2022-02-02T18:03:07.737 INFO:root:teuthology version: 1.1.0-0f634dc1 2022-02-02T18:03:07.739 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} --owner scheduled_pdonnell@teuthology --name pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi/6655627 -- /home/teuthworker/archive/pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi/6655627/orig.config.yaml 2022-02-02T18:03:07.796 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-02-02T18:03:07.868 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi/6655627 branch: wip-pdonnell-testing-20220202.154313 description: fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '6655627' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20220202.154313 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20220202.154313 sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 owner: scheduled_pdonnell@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-pdonnell-testing-20220202.154313 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 targets: smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9TLystJVEE2lsRZ3BBUyA2XziBcbJcDF7e3GuEGYKFMGgEC/qNsygL8y9e0HRViXvoARzgW0iNoerLf6qi4JnIY7ezBcBQrHwMVnUYe9IcNDgPx0RIreBNQBPA0iQIXW3O9UldzoWyYFVBGDX1mDgZ2ywe0ri+WuyY2OKq2baHl8idiaiQXe/gbwIQrk5eyo5DSv0ysHgIsUokTNKT4SvSIZ+u0aO66NKSJU+56/33TNpQkPCt2XLHEeYyLJTHoESngUEEDNlR77midJy9R5+IAHOLVirW0zMUSjAvpZ7NrbCvnG27cK3UXi8so919tocSDAJ8tZJn19L1LBC7dc0wHdg95nuamlF+9B0Z7Qsch6SMj1c8pfbH9F20a72VpmQQ8gyXLxKvDgXd2+uXOIh5lQYNCPl+aYzviO8Or8VUEtKkEFow32AGWJRg1H+s/O+VG35JZWA5Y8nAn7OVPPTv/9bqnac3XdP3d0ixZBgGKUphxDSnoXBUylEg1E/Yn8= smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0/Jz8ryArai7LxaVgKoUbuayZt78avmihOlNPrXDI6alZT9SKoYAH3Tw/C58DPvHRgoxbkDxjWh3TeR+3cj0w59HwLwo1Mg5297phByebBX+flr6RQGhcDFyUmEStucKANTBnHrfdV2eOU1tSR9dwWDwrwAg/iGT7OJMpd2qivUDra5BmbvfMUlLPneve5ZD3bONMgJAEYeZikAwr8R6WNsBSl5eM8N02E8zyMLaZDYFmUSX+mKat3yS0D+WMbeWGRXHi4NvBOKXnwJa3mpO9kwF8vp1UyysOsy9XwxC+Ub4PrY/BkMWdZfReBF2KpXiPAlmHD4rsioPs2q6PzjTGBOg+kEtoeqpU1heEhv5TM4CBywzizh7sBC0wyiz0zEcwRbrim4/QFO+W/aDX4uCBus3lHJacoLjinD2RosoXzs34KcagZMyI3sH9y25Auo4QgsPz2IKWlrQN1Z4S8i3Rz9b2XiCdS0q501ruVO/+UwQnULCbnINn/cCnQgXSR0s= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - ceph --format=json mds versions | jq -e ". | add == 4" - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology_branch: master teuthology_sha1: 0f634dc1c0a64a93646e6d007882c69b3e1663e0 timestamp: 2022-02-02_17:44:05 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20261 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2022-02-02T18:03:07.869 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa; will attempt to use it 2022-02-02T18:03:07.870 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks 2022-02-02T18:03:07.870 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-02-02T18:03:07.872 INFO:teuthology.task.internal:Checking packages... 2022-02-02T18:03:07.892 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '78571b80ad21c56cce214a3fbfb0b1a080f78167' 2022-02-02T18:03:07.892 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-02-02T18:03:07.893 INFO:teuthology.packaging:ref: None 2022-02-02T18:03:07.893 INFO:teuthology.packaging:tag: None 2022-02-02T18:03:07.893 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20220202.154313 2022-02-02T18:03:07.894 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:03:07.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20220202.154313 2022-02-02T18:03:08.107 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-10511.g78571b80 2022-02-02T18:03:08.108 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-02-02T18:03:08.116 INFO:teuthology.task.internal:no buildpackages task found 2022-02-02T18:03:08.116 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-02-02T18:03:08.158 INFO:teuthology.task.internal:Saving configuration 2022-02-02T18:03:08.178 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-02-02T18:03:08.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-02T18:03:08.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi/6655627', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-02-02 17:57:49.849188', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBELC6DfRResahnnHtDamWXrcXSgetgdCdFWaLdVwIQULebHfUci2MMQ4hI1NZMLd8be+xUZBL/p0m3YgynnuwcE='} 2022-02-02T18:03:08.259 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-02-02_17:44:05-fs:upgrade-wip-pdonnell-testing-20220202.154313-distro-default-smithi/6655627', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-02-02 17:57:49.847897', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFvUZaSKKRlhFiL+AH5hkA1pIapJyhD1LsEfaujM8YhYscxINpTqdI1SbPZXnxh8Wu0EwAKbdsaRsn+nUxfFgFM='} 2022-02-02T18:03:08.260 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-02-02T18:03:08.271 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2022-02-02T18:03:08.271 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2022-02-02T18:03:08.271 INFO:teuthology.run_tasks:Running task console_log... 2022-02-02T18:03:08.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa01e6c5c80>, signals=[15]) 2022-02-02T18:03:08.370 INFO:teuthology.run_tasks:Running task internal.connect... 2022-02-02T18:03:08.381 INFO:teuthology.task.internal:Opening connections... 2022-02-02T18:03:08.382 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:03:08.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:03:08.458 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2022-02-02T18:03:08.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:03:08.526 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-02-02T18:03:08.539 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2022-02-02T18:03:08.559 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2022-02-02T18:03:08.559 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2022-02-02T18:03:08.616 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2022-02-02T18:03:08.616 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2022-02-02T18:03:08.616 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2022-02-02T18:03:08.617 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2022-02-02T18:03:08.617 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2022-02-02T18:03:08.617 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2022-02-02T18:03:08.617 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-02T18:03:08.618 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2022-02-02T18:03:08.618 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-02T18:03:08.618 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2022-02-02T18:03:08.618 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-02T18:03:08.619 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-02T18:03:08.619 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-02T18:03:08.620 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2022-02-02T18:03:08.641 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2022-02-02T18:03:08.660 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2022-02-02T18:03:08.661 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2022-02-02T18:03:08.719 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2022-02-02T18:03:08.719 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2022-02-02T18:03:08.719 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2022-02-02T18:03:08.720 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2022-02-02T18:03:08.720 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2022-02-02T18:03:08.720 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2022-02-02T18:03:08.720 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-02T18:03:08.720 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2022-02-02T18:03:08.721 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-02T18:03:08.721 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2022-02-02T18:03:08.721 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-02T18:03:08.721 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-02T18:03:08.722 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-02T18:03:08.722 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2022-02-02T18:03:08.739 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-02-02T18:03:08.751 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-02-02T18:03:08.802 INFO:teuthology.task.internal:Checking for old test directory... 2022-02-02T18:03:08.803 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2022-02-02T18:03:08.806 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2022-02-02T18:03:08.823 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-02-02T18:03:08.834 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-02-02T18:03:08.835 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2022-02-02T18:03:08.863 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2022-02-02T18:03:08.892 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-02-02T18:03:08.950 INFO:teuthology.run_tasks:Running task kernel... 2022-02-02T18:03:08.968 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-02-02T18:03:08.969 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-02-02T18:03:08.969 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2022-02-02T18:03:08.970 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2022-02-02T18:03:08.989 INFO:teuthology.orchestra.run.smithi159.stdout:4.18.0-348.2.1.el8_5.x86_64 2022-02-02T18:03:08.989 INFO:teuthology.orchestra.run.smithi096.stdout:4.18.0-348.2.1.el8_5.x86_64 2022-02-02T18:03:08.989 INFO:teuthology.task.kernel:Running kernel on smithi159: 4.18.0-348.2.1.el8_5.x86_64 2022-02-02T18:03:08.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2022-02-02T18:03:08.990 INFO:teuthology.task.kernel:Running kernel on smithi096: 4.18.0-348.2.1.el8_5.x86_64 2022-02-02T18:03:08.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2022-02-02T18:03:10.017 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:03:10.018 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:03:10.062 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:03:10.063 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:03:11.739 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - AppStream 32 MB/s | 19 MB 00:00 2022-02-02T18:03:11.889 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - AppStream 28 MB/s | 19 MB 00:00 2022-02-02T18:03:15.639 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - Base 36 MB/s | 18 MB 00:00 2022-02-02T18:03:15.840 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - Base 31 MB/s | 18 MB 00:00 2022-02-02T18:03:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - Extras 131 kB/s | 17 kB 00:00 2022-02-02T18:03:18.572 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - Extras 140 kB/s | 17 kB 00:00 2022-02-02T18:03:18.723 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - PowerTools 16 MB/s | 4.0 MB 00:00 2022-02-02T18:03:18.925 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - PowerTools 17 MB/s | 4.0 MB 00:00 2022-02-02T18:03:22.239 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2022-02-02T18:03:22.240 INFO:teuthology.orchestra.run.smithi159.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2022-02-02T18:03:23.340 INFO:teuthology.orchestra.run.smithi096.stdout:Apache Arrow 190 kB/s | 184 kB 00:00 2022-02-02T18:03:23.433 INFO:teuthology.orchestra.run.smithi159.stdout:Apache Arrow 173 kB/s | 184 kB 00:01 2022-02-02T18:03:24.465 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:00 2022-02-02T18:03:25.483 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 11 MB 00:01 2022-02-02T18:03:27.165 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 386 kB/s | 24 kB 00:00 2022-02-02T18:03:28.167 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 462 kB/s | 24 kB 00:00 2022-02-02T18:03:29.695 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-4.18.0-348.2.1.el8_5.x86_64 is already installed. 2022-02-02T18:03:29.695 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2022-02-02T18:03:29.804 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:03:29.804 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:03:29.805 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:03:29.805 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:03:29.805 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:03:29.806 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 4.18.0-358.el8 CentOS-Base 7.5 M 2022-02-02T18:03:29.806 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:03:29.806 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 4.18.0-358.el8 CentOS-Base 38 M 2022-02-02T18:03:29.806 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 4.18.0-358.el8 CentOS-Base 31 M 2022-02-02T18:03:29.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:03:29.807 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:03:29.807 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:03:29.807 INFO:teuthology.orchestra.run.smithi096.stdout:Install 3 Packages 2022-02-02T18:03:29.807 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:03:29.808 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 77 M 2022-02-02T18:03:29.808 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 91 M 2022-02-02T18:03:29.809 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:03:30.033 INFO:teuthology.orchestra.run.smithi096.stdout:(1/3): kernel-4.18.0-358.el8.x86_64.rpm 33 MB/s | 7.5 MB 00:00 2022-02-02T18:03:30.730 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-4.18.0-348.2.1.el8_5.x86_64 is already installed. 2022-02-02T18:03:30.730 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2022-02-02T18:03:30.865 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:03:30.866 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:03:30.866 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:03:30.866 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:03:30.867 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:03:30.867 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 4.18.0-358.el8 CentOS-Base 7.5 M 2022-02-02T18:03:30.867 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:03:30.867 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 4.18.0-358.el8 CentOS-Base 38 M 2022-02-02T18:03:30.868 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 4.18.0-358.el8 CentOS-Base 31 M 2022-02-02T18:03:30.868 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:03:30.868 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:03:30.868 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:03:30.869 INFO:teuthology.orchestra.run.smithi159.stdout:Install 3 Packages 2022-02-02T18:03:30.869 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:03:30.869 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 77 M 2022-02-02T18:03:30.869 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 91 M 2022-02-02T18:03:30.870 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:03:30.883 INFO:teuthology.orchestra.run.smithi096.stdout:(2/3): kernel-core-4.18.0-358.el8.x86_64.rpm 36 MB/s | 38 MB 00:01 2022-02-02T18:03:31.193 INFO:teuthology.orchestra.run.smithi159.stdout:(1/3): kernel-4.18.0-358.el8.x86_64.rpm 23 MB/s | 7.5 MB 00:00 2022-02-02T18:03:31.233 INFO:teuthology.orchestra.run.smithi096.stdout:(3/3): kernel-modules-4.18.0-358.el8.x86_64.rpm 21 MB/s | 31 MB 00:01 2022-02-02T18:03:31.236 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:03:31.236 INFO:teuthology.orchestra.run.smithi096.stdout:Total 53 MB/s | 77 MB 00:01 2022-02-02T18:03:31.807 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:03:31.935 INFO:teuthology.orchestra.run.smithi159.stdout:(2/3): kernel-core-4.18.0-358.el8.x86_64.rpm 36 MB/s | 38 MB 00:01 2022-02-02T18:03:32.166 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:03:32.167 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:03:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:(3/3): kernel-modules-4.18.0-358.el8.x86_64.rpm 20 MB/s | 31 MB 00:01 2022-02-02T18:03:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:03:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:Total 51 MB/s | 77 MB 00:01 2022-02-02T18:03:32.939 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:03:33.301 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:03:33.302 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:03:33.451 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:03:33.466 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:03:34.572 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:03:34.583 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:03:35.928 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:03:36.444 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:03:37.048 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:03:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:03:40.187 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:03:40.535 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:03:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:03:41.615 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:03:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:03:43.864 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:03:44.727 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:03:44.945 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:05.114 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:04:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:04:05.898 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:05.898 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:04:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:04:05.899 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-4.18.0-358.el8.x86_64 kernel-core-4.18.0-358.el8.x86_64 2022-02-02T18:04:05.899 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-4.18.0-358.el8.x86_64 2022-02-02T18:04:05.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:04:05.899 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:04:06.028 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel --last | head -n 1 2022-02-02T18:04:06.190 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 06:03:43 PM UTC 2022-02-02T18:04:06.191 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T18:04:06.191 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-348.2.1.el8_5.x86_64 Expected: 4.18.0-358.el8.x86_64 2022-02-02T18:04:06.192 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-02-02T18:04:06.192 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-02-02T18:04:06.192 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2022-02-02T18:04:06.193 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2022-02-02T18:04:06.193 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel --last | head -n 1 2022-02-02T18:04:06.345 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 06:03:43 PM UTC 2022-02-02T18:04:06.346 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T18:04:06.346 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2022-02-02T18:04:06.379 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2022-02-02T18:04:06.380 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2022-02-02T18:04:06.380 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.02 2022-02-02T18:04:06.380 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 106.el8 2022-02-02T18:04:06.381 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2022-02-02T18:04:06.381 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Thu 02 Dec 2021 10:09:41 PM UTC 2022-02-02T18:04:06.381 INFO:teuthology.orchestra.run.smithi096.stdout:Group : System Environment/Base 2022-02-02T18:04:06.381 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 9265339 2022-02-02T18:04:06.382 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2022-02-02T18:04:06.382 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-02-02T18:04:06.382 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-02-02T18:04:06.382 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-02-02T18:04:06.383 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : kbuilder.bsys.centos.org 2022-02-02T18:04:06.383 INFO:teuthology.orchestra.run.smithi096.stdout:Relocations : (not relocatable) 2022-02-02T18:04:06.383 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : CentOS BuildSystem 2022-02-02T18:04:06.383 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2022-02-02T18:04:06.383 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2022-02-02T18:04:06.384 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2022-02-02T18:04:06.384 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2022-02-02T18:04:06.384 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:04:06.384 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-02-02T18:04:06.385 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2022-02-02T18:04:06.385 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2022-02-02T18:04:06.385 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2022-02-02T18:04:06.385 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:04:06.385 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2022-02-02T18:04:06.387 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-02-02T18:04:06.387 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 4.18.0-358.el8.x86_64 2022-02-02T18:04:06.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-02-02T18:04:06.536 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:06.865 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:06.865 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-4.18.0-358.el8.x86_64 1/3 2022-02-02T18:04:06.866 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-4.18.0-358.el8.x86_64 2/3 2022-02-02T18:04:07.703 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-4.18.0-358.el8.x86_64 3/3 2022-02-02T18:04:07.703 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:04:07.703 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:04:07.704 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-4.18.0-358.el8.x86_64 kernel-core-4.18.0-358.el8.x86_64 2022-02-02T18:04:07.704 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-4.18.0-358.el8.x86_64 2022-02-02T18:04:07.704 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:04:07.704 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:04:07.826 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel --last | head -n 1 2022-02-02T18:04:07.986 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 06:03:44 PM UTC 2022-02-02T18:04:07.988 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T18:04:07.988 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-348.2.1.el8_5.x86_64 Expected: 4.18.0-358.el8.x86_64 2022-02-02T18:04:07.988 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-02-02T18:04:07.989 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-02-02T18:04:07.989 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2022-02-02T18:04:07.989 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2022-02-02T18:04:07.989 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel --last | head -n 1 2022-02-02T18:04:08.114 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2022-02-02T18:04:08.143 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 06:03:44 PM UTC 2022-02-02T18:04:08.144 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T18:04:08.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2022-02-02T18:04:08.177 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2022-02-02T18:04:08.178 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2022-02-02T18:04:08.178 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.02 2022-02-02T18:04:08.178 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 106.el8 2022-02-02T18:04:08.179 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2022-02-02T18:04:08.179 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Thu 02 Dec 2021 10:09:41 PM UTC 2022-02-02T18:04:08.179 INFO:teuthology.orchestra.run.smithi159.stdout:Group : System Environment/Base 2022-02-02T18:04:08.179 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 9265339 2022-02-02T18:04:08.180 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2022-02-02T18:04:08.180 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-02-02T18:04:08.180 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-02-02T18:04:08.180 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-02-02T18:04:08.181 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : kbuilder.bsys.centos.org 2022-02-02T18:04:08.181 INFO:teuthology.orchestra.run.smithi159.stdout:Relocations : (not relocatable) 2022-02-02T18:04:08.181 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : CentOS BuildSystem 2022-02-02T18:04:08.181 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2022-02-02T18:04:08.182 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2022-02-02T18:04:08.182 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2022-02-02T18:04:08.182 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2022-02-02T18:04:08.183 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:04:08.183 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-02-02T18:04:08.183 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2022-02-02T18:04:08.183 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2022-02-02T18:04:08.184 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2022-02-02T18:04:08.184 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:04:08.184 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2022-02-02T18:04:08.185 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-02-02T18:04:08.185 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 4.18.0-358.el8.x86_64 2022-02-02T18:04:08.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-02-02T18:04:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2022-02-02T18:04:10.391 INFO:teuthology.orchestra.run.smithi096.stderr:done 2022-02-02T18:04:10.393 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2022-02-02T18:04:10.425 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.y7ytd8G2ae 2022-02-02T18:04:10.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.y7ytd8G2ae 2022-02-02T18:04:10.513 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.y7ytd8G2ae 2022-02-02T18:04:10.642 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.y7ytd8G2ae is 6KB 2022-02-02T18:04:10.693 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.y7ytd8G2ae 2022-02-02T18:04:10.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2022-02-02T18:04:10.792 INFO:teuthology.orchestra.run.smithi096.stdout:54c8b3f95a884696922d0d687e6bf68d-0-rescue.conf 2022-02-02T18:04:10.793 INFO:teuthology.orchestra.run.smithi096.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-240.el8.x86_64.conf 2022-02-02T18:04:10.793 INFO:teuthology.orchestra.run.smithi096.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-348.2.1.el8_5.x86_64.conf 2022-02-02T18:04:10.793 INFO:teuthology.orchestra.run.smithi096.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64.conf 2022-02-02T18:04:10.795 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64 2022-02-02T18:04:10.898 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2022-02-02T18:04:11.518 INFO:teuthology.orchestra.run.smithi159.stderr:done 2022-02-02T18:04:11.520 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2022-02-02T18:04:11.541 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.Utq7tSYFuI 2022-02-02T18:04:11.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Utq7tSYFuI 2022-02-02T18:04:11.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.Utq7tSYFuI 2022-02-02T18:04:11.774 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.Utq7tSYFuI is 6KB 2022-02-02T18:04:11.822 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.Utq7tSYFuI 2022-02-02T18:04:11.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2022-02-02T18:04:11.906 INFO:teuthology.orchestra.run.smithi159.stdout:54c8b3f95a884696922d0d687e6bf68d-0-rescue.conf 2022-02-02T18:04:11.906 INFO:teuthology.orchestra.run.smithi159.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-240.el8.x86_64.conf 2022-02-02T18:04:11.906 INFO:teuthology.orchestra.run.smithi159.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-348.2.1.el8_5.x86_64.conf 2022-02-02T18:04:11.907 INFO:teuthology.orchestra.run.smithi159.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64.conf 2022-02-02T18:04:11.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64 2022-02-02T18:04:12.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2022-02-02T18:04:40.927 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2022-02-02T18:04:40.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-02-02T18:04:40.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:04:42.074 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2022-02-02T18:04:42.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2022-02-02T18:04:42.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:05:16.623 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2022-02-02T18:05:40.955 DEBUG:teuthology.orchestra.remote:timed out 2022-02-02T18:05:46.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2022-02-02T18:05:46.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:06:02.306 DEBUG:teuthology.orchestra.run.smithi159:> true 2022-02-02T18:06:02.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2022-02-02T18:06:02.667 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-358.el8.x86_64"... 2022-02-02T18:06:02.668 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2022-02-02T18:06:02.684 INFO:teuthology.orchestra.run.smithi159.stdout:4.18.0-358.el8.x86_64 2022-02-02T18:06:02.684 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-358.el8.x86_64 vs 4.18.0-358.el8.x86_64 2022-02-02T18:06:02.685 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-02-02T18:06:02.685 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-02-02T18:06:03.686 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2022-02-02T18:06:03.686 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-02-02T18:06:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2022-02-02T18:06:03.834 DEBUG:teuthology.parallel:result is None 2022-02-02T18:06:10.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-02-02T18:06:10.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:06:11.405 DEBUG:teuthology.orchestra.run.smithi096:> true 2022-02-02T18:06:11.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-02-02T18:06:11.704 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-358.el8.x86_64"... 2022-02-02T18:06:11.705 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2022-02-02T18:06:11.721 INFO:teuthology.orchestra.run.smithi096.stdout:4.18.0-358.el8.x86_64 2022-02-02T18:06:11.722 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-358.el8.x86_64 vs 4.18.0-358.el8.x86_64 2022-02-02T18:06:11.722 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-02-02T18:06:11.723 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-02-02T18:06:12.723 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2022-02-02T18:06:12.724 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-02-02T18:06:12.811 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2022-02-02T18:06:12.829 DEBUG:teuthology.parallel:result is None 2022-02-02T18:06:12.829 INFO:teuthology.run_tasks:Running task internal.base... 2022-02-02T18:06:12.838 INFO:teuthology.task.internal:Creating test directory... 2022-02-02T18:06:12.839 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-02-02T18:06:12.842 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-02-02T18:06:12.863 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-02-02T18:06:12.884 INFO:teuthology.run_tasks:Running task internal.archive... 2022-02-02T18:06:12.902 INFO:teuthology.task.internal:Creating archive directory... 2022-02-02T18:06:12.903 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-02-02T18:06:12.906 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-02-02T18:06:12.957 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-02-02T18:06:12.966 INFO:teuthology.task.internal:Enabling coredump saving... 2022-02-02T18:06:12.966 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-02-02T18:06:12.971 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-02-02T18:06:13.001 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T18:06:13.012 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T18:06:13.014 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T18:06:13.027 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T18:06:13.028 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-02-02T18:06:13.037 INFO:teuthology.task.internal:Configuring sudo... 2022-02-02T18:06:13.038 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-02-02T18:06:13.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-02-02T18:06:13.098 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-02-02T18:06:13.108 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-02-02T18:06:13.108 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-02-02T18:06:13.125 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-02-02T18:06:13.155 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T18:06:13.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T18:06:13.275 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T18:06:13.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T18:06:13.399 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:06:13.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-02-02T18:06:13.464 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T18:06:13.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T18:06:13.565 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T18:06:13.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T18:06:13.693 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:06:13.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-02-02T18:06:13.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2022-02-02T18:06:13.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2022-02-02T18:06:13.827 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-02-02T18:06:13.875 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-02-02T18:06:14.287 INFO:teuthology.run_tasks:Running task internal.timer... 2022-02-02T18:06:14.301 INFO:teuthology.task.internal:Starting timer... 2022-02-02T18:06:14.301 INFO:teuthology.run_tasks:Running task pcp... 2022-02-02T18:06:14.360 INFO:teuthology.run_tasks:Running task selinux... 2022-02-02T18:06:14.378 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-02-02T18:06:14.379 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2022-02-02T18:06:14.435 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: [ OK ] 2022-02-02T18:06:14.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2022-02-02T18:06:14.516 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: [ OK ] 2022-02-02T18:06:14.518 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-02-02T18:06:14.518 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2022-02-02T18:06:14.544 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2022-02-02T18:06:14.544 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2022-02-02T18:06:14.580 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2022-02-02T18:06:14.580 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2022-02-02T18:06:14.581 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-02-02T18:06:14.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T18:06:14.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-02-02T18:06:14.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T18:06:14.647 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-02-02T18:06:14.647 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2022-02-02T18:06:14.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2022-02-02T18:06:14.726 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-02-02T18:06:14.738 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2022-02-02T18:06:14.739 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-02-02T18:11:07.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-02-02T18:11:07.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:11:07.642 DEBUG:teuthology.orchestra.run.smithi096:> true 2022-02-02T18:11:07.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2022-02-02T18:11:07.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T18:11:07.785 DEBUG:teuthology.orchestra.run.smithi159:> true 2022-02-02T18:11:07.854 INFO:teuthology.run_tasks:Running task clock... 2022-02-02T18:11:07.868 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-02-02T18:11:07.868 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-02-02T18:11:07.871 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-02-02T18:11:07.874 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-02-02T18:11:07.874 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-02-02T18:11:07.903 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-02-02T18:11:07.917 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-02-02T18:11:07.925 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-02-02T18:11:07.939 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-02-02T18:11:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2022-02-02T18:11:08.003 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2022-02-02T18:11:08.016 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2022-02-02T18:11:08.017 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-02-02T18:11:08.027 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2022-02-02T18:11:08.030 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-02-02T18:11:08.041 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-02-02T18:11:08.055 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-02-02T18:11:08.107 INFO:teuthology.orchestra.run.smithi096.stderr:bash: ntpq: command not found 2022-02-02T18:11:08.111 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-02-02T18:11:08.111 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2022-02-02T18:11:08.111 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.112 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.112 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.112 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.119 INFO:teuthology.orchestra.run.smithi159.stderr:bash: ntpq: command not found 2022-02-02T18:11:08.123 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-02-02T18:11:08.123 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2022-02-02T18:11:08.123 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.124 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.124 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.124 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T18:11:08.125 INFO:teuthology.run_tasks:Running task pexec... 2022-02-02T18:11:08.137 INFO:teuthology.task.pexec:Executing custom commands... 2022-02-02T18:11:08.138 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:11:08.138 DEBUG:teuthology.orchestra.run.smithi096:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T18:11:08.139 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi159.front.sepia.ceph.com 2022-02-02T18:11:08.139 DEBUG:teuthology.orchestra.run.smithi159:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T18:11:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:08.371 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:08.383 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:08.384 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:08.745 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 06:09:52 PM UTC. 2022-02-02T18:11:08.760 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 06:09:52 PM UTC. 2022-02-02T18:11:09.718 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:11:09.719 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:09.719 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:11:09.720 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:09.720 INFO:teuthology.orchestra.run.smithi159.stdout:Resetting modules: 2022-02-02T18:11:09.720 INFO:teuthology.orchestra.run.smithi159.stdout: container-tools 2022-02-02T18:11:09.720 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:09.721 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:11:09.721 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:09.721 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:09.743 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:11:09.744 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:09.744 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:11:09.744 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:09.744 INFO:teuthology.orchestra.run.smithi096.stdout:Resetting modules: 2022-02-02T18:11:09.745 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools 2022-02-02T18:11:09.745 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:09.745 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:11:09.745 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:09.746 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:09.939 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:11:09.965 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:11:10.215 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:10.215 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:10.220 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:10.221 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:10.589 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:18 ago on Wed 02 Feb 2022 06:09:52 PM UTC. 2022-02-02T18:11:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:18 ago on Wed 02 Feb 2022 06:09:52 PM UTC. 2022-02-02T18:11:11.563 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:11:11.564 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2022-02-02T18:11:11.564 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:11:11.565 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2022-02-02T18:11:11.565 INFO:teuthology.orchestra.run.smithi096.stdout:Installing group/module packages: 2022-02-02T18:11:11.565 INFO:teuthology.orchestra.run.smithi096.stdout: buildah x86_64 1:1.23.1-2.module_el8.6.0+954+963caf36 CentOS-AppStream 7.9 M 2022-02-02T18:11:11.565 INFO:teuthology.orchestra.run.smithi096.stdout: cockpit-podman noarch 35-1.module_el8.6.0+944+d413f95e CentOS-AppStream 457 k 2022-02-02T18:11:11.565 INFO:teuthology.orchestra.run.smithi096.stdout: crun x86_64 1.2-1.module_el8.6.0+954+963caf36 CentOS-AppStream 193 k 2022-02-02T18:11:11.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-podman noarch 3.2.1-4.module_el8.6.0+954+963caf36 CentOS-AppStream 148 k 2022-02-02T18:11:11.566 INFO:teuthology.orchestra.run.smithi096.stdout: skopeo x86_64 2:1.5.0-2.module_el8.6.0+954+963caf36 CentOS-AppStream 6.7 M 2022-02-02T18:11:11.570 INFO:teuthology.orchestra.run.smithi096.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-02-02T18:11:11.571 INFO:teuthology.orchestra.run.smithi096.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-02-02T18:11:11.571 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:11:11.571 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-02-02T18:11:11.571 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-02-02T18:11:11.572 INFO:teuthology.orchestra.run.smithi096.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-02-02T18:11:11.572 INFO:teuthology.orchestra.run.smithi096.stdout:Installing module profiles: 2022-02-02T18:11:11.572 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools/common 2022-02-02T18:11:11.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:11.573 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling module streams: 2022-02-02T18:11:11.573 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools rhel8 2022-02-02T18:11:11.573 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:11.573 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:11:11.574 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2022-02-02T18:11:11.574 INFO:teuthology.orchestra.run.smithi096.stdout:Install 10 Packages 2022-02-02T18:11:11.574 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:11.575 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 18 M 2022-02-02T18:11:11.575 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 64 M 2022-02-02T18:11:11.575 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:11:11.598 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:11:11.599 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================== 2022-02-02T18:11:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:11:11.600 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================== 2022-02-02T18:11:11.600 INFO:teuthology.orchestra.run.smithi159.stdout:Installing group/module packages: 2022-02-02T18:11:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: buildah x86_64 1:1.23.1-2.module_el8.6.0+954+963caf36 CentOS-AppStream 7.9 M 2022-02-02T18:11:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: cockpit-podman noarch 35-1.module_el8.6.0+944+d413f95e CentOS-AppStream 457 k 2022-02-02T18:11:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: crun x86_64 1.2-1.module_el8.6.0+954+963caf36 CentOS-AppStream 193 k 2022-02-02T18:11:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: python3-podman noarch 3.2.1-4.module_el8.6.0+954+963caf36 CentOS-AppStream 148 k 2022-02-02T18:11:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: skopeo x86_64 2:1.5.0-2.module_el8.6.0+954+963caf36 CentOS-AppStream 6.7 M 2022-02-02T18:11:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-02-02T18:11:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-02-02T18:11:11.602 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:11:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-02-02T18:11:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-02-02T18:11:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-02-02T18:11:11.603 INFO:teuthology.orchestra.run.smithi159.stdout:Installing module profiles: 2022-02-02T18:11:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: container-tools/common 2022-02-02T18:11:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:11.604 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling module streams: 2022-02-02T18:11:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: container-tools rhel8 2022-02-02T18:11:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:11.604 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:11:11.604 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================== 2022-02-02T18:11:11.605 INFO:teuthology.orchestra.run.smithi159.stdout:Install 10 Packages 2022-02-02T18:11:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:11.605 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 18 M 2022-02-02T18:11:11.606 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 64 M 2022-02-02T18:11:11.606 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:11:11.636 INFO:teuthology.orchestra.run.smithi096.stdout:(1/10): cockpit-podman-35-1.module_el8.6.0+944+ 6.5 MB/s | 457 kB 00:00 2022-02-02T18:11:11.661 INFO:teuthology.orchestra.run.smithi096.stdout:(2/10): crun-1.2-1.module_el8.6.0+954+963caf36. 2.0 MB/s | 193 kB 00:00 2022-02-02T18:11:11.686 INFO:teuthology.orchestra.run.smithi096.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 991 kB/s | 25 kB 00:00 2022-02-02T18:11:11.691 INFO:teuthology.orchestra.run.smithi159.stdout:(1/10): cockpit-podman-35-1.module_el8.6.0+944+ 5.0 MB/s | 457 kB 00:00 2022-02-02T18:11:11.708 INFO:teuthology.orchestra.run.smithi159.stdout:(2/10): python3-podman-3.2.1-4.module_el8.6.0+9 8.8 MB/s | 148 kB 00:00 2022-02-02T18:11:11.711 INFO:teuthology.orchestra.run.smithi096.stdout:(4/10): python3-podman-3.2.1-4.module_el8.6.0+9 1.9 MB/s | 148 kB 00:00 2022-02-02T18:11:11.734 INFO:teuthology.orchestra.run.smithi159.stdout:(3/10): crun-1.2-1.module_el8.6.0+954+963caf36. 1.4 MB/s | 193 kB 00:00 2022-02-02T18:11:11.759 INFO:teuthology.orchestra.run.smithi159.stdout:(4/10): python3-pytoml-0.1.14-5.git7dea353.el8. 492 kB/s | 25 kB 00:00 2022-02-02T18:11:11.760 INFO:teuthology.orchestra.run.smithi096.stdout:(5/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2022-02-02T18:11:11.784 INFO:teuthology.orchestra.run.smithi159.stdout:(5/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2022-02-02T18:11:12.026 INFO:teuthology.orchestra.run.smithi159.stdout:(6/10): toolbox-0.0.99.3-1.module_el8.5.0+877+1 9.3 MB/s | 2.3 MB 00:00 2022-02-02T18:11:12.070 INFO:teuthology.orchestra.run.smithi159.stdout:(7/10): udica-0.2.6-2.module_el8.6.0+944+d413f9 1.1 MB/s | 48 kB 00:00 2022-02-02T18:11:12.087 INFO:teuthology.orchestra.run.smithi096.stdout:(6/10): buildah-1.23.1-2.module_el8.6.0+954+963 15 MB/s | 7.9 MB 00:00 2022-02-02T18:11:12.102 INFO:teuthology.orchestra.run.smithi159.stdout:(8/10): yajl-2.1.0-10.el8.x86_64.rpm 1.3 MB/s | 41 kB 00:00 2022-02-02T18:11:12.137 INFO:teuthology.orchestra.run.smithi096.stdout:(7/10): toolbox-0.0.99.3-1.module_el8.5.0+877+1 6.0 MB/s | 2.3 MB 00:00 2022-02-02T18:11:12.163 INFO:teuthology.orchestra.run.smithi096.stdout:(8/10): udica-0.2.6-2.module_el8.6.0+944+d413f9 646 kB/s | 48 kB 00:00 2022-02-02T18:11:12.187 INFO:teuthology.orchestra.run.smithi096.stdout:(9/10): yajl-2.1.0-10.el8.x86_64.rpm 818 kB/s | 41 kB 00:00 2022-02-02T18:11:12.260 INFO:teuthology.orchestra.run.smithi159.stdout:(9/10): buildah-1.23.1-2.module_el8.6.0+954+963 12 MB/s | 7.9 MB 00:00 2022-02-02T18:11:12.296 INFO:teuthology.orchestra.run.smithi096.stdout:(10/10): skopeo-1.5.0-2.module_el8.6.0+954+963c 12 MB/s | 6.7 MB 00:00 2022-02-02T18:11:12.298 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:11:12.299 INFO:teuthology.orchestra.run.smithi096.stdout:Total 24 MB/s | 18 MB 00:00 2022-02-02T18:11:12.377 INFO:teuthology.orchestra.run.smithi159.stdout:(10/10): skopeo-1.5.0-2.module_el8.6.0+954+963c 11 MB/s | 6.7 MB 00:00 2022-02-02T18:11:12.380 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:11:12.380 INFO:teuthology.orchestra.run.smithi159.stdout:Total 23 MB/s | 18 MB 00:00 2022-02-02T18:11:12.495 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:11:12.512 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:11:12.513 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:11:12.577 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:11:12.594 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:11:12.595 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:11:12.709 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:11:12.712 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:11:12.792 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:11:12.795 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:11:13.181 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:11:13.302 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:11:13.555 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : yajl-2.1.0-10.el8.x86_64 1/10 2022-02-02T18:11:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : yajl-2.1.0-10.el8.x86_64 1/10 2022-02-02T18:11:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/10 2022-02-02T18:11:13.624 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/10 2022-02-02T18:11:13.739 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2022-02-02T18:11:13.839 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2022-02-02T18:11:13.916 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T18:11:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T18:11:14.078 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 5/10 2022-02-02T18:11:14.136 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 5/10 2022-02-02T18:11:14.422 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 6/10 2022-02-02T18:11:14.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 6/10 2022-02-02T18:11:15.178 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 7/10 2022-02-02T18:11:15.284 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 7/10 2022-02-02T18:11:15.355 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 8/10 2022-02-02T18:11:15.455 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 8/10 2022-02-02T18:11:16.140 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 9/10 2022-02-02T18:11:16.273 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 9/10 2022-02-02T18:11:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T18:11:16.450 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T18:11:16.575 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T18:11:16.575 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 1/10 2022-02-02T18:11:16.575 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 2/10 2022-02-02T18:11:16.576 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 3/10 2022-02-02T18:11:16.576 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T18:11:16.576 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/10 2022-02-02T18:11:16.576 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/10 2022-02-02T18:11:16.576 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 7/10 2022-02-02T18:11:16.577 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/10 2022-02-02T18:11:16.577 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/10 2022-02-02T18:11:16.762 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T18:11:16.762 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 1/10 2022-02-02T18:11:16.762 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 2/10 2022-02-02T18:11:16.762 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 3/10 2022-02-02T18:11:16.763 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T18:11:16.763 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/10 2022-02-02T18:11:16.763 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/10 2022-02-02T18:11:16.763 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 7/10 2022-02-02T18:11:16.764 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/10 2022-02-02T18:11:16.764 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/10 2022-02-02T18:11:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/10 2022-02-02T18:11:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:17.046 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:11:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: cockpit-podman-35-1.module_el8.6.0+944+d413f95e.noarch 2022-02-02T18:11:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: python3-podman-3.2.1-4.module_el8.6.0+954+963caf36.noarch 2022-02-02T18:11:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-02-02T18:11:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-02-02T18:11:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-02-02T18:11:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-02-02T18:11:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: yajl-2.1.0-10.el8.x86_64 2022-02-02T18:11:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:17.049 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:11:17.252 DEBUG:teuthology.parallel:result is None 2022-02-02T18:11:17.322 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/10 2022-02-02T18:11:17.322 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:11:17.323 INFO:teuthology.orchestra.run.smithi159.stdout: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.323 INFO:teuthology.orchestra.run.smithi159.stdout: cockpit-podman-35-1.module_el8.6.0+944+d413f95e.noarch 2022-02-02T18:11:17.323 INFO:teuthology.orchestra.run.smithi159.stdout: crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.323 INFO:teuthology.orchestra.run.smithi159.stdout: python3-podman-3.2.1-4.module_el8.6.0+954+963caf36.noarch 2022-02-02T18:11:17.324 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-02-02T18:11:17.324 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-02-02T18:11:17.324 INFO:teuthology.orchestra.run.smithi159.stdout: skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T18:11:17.325 INFO:teuthology.orchestra.run.smithi159.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-02-02T18:11:17.325 INFO:teuthology.orchestra.run.smithi159.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-02-02T18:11:17.325 INFO:teuthology.orchestra.run.smithi159.stdout: yajl-2.1.0-10.el8.x86_64 2022-02-02T18:11:17.325 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:11:17.513 DEBUG:teuthology.parallel:result is None 2022-02-02T18:11:17.513 INFO:teuthology.run_tasks:Running task pexec... 2022-02-02T18:11:17.524 INFO:teuthology.task.pexec:Executing custom commands... 2022-02-02T18:11:17.525 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:11:17.525 DEBUG:teuthology.orchestra.run.smithi096:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T18:11:17.526 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi159.front.sepia.ceph.com 2022-02-02T18:11:17.526 DEBUG:teuthology.orchestra.run.smithi159:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T18:11:17.714 DEBUG:teuthology.parallel:result is None 2022-02-02T18:11:17.719 DEBUG:teuthology.parallel:result is None 2022-02-02T18:11:17.720 INFO:teuthology.run_tasks:Running task install... 2022-02-02T18:11:17.734 DEBUG:teuthology.task.install:project ceph 2022-02-02T18:11:17.734 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '78571b80ad21c56cce214a3fbfb0b1a080f78167'}} 2022-02-02T18:11:17.735 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': '78571b80ad21c56cce214a3fbfb0b1a080f78167'} 2022-02-02T18:11:17.735 INFO:teuthology.task.install:Using flavor: default 2022-02-02T18:11:17.742 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-02-02T18:11:17.742 INFO:teuthology.task.install:extra packages: [] 2022-02-02T18:11:17.743 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2022-02-02T18:11:17.777 INFO:teuthology.orchestra.run.smithi096.stdout:CentOSStream 2022-02-02T18:11:17.778 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:11:17.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-02-02T18:11:17.779 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '78571b80ad21c56cce214a3fbfb0b1a080f78167', 'tag': 'v16.2.4', 'wait_for_package': False} 2022-02-02T18:11:17.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2022-02-02T18:11:17.814 INFO:teuthology.orchestra.run.smithi159.stdout:CentOSStream 2022-02-02T18:11:17.815 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:11:17.816 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '78571b80ad21c56cce214a3fbfb0b1a080f78167', 'tag': 'v16.2.4', 'wait_for_package': False} 2022-02-02T18:11:17.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-02-02T18:11:17.851 INFO:teuthology.orchestra.run.smithi096.stdout:CentOSStream 2022-02-02T18:11:17.852 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:11:17.853 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:11:17.853 INFO:teuthology.packaging:ref: None 2022-02-02T18:11:17.854 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:11:17.854 INFO:teuthology.packaging:branch: None 2022-02-02T18:11:17.855 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:11:17.886 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:11:17.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:11:17.926 INFO:teuthology.orchestra.run.smithi159.stdout:CentOSStream 2022-02-02T18:11:17.927 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:11:17.928 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:11:17.928 INFO:teuthology.packaging:ref: None 2022-02-02T18:11:17.928 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:11:17.929 INFO:teuthology.packaging:branch: None 2022-02-02T18:11:17.929 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:11:17.958 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:11:17.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:11:18.128 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2022-02-02T18:11:18.129 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2022-02-02T18:11:18.163 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2022-02-02T18:11:18.164 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2022-02-02T18:11:18.179 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-02-02T18:11:18.180 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:11:18.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-02-02T18:11:18.199 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-02-02T18:11:18.199 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:11:18.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-02-02T18:11:18.210 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-02-02T18:11:18.210 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:11:18.211 INFO:teuthology.packaging:ref: None 2022-02-02T18:11:18.211 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:11:18.211 INFO:teuthology.packaging:branch: None 2022-02-02T18:11:18.212 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:11:18.212 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-02-02T18:11:18.226 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-02-02T18:11:18.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:11:18.226 INFO:teuthology.packaging:ref: None 2022-02-02T18:11:18.227 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:11:18.227 INFO:teuthology.packaging:branch: None 2022-02-02T18:11:18.227 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:11:18.228 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-02-02T18:11:18.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-02-02T18:11:18.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-02-02T18:11:18.358 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-02-02T18:11:18.369 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-02-02T18:11:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2022-02-02T18:11:18.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2022-02-02T18:11:18.434 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2022-02-02T18:11:18.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2022-02-02T18:11:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.651 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.652 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.658 INFO:teuthology.orchestra.run.smithi096.stdout:76 files removed 2022-02-02T18:11:18.667 INFO:teuthology.orchestra.run.smithi159.stdout:76 files removed 2022-02-02T18:11:18.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw 2022-02-02T18:11:18.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw 2022-02-02T18:11:18.853 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.863 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:18.864 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:11:19.101 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 933 kB/s | 74 kB 00:00 2022-02-02T18:11:19.130 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 782 kB/s | 74 kB 00:00 2022-02-02T18:11:19.210 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 204 kB/s | 15 kB 00:00 2022-02-02T18:11:19.247 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 182 kB/s | 15 kB 00:00 2022-02-02T18:11:19.328 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 19 kB/s | 1.7 kB 00:00 2022-02-02T18:11:19.365 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 19 kB/s | 1.7 kB 00:00 2022-02-02T18:11:19.847 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - AppStream 39 MB/s | 19 MB 00:00 2022-02-02T18:11:19.984 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - AppStream 32 MB/s | 19 MB 00:00 2022-02-02T18:11:23.622 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - Base 42 MB/s | 18 MB 00:00 2022-02-02T18:11:23.867 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - Base 35 MB/s | 18 MB 00:00 2022-02-02T18:11:26.337 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - Extras 151 kB/s | 17 kB 00:00 2022-02-02T18:11:26.584 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - Extras 112 kB/s | 17 kB 00:00 2022-02-02T18:11:26.681 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-8 - PowerTools 17 MB/s | 4.0 MB 00:00 2022-02-02T18:11:26.927 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-8 - PowerTools 17 MB/s | 4.0 MB 00:00 2022-02-02T18:11:29.964 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2022-02-02T18:11:29.976 INFO:teuthology.orchestra.run.smithi159.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-02-02T18:11:31.315 INFO:teuthology.orchestra.run.smithi096.stdout:Apache Arrow 150 kB/s | 184 kB 00:01 2022-02-02T18:11:31.744 INFO:teuthology.orchestra.run.smithi159.stdout:Apache Arrow 112 kB/s | 184 kB 00:01 2022-02-02T18:11:33.565 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 11 MB 00:02 2022-02-02T18:11:34.802 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 11 MB 00:02 2022-02-02T18:11:36.248 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 453 kB/s | 24 kB 00:00 2022-02-02T18:11:37.494 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 271 kB/s | 24 kB 00:00 2022-02-02T18:11:38.950 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:11:38.953 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:38.953 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:11:38.953 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:38.953 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:11:38.953 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2022-02-02T18:11:38.954 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2022-02-02T18:11:38.954 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T18:11:38.954 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2022-02-02T18:11:38.954 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:11:38.955 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2022-02-02T18:11:38.955 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2022-02-02T18:11:38.955 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2022-02-02T18:11:38.955 INFO:teuthology.orchestra.run.smithi096.stdout: daxctl-libs x86_64 71.1-3.el8 CentOS-Base 42 k 2022-02-02T18:11:38.955 INFO:teuthology.orchestra.run.smithi096.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-02-02T18:11:38.956 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-02-02T18:11:38.956 INFO:teuthology.orchestra.run.smithi096.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-02-02T18:11:38.956 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2022-02-02T18:11:38.956 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-02-02T18:11:38.957 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2022-02-02T18:11:38.957 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-02-02T18:11:38.957 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2022-02-02T18:11:38.957 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-02-02T18:11:38.957 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2022-02-02T18:11:38.958 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-02-02T18:11:38.958 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-02-02T18:11:38.958 INFO:teuthology.orchestra.run.smithi096.stdout: ndctl-libs x86_64 71.1-3.el8 CentOS-Base 79 k 2022-02-02T18:11:38.958 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2022-02-02T18:11:38.958 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2022-02-02T18:11:38.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2022-02-02T18:11:38.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-02-02T18:11:38.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2022-02-02T18:11:38.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2022-02-02T18:11:38.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2022-02-02T18:11:38.960 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:38.960 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:11:38.960 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:11:38.961 INFO:teuthology.orchestra.run.smithi096.stdout:Install 25 Packages 2022-02-02T18:11:38.961 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 2 Packages 2022-02-02T18:11:38.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:11:38.962 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 59 M 2022-02-02T18:11:38.962 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:11:39.249 INFO:teuthology.orchestra.run.smithi096.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 21 MB/s | 6.0 MB 00:00 2022-02-02T18:11:39.308 INFO:teuthology.orchestra.run.smithi096.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 425 kB/s | 25 kB 00:00 2022-02-02T18:11:39.358 INFO:teuthology.orchestra.run.smithi096.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 16 MB/s | 801 kB 00:00 2022-02-02T18:11:39.408 INFO:teuthology.orchestra.run.smithi096.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 9.5 MB/s | 486 kB 00:00 2022-02-02T18:11:39.642 INFO:teuthology.orchestra.run.smithi096.stdout:(5/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 19 MB/s | 13 MB 00:00 2022-02-02T18:11:39.667 INFO:teuthology.orchestra.run.smithi096.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.8 MB/s | 44 kB 00:00 2022-02-02T18:11:39.692 INFO:teuthology.orchestra.run.smithi096.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.2 MB/s | 80 kB 00:00 2022-02-02T18:11:39.751 INFO:teuthology.orchestra.run.smithi096.stdout:(8/27): librgw2-16.2.4-0.el8.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2022-02-02T18:11:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:(9/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 2.5 MB/s | 213 kB 00:00 2022-02-02T18:11:39.801 INFO:teuthology.orchestra.run.smithi096.stdout:(10/27): python3-rados-16.2.4-0.el8.x86_64.rpm 7.5 MB/s | 387 kB 00:00 2022-02-02T18:11:39.827 INFO:teuthology.orchestra.run.smithi096.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2022-02-02T18:11:39.852 INFO:teuthology.orchestra.run.smithi096.stdout:(12/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 4.7 MB/s | 368 kB 00:00 2022-02-02T18:11:39.931 INFO:teuthology.orchestra.run.smithi096.stdout:(13/27): librdkafka-0.11.4-3.el8.x86_64.rpm 4.4 MB/s | 354 kB 00:00 2022-02-02T18:11:40.010 INFO:teuthology.orchestra.run.smithi096.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 795 kB/s | 145 kB 00:00 2022-02-02T18:11:40.154 INFO:teuthology.orchestra.run.smithi096.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 306 kB/s | 44 kB 00:00 2022-02-02T18:11:40.273 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:11:40.276 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:40.277 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:11:40.277 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:40.277 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:11:40.277 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2022-02-02T18:11:40.278 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2022-02-02T18:11:40.278 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T18:11:40.278 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2022-02-02T18:11:40.278 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:11:40.279 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2022-02-02T18:11:40.279 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2022-02-02T18:11:40.279 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2022-02-02T18:11:40.279 INFO:teuthology.orchestra.run.smithi159.stdout: daxctl-libs x86_64 71.1-3.el8 CentOS-Base 42 k 2022-02-02T18:11:40.280 INFO:teuthology.orchestra.run.smithi159.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-02-02T18:11:40.280 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-02-02T18:11:40.280 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-02-02T18:11:40.280 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2022-02-02T18:11:40.280 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-02-02T18:11:40.281 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2022-02-02T18:11:40.281 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-02-02T18:11:40.281 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2022-02-02T18:11:40.281 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-02-02T18:11:40.282 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2022-02-02T18:11:40.282 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-02-02T18:11:40.282 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-02-02T18:11:40.282 INFO:teuthology.orchestra.run.smithi159.stdout: ndctl-libs x86_64 71.1-3.el8 CentOS-Base 79 k 2022-02-02T18:11:40.283 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2022-02-02T18:11:40.283 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2022-02-02T18:11:40.283 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2022-02-02T18:11:40.283 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-02-02T18:11:40.283 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2022-02-02T18:11:40.284 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2022-02-02T18:11:40.284 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2022-02-02T18:11:40.284 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:40.284 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:11:40.285 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:11:40.285 INFO:teuthology.orchestra.run.smithi159.stdout:Install 25 Packages 2022-02-02T18:11:40.285 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 2 Packages 2022-02-02T18:11:40.285 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:11:40.286 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 59 M 2022-02-02T18:11:40.286 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:11:40.306 INFO:teuthology.orchestra.run.smithi096.stdout:(16/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 692 kB/s | 259 kB 00:00 2022-02-02T18:11:40.404 INFO:teuthology.orchestra.run.smithi096.stdout:(17/27): daxctl-libs-71.1-3.el8.x86_64.rpm 166 kB/s | 42 kB 00:00 2022-02-02T18:11:40.421 INFO:teuthology.orchestra.run.smithi096.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 409 kB/s | 47 kB 00:00 2022-02-02T18:11:40.438 INFO:teuthology.orchestra.run.smithi096.stdout:(19/27): ndctl-libs-71.1-3.el8.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2022-02-02T18:11:40.755 INFO:teuthology.orchestra.run.smithi096.stdout:(20/27): ceph-common-16.2.4-0.el8.x86_64.rpm 13 MB/s | 24 MB 00:01 2022-02-02T18:11:40.780 INFO:teuthology.orchestra.run.smithi096.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 324 kB/s | 116 kB 00:00 2022-02-02T18:11:40.914 INFO:teuthology.orchestra.run.smithi096.stdout:(22/27): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2022-02-02T18:11:40.946 INFO:teuthology.orchestra.run.smithi159.stdout:(1/27): ceph-common-16.2.4-0.el8.x86_64.rpm 36 MB/s | 24 MB 00:00 2022-02-02T18:11:40.955 INFO:teuthology.orchestra.run.smithi096.stdout:(23/27): gperftools-libs-2.7-9.el8.x86_64.rpm 592 kB/s | 306 kB 00:00 2022-02-02T18:11:40.962 INFO:teuthology.orchestra.run.smithi159.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2022-02-02T18:11:41.029 INFO:teuthology.orchestra.run.smithi159.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 12 MB/s | 801 kB 00:00 2022-02-02T18:11:41.089 INFO:teuthology.orchestra.run.smithi096.stdout:(24/27): librados2-16.2.4-0.el8.x86_64.rpm 28 MB/s | 3.7 MB 00:00 2022-02-02T18:11:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 374 kB/s | 75 kB 00:00 2022-02-02T18:11:41.129 INFO:teuthology.orchestra.run.smithi159.stdout:(4/27): ceph-base-16.2.4-0.el8.x86_64.rpm 7.1 MB/s | 6.0 MB 00:00 2022-02-02T18:11:41.140 INFO:teuthology.orchestra.run.smithi096.stdout:(26/27): leveldb-1.22-1.el8.x86_64.rpm 471 kB/s | 181 kB 00:00 2022-02-02T18:11:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:(5/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 3.8 MB/s | 486 kB 00:00 2022-02-02T18:11:41.172 INFO:teuthology.orchestra.run.smithi159.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 2.6 MB/s | 44 kB 00:00 2022-02-02T18:11:41.197 INFO:teuthology.orchestra.run.smithi159.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2022-02-02T18:11:41.232 INFO:teuthology.orchestra.run.smithi096.stdout:(27/27): librbd1-16.2.4-0.el8.x86_64.rpm 28 MB/s | 4.0 MB 00:00 2022-02-02T18:11:41.235 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:11:41.236 INFO:teuthology.orchestra.run.smithi096.stdout:Total 26 MB/s | 59 MB 00:02 2022-02-02T18:11:41.307 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:11:41.331 INFO:teuthology.orchestra.run.smithi159.stdout:(8/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 12 MB/s | 13 MB 00:01 2022-02-02T18:11:41.354 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:11:41.354 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:11:41.356 INFO:teuthology.orchestra.run.smithi159.stdout:(9/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 1.3 MB/s | 213 kB 00:00 2022-02-02T18:11:41.381 INFO:teuthology.orchestra.run.smithi159.stdout:(10/27): python3-rados-16.2.4-0.el8.x86_64.rpm 7.6 MB/s | 387 kB 00:00 2022-02-02T18:11:41.407 INFO:teuthology.orchestra.run.smithi159.stdout:(11/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 7.2 MB/s | 368 kB 00:00 2022-02-02T18:11:41.432 INFO:teuthology.orchestra.run.smithi159.stdout:(12/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 2.2 MB/s | 114 kB 00:00 2022-02-02T18:11:41.524 INFO:teuthology.orchestra.run.smithi159.stdout:(13/27): librgw2-16.2.4-0.el8.x86_64.rpm 10 MB/s | 4.1 MB 00:00 2022-02-02T18:11:41.549 INFO:teuthology.orchestra.run.smithi159.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 1.0 MB/s | 145 kB 00:00 2022-02-02T18:11:41.583 INFO:teuthology.orchestra.run.smithi159.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 1.5 MB/s | 44 kB 00:00 2022-02-02T18:11:41.608 INFO:teuthology.orchestra.run.smithi159.stdout:(16/27): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2022-02-02T18:11:41.633 INFO:teuthology.orchestra.run.smithi159.stdout:(17/27): daxctl-libs-71.1-3.el8.x86_64.rpm 838 kB/s | 42 kB 00:00 2022-02-02T18:11:41.659 INFO:teuthology.orchestra.run.smithi159.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 933 kB/s | 47 kB 00:00 2022-02-02T18:11:41.686 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:11:41.689 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:11:41.718 INFO:teuthology.orchestra.run.smithi159.stdout:(19/27): ndctl-libs-71.1-3.el8.x86_64.rpm 926 kB/s | 79 kB 00:00 2022-02-02T18:11:41.751 INFO:teuthology.orchestra.run.smithi159.stdout:(20/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2022-02-02T18:11:42.018 INFO:teuthology.orchestra.run.smithi159.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 324 kB/s | 116 kB 00:00 2022-02-02T18:11:42.035 INFO:teuthology.orchestra.run.smithi159.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 638 kB/s | 181 kB 00:00 2022-02-02T18:11:42.102 INFO:teuthology.orchestra.run.smithi159.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 702 kB/s | 59 kB 00:00 2022-02-02T18:11:42.127 INFO:teuthology.orchestra.run.smithi159.stdout:(24/27): libunwind-1.3.1-3.el8.x86_64.rpm 815 kB/s | 75 kB 00:00 2022-02-02T18:11:42.183 INFO:teuthology.orchestra.run.smithi159.stdout:(25/27): gperftools-libs-2.7-9.el8.x86_64.rpm 659 kB/s | 306 kB 00:00 2022-02-02T18:11:42.286 INFO:teuthology.orchestra.run.smithi159.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 26 MB/s | 4.0 MB 00:00 2022-02-02T18:11:42.361 INFO:teuthology.orchestra.run.smithi159.stdout:(27/27): librados2-16.2.4-0.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2022-02-02T18:11:42.365 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:11:42.365 INFO:teuthology.orchestra.run.smithi159.stdout:Total 28 MB/s | 59 MB 00:02 2022-02-02T18:11:42.438 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:11:42.486 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:11:42.486 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:11:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:11:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:11:42.856 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:11:43.029 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2022-02-02T18:11:43.194 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2022-02-02T18:11:43.368 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T18:11:43.791 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T18:11:43.968 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:11:44.139 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:11:44.139 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:11:44.203 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2022-02-02T18:11:44.334 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T18:11:44.388 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2022-02-02T18:11:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:11:44.570 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T18:11:44.593 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:11:44.749 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2022-02-02T18:11:44.909 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T18:11:44.978 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T18:11:45.119 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:11:45.227 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:11:45.338 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T18:11:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T18:11:45.551 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:11:45.695 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:11:45.732 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:11:45.756 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:11:45.893 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2022-02-02T18:11:46.019 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T18:11:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2022-02-02T18:11:46.439 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T18:11:46.551 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T18:11:46.607 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T18:11:46.644 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:11:46.721 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:11:46.724 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T18:11:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2022-02-02T18:11:46.918 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T18:11:47.159 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T18:11:47.216 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T18:11:47.376 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T18:11:47.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T18:11:47.712 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T18:11:47.831 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T18:11:47.867 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T18:11:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T18:11:48.053 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T18:11:48.123 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T18:11:48.236 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T18:11:48.270 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2022-02-02T18:11:48.296 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T18:11:48.469 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T18:11:48.510 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2022-02-02T18:11:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T18:11:48.764 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T18:11:48.890 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T18:11:48.925 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2022-02-02T18:11:49.019 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T18:11:49.106 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T18:11:49.158 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2022-02-02T18:11:49.264 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2022-02-02T18:11:49.307 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2022-02-02T18:11:49.451 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2022-02-02T18:11:49.487 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2022-02-02T18:11:49.635 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T18:11:49.703 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T18:11:49.886 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2022-02-02T18:11:50.110 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2022-02-02T18:11:50.276 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2022-02-02T18:11:50.428 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2022-02-02T18:11:52.929 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:53.817 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:53.971 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:54.129 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T18:11:54.169 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:54.236 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T18:11:54.366 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:11:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T18:11:55.155 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T18:11:55.287 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T18:11:55.409 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:12:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:12:12.604 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2022-02-02T18:12:12.604 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2022-02-02T18:12:12.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2022-02-02T18:12:12.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /run 2022-02-02T18:12:12.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2022-02-02T18:12:12.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2022-02-02T18:12:12.606 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2022-02-02T18:12:12.606 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2022-02-02T18:12:12.606 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2022-02-02T18:12:12.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:13.716 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:12:13.716 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2022-02-02T18:12:13.717 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2022-02-02T18:12:13.717 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2022-02-02T18:12:13.717 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /run 2022-02-02T18:12:13.717 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2022-02-02T18:12:13.717 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2022-02-02T18:12:13.718 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2022-02-02T18:12:13.718 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2022-02-02T18:12:13.718 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2022-02-02T18:12:13.718 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:13.941 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T18:12:14.012 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T18:12:14.013 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T18:12:14.247 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T18:12:14.248 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:14.970 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:14.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2022-02-02T18:12:14.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2022-02-02T18:12:14.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2022-02-02T18:12:14.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:12:14.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T18:12:14.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:12:14.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2022-02-02T18:12:14.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2022-02-02T18:12:14.973 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:12:14.973 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2022-02-02T18:12:14.973 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2022-02-02T18:12:14.973 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T18:12:14.974 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T18:12:14.974 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2022-02-02T18:12:14.974 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2022-02-02T18:12:14.974 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2022-02-02T18:12:14.975 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2022-02-02T18:12:14.975 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 18/29 2022-02-02T18:12:14.975 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2022-02-02T18:12:14.975 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 20/29 2022-02-02T18:12:14.976 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2022-02-02T18:12:14.976 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2022-02-02T18:12:14.976 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2022-02-02T18:12:14.976 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2022-02-02T18:12:14.977 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2022-02-02T18:12:14.977 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:12:14.977 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2022-02-02T18:12:14.977 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2022-02-02T18:12:15.035 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T18:12:15.109 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T18:12:15.109 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T18:12:15.292 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T18:12:15.292 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:15.928 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:15.928 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:15.928 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2022-02-02T18:12:15.929 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.929 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:15.929 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.930 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.930 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.930 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.930 INFO:teuthology.orchestra.run.smithi096.stdout: daxctl-libs-71.1-3.el8.x86_64 2022-02-02T18:12:15.931 INFO:teuthology.orchestra.run.smithi096.stdout: fmt-6.2.1-1.el8.x86_64 2022-02-02T18:12:15.931 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-02-02T18:12:15.931 INFO:teuthology.orchestra.run.smithi096.stdout: leveldb-1.22-1.el8.x86_64 2022-02-02T18:12:15.931 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.932 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.2-3.el8.x86_64 2022-02-02T18:12:15.932 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.6.1-1.el8.x86_64 2022-02-02T18:12:15.932 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-02-02T18:12:15.932 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.933 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-02-02T18:12:15.933 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.933 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.3.1-3.el8.x86_64 2022-02-02T18:12:15.933 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-02-02T18:12:15.933 INFO:teuthology.orchestra.run.smithi096.stdout: ndctl-libs-71.1-3.el8.x86_64 2022-02-02T18:12:15.934 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.934 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.934 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.934 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-02-02T18:12:15.935 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.935 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.935 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:15.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:15.936 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:16.103 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:16.104 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2022-02-02T18:12:16.104 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2022-02-02T18:12:16.104 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2022-02-02T18:12:16.104 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T18:12:16.104 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T18:12:16.105 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T18:12:16.105 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2022-02-02T18:12:16.105 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2022-02-02T18:12:16.106 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T18:12:16.106 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2022-02-02T18:12:16.106 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2022-02-02T18:12:16.106 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T18:12:16.107 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T18:12:16.107 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2022-02-02T18:12:16.107 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2022-02-02T18:12:16.108 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2022-02-02T18:12:16.108 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2022-02-02T18:12:16.108 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 18/29 2022-02-02T18:12:16.109 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2022-02-02T18:12:16.109 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 20/29 2022-02-02T18:12:16.109 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2022-02-02T18:12:16.110 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2022-02-02T18:12:16.110 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2022-02-02T18:12:16.110 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2022-02-02T18:12:16.110 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2022-02-02T18:12:16.111 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T18:12:16.111 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2022-02-02T18:12:16.111 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2022-02-02T18:12:16.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-test 2022-02-02T18:12:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:16.774 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:40 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:17.046 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T18:12:17.047 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:17.047 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2022-02-02T18:12:17.047 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.047 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:17.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.049 INFO:teuthology.orchestra.run.smithi159.stdout: daxctl-libs-71.1-3.el8.x86_64 2022-02-02T18:12:17.049 INFO:teuthology.orchestra.run.smithi159.stdout: fmt-6.2.1-1.el8.x86_64 2022-02-02T18:12:17.049 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-02-02T18:12:17.049 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb-1.22-1.el8.x86_64 2022-02-02T18:12:17.050 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.050 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.2-3.el8.x86_64 2022-02-02T18:12:17.050 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.6.1-1.el8.x86_64 2022-02-02T18:12:17.050 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-02-02T18:12:17.051 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.051 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-02-02T18:12:17.051 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.051 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.3.1-3.el8.x86_64 2022-02-02T18:12:17.052 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-02-02T18:12:17.052 INFO:teuthology.orchestra.run.smithi159.stdout: ndctl-libs-71.1-3.el8.x86_64 2022-02-02T18:12:17.052 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.052 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.052 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-02-02T18:12:17.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:17.054 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:17.054 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:17.323 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-test 2022-02-02T18:12:17.514 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:17.514 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:17.550 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:17.551 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:12:17.552 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:17.552 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2022-02-02T18:12:17.552 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:12:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-02-02T18:12:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2022-02-02T18:12:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-02-02T18:12:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-02-02T18:12:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-02-02T18:12:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:17.554 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:17.554 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:17.555 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2022-02-02T18:12:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:17.556 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 53 M 2022-02-02T18:12:17.556 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 229 M 2022-02-02T18:12:17.556 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 3.2 MB/s | 169 kB 00:00 2022-02-02T18:12:17.657 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): jq-1.6-3.el8.x86_64.rpm 1.9 MB/s | 202 kB 00:00 2022-02-02T18:12:17.698 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 8.0 MB/s | 323 kB 00:00 2022-02-02T18:12:17.723 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2022-02-02T18:12:17.898 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:40 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:17.948 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 276 kB/s | 69 kB 00:00 2022-02-02T18:12:18.674 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 46 MB/s | 52 MB 00:01 2022-02-02T18:12:18.676 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:18.677 INFO:teuthology.orchestra.run.smithi096.stdout:Total 47 MB/s | 53 MB 00:01 2022-02-02T18:12:18.709 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:18.710 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:18.711 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:12:18.711 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:18.711 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:12:18.711 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2022-02-02T18:12:18.711 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:12:18.712 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-02-02T18:12:18.712 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2022-02-02T18:12:18.712 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-02-02T18:12:18.712 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-02-02T18:12:18.713 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-02-02T18:12:18.713 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:18.713 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:12:18.713 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:18.714 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2022-02-02T18:12:18.714 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:18.715 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:12:18.715 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 53 M 2022-02-02T18:12:18.715 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 229 M 2022-02-02T18:12:18.716 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:12:18.734 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:12:18.734 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:12:18.777 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 2.6 MB/s | 169 kB 00:00 2022-02-02T18:12:18.810 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2022-02-02T18:12:18.844 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2022-02-02T18:12:18.869 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2022-02-02T18:12:19.003 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 517 kB/s | 69 kB 00:00 2022-02-02T18:12:19.043 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:12:19.047 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:12:19.513 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:12:19.696 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-02-02T18:12:19.803 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 48 MB/s | 52 MB 00:01 2022-02-02T18:12:19.807 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:19.807 INFO:teuthology.orchestra.run.smithi159.stdout:Total 48 MB/s | 53 MB 00:01 2022-02-02T18:12:19.845 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:12:19.866 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:12:19.866 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:12:19.871 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-02-02T18:12:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T18:12:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T18:12:20.170 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:12:20.173 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:12:20.301 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-02-02T18:12:20.444 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T18:12:20.661 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:12:20.835 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-02-02T18:12:21.017 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-02-02T18:12:21.173 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T18:12:21.249 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T18:12:21.421 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-02-02T18:12:21.547 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T18:12:25.274 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T18:12:25.507 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T18:12:25.791 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T18:12:25.791 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2022-02-02T18:12:25.792 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2022-02-02T18:12:25.792 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-02-02T18:12:25.792 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-02-02T18:12:25.792 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-02-02T18:12:26.364 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-02-02T18:12:26.365 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:26.365 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:26.366 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-02-02T18:12:26.366 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2022-02-02T18:12:26.367 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2022-02-02T18:12:26.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:26.367 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:26.435 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T18:12:26.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph 2022-02-02T18:12:26.661 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T18:12:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:26.948 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T18:12:26.948 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2022-02-02T18:12:26.948 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2022-02-02T18:12:26.949 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-02-02T18:12:26.949 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-02-02T18:12:26.949 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-02-02T18:12:27.148 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:51 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:27.371 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-02-02T18:12:27.372 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:27.372 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:27.372 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-02-02T18:12:27.372 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2022-02-02T18:12:27.373 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2022-02-02T18:12:27.373 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:27.373 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:27.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph 2022-02-02T18:12:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:27.799 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:27.961 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:27.964 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:27.964 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:12:27.965 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:27.965 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:27.965 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2022-02-02T18:12:27.965 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:12:27.966 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2022-02-02T18:12:27.966 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2022-02-02T18:12:27.966 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2022-02-02T18:12:27.966 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2022-02-02T18:12:27.967 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2022-02-02T18:12:27.967 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-02-02T18:12:27.967 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-02-02T18:12:27.967 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-02-02T18:12:27.967 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-02-02T18:12:27.968 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-02-02T18:12:27.968 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-02-02T18:12:27.968 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-02-02T18:12:27.968 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-02-02T18:12:27.969 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-02-02T18:12:27.969 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-02-02T18:12:27.969 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-02-02T18:12:27.969 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-02-02T18:12:27.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-02-02T18:12:27.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-02-02T18:12:27.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-02-02T18:12:27.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-02-02T18:12:27.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-02-02T18:12:27.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-02-02T18:12:27.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-02-02T18:12:27.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-02-02T18:12:27.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-02-02T18:12:27.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-02-02T18:12:27.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-02-02T18:12:27.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-02-02T18:12:27.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-02-02T18:12:27.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-02-02T18:12:27.973 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:27.973 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:27.973 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:27.974 INFO:teuthology.orchestra.run.smithi096.stdout:Install 32 Packages 2022-02-02T18:12:27.974 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:27.975 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 31 M 2022-02-02T18:12:27.975 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 111 M 2022-02-02T18:12:27.975 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:28.024 INFO:teuthology.orchestra.run.smithi096.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 117 kB/s | 6.3 kB 00:00 2022-02-02T18:12:28.124 INFO:teuthology.orchestra.run.smithi096.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2022-02-02T18:12:28.186 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:51 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:28.191 INFO:teuthology.orchestra.run.smithi096.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2022-02-02T18:12:28.225 INFO:teuthology.orchestra.run.smithi096.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2022-02-02T18:12:28.284 INFO:teuthology.orchestra.run.smithi096.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-02-02T18:12:28.309 INFO:teuthology.orchestra.run.smithi096.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-02-02T18:12:28.334 INFO:teuthology.orchestra.run.smithi096.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2022-02-02T18:12:28.393 INFO:teuthology.orchestra.run.smithi096.stdout:(8/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2022-02-02T18:12:28.443 INFO:teuthology.orchestra.run.smithi096.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 500 kB/s | 54 kB 00:00 2022-02-02T18:12:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.9 MB/s | 237 kB 00:00 2022-02-02T18:12:28.511 INFO:teuthology.orchestra.run.smithi096.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 17 MB/s | 559 kB 00:00 2022-02-02T18:12:28.536 INFO:teuthology.orchestra.run.smithi096.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2022-02-02T18:12:28.561 INFO:teuthology.orchestra.run.smithi096.stdout:(13/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.7 MB/s | 457 kB 00:00 2022-02-02T18:12:28.862 INFO:teuthology.orchestra.run.smithi096.stdout:(14/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 25 MB/s | 18 MB 00:00 2022-02-02T18:12:28.887 INFO:teuthology.orchestra.run.smithi096.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 124 kB/s | 44 kB 00:00 2022-02-02T18:12:28.912 INFO:teuthology.orchestra.run.smithi096.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 528 kB/s | 185 kB 00:00 2022-02-02T18:12:28.963 INFO:teuthology.orchestra.run.smithi096.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2022-02-02T18:12:29.001 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:29.005 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:29.005 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:12:29.005 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:29.005 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:12:29.006 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2022-02-02T18:12:29.006 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:12:29.006 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2022-02-02T18:12:29.006 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2022-02-02T18:12:29.007 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2022-02-02T18:12:29.007 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2022-02-02T18:12:29.007 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2022-02-02T18:12:29.007 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-02-02T18:12:29.008 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-02-02T18:12:29.008 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-02-02T18:12:29.008 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-02-02T18:12:29.008 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-02-02T18:12:29.008 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-02-02T18:12:29.009 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-02-02T18:12:29.009 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-02-02T18:12:29.009 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-02-02T18:12:29.009 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-02-02T18:12:29.010 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-02-02T18:12:29.010 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-02-02T18:12:29.010 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-02-02T18:12:29.010 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-02-02T18:12:29.011 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-02-02T18:12:29.011 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-02-02T18:12:29.011 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-02-02T18:12:29.012 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-02-02T18:12:29.012 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-02-02T18:12:29.012 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-02-02T18:12:29.012 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-02-02T18:12:29.013 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-02-02T18:12:29.013 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-02-02T18:12:29.013 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-02-02T18:12:29.013 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-02-02T18:12:29.013 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-02-02T18:12:29.014 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:29.014 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:12:29.014 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:29.014 INFO:teuthology.orchestra.run.smithi159.stdout:Install 32 Packages 2022-02-02T18:12:29.015 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:29.015 INFO:teuthology.orchestra.run.smithi096.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 353 kB/s | 18 kB 00:00 2022-02-02T18:12:29.016 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 31 M 2022-02-02T18:12:29.016 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 111 M 2022-02-02T18:12:29.016 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:12:29.063 INFO:teuthology.orchestra.run.smithi096.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 977 kB/s | 49 kB 00:00 2022-02-02T18:12:29.079 INFO:teuthology.orchestra.run.smithi159.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 92 kB/s | 6.3 kB 00:00 2022-02-02T18:12:29.114 INFO:teuthology.orchestra.run.smithi096.stdout:(20/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 687 kB/s | 173 kB 00:00 2022-02-02T18:12:29.139 INFO:teuthology.orchestra.run.smithi096.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2022-02-02T18:12:29.163 INFO:teuthology.orchestra.run.smithi159.stdout:(2/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2022-02-02T18:12:29.173 INFO:teuthology.orchestra.run.smithi096.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.3 MB/s | 384 kB 00:00 2022-02-02T18:12:29.197 INFO:teuthology.orchestra.run.smithi159.stdout:(3/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 8.4 MB/s | 1.6 MB 00:00 2022-02-02T18:12:29.198 INFO:teuthology.orchestra.run.smithi096.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 265 kB/s | 16 kB 00:00 2022-02-02T18:12:29.215 INFO:teuthology.orchestra.run.smithi096.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 447 kB/s | 19 kB 00:00 2022-02-02T18:12:29.239 INFO:teuthology.orchestra.run.smithi159.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 5.2 MB/s | 220 kB 00:00 2022-02-02T18:12:29.240 INFO:teuthology.orchestra.run.smithi096.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 571 kB/s | 24 kB 00:00 2022-02-02T18:12:29.266 INFO:teuthology.orchestra.run.smithi096.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 582 kB/s | 29 kB 00:00 2022-02-02T18:12:29.291 INFO:teuthology.orchestra.run.smithi096.stdout:(27/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2022-02-02T18:12:29.308 INFO:teuthology.orchestra.run.smithi096.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 410 kB/s | 27 kB 00:00 2022-02-02T18:12:29.314 INFO:teuthology.orchestra.run.smithi159.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2022-02-02T18:12:29.340 INFO:teuthology.orchestra.run.smithi159.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-02-02T18:12:29.365 INFO:teuthology.orchestra.run.smithi159.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2022-02-02T18:12:29.390 INFO:teuthology.orchestra.run.smithi159.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-02-02T18:12:29.416 INFO:teuthology.orchestra.run.smithi096.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.6 MB/s | 241 kB 00:00 2022-02-02T18:12:29.424 INFO:teuthology.orchestra.run.smithi159.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2022-02-02T18:12:29.441 INFO:teuthology.orchestra.run.smithi096.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 638 kB/s | 85 kB 00:00 2022-02-02T18:12:29.467 INFO:teuthology.orchestra.run.smithi096.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2022-02-02T18:12:29.491 INFO:teuthology.orchestra.run.smithi159.stdout:(10/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 12 MB/s | 5.0 MB 00:00 2022-02-02T18:12:29.492 INFO:teuthology.orchestra.run.smithi096.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2022-02-02T18:12:29.496 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:29.496 INFO:teuthology.orchestra.run.smithi096.stdout:Total 20 MB/s | 31 MB 00:01 2022-02-02T18:12:29.541 INFO:teuthology.orchestra.run.smithi159.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 237 kB 00:00 2022-02-02T18:12:29.575 INFO:teuthology.orchestra.run.smithi159.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 3.7 MB/s | 109 kB 00:00 2022-02-02T18:12:29.584 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:12:29.608 INFO:teuthology.orchestra.run.smithi159.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 4.7 MB/s | 559 kB 00:00 2022-02-02T18:12:29.622 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:12:29.623 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:12:29.892 INFO:teuthology.orchestra.run.smithi159.stdout:(14/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 25 MB/s | 18 MB 00:00 2022-02-02T18:12:29.917 INFO:teuthology.orchestra.run.smithi159.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 128 kB/s | 44 kB 00:00 2022-02-02T18:12:29.931 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:12:29.934 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:12:29.942 INFO:teuthology.orchestra.run.smithi159.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 555 kB/s | 185 kB 00:00 2022-02-02T18:12:29.993 INFO:teuthology.orchestra.run.smithi159.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2022-02-02T18:12:30.051 INFO:teuthology.orchestra.run.smithi159.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2022-02-02T18:12:30.076 INFO:teuthology.orchestra.run.smithi159.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 210 kB/s | 18 kB 00:00 2022-02-02T18:12:30.102 INFO:teuthology.orchestra.run.smithi159.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 967 kB/s | 49 kB 00:00 2022-02-02T18:12:30.127 INFO:teuthology.orchestra.run.smithi159.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-02-02T18:12:30.177 INFO:teuthology.orchestra.run.smithi159.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2022-02-02T18:12:30.211 INFO:teuthology.orchestra.run.smithi159.stdout:(23/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.3 MB/s | 384 kB 00:00 2022-02-02T18:12:30.228 INFO:teuthology.orchestra.run.smithi159.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 372 kB/s | 19 kB 00:00 2022-02-02T18:12:30.287 INFO:teuthology.orchestra.run.smithi159.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2022-02-02T18:12:30.304 INFO:teuthology.orchestra.run.smithi159.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 259 kB/s | 24 kB 00:00 2022-02-02T18:12:30.320 INFO:teuthology.orchestra.run.smithi159.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 317 kB/s | 29 kB 00:00 2022-02-02T18:12:30.337 INFO:teuthology.orchestra.run.smithi159.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 545 kB/s | 27 kB 00:00 2022-02-02T18:12:30.413 INFO:teuthology.orchestra.run.smithi159.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2022-02-02T18:12:30.455 INFO:teuthology.orchestra.run.smithi159.stdout:(30/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.8 MB/s | 241 kB 00:00 2022-02-02T18:12:30.506 INFO:teuthology.orchestra.run.smithi159.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2022-02-02T18:12:30.538 INFO:teuthology.orchestra.run.smithi159.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2022-02-02T18:12:30.543 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:30.543 INFO:teuthology.orchestra.run.smithi159.stdout:Total 20 MB/s | 31 MB 00:01 2022-02-02T18:12:30.632 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:12:30.670 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:12:30.670 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:12:30.976 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:12:30.979 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:12:31.081 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:12:31.262 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-02-02T18:12:31.474 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-02-02T18:12:31.712 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-02-02T18:12:31.964 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-02-02T18:12:32.095 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-02-02T18:12:32.214 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:12:32.251 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-02-02T18:12:32.394 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-02-02T18:12:32.422 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-02-02T18:12:32.543 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-02-02T18:12:32.637 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-02-02T18:12:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-02-02T18:12:32.817 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-02-02T18:12:32.951 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-02-02T18:12:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-02-02T18:12:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-02-02T18:12:33.216 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-02-02T18:12:33.357 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-02-02T18:12:33.381 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-02-02T18:12:33.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-02-02T18:12:33.635 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-02-02T18:12:33.724 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-02-02T18:12:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-02-02T18:12:33.993 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-02-02T18:12:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-02-02T18:12:34.190 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-02-02T18:12:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-02-02T18:12:34.372 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-02-02T18:12:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-02-02T18:12:34.566 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T18:12:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-02-02T18:12:34.858 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-02-02T18:12:35.029 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-02-02T18:12:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-02-02T18:12:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-02-02T18:12:35.245 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-02-02T18:12:35.437 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-02-02T18:12:35.488 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-02-02T18:12:35.637 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-02-02T18:12:35.672 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T18:12:35.852 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-02-02T18:12:35.905 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-02-02T18:12:36.075 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-02-02T18:12:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-02-02T18:12:36.289 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-02-02T18:12:36.392 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-02-02T18:12:36.467 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-02-02T18:12:36.712 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-02-02T18:12:36.729 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-02-02T18:12:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-02-02T18:12:37.107 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2022-02-02T18:12:37.166 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-02-02T18:12:37.277 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T18:12:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-02-02T18:12:37.868 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-02-02T18:12:38.260 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2022-02-02T18:12:38.415 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T18:12:38.798 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T18:12:39.010 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T18:12:39.441 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T18:12:39.627 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T18:12:39.848 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T18:12:39.934 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T18:12:40.031 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T18:12:40.048 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T18:12:40.131 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T18:12:40.188 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T18:12:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T18:12:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:Couldn't write '0 2147483647' to '-net/ipv4/ping_group_range', ignoring: No such file or directory 2022-02-02T18:12:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T18:12:40.580 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2022-02-02T18:12:40.580 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2022-02-02T18:12:40.580 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2022-02-02T18:12:40.580 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2022-02-02T18:12:40.581 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2022-02-02T18:12:40.581 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2022-02-02T18:12:40.581 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-02-02T18:12:40.581 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-02-02T18:12:40.582 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-02-02T18:12:40.582 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-02-02T18:12:40.582 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-02-02T18:12:40.582 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-02-02T18:12:40.582 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-02-02T18:12:40.583 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-02-02T18:12:40.583 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-02-02T18:12:40.583 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-02-02T18:12:40.583 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T18:12:40.584 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-02-02T18:12:40.584 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-02-02T18:12:40.584 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-02-02T18:12:40.584 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-02-02T18:12:40.584 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-02-02T18:12:40.585 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-02-02T18:12:40.585 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-02-02T18:12:40.585 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-02-02T18:12:40.585 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-02-02T18:12:40.586 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-02-02T18:12:40.586 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-02-02T18:12:40.587 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-02-02T18:12:40.587 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-02-02T18:12:40.587 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-02-02T18:12:40.756 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T18:12:40.978 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T18:12:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T18:12:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T18:12:41.314 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-02-02T18:12:41.314 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:41.315 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:41.315 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:41.315 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:41.315 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:41.316 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2022-02-02T18:12:41.316 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:41.316 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:41.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-02-02T18:12:41.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-02-02T18:12:41.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-02-02T18:12:41.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-02-02T18:12:41.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-02-02T18:12:41.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-02-02T18:12:41.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-6.2-6.el8.noarch 2022-02-02T18:12:41.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-02-02T18:12:41.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-02-02T18:12:41.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.0.6-13.el8.noarch 2022-02-02T18:12:41.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-02-02T18:12:41.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-02-02T18:12:41.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-02-02T18:12:41.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-2.6-1.el8.noarch 2022-02-02T18:12:41.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-02-02T18:12:41.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.14-14.el8.noarch 2022-02-02T18:12:41.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2017.2-9.el8.noarch 2022-02-02T18:12:41.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-02-02T18:12:41.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-02-02T18:12:41.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-02-02T18:12:41.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-02-02T18:12:41.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-02-02T18:12:41.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-02-02T18:12:41.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-02-02T18:12:41.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-02-02T18:12:41.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-02-02T18:12:41.322 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:41.322 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:41.323 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T18:12:41.407 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T18:12:41.407 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0 2147483647' to '-net/ipv4/ping_group_range', ignoring: No such file or directory 2022-02-02T18:12:41.408 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:41.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-base 2022-02-02T18:12:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:41.711 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2022-02-02T18:12:41.711 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2022-02-02T18:12:41.711 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2022-02-02T18:12:41.711 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2022-02-02T18:12:41.712 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2022-02-02T18:12:41.712 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2022-02-02T18:12:41.712 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-02-02T18:12:41.712 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-02-02T18:12:41.712 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-02-02T18:12:41.713 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-02-02T18:12:41.713 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-02-02T18:12:41.713 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-02-02T18:12:41.713 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-02-02T18:12:41.714 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-02-02T18:12:41.714 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-02-02T18:12:41.714 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-02-02T18:12:41.714 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T18:12:41.715 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-02-02T18:12:41.715 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-02-02T18:12:41.715 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-02-02T18:12:41.715 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-02-02T18:12:41.716 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-02-02T18:12:41.716 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-02-02T18:12:41.716 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-02-02T18:12:41.716 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-02-02T18:12:41.716 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-02-02T18:12:41.717 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-02-02T18:12:41.717 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-02-02T18:12:41.717 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-02-02T18:12:41.717 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-02-02T18:12:41.718 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-02-02T18:12:42.083 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:06 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-02-02T18:12:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:42.619 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2022-02-02T18:12:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-02-02T18:12:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-02-02T18:12:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-02-02T18:12:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-02-02T18:12:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-02-02T18:12:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-02-02T18:12:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-6.2-6.el8.noarch 2022-02-02T18:12:42.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-02-02T18:12:42.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-02-02T18:12:42.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.0.6-13.el8.noarch 2022-02-02T18:12:42.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-02-02T18:12:42.624 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-02-02T18:12:42.624 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-02-02T18:12:42.624 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-2.6-1.el8.noarch 2022-02-02T18:12:42.624 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-02-02T18:12:42.624 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.14-14.el8.noarch 2022-02-02T18:12:42.625 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2017.2-9.el8.noarch 2022-02-02T18:12:42.625 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-02-02T18:12:42.625 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-02-02T18:12:42.625 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-02-02T18:12:42.625 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-02-02T18:12:42.626 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-02-02T18:12:42.626 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-02-02T18:12:42.626 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-02-02T18:12:42.626 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-02-02T18:12:42.627 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-02-02T18:12:42.627 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:42.627 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:42.839 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:12:42.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-base 2022-02-02T18:12:42.884 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:42.885 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:12:42.885 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:42.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install cephadm 2022-02-02T18:12:43.041 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:43.042 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:43.426 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:06 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:43.526 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:07 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:44.163 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:12:44.210 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:44.211 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:12:44.211 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:44.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install cephadm 2022-02-02T18:12:44.330 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:44.331 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:44.331 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:12:44.331 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:44.332 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:44.332 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2022-02-02T18:12:44.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:44.332 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:44.333 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:44.333 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:12:44.333 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:44.334 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 71 k 2022-02-02T18:12:44.334 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 290 k 2022-02-02T18:12:44.334 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:44.375 INFO:teuthology.orchestra.run.smithi096.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.6 MB/s | 71 kB 00:00 2022-02-02T18:12:44.375 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.6 MB/s | 71 kB 00:00 2022-02-02T18:12:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:12:44.383 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:12:44.383 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:12:44.384 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:12:44.388 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:12:44.429 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:12:44.470 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:44.470 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:44.852 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:07 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:45.659 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:45.829 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:45.829 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:12:45.829 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:45.830 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:12:45.830 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2022-02-02T18:12:45.830 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:45.830 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:12:45.831 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:45.831 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:12:45.831 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:45.831 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 71 k 2022-02-02T18:12:45.832 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 290 k 2022-02-02T18:12:45.832 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:12:45.832 INFO:teuthology.orchestra.run.smithi159.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.6 MB/s | 71 kB 00:00 2022-02-02T18:12:45.832 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:45.832 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.6 MB/s | 71 kB 00:00 2022-02-02T18:12:45.833 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:12:45.833 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:12:45.833 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:12:45.833 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:12:45.833 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:12:45.834 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:12:45.924 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:46.146 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:46.339 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:46.745 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:46.745 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:46.745 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:46.746 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:16.2.4-0.el8.noarch 2022-02-02T18:12:46.746 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:46.746 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:47.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-immutable-object-cache 2022-02-02T18:12:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:47.357 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:47.542 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:47.589 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:11 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:48.120 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T18:12:48.121 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:48.121 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:48.121 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:16.2.4-0.el8.noarch 2022-02-02T18:12:48.122 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:48.122 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:48.329 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-immutable-object-cache 2022-02-02T18:12:48.361 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:48.363 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:48.364 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2022-02-02T18:12:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:48.365 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2022-02-02T18:12:48.365 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:48.365 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:48.366 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:48.366 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:12:48.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:48.367 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 163 k 2022-02-02T18:12:48.368 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 587 k 2022-02-02T18:12:48.368 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:48.507 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 1.1 MB/s | 163 kB 00:00 2022-02-02T18:12:48.508 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:48.508 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.1 MB/s | 163 kB 00:00 2022-02-02T18:12:48.508 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:12:48.518 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:12:48.519 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:12:48.564 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:12:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:12:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:12:48.854 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:49.174 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:49.175 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:49.240 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:49.562 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:12 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:49.592 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:49.592 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:49.592 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:49.592 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:49.593 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:49.593 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:49.819 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr 2022-02-02T18:12:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:50.354 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:50.356 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:50.356 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2022-02-02T18:12:50.356 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:50.356 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:12:50.357 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2022-02-02T18:12:50.357 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:50.357 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:12:50.357 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:50.357 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:12:50.358 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:50.358 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 163 k 2022-02-02T18:12:50.358 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 587 k 2022-02-02T18:12:50.358 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:12:50.390 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:14 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:50.403 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.4 MB/s | 163 kB 00:00 2022-02-02T18:12:50.403 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:50.404 INFO:teuthology.orchestra.run.smithi159.stdout:Total 3.3 MB/s | 163 kB 00:00 2022-02-02T18:12:50.404 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:12:50.415 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:12:50.415 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:12:50.461 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:12:50.464 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:12:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:12:50.751 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:51.120 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:51.146 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:12:51.192 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:51.193 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:12:51.193 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:51.282 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-dashboard 2022-02-02T18:12:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:51.489 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:12:51.489 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:51.489 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:51.490 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2022-02-02T18:12:51.490 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:51.490 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:51.685 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr 2022-02-02T18:12:51.838 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:15 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:51.870 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:51.870 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:52.260 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:15 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:52.633 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:52.634 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:52.634 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:12:52.635 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:52.635 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:52.635 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2022-02-02T18:12:52.635 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:12:52.636 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2022-02-02T18:12:52.636 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2022-02-02T18:12:52.636 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-02-02T18:12:52.636 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-02-02T18:12:52.636 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-02-02T18:12:52.637 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:52.637 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:52.637 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:12:52.637 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2022-02-02T18:12:52.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:52.638 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 3.0 M 2022-02-02T18:12:52.639 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 15 M 2022-02-02T18:12:52.639 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:52.685 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 492 kB/s | 24 kB 00:00 2022-02-02T18:12:52.710 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 121 kB/s | 8.9 kB 00:00 2022-02-02T18:12:52.786 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 18 MB/s | 2.7 MB 00:00 2022-02-02T18:12:52.811 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2022-02-02T18:12:52.870 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 211 kB/s | 34 kB 00:00 2022-02-02T18:12:52.991 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:12:53.012 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 872 kB/s | 196 kB 00:00 2022-02-02T18:12:53.014 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:53.015 INFO:teuthology.orchestra.run.smithi096.stdout:Total 7.8 MB/s | 3.0 MB 00:00 2022-02-02T18:12:53.026 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:12:53.036 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:12:53.036 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:12:53.037 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:53.038 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:12:53.039 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:53.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-dashboard 2022-02-02T18:12:53.161 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:12:53.164 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:12:53.302 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:53.303 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:53.422 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:12:53.634 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-02-02T18:12:53.683 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:12:54.471 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:12:54.472 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:54.472 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:12:54.473 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:54.473 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:12:54.473 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2022-02-02T18:12:54.474 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:12:54.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2022-02-02T18:12:54.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2022-02-02T18:12:54.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-02-02T18:12:54.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-02-02T18:12:54.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-02-02T18:12:54.475 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:54.475 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:12:54.475 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:12:54.476 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2022-02-02T18:12:54.476 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:54.477 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 3.0 M 2022-02-02T18:12:54.477 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 15 M 2022-02-02T18:12:54.477 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:12:54.868 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 61 kB/s | 24 kB 00:00 2022-02-02T18:12:55.157 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-02-02T18:12:55.221 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 12 kB/s | 8.9 kB 00:00 2022-02-02T18:12:55.632 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 2.3 MB/s | 2.7 MB 00:01 2022-02-02T18:12:55.878 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 42 kB/s | 43 kB 00:01 2022-02-02T18:12:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-02-02T18:12:56.253 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 33 kB/s | 34 kB 00:01 2022-02-02T18:12:56.335 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2022-02-02T18:12:56.530 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 219 kB/s | 196 kB 00:00 2022-02-02T18:12:56.533 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:12:56.533 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.4 MB/s | 3.0 MB 00:02 2022-02-02T18:12:56.545 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:12:56.556 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:12:56.556 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:12:56.824 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:12:56.827 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:12:57.174 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:12:57.332 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2022-02-02T18:12:57.397 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-02-02T18:12:57.573 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:12:57.634 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-02-02T18:12:57.835 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-02-02T18:12:57.845 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:12:57.845 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2022-02-02T18:12:57.845 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2022-02-02T18:12:57.845 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2022-02-02T18:12:57.846 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-02-02T18:12:57.846 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-02-02T18:12:57.956 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2022-02-02T18:12:58.207 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-02-02T18:12:58.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:58.208 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:12:58.208 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2022-02-02T18:12:58.208 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2022-02-02T18:12:58.209 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2022-02-02T18:12:58.209 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-02-02T18:12:58.209 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-02-02T18:12:58.209 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.4.1-12.el8.noarch 2022-02-02T18:12:58.210 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:58.210 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:12:58.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-diskprediction-local 2022-02-02T18:12:58.517 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:58.517 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:12:58.897 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:22 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:12:58.959 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2022-02-02T18:12:59.228 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:12:59.481 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:12:59.481 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2022-02-02T18:12:59.482 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2022-02-02T18:12:59.482 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2022-02-02T18:12:59.482 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-02-02T18:12:59.482 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-02-02T18:12:59.693 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:12:59.694 INFO:teuthology.orchestra.run.smithi096.stdout:===================================================================================================== 2022-02-02T18:12:59.694 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:12:59.694 INFO:teuthology.orchestra.run.smithi096.stdout:===================================================================================================== 2022-02-02T18:12:59.694 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:12:59.695 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2022-02-02T18:12:59.695 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:12:59.695 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-02-02T18:12:59.695 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-02-02T18:12:59.696 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-02-02T18:12:59.696 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-02-02T18:12:59.696 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-02-02T18:12:59.696 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-02-02T18:12:59.697 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-02-02T18:12:59.697 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:59.697 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:12:59.697 INFO:teuthology.orchestra.run.smithi096.stdout:===================================================================================================== 2022-02-02T18:12:59.697 INFO:teuthology.orchestra.run.smithi096.stdout:Install 8 Packages 2022-02-02T18:12:59.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:12:59.698 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 37 M 2022-02-02T18:12:59.699 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 210 M 2022-02-02T18:12:59.699 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:12:59.847 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-02-02T18:12:59.848 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:59.848 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:12:59.848 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2022-02-02T18:12:59.848 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2022-02-02T18:12:59.849 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2022-02-02T18:12:59.849 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-02-02T18:12:59.849 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-02-02T18:12:59.849 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.4.1-12.el8.noarch 2022-02-02T18:12:59.849 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:12:59.850 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:12:59.885 INFO:teuthology.orchestra.run.smithi096.stdout:(1/8): openblas-0.3.15-3.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2022-02-02T18:12:59.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-diskprediction-local 2022-02-02T18:12:59.994 INFO:teuthology.orchestra.run.smithi096.stdout:(2/8): ceph-mgr-diskprediction-local-16.2.4-0.e 29 MB/s | 8.6 MB 00:00 2022-02-02T18:13:00.086 INFO:teuthology.orchestra.run.smithi096.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 19 MB/s | 3.7 MB 00:00 2022-02-02T18:13:00.158 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:00.159 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:00.171 INFO:teuthology.orchestra.run.smithi096.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.2 MB/s | 225 kB 00:00 2022-02-02T18:13:00.253 INFO:teuthology.orchestra.run.smithi096.stdout:(5/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 8.7 MB/s | 4.9 MB 00:00 2022-02-02T18:13:00.286 INFO:teuthology.orchestra.run.smithi096.stdout:(6/8): libgfortran-8.5.0-10.el8.x86_64.rpm 5.5 MB/s | 643 kB 00:00 2022-02-02T18:13:00.312 INFO:teuthology.orchestra.run.smithi096.stdout:(7/8): libquadmath-8.5.0-10.el8.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2022-02-02T18:13:00.541 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:23 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:00.570 INFO:teuthology.orchestra.run.smithi096.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 28 MB/s | 14 MB 00:00 2022-02-02T18:13:00.574 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:00.574 INFO:teuthology.orchestra.run.smithi096.stdout:Total 42 MB/s | 37 MB 00:00 2022-02-02T18:13:00.809 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:00.827 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:00.828 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:01.146 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:01.149 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:01.355 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:01.356 INFO:teuthology.orchestra.run.smithi159.stdout:===================================================================================================== 2022-02-02T18:13:01.357 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:13:01.357 INFO:teuthology.orchestra.run.smithi159.stdout:===================================================================================================== 2022-02-02T18:13:01.357 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:01.357 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2022-02-02T18:13:01.358 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:13:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-02-02T18:13:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-02-02T18:13:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-02-02T18:13:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-02-02T18:13:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-02-02T18:13:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-02-02T18:13:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-02-02T18:13:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:01.360 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:01.360 INFO:teuthology.orchestra.run.smithi159.stdout:===================================================================================================== 2022-02-02T18:13:01.360 INFO:teuthology.orchestra.run.smithi159.stdout:Install 8 Packages 2022-02-02T18:13:01.361 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:01.362 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 37 M 2022-02-02T18:13:01.363 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 210 M 2022-02-02T18:13:01.363 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:01.548 INFO:teuthology.orchestra.run.smithi159.stdout:(1/8): openblas-0.3.15-3.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2022-02-02T18:13:01.649 INFO:teuthology.orchestra.run.smithi159.stdout:(2/8): ceph-mgr-diskprediction-local-16.2.4-0.e 30 MB/s | 8.6 MB 00:00 2022-02-02T18:13:01.692 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:01.782 INFO:teuthology.orchestra.run.smithi159.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 16 MB/s | 3.7 MB 00:00 2022-02-02T18:13:01.807 INFO:teuthology.orchestra.run.smithi159.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.4 MB/s | 225 kB 00:00 2022-02-02T18:13:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T18:13:01.949 INFO:teuthology.orchestra.run.smithi159.stdout:(5/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 8.2 MB/s | 4.9 MB 00:00 2022-02-02T18:13:02.016 INFO:teuthology.orchestra.run.smithi159.stdout:(6/8): libgfortran-8.5.0-10.el8.x86_64.rpm 3.0 MB/s | 643 kB 00:00 2022-02-02T18:13:02.034 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T18:13:02.042 INFO:teuthology.orchestra.run.smithi159.stdout:(7/8): libquadmath-8.5.0-10.el8.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2022-02-02T18:13:02.192 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T18:13:02.292 INFO:teuthology.orchestra.run.smithi159.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 27 MB/s | 14 MB 00:00 2022-02-02T18:13:02.294 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:02.295 INFO:teuthology.orchestra.run.smithi159.stdout:Total 39 MB/s | 37 MB 00:00 2022-02-02T18:13:02.530 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:02.548 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:02.549 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T18:13:02.863 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:02.866 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:02.951 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:03.448 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:03.582 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T18:13:03.749 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T18:13:03.750 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T18:13:03.866 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T18:13:04.434 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T18:13:04.488 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T18:13:04.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:04.804 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T18:13:05.042 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T18:13:05.309 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:05.463 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T18:13:06.143 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T18:13:06.518 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T18:13:06.773 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T18:13:06.783 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T18:13:08.112 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-02-02T18:13:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T18:13:08.529 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T18:13:08.602 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T18:13:08.602 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2022-02-02T18:13:08.603 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-02-02T18:13:08.603 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:08.603 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-02-02T18:13:08.603 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T18:13:08.604 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-02-02T18:13:08.604 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 7/8 2022-02-02T18:13:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 8/8 2022-02-02T18:13:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:09.014 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2022-02-02T18:13:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-02-02T18:13:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-02-02T18:13:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.15-3.el8.x86_64 2022-02-02T18:13:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-02-02T18:13:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-02-02T18:13:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-02-02T18:13:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-02-02T18:13:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:09.016 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:09.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-rook 2022-02-02T18:13:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:09.677 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:33 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:09.882 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-02-02T18:13:10.098 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T18:13:10.386 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T18:13:10.387 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2022-02-02T18:13:10.387 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-02-02T18:13:10.387 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-02-02T18:13:10.387 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-02-02T18:13:10.388 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T18:13:10.388 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-02-02T18:13:10.388 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 7/8 2022-02-02T18:13:10.455 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:10.456 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:10.457 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:13:10.457 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:10.457 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:10.457 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2022-02-02T18:13:10.457 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:13:10.458 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-02-02T18:13:10.458 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-02-02T18:13:10.458 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-02-02T18:13:10.458 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-02-02T18:13:10.459 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-02-02T18:13:10.459 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-02-02T18:13:10.459 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-02-02T18:13:10.459 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-02-02T18:13:10.459 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-02-02T18:13:10.460 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-02-02T18:13:10.460 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-02-02T18:13:10.460 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-02-02T18:13:10.460 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:10.460 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:Install 13 Packages 2022-02-02T18:13:10.461 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 1.9 M 2022-02-02T18:13:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 24 M 2022-02-02T18:13:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:10.513 INFO:teuthology.orchestra.run.smithi096.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 508 kB/s | 27 kB 00:00 2022-02-02T18:13:10.546 INFO:teuthology.orchestra.run.smithi096.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 307 kB/s | 27 kB 00:00 2022-02-02T18:13:10.597 INFO:teuthology.orchestra.run.smithi096.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 146 kB/s | 20 kB 00:00 2022-02-02T18:13:10.622 INFO:teuthology.orchestra.run.smithi096.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 4.4 MB/s | 110 kB 00:00 2022-02-02T18:13:10.647 INFO:teuthology.orchestra.run.smithi096.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2022-02-02T18:13:10.673 INFO:teuthology.orchestra.run.smithi096.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 846 kB/s | 43 kB 00:00 2022-02-02T18:13:10.698 INFO:teuthology.orchestra.run.smithi096.stdout:(7/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 685 kB/s | 126 kB 00:00 2022-02-02T18:13:10.782 INFO:teuthology.orchestra.run.smithi096.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2022-02-02T18:13:10.807 INFO:teuthology.orchestra.run.smithi096.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2022-02-02T18:13:10.827 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 8/8 2022-02-02T18:13:10.828 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:10.828 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:10.828 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2022-02-02T18:13:10.828 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-02-02T18:13:10.829 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-02-02T18:13:10.829 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.15-3.el8.x86_64 2022-02-02T18:13:10.829 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-02-02T18:13:10.829 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-02-02T18:13:10.829 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-02-02T18:13:10.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-02-02T18:13:10.830 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:10.830 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:10.832 INFO:teuthology.orchestra.run.smithi096.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 608 kB/s | 81 kB 00:00 2022-02-02T18:13:10.916 INFO:teuthology.orchestra.run.smithi096.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 566 kB/s | 61 kB 00:00 2022-02-02T18:13:10.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-rook 2022-02-02T18:13:10.941 INFO:teuthology.orchestra.run.smithi096.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 564 kB/s | 61 kB 00:00 2022-02-02T18:13:11.108 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:11.109 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:11.350 INFO:teuthology.orchestra.run.smithi096.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.1 MB/s | 1.2 MB 00:00 2022-02-02T18:13:11.352 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:11.352 INFO:teuthology.orchestra.run.smithi096.stdout:Total 2.1 MB/s | 1.9 MB 00:00 2022-02-02T18:13:11.412 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:11.428 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:11.428 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:11.492 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:34 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:11.507 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:11.510 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:12.277 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:12.278 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:12.279 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:13:12.279 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:12.279 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:12.279 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2022-02-02T18:13:12.280 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:13:12.280 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-02-02T18:13:12.280 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-02-02T18:13:12.280 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-02-02T18:13:12.280 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-02-02T18:13:12.281 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-02-02T18:13:12.281 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-02-02T18:13:12.281 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-02-02T18:13:12.281 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-02-02T18:13:12.281 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-02-02T18:13:12.282 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-02-02T18:13:12.282 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-02-02T18:13:12.282 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-02-02T18:13:12.282 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:12.282 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:12.283 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:12.283 INFO:teuthology.orchestra.run.smithi159.stdout:Install 13 Packages 2022-02-02T18:13:12.283 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:12.284 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 1.9 M 2022-02-02T18:13:12.284 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 24 M 2022-02-02T18:13:12.284 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:12.368 INFO:teuthology.orchestra.run.smithi159.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 312 kB/s | 27 kB 00:00 2022-02-02T18:13:12.490 INFO:teuthology.orchestra.run.smithi159.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 128 kB/s | 27 kB 00:00 2022-02-02T18:13:12.778 INFO:teuthology.orchestra.run.smithi159.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 40 kB/s | 20 kB 00:00 2022-02-02T18:13:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:13.050 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-02-02T18:13:13.117 INFO:teuthology.orchestra.run.smithi159.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 325 kB/s | 110 kB 00:00 2022-02-02T18:13:13.248 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-02-02T18:13:13.312 INFO:teuthology.orchestra.run.smithi159.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 291 kB/s | 155 kB 00:00 2022-02-02T18:13:13.337 INFO:teuthology.orchestra.run.smithi159.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 131 kB/s | 126 kB 00:00 2022-02-02T18:13:13.362 INFO:teuthology.orchestra.run.smithi159.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 174 kB/s | 43 kB 00:00 2022-02-02T18:13:13.467 INFO:teuthology.orchestra.run.smithi159.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 125 kB/s | 16 kB 00:00 2022-02-02T18:13:13.485 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-02-02T18:13:13.497 INFO:teuthology.orchestra.run.smithi159.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 179 kB/s | 33 kB 00:00 2022-02-02T18:13:13.522 INFO:teuthology.orchestra.run.smithi159.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 511 kB/s | 81 kB 00:00 2022-02-02T18:13:13.589 INFO:teuthology.orchestra.run.smithi159.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 671 kB/s | 61 kB 00:00 2022-02-02T18:13:13.614 INFO:teuthology.orchestra.run.smithi159.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 667 kB/s | 61 kB 00:00 2022-02-02T18:13:13.680 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-02-02T18:13:13.895 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-02-02T18:13:14.014 INFO:teuthology.orchestra.run.smithi159.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.1 MB/s | 1.2 MB 00:00 2022-02-02T18:13:14.017 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:14.017 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.1 MB/s | 1.9 MB 00:01 2022-02-02T18:13:14.082 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:14.093 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-02-02T18:13:14.099 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:14.099 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:14.179 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:14.182 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:14.401 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-02-02T18:13:14.651 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-02-02T18:13:14.732 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:15.009 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-02-02T18:13:15.207 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-02-02T18:13:15.417 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-02-02T18:13:15.630 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-02-02T18:13:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-02-02T18:13:15.864 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-02-02T18:13:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-02-02T18:13:16.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-02-02T18:13:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-02-02T18:13:16.397 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-02-02T18:13:16.415 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-02-02T18:13:16.556 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T18:13:16.687 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-02-02T18:13:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T18:13:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2022-02-02T18:13:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-02-02T18:13:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-02-02T18:13:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-02-02T18:13:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-02-02T18:13:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-02-02T18:13:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-02-02T18:13:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-02-02T18:13:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-02-02T18:13:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-02-02T18:13:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-02-02T18:13:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-02-02T18:13:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-02-02T18:13:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:17.294 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2022-02-02T18:13:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-02-02T18:13:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-02-02T18:13:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-02-02T18:13:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-02-02T18:13:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-02-02T18:13:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-02-02T18:13:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-02-02T18:13:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-02-02T18:13:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-02-02T18:13:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-02-02T18:13:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.8-1.el8.noarch 2022-02-02T18:13:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-02-02T18:13:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:17.298 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:17.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-cephadm 2022-02-02T18:13:17.549 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:17.749 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-02-02T18:13:17.930 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:41 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:18.029 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-02-02T18:13:18.263 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-02-02T18:13:18.495 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-02-02T18:13:18.716 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:18.717 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:18.718 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2022-02-02T18:13:18.718 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:18.718 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:18.718 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2022-02-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-02-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-02-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-02-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-02-02T18:13:18.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-02-02T18:13:18.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:18.720 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:18.720 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:18.721 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2022-02-02T18:13:18.721 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:18.722 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 5.8 M 2022-02-02T18:13:18.722 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 24 M 2022-02-02T18:13:18.722 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:18.767 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.9 MB/s | 89 kB 00:00 2022-02-02T18:13:18.809 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.9 MB/s | 538 kB 00:00 2022-02-02T18:13:18.914 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T18:13:18.940 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2022-02-02T18:13:18.968 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 106 kB/s | 21 kB 00:00 2022-02-02T18:13:19.085 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 339 kB/s | 49 kB 00:00 2022-02-02T18:13:19.177 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 968 kB/s | 355 kB 00:00 2022-02-02T18:13:19.178 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:19.178 INFO:teuthology.orchestra.run.smithi096.stdout:Total 13 MB/s | 5.8 MB 00:00 2022-02-02T18:13:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T18:13:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2022-02-02T18:13:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-02-02T18:13:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-02-02T18:13:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-02-02T18:13:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-02-02T18:13:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-02-02T18:13:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-02-02T18:13:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-02-02T18:13:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-02-02T18:13:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-02-02T18:13:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-02-02T18:13:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-02-02T18:13:19.231 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:19.241 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:19.242 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:19.343 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:19.345 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:19.617 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:19.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-02-02T18:13:19.620 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:19.620 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:19.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2022-02-02T18:13:19.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-02-02T18:13:19.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-02-02T18:13:19.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-02-02T18:13:19.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-02-02T18:13:19.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-02-02T18:13:19.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-02-02T18:13:19.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-02-02T18:13:19.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-02-02T18:13:19.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-02-02T18:13:19.622 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-02-02T18:13:19.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.8-1.el8.noarch 2022-02-02T18:13:19.623 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-02-02T18:13:19.623 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:19.623 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:19.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-cephadm 2022-02-02T18:13:19.888 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2022-02-02T18:13:19.927 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:19.927 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2022-02-02T18:13:20.310 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:43 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:21.045 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2022-02-02T18:13:21.096 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:21.097 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:21.098 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-02-02T18:13:21.098 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:21.098 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:21.098 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2022-02-02T18:13:21.099 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:13:21.099 INFO:teuthology.orchestra.run.smithi159.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-02-02T18:13:21.099 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-02-02T18:13:21.099 INFO:teuthology.orchestra.run.smithi159.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-02-02T18:13:21.099 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-02-02T18:13:21.100 INFO:teuthology.orchestra.run.smithi159.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-02-02T18:13:21.100 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:21.100 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:21.100 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:21.101 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2022-02-02T18:13:21.101 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:21.102 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 5.8 M 2022-02-02T18:13:21.102 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 24 M 2022-02-02T18:13:21.102 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:21.156 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.6 MB/s | 89 kB 00:00 2022-02-02T18:13:21.189 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.9 MB/s | 538 kB 00:00 2022-02-02T18:13:21.323 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2022-02-02T18:13:21.340 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 116 kB/s | 21 kB 00:00 2022-02-02T18:13:21.390 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 732 kB/s | 49 kB 00:00 2022-02-02T18:13:21.441 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2022-02-02T18:13:21.457 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.3 MB/s | 355 kB 00:00 2022-02-02T18:13:21.459 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:21.459 INFO:teuthology.orchestra.run.smithi159.stdout:Total 16 MB/s | 5.8 MB 00:00 2022-02-02T18:13:21.512 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:21.522 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:21.522 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:21.621 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:21.624 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2022-02-02T18:13:21.871 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:13:21.920 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:22.129 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:13:22.129 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2022-02-02T18:13:22.130 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2022-02-02T18:13:22.130 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2022-02-02T18:13:22.130 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2022-02-02T18:13:22.130 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2022-02-02T18:13:22.221 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2022-02-02T18:13:22.474 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2022-02-02T18:13:22.500 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2022-02-02T18:13:22.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:22.501 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:22.501 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2022-02-02T18:13:22.501 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2022-02-02T18:13:22.501 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2022-02-02T18:13:22.502 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:22.502 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:22.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-fuse 2022-02-02T18:13:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:23.150 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:47 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:23.378 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2022-02-02T18:13:23.782 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2022-02-02T18:13:23.920 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:23.921 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:23.922 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:23.922 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:23.923 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2022-02-02T18:13:23.923 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2022-02-02T18:13:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-02-02T18:13:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:23.925 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:23.925 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:23.926 INFO:teuthology.orchestra.run.smithi096.stdout:Install 2 Packages 2022-02-02T18:13:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:23.927 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 967 k 2022-02-02T18:13:23.927 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 3.2 M 2022-02-02T18:13:23.927 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:23.988 INFO:teuthology.orchestra.run.smithi096.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 13 MB/s | 885 kB 00:00 2022-02-02T18:13:24.013 INFO:teuthology.orchestra.run.smithi096.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 907 kB/s | 82 kB 00:00 2022-02-02T18:13:24.014 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:24.015 INFO:teuthology.orchestra.run.smithi096.stdout:Total 10 MB/s | 967 kB 00:00 2022-02-02T18:13:24.025 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:24.043 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2022-02-02T18:13:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:24.126 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:24.129 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:24.291 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:24.554 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2022-02-02T18:13:24.746 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T18:13:24.796 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:13:25.050 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T18:13:25.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2022-02-02T18:13:25.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2022-02-02T18:13:25.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2022-02-02T18:13:25.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2022-02-02T18:13:25.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2022-02-02T18:13:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T18:13:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2022-02-02T18:13:25.428 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2022-02-02T18:13:25.429 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:25.429 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:25.429 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2022-02-02T18:13:25.429 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2022-02-02T18:13:25.429 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2022-02-02T18:13:25.430 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:25.430 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:25.442 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2022-02-02T18:13:25.442 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:25.443 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:25.443 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2022-02-02T18:13:25.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:25.443 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:25.524 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-fuse 2022-02-02T18:13:25.659 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados-devel 2022-02-02T18:13:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:26.089 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:49 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:50 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:26.853 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:26.854 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:26.854 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:26.855 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:26.855 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:26.855 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2022-02-02T18:13:26.855 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-02-02T18:13:26.856 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-02-02T18:13:26.856 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:26.856 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:26.856 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:26.856 INFO:teuthology.orchestra.run.smithi159.stdout:Install 2 Packages 2022-02-02T18:13:26.857 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:26.857 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 967 k 2022-02-02T18:13:26.857 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 3.2 M 2022-02-02T18:13:26.857 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:26.924 INFO:teuthology.orchestra.run.smithi159.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 13 MB/s | 885 kB 00:00 2022-02-02T18:13:26.949 INFO:teuthology.orchestra.run.smithi159.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 879 kB/s | 82 kB 00:00 2022-02-02T18:13:26.951 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:26.951 INFO:teuthology.orchestra.run.smithi159.stdout:Total 9.8 MB/s | 967 kB 00:00 2022-02-02T18:13:26.961 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:26.982 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:26.982 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:27.043 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:27.044 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:27.044 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:27.044 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:27.045 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:27.045 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2022-02-02T18:13:27.045 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:27.045 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:27.046 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:27.046 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:13:27.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:27.046 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 131 k 2022-02-02T18:13:27.046 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 439 k 2022-02-02T18:13:27.047 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:27.062 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:27.065 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:27.110 INFO:teuthology.orchestra.run.smithi096.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.0 MB/s | 131 kB 00:00 2022-02-02T18:13:27.111 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:27.111 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.9 MB/s | 131 kB 00:00 2022-02-02T18:13:27.111 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:27.117 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:27.118 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:27.166 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:27.169 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:27.227 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:27.285 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:27.494 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:27.521 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2022-02-02T18:13:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T18:13:27.752 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:28.093 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T18:13:28.093 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2022-02-02T18:13:28.168 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:28.169 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:28.169 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:28.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs2 2022-02-02T18:13:28.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2022-02-02T18:13:28.457 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:28.457 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:28.457 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2022-02-02T18:13:28.458 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:28.458 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:28.515 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:28.515 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:28.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados-devel 2022-02-02T18:13:28.889 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:28.889 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:28.906 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:52 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:29.278 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:52 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:29.656 INFO:teuthology.orchestra.run.smithi096.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:29.701 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:29.702 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:29.703 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:29.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs-devel 2022-02-02T18:13:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:29.961 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:30.050 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:30.052 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:30.052 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:30.053 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:30.053 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2022-02-02T18:13:30.054 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:30.054 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:30.055 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:30.055 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:13:30.056 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:30.056 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 131 k 2022-02-02T18:13:30.057 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 439 k 2022-02-02T18:13:30.057 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:30.131 INFO:teuthology.orchestra.run.smithi159.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 1.6 MB/s | 131 kB 00:00 2022-02-02T18:13:30.133 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:30.133 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.6 MB/s | 131 kB 00:00 2022-02-02T18:13:30.134 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:30.138 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:30.139 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:30.186 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:30.189 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:30.308 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:30.342 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:54 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:30.535 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:30.816 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:31.148 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:31.149 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:31.149 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:31.150 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:31.150 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:31.150 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2022-02-02T18:13:31.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:31.151 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:31.151 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:31.151 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:13:31.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 24 k 2022-02-02T18:13:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 94 k 2022-02-02T18:13:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:31.178 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:31.179 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:31.179 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:31.179 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:31.179 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:31.179 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:31.199 INFO:teuthology.orchestra.run.smithi096.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 490 kB/s | 24 kB 00:00 2022-02-02T18:13:31.200 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:31.200 INFO:teuthology.orchestra.run.smithi096.stdout:Total 479 kB/s | 24 kB 00:00 2022-02-02T18:13:31.201 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:31.205 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:31.205 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:31.207 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:31.210 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:31.255 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:31.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs2 2022-02-02T18:13:31.443 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:31.601 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:31.601 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:31.991 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:54 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:32.009 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:32.010 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:32.010 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:32.010 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:32.010 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:32.011 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:32.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados2 2022-02-02T18:13:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:32.657 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:56 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:32.746 INFO:teuthology.orchestra.run.smithi159.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:32.790 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:32.792 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:32.792 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:32.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs-devel 2022-02-02T18:13:33.058 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:33.058 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:33.392 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:33.440 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:33.441 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:33.442 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:56 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:33.512 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librbd1 2022-02-02T18:13:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:34.072 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:58 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:34.232 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:34.233 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:34.234 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:34.234 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2022-02-02T18:13:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:34.235 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:34.236 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:34.236 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:13:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:34.236 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 24 k 2022-02-02T18:13:34.237 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 94 k 2022-02-02T18:13:34.237 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:34.268 INFO:teuthology.orchestra.run.smithi159.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 715 kB/s | 24 kB 00:00 2022-02-02T18:13:34.269 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:34.269 INFO:teuthology.orchestra.run.smithi159.stdout:Total 690 kB/s | 24 kB 00:00 2022-02-02T18:13:34.269 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:34.273 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:34.273 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:34.275 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:34.278 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:34.351 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:34.801 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:34.846 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:34.847 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:34.847 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:34.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rados 2022-02-02T18:13:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:35.510 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:59 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:35.612 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:35.612 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:35.612 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:35.612 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:35.613 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:35.613 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:35.718 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados2 2022-02-02T18:13:35.896 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:35.897 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:36.270 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:36.279 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:59 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:36.315 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:36.316 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:36.397 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rgw 2022-02-02T18:13:36.573 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:36.574 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:36.974 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:00 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:37.020 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:37.066 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:37.067 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:37.068 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:37.150 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librbd1 2022-02-02T18:13:37.328 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:37.328 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:37.711 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:00 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:37.711 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:37.757 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:37.758 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:37.758 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:37.852 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-cephfs 2022-02-02T18:13:38.029 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:38.029 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:38.414 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:02 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:38.484 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:38.529 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:38.530 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:38.531 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:38.615 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rados 2022-02-02T18:13:38.795 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:38.795 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:39.175 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:39.181 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:02 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:39.220 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:39.221 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:39.295 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rbd 2022-02-02T18:13:39.472 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:39.473 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:39.856 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:03 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:39.924 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:39.970 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:39.972 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:39.972 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:40.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rgw 2022-02-02T18:13:40.233 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:40.234 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:40.594 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:40.623 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:03 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2022-02-02T18:13:40.640 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:40.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-fuse 2022-02-02T18:13:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:41.394 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:41.440 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:05 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:41.441 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:41.441 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:41.441 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:41.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-cephfs 2022-02-02T18:13:42.141 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:42.141 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:42.230 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:42.231 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:42.231 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:42.231 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:42.231 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:42.232 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2022-02-02T18:13:42.232 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:42.232 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:42.232 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:42.233 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:13:42.233 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:42.233 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 89 k 2022-02-02T18:13:42.233 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 298 k 2022-02-02T18:13:42.234 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:42.280 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.8 MB/s | 89 kB 00:00 2022-02-02T18:13:42.281 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:42.282 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.7 MB/s | 89 kB 00:00 2022-02-02T18:13:42.282 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:42.291 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:42.291 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:42.342 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:42.344 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:42.473 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:42.524 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:05 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:42.649 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:42.929 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:43.268 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:43.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:43.268 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:43.268 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:43.269 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:43.269 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:43.290 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:43.336 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:43.337 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:43.337 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:43.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rbd 2022-02-02T18:13:43.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-mirror 2022-02-02T18:13:43.599 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:43.600 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:43.643 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:43.643 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:43.990 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:06 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:44.028 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:08 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:44.759 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T18:13:44.803 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:44.804 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2022-02-02T18:13:44.804 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:44.818 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:44.819 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T18:13:44.819 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:44.819 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:44.819 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:44.820 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:13:44.820 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:44.821 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 3.7 M 2022-02-02T18:13:44.821 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 18 M 2022-02-02T18:13:44.822 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:44.887 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-fuse 2022-02-02T18:13:44.934 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 32 MB/s | 3.7 MB 00:00 2022-02-02T18:13:44.935 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:44.935 INFO:teuthology.orchestra.run.smithi096.stdout:Total 32 MB/s | 3.7 MB 00:00 2022-02-02T18:13:44.936 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:44.947 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:44.947 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:45.009 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:45.012 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:45.065 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:45.065 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:45.449 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:08 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:45.472 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:45.660 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:46.044 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:46.221 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:46.223 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:46.223 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:46.224 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2022-02-02T18:13:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:46.225 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:46.226 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:46.226 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:13:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:46.227 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 89 k 2022-02-02T18:13:46.227 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 298 k 2022-02-02T18:13:46.227 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:46.295 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.2 MB/s | 89 kB 00:00 2022-02-02T18:13:46.295 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:46.296 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.2 MB/s | 89 kB 00:00 2022-02-02T18:13:46.296 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:46.305 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:46.306 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:46.353 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:46.356 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:46.459 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:46.612 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:46.613 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:46.613 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:46.614 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:46.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:46.615 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:46.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:46.763 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-nbd 2022-02-02T18:13:46.944 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:46.945 INFO:teuthology.orchestra.run.smithi096.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:47.037 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:47.330 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:11 ago on Wed 02 Feb 2022 06:11:36 PM UTC. 2022-02-02T18:13:47.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:47.427 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:47.427 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:47.427 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:47.428 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:47.428 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:47.664 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-mirror 2022-02-02T18:13:47.843 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:47.843 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:48.147 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2022-02-02T18:13:48.148 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:48.148 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:48.148 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:48.149 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2022-02-02T18:13:48.149 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2022-02-02T18:13:48.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:48.149 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2022-02-02T18:13:48.149 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2022-02-02T18:13:48.150 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2022-02-02T18:13:48.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:48.150 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 173 k 2022-02-02T18:13:48.150 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 649 k 2022-02-02T18:13:48.151 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2022-02-02T18:13:48.191 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 4.0 MB/s | 173 kB 00:00 2022-02-02T18:13:48.192 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:48.192 INFO:teuthology.orchestra.run.smithi096.stdout:Total 3.9 MB/s | 173 kB 00:00 2022-02-02T18:13:48.193 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2022-02-02T18:13:48.203 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2022-02-02T18:13:48.203 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2022-02-02T18:13:48.234 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:11 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:48.253 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2022-02-02T18:13:48.256 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2022-02-02T18:13:48.365 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2022-02-02T18:13:48.564 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:48.806 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:49.043 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:49.044 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:49.044 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:49.044 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:49.044 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:49.045 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T18:13:49.045 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:49.045 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:49.045 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:49.046 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:13:49.046 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:49.046 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 3.7 M 2022-02-02T18:13:49.046 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 18 M 2022-02-02T18:13:49.046 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:49.169 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:49.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:49.170 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2022-02-02T18:13:49.170 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:49.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:13:49.170 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2022-02-02T18:13:49.178 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 28 MB/s | 3.7 MB 00:00 2022-02-02T18:13:49.179 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:49.180 INFO:teuthology.orchestra.run.smithi159.stdout:Total 27 MB/s | 3.7 MB 00:00 2022-02-02T18:13:49.180 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:49.192 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:49.192 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:49.254 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:49.257 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:49.331 DEBUG:teuthology.parallel:result is None 2022-02-02T18:13:49.718 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:50.310 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:50.706 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:50.707 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:50.707 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:50.707 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:50.708 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:50.708 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:50.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-nbd 2022-02-02T18:13:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T18:13:51.526 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:14 ago on Wed 02 Feb 2022 06:11:37 PM UTC. 2022-02-02T18:13:52.332 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-02-02T18:13:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:52.333 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2022-02-02T18:13:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:52.334 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-02-02T18:13:52.334 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2022-02-02T18:13:52.334 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:52.335 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-02-02T18:13:52.335 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2022-02-02T18:13:52.335 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2022-02-02T18:13:52.336 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:52.336 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 173 k 2022-02-02T18:13:52.337 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 649 k 2022-02-02T18:13:52.337 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-02-02T18:13:52.376 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 4.0 MB/s | 173 kB 00:00 2022-02-02T18:13:52.377 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-02-02T18:13:52.377 INFO:teuthology.orchestra.run.smithi159.stdout:Total 3.9 MB/s | 173 kB 00:00 2022-02-02T18:13:52.377 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-02-02T18:13:52.387 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-02-02T18:13:52.388 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-02-02T18:13:52.437 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-02-02T18:13:52.440 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-02-02T18:13:52.551 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-02-02T18:13:52.765 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:53.360 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T18:13:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:53.361 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-02-02T18:13:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2022-02-02T18:13:53.362 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:13:53.362 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-02-02T18:13:53.562 DEBUG:teuthology.parallel:result is None 2022-02-02T18:13:53.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2022-02-02T18:13:53.605 INFO:teuthology.orchestra.run.smithi096.stdout:CentOSStream 2022-02-02T18:13:53.607 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:13:53.608 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:13:53.608 INFO:teuthology.packaging:ref: None 2022-02-02T18:13:53.608 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:13:53.609 INFO:teuthology.packaging:branch: None 2022-02-02T18:13:53.609 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:13:53.646 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:13:53.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:13:53.892 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-02-02T18:13:53.918 INFO:teuthology.orchestra.run.smithi096.stdout:16.2.4-0.el8 2022-02-02T18:13:53.919 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2022-02-02T18:13:53.920 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2022-02-02T18:13:53.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-02-02T18:13:53.955 INFO:teuthology.orchestra.run.smithi159.stdout:CentOSStream 2022-02-02T18:13:53.957 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T18:13:53.957 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T18:13:53.958 INFO:teuthology.packaging:ref: None 2022-02-02T18:13:53.958 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T18:13:53.958 INFO:teuthology.packaging:branch: None 2022-02-02T18:13:53.959 INFO:teuthology.packaging:sha1: 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:13:53.988 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:13:53.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T18:13:54.201 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-02-02T18:13:54.223 INFO:teuthology.orchestra.run.smithi159.stdout:16.2.4-0.el8 2022-02-02T18:13:54.224 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2022-02-02T18:13:54.224 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2022-02-02T18:13:54.225 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-02-02T18:13:54.225 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:13:54.226 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-02-02T18:13:54.257 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:13:54.257 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-02-02T18:13:54.289 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-02-02T18:13:54.289 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:13:54.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2022-02-02T18:13:54.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-02-02T18:13:54.393 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:13:54.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2022-02-02T18:13:54.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-02-02T18:13:54.485 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-02-02T18:13:54.486 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:13:54.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2022-02-02T18:13:54.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-02-02T18:13:54.582 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:13:54.582 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2022-02-02T18:13:54.607 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-02-02T18:13:54.672 INFO:teuthology.run_tasks:Running task print... 2022-02-02T18:13:54.683 INFO:teuthology.task.print:**** done install task... 2022-02-02T18:13:54.683 INFO:teuthology.run_tasks:Running task cephadm... 2022-02-02T18:13:54.777 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '78571b80ad21c56cce214a3fbfb0b1a080f78167'} 2022-02-02T18:13:54.778 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2022-02-02T18:13:54.779 INFO:tasks.cephadm:Cluster fsid is e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:13:54.779 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2022-02-02T18:13:54.780 INFO:tasks.cephadm:No mon roles; fabricating mons 2022-02-02T18:13:54.780 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi096': '172.21.15.96', 'mon.smithi159': '172.21.15.159'} 2022-02-02T18:13:54.780 INFO:tasks.cephadm:Normalizing hostnames... 2022-02-02T18:13:54.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname $(hostname -s) 2022-02-02T18:13:54.808 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2022-02-02T18:13:54.834 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2022-02-02T18:13:54.835 DEBUG:teuthology.orchestra.run.smithi096:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.030 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 2 18:13 /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.031 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.126 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 2 18:13 /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.126 DEBUG:teuthology.orchestra.run.smithi096:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.145 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-02-02T18:13:55.171 INFO:tasks.cephadm:Pulling image docker.io/ceph/ceph:v16.2.4 on all hosts... 2022-02-02T18:13:55.172 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 pull 2022-02-02T18:13:55.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 pull 2022-02-02T18:13:56.925 INFO:teuthology.orchestra.run.smithi096.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T18:13:57.365 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T18:14:11.632 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2022-02-02T18:14:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)", 2022-02-02T18:14:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", 2022-02-02T18:14:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2022-02-02T18:14:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", 2022-02-02T18:14:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "docker.io/ceph/ceph@sha256:70536e31b29a4241999ec4fd13d93e5860a5ffdc5467911e57e6bf04dfe68337" 2022-02-02T18:14:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2022-02-02T18:14:11.634 INFO:teuthology.orchestra.run.smithi159.stdout:} 2022-02-02T18:14:11.986 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:14:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)", 2022-02-02T18:14:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", 2022-02-02T18:14:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "repo_digests": [ 2022-02-02T18:14:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", 2022-02-02T18:14:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: "docker.io/ceph/ceph@sha256:70536e31b29a4241999ec4fd13d93e5860a5ffdc5467911e57e6bf04dfe68337" 2022-02-02T18:14:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2022-02-02T18:14:11.988 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:14:12.006 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph 2022-02-02T18:14:12.035 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2022-02-02T18:14:12.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /etc/ceph 2022-02-02T18:14:12.101 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2022-02-02T18:14:12.130 INFO:tasks.cephadm:Writing seed config... 2022-02-02T18:14:12.132 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2022-02-02T18:14:12.132 INFO:tasks.cephadm: override: [client] debug client = 20 2022-02-02T18:14:12.133 INFO:tasks.cephadm: override: [client] debug ms = 1 2022-02-02T18:14:12.133 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2022-02-02T18:14:12.134 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2022-02-02T18:14:12.134 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2022-02-02T18:14:12.135 INFO:tasks.cephadm: override: [mds] debug mds = 20 2022-02-02T18:14:12.135 INFO:tasks.cephadm: override: [mds] debug ms = 1 2022-02-02T18:14:12.135 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2022-02-02T18:14:12.136 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2022-02-02T18:14:12.136 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2022-02-02T18:14:12.136 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2022-02-02T18:14:12.137 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2022-02-02T18:14:12.137 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2022-02-02T18:14:12.138 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2022-02-02T18:14:12.138 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2022-02-02T18:14:12.138 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2022-02-02T18:14:12.139 INFO:tasks.cephadm: override: [mon] debug mon = 20 2022-02-02T18:14:12.139 INFO:tasks.cephadm: override: [mon] debug ms = 1 2022-02-02T18:14:12.139 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2022-02-02T18:14:12.140 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2022-02-02T18:14:12.140 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2022-02-02T18:14:12.140 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2022-02-02T18:14:12.141 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2022-02-02T18:14:12.141 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2022-02-02T18:14:12.141 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2022-02-02T18:14:12.142 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2022-02-02T18:14:12.142 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2022-02-02T18:14:12.142 INFO:tasks.cephadm: override: [osd] debug ms = 1 2022-02-02T18:14:12.143 INFO:tasks.cephadm: override: [osd] debug osd = 20 2022-02-02T18:14:12.143 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2022-02-02T18:14:12.143 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2022-02-02T18:14:12.144 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2022-02-02T18:14:12.144 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2022-02-02T18:14:12.144 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2022-02-02T18:14:12.144 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2022-02-02T18:14:12.145 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2022-02-02T18:14:12.146 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:14:12.146 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2022-02-02T18:14:12.162 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e1d78c58-8453-11ec-8c35-001a4aab830c mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2022-02-02T18:14:12.163 DEBUG:teuthology.orchestra.run.smithi096:mon.smithi096> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service 2022-02-02T18:14:12.205 INFO:tasks.cephadm:Bootstrapping... 2022-02-02T18:14:12.205 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid e1d78c58-8453-11ec-8c35-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.96 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2022-02-02T18:14:12.229 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:-- Logs begin at Wed 2022-02-02 18:05:35 UTC. -- 2022-02-02T18:14:12.391 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T18:14:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: 3.4.1-dev 2022-02-02T18:14:12.537 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying podman|docker is present... 2022-02-02T18:14:12.537 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T18:14:12.573 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: 3.4.1-dev 2022-02-02T18:14:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying lvm2 is present... 2022-02-02T18:14:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying time synchronization is in place... 2022-02-02T18:14:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled chrony.service 2022-02-02T18:14:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-02-02T18:14:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active chrony.service 2022-02-02T18:14:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:14:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled chronyd.service 2022-02-02T18:14:12.697 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: enabled 2022-02-02T18:14:12.699 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active chronyd.service 2022-02-02T18:14:12.702 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: active 2022-02-02T18:14:12.703 INFO:teuthology.orchestra.run.smithi096.stderr:Unit chronyd.service is enabled and running 2022-02-02T18:14:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:Repeating the final host check... 2022-02-02T18:14:12.704 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T18:14:12.739 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: 3.4.1-dev 2022-02-02T18:14:12.843 INFO:teuthology.orchestra.run.smithi096.stderr:podman|docker (/bin/podman) is present 2022-02-02T18:14:12.843 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl is present 2022-02-02T18:14:12.844 INFO:teuthology.orchestra.run.smithi096.stderr:lvcreate is present 2022-02-02T18:14:12.844 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled chrony.service 2022-02-02T18:14:12.848 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-02-02T18:14:12.849 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active chrony.service 2022-02-02T18:14:12.854 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:14:12.855 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled chronyd.service 2022-02-02T18:14:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: enabled 2022-02-02T18:14:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active chronyd.service 2022-02-02T18:14:12.865 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: active 2022-02-02T18:14:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:Unit chronyd.service is enabled and running 2022-02-02T18:14:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:Host looks OK 2022-02-02T18:14:12.867 INFO:teuthology.orchestra.run.smithi096.stderr:Cluster fsid: e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:12.867 INFO:teuthology.orchestra.run.smithi096.stderr:Acquiring lock 140677241420544 on /run/cephadm/e1d78c58-8453-11ec-8c35-001a4aab830c.lock 2022-02-02T18:14:12.867 INFO:teuthology.orchestra.run.smithi096.stderr:Lock 140677241420544 acquired on /run/cephadm/e1d78c58-8453-11ec-8c35-001a4aab830c.lock 2022-02-02T18:14:12.868 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying IP 172.21.15.96 port 3300 ... 2022-02-02T18:14:12.868 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying IP 172.21.15.96 port 6789 ... 2022-02-02T18:14:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:Base mon IP is 172.21.15.96, final addrv is [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2022-02-02T18:14:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /sbin/ip route ls 2022-02-02T18:14:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2022-02-02T18:14:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.96 metric 100 2022-02-02T18:14:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /sbin/ip -6 route ls 2022-02-02T18:14:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2022-02-02T18:14:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2022-02-02T18:14:12.873 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /sbin/ip -6 addr ls 2022-02-02T18:14:12.875 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2022-02-02T18:14:12.875 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: inet6 ::1/128 scope host 2022-02-02T18:14:12.875 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-02-02T18:14:12.875 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2022-02-02T18:14:12.876 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link noprefixroute 2022-02-02T18:14:12.876 INFO:teuthology.orchestra.run.smithi096.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-02-02T18:14:12.877 INFO:teuthology.orchestra.run.smithi096.stderr:Mon IP 172.21.15.96 is in CIDR network 172.21.0.0/20 2022-02-02T18:14:12.877 INFO:teuthology.orchestra.run.smithi096.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2022-02-02T18:14:12.877 INFO:teuthology.orchestra.run.smithi096.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T18:14:12.877 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2022-02-02T18:14:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2022-02-02T18:14:13.274 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Getting image source signatures 2022-02-02T18:14:13.274 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2022-02-02T18:14:13.275 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2022-02-02T18:14:13.275 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-02-02T18:14:13.333 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Writing manifest to image destination 2022-02-02T18:14:13.333 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: Storing signatures 2022-02-02T18:14:13.500 INFO:teuthology.orchestra.run.smithi096.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-02-02T18:14:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2022-02-02T18:14:14.002 INFO:teuthology.orchestra.run.smithi096.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-02-02T18:14:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-02-02T18:14:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:Extracting ceph user uid/gid from container image... 2022-02-02T18:14:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2022-02-02T18:14:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:stat: 167 167 2022-02-02T18:14:15.204 INFO:teuthology.orchestra.run.smithi096.stderr:Creating initial keys... 2022-02-02T18:14:15.204 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T18:14:15.596 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-authtool: AQD3yfphdGSWIhAAJkMBsxKHbMALYaL7v5O4JA== 2022-02-02T18:14:15.954 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T18:14:16.362 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-authtool: AQD4yfphAwDBFBAA5ecRwKbXGDgU8SA2zRLN4A== 2022-02-02T18:14:16.695 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T18:14:17.096 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-authtool: AQD5yfphk/fKBBAA2tsGdnis86BEaDBrlnRCHQ== 2022-02-02T18:14:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:Creating initial monmap... 2022-02-02T18:14:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpcyvv_6ws:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid e1d78c58-8453-11ec-8c35-001a4aab830c --addv smithi096 [v2:172.21.15.96:3300,v1:172.21.15.96:6789] /tmp/monmap 2022-02-02T18:14:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2022-02-02T18:14:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-02-02T18:14:18.183 INFO:teuthology.orchestra.run.smithi096.stderr:monmaptool for smithi096 [v2:172.21.15.96:3300,v1:172.21.15.96:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2022-02-02T18:14:18.183 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/monmaptool: set fsid to e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:18.184 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-02-02T18:14:18.184 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:14:18.184 INFO:teuthology.orchestra.run.smithi096.stderr:Creating mon... 2022-02-02T18:14:18.185 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096:/var/lib/ceph/mon/ceph-smithi096:z -v /tmp/ceph-tmp7xyi9lp8:/tmp/keyring:z -v /tmp/ceph-tmpcyvv_6ws:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi096 --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2022-02-02T18:14:18.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.575+0000 7f6847120700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T18:14:18.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.575+0000 7f6847120700 1 imported monmap: 2022-02-02T18:14:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: epoch 0 2022-02-02T18:14:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: last_changed 2022-02-02T18:14:17.785459+0000 2022-02-02T18:14:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: created 2022-02-02T18:14:17.785459+0000 2022-02-02T18:14:18.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2022-02-02T18:14:18.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: election_strategy: 1 2022-02-02T18:14:18.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.smithi096 2022-02-02T18:14:18.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.575+0000 7f6847120700 0 /usr/bin/ceph-mon: set fsid to e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T18:14:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T18:14:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Compile date May 13 2021 2022-02-02T18:14:18.652 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: DB SUMMARY 2022-02-02T18:14:18.652 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.652 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi096/store.db dir, Total Num: 0, files: 2022-02-02T18:14:18.652 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.652 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi096/store.db: 2022-02-02T18:14:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T18:14:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.create_if_missing: 1 2022-02-02T18:14:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T18:14:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.env: 0x560a0060a1c0 2022-02-02T18:14:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.fs: Posix File System 2022-02-02T18:14:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.info_log: 0x560a02050ec0 2022-02-02T18:14:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T18:14:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.statistics: (nil) 2022-02-02T18:14:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.use_fsync: 0 2022-02-02T18:14:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T18:14:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T18:14:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T18:14:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T18:14:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T18:14:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T18:14:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T18:14:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T18:14:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T18:14:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T18:14:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T18:14:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.db_log_dir: 2022-02-02T18:14:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi096/store.db 2022-02-02T18:14:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T18:14:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T18:14:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T18:14:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T18:14:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T18:14:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T18:14:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T18:14:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T18:14:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T18:14:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T18:14:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.write_buffer_manager: 0x560a02057530 2022-02-02T18:14:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T18:14:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T18:14:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T18:14:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T18:14:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T18:14:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T18:14:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T18:14:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T18:14:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T18:14:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.unordered_write: 0 2022-02-02T18:14:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T18:14:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T18:14:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T18:14:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T18:14:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.row_cache: None 2022-02-02T18:14:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.wal_filter: None 2022-02-02T18:14:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T18:14:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T18:14:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T18:14:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T18:14:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T18:14:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T18:14:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T18:14:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T18:14:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T18:14:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T18:14:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T18:14:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T18:14:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T18:14:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T18:14:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T18:14:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T18:14:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T18:14:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T18:14:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T18:14:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T18:14:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T18:14:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.max_open_files: -1 2022-02-02T18:14:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T18:14:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T18:14:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T18:14:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T18:14:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Compression algorithms supported: 2022-02-02T18:14:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T18:14:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kZSTD supported: 0 2022-02-02T18:14:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T18:14:18.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T18:14:18.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T18:14:18.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T18:14:18.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T18:14:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T18:14:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.576+0000 7f6847120700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T18:14:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.577+0000 7f6847120700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2022-02-02T18:14:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000001 2022-02-02T18:14:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T18:14:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T18:14:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.merge_operator: 2022-02-02T18:14:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_filter: None 2022-02-02T18:14:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T18:14:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T18:14:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T18:14:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560a01f68120) 2022-02-02T18:14:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2022-02-02T18:14:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T18:14:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T18:14:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2022-02-02T18:14:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: index_type: 0 2022-02-02T18:14:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2022-02-02T18:14:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: index_shortening: 1 2022-02-02T18:14:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2022-02-02T18:14:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2022-02-02T18:14:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: checksum: 1 2022-02-02T18:14:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2022-02-02T18:14:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_cache: 0x560a01f9ed10 2022-02-02T18:14:18.679 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2022-02-02T18:14:18.679 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_cache_options: 2022-02-02T18:14:18.679 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: capacity : 536870912 2022-02-02T18:14:18.679 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2022-02-02T18:14:18.680 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2022-02-02T18:14:18.680 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2022-02-02T18:14:18.680 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2022-02-02T18:14:18.680 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2022-02-02T18:14:18.681 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_size: 4096 2022-02-02T18:14:18.681 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2022-02-02T18:14:18.681 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2022-02-02T18:14:18.681 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2022-02-02T18:14:18.682 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2022-02-02T18:14:18.682 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: partition_filters: 0 2022-02-02T18:14:18.682 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2022-02-02T18:14:18.682 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T18:14:18.682 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2022-02-02T18:14:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: verify_compression: 0 2022-02-02T18:14:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2022-02-02T18:14:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: format_version: 2 2022-02-02T18:14:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2022-02-02T18:14:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: block_align: 0 2022-02-02T18:14:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T18:14:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T18:14:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression: NoCompression 2022-02-02T18:14:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T18:14:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T18:14:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T18:14:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.num_levels: 7 2022-02-02T18:14:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T18:14:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T18:14:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T18:14:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T18:14:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T18:14:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T18:14:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T18:14:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:14:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T18:14:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T18:14:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T18:14:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T18:14:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T18:14:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:14:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T18:14:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T18:14:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T18:14:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T18:14:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T18:14:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T18:14:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T18:14:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T18:14:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T18:14:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T18:14:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T18:14:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T18:14:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T18:14:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T18:14:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T18:14:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T18:14:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T18:14:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T18:14:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T18:14:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T18:14:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T18:14:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T18:14:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T18:14:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T18:14:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T18:14:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T18:14:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T18:14:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T18:14:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T18:14:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T18:14:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T18:14:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T18:14:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T18:14:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T18:14:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T18:14:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T18:14:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T18:14:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T18:14:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T18:14:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T18:14:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T18:14:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T18:14:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T18:14:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T18:14:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T18:14:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.ttl: 2592000 2022-02-02T18:14:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T18:14:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T18:14:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.580+0000 7f6847120700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-02-02T18:14:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.581+0000 7f6847120700 4 rocksdb: DB pointer 0x560a02063800 2022-02-02T18:14:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.581+0000 7f682ffb9700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T18:14:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.581+0000 7f682ffb9700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T18:14:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2022-02-02T18:14:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T18:14:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T18:14:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:14:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T18:14:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T18:14:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:14:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T18:14:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:14:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:14:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T18:14:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:18.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:18.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:18.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:18.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:14:18.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:14:18.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:14:18.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:18.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:18.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:14:18.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:14:18.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T18:14:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:18.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:14:18.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:14:18.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T18:14:18.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:18.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:18.718 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:18.718 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:18.718 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:18.718 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:14:18.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:14:18.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:14:18.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:18.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:18.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:14:18.720 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.720 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:14:18.720 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: 2022-02-02T18:14:18.720 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.582+0000 7f6847120700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2022-02-02T18:14:18.721 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.582+0000 7f6847120700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2022-02-02T18:14:18.721 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph-mon: debug 2022-02-02T18:14:18.582+0000 7f6847120700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi096 for mon.smithi096 2022-02-02T18:14:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:create mon.smithi096 on 2022-02-02T18:14:18.924 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl disable ceph.target 2022-02-02T18:14:18.935 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2022-02-02T18:14:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl enable ceph.target 2022-02-02T18:14:19.022 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2022-02-02T18:14:19.100 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl start ceph.target 2022-02-02T18:14:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl enable ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target 2022-02-02T18:14:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target. 2022-02-02T18:14:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target. 2022-02-02T18:14:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl start ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target 2022-02-02T18:14:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl daemon-reload 2022-02-02T18:14:19.274 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl stop ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096 2022-02-02T18:14:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl reset-failed ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096 2022-02-02T18:14:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Failed to reset failed state of unit ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service: Unit ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service not loaded. 2022-02-02T18:14:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl enable ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096 2022-02-02T18:14:19.308 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target.wants/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service → /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@.service. 2022-02-02T18:14:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl start ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096 2022-02-02T18:14:19.618 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 systemd[1]: Starting Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:14:19.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 podman[31337]: 2022-02-02T18:14:19.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 bash[31262]: 79efce3c7736db30bb5f1b0dbb28ee004ffaf5f80aac39fc1c2196b14d164a49 2022-02-02T18:14:19.916 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T18:14:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: disabled 2022-02-02T18:14:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T18:14:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:14:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:firewalld.service is not enabled 2022-02-02T18:14:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to enable service . firewalld.service is not available 2022-02-02T18:14:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-02-02T18:14:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mon to start... 2022-02-02T18:14:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mon... 2022-02-02T18:14:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096:/var/lib/ceph/mon/ceph-smithi096:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2022-02-02T18:14:20.127 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.866273+0000 mon.smithi096 (mon.0) 0 : [INF] mkfs e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:20.127 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 conmon[31376]: cluster 2022-02-02T18:14: 2022-02-02T18:14:20.127 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 conmon[31376]: 19.850169+0000 mon.smithi096 (mon.0) 1 : cluster [INF] mon.smithi096 is new leader, mons smithi096 in quorum (ranks 0) 2022-02-02T18:14:20.128 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:19 smithi096 systemd[1]: Started Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:14:20.380 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.376+0000 7fa63a17c700 1 Processor -- start 2022-02-02T18:14:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.376+0000 7fa63a17c700 1 -- start start 2022-02-02T18:14:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.376+0000 7fa63a17c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:20.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.376+0000 7fa63a17c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340feb20 con 0x7fa63406fbc0 2022-02-02T18:14:20.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.376+0000 7fa63917a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:20.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa63917a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51176/0 (socket says 172.21.15.96:51176) 2022-02-02T18:14:20.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa63917a700 1 -- 172.21.15.96:0/4202096831 learned_addr learned my addr 172.21.15.96:0/4202096831 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:20.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa63917a700 1 -- 172.21.15.96:0/4202096831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340fec60 con 0x7fa63406fbc0 2022-02-02T18:14:20.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa63917a700 1 --2- 172.21.15.96:0/4202096831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fa63000b5f0 tx=0x7fa630006ee0).ready entity=mon.0 client_cookie=515bc04cf7ee574f server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:20.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa623fff700 1 -- 172.21.15.96:0/4202096831 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63000d600 con 0x7fa63406fbc0 2022-02-02T18:14:20.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa623fff700 1 -- 172.21.15.96:0/4202096831 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000d760 con 0x7fa63406fbc0 2022-02-02T18:14:20.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.377+0000 7fa623fff700 1 -- 172.21.15.96:0/4202096831 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63000da30 con 0x7fa63406fbc0 2022-02-02T18:14:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 -- 172.21.15.96:0/4202096831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 msgr2=0x7fa6340fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 --2- 172.21.15.96:0/4202096831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fa63000b5f0 tx=0x7fa630006ee0).stop 2022-02-02T18:14:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 -- 172.21.15.96:0/4202096831 shutdown_connections 2022-02-02T18:14:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 --2- 172.21.15.96:0/4202096831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fe630 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:20.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 -- 172.21.15.96:0/4202096831 >> 172.21.15.96:0/4202096831 conn(0x7fa6340f6110 msgr2=0x7fa6340f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:20.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 -- 172.21.15.96:0/4202096831 shutdown_connections 2022-02-02T18:14:20.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.378+0000 7fa63a17c700 1 -- 172.21.15.96:0/4202096831 wait complete. 2022-02-02T18:14:20.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63a17c700 1 Processor -- start 2022-02-02T18:14:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63a17c700 1 -- start start 2022-02-02T18:14:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63a17c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63a17c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340fa530 con 0x7fa63406fbc0 2022-02-02T18:14:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63917a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63917a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51178/0 (socket says 172.21.15.96:51178) 2022-02-02T18:14:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.379+0000 7fa63917a700 1 -- 172.21.15.96:0/313463834 learned_addr learned my addr 172.21.15.96:0/313463834 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa63917a700 1 -- 172.21.15.96:0/313463834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63000b200 con 0x7fa63406fbc0 2022-02-02T18:14:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa63917a700 1 --2- 172.21.15.96:0/313463834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fa630006c70 tx=0x7fa630016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa630011b40 con 0x7fa63406fbc0 2022-02-02T18:14:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630011ca0 con 0x7fa63406fbc0 2022-02-02T18:14:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6340fa6d0 con 0x7fa63406fbc0 2022-02-02T18:14:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63001d430 con 0x7fa63406fbc0 2022-02-02T18:14:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6340fab60 con 0x7fa63406fbc0 2022-02-02T18:14:20.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fa63000f070 con 0x7fa63406fbc0 2022-02-02T18:14:20.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.380+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa63001dba0 con 0x7fa63406fbc0 2022-02-02T18:14:20.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.381+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634045ad0 con 0x7fa63406fbc0 2022-02-02T18:14:20.393 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.383+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fa630016070 con 0x7fa63406fbc0 2022-02-02T18:14:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.449+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa634103c70 con 0x7fa63406fbc0 2022-02-02T18:14:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.449+0000 7fa621ffb700 1 -- 172.21.15.96:0/313463834 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fa630036070 con 0x7fa63406fbc0 2022-02-02T18:14:20.454 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: cluster: 2022-02-02T18:14:20.454 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: id: e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:20.454 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: health: HEALTH_OK 2022-02-02T18:14:20.454 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.455 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: services: 2022-02-02T18:14:20.455 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi096 (age 0.585211s) 2022-02-02T18:14:20.455 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mgr: no daemons active 2022-02-02T18:14:20.455 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2022-02-02T18:14:20.455 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.456 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: data: 2022-02-02T18:14:20.456 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2022-02-02T18:14:20.456 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2022-02-02T18:14:20.457 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2022-02-02T18:14:20.457 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: pgs: 2022-02-02T18:14:20.457 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.457 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 msgr2=0x7fa6340fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:20.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 --2- 172.21.15.96:0/313463834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fa630006c70 tx=0x7fa630016000).stop 2022-02-02T18:14:20.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 shutdown_connections 2022-02-02T18:14:20.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 --2- 172.21.15.96:0/313463834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa63406fbc0 0x7fa6340fc0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:20.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 >> 172.21.15.96:0/313463834 conn(0x7fa6340f6110 msgr2=0x7fa6340f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:20.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 shutdown_connections 2022-02-02T18:14:20.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:20.450+0000 7fa63a17c700 1 -- 172.21.15.96:0/313463834 wait complete. 2022-02-02T18:14:20.771 INFO:teuthology.orchestra.run.smithi096.stderr:mon is available 2022-02-02T18:14:20.772 INFO:teuthology.orchestra.run.smithi096.stderr:Assimilating anything we can from ceph.conf... 2022-02-02T18:14:20.772 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096:/var/lib/ceph/mon/ceph-smithi096:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi096/config 2022-02-02T18:14:20.967 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.864980+0000 mon.smithi096 (mon.0) 2 2022-02-02T18:14:20.968 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: : cluster [INF] mon.smithi096 is new leader, mons smithi096 in quorum (ranks 0) 2022-02-02T18:14:20.968 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.865153+0000 mon.smithi096 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0]} 2022-02-02T18:14:20.968 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.867466+0000 mon.smithi096 (mon.0) 4 : cluster [DBG] fsmap 2022-02-02T18:14:20.968 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.870652+0000 mon.smithi096 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-02-02T18:14:20.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: cluster 2022-02-02T18:14:19.871047+0000 mon.smithi096 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2022-02-02T18:14:20.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:20 smithi096 conmon[31376]: audit 2022-02-02T18:14:20.450163+0000 mon.smithi096 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.96:0/313463834' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2022-02-02T18:14:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.223+0000 7f3ad98bd700 1 Processor -- start 2022-02-02T18:14:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.223+0000 7f3ad98bd700 1 -- start start 2022-02-02T18:14:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.223+0000 7f3ad98bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.223+0000 7f3ad98bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4072080 con 0x7f3ad4071c60 2022-02-02T18:14:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51180/0 (socket says 172.21.15.96:51180) 2022-02-02T18:14:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad2ffd700 1 -- 172.21.15.96:0/19433365 learned_addr learned my addr 172.21.15.96:0/19433365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad2ffd700 1 -- 172.21.15.96:0/19433365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40706f0 con 0x7f3ad4071c60 2022-02-02T18:14:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad2ffd700 1 --2- 172.21.15.96:0/19433365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3abc00b5f0 tx=0x7f3abc006ee0).ready entity=mon.0 client_cookie=16d3be23738179d4 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad1ffb700 1 -- 172.21.15.96:0/19433365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3abc00d600 con 0x7f3ad4071c60 2022-02-02T18:14:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.224+0000 7f3ad1ffb700 1 -- 172.21.15.96:0/19433365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00d760 con 0x7f3ad4071c60 2022-02-02T18:14:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad1ffb700 1 -- 172.21.15.96:0/19433365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3abc00da30 con 0x7f3ad4071c60 2022-02-02T18:14:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 -- 172.21.15.96:0/19433365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 msgr2=0x7f3ad4070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 --2- 172.21.15.96:0/19433365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3abc00b5f0 tx=0x7f3abc006ee0).stop 2022-02-02T18:14:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 -- 172.21.15.96:0/19433365 shutdown_connections 2022-02-02T18:14:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 --2- 172.21.15.96:0/19433365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad4070200 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 -- 172.21.15.96:0/19433365 >> 172.21.15.96:0/19433365 conn(0x7f3ad40f73e0 msgr2=0x7f3ad40f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 -- 172.21.15.96:0/19433365 shutdown_connections 2022-02-02T18:14:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.225+0000 7f3ad98bd700 1 -- 172.21.15.96:0/19433365 wait complete. 2022-02-02T18:14:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad98bd700 1 Processor -- start 2022-02-02T18:14:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad98bd700 1 -- start start 2022-02-02T18:14:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad98bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad98bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad410c8e0 con 0x7f3ad4071c60 2022-02-02T18:14:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51182/0 (socket says 172.21.15.96:51182) 2022-02-02T18:14:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.226+0000 7f3ad2ffd700 1 -- 172.21.15.96:0/2671753287 learned_addr learned my addr 172.21.15.96:0/2671753287 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3ad2ffd700 1 -- 172.21.15.96:0/2671753287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc00b200 con 0x7f3ad4071c60 2022-02-02T18:14:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3ad2ffd700 1 --2- 172.21.15.96:0/2671753287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3abc006c70 tx=0x7f3abc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3abc011b40 con 0x7f3ad4071c60 2022-02-02T18:14:21.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc011ca0 con 0x7f3ad4071c60 2022-02-02T18:14:21.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3abc01d430 con 0x7f3ad4071c60 2022-02-02T18:14:21.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad410cae0 con 0x7f3ad4071c60 2022-02-02T18:14:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad410cf70 con 0x7f3ad4071c60 2022-02-02T18:14:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3abc00f070 con 0x7f3ad4071c60 2022-02-02T18:14:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.227+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3abc01dba0 con 0x7f3ad4071c60 2022-02-02T18:14:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.228+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad4045ad0 con 0x7f3ad4071c60 2022-02-02T18:14:21.241 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.230+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f3abc016070 con 0x7f3ad4071c60 2022-02-02T18:14:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.294+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3ad4070a60 con 0x7f3ad4071c60 2022-02-02T18:14:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.298+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f3abc01de40 con 0x7f3ad4071c60 2022-02-02T18:14:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.298+0000 7f3acb7fe700 1 -- 172.21.15.96:0/2671753287 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+489 (secure 0 0 0) 0x7f3abc036020 con 0x7f3ad4071c60 2022-02-02T18:14:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: [global] 2022-02-02T18:14:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: fsid = e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: log_to_journald = false 2022-02-02T18:14:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2022-02-02T18:14:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2022-02-02T18:14:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2022-02-02T18:14:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2022-02-02T18:14:21.305 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2022-02-02T18:14:21.305 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: [mgr] 2022-02-02T18:14:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2022-02-02T18:14:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: [osd] 2022-02-02T18:14:21.307 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2022-02-02T18:14:21.307 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2022-02-02T18:14:21.307 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2022-02-02T18:14:21.307 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2022-02-02T18:14:21.308 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2022-02-02T18:14:21.308 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2022-02-02T18:14:21.308 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 msgr2=0x7f3ad410c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:21.308 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 --2- 172.21.15.96:0/2671753287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3abc006c70 tx=0x7f3abc016000).stop 2022-02-02T18:14:21.308 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 shutdown_connections 2022-02-02T18:14:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 --2- 172.21.15.96:0/2671753287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ad4071c60 0x7f3ad410c3f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 >> 172.21.15.96:0/2671753287 conn(0x7f3ad40f73e0 msgr2=0x7f3ad4100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 shutdown_connections 2022-02-02T18:14:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:21.299+0000 7f3ad98bd700 1 -- 172.21.15.96:0/2671753287 wait complete. 2022-02-02T18:14:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:Generating new minimal ceph.conf... 2022-02-02T18:14:21.708 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096:/var/lib/ceph/mon/ceph-smithi096:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi096/config 2022-02-02T18:14:22.165 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:21 smithi096 conmon[31376]: audit 2022-02-02T18:14:21.295596+0000 mon.smithi096 (mon.0) 8 : audit [INF] from='client.? 172.21.15.96:0/2671753287' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-02-02T18:14:22.165 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:21 smithi096 conmon[31376]: audit 2022-02-02T18:14:21.298719+0000 mon.smithi096 (mon.0) 9 : audit [INF] from='client.? 172.21.15.96:0/2671753287' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-02-02T18:14:22.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1cd8cb700 1 Processor -- start 2022-02-02T18:14:22.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1cd8cb700 1 -- start start 2022-02-02T18:14:22.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1cd8cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:22.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1cd8cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80fed40 con 0x7fc1c806fb80 2022-02-02T18:14:22.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:22.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51184/0 (socket says 172.21.15.96:51184) 2022-02-02T18:14:22.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1c6ffd700 1 -- 172.21.15.96:0/1203015965 learned_addr learned my addr 172.21.15.96:0/1203015965 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:22.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1c6ffd700 1 -- 172.21.15.96:0/1203015965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80fa630 con 0x7fc1c806fb80 2022-02-02T18:14:22.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.162+0000 7fc1c6ffd700 1 --2- 172.21.15.96:0/1203015965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc1b8011df0 tx=0x7fc1b8006f70).ready entity=mon.0 client_cookie=642a2343043b295b server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:22.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1c5ffb700 1 -- 172.21.15.96:0/1203015965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b8013bf0 con 0x7fc1c806fb80 2022-02-02T18:14:22.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1c5ffb700 1 -- 172.21.15.96:0/1203015965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc1b8013d50 con 0x7fc1c806fb80 2022-02-02T18:14:22.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1c5ffb700 1 -- 172.21.15.96:0/1203015965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b801b420 con 0x7fc1c806fb80 2022-02-02T18:14:22.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/1203015965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 msgr2=0x7fc1c80fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:22.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1cd8cb700 1 --2- 172.21.15.96:0/1203015965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc1b8011df0 tx=0x7fc1b8006f70).stop 2022-02-02T18:14:22.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.163+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/1203015965 shutdown_connections 2022-02-02T18:14:22.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 --2- 172.21.15.96:0/1203015965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c80fe850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:22.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/1203015965 >> 172.21.15.96:0/1203015965 conn(0x7fc1c80f62f0 msgr2=0x7fc1c80f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:22.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/1203015965 shutdown_connections 2022-02-02T18:14:22.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/1203015965 wait complete. 2022-02-02T18:14:22.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 Processor -- start 2022-02-02T18:14:22.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.164+0000 7fc1cd8cb700 1 -- start start 2022-02-02T18:14:22.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1cd8cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:22.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1cd8cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8108c40 con 0x7fc1c806fb80 2022-02-02T18:14:22.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:22.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51186/0 (socket says 172.21.15.96:51186) 2022-02-02T18:14:22.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1c6ffd700 1 -- 172.21.15.96:0/3233066662 learned_addr learned my addr 172.21.15.96:0/3233066662 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:22.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1c6ffd700 1 -- 172.21.15.96:0/3233066662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8011a80 con 0x7fc1c806fb80 2022-02-02T18:14:22.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1c6ffd700 1 --2- 172.21.15.96:0/3233066662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc1b8007010 tx=0x7fc1b8006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:22.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b8013bf0 con 0x7fc1c806fb80 2022-02-02T18:14:22.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc1b8013ec0 con 0x7fc1c806fb80 2022-02-02T18:14:22.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c8108e40 con 0x7fc1c806fb80 2022-02-02T18:14:22.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b8024a80 con 0x7fc1c806fb80 2022-02-02T18:14:22.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.165+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c8109270 con 0x7fc1c806fb80 2022-02-02T18:14:22.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.166+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fc1b802e460 con 0x7fc1c806fb80 2022-02-02T18:14:22.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.166+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc1b802d710 con 0x7fc1c806fb80 2022-02-02T18:14:22.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.167+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a8004fa0 con 0x7fc1c806fb80 2022-02-02T18:14:22.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.169+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fc1b8020040 con 0x7fc1c806fb80 2022-02-02T18:14:22.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.233+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc1a8005940 con 0x7fc1c806fb80 2022-02-02T18:14:22.237 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.234+0000 7fc1af7fe700 1 -- 172.21.15.96:0/3233066662 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fc1b8011600 con 0x7fc1c806fb80 2022-02-02T18:14:22.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.234+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 msgr2=0x7fc1c8108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:22.238 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.234+0000 7fc1cd8cb700 1 --2- 172.21.15.96:0/3233066662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc1b8007010 tx=0x7fc1b8006f70).stop 2022-02-02T18:14:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.235+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 shutdown_connections 2022-02-02T18:14:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.235+0000 7fc1cd8cb700 1 --2- 172.21.15.96:0/3233066662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c806fb80 0x7fc1c8108750 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.235+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 >> 172.21.15.96:0/3233066662 conn(0x7fc1c80f62f0 msgr2=0x7fc1c80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.235+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 shutdown_connections 2022-02-02T18:14:22.240 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:22.235+0000 7fc1cd8cb700 1 -- 172.21.15.96:0/3233066662 wait complete. 2022-02-02T18:14:22.643 INFO:teuthology.orchestra.run.smithi096.stderr:Restarting the monitor... 2022-02-02T18:14:22.643 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl restart ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096 2022-02-02T18:14:22.751 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:22 smithi096 systemd[1]: Stopping Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:14:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:22 smithi096 conmon[31376]: debug 2022-02-02T18:14:22.748+0000 7f4db90cd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi096 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T18:14:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:22 smithi096 conmon[31376]: debug 2022-02-02T18:14:22.748+0000 7f4db90cd700 -1 mon.smithi096@0(leader) e1 *** Got Signal Terminated *** 2022-02-02T18:14:23.531 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 podman[31861]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon.smithi096 2022-02-02T18:14:23.531 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service: Succeeded. 2022-02-02T18:14:23.532 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 systemd[1]: Stopped Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:14:23.532 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 systemd[1]: Starting Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:14:23.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 podman[32027]: 2022-02-02T18:14:23.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.724+0000 7fc30c090700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T18:14:23.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.724+0000 7fc30c090700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-02-02T18:14:23.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.724+0000 7fc30c090700 0 pidfile_write: ignore empty --pid-file 2022-02-02T18:14:23.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.728+0000 7fc30c090700 0 load: jerasure load: lrc load: isa 2022-02-02T18:14:23.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T18:14:23.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T18:14:23.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Compile date May 13 2021 2022-02-02T18:14:23.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: DB SUMMARY 2022-02-02T18:14:23.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: CURRENT file: CURRENT 2022-02-02T18:14:23.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: IDENTITY file: IDENTITY 2022-02-02T18:14:23.812 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.812 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2022-02-02T18:14:23.812 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.812 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi096/store.db dir, Total Num: 1, files: 000004.sst 2022-02-02T18:14:23.813 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.813 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi096/store.db: 000006.log size: 92104 ; 2022-02-02T18:14:23.813 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.813 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T18:14:23.813 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.create_if_missing: 0 2022-02-02T18:14:23.814 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T18:14:23.814 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.env: 0x55ea26fe81c0 2022-02-02T18:14:23.814 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.fs: Posix File System 2022-02-02T18:14:23.814 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.info_log: 0x55ea28a29960 2022-02-02T18:14:23.815 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T18:14:23.815 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.statistics: (nil) 2022-02-02T18:14:23.815 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.use_fsync: 0 2022-02-02T18:14:23.815 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T18:14:23.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T18:14:23.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T18:14:23.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T18:14:23.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T18:14:23.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T18:14:23.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T18:14:23.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T18:14:23.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T18:14:23.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T18:14:23.818 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T18:14:23.818 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.db_log_dir: 2022-02-02T18:14:23.818 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi096/store.db 2022-02-02T18:14:23.818 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T18:14:23.819 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T18:14:23.819 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T18:14:23.819 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T18:14:23.819 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T18:14:23.819 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T18:14:23.820 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T18:14:23.820 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T18:14:23.820 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T18:14:23.820 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T18:14:23.821 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.write_buffer_manager: 0x55ea2969e030 2022-02-02T18:14:23.821 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T18:14:23.821 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T18:14:23.821 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T18:14:23.821 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T18:14:23.822 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T18:14:23.822 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T18:14:23.822 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T18:14:23.822 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T18:14:23.823 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T18:14:23.823 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.unordered_write: 0 2022-02-02T18:14:23.823 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T18:14:23.823 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T18:14:23.824 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T18:14:23.824 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 bash[31951]: f3470b7172a1a9ad84fc8a3a97ecd3e26743f48849efb89d8440bed0833bf87d 2022-02-02T18:14:23.824 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T18:14:23.824 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.row_cache: None 2022-02-02T18:14:23.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.wal_filter: None 2022-02-02T18:14:23.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T18:14:23.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T18:14:23.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T18:14:23.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T18:14:23.826 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T18:14:23.826 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T18:14:23.826 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T18:14:23.826 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T18:14:23.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T18:14:23.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T18:14:23.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T18:14:23.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T18:14:23.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T18:14:23.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T18:14:23.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T18:14:23.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T18:14:23.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T18:14:23.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T18:14:23.829 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T18:14:23.829 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T18:14:23.829 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T18:14:23.829 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_open_files: -1 2022-02-02T18:14:23.829 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T18:14:23.830 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T18:14:23.830 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T18:14:23.830 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T18:14:23.830 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Compression algorithms supported: 2022-02-02T18:14:23.830 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T18:14:23.831 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kZSTD supported: 0 2022-02-02T18:14:23.831 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T18:14:23.831 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T18:14:23.831 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T18:14:23.831 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T18:14:23.832 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T18:14:23.832 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T18:14:23.832 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T18:14:23.832 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000005 2022-02-02T18:14:23.832 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.833 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T18:14:23.833 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.833 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T18:14:23.833 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.merge_operator: 2022-02-02T18:14:23.833 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_filter: None 2022-02-02T18:14:23.834 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T18:14:23.835 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T18:14:23.836 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T18:14:23.836 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ea28940128) 2022-02-02T18:14:23.836 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cache_index_and_filter_blocks: 1 2022-02-02T18:14:23.836 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T18:14:23.836 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T18:14:23.837 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: pin_top_level_index_and_filter: 1 2022-02-02T18:14:23.837 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: index_type: 0 2022-02-02T18:14:23.837 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: data_block_index_type: 0 2022-02-02T18:14:23.837 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: index_shortening: 1 2022-02-02T18:14:23.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: data_block_hash_table_util_ratio: 0.750000 2022-02-02T18:14:23.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: hash_index_allow_collision: 1 2022-02-02T18:14:23.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: checksum: 1 2022-02-02T18:14:23.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: no_block_cache: 0 2022-02-02T18:14:23.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_cache: 0x55ea28976f10 2022-02-02T18:14:23.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_cache_name: BinnedLRUCache 2022-02-02T18:14:23.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_cache_options: 2022-02-02T18:14:23.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: capacity : 536870912 2022-02-02T18:14:23.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: num_shard_bits : 4 2022-02-02T18:14:23.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: strict_capacity_limit : 0 2022-02-02T18:14:23.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: high_pri_pool_ratio: 0.000 2022-02-02T18:14:23.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_cache_compressed: (nil) 2022-02-02T18:14:23.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: persistent_cache: (nil) 2022-02-02T18:14:23.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_size: 4096 2022-02-02T18:14:23.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_size_deviation: 10 2022-02-02T18:14:23.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_restart_interval: 16 2022-02-02T18:14:23.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: index_block_restart_interval: 1 2022-02-02T18:14:23.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: metadata_block_size: 4096 2022-02-02T18:14:23.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: partition_filters: 0 2022-02-02T18:14:23.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: use_delta_encoding: 1 2022-02-02T18:14:23.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T18:14:23.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: whole_key_filtering: 1 2022-02-02T18:14:23.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: verify_compression: 0 2022-02-02T18:14:23.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: read_amp_bytes_per_bit: 0 2022-02-02T18:14:23.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: format_version: 2 2022-02-02T18:14:23.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: enable_index_compression: 1 2022-02-02T18:14:23.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: block_align: 0 2022-02-02T18:14:23.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T18:14:23.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T18:14:23.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression: NoCompression 2022-02-02T18:14:23.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T18:14:23.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T18:14:23.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T18:14:23.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.num_levels: 7 2022-02-02T18:14:23.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T18:14:23.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T18:14:23.846 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T18:14:23.846 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T18:14:23.846 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T18:14:23.846 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T18:14:23.847 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T18:14:23.847 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:14:23.847 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T18:14:23.847 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T18:14:23.847 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T18:14:23.848 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T18:14:23.848 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T18:14:23.848 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:14:23.848 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T18:14:23.848 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T18:14:23.849 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T18:14:23.849 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T18:14:23.849 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T18:14:23.849 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T18:14:23.849 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T18:14:23.850 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T18:14:23.850 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T18:14:23.850 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T18:14:23.850 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T18:14:23.851 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T18:14:23.851 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T18:14:23.851 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T18:14:23.851 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T18:14:23.852 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T18:14:23.852 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T18:14:23.852 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T18:14:23.852 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T18:14:23.853 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T18:14:23.853 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T18:14:23.853 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T18:14:23.853 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T18:14:23.853 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T18:14:23.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T18:14:23.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T18:14:23.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T18:14:23.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T18:14:23.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T18:14:23.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T18:14:23.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T18:14:23.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T18:14:23.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T18:14:23.856 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T18:14:23.856 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T18:14:23.856 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T18:14:23.856 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T18:14:23.857 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T18:14:23.857 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T18:14:23.857 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T18:14:23.857 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T18:14:23.857 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T18:14:23.858 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T18:14:23.858 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T18:14:23.858 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.858 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T18:14:23.858 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.ttl: 2592000 2022-02-02T18:14:23.859 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.729+0000 7fc30c090700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T18:14:23.859 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.730+0000 7fc30c090700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T18:14:23.859 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.859 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.730+0000 7fc30c090700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2022-02-02T18:14:23.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.730+0000 7fc30c090700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825663731303, "job": 1, "event": "recovery_started", "log_files": [6]} 2022-02-02T18:14:23.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.730+0000 7fc30c090700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2022-02-02T18:14:23.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.731+0000 7fc30c090700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T18:14:23.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.731+0000 7fc30c090700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825663732487, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 87904, "table_properties": {"data_size": 86031, "index_size": 350, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12269, "raw_average_key_size": 49, "raw_value_size": 79245, "raw_average_value_size": 320, "num_data_blocks": 11, "num_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643825663, "oldest_key_time": 3, "file_creation_time": 0}} 2022-02-02T18:14:23.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.731+0000 7fc30c090700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2022-02-02T18:14:23.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.732+0000 7fc30c090700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825663733021, "job": 1, "event": "recovery_finished"} 2022-02-02T18:14:23.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.733+0000 7fc30c090700 4 rocksdb: DB pointer 0x55ea28a3b800 2022-02-02T18:14:23.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.733+0000 7fc2f2ea8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T18:14:23.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.733+0000 7fc2f2ea8700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T18:14:23.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** DB Stats ** 2022-02-02T18:14:23.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:23.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T18:14:23.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T18:14:23.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:14:23.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T18:14:23.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T18:14:23.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:14:23.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** Compaction Stats [default] ** 2022-02-02T18:14:23.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:23.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:23.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: L0 2/0 87.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Sum 2/0 87.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** Compaction Stats [default] ** 2022-02-02T18:14:23.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:23.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:23.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:23.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:23.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:23.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:14:23.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:14:23.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:14:23.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Cumulative compaction: 0.00 GB write, 23.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:23.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Interval compaction: 0.00 GB write, 23.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:23.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:14:23.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:14:23.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** Compaction Stats [default] ** 2022-02-02T18:14:23.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:23.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:23.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: L0 2/0 87.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Sum 2/0 87.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:14:23.871 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.871 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** Compaction Stats [default] ** 2022-02-02T18:14:23.871 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:14:23.871 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:14:23.871 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 105.8 0.00 0.00 1 0.001 0 0 2022-02-02T18:14:23.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:14:23.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:23.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:14:23.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:14:23.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:14:23.873 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:14:23.873 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Cumulative compaction: 0.00 GB write, 23.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:23.873 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:14:23.873 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:14:23.874 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.874 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:14:23.874 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.875 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.734+0000 7fc30c090700 0 starting mon.smithi096 rank 0 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi096 fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:23.875 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.735+0000 7fc30c090700 1 mon.smithi096@-1(???) e1 preinit fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:23.875 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).mds e1 new map 2022-02-02T18:14:23.875 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).mds e1 print_map 2022-02-02T18:14:23.875 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: e1 2022-02-02T18:14:23.876 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:14:23.876 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:14:23.876 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: legacy client fscid: -1 2022-02-02T18:14:23.876 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: No filesystems configured 2022-02-02T18:14:23.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2022-02-02T18:14:23.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:14:23.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:14:23.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 0 mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:14:23.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: audit 2022-02-02T18:14:23.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T 2022-02-02T18:14:23.879 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 18:14:21.295596 2022-02-02T18:14:23.879 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 8 2022-02-02T18:14:23.879 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: : audit [INF] from='client.? 172.21.15.96:0/2671753287' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-02-02T18:14:23.879 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: audit 2022-02-02T18:14:23.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18 2022-02-02T18:14:23.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: :14:21.298719+0000 2022-02-02T18:14:23.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: mon.smithi096 (mon.0) 9 : audit 2022-02-02T18:14:23.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: [INF] from='client.? 172.21.15.96:0/2671753287' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-02-02T18:14:23.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.736+0000 7fc30c090700 1 mon.smithi096@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2022-02-02T18:14:23.881 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expand map: {default=false} 2022-02-02T18:14:23.881 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta from 'false' to 'false' 2022-02-02T18:14:23.881 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expanded map: {default=false} 2022-02-02T18:14:23.881 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expand map: {default=info} 2022-02-02T18:14:23.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta from 'info' to 'info' 2022-02-02T18:14:23.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expanded map: {default=info} 2022-02-02T18:14:23.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expand map: {default=daemon} 2022-02-02T18:14:23.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta from 'daemon' to 'daemon' 2022-02-02T18:14:23.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expanded map: {default=daemon} 2022-02-02T18:14:23.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expand map: {default=debug} 2022-02-02T18:14:23.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta from 'debug' to 'debug' 2022-02-02T18:14:23.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: debug 2022-02-02T18:14:23.737+0000 7fc30c090700 20 expand_channel_meta expanded map: {default=debug} 2022-02-02T18:14:23.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cluster 2022-02-02T18:14:23. 2022-02-02T18:14:23.884 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 753444+0000 mon.smithi096 (mon.0) 1 : cluster [INF] mon.smithi096 is new leader, mons smithi096 in quorum (ranks 0) 2022-02-02T18:14:23.884 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cluster 2022-02-02T18:14:23.753500 2022-02-02T18:14:23.884 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0]} 2022-02-02T18:14:23.884 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cluster 2022-02-02T18:14:23 2022-02-02T18:14:23.884 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: .753533+0000 mon.smithi096 (mon.0) 3 : cluster [DBG] fsmap 2022-02-02T18:14:23.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cluster 2022-02-02T18:14:23.753556+0000 2022-02-02T18:14:23.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: mon.smithi096 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-02-02T18:14:23.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: cluster 2022-02-02T18 2022-02-02T18:14:23.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: :14:23.753913+0000 mon.smithi096 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2022-02-02T18:14:23.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 conmon[32067]: 2022-02-02T18:14:23.886 INFO:teuthology.orchestra.run.smithi096.stderr:Setting mon public_network to 172.21.0.0/20 2022-02-02T18:14:23.886 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2022-02-02T18:14:24.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:23 smithi096 systemd[1]: Started Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:14:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.275+0000 7fe29c907700 1 Processor -- start 2022-02-02T18:14:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.275+0000 7fe29c907700 1 -- start start 2022-02-02T18:14:24.287 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.275+0000 7fe29c907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:24.287 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.275+0000 7fe29c907700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980fdc10 con 0x7fe2980fd270 2022-02-02T18:14:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51188/0 (socket says 172.21.15.96:51188) 2022-02-02T18:14:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29659c700 1 -- 172.21.15.96:0/4246792112 learned_addr learned my addr 172.21.15.96:0/4246792112 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29659c700 1 -- 172.21.15.96:0/4246792112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980fdd50 con 0x7fe2980fd270 2022-02-02T18:14:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29659c700 1 --2- 172.21.15.96:0/4246792112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe28c00b5f0 tx=0x7fe28c006ee0).ready entity=mon.0 client_cookie=4af4efde818d854d server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.276+0000 7fe29559a700 1 -- 172.21.15.96:0/4246792112 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe28c00d600 con 0x7fe2980fd270 2022-02-02T18:14:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29559a700 1 -- 172.21.15.96:0/4246792112 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fe28c00dbb0 con 0x7fe2980fd270 2022-02-02T18:14:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29559a700 1 -- 172.21.15.96:0/4246792112 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe28c011bb0 con 0x7fe2980fd270 2022-02-02T18:14:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 -- 172.21.15.96:0/4246792112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 msgr2=0x7fe2980fd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 --2- 172.21.15.96:0/4246792112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe28c00b5f0 tx=0x7fe28c006ee0).stop 2022-02-02T18:14:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 -- 172.21.15.96:0/4246792112 shutdown_connections 2022-02-02T18:14:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 --2- 172.21.15.96:0/4246792112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fd690 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 -- 172.21.15.96:0/4246792112 >> 172.21.15.96:0/4246792112 conn(0x7fe2980f59f0 msgr2=0x7fe2980f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 -- 172.21.15.96:0/4246792112 shutdown_connections 2022-02-02T18:14:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.277+0000 7fe29c907700 1 -- 172.21.15.96:0/4246792112 wait complete. 2022-02-02T18:14:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29c907700 1 Processor -- start 2022-02-02T18:14:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29c907700 1 -- start start 2022-02-02T18:14:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29c907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29c907700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980fafc0 con 0x7fe2980fd270 2022-02-02T18:14:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51190/0 (socket says 172.21.15.96:51190) 2022-02-02T18:14:24.296 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29659c700 1 -- 172.21.15.96:0/2181460639 learned_addr learned my addr 172.21.15.96:0/2181460639 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:24.296 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.278+0000 7fe29659c700 1 -- 172.21.15.96:0/2181460639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c00b200 con 0x7fe2980fd270 2022-02-02T18:14:24.296 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe29659c700 1 --2- 172.21.15.96:0/2181460639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fe28c006cb0 tx=0x7fe28c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe28c01b410 con 0x7fe2980fd270 2022-02-02T18:14:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2980fb160 con 0x7fe2980fd270 2022-02-02T18:14:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980fb5f0 con 0x7fe2980fd270 2022-02-02T18:14:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fe28c01b9c0 con 0x7fe2980fd270 2022-02-02T18:14:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe28c01a6f0 con 0x7fe2980fd270 2022-02-02T18:14:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe28c00f070 con 0x7fe2980fd270 2022-02-02T18:14:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.279+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe28c024a70 con 0x7fe2980fd270 2022-02-02T18:14:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.280+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274004fa0 con 0x7fe2980fd270 2022-02-02T18:14:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.282+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fe28c016070 con 0x7fe2980fd270 2022-02-02T18:14:24.347 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.344+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe274005940 con 0x7fe2980fd270 2022-02-02T18:14:24.349 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.347+0000 7fe286ffd700 1 -- 172.21.15.96:0/2181460639 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe28c01ad40 con 0x7fe2980fd270 2022-02-02T18:14:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.347+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 msgr2=0x7fe2980fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.347+0000 7fe29c907700 1 --2- 172.21.15.96:0/2181460639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fe28c006cb0 tx=0x7fe28c006ee0).stop 2022-02-02T18:14:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.348+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 shutdown_connections 2022-02-02T18:14:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.348+0000 7fe29c907700 1 --2- 172.21.15.96:0/2181460639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2980fd270 0x7fe2980fcb40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:24.353 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.348+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 >> 172.21.15.96:0/2181460639 conn(0x7fe2980f59f0 msgr2=0x7fe2980ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:24.353 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.348+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 shutdown_connections 2022-02-02T18:14:24.354 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:24.348+0000 7fe29c907700 1 -- 172.21.15.96:0/2181460639 wait complete. 2022-02-02T18:14:24.760 INFO:teuthology.orchestra.run.smithi096.stderr:Wrote config to /etc/ceph/ceph.conf 2022-02-02T18:14:24.761 INFO:teuthology.orchestra.run.smithi096.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2022-02-02T18:14:24.761 INFO:teuthology.orchestra.run.smithi096.stderr:Creating mgr... 2022-02-02T18:14:24.762 INFO:teuthology.orchestra.run.smithi096.stderr:Verifying port 9283 ... 2022-02-02T18:14:24.763 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl daemon-reload 2022-02-02T18:14:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl stop ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl 2022-02-02T18:14:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl reset-failed ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl 2022-02-02T18:14:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Failed to reset failed state of unit ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl.service: Unit ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl.service not loaded. 2022-02-02T18:14:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl enable ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl 2022-02-02T18:14:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c.target.wants/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl.service → /etc/systemd/system/ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@.service. 2022-02-02T18:14:24.964 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl start ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mgr.smithi096.shfutl 2022-02-02T18:14:25.491 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T18:14:25.499 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: disabled 2022-02-02T18:14:25.500 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T18:14:25.507 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:14:25.508 INFO:teuthology.orchestra.run.smithi096.stderr:firewalld.service is not enabled 2022-02-02T18:14:25.508 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to enable service . firewalld.service is not available 2022-02-02T18:14:25.508 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-02-02T18:14:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T18:14:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: disabled 2022-02-02T18:14:25.516 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T18:14:25.522 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:14:25.523 INFO:teuthology.orchestra.run.smithi096.stderr:firewalld.service is not enabled 2022-02-02T18:14:25.524 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2022-02-02T18:14:25.524 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mgr to start... 2022-02-02T18:14:25.524 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mgr... 2022-02-02T18:14:25.524 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T18:14:25.663 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:25 smithi096 conmon[32067]: audit 2022-02-02T18:14:24.347633+0000 mon.smithi096 (mon.0) 6 : audit [INF] from='client.? 172.21.15.96:0/2181460639' entity='client.admin' 2022-02-02T18:14:26.015 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f626c6700 1 Processor -- start 2022-02-02T18:14:26.016 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f626c6700 1 -- start start 2022-02-02T18:14:26.016 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f626c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:26.016 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f626c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0fa840 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.016 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:26.017 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51196/0 (socket says 172.21.15.96:51196) 2022-02-02T18:14:26.017 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.009+0000 7f8f5bfff700 1 -- 172.21.15.96:0/1260638294 learned_addr learned my addr 172.21.15.96:0/1260638294 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:26.017 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.010+0000 7f8f5bfff700 1 -- 172.21.15.96:0/1260638294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0fa980 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.017 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.010+0000 7f8f5bfff700 1 --2- 172.21.15.96:0/1260638294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8f4c00b5f0 tx=0x7f8f4c006ee0).ready entity=mon.0 client_cookie=f9b76c290b62d62 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.010+0000 7f8f5affd700 1 -- 172.21.15.96:0/1260638294 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f4c00d600 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.010+0000 7f8f5affd700 1 -- 172.21.15.96:0/1260638294 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f8f4c00dbb0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.010+0000 7f8f5affd700 1 -- 172.21.15.96:0/1260638294 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f4c011bb0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 -- 172.21.15.96:0/1260638294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 msgr2=0x7f8f5c0fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 --2- 172.21.15.96:0/1260638294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8f4c00b5f0 tx=0x7f8f4c006ee0).stop 2022-02-02T18:14:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 -- 172.21.15.96:0/1260638294 shutdown_connections 2022-02-02T18:14:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 --2- 172.21.15.96:0/1260638294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c0fa2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 -- 172.21.15.96:0/1260638294 >> 172.21.15.96:0/1260638294 conn(0x7f8f5c0f59d0 msgr2=0x7f8f5c0f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 -- 172.21.15.96:0/1260638294 shutdown_connections 2022-02-02T18:14:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.011+0000 7f8f626c6700 1 -- 172.21.15.96:0/1260638294 wait complete. 2022-02-02T18:14:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.012+0000 7f8f626c6700 1 Processor -- start 2022-02-02T18:14:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.012+0000 7f8f626c6700 1 -- start start 2022-02-02T18:14:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f626c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f626c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c10ae50 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51198/0 (socket says 172.21.15.96:51198) 2022-02-02T18:14:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f5bfff700 1 -- 172.21.15.96:0/145792462 learned_addr learned my addr 172.21.15.96:0/145792462 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f5bfff700 1 -- 172.21.15.96:0/145792462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c00b200 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f5bfff700 1 --2- 172.21.15.96:0/145792462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8f4c006d00 tx=0x7f8f4c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f4c01b570 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f8f4c01bb20 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.025 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c10b050 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.025 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f4c01a8e0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.025 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.013+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c10b4e0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.025 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.014+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f8f4c00f070 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.025 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.014+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8f4c024c60 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.015+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c045ad0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.017+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f8f4c016070 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.101 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.095+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8f5c0fd9f0 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.095+0000 7f8f58ff9700 1 -- 172.21.15.96:0/145792462 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f8f4c01ae80 con 0x7f8f5c0f9ea0 2022-02-02T18:14:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:14:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsid": "e1d78c58-8453-11ec-8c35-001a4aab830c", 2022-02-02T18:14:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "health": { 2022-02-02T18:14:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T18:14:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T18:14:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T18:14:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T18:14:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T18:14:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 0 2022-02-02T18:14:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T18:14:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "smithi096" 2022-02-02T18:14:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_age": 2, 2022-02-02T18:14:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T18:14:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T18:14:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T18:14:26.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T18:14:26.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:26.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T18:14:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T18:14:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T18:14:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T18:14:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T18:14:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T18:14:26.109 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.109 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T18:14:26.109 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T18:14:26.110 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T18:14:26.110 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T18:14:26.110 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T18:14:26.110 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T18:14:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T18:14:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T18:14:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T18:14:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T18:14:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T18:14:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T18:14:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T18:14:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "available": false, 2022-02-02T18:14:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T18:14:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T18:14:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "iostat", 2022-02-02T18:14:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "restful" 2022-02-02T18:14:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T18:14:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modified": "2022-02-02T18:14:19.866638+0000", 2022-02-02T18:14:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T18:14:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:14:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.097+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 msgr2=0x7f8f5c10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.097+0000 7f8f626c6700 1 --2- 172.21.15.96:0/145792462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8f4c006d00 tx=0x7f8f4c006ee0).stop 2022-02-02T18:14:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.098+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 shutdown_connections 2022-02-02T18:14:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.098+0000 7f8f626c6700 1 --2- 172.21.15.96:0/145792462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f5c0f9ea0 0x7f8f5c10a960 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.098+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 >> 172.21.15.96:0/145792462 conn(0x7f8f5c0f59d0 msgr2=0x7f8f5c0f74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.098+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 shutdown_connections 2022-02-02T18:14:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:26.098+0000 7f8f626c6700 1 -- 172.21.15.96:0/145792462 wait complete. 2022-02-02T18:14:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:mgr not available, waiting (1/15)... 2022-02-02T18:14:26.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:26 smithi096 conmon[32067]: audit 2022-02-02T18:14:26.096130+0000 mon.smithi096 (mon.0) 2022-02-02T18:14:26.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:26 smithi096 conmon[32067]: 7 : audit [DBG] from='client.? 172.21.15.96:0/145792462' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T18:14:28.667 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T18:14:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c9a2e700 1 Processor -- start 2022-02-02T18:14:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c9a2e700 1 -- start start 2022-02-02T18:14:29.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c9a2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:29.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c9a2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40fecf0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.116 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51200/0 (socket says 172.21.15.96:51200) 2022-02-02T18:14:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c2ffd700 1 -- 172.21.15.96:0/2121490310 learned_addr learned my addr 172.21.15.96:0/2121490310 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.110+0000 7fb7c2ffd700 1 -- 172.21.15.96:0/2121490310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40fee30 con 0x7fb7c406fbc0 2022-02-02T18:14:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c2ffd700 1 --2- 172.21.15.96:0/2121490310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb7b400b5f0 tx=0x7fb7b4006ee0).ready entity=mon.0 client_cookie=65619d29c1a55abb server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c1ffb700 1 -- 172.21.15.96:0/2121490310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b400d600 con 0x7fb7c406fbc0 2022-02-02T18:14:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c1ffb700 1 -- 172.21.15.96:0/2121490310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fb7b400dbb0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c1ffb700 1 -- 172.21.15.96:0/2121490310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b4011bb0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/2121490310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 msgr2=0x7fb7c40fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 --2- 172.21.15.96:0/2121490310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb7b400b5f0 tx=0x7fb7b4006ee0).stop 2022-02-02T18:14:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/2121490310 shutdown_connections 2022-02-02T18:14:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 --2- 172.21.15.96:0/2121490310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fe800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/2121490310 >> 172.21.15.96:0/2121490310 conn(0x7fb7c40f62a0 msgr2=0x7fb7c40f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/2121490310 shutdown_connections 2022-02-02T18:14:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.111+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/2121490310 wait complete. 2022-02-02T18:14:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.112+0000 7fb7c9a2e700 1 Processor -- start 2022-02-02T18:14:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.112+0000 7fb7c9a2e700 1 -- start start 2022-02-02T18:14:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c9a2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c9a2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40fa700 con 0x7fb7c406fbc0 2022-02-02T18:14:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51202/0 (socket says 172.21.15.96:51202) 2022-02-02T18:14:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c2ffd700 1 -- 172.21.15.96:0/4148838921 learned_addr learned my addr 172.21.15.96:0/4148838921 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c2ffd700 1 -- 172.21.15.96:0/4148838921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b400b200 con 0x7fb7c406fbc0 2022-02-02T18:14:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c2ffd700 1 --2- 172.21.15.96:0/4148838921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb7b400db50 tx=0x7fb7b4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b401b570 con 0x7fb7c406fbc0 2022-02-02T18:14:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fb7b401bb20 con 0x7fb7c406fbc0 2022-02-02T18:14:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.113+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c40fa8a0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.114+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b401a850 con 0x7fb7c406fbc0 2022-02-02T18:14:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.114+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c40fad30 con 0x7fb7c406fbc0 2022-02-02T18:14:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.114+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fb7b400f070 con 0x7fb7c406fbc0 2022-02-02T18:14:29.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.114+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb7b4025bb0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.114+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c4045ad0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.117+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fb7b4016070 con 0x7fb7c406fbc0 2022-02-02T18:14:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.184+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb7c4104820 con 0x7fb7c406fbc0 2022-02-02T18:14:29.190 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.184+0000 7fb7ab7fe700 1 -- 172.21.15.96:0/4148838921 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7fb7b4025dc0 con 0x7fb7c406fbc0 2022-02-02T18:14:29.190 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.190 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:14:29.190 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsid": "e1d78c58-8453-11ec-8c35-001a4aab830c", 2022-02-02T18:14:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "health": { 2022-02-02T18:14:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T18:14:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T18:14:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T18:14:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T18:14:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T18:14:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 0 2022-02-02T18:14:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T18:14:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "smithi096" 2022-02-02T18:14:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_age": 5, 2022-02-02T18:14:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T18:14:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T18:14:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T18:14:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T18:14:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T18:14:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T18:14:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T18:14:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T18:14:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T18:14:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T18:14:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T18:14:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T18:14:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T18:14:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T18:14:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T18:14:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T18:14:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T18:14:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T18:14:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T18:14:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T18:14:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T18:14:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T18:14:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T18:14:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "available": false, 2022-02-02T18:14:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T18:14:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T18:14:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "iostat", 2022-02-02T18:14:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "restful" 2022-02-02T18:14:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T18:14:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modified": "2022-02-02T18:14:19.866638+0000", 2022-02-02T18:14:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:29.209 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:29.209 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T18:14:29.209 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:14:29.209 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 msgr2=0x7fb7c40fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 --2- 172.21.15.96:0/4148838921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb7b400db50 tx=0x7fb7b4006ee0).stop 2022-02-02T18:14:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 shutdown_connections 2022-02-02T18:14:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 --2- 172.21.15.96:0/4148838921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7c406fbc0 0x7fb7c40fc280 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 >> 172.21.15.96:0/4148838921 conn(0x7fb7c40f62a0 msgr2=0x7fb7c40f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 shutdown_connections 2022-02-02T18:14:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:29.186+0000 7fb7c9a2e700 1 -- 172.21.15.96:0/4148838921 wait complete. 2022-02-02T18:14:29.504 INFO:teuthology.orchestra.run.smithi096.stderr:mgr not available, waiting (2/15)... 2022-02-02T18:14:29.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:29 smithi096 conmon[32067]: audit 2022-02-02T18:14:29.186205+0000 mon.smithi096 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.96:0/4148838921' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T18:14:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: cluster 2022-02-02T18:14:30.377474+0000 mon.smithi096 (mon.0) 9 : cluster [INF] Activating manager daemon smithi096.shfutl 2022-02-02T18:14:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: cluster 2022-02-02T18:14:30 2022-02-02T18:14:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: .380202+0000 mon.smithi096 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi096.shfutl(active, starting, since 0.00281591s) 2022-02-02T18:14:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:30.381188+0000 mon.smithi096 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:14:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:30.381316+0000 mon.smithi096 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:14:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:30.381417+0000 mon.smithi096 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:14:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:30.381560+0000 mon.smithi096 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:14:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:30 2022-02-02T18:14:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: .381860+0000 mon.smithi096 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:14:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: cluster 2022-02-02T 2022-02-02T18:14:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 18:14:30.395010+0000 mon.smithi096 (mon.0) 16 : cluster 2022-02-02T18:14:31.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: [INF] Manager daemon smithi096.shfutl is now available 2022-02-02T18:14:31.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:14:31.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 02-02T18:14:30.402413+0000 mon.smithi096 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:31.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 2022-02-02T18:14:31.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:14:31.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: T18:14:30.406264+0000 mon.smithi096 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:14:31.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:14:31.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 02T18:14:30.407395+0000 mon.smithi096 (mon.0) 19 2022-02-02T18:14:31.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: : audit [INF] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:14:31.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:31.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 2022-02-02T18:14:30.411901+0000 mon.smithi096 (mon.0) 20 : 2022-02-02T18:14:31.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit [INF] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:31.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: audit 2022-02-02T18:14:31.064 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 2022-02-02T18:14:30.413802+0000 mon.smithi096 (mon.0) 2022-02-02T18:14:31.064 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:30 smithi096 conmon[32067]: 21 : audit [INF] from='mgr.14100 172.21.15.96:0/347686783' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T18:14:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.935+0000 7f65d3a49700 1 Processor -- start 2022-02-02T18:14:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d3a49700 1 -- start start 2022-02-02T18:14:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d3a49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d3a49700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0f9f80 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d17e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d17e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51224/0 (socket says 172.21.15.96:51224) 2022-02-02T18:14:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.936+0000 7f65d17e5700 1 -- 172.21.15.96:0/1084256226 learned_addr learned my addr 172.21.15.96:0/1084256226 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.937+0000 7f65d17e5700 1 -- 172.21.15.96:0/1084256226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0fdca0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.937+0000 7f65d17e5700 1 --2- 172.21.15.96:0/1084256226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f65bc00b5f0 tx=0x7f65bc006ee0).ready entity=mon.0 client_cookie=2bd82b64cab1a8d2 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.937+0000 7f65bbfff700 1 -- 172.21.15.96:0/1084256226 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc00d600 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.937+0000 7f65bbfff700 1 -- 172.21.15.96:0/1084256226 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f65bc00dbb0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.937+0000 7f65bbfff700 1 -- 172.21.15.96:0/1084256226 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc011bb0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 -- 172.21.15.96:0/1084256226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 msgr2=0x7f65cc0fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 --2- 172.21.15.96:0/1084256226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f65bc00b5f0 tx=0x7f65bc006ee0).stop 2022-02-02T18:14:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 -- 172.21.15.96:0/1084256226 shutdown_connections 2022-02-02T18:14:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 --2- 172.21.15.96:0/1084256226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc0fd7b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 -- 172.21.15.96:0/1084256226 >> 172.21.15.96:0/1084256226 conn(0x7f65cc0f55e0 msgr2=0x7f65cc0f7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 -- 172.21.15.96:0/1084256226 shutdown_connections 2022-02-02T18:14:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.938+0000 7f65d3a49700 1 -- 172.21.15.96:0/1084256226 wait complete. 2022-02-02T18:14:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d3a49700 1 Processor -- start 2022-02-02T18:14:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d3a49700 1 -- start start 2022-02-02T18:14:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d3a49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d3a49700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc108be0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d17e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d17e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51226/0 (socket says 172.21.15.96:51226) 2022-02-02T18:14:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d17e5700 1 -- 172.21.15.96:0/3076587177 learned_addr learned my addr 172.21.15.96:0/3076587177 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.939+0000 7f65d17e5700 1 -- 172.21.15.96:0/3076587177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc00b200 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65d17e5700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65bc006cb0 tx=0x7f65bc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:31.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc01b410 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc108de0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f65bc01b9c0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc01a6f0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.940+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc109270 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.941+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7f65bc00f070 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.941+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc045ad0 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.941+0000 7f65b9ffb700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 0x7f65b4034380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:31.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.941+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f65bc040d80 con 0x7f65cc0fb3c0 2022-02-02T18:14:31.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.941+0000 7f65d0fe4700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 0x7f65b4034380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:31.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.942+0000 7f65d0fe4700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 0x7f65b4034380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f65c80096a0 tx=0x7f65c8006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:31.962 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:31.946+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f65bc019df0 con 0x7f65cc0fb3c0 2022-02-02T18:14:32.162 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.150+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f65cc0fabf0 con 0x7f65cc0fb3c0 2022-02-02T18:14:32.162 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.150+0000 7f65b9ffb700 1 -- 172.21.15.96:0/3076587177 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1229 (secure 0 0 0) 0x7f65bc016030 con 0x7f65cc0fb3c0 2022-02-02T18:14:32.162 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.163 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:14:32.163 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsid": "e1d78c58-8453-11ec-8c35-001a4aab830c", 2022-02-02T18:14:32.163 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "health": { 2022-02-02T18:14:32.163 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T18:14:32.164 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T18:14:32.164 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T18:14:32.164 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.164 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T18:14:32.164 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T18:14:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 0 2022-02-02T18:14:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T18:14:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "smithi096" 2022-02-02T18:14:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "quorum_age": 8, 2022-02-02T18:14:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T18:14:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T18:14:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T18:14:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T18:14:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:32.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T18:14:32.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T18:14:32.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T18:14:32.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T18:14:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T18:14:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T18:14:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T18:14:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T18:14:32.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T18:14:32.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T18:14:32.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T18:14:32.170 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T18:14:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T18:14:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T18:14:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T18:14:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T18:14:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T18:14:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T18:14:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T18:14:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "available": true, 2022-02-02T18:14:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T18:14:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T18:14:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "iostat", 2022-02-02T18:14:32.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "restful" 2022-02-02T18:14:32.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ], 2022-02-02T18:14:32.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:32.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T18:14:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T18:14:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "modified": "2022-02-02T18:14:19.866638+0000", 2022-02-02T18:14:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "services": {} 2022-02-02T18:14:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: }, 2022-02-02T18:14:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T18:14:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:14:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 msgr2=0x7f65b4034380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:32.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 0x7f65b4034380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f65c80096a0 tx=0x7f65c8006b40).stop 2022-02-02T18:14:32.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 msgr2=0x7f65cc1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:32.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65bc006cb0 tx=0x7f65bc006ee0).stop 2022-02-02T18:14:32.177 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 shutdown_connections 2022-02-02T18:14:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f65b4031ec0 0x7f65b4034380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 --2- 172.21.15.96:0/3076587177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65cc0fb3c0 0x7f65cc1086f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 >> 172.21.15.96:0/3076587177 conn(0x7f65cc0f55e0 msgr2=0x7f65cc0f7070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 shutdown_connections 2022-02-02T18:14:32.179 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:32.152+0000 7f65d3a49700 1 -- 172.21.15.96:0/3076587177 wait complete. 2022-02-02T18:14:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:mgr is available 2022-02-02T18:14:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:Enabling cephadm module... 2022-02-02T18:14:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2022-02-02T18:14:32.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:32 smithi096 conmon[32067]: cluster 2022-02-02T18:14:31.382974+0000 mon.smithi096 (mon.0) 22 2022-02-02T18:14:32.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:32 smithi096 conmon[32067]: : cluster [DBG] mgrmap e3: smithi096.shfutl(active, since 1.00559s) 2022-02-02T18:14:32.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:32 smithi096 conmon[32067]: audit 2022-02-02T18:14:32.152336+0000 mon.smithi096 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.96:0/3076587177' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T18:14:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.022+0000 7f457c409700 1 Processor -- start 2022-02-02T18:14:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.022+0000 7f457c409700 1 -- start start 2022-02-02T18:14:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.022+0000 7f457c409700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.022+0000 7f457c409700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740fedc0 con 0x7f457406fc20 2022-02-02T18:14:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f457a1a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f457a1a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51230/0 (socket says 172.21.15.96:51230) 2022-02-02T18:14:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f457a1a5700 1 -- 172.21.15.96:0/1777200872 learned_addr learned my addr 172.21.15.96:0/1777200872 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f457a1a5700 1 -- 172.21.15.96:0/1777200872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740fef00 con 0x7f457406fc20 2022-02-02T18:14:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f457a1a5700 1 --2- 172.21.15.96:0/1777200872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f457000b5f0 tx=0x7f4570006ee0).ready entity=mon.0 client_cookie=a513a95347572182 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f45791a3700 1 -- 172.21.15.96:0/1777200872 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f457000d600 con 0x7f457406fc20 2022-02-02T18:14:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f45791a3700 1 -- 172.21.15.96:0/1777200872 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f457000dbb0 con 0x7f457406fc20 2022-02-02T18:14:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.023+0000 7f45791a3700 1 -- 172.21.15.96:0/1777200872 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4570011bb0 con 0x7f457406fc20 2022-02-02T18:14:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- 172.21.15.96:0/1777200872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 msgr2=0x7f45740fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 --2- 172.21.15.96:0/1777200872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f457000b5f0 tx=0x7f4570006ee0).stop 2022-02-02T18:14:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- 172.21.15.96:0/1777200872 shutdown_connections 2022-02-02T18:14:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 --2- 172.21.15.96:0/1777200872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f45740fe840 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- 172.21.15.96:0/1777200872 >> 172.21.15.96:0/1777200872 conn(0x7f45740f62a0 msgr2=0x7f45740f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- 172.21.15.96:0/1777200872 shutdown_connections 2022-02-02T18:14:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- 172.21.15.96:0/1777200872 wait complete. 2022-02-02T18:14:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 Processor -- start 2022-02-02T18:14:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.024+0000 7f457c409700 1 -- start start 2022-02-02T18:14:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457c409700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457c409700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457410ae00 con 0x7f457406fc20 2022-02-02T18:14:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457a1a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457a1a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51232/0 (socket says 172.21.15.96:51232) 2022-02-02T18:14:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457a1a5700 1 -- 172.21.15.96:0/2059913728 learned_addr learned my addr 172.21.15.96:0/2059913728 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457a1a5700 1 -- 172.21.15.96:0/2059913728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457000b200 con 0x7f457406fc20 2022-02-02T18:14:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457a1a5700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4570003000 tx=0x7f4570006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4570011e30 con 0x7f457406fc20 2022-02-02T18:14:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f457000d9c0 con 0x7f457406fc20 2022-02-02T18:14:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457410b000 con 0x7f457406fc20 2022-02-02T18:14:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f457001b740 con 0x7f457406fc20 2022-02-02T18:14:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.025+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457410b490 con 0x7f457406fc20 2022-02-02T18:14:33.039 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.026+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7f457000f070 con 0x7f457406fc20 2022-02-02T18:14:33.039 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.026+0000 7f4562ffd700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 0x7f455c032110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:33.039 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.026+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4570040e40 con 0x7f457406fc20 2022-02-02T18:14:33.039 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.027+0000 7f45799a4700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 0x7f455c032110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:33.039 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.027+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574045ad0 con 0x7f457406fc20 2022-02-02T18:14:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.027+0000 7f45799a4700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 0x7f455c032110 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f45640096a0 tx=0x7f4564006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.031+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4570016070 con 0x7f457406fc20 2022-02-02T18:14:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.216+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f457410c9a0 con 0x7f457406fc20 2022-02-02T18:14:33.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.380+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 4) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f4570024790 con 0x7f457406fc20 2022-02-02T18:14:33.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.381+0000 7f4562ffd700 1 -- 172.21.15.96:0/2059913728 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v4) v1 ==== 86+0+0 (secure 0 0 0) 0x7f457002dd30 con 0x7f457406fc20 2022-02-02T18:14:33.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 msgr2=0x7f455c032110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:33.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 0x7f455c032110 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f45640096a0 tx=0x7f4564006b40).stop 2022-02-02T18:14:33.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 msgr2=0x7f457410a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:33.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4570003000 tx=0x7f4570006ee0).stop 2022-02-02T18:14:33.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 shutdown_connections 2022-02-02T18:14:33.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f455c02fc50 0x7f455c032110 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 --2- 172.21.15.96:0/2059913728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f457406fc20 0x7f457410a910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 >> 172.21.15.96:0/2059913728 conn(0x7f45740f62a0 msgr2=0x7f45740f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 shutdown_connections 2022-02-02T18:14:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:33.384+0000 7f457c409700 1 -- 172.21.15.96:0/2059913728 wait complete. 2022-02-02T18:14:33.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:33 smithi096 conmon[32067]: audit 2022-02-02T18:14:33.218842 2022-02-02T18:14:33.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:33 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 24 : audit [INF] from='client.? 172.21.15.96:0/2059913728' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2022-02-02T18:14:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:34 smithi096 conmon[32067]: audit 2022-02-02T18:14:33.383362+0000 mon.smithi096 (mon.0) 25 2022-02-02T18:14:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:34 smithi096 conmon[32067]: : audit [INF] from='client.? 172.21.15.96:0/2059913728' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2022-02-02T18:14:34.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:34 smithi096 conmon[32067]: cluster 2022-02-02T18:14:33.383430+0000 mon.smithi096 (mon.0) 26 : cluster [DBG] mgrmap e4: smithi096.shfutl(active, since 3s) 2022-02-02T18:14:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-02-02T18:14:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f2651012700 1 Processor -- start 2022-02-02T18:14:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f2651012700 1 -- start start 2022-02-02T18:14:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f2651012700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f2651012700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0fecf0 con 0x7f264c06fbc0 2022-02-02T18:14:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f264ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:37.915 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f264ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51250/0 (socket says 172.21.15.96:51250) 2022-02-02T18:14:37.915 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.874+0000 7f264ad9d700 1 -- 172.21.15.96:0/4225175128 learned_addr learned my addr 172.21.15.96:0/4225175128 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:37.915 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f264ad9d700 1 -- 172.21.15.96:0/4225175128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0fee30 con 0x7f264c06fbc0 2022-02-02T18:14:37.915 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f264ad9d700 1 --2- 172.21.15.96:0/4225175128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f263c00b5f0 tx=0x7f263c006ee0).ready entity=mon.0 client_cookie=3736fc0918e1456 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2649d9b700 1 -- 172.21.15.96:0/4225175128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f263c00d600 con 0x7f264c06fbc0 2022-02-02T18:14:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2649d9b700 1 -- 172.21.15.96:0/4225175128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f263c00dbb0 con 0x7f264c06fbc0 2022-02-02T18:14:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2649d9b700 1 -- 172.21.15.96:0/4225175128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f263c011bb0 con 0x7f264c06fbc0 2022-02-02T18:14:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2651012700 1 -- 172.21.15.96:0/4225175128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 msgr2=0x7f264c0fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2651012700 1 --2- 172.21.15.96:0/4225175128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f263c00b5f0 tx=0x7f263c006ee0).stop 2022-02-02T18:14:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.875+0000 7f2651012700 1 -- 172.21.15.96:0/4225175128 shutdown_connections 2022-02-02T18:14:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 --2- 172.21.15.96:0/4225175128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c0fe800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 -- 172.21.15.96:0/4225175128 >> 172.21.15.96:0/4225175128 conn(0x7f264c0f62a0 msgr2=0x7f264c0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:37.918 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 -- 172.21.15.96:0/4225175128 shutdown_connections 2022-02-02T18:14:37.918 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 -- 172.21.15.96:0/4225175128 wait complete. 2022-02-02T18:14:37.918 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 Processor -- start 2022-02-02T18:14:37.918 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 -- start start 2022-02-02T18:14:37.919 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:37.919 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.876+0000 7f2651012700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c10ad80 con 0x7f264c06fbc0 2022-02-02T18:14:37.919 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f264ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:37.919 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f264ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51252/0 (socket says 172.21.15.96:51252) 2022-02-02T18:14:37.920 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f264ad9d700 1 -- 172.21.15.96:0/1431789333 learned_addr learned my addr 172.21.15.96:0/1431789333 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:37.920 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f264ad9d700 1 -- 172.21.15.96:0/1431789333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c00b200 con 0x7f264c06fbc0 2022-02-02T18:14:37.920 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f264ad9d700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f263c006cb0 tx=0x7f263c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:37.920 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f263c01b570 con 0x7f264c06fbc0 2022-02-02T18:14:37.921 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f263c01bb20 con 0x7f264c06fbc0 2022-02-02T18:14:37.921 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c10af80 con 0x7f264c06fbc0 2022-02-02T18:14:37.921 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f263c01a960 con 0x7f264c06fbc0 2022-02-02T18:14:37.921 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.877+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c10b410 con 0x7f264c06fbc0 2022-02-02T18:14:37.922 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f263c00f070 con 0x7f264c06fbc0 2022-02-02T18:14:37.922 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f26337fe700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 0x7f2638032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:37.923 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f263c041eb0 con 0x7f264c06fbc0 2022-02-02T18:14:37.923 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f264a59c700 1 -- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 msgr2=0x7f2638032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1366851711 2022-02-02T18:14:37.923 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f264a59c700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 0x7f2638032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:14:37.924 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.878+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c045ad0 con 0x7f264c06fbc0 2022-02-02T18:14:37.924 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:37.882+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f263c016070 con 0x7f264c06fbc0 2022-02-02T18:14:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.077+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f264c104850 con 0x7f264c06fbc0 2022-02-02T18:14:38.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.078+0000 7f26337fe700 1 -- 172.21.15.96:0/1431789333 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v4) v1 ==== 56+0+103 (secure 0 0 0) 0x7f263c024410 con 0x7f264c06fbc0 2022-02-02T18:14:38.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:14:38.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 4, 2022-02-02T18:14:38.167 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "available": true, 2022-02-02T18:14:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "active_name": "smithi096.shfutl", 2022-02-02T18:14:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_standby": 0 2022-02-02T18:14:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:14:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.079+0000 7f264a59c700 1 -- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 msgr2=0x7f2638032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1366851711 2022-02-02T18:14:38.169 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.079+0000 7f264a59c700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 0x7f2638032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T18:14:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 msgr2=0x7f2638032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:14:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 0x7f2638032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:14:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 msgr2=0x7f264c10a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f263c006cb0 tx=0x7f263c006ee0).stop 2022-02-02T18:14:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 shutdown_connections 2022-02-02T18:14:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:6800/1366851711,v1:172.21.15.96:6801/1366851711] conn(0x7f263802fdb0 0x7f2638032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:14:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 --2- 172.21.15.96:0/1431789333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f264c06fbc0 0x7f264c10a890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 >> 172.21.15.96:0/1431789333 conn(0x7f264c0f62a0 msgr2=0x7f264c0f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 shutdown_connections 2022-02-02T18:14:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:38.080+0000 7f2651012700 1 -- 172.21.15.96:0/1431789333 wait complete. 2022-02-02T18:14:38.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:38 smithi096 conmon[32067]: audit 2022-02-02T18:14:38.079754 2022-02-02T18:14:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:38 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 27 : audit [DBG] from='client.? 172.21.15.96:0/1431789333' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-02-02T18:14:39.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster 2022-02-02T18:14:38.276799+0000 mon.smithi096 (mon.0 2022-02-02T18:14:39.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: ) 28 : cluster [INF] Active manager daemon smithi096.shfutl restarted 2022-02-02T18:14:39.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster 2022-02-02T18:14:38.277258+0000 mon.smithi096 (mon.0) 29 : cluster [INF] Activating manager daemon smithi096.shfutl 2022-02-02T18:14:39.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster 2022-02-02T18:14:38.278888+0000 mon.smithi096 (mon.0) 30 2022-02-02T18:14:39.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2022-02-02T18:14:39.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster 2022-02-02T18:14 2022-02-02T18:14:39.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: :39.133657+0000 mon.smithi096 (mon.0) 31 : 2022-02-02T18:14:39.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster [DBG] mgrmap e5: smithi096.shfutl(active, starting, since 0.856488s) 2022-02-02T18:14:39.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18:14 2022-02-02T18:14:39.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: :39.134870+0000 mon.smithi096 (mon. 2022-02-02T18:14:39.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 0) 32 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:14:39.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 2022-02-02T18:14:39.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:14:39.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: T18:14:39.135658+0000 mon.smithi096 (mon. 2022-02-02T18:14:39.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 0) 33 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:14:39.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:14:39.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 02-02T18:14:39.136513+0000 mon.smithi096 (mon 2022-02-02T18:14:39.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: .0) 34 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:14:39.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:14:39.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: :14:39.136724+0000 mon.smithi096 (mon.0) 35 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:14:39.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18:14:39. 2022-02-02T18:14:39.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 136896+0000 mon.smithi096 (mon.0) 36 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:14:39.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:14:39.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 02-02T18:14:39.151186 2022-02-02T18:14:39.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 37 : cluster [INF] 2022-02-02T18:14:39.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: Manager daemon smithi096.shfutl is now available 2022-02-02T18:14:39.565 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.169530+0000 mon.smithi096 (mon. 2022-02-02T18:14:39.565 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 0) 38 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:39.566 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.566 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 2022-02-02T18:14:39.175267+0000 mon.smithi096 (mon.0) 39 : audit 2022-02-02T18:14:39.566 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:39.566 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:14:39.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: :14:39.180964+0000 mon.smithi096 (mon.0 2022-02-02T18:14:39.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: ) 40 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:39.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 2022-02-02T18 2022-02-02T18:14:39.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: :14:39.275122+0000 mon.smithi096 (mon. 2022-02-02T18:14:39.568 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 0) 41 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:39.568 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:14:39.568 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: -02T18:14:39.275830+0000 2022-02-02T18:14:39.569 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: mon.smithi096 (mon.0) 42 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:14:39.569 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:39 smithi096 conmon[32067]: 2022-02-02T18:14:40.034 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for the mgr to restart... 2022-02-02T18:14:40.035 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mgr epoch 4... 2022-02-02T18:14:40.035 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-02-02T18:14:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.277338+0000 mon.smithi096 (mon.0) 43 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:14:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.280728+0000 mon.smithi096 (mon.0) 44 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:14:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: audit 2022-02-02T18:14:39.290000+0000 mon.smithi096 (mon.0) 45 : audit 2022-02-02T18:14:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:14:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: audit 2022-02-02T18: 2022-02-02T18:14:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: 14:39.291187+0000 mon.smithi096 (mon.0) 46 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:14:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:14:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: 02-02T18:14:40.135470+0000 2022-02-02T18:14:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:40 smithi096 conmon[32067]: mon.smithi096 (mon.0) 47 : cluster [DBG] mgrmap e6: smithi096.shfutl(active, since 1.85831s) 2022-02-02T18:14:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.110+0000 7fd232511700 1 Processor -- start 2022-02-02T18:14:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.110+0000 7fd232511700 1 -- start start 2022-02-02T18:14:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd232511700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd232511700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0fc630 con 0x7fd22c06fb60 2022-02-02T18:14:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51282/0 (socket says 172.21.15.96:51282) 2022-02-02T18:14:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22bfff700 1 -- 172.21.15.96:0/317561502 learned_addr learned my addr 172.21.15.96:0/317561502 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22bfff700 1 -- 172.21.15.96:0/317561502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c101130 con 0x7fd22c06fb60 2022-02-02T18:14:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22bfff700 1 --2- 172.21.15.96:0/317561502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd21400b5f0 tx=0x7fd214006ee0).ready entity=mon.0 client_cookie=7ee4bc0fba5c5708 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22affd700 1 -- 172.21.15.96:0/317561502 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd21400d600 con 0x7fd22c06fb60 2022-02-02T18:14:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22affd700 1 -- 172.21.15.96:0/317561502 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fd21400dbb0 con 0x7fd22c06fb60 2022-02-02T18:14:42.149 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.111+0000 7fd22affd700 1 -- 172.21.15.96:0/317561502 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd214011bb0 con 0x7fd22c06fb60 2022-02-02T18:14:42.149 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 -- 172.21.15.96:0/317561502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 msgr2=0x7fd22c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:42.149 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 --2- 172.21.15.96:0/317561502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd21400b5f0 tx=0x7fd214006ee0).stop 2022-02-02T18:14:42.149 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 -- 172.21.15.96:0/317561502 shutdown_connections 2022-02-02T18:14:42.150 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 --2- 172.21.15.96:0/317561502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c100c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:42.150 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 -- 172.21.15.96:0/317561502 >> 172.21.15.96:0/317561502 conn(0x7fd22c0f6260 msgr2=0x7fd22c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:42.150 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 -- 172.21.15.96:0/317561502 shutdown_connections 2022-02-02T18:14:42.150 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.112+0000 7fd232511700 1 -- 172.21.15.96:0/317561502 wait complete. 2022-02-02T18:14:42.151 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd232511700 1 Processor -- start 2022-02-02T18:14:42.151 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd232511700 1 -- start start 2022-02-02T18:14:42.151 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd232511700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:42.151 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd232511700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c10cfa0 con 0x7fd22c06fb60 2022-02-02T18:14:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd22bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd22bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51284/0 (socket says 172.21.15.96:51284) 2022-02-02T18:14:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd22bfff700 1 -- 172.21.15.96:0/552809711 learned_addr learned my addr 172.21.15.96:0/552809711 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd22bfff700 1 -- 172.21.15.96:0/552809711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21400b200 con 0x7fd22c06fb60 2022-02-02T18:14:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.113+0000 7fd22bfff700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd214006970 tx=0x7fd214006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd21401b570 con 0x7fd22c06fb60 2022-02-02T18:14:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fd21401bb20 con 0x7fd22c06fb60 2022-02-02T18:14:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c10d1a0 con 0x7fd22c06fb60 2022-02-02T18:14:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd21401a920 con 0x7fd22c06fb60 2022-02-02T18:14:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c10d630 con 0x7fd22c06fb60 2022-02-02T18:14:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.114+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fd21400f070 con 0x7fd22c06fb60 2022-02-02T18:14:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd228ff9700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 0x7fd20c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd22c059100 con 0x7fd20c02fdb0 2022-02-02T18:14:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fd214041090 con 0x7fd22c06fb60 2022-02-02T18:14:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd22b7fe700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 0x7fd20c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd22b7fe700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 0x7fd20c032270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd21c0096a0 tx=0x7fd21c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.115+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fd22c059100 con 0x7fd20c02fdb0 2022-02-02T18:14:42.156 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd22c045ad0 con 0x7fd20c02fdb0 2022-02-02T18:14:42.156 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd228ff9700 1 -- 172.21.15.96:0/552809711 <== mgr.14114 v2:172.21.15.96:6800/3681595525 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd22c045ad0 con 0x7fd20c02fdb0 2022-02-02T18:14:42.156 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 msgr2=0x7fd20c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:42.156 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 0x7fd20c032270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd21c0096a0 tx=0x7fd21c006b40).stop 2022-02-02T18:14:42.157 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 msgr2=0x7fd22c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:42.157 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd214006970 tx=0x7fd214006ee0).stop 2022-02-02T18:14:42.157 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.121+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 shutdown_connections 2022-02-02T18:14:42.157 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.122+0000 7fd232511700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fd20c02fdb0 0x7fd20c032270 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.122+0000 7fd232511700 1 --2- 172.21.15.96:0/552809711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd22c06fb60 0x7fd22c10cab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.122+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 >> 172.21.15.96:0/552809711 conn(0x7fd22c0f6260 msgr2=0x7fd22c0f7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.122+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 shutdown_connections 2022-02-02T18:14:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:42.122+0000 7fd232511700 1 -- 172.21.15.96:0/552809711 wait complete. 2022-02-02T18:14:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:14:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2022-02-02T18:14:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "initialized": true 2022-02-02T18:14:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:14:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:42 smithi096 conmon[32067]: cluster 2022-02-02T18:14:41.283368+0000 mon.smithi096 (mon.0) 48 : 2022-02-02T18:14:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:42 smithi096 conmon[32067]: cluster [DBG] mgrmap e7: smithi096.shfutl(active, since 3s) 2022-02-02T18:14:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:43 smithi096 conmon[32067]: audit 2022-02-02T18:14:42.117208+0000 mgr.smithi096.shfutl (mgr.14114) 1 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-02-02T18:14:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:43 smithi096 conmon[32067]: audit 2022-02-02T18:14:42.123123+0000 mgr.smithi096.shfutl (mgr.14114) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-02-02T18:14:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:mgr epoch 4 is available 2022-02-02T18:14:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:Setting orchestrator backend to cephadm... 2022-02-02T18:14:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2022-02-02T18:14:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.069+0000 7f9b85629700 1 Processor -- start 2022-02-02T18:14:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.069+0000 7f9b85629700 1 -- start start 2022-02-02T18:14:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.069+0000 7f9b85629700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.069+0000 7f9b85629700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800fc6e0 con 0x7f9b8006fc00 2022-02-02T18:14:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51288/0 (socket says 172.21.15.96:51288) 2022-02-02T18:14:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7effd700 1 -- 172.21.15.96:0/1794991408 learned_addr learned my addr 172.21.15.96:0/1794991408 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7effd700 1 -- 172.21.15.96:0/1794991408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80101150 con 0x7f9b8006fc00 2022-02-02T18:14:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7effd700 1 --2- 172.21.15.96:0/1794991408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9b7400b5f0 tx=0x7f9b74006ee0).ready entity=mon.0 client_cookie=b66b323595b401c server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7dffb700 1 -- 172.21.15.96:0/1794991408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7400d600 con 0x7f9b8006fc00 2022-02-02T18:14:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7dffb700 1 -- 172.21.15.96:0/1794991408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9b7400dbb0 con 0x7f9b8006fc00 2022-02-02T18:14:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.070+0000 7f9b7dffb700 1 -- 172.21.15.96:0/1794991408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b74011bb0 con 0x7f9b8006fc00 2022-02-02T18:14:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 -- 172.21.15.96:0/1794991408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 msgr2=0x7f9b80100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 --2- 172.21.15.96:0/1794991408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9b7400b5f0 tx=0x7f9b74006ee0).stop 2022-02-02T18:14:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 -- 172.21.15.96:0/1794991408 shutdown_connections 2022-02-02T18:14:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 --2- 172.21.15.96:0/1794991408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b80100c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 -- 172.21.15.96:0/1794991408 >> 172.21.15.96:0/1794991408 conn(0x7f9b800f62a0 msgr2=0x7f9b800f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 -- 172.21.15.96:0/1794991408 shutdown_connections 2022-02-02T18:14:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.071+0000 7f9b85629700 1 -- 172.21.15.96:0/1794991408 wait complete. 2022-02-02T18:14:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b85629700 1 Processor -- start 2022-02-02T18:14:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b85629700 1 -- start start 2022-02-02T18:14:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b85629700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b85629700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8010d000 con 0x7f9b8006fc00 2022-02-02T18:14:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51290/0 (socket says 172.21.15.96:51290) 2022-02-02T18:14:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.072+0000 7f9b7effd700 1 -- 172.21.15.96:0/1338103778 learned_addr learned my addr 172.21.15.96:0/1338103778 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b7effd700 1 -- 172.21.15.96:0/1338103778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7400b200 con 0x7f9b8006fc00 2022-02-02T18:14:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b7effd700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9b74006c70 tx=0x7f9b74006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7401b410 con 0x7f9b8006fc00 2022-02-02T18:14:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9b7401b9c0 con 0x7f9b8006fc00 2022-02-02T18:14:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8010d200 con 0x7f9b8006fc00 2022-02-02T18:14:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7401a6f0 con 0x7f9b8006fc00 2022-02-02T18:14:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.073+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8010d690 con 0x7f9b8006fc00 2022-02-02T18:14:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.074+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f9b7400f070 con 0x7f9b8006fc00 2022-02-02T18:14:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.074+0000 7f9b677fe700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 0x7f9b6c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.074+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f9b74041e20 con 0x7f9b8006fc00 2022-02-02T18:14:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.074+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b80045ad0 con 0x7f9b8006fc00 2022-02-02T18:14:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.074+0000 7f9b7e7fc700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 0x7f9b6c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.075+0000 7f9b7e7fc700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 0x7f9b6c032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9b700096a0 tx=0x7f9b70006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:45.090 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.079+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9b74016070 con 0x7f9b8006fc00 2022-02-02T18:14:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.257+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b80106bb0 con 0x7f9b6c02fdb0 2022-02-02T18:14:45.267 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.263+0000 7f9b677fe700 1 -- 172.21.15.96:0/1338103778 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9b80106bb0 con 0x7f9b6c02fdb0 2022-02-02T18:14:45.271 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 msgr2=0x7f9b6c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:45.271 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 0x7f9b6c032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9b700096a0 tx=0x7f9b70006b40).stop 2022-02-02T18:14:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 msgr2=0x7f9b8010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9b74006c70 tx=0x7f9b74006ee0).stop 2022-02-02T18:14:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 shutdown_connections 2022-02-02T18:14:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f9b6c02fdb0 0x7f9b6c032270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 --2- 172.21.15.96:0/1338103778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8006fc00 0x7f9b8010cb10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 >> 172.21.15.96:0/1338103778 conn(0x7f9b800f62a0 msgr2=0x7f9b800f7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.265+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 shutdown_connections 2022-02-02T18:14:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:45.266+0000 7f9b85629700 1 -- 172.21.15.96:0/1338103778 wait complete. 2022-02-02T18:14:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2022-02-02T18:14:46.095 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2158cc700 1 Processor -- start 2022-02-02T18:14:46.095 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2158cc700 1 -- start start 2022-02-02T18:14:46.096 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2158cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:46.096 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2158cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100fb1e0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.096 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2148ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:46.096 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2148ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51294/0 (socket says 172.21.15.96:51294) 2022-02-02T18:14:46.097 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2148ca700 1 -- 172.21.15.96:0/267345970 learned_addr learned my addr 172.21.15.96:0/267345970 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:46.097 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2148ca700 1 -- 172.21.15.96:0/267345970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100fb320 con 0x7ff2100fa8d0 2022-02-02T18:14:46.097 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.090+0000 7ff2148ca700 1 --2- 172.21.15.96:0/267345970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff20400b5f0 tx=0x7ff204006ee0).ready entity=mon.0 client_cookie=67832e548ca25459 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:46.097 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff20f7fe700 1 -- 172.21.15.96:0/267345970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20400d600 con 0x7ff2100fa8d0 2022-02-02T18:14:46.098 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff20f7fe700 1 -- 172.21.15.96:0/267345970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff20400dbb0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.098 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff20f7fe700 1 -- 172.21.15.96:0/267345970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff204011bb0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.101 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 -- 172.21.15.96:0/267345970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 msgr2=0x7ff2100facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:46.101 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 --2- 172.21.15.96:0/267345970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff20400b5f0 tx=0x7ff204006ee0).stop 2022-02-02T18:14:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 -- 172.21.15.96:0/267345970 shutdown_connections 2022-02-02T18:14:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 --2- 172.21.15.96:0/267345970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff2100facf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 -- 172.21.15.96:0/267345970 >> 172.21.15.96:0/267345970 conn(0x7ff2100f6110 msgr2=0x7ff2100f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 -- 172.21.15.96:0/267345970 shutdown_connections 2022-02-02T18:14:46.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.091+0000 7ff2158cc700 1 -- 172.21.15.96:0/267345970 wait complete. 2022-02-02T18:14:46.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2158cc700 1 Processor -- start 2022-02-02T18:14:46.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2158cc700 1 -- start start 2022-02-02T18:14:46.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2158cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:46.103 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2158cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21010ab90 con 0x7ff2100fa8d0 2022-02-02T18:14:46.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2148ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:46.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2148ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51296/0 (socket says 172.21.15.96:51296) 2022-02-02T18:14:46.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.092+0000 7ff2148ca700 1 -- 172.21.15.96:0/474420332 learned_addr learned my addr 172.21.15.96:0/474420332 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:46.104 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff2148ca700 1 -- 172.21.15.96:0/474420332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20400b200 con 0x7ff2100fa8d0 2022-02-02T18:14:46.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff2148ca700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff204006c70 tx=0x7ff204006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:46.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20401b570 con 0x7ff2100fa8d0 2022-02-02T18:14:46.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21010ad90 con 0x7ff2100fa8d0 2022-02-02T18:14:46.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff20401bb20 con 0x7ff2100fa8d0 2022-02-02T18:14:46.105 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20401a8c0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.093+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21010b220 con 0x7ff2100fa8d0 2022-02-02T18:14:46.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.094+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff210045ad0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.106 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.094+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff20400f070 con 0x7ff2100fa8d0 2022-02-02T18:14:46.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.094+0000 7ff20d7fa700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 0x7ff1f4032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:46.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.094+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff204041240 con 0x7ff2100fa8d0 2022-02-02T18:14:46.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.094+0000 7ff20ffff700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 0x7ff1f4032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:46.107 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.095+0000 7ff20ffff700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 0x7ff1f4032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff1fc0096a0 tx=0x7ff1fc006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:46.108 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.099+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff204019af0 con 0x7ff2100fa8d0 2022-02-02T18:14:46.254 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.249+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff21010bb40 con 0x7ff1f402fdb0 2022-02-02T18:14:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.250+0000 7ff20d7fa700 1 -- 172.21.15.96:0/474420332 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff21010bb40 con 0x7ff1f402fdb0 2022-02-02T18:14:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: value unchanged 2022-02-02T18:14:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 msgr2=0x7ff1f4032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 0x7ff1f4032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff1fc0096a0 tx=0x7ff1fc006b40).stop 2022-02-02T18:14:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 msgr2=0x7ff21010a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff204006c70 tx=0x7ff204006ee0).stop 2022-02-02T18:14:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 shutdown_connections 2022-02-02T18:14:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff1f402fdb0 0x7ff1f4032270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 --2- 172.21.15.96:0/474420332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2100fa8d0 0x7ff21010a6a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.251+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 >> 172.21.15.96:0/474420332 conn(0x7ff2100f6110 msgr2=0x7ff2100f6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.252+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 shutdown_connections 2022-02-02T18:14:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:46.252+0000 7ff2158cc700 1 -- 172.21.15.96:0/474420332 wait complete. 2022-02-02T18:14:46.438 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:46 smithi096 conmon[32067]: audit 2022-02-02T18:14:45.260335+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:14:46.438 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:46 smithi096 conmon[32067]: 14114) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:46.439 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:46 smithi096 conmon[32067]: audit 2022-02-02T18:14:45.264206+0000 mon.smithi096 (mon.0) 49 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:46.439 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:46 smithi096 conmon[32067]: audit 2022-02-02T18:14:45.267741+0000 mon.smithi096 (mon.0) 50 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:14:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:Generating ssh key... 2022-02-02T18:14:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2022-02-02T18:14:47.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.117+0000 7f4574f08700 1 Processor -- start 2022-02-02T18:14:47.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.117+0000 7f4574f08700 1 -- start start 2022-02-02T18:14:47.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f4574f08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:47.125 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f4574f08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700fdb50 con 0x7f45700fd1b0 2022-02-02T18:14:47.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:47.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51300/0 (socket says 172.21.15.96:51300) 2022-02-02T18:14:47.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456e59c700 1 -- 172.21.15.96:0/2738847454 learned_addr learned my addr 172.21.15.96:0/2738847454 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:47.126 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456e59c700 1 -- 172.21.15.96:0/2738847454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700fdc90 con 0x7f45700fd1b0 2022-02-02T18:14:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456e59c700 1 --2- 172.21.15.96:0/2738847454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f456400b5f0 tx=0x7f4564006ee0).ready entity=mon.0 client_cookie=75590b9d7cb0b4a4 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456d59a700 1 -- 172.21.15.96:0/2738847454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456400d600 con 0x7f45700fd1b0 2022-02-02T18:14:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456d59a700 1 -- 172.21.15.96:0/2738847454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f456400dbb0 con 0x7f45700fd1b0 2022-02-02T18:14:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.118+0000 7f456d59a700 1 -- 172.21.15.96:0/2738847454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4564011bb0 con 0x7f45700fd1b0 2022-02-02T18:14:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 -- 172.21.15.96:0/2738847454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 msgr2=0x7f45700fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 --2- 172.21.15.96:0/2738847454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f456400b5f0 tx=0x7f4564006ee0).stop 2022-02-02T18:14:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 -- 172.21.15.96:0/2738847454 shutdown_connections 2022-02-02T18:14:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 --2- 172.21.15.96:0/2738847454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f45700fd5d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 -- 172.21.15.96:0/2738847454 >> 172.21.15.96:0/2738847454 conn(0x7f45700f59d0 msgr2=0x7f45700f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 -- 172.21.15.96:0/2738847454 shutdown_connections 2022-02-02T18:14:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.119+0000 7f4574f08700 1 -- 172.21.15.96:0/2738847454 wait complete. 2022-02-02T18:14:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f4574f08700 1 Processor -- start 2022-02-02T18:14:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f4574f08700 1 -- start start 2022-02-02T18:14:47.130 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f4574f08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:47.130 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f4574f08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457010ae50 con 0x7f45700fd1b0 2022-02-02T18:14:47.130 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f456e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:47.130 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f456e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51302/0 (socket says 172.21.15.96:51302) 2022-02-02T18:14:47.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f456e59c700 1 -- 172.21.15.96:0/1652326876 learned_addr learned my addr 172.21.15.96:0/1652326876 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:47.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f456e59c700 1 -- 172.21.15.96:0/1652326876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456400b200 con 0x7f45700fd1b0 2022-02-02T18:14:47.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f456e59c700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4564006cb0 tx=0x7f4564006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:47.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456401b410 con 0x7f45700fd1b0 2022-02-02T18:14:47.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f456401b9c0 con 0x7f45700fd1b0 2022-02-02T18:14:47.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.120+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457010b050 con 0x7f45700fd1b0 2022-02-02T18:14:47.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.121+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457010b4e0 con 0x7f45700fd1b0 2022-02-02T18:14:47.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.121+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456401a6f0 con 0x7f45700fd1b0 2022-02-02T18:14:47.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.121+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f456400f070 con 0x7f45700fd1b0 2022-02-02T18:14:47.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.121+0000 7f455effd700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 0x7f4554032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:47.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.121+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f4564040ec0 con 0x7f45700fd1b0 2022-02-02T18:14:47.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.122+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c004fa0 con 0x7f45700fd1b0 2022-02-02T18:14:47.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.122+0000 7f456dd9b700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 0x7f4554032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:47.134 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.122+0000 7f456dd9b700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 0x7f4554032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f45600096a0 tx=0x7f4560006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:47.134 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.126+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4564016070 con 0x7f45700fd1b0 2022-02-02T18:14:47.278 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.275+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f454c0029f0 con 0x7f455402fdb0 2022-02-02T18:14:47.323 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.320+0000 7f455effd700 1 -- 172.21.15.96:0/1652326876 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f454c0029f0 con 0x7f455402fdb0 2022-02-02T18:14:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 msgr2=0x7f4554032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 0x7f4554032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f45600096a0 tx=0x7f4560006b40).stop 2022-02-02T18:14:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 msgr2=0x7f457010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4564006cb0 tx=0x7f4564006ee0).stop 2022-02-02T18:14:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 shutdown_connections 2022-02-02T18:14:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f455402fdb0 0x7f4554032270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 --2- 172.21.15.96:0/1652326876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45700fd1b0 0x7f457010a960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.322+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 >> 172.21.15.96:0/1652326876 conn(0x7f45700f59d0 msgr2=0x7f45700f74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.323+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 shutdown_connections 2022-02-02T18:14:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:47.323+0000 7f4574f08700 1 -- 172.21.15.96:0/1652326876 wait complete. 2022-02-02T18:14:47.481 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:47 smithi096 conmon[32067]: audit 2022-02-02T18:14:46.251647+0000 mgr.smithi096.shfutl (mgr.14114) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2022-02-02T18:14:48.130 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.122+0000 7f6bb2cc4700 1 Processor -- start 2022-02-02T18:14:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.122+0000 7f6bb2cc4700 1 -- start start 2022-02-02T18:14:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.122+0000 7f6bb2cc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.122+0000 7f6bb2cc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0fc650 con 0x7f6bac06fb40 2022-02-02T18:14:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bb0a60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bb0a60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51306/0 (socket says 172.21.15.96:51306) 2022-02-02T18:14:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bb0a60700 1 -- 172.21.15.96:0/599551695 learned_addr learned my addr 172.21.15.96:0/599551695 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bb0a60700 1 -- 172.21.15.96:0/599551695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac101150 con 0x7f6bac06fb40 2022-02-02T18:14:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bb0a60700 1 --2- 172.21.15.96:0/599551695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6ba000b5f0 tx=0x7f6ba0006ee0).ready entity=mon.0 client_cookie=be031cf284be26 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bab7fe700 1 -- 172.21.15.96:0/599551695 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ba000d600 con 0x7f6bac06fb40 2022-02-02T18:14:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bab7fe700 1 -- 172.21.15.96:0/599551695 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f6ba000dbb0 con 0x7f6bac06fb40 2022-02-02T18:14:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.123+0000 7f6bab7fe700 1 -- 172.21.15.96:0/599551695 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ba0011bb0 con 0x7f6bac06fb40 2022-02-02T18:14:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/599551695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 msgr2=0x7f6bac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/599551695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6ba000b5f0 tx=0x7f6ba0006ee0).stop 2022-02-02T18:14:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/599551695 shutdown_connections 2022-02-02T18:14:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/599551695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac100c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/599551695 >> 172.21.15.96:0/599551695 conn(0x7f6bac0f6260 msgr2=0x7f6bac0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/599551695 shutdown_connections 2022-02-02T18:14:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/599551695 wait complete. 2022-02-02T18:14:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.124+0000 7f6bb2cc4700 1 Processor -- start 2022-02-02T18:14:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb2cc4700 1 -- start start 2022-02-02T18:14:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb2cc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb2cc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac10cf80 con 0x7f6bac06fb40 2022-02-02T18:14:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb0a60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb0a60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51308/0 (socket says 172.21.15.96:51308) 2022-02-02T18:14:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb0a60700 1 -- 172.21.15.96:0/2398739400 learned_addr learned my addr 172.21.15.96:0/2398739400 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb0a60700 1 -- 172.21.15.96:0/2398739400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba000b200 con 0x7f6bac06fb40 2022-02-02T18:14:48.139 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.125+0000 7f6bb0a60700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6ba0006cb0 tx=0x7f6ba0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:48.139 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ba001b570 con 0x7f6bac06fb40 2022-02-02T18:14:48.139 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac10d180 con 0x7f6bac06fb40 2022-02-02T18:14:48.139 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f6ba001bb20 con 0x7f6bac06fb40 2022-02-02T18:14:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ba001a960 con 0x7f6bac06fb40 2022-02-02T18:14:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac10d610 con 0x7f6bac06fb40 2022-02-02T18:14:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.126+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f6ba000f070 con 0x7f6bac06fb40 2022-02-02T18:14:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.127+0000 7f6ba97fa700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 0x7f6b90032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.127+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac045ad0 con 0x7f6bac06fb40 2022-02-02T18:14:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.127+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6ba0041110 con 0x7f6bac06fb40 2022-02-02T18:14:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.127+0000 7f6babfff700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 0x7f6b90032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.127+0000 7f6babfff700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 0x7f6b90032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6b980096a0 tx=0x7f6b98006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:48.142 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.131+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6ba0016070 con 0x7f6bac06fb40 2022-02-02T18:14:48.285 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.281+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bac10df30 con 0x7f6b9002fd50 2022-02-02T18:14:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.282+0000 7f6ba97fa700 1 -- 172.21.15.96:0/2398739400 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6bac10df30 con 0x7f6b9002fd50 2022-02-02T18:14:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbbWAfuUfQYVyjxA9aw182sv5EcVdSzM2yCaH+9wwNVBOhLAVyONG5yxPji+NKlfA7z7q1fxypWNdELZqoPbnMGj7NzhuTs/t1mDEsyzhdCihKPAPDsXp9yWbV51d27rMLp+xPgfIE/sY5SrtBBPQM8aHRd7O/thSuCK9w3YADyaToazW/LWE2iUIESPIZPZ7gQW/Rmc85UuuwxJYvryN3ovRWVi7YNcIm4wIbQTGMPz7kk8wa5giiGrFQS1olkFjaI9TTRZaiSyjGqc+g7gP5qQ64YZyIyA6R/Cmd2tL7WPw4sbBjt4emYNxEj2M4hgj6/dQdc7zMuESMEVWrX78pXdhHIGdamT+f4XRMG9c+yNxm9VVOyn5p4DpN0/Es7xJoW75PPXdX6C3aNTRfFrUIysIfdbfEJSJOY0S9rpgMsEKJs90H8suEKVJYqJSbIge+KbzvMeAYv6Qa9uzie0q3swuqkz3cXKkYUwOfcQWk3JCbVLXRH+MFW1jNrWn9rW0= ceph-e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:14:48.289 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.283+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 msgr2=0x7f6b90032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.283+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 0x7f6b90032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6b980096a0 tx=0x7f6b98006b40).stop 2022-02-02T18:14:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.283+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 msgr2=0x7f6bac10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.283+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6ba0006cb0 tx=0x7f6ba0006ee0).stop 2022-02-02T18:14:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 shutdown_connections 2022-02-02T18:14:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f6b9002fd50 0x7f6b90032210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 --2- 172.21.15.96:0/2398739400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac06fb40 0x7f6bac10ca90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 >> 172.21.15.96:0/2398739400 conn(0x7f6bac0f6260 msgr2=0x7f6bac0f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 shutdown_connections 2022-02-02T18:14:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:48.284+0000 7f6bb2cc4700 1 -- 172.21.15.96:0/2398739400 wait complete. 2022-02-02T18:14:48.448 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:48 smithi096 conmon[32067]: cephadm 2022-02-02T18:14:47.276539+0000 mgr.smithi096.shfutl (mgr.14114) 6 : 2022-02-02T18:14:48.449 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:48 smithi096 conmon[32067]: cephadm [INF] Generating ssh key... 2022-02-02T18:14:48.449 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:48 smithi096 conmon[32067]: audit 2022-02-02T18:14:47.318798+0000 mon.smithi096 (mon.0) 51 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:48.449 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:48 smithi096 conmon[32067]: audit 2022-02-02T18:14: 2022-02-02T18:14:48.450 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:48 smithi096 conmon[32067]: 47.320501+0000 mon.smithi096 (mon.0) 52 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:48.629 INFO:teuthology.orchestra.run.smithi096.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2022-02-02T18:14:48.630 INFO:teuthology.orchestra.run.smithi096.stderr:Adding key to root@localhost authorized_keys... 2022-02-02T18:14:48.631 INFO:teuthology.orchestra.run.smithi096.stderr:Adding host smithi096... 2022-02-02T18:14:48.632 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi096 172.21.15.96 2022-02-02T18:14:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.069+0000 7fc814dec700 1 Processor -- start 2022-02-02T18:14:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.069+0000 7fc814dec700 1 -- start start 2022-02-02T18:14:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.069+0000 7fc814dec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc814dec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100fdb90 con 0x7fc8100fd280 2022-02-02T18:14:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51312/0 (socket says 172.21.15.96:51312) 2022-02-02T18:14:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80e59c700 1 -- 172.21.15.96:0/689732302 learned_addr learned my addr 172.21.15.96:0/689732302 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80e59c700 1 -- 172.21.15.96:0/689732302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100fdcd0 con 0x7fc8100fd280 2022-02-02T18:14:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80e59c700 1 --2- 172.21.15.96:0/689732302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc80400b5f0 tx=0x7fc804006ee0).ready entity=mon.0 client_cookie=ebebf57570d3d899 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:49.076 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80d59a700 1 -- 172.21.15.96:0/689732302 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc80400d600 con 0x7fc8100fd280 2022-02-02T18:14:49.076 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80d59a700 1 -- 172.21.15.96:0/689732302 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc80400dbb0 con 0x7fc8100fd280 2022-02-02T18:14:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.070+0000 7fc80d59a700 1 -- 172.21.15.96:0/689732302 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc804011bb0 con 0x7fc8100fd280 2022-02-02T18:14:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 -- 172.21.15.96:0/689732302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 msgr2=0x7fc8100fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 --2- 172.21.15.96:0/689732302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc80400b5f0 tx=0x7fc804006ee0).stop 2022-02-02T18:14:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 -- 172.21.15.96:0/689732302 shutdown_connections 2022-02-02T18:14:49.079 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 --2- 172.21.15.96:0/689732302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fd6a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:49.079 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 -- 172.21.15.96:0/689732302 >> 172.21.15.96:0/689732302 conn(0x7fc8100f5a60 msgr2=0x7fc8100f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:49.079 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 -- 172.21.15.96:0/689732302 shutdown_connections 2022-02-02T18:14:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 -- 172.21.15.96:0/689732302 wait complete. 2022-02-02T18:14:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.071+0000 7fc814dec700 1 Processor -- start 2022-02-02T18:14:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc814dec700 1 -- start start 2022-02-02T18:14:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc814dec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc814dec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100fafd0 con 0x7fc8100fd280 2022-02-02T18:14:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51314/0 (socket says 172.21.15.96:51314) 2022-02-02T18:14:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc80e59c700 1 -- 172.21.15.96:0/3179530069 learned_addr learned my addr 172.21.15.96:0/3179530069 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc80e59c700 1 -- 172.21.15.96:0/3179530069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80400b200 con 0x7fc8100fd280 2022-02-02T18:14:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc80e59c700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc804006a30 tx=0x7fc804006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc80401b570 con 0x7fc8100fd280 2022-02-02T18:14:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc80401bb20 con 0x7fc8100fd280 2022-02-02T18:14:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8100fb170 con 0x7fc8100fd280 2022-02-02T18:14:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc80401aa00 con 0x7fc8100fd280 2022-02-02T18:14:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.072+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8100fb600 con 0x7fc8100fd280 2022-02-02T18:14:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.073+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fc80400f070 con 0x7fc8100fd280 2022-02-02T18:14:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.073+0000 7fc7feffd700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 0x7fc7f4032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.073+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc810045ad0 con 0x7fc8100fd280 2022-02-02T18:14:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.073+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc804041070 con 0x7fc8100fd280 2022-02-02T18:14:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.073+0000 7fc80dd9b700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 0x7fc7f4032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.074+0000 7fc80dd9b700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 0x7fc7f4032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc8000096a0 tx=0x7fc800006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:49.085 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.078+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc804016070 con 0x7fc8100fd280 2022-02-02T18:14:49.252 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.249+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8100fb840 con 0x7fc7f402fdb0 2022-02-02T18:14:49.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:49 smithi096 conmon[32067]: audit 2022-02-02T18:14:48.282847+0000 mgr.smithi096.shfutl (mgr.14114) 7 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:49.939 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Added host 'smithi096' 2022-02-02T18:14:49.939 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.934+0000 7fc7feffd700 1 -- 172.21.15.96:0/3179530069 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7fc8100fb840 con 0x7fc7f402fdb0 2022-02-02T18:14:49.941 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 msgr2=0x7fc7f4032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:49.941 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 0x7fc7f4032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc8000096a0 tx=0x7fc800006b40).stop 2022-02-02T18:14:49.941 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 msgr2=0x7fc8100fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc804006a30 tx=0x7fc804006ee0).stop 2022-02-02T18:14:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 shutdown_connections 2022-02-02T18:14:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fc7f402fdb0 0x7fc7f4032270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 --2- 172.21.15.96:0/3179530069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8100fd280 0x7fc8100fcb50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 >> 172.21.15.96:0/3179530069 conn(0x7fc8100f5a60 msgr2=0x7fc8100ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.937+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 shutdown_connections 2022-02-02T18:14:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:49.938+0000 7fc814dec700 1 -- 172.21.15.96:0/3179530069 wait complete. 2022-02-02T18:14:50.269 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying mon service with default placement... 2022-02-02T18:14:50.269 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2022-02-02T18:14:50.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:50 smithi096 conmon[32067]: audit 2022-02-02T18:14:49.250735+0000 mgr.smithi096.shfutl ( 2022-02-02T18:14:50.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:50 smithi096 conmon[32067]: mgr.14114) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:50.522 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:50 smithi096 conmon[32067]: audit 2022-02-02T18:14:49.934323+0000 mon.smithi096 (mon.0) 53 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:50.522 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:50 smithi096 conmon[32067]: audit 2022-02-02T18:14:49.934879+0000 mon.smithi096 (mon.0) 54 : audit [DBG] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:14:50.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.699+0000 7f66d7fff700 1 Processor -- start 2022-02-02T18:14:50.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.699+0000 7f66d7fff700 1 -- start start 2022-02-02T18:14:50.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.699+0000 7f66d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:50.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.699+0000 7f66d7fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80fc420 con 0x7f66d806fbc0 2022-02-02T18:14:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51324/0 (socket says 172.21.15.96:51324) 2022-02-02T18:14:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d6ffd700 1 -- 172.21.15.96:0/2431547847 learned_addr learned my addr 172.21.15.96:0/2431547847 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d6ffd700 1 -- 172.21.15.96:0/2431547847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8100f20 con 0x7f66d806fbc0 2022-02-02T18:14:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d6ffd700 1 --2- 172.21.15.96:0/2431547847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f66cc00b5f0 tx=0x7f66cc006ee0).ready entity=mon.0 client_cookie=65db74e73e43b07f server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d5ffb700 1 -- 172.21.15.96:0/2431547847 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66cc00d600 con 0x7f66d806fbc0 2022-02-02T18:14:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d5ffb700 1 -- 172.21.15.96:0/2431547847 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f66cc00dbb0 con 0x7f66d806fbc0 2022-02-02T18:14:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.700+0000 7f66d5ffb700 1 -- 172.21.15.96:0/2431547847 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66cc011bb0 con 0x7f66d806fbc0 2022-02-02T18:14:50.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 -- 172.21.15.96:0/2431547847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 msgr2=0x7f66d8100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:50.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 --2- 172.21.15.96:0/2431547847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f66cc00b5f0 tx=0x7f66cc006ee0).stop 2022-02-02T18:14:50.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 -- 172.21.15.96:0/2431547847 shutdown_connections 2022-02-02T18:14:50.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 --2- 172.21.15.96:0/2431547847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d8100a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:50.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 -- 172.21.15.96:0/2431547847 >> 172.21.15.96:0/2431547847 conn(0x7f66d80f6110 msgr2=0x7f66d80f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:50.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 -- 172.21.15.96:0/2431547847 shutdown_connections 2022-02-02T18:14:50.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.701+0000 7f66d7fff700 1 -- 172.21.15.96:0/2431547847 wait complete. 2022-02-02T18:14:50.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d7fff700 1 Processor -- start 2022-02-02T18:14:50.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d7fff700 1 -- start start 2022-02-02T18:14:50.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:50.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d7fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80fcec0 con 0x7f66d806fbc0 2022-02-02T18:14:50.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:50.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51326/0 (socket says 172.21.15.96:51326) 2022-02-02T18:14:50.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d6ffd700 1 -- 172.21.15.96:0/3981142012 learned_addr learned my addr 172.21.15.96:0/3981142012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:50.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d6ffd700 1 -- 172.21.15.96:0/3981142012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc00b200 con 0x7f66d806fbc0 2022-02-02T18:14:50.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.702+0000 7f66d6ffd700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f66cc006cb0 tx=0x7f66cc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:50.715 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.703+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66cc01b570 con 0x7f66d806fbc0 2022-02-02T18:14:50.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.703+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f66cc01bb20 con 0x7f66d806fbc0 2022-02-02T18:14:50.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.703+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66cc01a960 con 0x7f66d806fbc0 2022-02-02T18:14:50.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.703+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d80fd0c0 con 0x7f66d806fbc0 2022-02-02T18:14:50.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.703+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d80fd550 con 0x7f66d806fbc0 2022-02-02T18:14:50.716 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.704+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8045ad0 con 0x7f66d806fbc0 2022-02-02T18:14:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.704+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f66cc00f070 con 0x7f66d806fbc0 2022-02-02T18:14:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.704+0000 7f66bf7fe700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 0x7f66c4032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.704+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f66cc041800 con 0x7f66d806fbc0 2022-02-02T18:14:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.704+0000 7f66d67fc700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 0x7f66c4032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:50.718 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.705+0000 7f66d67fc700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 0x7f66c4032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f66c80096a0 tx=0x7f66c8006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:50.719 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.708+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f66cc010360 con 0x7f66d806fbc0 2022-02-02T18:14:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.892+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d80fde00 con 0x7f66c402fdb0 2022-02-02T18:14:50.899 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.896+0000 7f66bf7fe700 1 -- 172.21.15.96:0/3981142012 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f66d80fde00 con 0x7f66c402fdb0 2022-02-02T18:14:50.899 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled mon update... 2022-02-02T18:14:50.901 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 msgr2=0x7f66c4032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 0x7f66c4032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f66c80096a0 tx=0x7f66c8006b40).stop 2022-02-02T18:14:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 msgr2=0x7f66d80fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:50.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f66cc006cb0 tx=0x7f66cc006ee0).stop 2022-02-02T18:14:50.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 shutdown_connections 2022-02-02T18:14:50.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f66c402fdb0 0x7f66c4032270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:50.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 --2- 172.21.15.96:0/3981142012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d806fbc0 0x7f66d80fc9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:50.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 >> 172.21.15.96:0/3981142012 conn(0x7f66d80f6110 msgr2=0x7f66d80f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:50.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 shutdown_connections 2022-02-02T18:14:50.904 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:50.898+0000 7f66d7fff700 1 -- 172.21.15.96:0/3981142012 wait complete. 2022-02-02T18:14:51.302 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying mgr service with default placement... 2022-02-02T18:14:51.302 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2022-02-02T18:14:51.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:51 smithi096 conmon[32067]: cephadm 2022-02-02T18:14:49. 2022-02-02T18:14:51.635 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:51 smithi096 conmon[32067]: 934663+0000 mgr.smithi096.shfutl (mgr.14114) 9 : cephadm [INF] Added host smithi096 2022-02-02T18:14:51.636 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:51 smithi096 conmon[32067]: audit 2022-02-02T18:14:50.896695+0000 mon.smithi096 (mon.0) 55 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:51.764 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.757+0000 7ff0357b9700 1 Processor -- start 2022-02-02T18:14:51.764 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.757+0000 7ff0357b9700 1 -- start start 2022-02-02T18:14:51.764 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.757+0000 7ff0357b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.757+0000 7ff0357b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300fb390 con 0x7ff0300faa80 2022-02-02T18:14:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.757+0000 7ff02effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51334/0 (socket says 172.21.15.96:51334) 2022-02-02T18:14:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02effd700 1 -- 172.21.15.96:0/2439491855 learned_addr learned my addr 172.21.15.96:0/2439491855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02effd700 1 -- 172.21.15.96:0/2439491855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300fb4d0 con 0x7ff0300faa80 2022-02-02T18:14:51.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02effd700 1 --2- 172.21.15.96:0/2439491855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff02400b5f0 tx=0x7ff024006ee0).ready entity=mon.0 client_cookie=f23589afe8f2a775 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:51.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02dffb700 1 -- 172.21.15.96:0/2439491855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff02400d600 con 0x7ff0300faa80 2022-02-02T18:14:51.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02dffb700 1 -- 172.21.15.96:0/2439491855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff02400dbb0 con 0x7ff0300faa80 2022-02-02T18:14:51.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.758+0000 7ff02dffb700 1 -- 172.21.15.96:0/2439491855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff024011bb0 con 0x7ff0300faa80 2022-02-02T18:14:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 -- 172.21.15.96:0/2439491855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 msgr2=0x7ff0300faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 --2- 172.21.15.96:0/2439491855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff02400b5f0 tx=0x7ff024006ee0).stop 2022-02-02T18:14:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 -- 172.21.15.96:0/2439491855 shutdown_connections 2022-02-02T18:14:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 --2- 172.21.15.96:0/2439491855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff0300faea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 -- 172.21.15.96:0/2439491855 >> 172.21.15.96:0/2439491855 conn(0x7ff0300f6260 msgr2=0x7ff0300f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 -- 172.21.15.96:0/2439491855 shutdown_connections 2022-02-02T18:14:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.759+0000 7ff0357b9700 1 -- 172.21.15.96:0/2439491855 wait complete. 2022-02-02T18:14:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff0357b9700 1 Processor -- start 2022-02-02T18:14:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff0357b9700 1 -- start start 2022-02-02T18:14:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff0357b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff0357b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03006fc00 con 0x7ff0300faa80 2022-02-02T18:14:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff02effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff02effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51336/0 (socket says 172.21.15.96:51336) 2022-02-02T18:14:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.760+0000 7ff02effd700 1 -- 172.21.15.96:0/3769594971 learned_addr learned my addr 172.21.15.96:0/3769594971 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff02effd700 1 -- 172.21.15.96:0/3769594971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02400b200 con 0x7ff0300faa80 2022-02-02T18:14:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff02effd700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff024003000 tx=0x7ff024006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff02400d9c0 con 0x7ff0300faa80 2022-02-02T18:14:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff02401a9d0 con 0x7ff0300faa80 2022-02-02T18:14:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03006fe00 con 0x7ff0300faa80 2022-02-02T18:14:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03010dc20 con 0x7ff0300faa80 2022-02-02T18:14:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.761+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff02401b880 con 0x7ff0300faa80 2022-02-02T18:14:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.762+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff02400f070 con 0x7ff0300faa80 2022-02-02T18:14:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.762+0000 7ff0177fe700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 0x7ff01c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.762+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff024041170 con 0x7ff0300faa80 2022-02-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.762+0000 7ff02e7fc700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 0x7ff01c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.762+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010004fa0 con 0x7ff0300faa80 2022-02-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.763+0000 7ff02e7fc700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 0x7ff01c032210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff0200096a0 tx=0x7ff020006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.767+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff024016030 con 0x7ff0300faa80 2022-02-02T18:14:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.951+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff010002a50 con 0x7ff01c02fd50 2022-02-02T18:14:51.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.955+0000 7ff0177fe700 1 -- 172.21.15.96:0/3769594971 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff010002a50 con 0x7ff01c02fd50 2022-02-02T18:14:51.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled mgr update... 2022-02-02T18:14:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 msgr2=0x7ff01c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 0x7ff01c032210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff0200096a0 tx=0x7ff020006b40).stop 2022-02-02T18:14:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 msgr2=0x7ff03010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff024003000 tx=0x7ff024006ee0).stop 2022-02-02T18:14:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 shutdown_connections 2022-02-02T18:14:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff01c02fd50 0x7ff01c032210 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 --2- 172.21.15.96:0/3769594971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0300faa80 0x7ff03010d570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.957+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 >> 172.21.15.96:0/3769594971 conn(0x7ff0300f6260 msgr2=0x7ff0300f7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.958+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 shutdown_connections 2022-02-02T18:14:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:51.958+0000 7ff0357b9700 1 -- 172.21.15.96:0/3769594971 wait complete. 2022-02-02T18:14:52.505 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:52 smithi096 conmon[32067]: audit 2022-02-02T18:14:50.893726+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:14:52.506 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:52 smithi096 conmon[32067]: 14114) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:52.506 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:52 smithi096 conmon[32067]: cephadm 2022-02-02T18:14:50.894416+0000 mgr.smithi096.shfutl (mgr.14114) 11 : cephadm [INF] Saving service mon spec with placement count:5 2022-02-02T18:14:52.506 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:52 smithi096 conmon[32067]: audit 2022-02-02T18:14:51.956006+0000 mon.smithi096 (mon.0) 56 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:52.674 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying crash service with default placement... 2022-02-02T18:14:52.675 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2022-02-02T18:14:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.206+0000 7fa26f1e0700 1 Processor -- start 2022-02-02T18:14:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.206+0000 7fa26f1e0700 1 -- start start 2022-02-02T18:14:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.206+0000 7fa26f1e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.206+0000 7fa26f1e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680fb390 con 0x7fa2680faa80 2022-02-02T18:14:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa26cf7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa26cf7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51340/0 (socket says 172.21.15.96:51340) 2022-02-02T18:14:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa26cf7c700 1 -- 172.21.15.96:0/3572621997 learned_addr learned my addr 172.21.15.96:0/3572621997 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa26cf7c700 1 -- 172.21.15.96:0/3572621997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680fb4d0 con 0x7fa2680faa80 2022-02-02T18:14:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa26cf7c700 1 --2- 172.21.15.96:0/3572621997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa25c00b5f0 tx=0x7fa25c006ee0).ready entity=mon.0 client_cookie=de3fa89f51b3d111 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa2677fe700 1 -- 172.21.15.96:0/3572621997 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa25c00d600 con 0x7fa2680faa80 2022-02-02T18:14:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa2677fe700 1 -- 172.21.15.96:0/3572621997 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa25c00dbf0 con 0x7fa2680faa80 2022-02-02T18:14:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.207+0000 7fa2677fe700 1 -- 172.21.15.96:0/3572621997 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa25c011bf0 con 0x7fa2680faa80 2022-02-02T18:14:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3572621997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 msgr2=0x7fa2680faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3572621997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa25c00b5f0 tx=0x7fa25c006ee0).stop 2022-02-02T18:14:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3572621997 shutdown_connections 2022-02-02T18:14:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3572621997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa2680faea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3572621997 >> 172.21.15.96:0/3572621997 conn(0x7fa2680f6260 msgr2=0x7fa2680f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3572621997 shutdown_connections 2022-02-02T18:14:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3572621997 wait complete. 2022-02-02T18:14:53.220 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.208+0000 7fa26f1e0700 1 Processor -- start 2022-02-02T18:14:53.220 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26f1e0700 1 -- start start 2022-02-02T18:14:53.220 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26f1e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:53.220 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26f1e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26810cf80 con 0x7fa2680faa80 2022-02-02T18:14:53.221 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26cf7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:53.221 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26cf7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51342/0 (socket says 172.21.15.96:51342) 2022-02-02T18:14:53.221 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26cf7c700 1 -- 172.21.15.96:0/3844356935 learned_addr learned my addr 172.21.15.96:0/3844356935 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:53.222 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26cf7c700 1 -- 172.21.15.96:0/3844356935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c00b200 con 0x7fa2680faa80 2022-02-02T18:14:53.222 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.209+0000 7fa26cf7c700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa25c011de0 tx=0x7fa25c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:53.222 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa25c01b410 con 0x7fa2680faa80 2022-02-02T18:14:53.222 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa25c01ba00 con 0x7fa2680faa80 2022-02-02T18:14:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26810d180 con 0x7fa2680faa80 2022-02-02T18:14:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa25c01a840 con 0x7fa2680faa80 2022-02-02T18:14:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26810d610 con 0x7fa2680faa80 2022-02-02T18:14:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fa25c02b070 con 0x7fa2680faa80 2022-02-02T18:14:53.224 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.210+0000 7fa2657fa700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 0x7fa24c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:53.224 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.211+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa25c041740 con 0x7fa2680faa80 2022-02-02T18:14:53.224 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.211+0000 7fa267fff700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 0x7fa24c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:53.225 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.211+0000 7fa267fff700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 0x7fa24c032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa2540096a0 tx=0x7fa254006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:53.225 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.211+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268045ad0 con 0x7fa2680faa80 2022-02-02T18:14:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.216+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa25c016070 con 0x7fa2680faa80 2022-02-02T18:14:53.407 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.404+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fa268106dd0 con 0x7fa24c02fd50 2022-02-02T18:14:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.408+0000 7fa2657fa700 1 -- 172.21.15.96:0/3844356935 <== mgr.14114 v2:172.21.15.96:6800/3681595525 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fa268106dd0 con 0x7fa24c02fd50 2022-02-02T18:14:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled crash update... 2022-02-02T18:14:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 msgr2=0x7fa24c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 0x7fa24c032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa2540096a0 tx=0x7fa254006b40).stop 2022-02-02T18:14:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 msgr2=0x7fa26810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa25c011de0 tx=0x7fa25c006ee0).stop 2022-02-02T18:14:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 shutdown_connections 2022-02-02T18:14:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7fa24c02fd50 0x7fa24c032210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 --2- 172.21.15.96:0/3844356935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2680faa80 0x7fa26810ca90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 >> 172.21.15.96:0/3844356935 conn(0x7fa2680f6260 msgr2=0x7fa26806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 shutdown_connections 2022-02-02T18:14:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:53.410+0000 7fa26f1e0700 1 -- 172.21.15.96:0/3844356935 wait complete. 2022-02-02T18:14:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: audit 2022-02-02T18:14:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 2022-02-02T18 2022-02-02T18:14:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: :14:51.953169+0000 mgr.smithi096.shfutl (mgr.14114) 12 : audit 2022-02-02T18:14:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: cephadm 2022-02-02T18:14:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 2022-02-02T18:14:51.953689+0000 2022-02-02T18:14:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14114) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2022-02-02T18:14:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:14:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 02T18:14:52.870189+0000 mon.smithi096 (mon.0) 2022-02-02T18:14:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 57 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: audit 2022-02-02T18:14:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 2022-02-02T18:14:53.262902+0000 2022-02-02T18:14:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: mon.smithi096 (mon.0) 58 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:53 smithi096 conmon[32067]: 2022-02-02T18:14:53.811 INFO:teuthology.orchestra.run.smithi096.stderr:Enabling mgr prometheus module... 2022-02-02T18:14:53.811 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2022-02-02T18:14:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.344+0000 7f43b358b700 1 Processor -- start 2022-02-02T18:14:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.344+0000 7f43b358b700 1 -- start start 2022-02-02T18:14:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.344+0000 7f43b358b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.344+0000 7f43b358b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0fb4e0 con 0x7f43ac0fab40 2022-02-02T18:14:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.345+0000 7f43b1327700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.345+0000 7f43b1327700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51346/0 (socket says 172.21.15.96:51346) 2022-02-02T18:14:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.345+0000 7f43b1327700 1 -- 172.21.15.96:0/4181213063 learned_addr learned my addr 172.21.15.96:0/4181213063 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.345+0000 7f43b1327700 1 -- 172.21.15.96:0/4181213063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0fb620 con 0x7f43ac0fab40 2022-02-02T18:14:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.345+0000 7f43b1327700 1 --2- 172.21.15.96:0/4181213063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f43a800b5f0 tx=0x7f43a8006ee0).ready entity=mon.0 client_cookie=90462bd11cb6fcf2 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43a3fff700 1 -- 172.21.15.96:0/4181213063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a800d600 con 0x7f43ac0fab40 2022-02-02T18:14:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43a3fff700 1 -- 172.21.15.96:0/4181213063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f43a800dbf0 con 0x7f43ac0fab40 2022-02-02T18:14:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43a3fff700 1 -- 172.21.15.96:0/4181213063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a8011bf0 con 0x7f43ac0fab40 2022-02-02T18:14:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 -- 172.21.15.96:0/4181213063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 msgr2=0x7f43ac0faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 --2- 172.21.15.96:0/4181213063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f43a800b5f0 tx=0x7f43a8006ee0).stop 2022-02-02T18:14:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 -- 172.21.15.96:0/4181213063 shutdown_connections 2022-02-02T18:14:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 --2- 172.21.15.96:0/4181213063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac0faf60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 -- 172.21.15.96:0/4181213063 >> 172.21.15.96:0/4181213063 conn(0x7f43ac0f62a0 msgr2=0x7f43ac0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 -- 172.21.15.96:0/4181213063 shutdown_connections 2022-02-02T18:14:54.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.346+0000 7f43b358b700 1 -- 172.21.15.96:0/4181213063 wait complete. 2022-02-02T18:14:54.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b358b700 1 Processor -- start 2022-02-02T18:14:54.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b358b700 1 -- start start 2022-02-02T18:14:54.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b358b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:54.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b358b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0ff310 con 0x7f43ac0fab40 2022-02-02T18:14:54.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b1327700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:54.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b1327700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51348/0 (socket says 172.21.15.96:51348) 2022-02-02T18:14:54.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b1327700 1 -- 172.21.15.96:0/1169329785 learned_addr learned my addr 172.21.15.96:0/1169329785 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:54.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.347+0000 7f43b1327700 1 -- 172.21.15.96:0/1169329785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a800b200 con 0x7f43ac0fab40 2022-02-02T18:14:54.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43b1327700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f43a8011de0 tx=0x7f43a8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:54.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a801b410 con 0x7f43ac0fab40 2022-02-02T18:14:54.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f43a801ba00 con 0x7f43ac0fab40 2022-02-02T18:14:54.390 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac0ff4b0 con 0x7f43ac0fab40 2022-02-02T18:14:54.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a801a770 con 0x7f43ac0fab40 2022-02-02T18:14:54.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.348+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac0ff940 con 0x7f43ac0fab40 2022-02-02T18:14:54.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f43a802b070 con 0x7f43ac0fab40 2022-02-02T18:14:54.391 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43a1ffb700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 0x7f4390032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:54.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f43a8042470 con 0x7f43ac0fab40 2022-02-02T18:14:54.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43b0b26700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 0x7f4390032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:54.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43b0b26700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 0x7f4390032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f439c0096a0 tx=0x7f439c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:54.392 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.349+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac059100 con 0x7f43ac0fab40 2022-02-02T18:14:54.393 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.354+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f43a801f080 con 0x7f43ac0fab40 2022-02-02T18:14:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:54.555+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7f43ac045ad0 con 0x7f43ac0fab40 2022-02-02T18:14:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:54 smithi096 conmon[32067]: audit 2022-02-02T18:14:53.405261+0000 mgr.smithi096.shfutl (mgr.14114) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:14:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:54 smithi096 conmon[32067]: cephadm 2022-02-02T18:14:53.405956+0000 mgr.smithi096.shfutl (mgr.14114) 15 : cephadm [INF] Saving service crash spec with placement * 2022-02-02T18:14:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:54 smithi096 conmon[32067]: audit 2022-02-02T18:14:53.408837+0000 mon.smithi096 (mon.0) 59 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:55.415 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.411+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 8) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f43a800f070 con 0x7f43ac0fab40 2022-02-02T18:14:55.416 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.412+0000 7f43a1ffb700 1 -- 172.21.15.96:0/1169329785 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v8) v1 ==== 89+0+0 (secure 0 0 0) 0x7f43a8041dd0 con 0x7f43ac0fab40 2022-02-02T18:14:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 msgr2=0x7f4390032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 0x7f4390032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f439c0096a0 tx=0x7f439c006b40).stop 2022-02-02T18:14:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 msgr2=0x7f43ac100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f43a8011de0 tx=0x7f43a8006ee0).stop 2022-02-02T18:14:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 shutdown_connections 2022-02-02T18:14:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7f439002fdb0 0x7f4390032270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 --2- 172.21.15.96:0/1169329785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43ac0fab40 0x7f43ac100e90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 >> 172.21.15.96:0/1169329785 conn(0x7f43ac0f62a0 msgr2=0x7f43ac06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 shutdown_connections 2022-02-02T18:14:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:55.414+0000 7f43b358b700 1 -- 172.21.15.96:0/1169329785 wait complete. 2022-02-02T18:14:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:55 smithi096 conmon[32067]: audit 2022-02-02T18:14:54.556364+0000 mon.smithi096 (mon. 2022-02-02T18:14:55.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:55 smithi096 conmon[32067]: 0) 60 : audit [INF] from='client.? 172.21.15.96:0/1169329785' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2022-02-02T18:14:55.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:55 smithi096 conmon[32067]: audit 2022-02-02T18:14:54.850335+0000 mon.smithi096 (mon.0) 61 : audit [INF] from='mgr.14114 172.21.15.96:0/2609524471' entity='mgr.smithi096.shfutl' 2022-02-02T18:14:56.048 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying prometheus service with default placement... 2022-02-02T18:14:56.048 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2022-02-02T18:14:56.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:56 smithi096 conmon[32067]: audit 2022-02-02T18:14:55.412968+0000 mon.smithi096 (mon.0 2022-02-02T18:14:56.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:56 smithi096 conmon[32067]: ) 62 : audit [INF] from='client.? 172.21.15.96:0/1169329785' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2022-02-02T18:14:56.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:14:56 smithi096 conmon[32067]: cluster 2022-02-02T18:14:55.413021+0000 mon.smithi096 (mon.0) 63 : cluster [DBG] mgrmap e8: smithi096.shfutl(active, since 17s) 2022-02-02T18:14:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.654+0000 7ff6b6849700 1 Processor -- start 2022-02-02T18:14:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.654+0000 7ff6b6849700 1 -- start start 2022-02-02T18:14:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.654+0000 7ff6b6849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.654+0000 7ff6b6849700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00fb390 con 0x7ff6b00faa80 2022-02-02T18:14:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.655+0000 7ff6affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.655+0000 7ff6affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51362/0 (socket says 172.21.15.96:51362) 2022-02-02T18:14:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.655+0000 7ff6affff700 1 -- 172.21.15.96:0/511016880 learned_addr learned my addr 172.21.15.96:0/511016880 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.655+0000 7ff6affff700 1 -- 172.21.15.96:0/511016880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00fb4d0 con 0x7ff6b00faa80 2022-02-02T18:14:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.655+0000 7ff6affff700 1 --2- 172.21.15.96:0/511016880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff6a000b5f0 tx=0x7ff6a0006ee0).ready entity=mon.0 client_cookie=8c99502698573a64 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.656+0000 7ff6aeffd700 1 -- 172.21.15.96:0/511016880 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6a000d600 con 0x7ff6b00faa80 2022-02-02T18:14:56.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.656+0000 7ff6aeffd700 1 -- 172.21.15.96:0/511016880 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff6a000dbf0 con 0x7ff6b00faa80 2022-02-02T18:14:56.667 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.656+0000 7ff6aeffd700 1 -- 172.21.15.96:0/511016880 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6a0011bf0 con 0x7ff6b00faa80 2022-02-02T18:14:56.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 -- 172.21.15.96:0/511016880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 msgr2=0x7ff6b00faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:14:56.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 --2- 172.21.15.96:0/511016880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff6a000b5f0 tx=0x7ff6a0006ee0).stop 2022-02-02T18:14:56.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 -- 172.21.15.96:0/511016880 shutdown_connections 2022-02-02T18:14:56.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 --2- 172.21.15.96:0/511016880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b00faea0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:14:56.668 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 -- 172.21.15.96:0/511016880 >> 172.21.15.96:0/511016880 conn(0x7ff6b00f6260 msgr2=0x7ff6b00f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:14:56.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 -- 172.21.15.96:0/511016880 shutdown_connections 2022-02-02T18:14:56.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.657+0000 7ff6b6849700 1 -- 172.21.15.96:0/511016880 wait complete. 2022-02-02T18:14:56.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.658+0000 7ff6b6849700 1 Processor -- start 2022-02-02T18:14:56.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.658+0000 7ff6b6849700 1 -- start start 2022-02-02T18:14:56.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.658+0000 7ff6b6849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:56.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.658+0000 7ff6b6849700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b010adc0 con 0x7ff6b00faa80 2022-02-02T18:14:56.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.658+0000 7ff6affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:14:56.670 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51364/0 (socket says 172.21.15.96:51364) 2022-02-02T18:14:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6affff700 1 -- 172.21.15.96:0/3609976112 learned_addr learned my addr 172.21.15.96:0/3609976112 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:14:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6affff700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a000b200 con 0x7ff6b00faa80 2022-02-02T18:14:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6affff700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff6a0011de0 tx=0x7ff6a0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:14:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6a001b410 con 0x7ff6b00faa80 2022-02-02T18:14:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff6a001ba00 con 0x7ff6b00faa80 2022-02-02T18:14:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.659+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b010afc0 con 0x7ff6b00faa80 2022-02-02T18:14:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.660+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b010b450 con 0x7ff6b00faa80 2022-02-02T18:14:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.660+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6a001a840 con 0x7ff6b00faa80 2022-02-02T18:14:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 36134+0+0 (secure 0 0 0) 0x7ff6a002b070 con 0x7ff6b00faa80 2022-02-02T18:14:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6acff9700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:14:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff6a0041740 con 0x7ff6b00faa80 2022-02-02T18:14:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6af7fe700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3681595525 2022-02-02T18:14:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:14:56.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.661+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff690004fa0 con 0x7ff6b00faa80 2022-02-02T18:14:56.674 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.669+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff6a001f080 con 0x7ff6b00faa80 2022-02-02T18:14:56.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.862+0000 7ff6af7fe700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3681595525 2022-02-02T18:14:56.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.862+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T18:14:56.897 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:56.894+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff690002a50 con 0x7ff69c02fe50 2022-02-02T18:14:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:57.263+0000 7ff6af7fe700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3681595525 2022-02-02T18:14:57.266 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:57.263+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T18:14:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:58.064+0000 7ff6af7fe700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3681595525 2022-02-02T18:14:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:58.064+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T18:14:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:59.665+0000 7ff6af7fe700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3681595525 2022-02-02T18:14:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:14:59.665+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T18:15:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:00.375+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 9) v1 ==== 35984+0+0 (secure 0 0 0) 0x7ff6a000f070 con 0x7ff6b00faa80 2022-02-02T18:15:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:00.375+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 msgr2=0x7ff69c032310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:15:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:00.375+0000 7ff6acff9700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:00.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: cluster 2022-02-02T18:15:00 2022-02-02T18:15:00.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: .321425+0000 mon.smithi096 (mon.0) 64 : cluster [INF] Active manager daemon smithi096.shfutl restarted 2022-02-02T18:15:00.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: cluster 2022-02-02T18:15:00.321809+0000 2022-02-02T18:15:00.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: mon.smithi096 (mon.0) 65 : cluster [INF] Activating manager daemon smithi096.shfutl 2022-02-02T18:15:00.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: cluster 2022-02-02T18:15:00. 2022-02-02T18:15:00.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: 326126+0000 mon.smithi096 (mon.0) 66 : cluster 2022-02-02T18:15:00.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:00 smithi096 conmon[32067]: [DBG] osdmap e3: 0 total, 0 up, 0 in 2022-02-02T18:15:01.387 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.382+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mgrmap(e 10) v1 ==== 36054+0+0 (secure 0 0 0) 0x7ff6a0042d30 con 0x7ff6b00faa80 2022-02-02T18:15:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.382+0000 7ff6acff9700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 0x7ff69c035ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.382+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 --> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff690002a50 con 0x7ff69c033c00 2022-02-02T18:15:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.382+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 0x7ff69c035ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:01.389 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.383+0000 7ff6af7fe700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 0x7ff69c035ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7ff6a4006fd0 tx=0x7ff6a4006db0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:01.393 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.390+0000 7ff6acff9700 1 -- 172.21.15.96:0/3609976112 <== mgr.14142 v2:172.21.15.96:6800/3765010446 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ff690002a50 con 0x7ff69c033c00 2022-02-02T18:15:01.393 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled prometheus update... 2022-02-02T18:15:01.396 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 msgr2=0x7ff69c035ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:01.396 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 0x7ff69c035ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7ff6a4006fd0 tx=0x7ff6a4006db0).stop 2022-02-02T18:15:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 msgr2=0x7ff6b010a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff6a0011de0 tx=0x7ff6a0006ee0).stop 2022-02-02T18:15:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 shutdown_connections 2022-02-02T18:15:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6b00faa80 0x7ff6b010a8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7ff69c033c00 0x7ff69c035ff0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 --2- 172.21.15.96:0/3609976112 >> [v2:172.21.15.96:6800/3681595525,v1:172.21.15.96:6801/3681595525] conn(0x7ff69c02fe50 0x7ff69c032310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 >> 172.21.15.96:0/3609976112 conn(0x7ff6b00f6260 msgr2=0x7ff6b00f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 shutdown_connections 2022-02-02T18:15:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:01.392+0000 7ff6b6849700 1 -- 172.21.15.96:0/3609976112 wait complete. 2022-02-02T18:15:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying grafana service with default placement... 2022-02-02T18:15:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2022-02-02T18:15:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: cluster 2022-02-02T18:15:00.377409+0000 2022-02-02T18:15:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: mon.smithi096 (mon.0) 67 : cluster [DBG] mgrmap e9: smithi096.shfutl(active, starting, since 0.05568s) 2022-02-02T18:15:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.378883+0000 mon.smithi096 (mon.0) 68 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:15:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.379540+0000 mon.smithi096 (mon.0) 69 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:15:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.380144+0000 mon.smithi096 (mon.0) 70 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:15:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.380277+0000 mon.smithi096 (mon.0) 71 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:15:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.380401+0000 mon.smithi096 (mon.0) 72 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:15:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: cluster 2022-02-02T18:15:00.394201+0000 mon.smithi096 (mon.0) 73 : cluster [INF] Manager daemon smithi096.shfutl is now available 2022-02-02T18:15:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.495540+0000 mon.smithi096 (mon.0) 2022-02-02T18:15:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: 74 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:15:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.497417+0000 mon.smithi096 (mon.0) 75 : audit [DBG] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:15:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.511860+0000 mon.smithi096 (mon.0 2022-02-02T18:15:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: ) 76 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:15:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: audit 2022-02-02T18:15:00.514412+0000 mon.smithi096 (mon.0) 2022-02-02T18:15:01.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:01 smithi096 conmon[32067]: 77 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:15:02.358 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d1a206700 1 Processor -- start 2022-02-02T18:15:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d1a206700 1 -- start start 2022-02-02T18:15:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d1a206700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d1a206700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140fb3c0 con 0x7f8d140faab0 2022-02-02T18:15:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51408/0 (socket says 172.21.15.96:51408) 2022-02-02T18:15:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.354+0000 7f8d137fe700 1 -- 172.21.15.96:0/3068707759 learned_addr learned my addr 172.21.15.96:0/3068707759 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:02.361 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.355+0000 7f8d137fe700 1 -- 172.21.15.96:0/3068707759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140fb500 con 0x7f8d140faab0 2022-02-02T18:15:02.361 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.355+0000 7f8d137fe700 1 --2- 172.21.15.96:0/3068707759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8cfc00b5f0 tx=0x7f8cfc006ee0).ready entity=mon.0 client_cookie=6ca5e2cacb02e5b9 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:02.362 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.355+0000 7f8d127fc700 1 -- 172.21.15.96:0/3068707759 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cfc00d600 con 0x7f8d140faab0 2022-02-02T18:15:02.362 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.355+0000 7f8d127fc700 1 -- 172.21.15.96:0/3068707759 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8cfc00dbf0 con 0x7f8d140faab0 2022-02-02T18:15:02.362 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.355+0000 7f8d127fc700 1 -- 172.21.15.96:0/3068707759 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cfc011bf0 con 0x7f8d140faab0 2022-02-02T18:15:02.362 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 -- 172.21.15.96:0/3068707759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 msgr2=0x7f8d140faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:02.363 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 --2- 172.21.15.96:0/3068707759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8cfc00b5f0 tx=0x7f8cfc006ee0).stop 2022-02-02T18:15:02.363 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 -- 172.21.15.96:0/3068707759 shutdown_connections 2022-02-02T18:15:02.363 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 --2- 172.21.15.96:0/3068707759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d140faed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:02.363 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 -- 172.21.15.96:0/3068707759 >> 172.21.15.96:0/3068707759 conn(0x7f8d140f62f0 msgr2=0x7f8d140f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:02.364 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 -- 172.21.15.96:0/3068707759 shutdown_connections 2022-02-02T18:15:02.364 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 -- 172.21.15.96:0/3068707759 wait complete. 2022-02-02T18:15:02.364 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.356+0000 7f8d1a206700 1 Processor -- start 2022-02-02T18:15:02.364 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d1a206700 1 -- start start 2022-02-02T18:15:02.365 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d1a206700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:02.365 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d1a206700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1410d030 con 0x7f8d140faab0 2022-02-02T18:15:02.365 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:02.365 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51410/0 (socket says 172.21.15.96:51410) 2022-02-02T18:15:02.365 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d137fe700 1 -- 172.21.15.96:0/4068041654 learned_addr learned my addr 172.21.15.96:0/4068041654 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:02.366 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d137fe700 1 -- 172.21.15.96:0/4068041654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc00b200 con 0x7f8d140faab0 2022-02-02T18:15:02.366 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d137fe700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8cfc011e30 tx=0x7f8cfc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:02.366 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cfc01b410 con 0x7f8d140faab0 2022-02-02T18:15:02.366 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1410d230 con 0x7f8d140faab0 2022-02-02T18:15:02.367 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8cfc01ba00 con 0x7f8d140faab0 2022-02-02T18:15:02.367 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.357+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cfc01a750 con 0x7f8d140faab0 2022-02-02T18:15:02.368 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.358+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1410d6c0 con 0x7f8d140faab0 2022-02-02T18:15:02.368 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.358+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f8cfc02b070 con 0x7f8d140faab0 2022-02-02T18:15:02.368 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.358+0000 7f8d0bfff700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 0x7f8cf40321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:02.368 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.358+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f8cfc0423d0 con 0x7f8d140faab0 2022-02-02T18:15:02.369 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.359+0000 7f8d12ffd700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 0x7f8cf40321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:02.369 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.359+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d14045ad0 con 0x7f8d140faab0 2022-02-02T18:15:02.370 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.359+0000 7f8d12ffd700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 0x7f8cf40321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8d040096a0 tx=0x7f8d04006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:02.370 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.363+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8cfc016020 con 0x7f8d140faab0 2022-02-02T18:15:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.391+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f8cfc00f070 con 0x7f8d140faab0 2022-02-02T18:15:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.550+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 --> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d14102670 con 0x7f8cf402fd00 2022-02-02T18:15:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.556+0000 7f8d0bfff700 1 -- 172.21.15.96:0/4068041654 <== mgr.14142 v2:172.21.15.96:6800/3765010446 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8d14102670 con 0x7f8cf402fd00 2022-02-02T18:15:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled grafana update... 2022-02-02T18:15:02.561 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 msgr2=0x7f8cf40321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 0x7f8cf40321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8d040096a0 tx=0x7f8d04006b40).stop 2022-02-02T18:15:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 msgr2=0x7f8d1410cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8cfc011e30 tx=0x7f8cfc006ee0).stop 2022-02-02T18:15:02.563 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 shutdown_connections 2022-02-02T18:15:02.563 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f8cf402fd00 0x7f8cf40321c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:02.563 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 --2- 172.21.15.96:0/4068041654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140faab0 0x7f8d1410cb40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:02.563 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.558+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 >> 172.21.15.96:0/4068041654 conn(0x7f8d140f62f0 msgr2=0x7f8d140ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:02.564 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.559+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 shutdown_connections 2022-02-02T18:15:02.564 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:02.559+0000 7f8d1a206700 1 -- 172.21.15.96:0/4068041654 wait complete. 2022-02-02T18:15:02.729 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:02 smithi096 conmon[32067]: cluster 2022-02-02T18:15:01.384400+0000 mon.smithi096 (mon.0) 78 : cluster [DBG] mgrmap e10: smithi096.shfutl(active, since 1.06267s) 2022-02-02T18:15:02.729 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:02 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:01.385737+0000 mgr.smithi096.shfutl (mgr.14142) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2022-02-02T18:15:02.730 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:02 smithi096 conmon[32067]: audit 2022-02-02T18:15:01.390538+0000 mon.smithi096 (mon.0) 79 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:02.936 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying node-exporter service with default placement... 2022-02-02T18:15:02.936 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2022-02-02T18:15:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:03 smithi096 conmon[32067]: cluster 2022-02-02T18:15:02.392552+0000 mon.smithi096 (mon.0) 80 : cluster [DBG] mgrmap e11: smithi096.shfutl(active, since 2s) 2022-02-02T18:15:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:03 smithi096 conmon[32067]: audit 2022-02-02T18:15:02.450185+0000 mon.smithi096 (mon.0) 81 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:03 smithi096 conmon[32067]: audit 2022-02-02T18:15:02.556876+0000 mon.smithi096 (mon.0) 82 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a1ce69700 1 Processor -- start 2022-02-02T18:15:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a1ce69700 1 -- start start 2022-02-02T18:15:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a1ce69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a1ce69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180fb180 con 0x7f2a180fa870 2022-02-02T18:15:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51414/0 (socket says 172.21.15.96:51414) 2022-02-02T18:15:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a177fe700 1 -- 172.21.15.96:0/2508268137 learned_addr learned my addr 172.21.15.96:0/2508268137 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.641+0000 7f2a177fe700 1 -- 172.21.15.96:0/2508268137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180fb2c0 con 0x7f2a180fa870 2022-02-02T18:15:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a177fe700 1 --2- 172.21.15.96:0/2508268137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2a0800b5f0 tx=0x7f2a08006ee0).ready entity=mon.0 client_cookie=25c8afbd1df12db0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a167fc700 1 -- 172.21.15.96:0/2508268137 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0800d600 con 0x7f2a180fa870 2022-02-02T18:15:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a167fc700 1 -- 172.21.15.96:0/2508268137 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2a0800dbf0 con 0x7f2a180fa870 2022-02-02T18:15:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a167fc700 1 -- 172.21.15.96:0/2508268137 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a08011bf0 con 0x7f2a180fa870 2022-02-02T18:15:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 -- 172.21.15.96:0/2508268137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 msgr2=0x7f2a180fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/2508268137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2a0800b5f0 tx=0x7f2a08006ee0).stop 2022-02-02T18:15:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 -- 172.21.15.96:0/2508268137 shutdown_connections 2022-02-02T18:15:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/2508268137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a180fac90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:03.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 -- 172.21.15.96:0/2508268137 >> 172.21.15.96:0/2508268137 conn(0x7f2a180f6090 msgr2=0x7f2a180f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:03.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 -- 172.21.15.96:0/2508268137 shutdown_connections 2022-02-02T18:15:03.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.642+0000 7f2a1ce69700 1 -- 172.21.15.96:0/2508268137 wait complete. 2022-02-02T18:15:03.650 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.643+0000 7f2a1ce69700 1 Processor -- start 2022-02-02T18:15:03.651 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.643+0000 7f2a1ce69700 1 -- start start 2022-02-02T18:15:03.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a1ce69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:03.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a1ce69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1806fc00 con 0x7f2a180fa870 2022-02-02T18:15:03.653 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:03.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51416/0 (socket says 172.21.15.96:51416) 2022-02-02T18:15:03.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a177fe700 1 -- 172.21.15.96:0/495953268 learned_addr learned my addr 172.21.15.96:0/495953268 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:03.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a177fe700 1 -- 172.21.15.96:0/495953268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0800b200 con 0x7f2a180fa870 2022-02-02T18:15:03.654 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a177fe700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a08011de0 tx=0x7f2a08006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:03.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0801b410 con 0x7f2a180fa870 2022-02-02T18:15:03.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2a0801ba00 con 0x7f2a180fa870 2022-02-02T18:15:03.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0801a840 con 0x7f2a180fa870 2022-02-02T18:15:03.655 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1806fe00 con 0x7f2a180fa870 2022-02-02T18:15:03.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.644+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1810da50 con 0x7f2a180fa870 2022-02-02T18:15:03.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.645+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a18045ad0 con 0x7f2a180fa870 2022-02-02T18:15:03.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.646+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f2a0802b070 con 0x7f2a180fa870 2022-02-02T18:15:03.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.646+0000 7f29fffff700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 0x7f2a04032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:03.656 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.646+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f2a08041740 con 0x7f2a180fa870 2022-02-02T18:15:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.646+0000 7f2a16ffd700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 0x7f2a04032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.646+0000 7f2a16ffd700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 0x7f2a04032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2a0c0096a0 tx=0x7f2a0c006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.650+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2a0802b8d0 con 0x7f2a180fa870 2022-02-02T18:15:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.835+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 --> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a18057f10 con 0x7f2a0402feb0 2022-02-02T18:15:03.845 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.842+0000 7f29fffff700 1 -- 172.21.15.96:0/495953268 <== mgr.14142 v2:172.21.15.96:6800/3765010446 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2a18057f10 con 0x7f2a0402feb0 2022-02-02T18:15:03.846 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2022-02-02T18:15:03.848 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 msgr2=0x7f2a04032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:03.849 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 0x7f2a04032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2a0c0096a0 tx=0x7f2a0c006b40).stop 2022-02-02T18:15:03.849 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 msgr2=0x7f2a1810d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:03.849 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a08011de0 tx=0x7f2a08006ee0).stop 2022-02-02T18:15:03.849 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 shutdown_connections 2022-02-02T18:15:03.850 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2a0402feb0 0x7f2a04032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:03.850 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 --2- 172.21.15.96:0/495953268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a180fa870 0x7f2a1810d3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:03.850 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 >> 172.21.15.96:0/495953268 conn(0x7f2a180f6090 msgr2=0x7f2a180f7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:03.851 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 shutdown_connections 2022-02-02T18:15:03.851 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:03.844+0000 7f2a1ce69700 1 -- 172.21.15.96:0/495953268 wait complete. 2022-02-02T18:15:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:Deploying alertmanager service with default placement... 2022-02-02T18:15:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2022-02-02T18:15:04.679 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:04 smithi096 conmon[32067]: audit 2022-02-02T18:15:02.551442+0000 mgr.smithi096.shfutl (mgr.14142) 3 2022-02-02T18:15:04.679 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:04 smithi096 conmon[32067]: : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:04.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:04 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:02.551998+0000 mgr.smithi096.shfutl (mgr.14142) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2022-02-02T18:15:04.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:04 smithi096 conmon[32067]: audit 2022-02-02T18:15:03.842652+0000 mon.smithi096 (mon.0) 83 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:04.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.675+0000 7f964d902700 1 Processor -- start 2022-02-02T18:15:04.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.675+0000 7f964d902700 1 -- start start 2022-02-02T18:15:04.685 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f964d902700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:04.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f964d902700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96480fa840 con 0x7f96480f9ea0 2022-02-02T18:15:04.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:04.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51420/0 (socket says 172.21.15.96:51420) 2022-02-02T18:15:04.686 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9646ffd700 1 -- 172.21.15.96:0/1617596230 learned_addr learned my addr 172.21.15.96:0/1617596230 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9646ffd700 1 -- 172.21.15.96:0/1617596230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96480fa980 con 0x7f96480f9ea0 2022-02-02T18:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9646ffd700 1 --2- 172.21.15.96:0/1617596230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f963000b5f0 tx=0x7f9630006ee0).ready entity=mon.0 client_cookie=1833e6d38e1f4e1d server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.676+0000 7f9645ffb700 1 -- 172.21.15.96:0/1617596230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963000d600 con 0x7f96480f9ea0 2022-02-02T18:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f9645ffb700 1 -- 172.21.15.96:0/1617596230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f963000dbf0 con 0x7f96480f9ea0 2022-02-02T18:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f9645ffb700 1 -- 172.21.15.96:0/1617596230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9630011bf0 con 0x7f96480f9ea0 2022-02-02T18:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 -- 172.21.15.96:0/1617596230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 msgr2=0x7f96480fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 --2- 172.21.15.96:0/1617596230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f963000b5f0 tx=0x7f9630006ee0).stop 2022-02-02T18:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 -- 172.21.15.96:0/1617596230 shutdown_connections 2022-02-02T18:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 --2- 172.21.15.96:0/1617596230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f96480fa2c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 -- 172.21.15.96:0/1617596230 >> 172.21.15.96:0/1617596230 conn(0x7f96480f59d0 msgr2=0x7f96480f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 -- 172.21.15.96:0/1617596230 shutdown_connections 2022-02-02T18:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.677+0000 7f964d902700 1 -- 172.21.15.96:0/1617596230 wait complete. 2022-02-02T18:15:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.678+0000 7f964d902700 1 Processor -- start 2022-02-02T18:15:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.678+0000 7f964d902700 1 -- start start 2022-02-02T18:15:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f964d902700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f964d902700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964810ae90 con 0x7f96480f9ea0 2022-02-02T18:15:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f9646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f9646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51422/0 (socket says 172.21.15.96:51422) 2022-02-02T18:15:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f9646ffd700 1 -- 172.21.15.96:0/609466830 learned_addr learned my addr 172.21.15.96:0/609466830 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f9646ffd700 1 -- 172.21.15.96:0/609466830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963000b200 con 0x7f96480f9ea0 2022-02-02T18:15:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f9646ffd700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9630011de0 tx=0x7f9630006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963001b410 con 0x7f96480f9ea0 2022-02-02T18:15:04.693 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f963001ba00 con 0x7f96480f9ea0 2022-02-02T18:15:04.693 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963001a770 con 0x7f96480f9ea0 2022-02-02T18:15:04.693 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964810b090 con 0x7f96480f9ea0 2022-02-02T18:15:04.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.679+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964810b520 con 0x7f96480f9ea0 2022-02-02T18:15:04.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.680+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f963002b070 con 0x7f96480f9ea0 2022-02-02T18:15:04.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.680+0000 7f963f7fe700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 0x7f9628032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:04.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.680+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f9630041600 con 0x7f96480f9ea0 2022-02-02T18:15:04.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.681+0000 7f96467fc700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 0x7f9628032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:04.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.681+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648045ad0 con 0x7f96480f9ea0 2022-02-02T18:15:04.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.681+0000 7f96467fc700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 0x7f9628032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f96380096a0 tx=0x7f9638006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:04.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.685+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9630016080 con 0x7f96480f9ea0 2022-02-02T18:15:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.864+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 --> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f964810bd80 con 0x7f962802feb0 2022-02-02T18:15:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.870+0000 7f963f7fe700 1 -- 172.21.15.96:0/609466830 <== mgr.14142 v2:172.21.15.96:6800/3765010446 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f964810bd80 con 0x7f962802feb0 2022-02-02T18:15:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2022-02-02T18:15:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 msgr2=0x7f9628032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 0x7f9628032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f96380096a0 tx=0x7f9638006b40).stop 2022-02-02T18:15:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 msgr2=0x7f964810a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9630011de0 tx=0x7f9630006ee0).stop 2022-02-02T18:15:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 shutdown_connections 2022-02-02T18:15:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f962802feb0 0x7f9628032370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 --2- 172.21.15.96:0/609466830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96480f9ea0 0x7f964810a9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 >> 172.21.15.96:0/609466830 conn(0x7f96480f59d0 msgr2=0x7f96480f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 shutdown_connections 2022-02-02T18:15:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:04.872+0000 7f964d902700 1 -- 172.21.15.96:0/609466830 wait complete. 2022-02-02T18:15:05.234 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2022-02-02T18:15:05.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:05 smithi096 conmon[32067]: audit 2022-02-02T18:15:03.837049+0000 mgr.smithi096.shfutl (mgr.14142) 5 : audit [DBG] 2022-02-02T18:15:05.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:05 smithi096 conmon[32067]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:05.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:05 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:03.837740+0000 mgr.smithi096.shfutl (mgr.14142) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2022-02-02T18:15:05.739 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:05 smithi096 conmon[32067]: audit 2022-02-02T18:15:04.870924+0000 mon.smithi096 (mon.0) 84 : audit [INF] from='mgr.14142 172.21.15.96:0/495324895' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.734+0000 7f7a14e58700 1 Processor -- start 2022-02-02T18:15:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.734+0000 7f7a14e58700 1 -- start start 2022-02-02T18:15:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a14e58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a14e58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100fb390 con 0x7f7a100faa80 2022-02-02T18:15:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51426/0 (socket says 172.21.15.96:51426) 2022-02-02T18:15:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a0e59c700 1 -- 172.21.15.96:0/2206477843 learned_addr learned my addr 172.21.15.96:0/2206477843 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a0e59c700 1 -- 172.21.15.96:0/2206477843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100fb4d0 con 0x7f7a100faa80 2022-02-02T18:15:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.735+0000 7f7a0e59c700 1 --2- 172.21.15.96:0/2206477843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7a0400b5f0 tx=0x7f7a04006ee0).ready entity=mon.0 client_cookie=1b953b00d654ef3c server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a0d59a700 1 -- 172.21.15.96:0/2206477843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a0400d600 con 0x7f7a100faa80 2022-02-02T18:15:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a0d59a700 1 -- 172.21.15.96:0/2206477843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7a0400dbf0 con 0x7f7a100faa80 2022-02-02T18:15:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a0d59a700 1 -- 172.21.15.96:0/2206477843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a04011bf0 con 0x7f7a100faa80 2022-02-02T18:15:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 -- 172.21.15.96:0/2206477843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 msgr2=0x7f7a100faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 --2- 172.21.15.96:0/2206477843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7a0400b5f0 tx=0x7f7a04006ee0).stop 2022-02-02T18:15:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 -- 172.21.15.96:0/2206477843 shutdown_connections 2022-02-02T18:15:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 --2- 172.21.15.96:0/2206477843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a100faea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 -- 172.21.15.96:0/2206477843 >> 172.21.15.96:0/2206477843 conn(0x7f7a100f6260 msgr2=0x7f7a100f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 -- 172.21.15.96:0/2206477843 shutdown_connections 2022-02-02T18:15:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.736+0000 7f7a14e58700 1 -- 172.21.15.96:0/2206477843 wait complete. 2022-02-02T18:15:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a14e58700 1 Processor -- start 2022-02-02T18:15:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a14e58700 1 -- start start 2022-02-02T18:15:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a14e58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a14e58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10109cb0 con 0x7f7a100faa80 2022-02-02T18:15:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51428/0 (socket says 172.21.15.96:51428) 2022-02-02T18:15:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.737+0000 7f7a0e59c700 1 -- 172.21.15.96:0/1927887202 learned_addr learned my addr 172.21.15.96:0/1927887202 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f7a0e59c700 1 -- 172.21.15.96:0/1927887202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0400b200 con 0x7f7a100faa80 2022-02-02T18:15:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f7a0e59c700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7a04011e30 tx=0x7f7a04006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a0401b410 con 0x7f7a100faa80 2022-02-02T18:15:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7a0401ba00 con 0x7f7a100faa80 2022-02-02T18:15:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a10109eb0 con 0x7f7a100faa80 2022-02-02T18:15:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a0401a7b0 con 0x7f7a100faa80 2022-02-02T18:15:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.738+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1010a340 con 0x7f7a100faa80 2022-02-02T18:15:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f7a0402b070 con 0x7f7a100faa80 2022-02-02T18:15:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f79feffd700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 0x7f79f4032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7a04041770 con 0x7f7a100faa80 2022-02-02T18:15:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f7a0dd9b700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 0x7f79f4032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10045ad0 con 0x7f7a100faa80 2022-02-02T18:15:05.752 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.739+0000 7f7a0dd9b700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 0x7f79f4032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7a000096a0 tx=0x7f7a00006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:05.752 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.743+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7a04016070 con 0x7f7a100faa80 2022-02-02T18:15:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.892+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7a100008d0 con 0x7f7a100faa80 2022-02-02T18:15:05.897 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.895+0000 7f79feffd700 1 -- 172.21.15.96:0/1927887202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v9)=0 v9) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7a0401f030 con 0x7f7a100faa80 2022-02-02T18:15:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.896+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 msgr2=0x7f79f4032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:05.901 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.896+0000 7f7a14e58700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 0x7f79f4032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7a000096a0 tx=0x7f7a00006b40).stop 2022-02-02T18:15:05.901 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.896+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 msgr2=0x7f7a101097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:05.901 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.896+0000 7f7a14e58700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7a04011e30 tx=0x7f7a04006ee0).stop 2022-02-02T18:15:05.901 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 shutdown_connections 2022-02-02T18:15:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f79f402fe60 0x7f79f4032320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 --2- 172.21.15.96:0/1927887202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a100faa80 0x7f7a101097c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 >> 172.21.15.96:0/1927887202 conn(0x7f7a100f6260 msgr2=0x7f7a100f7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 shutdown_connections 2022-02-02T18:15:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:05.897+0000 7f7a14e58700 1 -- 172.21.15.96:0/1927887202 wait complete. 2022-02-02T18:15:06.269 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2022-02-02T18:15:06.699 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:06 smithi096 conmon[32067]: audit 2022-02-02T18:15:04.865448+0000 mgr.smithi096.shfutl (mgr.14142) 7 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:06.700 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:06 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:04.866002+0000 mgr.smithi096.shfutl (mgr.14142) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2022-02-02T18:15:06.700 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:06 smithi096 conmon[32067]: audit 2022-02-02T18:15:05.895679+0000 mon.smithi096 (mon.0) 85 : audit [INF] from='client.? 172.21.15.96:0/1927887202' entity='client.admin' 2022-02-02T18:15:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd806e67700 1 Processor -- start 2022-02-02T18:15:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd806e67700 1 -- start start 2022-02-02T18:15:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd806e67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd806e67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800072080 con 0x7fd800071c60 2022-02-02T18:15:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd804c03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd804c03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51432/0 (socket says 172.21.15.96:51432) 2022-02-02T18:15:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.696+0000 7fd804c03700 1 -- 172.21.15.96:0/4094184394 learned_addr learned my addr 172.21.15.96:0/4094184394 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:06.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.697+0000 7fd804c03700 1 -- 172.21.15.96:0/4094184394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8000706f0 con 0x7fd800071c60 2022-02-02T18:15:06.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.697+0000 7fd804c03700 1 --2- 172.21.15.96:0/4094184394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd7f400b5f0 tx=0x7fd7f4006ee0).ready entity=mon.0 client_cookie=ef3347dbe29c2117 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:06.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.697+0000 7fd7ff7fe700 1 -- 172.21.15.96:0/4094184394 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7f400d600 con 0x7fd800071c60 2022-02-02T18:15:06.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.697+0000 7fd7ff7fe700 1 -- 172.21.15.96:0/4094184394 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd7f400dbf0 con 0x7fd800071c60 2022-02-02T18:15:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.697+0000 7fd7ff7fe700 1 -- 172.21.15.96:0/4094184394 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7f4011bf0 con 0x7fd800071c60 2022-02-02T18:15:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 -- 172.21.15.96:0/4094184394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 msgr2=0x7fd800070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 --2- 172.21.15.96:0/4094184394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd7f400b5f0 tx=0x7fd7f4006ee0).stop 2022-02-02T18:15:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 -- 172.21.15.96:0/4094184394 shutdown_connections 2022-02-02T18:15:06.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 --2- 172.21.15.96:0/4094184394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd800070200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:06.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 -- 172.21.15.96:0/4094184394 >> 172.21.15.96:0/4094184394 conn(0x7fd8000f73d0 msgr2=0x7fd8000f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:06.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 -- 172.21.15.96:0/4094184394 shutdown_connections 2022-02-02T18:15:06.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.698+0000 7fd806e67700 1 -- 172.21.15.96:0/4094184394 wait complete. 2022-02-02T18:15:06.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd806e67700 1 Processor -- start 2022-02-02T18:15:06.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd806e67700 1 -- start start 2022-02-02T18:15:06.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd806e67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:06.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd806e67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80010d0a0 con 0x7fd800071c60 2022-02-02T18:15:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd804c03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd804c03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51434/0 (socket says 172.21.15.96:51434) 2022-02-02T18:15:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd804c03700 1 -- 172.21.15.96:0/2548969799 learned_addr learned my addr 172.21.15.96:0/2548969799 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd804c03700 1 -- 172.21.15.96:0/2548969799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f400b200 con 0x7fd800071c60 2022-02-02T18:15:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.699+0000 7fd804c03700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd7f4006800 tx=0x7fd7f4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.700+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7f400dec0 con 0x7fd800071c60 2022-02-02T18:15:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.700+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80010d2a0 con 0x7fd800071c60 2022-02-02T18:15:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.700+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd7f401b8a0 con 0x7fd800071c60 2022-02-02T18:15:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.700+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7f401a6f0 con 0x7fd800071c60 2022-02-02T18:15:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.700+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80010d730 con 0x7fd800071c60 2022-02-02T18:15:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.701+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd800045ad0 con 0x7fd800071c60 2022-02-02T18:15:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.701+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fd7f402b070 con 0x7fd800071c60 2022-02-02T18:15:06.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.701+0000 7fd7fd7fa700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 0x7fd7e4032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:06.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.701+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fd7f40415b0 con 0x7fd800071c60 2022-02-02T18:15:06.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.701+0000 7fd7fffff700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 0x7fd7e4032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:06.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.702+0000 7fd7fffff700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 0x7fd7e4032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd7ec0096a0 tx=0x7fd7ec006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:06.714 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.705+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd7f402b4e0 con 0x7fd800071c60 2022-02-02T18:15:06.858 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.854+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd800101d70 con 0x7fd800071c60 2022-02-02T18:15:06.860 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.857+0000 7fd7fd7fa700 1 -- 172.21.15.96:0/2548969799 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v10)=0 v10) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd7f4016020 con 0x7fd800071c60 2022-02-02T18:15:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 msgr2=0x7fd7e4032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 0x7fd7e4032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd7ec0096a0 tx=0x7fd7ec006b40).stop 2022-02-02T18:15:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 msgr2=0x7fd80010cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd7f4006800 tx=0x7fd7f4006ee0).stop 2022-02-02T18:15:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 shutdown_connections 2022-02-02T18:15:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fd7e402fe60 0x7fd7e4032320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 --2- 172.21.15.96:0/2548969799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd800071c60 0x7fd80010cbb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 >> 172.21.15.96:0/2548969799 conn(0x7fd8000f73d0 msgr2=0x7fd8000f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 shutdown_connections 2022-02-02T18:15:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:06.859+0000 7fd806e67700 1 -- 172.21.15.96:0/2548969799 wait complete. 2022-02-02T18:15:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:Enabling the dashboard module... 2022-02-02T18:15:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2022-02-02T18:15:07.781 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e2cd2700 1 Processor -- start 2022-02-02T18:15:07.781 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e2cd2700 1 -- start start 2022-02-02T18:15:07.782 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e2cd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:07.782 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e2cd2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0feda0 con 0x7f73dc06fc40 2022-02-02T18:15:07.782 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e0a6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:07.782 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e0a6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51438/0 (socket says 172.21.15.96:51438) 2022-02-02T18:15:07.783 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e0a6e700 1 -- 172.21.15.96:0/4282645710 learned_addr learned my addr 172.21.15.96:0/4282645710 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:07.783 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.775+0000 7f73e0a6e700 1 -- 172.21.15.96:0/4282645710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0feee0 con 0x7f73dc06fc40 2022-02-02T18:15:07.783 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73e0a6e700 1 --2- 172.21.15.96:0/4282645710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f73cc00b5f0 tx=0x7f73cc006ee0).ready entity=mon.0 client_cookie=3b1113e9d0213f87 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:07.783 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73db7fe700 1 -- 172.21.15.96:0/4282645710 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73cc00d600 con 0x7f73dc06fc40 2022-02-02T18:15:07.783 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73db7fe700 1 -- 172.21.15.96:0/4282645710 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f73cc00dbf0 con 0x7f73dc06fc40 2022-02-02T18:15:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73db7fe700 1 -- 172.21.15.96:0/4282645710 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73cc011bf0 con 0x7f73dc06fc40 2022-02-02T18:15:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73e2cd2700 1 -- 172.21.15.96:0/4282645710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 msgr2=0x7f73dc0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.776+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/4282645710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f73cc00b5f0 tx=0x7f73cc006ee0).stop 2022-02-02T18:15:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 -- 172.21.15.96:0/4282645710 shutdown_connections 2022-02-02T18:15:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/4282645710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fe820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 -- 172.21.15.96:0/4282645710 >> 172.21.15.96:0/4282645710 conn(0x7f73dc0f62a0 msgr2=0x7f73dc0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 -- 172.21.15.96:0/4282645710 shutdown_connections 2022-02-02T18:15:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 -- 172.21.15.96:0/4282645710 wait complete. 2022-02-02T18:15:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 Processor -- start 2022-02-02T18:15:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.777+0000 7f73e2cd2700 1 -- start start 2022-02-02T18:15:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e2cd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e2cd2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0fa720 con 0x7f73dc06fc40 2022-02-02T18:15:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e0a6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e0a6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51440/0 (socket says 172.21.15.96:51440) 2022-02-02T18:15:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e0a6e700 1 -- 172.21.15.96:0/1136675012 learned_addr learned my addr 172.21.15.96:0/1136675012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e0a6e700 1 -- 172.21.15.96:0/1136675012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc00b200 con 0x7f73dc06fc40 2022-02-02T18:15:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73e0a6e700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f73cc011e30 tx=0x7f73cc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73cc01b410 con 0x7f73dc06fc40 2022-02-02T18:15:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f73cc01ba00 con 0x7f73dc06fc40 2022-02-02T18:15:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.778+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73cc01a750 con 0x7f73dc06fc40 2022-02-02T18:15:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.779+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc0fa8c0 con 0x7f73dc06fc40 2022-02-02T18:15:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.779+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0fad50 con 0x7f73dc06fc40 2022-02-02T18:15:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.779+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc045ad0 con 0x7f73dc06fc40 2022-02-02T18:15:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.780+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f73cc02b070 con 0x7f73dc06fc40 2022-02-02T18:15:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.780+0000 7f73d97fa700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 0x7f73c8032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.780+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f73cc041a90 con 0x7f73dc06fc40 2022-02-02T18:15:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.780+0000 7f73dbfff700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 0x7f73c8032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.780+0000 7f73dbfff700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 0x7f73c8032370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f73d00096a0 tx=0x7f73d0006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.784+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f73cc023d40 con 0x7f73dc06fc40 2022-02-02T18:15:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:07.970+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f73dc0ffc10 con 0x7f73dc06fc40 2022-02-02T18:15:08.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:07 smithi096 conmon[32067]: audit 2022-02-02T18:15:06.858333+0000 mon.smithi096 (mon.0) 86 2022-02-02T18:15:08.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:07 smithi096 conmon[32067]: : audit [INF] from='client.? 172.21.15.96:0/2548969799' entity='client.admin' 2022-02-02T18:15:08.866 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.862+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 12) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f73cc00f070 con 0x7f73dc06fc40 2022-02-02T18:15:08.889 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.864+0000 7f73d97fa700 1 -- 172.21.15.96:0/1136675012 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v12) v1 ==== 88+0+0 (secure 0 0 0) 0x7f73cc02c350 con 0x7f73dc06fc40 2022-02-02T18:15:08.889 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 msgr2=0x7f73c8032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 0x7f73c8032370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f73d00096a0 tx=0x7f73d0006b40).stop 2022-02-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 msgr2=0x7f73dc0fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f73cc011e30 tx=0x7f73cc006ee0).stop 2022-02-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 shutdown_connections 2022-02-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f73c802feb0 0x7f73c8032370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 --2- 172.21.15.96:0/1136675012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73dc06fc40 0x7f73dc0fc2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.866+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 >> 172.21.15.96:0/1136675012 conn(0x7f73dc0f62a0 msgr2=0x7f73dc0f7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.867+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 shutdown_connections 2022-02-02T18:15:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:08.867+0000 7f73e2cd2700 1 -- 172.21.15.96:0/1136675012 wait complete. 2022-02-02T18:15:09.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:08 smithi096 conmon[32067]: audit 2022-02-02T18:15:07.970835+0000 mon.smithi096 (mon.0) 87 : audit [INF] from='client.? 172.21.15.96:0/1136675012' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2022-02-02T18:15:09.244 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-02-02T18:15:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.684+0000 7fdfe9af4700 1 Processor -- start 2022-02-02T18:15:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.684+0000 7fdfe9af4700 1 -- start start 2022-02-02T18:15:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe9af4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe9af4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe406ff20 con 0x7fdfe406fb00 2022-02-02T18:15:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51454/0 (socket says 172.21.15.96:51454) 2022-02-02T18:15:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe37fe700 1 -- 172.21.15.96:0/1695546157 learned_addr learned my addr 172.21.15.96:0/1695546157 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe37fe700 1 -- 172.21.15.96:0/1695546157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40fc690 con 0x7fdfe406fb00 2022-02-02T18:15:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe37fe700 1 --2- 172.21.15.96:0/1695546157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdfd400b5f0 tx=0x7fdfd4006ee0).ready entity=mon.0 client_cookie=1f25afc049d4b0bf server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.685+0000 7fdfe27fc700 1 -- 172.21.15.96:0/1695546157 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd400d600 con 0x7fdfe406fb00 2022-02-02T18:15:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.686+0000 7fdfe27fc700 1 -- 172.21.15.96:0/1695546157 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdfd400dbf0 con 0x7fdfe406fb00 2022-02-02T18:15:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.686+0000 7fdfe27fc700 1 -- 172.21.15.96:0/1695546157 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd4011bf0 con 0x7fdfe406fb00 2022-02-02T18:15:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.686+0000 7fdfe9af4700 1 -- 172.21.15.96:0/1695546157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 msgr2=0x7fdfe4100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.686+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/1695546157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdfd400b5f0 tx=0x7fdfd4006ee0).stop 2022-02-02T18:15:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 -- 172.21.15.96:0/1695546157 shutdown_connections 2022-02-02T18:15:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/1695546157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4100ca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 -- 172.21.15.96:0/1695546157 >> 172.21.15.96:0/1695546157 conn(0x7fdfe40f6260 msgr2=0x7fdfe40f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 -- 172.21.15.96:0/1695546157 shutdown_connections 2022-02-02T18:15:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 -- 172.21.15.96:0/1695546157 wait complete. 2022-02-02T18:15:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 Processor -- start 2022-02-02T18:15:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.687+0000 7fdfe9af4700 1 -- start start 2022-02-02T18:15:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe9af4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe9af4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4111370 con 0x7fdfe406fb00 2022-02-02T18:15:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51456/0 (socket says 172.21.15.96:51456) 2022-02-02T18:15:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe37fe700 1 -- 172.21.15.96:0/93922480 learned_addr learned my addr 172.21.15.96:0/93922480 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe37fe700 1 -- 172.21.15.96:0/93922480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd400b200 con 0x7fdfe406fb00 2022-02-02T18:15:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe37fe700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fdfd4006800 tx=0x7fdfd4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd401b410 con 0x7fdfe406fb00 2022-02-02T18:15:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe4111570 con 0x7fdfe406fb00 2022-02-02T18:15:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.688+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe4112260 con 0x7fdfe406fb00 2022-02-02T18:15:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.689+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdfd401ba00 con 0x7fdfe406fb00 2022-02-02T18:15:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.689+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd401a6e0 con 0x7fdfe406fb00 2022-02-02T18:15:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.689+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fdfd402b070 con 0x7fdfe406fb00 2022-02-02T18:15:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.689+0000 7fdfcbfff700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 0x7fdfd00323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.690+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fdfd4041750 con 0x7fdfe406fb00 2022-02-02T18:15:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.690+0000 7fdfe2ffd700 1 -- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 msgr2=0x7fdfd00323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.690+0000 7fdfe2ffd700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 0x7fdfd00323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:15:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.690+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4004fa0 con 0x7fdfe406fb00 2022-02-02T18:15:09.701 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.694+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdfd4016070 con 0x7fdfe406fb00 2022-02-02T18:15:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.887+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdfc4005e80 con 0x7fdfe406fb00 2022-02-02T18:15:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.888+0000 7fdfcbfff700 1 -- 172.21.15.96:0/93922480 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v12) v1 ==== 56+0+104 (secure 0 0 0) 0x7fdfd401f030 con 0x7fdfe406fb00 2022-02-02T18:15:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:15:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "epoch": 12, 2022-02-02T18:15:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "available": true, 2022-02-02T18:15:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "active_name": "smithi096.shfutl", 2022-02-02T18:15:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "num_standby": 0 2022-02-02T18:15:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:15:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 msgr2=0x7fdfd00323c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:15:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 0x7fdfd00323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 msgr2=0x7fdfe4110e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fdfd4006800 tx=0x7fdfd4006ee0).stop 2022-02-02T18:15:09.896 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 shutdown_connections 2022-02-02T18:15:09.896 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7fdfd002ff00 0x7fdfd00323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:09.896 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 --2- 172.21.15.96:0/93922480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe406fb00 0x7fdfe4110e80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:09.896 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 >> 172.21.15.96:0/93922480 conn(0x7fdfe40f6260 msgr2=0x7fdfe40f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:09.896 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 shutdown_connections 2022-02-02T18:15:09.897 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:09.890+0000 7fdfe9af4700 1 -- 172.21.15.96:0/93922480 wait complete. 2022-02-02T18:15:10.043 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:09 smithi096 conmon[32067]: audit 2022-02-02T18:15:08.864562+0000 mon.smithi096 (mon.0) 88 : audit [INF] 2022-02-02T18:15:10.043 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:09 smithi096 conmon[32067]: from='client.? 172.21.15.96:0/1136675012' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2022-02-02T18:15:10.044 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:09 smithi096 conmon[32067]: cluster 2022-02-02T18:15:08.864669+0000 mon.smithi096 (mon.0) 89 : cluster [DBG] mgrmap e12: smithi096.shfutl(active, since 8s) 2022-02-02T18:15:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for the mgr to restart... 2022-02-02T18:15:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:Waiting for mgr epoch 12... 2022-02-02T18:15:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-02-02T18:15:10.787 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.777+0000 7f2af8587700 1 Processor -- start 2022-02-02T18:15:10.788 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.777+0000 7f2af8587700 1 -- start start 2022-02-02T18:15:10.788 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.777+0000 7f2af8587700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:10.788 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.777+0000 7f2af8587700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00fb3c0 con 0x7f2af00faab0 2022-02-02T18:15:10.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af6323700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:10.789 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af6323700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51462/0 (socket says 172.21.15.96:51462) 2022-02-02T18:15:10.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af6323700 1 -- 172.21.15.96:0/4286639458 learned_addr learned my addr 172.21.15.96:0/4286639458 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:10.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af6323700 1 -- 172.21.15.96:0/4286639458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00fb500 con 0x7f2af00faab0 2022-02-02T18:15:10.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af6323700 1 --2- 172.21.15.96:0/4286639458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2aec00b870 tx=0x7f2aec006f70).ready entity=mon.0 client_cookie=96a3e19ce7d4f472 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:10.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af5321700 1 -- 172.21.15.96:0/4286639458 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aec00da20 con 0x7f2af00faab0 2022-02-02T18:15:10.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af5321700 1 -- 172.21.15.96:0/4286639458 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2aec010470 con 0x7f2af00faab0 2022-02-02T18:15:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.778+0000 7f2af5321700 1 -- 172.21.15.96:0/4286639458 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aec00f5b0 con 0x7f2af00faab0 2022-02-02T18:15:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.779+0000 7f2af8587700 1 -- 172.21.15.96:0/4286639458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 msgr2=0x7f2af00faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.779+0000 7f2af8587700 1 --2- 172.21.15.96:0/4286639458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2aec00b870 tx=0x7f2aec006f70).stop 2022-02-02T18:15:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.780+0000 7f2af8587700 1 -- 172.21.15.96:0/4286639458 shutdown_connections 2022-02-02T18:15:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.780+0000 7f2af8587700 1 --2- 172.21.15.96:0/4286639458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af00faed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.780+0000 7f2af8587700 1 -- 172.21.15.96:0/4286639458 >> 172.21.15.96:0/4286639458 conn(0x7f2af00f62f0 msgr2=0x7f2af00f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.780+0000 7f2af8587700 1 -- 172.21.15.96:0/4286639458 shutdown_connections 2022-02-02T18:15:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.780+0000 7f2af8587700 1 -- 172.21.15.96:0/4286639458 wait complete. 2022-02-02T18:15:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af8587700 1 Processor -- start 2022-02-02T18:15:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af8587700 1 -- start start 2022-02-02T18:15:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af8587700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af8587700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0108c80 con 0x7f2af00faab0 2022-02-02T18:15:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af6323700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af6323700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51464/0 (socket says 172.21.15.96:51464) 2022-02-02T18:15:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af6323700 1 -- 172.21.15.96:0/1516869595 learned_addr learned my addr 172.21.15.96:0/1516869595 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.781+0000 7f2af6323700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec00b480 con 0x7f2af00faab0 2022-02-02T18:15:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2af6323700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2aec00b840 tx=0x7f2aec006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aec00f3d0 con 0x7f2af00faab0 2022-02-02T18:15:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2aec00fd00 con 0x7f2af00faab0 2022-02-02T18:15:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0108e80 con 0x7f2af00faab0 2022-02-02T18:15:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aec019b10 con 0x7f2af00faab0 2022-02-02T18:15:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.782+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af0109310 con 0x7f2af00faab0 2022-02-02T18:15:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f2aec016030 con 0x7f2af00faab0 2022-02-02T18:15:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2adeffd700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2af0059100 con 0x7f2ad802ff00 2022-02-02T18:15:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f2aec044c70 con 0x7f2af00faab0 2022-02-02T18:15:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2af5b22700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.783+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:15:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.984+0000 7f2af5b22700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:10.984+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T18:15:11.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:10 smithi096 conmon[32067]: audit 2022-02-02T18:15:09.888820+0000 mon.smithi096 (mon. 2022-02-02T18:15:11.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:10 smithi096 conmon[32067]: 0) 90 : audit [DBG] from='client.? 172.21.15.96:0/93922480' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-02-02T18:15:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:11.385+0000 7f2af5b22700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:11.385+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T18:15:12.189 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:12.186+0000 7f2af5b22700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:12.190 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:12.186+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T18:15:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:13.787+0000 7f2af5b22700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3765010446 2022-02-02T18:15:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:13.787+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T18:15:14.754 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:14.749+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mgrmap(e 13) v1 ==== 35997+0+0 (secure 0 0 0) 0x7f2aec019d40 con 0x7f2af00faab0 2022-02-02T18:15:14.754 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:14.749+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 msgr2=0x7f2ad80323c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:15:14.754 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:14.749+0000 7f2adeffd700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:15.012 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: cluster 2022-02-02T18:15:13.882448+0000 mon.smithi096 (mon.0) 91 : cluster [INF] Active manager daemon smithi096.shfutl restarted 2022-02-02T18:15:15.012 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: cluster 2022-02-02T18:15:13.882924+0000 mon.smithi096 (mon.0) 92 : cluster [INF] Activating manager daemon smithi096.shfutl 2022-02-02T18:15:15.013 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: cluster 2022-02-02T18:15:13.884587+0000 mon.smithi096 (mon.0) 93 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-02-02T18:15:15.013 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: cluster 2022-02-02T18:15:14.752625+0000 mon.smithi096 (mon.0) 94 : cluster [DBG] mgrmap e13: smithi096.shfutl(active, starting, since 0.869771s) 2022-02-02T18:15:15.013 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.753954+0000 mon.smithi096 (mon.0) 95 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:15:15.013 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.754710+0000 mon.smithi096 (mon.0) 96 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:15:15.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.755555+0000 mon.smithi096 (mon.0) 97 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:15:15.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.755804+0000 mon.smithi096 (mon.0) 98 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:15:15.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.756023+0000 mon.smithi096 (mon.0) 99 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:15:15.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: cluster 2022-02-02T18:15:14.770439+0000 mon.smithi096 (mon.0) 100 : cluster [INF] Manager daemon smithi096.shfutl is now available 2022-02-02T18:15:15.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.877438+0000 mon.smithi096 (mon.0) 101 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:15:15.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:15:15.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:14 smithi096 conmon[32067]: :15:14.878947+0000 mon.smithi096 (mon.0) 102 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:15:15.755 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.750+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 14) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f2aec02d3f0 con 0x7f2af00faab0 2022-02-02T18:15:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.750+0000 7f2adeffd700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 0x7f2ad8035d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.750+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2af0059100 con 0x7f2ad8033970 2022-02-02T18:15:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.751+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 0x7f2ad8035d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:15.758 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.751+0000 7f2af5b22700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 0x7f2ad8035d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f2ae0006fd0 tx=0x7f2ae0006d70).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:15.758 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.751+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f2af0059100 con 0x7f2ad8033970 2022-02-02T18:15:15.764 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.757+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2af0045ad0 con 0x7f2ad8033970 2022-02-02T18:15:15.764 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2adeffd700 1 -- 172.21.15.96:0/1516869595 <== mgr.14162 v2:172.21.15.96:6800/4170397281 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2af0045ad0 con 0x7f2ad8033970 2022-02-02T18:15:15.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: { 2022-02-02T18:15:15.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "mgrmap_epoch": 14, 2022-02-02T18:15:15.765 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: "initialized": true 2022-02-02T18:15:15.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: } 2022-02-02T18:15:15.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 msgr2=0x7f2ad8035d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:15.766 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 0x7f2ad8035d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f2ae0006fd0 tx=0x7f2ae0006d70).stop 2022-02-02T18:15:15.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 msgr2=0x7f2af0108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:15.767 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2aec00b840 tx=0x7f2aec006f70).stop 2022-02-02T18:15:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 shutdown_connections 2022-02-02T18:15:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2af00faab0 0x7f2af0108790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f2ad8033970 0x7f2ad8035d60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 --2- 172.21.15.96:0/1516869595 >> [v2:172.21.15.96:6800/3765010446,v1:172.21.15.96:6801/3765010446] conn(0x7f2ad802ff00 0x7f2ad80323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:15:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.758+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 >> 172.21.15.96:0/1516869595 conn(0x7f2af00f62f0 msgr2=0x7f2af00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.759+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 shutdown_connections 2022-02-02T18:15:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:15.759+0000 7f2af8587700 1 -- 172.21.15.96:0/1516869595 wait complete. 2022-02-02T18:15:16.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:15 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.903302+0000 mon.smithi096 (mon.0) 103 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:15:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:15 smithi096 conmon[32067]: audit 2022-02-02T18:15:14.906450+0000 mon.smithi096 (mon.0) 104 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:15:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:15 smithi096 conmon[32067]: cluster 2022-02-02T18:15:15.754075+0000 mon.smithi096 (mon.0) 105 : cluster [DBG] mgrmap e14: smithi096.shfutl(active, since 1.87124s) 2022-02-02T18:15:16.237 INFO:teuthology.orchestra.run.smithi096.stderr:mgr epoch 12 is available 2022-02-02T18:15:16.237 INFO:teuthology.orchestra.run.smithi096.stderr:Generating a dashboard self-signed certificate... 2022-02-02T18:15:16.238 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2022-02-02T18:15:16.945 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.932+0000 7fb8d70e3700 1 Processor -- start 2022-02-02T18:15:16.945 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.932+0000 7fb8d70e3700 1 -- start start 2022-02-02T18:15:16.946 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d70e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:16.946 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d70e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00fb390 con 0x7fb8d00faa80 2022-02-02T18:15:16.947 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d4e7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:16.947 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d4e7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51510/0 (socket says 172.21.15.96:51510) 2022-02-02T18:15:16.948 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d4e7f700 1 -- 172.21.15.96:0/2491839449 learned_addr learned my addr 172.21.15.96:0/2491839449 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:16.948 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d4e7f700 1 -- 172.21.15.96:0/2491839449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00fb4d0 con 0x7fb8d00faa80 2022-02-02T18:15:16.948 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.933+0000 7fb8d4e7f700 1 --2- 172.21.15.96:0/2491839449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8c8009960 tx=0x7fb8c80092d0).ready entity=mon.0 client_cookie=61e988e14e8e60b7 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:16.949 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8cf7fe700 1 -- 172.21.15.96:0/2491839449 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8c800b9c0 con 0x7fb8d00faa80 2022-02-02T18:15:16.949 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8cf7fe700 1 -- 172.21.15.96:0/2491839449 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb8c8011400 con 0x7fb8d00faa80 2022-02-02T18:15:16.950 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8cf7fe700 1 -- 172.21.15.96:0/2491839449 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8c8010580 con 0x7fb8d00faa80 2022-02-02T18:15:16.950 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 -- 172.21.15.96:0/2491839449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 msgr2=0x7fb8d00faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:16.951 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/2491839449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8c8009960 tx=0x7fb8c80092d0).stop 2022-02-02T18:15:16.951 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 -- 172.21.15.96:0/2491839449 shutdown_connections 2022-02-02T18:15:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/2491839449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d00faea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 -- 172.21.15.96:0/2491839449 >> 172.21.15.96:0/2491839449 conn(0x7fb8d00f6260 msgr2=0x7fb8d00f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 -- 172.21.15.96:0/2491839449 shutdown_connections 2022-02-02T18:15:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.934+0000 7fb8d70e3700 1 -- 172.21.15.96:0/2491839449 wait complete. 2022-02-02T18:15:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d70e3700 1 Processor -- start 2022-02-02T18:15:16.954 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d70e3700 1 -- start start 2022-02-02T18:15:16.954 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d70e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d70e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00ff110 con 0x7fb8d00faa80 2022-02-02T18:15:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d4e7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d4e7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51512/0 (socket says 172.21.15.96:51512) 2022-02-02T18:15:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.935+0000 7fb8d4e7f700 1 -- 172.21.15.96:0/876775756 learned_addr learned my addr 172.21.15.96:0/876775756 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8d4e7f700 1 -- 172.21.15.96:0/876775756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8009570 con 0x7fb8d00faa80 2022-02-02T18:15:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8d4e7f700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb8c8009fd0 tx=0x7fb8c80092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8c8010840 con 0x7fb8d00faa80 2022-02-02T18:15:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d00ff2b0 con 0x7fb8d00faa80 2022-02-02T18:15:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb8c8010e30 con 0x7fb8d00faa80 2022-02-02T18:15:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8c801bd70 con 0x7fb8d00faa80 2022-02-02T18:15:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.936+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00ff740 con 0x7fb8d00faa80 2022-02-02T18:15:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 15) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fb8c800f070 con 0x7fb8d00faa80 2022-02-02T18:15:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8cd7fa700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 0x7fb8b0032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb8c8041d80 con 0x7fb8d00faa80 2022-02-02T18:15:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8cffff700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 0x7fb8b0032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:16.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8cffff700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 0x7fb8b0032370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb8c00096a0 tx=0x7fb8c0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:16.961 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.937+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0059100 con 0x7fb8d00faa80 2022-02-02T18:15:16.963 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:16.942+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb8c8024400 con 0x7fb8d00faa80 2022-02-02T18:15:17.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:16 smithi096 conmon[32067]: audit 2022-02-02T18:15:15.753230+0000 mgr.smithi096.shfutl (mgr.14162) 1 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-02-02T18:15:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:16 smithi096 conmon[32067]: audit 2022-02-02T18:15:15.759490+0000 mgr.smithi096.shfutl (mgr.14162) 2 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-02-02T18:15:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:16 smithi096 conmon[32067]: audit 2022-02-02T18:15:16.694067+0000 mon.smithi096 (mon.0) 106 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.108+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8d0104850 con 0x7fb8b002feb0 2022-02-02T18:15:17.226 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.221+0000 7fb8cd7fa700 1 -- 172.21.15.96:0/876775756 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb8d0104850 con 0x7fb8b002feb0 2022-02-02T18:15:17.226 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: Self-signed certificate created 2022-02-02T18:15:17.228 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 msgr2=0x7fb8b0032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:17.228 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 0x7fb8b0032370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb8c00096a0 tx=0x7fb8c0006b40).stop 2022-02-02T18:15:17.228 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 msgr2=0x7fb8d0100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:17.229 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb8c8009fd0 tx=0x7fb8c80092d0).stop 2022-02-02T18:15:17.229 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 shutdown_connections 2022-02-02T18:15:17.229 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb8b002feb0 0x7fb8b0032370 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:17.229 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 --2- 172.21.15.96:0/876775756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00faa80 0x7fb8d0100c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:17.229 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 >> 172.21.15.96:0/876775756 conn(0x7fb8d00f6260 msgr2=0x7fb8d00f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:17.230 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 shutdown_connections 2022-02-02T18:15:17.230 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:17.223+0000 7fb8d70e3700 1 -- 172.21.15.96:0/876775756 wait complete. 2022-02-02T18:15:17.877 INFO:teuthology.orchestra.run.smithi096.stderr:Creating initial admin user... 2022-02-02T18:15:17.878 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpa47isu0a:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2022-02-02T18:15:18.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:17 smithi096 conmon[32067]: cluster 2022-02-02T18:15:16.889482+0000 mon.smithi096 (mon.0 2022-02-02T18:15:18.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:17 smithi096 conmon[32067]: ) 107 : cluster [DBG] mgrmap e15: smithi096.shfutl(active, since 3s) 2022-02-02T18:15:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:17 smithi096 conmon[32067]: audit 2022-02-02T18:15:17.220202+0000 mon.smithi096 (mon.0) 108 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:17 smithi096 conmon[32067]: audit 2022-02-02T18:15:17.222934+0000 mon.smithi096 (mon.0) 109 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff094923700 1 Processor -- start 2022-02-02T18:15:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff094923700 1 -- start start 2022-02-02T18:15:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff094923700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff094923700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900fc650 con 0x7ff09006fb40 2022-02-02T18:15:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff08e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.452+0000 7ff08e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51516/0 (socket says 172.21.15.96:51516) 2022-02-02T18:15:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08e59c700 1 -- 172.21.15.96:0/1525514963 learned_addr learned my addr 172.21.15.96:0/1525514963 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08e59c700 1 -- 172.21.15.96:0/1525514963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090101150 con 0x7ff09006fb40 2022-02-02T18:15:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08e59c700 1 --2- 172.21.15.96:0/1525514963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff08400b5f0 tx=0x7ff084006ee0).ready entity=mon.0 client_cookie=b7b72e39579d92c2 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08d59a700 1 -- 172.21.15.96:0/1525514963 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff08400d600 con 0x7ff09006fb40 2022-02-02T18:15:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08d59a700 1 -- 172.21.15.96:0/1525514963 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff08400dbf0 con 0x7ff09006fb40 2022-02-02T18:15:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.453+0000 7ff08d59a700 1 -- 172.21.15.96:0/1525514963 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff084011bf0 con 0x7ff09006fb40 2022-02-02T18:15:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 -- 172.21.15.96:0/1525514963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 msgr2=0x7ff090100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 --2- 172.21.15.96:0/1525514963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff08400b5f0 tx=0x7ff084006ee0).stop 2022-02-02T18:15:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 -- 172.21.15.96:0/1525514963 shutdown_connections 2022-02-02T18:15:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 --2- 172.21.15.96:0/1525514963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff090100c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 -- 172.21.15.96:0/1525514963 >> 172.21.15.96:0/1525514963 conn(0x7ff0900f6260 msgr2=0x7ff0900f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 -- 172.21.15.96:0/1525514963 shutdown_connections 2022-02-02T18:15:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 -- 172.21.15.96:0/1525514963 wait complete. 2022-02-02T18:15:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.454+0000 7ff094923700 1 Processor -- start 2022-02-02T18:15:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff094923700 1 -- start start 2022-02-02T18:15:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff094923700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff094923700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09010cff0 con 0x7ff09006fb40 2022-02-02T18:15:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff08e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff08e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51518/0 (socket says 172.21.15.96:51518) 2022-02-02T18:15:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff08e59c700 1 -- 172.21.15.96:0/1759434755 learned_addr learned my addr 172.21.15.96:0/1759434755 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff08e59c700 1 -- 172.21.15.96:0/1759434755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08400b200 con 0x7ff09006fb40 2022-02-02T18:15:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff08e59c700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff084011e00 tx=0x7ff084006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff08401b410 con 0x7ff09006fb40 2022-02-02T18:15:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff08401ba00 con 0x7ff09006fb40 2022-02-02T18:15:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.455+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09010d1f0 con 0x7ff09006fb40 2022-02-02T18:15:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.456+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff08401a780 con 0x7ff09006fb40 2022-02-02T18:15:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.456+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09010d680 con 0x7ff09006fb40 2022-02-02T18:15:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 15) v1 ==== 36208+0+0 (secure 0 0 0) 0x7ff08402b070 con 0x7ff09006fb40 2022-02-02T18:15:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff07effd700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 0x7ff0740323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff090045ad0 con 0x7ff09006fb40 2022-02-02T18:15:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ff0840416b0 con 0x7ff09006fb40 2022-02-02T18:15:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff08dd9b700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 0x7ff0740323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.457+0000 7ff08dd9b700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 0x7ff0740323c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff0800096a0 tx=0x7ff080006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.461+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff084016020 con 0x7ff09006fb40 2022-02-02T18:15:18.630 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.626+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff090101d50 con 0x7ff07402ff00 2022-02-02T18:15:18.851 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.847+0000 7ff07effd700 1 -- 172.21.15.96:0/1759434755 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff090101d50 con 0x7ff07402ff00 2022-02-02T18:15:18.852 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$yeuB6Np1W0cII296w226/.qpUB7u3UX4ds0fcROpEDIUPwHQ30S6a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1643825718, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2022-02-02T18:15:18.853 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 msgr2=0x7ff0740323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 0x7ff0740323c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff0800096a0 tx=0x7ff080006b40).stop 2022-02-02T18:15:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 msgr2=0x7ff09010cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff084011e00 tx=0x7ff084006ee0).stop 2022-02-02T18:15:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 shutdown_connections 2022-02-02T18:15:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff07402ff00 0x7ff0740323c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 --2- 172.21.15.96:0/1759434755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff09006fb40 0x7ff09010cb00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 >> 172.21.15.96:0/1759434755 conn(0x7ff0900f6260 msgr2=0x7ff0900f7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 shutdown_connections 2022-02-02T18:15:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:18.849+0000 7ff094923700 1 -- 172.21.15.96:0/1759434755 wait complete. 2022-02-02T18:15:19.203 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:18 smithi096 conmon[32067]: audit 2022-02-02T18:15:17.110286+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:15:19.203 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:18 smithi096 conmon[32067]: .14162) 3 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:19.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:18 smithi096 conmon[32067]: audit 2022-02-02T18:15:18.848987+0000 mon.smithi096 (mon.0) 110 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:Fetching dashboard port number... 2022-02-02T18:15:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi096 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpevgulqsj:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5tq2m_rc:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2022-02-02T18:15:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.695+0000 7f0d7a64b700 1 Processor -- start 2022-02-02T18:15:19.703 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.695+0000 7f0d7a64b700 1 -- start start 2022-02-02T18:15:19.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d7a64b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:19.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d7a64b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740fb4e0 con 0x7f0d740fab40 2022-02-02T18:15:19.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:19.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51522/0 (socket says 172.21.15.96:51522) 2022-02-02T18:15:19.704 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d73fff700 1 -- 172.21.15.96:0/716696567 learned_addr learned my addr 172.21.15.96:0/716696567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:19.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d73fff700 1 -- 172.21.15.96:0/716696567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740fb620 con 0x7f0d740fab40 2022-02-02T18:15:19.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d73fff700 1 --2- 172.21.15.96:0/716696567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0d6800b5f0 tx=0x7f0d68006ee0).ready entity=mon.0 client_cookie=e197360d1662004b server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:19.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d72ffd700 1 -- 172.21.15.96:0/716696567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d6800d600 con 0x7f0d740fab40 2022-02-02T18:15:19.705 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d72ffd700 1 -- 172.21.15.96:0/716696567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0d6800dbf0 con 0x7f0d740fab40 2022-02-02T18:15:19.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.696+0000 7f0d72ffd700 1 -- 172.21.15.96:0/716696567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d68011bf0 con 0x7f0d740fab40 2022-02-02T18:15:19.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 -- 172.21.15.96:0/716696567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 msgr2=0x7f0d740faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:19.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/716696567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0d6800b5f0 tx=0x7f0d68006ee0).stop 2022-02-02T18:15:19.706 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 -- 172.21.15.96:0/716696567 shutdown_connections 2022-02-02T18:15:19.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/716696567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d740faf60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:19.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 -- 172.21.15.96:0/716696567 >> 172.21.15.96:0/716696567 conn(0x7f0d740f62a0 msgr2=0x7f0d740f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:19.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 -- 172.21.15.96:0/716696567 shutdown_connections 2022-02-02T18:15:19.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.697+0000 7f0d7a64b700 1 -- 172.21.15.96:0/716696567 wait complete. 2022-02-02T18:15:19.707 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d7a64b700 1 Processor -- start 2022-02-02T18:15:19.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d7a64b700 1 -- start start 2022-02-02T18:15:19.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d7a64b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:19.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d7a64b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74109d90 con 0x7f0d740fab40 2022-02-02T18:15:19.708 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:19.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51524/0 (socket says 172.21.15.96:51524) 2022-02-02T18:15:19.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.698+0000 7f0d73fff700 1 -- 172.21.15.96:0/1339302489 learned_addr learned my addr 172.21.15.96:0/1339302489 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:19.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d73fff700 1 -- 172.21.15.96:0/1339302489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6800b200 con 0x7f0d740fab40 2022-02-02T18:15:19.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d73fff700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0d68011de0 tx=0x7f0d68006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:19.709 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d6801b410 con 0x7f0d740fab40 2022-02-02T18:15:19.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0d6801ba00 con 0x7f0d740fab40 2022-02-02T18:15:19.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74109f90 con 0x7f0d740fab40 2022-02-02T18:15:19.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d6801a770 con 0x7f0d740fab40 2022-02-02T18:15:19.710 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.699+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7410a420 con 0x7f0d740fab40 2022-02-02T18:15:19.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 15) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f0d6802b070 con 0x7f0d740fab40 2022-02-02T18:15:19.711 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d70ff9700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 0x7f0d60032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f0d68042650 con 0x7f0d740fab40 2022-02-02T18:15:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d737fe700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 0x7f0d60032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d737fe700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 0x7f0d60032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0d640096a0 tx=0x7f0d64006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.700+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74045ad0 con 0x7f0d740fab40 2022-02-02T18:15:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.705+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0d68016080 con 0x7f0d740fab40 2022-02-02T18:15:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.857+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0d740008d0 con 0x7f0d740fab40 2022-02-02T18:15:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.858+0000 7f0d70ff9700 1 -- 172.21.15.96:0/1339302489 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v10) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0d6801f070 con 0x7f0d740fab40 2022-02-02T18:15:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 8443 2022-02-02T18:15:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 msgr2=0x7f0d60032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 0x7f0d60032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0d640096a0 tx=0x7f0d64006b40).stop 2022-02-02T18:15:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 msgr2=0x7f0d741098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0d68011de0 tx=0x7f0d68006ee0).stop 2022-02-02T18:15:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 shutdown_connections 2022-02-02T18:15:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f0d6002feb0 0x7f0d60032370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 --2- 172.21.15.96:0/1339302489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d740fab40 0x7f0d741098a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 >> 172.21.15.96:0/1339302489 conn(0x7f0d740f62a0 msgr2=0x7f0d740f7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.859+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 shutdown_connections 2022-02-02T18:15:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:/usr/bin/ceph: 2022-02-02T18:15:19.860+0000 7f0d7a64b700 1 -- 172.21.15.96:0/1339302489 wait complete. 2022-02-02T18:15:20.213 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:19 smithi096 conmon[32067]: audit 2022-02-02T18:15:18.628885+0000 mgr.smithi096.shfutl (mgr.14162) 4 : audit 2022-02-02T18:15:20.213 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:19 smithi096 conmon[32067]: [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:20.214 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:19 smithi096 conmon[32067]: audit 2022-02-02T18:15:19.859560+0000 mon.smithi096 (mon.0) 111 : audit [DBG] from='client.? 172.21.15.96:0/1339302489' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2022-02-02T18:15:20.270 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T18:15:20.278 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: disabled 2022-02-02T18:15:20.279 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T18:15:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:systemctl: inactive 2022-02-02T18:15:20.285 INFO:teuthology.orchestra.run.smithi096.stderr:firewalld.service is not enabled 2022-02-02T18:15:20.286 INFO:teuthology.orchestra.run.smithi096.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2022-02-02T18:15:20.289 INFO:teuthology.orchestra.run.smithi096.stderr:Ceph Dashboard is now available at: 2022-02-02T18:15:20.289 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.289 INFO:teuthology.orchestra.run.smithi096.stderr: URL: https://smithi096.front.sepia.ceph.com:8443/ 2022-02-02T18:15:20.290 INFO:teuthology.orchestra.run.smithi096.stderr: User: admin 2022-02-02T18:15:20.290 INFO:teuthology.orchestra.run.smithi096.stderr: Password: why6zt1vs1 2022-02-02T18:15:20.291 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.291 INFO:teuthology.orchestra.run.smithi096.stderr:You can access the Ceph CLI with: 2022-02-02T18:15:20.292 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.292 INFO:teuthology.orchestra.run.smithi096.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2022-02-02T18:15:20.293 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.293 INFO:teuthology.orchestra.run.smithi096.stderr:Please consider enabling telemetry to help improve Ceph: 2022-02-02T18:15:20.293 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.294 INFO:teuthology.orchestra.run.smithi096.stderr: ceph telemetry on 2022-02-02T18:15:20.294 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.295 INFO:teuthology.orchestra.run.smithi096.stderr:For more information see: 2022-02-02T18:15:20.295 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.296 INFO:teuthology.orchestra.run.smithi096.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2022-02-02T18:15:20.296 INFO:teuthology.orchestra.run.smithi096.stderr: 2022-02-02T18:15:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:Bootstrap complete. 2022-02-02T18:15:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:Releasing lock 140677241420544 on /run/cephadm/e1d78c58-8453-11ec-8c35-001a4aab830c.lock 2022-02-02T18:15:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:Lock 140677241420544 released on /run/cephadm/e1d78c58-8453-11ec-8c35-001a4aab830c.lock 2022-02-02T18:15:20.323 INFO:tasks.cephadm:Fetching config... 2022-02-02T18:15:20.324 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:15:20.325 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2022-02-02T18:15:20.380 INFO:tasks.cephadm:Fetching client.admin keyring... 2022-02-02T18:15:20.381 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:15:20.381 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2022-02-02T18:15:20.436 INFO:tasks.cephadm:Fetching mon keyring... 2022-02-02T18:15:20.436 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:15:20.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/keyring of=/dev/stdout 2022-02-02T18:15:20.502 INFO:tasks.cephadm:Fetching pub ssh key... 2022-02-02T18:15:20.503 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:15:20.503 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2022-02-02T18:15:20.559 INFO:tasks.cephadm:Installing pub ssh key for root users... 2022-02-02T18:15:20.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbbWAfuUfQYVyjxA9aw182sv5EcVdSzM2yCaH+9wwNVBOhLAVyONG5yxPji+NKlfA7z7q1fxypWNdELZqoPbnMGj7NzhuTs/t1mDEsyzhdCihKPAPDsXp9yWbV51d27rMLp+xPgfIE/sY5SrtBBPQM8aHRd7O/thSuCK9w3YADyaToazW/LWE2iUIESPIZPZ7gQW/Rmc85UuuwxJYvryN3ovRWVi7YNcIm4wIbQTGMPz7kk8wa5giiGrFQS1olkFjaI9TTRZaiSyjGqc+g7gP5qQ64YZyIyA6R/Cmd2tL7WPw4sbBjt4emYNxEj2M4hgj6/dQdc7zMuESMEVWrX78pXdhHIGdamT+f4XRMG9c+yNxm9VVOyn5p4DpN0/Es7xJoW75PPXdX6C3aNTRfFrUIysIfdbfEJSJOY0S9rpgMsEKJs90H8suEKVJYqJSbIge+KbzvMeAYv6Qa9uzie0q3swuqkz3cXKkYUwOfcQWk3JCbVLXRH+MFW1jNrWn9rW0= ceph-e1d78c58-8453-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-02-02T18:15:20.637 INFO:teuthology.orchestra.run.smithi096.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbbWAfuUfQYVyjxA9aw182sv5EcVdSzM2yCaH+9wwNVBOhLAVyONG5yxPji+NKlfA7z7q1fxypWNdELZqoPbnMGj7NzhuTs/t1mDEsyzhdCihKPAPDsXp9yWbV51d27rMLp+xPgfIE/sY5SrtBBPQM8aHRd7O/thSuCK9w3YADyaToazW/LWE2iUIESPIZPZ7gQW/Rmc85UuuwxJYvryN3ovRWVi7YNcIm4wIbQTGMPz7kk8wa5giiGrFQS1olkFjaI9TTRZaiSyjGqc+g7gP5qQ64YZyIyA6R/Cmd2tL7WPw4sbBjt4emYNxEj2M4hgj6/dQdc7zMuESMEVWrX78pXdhHIGdamT+f4XRMG9c+yNxm9VVOyn5p4DpN0/Es7xJoW75PPXdX6C3aNTRfFrUIysIfdbfEJSJOY0S9rpgMsEKJs90H8suEKVJYqJSbIge+KbzvMeAYv6Qa9uzie0q3swuqkz3cXKkYUwOfcQWk3JCbVLXRH+MFW1jNrWn9rW0= ceph-e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:15:20.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbbWAfuUfQYVyjxA9aw182sv5EcVdSzM2yCaH+9wwNVBOhLAVyONG5yxPji+NKlfA7z7q1fxypWNdELZqoPbnMGj7NzhuTs/t1mDEsyzhdCihKPAPDsXp9yWbV51d27rMLp+xPgfIE/sY5SrtBBPQM8aHRd7O/thSuCK9w3YADyaToazW/LWE2iUIESPIZPZ7gQW/Rmc85UuuwxJYvryN3ovRWVi7YNcIm4wIbQTGMPz7kk8wa5giiGrFQS1olkFjaI9TTRZaiSyjGqc+g7gP5qQ64YZyIyA6R/Cmd2tL7WPw4sbBjt4emYNxEj2M4hgj6/dQdc7zMuESMEVWrX78pXdhHIGdamT+f4XRMG9c+yNxm9VVOyn5p4DpN0/Es7xJoW75PPXdX6C3aNTRfFrUIysIfdbfEJSJOY0S9rpgMsEKJs90H8suEKVJYqJSbIge+KbzvMeAYv6Qa9uzie0q3swuqkz3cXKkYUwOfcQWk3JCbVLXRH+MFW1jNrWn9rW0= ceph-e1d78c58-8453-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-02-02T18:15:20.692 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbbWAfuUfQYVyjxA9aw182sv5EcVdSzM2yCaH+9wwNVBOhLAVyONG5yxPji+NKlfA7z7q1fxypWNdELZqoPbnMGj7NzhuTs/t1mDEsyzhdCihKPAPDsXp9yWbV51d27rMLp+xPgfIE/sY5SrtBBPQM8aHRd7O/thSuCK9w3YADyaToazW/LWE2iUIESPIZPZ7gQW/Rmc85UuuwxJYvryN3ovRWVi7YNcIm4wIbQTGMPz7kk8wa5giiGrFQS1olkFjaI9TTRZaiSyjGqc+g7gP5qQ64YZyIyA6R/Cmd2tL7WPw4sbBjt4emYNxEj2M4hgj6/dQdc7zMuESMEVWrX78pXdhHIGdamT+f4XRMG9c+yNxm9VVOyn5p4DpN0/Es7xJoW75PPXdX6C3aNTRfFrUIysIfdbfEJSJOY0S9rpgMsEKJs90H8suEKVJYqJSbIge+KbzvMeAYv6Qa9uzie0q3swuqkz3cXKkYUwOfcQWk3JCbVLXRH+MFW1jNrWn9rW0= ceph-e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:15:20.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2022-02-02T18:15:22.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:21 smithi096 conmon[32067]: cluster 2022-02-02T18:15:20.893968+0000 mon.smithi096 (mon.0) 112 : cluster [DBG] mgrmap e16: smithi096.shfutl(active, since 7s) 2022-02-02T18:15:23.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 -- 172.21.15.96:0/3559140925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 msgr2=0x7f8ca00f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:23.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/3559140925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca00f55c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8c94009fb0 tx=0x7f8c94009b30).stop 2022-02-02T18:15:23.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 -- 172.21.15.96:0/3559140925 shutdown_connections 2022-02-02T18:15:23.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/3559140925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca00f55c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:23.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 -- 172.21.15.96:0/3559140925 >> 172.21.15.96:0/3559140925 conn(0x7f8ca00f09a0 msgr2=0x7f8ca00f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:23.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 -- 172.21.15.96:0/3559140925 shutdown_connections 2022-02-02T18:15:23.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.070+0000 7f8c9f59e700 1 -- 172.21.15.96:0/3559140925 wait complete. 2022-02-02T18:15:23.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9f59e700 1 Processor -- start 2022-02-02T18:15:23.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9f59e700 1 -- start start 2022-02-02T18:15:23.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0060220 con 0x7f8ca00f51a0 2022-02-02T18:15:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51534/0 (socket says 172.21.15.96:51534) 2022-02-02T18:15:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9e59c700 1 -- 172.21.15.96:0/654745699 learned_addr learned my addr 172.21.15.96:0/654745699 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.071+0000 7f8c9e59c700 1 -- 172.21.15.96:0/654745699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94005040 con 0x7f8ca00f51a0 2022-02-02T18:15:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c9e59c700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8c94009f80 tx=0x7f8c9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c94009320 con 0x7f8ca00f51a0 2022-02-02T18:15:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8c94013680 con 0x7f8ca00f51a0 2022-02-02T18:15:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca0060420 con 0x7f8ca00f51a0 2022-02-02T18:15:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9401eda0 con 0x7f8ca00f51a0 2022-02-02T18:15:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.072+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca0109860 con 0x7f8ca00f51a0 2022-02-02T18:15:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.073+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8c94014420 con 0x7f8ca00f51a0 2022-02-02T18:15:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.073+0000 7f8c8effd700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 0x7f8c88032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.073+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0059100 con 0x7f8ca00f51a0 2022-02-02T18:15:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.073+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8c94041250 con 0x7f8ca00f51a0 2022-02-02T18:15:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.074+0000 7f8c9dd9b700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 0x7f8c88032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.074+0000 7f8c9dd9b700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 0x7f8c88032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8c900096a0 tx=0x7f8c90006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.077+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8c9401c500 con 0x7f8ca00f51a0 2022-02-02T18:15:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.247+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f8ca00fac10 con 0x7f8ca00f51a0 2022-02-02T18:15:23.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.251+0000 7f8c8effd700 1 -- 172.21.15.96:0/654745699 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v11)=0 v11) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8c940160a0 con 0x7f8ca00f51a0 2022-02-02T18:15:23.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.253+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 msgr2=0x7f8c88032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:23.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 0x7f8c88032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8c900096a0 tx=0x7f8c90006b40).stop 2022-02-02T18:15:23.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 msgr2=0x7f8ca01091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:23.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8c94009f80 tx=0x7f8c9400b040).stop 2022-02-02T18:15:23.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 shutdown_connections 2022-02-02T18:15:23.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8c8802ff60 0x7f8c88032420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:23.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 --2- 172.21.15.96:0/654745699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ca00f51a0 0x7f8ca01091b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:23.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 >> 172.21.15.96:0/654745699 conn(0x7f8ca00f09a0 msgr2=0x7f8ca00f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:23.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 shutdown_connections 2022-02-02T18:15:23.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:23.254+0000 7f8c9f59e700 1 -- 172.21.15.96:0/654745699 wait complete. 2022-02-02T18:15:23.969 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2022-02-02T18:15:23.969 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:15:23.970 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2022-02-02T18:15:23.991 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:15:23.992 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T18:15:24.049 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2022-02-02T18:15:24.049 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch host add smithi159 2022-02-02T18:15:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:23 smithi096 conmon[32067]: audit 2022-02-02T18:15:22.747960+0000 mon.smithi096 (mon.0) 113 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:23 smithi096 conmon[32067]: audit 2022-02-02T18:15:23.250315+0000 mon.smithi096 (mon.0) 114 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:23 smithi096 conmon[32067]: audit 2022-02-02T18:15:23.252786+0000 mon.smithi096 (mon.0) 115 : audit [INF] from='client.? 172.21.15.96:0/654745699' entity='client.admin' 2022-02-02T18:15:24.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:24 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:23.260032+0000 mgr.smithi096.shfutl (mgr.14162) 5 : cephadm [INF] Deploying daemon alertmanager.smithi096 on smithi096 2022-02-02T18:15:24.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:24 smithi096 conmon[32067]: 2022-02-02T18:15:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 -- 172.21.15.96:0/998336819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 msgr2=0x7f59940f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 --2- 172.21.15.96:0/998336819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59940f4be0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5984009fb0 tx=0x7f5984009b30).stop 2022-02-02T18:15:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 -- 172.21.15.96:0/998336819 shutdown_connections 2022-02-02T18:15:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 --2- 172.21.15.96:0/998336819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59940f4be0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 -- 172.21.15.96:0/998336819 >> 172.21.15.96:0/998336819 conn(0x7f59940f02e0 msgr2=0x7f59940f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:27.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 -- 172.21.15.96:0/998336819 shutdown_connections 2022-02-02T18:15:27.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 -- 172.21.15.96:0/998336819 wait complete. 2022-02-02T18:15:27.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.075+0000 7f599be9d700 1 Processor -- start 2022-02-02T18:15:27.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f599be9d700 1 -- start start 2022-02-02T18:15:27.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f599be9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:27.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f599be9d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994106bd0 con 0x7f59940f47c0 2022-02-02T18:15:27.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f5999c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:27.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f5999c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51562/0 (socket says 172.21.15.96:51562) 2022-02-02T18:15:27.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f5999c39700 1 -- 172.21.15.96:0/4250324710 learned_addr learned my addr 172.21.15.96:0/4250324710 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f5999c39700 1 -- 172.21.15.96:0/4250324710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984005040 con 0x7f59940f47c0 2022-02-02T18:15:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f5999c39700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f59840089f0 tx=0x7f598400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5984009320 con 0x7f59940f47c0 2022-02-02T18:15:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5994106dd0 con 0x7f59940f47c0 2022-02-02T18:15:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5984013ec0 con 0x7f59940f47c0 2022-02-02T18:15:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.076+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5984014d30 con 0x7f59940f47c0 2022-02-02T18:15:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5994107260 con 0x7f59940f47c0 2022-02-02T18:15:27.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f59840263a0 con 0x7f59940f47c0 2022-02-02T18:15:27.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f598a7fc700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 0x7f5980032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:27.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f5984040fe0 con 0x7f59940f47c0 2022-02-02T18:15:27.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5994045ad0 con 0x7f59940f47c0 2022-02-02T18:15:27.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.077+0000 7f5999438700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 0x7f5980032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:27.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.078+0000 7f5999438700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 0x7f5980032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f59900096a0 tx=0x7f5990006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:27.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.082+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5984012920 con 0x7f59940f47c0 2022-02-02T18:15:27.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.276+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) v1 -- 0x7f59940f14c0 con 0x7f598002ff60 2022-02-02T18:15:27.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.994+0000 7f598a7fc700 1 -- 172.21.15.96:0/4250324710 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f59940f14c0 con 0x7f598002ff60 2022-02-02T18:15:27.999 INFO:teuthology.orchestra.run.smithi096.stdout:Added host 'smithi159' 2022-02-02T18:15:28.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.996+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 msgr2=0x7f5980032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:28.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.996+0000 7f599be9d700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 0x7f5980032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f59900096a0 tx=0x7f5990006b40).stop 2022-02-02T18:15:28.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.996+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 msgr2=0x7f59941066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:28.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.996+0000 7f599be9d700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f59840089f0 tx=0x7f598400b040).stop 2022-02-02T18:15:28.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 shutdown_connections 2022-02-02T18:15:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f598002ff60 0x7f5980032420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 --2- 172.21.15.96:0/4250324710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59940f47c0 0x7f59941066e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 >> 172.21.15.96:0/4250324710 conn(0x7f59940f02e0 msgr2=0x7f59940f0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 shutdown_connections 2022-02-02T18:15:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:27.997+0000 7f599be9d700 1 -- 172.21.15.96:0/4250324710 wait complete. 2022-02-02T18:15:28.214 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:27 smithi096 conmon[32067]: audit 2022-02-02T18:15:27.278757+0000 mgr.smithi096.shfutl ( 2022-02-02T18:15:28.215 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:27 smithi096 conmon[32067]: mgr.14162) 6 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:28.532 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch host ls --format=json 2022-02-02T18:15:29.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:28 smithi096 conmon[32067]: audit 2022-02-02T18:15:27.995980+0000 mon.smithi096 (mon.0) 2022-02-02T18:15:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:28 smithi096 conmon[32067]: 116 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:28 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:27.996274+0000 mgr.smithi096.shfutl (mgr.14162) 7 : cephadm [INF] Added host smithi159 2022-02-02T18:15:30.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.738+0000 7fd1f1b08700 1 -- 172.21.15.96:0/714808325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 msgr2=0x7fd1ec0f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:30.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.738+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/714808325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec0f4bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd1dc009fb0 tx=0x7fd1dc009b30).stop 2022-02-02T18:15:30.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 -- 172.21.15.96:0/714808325 shutdown_connections 2022-02-02T18:15:30.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/714808325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec0f4bd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:30.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 -- 172.21.15.96:0/714808325 >> 172.21.15.96:0/714808325 conn(0x7fd1ec0f02b0 msgr2=0x7fd1ec0f26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:30.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 -- 172.21.15.96:0/714808325 shutdown_connections 2022-02-02T18:15:30.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 -- 172.21.15.96:0/714808325 wait complete. 2022-02-02T18:15:30.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.739+0000 7fd1f1b08700 1 Processor -- start 2022-02-02T18:15:30.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1f1b08700 1 -- start start 2022-02-02T18:15:30.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1f1b08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:30.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1f1b08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec106b70 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:30.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51570/0 (socket says 172.21.15.96:51570) 2022-02-02T18:15:30.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1eb7fe700 1 -- 172.21.15.96:0/4120740073 learned_addr learned my addr 172.21.15.96:0/4120740073 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:30.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1eb7fe700 1 -- 172.21.15.96:0/4120740073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc005040 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.740+0000 7fd1eb7fe700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd1dc0089f0 tx=0x7fd1dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:30.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.741+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1dc009320 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.741+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd1dc013ec0 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.741+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1dc014d30 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.741+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec106d70 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.741+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec107200 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.742+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fd1dc0263a0 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.742+0000 7fd1d3fff700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 0x7fd1d4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:30.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.742+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc004fa0 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.742+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fd1dc041e40 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.742+0000 7fd1eaffd700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 0x7fd1d4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:30.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.743+0000 7fd1eaffd700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 0x7fd1d4032470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd1e00096a0 tx=0x7fd1e0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:30.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.747+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd1dc012920 con 0x7fd1ec0f47b0 2022-02-02T18:15:30.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.937+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1cc000bc0 con 0x7fd1d402ffb0 2022-02-02T18:15:30.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.938+0000 7fd1d3fff700 1 -- 172.21.15.96:0/4120740073 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7fd1cc000bc0 con 0x7fd1d402ffb0 2022-02-02T18:15:30.943 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:15:30.944 INFO:teuthology.orchestra.run.smithi096.stdout:[{"addr": "172.21.15.96", "hostname": "smithi096", "labels": [], "status": ""}, {"addr": "smithi159", "hostname": "smithi159", "labels": [], "status": ""}] 2022-02-02T18:15:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 msgr2=0x7fd1d4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 0x7fd1d4032470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd1e00096a0 tx=0x7fd1e0006b40).stop 2022-02-02T18:15:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 msgr2=0x7fd1ec106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd1dc0089f0 tx=0x7fd1dc00b040).stop 2022-02-02T18:15:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 shutdown_connections 2022-02-02T18:15:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd1d402ffb0 0x7fd1d4032470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 --2- 172.21.15.96:0/4120740073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1ec0f47b0 0x7fd1ec106680 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.940+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 >> 172.21.15.96:0/4120740073 conn(0x7fd1ec0f02b0 msgr2=0x7fd1ec0f0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.941+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 shutdown_connections 2022-02-02T18:15:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:30.941+0000 7fd1f1b08700 1 -- 172.21.15.96:0/4120740073 wait complete. 2022-02-02T18:15:31.360 INFO:tasks.cephadm:Setting crush tunables to default 2022-02-02T18:15:31.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd crush tunables default 2022-02-02T18:15:32.145 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:31 smithi096 conmon[32067]: audit 2022-02-02T18:15:30.887795+0000 mon.smithi096 (mon.0) 117 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:32.146 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:31 smithi096 conmon[32067]: audit 2022-02-02T18:15:30.888873+0000 mon.smithi096 (mon.0) 118 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:15:32.146 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:31 smithi096 conmon[32067]: audit 2022-02-02T18:15:30.890644+0000 mon.smithi096 (mon.0) 119 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-02-02T18:15:32.146 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:31 smithi096 conmon[32067]: audit 2022-02-02T18:15:30.891235+0000 mon.smithi096 (mon.0) 120 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:15:32.147 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:31 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:30.891839+0000 mgr.smithi096.shfutl (mgr.14162) 8 : cephadm [INF] Deploying daemon crash.smithi096 on smithi096 2022-02-02T18:15:33.000 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:32 smithi096 conmon[32067]: audit 2022-02-02T18:15:30.939865+0000 mgr.smithi096.shfutl (mgr.14162) 9 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T18:15:33.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 -- 172.21.15.96:0/1390769474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 msgr2=0x7ff88c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:33.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 --2- 172.21.15.96:0/1390769474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c0f6930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff87c009fb0 tx=0x7ff87c009b30).stop 2022-02-02T18:15:33.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 -- 172.21.15.96:0/1390769474 shutdown_connections 2022-02-02T18:15:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 --2- 172.21.15.96:0/1390769474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c0f6930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 -- 172.21.15.96:0/1390769474 >> 172.21.15.96:0/1390769474 conn(0x7ff88c0f1c70 msgr2=0x7ff88c0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 -- 172.21.15.96:0/1390769474 shutdown_connections 2022-02-02T18:15:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 -- 172.21.15.96:0/1390769474 wait complete. 2022-02-02T18:15:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.564+0000 7ff89341a700 1 Processor -- start 2022-02-02T18:15:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff89341a700 1 -- start start 2022-02-02T18:15:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff89341a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff89341a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c069e20 con 0x7ff88c0f6510 2022-02-02T18:15:33.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff8911b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:33.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff8911b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51576/0 (socket says 172.21.15.96:51576) 2022-02-02T18:15:33.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff8911b6700 1 -- 172.21.15.96:0/502448736 learned_addr learned my addr 172.21.15.96:0/502448736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:15:33.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff8911b6700 1 -- 172.21.15.96:0/502448736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c005040 con 0x7ff88c0f6510 2022-02-02T18:15:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff8911b6700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff87c000c00 tx=0x7ff87c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c0095f0 con 0x7ff88c0f6510 2022-02-02T18:15:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c069fc0 con 0x7ff88c0f6510 2022-02-02T18:15:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff87c007e50 con 0x7ff88c0f6510 2022-02-02T18:15:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.565+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c014e70 con 0x7ff88c0f6510 2022-02-02T18:15:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.566+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c06a450 con 0x7ff88c0f6510 2022-02-02T18:15:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.566+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7ff87c025070 con 0x7ff88c0f6510 2022-02-02T18:15:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.566+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c059100 con 0x7ff88c0f6510 2022-02-02T18:15:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.567+0000 7ff881ffb700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 0x7ff878032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.567+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ff87c040960 con 0x7ff88c0f6510 2022-02-02T18:15:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.567+0000 7ff8909b5700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 0x7ff878032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.567+0000 7ff8909b5700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 0x7ff878032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff8880096a0 tx=0x7ff888006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.571+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff87c026350 con 0x7ff88c0f6510 2022-02-02T18:15:33.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.736+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff88c045ad0 con 0x7ff88c0f6510 2022-02-02T18:15:33.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.902+0000 7ff881ffb700 1 -- 172.21.15.96:0/502448736 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff87c025300 con 0x7ff88c0f6510 2022-02-02T18:15:33.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 msgr2=0x7ff878032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:33.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 0x7ff878032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff8880096a0 tx=0x7ff888006b40).stop 2022-02-02T18:15:33.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 msgr2=0x7ff88c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:33.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff87c000c00 tx=0x7ff87c00b040).stop 2022-02-02T18:15:33.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 shutdown_connections 2022-02-02T18:15:33.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff87802ff60 0x7ff878032420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:33.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 --2- 172.21.15.96:0/502448736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c0f6510 0x7ff88c06b9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:33.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 >> 172.21.15.96:0/502448736 conn(0x7ff88c0f1c70 msgr2=0x7ff88c0f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:33.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 shutdown_connections 2022-02-02T18:15:33.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:15:33.905+0000 7ff89341a700 1 -- 172.21.15.96:0/502448736 wait complete. 2022-02-02T18:15:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2022-02-02T18:15:33.935 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:33 smithi096 conmon[32067]: audit 2022-02-02T18:15:33.737058+0000 mon.smithi096 (mon.0) 121 : audit [INF] from='client.? 172.21.15.96:0/502448736' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-02-02T18:15:34.830 INFO:tasks.cephadm:Adding mon.smithi096 on smithi096 2022-02-02T18:15:34.831 INFO:tasks.cephadm:Adding mon.smithi159 on smithi159 2022-02-02T18:15:34.831 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch apply mon '2;smithi096:172.21.15.96=smithi096;smithi159:172.21.15.159=smithi159' 2022-02-02T18:15:35.218 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:34 smithi096 conmon[32067]: audit 2022-02-02T18:15:33.903141+0000 mon.smithi096 (mon.0) 122 : audit [INF] from='client.? 172.21.15.96:0/502448736' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-02-02T18:15:35.218 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:34 smithi096 conmon[32067]: cluster 2022-02-02T18:15:33.903193+0000 mon.smithi096 (mon.0) 123 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-02-02T18:15:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: cluster 2022-02-02T18:15:34.756598+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:15:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: .14162) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: audit 2022-02-02T18:15:35.552486+0000 mon.smithi096 (mon.0) 124 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: audit 2022-02-02T18:15:35.730614+0000 mon.smithi096 (mon.0) 125 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:15:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: -02T18:15:35.732454+0000 mon.smithi096 (mon.0) 126 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:15:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: 02-02T18:15:35. 2022-02-02T18:15:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: 732844+0000 mon.smithi096 (mon.0) 2022-02-02T18:15:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: 127 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-02-02T18:15:36.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:15:36.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: 02-02T18:15:35.735536+0000 2022-02-02T18:15:36.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: mon.smithi096 (mon.0) 128 : audit [INF] 2022-02-02T18:15:36.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:35 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:36.457 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/362932142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 msgr2=0x7fd5c40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:36.458 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/362932142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c40f6930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd5b8009fb0 tx=0x7fd5b8009b30).stop 2022-02-02T18:15:36.459 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/362932142 shutdown_connections 2022-02-02T18:15:36.459 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/362932142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c40f6930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:36.459 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/362932142 >> 172.21.15.159:0/362932142 conn(0x7fd5c40f1c70 msgr2=0x7fd5c40f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:36.459 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/362932142 shutdown_connections 2022-02-02T18:15:36.460 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.454+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/362932142 wait complete. 2022-02-02T18:15:36.460 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.455+0000 7fd5c9ee0700 1 Processor -- start 2022-02-02T18:15:36.460 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.455+0000 7fd5c9ee0700 1 -- start start 2022-02-02T18:15:36.462 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.455+0000 7fd5c9ee0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:36.462 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.455+0000 7fd5c9ee0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4106c00 con 0x7fd5c40f6510 2022-02-02T18:15:36.463 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:36.463 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37690/0 (socket says 172.21.15.159:37690) 2022-02-02T18:15:36.463 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c37fe700 1 -- 172.21.15.159:0/719918620 learned_addr learned my addr 172.21.15.159:0/719918620 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:36.463 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c37fe700 1 -- 172.21.15.159:0/719918620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8005040 con 0x7fd5c40f6510 2022-02-02T18:15:36.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c37fe700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd5b80089f0 tx=0x7fd5b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:36.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b8009320 con 0x7fd5c40f6510 2022-02-02T18:15:36.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd5b8013ec0 con 0x7fd5c40f6510 2022-02-02T18:15:36.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c4106e00 con 0x7fd5c40f6510 2022-02-02T18:15:36.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b8014d30 con 0x7fd5c40f6510 2022-02-02T18:15:36.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.456+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c4107290 con 0x7fd5c40f6510 2022-02-02T18:15:36.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.457+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fd5b80263a0 con 0x7fd5c40f6510 2022-02-02T18:15:36.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.457+0000 7fd5abfff700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 0x7fd5ac032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:36.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.457+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fd5b8041040 con 0x7fd5c40f6510 2022-02-02T18:15:36.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.457+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c4045ad0 con 0x7fd5c40f6510 2022-02-02T18:15:36.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.458+0000 7fd5c2ffd700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 0x7fd5ac032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:36.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.458+0000 7fd5c2ffd700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 0x7fd5ac032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd5b40096a0 tx=0x7fd5b4006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:36.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.462+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd5b8012920 con 0x7fd5c40f6510 2022-02-02T18:15:36.638 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.636+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi096:172.21.15.96=smithi096;smithi159:172.21.15.159=smithi159", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5c40f2f00 con 0x7fd5ac02ffb0 2022-02-02T18:15:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.640+0000 7fd5abfff700 1 -- 172.21.15.159:0/719918620 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd5c40f2f00 con 0x7fd5ac02ffb0 2022-02-02T18:15:36.643 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mon update... 2022-02-02T18:15:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 msgr2=0x7fd5ac032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 0x7fd5ac032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd5b40096a0 tx=0x7fd5b4006b40).stop 2022-02-02T18:15:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 msgr2=0x7fd5c4106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd5b80089f0 tx=0x7fd5b800b040).stop 2022-02-02T18:15:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 shutdown_connections 2022-02-02T18:15:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd5ac02ffb0 0x7fd5ac032470 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 --2- 172.21.15.159:0/719918620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5c40f6510 0x7fd5c4106710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 >> 172.21.15.159:0/719918620 conn(0x7fd5c40f1c70 msgr2=0x7fd5c40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:36.647 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 shutdown_connections 2022-02-02T18:15:36.647 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:36.642+0000 7fd5c9ee0700 1 -- 172.21.15.159:0/719918620 wait complete. 2022-02-02T18:15:37.073 DEBUG:teuthology.orchestra.run.smithi159:mon.smithi159> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi159.service 2022-02-02T18:15:37.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:37.077 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:37.104 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:-- Logs begin at Wed 2022-02-02 18:05:45 UTC. -- 2022-02-02T18:15:37.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:36 smithi096 conmon[32067]: audit 2022-02-02T18:15:35.733221+0000 2022-02-02T18:15:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:36 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 11 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-02-02T18:15:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:36 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:35.739253+0000 mgr.smithi096.shfutl (mgr.14162) 12 : cephadm [INF] Deploying daemon grafana.smithi096 on smithi096 2022-02-02T18:15:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:36 smithi096 conmon[32067]: audit 2022-02-02T18:15:36.640761+0000 mon.smithi096 (mon.0) 129 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:37 smithi096 conmon[32067]: audit 2022-02-02T18:15:36.637189+0000 mgr.smithi096.shfutl (mgr.14162) 13 : audit 2022-02-02T18:15:38.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:37 smithi096 conmon[32067]: [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi096:172.21.15.96=smithi096;smithi159:172.21.15.159=smithi159", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:15:38.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:37 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:36.638441+0000 mgr.smithi096.shfutl (mgr.14162) 14 : cephadm [INF] Saving service mon spec with placement smithi096:172.21.15.96=smithi096;smithi159:172.21.15.159=smithi159;count:2 2022-02-02T18:15:38.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:37 smithi096 conmon[32067]: cluster 2022-02-02T18:15:36.756842+0000 mgr.smithi096.shfutl (mgr.14162) 15 : cluster [DBG] 2022-02-02T18:15:38.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:37 smithi096 conmon[32067]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:38.581 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.576+0000 7f42b364a700 1 -- 172.21.15.159:0/3865806661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 msgr2=0x7f42ac0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:38.581 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.576+0000 7f42b364a700 1 --2- 172.21.15.159:0/3865806661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac0f5830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f429c009fb0 tx=0x7f429c009b30).stop 2022-02-02T18:15:38.582 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.576+0000 7f42b364a700 1 -- 172.21.15.159:0/3865806661 shutdown_connections 2022-02-02T18:15:38.582 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.576+0000 7f42b364a700 1 --2- 172.21.15.159:0/3865806661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac0f5830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:38.582 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.576+0000 7f42b364a700 1 -- 172.21.15.159:0/3865806661 >> 172.21.15.159:0/3865806661 conn(0x7f42ac0f0b70 msgr2=0x7f42ac0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:38.583 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 -- 172.21.15.159:0/3865806661 shutdown_connections 2022-02-02T18:15:38.583 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 -- 172.21.15.159:0/3865806661 wait complete. 2022-02-02T18:15:38.583 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 Processor -- start 2022-02-02T18:15:38.583 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 -- start start 2022-02-02T18:15:38.584 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:38.584 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.577+0000 7f42b364a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac060240 con 0x7f42ac0f5410 2022-02-02T18:15:38.584 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b13e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:38.584 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b13e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37696/0 (socket says 172.21.15.159:37696) 2022-02-02T18:15:38.584 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b13e6700 1 -- 172.21.15.159:0/3401115925 learned_addr learned my addr 172.21.15.159:0/3401115925 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:38.585 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b13e6700 1 -- 172.21.15.159:0/3401115925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c005040 con 0x7f42ac0f5410 2022-02-02T18:15:38.585 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b13e6700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f429c0089f0 tx=0x7f429c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:38.585 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f429c009320 con 0x7f42ac0f5410 2022-02-02T18:15:38.585 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f429c013ec0 con 0x7f42ac0f5410 2022-02-02T18:15:38.586 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac060440 con 0x7f42ac0f5410 2022-02-02T18:15:38.586 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f429c014d30 con 0x7f42ac0f5410 2022-02-02T18:15:38.586 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.578+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac109ac0 con 0x7f42ac0f5410 2022-02-02T18:15:38.587 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.579+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f429c0263a0 con 0x7f42ac0f5410 2022-02-02T18:15:38.588 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.579+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac045ad0 con 0x7f42ac0f5410 2022-02-02T18:15:38.588 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.579+0000 7f42a1ffb700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 0x7f42980324c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:38.588 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.579+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f429c041020 con 0x7f42ac0f5410 2022-02-02T18:15:38.588 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.580+0000 7f42b0be5700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 0x7f42980324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:38.589 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.580+0000 7f42b0be5700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 0x7f42980324c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f42a80096a0 tx=0x7f42a8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:38.589 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.584+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f429c012510 con 0x7f42ac0f5410 2022-02-02T18:15:38.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.794+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f42ac0fae90 con 0x7f42ac0f5410 2022-02-02T18:15:38.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.795+0000 7f42a1ffb700 1 -- 172.21.15.159:0/3401115925 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f429c012330 con 0x7f42ac0f5410 2022-02-02T18:15:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:38.800 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 msgr2=0x7f42980324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:38.800 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 0x7f42980324c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f42a80096a0 tx=0x7f42a8006b40).stop 2022-02-02T18:15:38.800 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 msgr2=0x7f42ac109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:38.800 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f429c0089f0 tx=0x7f429c00b040).stop 2022-02-02T18:15:38.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 shutdown_connections 2022-02-02T18:15:38.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4298030000 0x7f42980324c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:38.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 --2- 172.21.15.159:0/3401115925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42ac0f5410 0x7f42ac109410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:38.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 >> 172.21.15.159:0/3401115925 conn(0x7f42ac0f0b70 msgr2=0x7f42ac0f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:38.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 shutdown_connections 2022-02-02T18:15:38.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:38.796+0000 7f42b364a700 1 -- 172.21.15.159:0/3401115925 wait complete. 2022-02-02T18:15:38.802 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:39 smithi096 conmon[32067]: cluster 2022-02-02T18:15:38.757090+0000 mgr.smithi096.shfutl (mgr.14162) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:39 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:15:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:39 smithi096 conmon[32067]: -02T18:15:38.795246+0000 mon.smithi096 (mon.0) 130 : audit [DBG] from='client.? 172.21.15.159:0/3401115925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:40.220 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:40.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:41.771 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 -- 172.21.15.159:0/2773639978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 msgr2=0x7f73f80f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:41.772 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2773639978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f80f5830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f73f4009fb0 tx=0x7f73f4009b30).stop 2022-02-02T18:15:41.772 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 -- 172.21.15.159:0/2773639978 shutdown_connections 2022-02-02T18:15:41.773 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2773639978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f80f5830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:41.773 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 -- 172.21.15.159:0/2773639978 >> 172.21.15.159:0/2773639978 conn(0x7f73f80f0b70 msgr2=0x7f73f80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:41.773 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 -- 172.21.15.159:0/2773639978 shutdown_connections 2022-02-02T18:15:41.773 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.767+0000 7f73ff94e700 1 -- 172.21.15.159:0/2773639978 wait complete. 2022-02-02T18:15:41.774 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73ff94e700 1 Processor -- start 2022-02-02T18:15:41.774 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73ff94e700 1 -- start start 2022-02-02T18:15:41.774 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73ff94e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:41.774 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73ff94e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8060240 con 0x7f73f80f5410 2022-02-02T18:15:41.775 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73fd6ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:41.775 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73fd6ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37702/0 (socket says 172.21.15.159:37702) 2022-02-02T18:15:41.775 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73fd6ea700 1 -- 172.21.15.159:0/2067809668 learned_addr learned my addr 172.21.15.159:0/2067809668 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:41.775 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73fd6ea700 1 -- 172.21.15.159:0/2067809668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4005040 con 0x7f73f80f5410 2022-02-02T18:15:41.776 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.768+0000 7f73fd6ea700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f73f40089f0 tx=0x7f73f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:41.776 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.769+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f4009320 con 0x7f73f80f5410 2022-02-02T18:15:41.776 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.769+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8060440 con 0x7f73f80f5410 2022-02-02T18:15:41.776 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.769+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f73f4013ec0 con 0x7f73f80f5410 2022-02-02T18:15:41.776 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.769+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f4014d30 con 0x7f73f80f5410 2022-02-02T18:15:41.777 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.769+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8109ac0 con 0x7f73f80f5410 2022-02-02T18:15:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f73f40263a0 con 0x7f73f80f5410 2022-02-02T18:15:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73edffb700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 0x7f73e4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8045ad0 con 0x7f73f80f5410 2022-02-02T18:15:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f73f4041240 con 0x7f73f80f5410 2022-02-02T18:15:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73fcee9700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 0x7f73e4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.770+0000 7f73fcee9700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 0x7f73e4032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f73e80096a0 tx=0x7f73e8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.774+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f73f401ccf0 con 0x7f73f80f5410 2022-02-02T18:15:41.983 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.981+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f73f80faf80 con 0x7f73f80f5410 2022-02-02T18:15:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.982+0000 7f73edffb700 1 -- 172.21.15.159:0/2067809668 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f73f401cb10 con 0x7f73f80f5410 2022-02-02T18:15:41.985 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 msgr2=0x7f73e4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:41.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 0x7f73e4032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f73e80096a0 tx=0x7f73e8006b40).stop 2022-02-02T18:15:41.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 msgr2=0x7f73f8109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:41.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f73f40089f0 tx=0x7f73f400b040).stop 2022-02-02T18:15:41.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 shutdown_connections 2022-02-02T18:15:41.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f73e402ffb0 0x7f73e4032470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:41.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 --2- 172.21.15.159:0/2067809668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73f80f5410 0x7f73f8109410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:41.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.983+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 >> 172.21.15.159:0/2067809668 conn(0x7f73f80f0b70 msgr2=0x7f73f80f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:41.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.984+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 shutdown_connections 2022-02-02T18:15:41.989 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:41.984+0000 7f73ff94e700 1 -- 172.21.15.159:0/2067809668 wait complete. 2022-02-02T18:15:41.989 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:41 smithi096 conmon[32067]: cluster 2022-02-02T18:15:40. 2022-02-02T18:15:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:41 smithi096 conmon[32067]: 757284+0000 mgr.smithi096.shfutl (mgr.14162) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:42 smithi096 conmon[32067]: audit 2022-02-02T18:15:41.982200+0000 mon.smithi096 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.159:0/2067809668' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:43.456 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:43.457 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:44.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:43 smithi096 conmon[32067]: cluster 2022-02-02T18:15:42.757541+0000 mgr.smithi096.shfutl (mgr.14162) 18 2022-02-02T18:15:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:43 smithi096 conmon[32067]: : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:44.998 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 -- 172.21.15.159:0/3316376311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 msgr2=0x7fb8440f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:44.998 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 --2- 172.21.15.159:0/3316376311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8440f5830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb838009fb0 tx=0x7fb838009b30).stop 2022-02-02T18:15:44.998 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 -- 172.21.15.159:0/3316376311 shutdown_connections 2022-02-02T18:15:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 --2- 172.21.15.159:0/3316376311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8440f5830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 -- 172.21.15.159:0/3316376311 >> 172.21.15.159:0/3316376311 conn(0x7fb8440f0b70 msgr2=0x7fb8440f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 -- 172.21.15.159:0/3316376311 shutdown_connections 2022-02-02T18:15:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.993+0000 7fb8489a4700 1 -- 172.21.15.159:0/3316376311 wait complete. 2022-02-02T18:15:45.000 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb8489a4700 1 Processor -- start 2022-02-02T18:15:45.000 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb8489a4700 1 -- start start 2022-02-02T18:15:45.000 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb8489a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:45.000 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb8489a4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844060280 con 0x7fb8440f5410 2022-02-02T18:15:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb84259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb84259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37708/0 (socket says 172.21.15.159:37708) 2022-02-02T18:15:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.994+0000 7fb84259c700 1 -- 172.21.15.159:0/1559749057 learned_addr learned my addr 172.21.15.159:0/1559749057 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb84259c700 1 -- 172.21.15.159:0/1559749057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838005040 con 0x7fb8440f5410 2022-02-02T18:15:45.002 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb84259c700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb838000c00 tx=0x7fb83800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:45.002 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8380095f0 con 0x7fb8440f5410 2022-02-02T18:15:45.002 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb838007e50 con 0x7fb8440f5410 2022-02-02T18:15:45.002 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb844060480 con 0x7fb8440f5410 2022-02-02T18:15:45.003 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb838014e70 con 0x7fb8440f5410 2022-02-02T18:15:45.003 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.995+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb844109b00 con 0x7fb8440f5410 2022-02-02T18:15:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.996+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb838025070 con 0x7fb8440f5410 2022-02-02T18:15:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.996+0000 7fb832ffd700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 0x7fb82c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.996+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb844045ad0 con 0x7fb8440f5410 2022-02-02T18:15:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.996+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb838040870 con 0x7fb8440f5410 2022-02-02T18:15:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.996+0000 7fb841d9b700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 0x7fb82c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:44.997+0000 7fb841d9b700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 0x7fb82c032470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb8340096a0 tx=0x7fb834006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.002+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb83800f4e0 con 0x7fb8440f5410 2022-02-02T18:15:45.208 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.205+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb8440fae90 con 0x7fb8440f5410 2022-02-02T18:15:45.209 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.206+0000 7fb832ffd700 1 -- 172.21.15.159:0/1559749057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fb83800f300 con 0x7fb8440f5410 2022-02-02T18:15:45.209 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:45.209 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:45.211 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 msgr2=0x7fb82c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:45.211 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 0x7fb82c032470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb8340096a0 tx=0x7fb834006b40).stop 2022-02-02T18:15:45.211 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 msgr2=0x7fb8441093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:45.211 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb838000c00 tx=0x7fb83800b040).stop 2022-02-02T18:15:45.218 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 shutdown_connections 2022-02-02T18:15:45.218 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb82c02ffb0 0x7fb82c032470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:45.219 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 --2- 172.21.15.159:0/1559749057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8440f5410 0x7fb8441093d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:45.219 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 >> 172.21.15.159:0/1559749057 conn(0x7fb8440f0b70 msgr2=0x7fb8440f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:45.219 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 shutdown_connections 2022-02-02T18:15:45.219 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:45.208+0000 7fb8489a4700 1 -- 172.21.15.159:0/1559749057 wait complete. 2022-02-02T18:15:45.219 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:46.003 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:45 smithi096 conmon[32067]: cluster 2022-02-02T18:15:44.757811+0000 mgr.smithi096.shfutl (mgr.14162) 19 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:46.004 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:45 smithi096 conmon[32067]: audit 2022-02-02T18:15:45.206849+0000 mon.smithi096 (mon.0) 132 : audit [DBG] from='client.? 172.21.15.159:0/1559749057' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:46.693 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:46.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:47.444 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:47 smithi096 conmon[32067]: audit 2022-02-02T18:15:46.370667+0000 mon.smithi096 (mon.0) 133 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:47.445 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:47 smithi096 conmon[32067]: cephadm 2022-02-02T18: 2022-02-02T18:15:47.445 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:47 smithi096 conmon[32067]: 15:46.371919+0000 mgr.smithi096.shfutl (mgr.14162) 20 : cephadm [INF] Deploying daemon node-exporter.smithi096 on smithi096 2022-02-02T18:15:47.445 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:47 smithi096 conmon[32067]: cluster 2022-02-02T18:15:46.758088+0000 mgr.smithi096.shfutl (mgr.14162) 21 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:48.194 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 -- 172.21.15.159:0/2884522331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 msgr2=0x7f973c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:48.195 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 --2- 172.21.15.159:0/2884522331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0f5830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f972c009fb0 tx=0x7f972c009b30).stop 2022-02-02T18:15:48.195 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 -- 172.21.15.159:0/2884522331 shutdown_connections 2022-02-02T18:15:48.195 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 --2- 172.21.15.159:0/2884522331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0f5830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:48.196 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 -- 172.21.15.159:0/2884522331 >> 172.21.15.159:0/2884522331 conn(0x7f973c0f0b70 msgr2=0x7f973c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:48.196 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 -- 172.21.15.159:0/2884522331 shutdown_connections 2022-02-02T18:15:48.196 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 -- 172.21.15.159:0/2884522331 wait complete. 2022-02-02T18:15:48.196 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.190+0000 7f97420c7700 1 Processor -- start 2022-02-02T18:15:48.197 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f97420c7700 1 -- start start 2022-02-02T18:15:48.197 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f97420c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:48.197 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f97420c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0fb800 con 0x7f973c0f5410 2022-02-02T18:15:48.197 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f973b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:48.197 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f973b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37714/0 (socket says 172.21.15.159:37714) 2022-02-02T18:15:48.198 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f973b7fe700 1 -- 172.21.15.159:0/10277914 learned_addr learned my addr 172.21.15.159:0/10277914 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:48.198 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f973b7fe700 1 -- 172.21.15.159:0/10277914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c005040 con 0x7f973c0f5410 2022-02-02T18:15:48.198 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.191+0000 7f973b7fe700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f972c009f80 tx=0x7f972c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:48.198 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f972c009320 con 0x7f973c0f5410 2022-02-02T18:15:48.199 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f972c013380 con 0x7f973c0f5410 2022-02-02T18:15:48.199 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0fb9a0 con 0x7f973c0f5410 2022-02-02T18:15:48.199 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f972c01ebd0 con 0x7f973c0f5410 2022-02-02T18:15:48.199 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c0fbe30 con 0x7f973c0f5410 2022-02-02T18:15:48.200 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.192+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f972c01e420 con 0x7f973c0f5410 2022-02-02T18:15:48.201 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.193+0000 7f9733fff700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 0x7f9728032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:48.201 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.193+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c059100 con 0x7f973c0f5410 2022-02-02T18:15:48.201 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.193+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f972c040e20 con 0x7f973c0f5410 2022-02-02T18:15:48.201 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.193+0000 7f973affd700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 0x7f9728032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:48.202 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.193+0000 7f973affd700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 0x7f9728032420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f97240096a0 tx=0x7f9724006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:48.202 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.197+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f972c01ccf0 con 0x7f973c0f5410 2022-02-02T18:15:48.405 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.403+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f973c0fae90 con 0x7f973c0f5410 2022-02-02T18:15:48.406 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.404+0000 7f9733fff700 1 -- 172.21.15.159:0/10277914 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f972c01d380 con 0x7f973c0f5410 2022-02-02T18:15:48.407 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:48.407 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:48.408 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.405+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 msgr2=0x7f9728032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:48.409 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.405+0000 7f97420c7700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 0x7f9728032420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f97240096a0 tx=0x7f9724006b40).stop 2022-02-02T18:15:48.409 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.405+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 msgr2=0x7f973c0fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:48.409 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.405+0000 7f97420c7700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f972c009f80 tx=0x7f972c00b040).stop 2022-02-02T18:15:48.409 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 shutdown_connections 2022-02-02T18:15:48.410 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f972802ff60 0x7f9728032420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:48.410 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 --2- 172.21.15.159:0/10277914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f973c0f5410 0x7f973c0fd380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:48.410 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 >> 172.21.15.159:0/10277914 conn(0x7f973c0f0b70 msgr2=0x7f973c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:48.410 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 shutdown_connections 2022-02-02T18:15:48.411 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:48.406+0000 7f97420c7700 1 -- 172.21.15.159:0/10277914 wait complete. 2022-02-02T18:15:48.411 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:48.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:48 smithi096 conmon[32067]: audit 2022-02-02T18:15:48.404088+0000 mon.smithi096 (mon. 2022-02-02T18:15:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:48 smithi096 conmon[32067]: 0) 134 : audit [DBG] from='client.? 172.21.15.159:0/10277914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:49.843 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:49.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:50.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:49 smithi096 conmon[32067]: cluster 2022-02-02T18:15:48.758333+0000 mgr.smithi096.shfutl (mgr.14162) 22 : cluster 2022-02-02T18:15:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:49 smithi096 conmon[32067]: [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:49 smithi096 conmon[32067]: audit 2022-02-02T18:15:49.518147+0000 mon.smithi096 (mon.0) 135 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:50 smithi096 conmon[32067]: cephadm 2022-02-02T18:15:49.523440+0000 mgr.smithi096.shfutl (mgr.14162) 23 : cephadm 2022-02-02T18:15:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:50 smithi096 conmon[32067]: [INF] Deploying daemon prometheus.smithi096 on smithi096 2022-02-02T18:15:51.429 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 -- 172.21.15.159:0/1812837283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 msgr2=0x7fe9100f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:51.430 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 --2- 172.21.15.159:0/1812837283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9100f5830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe900009fb0 tx=0x7fe900009b30).stop 2022-02-02T18:15:51.430 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 -- 172.21.15.159:0/1812837283 shutdown_connections 2022-02-02T18:15:51.430 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 --2- 172.21.15.159:0/1812837283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9100f5830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:51.430 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 -- 172.21.15.159:0/1812837283 >> 172.21.15.159:0/1812837283 conn(0x7fe9100f0b70 msgr2=0x7fe9100f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:51.431 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 -- 172.21.15.159:0/1812837283 shutdown_connections 2022-02-02T18:15:51.431 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.424+0000 7fe917cb0700 1 -- 172.21.15.159:0/1812837283 wait complete. 2022-02-02T18:15:51.431 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.425+0000 7fe917cb0700 1 Processor -- start 2022-02-02T18:15:51.431 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.425+0000 7fe917cb0700 1 -- start start 2022-02-02T18:15:51.432 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.425+0000 7fe917cb0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:51.432 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.425+0000 7fe917cb0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910105aa0 con 0x7fe9100f5410 2022-02-02T18:15:51.432 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.426+0000 7fe915a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:51.432 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.426+0000 7fe915a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37720/0 (socket says 172.21.15.159:37720) 2022-02-02T18:15:51.433 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.426+0000 7fe915a4c700 1 -- 172.21.15.159:0/2311032409 learned_addr learned my addr 172.21.15.159:0/2311032409 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:51.433 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.426+0000 7fe915a4c700 1 -- 172.21.15.159:0/2311032409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900005040 con 0x7fe9100f5410 2022-02-02T18:15:51.433 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.426+0000 7fe915a4c700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe900000c00 tx=0x7fe90000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:51.433 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.427+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9000095f0 con 0x7fe9100f5410 2022-02-02T18:15:51.434 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.427+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe900007e50 con 0x7fe9100f5410 2022-02-02T18:15:51.434 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.427+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe900014e70 con 0x7fe9100f5410 2022-02-02T18:15:51.434 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.427+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe910105ca0 con 0x7fe9100f5410 2022-02-02T18:15:51.434 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.427+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe910106130 con 0x7fe9100f5410 2022-02-02T18:15:51.435 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fe9000079c0 con 0x7fe9100f5410 2022-02-02T18:15:51.436 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910045ad0 con 0x7fe9100f5410 2022-02-02T18:15:51.436 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe9067fc700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 0x7fe8fc032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:51.436 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fe9000407e0 con 0x7fe9100f5410 2022-02-02T18:15:51.436 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe91524b700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 0x7fe8fc032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:51.437 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.428+0000 7fe91524b700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 0x7fe8fc032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe90c0096a0 tx=0x7fe90c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:51.437 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.432+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe90001b910 con 0x7fe9100f5410 2022-02-02T18:15:51.641 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.639+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe910106f30 con 0x7fe9100f5410 2022-02-02T18:15:51.642 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.639+0000 7fe9067fc700 1 -- 172.21.15.159:0/2311032409 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fe900011290 con 0x7fe9100f5410 2022-02-02T18:15:51.643 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:51.643 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 msgr2=0x7fe8fc032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 0x7fe8fc032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe90c0096a0 tx=0x7fe90c006b40).stop 2022-02-02T18:15:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 msgr2=0x7fe9101055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe900000c00 tx=0x7fe90000b040).stop 2022-02-02T18:15:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 shutdown_connections 2022-02-02T18:15:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe8fc02ffb0 0x7fe8fc032470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 --2- 172.21.15.159:0/2311032409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9100f5410 0x7fe9101055b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 >> 172.21.15.159:0/2311032409 conn(0x7fe9100f0b70 msgr2=0x7fe9100f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 shutdown_connections 2022-02-02T18:15:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:51.641+0000 7fe917cb0700 1 -- 172.21.15.159:0/2311032409 wait complete. 2022-02-02T18:15:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:51 smithi096 conmon[32067]: cluster 2022-02-02T18:15:50.758563+0000 mgr.smithi096.shfutl (mgr.14162) 24 2022-02-02T18:15:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:51 smithi096 conmon[32067]: : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:51 smithi096 conmon[32067]: audit 2022-02-02T18:15:51.639880+0000 mon.smithi096 (mon.0) 136 : audit [DBG] from='client.? 172.21.15.159:0/2311032409' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:52.988 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:52.988 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:53 smithi096 conmon[32067]: cluster 2022-02-02T18:15:52.758940+0000 mgr.smithi096.shfutl (mgr.14162) 25 : 2022-02-02T18:15:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:53 smithi096 conmon[32067]: cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:54.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 -- 172.21.15.159:0/3763539545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 msgr2=0x7f7c100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:54.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3763539545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c100f6930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7c04009fb0 tx=0x7f7c04009b30).stop 2022-02-02T18:15:54.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 -- 172.21.15.159:0/3763539545 shutdown_connections 2022-02-02T18:15:54.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3763539545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c100f6930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:54.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 -- 172.21.15.159:0/3763539545 >> 172.21.15.159:0/3763539545 conn(0x7f7c100f1c70 msgr2=0x7f7c100f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:54.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 -- 172.21.15.159:0/3763539545 shutdown_connections 2022-02-02T18:15:54.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.461+0000 7f7c148c8700 1 -- 172.21.15.159:0/3763539545 wait complete. 2022-02-02T18:15:54.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c148c8700 1 Processor -- start 2022-02-02T18:15:54.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c148c8700 1 -- start start 2022-02-02T18:15:54.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c148c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:54.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c148c8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10069e20 con 0x7f7c100f6510 2022-02-02T18:15:54.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:54.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37726/0 (socket says 172.21.15.159:37726) 2022-02-02T18:15:54.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.462+0000 7f7c0e59c700 1 -- 172.21.15.159:0/3613786802 learned_addr learned my addr 172.21.15.159:0/3613786802 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:54.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7c0e59c700 1 -- 172.21.15.159:0/3613786802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c04005040 con 0x7f7c100f6510 2022-02-02T18:15:54.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7c0e59c700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7c040089f0 tx=0x7f7c0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:54.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c04009320 con 0x7f7c100f6510 2022-02-02T18:15:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10069fc0 con 0x7f7c100f6510 2022-02-02T18:15:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7c04013ec0 con 0x7f7c100f6510 2022-02-02T18:15:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c04014d30 con 0x7f7c100f6510 2022-02-02T18:15:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.463+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1006a450 con 0x7f7c100f6510 2022-02-02T18:15:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.464+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f7c04014420 con 0x7f7c100f6510 2022-02-02T18:15:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.464+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10059100 con 0x7f7c100f6510 2022-02-02T18:15:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.464+0000 7f7bfeffd700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 0x7f7bf8032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.464+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7c040410c0 con 0x7f7c100f6510 2022-02-02T18:15:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.464+0000 7f7c0dd9b700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 0x7f7bf8032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.465+0000 7f7c0dd9b700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 0x7f7bf8032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7c000096a0 tx=0x7f7c00006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.469+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7c040095f0 con 0x7f7c100f6510 2022-02-02T18:15:54.674 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.672+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7c100fbf90 con 0x7f7c100f6510 2022-02-02T18:15:54.675 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.672+0000 7f7bfeffd700 1 -- 172.21.15.159:0/3613786802 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f7c0401db70 con 0x7f7c100f6510 2022-02-02T18:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:54.677 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 msgr2=0x7f7bf8032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:54.677 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 0x7f7bf8032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7c000096a0 tx=0x7f7c00006b40).stop 2022-02-02T18:15:54.678 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 msgr2=0x7f7c1006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:54.678 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7c040089f0 tx=0x7f7c0400b040).stop 2022-02-02T18:15:54.678 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 shutdown_connections 2022-02-02T18:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bf802ffb0 0x7f7bf8032470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 --2- 172.21.15.159:0/3613786802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c100f6510 0x7f7c1006b9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 >> 172.21.15.159:0/3613786802 conn(0x7f7c100f1c70 msgr2=0x7f7c100f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 shutdown_connections 2022-02-02T18:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:54.674+0000 7f7c148c8700 1 -- 172.21.15.159:0/3613786802 wait complete. 2022-02-02T18:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:55.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:54 smithi096 conmon[32067]: audit 2022-02-02T18:15:54.672949+0000 mon.smithi096 (mon.0) 137 : audit [DBG] from='client.? 172.21.15.159:0/3613786802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:55.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:55 smithi096 conmon[32067]: cluster 2022-02-02T18:15:54.759208+0000 mgr.smithi096.shfutl (mgr.14162) 26 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:56.131 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:56.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:15:57.736 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3858353955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 msgr2=0x7fd2c80f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:57.737 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3858353955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c80f66c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd2b8009fb0 tx=0x7fd2b8009b30).stop 2022-02-02T18:15:57.737 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3858353955 shutdown_connections 2022-02-02T18:15:57.737 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3858353955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c80f66c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:57.737 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3858353955 >> 172.21.15.159:0/3858353955 conn(0x7fd2c80f1aa0 msgr2=0x7fd2c80f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:57.738 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3858353955 shutdown_connections 2022-02-02T18:15:57.738 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3858353955 wait complete. 2022-02-02T18:15:57.738 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 Processor -- start 2022-02-02T18:15:57.738 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.732+0000 7fd2ccd91700 1 -- start start 2022-02-02T18:15:57.739 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2ccd91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:57.739 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2ccd91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c8106980 con 0x7fd2c80f62a0 2022-02-02T18:15:57.739 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:57.739 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37732/0 (socket says 172.21.15.159:37732) 2022-02-02T18:15:57.740 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2c77fe700 1 -- 172.21.15.159:0/3815270574 learned_addr learned my addr 172.21.15.159:0/3815270574 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:15:57.740 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2c77fe700 1 -- 172.21.15.159:0/3815270574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8005040 con 0x7fd2c80f62a0 2022-02-02T18:15:57.740 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2c77fe700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd2b8000c00 tx=0x7fd2b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:57.740 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.733+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b80095f0 con 0x7fd2c80f62a0 2022-02-02T18:15:57.741 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.734+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd2b8007e50 con 0x7fd2c80f62a0 2022-02-02T18:15:57.741 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.734+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8106b80 con 0x7fd2c80f62a0 2022-02-02T18:15:57.741 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.734+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8107010 con 0x7fd2c80f62a0 2022-02-02T18:15:57.741 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.734+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b8014e70 con 0x7fd2c80f62a0 2022-02-02T18:15:57.742 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fd2b8025070 con 0x7fd2c80f62a0 2022-02-02T18:15:57.743 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a8004fa0 con 0x7fd2c80f62a0 2022-02-02T18:15:57.743 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2affff700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 0x7fd2b0032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:15:57.743 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fd2b8040c20 con 0x7fd2c80f62a0 2022-02-02T18:15:57.743 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2c6ffd700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 0x7fd2b0032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:15:57.744 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.735+0000 7fd2c6ffd700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 0x7fd2b0032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd2bc0096a0 tx=0x7fd2bc006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:15:57.744 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.739+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd2b8026350 con 0x7fd2c80f62a0 2022-02-02T18:15:57.961 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.958+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd2a8005670 con 0x7fd2c80f62a0 2022-02-02T18:15:57.962 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.959+0000 7fd2affff700 1 -- 172.21.15.159:0/3815270574 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fd2b8012330 con 0x7fd2c80f62a0 2022-02-02T18:15:57.962 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:15:57.963 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:15:57.964 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 msgr2=0x7fd2b0032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:57.964 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 0x7fd2b0032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd2bc0096a0 tx=0x7fd2bc006b40).stop 2022-02-02T18:15:57.964 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 msgr2=0x7fd2c8106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:15:57.964 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd2b8000c00 tx=0x7fd2b800b040).stop 2022-02-02T18:15:57.965 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 shutdown_connections 2022-02-02T18:15:57.965 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd2b002ff60 0x7fd2b0032420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:57.965 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 --2- 172.21.15.159:0/3815270574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c80f62a0 0x7fd2c8106490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:15:57.966 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 >> 172.21.15.159:0/3815270574 conn(0x7fd2c80f1aa0 msgr2=0x7fd2c80f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:15:57.966 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 shutdown_connections 2022-02-02T18:15:57.966 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:15:57.961+0000 7fd2ccd91700 1 -- 172.21.15.159:0/3815270574 wait complete. 2022-02-02T18:15:57.967 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:15:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:57 smithi096 conmon[32067]: cluster 2022-02-02T18:15:56.759484+0000 mgr.smithi096.shfutl (mgr.14162) 27 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:15:58.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:57 smithi096 conmon[32067]: audit 2022-02-02T18:15:56.956916+0000 mon.smithi096 (mon.0) 138 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:58.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:57 smithi096 conmon[32067]: audit 2022-02-02T18:15:56.957392+0000 mon.smithi096 (mon.0) 139 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:15:58.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:57 smithi096 conmon[32067]: audit 2022-02-02T18:15:57.364970+0000 mon.smithi096 (mon.0) 140 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:59.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:58 smithi096 conmon[32067]: audit 2022-02-02T18:15:57.857162+0000 mon.smithi096 (mon. 2022-02-02T18:15:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:58 smithi096 conmon[32067]: 0) 141 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:15:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:58 smithi096 conmon[32067]: audit 2022-02-02T18:15:57.959537+0000 mon.smithi096 (mon.0) 142 : audit [DBG] from='client.? 172.21.15.159:0/3815270574' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:15:59.398 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:15:59.399 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:16:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:15:59 smithi096 conmon[32067]: cluster 2022-02-02T18:15:58.759870+0000 mgr.smithi096.shfutl (mgr.14162) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:01.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 -- 172.21.15.159:0/424846562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 msgr2=0x7f8aac0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:01.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 --2- 172.21.15.159:0/424846562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac0f6930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8aa8009fb0 tx=0x7f8aa8009b30).stop 2022-02-02T18:16:01.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 -- 172.21.15.159:0/424846562 shutdown_connections 2022-02-02T18:16:01.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 --2- 172.21.15.159:0/424846562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac0f6930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:01.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 -- 172.21.15.159:0/424846562 >> 172.21.15.159:0/424846562 conn(0x7f8aac0f1c70 msgr2=0x7f8aac0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:01.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 -- 172.21.15.159:0/424846562 shutdown_connections 2022-02-02T18:16:01.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.268+0000 7f8ab328b700 1 -- 172.21.15.159:0/424846562 wait complete. 2022-02-02T18:16:01.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.269+0000 7f8ab328b700 1 Processor -- start 2022-02-02T18:16:01.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.269+0000 7f8ab328b700 1 -- start start 2022-02-02T18:16:01.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.269+0000 7f8ab328b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:01.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.269+0000 7f8ab328b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac106ba0 con 0x7f8aac0f6510 2022-02-02T18:16:01.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.269+0000 7f8ab1027700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:01.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8ab1027700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37738/0 (socket says 172.21.15.159:37738) 2022-02-02T18:16:01.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8ab1027700 1 -- 172.21.15.159:0/3356547575 learned_addr learned my addr 172.21.15.159:0/3356547575 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:16:01.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8ab1027700 1 -- 172.21.15.159:0/3356547575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8005040 con 0x7f8aac0f6510 2022-02-02T18:16:01.277 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8ab1027700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8aa80089f0 tx=0x7f8aa800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:01.277 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa8009320 con 0x7f8aac0f6510 2022-02-02T18:16:01.277 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac106da0 con 0x7f8aac0f6510 2022-02-02T18:16:01.277 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8aa8013ec0 con 0x7f8aac0f6510 2022-02-02T18:16:01.278 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.270+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa8014d30 con 0x7f8aac0f6510 2022-02-02T18:16:01.279 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.271+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac107230 con 0x7f8aac0f6510 2022-02-02T18:16:01.279 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.271+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8aa80263a0 con 0x7f8aac0f6510 2022-02-02T18:16:01.279 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.271+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac045ad0 con 0x7f8aac0f6510 2022-02-02T18:16:01.280 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.272+0000 7f8aa1ffb700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 0x7f8a98032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:01.280 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.272+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8aa8041260 con 0x7f8aac0f6510 2022-02-02T18:16:01.280 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.272+0000 7f8ab0826700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 0x7f8a98032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:01.280 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.272+0000 7f8ab0826700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 0x7f8a98032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8a9c0096a0 tx=0x7f8a9c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:01.281 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.276+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8aa8012330 con 0x7f8aac0f6510 2022-02-02T18:16:01.501 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.497+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8aac108080 con 0x7f8aac0f6510 2022-02-02T18:16:01.501 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.498+0000 7f8aa1ffb700 1 -- 172.21.15.159:0/3356547575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f8aa801ccb0 con 0x7f8aac0f6510 2022-02-02T18:16:01.501 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:16:01.502 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:16:01.503 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 msgr2=0x7f8a98032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:01.503 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 0x7f8a98032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8a9c0096a0 tx=0x7f8a9c006b40).stop 2022-02-02T18:16:01.503 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 msgr2=0x7f8aac1066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:01.504 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8aa80089f0 tx=0x7f8aa800b040).stop 2022-02-02T18:16:01.504 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 shutdown_connections 2022-02-02T18:16:01.504 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f8a9802ffb0 0x7f8a98032470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:01.504 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 --2- 172.21.15.159:0/3356547575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6510 0x7f8aac1066b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:01.504 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 >> 172.21.15.159:0/3356547575 conn(0x7f8aac0f1c70 msgr2=0x7f8aac0f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:01.505 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 shutdown_connections 2022-02-02T18:16:01.505 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:01.500+0000 7f8ab328b700 1 -- 172.21.15.159:0/3356547575 wait complete. 2022-02-02T18:16:01.505 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:16:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: cluster 2022-02-02T18:16:00.760255+0000 mgr.smithi096.shfutl 2022-02-02T18:16:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: (mgr.14162) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022-02-02T18:16:01.131632+0000 mon.smithi096 (mon.0) 143 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022-02-02T18:16:01.498587+0000 mon.smithi096 (mon.0) 144 : audit [DBG] 2022-02-02T18:16:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: from='client.? 172.21.15.159:0/3356547575' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:16:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022-02-02T18:16:01.526727 2022-02-02T18:16:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 145 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:16:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: 02T18:16:01.832704+0000 mon.smithi096 (mon 2022-02-02T18:16:02.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: .0) 146 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:02.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:02.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: 02-02T18:16:01.835736+0000 mon.smithi096 2022-02-02T18:16:02.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: (mon.0) 147 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:02.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:02.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: -02-02T18:16:01.836549+0000 2022-02-02T18:16:02.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: mon.smithi096 (mon.0) 148 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:16:02.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: 2022-02-02T18:16:02.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022-02-02T18:16:02.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: 2022-02-02T18:16:01.839190+0000 mon.smithi096 ( 2022-02-02T18:16:02.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: mon.0) 149 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-02-02T18:16:02.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:02.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: 02-02T18:16:01.839812+0000 mon.smithi096 2022-02-02T18:16:02.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:01 smithi096 conmon[32067]: (mon.0) 150 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:02.950 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:16:02.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:16:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:02 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:01.840465+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:03.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:02 smithi096 conmon[32067]: .14162) 30 : cephadm [INF] Deploying daemon crash.smithi159 on smithi159 2022-02-02T18:16:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:03 smithi096 conmon[32067]: cluster 2022-02-02T18:16:02.760563+0000 mgr.smithi096.shfutl (mgr.14162) 31 2022-02-02T18:16:04.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:03 smithi096 conmon[32067]: : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:04.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 -- 172.21.15.159:0/1258793148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 msgr2=0x7f80780f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:04.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 --2- 172.21.15.159:0/1258793148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80780f4be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8068009fb0 tx=0x7f8068009b30).stop 2022-02-02T18:16:04.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 -- 172.21.15.159:0/1258793148 shutdown_connections 2022-02-02T18:16:04.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 --2- 172.21.15.159:0/1258793148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80780f4be0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:04.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 -- 172.21.15.159:0/1258793148 >> 172.21.15.159:0/1258793148 conn(0x7f80780f02e0 msgr2=0x7f80780f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:04.807 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 -- 172.21.15.159:0/1258793148 shutdown_connections 2022-02-02T18:16:04.807 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.796+0000 7f807d2ad700 1 -- 172.21.15.159:0/1258793148 wait complete. 2022-02-02T18:16:04.807 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.797+0000 7f807d2ad700 1 Processor -- start 2022-02-02T18:16:04.808 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.797+0000 7f807d2ad700 1 -- start start 2022-02-02T18:16:04.808 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.797+0000 7f807d2ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:04.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.797+0000 7f807d2ad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078106bd0 con 0x7f80780f47c0 2022-02-02T18:16:04.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f8076ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:04.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f8076ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37744/0 (socket says 172.21.15.159:37744) 2022-02-02T18:16:04.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f8076ffd700 1 -- 172.21.15.159:0/2992332794 learned_addr learned my addr 172.21.15.159:0/2992332794 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:16:04.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f8076ffd700 1 -- 172.21.15.159:0/2992332794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068005040 con 0x7f80780f47c0 2022-02-02T18:16:04.810 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f8076ffd700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f80680089f0 tx=0x7f806800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:04.810 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8068009320 con 0x7f80780f47c0 2022-02-02T18:16:04.810 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8068013ec0 con 0x7f80780f47c0 2022-02-02T18:16:04.810 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8078106dd0 con 0x7f80780f47c0 2022-02-02T18:16:04.811 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8068014d30 con 0x7f80780f47c0 2022-02-02T18:16:04.811 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.798+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078107260 con 0x7f80780f47c0 2022-02-02T18:16:04.811 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.799+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f80680263a0 con 0x7f80780f47c0 2022-02-02T18:16:04.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.799+0000 7f805f7fe700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 0x7f8060032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:04.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.799+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078045ad0 con 0x7f80780f47c0 2022-02-02T18:16:04.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.800+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8068040f60 con 0x7f80780f47c0 2022-02-02T18:16:04.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.800+0000 7f80767fc700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 0x7f8060032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:04.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.800+0000 7f80767fc700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 0x7f8060032470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f806c0096a0 tx=0x7f806c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:04.813 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:04.804+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8068012920 con 0x7f80780f47c0 2022-02-02T18:16:05.028 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.025+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8078108110 con 0x7f80780f47c0 2022-02-02T18:16:05.029 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.026+0000 7f805f7fe700 1 -- 172.21.15.159:0/2992332794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f806802c090 con 0x7f80780f47c0 2022-02-02T18:16:05.029 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:16:05.029 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:16:05.031 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 msgr2=0x7f8060032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:05.031 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 0x7f8060032470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f806c0096a0 tx=0x7f806c006b40).stop 2022-02-02T18:16:05.032 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 msgr2=0x7f80781066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:05.032 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f80680089f0 tx=0x7f806800b040).stop 2022-02-02T18:16:05.032 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 shutdown_connections 2022-02-02T18:16:05.032 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f806002ffb0 0x7f8060032470 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:05.033 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 --2- 172.21.15.159:0/2992332794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80780f47c0 0x7f80781066e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:05.033 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 >> 172.21.15.159:0/2992332794 conn(0x7f80780f02e0 msgr2=0x7f80780f0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:05.033 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 shutdown_connections 2022-02-02T18:16:05.034 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:05.028+0000 7f807d2ad700 1 -- 172.21.15.159:0/2992332794 wait complete. 2022-02-02T18:16:05.034 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:16:05.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022-02-02T18:16:04.183163+0000 mon.smithi096 (mon.0) 151 : audit 2022-02-02T18:16:05.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:05.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022-02-02T18:16:04.184443+0000 mon.smithi096 (mon.0) 152 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:16:05.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: 02-02T18:16:04.186563+0000 mon.smithi096 (mon.0) 153 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-02-02T18:16:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022-02-02T18:16:04.187389+0000 2022-02-02T18:16:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: mon.smithi096 (mon.0) 154 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:16:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: 02-02T18:16:04.188315+0000 mon.smithi096 (mon.0) 155 2022-02-02T18:16:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: cephadm 2022-02 2022-02-02T18:16:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: -02T18:16:04.188983+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:16:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: 14162) 32 : cephadm [INF] Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:16:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: -02-02T18:16:04.760878+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: .14162) 33 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:05.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:16:05.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: :16:05.026620+0000 mon.smithi096 (mon.0) 156 : audit [DBG] 2022-02-02T18:16:05.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:05 smithi096 conmon[32067]: from='client.? 172.21.15.159:0/2992332794' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:16:06.505 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:16:06.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:16:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: audit 2022-02-02T18:16:06.538784+0000 mon.smithi096 (mon.0) 157 : audit 2022-02-02T18:16:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: audit 2022-02-02T18:16:06.539899+0000 mon.smithi096 (mon.0) 158 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:16:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:16:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: :16:06.540747+0000 mon.smithi096 (mon.0) 159 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:06.541444+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: .14162) 34 : cephadm [INF] Deploying daemon mon.smithi159 on smithi159 2022-02-02T18:16:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: cluster 2022-02-02T18:16:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: 2022-02-02T18:16:06.761240+0000 mgr.smithi096.shfutl ( 2022-02-02T18:16:07.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:07 smithi096 conmon[32067]: mgr.14162) 35 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:08.445 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 -- 172.21.15.159:0/1335414831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 msgr2=0x7f53a40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:08.445 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 --2- 172.21.15.159:0/1335414831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a40f6930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5398009fb0 tx=0x7f5398009b30).stop 2022-02-02T18:16:08.445 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 -- 172.21.15.159:0/1335414831 shutdown_connections 2022-02-02T18:16:08.445 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 --2- 172.21.15.159:0/1335414831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a40f6930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:08.446 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 -- 172.21.15.159:0/1335414831 >> 172.21.15.159:0/1335414831 conn(0x7f53a40f1c70 msgr2=0x7f53a40f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:08.446 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 -- 172.21.15.159:0/1335414831 shutdown_connections 2022-02-02T18:16:08.446 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.438+0000 7f53aaac1700 1 -- 172.21.15.159:0/1335414831 wait complete. 2022-02-02T18:16:08.446 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.439+0000 7f53aaac1700 1 Processor -- start 2022-02-02T18:16:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.439+0000 7f53aaac1700 1 -- start start 2022-02-02T18:16:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.439+0000 7f53aaac1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.439+0000 7f53aaac1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4106c00 con 0x7f53a40f6510 2022-02-02T18:16:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a885d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:08.448 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a885d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.159:37754/0 (socket says 172.21.15.159:37754) 2022-02-02T18:16:08.448 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a885d700 1 -- 172.21.15.159:0/2674850580 learned_addr learned my addr 172.21.15.159:0/2674850580 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:16:08.448 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a885d700 1 -- 172.21.15.159:0/2674850580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398005040 con 0x7f53a40f6510 2022-02-02T18:16:08.448 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a885d700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f53980089f0 tx=0x7f539800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:08.449 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5398009320 con 0x7f53a40f6510 2022-02-02T18:16:08.449 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4106e00 con 0x7f53a40f6510 2022-02-02T18:16:08.449 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4107290 con 0x7f53a40f6510 2022-02-02T18:16:08.449 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5398013ec0 con 0x7f53a40f6510 2022-02-02T18:16:08.449 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.440+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5398014d00 con 0x7f53a40f6510 2022-02-02T18:16:08.450 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.441+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f53980263a0 con 0x7f53a40f6510 2022-02-02T18:16:08.450 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.441+0000 7f53a17fa700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 0x7f5394036880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:08.450 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.441+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f5398041e70 con 0x7f53a40f6510 2022-02-02T18:16:08.450 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.441+0000 7f53a3fff700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 0x7f5394036880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.441+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384004fa0 con 0x7f53a40f6510 2022-02-02T18:16:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.442+0000 7f53a3fff700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 0x7f5394036880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f53900096a0 tx=0x7f5390006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.446+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f539801d380 con 0x7f53a40f6510 2022-02-02T18:16:08.671 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.668+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5384005670 con 0x7f53a40f6510 2022-02-02T18:16:08.672 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.668+0000 7f53a17fa700 1 -- 172.21.15.159:0/2674850580 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f539802b020 con 0x7f53a40f6510 2022-02-02T18:16:08.672 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:16:08.672 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:14:17.785459Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T18:16:08.674 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 msgr2=0x7f5394036880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:08.674 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 0x7f5394036880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f53900096a0 tx=0x7f5390006b40).stop 2022-02-02T18:16:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 msgr2=0x7f53a4106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f53980089f0 tx=0x7f539800b040).stop 2022-02-02T18:16:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 shutdown_connections 2022-02-02T18:16:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f53940343c0 0x7f5394036880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 --2- 172.21.15.159:0/2674850580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53a40f6510 0x7f53a4106710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.671+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 >> 172.21.15.159:0/2674850580 conn(0x7f53a40f1c70 msgr2=0x7f53a40f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.672+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 shutdown_connections 2022-02-02T18:16:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:08.672+0000 7f53aaac1700 1 -- 172.21.15.159:0/2674850580 wait complete. 2022-02-02T18:16:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2022-02-02T18:16:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:08 smithi096 conmon[32067]: audit 2022-02-02T18:16:08.668917+0000 mon.smithi096 (mon.0) 160 : audit [DBG] from='client.? 172.21.15.159:0/2674850580' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:16:09.564 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:09 smithi159 systemd[1]: Starting Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:16:09.939 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:09 smithi159 podman[35625]: 2022-02-02T18:16:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:09 smithi096 conmon[32067]: cluster 2022-02-02T18:16:08.761532+0000 2022-02-02T18:16:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:09 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 36 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.007+0000 7efd53294700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T18:16:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.007+0000 7efd53294700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-02-02T18:16:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.007+0000 7efd53294700 0 pidfile_write: ignore empty --pid-file 2022-02-02T18:16:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 0 load: jerasure load: lrc load: isa 2022-02-02T18:16:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T18:16:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T18:16:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Compile date May 13 2021 2022-02-02T18:16:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: DB SUMMARY 2022-02-02T18:16:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: CURRENT file: CURRENT 2022-02-02T18:16:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: IDENTITY file: IDENTITY 2022-02-02T18:16:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2022-02-02T18:16:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 0, files: 2022-02-02T18:16:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000003.log size: 511 ; 2022-02-02T18:16:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T18:16:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.create_if_missing: 0 2022-02-02T18:16:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T18:16:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.env: 0x5640f8c181c0 2022-02-02T18:16:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.fs: Posix File System 2022-02-02T18:16:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.info_log: 0x5640fa251960 2022-02-02T18:16:10.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T18:16:10.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.statistics: (nil) 2022-02-02T18:16:10.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.use_fsync: 0 2022-02-02T18:16:10.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T18:16:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T18:16:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T18:16:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T18:16:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T18:16:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T18:16:10.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T18:16:10.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T18:16:10.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T18:16:10.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T18:16:10.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T18:16:10.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.db_log_dir: 2022-02-02T18:16:10.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi159/store.db 2022-02-02T18:16:10.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T18:16:10.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T18:16:10.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T18:16:10.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T18:16:10.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T18:16:10.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T18:16:10.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T18:16:10.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T18:16:10.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T18:16:10.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T18:16:10.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.write_buffer_manager: 0x5640faec6030 2022-02-02T18:16:10.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T18:16:10.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T18:16:10.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T18:16:10.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T18:16:10.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T18:16:10.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T18:16:10.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T18:16:10.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T18:16:10.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T18:16:10.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.unordered_write: 0 2022-02-02T18:16:10.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T18:16:10.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T18:16:10.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T18:16:10.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T18:16:10.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.row_cache: None 2022-02-02T18:16:10.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.wal_filter: None 2022-02-02T18:16:10.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T18:16:10.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T18:16:10.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T18:16:10.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T18:16:10.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T18:16:10.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T18:16:10.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T18:16:10.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T18:16:10.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T18:16:10.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T18:16:10.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T18:16:10.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T18:16:10.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T18:16:10.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T18:16:10.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T18:16:10.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T18:16:10.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T18:16:10.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T18:16:10.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T18:16:10.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T18:16:10.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T18:16:10.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.max_open_files: -1 2022-02-02T18:16:10.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T18:16:10.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T18:16:10.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T18:16:10.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T18:16:10.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Compression algorithms supported: 2022-02-02T18:16:10.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T18:16:10.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kZSTD supported: 0 2022-02-02T18:16:10.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T18:16:10.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T18:16:10.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T18:16:10.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T18:16:10.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T18:16:10.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T18:16:10.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.012+0000 7efd53294700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T18:16:10.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000001 2022-02-02T18:16:10.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T18:16:10.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T18:16:10.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.merge_operator: 2022-02-02T18:16:10.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_filter: None 2022-02-02T18:16:10.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T18:16:10.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T18:16:10.304 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T18:16:10.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5640fa168128) 2022-02-02T18:16:10.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: cache_index_and_filter_blocks: 1 2022-02-02T18:16:10.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T18:16:10.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T18:16:10.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: pin_top_level_index_and_filter: 1 2022-02-02T18:16:10.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: index_type: 0 2022-02-02T18:16:10.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: data_block_index_type: 0 2022-02-02T18:16:10.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: index_shortening: 1 2022-02-02T18:16:10.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: data_block_hash_table_util_ratio: 0.750000 2022-02-02T18:16:10.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: hash_index_allow_collision: 1 2022-02-02T18:16:10.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: checksum: 1 2022-02-02T18:16:10.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: no_block_cache: 0 2022-02-02T18:16:10.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_cache: 0x5640fa19ef10 2022-02-02T18:16:10.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_cache_name: BinnedLRUCache 2022-02-02T18:16:10.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_cache_options: 2022-02-02T18:16:10.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: capacity : 536870912 2022-02-02T18:16:10.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: num_shard_bits : 4 2022-02-02T18:16:10.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: strict_capacity_limit : 0 2022-02-02T18:16:10.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: high_pri_pool_ratio: 0.000 2022-02-02T18:16:10.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_cache_compressed: (nil) 2022-02-02T18:16:10.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: persistent_cache: (nil) 2022-02-02T18:16:10.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_size: 4096 2022-02-02T18:16:10.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_size_deviation: 10 2022-02-02T18:16:10.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_restart_interval: 16 2022-02-02T18:16:10.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: index_block_restart_interval: 1 2022-02-02T18:16:10.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: metadata_block_size: 4096 2022-02-02T18:16:10.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: partition_filters: 0 2022-02-02T18:16:10.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: use_delta_encoding: 1 2022-02-02T18:16:10.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T18:16:10.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: whole_key_filtering: 1 2022-02-02T18:16:10.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: verify_compression: 0 2022-02-02T18:16:10.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: read_amp_bytes_per_bit: 0 2022-02-02T18:16:10.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: format_version: 2 2022-02-02T18:16:10.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: enable_index_compression: 1 2022-02-02T18:16:10.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: block_align: 0 2022-02-02T18:16:10.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T18:16:10.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T18:16:10.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression: NoCompression 2022-02-02T18:16:10.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T18:16:10.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T18:16:10.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T18:16:10.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.num_levels: 7 2022-02-02T18:16:10.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T18:16:10.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T18:16:10.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T18:16:10.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T18:16:10.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T18:16:10.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T18:16:10.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T18:16:10.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:16:10.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T18:16:10.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T18:16:10.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T18:16:10.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T18:16:10.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T18:16:10.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:16:10.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T18:16:10.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T18:16:10.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T18:16:10.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T18:16:10.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T18:16:10.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T18:16:10.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T18:16:10.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T18:16:10.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T18:16:10.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T18:16:10.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T18:16:10.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T18:16:10.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T18:16:10.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T18:16:10.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T18:16:10.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T18:16:10.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T18:16:10.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T18:16:10.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T18:16:10.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T18:16:10.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T18:16:10.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T18:16:10.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T18:16:10.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T18:16:10.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T18:16:10.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T18:16:10.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T18:16:10.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T18:16:10.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T18:16:10.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T18:16:10.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T18:16:10.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T18:16:10.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T18:16:10.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T18:16:10.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T18:16:10.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T18:16:10.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T18:16:10.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T18:16:10.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T18:16:10.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T18:16:10.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T18:16:10.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T18:16:10.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T18:16:10.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T18:16:10.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T18:16:10.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.ttl: 2592000 2022-02-02T18:16:10.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T18:16:10.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T18:16:10.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-02-02T18:16:10.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825770014890, "job": 1, "event": "recovery_started", "log_files": [3]} 2022-02-02T18:16:10.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.013+0000 7efd53294700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2022-02-02T18:16:10.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.014+0000 7efd53294700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T18:16:10.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.014+0000 7efd53294700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825770015378, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643825770, "oldest_key_time": 3, "file_creation_time": 0}} 2022-02-02T18:16:10.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.014+0000 7efd53294700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2022-02-02T18:16:10.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.014+0000 7efd53294700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643825770015762, "job": 1, "event": "recovery_finished"} 2022-02-02T18:16:10.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.015+0000 7efd53294700 4 rocksdb: DB pointer 0x5640fa263800 2022-02-02T18:16:10.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.015+0000 7efd3a0ac700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T18:16:10.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.015+0000 7efd3a0ac700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T18:16:10.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** DB Stats ** 2022-02-02T18:16:10.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:16:10.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T18:16:10.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T18:16:10.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:16:10.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T18:16:10.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T18:16:10.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:16:10.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** Compaction Stats [default] ** 2022-02-02T18:16:10.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:16:10.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:16:10.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** Compaction Stats [default] ** 2022-02-02T18:16:10.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:16:10.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:16:10.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:16:10.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:16:10.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:16:10.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:16:10.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:16:10.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:16:10.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:16:10.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:16:10.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:16:10.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:16:10.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** Compaction Stats [default] ** 2022-02-02T18:16:10.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:16:10.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:16:10.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:16:10.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** Compaction Stats [default] ** 2022-02-02T18:16:10.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:16:10.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:16:10.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2022-02-02T18:16:10.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:16:10.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T18:16:10.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:16:10.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:16:10.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 bash[35547]: 415162de66b1216f464f2e6d82301ae8c5375d67c9ffb263226df79ba879d847 2022-02-02T18:16:10.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:16:10.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:16:10.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:16:10.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:16:10.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:16:10.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:16:10.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.015+0000 7efd53294700 0 mon.smithi159 does not exist in monmap, will attempt to join an existing cluster 2022-02-02T18:16:10.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.016+0000 7efd53294700 0 using public_addr v2:172.21.15.159:0/0 -> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2022-02-02T18:16:10.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.016+0000 7efd53294700 0 starting mon.smithi159 rank -1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:16:10.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.017+0000 7efd53294700 1 mon.smithi159@-1(???) e0 preinit fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:16:10.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).mds e1 new map 2022-02-02T18:16:10.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).mds e1 print_map 2022-02-02T18:16:10.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: e1 2022-02-02T18:16:10.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:16:10.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:16:10.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: legacy client fscid: -1 2022-02-02T18:16:10.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: No filesystems configured 2022-02-02T18:16:10.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:10.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-02-02T18:16:10.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-02-02T18:16:10.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-02-02T18:16:10.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-02-02T18:16:10.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-02-02T18:16:10.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-02-02T18:16:10.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2022-02-02T18:16:10.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2022-02-02T18:16:10.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:16:10.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:16:10.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 0 mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T18:16:10.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: cluster 2022-02-02T18:16:10.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: 2022-02-02T18:16:08.761532+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:10.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: .14162) 36 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:10.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.044+0000 7efd3c8b1700 1 mon.smithi159@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2022-02-02T18:16:10.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expand map: {default=false} 2022-02-02T18:16:10.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta from 'false' to 'false' 2022-02-02T18:16:10.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expanded map: {default=false} 2022-02-02T18:16:10.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expand map: {default=info} 2022-02-02T18:16:10.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta from 'info' to 'info' 2022-02-02T18:16:10.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expanded map: {default=info} 2022-02-02T18:16:10.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expand map: {default=daemon} 2022-02-02T18:16:10.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta from 'daemon' to 'daemon' 2022-02-02T18:16:10.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expanded map: {default=daemon} 2022-02-02T18:16:10.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expand map: {default=debug} 2022-02-02T18:16:10.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta from 'debug' to 'debug' 2022-02-02T18:16:10.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 20 expand_channel_meta expanded map: {default=debug} 2022-02-02T18:16:10.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 conmon[35668]: debug 2022-02-02T18:16:10.046+0000 7efd3c8b1700 10 mon.smithi159@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2022-02-02T18:16:10.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:10 smithi159 systemd[1]: Started Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:16:10.417 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T18:16:10.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T18:16:15.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.471+0000 7fde5ac20700 1 -- 172.21.15.159:0/3113984596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 msgr2=0x7fde400056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.471+0000 7fde5ac20700 1 --2- 172.21.15.159:0/3113984596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde400056e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fde540f5ff0 tx=0x7fde5000b040).stop 2022-02-02T18:16:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.472+0000 7fde5ac20700 1 -- 172.21.15.159:0/3113984596 shutdown_connections 2022-02-02T18:16:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.472+0000 7fde5ac20700 1 --2- 172.21.15.159:0/3113984596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde400056e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.472+0000 7fde5ac20700 1 -- 172.21.15.159:0/3113984596 >> 172.21.15.159:0/3113984596 conn(0x7fde540f09a0 msgr2=0x7fde540f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.472+0000 7fde5ac20700 1 -- 172.21.15.159:0/3113984596 shutdown_connections 2022-02-02T18:16:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.472+0000 7fde5ac20700 1 -- 172.21.15.159:0/3113984596 wait complete. 2022-02-02T18:16:15.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:10.051819+0000 mon.smithi096 (mon.0) 162 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:16:15.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:10.051997+0000 mon.smithi096 (mon.0) 163 : cluster [INF] mon.smithi096 calling monitor election 2022-02-02T18:16:15.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:10.065403+0000 mon.smithi096 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:10.761829+0000 mgr.smithi096.shfutl (mgr.14162) 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:11.048780+0000 mon.smithi096 (mon.0) 165 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:11.732468+0000 mon.smithi096 (mon.0) 166 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:16:15.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:12.049054+0000 mon.smithi096 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:12.050740+0000 mon.smithi159 (mon.1) 1 : cluster [INF] mon.smithi159 calling monitor election 2022-02-02T18:16:15.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:12.762128+0000 mgr.smithi096.shfutl (mgr.14162) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:13.049337+0000 mon.smithi096 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:14.049380+0000 mon.smithi096 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:14.762461+0000 mgr.smithi096.shfutl (mgr.14162) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:14.905338+0000 mon.smithi096 (mon.0) 170 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:16:15.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:14.907870+0000 mon.smithi096 (mon.0) 171 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:16:15.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.049404+0000 mon.smithi096 (mon.0) 172 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.079999+0000 mon.smithi096 (mon.0) 173 : cluster [INF] mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:16:15.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.084591+0000 mon.smithi096 (mon.0) 174 : cluster [DBG] monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:16:15.766 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.084670+0000 mon.smithi096 (mon.0) 175 : cluster [DBG] fsmap 2022-02-02T18:16:15.766 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.084701+0000 mon.smithi096 (mon.0) 176 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-02-02T18:16:15.766 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16 2022-02-02T18:16:15.766 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: :15.084909+0000 mon.smithi096 (mon.0) 177 : cluster [DBG] mgrmap e16: smithi096.shfutl(active, since 61s) 2022-02-02T18:16:15.766 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.085843+0000 mon.smithi096 (mon.0) 178 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:16:15.767 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.087082+0000 mon.smithi096 (mon.0) 179 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:16:15.767 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.088879+0000 mon.smithi096 (mon.0) 180 : cluster [INF] overall HEALTH_OK 2022-02-02T18:16:15.767 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.089369+0000 mon.smithi096 (mon.0) 181 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:16:15.767 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.091294+0000 mon.smithi096 (mon.0) 182 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:15.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:15 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.091701+0000 mon.smithi096 (mon.0) 183 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:16:15.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16:10.051819+0000 mon.smithi096 (mon.0) 162 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:16:15.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 2022-02-02T18:16:15.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022-02-02T18:16:10.051997+0000 mon.smithi096 (mon.0) 163 : cluster [INF] mon.smithi096 calling monitor election 2022-02-02T18:16:15.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16:10. 2022-02-02T18:16:15.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 065403+0000 mon.smithi096 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:16:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:10.761829+0000 mgr.smithi096.shfutl (mgr.14162) 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 2022-02-02T18:16:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16:11.048780+0000 2022-02-02T18:16:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: mon.smithi096 (mon.0) 165 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16 2022-02-02T18:16:15.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: :11.732468+0000 mon.smithi096 (mon.0) 166 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:16:15.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:15.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:12.049054+0000 mon.smithi096 (mon 2022-02-02T18:16:15.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 167 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022-02-02 2022-02-02T18:16:15.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: T18:16:12.050740+0000 mon.smithi159 (mon.1) 1 2022-02-02T18:16:15.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: : cluster [INF] mon.smithi159 calling monitor election 2022-02-02T18:16:15.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:15.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:12.762128+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:15.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .14162) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:15.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:13.049337+0000 mon.smithi096 (mon. 2022-02-02T18:16:15.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 0) 168 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:15.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:14.049380+0000 mon.smithi096 ( 2022-02-02T18:16:15.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022-02-02T18:16:15.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 2022-02-02T18:16:14.762461+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:15.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .14162) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:15.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:16:15.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 18:16:14.905338+0000 mon.smithi096 (mon.0) 170 : audit [INF] 2022-02-02T18:16:15.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:16:15.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16:14.907870 2022-02-02T18:16:15.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 171 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:16:15.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022-02-02T18:16:15.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 2022-02-02T18:16:15.049404+0000 mon.smithi096 ( 2022-02-02T18:16:15.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: mon.0) 172 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:15.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:15.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.079999+0000 mon.smithi096 (mon. 2022-02-02T18:16:15.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 0) 173 : cluster [INF] mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:16:15.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:16:15.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:15.084591+0000 mon.smithi096 (mon 2022-02-02T18:16:15.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 174 : cluster [DBG] monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:16:15.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:15.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.084670+0000 mon.smithi096 (mon 2022-02-02T18:16:15.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 175 : cluster [DBG] fsmap 2022-02-02T18:16:15.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:16:15.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:15.084701+0000 mon.smithi096 (mon.0 2022-02-02T18:16:15.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: ) 176 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-02-02T18:16:15.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:15.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.084909+0000 mon.smithi096 (mon 2022-02-02T18:16:15.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 177 : cluster [DBG] mgrmap e16: smithi096.shfutl(active, since 61s) 2022-02-02T18:16:15.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:16:15.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:15.085843+0000 mon.smithi096 (mon. 2022-02-02T18:16:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 0) 178 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:16:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.087082+0000 mon.smithi096 ( 2022-02-02T18:16:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: mon.0) 179 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:16:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:16:15.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.088879+0000 mon.smithi096 (mon. 2022-02-02T18:16:15.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 0) 180 : cluster [INF] overall HEALTH_OK 2022-02-02T18:16:15.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:16:15.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: 02-02T18:16:15.089369+0000 mon.smithi096 (mon 2022-02-02T18:16:15.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 181 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:16:15.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:15.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.091294+0000 mon.smithi096 (mon 2022-02-02T18:16:15.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: .0) 182 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:15.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: audit 2022 2022-02-02T18:16:15.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: -02-02T18:16:15.091701+0000 mon.smithi096 (mon.0 2022-02-02T18:16:15.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:15 smithi096 conmon[32067]: ) 183 : audit [DBG] from='mgr.? 172.21.15.159:0/3209031124' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:16:15.786 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 Processor -- start 2022-02-02T18:16:15.786 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 -- start start 2022-02-02T18:16:15.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde54106540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:15.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:15.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54106f90 con 0x7fde40003250 2022-02-02T18:16:15.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5ac20700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde541070d0 con 0x7fde54106a30 2022-02-02T18:16:15.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:15.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42888/0 (socket says 172.21.15.159:42888) 2022-02-02T18:16:15.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 -- 172.21.15.159:0/987283568 learned_addr learned my addr 172.21.15.159:0/987283568 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:16:15.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde59c1e700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde54106540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:15.789 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 -- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 msgr2=0x7fde54107920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2022-02-02T18:16:15.789 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 -- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 msgr2=0x7fde54107920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-02-02T18:16:15.789 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-02-02T18:16:15.789 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.473+0000 7fde5941d700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:16:15.789 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde59c1e700 1 -- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 msgr2=0x7fde54107920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:16:15.790 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde59c1e700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:15.790 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde59c1e700 1 -- 172.21.15.159:0/987283568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50005040 con 0x7fde40003250 2022-02-02T18:16:15.790 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde59c1e700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde54106540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fde5000b010 tx=0x7fde50002040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:15.790 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde50017930 con 0x7fde40003250 2022-02-02T18:16:15.791 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fde50021440 con 0x7fde40003250 2022-02-02T18:16:15.791 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54107ed0 con 0x7fde40003250 2022-02-02T18:16:15.791 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde50020630 con 0x7fde40003250 2022-02-02T18:16:15.791 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.474+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde54108490 con 0x7fde40003250 2022-02-02T18:16:15.792 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.475+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54045ad0 con 0x7fde40003250 2022-02-02T18:16:15.792 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.475+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fde50031070 con 0x7fde40003250 2022-02-02T18:16:15.792 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.476+0000 7fde4a7fc700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 0x7fde3805e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:15.792 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.476+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fde500777b0 con 0x7fde40003250 2022-02-02T18:16:15.792 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.476+0000 7fde5941d700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 0x7fde3805e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:15.793 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.476+0000 7fde5941d700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 0x7fde3805e8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fde44006fd0 tx=0x7fde44006e50).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:15.793 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.481+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fde5004b4c0 con 0x7fde40003250 2022-02-02T18:16:15.793 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.714+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde54108700 con 0x7fde40003250 2022-02-02T18:16:15.793 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.715+0000 7fde4a7fc700 1 -- 172.21.15.159:0/987283568 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+968 (secure 0 0 0) 0x7fde5002f020 con 0x7fde40003250 2022-02-02T18:16:15.794 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-02-02T18:16:15.794 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","modified":"2022-02-02T18:16:10.049227Z","created":"2022-02-02T18:14:17.785459Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-02-02T18:16:15.795 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 msgr2=0x7fde3805e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:15.795 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 0x7fde3805e8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fde44006fd0 tx=0x7fde44006e50).stop 2022-02-02T18:16:15.796 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 msgr2=0x7fde54106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:15.796 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde54106540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fde5000b010 tx=0x7fde50002040).stop 2022-02-02T18:16:15.796 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 shutdown_connections 2022-02-02T18:16:15.796 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fde3805c400 0x7fde3805e8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:15.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde40003250 0x7fde54106540 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:15.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 --2- 172.21.15.159:0/987283568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde54106a30 0x7fde54107920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:15.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.717+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 >> 172.21.15.159:0/987283568 conn(0x7fde540f09a0 msgr2=0x7fde540f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:15.797 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.718+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 shutdown_connections 2022-02-02T18:16:15.798 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:16:15.718+0000 7fde5ac20700 1 -- 172.21.15.159:0/987283568 wait complete. 2022-02-02T18:16:15.798 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2022-02-02T18:16:16.159 INFO:tasks.cephadm:Generating final ceph.conf file... 2022-02-02T18:16:16.160 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph config generate-minimal-conf 2022-02-02T18:16:16.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:15 2022-02-02T18:16:16.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: .092339+0000 mgr.smithi096.shfutl (mgr.14162) 40 : cephadm [INF] Deploying daemon node-exporter.smithi159 on smithi159 2022-02-02T18:16:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: cluster 2022-02-02T18:16:15.148009+0000 mon.smithi096 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi096.shfutl(active, since 61s), standbys: smithi159.jrxkfz 2022-02-02T18:16:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.148160+0000 mon.smithi096 (mon.0) 185 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:16:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: audit 2022-02-02T18:16:15.715994+0000 mon.smithi096 (mon.0) 186 : audit [DBG] from='client.? 172.21.15.159:0/987283568' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:16:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:16 smithi159 conmon[35668]: audit 2022-02-02T18:16:16.052771+0000 mon.smithi096 (mon.0) 187 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:16.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:15.092339+0000 mgr.smithi096.shfutl (mgr.14162) 40 : cephadm 2022-02-02T18:16:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: [INF] Deploying daemon node-exporter.smithi159 on smithi159 2022-02-02T18:16:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: cluster 2022-02-02T18:16:15.148009+0000 mon.smithi096 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi096.shfutl(active, since 61s), standbys: smithi159.jrxkfz 2022-02-02T18:16:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: audit 2022-02-02T18:16:15 2022-02-02T18:16:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: .148160+0000 mon.smithi096 (mon.0) 185 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:16:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: audit 2022-02-02T18:16:15.715994 2022-02-02T18:16:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 186 : audit [DBG] from='client.? 172.21.15.159:0/987283568' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T18:16:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: audit 2022-02-02T18:16 2022-02-02T18:16:16.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: :16.052771+0000 mon.smithi096 (mon.0) 187 : audit 2022-02-02T18:16:16.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:16 smithi096 conmon[32067]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:16:17.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:17 smithi159 conmon[35668]: cluster 2022-02-02T18:16:16.762732+0000 mgr.smithi096.shfutl (mgr.14162) 41 : cluster 2022-02-02T18:16:17.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:17 smithi159 conmon[35668]: [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:17.507 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:17 smithi096 conmon[32067]: cluster 2022-02-02T18:16:16.762732+0000 2022-02-02T18:16:17.508 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:17 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 41 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:18.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 -- 172.21.15.96:0/1326908677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 msgr2=0x7f95f80f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:18.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/1326908677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f9190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f95e0009fb0 tx=0x7f95e0009b30).stop 2022-02-02T18:16:18.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 -- 172.21.15.96:0/1326908677 shutdown_connections 2022-02-02T18:16:18.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/1326908677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f9190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:18.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 -- 172.21.15.96:0/1326908677 >> 172.21.15.96:0/1326908677 conn(0x7f95f80f0b70 msgr2=0x7f95f80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:18.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 -- 172.21.15.96:0/1326908677 shutdown_connections 2022-02-02T18:16:18.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.782+0000 7f95fdcc2700 1 -- 172.21.15.96:0/1326908677 wait complete. 2022-02-02T18:16:18.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 Processor -- start 2022-02-02T18:16:18.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 -- start start 2022-02-02T18:16:18.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:18.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:18.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80f5a90 con 0x7f95f80601e0 2022-02-02T18:16:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.783+0000 7f95fdcc2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80f5bd0 con 0x7f95f80f5090 2022-02-02T18:16:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51646/0 (socket says 172.21.15.96:51646) 2022-02-02T18:16:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 -- 172.21.15.96:0/303126580 learned_addr learned my addr 172.21.15.96:0/303126580 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:16:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f6ffd700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f6ffd700 1 -- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 msgr2=0x7f95f80f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2022-02-02T18:16:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f6ffd700 1 -- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 msgr2=0x7f95f80f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-02-02T18:16:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f6ffd700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-02-02T18:16:18.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f6ffd700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T18:16:18.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 -- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 msgr2=0x7f95f80f5510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:16:18.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:18.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 -- 172.21.15.96:0/303126580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0005040 con 0x7f95f80601e0 2022-02-02T18:16:18.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95f77fe700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f95e0013600 tx=0x7f95e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:18.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e000e030 con 0x7f95f80601e0 2022-02-02T18:16:18.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80f5e20 con 0x7f95f80601e0 2022-02-02T18:16:18.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f95e0009630 con 0x7f95f80601e0 2022-02-02T18:16:18.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e0018070 con 0x7f95f80601e0 2022-02-02T18:16:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.784+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f810eaa0 con 0x7f95f80601e0 2022-02-02T18:16:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.785+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8045ad0 con 0x7f95f80601e0 2022-02-02T18:16:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.786+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f95e00125d0 con 0x7f95f80601e0 2022-02-02T18:16:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.786+0000 7f95effff700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 0x7f95e405e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.786+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f95e0076c00 con 0x7f95f80601e0 2022-02-02T18:16:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.786+0000 7f95f6ffd700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 0x7f95e405e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:18.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.787+0000 7f95f6ffd700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 0x7f95e405e870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f95e8006c30 tx=0x7f95e8008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:18.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.791+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f95e007c020 con 0x7f95f80601e0 2022-02-02T18:16:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.950+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f95f80fbf90 con 0x7f95f80601e0 2022-02-02T18:16:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.950+0000 7f95effff700 1 -- 172.21.15.96:0/303126580 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+225 (secure 0 0 0) 0x7f95e004a8f0 con 0x7f95f80601e0 2022-02-02T18:16:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:# minimal ceph.conf for e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:16:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2022-02-02T18:16:18.954 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:16:18.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon_host = [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2022-02-02T18:16:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.952+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 msgr2=0x7f95e405e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.952+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 0x7f95e405e870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f95e8006c30 tx=0x7f95e8008040).stop 2022-02-02T18:16:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.952+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 msgr2=0x7f95f80f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:18.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.952+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f95e0013600 tx=0x7f95e0009b30).stop 2022-02-02T18:16:18.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 shutdown_connections 2022-02-02T18:16:18.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f95e405c3b0 0x7f95e405e870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:18.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f80601e0 0x7f95f80f6c10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:18.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 --2- 172.21.15.96:0/303126580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f80f5090 0x7f95f80f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:18.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 >> 172.21.15.96:0/303126580 conn(0x7f95f80f0b70 msgr2=0x7f95f80f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:18.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 shutdown_connections 2022-02-02T18:16:18.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:18.953+0000 7f95fdcc2700 1 -- 172.21.15.96:0/303126580 wait complete. 2022-02-02T18:16:19.494 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:19 smithi096 conmon[32067]: audit 2022-02-02T18:16:18.202285+0000 mon.smithi096 (mon.0) 188 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:19.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:19 smithi096 conmon[32067]: audit 2022-02-02T18:16:18.203213+0000 mon.smithi096 (mon.0) 189 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:16:19.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:19 smithi096 conmon[32067]: cluster 2022-02-02T18:16:18.762944+0000 mgr.smithi096.shfutl (mgr.14162) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:19.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:19 smithi096 conmon[32067]: audit 2022-02-02T18:16:18.951009+0000 mon.smithi096 (mon.0) 190 : audit [DBG] from='client.? 172.21.15.96:0/303126580' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:19.497 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2022-02-02T18:16:19.497 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:16:19.498 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.conf 2022-02-02T18:16:19.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:19 smithi159 conmon[35668]: audit 2022-02-02T18:16:18.202285+0000 mon.smithi096 (mon.0) 188 2022-02-02T18:16:19.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:19 smithi159 conmon[35668]: : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:19 smithi159 conmon[35668]: audit 2022-02-02T18:16:18.203213+0000 mon.smithi096 (mon.0) 189 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:16:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:19 smithi159 conmon[35668]: cluster 2022-02-02T18:16:18.762944+0000 mgr.smithi096.shfutl (mgr.14162) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:19 smithi159 conmon[35668]: audit 2022-02-02T18:16:18.951009+0000 mon.smithi096 (mon.0) 190 : audit [DBG] from='client.? 172.21.15.96:0/303126580' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:19.538 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:16:19.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T18:16:19.604 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:16:19.604 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2022-02-02T18:16:19.638 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:16:19.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T18:16:19.704 INFO:tasks.cephadm:Deploying OSDs... 2022-02-02T18:16:19.705 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:16:19.705 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2022-02-02T18:16:19.721 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-02-02T18:16:19.722 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-02-02T18:16:19.778 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-02-02T18:16:19.779 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:19.779 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 156259 Links: 1 2022-02-02T18:16:19.779 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:19.779 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:19.780 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2022-02-02 18:15:56.242076220 +0000 2022-02-02T18:16:19.780 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2022-02-02 18:10:44.092225157 +0000 2022-02-02T18:16:19.780 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2022-02-02 18:10:44.092225157 +0000 2022-02-02T18:16:19.780 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2022-02-02T18:16:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2022-02-02T18:16:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2022-02-02T18:16:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00022956 s, 2.2 MB/s 2022-02-02T18:16:19.791 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-02-02T18:16:19.849 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-02-02T18:16:19.849 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:19.849 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 156736 Links: 1 2022-02-02T18:16:19.850 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:19.850 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:19.850 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2022-02-02 18:15:56.242076220 +0000 2022-02-02T18:16:19.850 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2022-02-02 18:10:44.420217439 +0000 2022-02-02T18:16:19.850 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2022-02-02 18:10:44.420217439 +0000 2022-02-02T18:16:19.851 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2022-02-02T18:16:19.859 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2022-02-02T18:16:19.860 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2022-02-02T18:16:19.860 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00019659 s, 2.6 MB/s 2022-02-02T18:16:19.863 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-02-02T18:16:19.918 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-02-02T18:16:19.919 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:19.919 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 148470 Links: 1 2022-02-02T18:16:19.919 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:19.919 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:19.920 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2022-02-02 18:15:56.242076220 +0000 2022-02-02T18:16:19.920 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2022-02-02 18:10:44.762209391 +0000 2022-02-02T18:16:19.920 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2022-02-02 18:10:44.762209391 +0000 2022-02-02T18:16:19.920 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2022-02-02T18:16:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2022-02-02T18:16:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2022-02-02T18:16:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000229067 s, 2.2 MB/s 2022-02-02T18:16:19.931 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-02-02T18:16:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-02-02T18:16:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:19.988 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 157937 Links: 1 2022-02-02T18:16:19.988 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:19.988 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:19.989 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2022-02-02 18:15:56.242076220 +0000 2022-02-02T18:16:19.989 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2022-02-02 18:10:45.104201344 +0000 2022-02-02T18:16:19.989 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2022-02-02 18:10:45.104201344 +0000 2022-02-02T18:16:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2022-02-02T18:16:19.998 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2022-02-02T18:16:19.998 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2022-02-02T18:16:19.998 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000188362 s, 2.7 MB/s 2022-02-02T18:16:20.001 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:16:20.001 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2022-02-02T18:16:20.018 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-02-02T18:16:20.018 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-02-02T18:16:20.074 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-02-02T18:16:20.074 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:20.074 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 152098 Links: 1 2022-02-02T18:16:20.074 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:20.075 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:20.075 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-02-02 18:16:15.727517931 +0000 2022-02-02T18:16:20.075 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-02-02 18:10:45.466484777 +0000 2022-02-02T18:16:20.075 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-02-02 18:10:45.466484777 +0000 2022-02-02T18:16:20.076 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-02-02T18:16:20.085 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-02-02T18:16:20.086 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-02-02T18:16:20.086 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.00023708 s, 2.2 MB/s 2022-02-02T18:16:20.089 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-02-02T18:16:20.145 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-02-02T18:16:20.145 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:20.146 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 156206 Links: 1 2022-02-02T18:16:20.146 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:20.146 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:20.146 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-02-02 18:16:15.727517931 +0000 2022-02-02T18:16:20.147 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-02-02 18:10:45.790483463 +0000 2022-02-02T18:16:20.147 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-02-02 18:10:45.790483463 +0000 2022-02-02T18:16:20.147 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-02-02T18:16:20.155 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-02-02T18:16:20.155 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-02-02T18:16:20.156 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000212708 s, 2.4 MB/s 2022-02-02T18:16:20.158 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-02-02T18:16:20.214 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-02-02T18:16:20.214 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 153293 Links: 1 2022-02-02T18:16:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-02-02 18:16:15.727517931 +0000 2022-02-02T18:16:20.216 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-02-02 18:10:46.144482028 +0000 2022-02-02T18:16:20.216 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-02-02 18:10:46.144482028 +0000 2022-02-02T18:16:20.216 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-02-02T18:16:20.224 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-02-02T18:16:20.224 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-02-02T18:16:20.224 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000189535 s, 2.7 MB/s 2022-02-02T18:16:20.227 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-02-02T18:16:20.281 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-02-02T18:16:20.282 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T18:16:20.282 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 152267 Links: 1 2022-02-02T18:16:20.282 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:16:20.282 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T18:16:20.283 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-02-02 18:16:15.727517931 +0000 2022-02-02T18:16:20.283 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-02-02 18:10:46.482480657 +0000 2022-02-02T18:16:20.283 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-02-02 18:10:46.482480657 +0000 2022-02-02T18:16:20.283 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-02-02T18:16:20.291 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-02-02T18:16:20.291 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-02-02T18:16:20.292 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000157315 s, 3.3 MB/s 2022-02-02T18:16:20.294 INFO:tasks.cephadm:Deploying osd.0 on smithi096 with /dev/vg_nvme/lv_4... 2022-02-02T18:16:20.295 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-02-02T18:16:21.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:21 smithi096 conmon[32067]: audit 2022-02-02T18:16:20.348472+0000 mon.smithi096 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:21.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:21 smithi096 conmon[32067]: cluster 2022-02-02T18:16:20.763202+0000 mgr.smithi096.shfutl (mgr.14162) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:21.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:21 smithi159 conmon[35668]: audit 2022-02-02T18:16:20.348472+0000 mon.smithi096 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:21.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:21 smithi159 conmon[35668]: cluster 2022-02-02T18:16:20.763202+0000 mgr.smithi096.shfutl (mgr.14162) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:22.542 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-02-02T18:16:22.542 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-02-02T18:16:22.543 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2022-02-02T18:16:22.543 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2022-02-02T18:16:22.543 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145102 s, 723 MB/s 2022-02-02T18:16:22.543 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2022-02-02T18:16:24.083 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:23 smithi096 conmon[32067]: cluster 2022-02-02T18:16:22.763469+0000 mgr.smithi096.shfutl (mgr.14162) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:24.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_4 2022-02-02T18:16:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:23 smithi159 conmon[35668]: cluster 2022-02-02T18:16:22.763469+0000 mgr.smithi096.shfutl (mgr.14162) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:25.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1283368733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f7980 msgr2=0x7f61f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:25.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1283368733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f7980 0x7f61f00f7de0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f61dc004660 tx=0x7f61dc009b30).stop 2022-02-02T18:16:25.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1283368733 shutdown_connections 2022-02-02T18:16:25.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1283368733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f7980 0x7f61f00f7de0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:25.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1283368733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f66e0 0x7f61f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:25.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.928+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1283368733 >> 172.21.15.96:0/1283368733 conn(0x7f61f00f1e40 msgr2=0x7f61f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:25.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.929+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1283368733 shutdown_connections 2022-02-02T18:16:25.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.929+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1283368733 wait complete. 2022-02-02T18:16:25.934 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: cluster 2022-02-02T18:16:24.763842+0000 mgr.smithi096.shfutl (mgr.14162) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:25.935 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: audit 2022-02-02T18:16:24.951687+0000 mon.smithi096 (mon.0) 192 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:25.935 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: audit 2022-02-02T18:16:25.567952+0000 mon.smithi096 (mon.0) 193 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:25.935 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: audit 2022-02-02T18:16:25.569743+0000 mon.smithi096 (mon.0) 194 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:16:25.935 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: audit 2022-02-02T18:16:25.570303+0000 mon.smithi096 (mon.0) 195 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:16:25.936 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:25 smithi096 conmon[32067]: audit 2022-02-02T18:16:25.570871+0000 mon.smithi096 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.929+0000 7f61f6f1a700 1 Processor -- start 2022-02-02T18:16:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.929+0000 7f61f6f1a700 1 -- start start 2022-02-02T18:16:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f6f1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f6f1a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f7980 0x7f61f0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f6f1a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0107a00 con 0x7f61f00f66e0 2022-02-02T18:16:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f6f1a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0107b40 con 0x7f61f00f7980 2022-02-02T18:16:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61effff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f7980 0x7f61f0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51654/0 (socket says 172.21.15.96:51654) 2022-02-02T18:16:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 -- 172.21.15.96:0/1416086668 learned_addr learned my addr 172.21.15.96:0/1416086668 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:16:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 -- 172.21.15.96:0/1416086668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f7980 msgr2=0x7f61f0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f7980 0x7f61f0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 -- 172.21.15.96:0/1416086668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc005040 con 0x7f61f00f66e0 2022-02-02T18:16:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.930+0000 7f61f4cb6700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f61e400c530 tx=0x7f61e4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.931+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e400f650 con 0x7f61f00f66e0 2022-02-02T18:16:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.931+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f61e400fc40 con 0x7f61f00f66e0 2022-02-02T18:16:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.931+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f01084e0 con 0x7f61f00f66e0 2022-02-02T18:16:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.931+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e4012c20 con 0x7f61f00f66e0 2022-02-02T18:16:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.931+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f0108aa0 con 0x7f61f00f66e0 2022-02-02T18:16:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.932+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0045ad0 con 0x7f61f00f66e0 2022-02-02T18:16:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.932+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f61e4019030 con 0x7f61f00f66e0 2022-02-02T18:16:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.932+0000 7f61ed7fa700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 0x7f61e005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.932+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f61e4074ac0 con 0x7f61f00f66e0 2022-02-02T18:16:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.932+0000 7f61effff700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 0x7f61e005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.933+0000 7f61effff700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 0x7f61e005e760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f61dc004e30 tx=0x7f61dc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:25.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:25.936+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f61e4048800 con 0x7f61f00f66e0 2022-02-02T18:16:26.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:26.126+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f61f0108d20 con 0x7f61e005c2a0 2022-02-02T18:16:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: cluster 2022-02-02T18:16:24.763842+0000 mgr.smithi096.shfutl (mgr.14162) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: audit 2022-02-02T18:16:24.951687+0000 mon.smithi096 (mon.0) 192 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: audit 2022-02-02T18:16:25.567952+0000 mon.smithi096 2022-02-02T18:16:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: (mon.0) 193 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:16:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: -02T18:16:25.569743+0000 mon.smithi096 (mon.0) 194 : audit [INF] 2022-02-02T18:16:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:16:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: audit 2022-02-02T18:16:25. 2022-02-02T18:16:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: 570303+0000 mon.smithi096 (mon.0) 195 : audit [DBG] 2022-02-02T18:16:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:16:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: audit 2022-02-02T18:16:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: 2022-02-02T18:16:25.570871+0000 mon.smithi096 (mon.0 2022-02-02T18:16:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:25 smithi159 conmon[35668]: ) 196 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:26.973 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:25.569543+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:16:26.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: 14162) 46 : cephadm [INF] Reconfiguring mon.smithi096 (unknown last config time)... 2022-02-02T18:16:26.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:25.571351+0000 mgr.smithi096.shfutl (mgr.14162) 47 : cephadm [INF] Reconfiguring daemon mon.smithi096 on smithi096 2022-02-02T18:16:26.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: audit 2022-02-02T18:16:26.128086+0000 mon.smithi096 (mon.0) 197 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:16:26.975 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: audit 2022-02-02T18:16:26.129510+0000 mon.smithi096 (mon.0) 198 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:16:26.975 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:26 smithi096 conmon[32067]: audit 2022-02-02T18:16:26.130088+0000 mon.smithi096 (mon.0) 199 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:25.569543+0000 2022-02-02T18:16:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 46 : cephadm [INF] Reconfiguring mon.smithi096 (unknown last config time)... 2022-02-02T18:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:25.571351+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: 47 : cephadm [INF] Reconfiguring daemon mon.smithi096 on smithi096 2022-02-02T18:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: audit 2022-02-02T18:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: 2022-02-02T18:16:26.128086+0000 mon.smithi096 (mon.0) 197 : audit 2022-02-02T18:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:16:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: audit 2022-02-02T18:16 2022-02-02T18:16:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: :26.129510+0000 mon.smithi096 (mon.0) 198 : audit 2022-02-02T18:16:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:16:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: audit 2022-02-02T18:16:26 2022-02-02T18:16:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: .130088+0000 mon.smithi096 (mon.0) 199 : audit [DBG] 2022-02-02T18:16:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:26 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: audit 2022-02-02T18:16:26.127333+0000 mgr.smithi096.shfutl (mgr.14162) 48 : audit [DBG] from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:16:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:26.129302+0000 mgr.smithi096.shfutl (mgr.14162) 49 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:16:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: cluster 2022-02-02T18:16:26.764272+0000 mgr.smithi096.shfutl (mgr.14162) 50 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: audit 2022-02-02T18:16:27.108294+0000 mon.smithi096 (mon.0) 200 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: audit 2022-02-02T18:16:27.108993+0000 mon.smithi096 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:16:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: audit 2022-02-02T18:16:27.109623+0000 mon.smithi096 (mon.0) 202 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:16:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:27 smithi096 conmon[32067]: audit 2022-02-02T18:16:27.110099+0000 mon.smithi096 (mon.0) 203 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: audit 2022-02-02T18:16:26.127333+0000 2022-02-02T18:16:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 48 : audit [DBG] from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:16:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:26.129302+0000 mgr.smithi096.shfutl ( 2022-02-02T18:16:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: mgr.14162) 49 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:16:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: cluster 2022-02-02T18:16:26.764272+0000 mgr.smithi096.shfutl ( 2022-02-02T18:16:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: mgr.14162) 50 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: audit 2022 2022-02-02T18:16:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: -02-02T18:16:27.108294+0000 mon.smithi096 (mon.0 2022-02-02T18:16:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: ) 200 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: audit 2022 2022-02-02T18:16:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: -02-02T18:16:27.108993+0000 mon.smithi096 (mon 2022-02-02T18:16:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: .0) 201 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:16:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:16:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: 16:27.109623+0000 mon.smithi096 (mon.0) 202 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:16:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:16:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: 02T18:16:27.110099+0000 mon.smithi096 (mon.0) 203 : audit 2022-02-02T18:16:28.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:27 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:29.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:27.108733+0000 mgr.smithi096.shfutl 2022-02-02T18:16:29.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: (mgr.14162) 51 : cephadm [INF] Reconfiguring mgr.smithi096.shfutl (unknown last config time)... 2022-02-02T18:16:29.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:27.110529+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:16:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: 52 : cephadm [INF] Reconfiguring daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:16:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: audit 2022 2022-02-02T18:16:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: -02-02T18:16:28.634406+0000 mon.smithi096 (mon.0) 204 : audit [INF] 2022-02-02T18:16:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:28 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:29.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:28 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:27. 2022-02-02T18:16:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:28 smithi096 conmon[32067]: 108733+0000 mgr.smithi096.shfutl (mgr.14162) 51 : cephadm [INF] Reconfiguring mgr.smithi096.shfutl (unknown last config time)... 2022-02-02T18:16:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:28 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:27.110529+0000 mgr.smithi096.shfutl (mgr.14162) 52 : cephadm [INF] Reconfiguring daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:16:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:28 smithi096 conmon[32067]: audit 2022-02-02T18:16:28.634406+0000 mon.smithi096 (mon.0) 204 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:30.084 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:28.635138+0000 mgr.smithi096.shfutl 2022-02-02T18:16:30.085 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: (mgr.14162) 53 : cephadm [INF] Reconfiguring alertmanager.smithi096 (dependencies changed)... 2022-02-02T18:16:30.085 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:28.637662+0000 mgr.smithi096.shfutl (mgr.14162) 54 : cephadm [INF] Reconfiguring daemon alertmanager.smithi096 on smithi096 2022-02-02T18:16:30.085 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: cluster 2022-02-02T18:16:28.764553+0000 mgr.smithi096.shfutl (mgr.14162) 55 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:30.085 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: audit 2022-02-02T18:16:29.669169+0000 mon.smithi096 (mon.0) 205 : audit [INF] from='client.? 172.21.15.96:0/622775866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d7ab242-00e2-4b8d-a7be-0bf62b292a6d"}]: dispatch 2022-02-02T18:16:30.086 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: audit 2022-02-02T18:16:29.672512+0000 mon.smithi096 (mon.0) 206 : audit [INF] from='client.? 172.21.15.96:0/622775866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d7ab242-00e2-4b8d-a7be-0bf62b292a6d"}]': finished 2022-02-02T18:16:30.086 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: cluster 2022-02-02T18:16:29.672586+0000 mon.smithi096 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-02-02T18:16:30.086 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:29 smithi096 conmon[32067]: audit 2022-02-02T18:16:29.672723+0000 mon.smithi096 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:28.635138+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:16:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: ) 53 : cephadm [INF] Reconfiguring alertmanager.smithi096 (dependencies changed)... 2022-02-02T18:16:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:28.637662+0000 mgr.smithi096.shfutl (mgr.14162) 54 : cephadm [INF] 2022-02-02T18:16:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: Reconfiguring daemon alertmanager.smithi096 on smithi096 2022-02-02T18:16:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: cluster 2022-02-02T18 2022-02-02T18:16:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: :16:28.764553+0000 mgr.smithi096.shfutl (mgr.14162) 55 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:16:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: -02T18:16:29.669169+0000 mon.smithi096 (mon. 2022-02-02T18:16:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: 0) 205 : audit [INF] from='client.? 172.21.15.96:0/622775866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d7ab242-00e2-4b8d-a7be-0bf62b292a6d"}]: dispatch 2022-02-02T18:16:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: audit 2022-02-02T18:16 2022-02-02T18:16:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: :29.672512+0000 mon.smithi096 (mon.0) 206 : audit [INF] from='client.? 172.21.15.96:0/622775866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d7ab242-00e2-4b8d-a7be-0bf62b292a6d"}]': finished 2022-02-02T18:16:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: cluster 2022-02-02T18:16:29. 2022-02-02T18:16:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: 672586+0000 mon.smithi096 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-02-02T18:16:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:16:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: T18:16:29.672723+0000 mon.smithi096 (mon.0) 208 : 2022-02-02T18:16:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:29 smithi159 conmon[35668]: audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:30 smithi159 conmon[35668]: audit 2022-02-02T18:16:30.081770+0000 mon.smithi096 (mon.0) 2022-02-02T18:16:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:30 smithi159 conmon[35668]: 209 : audit [DBG] from='client.? 172.21.15.96:0/4013785786' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:16:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:30 smithi096 conmon[32067]: audit 2022-02-02T18:16:30.081770+0000 mon.smithi096 (mon.0) 209 : audit [DBG] from='client.? 172.21.15.96:0/4013785786' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:16:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:31 smithi159 conmon[35668]: cluster 2022-02-02T18:16:30.764882+0000 mgr.smithi096.shfutl (mgr.14162) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:31 smithi096 conmon[32067]: cluster 2022-02-02T18:16:30.764882+0000 mgr.smithi096.shfutl (mgr.14162) 56 : 2022-02-02T18:16:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:31 smithi096 conmon[32067]: cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:34.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:33 smithi096 conmon[32067]: cluster 2022-02-02T18:16:32.765296+0000 mgr.smithi096.shfutl (mgr.14162) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:33 smithi159 conmon[35668]: cluster 2022-02-02T18:16:32.765296+0000 mgr.smithi096.shfutl (mgr.14162) 57 : cluster 2022-02-02T18:16:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:33 smithi159 conmon[35668]: [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:35 smithi159 conmon[35668]: cluster 2022-02-02T18:16:34.765770+0000 mgr.smithi096.shfutl (mgr.14162) 58 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:35 smithi096 conmon[32067]: cluster 2022-02-02T18:16:34.765770+0000 mgr.smithi096.shfutl (mgr.14162) 58 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:37.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: cluster 2022-02-02T18:16:36.766089+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:16:37.970 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: 14162) 59 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:37.970 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: audit 2022-02-02T18:16:37.827790+0000 mon.smithi096 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:37.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: audit 2022-02-02T18:16 2022-02-02T18:16:37.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: :37.828590+0000 mon.smithi096 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:16:37.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:16:37.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: 02T18:16:37.829232+0000 mon.smithi096 (mon.0) 212 : 2022-02-02T18:16:37.972 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:37 smithi096 conmon[32067]: audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: cluster 2022-02-02T18:16:36.766089+0000 mgr.smithi096.shfutl (mgr.14162) 59 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:16:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: 16:37.827790+0000 mon.smithi096 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: audit 2022-02-02T18:16:37.828590+0000 mon.smithi096 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:16:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:16:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:37 smithi159 conmon[35668]: 18:16:37.829232+0000 mon.smithi096 (mon.0) 212 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:38 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:37.828315+0000 mgr.smithi096.shfutl (mgr.14162) 60 : cephadm [INF] Reconfiguring crash.smithi096 (monmap changed)... 2022-02-02T18:16:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:38 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:37.829829+0000 mgr.smithi096.shfutl (mgr.14162) 61 : cephadm [INF] Reconfiguring daemon crash.smithi096 on smithi096 2022-02-02T18:16:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:38 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:37.828315+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:38 smithi096 conmon[32067]: .14162) 60 : cephadm [INF] Reconfiguring crash.smithi096 (monmap changed)... 2022-02-02T18:16:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:38 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:37.829829+0000 mgr.smithi096.shfutl (mgr.14162) 61 : cephadm [INF] Reconfiguring daemon crash.smithi096 on smithi096 2022-02-02T18:16:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: cluster 2022-02-02T18:16:38.766532+0000 mgr.smithi096.shfutl (mgr.14162) 62 : 2022-02-02T18:16:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: audit 2022-02-02T18:16:38.990669+0000 mon.smithi096 (mon.0) 213 : audit [INF] 2022-02-02T18:16:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-02-02T18:16:40.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: audit 2022-02-02T18:16:38.991254 2022-02-02T18:16:40.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:39 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 214 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:39 smithi159 conmon[35668]: cluster 2022-02-02T18:16:38.766532+0000 mgr.smithi096.shfutl (mgr.14162) 62 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:39 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:16:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:39 smithi159 conmon[35668]: 02T18:16:38.990669+0000 mon.smithi096 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-02-02T18:16:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:39 smithi159 conmon[35668]: audit 2022-02-02T18:16:38.991254+0000 mon.smithi096 (mon.0) 214 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:41.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:40 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:38.991724+0000 mgr.smithi096.shfutl (mgr.14162) 63 : cephadm [INF] Deploying daemon osd.0 on smithi096 2022-02-02T18:16:41.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:40 smithi096 conmon[32067]: audit 2022-02-02T18:16:40.175037+0000 mon.smithi096 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:40 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:38.991724+0000 mgr.smithi096.shfutl (mgr.14162) 63 : cephadm [INF] Deploying daemon osd.0 on smithi096 2022-02-02T18:16:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:40 smithi159 conmon[35668]: audit 2022-02-02T18:16:40.175037+0000 mon.smithi096 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:41 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:40.175545+0000 mgr.smithi096.shfutl (mgr.14162) 64 : cephadm [INF] Reconfiguring grafana.smithi096 (dependencies changed)... 2022-02-02T18:16:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:41 smithi096 conmon[32067]: cephadm 2022 2022-02-02T18:16:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:41 smithi096 conmon[32067]: -02-02T18:16:40.179531+0000 mgr.smithi096.shfutl (mgr.14162) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi096 on smithi096 2022-02-02T18:16:42.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:41 smithi096 conmon[32067]: cluster 2022-02-02T18:16:40.766879+0000 mgr.smithi096.shfutl (mgr.14162) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:41 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:40.175545+0000 mgr.smithi096.shfutl (mgr.14162) 64 : cephadm [INF] Reconfiguring grafana.smithi096 (dependencies changed)... 2022-02-02T18:16:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:41 smithi159 conmon[35668]: cephadm 2022-02- 2022-02-02T18:16:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:41 smithi159 conmon[35668]: 02T18:16:40.179531+0000 mgr.smithi096.shfutl (mgr.14162) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi096 on smithi096 2022-02-02T18:16:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:41 smithi159 conmon[35668]: cluster 2022-02-02T18:16:40.766879+0000 mgr.smithi096.shfutl (mgr.14162) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:43.219 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 0 on host 'smithi096' 2022-02-02T18:16:43.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.215+0000 7f61ed7fa700 1 -- 172.21.15.96:0/1416086668 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f61f0108d20 con 0x7f61e005c2a0 2022-02-02T18:16:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 msgr2=0x7f61e005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 0x7f61e005e760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f61dc004e30 tx=0x7f61dc009b30).stop 2022-02-02T18:16:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 msgr2=0x7f61f0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f61e400c530 tx=0x7f61e4007e10).stop 2022-02-02T18:16:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 shutdown_connections 2022-02-02T18:16:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f61e005c2a0 0x7f61e005e760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f66e0 0x7f61f0106f60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 --2- 172.21.15.96:0/1416086668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f7980 0x7f61f0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 >> 172.21.15.96:0/1416086668 conn(0x7f61f00f1e40 msgr2=0x7f61f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 shutdown_connections 2022-02-02T18:16:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:43.218+0000 7f61f6f1a700 1 -- 172.21.15.96:0/1416086668 wait complete. 2022-02-02T18:16:43.648 DEBUG:teuthology.orchestra.run.smithi096:osd.0> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.0.service 2022-02-02T18:16:43.651 INFO:tasks.cephadm:Deploying osd.1 on smithi096 with /dev/vg_nvme/lv_3... 2022-02-02T18:16:43.652 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-02-02T18:16:43.680 INFO:journalctl@ceph.osd.0.smithi096.stdout:-- Logs begin at Wed 2022-02-02 18:05:35 UTC. -- 2022-02-02T18:16:44.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:43 smithi096 conmon[32067]: cluster 2022-02-02T18:16:42.767160+0000 mgr.smithi096.shfutl (mgr.14162) 67 : cluster [DBG] 2022-02-02T18:16:44.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:43 smithi096 conmon[32067]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:44.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:43 smithi096 conmon[32067]: audit 2022-02-02T18:16:43.210408+0000 mon.smithi096 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:44.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:43 smithi096 conmon[32067]: audit 2022-02-02T18:16:43.215085+0000 mon.smithi096 (mon.0) 217 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:43 smithi159 conmon[35668]: cluster 2022-02-02T18:16:42.767160+0000 mgr.smithi096.shfutl (mgr.14162) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:43 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:16:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:43 smithi159 conmon[35668]: 16:43.210408+0000 mon.smithi096 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:43 smithi159 conmon[35668]: audit 2022-02-02T18:16:43.215085+0000 mon.smithi096 (mon.0) 217 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:46.215 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:45 smithi096 conmon[32067]: cluster 2022-02-02T18:16:44.767423+0000 mgr.smithi096.shfutl 2022-02-02T18:16:46.215 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:45 smithi096 conmon[32067]: (mgr.14162) 68 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:45 smithi159 conmon[35668]: cluster 2022-02-02T18:16:44.767423+0000 mgr.smithi096.shfutl (mgr.14162) 68 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:46.457 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-02-02T18:16:46.457 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-02-02T18:16:46.457 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2022-02-02T18:16:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2022-02-02T18:16:46.458 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120377 s, 871 MB/s 2022-02-02T18:16:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2022-02-02T18:16:46.918 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_3 2022-02-02T18:16:47.442 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:16:47 smithi096 conmon[49697]: debug 2022-02-02T18:16:47.132+0000 7f32e843f080 -1 osd.0 0 log_to_monitors {default=true} 2022-02-02T18:16:48.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:47 smithi096 conmon[32067]: cluster 2022-02-02T18:16:46.767804+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:16:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:47 smithi096 conmon[32067]: .14162) 69 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:47 smithi096 conmon[32067]: audit 2022-02-02T18:16:47.137730+0000 mon.smithi096 (mon.0) 218 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T18:16:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:47 smithi096 conmon[32067]: audit 2022-02-02T18:16:47.466243+0000 mon.smithi096 (mon.0) 219 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:48.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:47 smithi159 conmon[35668]: cluster 2022-02-02T18:16:46.767804+0000 mgr.smithi096.shfutl (mgr.14162) 69 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:48.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:47 smithi159 conmon[35668]: audit 2022-02-02T18:16:47.137730+0000 mon.smithi096 (mon.0) 218 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T18:16:48.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:47 smithi159 conmon[35668]: audit 2022-02-02T18:16:47.466243+0000 mon.smithi096 (mon.0 2022-02-02T18:16:48.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:47 smithi159 conmon[35668]: ) 219 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:48.981 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[49697]: debug 2022-02-02T18:16:48.871+0000 7f32de9b0700 -1 osd.0 0 waiting for initial osdmap 2022-02-02T18:16:48.981 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[49697]: debug 2022-02-02T18:16:48.875+0000 7f32d7124700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:16:48.982 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:47.466823+0000 mgr.smithi096.shfutl ( 2022-02-02T18:16:48.982 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: mgr.14162) 70 : cephadm [INF] Reconfiguring prometheus.smithi096 (dependencies changed)... 2022-02-02T18:16:48.982 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:47.468714+0000 mgr.smithi096.shfutl (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon prometheus.smithi096 on smithi096 2022-02-02T18:16:48.983 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: audit 2022-02-02T18:16:47.869072+0000 mon.smithi096 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T18:16:48.983 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: cluster 2022-02-02T18:16:47.869130 2022-02-02T18:16:48.983 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 221 : cluster [DBG] 2022-02-02T18:16:48.983 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: osdmap e7: 1 total, 0 up, 1 in 2022-02-02T18:16:48.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:16:48.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: 18:16:47.869443+0000 mon.smithi096 (mon. 2022-02-02T18:16:48.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: 0) 222 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:48.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: audit 2022-02-02T18:16:48.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: 2022-02-02T18:16: 2022-02-02T18:16:48.985 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: 47.869768+0000 mon.smithi096 (mon.0) 223 2022-02-02T18:16:48.985 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:48 smithi096 conmon[32067]: : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:16:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.267+0000 7f4758980700 1 -- 172.21.15.96:0/1641245502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f6860 msgr2=0x7f47540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.267+0000 7f4758980700 1 --2- 172.21.15.96:0/1641245502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f6860 0x7f47540f6cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f4744004660 tx=0x7f4744009b30).stop 2022-02-02T18:16:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- 172.21.15.96:0/1641245502 shutdown_connections 2022-02-02T18:16:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 --2- 172.21.15.96:0/1641245502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f6860 0x7f47540f6cc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 --2- 172.21.15.96:0/1641245502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f55c0 0x7f47540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- 172.21.15.96:0/1641245502 >> 172.21.15.96:0/1641245502 conn(0x7f47540f0d40 msgr2=0x7f47540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:16:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- 172.21.15.96:0/1641245502 shutdown_connections 2022-02-02T18:16:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- 172.21.15.96:0/1641245502 wait complete. 2022-02-02T18:16:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 Processor -- start 2022-02-02T18:16:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- start start 2022-02-02T18:16:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f6860 0x7f47541063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541069b0 con 0x7f47540f55c0 2022-02-02T18:16:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f4758980700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541071c0 con 0x7f47540f6860 2022-02-02T18:16:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.268+0000 7f475259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51698/0 (socket says 172.21.15.96:51698) 2022-02-02T18:16:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 -- 172.21.15.96:0/3354009640 learned_addr learned my addr 172.21.15.96:0/3354009640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:16:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4751d9b700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f6860 0x7f47541063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 -- 172.21.15.96:0/3354009640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f6860 msgr2=0x7f47541063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:16:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f6860 0x7f47541063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:16:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 -- 172.21.15.96:0/3354009640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744005040 con 0x7f47540f55c0 2022-02-02T18:16:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f475259c700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f474800c530 tx=0x7f4748007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474800f650 con 0x7f47540f55c0 2022-02-02T18:16:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f474800fc40 con 0x7f47540f55c0 2022-02-02T18:16:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4754107440 con 0x7f47540f55c0 2022-02-02T18:16:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4748012c20 con 0x7f47540f55c0 2022-02-02T18:16:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.269+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4754107a00 con 0x7f47540f55c0 2022-02-02T18:16:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.270+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47540f49b0 con 0x7f47540f55c0 2022-02-02T18:16:49.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:47.466823+0000 mgr.smithi096.shfutl (mgr.14162) 70 : cephadm 2022-02-02T18:16:49.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: [INF] Reconfiguring prometheus.smithi096 (dependencies changed)... 2022-02-02T18:16:49.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:47.468714+0000 mgr.smithi096.shfutl (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon prometheus.smithi096 on smithi096 2022-02-02T18:16:49.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: audit 2022-02-02T18:16:47.869072+0000 mon.smithi096 (mon 2022-02-02T18:16:49.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: .0) 220 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T18:16:49.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: cluster 2022-02-02T18:16 2022-02-02T18:16:49.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: :47.869130+0000 mon.smithi096 (mon.0) 221 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-02-02T18:16:49.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:16:49.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: -02T18:16:47.869443+0000 mon.smithi096 ( 2022-02-02T18:16:49.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: mon.0) 222 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:49.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:16:49.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: 02T18:16:47.869768+0000 mon.smithi096 (mon 2022-02-02T18:16:49.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:48 smithi159 conmon[35668]: .0) 223 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:16:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.270+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4748019030 con 0x7f47540f55c0 2022-02-02T18:16:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.271+0000 7f4742ffd700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 0x7f473c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:16:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.271+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1569+0+0 (secure 0 0 0) 0x7f4748074c20 con 0x7f47540f55c0 2022-02-02T18:16:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.271+0000 7f4751d9b700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 0x7f473c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:16:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.271+0000 7f4751d9b700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 0x7f473c05e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4744005010 tx=0x7f4744009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:16:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.275+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4748048810 con 0x7f47540f55c0 2022-02-02T18:16:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:16:49.458+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f47540ff800 con 0x7f473c05c2b0 2022-02-02T18:16:50.184 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: cluster 2022-02-02T18:16:48.768294+0000 mgr.smithi096.shfutl ( 2022-02-02T18:16:50.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: mgr.14162) 72 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:50.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:48.870341+0000 mon.smithi096 (mon.0) 224 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:16:50.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: cluster 2022-02-02T18:16:48.870398+0000 mon.smithi096 (mon.0) 225 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-02-02T18:16:50.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:48.870523+0000 mon.smithi096 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:50.187 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:48.873638+0000 mon.smithi096 (mon.0) 227 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:50.187 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:49.462046+0000 mon.smithi096 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:16:50.188 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:49.463808+0000 mon.smithi096 (mon.0) 229 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:16:50.188 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:49.464402+0000 mon.smithi096 (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:50.188 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:49 smithi096 conmon[32067]: audit 2022-02-02T18:16:49.873404+0000 mon.smithi096 (mon.0) 231 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: cluster 2022-02-02T18:16:48.768294+0000 mgr.smithi096.shfutl (mgr.14162) 72 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:16:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 18:16:48.870341+0000 mon.smithi096 (mon.0) 224 : audit [INF] from='osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:16:50.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: cluster 2022-02-02T18:16:48.870398+0000 mon.smithi096 (mon.0) 225 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-02-02T18:16:50.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:16:50.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: :16:48.870523+0000 mon.smithi096 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:50.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022-02-02T18:16:48.873638 2022-02-02T18:16:50.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 227 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:50.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 2022-02-02T18:16:50.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022-02-02T18:16:50.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 2022-02-02T18:16:49.462046+0000 mon.smithi096 (mon.0 2022-02-02T18:16:50.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: ) 228 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:16:50.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:16:50.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 18:16:49.463808+0000 mon.smithi096 (mon.0 2022-02-02T18:16:50.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: ) 229 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:16:50.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:16:50.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 02-02T18:16:49.464402+0000 mon.smithi096 2022-02-02T18:16:50.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:50.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:16:50.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: 02-02T18:16:49.873404+0000 mon.smithi096 ( 2022-02-02T18:16:50.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:49 smithi159 conmon[35668]: mon.0) 231 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: cluster 2022-02-02T18:16:48.144123+0000 osd.0 (osd.0 2022-02-02T18:16:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: ) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:16:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: cluster 2022-02-02T18:16:48.144333+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:16:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: audit 2022-02-02T18:16:49.460805+0000 mgr.smithi096.shfutl (mgr.14162) 73 : audit [DBG] from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:16:51.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:49.463577+0000 mgr.smithi096.shfutl (mgr.14162) 74 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:16:51.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: cluster 2022-02-02T18: 2022-02-02T18:16:51.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: 16:49.887747+0000 mon.smithi096 (mon.0) 232 : cluster [INF] osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] boot 2022-02-02T18:16:51.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: cluster 2022-02-02T18:16:49.887773+0000 mon.smithi096 (mon.0) 233 : cluster [DBG] 2022-02-02T18:16:51.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: osdmap e9: 1 total, 1 up, 1 in 2022-02-02T18:16:51.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: audit 2022-02-02T18:16 2022-02-02T18:16:51.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:50 smithi096 conmon[32067]: :49.888915+0000 mon.smithi096 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:51.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: cluster 2022-02-02T18:16:48.144123+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:16:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: cluster 2022-02-02T18 2022-02-02T18:16:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: :16:48.144333+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:16:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: audit 2022-02-02T18:16:49.460805+0000 mgr.smithi096.shfutl (mgr.14162) 73 : audit [DBG] from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:16:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: cephadm 2022-02-02 2022-02-02T18:16:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: T18:16:49.463577+0000 mgr.smithi096.shfutl (mgr.14162) 74 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:16:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: cluster 2022-02-02T18:16: 2022-02-02T18:16:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: 49.887747+0000 mon.smithi096 (mon.0) 232 : cluster 2022-02-02T18:16:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: [INF] osd.0 [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] boot 2022-02-02T18:16:51.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: cluster 2022-02-02T18:16:49. 2022-02-02T18:16:51.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: 887773+0000 mon.smithi096 (mon.0) 233 : cluster [DBG] 2022-02-02T18:16:51.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: osdmap e9: 1 total, 1 up, 1 in 2022-02-02T18:16:51.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: audit 2022-02-02T18:16:51.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: 2022-02-02T18:16:49.888915+0000 mon.smithi096 (mon. 2022-02-02T18:16:51.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:50 smithi159 conmon[35668]: 0) 234 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:16:52.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:51 smithi096 conmon[32067]: cluster 2022-02-02T18:16:50.768632+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:16:52.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:51 smithi096 conmon[32067]: ) 75 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:52.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:51 smithi096 conmon[32067]: cluster 2022-02-02T18:16:50.896521+0000 mon.smithi096 (mon.0) 235 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-02-02T18:16:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:51 smithi159 conmon[35668]: cluster 2022-02-02T18:16:50.768632+0000 mgr.smithi096.shfutl (mgr.14162) 75 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T18:16:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:51 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:16:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:51 smithi159 conmon[35668]: 02-02T18:16:50.896521+0000 mon.smithi096 (mon.0) 235 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-02-02T18:16:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:52.225072+0000 mon.smithi096 (mon.0) 2022-02-02T18:16:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: 236 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:52.225522+0000 mgr.smithi096.shfutl (mgr.14162) 76 : cephadm [INF] Reconfiguring crash.smithi159 (monmap changed)... 2022-02-02T18:16:53.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:52.225750+0000 mon.smithi096 (mon.0) 237 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:16:53.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:52.226331+0000 mon.smithi096 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:53.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:52.226743+0000 mgr.smithi096.shfutl (mgr.14162) 77 : cephadm [INF] Reconfiguring daemon crash.smithi159 on smithi159 2022-02-02T18:16:53.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: cluster 2022-02-02T18:16:52.768881+0000 mgr.smithi096.shfutl (mgr.14162) 78 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:16:53.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.203901+0000 mon.smithi096 (mon.0) 239 : audit [INF] from='client.? 172.21.15.96:0/492811055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dec772e4-b9e6-4351-a19d-64fdd5df9e1a"}]: dispatch 2022-02-02T18:16:53.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.207191+0000 mon.smithi096 (mon.0) 240 : audit [INF] from='client.? 172.21.15.96:0/492811055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dec772e4-b9e6-4351-a19d-64fdd5df9e1a"}]': finished 2022-02-02T18:16:53.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: cluster 2022-02-02T18:16:53.207233+0000 mon.smithi096 (mon.0) 241 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-02-02T18:16:53.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:53 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.207328+0000 mon.smithi096 (mon.0) 242 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:16:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:52.225072+0000 mon.smithi096 (mon.0) 236 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:52.225522+0000 mgr.smithi096.shfutl (mgr.14162) 76 : cephadm [INF] Reconfiguring crash.smithi159 (monmap changed)... 2022-02-02T18:16:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:52.225750+0000 mon.smithi096 (mon.0) 237 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:16:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:52.226331+0000 mon.smithi096 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:52.226743+0000 mgr.smithi096.shfutl (mgr.14162) 77 : cephadm [INF] Reconfiguring daemon crash.smithi159 on smithi159 2022-02-02T18:16:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: cluster 2022-02-02T18:16:52.768881+0000 mgr.smithi096.shfutl (mgr.14162) 78 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:16:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.203901+0000 mon.smithi096 (mon.0) 239 : audit [INF] from='client.? 172.21.15.96:0/492811055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dec772e4-b9e6-4351-a19d-64fdd5df9e1a"}]: dispatch 2022-02-02T18:16:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.207191+0000 mon.smithi096 (mon.0) 240 : audit [INF] from='client.? 172.21.15.96:0/492811055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dec772e4-b9e6-4351-a19d-64fdd5df9e1a"}]': finished 2022-02-02T18:16:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: cluster 2022-02-02T18:16:53.207233+0000 mon.smithi096 (mon.0) 241 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-02-02T18:16:53.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:53 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.207328+0000 mon.smithi096 (mon.0) 242 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:16:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.403476+0000 mon.smithi096 (mon.0) 243 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:53.404002+0000 mgr.smithi096.shfutl (mgr.14162) 79 : cephadm [INF] Reconfiguring mgr.smithi159.jrxkfz (monmap changed)... 2022-02-02T18:16:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.404260+0000 mon.smithi096 (mon.0) 244 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:16:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.404983+0000 mon.smithi096 (mon.0) 245 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:16:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.405555+0000 mon.smithi096 (mon.0) 246 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:53.406067+0000 mgr.smithi096.shfutl (mgr.14162) 80 : cephadm [INF] Reconfiguring daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:16:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:54 smithi159 conmon[35668]: audit 2022-02-02T18:16:53.619778+0000 mon.smithi096 (mon.0) 247 : audit [DBG] from='client.? 172.21.15.96:0/2878311494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:16:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.403476+0000 mon.smithi096 (mon.0) 243 2022-02-02T18:16:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:53.404002+0000 mgr.smithi096.shfutl (mgr.14162) 79 : cephadm [INF] Reconfiguring mgr.smithi159.jrxkfz (monmap changed)... 2022-02-02T18:16:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.404260+0000 mon.smithi096 (mon.0) 244 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:16:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.404983+0000 mon.smithi096 (mon.0) 245 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:16:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.405555+0000 mon.smithi096 (mon.0) 246 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:53.406067+0000 mgr.smithi096.shfutl (mgr.14162) 80 : cephadm [INF] Reconfiguring daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:16:54.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:54 smithi096 conmon[32067]: audit 2022-02-02T18:16:53.619778+0000 mon.smithi096 (mon.0) 247 : audit [DBG] from='client.? 172.21.15.96:0/2878311494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:16:56.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: audit 2022-02-02T18:16:54.680092+0000 mon.smithi096 (mon.0) 248 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:54.680569+0000 mgr.smithi096.shfutl (mgr.14162) 81 : cephadm [INF] Reconfiguring mon.smithi159 (monmap changed)... 2022-02-02T18:16:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: audit 2022-02-02T18:16:54.680845+0000 mon.smithi096 (mon.0) 249 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:16:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: audit 2022-02-02T18:16:54.681490+0000 mon.smithi096 (mon.0) 250 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:16:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: audit 2022-02-02T18:16:54.682099+0000 mon.smithi096 (mon.0) 251 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: cephadm 2022-02-02T18 2022-02-02T18:16:56.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: :16:54.682619+0000 mgr.smithi096.shfutl (mgr.14162) 82 : cephadm [INF] Reconfiguring daemon mon.smithi159 on smithi159 2022-02-02T18:16:56.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: cluster 2022-02-02T 2022-02-02T18:16:56.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: 18:16:54.769291+0000 mgr.smithi096.shfutl (mgr.14162) 83 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:16:56.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:55 smithi159 conmon[35668]: 2022-02-02T18:16:56.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: audit 2022-02-02T18:16:54.680092+0000 mon.smithi096 (mon.0) 248 2022-02-02T18:16:56.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:56.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:54.680569+0000 mgr.smithi096.shfutl (mgr.14162) 81 : cephadm [INF] Reconfiguring mon.smithi159 (monmap changed)... 2022-02-02T18:16:56.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: audit 2022-02-02T18:16:54.680845+0000 mon.smithi096 (mon.0) 249 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:16:56.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: 2022-02-02T18:16:56.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: audit 2022-02-02T18:16:54.681490 2022-02-02T18:16:56.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 250 : audit [DBG] 2022-02-02T18:16:56.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:16:56.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: audit 2022-02-02T18:16:54.682099+0000 2022-02-02T18:16:56.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: mon.smithi096 (mon.0) 251 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:16:56.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: 2022-02-02T18:16:56.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:54. 2022-02-02T18:16:56.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: 682619+0000 mgr.smithi096.shfutl (mgr.14162) 82 : cephadm [INF] 2022-02-02T18:16:56.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: Reconfiguring daemon mon.smithi159 on smithi159 2022-02-02T18:16:56.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: cluster 2022-02-02T18:16: 2022-02-02T18:16:56.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: 54.769291+0000 mgr.smithi096.shfutl (mgr.14162) 83 : cluster 2022-02-02T18:16:56.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:55 smithi096 conmon[32067]: [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:16:57.121 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: audit 2022-02-02T18:16:55.851227+0000 mon.smithi096 (mon.0) 252 : audit 2022-02-02T18:16:57.121 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:57.121 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: audit 2022-02-02T18:16:55.853699+0000 mon.smithi096 (mon.0) 2022-02-02T18:16:57.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: 253 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T18:16:57.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: audit 2022-02-02T18:16:55. 2022-02-02T18:16:57.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: 854027+0000 mgr.smithi096.shfutl (mgr.14162) 84 : audit [DBG] 2022-02-02T18:16:57.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:56 smithi096 conmon[32067]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T18:16:57.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:56 smithi159 conmon[35668]: audit 2022-02-02T18:16:55.851227+0000 mon.smithi096 (mon.0) 252 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:16:57.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:56 smithi159 conmon[35668]: 2022-02-02T18:16:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:56 smithi159 conmon[35668]: audit 2022-02-02T18:16:55.853699+0000 mon.smithi096 (mon.0) 253 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T18:16:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:56 smithi159 conmon[35668]: audit 2022-02-02T18:16:55.854027+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:16:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:56 smithi159 conmon[35668]: 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T18:16:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:57 smithi096 conmon[32067]: cluster 2022-02-02T18:16:56.769779+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:16:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:57 smithi096 conmon[32067]: 14162) 85 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:16:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:57 smithi159 conmon[35668]: cluster 2022-02-02T18:16:56.769779+0000 2022-02-02T18:16:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:57 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 85 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:59 smithi096 conmon[32067]: cluster 2022-02-02T18:16:58.770099+0000 mgr.smithi096.shfutl (mgr.14162) 86 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:00.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:59 smithi096 conmon[32067]: audit 2022-02-02T18:16:59.730831+0000 mon.smithi096 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-02-02T18:17:00.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:16:59 smithi096 conmon[32067]: audit 2022-02-02T18:16:59.731392+0000 mon.smithi096 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:59 smithi159 conmon[35668]: cluster 2022-02-02T18:16:58.770099+0000 mgr.smithi096.shfutl (mgr.14162) 86 : cluster [DBG] 2022-02-02T18:17:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:59 smithi159 conmon[35668]: pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:59 smithi159 conmon[35668]: audit 2022-02-02T18:16:59.730831+0000 mon.smithi096 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-02-02T18:17:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:16:59 smithi159 conmon[35668]: audit 2022-02-02T18:16:59.731392+0000 mon.smithi096 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:01.131 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:00 smithi096 conmon[32067]: cephadm 2022-02-02T18:16:59.731830+0000 mgr.smithi096.shfutl (mgr.14162) 87 : cephadm 2022-02-02T18:17:01.132 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:00 smithi096 conmon[32067]: [INF] Deploying daemon osd.1 on smithi096 2022-02-02T18:17:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:00 smithi159 conmon[35668]: cephadm 2022-02-02T18:16:59.731830+0000 mgr.smithi096.shfutl 2022-02-02T18:17:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:00 smithi159 conmon[35668]: (mgr.14162) 87 : cephadm [INF] Deploying daemon osd.1 on smithi096 2022-02-02T18:17:02.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:01 smithi096 conmon[32067]: cluster 2022-02-02T18:17:00.770540+0000 mgr.smithi096.shfutl (mgr.14162) 88 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:01 smithi159 conmon[35668]: cluster 2022-02-02T18:17:00.770540+0000 mgr.smithi096.shfutl ( 2022-02-02T18:17:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:01 smithi159 conmon[35668]: mgr.14162) 88 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:03.048 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 1 on host 'smithi096' 2022-02-02T18:17:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.043+0000 7f4742ffd700 1 -- 172.21.15.96:0/3354009640 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f47540ff800 con 0x7f473c05c2b0 2022-02-02T18:17:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 msgr2=0x7f473c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 0x7f473c05e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4744005010 tx=0x7f4744009b30).stop 2022-02-02T18:17:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 msgr2=0x7f4754105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f474800c530 tx=0x7f4748007e10).stop 2022-02-02T18:17:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 shutdown_connections 2022-02-02T18:17:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f473c05c2b0 0x7f473c05e770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47540f55c0 0x7f4754105ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 --2- 172.21.15.96:0/3354009640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47540f6860 0x7f47541063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 >> 172.21.15.96:0/3354009640 conn(0x7f47540f0d40 msgr2=0x7f47540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 shutdown_connections 2022-02-02T18:17:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:03.046+0000 7f4758980700 1 -- 172.21.15.96:0/3354009640 wait complete. 2022-02-02T18:17:03.480 DEBUG:teuthology.orchestra.run.smithi096:osd.1> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.1.service 2022-02-02T18:17:03.482 INFO:tasks.cephadm:Deploying osd.2 on smithi096 with /dev/vg_nvme/lv_2... 2022-02-02T18:17:03.483 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-02-02T18:17:03.512 INFO:journalctl@ceph.osd.1.smithi096.stdout:-- Logs begin at Wed 2022-02-02 18:05:35 UTC. -- 2022-02-02T18:17:04.232 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: cluster 2022-02-02T18:17:02.770974+0000 mgr.smithi096.shfutl 2022-02-02T18:17:04.232 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: (mgr.14162) 89 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:04.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.040273+0000 mon.smithi096 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.043866+0000 mon.smithi096 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.054741+0000 mon.smithi096 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.96:9093"}]: dispatch 2022-02-02T18:17:04.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.059517+0000 mon.smithi096 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.062783+0000 mon.smithi096 (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T18:17:04.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.068694+0000 mon.smithi096 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2022-02-02T18:17:04.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.073203+0000 mon.smithi096 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.076119+0000 mon.smithi096 (mon.0) 263 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T18:17:04.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:17:04.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: :17:03.080713+0000 mon.smithi096 (mon.0) 264 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2022-02-02T18:17:04.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: 2022-02-02T18:17:04.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T18:17:04.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: 2022-02-02T18:17: 2022-02-02T18:17:04.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: 03.085916+0000 mon.smithi096 (mon.0) 265 : 2022-02-02T18:17:04.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:17:04.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: 18:17:03.087515+0000 mon.smithi096 (mon.0 2022-02-02T18:17:04.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:03 smithi096 conmon[32067]: ) 266 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: cluster 2022-02-02T18:17:02.770974+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:17:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 89 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.040273+0000 mon.smithi096 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.043866+0000 mon.smithi096 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.054741+0000 mon.smithi096 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.96:9093"}]: dispatch 2022-02-02T18:17:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:17:04.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 18:17:03.059517+0000 mon.smithi096 2022-02-02T18:17:04.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: (mon.0) 259 : audit [INF] 2022-02-02T18:17:04.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:17:04.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: -02T18:17:03.062783+0000 mon.smithi096 2022-02-02T18:17:04.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T18:17:04.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:17:04.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 02-02T18:17:03.068694+0000 2022-02-02T18:17:04.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: mon.smithi096 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2022-02-02T18:17:04.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 2022-02-02T18:17:04.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:17:04.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 02-02T18:17:03.073203+0000 mon.smithi096 (mon.0 2022-02-02T18:17:04.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: ) 262 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:17:04.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 17:03.076119+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:04.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 263 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T18:17:04.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:17:04.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: :17:03.080713+0000 mon.smithi096 (mon.0 2022-02-02T18:17:04.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: ) 264 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2022-02-02T18:17:04.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:17:04.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: :17:03.085916+0000 mon.smithi096 (mon.0 2022-02-02T18:17:04.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: ) 265 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:04.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:17:04.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 18:17:03.087515+0000 mon.smithi096 (mon. 2022-02-02T18:17:04.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:03 smithi159 conmon[35668]: 0) 266 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:05.208 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.055135+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:17:05.209 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: .14162) 90 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.96:9093"}]: dispatch 2022-02-02T18:17:05.209 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.063085+0000 mgr.smithi096.shfutl (mgr.14162) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T18:17:05.209 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.069113+0000 mgr.smithi096.shfutl (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2022-02-02T18:17:05.209 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.076483+0000 mgr.smithi096.shfutl (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T18:17:05.210 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:04 smithi096 conmon[32067]: audit 2022-02-02T18:17:03.081060+0000 mgr.smithi096.shfutl (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2022-02-02T18:17:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.055135+0000 mgr.smithi096.shfutl (mgr.14162) 90 : audit 2022-02-02T18:17:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.96:9093"}]: dispatch 2022-02-02T18:17:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.063085+0000 mgr.smithi096.shfutl (mgr.14162) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T18:17:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.069113+0000 mgr.smithi096.shfutl (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2022-02-02T18:17:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.076483+0000 mgr.smithi096.shfutl (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T18:17:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:04 smithi159 conmon[35668]: audit 2022-02-02T18:17:03.081060+0000 mgr.smithi096.shfutl (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2022-02-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-02-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-02-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2022-02-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2022-02-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131585 s, 797 MB/s 2022-02-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2022-02-02T18:17:06.144 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:05 smithi096 conmon[32067]: cluster 2022-02-02T18:17 2022-02-02T18:17:06.144 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:05 smithi096 conmon[32067]: :04.771355+0000 mgr.smithi096.shfutl (mgr.14162) 95 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:06.145 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:05 smithi096 conmon[32067]: audit 2022-02-02T18:17:05.237644+0000 mon.smithi096 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:05 smithi159 conmon[35668]: cluster 2022-02-02T18:17:04.771355+0000 mgr.smithi096.shfutl (mgr.14162) 95 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:05 smithi159 conmon[35668]: audit 2022-02-02T18:17:05.237644+0000 mon.smithi096 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:06.434 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_2 2022-02-02T18:17:07.173 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:17:07 smithi096 conmon[54651]: debug 2022-02-02T18:17:06.998+0000 7f1d4d385080 -1 osd.1 0 log_to_monitors {default=true} 2022-02-02T18:17:07.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:07 smithi096 conmon[32067]: cluster 2022-02-02T18:17:06.771699+0000 mgr.smithi096.shfutl (mgr.14162) 96 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:07.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:07 smithi096 conmon[32067]: audit 2022-02-02T18:17:07.001395+0000 mon.smithi096 (mon.0) 268 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T18:17:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:07 smithi159 conmon[35668]: cluster 2022-02-02T18:17:06.771699+0000 mgr.smithi096.shfutl (mgr.14162) 96 2022-02-02T18:17:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:07 smithi159 conmon[35668]: : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:07 smithi159 conmon[35668]: audit 2022-02-02T18:17:07.001395+0000 mon.smithi096 (mon.0) 268 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T18:17:08.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.701+0000 7f24050de700 1 -- 172.21.15.96:0/1953974220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 msgr2=0x7f24000f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 --2- 172.21.15.96:0/1953974220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f4cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f23f0004660 tx=0x7f23f0009b30).stop 2022-02-02T18:17:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 -- 172.21.15.96:0/1953974220 shutdown_connections 2022-02-02T18:17:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 --2- 172.21.15.96:0/1953974220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 --2- 172.21.15.96:0/1953974220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f4cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 -- 172.21.15.96:0/1953974220 >> 172.21.15.96:0/1953974220 conn(0x7f24000f0320 msgr2=0x7f24000f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 -- 172.21.15.96:0/1953974220 shutdown_connections 2022-02-02T18:17:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 -- 172.21.15.96:0/1953974220 wait complete. 2022-02-02T18:17:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 Processor -- start 2022-02-02T18:17:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.702+0000 7f24050de700 1 -- start start 2022-02-02T18:17:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000f5e70 con 0x7f24000f48a0 2022-02-02T18:17:08.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000f5fb0 con 0x7f24000f5240 2022-02-02T18:17:08.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:08.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51752/0 (socket says 172.21.15.96:51752) 2022-02-02T18:17:08.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 -- 172.21.15.96:0/3762885701 learned_addr learned my addr 172.21.15.96:0/3762885701 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:17:08.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23ff7fe700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 -- 172.21.15.96:0/3762885701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 msgr2=0x7f24000f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 -- 172.21.15.96:0/3762885701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0005040 con 0x7f24000f48a0 2022-02-02T18:17:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23ff7fe700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:17:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fffff700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f23f0009990 tx=0x7f23f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f0018070 con 0x7f24000f48a0 2022-02-02T18:17:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24000f6230 con 0x7f24000f48a0 2022-02-02T18:17:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24000f6790 con 0x7f24000f48a0 2022-02-02T18:17:08.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f23f0013410 con 0x7f24000f48a0 2022-02-02T18:17:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.703+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f001c620 con 0x7f24000f48a0 2022-02-02T18:17:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.704+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e0004fa0 con 0x7f24000f48a0 2022-02-02T18:17:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.705+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f23f001d420 con 0x7f24000f48a0 2022-02-02T18:17:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.705+0000 7f23fcff9700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 0x7f23e805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.705+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1985+0+0 (secure 0 0 0) 0x7f23f00773c0 con 0x7f24000f48a0 2022-02-02T18:17:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.706+0000 7f23ff7fe700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 0x7f23e805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.706+0000 7f23ff7fe700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 0x7f23e805e7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f24000f56c0 tx=0x7f23f4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:08.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.709+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f23f004aeb0 con 0x7f24000f48a0 2022-02-02T18:17:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:08.919+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f23e0000bc0 con 0x7f23e805c300 2022-02-02T18:17:09.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[54651]: debug 2022-02-02T18:17:08.884+0000 7f1d438f6700 -1 osd.1 0 waiting for initial osdmap 2022-02-02T18:17:09.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[54651]: debug 2022-02-02T18:17:08.889+0000 7f1d3e06e700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:17:09.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: audit 2022-02-02T18:17:07 2022-02-02T18:17:09.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: .879493+0000 mon.smithi096 (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T18:17:09.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: cluster 2022-02-02T18 2022-02-02T18:17:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: :17:07.879542+0000 mon.smithi096 (mon.0 2022-02-02T18:17:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: ) 270 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-02-02T18:17:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: -02-02T18:17:07.879889+0000 2022-02-02T18:17:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: mon.smithi096 (mon.0) 271 : 2022-02-02T18:17:09.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:09.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: audit 2022-02-02T18:17:09.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: 2022-02-02T18:17:07. 2022-02-02T18:17:09.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: 880172+0000 mon.smithi096 (mon.0) 272 : audit [INF] 2022-02-02T18:17:09.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:08 smithi096 conmon[32067]: from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:17:09.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:08 smithi159 conmon[35668]: audit 2022-02-02T18:17:07.879493+0000 mon.smithi096 (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T18:17:09.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:08 smithi159 conmon[35668]: cluster 2022-02-02T18:17:07.879542+0000 mon.smithi096 (mon. 2022-02-02T18:17:09.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:08 smithi159 conmon[35668]: 0) 270 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-02-02T18:17:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:08 smithi159 conmon[35668]: audit 2022-02-02T18:17:07.879889+0000 mon.smithi096 (mon.0) 271 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:09.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:08 smithi159 conmon[35668]: audit 2022-02-02T18:17:07.880172+0000 mon.smithi096 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:17:10.259 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: cluster 2022-02-02T18:17:08.772003+0000 mgr.smithi096.shfutl (mgr.14162) 97 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:10.260 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.881688+0000 mon.smithi096 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:17:10.260 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: cluster 2022-02-02T18:17:08.881778+0000 mon.smithi096 (mon.0) 274 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2022-02-02T18:17:10.260 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.881880+0000 mon.smithi096 (mon.0) 275 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:10.260 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.885654+0000 mon.smithi096 (mon.0) 276 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:10.261 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.921110+0000 mgr.smithi096.shfutl (mgr.14162) 98 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:10.261 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.921873+0000 mon.smithi096 (mon.0) 277 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:10.261 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.923156+0000 mon.smithi096 (mon.0) 278 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:10.261 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:08.923656+0000 mon.smithi096 (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:10.262 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:09 smithi096 conmon[32067]: audit 2022-02-02T18:17:09.884743+0000 mon.smithi096 (mon.0) 280 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: cluster 2022-02-02T18:17:08.772003+0000 mgr.smithi096.shfutl (mgr.14162) 97 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02T18:17:08.881688+0000 mon.smithi096 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:17:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: cluster 2022-02-02T18:17:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 2022-02-02T18:17:08.881778+0000 mon.smithi096 (mon.0) 274 : cluster [DBG] 2022-02-02T18:17:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: osdmap e13: 2 total, 1 up, 2 in 2022-02-02T18:17:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02T18:17:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 2022-02-02T18:17:08.881880+0000 mon.smithi096 (mon 2022-02-02T18:17:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: .0) 275 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:17:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 18:17:08.885654+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 276 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:17:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: T18:17:08.921110+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:17:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 14162) 98 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:17:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: T18:17:08.921873+0000 mon.smithi096 (mon. 2022-02-02T18:17:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 0) 277 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:17:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: T18:17:08.923156+0000 mon.smithi096 (mon. 2022-02-02T18:17:10.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 0) 278 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:17:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 02-02T18:17:08.923656+0000 mon.smithi096 2022-02-02T18:17:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:17:10.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 18:17:09.884743+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:10.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:09 smithi159 conmon[35668]: 280 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:11.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: cluster 2022-02-02T18:17:08.030693+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:17:11.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: 2022-02-02T18:17:11.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: cluster 2022-02-02T18:17:08.030793+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:11.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:08.922958+0000 mgr.smithi096.shfutl (mgr.14162) 99 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:17:11.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: cluster 2022-02-02T18:17:09.889848+0000 mon.smithi096 (mon.0) 281 : cluster [INF] osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] boot 2022-02-02T18:17:11.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: cluster 2022-02-02T18:17:09.889886+0000 mon.smithi096 (mon.0) 282 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-02-02T18:17:11.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: audit 2022-02-02T18:17:09.890178+0000 mon.smithi096 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:11.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:10 smithi096 conmon[32067]: audit 2022-02-02T18:17:10.202447+0000 mon.smithi096 (mon.0) 284 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: cluster 2022-02-02T18:17:08.030693+0000 osd.1 (osd.1) 1 2022-02-02T18:17:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:17:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: cluster 2022-02-02T18:17:08.030793+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:08.922958 2022-02-02T18:17:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: +0000 mgr.smithi096.shfutl (mgr.14162) 99 : cephadm [INF] Applying service osd.None on host smithi096... 2022-02-02T18:17:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 2022-02-02T18:17:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: cluster 2022-02-02T18:17:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 2022-02-02T18:17:09.889848+0000 mon.smithi096 (mon 2022-02-02T18:17:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: .0) 281 : cluster [INF] osd.1 [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] boot 2022-02-02T18:17:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: cluster 2022-02-02T 2022-02-02T18:17:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 18:17:09.889886+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 282 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-02-02T18:17:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:17:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 18:17:09.890178+0000 mon.smithi096 (mon.0 2022-02-02T18:17:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: ) 283 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:17:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:17:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: 17:10.202447+0000 mon.smithi096 (mon.0) 284 : 2022-02-02T18:17:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:10 smithi159 conmon[35668]: audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:12.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: cluster 2022-02-02T18:17:10.772267+0000 mgr.smithi096.shfutl (mgr.14162) 100 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:12.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: cluster 2022-02-02T18:17:10.894053+0000 mon.smithi096 (mon.0) 285 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-02-02T18:17:12.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: audit 2022-02-02T18:17:11.718870+0000 mon.smithi096 (mon.0) 286 : audit [INF] from='client.? 172.21.15.96:0/3309195669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71e07e53-0fd8-4df3-8306-f483afe6fbbc"}]: dispatch 2022-02-02T18:17:12.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: audit 2022-02-02T18:17:11.722543+0000 mon.smithi096 (mon.0) 287 : audit [INF] from='client.? 172.21.15.96:0/3309195669' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71e07e53-0fd8-4df3-8306-f483afe6fbbc"}]': finished 2022-02-02T18:17:12.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: cluster 2022-02-02T18:17:11.722592+0000 mon.smithi096 (mon.0) 288 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-02-02T18:17:12.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:11 smithi096 conmon[32067]: audit 2022-02-02T18:17:11.722683+0000 mon.smithi096 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: cluster 2022-02-02T18:17:10.772267+0000 mgr.smithi096.shfutl (mgr.14162) 100 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T18:17:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: cluster 2022-02-02T18:17:10.894053+0000 mon.smithi096 (mon.0) 285 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-02-02T18:17:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: audit 2022-02-02T18:17: 2022-02-02T18:17:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: 11.718870+0000 mon.smithi096 (mon.0) 286 : audit [INF] from='client.? 172.21.15.96:0/3309195669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71e07e53-0fd8-4df3-8306-f483afe6fbbc"}]: dispatch 2022-02-02T18:17:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: audit 2022-02-02T18:17:11.722543 2022-02-02T18:17:12.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 287 : audit [INF] from='client.? 172.21.15.96:0/3309195669' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71e07e53-0fd8-4df3-8306-f483afe6fbbc"}]': finished 2022-02-02T18:17:12.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: 2022-02-02T18:17:12.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: cluster 2022-02-02T18:17 2022-02-02T18:17:12.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: :11.722592+0000 mon.smithi096 (mon.0) 288 : cluster 2022-02-02T18:17:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-02-02T18:17:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: audit 2022-02-02T18:17: 2022-02-02T18:17:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: 11.722683+0000 mon.smithi096 (mon.0) 289 : audit 2022-02-02T18:17:12.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:11 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:12 smithi096 conmon[32067]: audit 2022-02-02T18:17:12.144852+0000 mon.smithi096 ( 2022-02-02T18:17:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:12 smithi096 conmon[32067]: mon.0) 290 : audit [DBG] from='client.? 172.21.15.96:0/403532427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:12 smithi159 conmon[35668]: audit 2022-02-02T18:17:12.144852+0000 mon.smithi096 (mon.0) 290 : audit [DBG] from='client.? 172.21.15.96:0/403532427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:13 smithi159 conmon[35668]: cluster 2022-02-02T18:17:12.772597+0000 mgr.smithi096.shfutl (mgr.14162) 101 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:13 smithi096 conmon[32067]: cluster 2022-02-02T18:17:12.772597+0000 mgr.smithi096.shfutl (mgr.14162) 101 : cluster 2022-02-02T18:17:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:13 smithi096 conmon[32067]: [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:16.146 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:15 smithi096 conmon[32067]: cluster 2022-02-02T18:17:14.772930+0000 mgr.smithi096.shfutl 2022-02-02T18:17:16.147 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:15 smithi096 conmon[32067]: (mgr.14162) 102 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:16.147 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:15 smithi096 conmon[32067]: audit 2022-02-02T18:17:15.093554+0000 mon.smithi096 (mon.0) 291 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:17:16.147 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:15 smithi096 conmon[32067]: audit 2022-02-02T18:17:15.093809+0000 mon.smithi096 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:17:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:15 smithi159 conmon[35668]: cluster 2022-02-02T18:17:14.772930+0000 mgr.smithi096.shfutl (mgr.14162) 102 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:15 smithi159 conmon[35668]: audit 2022-02-02T18:17:15.093554+0000 mon.smithi096 (mon.0) 291 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:17:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:15 smithi159 conmon[35668]: audit 2022-02-02T18:17:15.093809+0000 mon.smithi096 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:17:18.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:17 smithi096 conmon[32067]: cluster 2022-02-02T18:17:16.773356+0000 mgr.smithi096.shfutl (mgr.14162) 103 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:17 smithi096 conmon[32067]: audit 2022-02-02T18:17:17.826363+0000 mon.smithi096 (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:17 smithi096 conmon[32067]: audit 2022-02-02T18:17:17.829817+0000 mon.smithi096 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:17 smithi096 conmon[32067]: audit 2022-02-02T18:17:17.832073+0000 mon.smithi096 (mon.0) 295 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:17 smithi159 conmon[35668]: cluster 2022-02-02T18:17:16.773356+0000 mgr.smithi096.shfutl (mgr.14162) 103 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:17 smithi159 conmon[35668]: audit 2022-02-02T18:17:17.826363+0000 mon.smithi096 (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:18.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:17 smithi159 conmon[35668]: audit 2022-02-02T18:17:17.829817+0000 mon.smithi096 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:18.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:17 smithi159 conmon[35668]: audit 2022-02-02T18:17:17.832073 2022-02-02T18:17:18.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:17 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 295 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:19.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:18 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:17.821718+0000 mgr.smithi096.shfutl (mgr.14162) 104 : cephadm [INF] Detected new or changed devices on smithi096 2022-02-02T18:17:19.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:18 smithi159 conmon[35668]: audit 2022-02-02T18:17:18.689151+0000 mon.smithi096 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-02-02T18:17:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:18 smithi159 conmon[35668]: audit 2022-02-02T18:17:18.689729+0000 mon.smithi096 (mon.0) 297 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:19.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:18 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:17.821718+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:17:19.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:18 smithi096 conmon[32067]: .14162) 104 : cephadm [INF] Detected new or changed devices on smithi096 2022-02-02T18:17:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:18 smithi096 conmon[32067]: audit 2022-02-02T18:17:18.689151+0000 mon.smithi096 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-02-02T18:17:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:18 smithi096 conmon[32067]: audit 2022-02-02T18:17:18.689729+0000 mon.smithi096 (mon.0) 297 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:19 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:18.690217+0000 mgr.smithi096.shfutl ( 2022-02-02T18:17:20.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:19 smithi096 conmon[32067]: mgr.14162) 105 : cephadm [INF] Deploying daemon osd.2 on smithi096 2022-02-02T18:17:20.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:19 smithi096 conmon[32067]: cluster 2022-02-02T18:17:18.773656+0000 mgr.smithi096.shfutl (mgr.14162) 106 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:19 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:18.690217+0000 mgr.smithi096.shfutl (mgr.14162) 105 : cephadm [INF] Deploying daemon osd.2 on smithi096 2022-02-02T18:17:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:19 smithi159 conmon[35668]: cluster 2022-02-02T18 2022-02-02T18:17:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:19 smithi159 conmon[35668]: :17:18.773656+0000 mgr.smithi096.shfutl (mgr.14162) 106 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:20 smithi159 conmon[35668]: audit 2022-02-02T18:17:19.984821+0000 mon.smithi096 (mon.0) 298 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:20 smithi159 conmon[35668]: cluster 2022-02-02T18:17:20.773877+0000 mgr.smithi096.shfutl (mgr.14162) 107 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:20 smithi096 conmon[32067]: audit 2022-02-02T18:17:19.984821+0000 mon.smithi096 2022-02-02T18:17:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:20 smithi096 conmon[32067]: (mon.0) 298 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:20 smithi096 conmon[32067]: cluster 2022-02-02T18:17:20.773877+0000 mgr.smithi096.shfutl (mgr.14162) 107 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:22.574 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 2 on host 'smithi096' 2022-02-02T18:17:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.570+0000 7f23fcff9700 1 -- 172.21.15.96:0/3762885701 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f23e0000bc0 con 0x7f23e805c300 2022-02-02T18:17:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 msgr2=0x7f23e805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:22.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 0x7f23e805e7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f24000f56c0 tx=0x7f23f4009040).stop 2022-02-02T18:17:22.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 msgr2=0x7f24000f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:22.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f23f0009990 tx=0x7f23f0009b30).stop 2022-02-02T18:17:22.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 shutdown_connections 2022-02-02T18:17:22.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23e805c300 0x7f23e805e7c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:22.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24000f48a0 0x7f24000f7490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:22.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 --2- 172.21.15.96:0/3762885701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000f5240 0x7f24000f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:22.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 >> 172.21.15.96:0/3762885701 conn(0x7f24000f0320 msgr2=0x7f24000fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:22.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 shutdown_connections 2022-02-02T18:17:22.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:17:22.572+0000 7f24050de700 1 -- 172.21.15.96:0/3762885701 wait complete. 2022-02-02T18:17:23.389 DEBUG:teuthology.orchestra.run.smithi096:osd.2> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.2.service 2022-02-02T18:17:23.391 INFO:tasks.cephadm:Deploying osd.3 on smithi159 with /dev/vg_nvme/lv_4... 2022-02-02T18:17:23.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-02-02T18:17:23.420 INFO:journalctl@ceph.osd.2.smithi096.stdout:-- Logs begin at Wed 2022-02-02 18:05:35 UTC. -- 2022-02-02T18:17:23.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:23 smithi159 conmon[35668]: audit 2022-02-02T18:17:22.565910+0000 mon.smithi096 (mon.0) 299 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:23.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:23 smithi159 conmon[35668]: audit 2022-02-02T18:17: 2022-02-02T18:17:23.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:23 smithi159 conmon[35668]: 22.569981+0000 mon.smithi096 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:23.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:23 smithi159 conmon[35668]: cluster 2022-02-02T18:17:22.774135+0000 mgr.smithi096.shfutl (mgr.14162) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:23 smithi096 conmon[32067]: audit 2022-02-02T18:17:22.565910+0000 mon.smithi096 (mon. 2022-02-02T18:17:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:23 smithi096 conmon[32067]: 0) 299 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:23 smithi096 conmon[32067]: audit 2022-02-02T18:17:22.569981+0000 mon.smithi096 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:23 smithi096 conmon[32067]: cluster 2022-02-02T18:17:22.774135+0000 mgr.smithi096.shfutl (mgr.14162) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-02-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-02-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2022-02-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2022-02-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128416 s, 817 MB/s 2022-02-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 2022-02-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2022-02-02T18:17:25.479 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:25 smithi096 conmon[32067]: audit 2022-02-02T18:17:24.215221+0000 mon.smithi096 ( 2022-02-02T18:17:25.479 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:25 smithi096 conmon[32067]: mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:25.479 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:25 smithi096 conmon[32067]: cluster 2022-02-02T18:17:24.774726+0000 mgr.smithi096.shfutl (mgr.14162) 109 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:25.497 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:25 smithi159 conmon[35668]: audit 2022-02-02T18:17:24.215221+0000 mon.smithi096 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:25.497 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:25 smithi159 conmon[35668]: cluster 2022-02-02T18:17:24.774726+0000 mgr.smithi096.shfutl (mgr.14162) 109 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:25.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2022-02-02T18:17:26.736 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:26 smithi096 conmon[32067]: audit 2022-02-02T18:17:26.476571+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:26.736 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:26 smithi096 conmon[32067]: 302 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T18:17:26.737 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:17:26 smithi096 conmon[60907]: debug 2022-02-02T18:17:26.473+0000 7f56f5b20080 -1 osd.2 0 log_to_monitors {default=true} 2022-02-02T18:17:26.932 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:26 smithi159 conmon[35668]: audit 2022-02-02T18:17:26.476571+0000 mon.smithi096 (mon.0) 302 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T18:17:27.298 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- 172.21.15.159:0/1897014276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 msgr2=0x7f29d80f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:27.299 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 --2- 172.21.15.159:0/1897014276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d80f5d30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f29d4004660 tx=0x7f29d4009b30).stop 2022-02-02T18:17:27.299 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- 172.21.15.159:0/1897014276 shutdown_connections 2022-02-02T18:17:27.299 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 --2- 172.21.15.159:0/1897014276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d80f5d30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:27.299 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 --2- 172.21.15.159:0/1897014276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 0x7f29d80f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:27.300 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- 172.21.15.159:0/1897014276 >> 172.21.15.159:0/1897014276 conn(0x7f29d80f04c0 msgr2=0x7f29d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:27.300 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- 172.21.15.159:0/1897014276 shutdown_connections 2022-02-02T18:17:27.300 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- 172.21.15.159:0/1897014276 wait complete. 2022-02-02T18:17:27.300 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 Processor -- start 2022-02-02T18:17:27.301 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 -- start start 2022-02-02T18:17:27.301 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.294+0000 7f29dfadf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:27.301 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dfadf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 0x7f29d8107500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:27.301 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dfadf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8107ab0 con 0x7f29d80f6bb0 2022-02-02T18:17:27.301 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dfadf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8107bf0 con 0x7f29d80f58b0 2022-02-02T18:17:27.302 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:27.302 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42918/0 (socket says 172.21.15.159:42918) 2022-02-02T18:17:27.302 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 -- 172.21.15.159:0/3585233547 learned_addr learned my addr 172.21.15.159:0/3585233547 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:17:27.302 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd07a700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 0x7f29d8107500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:27.303 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 -- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 msgr2=0x7f29d8107500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:27.303 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 0x7f29d8107500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:27.303 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 -- 172.21.15.159:0/3585233547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d4005040 con 0x7f29d80f58b0 2022-02-02T18:17:27.303 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dd87b700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f29c8002700 tx=0x7f29c8009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:27.303 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c80079c0 con 0x7f29d80f58b0 2022-02-02T18:17:27.304 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8108590 con 0x7f29d80f58b0 2022-02-02T18:17:27.304 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f29c800f040 con 0x7f29d80f58b0 2022-02-02T18:17:27.304 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c8014860 con 0x7f29d80f58b0 2022-02-02T18:17:27.304 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.295+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d8108b50 con 0x7f29d80f58b0 2022-02-02T18:17:27.306 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.296+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8045ad0 con 0x7f29d80f58b0 2022-02-02T18:17:27.306 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.297+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f29c801b060 con 0x7f29d80f58b0 2022-02-02T18:17:27.306 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.297+0000 7f29ce7fc700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 0x7f29c405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:27.306 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.297+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f29c80751e0 con 0x7f29d80f58b0 2022-02-02T18:17:27.307 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.297+0000 7f29dd07a700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 0x7f29c405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:27.307 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.297+0000 7f29dd07a700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 0x7f29c405e760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f29d4004e30 tx=0x7f29d4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:27.307 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.301+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f29c8048a30 con 0x7f29d80f58b0 2022-02-02T18:17:27.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:27.472+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f29d80fad00 con 0x7f29c405c2a0 2022-02-02T18:17:27.540 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[60907]: debug 2022-02-02T18:17:27.533+0000 7f56ec091700 -1 osd.2 0 waiting for initial osdmap 2022-02-02T18:17:27.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T18:17:26. 2022-02-02T18:17:27.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: 530183+0000 mon.smithi096 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T18:17:27.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: cluster 2022-02-02 2022-02-02T18:17:27.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: T18:17:26.530261+0000 mon.smithi096 (mon.0 2022-02-02T18:17:27.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: ) 304 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-02-02T18:17:27.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:27.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: -02-02T18:17:26.530599+0000 2022-02-02T18:17:27.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: mon.smithi096 (mon.0) 305 : audit [DBG] 2022-02-02T18:17:27.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:27.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:17:27.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: :17:26.530866+0000 mon.smithi096 (mon.0 2022-02-02T18:17:27.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: ) 306 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:17:27.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:17:27.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: -02-02T18:17:26.775045 2022-02-02T18:17:27.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 110 : cluster 2022-02-02T18:17:27.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:27.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:17:27.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: 18:17:27.475292+0000 mon.smithi096 (mon. 2022-02-02T18:17:27.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: 0) 307 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:27.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: 2022-02-02T18:17:27 2022-02-02T18:17:27.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: .476707+0000 mon.smithi096 (mon.0) 308 : 2022-02-02T18:17:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:26.530183+0000 mon.smithi096 (mon.0) 303 : audit 2022-02-02T18:17:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T18:17:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: cluster 2022-02-02T18:17:26.530261+0000 mon.smithi096 (mon.0) 304 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-02-02T18:17:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:26.530599+0000 mon.smithi096 (mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:26.530866+0000 mon.smithi096 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:17:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: cluster 2022-02-02T18:17:26.775045+0000 mgr.smithi096.shfutl (mgr.14162) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.475292+0000 mon.smithi096 (mon.0) 307 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.476707+0000 mon.smithi096 (mon.0) 308 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.477284+0000 mon.smithi096 (mon.0) 309 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:27 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.509302+0000 mon.smithi096 (mon.0) 310 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:27.807 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[60907]: debug 2022-02-02T18:17:27.538+0000 7f56e6809700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:17:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T18:17 2022-02-02T18:17:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: :27.477284+0000 mon.smithi096 (mon.0) 309 2022-02-02T18:17:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: audit 2022-02-02T18:17 2022-02-02T18:17:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: :27.509302+0000 mon.smithi096 (mon.0) 310 : audit 2022-02-02T18:17:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:27 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.474442+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:17:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 111 : audit [DBG] from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:27.476472+0000 mgr.smithi096.shfutl (mgr.14162) 112 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:17:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18:17:27.531130+0000 mon.smithi096 (mon.0) 311 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:17:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: cluster 2022-02-02T18:17:27.531182+0000 mon.smithi096 (mon. 2022-02-02T18:17:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 0) 312 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-02-02T18:17:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18:17:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 2022-02-02T18:17:27.531278+0000 mon.smithi096 (mon.0) 313 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:28.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 2022-02-02T18:17:28.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:17:28.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 17:27.534526+0000 mon.smithi096 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:28.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18:17:28.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 2022-02-02T18:17:27.858569+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:28.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 315 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:28.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02-02T18:17:28.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 2022-02-02T18:17:27.860753+0000 mon.smithi096 (mon.0) 316 : audit 2022-02-02T18:17:28.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:28.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:17:28.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:28 smithi159 conmon[35668]: 02T18:17:28.534216+0000 mon.smithi096 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.474442+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:17:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: .14162) 111 : audit [DBG] from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:27.476472+0000 mgr.smithi096.shfutl (mgr.14162) 112 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:17:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.531130+0000 mon.smithi096 (mon.0) 311 : audit [INF] from='osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2022-02-02T18:17:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: cluster 2022-02-02T18:17:27.531182+0000 mon.smithi096 (mon.0) 312 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-02-02T18:17:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.531278+0000 mon.smithi096 (mon.0) 313 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.534526+0000 mon.smithi096 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:28.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.858569+0000 mon.smithi096 (mon.0) 315 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:28.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:27.860753+0000 mon.smithi096 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:28.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:28 smithi096 conmon[32067]: audit 2022-02-02T18:17:28.534216+0000 mon.smithi096 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:29.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: cluster 2022-02-02T18:17:27.491045+0000 osd.2 (osd.2) 2022-02-02T18:17:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:17:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: cluster 2022-02-02T18:17:27.491148+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:29.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: cluster 2022-02-02T18:17:28.540928+0000 mon.smithi096 (mon.0) 318 : cluster [INF] osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] boot 2022-02-02T18:17:29.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: cluster 2022-02-02T18:17:28.540960+0000 mon.smithi096 (mon.0) 319 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-02-02T18:17:29.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: audit 2022-02-02T18:17:28.541856+0000 mon.smithi096 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:29.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: cluster 2022-02-02T18:17:28.775329+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:17:29.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:29 smithi096 conmon[32067]: 14162) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:30.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: cluster 2022-02-02T18:17:27.491045+0000 osd.2 (osd.2) 1 : cluster 2022-02-02T18:17:30.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: [DBG] purged_snaps scrub starts 2022-02-02T18:17:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: cluster 2022-02-02T18:17:27.491148+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: cluster 2022-02-02T18:17:28.540928+0000 mon.smithi096 (mon.0) 318 : cluster [INF] osd.2 [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] boot 2022-02-02T18:17:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: cluster 2022-02-02T18:17:28.540960+0000 mon.smithi096 (mon.0) 319 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-02-02T18:17:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: audit 2022-02-02T18:17:28.541856+0000 mon.smithi096 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:17:30.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:29 smithi159 conmon[35668]: cluster 2022-02-02T18:17:28.775329+0000 mgr.smithi096.shfutl (mgr.14162) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T18:17:31.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:29 2022-02-02T18:17:31.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: .724338+0000 mon.smithi159 (mon.1) 2 : audit [INF] from='client.? 172.21.15.159:0/1272971601' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]: dispatch 2022-02-02T18:17:31.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:29.724427+0000 mon.smithi096 (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]: dispatch 2022-02-02T18:17:31.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:29.728046+0000 mon.smithi096 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]': finished 2022-02-02T18:17:31.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: cluster 2022-02-02T18:17:29.728097+0000 mon.smithi096 (mon.0) 323 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2022-02-02T18:17:31.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:29.728181+0000 mon.smithi096 (mon.0) 324 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:31.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:30.163879+0000 mon.smithi159 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.159:0/105043072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:31.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:30 smithi159 conmon[35668]: audit 2022-02-02T18:17:30.432157+0000 mon.smithi096 (mon.0) 325 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:31.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:29.724338+0000 mon.smithi159 (mon. 2022-02-02T18:17:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: 1) 2 : audit [INF] from='client.? 172.21.15.159:0/1272971601' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]: dispatch 2022-02-02T18:17:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:29.724427+0000 mon.smithi096 (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]: dispatch 2022-02-02T18:17:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:29.728046+0000 mon.smithi096 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a85a335-124c-4fcd-bbc5-db2bd88eaa14"}]': finished 2022-02-02T18:17:31.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: cluster 2022-02-02T18:17:29.728097+0000 mon.smithi096 (mon.0) 323 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2022-02-02T18:17:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:29.728181+0000 2022-02-02T18:17:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: mon.smithi096 (mon.0) 324 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:30.163879+0000 mon.smithi159 (mon.1) 2022-02-02T18:17:31.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: 3 : audit [DBG] from='client.? 172.21.15.159:0/105043072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: audit 2022-02-02T18:17:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: 2022-02-02T18:17:30. 2022-02-02T18:17:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: 432157+0000 mon.smithi096 (mon.0) 325 : audit 2022-02-02T18:17:31.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:30 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:32.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:31 smithi159 conmon[35668]: cluster 2022-02-02T18:17:30.775712+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:17:32.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:31 smithi159 conmon[35668]: .14162) 114 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:32.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:31 smithi096 conmon[32067]: cluster 2022-02-02T18:17:30.775712+0000 mgr.smithi096.shfutl (mgr.14162) 114 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:34.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:33 smithi096 conmon[32067]: audit 2022-02-02T18:17:32.756472+0000 mon.smithi096 2022-02-02T18:17:34.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:33 smithi096 conmon[32067]: (mon.0) 326 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:34.015 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:33 smithi096 conmon[32067]: cluster 2022-02-02T18:17:32.775953+0000 mgr.smithi096.shfutl (mgr.14162) 115 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:34.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:33 smithi159 conmon[35668]: audit 2022-02-02T18:17:32.756472+0000 mon.smithi096 (mon 2022-02-02T18:17:34.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:33 smithi159 conmon[35668]: .0) 326 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:34.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:33 smithi159 conmon[35668]: cluster 2022-02-02T18:17:32.775953+0000 mgr.smithi096.shfutl (mgr.14162) 115 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:36.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:35 smithi159 conmon[35668]: cluster 2022-02-02T18:17:34.776249+0000 mgr.smithi096.shfutl (mgr.14162) 116 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:36.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:35 smithi159 conmon[35668]: audit 2022-02-02T18:17:35.748675+0000 mon.smithi096 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-02-02T18:17:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:35 smithi159 conmon[35668]: audit 2022-02-02T18:17:35.749288+0000 mon.smithi096 (mon.0) 328 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:35 smithi096 conmon[32067]: cluster 2022-02-02T18:17:34.776249+0000 mgr.smithi096.shfutl (mgr.14162) 116 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:35 smithi096 conmon[32067]: audit 2022-02-02T18:17:35.748675+0000 mon.smithi096 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-02-02T18:17:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:35 smithi096 conmon[32067]: audit 2022-02-02T18:17:35.749288+0000 mon.smithi096 (mon.0) 328 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:36.941 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:36 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:35.749775+0000 mgr.smithi096.shfutl 2022-02-02T18:17:36.941 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:36 smithi159 conmon[35668]: (mgr.14162) 117 : cephadm [INF] Deploying daemon osd.3 on smithi159 2022-02-02T18:17:36.941 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:36 smithi159 conmon[35668]: audit 2022-02-02T18:17:36.048762+0000 mon.smithi096 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:36.941 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:36 smithi159 conmon[35668]: audit 2022-02-02T18:17:36.053675+0000 mon.smithi096 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:36 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:35.749775+0000 mgr.smithi096.shfutl (mgr.14162) 117 : cephadm [INF] Deploying daemon osd.3 on smithi159 2022-02-02T18:17:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:36 smithi096 conmon[32067]: audit 2022-02-02T18:17:36.048762+0000 mon.smithi096 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:36 smithi096 conmon[32067]: audit 2022-02-02T18:17:36.053675+0000 mon.smithi096 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:37 smithi096 conmon[32067]: cluster 2022-02-02T18:17:36.776692+0000 mgr.smithi096.shfutl (mgr.14162) 118 : cluster 2022-02-02T18:17:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:37 smithi096 conmon[32067]: [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:37 smithi159 conmon[35668]: cluster 2022-02-02T18:17:36.776692+0000 mgr.smithi096.shfutl ( 2022-02-02T18:17:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:37 smithi159 conmon[35668]: mgr.14162) 118 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:38.633 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 3 on host 'smithi159' 2022-02-02T18:17:38.634 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.629+0000 7f29ce7fc700 1 -- 172.21.15.159:0/3585233547 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f29d80fad00 con 0x7f29c405c2a0 2022-02-02T18:17:38.635 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 msgr2=0x7f29c405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:38.635 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 0x7f29c405e760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f29d4004e30 tx=0x7f29d4009b30).stop 2022-02-02T18:17:38.635 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 msgr2=0x7f29d8107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:38.636 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f29c8002700 tx=0x7f29c8009d80).stop 2022-02-02T18:17:38.636 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 shutdown_connections 2022-02-02T18:17:38.636 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f29c405c2a0 0x7f29c405e760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:38.636 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29d80f58b0 0x7f29d8107010 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:38.636 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 --2- 172.21.15.159:0/3585233547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29d80f6bb0 0x7f29d8107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:38.637 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 >> 172.21.15.159:0/3585233547 conn(0x7f29d80f04c0 msgr2=0x7f29d80f4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:38.637 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 shutdown_connections 2022-02-02T18:17:38.637 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:38.631+0000 7f29dfadf700 1 -- 172.21.15.159:0/3585233547 wait complete. 2022-02-02T18:17:38.905 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:38 smithi159 conmon[35668]: audit 2022-02-02T18:17:38.618498+0000 mon.smithi096 (mon.0) 331 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:38.905 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:38 smithi159 conmon[35668]: audit 2022-02-02T18:17:38.621760+0000 mon.smithi096 (mon.0) 332 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:38.905 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:38 smithi159 conmon[35668]: audit 2022-02-02T18:17:38.628652+0000 mon.smithi096 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:39.062 DEBUG:teuthology.orchestra.run.smithi159:osd.3> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.3.service 2022-02-02T18:17:39.066 INFO:tasks.cephadm:Deploying osd.4 on smithi159 with /dev/vg_nvme/lv_3... 2022-02-02T18:17:39.067 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-02-02T18:17:39.095 INFO:journalctl@ceph.osd.3.smithi159.stdout:-- Logs begin at Wed 2022-02-02 18:05:45 UTC. -- 2022-02-02T18:17:39.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:38 smithi096 conmon[32067]: audit 2022-02-02T18:17:38.618498+0000 2022-02-02T18:17:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:38 smithi096 conmon[32067]: mon.smithi096 (mon.0) 331 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:38 smithi096 conmon[32067]: audit 2022-02-02T18:17:38.621760+0000 mon.smithi096 (mon.0) 332 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:38 smithi096 conmon[32067]: audit 2022-02-02T18:17:38.628652+0000 mon.smithi096 ( 2022-02-02T18:17:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:38 smithi096 conmon[32067]: mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: audit 2022-02-02T18:17:38.630722+0000 mon.smithi096 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-02-02T18:17:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: cluster 2022-02-02T18:17:38.776944+0000 mgr.smithi096.shfutl (mgr.14162) 119 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: audit 2022-02-02T18:17:39.634797+0000 mon.smithi096 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-02-02T18:17:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: cluster 2022-02-02T18:17:39.634855+0000 mon.smithi096 (mon.0) 336 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-02-02T18:17:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: audit 2022-02-02T18:17:39.634976+0000 mon.smithi096 (mon.0) 337 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:39 smithi159 conmon[35668]: audit 2022-02-02T18:17:39.635563+0000 mon.smithi096 (mon.0) 338 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-02-02T18:17:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: audit 2022-02-02T18:17: 2022-02-02T18:17:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: 38.630722+0000 mon.smithi096 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-02-02T18:17:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: cluster 2022-02-02T18:17:38.776944+0000 mgr.smithi096.shfutl (mgr.14162) 119 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: audit 2022-02-02T18:17:39.634797+0000 mon.smithi096 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-02-02T18:17:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: cluster 2022-02-02T18:17:39.634855+0000 mon.smithi096 (mon.0) 336 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-02-02T18:17:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: audit 2022-02-02T18:17:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: 2022-02-02T18:17:39.634976+0000 mon.smithi096 (mon.0) 337 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: audit 2022-02-02T18:17:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: 2022-02-02T18:17: 2022-02-02T18:17:40.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: 39.635563+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:40.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:39 smithi096 conmon[32067]: 338 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-02-02T18:17:41.416 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-02-02T18:17:41.416 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-02-02T18:17:41.417 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2022-02-02T18:17:41.417 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2022-02-02T18:17:41.417 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122432 s, 856 MB/s 2022-02-02T18:17:41.417 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2022-02-02T18:17:41.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:41 smithi159 conmon[35668]: audit 2022-02-02T18:17:40.637089+0000 mon.smithi096 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-02-02T18:17:41.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:41 smithi159 conmon[35668]: cluster 2022-02-02T18:17:40.637188+0000 mon.smithi096 (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-02-02T18:17:41.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:41 smithi159 conmon[35668]: audit 2022-02-02T18:17:40.637341+0000 mon.smithi096 (mon.0) 341 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:41.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:41 smithi159 conmon[35668]: cluster 2022-02-02T18:17:40.777237+0000 mgr.smithi096.shfutl (mgr.14162) 120 : cluster [DBG] pgmap v84: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:41.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2022-02-02T18:17:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:41 smithi096 conmon[32067]: audit 2022-02-02T18:17:40.637089+0000 mon.smithi096 (mon.0 2022-02-02T18:17:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:41 smithi096 conmon[32067]: ) 339 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-02-02T18:17:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:41 smithi096 conmon[32067]: cluster 2022-02-02T18:17:40.637188+0000 mon.smithi096 (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-02-02T18:17:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:41 smithi096 conmon[32067]: audit 2022-02-02T18:17:40.637341+0000 mon.smithi096 (mon.0) 341 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:41 smithi096 conmon[32067]: cluster 2022-02-02T18:17:40.777237+0000 mgr.smithi096.shfutl (mgr.14162) 120 : cluster [DBG] pgmap v84: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:43.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[42212]: debug 2022-02-02T18:17:42.551+0000 7f826358d080 -1 osd.3 0 log_to_monitors {default=true} 2022-02-02T18:17:43.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: cluster 2022-02-02T18:17:41.641473+0000 mon.smithi096 2022-02-02T18:17:43.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-02-02T18:17:43.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: audit 2022-02-02T18:17:41.641787+0000 mon.smithi096 (mon.0) 343 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:43.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: audit 2022-02-02T18:17:41.948648+0000 mon.smithi096 (mon.0) 344 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:43.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.556152+0000 mon.smithi096 (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:17:43.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:42 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.556225+0000 mon.smithi159 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:17:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: cluster 2022-02-02T18:17:41.641473+0000 mon.smithi096 (mon.0) 342 : 2022-02-02T18:17:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-02-02T18:17:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: audit 2022-02-02T18:17:41.641787+0000 mon.smithi096 (mon.0) 343 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: audit 2022-02-02T18:17:41.948648+0000 mon.smithi096 (mon.0) 344 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: audit 2022-02-02T18:17:42.556152+0000 mon.smithi096 (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:17:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:42 smithi096 conmon[32067]: audit 2022-02-02T18:17:42.556225+0000 mon.smithi159 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:17:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- 172.21.15.159:0/2950346342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 msgr2=0x7f25600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:43.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 --2- 172.21.15.159:0/2950346342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f25600f5850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2554004660 tx=0x7f2554009b30).stop 2022-02-02T18:17:43.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- 172.21.15.159:0/2950346342 shutdown_connections 2022-02-02T18:17:43.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 --2- 172.21.15.159:0/2950346342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 0x7f25600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:43.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 --2- 172.21.15.159:0/2950346342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f25600f5850 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- 172.21.15.159:0/2950346342 >> 172.21.15.159:0/2950346342 conn(0x7f25600f0b90 msgr2=0x7f25600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- 172.21.15.159:0/2950346342 shutdown_connections 2022-02-02T18:17:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- 172.21.15.159:0/2950346342 wait complete. 2022-02-02T18:17:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 Processor -- start 2022-02-02T18:17:43.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.796+0000 7f2565e1d700 1 -- start start 2022-02-02T18:17:43.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2565e1d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:43.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2565e1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 0x7f256010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:43.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2565e1d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600603c0 con 0x7f25600f66d0 2022-02-02T18:17:43.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2565e1d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560060500 con 0x7f25600f5430 2022-02-02T18:17:43.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:43.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42960/0 (socket says 172.21.15.159:42960) 2022-02-02T18:17:43.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 -- 172.21.15.159:0/4294468779 learned_addr learned my addr 172.21.15.159:0/4294468779 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:17:43.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f255ffff700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 0x7f256010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:43.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 -- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 msgr2=0x7f256010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:43.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 0x7f256010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:43.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 -- 172.21.15.159:0/4294468779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005040 con 0x7f25600f5430 2022-02-02T18:17:43.805 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f2564e1b700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2554014040 tx=0x7f255400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:43.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.797+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554019070 con 0x7f25600f5430 2022-02-02T18:17:43.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.798+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2554007e50 con 0x7f25600f5430 2022-02-02T18:17:43.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.798+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256010c490 con 0x7f25600f5430 2022-02-02T18:17:43.806 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.798+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554014c90 con 0x7f25600f5430 2022-02-02T18:17:43.807 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.798+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256010c9c0 con 0x7f25600f5430 2022-02-02T18:17:43.808 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.799+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2560059100 con 0x7f25600f5430 2022-02-02T18:17:43.808 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.799+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2554025070 con 0x7f25600f5430 2022-02-02T18:17:43.808 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.799+0000 7f255d7fa700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 0x7f255005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:17:43.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.799+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3249+0+0 (secure 0 0 0) 0x7f2554076600 con 0x7f25600f5430 2022-02-02T18:17:43.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.800+0000 7f255ffff700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 0x7f255005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:17:43.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.800+0000 7f255ffff700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 0x7f255005e7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f254c009fd0 tx=0x7f254c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:17:43.809 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.803+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2554049b90 con 0x7f25600f5430 2022-02-02T18:17:43.865 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: cluster 2022-02-02T18:17:42.777727+0000 mgr.smithi096.shfutl (mgr.14162) 121 : cluster [DBG] pgmap v86: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:43.866 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.951166+0000 mon.smithi096 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T18:17:43.866 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: cluster 2022-02-02T18:17:42.951247+0000 mon.smithi096 (mon.0) 347 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-02-02T18:17:43.866 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.951382+0000 mon.smithi096 (mon.0) 348 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:43.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.952141+0000 mon.smithi096 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:17:43.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: audit 2022-02-02T18:17:42.952235+0000 mon.smithi159 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:17:43.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[35668]: audit 2022-02-02T18:17:43.333394+0000 mon.smithi096 (mon.0) 350 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:44.001 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:43.999+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f25600fdd70 con 0x7f255005c300 2022-02-02T18:17:44.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: cluster 2022-02-02T18:17:42.777727+0000 mgr.smithi096.shfutl (mgr.14162) 121 : cluster [DBG] 2022-02-02T18:17:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: pgmap v86: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: audit 2022-02-02T18:17:42.951166+0000 mon.smithi096 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T18:17:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: cluster 2022-02- 2022-02-02T18:17:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: 02T18:17:42.951247+0000 mon.smithi096 (mon.0) 347 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-02-02T18:17:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: -02-02T18:17:42.951382+0000 mon.smithi096 (mon. 2022-02-02T18:17:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: 0) 348 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:17:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: :17:42.952141+0000 mon.smithi096 ( 2022-02-02T18:17:44.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: mon.0) 349 : audit [INF] 2022-02-02T18:17:44.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:17:44.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: audit 2022-02-02T18:17:44.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: 2022-02-02T18: 2022-02-02T18:17:44.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: 17:42.952235+0000 mon.smithi159 (mon 2022-02-02T18:17:44.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: .1) 5 : audit [INF] 2022-02-02T18:17:44.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: from='osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:17:44.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:44.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: -02-02T18:17:43 2022-02-02T18:17:44.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: .333394+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:44.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:43 smithi096 conmon[32067]: 350 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:44.276 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[42212]: debug 2022-02-02T18:17:43.955+0000 7f8259afe700 -1 osd.3 0 waiting for initial osdmap 2022-02-02T18:17:44.276 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:17:43 smithi159 conmon[42212]: debug 2022-02-02T18:17:43.963+0000 7f825627a700 -1 osd.3 25 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:17:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:43.952074+0000 mon.smithi096 (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:17:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: cluster 2022-02-02T18:17:43.952168+0000 mon.smithi096 (mon.0) 352 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-02-02T18:17:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:43.952333+0000 mon.smithi096 (mon.0) 353 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:43.956427+0000 mon.smithi096 (mon.0) 354 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:44.000661+0000 mgr.smithi096.shfutl (mgr.14162) 122 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:44.001558+0000 mon.smithi096 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:44.002925+0000 mgr.smithi096.shfutl (mgr.14162) 123 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:17:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:44.003199+0000 mon.smithi096 (mon.0) 356 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: audit 2022-02-02T18:17:44.004049+0000 mon.smithi096 (mon.0) 357 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:45.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:44 smithi159 conmon[35668]: cluster 2022-02-02T18:17:44.778159+0000 mgr.smithi096.shfutl (mgr.14162) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18:17:43.952074+0000 mon.smithi096 (mon.0) 351 2022-02-02T18:17:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:17:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: cluster 2022-02-02T18:17:43.952168+0000 mon.smithi096 (mon.0) 352 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-02-02T18:17:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18:17:43.952333+0000 mon.smithi096 (mon.0) 353 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18:17:43.956427+0000 2022-02-02T18:17:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: mon.smithi096 (mon.0) 354 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18:17:44.000661+0000 2022-02-02T18:17:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 122 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:17:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18: 2022-02-02T18:17:45.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: 17:44.001558+0000 mon.smithi096 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:17:45.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: 2022-02-02T18:17:45.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: cephadm 2022-02 2022-02-02T18:17:45.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: -02T18:17:44.002925+0000 mgr.smithi096.shfutl (mgr.14162) 123 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:17:45.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022-02-02T18:17: 2022-02-02T18:17:45.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: 44.003199+0000 mon.smithi096 (mon.0) 356 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:17:45.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:17:45.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: 02-02T18:17:44.004049+0000 mon.smithi096 (mon.0) 357 : 2022-02-02T18:17:45.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:45.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: cluster 2022-02-02T18:17:45.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: 2022-02-02T18:17:44.778159+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:17:45.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:44 smithi096 conmon[32067]: .14162) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T18:17:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: cluster 2022-02-02T18:17:43.510288+0000 osd.3 (osd.3) 1 : cluster [DBG] 2022-02-02T18:17:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: purged_snaps scrub starts 2022-02-02T18:17:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: cluster 2022-02-02T18:17:43.510405+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: cluster 2022-02-02T18:17:44.960585+0000 mon.smithi096 (mon.0) 358 : cluster [INF] osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] boot 2022-02-02T18:17:46.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: cluster 2022-02-02T18:17:44.960685+0000 mon.smithi096 (mon.0) 359 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2022-02-02T18:17:46.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: audit 2022-02-02T18:17:44.961117+0000 mon.smithi096 (mon.0) 360 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:46.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:45.488132+0000 mgr.smithi096.shfutl (mgr.14162) 125 : cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:17:46.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: audit 2022-02-02T18:17:45.493137+0000 mon.smithi096 (mon.0) 361 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:46.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: audit 2022-02-02T18:17:45.496737+0000 mon.smithi096 (mon.0) 362 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:46.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:45 smithi159 conmon[35668]: audit 2022-02-02T18:17:45.499642+0000 mon.smithi096 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: cluster 2022-02-02T18:17:43.510288+0000 osd.3 (osd.3) 1 : cluster 2022-02-02T18:17:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: [DBG] purged_snaps scrub starts 2022-02-02T18:17:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: cluster 2022-02-02T18:17:43.510405+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:17:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: cluster 2022-02-02T18:17:44.960585+0000 mon.smithi096 (mon.0) 358 : cluster [INF] osd.3 [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] boot 2022-02-02T18:17:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: cluster 2022-02-02T18:17:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:44.960685+0000 mon.smithi096 (mon.0) 359 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2022-02-02T18:17:46.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:44.961117+0000 mon.smithi096 (mon.0) 360 : audit 2022-02-02T18:17:46.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:17:46.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: cephadm 2022-02-02T18 2022-02-02T18:17:46.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: :17:45.488132+0000 mgr.smithi096.shfutl (mgr.14162) 125 : cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:17:46.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17: 2022-02-02T18:17:46.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 45.493137+0000 mon.smithi096 (mon.0) 361 : audit 2022-02-02T18:17:46.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:46.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:45. 2022-02-02T18:17:46.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 496737+0000 mon.smithi096 (mon.0) 362 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:46.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:46.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:45.499642 2022-02-02T18:17:46.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:46.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:45 smithi096 conmon[32067]: 2022-02-02T18:17:47.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: cluster 2022-02-02T18:17:45.962321+0000 2022-02-02T18:17:47.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: mon.smithi096 (mon.0) 364 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2022-02-02T18:17:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: audit 2022-02-02T18:17:46.387968+0000 mon.smithi096 (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]: dispatch 2022-02-02T18:17:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: audit 2022-02-02T18:17:46.387994+0000 mon.smithi159 (mon.1) 6 : audit [INF] from='client.? 172.21.15.159:0/997951001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]: dispatch 2022-02-02T18:17:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: audit 2022-02-02T18:17:46.391679+0000 mon.smithi096 (mon.0) 366 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]': finished 2022-02-02T18:17:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: cluster 2022-02-02T18:17:46.391743+0000 mon.smithi096 (mon.0) 367 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-02-02T18:17:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: audit 2022-02-02T18:17:46.391859+0000 mon.smithi096 (mon.0) 368 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:17:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: cluster 2022-02-02T18:17:46.778465+0000 mgr.smithi096.shfutl (mgr.14162) 126 : cluster [DBG] pgmap v93: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:46 smithi159 conmon[35668]: audit 2022-02-02T18:17:46.818967+0000 mon.smithi159 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.159:0/1642699481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:47.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: cluster 2022-02-02T18:17:45.962321+0000 mon.smithi096 (mon.0 2022-02-02T18:17:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: ) 364 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2022-02-02T18:17:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.387968+0000 mon.smithi096 (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]: dispatch 2022-02-02T18:17:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: audit 2022-02-02T18:17:46.387994+0000 mon.smithi159 2022-02-02T18:17:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: (mon.1) 6 : audit [INF] from='client.? 172.21.15.159:0/997951001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]: dispatch 2022-02-02T18:17:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:17:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: -02T18:17:46.391679+0000 mon.smithi096 ( 2022-02-02T18:17:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: mon.0) 366 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b22a2951-4fd4-4bc3-bc1e-f315e3d9514c"}]': finished 2022-02-02T18:17:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:17:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: 02-02T18:17:46.391743+0000 2022-02-02T18:17:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: mon.smithi096 (mon.0) 367 : cluster 2022-02-02T18:17:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-02-02T18:17:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: -02-02T18:17:46 2022-02-02T18:17:47.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: .391859+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:47.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: 368 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:17:47.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:17:47.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: 02-02T18:17:46.778465+0000 2022-02-02T18:17:47.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 126 : cluster [DBG] 2022-02-02T18:17:47.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: pgmap v93: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:47.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: audit 2022-02-02T18:17: 2022-02-02T18:17:47.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:46 smithi096 conmon[32067]: 46.818967+0000 mon.smithi159 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.159:0/1642699481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:17:50.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:49 smithi159 conmon[35668]: cluster 2022-02-02T18:17:48.778955+0000 mgr.smithi096.shfutl (mgr.14162) 127 : cluster [DBG] 2022-02-02T18:17:50.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:49 smithi159 conmon[35668]: pgmap v94: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:49 smithi096 conmon[32067]: cluster 2022-02-02T18:17:48.778955+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:17:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:49 smithi096 conmon[32067]: ) 127 : cluster [DBG] pgmap v94: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:51.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:51 smithi096 conmon[32067]: audit 2022-02-02T18:17:50.298486+0000 mon.smithi096 (mon.0) 369 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:51 smithi096 conmon[32067]: 2022-02-02T18:17:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:51 smithi096 conmon[32067]: audit 2022-02-02T18:17:50.301432+0000 mon.smithi096 (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:51 smithi096 conmon[32067]: cluster 2022-02-02T18:17:50.779320+0000 mgr.smithi096.shfutl (mgr.14162) 128 : cluster [DBG] pgmap v95: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:51.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:51 smithi159 conmon[35668]: audit 2022-02-02T18:17:50.298486+0000 mon.smithi096 (mon.0) 369 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:51.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:51 smithi159 conmon[35668]: audit 2022-02-02T18:17:50.301432+0000 mon.smithi096 (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:51.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:51 smithi159 conmon[35668]: cluster 2022-02-02T18:17:50.779320+0000 mgr.smithi096.shfutl (mgr.14162) 128 : cluster [DBG] pgmap v95: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:53.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:52 smithi159 conmon[35668]: audit 2022-02-02T18:17:52.615961+0000 mon.smithi096 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-02-02T18:17:53.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:52 smithi159 conmon[35668]: audit 2022-02-02T18:17:52.616789+0000 mon.smithi096 (mon.0) 372 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:52 smithi096 conmon[32067]: audit 2022-02-02T18:17:52.615961+0000 mon.smithi096 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-02-02T18:17:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:52 smithi096 conmon[32067]: 2022-02-02T18:17:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:52 smithi096 conmon[32067]: audit 2022-02-02T18:17:52.616789+0000 mon.smithi096 (mon.0) 372 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:17:53.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:53 smithi159 conmon[35668]: cephadm 2022-02-02T18:17:52.617433+0000 mgr.smithi096.shfutl (mgr.14162) 129 : cephadm [INF] Deploying daemon osd.4 on smithi159 2022-02-02T18:17:53.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:53 smithi159 conmon[35668]: cluster 2022-02-02T18:17:52.779875+0000 mgr.smithi096.shfutl (mgr.14162) 130 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:53 smithi096 conmon[32067]: cephadm 2022-02-02T18:17:52.617433+0000 mgr.smithi096.shfutl (mgr.14162) 129 : cephadm [INF] Deploying daemon osd.4 on smithi159 2022-02-02T18:17:54.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:53 smithi096 conmon[32067]: cluster 2022-02-02T18:17:52.779875+0000 mgr.smithi096.shfutl (mgr.14162) 130 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:55.826 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.822+0000 7f255d7fa700 1 -- 172.21.15.159:0/4294468779 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f25600fdd70 con 0x7f255005c300 2022-02-02T18:17:55.827 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 4 on host 'smithi159' 2022-02-02T18:17:55.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 msgr2=0x7f255005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:55.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 0x7f255005e7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f254c009fd0 tx=0x7f254c00b040).stop 2022-02-02T18:17:55.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 msgr2=0x7f2560109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2554014040 tx=0x7f255400b040).stop 2022-02-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 shutdown_connections 2022-02-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f255005c300 0x7f255005e7c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25600f5430 0x7f2560109a40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 --2- 172.21.15.159:0/4294468779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25600f66d0 0x7f256010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 >> 172.21.15.159:0/4294468779 conn(0x7f25600f0b90 msgr2=0x7f25600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 shutdown_connections 2022-02-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:17:55.825+0000 7f2565e1d700 1 -- 172.21.15.159:0/4294468779 wait complete. 2022-02-02T18:17:56.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:55 smithi159 conmon[35668]: cluster 2022-02-02T18:17:54.780362+0000 mgr.smithi096.shfutl (mgr.14162) 131 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:55 smithi159 conmon[35668]: audit 2022-02-02T18:17:55.812732+0000 mon.smithi096 (mon.0) 373 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:55 smithi159 conmon[35668]: audit 2022-02-02T18:17:55.816022+0000 mon.smithi096 (mon.0) 374 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:55 smithi159 conmon[35668]: audit 2022-02-02T18:17:55.820999+0000 mon.smithi096 (mon.0) 375 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:56.277 DEBUG:teuthology.orchestra.run.smithi159:osd.4> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.4.service 2022-02-02T18:17:56.279 INFO:tasks.cephadm:Deploying osd.5 on smithi159 with /dev/vg_nvme/lv_2... 2022-02-02T18:17:56.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-02-02T18:17:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: cluster 2022-02-02T18:17:54.780362+0000 2022-02-02T18:17:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 131 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:17:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: :17:55.812732+0000 mon.smithi096 (mon.0) 373 : audit 2022-02-02T18:17:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:17:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: -02-02T18:17:55. 2022-02-02T18:17:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: 816022+0000 mon.smithi096 (mon.0 2022-02-02T18:17:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: ) 374 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: audit 2022 2022-02-02T18:17:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: -02-02T18:17:55. 2022-02-02T18:17:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: 820999+0000 mon.smithi096 (mon.0) 2022-02-02T18:17:56.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:55 smithi096 conmon[32067]: 375 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:17:56.319 INFO:journalctl@ceph.osd.4.smithi159.stdout:-- Logs begin at Wed 2022-02-02 18:05:45 UTC. -- 2022-02-02T18:17:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:57 smithi159 conmon[35668]: cluster 2022-02-02T18:17:56.780704+0000 mgr.smithi096.shfutl (mgr.14162) 132 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:57 smithi096 conmon[32067]: cluster 2022-02-02T18:17:56.780704+0000 mgr.smithi096.shfutl (mgr.14162) 132 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:17:58.585 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-02-02T18:17:58.585 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-02-02T18:17:58.585 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2022-02-02T18:17:58.585 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2022-02-02T18:17:58.586 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014048 s, 746 MB/s 2022-02-02T18:17:58.586 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2022-02-02T18:17:59.040 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2022-02-02T18:18:00.026 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[47054]: debug 2022-02-02T18:17:59.753+0000 7f641c817080 -1 osd.4 0 log_to_monitors {default=true} 2022-02-02T18:18:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: cluster 2022-02-02T18:17:58.781135+0000 mgr.smithi096.shfutl 2022-02-02T18:18:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: (mgr.14162) 133 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:18:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: audit 2022-02-02T18:17:59.050374 2022-02-02T18:18:00.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:00.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: audit 2022-02-02T18:17 2022-02-02T18:18:00.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: :59.757050+0000 mon.smithi096 (mon.0) 377 : 2022-02-02T18:18:00.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:17:59 smithi159 conmon[35668]: audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:18:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:59 smithi096 conmon[32067]: cluster 2022-02-02T18:17:58.781135+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:18:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:59 smithi096 conmon[32067]: ) 133 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:18:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:59 smithi096 conmon[32067]: audit 2022-02-02T18:17:59.050374+0000 mon.smithi096 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:59 smithi096 conmon[32067]: audit 2022-02-02T18:17:59.757050+0000 mon.smithi096 (mon.0 2022-02-02T18:18:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:17:59 smithi096 conmon[32067]: ) 377 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:18:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: audit 2022-02-02T18:18:00.051975+0000 mon.smithi096 (mon.0) 378 : audit 2022-02-02T18:18:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T18:18:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: cluster 2022-02-02T18:18:00.052054+0000 mon.smithi096 (mon.0) 379 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-02-02T18:18:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:18:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: 02-02T18:18:00.052185+0000 mon.smithi096 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: audit 2022-02-02T18:18: 2022-02-02T18:18:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: 00.052454+0000 mon.smithi096 (mon.0) 381 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: audit 2022-02-02T18:18:00.612720+0000 mon.smithi096 ( 2022-02-02T18:18:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: cluster 2022-02-02T18:18:00. 2022-02-02T18:18:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:01 smithi096 conmon[32067]: 781503+0000 mgr.smithi096.shfutl (mgr.14162) 134 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:18:01.343 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 -- 172.21.15.159:0/51925893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 msgr2=0x7f11c00f5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:01.343 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 --2- 172.21.15.159:0/51925893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c00f5e30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f11b4004660 tx=0x7f11b4009b30).stop 2022-02-02T18:18:01.344 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 -- 172.21.15.159:0/51925893 shutdown_connections 2022-02-02T18:18:01.344 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 --2- 172.21.15.159:0/51925893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11c00f63b0 0x7f11c00f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:01.344 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 --2- 172.21.15.159:0/51925893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c00f5e30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:01.344 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 -- 172.21.15.159:0/51925893 >> 172.21.15.159:0/51925893 conn(0x7f11c00f0320 msgr2=0x7f11c00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:01.345 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 -- 172.21.15.159:0/51925893 shutdown_connections 2022-02-02T18:18:01.345 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.339+0000 7f11c4916700 1 -- 172.21.15.159:0/51925893 wait complete. 2022-02-02T18:18:01.345 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 Processor -- start 2022-02-02T18:18:01.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: audit 2022-02-02T18:18:00.051975+0000 mon.smithi096 (mon.0) 378 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T18:18:01.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: cluster 2022-02-02T18:18:00.052054+0000 mon.smithi096 (mon.0) 379 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-02-02T18:18:01.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: audit 2022-02-02T18:18:00.052185+0000 mon.smithi096 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:01.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: audit 2022-02-02T18:18:00.052454+0000 mon.smithi096 (mon.0) 381 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:01.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: audit 2022-02-02T18:18:00.612720+0000 mon.smithi096 (mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:01.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: cluster 2022-02-02T18:18:00.781503+0000 mgr.smithi096.shfutl (mgr.14162) 134 : cluster 2022-02-02T18:18:01.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[35668]: [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T18:18:01.348 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[47054]: debug 2022-02-02T18:18:01.056+0000 7f6412d88700 -1 osd.4 0 waiting for initial osdmap 2022-02-02T18:18:01.348 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:18:01 smithi159 conmon[47054]: debug 2022-02-02T18:18:01.066+0000 7f640dd01700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:18:01.350 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 -- start start 2022-02-02T18:18:01.350 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:01.351 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11c00f63b0 0x7f11c0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:01.351 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00f5540 con 0x7f11c00f63b0 2022-02-02T18:18:01.351 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11c4916700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00f5680 con 0x7f11c00f5a10 2022-02-02T18:18:01.351 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11bf7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:01.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11bf7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43026/0 (socket says 172.21.15.159:43026) 2022-02-02T18:18:01.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.340+0000 7f11bf7fe700 1 -- 172.21.15.159:0/617746513 learned_addr learned my addr 172.21.15.159:0/617746513 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:18:01.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11bf7fe700 1 -- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11c00f63b0 msgr2=0x7f11c0109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:01.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11bf7fe700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11c00f63b0 0x7f11c0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:01.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11bf7fe700 1 -- 172.21.15.159:0/617746513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4005040 con 0x7f11c00f5a10 2022-02-02T18:18:01.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11bf7fe700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f11b4014040 tx=0x7f11b400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:01.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b4019070 con 0x7f11c00f5a10 2022-02-02T18:18:01.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f11b4007e50 con 0x7f11c00f5a10 2022-02-02T18:18:01.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c010a240 con 0x7f11c00f5a10 2022-02-02T18:18:01.354 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b4014d30 con 0x7f11c00f5a10 2022-02-02T18:18:01.354 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.341+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c010a7a0 con 0x7f11c00f5a10 2022-02-02T18:18:01.354 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.342+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0045ad0 con 0x7f11c00f5a10 2022-02-02T18:18:01.354 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.343+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f11b4025070 con 0x7f11c00f5a10 2022-02-02T18:18:01.355 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.343+0000 7f11a7fff700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 0x7f11a805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:01.355 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.343+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3807+0+0 (secure 0 0 0) 0x7f11b40769a0 con 0x7f11c00f5a10 2022-02-02T18:18:01.355 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.343+0000 7f11beffd700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 0x7f11a805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:01.355 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.344+0000 7f11beffd700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 0x7f11a805e7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f11b0004b70 tx=0x7f11b000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:01.356 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.347+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f11b4049c90 con 0x7f11c00f5a10 2022-02-02T18:18:01.537 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:01.534+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f11c00fdd70 con 0x7f11a805c300 2022-02-02T18:18:02.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.053502+0000 mon.smithi096 (mon.0 2022-02-02T18:18:02.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: ) 383 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:18:02.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: cluster 2022-02-02T18:18:01.053562+0000 mon.smithi096 (mon.0) 384 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-02-02T18:18:02.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.053946+0000 mon.smithi096 (mon.0) 385 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:02.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.057843+0000 mon.smithi096 (mon.0) 386 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:02.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.535948+0000 mgr.smithi096.shfutl (mgr.14162) 135 : audit [DBG] from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:18:02.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.536797+0000 mon.smithi096 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:18:02.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: cephadm 2022-02-02T18:18:01.538160+0000 mgr.smithi096.shfutl (mgr.14162) 136 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:18:02.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.538486+0000 mon.smithi096 (mon.0) 388 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:18:02.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:02 smithi159 conmon[35668]: audit 2022-02-02T18:18:01.539268+0000 mon.smithi096 (mon.0) 389 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:18:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.053502+0000 mon.smithi096 (mon.0) 383 : audit [INF] from='osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:18:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:18:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: -02-02T18:18:01.053562+0000 mon.smithi096 (mon.0) 384 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-02-02T18:18:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.053946+0000 mon.smithi096 (mon.0) 385 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.057843+0000 mon.smithi096 (mon.0) 386 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.535948+0000 mgr.smithi096.shfutl (mgr.14162) 135 : audit [DBG] from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:18:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.536797+0000 mon.smithi096 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T18:18:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: cephadm 2022-02-02T18:18:01.538160+0000 mgr.smithi096.shfutl (mgr.14162) 136 : cephadm [INF] Applying service osd.None on host smithi159... 2022-02-02T18:18:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.538486+0000 mon.smithi096 (mon.0) 388 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T18:18:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:02 smithi096 conmon[32067]: audit 2022-02-02T18:18:01.539268+0000 mon.smithi096 (mon.0) 389 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:18:03.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cluster 2022-02-02T18:18:00.754737+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:18:03.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cluster 2022-02-02T18:18:00.754867+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:18:03.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cluster 2022-02-02T18:18:02.055312+0000 mon.smithi096 (mon.0) 390 : cluster [INF] osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] boot 2022-02-02T18:18:03.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cluster 2022-02-02T18:18:02.055354+0000 mon.smithi096 (mon.0) 391 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-02-02T18:18:03.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: audit 2022-02-02T18:18:02.056077+0000 mon.smithi096 (mon.0) 392 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:03.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cephadm 2022-02-02T18:18:02.463864+0000 mgr.smithi096.shfutl (mgr.14162) 137 : cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:18:03.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: audit 2022-02-02T18:18:02.468816+0000 mon.smithi096 (mon.0) 393 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:03.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:18:03.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: T18:18:02.472858+0000 mon.smithi096 (mon.0) 394 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:03.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: audit 2022-02-02T18:18:02.475912+0000 mon.smithi096 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:03.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:03 smithi159 conmon[35668]: cluster 2022-02-02T18:18:02.781845+0000 mgr.smithi096.shfutl (mgr.14162) 138 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster 2022-02-02T18:18:00.754737+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:18:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster 2022-02-02T18:18:00.754867+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:18:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:18:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 02-02T18:18:02.055312+0000 mon.smithi096 (mon.0) 390 : 2022-02-02T18:18:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster [INF] osd.4 [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] boot 2022-02-02T18:18:03.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster 2022-02- 2022-02-02T18:18:03.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 02T18:18:02.055354+0000 mon.smithi096 2022-02-02T18:18:03.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: (mon.0) 391 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-02-02T18:18:03.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: audit 2022 2022-02-02T18:18:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: -02-02T18:18: 2022-02-02T18:18:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 02.056077+0000 mon.smithi096 (mon.0) 392 : 2022-02-02T18:18:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:18:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cephadm 2022-02 2022-02-02T18:18:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: -02T18:18:02. 2022-02-02T18:18:03.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 463864+0000 mgr.smithi096.shfutl (mgr.14162) 137 : 2022-02-02T18:18:03.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:18:03.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:18:03.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: -02T18:18:02.468816 2022-02-02T18:18:03.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 393 : audit [INF] 2022-02-02T18:18:03.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:03.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: audit 2022-02-02T18 2022-02-02T18:18:03.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: :18:02.472858+0000 mon.smithi096 (mon. 2022-02-02T18:18:03.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 0) 394 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:03.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:18:03.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 02-02T18:18:02. 2022-02-02T18:18:03.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 475912+0000 mon.smithi096 (mon.0) 395 : audit 2022-02-02T18:18:03.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:03.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: cluster 2022-02- 2022-02-02T18:18:03.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: 02T18:18:02.781845+0000 mgr.smithi096.shfutl 2022-02-02T18:18:03.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:03 smithi096 conmon[32067]: (mgr.14162) 138 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: cluster 2022-02-02T18:18:03.479261+0000 mon.smithi096 (mon. 2022-02-02T18:18:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: 0) 396 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-02-02T18:18:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: audit 2022-02-02T18:18:03.867132+0000 mon.smithi159 (mon.1) 8 : audit [INF] from='client.? 172.21.15.159:0/3077687405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]: dispatch 2022-02-02T18:18:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: audit 2022-02-02T18:18:03.867208+0000 mon.smithi096 (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]: dispatch 2022-02-02T18:18:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: audit 2022-02-02T18:18:03.870817+0000 mon.smithi096 (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]': finished 2022-02-02T18:18:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: cluster 2022-02-02T18:18:03.870864+0000 mon.smithi096 (mon.0) 399 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-02-02T18:18:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: audit 2022-02-02T18:18:03.870958+0000 mon.smithi096 (mon.0) 400 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:04 smithi159 conmon[35668]: audit 2022-02-02T18:18:04.289612+0000 mon.smithi159 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.159:0/3986893198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:18:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: cluster 2022-02-02T18:18:03.479261+0000 mon.smithi096 (mon.0) 396 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-02-02T18:18:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:18:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: 02T18:18:03.867132+0000 mon.smithi159 (mon.1) 8 : audit [INF] from='client.? 172.21.15.159:0/3077687405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]: dispatch 2022-02-02T18:18:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit 2022-02-02T18:18:03.867208+0000 mon.smithi096 (mon.0) 397 : 2022-02-02T18:18:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]: dispatch 2022-02-02T18:18:04.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit 2022 2022-02-02T18:18:04.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: -02-02T18:18:03.870817+0000 mon.smithi096 (mon.0) 398 : audit 2022-02-02T18:18:04.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff39853-acbf-4ad7-90a7-9e777d5f2e77"}]': finished 2022-02-02T18:18:04.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: cluster 2022-02-02T18 2022-02-02T18:18:04.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: :18:03.870864+0000 mon.smithi096 ( 2022-02-02T18:18:04.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: mon.0) 399 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-02-02T18:18:04.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit 2022-02-02T18:18:04.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: 2022-02-02T18:18: 2022-02-02T18:18:04.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: 03.870958+0000 mon.smithi096 (mon.0) 400 2022-02-02T18:18:04.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:04.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:18:04.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: T18:18:04.289612+0000 mon.smithi159 2022-02-02T18:18:04.811 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:04 smithi096 conmon[32067]: (mon.1) 9 : audit [DBG] from='client.? 172.21.15.159:0/3986893198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T18:18:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:05 smithi159 conmon[35668]: cluster 2022-02-02T18:18:04.782142+0000 mgr.smithi096.shfutl (mgr.14162) 139 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:05.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:05 smithi096 conmon[32067]: cluster 2022-02-02T18:18:04.782142+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:18:05.810 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:05 smithi096 conmon[32067]: ) 139 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:07 smithi159 conmon[35668]: cluster 2022-02-02T18:18:06.782439+0000 mgr.smithi096.shfutl (mgr.14162) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:07 smithi159 conmon[35668]: audit 2022-02-02T18:18:07.370237+0000 mon.smithi096 (mon.0) 401 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:07 smithi159 conmon[35668]: audit 2022-02-02T18:18:07.373233+0000 mon.smithi096 (mon.0) 402 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:07 smithi096 conmon[32067]: cluster 2022-02-02T18:18:06.782439+0000 mgr.smithi096.shfutl (mgr.14162) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:07 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:18:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:07 smithi096 conmon[32067]: -02T18:18:07.370237+0000 mon.smithi096 (mon.0) 401 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:08.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:07 smithi096 conmon[32067]: audit 2022-02-02T18:18:07.373233+0000 mon.smithi096 (mon.0) 402 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:08.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:07 smithi096 conmon[32067]: 2022-02-02T18:18:10.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:09 smithi159 conmon[35668]: cluster 2022-02-02T18:18:08.782747+0000 mgr.smithi096.shfutl (mgr.14162) 141 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:09 smithi096 conmon[32067]: cluster 2022-02-02T18:18:08.782747+0000 mgr.smithi096.shfutl (mgr.14162) 141 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:11.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:10 smithi159 conmon[35668]: audit 2022-02-02T18:18:10.122994+0000 mon.smithi096 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-02-02T18:18:11.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:10 smithi159 conmon[35668]: 2022-02-02T18:18:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:10 smithi159 conmon[35668]: audit 2022-02-02T18:18:10.123769+0000 mon.smithi096 (mon.0) 404 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:18:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:10 smithi096 conmon[32067]: audit 2022-02-02T18:18:10.122994+0000 mon.smithi096 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-02-02T18:18:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:10 smithi096 conmon[32067]: audit 2022-02-02T18:18:10.123769+0000 mon.smithi096 (mon.0) 404 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:18:12.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:11 smithi159 conmon[35668]: cephadm 2022-02-02T18:18:10.124366+0000 mgr.smithi096.shfutl (mgr.14162) 142 : cephadm [INF] Deploying daemon osd.5 on smithi159 2022-02-02T18:18:12.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:11 smithi159 conmon[35668]: cluster 2022-02-02T18:18:10.783095+0000 mgr.smithi096.shfutl (mgr.14162) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:11 smithi096 conmon[32067]: cephadm 2022-02-02T18:18:10.124366+0000 mgr.smithi096.shfutl (mgr.14162) 142 : cephadm [INF] Deploying daemon osd.5 on smithi159 2022-02-02T18:18:12.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:11 smithi096 conmon[32067]: cluster 2022-02-02T18:18:10.783095+0000 mgr.smithi096.shfutl (mgr.14162) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:13.336 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.331+0000 7f11a7fff700 1 -- 172.21.15.159:0/617746513 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f11c00fdd70 con 0x7f11a805c300 2022-02-02T18:18:13.336 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 5 on host 'smithi159' 2022-02-02T18:18:13.338 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 msgr2=0x7f11a805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:13.338 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 0x7f11a805e7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f11b0004b70 tx=0x7f11b000b040).stop 2022-02-02T18:18:13.338 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 msgr2=0x7f11c0107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:13.339 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f11b4014040 tx=0x7f11b400b040).stop 2022-02-02T18:18:13.339 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 shutdown_connections 2022-02-02T18:18:13.339 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f11a805c300 0x7f11a805e7c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:13.339 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11c00f5a10 0x7f11c0107790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:13.340 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 --2- 172.21.15.159:0/617746513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11c00f63b0 0x7f11c0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:13.340 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 >> 172.21.15.159:0/617746513 conn(0x7f11c00f0320 msgr2=0x7f11c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:13.340 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 shutdown_connections 2022-02-02T18:18:13.340 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:13.335+0000 7f11c4916700 1 -- 172.21.15.159:0/617746513 wait complete. 2022-02-02T18:18:13.709 DEBUG:teuthology.orchestra.run.smithi159:osd.5> sudo journalctl -f -n 0 -u ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.5.service 2022-02-02T18:18:13.712 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2022-02-02T18:18:13.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T18:18:13.746 INFO:journalctl@ceph.osd.5.smithi159.stdout:-- Logs begin at Wed 2022-02-02 18:05:45 UTC. -- 2022-02-02T18:18:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:13 smithi096 conmon[32067]: cluster 2022-02-02T18:18:12.783655+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:18:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:13 smithi096 conmon[32067]: 144 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:13 smithi096 conmon[32067]: audit 2022-02-02T18:18:13.321018+0000 mon.smithi096 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:13 smithi096 conmon[32067]: audit 2022-02-02T18:18:13.325806+0000 mon.smithi096 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:13 smithi096 conmon[32067]: audit 2022-02-02T18:18:13.331828+0000 mon.smithi096 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:13 smithi159 conmon[35668]: cluster 2022-02-02T18:18:12.783655+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:18:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:13 smithi159 conmon[35668]: 144 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:13 smithi159 conmon[35668]: audit 2022-02-02T18:18:13.321018+0000 mon.smithi096 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:13 smithi159 conmon[35668]: audit 2022-02-02T18:18:13.325806+0000 mon.smithi096 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:13 smithi159 conmon[35668]: audit 2022-02-02T18:18:13.331828+0000 mon.smithi096 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.997+0000 7f7a3759e700 1 -- 172.21.15.96:0/2920587315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 msgr2=0x7f7a380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.997+0000 7f7a3759e700 1 --2- 172.21.15.96:0/2920587315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a380f6950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7a28004660 tx=0x7f7a28009b30).stop 2022-02-02T18:18:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 -- 172.21.15.96:0/2920587315 shutdown_connections 2022-02-02T18:18:16.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 --2- 172.21.15.96:0/2920587315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 0x7f7a380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 --2- 172.21.15.96:0/2920587315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a380f6950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 -- 172.21.15.96:0/2920587315 >> 172.21.15.96:0/2920587315 conn(0x7f7a380f1c90 msgr2=0x7f7a380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:16.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 -- 172.21.15.96:0/2920587315 shutdown_connections 2022-02-02T18:18:16.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 -- 172.21.15.96:0/2920587315 wait complete. 2022-02-02T18:18:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 Processor -- start 2022-02-02T18:18:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 -- start start 2022-02-02T18:18:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:15.999+0000 7f7a3759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 0x7f7a381072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381078c0 con 0x7f7a380f6530 2022-02-02T18:18:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a38108100 con 0x7f7a380f77d0 2022-02-02T18:18:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51872/0 (socket says 172.21.15.96:51872) 2022-02-02T18:18:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 -- 172.21.15.96:0/459427615 learned_addr learned my addr 172.21.15.96:0/459427615 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a35d9b700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 0x7f7a381072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 -- 172.21.15.96:0/459427615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 msgr2=0x7f7a381072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 0x7f7a381072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 -- 172.21.15.96:0/459427615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28005040 con 0x7f7a380f6530 2022-02-02T18:18:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3659c700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7a28007a60 tx=0x7f7a28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a28018070 con 0x7f7a380f6530 2022-02-02T18:18:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a38108380 con 0x7f7a380f6530 2022-02-02T18:18:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7a28013410 con 0x7f7a380f6530 2022-02-02T18:18:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2801c400 con 0x7f7a380f6530 2022-02-02T18:18:16.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.000+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a38108860 con 0x7f7a380f6530 2022-02-02T18:18:16.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.001+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a38059100 con 0x7f7a380f6530 2022-02-02T18:18:16.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.002+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7a2801d420 con 0x7f7a380f6530 2022-02-02T18:18:16.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.002+0000 7f7a26ffd700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 0x7f7a2005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.002+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f7a28077910 con 0x7f7a380f6530 2022-02-02T18:18:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.002+0000 7f7a35d9b700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 0x7f7a2005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.002+0000 7f7a35d9b700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 0x7f7a2005e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7a38106b60 tx=0x7f7a2c009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:16.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.007+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7a2804aa70 con 0x7f7a380f6530 2022-02-02T18:18:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.166+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7a380fecf0 con 0x7f7a380f6530 2022-02-02T18:18:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.167+0000 7f7a26ffd700 1 -- 172.21.15.96:0/459427615 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v33) v1 ==== 74+0+130 (secure 0 0 0) 0x7f7a2804e090 con 0x7f7a380f6530 2022-02-02T18:18:16.172 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:16.172 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:15 smithi096 conmon[32067]: cluster 2022-02-02T18:18:14.783981+0000 mgr.smithi096.shfutl (mgr.14162) 145 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:16.172 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:15 smithi096 conmon[32067]: audit 2022-02-02T18:18:15.094709+0000 mon.smithi096 (mon.0) 408 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:18:16.173 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:15 smithi096 conmon[32067]: audit 2022-02-02T18:18:15.094953+0000 mon.smithi096 (mon.0) 409 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:18:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 msgr2=0x7f7a2005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:16.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 0x7f7a2005e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7a38106b60 tx=0x7f7a2c009040).stop 2022-02-02T18:18:16.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 msgr2=0x7f7a38106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:16.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7a28007a60 tx=0x7f7a28009b30).stop 2022-02-02T18:18:16.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 shutdown_connections 2022-02-02T18:18:16.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7a2005c300 0x7f7a2005e7c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a380f6530 0x7f7a38106dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 --2- 172.21.15.96:0/459427615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a380f77d0 0x7f7a381072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:16.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.168+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 >> 172.21.15.96:0/459427615 conn(0x7f7a380f1c90 msgr2=0x7f7a380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:16.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.169+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 shutdown_connections 2022-02-02T18:18:16.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:16.169+0000 7f7a3759e700 1 -- 172.21.15.96:0/459427615 wait complete. 2022-02-02T18:18:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:15 smithi159 conmon[35668]: cluster 2022-02-02T18:18:14.783981+0000 mgr.smithi096.shfutl (mgr.14162) 145 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:15 smithi159 conmon[35668]: audit 2022-02-02T18:18:15.094709+0000 mon.smithi096 (mon.0) 408 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:18:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:15 smithi159 conmon[35668]: audit 2022-02-02T18:18:15.094953+0000 mon.smithi096 (mon.0) 409 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:18:16.644 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":33,"num_osds":6,"num_up_osds":5,"osd_up_since":1643825882,"num_in_osds":6,"osd_in_since":1643825883,"num_remapped_pgs":0} 2022-02-02T18:18:17.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:17 smithi159 conmon[35668]: audit 2022-02-02T18:18:16.000648+0000 mon.smithi096 (mon.0) 410 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:17.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:17 smithi159 conmon[35668]: audit 2022-02-02T18:18:16.168693+0000 mon.smithi096 (mon.0) 411 : audit [DBG] from='client.? 172.21.15.96:0/459427615' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:17 smithi159 conmon[35668]: cluster 2022-02-02T18:18:16.784315+0000 mgr.smithi096.shfutl (mgr.14162) 146 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:17.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:17 smithi096 conmon[32067]: audit 2022-02-02T18:18:16.000648+0000 mon.smithi096 (mon. 2022-02-02T18:18:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:17 smithi096 conmon[32067]: 0) 410 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:17 smithi096 conmon[32067]: audit 2022-02-02T18:18:16.168693+0000 mon.smithi096 (mon.0) 411 : audit [DBG] from='client.? 172.21.15.96:0/459427615' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:17 smithi096 conmon[32067]: cluster 2022-02-02T18:18:16.784315+0000 mgr.smithi096.shfutl (mgr.14162) 146 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:17.645 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T18:18:17.776 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:18:17 smithi159 conmon[51955]: debug 2022-02-02T18:18:17.281+0000 7f9846557080 -1 osd.5 0 log_to_monitors {default=true} 2022-02-02T18:18:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:18 smithi159 conmon[35668]: audit 2022-02-02T18:18:17.285142+0000 mon.smithi096 (mon.0) 2022-02-02T18:18:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:18 smithi159 conmon[35668]: 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:18:18.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:18 smithi159 conmon[35668]: audit 2022-02-02T18:18:17.285220+0000 mon.smithi159 (mon.1) 10 : audit [INF] from='osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:18:18.294 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:18 smithi096 conmon[32067]: audit 2022-02-02T18:18:17.285142+0000 mon.smithi096 (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:18:18.294 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:18 smithi096 conmon[32067]: audit 2022-02-02T18:18:17.285220+0000 mon.smithi159 (mon.1) 10 : audit [INF] from='osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:18:19.276 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[51955]: debug 2022-02-02T18:18:19.018+0000 7f983cac8700 -1 osd.5 0 waiting for initial osdmap 2022-02-02T18:18:19.276 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[51955]: debug 2022-02-02T18:18:19.027+0000 7f9837240700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-02-02T18:18:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: audit 2022-02-02T18:18:18.014706+0000 mon.smithi096 (mon.0) 413 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T18:18:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: 2022-02-02T18:18:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: cluster 2022-02-02T18:18:18.014801+0000 mon.smithi096 (mon.0) 414 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-02-02T18:18:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: audit 2022-02-02T18:18:18.014913+0000 mon.smithi096 (mon.0) 415 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: audit 2022-02-02T18:18:18.015721+0000 mon.smithi096 (mon.0) 416 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: audit 2022-02-02T18:18:18.015800+0000 mon.smithi159 (mon.1) 11 : audit [INF] from='osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: cluster 2022-02-02T18:18:18.784779+0000 mgr.smithi096.shfutl (mgr.14162) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:19.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: cephadm 2022-02-02T18:18:18.903300+0000 mgr.smithi096.shfutl (mgr.14162) 148 : cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:18:19.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:19 smithi159 conmon[35668]: audit 2022-02-02T18:18:18.906997+0000 mon.smithi096 (mon.0) 417 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:19.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: audit 2022-02-02T18:18:18.014706+0000 mon.smithi096 (mon.0) 413 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T18:18:19.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: cluster 2022-02-02T18:18:18.014801+0000 mon.smithi096 (mon.0) 414 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-02-02T18:18:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: audit 2022-02-02T18:18:18.014913+0000 mon.smithi096 (mon.0) 415 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: audit 2022-02-02T18:18:18.015721+0000 mon.smithi096 (mon.0) 416 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: audit 2022-02-02T18:18:18.015800+0000 mon.smithi159 (mon.1) 11 : audit [INF] from='osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:18:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: cluster 2022-02-02T18:18:18.784779+0000 mgr.smithi096.shfutl (mgr.14162) 147 : cluster 2022-02-02T18:18:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:19.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: cephadm 2022-02-02T18:18:18.903300+0000 mgr.smithi096.shfutl (mgr.14162) 148 : cephadm [INF] Detected new or changed devices on smithi159 2022-02-02T18:18:19.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:19 smithi096 conmon[32067]: audit 2022-02-02T18:18:18.906997+0000 mon.smithi096 (mon.0) 417 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- 172.21.15.96:0/4203602021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f77d0 msgr2=0x7f950c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 --2- 172.21.15.96:0/4203602021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f77d0 0x7f950c0f7c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f9500004660 tx=0x7f9500009b30).stop 2022-02-02T18:18:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- 172.21.15.96:0/4203602021 shutdown_connections 2022-02-02T18:18:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 --2- 172.21.15.96:0/4203602021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f77d0 0x7f950c0f7c30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 --2- 172.21.15.96:0/4203602021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f6530 0x7f950c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- 172.21.15.96:0/4203602021 >> 172.21.15.96:0/4203602021 conn(0x7f950c0f1cd0 msgr2=0x7f950c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- 172.21.15.96:0/4203602021 shutdown_connections 2022-02-02T18:18:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- 172.21.15.96:0/4203602021 wait complete. 2022-02-02T18:18:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 Processor -- start 2022-02-02T18:18:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- start start 2022-02-02T18:18:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f77d0 0x7f950c107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c1077c0 con 0x7f950c0f6530 2022-02-02T18:18:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.482+0000 7f950b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c107fc0 con 0x7f950c0f77d0 2022-02-02T18:18:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51882/0 (socket says 172.21.15.96:51882) 2022-02-02T18:18:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 -- 172.21.15.96:0/409271445 learned_addr learned my addr 172.21.15.96:0/409271445 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f9509d9b700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f77d0 0x7f950c107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 -- 172.21.15.96:0/409271445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f77d0 msgr2=0x7f950c107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f77d0 0x7f950c107210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 -- 172.21.15.96:0/409271445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500005040 con 0x7f950c0f6530 2022-02-02T18:18:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950a59c700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f950400d8d0 tx=0x7f9504004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f950400b4b0 con 0x7f950c0f6530 2022-02-02T18:18:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f950400f040 con 0x7f950c0f6530 2022-02-02T18:18:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c1082a0 con 0x7f950c0f6530 2022-02-02T18:18:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9504013940 con 0x7f950c0f6530 2022-02-02T18:18:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.483+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c108860 con 0x7f950c0f6530 2022-02-02T18:18:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.484+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c059100 con 0x7f950c0f6530 2022-02-02T18:18:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.484+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f950401a030 con 0x7f950c0f6530 2022-02-02T18:18:19.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.485+0000 7f94faffd700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 0x7f94f405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.485+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4239+0+0 (secure 0 0 0) 0x7f9504075840 con 0x7f950c0f6530 2022-02-02T18:18:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.485+0000 7f9509d9b700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 0x7f94f405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.485+0000 7f9509d9b700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 0x7f94f405e7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9500005010 tx=0x7f9500009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.489+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f95040489a0 con 0x7f950c0f6530 2022-02-02T18:18:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.657+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f950c045ad0 con 0x7f950c0f6530 2022-02-02T18:18:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.658+0000 7f94faffd700 1 -- 172.21.15.96:0/409271445 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) v1 ==== 74+0+130 (secure 0 0 0) 0x7f950404bfc0 con 0x7f950c0f6530 2022-02-02T18:18:19.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:19.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 msgr2=0x7f94f405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:19.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 0x7f94f405e7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9500005010 tx=0x7f9500009b30).stop 2022-02-02T18:18:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 msgr2=0x7f950c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f950400d8d0 tx=0x7f9504004f00).stop 2022-02-02T18:18:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 shutdown_connections 2022-02-02T18:18:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f94f405c300 0x7f94f405e7c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950c0f6530 0x7f950c106d20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 --2- 172.21.15.96:0/409271445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f950c0f77d0 0x7f950c107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 >> 172.21.15.96:0/409271445 conn(0x7f950c0f1cd0 msgr2=0x7f950c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 shutdown_connections 2022-02-02T18:18:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:19.659+0000 7f950b59e700 1 -- 172.21.15.96:0/409271445 wait complete. 2022-02-02T18:18:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1643825882,"num_in_osds":6,"osd_in_since":1643825883,"num_remapped_pgs":0} 2022-02-02T18:18:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022-02-02T18:18:19.013608+0000 mon.smithi096 (mon.0) 2022-02-02T18:18:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:18:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: cluster 2022-02-02T18:18:19.013719+0000 mon.smithi096 (mon.0) 419 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-02-02T18:18:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022-02-02T18:18:19.014138+0000 mon.smithi096 2022-02-02T18:18:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: (mon.0) 420 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 2022-02-02T18:18:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:18:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 02T18:18:19.019530+0000 2022-02-02T18:18:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: mon.smithi096 (mon.0) 421 : audit 2022-02-02T18:18:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:18:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 02-02T18:18:19.257078 2022-02-02T18:18:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 422 : audit 2022-02-02T18:18:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:20.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:18:20.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 02-02T18:18:19.262536 2022-02-02T18:18:20.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 423 : audit 2022-02-02T18:18:20.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:20.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:18:20.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: -02T18:18:19.264944+0000 2022-02-02T18:18:20.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: mon.smithi096 (mon.0) 424 : audit 2022-02-02T18:18:20.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:20.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:18:20.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: 02T18:18:19.659563+0000 2022-02-02T18:18:20.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: mon.smithi096 (mon.0) 425 : audit 2022-02-02T18:18:20.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:20 smithi159 conmon[35668]: [DBG] from='client.? 172.21.15.96:0/409271445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19 2022-02-02T18:18:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: .013608+0000 mon.smithi096 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2022-02-02T18:18:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: cluster 2022-02-02T18:18:19.013719+0000 mon.smithi096 (mon.0) 419 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-02-02T18:18:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.014138+0000 mon.smithi096 (mon.0) 420 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.019530+0000 mon.smithi096 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.257078+0000 mon.smithi096 (mon.0) 422 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.262536+0000 mon.smithi096 (mon.0) 423 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.264944+0000 mon.smithi096 (mon.0) 424 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:18:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:20 smithi096 conmon[32067]: audit 2022-02-02T18:18:19.659563+0000 mon.smithi096 (mon.0) 425 : audit [DBG] from='client.? 172.21.15.96:0/409271445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:21.075 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T18:18:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: cluster 2022-02-02T18:18:18.316023+0000 osd.5 (osd. 2022-02-02T18:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: 5) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T18:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: cluster 2022-02-02T18:18:18.316126+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: cluster 2022-02-02T18:18:20.019114+0000 mon.smithi096 (mon.0) 426 : cluster [INF] osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] boot 2022-02-02T18:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: cluster 2022-02-02T18:18:20.019172+0000 mon.smithi096 (mon.0) 427 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-02-02T18:18:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: audit 2022-02-02T18:18:20.019572+0000 mon.smithi096 (mon.0) 428 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:21 smithi096 conmon[32067]: cluster 2022-02-02T18:18:20.785066+0000 mgr.smithi096.shfutl (mgr.14162) 149 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: cluster 2022-02-02T18:18:18.316023+0000 osd.5 (osd.5) 1 : cluster [DBG] 2022-02-02T18:18:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: purged_snaps scrub starts 2022-02-02T18:18:21.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: cluster 2022-02-02T18:18:18.316126+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T18:18:21.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: cluster 2022-02-02T18:18:20.019114+0000 mon.smithi096 (mon.0) 426 : cluster [INF] osd.5 [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] boot 2022-02-02T18:18:21.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: cluster 2022-02-02T18:18:20.019172+0000 mon.smithi096 (mon.0) 427 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-02-02T18:18:21.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: audit 2022-02-02T18:18:20.019572+0000 mon.smithi096 (mon.0) 428 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:18:21.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: cluster 2022-02-02T18: 2022-02-02T18:18:21.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: 18:20.785066+0000 mgr.smithi096.shfutl (mgr.14162) 149 2022-02-02T18:18:21.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:21 smithi159 conmon[35668]: : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T18:18:22.161 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:22 smithi096 conmon[32067]: cluster 2022-02-02T18:18:21.027600+0000 mon.smithi096 (mon.0) 429 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-02-02T18:18:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:22 smithi159 conmon[35668]: cluster 2022-02-02T18:18:21.027600+0000 mon.smithi096 (mon.0) 429 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-02-02T18:18:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 -- 172.21.15.96:0/95005381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f55c0 msgr2=0x7fdb640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/95005381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f55c0 0x7fdb640f59e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdb4c004660 tx=0x7fdb4c009b30).stop 2022-02-02T18:18:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 -- 172.21.15.96:0/95005381 shutdown_connections 2022-02-02T18:18:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/95005381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f6860 0x7fdb640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/95005381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f55c0 0x7fdb640f59e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 -- 172.21.15.96:0/95005381 >> 172.21.15.96:0/95005381 conn(0x7fdb640f0d40 msgr2=0x7fdb640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 -- 172.21.15.96:0/95005381 shutdown_connections 2022-02-02T18:18:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.045+0000 7fdb6ab09700 1 -- 172.21.15.96:0/95005381 wait complete. 2022-02-02T18:18:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 Processor -- start 2022-02-02T18:18:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 -- start start 2022-02-02T18:18:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f55c0 0x7fdb6410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640602b0 con 0x7fdb640f6860 2022-02-02T18:18:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb6ab09700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640603f0 con 0x7fdb640f55c0 2022-02-02T18:18:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51906/0 (socket says 172.21.15.96:51906) 2022-02-02T18:18:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 -- 172.21.15.96:0/1966921657 learned_addr learned my addr 172.21.15.96:0/1966921657 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb688a5700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f55c0 0x7fdb6410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 -- 172.21.15.96:0/1966921657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f55c0 msgr2=0x7fdb6410c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f55c0 0x7fdb6410c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.046+0000 7fdb63fff700 1 -- 172.21.15.96:0/1966921657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c005040 con 0x7fdb640f6860 2022-02-02T18:18:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb63fff700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdb5400c530 tx=0x7fdb54007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb5400f650 con 0x7fdb640f6860 2022-02-02T18:18:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6410ea80 con 0x7fdb640f6860 2022-02-02T18:18:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdb5400fc40 con 0x7fdb640f6860 2022-02-02T18:18:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb54012c40 con 0x7fdb640f6860 2022-02-02T18:18:23.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.047+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6410ef00 con 0x7fdb640f6860 2022-02-02T18:18:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.048+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64045ad0 con 0x7fdb640f6860 2022-02-02T18:18:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.048+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdb54010070 con 0x7fdb640f6860 2022-02-02T18:18:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.048+0000 7fdb617fa700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 0x7fdb5005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.049+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fdb54075910 con 0x7fdb640f6860 2022-02-02T18:18:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.049+0000 7fdb688a5700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 0x7fdb5005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.049+0000 7fdb688a5700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 0x7fdb5005e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdb4c004e30 tx=0x7fdb4c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.052+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdb540452b0 con 0x7fdb640f6860 2022-02-02T18:18:23.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.213+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fdb64027a00 con 0x7fdb640f6860 2022-02-02T18:18:23.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.214+0000 7fdb617fa700 1 -- 172.21.15.96:0/1966921657 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7fdb54048930 con 0x7fdb640f6860 2022-02-02T18:18:23.218 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:23.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.215+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 msgr2=0x7fdb5005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:23.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.215+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 0x7fdb5005e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdb4c004e30 tx=0x7fdb4c009b30).stop 2022-02-02T18:18:23.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.215+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 msgr2=0x7fdb6410e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:23.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.215+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdb5400c530 tx=0x7fdb54007e20).stop 2022-02-02T18:18:23.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 shutdown_connections 2022-02-02T18:18:23.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fdb5005c2b0 0x7fdb5005e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb640f55c0 0x7fdb6410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 --2- 172.21.15.96:0/1966921657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb640f6860 0x7fdb6410e590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:23.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 >> 172.21.15.96:0/1966921657 conn(0x7fdb640f0d40 msgr2=0x7fdb640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:23.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 shutdown_connections 2022-02-02T18:18:23.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:23.216+0000 7fdb6ab09700 1 -- 172.21.15.96:0/1966921657 wait complete. 2022-02-02T18:18:23.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:23 smithi096 conmon[32067]: cluster 2022-02-02T18:18:22.785369+0000 mgr.smithi096.shfutl (mgr.14162) 150 2022-02-02T18:18:23.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:23 smithi096 conmon[32067]: : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:23.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:23 smithi159 conmon[35668]: cluster 2022-02-02T18:18:22.785369+0000 mgr.smithi096.shfutl (mgr.14162) 150 : cluster 2022-02-02T18:18:23.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:23 smithi159 conmon[35668]: [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:23.788 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1643825900,"num_in_osds":6,"osd_in_since":1643825883,"num_remapped_pgs":0} 2022-02-02T18:18:23.789 INFO:tasks.cephadm:Setting up client nodes... 2022-02-02T18:18:23.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-02-02T18:18:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:24 smithi096 conmon[32067]: audit 2022-02-02T18:18:23.215582+0000 mon.smithi096 (mon.0) 430 : audit [DBG] from='client.? 172.21.15.96:0/1966921657' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:24 smithi159 conmon[35668]: audit 2022-02-02T18:18:23.215582+0000 mon.smithi096 (mon.0) 430 : audit [DBG] from='client.? 172.21.15.96:0/1966921657' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T18:18:25.121 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:25 smithi096 conmon[32067]: cluster 2022-02-02T18:18:24.785618+0000 mgr.smithi096.shfutl (mgr.14162) 151 : cluster [DBG] 2022-02-02T18:18:25.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:25 smithi096 conmon[32067]: pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:25.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:25 smithi159 conmon[35668]: cluster 2022-02-02T18:18:24.785618+0000 mgr.smithi096.shfutl (mgr.14162) 151 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:25.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 -- 172.21.15.96:0/968405012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f7ba0 msgr2=0x7f3c8c0f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:25.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/968405012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c0f7fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3c7c004660 tx=0x7f3c7c009b30).stop 2022-02-02T18:18:25.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 -- 172.21.15.96:0/968405012 shutdown_connections 2022-02-02T18:18:25.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/968405012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c0f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/968405012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c0f7fc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 -- 172.21.15.96:0/968405012 >> 172.21.15.96:0/968405012 conn(0x7f3c8c0f0320 msgr2=0x7f3c8c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:25.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 -- 172.21.15.96:0/968405012 shutdown_connections 2022-02-02T18:18:25.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 -- 172.21.15.96:0/968405012 wait complete. 2022-02-02T18:18:25.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.623+0000 7f3c8bfff700 1 Processor -- start 2022-02-02T18:18:25.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 -- start start 2022-02-02T18:18:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c107900 con 0x7f3c8c0f8540 2022-02-02T18:18:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c108110 con 0x7f3c8c0f7ba0 2022-02-02T18:18:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51916/0 (socket says 172.21.15.96:51916) 2022-02-02T18:18:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 -- 172.21.15.96:0/3856636843 learned_addr learned my addr 172.21.15.96:0/3856636843 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8affd700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 -- 172.21.15.96:0/3856636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 msgr2=0x7f3c8c106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 -- 172.21.15.96:0/3856636843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c005040 con 0x7f3c8c0f8540 2022-02-02T18:18:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8affd700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:18:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8a7fc700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3c8000c530 tx=0x7f3c80007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8000f650 con 0x7f3c8c0f8540 2022-02-02T18:18:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c108390 con 0x7f3c8c0f8540 2022-02-02T18:18:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3c8000fc40 con 0x7f3c8c0f8540 2022-02-02T18:18:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.624+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c80012c40 con 0x7f3c8c0f8540 2022-02-02T18:18:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.625+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c108950 con 0x7f3c8c0f8540 2022-02-02T18:18:25.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.625+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c059100 con 0x7f3c8c0f8540 2022-02-02T18:18:25.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.626+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3c80010070 con 0x7f3c8c0f8540 2022-02-02T18:18:25.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.626+0000 7f3c737fe700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 0x7f3c7405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:25.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.626+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3c80075950 con 0x7f3c8c0f8540 2022-02-02T18:18:25.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.626+0000 7f3c8affd700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 0x7f3c7405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:25.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.627+0000 7f3c8affd700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 0x7f3c7405e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3c7c004e30 tx=0x7f3c7c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:25.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.631+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3c800452b0 con 0x7f3c8c0f8540 2022-02-02T18:18:25.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.843+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3c8c0fed10 con 0x7f3c8c0f8540 2022-02-02T18:18:25.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.847+0000 7f3c737fe700 1 -- 172.21.15.96:0/3856636843 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3c8004c3a0 con 0x7f3c8c0f8540 2022-02-02T18:18:25.851 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2022-02-02T18:18:25.851 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDxyvphSMdjMhAAdKj2mG/0uvvnCqQ+0ry8pw== 2022-02-02T18:18:25.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 msgr2=0x7f3c7405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:25.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 0x7f3c7405e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3c7c004e30 tx=0x7f3c7c009b30).stop 2022-02-02T18:18:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 msgr2=0x7f3c8c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3c8000c530 tx=0x7f3c80007e20).stop 2022-02-02T18:18:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 shutdown_connections 2022-02-02T18:18:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3c7405c300 0x7f3c7405e7c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f7ba0 0x7f3c8c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.848+0000 7f3c8bfff700 1 --2- 172.21.15.96:0/3856636843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f8540 0x7f3c8c107300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.849+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 >> 172.21.15.96:0/3856636843 conn(0x7f3c8c0f0320 msgr2=0x7f3c8c0fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.849+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 shutdown_connections 2022-02-02T18:18:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:25.849+0000 7f3c8bfff700 1 -- 172.21.15.96:0/3856636843 wait complete. 2022-02-02T18:18:26.305 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:18:26.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2022-02-02T18:18:26.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-02-02T18:18:26.347 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-02-02T18:18:27.015 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:26 smithi159 conmon[35668]: audit 2022-02-02T18:18:25.762540+0000 mon.smithi096 (mon.0) 2022-02-02T18:18:27.016 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:26 smithi159 conmon[35668]: 431 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:27.016 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:26 smithi159 conmon[35668]: audit 2022-02-02T18:18:25.765699+0000 mon.smithi096 (mon.0) 432 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:27.016 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:26 smithi159 conmon[35668]: audit 2022-02-02T18:18:25.845252+0000 mon.smithi096 (mon.0) 433 : audit [INF] from='client.? 172.21.15.96:0/3856636843' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:27.017 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:26 smithi159 conmon[35668]: audit 2022-02-02T18:18:25.848667+0000 mon.smithi096 (mon.0) 434 : audit [INF] from='client.? 172.21.15.96:0/3856636843' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T18:18:27.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:26 smithi096 conmon[32067]: audit 2022-02-02T18:18:25.762540+0000 mon.smithi096 (mon.0) 431 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:27.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:26 smithi096 conmon[32067]: audit 2022-02-02T18:18:25.765699+0000 mon.smithi096 (mon.0) 432 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:18:27.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:26 smithi096 conmon[32067]: audit 2022-02-02T18:18:25.845252+0000 mon.smithi096 (mon.0) 433 : audit [INF] from='client.? 172.21.15.96:0/3856636843' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:27.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:26 smithi096 conmon[32067]: audit 2022-02-02T18:18:25.848667+0000 mon.smithi096 (mon.0) 434 : audit [INF] from='client.? 172.21.15.96:0/3856636843' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T18:18:27.724 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 -- 172.21.15.159:0/3935106338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 msgr2=0x7f6b080f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:27.725 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/3935106338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b080f6cb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6b04004660 tx=0x7f6b04009b30).stop 2022-02-02T18:18:27.725 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 -- 172.21.15.159:0/3935106338 shutdown_connections 2022-02-02T18:18:27.725 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/3935106338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b080f6cb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.726 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/3935106338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 0x7f6b080f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.726 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 -- 172.21.15.159:0/3935106338 >> 172.21.15.159:0/3935106338 conn(0x7f6b080f0d10 msgr2=0x7f6b080f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:27.726 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 -- 172.21.15.159:0/3935106338 shutdown_connections 2022-02-02T18:18:27.726 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.719+0000 7f6b0f56f700 1 -- 172.21.15.159:0/3935106338 wait complete. 2022-02-02T18:18:27.727 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 Processor -- start 2022-02-02T18:18:27.727 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 -- start start 2022-02-02T18:18:27.727 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 0x7f6b08106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:27.727 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:27.728 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08107a00 con 0x7f6b080f55b0 2022-02-02T18:18:27.728 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0f56f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08107b40 con 0x7f6b080f6850 2022-02-02T18:18:27.728 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0cb0a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:27.728 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0cb0a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43148/0 (socket says 172.21.15.159:43148) 2022-02-02T18:18:27.729 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.720+0000 7f6b0cb0a700 1 -- 172.21.15.159:0/2902033709 learned_addr learned my addr 172.21.15.159:0/2902033709 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-02-02T18:18:27.729 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0d30b700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 0x7f6b08106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:27.729 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0cb0a700 1 -- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 msgr2=0x7f6b08106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:27.729 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0cb0a700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 0x7f6b08106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.730 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0cb0a700 1 -- 172.21.15.159:0/2902033709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04005040 con 0x7f6b080f6850 2022-02-02T18:18:27.730 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0cb0a700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6b04009990 tx=0x7f6b04009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:27.730 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b04018070 con 0x7f6b080f6850 2022-02-02T18:18:27.730 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b08108480 con 0x7f6b080f6850 2022-02-02T18:18:27.730 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6b04013410 con 0x7f6b080f6850 2022-02-02T18:18:27.731 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0401c620 con 0x7f6b080f6850 2022-02-02T18:18:27.731 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.721+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b081089e0 con 0x7f6b080f6850 2022-02-02T18:18:27.732 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.722+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b08045ad0 con 0x7f6b080f6850 2022-02-02T18:18:27.733 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.722+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6b0401d420 con 0x7f6b080f6850 2022-02-02T18:18:27.733 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.723+0000 7f6afdffb700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 0x7f6af405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:27.733 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.723+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f6b04077a40 con 0x7f6b080f6850 2022-02-02T18:18:27.734 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.723+0000 7f6b0d30b700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 0x7f6af405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:27.734 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.723+0000 7f6b0d30b700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 0x7f6af405e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6af8007fd0 tx=0x7f6af8009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:27.734 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.727+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6b0404aae0 con 0x7f6b080f6850 2022-02-02T18:18:27.937 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.934+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6b08109130 con 0x7f6b080f6850 2022-02-02T18:18:27.941 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.939+0000 7f6afdffb700 1 -- 172.21.15.159:0/2902033709 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6b0404e100 con 0x7f6b080f6850 2022-02-02T18:18:27.942 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2022-02-02T18:18:27.942 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDzyvphRmjMNxAA3NrEJF2agSbrPcbbA75NDg== 2022-02-02T18:18:27.944 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 msgr2=0x7f6af405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:27.944 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 0x7f6af405e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6af8007fd0 tx=0x7f6af8009040).stop 2022-02-02T18:18:27.944 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 msgr2=0x7f6b08107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:27.944 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6b04009990 tx=0x7f6b04009b30).stop 2022-02-02T18:18:27.945 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 shutdown_connections 2022-02-02T18:18:27.945 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6af405c2b0 0x7f6af405e770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.945 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080f55b0 0x7f6b08106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.945 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 --2- 172.21.15.159:0/2902033709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b080f6850 0x7f6b08107450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:27.946 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 >> 172.21.15.159:0/2902033709 conn(0x7f6b080f0d10 msgr2=0x7f6b0805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:27.946 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 shutdown_connections 2022-02-02T18:18:27.946 INFO:teuthology.orchestra.run.smithi159.stderr:2022-02-02T18:18:27.941+0000 7f6b0f56f700 1 -- 172.21.15.159:0/2902033709 wait complete. 2022-02-02T18:18:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:27 smithi159 conmon[35668]: cluster 2022-02-02T18:18:26.786049+0000 mgr.smithi096.shfutl (mgr.14162) 152 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:27 smithi096 conmon[32067]: cluster 2022-02-02T18:18:26.786049+0000 mgr.smithi096.shfutl (mgr.14162) 152 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:27 smithi096 conmon[32067]: 2022-02-02T18:18:28.462 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:18:28.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2022-02-02T18:18:28.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-02-02T18:18:28.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T18:18:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:28 smithi096 conmon[32067]: audit 2022-02-02T18:18:27.935716+0000 mon.smithi159 (mon.1) 12 : audit 2022-02-02T18:18:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:28 smithi096 conmon[32067]: [INF] from='client.? 172.21.15.159:0/2902033709' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:28 smithi096 conmon[32067]: audit 2022-02-02T18:18:27.935963+0000 mon.smithi096 (mon.0) 435 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:28 smithi096 conmon[32067]: audit 2022-02-02T18:18:27.939354+0000 2022-02-02T18:18:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:28 smithi096 conmon[32067]: mon.smithi096 (mon.0) 436 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T18:18:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:28 smithi159 conmon[35668]: audit 2022-02-02T18:18:27.935716+0000 mon.smithi159 (mon.1) 12 : audit [INF] from='client.? 172.21.15.159:0/2902033709' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:28 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:18:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:28 smithi159 conmon[35668]: 02T18:18:27.935963+0000 mon.smithi096 (mon.0) 435 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T18:18:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:28 smithi159 conmon[35668]: audit 2022-02-02T18:18:27.939354+0000 mon.smithi096 (mon.0) 436 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T18:18:30.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:29 smithi096 conmon[32067]: cluster 2022-02-02T18:18:28.786513+0000 mgr.smithi096.shfutl 2022-02-02T18:18:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:29 smithi096 conmon[32067]: (mgr.14162) 153 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:29 smithi159 conmon[35668]: cluster 2022-02-02T18:18:28.786513+0000 mgr.smithi096.shfutl (mgr.14162) 153 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:30.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 -- 172.21.15.96:0/182263508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 msgr2=0x7f9d140f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:30.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/182263508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d140f6c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9d10004660 tx=0x7f9d10009b30).stop 2022-02-02T18:18:30.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 -- 172.21.15.96:0/182263508 shutdown_connections 2022-02-02T18:18:30.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/182263508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d140f6c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/182263508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 0x7f9d140f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 -- 172.21.15.96:0/182263508 >> 172.21.15.96:0/182263508 conn(0x7f9d140f0ca0 msgr2=0x7f9d140f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:30.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 -- 172.21.15.96:0/182263508 shutdown_connections 2022-02-02T18:18:30.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.335+0000 7f9d1a80b700 1 -- 172.21.15.96:0/182263508 wait complete. 2022-02-02T18:18:30.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 Processor -- start 2022-02-02T18:18:30.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 -- start start 2022-02-02T18:18:30.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 0x7f9d14106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:30.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:30.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14107960 con 0x7f9d140f67c0 2022-02-02T18:18:30.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d1a80b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14107aa0 con 0x7f9d140f5520 2022-02-02T18:18:30.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d19008700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:30.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d19008700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51926/0 (socket says 172.21.15.96:51926) 2022-02-02T18:18:30.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d19008700 1 -- 172.21.15.96:0/2428124964 learned_addr learned my addr 172.21.15.96:0/2428124964 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:30.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d19008700 1 -- 172.21.15.96:0/2428124964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 msgr2=0x7f9d14106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:30.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.336+0000 7f9d19809700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 0x7f9d14106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:30.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d19008700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 0x7f9d14106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d19008700 1 -- 172.21.15.96:0/2428124964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10005040 con 0x7f9d140f67c0 2022-02-02T18:18:30.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d19008700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9d10009990 tx=0x7f9d10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:30.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d10018070 con 0x7f9d140f67c0 2022-02-02T18:18:30.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9d10013410 con 0x7f9d140f67c0 2022-02-02T18:18:30.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d141083e0 con 0x7f9d140f67c0 2022-02-02T18:18:30.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1001c620 con 0x7f9d140f67c0 2022-02-02T18:18:30.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.337+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d14108940 con 0x7f9d140f67c0 2022-02-02T18:18:30.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.338+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d14045ad0 con 0x7f9d140f67c0 2022-02-02T18:18:30.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.338+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9d1001c8e0 con 0x7f9d140f67c0 2022-02-02T18:18:30.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.338+0000 7f9d0a7fc700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 0x7f9d0005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:30.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.339+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f9d10077b40 con 0x7f9d140f67c0 2022-02-02T18:18:30.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.339+0000 7f9d19809700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 0x7f9d0005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:30.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.339+0000 7f9d19809700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 0x7f9d0005e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9d140f6620 tx=0x7f9d04009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:30.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.343+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9d1004ab60 con 0x7f9d140f67c0 2022-02-02T18:18:30.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.493+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d1410d4e0 con 0x7f9d140f67c0 2022-02-02T18:18:30.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.494+0000 7f9d0a7fc700 1 -- 172.21.15.96:0/2428124964 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10880 (secure 0 0 0) 0x7f9d1004e180 con 0x7f9d140f67c0 2022-02-02T18:18:30.497 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:30.497 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":37,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","created":"2022-02-02T18:14:19.866158+0000","modified":"2022-02-02T18:18:21.020786+0000","last_up_change":"2022-02-02T18:18:20.014966+0000","last_in_change":"2022-02-02T18:18:03.867700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T18:17:38.891092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8d7ab242-00e2-4b8d-a7be-0bf62b292a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6803","nonce":195432068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6805","nonce":195432068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6809","nonce":195432068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6807","nonce":195432068}]},"public_addr":"172.21.15.96:6803/195432068","cluster_addr":"172.21.15.96:6805/195432068","heartbeat_back_addr":"172.21.15.96:6809/195432068","heartbeat_front_addr":"172.21.15.96:6807/195432068","state":["exists","up"]},{"osd":1,"uuid":"dec772e4-b9e6-4351-a19d-64fdd5df9e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6811","nonce":2713933524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6813","nonce":2713933524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6817","nonce":2713933524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6815","nonce":2713933524}]},"public_addr":"172.21.15.96:6811/2713933524","cluster_addr":"172.21.15.96:6813/2713933524","heartbeat_back_addr":"172.21.15.96:6817/2713933524","heartbeat_front_addr":"172.21.15.96:6815/2713933524","state":["exists","up"]},{"osd":2,"uuid":"71e07e53-0fd8-4df3-8306-f483afe6fbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6819","nonce":620516912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6821","nonce":620516912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6825","nonce":620516912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6823","nonce":620516912}]},"public_addr":"172.21.15.96:6819/620516912","cluster_addr":"172.21.15.96:6821/620516912","heartbeat_back_addr":"172.21.15.96:6825/620516912","heartbeat_front_addr":"172.21.15.96:6823/620516912","state":["exists","up"]},{"osd":3,"uuid":"7a85a335-124c-4fcd-bbc5-db2bd88eaa14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6801","nonce":3926735851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6803","nonce":3926735851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6807","nonce":3926735851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6805","nonce":3926735851}]},"public_addr":"172.21.15.159:6801/3926735851","cluster_addr":"172.21.15.159:6803/3926735851","heartbeat_back_addr":"172.21.15.159:6807/3926735851","heartbeat_front_addr":"172.21.15.159:6805/3926735851","state":["exists","up"]},{"osd":4,"uuid":"b22a2951-4fd4-4bc3-bc1e-f315e3d9514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6809","nonce":3593977560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6811","nonce":3593977560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6815","nonce":3593977560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6813","nonce":3593977560}]},"public_addr":"172.21.15.159:6809/3593977560","cluster_addr":"172.21.15.159:6811/3593977560","heartbeat_back_addr":"172.21.15.159:6815/3593977560","heartbeat_front_addr":"172.21.15.159:6813/3593977560","state":["exists","up"]},{"osd":5,"uuid":"0ff39853-acbf-4ad7-90a7-9e777d5f2e77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6817","nonce":3899321246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6819","nonce":3899321246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6823","nonce":3899321246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6821","nonce":3899321246}]},"public_addr":"172.21.15.159:6817/3899321246","cluster_addr":"172.21.15.159:6819/3899321246","heartbeat_back_addr":"172.21.15.159:6823/3899321246","heartbeat_front_addr":"172.21.15.159:6821/3899321246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:16:48.144336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:08.030795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:27.491150+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:43.510407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:00.754870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:18.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/4214525506":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:0/485054154":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2852726971":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:6800/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:0/2703146795":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2843799198":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/1749856739":"2022-02-03T18:14:38.276817+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T18:18:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 msgr2=0x7f9d0005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 0x7f9d0005e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9d140f6620 tx=0x7f9d04009040).stop 2022-02-02T18:18:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 msgr2=0x7f9d141073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9d10009990 tx=0x7f9d10009b30).stop 2022-02-02T18:18:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 shutdown_connections 2022-02-02T18:18:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9d0005c2b0 0x7f9d0005e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d140f5520 0x7f9d14106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 --2- 172.21.15.96:0/2428124964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d140f67c0 0x7f9d141073b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 >> 172.21.15.96:0/2428124964 conn(0x7f9d140f0ca0 msgr2=0x7f9d140603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 shutdown_connections 2022-02-02T18:18:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:30.495+0000 7f9d1a80b700 1 -- 172.21.15.96:0/2428124964 wait complete. 2022-02-02T18:18:31.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:30 smithi096 conmon[32067]: audit 2022-02-02T18:18:30.494162+0000 mon.smithi096 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.96:0/2428124964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:31.059 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-02-02T18:17:38.891092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2022-02-02T18:18:31.060 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2022-02-02T18:18:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:30 smithi159 conmon[35668]: audit 2022-02-02T18:18:30.494162+0000 mon.smithi096 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.96:0/2428124964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:31 smithi159 conmon[35668]: cluster 2022-02-02T18:18:30.786833+0000 mgr.smithi096.shfutl (mgr.14162) 154 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:32.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:31 smithi096 conmon[32067]: cluster 2022-02-02T18:18:30.786833+0000 mgr.smithi096.shfutl 2022-02-02T18:18:32.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:31 smithi096 conmon[32067]: (mgr.14162) 154 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 -- 172.21.15.96:0/2546042891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 msgr2=0x7f1d140f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 --2- 172.21.15.96:0/2546042891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d140f4e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1d08004660 tx=0x7f1d08009b30).stop 2022-02-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 -- 172.21.15.96:0/2546042891 shutdown_connections 2022-02-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 --2- 172.21.15.96:0/2546042891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 0x7f1d140f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 --2- 172.21.15.96:0/2546042891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d140f4e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 -- 172.21.15.96:0/2546042891 >> 172.21.15.96:0/2546042891 conn(0x7f1d140f0590 msgr2=0x7f1d140f29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 -- 172.21.15.96:0/2546042891 shutdown_connections 2022-02-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.984+0000 7f1d19315700 1 -- 172.21.15.96:0/2546042891 wait complete. 2022-02-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 Processor -- start 2022-02-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 -- start start 2022-02-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 0x7f1d141075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14107b90 con 0x7f1d140f4a70 2022-02-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d19315700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14107cd0 con 0x7f1d140f5410 2022-02-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51932/0 (socket says 172.21.15.96:51932) 2022-02-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 -- 172.21.15.96:0/3146532172 learned_addr learned my addr 172.21.15.96:0/3146532172 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d127fc700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 0x7f1d141075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 -- 172.21.15.96:0/3146532172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 msgr2=0x7f1d141075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 0x7f1d141075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 -- 172.21.15.96:0/3146532172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08005040 con 0x7f1d140f4a70 2022-02-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1d12ffd700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1d08004e30 tx=0x7f1d08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.985+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d08018070 con 0x7f1d140f4a70 2022-02-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.986+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1d08013410 con 0x7f1d140f4a70 2022-02-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.986+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14108610 con 0x7f1d140f4a70 2022-02-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.986+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0801c3c0 con 0x7f1d140f4a70 2022-02-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.986+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d14108b70 con 0x7f1d140f4a70 2022-02-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d14045ad0 con 0x7f1d140f4a70 2022-02-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1d0801c630 con 0x7f1d140f4a70 2022-02-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1cfb7fe700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 0x7f1cfc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f1d08077950 con 0x7f1d140f4a70 2022-02-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1d127fc700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 0x7f1cfc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.987+0000 7f1d127fc700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 0x7f1cfc05e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1d140f5850 tx=0x7f1d04009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:32.991+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1d0804a970 con 0x7f1d140f4a70 2022-02-02T18:18:33.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.139+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1d14027a00 con 0x7f1d140f4a70 2022-02-02T18:18:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.140+0000 7f1cfb7fe700 1 -- 172.21.15.96:0/3146532172 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v37) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1d0804df90 con 0x7f1d140f4a70 2022-02-02T18:18:33.143 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2022-02-02T18:18:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 msgr2=0x7f1cfc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 0x7f1cfc05e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1d140f5850 tx=0x7f1d04009be0).stop 2022-02-02T18:18:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 msgr2=0x7f1d141070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1d08004e30 tx=0x7f1d08009b30).stop 2022-02-02T18:18:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 shutdown_connections 2022-02-02T18:18:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1cfc05c2a0 0x7f1cfc05e760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d140f4a70 0x7f1d141070f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 --2- 172.21.15.96:0/3146532172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d140f5410 0x7f1d141075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 >> 172.21.15.96:0/3146532172 conn(0x7f1d140f0590 msgr2=0x7f1d140fb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.141+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 shutdown_connections 2022-02-02T18:18:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:33.142+0000 7f1d19315700 1 -- 172.21.15.96:0/3146532172 wait complete. 2022-02-02T18:18:33.595 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-02-02T18:18:33.596 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2022-02-02T18:18:33.596 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph mgr dump --format=json 2022-02-02T18:18:34.032 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:34.253 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:33 smithi096 conmon[32067]: cluster 2022-02-02T18:18:32.787265+0000 mgr.smithi096.shfutl ( 2022-02-02T18:18:34.254 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:33 smithi096 conmon[32067]: mgr.14162) 155 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:34.254 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:33 smithi096 conmon[32067]: audit 2022-02-02T18:18:33.140684+0000 mon.smithi096 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.96:0/3146532172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T18:18:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:33 smithi159 conmon[35668]: cluster 2022-02-02T18:18:32.787265+0000 mgr.smithi096.shfutl (mgr.14162) 155 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:33 smithi159 conmon[35668]: audit 2022-02-02T18:18:33.140684+0000 mon.smithi096 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.96:0/3146532172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T18:18:35.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 -- 172.21.15.96:0/533855738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f4ca0 msgr2=0x7f349c0f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:35.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 --2- 172.21.15.96:0/533855738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f4ca0 0x7f349c0f50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f348c004660 tx=0x7f348c009b30).stop 2022-02-02T18:18:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 -- 172.21.15.96:0/533855738 shutdown_connections 2022-02-02T18:18:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 --2- 172.21.15.96:0/533855738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f5f40 0x7f349c0f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 --2- 172.21.15.96:0/533855738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f4ca0 0x7f349c0f50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 -- 172.21.15.96:0/533855738 >> 172.21.15.96:0/533855738 conn(0x7f349c0f0400 msgr2=0x7f349c0f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.439+0000 7f34a0f78700 1 -- 172.21.15.96:0/533855738 shutdown_connections 2022-02-02T18:18:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.440+0000 7f34a0f78700 1 -- 172.21.15.96:0/533855738 wait complete. 2022-02-02T18:18:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.440+0000 7f34a0f78700 1 Processor -- start 2022-02-02T18:18:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.440+0000 7f34a0f78700 1 -- start start 2022-02-02T18:18:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 0x7f349c105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1069d0 con 0x7f349c0f5f40 2022-02-02T18:18:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c107140 con 0x7f349c0f4ca0 2022-02-02T18:18:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51944/0 (socket says 172.21.15.96:51944) 2022-02-02T18:18:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 -- 172.21.15.96:0/346930122 learned_addr learned my addr 172.21.15.96:0/346930122 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349b7fe700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 0x7f349c105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 -- 172.21.15.96:0/346930122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 msgr2=0x7f349c105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 0x7f349c105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:35.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 -- 172.21.15.96:0/346930122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c005040 con 0x7f349c0f5f40 2022-02-02T18:18:35.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349b7fe700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 0x7f349c105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:18:35.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f349affd700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f349000b410 tx=0x7f3490006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:35.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34900125f0 con 0x7f349c0f5f40 2022-02-02T18:18:35.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c107420 con 0x7f349c0f5f40 2022-02-02T18:18:35.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.441+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c1079e0 con 0x7f349c0f5f40 2022-02-02T18:18:35.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.442+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3490012be0 con 0x7f349c0f5f40 2022-02-02T18:18:35.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.442+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3490002a00 con 0x7f349c0f5f40 2022-02-02T18:18:35.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.442+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c004fa0 con 0x7f349c0f5f40 2022-02-02T18:18:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.443+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f349000f030 con 0x7f349c0f5f40 2022-02-02T18:18:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.443+0000 7f3483fff700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 0x7f348405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.443+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3490075f60 con 0x7f349c0f5f40 2022-02-02T18:18:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.443+0000 7f349b7fe700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 0x7f348405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.444+0000 7f349b7fe700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 0x7f348405e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f348c004e30 tx=0x7f348c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.447+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3490048f20 con 0x7f349c0f5f40 2022-02-02T18:18:35.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.634+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f347c005670 con 0x7f349c0f5f40 2022-02-02T18:18:35.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.637+0000 7f3483fff700 1 -- 172.21.15.96:0/346930122 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+143500 (secure 0 0 0) 0x7f349004c540 con 0x7f349c0f5f40 2022-02-02T18:18:35.642 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:35.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.639+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 msgr2=0x7f348405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:35.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.639+0000 7f34a0f78700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 0x7f348405e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f348c004e30 tx=0x7f348c009b30).stop 2022-02-02T18:18:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.639+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 msgr2=0x7f349c106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.639+0000 7f34a0f78700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f349000b410 tx=0x7f3490006ef0).stop 2022-02-02T18:18:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 shutdown_connections 2022-02-02T18:18:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f348405c2b0 0x7f348405e770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f349c0f4ca0 0x7f349c105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 --2- 172.21.15.96:0/346930122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f349c0f5f40 0x7f349c106390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 >> 172.21.15.96:0/346930122 conn(0x7f349c0f0400 msgr2=0x7f349c0f27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 shutdown_connections 2022-02-02T18:18:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:35.640+0000 7f34a0f78700 1 -- 172.21.15.96:0/346930122 wait complete. 2022-02-02T18:18:36.098 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:35 smithi096 conmon[32067]: cluster 2022-02-02T18:18:34.787874+0000 mgr.smithi096.shfutl (mgr.14162) 156 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:36.098 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:35 smithi096 conmon[32067]: audit 2022-02-02T18:18:35.635717+0000 mon.smithi096 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.96:0/346930122' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-02-02T18:18:36.130 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"active_gid":14162,"active_name":"smithi096.shfutl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":4170397281},{"type":"v1","addr":"172.21.15.96:6801","nonce":4170397281}]},"active_addr":"172.21.15.96:6801/4170397281","active_change":"2022-02-02T18:15:13.882827+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14206,"name":"smithi159.jrxkfz","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi096.front.sepia.ceph.com:8443/","prometheus":"http://smithi096.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2837435548}]},{"addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3295794755}]}]}} 2022-02-02T18:18:36.136 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2022-02-02T18:18:36.137 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2022-02-02T18:18:36.137 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T18:18:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:35 smithi159 conmon[35668]: cluster 2022-02-02T18:18:34.787874+0000 mgr.smithi096.shfutl (mgr.14162) 156 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:35 smithi159 conmon[35668]: audit 2022-02-02T18:18:35.635717+0000 mon.smithi096 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.96:0/346930122' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-02-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:37.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 -- 172.21.15.96:0/358764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f6980 msgr2=0x7f64ec0f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:37.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 --2- 172.21.15.96:0/358764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f6980 0x7f64ec0f6de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f64e0004660 tx=0x7f64e0009b30).stop 2022-02-02T18:18:37.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 -- 172.21.15.96:0/358764428 shutdown_connections 2022-02-02T18:18:37.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 --2- 172.21.15.96:0/358764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f6980 0x7f64ec0f6de0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:37.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 --2- 172.21.15.96:0/358764428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f56e0 0x7f64ec0f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:37.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 -- 172.21.15.96:0/358764428 >> 172.21.15.96:0/358764428 conn(0x7f64ec0f0e20 msgr2=0x7f64ec0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:37.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 -- 172.21.15.96:0/358764428 shutdown_connections 2022-02-02T18:18:37.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.982+0000 7f64f194a700 1 -- 172.21.15.96:0/358764428 wait complete. 2022-02-02T18:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.983+0000 7f64f194a700 1 Processor -- start 2022-02-02T18:18:37.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.983+0000 7f64f194a700 1 -- start start 2022-02-02T18:18:37.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.983+0000 7f64f194a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:37.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64f194a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f6980 0x7f64ec10c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:37.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64f194a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec060980 con 0x7f64ec0f56e0 2022-02-02T18:18:37.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64f194a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec060ac0 con 0x7f64ec0f6980 2022-02-02T18:18:37.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:37.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51952/0 (socket says 172.21.15.96:51952) 2022-02-02T18:18:37.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 -- 172.21.15.96:0/3554093128 learned_addr learned my addr 172.21.15.96:0/3554093128 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:37.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64ea7fc700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f6980 0x7f64ec10c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:37.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 -- 172.21.15.96:0/3554093128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f6980 msgr2=0x7f64ec10c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:37.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f6980 0x7f64ec10c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:37.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 -- 172.21.15.96:0/3554093128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0005040 con 0x7f64ec0f56e0 2022-02-02T18:18:37.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64eaffd700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f64e400c810 tx=0x7f64e4004d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:37.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e400a700 con 0x7f64ec0f56e0 2022-02-02T18:18:37.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec10c850 con 0x7f64ec0f56e0 2022-02-02T18:18:37.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f64e400acf0 con 0x7f64ec0f56e0 2022-02-02T18:18:37.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e4012dc0 con 0x7f64ec0f56e0 2022-02-02T18:18:37.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.984+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec10cde0 con 0x7f64ec0f56e0 2022-02-02T18:18:37.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.985+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec059100 con 0x7f64ec0f56e0 2022-02-02T18:18:37.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.986+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f64e4019030 con 0x7f64ec0f56e0 2022-02-02T18:18:37.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.986+0000 7f64d37fe700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 0x7f64d405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:37.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.986+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f64e4075bf0 con 0x7f64ec0f56e0 2022-02-02T18:18:37.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.986+0000 7f64ea7fc700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 0x7f64d405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:37.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.986+0000 7f64ea7fc700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 0x7f64d405e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f64e0004630 tx=0x7f64e0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:37.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:37.990+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f64e40462b0 con 0x7f64ec0f56e0 2022-02-02T18:18:38.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.139+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64ec045ad0 con 0x7f64ec0f56e0 2022-02-02T18:18:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.140+0000 7f64d37fe700 1 -- 172.21.15.96:0/3554093128 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10880 (secure 0 0 0) 0x7f64e4017030 con 0x7f64ec0f56e0 2022-02-02T18:18:38.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:38.143 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":37,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","created":"2022-02-02T18:14:19.866158+0000","modified":"2022-02-02T18:18:21.020786+0000","last_up_change":"2022-02-02T18:18:20.014966+0000","last_in_change":"2022-02-02T18:18:03.867700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T18:17:38.891092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8d7ab242-00e2-4b8d-a7be-0bf62b292a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6803","nonce":195432068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6805","nonce":195432068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6809","nonce":195432068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6807","nonce":195432068}]},"public_addr":"172.21.15.96:6803/195432068","cluster_addr":"172.21.15.96:6805/195432068","heartbeat_back_addr":"172.21.15.96:6809/195432068","heartbeat_front_addr":"172.21.15.96:6807/195432068","state":["exists","up"]},{"osd":1,"uuid":"dec772e4-b9e6-4351-a19d-64fdd5df9e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6811","nonce":2713933524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6813","nonce":2713933524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6817","nonce":2713933524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6815","nonce":2713933524}]},"public_addr":"172.21.15.96:6811/2713933524","cluster_addr":"172.21.15.96:6813/2713933524","heartbeat_back_addr":"172.21.15.96:6817/2713933524","heartbeat_front_addr":"172.21.15.96:6815/2713933524","state":["exists","up"]},{"osd":2,"uuid":"71e07e53-0fd8-4df3-8306-f483afe6fbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6819","nonce":620516912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6821","nonce":620516912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6825","nonce":620516912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6823","nonce":620516912}]},"public_addr":"172.21.15.96:6819/620516912","cluster_addr":"172.21.15.96:6821/620516912","heartbeat_back_addr":"172.21.15.96:6825/620516912","heartbeat_front_addr":"172.21.15.96:6823/620516912","state":["exists","up"]},{"osd":3,"uuid":"7a85a335-124c-4fcd-bbc5-db2bd88eaa14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6801","nonce":3926735851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6803","nonce":3926735851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6807","nonce":3926735851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6805","nonce":3926735851}]},"public_addr":"172.21.15.159:6801/3926735851","cluster_addr":"172.21.15.159:6803/3926735851","heartbeat_back_addr":"172.21.15.159:6807/3926735851","heartbeat_front_addr":"172.21.15.159:6805/3926735851","state":["exists","up"]},{"osd":4,"uuid":"b22a2951-4fd4-4bc3-bc1e-f315e3d9514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6809","nonce":3593977560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6811","nonce":3593977560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6815","nonce":3593977560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6813","nonce":3593977560}]},"public_addr":"172.21.15.159:6809/3593977560","cluster_addr":"172.21.15.159:6811/3593977560","heartbeat_back_addr":"172.21.15.159:6815/3593977560","heartbeat_front_addr":"172.21.15.159:6813/3593977560","state":["exists","up"]},{"osd":5,"uuid":"0ff39853-acbf-4ad7-90a7-9e777d5f2e77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6817","nonce":3899321246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6819","nonce":3899321246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6823","nonce":3899321246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6821","nonce":3899321246}]},"public_addr":"172.21.15.159:6817/3899321246","cluster_addr":"172.21.15.159:6819/3899321246","heartbeat_back_addr":"172.21.15.159:6823/3899321246","heartbeat_front_addr":"172.21.15.159:6821/3899321246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:16:48.144336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:08.030795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:27.491150+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:43.510407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:00.754870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:18.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/4214525506":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:0/485054154":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2852726971":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:6800/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:0/2703146795":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2843799198":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/1749856739":"2022-02-03T18:14:38.276817+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T18:18:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 msgr2=0x7f64d405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 0x7f64d405e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f64e0004630 tx=0x7f64e0009b30).stop 2022-02-02T18:18:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 msgr2=0x7f64ec109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f64e400c810 tx=0x7f64e4004d90).stop 2022-02-02T18:18:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 shutdown_connections 2022-02-02T18:18:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f64d405c2a0 0x7f64d405e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64ec0f56e0 0x7f64ec109d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 --2- 172.21.15.96:0/3554093128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ec0f6980 0x7f64ec10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 >> 172.21.15.96:0/3554093128 conn(0x7f64ec0f0e20 msgr2=0x7f64ec0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 shutdown_connections 2022-02-02T18:18:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:38.141+0000 7f64f194a700 1 -- 172.21.15.96:0/3554093128 wait complete. 2022-02-02T18:18:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:37 smithi159 conmon[35668]: cluster 2022-02-02T18:18:36.788307+0000 mgr.smithi096.shfutl (mgr.14162) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:37 smithi096 conmon[32067]: cluster 2022-02-02T18:18:36.788307+0000 mgr.smithi096.shfutl (mgr.14162) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:38.773 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2022-02-02T18:18:38.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T18:18:39.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:38 smithi096 conmon[32067]: audit 2022-02-02T18:18:38.140116+0000 mon.smithi096 (mon.0) 440 : audit 2022-02-02T18:18:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:38 smithi096 conmon[32067]: [DBG] from='client.? 172.21.15.96:0/3554093128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:39.250 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:38 smithi159 conmon[35668]: audit 2022-02-02T18:18:38.140116+0000 mon.smithi096 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.96:0/3554093128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:40.230 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:39 smithi096 conmon[32067]: cluster 2022-02-02T18:18:38.788722+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:18:40.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:39 smithi096 conmon[32067]: ) 158 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:39 smithi159 conmon[35668]: cluster 2022-02-02T18:18:38.788722+0000 mgr.smithi096.shfutl (mgr.14162) 158 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 -- 172.21.15.96:0/4160195995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f56e0 msgr2=0x7fa5680f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 --2- 172.21.15.96:0/4160195995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f56e0 0x7fa5680f5b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa55c004660 tx=0x7fa55c009b30).stop 2022-02-02T18:18:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 -- 172.21.15.96:0/4160195995 shutdown_connections 2022-02-02T18:18:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 --2- 172.21.15.96:0/4160195995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f6980 0x7fa5680f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 --2- 172.21.15.96:0/4160195995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f56e0 0x7fa5680f5b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 -- 172.21.15.96:0/4160195995 >> 172.21.15.96:0/4160195995 conn(0x7fa5680f0e20 msgr2=0x7fa5680f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 -- 172.21.15.96:0/4160195995 shutdown_connections 2022-02-02T18:18:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.720+0000 7fa56d308700 1 -- 172.21.15.96:0/4160195995 wait complete. 2022-02-02T18:18:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 Processor -- start 2022-02-02T18:18:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 -- start start 2022-02-02T18:18:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 0x7fa5681070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568107b70 con 0x7fa5680f6980 2022-02-02T18:18:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568107cb0 con 0x7fa5680f56e0 2022-02-02T18:18:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51964/0 (socket says 172.21.15.96:51964) 2022-02-02T18:18:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 -- 172.21.15.96:0/187223338 learned_addr learned my addr 172.21.15.96:0/187223338 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa566ffd700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 0x7fa5681070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 -- 172.21.15.96:0/187223338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 msgr2=0x7fa5681070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 0x7fa5681070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 -- 172.21.15.96:0/187223338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c005040 con 0x7fa5680f6980 2022-02-02T18:18:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa566ffd700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 0x7fa5681070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:18:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa5667fc700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa55800c790 tx=0x7fa558007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:40.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55800e680 con 0x7fa5680f6980 2022-02-02T18:18:40.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa55800ec70 con 0x7fa5680f6980 2022-02-02T18:18:40.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa568108650 con 0x7fa5680f6980 2022-02-02T18:18:40.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.721+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa558013d30 con 0x7fa5680f6980 2022-02-02T18:18:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.722+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa568108c10 con 0x7fa5680f6980 2022-02-02T18:18:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.722+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa568045ad0 con 0x7fa5680f6980 2022-02-02T18:18:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.723+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa55801a060 con 0x7fa5680f6980 2022-02-02T18:18:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.723+0000 7fa54f7fe700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 0x7fa55005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.723+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fa558075dd0 con 0x7fa5680f6980 2022-02-02T18:18:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.723+0000 7fa566ffd700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 0x7fa55005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.724+0000 7fa566ffd700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 0x7fa55005e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa55c004e30 tx=0x7fa55c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.727+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa558048df0 con 0x7fa5680f6980 2022-02-02T18:18:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.880+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa568109310 con 0x7fa5680f6980 2022-02-02T18:18:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.881+0000 7fa54f7fe700 1 -- 172.21.15.96:0/187223338 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10880 (secure 0 0 0) 0x7fa55804c410 con 0x7fa5680f6980 2022-02-02T18:18:40.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:18:40.885 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":37,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","created":"2022-02-02T18:14:19.866158+0000","modified":"2022-02-02T18:18:21.020786+0000","last_up_change":"2022-02-02T18:18:20.014966+0000","last_in_change":"2022-02-02T18:18:03.867700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T18:17:38.891092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8d7ab242-00e2-4b8d-a7be-0bf62b292a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6803","nonce":195432068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6805","nonce":195432068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6809","nonce":195432068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6807","nonce":195432068}]},"public_addr":"172.21.15.96:6803/195432068","cluster_addr":"172.21.15.96:6805/195432068","heartbeat_back_addr":"172.21.15.96:6809/195432068","heartbeat_front_addr":"172.21.15.96:6807/195432068","state":["exists","up"]},{"osd":1,"uuid":"dec772e4-b9e6-4351-a19d-64fdd5df9e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6811","nonce":2713933524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6813","nonce":2713933524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6817","nonce":2713933524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6815","nonce":2713933524}]},"public_addr":"172.21.15.96:6811/2713933524","cluster_addr":"172.21.15.96:6813/2713933524","heartbeat_back_addr":"172.21.15.96:6817/2713933524","heartbeat_front_addr":"172.21.15.96:6815/2713933524","state":["exists","up"]},{"osd":2,"uuid":"71e07e53-0fd8-4df3-8306-f483afe6fbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6819","nonce":620516912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6821","nonce":620516912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6825","nonce":620516912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6823","nonce":620516912}]},"public_addr":"172.21.15.96:6819/620516912","cluster_addr":"172.21.15.96:6821/620516912","heartbeat_back_addr":"172.21.15.96:6825/620516912","heartbeat_front_addr":"172.21.15.96:6823/620516912","state":["exists","up"]},{"osd":3,"uuid":"7a85a335-124c-4fcd-bbc5-db2bd88eaa14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6801","nonce":3926735851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6803","nonce":3926735851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6807","nonce":3926735851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6805","nonce":3926735851}]},"public_addr":"172.21.15.159:6801/3926735851","cluster_addr":"172.21.15.159:6803/3926735851","heartbeat_back_addr":"172.21.15.159:6807/3926735851","heartbeat_front_addr":"172.21.15.159:6805/3926735851","state":["exists","up"]},{"osd":4,"uuid":"b22a2951-4fd4-4bc3-bc1e-f315e3d9514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6809","nonce":3593977560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6811","nonce":3593977560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6815","nonce":3593977560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6813","nonce":3593977560}]},"public_addr":"172.21.15.159:6809/3593977560","cluster_addr":"172.21.15.159:6811/3593977560","heartbeat_back_addr":"172.21.15.159:6815/3593977560","heartbeat_front_addr":"172.21.15.159:6813/3593977560","state":["exists","up"]},{"osd":5,"uuid":"0ff39853-acbf-4ad7-90a7-9e777d5f2e77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6817","nonce":3899321246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6819","nonce":3899321246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6823","nonce":3899321246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6821","nonce":3899321246}]},"public_addr":"172.21.15.159:6817/3899321246","cluster_addr":"172.21.15.159:6819/3899321246","heartbeat_back_addr":"172.21.15.159:6823/3899321246","heartbeat_front_addr":"172.21.15.159:6821/3899321246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:16:48.144336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:08.030795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:27.491150+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:43.510407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:00.754870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:18.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/4214525506":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:0/485054154":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2852726971":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:6800/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:0/2703146795":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2843799198":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/1749856739":"2022-02-03T18:14:38.276817+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T18:18:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 msgr2=0x7fa55005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 0x7fa55005e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa55c004e30 tx=0x7fa55c009b30).stop 2022-02-02T18:18:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 msgr2=0x7fa5681075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa55800c790 tx=0x7fa558007d70).stop 2022-02-02T18:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 shutdown_connections 2022-02-02T18:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa55005c2a0 0x7fa55005e760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5680f56e0 0x7fa5681070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 --2- 172.21.15.96:0/187223338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680f6980 0x7fa5681075c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 >> 172.21.15.96:0/187223338 conn(0x7fa5680f0e20 msgr2=0x7fa56805fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 shutdown_connections 2022-02-02T18:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:40.883+0000 7fa56d308700 1 -- 172.21.15.96:0/187223338 wait complete. 2022-02-02T18:18:41.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:40 smithi096 conmon[32067]: audit 2022-02-02T18:18:40.881528+0000 mon.smithi096 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.96:0/187223338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:40 smithi159 conmon[35668]: audit 2022-02-02T18:18:40.881528+0000 mon.smithi096 (mon.0) 441 : audit 2022-02-02T18:18:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:40 smithi159 conmon[35668]: [DBG] from='client.? 172.21.15.96:0/187223338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:18:41.552 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2022-02-02T18:18:41.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2022-02-02T18:18:41.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2022-02-02T18:18:41.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2022-02-02T18:18:41.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2022-02-02T18:18:41.556 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2022-02-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:42.092 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:42.097 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:42.250 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:41 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:18:42.251 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:41 smithi096 conmon[32067]: -02T18:18:40.789008+0000 mgr.smithi096.shfutl (mgr.14162) 159 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:41 smithi159 conmon[35668]: cluster 2022-02-02T18:18:40.789008+0000 mgr.smithi096.shfutl (mgr.14162) 159 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:42.971 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:43.247 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:42 smithi096 conmon[32067]: cluster 2022-02-02T18:18:42.789284+0000 mgr.smithi096.shfutl 2022-02-02T18:18:43.247 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:42 smithi096 conmon[32067]: (mgr.14162) 160 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:42 smithi159 conmon[35668]: cluster 2022-02-02T18:18:42.789284+0000 mgr.smithi096.shfutl (mgr.14162) 160 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:46.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:45 smithi096 conmon[32067]: cluster 2022-02-02T18:18:44.789821+0000 mgr.smithi096.shfutl (mgr.14162) 161 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:45 smithi159 conmon[35668]: cluster 2022-02-02T18:18:44.789821+0000 mgr.smithi096.shfutl (mgr.14162) 161 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 -- 172.21.15.96:0/871288469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 msgr2=0x7ff8840f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 --2- 172.21.15.96:0/871288469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff8840f93a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff874004660 tx=0x7ff874009b30).stop 2022-02-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 -- 172.21.15.96:0/871288469 shutdown_connections 2022-02-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 --2- 172.21.15.96:0/871288469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8840f9920 0x7ff8840fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 --2- 172.21.15.96:0/871288469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff8840f93a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 -- 172.21.15.96:0/871288469 >> 172.21.15.96:0/871288469 conn(0x7ff8840f0e20 msgr2=0x7ff8840f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 -- 172.21.15.96:0/871288469 shutdown_connections 2022-02-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.476+0000 7ff888f91700 1 -- 172.21.15.96:0/871288469 wait complete. 2022-02-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 Processor -- start 2022-02-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 -- start start 2022-02-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8840f9920 0x7ff884107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884107b30 con 0x7ff884060870 2022-02-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff888f91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884107c70 con 0x7ff8840f9920 2022-02-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff88259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff88259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51972/0 (socket says 172.21.15.96:51972) 2022-02-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.477+0000 7ff88259c700 1 -- 172.21.15.96:0/1262627829 learned_addr learned my addr 172.21.15.96:0/1262627829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff88259c700 1 -- 172.21.15.96:0/1262627829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8840f9920 msgr2=0x7ff884107580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff88259c700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8840f9920 0x7ff884107580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff88259c700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874005040 con 0x7ff884060870 2022-02-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff88259c700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff874009990 tx=0x7ff874009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff874018070 con 0x7ff884060870 2022-02-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8841085b0 con 0x7ff884060870 2022-02-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff874013410 con 0x7ff884060870 2022-02-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87401c3c0 con 0x7ff884060870 2022-02-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.478+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884108b10 con 0x7ff884060870 2022-02-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.479+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff88405dd30 con 0x7ff884060870 2022-02-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.479+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff87401d420 con 0x7ff884060870 2022-02-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff872ffd700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 0x7ff86c062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7ff874077c90 con 0x7ff884060870 2022-02-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff881d9b700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 0x7ff86c062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff872ffd700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 0x7ff86c068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff86c068e90 con 0x7ff86c0663d0 2022-02-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff874078090 con 0x7ff884060870 2022-02-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff882d9d700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 0x7ff86c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff881d9b700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 0x7ff86c062b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff884060640 tx=0x7ff8780099e0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.480+0000 7ff882d9d700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 0x7ff86c068810 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.481+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== osd.0 v2:172.21.15.96:6802/195432068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff86c068e90 con 0x7ff86c0663d0 2022-02-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 --> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff884108f70 con 0x7ff86c0663d0 2022-02-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff872ffd700 1 -- 172.21.15.96:0/1262627829 <== osd.0 v2:172.21.15.96:6802/195432068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff884108f70 con 0x7ff86c0663d0 2022-02-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 msgr2=0x7ff86c068810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 0x7ff86c068810 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 msgr2=0x7ff86c062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 0x7ff86c062b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff884060640 tx=0x7ff8780099e0).stop 2022-02-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 msgr2=0x7ff884107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff874009990 tx=0x7ff874009b30).stop 2022-02-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 shutdown_connections 2022-02-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6802/195432068,v1:172.21.15.96:6803/195432068] conn(0x7ff86c0663d0 0x7ff86c068810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff86c0606b0 0x7ff86c062b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff884060870 0x7ff884107090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 --2- 172.21.15.96:0/1262627829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8840f9920 0x7ff884107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 >> 172.21.15.96:0/1262627829 conn(0x7ff8840f0e20 msgr2=0x7ff8840f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 shutdown_connections 2022-02-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.496+0000 7ff888f91700 1 -- 172.21.15.96:0/1262627829 wait complete. 2022-02-02T18:18:47.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 -- 172.21.15.96:0/2339842983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 msgr2=0x7f7be00f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:47.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 --2- 172.21.15.96:0/2339842983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be00f6de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7bd4004660 tx=0x7f7bd4009b30).stop 2022-02-02T18:18:47.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 -- 172.21.15.96:0/2339842983 shutdown_connections 2022-02-02T18:18:47.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 --2- 172.21.15.96:0/2339842983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be00f6de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 --2- 172.21.15.96:0/2339842983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 0x7f7be00f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 -- 172.21.15.96:0/2339842983 >> 172.21.15.96:0/2339842983 conn(0x7f7be00f0e20 msgr2=0x7f7be00f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:47.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 -- 172.21.15.96:0/2339842983 shutdown_connections 2022-02-02T18:18:47.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.910+0000 7f7be5b51700 1 -- 172.21.15.96:0/2339842983 wait complete. 2022-02-02T18:18:47.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 Processor -- start 2022-02-02T18:18:47.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 -- start start 2022-02-02T18:18:47.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 0x7f7be0109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:47.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:47.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0060940 con 0x7f7be00f6980 2022-02-02T18:18:47.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7be5b51700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0060a80 con 0x7f7be00f56e0 2022-02-02T18:18:47.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7bdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:47.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7bdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51986/0 (socket says 172.21.15.96:51986) 2022-02-02T18:18:47.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7bdeffd700 1 -- 172.21.15.96:0/3696727365 learned_addr learned my addr 172.21.15.96:0/3696727365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:47.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.911+0000 7f7bdf7fe700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 0x7f7be0109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:47.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bdeffd700 1 -- 172.21.15.96:0/3696727365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 msgr2=0x7f7be0109d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bdeffd700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 0x7f7be0109d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bdeffd700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4005040 con 0x7f7be00f6980 2022-02-02T18:18:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bdeffd700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f7bd4000c00 tx=0x7f7bd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd4019070 con 0x7f7be00f6980 2022-02-02T18:18:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7bd4007e50 con 0x7f7be00f6980 2022-02-02T18:18:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be010c780 con 0x7f7be00f6980 2022-02-02T18:18:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.912+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd4014cd0 con 0x7f7be00f6980 2022-02-02T18:18:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.913+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be010cce0 con 0x7f7be00f6980 2022-02-02T18:18:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.913+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7be005dcf0 con 0x7f7be00f6980 2022-02-02T18:18:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7bd4025070 con 0x7f7be00f6980 2022-02-02T18:18:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 0x7f7bc805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f7bd4076b40 con 0x7f7be00f6980 2022-02-02T18:18:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bdf7fe700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 0x7f7bc805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 0x7f7bc8064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bc8064a80 con 0x7f7bc8061fc0 2022-02-02T18:18:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bd407b220 con 0x7f7be00f6980 2022-02-02T18:18:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bdffff700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 0x7f7bc8064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.914+0000 7f7bdf7fe700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 0x7f7bc805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7be00605c0 tx=0x7f7bd000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.915+0000 7f7bdffff700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 0x7f7bc8064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.915+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== osd.1 v2:172.21.15.96:6810/2713933524 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7bc8064a80 con 0x7f7bc8061fc0 2022-02-02T18:18:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.929+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 --> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7be0058150 con 0x7f7bc8061fc0 2022-02-02T18:18:47.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7bc7fff700 1 -- 172.21.15.96:0/3696727365 <== osd.1 v2:172.21.15.96:6810/2713933524 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7be0058150 con 0x7f7bc8061fc0 2022-02-02T18:18:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 msgr2=0x7f7bc8064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 0x7f7bc8064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 msgr2=0x7f7bc805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:47.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 0x7f7bc805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7be00605c0 tx=0x7f7bd000b040).stop 2022-02-02T18:18:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 msgr2=0x7f7be010c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f7bd4000c00 tx=0x7f7bd400b040).stop 2022-02-02T18:18:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 shutdown_connections 2022-02-02T18:18:47.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6810/2713933524,v1:172.21.15.96:6811/2713933524] conn(0x7f7bc8061fc0 0x7f7bc8064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7bc805c2a0 0x7f7bc805e760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be00f56e0 0x7f7be0109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 --2- 172.21.15.96:0/3696727365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7be00f6980 0x7f7be010c230 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0x7f7bd4000c00 tx=0x7f7bd400b040).stop 2022-02-02T18:18:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 >> 172.21.15.96:0/3696727365 conn(0x7f7be00f0e20 msgr2=0x7f7be00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 shutdown_connections 2022-02-02T18:18:47.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:46.930+0000 7f7be5b51700 1 -- 172.21.15.96:0/3696727365 wait complete. 2022-02-02T18:18:47.760 INFO:teuthology.orchestra.run.smithi096.stdout:38654705691 2022-02-02T18:18:47.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.0 2022-02-02T18:18:47.986 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:47 smithi096 conmon[32067]: cluster 2022-02-02T18:18:46.790406+0000 mgr.smithi096.shfutl (mgr.14162) 162 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:48.169 INFO:teuthology.orchestra.run.smithi096.stdout:60129542167 2022-02-02T18:18:48.169 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.1 2022-02-02T18:18:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 -- 172.21.15.96:0/632073100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 msgr2=0x7f1fdc0f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/632073100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc0f6a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f1fd0004660 tx=0x7f1fd0009b30).stop 2022-02-02T18:18:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 -- 172.21.15.96:0/632073100 shutdown_connections 2022-02-02T18:18:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/632073100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc0f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/632073100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc0f6a30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 -- 172.21.15.96:0/632073100 >> 172.21.15.96:0/632073100 conn(0x7f1fdc0f1d70 msgr2=0x7f1fdc0f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 -- 172.21.15.96:0/632073100 shutdown_connections 2022-02-02T18:18:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.137+0000 7f1fe1e67700 1 -- 172.21.15.96:0/632073100 wait complete. 2022-02-02T18:18:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 Processor -- start 2022-02-02T18:18:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 -- start start 2022-02-02T18:18:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc06a380 con 0x7f1fdc0f6610 2022-02-02T18:18:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe1e67700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc06a4c0 con 0x7f1fdc0f78b0 2022-02-02T18:18:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe0e65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.138+0000 7f1fe0e65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52018/0 (socket says 172.21.15.96:52018) 2022-02-02T18:18:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe0e65700 1 -- 172.21.15.96:0/2714443613 learned_addr learned my addr 172.21.15.96:0/2714443613 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:48.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fdbfff700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe0e65700 1 -- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 msgr2=0x7f1fdc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe0e65700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe0e65700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0005040 con 0x7f1fdc0f6610 2022-02-02T18:18:48.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fdbfff700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:18:48.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe0e65700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1fd0004e30 tx=0x7f1fd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd0018070 con 0x7f1fdc0f6610 2022-02-02T18:18:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1fd0013410 con 0x7f1fdc0f6610 2022-02-02T18:18:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc06a740 con 0x7f1fdc0f6610 2022-02-02T18:18:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd001c3c0 con 0x7f1fdc0f6610 2022-02-02T18:18:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.139+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc06aca0 con 0x7f1fdc0f6610 2022-02-02T18:18:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.140+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fdc05db80 con 0x7f1fdc0f6610 2022-02-02T18:18:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.140+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1fd001d420 con 0x7f1fdc0f6610 2022-02-02T18:18:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fd97fa700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 0x7f1fcc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f1fd00778f0 con 0x7f1fdc0f6610 2022-02-02T18:18:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fdbfff700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 0x7f1fcc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fd97fa700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 0x7f1fcc064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fcc064a90 con 0x7f1fcc061fd0 2022-02-02T18:18:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fd007c220 con 0x7f1fdc0f6610 2022-02-02T18:18:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fdbfff700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 0x7f1fcc05e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f1fc8009780 tx=0x7f1fc8009c80).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.141+0000 7f1fe1666700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 0x7f1fcc064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.142+0000 7f1fe1666700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 0x7f1fcc064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.142+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== osd.5 v2:172.21.15.159:6816/3899321246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1fcc064a90 con 0x7f1fcc061fd0 2022-02-02T18:18:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.157+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 --> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fdc0581d0 con 0x7f1fcc061fd0 2022-02-02T18:18:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fd97fa700 1 -- 172.21.15.96:0/2714443613 <== osd.5 v2:172.21.15.159:6816/3899321246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1fdc0581d0 con 0x7f1fcc061fd0 2022-02-02T18:18:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 msgr2=0x7f1fcc064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 0x7f1fcc064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 msgr2=0x7f1fcc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 0x7f1fcc05e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f1fc8009780 tx=0x7f1fc8009c80).stop 2022-02-02T18:18:48.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 msgr2=0x7f1fdc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1fd0004e30 tx=0x7f1fd0009b30).stop 2022-02-02T18:18:48.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 shutdown_connections 2022-02-02T18:18:48.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:6816/3899321246,v1:172.21.15.159:6817/3899321246] conn(0x7f1fcc061fd0 0x7f1fcc064410 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f1fcc05c2b0 0x7f1fcc05e770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc0f6610 0x7f1fdc06b9a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 --2- 172.21.15.96:0/2714443613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc0f78b0 0x7f1fdc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 >> 172.21.15.96:0/2714443613 conn(0x7f1fdc0f1d70 msgr2=0x7f1fdc0fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.158+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 shutdown_connections 2022-02-02T18:18:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.159+0000 7f1fe1e67700 1 -- 172.21.15.96:0/2714443613 wait complete. 2022-02-02T18:18:48.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:47 smithi159 conmon[35668]: cluster 2022-02-02T18:18:46.790406+0000 mgr.smithi096.shfutl (mgr.14162) 162 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:48.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- 172.21.15.96:0/669453577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f56e0 msgr2=0x7f02f00f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 --2- 172.21.15.96:0/669453577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f56e0 0x7f02f00f5b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f02e0004660 tx=0x7f02e0009b30).stop 2022-02-02T18:18:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- 172.21.15.96:0/669453577 shutdown_connections 2022-02-02T18:18:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 --2- 172.21.15.96:0/669453577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f6980 0x7f02f00f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 --2- 172.21.15.96:0/669453577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f56e0 0x7f02f00f5b00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- 172.21.15.96:0/669453577 >> 172.21.15.96:0/669453577 conn(0x7f02f00f0e20 msgr2=0x7f02f00f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- 172.21.15.96:0/669453577 shutdown_connections 2022-02-02T18:18:48.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- 172.21.15.96:0/669453577 wait complete. 2022-02-02T18:18:48.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 Processor -- start 2022-02-02T18:18:48.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.729+0000 7f02f55d2700 1 -- start start 2022-02-02T18:18:48.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02f55d2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f56e0 0x7f02f0109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02f55d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02f55d2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0060940 con 0x7f02f00f6980 2022-02-02T18:18:48.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02f55d2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0060a80 con 0x7f02f00f56e0 2022-02-02T18:18:48.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51998/0 (socket says 172.21.15.96:51998) 2022-02-02T18:18:48.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 -- 172.21.15.96:0/3171589659 learned_addr learned my addr 172.21.15.96:0/3171589659 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:48.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02eeffd700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f56e0 0x7f02f0109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 -- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f56e0 msgr2=0x7f02f0109de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f56e0 0x7f02f0109de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0005040 con 0x7f02f00f6980 2022-02-02T18:18:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02ee7fc700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f02e40026d0 tx=0x7f02e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02e40079c0 con 0x7f02f00f6980 2022-02-02T18:18:48.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f010c890 con 0x7f02f00f6980 2022-02-02T18:18:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f02e400f040 con 0x7f02f00f6980 2022-02-02T18:18:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.730+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02e4014820 con 0x7f02f00f6980 2022-02-02T18:18:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.731+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f010ce50 con 0x7f02f00f6980 2022-02-02T18:18:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.731+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02f005dcf0 con 0x7f02f00f6980 2022-02-02T18:18:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.732+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f02e40090d0 con 0x7f02f00f6980 2022-02-02T18:18:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02d77fe700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 0x7f02d805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f02e4076120 con 0x7f02f00f6980 2022-02-02T18:18:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02eeffd700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 0x7f02d805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02d77fe700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 0x7f02d8064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02d8064a80 con 0x7f02d8061fc0 2022-02-02T18:18:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02e4076520 con 0x7f02f00f6980 2022-02-02T18:18:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02eeffd700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 0x7f02d805e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f02f00605c0 tx=0x7f02e0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.733+0000 7f02ef7fe700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 0x7f02d8064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.734+0000 7f02ef7fe700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 0x7f02d8064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.735+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== osd.4 v2:172.21.15.159:6808/3593977560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f02d8064a80 con 0x7f02d8061fc0 2022-02-02T18:18:48.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.753+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 --> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f02f0058150 con 0x7f02d8061fc0 2022-02-02T18:18:48.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.753+0000 7f02d77fe700 1 -- 172.21.15.96:0/3171589659 <== osd.4 v2:172.21.15.159:6808/3593977560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f02f0058150 con 0x7f02d8061fc0 2022-02-02T18:18:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 msgr2=0x7f02d8064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 0x7f02d8064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 msgr2=0x7f02d805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 0x7f02d805e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f02f00605c0 tx=0x7f02e0009b30).stop 2022-02-02T18:18:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 msgr2=0x7f02f010c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f02e40026d0 tx=0x7f02e4009de0).stop 2022-02-02T18:18:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 shutdown_connections 2022-02-02T18:18:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f02d805c2a0 0x7f02d805e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:6808/3593977560,v1:172.21.15.159:6809/3593977560] conn(0x7f02d8061fc0 0x7f02d8064400 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02f00f56e0 0x7f02f0109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 --2- 172.21.15.96:0/3171589659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f00f6980 0x7f02f010c2e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 >> 172.21.15.96:0/3171589659 conn(0x7f02f00f0e20 msgr2=0x7f02f00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 shutdown_connections 2022-02-02T18:18:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.754+0000 7f02f55d2700 1 -- 172.21.15.96:0/3171589659 wait complete. 2022-02-02T18:18:48.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 -- 172.21.15.96:0/2439298851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f4e60 msgr2=0x7f6be40f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 --2- 172.21.15.96:0/2439298851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f4e60 0x7f6be40f5280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6be0004770 tx=0x7f6be000ac40).stop 2022-02-02T18:18:48.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 -- 172.21.15.96:0/2439298851 shutdown_connections 2022-02-02T18:18:48.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 --2- 172.21.15.96:0/2439298851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f6060 0x7f6be40f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 --2- 172.21.15.96:0/2439298851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f4e60 0x7f6be40f5280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 -- 172.21.15.96:0/2439298851 >> 172.21.15.96:0/2439298851 conn(0x7f6be40f05e0 msgr2=0x7f6be40f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 -- 172.21.15.96:0/2439298851 shutdown_connections 2022-02-02T18:18:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.983+0000 7f6bebc63700 1 -- 172.21.15.96:0/2439298851 wait complete. 2022-02-02T18:18:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 Processor -- start 2022-02-02T18:18:48.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 -- start start 2022-02-02T18:18:48.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f4e60 0x7f6be4104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4105920 con 0x7f6be40f6060 2022-02-02T18:18:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6bebc63700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4105a60 con 0x7f6be40f4e60 2022-02-02T18:18:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6be91fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6be91fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52010/0 (socket says 172.21.15.96:52010) 2022-02-02T18:18:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6be91fe700 1 -- 172.21.15.96:0/4188864634 learned_addr learned my addr 172.21.15.96:0/4188864634 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.984+0000 7f6be99ff700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f4e60 0x7f6be4104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6be91fe700 1 -- 172.21.15.96:0/4188864634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f4e60 msgr2=0x7f6be4104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6be91fe700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f4e60 0x7f6be4104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6be91fe700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0005040 con 0x7f6be40f6060 2022-02-02T18:18:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6be91fe700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6bd400c530 tx=0x7f6bd4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd400f650 con 0x7f6be40f6060 2022-02-02T18:18:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be4106400 con 0x7f6be40f6060 2022-02-02T18:18:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6bd400fc40 con 0x7f6be40f6060 2022-02-02T18:18:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd4012b90 con 0x7f6be40f6060 2022-02-02T18:18:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.985+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be41069c0 con 0x7f6be40f6060 2022-02-02T18:18:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.986+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6be405dcf0 con 0x7f6be40f6060 2022-02-02T18:18:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.986+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6bd4022070 con 0x7f6be40f6060 2022-02-02T18:18:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bda7fc700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 0x7f6bd005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f6bd40763f0 con 0x7f6be40f6060 2022-02-02T18:18:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6be99ff700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 0x7f6bd005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bda7fc700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 0x7f6bd0064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bd0064a80 con 0x7f6bd0061fc0 2022-02-02T18:18:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd40767f0 con 0x7f6be40f6060 2022-02-02T18:18:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bea200700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 0x7f6bd0064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6be99ff700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 0x7f6bd005e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6be000ad30 tx=0x7f6be000c040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.987+0000 7f6bea200700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 0x7f6bd0064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:47.988+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== osd.2 v2:172.21.15.96:6818/620516912 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6bd0064a80 con 0x7f6bd0061fc0 2022-02-02T18:18:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 --> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6be4106ee0 con 0x7f6bd0061fc0 2022-02-02T18:18:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bda7fc700 1 -- 172.21.15.96:0/4188864634 <== osd.2 v2:172.21.15.96:6818/620516912 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6be4106ee0 con 0x7f6bd0061fc0 2022-02-02T18:18:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 msgr2=0x7f6bd0064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 0x7f6bd0064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 msgr2=0x7f6bd005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 0x7f6bd005e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6be000ad30 tx=0x7f6be000c040).stop 2022-02-02T18:18:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 msgr2=0x7f6be4105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6bd400c530 tx=0x7f6bd4007e20).stop 2022-02-02T18:18:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 shutdown_connections 2022-02-02T18:18:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6818/620516912,v1:172.21.15.96:6819/620516912] conn(0x7f6bd0061fc0 0x7f6bd0064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6bd005c2a0 0x7f6bd005e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40f4e60 0x7f6be4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 --2- 172.21.15.96:0/4188864634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6be40f6060 0x7f6be4105370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 >> 172.21.15.96:0/4188864634 conn(0x7f6be40f05e0 msgr2=0x7f6be40f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.003+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 shutdown_connections 2022-02-02T18:18:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.004+0000 7f6bebc63700 1 -- 172.21.15.96:0/4188864634 wait complete. 2022-02-02T18:18:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/2359291328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f67c0 msgr2=0x7f3b680f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/2359291328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f67c0 0x7f3b680f6be0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f3b5c004660 tx=0x7f3b5c009b30).stop 2022-02-02T18:18:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/2359291328 shutdown_connections 2022-02-02T18:18:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/2359291328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f7a60 0x7f3b680f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/2359291328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f67c0 0x7f3b680f6be0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/2359291328 >> 172.21.15.96:0/2359291328 conn(0x7f3b680f1f20 msgr2=0x7f3b680f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/2359291328 shutdown_connections 2022-02-02T18:18:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/2359291328 wait complete. 2022-02-02T18:18:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.669+0000 7f3b6e6ae700 1 Processor -- start 2022-02-02T18:18:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 -- start start 2022-02-02T18:18:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 0x7f3b6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6806a380 con 0x7f3b680f7a60 2022-02-02T18:18:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6806a4c0 con 0x7f3b680f67c0 2022-02-02T18:18:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52032/0 (socket says 172.21.15.96:52032) 2022-02-02T18:18:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 -- 172.21.15.96:0/3598841491 learned_addr learned my addr 172.21.15.96:0/3598841491 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b67fff700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 0x7f3b6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 -- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 msgr2=0x7f3b6806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 0x7f3b6806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c005040 con 0x7f3b680f7a60 2022-02-02T18:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b67fff700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 0x7f3b6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b677fe700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3b5800e7f0 tx=0x7f3b5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b580092e0 con 0x7f3b680f7a60 2022-02-02T18:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3b5800f040 con 0x7f3b680f7a60 2022-02-02T18:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6806a7a0 con 0x7f3b680f7a60 2022-02-02T18:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.670+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b580146c0 con 0x7f3b680f7a60 2022-02-02T18:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.671+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6810f040 con 0x7f3b680f7a60 2022-02-02T18:18:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.671+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b6805dd30 con 0x7f3b680f7a60 2022-02-02T18:18:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3b5801b030 con 0x7f3b680f7a60 2022-02-02T18:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 0x7f3b5005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3b58075910 con 0x7f3b680f7a60 2022-02-02T18:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b67fff700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 0x7f3b5005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 0x7f3b50064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b50064a80 con 0x7f3b50061fc0 2022-02-02T18:18:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.672+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b5807a220 con 0x7f3b680f7a60 2022-02-02T18:18:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.673+0000 7f3b67fff700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 0x7f3b5005e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3b5c000c00 tx=0x7f3b5c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.673+0000 7f3b6cc4b700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 0x7f3b50064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.673+0000 7f3b6cc4b700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 0x7f3b50064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.674+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== osd.3 v2:172.21.15.159:6800/3926735851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3b50064a80 con 0x7f3b50061fc0 2022-02-02T18:18:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.688+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 --> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b68058150 con 0x7f3b50061fc0 2022-02-02T18:18:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b64ff9700 1 -- 172.21.15.96:0/3598841491 <== osd.3 v2:172.21.15.159:6800/3926735851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3b68058150 con 0x7f3b50061fc0 2022-02-02T18:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 msgr2=0x7f3b50064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 0x7f3b50064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 msgr2=0x7f3b5005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 0x7f3b5005e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3b5c000c00 tx=0x7f3b5c00b040).stop 2022-02-02T18:18:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 msgr2=0x7f3b68069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3b5800e7f0 tx=0x7f3b5800b040).stop 2022-02-02T18:18:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 shutdown_connections 2022-02-02T18:18:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f3b5005c2a0 0x7f3b5005e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b680f67c0 0x7f3b6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.159:6800/3926735851,v1:172.21.15.159:6801/3926735851] conn(0x7f3b50061fc0 0x7f3b50064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 --2- 172.21.15.96:0/3598841491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b680f7a60 0x7f3b68069e20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 >> 172.21.15.96:0/3598841491 conn(0x7f3b680f1f20 msgr2=0x7f3b680fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 shutdown_connections 2022-02-02T18:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:48.689+0000 7f3b6e6ae700 1 -- 172.21.15.96:0/3598841491 wait complete. 2022-02-02T18:18:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:154618822665 2022-02-02T18:18:49.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.5 2022-02-02T18:18:49.682 INFO:teuthology.orchestra.run.smithi096.stdout:81604378643 2022-02-02T18:18:49.682 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.2 2022-02-02T18:18:50.085 INFO:teuthology.orchestra.run.smithi096.stdout:111669149712 2022-02-02T18:18:50.086 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.3 2022-02-02T18:18:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:50.189 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:50.195 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:49 smithi096 conmon[32067]: cluster 2022-02-02T18:18:48.790747+0000 mgr.smithi096.shfutl (mgr.14162) 163 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:50.196 INFO:teuthology.orchestra.run.smithi096.stdout:133143986188 2022-02-02T18:18:50.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.4 2022-02-02T18:18:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:49 smithi159 conmon[35668]: cluster 2022-02-02T18:18:48.790747+0000 mgr.smithi096.shfutl (mgr.14162) 163 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:50.291 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:52.202 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:51 smithi096 conmon[32067]: cluster 2022-02-02T18:18:50.791202+0000 2022-02-02T18:18:52.202 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:51 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 164 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:51 smithi159 conmon[35668]: cluster 2022-02-02T18:18:50.791202+0000 mgr.smithi096.shfutl (mgr.14162) 164 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:52.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 -- 172.21.15.96:0/3980989351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 msgr2=0x7f38400f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:52.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 --2- 172.21.15.96:0/3980989351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38400f6be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f3834004660 tx=0x7f3834009b30).stop 2022-02-02T18:18:52.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 -- 172.21.15.96:0/3980989351 shutdown_connections 2022-02-02T18:18:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 --2- 172.21.15.96:0/3980989351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 0x7f38400f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 --2- 172.21.15.96:0/3980989351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38400f6be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 -- 172.21.15.96:0/3980989351 >> 172.21.15.96:0/3980989351 conn(0x7f38400f1f20 msgr2=0x7f38400f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 -- 172.21.15.96:0/3980989351 shutdown_connections 2022-02-02T18:18:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.629+0000 7f3846a87700 1 -- 172.21.15.96:0/3980989351 wait complete. 2022-02-02T18:18:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 Processor -- start 2022-02-02T18:18:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 -- start start 2022-02-02T18:18:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 0x7f38401075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840107b70 con 0x7f38400f67c0 2022-02-02T18:18:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3846a87700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840107cb0 con 0x7f38400f7a60 2022-02-02T18:18:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3844823700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3844823700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52040/0 (socket says 172.21.15.96:52040) 2022-02-02T18:18:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3844823700 1 -- 172.21.15.96:0/3667957708 learned_addr learned my addr 172.21.15.96:0/3667957708 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f3844823700 1 -- 172.21.15.96:0/3667957708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 msgr2=0x7f38401075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.630+0000 7f383ffff700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 0x7f38401075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f3844823700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 0x7f38401075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f3844823700 1 -- 172.21.15.96:0/3667957708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005040 con 0x7f38400f67c0 2022-02-02T18:18:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f3844823700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f3834004e30 tx=0x7f3834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3834018070 con 0x7f38400f67c0 2022-02-02T18:18:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3834013410 con 0x7f38400f67c0 2022-02-02T18:18:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38401085f0 con 0x7f38400f67c0 2022-02-02T18:18:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383401c3c0 con 0x7f38400f67c0 2022-02-02T18:18:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.631+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3840108b50 con 0x7f38400f67c0 2022-02-02T18:18:52.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.632+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3840045ad0 con 0x7f38400f67c0 2022-02-02T18:18:52.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.632+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f383401d420 con 0x7f38400f67c0 2022-02-02T18:18:52.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.633+0000 7f383d7fa700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 0x7f383005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:52.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.633+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f38340779b0 con 0x7f38400f67c0 2022-02-02T18:18:52.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.633+0000 7f383ffff700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 0x7f383005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:52.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.633+0000 7f383ffff700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 0x7f383005e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f382c004a70 tx=0x7f382c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:52.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.637+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f383404a910 con 0x7f38400f67c0 2022-02-02T18:18:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.806+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3840027a00 con 0x7f38400f67c0 2022-02-02T18:18:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.806+0000 7f383d7fa700 1 -- 172.21.15.96:0/3667957708 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f383401d6b0 con 0x7f38400f67c0 2022-02-02T18:18:52.810 INFO:teuthology.orchestra.run.smithi096.stdout:81604378644 2022-02-02T18:18:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.808+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 msgr2=0x7f383005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.808+0000 7f3846a87700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 0x7f383005e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f382c004a70 tx=0x7f382c00b040).stop 2022-02-02T18:18:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.808+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 msgr2=0x7f38401070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.808+0000 7f3846a87700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f3834004e30 tx=0x7f3834009b30).stop 2022-02-02T18:18:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 shutdown_connections 2022-02-02T18:18:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f383005c2a0 0x7f383005e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38400f67c0 0x7f38401070d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 --2- 172.21.15.96:0/3667957708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38400f7a60 0x7f38401075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 >> 172.21.15.96:0/3667957708 conn(0x7f38400f1f20 msgr2=0x7f38400fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 shutdown_connections 2022-02-02T18:18:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:52.809+0000 7f3846a87700 1 -- 172.21.15.96:0/3667957708 wait complete. 2022-02-02T18:18:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:53.214 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:52 smithi096 conmon[32067]: audit 2022-02-02T18:18:52.807396+0000 mon.smithi096 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.96:0/3667957708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-02-02T18:18:53.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:52 smithi159 conmon[35668]: audit 2022-02-02T18:18:52.807396+0000 mon.smithi096 (mon.0) 442 : audit [DBG] 2022-02-02T18:18:53.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:52 smithi159 conmon[35668]: from='client.? 172.21.15.96:0/3667957708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-02-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:18:53.616 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378643 got 81604378644 for osd.2 2022-02-02T18:18:53.617 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:54.163 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:53 smithi096 conmon[32067]: cluster 2022-02-02T18:18:52.791496+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:18:54.164 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:53 smithi096 conmon[32067]: 14162) 165 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:53 smithi159 conmon[35668]: cluster 2022-02-02T18:18:52.791496+0000 mgr.smithi096.shfutl (mgr.14162) 165 : 2022-02-02T18:18:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:53 smithi159 conmon[35668]: cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 -- 172.21.15.96:0/251775634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 msgr2=0x7f16140f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 --2- 172.21.15.96:0/251775634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f16140f9260 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1604004660 tx=0x7f1604009b30).stop 2022-02-02T18:18:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 -- 172.21.15.96:0/251775634 shutdown_connections 2022-02-02T18:18:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 --2- 172.21.15.96:0/251775634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16140f97e0 0x7f16140fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 --2- 172.21.15.96:0/251775634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f16140f9260 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 -- 172.21.15.96:0/251775634 >> 172.21.15.96:0/251775634 conn(0x7f16140f0ca0 msgr2=0x7f16140f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 -- 172.21.15.96:0/251775634 shutdown_connections 2022-02-02T18:18:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.091+0000 7f161359e700 1 -- 172.21.15.96:0/251775634 wait complete. 2022-02-02T18:18:54.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 Processor -- start 2022-02-02T18:18:54.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 -- start start 2022-02-02T18:18:54.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16140f97e0 0x7f16141073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614107950 con 0x7f1614060810 2022-02-02T18:18:54.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614108150 con 0x7f16140f97e0 2022-02-02T18:18:54.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52048/0 (socket says 172.21.15.96:52048) 2022-02-02T18:18:54.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 -- 172.21.15.96:0/534682337 learned_addr learned my addr 172.21.15.96:0/534682337 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 -- 172.21.15.96:0/534682337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16140f97e0 msgr2=0x7f16141073a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:18:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16140f97e0 0x7f16141073a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 -- 172.21.15.96:0/534682337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604005040 con 0x7f1614060810 2022-02-02T18:18:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.092+0000 7f161259c700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1604009870 tx=0x7f160400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.291 INFO:teuthology.orchestra.run.smithi096.stdout:154618822666 2022-02-02T18:18:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.093+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1604019070 con 0x7f1614060810 2022-02-02T18:18:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.093+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1604014420 con 0x7f1614060810 2022-02-02T18:18:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.093+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1614108370 con 0x7f1614060810 2022-02-02T18:18:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.093+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1604007e50 con 0x7f1614060810 2022-02-02T18:18:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.093+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1614108880 con 0x7f1614060810 2022-02-02T18:18:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.094+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1614059100 con 0x7f1614060810 2022-02-02T18:18:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.094+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1604014950 con 0x7f1614060810 2022-02-02T18:18:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.095+0000 7f1602ffd700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 0x7f15fc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.095+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f1604077130 con 0x7f1614060810 2022-02-02T18:18:54.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.095+0000 7f1611d9b700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 0x7f15fc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.095+0000 7f1611d9b700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 0x7f15fc05e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f16140605e0 tx=0x7f160800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.099+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f160404a0f0 con 0x7f1614060810 2022-02-02T18:18:54.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.282+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1614045ad0 con 0x7f1614060810 2022-02-02T18:18:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.283+0000 7f1602ffd700 1 -- 172.21.15.96:0/534682337 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f160404d710 con 0x7f1614060810 2022-02-02T18:18:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 msgr2=0x7f15fc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 0x7f15fc05e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f16140605e0 tx=0x7f160800b040).stop 2022-02-02T18:18:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 msgr2=0x7f1614106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1604009870 tx=0x7f160400b040).stop 2022-02-02T18:18:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 shutdown_connections 2022-02-02T18:18:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f15fc05c2a0 0x7f15fc05e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1614060810 0x7f1614106eb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 --2- 172.21.15.96:0/534682337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16140f97e0 0x7f16141073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 >> 172.21.15.96:0/534682337 conn(0x7f16140f0ca0 msgr2=0x7f16140f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 shutdown_connections 2022-02-02T18:18:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.285+0000 7f161359e700 1 -- 172.21.15.96:0/534682337 wait complete. 2022-02-02T18:18:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.195+0000 7f0614fa9700 1 -- 172.21.15.96:0/2498911938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 msgr2=0x7f06100f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.195+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2498911938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f06100f6c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0604004660 tx=0x7f0604009b30).stop 2022-02-02T18:18:54.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 -- 172.21.15.96:0/2498911938 shutdown_connections 2022-02-02T18:18:54.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2498911938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f06100f6c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2498911938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5520 0x7f06100f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 -- 172.21.15.96:0/2498911938 >> 172.21.15.96:0/2498911938 conn(0x7f06100f0ca0 msgr2=0x7f06100f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 -- 172.21.15.96:0/2498911938 shutdown_connections 2022-02-02T18:18:54.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.196+0000 7f0614fa9700 1 -- 172.21.15.96:0/2498911938 wait complete. 2022-02-02T18:18:54.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.197+0000 7f0614fa9700 1 Processor -- start 2022-02-02T18:18:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.197+0000 7f0614fa9700 1 -- start start 2022-02-02T18:18:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f0614fa9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5520 0x7f0610109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f0614fa9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f0614fa9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610060980 con 0x7f06100f67c0 2022-02-02T18:18:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f0614fa9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610060ac0 con 0x7f06100f5520 2022-02-02T18:18:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52068/0 (socket says 172.21.15.96:52068) 2022-02-02T18:18:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 -- 172.21.15.96:0/2110801442 learned_addr learned my addr 172.21.15.96:0/2110801442 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 -- 172.21.15.96:0/2110801442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5520 msgr2=0x7f0610109b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:18:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5520 0x7f0610109b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 -- 172.21.15.96:0/2110801442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604005040 con 0x7f06100f67c0 2022-02-02T18:18:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f060effd700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f0604009d30 tx=0x7f0604009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.198+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604004290 con 0x7f06100f67c0 2022-02-02T18:18:54.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.199+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0604022d60 con 0x7f06100f67c0 2022-02-02T18:18:54.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.199+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604012950 con 0x7f06100f67c0 2022-02-02T18:18:54.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.199+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06101058f0 con 0x7f06100f67c0 2022-02-02T18:18:54.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.199+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0610105e50 con 0x7f06100f67c0 2022-02-02T18:18:54.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.200+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610045ad0 con 0x7f06100f67c0 2022-02-02T18:18:54.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.200+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0604012c10 con 0x7f06100f67c0 2022-02-02T18:18:54.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.201+0000 7f05f7fff700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.201+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f060407f090 con 0x7f06100f67c0 2022-02-02T18:18:54.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.201+0000 7f060f7fe700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.201+0000 7f060f7fe700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 0x7f05f805e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0610060600 tx=0x7f06000099e0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.205+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0604052140 con 0x7f06100f67c0 2022-02-02T18:18:54.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.376+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06100fde70 con 0x7f06100f67c0 2022-02-02T18:18:54.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.376+0000 7f05f7fff700 1 -- 172.21.15.96:0/2110801442 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06100fde70 con 0x7f06100f67c0 2022-02-02T18:18:54.379 INFO:teuthology.orchestra.run.smithi096.stdout:38654705692 2022-02-02T18:18:54.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 msgr2=0x7f05f805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 0x7f05f805e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0610060600 tx=0x7f06000099e0).stop 2022-02-02T18:18:54.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 msgr2=0x7f061010c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f0604009d30 tx=0x7f0604009b30).stop 2022-02-02T18:18:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 shutdown_connections 2022-02-02T18:18:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5520 0x7f0610109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:18:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 --2- 172.21.15.96:0/2110801442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f67c0 0x7f061010c010 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.378+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 >> 172.21.15.96:0/2110801442 conn(0x7f06100f0ca0 msgr2=0x7f06100fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.379+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 shutdown_connections 2022-02-02T18:18:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.379+0000 7f0614fa9700 1 -- 172.21.15.96:0/2110801442 wait complete. 2022-02-02T18:18:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 -- 172.21.15.96:0/4245545594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63880fbd00 msgr2=0x7f63880fe0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 --2- 172.21.15.96:0/4245545594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63880fbd00 0x7f63880fe0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f637c004660 tx=0x7f637c009b30).stop 2022-02-02T18:18:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 -- 172.21.15.96:0/4245545594 shutdown_connections 2022-02-02T18:18:54.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 --2- 172.21.15.96:0/4245545594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63880fbd00 0x7f63880fe0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 --2- 172.21.15.96:0/4245545594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6388060810 0x7f63880fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 -- 172.21.15.96:0/4245545594 >> 172.21.15.96:0/4245545594 conn(0x7f63880f0e10 msgr2=0x7f63880f3250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 -- 172.21.15.96:0/4245545594 shutdown_connections 2022-02-02T18:18:54.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.160+0000 7f638d450700 1 -- 172.21.15.96:0/4245545594 wait complete. 2022-02-02T18:18:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 Processor -- start 2022-02-02T18:18:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 -- start start 2022-02-02T18:18:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63880fbd00 0x7f63880f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880f82a0 con 0x7f6388060810 2022-02-02T18:18:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.161+0000 7f638d450700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880f83e0 con 0x7f63880fbd00 2022-02-02T18:18:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52058/0 (socket says 172.21.15.96:52058) 2022-02-02T18:18:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 -- 172.21.15.96:0/2965266600 learned_addr learned my addr 172.21.15.96:0/2965266600 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f63867fc700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63880fbd00 0x7f63880f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 -- 172.21.15.96:0/2965266600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63880fbd00 msgr2=0x7f63880f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63880fbd00 0x7f63880f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 -- 172.21.15.96:0/2965266600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c005040 con 0x7f6388060810 2022-02-02T18:18:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f6386ffd700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f637800e7f0 tx=0x7f637800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63780092e0 con 0x7f6388060810 2022-02-02T18:18:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f637800f040 con 0x7f6388060810 2022-02-02T18:18:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63780146c0 con 0x7f6388060810 2022-02-02T18:18:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63880f8d50 con 0x7f6388060810 2022-02-02T18:18:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.162+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63880f9310 con 0x7f6388060810 2022-02-02T18:18:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.164+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f637801b030 con 0x7f6388060810 2022-02-02T18:18:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.164+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6388045ad0 con 0x7f6388060810 2022-02-02T18:18:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.164+0000 7f636f7fe700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 0x7f637005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:54.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.164+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f63780758e0 con 0x7f6388060810 2022-02-02T18:18:54.558 INFO:teuthology.orchestra.run.smithi096.stdout:60129542168 2022-02-02T18:18:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.164+0000 7f63867fc700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 0x7f637005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.165+0000 7f63867fc700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 0x7f637005e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f637c004d80 tx=0x7f637c016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.172+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f63780489b0 con 0x7f6388060810 2022-02-02T18:18:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.352+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6388027a00 con 0x7f6388060810 2022-02-02T18:18:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.353+0000 7f636f7fe700 1 -- 172.21.15.96:0/2965266600 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6378019020 con 0x7f6388060810 2022-02-02T18:18:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.354+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 msgr2=0x7f637005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.354+0000 7f638d450700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 0x7f637005e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f637c004d80 tx=0x7f637c016040).stop 2022-02-02T18:18:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.354+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 msgr2=0x7f63880f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.354+0000 7f638d450700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f637800e7f0 tx=0x7f637800b040).stop 2022-02-02T18:18:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 shutdown_connections 2022-02-02T18:18:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f637005c2a0 0x7f637005e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6388060810 0x7f63880f77b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 --2- 172.21.15.96:0/2965266600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63880fbd00 0x7f63880f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 >> 172.21.15.96:0/2965266600 conn(0x7f63880f0e10 msgr2=0x7f63880f3250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 shutdown_connections 2022-02-02T18:18:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:54.355+0000 7f638d450700 1 -- 172.21.15.96:0/2965266600 wait complete. 2022-02-02T18:18:55.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:54 smithi096 conmon[32067]: audit 2022-02-02T18:18:54.283503+0000 mon.smithi096 (mon.0) 443 2022-02-02T18:18:55.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:54 smithi096 conmon[32067]: : audit [DBG] from='client.? 172.21.15.96:0/534682337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-02-02T18:18:55.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:54 smithi096 conmon[32067]: audit 2022-02-02T18:18:54.353720+0000 mon.smithi096 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.96:0/2965266600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-02-02T18:18:55.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:54 smithi096 conmon[32067]: audit 2022-02-02T18:18:54.376926+0000 mon.smithi096 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.96:0/2110801442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-02-02T18:18:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:54 smithi159 conmon[35668]: audit 2022-02-02T18:18:54.283503+0000 mon.smithi096 (mon.0) 443 : audit [DBG] 2022-02-02T18:18:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:54 smithi159 conmon[35668]: from='client.? 172.21.15.96:0/534682337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-02-02T18:18:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:54 smithi159 conmon[35668]: audit 2022-02-02T18:18:54.353720+0000 mon.smithi096 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.96:0/2965266600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-02-02T18:18:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:54 smithi159 conmon[35668]: audit 2022-02-02T18:18:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:54 smithi159 conmon[35668]: 2022-02-02T18:18:54.376926+0000 mon.smithi096 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.96:0/2110801442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-02-02T18:18:55.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705691 got 38654705692 for osd.0 2022-02-02T18:18:55.777 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:55.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542167 got 60129542168 for osd.1 2022-02-02T18:18:55.974 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:55 smithi159 conmon[35668]: cluster 2022-02-02T18:18:54.791753+0000 mgr.smithi096.shfutl (mgr.14162) 166 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:56.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:55 smithi096 conmon[32067]: cluster 2022-02-02T18:18:54.791753+0000 mgr.smithi096.shfutl (mgr.14162) 166 : 2022-02-02T18:18:56.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:55 smithi096 conmon[32067]: cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:56.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822665 got 154618822666 for osd.5 2022-02-02T18:18:56.638 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- 172.21.15.96:0/3304182186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f67b0 msgr2=0x7f709c0f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 --2- 172.21.15.96:0/3304182186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f67b0 0x7f709c0f6c10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f708c004660 tx=0x7f708c009b30).stop 2022-02-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- 172.21.15.96:0/3304182186 shutdown_connections 2022-02-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 --2- 172.21.15.96:0/3304182186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f67b0 0x7f709c0f6c10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 --2- 172.21.15.96:0/3304182186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f5510 0x7f709c0f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- 172.21.15.96:0/3304182186 >> 172.21.15.96:0/3304182186 conn(0x7f709c0f0c70 msgr2=0x7f709c0f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- 172.21.15.96:0/3304182186 shutdown_connections 2022-02-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- 172.21.15.96:0/3304182186 wait complete. 2022-02-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 Processor -- start 2022-02-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- start start 2022-02-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f67b0 0x7f709c106310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c106910 con 0x7f709c0f5510 2022-02-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a308a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c107120 con 0x7f709c0f67b0 2022-02-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.924+0000 7f70a2088700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52076/0 (socket says 172.21.15.96:52076) 2022-02-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 -- 172.21.15.96:0/4148853941 learned_addr learned my addr 172.21.15.96:0/4148853941 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a1887700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f67b0 0x7f709c106310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 -- 172.21.15.96:0/4148853941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f67b0 msgr2=0x7f709c106310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f67b0 0x7f709c106310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 -- 172.21.15.96:0/4148853941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c005040 con 0x7f709c0f5510 2022-02-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a2088700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f709400d7f0 tx=0x7f7094004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f709400f490 con 0x7f709c0f5510 2022-02-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f709400f040 con 0x7f709c0f5510 2022-02-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c1073a0 con 0x7f709c0f5510 2022-02-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7094013920 con 0x7f709c0f5510 2022-02-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.925+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c107960 con 0x7f709c0f5510 2022-02-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.926+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c059100 con 0x7f709c0f5510 2022-02-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.926+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f709401a030 con 0x7f709c0f5510 2022-02-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.927+0000 7f7092ffd700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 0x7f708805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.927+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f70940759c0 con 0x7f709c0f5510 2022-02-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.927+0000 7f70a1887700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 0x7f708805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.927+0000 7f70a1887700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 0x7f708805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f708c005010 tx=0x7f708c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:56.931+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f70940489e0 con 0x7f709c0f5510 2022-02-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.091+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f709c045ad0 con 0x7f709c0f5510 2022-02-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.091+0000 7f7092ffd700 1 -- 172.21.15.96:0/4148853941 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f709404c000 con 0x7f709c0f5510 2022-02-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi096.stdout:111669149714 2022-02-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 msgr2=0x7f708805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 0x7f708805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f708c005010 tx=0x7f708c009b30).stop 2022-02-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 msgr2=0x7f709c105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f709400d7f0 tx=0x7f7094004e80).stop 2022-02-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 shutdown_connections 2022-02-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f708805c2b0 0x7f708805e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f709c0f5510 0x7f709c105e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 --2- 172.21.15.96:0/4148853941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709c0f67b0 0x7f709c106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 >> 172.21.15.96:0/4148853941 conn(0x7f709c0f0c70 msgr2=0x7f709c0fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 shutdown_connections 2022-02-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.093+0000 7f70a308a700 1 -- 172.21.15.96:0/4148853941 wait complete. 2022-02-02T18:18:57.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 -- 172.21.15.96:0/2277059716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f6610 msgr2=0x7f93580f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 --2- 172.21.15.96:0/2277059716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f6610 0x7f93580f6a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9348004660 tx=0x7f9348009b30).stop 2022-02-02T18:18:57.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 -- 172.21.15.96:0/2277059716 shutdown_connections 2022-02-02T18:18:57.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 --2- 172.21.15.96:0/2277059716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f78b0 0x7f93580f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 --2- 172.21.15.96:0/2277059716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f6610 0x7f93580f6a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 -- 172.21.15.96:0/2277059716 >> 172.21.15.96:0/2277059716 conn(0x7f93580f1d70 msgr2=0x7f93580f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:57.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 -- 172.21.15.96:0/2277059716 shutdown_connections 2022-02-02T18:18:57.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.263+0000 7f935e363700 1 -- 172.21.15.96:0/2277059716 wait complete. 2022-02-02T18:18:57.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 Processor -- start 2022-02-02T18:18:57.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 -- start start 2022-02-02T18:18:57.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f6610 0x7f9358106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:57.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358107960 con 0x7f93580f78b0 2022-02-02T18:18:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935e363700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358107aa0 con 0x7f93580f6610 2022-02-02T18:18:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52088/0 (socket says 172.21.15.96:52088) 2022-02-02T18:18:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 -- 172.21.15.96:0/2311279973 learned_addr learned my addr 172.21.15.96:0/2311279973 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:18:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935d361700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f6610 0x7f9358106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 -- 172.21.15.96:0/2311279973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f6610 msgr2=0x7f9358106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f6610 0x7f9358106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.264+0000 7f935cb60700 1 -- 172.21.15.96:0/2311279973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348005040 con 0x7f93580f78b0 2022-02-02T18:18:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f935cb60700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f93540026d0 tx=0x7f9354009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9354009320 con 0x7f93580f78b0 2022-02-02T18:18:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358108440 con 0x7f93580f78b0 2022-02-02T18:18:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f935400f040 con 0x7f93580f78b0 2022-02-02T18:18:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9354014770 con 0x7f93580f78b0 2022-02-02T18:18:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.265+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9358108a00 con 0x7f93580f78b0 2022-02-02T18:18:57.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.266+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358045ad0 con 0x7f93580f78b0 2022-02-02T18:18:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.266+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9354009480 con 0x7f93580f78b0 2022-02-02T18:18:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.267+0000 7f934dffb700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 0x7f934405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:18:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.267+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f9354076230 con 0x7f93580f78b0 2022-02-02T18:18:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.267+0000 7f935d361700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 0x7f934405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:18:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.267+0000 7f935d361700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 0x7f934405e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9348004e30 tx=0x7f9348009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:18:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.271+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9354049210 con 0x7f93580f78b0 2022-02-02T18:18:57.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.427+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f93580feed0 con 0x7f93580f78b0 2022-02-02T18:18:57.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.428+0000 7f934dffb700 1 -- 172.21.15.96:0/2311279973 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f935404c830 con 0x7f93580f78b0 2022-02-02T18:18:57.432 INFO:teuthology.orchestra.run.smithi096.stdout:133143986189 2022-02-02T18:18:57.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 msgr2=0x7f934405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 0x7f934405e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9348004e30 tx=0x7f9348009b30).stop 2022-02-02T18:18:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 msgr2=0x7f93581073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:18:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f93540026d0 tx=0x7f9354009de0).stop 2022-02-02T18:18:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 shutdown_connections 2022-02-02T18:18:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f934405c300 0x7f934405e7c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93580f6610 0x7f9358106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 --2- 172.21.15.96:0/2311279973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93580f78b0 0x7f93581073b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:18:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 >> 172.21.15.96:0/2311279973 conn(0x7f93580f1d70 msgr2=0x7f93580fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:18:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 shutdown_connections 2022-02-02T18:18:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:18:57.430+0000 7f935e363700 1 -- 172.21.15.96:0/2311279973 wait complete. 2022-02-02T18:18:57.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149712 got 111669149714 for osd.3 2022-02-02T18:18:57.740 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:57 smithi096 conmon[32067]: cluster 2022-02-02T18:18:56.792114+0000 mgr.smithi096.shfutl (mgr.14162) 167 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:57 smithi096 conmon[32067]: audit 2022-02-02T18:18:57.093370+0000 mon.smithi096 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.96:0/4148853941' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-02-02T18:18:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:57 smithi096 conmon[32067]: audit 2022-02-02T18:18:57.429731+0000 mon.smithi096 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.96:0/2311279973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-02-02T18:18:58.056 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986188 got 133143986189 for osd.4 2022-02-02T18:18:58.057 DEBUG:teuthology.parallel:result is None 2022-02-02T18:18:58.057 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2022-02-02T18:18:58.058 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-02-02T18:18:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:57 smithi159 conmon[35668]: cluster 2022-02-02T18:18:56.792114+0000 mgr.smithi096.shfutl (mgr.14162) 167 : cluster [DBG] 2022-02-02T18:18:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:57 smithi159 conmon[35668]: pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:18:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:57 smithi159 conmon[35668]: audit 2022-02-02T18:18:57.093370+0000 mon.smithi096 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.96:0/4148853941' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-02-02T18:18:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:57 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:18:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:57 smithi159 conmon[35668]: :18:57.429731+0000 mon.smithi096 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.96:0/2311279973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-02-02T18:18:58.493 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:19:00.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 -- 172.21.15.96:0/689185551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f67e0 msgr2=0x7fe0640f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/689185551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f67e0 0x7fe0640f6c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe054004660 tx=0x7fe054009b30).stop 2022-02-02T18:19:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 -- 172.21.15.96:0/689185551 shutdown_connections 2022-02-02T18:19:00.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/689185551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f7a80 0x7fe0640f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:00.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/689185551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f67e0 0x7fe0640f6c00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:00.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 -- 172.21.15.96:0/689185551 >> 172.21.15.96:0/689185551 conn(0x7fe0640f1f80 msgr2=0x7fe0640f43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:00.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 -- 172.21.15.96:0/689185551 shutdown_connections 2022-02-02T18:19:00.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.014+0000 7fe06c6e4700 1 -- 172.21.15.96:0/689185551 wait complete. 2022-02-02T18:19:00.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:18:59 smithi096 conmon[32067]: cluster 2022-02-02T18:18:58.792719+0000 mgr.smithi096.shfutl (mgr.14162) 168 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:00.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 Processor -- start 2022-02-02T18:19:00.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 -- start start 2022-02-02T18:19:00.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 0x7fe064107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:00.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:00.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064107bc0 con 0x7fe0640f7a80 2022-02-02T18:19:00.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06c6e4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064108470 con 0x7fe0640f67e0 2022-02-02T18:19:00.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:00.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52098/0 (socket says 172.21.15.96:52098) 2022-02-02T18:19:00.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 -- 172.21.15.96:0/3205435717 learned_addr learned my addr 172.21.15.96:0/3205435717 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:00.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06a480700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 0x7fe064107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:00.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 -- 172.21.15.96:0/3205435717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 msgr2=0x7fe064107090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:00.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 0x7fe064107090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:00.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe069c7f700 1 -- 172.21.15.96:0/3205435717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054005040 con 0x7fe0640f7a80 2022-02-02T18:19:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.015+0000 7fe06a480700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 0x7fe064107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:19:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe069c7f700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe06000b410 tx=0x7fe060006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0600125f0 con 0x7fe0640f7a80 2022-02-02T18:19:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe060012be0 con 0x7fe0640f7a80 2022-02-02T18:19:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064108750 con 0x7fe0640f7a80 2022-02-02T18:19:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe060002a00 con 0x7fe0640f7a80 2022-02-02T18:19:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.016+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe064108d10 con 0x7fe0640f7a80 2022-02-02T18:19:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.017+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe064059100 con 0x7fe0640f7a80 2022-02-02T18:19:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.017+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe06000f030 con 0x7fe0640f7a80 2022-02-02T18:19:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.017+0000 7fe05affd700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 0x7fe05005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.017+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fe0600760e0 con 0x7fe0640f7a80 2022-02-02T18:19:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.017+0000 7fe06a480700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 0x7fe05005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.018+0000 7fe06a480700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 0x7fe05005e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe054004e30 tx=0x7fe054009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:00.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.021+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe060049100 con 0x7fe0640f7a80 2022-02-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.166+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0640ff090 con 0x7fe05005c2a0 2022-02-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.167+0000 7fe05affd700 1 -- 172.21.15.96:0/3205435717 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24076 (secure 0 0 0) 0x7fe0640ff090 con 0x7fe05005c2a0 2022-02-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 msgr2=0x7fe05005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 0x7fe05005e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe054004e30 tx=0x7fe054009b30).stop 2022-02-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 msgr2=0x7fe064107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe06000b410 tx=0x7fe060006ef0).stop 2022-02-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 shutdown_connections 2022-02-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fe05005c2a0 0x7fe05005e760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0640f67e0 0x7fe064107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 --2- 172.21.15.96:0/3205435717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0640f7a80 0x7fe064107580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 >> 172.21.15.96:0/3205435717 conn(0x7fe0640f1f80 msgr2=0x7fe0640fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 shutdown_connections 2022-02-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:00.169+0000 7fe06c6e4700 1 -- 172.21.15.96:0/3205435717 wait complete. 2022-02-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2022-02-02T18:19:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:18:59 smithi159 conmon[35668]: cluster 2022-02-02T18:18:58.792719+0000 mgr.smithi096.shfutl (mgr.14162) 168 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:00.695 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2022-02-02T18:18:58.792556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31112,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":562439800,"statfs":{"total":575970213888,"available":575938355200,"internally_reserved":0,"allocated":1990656,"data_stored":737700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"36","state":"active+clean","last_fresh":"2022-02-02T18:18:20.018317+0000","last_change":"2022-02-02T18:18:02.986446+0000","last_active":"2022-02-02T18:18:20.018317+0000","last_peered":"2022-02-02T18:18:20.018317+0000","last_clean":"2022-02-02T18:18:20.018317+0000","last_became_active":"2022-02-02T18:18:02.986070+0000","last_became_peered":"2022-02-02T18:18:02.986070+0000","last_unstale":"2022-02-02T18:18:20.018317+0000","last_undegraded":"2022-02-02T18:18:20.018317+0000","last_fullsized":"2022-02-02T18:18:20.018317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-02T18:17:39.627123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-02T18:17:39.627123+0000","last_clean_scrub_stamp":"2022-02-02T18:17:39.627123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378645,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:29 2022","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.33100000000000002}]},{"osd":1,"last update":"Wed Feb 2 18:18:29 2022","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed Feb 2 18:18:47 2022","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 2 18:18:15 2022","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":14.077,"5min":14.077,"15min":14.077},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Feb 2 18:18:31 2022","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.311}]},{"osd":3,"last update":"Wed Feb 2 18:18:46 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:13 2022","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Feb 2 18:18:32 2022","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.38},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed Feb 2 18:18:45 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-02-02T18:19:00.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-02-02T18:19:01.136 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:19:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:00 smithi159 conmon[35668]: audit 2022-02-02T18:19:00.168278+0000 mgr.smithi096.shfutl (mgr.14162) 169 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T18:19:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:00 smithi159 conmon[35668]: 2022-02-02T18:19:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:00 smithi159 conmon[35668]: cluster 2022-02-02T18:19:00.793055+0000 mgr.smithi096.shfutl (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:00 smithi096 conmon[32067]: audit 2022-02-02T18:19:00.168278+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:19:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:00 smithi096 conmon[32067]: 14162) 169 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T18:19:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:00 smithi096 conmon[32067]: cluster 2022-02-02T18:19:00.793055+0000 mgr.smithi096.shfutl (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:02.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 -- 172.21.15.96:0/899910203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f67b0 msgr2=0x7fcd8c0f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/899910203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c0f6c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcd7c004660 tx=0x7fcd7c009b30).stop 2022-02-02T18:19:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 -- 172.21.15.96:0/899910203 shutdown_connections 2022-02-02T18:19:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/899910203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c0f6c10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/899910203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c0f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 -- 172.21.15.96:0/899910203 >> 172.21.15.96:0/899910203 conn(0x7fcd8c0f0c70 msgr2=0x7fcd8c0f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 -- 172.21.15.96:0/899910203 shutdown_connections 2022-02-02T18:19:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.649+0000 7fcd8b59e700 1 -- 172.21.15.96:0/899910203 wait complete. 2022-02-02T18:19:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 Processor -- start 2022-02-02T18:19:02.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 -- start start 2022-02-02T18:19:02.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:02.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:02.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c060810 con 0x7fcd8c0f5510 2022-02-02T18:19:02.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c060950 con 0x7fcd8c0f67b0 2022-02-02T18:19:02.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:02.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52106/0 (socket says 172.21.15.96:52106) 2022-02-02T18:19:02.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd8a59c700 1 -- 172.21.15.96:0/2378334304 learned_addr learned my addr 172.21.15.96:0/2378334304 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.650+0000 7fcd89d9b700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8a59c700 1 -- 172.21.15.96:0/2378334304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f67b0 msgr2=0x7fcd8c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8a59c700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8a59c700 1 -- 172.21.15.96:0/2378334304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c005040 con 0x7fcd8c0f5510 2022-02-02T18:19:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8a59c700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcd8000c530 tx=0x7fcd80007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8000f650 con 0x7fcd8c0f5510 2022-02-02T18:19:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcd8000fc40 con 0x7fcd8c0f5510 2022-02-02T18:19:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c10e9c0 con 0x7fcd8c0f5510 2022-02-02T18:19:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c10ee40 con 0x7fcd8c0f5510 2022-02-02T18:19:02.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.651+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd80012c20 con 0x7fcd8c0f5510 2022-02-02T18:19:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.652+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70004fa0 con 0x7fcd8c0f5510 2022-02-02T18:19:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.652+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcd80019030 con 0x7fcd8c0f5510 2022-02-02T18:19:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.653+0000 7fcd7affd700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 0x7fcd7405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.653+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fcd80075700 con 0x7fcd8c0f5510 2022-02-02T18:19:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.653+0000 7fcd89d9b700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 0x7fcd7405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.653+0000 7fcd89d9b700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 0x7fcd7405e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcd7c005010 tx=0x7fcd7c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.657+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd80048770 con 0x7fcd8c0f5510 2022-02-02T18:19:02.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.803+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd70002a40 con 0x7fcd7405c2b0 2022-02-02T18:19:02.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.804+0000 7fcd7affd700 1 -- 172.21.15.96:0/2378334304 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24062 (secure 0 0 0) 0x7fcd70002a40 con 0x7fcd7405c2b0 2022-02-02T18:19:02.809 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:02.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 msgr2=0x7fcd7405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:02.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 0x7fcd7405e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcd7c005010 tx=0x7fcd7c009b30).stop 2022-02-02T18:19:02.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 msgr2=0x7fcd8c10bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:02.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcd8000c530 tx=0x7fcd80007e10).stop 2022-02-02T18:19:02.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 shutdown_connections 2022-02-02T18:19:02.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fcd7405c2b0 0x7fcd7405e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5510 0x7fcd8c10bfd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 --2- 172.21.15.96:0/2378334304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f67b0 0x7fcd8c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 >> 172.21.15.96:0/2378334304 conn(0x7fcd8c0f0c70 msgr2=0x7fcd8c0fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 shutdown_connections 2022-02-02T18:19:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:02.806+0000 7fcd8b59e700 1 -- 172.21.15.96:0/2378334304 wait complete. 2022-02-02T18:19:02.813 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2022-02-02T18:19:03.351 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2022-02-02T18:19:02.793260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31112,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":562439800,"statfs":{"total":575970213888,"available":575938355200,"internally_reserved":0,"allocated":1990656,"data_stored":737700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"36","state":"active+clean","last_fresh":"2022-02-02T18:18:20.018317+0000","last_change":"2022-02-02T18:18:02.986446+0000","last_active":"2022-02-02T18:18:20.018317+0000","last_peered":"2022-02-02T18:18:20.018317+0000","last_clean":"2022-02-02T18:18:20.018317+0000","last_became_active":"2022-02-02T18:18:02.986070+0000","last_became_peered":"2022-02-02T18:18:02.986070+0000","last_unstale":"2022-02-02T18:18:20.018317+0000","last_undegraded":"2022-02-02T18:18:20.018317+0000","last_fullsized":"2022-02-02T18:18:20.018317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-02T18:17:39.627123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-02T18:17:39.627123+0000","last_clean_scrub_stamp":"2022-02-02T18:17:39.627123+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Feb 2 18:18:49 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378646,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:29 2022","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Feb 2 18:18:29 2022","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed Feb 2 18:18:47 2022","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.437},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 2 18:18:15 2022","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.314},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":14.077,"5min":14.077,"15min":14.077},"last":0.24299999999999999}]},{"osd":2,"last update":"Wed Feb 2 18:18:31 2022","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.28599999999999998}]},{"osd":3,"last update":"Wed Feb 2 18:18:46 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 18:18:13 2022","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed Feb 2 18:18:32 2022","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.314}]},{"osd":3,"last update":"Wed Feb 2 18:18:45 2022","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-02-02T18:19:03.352 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2022-02-02T18:19:03.353 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-02-02T18:19:03.353 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2022-02-02T18:19:03.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph health --format=json 2022-02-02T18:19:03.789 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:19:04.194 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:03 smithi096 conmon[32067]: cluster 2022-02-02T18:19:02.793406+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:19:04.194 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:03 smithi096 conmon[32067]: .14162) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:04.195 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:03 smithi096 conmon[32067]: audit 2022-02-02T18:19:02.805099+0000 mgr.smithi096.shfutl (mgr.14162) 172 : audit [DBG] from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T18:19:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:03 smithi159 conmon[35668]: cluster 2022-02-02T18:19:02.793406+0000 mgr.smithi096.shfutl (mgr.14162) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:03 smithi159 conmon[35668]: audit 2022-02-02T18:19:02.805099+0000 mgr.smithi096.shfutl (mgr.14162) 172 : audit [DBG] from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T18:19:05.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- 172.21.15.96:0/1218692738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 msgr2=0x7ff3040f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:05.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 --2- 172.21.15.96:0/1218692738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff3040f5b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff2f4004660 tx=0x7ff2f4009b30).stop 2022-02-02T18:19:05.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- 172.21.15.96:0/1218692738 shutdown_connections 2022-02-02T18:19:05.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 --2- 172.21.15.96:0/1218692738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 0x7ff3040f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:05.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 --2- 172.21.15.96:0/1218692738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff3040f5b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:05.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- 172.21.15.96:0/1218692738 >> 172.21.15.96:0/1218692738 conn(0x7ff3040f0e20 msgr2=0x7ff3040f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:05.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- 172.21.15.96:0/1218692738 shutdown_connections 2022-02-02T18:19:05.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- 172.21.15.96:0/1218692738 wait complete. 2022-02-02T18:19:05.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 Processor -- start 2022-02-02T18:19:05.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- start start 2022-02-02T18:19:05.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:05.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 0x7ff30410e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:05.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304060810 con 0x7ff3040f56e0 2022-02-02T18:19:05.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.192+0000 7ff308a5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304060950 con 0x7ff3040f6980 2022-02-02T18:19:05.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:05.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52114/0 (socket says 172.21.15.96:52114) 2022-02-02T18:19:05.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 -- 172.21.15.96:0/901095480 learned_addr learned my addr 172.21.15.96:0/901095480 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff301d9b700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 0x7ff30410e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 -- 172.21.15.96:0/901095480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 msgr2=0x7ff30410e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 0x7ff30410e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 -- 172.21.15.96:0/901095480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4005040 con 0x7ff3040f56e0 2022-02-02T18:19:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff30259c700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff2f4007a60 tx=0x7ff2f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f4018070 con 0x7ff3040f56e0 2022-02-02T18:19:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff2f4013410 con 0x7ff3040f56e0 2022-02-02T18:19:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30410ebf0 con 0x7ff3040f56e0 2022-02-02T18:19:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f401c620 con 0x7ff3040f56e0 2022-02-02T18:19:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.193+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30410f010 con 0x7ff3040f56e0 2022-02-02T18:19:05.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.194+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304045ad0 con 0x7ff3040f56e0 2022-02-02T18:19:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.194+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff2f401d940 con 0x7ff3040f56e0 2022-02-02T18:19:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.195+0000 7ff2f2ffd700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 0x7ff2ec05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.195+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7ff2f4077a40 con 0x7ff3040f56e0 2022-02-02T18:19:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.195+0000 7ff301d9b700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 0x7ff2ec05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:05.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.195+0000 7ff301d9b700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 0x7ff2ec05e760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2f800b790 tx=0x7ff2f8008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:05.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.199+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff2f404aae0 con 0x7ff3040f56e0 2022-02-02T18:19:05.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.406+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff304027a00 con 0x7ff3040f56e0 2022-02-02T18:19:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.406+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/901095480 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7ff2f404e100 con 0x7ff3040f56e0 2022-02-02T18:19:05.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 msgr2=0x7ff2ec05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 0x7ff2ec05e760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2f800b790 tx=0x7ff2f8008040).stop 2022-02-02T18:19:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 msgr2=0x7ff30410c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff2f4007a60 tx=0x7ff2f4009b30).stop 2022-02-02T18:19:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 shutdown_connections 2022-02-02T18:19:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff2ec05c2a0 0x7ff2ec05e760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3040f56e0 0x7ff30410c200 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 --2- 172.21.15.96:0/901095480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3040f6980 0x7ff30410e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 >> 172.21.15.96:0/901095480 conn(0x7ff3040f0e20 msgr2=0x7ff3040fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 shutdown_connections 2022-02-02T18:19:05.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:05.408+0000 7ff308a5f700 1 -- 172.21.15.96:0/901095480 wait complete. 2022-02-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-02-02T18:19:05.906 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2022-02-02T18:19:05.907 INFO:tasks.cephadm:Setup complete, yielding 2022-02-02T18:19:05.907 INFO:teuthology.run_tasks:Running task print... 2022-02-02T18:19:05.918 INFO:teuthology.task.print:**** done starting v16.2.4 2022-02-02T18:19:05.919 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:05.952 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:05.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph orch status' 2022-02-02T18:19:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:05 smithi159 conmon[35668]: cluster 2022-02-02T18:19:04.793750+0000 mgr.smithi096.shfutl (mgr.14162) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:05 smithi159 conmon[35668]: audit 2022-02-02T18:19:05.407932+0000 mon.smithi096 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.96:0/901095480' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-02-02T18:19:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:05 smithi096 conmon[32067]: cluster 2022-02-02T18:19:04.793750+0000 mgr.smithi096.shfutl (mgr.14162) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:06.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:05 smithi096 conmon[32067]: audit 2022-02-02T18:19:05.407932+0000 mon.smithi096 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.96:0/901095480' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-02-02T18:19:07.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 -- 172.21.15.96:0/268300840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 msgr2=0x7f28700f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:07.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 --2- 172.21.15.96:0/268300840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f28700f7010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f286c004660 tx=0x7f286c009b30).stop 2022-02-02T18:19:07.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 -- 172.21.15.96:0/268300840 shutdown_connections 2022-02-02T18:19:07.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 --2- 172.21.15.96:0/268300840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:07.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 --2- 172.21.15.96:0/268300840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f28700f7010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:07.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.797+0000 7f2878407700 1 -- 172.21.15.96:0/268300840 >> 172.21.15.96:0/268300840 conn(0x7f28700f04c0 msgr2=0x7f28700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:07.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 -- 172.21.15.96:0/268300840 shutdown_connections 2022-02-02T18:19:07.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 -- 172.21.15.96:0/268300840 wait complete. 2022-02-02T18:19:07.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 Processor -- start 2022-02-02T18:19:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 -- start start 2022-02-02T18:19:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870069880 con 0x7f28700f6bf0 2022-02-02T18:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f2878407700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287010fab0 con 0x7f28700f7590 2022-02-02T18:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f28761a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f28761a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52124/0 (socket says 172.21.15.96:52124) 2022-02-02T18:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.798+0000 7f28761a3700 1 -- 172.21.15.96:0/2135655433 learned_addr learned my addr 172.21.15.96:0/2135655433 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28759a2700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28761a3700 1 -- 172.21.15.96:0/2135655433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 msgr2=0x7f28700691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28761a3700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28761a3700 1 -- 172.21.15.96:0/2135655433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c005040 con 0x7f28700f6bf0 2022-02-02T18:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28759a2700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f28761a3700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f286c013a00 tx=0x7f286c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c01a070 con 0x7f28700f6bf0 2022-02-02T18:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f286c0097a0 con 0x7f28700f6bf0 2022-02-02T18:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287010fd30 con 0x7f28700f6bf0 2022-02-02T18:19:07.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c01f970 con 0x7f28700f6bf0 2022-02-02T18:19:07.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.799+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870110290 con 0x7f28700f6bf0 2022-02-02T18:19:07.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.800+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870045ad0 con 0x7f28700f6bf0 2022-02-02T18:19:07.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.800+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f286c012d40 con 0x7f28700f6bf0 2022-02-02T18:19:07.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.801+0000 7f2866ffd700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 0x7f285c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:07.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.801+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f286c079fd0 con 0x7f28700f6bf0 2022-02-02T18:19:07.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.801+0000 7f28759a2700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 0x7f285c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:07.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.801+0000 7f28759a2700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 0x7f285c05e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f286000a7e0 tx=0x7f2860008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:07.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.805+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f286c04cff0 con 0x7f28700f6bf0 2022-02-02T18:19:07.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.985+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28700f4880 con 0x7f285c05c2b0 2022-02-02T18:19:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.986+0000 7f2866ffd700 1 -- 172.21.15.96:0/2135655433 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f28700f4880 con 0x7f285c05c2b0 2022-02-02T18:19:07.989 INFO:teuthology.orchestra.run.smithi096.stdout:Backend: cephadm 2022-02-02T18:19:07.990 INFO:teuthology.orchestra.run.smithi096.stdout:Available: Yes 2022-02-02T18:19:07.990 INFO:teuthology.orchestra.run.smithi096.stdout:Paused: No 2022-02-02T18:19:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 msgr2=0x7f285c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 0x7f285c05e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f286000a7e0 tx=0x7f2860008040).stop 2022-02-02T18:19:07.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 msgr2=0x7f2870068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:07.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f286c013a00 tx=0x7f286c009b30).stop 2022-02-02T18:19:07.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 shutdown_connections 2022-02-02T18:19:07.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f285c05c2b0 0x7f285c05e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:07.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28700f6bf0 0x7f2870068d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:07.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 --2- 172.21.15.96:0/2135655433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28700f7590 0x7f28700691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:07.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 >> 172.21.15.96:0/2135655433 conn(0x7f28700f04c0 msgr2=0x7f28700fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:07.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 shutdown_connections 2022-02-02T18:19:07.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:07.987+0000 7f2878407700 1 -- 172.21.15.96:0/2135655433 wait complete. 2022-02-02T18:19:08.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:07 smithi096 conmon[32067]: cluster 2022-02-02T18:19:06.794070+0000 mgr.smithi096.shfutl (mgr.14162) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:07 smithi159 conmon[35668]: cluster 2022-02-02T18:19:06.794070+0000 mgr.smithi096.shfutl (mgr.14162) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:07 smithi159 conmon[35668]: 2022-02-02T18:19:08.466 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ps' 2022-02-02T18:19:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- 172.21.15.96:0/2279834385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 msgr2=0x7f35400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 --2- 172.21.15.96:0/2279834385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f35400f59e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3534004660 tx=0x7f3534009b30).stop 2022-02-02T18:19:10.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- 172.21.15.96:0/2279834385 shutdown_connections 2022-02-02T18:19:10.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 --2- 172.21.15.96:0/2279834385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 0x7f35400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:10.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 --2- 172.21.15.96:0/2279834385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f35400f59e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:10.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- 172.21.15.96:0/2279834385 >> 172.21.15.96:0/2279834385 conn(0x7f35400f0d40 msgr2=0x7f35400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- 172.21.15.96:0/2279834385 shutdown_connections 2022-02-02T18:19:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- 172.21.15.96:0/2279834385 wait complete. 2022-02-02T18:19:10.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:09 smithi096 conmon[32067]: audit 2022-02-02T18:19:07.987264+0000 mgr.smithi096.shfutl (mgr.14162) 175 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:10.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:09 smithi096 conmon[32067]: cluster 2022-02-02T18:19:08.794395+0000 mgr.smithi096.shfutl (mgr.14162) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 Processor -- start 2022-02-02T18:19:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- start start 2022-02-02T18:19:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 0x7f3540105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35401058a0 con 0x7f35400f55c0 2022-02-02T18:19:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.269+0000 7f3544aab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3540106150 con 0x7f35400f6860 2022-02-02T18:19:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52134/0 (socket says 172.21.15.96:52134) 2022-02-02T18:19:10.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 -- 172.21.15.96:0/1981381928 learned_addr learned my addr 172.21.15.96:0/1981381928 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:10.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353dd9b700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 0x7f3540105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:10.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 -- 172.21.15.96:0/1981381928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 msgr2=0x7f3540105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:10.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 0x7f3540105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:10.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 -- 172.21.15.96:0/1981381928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534005040 con 0x7f35400f55c0 2022-02-02T18:19:10.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f353e59c700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f3534000c00 tx=0x7f3534009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:10.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3534018070 con 0x7f35400f55c0 2022-02-02T18:19:10.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35401063a0 con 0x7f35400f55c0 2022-02-02T18:19:10.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3534013410 con 0x7f35400f55c0 2022-02-02T18:19:10.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353401c440 con 0x7f35400f55c0 2022-02-02T18:19:10.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.270+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3540106900 con 0x7f35400f55c0 2022-02-02T18:19:10.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.271+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35400f49b0 con 0x7f35400f55c0 2022-02-02T18:19:10.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.271+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f353401d420 con 0x7f35400f55c0 2022-02-02T18:19:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.272+0000 7f352effd700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 0x7f352805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.272+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3534077a70 con 0x7f35400f55c0 2022-02-02T18:19:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.272+0000 7f353dd9b700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 0x7f352805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.272+0000 7f353dd9b700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 0x7f352805e760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3530006fd0 tx=0x7f3530008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:09 smithi159 conmon[35668]: audit 2022-02-02T18:19:07.987264+0000 mgr.smithi096.shfutl (mgr.14162) 175 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:10.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:09 smithi159 conmon[35668]: cluster 2022-02-02T18:19:08.794395+0000 mgr.smithi096.shfutl (mgr.14162) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:10.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.276+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f353404aa90 con 0x7f35400f55c0 2022-02-02T18:19:10.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.450+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f35400faaa0 con 0x7f352805c2a0 2022-02-02T18:19:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.457+0000 7f352effd700 1 -- 172.21.15.96:0/1981381928 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f35400faaa0 con 0x7f352805c2a0 2022-02-02T18:19:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T18:19:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2m) 44s ago 3m 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:19:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3m) 44s ago 3m 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:19:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3m) 54s ago 3m 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:19:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2m) 44s ago 3m 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:19:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (4m) 44s ago 4m 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:19:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3m) 54s ago 3m 16.2.4 8d91d370c2b8 744df187ddef 2022-02-02T18:19:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4m) 44s ago 4m 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:19:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3m) 54s ago 3m 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:19:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3m) 44s ago 3m 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:19:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2m) 54s ago 2m 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:19:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2m) 44s ago 2m 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:19:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 44s ago 2m 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:19:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (108s) 44s ago 107s 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:19:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (92s) 54s ago 91s 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:19:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (75s) 54s ago 74s 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:19:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (57s) 54s ago 57s 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:19:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2m) 44s ago 3m 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:19:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 msgr2=0x7f352805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 0x7f352805e760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3530006fd0 tx=0x7f3530008040).stop 2022-02-02T18:19:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 msgr2=0x7f3540104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f3534000c00 tx=0x7f3534009b30).stop 2022-02-02T18:19:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 shutdown_connections 2022-02-02T18:19:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f352805c2a0 0x7f352805e760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35400f55c0 0x7f3540104d20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 --2- 172.21.15.96:0/1981381928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35400f6860 0x7f3540105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 >> 172.21.15.96:0/1981381928 conn(0x7f35400f0d40 msgr2=0x7f354005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 shutdown_connections 2022-02-02T18:19:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:10.459+0000 7f3544aab700 1 -- 172.21.15.96:0/1981381928 wait complete. 2022-02-02T18:19:10.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ls' 2022-02-02T18:19:11.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:11 smithi096 conmon[32067]: audit 2022-02-02T18:19:10.453096 2022-02-02T18:19:11.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:11 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 177 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:11.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:11 smithi096 conmon[32067]: cluster 2022-02-02T18:19:10.794782+0000 mgr.smithi096.shfutl (mgr.14162) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:11 smithi159 conmon[35668]: audit 2022-02-02T18:19:10.453096+0000 mgr.smithi096.shfutl (mgr.14162) 177 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:11 smithi159 conmon[35668]: cluster 2022-02-02T18:19:10.794782+0000 mgr.smithi096.shfutl (mgr.14162) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:12.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- 172.21.15.96:0/83747342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f55c0 msgr2=0x7f92a00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/83747342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f55c0 0x7f92a00f59e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9290004660 tx=0x7f9290009b30).stop 2022-02-02T18:19:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- 172.21.15.96:0/83747342 shutdown_connections 2022-02-02T18:19:12.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/83747342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f6860 0x7f92a00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/83747342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f55c0 0x7f92a00f59e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- 172.21.15.96:0/83747342 >> 172.21.15.96:0/83747342 conn(0x7f92a00f0d40 msgr2=0x7f92a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:12.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- 172.21.15.96:0/83747342 shutdown_connections 2022-02-02T18:19:12.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- 172.21.15.96:0/83747342 wait complete. 2022-02-02T18:19:12.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 Processor -- start 2022-02-02T18:19:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.677+0000 7f92a7bb0700 1 -- start start 2022-02-02T18:19:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 0x7f92a0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:12.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00603c0 con 0x7f92a00f6860 2022-02-02T18:19:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0060500 con 0x7f92a00f55c0 2022-02-02T18:19:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a594c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 0x7f92a0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a594c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 0x7f92a0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56248/0 (socket says 172.21.15.96:56248) 2022-02-02T18:19:12.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52146/0 (socket says 172.21.15.96:52146) 2022-02-02T18:19:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a594c700 1 -- 172.21.15.96:0/1720683534 learned_addr learned my addr 172.21.15.96:0/1720683534 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 -- 172.21.15.96:0/1720683534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 msgr2=0x7f92a0109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 0x7f92a0109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 -- 172.21.15.96:0/1720683534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290005040 con 0x7f92a00f6860 2022-02-02T18:19:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a514b700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f929c002700 tx=0x7f929c009cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929c0079c0 con 0x7f92a00f6860 2022-02-02T18:19:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a010c740 con 0x7f92a00f6860 2022-02-02T18:19:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f929c00f040 con 0x7f92a00f6860 2022-02-02T18:19:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929c0146a0 con 0x7f92a00f6860 2022-02-02T18:19:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.678+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a010ccd0 con 0x7f92a00f6860 2022-02-02T18:19:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.679+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a00f49b0 con 0x7f92a00f6860 2022-02-02T18:19:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.680+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f929c01b060 con 0x7f92a00f6860 2022-02-02T18:19:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.680+0000 7f92967fc700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 0x7f928c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.680+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f929c075980 con 0x7f92a00f6860 2022-02-02T18:19:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.680+0000 7f92a594c700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 0x7f928c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:12.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.681+0000 7f92a594c700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 0x7f928c05e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9290013620 tx=0x7f9290009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:12.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.684+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f929c048940 con 0x7f92a00f6860 2022-02-02T18:19:12.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.859+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f92a00fde60 con 0x7f928c05c2b0 2022-02-02T18:19:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.863+0000 7f92967fc700 1 -- 172.21.15.96:0/1720683534 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1116 (secure 0 0 0) 0x7f92a00fde60 con 0x7f928c05c2b0 2022-02-02T18:19:12.867 INFO:teuthology.orchestra.run.smithi096.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2022-02-02T18:19:12.867 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager 1/1 47s ago 4m count:1 2022-02-02T18:19:12.867 INFO:teuthology.orchestra.run.smithi096.stdout:crash 2/2 56s ago 4m * 2022-02-02T18:19:12.868 INFO:teuthology.orchestra.run.smithi096.stdout:grafana 1/1 47s ago 4m count:1 2022-02-02T18:19:12.868 INFO:teuthology.orchestra.run.smithi096.stdout:mgr 2/2 56s ago 4m count:2 2022-02-02T18:19:12.868 INFO:teuthology.orchestra.run.smithi096.stdout:mon 2/2 56s ago 3m smithi096:172.21.15.96=smithi096;smithi159:172.21.15.159=smithi159;count:2 2022-02-02T18:19:12.868 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter 2/2 56s ago 4m * 2022-02-02T18:19:12.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.unmanaged 6/6 56s ago - 2022-02-02T18:19:12.869 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus 1/1 47s ago 4m count:1 2022-02-02T18:19:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 msgr2=0x7f928c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 0x7f928c05e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9290013620 tx=0x7f9290009b30).stop 2022-02-02T18:19:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 msgr2=0x7f92a010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:12.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f929c002700 tx=0x7f929c009cc0).stop 2022-02-02T18:19:12.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 shutdown_connections 2022-02-02T18:19:12.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f928c05c2b0 0x7f928c05e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f55c0 0x7f92a0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 --2- 172.21.15.96:0/1720683534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f6860 0x7f92a010c190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 >> 172.21.15.96:0/1720683534 conn(0x7f92a00f0d40 msgr2=0x7f92a00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 shutdown_connections 2022-02-02T18:19:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:12.865+0000 7f92a7bb0700 1 -- 172.21.15.96:0/1720683534 wait complete. 2022-02-02T18:19:13.605 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph orch host ls' 2022-02-02T18:19:14.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:13 smithi096 conmon[32067]: cluster 2022-02-02T18:19:12. 2022-02-02T18:19:14.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:13 smithi096 conmon[32067]: 795094+0000 mgr.smithi096.shfutl (mgr.14162) 179 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:14.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:13 smithi096 conmon[32067]: audit 2022-02-02T18:19:12.861564+0000 mgr.smithi096.shfutl (mgr.14162) 180 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:13 smithi159 conmon[35668]: cluster 2022-02-02T18:19:12.795094+0000 mgr.smithi096.shfutl (mgr.14162) 179 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:13 smithi159 conmon[35668]: audit 2022-02-02T18:19:12.861564+0000 mgr.smithi096.shfutl (mgr.14162) 180 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 -- 172.21.15.96:0/2494374210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 msgr2=0x7f43f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/2494374210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f80f6cc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f43f4004660 tx=0x7f43f4009b30).stop 2022-02-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 -- 172.21.15.96:0/2494374210 shutdown_connections 2022-02-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/2494374210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f80f6cc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/2494374210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 0x7f43f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 -- 172.21.15.96:0/2494374210 >> 172.21.15.96:0/2494374210 conn(0x7f43f80f0d40 msgr2=0x7f43f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 -- 172.21.15.96:0/2494374210 shutdown_connections 2022-02-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.405+0000 7f43ffb3f700 1 -- 172.21.15.96:0/2494374210 wait complete. 2022-02-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 Processor -- start 2022-02-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 -- start start 2022-02-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 0x7f43f81090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8109b90 con 0x7f43f80f6860 2022-02-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43ffb3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8109cd0 con 0x7f43f80f55c0 2022-02-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52154/0 (socket says 172.21.15.96:52154) 2022-02-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 -- 172.21.15.96:0/237985921 learned_addr learned my addr 172.21.15.96:0/237985921 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd8db700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 0x7f43f81090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 -- 172.21.15.96:0/237985921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 msgr2=0x7f43f81090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 0x7f43f81090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.406+0000 7f43fd0da700 1 -- 172.21.15.96:0/237985921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4005040 con 0x7f43f80f6860 2022-02-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43fd0da700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f43f4009990 tx=0x7f43f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43f4018070 con 0x7f43f80f6860 2022-02-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f810a610 con 0x7f43f80f6860 2022-02-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f810ab70 con 0x7f43f80f6860 2022-02-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f43f4013410 con 0x7f43f80f6860 2022-02-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.407+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43f401de80 con 0x7f43f80f6860 2022-02-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.408+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e0004fa0 con 0x7f43f80f6860 2022-02-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.408+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f43f401d420 con 0x7f43f80f6860 2022-02-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.409+0000 7f43ee7fc700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 0x7f43e405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.409+0000 7f43fd8db700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 0x7f43e405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.409+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f43f40775f0 con 0x7f43f80f6860 2022-02-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.409+0000 7f43fd8db700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 0x7f43e405e760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f43f80f66c0 tx=0x7f43e800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.413+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f43f404a690 con 0x7f43f80f6860 2022-02-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.587+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e0000bc0 con 0x7f43e405c2a0 2022-02-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.588+0000 7f43ee7fc700 1 -- 172.21.15.96:0/237985921 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7f43e0000bc0 con 0x7f43e405c2a0 2022-02-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi096.stdout:HOST ADDR LABELS STATUS 2022-02-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 172.21.15.96 2022-02-02T18:19:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:smithi159 smithi159 2022-02-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 msgr2=0x7f43e405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 0x7f43e405e760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f43f80f66c0 tx=0x7f43e800b040).stop 2022-02-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 msgr2=0x7f43f81095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f43f4009990 tx=0x7f43f4009b30).stop 2022-02-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 shutdown_connections 2022-02-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f43e405c2a0 0x7f43e405e760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43f80f55c0 0x7f43f81090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 --2- 172.21.15.96:0/237985921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43f80f6860 0x7f43f81095e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 >> 172.21.15.96:0/237985921 conn(0x7f43f80f0d40 msgr2=0x7f43f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 shutdown_connections 2022-02-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:15.590+0000 7f43ffb3f700 1 -- 172.21.15.96:0/237985921 wait complete. 2022-02-02T18:19:16.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:15 smithi096 conmon[32067]: cluster 2022-02-02T18:19:14.795525+0000 mgr.smithi096.shfutl (mgr.14162) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:15 smithi096 conmon[32067]: audit 2022-02-02T18:19:15.095942+0000 mon.smithi096 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:19:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:15 smithi096 conmon[32067]: audit 2022-02-02T18:19:15.096234+0000 mon.smithi096 (mon.0) 450 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:19:16.127 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph orch device ls' 2022-02-02T18:19:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:15 smithi159 conmon[35668]: cluster 2022-02-02T18:19:14.795525+0000 mgr.smithi096.shfutl (mgr.14162) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:15 smithi159 conmon[35668]: audit 2022-02-02T18:19:15.095942+0000 2022-02-02T18:19:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:15 smithi159 conmon[35668]: mon.smithi096 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:19:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:15 smithi159 conmon[35668]: audit 2022-02-02T18:19:15.096234+0000 mon.smithi096 (mon.0) 450 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:19:17.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:16 smithi159 conmon[35668]: audit 2022-02-02T18:19:15.588762+0000 mgr.smithi096.shfutl (mgr.14162) 182 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:17.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:16 smithi096 conmon[32067]: audit 2022-02-02T18:19:15.588762+0000 mgr.smithi096.shfutl (mgr.14162) 182 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- 172.21.15.96:0/876546219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f6860 msgr2=0x7f43580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 --2- 172.21.15.96:0/876546219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f6860 0x7f43580f6cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4344004660 tx=0x7f4344009b30).stop 2022-02-02T18:19:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- 172.21.15.96:0/876546219 shutdown_connections 2022-02-02T18:19:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 --2- 172.21.15.96:0/876546219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f6860 0x7f43580f6cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 --2- 172.21.15.96:0/876546219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f55c0 0x7f43580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- 172.21.15.96:0/876546219 >> 172.21.15.96:0/876546219 conn(0x7f43580f0d40 msgr2=0x7f43580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- 172.21.15.96:0/876546219 shutdown_connections 2022-02-02T18:19:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- 172.21.15.96:0/876546219 wait complete. 2022-02-02T18:19:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 Processor -- start 2022-02-02T18:19:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.821+0000 7f435ed5d700 1 -- start start 2022-02-02T18:19:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 0x7f4358107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358107a10 con 0x7f43580f55c0 2022-02-02T18:19:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358107b50 con 0x7f43580f6860 2022-02-02T18:19:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52160/0 (socket says 172.21.15.96:52160) 2022-02-02T18:19:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 -- 172.21.15.96:0/3651307748 learned_addr learned my addr 172.21.15.96:0/3651307748 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f4357fff700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 0x7f4358107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 -- 172.21.15.96:0/3651307748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 msgr2=0x7f4358107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 0x7f4358107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 -- 172.21.15.96:0/3651307748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344005040 con 0x7f43580f55c0 2022-02-02T18:19:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f4357fff700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 0x7f4358107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:19:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435caf9700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f434c00c530 tx=0x7f434c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c00f650 con 0x7f43580f55c0 2022-02-02T18:19:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43581084f0 con 0x7f43580f55c0 2022-02-02T18:19:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f434c00fc40 con 0x7f43580f55c0 2022-02-02T18:19:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c012c90 con 0x7f43580f55c0 2022-02-02T18:19:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.822+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4358108ab0 con 0x7f43580f55c0 2022-02-02T18:19:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.823+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358045ad0 con 0x7f43580f55c0 2022-02-02T18:19:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.824+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f434c019030 con 0x7f43580f55c0 2022-02-02T18:19:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.824+0000 7f43557fa700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 0x7f434805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.824+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f434c075810 con 0x7f43580f55c0 2022-02-02T18:19:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.824+0000 7f4357fff700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 0x7f434805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.824+0000 7f4357fff700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 0x7f434805e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4344004e30 tx=0x7f4344009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:17.828+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f434c048880 con 0x7f43580f55c0 2022-02-02T18:19:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.005+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f435805fd30 con 0x7f434805c2b0 2022-02-02T18:19:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.006+0000 7f43557fa700 1 -- 172.21.15.96:0/3651307748 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7f435805fd30 con 0x7f434805c2b0 2022-02-02T18:19:18.009 INFO:teuthology.orchestra.run.smithi096.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2022-02-02T18:19:18.009 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 /dev/nvme0n1 ssd PHFT620400NH400BGN 400G Unknown N/A N/A No 2022-02-02T18:19:18.010 INFO:teuthology.orchestra.run.smithi096.stdout:smithi159 /dev/nvme0n1 ssd CVFT623300GH400BGN 400G Unknown N/A N/A No 2022-02-02T18:19:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 msgr2=0x7f434805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 0x7f434805e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4344004e30 tx=0x7f4344009b30).stop 2022-02-02T18:19:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 msgr2=0x7f4358106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f434c00c530 tx=0x7f434c007e10).stop 2022-02-02T18:19:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 shutdown_connections 2022-02-02T18:19:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f434805c2b0 0x7f434805e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43580f55c0 0x7f4358106f70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 --2- 172.21.15.96:0/3651307748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43580f6860 0x7f4358107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 >> 172.21.15.96:0/3651307748 conn(0x7f43580f0d40 msgr2=0x7f435805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 shutdown_connections 2022-02-02T18:19:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:18.008+0000 7f435ed5d700 1 -- 172.21.15.96:0/3651307748 wait complete. 2022-02-02T18:19:18.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:17 smithi096 conmon[32067]: cluster 2022-02-02T18:19:16.795899+0000 mgr.smithi096.shfutl (mgr.14162) 183 : cluster [DBG] 2022-02-02T18:19:18.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:17 smithi096 conmon[32067]: pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:17 smithi159 conmon[35668]: cluster 2022-02-02T18:19:16.795899+0000 mgr.smithi096.shfutl (mgr.14162) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:18.533 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:18.545 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:18.546 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs volume create cephfs --placement=4' 2022-02-02T18:19:19.997 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:19 smithi096 conmon[32067]: audit 2022-02-02T18:19:18.006534+0000 mgr.smithi096.shfutl (mgr.14162) 184 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:19.997 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:19 smithi096 conmon[32067]: cluster 2022-02-02T18:19:18.796214+0000 mgr.smithi096.shfutl (mgr.14162) 185 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 -- 172.21.15.96:0/1308557386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f5430 msgr2=0x7fd2900f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 --2- 172.21.15.96:0/1308557386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f5430 0x7fd2900f5850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fd280004660 tx=0x7fd280009b30).stop 2022-02-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 -- 172.21.15.96:0/1308557386 shutdown_connections 2022-02-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 --2- 172.21.15.96:0/1308557386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f66d0 0x7fd2900f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 --2- 172.21.15.96:0/1308557386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f5430 0x7fd2900f5850 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 -- 172.21.15.96:0/1308557386 >> 172.21.15.96:0/1308557386 conn(0x7fd2900f0b90 msgr2=0x7fd2900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 -- 172.21.15.96:0/1308557386 shutdown_connections 2022-02-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.188+0000 7fd28ffff700 1 -- 172.21.15.96:0/1308557386 wait complete. 2022-02-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 Processor -- start 2022-02-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 -- start start 2022-02-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5430 0x7fd29010be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900602b0 con 0x7fd2900f66d0 2022-02-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900603f0 con 0x7fd2900f5430 2022-02-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52172/0 (socket says 172.21.15.96:52172) 2022-02-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.189+0000 7fd28e7fc700 1 -- 172.21.15.96:0/4230506732 learned_addr learned my addr 172.21.15.96:0/4230506732 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28effd700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5430 0x7fd29010be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28e7fc700 1 -- 172.21.15.96:0/4230506732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5430 msgr2=0x7fd29010be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28e7fc700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5430 0x7fd29010be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28e7fc700 1 -- 172.21.15.96:0/4230506732 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280005040 con 0x7fd2900f66d0 2022-02-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28e7fc700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd2840026d0 tx=0x7fd284009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2840079c0 con 0x7fd2900f66d0 2022-02-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd28400f040 con 0x7fd2900f66d0 2022-02-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29010e830 con 0x7fd2900f66d0 2022-02-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd284014820 con 0x7fd2900f66d0 2022-02-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.190+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29010ecb0 con 0x7fd2900f66d0 2022-02-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.191+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290045ad0 con 0x7fd2900f66d0 2022-02-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.192+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd2840090d0 con 0x7fd2900f66d0 2022-02-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.193+0000 7fd2777fe700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 0x7fd27805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.193+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fd284075fc0 con 0x7fd2900f66d0 2022-02-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.193+0000 7fd28effd700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 0x7fd27805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.193+0000 7fd28effd700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 0x7fd27805e7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd280013620 tx=0x7fd280009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.196+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd284049010 con 0x7fd2900f66d0 2022-02-02T18:19:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:19 smithi159 conmon[35668]: audit 2022-02-02T18:19:18.006534+0000 mgr.smithi096.shfutl (mgr.14162) 184 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:19 smithi159 conmon[35668]: cluster 2022-02-02T18:19:18.796214+0000 mgr.smithi096.shfutl ( 2022-02-02T18:19:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:19 smithi159 conmon[35668]: mgr.14162) 185 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:20.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:20.376+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd290057f10 con 0x7fd27805c300 2022-02-02T18:19:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: audit 2022-02-02T18:19:20.377690+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:19:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: ) 186 : audit [DBG] from='client.14432 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: audit 2022-02-02T18:19:20.378225+0000 mon.smithi096 (mon.0) 2022-02-02T18:19:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: 451 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2022-02-02T18:19:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: 2022-02-02T18:19: 2022-02-02T18:19:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: 20.796661+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:19:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:20 smithi159 conmon[35668]: 187 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:20 smithi096 conmon[32067]: audit 2022-02-02T18:19:20. 2022-02-02T18:19:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:20 smithi096 conmon[32067]: 377690+0000 mgr.smithi096.shfutl (mgr.14162) 186 : audit [DBG] from='client.14432 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:19:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:20 smithi096 conmon[32067]: audit 2022-02-02T18:19:20.378225+0000 mon.smithi096 (mon.0) 451 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2022-02-02T18:19:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:20 smithi096 conmon[32067]: cluster 2022-02-02T18:19:20.796661+0000 mgr.smithi096.shfutl (mgr.14162) 187 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:21.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.989+0000 7fd2777fe700 1 -- 172.21.15.96:0/4230506732 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd290057f10 con 0x7fd27805c300 2022-02-02T18:19:21.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 msgr2=0x7fd27805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:21.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 0x7fd27805e7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd280013620 tx=0x7fd280009b30).stop 2022-02-02T18:19:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 msgr2=0x7fd29010e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd2840026d0 tx=0x7fd284009de0).stop 2022-02-02T18:19:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 shutdown_connections 2022-02-02T18:19:21.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd27805c300 0x7fd27805e7c0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0x7fd280013620 tx=0x7fd280009b30).stop 2022-02-02T18:19:21.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5430 0x7fd29010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:21.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 --2- 172.21.15.96:0/4230506732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f66d0 0x7fd29010e340 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:21.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 >> 172.21.15.96:0/4230506732 conn(0x7fd2900f0b90 msgr2=0x7fd2900fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:21.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 shutdown_connections 2022-02-02T18:19:21.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:21.992+0000 7fd28ffff700 1 -- 172.21.15.96:0/4230506732 wait complete. 2022-02-02T18:19:22.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:21 smithi096 conmon[32067]: debug 2022-02-02T18:19:21.963+0000 7fc2f56ad700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T18:19:22.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:21 smithi096 conmon[32067]: audit 2022-02-02T18:19:20.951153+0000 mon.smithi096 (mon.0) 452 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2022-02-02T18:19:22.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:21 smithi096 conmon[32067]: cluster 2022-02-02T18:19:20.951228+0000 mon.smithi096 (mon.0) 453 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-02-02T18:19:22.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:21 smithi096 conmon[32067]: audit 2022-02-02T18:19:20.962207+0000 mon.smithi096 (mon.0) 454 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2022-02-02T18:19:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:21 smithi159 conmon[35668]: audit 2022-02-02T18:19:20.951153+0000 mon.smithi096 (mon.0) 452 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2022-02-02T18:19:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:21 smithi159 conmon[35668]: cluster 2022-02-02T18:19:20.951228+0000 mon.smithi096 (mon.0) 453 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-02-02T18:19:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:21 smithi159 conmon[35668]: audit 2022-02-02T18:19:20.962207+0000 mon.smithi096 (mon.0) 454 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2022-02-02T18:19:22.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs dump' 2022-02-02T18:19:23.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:21.954411+0000 mon.smithi096 (mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2022-02-02T18:19:23.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:21.954488+0000 mon.smithi096 (mon.0) 456 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2022-02-02T18:19:23.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:21.963028+0000 mon.smithi096 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2022-02-02T18:19:23.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:21.963875+0000 mon.smithi096 (mon.0) 458 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T18:19:23.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:21.963909+0000 mon.smithi096 (mon.0) 459 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T18:19:23.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:21.977285+0000 mon.smithi096 (mon.0) 460 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2022-02-02T18:19:23.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:21.977416+0000 mon.smithi096 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2022-02-02T18:19:23.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:21.977507+0000 mon.smithi096 (mon.0) 462 : cluster [DBG] fsmap cephfs:0 2022-02-02T18:19:23.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cephadm 2022-02-02T18:19:21.981313+0000 mgr.smithi096.shfutl (mgr.14162) 188 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2022-02-02T18:19:23.235 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:21.989312+0000 mon.smithi096 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:21.994311+0000 mon.smithi096 (mon.0) 464 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:22.411820+0000 mon.smithi096 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:22.416863+0000 mon.smithi096 (mon.0) 466 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:22.417476+0000 mon.smithi096 (mon.0) 467 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:22.420953+0000 mon.smithi096 (mon.0) 468 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: audit 2022-02-02T18:19:22.421495+0000 mon.smithi096 (mon.0) 469 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cephadm 2022-02-02T18:19:22.422005+0000 mgr.smithi096.shfutl (mgr.14162) 189 : cephadm [INF] Deploying daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:19:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:22 smithi096 conmon[32067]: cluster 2022-02-02T18:19:22.797104+0000 mgr.smithi096.shfutl (mgr.14162) 190 : cluster [DBG] pgmap v153: 65 pgs: 17 creating+peering, 44 unknown, 4 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:23.238 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:21.954411+0000 mon.smithi096 ( 2022-02-02T18:19:23.238 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2022-02-02T18:19:23.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.954488+0000 mon.smithi096 (mon.0) 456 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2022-02-02T18:19:23.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:21.963028+0000 mon.smithi096 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2022-02-02T18:19:23.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.963875+0000 mon.smithi096 (mon.0) 458 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T18:19:23.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.963909+0000 mon.smithi096 (mon.0) 459 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T18:19:23.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.977285+0000 mon.smithi096 (mon.0) 460 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2022-02-02T18:19:23.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:21.977416+0000 mon.smithi096 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2022-02-02T18:19:23.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18:19:21.977507+0000 mon.smithi096 (mon.0) 462 : cluster [DBG] fsmap cephfs:0 2022-02-02T18:19:23.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cephadm 2022-02-02T18:19:21.981313+0000 mgr.smithi096.shfutl (mgr.14162) 188 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2022-02-02T18:19:23.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:21.989312+0000 mon.smithi096 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:21.994311+0000 mon.smithi096 (mon.0) 464 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:23.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:22.411820+0000 mon.smithi096 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:22.416863+0000 mon.smithi096 (mon.0) 466 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:23.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:23.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: 2022-02-02T18:19:22.417476+0000 mon.smithi096 (mon.0) 467 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:23.242 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:22.420953+0000 mon.smithi096 (mon.0) 468 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:23.242 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: audit 2022-02-02T18:19:22.421495+0000 mon.smithi096 (mon.0 2022-02-02T18:19:23.242 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: ) 469 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:23.242 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cephadm 2022-02-02 2022-02-02T18:19:23.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: T18:19:22.422005+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:19:23.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: 189 : cephadm [INF] Deploying daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:19:23.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: cluster 2022-02-02T18 2022-02-02T18:19:23.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: :19:22.797104+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:19:23.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:22 smithi159 conmon[35668]: ) 190 : cluster [DBG] pgmap v153: 65 pgs: 17 creating+peering, 44 unknown, 4 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:24.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:23 smithi159 conmon[35668]: cluster 2022-02-02T18:19:22.974814 2022-02-02T18:19:24.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:23 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 470 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2022-02-02T18:19:24.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- 172.21.15.96:0/1607062710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f77d0 msgr2=0x7f02300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:24.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 --2- 172.21.15.96:0/1607062710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f77d0 0x7f02300f7c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f0220004660 tx=0x7f0220009b30).stop 2022-02-02T18:19:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- 172.21.15.96:0/1607062710 shutdown_connections 2022-02-02T18:19:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 --2- 172.21.15.96:0/1607062710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f77d0 0x7f02300f7c30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 --2- 172.21.15.96:0/1607062710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f6530 0x7f02300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- 172.21.15.96:0/1607062710 >> 172.21.15.96:0/1607062710 conn(0x7f02300f1c90 msgr2=0x7f02300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- 172.21.15.96:0/1607062710 shutdown_connections 2022-02-02T18:19:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- 172.21.15.96:0/1607062710 wait complete. 2022-02-02T18:19:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 Processor -- start 2022-02-02T18:19:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- start start 2022-02-02T18:19:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f77d0 0x7f0230107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230107880 con 0x7f02300f6530 2022-02-02T18:19:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.193+0000 7f022f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230108090 con 0x7f02300f77d0 2022-02-02T18:19:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52180/0 (socket says 172.21.15.96:52180) 2022-02-02T18:19:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022dd9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f77d0 0x7f0230107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 -- 172.21.15.96:0/474851638 learned_addr learned my addr 172.21.15.96:0/474851638 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 -- 172.21.15.96:0/474851638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f77d0 msgr2=0x7f0230107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f77d0 0x7f0230107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 -- 172.21.15.96:0/474851638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220005040 con 0x7f02300f6530 2022-02-02T18:19:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022e59c700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f022400c530 tx=0x7f0224007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022400f650 con 0x7f02300f6530 2022-02-02T18:19:24.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f022400fc40 con 0x7f02300f6530 2022-02-02T18:19:24.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0230108310 con 0x7f02300f6530 2022-02-02T18:19:24.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0224012c20 con 0x7f02300f6530 2022-02-02T18:19:24.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.194+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301088d0 con 0x7f02300f6530 2022-02-02T18:19:24.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.195+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230059100 con 0x7f02300f6530 2022-02-02T18:19:24.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.196+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0224019030 con 0x7f02300f6530 2022-02-02T18:19:24.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.196+0000 7f021effd700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 0x7f021805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:24.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.196+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0224075ad0 con 0x7f02300f6530 2022-02-02T18:19:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.196+0000 7f022dd9b700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 0x7f021805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.196+0000 7f022dd9b700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 0x7f021805e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0220005010 tx=0x7f0220009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.200+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0224048800 con 0x7f02300f6530 2022-02-02T18:19:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:23 smithi096 conmon[32067]: cluster 2022-02-02T18:19:22.974814 2022-02-02T18:19:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:23 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 470 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2022-02-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.387+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0230045ad0 con 0x7f02300f6530 2022-02-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.387+0000 7f021effd700 1 -- 172.21.15.96:0/474851638 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7f0224017070 con 0x7f02300f6530 2022-02-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi096.stdout:e2 2022-02-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 2 2022-02-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 2022-02-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:19:21.963778+0000 2022-02-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:in 2022-02-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:up {} 2022-02-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 0 2022-02-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 msgr2=0x7f021805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 0x7f021805e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0220005010 tx=0x7f0220009b30).stop 2022-02-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 msgr2=0x7f0230106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f022400c530 tx=0x7f0224007e10).stop 2022-02-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 shutdown_connections 2022-02-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f021805c300 0x7f021805e7c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02300f6530 0x7f0230106d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 --2- 172.21.15.96:0/474851638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02300f77d0 0x7f0230107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 >> 172.21.15.96:0/474851638 conn(0x7f02300f1c90 msgr2=0x7f02300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 shutdown_connections 2022-02-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:24.390+0000 7f022f59e700 1 -- 172.21.15.96:0/474851638 wait complete. 2022-02-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2022-02-02T18:19:24.894 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:24.904 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:24.904 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs max_mds 2' 2022-02-02T18:19:25.149 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: cluster 2022-02-02T18:19:23.976842+0000 mon.smithi096 (mon. 2022-02-02T18:19:25.149 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: 0) 471 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2022-02-02T18:19:25.149 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.388001+0000 mon.smithi096 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.96:0/474851638' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:19:25.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.480982+0000 mon.smithi096 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:25.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.481730+0000 mon.smithi096 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:25.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.486483+0000 mon.smithi096 (mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:25.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.487074+0000 mon.smithi096 (mon.0) 476 : audit [DBG] 2022-02-02T18:19:25.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:25.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: cephadm 2022-02-02T18:19:24.487717+0000 mgr.smithi096.shfutl (mgr.14162) 191 : cephadm [INF] Deploying daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:19:25.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: cluster 2022-02-02T18:19:25.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: 2022-02-02T18:19:24.797684+0000 2022-02-02T18:19:25.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 192 : cluster [DBG] 2022-02-02T18:19:25.152 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:24 smithi096 conmon[32067]: pgmap v156: 65 pgs: 17 creating+peering, 35 unknown, 13 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: cluster 2022-02-02T18:19:23.976842+0000 mon.smithi096 (mon.0) 471 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2022-02-02T18:19:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: audit 2022-02-02T18:19:24 2022-02-02T18:19:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: .388001+0000 mon.smithi096 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.96:0/474851638' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:19:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: audit 2022-02-02T18:19:24.480982+0000 mon.smithi096 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: audit 2022-02-02T18:19:24.481730+0000 mon.smithi096 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: audit 2022-02-02T18:19:24.486483+0000 mon.smithi096 (mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:19:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: :19:24.487074+0000 mon.smithi096 (mon.0) 476 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: cephadm 2022-02-02T18:19:24.487717+0000 mgr.smithi096.shfutl (mgr.14162) 191 2022-02-02T18:19:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: : cephadm [INF] Deploying daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:19:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: cluster 2022-02-02T18:19 2022-02-02T18:19:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:24 smithi159 conmon[35668]: :24.797684+0000 mgr.smithi096.shfutl (mgr.14162) 192 : cluster [DBG] pgmap v156: 65 pgs: 17 creating+peering, 35 unknown, 13 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.990561+0000 mon.smithi096 (mon.0) 477 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382] up:boot 2022-02-02T18:19:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.990616+0000 mon.smithi096 (mon.0) 478 : cluster [INF] daemon mds.cephfs.smithi159.shbucd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2022-02-02T18:19:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.990666+0000 mon.smithi096 (mon.0) 479 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T18:19:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.990680+0000 mon.smithi096 (mon.0) 480 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T18:19:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.990692 2022-02-02T18:19:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 481 : cluster [INF] Cluster is now healthy 2022-02-02T18:19:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:24.991351+0000 mon.smithi096 ( 2022-02-02T18:19:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: mon.0) 482 : cluster [DBG] fsmap cephfs:0 1 up:standby 2022-02-02T18:19:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: audit 2022-02-02T18:19:24.991438+0000 mon.smithi096 (mon.0) 483 2022-02-02T18:19:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:19:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:19:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: 02-02T18:19:24.995703+0000 mon.smithi096 (mon.0) 484 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:creating} 2022-02-02T18:19:26.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: cluster 2022-02-02T18:19:25.005467+0000 mon.smithi096 (mon.0) 2022-02-02T18:19:26.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:25 smithi159 conmon[35668]: 485 : cluster [INF] daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:19:26.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.990561+0000 mon.smithi096 (mon.0) 477 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382] up:boot 2022-02-02T18:19:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.990616+0000 mon.smithi096 (mon.0) 478 : cluster [INF] daemon mds.cephfs.smithi159.shbucd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2022-02-02T18:19:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.990666+0000 mon.smithi096 (mon.0) 479 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T18:19:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.990680+0000 mon.smithi096 (mon.0) 480 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T18:19:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.990692+0000 mon.smithi096 (mon.0) 481 : cluster [INF] Cluster is now healthy 2022-02-02T18:19:26.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.991351+0000 mon.smithi096 (mon.0) 482 : cluster [DBG] fsmap cephfs:0 1 up:standby 2022-02-02T18:19:26.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: audit 2022-02-02T18:19:24.991438+0000 mon.smithi096 (mon.0) 483 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:19:26.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:24.995703+0000 mon.smithi096 (mon.0) 484 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:creating} 2022-02-02T18:19:26.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:25 smithi096 conmon[32067]: cluster 2022-02-02T18:19:25.005467+0000 mon.smithi096 (mon.0) 485 : cluster [INF] daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:19:27.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- 172.21.15.96:0/3722720534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 msgr2=0x7f6b180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/3722720534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b180f7de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6b14004660 tx=0x7f6b14009b30).stop 2022-02-02T18:19:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- 172.21.15.96:0/3722720534 shutdown_connections 2022-02-02T18:19:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/3722720534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b180f7de0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/3722720534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 0x7f6b180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- 172.21.15.96:0/3722720534 >> 172.21.15.96:0/3722720534 conn(0x7f6b180f1e40 msgr2=0x7f6b180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- 172.21.15.96:0/3722720534 shutdown_connections 2022-02-02T18:19:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- 172.21.15.96:0/3722720534 wait complete. 2022-02-02T18:19:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 Processor -- start 2022-02-02T18:19:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.261+0000 7f6b1fd00700 1 -- start start 2022-02-02T18:19:27.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:27 smithi096 conmon[32067]: cluster 2022-02-02T18:19:25.997160+0000 mon.smithi096 (mon.0) 486 2022-02-02T18:19:27.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:27 smithi096 conmon[32067]: : cluster [DBG] mds.? [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382] up:active 2022-02-02T18:19:27.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:27 smithi096 conmon[32067]: cluster 2022-02-02T18:19:25.997207+0000 mon.smithi096 (mon.0) 487 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 2022-02-02T18:19:27.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:27 smithi096 conmon[32067]: cluster 2022-02-02T18:19:26.798345+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:19:27.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:27 smithi096 conmon[32067]: .14162) 193 : cluster [DBG] pgmap v157: 65 pgs: 3 creating+peering, 62 active+clean; 2.2 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:27.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1fd00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 0x7f6b18106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:27.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1fd00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:27.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1fd00700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181079b0 con 0x7f6b180f7980 2022-02-02T18:19:27.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1fd00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18107af0 con 0x7f6b180f66e0 2022-02-02T18:19:27.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:27.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52198/0 (socket says 172.21.15.96:52198) 2022-02-02T18:19:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 -- 172.21.15.96:0/4205704277 learned_addr learned my addr 172.21.15.96:0/4205704277 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1da9c700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 0x7f6b18106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 -- 172.21.15.96:0/4205704277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 msgr2=0x7f6b18106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 0x7f6b18106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 -- 172.21.15.96:0/4205704277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14005040 con 0x7f6b180f7980 2022-02-02T18:19:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.262+0000 7f6b1d29b700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f6b14009990 tx=0x7f6b14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b14018070 con 0x7f6b180f7980 2022-02-02T18:19:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b18108430 con 0x7f6b180f7980 2022-02-02T18:19:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18108990 con 0x7f6b180f7980 2022-02-02T18:19:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6b14013410 con 0x7f6b180f7980 2022-02-02T18:19:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1401de80 con 0x7f6b180f7980 2022-02-02T18:19:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.263+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b00004fa0 con 0x7f6b180f7980 2022-02-02T18:19:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.264+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6b1401d420 con 0x7f6b180f7980 2022-02-02T18:19:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.264+0000 7f6b0e7fc700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 0x7f6b0405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.265+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6b14077930 con 0x7f6b180f7980 2022-02-02T18:19:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.265+0000 7f6b1da9c700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 0x7f6b0405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.265+0000 7f6b1da9c700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 0x7f6b0405e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6b180f77e0 tx=0x7f6b0800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:27 smithi159 conmon[35668]: cluster 2022-02-02T18:19:25.997160+0000 mon.smithi096 (mon.0) 486 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382] up:active 2022-02-02T18:19:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:27 smithi159 conmon[35668]: cluster 2022-02-02T18:19:25.997207+0000 mon.smithi096 (mon.0) 487 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 2022-02-02T18:19:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:27 smithi159 conmon[35668]: cluster 2022-02-02T18:19:26.798345+0000 mgr.smithi096.shfutl (mgr.14162) 193 : cluster [DBG] pgmap v157: 65 pgs: 3 creating+peering, 62 active+clean; 2.2 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2022-02-02T18:19:27.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.268+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6b1404a690 con 0x7f6b180f7980 2022-02-02T18:19:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:27.456+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f6b00005bf0 con 0x7f6b180f7980 2022-02-02T18:19:28.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.064+0000 7f6b0e7fc700 1 -- 172.21.15.96:0/4205704277 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6b1404dcb0 con 0x7f6b180f7980 2022-02-02T18:19:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 msgr2=0x7f6b0405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:28.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 0x7f6b0405e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6b180f77e0 tx=0x7f6b0800b040).stop 2022-02-02T18:19:28.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 msgr2=0x7f6b18107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:28.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f6b14009990 tx=0x7f6b14009b30).stop 2022-02-02T18:19:28.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 shutdown_connections 2022-02-02T18:19:28.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f6b0405c2b0 0x7f6b0405e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:28.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b180f66e0 0x7f6b18106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:28.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 --2- 172.21.15.96:0/4205704277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b180f7980 0x7f6b18107400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:28.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 >> 172.21.15.96:0/4205704277 conn(0x7f6b180f1e40 msgr2=0x7f6b180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:28.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 shutdown_connections 2022-02-02T18:19:28.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:28.067+0000 7f6b1fd00700 1 -- 172.21.15.96:0/4205704277 wait complete. 2022-02-02T18:19:28.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: audit 2022-02-02T18:19:27.059057+0000 mon.smithi096 (mon.0) 488 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:28.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: audit 2022-02-02T18:19:27.060075+0000 mon.smithi096 (mon.0) 489 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:28.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: audit 2022-02-02T18:19:27.063714+0000 mon.smithi096 (mon.0) 490 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:28.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: audit 2022-02-02T18:19:27.064686+0000 mon.smithi096 (mon.0) 491 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:28.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: cephadm 2022-02-02T18:19:27.065492+0000 mgr.smithi096.shfutl (mgr.14162) 194 : cephadm [INF] Deploying daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:19:28.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:28 smithi096 conmon[32067]: audit 2022-02-02T18:19:27.457128+0000 mon.smithi096 (mon.0) 492 : audit [INF] from='client.? 172.21.15.96:0/4205704277' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2022-02-02T18:19:28.356 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: audit 2022-02-02T18:19:27.059057+0000 mon.smithi096 (mon.0) 488 : audit 2022-02-02T18:19:28.357 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:28.357 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: audit 2022-02-02T18:19:27.060075+0000 mon.smithi096 (mon.0) 489 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:28.357 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: audit 2022-02-02T18:19:27.063714+0000 mon.smithi096 (mon.0) 490 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:28.357 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: audit 2022-02-02T18:19:27.064686+0000 mon.smithi096 (mon.0) 491 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:28.358 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:19:27.065492+0000 mgr.smithi096.shfutl (mgr.14162) 194 : cephadm [INF] Deploying daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:19:28.358 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:28 smithi159 conmon[35668]: audit 2022-02-02T18:19:27.457128+0000 mon.smithi096 (mon.0) 492 : audit [INF] from='client.? 172.21.15.96:0/4205704277' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2022-02-02T18:19:28.558 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:28.572 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:28.572 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2022-02-02T18:19:29.115 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: cluster 2022-02-02T18:19:28.062253+0000 mon.smithi096 (mon.0 2022-02-02T18:19:29.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: ) 493 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T18:19:29.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: audit 2022-02-02T18:19:28.065203+0000 mon.smithi096 (mon.0) 494 : audit [INF] from='client.? 172.21.15.96:0/4205704277' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2022-02-02T18:19:29.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: cluster 2022-02-02T18:19:28.065307+0000 mon.smithi096 (mon.0) 495 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 2022-02-02T18:19:29.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: cluster 2022-02-02T18:19:28.798994+0000 2022-02-02T18:19:29.117 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:29 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 195 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2022-02-02T18:19:29.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:29 smithi096 conmon[32067]: cluster 2022-02-02T18:19:28.062253+0000 mon.smithi096 (mon 2022-02-02T18:19:29.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:29 smithi096 conmon[32067]: .0) 493 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T18:19:29.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:29 smithi096 conmon[32067]: audit 2022-02-02T18:19:28.065203+0000 mon.smithi096 (mon.0) 494 : audit [INF] from='client.? 172.21.15.96:0/4205704277' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2022-02-02T18:19:29.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:29 smithi096 conmon[32067]: cluster 2022-02-02T18:19:28.065307+0000 mon.smithi096 (mon.0) 495 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 2022-02-02T18:19:29.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:29 smithi096 conmon[32067]: cluster 2022-02-02T18:19:28.798994+0000 mgr.smithi096.shfutl (mgr.14162) 195 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2022-02-02T18:19:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: audit 2022-02-02T18:19:29.155371+0000 mon.smithi096 (mon.0) 496 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: 2022-02-02T18:19:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: audit 2022-02-02T18:19:29.156273+0000 mon.smithi096 (mon.0) 497 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: audit 2022-02-02T18:19:29.160394+0000 mon.smithi096 (mon.0) 498 : audit [INF] 2022-02-02T18:19:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: audit 2022-02-02T18:19:29.161157+0000 mon.smithi096 (mon.0) 499 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cephadm 2022-02-02T18:19:29.161874+0000 mgr.smithi096.shfutl (mgr.14162) 196 : cephadm [INF] Deploying daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:19:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02-02T18:19:29.922737+0000 mon.smithi096 2022-02-02T18:19:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: (mon.0) 500 : cluster [DBG] mds.? [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] up:boot 2022-02-02T18:19:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02-02T18:19:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: 2022-02-02T18:19:29.922775+0000 mon.smithi096 (mon.0) 501 : cluster [INF] daemon mds.cephfs.smithi159.omlhix assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2022-02-02T18:19:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02-02T18:19:29.922833+0000 mon.smithi096 (mon 2022-02-02T18:19:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: .0) 502 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2022-02-02T18:19:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:19:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: -02-02T18:19:29.922849+0000 mon.smithi096 (mon.0) 503 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T18:19:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02-02T18:19:29.923031+0000 mon.smithi096 (mon.0 2022-02-02T18:19:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: ) 504 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 1 up:standby 2022-02-02T18:19:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: audit 2022-02-02T18:19:29.923118+0000 mon.smithi096 (mon.0) 505 : audit 2022-02-02T18:19:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:19:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02 2022-02-02T18:19:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: -02T18:19:29.925472+0000 mon.smithi096 (mon.0) 506 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:creating} 2022-02-02T18:19:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: cluster 2022-02-02T18:19:29.939298+0000 mon.smithi096 (mon.0) 507 2022-02-02T18:19:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:30 smithi159 conmon[35668]: : cluster [INF] daemon mds.cephfs.smithi159.omlhix is now active in filesystem cephfs as rank 1 2022-02-02T18:19:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: audit 2022-02-02T18:19:29.155371+0000 mon.smithi096 (mon.0) 496 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: audit 2022-02-02T18:19:29.156273+0000 mon.smithi096 (mon.0) 497 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:19:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: audit 2022-02-02T18:19:29.160394+0000 mon.smithi096 (mon.0) 498 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T18:19:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: audit 2022-02-02T18:19:29.161157+0000 mon.smithi096 (mon.0) 499 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:19:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cephadm 2022-02-02T18:19:29.161874+0000 mgr.smithi096.shfutl (mgr.14162) 196 : cephadm [INF] Deploying daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:19:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.922737+0000 mon.smithi096 (mon.0) 500 : cluster [DBG] mds.? [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] up:boot 2022-02-02T18:19:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.922775+0000 mon.smithi096 (mon.0) 501 : cluster [INF] daemon mds.cephfs.smithi159.omlhix assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2022-02-02T18:19:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.922833+0000 mon.smithi096 (mon.0) 502 : cluster 2022-02-02T18:19:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2022-02-02T18:19:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.922849+0000 mon.smithi096 (mon.0) 503 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T18:19:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.923031+0000 mon.smithi096 (mon.0) 504 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi159.shbucd=up:active} 1 up:standby 2022-02-02T18:19:30.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: audit 2022-02-02T18:19:29.923118+0000 mon.smithi096 (mon.0) 505 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:19:30.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.925472+0000 mon.smithi096 (mon.0) 506 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:creating} 2022-02-02T18:19:30.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:30 smithi096 conmon[32067]: cluster 2022-02-02T18:19:29.939298+0000 mon.smithi096 (mon.0) 507 : cluster [INF] daemon mds.cephfs.smithi159.omlhix is now active in filesystem cephfs as rank 1 2022-02-02T18:19:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 -- 172.21.15.96:0/2631708810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 msgr2=0x7f73500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 --2- 172.21.15.96:0/2631708810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f73500f59e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7340004660 tx=0x7f7340009b30).stop 2022-02-02T18:19:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 -- 172.21.15.96:0/2631708810 shutdown_connections 2022-02-02T18:19:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 --2- 172.21.15.96:0/2631708810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f73500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 --2- 172.21.15.96:0/2631708810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f73500f59e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 -- 172.21.15.96:0/2631708810 >> 172.21.15.96:0/2631708810 conn(0x7f73500f0d40 msgr2=0x7f73500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 -- 172.21.15.96:0/2631708810 shutdown_connections 2022-02-02T18:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.610+0000 7f7355a71700 1 -- 172.21.15.96:0/2631708810 wait complete. 2022-02-02T18:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 Processor -- start 2022-02-02T18:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 -- start start 2022-02-02T18:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f735010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73500603e0 con 0x7f73500f55c0 2022-02-02T18:19:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f7355a71700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7350060520 con 0x7f73500f6860 2022-02-02T18:19:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f734f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f734f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52206/0 (socket says 172.21.15.96:52206) 2022-02-02T18:19:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.611+0000 7f734f7fe700 1 -- 172.21.15.96:0/30752462 learned_addr learned my addr 172.21.15.96:0/30752462 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734f7fe700 1 -- 172.21.15.96:0/30752462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 msgr2=0x7f735010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734effd700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f735010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734f7fe700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f735010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734f7fe700 1 -- 172.21.15.96:0/30752462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340005040 con 0x7f73500f55c0 2022-02-02T18:19:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734effd700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f735010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:19:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f734f7fe700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7340007a60 tx=0x7f7340009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7340018070 con 0x7f73500f55c0 2022-02-02T18:19:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735010c700 con 0x7f73500f55c0 2022-02-02T18:19:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7340013410 con 0x7f73500f55c0 2022-02-02T18:19:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f734001c620 con 0x7f73500f55c0 2022-02-02T18:19:30.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.612+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735010cc60 con 0x7f73500f55c0 2022-02-02T18:19:30.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.613+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7350045ad0 con 0x7f73500f55c0 2022-02-02T18:19:30.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.613+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f734001d940 con 0x7f73500f55c0 2022-02-02T18:19:30.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.613+0000 7f7337fff700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 0x7f733805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:30.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.614+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7340077e70 con 0x7f73500f55c0 2022-02-02T18:19:30.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.614+0000 7f734effd700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 0x7f733805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:30.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.614+0000 7f734effd700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 0x7f733805e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f73440041d0 tx=0x7f7344009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:30.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.618+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f734004ab50 con 0x7f73500f55c0 2022-02-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.812+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f73500fde50 con 0x7f73500f55c0 2022-02-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.926+0000 7f7337fff700 1 -- 172.21.15.96:0/30752462 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f734004e170 con 0x7f73500f55c0 2022-02-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 msgr2=0x7f733805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 0x7f733805e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f73440041d0 tx=0x7f7344009040).stop 2022-02-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 msgr2=0x7f7350109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7340007a60 tx=0x7f7340009b30).stop 2022-02-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 shutdown_connections 2022-02-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f733805c2b0 0x7f733805e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73500f55c0 0x7f7350109cb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 --2- 172.21.15.96:0/30752462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73500f6860 0x7f735010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 >> 172.21.15.96:0/30752462 conn(0x7f73500f0d40 msgr2=0x7f73500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 shutdown_connections 2022-02-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:30.928+0000 7f7355a71700 1 -- 172.21.15.96:0/30752462 wait complete. 2022-02-02T18:19:31.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:31 smithi096 conmon[32067]: cluster 2022-02-02T18:19:30.799309+0000 mgr.smithi096.shfutl (mgr.14162) 197 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 4 op/s 2022-02-02T18:19:31.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:31 smithi096 conmon[32067]: audit 2022-02-02T18:19:30.812984+0000 mon.smithi096 (mon.0) 508 : audit [INF] from='client.? 172.21.15.96:0/30752462' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-02-02T18:19:31.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:31 smithi096 conmon[32067]: cluster 2022-02-02T18:19:30.927285+0000 mon.smithi096 (mon.0) 509 : cluster [DBG] mds.? [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] up:active 2022-02-02T18:19:31.229 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:31 smithi096 conmon[32067]: audit 2022-02-02T18:19:30.927342+0000 mon.smithi096 (mon.0) 510 : audit [INF] from='client.? 172.21.15.96:0/30752462' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-02-02T18:19:31.229 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:31 smithi096 conmon[32067]: cluster 2022-02-02T18:19:30.927408+0000 mon.smithi096 (mon.0) 511 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2022-02-02T18:19:31.491 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:31.513 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:31.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs inline_data false' 2022-02-02T18:19:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: cluster 2022-02-02T18:19:30.799309+0000 mgr.smithi096.shfutl (mgr.14162) 197 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 4 op/s 2022-02-02T18:19:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: audit 2022-02-02T18:19:30.812984+0000 2022-02-02T18:19:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: mon.smithi096 (mon.0) 508 : audit [INF] from='client.? 172.21.15.96:0/30752462' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-02-02T18:19:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: cluster 2022-02-02T18:19:30.927285+0000 mon.smithi096 (mon.0) 509 : cluster [DBG] mds.? [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] up:active 2022-02-02T18:19:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: audit 2022-02-02T18:19:30.927342+0000 mon.smithi096 (mon.0) 510 : audit [INF] from='client.? 172.21.15.96:0/30752462' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-02-02T18:19:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: cluster 2022-02-02T18:19:30.927408+0000 mon.smithi096 (mon.0) 511 : cluster [DBG] 2022-02-02T18:19:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:31 smithi159 conmon[35668]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2022-02-02T18:19:32.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: cluster 2022-02-02T18:19:31.925502+0000 mon.smithi096 (mon.0 2022-02-02T18:19:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: ) 512 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2022-02-02T18:19:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: cluster 2022-02-02T18:19:31.925546+0000 mon.smithi096 (mon.0) 513 : cluster [INF] Cluster is now healthy 2022-02-02T18:19:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: cluster 2022-02-02T18:19:31.929285+0000 mon.smithi096 (mon 2022-02-02T18:19:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: .0) 514 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:boot 2022-02-02T18:19:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: cluster 2022-02-02T18:19: 2022-02-02T18:19:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 31.929625+0000 mon.smithi096 (mon.0) 515 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby 2022-02-02T18:19:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: audit 2022-02-02T18:19:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 2022-02-02T18:19:31.930280+0000 2022-02-02T18:19:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: mon.smithi096 (mon.0) 516 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:19:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 2022-02-02T18:19:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: cluster 2022-02-02T18:19:32.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 2022-02-02T18:19:31.933404+0000 mon.smithi096 (mon. 2022-02-02T18:19:32.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 0) 517 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2022-02-02T18:19:32.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:19:32.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: T18:19:31.960428+0000 mon.smithi096 (mon 2022-02-02T18:19:32.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: .0) 518 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:32.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:19:32.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: 02T18:19:31.961110+0000 mon.smithi096 ( 2022-02-02T18:19:32.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:32 smithi159 conmon[35668]: mon.0) 519 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:32.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: cluster 2022-02-02T18:19:31.925502+0000 mon.smithi096 (mon 2022-02-02T18:19:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: .0) 512 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2022-02-02T18:19:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: cluster 2022-02-02T18:19:31.925546+0000 mon.smithi096 (mon.0) 513 : cluster [INF] Cluster is now healthy 2022-02-02T18:19:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: cluster 2022-02-02T18:19:31.929285+0000 mon.smithi096 (mon.0) 514 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:boot 2022-02-02T18:19:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: cluster 2022-02-02T18:19:31.929625+0000 mon.smithi096 (mon.0) 515 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby 2022-02-02T18:19:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: audit 2022-02-02T18:19:31.930280+0000 mon.smithi096 (mon.0) 516 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:19:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: cluster 2022-02-02T18:19:31.933404+0000 mon.smithi096 (mon.0) 517 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2022-02-02T18:19:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: audit 2022-02-02T18:19:31.960428+0000 mon.smithi096 (mon.0) 518 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:32 smithi096 conmon[32067]: audit 2022-02-02T18:19:31.961110+0000 mon.smithi096 (mon.0) 519 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:33 smithi159 conmon[35668]: cluster 2022-02-02T18:19:32.799800+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:19:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:33 smithi159 conmon[35668]: 198 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 9 op/s 2022-02-02T18:19:33.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:33 smithi096 conmon[32067]: cluster 2022-02-02T18:19:32.799800+0000 mgr.smithi096.shfutl (mgr.14162) 198 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 9 op/s 2022-02-02T18:19:33.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 -- 172.21.15.96:0/254603192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f6860 msgr2=0x7f50900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 --2- 172.21.15.96:0/254603192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f6860 0x7f50900f6cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f5084004660 tx=0x7f5084009b30).stop 2022-02-02T18:19:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 -- 172.21.15.96:0/254603192 shutdown_connections 2022-02-02T18:19:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 --2- 172.21.15.96:0/254603192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f6860 0x7f50900f6cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 --2- 172.21.15.96:0/254603192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f55c0 0x7f50900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 -- 172.21.15.96:0/254603192 >> 172.21.15.96:0/254603192 conn(0x7f50900f0d40 msgr2=0x7f50900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 -- 172.21.15.96:0/254603192 shutdown_connections 2022-02-02T18:19:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 -- 172.21.15.96:0/254603192 wait complete. 2022-02-02T18:19:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.790+0000 7f50967e5700 1 Processor -- start 2022-02-02T18:19:33.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f50967e5700 1 -- start start 2022-02-02T18:19:33.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f50967e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:33.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f50967e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 0x7f509010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:33.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f50967e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090060470 con 0x7f50900f55c0 2022-02-02T18:19:33.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f50967e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900605b0 con 0x7f50900f6860 2022-02-02T18:19:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52234/0 (socket says 172.21.15.96:52234) 2022-02-02T18:19:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 -- 172.21.15.96:0/739957147 learned_addr learned my addr 172.21.15.96:0/739957147 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508f7fe700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 0x7f509010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 -- 172.21.15.96:0/739957147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 msgr2=0x7f509010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 0x7f509010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508ffff700 1 -- 172.21.15.96:0/739957147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084005040 con 0x7f50900f55c0 2022-02-02T18:19:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.791+0000 7f508f7fe700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 0x7f509010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:19:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f508ffff700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f50800093f0 tx=0x7f5080006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:33.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5080009ea0 con 0x7f50900f55c0 2022-02-02T18:19:33.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509010c810 con 0x7f50900f55c0 2022-02-02T18:19:33.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5080013ad0 con 0x7f50900f55c0 2022-02-02T18:19:33.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f508000da80 con 0x7f50900f55c0 2022-02-02T18:19:33.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.792+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509010cda0 con 0x7f50900f55c0 2022-02-02T18:19:33.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.793+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5090045ad0 con 0x7f50900f55c0 2022-02-02T18:19:33.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.794+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f508001a060 con 0x7f50900f55c0 2022-02-02T18:19:33.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.794+0000 7f508cff9700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 0x7f507805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:33.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.794+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f50800762d0 con 0x7f50900f55c0 2022-02-02T18:19:33.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.794+0000 7f508f7fe700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 0x7f507805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:33.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.795+0000 7f508f7fe700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 0x7f507805e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5084004e30 tx=0x7f5084009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:33.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:33.797+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5080049040 con 0x7f50900f55c0 2022-02-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.021+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f5090027a00 con 0x7f50900f55c0 2022-02-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.927+0000 7f508cff9700 1 -- 172.21.15.96:0/739957147 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f508004c660 con 0x7f50900f55c0 2022-02-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 msgr2=0x7f507805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 0x7f507805e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5084004e30 tx=0x7f5084009b30).stop 2022-02-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 msgr2=0x7f5090109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f50800093f0 tx=0x7f5080006ec0).stop 2022-02-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 shutdown_connections 2022-02-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f507805c2b0 0x7f507805e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50900f55c0 0x7f5090109cb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.929+0000 7f50967e5700 1 --2- 172.21.15.96:0/739957147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50900f6860 0x7f509010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.930+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 >> 172.21.15.96:0/739957147 conn(0x7f50900f0d40 msgr2=0x7f50900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.930+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 shutdown_connections 2022-02-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:34.930+0000 7f50967e5700 1 -- 172.21.15.96:0/739957147 wait complete. 2022-02-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi096.stderr:inline data disabled 2022-02-02T18:19:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:34 smithi159 conmon[35668]: audit 2022-02-02T18:19:34.022063+0000 mon.smithi096 (mon.0) 520 : audit 2022-02-02T18:19:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:34 smithi159 conmon[35668]: [INF] from='client.? 172.21.15.96:0/739957147' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2022-02-02T18:19:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:34 smithi159 conmon[35668]: audit 2022-02-02T18:19:34.834789+0000 mon.smithi096 (mon.0) 521 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:34 smithi096 conmon[32067]: audit 2022-02-02T18:19:34.022063+0000 mon.smithi096 (mon.0) 520 : audit [INF] from='client.? 172.21.15.96:0/739957147' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2022-02-02T18:19:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:34 smithi096 conmon[32067]: audit 2022-02-02T18:19:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:34 smithi096 conmon[32067]: 2022-02-02T18:19:34.834789 2022-02-02T18:19:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:34 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 521 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:35.635 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T18:19:35.647 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:35.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph fs dump' 2022-02-02T18:19:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:35 smithi159 conmon[35668]: cluster 2022-02-02T18:19:34.800165+0000 mgr.smithi096.shfutl (mgr.14162) 199 : cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 1.5 KiB/s wr, 7 op/s 2022-02-02T18:19:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:35 smithi159 conmon[35668]: audit 2022-02-02T18:19:34.928176+0000 mon.smithi096 (mon.0) 522 : audit [INF] from='client.? 172.21.15.96:0/739957147' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2022-02-02T18:19:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:35 smithi159 conmon[35668]: cluster 2022-02-02T18:19:34.928247+0000 mon.smithi096 (mon.0) 523 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2022-02-02T18:19:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:35 smithi096 conmon[32067]: cluster 2022-02-02T18:19:34.800165+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:19:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:35 smithi096 conmon[32067]: 14162) 199 : cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 1.5 KiB/s wr, 7 op/s 2022-02-02T18:19:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:35 smithi096 conmon[32067]: audit 2022-02-02T18:19:34.928176+0000 mon.smithi096 (mon.0) 522 : audit [INF] from='client.? 172.21.15.96:0/739957147' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2022-02-02T18:19:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:35 smithi096 conmon[32067]: cluster 2022-02-02T18:19:34.928247+0000 mon.smithi096 (mon.0) 523 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2022-02-02T18:19:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: cluster 2022-02-02T18:19:35.933557+0000 mon.smithi096 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:standby-replay 2022-02-02T18:19:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: cluster 2022-02-02T18:19:35.933602+0000 mon.smithi096 (mon.0) 525 : cluster [DBG] mds.? [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] up:boot 2022-02-02T18:19:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: cluster 2022-02-02T18:19:35.934767+0000 mon.smithi096 (mon.0) 526 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:19:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: audit 2022-02-02T18:19:35.934864+0000 mon.smithi096 (mon.0) 527 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:19:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: cluster 2022-02-02T18:19:35.939420+0000 mon.smithi096 (mon.0) 528 : cluster 2022-02-02T18:19:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:36 smithi159 conmon[35668]: [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:19:37.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:36 smithi096 conmon[32067]: cluster 2022-02-02T18:19:35.933557+0000 mon.smithi096 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:standby-replay 2022-02-02T18:19:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:36 smithi096 conmon[32067]: cluster 2022-02-02T18:19:35.933602+0000 mon.smithi096 (mon.0) 525 : cluster [DBG] mds.? [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] up:boot 2022-02-02T18:19:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:36 smithi096 conmon[32067]: cluster 2022-02-02T18:19:35.934767+0000 mon.smithi096 (mon.0) 526 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:19:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:36 smithi096 conmon[32067]: audit 2022-02-02T18:19:35.934864+0000 mon.smithi096 (mon.0) 527 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:19:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:36 smithi096 conmon[32067]: cluster 2022-02-02T18:19:35.939420+0000 mon.smithi096 (mon.0) 528 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:19:38.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 -- 172.21.15.96:0/4174506589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 msgr2=0x7fc6e00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:38.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4174506589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e00f7de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc6d0004660 tx=0x7fc6d0009b30).stop 2022-02-02T18:19:38.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 -- 172.21.15.96:0/4174506589 shutdown_connections 2022-02-02T18:19:38.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4174506589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e00f7de0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4174506589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 0x7fc6e00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 -- 172.21.15.96:0/4174506589 >> 172.21.15.96:0/4174506589 conn(0x7fc6e00f1e40 msgr2=0x7fc6e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:38.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 -- 172.21.15.96:0/4174506589 shutdown_connections 2022-02-02T18:19:38.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.046+0000 7fc6e613e700 1 -- 172.21.15.96:0/4174506589 wait complete. 2022-02-02T18:19:38.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 Processor -- start 2022-02-02T18:19:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 -- start start 2022-02-02T18:19:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 0x7fc6e0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0107a00 con 0x7fc6e00f7980 2022-02-02T18:19:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6e613e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0107b40 con 0x7fc6e00f66e0 2022-02-02T18:19:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52254/0 (socket says 172.21.15.96:52254) 2022-02-02T18:19:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.047+0000 7fc6deffd700 1 -- 172.21.15.96:0/4074628811 learned_addr learned my addr 172.21.15.96:0/4074628811 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6df7fe700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 0x7fc6e0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6deffd700 1 -- 172.21.15.96:0/4074628811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 msgr2=0x7fc6e0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6deffd700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 0x7fc6e0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6deffd700 1 -- 172.21.15.96:0/4074628811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0005040 con 0x7fc6e00f7980 2022-02-02T18:19:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6deffd700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc6d0009990 tx=0x7fc6d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d0018070 con 0x7fc6e00f7980 2022-02-02T18:19:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc6d0013410 con 0x7fc6e00f7980 2022-02-02T18:19:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0108480 con 0x7fc6e00f7980 2022-02-02T18:19:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d001c620 con 0x7fc6e00f7980 2022-02-02T18:19:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.048+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e01089e0 con 0x7fc6e00f7980 2022-02-02T18:19:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.049+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0045ad0 con 0x7fc6e00f7980 2022-02-02T18:19:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.049+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc6d001c8e0 con 0x7fc6e00f7980 2022-02-02T18:19:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.050+0000 7fc6c7fff700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 0x7fc6c805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.050+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc6d0077e80 con 0x7fc6e00f7980 2022-02-02T18:19:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.050+0000 7fc6df7fe700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 0x7fc6c805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:38.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.050+0000 7fc6df7fe700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 0x7fc6c805e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc6e00f77e0 tx=0x7fc6d4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:38.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.054+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc6d004ab60 con 0x7fc6e00f7980 2022-02-02T18:19:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.252+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6e00fefa0 con 0x7fc6e00f7980 2022-02-02T18:19:38.255 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:37 smithi096 conmon[32067]: cluster 2022-02-02T18:19:36.800628+0000 mgr.smithi096.shfutl ( 2022-02-02T18:19:38.256 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:37 smithi096 conmon[32067]: mgr.14162) 200 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2022-02-02T18:19:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.253+0000 7fc6c7fff700 1 -- 172.21.15.96:0/4074628811 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1608 (secure 0 0 0) 0x7fc6d004e180 con 0x7fc6e00f7980 2022-02-02T18:19:38.257 INFO:teuthology.orchestra.run.smithi096.stdout:e14 2022-02-02T18:19:38.257 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:19:38.257 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:19:38.257 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:19:38.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:38.258 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:19:38.258 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:19:38.258 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 14 2022-02-02T18:19:38.258 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:19:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:19:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:19:35.933675+0000 2022-02-02T18:19:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:19:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:19:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:19:38.260 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:19:38.260 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:19:38.260 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:19:38.260 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:19:38.260 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:19:38.261 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:19:38.261 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:19:38.261 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:19:38.261 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:19:38.261 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:19:38.262 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:19:38.262 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:19:38.262 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:19:38.262 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:19:38.262 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:19:38.263 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:19:38.263 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:19:38.263 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:19:38.263 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:19:38.263 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:19:38.264 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 2 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:19:38.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:38.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 msgr2=0x7fc6c805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 0x7fc6c805e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc6e00f77e0 tx=0x7fc6d4009040).stop 2022-02-02T18:19:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 msgr2=0x7fc6e0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc6d0009990 tx=0x7fc6d0009b30).stop 2022-02-02T18:19:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 shutdown_connections 2022-02-02T18:19:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc6c805c2b0 0x7fc6c805e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e00f66e0 0x7fc6e0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 --2- 172.21.15.96:0/4074628811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e00f7980 0x7fc6e0107450 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 >> 172.21.15.96:0/4074628811 conn(0x7fc6e00f1e40 msgr2=0x7fc6e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 shutdown_connections 2022-02-02T18:19:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:38.255+0000 7fc6e613e700 1 -- 172.21.15.96:0/4074628811 wait complete. 2022-02-02T18:19:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 14 2022-02-02T18:19:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:37 smithi159 conmon[35668]: cluster 2022-02-02T18:19:36.800628+0000 mgr.smithi096.shfutl (mgr.14162) 200 : cluster 2022-02-02T18:19:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:37 smithi159 conmon[35668]: [DBG] pgmap v162: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2022-02-02T18:19:38.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2022-02-02T18:19:39.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:38 smithi096 conmon[32067]: audit 2022-02-02T18:19:38.253396+0000 mon.smithi096 (mon.0) 529 : audit [DBG] from='client.? 172.21.15.96:0/4074628811' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:19:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:38 smithi159 conmon[35668]: audit 2022-02-02T18:19:38.253396+0000 mon.smithi096 (mon.0) 529 : audit [DBG] from='client.? 172.21.15.96:0/4074628811' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:19:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:39 smithi159 conmon[35668]: cluster 2022-02-02T18:19:38.800994+0000 mgr.smithi096.shfutl (mgr.14162) 201 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1023 B/s wr, 6 op/s 2022-02-02T18:19:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:39 smithi159 conmon[35668]: audit 2022-02-02T18:19 2022-02-02T18:19:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:39 smithi159 conmon[35668]: :39.029315+0000 mon.smithi096 (mon.0) 530 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:39 smithi159 conmon[35668]: audit 2022-02-02T18:19:39.033286+0000 mon.smithi096 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:39 smithi159 conmon[35668]: audit 2022-02-02T18:19:39.036562+0000 mon.smithi096 (mon.0) 532 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:40.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:39 smithi096 conmon[32067]: cluster 2022-02-02T18:19:38.800994+0000 mgr.smithi096.shfutl (mgr.14162) 201 2022-02-02T18:19:40.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:39 smithi096 conmon[32067]: : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1023 B/s wr, 6 op/s 2022-02-02T18:19:40.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:39 smithi096 conmon[32067]: audit 2022-02-02T18:19:39.029315+0000 mon.smithi096 (mon.0) 530 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:40.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:39 smithi096 conmon[32067]: audit 2022-02-02T18:19:39.033286+0000 mon.smithi096 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:40.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:39 smithi096 conmon[32067]: audit 2022-02-02T18:19:39.036562+0000 mon.smithi096 (mon.0) 532 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:19:40.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 -- 172.21.15.96:0/2464899577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 msgr2=0x7f5ce80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:40.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 --2- 172.21.15.96:0/2464899577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce80f6b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5cd80099e0 tx=0x7f5cd8004d10).stop 2022-02-02T18:19:40.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 -- 172.21.15.96:0/2464899577 shutdown_connections 2022-02-02T18:19:40.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 --2- 172.21.15.96:0/2464899577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 0x7f5ce80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 --2- 172.21.15.96:0/2464899577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce80f6b00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.663+0000 7f5cefd95700 1 -- 172.21.15.96:0/2464899577 >> 172.21.15.96:0/2464899577 conn(0x7f5ce80f1e40 msgr2=0x7f5ce80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:40.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 -- 172.21.15.96:0/2464899577 shutdown_connections 2022-02-02T18:19:40.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 -- 172.21.15.96:0/2464899577 wait complete. 2022-02-02T18:19:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 Processor -- start 2022-02-02T18:19:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 -- start start 2022-02-02T18:19:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 0x7f5ce81075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce8107b70 con 0x7f5ce80f66e0 2022-02-02T18:19:40.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cefd95700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce8107cb0 con 0x7f5ce80f7980 2022-02-02T18:19:40.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cedb31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:40.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cedb31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52262/0 (socket says 172.21.15.96:52262) 2022-02-02T18:19:40.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5cedb31700 1 -- 172.21.15.96:0/1697951216 learned_addr learned my addr 172.21.15.96:0/1697951216 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:40.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.664+0000 7f5ced330700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 0x7f5ce81075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:40.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cedb31700 1 -- 172.21.15.96:0/1697951216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 msgr2=0x7f5ce81075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:40.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cedb31700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 0x7f5ce81075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cedb31700 1 -- 172.21.15.96:0/1697951216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009640 con 0x7f5ce80f66e0 2022-02-02T18:19:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cedb31700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5cd800b3b0 tx=0x7f5cd8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd800e030 con 0x7f5ce80f66e0 2022-02-02T18:19:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce81085f0 con 0x7f5ce80f66e0 2022-02-02T18:19:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5cd8007df0 con 0x7f5ce80f66e0 2022-02-02T18:19:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd8018070 con 0x7f5ce80f66e0 2022-02-02T18:19:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.665+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8108ad0 con 0x7f5ce80f66e0 2022-02-02T18:19:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.666+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce8045ad0 con 0x7f5ce80f66e0 2022-02-02T18:19:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.666+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5cd801d420 con 0x7f5ce80f66e0 2022-02-02T18:19:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.667+0000 7f5ce67fc700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 0x7f5cd005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.667+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5cd8077c90 con 0x7f5ce80f66e0 2022-02-02T18:19:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.667+0000 7f5ced330700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 0x7f5cd005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.667+0000 7f5ced330700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 0x7f5cd005e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5cdc0096c0 tx=0x7f5cdc009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.671+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5cd804a910 con 0x7f5ce80f66e0 2022-02-02T18:19:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.862+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ce80feea0 con 0x7f5ce80f66e0 2022-02-02T18:19:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.862+0000 7f5ce67fc700 1 -- 172.21.15.96:0/1697951216 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2962 (secure 0 0 0) 0x7f5cd804df30 con 0x7f5ce80f66e0 2022-02-02T18:19:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.864+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 msgr2=0x7f5cd005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.864+0000 7f5cefd95700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 0x7f5cd005e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5cdc0096c0 tx=0x7f5cdc009be0).stop 2022-02-02T18:19:40.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.864+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 msgr2=0x7f5ce81070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:40.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.864+0000 7f5cefd95700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5cd800b3b0 tx=0x7f5cd8004d10).stop 2022-02-02T18:19:40.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 shutdown_connections 2022-02-02T18:19:40.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f5cd005c2b0 0x7f5cd005e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce80f66e0 0x7f5ce81070d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 --2- 172.21.15.96:0/1697951216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ce80f7980 0x7f5ce81075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 >> 172.21.15.96:0/1697951216 conn(0x7f5ce80f1e40 msgr2=0x7f5ce80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 shutdown_connections 2022-02-02T18:19:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:40.865+0000 7f5cefd95700 1 -- 172.21.15.96:0/1697951216 wait complete. 2022-02-02T18:19:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 15 2022-02-02T18:19:40.878 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:19:41.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:41 smithi096 conmon[32067]: cluster 2022-02-02T18:19:40.035231+0000 mon.smithi096 (mon.0) 533 : cluster [DBG] mds.? [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] up:standby-replay 2022-02-02T18:19:41.293 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:41 smithi096 conmon[32067]: cluster 2022-02-02T18:19:40.035301+0000 mon.smithi096 (mon.0) 534 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:19:41.293 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:41 smithi096 conmon[32067]: cluster 2022-02-02T18:19:40.801327+0000 mgr.smithi096.shfutl (mgr.14162) 202 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 938 B/s wr, 6 op/s 2022-02-02T18:19:41.293 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:41 smithi096 conmon[32067]: audit 2022-02-02T18:19:40.864320+0000 mon.smithi096 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.96:0/1697951216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T18:19:41.294 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- bash -c 'ceph --format=json mds versions | jq -e ". | add == 4"' 2022-02-02T18:19:41.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: cluster 2022-02-02T18:19:40.035231+0000 mon.smithi096 (mon.0) 533 : 2022-02-02T18:19:41.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: cluster [DBG] mds.? [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] up:standby-replay 2022-02-02T18:19:41.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: cluster 2022-02-02T18:19:40.035301+0000 mon.smithi096 (mon.0) 534 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:19:41.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: cluster 2022-02-02T18:19:40.801327+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:19:41.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: 202 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 938 B/s wr, 6 op/s 2022-02-02T18:19:41.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:19:41.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: 19:40.864320+0000 mon.smithi096 (mon.0) 535 2022-02-02T18:19:41.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:41 smithi159 conmon[35668]: : audit [DBG] from='client.? 172.21.15.96:0/1697951216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T18:19:42.990 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:42 smithi096 conmon[32067]: audit 2022-02-02T18:19:41.800120+0000 mon.smithi096 (mon.0) 2022-02-02T18:19:42.990 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:42 smithi096 conmon[32067]: 536 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 -- 172.21.15.96:0/1105002294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 msgr2=0x7fa00c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 --2- 172.21.15.96:0/1105002294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c0f7c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa000004660 tx=0x7fa000009b30).stop 2022-02-02T18:19:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 -- 172.21.15.96:0/1105002294 shutdown_connections 2022-02-02T18:19:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 --2- 172.21.15.96:0/1105002294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c0f7c30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 --2- 172.21.15.96:0/1105002294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 -- 172.21.15.96:0/1105002294 >> 172.21.15.96:0/1105002294 conn(0x7fa00c0f1c90 msgr2=0x7fa00c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 -- 172.21.15.96:0/1105002294 shutdown_connections 2022-02-02T18:19:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.179+0000 7fa010869700 1 -- 172.21.15.96:0/1105002294 wait complete. 2022-02-02T18:19:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 Processor -- start 2022-02-02T18:19:43.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 -- start start 2022-02-02T18:19:43.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:43.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:43.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c107980 con 0x7fa00c0f77d0 2022-02-02T18:19:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa010869700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c108100 con 0x7fa00c0f6530 2022-02-02T18:19:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa00a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa00a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52274/0 (socket says 172.21.15.96:52274) 2022-02-02T18:19:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.180+0000 7fa00a59c700 1 -- 172.21.15.96:0/2399393937 learned_addr learned my addr 172.21.15.96:0/2399393937 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00ad9d700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00a59c700 1 -- 172.21.15.96:0/2399393937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 msgr2=0x7fa00c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00a59c700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00a59c700 1 -- 172.21.15.96:0/2399393937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000005040 con 0x7fa00c0f77d0 2022-02-02T18:19:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00ad9d700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:19:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa00a59c700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa000009990 tx=0x7fa000009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa000018070 con 0x7fa00c0f77d0 2022-02-02T18:19:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c108320 con 0x7fa00c0f77d0 2022-02-02T18:19:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa000013410 con 0x7fa00c0f77d0 2022-02-02T18:19:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00001c620 con 0x7fa00c0f77d0 2022-02-02T18:19:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.181+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c108880 con 0x7fa00c0f77d0 2022-02-02T18:19:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.182+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c045ad0 con 0x7fa00c0f77d0 2022-02-02T18:19:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.182+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa00001c8e0 con 0x7fa00c0f77d0 2022-02-02T18:19:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.183+0000 7f9ff37fe700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 0x7f9ff405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.183+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa000077e80 con 0x7fa00c0f77d0 2022-02-02T18:19:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.183+0000 7fa00ad9d700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 0x7f9ff405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.183+0000 7fa00ad9d700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 0x7f9ff405e7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa00c106b70 tx=0x7f9ffc008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.187+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa00004ab60 con 0x7fa00c0f77d0 2022-02-02T18:19:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:42 smithi159 conmon[35668]: audit 2022-02-02T18:19:41.800120+0000 mon.smithi096 (mon.0) 536 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.409+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fa00c027a00 con 0x7fa00c0f77d0 2022-02-02T18:19:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.409+0000 7f9ff37fe700 1 -- 172.21.15.96:0/2399393937 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+86 (secure 0 0 0) 0x7fa00004e180 con 0x7fa00c0f77d0 2022-02-02T18:19:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 msgr2=0x7f9ff405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 0x7f9ff405e7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa00c106b70 tx=0x7f9ffc008040).stop 2022-02-02T18:19:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 msgr2=0x7fa00c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa000009990 tx=0x7fa000009b30).stop 2022-02-02T18:19:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 shutdown_connections 2022-02-02T18:19:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9ff405c300 0x7f9ff405e7c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c0f6530 0x7fa00c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 --2- 172.21.15.96:0/2399393937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa00c0f77d0 0x7fa00c1072f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:43.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 >> 172.21.15.96:0/2399393937 conn(0x7fa00c0f1c90 msgr2=0x7fa00c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:43.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 shutdown_connections 2022-02-02T18:19:43.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:43.411+0000 7fa010869700 1 -- 172.21.15.96:0/2399393937 wait complete. 2022-02-02T18:19:43.425 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:19:44.007 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:43 smithi096 conmon[32067]: cluster 2022-02-02T18:19:42.801781+0000 mgr.smithi096.shfutl (mgr.14162) 203 2022-02-02T18:19:44.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:43 smithi096 conmon[32067]: : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2022-02-02T18:19:44.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:43 smithi096 conmon[32067]: audit 2022-02-02T18:19:43.411061+0000 mon.smithi096 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.96:0/2399393937' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2022-02-02T18:19:44.009 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2022-02-02T18:19:44.024 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-02-02T18:19:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 -- 172.21.15.96:0/1634451486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00603a0 msgr2=0x7f37d00f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/1634451486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00603a0 0x7f37d00f9140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f37c0004660 tx=0x7f37c0009b30).stop 2022-02-02T18:19:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 -- 172.21.15.96:0/1634451486 shutdown_connections 2022-02-02T18:19:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/1634451486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00f96c0 0x7f37d00fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/1634451486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00603a0 0x7f37d00f9140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 -- 172.21.15.96:0/1634451486 >> 172.21.15.96:0/1634451486 conn(0x7f37d00f0ba0 msgr2=0x7f37d00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 -- 172.21.15.96:0/1634451486 shutdown_connections 2022-02-02T18:19:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 -- 172.21.15.96:0/1634451486 wait complete. 2022-02-02T18:19:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.234+0000 7f37d5a6c700 1 Processor -- start 2022-02-02T18:19:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37d5a6c700 1 -- start start 2022-02-02T18:19:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37d5a6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00603a0 0x7f37d0108dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37d5a6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37d5a6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d0109860 con 0x7f37d00f96c0 2022-02-02T18:19:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37d5a6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d01099a0 con 0x7f37d00603a0 2022-02-02T18:19:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52284/0 (socket says 172.21.15.96:52284) 2022-02-02T18:19:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 -- 172.21.15.96:0/911316636 learned_addr learned my addr 172.21.15.96:0/911316636 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37cf7fe700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00603a0 0x7f37d0108dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 -- 172.21.15.96:0/911316636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00603a0 msgr2=0x7f37d0108dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00603a0 0x7f37d0108dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 -- 172.21.15.96:0/911316636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0005040 con 0x7f37d00f96c0 2022-02-02T18:19:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37ceffd700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f37c4002700 tx=0x7f37c4009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.235+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c40079c0 con 0x7f37d00f96c0 2022-02-02T18:19:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.236+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f37c400f040 con 0x7f37d00f96c0 2022-02-02T18:19:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.236+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d010e440 con 0x7f37d00f96c0 2022-02-02T18:19:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.236+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c40146e0 con 0x7f37d00f96c0 2022-02-02T18:19:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.236+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d010ea00 con 0x7f37d00f96c0 2022-02-02T18:19:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.237+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d00fecd0 con 0x7f37d00f96c0 2022-02-02T18:19:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.237+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f37c401b060 con 0x7f37d00f96c0 2022-02-02T18:19:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.237+0000 7f37b7fff700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 0x7f37b805e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.238+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f37c4075d70 con 0x7f37d00f96c0 2022-02-02T18:19:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.238+0000 7f37cf7fe700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 0x7f37b805e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.238+0000 7f37cf7fe700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 0x7f37b805e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f37c0005010 tx=0x7f37c0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.243+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f37c4048a50 con 0x7f37d00f96c0 2022-02-02T18:19:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:43 smithi159 conmon[35668]: cluster 2022-02-02T18:19:42.801781+0000 mgr.smithi096.shfutl (mgr.14162) 203 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2022-02-02T18:19:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:43 smithi159 conmon[35668]: 2022-02-02T18:19:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:43 smithi159 conmon[35668]: audit 2022-02-02T18:19:43.411061+0000 mon.smithi096 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.96:0/2399393937' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2022-02-02T18:19:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.411+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37d010f390 con 0x7f37d00f96c0 2022-02-02T18:19:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.412+0000 7f37b7fff700 1 -- 172.21.15.96:0/911316636 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+14055 (secure 0 0 0) 0x7f37c404c070 con 0x7f37d00f96c0 2022-02-02T18:19:44.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:44.417 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":42,"fsid":"e1d78c58-8453-11ec-8c35-001a4aab830c","created":"2022-02-02T18:14:19.866158+0000","modified":"2022-02-02T18:19:23.972889+0000","last_up_change":"2022-02-02T18:18:20.014966+0000","last_in_change":"2022-02-02T18:18:03.867700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T18:17:38.891092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2022-02-02T18:19:20.619008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2022-02-02T18:19:21.202671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d7ab242-00e2-4b8d-a7be-0bf62b292a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6803","nonce":195432068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6805","nonce":195432068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6809","nonce":195432068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":195432068},{"type":"v1","addr":"172.21.15.96:6807","nonce":195432068}]},"public_addr":"172.21.15.96:6803/195432068","cluster_addr":"172.21.15.96:6805/195432068","heartbeat_back_addr":"172.21.15.96:6809/195432068","heartbeat_front_addr":"172.21.15.96:6807/195432068","state":["exists","up"]},{"osd":1,"uuid":"dec772e4-b9e6-4351-a19d-64fdd5df9e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6811","nonce":2713933524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6813","nonce":2713933524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6817","nonce":2713933524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2713933524},{"type":"v1","addr":"172.21.15.96:6815","nonce":2713933524}]},"public_addr":"172.21.15.96:6811/2713933524","cluster_addr":"172.21.15.96:6813/2713933524","heartbeat_back_addr":"172.21.15.96:6817/2713933524","heartbeat_front_addr":"172.21.15.96:6815/2713933524","state":["exists","up"]},{"osd":2,"uuid":"71e07e53-0fd8-4df3-8306-f483afe6fbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6819","nonce":620516912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6821","nonce":620516912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6825","nonce":620516912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":620516912},{"type":"v1","addr":"172.21.15.96:6823","nonce":620516912}]},"public_addr":"172.21.15.96:6819/620516912","cluster_addr":"172.21.15.96:6821/620516912","heartbeat_back_addr":"172.21.15.96:6825/620516912","heartbeat_front_addr":"172.21.15.96:6823/620516912","state":["exists","up"]},{"osd":3,"uuid":"7a85a335-124c-4fcd-bbc5-db2bd88eaa14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6801","nonce":3926735851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6803","nonce":3926735851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6807","nonce":3926735851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3926735851},{"type":"v1","addr":"172.21.15.159:6805","nonce":3926735851}]},"public_addr":"172.21.15.159:6801/3926735851","cluster_addr":"172.21.15.159:6803/3926735851","heartbeat_back_addr":"172.21.15.159:6807/3926735851","heartbeat_front_addr":"172.21.15.159:6805/3926735851","state":["exists","up"]},{"osd":4,"uuid":"b22a2951-4fd4-4bc3-bc1e-f315e3d9514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6809","nonce":3593977560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6811","nonce":3593977560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6815","nonce":3593977560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3593977560},{"type":"v1","addr":"172.21.15.159:6813","nonce":3593977560}]},"public_addr":"172.21.15.159:6809/3593977560","cluster_addr":"172.21.15.159:6811/3593977560","heartbeat_back_addr":"172.21.15.159:6815/3593977560","heartbeat_front_addr":"172.21.15.159:6813/3593977560","state":["exists","up"]},{"osd":5,"uuid":"0ff39853-acbf-4ad7-90a7-9e777d5f2e77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6817","nonce":3899321246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6819","nonce":3899321246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6823","nonce":3899321246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3899321246},{"type":"v1","addr":"172.21.15.159:6821","nonce":3899321246}]},"public_addr":"172.21.15.159:6817/3899321246","cluster_addr":"172.21.15.159:6819/3899321246","heartbeat_back_addr":"172.21.15.159:6823/3899321246","heartbeat_front_addr":"172.21.15.159:6821/3899321246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:16:48.144336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:08.030795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:27.491150+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:17:43.510407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:00.754870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T18:18:18.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/4214525506":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:0/485054154":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2852726971":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:6800/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3765010446":"2022-02-03T18:15:13.882473+0000","172.21.15.96:6801/1366851711":"2022-02-03T18:14:38.276817+0000","172.21.15.96:0/2703146795":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/2843799198":"2022-02-03T18:14:38.276817+0000","172.21.15.96:6800/3681595525":"2022-02-03T18:15:00.321443+0000","172.21.15.96:0/1749856739":"2022-02-03T18:14:38.276817+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T18:19:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 msgr2=0x7f37b805e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 0x7f37b805e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f37c0005010 tx=0x7f37c0009b30).stop 2022-02-02T18:19:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 msgr2=0x7f37d01092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f37c4002700 tx=0x7f37c4009d60).stop 2022-02-02T18:19:44.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 shutdown_connections 2022-02-02T18:19:44.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f37b805c370 0x7f37b805e830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37d00603a0 0x7f37d0108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 --2- 172.21.15.96:0/911316636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d00f96c0 0x7f37d01092b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 >> 172.21.15.96:0/911316636 conn(0x7f37d00f0ba0 msgr2=0x7f37d00f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 shutdown_connections 2022-02-02T18:19:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.414+0000 7f37d5a6c700 1 -- 172.21.15.96:0/911316636 wait complete. 2022-02-02T18:19:44.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-02-02T18:17:38.891092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2022-02-02T18:19:20.619008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2022-02-02T18:19:21.202671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-02-02T18:19:44.431 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-02-02T18:19:44.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.559+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/2463023164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 msgr2=0x7fb8a40f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.559+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/2463023164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a40f6ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fb898004660 tx=0x7fb898009b30).stop 2022-02-02T18:19:44.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/2463023164 shutdown_connections 2022-02-02T18:19:44.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/2463023164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a40f6ae0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/2463023164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 0x7fb8a40f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/2463023164 >> 172.21.15.96:0/2463023164 conn(0x7fb8a40f0b60 msgr2=0x7fb8a40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:44.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/2463023164 shutdown_connections 2022-02-02T18:19:44.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/2463023164 wait complete. 2022-02-02T18:19:44.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 Processor -- start 2022-02-02T18:19:44.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.560+0000 7fb8aa7c5700 1 -- start start 2022-02-02T18:19:44.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 0x7fb8a4105b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41065a0 con 0x7fb8a40f6680 2022-02-02T18:19:44.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41066e0 con 0x7fb8a40f53e0 2022-02-02T18:19:44.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52294/0 (socket says 172.21.15.96:52294) 2022-02-02T18:19:44.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 -- 172.21.15.96:0/4073431857 learned_addr learned my addr 172.21.15.96:0/4073431857 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:44.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a3fff700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 0x7fb8a4105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 -- 172.21.15.96:0/4073431857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 msgr2=0x7fb8a4105b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 0x7fb8a4105b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 -- 172.21.15.96:0/4073431857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898005040 con 0x7fb8a40f6680 2022-02-02T18:19:44.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a37fe700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb898009990 tx=0x7fb898009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb898018070 con 0x7fb8a40f6680 2022-02-02T18:19:44.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb898013410 con 0x7fb8a40f6680 2022-02-02T18:19:44.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a410b120 con 0x7fb8a40f6680 2022-02-02T18:19:44.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89801c3c0 con 0x7fb8a40f6680 2022-02-02T18:19:44.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.561+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a410b6e0 con 0x7fb8a40f6680 2022-02-02T18:19:44.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.562+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a4027a00 con 0x7fb8a40f6680 2022-02-02T18:19:44.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.563+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb89801d420 con 0x7fb8a40f6680 2022-02-02T18:19:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.563+0000 7fb8a0ff9700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 0x7fb88c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.563+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb898077c80 con 0x7fb8a40f6680 2022-02-02T18:19:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.563+0000 7fb8a3fff700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 0x7fb88c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.564+0000 7fb8a3fff700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 0x7fb88c05e7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb8a40f64e0 tx=0x7fb894009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.567+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb89804a8a0 con 0x7fb8a40f6680 2022-02-02T18:19:44.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.726+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb8a40fdba0 con 0x7fb8a40f6680 2022-02-02T18:19:44.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.727+0000 7fb8a0ff9700 1 -- 172.21.15.96:0/4073431857 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb89801d6b0 con 0x7fb8a40f6680 2022-02-02T18:19:44.731 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2022-02-02T18:19:44.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 msgr2=0x7fb88c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 0x7fb88c05e7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb8a40f64e0 tx=0x7fb894009c00).stop 2022-02-02T18:19:44.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 msgr2=0x7fb8a4105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb898009990 tx=0x7fb898009b30).stop 2022-02-02T18:19:44.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 shutdown_connections 2022-02-02T18:19:44.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb88c05c300 0x7fb88c05e7c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a40f53e0 0x7fb8a4105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 --2- 172.21.15.96:0/4073431857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8a40f6680 0x7fb8a4105ff0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 >> 172.21.15.96:0/4073431857 conn(0x7fb8a40f0b60 msgr2=0x7fb8a40fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:44.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 shutdown_connections 2022-02-02T18:19:44.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.728+0000 7fb8aa7c5700 1 -- 172.21.15.96:0/4073431857 wait complete. 2022-02-02T18:19:44.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2022-02-02T18:19:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 -- 172.21.15.96:0/786628255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 msgr2=0x7fb5bc0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/786628255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc0f66d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb5ac004660 tx=0x7fb5ac009b30).stop 2022-02-02T18:19:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 -- 172.21.15.96:0/786628255 shutdown_connections 2022-02-02T18:19:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/786628255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc0f66d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/786628255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5bc0f5390 0x7fb5bc0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 -- 172.21.15.96:0/786628255 >> 172.21.15.96:0/786628255 conn(0x7fb5bc0f0b70 msgr2=0x7fb5bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 -- 172.21.15.96:0/786628255 shutdown_connections 2022-02-02T18:19:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.863+0000 7fb5c42ed700 1 -- 172.21.15.96:0/786628255 wait complete. 2022-02-02T18:19:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 Processor -- start 2022-02-02T18:19:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 -- start start 2022-02-02T18:19:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5bc0f5390 0x7fb5bc05fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc10bf20 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c42ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc10c060 con 0x7fb5bc0f5390 2022-02-02T18:19:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52304/0 (socket says 172.21.15.96:52304) 2022-02-02T18:19:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 -- 172.21.15.96:0/3865848083 learned_addr learned my addr 172.21.15.96:0/3865848083 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 -- 172.21.15.96:0/3865848083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5bc0f5390 msgr2=0x7fb5bc05fcb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:19:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5bc0f5390 0x7fb5bc05fcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 -- 172.21.15.96:0/3865848083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac005040 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.864+0000 7fb5c1888700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb5ac009d60 tx=0x7fb5ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5ac018070 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb5ac013410 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc10c260 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5ac01c3c0 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc10c7c0 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.865+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc027a00 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.866+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb5ac01d420 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.866+0000 7fb5b2ffd700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 0x7fb5a805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:44.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.866+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb5ac077af0 con 0x7fb5bc0f5ca0 2022-02-02T18:19:44.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.866+0000 7fb5c2089700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 0x7fb5a805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:44.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.867+0000 7fb5c2089700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 0x7fb5a805e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb5b8004a10 tx=0x7fb5b80099e0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:44.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:44.870+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb5ac04a850 con 0x7fb5bc0f5ca0 2022-02-02T18:19:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.038+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb5bc0fdb80 con 0x7fb5bc0f5ca0 2022-02-02T18:19:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.039+0000 7fb5b2ffd700 1 -- 172.21.15.96:0/3865848083 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb5ac01d6b0 con 0x7fb5bc0f5ca0 2022-02-02T18:19:45.043 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2022-02-02T18:19:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 msgr2=0x7fb5a805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 0x7fb5a805e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb5b8004a10 tx=0x7fb5b80099e0).stop 2022-02-02T18:19:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 msgr2=0x7fb5bc10ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb5ac009d60 tx=0x7fb5ac009b30).stop 2022-02-02T18:19:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 shutdown_connections 2022-02-02T18:19:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fb5a805c2b0 0x7fb5a805e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5bc0f5390 0x7fb5bc05fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 --2- 172.21.15.96:0/3865848083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5bc0f5ca0 0x7fb5bc10ba30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.040+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 >> 172.21.15.96:0/3865848083 conn(0x7fb5bc0f0b70 msgr2=0x7fb5bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.041+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 shutdown_connections 2022-02-02T18:19:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.041+0000 7fb5c42ed700 1 -- 172.21.15.96:0/3865848083 wait complete. 2022-02-02T18:19:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:44 smithi096 conmon[32067]: audit 2022-02-02T18:19:44.413762+0000 mon.smithi096 (mon.0) 538 2022-02-02T18:19:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:44 smithi096 conmon[32067]: : audit [DBG] from='client.? 172.21.15.96:0/911316636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:19:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:44 smithi096 conmon[32067]: audit 2022-02-02T18:19:44.728472+0000 mon.smithi096 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.96:0/4073431857' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T18:19:45.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2022-02-02T18:19:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 -- 172.21.15.96:0/3830205982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 msgr2=0x7fd4400f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 --2- 172.21.15.96:0/3830205982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd4400f57e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fd434004660 tx=0x7fd434009b30).stop 2022-02-02T18:19:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 -- 172.21.15.96:0/3830205982 shutdown_connections 2022-02-02T18:19:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 --2- 172.21.15.96:0/3830205982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 0x7fd4400f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 --2- 172.21.15.96:0/3830205982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd4400f57e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 -- 172.21.15.96:0/3830205982 >> 172.21.15.96:0/3830205982 conn(0x7fd4400f0b00 msgr2=0x7fd4400f2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 -- 172.21.15.96:0/3830205982 shutdown_connections 2022-02-02T18:19:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.176+0000 7fd446410700 1 -- 172.21.15.96:0/3830205982 wait complete. 2022-02-02T18:19:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 Processor -- start 2022-02-02T18:19:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 -- start start 2022-02-02T18:19:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 0x7fd44010ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010bf50 con 0x7fd4400f53c0 2022-02-02T18:19:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd446410700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010c090 con 0x7fd4400f6660 2022-02-02T18:19:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52312/0 (socket says 172.21.15.96:52312) 2022-02-02T18:19:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 -- 172.21.15.96:0/1650070186 learned_addr learned my addr 172.21.15.96:0/1650070186 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43f7fe700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 0x7fd44010ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 -- 172.21.15.96:0/1650070186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 msgr2=0x7fd44010ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 0x7fd44010ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.177+0000 7fd43ffff700 1 -- 172.21.15.96:0/1650070186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434005040 con 0x7fd4400f53c0 2022-02-02T18:19:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd43ffff700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd434007a90 tx=0x7fd434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd434018070 con 0x7fd4400f53c0 2022-02-02T18:19:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44010c290 con 0x7fd4400f53c0 2022-02-02T18:19:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd434013410 con 0x7fd4400f53c0 2022-02-02T18:19:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43401dea0 con 0x7fd4400f53c0 2022-02-02T18:19:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44010c7f0 con 0x7fd4400f53c0 2022-02-02T18:19:45.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.178+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440027a00 con 0x7fd4400f53c0 2022-02-02T18:19:45.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.179+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd43401d940 con 0x7fd4400f53c0 2022-02-02T18:19:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.179+0000 7fd43cff9700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 0x7fd42805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.179+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd434077e10 con 0x7fd4400f53c0 2022-02-02T18:19:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.179+0000 7fd43f7fe700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 0x7fd42805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.180+0000 7fd43f7fe700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 0x7fd42805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd430007fd0 tx=0x7fd430009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.183+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd43404aaf0 con 0x7fd4400f53c0 2022-02-02T18:19:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:44 smithi159 conmon[35668]: audit 2022-02-02T18:19:44.413762+0000 mon.smithi096 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.96:0/911316636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T18:19:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:44 smithi159 conmon[35668]: audit 2022-02-02T18:19:44.728472+0000 mon.smithi096 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.96:0/4073431857' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T18:19:45.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.349+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd4400fdb80 con 0x7fd4400f53c0 2022-02-02T18:19:45.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.350+0000 7fd43cff9700 1 -- 172.21.15.96:0/1650070186 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd43404e110 con 0x7fd4400f53c0 2022-02-02T18:19:45.354 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2022-02-02T18:19:45.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 msgr2=0x7fd42805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 0x7fd42805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd430007fd0 tx=0x7fd430009040).stop 2022-02-02T18:19:45.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 msgr2=0x7fd440060120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd434007a90 tx=0x7fd434009b30).stop 2022-02-02T18:19:45.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 shutdown_connections 2022-02-02T18:19:45.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd42805c2b0 0x7fd42805e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4400f53c0 0x7fd440060120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 --2- 172.21.15.96:0/1650070186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4400f6660 0x7fd44010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 >> 172.21.15.96:0/1650070186 conn(0x7fd4400f0b00 msgr2=0x7fd4400fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:45.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 shutdown_connections 2022-02-02T18:19:45.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.352+0000 7fd446410700 1 -- 172.21.15.96:0/1650070186 wait complete. 2022-02-02T18:19:45.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-02-02T18:19:45.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3676028650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 msgr2=0x7f7e340f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3676028650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e340f5720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f7e24004660 tx=0x7f7e24009b30).stop 2022-02-02T18:19:45.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3676028650 shutdown_connections 2022-02-02T18:19:45.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3676028650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e340f5720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3676028650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 0x7f7e340f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3676028650 >> 172.21.15.96:0/3676028650 conn(0x7f7e340f0270 msgr2=0x7f7e340f26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:45.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3676028650 shutdown_connections 2022-02-02T18:19:45.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.505+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3676028650 wait complete. 2022-02-02T18:19:45.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 Processor -- start 2022-02-02T18:19:45.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 -- start start 2022-02-02T18:19:45.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 0x7f7e340f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3410bdd0 con 0x7f7e340f72e0 2022-02-02T18:19:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e3b9db700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3410bf10 con 0x7f7e340f6940 2022-02-02T18:19:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.506+0000 7f7e38f76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52324/0 (socket says 172.21.15.96:52324) 2022-02-02T18:19:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 -- 172.21.15.96:0/3085033042 learned_addr learned my addr 172.21.15.96:0/3085033042 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e39777700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 0x7f7e340f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 -- 172.21.15.96:0/3085033042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 msgr2=0x7f7e340f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 0x7f7e340f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 -- 172.21.15.96:0/3085033042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24005040 con 0x7f7e340f72e0 2022-02-02T18:19:45.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e38f76700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7e24000c00 tx=0x7f7e2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:45.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e24019070 con 0x7f7e340f72e0 2022-02-02T18:19:45.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3410c140 con 0x7f7e340f72e0 2022-02-02T18:19:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7e24007e50 con 0x7f7e340f72e0 2022-02-02T18:19:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e24014d00 con 0x7f7e340f72e0 2022-02-02T18:19:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.507+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3410c6a0 con 0x7f7e340f72e0 2022-02-02T18:19:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.508+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e34027a00 con 0x7f7e340f72e0 2022-02-02T18:19:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.508+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7e24025070 con 0x7f7e340f72e0 2022-02-02T18:19:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.509+0000 7f7e29ffb700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 0x7f7e2005e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.509+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7e24076f80 con 0x7f7e340f72e0 2022-02-02T18:19:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.509+0000 7f7e39777700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 0x7f7e2005e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:45.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.509+0000 7f7e39777700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 0x7f7e2005e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7e30009da0 tx=0x7f7e3000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:45.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.513+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7e24049c60 con 0x7f7e340f72e0 2022-02-02T18:19:45.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.707+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e340fdb70 con 0x7f7e340f72e0 2022-02-02T18:19:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.707+0000 7f7e29ffb700 1 -- 172.21.15.96:0/3085033042 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2962 (secure 0 0 0) 0x7f7e2404d280 con 0x7f7e340f72e0 2022-02-02T18:19:45.712 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:19:45.712 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-02-02T18:19:21.963693+0000","modified":"2022-02-02T18:19:40.031738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24263,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi096.pitrsc","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.96:6827/581960765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":581960765},{"type":"v1","addr":"172.21.15.96:6827","nonce":581960765}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_14460":{"gid":14460,"name":"cephfs.smithi096.ghwylx","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.96:6829/3970357036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3970357036},{"type":"v1","addr":"172.21.15.96:6829","nonce":3970357036}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24263":{"gid":24263,"name":"cephfs.smithi159.shbucd","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.159:6825/1329095382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1329095382},{"type":"v1","addr":"172.21.15.159:6825","nonce":1329095382}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24273":{"gid":24273,"name":"cephfs.smithi159.omlhix","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.159:6827/1698563654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1698563654},{"type":"v1","addr":"172.21.15.159:6827","nonce":1698563654}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-02-02T18:19:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 msgr2=0x7f7e2005e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 0x7f7e2005e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7e30009da0 tx=0x7f7e3000b040).stop 2022-02-02T18:19:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 msgr2=0x7f7e3410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7e24000c00 tx=0x7f7e2400b040).stop 2022-02-02T18:19:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 shutdown_connections 2022-02-02T18:19:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7e2005c370 0x7f7e2005e830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e340f6940 0x7f7e340f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 --2- 172.21.15.96:0/3085033042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e340f72e0 0x7f7e3410b8e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 >> 172.21.15.96:0/3085033042 conn(0x7f7e340f0270 msgr2=0x7f7e340fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 shutdown_connections 2022-02-02T18:19:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:45.710+0000 7f7e3b9db700 1 -- 172.21.15.96:0/3085033042 wait complete. 2022-02-02T18:19:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 15 2022-02-02T18:19:45.725 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2022-02-02T18:19:45.726 INFO:teuthology.run_tasks:Running task kclient... 2022-02-02T18:19:45.753 INFO:tasks.kclient:Mounting kernel clients... 2022-02-02T18:19:45.753 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2022-02-02T18:19:45.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:45.754 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2022-02-02T18:19:45.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:45.772 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2022-02-02T18:19:45.841 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2022-02-02T18:19:45.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T18:19:45.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:45.843 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2022-02-02T18:19:45.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:45.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2022-02-02T18:19:45.940 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2022-02-02T18:19:45.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T18:19:45.942 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2022-02-02T18:19:45.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph fs ls 2022-02-02T18:19:46.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:45 smithi096 conmon[32067]: cluster 2022-02-02T18:19:44.802269+0000 mgr.smithi096.shfutl (mgr.14162) 204 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2022-02-02T18:19:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:45 smithi096 conmon[32067]: audit 2022-02-02T18:19:45.040654+0000 mon.smithi096 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.96:0/3865848083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2022-02-02T18:19:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:45 smithi096 conmon[32067]: audit 2022-02-02T18:19:45.351584+0000 mon.smithi096 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.96:0/1650070186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2022-02-02T18:19:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:45 smithi096 conmon[32067]: audit 2022-02-02T18:19:45.709189+0000 mon.smithi096 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.96:0/3085033042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T18:19:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:45 smithi159 conmon[35668]: cluster 2022-02-02T18:19:44.802269+0000 mgr.smithi096.shfutl (mgr.14162) 204 2022-02-02T18:19:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:45 smithi159 conmon[35668]: : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2022-02-02T18:19:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:45 smithi159 conmon[35668]: audit 2022-02-02T18:19:45.040654+0000 mon.smithi096 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.96:0/3865848083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2022-02-02T18:19:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:45 smithi159 conmon[35668]: audit 2022-02-02T18:19:45.351584+0000 mon.smithi096 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.96:0/1650070186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2022-02-02T18:19:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:45 smithi159 conmon[35668]: audit 2022-02-02T18:19:45.709189+0000 mon.smithi096 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.96:0/3085033042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T18:19:46.438 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:19:47.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:47 smithi096 conmon[32067]: audit 2022-02-02T18:19:46.413683+0000 mon.smithi096 (mon.0) 543 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:47.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:47 smithi096 conmon[32067]: audit 2022-02-02T18:19:46. 2022-02-02T18:19:47.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:47 smithi096 conmon[32067]: 416656+0000 mon.smithi096 (mon.0) 544 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:47.500 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:47 smithi096 conmon[32067]: cluster 2022-02-02T18:19:46.802931+0000 mgr.smithi096.shfutl (mgr.14162) 205 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2022-02-02T18:19:47.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:47 smithi159 conmon[35668]: audit 2022-02-02T18:19:46.413683+0000 mon.smithi096 (mon.0) 543 : audit 2022-02-02T18:19:47.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:47 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:47 smithi159 conmon[35668]: audit 2022-02-02T18:19:46.416656+0000 mon.smithi096 (mon.0) 544 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:19:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:47 smithi159 conmon[35668]: cluster 2022-02-02T18:19:46.802931+0000 mgr.smithi096.shfutl (mgr.14162) 205 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2022-02-02T18:19:48.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 -- 172.21.15.96:0/479393834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 msgr2=0x7f24080f9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:48.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 --2- 172.21.15.96:0/479393834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24080f9460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f23fc004660 tx=0x7f23fc009b30).stop 2022-02-02T18:19:48.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 -- 172.21.15.96:0/479393834 shutdown_connections 2022-02-02T18:19:48.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 --2- 172.21.15.96:0/479393834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 0x7f24080fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 --2- 172.21.15.96:0/479393834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24080f9460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 -- 172.21.15.96:0/479393834 >> 172.21.15.96:0/479393834 conn(0x7f24080f0e20 msgr2=0x7f24080f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:48.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 -- 172.21.15.96:0/479393834 shutdown_connections 2022-02-02T18:19:48.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.013+0000 7f240d6ec700 1 -- 172.21.15.96:0/479393834 wait complete. 2022-02-02T18:19:48.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.014+0000 7f240d6ec700 1 Processor -- start 2022-02-02T18:19:48.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.014+0000 7f240d6ec700 1 -- start start 2022-02-02T18:19:48.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:48.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 0x7f2408107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:48.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408107b40 con 0x7f24080607d0 2022-02-02T18:19:48.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408107c80 con 0x7f24080f9950 2022-02-02T18:19:48.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:48.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52332/0 (socket says 172.21.15.96:52332) 2022-02-02T18:19:48.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 -- 172.21.15.96:0/4003447130 learned_addr learned my addr 172.21.15.96:0/4003447130 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:48.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f24067fc700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 0x7f2408107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 -- 172.21.15.96:0/4003447130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 msgr2=0x7f2408107590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 0x7f2408107590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 -- 172.21.15.96:0/4003447130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc005040 con 0x7f24080607d0 2022-02-02T18:19:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f2406ffd700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f23fc009990 tx=0x7f23fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:48.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc018070 con 0x7f24080607d0 2022-02-02T18:19:48.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f23fc013410 con 0x7f24080607d0 2022-02-02T18:19:48.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24081085c0 con 0x7f24080607d0 2022-02-02T18:19:48.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc01c3c0 con 0x7f24080607d0 2022-02-02T18:19:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.015+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2408108b20 con 0x7f24080607d0 2022-02-02T18:19:48.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.016+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2408045ad0 con 0x7f24080607d0 2022-02-02T18:19:48.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.017+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f23fc01d420 con 0x7f24080607d0 2022-02-02T18:19:48.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.017+0000 7f23ef7fe700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 0x7f23f005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:48.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.017+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f23fc077c90 con 0x7f24080607d0 2022-02-02T18:19:48.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.017+0000 7f24067fc700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 0x7f23f005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:48.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.017+0000 7f24067fc700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 0x7f23f005e760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f24080605a0 tx=0x7f23f8009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:48.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.021+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f23fc04a970 con 0x7f24080607d0 2022-02-02T18:19:48.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.208+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24080ff070 con 0x7f24080607d0 2022-02-02T18:19:48.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.208+0000 7f23ef7fe700 1 -- 172.21.15.96:0/4003447130 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f23fc04df90 con 0x7f24080607d0 2022-02-02T18:19:48.213 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2022-02-02T18:19:48.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 msgr2=0x7f23f005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:48.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 0x7f23f005e760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f24080605a0 tx=0x7f23f8009be0).stop 2022-02-02T18:19:48.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 msgr2=0x7f24081070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:48.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f23fc009990 tx=0x7f23fc009b30).stop 2022-02-02T18:19:48.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 shutdown_connections 2022-02-02T18:19:48.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f23f005c2a0 0x7f23f005e760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080607d0 0x7f24081070a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 --2- 172.21.15.96:0/4003447130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f9950 0x7f2408107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:48.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 >> 172.21.15.96:0/4003447130 conn(0x7f24080f0e20 msgr2=0x7f24080f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:48.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 shutdown_connections 2022-02-02T18:19:48.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:48.210+0000 7f240d6ec700 1 -- 172.21.15.96:0/4003447130 wait complete. 2022-02-02T18:19:48.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:48 smithi096 conmon[32067]: audit 2022-02-02T18:19:48.210191+0000 mon.smithi096 (mon.0) 545 : audit [DBG] from='client.? 172.21.15.96:0/4003447130' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T18:19:48.740 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-02-02T18:19:48.741 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-02-02T18:19:48.741 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2022-02-02T18:19:48.741 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-02-02T18:19:48.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:48.742 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-02-02T18:19:48.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-02-02T18:19:48.743 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-02-02T18:19:48.743 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-02-02T18:19:48.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:48.744 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2022-02-02T18:19:48.762 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-02-02T18:19:48.762 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-02-02T18:19:48.763 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2022-02-02T18:19:48.763 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:48.763 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2022-02-02T18:19:48.763 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:48.764 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:48.764 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:48.764 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:48.764 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:48.765 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:48.765 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:48.765 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-02-02T18:19:48.765 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:48.765 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-02-02T18:19:48.766 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42359sec preferred_lft 42359sec 2022-02-02T18:19:48.766 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link noprefixroute 2022-02-02T18:19:48.766 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:48.767 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-02-02T18:19:48.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:48.768 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2022-02-02T18:19:48.768 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2022-02-02T18:19:48.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2022-02-02T18:19:48.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2022-02-02T18:19:48.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2022-02-02T18:19:48.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-02-02T18:19:48.770 DEBUG:teuthology.orchestra.run.smithi096:> ') 2022-02-02T18:19:48.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:48 smithi159 conmon[35668]: audit 2022-02-02T18:19:48.210191+0000 mon.smithi096 (mon.0) 545 : audit [DBG] from='client.? 172.21.15.96:0/4003447130' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T18:19:48.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:48.953 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-02-02T18:19:48.979 INFO:teuthology.orchestra.run.smithi096.stdout:1 2022-02-02T18:19:48.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:48.981 DEBUG:teuthology.orchestra.run.smithi096:> route 2022-02-02T18:19:49.055 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2022-02-02T18:19:49.056 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-02-02T18:19:49.056 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-02-02T18:19:49.056 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-02-02T18:19:49.056 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-02-02T18:19:49.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.057 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2022-02-02T18:19:49.058 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2022-02-02T18:19:49.058 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-02-02T18:19:49.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-02-02T18:19:49.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-02-02T18:19:49.059 DEBUG:teuthology.orchestra.run.smithi096:> ') 2022-02-02T18:19:49.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.375 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2022-02-02T18:19:49.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.391 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2022-02-02T18:19:49.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.447 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2022-02-02T18:19:49.448 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2022-02-02T18:19:49.448 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-02-02T18:19:49.448 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-02-02T18:19:49.449 DEBUG:teuthology.orchestra.run.smithi096:> ') 2022-02-02T18:19:49.539 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-02-02T18:19:49.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.540 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2022-02-02T18:19:49.541 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2022-02-02T18:19:49.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-02-02T18:19:49.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-02-02T18:19:49.542 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-02-02T18:19:49.542 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-02-02T18:19:49.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-02-02T18:19:49.543 DEBUG:teuthology.orchestra.run.smithi096:> ') 2022-02-02T18:19:49.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:49.769 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2022-02-02T18:19:49.769 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2022-02-02T18:19:49.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2022-02-02T18:19:49.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2022-02-02T18:19:49.770 DEBUG:teuthology.orchestra.run.smithi096:> ') 2022-02-02T18:19:49.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T18:19:49.877 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:49.896 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-02-02T18:19:49.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T18:19:49.897 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:49.953 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-02-02T18:19:49.953 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-02-02T18:19:49.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T18:19:50.063 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T18:19:50.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2022-02-02T18:19:50.098 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:49 smithi096 conmon[32067]: cluster 2022-02-02T18:19:48.803282+0000 mgr.smithi096.shfutl (mgr.14162) 206 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2022-02-02T18:19:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T18:19:50.122 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2022-02-02T18:19:50.124 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-02-02T18:19:50.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:50.125 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:50.156 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2022-02-02T18:19:50.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -- ceph fs ls 2022-02-02T18:19:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:49 smithi159 conmon[35668]: cluster 2022-02-02T18:19:48.803282+0000 mgr.smithi096.shfutl (mgr.14162) 206 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2022-02-02T18:19:50.633 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/e1d78c58-8453-11ec-8c35-001a4aab830c/mon.smithi096/config 2022-02-02T18:19:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 -- 172.21.15.96:0/4261032720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 msgr2=0x7f313c0f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 --2- 172.21.15.96:0/4261032720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c0f5ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f3124004660 tx=0x7f3124009b30).stop 2022-02-02T18:19:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 -- 172.21.15.96:0/4261032720 shutdown_connections 2022-02-02T18:19:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 --2- 172.21.15.96:0/4261032720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 0x7f313c0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 --2- 172.21.15.96:0/4261032720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c0f5ae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.034+0000 7f3140eb4700 1 -- 172.21.15.96:0/4261032720 >> 172.21.15.96:0/4261032720 conn(0x7f313c0f0e20 msgr2=0x7f313c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 -- 172.21.15.96:0/4261032720 shutdown_connections 2022-02-02T18:19:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 -- 172.21.15.96:0/4261032720 wait complete. 2022-02-02T18:19:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 Processor -- start 2022-02-02T18:19:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 -- start start 2022-02-02T18:19:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 0x7f313c1075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c107c30 con 0x7f313c0f56c0 2022-02-02T18:19:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.035+0000 7f3140eb4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1084e0 con 0x7f313c0f6960 2022-02-02T18:19:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52348/0 (socket says 172.21.15.96:52348) 2022-02-02T18:19:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 -- 172.21.15.96:0/2077733940 learned_addr learned my addr 172.21.15.96:0/2077733940 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3139d9b700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 0x7f313c1075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 -- 172.21.15.96:0/2077733940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 msgr2=0x7f313c1075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 0x7f313c1075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 -- 172.21.15.96:0/2077733940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124005040 con 0x7f313c0f56c0 2022-02-02T18:19:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f313a59c700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3124009da0 tx=0x7f3124009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3124018070 con 0x7f313c0f56c0 2022-02-02T18:19:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3124007df0 con 0x7f313c0f56c0 2022-02-02T18:19:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c108760 con 0x7f313c0f56c0 2022-02-02T18:19:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f312401d680 con 0x7f313c0f56c0 2022-02-02T18:19:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.036+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c108cc0 con 0x7f313c0f56c0 2022-02-02T18:19:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.037+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c059100 con 0x7f313c0f56c0 2022-02-02T18:19:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.038+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f31240125d0 con 0x7f313c0f56c0 2022-02-02T18:19:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.038+0000 7f3132ffd700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 0x7f312805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.038+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3124077e60 con 0x7f313c0f56c0 2022-02-02T18:19:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.038+0000 7f3139d9b700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 0x7f312805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.038+0000 7f3139d9b700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 0x7f312805e760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f312c00b700 tx=0x7f312c008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.042+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f312404abc0 con 0x7f313c0f56c0 2022-02-02T18:19:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.228+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f313c0fe0b0 con 0x7f313c0f56c0 2022-02-02T18:19:52.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:51 smithi096 conmon[32067]: cluster 2022-02-02T18:19:50.803639+0000 mgr.smithi096.shfutl (mgr.14162) 207 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2022-02-02T18:19:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.229+0000 7f3132ffd700 1 -- 172.21.15.96:0/2077733940 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f313c0fe0b0 con 0x7f313c0f56c0 2022-02-02T18:19:52.234 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2022-02-02T18:19:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 msgr2=0x7f312805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 0x7f312805e760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f312c00b700 tx=0x7f312c008040).stop 2022-02-02T18:19:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 msgr2=0x7f313c107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3124009da0 tx=0x7f3124009b30).stop 2022-02-02T18:19:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 shutdown_connections 2022-02-02T18:19:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f312805c2a0 0x7f312805e760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313c0f56c0 0x7f313c107100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 --2- 172.21.15.96:0/2077733940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f313c0f6960 0x7f313c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 >> 172.21.15.96:0/2077733940 conn(0x7f313c0f0e20 msgr2=0x7f313c05fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 shutdown_connections 2022-02-02T18:19:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:52.230+0000 7f3140eb4700 1 -- 172.21.15.96:0/2077733940 wait complete. 2022-02-02T18:19:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:51 smithi159 conmon[35668]: cluster 2022-02-02T18:19:50.803639+0000 mgr.smithi096.shfutl (mgr.14162) 207 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2022-02-02T18:19:52.835 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-02-02T18:19:52.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-02-02T18:19:52.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2022-02-02T18:19:52.836 INFO:tasks.cephfs.mount:self.client.name = client.1 2022-02-02T18:19:52.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:52.837 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-02-02T18:19:52.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-02-02T18:19:52.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-02-02T18:19:52.838 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2022-02-02T18:19:52.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:52.839 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2022-02-02T18:19:52.859 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-02-02T18:19:52.860 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-02-02T18:19:52.860 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2022-02-02T18:19:52.860 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:52.860 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2022-02-02T18:19:52.861 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:52.861 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:52.861 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:52.861 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:52.861 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:52.862 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T18:19:52.862 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:52.862 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-02-02T18:19:52.862 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2022-02-02T18:19:52.863 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-02-02T18:19:52.863 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42365sec preferred_lft 42365sec 2022-02-02T18:19:52.863 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link noprefixroute 2022-02-02T18:19:52.863 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2022-02-02T18:19:52.864 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-02-02T18:19:52.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:52.864 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2022-02-02T18:19:52.865 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2022-02-02T18:19:52.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2022-02-02T18:19:52.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2022-02-02T18:19:52.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2022-02-02T18:19:52.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-02-02T18:19:52.866 DEBUG:teuthology.orchestra.run.smithi159:> ') 2022-02-02T18:19:53.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.065 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-02-02T18:19:53.093 INFO:teuthology.orchestra.run.smithi159.stdout:1 2022-02-02T18:19:53.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.094 DEBUG:teuthology.orchestra.run.smithi159:> route 2022-02-02T18:19:53.166 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2022-02-02T18:19:53.166 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-02-02T18:19:53.166 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-02-02T18:19:53.167 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-02-02T18:19:53.167 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-02-02T18:19:53.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.168 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2022-02-02T18:19:53.168 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2022-02-02T18:19:53.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-02-02T18:19:53.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-02-02T18:19:53.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-02-02T18:19:53.170 DEBUG:teuthology.orchestra.run.smithi159:> ') 2022-02-02T18:19:53.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:52 smithi096 conmon[32067]: audit 2022-02-02T18:19:52.230516+0000 mon.smithi096 (mon.0 2022-02-02T18:19:53.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:52 smithi096 conmon[32067]: ) 546 : audit [DBG] from='client.? 172.21.15.96:0/2077733940' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T18:19:53.244 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:52 smithi159 conmon[35668]: audit 2022-02-02T18:19:52.230516+0000 mon.smithi096 (mon.0) 546 : audit 2022-02-02T18:19:53.244 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:52 smithi159 conmon[35668]: [DBG] from='client.? 172.21.15.96:0/2077733940' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T18:19:53.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.501 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2022-02-02T18:19:53.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.558 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2022-02-02T18:19:53.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.615 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2022-02-02T18:19:53.616 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2022-02-02T18:19:53.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2022-02-02T18:19:53.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2022-02-02T18:19:53.617 DEBUG:teuthology.orchestra.run.smithi159:> ') 2022-02-02T18:19:53.708 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2022-02-02T18:19:53.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.709 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2022-02-02T18:19:53.709 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2022-02-02T18:19:53.709 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2022-02-02T18:19:53.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-02-02T18:19:53.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2022-02-02T18:19:53.711 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2022-02-02T18:19:53.711 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2022-02-02T18:19:53.711 DEBUG:teuthology.orchestra.run.smithi159:> ') 2022-02-02T18:19:53.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:53.935 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2022-02-02T18:19:53.935 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2022-02-02T18:19:53.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2022-02-02T18:19:53.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2022-02-02T18:19:53.936 DEBUG:teuthology.orchestra.run.smithi159:> ') 2022-02-02T18:19:54.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:53 smithi159 conmon[35668]: cluster 2022-02-02T18:19:52.804311+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:19:54.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:53 smithi159 conmon[35668]: .14162) 208 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2022-02-02T18:19:54.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T18:19:54.062 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.080 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2022-02-02T18:19:54.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T18:19:54.080 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.136 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-02-02T18:19:54.137 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-02-02T18:19:54.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T18:19:54.273 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T18:19:54.273 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2022-02-02T18:19:54.301 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T18:19:54.301 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2022-02-02T18:19:54.306 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-02-02T18:19:54.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T18:19:54.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:53 smithi096 conmon[32067]: cluster 2022-02-02T18:19:52.804311+0000 mgr.smithi096.shfutl (mgr.14162) 208 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2022-02-02T18:19:54.423 INFO:teuthology.run_tasks:Running task print... 2022-02-02T18:19:54.435 INFO:teuthology.task.print:**** done client 2022-02-02T18:19:54.435 INFO:teuthology.run_tasks:Running task parallel... 2022-02-02T18:19:54.463 INFO:teuthology.task.parallel:starting parallel... 2022-02-02T18:19:54.464 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-02-02T18:19:54.464 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-02-02T18:19:54.465 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:19:54.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -e sha1=78571b80ad21c56cce214a3fbfb0b1a080f78167 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2022-02-02T18:19:54.466 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-02-02T18:19:54.466 INFO:teuthology.task.sequential:In sequential, running task workunit... 2022-02-02T18:19:54.470 INFO:tasks.workunit:Pulling workunits from ref 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:19:54.472 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-02-02T18:19:54.472 INFO:tasks.workunit:timeout=3h 2022-02-02T18:19:54.473 INFO:tasks.workunit:cleanup=True 2022-02-02T18:19:54.473 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:54.497 INFO:teuthology.orchestra.run.smithi096.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:54.497 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-02-02T18:19:54.497 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 99h/153d Inode: 1 Links: 2 2022-02-02T18:19:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:19:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:cephfs_t:s0 2022-02-02T18:19:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-02-02T18:19:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2022-02-02 18:19:24.995682444 +0000 2022-02-02T18:19:54.499 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2022-02-02 18:19:50.146752201 +0000 2022-02-02T18:19:54.499 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2022-02-02 18:19:24.995682444 +0000 2022-02-02T18:19:54.499 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-02-02T18:19:54.500 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-02-02T18:19:54.569 DEBUG:teuthology.orchestra.run.smithi159:> stat -- /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.587 INFO:teuthology.orchestra.run.smithi159.stdout: File: /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.588 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2022-02-02T18:19:54.588 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 78h/120d Inode: 1 Links: 3 2022-02-02T18:19:54.588 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T18:19:54.589 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:cephfs_t:s0 2022-02-02T18:19:54.589 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-02-02T18:19:54.589 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-02-02 18:19:54.561650425 +0000 2022-02-02T18:19:54.589 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-02-02 18:19:54.561650425 +0000 2022-02-02T18:19:54.589 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-02-02T18:19:54.590 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2022-02-02T18:19:54.590 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2022-02-02T18:19:54.661 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:19:54.662 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:19:54.679 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-02-02T18:19:54.718 INFO:tasks.workunit.client.1.smithi159.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2022-02-02T18:19:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:55 smithi159 conmon[35668]: cluster 2022-02-02T18:19:54.804692+0000 mgr.smithi096.shfutl (mgr.14162) 209 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2022-02-02T18:19:56.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.298+0000 7f9e5b59e700 1 -- 172.21.15.96:0/3433340089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f77d0 msgr2=0x7f9e5c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:56.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.298+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/3433340089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c0f7c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9e4c004660 tx=0x7f9e4c009b30).stop 2022-02-02T18:19:56.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 -- 172.21.15.96:0/3433340089 shutdown_connections 2022-02-02T18:19:56.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/3433340089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c0f7c30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:56.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/3433340089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:19:56.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 -- 172.21.15.96:0/3433340089 >> 172.21.15.96:0/3433340089 conn(0x7f9e5c0f1c90 msgr2=0x7f9e5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:56.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 -- 172.21.15.96:0/3433340089 shutdown_connections 2022-02-02T18:19:56.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 -- 172.21.15.96:0/3433340089 wait complete. 2022-02-02T18:19:56.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:55 smithi096 conmon[32067]: cluster 2022-02-02T18:19:54.804692+0000 mgr.smithi096.shfutl (mgr.14162) 209 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2022-02-02T18:19:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 Processor -- start 2022-02-02T18:19:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.299+0000 7f9e5b59e700 1 -- start start 2022-02-02T18:19:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c109ae0 con 0x7f9e5c0f6530 2022-02-02T18:19:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c10a390 con 0x7f9e5c0f77d0 2022-02-02T18:19:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52360/0 (socket says 172.21.15.96:52360) 2022-02-02T18:19:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 -- 172.21.15.96:0/4004481058 learned_addr learned my addr 172.21.15.96:0/4004481058 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e59d9b700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 -- 172.21.15.96:0/4004481058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 msgr2=0x7f9e5c1094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c1094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 -- 172.21.15.96:0/4004481058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c005040 con 0x7f9e5c0f6530 2022-02-02T18:19:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e59d9b700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:19:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5a59c700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9e440093f0 tx=0x7f9e44006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e44009ea0 con 0x7f9e5c0f6530 2022-02-02T18:19:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9e44013ad0 con 0x7f9e5c0f6530 2022-02-02T18:19:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c10a670 con 0x7f9e5c0f6530 2022-02-02T18:19:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4400da80 con 0x7f9e5c0f6530 2022-02-02T18:19:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.300+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c10ac30 con 0x7f9e5c0f6530 2022-02-02T18:19:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.301+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c059100 con 0x7f9e5c0f6530 2022-02-02T18:19:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.302+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9e4401a060 con 0x7f9e5c0f6530 2022-02-02T18:19:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.302+0000 7f9e52ffd700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 0x7f9e4805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.302+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9e44075f80 con 0x7f9e5c0f6530 2022-02-02T18:19:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.302+0000 7f9e59d9b700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 0x7f9e4805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.302+0000 7f9e59d9b700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 0x7f9e4805e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9e4c004e30 tx=0x7f9e4c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.306+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9e44048c00 con 0x7f9e5c0f6530 2022-02-02T18:19:56.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.457+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9e5c045ad0 con 0x7f9e5c0f6530 2022-02-02T18:19:56.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.457+0000 7f9e52ffd700 1 -- 172.21.15.96:0/4004481058 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9e4404c220 con 0x7f9e5c0f6530 2022-02-02T18:19:56.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 msgr2=0x7f9e4805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:56.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 0x7f9e4805e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9e4c004e30 tx=0x7f9e4c009b30).stop 2022-02-02T18:19:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 msgr2=0x7f9e5c108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9e440093f0 tx=0x7f9e44006ec0).stop 2022-02-02T18:19:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 shutdown_connections 2022-02-02T18:19:56.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f9e4805c300 0x7f9e4805e7c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:56.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e5c0f6530 0x7f9e5c108fb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:56.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 --2- 172.21.15.96:0/4004481058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e5c0f77d0 0x7f9e5c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:56.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 >> 172.21.15.96:0/4004481058 conn(0x7f9e5c0f1c90 msgr2=0x7f9e5c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:56.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 shutdown_connections 2022-02-02T18:19:56.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:56.459+0000 7f9e5b59e700 1 -- 172.21.15.96:0/4004481058 wait complete. 2022-02-02T18:19:56.920 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -e sha1=78571b80ad21c56cce214a3fbfb0b1a080f78167 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2022-02-02T18:19:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:57 smithi096 conmon[32067]: cluster 2022-02-02T18:19:56.805120+0000 mgr.smithi096.shfutl (mgr.14162) 210 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 938 B/s wr, 5 op/s 2022-02-02T18:19:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:57 smithi159 conmon[35668]: cluster 2022-02-02T18:19:56.805120+0000 mgr.smithi096.shfutl (mgr.14162) 210 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 938 B/s wr, 5 op/s 2022-02-02T18:19:58.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 -- 172.21.15.96:0/2096020152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 msgr2=0x7ff8a80f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:58.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 --2- 172.21.15.96:0/2096020152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a80f6d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff898004660 tx=0x7ff898009b30).stop 2022-02-02T18:19:58.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 -- 172.21.15.96:0/2096020152 shutdown_connections 2022-02-02T18:19:58.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 --2- 172.21.15.96:0/2096020152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 0x7ff8a80f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 --2- 172.21.15.96:0/2096020152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a80f6d00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 -- 172.21.15.96:0/2096020152 >> 172.21.15.96:0/2096020152 conn(0x7ff8a80f2020 msgr2=0x7ff8a80f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:58.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 -- 172.21.15.96:0/2096020152 shutdown_connections 2022-02-02T18:19:58.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.656+0000 7ff8af85d700 1 -- 172.21.15.96:0/2096020152 wait complete. 2022-02-02T18:19:58.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 Processor -- start 2022-02-02T18:19:58.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 -- start start 2022-02-02T18:19:58.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:58.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 0x7ff8a81076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:58.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8107c80 con 0x7ff8a80f68e0 2022-02-02T18:19:58.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8af85d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8107dc0 con 0x7ff8a80f7b80 2022-02-02T18:19:58.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:58.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52368/0 (socket says 172.21.15.96:52368) 2022-02-02T18:19:58.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 -- 172.21.15.96:0/3465185294 learned_addr learned my addr 172.21.15.96:0/3465185294 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:19:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8acdf8700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 0x7ff8a81076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 -- 172.21.15.96:0/3465185294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 msgr2=0x7ff8a81076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 0x7ff8a81076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 -- 172.21.15.96:0/3465185294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898005040 con 0x7ff8a80f68e0 2022-02-02T18:19:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.657+0000 7ff8ad5f9700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7ff898007a60 tx=0x7ff898009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.658+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff898018070 con 0x7ff8a80f68e0 2022-02-02T18:19:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.658+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff898013410 con 0x7ff8a80f68e0 2022-02-02T18:19:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.658+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff89801c620 con 0x7ff8a80f68e0 2022-02-02T18:19:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.658+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a8108700 con 0x7ff8a80f68e0 2022-02-02T18:19:58.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.658+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a8108c60 con 0x7ff8a80f68e0 2022-02-02T18:19:58.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.659+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a8045ad0 con 0x7ff8a80f68e0 2022-02-02T18:19:58.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.659+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff89801d940 con 0x7ff8a80f68e0 2022-02-02T18:19:58.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.659+0000 7ff89dffb700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 0x7ff89405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:19:58.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.660+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff898077e00 con 0x7ff8a80f68e0 2022-02-02T18:19:58.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.660+0000 7ff8acdf8700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 0x7ff89405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:19:58.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.660+0000 7ff8acdf8700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 0x7ff89405e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff8a4007fd0 tx=0x7ff8a4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:19:58.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.663+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff89804aae0 con 0x7ff8a80f68e0 2022-02-02T18:19:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.816+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7ff8a8027ad0 con 0x7ff8a80f68e0 2022-02-02T18:19:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.816+0000 7ff89dffb700 1 -- 172.21.15.96:0/3465185294 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7ff89804e100 con 0x7ff8a80f68e0 2022-02-02T18:19:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 msgr2=0x7ff89405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 0x7ff89405e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff8a4007fd0 tx=0x7ff8a4009040).stop 2022-02-02T18:19:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 msgr2=0x7ff8a81071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:19:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7ff898007a60 tx=0x7ff898009b30).stop 2022-02-02T18:19:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 shutdown_connections 2022-02-02T18:19:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7ff89405c2b0 0x7ff89405e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8a80f68e0 0x7ff8a81071e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 --2- 172.21.15.96:0/3465185294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a80f7b80 0x7ff8a81076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:19:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 >> 172.21.15.96:0/3465185294 conn(0x7ff8a80f2020 msgr2=0x7ff8a80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:19:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 shutdown_connections 2022-02-02T18:19:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:19:58.818+0000 7ff8af85d700 1 -- 172.21.15.96:0/3465185294 wait complete. 2022-02-02T18:19:59.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -e sha1=78571b80ad21c56cce214a3fbfb0b1a080f78167 -- bash -c 'ceph config set global log_to_journald false --force' 2022-02-02T18:20:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:59 smithi096 conmon[32067]: cluster 2022-02-02T18:19:58.805531+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:00.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:19:59 smithi096 conmon[32067]: 14162) 211 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2022-02-02T18:20:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:19:59 smithi159 conmon[35668]: cluster 2022-02-02T18:19:58.805531+0000 mgr.smithi096.shfutl (mgr.14162) 211 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2022-02-02T18:20:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 -- 172.21.15.96:0/1773671640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f55c0 msgr2=0x7fd92c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 --2- 172.21.15.96:0/1773671640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f55c0 0x7fd92c0f59e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fd928004660 tx=0x7fd928009b30).stop 2022-02-02T18:20:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 -- 172.21.15.96:0/1773671640 shutdown_connections 2022-02-02T18:20:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 --2- 172.21.15.96:0/1773671640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f6860 0x7fd92c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:20:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 --2- 172.21.15.96:0/1773671640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f55c0 0x7fd92c0f59e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 -- 172.21.15.96:0/1773671640 >> 172.21.15.96:0/1773671640 conn(0x7fd92c0f0d40 msgr2=0x7fd92c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 -- 172.21.15.96:0/1773671640 shutdown_connections 2022-02-02T18:20:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.112+0000 7fd9333e3700 1 -- 172.21.15.96:0/1773671640 wait complete. 2022-02-02T18:20:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 Processor -- start 2022-02-02T18:20:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 -- start start 2022-02-02T18:20:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 0x7fd92c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c0602b0 con 0x7fd92c0f6860 2022-02-02T18:20:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd9333e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c0603f0 con 0x7fd92c0f55c0 2022-02-02T18:20:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd93097e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd93097e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52378/0 (socket says 172.21.15.96:52378) 2022-02-02T18:20:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.113+0000 7fd93097e700 1 -- 172.21.15.96:0/3171320219 learned_addr learned my addr 172.21.15.96:0/3171320219 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93117f700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 0x7fd92c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93097e700 1 -- 172.21.15.96:0/3171320219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 msgr2=0x7fd92c10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93097e700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 0x7fd92c10c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:01.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93097e700 1 -- 172.21.15.96:0/3171320219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928005040 con 0x7fd92c0f6860 2022-02-02T18:20:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93117f700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 0x7fd92c10c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:20:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd93097e700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fd91c00b410 tx=0x7fd91c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91c0125f0 con 0x7fd92c0f6860 2022-02-02T18:20:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd91c012be0 con 0x7fd92c0f6860 2022-02-02T18:20:01.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92c10ead0 con 0x7fd92c0f6860 2022-02-02T18:20:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91c002a00 con 0x7fd92c0f6860 2022-02-02T18:20:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.114+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92c10efb0 con 0x7fd92c0f6860 2022-02-02T18:20:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.115+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92c045ad0 con 0x7fd92c0f6860 2022-02-02T18:20:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.115+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd91c00f030 con 0x7fd92c0f6860 2022-02-02T18:20:01.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.116+0000 7fd921ffb700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 0x7fd91805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:01.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.116+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd91c076400 con 0x7fd92c0f6860 2022-02-02T18:20:01.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.116+0000 7fd93117f700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 0x7fd91805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:01.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.116+0000 7fd93117f700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 0x7fd91805e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd928004e30 tx=0x7fd928009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:01.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.120+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd91c0490e0 con 0x7fd92c0f6860 2022-02-02T18:20:01.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.270+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fd92c027a00 con 0x7fd92c0f6860 2022-02-02T18:20:01.273 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:00 smithi096 conmon[32067]: cluster 2022-02-02T18:20:00.000144+0000 mon.smithi096 (mon.0) 547 : cluster [INF] overall HEALTH_OK 2022-02-02T18:20:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:00 smithi159 conmon[35668]: cluster 2022-02-02T18:20:00.000144+0000 mon.smithi096 (mon.0) 547 : cluster 2022-02-02T18:20:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:00 smithi159 conmon[35668]: [INF] overall HEALTH_OK 2022-02-02T18:20:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.275+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd91c0490e0 con 0x7fd92c0f6860 2022-02-02T18:20:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.275+0000 7fd921ffb700 1 -- 172.21.15.96:0/3171320219 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd91c04c700 con 0x7fd92c0f6860 2022-02-02T18:20:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.276+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 msgr2=0x7fd91805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.276+0000 7fd9333e3700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 0x7fd91805e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd928004e30 tx=0x7fd928009b30).stop 2022-02-02T18:20:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 msgr2=0x7fd92c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fd91c00b410 tx=0x7fd91c006ef0).stop 2022-02-02T18:20:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 shutdown_connections 2022-02-02T18:20:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd91805c2b0 0x7fd91805e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:01.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd92c0f55c0 0x7fd92c10c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:01.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 --2- 172.21.15.96:0/3171320219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd92c0f6860 0x7fd92c10e5e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:01.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 >> 172.21.15.96:0/3171320219 conn(0x7fd92c0f0d40 msgr2=0x7fd92c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:01.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 shutdown_connections 2022-02-02T18:20:01.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:01.277+0000 7fd9333e3700 1 -- 172.21.15.96:0/3171320219 wait complete. 2022-02-02T18:20:01.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -e sha1=78571b80ad21c56cce214a3fbfb0b1a080f78167 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2022-02-02T18:20:02.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:01 smithi096 conmon[32067]: cluster 2022-02-02T18:20:00.805864+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:20:02.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:01 smithi096 conmon[32067]: ) 212 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2022-02-02T18:20:02.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:01 smithi096 conmon[32067]: audit 2022-02-02T18:20:01.275086+0000 mon.smithi096 (mon.0) 548 : audit [INF] from='client.? 172.21.15.96:0/3171320219' entity='client.admin' 2022-02-02T18:20:02.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:01 smithi096 conmon[32067]: audit 2022-02-02T18:20:01.278340+0000 mon.smithi096 (mon.0) 549 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:02.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:01 smithi096 conmon[32067]: audit 2022-02-02T18:20:01.283350+0000 mon.smithi096 (mon.0) 550 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:01 smithi159 conmon[35668]: cluster 2022-02-02T18:20:00.805864+0000 mgr.smithi096.shfutl (mgr.14162) 212 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2022-02-02T18:20:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:01 smithi159 conmon[35668]: audit 2022-02-02T18:20:01.275086+0000 mon.smithi096 (mon.0) 548 : audit [INF] from='client.? 172.21.15.96:0/3171320219' entity='client.admin' 2022-02-02T18:20:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:01 smithi159 conmon[35668]: audit 2022-02-02T18:20:01.278340+0000 mon.smithi096 (mon.0) 549 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:01 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:20:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:01 smithi159 conmon[35668]: :20:01.283350+0000 mon.smithi096 (mon.0) 550 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1173125348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f6860 msgr2=0x7f99a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1173125348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f6860 0x7f99a00f6cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f998c004660 tx=0x7f998c009b30).stop 2022-02-02T18:20:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1173125348 shutdown_connections 2022-02-02T18:20:03.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1173125348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f6860 0x7f99a00f6cc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:03.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1173125348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f55c0 0x7f99a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:20:03.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1173125348 >> 172.21.15.96:0/1173125348 conn(0x7f99a00f0d40 msgr2=0x7f99a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1173125348 shutdown_connections 2022-02-02T18:20:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1173125348 wait complete. 2022-02-02T18:20:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 Processor -- start 2022-02-02T18:20:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.613+0000 7f99a6cb4700 1 -- start start 2022-02-02T18:20:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a6cb4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a6cb4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 0x7f99a010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a6cb4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00602d0 con 0x7f99a00f55c0 2022-02-02T18:20:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a6cb4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0060410 con 0x7f99a00f6860 2022-02-02T18:20:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52386/0 (socket says 172.21.15.96:52386) 2022-02-02T18:20:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 -- 172.21.15.96:0/1563005804 learned_addr learned my addr 172.21.15.96:0/1563005804 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f999ffff700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 0x7f99a010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 -- 172.21.15.96:0/1563005804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 msgr2=0x7f99a010e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 0x7f99a010e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f99a4a50700 1 -- 172.21.15.96:0/1563005804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c005040 con 0x7f99a00f55c0 2022-02-02T18:20:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.614+0000 7f999ffff700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 0x7f99a010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:20:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f99a4a50700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f99940093f0 tx=0x7f9994006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9994009ea0 con 0x7f99a00f55c0 2022-02-02T18:20:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9994013af0 con 0x7f99a00f55c0 2022-02-02T18:20:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a010eaa0 con 0x7f99a00f55c0 2022-02-02T18:20:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f999400db10 con 0x7f99a00f55c0 2022-02-02T18:20:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.615+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a010efb0 con 0x7f99a00f55c0 2022-02-02T18:20:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.616+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0045ad0 con 0x7f99a00f55c0 2022-02-02T18:20:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.616+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f999401a060 con 0x7f99a00f55c0 2022-02-02T18:20:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.616+0000 7f999d7fa700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 0x7f999005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.617+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9994075e40 con 0x7f99a00f55c0 2022-02-02T18:20:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.617+0000 7f999ffff700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 0x7f999005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.617+0000 7f999ffff700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 0x7f999005e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f998c004e30 tx=0x7f998c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.620+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9994048ba0 con 0x7f99a00f55c0 2022-02-02T18:20:03.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.800+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167", "target": ["mon-mgr", ""]}) v1 -- 0x7f99a0057f10 con 0x7f999005c2b0 2022-02-02T18:20:03.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.805+0000 7f999d7fa700 1 -- 172.21.15.96:0/1563005804 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f99a0057f10 con 0x7f999005c2b0 2022-02-02T18:20:03.808 INFO:teuthology.orchestra.run.smithi096.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:20:03.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 msgr2=0x7f999005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:03.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 0x7f999005e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f998c004e30 tx=0x7f998c009b30).stop 2022-02-02T18:20:03.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 msgr2=0x7f99a010c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:03.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f99940093f0 tx=0x7f9994006ec0).stop 2022-02-02T18:20:03.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 shutdown_connections 2022-02-02T18:20:03.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f999005c2b0 0x7f999005e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:03.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99a00f55c0 0x7f99a010c0b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:03.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 --2- 172.21.15.96:0/1563005804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a00f6860 0x7f99a010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:03.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 >> 172.21.15.96:0/1563005804 conn(0x7f99a00f0d40 msgr2=0x7f99a00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:03.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 shutdown_connections 2022-02-02T18:20:03.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:03.807+0000 7f99a6cb4700 1 -- 172.21.15.96:0/1563005804 wait complete. 2022-02-02T18:20:04.216 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:03 smithi096 conmon[32067]: cluster 2022-02-02T18:20:02.806301+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:20:04.216 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:03 smithi096 conmon[32067]: 213 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2022-02-02T18:20:04.217 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:03 smithi096 conmon[32067]: audit 2022-02-02T18:20:03.805656+0000 mon.smithi096 (mon.0) 551 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:04.217 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:03 smithi096 conmon[32067]: audit 2022-02-02T18:20:03.806101+0000 mon.smithi096 (mon.0) 552 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:04.217 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:03 smithi096 conmon[32067]: audit 2022-02-02T18:20:03.810979+0000 mon.smithi096 (mon.0) 553 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:04.218 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-02-02T18:20:04.219 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2022-02-02T18:20:04.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1d78c58-8453-11ec-8c35-001a4aab830c -e sha1=78571b80ad21c56cce214a3fbfb0b1a080f78167 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done' 2022-02-02T18:20:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:03 smithi159 conmon[35668]: cluster 2022-02-02T18:20:02.806301+0000 mgr.smithi096.shfutl (mgr.14162) 213 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2022-02-02T18:20:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:03 smithi159 conmon[35668]: audit 2022-02-02T18:20:03.805656+0000 mon.smithi096 (mon.0) 551 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:03 smithi159 conmon[35668]: audit 2022-02-02T18:20:03.806101+0000 mon.smithi096 (mon.0) 552 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:03 smithi159 conmon[35668]: audit 2022-02-02T18:20:03.810979+0000 mon.smithi096 (mon.0) 553 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:05.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:04 smithi096 conmon[32067]: audit 2022-02-02T18:20:03.801711+0000 mgr.smithi096.shfutl (mgr.14162) 214 : audit [DBG] 2022-02-02T18:20:05.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:04 smithi096 conmon[32067]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:05.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:04 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:03.802276+0000 mgr.smithi096.shfutl (mgr.14162) 215 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:20:05.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:04 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:03.813913+0000 mgr.smithi096.shfutl (mgr.14162) 216 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:20:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:04 smithi159 conmon[35668]: audit 2022-02-02T18:20:03.801711+0000 mgr.smithi096.shfutl (mgr.14162) 214 : audit [DBG] 2022-02-02T18:20:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:04 smithi159 conmon[35668]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:04 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:03.802276+0000 mgr.smithi096.shfutl (mgr.14162) 215 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:20:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:04 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:03.813913+0000 mgr.smithi096.shfutl (mgr.14162) 216 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:20:06.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 -- 172.21.15.96:0/449073624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 msgr2=0x7f39700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 --2- 172.21.15.96:0/449073624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f39700f6950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3964004660 tx=0x7f3964009b30).stop 2022-02-02T18:20:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 -- 172.21.15.96:0/449073624 shutdown_connections 2022-02-02T18:20:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 --2- 172.21.15.96:0/449073624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 0x7f39700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 --2- 172.21.15.96:0/449073624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f39700f6950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 -- 172.21.15.96:0/449073624 >> 172.21.15.96:0/449073624 conn(0x7f39700f1c90 msgr2=0x7f39700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 -- 172.21.15.96:0/449073624 shutdown_connections 2022-02-02T18:20:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.151+0000 7f3975f19700 1 -- 172.21.15.96:0/449073624 wait complete. 2022-02-02T18:20:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 Processor -- start 2022-02-02T18:20:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 -- start start 2022-02-02T18:20:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 0x7f39701072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39701078f0 con 0x7f39700f6530 2022-02-02T18:20:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.152+0000 7f3975f19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970108100 con 0x7f39700f77d0 2022-02-02T18:20:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52414/0 (socket says 172.21.15.96:52414) 2022-02-02T18:20:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 -- 172.21.15.96:0/2842797090 learned_addr learned my addr 172.21.15.96:0/2842797090 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f396ffff700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 0x7f39701072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 -- 172.21.15.96:0/2842797090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 msgr2=0x7f39701072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 0x7f39701072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 -- 172.21.15.96:0/2842797090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964005040 con 0x7f39700f6530 2022-02-02T18:20:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3974f17700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f3964013a70 tx=0x7f3964009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3964018070 con 0x7f39700f6530 2022-02-02T18:20:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3970108320 con 0x7f39700f6530 2022-02-02T18:20:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39640097d0 con 0x7f39700f6530 2022-02-02T18:20:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396401de80 con 0x7f39700f6530 2022-02-02T18:20:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.153+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970108880 con 0x7f39700f6530 2022-02-02T18:20:06.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.154+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3970059100 con 0x7f39700f6530 2022-02-02T18:20:06.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.155+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f396401c4e0 con 0x7f39700f6530 2022-02-02T18:20:06.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.155+0000 7f396d7fa700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 0x7f396005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.155+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3964077b50 con 0x7f39700f6530 2022-02-02T18:20:06.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.155+0000 7f396ffff700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 0x7f396005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.156+0000 7f396ffff700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 0x7f396005e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f395c004c40 tx=0x7f395c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.161+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f396404a830 con 0x7f39700f6530 2022-02-02T18:20:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:05 smithi159 conmon[35668]: cluster 2022-02-02T18:20:04.806651+0000 mgr.smithi096.shfutl (mgr.14162) 217 : cluster [DBG] 2022-02-02T18:20:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:05 smithi159 conmon[35668]: pgmap v176: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2022-02-02T18:20:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:05 smithi096 conmon[32067]: cluster 2022-02-02T18:20:04.806651+0000 mgr.smithi096.shfutl (mgr.14162) 217 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2022-02-02T18:20:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.377+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39700fed60 con 0x7f396005c300 2022-02-02T18:20:06.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.378+0000 7f396d7fa700 1 -- 172.21.15.96:0/2842797090 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f39700fed60 con 0x7f396005c300 2022-02-02T18:20:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 msgr2=0x7f396005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 0x7f396005e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f395c004c40 tx=0x7f395c00b040).stop 2022-02-02T18:20:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 msgr2=0x7f3970106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f3964013a70 tx=0x7f3964009b30).stop 2022-02-02T18:20:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 shutdown_connections 2022-02-02T18:20:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f396005c300 0x7f396005e7c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39700f6530 0x7f3970106e00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 --2- 172.21.15.96:0/2842797090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39700f77d0 0x7f39701072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 >> 172.21.15.96:0/2842797090 conn(0x7f39700f1c90 msgr2=0x7f39700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:06.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 shutdown_connections 2022-02-02T18:20:06.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.381+0000 7f3975f19700 1 -- 172.21.15.96:0/2842797090 wait complete. 2022-02-02T18:20:06.394 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:20:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 -- 172.21.15.96:0/2149015581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f57e0 msgr2=0x7fa5180f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 --2- 172.21.15.96:0/2149015581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f57e0 0x7fa5180f5c60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa50c004660 tx=0x7fa50c009b30).stop 2022-02-02T18:20:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 -- 172.21.15.96:0/2149015581 shutdown_connections 2022-02-02T18:20:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 --2- 172.21.15.96:0/2149015581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f57e0 0x7fa5180f5c60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 --2- 172.21.15.96:0/2149015581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f6ad0 0x7fa5180f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 -- 172.21.15.96:0/2149015581 >> 172.21.15.96:0/2149015581 conn(0x7fa5180f0330 msgr2=0x7fa5180f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 -- 172.21.15.96:0/2149015581 shutdown_connections 2022-02-02T18:20:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.495+0000 7fa51da55700 1 -- 172.21.15.96:0/2149015581 wait complete. 2022-02-02T18:20:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 Processor -- start 2022-02-02T18:20:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 -- start start 2022-02-02T18:20:06.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f57e0 0x7fa518105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518106770 con 0x7fa5180f6ad0 2022-02-02T18:20:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa51da55700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518106f70 con 0x7fa5180f57e0 2022-02-02T18:20:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa5167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa5167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52426/0 (socket says 172.21.15.96:52426) 2022-02-02T18:20:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa5167fc700 1 -- 172.21.15.96:0/104097874 learned_addr learned my addr 172.21.15.96:0/104097874 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.496+0000 7fa516ffd700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f57e0 0x7fa518105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa5167fc700 1 -- 172.21.15.96:0/104097874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f57e0 msgr2=0x7fa518105cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa5167fc700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f57e0 0x7fa518105cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa5167fc700 1 -- 172.21.15.96:0/104097874 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c005040 con 0x7fa5180f6ad0 2022-02-02T18:20:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa5167fc700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa50c009da0 tx=0x7fa50c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c007d70 con 0x7fa5180f6ad0 2022-02-02T18:20:06.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa518107190 con 0x7fa5180f6ad0 2022-02-02T18:20:06.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa50c01b930 con 0x7fa5180f6ad0 2022-02-02T18:20:06.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c01a6b0 con 0x7fa5180f6ad0 2022-02-02T18:20:06.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.497+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa518107640 con 0x7fa5180f6ad0 2022-02-02T18:20:06.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.498+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa518045ad0 con 0x7fa5180f6ad0 2022-02-02T18:20:06.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.498+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa50c01baa0 con 0x7fa5180f6ad0 2022-02-02T18:20:06.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.499+0000 7fa4ff7fe700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 0x7fa50005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.499+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa50c07a060 con 0x7fa5180f6ad0 2022-02-02T18:20:06.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.499+0000 7fa516ffd700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 0x7fa50005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.499+0000 7fa516ffd700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 0x7fa50005e7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa508007fd0 tx=0x7fa508009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.503+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa50c04cd40 con 0x7fa5180f6ad0 2022-02-02T18:20:06.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.739+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5180f46d0 con 0x7fa50005c2f0 2022-02-02T18:20:06.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.748+0000 7fa4ff7fe700 1 -- 172.21.15.96:0/104097874 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7fa5180f46d0 con 0x7fa50005c2f0 2022-02-02T18:20:06.751 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T18:20:06.751 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3m) 20s ago 4m 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:20:06.752 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4m) 20s ago 4m 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:20:06.752 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4m) 24s ago 4m 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:20:06.752 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3m) 20s ago 4m 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:20:06.752 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (35s) 20s ago 34s 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:20:06.752 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (40s) 20s ago 39s 16.2.4 8d91d370c2b8 02d535f62526 2022-02-02T18:20:06.753 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (38s) 24s ago 37s 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:20:06.753 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (42s) 24s ago 42s 16.2.4 8d91d370c2b8 1be2a63e320d 2022-02-02T18:20:06.753 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (5m) 20s ago 5m 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:20:06.753 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4m) 24s ago 4m 16.2.4 8d91d370c2b8 744df187ddef 2022-02-02T18:20:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (5m) 20s ago 5m 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:20:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3m) 24s ago 3m 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:20:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4m) 20s ago 4m 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:20:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3m) 24s ago 3m 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:20:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:20:06.755 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:20:06.755 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:20:06.755 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:20:06.755 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:20:06.755 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (113s) 24s ago 113s 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:20:06.756 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3m) 20s ago 4m 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:20:06.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 msgr2=0x7fa50005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 0x7fa50005e7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa508007fd0 tx=0x7fa508009040).stop 2022-02-02T18:20:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 msgr2=0x7fa5181061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa50c009da0 tx=0x7fa50c009b30).stop 2022-02-02T18:20:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 shutdown_connections 2022-02-02T18:20:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa50005c2f0 0x7fa50005e7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f57e0 0x7fa518105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 --2- 172.21.15.96:0/104097874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f6ad0 0x7fa5181061c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 >> 172.21.15.96:0/104097874 conn(0x7fa5180f0330 msgr2=0x7fa5180fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:06.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 shutdown_connections 2022-02-02T18:20:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.750+0000 7fa51da55700 1 -- 172.21.15.96:0/104097874 wait complete. 2022-02-02T18:20:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 -- 172.21.15.96:0/2967850763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 msgr2=0x7fc8440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 --2- 172.21.15.96:0/2967850763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc8440f6950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fc834004660 tx=0x7fc834009b30).stop 2022-02-02T18:20:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 -- 172.21.15.96:0/2967850763 shutdown_connections 2022-02-02T18:20:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 --2- 172.21.15.96:0/2967850763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 --2- 172.21.15.96:0/2967850763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc8440f6950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 -- 172.21.15.96:0/2967850763 >> 172.21.15.96:0/2967850763 conn(0x7fc8440f1c90 msgr2=0x7fc8440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 -- 172.21.15.96:0/2967850763 shutdown_connections 2022-02-02T18:20:06.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.861+0000 7fc8489a0700 1 -- 172.21.15.96:0/2967850763 wait complete. 2022-02-02T18:20:06.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 Processor -- start 2022-02-02T18:20:06.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 -- start start 2022-02-02T18:20:06.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8441072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441078c0 con 0x7fc8440f6530 2022-02-02T18:20:06.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc8489a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844108100 con 0x7fc8440f77d0 2022-02-02T18:20:06.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52434/0 (socket says 172.21.15.96:52434) 2022-02-02T18:20:06.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 -- 172.21.15.96:0/1485482418 learned_addr learned my addr 172.21.15.96:0/1485482418 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:06.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc84259c700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8441072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 -- 172.21.15.96:0/1485482418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 msgr2=0x7fc8441072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:06.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8441072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:06.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc842d9d700 1 -- 172.21.15.96:0/1485482418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834005040 con 0x7fc8440f6530 2022-02-02T18:20:06.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.862+0000 7fc84259c700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8441072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:20:06.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc842d9d700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc834013a70 tx=0x7fc834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc834018070 con 0x7fc8440f6530 2022-02-02T18:20:06.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc8340097d0 con 0x7fc8440f6530 2022-02-02T18:20:06.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844108380 con 0x7fc8440f6530 2022-02-02T18:20:06.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc844108860 con 0x7fc8440f6530 2022-02-02T18:20:06.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.863+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc83401c3c0 con 0x7fc8440f6530 2022-02-02T18:20:06.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.864+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc824004fa0 con 0x7fc8440f6530 2022-02-02T18:20:06.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.864+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc834007ba0 con 0x7fc8440f6530 2022-02-02T18:20:06.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.864+0000 7fc82b7fe700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 0x7fc82c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:06.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.865+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc834077af0 con 0x7fc8440f6530 2022-02-02T18:20:06.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.865+0000 7fc84259c700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 0x7fc82c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:06.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.865+0000 7fc84259c700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 0x7fc82c05e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc838009fd0 tx=0x7fc83800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:06.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:06.870+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc83404a850 con 0x7fc8440f6530 2022-02-02T18:20:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:06 smithi096 conmon[32067]: audit 2022-02-02T18:20:06.379013+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:06 smithi096 conmon[32067]: 14162) 218 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:06 smithi096 conmon[32067]: audit 2022-02-02T18:20:06.740767+0000 mgr.smithi096.shfutl (mgr.14162) 219 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:06 smithi096 conmon[32067]: cluster 2022-02-02T18:20:06.807200+0000 mgr.smithi096.shfutl (mgr.14162) 220 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2022-02-02T18:20:07.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.150+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc824005e80 con 0x7fc8440f6530 2022-02-02T18:20:07.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.151+0000 7fc82b7fe700 1 -- 172.21.15.96:0/1485482418 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fc83404de70 con 0x7fc8440f6530 2022-02-02T18:20:07.155 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:20:07.155 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:20:07.155 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:20:07.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:07.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:20:07.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:20:07.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:07.156 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:20:07.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:20:07.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:07.157 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:20:07.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:20:07.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:07.158 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:20:07.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T18:20:07.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:20:07.158 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:20:07.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.152+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 msgr2=0x7fc82c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.152+0000 7fc8489a0700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 0x7fc82c05e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc838009fd0 tx=0x7fc83800b040).stop 2022-02-02T18:20:07.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.152+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 msgr2=0x7fc844106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.152+0000 7fc8489a0700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc834013a70 tx=0x7fc834009b30).stop 2022-02-02T18:20:07.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 shutdown_connections 2022-02-02T18:20:07.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fc82c05c300 0x7fc82c05e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8440f6530 0x7fc844106dd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 --2- 172.21.15.96:0/1485482418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8440f77d0 0x7fc8441072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 >> 172.21.15.96:0/1485482418 conn(0x7fc8440f1c90 msgr2=0x7fc8440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 shutdown_connections 2022-02-02T18:20:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.153+0000 7fc8489a0700 1 -- 172.21.15.96:0/1485482418 wait complete. 2022-02-02T18:20:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 -- 172.21.15.96:0/2000892510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f6530 msgr2=0x7f72880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 --2- 172.21.15.96:0/2000892510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f6530 0x7f72880f6950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7284004660 tx=0x7f7284009b30).stop 2022-02-02T18:20:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 -- 172.21.15.96:0/2000892510 shutdown_connections 2022-02-02T18:20:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 --2- 172.21.15.96:0/2000892510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f77d0 0x7f72880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 --2- 172.21.15.96:0/2000892510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f6530 0x7f72880f6950 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.263+0000 7f728e6fe700 1 -- 172.21.15.96:0/2000892510 >> 172.21.15.96:0/2000892510 conn(0x7f72880f1c90 msgr2=0x7f72880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 -- 172.21.15.96:0/2000892510 shutdown_connections 2022-02-02T18:20:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 -- 172.21.15.96:0/2000892510 wait complete. 2022-02-02T18:20:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 Processor -- start 2022-02-02T18:20:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 -- start start 2022-02-02T18:20:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f6530 0x7f7288106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72881078f0 con 0x7f72880f77d0 2022-02-02T18:20:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.264+0000 7f728e6fe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288108100 con 0x7f72880f6530 2022-02-02T18:20:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52444/0 (socket says 172.21.15.96:52444) 2022-02-02T18:20:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 -- 172.21.15.96:0/349066626 learned_addr learned my addr 172.21.15.96:0/349066626 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728d6fc700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f6530 0x7f7288106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 -- 172.21.15.96:0/349066626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f6530 msgr2=0x7f7288106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f6530 0x7f7288106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 -- 172.21.15.96:0/349066626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284005040 con 0x7f72880f77d0 2022-02-02T18:20:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728cefb700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f727800c790 tx=0x7f7278007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7278002590 con 0x7f72880f77d0 2022-02-02T18:20:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7278002ba0 con 0x7f72880f77d0 2022-02-02T18:20:07.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288108380 con 0x7f72880f77d0 2022-02-02T18:20:07.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.265+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7278013d90 con 0x7f72880f77d0 2022-02-02T18:20:07.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.266+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288108940 con 0x7f72880f77d0 2022-02-02T18:20:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.267+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7288059100 con 0x7f72880f77d0 2022-02-02T18:20:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.267+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f727801a060 con 0x7f72880f77d0 2022-02-02T18:20:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.267+0000 7f727dffb700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 0x7f727405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:07.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.268+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7278076060 con 0x7f72880f77d0 2022-02-02T18:20:07.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.268+0000 7f728d6fc700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 0x7f727405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:07.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.268+0000 7f728d6fc700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 0x7f727405e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7288106b70 tx=0x7f7284009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:07.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:06 smithi159 conmon[35668]: audit 2022-02-02T18:20:06.379013+0000 mgr.smithi096.shfutl (mgr.14162) 218 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:07.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:06 smithi159 conmon[35668]: 2022-02-02T18:20:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:06 smithi159 conmon[35668]: audit 2022-02-02T18:20:06.740767+0000 mgr.smithi096.shfutl (mgr.14162) 219 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:06 smithi159 conmon[35668]: cluster 2022-02-02T18:20:06.807200+0000 mgr.smithi096.shfutl (mgr.14162) 220 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2022-02-02T18:20:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.273+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7278048d60 con 0x7f72880f77d0 2022-02-02T18:20:07.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.500+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72880fede0 con 0x7f72880f77d0 2022-02-02T18:20:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.501+0000 7f727dffb700 1 -- 172.21.15.96:0/349066626 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1621 (secure 0 0 0) 0x7f727804c380 con 0x7f72880f77d0 2022-02-02T18:20:07.504 INFO:teuthology.orchestra.run.smithi096.stdout:e15 2022-02-02T18:20:07.505 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:20:07.505 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:20:07.505 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:20:07.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:07.505 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:20:07.506 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:20:07.506 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 15 2022-02-02T18:20:07.506 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:20:07.506 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:20:07.507 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:19:40.031738+0000 2022-02-02T18:20:07.507 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:20:07.507 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:20:07.507 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:20:07.508 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:20:07.508 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:20:07.508 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:20:07.508 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:20:07.508 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:20:07.509 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:20:07.509 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:20:07.509 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:20:07.509 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:20:07.510 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:20:07.510 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:20:07.510 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:20:07.510 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:20:07.510 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:20:07.511 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:20:07.511 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:20:07.511 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:20:07.511 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:20:07.512 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:20:07.512 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:20:07.512 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:20:07.512 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:07.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.503+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 msgr2=0x7f727405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.503+0000 7f728e6fe700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 0x7f727405e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7288106b70 tx=0x7f7284009b30).stop 2022-02-02T18:20:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.503+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 msgr2=0x7f72881072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:07.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.503+0000 7f728e6fe700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f727800c790 tx=0x7f7278007d70).stop 2022-02-02T18:20:07.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.503+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 shutdown_connections 2022-02-02T18:20:07.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f727405c2f0 0x7f727405e7b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72880f6530 0x7f7288106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 --2- 172.21.15.96:0/349066626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72880f77d0 0x7f72881072f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 >> 172.21.15.96:0/349066626 conn(0x7f72880f1c90 msgr2=0x7f72880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 shutdown_connections 2022-02-02T18:20:07.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:07.504+0000 7f728e6fe700 1 -- 172.21.15.96:0/349066626 wait complete. 2022-02-02T18:20:07.517 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 15 2022-02-02T18:20:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:07 smithi159 conmon[35668]: audit 2022-02-02T18:20:07.151419+0000 mon.smithi096 (mon.0) 554 : audit [DBG] from='client.? 172.21.15.96:0/1485482418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:20:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:07 smithi159 conmon[35668]: 2022-02-02T18:20:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:07 smithi159 conmon[35668]: audit 2022-02-02T18:20:07.501690+0000 mon.smithi096 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.96:0/349066626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:20:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:07 smithi096 conmon[32067]: audit 2022-02-02T18:20:07.151419+0000 mon.smithi096 (mon.0 2022-02-02T18:20:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:07 smithi096 conmon[32067]: ) 554 : audit [DBG] from='client.? 172.21.15.96:0/1485482418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:20:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:07 smithi096 conmon[32067]: audit 2022-02-02T18:20:07.501690+0000 mon.smithi096 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.96:0/349066626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:20:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:09 smithi159 conmon[35668]: cluster 2022-02-02T18:20:08.807619+0000 mgr.smithi096.shfutl (mgr.14162) 221 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2022-02-02T18:20:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:09 smithi096 conmon[32067]: cluster 2022-02-02T18:20:08.807619+0000 mgr.smithi096.shfutl (mgr.14162) 221 : 2022-02-02T18:20:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:09 smithi096 conmon[32067]: cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2022-02-02T18:20:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:11 smithi159 conmon[35668]: cluster 2022-02-02T18:20:10.808046+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:20:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:11 smithi159 conmon[35668]: 222 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2022-02-02T18:20:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:11 smithi096 conmon[32067]: cluster 2022-02-02T18:20:10.808046 2022-02-02T18:20:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:11 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 222 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2022-02-02T18:20:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:13 smithi159 conmon[35668]: cluster 2022-02-02T18:20:12.808623+0000 mgr.smithi096.shfutl (mgr.14162) 223 2022-02-02T18:20:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:13 smithi159 conmon[35668]: : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2022-02-02T18:20:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:13 smithi096 conmon[32067]: cluster 2022-02-02T18:20:12.808623+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:13 smithi096 conmon[32067]: 14162) 223 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2022-02-02T18:20:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:15 smithi159 conmon[35668]: cluster 2022-02-02T18:20:14 2022-02-02T18:20:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:15 smithi159 conmon[35668]: .808979+0000 mgr.smithi096.shfutl (mgr.14162) 224 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:15 smithi159 conmon[35668]: audit 2022-02-02T18:20:15.097205+0000 mon.smithi096 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:20:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:15 smithi159 conmon[35668]: audit 2022-02-02T18:20:15.097469+0000 mon.smithi096 (mon.0) 557 : audit [INF] 2022-02-02T18:20:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:15 smithi159 conmon[35668]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:20:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:15 smithi096 conmon[32067]: cluster 2022-02-02T18:20:14.808979+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:20:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:15 smithi096 conmon[32067]: .14162) 224 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:15 smithi096 conmon[32067]: audit 2022-02-02T18:20:15.097205+0000 mon.smithi096 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:20:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:15 smithi096 conmon[32067]: audit 2022-02-02T18:20:15.097469+0000 mon.smithi096 (mon 2022-02-02T18:20:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:15 smithi096 conmon[32067]: .0) 557 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:20:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:17 smithi159 conmon[35668]: cluster 2022-02-02T18:20:16.809489+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:20:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:17 smithi159 conmon[35668]: ) 225 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:18.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:17 smithi096 conmon[32067]: cluster 2022-02-02T18:20:16.809489+0000 2022-02-02T18:20:18.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:17 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 225 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:19 smithi159 conmon[35668]: cluster 2022-02-02T18:20:18.809834+0000 mgr.smithi096.shfutl (mgr.14162) 226 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:19 smithi159 conmon[35668]: 2022-02-02T18:20:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:19 smithi096 conmon[32067]: cluster 2022-02-02T18:20:18.809834 2022-02-02T18:20:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:19 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 226 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:21 smithi159 conmon[35668]: cluster 2022-02-02T18:20:20.810192+0000 mgr.smithi096.shfutl (mgr.14162) 227 : cluster 2022-02-02T18:20:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:21 smithi159 conmon[35668]: [DBG] pgmap v184: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:21 smithi096 conmon[32067]: cluster 2022-02-02T18:20:20.810192+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:20:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:21 smithi096 conmon[32067]: ) 227 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:23.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:22 smithi096 conmon[32067]: cluster 2022-02-02T18:20:22.810638+0000 mgr.smithi096.shfutl ( 2022-02-02T18:20:23.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:22 smithi096 conmon[32067]: mgr.14162) 228 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:22 smithi159 conmon[35668]: cluster 2022-02-02T18:20:22.810638+0000 mgr.smithi096.shfutl (mgr.14162) 228 : cluster [DBG] 2022-02-02T18:20:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:22 smithi159 conmon[35668]: pgmap v185: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:25 smithi159 conmon[35668]: cluster 2022-02-02T18:20:24.811049+0000 2022-02-02T18:20:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:25 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 229 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:25 smithi096 conmon[32067]: cluster 2022-02-02T18:20:24.811049+0000 2022-02-02T18:20:26.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:25 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 229 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:27 smithi159 conmon[35668]: cluster 2022-02-02T18:20:26.811593+0000 mgr.smithi096.shfutl 2022-02-02T18:20:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:27 smithi159 conmon[35668]: (mgr.14162) 230 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:27 smithi096 conmon[32067]: cluster 2022-02-02T 2022-02-02T18:20:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:27 smithi096 conmon[32067]: 18:20:26.811593+0000 mgr.smithi096.shfutl (mgr.14162) 230 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2022-02-02T18:20:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:29 smithi159 conmon[35668]: cluster 2022-02-02T18:20:28.812016+0000 2022-02-02T18:20:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:29 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 231 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:29 smithi096 conmon[32067]: cluster 2022-02-02T18:20:28.812016 2022-02-02T18:20:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:29 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 231 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:31 smithi159 conmon[35668]: cluster 2022-02-02T18:20:30.812420+0000 2022-02-02T18:20:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:31 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 232 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:31 smithi096 conmon[32067]: cluster 2022-02-02T18:20:30.812420+0000 mgr.smithi096.shfutl 2022-02-02T18:20:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:31 smithi096 conmon[32067]: (mgr.14162) 232 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2022-02-02T18:20:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:33 smithi159 conmon[35668]: cluster 2022-02-02T18:20:32.812960+0000 2022-02-02T18:20:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:33 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 233 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2022-02-02T18:20:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:33 smithi096 conmon[32067]: cluster 2022-02-02T18:20:32.812960+0000 mgr.smithi096.shfutl (mgr.14162) 233 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2022-02-02T18:20:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:35 smithi159 conmon[35668]: cluster 2022-02-02T18:20:34.813377+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:20:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:35 smithi159 conmon[35668]: ) 234 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2022-02-02T18:20:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:35 smithi096 conmon[32067]: cluster 2022-02-02T18:20:34.813377+0000 mgr.smithi096.shfutl 2022-02-02T18:20:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:35 smithi096 conmon[32067]: (mgr.14162) 234 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2022-02-02T18:20:37.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.644+0000 7f3301eae700 1 -- 172.21.15.96:0/4208586883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 msgr2=0x7f32fc0f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:37.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 --2- 172.21.15.96:0/4208586883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 0x7f32fc0f5e70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f32f40099e0 tx=0x7f32f4004d10).stop 2022-02-02T18:20:37.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 -- 172.21.15.96:0/4208586883 shutdown_connections 2022-02-02T18:20:37.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 --2- 172.21.15.96:0/4208586883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc0f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:37.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 --2- 172.21.15.96:0/4208586883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 0x7f32fc0f5e70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:37.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 -- 172.21.15.96:0/4208586883 >> 172.21.15.96:0/4208586883 conn(0x7f32fc0f04c0 msgr2=0x7f32fc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:37.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 -- 172.21.15.96:0/4208586883 shutdown_connections 2022-02-02T18:20:37.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 -- 172.21.15.96:0/4208586883 wait complete. 2022-02-02T18:20:37.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.645+0000 7f3301eae700 1 Processor -- start 2022-02-02T18:20:37.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f3301eae700 1 -- start start 2022-02-02T18:20:37.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f3301eae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:37.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f3301eae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 0x7f32fc1273d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:37.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f3301eae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc127980 con 0x7f32fc0f5a50 2022-02-02T18:20:37.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f3301eae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc127ac0 con 0x7f32fc0f47a0 2022-02-02T18:20:37.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:37.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56556/0 (socket says 172.21.15.96:56556) 2022-02-02T18:20:37.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.646+0000 7f32fb7fe700 1 -- 172.21.15.96:0/914330575 learned_addr learned my addr 172.21.15.96:0/914330575 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:37.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32fb7fe700 1 -- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 msgr2=0x7f32fc1273d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:20:37.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32fb7fe700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 0x7f32fc1273d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:20:37.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32fb7fe700 1 -- 172.21.15.96:0/914330575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009640 con 0x7f32fc0f47a0 2022-02-02T18:20:37.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32fb7fe700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f32f400b3b0 tx=0x7f32f4004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:37.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f400e070 con 0x7f32fc0f47a0 2022-02-02T18:20:37.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32f4007dc0 con 0x7f32fc0f47a0 2022-02-02T18:20:37.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f4018070 con 0x7f32fc0f47a0 2022-02-02T18:20:37.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc128400 con 0x7f32fc0f47a0 2022-02-02T18:20:37.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.647+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc128960 con 0x7f32fc0f47a0 2022-02-02T18:20:37.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.649+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f32f4024060 con 0x7f32fc0f47a0 2022-02-02T18:20:37.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.649+0000 7f32ebfff700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 0x7f32e005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:37.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.649+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f32f40786a0 con 0x7f32fc0f47a0 2022-02-02T18:20:37.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.650+0000 7f32faffd700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 0x7f32e005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:37.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.650+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc045ad0 con 0x7f32fc0f47a0 2022-02-02T18:20:37.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.650+0000 7f32faffd700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 0x7f32e005e760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f32f0009e20 tx=0x7f32f001c040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:37.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.655+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f32f404b2c0 con 0x7f32fc0f47a0 2022-02-02T18:20:37.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.884+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32fc11ed20 con 0x7f32e005c2a0 2022-02-02T18:20:37.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.885+0000 7f32ebfff700 1 -- 172.21.15.96:0/914330575 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f32fc11ed20 con 0x7f32e005c2a0 2022-02-02T18:20:37.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.887+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 msgr2=0x7f32e005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:37.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.887+0000 7f3301eae700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 0x7f32e005e760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f32f0009e20 tx=0x7f32f001c040).stop 2022-02-02T18:20:37.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.887+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 msgr2=0x7f32fc126ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:37.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.887+0000 7f3301eae700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f32f400b3b0 tx=0x7f32f4004d10).stop 2022-02-02T18:20:37.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 shutdown_connections 2022-02-02T18:20:37.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f32e005c2a0 0x7f32e005e760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:37.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32fc0f47a0 0x7f32fc126ee0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:37.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 --2- 172.21.15.96:0/914330575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32fc0f5a50 0x7f32fc1273d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:20:37.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 >> 172.21.15.96:0/914330575 conn(0x7f32fc0f04c0 msgr2=0x7f32fc0f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:37.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 shutdown_connections 2022-02-02T18:20:37.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:37.888+0000 7f3301eae700 1 -- 172.21.15.96:0/914330575 wait complete. 2022-02-02T18:20:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:20:38.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 -- 172.21.15.96:0/3447460916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 msgr2=0x7f38e00f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 --2- 172.21.15.96:0/3447460916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e00f4a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f38d4004660 tx=0x7f38d4009b30).stop 2022-02-02T18:20:38.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 -- 172.21.15.96:0/3447460916 shutdown_connections 2022-02-02T18:20:38.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 --2- 172.21.15.96:0/3447460916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e00f4a80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 --2- 172.21.15.96:0/3447460916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 0x7f38e00f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 -- 172.21.15.96:0/3447460916 >> 172.21.15.96:0/3447460916 conn(0x7f38e00f0320 msgr2=0x7f38e00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:38.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.006+0000 7f38df59e700 1 -- 172.21.15.96:0/3447460916 shutdown_connections 2022-02-02T18:20:38.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.007+0000 7f38df59e700 1 -- 172.21.15.96:0/3447460916 wait complete. 2022-02-02T18:20:38.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.007+0000 7f38df59e700 1 Processor -- start 2022-02-02T18:20:38.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.007+0000 7f38df59e700 1 -- start start 2022-02-02T18:20:38.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.007+0000 7f38df59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38df59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 0x7f38e010d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38df59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e010de30 con 0x7f38e00f4600 2022-02-02T18:20:38.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38df59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e010df70 con 0x7f38e00f58b0 2022-02-02T18:20:38.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52460/0 (socket says 172.21.15.96:52460) 2022-02-02T18:20:38.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38de59c700 1 -- 172.21.15.96:0/4127782293 learned_addr learned my addr 172.21.15.96:0/4127782293 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:38.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.008+0000 7f38de59c700 1 -- 172.21.15.96:0/4127782293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 msgr2=0x7f38e010d880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:20:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38ddd9b700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 0x7f38e010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38de59c700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 0x7f38e010d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38de59c700 1 -- 172.21.15.96:0/4127782293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4005040 con 0x7f38e00f4600 2022-02-02T18:20:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38de59c700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f38d00026d0 tx=0x7f38d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d0009320 con 0x7f38e00f4600 2022-02-02T18:20:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e010e910 con 0x7f38e00f4600 2022-02-02T18:20:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e010eed0 con 0x7f38e00f4600 2022-02-02T18:20:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38d000f040 con 0x7f38e00f4600 2022-02-02T18:20:38.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.009+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d00147e0 con 0x7f38e00f4600 2022-02-02T18:20:38.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.011+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f38d0014a50 con 0x7f38e00f4600 2022-02-02T18:20:38.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.011+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c4004fa0 con 0x7f38e00f4600 2022-02-02T18:20:38.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.011+0000 7f38ceffd700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 0x7f38c805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.011+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f38d00764b0 con 0x7f38e00f4600 2022-02-02T18:20:38.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.011+0000 7f38ddd9b700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 0x7f38c805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.012+0000 7f38ddd9b700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 0x7f38c805e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f38d4009da0 tx=0x7f38d4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.016+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f38d0049210 con 0x7f38e00f4600 2022-02-02T18:20:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:37 smithi159 conmon[35668]: cluster 2022-02-02T18:20:36.813897+0000 mgr.smithi096.shfutl (mgr.14162) 235 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2022-02-02T18:20:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:37 smithi096 conmon[32067]: cluster 2022-02-02T18:20:36.813897+0000 mgr.smithi096.shfutl (mgr.14162) 235 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2022-02-02T18:20:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.375+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f38c4000bc0 con 0x7f38c805c300 2022-02-02T18:20:38.389 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T18:20:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4m) 51s ago 5m 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:20:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 51s ago 5m 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:20:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4m) 56s ago 4m 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:20:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3m) 51s ago 4m 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:20:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (66s) 51s ago 66s 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:20:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (71s) 51s ago 71s 16.2.4 8d91d370c2b8 02d535f62526 2022-02-02T18:20:38.392 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (69s) 56s ago 69s 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:20:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (74s) 56s ago 73s 16.2.4 8d91d370c2b8 1be2a63e320d 2022-02-02T18:20:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (6m) 51s ago 6m 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:20:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4m) 56s ago 4m 16.2.4 8d91d370c2b8 744df187ddef 2022-02-02T18:20:38.394 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 51s ago 6m 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:20:38.394 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4m) 56s ago 4m 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:20:38.395 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4m) 51s ago 4m 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:20:38.395 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 56s ago 4m 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:20:38.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:20:38.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:20:38.396 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:20:38.396 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3m) 56s ago 2m 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:20:38.396 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2m) 56s ago 2m 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:20:38.396 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2m) 56s ago 2m 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:20:38.396 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3m) 51s ago 4m 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:20:38.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.384+0000 7f38ceffd700 1 -- 172.21.15.96:0/4127782293 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f38c4000bc0 con 0x7f38c805c300 2022-02-02T18:20:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.387+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 msgr2=0x7f38c805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.387+0000 7f38df59e700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 0x7f38c805e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f38d4009da0 tx=0x7f38d4009b30).stop 2022-02-02T18:20:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.387+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 msgr2=0x7f38e010d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.387+0000 7f38df59e700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f38d00026d0 tx=0x7f38d0009de0).stop 2022-02-02T18:20:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 shutdown_connections 2022-02-02T18:20:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f38c805c300 0x7f38c805e7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38e00f4600 0x7f38e010d390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 --2- 172.21.15.96:0/4127782293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38e00f58b0 0x7f38e010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 >> 172.21.15.96:0/4127782293 conn(0x7f38e00f0320 msgr2=0x7f38e00f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 shutdown_connections 2022-02-02T18:20:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.388+0000 7f38df59e700 1 -- 172.21.15.96:0/4127782293 wait complete. 2022-02-02T18:20:38.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.501+0000 7fd9cd617700 1 -- 172.21.15.96:0/501613758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 msgr2=0x7fd9c81033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 --2- 172.21.15.96:0/501613758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c81033c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd9c00099e0 tx=0x7fd9c0004d10).stop 2022-02-02T18:20:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 -- 172.21.15.96:0/501613758 shutdown_connections 2022-02-02T18:20:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 --2- 172.21.15.96:0/501613758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c81033c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 --2- 172.21.15.96:0/501613758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 0x7fd9c8100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 -- 172.21.15.96:0/501613758 >> 172.21.15.96:0/501613758 conn(0x7fd9c8063530 msgr2=0x7fd9c8065950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 -- 172.21.15.96:0/501613758 shutdown_connections 2022-02-02T18:20:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.502+0000 7fd9cd617700 1 -- 172.21.15.96:0/501613758 wait complete. 2022-02-02T18:20:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 Processor -- start 2022-02-02T18:20:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 -- start start 2022-02-02T18:20:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 0x7fd9c810f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81100a0 con 0x7fd9c8100fd0 2022-02-02T18:20:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9cd617700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81101e0 con 0x7fd9c8067dd0 2022-02-02T18:20:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52472/0 (socket says 172.21.15.96:52472) 2022-02-02T18:20:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9c77fe700 1 -- 172.21.15.96:0/68852465 learned_addr learned my addr 172.21.15.96:0/68852465 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.503+0000 7fd9c7fff700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 0x7fd9c810f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c77fe700 1 -- 172.21.15.96:0/68852465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 msgr2=0x7fd9c810f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c77fe700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 0x7fd9c810f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c77fe700 1 -- 172.21.15.96:0/68852465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009640 con 0x7fd9c8100fd0 2022-02-02T18:20:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c77fe700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fd9c000b3b0 tx=0x7fd9c0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c000e030 con 0x7fd9c8100fd0 2022-02-02T18:20:38.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c8110b20 con 0x7fd9c8100fd0 2022-02-02T18:20:38.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c8111000 con 0x7fd9c8100fd0 2022-02-02T18:20:38.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9c00049b0 con 0x7fd9c8100fd0 2022-02-02T18:20:38.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.504+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c0018070 con 0x7fd9c8100fd0 2022-02-02T18:20:38.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.505+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8004fa0 con 0x7fd9c8100fd0 2022-02-02T18:20:38.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.506+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd9c0007d40 con 0x7fd9c8100fd0 2022-02-02T18:20:38.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.507+0000 7fd9c4ff9700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 0x7fd9b005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.507+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd9c0077c90 con 0x7fd9c8100fd0 2022-02-02T18:20:38.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.507+0000 7fd9c7fff700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 0x7fd9b005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.508+0000 7fd9c7fff700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 0x7fd9b005e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd9c8067ac0 tx=0x7fd9bc009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.514+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd9c004a970 con 0x7fd9c8100fd0 2022-02-02T18:20:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.789+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9a8005e80 con 0x7fd9c8100fd0 2022-02-02T18:20:38.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.789+0000 7fd9c4ff9700 1 -- 172.21.15.96:0/68852465 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fd9c004df90 con 0x7fd9c8100fd0 2022-02-02T18:20:38.794 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:20:38.794 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:20:38.794 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:20:38.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:38.795 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:20:38.795 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:20:38.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:38.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:20:38.795 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:20:38.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:38.796 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:20:38.796 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:20:38.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:20:38.797 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:20:38.797 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T18:20:38.797 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:20:38.797 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:20:38.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.791+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 msgr2=0x7fd9b005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.791+0000 7fd9cd617700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 0x7fd9b005e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd9c8067ac0 tx=0x7fd9bc009c00).stop 2022-02-02T18:20:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.791+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 msgr2=0x7fd9c810faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.791+0000 7fd9cd617700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fd9c000b3b0 tx=0x7fd9c0004d10).stop 2022-02-02T18:20:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 shutdown_connections 2022-02-02T18:20:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fd9b005c300 0x7fd9b005e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c8067dd0 0x7fd9c810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 --2- 172.21.15.96:0/68852465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9c8100fd0 0x7fd9c810faf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 >> 172.21.15.96:0/68852465 conn(0x7fd9c8063530 msgr2=0x7fd9c8065920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 shutdown_connections 2022-02-02T18:20:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.792+0000 7fd9cd617700 1 -- 172.21.15.96:0/68852465 wait complete. 2022-02-02T18:20:38.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 -- 172.21.15.96:0/136827304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64900696d0 msgr2=0x7f6490067d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 --2- 172.21.15.96:0/136827304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64900696d0 0x7f6490067d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f648c0045a0 tx=0x7f648c009b30).stop 2022-02-02T18:20:38.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 -- 172.21.15.96:0/136827304 shutdown_connections 2022-02-02T18:20:38.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 --2- 172.21.15.96:0/136827304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6490068250 0x7f64900686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 --2- 172.21.15.96:0/136827304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64900696d0 0x7f6490067d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.899+0000 7f64984da700 1 -- 172.21.15.96:0/136827304 >> 172.21.15.96:0/136827304 conn(0x7f64900636c0 msgr2=0x7f6490065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:38.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.900+0000 7f64984da700 1 -- 172.21.15.96:0/136827304 shutdown_connections 2022-02-02T18:20:38.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.900+0000 7f64984da700 1 -- 172.21.15.96:0/136827304 wait complete. 2022-02-02T18:20:38.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.900+0000 7f64984da700 1 Processor -- start 2022-02-02T18:20:38.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.900+0000 7f64984da700 1 -- start start 2022-02-02T18:20:38.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f64984da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f64984da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 0x7f6490116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f64984da700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64901167e0 con 0x7f64900696d0 2022-02-02T18:20:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f64984da700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490116fe0 con 0x7f6490068250 2022-02-02T18:20:38.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6495a75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 0x7f6490116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56584/0 (socket says 172.21.15.96:56584) 2022-02-02T18:20:38.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 -- 172.21.15.96:0/2938600382 learned_addr learned my addr 172.21.15.96:0/2938600382 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:20:38.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 -- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 msgr2=0x7f6490116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:38.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 0x7f6490116230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:38.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 -- 172.21.15.96:0/2938600382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c005040 con 0x7f6490068250 2022-02-02T18:20:38.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6495a75700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 0x7f6490116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:20:38.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.901+0000 7f6496276700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f648c0134f0 tx=0x7f648c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.903+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648c00e070 con 0x7f6490068250 2022-02-02T18:20:38.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.903+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f648c0097d0 con 0x7f6490068250 2022-02-02T18:20:38.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.903+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648c019070 con 0x7f6490068250 2022-02-02T18:20:38.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.903+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490117260 con 0x7f6490068250 2022-02-02T18:20:38.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.903+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490117740 con 0x7f6490068250 2022-02-02T18:20:38.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.904+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900672e0 con 0x7f6490068250 2022-02-02T18:20:38.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.905+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f648c025070 con 0x7f6490068250 2022-02-02T18:20:38.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.905+0000 7f6486ffd700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 0x7f647c05e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:20:38.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.905+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f648c076a20 con 0x7f6490068250 2022-02-02T18:20:38.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.905+0000 7f6495a75700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 0x7f647c05e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:20:38.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.906+0000 7f6495a75700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 0x7f647c05e800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6480009880 tx=0x7f648000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:20:38.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:38.910+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f648c049720 con 0x7f6490068250 2022-02-02T18:20:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:38 smithi096 conmon[32067]: audit 2022-02-02T18:20:37.886717+0000 mgr.smithi096.shfutl ( 2022-02-02T18:20:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:38 smithi096 conmon[32067]: mgr.14162) 236 : audit [DBG] from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:38 smithi096 conmon[32067]: audit 2022-02-02T18:20:38.790997+0000 mon.smithi096 (mon.0) 558 : audit 2022-02-02T18:20:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:38 smithi096 conmon[32067]: [DBG] from='client.? 172.21.15.96:0/68852465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:20:39.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.173+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f649010dcf0 con 0x7f6490068250 2022-02-02T18:20:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.173+0000 7f6486ffd700 1 -- 172.21.15.96:0/2938600382 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1621 (secure 0 0 0) 0x7f648c023070 con 0x7f6490068250 2022-02-02T18:20:39.178 INFO:teuthology.orchestra.run.smithi096.stdout:e15 2022-02-02T18:20:39.179 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:20:39.179 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:20:39.179 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:20:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:39.180 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:20:39.180 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:20:39.180 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 15 2022-02-02T18:20:39.180 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:20:39.181 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:20:39.181 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:19:40.031738+0000 2022-02-02T18:20:39.181 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:20:39.181 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:20:39.182 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:20:39.182 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:20:39.182 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:20:39.182 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:20:39.182 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:20:39.183 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:20:39.183 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:20:39.183 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:20:39.183 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:20:39.184 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:20:39.184 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:20:39.184 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:20:39.184 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:20:39.185 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:20:39.185 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:20:39.185 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:20:39.185 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:20:39.186 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:20:39.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:20:39.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:20:39.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:20:39.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:20:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:20:39.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 msgr2=0x7f647c05e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 0x7f647c05e800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6480009880 tx=0x7f648000b040).stop 2022-02-02T18:20:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 msgr2=0x7f6490115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:20:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f648c0134f0 tx=0x7f648c00b040).stop 2022-02-02T18:20:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 shutdown_connections 2022-02-02T18:20:39.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f647c05c340 0x7f647c05e800 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:39.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6490068250 0x7f6490115d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:39.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 --2- 172.21.15.96:0/2938600382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64900696d0 0x7f6490116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:20:39.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.176+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 >> 172.21.15.96:0/2938600382 conn(0x7f64900636c0 msgr2=0x7f6490101300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:20:39.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.177+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 shutdown_connections 2022-02-02T18:20:39.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:20:39.177+0000 7f64984da700 1 -- 172.21.15.96:0/2938600382 wait complete. 2022-02-02T18:20:39.191 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 15 2022-02-02T18:20:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:38 smithi159 conmon[35668]: audit 2022-02-02T18:20:37.886717+0000 mgr.smithi096.shfutl (mgr.14162) 236 : audit [DBG] from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:38 smithi159 conmon[35668]: audit 2022-02-02T18:20:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:38 smithi159 conmon[35668]: 2022-02-02T18:20:38.790997+0000 mon.smithi096 (mon.0) 558 : audit [DBG] from='client.? 172.21.15.96:0/68852465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:20:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:39 smithi159 conmon[35668]: audit 2022-02-02T18:20:38.377948+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:20:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:39 smithi159 conmon[35668]: 237 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:39 smithi159 conmon[35668]: cluster 2022-02-02T18:20:38.814332+0000 mgr.smithi096.shfutl (mgr.14162) 238 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2022-02-02T18:20:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:39 smithi159 conmon[35668]: audit 2022-02-02T18:20:39.175442+0000 mon.smithi159 (mon.1) 2022-02-02T18:20:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:39 smithi159 conmon[35668]: 13 : audit [DBG] from='client.? 172.21.15.96:0/2938600382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:20:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: audit 2022-02-02T18:20:38.377948+0000 2022-02-02T18:20:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 237 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:20:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: cluster 2022-02-02T18:20:38.814332+0000 mgr.smithi096.shfutl ( 2022-02-02T18:20:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: mgr.14162) 238 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2022-02-02T18:20:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: audit 2022-02-02T18:20:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: 2022-02-02T18:20:39.175442+0000 mon.smithi159 (mon.1) 13 2022-02-02T18:20:40.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:39 smithi096 conmon[32067]: : audit [DBG] from='client.? 172.21.15.96:0/2938600382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:20:40.703 INFO:tasks.workunit.client.1.smithi159.stderr:Note: switching to '78571b80ad21c56cce214a3fbfb0b1a080f78167'. 2022-02-02T18:20:40.704 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.704 INFO:tasks.workunit.client.1.smithi159.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-02-02T18:20:40.704 INFO:tasks.workunit.client.1.smithi159.stderr:changes and commit them, and you can discard any commits you make in this 2022-02-02T18:20:40.704 INFO:tasks.workunit.client.1.smithi159.stderr:state without impacting any branches by switching back to a branch. 2022-02-02T18:20:40.705 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.705 INFO:tasks.workunit.client.1.smithi159.stderr:If you want to create a new branch to retain commits you create, you may 2022-02-02T18:20:40.705 INFO:tasks.workunit.client.1.smithi159.stderr:do so (now or later) by using -c with the switch command. Example: 2022-02-02T18:20:40.705 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.705 INFO:tasks.workunit.client.1.smithi159.stderr: git switch -c 2022-02-02T18:20:40.706 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.706 INFO:tasks.workunit.client.1.smithi159.stderr:Or undo this operation with: 2022-02-02T18:20:40.706 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.707 INFO:tasks.workunit.client.1.smithi159.stderr: git switch - 2022-02-02T18:20:40.707 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.707 INFO:tasks.workunit.client.1.smithi159.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-02-02T18:20:40.708 INFO:tasks.workunit.client.1.smithi159.stderr: 2022-02-02T18:20:40.708 INFO:tasks.workunit.client.1.smithi159.stderr:HEAD is now at 78571b80ad2 Merge PR #44851 into wip-pdonnell-testing-20220202.154313 2022-02-02T18:20:40.711 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2022-02-02T18:20:40.771 INFO:tasks.workunit.client.1.smithi159.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-02-02T18:20:40.774 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-02-02T18:20:40.774 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-02-02T18:20:41.115 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:40 smithi096 conmon[32067]: cluster 2022-02-02T18:20:40.814739+0000 mgr.smithi096.shfutl (mgr.14162) 239 : cluster 2022-02-02T18:20:41.115 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:40 smithi096 conmon[32067]: [DBG] pgmap v194: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2022-02-02T18:20:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:40 smithi159 conmon[35668]: cluster 2022-02-02T18:20:40.814739+0000 mgr.smithi096.shfutl (mgr.14162) 239 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2022-02-02T18:20:41.312 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-02-02T18:20:41.369 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-02-02T18:20:41.406 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-02-02T18:20:41.407 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-02-02T18:20:41.408 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-02-02T18:20:41.444 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-02-02T18:20:41.447 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-02-02T18:20:41.447 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2022-02-02T18:20:41.504 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2022-02-02T18:20:41.505 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2022-02-02T18:20:41.506 DEBUG:teuthology.orchestra.run.smithi159:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78571b80ad21c56cce214a3fbfb0b1a080f78167 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2022-02-02T18:20:41.565 INFO:tasks.workunit.client.1.smithi159.stderr:+ mkdir -p fsstress 2022-02-02T18:20:41.566 INFO:tasks.workunit.client.1.smithi159.stderr:+ pushd fsstress 2022-02-02T18:20:41.567 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T18:20:41.567 INFO:tasks.workunit.client.1.smithi159.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2022-02-02T18:20:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: audit 2022-02-02T18:20:41.926812+0000 mon.smithi096 (mon.0) 559 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: 2022-02-02T18:20:41.927259+0000 mgr.smithi096.shfutl (mgr.14162) 240 : cephadm [INF] Upgrade: Target is version 17.0.0-10511-g78571b80 (unknown) 2022-02-02T18:20:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:41.927321+0000 mgr.smithi096.shfutl (mgr.14162) 241 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f'] 2022-02-02T18:20:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: audit 2022-02-02T18:20:41.927978+0000 mon.smithi096 (mon.0) 560 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:42 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:41.928853+0000 mgr.smithi096.shfutl (mgr.14162) 242 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:20:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: audit 2022-02-02T18:20:41.926812+0000 mon.smithi096 (mon.0) 559 2022-02-02T18:20:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:20:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:41.927259+0000 mgr.smithi096.shfutl (mgr.14162) 240 : cephadm [INF] Upgrade: Target is version 17.0.0-10511-g78571b80 (unknown) 2022-02-02T18:20:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:41.927321+0000 mgr.smithi096.shfutl (mgr.14162) 241 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f'] 2022-02-02T18:20:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: audit 2022-02-02T18:20:41.927978+0000 mon.smithi096 (mon.0) 560 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:20:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:42 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:41.928853+0000 mgr.smithi096.shfutl (mgr.14162) 242 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:20:43.485 INFO:tasks.workunit.client.1.smithi159.stderr:+ tar xzf ltp-full.tgz 2022-02-02T18:20:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:43 smithi159 conmon[35668]: cephadm 2022-02-02T18:20:42. 2022-02-02T18:20:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:43 smithi159 conmon[35668]: 285123+0000 mgr.smithi096.shfutl (mgr.14162) 243 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f on smithi159 2022-02-02T18:20:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:43 smithi159 conmon[35668]: cluster 2022-02-02T18: 2022-02-02T18:20:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:43 smithi159 conmon[35668]: 20:42.815484+0000 mgr.smithi096.shfutl (mgr.14162) 244 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2022-02-02T18:20:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:43 smithi096 conmon[32067]: cephadm 2022-02-02T18:20:42.285123+0000 mgr.smithi096.shfutl (mgr.14162) 243 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f on smithi159 2022-02-02T18:20:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:43 smithi096 conmon[32067]: cluster 2022-02-02T18:20:42.815484+0000 mgr.smithi096.shfutl (mgr.14162) 244 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2022-02-02T18:20:44.652 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to '78571b80ad21c56cce214a3fbfb0b1a080f78167'. 2022-02-02T18:20:44.652 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.653 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-02-02T18:20:44.653 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2022-02-02T18:20:44.653 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2022-02-02T18:20:44.653 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.654 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2022-02-02T18:20:44.654 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2022-02-02T18:20:44.654 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.654 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2022-02-02T18:20:44.654 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.655 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2022-02-02T18:20:44.655 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.655 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2022-02-02T18:20:44.655 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.656 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-02-02T18:20:44.656 INFO:tasks.workunit.client.0.smithi096.stderr: 2022-02-02T18:20:44.656 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at 78571b80ad2 Merge PR #44851 into wip-pdonnell-testing-20220202.154313 2022-02-02T18:20:44.659 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-02-02T18:20:44.687 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-02-02T18:20:44.689 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-02-02T18:20:44.690 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-02-02T18:20:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:45 smithi159 conmon[35668]: cluster 2022-02-02T18:20:44.816062+0000 mgr.smithi096.shfutl (mgr.14162) 245 : cluster [DBG] 2022-02-02T18:20:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:45 smithi159 conmon[35668]: pgmap v196: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 85 B/s wr, 3 op/s 2022-02-02T18:20:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:45 smithi096 conmon[32067]: cluster 2022-02-02T18:20:44.816062+0000 mgr.smithi096.shfutl (mgr.14162) 245 : cluster [DBG] 2022-02-02T18:20:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:45 smithi096 conmon[32067]: pgmap v196: 65 pgs: 65 active+clean; 13 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 85 B/s wr, 3 op/s 2022-02-02T18:20:48.226 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-02-02T18:20:48.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:47 smithi159 conmon[35668]: cluster 2022-02-02T18:20:46.816663+0000 mgr.smithi096.shfutl (mgr.14162) 246 : 2022-02-02T18:20:48.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:47 smithi159 conmon[35668]: cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 4.0 MiB data, 39 MiB used, 536 GiB / 536 GiB avail; 279 KiB/s rd, 346 KiB/s wr, 6 op/s 2022-02-02T18:20:48.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:47 smithi096 conmon[32067]: cluster 2022-02-02T18:20:46.816663+0000 mgr.smithi096.shfutl (mgr.14162) 246 2022-02-02T18:20:48.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:47 smithi096 conmon[32067]: : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 4.0 MiB data, 39 MiB used, 536 GiB / 536 GiB avail; 279 KiB/s rd, 346 KiB/s wr, 6 op/s 2022-02-02T18:20:48.774 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-02-02T18:20:48.918 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-02-02T18:20:48.919 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-02-02T18:20:48.920 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-02-02T18:20:48.970 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-02-02T18:20:48.980 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2022-02-02T18:20:48.980 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-02-02T18:20:49.039 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2022-02-02T18:20:49.041 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2022-02-02T18:20:49.041 DEBUG:teuthology.orchestra.run.smithi096:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78571b80ad21c56cce214a3fbfb0b1a080f78167 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2022-02-02T18:20:49.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ mkdir -p fsstress 2022-02-02T18:20:49.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd fsstress 2022-02-02T18:20:49.151 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2022-02-02T18:20:49.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2022-02-02T18:20:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:49 smithi159 conmon[35668]: cluster 2022-02-02T18:20:48.817054+0000 mgr.smithi096.shfutl (mgr.14162) 247 2022-02-02T18:20:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:49 smithi159 conmon[35668]: : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 4.1 MiB data, 43 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 358 KiB/s wr, 5 op/s 2022-02-02T18:20:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:49 smithi096 conmon[32067]: cluster 2022-02-02T18:20:48.817054+0000 mgr.smithi096.shfutl (mgr.14162) 247 : cluster [DBG] 2022-02-02T18:20:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:49 smithi096 conmon[32067]: pgmap v198: 65 pgs: 65 active+clean; 4.1 MiB data, 43 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 358 KiB/s wr, 5 op/s 2022-02-02T18:20:50.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ tar xzf ltp-full.tgz 2022-02-02T18:20:51.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:50 smithi159 conmon[35668]: cluster 2022-02-02T18:20:49.946632+0000 2022-02-02T18:20:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:50 smithi159 conmon[35668]: mon.smithi096 (mon.0) 561 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:20:51.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:50 smithi096 conmon[32067]: cluster 2022-02-02T18:20:49.946632+0000 mon.smithi096 (mon.0) 561 2022-02-02T18:20:51.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:50 smithi096 conmon[32067]: : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:20:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:51 smithi159 conmon[35668]: cluster 2022-02-02T18:20:50.817728+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:51 smithi159 conmon[35668]: 14162) 248 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 5.3 MiB data, 56 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 473 KiB/s wr, 36 op/s 2022-02-02T18:20:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:51 smithi096 conmon[32067]: cluster 2022-02-02T18:20:50.817728+0000 mgr.smithi096.shfutl (mgr.14162) 248 2022-02-02T18:20:52.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:51 smithi096 conmon[32067]: : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 5.3 MiB data, 56 MiB used, 536 GiB / 536 GiB avail; 278 KiB/s rd, 473 KiB/s wr, 36 op/s 2022-02-02T18:20:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:53 smithi159 conmon[35668]: cluster 2022-02-02T18:20:52.818233+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:53 smithi159 conmon[35668]: 14162) 249 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 36 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 265 op/s 2022-02-02T18:20:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:53 smithi096 conmon[32067]: cluster 2022-02-02T18:20:52.818233+0000 mgr.smithi096.shfutl (mgr.14162) 249 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 36 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 265 op/s 2022-02-02T18:20:55.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:54 smithi159 conmon[35668]: cluster 2022-02-02T18:20:54.818792+0000 mgr.smithi096.shfutl (mgr.14162) 250 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 38 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 265 op/s 2022-02-02T18:20:55.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:54 smithi096 conmon[32067]: cluster 2022-02-02T18:20:54.818792+0000 mgr.smithi096.shfutl (mgr.14162) 250 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 38 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 265 op/s 2022-02-02T18:20:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:57 smithi159 conmon[35668]: cluster 2022-02-02T18:20:56.819232+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:20:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:57 smithi159 conmon[35668]: 14162) 251 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 58 MiB data, 211 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 368 op/s 2022-02-02T18:20:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:57 smithi096 conmon[32067]: cluster 2022-02-02T18:20:56.819232+0000 mgr.smithi096.shfutl (mgr.14162) 251 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 58 MiB data, 211 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 368 op/s 2022-02-02T18:20:58.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:57 smithi096 conmon[32067]: 2022-02-02T18:21:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:59 smithi159 conmon[35668]: cluster 2022-02-02T18:20:58.819623+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:21:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:20:59 smithi159 conmon[35668]: .14162) 252 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 59 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 375 op/s 2022-02-02T18:21:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:20:59 smithi096 conmon[32067]: cluster 2022-02-02T18:20:58.819623+0000 mgr.smithi096.shfutl (mgr.14162) 252 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 59 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 375 op/s 2022-02-02T18:21:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:01 smithi159 conmon[35668]: cluster 2022-02-02T18:21:00.820074+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:21:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:01 smithi159 conmon[35668]: .14162) 253 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 61 MiB data, 232 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 390 op/s 2022-02-02T18:21:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:01 smithi096 conmon[32067]: cluster 2022-02-02T18:21:00.820074+0000 mgr.smithi096.shfutl ( 2022-02-02T18:21:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:01 smithi096 conmon[32067]: mgr.14162) 253 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 61 MiB data, 232 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 390 op/s 2022-02-02T18:21:03.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:03 smithi096 conmon[32067]: cluster 2022-02-02T18:21:02.820602+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:21:03.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:03 smithi096 conmon[32067]: .14162) 254 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 76 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 368 op/s 2022-02-02T18:21:03.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:03 smithi159 conmon[35668]: cluster 2022-02-02T18:21:02.820602+0000 mgr.smithi096.shfutl (mgr.14162) 254 2022-02-02T18:21:03.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:03 smithi159 conmon[35668]: : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 76 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 368 op/s 2022-02-02T18:21:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:05 smithi159 conmon[35668]: cluster 2022-02-02T18:21:04.820940+0000 2022-02-02T18:21:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:05 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 255 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 86 MiB data, 340 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 226 op/s 2022-02-02T18:21:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:05 smithi096 conmon[32067]: cluster 2022-02-02T18:21:04.820940+0000 mgr.smithi096.shfutl 2022-02-02T18:21:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:05 smithi096 conmon[32067]: (mgr.14162) 255 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 86 MiB data, 340 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 226 op/s 2022-02-02T18:21:08.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:07 smithi159 conmon[35668]: cluster 2022-02-02T18:21: 2022-02-02T18:21:08.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:07 smithi159 conmon[35668]: 06.821370+0000 mgr.smithi096.shfutl (mgr.14162) 256 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 128 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 703 op/s 2022-02-02T18:21:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:07 smithi096 conmon[32067]: cluster 2022-02-02T18:21:06.821370+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:21:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:07 smithi096 conmon[32067]: 256 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 128 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 703 op/s 2022-02-02T18:21:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- 172.21.15.96:0/2336987373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 msgr2=0x7f193c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 --2- 172.21.15.96:0/2336987373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c0f7de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1928004660 tx=0x7f1928009b30).stop 2022-02-02T18:21:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- 172.21.15.96:0/2336987373 shutdown_connections 2022-02-02T18:21:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 --2- 172.21.15.96:0/2336987373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c0f7de0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 --2- 172.21.15.96:0/2336987373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- 172.21.15.96:0/2336987373 >> 172.21.15.96:0/2336987373 conn(0x7f193c0f1e40 msgr2=0x7f193c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- 172.21.15.96:0/2336987373 shutdown_connections 2022-02-02T18:21:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- 172.21.15.96:0/2336987373 wait complete. 2022-02-02T18:21:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 Processor -- start 2022-02-02T18:21:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.293+0000 7f1942e3a700 1 -- start start 2022-02-02T18:21:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1942e3a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1942e3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1942e3a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c1079b0 con 0x7f193c0f7980 2022-02-02T18:21:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1942e3a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c107af0 con 0x7f193c0f66e0 2022-02-02T18:21:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1940bd6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1940bd6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56612/0 (socket says 172.21.15.96:56612) 2022-02-02T18:21:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f193bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f1940bd6700 1 -- 172.21.15.96:0/1304187145 learned_addr learned my addr 172.21.15.96:0/1304187145 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f193bfff700 1 -- 172.21.15.96:0/1304187145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 msgr2=0x7f193c106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f193bfff700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.294+0000 7f193bfff700 1 -- 172.21.15.96:0/1304187145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928005040 con 0x7f193c0f7980 2022-02-02T18:21:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f193bfff700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c107400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1928000c00 tx=0x7f1928009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1928018070 con 0x7f193c0f7980 2022-02-02T18:21:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c108430 con 0x7f193c0f7980 2022-02-02T18:21:09.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19280097d0 con 0x7f193c0f7980 2022-02-02T18:21:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192801ddb0 con 0x7f193c0f7980 2022-02-02T18:21:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.295+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c108990 con 0x7f193c0f7980 2022-02-02T18:21:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.296+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c045ad0 con 0x7f193c0f7980 2022-02-02T18:21:09.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.296+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1928007ca0 con 0x7f193c0f7980 2022-02-02T18:21:09.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.297+0000 7f19397fa700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 0x7f192c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.297+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1928077ab0 con 0x7f193c0f7980 2022-02-02T18:21:09.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.297+0000 7f1940bd6700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 0x7f192c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.297+0000 7f1940bd6700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 0x7f192c05e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1930004d40 tx=0x7f193000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.301+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f192804a790 con 0x7f193c0f7980 2022-02-02T18:21:09.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.520+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f193c0fefb0 con 0x7f192c05c2b0 2022-02-02T18:21:09.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.521+0000 7f19397fa700 1 -- 172.21.15.96:0/1304187145 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f193c0fefb0 con 0x7f192c05c2b0 2022-02-02T18:21:09.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.523+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 msgr2=0x7f192c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.523+0000 7f1942e3a700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 0x7f192c05e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1930004d40 tx=0x7f193000b040).stop 2022-02-02T18:21:09.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.523+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 msgr2=0x7f193c107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.523+0000 7f1942e3a700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c107400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1928000c00 tx=0x7f1928009b30).stop 2022-02-02T18:21:09.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 shutdown_connections 2022-02-02T18:21:09.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f192c05c2b0 0x7f192c05e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c0f66e0 0x7f193c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 --2- 172.21.15.96:0/1304187145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f193c0f7980 0x7f193c107400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 >> 172.21.15.96:0/1304187145 conn(0x7f193c0f1e40 msgr2=0x7f193c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 shutdown_connections 2022-02-02T18:21:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.524+0000 7f1942e3a700 1 -- 172.21.15.96:0/1304187145 wait complete. 2022-02-02T18:21:09.537 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:21:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 -- 172.21.15.96:0/2743704571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 msgr2=0x7f66800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 --2- 172.21.15.96:0/2743704571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f66800f6b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f6670004660 tx=0x7f6670009b30).stop 2022-02-02T18:21:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 -- 172.21.15.96:0/2743704571 shutdown_connections 2022-02-02T18:21:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 --2- 172.21.15.96:0/2743704571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f66800f6b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 --2- 172.21.15.96:0/2743704571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 0x7f66800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 -- 172.21.15.96:0/2743704571 >> 172.21.15.96:0/2743704571 conn(0x7f66800f0b90 msgr2=0x7f66800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 -- 172.21.15.96:0/2743704571 shutdown_connections 2022-02-02T18:21:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.626+0000 7f667f59e700 1 -- 172.21.15.96:0/2743704571 wait complete. 2022-02-02T18:21:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 Processor -- start 2022-02-02T18:21:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 -- start start 2022-02-02T18:21:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 0x7f668010be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800602d0 con 0x7f66800f66d0 2022-02-02T18:21:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680060410 con 0x7f66800f5430 2022-02-02T18:21:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52520/0 (socket says 172.21.15.96:52520) 2022-02-02T18:21:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 -- 172.21.15.96:0/1516920796 learned_addr learned my addr 172.21.15.96:0/1516920796 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667e59c700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 0x7f668010be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 -- 172.21.15.96:0/1516920796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 msgr2=0x7f668010be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 0x7f668010be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 -- 172.21.15.96:0/1516920796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670005040 con 0x7f66800f66d0 2022-02-02T18:21:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.627+0000 7f667dd9b700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f6670009990 tx=0x7f6670009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.628+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6670018070 con 0x7f66800f66d0 2022-02-02T18:21:09.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.628+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6670007ba0 con 0x7f66800f66d0 2022-02-02T18:21:09.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.628+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668010e810 con 0x7f66800f66d0 2022-02-02T18:21:09.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.628+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f667001c3c0 con 0x7f66800f66d0 2022-02-02T18:21:09.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.628+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668010ebe0 con 0x7f66800f66d0 2022-02-02T18:21:09.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.629+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6680059100 con 0x7f66800f66d0 2022-02-02T18:21:09.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.629+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f667001d420 con 0x7f66800f66d0 2022-02-02T18:21:09.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.629+0000 7f666effd700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 0x7f666805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.630+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6670077a80 con 0x7f66800f66d0 2022-02-02T18:21:09.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.630+0000 7f667e59c700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 0x7f666805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.630+0000 7f667e59c700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 0x7f666805e7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6680060060 tx=0x7f667400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.634+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f667004a780 con 0x7f66800f66d0 2022-02-02T18:21:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.831+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66800fdcd0 con 0x7f666805c300 2022-02-02T18:21:09.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.840+0000 7f666effd700 1 -- 172.21.15.96:0/1516920796 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7f66800fdcd0 con 0x7f666805c300 2022-02-02T18:21:09.844 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T18:21:09.844 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4m) 83s ago 5m 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:21:09.844 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 83s ago 5m 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:21:09.844 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (5m) 88s ago 5m 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:21:09.845 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4m) 83s ago 5m 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:21:09.845 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (98s) 83s ago 97s 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:21:09.845 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (103s) 83s ago 102s 16.2.4 8d91d370c2b8 02d535f62526 2022-02-02T18:21:09.845 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (101s) 88s ago 100s 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:21:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (105s) 88s ago 105s 16.2.4 8d91d370c2b8 1be2a63e320d 2022-02-02T18:21:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (6m) 83s ago 6m 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:21:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (5m) 88s ago 5m 16.2.4 8d91d370c2b8 744df187ddef 2022-02-02T18:21:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 83s ago 6m 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:21:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (5m) 88s ago 4m 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:21:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (5m) 83s ago 5m 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:21:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 88s ago 4m 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:21:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 83s ago 4m 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:21:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 83s ago 4m 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:21:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 83s ago 3m 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:21:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3m) 88s ago 3m 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:21:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3m) 88s ago 3m 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:21:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2m) 88s ago 2m 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:21:09.849 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4m) 83s ago 5m 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:21:09.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 msgr2=0x7f666805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 0x7f666805e7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6680060060 tx=0x7f667400b040).stop 2022-02-02T18:21:09.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 msgr2=0x7f668010e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f6670009990 tx=0x7f6670009b30).stop 2022-02-02T18:21:09.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 shutdown_connections 2022-02-02T18:21:09.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f666805c300 0x7f666805e7c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66800f5430 0x7f668010be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 --2- 172.21.15.96:0/1516920796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66800f66d0 0x7f668010e320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.841+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 >> 172.21.15.96:0/1516920796 conn(0x7f66800f0b90 msgr2=0x7f66800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:09.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.842+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 shutdown_connections 2022-02-02T18:21:09.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.842+0000 7f667f59e700 1 -- 172.21.15.96:0/1516920796 wait complete. 2022-02-02T18:21:09.856 INFO:tasks.workunit.client.1.smithi159.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2022-02-02T18:21:09.857 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T18:21:09.858 INFO:tasks.workunit.client.1.smithi159.stderr:+ make 2022-02-02T18:21:09.946 INFO:tasks.workunit.client.1.smithi159.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2022-02-02T18:21:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 -- 172.21.15.96:0/639039772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f4800 msgr2=0x7fecf00f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 --2- 172.21.15.96:0/639039772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f4800 0x7fecf00f4c20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fece0004660 tx=0x7fece0009b30).stop 2022-02-02T18:21:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 -- 172.21.15.96:0/639039772 shutdown_connections 2022-02-02T18:21:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 --2- 172.21.15.96:0/639039772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f51a0 0x7fecf00f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 --2- 172.21.15.96:0/639039772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f4800 0x7fecf00f4c20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 -- 172.21.15.96:0/639039772 >> 172.21.15.96:0/639039772 conn(0x7fecf00f0320 msgr2=0x7fecf00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.949+0000 7fecef59e700 1 -- 172.21.15.96:0/639039772 shutdown_connections 2022-02-02T18:21:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.950+0000 7fecef59e700 1 -- 172.21.15.96:0/639039772 wait complete. 2022-02-02T18:21:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.950+0000 7fecef59e700 1 Processor -- start 2022-02-02T18:21:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.950+0000 7fecef59e700 1 -- start start 2022-02-02T18:21:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecef59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f4800 0x7fecf0106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecef59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecef59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0107860 con 0x7fecf00f51a0 2022-02-02T18:21:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecef59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0108070 con 0x7fecf00f4800 2022-02-02T18:21:09.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52530/0 (socket says 172.21.15.96:52530) 2022-02-02T18:21:09.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 -- 172.21.15.96:0/84769693 learned_addr learned my addr 172.21.15.96:0/84769693 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:09.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecee59c700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f4800 0x7fecf0106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 -- 172.21.15.96:0/84769693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f4800 msgr2=0x7fecf0106d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:09.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f4800 0x7fecf0106d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:09.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 -- 172.21.15.96:0/84769693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0005040 con 0x7fecf00f51a0 2022-02-02T18:21:09.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.951+0000 7fecedd9b700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fece400e7c0 tx=0x7fece400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.952+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece40092e0 con 0x7fecf00f51a0 2022-02-02T18:21:09.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.952+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf01082f0 con 0x7fecf00f51a0 2022-02-02T18:21:09.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.952+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fece400f040 con 0x7fecf00f51a0 2022-02-02T18:21:09.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.952+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece40147a0 con 0x7fecf00f51a0 2022-02-02T18:21:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.952+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf01088b0 con 0x7fecf00f51a0 2022-02-02T18:21:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.953+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0059100 con 0x7fecf00f51a0 2022-02-02T18:21:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.954+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fece4024080 con 0x7fecf00f51a0 2022-02-02T18:21:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.954+0000 7fecdeffd700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 0x7fecd805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.954+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fece40765d0 con 0x7fecf00f51a0 2022-02-02T18:21:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.955+0000 7fecee59c700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 0x7fecd805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.955+0000 7fecee59c700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 0x7fecd805e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fece0000c00 tx=0x7fece0016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:09.957+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fece40492b0 con 0x7fecf00f51a0 2022-02-02T18:21:10.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.183+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fecf00fed40 con 0x7fecf00f51a0 2022-02-02T18:21:10.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.183+0000 7fecdeffd700 1 -- 172.21.15.96:0/84769693 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fece404c8d0 con 0x7fecf00f51a0 2022-02-02T18:21:10.187 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:21:10.188 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:21:10.188 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:21:10.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:10.188 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:21:10.189 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:21:10.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:10.189 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:21:10.189 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:21:10.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:10.190 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:21:10.190 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:21:10.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:10.191 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:21:10.191 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T18:21:10.191 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:21:10.191 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:21:10.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 msgr2=0x7fecd805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 0x7fecd805e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fece0000c00 tx=0x7fece0016040).stop 2022-02-02T18:21:10.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 msgr2=0x7fecf0107260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fece400e7c0 tx=0x7fece400b040).stop 2022-02-02T18:21:10.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 shutdown_connections 2022-02-02T18:21:10.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fecd805c300 0x7fecd805e7c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecf00f4800 0x7fecf0106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 --2- 172.21.15.96:0/84769693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecf00f51a0 0x7fecf0107260 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 >> 172.21.15.96:0/84769693 conn(0x7fecf00f0320 msgr2=0x7fecf00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:10.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 shutdown_connections 2022-02-02T18:21:10.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.185+0000 7fecef59e700 1 -- 172.21.15.96:0/84769693 wait complete. 2022-02-02T18:21:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:09 smithi159 conmon[35668]: cluster 2022-02-02T18:21:08.821699+0000 2022-02-02T18:21:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:09 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 257 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 132 MiB data, 582 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 658 op/s 2022-02-02T18:21:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 -- 172.21.15.96:0/1385255591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 msgr2=0x7f4a500f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 --2- 172.21.15.96:0/1385255591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a500f8160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f4a44004660 tx=0x7f4a44009b30).stop 2022-02-02T18:21:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 -- 172.21.15.96:0/1385255591 shutdown_connections 2022-02-02T18:21:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 --2- 172.21.15.96:0/1385255591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a500f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 --2- 172.21.15.96:0/1385255591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a500f8160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 -- 172.21.15.96:0/1385255591 >> 172.21.15.96:0/1385255591 conn(0x7f4a500f04c0 msgr2=0x7f4a500f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 -- 172.21.15.96:0/1385255591 shutdown_connections 2022-02-02T18:21:10.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:09 smithi096 conmon[32067]: cluster 2022-02-02T18:21 2022-02-02T18:21:10.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:09 smithi096 conmon[32067]: :08.821699+0000 mgr.smithi096.shfutl (mgr.14162) 257 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 132 MiB data, 582 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 658 op/s 2022-02-02T18:21:10.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.284+0000 7f4a55130700 1 -- 172.21.15.96:0/1385255591 wait complete. 2022-02-02T18:21:10.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 Processor -- start 2022-02-02T18:21:10.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 -- start start 2022-02-02T18:21:10.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a501074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50107a80 con 0x7f4a500f7d40 2022-02-02T18:21:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a55130700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50107bc0 con 0x7f4a500f86e0 2022-02-02T18:21:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52538/0 (socket says 172.21.15.96:52538) 2022-02-02T18:21:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 -- 172.21.15.96:0/3492655032 learned_addr learned my addr 172.21.15.96:0/3492655032 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4e59c700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a501074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 -- 172.21.15.96:0/3492655032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 msgr2=0x7f4a501074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a501074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 -- 172.21.15.96:0/3492655032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44005040 con 0x7f4a500f7d40 2022-02-02T18:21:10.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4e59c700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a501074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:21:10.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a4ed9d700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4a440043a0 tx=0x7f4a44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:10.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.285+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a44018070 con 0x7f4a500f7d40 2022-02-02T18:21:10.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.286+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a44007ba0 con 0x7f4a500f7d40 2022-02-02T18:21:10.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.286+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a4401c3c0 con 0x7f4a500f7d40 2022-02-02T18:21:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.286+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a50108500 con 0x7f4a500f7d40 2022-02-02T18:21:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.286+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a50108a10 con 0x7f4a500f7d40 2022-02-02T18:21:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.287+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a50045ad0 con 0x7f4a500f7d40 2022-02-02T18:21:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.287+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4a4401d420 con 0x7f4a500f7d40 2022-02-02T18:21:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.287+0000 7f4a377fe700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 0x7f4a3805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.287+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4a44077ba0 con 0x7f4a500f7d40 2022-02-02T18:21:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.287+0000 7f4a4e59c700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 0x7f4a3805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.288+0000 7f4a4e59c700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 0x7f4a3805e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4a40009760 tx=0x7f4a40009c60).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:10.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.291+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4a4404a820 con 0x7f4a500f7d40 2022-02-02T18:21:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.478+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a500fefc0 con 0x7f4a500f7d40 2022-02-02T18:21:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.478+0000 7f4a377fe700 1 -- 172.21.15.96:0/3492655032 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1638 (secure 0 0 0) 0x7f4a4404de40 con 0x7f4a500f7d40 2022-02-02T18:21:10.483 INFO:teuthology.orchestra.run.smithi096.stdout:e16 2022-02-02T18:21:10.483 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:21:10.483 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:21:10.483 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:21:10.484 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:10.484 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:21:10.484 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:21:10.484 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 16 2022-02-02T18:21:10.485 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:21:10.485 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:21:10.485 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:20:49.943413+0000 2022-02-02T18:21:10.485 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:21:10.485 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:21:10.486 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:21:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:21:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:21:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:21:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:21:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:21:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:21:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:21:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:21:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:21:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:21:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:21:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:21:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:21:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:21:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:21:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:21:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:21:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:21:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:21:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:21:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:21:10.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:10.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:10.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 msgr2=0x7f4a3805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 0x7f4a3805e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4a40009760 tx=0x7f4a40009c60).stop 2022-02-02T18:21:10.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 msgr2=0x7f4a50106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:10.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4a440043a0 tx=0x7f4a44009b30).stop 2022-02-02T18:21:10.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 shutdown_connections 2022-02-02T18:21:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f4a3805c2b0 0x7f4a3805e770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a500f7d40 0x7f4a50106fe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 --2- 172.21.15.96:0/3492655032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a500f86e0 0x7f4a501074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 >> 172.21.15.96:0/3492655032 conn(0x7f4a500f04c0 msgr2=0x7f4a500fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 shutdown_connections 2022-02-02T18:21:10.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:10.480+0000 7f4a55130700 1 -- 172.21.15.96:0/3492655032 wait complete. 2022-02-02T18:21:10.496 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2022-02-02T18:21:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:10 smithi159 conmon[35668]: audit 2022-02-02T18:21:09.522744+0000 mgr.smithi096.shfutl (mgr.14162) 258 : audit [DBG] from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:11.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:10 smithi159 conmon[35668]: audit 2022-02-02T18:21:09.834163+0000 mgr.smithi096.shfutl (mgr.14162) 259 : audit [DBG] from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:11.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:10 smithi159 conmon[35668]: audit 2022-02-02T18:21:10.184926+0000 mon.smithi096 (mon.0) 562 : audit [DBG] from='client.? 172.21.15.96:0/84769693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:21:11.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:10 smithi159 conmon[35668]: audit 2022-02-02T18:21:10.480248+0000 mon.smithi096 (mon.0) 563 : audit [DBG] from='client.? 172.21.15.96:0/3492655032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:21:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:10 smithi096 conmon[32067]: audit 2022-02-02T18:21:09.522744+0000 mgr.smithi096.shfutl (mgr.14162) 258 : audit [DBG] from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:10 smithi096 conmon[32067]: audit 2022-02-02T18:21:09.834163+0000 mgr.smithi096.shfutl (mgr.14162) 259 : audit [DBG] from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:10 smithi096 conmon[32067]: audit 2022-02-02T18:21:10.184926+0000 mon.smithi096 (mon.0) 562 : audit [DBG] from='client.? 172.21.15.96:0/84769693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:21:11.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:10 smithi096 conmon[32067]: audit 2022-02-02T18:21:10.480248+0000 mon.smithi096 (mon.0) 563 : audit [DBG] from='client.? 172.21.15.96:0/3492655032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:21:12.002 INFO:tasks.workunit.client.1.smithi159.stderr:++ readlink -f fsstress 2022-02-02T18:21:12.010 INFO:tasks.workunit.client.1.smithi159.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2022-02-02T18:21:12.010 INFO:tasks.workunit.client.1.smithi159.stderr:+ popd 2022-02-02T18:21:12.011 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T18:21:12.011 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp 2022-02-02T18:21:12.012 INFO:tasks.workunit.client.1.smithi159.stderr:+ popd 2022-02-02T18:21:12.012 INFO:tasks.workunit.client.1.smithi159.stderr:++ mktemp -d -p . 2022-02-02T18:21:12.014 INFO:tasks.workunit.client.1.smithi159.stderr:+ T=./tmp.y81vbMCDNG 2022-02-02T18:21:12.014 INFO:tasks.workunit.client.1.smithi159.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.y81vbMCDNG -l 1 -n 1000 -p 10 -v 2022-02-02T18:21:12.016 INFO:tasks.workunit.client.1.smithi159.stdout:seed = 1643836135 2022-02-02T18:21:12.022 INFO:tasks.workunit.client.1.smithi159.stdout:1/0: truncate - no filename 2022-02-02T18:21:12.022 INFO:tasks.workunit.client.1.smithi159.stdout:1/1: write - no filename 2022-02-02T18:21:12.024 INFO:tasks.workunit.client.1.smithi159.stdout:1/2: symlink l0 0 2022-02-02T18:21:12.025 INFO:tasks.workunit.client.1.smithi159.stdout:0/0: dread - no filename 2022-02-02T18:21:12.025 INFO:tasks.workunit.client.1.smithi159.stdout:0/1: rename - no filename 2022-02-02T18:21:12.026 INFO:tasks.workunit.client.1.smithi159.stdout:1/3: creat f1 x:0 0 0 2022-02-02T18:21:12.027 INFO:tasks.workunit.client.1.smithi159.stdout:0/2: creat f0 x:0 0 0 2022-02-02T18:21:12.028 INFO:tasks.workunit.client.1.smithi159.stdout:3/0: dwrite - no filename 2022-02-02T18:21:12.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/4: symlink l2 0 2022-02-02T18:21:12.032 INFO:tasks.workunit.client.1.smithi159.stdout:3/1: mknod c0 0 2022-02-02T18:21:12.032 INFO:tasks.workunit.client.1.smithi159.stdout:3/2: read - no filename 2022-02-02T18:21:12.033 INFO:tasks.workunit.client.1.smithi159.stdout:3/3: dread - no filename 2022-02-02T18:21:12.033 INFO:tasks.workunit.client.1.smithi159.stdout:3/4: chown c0 1 1 2022-02-02T18:21:12.033 INFO:tasks.workunit.client.1.smithi159.stdout:3/5: fdatasync - no filename 2022-02-02T18:21:12.033 INFO:tasks.workunit.client.1.smithi159.stdout:3/6: dwrite - no filename 2022-02-02T18:21:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:3/7: write - no filename 2022-02-02T18:21:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:3/8: dread - no filename 2022-02-02T18:21:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:3/9: dread - no filename 2022-02-02T18:21:12.039 INFO:tasks.workunit.client.1.smithi159.stdout:5/0: dwrite - no filename 2022-02-02T18:21:12.039 INFO:tasks.workunit.client.1.smithi159.stdout:6/0: chown . 48679 1 2022-02-02T18:21:12.039 INFO:tasks.workunit.client.1.smithi159.stdout:6/1: dread - no filename 2022-02-02T18:21:12.039 INFO:tasks.workunit.client.1.smithi159.stdout:5/1: mknod c0 0 2022-02-02T18:21:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:5/2: chown c0 641 1 2022-02-02T18:21:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:5/3: dread - no filename 2022-02-02T18:21:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:5/4: write - no filename 2022-02-02T18:21:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/10: rename c0 to c1 0 2022-02-02T18:21:12.041 INFO:tasks.workunit.client.1.smithi159.stdout:3/11: chown c1 37023 1 2022-02-02T18:21:12.041 INFO:tasks.workunit.client.1.smithi159.stdout:3/12: read - no filename 2022-02-02T18:21:12.042 INFO:tasks.workunit.client.1.smithi159.stdout:6/2: mknod c0 0 2022-02-02T18:21:12.042 INFO:tasks.workunit.client.1.smithi159.stdout:6/3: dwrite - no filename 2022-02-02T18:21:12.042 INFO:tasks.workunit.client.1.smithi159.stdout:6/4: rmdir - no directory 2022-02-02T18:21:12.042 INFO:tasks.workunit.client.1.smithi159.stdout:6/5: creat f1 x:0 0 0 2022-02-02T18:21:12.043 INFO:tasks.workunit.client.1.smithi159.stdout:6/6: creat f2 x:0 0 0 2022-02-02T18:21:12.043 INFO:tasks.workunit.client.1.smithi159.stdout:6/7: creat f3 x:0 0 0 2022-02-02T18:21:12.043 INFO:tasks.workunit.client.1.smithi159.stdout:7/0: fsync - no filename 2022-02-02T18:21:12.043 INFO:tasks.workunit.client.1.smithi159.stdout:5/5: creat f1 x:0 0 0 2022-02-02T18:21:12.047 INFO:tasks.workunit.client.1.smithi159.stdout:6/8: link c0 c4 0 2022-02-02T18:21:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/0: dread - no filename 2022-02-02T18:21:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/1: dread - no filename 2022-02-02T18:21:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/2: rename - no filename 2022-02-02T18:21:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/3: dwrite - no filename 2022-02-02T18:21:12.049 INFO:tasks.workunit.client.1.smithi159.stdout:8/4: write - no filename 2022-02-02T18:21:12.049 INFO:tasks.workunit.client.1.smithi159.stdout:8/5: write - no filename 2022-02-02T18:21:12.049 INFO:tasks.workunit.client.1.smithi159.stdout:8/6: readlink - no filename 2022-02-02T18:21:12.049 INFO:tasks.workunit.client.1.smithi159.stdout:8/7: fdatasync - no filename 2022-02-02T18:21:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:8/8: fdatasync - no filename 2022-02-02T18:21:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:8/9: unlink - no file 2022-02-02T18:21:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:8/10: getdents . 0 2022-02-02T18:21:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:8/11: fsync - no filename 2022-02-02T18:21:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:8/12: dread - no filename 2022-02-02T18:21:12.051 INFO:tasks.workunit.client.1.smithi159.stdout:7/1: mknod c0 0 2022-02-02T18:21:12.052 INFO:tasks.workunit.client.1.smithi159.stdout:5/6: symlink l2 0 2022-02-02T18:21:12.052 INFO:tasks.workunit.client.1.smithi159.stdout:6/9: unlink f2 0 2022-02-02T18:21:12.052 INFO:tasks.workunit.client.1.smithi159.stdout:4/0: dread - no filename 2022-02-02T18:21:12.052 INFO:tasks.workunit.client.1.smithi159.stdout:8/13: symlink l0 0 2022-02-02T18:21:12.054 INFO:tasks.workunit.client.1.smithi159.stdout:5/7: rename c0 to c3 0 2022-02-02T18:21:12.054 INFO:tasks.workunit.client.1.smithi159.stdout:5/8: dread - f1 zero size 2022-02-02T18:21:12.054 INFO:tasks.workunit.client.1.smithi159.stdout:5/9: chown l2 11 1 2022-02-02T18:21:12.054 INFO:tasks.workunit.client.1.smithi159.stdout:5/10: dread - f1 zero size 2022-02-02T18:21:12.055 INFO:tasks.workunit.client.1.smithi159.stdout:4/1: mkdir d0 0 2022-02-02T18:21:12.056 INFO:tasks.workunit.client.1.smithi159.stdout:4/2: readlink - no filename 2022-02-02T18:21:12.056 INFO:tasks.workunit.client.1.smithi159.stdout:4/3: write - no filename 2022-02-02T18:21:12.056 INFO:tasks.workunit.client.1.smithi159.stdout:4/4: read - no filename 2022-02-02T18:21:12.056 INFO:tasks.workunit.client.1.smithi159.stdout:4/5: rename d0 to d0/d1 22 2022-02-02T18:21:12.056 INFO:tasks.workunit.client.1.smithi159.stdout:7/2: creat f1 x:0 0 0 2022-02-02T18:21:12.057 INFO:tasks.workunit.client.1.smithi159.stdout:8/14: mkdir d1 0 2022-02-02T18:21:12.059 INFO:tasks.workunit.client.1.smithi159.stdout:4/6: mknod d0/c2 0 2022-02-02T18:21:12.059 INFO:tasks.workunit.client.1.smithi159.stdout:4/7: chown d0/c2 1261 1 2022-02-02T18:21:12.060 INFO:tasks.workunit.client.1.smithi159.stdout:4/8: dread - no filename 2022-02-02T18:21:12.060 INFO:tasks.workunit.client.1.smithi159.stdout:7/3: mknod c2 0 2022-02-02T18:21:12.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/15: rename l0 to d1/l2 0 2022-02-02T18:21:12.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/16: read - no filename 2022-02-02T18:21:12.063 INFO:tasks.workunit.client.1.smithi159.stdout:8/17: dread - no filename 2022-02-02T18:21:12.063 INFO:tasks.workunit.client.1.smithi159.stdout:8/18: truncate - no filename 2022-02-02T18:21:12.063 INFO:tasks.workunit.client.1.smithi159.stdout:8/19: stat d1 0 2022-02-02T18:21:12.063 INFO:tasks.workunit.client.1.smithi159.stdout:8/20: write - no filename 2022-02-02T18:21:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:8/21: dread - no filename 2022-02-02T18:21:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:8/22: write - no filename 2022-02-02T18:21:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:8/23: rename d1 to d1/d3 22 2022-02-02T18:21:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:8/24: truncate - no filename 2022-02-02T18:21:12.066 INFO:tasks.workunit.client.1.smithi159.stdout:7/4: mkdir d3 0 2022-02-02T18:21:12.066 INFO:tasks.workunit.client.1.smithi159.stdout:7/5: readlink - no filename 2022-02-02T18:21:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:7/6: dread - f1 zero size 2022-02-02T18:21:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:7/7: truncate f1 514456 0 2022-02-02T18:21:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:7/8: write f1 [721064,61164] 0 2022-02-02T18:21:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:8/25: creat d1/f4 x:0 0 0 2022-02-02T18:21:12.068 INFO:tasks.workunit.client.1.smithi159.stdout:8/26: truncate d1/f4 324434 0 2022-02-02T18:21:12.068 INFO:tasks.workunit.client.1.smithi159.stdout:7/9: mknod d3/c4 0 2022-02-02T18:21:12.069 INFO:tasks.workunit.client.1.smithi159.stdout:4/9: creat d0/f3 x:0 0 0 2022-02-02T18:21:12.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/10: mkdir d3/d5 0 2022-02-02T18:21:12.070 INFO:tasks.workunit.client.1.smithi159.stdout:5/11: link f1 f4 0 2022-02-02T18:21:12.070 INFO:tasks.workunit.client.1.smithi159.stdout:4/10: symlink d0/l4 0 2022-02-02T18:21:12.070 INFO:tasks.workunit.client.1.smithi159.stdout:4/11: creat d0/f5 x:0 0 0 2022-02-02T18:21:12.071 INFO:tasks.workunit.client.1.smithi159.stdout:4/12: truncate d0/f3 180874 0 2022-02-02T18:21:12.071 INFO:tasks.workunit.client.1.smithi159.stdout:4/13: creat d0/f6 x:0 0 0 2022-02-02T18:21:12.074 INFO:tasks.workunit.client.1.smithi159.stdout:5/12: link f1 f5 0 2022-02-02T18:21:12.075 INFO:tasks.workunit.client.1.smithi159.stdout:2/0: fsync - no filename 2022-02-02T18:21:12.075 INFO:tasks.workunit.client.1.smithi159.stdout:2/1: chown . 1081281477 1 2022-02-02T18:21:12.075 INFO:tasks.workunit.client.1.smithi159.stdout:2/2: fdatasync - no filename 2022-02-02T18:21:12.075 INFO:tasks.workunit.client.1.smithi159.stdout:2/3: link - no file 2022-02-02T18:21:12.080 INFO:tasks.workunit.client.1.smithi159.stdout:9/0: mkdir d0 0 2022-02-02T18:21:12.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/1: fdatasync - no filename 2022-02-02T18:21:12.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/2: fsync - no filename 2022-02-02T18:21:12.092 INFO:tasks.workunit.client.1.smithi159.stdout:5/13: rename f5 to f6 0 2022-02-02T18:21:12.092 INFO:tasks.workunit.client.1.smithi159.stdout:5/14: rmdir - no directory 2022-02-02T18:21:12.093 INFO:tasks.workunit.client.1.smithi159.stdout:5/15: read - f6 zero size 2022-02-02T18:21:12.093 INFO:tasks.workunit.client.1.smithi159.stdout:5/16: creat f7 x:0 0 0 2022-02-02T18:21:12.093 INFO:tasks.workunit.client.1.smithi159.stdout:5/17: write f1 [110161,113800] 0 2022-02-02T18:21:12.093 INFO:tasks.workunit.client.1.smithi159.stdout:5/18: creat f8 x:0 0 0 2022-02-02T18:21:12.100 INFO:tasks.workunit.client.1.smithi159.stdout:5/19: mkdir d9 0 2022-02-02T18:21:12.128 INFO:tasks.workunit.client.1.smithi159.stdout:8/27: read d1/f4 [114177,75887] 0 2022-02-02T18:21:12.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/28: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:12.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/29: creat d1/f5 x:0 0 0 2022-02-02T18:21:12.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/30: readlink d1/l2 0 2022-02-02T18:21:12.146 INFO:tasks.workunit.client.1.smithi159.stdout:8/31: chown d1/l2 288634 1 2022-02-02T18:21:12.170 INFO:tasks.workunit.client.1.smithi159.stdout:7/11: dread f1 [0,4194304] 0 2022-02-02T18:21:12.173 INFO:tasks.workunit.client.1.smithi159.stdout:8/32: dwrite d1/f5 [0,4194304] 0 2022-02-02T18:21:12.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/3: write - no filename 2022-02-02T18:21:12.178 INFO:tasks.workunit.client.1.smithi159.stdout:9/4: mknod d0/c1 0 2022-02-02T18:21:12.181 INFO:tasks.workunit.client.1.smithi159.stdout:9/5: unlink d0/c1 0 2022-02-02T18:21:12.181 INFO:tasks.workunit.client.1.smithi159.stdout:9/6: truncate - no filename 2022-02-02T18:21:12.181 INFO:tasks.workunit.client.1.smithi159.stdout:9/7: chown d0 0 1 2022-02-02T18:21:12.181 INFO:tasks.workunit.client.1.smithi159.stdout:9/8: dwrite - no filename 2022-02-02T18:21:12.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/9: dwrite - no filename 2022-02-02T18:21:12.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/10: chown d0 78537 1 2022-02-02T18:21:12.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/11: rename d0 to d0/d2 22 2022-02-02T18:21:12.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/12: dwrite - no filename 2022-02-02T18:21:12.207 INFO:tasks.workunit.client.1.smithi159.stdout:1/5: dwrite f1 [0,4194304] 0 2022-02-02T18:21:12.247 INFO:tasks.workunit.client.1.smithi159.stdout:5/20: dwrite f7 [0,4194304] 0 2022-02-02T18:21:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:11 smithi159 conmon[35668]: cluster 2022-02-02T18:21:10.822057+0000 mgr.smithi096.shfutl (mgr.14162) 260 : cluster [DBG] 2022-02-02T18:21:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:11 smithi159 conmon[35668]: pgmap v209: 65 pgs: 65 active+clean; 134 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 659 op/s 2022-02-02T18:21:12.290 INFO:tasks.workunit.client.1.smithi159.stdout:3/13: link c1 c2 0 2022-02-02T18:21:12.290 INFO:tasks.workunit.client.1.smithi159.stdout:3/14: write - no filename 2022-02-02T18:21:12.290 INFO:tasks.workunit.client.1.smithi159.stdout:3/15: fdatasync - no filename 2022-02-02T18:21:12.306 INFO:tasks.workunit.client.1.smithi159.stdout:7/12: fsync f1 0 2022-02-02T18:21:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:11 smithi096 conmon[32067]: cluster 2022-02-02T18:21:10.822057+0000 mgr.smithi096.shfutl (mgr.14162) 260 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 134 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 659 op/s 2022-02-02T18:21:12.310 INFO:tasks.workunit.client.1.smithi159.stdout:4/14: fsync d0/f5 0 2022-02-02T18:21:12.335 INFO:tasks.workunit.client.1.smithi159.stdout:0/3: getdents . 0 2022-02-02T18:21:12.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/4: getdents . 0 2022-02-02T18:21:12.337 INFO:tasks.workunit.client.1.smithi159.stdout:6/10: getdents . 0 2022-02-02T18:21:12.337 INFO:tasks.workunit.client.1.smithi159.stdout:6/11: write f3 [597370,39803] 0 2022-02-02T18:21:12.349 INFO:tasks.workunit.client.1.smithi159.stdout:7/13: mkdir d3/d6 0 2022-02-02T18:21:12.349 INFO:tasks.workunit.client.1.smithi159.stdout:7/14: write f1 [1375399,3521] 0 2022-02-02T18:21:12.349 INFO:tasks.workunit.client.1.smithi159.stdout:7/15: getdents d3/d6 0 2022-02-02T18:21:12.349 INFO:tasks.workunit.client.1.smithi159.stdout:7/16: truncate f1 1395913 0 2022-02-02T18:21:12.350 INFO:tasks.workunit.client.1.smithi159.stdout:5/21: rename c3 to d9/ca 0 2022-02-02T18:21:12.351 INFO:tasks.workunit.client.1.smithi159.stdout:9/13: rmdir d0 0 2022-02-02T18:21:12.351 INFO:tasks.workunit.client.1.smithi159.stdout:9/14: link - no file 2022-02-02T18:21:12.351 INFO:tasks.workunit.client.1.smithi159.stdout:9/15: readlink - no filename 2022-02-02T18:21:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/16: fdatasync - no filename 2022-02-02T18:21:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/17: dread - no filename 2022-02-02T18:21:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/18: truncate - no filename 2022-02-02T18:21:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/19: write - no filename 2022-02-02T18:21:12.353 INFO:tasks.workunit.client.1.smithi159.stdout:9/20: write - no filename 2022-02-02T18:21:12.353 INFO:tasks.workunit.client.1.smithi159.stdout:9/21: truncate - no filename 2022-02-02T18:21:12.353 INFO:tasks.workunit.client.1.smithi159.stdout:9/22: link - no file 2022-02-02T18:21:12.355 INFO:tasks.workunit.client.1.smithi159.stdout:5/22: rename f6 to d9/fb 0 2022-02-02T18:21:12.355 INFO:tasks.workunit.client.1.smithi159.stdout:4/15: rename d0 to d0/d7 22 2022-02-02T18:21:12.355 INFO:tasks.workunit.client.1.smithi159.stdout:4/16: dread - d0/f6 zero size 2022-02-02T18:21:12.355 INFO:tasks.workunit.client.1.smithi159.stdout:5/23: write f8 [210220,55554] 0 2022-02-02T18:21:12.356 INFO:tasks.workunit.client.1.smithi159.stdout:5/24: chown f4 1 1 2022-02-02T18:21:12.356 INFO:tasks.workunit.client.1.smithi159.stdout:5/25: chown f8 2472425 1 2022-02-02T18:21:12.356 INFO:tasks.workunit.client.1.smithi159.stdout:7/17: unlink f1 0 2022-02-02T18:21:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/18: fsync - no filename 2022-02-02T18:21:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/19: write - no filename 2022-02-02T18:21:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/23: creat f3 x:0 0 0 2022-02-02T18:21:12.358 INFO:tasks.workunit.client.1.smithi159.stdout:5/26: write f7 [953055,96152] 0 2022-02-02T18:21:12.361 INFO:tasks.workunit.client.1.smithi159.stdout:1/6: dwrite f1 [0,4194304] 0 2022-02-02T18:21:12.361 INFO:tasks.workunit.client.1.smithi159.stdout:7/20: mknod d3/d5/c7 0 2022-02-02T18:21:12.362 INFO:tasks.workunit.client.1.smithi159.stdout:9/24: mkdir d4 0 2022-02-02T18:21:12.362 INFO:tasks.workunit.client.1.smithi159.stdout:9/25: chown d4 255531 1 2022-02-02T18:21:12.364 INFO:tasks.workunit.client.1.smithi159.stdout:7/21: mkdir d3/d5/d8 0 2022-02-02T18:21:12.368 INFO:tasks.workunit.client.1.smithi159.stdout:7/22: creat d3/d5/d8/f9 x:0 0 0 2022-02-02T18:21:12.368 INFO:tasks.workunit.client.1.smithi159.stdout:7/23: write d3/d5/d8/f9 [634941,6496] 0 2022-02-02T18:21:12.393 INFO:tasks.workunit.client.1.smithi159.stdout:3/16: getdents . 0 2022-02-02T18:21:12.398 INFO:tasks.workunit.client.1.smithi159.stdout:3/17: rename c1 to c3 0 2022-02-02T18:21:12.400 INFO:tasks.workunit.client.1.smithi159.stdout:3/18: symlink l4 0 2022-02-02T18:21:12.402 INFO:tasks.workunit.client.1.smithi159.stdout:3/19: creat f5 x:0 0 0 2022-02-02T18:21:12.403 INFO:tasks.workunit.client.1.smithi159.stdout:3/20: readlink l4 0 2022-02-02T18:21:12.416 INFO:tasks.workunit.client.1.smithi159.stdout:1/7: dwrite f1 [0,4194304] 0 2022-02-02T18:21:12.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/8: rename l2 to l3 0 2022-02-02T18:21:12.447 INFO:tasks.workunit.client.1.smithi159.stdout:3/21: dwrite f5 [0,4194304] 0 2022-02-02T18:21:12.459 INFO:tasks.workunit.client.1.smithi159.stdout:8/33: dwrite d1/f4 [0,4194304] 0 2022-02-02T18:21:12.463 INFO:tasks.workunit.client.1.smithi159.stdout:7/24: dread d3/d5/d8/f9 [0,4194304] 0 2022-02-02T18:21:12.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/25: read d3/d5/d8/f9 [500037,16613] 0 2022-02-02T18:21:12.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/26: stat d3/d5/d8 0 2022-02-02T18:21:12.465 INFO:tasks.workunit.client.1.smithi159.stdout:3/22: link l4 l6 0 2022-02-02T18:21:12.470 INFO:tasks.workunit.client.1.smithi159.stdout:3/23: unlink l6 0 2022-02-02T18:21:12.470 INFO:tasks.workunit.client.1.smithi159.stdout:8/34: link d1/l2 d1/l6 0 2022-02-02T18:21:12.474 INFO:tasks.workunit.client.1.smithi159.stdout:3/24: stat c3 0 2022-02-02T18:21:12.475 INFO:tasks.workunit.client.1.smithi159.stdout:8/35: symlink d1/l7 0 2022-02-02T18:21:12.475 INFO:tasks.workunit.client.1.smithi159.stdout:3/25: chown c2 291 1 2022-02-02T18:21:12.481 INFO:tasks.workunit.client.1.smithi159.stdout:3/26: creat f7 x:0 0 0 2022-02-02T18:21:12.486 INFO:tasks.workunit.client.1.smithi159.stdout:4/17: dwrite d0/f3 [0,4194304] 0 2022-02-02T18:21:12.494 INFO:tasks.workunit.client.1.smithi159.stdout:3/27: symlink l8 0 2022-02-02T18:21:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:4/18: mkdir d0/d8 0 2022-02-02T18:21:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:4/19: write d0/f6 [532075,90677] 0 2022-02-02T18:21:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:4/20: truncate d0/f5 774131 0 2022-02-02T18:21:12.509 INFO:tasks.workunit.client.1.smithi159.stdout:1/9: dwrite f1 [0,4194304] 0 2022-02-02T18:21:12.518 INFO:tasks.workunit.client.1.smithi159.stdout:7/27: truncate d3/d5/d8/f9 546196 0 2022-02-02T18:21:12.519 INFO:tasks.workunit.client.1.smithi159.stdout:7/28: readlink - no filename 2022-02-02T18:21:12.519 INFO:tasks.workunit.client.1.smithi159.stdout:8/36: getdents d1 0 2022-02-02T18:21:12.522 INFO:tasks.workunit.client.1.smithi159.stdout:7/29: mknod d3/d5/d8/ca 0 2022-02-02T18:21:12.529 INFO:tasks.workunit.client.1.smithi159.stdout:7/30: creat d3/fb x:0 0 0 2022-02-02T18:21:12.534 INFO:tasks.workunit.client.1.smithi159.stdout:3/28: getdents . 0 2022-02-02T18:21:12.534 INFO:tasks.workunit.client.1.smithi159.stdout:3/29: chown l4 259559464 1 2022-02-02T18:21:12.534 INFO:tasks.workunit.client.1.smithi159.stdout:3/30: chown l8 19887 1 2022-02-02T18:21:12.542 INFO:tasks.workunit.client.1.smithi159.stdout:8/37: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/31: dread f5 [0,4194304] 0 2022-02-02T18:21:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/32: fsync f5 0 2022-02-02T18:21:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/33: getdents . 0 2022-02-02T18:21:12.550 INFO:tasks.workunit.client.1.smithi159.stdout:3/34: chown l8 46719109 1 2022-02-02T18:21:12.552 INFO:tasks.workunit.client.1.smithi159.stdout:7/31: dread d3/d5/d8/f9 [0,4194304] 0 2022-02-02T18:21:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:7/32: chown c2 108119 1 2022-02-02T18:21:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:7/33: stat d3/d5/d8/ca 0 2022-02-02T18:21:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:7/34: read - d3/fb zero size 2022-02-02T18:21:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:4/21: dwrite d0/f6 [0,4194304] 0 2022-02-02T18:21:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:8/38: creat d1/f8 x:0 0 0 2022-02-02T18:21:12.557 INFO:tasks.workunit.client.1.smithi159.stdout:7/35: rename d3/d5/c7 to d3/d6/cc 0 2022-02-02T18:21:12.557 INFO:tasks.workunit.client.1.smithi159.stdout:4/22: mknod d0/c9 0 2022-02-02T18:21:12.559 INFO:tasks.workunit.client.1.smithi159.stdout:8/39: rename d1/l7 to d1/l9 0 2022-02-02T18:21:12.559 INFO:tasks.workunit.client.1.smithi159.stdout:8/40: creat d1/fa x:0 0 0 2022-02-02T18:21:12.561 INFO:tasks.workunit.client.1.smithi159.stdout:4/23: symlink d0/d8/la 0 2022-02-02T18:21:12.562 INFO:tasks.workunit.client.1.smithi159.stdout:4/24: creat d0/fb x:0 0 0 2022-02-02T18:21:12.562 INFO:tasks.workunit.client.1.smithi159.stdout:4/25: rename d0 to d0/dc 22 2022-02-02T18:21:12.564 INFO:tasks.workunit.client.1.smithi159.stdout:4/26: symlink d0/ld 0 2022-02-02T18:21:12.571 INFO:tasks.workunit.client.1.smithi159.stdout:3/35: dread f5 [0,4194304] 0 2022-02-02T18:21:12.571 INFO:tasks.workunit.client.1.smithi159.stdout:1/10: dwrite f1 [0,4194304] 0 2022-02-02T18:21:12.571 INFO:tasks.workunit.client.1.smithi159.stdout:1/11: chown f1 76199553 1 2022-02-02T18:21:12.576 INFO:tasks.workunit.client.1.smithi159.stdout:3/36: dread f5 [0,4194304] 0 2022-02-02T18:21:12.581 INFO:tasks.workunit.client.1.smithi159.stdout:6/12: dwrite f3 [0,4194304] 0 2022-02-02T18:21:12.587 INFO:tasks.workunit.client.1.smithi159.stdout:7/36: dwrite d3/fb [0,4194304] 0 2022-02-02T18:21:12.595 INFO:tasks.workunit.client.1.smithi159.stdout:4/27: rmdir d0 39 2022-02-02T18:21:12.598 INFO:tasks.workunit.client.1.smithi159.stdout:8/41: dwrite d1/f5 [0,4194304] 0 2022-02-02T18:21:12.598 INFO:tasks.workunit.client.1.smithi159.stdout:8/42: creat d1/fb x:0 0 0 2022-02-02T18:21:12.599 INFO:tasks.workunit.client.1.smithi159.stdout:3/37: write f5 [1223653,46034] 0 2022-02-02T18:21:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:8/43: write d1/f5 [2815938,22537] 0 2022-02-02T18:21:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/12: dread f1 [0,4194304] 0 2022-02-02T18:21:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/13: chown f1 577 1 2022-02-02T18:21:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/14: creat f4 x:0 0 0 2022-02-02T18:21:12.613 INFO:tasks.workunit.client.1.smithi159.stdout:3/38: dread f5 [0,4194304] 0 2022-02-02T18:21:12.615 INFO:tasks.workunit.client.1.smithi159.stdout:1/15: mknod c5 0 2022-02-02T18:21:12.615 INFO:tasks.workunit.client.1.smithi159.stdout:1/16: truncate f1 5092805 0 2022-02-02T18:21:12.621 INFO:tasks.workunit.client.1.smithi159.stdout:7/37: dread d3/fb [0,4194304] 0 2022-02-02T18:21:12.623 INFO:tasks.workunit.client.1.smithi159.stdout:3/39: creat f9 x:0 0 0 2022-02-02T18:21:12.623 INFO:tasks.workunit.client.1.smithi159.stdout:1/17: mknod c6 0 2022-02-02T18:21:12.623 INFO:tasks.workunit.client.1.smithi159.stdout:1/18: chown l0 20062579 1 2022-02-02T18:21:12.624 INFO:tasks.workunit.client.1.smithi159.stdout:1/19: stat c5 0 2022-02-02T18:21:12.624 INFO:tasks.workunit.client.1.smithi159.stdout:1/20: creat f7 x:0 0 0 2022-02-02T18:21:12.624 INFO:tasks.workunit.client.1.smithi159.stdout:1/21: chown l0 3 1 2022-02-02T18:21:12.627 INFO:tasks.workunit.client.1.smithi159.stdout:3/40: symlink la 0 2022-02-02T18:21:12.627 INFO:tasks.workunit.client.1.smithi159.stdout:3/41: write f7 [135381,96921] 0 2022-02-02T18:21:12.653 INFO:tasks.workunit.client.1.smithi159.stdout:7/38: truncate d3/fb 1937699 0 2022-02-02T18:21:12.653 INFO:tasks.workunit.client.1.smithi159.stdout:7/39: write d3/d5/d8/f9 [986548,103611] 0 2022-02-02T18:21:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:1/22: write f1 [1296590,7690] 0 2022-02-02T18:21:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:1/23: rmdir - no directory 2022-02-02T18:21:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:1/24: fdatasync f4 0 2022-02-02T18:21:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:1/25: write f7 [256340,13524] 0 2022-02-02T18:21:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:1/26: write f7 [1224351,53372] 0 2022-02-02T18:21:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:1/27: truncate f4 451696 0 2022-02-02T18:21:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:3/42: getdents . 0 2022-02-02T18:21:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:3/43: fdatasync f9 0 2022-02-02T18:21:12.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/44: mknod cb 0 2022-02-02T18:21:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:3/45: creat fc x:0 0 0 2022-02-02T18:21:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:3/46: write fc [780845,9968] 0 2022-02-02T18:21:12.666 INFO:tasks.workunit.client.1.smithi159.stdout:1/28: dread f4 [0,4194304] 0 2022-02-02T18:21:12.666 INFO:tasks.workunit.client.1.smithi159.stdout:3/47: dread - f9 zero size 2022-02-02T18:21:12.668 INFO:tasks.workunit.client.1.smithi159.stdout:1/29: symlink l8 0 2022-02-02T18:21:12.671 INFO:tasks.workunit.client.1.smithi159.stdout:1/30: symlink l9 0 2022-02-02T18:21:12.672 INFO:tasks.workunit.client.1.smithi159.stdout:1/31: symlink la 0 2022-02-02T18:21:12.684 INFO:tasks.workunit.client.1.smithi159.stdout:7/40: read d3/d5/d8/f9 [802062,63269] 0 2022-02-02T18:21:12.690 INFO:tasks.workunit.client.1.smithi159.stdout:7/41: dread d3/fb [0,4194304] 0 2022-02-02T18:21:12.691 INFO:tasks.workunit.client.1.smithi159.stdout:3/48: dread fc [0,4194304] 0 2022-02-02T18:21:12.694 INFO:tasks.workunit.client.1.smithi159.stdout:3/49: getdents . 0 2022-02-02T18:21:12.694 INFO:tasks.workunit.client.1.smithi159.stdout:3/50: truncate fc 912989 0 2022-02-02T18:21:12.695 INFO:tasks.workunit.client.1.smithi159.stdout:3/51: mkdir dd 0 2022-02-02T18:21:12.697 INFO:tasks.workunit.client.1.smithi159.stdout:3/52: mknod dd/ce 0 2022-02-02T18:21:12.714 INFO:tasks.workunit.client.1.smithi159.stdout:7/42: dwrite d3/d5/d8/f9 [0,4194304] 0 2022-02-02T18:21:12.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/43: rename d3/d5/d8/f9 to d3/d5/d8/fd 0 2022-02-02T18:21:12.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/44: write d3/fb [2308650,72777] 0 2022-02-02T18:21:12.723 INFO:tasks.workunit.client.1.smithi159.stdout:7/45: write d3/d5/d8/fd [4572702,11924] 0 2022-02-02T18:21:12.723 INFO:tasks.workunit.client.1.smithi159.stdout:7/46: stat d3/d5/d8 0 2022-02-02T18:21:12.724 INFO:tasks.workunit.client.1.smithi159.stdout:3/53: dwrite f5 [0,4194304] 0 2022-02-02T18:21:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:3/54: creat dd/ff x:0 0 0 2022-02-02T18:21:12.731 INFO:tasks.workunit.client.1.smithi159.stdout:3/55: symlink dd/l10 0 2022-02-02T18:21:12.732 INFO:tasks.workunit.client.1.smithi159.stdout:7/47: truncate d3/d5/d8/fd 2887134 0 2022-02-02T18:21:12.733 INFO:tasks.workunit.client.1.smithi159.stdout:3/56: dread f7 [0,4194304] 0 2022-02-02T18:21:12.733 INFO:tasks.workunit.client.1.smithi159.stdout:3/57: creat dd/f11 x:0 0 0 2022-02-02T18:21:12.735 INFO:tasks.workunit.client.1.smithi159.stdout:3/58: mknod dd/c12 0 2022-02-02T18:21:12.735 INFO:tasks.workunit.client.1.smithi159.stdout:3/59: chown l8 605 1 2022-02-02T18:21:12.735 INFO:tasks.workunit.client.1.smithi159.stdout:3/60: chown l8 1892399 1 2022-02-02T18:21:12.736 INFO:tasks.workunit.client.1.smithi159.stdout:3/61: write fc [1148033,17905] 0 2022-02-02T18:21:12.739 INFO:tasks.workunit.client.1.smithi159.stdout:3/62: fsync dd/ff 0 2022-02-02T18:21:12.739 INFO:tasks.workunit.client.1.smithi159.stdout:3/63: chown dd/l10 900232 1 2022-02-02T18:21:12.742 INFO:tasks.workunit.client.1.smithi159.stdout:3/64: symlink dd/l13 0 2022-02-02T18:21:12.743 INFO:tasks.workunit.client.1.smithi159.stdout:3/65: symlink dd/l14 0 2022-02-02T18:21:12.747 INFO:tasks.workunit.client.1.smithi159.stdout:7/48: write d3/d5/d8/fd [2146647,128663] 0 2022-02-02T18:21:12.751 INFO:tasks.workunit.client.1.smithi159.stdout:7/49: symlink d3/d5/le 0 2022-02-02T18:21:12.753 INFO:tasks.workunit.client.1.smithi159.stdout:7/50: mknod d3/d5/cf 0 2022-02-02T18:21:12.753 INFO:tasks.workunit.client.1.smithi159.stdout:7/51: rename d3/d5 to d3/d5/d10 22 2022-02-02T18:21:12.754 INFO:tasks.workunit.client.1.smithi159.stdout:7/52: write d3/d5/d8/fd [495063,14263] 0 2022-02-02T18:21:12.776 INFO:tasks.workunit.client.1.smithi159.stdout:7/53: dwrite d3/fb [0,4194304] 0 2022-02-02T18:21:12.798 INFO:tasks.workunit.client.1.smithi159.stdout:7/54: dwrite d3/d5/d8/fd [0,4194304] 0 2022-02-02T18:21:12.814 INFO:tasks.workunit.client.1.smithi159.stdout:7/55: dwrite d3/fb [4194304,4194304] 0 2022-02-02T18:21:12.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/56: dwrite d3/d5/d8/fd [0,4194304] 0 2022-02-02T18:21:12.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/57: chown d3/d5/cf 8170657 1 2022-02-02T18:21:12.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/58: chown d3/c4 42 1 2022-02-02T18:21:12.831 INFO:tasks.workunit.client.1.smithi159.stdout:7/59: read d3/fb [1924637,48583] 0 2022-02-02T18:21:12.832 INFO:tasks.workunit.client.1.smithi159.stdout:7/60: creat d3/d5/d8/f11 x:0 0 0 2022-02-02T18:21:12.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/61: creat d3/d5/f12 x:0 0 0 2022-02-02T18:21:12.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/62: creat d3/d5/f13 x:0 0 0 2022-02-02T18:21:12.835 INFO:tasks.workunit.client.1.smithi159.stdout:7/63: rename d3/d5/f13 to d3/f14 0 2022-02-02T18:21:12.836 INFO:tasks.workunit.client.1.smithi159.stdout:7/64: link c2 d3/c15 0 2022-02-02T18:21:12.837 INFO:tasks.workunit.client.1.smithi159.stdout:7/65: stat d3/d5/cf 0 2022-02-02T18:21:12.837 INFO:tasks.workunit.client.1.smithi159.stdout:7/66: chown d3/d5/d8/ca 19788858 1 2022-02-02T18:21:12.837 INFO:tasks.workunit.client.1.smithi159.stdout:7/67: mknod d3/d5/c16 0 2022-02-02T18:21:12.838 INFO:tasks.workunit.client.1.smithi159.stdout:7/68: creat d3/d6/f17 x:0 0 0 2022-02-02T18:21:12.839 INFO:tasks.workunit.client.1.smithi159.stdout:7/69: mkdir d3/d18 0 2022-02-02T18:21:12.853 INFO:tasks.workunit.client.1.smithi159.stdout:7/70: dwrite d3/f14 [0,4194304] 0 2022-02-02T18:21:12.862 INFO:tasks.workunit.client.1.smithi159.stdout:7/71: dread d3/fb [0,4194304] 0 2022-02-02T18:21:12.864 INFO:tasks.workunit.client.1.smithi159.stdout:7/72: mkdir d3/d19 0 2022-02-02T18:21:12.864 INFO:tasks.workunit.client.1.smithi159.stdout:7/73: write d3/f14 [4999132,42987] 0 2022-02-02T18:21:12.865 INFO:tasks.workunit.client.1.smithi159.stdout:7/74: write d3/fb [421333,123421] 0 2022-02-02T18:21:12.881 INFO:tasks.workunit.client.1.smithi159.stdout:7/75: dwrite d3/d5/d8/fd [0,4194304] 0 2022-02-02T18:21:12.881 INFO:tasks.workunit.client.1.smithi159.stdout:7/76: unlink c0 0 2022-02-02T18:21:12.882 INFO:tasks.workunit.client.1.smithi159.stdout:7/77: fsync d3/d5/f12 0 2022-02-02T18:21:12.890 INFO:tasks.workunit.client.1.smithi159.stdout:7/78: dread d3/fb [4194304,4194304] 0 2022-02-02T18:21:12.892 INFO:tasks.workunit.client.1.smithi159.stdout:7/79: mknod d3/d18/c1a 0 2022-02-02T18:21:12.892 INFO:tasks.workunit.client.1.smithi159.stdout:7/80: read d3/fb [3027609,67799] 0 2022-02-02T18:21:12.893 INFO:tasks.workunit.client.1.smithi159.stdout:7/81: read d3/d5/d8/fd [145432,64148] 0 2022-02-02T18:21:12.893 INFO:tasks.workunit.client.1.smithi159.stdout:7/82: creat d3/d5/f1b x:0 0 0 2022-02-02T18:21:12.893 INFO:tasks.workunit.client.1.smithi159.stdout:7/83: read d3/fb [8053000,65877] 0 2022-02-02T18:21:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:12 smithi096 conmon[32067]: cluster 2022-02-02T18:21:12.822630+0000 mgr.smithi096.shfutl (mgr.14162) 261 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 164 MiB data, 687 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 9.1 MiB/s wr, 834 op/s 2022-02-02T18:21:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:12 smithi159 conmon[35668]: cluster 2022-02-02T18:21:12.822630+0000 mgr.smithi096.shfutl (mgr.14162) 261 2022-02-02T18:21:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:12 smithi159 conmon[35668]: : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 164 MiB data, 687 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 9.1 MiB/s wr, 834 op/s 2022-02-02T18:21:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: cluster 2022-02-02T18:21:14.823105+0000 mgr.smithi096.shfutl (mgr.14162) 262 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 173 MiB data, 739 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 8.9 MiB/s wr, 907 op/s 2022-02-02T18:21:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: audit 2022-02-02T18:21:15.098501+0000 mon.smithi096 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:21:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:21:16.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: 02T18:21:15.099318+0000 2022-02-02T18:21:16.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: mon.smithi096 (mon.0) 565 : audit 2022-02-02T18:21:16.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:15 smithi159 conmon[35668]: [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:21:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:15 smithi096 conmon[32067]: cluster 2022-02-02T18:21:14.823105+0000 mgr.smithi096.shfutl (mgr.14162) 262 : cluster [DBG] 2022-02-02T18:21:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:15 smithi096 conmon[32067]: pgmap v211: 65 pgs: 65 active+clean; 173 MiB data, 739 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 8.9 MiB/s wr, 907 op/s 2022-02-02T18:21:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:15 smithi096 conmon[32067]: audit 2022-02-02T18:21:15.098501+0000 mon.smithi096 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:21:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:15 smithi096 conmon[32067]: audit 2022-02-02T18:21:15.099318+0000 mon.smithi096 (mon.0) 565 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:21:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:17 smithi159 conmon[35668]: cluster 2022-02-02T18:21:16.823662+0000 mgr.smithi096.shfutl (mgr.14162) 263 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 990 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 17 MiB/s wr, 1.25k op/s 2022-02-02T18:21:18.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:17 smithi096 conmon[32067]: cluster 2022-02-02T18:21:16.823662+0000 mgr.smithi096.shfutl (mgr.14162) 263 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 990 MiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 17 MiB/s wr, 1.25k op/s 2022-02-02T18:21:18.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2022-02-02T18:21:18.895 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2022-02-02T18:21:18.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ make 2022-02-02T18:21:18.974 INFO:tasks.workunit.client.0.smithi096.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2022-02-02T18:21:19.875 INFO:tasks.workunit.client.0.smithi096.stderr:++ readlink -f fsstress 2022-02-02T18:21:19.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2022-02-02T18:21:19.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2022-02-02T18:21:19.878 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2022-02-02T18:21:19.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2022-02-02T18:21:19.879 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp 2022-02-02T18:21:19.879 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp -d -p . 2022-02-02T18:21:19.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ T=./tmp.kPwonJpaO0 2022-02-02T18:21:19.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kPwonJpaO0 -l 1 -n 1000 -p 10 -v 2022-02-02T18:21:19.881 INFO:tasks.workunit.client.0.smithi096.stdout:seed = 1643618560 2022-02-02T18:21:19.883 INFO:tasks.workunit.client.0.smithi096.stdout:0/0: write - no filename 2022-02-02T18:21:19.883 INFO:tasks.workunit.client.0.smithi096.stdout:0/1: write - no filename 2022-02-02T18:21:19.884 INFO:tasks.workunit.client.0.smithi096.stdout:0/2: dread - no filename 2022-02-02T18:21:19.885 INFO:tasks.workunit.client.0.smithi096.stdout:0/3: read - no filename 2022-02-02T18:21:19.888 INFO:tasks.workunit.client.0.smithi096.stdout:1/0: getdents . 0 2022-02-02T18:21:19.889 INFO:tasks.workunit.client.0.smithi096.stdout:1/1: dread - no filename 2022-02-02T18:21:19.889 INFO:tasks.workunit.client.0.smithi096.stdout:1/2: dwrite - no filename 2022-02-02T18:21:19.890 INFO:tasks.workunit.client.0.smithi096.stdout:0/4: mknod c0 0 2022-02-02T18:21:19.890 INFO:tasks.workunit.client.0.smithi096.stdout:0/5: read - no filename 2022-02-02T18:21:19.890 INFO:tasks.workunit.client.0.smithi096.stdout:0/6: dwrite - no filename 2022-02-02T18:21:19.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/7: write - no filename 2022-02-02T18:21:19.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/8: dwrite - no filename 2022-02-02T18:21:19.892 INFO:tasks.workunit.client.0.smithi096.stdout:0/9: chown c0 371 1 2022-02-02T18:21:19.892 INFO:tasks.workunit.client.0.smithi096.stdout:0/10: dread - no filename 2022-02-02T18:21:19.893 INFO:tasks.workunit.client.0.smithi096.stdout:0/11: fsync - no filename 2022-02-02T18:21:19.893 INFO:tasks.workunit.client.0.smithi096.stdout:0/12: dread - no filename 2022-02-02T18:21:19.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/13: chown c0 5067261 1 2022-02-02T18:21:19.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/14: dread - no filename 2022-02-02T18:21:19.895 INFO:tasks.workunit.client.0.smithi096.stdout:0/15: truncate - no filename 2022-02-02T18:21:19.895 INFO:tasks.workunit.client.0.smithi096.stdout:0/16: write - no filename 2022-02-02T18:21:19.896 INFO:tasks.workunit.client.0.smithi096.stdout:0/17: dread - no filename 2022-02-02T18:21:19.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/0: read - no filename 2022-02-02T18:21:19.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/1: dwrite - no filename 2022-02-02T18:21:19.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/2: dwrite - no filename 2022-02-02T18:21:19.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/3: rename - no filename 2022-02-02T18:21:19.897 INFO:tasks.workunit.client.0.smithi096.stdout:2/4: dread - no filename 2022-02-02T18:21:19.897 INFO:tasks.workunit.client.0.smithi096.stdout:2/5: fdatasync - no filename 2022-02-02T18:21:19.897 INFO:tasks.workunit.client.0.smithi096.stdout:2/6: unlink - no file 2022-02-02T18:21:19.898 INFO:tasks.workunit.client.0.smithi096.stdout:2/7: readlink - no filename 2022-02-02T18:21:19.898 INFO:tasks.workunit.client.0.smithi096.stdout:2/8: dwrite - no filename 2022-02-02T18:21:19.898 INFO:tasks.workunit.client.0.smithi096.stdout:2/9: dwrite - no filename 2022-02-02T18:21:19.898 INFO:tasks.workunit.client.0.smithi096.stdout:2/10: unlink - no file 2022-02-02T18:21:19.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/11: write - no filename 2022-02-02T18:21:19.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/12: dread - no filename 2022-02-02T18:21:19.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/13: dwrite - no filename 2022-02-02T18:21:19.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/14: dread - no filename 2022-02-02T18:21:19.900 INFO:tasks.workunit.client.0.smithi096.stdout:1/3: mknod c0 0 2022-02-02T18:21:19.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/18: creat f1 x:0 0 0 2022-02-02T18:21:19.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/0: link - no file 2022-02-02T18:21:19.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/1: write - no filename 2022-02-02T18:21:19.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/2: fdatasync - no filename 2022-02-02T18:21:19.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/15: symlink l0 0 2022-02-02T18:21:19.906 INFO:tasks.workunit.client.0.smithi096.stdout:0/19: mkdir d2 0 2022-02-02T18:21:19.906 INFO:tasks.workunit.client.0.smithi096.stdout:4/0: getdents . 0 2022-02-02T18:21:19.906 INFO:tasks.workunit.client.0.smithi096.stdout:4/1: chown . 35 1 2022-02-02T18:21:19.906 INFO:tasks.workunit.client.0.smithi096.stdout:4/2: fdatasync - no filename 2022-02-02T18:21:19.907 INFO:tasks.workunit.client.0.smithi096.stdout:4/3: stat - no entries 2022-02-02T18:21:19.907 INFO:tasks.workunit.client.0.smithi096.stdout:3/3: mknod c0 0 2022-02-02T18:21:19.907 INFO:tasks.workunit.client.0.smithi096.stdout:2/16: creat f1 x:0 0 0 2022-02-02T18:21:19.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/20: creat d2/f3 x:0 0 0 2022-02-02T18:21:19.908 INFO:tasks.workunit.client.0.smithi096.stdout:0/21: dread - f1 zero size 2022-02-02T18:21:19.908 INFO:tasks.workunit.client.0.smithi096.stdout:0/22: creat d2/f4 x:0 0 0 2022-02-02T18:21:19.909 INFO:tasks.workunit.client.0.smithi096.stdout:0/23: write d2/f4 [673416,18383] 0 2022-02-02T18:21:19.909 INFO:tasks.workunit.client.0.smithi096.stdout:0/24: write f1 [175824,95429] 0 2022-02-02T18:21:19.909 INFO:tasks.workunit.client.0.smithi096.stdout:0/25: rename d2 to d2/d5 22 2022-02-02T18:21:19.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/26: truncate f1 626203 0 2022-02-02T18:21:19.910 INFO:tasks.workunit.client.0.smithi096.stdout:5/0: fsync - no filename 2022-02-02T18:21:19.910 INFO:tasks.workunit.client.0.smithi096.stdout:5/1: unlink - no file 2022-02-02T18:21:19.910 INFO:tasks.workunit.client.0.smithi096.stdout:1/4: getdents . 0 2022-02-02T18:21:19.911 INFO:tasks.workunit.client.0.smithi096.stdout:1/5: rmdir - no directory 2022-02-02T18:21:19.911 INFO:tasks.workunit.client.0.smithi096.stdout:4/4: mknod c0 0 2022-02-02T18:21:19.911 INFO:tasks.workunit.client.0.smithi096.stdout:4/5: readlink - no filename 2022-02-02T18:21:19.911 INFO:tasks.workunit.client.0.smithi096.stdout:3/4: rename c0 to c1 0 2022-02-02T18:21:19.911 INFO:tasks.workunit.client.0.smithi096.stdout:3/5: dwrite - no filename 2022-02-02T18:21:19.912 INFO:tasks.workunit.client.0.smithi096.stdout:3/6: write - no filename 2022-02-02T18:21:19.912 INFO:tasks.workunit.client.0.smithi096.stdout:3/7: read - no filename 2022-02-02T18:21:19.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/17: mkdir d2 0 2022-02-02T18:21:19.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/18: truncate f1 404119 0 2022-02-02T18:21:19.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/19: dread f1 [0,4194304] 0 2022-02-02T18:21:19.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/20: truncate f1 1351968 0 2022-02-02T18:21:19.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/27: mkdir d2/d6 0 2022-02-02T18:21:19.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/28: write d2/f4 [1164937,101275] 0 2022-02-02T18:21:19.914 INFO:tasks.workunit.client.0.smithi096.stdout:2/21: dread f1 [0,4194304] 0 2022-02-02T18:21:19.914 INFO:tasks.workunit.client.0.smithi096.stdout:2/22: write f1 [2376754,3076] 0 2022-02-02T18:21:19.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/0: dread - no filename 2022-02-02T18:21:19.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/1: stat - no entries 2022-02-02T18:21:19.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/2: dwrite - no filename 2022-02-02T18:21:19.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/3: dwrite - no filename 2022-02-02T18:21:19.915 INFO:tasks.workunit.client.0.smithi096.stdout:5/2: creat f0 x:0 0 0 2022-02-02T18:21:19.915 INFO:tasks.workunit.client.0.smithi096.stdout:5/3: fdatasync f0 0 2022-02-02T18:21:19.918 INFO:tasks.workunit.client.0.smithi096.stdout:1/6: symlink l1 0 2022-02-02T18:21:19.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/6: creat f1 x:0 0 0 2022-02-02T18:21:19.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/7: creat f2 x:0 0 0 2022-02-02T18:21:19.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/8: dread - f1 zero size 2022-02-02T18:21:19.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/9: chown f2 4134806 1 2022-02-02T18:21:19.920 INFO:tasks.workunit.client.0.smithi096.stdout:3/8: stat c1 0 2022-02-02T18:21:19.920 INFO:tasks.workunit.client.0.smithi096.stdout:3/9: truncate - no filename 2022-02-02T18:21:19.921 INFO:tasks.workunit.client.0.smithi096.stdout:0/29: mknod d2/c7 0 2022-02-02T18:21:19.921 INFO:tasks.workunit.client.0.smithi096.stdout:2/23: creat d2/f3 x:0 0 0 2022-02-02T18:21:19.922 INFO:tasks.workunit.client.0.smithi096.stdout:2/24: creat d2/f4 x:0 0 0 2022-02-02T18:21:19.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/0: dwrite - no filename 2022-02-02T18:21:19.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/1: dread - no filename 2022-02-02T18:21:19.923 INFO:tasks.workunit.client.0.smithi096.stdout:7/2: rename - no filename 2022-02-02T18:21:19.923 INFO:tasks.workunit.client.0.smithi096.stdout:6/4: creat f0 x:0 0 0 2022-02-02T18:21:19.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/5: chown f0 30 1 2022-02-02T18:21:19.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/6: rmdir - no directory 2022-02-02T18:21:19.924 INFO:tasks.workunit.client.0.smithi096.stdout:4/10: mkdir d3 0 2022-02-02T18:21:19.924 INFO:tasks.workunit.client.0.smithi096.stdout:4/11: fdatasync f1 0 2022-02-02T18:21:19.925 INFO:tasks.workunit.client.0.smithi096.stdout:4/12: dread - f1 zero size 2022-02-02T18:21:19.925 INFO:tasks.workunit.client.0.smithi096.stdout:0/30: rmdir d2/d6 0 2022-02-02T18:21:19.926 INFO:tasks.workunit.client.0.smithi096.stdout:3/10: mkdir d2 0 2022-02-02T18:21:19.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/0: rmdir - no directory 2022-02-02T18:21:19.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/1: chown . 135 1 2022-02-02T18:21:19.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/2: write - no filename 2022-02-02T18:21:19.927 INFO:tasks.workunit.client.0.smithi096.stdout:8/3: truncate - no filename 2022-02-02T18:21:19.928 INFO:tasks.workunit.client.0.smithi096.stdout:1/7: mknod c2 0 2022-02-02T18:21:19.929 INFO:tasks.workunit.client.0.smithi096.stdout:4/13: mkdir d3/d4 0 2022-02-02T18:21:19.929 INFO:tasks.workunit.client.0.smithi096.stdout:1/8: readlink l1 0 2022-02-02T18:21:19.929 INFO:tasks.workunit.client.0.smithi096.stdout:1/9: dread - no filename 2022-02-02T18:21:19.929 INFO:tasks.workunit.client.0.smithi096.stdout:0/31: mknod d2/c8 0 2022-02-02T18:21:19.930 INFO:tasks.workunit.client.0.smithi096.stdout:7/3: creat f0 x:0 0 0 2022-02-02T18:21:19.930 INFO:tasks.workunit.client.0.smithi096.stdout:9/0: dread - no filename 2022-02-02T18:21:19.948 INFO:tasks.workunit.client.0.smithi096.stdout:4/14: creat d3/f5 x:0 0 0 2022-02-02T18:21:19.948 INFO:tasks.workunit.client.0.smithi096.stdout:0/32: mknod d2/c9 0 2022-02-02T18:21:19.948 INFO:tasks.workunit.client.0.smithi096.stdout:7/4: mknod c1 0 2022-02-02T18:21:19.948 INFO:tasks.workunit.client.0.smithi096.stdout:0/33: creat d2/fa x:0 0 0 2022-02-02T18:21:19.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/5: stat c1 0 2022-02-02T18:21:19.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/6: chown f0 1106889417 1 2022-02-02T18:21:19.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/7: chown f0 64447 1 2022-02-02T18:21:19.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/8: creat f2 x:0 0 0 2022-02-02T18:21:19.952 INFO:tasks.workunit.client.0.smithi096.stdout:1/10: creat f3 x:0 0 0 2022-02-02T18:21:19.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/1: creat f0 x:0 0 0 2022-02-02T18:21:19.956 INFO:tasks.workunit.client.0.smithi096.stdout:0/34: mkdir d2/db 0 2022-02-02T18:21:19.956 INFO:tasks.workunit.client.0.smithi096.stdout:0/35: stat d2/db 0 2022-02-02T18:21:19.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/36: dread - d2/f3 zero size 2022-02-02T18:21:19.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/37: dread - d2/fa zero size 2022-02-02T18:21:19.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/38: stat d2/c8 0 2022-02-02T18:21:19.972 INFO:tasks.workunit.client.0.smithi096.stdout:3/11: rename c1 to d2/c3 0 2022-02-02T18:21:19.972 INFO:tasks.workunit.client.0.smithi096.stdout:3/12: dwrite - no filename 2022-02-02T18:21:19.985 INFO:tasks.workunit.client.0.smithi096.stdout:6/7: dwrite f0 [0,4194304] 0 2022-02-02T18:21:19.985 INFO:tasks.workunit.client.0.smithi096.stdout:6/8: rmdir - no directory 2022-02-02T18:21:19.991 INFO:tasks.workunit.client.0.smithi096.stdout:6/9: mknod c1 0 2022-02-02T18:21:19.992 INFO:tasks.workunit.client.0.smithi096.stdout:2/25: getdents d2 0 2022-02-02T18:21:19.994 INFO:tasks.workunit.client.0.smithi096.stdout:6/10: rename f0 to f2 0 2022-02-02T18:21:20.028 INFO:tasks.workunit.client.0.smithi096.stdout:5/4: dwrite f0 [0,4194304] 0 2022-02-02T18:21:20.212 INFO:tasks.workunit.client.0.smithi096.stdout:6/11: dread f2 [0,4194304] 0 2022-02-02T18:21:20.212 INFO:tasks.workunit.client.0.smithi096.stdout:6/12: read f2 [3172344,120478] 0 2022-02-02T18:21:20.213 INFO:tasks.workunit.client.0.smithi096.stdout:6/13: readlink - no filename 2022-02-02T18:21:20.225 INFO:tasks.workunit.client.0.smithi096.stdout:2/26: write f1 [2136987,113045] 0 2022-02-02T18:21:20.265 INFO:tasks.workunit.client.0.smithi096.stdout:0/39: fsync d2/f4 0 2022-02-02T18:21:20.265 INFO:tasks.workunit.client.0.smithi096.stdout:0/40: chown d2/c7 13575 1 2022-02-02T18:21:20.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/11: dwrite f3 [0,4194304] 0 2022-02-02T18:21:20.275 INFO:tasks.workunit.client.0.smithi096.stdout:9/2: truncate f0 409572 0 2022-02-02T18:21:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:19 smithi159 conmon[35668]: cluster 2022-02-02T18:21:18.824011+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:21:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:19 smithi159 conmon[35668]: ) 264 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 261 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 15 MiB/s wr, 773 op/s 2022-02-02T18:21:20.284 INFO:tasks.workunit.client.0.smithi096.stdout:4/15: fsync d3/f5 0 2022-02-02T18:21:20.286 INFO:tasks.workunit.client.0.smithi096.stdout:0/41: fsync d2/fa 0 2022-02-02T18:21:20.289 INFO:tasks.workunit.client.0.smithi096.stdout:3/13: link d2/c3 d2/c4 0 2022-02-02T18:21:20.289 INFO:tasks.workunit.client.0.smithi096.stdout:3/14: write - no filename 2022-02-02T18:21:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:19 smithi096 conmon[32067]: cluster 2022-02-02T18:21:18.824011+0000 mgr.smithi096.shfutl (mgr.14162) 264 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 261 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 15 MiB/s wr, 773 op/s 2022-02-02T18:21:20.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/27: dwrite d2/f3 [0,4194304] 0 2022-02-02T18:21:20.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/28: write d2/f4 [544451,97762] 0 2022-02-02T18:21:20.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/29: write d2/f4 [1037132,82254] 0 2022-02-02T18:21:20.320 INFO:tasks.workunit.client.0.smithi096.stdout:2/30: rename d2 to d2/d5 22 2022-02-02T18:21:20.325 INFO:tasks.workunit.client.0.smithi096.stdout:7/9: dwrite f2 [0,4194304] 0 2022-02-02T18:21:20.326 INFO:tasks.workunit.client.0.smithi096.stdout:5/5: dwrite f0 [0,4194304] 0 2022-02-02T18:21:20.341 INFO:tasks.workunit.client.0.smithi096.stdout:7/10: dread f2 [0,4194304] 0 2022-02-02T18:21:20.346 INFO:tasks.workunit.client.0.smithi096.stdout:5/6: dwrite f0 [0,4194304] 0 2022-02-02T18:21:20.593 INFO:tasks.workunit.client.0.smithi096.stdout:6/14: mknod c3 0 2022-02-02T18:21:21.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/3: mkdir d1 0 2022-02-02T18:21:21.028 INFO:tasks.workunit.client.0.smithi096.stdout:9/4: dwrite f0 [0,4194304] 0 2022-02-02T18:21:21.028 INFO:tasks.workunit.client.0.smithi096.stdout:9/5: chown f0 186590225 1 2022-02-02T18:21:21.028 INFO:tasks.workunit.client.0.smithi096.stdout:9/6: chown d1 1 1 2022-02-02T18:21:21.049 INFO:tasks.workunit.client.0.smithi096.stdout:0/42: creat d2/db/fc x:0 0 0 2022-02-02T18:21:21.133 INFO:tasks.workunit.client.0.smithi096.stdout:2/31: mkdir d2/d6 0 2022-02-02T18:21:21.178 INFO:tasks.workunit.client.0.smithi096.stdout:7/11: rename c1 to c3 0 2022-02-02T18:21:21.179 INFO:tasks.workunit.client.0.smithi096.stdout:5/7: unlink f0 0 2022-02-02T18:21:21.179 INFO:tasks.workunit.client.0.smithi096.stdout:5/8: dread - no filename 2022-02-02T18:21:21.180 INFO:tasks.workunit.client.0.smithi096.stdout:6/15: symlink l4 0 2022-02-02T18:21:21.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/12: getdents . 0 2022-02-02T18:21:21.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/13: fdatasync f3 0 2022-02-02T18:21:21.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/14: chown c2 2022 1 2022-02-02T18:21:21.184 INFO:tasks.workunit.client.0.smithi096.stdout:9/7: symlink d1/l2 0 2022-02-02T18:21:21.185 INFO:tasks.workunit.client.0.smithi096.stdout:6/16: dread f2 [0,4194304] 0 2022-02-02T18:21:21.185 INFO:tasks.workunit.client.0.smithi096.stdout:6/17: chown c1 9281238 1 2022-02-02T18:21:21.185 INFO:tasks.workunit.client.0.smithi096.stdout:4/16: getdents d3 0 2022-02-02T18:21:21.186 INFO:tasks.workunit.client.0.smithi096.stdout:6/18: write f2 [3541835,102932] 0 2022-02-02T18:21:21.189 INFO:tasks.workunit.client.0.smithi096.stdout:1/15: dread f3 [0,4194304] 0 2022-02-02T18:21:21.192 INFO:tasks.workunit.client.0.smithi096.stdout:0/43: link d2/fa d2/db/fd 0 2022-02-02T18:21:21.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/32: creat d2/f7 x:0 0 0 2022-02-02T18:21:21.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/33: truncate d2/f3 4250155 0 2022-02-02T18:21:21.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/34: creat d2/f8 x:0 0 0 2022-02-02T18:21:21.194 INFO:tasks.workunit.client.0.smithi096.stdout:5/9: mknod c1 0 2022-02-02T18:21:21.194 INFO:tasks.workunit.client.0.smithi096.stdout:5/10: write - no filename 2022-02-02T18:21:21.194 INFO:tasks.workunit.client.0.smithi096.stdout:5/11: stat c1 0 2022-02-02T18:21:21.195 INFO:tasks.workunit.client.0.smithi096.stdout:5/12: stat c1 0 2022-02-02T18:21:21.195 INFO:tasks.workunit.client.0.smithi096.stdout:9/8: mknod d1/c3 0 2022-02-02T18:21:21.195 INFO:tasks.workunit.client.0.smithi096.stdout:4/17: rmdir d3 39 2022-02-02T18:21:21.196 INFO:tasks.workunit.client.0.smithi096.stdout:6/19: mknod c5 0 2022-02-02T18:21:21.197 INFO:tasks.workunit.client.0.smithi096.stdout:6/20: fsync f2 0 2022-02-02T18:21:21.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/44: unlink f1 0 2022-02-02T18:21:21.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/45: truncate d2/fa 321106 0 2022-02-02T18:21:21.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/46: readlink - no filename 2022-02-02T18:21:21.200 INFO:tasks.workunit.client.0.smithi096.stdout:9/9: creat d1/f4 x:0 0 0 2022-02-02T18:21:21.200 INFO:tasks.workunit.client.0.smithi096.stdout:7/12: dwrite f0 [0,4194304] 0 2022-02-02T18:21:21.201 INFO:tasks.workunit.client.0.smithi096.stdout:4/18: rename d3/f5 to d3/f6 0 2022-02-02T18:21:21.202 INFO:tasks.workunit.client.0.smithi096.stdout:4/19: dread - d3/f6 zero size 2022-02-02T18:21:21.202 INFO:tasks.workunit.client.0.smithi096.stdout:4/20: dread - f1 zero size 2022-02-02T18:21:21.202 INFO:tasks.workunit.client.0.smithi096.stdout:7/13: write f2 [1950764,30152] 0 2022-02-02T18:21:21.203 INFO:tasks.workunit.client.0.smithi096.stdout:7/14: fdatasync f0 0 2022-02-02T18:21:21.203 INFO:tasks.workunit.client.0.smithi096.stdout:0/47: mknod d2/db/ce 0 2022-02-02T18:21:21.204 INFO:tasks.workunit.client.0.smithi096.stdout:9/10: link f0 d1/f5 0 2022-02-02T18:21:21.204 INFO:tasks.workunit.client.0.smithi096.stdout:7/15: write f2 [594718,110316] 0 2022-02-02T18:21:21.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/16: link c0 c4 0 2022-02-02T18:21:21.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/17: chown c2 452271 1 2022-02-02T18:21:21.208 INFO:tasks.workunit.client.0.smithi096.stdout:1/18: read f3 [849366,49433] 0 2022-02-02T18:21:21.208 INFO:tasks.workunit.client.0.smithi096.stdout:0/48: rename d2/db/fd to d2/ff 0 2022-02-02T18:21:21.211 INFO:tasks.workunit.client.0.smithi096.stdout:1/19: creat f5 x:0 0 0 2022-02-02T18:21:21.213 INFO:tasks.workunit.client.0.smithi096.stdout:2/35: rmdir d2 39 2022-02-02T18:21:21.214 INFO:tasks.workunit.client.0.smithi096.stdout:7/16: getdents . 0 2022-02-02T18:21:21.220 INFO:tasks.workunit.client.0.smithi096.stdout:9/11: dwrite f0 [0,4194304] 0 2022-02-02T18:21:21.220 INFO:tasks.workunit.client.0.smithi096.stdout:9/12: creat d1/f6 x:0 0 0 2022-02-02T18:21:21.223 INFO:tasks.workunit.client.0.smithi096.stdout:1/20: rename c0 to c6 0 2022-02-02T18:21:21.224 INFO:tasks.workunit.client.0.smithi096.stdout:1/21: dread - f5 zero size 2022-02-02T18:21:21.224 INFO:tasks.workunit.client.0.smithi096.stdout:1/22: chown c2 24879193 1 2022-02-02T18:21:21.224 INFO:tasks.workunit.client.0.smithi096.stdout:1/23: write f5 [856774,103538] 0 2022-02-02T18:21:21.228 INFO:tasks.workunit.client.0.smithi096.stdout:0/49: truncate d2/fa 99397 0 2022-02-02T18:21:21.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/50: mkdir d2/db/d10 0 2022-02-02T18:21:21.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/24: dread f5 [0,4194304] 0 2022-02-02T18:21:21.232 INFO:tasks.workunit.client.0.smithi096.stdout:0/51: mknod d2/db/c11 0 2022-02-02T18:21:21.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/25: symlink l7 0 2022-02-02T18:21:21.235 INFO:tasks.workunit.client.0.smithi096.stdout:1/26: creat f8 x:0 0 0 2022-02-02T18:21:21.251 INFO:tasks.workunit.client.0.smithi096.stdout:2/36: dwrite d2/f7 [0,4194304] 0 2022-02-02T18:21:21.252 INFO:tasks.workunit.client.0.smithi096.stdout:9/13: dwrite d1/f6 [0,4194304] 0 2022-02-02T18:21:21.252 INFO:tasks.workunit.client.0.smithi096.stdout:1/27: dwrite f5 [0,4194304] 0 2022-02-02T18:21:21.254 INFO:tasks.workunit.client.0.smithi096.stdout:0/52: rmdir d2/db 39 2022-02-02T18:21:21.255 INFO:tasks.workunit.client.0.smithi096.stdout:0/53: read d2/ff [38763,23637] 0 2022-02-02T18:21:21.257 INFO:tasks.workunit.client.0.smithi096.stdout:2/37: rename d2/f3 to d2/f9 0 2022-02-02T18:21:21.257 INFO:tasks.workunit.client.0.smithi096.stdout:2/38: fsync d2/f8 0 2022-02-02T18:21:21.259 INFO:tasks.workunit.client.0.smithi096.stdout:9/14: mkdir d1/d7 0 2022-02-02T18:21:21.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/15: write f0 [3012138,96403] 0 2022-02-02T18:21:21.262 INFO:tasks.workunit.client.0.smithi096.stdout:1/28: truncate f3 1119414 0 2022-02-02T18:21:21.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/54: getdents d2/db 0 2022-02-02T18:21:21.264 INFO:tasks.workunit.client.0.smithi096.stdout:2/39: creat d2/d6/fa x:0 0 0 2022-02-02T18:21:21.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/29: unlink c6 0 2022-02-02T18:21:21.268 INFO:tasks.workunit.client.0.smithi096.stdout:0/55: symlink d2/db/l12 0 2022-02-02T18:21:21.269 INFO:tasks.workunit.client.0.smithi096.stdout:0/56: mknod d2/c13 0 2022-02-02T18:21:21.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/30: mknod c9 0 2022-02-02T18:21:21.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/31: fsync f8 0 2022-02-02T18:21:21.272 INFO:tasks.workunit.client.0.smithi096.stdout:0/57: read d2/ff [78884,127625] 0 2022-02-02T18:21:21.272 INFO:tasks.workunit.client.0.smithi096.stdout:2/40: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:21.272 INFO:tasks.workunit.client.0.smithi096.stdout:2/41: write d2/f9 [3928908,90412] 0 2022-02-02T18:21:21.273 INFO:tasks.workunit.client.0.smithi096.stdout:1/32: rename l1 to la 0 2022-02-02T18:21:21.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/33: unlink f5 0 2022-02-02T18:21:21.274 INFO:tasks.workunit.client.0.smithi096.stdout:2/42: mkdir d2/d6/db 0 2022-02-02T18:21:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:20 smithi159 conmon[35668]: cluster 2022-02-02T18:21:20.824496+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:21:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:20 smithi159 conmon[35668]: 265 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 261 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 716 op/s 2022-02-02T18:21:21.277 INFO:tasks.workunit.client.0.smithi096.stdout:2/43: creat d2/d6/db/fc x:0 0 0 2022-02-02T18:21:21.277 INFO:tasks.workunit.client.0.smithi096.stdout:1/34: mknod cb 0 2022-02-02T18:21:21.277 INFO:tasks.workunit.client.0.smithi096.stdout:1/35: unlink cb 0 2022-02-02T18:21:21.277 INFO:tasks.workunit.client.0.smithi096.stdout:1/36: chown l7 2029 1 2022-02-02T18:21:21.279 INFO:tasks.workunit.client.0.smithi096.stdout:0/58: dread d2/f4 [0,4194304] 0 2022-02-02T18:21:21.280 INFO:tasks.workunit.client.0.smithi096.stdout:9/16: dwrite d1/f4 [0,4194304] 0 2022-02-02T18:21:21.281 INFO:tasks.workunit.client.0.smithi096.stdout:0/59: dread d2/fa [0,4194304] 0 2022-02-02T18:21:21.287 INFO:tasks.workunit.client.0.smithi096.stdout:9/17: rename f0 to d1/f8 0 2022-02-02T18:21:21.287 INFO:tasks.workunit.client.0.smithi096.stdout:2/44: rmdir d2/d6 39 2022-02-02T18:21:21.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/37: link f8 fc 0 2022-02-02T18:21:21.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/38: truncate fc 733761 0 2022-02-02T18:21:21.293 INFO:tasks.workunit.client.0.smithi096.stdout:9/18: mkdir d1/d9 0 2022-02-02T18:21:21.293 INFO:tasks.workunit.client.0.smithi096.stdout:9/19: fsync d1/f6 0 2022-02-02T18:21:21.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/20: write d1/f4 [4669058,119330] 0 2022-02-02T18:21:21.294 INFO:tasks.workunit.client.0.smithi096.stdout:2/45: symlink d2/d6/ld 0 2022-02-02T18:21:21.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/46: creat d2/fe x:0 0 0 2022-02-02T18:21:21.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/47: chown d2/d6 497 1 2022-02-02T18:21:21.297 INFO:tasks.workunit.client.0.smithi096.stdout:2/48: dread - d2/d6/fa zero size 2022-02-02T18:21:21.297 INFO:tasks.workunit.client.0.smithi096.stdout:2/49: truncate d2/d6/fa 560781 0 2022-02-02T18:21:21.297 INFO:tasks.workunit.client.0.smithi096.stdout:2/50: mknod d2/d6/cf 0 2022-02-02T18:21:21.299 INFO:tasks.workunit.client.0.smithi096.stdout:2/51: mkdir d2/d6/db/d10 0 2022-02-02T18:21:21.300 INFO:tasks.workunit.client.0.smithi096.stdout:2/52: symlink d2/l11 0 2022-02-02T18:21:21.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/39: rename f8 to fd 0 2022-02-02T18:21:21.305 INFO:tasks.workunit.client.0.smithi096.stdout:1/40: creat fe x:0 0 0 2022-02-02T18:21:21.306 INFO:tasks.workunit.client.0.smithi096.stdout:9/21: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:21.306 INFO:tasks.workunit.client.0.smithi096.stdout:1/41: creat ff x:0 0 0 2022-02-02T18:21:21.307 INFO:tasks.workunit.client.0.smithi096.stdout:1/42: chown fe 7737821 1 2022-02-02T18:21:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:20 smithi096 conmon[32067]: cluster 2022-02-02T18:21:20.824496+0000 mgr.smithi096.shfutl (mgr.14162) 265 : cluster 2022-02-02T18:21:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:20 smithi096 conmon[32067]: [DBG] pgmap v214: 65 pgs: 65 active+clean; 261 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 716 op/s 2022-02-02T18:21:21.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/60: dwrite d2/db/fc [0,4194304] 0 2022-02-02T18:21:21.311 INFO:tasks.workunit.client.0.smithi096.stdout:2/53: getdents d2/d6/db 0 2022-02-02T18:21:21.311 INFO:tasks.workunit.client.0.smithi096.stdout:2/54: write d2/f8 [10098,103736] 0 2022-02-02T18:21:21.313 INFO:tasks.workunit.client.0.smithi096.stdout:0/61: chown d2/db/c11 11965 1 2022-02-02T18:21:21.314 INFO:tasks.workunit.client.0.smithi096.stdout:2/55: mknod d2/c12 0 2022-02-02T18:21:21.315 INFO:tasks.workunit.client.0.smithi096.stdout:0/62: getdents d2/db 0 2022-02-02T18:21:21.318 INFO:tasks.workunit.client.0.smithi096.stdout:0/63: mknod d2/db/c14 0 2022-02-02T18:21:21.318 INFO:tasks.workunit.client.0.smithi096.stdout:0/64: readlink d2/db/l12 0 2022-02-02T18:21:21.326 INFO:tasks.workunit.client.0.smithi096.stdout:0/65: write d2/db/fc [3371376,31161] 0 2022-02-02T18:21:21.327 INFO:tasks.workunit.client.0.smithi096.stdout:0/66: creat d2/f15 x:0 0 0 2022-02-02T18:21:21.330 INFO:tasks.workunit.client.0.smithi096.stdout:9/22: dwrite d1/f5 [0,4194304] 0 2022-02-02T18:21:21.331 INFO:tasks.workunit.client.0.smithi096.stdout:9/23: write d1/f4 [1040203,35995] 0 2022-02-02T18:21:21.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/43: dwrite fe [0,4194304] 0 2022-02-02T18:21:21.334 INFO:tasks.workunit.client.0.smithi096.stdout:2/56: dwrite d2/f4 [0,4194304] 0 2022-02-02T18:21:21.335 INFO:tasks.workunit.client.0.smithi096.stdout:2/57: chown f1 1498699 1 2022-02-02T18:21:21.338 INFO:tasks.workunit.client.0.smithi096.stdout:2/58: mkdir d2/d13 0 2022-02-02T18:21:21.340 INFO:tasks.workunit.client.0.smithi096.stdout:1/44: rename la to l10 0 2022-02-02T18:21:21.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/24: dread d1/f6 [0,4194304] 0 2022-02-02T18:21:21.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/25: stat d1/f5 0 2022-02-02T18:21:21.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/26: mknod d1/d7/ca 0 2022-02-02T18:21:21.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/27: mkdir d1/db 0 2022-02-02T18:21:21.344 INFO:tasks.workunit.client.0.smithi096.stdout:9/28: chown d1/f5 2062158706 1 2022-02-02T18:21:21.344 INFO:tasks.workunit.client.0.smithi096.stdout:9/29: chown d1/d7 1296152 1 2022-02-02T18:21:21.344 INFO:tasks.workunit.client.0.smithi096.stdout:9/30: readlink d1/l2 0 2022-02-02T18:21:21.345 INFO:tasks.workunit.client.0.smithi096.stdout:0/67: dwrite d2/f15 [0,4194304] 0 2022-02-02T18:21:21.345 INFO:tasks.workunit.client.0.smithi096.stdout:9/31: write d1/f5 [3924728,81033] 0 2022-02-02T18:21:21.347 INFO:tasks.workunit.client.0.smithi096.stdout:1/45: truncate fe 911350 0 2022-02-02T18:21:21.348 INFO:tasks.workunit.client.0.smithi096.stdout:2/59: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:21.348 INFO:tasks.workunit.client.0.smithi096.stdout:2/60: fdatasync d2/fe 0 2022-02-02T18:21:21.349 INFO:tasks.workunit.client.0.smithi096.stdout:2/61: stat d2/fe 0 2022-02-02T18:21:21.350 INFO:tasks.workunit.client.0.smithi096.stdout:9/32: symlink d1/d9/lc 0 2022-02-02T18:21:21.350 INFO:tasks.workunit.client.0.smithi096.stdout:9/33: chown d1 6987614 1 2022-02-02T18:21:21.351 INFO:tasks.workunit.client.0.smithi096.stdout:9/34: write d1/f8 [171097,83287] 0 2022-02-02T18:21:21.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/68: creat d2/db/d10/f16 x:0 0 0 2022-02-02T18:21:21.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/69: truncate d2/ff 1119126 0 2022-02-02T18:21:21.360 INFO:tasks.workunit.client.0.smithi096.stdout:9/35: mkdir d1/d7/dd 0 2022-02-02T18:21:21.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/70: mknod d2/c17 0 2022-02-02T18:21:21.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/71: dread d2/f4 [0,4194304] 0 2022-02-02T18:21:21.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/72: creat d2/db/d10/f18 x:0 0 0 2022-02-02T18:21:21.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/73: fsync d2/f4 0 2022-02-02T18:21:21.362 INFO:tasks.workunit.client.0.smithi096.stdout:9/36: rename d1/d7 to d1/d9/de 0 2022-02-02T18:21:21.363 INFO:tasks.workunit.client.0.smithi096.stdout:0/74: creat d2/db/f19 x:0 0 0 2022-02-02T18:21:21.364 INFO:tasks.workunit.client.0.smithi096.stdout:9/37: getdents d1/d9/de 0 2022-02-02T18:21:21.365 INFO:tasks.workunit.client.0.smithi096.stdout:9/38: write d1/f6 [297281,117110] 0 2022-02-02T18:21:21.375 INFO:tasks.workunit.client.0.smithi096.stdout:9/39: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:21.377 INFO:tasks.workunit.client.0.smithi096.stdout:9/40: creat d1/d9/de/ff x:0 0 0 2022-02-02T18:21:21.377 INFO:tasks.workunit.client.0.smithi096.stdout:9/41: getdents d1/d9/de/dd 0 2022-02-02T18:21:21.380 INFO:tasks.workunit.client.0.smithi096.stdout:9/42: dread d1/f5 [0,4194304] 0 2022-02-02T18:21:21.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/75: dwrite d2/db/d10/f16 [0,4194304] 0 2022-02-02T18:21:21.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/76: write d2/f3 [849144,62488] 0 2022-02-02T18:21:21.382 INFO:tasks.workunit.client.0.smithi096.stdout:9/43: creat d1/d9/de/f10 x:0 0 0 2022-02-02T18:21:21.382 INFO:tasks.workunit.client.0.smithi096.stdout:9/44: readlink d1/l2 0 2022-02-02T18:21:21.383 INFO:tasks.workunit.client.0.smithi096.stdout:9/45: mkdir d1/d9/d11 0 2022-02-02T18:21:21.383 INFO:tasks.workunit.client.0.smithi096.stdout:9/46: chown d1/d9/lc 4931073 1 2022-02-02T18:21:21.389 INFO:tasks.workunit.client.0.smithi096.stdout:0/77: dread d2/db/fc [0,4194304] 0 2022-02-02T18:21:21.390 INFO:tasks.workunit.client.0.smithi096.stdout:0/78: mknod d2/db/d10/c1a 0 2022-02-02T18:21:21.390 INFO:tasks.workunit.client.0.smithi096.stdout:0/79: write d2/f3 [1530468,25070] 0 2022-02-02T18:21:21.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/80: link d2/c17 d2/db/d10/c1b 0 2022-02-02T18:21:21.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/81: mknod d2/c1c 0 2022-02-02T18:21:21.393 INFO:tasks.workunit.client.0.smithi096.stdout:0/82: fsync d2/db/f19 0 2022-02-02T18:21:21.393 INFO:tasks.workunit.client.0.smithi096.stdout:0/83: unlink d2/f3 0 2022-02-02T18:21:21.398 INFO:tasks.workunit.client.0.smithi096.stdout:9/47: dwrite d1/f4 [4194304,4194304] 0 2022-02-02T18:21:21.398 INFO:tasks.workunit.client.0.smithi096.stdout:9/48: truncate d1/d9/de/ff 30401 0 2022-02-02T18:21:21.398 INFO:tasks.workunit.client.0.smithi096.stdout:9/49: readlink d1/l2 0 2022-02-02T18:21:21.398 INFO:tasks.workunit.client.0.smithi096.stdout:0/84: write d2/db/d10/f16 [1435338,104749] 0 2022-02-02T18:21:21.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/85: write d2/db/d10/f18 [684033,85968] 0 2022-02-02T18:21:21.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/86: creat d2/f1d x:0 0 0 2022-02-02T18:21:21.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/87: read d2/db/fc [1009225,57066] 0 2022-02-02T18:21:21.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/88: read d2/ff [268044,46251] 0 2022-02-02T18:21:21.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/50: unlink d1/d9/lc 0 2022-02-02T18:21:21.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/51: mkdir d1/d9/de/dd/d12 0 2022-02-02T18:21:21.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/52: write d1/d9/de/f10 [615349,61839] 0 2022-02-02T18:21:21.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/53: rename d1/l2 to d1/d9/de/l13 0 2022-02-02T18:21:21.405 INFO:tasks.workunit.client.0.smithi096.stdout:9/54: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:21.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/55: mkdir d1/db/d14 0 2022-02-02T18:21:21.407 INFO:tasks.workunit.client.0.smithi096.stdout:0/89: getdents d2 0 2022-02-02T18:21:21.407 INFO:tasks.workunit.client.0.smithi096.stdout:0/90: fdatasync d2/fa 0 2022-02-02T18:21:21.408 INFO:tasks.workunit.client.0.smithi096.stdout:0/91: write d2/db/d10/f16 [454055,121055] 0 2022-02-02T18:21:21.408 INFO:tasks.workunit.client.0.smithi096.stdout:9/56: rename d1/c3 to d1/d9/de/c15 0 2022-02-02T18:21:21.409 INFO:tasks.workunit.client.0.smithi096.stdout:0/92: dread d2/fa [0,4194304] 0 2022-02-02T18:21:21.409 INFO:tasks.workunit.client.0.smithi096.stdout:0/93: mkdir d2/d1e 0 2022-02-02T18:21:21.410 INFO:tasks.workunit.client.0.smithi096.stdout:0/94: mknod d2/c1f 0 2022-02-02T18:21:21.411 INFO:tasks.workunit.client.0.smithi096.stdout:0/95: fdatasync d2/f1d 0 2022-02-02T18:21:21.413 INFO:tasks.workunit.client.0.smithi096.stdout:9/57: rename d1/d9/de/c15 to d1/d9/de/dd/c16 0 2022-02-02T18:21:21.419 INFO:tasks.workunit.client.0.smithi096.stdout:0/96: dread d2/f15 [0,4194304] 0 2022-02-02T18:21:21.420 INFO:tasks.workunit.client.0.smithi096.stdout:9/58: dread d1/f4 [4194304,4194304] 0 2022-02-02T18:21:21.420 INFO:tasks.workunit.client.0.smithi096.stdout:0/97: creat d2/db/f20 x:0 0 0 2022-02-02T18:21:21.421 INFO:tasks.workunit.client.0.smithi096.stdout:0/98: symlink d2/d1e/l21 0 2022-02-02T18:21:21.422 INFO:tasks.workunit.client.0.smithi096.stdout:9/59: fdatasync d1/d9/de/f10 0 2022-02-02T18:21:21.422 INFO:tasks.workunit.client.0.smithi096.stdout:0/99: unlink d2/d1e/l21 0 2022-02-02T18:21:21.439 INFO:tasks.workunit.client.0.smithi096.stdout:0/100: dwrite d2/f15 [0,4194304] 0 2022-02-02T18:21:21.441 INFO:tasks.workunit.client.0.smithi096.stdout:0/101: rename d2/c1c to d2/c22 0 2022-02-02T18:21:21.441 INFO:tasks.workunit.client.0.smithi096.stdout:0/102: write d2/db/f19 [181815,49886] 0 2022-02-02T18:21:21.442 INFO:tasks.workunit.client.0.smithi096.stdout:0/103: chown d2/db/ce 3 1 2022-02-02T18:21:21.442 INFO:tasks.workunit.client.0.smithi096.stdout:0/104: symlink d2/d1e/l23 0 2022-02-02T18:21:21.443 INFO:tasks.workunit.client.0.smithi096.stdout:0/105: mkdir d2/db/d24 0 2022-02-02T18:21:21.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/106: rename d2/c8 to d2/db/d10/c25 0 2022-02-02T18:21:21.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/107: readlink d2/db/l12 0 2022-02-02T18:21:21.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/108: stat d2/ff 0 2022-02-02T18:21:21.446 INFO:tasks.workunit.client.0.smithi096.stdout:0/109: fsync d2/db/d10/f16 0 2022-02-02T18:21:21.446 INFO:tasks.workunit.client.0.smithi096.stdout:0/110: chown d2/f4 85746 1 2022-02-02T18:21:21.446 INFO:tasks.workunit.client.0.smithi096.stdout:0/111: write d2/ff [1804967,116373] 0 2022-02-02T18:21:22.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/17: sync 2022-02-02T18:21:22.327 INFO:tasks.workunit.client.0.smithi096.stdout:8/4: sync 2022-02-02T18:21:22.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/18: rmdir - no directory 2022-02-02T18:21:22.328 INFO:tasks.workunit.client.0.smithi096.stdout:4/21: sync 2022-02-02T18:21:22.328 INFO:tasks.workunit.client.0.smithi096.stdout:1/46: sync 2022-02-02T18:21:22.328 INFO:tasks.workunit.client.0.smithi096.stdout:5/13: sync 2022-02-02T18:21:22.328 INFO:tasks.workunit.client.0.smithi096.stdout:4/22: dread - f2 zero size 2022-02-02T18:21:22.328 INFO:tasks.workunit.client.0.smithi096.stdout:3/15: sync 2022-02-02T18:21:22.329 INFO:tasks.workunit.client.0.smithi096.stdout:2/62: sync 2022-02-02T18:21:22.329 INFO:tasks.workunit.client.0.smithi096.stdout:2/63: chown d2/d6/db 425720 1 2022-02-02T18:21:22.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/16: chown d2 0 1 2022-02-02T18:21:22.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/17: write - no filename 2022-02-02T18:21:22.330 INFO:tasks.workunit.client.0.smithi096.stdout:3/18: fsync - no filename 2022-02-02T18:21:22.330 INFO:tasks.workunit.client.0.smithi096.stdout:2/64: chown d2/d13 170 1 2022-02-02T18:21:22.330 INFO:tasks.workunit.client.0.smithi096.stdout:7/19: write f2 [4613054,79780] 0 2022-02-02T18:21:22.331 INFO:tasks.workunit.client.0.smithi096.stdout:0/112: sync 2022-02-02T18:21:22.331 INFO:tasks.workunit.client.0.smithi096.stdout:9/60: sync 2022-02-02T18:21:22.331 INFO:tasks.workunit.client.0.smithi096.stdout:4/23: write d3/f6 [929409,83378] 0 2022-02-02T18:21:22.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/21: sync 2022-02-02T18:21:22.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/5: symlink l0 0 2022-02-02T18:21:22.333 INFO:tasks.workunit.client.0.smithi096.stdout:8/6: dwrite - no filename 2022-02-02T18:21:22.333 INFO:tasks.workunit.client.0.smithi096.stdout:8/7: stat l0 0 2022-02-02T18:21:22.333 INFO:tasks.workunit.client.0.smithi096.stdout:0/113: write d2/db/d10/f18 [481264,45084] 0 2022-02-02T18:21:22.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/22: write f2 [2885262,9076] 0 2022-02-02T18:21:22.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/47: creat f11 x:0 0 0 2022-02-02T18:21:22.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/48: fsync fe 0 2022-02-02T18:21:22.334 INFO:tasks.workunit.client.0.smithi096.stdout:5/14: link c1 c2 0 2022-02-02T18:21:22.334 INFO:tasks.workunit.client.0.smithi096.stdout:5/15: creat f3 x:0 0 0 2022-02-02T18:21:22.335 INFO:tasks.workunit.client.0.smithi096.stdout:3/19: rename d2/c3 to d2/c5 0 2022-02-02T18:21:22.335 INFO:tasks.workunit.client.0.smithi096.stdout:3/20: write - no filename 2022-02-02T18:21:22.338 INFO:tasks.workunit.client.0.smithi096.stdout:7/20: dread f0 [0,4194304] 0 2022-02-02T18:21:22.439 INFO:tasks.workunit.client.0.smithi096.stdout:2/65: creat d2/d13/f14 x:0 0 0 2022-02-02T18:21:22.439 INFO:tasks.workunit.client.0.smithi096.stdout:4/24: symlink d3/d4/l7 0 2022-02-02T18:21:22.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/8: unlink l0 0 2022-02-02T18:21:22.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/9: read - no filename 2022-02-02T18:21:22.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/10: read - no filename 2022-02-02T18:21:22.441 INFO:tasks.workunit.client.0.smithi096.stdout:8/11: stat - no entries 2022-02-02T18:21:22.441 INFO:tasks.workunit.client.0.smithi096.stdout:8/12: dwrite - no filename 2022-02-02T18:21:22.441 INFO:tasks.workunit.client.0.smithi096.stdout:8/13: rename - no filename 2022-02-02T18:21:22.441 INFO:tasks.workunit.client.0.smithi096.stdout:8/14: chown . 0 1 2022-02-02T18:21:22.442 INFO:tasks.workunit.client.0.smithi096.stdout:8/15: link - no file 2022-02-02T18:21:22.442 INFO:tasks.workunit.client.0.smithi096.stdout:8/16: truncate - no filename 2022-02-02T18:21:22.443 INFO:tasks.workunit.client.0.smithi096.stdout:0/114: link d2/db/d10/c1a d2/d1e/c26 0 2022-02-02T18:21:22.443 INFO:tasks.workunit.client.0.smithi096.stdout:6/23: link c1 c6 0 2022-02-02T18:21:22.443 INFO:tasks.workunit.client.0.smithi096.stdout:6/24: write f2 [21522,66426] 0 2022-02-02T18:21:22.445 INFO:tasks.workunit.client.0.smithi096.stdout:3/21: creat d2/f6 x:0 0 0 2022-02-02T18:21:22.445 INFO:tasks.workunit.client.0.smithi096.stdout:3/22: creat d2/f7 x:0 0 0 2022-02-02T18:21:22.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/21: mknod c4 0 2022-02-02T18:21:22.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/22: rmdir - no directory 2022-02-02T18:21:22.447 INFO:tasks.workunit.client.0.smithi096.stdout:2/66: dread d2/f4 [0,4194304] 0 2022-02-02T18:21:22.447 INFO:tasks.workunit.client.0.smithi096.stdout:4/25: rename f2 to d3/f8 0 2022-02-02T18:21:22.448 INFO:tasks.workunit.client.0.smithi096.stdout:4/26: chown d3/f6 124 1 2022-02-02T18:21:22.449 INFO:tasks.workunit.client.0.smithi096.stdout:0/115: mkdir d2/db/d10/d27 0 2022-02-02T18:21:22.449 INFO:tasks.workunit.client.0.smithi096.stdout:0/116: creat d2/db/d10/f28 x:0 0 0 2022-02-02T18:21:22.452 INFO:tasks.workunit.client.0.smithi096.stdout:4/27: dread d3/f6 [0,4194304] 0 2022-02-02T18:21:22.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/23: dread f0 [0,4194304] 0 2022-02-02T18:21:22.453 INFO:tasks.workunit.client.0.smithi096.stdout:6/25: symlink l7 0 2022-02-02T18:21:22.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/16: fsync f3 0 2022-02-02T18:21:22.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/17: creat f4 x:0 0 0 2022-02-02T18:21:22.463 INFO:tasks.workunit.client.0.smithi096.stdout:2/67: unlink d2/f8 0 2022-02-02T18:21:22.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/117: creat d2/db/f29 x:0 0 0 2022-02-02T18:21:22.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/118: truncate d2/fa 2253358 0 2022-02-02T18:21:22.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/119: chown d2/db/fc 3852 1 2022-02-02T18:21:22.466 INFO:tasks.workunit.client.0.smithi096.stdout:6/26: symlink l8 0 2022-02-02T18:21:22.466 INFO:tasks.workunit.client.0.smithi096.stdout:6/27: rmdir - no directory 2022-02-02T18:21:22.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/28: chown c3 32672833 1 2022-02-02T18:21:22.472 INFO:tasks.workunit.client.0.smithi096.stdout:5/18: symlink l5 0 2022-02-02T18:21:22.472 INFO:tasks.workunit.client.0.smithi096.stdout:5/19: creat f6 x:0 0 0 2022-02-02T18:21:22.472 INFO:tasks.workunit.client.0.smithi096.stdout:3/23: rmdir d2 39 2022-02-02T18:21:22.474 INFO:tasks.workunit.client.0.smithi096.stdout:6/29: mknod c9 0 2022-02-02T18:21:22.475 INFO:tasks.workunit.client.0.smithi096.stdout:3/24: getdents d2 0 2022-02-02T18:21:22.476 INFO:tasks.workunit.client.0.smithi096.stdout:3/25: fdatasync d2/f7 0 2022-02-02T18:21:22.476 INFO:tasks.workunit.client.0.smithi096.stdout:0/120: getdents d2/d1e 0 2022-02-02T18:21:22.478 INFO:tasks.workunit.client.0.smithi096.stdout:6/30: rename l8 to la 0 2022-02-02T18:21:22.479 INFO:tasks.workunit.client.0.smithi096.stdout:0/121: creat d2/db/f2a x:0 0 0 2022-02-02T18:21:22.479 INFO:tasks.workunit.client.0.smithi096.stdout:0/122: fsync d2/db/fc 0 2022-02-02T18:21:22.479 INFO:tasks.workunit.client.0.smithi096.stdout:0/123: creat d2/db/d10/f2b x:0 0 0 2022-02-02T18:21:22.487 INFO:tasks.workunit.client.0.smithi096.stdout:6/31: fsync f2 0 2022-02-02T18:21:22.488 INFO:tasks.workunit.client.0.smithi096.stdout:6/32: creat fb x:0 0 0 2022-02-02T18:21:22.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/68: dwrite d2/fe [0,4194304] 0 2022-02-02T18:21:22.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/69: write d2/d6/fa [1093346,82390] 0 2022-02-02T18:21:22.499 INFO:tasks.workunit.client.0.smithi096.stdout:4/28: dwrite d3/f6 [0,4194304] 0 2022-02-02T18:21:22.499 INFO:tasks.workunit.client.0.smithi096.stdout:4/29: fdatasync f1 0 2022-02-02T18:21:22.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/24: dwrite f0 [0,4194304] 0 2022-02-02T18:21:22.501 INFO:tasks.workunit.client.0.smithi096.stdout:2/70: mknod d2/c15 0 2022-02-02T18:21:22.503 INFO:tasks.workunit.client.0.smithi096.stdout:7/25: read f0 [3949967,93208] 0 2022-02-02T18:21:22.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/30: creat d3/d4/f9 x:0 0 0 2022-02-02T18:21:22.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/31: fsync d3/f6 0 2022-02-02T18:21:22.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/26: dwrite d2/f7 [0,4194304] 0 2022-02-02T18:21:22.507 INFO:tasks.workunit.client.0.smithi096.stdout:0/124: dwrite d2/db/d10/f16 [0,4194304] 0 2022-02-02T18:21:22.508 INFO:tasks.workunit.client.0.smithi096.stdout:7/26: getdents . 0 2022-02-02T18:21:22.510 INFO:tasks.workunit.client.0.smithi096.stdout:4/32: unlink c0 0 2022-02-02T18:21:22.511 INFO:tasks.workunit.client.0.smithi096.stdout:0/125: dread d2/db/f19 [0,4194304] 0 2022-02-02T18:21:22.512 INFO:tasks.workunit.client.0.smithi096.stdout:6/33: dwrite f2 [4194304,4194304] 0 2022-02-02T18:21:22.512 INFO:tasks.workunit.client.0.smithi096.stdout:6/34: readlink la 0 2022-02-02T18:21:22.512 INFO:tasks.workunit.client.0.smithi096.stdout:6/35: chown l4 4060 1 2022-02-02T18:21:22.513 INFO:tasks.workunit.client.0.smithi096.stdout:6/36: chown c1 3228920 1 2022-02-02T18:21:22.513 INFO:tasks.workunit.client.0.smithi096.stdout:6/37: truncate fb 400877 0 2022-02-02T18:21:22.513 INFO:tasks.workunit.client.0.smithi096.stdout:3/27: mkdir d2/d8 0 2022-02-02T18:21:22.514 INFO:tasks.workunit.client.0.smithi096.stdout:7/27: truncate f2 315903 0 2022-02-02T18:21:22.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/33: link d3/d4/f9 d3/fa 0 2022-02-02T18:21:22.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/34: write d3/fa [407122,84925] 0 2022-02-02T18:21:22.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/35: chown d3 213120 1 2022-02-02T18:21:22.520 INFO:tasks.workunit.client.0.smithi096.stdout:6/38: symlink lc 0 2022-02-02T18:21:22.520 INFO:tasks.workunit.client.0.smithi096.stdout:4/36: mknod d3/cb 0 2022-02-02T18:21:22.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/37: write f1 [549458,9038] 0 2022-02-02T18:21:22.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/38: dread - d3/f8 zero size 2022-02-02T18:21:22.522 INFO:tasks.workunit.client.0.smithi096.stdout:4/39: mknod d3/cc 0 2022-02-02T18:21:22.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/28: write f2 [459868,76628] 0 2022-02-02T18:21:22.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/29: getdents . 0 2022-02-02T18:21:22.531 INFO:tasks.workunit.client.0.smithi096.stdout:2/71: dwrite d2/f7 [4194304,4194304] 0 2022-02-02T18:21:22.532 INFO:tasks.workunit.client.0.smithi096.stdout:4/40: dread d3/f6 [0,4194304] 0 2022-02-02T18:21:22.540 INFO:tasks.workunit.client.0.smithi096.stdout:0/126: dwrite d2/db/fc [0,4194304] 0 2022-02-02T18:21:22.543 INFO:tasks.workunit.client.0.smithi096.stdout:0/127: dread d2/f4 [0,4194304] 0 2022-02-02T18:21:22.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/128: symlink d2/db/d10/l2c 0 2022-02-02T18:21:22.545 INFO:tasks.workunit.client.0.smithi096.stdout:0/129: write d2/f15 [3974494,58714] 0 2022-02-02T18:21:22.545 INFO:tasks.workunit.client.0.smithi096.stdout:0/130: read d2/db/d10/f18 [114465,106813] 0 2022-02-02T18:21:22.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/28: dwrite d2/f6 [0,4194304] 0 2022-02-02T18:21:22.551 INFO:tasks.workunit.client.0.smithi096.stdout:4/41: fdatasync d3/d4/f9 0 2022-02-02T18:21:22.552 INFO:tasks.workunit.client.0.smithi096.stdout:4/42: stat d3/fa 0 2022-02-02T18:21:22.552 INFO:tasks.workunit.client.0.smithi096.stdout:6/39: dwrite f2 [0,4194304] 0 2022-02-02T18:21:22.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/72: dwrite f1 [0,4194304] 0 2022-02-02T18:21:22.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/73: unlink d2/l11 0 2022-02-02T18:21:22.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/74: write d2/f7 [2409843,119591] 0 2022-02-02T18:21:22.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/75: readlink l0 0 2022-02-02T18:21:22.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/76: read - d2/d13/f14 zero size 2022-02-02T18:21:22.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/29: creat d2/f9 x:0 0 0 2022-02-02T18:21:22.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/30: write d2/f9 [153072,27632] 0 2022-02-02T18:21:22.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/31: rename d2 to d2/da 22 2022-02-02T18:21:22.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/40: rename la to ld 0 2022-02-02T18:21:22.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/41: truncate fb 1087473 0 2022-02-02T18:21:22.560 INFO:tasks.workunit.client.0.smithi096.stdout:1/49: sync 2022-02-02T18:21:22.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/30: write f2 [143898,42107] 0 2022-02-02T18:21:22.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/131: dwrite d2/f1d [0,4194304] 0 2022-02-02T18:21:22.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/61: sync 2022-02-02T18:21:22.563 INFO:tasks.workunit.client.0.smithi096.stdout:2/77: creat d2/d6/db/f16 x:0 0 0 2022-02-02T18:21:22.563 INFO:tasks.workunit.client.0.smithi096.stdout:2/78: fdatasync d2/d6/db/f16 0 2022-02-02T18:21:22.564 INFO:tasks.workunit.client.0.smithi096.stdout:3/32: unlink d2/f9 0 2022-02-02T18:21:22.564 INFO:tasks.workunit.client.0.smithi096.stdout:3/33: creat d2/fb x:0 0 0 2022-02-02T18:21:22.566 INFO:tasks.workunit.client.0.smithi096.stdout:6/42: unlink c3 0 2022-02-02T18:21:22.566 INFO:tasks.workunit.client.0.smithi096.stdout:6/43: truncate fb 1128215 0 2022-02-02T18:21:22.567 INFO:tasks.workunit.client.0.smithi096.stdout:6/44: stat c9 0 2022-02-02T18:21:22.567 INFO:tasks.workunit.client.0.smithi096.stdout:6/45: fdatasync fb 0 2022-02-02T18:21:22.567 INFO:tasks.workunit.client.0.smithi096.stdout:2/79: write d2/fe [1251028,128727] 0 2022-02-02T18:21:22.567 INFO:tasks.workunit.client.0.smithi096.stdout:3/34: write d2/f6 [975186,111836] 0 2022-02-02T18:21:22.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/31: dread f2 [0,4194304] 0 2022-02-02T18:21:22.568 INFO:tasks.workunit.client.0.smithi096.stdout:6/46: read f2 [4190753,86283] 0 2022-02-02T18:21:22.569 INFO:tasks.workunit.client.0.smithi096.stdout:8/17: sync 2022-02-02T18:21:22.569 INFO:tasks.workunit.client.0.smithi096.stdout:8/18: chown . 2505273 1 2022-02-02T18:21:22.569 INFO:tasks.workunit.client.0.smithi096.stdout:8/19: dwrite - no filename 2022-02-02T18:21:22.573 INFO:tasks.workunit.client.0.smithi096.stdout:2/80: symlink d2/d6/l17 0 2022-02-02T18:21:22.575 INFO:tasks.workunit.client.0.smithi096.stdout:3/35: symlink d2/d8/lc 0 2022-02-02T18:21:22.576 INFO:tasks.workunit.client.0.smithi096.stdout:7/32: mknod c5 0 2022-02-02T18:21:22.577 INFO:tasks.workunit.client.0.smithi096.stdout:6/47: mknod ce 0 2022-02-02T18:21:22.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/62: dwrite d1/f5 [0,4194304] 0 2022-02-02T18:21:22.579 INFO:tasks.workunit.client.0.smithi096.stdout:8/20: creat f1 x:0 0 0 2022-02-02T18:21:22.580 INFO:tasks.workunit.client.0.smithi096.stdout:8/21: truncate f1 729189 0 2022-02-02T18:21:22.582 INFO:tasks.workunit.client.0.smithi096.stdout:9/63: write d1/f6 [93543,76844] 0 2022-02-02T18:21:22.582 INFO:tasks.workunit.client.0.smithi096.stdout:2/81: rmdir d2/d6 39 2022-02-02T18:21:22.588 INFO:tasks.workunit.client.0.smithi096.stdout:1/50: link c4 c12 0 2022-02-02T18:21:22.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/20: sync 2022-02-02T18:21:22.589 INFO:tasks.workunit.client.0.smithi096.stdout:3/36: dread d2/f6 [0,4194304] 0 2022-02-02T18:21:22.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/21: dread - f6 zero size 2022-02-02T18:21:22.589 INFO:tasks.workunit.client.0.smithi096.stdout:3/37: creat d2/fd x:0 0 0 2022-02-02T18:21:22.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/22: readlink l5 0 2022-02-02T18:21:22.590 INFO:tasks.workunit.client.0.smithi096.stdout:8/22: mkdir d2 0 2022-02-02T18:21:22.590 INFO:tasks.workunit.client.0.smithi096.stdout:9/64: mkdir d1/d9/d17 0 2022-02-02T18:21:22.590 INFO:tasks.workunit.client.0.smithi096.stdout:2/82: mknod d2/c18 0 2022-02-02T18:21:22.593 INFO:tasks.workunit.client.0.smithi096.stdout:5/23: mknod c7 0 2022-02-02T18:21:22.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/24: fdatasync f3 0 2022-02-02T18:21:22.595 INFO:tasks.workunit.client.0.smithi096.stdout:7/33: dwrite f2 [0,4194304] 0 2022-02-02T18:21:22.595 INFO:tasks.workunit.client.0.smithi096.stdout:7/34: truncate f0 4203344 0 2022-02-02T18:21:22.595 INFO:tasks.workunit.client.0.smithi096.stdout:8/23: rmdir d2 0 2022-02-02T18:21:22.595 INFO:tasks.workunit.client.0.smithi096.stdout:8/24: chown f1 7 1 2022-02-02T18:21:22.596 INFO:tasks.workunit.client.0.smithi096.stdout:8/25: fdatasync f1 0 2022-02-02T18:21:22.596 INFO:tasks.workunit.client.0.smithi096.stdout:2/83: mkdir d2/d19 0 2022-02-02T18:21:22.597 INFO:tasks.workunit.client.0.smithi096.stdout:1/51: rename fe to f13 0 2022-02-02T18:21:22.597 INFO:tasks.workunit.client.0.smithi096.stdout:5/25: symlink l8 0 2022-02-02T18:21:22.598 INFO:tasks.workunit.client.0.smithi096.stdout:7/35: mknod c6 0 2022-02-02T18:21:22.599 INFO:tasks.workunit.client.0.smithi096.stdout:8/26: symlink l3 0 2022-02-02T18:21:22.600 INFO:tasks.workunit.client.0.smithi096.stdout:8/27: write f1 [846034,31279] 0 2022-02-02T18:21:22.600 INFO:tasks.workunit.client.0.smithi096.stdout:2/84: symlink d2/d6/l1a 0 2022-02-02T18:21:22.602 INFO:tasks.workunit.client.0.smithi096.stdout:5/26: link f6 f9 0 2022-02-02T18:21:22.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/36: link f2 f7 0 2022-02-02T18:21:22.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/37: chown c5 3958121 1 2022-02-02T18:21:22.605 INFO:tasks.workunit.client.0.smithi096.stdout:0/132: dwrite d2/f1d [4194304,4194304] 0 2022-02-02T18:21:22.605 INFO:tasks.workunit.client.0.smithi096.stdout:8/28: symlink l4 0 2022-02-02T18:21:22.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/29: truncate f1 1806148 0 2022-02-02T18:21:22.607 INFO:tasks.workunit.client.0.smithi096.stdout:2/85: dread f1 [0,4194304] 0 2022-02-02T18:21:22.607 INFO:tasks.workunit.client.0.smithi096.stdout:2/86: write d2/d6/fa [1823481,106579] 0 2022-02-02T18:21:22.608 INFO:tasks.workunit.client.0.smithi096.stdout:1/52: mknod c14 0 2022-02-02T18:21:22.608 INFO:tasks.workunit.client.0.smithi096.stdout:5/27: link f3 fa 0 2022-02-02T18:21:22.610 INFO:tasks.workunit.client.0.smithi096.stdout:3/38: getdents d2/d8 0 2022-02-02T18:21:22.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/38: write f2 [2538218,2580] 0 2022-02-02T18:21:22.611 INFO:tasks.workunit.client.0.smithi096.stdout:0/133: creat d2/db/d10/d27/f2d x:0 0 0 2022-02-02T18:21:22.611 INFO:tasks.workunit.client.0.smithi096.stdout:0/134: readlink d2/db/d10/l2c 0 2022-02-02T18:21:22.612 INFO:tasks.workunit.client.0.smithi096.stdout:0/135: write d2/db/d10/f18 [637549,129518] 0 2022-02-02T18:21:22.613 INFO:tasks.workunit.client.0.smithi096.stdout:2/87: unlink d2/d6/db/f16 0 2022-02-02T18:21:22.614 INFO:tasks.workunit.client.0.smithi096.stdout:5/28: mkdir db 0 2022-02-02T18:21:22.617 INFO:tasks.workunit.client.0.smithi096.stdout:9/65: dwrite d1/f6 [0,4194304] 0 2022-02-02T18:21:22.618 INFO:tasks.workunit.client.0.smithi096.stdout:9/66: chown d1/d9/d17 146279613 1 2022-02-02T18:21:22.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/39: rename d2/f6 to d2/d8/fe 0 2022-02-02T18:21:22.619 INFO:tasks.workunit.client.0.smithi096.stdout:8/30: dread f1 [0,4194304] 0 2022-02-02T18:21:22.619 INFO:tasks.workunit.client.0.smithi096.stdout:6/48: truncate fb 76971 0 2022-02-02T18:21:22.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/31: write f1 [940349,71035] 0 2022-02-02T18:21:22.620 INFO:tasks.workunit.client.0.smithi096.stdout:7/39: symlink l8 0 2022-02-02T18:21:22.621 INFO:tasks.workunit.client.0.smithi096.stdout:2/88: truncate d2/f7 4929016 0 2022-02-02T18:21:22.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/53: unlink c9 0 2022-02-02T18:21:22.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/54: write f13 [1022371,27558] 0 2022-02-02T18:21:22.626 INFO:tasks.workunit.client.0.smithi096.stdout:5/29: symlink db/lc 0 2022-02-02T18:21:22.626 INFO:tasks.workunit.client.0.smithi096.stdout:5/30: unlink c7 0 2022-02-02T18:21:22.640 INFO:tasks.workunit.client.0.smithi096.stdout:9/67: rmdir d1/d9/d17 0 2022-02-02T18:21:22.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/40: mkdir d2/df 0 2022-02-02T18:21:22.642 INFO:tasks.workunit.client.0.smithi096.stdout:6/49: rename c9 to cf 0 2022-02-02T18:21:22.642 INFO:tasks.workunit.client.0.smithi096.stdout:6/50: chown f2 994063 1 2022-02-02T18:21:22.643 INFO:tasks.workunit.client.0.smithi096.stdout:7/40: getdents . 0 2022-02-02T18:21:22.645 INFO:tasks.workunit.client.0.smithi096.stdout:1/55: dread f3 [0,4194304] 0 2022-02-02T18:21:22.646 INFO:tasks.workunit.client.0.smithi096.stdout:2/89: dwrite d2/fe [0,4194304] 0 2022-02-02T18:21:22.646 INFO:tasks.workunit.client.0.smithi096.stdout:5/31: mkdir db/dd 0 2022-02-02T18:21:22.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/32: dwrite f1 [0,4194304] 0 2022-02-02T18:21:22.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/33: creat f5 x:0 0 0 2022-02-02T18:21:22.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/34: chown l3 59325746 1 2022-02-02T18:21:22.649 INFO:tasks.workunit.client.0.smithi096.stdout:8/35: truncate f5 232298 0 2022-02-02T18:21:22.649 INFO:tasks.workunit.client.0.smithi096.stdout:9/68: creat d1/d9/f18 x:0 0 0 2022-02-02T18:21:22.649 INFO:tasks.workunit.client.0.smithi096.stdout:3/41: creat d2/d8/f10 x:0 0 0 2022-02-02T18:21:22.651 INFO:tasks.workunit.client.0.smithi096.stdout:4/43: sync 2022-02-02T18:21:22.651 INFO:tasks.workunit.client.0.smithi096.stdout:4/44: dread - d3/f8 zero size 2022-02-02T18:21:22.654 INFO:tasks.workunit.client.0.smithi096.stdout:6/51: symlink l10 0 2022-02-02T18:21:22.654 INFO:tasks.workunit.client.0.smithi096.stdout:6/52: readlink lc 0 2022-02-02T18:21:22.654 INFO:tasks.workunit.client.0.smithi096.stdout:6/53: readlink l4 0 2022-02-02T18:21:22.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/41: mkdir d9 0 2022-02-02T18:21:22.655 INFO:tasks.workunit.client.0.smithi096.stdout:2/90: mkdir d2/d6/d1b 0 2022-02-02T18:21:22.658 INFO:tasks.workunit.client.0.smithi096.stdout:5/32: mkdir db/de 0 2022-02-02T18:21:22.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/36: symlink l6 0 2022-02-02T18:21:22.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/37: write f1 [725307,91998] 0 2022-02-02T18:21:22.662 INFO:tasks.workunit.client.0.smithi096.stdout:9/69: mknod d1/db/d14/c19 0 2022-02-02T18:21:22.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/38: write f1 [354256,104981] 0 2022-02-02T18:21:22.663 INFO:tasks.workunit.client.0.smithi096.stdout:4/45: unlink d3/cb 0 2022-02-02T18:21:22.664 INFO:tasks.workunit.client.0.smithi096.stdout:6/54: mknod c11 0 2022-02-02T18:21:22.664 INFO:tasks.workunit.client.0.smithi096.stdout:6/55: read fb [10354,79740] 0 2022-02-02T18:21:22.665 INFO:tasks.workunit.client.0.smithi096.stdout:6/56: creat f12 x:0 0 0 2022-02-02T18:21:22.666 INFO:tasks.workunit.client.0.smithi096.stdout:1/56: mkdir d15 0 2022-02-02T18:21:22.667 INFO:tasks.workunit.client.0.smithi096.stdout:2/91: creat d2/d19/f1c x:0 0 0 2022-02-02T18:21:22.667 INFO:tasks.workunit.client.0.smithi096.stdout:1/57: dread - f11 zero size 2022-02-02T18:21:22.667 INFO:tasks.workunit.client.0.smithi096.stdout:2/92: dread - d2/d6/db/fc zero size 2022-02-02T18:21:22.668 INFO:tasks.workunit.client.0.smithi096.stdout:7/42: read f7 [2508973,62833] 0 2022-02-02T18:21:22.670 INFO:tasks.workunit.client.0.smithi096.stdout:9/70: mknod d1/d9/d11/c1a 0 2022-02-02T18:21:22.670 INFO:tasks.workunit.client.0.smithi096.stdout:9/71: fdatasync d1/d9/f18 0 2022-02-02T18:21:22.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/42: mkdir d2/d8/d11 0 2022-02-02T18:21:22.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/43: fdatasync d2/fd 0 2022-02-02T18:21:22.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/44: fdatasync d2/fb 0 2022-02-02T18:21:22.671 INFO:tasks.workunit.client.0.smithi096.stdout:4/46: creat d3/fd x:0 0 0 2022-02-02T18:21:22.675 INFO:tasks.workunit.client.0.smithi096.stdout:6/57: symlink l13 0 2022-02-02T18:21:22.675 INFO:tasks.workunit.client.0.smithi096.stdout:6/58: truncate f12 865200 0 2022-02-02T18:21:22.675 INFO:tasks.workunit.client.0.smithi096.stdout:6/59: creat f14 x:0 0 0 2022-02-02T18:21:22.676 INFO:tasks.workunit.client.0.smithi096.stdout:1/58: creat d15/f16 x:0 0 0 2022-02-02T18:21:22.678 INFO:tasks.workunit.client.0.smithi096.stdout:7/43: mknod d9/ca 0 2022-02-02T18:21:22.679 INFO:tasks.workunit.client.0.smithi096.stdout:9/72: getdents d1/d9/de 0 2022-02-02T18:21:22.680 INFO:tasks.workunit.client.0.smithi096.stdout:8/39: dwrite f5 [0,4194304] 0 2022-02-02T18:21:22.680 INFO:tasks.workunit.client.0.smithi096.stdout:8/40: fsync f1 0 2022-02-02T18:21:22.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/41: chown l3 311586 1 2022-02-02T18:21:22.684 INFO:tasks.workunit.client.0.smithi096.stdout:4/47: symlink d3/d4/le 0 2022-02-02T18:21:22.686 INFO:tasks.workunit.client.0.smithi096.stdout:5/33: dwrite f4 [0,4194304] 0 2022-02-02T18:21:22.687 INFO:tasks.workunit.client.0.smithi096.stdout:7/44: creat d9/fb x:0 0 0 2022-02-02T18:21:22.687 INFO:tasks.workunit.client.0.smithi096.stdout:7/45: creat d9/fc x:0 0 0 2022-02-02T18:21:22.687 INFO:tasks.workunit.client.0.smithi096.stdout:7/46: creat d9/fd x:0 0 0 2022-02-02T18:21:22.691 INFO:tasks.workunit.client.0.smithi096.stdout:8/42: rename l3 to l7 0 2022-02-02T18:21:22.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/34: symlink db/lf 0 2022-02-02T18:21:22.696 INFO:tasks.workunit.client.0.smithi096.stdout:7/47: unlink c6 0 2022-02-02T18:21:22.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/43: dread f1 [0,4194304] 0 2022-02-02T18:21:22.715 INFO:tasks.workunit.client.0.smithi096.stdout:3/45: rmdir d2/d8 39 2022-02-02T18:21:22.715 INFO:tasks.workunit.client.0.smithi096.stdout:6/60: dwrite f12 [0,4194304] 0 2022-02-02T18:21:22.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/61: write f14 [593430,113162] 0 2022-02-02T18:21:22.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/59: dwrite f3 [0,4194304] 0 2022-02-02T18:21:22.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/60: read - ff zero size 2022-02-02T18:21:22.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/61: truncate ff 459592 0 2022-02-02T18:21:22.717 INFO:tasks.workunit.client.0.smithi096.stdout:9/73: dwrite d1/f6 [4194304,4194304] 0 2022-02-02T18:21:22.718 INFO:tasks.workunit.client.0.smithi096.stdout:4/48: dwrite d3/fa [0,4194304] 0 2022-02-02T18:21:22.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/74: write d1/d9/de/f10 [56484,105359] 0 2022-02-02T18:21:22.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/75: chown d1/d9/de/ff 3525891 1 2022-02-02T18:21:22.719 INFO:tasks.workunit.client.0.smithi096.stdout:3/46: unlink d2/c4 0 2022-02-02T18:21:22.720 INFO:tasks.workunit.client.0.smithi096.stdout:6/62: mknod c15 0 2022-02-02T18:21:22.721 INFO:tasks.workunit.client.0.smithi096.stdout:6/63: fdatasync fb 0 2022-02-02T18:21:22.721 INFO:tasks.workunit.client.0.smithi096.stdout:6/64: chown l13 4096 1 2022-02-02T18:21:22.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/62: mknod d15/c17 0 2022-02-02T18:21:22.724 INFO:tasks.workunit.client.0.smithi096.stdout:8/44: write f5 [5023838,37537] 0 2022-02-02T18:21:22.725 INFO:tasks.workunit.client.0.smithi096.stdout:8/45: write f5 [5907605,93622] 0 2022-02-02T18:21:22.726 INFO:tasks.workunit.client.0.smithi096.stdout:4/49: mknod d3/d4/cf 0 2022-02-02T18:21:22.728 INFO:tasks.workunit.client.0.smithi096.stdout:6/65: symlink l16 0 2022-02-02T18:21:22.729 INFO:tasks.workunit.client.0.smithi096.stdout:1/63: rename c14 to d15/c18 0 2022-02-02T18:21:22.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/66: mknod c17 0 2022-02-02T18:21:22.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/46: getdents . 0 2022-02-02T18:21:22.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/47: readlink l7 0 2022-02-02T18:21:22.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/48: chown l4 810 1 2022-02-02T18:21:22.736 INFO:tasks.workunit.client.0.smithi096.stdout:8/49: write f5 [4247070,81648] 0 2022-02-02T18:21:22.737 INFO:tasks.workunit.client.0.smithi096.stdout:4/50: dread d3/fa [0,4194304] 0 2022-02-02T18:21:22.737 INFO:tasks.workunit.client.0.smithi096.stdout:4/51: creat d3/f10 x:0 0 0 2022-02-02T18:21:22.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/52: readlink d3/d4/l7 0 2022-02-02T18:21:22.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/53: dread - d3/f10 zero size 2022-02-02T18:21:22.739 INFO:tasks.workunit.client.0.smithi096.stdout:5/35: dwrite fa [0,4194304] 0 2022-02-02T18:21:22.739 INFO:tasks.workunit.client.0.smithi096.stdout:3/47: dwrite d2/d8/f10 [0,4194304] 0 2022-02-02T18:21:22.739 INFO:tasks.workunit.client.0.smithi096.stdout:3/48: dread - d2/fd zero size 2022-02-02T18:21:22.741 INFO:tasks.workunit.client.0.smithi096.stdout:7/48: dwrite f2 [0,4194304] 0 2022-02-02T18:21:22.742 INFO:tasks.workunit.client.0.smithi096.stdout:6/67: mkdir d18 0 2022-02-02T18:21:22.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/49: write d9/fd [985195,53915] 0 2022-02-02T18:21:22.743 INFO:tasks.workunit.client.0.smithi096.stdout:7/50: creat d9/fe x:0 0 0 2022-02-02T18:21:22.743 INFO:tasks.workunit.client.0.smithi096.stdout:4/54: link d3/d4/le d3/d4/l11 0 2022-02-02T18:21:22.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/36: unlink f9 0 2022-02-02T18:21:22.745 INFO:tasks.workunit.client.0.smithi096.stdout:5/37: unlink l5 0 2022-02-02T18:21:22.749 INFO:tasks.workunit.client.0.smithi096.stdout:7/51: mkdir d9/df 0 2022-02-02T18:21:22.752 INFO:tasks.workunit.client.0.smithi096.stdout:4/55: mkdir d3/d12 0 2022-02-02T18:21:22.753 INFO:tasks.workunit.client.0.smithi096.stdout:5/38: mkdir db/de/d10 0 2022-02-02T18:21:22.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/56: dread f1 [0,4194304] 0 2022-02-02T18:21:22.756 INFO:tasks.workunit.client.0.smithi096.stdout:6/68: dwrite f12 [4194304,4194304] 0 2022-02-02T18:21:22.756 INFO:tasks.workunit.client.0.smithi096.stdout:3/49: rename d2/fb to d2/d8/f12 0 2022-02-02T18:21:22.756 INFO:tasks.workunit.client.0.smithi096.stdout:1/64: dwrite f13 [0,4194304] 0 2022-02-02T18:21:22.757 INFO:tasks.workunit.client.0.smithi096.stdout:1/65: dread - d15/f16 zero size 2022-02-02T18:21:22.757 INFO:tasks.workunit.client.0.smithi096.stdout:5/39: rmdir db/dd 0 2022-02-02T18:21:22.758 INFO:tasks.workunit.client.0.smithi096.stdout:1/66: read fc [537672,57274] 0 2022-02-02T18:21:22.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/57: creat d3/d12/f13 x:0 0 0 2022-02-02T18:21:22.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/58: write d3/f6 [4385946,60762] 0 2022-02-02T18:21:22.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/59: chown d3/fa 23 1 2022-02-02T18:21:22.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/60: dread - d3/fd zero size 2022-02-02T18:21:22.762 INFO:tasks.workunit.client.0.smithi096.stdout:8/50: truncate f5 3983514 0 2022-02-02T18:21:22.763 INFO:tasks.workunit.client.0.smithi096.stdout:8/51: write f1 [1081310,120017] 0 2022-02-02T18:21:22.893 INFO:tasks.workunit.client.0.smithi096.stdout:7/52: dwrite d9/fc [0,4194304] 0 2022-02-02T18:21:22.893 INFO:tasks.workunit.client.0.smithi096.stdout:6/69: creat d18/f19 x:0 0 0 2022-02-02T18:21:22.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/70: chown lc 500 1 2022-02-02T18:21:22.894 INFO:tasks.workunit.client.0.smithi096.stdout:5/40: mknod db/de/d10/c11 0 2022-02-02T18:21:22.894 INFO:tasks.workunit.client.0.smithi096.stdout:5/41: rename db to db/de/d12 22 2022-02-02T18:21:22.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/136: sync 2022-02-02T18:21:22.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/93: sync 2022-02-02T18:21:22.895 INFO:tasks.workunit.client.0.smithi096.stdout:1/67: stat l10 0 2022-02-02T18:21:22.895 INFO:tasks.workunit.client.0.smithi096.stdout:1/68: write f3 [1191688,60917] 0 2022-02-02T18:21:22.895 INFO:tasks.workunit.client.0.smithi096.stdout:4/61: mkdir d3/d4/d14 0 2022-02-02T18:21:22.896 INFO:tasks.workunit.client.0.smithi096.stdout:8/52: rename l7 to l8 0 2022-02-02T18:21:22.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/71: dread f2 [0,4194304] 0 2022-02-02T18:21:22.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/72: unlink f14 0 2022-02-02T18:21:22.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/73: stat l13 0 2022-02-02T18:21:22.897 INFO:tasks.workunit.client.0.smithi096.stdout:6/74: creat d18/f1a x:0 0 0 2022-02-02T18:21:22.897 INFO:tasks.workunit.client.0.smithi096.stdout:6/75: fdatasync f2 0 2022-02-02T18:21:22.898 INFO:tasks.workunit.client.0.smithi096.stdout:6/76: write f2 [5458690,69493] 0 2022-02-02T18:21:22.898 INFO:tasks.workunit.client.0.smithi096.stdout:5/42: truncate f3 891366 0 2022-02-02T18:21:22.898 INFO:tasks.workunit.client.0.smithi096.stdout:5/43: unlink f4 0 2022-02-02T18:21:22.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/137: creat d2/d1e/f2e x:0 0 0 2022-02-02T18:21:22.899 INFO:tasks.workunit.client.0.smithi096.stdout:8/53: unlink l6 0 2022-02-02T18:21:22.899 INFO:tasks.workunit.client.0.smithi096.stdout:8/54: readlink l8 0 2022-02-02T18:21:22.899 INFO:tasks.workunit.client.0.smithi096.stdout:7/53: truncate f2 3883604 0 2022-02-02T18:21:22.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/77: rename c6 to d18/c1b 0 2022-02-02T18:21:22.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/78: chown ce 1255280 1 2022-02-02T18:21:22.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/79: chown c5 476797981 1 2022-02-02T18:21:22.901 INFO:tasks.workunit.client.0.smithi096.stdout:6/80: creat d18/f1c x:0 0 0 2022-02-02T18:21:22.901 INFO:tasks.workunit.client.0.smithi096.stdout:6/81: dread - d18/f1c zero size 2022-02-02T18:21:22.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/69: dwrite fc [0,4194304] 0 2022-02-02T18:21:22.902 INFO:tasks.workunit.client.0.smithi096.stdout:5/44: getdents db 0 2022-02-02T18:21:22.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/55: dread f1 [0,4194304] 0 2022-02-02T18:21:22.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/56: read f5 [3779927,31115] 0 2022-02-02T18:21:22.902 INFO:tasks.workunit.client.0.smithi096.stdout:1/70: rename f3 to d15/f19 0 2022-02-02T18:21:22.903 INFO:tasks.workunit.client.0.smithi096.stdout:1/71: creat d15/f1a x:0 0 0 2022-02-02T18:21:22.903 INFO:tasks.workunit.client.0.smithi096.stdout:5/45: creat db/de/f13 x:0 0 0 2022-02-02T18:21:22.903 INFO:tasks.workunit.client.0.smithi096.stdout:8/57: stat l8 0 2022-02-02T18:21:22.903 INFO:tasks.workunit.client.0.smithi096.stdout:0/138: rmdir d2/d1e 39 2022-02-02T18:21:22.904 INFO:tasks.workunit.client.0.smithi096.stdout:8/58: write f1 [3364300,90198] 0 2022-02-02T18:21:22.904 INFO:tasks.workunit.client.0.smithi096.stdout:6/82: dwrite d18/f1c [0,4194304] 0 2022-02-02T18:21:22.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/72: mkdir d15/d1b 0 2022-02-02T18:21:22.905 INFO:tasks.workunit.client.0.smithi096.stdout:5/46: symlink db/l14 0 2022-02-02T18:21:22.905 INFO:tasks.workunit.client.0.smithi096.stdout:7/54: dread f0 [0,4194304] 0 2022-02-02T18:21:22.906 INFO:tasks.workunit.client.0.smithi096.stdout:0/139: symlink d2/db/d10/l2f 0 2022-02-02T18:21:22.906 INFO:tasks.workunit.client.0.smithi096.stdout:6/83: symlink d18/l1d 0 2022-02-02T18:21:22.906 INFO:tasks.workunit.client.0.smithi096.stdout:6/84: write f2 [4049666,40958] 0 2022-02-02T18:21:22.906 INFO:tasks.workunit.client.0.smithi096.stdout:6/85: readlink l10 0 2022-02-02T18:21:22.907 INFO:tasks.workunit.client.0.smithi096.stdout:6/86: readlink lc 0 2022-02-02T18:21:22.907 INFO:tasks.workunit.client.0.smithi096.stdout:6/87: write d18/f1c [4952639,22652] 0 2022-02-02T18:21:22.908 INFO:tasks.workunit.client.0.smithi096.stdout:5/47: creat db/de/d10/f15 x:0 0 0 2022-02-02T18:21:22.908 INFO:tasks.workunit.client.0.smithi096.stdout:5/48: dread - db/de/d10/f15 zero size 2022-02-02T18:21:22.908 INFO:tasks.workunit.client.0.smithi096.stdout:5/49: dread - db/de/d10/f15 zero size 2022-02-02T18:21:22.908 INFO:tasks.workunit.client.0.smithi096.stdout:5/50: dread - db/de/d10/f15 zero size 2022-02-02T18:21:22.909 INFO:tasks.workunit.client.0.smithi096.stdout:6/88: mknod d18/c1e 0 2022-02-02T18:21:22.909 INFO:tasks.workunit.client.0.smithi096.stdout:7/55: creat d9/df/f10 x:0 0 0 2022-02-02T18:21:22.909 INFO:tasks.workunit.client.0.smithi096.stdout:1/73: rename fd to d15/d1b/f1c 0 2022-02-02T18:21:22.909 INFO:tasks.workunit.client.0.smithi096.stdout:7/56: truncate f0 4907756 0 2022-02-02T18:21:22.910 INFO:tasks.workunit.client.0.smithi096.stdout:6/89: creat d18/f1f x:0 0 0 2022-02-02T18:21:22.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/140: rename d2/f1d to d2/db/d24/f30 0 2022-02-02T18:21:22.911 INFO:tasks.workunit.client.0.smithi096.stdout:1/74: rename d15/f19 to d15/f1d 0 2022-02-02T18:21:22.911 INFO:tasks.workunit.client.0.smithi096.stdout:6/90: symlink d18/l20 0 2022-02-02T18:21:22.912 INFO:tasks.workunit.client.0.smithi096.stdout:6/91: chown c15 501502 1 2022-02-02T18:21:22.912 INFO:tasks.workunit.client.0.smithi096.stdout:6/92: write d18/f19 [135523,112025] 0 2022-02-02T18:21:22.912 INFO:tasks.workunit.client.0.smithi096.stdout:6/93: creat d18/f21 x:0 0 0 2022-02-02T18:21:22.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/141: write d2/db/d10/f16 [2663139,61978] 0 2022-02-02T18:21:22.914 INFO:tasks.workunit.client.0.smithi096.stdout:0/142: fsync d2/f15 0 2022-02-02T18:21:22.915 INFO:tasks.workunit.client.0.smithi096.stdout:0/143: write d2/db/d10/d27/f2d [737839,47923] 0 2022-02-02T18:21:22.915 INFO:tasks.workunit.client.0.smithi096.stdout:1/75: mknod d15/c1e 0 2022-02-02T18:21:22.915 INFO:tasks.workunit.client.0.smithi096.stdout:8/59: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:22.915 INFO:tasks.workunit.client.0.smithi096.stdout:8/60: fsync f1 0 2022-02-02T18:21:22.916 INFO:tasks.workunit.client.0.smithi096.stdout:6/94: link d18/c1b d18/c22 0 2022-02-02T18:21:22.916 INFO:tasks.workunit.client.0.smithi096.stdout:0/144: stat d2/c17 0 2022-02-02T18:21:22.916 INFO:tasks.workunit.client.0.smithi096.stdout:8/61: rename l4 to l9 0 2022-02-02T18:21:22.917 INFO:tasks.workunit.client.0.smithi096.stdout:8/62: mknod ca 0 2022-02-02T18:21:22.917 INFO:tasks.workunit.client.0.smithi096.stdout:8/63: write f1 [7658867,43204] 0 2022-02-02T18:21:22.918 INFO:tasks.workunit.client.0.smithi096.stdout:1/76: dwrite d15/f16 [0,4194304] 0 2022-02-02T18:21:22.918 INFO:tasks.workunit.client.0.smithi096.stdout:5/51: dwrite fa [0,4194304] 0 2022-02-02T18:21:22.919 INFO:tasks.workunit.client.0.smithi096.stdout:5/52: creat db/de/f16 x:0 0 0 2022-02-02T18:21:22.919 INFO:tasks.workunit.client.0.smithi096.stdout:6/95: dwrite d18/f1c [0,4194304] 0 2022-02-02T18:21:22.919 INFO:tasks.workunit.client.0.smithi096.stdout:6/96: creat d18/f23 x:0 0 0 2022-02-02T18:21:22.920 INFO:tasks.workunit.client.0.smithi096.stdout:1/77: symlink d15/l1f 0 2022-02-02T18:21:22.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/145: truncate d2/db/d10/d27/f2d 51653 0 2022-02-02T18:21:22.921 INFO:tasks.workunit.client.0.smithi096.stdout:0/146: mknod d2/db/d10/c31 0 2022-02-02T18:21:22.921 INFO:tasks.workunit.client.0.smithi096.stdout:0/147: truncate d2/f4 266059 0 2022-02-02T18:21:22.922 INFO:tasks.workunit.client.0.smithi096.stdout:0/148: dread d2/ff [0,4194304] 0 2022-02-02T18:21:22.922 INFO:tasks.workunit.client.0.smithi096.stdout:0/149: dread - d2/db/f2a zero size 2022-02-02T18:21:22.922 INFO:tasks.workunit.client.0.smithi096.stdout:0/150: chown d2/db/d10/l2f 3 1 2022-02-02T18:21:22.923 INFO:tasks.workunit.client.0.smithi096.stdout:0/151: symlink d2/db/d10/d27/l32 0 2022-02-02T18:21:22.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/64: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:22.924 INFO:tasks.workunit.client.0.smithi096.stdout:8/65: chown l8 0 1 2022-02-02T18:21:22.924 INFO:tasks.workunit.client.0.smithi096.stdout:8/66: write f1 [4786047,104837] 0 2022-02-02T18:21:22.925 INFO:tasks.workunit.client.0.smithi096.stdout:1/78: dwrite d15/f1a [0,4194304] 0 2022-02-02T18:21:22.925 INFO:tasks.workunit.client.0.smithi096.stdout:8/67: write f5 [1377234,117458] 0 2022-02-02T18:21:22.925 INFO:tasks.workunit.client.0.smithi096.stdout:1/79: write d15/f16 [1451491,18518] 0 2022-02-02T18:21:22.926 INFO:tasks.workunit.client.0.smithi096.stdout:1/80: write f11 [758984,21390] 0 2022-02-02T18:21:22.926 INFO:tasks.workunit.client.0.smithi096.stdout:9/76: sync 2022-02-02T18:21:22.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/97: dwrite d18/f19 [0,4194304] 0 2022-02-02T18:21:22.927 INFO:tasks.workunit.client.0.smithi096.stdout:3/50: sync 2022-02-02T18:21:22.927 INFO:tasks.workunit.client.0.smithi096.stdout:3/51: fdatasync d2/d8/fe 0 2022-02-02T18:21:22.928 INFO:tasks.workunit.client.0.smithi096.stdout:9/77: dread d1/d9/de/f10 [0,4194304] 0 2022-02-02T18:21:22.928 INFO:tasks.workunit.client.0.smithi096.stdout:0/152: rmdir d2/db 39 2022-02-02T18:21:22.929 INFO:tasks.workunit.client.0.smithi096.stdout:8/68: creat fb x:0 0 0 2022-02-02T18:21:22.929 INFO:tasks.workunit.client.0.smithi096.stdout:8/69: unlink fb 0 2022-02-02T18:21:22.930 INFO:tasks.workunit.client.0.smithi096.stdout:8/70: creat fc x:0 0 0 2022-02-02T18:21:22.930 INFO:tasks.workunit.client.0.smithi096.stdout:1/81: readlink l7 0 2022-02-02T18:21:22.937 INFO:tasks.workunit.client.0.smithi096.stdout:6/98: mkdir d18/d24 0 2022-02-02T18:21:22.937 INFO:tasks.workunit.client.0.smithi096.stdout:6/99: write d18/f23 [860912,4009] 0 2022-02-02T18:21:22.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/100: dread - d18/f1f zero size 2022-02-02T18:21:22.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/101: chown l4 5 1 2022-02-02T18:21:22.938 INFO:tasks.workunit.client.0.smithi096.stdout:3/52: readlink d2/d8/lc 0 2022-02-02T18:21:22.939 INFO:tasks.workunit.client.0.smithi096.stdout:9/78: symlink d1/db/l1b 0 2022-02-02T18:21:22.939 INFO:tasks.workunit.client.0.smithi096.stdout:9/79: readlink d1/db/l1b 0 2022-02-02T18:21:22.940 INFO:tasks.workunit.client.0.smithi096.stdout:9/80: read d1/d9/de/ff [28405,73591] 0 2022-02-02T18:21:22.940 INFO:tasks.workunit.client.0.smithi096.stdout:9/81: chown d1/d9/d11/c1a 6730 1 2022-02-02T18:21:22.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/153: creat d2/db/d10/f33 x:0 0 0 2022-02-02T18:21:22.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/154: dread - d2/db/d10/f2b zero size 2022-02-02T18:21:22.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/155: fdatasync d2/db/f19 0 2022-02-02T18:21:22.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/156: write d2/db/d10/f2b [381118,14932] 0 2022-02-02T18:21:22.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/71: mknod cd 0 2022-02-02T18:21:22.943 INFO:tasks.workunit.client.0.smithi096.stdout:3/53: mknod d2/d8/d11/c13 0 2022-02-02T18:21:22.944 INFO:tasks.workunit.client.0.smithi096.stdout:9/82: mkdir d1/db/d1c 0 2022-02-02T18:21:22.944 INFO:tasks.workunit.client.0.smithi096.stdout:0/157: mknod d2/db/d10/c34 0 2022-02-02T18:21:22.945 INFO:tasks.workunit.client.0.smithi096.stdout:3/54: rename d2/d8 to d2/df/d14 0 2022-02-02T18:21:22.945 INFO:tasks.workunit.client.0.smithi096.stdout:3/55: creat d2/f15 x:0 0 0 2022-02-02T18:21:22.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/56: write d2/fd [852288,105691] 0 2022-02-02T18:21:22.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/158: creat d2/d1e/f35 x:0 0 0 2022-02-02T18:21:22.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/159: creat d2/d1e/f36 x:0 0 0 2022-02-02T18:21:22.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/83: rename d1/d9/de/l13 to d1/d9/de/dd/d12/l1d 0 2022-02-02T18:21:22.947 INFO:tasks.workunit.client.0.smithi096.stdout:8/72: getdents . 0 2022-02-02T18:21:22.947 INFO:tasks.workunit.client.0.smithi096.stdout:8/73: symlink le 0 2022-02-02T18:21:22.949 INFO:tasks.workunit.client.0.smithi096.stdout:3/57: dwrite d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:22.949 INFO:tasks.workunit.client.0.smithi096.stdout:3/58: stat d2 0 2022-02-02T18:21:22.950 INFO:tasks.workunit.client.0.smithi096.stdout:9/84: dwrite d1/d9/de/ff [0,4194304] 0 2022-02-02T18:21:22.950 INFO:tasks.workunit.client.0.smithi096.stdout:0/160: dwrite d2/db/d10/f18 [0,4194304] 0 2022-02-02T18:21:22.950 INFO:tasks.workunit.client.0.smithi096.stdout:0/161: stat d2/d1e 0 2022-02-02T18:21:22.950 INFO:tasks.workunit.client.0.smithi096.stdout:0/162: mkdir d2/db/d37 0 2022-02-02T18:21:22.951 INFO:tasks.workunit.client.0.smithi096.stdout:2/94: sync 2022-02-02T18:21:22.951 INFO:tasks.workunit.client.0.smithi096.stdout:4/62: sync 2022-02-02T18:21:22.951 INFO:tasks.workunit.client.0.smithi096.stdout:4/63: dread - d3/f10 zero size 2022-02-02T18:21:22.951 INFO:tasks.workunit.client.0.smithi096.stdout:4/64: write d3/fa [4194688,77468] 0 2022-02-02T18:21:22.951 INFO:tasks.workunit.client.0.smithi096.stdout:2/95: write d2/f4 [1864247,1280] 0 2022-02-02T18:21:22.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/96: write f1 [469847,40796] 0 2022-02-02T18:21:22.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/97: readlink d2/d6/l1a 0 2022-02-02T18:21:22.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/98: write d2/d13/f14 [254514,47659] 0 2022-02-02T18:21:22.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/99: fsync d2/f9 0 2022-02-02T18:21:22.953 INFO:tasks.workunit.client.0.smithi096.stdout:9/85: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:22.954 INFO:tasks.workunit.client.0.smithi096.stdout:2/100: creat d2/d6/db/d10/f1d x:0 0 0 2022-02-02T18:21:22.954 INFO:tasks.workunit.client.0.smithi096.stdout:2/101: rename d2/d19 to d2/d19/d1e 22 2022-02-02T18:21:22.954 INFO:tasks.workunit.client.0.smithi096.stdout:2/102: getdents d2/d6/d1b 0 2022-02-02T18:21:22.955 INFO:tasks.workunit.client.0.smithi096.stdout:9/86: mkdir d1/d9/d11/d1e 0 2022-02-02T18:21:22.955 INFO:tasks.workunit.client.0.smithi096.stdout:9/87: dread d1/d9/de/f10 [0,4194304] 0 2022-02-02T18:21:22.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/103: getdents d2/d13 0 2022-02-02T18:21:22.956 INFO:tasks.workunit.client.0.smithi096.stdout:9/88: creat d1/d9/de/dd/d12/f1f x:0 0 0 2022-02-02T18:21:22.956 INFO:tasks.workunit.client.0.smithi096.stdout:3/59: dwrite d2/df/d14/fe [0,4194304] 0 2022-02-02T18:21:22.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/89: symlink d1/d9/l20 0 2022-02-02T18:21:22.959 INFO:tasks.workunit.client.0.smithi096.stdout:9/90: truncate d1/f4 3029538 0 2022-02-02T18:21:22.961 INFO:tasks.workunit.client.0.smithi096.stdout:3/60: mkdir d2/df/d14/d16 0 2022-02-02T18:21:22.962 INFO:tasks.workunit.client.0.smithi096.stdout:9/91: mknod d1/d9/de/dd/d12/c21 0 2022-02-02T18:21:22.965 INFO:tasks.workunit.client.0.smithi096.stdout:3/61: symlink d2/df/d14/d16/l17 0 2022-02-02T18:21:22.967 INFO:tasks.workunit.client.0.smithi096.stdout:3/62: creat d2/df/d14/f18 x:0 0 0 2022-02-02T18:21:22.967 INFO:tasks.workunit.client.0.smithi096.stdout:3/63: write d2/f15 [45156,40479] 0 2022-02-02T18:21:22.968 INFO:tasks.workunit.client.0.smithi096.stdout:3/64: chown d2/df/d14/lc 435598863 1 2022-02-02T18:21:22.974 INFO:tasks.workunit.client.0.smithi096.stdout:0/163: dwrite d2/f4 [0,4194304] 0 2022-02-02T18:21:22.975 INFO:tasks.workunit.client.0.smithi096.stdout:9/92: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:22.979 INFO:tasks.workunit.client.0.smithi096.stdout:2/104: dwrite d2/d6/db/fc [0,4194304] 0 2022-02-02T18:21:22.980 INFO:tasks.workunit.client.0.smithi096.stdout:4/65: dwrite d3/f6 [0,4194304] 0 2022-02-02T18:21:22.982 INFO:tasks.workunit.client.0.smithi096.stdout:2/105: rmdir d2/d6 39 2022-02-02T18:21:22.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/66: symlink d3/l15 0 2022-02-02T18:21:22.988 INFO:tasks.workunit.client.0.smithi096.stdout:4/67: rename d3/d4/f9 to d3/d4/d14/f16 0 2022-02-02T18:21:22.988 INFO:tasks.workunit.client.0.smithi096.stdout:4/68: fsync d3/f6 0 2022-02-02T18:21:22.989 INFO:tasks.workunit.client.0.smithi096.stdout:2/106: rmdir d2/d6/db 39 2022-02-02T18:21:22.991 INFO:tasks.workunit.client.0.smithi096.stdout:4/69: mknod d3/c17 0 2022-02-02T18:21:22.995 INFO:tasks.workunit.client.0.smithi096.stdout:3/65: dwrite d2/df/d14/f10 [0,4194304] 0 2022-02-02T18:21:22.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/66: chown d2 54530 1 2022-02-02T18:21:22.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/70: write d3/d4/d14/f16 [2577260,4429] 0 2022-02-02T18:21:22.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/71: fdatasync d3/f6 0 2022-02-02T18:21:22.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/72: write d3/f10 [1025252,96108] 0 2022-02-02T18:21:22.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/107: mknod d2/d19/c1f 0 2022-02-02T18:21:22.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/108: read - d2/d6/db/d10/f1d zero size 2022-02-02T18:21:22.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/109: chown d2/c18 8171 1 2022-02-02T18:21:22.997 INFO:tasks.workunit.client.0.smithi096.stdout:3/67: symlink d2/df/d14/d11/l19 0 2022-02-02T18:21:22.998 INFO:tasks.workunit.client.0.smithi096.stdout:4/73: symlink d3/d4/d14/l18 0 2022-02-02T18:21:22.998 INFO:tasks.workunit.client.0.smithi096.stdout:9/93: dwrite d1/d9/de/dd/d12/f1f [0,4194304] 0 2022-02-02T18:21:22.999 INFO:tasks.workunit.client.0.smithi096.stdout:4/74: creat d3/d4/d14/f19 x:0 0 0 2022-02-02T18:21:22.999 INFO:tasks.workunit.client.0.smithi096.stdout:4/75: chown d3/cc 3532 1 2022-02-02T18:21:23.002 INFO:tasks.workunit.client.0.smithi096.stdout:9/94: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:23.003 INFO:tasks.workunit.client.0.smithi096.stdout:4/76: mknod d3/c1a 0 2022-02-02T18:21:23.003 INFO:tasks.workunit.client.0.smithi096.stdout:4/77: read - d3/f8 zero size 2022-02-02T18:21:23.004 INFO:tasks.workunit.client.0.smithi096.stdout:2/110: getdents d2/d19 0 2022-02-02T18:21:23.004 INFO:tasks.workunit.client.0.smithi096.stdout:9/95: symlink d1/d9/d11/l22 0 2022-02-02T18:21:23.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/111: creat d2/d6/f20 x:0 0 0 2022-02-02T18:21:23.006 INFO:tasks.workunit.client.0.smithi096.stdout:2/112: rename d2/d13 to d2/d13/d21 22 2022-02-02T18:21:23.006 INFO:tasks.workunit.client.0.smithi096.stdout:2/113: chown d2/fe 2 1 2022-02-02T18:21:23.006 INFO:tasks.workunit.client.0.smithi096.stdout:2/114: chown l0 16152 1 2022-02-02T18:21:23.006 INFO:tasks.workunit.client.0.smithi096.stdout:2/115: readlink l0 0 2022-02-02T18:21:23.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/96: creat d1/d9/de/f23 x:0 0 0 2022-02-02T18:21:23.010 INFO:tasks.workunit.client.0.smithi096.stdout:3/68: dwrite d2/df/d14/fe [0,4194304] 0 2022-02-02T18:21:23.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/97: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:23.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/98: link d1/d9/de/dd/d12/f1f d1/d9/d11/d1e/f24 0 2022-02-02T18:21:23.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/99: chown d1/d9/de 934465942 1 2022-02-02T18:21:23.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/100: dread - d1/d9/de/f23 zero size 2022-02-02T18:21:23.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/101: truncate d1/d9/de/dd/d12/f1f 4508865 0 2022-02-02T18:21:23.027 INFO:tasks.workunit.client.0.smithi096.stdout:2/116: dwrite d2/d6/db/fc [0,4194304] 0 2022-02-02T18:21:23.027 INFO:tasks.workunit.client.0.smithi096.stdout:2/117: write d2/d6/f20 [367449,35127] 0 2022-02-02T18:21:23.028 INFO:tasks.workunit.client.0.smithi096.stdout:2/118: write d2/d6/f20 [1108543,59309] 0 2022-02-02T18:21:23.028 INFO:tasks.workunit.client.0.smithi096.stdout:2/119: fdatasync d2/d19/f1c 0 2022-02-02T18:21:23.028 INFO:tasks.workunit.client.0.smithi096.stdout:2/120: unlink d2/f7 0 2022-02-02T18:21:23.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/121: unlink d2/d19/c1f 0 2022-02-02T18:21:23.030 INFO:tasks.workunit.client.0.smithi096.stdout:2/122: creat d2/d6/db/d10/f22 x:0 0 0 2022-02-02T18:21:23.035 INFO:tasks.workunit.client.0.smithi096.stdout:9/102: rename d1/d9/de to d1/d9/d25 0 2022-02-02T18:21:23.035 INFO:tasks.workunit.client.0.smithi096.stdout:4/78: dwrite d3/fa [0,4194304] 0 2022-02-02T18:21:23.035 INFO:tasks.workunit.client.0.smithi096.stdout:9/103: read d1/f5 [3356755,74229] 0 2022-02-02T18:21:23.035 INFO:tasks.workunit.client.0.smithi096.stdout:9/104: chown d1/d9/d25/f23 1497719 1 2022-02-02T18:21:23.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/79: mknod d3/d4/c1b 0 2022-02-02T18:21:23.036 INFO:tasks.workunit.client.0.smithi096.stdout:3/69: dwrite d2/fd [0,4194304] 0 2022-02-02T18:21:23.038 INFO:tasks.workunit.client.0.smithi096.stdout:4/80: link f1 d3/d4/f1c 0 2022-02-02T18:21:23.041 INFO:tasks.workunit.client.0.smithi096.stdout:3/70: mkdir d2/df/d1a 0 2022-02-02T18:21:23.044 INFO:tasks.workunit.client.0.smithi096.stdout:4/81: rename d3/d4/cf to d3/d12/c1d 0 2022-02-02T18:21:23.048 INFO:tasks.workunit.client.0.smithi096.stdout:3/71: creat d2/df/d14/f1b x:0 0 0 2022-02-02T18:21:23.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/72: mkdir d2/df/d1c 0 2022-02-02T18:21:23.064 INFO:tasks.workunit.client.0.smithi096.stdout:3/73: dread d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:23.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/74: creat d2/f1d x:0 0 0 2022-02-02T18:21:23.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/75: unlink d2/fd 0 2022-02-02T18:21:23.066 INFO:tasks.workunit.client.0.smithi096.stdout:2/123: dwrite d2/fe [4194304,4194304] 0 2022-02-02T18:21:23.067 INFO:tasks.workunit.client.0.smithi096.stdout:2/124: chown d2/f4 613392 1 2022-02-02T18:21:23.068 INFO:tasks.workunit.client.0.smithi096.stdout:3/76: symlink d2/df/l1e 0 2022-02-02T18:21:23.068 INFO:tasks.workunit.client.0.smithi096.stdout:9/105: dwrite d1/f4 [0,4194304] 0 2022-02-02T18:21:23.069 INFO:tasks.workunit.client.0.smithi096.stdout:4/82: dwrite d3/f8 [0,4194304] 0 2022-02-02T18:21:23.069 INFO:tasks.workunit.client.0.smithi096.stdout:9/106: rmdir d1/d9/d11 39 2022-02-02T18:21:23.070 INFO:tasks.workunit.client.0.smithi096.stdout:3/77: dread d2/f15 [0,4194304] 0 2022-02-02T18:21:23.070 INFO:tasks.workunit.client.0.smithi096.stdout:3/78: write d2/f1d [595298,13142] 0 2022-02-02T18:21:23.075 INFO:tasks.workunit.client.0.smithi096.stdout:4/83: mknod d3/d4/d14/c1e 0 2022-02-02T18:21:23.076 INFO:tasks.workunit.client.0.smithi096.stdout:9/107: mkdir d1/d9/d25/dd/d12/d26 0 2022-02-02T18:21:23.078 INFO:tasks.workunit.client.0.smithi096.stdout:9/108: dread d1/d9/d25/f10 [0,4194304] 0 2022-02-02T18:21:23.081 INFO:tasks.workunit.client.0.smithi096.stdout:9/109: rename d1/d9/l20 to d1/d9/d11/d1e/l27 0 2022-02-02T18:21:23.081 INFO:tasks.workunit.client.0.smithi096.stdout:9/110: dread - d1/d9/d25/f23 zero size 2022-02-02T18:21:23.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/79: dwrite d2/f15 [0,4194304] 0 2022-02-02T18:21:23.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/80: creat d2/df/d14/d11/f1f x:0 0 0 2022-02-02T18:21:23.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/81: stat d2/df/d14/d16 0 2022-02-02T18:21:23.118 INFO:tasks.workunit.client.0.smithi096.stdout:2/125: dwrite d2/f9 [0,4194304] 0 2022-02-02T18:21:23.119 INFO:tasks.workunit.client.0.smithi096.stdout:7/57: sync 2022-02-02T18:21:23.120 INFO:tasks.workunit.client.0.smithi096.stdout:7/58: read f7 [2508528,33838] 0 2022-02-02T18:21:23.121 INFO:tasks.workunit.client.0.smithi096.stdout:7/59: symlink d9/l11 0 2022-02-02T18:21:23.122 INFO:tasks.workunit.client.0.smithi096.stdout:4/84: dwrite d3/f8 [0,4194304] 0 2022-02-02T18:21:23.122 INFO:tasks.workunit.client.0.smithi096.stdout:4/85: chown d3/d4/d14/c1e 1275 1 2022-02-02T18:21:23.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/82: fsync d2/df/d14/d11/f1f 0 2022-02-02T18:21:23.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/83: fdatasync d2/df/d14/d11/f1f 0 2022-02-02T18:21:23.125 INFO:tasks.workunit.client.0.smithi096.stdout:4/86: link f1 d3/d4/d14/f1f 0 2022-02-02T18:21:23.125 INFO:tasks.workunit.client.0.smithi096.stdout:7/60: rmdir d9 39 2022-02-02T18:21:23.126 INFO:tasks.workunit.client.0.smithi096.stdout:4/87: dread f1 [0,4194304] 0 2022-02-02T18:21:23.127 INFO:tasks.workunit.client.0.smithi096.stdout:7/61: read d9/fd [361005,118734] 0 2022-02-02T18:21:23.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/84: mkdir d2/df/d20 0 2022-02-02T18:21:23.128 INFO:tasks.workunit.client.0.smithi096.stdout:4/88: mkdir d3/d4/d20 0 2022-02-02T18:21:23.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/62: mkdir d9/df/d12 0 2022-02-02T18:21:23.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/85: symlink d2/df/d1a/l21 0 2022-02-02T18:21:23.130 INFO:tasks.workunit.client.0.smithi096.stdout:4/89: rename d3/f8 to d3/d4/d14/f21 0 2022-02-02T18:21:23.131 INFO:tasks.workunit.client.0.smithi096.stdout:7/63: symlink d9/l13 0 2022-02-02T18:21:23.131 INFO:tasks.workunit.client.0.smithi096.stdout:7/64: dread - d9/df/f10 zero size 2022-02-02T18:21:23.131 INFO:tasks.workunit.client.0.smithi096.stdout:7/65: getdents d9/df/d12 0 2022-02-02T18:21:23.132 INFO:tasks.workunit.client.0.smithi096.stdout:4/90: link d3/d4/d14/f19 d3/d4/d20/f22 0 2022-02-02T18:21:23.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/126: dwrite d2/d6/db/fc [0,4194304] 0 2022-02-02T18:21:23.134 INFO:tasks.workunit.client.0.smithi096.stdout:2/127: symlink d2/d19/l23 0 2022-02-02T18:21:23.134 INFO:tasks.workunit.client.0.smithi096.stdout:3/86: dread d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:23.135 INFO:tasks.workunit.client.0.smithi096.stdout:2/128: chown d2/f4 108189 1 2022-02-02T18:21:23.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/87: stat d2/df/d14/lc 0 2022-02-02T18:21:23.139 INFO:tasks.workunit.client.0.smithi096.stdout:2/129: link d2/d13/f14 d2/f24 0 2022-02-02T18:21:23.140 INFO:tasks.workunit.client.0.smithi096.stdout:3/88: truncate d2/f7 2321213 0 2022-02-02T18:21:23.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/66: dread d9/fc [0,4194304] 0 2022-02-02T18:21:23.141 INFO:tasks.workunit.client.0.smithi096.stdout:2/130: mknod d2/d19/c25 0 2022-02-02T18:21:23.142 INFO:tasks.workunit.client.0.smithi096.stdout:3/89: symlink d2/df/d1c/l22 0 2022-02-02T18:21:23.143 INFO:tasks.workunit.client.0.smithi096.stdout:7/67: mkdir d9/df/d12/d14 0 2022-02-02T18:21:23.147 INFO:tasks.workunit.client.0.smithi096.stdout:2/131: link d2/f24 d2/d13/f26 0 2022-02-02T18:21:23.147 INFO:tasks.workunit.client.0.smithi096.stdout:4/91: rmdir d3 39 2022-02-02T18:21:23.150 INFO:tasks.workunit.client.0.smithi096.stdout:4/92: rmdir d3/d4 39 2022-02-02T18:21:23.151 INFO:tasks.workunit.client.0.smithi096.stdout:7/68: dread f7 [0,4194304] 0 2022-02-02T18:21:23.152 INFO:tasks.workunit.client.0.smithi096.stdout:4/93: creat d3/d4/f23 x:0 0 0 2022-02-02T18:21:23.153 INFO:tasks.workunit.client.0.smithi096.stdout:7/69: symlink d9/l15 0 2022-02-02T18:21:23.154 INFO:tasks.workunit.client.0.smithi096.stdout:2/132: fsync d2/d13/f14 0 2022-02-02T18:21:23.155 INFO:tasks.workunit.client.0.smithi096.stdout:3/90: write d2/f7 [402255,59157] 0 2022-02-02T18:21:23.156 INFO:tasks.workunit.client.0.smithi096.stdout:7/70: mkdir d9/df/d16 0 2022-02-02T18:21:23.156 INFO:tasks.workunit.client.0.smithi096.stdout:3/91: read d2/df/d14/f12 [1446153,60441] 0 2022-02-02T18:21:23.158 INFO:tasks.workunit.client.0.smithi096.stdout:2/133: rename d2/f4 to d2/d6/db/f27 0 2022-02-02T18:21:23.159 INFO:tasks.workunit.client.0.smithi096.stdout:3/92: creat d2/df/d14/d16/f23 x:0 0 0 2022-02-02T18:21:23.160 INFO:tasks.workunit.client.0.smithi096.stdout:3/93: write d2/df/d14/f18 [287478,105653] 0 2022-02-02T18:21:23.161 INFO:tasks.workunit.client.0.smithi096.stdout:2/134: symlink d2/d13/l28 0 2022-02-02T18:21:23.162 INFO:tasks.workunit.client.0.smithi096.stdout:2/135: truncate d2/d13/f14 171249 0 2022-02-02T18:21:23.169 INFO:tasks.workunit.client.0.smithi096.stdout:3/94: dread d2/f15 [0,4194304] 0 2022-02-02T18:21:23.170 INFO:tasks.workunit.client.0.smithi096.stdout:2/136: dread d2/d6/db/fc [0,4194304] 0 2022-02-02T18:21:23.170 INFO:tasks.workunit.client.0.smithi096.stdout:3/95: creat d2/df/f24 x:0 0 0 2022-02-02T18:21:23.170 INFO:tasks.workunit.client.0.smithi096.stdout:3/96: readlink d2/df/d1c/l22 0 2022-02-02T18:21:23.171 INFO:tasks.workunit.client.0.smithi096.stdout:4/94: dwrite d3/d4/d14/f19 [0,4194304] 0 2022-02-02T18:21:23.172 INFO:tasks.workunit.client.0.smithi096.stdout:4/95: creat d3/d4/f24 x:0 0 0 2022-02-02T18:21:23.172 INFO:tasks.workunit.client.0.smithi096.stdout:3/97: link d2/f15 d2/df/d1a/f25 0 2022-02-02T18:21:23.173 INFO:tasks.workunit.client.0.smithi096.stdout:3/98: creat d2/df/f26 x:0 0 0 2022-02-02T18:21:23.173 INFO:tasks.workunit.client.0.smithi096.stdout:3/99: write d2/df/d14/f1b [425520,25176] 0 2022-02-02T18:21:23.183 INFO:tasks.workunit.client.0.smithi096.stdout:4/96: dread d3/f6 [0,4194304] 0 2022-02-02T18:21:23.183 INFO:tasks.workunit.client.0.smithi096.stdout:4/97: readlink d3/d4/l11 0 2022-02-02T18:21:23.185 INFO:tasks.workunit.client.0.smithi096.stdout:4/98: rename d3/d4/d14/f16 to d3/d12/f25 0 2022-02-02T18:21:23.187 INFO:tasks.workunit.client.0.smithi096.stdout:4/99: unlink d3/fa 0 2022-02-02T18:21:23.188 INFO:tasks.workunit.client.0.smithi096.stdout:4/100: mkdir d3/d4/d20/d26 0 2022-02-02T18:21:23.188 INFO:tasks.workunit.client.0.smithi096.stdout:4/101: readlink d3/d4/l11 0 2022-02-02T18:21:23.192 INFO:tasks.workunit.client.0.smithi096.stdout:5/53: sync 2022-02-02T18:21:23.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/137: dwrite d2/d6/db/d10/f1d [0,4194304] 0 2022-02-02T18:21:23.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/138: write d2/d6/db/fc [4268518,107295] 0 2022-02-02T18:21:23.195 INFO:tasks.workunit.client.0.smithi096.stdout:2/139: dread - d2/d19/f1c zero size 2022-02-02T18:21:23.195 INFO:tasks.workunit.client.0.smithi096.stdout:2/140: chown d2/d6/db/f27 89554010 1 2022-02-02T18:21:23.195 INFO:tasks.workunit.client.0.smithi096.stdout:3/100: dwrite d2/df/d1a/f25 [0,4194304] 0 2022-02-02T18:21:23.196 INFO:tasks.workunit.client.0.smithi096.stdout:2/141: dread d2/d13/f14 [0,4194304] 0 2022-02-02T18:21:23.196 INFO:tasks.workunit.client.0.smithi096.stdout:5/54: write fa [3133638,93706] 0 2022-02-02T18:21:23.197 INFO:tasks.workunit.client.0.smithi096.stdout:3/101: mknod d2/df/d14/d11/c27 0 2022-02-02T18:21:23.198 INFO:tasks.workunit.client.0.smithi096.stdout:2/142: unlink d2/d13/f14 0 2022-02-02T18:21:23.200 INFO:tasks.workunit.client.0.smithi096.stdout:5/55: truncate f6 906648 0 2022-02-02T18:21:23.202 INFO:tasks.workunit.client.0.smithi096.stdout:3/102: rename d2/f7 to d2/df/d1c/f28 0 2022-02-02T18:21:23.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/143: mkdir d2/d29 0 2022-02-02T18:21:23.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/144: fsync d2/d6/db/d10/f22 0 2022-02-02T18:21:23.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/56: symlink db/de/d10/l17 0 2022-02-02T18:21:23.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/57: readlink db/lc 0 2022-02-02T18:21:23.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/58: creat db/de/d10/f18 x:0 0 0 2022-02-02T18:21:23.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/59: chown db 0 1 2022-02-02T18:21:23.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/60: chown fa 1 1 2022-02-02T18:21:23.207 INFO:tasks.workunit.client.0.smithi096.stdout:5/61: creat db/de/d10/f19 x:0 0 0 2022-02-02T18:21:23.207 INFO:tasks.workunit.client.0.smithi096.stdout:5/62: readlink l8 0 2022-02-02T18:21:23.208 INFO:tasks.workunit.client.0.smithi096.stdout:2/145: write d2/d13/f26 [1015681,17876] 0 2022-02-02T18:21:23.208 INFO:tasks.workunit.client.0.smithi096.stdout:4/102: dwrite d3/f6 [0,4194304] 0 2022-02-02T18:21:23.210 INFO:tasks.workunit.client.0.smithi096.stdout:3/103: rmdir d2/df/d14 39 2022-02-02T18:21:23.213 INFO:tasks.workunit.client.0.smithi096.stdout:2/146: mkdir d2/d2a 0 2022-02-02T18:21:23.219 INFO:tasks.workunit.client.0.smithi096.stdout:3/104: creat d2/df/d1c/f29 x:0 0 0 2022-02-02T18:21:23.219 INFO:tasks.workunit.client.0.smithi096.stdout:3/105: readlink d2/df/l1e 0 2022-02-02T18:21:23.223 INFO:tasks.workunit.client.0.smithi096.stdout:2/147: dread d2/fe [4194304,4194304] 0 2022-02-02T18:21:23.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/106: mknod d2/df/d14/c2a 0 2022-02-02T18:21:23.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/107: fsync d2/df/d14/fe 0 2022-02-02T18:21:23.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/108: write d2/f15 [3735684,124043] 0 2022-02-02T18:21:23.225 INFO:tasks.workunit.client.0.smithi096.stdout:1/82: sync 2022-02-02T18:21:23.226 INFO:tasks.workunit.client.0.smithi096.stdout:0/164: sync 2022-02-02T18:21:23.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/102: sync 2022-02-02T18:21:23.226 INFO:tasks.workunit.client.0.smithi096.stdout:8/74: sync 2022-02-02T18:21:23.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/103: rename d18/d24 to d18/d24/d25 22 2022-02-02T18:21:23.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/104: creat d18/f26 x:0 0 0 2022-02-02T18:21:23.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/103: dwrite f1 [0,4194304] 0 2022-02-02T18:21:23.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/165: write d2/db/d10/f16 [3342057,52034] 0 2022-02-02T18:21:23.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/104: truncate d3/d12/f13 985993 0 2022-02-02T18:21:23.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/109: creat d2/df/d14/d11/f2b x:0 0 0 2022-02-02T18:21:23.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/83: mknod d15/c20 0 2022-02-02T18:21:23.231 INFO:tasks.workunit.client.0.smithi096.stdout:8/75: symlink lf 0 2022-02-02T18:21:23.232 INFO:tasks.workunit.client.0.smithi096.stdout:2/148: getdents d2/d19 0 2022-02-02T18:21:23.233 INFO:tasks.workunit.client.0.smithi096.stdout:0/166: write d2/f15 [561657,61838] 0 2022-02-02T18:21:23.238 INFO:tasks.workunit.client.0.smithi096.stdout:4/105: rename d3/d12 to d3/d27 0 2022-02-02T18:21:23.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/84: mknod d15/d1b/c21 0 2022-02-02T18:21:23.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/76: symlink l10 0 2022-02-02T18:21:23.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/77: rmdir - no directory 2022-02-02T18:21:23.243 INFO:tasks.workunit.client.0.smithi096.stdout:2/149: fsync d2/d6/db/fc 0 2022-02-02T18:21:23.243 INFO:tasks.workunit.client.0.smithi096.stdout:8/78: write f1 [3798667,31133] 0 2022-02-02T18:21:23.244 INFO:tasks.workunit.client.0.smithi096.stdout:0/167: mknod d2/c38 0 2022-02-02T18:21:23.244 INFO:tasks.workunit.client.0.smithi096.stdout:0/168: creat d2/db/d10/f39 x:0 0 0 2022-02-02T18:21:23.245 INFO:tasks.workunit.client.0.smithi096.stdout:4/106: creat d3/d27/f28 x:0 0 0 2022-02-02T18:21:23.246 INFO:tasks.workunit.client.0.smithi096.stdout:8/79: rename l10 to l11 0 2022-02-02T18:21:23.247 INFO:tasks.workunit.client.0.smithi096.stdout:0/169: rename d2/db/d10/d27/l32 to d2/db/d37/l3a 0 2022-02-02T18:21:23.247 INFO:tasks.workunit.client.0.smithi096.stdout:2/150: dread d2/f24 [0,4194304] 0 2022-02-02T18:21:23.249 INFO:tasks.workunit.client.0.smithi096.stdout:4/107: creat d3/d4/d14/f29 x:0 0 0 2022-02-02T18:21:23.249 INFO:tasks.workunit.client.0.smithi096.stdout:8/80: mknod c12 0 2022-02-02T18:21:23.250 INFO:tasks.workunit.client.0.smithi096.stdout:8/81: write fc [600180,32921] 0 2022-02-02T18:21:23.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/108: symlink d3/l2a 0 2022-02-02T18:21:23.252 INFO:tasks.workunit.client.0.smithi096.stdout:2/151: symlink d2/d2a/l2b 0 2022-02-02T18:21:23.252 INFO:tasks.workunit.client.0.smithi096.stdout:4/109: mknod d3/d4/d20/d26/c2b 0 2022-02-02T18:21:23.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/110: truncate d3/d4/d14/f19 62323 0 2022-02-02T18:21:23.255 INFO:tasks.workunit.client.0.smithi096.stdout:1/85: dread d15/d1b/f1c [0,4194304] 0 2022-02-02T18:21:23.255 INFO:tasks.workunit.client.0.smithi096.stdout:1/86: creat d15/f22 x:0 0 0 2022-02-02T18:21:23.256 INFO:tasks.workunit.client.0.smithi096.stdout:3/110: dwrite d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:23.256 INFO:tasks.workunit.client.0.smithi096.stdout:2/152: mknod d2/c2c 0 2022-02-02T18:21:23.258 INFO:tasks.workunit.client.0.smithi096.stdout:4/111: symlink d3/d4/l2c 0 2022-02-02T18:21:23.259 INFO:tasks.workunit.client.0.smithi096.stdout:4/112: creat d3/d4/d14/f2d x:0 0 0 2022-02-02T18:21:23.259 INFO:tasks.workunit.client.0.smithi096.stdout:1/87: symlink d15/l23 0 2022-02-02T18:21:23.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/105: dwrite d18/f26 [0,4194304] 0 2022-02-02T18:21:23.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/106: creat d18/f27 x:0 0 0 2022-02-02T18:21:23.263 INFO:tasks.workunit.client.0.smithi096.stdout:1/88: symlink d15/l24 0 2022-02-02T18:21:23.263 INFO:tasks.workunit.client.0.smithi096.stdout:1/89: fsync f13 0 2022-02-02T18:21:23.263 INFO:tasks.workunit.client.0.smithi096.stdout:1/90: fsync d15/d1b/f1c 0 2022-02-02T18:21:23.263 INFO:tasks.workunit.client.0.smithi096.stdout:1/91: chown l10 281607552 1 2022-02-02T18:21:23.264 INFO:tasks.workunit.client.0.smithi096.stdout:1/92: read fc [393721,41374] 0 2022-02-02T18:21:23.269 INFO:tasks.workunit.client.0.smithi096.stdout:4/113: write d3/d4/d14/f19 [224032,77106] 0 2022-02-02T18:21:23.273 INFO:tasks.workunit.client.0.smithi096.stdout:6/107: mkdir d18/d24/d28 0 2022-02-02T18:21:23.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/93: truncate f13 2671898 0 2022-02-02T18:21:23.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/108: truncate d18/f1c 2157912 0 2022-02-02T18:21:23.276 INFO:tasks.workunit.client.0.smithi096.stdout:1/94: creat d15/d1b/f25 x:0 0 0 2022-02-02T18:21:23.276 INFO:tasks.workunit.client.0.smithi096.stdout:1/95: write d15/f1a [4452943,64679] 0 2022-02-02T18:21:23.277 INFO:tasks.workunit.client.0.smithi096.stdout:4/114: write d3/d4/d14/f21 [356417,18356] 0 2022-02-02T18:21:23.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/170: dwrite d2/db/d10/f18 [4194304,4194304] 0 2022-02-02T18:21:23.277 INFO:tasks.workunit.client.0.smithi096.stdout:6/109: mkdir d18/d29 0 2022-02-02T18:21:23.278 INFO:tasks.workunit.client.0.smithi096.stdout:1/96: mkdir d15/d1b/d26 0 2022-02-02T18:21:23.278 INFO:tasks.workunit.client.0.smithi096.stdout:1/97: read f11 [611071,129718] 0 2022-02-02T18:21:23.280 INFO:tasks.workunit.client.0.smithi096.stdout:1/98: write f11 [135549,80601] 0 2022-02-02T18:21:23.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/171: symlink d2/d1e/l3b 0 2022-02-02T18:21:23.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/110: mknod d18/d24/d28/c2a 0 2022-02-02T18:21:23.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/111: readlink l10 0 2022-02-02T18:21:23.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/115: read f1 [3452425,27798] 0 2022-02-02T18:21:23.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/116: fsync d3/f10 0 2022-02-02T18:21:23.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/172: mkdir d2/d3c 0 2022-02-02T18:21:23.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/173: write d2/db/d10/f28 [99357,91259] 0 2022-02-02T18:21:23.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/174: symlink d2/l3d 0 2022-02-02T18:21:23.283 INFO:tasks.workunit.client.0.smithi096.stdout:1/99: write d15/f16 [1971120,77314] 0 2022-02-02T18:21:23.283 INFO:tasks.workunit.client.0.smithi096.stdout:1/100: fsync ff 0 2022-02-02T18:21:23.283 INFO:tasks.workunit.client.0.smithi096.stdout:1/101: chown d15/f1d 1 1 2022-02-02T18:21:23.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/175: creat d2/db/d37/f3e x:0 0 0 2022-02-02T18:21:23.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/176: readlink d2/d1e/l23 0 2022-02-02T18:21:23.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/177: chown d2/db/d10/c1b 149903 1 2022-02-02T18:21:23.285 INFO:tasks.workunit.client.0.smithi096.stdout:0/178: truncate d2/db/f20 164806 0 2022-02-02T18:21:23.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/117: dread d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:23.297 INFO:tasks.workunit.client.0.smithi096.stdout:0/179: dread d2/db/d10/f18 [0,4194304] 0 2022-02-02T18:21:23.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/118: write d3/d27/f25 [1773318,23321] 0 2022-02-02T18:21:23.300 INFO:tasks.workunit.client.0.smithi096.stdout:0/180: write d2/f15 [4022720,118811] 0 2022-02-02T18:21:23.300 INFO:tasks.workunit.client.0.smithi096.stdout:0/181: write d2/d1e/f35 [56406,16619] 0 2022-02-02T18:21:23.301 INFO:tasks.workunit.client.0.smithi096.stdout:0/182: link d2/l3d d2/db/d10/l3f 0 2022-02-02T18:21:23.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/183: write d2/fa [662563,60922] 0 2022-02-02T18:21:23.306 INFO:tasks.workunit.client.0.smithi096.stdout:2/153: dwrite d2/d6/f20 [0,4194304] 0 2022-02-02T18:21:23.308 INFO:tasks.workunit.client.0.smithi096.stdout:3/111: dwrite d2/df/d14/fe [0,4194304] 0 2022-02-02T18:21:23.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/112: dwrite fb [0,4194304] 0 2022-02-02T18:21:23.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/113: chown c5 299 1 2022-02-02T18:21:23.310 INFO:tasks.workunit.client.0.smithi096.stdout:1/102: dwrite d15/d1b/f25 [0,4194304] 0 2022-02-02T18:21:23.310 INFO:tasks.workunit.client.0.smithi096.stdout:8/82: dwrite fc [0,4194304] 0 2022-02-02T18:21:23.310 INFO:tasks.workunit.client.0.smithi096.stdout:1/103: creat d15/f27 x:0 0 0 2022-02-02T18:21:23.310 INFO:tasks.workunit.client.0.smithi096.stdout:3/112: truncate d2/df/d14/f18 205850 0 2022-02-02T18:21:23.311 INFO:tasks.workunit.client.0.smithi096.stdout:3/113: fdatasync d2/df/d14/d16/f23 0 2022-02-02T18:21:23.311 INFO:tasks.workunit.client.0.smithi096.stdout:8/83: read fc [1270933,37686] 0 2022-02-02T18:21:23.312 INFO:tasks.workunit.client.0.smithi096.stdout:2/154: rename d2/d6/ld to d2/d13/l2d 0 2022-02-02T18:21:23.314 INFO:tasks.workunit.client.0.smithi096.stdout:2/155: read d2/d6/db/d10/f1d [1174451,38051] 0 2022-02-02T18:21:23.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/111: sync 2022-02-02T18:21:23.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/71: sync 2022-02-02T18:21:23.317 INFO:tasks.workunit.client.0.smithi096.stdout:7/72: read f0 [4495876,89652] 0 2022-02-02T18:21:23.317 INFO:tasks.workunit.client.0.smithi096.stdout:6/114: symlink d18/l2b 0 2022-02-02T18:21:23.318 INFO:tasks.workunit.client.0.smithi096.stdout:2/156: write d2/d6/db/f27 [841582,128703] 0 2022-02-02T18:21:23.318 INFO:tasks.workunit.client.0.smithi096.stdout:2/157: chown d2/d6/l1a 4 1 2022-02-02T18:21:23.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/119: dwrite d3/d4/d14/f19 [0,4194304] 0 2022-02-02T18:21:23.341 INFO:tasks.workunit.client.0.smithi096.stdout:1/104: mkdir d15/d1b/d28 0 2022-02-02T18:21:23.342 INFO:tasks.workunit.client.0.smithi096.stdout:1/105: creat d15/d1b/f29 x:0 0 0 2022-02-02T18:21:23.342 INFO:tasks.workunit.client.0.smithi096.stdout:1/106: chown l10 56 1 2022-02-02T18:21:23.342 INFO:tasks.workunit.client.0.smithi096.stdout:5/63: sync 2022-02-02T18:21:23.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/112: truncate d1/f6 8064598 0 2022-02-02T18:21:23.344 INFO:tasks.workunit.client.0.smithi096.stdout:7/73: symlink d9/l17 0 2022-02-02T18:21:23.344 INFO:tasks.workunit.client.0.smithi096.stdout:7/74: chown d9/fe 3 1 2022-02-02T18:21:23.346 INFO:tasks.workunit.client.0.smithi096.stdout:6/115: creat d18/d24/f2c x:0 0 0 2022-02-02T18:21:23.352 INFO:tasks.workunit.client.0.smithi096.stdout:4/120: mknod d3/d4/d14/c2e 0 2022-02-02T18:21:23.352 INFO:tasks.workunit.client.0.smithi096.stdout:5/64: creat db/f1a x:0 0 0 2022-02-02T18:21:23.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/114: mkdir d2/df/d14/d2c 0 2022-02-02T18:21:23.353 INFO:tasks.workunit.client.0.smithi096.stdout:5/65: chown db/de/f13 2 1 2022-02-02T18:21:23.353 INFO:tasks.workunit.client.0.smithi096.stdout:2/158: symlink d2/d19/l2e 0 2022-02-02T18:21:23.354 INFO:tasks.workunit.client.0.smithi096.stdout:9/113: creat d1/d9/d25/dd/d12/f28 x:0 0 0 2022-02-02T18:21:23.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/75: mkdir d9/df/d12/d14/d18 0 2022-02-02T18:21:23.355 INFO:tasks.workunit.client.0.smithi096.stdout:1/107: dwrite f11 [0,4194304] 0 2022-02-02T18:21:23.355 INFO:tasks.workunit.client.0.smithi096.stdout:1/108: creat d15/f2a x:0 0 0 2022-02-02T18:21:23.356 INFO:tasks.workunit.client.0.smithi096.stdout:6/116: rename d18/f1f to d18/d24/f2d 0 2022-02-02T18:21:23.356 INFO:tasks.workunit.client.0.smithi096.stdout:3/115: read d2/df/d14/f10 [3244499,29230] 0 2022-02-02T18:21:23.357 INFO:tasks.workunit.client.0.smithi096.stdout:4/121: creat d3/d4/d20/d26/f2f x:0 0 0 2022-02-02T18:21:23.359 INFO:tasks.workunit.client.0.smithi096.stdout:5/66: unlink db/f1a 0 2022-02-02T18:21:23.359 INFO:tasks.workunit.client.0.smithi096.stdout:5/67: stat f6 0 2022-02-02T18:21:23.359 INFO:tasks.workunit.client.0.smithi096.stdout:5/68: creat db/f1b x:0 0 0 2022-02-02T18:21:23.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/69: stat db/de/d10/f19 0 2022-02-02T18:21:23.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/70: dread - db/de/d10/f15 zero size 2022-02-02T18:21:23.360 INFO:tasks.workunit.client.0.smithi096.stdout:2/159: stat d2/d29 0 2022-02-02T18:21:23.361 INFO:tasks.workunit.client.0.smithi096.stdout:9/114: symlink d1/d9/d25/dd/d12/d26/l29 0 2022-02-02T18:21:23.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/76: unlink d9/fe 0 2022-02-02T18:21:23.366 INFO:tasks.workunit.client.0.smithi096.stdout:1/109: truncate fc 491434 0 2022-02-02T18:21:23.367 INFO:tasks.workunit.client.0.smithi096.stdout:3/116: symlink d2/df/d14/d11/l2d 0 2022-02-02T18:21:23.370 INFO:tasks.workunit.client.0.smithi096.stdout:4/122: rename d3/d4/d14/f21 to d3/d27/f30 0 2022-02-02T18:21:23.381 INFO:tasks.workunit.client.0.smithi096.stdout:9/115: mknod d1/d9/d25/c2a 0 2022-02-02T18:21:23.382 INFO:tasks.workunit.client.0.smithi096.stdout:9/116: dread d1/d9/d25/f10 [0,4194304] 0 2022-02-02T18:21:23.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/160: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:23.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/161: readlink l0 0 2022-02-02T18:21:23.392 INFO:tasks.workunit.client.0.smithi096.stdout:5/71: dwrite db/de/d10/f15 [0,4194304] 0 2022-02-02T18:21:23.392 INFO:tasks.workunit.client.0.smithi096.stdout:2/162: getdents d2/d6 0 2022-02-02T18:21:23.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/163: chown d2/d19/l2e 57666 1 2022-02-02T18:21:23.396 INFO:tasks.workunit.client.0.smithi096.stdout:2/164: creat d2/f2f x:0 0 0 2022-02-02T18:21:23.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/72: rmdir db/de/d10 39 2022-02-02T18:21:23.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/73: fdatasync db/de/d10/f15 0 2022-02-02T18:21:23.398 INFO:tasks.workunit.client.0.smithi096.stdout:2/165: creat d2/d2a/f30 x:0 0 0 2022-02-02T18:21:23.398 INFO:tasks.workunit.client.0.smithi096.stdout:2/166: chown d2/f9 152136 1 2022-02-02T18:21:23.399 INFO:tasks.workunit.client.0.smithi096.stdout:2/167: getdents d2/d6/db 0 2022-02-02T18:21:23.400 INFO:tasks.workunit.client.0.smithi096.stdout:5/74: getdents db/de 0 2022-02-02T18:21:23.400 INFO:tasks.workunit.client.0.smithi096.stdout:1/110: dwrite d15/f1a [4194304,4194304] 0 2022-02-02T18:21:23.401 INFO:tasks.workunit.client.0.smithi096.stdout:1/111: readlink d15/l23 0 2022-02-02T18:21:23.401 INFO:tasks.workunit.client.0.smithi096.stdout:2/168: mknod d2/d6/db/c31 0 2022-02-02T18:21:23.402 INFO:tasks.workunit.client.0.smithi096.stdout:5/75: mkdir db/d1c 0 2022-02-02T18:21:23.403 INFO:tasks.workunit.client.0.smithi096.stdout:2/169: creat d2/d29/f32 x:0 0 0 2022-02-02T18:21:23.403 INFO:tasks.workunit.client.0.smithi096.stdout:2/170: stat d2/d6/db 0 2022-02-02T18:21:23.404 INFO:tasks.workunit.client.0.smithi096.stdout:5/76: mkdir db/d1d 0 2022-02-02T18:21:23.405 INFO:tasks.workunit.client.0.smithi096.stdout:5/77: link db/de/d10/c11 db/c1e 0 2022-02-02T18:21:23.406 INFO:tasks.workunit.client.0.smithi096.stdout:7/77: dwrite f2 [0,4194304] 0 2022-02-02T18:21:23.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/171: symlink d2/d6/db/d10/l33 0 2022-02-02T18:21:23.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/172: dread - d2/d29/f32 zero size 2022-02-02T18:21:23.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/173: dread - d2/f2f zero size 2022-02-02T18:21:23.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/174: creat d2/d2a/f34 x:0 0 0 2022-02-02T18:21:23.408 INFO:tasks.workunit.client.0.smithi096.stdout:5/78: mkdir db/de/d1f 0 2022-02-02T18:21:23.408 INFO:tasks.workunit.client.0.smithi096.stdout:5/79: dread - db/de/d10/f19 zero size 2022-02-02T18:21:23.408 INFO:tasks.workunit.client.0.smithi096.stdout:5/80: dread - db/de/f16 zero size 2022-02-02T18:21:23.409 INFO:tasks.workunit.client.0.smithi096.stdout:7/78: mkdir d9/df/d12/d14/d18/d19 0 2022-02-02T18:21:23.409 INFO:tasks.workunit.client.0.smithi096.stdout:5/81: mkdir db/d20 0 2022-02-02T18:21:23.410 INFO:tasks.workunit.client.0.smithi096.stdout:7/79: symlink d9/df/d16/l1a 0 2022-02-02T18:21:23.411 INFO:tasks.workunit.client.0.smithi096.stdout:7/80: write f7 [4199988,130465] 0 2022-02-02T18:21:23.412 INFO:tasks.workunit.client.0.smithi096.stdout:5/82: symlink db/de/d1f/l21 0 2022-02-02T18:21:23.413 INFO:tasks.workunit.client.0.smithi096.stdout:7/81: rmdir d9/df/d12/d14 39 2022-02-02T18:21:23.414 INFO:tasks.workunit.client.0.smithi096.stdout:7/82: rmdir d9/df/d12 39 2022-02-02T18:21:23.416 INFO:tasks.workunit.client.0.smithi096.stdout:7/83: write f2 [3321161,115276] 0 2022-02-02T18:21:23.416 INFO:tasks.workunit.client.0.smithi096.stdout:7/84: write d9/df/f10 [413183,128703] 0 2022-02-02T18:21:23.417 INFO:tasks.workunit.client.0.smithi096.stdout:9/117: dwrite d1/d9/d25/ff [4194304,4194304] 0 2022-02-02T18:21:23.417 INFO:tasks.workunit.client.0.smithi096.stdout:9/118: write d1/d9/d25/f10 [1059660,21443] 0 2022-02-02T18:21:23.418 INFO:tasks.workunit.client.0.smithi096.stdout:9/119: fdatasync d1/f8 0 2022-02-02T18:21:23.418 INFO:tasks.workunit.client.0.smithi096.stdout:9/120: write d1/f5 [4598619,116592] 0 2022-02-02T18:21:23.418 INFO:tasks.workunit.client.0.smithi096.stdout:7/85: mknod d9/df/c1b 0 2022-02-02T18:21:23.419 INFO:tasks.workunit.client.0.smithi096.stdout:9/121: mkdir d1/d9/d25/dd/d12/d26/d2b 0 2022-02-02T18:21:23.420 INFO:tasks.workunit.client.0.smithi096.stdout:9/122: creat d1/f2c x:0 0 0 2022-02-02T18:21:23.421 INFO:tasks.workunit.client.0.smithi096.stdout:9/123: dread d1/d9/d25/dd/d12/f1f [4194304,4194304] 0 2022-02-02T18:21:23.421 INFO:tasks.workunit.client.0.smithi096.stdout:9/124: chown d1/d9/d25/dd/d12/c21 2776150 1 2022-02-02T18:21:23.421 INFO:tasks.workunit.client.0.smithi096.stdout:9/125: readlink d1/d9/d11/l22 0 2022-02-02T18:21:23.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/123: dwrite d3/d4/d20/d26/f2f [0,4194304] 0 2022-02-02T18:21:23.422 INFO:tasks.workunit.client.0.smithi096.stdout:3/117: dwrite d2/df/f26 [0,4194304] 0 2022-02-02T18:21:23.423 INFO:tasks.workunit.client.0.smithi096.stdout:3/118: chown d2/df/d14/d11 9525394 1 2022-02-02T18:21:23.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/126: creat d1/d9/d11/f2d x:0 0 0 2022-02-02T18:21:23.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/127: fsync d1/d9/d25/dd/d12/f1f 0 2022-02-02T18:21:23.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/128: truncate d1/f4 5242813 0 2022-02-02T18:21:23.424 INFO:tasks.workunit.client.0.smithi096.stdout:4/124: write d3/d27/f25 [1141367,21042] 0 2022-02-02T18:21:23.425 INFO:tasks.workunit.client.0.smithi096.stdout:4/125: truncate d3/d27/f28 774709 0 2022-02-02T18:21:23.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/175: dwrite d2/d6/db/d10/f22 [0,4194304] 0 2022-02-02T18:21:23.429 INFO:tasks.workunit.client.0.smithi096.stdout:4/126: dread d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:23.429 INFO:tasks.workunit.client.0.smithi096.stdout:4/127: write d3/d4/f24 [58607,114221] 0 2022-02-02T18:21:23.436 INFO:tasks.workunit.client.0.smithi096.stdout:5/83: rename db/de/d1f to db/d1d/d22 0 2022-02-02T18:21:23.436 INFO:tasks.workunit.client.0.smithi096.stdout:9/129: symlink d1/d9/d25/l2e 0 2022-02-02T18:21:23.436 INFO:tasks.workunit.client.0.smithi096.stdout:5/84: readlink db/de/d10/l17 0 2022-02-02T18:21:23.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/85: mknod db/d1d/d22/c23 0 2022-02-02T18:21:23.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/86: dread - db/de/d10/f18 zero size 2022-02-02T18:21:23.441 INFO:tasks.workunit.client.0.smithi096.stdout:5/87: dread - db/de/f13 zero size 2022-02-02T18:21:23.441 INFO:tasks.workunit.client.0.smithi096.stdout:5/88: read - db/de/f16 zero size 2022-02-02T18:21:23.442 INFO:tasks.workunit.client.0.smithi096.stdout:7/86: rename c5 to d9/df/d12/c1c 0 2022-02-02T18:21:23.444 INFO:tasks.workunit.client.0.smithi096.stdout:7/87: write d9/fc [3407892,105940] 0 2022-02-02T18:21:23.444 INFO:tasks.workunit.client.0.smithi096.stdout:7/88: chown d9/fd 6 1 2022-02-02T18:21:23.448 INFO:tasks.workunit.client.0.smithi096.stdout:3/119: dwrite d2/df/d14/f12 [4194304,4194304] 0 2022-02-02T18:21:23.449 INFO:tasks.workunit.client.0.smithi096.stdout:2/176: dwrite d2/f24 [0,4194304] 0 2022-02-02T18:21:23.453 INFO:tasks.workunit.client.0.smithi096.stdout:2/177: symlink d2/d13/l35 0 2022-02-02T18:21:23.453 INFO:tasks.workunit.client.0.smithi096.stdout:2/178: readlink d2/d13/l35 0 2022-02-02T18:21:23.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/179: mknod d2/d29/c36 0 2022-02-02T18:21:23.462 INFO:tasks.workunit.client.0.smithi096.stdout:9/130: dwrite d1/d9/f18 [0,4194304] 0 2022-02-02T18:21:23.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/180: write d2/f9 [1910359,70838] 0 2022-02-02T18:21:23.467 INFO:tasks.workunit.client.0.smithi096.stdout:2/181: rmdir d2/d19 39 2022-02-02T18:21:23.469 INFO:tasks.workunit.client.0.smithi096.stdout:2/182: mknod d2/d6/db/c37 0 2022-02-02T18:21:23.480 INFO:tasks.workunit.client.0.smithi096.stdout:0/184: sync 2022-02-02T18:21:23.481 INFO:tasks.workunit.client.0.smithi096.stdout:2/183: dread d2/d13/f26 [0,4194304] 0 2022-02-02T18:21:23.481 INFO:tasks.workunit.client.0.smithi096.stdout:2/184: write d2/d2a/f30 [494907,113083] 0 2022-02-02T18:21:23.481 INFO:tasks.workunit.client.0.smithi096.stdout:0/185: dread d2/db/f20 [0,4194304] 0 2022-02-02T18:21:23.482 INFO:tasks.workunit.client.0.smithi096.stdout:0/186: readlink d2/db/d37/l3a 0 2022-02-02T18:21:23.482 INFO:tasks.workunit.client.0.smithi096.stdout:0/187: stat d2/ff 0 2022-02-02T18:21:23.483 INFO:tasks.workunit.client.0.smithi096.stdout:2/185: creat d2/d6/db/f38 x:0 0 0 2022-02-02T18:21:23.483 INFO:tasks.workunit.client.0.smithi096.stdout:2/186: truncate d2/d6/db/f38 857437 0 2022-02-02T18:21:23.484 INFO:tasks.workunit.client.0.smithi096.stdout:0/188: rename d2/d3c to d2/db/d37/d40 0 2022-02-02T18:21:23.487 INFO:tasks.workunit.client.0.smithi096.stdout:8/84: sync 2022-02-02T18:21:23.487 INFO:tasks.workunit.client.0.smithi096.stdout:6/117: sync 2022-02-02T18:21:23.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/131: dwrite d1/d9/d11/f2d [0,4194304] 0 2022-02-02T18:21:23.490 INFO:tasks.workunit.client.0.smithi096.stdout:2/187: dread f1 [0,4194304] 0 2022-02-02T18:21:23.491 INFO:tasks.workunit.client.0.smithi096.stdout:6/118: symlink d18/d24/d28/l2e 0 2022-02-02T18:21:23.491 INFO:tasks.workunit.client.0.smithi096.stdout:6/119: fdatasync d18/f26 0 2022-02-02T18:21:23.491 INFO:tasks.workunit.client.0.smithi096.stdout:5/89: dwrite db/de/f13 [0,4194304] 0 2022-02-02T18:21:23.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/89: dwrite d9/fc [0,4194304] 0 2022-02-02T18:21:23.492 INFO:tasks.workunit.client.0.smithi096.stdout:8/85: mknod c13 0 2022-02-02T18:21:23.492 INFO:tasks.workunit.client.0.smithi096.stdout:9/132: mkdir d1/db/d1c/d2f 0 2022-02-02T18:21:23.493 INFO:tasks.workunit.client.0.smithi096.stdout:9/133: creat d1/d9/d11/f30 x:0 0 0 2022-02-02T18:21:23.493 INFO:tasks.workunit.client.0.smithi096.stdout:9/134: write d1/d9/d25/ff [6149469,32326] 0 2022-02-02T18:21:23.493 INFO:tasks.workunit.client.0.smithi096.stdout:2/188: creat d2/d6/d1b/f39 x:0 0 0 2022-02-02T18:21:23.494 INFO:tasks.workunit.client.0.smithi096.stdout:6/120: creat d18/d29/f2f x:0 0 0 2022-02-02T18:21:23.494 INFO:tasks.workunit.client.0.smithi096.stdout:6/121: fdatasync d18/f1a 0 2022-02-02T18:21:23.501 INFO:tasks.workunit.client.0.smithi096.stdout:5/90: creat db/d1d/d22/f24 x:0 0 0 2022-02-02T18:21:23.501 INFO:tasks.workunit.client.0.smithi096.stdout:5/91: fsync db/de/d10/f19 0 2022-02-02T18:21:23.503 INFO:tasks.workunit.client.0.smithi096.stdout:8/86: mknod c14 0 2022-02-02T18:21:23.503 INFO:tasks.workunit.client.0.smithi096.stdout:8/87: fsync f1 0 2022-02-02T18:21:23.503 INFO:tasks.workunit.client.0.smithi096.stdout:8/88: chown f1 62436 1 2022-02-02T18:21:23.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/189: dwrite d2/db/d10/f16 [0,4194304] 0 2022-02-02T18:21:23.506 INFO:tasks.workunit.client.0.smithi096.stdout:9/135: getdents d1/d9/d11/d1e 0 2022-02-02T18:21:23.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/112: sync 2022-02-02T18:21:23.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/113: truncate d15/d1b/f29 938515 0 2022-02-02T18:21:23.510 INFO:tasks.workunit.client.0.smithi096.stdout:6/122: mknod d18/d24/d28/c30 0 2022-02-02T18:21:23.511 INFO:tasks.workunit.client.0.smithi096.stdout:5/92: mkdir db/de/d10/d25 0 2022-02-02T18:21:23.512 INFO:tasks.workunit.client.0.smithi096.stdout:7/90: dwrite f0 [0,4194304] 0 2022-02-02T18:21:23.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/89: link f5 f15 0 2022-02-02T18:21:23.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/90: rmdir - no directory 2022-02-02T18:21:23.514 INFO:tasks.workunit.client.0.smithi096.stdout:1/114: read f13 [1855575,92278] 0 2022-02-02T18:21:23.514 INFO:tasks.workunit.client.0.smithi096.stdout:2/189: getdents d2/d13 0 2022-02-02T18:21:23.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/123: rename d18/d29/f2f to d18/f31 0 2022-02-02T18:21:23.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/124: dread - d18/d24/f2c zero size 2022-02-02T18:21:23.517 INFO:tasks.workunit.client.0.smithi096.stdout:5/93: mknod db/c26 0 2022-02-02T18:21:23.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/94: chown db/d1d/d22/c23 3610903 1 2022-02-02T18:21:23.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/95: write f6 [540818,128509] 0 2022-02-02T18:21:23.519 INFO:tasks.workunit.client.0.smithi096.stdout:8/91: mknod c16 0 2022-02-02T18:21:23.519 INFO:tasks.workunit.client.0.smithi096.stdout:1/115: mknod d15/d1b/d28/c2b 0 2022-02-02T18:21:23.520 INFO:tasks.workunit.client.0.smithi096.stdout:2/190: mkdir d2/d6/d1b/d3a 0 2022-02-02T18:21:23.521 INFO:tasks.workunit.client.0.smithi096.stdout:9/136: dwrite d1/d9/d25/f10 [0,4194304] 0 2022-02-02T18:21:23.521 INFO:tasks.workunit.client.0.smithi096.stdout:1/116: dread fc [0,4194304] 0 2022-02-02T18:21:23.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/125: symlink d18/d29/l32 0 2022-02-02T18:21:23.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/126: creat d18/d24/f33 x:0 0 0 2022-02-02T18:21:23.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/127: chown d18/f1c 29 1 2022-02-02T18:21:23.525 INFO:tasks.workunit.client.0.smithi096.stdout:5/96: rename db/d1c to db/de/d10/d27 0 2022-02-02T18:21:23.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/91: link c3 d9/df/d12/d14/d18/c1d 0 2022-02-02T18:21:23.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/92: fdatasync d9/fd 0 2022-02-02T18:21:23.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/93: chown d9/df/f10 9716940 1 2022-02-02T18:21:23.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/94: fsync d9/fb 0 2022-02-02T18:21:23.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/95: unlink d9/fb 0 2022-02-02T18:21:23.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/128: sync 2022-02-02T18:21:23.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/129: readlink d3/d4/d14/l18 0 2022-02-02T18:21:23.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/130: chown d3/d27/c1d 1 1 2022-02-02T18:21:23.529 INFO:tasks.workunit.client.0.smithi096.stdout:5/97: read f3 [2605609,61561] 0 2022-02-02T18:21:23.529 INFO:tasks.workunit.client.0.smithi096.stdout:5/98: write db/d1d/d22/f24 [45383,70846] 0 2022-02-02T18:21:23.530 INFO:tasks.workunit.client.0.smithi096.stdout:7/96: dread d9/df/f10 [0,4194304] 0 2022-02-02T18:21:23.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/137: unlink d1/f5 0 2022-02-02T18:21:23.531 INFO:tasks.workunit.client.0.smithi096.stdout:1/117: mkdir d15/d1b/d28/d2c 0 2022-02-02T18:21:23.531 INFO:tasks.workunit.client.0.smithi096.stdout:1/118: write d15/f27 [944648,21643] 0 2022-02-02T18:21:23.531 INFO:tasks.workunit.client.0.smithi096.stdout:8/92: getdents . 0 2022-02-02T18:21:23.537 INFO:tasks.workunit.client.0.smithi096.stdout:6/128: rename d18/f21 to d18/d29/f34 0 2022-02-02T18:21:23.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/99: mknod db/de/d10/d27/c28 0 2022-02-02T18:21:23.540 INFO:tasks.workunit.client.0.smithi096.stdout:7/97: rmdir d9/df/d12/d14/d18 39 2022-02-02T18:21:23.542 INFO:tasks.workunit.client.0.smithi096.stdout:9/138: creat d1/d9/d11/d1e/f31 x:0 0 0 2022-02-02T18:21:23.544 INFO:tasks.workunit.client.0.smithi096.stdout:1/119: symlink d15/d1b/d26/l2d 0 2022-02-02T18:21:23.544 INFO:tasks.workunit.client.0.smithi096.stdout:1/120: creat d15/f2e x:0 0 0 2022-02-02T18:21:23.544 INFO:tasks.workunit.client.0.smithi096.stdout:1/121: write d15/f2a [647924,104442] 0 2022-02-02T18:21:23.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/122: truncate d15/f2e 76564 0 2022-02-02T18:21:23.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/123: creat d15/d1b/f2f x:0 0 0 2022-02-02T18:21:23.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/124: dread - d15/f22 zero size 2022-02-02T18:21:23.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/125: write d15/d1b/f1c [423856,95647] 0 2022-02-02T18:21:23.547 INFO:tasks.workunit.client.0.smithi096.stdout:4/131: rename d3/d4/le to d3/l31 0 2022-02-02T18:21:23.548 INFO:tasks.workunit.client.0.smithi096.stdout:5/100: creat db/d20/f29 x:0 0 0 2022-02-02T18:21:23.551 INFO:tasks.workunit.client.0.smithi096.stdout:8/93: dwrite fc [0,4194304] 0 2022-02-02T18:21:23.556 INFO:tasks.workunit.client.0.smithi096.stdout:1/126: link c4 d15/d1b/d26/c30 0 2022-02-02T18:21:23.557 INFO:tasks.workunit.client.0.smithi096.stdout:3/120: sync 2022-02-02T18:21:23.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/98: dwrite f0 [0,4194304] 0 2022-02-02T18:21:23.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/129: rename d18/d24/f2c to d18/d24/d28/f35 0 2022-02-02T18:21:23.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/130: fsync f2 0 2022-02-02T18:21:23.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/131: chown d18/l20 29 1 2022-02-02T18:21:23.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/132: creat d18/d24/f36 x:0 0 0 2022-02-02T18:21:23.560 INFO:tasks.workunit.client.0.smithi096.stdout:4/132: link d3/f6 d3/f32 0 2022-02-02T18:21:23.562 INFO:tasks.workunit.client.0.smithi096.stdout:5/101: unlink db/c1e 0 2022-02-02T18:21:23.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/139: getdents d1/d9/d11/d1e 0 2022-02-02T18:21:23.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/140: dread - d1/f2c zero size 2022-02-02T18:21:23.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/141: dread - d1/d9/d11/f30 zero size 2022-02-02T18:21:23.564 INFO:tasks.workunit.client.0.smithi096.stdout:5/102: dread db/d1d/d22/f24 [0,4194304] 0 2022-02-02T18:21:23.564 INFO:tasks.workunit.client.0.smithi096.stdout:5/103: dread - db/f1b zero size 2022-02-02T18:21:23.564 INFO:tasks.workunit.client.0.smithi096.stdout:5/104: stat db/d20/f29 0 2022-02-02T18:21:23.565 INFO:tasks.workunit.client.0.smithi096.stdout:5/105: unlink db/lf 0 2022-02-02T18:21:23.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/94: creat f17 x:0 0 0 2022-02-02T18:21:23.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/95: dread - f17 zero size 2022-02-02T18:21:23.566 INFO:tasks.workunit.client.0.smithi096.stdout:8/96: read f1 [2047325,45468] 0 2022-02-02T18:21:23.566 INFO:tasks.workunit.client.0.smithi096.stdout:5/106: dread db/d1d/d22/f24 [0,4194304] 0 2022-02-02T18:21:23.567 INFO:tasks.workunit.client.0.smithi096.stdout:5/107: dread - db/de/d10/f19 zero size 2022-02-02T18:21:23.567 INFO:tasks.workunit.client.0.smithi096.stdout:1/127: creat d15/d1b/d26/f31 x:0 0 0 2022-02-02T18:21:23.571 INFO:tasks.workunit.client.0.smithi096.stdout:7/99: dread f2 [0,4194304] 0 2022-02-02T18:21:23.572 INFO:tasks.workunit.client.0.smithi096.stdout:6/133: creat d18/d24/d28/f37 x:0 0 0 2022-02-02T18:21:23.572 INFO:tasks.workunit.client.0.smithi096.stdout:4/133: rmdir d3/d4/d20 39 2022-02-02T18:21:23.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/97: mknod c18 0 2022-02-02T18:21:23.573 INFO:tasks.workunit.client.0.smithi096.stdout:3/121: symlink d2/df/d14/l2e 0 2022-02-02T18:21:23.573 INFO:tasks.workunit.client.0.smithi096.stdout:6/134: read f2 [3564519,46268] 0 2022-02-02T18:21:23.574 INFO:tasks.workunit.client.0.smithi096.stdout:4/134: write f1 [1659717,3552] 0 2022-02-02T18:21:23.575 INFO:tasks.workunit.client.0.smithi096.stdout:6/135: link d18/d29/l32 d18/d24/d28/l38 0 2022-02-02T18:21:23.575 INFO:tasks.workunit.client.0.smithi096.stdout:6/136: stat d18/l2b 0 2022-02-02T18:21:23.575 INFO:tasks.workunit.client.0.smithi096.stdout:1/128: dread d15/f1a [4194304,4194304] 0 2022-02-02T18:21:23.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/108: dread db/de/d10/f15 [0,4194304] 0 2022-02-02T18:21:23.577 INFO:tasks.workunit.client.0.smithi096.stdout:4/135: mknod d3/d4/c33 0 2022-02-02T18:21:23.578 INFO:tasks.workunit.client.0.smithi096.stdout:8/98: write fc [2760197,65538] 0 2022-02-02T18:21:23.578 INFO:tasks.workunit.client.0.smithi096.stdout:3/122: write d2/df/f26 [2023477,36129] 0 2022-02-02T18:21:23.578 INFO:tasks.workunit.client.0.smithi096.stdout:3/123: readlink d2/df/d1a/l21 0 2022-02-02T18:21:23.578 INFO:tasks.workunit.client.0.smithi096.stdout:3/124: fdatasync d2/f15 0 2022-02-02T18:21:23.579 INFO:tasks.workunit.client.0.smithi096.stdout:3/125: creat d2/df/f2f x:0 0 0 2022-02-02T18:21:23.579 INFO:tasks.workunit.client.0.smithi096.stdout:3/126: dread - d2/df/f2f zero size 2022-02-02T18:21:23.579 INFO:tasks.workunit.client.0.smithi096.stdout:5/109: link db/de/d10/f18 db/de/f2a 0 2022-02-02T18:21:23.580 INFO:tasks.workunit.client.0.smithi096.stdout:9/142: dwrite d1/d9/d25/f10 [0,4194304] 0 2022-02-02T18:21:23.580 INFO:tasks.workunit.client.0.smithi096.stdout:9/143: chown d1/d9/d25/dd/d12/f28 725 1 2022-02-02T18:21:23.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/136: rmdir d3/d27 39 2022-02-02T18:21:23.581 INFO:tasks.workunit.client.0.smithi096.stdout:6/137: read f12 [4278993,45497] 0 2022-02-02T18:21:23.581 INFO:tasks.workunit.client.0.smithi096.stdout:5/110: rmdir db/de/d10/d27 39 2022-02-02T18:21:23.582 INFO:tasks.workunit.client.0.smithi096.stdout:4/137: rename d3/f6 to d3/d4/d20/d26/f34 0 2022-02-02T18:21:23.583 INFO:tasks.workunit.client.0.smithi096.stdout:4/138: write d3/fd [492827,113810] 0 2022-02-02T18:21:23.583 INFO:tasks.workunit.client.0.smithi096.stdout:5/111: creat db/de/d10/d27/f2b x:0 0 0 2022-02-02T18:21:23.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/138: rename d18/d24/d28/f37 to d18/d29/f39 0 2022-02-02T18:21:23.586 INFO:tasks.workunit.client.0.smithi096.stdout:3/127: dread d2/df/d1c/f28 [0,4194304] 0 2022-02-02T18:21:23.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/139: rename d3/d27/c1d to d3/d4/d14/c35 0 2022-02-02T18:21:23.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/140: truncate d3/d27/f30 4867195 0 2022-02-02T18:21:23.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/128: rename d2/df/d14/fe to d2/df/d14/f30 0 2022-02-02T18:21:23.601 INFO:tasks.workunit.client.0.smithi096.stdout:3/129: write d2/df/f26 [2199480,35191] 0 2022-02-02T18:21:23.602 INFO:tasks.workunit.client.0.smithi096.stdout:3/130: mkdir d2/df/d14/d2c/d31 0 2022-02-02T18:21:23.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/100: dwrite d9/fd [0,4194304] 0 2022-02-02T18:21:23.614 INFO:tasks.workunit.client.0.smithi096.stdout:8/99: dwrite f5 [0,4194304] 0 2022-02-02T18:21:23.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/100: read fc [1164488,90958] 0 2022-02-02T18:21:23.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/101: readlink l8 0 2022-02-02T18:21:23.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/102: read f5 [3613645,30829] 0 2022-02-02T18:21:23.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/112: fsync db/de/d10/d27/f2b 0 2022-02-02T18:21:23.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/113: stat db 0 2022-02-02T18:21:23.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/144: dwrite d1/f6 [0,4194304] 0 2022-02-02T18:21:23.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/145: write d1/d9/d11/d1e/f31 [75240,115930] 0 2022-02-02T18:21:23.624 INFO:tasks.workunit.client.0.smithi096.stdout:6/139: dwrite fb [0,4194304] 0 2022-02-02T18:21:23.625 INFO:tasks.workunit.client.0.smithi096.stdout:1/129: dwrite d15/f2a [0,4194304] 0 2022-02-02T18:21:23.625 INFO:tasks.workunit.client.0.smithi096.stdout:3/131: dwrite d2/df/d14/d11/f1f [0,4194304] 0 2022-02-02T18:21:23.625 INFO:tasks.workunit.client.0.smithi096.stdout:3/132: fdatasync d2/df/d14/f10 0 2022-02-02T18:21:23.625 INFO:tasks.workunit.client.0.smithi096.stdout:4/141: rmdir d3/d4/d14 39 2022-02-02T18:21:23.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/142: write d3/d4/d20/f22 [4296985,83374] 0 2022-02-02T18:21:23.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/143: write d3/d4/f1c [3413934,121507] 0 2022-02-02T18:21:23.627 INFO:tasks.workunit.client.0.smithi096.stdout:9/146: unlink d1/d9/d25/f10 0 2022-02-02T18:21:23.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/144: write f1 [2769216,42538] 0 2022-02-02T18:21:23.629 INFO:tasks.workunit.client.0.smithi096.stdout:7/101: truncate f0 2852551 0 2022-02-02T18:21:23.629 INFO:tasks.workunit.client.0.smithi096.stdout:7/102: fdatasync f7 0 2022-02-02T18:21:23.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/103: dread f15 [0,4194304] 0 2022-02-02T18:21:23.638 INFO:tasks.workunit.client.0.smithi096.stdout:1/130: mknod d15/d1b/d28/d2c/c32 0 2022-02-02T18:21:23.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/133: rmdir d2/df/d14/d2c 39 2022-02-02T18:21:23.639 INFO:tasks.workunit.client.0.smithi096.stdout:9/147: creat d1/db/d1c/d2f/f32 x:0 0 0 2022-02-02T18:21:23.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/145: mkdir d3/d4/d20/d26/d36 0 2022-02-02T18:21:23.643 INFO:tasks.workunit.client.0.smithi096.stdout:4/146: write d3/d27/f28 [1083207,63622] 0 2022-02-02T18:21:23.643 INFO:tasks.workunit.client.0.smithi096.stdout:4/147: creat d3/d4/f37 x:0 0 0 2022-02-02T18:21:23.643 INFO:tasks.workunit.client.0.smithi096.stdout:4/148: chown d3/d4/d20/d26 459942 1 2022-02-02T18:21:23.644 INFO:tasks.workunit.client.0.smithi096.stdout:7/103: creat d9/df/d12/d14/d18/d19/f1e x:0 0 0 2022-02-02T18:21:23.644 INFO:tasks.workunit.client.0.smithi096.stdout:4/149: dread d3/d4/f24 [0,4194304] 0 2022-02-02T18:21:23.648 INFO:tasks.workunit.client.0.smithi096.stdout:1/131: symlink d15/d1b/d26/l33 0 2022-02-02T18:21:23.648 INFO:tasks.workunit.client.0.smithi096.stdout:3/134: mknod d2/df/d1a/c32 0 2022-02-02T18:21:23.649 INFO:tasks.workunit.client.0.smithi096.stdout:4/150: write d3/f32 [2025081,34167] 0 2022-02-02T18:21:23.652 INFO:tasks.workunit.client.0.smithi096.stdout:5/114: dwrite db/de/d10/f19 [0,4194304] 0 2022-02-02T18:21:23.652 INFO:tasks.workunit.client.0.smithi096.stdout:5/115: truncate db/f1b 499134 0 2022-02-02T18:21:23.653 INFO:tasks.workunit.client.0.smithi096.stdout:6/140: dwrite d18/d24/f33 [0,4194304] 0 2022-02-02T18:21:23.654 INFO:tasks.workunit.client.0.smithi096.stdout:9/148: unlink d1/d9/d25/dd/d12/f28 0 2022-02-02T18:21:23.654 INFO:tasks.workunit.client.0.smithi096.stdout:9/149: truncate d1/d9/d11/f30 202112 0 2022-02-02T18:21:23.655 INFO:tasks.workunit.client.0.smithi096.stdout:9/150: chown d1/d9/d25/dd/d12/c21 154 1 2022-02-02T18:21:23.657 INFO:tasks.workunit.client.0.smithi096.stdout:4/151: dread d3/d27/f28 [0,4194304] 0 2022-02-02T18:21:23.657 INFO:tasks.workunit.client.0.smithi096.stdout:4/152: rename d3/d4 to d3/d4/d20/d38 22 2022-02-02T18:21:23.659 INFO:tasks.workunit.client.0.smithi096.stdout:5/116: truncate fa 3041017 0 2022-02-02T18:21:23.660 INFO:tasks.workunit.client.0.smithi096.stdout:5/117: read db/de/d10/f15 [2953598,51549] 0 2022-02-02T18:21:23.660 INFO:tasks.workunit.client.0.smithi096.stdout:5/118: write db/de/d10/d27/f2b [849854,92768] 0 2022-02-02T18:21:23.661 INFO:tasks.workunit.client.0.smithi096.stdout:2/191: sync 2022-02-02T18:21:23.661 INFO:tasks.workunit.client.0.smithi096.stdout:0/190: sync 2022-02-02T18:21:23.661 INFO:tasks.workunit.client.0.smithi096.stdout:0/191: truncate d2/d1e/f2e 926228 0 2022-02-02T18:21:23.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/151: mknod d1/d9/d25/dd/d12/c33 0 2022-02-02T18:21:23.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/152: dread - d1/db/d1c/d2f/f32 zero size 2022-02-02T18:21:23.664 INFO:tasks.workunit.client.0.smithi096.stdout:9/153: creat d1/f34 x:0 0 0 2022-02-02T18:21:23.664 INFO:tasks.workunit.client.0.smithi096.stdout:9/154: truncate d1/d9/d11/f30 1112245 0 2022-02-02T18:21:23.664 INFO:tasks.workunit.client.0.smithi096.stdout:3/135: rmdir d2/df/d1c 39 2022-02-02T18:21:23.665 INFO:tasks.workunit.client.0.smithi096.stdout:3/136: readlink d2/df/d1c/l22 0 2022-02-02T18:21:23.665 INFO:tasks.workunit.client.0.smithi096.stdout:6/141: dread d18/f1c [0,4194304] 0 2022-02-02T18:21:23.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/153: creat d3/d27/f39 x:0 0 0 2022-02-02T18:21:23.667 INFO:tasks.workunit.client.0.smithi096.stdout:5/119: symlink db/d20/l2c 0 2022-02-02T18:21:23.669 INFO:tasks.workunit.client.0.smithi096.stdout:7/104: dwrite f0 [0,4194304] 0 2022-02-02T18:21:23.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/104: dwrite fc [4194304,4194304] 0 2022-02-02T18:21:23.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/105: creat f19 x:0 0 0 2022-02-02T18:21:23.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/106: creat f1a x:0 0 0 2022-02-02T18:21:23.672 INFO:tasks.workunit.client.0.smithi096.stdout:9/155: getdents d1/db/d14 0 2022-02-02T18:21:23.673 INFO:tasks.workunit.client.0.smithi096.stdout:3/137: mkdir d2/df/d20/d33 0 2022-02-02T18:21:23.673 INFO:tasks.workunit.client.0.smithi096.stdout:2/192: dread d2/d6/db/fc [0,4194304] 0 2022-02-02T18:21:23.675 INFO:tasks.workunit.client.0.smithi096.stdout:5/120: symlink db/de/d10/l2d 0 2022-02-02T18:21:23.676 INFO:tasks.workunit.client.0.smithi096.stdout:7/105: chown c4 11042147 1 2022-02-02T18:21:23.677 INFO:tasks.workunit.client.0.smithi096.stdout:1/132: rmdir d15/d1b 39 2022-02-02T18:21:23.678 INFO:tasks.workunit.client.0.smithi096.stdout:9/156: write d1/d9/d25/ff [3219738,27082] 0 2022-02-02T18:21:23.679 INFO:tasks.workunit.client.0.smithi096.stdout:9/157: chown d1/d9/d25/f23 4526627 1 2022-02-02T18:21:23.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/138: dread d2/f15 [0,4194304] 0 2022-02-02T18:21:23.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/139: dread - d2/df/d14/d16/f23 zero size 2022-02-02T18:21:23.682 INFO:tasks.workunit.client.0.smithi096.stdout:0/192: dwrite d2/db/d10/f33 [0,4194304] 0 2022-02-02T18:21:23.682 INFO:tasks.workunit.client.0.smithi096.stdout:0/193: write d2/d1e/f36 [164846,31566] 0 2022-02-02T18:21:23.682 INFO:tasks.workunit.client.0.smithi096.stdout:7/106: write d9/fd [3011776,57167] 0 2022-02-02T18:21:23.683 INFO:tasks.workunit.client.0.smithi096.stdout:1/133: write d15/f1a [2739819,19609] 0 2022-02-02T18:21:23.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/134: readlink d15/d1b/d26/l2d 0 2022-02-02T18:21:23.685 INFO:tasks.workunit.client.0.smithi096.stdout:7/107: write d9/fc [4094258,65610] 0 2022-02-02T18:21:23.687 INFO:tasks.workunit.client.0.smithi096.stdout:8/107: dwrite fc [8388608,4194304] 0 2022-02-02T18:21:23.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/121: mkdir db/de/d2e 0 2022-02-02T18:21:23.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/122: truncate f3 3230100 0 2022-02-02T18:21:23.697 INFO:tasks.workunit.client.0.smithi096.stdout:5/123: dread f6 [0,4194304] 0 2022-02-02T18:21:23.698 INFO:tasks.workunit.client.0.smithi096.stdout:5/124: chown db/de/f16 6660010 1 2022-02-02T18:21:23.698 INFO:tasks.workunit.client.0.smithi096.stdout:2/193: write d2/fe [2971246,122578] 0 2022-02-02T18:21:23.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/108: dread d9/fd [0,4194304] 0 2022-02-02T18:21:23.699 INFO:tasks.workunit.client.0.smithi096.stdout:9/158: mknod d1/db/d14/c35 0 2022-02-02T18:21:23.699 INFO:tasks.workunit.client.0.smithi096.stdout:9/159: dread - d1/db/d1c/d2f/f32 zero size 2022-02-02T18:21:23.700 INFO:tasks.workunit.client.0.smithi096.stdout:9/160: creat d1/f36 x:0 0 0 2022-02-02T18:21:23.700 INFO:tasks.workunit.client.0.smithi096.stdout:3/140: mkdir d2/df/d34 0 2022-02-02T18:21:23.701 INFO:tasks.workunit.client.0.smithi096.stdout:2/194: dread f1 [0,4194304] 0 2022-02-02T18:21:23.703 INFO:tasks.workunit.client.0.smithi096.stdout:0/194: mknod d2/db/d24/c41 0 2022-02-02T18:21:23.705 INFO:tasks.workunit.client.0.smithi096.stdout:7/109: dread f7 [0,4194304] 0 2022-02-02T18:21:23.707 INFO:tasks.workunit.client.0.smithi096.stdout:1/135: rename fc to d15/d1b/d28/d2c/f34 0 2022-02-02T18:21:23.708 INFO:tasks.workunit.client.0.smithi096.stdout:2/195: dread d2/d6/db/d10/f22 [0,4194304] 0 2022-02-02T18:21:23.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/136: write d15/f2a [3221165,52847] 0 2022-02-02T18:21:23.710 INFO:tasks.workunit.client.0.smithi096.stdout:8/108: mknod c1b 0 2022-02-02T18:21:23.710 INFO:tasks.workunit.client.0.smithi096.stdout:8/109: creat f1c x:0 0 0 2022-02-02T18:21:23.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/110: truncate f17 269178 0 2022-02-02T18:21:23.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/111: read - f1c zero size 2022-02-02T18:21:23.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/125: mkdir db/d1d/d2f 0 2022-02-02T18:21:23.712 INFO:tasks.workunit.client.0.smithi096.stdout:7/110: dread f7 [0,4194304] 0 2022-02-02T18:21:23.712 INFO:tasks.workunit.client.0.smithi096.stdout:3/141: mknod d2/df/d20/c35 0 2022-02-02T18:21:23.714 INFO:tasks.workunit.client.0.smithi096.stdout:0/195: creat d2/db/d37/d40/f42 x:0 0 0 2022-02-02T18:21:23.714 INFO:tasks.workunit.client.0.smithi096.stdout:0/196: stat d2/db/d10/l2f 0 2022-02-02T18:21:23.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/161: rename d1/d9/d11/d1e/l27 to d1/db/d14/l37 0 2022-02-02T18:21:23.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/162: stat d1/d9/d25 0 2022-02-02T18:21:23.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/137: symlink d15/d1b/d26/l35 0 2022-02-02T18:21:23.721 INFO:tasks.workunit.client.0.smithi096.stdout:8/112: unlink lf 0 2022-02-02T18:21:23.721 INFO:tasks.workunit.client.0.smithi096.stdout:8/113: write f1c [166263,70545] 0 2022-02-02T18:21:23.721 INFO:tasks.workunit.client.0.smithi096.stdout:8/114: readlink l9 0 2022-02-02T18:21:23.723 INFO:tasks.workunit.client.0.smithi096.stdout:5/126: symlink db/de/d10/d25/l30 0 2022-02-02T18:21:23.723 INFO:tasks.workunit.client.0.smithi096.stdout:7/111: getdents d9/df/d12/d14/d18 0 2022-02-02T18:21:23.725 INFO:tasks.workunit.client.0.smithi096.stdout:3/142: mkdir d2/df/d36 0 2022-02-02T18:21:23.726 INFO:tasks.workunit.client.0.smithi096.stdout:0/197: getdents d2/db 0 2022-02-02T18:21:23.726 INFO:tasks.workunit.client.0.smithi096.stdout:0/198: write d2/d1e/f2e [956552,112815] 0 2022-02-02T18:21:23.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/196: mkdir d2/d3b 0 2022-02-02T18:21:23.729 INFO:tasks.workunit.client.0.smithi096.stdout:2/197: read d2/d6/fa [1248838,68209] 0 2022-02-02T18:21:23.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/115: mknod c1d 0 2022-02-02T18:21:23.732 INFO:tasks.workunit.client.0.smithi096.stdout:5/127: symlink db/de/d2e/l31 0 2022-02-02T18:21:23.732 INFO:tasks.workunit.client.0.smithi096.stdout:5/128: write f6 [1946662,17732] 0 2022-02-02T18:21:23.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/129: chown c2 55374357 1 2022-02-02T18:21:23.733 INFO:tasks.workunit.client.0.smithi096.stdout:3/143: unlink d2/df/d1a/c32 0 2022-02-02T18:21:23.733 INFO:tasks.workunit.client.0.smithi096.stdout:8/116: read fc [750644,110144] 0 2022-02-02T18:21:23.734 INFO:tasks.workunit.client.0.smithi096.stdout:0/199: symlink d2/db/d37/l43 0 2022-02-02T18:21:23.736 INFO:tasks.workunit.client.0.smithi096.stdout:2/198: symlink d2/d6/d1b/l3c 0 2022-02-02T18:21:23.736 INFO:tasks.workunit.client.0.smithi096.stdout:2/199: fdatasync d2/d6/d1b/f39 0 2022-02-02T18:21:23.737 INFO:tasks.workunit.client.0.smithi096.stdout:5/130: rmdir db/d1d 39 2022-02-02T18:21:23.737 INFO:tasks.workunit.client.0.smithi096.stdout:3/144: creat d2/df/d20/f37 x:0 0 0 2022-02-02T18:21:23.738 INFO:tasks.workunit.client.0.smithi096.stdout:8/117: mknod c1e 0 2022-02-02T18:21:23.738 INFO:tasks.workunit.client.0.smithi096.stdout:1/138: dwrite d15/d1b/d28/d2c/f34 [0,4194304] 0 2022-02-02T18:21:23.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/131: mkdir db/d1d/d32 0 2022-02-02T18:21:23.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/132: write db/de/d10/f18 [841288,113484] 0 2022-02-02T18:21:23.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/133: dread - db/de/f16 zero size 2022-02-02T18:21:23.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/134: read db/de/d10/f19 [2360755,44195] 0 2022-02-02T18:21:23.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/135: chown db 46 1 2022-02-02T18:21:23.742 INFO:tasks.workunit.client.0.smithi096.stdout:3/145: symlink d2/df/d14/d16/l38 0 2022-02-02T18:21:23.743 INFO:tasks.workunit.client.0.smithi096.stdout:3/146: write d2/df/f26 [4824721,14382] 0 2022-02-02T18:21:23.743 INFO:tasks.workunit.client.0.smithi096.stdout:3/147: fdatasync d2/df/d1a/f25 0 2022-02-02T18:21:23.744 INFO:tasks.workunit.client.0.smithi096.stdout:0/200: dread d2/db/d10/f18 [4194304,4194304] 0 2022-02-02T18:21:23.746 INFO:tasks.workunit.client.0.smithi096.stdout:9/163: rename d1/db/d14 to d1/d9/d11/d1e/d38 0 2022-02-02T18:21:23.755 INFO:tasks.workunit.client.0.smithi096.stdout:1/139: link d15/f22 d15/d1b/d28/d2c/f36 0 2022-02-02T18:21:23.757 INFO:tasks.workunit.client.0.smithi096.stdout:1/140: dread d15/f27 [0,4194304] 0 2022-02-02T18:21:23.758 INFO:tasks.workunit.client.0.smithi096.stdout:1/141: write d15/d1b/f29 [1100616,105314] 0 2022-02-02T18:21:23.760 INFO:tasks.workunit.client.0.smithi096.stdout:2/200: rmdir d2 39 2022-02-02T18:21:23.762 INFO:tasks.workunit.client.0.smithi096.stdout:4/154: sync 2022-02-02T18:21:23.762 INFO:tasks.workunit.client.0.smithi096.stdout:6/142: sync 2022-02-02T18:21:23.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/143: creat d18/f3a x:0 0 0 2022-02-02T18:21:23.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/144: dread - d18/d29/f39 zero size 2022-02-02T18:21:23.763 INFO:tasks.workunit.client.0.smithi096.stdout:8/118: getdents . 0 2022-02-02T18:21:23.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/201: symlink d2/db/d37/l44 0 2022-02-02T18:21:23.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/202: read d2/db/d10/f28 [181128,11719] 0 2022-02-02T18:21:23.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/203: chown d2/db/d10/c1a 701 1 2022-02-02T18:21:23.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/204: chown d2/db/d10/c1a 12996267 1 2022-02-02T18:21:23.765 INFO:tasks.workunit.client.0.smithi096.stdout:9/164: mkdir d1/d39 0 2022-02-02T18:21:23.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/142: truncate d15/f1a 8207803 0 2022-02-02T18:21:23.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/201: chown d2/d19/c25 1 1 2022-02-02T18:21:23.767 INFO:tasks.workunit.client.0.smithi096.stdout:8/119: dread f1 [0,4194304] 0 2022-02-02T18:21:23.768 INFO:tasks.workunit.client.0.smithi096.stdout:8/120: getdents . 0 2022-02-02T18:21:23.769 INFO:tasks.workunit.client.0.smithi096.stdout:3/148: rmdir d2 39 2022-02-02T18:21:23.770 INFO:tasks.workunit.client.0.smithi096.stdout:4/155: rmdir d3/d4/d20 39 2022-02-02T18:21:23.771 INFO:tasks.workunit.client.0.smithi096.stdout:0/205: link d2/db/d37/l43 d2/db/d37/l45 0 2022-02-02T18:21:23.773 INFO:tasks.workunit.client.0.smithi096.stdout:7/112: rename l8 to d9/df/d12/d14/l1f 0 2022-02-02T18:21:23.775 INFO:tasks.workunit.client.0.smithi096.stdout:1/143: mkdir d15/d37 0 2022-02-02T18:21:23.775 INFO:tasks.workunit.client.0.smithi096.stdout:1/144: stat l10 0 2022-02-02T18:21:23.776 INFO:tasks.workunit.client.0.smithi096.stdout:8/121: rename f15 to f1f 0 2022-02-02T18:21:23.777 INFO:tasks.workunit.client.0.smithi096.stdout:8/122: read f5 [908952,6002] 0 2022-02-02T18:21:23.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/149: creat d2/df/d34/f39 x:0 0 0 2022-02-02T18:21:23.779 INFO:tasks.workunit.client.0.smithi096.stdout:0/206: truncate d2/ff 579019 0 2022-02-02T18:21:23.781 INFO:tasks.workunit.client.0.smithi096.stdout:8/123: dread f1f [0,4194304] 0 2022-02-02T18:21:23.782 INFO:tasks.workunit.client.0.smithi096.stdout:5/136: rename db/d1d/d22/c23 to db/d20/c33 0 2022-02-02T18:21:23.782 INFO:tasks.workunit.client.0.smithi096.stdout:5/137: creat db/d1d/d22/f34 x:0 0 0 2022-02-02T18:21:23.783 INFO:tasks.workunit.client.0.smithi096.stdout:7/113: symlink d9/df/d12/d14/l20 0 2022-02-02T18:21:23.784 INFO:tasks.workunit.client.0.smithi096.stdout:5/138: dread db/d1d/d22/f24 [0,4194304] 0 2022-02-02T18:21:23.784 INFO:tasks.workunit.client.0.smithi096.stdout:5/139: fsync db/d20/f29 0 2022-02-02T18:21:23.785 INFO:tasks.workunit.client.0.smithi096.stdout:8/124: mknod c20 0 2022-02-02T18:21:23.786 INFO:tasks.workunit.client.0.smithi096.stdout:6/145: fsync d18/f3a 0 2022-02-02T18:21:23.786 INFO:tasks.workunit.client.0.smithi096.stdout:6/146: write d18/f26 [4400761,71623] 0 2022-02-02T18:21:23.786 INFO:tasks.workunit.client.0.smithi096.stdout:6/147: write d18/d24/f36 [939006,43470] 0 2022-02-02T18:21:23.786 INFO:tasks.workunit.client.0.smithi096.stdout:9/165: dwrite d1/d9/d11/d1e/f24 [4194304,4194304] 0 2022-02-02T18:21:23.790 INFO:tasks.workunit.client.0.smithi096.stdout:4/156: rename d3/fd to d3/d27/f3a 0 2022-02-02T18:21:23.792 INFO:tasks.workunit.client.0.smithi096.stdout:7/114: mknod d9/df/d12/d14/c21 0 2022-02-02T18:21:23.795 INFO:tasks.workunit.client.0.smithi096.stdout:9/166: mknod d1/db/d1c/c3a 0 2022-02-02T18:21:23.802 INFO:tasks.workunit.client.0.smithi096.stdout:9/167: rmdir d1/db/d1c/d2f 39 2022-02-02T18:21:23.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/145: dwrite d15/f27 [0,4194304] 0 2022-02-02T18:21:23.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/146: chown d15/d1b/f2f 600419749 1 2022-02-02T18:21:23.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/147: chown d15/l24 15448 1 2022-02-02T18:21:23.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/168: creat d1/db/d1c/d2f/f3b x:0 0 0 2022-02-02T18:21:23.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/148: write f11 [1021394,113888] 0 2022-02-02T18:21:23.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/169: mkdir d1/d9/d11/d3c 0 2022-02-02T18:21:23.808 INFO:tasks.workunit.client.0.smithi096.stdout:1/149: link d15/d1b/f29 d15/d1b/d28/d2c/f38 0 2022-02-02T18:21:23.808 INFO:tasks.workunit.client.0.smithi096.stdout:1/150: fsync d15/d1b/d28/d2c/f34 0 2022-02-02T18:21:23.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/151: rmdir d15/d37 0 2022-02-02T18:21:23.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/152: mkdir d15/d1b/d28/d2c/d39 0 2022-02-02T18:21:23.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/153: read - d15/d1b/d26/f31 zero size 2022-02-02T18:21:23.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/154: truncate d15/d1b/d28/d2c/f38 1907871 0 2022-02-02T18:21:23.812 INFO:tasks.workunit.client.0.smithi096.stdout:1/155: mknod d15/d1b/d28/c3a 0 2022-02-02T18:21:23.812 INFO:tasks.workunit.client.0.smithi096.stdout:1/156: dread - d15/f22 zero size 2022-02-02T18:21:23.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/157: write f11 [976491,43750] 0 2022-02-02T18:21:23.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/158: write d15/d1b/d26/f31 [943483,119879] 0 2022-02-02T18:21:23.820 INFO:tasks.workunit.client.0.smithi096.stdout:3/150: dwrite d2/df/d14/d11/f1f [4194304,4194304] 0 2022-02-02T18:21:23.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/125: dwrite f1c [0,4194304] 0 2022-02-02T18:21:23.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/126: chown c16 8 1 2022-02-02T18:21:23.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/207: dwrite d2/db/d37/d40/f42 [0,4194304] 0 2022-02-02T18:21:23.821 INFO:tasks.workunit.client.0.smithi096.stdout:3/151: mkdir d2/df/d20/d3a 0 2022-02-02T18:21:23.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/127: creat f21 x:0 0 0 2022-02-02T18:21:23.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/128: creat f22 x:0 0 0 2022-02-02T18:21:23.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/129: creat f23 x:0 0 0 2022-02-02T18:21:23.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/130: creat f24 x:0 0 0 2022-02-02T18:21:23.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/131: truncate f19 532542 0 2022-02-02T18:21:23.831 INFO:tasks.workunit.client.0.smithi096.stdout:9/170: truncate d1/d9/d25/dd/d12/f1f 8260041 0 2022-02-02T18:21:23.831 INFO:tasks.workunit.client.0.smithi096.stdout:9/171: dread - d1/db/d1c/d2f/f32 zero size 2022-02-02T18:21:23.832 INFO:tasks.workunit.client.0.smithi096.stdout:9/172: truncate d1/db/d1c/d2f/f32 880890 0 2022-02-02T18:21:23.832 INFO:tasks.workunit.client.0.smithi096.stdout:0/208: dread d2/f15 [0,4194304] 0 2022-02-02T18:21:23.840 INFO:tasks.workunit.client.0.smithi096.stdout:5/140: rename db/d1d/d22 to db/de/d2e/d35 0 2022-02-02T18:21:23.846 INFO:tasks.workunit.client.0.smithi096.stdout:8/132: mknod c25 0 2022-02-02T18:21:23.847 INFO:tasks.workunit.client.0.smithi096.stdout:2/202: sync 2022-02-02T18:21:23.848 INFO:tasks.workunit.client.0.smithi096.stdout:9/173: link d1/db/d1c/d2f/f32 d1/d9/d25/dd/d12/d26/d2b/f3d 0 2022-02-02T18:21:23.849 INFO:tasks.workunit.client.0.smithi096.stdout:0/209: mknod d2/db/c46 0 2022-02-02T18:21:23.849 INFO:tasks.workunit.client.0.smithi096.stdout:0/210: readlink d2/db/d37/l44 0 2022-02-02T18:21:23.850 INFO:tasks.workunit.client.0.smithi096.stdout:6/148: rename f2 to d18/d29/f3b 0 2022-02-02T18:21:23.851 INFO:tasks.workunit.client.0.smithi096.stdout:8/133: link c20 c26 0 2022-02-02T18:21:23.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/203: rmdir d2/d3b 0 2022-02-02T18:21:23.853 INFO:tasks.workunit.client.0.smithi096.stdout:5/141: dwrite db/de/d10/f15 [4194304,4194304] 0 2022-02-02T18:21:23.853 INFO:tasks.workunit.client.0.smithi096.stdout:5/142: creat db/de/d10/d27/f36 x:0 0 0 2022-02-02T18:21:23.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/211: mknod d2/db/d10/d27/c47 0 2022-02-02T18:21:23.855 INFO:tasks.workunit.client.0.smithi096.stdout:6/149: rename l10 to d18/d29/l3c 0 2022-02-02T18:21:23.855 INFO:tasks.workunit.client.0.smithi096.stdout:8/134: link l8 l27 0 2022-02-02T18:21:23.857 INFO:tasks.workunit.client.0.smithi096.stdout:5/143: getdents db/d1d 0 2022-02-02T18:21:23.858 INFO:tasks.workunit.client.0.smithi096.stdout:5/144: read - db/de/d10/d27/f36 zero size 2022-02-02T18:21:23.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/174: truncate d1/f8 4285572 0 2022-02-02T18:21:23.859 INFO:tasks.workunit.client.0.smithi096.stdout:0/212: link d2/c9 d2/d1e/c48 0 2022-02-02T18:21:23.859 INFO:tasks.workunit.client.0.smithi096.stdout:0/213: fsync d2/db/d10/f28 0 2022-02-02T18:21:23.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/150: mknod d18/d24/d28/c3d 0 2022-02-02T18:21:23.861 INFO:tasks.workunit.client.0.smithi096.stdout:5/145: dread db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:23.862 INFO:tasks.workunit.client.0.smithi096.stdout:5/146: write db/de/d10/f18 [174712,49146] 0 2022-02-02T18:21:23.864 INFO:tasks.workunit.client.0.smithi096.stdout:4/157: rename d3/d4/d14/c1e to d3/d27/c3b 0 2022-02-02T18:21:23.864 INFO:tasks.workunit.client.0.smithi096.stdout:8/135: symlink l28 0 2022-02-02T18:21:23.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/151: mkdir d18/d24/d28/d3e 0 2022-02-02T18:21:23.872 INFO:tasks.workunit.client.0.smithi096.stdout:5/147: creat db/de/d2e/d35/f37 x:0 0 0 2022-02-02T18:21:23.873 INFO:tasks.workunit.client.0.smithi096.stdout:9/175: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:23.874 INFO:tasks.workunit.client.0.smithi096.stdout:5/148: dread db/f1b [0,4194304] 0 2022-02-02T18:21:23.874 INFO:tasks.workunit.client.0.smithi096.stdout:7/115: rename c4 to d9/df/d12/d14/d18/c22 0 2022-02-02T18:21:23.874 INFO:tasks.workunit.client.0.smithi096.stdout:7/116: fsync f7 0 2022-02-02T18:21:23.875 INFO:tasks.workunit.client.0.smithi096.stdout:7/117: write d9/fd [234783,30901] 0 2022-02-02T18:21:23.875 INFO:tasks.workunit.client.0.smithi096.stdout:4/158: mknod d3/c3c 0 2022-02-02T18:21:23.876 INFO:tasks.workunit.client.0.smithi096.stdout:8/136: mkdir d29 0 2022-02-02T18:21:23.877 INFO:tasks.workunit.client.0.smithi096.stdout:9/176: link d1/d9/d25/dd/d12/c21 d1/c3e 0 2022-02-02T18:21:23.878 INFO:tasks.workunit.client.0.smithi096.stdout:0/214: dwrite d2/d1e/f2e [0,4194304] 0 2022-02-02T18:21:23.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/152: rename d2/df/d1a/f25 to d2/df/d20/d33/f3b 0 2022-02-02T18:21:23.883 INFO:tasks.workunit.client.0.smithi096.stdout:4/159: mknod d3/d4/d20/d26/d36/c3d 0 2022-02-02T18:21:23.884 INFO:tasks.workunit.client.0.smithi096.stdout:9/177: unlink d1/d9/d11/d1e/f24 0 2022-02-02T18:21:23.885 INFO:tasks.workunit.client.0.smithi096.stdout:1/159: sync 2022-02-02T18:21:23.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/160: stat d15/d1b/d26/l33 0 2022-02-02T18:21:23.892 INFO:tasks.workunit.client.0.smithi096.stdout:0/215: mknod d2/db/d10/d27/c49 0 2022-02-02T18:21:23.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/137: dread fc [8388608,4194304] 0 2022-02-02T18:21:23.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/138: stat c13 0 2022-02-02T18:21:23.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/139: readlink l11 0 2022-02-02T18:21:23.893 INFO:tasks.workunit.client.0.smithi096.stdout:0/216: dread d2/db/f19 [0,4194304] 0 2022-02-02T18:21:23.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/217: creat d2/db/d10/f4a x:0 0 0 2022-02-02T18:21:23.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/218: chown d2/db/d10/d27 33 1 2022-02-02T18:21:23.894 INFO:tasks.workunit.client.0.smithi096.stdout:2/204: rename d2/d6/l17 to d2/d6/d1b/d3a/l3d 0 2022-02-02T18:21:23.895 INFO:tasks.workunit.client.0.smithi096.stdout:9/178: creat d1/d9/d25/dd/d12/d26/f3f x:0 0 0 2022-02-02T18:21:23.896 INFO:tasks.workunit.client.0.smithi096.stdout:1/161: truncate f11 2635572 0 2022-02-02T18:21:23.897 INFO:tasks.workunit.client.0.smithi096.stdout:7/118: dwrite d9/df/d12/d14/d18/d19/f1e [0,4194304] 0 2022-02-02T18:21:23.898 INFO:tasks.workunit.client.0.smithi096.stdout:8/140: creat d29/f2a x:0 0 0 2022-02-02T18:21:23.898 INFO:tasks.workunit.client.0.smithi096.stdout:8/141: creat d29/f2b x:0 0 0 2022-02-02T18:21:23.898 INFO:tasks.workunit.client.0.smithi096.stdout:8/142: dread - f24 zero size 2022-02-02T18:21:23.904 INFO:tasks.workunit.client.0.smithi096.stdout:5/149: rename db/c26 to db/d1d/d32/c38 0 2022-02-02T18:21:23.905 INFO:tasks.workunit.client.0.smithi096.stdout:5/150: chown db/de/f13 9 1 2022-02-02T18:21:23.905 INFO:tasks.workunit.client.0.smithi096.stdout:5/151: chown db/de/d2e/d35 7249 1 2022-02-02T18:21:23.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/162: dread d15/f2a [0,4194304] 0 2022-02-02T18:21:23.906 INFO:tasks.workunit.client.0.smithi096.stdout:1/163: write d15/d1b/d28/d2c/f38 [298633,76013] 0 2022-02-02T18:21:23.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/205: creat d2/d6/d1b/d3a/f3e x:0 0 0 2022-02-02T18:21:23.907 INFO:tasks.workunit.client.0.smithi096.stdout:5/152: dread db/de/f2a [0,4194304] 0 2022-02-02T18:21:23.907 INFO:tasks.workunit.client.0.smithi096.stdout:5/153: write db/de/d2e/d35/f24 [915960,107632] 0 2022-02-02T18:21:23.908 INFO:tasks.workunit.client.0.smithi096.stdout:9/179: symlink d1/d9/d11/d1e/d38/l40 0 2022-02-02T18:21:23.908 INFO:tasks.workunit.client.0.smithi096.stdout:4/160: dwrite d3/d4/d14/f29 [0,4194304] 0 2022-02-02T18:21:23.912 INFO:tasks.workunit.client.0.smithi096.stdout:8/143: symlink d29/l2c 0 2022-02-02T18:21:23.912 INFO:tasks.workunit.client.0.smithi096.stdout:8/144: chown d29/f2b 734 1 2022-02-02T18:21:23.913 INFO:tasks.workunit.client.0.smithi096.stdout:1/164: getdents d15/d1b/d26 0 2022-02-02T18:21:23.914 INFO:tasks.workunit.client.0.smithi096.stdout:2/206: symlink d2/d6/d1b/l3f 0 2022-02-02T18:21:23.915 INFO:tasks.workunit.client.0.smithi096.stdout:9/180: stat d1/d9/d25/dd/d12/l1d 0 2022-02-02T18:21:23.915 INFO:tasks.workunit.client.0.smithi096.stdout:9/181: dread - d1/f36 zero size 2022-02-02T18:21:23.915 INFO:tasks.workunit.client.0.smithi096.stdout:9/182: truncate d1/d9/d25/dd/d12/d26/f3f 275049 0 2022-02-02T18:21:23.917 INFO:tasks.workunit.client.0.smithi096.stdout:4/161: mknod d3/d4/d14/c3e 0 2022-02-02T18:21:23.918 INFO:tasks.workunit.client.0.smithi096.stdout:8/145: mkdir d29/d2d 0 2022-02-02T18:21:23.919 INFO:tasks.workunit.client.0.smithi096.stdout:7/119: dwrite d9/fd [0,4194304] 0 2022-02-02T18:21:23.919 INFO:tasks.workunit.client.0.smithi096.stdout:5/154: dread fa [0,4194304] 0 2022-02-02T18:21:23.919 INFO:tasks.workunit.client.0.smithi096.stdout:7/120: chown d9/l11 3798 1 2022-02-02T18:21:23.920 INFO:tasks.workunit.client.0.smithi096.stdout:2/207: creat d2/d13/f40 x:0 0 0 2022-02-02T18:21:23.921 INFO:tasks.workunit.client.0.smithi096.stdout:4/162: mknod d3/d4/d20/d26/c3f 0 2022-02-02T18:21:23.921 INFO:tasks.workunit.client.0.smithi096.stdout:4/163: write d3/d27/f28 [1439538,116519] 0 2022-02-02T18:21:23.922 INFO:tasks.workunit.client.0.smithi096.stdout:4/164: fsync d3/d27/f30 0 2022-02-02T18:21:23.922 INFO:tasks.workunit.client.0.smithi096.stdout:4/165: read - d3/d4/f37 zero size 2022-02-02T18:21:23.922 INFO:tasks.workunit.client.0.smithi096.stdout:4/166: creat d3/d4/f40 x:0 0 0 2022-02-02T18:21:23.922 INFO:tasks.workunit.client.0.smithi096.stdout:4/167: creat d3/d27/f41 x:0 0 0 2022-02-02T18:21:23.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/183: read d1/d9/d25/dd/d12/f1f [92513,32170] 0 2022-02-02T18:21:23.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/146: rename d29/f2a to d29/d2d/f2e 0 2022-02-02T18:21:23.924 INFO:tasks.workunit.client.0.smithi096.stdout:9/184: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:23.925 INFO:tasks.workunit.client.0.smithi096.stdout:7/121: mknod d9/df/c23 0 2022-02-02T18:21:23.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/185: chown d1/db/d1c/d2f/f32 20833617 1 2022-02-02T18:21:23.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/186: getdents d1/d39 0 2022-02-02T18:21:23.926 INFO:tasks.workunit.client.0.smithi096.stdout:1/165: dread d15/d1b/f25 [0,4194304] 0 2022-02-02T18:21:23.926 INFO:tasks.workunit.client.0.smithi096.stdout:5/155: mknod db/de/d2e/d35/c39 0 2022-02-02T18:21:23.926 INFO:tasks.workunit.client.0.smithi096.stdout:7/122: write f0 [516870,15631] 0 2022-02-02T18:21:23.927 INFO:tasks.workunit.client.0.smithi096.stdout:2/208: link d2/f9 d2/d6/f41 0 2022-02-02T18:21:23.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/168: truncate d3/d4/d20/f22 2613394 0 2022-02-02T18:21:23.933 INFO:tasks.workunit.client.0.smithi096.stdout:8/147: rename f24 to d29/d2d/f2f 0 2022-02-02T18:21:23.933 INFO:tasks.workunit.client.0.smithi096.stdout:8/148: truncate f21 718969 0 2022-02-02T18:21:23.933 INFO:tasks.workunit.client.0.smithi096.stdout:4/169: write d3/d27/f30 [3346875,86670] 0 2022-02-02T18:21:23.934 INFO:tasks.workunit.client.0.smithi096.stdout:8/149: write f5 [96174,81751] 0 2022-02-02T18:21:23.934 INFO:tasks.workunit.client.0.smithi096.stdout:8/150: chown l27 176 1 2022-02-02T18:21:23.934 INFO:tasks.workunit.client.0.smithi096.stdout:9/187: creat d1/d9/d11/d3c/f41 x:0 0 0 2022-02-02T18:21:23.935 INFO:tasks.workunit.client.0.smithi096.stdout:1/166: rename d15/f1d to d15/f3b 0 2022-02-02T18:21:23.935 INFO:tasks.workunit.client.0.smithi096.stdout:9/188: dread d1/d9/d11/f30 [0,4194304] 0 2022-02-02T18:21:23.939 INFO:tasks.workunit.client.0.smithi096.stdout:8/151: dread fc [8388608,4194304] 0 2022-02-02T18:21:23.939 INFO:tasks.workunit.client.0.smithi096.stdout:8/152: write d29/d2d/f2f [551466,73064] 0 2022-02-02T18:21:23.942 INFO:tasks.workunit.client.0.smithi096.stdout:5/156: getdents db/de/d10/d25 0 2022-02-02T18:21:23.944 INFO:tasks.workunit.client.0.smithi096.stdout:7/123: link d9/df/d12/d14/d18/c22 d9/df/d12/d14/d18/d19/c24 0 2022-02-02T18:21:23.944 INFO:tasks.workunit.client.0.smithi096.stdout:7/124: read f2 [3549551,71286] 0 2022-02-02T18:21:23.948 INFO:tasks.workunit.client.0.smithi096.stdout:1/167: unlink d15/d1b/d28/d2c/f36 0 2022-02-02T18:21:23.950 INFO:tasks.workunit.client.0.smithi096.stdout:9/189: creat d1/d9/d25/dd/d12/d26/d2b/f42 x:0 0 0 2022-02-02T18:21:23.953 INFO:tasks.workunit.client.0.smithi096.stdout:8/153: creat d29/d2d/f30 x:0 0 0 2022-02-02T18:21:23.953 INFO:tasks.workunit.client.0.smithi096.stdout:8/154: read - f22 zero size 2022-02-02T18:21:23.955 INFO:tasks.workunit.client.0.smithi096.stdout:1/168: dread d15/f1a [0,4194304] 0 2022-02-02T18:21:23.958 INFO:tasks.workunit.client.0.smithi096.stdout:5/157: mknod db/de/d10/d25/c3a 0 2022-02-02T18:21:23.958 INFO:tasks.workunit.client.0.smithi096.stdout:2/209: getdents d2/d13 0 2022-02-02T18:21:23.959 INFO:tasks.workunit.client.0.smithi096.stdout:2/210: fdatasync d2/d6/db/f38 0 2022-02-02T18:21:23.959 INFO:tasks.workunit.client.0.smithi096.stdout:4/170: truncate d3/d4/d14/f19 611138 0 2022-02-02T18:21:23.959 INFO:tasks.workunit.client.0.smithi096.stdout:4/171: read d3/d4/f24 [120366,33809] 0 2022-02-02T18:21:23.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/190: symlink d1/db/d1c/d2f/l43 0 2022-02-02T18:21:23.960 INFO:tasks.workunit.client.0.smithi096.stdout:1/169: mknod d15/d1b/d28/d2c/c3c 0 2022-02-02T18:21:23.961 INFO:tasks.workunit.client.0.smithi096.stdout:9/191: read d1/d9/f18 [1169189,50463] 0 2022-02-02T18:21:23.961 INFO:tasks.workunit.client.0.smithi096.stdout:2/211: unlink d2/d6/f20 0 2022-02-02T18:21:23.962 INFO:tasks.workunit.client.0.smithi096.stdout:7/125: dwrite d9/df/f10 [0,4194304] 0 2022-02-02T18:21:23.962 INFO:tasks.workunit.client.0.smithi096.stdout:5/158: dread db/de/d10/d27/f2b [0,4194304] 0 2022-02-02T18:21:23.963 INFO:tasks.workunit.client.0.smithi096.stdout:5/159: read - db/d20/f29 zero size 2022-02-02T18:21:23.963 INFO:tasks.workunit.client.0.smithi096.stdout:4/172: mknod d3/d4/d14/c42 0 2022-02-02T18:21:23.963 INFO:tasks.workunit.client.0.smithi096.stdout:1/170: getdents d15/d1b/d28 0 2022-02-02T18:21:23.967 INFO:tasks.workunit.client.0.smithi096.stdout:4/173: write d3/d4/f1c [2815562,30192] 0 2022-02-02T18:21:23.968 INFO:tasks.workunit.client.0.smithi096.stdout:4/174: chown d3/d4/f1c 22 1 2022-02-02T18:21:23.968 INFO:tasks.workunit.client.0.smithi096.stdout:4/175: creat d3/d27/f43 x:0 0 0 2022-02-02T18:21:23.968 INFO:tasks.workunit.client.0.smithi096.stdout:5/160: truncate db/de/f13 1536417 0 2022-02-02T18:21:23.970 INFO:tasks.workunit.client.0.smithi096.stdout:1/171: symlink d15/d1b/d26/l3d 0 2022-02-02T18:21:23.971 INFO:tasks.workunit.client.0.smithi096.stdout:5/161: dread db/de/d2e/d35/f24 [0,4194304] 0 2022-02-02T18:21:23.972 INFO:tasks.workunit.client.0.smithi096.stdout:4/176: creat d3/d4/d20/d26/d36/f44 x:0 0 0 2022-02-02T18:21:23.975 INFO:tasks.workunit.client.0.smithi096.stdout:5/162: mknod db/d1d/d2f/c3b 0 2022-02-02T18:21:23.985 INFO:tasks.workunit.client.0.smithi096.stdout:2/212: dwrite d2/d29/f32 [0,4194304] 0 2022-02-02T18:21:23.985 INFO:tasks.workunit.client.0.smithi096.stdout:2/213: stat d2/d6/db 0 2022-02-02T18:21:23.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/192: dwrite d1/d9/d25/dd/d12/d26/f3f [0,4194304] 0 2022-02-02T18:21:23.987 INFO:tasks.workunit.client.0.smithi096.stdout:9/193: stat d1/d9/d11/f30 0 2022-02-02T18:21:23.987 INFO:tasks.workunit.client.0.smithi096.stdout:9/194: dread - d1/f36 zero size 2022-02-02T18:21:23.989 INFO:tasks.workunit.client.0.smithi096.stdout:1/172: dread d15/f27 [0,4194304] 0 2022-02-02T18:21:23.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/173: readlink l7 0 2022-02-02T18:21:23.991 INFO:tasks.workunit.client.0.smithi096.stdout:2/214: mkdir d2/d13/d42 0 2022-02-02T18:21:23.995 INFO:tasks.workunit.client.0.smithi096.stdout:1/174: unlink d15/f16 0 2022-02-02T18:21:23.997 INFO:tasks.workunit.client.0.smithi096.stdout:9/195: getdents d1/d9/d11/d3c 0 2022-02-02T18:21:23.997 INFO:tasks.workunit.client.0.smithi096.stdout:9/196: fdatasync d1/d9/d25/dd/d12/f1f 0 2022-02-02T18:21:23.999 INFO:tasks.workunit.client.0.smithi096.stdout:7/126: dwrite f0 [0,4194304] 0 2022-02-02T18:21:23.999 INFO:tasks.workunit.client.0.smithi096.stdout:7/127: write d9/fd [5235449,1461] 0 2022-02-02T18:21:24.000 INFO:tasks.workunit.client.0.smithi096.stdout:1/175: link f13 d15/d1b/d28/f3e 0 2022-02-02T18:21:24.000 INFO:tasks.workunit.client.0.smithi096.stdout:9/197: mknod d1/d9/d25/dd/c44 0 2022-02-02T18:21:24.001 INFO:tasks.workunit.client.0.smithi096.stdout:4/177: dwrite d3/d4/d14/f2d [0,4194304] 0 2022-02-02T18:21:24.001 INFO:tasks.workunit.client.0.smithi096.stdout:9/198: dread d1/d9/d25/dd/d12/d26/d2b/f3d [0,4194304] 0 2022-02-02T18:21:24.003 INFO:tasks.workunit.client.0.smithi096.stdout:7/128: mkdir d9/df/d16/d25 0 2022-02-02T18:21:24.004 INFO:tasks.workunit.client.0.smithi096.stdout:1/176: mkdir d15/d1b/d28/d3f 0 2022-02-02T18:21:24.004 INFO:tasks.workunit.client.0.smithi096.stdout:2/215: dread d2/d6/db/f27 [0,4194304] 0 2022-02-02T18:21:24.006 INFO:tasks.workunit.client.0.smithi096.stdout:5/163: dwrite db/de/f13 [0,4194304] 0 2022-02-02T18:21:24.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/164: truncate db/de/f16 430602 0 2022-02-02T18:21:24.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/178: rename d3/d4/d14/c2e to d3/d4/d14/c45 0 2022-02-02T18:21:24.008 INFO:tasks.workunit.client.0.smithi096.stdout:9/199: link d1/d9/d25/ca d1/d9/c45 0 2022-02-02T18:21:24.009 INFO:tasks.workunit.client.0.smithi096.stdout:7/129: rmdir d9/df/d12 39 2022-02-02T18:21:24.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/200: write d1/d9/d25/dd/d12/f1f [6450837,31635] 0 2022-02-02T18:21:24.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/201: fdatasync d1/d9/d11/f30 0 2022-02-02T18:21:24.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/202: write d1/d9/d25/f23 [295799,43137] 0 2022-02-02T18:21:24.010 INFO:tasks.workunit.client.0.smithi096.stdout:1/177: mknod d15/d1b/d28/c40 0 2022-02-02T18:21:24.011 INFO:tasks.workunit.client.0.smithi096.stdout:1/178: fsync d15/d1b/d28/d2c/f34 0 2022-02-02T18:21:24.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/216: getdents d2/d13 0 2022-02-02T18:21:24.014 INFO:tasks.workunit.client.0.smithi096.stdout:5/165: mknod db/de/d10/d27/c3c 0 2022-02-02T18:21:24.016 INFO:tasks.workunit.client.0.smithi096.stdout:4/179: rename d3/d27/f25 to d3/d4/d14/f46 0 2022-02-02T18:21:24.017 INFO:tasks.workunit.client.0.smithi096.stdout:4/180: write d3/d27/f43 [284070,19303] 0 2022-02-02T18:21:24.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/130: link f0 d9/f26 0 2022-02-02T18:21:24.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/131: creat d9/df/d12/d14/d18/d19/f27 x:0 0 0 2022-02-02T18:21:24.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/203: link d1/d9/d25/dd/c16 d1/d9/d11/c46 0 2022-02-02T18:21:24.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/204: fdatasync d1/f6 0 2022-02-02T18:21:24.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/205: write d1/d9/d25/dd/d12/d26/d2b/f42 [449170,17306] 0 2022-02-02T18:21:24.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/206: dread - d1/d9/d11/d3c/f41 zero size 2022-02-02T18:21:24.022 INFO:tasks.workunit.client.0.smithi096.stdout:1/179: mknod d15/d1b/d28/d2c/c41 0 2022-02-02T18:21:24.023 INFO:tasks.workunit.client.0.smithi096.stdout:2/217: mkdir d2/d13/d43 0 2022-02-02T18:21:24.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/181: mknod d3/c47 0 2022-02-02T18:21:24.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/182: write d3/d4/d14/f46 [5292152,71384] 0 2022-02-02T18:21:24.025 INFO:tasks.workunit.client.0.smithi096.stdout:1/180: creat d15/d1b/d26/f42 x:0 0 0 2022-02-02T18:21:24.025 INFO:tasks.workunit.client.0.smithi096.stdout:2/218: chown d2/c12 573300 1 2022-02-02T18:21:24.027 INFO:tasks.workunit.client.0.smithi096.stdout:9/207: getdents d1/db/d1c/d2f 0 2022-02-02T18:21:24.029 INFO:tasks.workunit.client.0.smithi096.stdout:6/152: sync 2022-02-02T18:21:24.029 INFO:tasks.workunit.client.0.smithi096.stdout:6/153: chown d18/d24/d28/f35 23 1 2022-02-02T18:21:24.030 INFO:tasks.workunit.client.0.smithi096.stdout:9/208: mkdir d1/d9/d11/d1e/d47 0 2022-02-02T18:21:24.030 INFO:tasks.workunit.client.0.smithi096.stdout:9/209: chown d1/d9/d11/d1e/f31 366 1 2022-02-02T18:21:24.030 INFO:tasks.workunit.client.0.smithi096.stdout:5/166: dwrite db/de/d10/f15 [4194304,4194304] 0 2022-02-02T18:21:24.035 INFO:tasks.workunit.client.0.smithi096.stdout:7/132: getdents d9 0 2022-02-02T18:21:24.037 INFO:tasks.workunit.client.0.smithi096.stdout:4/183: dread d3/d27/f30 [0,4194304] 0 2022-02-02T18:21:24.043 INFO:tasks.workunit.client.0.smithi096.stdout:4/184: mkdir d3/d48 0 2022-02-02T18:21:24.046 INFO:tasks.workunit.client.0.smithi096.stdout:4/185: link d3/d4/l11 d3/l49 0 2022-02-02T18:21:24.046 INFO:tasks.workunit.client.0.smithi096.stdout:4/186: write d3/d4/f1c [4557125,20315] 0 2022-02-02T18:21:24.048 INFO:tasks.workunit.client.0.smithi096.stdout:4/187: rename d3/d48 to d3/d27/d4a 0 2022-02-02T18:21:24.049 INFO:tasks.workunit.client.0.smithi096.stdout:4/188: creat d3/d4/d14/f4b x:0 0 0 2022-02-02T18:21:24.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/189: symlink d3/d27/l4c 0 2022-02-02T18:21:24.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/190: truncate d3/d4/d20/d26/f34 2064384 0 2022-02-02T18:21:24.052 INFO:tasks.workunit.client.0.smithi096.stdout:7/133: write f0 [3337846,82776] 0 2022-02-02T18:21:24.052 INFO:tasks.workunit.client.0.smithi096.stdout:1/181: dwrite f13 [0,4194304] 0 2022-02-02T18:21:24.053 INFO:tasks.workunit.client.0.smithi096.stdout:4/191: mkdir d3/d4/d20/d4d 0 2022-02-02T18:21:24.053 INFO:tasks.workunit.client.0.smithi096.stdout:4/192: read d3/d27/f13 [620190,55274] 0 2022-02-02T18:21:24.054 INFO:tasks.workunit.client.0.smithi096.stdout:1/182: rename d15/c17 to d15/d1b/d28/d2c/c43 0 2022-02-02T18:21:24.055 INFO:tasks.workunit.client.0.smithi096.stdout:4/193: link d3/d4/d14/f1f d3/d4/d20/d4d/f4e 0 2022-02-02T18:21:24.060 INFO:tasks.workunit.client.0.smithi096.stdout:6/154: dwrite d18/d29/f3b [4194304,4194304] 0 2022-02-02T18:21:24.060 INFO:tasks.workunit.client.0.smithi096.stdout:6/155: dread - d18/d29/f34 zero size 2022-02-02T18:21:24.061 INFO:tasks.workunit.client.0.smithi096.stdout:6/156: symlink d18/l3f 0 2022-02-02T18:21:24.063 INFO:tasks.workunit.client.0.smithi096.stdout:6/157: symlink d18/l40 0 2022-02-02T18:21:24.064 INFO:tasks.workunit.client.0.smithi096.stdout:4/194: truncate d3/d4/d14/f46 4876203 0 2022-02-02T18:21:24.064 INFO:tasks.workunit.client.0.smithi096.stdout:4/195: write d3/d27/f13 [998901,29343] 0 2022-02-02T18:21:24.065 INFO:tasks.workunit.client.0.smithi096.stdout:6/158: link d18/d29/f34 d18/d24/d28/d3e/f41 0 2022-02-02T18:21:24.066 INFO:tasks.workunit.client.0.smithi096.stdout:6/159: write d18/f27 [258368,114226] 0 2022-02-02T18:21:24.067 INFO:tasks.workunit.client.0.smithi096.stdout:7/134: dread d9/df/d12/d14/d18/d19/f1e [0,4194304] 0 2022-02-02T18:21:24.072 INFO:tasks.workunit.client.0.smithi096.stdout:6/160: creat d18/d24/d28/d3e/f42 x:0 0 0 2022-02-02T18:21:24.072 INFO:tasks.workunit.client.0.smithi096.stdout:6/161: dread - d18/d29/f34 zero size 2022-02-02T18:21:24.072 INFO:tasks.workunit.client.0.smithi096.stdout:6/162: creat d18/d29/f43 x:0 0 0 2022-02-02T18:21:24.073 INFO:tasks.workunit.client.0.smithi096.stdout:6/163: creat d18/d24/d28/d3e/f44 x:0 0 0 2022-02-02T18:21:24.075 INFO:tasks.workunit.client.0.smithi096.stdout:5/167: dwrite db/de/f13 [0,4194304] 0 2022-02-02T18:21:24.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/135: dread f2 [0,4194304] 0 2022-02-02T18:21:24.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/136: chown d9/df/c23 260036813 1 2022-02-02T18:21:24.076 INFO:tasks.workunit.client.0.smithi096.stdout:6/164: mknod d18/d24/d28/d3e/c45 0 2022-02-02T18:21:24.077 INFO:tasks.workunit.client.0.smithi096.stdout:1/183: dwrite d15/f2e [0,4194304] 0 2022-02-02T18:21:24.077 INFO:tasks.workunit.client.0.smithi096.stdout:1/184: write d15/d1b/d28/d2c/f38 [1641679,113890] 0 2022-02-02T18:21:24.078 INFO:tasks.workunit.client.0.smithi096.stdout:4/196: read d3/f32 [852259,98767] 0 2022-02-02T18:21:24.078 INFO:tasks.workunit.client.0.smithi096.stdout:7/137: getdents d9/df/d12 0 2022-02-02T18:21:24.080 INFO:tasks.workunit.client.0.smithi096.stdout:5/168: dread f6 [0,4194304] 0 2022-02-02T18:21:24.080 INFO:tasks.workunit.client.0.smithi096.stdout:5/169: write db/f1b [842782,28635] 0 2022-02-02T18:21:24.080 INFO:tasks.workunit.client.0.smithi096.stdout:5/170: write fa [3280127,46061] 0 2022-02-02T18:21:24.080 INFO:tasks.workunit.client.0.smithi096.stdout:5/171: readlink db/de/d10/l17 0 2022-02-02T18:21:24.081 INFO:tasks.workunit.client.0.smithi096.stdout:6/165: symlink d18/d24/d28/l46 0 2022-02-02T18:21:24.083 INFO:tasks.workunit.client.0.smithi096.stdout:6/166: dread d18/f27 [0,4194304] 0 2022-02-02T18:21:24.144 INFO:tasks.workunit.client.0.smithi096.stdout:1/185: creat d15/d1b/d28/f44 x:0 0 0 2022-02-02T18:21:24.144 INFO:tasks.workunit.client.0.smithi096.stdout:3/153: sync 2022-02-02T18:21:24.146 INFO:tasks.workunit.client.0.smithi096.stdout:4/197: creat d3/f4f x:0 0 0 2022-02-02T18:21:24.149 INFO:tasks.workunit.client.0.smithi096.stdout:7/138: rename d9/fc to d9/df/d16/f28 0 2022-02-02T18:21:24.150 INFO:tasks.workunit.client.0.smithi096.stdout:5/172: getdents db/de/d10/d25 0 2022-02-02T18:21:24.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/167: mknod d18/d24/d28/d3e/c47 0 2022-02-02T18:21:24.174 INFO:tasks.workunit.client.0.smithi096.stdout:4/198: dwrite d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:24.176 INFO:tasks.workunit.client.0.smithi096.stdout:5/173: dwrite f3 [0,4194304] 0 2022-02-02T18:21:24.177 INFO:tasks.workunit.client.0.smithi096.stdout:8/155: sync 2022-02-02T18:21:24.177 INFO:tasks.workunit.client.0.smithi096.stdout:9/210: sync 2022-02-02T18:21:24.177 INFO:tasks.workunit.client.0.smithi096.stdout:2/219: sync 2022-02-02T18:21:24.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/219: sync 2022-02-02T18:21:24.189 INFO:tasks.workunit.client.0.smithi096.stdout:9/211: dread d1/d9/d25/ff [0,4194304] 0 2022-02-02T18:21:24.189 INFO:tasks.workunit.client.0.smithi096.stdout:9/212: dread - d1/db/d1c/d2f/f3b zero size 2022-02-02T18:21:24.190 INFO:tasks.workunit.client.0.smithi096.stdout:4/199: dwrite d3/d27/f28 [0,4194304] 0 2022-02-02T18:21:24.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/186: link c4 d15/d1b/d28/c45 0 2022-02-02T18:21:24.210 INFO:tasks.workunit.client.0.smithi096.stdout:3/154: truncate d2/df/d14/f10 1329615 0 2022-02-02T18:21:24.211 INFO:tasks.workunit.client.0.smithi096.stdout:7/139: creat d9/df/d16/f29 x:0 0 0 2022-02-02T18:21:24.214 INFO:tasks.workunit.client.0.smithi096.stdout:6/168: rename d18/c1e to d18/d24/d28/d3e/c48 0 2022-02-02T18:21:24.214 INFO:tasks.workunit.client.0.smithi096.stdout:6/169: creat d18/f49 x:0 0 0 2022-02-02T18:21:24.214 INFO:tasks.workunit.client.0.smithi096.stdout:6/170: truncate d18/f1a 664226 0 2022-02-02T18:21:24.215 INFO:tasks.workunit.client.0.smithi096.stdout:7/140: write d9/df/d16/f28 [3039890,94485] 0 2022-02-02T18:21:24.215 INFO:tasks.workunit.client.0.smithi096.stdout:7/141: creat d9/df/d16/f2a x:0 0 0 2022-02-02T18:21:24.217 INFO:tasks.workunit.client.0.smithi096.stdout:5/174: creat db/d1d/d2f/f3d x:0 0 0 2022-02-02T18:21:24.219 INFO:tasks.workunit.client.0.smithi096.stdout:8/156: link f21 d29/d2d/f31 0 2022-02-02T18:21:24.220 INFO:tasks.workunit.client.0.smithi096.stdout:2/220: truncate d2/f24 2132815 0 2022-02-02T18:21:24.222 INFO:tasks.workunit.client.0.smithi096.stdout:3/155: dread d2/df/d14/d11/f1f [0,4194304] 0 2022-02-02T18:21:24.223 INFO:tasks.workunit.client.0.smithi096.stdout:9/213: mkdir d1/db/d48 0 2022-02-02T18:21:24.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/214: write d1/db/d1c/d2f/f32 [103492,39632] 0 2022-02-02T18:21:24.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/200: rmdir d3/d4/d20/d4d 39 2022-02-02T18:21:24.227 INFO:tasks.workunit.client.0.smithi096.stdout:2/221: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:24.227 INFO:tasks.workunit.client.0.smithi096.stdout:2/222: creat d2/d6/d1b/d3a/f44 x:0 0 0 2022-02-02T18:21:24.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/187: symlink d15/d1b/d28/d2c/l46 0 2022-02-02T18:21:24.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/171: truncate d18/d24/f33 3740277 0 2022-02-02T18:21:24.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/188: dread d15/d1b/f25 [0,4194304] 0 2022-02-02T18:21:24.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/189: chown d15 115701 1 2022-02-02T18:21:24.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/142: symlink d9/df/d12/d14/d18/l2b 0 2022-02-02T18:21:24.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/143: chown d9/df/d12/d14/d18/c22 84 1 2022-02-02T18:21:24.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/172: write f12 [4360513,17129] 0 2022-02-02T18:21:24.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/175: creat db/de/d2e/f3e x:0 0 0 2022-02-02T18:21:24.235 INFO:tasks.workunit.client.0.smithi096.stdout:0/220: getdents d2/db/d10 0 2022-02-02T18:21:24.236 INFO:tasks.workunit.client.0.smithi096.stdout:8/157: dwrite f19 [0,4194304] 0 2022-02-02T18:21:24.238 INFO:tasks.workunit.client.0.smithi096.stdout:3/156: rename d2/df/d14/d11/c13 to d2/df/d20/d33/c3c 0 2022-02-02T18:21:24.238 INFO:tasks.workunit.client.0.smithi096.stdout:3/157: stat d2/df/d14/c2a 0 2022-02-02T18:21:24.240 INFO:tasks.workunit.client.0.smithi096.stdout:9/215: mkdir d1/d9/d25/dd/d49 0 2022-02-02T18:21:24.249 INFO:tasks.workunit.client.0.smithi096.stdout:4/201: mkdir d3/d4/d50 0 2022-02-02T18:21:24.251 INFO:tasks.workunit.client.0.smithi096.stdout:1/190: mkdir d15/d1b/d28/d47 0 2022-02-02T18:21:24.252 INFO:tasks.workunit.client.0.smithi096.stdout:7/144: rmdir d9/df/d12/d14 39 2022-02-02T18:21:24.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/173: mkdir d18/d24/d28/d4a 0 2022-02-02T18:21:24.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/174: write d18/f23 [1112824,79019] 0 2022-02-02T18:21:24.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/175: chown f12 1 1 2022-02-02T18:21:24.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/176: creat d18/d29/f4b x:0 0 0 2022-02-02T18:21:24.255 INFO:tasks.workunit.client.0.smithi096.stdout:6/177: write d18/f27 [951389,102545] 0 2022-02-02T18:21:24.256 INFO:tasks.workunit.client.0.smithi096.stdout:0/221: mknod d2/db/d10/c4b 0 2022-02-02T18:21:24.256 INFO:tasks.workunit.client.0.smithi096.stdout:0/222: fdatasync d2/fa 0 2022-02-02T18:21:24.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/176: symlink db/de/d2e/d35/l3f 0 2022-02-02T18:21:24.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/177: chown db/de/d10 1604400144 1 2022-02-02T18:21:24.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/158: mknod d2/df/d36/c3d 0 2022-02-02T18:21:24.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/216: unlink d1/c3e 0 2022-02-02T18:21:24.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/217: write d1/db/d1c/d2f/f3b [256731,100988] 0 2022-02-02T18:21:24.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/218: fdatasync d1/f8 0 2022-02-02T18:21:24.264 INFO:tasks.workunit.client.0.smithi096.stdout:4/202: mkdir d3/d4/d20/d26/d36/d51 0 2022-02-02T18:21:24.265 INFO:tasks.workunit.client.0.smithi096.stdout:7/145: symlink d9/df/d12/d14/d18/d19/l2c 0 2022-02-02T18:21:24.268 INFO:tasks.workunit.client.0.smithi096.stdout:5/178: link db/d20/f29 db/de/d10/d25/f40 0 2022-02-02T18:21:24.269 INFO:tasks.workunit.client.0.smithi096.stdout:5/179: chown db/d1d/d2f/c3b 2 1 2022-02-02T18:21:24.270 INFO:tasks.workunit.client.0.smithi096.stdout:3/159: rmdir d2/df/d1c 39 2022-02-02T18:21:24.270 INFO:tasks.workunit.client.0.smithi096.stdout:3/160: stat d2/df/d14/d11/c27 0 2022-02-02T18:21:24.271 INFO:tasks.workunit.client.0.smithi096.stdout:3/161: write d2/f1d [167818,74367] 0 2022-02-02T18:21:24.271 INFO:tasks.workunit.client.0.smithi096.stdout:3/162: write d2/df/d14/f10 [1948811,64698] 0 2022-02-02T18:21:24.273 INFO:tasks.workunit.client.0.smithi096.stdout:2/223: rename d2/d13/f40 to d2/d2a/f45 0 2022-02-02T18:21:24.274 INFO:tasks.workunit.client.0.smithi096.stdout:2/224: dread - d2/d19/f1c zero size 2022-02-02T18:21:24.274 INFO:tasks.workunit.client.0.smithi096.stdout:9/219: link d1/d9/d25/dd/d12/c33 d1/db/c4a 0 2022-02-02T18:21:24.277 INFO:tasks.workunit.client.0.smithi096.stdout:4/203: link d3/d4/d14/c45 d3/d27/c52 0 2022-02-02T18:21:24.277 INFO:tasks.workunit.client.0.smithi096.stdout:4/204: fdatasync f1 0 2022-02-02T18:21:24.278 INFO:tasks.workunit.client.0.smithi096.stdout:4/205: fdatasync d3/d4/d20/f22 0 2022-02-02T18:21:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:23 smithi159 conmon[35668]: cluster 2022-02-02T18:21:22.824909+0000 mgr.smithi096.shfutl (mgr.14162) 266 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 318 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 20 MiB/s wr, 846 op/s 2022-02-02T18:21:24.279 INFO:tasks.workunit.client.0.smithi096.stdout:6/178: dwrite d18/f19 [4194304,4194304] 0 2022-02-02T18:21:24.280 INFO:tasks.workunit.client.0.smithi096.stdout:1/191: rename d15/d1b/d28/c40 to d15/c48 0 2022-02-02T18:21:24.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/206: creat d3/d4/d20/d26/d36/d51/f53 x:0 0 0 2022-02-02T18:21:24.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/207: chown d3/d4/l2c 4 1 2022-02-02T18:21:24.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/223: dwrite d2/ff [0,4194304] 0 2022-02-02T18:21:24.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/224: chown d2/db/d37/l3a 6 1 2022-02-02T18:21:24.283 INFO:tasks.workunit.client.0.smithi096.stdout:9/220: dread d1/f8 [0,4194304] 0 2022-02-02T18:21:24.284 INFO:tasks.workunit.client.0.smithi096.stdout:6/179: symlink d18/d24/d28/l4c 0 2022-02-02T18:21:24.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/192: link f11 d15/d1b/d26/f49 0 2022-02-02T18:21:24.285 INFO:tasks.workunit.client.0.smithi096.stdout:1/193: readlink d15/l1f 0 2022-02-02T18:21:24.285 INFO:tasks.workunit.client.0.smithi096.stdout:2/225: mknod d2/d13/d42/c46 0 2022-02-02T18:21:24.286 INFO:tasks.workunit.client.0.smithi096.stdout:2/226: fdatasync d2/d6/db/f38 0 2022-02-02T18:21:24.286 INFO:tasks.workunit.client.0.smithi096.stdout:4/208: creat d3/d4/d20/d4d/f54 x:0 0 0 2022-02-02T18:21:24.287 INFO:tasks.workunit.client.0.smithi096.stdout:0/225: unlink d2/db/d37/l43 0 2022-02-02T18:21:24.287 INFO:tasks.workunit.client.0.smithi096.stdout:0/226: readlink d2/db/d10/l2f 0 2022-02-02T18:21:24.288 INFO:tasks.workunit.client.0.smithi096.stdout:6/180: link d18/d29/f43 d18/d24/f4d 0 2022-02-02T18:21:24.289 INFO:tasks.workunit.client.0.smithi096.stdout:9/221: write d1/d9/f18 [3028781,16321] 0 2022-02-02T18:21:24.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/194: link d15/d1b/d28/d2c/f38 d15/d1b/d28/f4a 0 2022-02-02T18:21:24.290 INFO:tasks.workunit.client.0.smithi096.stdout:2/227: rmdir d2/d29 39 2022-02-02T18:21:24.291 INFO:tasks.workunit.client.0.smithi096.stdout:4/209: mkdir d3/d4/d14/d55 0 2022-02-02T18:21:24.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/227: symlink d2/d1e/l4c 0 2022-02-02T18:21:24.292 INFO:tasks.workunit.client.0.smithi096.stdout:6/181: mknod d18/d24/c4e 0 2022-02-02T18:21:24.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/222: rmdir d1/d9/d11/d3c 39 2022-02-02T18:21:24.293 INFO:tasks.workunit.client.0.smithi096.stdout:1/195: symlink d15/d1b/l4b 0 2022-02-02T18:21:24.294 INFO:tasks.workunit.client.0.smithi096.stdout:1/196: write d15/d1b/d28/f4a [1846573,73290] 0 2022-02-02T18:21:24.294 INFO:tasks.workunit.client.0.smithi096.stdout:2/228: creat d2/d13/d43/f47 x:0 0 0 2022-02-02T18:21:24.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/228: mkdir d2/db/d24/d4d 0 2022-02-02T18:21:24.297 INFO:tasks.workunit.client.0.smithi096.stdout:9/223: mknod d1/d9/d11/c4b 0 2022-02-02T18:21:24.298 INFO:tasks.workunit.client.0.smithi096.stdout:3/163: dwrite d2/df/d1c/f28 [0,4194304] 0 2022-02-02T18:21:24.299 INFO:tasks.workunit.client.0.smithi096.stdout:7/146: dwrite d9/f26 [0,4194304] 0 2022-02-02T18:21:24.299 INFO:tasks.workunit.client.0.smithi096.stdout:7/147: unlink f0 0 2022-02-02T18:21:24.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/229: rename d2/db/d37/d40/f42 to d2/db/d37/d40/f4e 0 2022-02-02T18:21:24.300 INFO:tasks.workunit.client.0.smithi096.stdout:5/180: dwrite db/de/d10/f15 [0,4194304] 0 2022-02-02T18:21:24.300 INFO:tasks.workunit.client.0.smithi096.stdout:5/181: creat db/de/d2e/f41 x:0 0 0 2022-02-02T18:21:24.300 INFO:tasks.workunit.client.0.smithi096.stdout:5/182: write db/de/d2e/f3e [143628,55504] 0 2022-02-02T18:21:24.305 INFO:tasks.workunit.client.0.smithi096.stdout:3/164: rename d2/f15 to d2/df/f3e 0 2022-02-02T18:21:24.306 INFO:tasks.workunit.client.0.smithi096.stdout:7/148: symlink d9/df/d12/l2d 0 2022-02-02T18:21:24.306 INFO:tasks.workunit.client.0.smithi096.stdout:7/149: write d9/df/d16/f2a [99506,69065] 0 2022-02-02T18:21:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:23 smithi096 conmon[32067]: cluster 2022-02-02T18:21:22.824909+0000 mgr.smithi096.shfutl (mgr.14162) 266 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 318 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 20 MiB/s wr, 846 op/s 2022-02-02T18:21:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:23 smithi096 conmon[32067]: 2022-02-02T18:21:24.311 INFO:tasks.workunit.client.0.smithi096.stdout:5/183: truncate db/de/f16 379203 0 2022-02-02T18:21:24.312 INFO:tasks.workunit.client.0.smithi096.stdout:5/184: fsync db/de/d10/d27/f36 0 2022-02-02T18:21:24.312 INFO:tasks.workunit.client.0.smithi096.stdout:5/185: creat db/de/d10/d27/f42 x:0 0 0 2022-02-02T18:21:24.315 INFO:tasks.workunit.client.0.smithi096.stdout:3/165: mknod d2/df/d34/c3f 0 2022-02-02T18:21:24.321 INFO:tasks.workunit.client.0.smithi096.stdout:5/186: symlink db/l43 0 2022-02-02T18:21:24.323 INFO:tasks.workunit.client.0.smithi096.stdout:3/166: creat d2/df/d14/d2c/d31/f40 x:0 0 0 2022-02-02T18:21:24.323 INFO:tasks.workunit.client.0.smithi096.stdout:3/167: chown d2/df/d14/d16/l38 61040067 1 2022-02-02T18:21:24.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/168: write d2/df/d14/d11/f2b [871328,96980] 0 2022-02-02T18:21:24.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/169: chown d2/df/d1c/f29 181690018 1 2022-02-02T18:21:24.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/170: write d2/df/d14/d16/f23 [421899,85012] 0 2022-02-02T18:21:24.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/171: fsync d2/df/d14/f12 0 2022-02-02T18:21:24.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/172: write d2/df/d20/f37 [266159,44826] 0 2022-02-02T18:21:24.325 INFO:tasks.workunit.client.0.smithi096.stdout:3/173: symlink d2/df/l41 0 2022-02-02T18:21:24.326 INFO:tasks.workunit.client.0.smithi096.stdout:5/187: rmdir db/d20 39 2022-02-02T18:21:24.328 INFO:tasks.workunit.client.0.smithi096.stdout:3/174: creat d2/df/d1a/f42 x:0 0 0 2022-02-02T18:21:24.329 INFO:tasks.workunit.client.0.smithi096.stdout:5/188: dread db/de/d2e/f3e [0,4194304] 0 2022-02-02T18:21:24.330 INFO:tasks.workunit.client.0.smithi096.stdout:5/189: symlink db/d1d/d32/l44 0 2022-02-02T18:21:24.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/190: creat db/de/d10/d25/f45 x:0 0 0 2022-02-02T18:21:24.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/191: dread - db/de/d2e/d35/f37 zero size 2022-02-02T18:21:24.332 INFO:tasks.workunit.client.0.smithi096.stdout:5/192: mkdir db/d1d/d2f/d46 0 2022-02-02T18:21:24.332 INFO:tasks.workunit.client.0.smithi096.stdout:5/193: creat db/de/d2e/d35/f47 x:0 0 0 2022-02-02T18:21:24.333 INFO:tasks.workunit.client.0.smithi096.stdout:5/194: mknod db/de/d10/c48 0 2022-02-02T18:21:24.334 INFO:tasks.workunit.client.0.smithi096.stdout:3/175: write d2/df/d14/f30 [3699866,119707] 0 2022-02-02T18:21:24.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/230: dwrite d2/db/f2a [0,4194304] 0 2022-02-02T18:21:24.336 INFO:tasks.workunit.client.0.smithi096.stdout:4/210: dwrite d3/d4/d20/d26/d36/f44 [0,4194304] 0 2022-02-02T18:21:24.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/176: mkdir d2/df/d1a/d43 0 2022-02-02T18:21:24.339 INFO:tasks.workunit.client.0.smithi096.stdout:9/224: dwrite d1/d9/d11/f2d [0,4194304] 0 2022-02-02T18:21:24.340 INFO:tasks.workunit.client.0.smithi096.stdout:6/182: dwrite d18/d24/d28/f35 [0,4194304] 0 2022-02-02T18:21:24.341 INFO:tasks.workunit.client.0.smithi096.stdout:6/183: unlink l4 0 2022-02-02T18:21:24.341 INFO:tasks.workunit.client.0.smithi096.stdout:7/150: dwrite d9/f26 [4194304,4194304] 0 2022-02-02T18:21:24.353 INFO:tasks.workunit.client.0.smithi096.stdout:7/151: dread d9/df/f10 [0,4194304] 0 2022-02-02T18:21:24.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/152: dread - d9/df/d12/d14/d18/d19/f27 zero size 2022-02-02T18:21:24.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/153: stat f7 0 2022-02-02T18:21:24.355 INFO:tasks.workunit.client.0.smithi096.stdout:7/154: write d9/fd [4153933,98327] 0 2022-02-02T18:21:24.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/155: stat d9/l11 0 2022-02-02T18:21:24.364 INFO:tasks.workunit.client.0.smithi096.stdout:3/177: mknod d2/df/d14/d2c/d31/c44 0 2022-02-02T18:21:24.365 INFO:tasks.workunit.client.0.smithi096.stdout:5/195: dwrite db/f1b [0,4194304] 0 2022-02-02T18:21:24.365 INFO:tasks.workunit.client.0.smithi096.stdout:5/196: dread - db/de/d10/d27/f36 zero size 2022-02-02T18:21:24.366 INFO:tasks.workunit.client.0.smithi096.stdout:5/197: dread - db/d20/f29 zero size 2022-02-02T18:21:24.366 INFO:tasks.workunit.client.0.smithi096.stdout:5/198: rename db/de to db/de/d49 22 2022-02-02T18:21:24.366 INFO:tasks.workunit.client.0.smithi096.stdout:5/199: stat f3 0 2022-02-02T18:21:24.366 INFO:tasks.workunit.client.0.smithi096.stdout:9/225: creat d1/d9/d11/d1e/f4c x:0 0 0 2022-02-02T18:21:24.367 INFO:tasks.workunit.client.0.smithi096.stdout:4/211: dwrite d3/d27/f30 [4194304,4194304] 0 2022-02-02T18:21:24.367 INFO:tasks.workunit.client.0.smithi096.stdout:0/231: dwrite d2/db/f20 [0,4194304] 0 2022-02-02T18:21:24.370 INFO:tasks.workunit.client.0.smithi096.stdout:6/184: symlink d18/l4f 0 2022-02-02T18:21:24.370 INFO:tasks.workunit.client.0.smithi096.stdout:6/185: stat ce 0 2022-02-02T18:21:24.378 INFO:tasks.workunit.client.0.smithi096.stdout:7/156: creat d9/f2e x:0 0 0 2022-02-02T18:21:24.379 INFO:tasks.workunit.client.0.smithi096.stdout:4/212: dread d3/d4/d14/f2d [0,4194304] 0 2022-02-02T18:21:24.384 INFO:tasks.workunit.client.0.smithi096.stdout:5/200: symlink db/de/d10/d25/l4a 0 2022-02-02T18:21:24.385 INFO:tasks.workunit.client.0.smithi096.stdout:5/201: truncate db/de/d10/d25/f40 675018 0 2022-02-02T18:21:24.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/226: mknod d1/db/d1c/c4d 0 2022-02-02T18:21:24.387 INFO:tasks.workunit.client.0.smithi096.stdout:0/232: symlink d2/l4f 0 2022-02-02T18:21:24.388 INFO:tasks.workunit.client.0.smithi096.stdout:4/213: dread d3/d4/d20/d26/f34 [0,4194304] 0 2022-02-02T18:21:24.389 INFO:tasks.workunit.client.0.smithi096.stdout:3/178: dwrite d2/df/d14/f10 [0,4194304] 0 2022-02-02T18:21:24.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/186: dwrite fb [0,4194304] 0 2022-02-02T18:21:24.391 INFO:tasks.workunit.client.0.smithi096.stdout:3/179: write d2/df/d1c/f28 [423477,101768] 0 2022-02-02T18:21:24.391 INFO:tasks.workunit.client.0.smithi096.stdout:3/180: write d2/df/d14/f1b [559016,42467] 0 2022-02-02T18:21:24.392 INFO:tasks.workunit.client.0.smithi096.stdout:5/202: creat db/d1d/d32/f4b x:0 0 0 2022-02-02T18:21:24.394 INFO:tasks.workunit.client.0.smithi096.stdout:9/227: mkdir d1/d9/d25/dd/d12/d4e 0 2022-02-02T18:21:24.395 INFO:tasks.workunit.client.0.smithi096.stdout:9/228: readlink d1/d9/d11/d1e/d38/l37 0 2022-02-02T18:21:24.396 INFO:tasks.workunit.client.0.smithi096.stdout:0/233: dread - d2/db/d37/f3e zero size 2022-02-02T18:21:24.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/214: unlink d3/d4/c33 0 2022-02-02T18:21:24.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/215: chown d3 701177874 1 2022-02-02T18:21:24.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/216: truncate d3/d27/f41 157522 0 2022-02-02T18:21:24.402 INFO:tasks.workunit.client.0.smithi096.stdout:3/181: mknod d2/df/d1a/c45 0 2022-02-02T18:21:24.402 INFO:tasks.workunit.client.0.smithi096.stdout:3/182: write d2/df/d20/f37 [275349,32996] 0 2022-02-02T18:21:24.403 INFO:tasks.workunit.client.0.smithi096.stdout:5/203: mkdir db/de/d10/d25/d4c 0 2022-02-02T18:21:24.408 INFO:tasks.workunit.client.0.smithi096.stdout:9/229: mknod d1/d9/d25/dd/d49/c4f 0 2022-02-02T18:21:24.409 INFO:tasks.workunit.client.0.smithi096.stdout:1/197: sync 2022-02-02T18:21:24.409 INFO:tasks.workunit.client.0.smithi096.stdout:8/158: sync 2022-02-02T18:21:24.409 INFO:tasks.workunit.client.0.smithi096.stdout:2/229: sync 2022-02-02T18:21:24.409 INFO:tasks.workunit.client.0.smithi096.stdout:6/187: rmdir d18/d24/d28/d3e 39 2022-02-02T18:21:24.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/188: fdatasync d18/f23 0 2022-02-02T18:21:24.411 INFO:tasks.workunit.client.0.smithi096.stdout:3/183: symlink d2/df/d1a/d43/l46 0 2022-02-02T18:21:24.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/159: write fc [12253411,109008] 0 2022-02-02T18:21:24.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/160: creat d29/d2d/f32 x:0 0 0 2022-02-02T18:21:24.411 INFO:tasks.workunit.client.0.smithi096.stdout:4/217: getdents d3/d4/d14 0 2022-02-02T18:21:24.413 INFO:tasks.workunit.client.0.smithi096.stdout:9/230: mkdir d1/d9/d11/d1e/d47/d50 0 2022-02-02T18:21:24.413 INFO:tasks.workunit.client.0.smithi096.stdout:9/231: write d1/d9/f18 [4596475,45734] 0 2022-02-02T18:21:24.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/234: mknod d2/db/d37/d40/c50 0 2022-02-02T18:21:24.414 INFO:tasks.workunit.client.0.smithi096.stdout:0/235: write d2/db/f29 [272723,68046] 0 2022-02-02T18:21:24.415 INFO:tasks.workunit.client.0.smithi096.stdout:1/198: creat d15/d1b/d28/d2c/f4c x:0 0 0 2022-02-02T18:21:24.416 INFO:tasks.workunit.client.0.smithi096.stdout:0/236: dread d2/d1e/f36 [0,4194304] 0 2022-02-02T18:21:24.416 INFO:tasks.workunit.client.0.smithi096.stdout:1/199: read d15/d1b/f25 [2582332,69765] 0 2022-02-02T18:21:24.416 INFO:tasks.workunit.client.0.smithi096.stdout:1/200: chown d15/f22 0 1 2022-02-02T18:21:24.417 INFO:tasks.workunit.client.0.smithi096.stdout:2/230: truncate d2/d6/fa 1057697 0 2022-02-02T18:21:24.417 INFO:tasks.workunit.client.0.smithi096.stdout:2/231: read d2/fe [899710,43037] 0 2022-02-02T18:21:24.418 INFO:tasks.workunit.client.0.smithi096.stdout:6/189: mkdir d18/d50 0 2022-02-02T18:21:24.419 INFO:tasks.workunit.client.0.smithi096.stdout:6/190: write d18/d24/d28/d3e/f44 [939873,79641] 0 2022-02-02T18:21:24.423 INFO:tasks.workunit.client.0.smithi096.stdout:8/161: rename f1 to d29/f33 0 2022-02-02T18:21:24.427 INFO:tasks.workunit.client.0.smithi096.stdout:9/232: creat d1/db/d1c/d2f/f51 x:0 0 0 2022-02-02T18:21:24.427 INFO:tasks.workunit.client.0.smithi096.stdout:5/204: dwrite db/de/d10/d27/f36 [0,4194304] 0 2022-02-02T18:21:24.428 INFO:tasks.workunit.client.0.smithi096.stdout:5/205: truncate db/de/d2e/d35/f34 662019 0 2022-02-02T18:21:24.434 INFO:tasks.workunit.client.0.smithi096.stdout:0/237: getdents d2/db/d37 0 2022-02-02T18:21:24.434 INFO:tasks.workunit.client.0.smithi096.stdout:1/201: mkdir d15/d4d 0 2022-02-02T18:21:24.435 INFO:tasks.workunit.client.0.smithi096.stdout:2/232: mkdir d2/d6/d1b/d48 0 2022-02-02T18:21:24.435 INFO:tasks.workunit.client.0.smithi096.stdout:6/191: creat d18/d50/f51 x:0 0 0 2022-02-02T18:21:24.435 INFO:tasks.workunit.client.0.smithi096.stdout:9/233: symlink d1/d9/d25/dd/d12/l52 0 2022-02-02T18:21:24.436 INFO:tasks.workunit.client.0.smithi096.stdout:1/202: read d15/f3b [3903062,26285] 0 2022-02-02T18:21:24.436 INFO:tasks.workunit.client.0.smithi096.stdout:1/203: chown d15/l23 1224 1 2022-02-02T18:21:24.437 INFO:tasks.workunit.client.0.smithi096.stdout:0/238: mknod d2/db/c51 0 2022-02-02T18:21:24.437 INFO:tasks.workunit.client.0.smithi096.stdout:0/239: chown d2/db/d24/d4d 29704 1 2022-02-02T18:21:24.437 INFO:tasks.workunit.client.0.smithi096.stdout:2/233: getdents d2/d6/db/d10 0 2022-02-02T18:21:24.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/192: mkdir d18/d29/d52 0 2022-02-02T18:21:24.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/193: truncate d18/d29/f39 1026768 0 2022-02-02T18:21:24.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/194: dread - d18/d24/d28/d3e/f42 zero size 2022-02-02T18:21:24.440 INFO:tasks.workunit.client.0.smithi096.stdout:6/195: creat d18/d29/f53 x:0 0 0 2022-02-02T18:21:24.440 INFO:tasks.workunit.client.0.smithi096.stdout:9/234: link d1/db/d1c/d2f/f32 d1/d9/d11/d1e/f53 0 2022-02-02T18:21:24.441 INFO:tasks.workunit.client.0.smithi096.stdout:9/235: creat d1/db/d1c/d2f/f54 x:0 0 0 2022-02-02T18:21:24.441 INFO:tasks.workunit.client.0.smithi096.stdout:2/234: dread d2/d6/f41 [0,4194304] 0 2022-02-02T18:21:24.442 INFO:tasks.workunit.client.0.smithi096.stdout:0/240: mknod d2/db/d10/c52 0 2022-02-02T18:21:24.446 INFO:tasks.workunit.client.0.smithi096.stdout:9/236: link d1/d9/d25/dd/d12/d26/d2b/f3d d1/db/d1c/d2f/f55 0 2022-02-02T18:21:24.446 INFO:tasks.workunit.client.0.smithi096.stdout:9/237: truncate d1/d9/d25/f23 1369098 0 2022-02-02T18:21:24.447 INFO:tasks.workunit.client.0.smithi096.stdout:1/204: getdents d15/d1b/d28 0 2022-02-02T18:21:24.447 INFO:tasks.workunit.client.0.smithi096.stdout:1/205: getdents d15/d1b/d28/d2c/d39 0 2022-02-02T18:21:24.447 INFO:tasks.workunit.client.0.smithi096.stdout:1/206: write d15/d1b/d28/f44 [277867,107908] 0 2022-02-02T18:21:24.449 INFO:tasks.workunit.client.0.smithi096.stdout:9/238: link d1/f36 d1/f56 0 2022-02-02T18:21:24.449 INFO:tasks.workunit.client.0.smithi096.stdout:1/207: truncate d15/d1b/f1c 336471 0 2022-02-02T18:21:24.452 INFO:tasks.workunit.client.0.smithi096.stdout:2/235: rename d2/d6/db/d10 to d2/d6/db/d49 0 2022-02-02T18:21:24.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/239: creat d1/d9/d25/dd/d12/d4e/f57 x:0 0 0 2022-02-02T18:21:24.453 INFO:tasks.workunit.client.0.smithi096.stdout:2/236: write d2/d19/f1c [854263,73498] 0 2022-02-02T18:21:24.453 INFO:tasks.workunit.client.0.smithi096.stdout:2/237: stat d2/d29 0 2022-02-02T18:21:24.454 INFO:tasks.workunit.client.0.smithi096.stdout:2/238: write d2/d6/db/d49/f22 [152869,15106] 0 2022-02-02T18:21:24.463 INFO:tasks.workunit.client.0.smithi096.stdout:1/208: dread f13 [0,4194304] 0 2022-02-02T18:21:24.464 INFO:tasks.workunit.client.0.smithi096.stdout:1/209: mknod d15/d1b/d28/c4e 0 2022-02-02T18:21:24.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/210: stat c2 0 2022-02-02T18:21:24.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/211: chown ff 13094 1 2022-02-02T18:21:24.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/212: getdents d15/d1b 0 2022-02-02T18:21:24.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/213: mkdir d15/d1b/d28/d2c/d4f 0 2022-02-02T18:21:24.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/214: dread - d15/d1b/d26/f42 zero size 2022-02-02T18:21:24.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/184: dwrite d2/df/d20/f37 [0,4194304] 0 2022-02-02T18:21:24.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/185: fdatasync d2/df/f24 0 2022-02-02T18:21:24.468 INFO:tasks.workunit.client.0.smithi096.stdout:1/215: mknod d15/d4d/c50 0 2022-02-02T18:21:24.468 INFO:tasks.workunit.client.0.smithi096.stdout:1/216: fsync d15/d1b/d26/f31 0 2022-02-02T18:21:24.469 INFO:tasks.workunit.client.0.smithi096.stdout:4/218: dwrite d3/d4/f23 [0,4194304] 0 2022-02-02T18:21:24.470 INFO:tasks.workunit.client.0.smithi096.stdout:8/162: dwrite f21 [0,4194304] 0 2022-02-02T18:21:24.470 INFO:tasks.workunit.client.0.smithi096.stdout:0/241: dwrite d2/f15 [0,4194304] 0 2022-02-02T18:21:24.470 INFO:tasks.workunit.client.0.smithi096.stdout:0/242: chown d2/db/d10/f33 109747628 1 2022-02-02T18:21:24.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/206: dwrite f3 [0,4194304] 0 2022-02-02T18:21:24.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/207: creat db/de/d10/d27/f4d x:0 0 0 2022-02-02T18:21:24.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/217: mkdir d15/d1b/d28/d2c/d4f/d51 0 2022-02-02T18:21:24.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/218: chown d15/d1b/d26/l33 8530961 1 2022-02-02T18:21:24.474 INFO:tasks.workunit.client.0.smithi096.stdout:1/219: write d15/f1a [7414244,98628] 0 2022-02-02T18:21:24.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/186: write d2/df/d14/f30 [3208622,46946] 0 2022-02-02T18:21:24.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/187: write d2/df/d14/f18 [340935,13167] 0 2022-02-02T18:21:24.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/188: chown d2/df/d14/lc 5678 1 2022-02-02T18:21:24.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/189: dread - d2/df/f2f zero size 2022-02-02T18:21:24.485 INFO:tasks.workunit.client.0.smithi096.stdout:5/208: dread db/de/d10/d27/f36 [0,4194304] 0 2022-02-02T18:21:24.486 INFO:tasks.workunit.client.0.smithi096.stdout:9/240: dwrite d1/d9/d25/f23 [0,4194304] 0 2022-02-02T18:21:24.486 INFO:tasks.workunit.client.0.smithi096.stdout:0/243: dread d2/db/f20 [0,4194304] 0 2022-02-02T18:21:24.491 INFO:tasks.workunit.client.0.smithi096.stdout:2/239: dwrite f1 [0,4194304] 0 2022-02-02T18:21:24.491 INFO:tasks.workunit.client.0.smithi096.stdout:4/219: dwrite d3/d4/d14/f46 [0,4194304] 0 2022-02-02T18:21:24.492 INFO:tasks.workunit.client.0.smithi096.stdout:4/220: truncate d3/d27/f41 218741 0 2022-02-02T18:21:24.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/220: mknod d15/d1b/d28/d2c/d4f/c52 0 2022-02-02T18:21:24.495 INFO:tasks.workunit.client.0.smithi096.stdout:8/163: dwrite f1a [0,4194304] 0 2022-02-02T18:21:24.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/190: unlink d2/df/d14/f1b 0 2022-02-02T18:21:24.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/191: creat d2/df/d14/d2c/d31/f47 x:0 0 0 2022-02-02T18:21:24.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/192: fdatasync d2/df/d34/f39 0 2022-02-02T18:21:24.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/193: chown d2/df/d1a/f42 544 1 2022-02-02T18:21:24.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/196: rename d18/d29 to d18/d54 0 2022-02-02T18:21:24.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/197: chown d18/l4f 5844 1 2022-02-02T18:21:24.498 INFO:tasks.workunit.client.0.smithi096.stdout:5/209: mkdir db/d1d/d4e 0 2022-02-02T18:21:24.498 INFO:tasks.workunit.client.0.smithi096.stdout:5/210: write db/de/f2a [787197,93036] 0 2022-02-02T18:21:24.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/244: mkdir d2/db/d24/d4d/d53 0 2022-02-02T18:21:24.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/245: write d2/db/d37/f3e [687167,42791] 0 2022-02-02T18:21:24.506 INFO:tasks.workunit.client.0.smithi096.stdout:0/246: fsync d2/f15 0 2022-02-02T18:21:24.506 INFO:tasks.workunit.client.0.smithi096.stdout:0/247: truncate d2/db/d10/f4a 1028317 0 2022-02-02T18:21:24.507 INFO:tasks.workunit.client.0.smithi096.stdout:9/241: symlink d1/d9/d25/dd/d12/d26/l58 0 2022-02-02T18:21:24.509 INFO:tasks.workunit.client.0.smithi096.stdout:1/221: creat d15/d1b/d28/d47/f53 x:0 0 0 2022-02-02T18:21:24.515 INFO:tasks.workunit.client.0.smithi096.stdout:6/198: write d18/d24/f36 [196439,41169] 0 2022-02-02T18:21:24.515 INFO:tasks.workunit.client.0.smithi096.stdout:6/199: dread - d18/d54/f53 zero size 2022-02-02T18:21:24.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/157: sync 2022-02-02T18:21:24.522 INFO:tasks.workunit.client.0.smithi096.stdout:0/248: mkdir d2/db/d24/d4d/d54 0 2022-02-02T18:21:24.522 INFO:tasks.workunit.client.0.smithi096.stdout:0/249: chown d2/db/ce 127147188 1 2022-02-02T18:21:24.522 INFO:tasks.workunit.client.0.smithi096.stdout:0/250: truncate d2/db/d10/d27/f2d 410960 0 2022-02-02T18:21:24.523 INFO:tasks.workunit.client.0.smithi096.stdout:0/251: write d2/db/d37/f3e [1209286,84989] 0 2022-02-02T18:21:24.524 INFO:tasks.workunit.client.0.smithi096.stdout:2/240: rename d2/d13/l28 to d2/d13/d43/l4a 0 2022-02-02T18:21:24.524 INFO:tasks.workunit.client.0.smithi096.stdout:1/222: rename d15/d1b/d28 to d15/d1b/d28/d2c/d4f/d51/d54 22 2022-02-02T18:21:24.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/164: dwrite f1a [0,4194304] 0 2022-02-02T18:21:24.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/165: creat d29/f34 x:0 0 0 2022-02-02T18:21:24.526 INFO:tasks.workunit.client.0.smithi096.stdout:6/200: truncate d18/f1c 530107 0 2022-02-02T18:21:24.527 INFO:tasks.workunit.client.0.smithi096.stdout:3/194: dwrite d2/df/d14/f10 [4194304,4194304] 0 2022-02-02T18:21:24.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/252: creat d2/db/d24/d4d/d54/f55 x:0 0 0 2022-02-02T18:21:24.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/242: dwrite d1/f2c [0,4194304] 0 2022-02-02T18:21:24.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/243: fsync d1/db/d1c/d2f/f54 0 2022-02-02T18:21:24.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/244: creat d1/d9/d25/dd/d12/d4e/f59 x:0 0 0 2022-02-02T18:21:24.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/245: creat d1/db/d1c/d2f/f5a x:0 0 0 2022-02-02T18:21:24.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/246: fsync d1/d9/d25/dd/d12/d26/d2b/f42 0 2022-02-02T18:21:24.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/247: creat d1/d9/d25/dd/d12/f5b x:0 0 0 2022-02-02T18:21:24.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/248: stat d1/d9/d25 0 2022-02-02T18:21:24.531 INFO:tasks.workunit.client.0.smithi096.stdout:2/241: creat d2/d6/db/d49/f4b x:0 0 0 2022-02-02T18:21:24.531 INFO:tasks.workunit.client.0.smithi096.stdout:1/223: symlink d15/d1b/d28/d2c/d4f/d51/l55 0 2022-02-02T18:21:24.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/158: dread d9/df/d12/d14/d18/d19/f1e [0,4194304] 0 2022-02-02T18:21:24.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/159: write f7 [4178122,95068] 0 2022-02-02T18:21:24.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/160: chown d9/df/d12/d14/d18/d19/f27 0 1 2022-02-02T18:21:24.537 INFO:tasks.workunit.client.0.smithi096.stdout:1/224: dread d15/f2a [0,4194304] 0 2022-02-02T18:21:24.538 INFO:tasks.workunit.client.0.smithi096.stdout:6/201: mknod d18/d54/c55 0 2022-02-02T18:21:24.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/195: creat d2/df/d20/d3a/f48 x:0 0 0 2022-02-02T18:21:24.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/196: fdatasync d2/df/d14/f10 0 2022-02-02T18:21:24.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/253: rename d2/d1e/l3b to d2/db/d24/d4d/l56 0 2022-02-02T18:21:24.549 INFO:tasks.workunit.client.0.smithi096.stdout:2/242: creat d2/d6/db/f4c x:0 0 0 2022-02-02T18:21:24.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/249: dwrite d1/d9/d25/f23 [0,4194304] 0 2022-02-02T18:21:24.551 INFO:tasks.workunit.client.0.smithi096.stdout:8/166: rmdir d29/d2d 39 2022-02-02T18:21:24.551 INFO:tasks.workunit.client.0.smithi096.stdout:8/167: write d29/d2d/f32 [466289,41308] 0 2022-02-02T18:21:24.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/243: write d2/d6/db/fc [3235341,42537] 0 2022-02-02T18:21:24.553 INFO:tasks.workunit.client.0.smithi096.stdout:1/225: symlink d15/d4d/l56 0 2022-02-02T18:21:24.556 INFO:tasks.workunit.client.0.smithi096.stdout:9/250: unlink d1/d9/d11/d1e/f4c 0 2022-02-02T18:21:24.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/161: dwrite d9/df/d12/d14/d18/d19/f1e [0,4194304] 0 2022-02-02T18:21:24.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/162: chown d9/df/d12/d14/d18/l2b 911146 1 2022-02-02T18:21:24.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/163: chown d9/df/d12/d14/d18/c1d 0 1 2022-02-02T18:21:24.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/164: creat d9/df/d12/d14/d18/d19/f2f x:0 0 0 2022-02-02T18:21:24.559 INFO:tasks.workunit.client.0.smithi096.stdout:8/168: mknod d29/c35 0 2022-02-02T18:21:24.560 INFO:tasks.workunit.client.0.smithi096.stdout:2/244: link d2/d29/f32 d2/d6/d1b/d48/f4d 0 2022-02-02T18:21:24.561 INFO:tasks.workunit.client.0.smithi096.stdout:1/226: dread d15/d1b/d26/f31 [0,4194304] 0 2022-02-02T18:21:24.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/251: mknod d1/d9/d11/c5c 0 2022-02-02T18:21:24.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/165: truncate d9/df/f10 1853404 0 2022-02-02T18:21:24.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/166: chown d9/df/d12/d14/d18/d19/l2c 113335136 1 2022-02-02T18:21:24.567 INFO:tasks.workunit.client.0.smithi096.stdout:8/169: mknod d29/d2d/c36 0 2022-02-02T18:21:24.568 INFO:tasks.workunit.client.0.smithi096.stdout:1/227: dread d15/d1b/d26/f49 [0,4194304] 0 2022-02-02T18:21:24.569 INFO:tasks.workunit.client.0.smithi096.stdout:2/245: symlink d2/d6/d1b/d48/l4e 0 2022-02-02T18:21:24.571 INFO:tasks.workunit.client.0.smithi096.stdout:9/252: creat d1/d9/d25/dd/f5d x:0 0 0 2022-02-02T18:21:24.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/170: creat d29/d2d/f37 x:0 0 0 2022-02-02T18:21:24.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/171: truncate f19 5112867 0 2022-02-02T18:21:24.575 INFO:tasks.workunit.client.0.smithi096.stdout:9/253: symlink d1/d9/d25/dd/d12/d4e/l5e 0 2022-02-02T18:21:24.577 INFO:tasks.workunit.client.0.smithi096.stdout:6/202: dwrite d18/f19 [4194304,4194304] 0 2022-02-02T18:21:24.577 INFO:tasks.workunit.client.0.smithi096.stdout:6/203: dread - d18/d24/d28/d3e/f42 zero size 2022-02-02T18:21:24.581 INFO:tasks.workunit.client.0.smithi096.stdout:3/197: dwrite d2/df/d1a/f42 [0,4194304] 0 2022-02-02T18:21:24.582 INFO:tasks.workunit.client.0.smithi096.stdout:0/254: dwrite d2/db/d37/d40/f4e [0,4194304] 0 2022-02-02T18:21:24.587 INFO:tasks.workunit.client.0.smithi096.stdout:0/255: link d2/d1e/c48 d2/db/d24/d4d/c57 0 2022-02-02T18:21:24.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/167: dwrite d9/df/d12/d14/d18/d19/f1e [4194304,4194304] 0 2022-02-02T18:21:24.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/168: chown c3 2105212 1 2022-02-02T18:21:24.594 INFO:tasks.workunit.client.0.smithi096.stdout:0/256: rmdir d2/db/d24/d4d 39 2022-02-02T18:21:24.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/198: dread d2/df/d14/d11/f1f [4194304,4194304] 0 2022-02-02T18:21:24.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/199: dread - d2/df/d34/f39 zero size 2022-02-02T18:21:24.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/257: dread d2/db/d10/f4a [0,4194304] 0 2022-02-02T18:21:24.596 INFO:tasks.workunit.client.0.smithi096.stdout:8/172: dwrite f22 [0,4194304] 0 2022-02-02T18:21:24.596 INFO:tasks.workunit.client.0.smithi096.stdout:8/173: dread - d29/d2d/f37 zero size 2022-02-02T18:21:24.597 INFO:tasks.workunit.client.0.smithi096.stdout:0/258: mkdir d2/db/d24/d4d/d53/d58 0 2022-02-02T18:21:24.598 INFO:tasks.workunit.client.0.smithi096.stdout:6/204: dwrite d18/f1a [0,4194304] 0 2022-02-02T18:21:24.598 INFO:tasks.workunit.client.0.smithi096.stdout:6/205: creat d18/d50/f56 x:0 0 0 2022-02-02T18:21:24.601 INFO:tasks.workunit.client.0.smithi096.stdout:8/174: unlink c20 0 2022-02-02T18:21:24.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/200: dread d2/df/d14/f30 [0,4194304] 0 2022-02-02T18:21:24.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/201: chown d2/df/d14/d16/l38 157 1 2022-02-02T18:21:24.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/202: chown d2/df 3 1 2022-02-02T18:21:24.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/169: dwrite d9/df/d16/f2a [0,4194304] 0 2022-02-02T18:21:24.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/170: fsync d9/df/d16/f2a 0 2022-02-02T18:21:24.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/171: write d9/df/d16/f29 [49071,54907] 0 2022-02-02T18:21:24.609 INFO:tasks.workunit.client.0.smithi096.stdout:6/206: mknod d18/d24/d28/d4a/c57 0 2022-02-02T18:21:24.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/221: sync 2022-02-02T18:21:24.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/222: chown d3/d4/d14/c45 33019269 1 2022-02-02T18:21:24.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/207: rmdir d18/d54/d52 0 2022-02-02T18:21:24.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/208: rename d18/l4f to d18/d54/l58 0 2022-02-02T18:21:24.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/203: dread d2/df/d14/f10 [0,4194304] 0 2022-02-02T18:21:24.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/204: creat d2/df/d14/d2c/d31/f49 x:0 0 0 2022-02-02T18:21:24.621 INFO:tasks.workunit.client.0.smithi096.stdout:6/209: link ce d18/d50/c59 0 2022-02-02T18:21:24.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/172: dread f7 [0,4194304] 0 2022-02-02T18:21:24.623 INFO:tasks.workunit.client.0.smithi096.stdout:0/259: dwrite d2/d1e/f36 [0,4194304] 0 2022-02-02T18:21:24.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/205: mkdir d2/df/d20/d4a 0 2022-02-02T18:21:24.624 INFO:tasks.workunit.client.0.smithi096.stdout:3/206: write d2/df/f3e [3399912,19920] 0 2022-02-02T18:21:24.625 INFO:tasks.workunit.client.0.smithi096.stdout:6/210: symlink d18/d24/l5a 0 2022-02-02T18:21:24.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/211: truncate d18/d50/f51 477270 0 2022-02-02T18:21:24.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/212: creat d18/d24/f5b x:0 0 0 2022-02-02T18:21:24.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/223: dread d3/d4/d14/f29 [0,4194304] 0 2022-02-02T18:21:24.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/224: truncate d3/d4/d20/f22 1035835 0 2022-02-02T18:21:24.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/225: write d3/d27/f39 [941539,2936] 0 2022-02-02T18:21:24.628 INFO:tasks.workunit.client.0.smithi096.stdout:7/173: creat d9/df/d12/d14/f30 x:0 0 0 2022-02-02T18:21:24.636 INFO:tasks.workunit.client.0.smithi096.stdout:0/260: symlink d2/l59 0 2022-02-02T18:21:24.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/213: symlink d18/l5c 0 2022-02-02T18:21:24.642 INFO:tasks.workunit.client.0.smithi096.stdout:3/207: getdents d2/df/d14/d2c/d31 0 2022-02-02T18:21:24.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/214: symlink d18/d24/l5d 0 2022-02-02T18:21:24.644 INFO:tasks.workunit.client.0.smithi096.stdout:6/215: truncate d18/d54/f39 1274793 0 2022-02-02T18:21:24.644 INFO:tasks.workunit.client.0.smithi096.stdout:0/261: getdents d2/d1e 0 2022-02-02T18:21:24.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/174: dwrite d9/df/d12/d14/d18/d19/f27 [0,4194304] 0 2022-02-02T18:21:24.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/175: chown d9/df/d12/d14/l1f 3444231 1 2022-02-02T18:21:24.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/176: creat d9/df/d12/d14/f31 x:0 0 0 2022-02-02T18:21:24.646 INFO:tasks.workunit.client.0.smithi096.stdout:6/216: mknod d18/d24/d28/c5e 0 2022-02-02T18:21:24.647 INFO:tasks.workunit.client.0.smithi096.stdout:7/177: write d9/df/d12/d14/d18/d19/f1e [3132086,77925] 0 2022-02-02T18:21:24.647 INFO:tasks.workunit.client.0.smithi096.stdout:7/178: write d9/df/d12/d14/d18/d19/f2f [694965,100979] 0 2022-02-02T18:21:24.647 INFO:tasks.workunit.client.0.smithi096.stdout:0/262: symlink d2/db/d10/l5a 0 2022-02-02T18:21:24.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/179: fsync d9/df/d12/d14/d18/d19/f1e 0 2022-02-02T18:21:24.654 INFO:tasks.workunit.client.0.smithi096.stdout:3/208: link d2/df/d20/d33/f3b d2/df/d14/f4b 0 2022-02-02T18:21:24.655 INFO:tasks.workunit.client.0.smithi096.stdout:3/209: read - d2/df/d1c/f29 zero size 2022-02-02T18:21:24.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/217: rename d18/d54/f34 to d18/d24/d28/d3e/f5f 0 2022-02-02T18:21:24.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/218: truncate d18/d24/f36 1189320 0 2022-02-02T18:21:24.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/219: fdatasync d18/d24/d28/f35 0 2022-02-02T18:21:24.658 INFO:tasks.workunit.client.0.smithi096.stdout:0/263: creat d2/db/d10/d27/f5b x:0 0 0 2022-02-02T18:21:24.659 INFO:tasks.workunit.client.0.smithi096.stdout:3/210: mknod d2/df/d1c/c4c 0 2022-02-02T18:21:24.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/220: mknod d18/c60 0 2022-02-02T18:21:24.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/221: chown d18/d24/d28/c5e 920 1 2022-02-02T18:21:24.661 INFO:tasks.workunit.client.0.smithi096.stdout:5/211: sync 2022-02-02T18:21:24.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/222: creat d18/d50/f61 x:0 0 0 2022-02-02T18:21:24.663 INFO:tasks.workunit.client.0.smithi096.stdout:0/264: link d2/c17 d2/db/d37/d40/c5c 0 2022-02-02T18:21:24.664 INFO:tasks.workunit.client.0.smithi096.stdout:3/211: dread d2/df/f3e [0,4194304] 0 2022-02-02T18:21:24.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/180: rename d9/f26 to d9/df/d12/f32 0 2022-02-02T18:21:24.665 INFO:tasks.workunit.client.0.smithi096.stdout:3/212: write d2/df/d14/f4b [4024063,69007] 0 2022-02-02T18:21:24.665 INFO:tasks.workunit.client.0.smithi096.stdout:3/213: read - d2/df/d14/d2c/d31/f40 zero size 2022-02-02T18:21:24.668 INFO:tasks.workunit.client.0.smithi096.stdout:5/212: symlink db/d1d/d2f/l4f 0 2022-02-02T18:21:24.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/223: link d18/f1c d18/d24/d28/d3e/f62 0 2022-02-02T18:21:24.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/214: rename d2/df/f2f to d2/df/d14/d2c/f4d 0 2022-02-02T18:21:24.672 INFO:tasks.workunit.client.0.smithi096.stdout:5/213: rmdir db/d1d/d4e 0 2022-02-02T18:21:24.672 INFO:tasks.workunit.client.0.smithi096.stdout:5/214: stat db/de/d10/d27 0 2022-02-02T18:21:24.674 INFO:tasks.workunit.client.0.smithi096.stdout:5/215: read db/de/d10/f19 [3872175,96969] 0 2022-02-02T18:21:24.674 INFO:tasks.workunit.client.0.smithi096.stdout:6/224: mkdir d18/d54/d63 0 2022-02-02T18:21:24.675 INFO:tasks.workunit.client.0.smithi096.stdout:6/225: fdatasync d18/d50/f56 0 2022-02-02T18:21:24.675 INFO:tasks.workunit.client.0.smithi096.stdout:7/181: link d9/l15 d9/df/d12/l33 0 2022-02-02T18:21:24.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/215: unlink d2/df/l1e 0 2022-02-02T18:21:24.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/216: fdatasync d2/df/d1a/f42 0 2022-02-02T18:21:24.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/217: chown d2/df/d14/d11/c27 370036541 1 2022-02-02T18:21:24.678 INFO:tasks.workunit.client.0.smithi096.stdout:6/226: symlink d18/d24/d28/d4a/l64 0 2022-02-02T18:21:24.678 INFO:tasks.workunit.client.0.smithi096.stdout:0/265: dwrite d2/db/f29 [0,4194304] 0 2022-02-02T18:21:24.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/182: mknod d9/df/d12/d14/c34 0 2022-02-02T18:21:24.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/183: creat d9/df/d12/d14/d18/d19/f35 x:0 0 0 2022-02-02T18:21:24.680 INFO:tasks.workunit.client.0.smithi096.stdout:0/266: read d2/d1e/f2e [1341776,109358] 0 2022-02-02T18:21:24.680 INFO:tasks.workunit.client.0.smithi096.stdout:0/267: fsync d2/db/d10/f4a 0 2022-02-02T18:21:24.681 INFO:tasks.workunit.client.0.smithi096.stdout:0/268: write d2/d1e/f35 [828668,50298] 0 2022-02-02T18:21:24.681 INFO:tasks.workunit.client.0.smithi096.stdout:0/269: readlink d2/l3d 0 2022-02-02T18:21:24.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/227: mknod d18/d50/c65 0 2022-02-02T18:21:24.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/228: stat c15 0 2022-02-02T18:21:24.685 INFO:tasks.workunit.client.0.smithi096.stdout:3/218: dread d2/df/d1c/f28 [0,4194304] 0 2022-02-02T18:21:24.685 INFO:tasks.workunit.client.0.smithi096.stdout:3/219: dread - d2/df/d1c/f29 zero size 2022-02-02T18:21:24.686 INFO:tasks.workunit.client.0.smithi096.stdout:7/184: rename d9/df/d12/d14/d18/c1d to d9/df/d12/c36 0 2022-02-02T18:21:24.687 INFO:tasks.workunit.client.0.smithi096.stdout:3/220: truncate d2/df/f26 4230595 0 2022-02-02T18:21:24.688 INFO:tasks.workunit.client.0.smithi096.stdout:3/221: stat d2/df/f3e 0 2022-02-02T18:21:24.688 INFO:tasks.workunit.client.0.smithi096.stdout:3/222: chown d2/df/d14/f4b 1 1 2022-02-02T18:21:24.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/185: stat d9/l13 0 2022-02-02T18:21:24.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/186: write d9/df/d12/d14/d18/d19/f2f [831341,69063] 0 2022-02-02T18:21:24.688 INFO:tasks.workunit.client.0.smithi096.stdout:2/246: sync 2022-02-02T18:21:24.689 INFO:tasks.workunit.client.0.smithi096.stdout:1/228: sync 2022-02-02T18:21:24.689 INFO:tasks.workunit.client.0.smithi096.stdout:2/247: fdatasync d2/d29/f32 0 2022-02-02T18:21:24.690 INFO:tasks.workunit.client.0.smithi096.stdout:3/223: creat d2/f4e x:0 0 0 2022-02-02T18:21:24.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/248: symlink d2/d6/d1b/l4f 0 2022-02-02T18:21:24.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/249: truncate d2/d13/d43/f47 931234 0 2022-02-02T18:21:24.691 INFO:tasks.workunit.client.0.smithi096.stdout:2/250: unlink d2/d6/d1b/l3f 0 2022-02-02T18:21:24.691 INFO:tasks.workunit.client.0.smithi096.stdout:2/251: write d2/d6/db/d49/f4b [313273,41480] 0 2022-02-02T18:21:24.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/270: dread d2/db/f29 [0,4194304] 0 2022-02-02T18:21:24.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/271: chown d2/db/d24/f30 21 1 2022-02-02T18:21:24.693 INFO:tasks.workunit.client.0.smithi096.stdout:5/216: dwrite f6 [0,4194304] 0 2022-02-02T18:21:24.693 INFO:tasks.workunit.client.0.smithi096.stdout:5/217: chown db/d20/l2c 5164985 1 2022-02-02T18:21:24.699 INFO:tasks.workunit.client.0.smithi096.stdout:1/229: dread d15/f27 [0,4194304] 0 2022-02-02T18:21:24.700 INFO:tasks.workunit.client.0.smithi096.stdout:7/187: dread d9/df/d12/d14/d18/d19/f1e [4194304,4194304] 0 2022-02-02T18:21:24.700 INFO:tasks.workunit.client.0.smithi096.stdout:6/229: getdents d18/d50 0 2022-02-02T18:21:24.705 INFO:tasks.workunit.client.0.smithi096.stdout:5/218: symlink db/d1d/d32/l50 0 2022-02-02T18:21:24.707 INFO:tasks.workunit.client.0.smithi096.stdout:2/252: dwrite d2/d6/d1b/d48/f4d [0,4194304] 0 2022-02-02T18:21:24.707 INFO:tasks.workunit.client.0.smithi096.stdout:1/230: link d15/f27 d15/d1b/d28/d2c/d39/f57 0 2022-02-02T18:21:24.708 INFO:tasks.workunit.client.0.smithi096.stdout:6/230: symlink d18/d54/d63/l66 0 2022-02-02T18:21:24.708 INFO:tasks.workunit.client.0.smithi096.stdout:6/231: dread - d18/d24/f4d zero size 2022-02-02T18:21:24.709 INFO:tasks.workunit.client.0.smithi096.stdout:5/219: rename fa to db/de/d2e/f51 0 2022-02-02T18:21:24.710 INFO:tasks.workunit.client.0.smithi096.stdout:2/253: mknod d2/d13/d43/c50 0 2022-02-02T18:21:24.711 INFO:tasks.workunit.client.0.smithi096.stdout:6/232: symlink d18/l67 0 2022-02-02T18:21:24.711 INFO:tasks.workunit.client.0.smithi096.stdout:6/233: fdatasync d18/f23 0 2022-02-02T18:21:24.712 INFO:tasks.workunit.client.0.smithi096.stdout:5/220: truncate f3 1223157 0 2022-02-02T18:21:24.714 INFO:tasks.workunit.client.0.smithi096.stdout:6/234: unlink d18/d24/d28/c5e 0 2022-02-02T18:21:24.714 INFO:tasks.workunit.client.0.smithi096.stdout:5/221: creat db/d20/f52 x:0 0 0 2022-02-02T18:21:24.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/235: link d18/l5c d18/d50/l68 0 2022-02-02T18:21:24.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/236: write d18/d24/f5b [933194,20584] 0 2022-02-02T18:21:24.717 INFO:tasks.workunit.client.0.smithi096.stdout:5/222: mknod db/d1d/d2f/c53 0 2022-02-02T18:21:24.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/231: dread d15/d1b/d28/d2c/d39/f57 [0,4194304] 0 2022-02-02T18:21:24.718 INFO:tasks.workunit.client.0.smithi096.stdout:5/223: truncate db/de/f2a 211761 0 2022-02-02T18:21:24.720 INFO:tasks.workunit.client.0.smithi096.stdout:1/232: link d15/d1b/d28/d47/f53 d15/d1b/d28/f58 0 2022-02-02T18:21:24.722 INFO:tasks.workunit.client.0.smithi096.stdout:3/224: write d2/df/f26 [3901903,129572] 0 2022-02-02T18:21:24.722 INFO:tasks.workunit.client.0.smithi096.stdout:3/225: chown d2/df/d1a 7057 1 2022-02-02T18:21:24.723 INFO:tasks.workunit.client.0.smithi096.stdout:8/175: sync 2022-02-02T18:21:24.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/226: sync 2022-02-02T18:21:24.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/254: sync 2022-02-02T18:21:24.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/227: readlink d3/d4/l11 0 2022-02-02T18:21:24.724 INFO:tasks.workunit.client.0.smithi096.stdout:8/176: chown d29/f2b 173222883 1 2022-02-02T18:21:24.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/255: rmdir d1/d9/d11/d1e/d38 39 2022-02-02T18:21:24.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/233: dread d15/d1b/d28/f3e [0,4194304] 0 2022-02-02T18:21:24.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/234: chown ff 2030691592 1 2022-02-02T18:21:24.726 INFO:tasks.workunit.client.0.smithi096.stdout:4/228: rename d3/d27/f28 to d3/d4/d20/d26/d36/f56 0 2022-02-02T18:21:24.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/235: unlink d15/d1b/d28/d2c/d39/f57 0 2022-02-02T18:21:24.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/236: fsync d15/d1b/f29 0 2022-02-02T18:21:24.729 INFO:tasks.workunit.client.0.smithi096.stdout:4/229: mkdir d3/d4/d20/d26/d36/d51/d57 0 2022-02-02T18:21:24.729 INFO:tasks.workunit.client.0.smithi096.stdout:3/226: write d2/df/d1a/f42 [2962758,75524] 0 2022-02-02T18:21:24.730 INFO:tasks.workunit.client.0.smithi096.stdout:6/237: dread d18/f19 [0,4194304] 0 2022-02-02T18:21:24.730 INFO:tasks.workunit.client.0.smithi096.stdout:4/230: write d3/d4/d20/f22 [815351,109235] 0 2022-02-02T18:21:24.731 INFO:tasks.workunit.client.0.smithi096.stdout:4/231: chown d3/d4/d14/f4b 175 1 2022-02-02T18:21:24.731 INFO:tasks.workunit.client.0.smithi096.stdout:8/177: link f23 d29/d2d/f38 0 2022-02-02T18:21:24.731 INFO:tasks.workunit.client.0.smithi096.stdout:8/178: write d29/d2d/f38 [639998,30053] 0 2022-02-02T18:21:24.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/254: dwrite d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:24.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/255: dread - d2/d2a/f45 zero size 2022-02-02T18:21:24.733 INFO:tasks.workunit.client.0.smithi096.stdout:3/227: rmdir d2/df/d20/d33 39 2022-02-02T18:21:24.733 INFO:tasks.workunit.client.0.smithi096.stdout:3/228: stat d2/df/d34/c3f 0 2022-02-02T18:21:24.733 INFO:tasks.workunit.client.0.smithi096.stdout:3/229: write d2/df/d14/d2c/d31/f47 [910481,74376] 0 2022-02-02T18:21:24.734 INFO:tasks.workunit.client.0.smithi096.stdout:4/232: write d3/d4/d14/f46 [1690174,91923] 0 2022-02-02T18:21:24.734 INFO:tasks.workunit.client.0.smithi096.stdout:4/233: write d3/d4/f40 [950120,88587] 0 2022-02-02T18:21:24.736 INFO:tasks.workunit.client.0.smithi096.stdout:3/230: dread d2/df/d14/f18 [0,4194304] 0 2022-02-02T18:21:24.736 INFO:tasks.workunit.client.0.smithi096.stdout:3/231: chown d2/df/d34 11323 1 2022-02-02T18:21:24.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/188: dwrite d9/df/d12/d14/d18/d19/f2f [0,4194304] 0 2022-02-02T18:21:24.737 INFO:tasks.workunit.client.0.smithi096.stdout:7/189: readlink d9/df/d12/d14/d18/l2b 0 2022-02-02T18:21:24.737 INFO:tasks.workunit.client.0.smithi096.stdout:6/238: mknod d18/d54/c69 0 2022-02-02T18:21:24.740 INFO:tasks.workunit.client.0.smithi096.stdout:8/179: mknod d29/c39 0 2022-02-02T18:21:24.743 INFO:tasks.workunit.client.0.smithi096.stdout:1/237: dread d15/f27 [0,4194304] 0 2022-02-02T18:21:24.743 INFO:tasks.workunit.client.0.smithi096.stdout:1/238: fsync d15/d1b/d26/f42 0 2022-02-02T18:21:24.743 INFO:tasks.workunit.client.0.smithi096.stdout:2/256: mkdir d2/d13/d43/d51 0 2022-02-02T18:21:24.745 INFO:tasks.workunit.client.0.smithi096.stdout:4/234: creat d3/d4/d14/f58 x:0 0 0 2022-02-02T18:21:24.746 INFO:tasks.workunit.client.0.smithi096.stdout:3/232: mknod d2/df/d20/c4f 0 2022-02-02T18:21:24.746 INFO:tasks.workunit.client.0.smithi096.stdout:5/224: dread db/f1b [0,4194304] 0 2022-02-02T18:21:24.748 INFO:tasks.workunit.client.0.smithi096.stdout:7/190: mkdir d9/df/d12/d14/d18/d37 0 2022-02-02T18:21:24.748 INFO:tasks.workunit.client.0.smithi096.stdout:7/191: fsync d9/df/d12/d14/d18/d19/f27 0 2022-02-02T18:21:24.749 INFO:tasks.workunit.client.0.smithi096.stdout:6/239: creat d18/d54/f6a x:0 0 0 2022-02-02T18:21:24.749 INFO:tasks.workunit.client.0.smithi096.stdout:6/240: creat d18/d54/f6b x:0 0 0 2022-02-02T18:21:24.751 INFO:tasks.workunit.client.0.smithi096.stdout:4/235: write d3/d4/f1c [3139313,44623] 0 2022-02-02T18:21:24.755 INFO:tasks.workunit.client.0.smithi096.stdout:5/225: creat db/de/f54 x:0 0 0 2022-02-02T18:21:24.756 INFO:tasks.workunit.client.0.smithi096.stdout:7/192: mknod d9/df/c38 0 2022-02-02T18:21:24.757 INFO:tasks.workunit.client.0.smithi096.stdout:2/257: getdents d2/d6/d1b/d3a 0 2022-02-02T18:21:24.758 INFO:tasks.workunit.client.0.smithi096.stdout:5/226: creat db/d1d/f55 x:0 0 0 2022-02-02T18:21:24.758 INFO:tasks.workunit.client.0.smithi096.stdout:7/193: mkdir d9/df/d12/d39 0 2022-02-02T18:21:24.760 INFO:tasks.workunit.client.0.smithi096.stdout:9/256: dwrite d1/d9/d25/dd/f5d [0,4194304] 0 2022-02-02T18:21:24.760 INFO:tasks.workunit.client.0.smithi096.stdout:9/257: readlink d1/d9/d11/l22 0 2022-02-02T18:21:24.760 INFO:tasks.workunit.client.0.smithi096.stdout:9/258: write d1/f34 [630283,102113] 0 2022-02-02T18:21:24.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/259: chown d1/f8 180 1 2022-02-02T18:21:24.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/260: chown d1/d9/d25/dd/d12/l1d 237 1 2022-02-02T18:21:24.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/261: creat d1/d9/d25/dd/d12/d26/f5f x:0 0 0 2022-02-02T18:21:24.762 INFO:tasks.workunit.client.0.smithi096.stdout:2/258: symlink d2/d2a/l52 0 2022-02-02T18:21:24.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/262: write d1/f34 [121711,105860] 0 2022-02-02T18:21:24.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/239: dwrite d15/d1b/d28/f58 [0,4194304] 0 2022-02-02T18:21:24.763 INFO:tasks.workunit.client.0.smithi096.stdout:5/227: symlink db/d1d/d2f/l56 0 2022-02-02T18:21:24.763 INFO:tasks.workunit.client.0.smithi096.stdout:5/228: creat db/f57 x:0 0 0 2022-02-02T18:21:24.764 INFO:tasks.workunit.client.0.smithi096.stdout:6/241: dread d18/f19 [0,4194304] 0 2022-02-02T18:21:24.765 INFO:tasks.workunit.client.0.smithi096.stdout:7/194: rename d9/df/d12/d14/d18/l2b to d9/df/d12/d14/l3a 0 2022-02-02T18:21:24.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/259: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:24.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/260: chown d2/d6/db/c31 108 1 2022-02-02T18:21:24.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/261: fdatasync d2/f9 0 2022-02-02T18:21:24.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/262: chown d2/d2a/l2b 228 1 2022-02-02T18:21:24.770 INFO:tasks.workunit.client.0.smithi096.stdout:8/180: dread fc [4194304,4194304] 0 2022-02-02T18:21:24.771 INFO:tasks.workunit.client.0.smithi096.stdout:8/181: creat d29/f3a x:0 0 0 2022-02-02T18:21:24.771 INFO:tasks.workunit.client.0.smithi096.stdout:8/182: stat d29/f34 0 2022-02-02T18:21:24.773 INFO:tasks.workunit.client.0.smithi096.stdout:4/236: truncate f1 1923511 0 2022-02-02T18:21:24.779 INFO:tasks.workunit.client.0.smithi096.stdout:9/263: creat d1/d39/f60 x:0 0 0 2022-02-02T18:21:24.781 INFO:tasks.workunit.client.0.smithi096.stdout:1/240: mkdir d15/d1b/d26/d59 0 2022-02-02T18:21:24.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/241: write d15/d1b/f29 [706093,109371] 0 2022-02-02T18:21:24.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/242: creat d15/d1b/d28/d2c/f5a x:0 0 0 2022-02-02T18:21:24.783 INFO:tasks.workunit.client.0.smithi096.stdout:1/243: fsync d15/d1b/d28/f3e 0 2022-02-02T18:21:24.783 INFO:tasks.workunit.client.0.smithi096.stdout:6/242: stat ld 0 2022-02-02T18:21:24.783 INFO:tasks.workunit.client.0.smithi096.stdout:6/243: fsync d18/f23 0 2022-02-02T18:21:24.783 INFO:tasks.workunit.client.0.smithi096.stdout:1/244: write f11 [1330142,43463] 0 2022-02-02T18:21:24.784 INFO:tasks.workunit.client.0.smithi096.stdout:7/195: rename c3 to d9/df/d16/c3b 0 2022-02-02T18:21:24.785 INFO:tasks.workunit.client.0.smithi096.stdout:8/183: chown f1c 21898386 1 2022-02-02T18:21:24.786 INFO:tasks.workunit.client.0.smithi096.stdout:4/237: mknod d3/c59 0 2022-02-02T18:21:24.786 INFO:tasks.workunit.client.0.smithi096.stdout:4/238: read - d3/d4/f37 zero size 2022-02-02T18:21:24.786 INFO:tasks.workunit.client.0.smithi096.stdout:4/239: chown d3/l2a 1887547 1 2022-02-02T18:21:24.786 INFO:tasks.workunit.client.0.smithi096.stdout:4/240: getdents d3/d4/d20/d26/d36/d51/d57 0 2022-02-02T18:21:24.787 INFO:tasks.workunit.client.0.smithi096.stdout:3/233: dwrite d2/df/d14/d2c/d31/f47 [0,4194304] 0 2022-02-02T18:21:24.787 INFO:tasks.workunit.client.0.smithi096.stdout:9/264: symlink d1/d9/d25/dd/d12/d4e/l61 0 2022-02-02T18:21:24.788 INFO:tasks.workunit.client.0.smithi096.stdout:6/244: getdents d18/d24/d28/d3e 0 2022-02-02T18:21:24.788 INFO:tasks.workunit.client.0.smithi096.stdout:1/245: truncate d15/f3b 3740531 0 2022-02-02T18:21:24.790 INFO:tasks.workunit.client.0.smithi096.stdout:8/184: unlink d29/c35 0 2022-02-02T18:21:24.791 INFO:tasks.workunit.client.0.smithi096.stdout:4/241: mkdir d3/d5a 0 2022-02-02T18:21:24.792 INFO:tasks.workunit.client.0.smithi096.stdout:9/265: mknod d1/d9/d11/d1e/d47/c62 0 2022-02-02T18:21:24.792 INFO:tasks.workunit.client.0.smithi096.stdout:9/266: getdents d1/d9/d11/d3c 0 2022-02-02T18:21:24.793 INFO:tasks.workunit.client.0.smithi096.stdout:9/267: truncate d1/d9/d25/dd/d12/d26/f5f 563815 0 2022-02-02T18:21:24.794 INFO:tasks.workunit.client.0.smithi096.stdout:4/242: link d3/d4/d20/d26/f34 d3/d4/d20/d4d/f5b 0 2022-02-02T18:21:24.794 INFO:tasks.workunit.client.0.smithi096.stdout:4/243: creat d3/d4/d20/d26/f5c x:0 0 0 2022-02-02T18:21:24.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/244: write d3/d4/d14/f19 [1117513,47605] 0 2022-02-02T18:21:24.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/245: write d3/d4/d14/f58 [1000734,130188] 0 2022-02-02T18:21:24.795 INFO:tasks.workunit.client.0.smithi096.stdout:5/229: dwrite db/d1d/d32/f4b [0,4194304] 0 2022-02-02T18:21:24.796 INFO:tasks.workunit.client.0.smithi096.stdout:4/246: read d3/d4/d20/d26/d36/f56 [2615323,41578] 0 2022-02-02T18:21:24.796 INFO:tasks.workunit.client.0.smithi096.stdout:8/185: link l8 d29/d2d/l3b 0 2022-02-02T18:21:24.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/186: creat d29/f3c x:0 0 0 2022-02-02T18:21:24.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/263: dwrite d2/d6/f41 [0,4194304] 0 2022-02-02T18:21:24.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/264: dread - d2/d6/d1b/d3a/f3e zero size 2022-02-02T18:21:24.802 INFO:tasks.workunit.client.0.smithi096.stdout:5/230: mknod db/de/c58 0 2022-02-02T18:21:24.807 INFO:tasks.workunit.client.0.smithi096.stdout:7/196: rename d9/df/d12/d14/l3a to d9/df/d12/d14/l3c 0 2022-02-02T18:21:24.816 INFO:tasks.workunit.client.0.smithi096.stdout:0/272: sync 2022-02-02T18:21:24.816 INFO:tasks.workunit.client.0.smithi096.stdout:0/273: stat d2/db/f20 0 2022-02-02T18:21:24.817 INFO:tasks.workunit.client.0.smithi096.stdout:0/274: stat d2/c7 0 2022-02-02T18:21:24.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/275: creat d2/d1e/f5d x:0 0 0 2022-02-02T18:21:24.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/276: truncate d2/db/d10/d27/f2d 1299835 0 2022-02-02T18:21:24.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/277: dread - d2/db/d24/d4d/d54/f55 zero size 2022-02-02T18:21:24.820 INFO:tasks.workunit.client.0.smithi096.stdout:0/278: getdents d2/db/d24/d4d 0 2022-02-02T18:21:24.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/245: dwrite d18/f3a [0,4194304] 0 2022-02-02T18:21:24.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/246: stat d18/d50/f61 0 2022-02-02T18:21:24.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/279: symlink d2/db/d24/l5e 0 2022-02-02T18:21:24.824 INFO:tasks.workunit.client.0.smithi096.stdout:6/247: rmdir d18/d24/d28/d3e 39 2022-02-02T18:21:24.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/280: mkdir d2/db/d37/d5f 0 2022-02-02T18:21:24.828 INFO:tasks.workunit.client.0.smithi096.stdout:0/281: rename d2/c9 to d2/db/d37/d5f/c60 0 2022-02-02T18:21:24.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/248: mknod d18/d24/d28/d4a/c6c 0 2022-02-02T18:21:24.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/249: chown d18 246311552 1 2022-02-02T18:21:24.829 INFO:tasks.workunit.client.0.smithi096.stdout:0/282: readlink d2/d1e/l4c 0 2022-02-02T18:21:24.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/250: truncate d18/d24/d28/f35 4346177 0 2022-02-02T18:21:24.831 INFO:tasks.workunit.client.0.smithi096.stdout:0/283: truncate d2/db/d24/f30 5149186 0 2022-02-02T18:21:24.832 INFO:tasks.workunit.client.0.smithi096.stdout:0/284: chown d2/db/d10/d27 4140777 1 2022-02-02T18:21:24.839 INFO:tasks.workunit.client.0.smithi096.stdout:7/197: dread f2 [0,4194304] 0 2022-02-02T18:21:24.841 INFO:tasks.workunit.client.0.smithi096.stdout:7/198: link f2 d9/df/d12/d14/d18/d37/f3d 0 2022-02-02T18:21:24.841 INFO:tasks.workunit.client.0.smithi096.stdout:7/199: write d9/df/d16/f29 [161537,130501] 0 2022-02-02T18:21:24.842 INFO:tasks.workunit.client.0.smithi096.stdout:1/246: dwrite f13 [0,4194304] 0 2022-02-02T18:21:24.842 INFO:tasks.workunit.client.0.smithi096.stdout:9/268: dwrite d1/db/d1c/d2f/f51 [0,4194304] 0 2022-02-02T18:21:24.843 INFO:tasks.workunit.client.0.smithi096.stdout:7/200: creat d9/f3e x:0 0 0 2022-02-02T18:21:24.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/247: truncate d15/d1b/d26/f31 721886 0 2022-02-02T18:21:24.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/247: dwrite d3/d27/f39 [0,4194304] 0 2022-02-02T18:21:24.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/248: chown d3/d27/f13 755854 1 2022-02-02T18:21:24.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/249: creat d3/f5d x:0 0 0 2022-02-02T18:21:24.853 INFO:tasks.workunit.client.0.smithi096.stdout:3/234: dwrite d2/df/d1a/f42 [0,4194304] 0 2022-02-02T18:21:24.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/235: fdatasync d2/df/d1a/f42 0 2022-02-02T18:21:24.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/236: stat d2/df/d1a/c45 0 2022-02-02T18:21:24.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/237: fdatasync d2/df/d14/d2c/f4d 0 2022-02-02T18:21:24.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/238: fdatasync d2/f1d 0 2022-02-02T18:21:24.855 INFO:tasks.workunit.client.0.smithi096.stdout:3/239: chown d2/df/d20/d3a 329547981 1 2022-02-02T18:21:24.855 INFO:tasks.workunit.client.0.smithi096.stdout:3/240: fsync d2/df/d14/f4b 0 2022-02-02T18:21:24.855 INFO:tasks.workunit.client.0.smithi096.stdout:2/265: dwrite d2/f2f [0,4194304] 0 2022-02-02T18:21:24.856 INFO:tasks.workunit.client.0.smithi096.stdout:5/231: dwrite db/d1d/d32/f4b [0,4194304] 0 2022-02-02T18:21:24.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/251: dwrite d18/f31 [0,4194304] 0 2022-02-02T18:21:24.856 INFO:tasks.workunit.client.0.smithi096.stdout:7/201: creat d9/df/d12/f3f x:0 0 0 2022-02-02T18:21:24.857 INFO:tasks.workunit.client.0.smithi096.stdout:5/232: dread db/de/d2e/d35/f34 [0,4194304] 0 2022-02-02T18:21:24.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/248: getdents d15/d1b/d28 0 2022-02-02T18:21:24.860 INFO:tasks.workunit.client.0.smithi096.stdout:1/249: dread d15/d1b/d28/d2c/f34 [0,4194304] 0 2022-02-02T18:21:24.863 INFO:tasks.workunit.client.0.smithi096.stdout:3/241: rmdir d2/df/d14/d2c 39 2022-02-02T18:21:24.868 INFO:tasks.workunit.client.0.smithi096.stdout:0/285: read d2/db/d24/f30 [2086072,107735] 0 2022-02-02T18:21:24.869 INFO:tasks.workunit.client.0.smithi096.stdout:0/286: read - d2/db/d10/f39 zero size 2022-02-02T18:21:24.870 INFO:tasks.workunit.client.0.smithi096.stdout:2/266: write d2/d13/f26 [708487,14479] 0 2022-02-02T18:21:24.874 INFO:tasks.workunit.client.0.smithi096.stdout:6/252: mkdir d18/d50/d6d 0 2022-02-02T18:21:24.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/253: chown d18/d24/f33 447908406 1 2022-02-02T18:21:24.876 INFO:tasks.workunit.client.0.smithi096.stdout:7/202: mkdir d9/df/d12/d39/d40 0 2022-02-02T18:21:24.878 INFO:tasks.workunit.client.0.smithi096.stdout:1/250: mknod d15/d1b/d26/c5b 0 2022-02-02T18:21:24.878 INFO:tasks.workunit.client.0.smithi096.stdout:1/251: creat d15/d1b/d28/d47/f5c x:0 0 0 2022-02-02T18:21:24.878 INFO:tasks.workunit.client.0.smithi096.stdout:1/252: readlink l7 0 2022-02-02T18:21:24.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/242: creat d2/df/d14/f50 x:0 0 0 2022-02-02T18:21:24.880 INFO:tasks.workunit.client.0.smithi096.stdout:0/287: rmdir d2/db/d37/d40 39 2022-02-02T18:21:24.880 INFO:tasks.workunit.client.0.smithi096.stdout:0/288: fsync d2/db/d10/d27/f5b 0 2022-02-02T18:21:24.884 INFO:tasks.workunit.client.0.smithi096.stdout:7/203: mkdir d9/df/d12/d39/d41 0 2022-02-02T18:21:24.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/243: creat d2/df/d20/d33/f51 x:0 0 0 2022-02-02T18:21:24.892 INFO:tasks.workunit.client.0.smithi096.stdout:7/204: truncate d9/df/f10 886527 0 2022-02-02T18:21:24.893 INFO:tasks.workunit.client.0.smithi096.stdout:5/233: rename db/d1d to db/de/d10/d27/d59 0 2022-02-02T18:21:24.893 INFO:tasks.workunit.client.0.smithi096.stdout:5/234: readlink db/de/d10/l17 0 2022-02-02T18:21:24.893 INFO:tasks.workunit.client.0.smithi096.stdout:5/235: chown db/de/d10/d27/c3c 193157735 1 2022-02-02T18:21:24.894 INFO:tasks.workunit.client.0.smithi096.stdout:7/205: mkdir d9/df/d12/d39/d42 0 2022-02-02T18:21:24.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/289: dwrite d2/db/f20 [4194304,4194304] 0 2022-02-02T18:21:24.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/267: rename d2/d6/l1a to d2/d6/db/d49/l53 0 2022-02-02T18:21:24.895 INFO:tasks.workunit.client.0.smithi096.stdout:6/254: rename d18/d24/d28/d4a to d18/d24/d28/d4a/d6e 22 2022-02-02T18:21:24.899 INFO:tasks.workunit.client.0.smithi096.stdout:1/253: getdents d15/d1b/d28/d47 0 2022-02-02T18:21:24.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/268: mknod d2/d13/d43/d51/c54 0 2022-02-02T18:21:24.899 INFO:tasks.workunit.client.0.smithi096.stdout:1/254: creat d15/d1b/d28/d2c/f5d x:0 0 0 2022-02-02T18:21:24.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/269: readlink d2/d13/d43/l4a 0 2022-02-02T18:21:24.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/244: dread d2/df/f3e [0,4194304] 0 2022-02-02T18:21:24.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/255: creat d18/d54/d63/f6f x:0 0 0 2022-02-02T18:21:24.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/256: read d18/f1c [243161,170] 0 2022-02-02T18:21:24.902 INFO:tasks.workunit.client.0.smithi096.stdout:0/290: dread d2/ff [0,4194304] 0 2022-02-02T18:21:24.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/255: mknod d15/d1b/d28/d2c/d4f/d51/c5e 0 2022-02-02T18:21:24.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/256: fdatasync d15/d1b/d28/f4a 0 2022-02-02T18:21:24.906 INFO:tasks.workunit.client.0.smithi096.stdout:3/245: creat d2/df/d14/d16/f52 x:0 0 0 2022-02-02T18:21:24.907 INFO:tasks.workunit.client.0.smithi096.stdout:6/257: symlink d18/d54/l70 0 2022-02-02T18:21:24.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/291: truncate d2/d1e/f2e 1376828 0 2022-02-02T18:21:24.908 INFO:tasks.workunit.client.0.smithi096.stdout:2/270: symlink d2/l55 0 2022-02-02T18:21:24.910 INFO:tasks.workunit.client.0.smithi096.stdout:1/257: link d15/d1b/d28/d2c/f4c d15/d1b/d28/f5f 0 2022-02-02T18:21:24.911 INFO:tasks.workunit.client.0.smithi096.stdout:0/292: mkdir d2/db/d24/d4d/d61 0 2022-02-02T18:21:24.916 INFO:tasks.workunit.client.0.smithi096.stdout:6/258: write d18/d24/d28/f35 [2551034,79186] 0 2022-02-02T18:21:24.916 INFO:tasks.workunit.client.0.smithi096.stdout:2/271: mknod d2/c56 0 2022-02-02T18:21:24.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/259: creat d18/d24/d28/d3e/f71 x:0 0 0 2022-02-02T18:21:24.920 INFO:tasks.workunit.client.0.smithi096.stdout:7/206: dwrite d9/df/f10 [0,4194304] 0 2022-02-02T18:21:24.920 INFO:tasks.workunit.client.0.smithi096.stdout:7/207: write d9/df/d12/d14/f30 [96281,104099] 0 2022-02-02T18:21:24.920 INFO:tasks.workunit.client.0.smithi096.stdout:7/208: write d9/df/d12/f3f [547319,27224] 0 2022-02-02T18:21:24.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/260: link d18/l20 d18/d50/l72 0 2022-02-02T18:21:24.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/261: mkdir d18/d24/d73 0 2022-02-02T18:21:24.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/262: write d18/d54/f6b [632353,33788] 0 2022-02-02T18:21:24.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/263: mknod d18/d24/d28/c74 0 2022-02-02T18:21:24.928 INFO:tasks.workunit.client.0.smithi096.stdout:6/264: creat d18/d24/d73/f75 x:0 0 0 2022-02-02T18:21:24.928 INFO:tasks.workunit.client.0.smithi096.stdout:6/265: write d18/d24/d73/f75 [147306,108547] 0 2022-02-02T18:21:24.930 INFO:tasks.workunit.client.0.smithi096.stdout:0/293: write d2/db/d37/d40/f4e [2716428,18437] 0 2022-02-02T18:21:24.933 INFO:tasks.workunit.client.0.smithi096.stdout:3/246: dwrite d2/df/d14/d2c/f4d [0,4194304] 0 2022-02-02T18:21:24.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/266: write d18/d24/d28/f35 [776337,19723] 0 2022-02-02T18:21:24.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/267: fsync d18/d50/f56 0 2022-02-02T18:21:24.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/268: read - d18/d54/f53 zero size 2022-02-02T18:21:24.936 INFO:tasks.workunit.client.0.smithi096.stdout:6/269: unlink f12 0 2022-02-02T18:21:24.936 INFO:tasks.workunit.client.0.smithi096.stdout:3/247: link d2/df/d14/d2c/d31/f40 d2/df/d14/d11/f53 0 2022-02-02T18:21:24.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/248: unlink d2/df/d14/d16/l17 0 2022-02-02T18:21:24.940 INFO:tasks.workunit.client.0.smithi096.stdout:3/249: creat d2/df/d36/f54 x:0 0 0 2022-02-02T18:21:24.941 INFO:tasks.workunit.client.0.smithi096.stdout:3/250: creat d2/df/d1a/f55 x:0 0 0 2022-02-02T18:21:24.942 INFO:tasks.workunit.client.0.smithi096.stdout:3/251: mkdir d2/df/d36/d56 0 2022-02-02T18:21:24.943 INFO:tasks.workunit.client.0.smithi096.stdout:3/252: chown d2/df/f26 146845444 1 2022-02-02T18:21:24.944 INFO:tasks.workunit.client.0.smithi096.stdout:3/253: mknod d2/df/d1c/c57 0 2022-02-02T18:21:24.946 INFO:tasks.workunit.client.0.smithi096.stdout:1/258: dwrite d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:24.946 INFO:tasks.workunit.client.0.smithi096.stdout:1/259: write d15/d1b/d26/f49 [3665937,94052] 0 2022-02-02T18:21:24.947 INFO:tasks.workunit.client.0.smithi096.stdout:1/260: read d15/d1b/d28/d2c/f34 [252796,45276] 0 2022-02-02T18:21:24.947 INFO:tasks.workunit.client.0.smithi096.stdout:1/261: chown d15/d1b/d26/c5b 148322 1 2022-02-02T18:21:24.947 INFO:tasks.workunit.client.0.smithi096.stdout:1/262: fsync d15/d1b/d28/d2c/f4c 0 2022-02-02T18:21:24.948 INFO:tasks.workunit.client.0.smithi096.stdout:1/263: chown l10 65 1 2022-02-02T18:21:24.949 INFO:tasks.workunit.client.0.smithi096.stdout:2/272: dwrite d2/d6/db/d49/f1d [0,4194304] 0 2022-02-02T18:21:24.951 INFO:tasks.workunit.client.0.smithi096.stdout:1/264: mknod d15/d1b/d28/d2c/d4f/c60 0 2022-02-02T18:21:24.951 INFO:tasks.workunit.client.0.smithi096.stdout:1/265: write d15/d1b/d28/d2c/f34 [506079,79548] 0 2022-02-02T18:21:24.951 INFO:tasks.workunit.client.0.smithi096.stdout:7/209: dwrite d9/df/d16/f29 [0,4194304] 0 2022-02-02T18:21:24.953 INFO:tasks.workunit.client.0.smithi096.stdout:1/266: creat d15/d1b/d28/f61 x:0 0 0 2022-02-02T18:21:24.953 INFO:tasks.workunit.client.0.smithi096.stdout:1/267: dread - d15/d1b/d28/d47/f5c zero size 2022-02-02T18:21:24.955 INFO:tasks.workunit.client.0.smithi096.stdout:7/210: symlink d9/df/d12/d14/d18/d19/l43 0 2022-02-02T18:21:24.956 INFO:tasks.workunit.client.0.smithi096.stdout:7/211: write d9/df/d12/d14/d18/d19/f1e [7234874,51572] 0 2022-02-02T18:21:24.961 INFO:tasks.workunit.client.0.smithi096.stdout:7/212: write d9/fd [1929460,98268] 0 2022-02-02T18:21:24.965 INFO:tasks.workunit.client.0.smithi096.stdout:0/294: dwrite d2/d1e/f2e [0,4194304] 0 2022-02-02T18:21:24.966 INFO:tasks.workunit.client.0.smithi096.stdout:0/295: mkdir d2/d62 0 2022-02-02T18:21:24.970 INFO:tasks.workunit.client.0.smithi096.stdout:3/254: dwrite d2/df/d14/f12 [4194304,4194304] 0 2022-02-02T18:21:24.971 INFO:tasks.workunit.client.0.smithi096.stdout:6/270: dwrite d18/f1a [0,4194304] 0 2022-02-02T18:21:24.972 INFO:tasks.workunit.client.0.smithi096.stdout:0/296: fdatasync d2/db/d37/d40/f4e 0 2022-02-02T18:21:24.974 INFO:tasks.workunit.client.0.smithi096.stdout:3/255: mkdir d2/df/d20/d33/d58 0 2022-02-02T18:21:24.975 INFO:tasks.workunit.client.0.smithi096.stdout:3/256: chown d2/df/d14/f12 694 1 2022-02-02T18:21:24.975 INFO:tasks.workunit.client.0.smithi096.stdout:6/271: write d18/d24/f33 [2230643,85709] 0 2022-02-02T18:21:24.976 INFO:tasks.workunit.client.0.smithi096.stdout:6/272: chown d18/d54/f6b 2 1 2022-02-02T18:21:24.981 INFO:tasks.workunit.client.0.smithi096.stdout:7/213: dwrite f2 [0,4194304] 0 2022-02-02T18:21:24.983 INFO:tasks.workunit.client.0.smithi096.stdout:6/273: rename d18/d24/d28/l2e to d18/d24/d73/l76 0 2022-02-02T18:21:24.984 INFO:tasks.workunit.client.0.smithi096.stdout:0/297: dread d2/db/d24/f30 [0,4194304] 0 2022-02-02T18:21:24.984 INFO:tasks.workunit.client.0.smithi096.stdout:0/298: fsync d2/d1e/f5d 0 2022-02-02T18:21:24.985 INFO:tasks.workunit.client.0.smithi096.stdout:7/214: mkdir d9/df/d44 0 2022-02-02T18:21:24.986 INFO:tasks.workunit.client.0.smithi096.stdout:6/274: mknod d18/d24/d28/c77 0 2022-02-02T18:21:24.986 INFO:tasks.workunit.client.0.smithi096.stdout:6/275: write d18/d24/d28/d3e/f62 [1076893,52362] 0 2022-02-02T18:21:24.986 INFO:tasks.workunit.client.0.smithi096.stdout:6/276: write d18/d24/d73/f75 [144747,20403] 0 2022-02-02T18:21:24.986 INFO:tasks.workunit.client.0.smithi096.stdout:6/277: stat d18/f1c 0 2022-02-02T18:21:24.987 INFO:tasks.workunit.client.0.smithi096.stdout:6/278: creat d18/d24/d28/f78 x:0 0 0 2022-02-02T18:21:24.987 INFO:tasks.workunit.client.0.smithi096.stdout:0/299: creat d2/db/f63 x:0 0 0 2022-02-02T18:21:24.987 INFO:tasks.workunit.client.0.smithi096.stdout:6/279: unlink d18/d50/l72 0 2022-02-02T18:21:24.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/280: chown c17 2 1 2022-02-02T18:21:24.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/281: write d18/d24/f33 [937010,23338] 0 2022-02-02T18:21:24.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/282: fdatasync d18/d50/f51 0 2022-02-02T18:21:24.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/283: write d18/d24/f5b [1589803,119787] 0 2022-02-02T18:21:24.989 INFO:tasks.workunit.client.0.smithi096.stdout:0/300: rename d2/db/d10/c34 to d2/db/d24/d4d/d54/c64 0 2022-02-02T18:21:24.990 INFO:tasks.workunit.client.0.smithi096.stdout:0/301: write d2/f15 [1077,124497] 0 2022-02-02T18:21:24.990 INFO:tasks.workunit.client.0.smithi096.stdout:0/302: truncate d2/db/d37/d40/f4e 4882128 0 2022-02-02T18:21:24.991 INFO:tasks.workunit.client.0.smithi096.stdout:0/303: write d2/db/f2a [2960854,32303] 0 2022-02-02T18:21:24.991 INFO:tasks.workunit.client.0.smithi096.stdout:0/304: mkdir d2/db/d24/d4d/d65 0 2022-02-02T18:21:24.993 INFO:tasks.workunit.client.0.smithi096.stdout:0/305: mkdir d2/d66 0 2022-02-02T18:21:24.993 INFO:tasks.workunit.client.0.smithi096.stdout:0/306: chown d2/db/d37/l3a 957 1 2022-02-02T18:21:24.994 INFO:tasks.workunit.client.0.smithi096.stdout:0/307: mkdir d2/d1e/d67 0 2022-02-02T18:21:24.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/308: symlink d2/d66/l68 0 2022-02-02T18:21:24.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/309: fsync d2/db/d10/f4a 0 2022-02-02T18:21:24.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/310: chown d2/db/d24/f30 1654047554 1 2022-02-02T18:21:24.996 INFO:tasks.workunit.client.0.smithi096.stdout:0/311: dread d2/db/d10/f4a [0,4194304] 0 2022-02-02T18:21:25.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/215: write d9/df/d16/f2a [755309,88233] 0 2022-02-02T18:21:25.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/216: fsync d9/fd 0 2022-02-02T18:21:25.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/217: getdents d9/df/d12/d39/d41 0 2022-02-02T18:21:25.010 INFO:tasks.workunit.client.0.smithi096.stdout:8/187: sync 2022-02-02T18:21:25.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/269: sync 2022-02-02T18:21:25.011 INFO:tasks.workunit.client.0.smithi096.stdout:9/270: truncate d1/db/d1c/d2f/f5a 662575 0 2022-02-02T18:21:25.011 INFO:tasks.workunit.client.0.smithi096.stdout:8/188: fdatasync f1f 0 2022-02-02T18:21:25.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/271: mkdir d1/db/d63 0 2022-02-02T18:21:25.013 INFO:tasks.workunit.client.0.smithi096.stdout:8/189: dread d29/d2d/f2f [0,4194304] 0 2022-02-02T18:21:25.014 INFO:tasks.workunit.client.0.smithi096.stdout:9/272: creat d1/db/d1c/f64 x:0 0 0 2022-02-02T18:21:25.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/273: creat d1/d9/d11/d1e/f65 x:0 0 0 2022-02-02T18:21:25.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/274: mkdir d1/d9/d11/d1e/d66 0 2022-02-02T18:21:25.017 INFO:tasks.workunit.client.0.smithi096.stdout:7/218: dwrite d9/df/d16/f28 [4194304,4194304] 0 2022-02-02T18:21:25.018 INFO:tasks.workunit.client.0.smithi096.stdout:8/190: write f19 [1600226,100775] 0 2022-02-02T18:21:25.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/275: dread d1/db/d1c/d2f/f3b [0,4194304] 0 2022-02-02T18:21:25.018 INFO:tasks.workunit.client.0.smithi096.stdout:8/191: write fc [11737088,21263] 0 2022-02-02T18:21:25.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/312: rmdir d2/db/d24/d4d/d54 39 2022-02-02T18:21:25.023 INFO:tasks.workunit.client.0.smithi096.stdout:5/236: sync 2022-02-02T18:21:25.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/250: sync 2022-02-02T18:21:25.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/251: readlink d3/d4/l11 0 2022-02-02T18:21:25.024 INFO:tasks.workunit.client.0.smithi096.stdout:5/237: write db/de/d2e/d35/f34 [1338268,87225] 0 2022-02-02T18:21:25.024 INFO:tasks.workunit.client.0.smithi096.stdout:4/252: dread d3/d27/f43 [0,4194304] 0 2022-02-02T18:21:25.027 INFO:tasks.workunit.client.0.smithi096.stdout:7/219: getdents d9/df/d12 0 2022-02-02T18:21:25.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/313: truncate d2/db/d37/d40/f4e 4174144 0 2022-02-02T18:21:25.030 INFO:tasks.workunit.client.0.smithi096.stdout:7/220: creat d9/df/d12/f45 x:0 0 0 2022-02-02T18:21:25.032 INFO:tasks.workunit.client.0.smithi096.stdout:0/314: creat d2/f69 x:0 0 0 2022-02-02T18:21:25.032 INFO:tasks.workunit.client.0.smithi096.stdout:0/315: readlink d2/db/d10/l5a 0 2022-02-02T18:21:25.032 INFO:tasks.workunit.client.0.smithi096.stdout:0/316: readlink d2/db/d24/l5e 0 2022-02-02T18:21:25.032 INFO:tasks.workunit.client.0.smithi096.stdout:0/317: chown d2/db/f20 31815816 1 2022-02-02T18:21:25.033 INFO:tasks.workunit.client.0.smithi096.stdout:4/253: dread d3/d4/f40 [0,4194304] 0 2022-02-02T18:21:25.034 INFO:tasks.workunit.client.0.smithi096.stdout:4/254: chown d3/d27 216921 1 2022-02-02T18:21:25.034 INFO:tasks.workunit.client.0.smithi096.stdout:4/255: write d3/d4/f37 [10470,122] 0 2022-02-02T18:21:25.034 INFO:tasks.workunit.client.0.smithi096.stdout:4/256: truncate d3/d4/d20/d26/d36/f56 4590529 0 2022-02-02T18:21:25.035 INFO:tasks.workunit.client.0.smithi096.stdout:7/221: mkdir d9/df/d12/d39/d46 0 2022-02-02T18:21:25.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/257: rename d3/d4/d14/f19 to d3/d4/d20/d26/f5e 0 2022-02-02T18:21:25.037 INFO:tasks.workunit.client.0.smithi096.stdout:9/276: dwrite d1/d9/d25/f23 [4194304,4194304] 0 2022-02-02T18:21:25.039 INFO:tasks.workunit.client.0.smithi096.stdout:4/258: link d3/d4/d20/f22 d3/d5a/f5f 0 2022-02-02T18:21:25.043 INFO:tasks.workunit.client.0.smithi096.stdout:7/222: rename d9/df/d12/d14/d18 to d9/df/d47 0 2022-02-02T18:21:25.043 INFO:tasks.workunit.client.0.smithi096.stdout:7/223: rename d9/df/d47 to d9/df/d47/d48 22 2022-02-02T18:21:25.045 INFO:tasks.workunit.client.0.smithi096.stdout:8/192: dwrite f1a [0,4194304] 0 2022-02-02T18:21:25.046 INFO:tasks.workunit.client.0.smithi096.stdout:8/193: chown d29/d2d/l3b 117405 1 2022-02-02T18:21:25.046 INFO:tasks.workunit.client.0.smithi096.stdout:8/194: creat d29/d2d/f3d x:0 0 0 2022-02-02T18:21:25.046 INFO:tasks.workunit.client.0.smithi096.stdout:8/195: write d29/f2b [29154,23462] 0 2022-02-02T18:21:25.048 INFO:tasks.workunit.client.0.smithi096.stdout:0/318: read d2/db/d37/d40/f4e [570202,41512] 0 2022-02-02T18:21:25.051 INFO:tasks.workunit.client.0.smithi096.stdout:0/319: rename d2/db/d10/l2f to d2/db/d10/l6a 0 2022-02-02T18:21:25.051 INFO:tasks.workunit.client.0.smithi096.stdout:0/320: creat d2/f6b x:0 0 0 2022-02-02T18:21:25.054 INFO:tasks.workunit.client.0.smithi096.stdout:0/321: link d2/db/d10/l2c d2/db/d37/d40/l6c 0 2022-02-02T18:21:25.054 INFO:tasks.workunit.client.0.smithi096.stdout:0/322: dread - d2/db/f63 zero size 2022-02-02T18:21:25.054 INFO:tasks.workunit.client.0.smithi096.stdout:0/323: chown d2/f15 27282 1 2022-02-02T18:21:25.055 INFO:tasks.workunit.client.0.smithi096.stdout:0/324: dread - d2/d1e/f5d zero size 2022-02-02T18:21:25.060 INFO:tasks.workunit.client.0.smithi096.stdout:0/325: dread d2/db/d10/f28 [0,4194304] 0 2022-02-02T18:21:25.061 INFO:tasks.workunit.client.0.smithi096.stdout:9/277: dwrite d1/db/d1c/d2f/f51 [0,4194304] 0 2022-02-02T18:21:25.063 INFO:tasks.workunit.client.0.smithi096.stdout:9/278: link d1/d39/f60 d1/d9/d11/d1e/f67 0 2022-02-02T18:21:25.067 INFO:tasks.workunit.client.0.smithi096.stdout:0/326: write d2/db/d37/d40/f4e [3772472,29461] 0 2022-02-02T18:21:25.068 INFO:tasks.workunit.client.0.smithi096.stdout:9/279: rename d1/d9/d25/dd/d12 to d1/d9/d11/d1e/d38/d68 0 2022-02-02T18:21:25.069 INFO:tasks.workunit.client.0.smithi096.stdout:0/327: symlink d2/d1e/d67/l6d 0 2022-02-02T18:21:25.069 INFO:tasks.workunit.client.0.smithi096.stdout:0/328: write d2/db/d24/d4d/d54/f55 [178133,41377] 0 2022-02-02T18:21:25.071 INFO:tasks.workunit.client.0.smithi096.stdout:0/329: rename d2/db/d24/d4d/l56 to d2/db/l6e 0 2022-02-02T18:21:25.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/224: dwrite d9/df/d16/f2a [0,4194304] 0 2022-02-02T18:21:25.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/196: dwrite d29/d2d/f30 [0,4194304] 0 2022-02-02T18:21:25.079 INFO:tasks.workunit.client.0.smithi096.stdout:8/197: fsync f1a 0 2022-02-02T18:21:25.084 INFO:tasks.workunit.client.0.smithi096.stdout:8/198: chown f22 138550 1 2022-02-02T18:21:25.084 INFO:tasks.workunit.client.0.smithi096.stdout:8/199: creat d29/f3e x:0 0 0 2022-02-02T18:21:25.085 INFO:tasks.workunit.client.0.smithi096.stdout:8/200: chown d29/d2d/f32 47084299 1 2022-02-02T18:21:25.085 INFO:tasks.workunit.client.0.smithi096.stdout:8/201: creat d29/d2d/f3f x:0 0 0 2022-02-02T18:21:25.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/225: write d9/df/d12/f32 [4099426,25510] 0 2022-02-02T18:21:25.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/226: fdatasync d9/df/f10 0 2022-02-02T18:21:25.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/227: fdatasync f2 0 2022-02-02T18:21:25.088 INFO:tasks.workunit.client.0.smithi096.stdout:0/330: dwrite d2/fa [0,4194304] 0 2022-02-02T18:21:25.088 INFO:tasks.workunit.client.0.smithi096.stdout:9/280: rmdir d1/d9/d25 39 2022-02-02T18:21:25.090 INFO:tasks.workunit.client.0.smithi096.stdout:8/202: mkdir d29/d40 0 2022-02-02T18:21:25.090 INFO:tasks.workunit.client.0.smithi096.stdout:8/203: truncate f19 5411919 0 2022-02-02T18:21:25.092 INFO:tasks.workunit.client.0.smithi096.stdout:7/228: creat d9/df/d12/d39/d41/f49 x:0 0 0 2022-02-02T18:21:25.093 INFO:tasks.workunit.client.0.smithi096.stdout:0/331: symlink d2/l6f 0 2022-02-02T18:21:25.093 INFO:tasks.workunit.client.0.smithi096.stdout:0/332: write d2/db/d24/d4d/d54/f55 [524687,84344] 0 2022-02-02T18:21:25.094 INFO:tasks.workunit.client.0.smithi096.stdout:9/281: mkdir d1/db/d48/d69 0 2022-02-02T18:21:25.094 INFO:tasks.workunit.client.0.smithi096.stdout:9/282: creat d1/db/d1c/d2f/f6a x:0 0 0 2022-02-02T18:21:25.095 INFO:tasks.workunit.client.0.smithi096.stdout:7/229: mknod d9/df/d47/c4a 0 2022-02-02T18:21:25.097 INFO:tasks.workunit.client.0.smithi096.stdout:9/283: creat d1/db/f6b x:0 0 0 2022-02-02T18:21:25.098 INFO:tasks.workunit.client.0.smithi096.stdout:9/284: dread - d1/d9/d11/d3c/f41 zero size 2022-02-02T18:21:25.098 INFO:tasks.workunit.client.0.smithi096.stdout:9/285: fsync d1/f8 0 2022-02-02T18:21:25.099 INFO:tasks.workunit.client.0.smithi096.stdout:8/204: link l9 d29/l41 0 2022-02-02T18:21:25.099 INFO:tasks.workunit.client.0.smithi096.stdout:0/333: dread d2/d1e/f2e [0,4194304] 0 2022-02-02T18:21:25.099 INFO:tasks.workunit.client.0.smithi096.stdout:0/334: fsync d2/db/d10/d27/f2d 0 2022-02-02T18:21:25.100 INFO:tasks.workunit.client.0.smithi096.stdout:9/286: creat d1/d9/d11/d1e/d66/f6c x:0 0 0 2022-02-02T18:21:25.101 INFO:tasks.workunit.client.0.smithi096.stdout:8/205: mkdir d29/d2d/d42 0 2022-02-02T18:21:25.102 INFO:tasks.workunit.client.0.smithi096.stdout:7/230: symlink d9/df/d12/l4b 0 2022-02-02T18:21:25.102 INFO:tasks.workunit.client.0.smithi096.stdout:7/231: write d9/df/d12/d39/d41/f49 [912258,6898] 0 2022-02-02T18:21:25.103 INFO:tasks.workunit.client.0.smithi096.stdout:0/335: link d2/fa d2/d1e/d67/f70 0 2022-02-02T18:21:25.104 INFO:tasks.workunit.client.0.smithi096.stdout:9/287: mkdir d1/d9/d11/d1e/d38/d68/d6d 0 2022-02-02T18:21:25.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/232: symlink d9/df/d44/l4c 0 2022-02-02T18:21:25.109 INFO:tasks.workunit.client.0.smithi096.stdout:9/288: rename d1/d9/d11/d1e/d66/f6c to d1/db/d1c/f6e 0 2022-02-02T18:21:25.113 INFO:tasks.workunit.client.0.smithi096.stdout:2/273: sync 2022-02-02T18:21:25.114 INFO:tasks.workunit.client.0.smithi096.stdout:3/257: sync 2022-02-02T18:21:25.114 INFO:tasks.workunit.client.0.smithi096.stdout:6/284: sync 2022-02-02T18:21:25.114 INFO:tasks.workunit.client.0.smithi096.stdout:1/268: sync 2022-02-02T18:21:25.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/233: creat d9/df/d12/d39/d42/f4d x:0 0 0 2022-02-02T18:21:25.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/234: chown d9/df/d47/d19/f1e 10364 1 2022-02-02T18:21:25.116 INFO:tasks.workunit.client.0.smithi096.stdout:7/235: write d9/df/d47/d19/f2f [5192811,48341] 0 2022-02-02T18:21:25.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/206: getdents d29 0 2022-02-02T18:21:25.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/207: write d29/f34 [473026,114648] 0 2022-02-02T18:21:25.117 INFO:tasks.workunit.client.0.smithi096.stdout:9/289: mkdir d1/d9/d11/d1e/d38/d68/d6d/d6f 0 2022-02-02T18:21:25.120 INFO:tasks.workunit.client.0.smithi096.stdout:2/274: stat d2/d13/l35 0 2022-02-02T18:21:25.121 INFO:tasks.workunit.client.0.smithi096.stdout:6/285: mkdir d18/d24/d73/d79 0 2022-02-02T18:21:25.122 INFO:tasks.workunit.client.0.smithi096.stdout:5/238: sync 2022-02-02T18:21:25.124 INFO:tasks.workunit.client.0.smithi096.stdout:1/269: rename d15/d1b/d28/c45 to d15/d1b/d28/d2c/d4f/c62 0 2022-02-02T18:21:25.124 INFO:tasks.workunit.client.0.smithi096.stdout:1/270: write d15/d1b/d26/f31 [1740447,3114] 0 2022-02-02T18:21:25.125 INFO:tasks.workunit.client.0.smithi096.stdout:8/208: link d29/d2d/f3f d29/d2d/d42/f43 0 2022-02-02T18:21:25.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/290: truncate d1/f8 769160 0 2022-02-02T18:21:25.127 INFO:tasks.workunit.client.0.smithi096.stdout:2/275: rmdir d2/d13 39 2022-02-02T18:21:25.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/291: creat d1/d39/f70 x:0 0 0 2022-02-02T18:21:25.128 INFO:tasks.workunit.client.0.smithi096.stdout:6/286: dread d18/f1c [0,4194304] 0 2022-02-02T18:21:25.129 INFO:tasks.workunit.client.0.smithi096.stdout:2/276: rename d2/d6/db/d49/l53 to d2/d6/d1b/d3a/l57 0 2022-02-02T18:21:25.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/292: creat d1/db/d48/f71 x:0 0 0 2022-02-02T18:21:25.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/293: stat d1/f6 0 2022-02-02T18:21:25.135 INFO:tasks.workunit.client.0.smithi096.stdout:7/236: dread d9/df/d16/f29 [0,4194304] 0 2022-02-02T18:21:25.135 INFO:tasks.workunit.client.0.smithi096.stdout:6/287: creat d18/d50/f7a x:0 0 0 2022-02-02T18:21:25.136 INFO:tasks.workunit.client.0.smithi096.stdout:2/277: mknod d2/d6/d1b/d3a/c58 0 2022-02-02T18:21:25.138 INFO:tasks.workunit.client.0.smithi096.stdout:2/278: write d2/d6/db/d49/f1d [3642509,105925] 0 2022-02-02T18:21:25.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/258: dread d2/df/f26 [0,4194304] 0 2022-02-02T18:21:25.139 INFO:tasks.workunit.client.0.smithi096.stdout:0/336: dwrite d2/db/d24/d4d/d54/f55 [0,4194304] 0 2022-02-02T18:21:25.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/237: mkdir d9/df/d12/d39/d4e 0 2022-02-02T18:21:25.140 INFO:tasks.workunit.client.0.smithi096.stdout:6/288: mknod d18/d24/c7b 0 2022-02-02T18:21:25.140 INFO:tasks.workunit.client.0.smithi096.stdout:6/289: fsync d18/f1c 0 2022-02-02T18:21:25.141 INFO:tasks.workunit.client.0.smithi096.stdout:6/290: write d18/d24/d73/f75 [631174,47297] 0 2022-02-02T18:21:25.141 INFO:tasks.workunit.client.0.smithi096.stdout:2/279: dread d2/d13/f26 [0,4194304] 0 2022-02-02T18:21:25.145 INFO:tasks.workunit.client.0.smithi096.stdout:0/337: mkdir d2/d66/d71 0 2022-02-02T18:21:25.147 INFO:tasks.workunit.client.0.smithi096.stdout:7/238: rename d9/f2e to d9/df/d12/d39/d41/f4f 0 2022-02-02T18:21:25.148 INFO:tasks.workunit.client.0.smithi096.stdout:6/291: symlink d18/d50/d6d/l7c 0 2022-02-02T18:21:25.149 INFO:tasks.workunit.client.0.smithi096.stdout:2/280: truncate d2/f2f 3693131 0 2022-02-02T18:21:25.150 INFO:tasks.workunit.client.0.smithi096.stdout:0/338: creat d2/d62/f72 x:0 0 0 2022-02-02T18:21:25.151 INFO:tasks.workunit.client.0.smithi096.stdout:0/339: creat d2/db/d10/d27/f73 x:0 0 0 2022-02-02T18:21:25.152 INFO:tasks.workunit.client.0.smithi096.stdout:6/292: unlink d18/d50/d6d/l7c 0 2022-02-02T18:21:25.153 INFO:tasks.workunit.client.0.smithi096.stdout:6/293: write d18/d24/d73/f75 [1256404,111362] 0 2022-02-02T18:21:25.153 INFO:tasks.workunit.client.0.smithi096.stdout:6/294: readlink d18/d54/d63/l66 0 2022-02-02T18:21:25.154 INFO:tasks.workunit.client.0.smithi096.stdout:0/340: mknod d2/d66/c74 0 2022-02-02T18:21:25.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/341: write d2/db/f20 [5632560,117998] 0 2022-02-02T18:21:25.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/342: fsync d2/db/f29 0 2022-02-02T18:21:25.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/343: read - d2/db/d10/f39 zero size 2022-02-02T18:21:25.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/239: dwrite db/de/f2a [0,4194304] 0 2022-02-02T18:21:25.157 INFO:tasks.workunit.client.0.smithi096.stdout:5/240: chown db/de/d10/d27 3008421 1 2022-02-02T18:21:25.159 INFO:tasks.workunit.client.0.smithi096.stdout:9/294: dread d1/d9/d25/dd/f5d [0,4194304] 0 2022-02-02T18:21:25.162 INFO:tasks.workunit.client.0.smithi096.stdout:5/241: symlink db/de/l5a 0 2022-02-02T18:21:25.169 INFO:tasks.workunit.client.0.smithi096.stdout:1/271: dwrite d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:25.170 INFO:tasks.workunit.client.0.smithi096.stdout:8/209: dwrite d29/d2d/f38 [0,4194304] 0 2022-02-02T18:21:25.171 INFO:tasks.workunit.client.0.smithi096.stdout:8/210: read - d29/d2d/d42/f43 zero size 2022-02-02T18:21:25.171 INFO:tasks.workunit.client.0.smithi096.stdout:3/259: dwrite d2/df/d14/f18 [0,4194304] 0 2022-02-02T18:21:25.179 INFO:tasks.workunit.client.0.smithi096.stdout:5/242: read db/de/f13 [561161,112736] 0 2022-02-02T18:21:25.179 INFO:tasks.workunit.client.0.smithi096.stdout:5/243: readlink db/de/d2e/d35/l3f 0 2022-02-02T18:21:25.182 INFO:tasks.workunit.client.0.smithi096.stdout:8/211: rename d29/d2d/d42/f43 to d29/d40/f44 0 2022-02-02T18:21:25.182 INFO:tasks.workunit.client.0.smithi096.stdout:8/212: creat d29/d2d/f45 x:0 0 0 2022-02-02T18:21:25.183 INFO:tasks.workunit.client.0.smithi096.stdout:3/260: creat d2/df/d1c/f59 x:0 0 0 2022-02-02T18:21:25.183 INFO:tasks.workunit.client.0.smithi096.stdout:5/244: symlink db/de/l5b 0 2022-02-02T18:21:25.201 INFO:tasks.workunit.client.0.smithi096.stdout:8/213: dread d29/d2d/f31 [0,4194304] 0 2022-02-02T18:21:25.202 INFO:tasks.workunit.client.0.smithi096.stdout:8/214: symlink d29/d2d/d42/l46 0 2022-02-02T18:21:25.203 INFO:tasks.workunit.client.0.smithi096.stdout:8/215: mkdir d29/d2d/d47 0 2022-02-02T18:21:25.203 INFO:tasks.workunit.client.0.smithi096.stdout:8/216: creat d29/d2d/f48 x:0 0 0 2022-02-02T18:21:25.203 INFO:tasks.workunit.client.0.smithi096.stdout:8/217: write d29/d40/f44 [307864,23769] 0 2022-02-02T18:21:25.206 INFO:tasks.workunit.client.0.smithi096.stdout:7/239: dwrite d9/df/d47/d19/f27 [0,4194304] 0 2022-02-02T18:21:25.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/344: dwrite d2/db/f2a [0,4194304] 0 2022-02-02T18:21:25.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/345: dread - d2/db/d10/d27/f5b zero size 2022-02-02T18:21:25.210 INFO:tasks.workunit.client.0.smithi096.stdout:2/281: dwrite d2/d2a/f30 [0,4194304] 0 2022-02-02T18:21:25.210 INFO:tasks.workunit.client.0.smithi096.stdout:9/295: dwrite d1/d9/d11/f2d [0,4194304] 0 2022-02-02T18:21:25.211 INFO:tasks.workunit.client.0.smithi096.stdout:1/272: dwrite d15/d1b/d28/d2c/f38 [0,4194304] 0 2022-02-02T18:21:25.211 INFO:tasks.workunit.client.0.smithi096.stdout:1/273: write d15/d1b/f1c [280018,97724] 0 2022-02-02T18:21:25.212 INFO:tasks.workunit.client.0.smithi096.stdout:9/296: write d1/d9/d11/d1e/f53 [377051,115897] 0 2022-02-02T18:21:25.212 INFO:tasks.workunit.client.0.smithi096.stdout:0/346: creat d2/db/d37/f75 x:0 0 0 2022-02-02T18:21:25.213 INFO:tasks.workunit.client.0.smithi096.stdout:2/282: creat d2/d19/f59 x:0 0 0 2022-02-02T18:21:25.214 INFO:tasks.workunit.client.0.smithi096.stdout:2/283: truncate d2/d2a/f45 133283 0 2022-02-02T18:21:25.214 INFO:tasks.workunit.client.0.smithi096.stdout:2/284: fsync d2/f9 0 2022-02-02T18:21:25.216 INFO:tasks.workunit.client.0.smithi096.stdout:6/295: dwrite d18/f1a [0,4194304] 0 2022-02-02T18:21:25.216 INFO:tasks.workunit.client.0.smithi096.stdout:1/274: rename d15/d1b/d28/f5f to d15/d1b/d28/d47/f63 0 2022-02-02T18:21:25.219 INFO:tasks.workunit.client.0.smithi096.stdout:0/347: mknod d2/db/d24/d4d/d54/c76 0 2022-02-02T18:21:25.219 INFO:tasks.workunit.client.0.smithi096.stdout:0/348: write d2/fa [5175769,130474] 0 2022-02-02T18:21:25.220 INFO:tasks.workunit.client.0.smithi096.stdout:0/349: write d2/db/d10/f39 [797266,114344] 0 2022-02-02T18:21:25.220 INFO:tasks.workunit.client.0.smithi096.stdout:3/261: dwrite d2/df/f26 [0,4194304] 0 2022-02-02T18:21:25.220 INFO:tasks.workunit.client.0.smithi096.stdout:3/262: readlink d2/df/d1a/l21 0 2022-02-02T18:21:25.220 INFO:tasks.workunit.client.0.smithi096.stdout:5/245: dwrite db/de/d10/d27/d59/f55 [0,4194304] 0 2022-02-02T18:21:25.222 INFO:tasks.workunit.client.0.smithi096.stdout:2/285: mknod d2/d6/d1b/d48/c5a 0 2022-02-02T18:21:25.222 INFO:tasks.workunit.client.0.smithi096.stdout:0/350: write d2/db/d10/f18 [135228,81356] 0 2022-02-02T18:21:25.222 INFO:tasks.workunit.client.0.smithi096.stdout:6/296: symlink d18/d24/d28/l7d 0 2022-02-02T18:21:25.223 INFO:tasks.workunit.client.0.smithi096.stdout:6/297: write d18/d50/f61 [299763,59797] 0 2022-02-02T18:21:25.223 INFO:tasks.workunit.client.0.smithi096.stdout:6/298: chown d18/d24/d28/d4a/c6c 125234074 1 2022-02-02T18:21:25.223 INFO:tasks.workunit.client.0.smithi096.stdout:6/299: stat d18/d24/f2d 0 2022-02-02T18:21:25.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/300: stat d18/l2b 0 2022-02-02T18:21:25.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/301: chown c17 86939 1 2022-02-02T18:21:25.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/302: write d18/f49 [298796,30161] 0 2022-02-02T18:21:25.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/297: rename d1/d9/d25/f23 to d1/db/f72 0 2022-02-02T18:21:25.226 INFO:tasks.workunit.client.0.smithi096.stdout:9/298: write d1/d9/d11/d1e/d38/d68/f5b [318508,59229] 0 2022-02-02T18:21:25.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/259: sync 2022-02-02T18:21:25.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/260: write d3/d27/f41 [860498,82132] 0 2022-02-02T18:21:25.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/275: mknod d15/d1b/d28/d2c/d4f/c64 0 2022-02-02T18:21:25.233 INFO:tasks.workunit.client.0.smithi096.stdout:3/263: link d2/c5 d2/df/d36/c5a 0 2022-02-02T18:21:25.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/276: dread f11 [0,4194304] 0 2022-02-02T18:21:25.235 INFO:tasks.workunit.client.0.smithi096.stdout:2/286: creat d2/d6/d1b/f5b x:0 0 0 2022-02-02T18:21:25.240 INFO:tasks.workunit.client.0.smithi096.stdout:6/303: mkdir d18/d54/d63/d7e 0 2022-02-02T18:21:25.241 INFO:tasks.workunit.client.0.smithi096.stdout:0/351: dwrite d2/db/fc [0,4194304] 0 2022-02-02T18:21:25.242 INFO:tasks.workunit.client.0.smithi096.stdout:5/246: rename db/de/d10/d27/d59 to db/d5c 0 2022-02-02T18:21:25.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/304: read d18/d54/f3b [6066803,88493] 0 2022-02-02T18:21:25.244 INFO:tasks.workunit.client.0.smithi096.stdout:9/299: symlink d1/d9/d11/d1e/d38/d68/d4e/l73 0 2022-02-02T18:21:25.246 INFO:tasks.workunit.client.0.smithi096.stdout:4/261: mkdir d3/d60 0 2022-02-02T18:21:25.246 INFO:tasks.workunit.client.0.smithi096.stdout:4/262: write d3/d27/f41 [1953365,2392] 0 2022-02-02T18:21:25.247 INFO:tasks.workunit.client.0.smithi096.stdout:3/264: creat d2/df/d20/f5b x:0 0 0 2022-02-02T18:21:25.247 INFO:tasks.workunit.client.0.smithi096.stdout:3/265: read d2/df/d20/d33/f3b [2061352,24368] 0 2022-02-02T18:21:25.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/277: creat d15/d4d/f65 x:0 0 0 2022-02-02T18:21:25.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/278: chown f11 420510 1 2022-02-02T18:21:25.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/352: dread d2/db/d10/f16 [0,4194304] 0 2022-02-02T18:21:25.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/353: stat d2/d1e/l4c 0 2022-02-02T18:21:25.253 INFO:tasks.workunit.client.0.smithi096.stdout:5/247: rename db/de/d2e/d35/f24 to db/de/d10/d25/d4c/f5d 0 2022-02-02T18:21:25.254 INFO:tasks.workunit.client.0.smithi096.stdout:9/300: unlink d1/d9/d11/d1e/d38/d68/d26/l58 0 2022-02-02T18:21:25.255 INFO:tasks.workunit.client.0.smithi096.stdout:9/301: read - d1/f56 zero size 2022-02-02T18:21:25.255 INFO:tasks.workunit.client.0.smithi096.stdout:4/263: symlink d3/d4/d20/l61 0 2022-02-02T18:21:25.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/266: mkdir d2/df/d14/d11/d5c 0 2022-02-02T18:21:25.257 INFO:tasks.workunit.client.0.smithi096.stdout:1/279: symlink d15/d1b/d28/l66 0 2022-02-02T18:21:25.258 INFO:tasks.workunit.client.0.smithi096.stdout:2/287: rmdir d2/d6/db/d49 39 2022-02-02T18:21:25.260 INFO:tasks.workunit.client.0.smithi096.stdout:0/354: link d2/db/d37/d40/l6c d2/db/d37/d40/l77 0 2022-02-02T18:21:25.261 INFO:tasks.workunit.client.0.smithi096.stdout:6/305: rename d18/d24/c4e to d18/d24/d28/d3e/c7f 0 2022-02-02T18:21:25.261 INFO:tasks.workunit.client.0.smithi096.stdout:6/306: stat d18/d24/d28/d4a 0 2022-02-02T18:21:25.263 INFO:tasks.workunit.client.0.smithi096.stdout:5/248: creat db/d5c/f5e x:0 0 0 2022-02-02T18:21:25.264 INFO:tasks.workunit.client.0.smithi096.stdout:9/302: creat d1/d9/d11/d1e/d38/d68/d26/f74 x:0 0 0 2022-02-02T18:21:25.265 INFO:tasks.workunit.client.0.smithi096.stdout:9/303: chown d1/d9/d11/d1e/f65 0 1 2022-02-02T18:21:25.265 INFO:tasks.workunit.client.0.smithi096.stdout:4/264: mknod d3/d27/d4a/c62 0 2022-02-02T18:21:25.268 INFO:tasks.workunit.client.0.smithi096.stdout:1/280: mkdir d15/d67 0 2022-02-02T18:21:25.272 INFO:tasks.workunit.client.0.smithi096.stdout:2/288: symlink d2/d13/d43/l5c 0 2022-02-02T18:21:25.272 INFO:tasks.workunit.client.0.smithi096.stdout:2/289: chown d2/d6/d1b/d48 2966148 1 2022-02-02T18:21:25.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/355: dread d2/db/d24/d4d/d54/f55 [0,4194304] 0 2022-02-02T18:21:25.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/356: write d2/db/d24/f30 [1867640,95291] 0 2022-02-02T18:21:25.275 INFO:tasks.workunit.client.0.smithi096.stdout:2/290: getdents d2 0 2022-02-02T18:21:25.276 INFO:tasks.workunit.client.0.smithi096.stdout:5/249: rmdir db/d20 39 2022-02-02T18:21:25.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/250: chown db/de/d10/c11 1053 1 2022-02-02T18:21:25.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/251: dread - db/f57 zero size 2022-02-02T18:21:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:25 smithi159 conmon[35668]: cluster 2022-02-02T18:21:24.825319+0000 mgr.smithi096.shfutl (mgr.14162) 267 : cluster [DBG] 2022-02-02T18:21:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:25 smithi159 conmon[35668]: pgmap v216: 65 pgs: 65 active+clean; 358 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 22 MiB/s wr, 676 op/s 2022-02-02T18:21:25.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/267: rename d2/df/d20/d3a to d2/df/d1c/d5d 0 2022-02-02T18:21:25.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/252: creat db/d5c/d2f/d46/f5f x:0 0 0 2022-02-02T18:21:25.285 INFO:tasks.workunit.client.0.smithi096.stdout:6/307: getdents d18/d24 0 2022-02-02T18:21:25.287 INFO:tasks.workunit.client.0.smithi096.stdout:9/304: rename d1/d9/d11/d1e/d38/d68/d4e/l5e to d1/d9/d11/d1e/d38/d68/d26/d2b/l75 0 2022-02-02T18:21:25.288 INFO:tasks.workunit.client.0.smithi096.stdout:3/268: creat d2/df/d20/d33/d58/f5e x:0 0 0 2022-02-02T18:21:25.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/253: mkdir db/d5c/d60 0 2022-02-02T18:21:25.290 INFO:tasks.workunit.client.0.smithi096.stdout:5/254: stat db/de/d2e/l31 0 2022-02-02T18:21:25.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/308: creat d18/d50/d6d/f80 x:0 0 0 2022-02-02T18:21:25.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/309: write d18/f1a [4399499,102569] 0 2022-02-02T18:21:25.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/265: dwrite d3/d4/d14/f58 [0,4194304] 0 2022-02-02T18:21:25.293 INFO:tasks.workunit.client.0.smithi096.stdout:5/255: unlink db/d20/f52 0 2022-02-02T18:21:25.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/266: write d3/d27/f13 [1149611,33937] 0 2022-02-02T18:21:25.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/267: truncate d3/d4/d20/d26/d36/d51/f53 482722 0 2022-02-02T18:21:25.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/357: dread d2/db/d24/d4d/d54/f55 [0,4194304] 0 2022-02-02T18:21:25.296 INFO:tasks.workunit.client.0.smithi096.stdout:3/269: symlink d2/df/d14/l5f 0 2022-02-02T18:21:25.298 INFO:tasks.workunit.client.0.smithi096.stdout:5/256: unlink db/de/d2e/d35/l3f 0 2022-02-02T18:21:25.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/268: link d3/d4/d20/d26/d36/d51/f53 d3/d5a/f63 0 2022-02-02T18:21:25.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/305: dread d1/d9/d11/f2d [0,4194304] 0 2022-02-02T18:21:25.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/306: read - d1/d39/f70 zero size 2022-02-02T18:21:25.301 INFO:tasks.workunit.client.0.smithi096.stdout:6/310: dread fb [0,4194304] 0 2022-02-02T18:21:25.302 INFO:tasks.workunit.client.0.smithi096.stdout:6/311: chown d18/c22 8559679 1 2022-02-02T18:21:25.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/358: symlink d2/db/d24/d4d/d65/l78 0 2022-02-02T18:21:25.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/359: fdatasync d2/d1e/f36 0 2022-02-02T18:21:25.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/257: mkdir db/d5c/d61 0 2022-02-02T18:21:25.303 INFO:tasks.workunit.client.0.smithi096.stdout:5/258: fsync db/de/d10/d27/f42 0 2022-02-02T18:21:25.303 INFO:tasks.workunit.client.0.smithi096.stdout:6/312: write d18/f27 [122108,117617] 0 2022-02-02T18:21:25.304 INFO:tasks.workunit.client.0.smithi096.stdout:0/360: rename d2/db/d10/l2c to d2/db/d10/d27/l79 0 2022-02-02T18:21:25.304 INFO:tasks.workunit.client.0.smithi096.stdout:0/361: creat d2/db/d37/f7a x:0 0 0 2022-02-02T18:21:25.305 INFO:tasks.workunit.client.0.smithi096.stdout:2/291: dwrite d2/d2a/f45 [0,4194304] 0 2022-02-02T18:21:25.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/362: write d2/d1e/f36 [920211,38492] 0 2022-02-02T18:21:25.306 INFO:tasks.workunit.client.0.smithi096.stdout:5/259: mkdir db/d62 0 2022-02-02T18:21:25.307 INFO:tasks.workunit.client.0.smithi096.stdout:3/270: dread d2/df/d14/d2c/d31/f47 [0,4194304] 0 2022-02-02T18:21:25.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:25 smithi096 conmon[32067]: cluster 2022-02-02T18:21:24.825319+0000 mgr.smithi096.shfutl (mgr.14162) 267 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 358 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 22 MiB/s wr, 676 op/s 2022-02-02T18:21:25.308 INFO:tasks.workunit.client.0.smithi096.stdout:3/271: write d2/df/f3e [3183229,103611] 0 2022-02-02T18:21:25.310 INFO:tasks.workunit.client.0.smithi096.stdout:2/292: write d2/f2f [434086,37687] 0 2022-02-02T18:21:25.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/313: mknod d18/d54/c81 0 2022-02-02T18:21:25.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/314: write d18/d54/f6b [1134519,28770] 0 2022-02-02T18:21:25.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/240: sync 2022-02-02T18:21:25.318 INFO:tasks.workunit.client.0.smithi096.stdout:8/218: sync 2022-02-02T18:21:25.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/241: creat d9/df/d12/d14/f50 x:0 0 0 2022-02-02T18:21:25.323 INFO:tasks.workunit.client.0.smithi096.stdout:0/363: rename d2/db/d37/d5f/c60 to d2/d66/d71/c7b 0 2022-02-02T18:21:25.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/364: truncate d2/db/d10/f18 9121655 0 2022-02-02T18:21:25.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/365: write d2/db/fc [4456898,100363] 0 2022-02-02T18:21:25.325 INFO:tasks.workunit.client.0.smithi096.stdout:5/260: creat db/de/d10/d25/d4c/f63 x:0 0 0 2022-02-02T18:21:25.326 INFO:tasks.workunit.client.0.smithi096.stdout:2/293: mkdir d2/d13/d43/d51/d5d 0 2022-02-02T18:21:25.327 INFO:tasks.workunit.client.0.smithi096.stdout:6/315: mknod d18/d54/c82 0 2022-02-02T18:21:25.327 INFO:tasks.workunit.client.0.smithi096.stdout:8/219: stat d29/l41 0 2022-02-02T18:21:25.328 INFO:tasks.workunit.client.0.smithi096.stdout:7/242: mkdir d9/df/d12/d39/d40/d51 0 2022-02-02T18:21:25.329 INFO:tasks.workunit.client.0.smithi096.stdout:0/366: link d2/d1e/c48 d2/db/d24/d4d/c7c 0 2022-02-02T18:21:25.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/261: symlink db/d5c/d32/l64 0 2022-02-02T18:21:25.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/262: truncate db/de/f16 1321329 0 2022-02-02T18:21:25.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/263: readlink db/de/d10/l2d 0 2022-02-02T18:21:25.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/316: unlink d18/d54/c82 0 2022-02-02T18:21:25.334 INFO:tasks.workunit.client.0.smithi096.stdout:6/317: readlink d18/d54/d63/l66 0 2022-02-02T18:21:25.334 INFO:tasks.workunit.client.0.smithi096.stdout:6/318: chown d18/d54/f53 0 1 2022-02-02T18:21:25.334 INFO:tasks.workunit.client.0.smithi096.stdout:8/220: creat d29/d40/f49 x:0 0 0 2022-02-02T18:21:25.335 INFO:tasks.workunit.client.0.smithi096.stdout:9/307: dwrite d1/d9/d11/d1e/d38/d68/f1f [4194304,4194304] 0 2022-02-02T18:21:25.335 INFO:tasks.workunit.client.0.smithi096.stdout:7/243: creat d9/df/d12/d39/d40/d51/f52 x:0 0 0 2022-02-02T18:21:25.336 INFO:tasks.workunit.client.0.smithi096.stdout:7/244: readlink d9/df/d12/d14/l1f 0 2022-02-02T18:21:25.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/367: mknod d2/db/d24/d4d/d54/c7d 0 2022-02-02T18:21:25.337 INFO:tasks.workunit.client.0.smithi096.stdout:4/269: dwrite d3/d4/d20/d26/f2f [0,4194304] 0 2022-02-02T18:21:25.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/272: dwrite d2/df/d1c/d5d/f48 [0,4194304] 0 2022-02-02T18:21:25.337 INFO:tasks.workunit.client.0.smithi096.stdout:0/368: read d2/db/d10/f4a [425603,110345] 0 2022-02-02T18:21:25.337 INFO:tasks.workunit.client.0.smithi096.stdout:2/294: dread d2/d29/f32 [0,4194304] 0 2022-02-02T18:21:25.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/369: chown d2/db/d10/c31 297 1 2022-02-02T18:21:25.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/221: mkdir d29/d4a 0 2022-02-02T18:21:25.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/222: readlink d29/l2c 0 2022-02-02T18:21:25.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/223: write d29/f3c [820841,3584] 0 2022-02-02T18:21:25.340 INFO:tasks.workunit.client.0.smithi096.stdout:4/270: write d3/d4/d20/f22 [291224,1153] 0 2022-02-02T18:21:25.340 INFO:tasks.workunit.client.0.smithi096.stdout:8/224: write d29/d2d/f48 [282819,119395] 0 2022-02-02T18:21:25.340 INFO:tasks.workunit.client.0.smithi096.stdout:9/308: unlink d1/d9/d11/d1e/f67 0 2022-02-02T18:21:25.340 INFO:tasks.workunit.client.0.smithi096.stdout:9/309: write d1/f56 [210602,37418] 0 2022-02-02T18:21:25.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/310: dread d1/db/d1c/d2f/f55 [0,4194304] 0 2022-02-02T18:21:25.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/311: readlink d1/d9/d11/d1e/d38/d68/d4e/l73 0 2022-02-02T18:21:25.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/312: write d1/d39/f70 [829323,47329] 0 2022-02-02T18:21:25.349 INFO:tasks.workunit.client.0.smithi096.stdout:6/319: rmdir d18/d50 39 2022-02-02T18:21:25.352 INFO:tasks.workunit.client.0.smithi096.stdout:3/273: mknod d2/df/d1c/c60 0 2022-02-02T18:21:25.352 INFO:tasks.workunit.client.0.smithi096.stdout:2/295: mkdir d2/d5e 0 2022-02-02T18:21:25.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/370: mknod d2/db/d24/d4d/c7e 0 2022-02-02T18:21:25.354 INFO:tasks.workunit.client.0.smithi096.stdout:4/271: symlink d3/d4/d20/d26/d36/l64 0 2022-02-02T18:21:25.354 INFO:tasks.workunit.client.0.smithi096.stdout:9/313: mkdir d1/d9/d11/d1e/d38/d68/d26/d2b/d76 0 2022-02-02T18:21:25.355 INFO:tasks.workunit.client.0.smithi096.stdout:9/314: chown d1/d9/d25/dd/d49 0 1 2022-02-02T18:21:25.355 INFO:tasks.workunit.client.0.smithi096.stdout:9/315: readlink d1/d9/d11/d1e/d38/l37 0 2022-02-02T18:21:25.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/245: truncate d9/df/d12/f3f 6241 0 2022-02-02T18:21:25.357 INFO:tasks.workunit.client.0.smithi096.stdout:9/316: write d1/db/d1c/d2f/f55 [150533,97675] 0 2022-02-02T18:21:25.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/274: symlink d2/df/d34/l61 0 2022-02-02T18:21:25.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/275: dread - d2/df/d20/d33/d58/f5e zero size 2022-02-02T18:21:25.358 INFO:tasks.workunit.client.0.smithi096.stdout:8/225: dwrite d29/d2d/f45 [0,4194304] 0 2022-02-02T18:21:25.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/296: mkdir d2/d29/d5f 0 2022-02-02T18:21:25.359 INFO:tasks.workunit.client.0.smithi096.stdout:0/371: rmdir d2/db/d24/d4d/d65 39 2022-02-02T18:21:25.359 INFO:tasks.workunit.client.0.smithi096.stdout:0/372: dread - d2/f6b zero size 2022-02-02T18:21:25.360 INFO:tasks.workunit.client.0.smithi096.stdout:0/373: write d2/db/fc [5466439,67833] 0 2022-02-02T18:21:25.360 INFO:tasks.workunit.client.0.smithi096.stdout:2/297: write d2/d6/db/f38 [457269,47094] 0 2022-02-02T18:21:25.360 INFO:tasks.workunit.client.0.smithi096.stdout:2/298: chown d2/d6/d1b/d3a/c58 7691 1 2022-02-02T18:21:25.361 INFO:tasks.workunit.client.0.smithi096.stdout:4/272: mknod d3/d4/d50/c65 0 2022-02-02T18:21:25.361 INFO:tasks.workunit.client.0.smithi096.stdout:9/317: dread d1/d9/d11/f2d [0,4194304] 0 2022-02-02T18:21:25.362 INFO:tasks.workunit.client.0.smithi096.stdout:6/320: dread d18/f26 [0,4194304] 0 2022-02-02T18:21:25.363 INFO:tasks.workunit.client.0.smithi096.stdout:2/299: dread d2/d13/f26 [0,4194304] 0 2022-02-02T18:21:25.365 INFO:tasks.workunit.client.0.smithi096.stdout:4/273: dread d3/d4/d14/f1f [0,4194304] 0 2022-02-02T18:21:25.368 INFO:tasks.workunit.client.0.smithi096.stdout:0/374: getdents d2/db/d24/d4d/d54 0 2022-02-02T18:21:25.371 INFO:tasks.workunit.client.0.smithi096.stdout:7/246: dread f7 [0,4194304] 0 2022-02-02T18:21:25.371 INFO:tasks.workunit.client.0.smithi096.stdout:4/274: dread d3/d4/d20/d26/f5e [0,4194304] 0 2022-02-02T18:21:25.371 INFO:tasks.workunit.client.0.smithi096.stdout:4/275: creat d3/d4/d14/f66 x:0 0 0 2022-02-02T18:21:25.372 INFO:tasks.workunit.client.0.smithi096.stdout:2/300: rename d2/d13/d43/d51/c54 to d2/d13/d43/d51/d5d/c60 0 2022-02-02T18:21:25.372 INFO:tasks.workunit.client.0.smithi096.stdout:2/301: chown d2/d6/fa 12 1 2022-02-02T18:21:25.374 INFO:tasks.workunit.client.0.smithi096.stdout:0/375: unlink d2/ff 0 2022-02-02T18:21:25.375 INFO:tasks.workunit.client.0.smithi096.stdout:7/247: creat d9/df/d44/f53 x:0 0 0 2022-02-02T18:21:25.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/276: symlink d3/d4/d20/d26/d36/d51/l67 0 2022-02-02T18:21:25.379 INFO:tasks.workunit.client.0.smithi096.stdout:2/302: symlink d2/d6/d1b/d3a/l61 0 2022-02-02T18:21:25.381 INFO:tasks.workunit.client.0.smithi096.stdout:7/248: mkdir d9/df/d54 0 2022-02-02T18:21:25.381 INFO:tasks.workunit.client.0.smithi096.stdout:4/277: write d3/d4/d14/f2d [1662116,52432] 0 2022-02-02T18:21:25.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/249: chown d9/df/d12/f3f 26 1 2022-02-02T18:21:25.386 INFO:tasks.workunit.client.0.smithi096.stdout:4/278: creat d3/d5a/f68 x:0 0 0 2022-02-02T18:21:25.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/279: chown d3/d27/c52 30805 1 2022-02-02T18:21:25.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/280: write d3/d4/d20/d4d/f5b [2874503,62029] 0 2022-02-02T18:21:25.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/281: write d3/d4/d20/d26/f5e [2203534,30442] 0 2022-02-02T18:21:25.388 INFO:tasks.workunit.client.0.smithi096.stdout:0/376: dread d2/db/fc [0,4194304] 0 2022-02-02T18:21:25.389 INFO:tasks.workunit.client.0.smithi096.stdout:4/282: unlink d3/d4/d14/l18 0 2022-02-02T18:21:25.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/377: rmdir d2/db/d24/d4d/d53 39 2022-02-02T18:21:25.399 INFO:tasks.workunit.client.0.smithi096.stdout:3/276: dwrite d2/df/f26 [4194304,4194304] 0 2022-02-02T18:21:25.399 INFO:tasks.workunit.client.0.smithi096.stdout:4/283: mknod d3/d4/d20/d26/d36/d51/d57/c69 0 2022-02-02T18:21:25.399 INFO:tasks.workunit.client.0.smithi096.stdout:8/226: dwrite f1a [0,4194304] 0 2022-02-02T18:21:25.400 INFO:tasks.workunit.client.0.smithi096.stdout:0/378: mkdir d2/db/d7f 0 2022-02-02T18:21:25.400 INFO:tasks.workunit.client.0.smithi096.stdout:0/379: stat d2/db/d10/d27/f73 0 2022-02-02T18:21:25.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/277: creat d2/df/d20/d4a/f62 x:0 0 0 2022-02-02T18:21:25.401 INFO:tasks.workunit.client.0.smithi096.stdout:4/284: truncate d3/d4/d14/f46 1313532 0 2022-02-02T18:21:25.401 INFO:tasks.workunit.client.0.smithi096.stdout:4/285: chown d3/l15 241742 1 2022-02-02T18:21:25.401 INFO:tasks.workunit.client.0.smithi096.stdout:8/227: symlink d29/l4b 0 2022-02-02T18:21:25.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/286: truncate d3/d27/f39 837890 0 2022-02-02T18:21:25.403 INFO:tasks.workunit.client.0.smithi096.stdout:4/287: dread - d3/d4/d20/d4d/f54 zero size 2022-02-02T18:21:25.405 INFO:tasks.workunit.client.0.smithi096.stdout:3/278: getdents d2/df/d14/d16 0 2022-02-02T18:21:25.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/288: link d3/d27/c52 d3/d5a/c6a 0 2022-02-02T18:21:25.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/289: creat d3/f6b x:0 0 0 2022-02-02T18:21:25.410 INFO:tasks.workunit.client.0.smithi096.stdout:4/290: rename d3/c59 to d3/d4/c6c 0 2022-02-02T18:21:25.411 INFO:tasks.workunit.client.0.smithi096.stdout:3/279: rmdir d2/df/d20/d33 39 2022-02-02T18:21:25.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/291: mknod d3/d60/c6d 0 2022-02-02T18:21:25.412 INFO:tasks.workunit.client.0.smithi096.stdout:8/228: dread d29/d2d/f31 [0,4194304] 0 2022-02-02T18:21:25.413 INFO:tasks.workunit.client.0.smithi096.stdout:8/229: rmdir d29 39 2022-02-02T18:21:25.416 INFO:tasks.workunit.client.0.smithi096.stdout:3/280: dread d2/df/d14/f30 [0,4194304] 0 2022-02-02T18:21:25.417 INFO:tasks.workunit.client.0.smithi096.stdout:4/292: dread d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:25.421 INFO:tasks.workunit.client.0.smithi096.stdout:6/321: dwrite d18/d54/f6a [0,4194304] 0 2022-02-02T18:21:25.421 INFO:tasks.workunit.client.0.smithi096.stdout:3/281: dread d2/df/d14/d16/f23 [0,4194304] 0 2022-02-02T18:21:25.422 INFO:tasks.workunit.client.0.smithi096.stdout:9/318: dwrite d1/d9/d11/d1e/f53 [0,4194304] 0 2022-02-02T18:21:25.422 INFO:tasks.workunit.client.0.smithi096.stdout:2/303: dwrite d2/d6/d1b/f39 [0,4194304] 0 2022-02-02T18:21:25.423 INFO:tasks.workunit.client.0.smithi096.stdout:0/380: dwrite d2/db/d24/d4d/d54/f55 [0,4194304] 0 2022-02-02T18:21:25.429 INFO:tasks.workunit.client.0.smithi096.stdout:6/322: rename cf to d18/d50/c83 0 2022-02-02T18:21:25.431 INFO:tasks.workunit.client.0.smithi096.stdout:4/293: fsync d3/d4/d14/f46 0 2022-02-02T18:21:25.432 INFO:tasks.workunit.client.0.smithi096.stdout:3/282: creat d2/df/d20/d33/f63 x:0 0 0 2022-02-02T18:21:25.435 INFO:tasks.workunit.client.0.smithi096.stdout:8/230: dread d29/d2d/f45 [0,4194304] 0 2022-02-02T18:21:25.437 INFO:tasks.workunit.client.0.smithi096.stdout:0/381: dwrite d2/db/d10/d27/f5b [0,4194304] 0 2022-02-02T18:21:25.446 INFO:tasks.workunit.client.0.smithi096.stdout:2/304: mknod d2/c62 0 2022-02-02T18:21:25.447 INFO:tasks.workunit.client.0.smithi096.stdout:9/319: symlink d1/d9/d11/d1e/d38/d68/d26/l77 0 2022-02-02T18:21:25.448 INFO:tasks.workunit.client.0.smithi096.stdout:6/323: symlink d18/d50/d6d/l84 0 2022-02-02T18:21:25.448 INFO:tasks.workunit.client.0.smithi096.stdout:2/305: write d2/d2a/f45 [3658975,82426] 0 2022-02-02T18:21:25.449 INFO:tasks.workunit.client.0.smithi096.stdout:3/283: dwrite d2/df/d20/f37 [4194304,4194304] 0 2022-02-02T18:21:25.450 INFO:tasks.workunit.client.0.smithi096.stdout:4/294: unlink d3/d4/d20/d26/f5c 0 2022-02-02T18:21:25.451 INFO:tasks.workunit.client.0.smithi096.stdout:6/324: dread d18/d24/f5b [0,4194304] 0 2022-02-02T18:21:25.452 INFO:tasks.workunit.client.0.smithi096.stdout:8/231: mknod d29/d2d/c4c 0 2022-02-02T18:21:25.456 INFO:tasks.workunit.client.0.smithi096.stdout:0/382: mkdir d2/db/d10/d80 0 2022-02-02T18:21:25.456 INFO:tasks.workunit.client.0.smithi096.stdout:0/383: readlink d2/db/d37/l45 0 2022-02-02T18:21:25.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/306: mkdir d2/d6/db/d49/d63 0 2022-02-02T18:21:25.463 INFO:tasks.workunit.client.0.smithi096.stdout:3/284: link d2/df/d34/c3f d2/df/d14/d11/c64 0 2022-02-02T18:21:25.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/295: creat d3/d27/d4a/f6e x:0 0 0 2022-02-02T18:21:25.465 INFO:tasks.workunit.client.0.smithi096.stdout:8/232: mknod d29/d2d/d42/c4d 0 2022-02-02T18:21:25.465 INFO:tasks.workunit.client.0.smithi096.stdout:4/296: read d3/d4/f40 [392660,116763] 0 2022-02-02T18:21:25.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/297: creat d3/d4/d20/d26/f6f x:0 0 0 2022-02-02T18:21:25.467 INFO:tasks.workunit.client.0.smithi096.stdout:0/384: mknod d2/d62/c81 0 2022-02-02T18:21:25.467 INFO:tasks.workunit.client.0.smithi096.stdout:0/385: write d2/db/d10/f2b [550291,72316] 0 2022-02-02T18:21:25.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/325: dwrite d18/f31 [0,4194304] 0 2022-02-02T18:21:25.471 INFO:tasks.workunit.client.0.smithi096.stdout:2/307: truncate d2/d6/d1b/d48/f4d 3543187 0 2022-02-02T18:21:25.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/285: symlink d2/df/d14/d2c/d31/l65 0 2022-02-02T18:21:25.473 INFO:tasks.workunit.client.0.smithi096.stdout:4/298: link d3/d4/d14/c42 d3/c70 0 2022-02-02T18:21:25.475 INFO:tasks.workunit.client.0.smithi096.stdout:0/386: creat d2/d66/d71/f82 x:0 0 0 2022-02-02T18:21:25.477 INFO:tasks.workunit.client.0.smithi096.stdout:6/326: mknod d18/c85 0 2022-02-02T18:21:25.479 INFO:tasks.workunit.client.0.smithi096.stdout:9/320: rename d1/d9 to d1/db/d1c/d2f/d78 0 2022-02-02T18:21:25.480 INFO:tasks.workunit.client.0.smithi096.stdout:2/308: creat d2/d13/f64 x:0 0 0 2022-02-02T18:21:25.482 INFO:tasks.workunit.client.0.smithi096.stdout:6/327: symlink d18/d24/l86 0 2022-02-02T18:21:25.483 INFO:tasks.workunit.client.0.smithi096.stdout:6/328: chown d18/f27 1826111158 1 2022-02-02T18:21:25.484 INFO:tasks.workunit.client.0.smithi096.stdout:4/299: rename d3/d4/d20/d26/d36/c3d to d3/d27/c71 0 2022-02-02T18:21:25.485 INFO:tasks.workunit.client.0.smithi096.stdout:3/286: mkdir d2/df/d14/d66 0 2022-02-02T18:21:25.485 INFO:tasks.workunit.client.0.smithi096.stdout:3/287: fsync d2/df/d1a/f42 0 2022-02-02T18:21:25.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/321: rename d1/db/d48/f71 to d1/db/d1c/d2f/d78/d11/d3c/f79 0 2022-02-02T18:21:25.489 INFO:tasks.workunit.client.0.smithi096.stdout:4/300: truncate d3/d4/d20/d26/d36/f44 370842 0 2022-02-02T18:21:25.491 INFO:tasks.workunit.client.0.smithi096.stdout:8/233: dwrite d29/d2d/f30 [4194304,4194304] 0 2022-02-02T18:21:25.492 INFO:tasks.workunit.client.0.smithi096.stdout:2/309: rename d2/d6/d1b/d48/c5a to d2/d6/d1b/c65 0 2022-02-02T18:21:25.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/288: creat d2/df/d20/d33/d58/f67 x:0 0 0 2022-02-02T18:21:25.493 INFO:tasks.workunit.client.0.smithi096.stdout:9/322: truncate d1/db/d1c/d2f/d78/d25/dd/f5d 1647786 0 2022-02-02T18:21:25.494 INFO:tasks.workunit.client.0.smithi096.stdout:9/323: chown d1/db/d1c/d2f/d78/d25/dd/c16 35415 1 2022-02-02T18:21:25.496 INFO:tasks.workunit.client.0.smithi096.stdout:2/310: getdents d2/d13/d43/d51 0 2022-02-02T18:21:25.496 INFO:tasks.workunit.client.0.smithi096.stdout:2/311: fsync d2/f24 0 2022-02-02T18:21:25.497 INFO:tasks.workunit.client.0.smithi096.stdout:9/324: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26 39 2022-02-02T18:21:25.497 INFO:tasks.workunit.client.0.smithi096.stdout:9/325: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l52 1465312 1 2022-02-02T18:21:25.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/326: chown d1/f36 203635706 1 2022-02-02T18:21:25.498 INFO:tasks.workunit.client.0.smithi096.stdout:2/312: mkdir d2/d6/db/d49/d66 0 2022-02-02T18:21:25.499 INFO:tasks.workunit.client.0.smithi096.stdout:9/327: symlink d1/db/d1c/d2f/d78/l7a 0 2022-02-02T18:21:25.504 INFO:tasks.workunit.client.0.smithi096.stdout:9/328: rename d1/db/f6b to d1/db/d1c/d2f/d78/d11/d1e/d38/f7b 0 2022-02-02T18:21:25.504 INFO:tasks.workunit.client.0.smithi096.stdout:9/329: readlink d1/db/d1c/d2f/d78/l7a 0 2022-02-02T18:21:25.504 INFO:tasks.workunit.client.0.smithi096.stdout:9/330: write d1/db/d1c/d2f/d78/d11/d1e/f31 [181596,29569] 0 2022-02-02T18:21:25.506 INFO:tasks.workunit.client.0.smithi096.stdout:9/331: creat d1/db/d48/d69/f7c x:0 0 0 2022-02-02T18:21:25.507 INFO:tasks.workunit.client.0.smithi096.stdout:9/332: rename d1/db/d1c/d2f/d78/d11/d1e/d38/c35 to d1/db/d1c/d2f/d78/d11/d3c/c7d 0 2022-02-02T18:21:25.509 INFO:tasks.workunit.client.0.smithi096.stdout:9/333: symlink d1/db/d1c/d2f/d78/d11/d1e/d47/d50/l7e 0 2022-02-02T18:21:25.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/387: dwrite d2/d66/d71/f82 [0,4194304] 0 2022-02-02T18:21:25.511 INFO:tasks.workunit.client.0.smithi096.stdout:9/334: getdents d1/db/d1c/d2f/d78/d11 0 2022-02-02T18:21:25.515 INFO:tasks.workunit.client.0.smithi096.stdout:9/335: creat d1/db/d1c/d2f/d78/d11/d1e/d38/f7f x:0 0 0 2022-02-02T18:21:25.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/301: getdents d3 0 2022-02-02T18:21:25.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/302: write d3/d27/f30 [3364277,105397] 0 2022-02-02T18:21:25.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/303: readlink d3/d4/l2c 0 2022-02-02T18:21:25.519 INFO:tasks.workunit.client.0.smithi096.stdout:4/304: truncate d3/f5d 94362 0 2022-02-02T18:21:25.519 INFO:tasks.workunit.client.0.smithi096.stdout:9/336: write d1/f6 [7472863,40612] 0 2022-02-02T18:21:25.520 INFO:tasks.workunit.client.0.smithi096.stdout:4/305: creat d3/f72 x:0 0 0 2022-02-02T18:21:25.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/306: fdatasync d3/d4/d14/f4b 0 2022-02-02T18:21:25.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/307: truncate d3/d4/d20/d26/d36/d51/f53 1277031 0 2022-02-02T18:21:25.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/308: chown d3/d4/d20/d26/d36/d51/l67 224105597 1 2022-02-02T18:21:25.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/337: link d1/db/d48/d69/f7c d1/db/d63/f80 0 2022-02-02T18:21:25.524 INFO:tasks.workunit.client.0.smithi096.stdout:4/309: mknod d3/d4/d14/c73 0 2022-02-02T18:21:25.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/234: dwrite d29/d40/f49 [0,4194304] 0 2022-02-02T18:21:25.526 INFO:tasks.workunit.client.0.smithi096.stdout:6/329: dwrite d18/d24/d28/d3e/f42 [0,4194304] 0 2022-02-02T18:21:25.526 INFO:tasks.workunit.client.0.smithi096.stdout:2/313: dwrite d2/d6/db/d49/f1d [0,4194304] 0 2022-02-02T18:21:25.527 INFO:tasks.workunit.client.0.smithi096.stdout:4/310: mknod d3/d4/d20/d26/d36/d51/c74 0 2022-02-02T18:21:25.528 INFO:tasks.workunit.client.0.smithi096.stdout:6/330: dread d18/d24/d28/d3e/f62 [0,4194304] 0 2022-02-02T18:21:25.528 INFO:tasks.workunit.client.0.smithi096.stdout:6/331: stat ld 0 2022-02-02T18:21:25.529 INFO:tasks.workunit.client.0.smithi096.stdout:6/332: creat d18/d24/d28/f87 x:0 0 0 2022-02-02T18:21:25.531 INFO:tasks.workunit.client.0.smithi096.stdout:3/289: dwrite d2/f4e [0,4194304] 0 2022-02-02T18:21:25.531 INFO:tasks.workunit.client.0.smithi096.stdout:3/290: chown d2/df/d20/d33/f51 0 1 2022-02-02T18:21:25.532 INFO:tasks.workunit.client.0.smithi096.stdout:3/291: creat d2/df/d36/f68 x:0 0 0 2022-02-02T18:21:25.534 INFO:tasks.workunit.client.0.smithi096.stdout:4/311: rename d3/d4/d20/d26/f6f to d3/d4/d14/f75 0 2022-02-02T18:21:25.534 INFO:tasks.workunit.client.0.smithi096.stdout:0/388: dwrite d2/d66/d71/f82 [0,4194304] 0 2022-02-02T18:21:25.536 INFO:tasks.workunit.client.0.smithi096.stdout:6/333: creat d18/d50/f88 x:0 0 0 2022-02-02T18:21:25.541 INFO:tasks.workunit.client.0.smithi096.stdout:9/338: dread d1/db/d1c/d2f/d78/d11/d1e/f31 [0,4194304] 0 2022-02-02T18:21:25.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/235: dwrite d29/f3c [0,4194304] 0 2022-02-02T18:21:25.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/236: chown d29 3677 1 2022-02-02T18:21:25.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/237: read fc [11068774,23089] 0 2022-02-02T18:21:25.554 INFO:tasks.workunit.client.0.smithi096.stdout:1/281: sync 2022-02-02T18:21:25.556 INFO:tasks.workunit.client.0.smithi096.stdout:4/312: link d3/d4/d14/f75 d3/d4/d20/f76 0 2022-02-02T18:21:25.556 INFO:tasks.workunit.client.0.smithi096.stdout:4/313: chown d3/d4/d14/f46 9239 1 2022-02-02T18:21:25.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/389: symlink d2/db/d10/l83 0 2022-02-02T18:21:25.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/334: symlink d18/l89 0 2022-02-02T18:21:25.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/390: creat d2/db/f84 x:0 0 0 2022-02-02T18:21:25.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/391: truncate d2/db/d10/d27/f73 275519 0 2022-02-02T18:21:25.560 INFO:tasks.workunit.client.0.smithi096.stdout:6/335: read d18/f19 [6504141,105195] 0 2022-02-02T18:21:25.560 INFO:tasks.workunit.client.0.smithi096.stdout:6/336: read d18/d54/f39 [592765,62435] 0 2022-02-02T18:21:25.562 INFO:tasks.workunit.client.0.smithi096.stdout:0/392: symlink d2/db/d10/d80/l85 0 2022-02-02T18:21:25.563 INFO:tasks.workunit.client.0.smithi096.stdout:0/393: chown d2/d1e/l23 22 1 2022-02-02T18:21:25.564 INFO:tasks.workunit.client.0.smithi096.stdout:6/337: link d18/f49 d18/f8a 0 2022-02-02T18:21:25.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/238: dwrite d29/f34 [0,4194304] 0 2022-02-02T18:21:25.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/239: write d29/f2b [46038,85200] 0 2022-02-02T18:21:25.566 INFO:tasks.workunit.client.0.smithi096.stdout:3/292: rename d2/df/d1a to d2/df/d1c/d5d/d69 0 2022-02-02T18:21:25.566 INFO:tasks.workunit.client.0.smithi096.stdout:3/293: write d2/df/d1c/d5d/d69/f55 [959021,101593] 0 2022-02-02T18:21:25.566 INFO:tasks.workunit.client.0.smithi096.stdout:5/264: sync 2022-02-02T18:21:25.567 INFO:tasks.workunit.client.0.smithi096.stdout:5/265: stat db/lc 0 2022-02-02T18:21:25.570 INFO:tasks.workunit.client.0.smithi096.stdout:1/282: dwrite d15/d1b/d28/d47/f53 [0,4194304] 0 2022-02-02T18:21:25.573 INFO:tasks.workunit.client.0.smithi096.stdout:6/338: mknod d18/d54/c8b 0 2022-02-02T18:21:25.574 INFO:tasks.workunit.client.0.smithi096.stdout:8/240: mkdir d29/d4e 0 2022-02-02T18:21:25.579 INFO:tasks.workunit.client.0.smithi096.stdout:4/314: rename d3/d4/c1b to d3/d4/d20/d26/c77 0 2022-02-02T18:21:25.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/315: creat d3/d27/f78 x:0 0 0 2022-02-02T18:21:25.580 INFO:tasks.workunit.client.0.smithi096.stdout:7/250: sync 2022-02-02T18:21:25.581 INFO:tasks.workunit.client.0.smithi096.stdout:3/294: rmdir d2/df/d14/d11/d5c 0 2022-02-02T18:21:25.583 INFO:tasks.workunit.client.0.smithi096.stdout:1/283: symlink d15/l68 0 2022-02-02T18:21:25.584 INFO:tasks.workunit.client.0.smithi096.stdout:8/241: unlink d29/d2d/f38 0 2022-02-02T18:21:25.587 INFO:tasks.workunit.client.0.smithi096.stdout:3/295: write d2/df/d14/f12 [7687956,50762] 0 2022-02-02T18:21:25.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/394: dwrite d2/db/d10/f16 [0,4194304] 0 2022-02-02T18:21:25.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/251: link d9/df/d47/d19/f35 d9/df/d16/d25/f55 0 2022-02-02T18:21:25.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/252: write d9/df/d12/f3f [818293,95151] 0 2022-02-02T18:21:25.589 INFO:tasks.workunit.client.0.smithi096.stdout:8/242: mknod d29/d40/c4f 0 2022-02-02T18:21:25.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/316: rmdir d3/d4/d14 39 2022-02-02T18:21:25.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/317: write d3/d27/d4a/f6e [711311,80181] 0 2022-02-02T18:21:25.592 INFO:tasks.workunit.client.0.smithi096.stdout:0/395: mknod d2/db/d24/d4d/d53/c86 0 2022-02-02T18:21:25.592 INFO:tasks.workunit.client.0.smithi096.stdout:7/253: mknod d9/df/d12/d39/d46/c56 0 2022-02-02T18:21:25.593 INFO:tasks.workunit.client.0.smithi096.stdout:0/396: dread d2/db/d10/d27/f2d [0,4194304] 0 2022-02-02T18:21:25.593 INFO:tasks.workunit.client.0.smithi096.stdout:1/284: getdents d15/d1b/d28/d2c 0 2022-02-02T18:21:25.593 INFO:tasks.workunit.client.0.smithi096.stdout:1/285: fsync d15/d1b/d28/d2c/f4c 0 2022-02-02T18:21:25.594 INFO:tasks.workunit.client.0.smithi096.stdout:8/243: symlink d29/d40/l50 0 2022-02-02T18:21:25.595 INFO:tasks.workunit.client.0.smithi096.stdout:4/318: creat d3/d60/f79 x:0 0 0 2022-02-02T18:21:25.595 INFO:tasks.workunit.client.0.smithi096.stdout:5/266: dwrite db/d20/f29 [0,4194304] 0 2022-02-02T18:21:25.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/254: creat d9/df/d12/f57 x:0 0 0 2022-02-02T18:21:25.596 INFO:tasks.workunit.client.0.smithi096.stdout:0/397: mknod d2/d1e/d67/c87 0 2022-02-02T18:21:25.597 INFO:tasks.workunit.client.0.smithi096.stdout:6/339: dwrite d18/d24/d28/d3e/f5f [0,4194304] 0 2022-02-02T18:21:25.598 INFO:tasks.workunit.client.0.smithi096.stdout:1/286: link c12 d15/d1b/d26/c69 0 2022-02-02T18:21:25.598 INFO:tasks.workunit.client.0.smithi096.stdout:1/287: chown d15/d1b/d26/l33 62 1 2022-02-02T18:21:25.598 INFO:tasks.workunit.client.0.smithi096.stdout:1/288: chown d15/d1b/d28/d2c/d4f/c52 8157183 1 2022-02-02T18:21:25.599 INFO:tasks.workunit.client.0.smithi096.stdout:1/289: fdatasync d15/f27 0 2022-02-02T18:21:25.599 INFO:tasks.workunit.client.0.smithi096.stdout:1/290: stat d15/d1b/d26/f42 0 2022-02-02T18:21:25.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/267: read db/f1b [3496275,54893] 0 2022-02-02T18:21:25.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/268: truncate db/de/d10/d27/f2b 1527683 0 2022-02-02T18:21:25.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/269: creat db/de/d10/d25/d4c/f65 x:0 0 0 2022-02-02T18:21:25.600 INFO:tasks.workunit.client.0.smithi096.stdout:8/244: truncate d29/f33 7987532 0 2022-02-02T18:21:25.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/270: dread db/de/d2e/f3e [0,4194304] 0 2022-02-02T18:21:25.601 INFO:tasks.workunit.client.0.smithi096.stdout:4/319: rename d3/d4/d14/c3e to d3/c7a 0 2022-02-02T18:21:25.601 INFO:tasks.workunit.client.0.smithi096.stdout:4/320: dread - d3/d4/d20/d4d/f54 zero size 2022-02-02T18:21:25.602 INFO:tasks.workunit.client.0.smithi096.stdout:8/245: write f22 [1700946,115949] 0 2022-02-02T18:21:25.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/255: dread d9/df/d47/d37/f3d [4194304,4194304] 0 2022-02-02T18:21:25.603 INFO:tasks.workunit.client.0.smithi096.stdout:7/256: dread - d9/df/d16/d25/f55 zero size 2022-02-02T18:21:25.603 INFO:tasks.workunit.client.0.smithi096.stdout:8/246: read d29/d2d/f32 [462821,93706] 0 2022-02-02T18:21:25.612 INFO:tasks.workunit.client.0.smithi096.stdout:0/398: dwrite d2/db/d10/f4a [0,4194304] 0 2022-02-02T18:21:25.612 INFO:tasks.workunit.client.0.smithi096.stdout:3/296: dread d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:25.613 INFO:tasks.workunit.client.0.smithi096.stdout:6/340: unlink d18/d24/d28/l38 0 2022-02-02T18:21:25.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/257: dread d9/df/d16/f28 [4194304,4194304] 0 2022-02-02T18:21:25.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/258: dread - d9/df/d12/d39/d42/f4d zero size 2022-02-02T18:21:25.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/341: dread d18/d54/f39 [0,4194304] 0 2022-02-02T18:21:25.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/291: mknod d15/d1b/d28/d2c/c6a 0 2022-02-02T18:21:25.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/292: fdatasync d15/d1b/d28/f3e 0 2022-02-02T18:21:25.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/321: mknod d3/d4/d20/d26/d36/c7b 0 2022-02-02T18:21:25.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/247: rmdir d29/d2d/d42 39 2022-02-02T18:21:25.628 INFO:tasks.workunit.client.0.smithi096.stdout:0/399: rename d2/db/d24/d4d/c57 to d2/db/d24/d4d/d54/c88 0 2022-02-02T18:21:25.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/297: link d2/df/d14/d16/l38 d2/df/d20/d33/l6a 0 2022-02-02T18:21:25.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/259: symlink d9/df/d54/l58 0 2022-02-02T18:21:25.632 INFO:tasks.workunit.client.0.smithi096.stdout:6/342: unlink d18/l20 0 2022-02-02T18:21:25.633 INFO:tasks.workunit.client.0.smithi096.stdout:4/322: dwrite d3/d4/d14/f66 [0,4194304] 0 2022-02-02T18:21:25.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/293: mkdir d15/d1b/d28/d2c/d39/d6b 0 2022-02-02T18:21:25.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/294: read d15/d1b/d26/f49 [2898139,18648] 0 2022-02-02T18:21:25.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/295: write d15/f2a [4473969,130314] 0 2022-02-02T18:21:25.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/296: dread - d15/d1b/d28/d47/f5c zero size 2022-02-02T18:21:25.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/297: stat d15/d1b/d28/d47/f53 0 2022-02-02T18:21:25.637 INFO:tasks.workunit.client.0.smithi096.stdout:8/248: creat d29/d2d/d42/f51 x:0 0 0 2022-02-02T18:21:25.637 INFO:tasks.workunit.client.0.smithi096.stdout:0/400: mkdir d2/db/d24/d89 0 2022-02-02T18:21:25.637 INFO:tasks.workunit.client.0.smithi096.stdout:0/401: chown d2/db/d10/d80 1003 1 2022-02-02T18:21:25.637 INFO:tasks.workunit.client.0.smithi096.stdout:0/402: fsync d2/fa 0 2022-02-02T18:21:25.638 INFO:tasks.workunit.client.0.smithi096.stdout:0/403: chown d2/db/d37 43047 1 2022-02-02T18:21:25.641 INFO:tasks.workunit.client.0.smithi096.stdout:4/323: unlink d3/d27/l4c 0 2022-02-02T18:21:25.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/343: dread d18/f1a [0,4194304] 0 2022-02-02T18:21:25.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/344: fsync d18/f31 0 2022-02-02T18:21:25.643 INFO:tasks.workunit.client.0.smithi096.stdout:4/324: write d3/d27/f13 [505083,6777] 0 2022-02-02T18:21:25.644 INFO:tasks.workunit.client.0.smithi096.stdout:8/249: stat l27 0 2022-02-02T18:21:25.649 INFO:tasks.workunit.client.0.smithi096.stdout:4/325: mknod d3/d27/c7c 0 2022-02-02T18:21:25.649 INFO:tasks.workunit.client.0.smithi096.stdout:0/404: unlink d2/db/d10/f18 0 2022-02-02T18:21:25.650 INFO:tasks.workunit.client.0.smithi096.stdout:4/326: chown d3/d4/d20/d26/d36/c7b 21225 1 2022-02-02T18:21:25.650 INFO:tasks.workunit.client.0.smithi096.stdout:8/250: symlink d29/d2d/d42/l52 0 2022-02-02T18:21:25.650 INFO:tasks.workunit.client.0.smithi096.stdout:8/251: write d29/f3a [272862,47976] 0 2022-02-02T18:21:25.650 INFO:tasks.workunit.client.0.smithi096.stdout:8/252: truncate d29/d2d/f3d 880529 0 2022-02-02T18:21:25.651 INFO:tasks.workunit.client.0.smithi096.stdout:8/253: fsync f1a 0 2022-02-02T18:21:25.652 INFO:tasks.workunit.client.0.smithi096.stdout:8/254: dread d29/d2d/f3d [0,4194304] 0 2022-02-02T18:21:25.652 INFO:tasks.workunit.client.0.smithi096.stdout:8/255: chown f23 1143 1 2022-02-02T18:21:25.652 INFO:tasks.workunit.client.0.smithi096.stdout:1/298: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:25.653 INFO:tasks.workunit.client.0.smithi096.stdout:1/299: fsync d15/d1b/d26/f31 0 2022-02-02T18:21:25.653 INFO:tasks.workunit.client.0.smithi096.stdout:4/327: write d3/d27/f41 [1362524,35970] 0 2022-02-02T18:21:25.653 INFO:tasks.workunit.client.0.smithi096.stdout:4/328: chown d3/d5a/c6a 1868 1 2022-02-02T18:21:25.654 INFO:tasks.workunit.client.0.smithi096.stdout:4/329: creat d3/d4/d14/d55/f7d x:0 0 0 2022-02-02T18:21:25.654 INFO:tasks.workunit.client.0.smithi096.stdout:3/298: dwrite d2/df/d20/f5b [0,4194304] 0 2022-02-02T18:21:25.655 INFO:tasks.workunit.client.0.smithi096.stdout:8/256: truncate f21 3142523 0 2022-02-02T18:21:25.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/300: getdents d15/d1b/d28 0 2022-02-02T18:21:25.658 INFO:tasks.workunit.client.0.smithi096.stdout:4/330: rename d3/d27/c3b to d3/d27/d4a/c7e 0 2022-02-02T18:21:25.660 INFO:tasks.workunit.client.0.smithi096.stdout:3/299: mknod d2/df/d1c/d5d/c6b 0 2022-02-02T18:21:25.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/300: chown d2/df/d14/d16/l38 13496 1 2022-02-02T18:21:25.661 INFO:tasks.workunit.client.0.smithi096.stdout:1/301: dread d15/d1b/d28/d47/f63 [0,4194304] 0 2022-02-02T18:21:25.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/257: chown c16 79192051 1 2022-02-02T18:21:25.662 INFO:tasks.workunit.client.0.smithi096.stdout:6/345: dwrite d18/f31 [0,4194304] 0 2022-02-02T18:21:25.662 INFO:tasks.workunit.client.0.smithi096.stdout:6/346: dread - d18/d24/d28/f87 zero size 2022-02-02T18:21:25.663 INFO:tasks.workunit.client.0.smithi096.stdout:3/301: unlink d2/f1d 0 2022-02-02T18:21:25.663 INFO:tasks.workunit.client.0.smithi096.stdout:1/302: mknod d15/d4d/c6c 0 2022-02-02T18:21:25.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/260: dwrite d9/df/d47/d19/f27 [0,4194304] 0 2022-02-02T18:21:25.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/261: creat d9/df/d12/d39/d40/d51/f59 x:0 0 0 2022-02-02T18:21:25.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/262: write d9/df/d16/d25/f55 [253218,16093] 0 2022-02-02T18:21:25.666 INFO:tasks.workunit.client.0.smithi096.stdout:1/303: mknod d15/d1b/d28/d2c/d39/d6b/c6d 0 2022-02-02T18:21:25.667 INFO:tasks.workunit.client.0.smithi096.stdout:1/304: fdatasync d15/f3b 0 2022-02-02T18:21:25.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/302: dread d2/df/d1c/d5d/d69/f55 [0,4194304] 0 2022-02-02T18:21:25.667 INFO:tasks.workunit.client.0.smithi096.stdout:1/305: write d15/f27 [3228642,57542] 0 2022-02-02T18:21:25.668 INFO:tasks.workunit.client.0.smithi096.stdout:8/258: unlink l11 0 2022-02-02T18:21:25.668 INFO:tasks.workunit.client.0.smithi096.stdout:8/259: write d29/d2d/d42/f51 [263265,20286] 0 2022-02-02T18:21:25.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/347: getdents d18/d54 0 2022-02-02T18:21:25.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/348: chown d18/d54/f3b 642930 1 2022-02-02T18:21:25.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/349: write d18/d24/f33 [3027160,65326] 0 2022-02-02T18:21:25.670 INFO:tasks.workunit.client.0.smithi096.stdout:6/350: chown d18/d24/f2d 2005737 1 2022-02-02T18:21:25.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/260: write f22 [2011059,31780] 0 2022-02-02T18:21:25.675 INFO:tasks.workunit.client.0.smithi096.stdout:4/331: getdents d3/d27 0 2022-02-02T18:21:25.675 INFO:tasks.workunit.client.0.smithi096.stdout:4/332: fsync d3/f72 0 2022-02-02T18:21:25.682 INFO:tasks.workunit.client.0.smithi096.stdout:7/263: rename f7 to d9/df/d12/d39/d42/f5a 0 2022-02-02T18:21:25.682 INFO:tasks.workunit.client.0.smithi096.stdout:7/264: creat d9/df/d12/d39/d42/f5b x:0 0 0 2022-02-02T18:21:25.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/306: dwrite d15/f2e [0,4194304] 0 2022-02-02T18:21:25.685 INFO:tasks.workunit.client.0.smithi096.stdout:3/303: link d2/df/d14/l5f d2/df/d1c/l6c 0 2022-02-02T18:21:25.685 INFO:tasks.workunit.client.0.smithi096.stdout:3/304: fsync d2/df/d14/d16/f23 0 2022-02-02T18:21:25.690 INFO:tasks.workunit.client.0.smithi096.stdout:4/333: rename d3/d4/d14/c35 to d3/d4/d20/d26/d36/d51/c7f 0 2022-02-02T18:21:25.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/334: chown d3/d4/d20/d26/d36/d51/c7f 23 1 2022-02-02T18:21:25.694 INFO:tasks.workunit.client.0.smithi096.stdout:9/339: sync 2022-02-02T18:21:25.694 INFO:tasks.workunit.client.0.smithi096.stdout:2/314: sync 2022-02-02T18:21:25.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/340: chown d1/db/d1c/d2f/f51 1239529 1 2022-02-02T18:21:25.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/341: fsync d1/db/d1c/d2f/d78/d11/d3c/f41 0 2022-02-02T18:21:25.695 INFO:tasks.workunit.client.0.smithi096.stdout:6/351: dwrite d18/d54/f39 [0,4194304] 0 2022-02-02T18:21:25.696 INFO:tasks.workunit.client.0.smithi096.stdout:6/352: stat d18/d54/f43 0 2022-02-02T18:21:25.696 INFO:tasks.workunit.client.0.smithi096.stdout:3/305: mkdir d2/df/d1c/d5d/d6d 0 2022-02-02T18:21:25.698 INFO:tasks.workunit.client.0.smithi096.stdout:8/261: rmdir d29/d2d/d42 39 2022-02-02T18:21:25.701 INFO:tasks.workunit.client.0.smithi096.stdout:5/271: sync 2022-02-02T18:21:25.701 INFO:tasks.workunit.client.0.smithi096.stdout:5/272: write db/de/d10/d25/f45 [107460,72242] 0 2022-02-02T18:21:25.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/273: stat db/de/d10/c48 0 2022-02-02T18:21:25.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/274: chown db/de/d10/d27/c3c 32702389 1 2022-02-02T18:21:25.703 INFO:tasks.workunit.client.0.smithi096.stdout:4/335: mknod d3/d4/d20/d26/d36/d51/c80 0 2022-02-02T18:21:25.705 INFO:tasks.workunit.client.0.smithi096.stdout:2/315: mknod d2/d6/db/d49/d66/c67 0 2022-02-02T18:21:25.705 INFO:tasks.workunit.client.0.smithi096.stdout:2/316: chown d2/d6 436110 1 2022-02-02T18:21:25.705 INFO:tasks.workunit.client.0.smithi096.stdout:2/317: write d2/d13/d43/f47 [1769699,92724] 0 2022-02-02T18:21:25.706 INFO:tasks.workunit.client.0.smithi096.stdout:9/342: mknod d1/db/d1c/d2f/d78/c81 0 2022-02-02T18:21:25.707 INFO:tasks.workunit.client.0.smithi096.stdout:6/353: mknod d18/d54/c8c 0 2022-02-02T18:21:25.707 INFO:tasks.workunit.client.0.smithi096.stdout:6/354: write d18/d50/f51 [1287392,7152] 0 2022-02-02T18:21:25.708 INFO:tasks.workunit.client.0.smithi096.stdout:6/355: creat d18/d54/d63/f8d x:0 0 0 2022-02-02T18:21:25.708 INFO:tasks.workunit.client.0.smithi096.stdout:5/275: symlink db/l66 0 2022-02-02T18:21:25.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/318: truncate d2/d6/db/f38 3504221 0 2022-02-02T18:21:25.710 INFO:tasks.workunit.client.0.smithi096.stdout:9/343: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/c82 0 2022-02-02T18:21:25.710 INFO:tasks.workunit.client.0.smithi096.stdout:4/336: dread d3/d4/d14/f29 [0,4194304] 0 2022-02-02T18:21:25.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/262: dread d29/d2d/f48 [0,4194304] 0 2022-02-02T18:21:25.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/263: truncate d29/d2d/f2e 932703 0 2022-02-02T18:21:25.713 INFO:tasks.workunit.client.0.smithi096.stdout:6/356: creat d18/d24/f8e x:0 0 0 2022-02-02T18:21:25.714 INFO:tasks.workunit.client.0.smithi096.stdout:7/265: dwrite d9/df/d12/d39/d40/d51/f59 [0,4194304] 0 2022-02-02T18:21:25.715 INFO:tasks.workunit.client.0.smithi096.stdout:2/319: creat d2/d6/db/d49/d66/f68 x:0 0 0 2022-02-02T18:21:25.715 INFO:tasks.workunit.client.0.smithi096.stdout:2/320: write d2/d13/d43/f47 [2560250,3241] 0 2022-02-02T18:21:25.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/344: link d1/db/d63/f80 d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f83 0 2022-02-02T18:21:25.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/345: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [4689868,106684] 0 2022-02-02T18:21:25.717 INFO:tasks.workunit.client.0.smithi096.stdout:2/321: write d2/d19/f1c [131012,29190] 0 2022-02-02T18:21:25.717 INFO:tasks.workunit.client.0.smithi096.stdout:6/357: mkdir d18/d50/d8f 0 2022-02-02T18:21:25.722 INFO:tasks.workunit.client.0.smithi096.stdout:2/322: creat d2/d13/d43/d51/f69 x:0 0 0 2022-02-02T18:21:25.724 INFO:tasks.workunit.client.0.smithi096.stdout:1/307: dwrite d15/d1b/d28/d47/f63 [0,4194304] 0 2022-02-02T18:21:25.734 INFO:tasks.workunit.client.0.smithi096.stdout:2/323: dread f1 [0,4194304] 0 2022-02-02T18:21:25.735 INFO:tasks.workunit.client.0.smithi096.stdout:3/306: dwrite d2/df/d1c/d5d/d69/f42 [0,4194304] 0 2022-02-02T18:21:25.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/346: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f5b [0,4194304] 0 2022-02-02T18:21:25.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/347: creat d1/db/d1c/f84 x:0 0 0 2022-02-02T18:21:25.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/358: read d18/d54/f6a [3510650,15715] 0 2022-02-02T18:21:25.737 INFO:tasks.workunit.client.0.smithi096.stdout:2/324: creat d2/d6/db/d49/f6a x:0 0 0 2022-02-02T18:21:25.737 INFO:tasks.workunit.client.0.smithi096.stdout:5/276: dwrite db/de/d10/d27/f42 [0,4194304] 0 2022-02-02T18:21:25.738 INFO:tasks.workunit.client.0.smithi096.stdout:5/277: write db/d5c/d2f/f3d [903915,41958] 0 2022-02-02T18:21:25.738 INFO:tasks.workunit.client.0.smithi096.stdout:3/307: mknod d2/df/c6e 0 2022-02-02T18:21:25.740 INFO:tasks.workunit.client.0.smithi096.stdout:6/359: write d18/d24/d28/d3e/f41 [1926246,76689] 0 2022-02-02T18:21:25.741 INFO:tasks.workunit.client.0.smithi096.stdout:9/348: symlink d1/db/d1c/d2f/d78/d25/dd/l85 0 2022-02-02T18:21:25.747 INFO:tasks.workunit.client.0.smithi096.stdout:5/278: link db/de/d10/d27/c3c db/de/d10/d25/c67 0 2022-02-02T18:21:25.749 INFO:tasks.workunit.client.0.smithi096.stdout:6/360: unlink d18/d54/l32 0 2022-02-02T18:21:25.750 INFO:tasks.workunit.client.0.smithi096.stdout:6/361: chown d18/d24/d28/c3d 1 1 2022-02-02T18:21:25.751 INFO:tasks.workunit.client.0.smithi096.stdout:9/349: rename d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f3f to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f86 0 2022-02-02T18:21:25.752 INFO:tasks.workunit.client.0.smithi096.stdout:5/279: mknod db/de/d10/d27/c68 0 2022-02-02T18:21:25.753 INFO:tasks.workunit.client.0.smithi096.stdout:6/362: symlink d18/d50/d6d/l90 0 2022-02-02T18:21:25.755 INFO:tasks.workunit.client.0.smithi096.stdout:9/350: rmdir d1/db/d48/d69 39 2022-02-02T18:21:25.755 INFO:tasks.workunit.client.0.smithi096.stdout:9/351: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f74 zero size 2022-02-02T18:21:25.761 INFO:tasks.workunit.client.0.smithi096.stdout:3/308: dread d2/df/f26 [4194304,4194304] 0 2022-02-02T18:21:25.763 INFO:tasks.workunit.client.0.smithi096.stdout:3/309: mknod d2/df/d14/d66/c6f 0 2022-02-02T18:21:25.766 INFO:tasks.workunit.client.0.smithi096.stdout:8/264: dwrite f1f [0,4194304] 0 2022-02-02T18:21:25.767 INFO:tasks.workunit.client.0.smithi096.stdout:8/265: fsync d29/d2d/f37 0 2022-02-02T18:21:25.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/337: dwrite d3/d4/f40 [0,4194304] 0 2022-02-02T18:21:25.767 INFO:tasks.workunit.client.0.smithi096.stdout:2/325: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:25.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/310: rename d2/df/d14/d11/l19 to d2/df/d14/l70 0 2022-02-02T18:21:25.770 INFO:tasks.workunit.client.0.smithi096.stdout:7/266: dwrite d9/df/d16/f28 [8388608,4194304] 0 2022-02-02T18:21:25.770 INFO:tasks.workunit.client.0.smithi096.stdout:1/308: dwrite d15/d4d/f65 [0,4194304] 0 2022-02-02T18:21:25.771 INFO:tasks.workunit.client.0.smithi096.stdout:5/280: dread db/de/d10/f15 [0,4194304] 0 2022-02-02T18:21:25.771 INFO:tasks.workunit.client.0.smithi096.stdout:1/309: stat d15/c1e 0 2022-02-02T18:21:25.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/326: rename d2/d6/d1b/d48/l4e to d2/d6/d1b/d3a/l6b 0 2022-02-02T18:21:25.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/311: mkdir d2/d71 0 2022-02-02T18:21:25.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/352: dwrite d1/db/d1c/f64 [0,4194304] 0 2022-02-02T18:21:25.782 INFO:tasks.workunit.client.0.smithi096.stdout:7/267: truncate f2 2459290 0 2022-02-02T18:21:25.782 INFO:tasks.workunit.client.0.smithi096.stdout:7/268: write d9/df/f10 [4325553,87354] 0 2022-02-02T18:21:25.783 INFO:tasks.workunit.client.0.smithi096.stdout:1/310: creat d15/d1b/f6e x:0 0 0 2022-02-02T18:21:25.784 INFO:tasks.workunit.client.0.smithi096.stdout:1/311: stat d15/d1b/d26/c5b 0 2022-02-02T18:21:25.784 INFO:tasks.workunit.client.0.smithi096.stdout:2/327: symlink d2/d29/d5f/l6c 0 2022-02-02T18:21:25.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/328: stat d2/d6/d1b/d3a/f44 0 2022-02-02T18:21:25.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/329: write d2/d13/d43/d51/f69 [312054,124419] 0 2022-02-02T18:21:25.785 INFO:tasks.workunit.client.0.smithi096.stdout:3/312: mkdir d2/df/d1c/d5d/d69/d43/d72 0 2022-02-02T18:21:25.785 INFO:tasks.workunit.client.0.smithi096.stdout:3/313: fdatasync d2/df/d1c/d5d/f48 0 2022-02-02T18:21:25.789 INFO:tasks.workunit.client.0.smithi096.stdout:2/330: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:25.789 INFO:tasks.workunit.client.0.smithi096.stdout:2/331: chown d2/d13/d43/d51 1510 1 2022-02-02T18:21:25.789 INFO:tasks.workunit.client.0.smithi096.stdout:2/332: fdatasync d2/d6/db/f27 0 2022-02-02T18:21:25.790 INFO:tasks.workunit.client.0.smithi096.stdout:6/363: dread d18/f19 [0,4194304] 0 2022-02-02T18:21:25.790 INFO:tasks.workunit.client.0.smithi096.stdout:6/364: fsync d18/d50/f7a 0 2022-02-02T18:21:25.791 INFO:tasks.workunit.client.0.smithi096.stdout:6/365: unlink d18/l2b 0 2022-02-02T18:21:25.791 INFO:tasks.workunit.client.0.smithi096.stdout:9/353: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/l77 0 2022-02-02T18:21:25.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/333: unlink d2/f2f 0 2022-02-02T18:21:25.799 INFO:tasks.workunit.client.0.smithi096.stdout:7/269: link d9/df/c1b d9/df/d12/d39/d46/c5c 0 2022-02-02T18:21:25.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/334: write d2/d6/db/d49/f6a [649617,73640] 0 2022-02-02T18:21:25.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/335: chown d2/d6/db/c37 864425530 1 2022-02-02T18:21:25.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/336: chown d2/c56 358479 1 2022-02-02T18:21:25.802 INFO:tasks.workunit.client.0.smithi096.stdout:8/266: dwrite fc [4194304,4194304] 0 2022-02-02T18:21:25.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/354: symlink d1/db/d1c/d2f/d78/d11/d1e/d47/l87 0 2022-02-02T18:21:25.805 INFO:tasks.workunit.client.0.smithi096.stdout:0/405: sync 2022-02-02T18:21:25.805 INFO:tasks.workunit.client.0.smithi096.stdout:0/406: fdatasync d2/db/f20 0 2022-02-02T18:21:25.806 INFO:tasks.workunit.client.0.smithi096.stdout:3/314: mkdir d2/df/d14/d73 0 2022-02-02T18:21:25.806 INFO:tasks.workunit.client.0.smithi096.stdout:3/315: write d2/df/d1c/f29 [577077,47851] 0 2022-02-02T18:21:25.807 INFO:tasks.workunit.client.0.smithi096.stdout:2/337: mkdir d2/d5e/d6d 0 2022-02-02T18:21:25.812 INFO:tasks.workunit.client.0.smithi096.stdout:8/267: creat d29/d2d/d42/f53 x:0 0 0 2022-02-02T18:21:25.814 INFO:tasks.workunit.client.0.smithi096.stdout:9/355: unlink d1/f4 0 2022-02-02T18:21:25.815 INFO:tasks.workunit.client.0.smithi096.stdout:0/407: rmdir d2/db/d24/d4d/d54 39 2022-02-02T18:21:25.816 INFO:tasks.workunit.client.0.smithi096.stdout:3/316: mkdir d2/df/d14/d2c/d74 0 2022-02-02T18:21:25.816 INFO:tasks.workunit.client.0.smithi096.stdout:3/317: write d2/df/d34/f39 [1044214,44848] 0 2022-02-02T18:21:25.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/268: symlink d29/d40/l54 0 2022-02-02T18:21:25.822 INFO:tasks.workunit.client.0.smithi096.stdout:9/356: symlink d1/db/d63/l88 0 2022-02-02T18:21:25.823 INFO:tasks.workunit.client.0.smithi096.stdout:1/312: dwrite f11 [0,4194304] 0 2022-02-02T18:21:25.823 INFO:tasks.workunit.client.0.smithi096.stdout:1/313: chown d15/d1b/d28/d2c/d39/d6b/c6d 248 1 2022-02-02T18:21:25.824 INFO:tasks.workunit.client.0.smithi096.stdout:0/408: mkdir d2/db/d37/d40/d8a 0 2022-02-02T18:21:25.824 INFO:tasks.workunit.client.0.smithi096.stdout:0/409: dread - d2/d1e/f5d zero size 2022-02-02T18:21:25.824 INFO:tasks.workunit.client.0.smithi096.stdout:9/357: mknod d1/db/d48/c89 0 2022-02-02T18:21:25.825 INFO:tasks.workunit.client.0.smithi096.stdout:7/270: fdatasync d9/df/f10 0 2022-02-02T18:21:25.825 INFO:tasks.workunit.client.0.smithi096.stdout:7/271: chown d9/df/d47/d19/f1e 227 1 2022-02-02T18:21:25.826 INFO:tasks.workunit.client.0.smithi096.stdout:1/314: rmdir d15/d1b/d28/d2c 39 2022-02-02T18:21:25.827 INFO:tasks.workunit.client.0.smithi096.stdout:5/281: dwrite f3 [0,4194304] 0 2022-02-02T18:21:25.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/366: dwrite d18/d24/d28/d3e/f71 [0,4194304] 0 2022-02-02T18:21:25.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/367: dread - d18/d50/f56 zero size 2022-02-02T18:21:25.827 INFO:tasks.workunit.client.0.smithi096.stdout:0/410: mknod d2/db/d7f/c8b 0 2022-02-02T18:21:25.828 INFO:tasks.workunit.client.0.smithi096.stdout:0/411: readlink d2/db/d10/l83 0 2022-02-02T18:21:25.828 INFO:tasks.workunit.client.0.smithi096.stdout:4/338: dwrite d3/d4/d20/d26/f2f [0,4194304] 0 2022-02-02T18:21:25.828 INFO:tasks.workunit.client.0.smithi096.stdout:4/339: truncate d3/d4/d14/f4b 995210 0 2022-02-02T18:21:25.828 INFO:tasks.workunit.client.0.smithi096.stdout:0/412: write d2/db/d10/f2b [117458,62412] 0 2022-02-02T18:21:25.829 INFO:tasks.workunit.client.0.smithi096.stdout:9/358: mkdir d1/d39/d8a 0 2022-02-02T18:21:25.829 INFO:tasks.workunit.client.0.smithi096.stdout:9/359: truncate d1/db/d1c/d2f/d78/d11/d3c/f79 282506 0 2022-02-02T18:21:25.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/315: mkdir d15/d1b/d26/d6f 0 2022-02-02T18:21:25.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/316: creat d15/f70 x:0 0 0 2022-02-02T18:21:25.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/317: write d15/d1b/f6e [564062,88095] 0 2022-02-02T18:21:25.831 INFO:tasks.workunit.client.0.smithi096.stdout:1/318: write d15/f70 [16973,82040] 0 2022-02-02T18:21:25.831 INFO:tasks.workunit.client.0.smithi096.stdout:4/340: read d3/d4/d14/f66 [1085922,25336] 0 2022-02-02T18:21:25.831 INFO:tasks.workunit.client.0.smithi096.stdout:5/282: creat db/d5c/d32/f69 x:0 0 0 2022-02-02T18:21:25.832 INFO:tasks.workunit.client.0.smithi096.stdout:5/283: chown db/de/d10/d25/l30 110630 1 2022-02-02T18:21:25.833 INFO:tasks.workunit.client.0.smithi096.stdout:7/272: dread f2 [0,4194304] 0 2022-02-02T18:21:25.834 INFO:tasks.workunit.client.0.smithi096.stdout:6/368: mknod d18/d54/d63/c91 0 2022-02-02T18:21:25.834 INFO:tasks.workunit.client.0.smithi096.stdout:6/369: chown d18/f8a 3894821 1 2022-02-02T18:21:25.835 INFO:tasks.workunit.client.0.smithi096.stdout:0/413: symlink d2/db/d10/d80/l8c 0 2022-02-02T18:21:25.836 INFO:tasks.workunit.client.0.smithi096.stdout:9/360: mknod d1/db/d48/d69/c8b 0 2022-02-02T18:21:25.837 INFO:tasks.workunit.client.0.smithi096.stdout:1/319: truncate d15/d1b/d28/d47/f63 3539803 0 2022-02-02T18:21:25.837 INFO:tasks.workunit.client.0.smithi096.stdout:5/284: write db/de/d10/f18 [1327304,100002] 0 2022-02-02T18:21:25.840 INFO:tasks.workunit.client.0.smithi096.stdout:3/318: dwrite d2/df/d1c/f28 [4194304,4194304] 0 2022-02-02T18:21:25.842 INFO:tasks.workunit.client.0.smithi096.stdout:4/341: symlink d3/d4/d50/l81 0 2022-02-02T18:21:25.842 INFO:tasks.workunit.client.0.smithi096.stdout:8/269: dwrite d29/d2d/d42/f53 [0,4194304] 0 2022-02-02T18:21:25.845 INFO:tasks.workunit.client.0.smithi096.stdout:7/273: rename d9/df/d16/c3b to d9/df/d16/d25/c5d 0 2022-02-02T18:21:25.845 INFO:tasks.workunit.client.0.smithi096.stdout:6/370: dread d18/d24/d28/d3e/f71 [0,4194304] 0 2022-02-02T18:21:25.846 INFO:tasks.workunit.client.0.smithi096.stdout:0/414: mknod d2/db/d10/d80/c8d 0 2022-02-02T18:21:25.849 INFO:tasks.workunit.client.0.smithi096.stdout:9/361: getdents d1/db/d1c/d2f/d78/d11/d1e/d66 0 2022-02-02T18:21:25.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/320: mkdir d15/d1b/d28/d2c/d39/d71 0 2022-02-02T18:21:25.862 INFO:tasks.workunit.client.0.smithi096.stdout:1/321: dread d15/d4d/f65 [0,4194304] 0 2022-02-02T18:21:25.862 INFO:tasks.workunit.client.0.smithi096.stdout:3/319: creat d2/df/d1c/d5d/d69/d43/d72/f75 x:0 0 0 2022-02-02T18:21:25.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/342: symlink d3/d4/d20/l82 0 2022-02-02T18:21:25.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/343: write d3/d4/f24 [919069,129865] 0 2022-02-02T18:21:25.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/344: truncate d3/d5a/f63 1510356 0 2022-02-02T18:21:25.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/270: truncate f1c 1756358 0 2022-02-02T18:21:25.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/371: dwrite d18/d24/d28/d3e/f41 [0,4194304] 0 2022-02-02T18:21:25.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/372: creat d18/d24/d73/f92 x:0 0 0 2022-02-02T18:21:25.869 INFO:tasks.workunit.client.0.smithi096.stdout:7/274: rmdir d9/df/d54 39 2022-02-02T18:21:25.869 INFO:tasks.workunit.client.0.smithi096.stdout:7/275: dread - d9/df/d12/d39/d41/f4f zero size 2022-02-02T18:21:25.870 INFO:tasks.workunit.client.0.smithi096.stdout:0/415: unlink d2/c38 0 2022-02-02T18:21:25.871 INFO:tasks.workunit.client.0.smithi096.stdout:0/416: dread - d2/db/d37/f7a zero size 2022-02-02T18:21:25.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/362: truncate d1/f56 46220 0 2022-02-02T18:21:25.873 INFO:tasks.workunit.client.0.smithi096.stdout:7/276: dread d9/df/d12/d14/f30 [0,4194304] 0 2022-02-02T18:21:25.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/322: mkdir d15/d1b/d26/d72 0 2022-02-02T18:21:25.876 INFO:tasks.workunit.client.0.smithi096.stdout:3/320: mkdir d2/df/d34/d76 0 2022-02-02T18:21:25.877 INFO:tasks.workunit.client.0.smithi096.stdout:4/345: mknod d3/d4/d14/c83 0 2022-02-02T18:21:25.877 INFO:tasks.workunit.client.0.smithi096.stdout:8/271: symlink d29/d2d/d42/l55 0 2022-02-02T18:21:25.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/272: creat d29/d2d/f56 x:0 0 0 2022-02-02T18:21:25.878 INFO:tasks.workunit.client.0.smithi096.stdout:4/346: dread d3/d4/d20/d26/d36/d51/f53 [0,4194304] 0 2022-02-02T18:21:25.880 INFO:tasks.workunit.client.0.smithi096.stdout:0/417: truncate d2/db/d37/d40/f4e 1486304 0 2022-02-02T18:21:25.880 INFO:tasks.workunit.client.0.smithi096.stdout:0/418: write d2/db/d10/f2b [820548,115790] 0 2022-02-02T18:21:25.882 INFO:tasks.workunit.client.0.smithi096.stdout:7/277: link d9/df/d47/d19/l2c d9/df/d12/d39/d40/l5e 0 2022-02-02T18:21:25.883 INFO:tasks.workunit.client.0.smithi096.stdout:1/323: mknod d15/d67/c73 0 2022-02-02T18:21:25.884 INFO:tasks.workunit.client.0.smithi096.stdout:1/324: chown d15/d1b/d28/f58 176745 1 2022-02-02T18:21:25.884 INFO:tasks.workunit.client.0.smithi096.stdout:1/325: chown d15/d4d/c50 16250 1 2022-02-02T18:21:25.885 INFO:tasks.workunit.client.0.smithi096.stdout:8/273: mkdir d29/d2d/d47/d57 0 2022-02-02T18:21:25.885 INFO:tasks.workunit.client.0.smithi096.stdout:8/274: chown d29/d2d/f48 452 1 2022-02-02T18:21:25.886 INFO:tasks.workunit.client.0.smithi096.stdout:7/278: write d9/df/d16/f2a [703934,24412] 0 2022-02-02T18:21:25.886 INFO:tasks.workunit.client.0.smithi096.stdout:4/347: symlink d3/d4/d20/d26/d36/d51/l84 0 2022-02-02T18:21:25.888 INFO:tasks.workunit.client.0.smithi096.stdout:0/419: mknod d2/d66/c8e 0 2022-02-02T18:21:25.889 INFO:tasks.workunit.client.0.smithi096.stdout:1/326: mkdir d15/d74 0 2022-02-02T18:21:25.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/275: mkdir d29/d58 0 2022-02-02T18:21:25.890 INFO:tasks.workunit.client.0.smithi096.stdout:7/279: mknod d9/df/d47/c5f 0 2022-02-02T18:21:25.891 INFO:tasks.workunit.client.0.smithi096.stdout:7/280: fdatasync d9/df/d12/d39/d42/f4d 0 2022-02-02T18:21:25.892 INFO:tasks.workunit.client.0.smithi096.stdout:4/348: mkdir d3/d85 0 2022-02-02T18:21:25.892 INFO:tasks.workunit.client.0.smithi096.stdout:4/349: readlink d3/d4/d20/l61 0 2022-02-02T18:21:25.892 INFO:tasks.workunit.client.0.smithi096.stdout:4/350: creat d3/d4/d20/d26/d36/d51/f86 x:0 0 0 2022-02-02T18:21:25.897 INFO:tasks.workunit.client.0.smithi096.stdout:8/276: dread d29/f2b [0,4194304] 0 2022-02-02T18:21:25.897 INFO:tasks.workunit.client.0.smithi096.stdout:9/363: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f42 [0,4194304] 0 2022-02-02T18:21:25.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/364: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l1d 1154754353 1 2022-02-02T18:21:25.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/365: chown d1/db/d1c/d2f/d78/d11/d3c/c7d 6881 1 2022-02-02T18:21:25.898 INFO:tasks.workunit.client.0.smithi096.stdout:6/373: dwrite d18/d24/d28/f87 [0,4194304] 0 2022-02-02T18:21:25.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/420: mkdir d2/db/d24/d89/d8f 0 2022-02-02T18:21:25.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/421: write d2/db/d37/f7a [906431,5815] 0 2022-02-02T18:21:25.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/422: fdatasync d2/d66/d71/f82 0 2022-02-02T18:21:25.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/423: chown d2/db/d37 801759041 1 2022-02-02T18:21:25.900 INFO:tasks.workunit.client.0.smithi096.stdout:8/277: read d29/f34 [596831,54107] 0 2022-02-02T18:21:25.900 INFO:tasks.workunit.client.0.smithi096.stdout:8/278: creat d29/d2d/d42/f59 x:0 0 0 2022-02-02T18:21:25.901 INFO:tasks.workunit.client.0.smithi096.stdout:3/321: dwrite d2/df/d20/d33/d58/f67 [0,4194304] 0 2022-02-02T18:21:25.910 INFO:tasks.workunit.client.0.smithi096.stdout:9/366: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d8c 0 2022-02-02T18:21:25.910 INFO:tasks.workunit.client.0.smithi096.stdout:9/367: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68 3 1 2022-02-02T18:21:25.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/281: getdents d9/df/d12/d14 0 2022-02-02T18:21:25.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/351: rmdir d3/d4/d14/d55 39 2022-02-02T18:21:25.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/352: creat d3/d5a/f87 x:0 0 0 2022-02-02T18:21:25.914 INFO:tasks.workunit.client.0.smithi096.stdout:1/327: dwrite d15/f2a [0,4194304] 0 2022-02-02T18:21:25.915 INFO:tasks.workunit.client.0.smithi096.stdout:0/424: creat d2/db/d24/f90 x:0 0 0 2022-02-02T18:21:25.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/374: dwrite d18/f49 [0,4194304] 0 2022-02-02T18:21:25.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/375: dread - d18/d50/f88 zero size 2022-02-02T18:21:25.917 INFO:tasks.workunit.client.0.smithi096.stdout:8/279: symlink d29/d2d/l5a 0 2022-02-02T18:21:25.919 INFO:tasks.workunit.client.0.smithi096.stdout:7/282: dread d9/df/d47/d19/f1e [4194304,4194304] 0 2022-02-02T18:21:25.921 INFO:tasks.workunit.client.0.smithi096.stdout:1/328: dread d15/d1b/d28/f58 [0,4194304] 0 2022-02-02T18:21:25.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/329: readlink d15/l1f 0 2022-02-02T18:21:25.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/330: write d15/d1b/d28/f3e [4741953,68280] 0 2022-02-02T18:21:25.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/331: write d15/d1b/d26/f49 [4605461,69265] 0 2022-02-02T18:21:25.923 INFO:tasks.workunit.client.0.smithi096.stdout:1/332: write d15/d1b/f6e [519129,1972] 0 2022-02-02T18:21:25.923 INFO:tasks.workunit.client.0.smithi096.stdout:1/333: unlink d15/l23 0 2022-02-02T18:21:25.923 INFO:tasks.workunit.client.0.smithi096.stdout:0/425: mkdir d2/db/d24/d89/d91 0 2022-02-02T18:21:25.924 INFO:tasks.workunit.client.0.smithi096.stdout:1/334: write d15/d1b/d28/f58 [2226340,4464] 0 2022-02-02T18:21:25.924 INFO:tasks.workunit.client.0.smithi096.stdout:0/426: chown d2/db/d37/l3a 0 1 2022-02-02T18:21:25.924 INFO:tasks.workunit.client.0.smithi096.stdout:2/338: sync 2022-02-02T18:21:25.927 INFO:tasks.workunit.client.0.smithi096.stdout:8/280: rmdir d29/d2d/d47/d57 0 2022-02-02T18:21:25.927 INFO:tasks.workunit.client.0.smithi096.stdout:8/281: readlink d29/d2d/d42/l46 0 2022-02-02T18:21:25.927 INFO:tasks.workunit.client.0.smithi096.stdout:8/282: chown d29/d2d/f45 906 1 2022-02-02T18:21:25.928 INFO:tasks.workunit.client.0.smithi096.stdout:7/283: rmdir d9/df/d12/d39/d46 39 2022-02-02T18:21:25.928 INFO:tasks.workunit.client.0.smithi096.stdout:2/339: dread d2/d13/d43/f47 [0,4194304] 0 2022-02-02T18:21:25.934 INFO:tasks.workunit.client.0.smithi096.stdout:0/427: mknod d2/db/d37/c92 0 2022-02-02T18:21:25.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/376: rmdir d18/d50 39 2022-02-02T18:21:25.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/377: stat d18/d50 0 2022-02-02T18:21:25.936 INFO:tasks.workunit.client.0.smithi096.stdout:7/284: unlink d9/df/d12/d14/l20 0 2022-02-02T18:21:25.938 INFO:tasks.workunit.client.0.smithi096.stdout:0/428: mkdir d2/db/d10/d80/d93 0 2022-02-02T18:21:25.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/378: link d18/f26 d18/d24/d73/d79/f93 0 2022-02-02T18:21:25.941 INFO:tasks.workunit.client.0.smithi096.stdout:2/340: mknod d2/d6/db/c6e 0 2022-02-02T18:21:25.941 INFO:tasks.workunit.client.0.smithi096.stdout:2/341: readlink d2/d6/d1b/d3a/l57 0 2022-02-02T18:21:25.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/342: fsync d2/d2a/f34 0 2022-02-02T18:21:25.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/343: fsync d2/fe 0 2022-02-02T18:21:25.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/429: creat d2/db/d37/d40/d8a/f94 x:0 0 0 2022-02-02T18:21:25.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/430: readlink d2/l59 0 2022-02-02T18:21:25.943 INFO:tasks.workunit.client.0.smithi096.stdout:6/379: rmdir d18/d24/d28/d4a 39 2022-02-02T18:21:25.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/431: mkdir d2/db/d24/d89/d8f/d95 0 2022-02-02T18:21:25.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/432: write d2/db/d24/d4d/d54/f55 [4491239,108092] 0 2022-02-02T18:21:25.946 INFO:tasks.workunit.client.0.smithi096.stdout:6/380: symlink d18/d54/d63/d7e/l94 0 2022-02-02T18:21:25.947 INFO:tasks.workunit.client.0.smithi096.stdout:2/344: rmdir d2/d13/d43 39 2022-02-02T18:21:25.948 INFO:tasks.workunit.client.0.smithi096.stdout:0/433: mknod d2/db/d10/c96 0 2022-02-02T18:21:25.950 INFO:tasks.workunit.client.0.smithi096.stdout:2/345: rename d2/d13/d43/d51/d5d/c60 to d2/d6/d1b/d3a/c6f 0 2022-02-02T18:21:25.950 INFO:tasks.workunit.client.0.smithi096.stdout:0/434: mknod d2/db/d24/d4d/d61/c97 0 2022-02-02T18:21:25.952 INFO:tasks.workunit.client.0.smithi096.stdout:8/283: dwrite d29/d2d/f2f [0,4194304] 0 2022-02-02T18:21:25.952 INFO:tasks.workunit.client.0.smithi096.stdout:0/435: creat d2/d66/f98 x:0 0 0 2022-02-02T18:21:25.952 INFO:tasks.workunit.client.0.smithi096.stdout:0/436: truncate d2/db/d37/f75 323909 0 2022-02-02T18:21:25.954 INFO:tasks.workunit.client.0.smithi096.stdout:2/346: dread d2/d6/db/d49/f6a [0,4194304] 0 2022-02-02T18:21:25.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/284: chown c18 2091451346 1 2022-02-02T18:21:25.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/285: readlink d29/d40/l54 0 2022-02-02T18:21:25.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/286: dread - d29/f3e zero size 2022-02-02T18:21:25.959 INFO:tasks.workunit.client.0.smithi096.stdout:8/287: dread f1c [0,4194304] 0 2022-02-02T18:21:25.962 INFO:tasks.workunit.client.0.smithi096.stdout:2/347: link d2/d6/f41 d2/d19/f70 0 2022-02-02T18:21:25.962 INFO:tasks.workunit.client.0.smithi096.stdout:2/348: stat d2/d13/d43/d51/d5d 0 2022-02-02T18:21:25.963 INFO:tasks.workunit.client.0.smithi096.stdout:8/288: mkdir d29/d4a/d5b 0 2022-02-02T18:21:25.964 INFO:tasks.workunit.client.0.smithi096.stdout:8/289: fsync d29/d2d/d42/f53 0 2022-02-02T18:21:25.964 INFO:tasks.workunit.client.0.smithi096.stdout:8/290: fsync d29/d40/f49 0 2022-02-02T18:21:25.964 INFO:tasks.workunit.client.0.smithi096.stdout:8/291: creat d29/d40/f5c x:0 0 0 2022-02-02T18:21:25.964 INFO:tasks.workunit.client.0.smithi096.stdout:8/292: chown d29/d2d/f2e 2028015360 1 2022-02-02T18:21:25.965 INFO:tasks.workunit.client.0.smithi096.stdout:2/349: write d2/f9 [1156695,88316] 0 2022-02-02T18:21:25.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/285: dwrite d9/df/d16/f2a [0,4194304] 0 2022-02-02T18:21:25.967 INFO:tasks.workunit.client.0.smithi096.stdout:2/350: truncate d2/d13/d43/f47 50992 0 2022-02-02T18:21:25.967 INFO:tasks.workunit.client.0.smithi096.stdout:2/351: fdatasync d2/d6/db/d49/f22 0 2022-02-02T18:21:25.968 INFO:tasks.workunit.client.0.smithi096.stdout:7/286: mkdir d9/df/d47/d60 0 2022-02-02T18:21:25.969 INFO:tasks.workunit.client.0.smithi096.stdout:2/352: mkdir d2/d13/d42/d71 0 2022-02-02T18:21:25.970 INFO:tasks.workunit.client.0.smithi096.stdout:2/353: fdatasync d2/d6/d1b/f39 0 2022-02-02T18:21:25.972 INFO:tasks.workunit.client.0.smithi096.stdout:7/287: creat d9/df/d12/d14/f61 x:0 0 0 2022-02-02T18:21:25.974 INFO:tasks.workunit.client.0.smithi096.stdout:5/285: sync 2022-02-02T18:21:25.974 INFO:tasks.workunit.client.0.smithi096.stdout:5/286: chown db/de/d10/l2d 232637 1 2022-02-02T18:21:25.975 INFO:tasks.workunit.client.0.smithi096.stdout:7/288: symlink d9/df/d12/d39/d40/d51/l62 0 2022-02-02T18:21:25.975 INFO:tasks.workunit.client.0.smithi096.stdout:7/289: dread - d9/df/d12/d39/d40/d51/f52 zero size 2022-02-02T18:21:25.976 INFO:tasks.workunit.client.0.smithi096.stdout:8/293: dread d29/f33 [0,4194304] 0 2022-02-02T18:21:25.978 INFO:tasks.workunit.client.0.smithi096.stdout:7/290: rename d9/df/d12/d39/d46/c56 to d9/df/d47/c63 0 2022-02-02T18:21:25.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/294: mknod d29/d2d/c5d 0 2022-02-02T18:21:25.981 INFO:tasks.workunit.client.0.smithi096.stdout:8/295: rename d29/d2d/d42/l46 to d29/d40/l5e 0 2022-02-02T18:21:25.983 INFO:tasks.workunit.client.0.smithi096.stdout:8/296: dread d29/d40/f44 [0,4194304] 0 2022-02-02T18:21:25.984 INFO:tasks.workunit.client.0.smithi096.stdout:8/297: creat d29/d4a/f5f x:0 0 0 2022-02-02T18:21:25.986 INFO:tasks.workunit.client.0.smithi096.stdout:2/354: dwrite d2/d29/f32 [0,4194304] 0 2022-02-02T18:21:25.987 INFO:tasks.workunit.client.0.smithi096.stdout:2/355: dread - d2/d2a/f34 zero size 2022-02-02T18:21:25.987 INFO:tasks.workunit.client.0.smithi096.stdout:8/298: symlink d29/d2d/d47/l60 0 2022-02-02T18:21:25.988 INFO:tasks.workunit.client.0.smithi096.stdout:7/291: fsync d9/df/d12/d14/f61 0 2022-02-02T18:21:25.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/292: write f2 [177601,31520] 0 2022-02-02T18:21:25.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/293: chown d9/df/d47/c63 513 1 2022-02-02T18:21:25.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/294: read - d9/df/d12/d14/f61 zero size 2022-02-02T18:21:25.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/295: truncate d9/df/d12/d14/f61 145939 0 2022-02-02T18:21:25.990 INFO:tasks.workunit.client.0.smithi096.stdout:2/356: creat d2/f72 x:0 0 0 2022-02-02T18:21:25.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/299: link d29/d2d/f3f d29/d2d/d42/f61 0 2022-02-02T18:21:25.995 INFO:tasks.workunit.client.0.smithi096.stdout:5/287: dwrite db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:25.995 INFO:tasks.workunit.client.0.smithi096.stdout:2/357: rmdir d2/d6/db/d49/d63 0 2022-02-02T18:21:25.996 INFO:tasks.workunit.client.0.smithi096.stdout:2/358: chown d2/d29/c36 0 1 2022-02-02T18:21:25.997 INFO:tasks.workunit.client.0.smithi096.stdout:8/300: write f21 [483056,47150] 0 2022-02-02T18:21:25.997 INFO:tasks.workunit.client.0.smithi096.stdout:5/288: mknod db/de/d10/d25/c6a 0 2022-02-02T18:21:26.003 INFO:tasks.workunit.client.0.smithi096.stdout:5/289: rename db/f57 to db/d5c/d61/f6b 0 2022-02-02T18:21:26.003 INFO:tasks.workunit.client.0.smithi096.stdout:5/290: creat db/f6c x:0 0 0 2022-02-02T18:21:26.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/291: rmdir db/de/d10/d27 39 2022-02-02T18:21:26.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/292: write db/d5c/d2f/f3d [1009001,31774] 0 2022-02-02T18:21:26.008 INFO:tasks.workunit.client.0.smithi096.stdout:5/293: dread - db/d5c/d32/f69 zero size 2022-02-02T18:21:26.009 INFO:tasks.workunit.client.0.smithi096.stdout:5/294: mknod db/d5c/d60/c6d 0 2022-02-02T18:21:26.009 INFO:tasks.workunit.client.0.smithi096.stdout:7/296: dwrite d9/f3e [0,4194304] 0 2022-02-02T18:21:26.010 INFO:tasks.workunit.client.0.smithi096.stdout:7/297: stat d9/df/d12/d14/c21 0 2022-02-02T18:21:26.010 INFO:tasks.workunit.client.0.smithi096.stdout:7/298: write d9/df/d16/d25/f55 [116583,114855] 0 2022-02-02T18:21:26.011 INFO:tasks.workunit.client.0.smithi096.stdout:5/295: creat db/d5c/d2f/f6e x:0 0 0 2022-02-02T18:21:26.012 INFO:tasks.workunit.client.0.smithi096.stdout:5/296: read db/de/f16 [77206,126412] 0 2022-02-02T18:21:26.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/359: dwrite d2/f9 [4194304,4194304] 0 2022-02-02T18:21:26.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/360: chown d2/d29 465135 1 2022-02-02T18:21:26.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/297: link db/f1b db/d5c/f6f 0 2022-02-02T18:21:26.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/298: write db/d5c/f5e [220624,26341] 0 2022-02-02T18:21:26.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/299: write db/de/d2e/f3e [867588,49482] 0 2022-02-02T18:21:26.018 INFO:tasks.workunit.client.0.smithi096.stdout:5/300: stat db/d5c/d60/c6d 0 2022-02-02T18:21:26.018 INFO:tasks.workunit.client.0.smithi096.stdout:5/301: readlink db/d5c/d32/l44 0 2022-02-02T18:21:26.018 INFO:tasks.workunit.client.0.smithi096.stdout:7/299: getdents d9/df/d12/d39/d40/d51 0 2022-02-02T18:21:26.019 INFO:tasks.workunit.client.0.smithi096.stdout:5/302: mkdir db/d5c/d32/d70 0 2022-02-02T18:21:26.020 INFO:tasks.workunit.client.0.smithi096.stdout:7/300: symlink d9/df/d12/d39/d42/l64 0 2022-02-02T18:21:26.020 INFO:tasks.workunit.client.0.smithi096.stdout:7/301: readlink d9/df/d47/d19/l2c 0 2022-02-02T18:21:26.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/302: rename d9/df/d47/c22 to d9/df/d12/d39/d41/c65 0 2022-02-02T18:21:26.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/303: chown d9/df/d12/d14/f50 48430 1 2022-02-02T18:21:26.023 INFO:tasks.workunit.client.0.smithi096.stdout:7/304: mknod d9/df/d16/d25/c66 0 2022-02-02T18:21:26.023 INFO:tasks.workunit.client.0.smithi096.stdout:7/305: readlink d9/df/d12/d14/l3c 0 2022-02-02T18:21:26.024 INFO:tasks.workunit.client.0.smithi096.stdout:7/306: symlink d9/df/d12/l67 0 2022-02-02T18:21:26.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/303: dread db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:26.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/361: dwrite d2/d13/f64 [0,4194304] 0 2022-02-02T18:21:26.036 INFO:tasks.workunit.client.0.smithi096.stdout:5/304: dread db/d5c/f55 [0,4194304] 0 2022-02-02T18:21:26.036 INFO:tasks.workunit.client.0.smithi096.stdout:5/305: readlink db/l14 0 2022-02-02T18:21:26.041 INFO:tasks.workunit.client.0.smithi096.stdout:3/322: sync 2022-02-02T18:21:26.043 INFO:tasks.workunit.client.0.smithi096.stdout:3/323: unlink d2/df/d36/f54 0 2022-02-02T18:21:26.044 INFO:tasks.workunit.client.0.smithi096.stdout:3/324: truncate d2/df/f24 817405 0 2022-02-02T18:21:26.045 INFO:tasks.workunit.client.0.smithi096.stdout:3/325: link d2/df/d14/d11/c27 d2/df/d1c/d5d/d69/d43/d72/c77 0 2022-02-02T18:21:26.045 INFO:tasks.workunit.client.0.smithi096.stdout:3/326: fsync d2/df/d1c/f59 0 2022-02-02T18:21:26.046 INFO:tasks.workunit.client.0.smithi096.stdout:3/327: symlink d2/df/d14/d2c/l78 0 2022-02-02T18:21:26.046 INFO:tasks.workunit.client.0.smithi096.stdout:3/328: chown d2/df/d14/d66 1 1 2022-02-02T18:21:26.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/329: write d2/df/d20/f5b [4248571,101563] 0 2022-02-02T18:21:26.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/330: fsync d2/df/d20/d33/d58/f67 0 2022-02-02T18:21:26.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/331: write d2/df/d14/f4b [1201906,12600] 0 2022-02-02T18:21:26.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/332: getdents d2/df 0 2022-02-02T18:21:26.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/333: write d2/df/d14/f50 [649441,124646] 0 2022-02-02T18:21:26.049 INFO:tasks.workunit.client.0.smithi096.stdout:2/362: dwrite d2/d2a/f30 [4194304,4194304] 0 2022-02-02T18:21:26.049 INFO:tasks.workunit.client.0.smithi096.stdout:5/306: dread db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:26.055 INFO:tasks.workunit.client.0.smithi096.stdout:2/363: mkdir d2/d13/d43/d51/d73 0 2022-02-02T18:21:26.055 INFO:tasks.workunit.client.0.smithi096.stdout:2/364: fsync d2/d6/db/d49/f22 0 2022-02-02T18:21:26.055 INFO:tasks.workunit.client.0.smithi096.stdout:5/307: truncate f3 4169475 0 2022-02-02T18:21:26.056 INFO:tasks.workunit.client.0.smithi096.stdout:5/308: fdatasync db/de/d2e/d35/f37 0 2022-02-02T18:21:26.056 INFO:tasks.workunit.client.0.smithi096.stdout:5/309: chown db/de/d10/d27/f4d 6 1 2022-02-02T18:21:26.057 INFO:tasks.workunit.client.0.smithi096.stdout:2/365: mknod d2/d13/d42/d71/c74 0 2022-02-02T18:21:26.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/310: rmdir db/d5c 39 2022-02-02T18:21:26.058 INFO:tasks.workunit.client.0.smithi096.stdout:2/366: symlink d2/d2a/l75 0 2022-02-02T18:21:26.058 INFO:tasks.workunit.client.0.smithi096.stdout:2/367: write d2/d13/f26 [468677,75303] 0 2022-02-02T18:21:26.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/311: rename db/de/c58 to db/de/d10/d25/c71 0 2022-02-02T18:21:26.062 INFO:tasks.workunit.client.0.smithi096.stdout:3/334: dwrite d2/df/d1c/d5d/d69/f55 [0,4194304] 0 2022-02-02T18:21:26.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/335: creat d2/df/d1c/d5d/f79 x:0 0 0 2022-02-02T18:21:26.066 INFO:tasks.workunit.client.0.smithi096.stdout:3/336: getdents d2/df/d14/d2c/d31 0 2022-02-02T18:21:26.073 INFO:tasks.workunit.client.0.smithi096.stdout:2/368: dread d2/d6/f41 [4194304,4194304] 0 2022-02-02T18:21:26.073 INFO:tasks.workunit.client.0.smithi096.stdout:2/369: getdents d2/d6/d1b/d48 0 2022-02-02T18:21:26.074 INFO:tasks.workunit.client.0.smithi096.stdout:2/370: read d2/d13/d43/d51/f69 [359005,124988] 0 2022-02-02T18:21:26.085 INFO:tasks.workunit.client.0.smithi096.stdout:5/312: dwrite db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:26.086 INFO:tasks.workunit.client.0.smithi096.stdout:5/313: fsync db/d5c/d32/f4b 0 2022-02-02T18:21:26.087 INFO:tasks.workunit.client.0.smithi096.stdout:5/314: mkdir db/d5c/d60/d72 0 2022-02-02T18:21:26.088 INFO:tasks.workunit.client.0.smithi096.stdout:5/315: rename db/de/d2e/f3e to db/d5c/d2f/d46/f73 0 2022-02-02T18:21:26.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/337: dwrite d2/df/d1c/f28 [4194304,4194304] 0 2022-02-02T18:21:26.094 INFO:tasks.workunit.client.0.smithi096.stdout:2/371: dwrite d2/f72 [0,4194304] 0 2022-02-02T18:21:26.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/338: symlink d2/d71/l7a 0 2022-02-02T18:21:26.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/339: dread - d2/df/d20/d33/f63 zero size 2022-02-02T18:21:26.104 INFO:tasks.workunit.client.0.smithi096.stdout:5/316: dread db/de/d10/f19 [0,4194304] 0 2022-02-02T18:21:26.109 INFO:tasks.workunit.client.0.smithi096.stdout:5/317: truncate db/de/d10/f18 406310 0 2022-02-02T18:21:26.109 INFO:tasks.workunit.client.0.smithi096.stdout:5/318: chown db/d5c/d2f/c3b 206680 1 2022-02-02T18:21:26.110 INFO:tasks.workunit.client.0.smithi096.stdout:5/319: creat db/d5c/d2f/d46/f74 x:0 0 0 2022-02-02T18:21:26.113 INFO:tasks.workunit.client.0.smithi096.stdout:5/320: mkdir db/d5c/d2f/d46/d75 0 2022-02-02T18:21:26.114 INFO:tasks.workunit.client.0.smithi096.stdout:5/321: mknod db/de/c76 0 2022-02-02T18:21:26.116 INFO:tasks.workunit.client.0.smithi096.stdout:5/322: dread db/d5c/f5e [0,4194304] 0 2022-02-02T18:21:26.117 INFO:tasks.workunit.client.0.smithi096.stdout:5/323: symlink db/d5c/d61/l77 0 2022-02-02T18:21:26.118 INFO:tasks.workunit.client.0.smithi096.stdout:5/324: write db/de/d10/d25/f40 [5173007,126557] 0 2022-02-02T18:21:26.118 INFO:tasks.workunit.client.0.smithi096.stdout:5/325: fsync db/de/d10/d25/d4c/f65 0 2022-02-02T18:21:26.119 INFO:tasks.workunit.client.0.smithi096.stdout:2/372: dwrite d2/d13/f26 [0,4194304] 0 2022-02-02T18:21:26.121 INFO:tasks.workunit.client.0.smithi096.stdout:3/340: dwrite d2/df/d14/d16/f52 [0,4194304] 0 2022-02-02T18:21:26.121 INFO:tasks.workunit.client.0.smithi096.stdout:2/373: getdents d2/d19 0 2022-02-02T18:21:26.126 INFO:tasks.workunit.client.0.smithi096.stdout:3/341: unlink d2/df/d14/d2c/f4d 0 2022-02-02T18:21:26.126 INFO:tasks.workunit.client.0.smithi096.stdout:3/342: readlink d2/df/d14/l70 0 2022-02-02T18:21:26.126 INFO:tasks.workunit.client.0.smithi096.stdout:3/343: readlink d2/df/d1c/l22 0 2022-02-02T18:21:26.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/344: write d2/df/d20/d33/f3b [199514,51563] 0 2022-02-02T18:21:26.127 INFO:tasks.workunit.client.0.smithi096.stdout:2/374: mkdir d2/d6/d76 0 2022-02-02T18:21:26.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/345: rename d2/df/d14/f4b to d2/df/d14/d2c/d74/f7b 0 2022-02-02T18:21:26.131 INFO:tasks.workunit.client.0.smithi096.stdout:0/437: sync 2022-02-02T18:21:26.131 INFO:tasks.workunit.client.0.smithi096.stdout:4/353: sync 2022-02-02T18:21:26.131 INFO:tasks.workunit.client.0.smithi096.stdout:9/368: sync 2022-02-02T18:21:26.131 INFO:tasks.workunit.client.0.smithi096.stdout:4/354: chown d3/d4/d14/f2d 1943983 1 2022-02-02T18:21:26.132 INFO:tasks.workunit.client.0.smithi096.stdout:3/346: truncate d2/df/d14/f30 2704025 0 2022-02-02T18:21:26.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/369: truncate d1/db/d1c/f84 693749 0 2022-02-02T18:21:26.132 INFO:tasks.workunit.client.0.smithi096.stdout:1/335: sync 2022-02-02T18:21:26.132 INFO:tasks.workunit.client.0.smithi096.stdout:6/381: sync 2022-02-02T18:21:26.133 INFO:tasks.workunit.client.0.smithi096.stdout:9/370: truncate d1/db/d1c/d2f/d78/d11/d3c/f79 1240506 0 2022-02-02T18:21:26.133 INFO:tasks.workunit.client.0.smithi096.stdout:6/382: write d18/d24/f4d [276778,52911] 0 2022-02-02T18:21:26.133 INFO:tasks.workunit.client.0.smithi096.stdout:9/371: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f74 0 2022-02-02T18:21:26.134 INFO:tasks.workunit.client.0.smithi096.stdout:4/355: mkdir d3/d4/d20/d26/d36/d88 0 2022-02-02T18:21:26.134 INFO:tasks.workunit.client.0.smithi096.stdout:4/356: write d3/d4/d14/f58 [4336817,127786] 0 2022-02-02T18:21:26.135 INFO:tasks.workunit.client.0.smithi096.stdout:4/357: read d3/d4/d20/d26/f2f [2533918,67450] 0 2022-02-02T18:21:26.135 INFO:tasks.workunit.client.0.smithi096.stdout:1/336: symlink d15/d1b/d28/l75 0 2022-02-02T18:21:26.135 INFO:tasks.workunit.client.0.smithi096.stdout:9/372: dread d1/db/d1c/d2f/d78/d11/f2d [0,4194304] 0 2022-02-02T18:21:26.136 INFO:tasks.workunit.client.0.smithi096.stdout:9/373: creat d1/db/d48/f8d x:0 0 0 2022-02-02T18:21:26.136 INFO:tasks.workunit.client.0.smithi096.stdout:6/383: mkdir d18/d50/d6d/d95 0 2022-02-02T18:21:26.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/374: write d1/db/d1c/d2f/d78/d11/d1e/f53 [929529,108135] 0 2022-02-02T18:21:26.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/375: chown d1/db/d48 151 1 2022-02-02T18:21:26.138 INFO:tasks.workunit.client.0.smithi096.stdout:9/376: write d1/db/d63/f80 [705778,105533] 0 2022-02-02T18:21:26.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/358: mknod d3/d5a/c89 0 2022-02-02T18:21:26.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/359: write d3/d4/d14/f58 [5278995,96144] 0 2022-02-02T18:21:26.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/360: dread - d3/d60/f79 zero size 2022-02-02T18:21:26.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/361: creat d3/d4/d20/d26/d36/f8a x:0 0 0 2022-02-02T18:21:26.140 INFO:tasks.workunit.client.0.smithi096.stdout:1/337: getdents d15/d1b/d28/d2c/d39 0 2022-02-02T18:21:26.142 INFO:tasks.workunit.client.0.smithi096.stdout:1/338: dread f13 [4194304,4194304] 0 2022-02-02T18:21:26.143 INFO:tasks.workunit.client.0.smithi096.stdout:6/384: mknod d18/d50/c96 0 2022-02-02T18:21:26.143 INFO:tasks.workunit.client.0.smithi096.stdout:9/377: rmdir d1/db/d1c/d2f/d78/d11/d3c 39 2022-02-02T18:21:26.144 INFO:tasks.workunit.client.0.smithi096.stdout:9/378: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f5f [794473,58332] 0 2022-02-02T18:21:26.146 INFO:tasks.workunit.client.0.smithi096.stdout:4/362: truncate d3/d4/f23 3229969 0 2022-02-02T18:21:26.149 INFO:tasks.workunit.client.0.smithi096.stdout:6/385: creat d18/d50/d6d/d95/f97 x:0 0 0 2022-02-02T18:21:26.149 INFO:tasks.workunit.client.0.smithi096.stdout:9/379: mkdir d1/db/d1c/d2f/d78/d25/d8e 0 2022-02-02T18:21:26.151 INFO:tasks.workunit.client.0.smithi096.stdout:6/386: read d18/f8a [1330398,59205] 0 2022-02-02T18:21:26.151 INFO:tasks.workunit.client.0.smithi096.stdout:6/387: chown d18/d54/c69 109 1 2022-02-02T18:21:26.152 INFO:tasks.workunit.client.0.smithi096.stdout:9/380: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f 0 2022-02-02T18:21:26.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/381: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f90 x:0 0 0 2022-02-02T18:21:26.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/382: chown d1/db/l1b 7 1 2022-02-02T18:21:26.156 INFO:tasks.workunit.client.0.smithi096.stdout:6/388: getdents d18/d24/d28/d3e 0 2022-02-02T18:21:26.157 INFO:tasks.workunit.client.0.smithi096.stdout:9/383: write d1/f6 [974071,130315] 0 2022-02-02T18:21:26.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/389: link d18/d24/d28/d4a/c6c d18/d54/d63/d7e/c98 0 2022-02-02T18:21:26.159 INFO:tasks.workunit.client.0.smithi096.stdout:6/390: chown d18/d24/d28/c77 59313 1 2022-02-02T18:21:26.159 INFO:tasks.workunit.client.0.smithi096.stdout:6/391: chown d18/f49 4 1 2022-02-02T18:21:26.160 INFO:tasks.workunit.client.0.smithi096.stdout:6/392: mknod d18/d24/d28/c99 0 2022-02-02T18:21:26.160 INFO:tasks.workunit.client.0.smithi096.stdout:6/393: mkdir d18/d50/d9a 0 2022-02-02T18:21:26.162 INFO:tasks.workunit.client.0.smithi096.stdout:6/394: mkdir d18/d9b 0 2022-02-02T18:21:26.163 INFO:tasks.workunit.client.0.smithi096.stdout:5/326: dwrite db/de/f13 [0,4194304] 0 2022-02-02T18:21:26.163 INFO:tasks.workunit.client.0.smithi096.stdout:6/395: mknod d18/d24/d73/d79/c9c 0 2022-02-02T18:21:26.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/327: dread db/de/d10/d25/f45 [0,4194304] 0 2022-02-02T18:21:26.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/328: creat db/d5c/d2f/d46/f78 x:0 0 0 2022-02-02T18:21:26.166 INFO:tasks.workunit.client.0.smithi096.stdout:6/396: rmdir d18/d9b 0 2022-02-02T18:21:26.166 INFO:tasks.workunit.client.0.smithi096.stdout:6/397: dread - d18/d24/f8e zero size 2022-02-02T18:21:26.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/329: symlink db/l79 0 2022-02-02T18:21:26.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/330: fsync db/d5c/d2f/f3d 0 2022-02-02T18:21:26.170 INFO:tasks.workunit.client.0.smithi096.stdout:1/339: dwrite d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:26.170 INFO:tasks.workunit.client.0.smithi096.stdout:1/340: getdents d15/d1b/d28/d3f 0 2022-02-02T18:21:26.171 INFO:tasks.workunit.client.0.smithi096.stdout:1/341: unlink l7 0 2022-02-02T18:21:26.171 INFO:tasks.workunit.client.0.smithi096.stdout:4/363: dwrite d3/d4/d20/d26/d36/d51/f53 [0,4194304] 0 2022-02-02T18:21:26.172 INFO:tasks.workunit.client.0.smithi096.stdout:6/398: dread d18/d24/d73/f75 [0,4194304] 0 2022-02-02T18:21:26.172 INFO:tasks.workunit.client.0.smithi096.stdout:9/384: dread d1/db/d1c/d2f/f51 [0,4194304] 0 2022-02-02T18:21:26.172 INFO:tasks.workunit.client.0.smithi096.stdout:6/399: chown d18/d24/d28/f35 1076806437 1 2022-02-02T18:21:26.173 INFO:tasks.workunit.client.0.smithi096.stdout:0/438: dwrite d2/db/f29 [0,4194304] 0 2022-02-02T18:21:26.173 INFO:tasks.workunit.client.0.smithi096.stdout:0/439: read - d2/f69 zero size 2022-02-02T18:21:26.176 INFO:tasks.workunit.client.0.smithi096.stdout:1/342: write d15/d1b/d28/f4a [1460292,12677] 0 2022-02-02T18:21:26.176 INFO:tasks.workunit.client.0.smithi096.stdout:1/343: truncate d15/d1b/d28/f61 375001 0 2022-02-02T18:21:26.176 INFO:tasks.workunit.client.0.smithi096.stdout:4/364: mknod d3/d4/d50/c8b 0 2022-02-02T18:21:26.179 INFO:tasks.workunit.client.0.smithi096.stdout:6/400: unlink d18/d24/l86 0 2022-02-02T18:21:26.181 INFO:tasks.workunit.client.0.smithi096.stdout:9/385: dread d1/db/d1c/d2f/d78/f18 [0,4194304] 0 2022-02-02T18:21:26.184 INFO:tasks.workunit.client.0.smithi096.stdout:6/401: dread d18/f23 [0,4194304] 0 2022-02-02T18:21:26.184 INFO:tasks.workunit.client.0.smithi096.stdout:6/402: stat d18/d24/f5b 0 2022-02-02T18:21:26.184 INFO:tasks.workunit.client.0.smithi096.stdout:6/403: dread - d18/d50/f88 zero size 2022-02-02T18:21:26.185 INFO:tasks.workunit.client.0.smithi096.stdout:5/331: dwrite db/d5c/d2f/f3d [0,4194304] 0 2022-02-02T18:21:26.189 INFO:tasks.workunit.client.0.smithi096.stdout:0/440: symlink d2/db/d10/d80/d93/l99 0 2022-02-02T18:21:26.191 INFO:tasks.workunit.client.0.smithi096.stdout:1/344: link c12 d15/d1b/d28/d47/c76 0 2022-02-02T18:21:26.193 INFO:tasks.workunit.client.0.smithi096.stdout:4/365: rename d3/d27/f13 to d3/d27/f8c 0 2022-02-02T18:21:26.195 INFO:tasks.workunit.client.0.smithi096.stdout:1/345: dread d15/d1b/d28/d47/f53 [0,4194304] 0 2022-02-02T18:21:26.195 INFO:tasks.workunit.client.0.smithi096.stdout:1/346: chown d15/d1b/d28/d2c/d39/d6b 1240 1 2022-02-02T18:21:26.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/386: symlink d1/db/d1c/d2f/d78/d11/d1e/d66/l91 0 2022-02-02T18:21:26.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/387: fdatasync d1/f56 0 2022-02-02T18:21:26.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/388: fsync d1/db/d1c/d2f/d78/d11/f2d 0 2022-02-02T18:21:26.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/389: fsync d1/db/d1c/d2f/d78/d11/d3c/f79 0 2022-02-02T18:21:26.198 INFO:tasks.workunit.client.0.smithi096.stdout:7/307: sync 2022-02-02T18:21:26.198 INFO:tasks.workunit.client.0.smithi096.stdout:8/301: sync 2022-02-02T18:21:26.199 INFO:tasks.workunit.client.0.smithi096.stdout:7/308: dread - d9/df/d12/d14/f50 zero size 2022-02-02T18:21:26.199 INFO:tasks.workunit.client.0.smithi096.stdout:6/404: mkdir d18/d24/d28/d4a/d9d 0 2022-02-02T18:21:26.199 INFO:tasks.workunit.client.0.smithi096.stdout:6/405: chown d18/d24/d28/f35 13690 1 2022-02-02T18:21:26.202 INFO:tasks.workunit.client.0.smithi096.stdout:5/332: mknod db/de/d10/d27/c7a 0 2022-02-02T18:21:26.203 INFO:tasks.workunit.client.0.smithi096.stdout:5/333: creat db/d5c/d2f/d46/f7b x:0 0 0 2022-02-02T18:21:26.204 INFO:tasks.workunit.client.0.smithi096.stdout:4/366: mkdir d3/d60/d8d 0 2022-02-02T18:21:26.204 INFO:tasks.workunit.client.0.smithi096.stdout:4/367: write d3/d4/f1c [2076776,35765] 0 2022-02-02T18:21:26.204 INFO:tasks.workunit.client.0.smithi096.stdout:4/368: fsync d3/d27/f3a 0 2022-02-02T18:21:26.205 INFO:tasks.workunit.client.0.smithi096.stdout:4/369: readlink d3/d4/d20/d26/d36/l64 0 2022-02-02T18:21:26.205 INFO:tasks.workunit.client.0.smithi096.stdout:4/370: readlink d3/d4/l2c 0 2022-02-02T18:21:26.205 INFO:tasks.workunit.client.0.smithi096.stdout:7/309: truncate d9/df/d47/d19/f1e 8379180 0 2022-02-02T18:21:26.208 INFO:tasks.workunit.client.0.smithi096.stdout:4/371: symlink d3/d27/d4a/l8e 0 2022-02-02T18:21:26.208 INFO:tasks.workunit.client.0.smithi096.stdout:4/372: read - d3/d4/d20/d26/d36/f8a zero size 2022-02-02T18:21:26.209 INFO:tasks.workunit.client.0.smithi096.stdout:4/373: fsync d3/d5a/f5f 0 2022-02-02T18:21:26.209 INFO:tasks.workunit.client.0.smithi096.stdout:1/347: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:26.209 INFO:tasks.workunit.client.0.smithi096.stdout:1/348: creat d15/d1b/d26/f77 x:0 0 0 2022-02-02T18:21:26.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/441: dwrite d2/d1e/f2e [4194304,4194304] 0 2022-02-02T18:21:26.210 INFO:tasks.workunit.client.0.smithi096.stdout:7/310: symlink d9/df/d47/l68 0 2022-02-02T18:21:26.210 INFO:tasks.workunit.client.0.smithi096.stdout:5/334: getdents db/de/d2e/d35 0 2022-02-02T18:21:26.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/374: rename d3/f6b to d3/d27/d4a/f8f 0 2022-02-02T18:21:26.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/375: chown d3/d4/d20/d26/f5e 36662292 1 2022-02-02T18:21:26.214 INFO:tasks.workunit.client.0.smithi096.stdout:1/349: symlink d15/d1b/d28/d2c/d4f/d51/l78 0 2022-02-02T18:21:26.215 INFO:tasks.workunit.client.0.smithi096.stdout:5/335: rmdir db/de/d10 39 2022-02-02T18:21:26.218 INFO:tasks.workunit.client.0.smithi096.stdout:0/442: dread d2/db/f2a [0,4194304] 0 2022-02-02T18:21:26.218 INFO:tasks.workunit.client.0.smithi096.stdout:0/443: chown d2/d1e/f5d 11534213 1 2022-02-02T18:21:26.218 INFO:tasks.workunit.client.0.smithi096.stdout:7/311: rename d9/df/d12/d39/d40/d51/f52 to d9/df/d12/d39/d40/f69 0 2022-02-02T18:21:26.219 INFO:tasks.workunit.client.0.smithi096.stdout:7/312: creat d9/df/d12/d39/d41/f6a x:0 0 0 2022-02-02T18:21:26.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/376: mkdir d3/d4/d90 0 2022-02-02T18:21:26.220 INFO:tasks.workunit.client.0.smithi096.stdout:0/444: dread d2/db/d37/f3e [0,4194304] 0 2022-02-02T18:21:26.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/406: dwrite d18/d50/f61 [0,4194304] 0 2022-02-02T18:21:26.224 INFO:tasks.workunit.client.0.smithi096.stdout:0/445: dread d2/db/d10/f2b [0,4194304] 0 2022-02-02T18:21:26.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/336: rename db/de/d10/d25/l4a to db/d5c/d32/d70/l7c 0 2022-02-02T18:21:26.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/337: write db/d5c/d32/f69 [867253,105755] 0 2022-02-02T18:21:26.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/390: dwrite d1/d39/f60 [0,4194304] 0 2022-02-02T18:21:26.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/313: mkdir d9/df/d12/d39/d40/d6b 0 2022-02-02T18:21:26.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/377: mkdir d3/d5a/d91 0 2022-02-02T18:21:26.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/378: write d3/d4/f37 [383438,97622] 0 2022-02-02T18:21:26.233 INFO:tasks.workunit.client.0.smithi096.stdout:1/350: rmdir d15/d4d 39 2022-02-02T18:21:26.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/351: chown d15/d1b/d28/f58 63688362 1 2022-02-02T18:21:26.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/352: read d15/f2e [2553941,82799] 0 2022-02-02T18:21:26.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/407: link d18/d54/d63/d7e/c98 d18/d24/d28/d3e/c9e 0 2022-02-02T18:21:26.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/408: fsync d18/d24/d73/f92 0 2022-02-02T18:21:26.240 INFO:tasks.workunit.client.0.smithi096.stdout:5/338: mknod db/d5c/d60/c7d 0 2022-02-02T18:21:26.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/409: dread d18/f26 [0,4194304] 0 2022-02-02T18:21:26.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/410: stat d18/d54/d63/l66 0 2022-02-02T18:21:26.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/411: chown d18/d24/c7b 25995 1 2022-02-02T18:21:26.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/412: chown d18/d24/d28/f35 4690314 1 2022-02-02T18:21:26.244 INFO:tasks.workunit.client.0.smithi096.stdout:6/413: creat d18/d54/d63/f9f x:0 0 0 2022-02-02T18:21:26.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/391: link d1/db/d1c/d2f/f3b d1/db/d1c/d2f/d78/f92 0 2022-02-02T18:21:26.245 INFO:tasks.workunit.client.0.smithi096.stdout:7/314: creat d9/df/d12/d39/d40/f6c x:0 0 0 2022-02-02T18:21:26.245 INFO:tasks.workunit.client.0.smithi096.stdout:7/315: write d9/df/d47/d19/f35 [689490,61630] 0 2022-02-02T18:21:26.246 INFO:tasks.workunit.client.0.smithi096.stdout:1/353: getdents d15/d1b/d28/d47 0 2022-02-02T18:21:26.246 INFO:tasks.workunit.client.0.smithi096.stdout:0/446: getdents d2/d62 0 2022-02-02T18:21:26.247 INFO:tasks.workunit.client.0.smithi096.stdout:0/447: creat d2/db/d24/f9a x:0 0 0 2022-02-02T18:21:26.248 INFO:tasks.workunit.client.0.smithi096.stdout:5/339: symlink db/de/d2e/d35/l7e 0 2022-02-02T18:21:26.248 INFO:tasks.workunit.client.0.smithi096.stdout:0/448: dread d2/db/d10/d27/f73 [0,4194304] 0 2022-02-02T18:21:26.249 INFO:tasks.workunit.client.0.smithi096.stdout:6/414: creat d18/d50/d8f/fa0 x:0 0 0 2022-02-02T18:21:26.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/379: dwrite d3/d4/d20/d26/d36/d51/f53 [0,4194304] 0 2022-02-02T18:21:26.252 INFO:tasks.workunit.client.0.smithi096.stdout:9/392: rename d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f5f to d1/db/d48/d69/f93 0 2022-02-02T18:21:26.252 INFO:tasks.workunit.client.0.smithi096.stdout:9/393: dread - d1/db/d1c/d2f/f54 zero size 2022-02-02T18:21:26.253 INFO:tasks.workunit.client.0.smithi096.stdout:9/394: chown d1/db/d63/l88 7 1 2022-02-02T18:21:26.253 INFO:tasks.workunit.client.0.smithi096.stdout:7/316: creat d9/df/d12/f6d x:0 0 0 2022-02-02T18:21:26.254 INFO:tasks.workunit.client.0.smithi096.stdout:9/395: dread d1/f36 [0,4194304] 0 2022-02-02T18:21:26.255 INFO:tasks.workunit.client.0.smithi096.stdout:1/354: creat d15/d1b/d28/d47/f79 x:0 0 0 2022-02-02T18:21:26.255 INFO:tasks.workunit.client.0.smithi096.stdout:9/396: dread d1/db/d1c/d2f/d78/d11/d1e/f31 [0,4194304] 0 2022-02-02T18:21:26.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/340: mkdir db/d5c/d2f/d46/d7f 0 2022-02-02T18:21:26.256 INFO:tasks.workunit.client.0.smithi096.stdout:9/397: write d1/db/d1c/f6e [770502,113299] 0 2022-02-02T18:21:26.257 INFO:tasks.workunit.client.0.smithi096.stdout:9/398: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d8c 0 2022-02-02T18:21:26.259 INFO:tasks.workunit.client.0.smithi096.stdout:6/415: symlink d18/d50/d6d/d95/la1 0 2022-02-02T18:21:26.259 INFO:tasks.workunit.client.0.smithi096.stdout:6/416: stat d18/d24/d28/d4a/c57 0 2022-02-02T18:21:26.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/417: chown d18/d54/f3b 81302 1 2022-02-02T18:21:26.260 INFO:tasks.workunit.client.0.smithi096.stdout:1/355: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:26.262 INFO:tasks.workunit.client.0.smithi096.stdout:0/449: rename d2/c22 to d2/db/d24/d4d/d53/c9b 0 2022-02-02T18:21:26.264 INFO:tasks.workunit.client.0.smithi096.stdout:6/418: link d18/d24/d28/c99 d18/d24/d28/d4a/ca2 0 2022-02-02T18:21:26.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/356: dread d15/f1a [4194304,4194304] 0 2022-02-02T18:21:26.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/357: read - d15/d1b/d28/d2c/f5d zero size 2022-02-02T18:21:26.267 INFO:tasks.workunit.client.0.smithi096.stdout:1/358: chown d15/d1b/d26/l3d 0 1 2022-02-02T18:21:26.269 INFO:tasks.workunit.client.0.smithi096.stdout:4/380: rename d3/d27/c52 to d3/d4/d20/d4d/c92 0 2022-02-02T18:21:26.269 INFO:tasks.workunit.client.0.smithi096.stdout:4/381: creat d3/d4/d20/d26/d36/d51/f93 x:0 0 0 2022-02-02T18:21:26.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/382: chown d3/d4/f37 5 1 2022-02-02T18:21:26.270 INFO:tasks.workunit.client.0.smithi096.stdout:0/450: unlink d2/db/c51 0 2022-02-02T18:21:26.271 INFO:tasks.workunit.client.0.smithi096.stdout:0/451: chown d2/c7 341 1 2022-02-02T18:21:26.271 INFO:tasks.workunit.client.0.smithi096.stdout:0/452: fdatasync d2/db/d10/f33 0 2022-02-02T18:21:26.273 INFO:tasks.workunit.client.0.smithi096.stdout:9/399: getdents d1 0 2022-02-02T18:21:26.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/317: dwrite d9/df/d12/f57 [0,4194304] 0 2022-02-02T18:21:26.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/419: rmdir d18/d54/d63/d7e 39 2022-02-02T18:21:26.275 INFO:tasks.workunit.client.0.smithi096.stdout:4/383: write d3/d4/d20/d26/f2f [3544975,42319] 0 2022-02-02T18:21:26.275 INFO:tasks.workunit.client.0.smithi096.stdout:1/359: creat d15/d1b/d26/d6f/f7a x:0 0 0 2022-02-02T18:21:26.276 INFO:tasks.workunit.client.0.smithi096.stdout:1/360: write d15/d1b/d28/f61 [1024526,110691] 0 2022-02-02T18:21:26.278 INFO:tasks.workunit.client.0.smithi096.stdout:5/341: dwrite db/d5c/d2f/d46/f5f [0,4194304] 0 2022-02-02T18:21:26.279 INFO:tasks.workunit.client.0.smithi096.stdout:2/375: sync 2022-02-02T18:21:26.279 INFO:tasks.workunit.client.0.smithi096.stdout:3/347: sync 2022-02-02T18:21:26.279 INFO:tasks.workunit.client.0.smithi096.stdout:2/376: fsync d2/d6/db/d49/d66/f68 0 2022-02-02T18:21:26.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/348: fdatasync d2/df/d14/f30 0 2022-02-02T18:21:26.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/349: read - d2/df/d20/d33/f63 zero size 2022-02-02T18:21:26.280 INFO:tasks.workunit.client.0.smithi096.stdout:2/377: write d2/d13/d43/d51/f69 [846140,95772] 0 2022-02-02T18:21:26.281 INFO:tasks.workunit.client.0.smithi096.stdout:2/378: write d2/d6/d1b/d48/f4d [475607,30902] 0 2022-02-02T18:21:26.281 INFO:tasks.workunit.client.0.smithi096.stdout:0/453: unlink d2/db/d10/d80/l85 0 2022-02-02T18:21:26.282 INFO:tasks.workunit.client.0.smithi096.stdout:9/400: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/f94 x:0 0 0 2022-02-02T18:21:26.284 INFO:tasks.workunit.client.0.smithi096.stdout:7/318: mkdir d9/df/d12/d39/d4e/d6e 0 2022-02-02T18:21:26.284 INFO:tasks.workunit.client.0.smithi096.stdout:7/319: dread - d9/df/d12/d14/f50 zero size 2022-02-02T18:21:26.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/384: mknod d3/d85/c94 0 2022-02-02T18:21:26.286 INFO:tasks.workunit.client.0.smithi096.stdout:1/361: symlink d15/d74/l7b 0 2022-02-02T18:21:26.287 INFO:tasks.workunit.client.0.smithi096.stdout:1/362: truncate d15/f1a 8936318 0 2022-02-02T18:21:26.287 INFO:tasks.workunit.client.0.smithi096.stdout:6/420: dwrite d18/d24/d28/f87 [4194304,4194304] 0 2022-02-02T18:21:26.288 INFO:tasks.workunit.client.0.smithi096.stdout:6/421: write d18/f19 [7678248,36029] 0 2022-02-02T18:21:26.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/342: mkdir db/de/d10/d80 0 2022-02-02T18:21:26.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/454: link d2/f6b d2/d1e/d67/f9c 0 2022-02-02T18:21:26.302 INFO:tasks.workunit.client.0.smithi096.stdout:9/401: creat d1/db/d1c/d2f/d78/f95 x:0 0 0 2022-02-02T18:21:26.302 INFO:tasks.workunit.client.0.smithi096.stdout:9/402: stat d1/db/d1c/d2f/d78/d11/d1e/d47/d50/l7e 0 2022-02-02T18:21:26.303 INFO:tasks.workunit.client.0.smithi096.stdout:1/363: dread d15/d1b/d28/f3e [0,4194304] 0 2022-02-02T18:21:26.303 INFO:tasks.workunit.client.0.smithi096.stdout:7/320: getdents d9/df/d12/d39/d40/d51 0 2022-02-02T18:21:26.306 INFO:tasks.workunit.client.0.smithi096.stdout:6/422: unlink d18/d24/d28/d3e/f71 0 2022-02-02T18:21:26.307 INFO:tasks.workunit.client.0.smithi096.stdout:3/350: getdents d2/df/d14/d2c 0 2022-02-02T18:21:26.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/379: rmdir d2/d6 39 2022-02-02T18:21:26.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/455: symlink d2/d62/l9d 0 2022-02-02T18:21:26.311 INFO:tasks.workunit.client.0.smithi096.stdout:1/364: dread d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:26.312 INFO:tasks.workunit.client.0.smithi096.stdout:9/403: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d8c 0 2022-02-02T18:21:26.312 INFO:tasks.workunit.client.0.smithi096.stdout:9/404: fsync d1/db/d1c/d2f/f3b 0 2022-02-02T18:21:26.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/321: symlink d9/df/d12/d39/l6f 0 2022-02-02T18:21:26.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/322: read d9/df/d12/d39/d41/f49 [449502,71005] 0 2022-02-02T18:21:26.317 INFO:tasks.workunit.client.0.smithi096.stdout:6/423: unlink d18/d50/d6d/f80 0 2022-02-02T18:21:26.318 INFO:tasks.workunit.client.0.smithi096.stdout:8/302: sync 2022-02-02T18:21:26.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/424: write d18/f1c [872035,123392] 0 2022-02-02T18:21:26.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/425: write d18/f23 [1498194,49656] 0 2022-02-02T18:21:26.318 INFO:tasks.workunit.client.0.smithi096.stdout:3/351: unlink d2/df/d1c/l22 0 2022-02-02T18:21:26.319 INFO:tasks.workunit.client.0.smithi096.stdout:4/385: dwrite d3/d4/d14/f58 [0,4194304] 0 2022-02-02T18:21:26.320 INFO:tasks.workunit.client.0.smithi096.stdout:5/343: dwrite db/d5c/f5e [0,4194304] 0 2022-02-02T18:21:26.320 INFO:tasks.workunit.client.0.smithi096.stdout:2/380: symlink d2/d6/d1b/l77 0 2022-02-02T18:21:26.320 INFO:tasks.workunit.client.0.smithi096.stdout:2/381: readlink d2/d6/db/d49/l33 0 2022-02-02T18:21:26.321 INFO:tasks.workunit.client.0.smithi096.stdout:6/426: read d18/d24/d73/d79/f93 [2681762,10666] 0 2022-02-02T18:21:26.321 INFO:tasks.workunit.client.0.smithi096.stdout:0/456: creat d2/d1e/d67/f9e x:0 0 0 2022-02-02T18:21:26.322 INFO:tasks.workunit.client.0.smithi096.stdout:9/405: rename d1/db/d1c/d2f/d78/d25/dd/c44 to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/c96 0 2022-02-02T18:21:26.323 INFO:tasks.workunit.client.0.smithi096.stdout:0/457: read d2/d1e/f36 [2936607,75545] 0 2022-02-02T18:21:26.323 INFO:tasks.workunit.client.0.smithi096.stdout:7/323: unlink d9/df/c38 0 2022-02-02T18:21:26.325 INFO:tasks.workunit.client.0.smithi096.stdout:8/303: creat d29/f62 x:0 0 0 2022-02-02T18:21:26.327 INFO:tasks.workunit.client.0.smithi096.stdout:5/344: truncate f6 786258 0 2022-02-02T18:21:26.327 INFO:tasks.workunit.client.0.smithi096.stdout:5/345: stat db/de/d10/d27/f4d 0 2022-02-02T18:21:26.328 INFO:tasks.workunit.client.0.smithi096.stdout:5/346: chown db/de/d10/l2d 34781 1 2022-02-02T18:21:26.328 INFO:tasks.workunit.client.0.smithi096.stdout:4/386: dread d3/d4/d14/f2d [0,4194304] 0 2022-02-02T18:21:26.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/387: write d3/d4/d20/d26/d36/f44 [641049,91315] 0 2022-02-02T18:21:26.333 INFO:tasks.workunit.client.0.smithi096.stdout:0/458: creat d2/db/d10/d80/f9f x:0 0 0 2022-02-02T18:21:26.334 INFO:tasks.workunit.client.0.smithi096.stdout:8/304: mkdir d29/d58/d63 0 2022-02-02T18:21:26.334 INFO:tasks.workunit.client.0.smithi096.stdout:0/459: creat d2/d1e/fa0 x:0 0 0 2022-02-02T18:21:26.334 INFO:tasks.workunit.client.0.smithi096.stdout:9/406: rename d1/db/d1c/d2f/d78/d11/d1e/d47/d50 to d1/d39/d8a/d97 0 2022-02-02T18:21:26.334 INFO:tasks.workunit.client.0.smithi096.stdout:0/460: chown d2/db/l12 1383 1 2022-02-02T18:21:26.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/461: fdatasync d2/d1e/d67/f9c 0 2022-02-02T18:21:26.335 INFO:tasks.workunit.client.0.smithi096.stdout:9/407: dread - d1/db/d1c/d2f/f54 zero size 2022-02-02T18:21:26.335 INFO:tasks.workunit.client.0.smithi096.stdout:9/408: write d1/f8 [1298672,41732] 0 2022-02-02T18:21:26.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/462: write d2/db/d24/f9a [241393,88749] 0 2022-02-02T18:21:26.336 INFO:tasks.workunit.client.0.smithi096.stdout:9/409: chown d1/d39 10 1 2022-02-02T18:21:26.336 INFO:tasks.workunit.client.0.smithi096.stdout:9/410: read d1/db/d1c/d2f/d78/d11/d1e/f31 [80307,109474] 0 2022-02-02T18:21:26.338 INFO:tasks.workunit.client.0.smithi096.stdout:1/365: dwrite d15/d1b/d28/d2c/f38 [0,4194304] 0 2022-02-02T18:21:26.339 INFO:tasks.workunit.client.0.smithi096.stdout:1/366: stat d15/d1b/d28/d2c/d4f/d51/l55 0 2022-02-02T18:21:26.339 INFO:tasks.workunit.client.0.smithi096.stdout:4/388: symlink d3/d4/d20/d4d/l95 0 2022-02-02T18:21:26.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/382: dread d2/d2a/f45 [0,4194304] 0 2022-02-02T18:21:26.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/383: unlink d2/fe 0 2022-02-02T18:21:26.341 INFO:tasks.workunit.client.0.smithi096.stdout:8/305: unlink d29/d2d/c4c 0 2022-02-02T18:21:26.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/411: creat d1/db/d1c/d2f/d78/d11/d1e/d47/f98 x:0 0 0 2022-02-02T18:21:26.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/412: creat d1/db/f99 x:0 0 0 2022-02-02T18:21:26.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/389: rename d3/d4/c6c to d3/d27/d4a/c96 0 2022-02-02T18:21:26.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/390: fdatasync d3/d4/d20/d26/d36/f8a 0 2022-02-02T18:21:26.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/391: truncate d3/d27/f39 1147183 0 2022-02-02T18:21:26.345 INFO:tasks.workunit.client.0.smithi096.stdout:4/392: dread - d3/d4/d20/d26/d36/d51/f86 zero size 2022-02-02T18:21:26.345 INFO:tasks.workunit.client.0.smithi096.stdout:5/347: dread db/de/d10/d27/f42 [0,4194304] 0 2022-02-02T18:21:26.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/306: creat d29/d4a/d5b/f64 x:0 0 0 2022-02-02T18:21:26.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/307: fdatasync f22 0 2022-02-02T18:21:26.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/308: creat d29/f65 x:0 0 0 2022-02-02T18:21:26.351 INFO:tasks.workunit.client.0.smithi096.stdout:8/309: read d29/d2d/f2f [1344973,61530] 0 2022-02-02T18:21:26.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/310: read d29/d2d/f45 [2019006,25433] 0 2022-02-02T18:21:26.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/311: readlink d29/l2c 0 2022-02-02T18:21:26.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/312: chown d29/d2d/l3b 1018028867 1 2022-02-02T18:21:26.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/352: dwrite d2/df/d14/d11/f1f [0,4194304] 0 2022-02-02T18:21:26.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/353: chown d2/df/d1c/d5d/f48 210 1 2022-02-02T18:21:26.355 INFO:tasks.workunit.client.0.smithi096.stdout:7/324: dwrite d9/df/d47/d19/f35 [0,4194304] 0 2022-02-02T18:21:26.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/325: read d9/df/d12/d14/f61 [88507,113] 0 2022-02-02T18:21:26.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/326: write f2 [2494169,23034] 0 2022-02-02T18:21:26.357 INFO:tasks.workunit.client.0.smithi096.stdout:9/413: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/l75 0 2022-02-02T18:21:26.357 INFO:tasks.workunit.client.0.smithi096.stdout:0/463: dwrite d2/db/f84 [0,4194304] 0 2022-02-02T18:21:26.357 INFO:tasks.workunit.client.0.smithi096.stdout:9/414: creat d1/db/f9a x:0 0 0 2022-02-02T18:21:26.358 INFO:tasks.workunit.client.0.smithi096.stdout:0/464: write d2/db/f63 [425553,87530] 0 2022-02-02T18:21:26.360 INFO:tasks.workunit.client.0.smithi096.stdout:2/384: rename d2/d13/f26 to d2/d13/d42/d71/f78 0 2022-02-02T18:21:26.363 INFO:tasks.workunit.client.0.smithi096.stdout:4/393: link d3/c47 d3/d4/c97 0 2022-02-02T18:21:26.365 INFO:tasks.workunit.client.0.smithi096.stdout:3/354: mkdir d2/df/d20/d33/d58/d7c 0 2022-02-02T18:21:26.371 INFO:tasks.workunit.client.0.smithi096.stdout:0/465: getdents d2/db/d37/d5f 0 2022-02-02T18:21:26.372 INFO:tasks.workunit.client.0.smithi096.stdout:0/466: write d2/db/f19 [855511,52161] 0 2022-02-02T18:21:26.372 INFO:tasks.workunit.client.0.smithi096.stdout:5/348: dwrite db/de/d10/f19 [0,4194304] 0 2022-02-02T18:21:26.373 INFO:tasks.workunit.client.0.smithi096.stdout:4/394: mkdir d3/d4/d20/d26/d36/d88/d98 0 2022-02-02T18:21:26.374 INFO:tasks.workunit.client.0.smithi096.stdout:7/327: rename d9/df/d44/f53 to d9/f70 0 2022-02-02T18:21:26.375 INFO:tasks.workunit.client.0.smithi096.stdout:7/328: write d9/df/d12/d39/d40/f69 [37163,7801] 0 2022-02-02T18:21:26.375 INFO:tasks.workunit.client.0.smithi096.stdout:7/329: chown d9/df/d12/d39/d42/l64 121618155 1 2022-02-02T18:21:26.375 INFO:tasks.workunit.client.0.smithi096.stdout:2/385: dread d2/f72 [0,4194304] 0 2022-02-02T18:21:26.375 INFO:tasks.workunit.client.0.smithi096.stdout:2/386: chown d2/d13/d43/d51 847322 1 2022-02-02T18:21:26.376 INFO:tasks.workunit.client.0.smithi096.stdout:2/387: chown d2/d2a/f45 67040544 1 2022-02-02T18:21:26.376 INFO:tasks.workunit.client.0.smithi096.stdout:5/349: unlink db/de/d10/f19 0 2022-02-02T18:21:26.377 INFO:tasks.workunit.client.0.smithi096.stdout:5/350: readlink db/de/d2e/d35/l21 0 2022-02-02T18:21:26.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/395: creat d3/d4/d20/d26/d36/d88/f99 x:0 0 0 2022-02-02T18:21:26.378 INFO:tasks.workunit.client.0.smithi096.stdout:7/330: symlink d9/df/d12/d39/d40/d6b/l71 0 2022-02-02T18:21:26.378 INFO:tasks.workunit.client.0.smithi096.stdout:7/331: dread - d9/df/d12/d14/f31 zero size 2022-02-02T18:21:26.379 INFO:tasks.workunit.client.0.smithi096.stdout:1/367: dwrite d15/f27 [0,4194304] 0 2022-02-02T18:21:26.380 INFO:tasks.workunit.client.0.smithi096.stdout:1/368: fdatasync d15/d1b/d28/f3e 0 2022-02-02T18:21:26.380 INFO:tasks.workunit.client.0.smithi096.stdout:5/351: creat db/de/d2e/d35/f81 x:0 0 0 2022-02-02T18:21:26.381 INFO:tasks.workunit.client.0.smithi096.stdout:4/396: creat d3/d60/d8d/f9a x:0 0 0 2022-02-02T18:21:26.381 INFO:tasks.workunit.client.0.smithi096.stdout:4/397: read - d3/d27/d4a/f8f zero size 2022-02-02T18:21:26.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/332: mkdir d9/df/d12/d39/d4e/d6e/d72 0 2022-02-02T18:21:26.382 INFO:tasks.workunit.client.0.smithi096.stdout:1/369: mknod d15/d1b/d26/d6f/c7c 0 2022-02-02T18:21:26.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/370: write d15/d1b/d28/f58 [2181050,44239] 0 2022-02-02T18:21:26.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/371: write d15/d1b/d26/f42 [98778,25133] 0 2022-02-02T18:21:26.384 INFO:tasks.workunit.client.0.smithi096.stdout:2/388: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:26.384 INFO:tasks.workunit.client.0.smithi096.stdout:9/415: dwrite d1/d39/f60 [0,4194304] 0 2022-02-02T18:21:26.384 INFO:tasks.workunit.client.0.smithi096.stdout:5/352: rename db/de/d10/d27/f42 to db/d5c/d32/d70/f82 0 2022-02-02T18:21:26.385 INFO:tasks.workunit.client.0.smithi096.stdout:3/355: dwrite d2/df/d14/d2c/d31/f40 [0,4194304] 0 2022-02-02T18:21:26.386 INFO:tasks.workunit.client.0.smithi096.stdout:4/398: creat d3/d85/f9b x:0 0 0 2022-02-02T18:21:26.388 INFO:tasks.workunit.client.0.smithi096.stdout:9/416: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/c9b 0 2022-02-02T18:21:26.390 INFO:tasks.workunit.client.0.smithi096.stdout:7/333: rename d9/df/d47/d37/f3d to d9/df/d47/d60/f73 0 2022-02-02T18:21:26.392 INFO:tasks.workunit.client.0.smithi096.stdout:5/353: mkdir db/de/d10/d27/d83 0 2022-02-02T18:21:26.396 INFO:tasks.workunit.client.0.smithi096.stdout:1/372: dread d15/f2e [0,4194304] 0 2022-02-02T18:21:26.397 INFO:tasks.workunit.client.0.smithi096.stdout:3/356: dread d2/df/d1c/d5d/f48 [0,4194304] 0 2022-02-02T18:21:26.400 INFO:tasks.workunit.client.0.smithi096.stdout:1/373: dread d15/f2e [0,4194304] 0 2022-02-02T18:21:26.403 INFO:tasks.workunit.client.0.smithi096.stdout:9/417: creat d1/db/d48/d69/f9c x:0 0 0 2022-02-02T18:21:26.404 INFO:tasks.workunit.client.0.smithi096.stdout:9/418: dread - d1/db/d1c/d2f/d78/f95 zero size 2022-02-02T18:21:26.405 INFO:tasks.workunit.client.0.smithi096.stdout:2/389: rename d2/d6/db/d49 to d2/d5e/d6d/d79 0 2022-02-02T18:21:26.405 INFO:tasks.workunit.client.0.smithi096.stdout:2/390: read d2/d5e/d6d/d79/f6a [499863,87232] 0 2022-02-02T18:21:26.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/399: dwrite d3/d4/d20/d4d/f4e [0,4194304] 0 2022-02-02T18:21:26.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/400: fdatasync d3/d5a/f5f 0 2022-02-02T18:21:26.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/401: fsync d3/d27/f41 0 2022-02-02T18:21:26.408 INFO:tasks.workunit.client.0.smithi096.stdout:4/402: write f1 [4706597,119367] 0 2022-02-02T18:21:26.408 INFO:tasks.workunit.client.0.smithi096.stdout:7/334: unlink d9/df/d16/d25/c5d 0 2022-02-02T18:21:26.411 INFO:tasks.workunit.client.0.smithi096.stdout:3/357: truncate d2/df/d1c/d5d/d69/f55 1818082 0 2022-02-02T18:21:26.412 INFO:tasks.workunit.client.0.smithi096.stdout:3/358: stat d2 0 2022-02-02T18:21:26.413 INFO:tasks.workunit.client.0.smithi096.stdout:1/374: creat d15/d1b/d28/d2c/d39/d71/f7d x:0 0 0 2022-02-02T18:21:26.413 INFO:tasks.workunit.client.0.smithi096.stdout:1/375: write d15/d1b/d28/d2c/d39/d71/f7d [126729,6583] 0 2022-02-02T18:21:26.419 INFO:tasks.workunit.client.0.smithi096.stdout:9/419: mkdir d1/db/d1c/d2f/d78/d25/d8e/d9d 0 2022-02-02T18:21:26.420 INFO:tasks.workunit.client.0.smithi096.stdout:2/391: getdents d2/d6/db 0 2022-02-02T18:21:26.420 INFO:tasks.workunit.client.0.smithi096.stdout:2/392: write d2/d6/d1b/f39 [190808,58712] 0 2022-02-02T18:21:26.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/393: truncate d2/d6/d1b/d3a/f44 767117 0 2022-02-02T18:21:26.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/403: mknod d3/d5a/d91/c9c 0 2022-02-02T18:21:26.425 INFO:tasks.workunit.client.0.smithi096.stdout:4/404: dread d3/d4/f37 [0,4194304] 0 2022-02-02T18:21:26.429 INFO:tasks.workunit.client.0.smithi096.stdout:7/335: creat d9/df/d12/d39/d4e/d6e/f74 x:0 0 0 2022-02-02T18:21:26.432 INFO:tasks.workunit.client.0.smithi096.stdout:5/354: getdents db/de/d10/d25 0 2022-02-02T18:21:26.432 INFO:tasks.workunit.client.0.smithi096.stdout:5/355: dread - db/f6c zero size 2022-02-02T18:21:26.434 INFO:tasks.workunit.client.0.smithi096.stdout:3/359: mknod d2/df/d1c/d5d/d69/d43/c7d 0 2022-02-02T18:21:26.435 INFO:tasks.workunit.client.0.smithi096.stdout:1/376: mknod d15/d1b/d28/d2c/d39/c7e 0 2022-02-02T18:21:26.438 INFO:tasks.workunit.client.0.smithi096.stdout:9/420: link d1/db/d1c/d2f/f32 d1/db/d1c/d2f/d78/d11/d1e/f9e 0 2022-02-02T18:21:26.441 INFO:tasks.workunit.client.0.smithi096.stdout:2/394: creat d2/d13/d42/d71/f7a x:0 0 0 2022-02-02T18:21:26.442 INFO:tasks.workunit.client.0.smithi096.stdout:2/395: chown d2/d2a/f45 1 1 2022-02-02T18:21:26.442 INFO:tasks.workunit.client.0.smithi096.stdout:2/396: fdatasync d2/d29/f32 0 2022-02-02T18:21:26.444 INFO:tasks.workunit.client.0.smithi096.stdout:7/336: chown d9/df/d12/d39/d40/d51 19613 1 2022-02-02T18:21:26.446 INFO:tasks.workunit.client.0.smithi096.stdout:1/377: creat d15/d1b/d26/d72/f7f x:0 0 0 2022-02-02T18:21:26.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/337: rmdir d9/df/d12/d39/d4e 39 2022-02-02T18:21:26.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/338: creat d9/df/d12/d39/f75 x:0 0 0 2022-02-02T18:21:26.450 INFO:tasks.workunit.client.0.smithi096.stdout:2/397: dread d2/f24 [0,4194304] 0 2022-02-02T18:21:26.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/339: write d9/df/d12/d14/f50 [934086,35492] 0 2022-02-02T18:21:26.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/340: getdents d9/df/d12/d39/d4e/d6e/d72 0 2022-02-02T18:21:26.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/341: mknod d9/df/d12/d39/d4e/d6e/d72/c76 0 2022-02-02T18:21:26.454 INFO:tasks.workunit.client.0.smithi096.stdout:2/398: symlink d2/d13/l7b 0 2022-02-02T18:21:26.455 INFO:tasks.workunit.client.0.smithi096.stdout:7/342: truncate d9/df/d16/f2a 3972721 0 2022-02-02T18:21:26.458 INFO:tasks.workunit.client.0.smithi096.stdout:5/356: dwrite db/d5c/d2f/d46/f78 [0,4194304] 0 2022-02-02T18:21:26.458 INFO:tasks.workunit.client.0.smithi096.stdout:5/357: stat db/de/d10/d25/d4c 0 2022-02-02T18:21:26.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/399: mkdir d2/d5e/d7c 0 2022-02-02T18:21:26.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/400: fsync d2/d19/f70 0 2022-02-02T18:21:26.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/405: dwrite d3/d4/d20/f22 [0,4194304] 0 2022-02-02T18:21:26.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/406: truncate d3/d4/d20/d26/d36/d88/f99 88732 0 2022-02-02T18:21:26.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/401: getdents d2/d6/d1b 0 2022-02-02T18:21:26.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/343: write d9/df/d12/d39/d40/d51/f59 [3528119,110458] 0 2022-02-02T18:21:26.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/421: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:26.466 INFO:tasks.workunit.client.0.smithi096.stdout:2/402: rename d2/d5e/d6d/d79/f22 to d2/d5e/d6d/f7d 0 2022-02-02T18:21:26.466 INFO:tasks.workunit.client.0.smithi096.stdout:7/344: readlink d9/l11 0 2022-02-02T18:21:26.466 INFO:tasks.workunit.client.0.smithi096.stdout:7/345: getdents d9/df/d12/d39/d40/d51 0 2022-02-02T18:21:26.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/407: dread d3/d4/f24 [0,4194304] 0 2022-02-02T18:21:26.468 INFO:tasks.workunit.client.0.smithi096.stdout:9/422: unlink d1/db/d48/d69/f93 0 2022-02-02T18:21:26.469 INFO:tasks.workunit.client.0.smithi096.stdout:5/358: dread db/d5c/f55 [0,4194304] 0 2022-02-02T18:21:26.469 INFO:tasks.workunit.client.0.smithi096.stdout:2/403: symlink d2/d13/d43/d51/d73/l7e 0 2022-02-02T18:21:26.471 INFO:tasks.workunit.client.0.smithi096.stdout:4/408: link d3/f10 d3/d4/d14/d55/f9d 0 2022-02-02T18:21:26.471 INFO:tasks.workunit.client.0.smithi096.stdout:4/409: readlink d3/d4/d20/d26/d36/l64 0 2022-02-02T18:21:26.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/423: getdents d1/db/d1c/d2f/d78/d25/d8e 0 2022-02-02T18:21:26.472 INFO:tasks.workunit.client.0.smithi096.stdout:3/360: dwrite d2/df/d14/f18 [0,4194304] 0 2022-02-02T18:21:26.472 INFO:tasks.workunit.client.0.smithi096.stdout:1/378: dwrite d15/d1b/d26/f49 [0,4194304] 0 2022-02-02T18:21:26.477 INFO:tasks.workunit.client.0.smithi096.stdout:5/359: mknod db/de/d10/d25/d4c/c84 0 2022-02-02T18:21:26.478 INFO:tasks.workunit.client.0.smithi096.stdout:2/404: truncate d2/f24 2795826 0 2022-02-02T18:21:26.479 INFO:tasks.workunit.client.0.smithi096.stdout:7/346: rename d9/ca to d9/df/d47/d37/c77 0 2022-02-02T18:21:26.481 INFO:tasks.workunit.client.0.smithi096.stdout:4/410: creat d3/d4/d14/f9e x:0 0 0 2022-02-02T18:21:26.482 INFO:tasks.workunit.client.0.smithi096.stdout:4/411: write d3/d27/d4a/f6e [1194162,35802] 0 2022-02-02T18:21:26.482 INFO:tasks.workunit.client.0.smithi096.stdout:4/412: fsync d3/d4/f24 0 2022-02-02T18:21:26.484 INFO:tasks.workunit.client.0.smithi096.stdout:7/347: dread d9/df/d47/d19/f1e [4194304,4194304] 0 2022-02-02T18:21:26.486 INFO:tasks.workunit.client.0.smithi096.stdout:9/424: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/d9f 0 2022-02-02T18:21:26.486 INFO:tasks.workunit.client.0.smithi096.stdout:9/425: chown d1/db/d1c/d2f/d78/d25/dd/d49/c4f 33 1 2022-02-02T18:21:26.489 INFO:tasks.workunit.client.0.smithi096.stdout:1/379: creat d15/d1b/d26/d59/f80 x:0 0 0 2022-02-02T18:21:26.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/360: mkdir db/d5c/d32/d70/d85 0 2022-02-02T18:21:26.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/361: stat db/d5c/d2f/d46/d7f 0 2022-02-02T18:21:26.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/362: getdents db/d62 0 2022-02-02T18:21:26.491 INFO:tasks.workunit.client.0.smithi096.stdout:3/361: rename d2/df/d20/c35 to d2/df/d14/d66/c7e 0 2022-02-02T18:21:26.492 INFO:tasks.workunit.client.0.smithi096.stdout:3/362: write d2/df/d14/d2c/d31/f40 [469788,89346] 0 2022-02-02T18:21:26.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/363: creat d2/df/d36/f7f x:0 0 0 2022-02-02T18:21:26.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/364: write d2/df/d1c/d5d/f48 [3453563,6501] 0 2022-02-02T18:21:26.496 INFO:tasks.workunit.client.0.smithi096.stdout:4/413: creat d3/d4/d90/f9f x:0 0 0 2022-02-02T18:21:26.499 INFO:tasks.workunit.client.0.smithi096.stdout:4/414: write d3/d4/f1c [3510030,553] 0 2022-02-02T18:21:26.499 INFO:tasks.workunit.client.0.smithi096.stdout:4/415: stat d3/d4/d20/d26/d36/d51 0 2022-02-02T18:21:26.500 INFO:tasks.workunit.client.0.smithi096.stdout:4/416: creat d3/d85/fa0 x:0 0 0 2022-02-02T18:21:26.500 INFO:tasks.workunit.client.0.smithi096.stdout:4/417: write d3/d4/d14/d55/f7d [453857,77116] 0 2022-02-02T18:21:26.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/348: mknod d9/df/d12/d39/d40/c78 0 2022-02-02T18:21:26.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/349: truncate d9/df/d12/d39/d40/f6c 871375 0 2022-02-02T18:21:26.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/350: fsync d9/fd 0 2022-02-02T18:21:26.501 INFO:tasks.workunit.client.0.smithi096.stdout:9/426: creat d1/d39/d8a/d97/fa0 x:0 0 0 2022-02-02T18:21:26.501 INFO:tasks.workunit.client.0.smithi096.stdout:5/363: dread db/de/d2e/f51 [0,4194304] 0 2022-02-02T18:21:26.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/351: dread d9/df/d12/d39/d40/f69 [0,4194304] 0 2022-02-02T18:21:26.502 INFO:tasks.workunit.client.0.smithi096.stdout:7/352: chown d9/df/d12/d39/d40/d51/f59 538 1 2022-02-02T18:21:26.502 INFO:tasks.workunit.client.0.smithi096.stdout:1/380: creat d15/d4d/f81 x:0 0 0 2022-02-02T18:21:26.503 INFO:tasks.workunit.client.0.smithi096.stdout:2/405: rename d2/d2a/f45 to d2/d6/d1b/d3a/f7f 0 2022-02-02T18:21:26.503 INFO:tasks.workunit.client.0.smithi096.stdout:2/406: chown d2/d6/d76 1954569 1 2022-02-02T18:21:26.503 INFO:tasks.workunit.client.0.smithi096.stdout:2/407: truncate d2/d13/d43/f47 756593 0 2022-02-02T18:21:26.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/365: mknod d2/df/d1c/d5d/d6d/c80 0 2022-02-02T18:21:26.507 INFO:tasks.workunit.client.0.smithi096.stdout:3/366: write d2/df/d20/d33/d58/f67 [520846,55969] 0 2022-02-02T18:21:26.507 INFO:tasks.workunit.client.0.smithi096.stdout:3/367: fsync d2/df/d34/f39 0 2022-02-02T18:21:26.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/381: truncate d15/d1b/f2f 1140289 0 2022-02-02T18:21:26.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/382: write d15/d1b/d26/d72/f7f [777126,51183] 0 2022-02-02T18:21:26.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/383: creat d15/d1b/d26/d6f/f82 x:0 0 0 2022-02-02T18:21:26.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/384: dread - d15/d4d/f81 zero size 2022-02-02T18:21:26.513 INFO:tasks.workunit.client.0.smithi096.stdout:9/427: rename d1/db/d1c/c3a to d1/db/d1c/d2f/ca1 0 2022-02-02T18:21:26.513 INFO:tasks.workunit.client.0.smithi096.stdout:9/428: write d1/db/d48/f8d [259407,23670] 0 2022-02-02T18:21:26.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/408: readlink d2/d13/l2d 0 2022-02-02T18:21:26.514 INFO:tasks.workunit.client.0.smithi096.stdout:1/385: read d15/f1a [2675759,31177] 0 2022-02-02T18:21:26.514 INFO:tasks.workunit.client.0.smithi096.stdout:9/429: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f1f [988034,68866] 0 2022-02-02T18:21:26.515 INFO:tasks.workunit.client.0.smithi096.stdout:9/430: readlink d1/db/d1c/d2f/d78/d25/dd/l85 0 2022-02-02T18:21:26.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/368: symlink d2/df/d20/d33/d58/l81 0 2022-02-02T18:21:26.518 INFO:tasks.workunit.client.0.smithi096.stdout:1/386: dread d15/f2e [0,4194304] 0 2022-02-02T18:21:26.519 INFO:tasks.workunit.client.0.smithi096.stdout:1/387: creat d15/d1b/d26/d72/f83 x:0 0 0 2022-02-02T18:21:26.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/353: link d9/df/d16/l1a d9/l79 0 2022-02-02T18:21:26.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/409: getdents d2/d5e/d6d 0 2022-02-02T18:21:26.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/369: symlink d2/df/d1c/d5d/d69/d43/d72/l82 0 2022-02-02T18:21:26.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/370: write d2/df/d14/d2c/d74/f7b [1647690,115452] 0 2022-02-02T18:21:26.524 INFO:tasks.workunit.client.0.smithi096.stdout:1/388: mkdir d15/d1b/d28/d2c/d84 0 2022-02-02T18:21:26.526 INFO:tasks.workunit.client.0.smithi096.stdout:7/354: rename d9/df/d12/d39/d42/f4d to d9/df/d54/f7a 0 2022-02-02T18:21:26.527 INFO:tasks.workunit.client.0.smithi096.stdout:1/389: rename d15/d1b/d28/d2c/d39 to d15/d1b/d28/d2c/d39/d85 22 2022-02-02T18:21:26.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/355: chown d9/df/d12/d14/c34 153809503 1 2022-02-02T18:21:26.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/356: creat d9/df/d12/d39/f7b x:0 0 0 2022-02-02T18:21:26.528 INFO:tasks.workunit.client.0.smithi096.stdout:2/410: mkdir d2/d13/d43/d80 0 2022-02-02T18:21:26.529 INFO:tasks.workunit.client.0.smithi096.stdout:2/411: write d2/d5e/d6d/d79/f6a [283178,128954] 0 2022-02-02T18:21:26.529 INFO:tasks.workunit.client.0.smithi096.stdout:2/412: chown d2/d13/l35 414 1 2022-02-02T18:21:26.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/390: creat d15/d1b/d28/d47/f86 x:0 0 0 2022-02-02T18:21:26.530 INFO:tasks.workunit.client.0.smithi096.stdout:2/413: dread d2/d6/fa [0,4194304] 0 2022-02-02T18:21:26.531 INFO:tasks.workunit.client.0.smithi096.stdout:7/357: mknod d9/df/d12/d39/d40/c7c 0 2022-02-02T18:21:26.531 INFO:tasks.workunit.client.0.smithi096.stdout:1/391: rename d15/d1b/d28/d2c/d4f/c64 to d15/d1b/d28/d3f/c87 0 2022-02-02T18:21:26.532 INFO:tasks.workunit.client.0.smithi096.stdout:2/414: mkdir d2/d5e/d6d/d79/d81 0 2022-02-02T18:21:26.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/358: stat d9/df/d47/d19/l2c 0 2022-02-02T18:21:26.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/359: readlink d9/df/d12/d14/l3c 0 2022-02-02T18:21:26.534 INFO:tasks.workunit.client.0.smithi096.stdout:2/415: creat d2/d6/d1b/d48/f82 x:0 0 0 2022-02-02T18:21:26.535 INFO:tasks.workunit.client.0.smithi096.stdout:5/364: dwrite db/d5c/d2f/d46/f74 [0,4194304] 0 2022-02-02T18:21:26.536 INFO:tasks.workunit.client.0.smithi096.stdout:4/418: dwrite d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:26.536 INFO:tasks.workunit.client.0.smithi096.stdout:4/419: fdatasync f1 0 2022-02-02T18:21:26.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/360: rmdir d9/df/d44 39 2022-02-02T18:21:26.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/361: truncate d9/df/d54/f7a 829243 0 2022-02-02T18:21:26.540 INFO:tasks.workunit.client.0.smithi096.stdout:9/431: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/f94 [0,4194304] 0 2022-02-02T18:21:26.540 INFO:tasks.workunit.client.0.smithi096.stdout:3/371: dread d2/df/d20/d33/f3b [0,4194304] 0 2022-02-02T18:21:26.540 INFO:tasks.workunit.client.0.smithi096.stdout:3/372: fsync d2/df/f26 0 2022-02-02T18:21:26.540 INFO:tasks.workunit.client.0.smithi096.stdout:4/420: rename d3/d4/d50/c8b to d3/d27/ca1 0 2022-02-02T18:21:26.541 INFO:tasks.workunit.client.0.smithi096.stdout:4/421: truncate d3/d4/d14/f46 2251625 0 2022-02-02T18:21:26.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/362: write d9/df/d12/f45 [781184,109312] 0 2022-02-02T18:21:26.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/363: chown d9/df/d12/d39/d42 6007048 1 2022-02-02T18:21:26.543 INFO:tasks.workunit.client.0.smithi096.stdout:4/422: read d3/d4/d20/d26/f2f [18938,21853] 0 2022-02-02T18:21:26.544 INFO:tasks.workunit.client.0.smithi096.stdout:4/423: truncate d3/d27/d4a/f8f 1022072 0 2022-02-02T18:21:26.547 INFO:tasks.workunit.client.0.smithi096.stdout:5/365: dread db/d5c/d2f/d46/f78 [0,4194304] 0 2022-02-02T18:21:26.551 INFO:tasks.workunit.client.0.smithi096.stdout:4/424: write d3/d4/d14/f2d [2163442,54358] 0 2022-02-02T18:21:26.552 INFO:tasks.workunit.client.0.smithi096.stdout:2/416: fsync d2/d6/d1b/d48/f82 0 2022-02-02T18:21:26.555 INFO:tasks.workunit.client.0.smithi096.stdout:9/432: mkdir d1/db/d63/da2 0 2022-02-02T18:21:26.556 INFO:tasks.workunit.client.0.smithi096.stdout:9/433: truncate d1/f36 906616 0 2022-02-02T18:21:26.556 INFO:tasks.workunit.client.0.smithi096.stdout:1/392: dwrite ff [0,4194304] 0 2022-02-02T18:21:26.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/373: rmdir d2/df/d14/d11 39 2022-02-02T18:21:26.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/364: chown d9/df/d12/c36 519 1 2022-02-02T18:21:26.558 INFO:tasks.workunit.client.0.smithi096.stdout:5/366: symlink db/de/d10/d25/l86 0 2022-02-02T18:21:26.561 INFO:tasks.workunit.client.0.smithi096.stdout:4/425: unlink d3/d4/d20/d26/d36/d51/f93 0 2022-02-02T18:21:26.562 INFO:tasks.workunit.client.0.smithi096.stdout:4/426: chown d3/d4/d20/d4d/l95 1344 1 2022-02-02T18:21:26.562 INFO:tasks.workunit.client.0.smithi096.stdout:2/417: creat d2/d5e/d7c/f83 x:0 0 0 2022-02-02T18:21:26.563 INFO:tasks.workunit.client.0.smithi096.stdout:2/418: chown d2/d6/d1b/l4f 3 1 2022-02-02T18:21:26.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/313: sync 2022-02-02T18:21:26.565 INFO:tasks.workunit.client.0.smithi096.stdout:6/427: sync 2022-02-02T18:21:26.565 INFO:tasks.workunit.client.0.smithi096.stdout:6/428: chown d18/d54/d63/f6f 2 1 2022-02-02T18:21:26.565 INFO:tasks.workunit.client.0.smithi096.stdout:6/429: chown ce 3 1 2022-02-02T18:21:26.566 INFO:tasks.workunit.client.0.smithi096.stdout:6/430: write d18/f26 [853201,53007] 0 2022-02-02T18:21:26.566 INFO:tasks.workunit.client.0.smithi096.stdout:9/434: mkdir d1/db/d1c/d2f/d78/d11/d1e/d47/da3 0 2022-02-02T18:21:26.567 INFO:tasks.workunit.client.0.smithi096.stdout:1/393: mknod d15/d1b/d26/c88 0 2022-02-02T18:21:26.568 INFO:tasks.workunit.client.0.smithi096.stdout:3/374: creat d2/d71/f83 x:0 0 0 2022-02-02T18:21:26.569 INFO:tasks.workunit.client.0.smithi096.stdout:7/365: getdents d9/df/d47/d19 0 2022-02-02T18:21:26.572 INFO:tasks.workunit.client.0.smithi096.stdout:5/367: rename db/d5c/d32/l64 to db/de/d2e/l87 0 2022-02-02T18:21:26.573 INFO:tasks.workunit.client.0.smithi096.stdout:0/467: sync 2022-02-02T18:21:26.574 INFO:tasks.workunit.client.0.smithi096.stdout:0/468: dread d2/db/d10/d27/f2d [0,4194304] 0 2022-02-02T18:21:26.574 INFO:tasks.workunit.client.0.smithi096.stdout:0/469: fsync d2/db/d10/f16 0 2022-02-02T18:21:26.574 INFO:tasks.workunit.client.0.smithi096.stdout:4/427: link d3/d5a/f63 d3/d4/d50/fa2 0 2022-02-02T18:21:26.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/419: creat d2/d6/d76/f84 x:0 0 0 2022-02-02T18:21:26.576 INFO:tasks.workunit.client.0.smithi096.stdout:8/314: mknod d29/d40/c66 0 2022-02-02T18:21:26.576 INFO:tasks.workunit.client.0.smithi096.stdout:8/315: creat d29/d2d/d42/f67 x:0 0 0 2022-02-02T18:21:26.576 INFO:tasks.workunit.client.0.smithi096.stdout:8/316: creat d29/d2d/d42/f68 x:0 0 0 2022-02-02T18:21:26.577 INFO:tasks.workunit.client.0.smithi096.stdout:8/317: write d29/d40/f5c [953050,54754] 0 2022-02-02T18:21:26.578 INFO:tasks.workunit.client.0.smithi096.stdout:6/431: mknod d18/d24/d73/d79/ca3 0 2022-02-02T18:21:26.579 INFO:tasks.workunit.client.0.smithi096.stdout:9/435: mknod d1/db/d1c/d2f/d78/d25/ca4 0 2022-02-02T18:21:26.579 INFO:tasks.workunit.client.0.smithi096.stdout:6/432: getdents d18/d24/d28/d4a/d9d 0 2022-02-02T18:21:26.579 INFO:tasks.workunit.client.0.smithi096.stdout:9/436: chown d1/db/d1c/d2f/d78/d11/d1e/d47/c62 3151075 1 2022-02-02T18:21:26.579 INFO:tasks.workunit.client.0.smithi096.stdout:3/375: rename d2/df/d14/d66/c6f to d2/df/d14/d66/c84 0 2022-02-02T18:21:26.580 INFO:tasks.workunit.client.0.smithi096.stdout:7/366: mkdir d9/df/d12/d39/d46/d7d 0 2022-02-02T18:21:26.580 INFO:tasks.workunit.client.0.smithi096.stdout:9/437: write d1/db/d1c/d2f/f32 [4292651,9452] 0 2022-02-02T18:21:26.581 INFO:tasks.workunit.client.0.smithi096.stdout:5/368: mknod db/d5c/d32/c88 0 2022-02-02T18:21:26.581 INFO:tasks.workunit.client.0.smithi096.stdout:4/428: truncate d3/d4/f37 299009 0 2022-02-02T18:21:26.582 INFO:tasks.workunit.client.0.smithi096.stdout:4/429: truncate d3/d27/f78 997690 0 2022-02-02T18:21:26.582 INFO:tasks.workunit.client.0.smithi096.stdout:4/430: dread d3/d4/d20/d26/d36/d88/f99 [0,4194304] 0 2022-02-02T18:21:26.583 INFO:tasks.workunit.client.0.smithi096.stdout:2/420: creat d2/d13/d43/d51/f85 x:0 0 0 2022-02-02T18:21:26.583 INFO:tasks.workunit.client.0.smithi096.stdout:1/394: dwrite d15/d1b/d28/d2c/f38 [0,4194304] 0 2022-02-02T18:21:26.585 INFO:tasks.workunit.client.0.smithi096.stdout:3/376: symlink d2/l85 0 2022-02-02T18:21:26.586 INFO:tasks.workunit.client.0.smithi096.stdout:3/377: write d2/df/d20/d33/f51 [552390,52945] 0 2022-02-02T18:21:26.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/367: write d9/df/d12/f3f [1883298,62271] 0 2022-02-02T18:21:26.591 INFO:tasks.workunit.client.0.smithi096.stdout:6/433: dread d18/d50/f51 [0,4194304] 0 2022-02-02T18:21:26.591 INFO:tasks.workunit.client.0.smithi096.stdout:6/434: chown d18/d54/c69 0 1 2022-02-02T18:21:26.592 INFO:tasks.workunit.client.0.smithi096.stdout:6/435: creat d18/d50/d8f/fa4 x:0 0 0 2022-02-02T18:21:26.592 INFO:tasks.workunit.client.0.smithi096.stdout:9/438: unlink d1/db/d1c/d2f/d78/d11/l22 0 2022-02-02T18:21:26.592 INFO:tasks.workunit.client.0.smithi096.stdout:5/369: rename db/de/d10/l2d to db/d5c/l89 0 2022-02-02T18:21:26.593 INFO:tasks.workunit.client.0.smithi096.stdout:4/431: symlink d3/d4/d50/la3 0 2022-02-02T18:21:26.593 INFO:tasks.workunit.client.0.smithi096.stdout:4/432: chown d3/d4/d14/f75 507 1 2022-02-02T18:21:26.593 INFO:tasks.workunit.client.0.smithi096.stdout:4/433: fdatasync d3/d4/d14/f46 0 2022-02-02T18:21:26.594 INFO:tasks.workunit.client.0.smithi096.stdout:4/434: dread - d3/d85/f9b zero size 2022-02-02T18:21:26.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/378: dread d2/df/d1c/d5d/d69/f55 [0,4194304] 0 2022-02-02T18:21:26.599 INFO:tasks.workunit.client.0.smithi096.stdout:7/368: link d9/df/d12/d39/d40/f69 d9/df/d12/d39/d46/f7e 0 2022-02-02T18:21:26.600 INFO:tasks.workunit.client.0.smithi096.stdout:6/436: mknod d18/d50/d8f/ca5 0 2022-02-02T18:21:26.602 INFO:tasks.workunit.client.0.smithi096.stdout:9/439: link d1/f36 d1/db/d1c/d2f/d78/d25/d8e/d9d/fa5 0 2022-02-02T18:21:26.604 INFO:tasks.workunit.client.0.smithi096.stdout:6/437: read d18/d24/f33 [846606,83348] 0 2022-02-02T18:21:26.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/370: link db/d5c/f5e db/de/d2e/f8a 0 2022-02-02T18:21:26.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/371: readlink db/l14 0 2022-02-02T18:21:26.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/372: stat db/d5c/d60 0 2022-02-02T18:21:26.608 INFO:tasks.workunit.client.0.smithi096.stdout:5/373: chown db/d5c/d32 18898269 1 2022-02-02T18:21:26.608 INFO:tasks.workunit.client.0.smithi096.stdout:0/470: dwrite d2/db/d10/d27/f73 [0,4194304] 0 2022-02-02T18:21:26.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/435: creat d3/d4/d20/d26/d36/d88/d98/fa4 x:0 0 0 2022-02-02T18:21:26.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/436: dread - d3/d5a/f68 zero size 2022-02-02T18:21:26.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/437: readlink d3/l49 0 2022-02-02T18:21:26.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/438: chown d3/d4/d20/d26/d36/f44 107668 1 2022-02-02T18:21:26.610 INFO:tasks.workunit.client.0.smithi096.stdout:3/379: symlink d2/df/d1c/d5d/l86 0 2022-02-02T18:21:26.611 INFO:tasks.workunit.client.0.smithi096.stdout:3/380: chown d2/df/d14/d11/f2b 15 1 2022-02-02T18:21:26.611 INFO:tasks.workunit.client.0.smithi096.stdout:3/381: write d2/df/d14/f18 [4284892,39073] 0 2022-02-02T18:21:26.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/374: creat db/d5c/d61/f8b x:0 0 0 2022-02-02T18:21:26.613 INFO:tasks.workunit.client.0.smithi096.stdout:0/471: mkdir d2/db/d24/d89/d8f/da1 0 2022-02-02T18:21:26.614 INFO:tasks.workunit.client.0.smithi096.stdout:8/318: dwrite f1c [0,4194304] 0 2022-02-02T18:21:26.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/439: getdents d3/d27 0 2022-02-02T18:21:26.616 INFO:tasks.workunit.client.0.smithi096.stdout:7/369: dread d9/df/d47/d19/f1e [0,4194304] 0 2022-02-02T18:21:26.617 INFO:tasks.workunit.client.0.smithi096.stdout:4/440: truncate d3/f4f 328853 0 2022-02-02T18:21:26.617 INFO:tasks.workunit.client.0.smithi096.stdout:7/370: dread - d9/df/d12/d39/f75 zero size 2022-02-02T18:21:26.617 INFO:tasks.workunit.client.0.smithi096.stdout:5/375: rmdir db/d5c/d60/d72 0 2022-02-02T18:21:26.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/472: symlink d2/db/d24/d4d/d65/la2 0 2022-02-02T18:21:26.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/473: getdents d2/db/d24/d89/d8f/da1 0 2022-02-02T18:21:26.619 INFO:tasks.workunit.client.0.smithi096.stdout:8/319: mknod d29/d4e/c69 0 2022-02-02T18:21:26.620 INFO:tasks.workunit.client.0.smithi096.stdout:2/421: dwrite d2/f72 [0,4194304] 0 2022-02-02T18:21:26.620 INFO:tasks.workunit.client.0.smithi096.stdout:1/395: dwrite d15/f2e [0,4194304] 0 2022-02-02T18:21:26.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/371: write d9/df/d16/d25/f55 [3009007,57902] 0 2022-02-02T18:21:26.625 INFO:tasks.workunit.client.0.smithi096.stdout:7/372: fdatasync d9/df/d47/d60/f73 0 2022-02-02T18:21:26.626 INFO:tasks.workunit.client.0.smithi096.stdout:5/376: creat db/d5c/d60/f8c x:0 0 0 2022-02-02T18:21:26.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/438: dwrite d18/f31 [0,4194304] 0 2022-02-02T18:21:26.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/439: unlink d18/d24/d28/d3e/f42 0 2022-02-02T18:21:26.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/422: dread d2/d6/d1b/f39 [0,4194304] 0 2022-02-02T18:21:26.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/423: read d2/f9 [4694042,27933] 0 2022-02-02T18:21:26.634 INFO:tasks.workunit.client.0.smithi096.stdout:8/320: symlink d29/d40/l6a 0 2022-02-02T18:21:26.634 INFO:tasks.workunit.client.0.smithi096.stdout:8/321: read d29/d2d/d42/f61 [160442,53910] 0 2022-02-02T18:21:26.635 INFO:tasks.workunit.client.0.smithi096.stdout:8/322: chown d29/d2d/f3d 610739 1 2022-02-02T18:21:26.635 INFO:tasks.workunit.client.0.smithi096.stdout:8/323: read - d29/d2d/d42/f68 zero size 2022-02-02T18:21:26.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/396: creat d15/d1b/d28/d2c/d4f/f89 x:0 0 0 2022-02-02T18:21:26.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/397: chown d15/d1b/f29 2328949 1 2022-02-02T18:21:26.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/398: chown d15/d1b/d26/d59/f80 1553323793 1 2022-02-02T18:21:26.637 INFO:tasks.workunit.client.0.smithi096.stdout:1/399: fdatasync d15/f2a 0 2022-02-02T18:21:26.637 INFO:tasks.workunit.client.0.smithi096.stdout:3/382: dwrite d2/df/f24 [0,4194304] 0 2022-02-02T18:21:26.637 INFO:tasks.workunit.client.0.smithi096.stdout:7/373: rename d9/df/d54/l58 to d9/df/d12/d39/d42/l7f 0 2022-02-02T18:21:26.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/383: write d2/df/d14/f30 [556012,89410] 0 2022-02-02T18:21:26.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/377: symlink db/l8d 0 2022-02-02T18:21:26.639 INFO:tasks.workunit.client.0.smithi096.stdout:0/474: rmdir d2/d66/d71 39 2022-02-02T18:21:26.639 INFO:tasks.workunit.client.0.smithi096.stdout:0/475: fsync d2/f69 0 2022-02-02T18:21:26.640 INFO:tasks.workunit.client.0.smithi096.stdout:4/441: dwrite d3/d4/d20/d26/f34 [0,4194304] 0 2022-02-02T18:21:26.643 INFO:tasks.workunit.client.0.smithi096.stdout:2/424: mkdir d2/d19/d86 0 2022-02-02T18:21:26.643 INFO:tasks.workunit.client.0.smithi096.stdout:2/425: write d2/d19/f59 [650710,121954] 0 2022-02-02T18:21:26.644 INFO:tasks.workunit.client.0.smithi096.stdout:8/324: dread d29/d2d/f45 [0,4194304] 0 2022-02-02T18:21:26.647 INFO:tasks.workunit.client.0.smithi096.stdout:1/400: mkdir d15/d1b/d28/d2c/d39/d6b/d8a 0 2022-02-02T18:21:26.650 INFO:tasks.workunit.client.0.smithi096.stdout:7/374: rename d9/df/d12/d39/d40/c7c to d9/df/d12/d39/d4e/c80 0 2022-02-02T18:21:26.651 INFO:tasks.workunit.client.0.smithi096.stdout:1/401: read d15/d1b/d26/f31 [1084285,123110] 0 2022-02-02T18:21:26.651 INFO:tasks.workunit.client.0.smithi096.stdout:5/378: mknod db/de/d10/d80/c8e 0 2022-02-02T18:21:26.652 INFO:tasks.workunit.client.0.smithi096.stdout:0/476: mkdir d2/db/d10/d80/d93/da3 0 2022-02-02T18:21:26.653 INFO:tasks.workunit.client.0.smithi096.stdout:0/477: write d2/db/d10/f28 [756110,50536] 0 2022-02-02T18:21:26.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/442: mkdir d3/d85/da5 0 2022-02-02T18:21:26.656 INFO:tasks.workunit.client.0.smithi096.stdout:4/443: chown d3/d4/d20/d4d/l95 1236 1 2022-02-02T18:21:26.656 INFO:tasks.workunit.client.0.smithi096.stdout:4/444: fdatasync d3/d27/d4a/f6e 0 2022-02-02T18:21:26.658 INFO:tasks.workunit.client.0.smithi096.stdout:8/325: stat le 0 2022-02-02T18:21:26.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/426: dwrite d2/d5e/d6d/d79/f1d [0,4194304] 0 2022-02-02T18:21:26.660 INFO:tasks.workunit.client.0.smithi096.stdout:3/384: rename d2/f4e to d2/df/d14/d2c/f87 0 2022-02-02T18:21:26.662 INFO:tasks.workunit.client.0.smithi096.stdout:7/375: mknod d9/df/d47/d19/c81 0 2022-02-02T18:21:26.662 INFO:tasks.workunit.client.0.smithi096.stdout:7/376: chown d9/df/d12/d39/d40/d51/l62 75 1 2022-02-02T18:21:26.663 INFO:tasks.workunit.client.0.smithi096.stdout:1/402: mknod d15/c8b 0 2022-02-02T18:21:26.664 INFO:tasks.workunit.client.0.smithi096.stdout:1/403: creat d15/d1b/f8c x:0 0 0 2022-02-02T18:21:26.665 INFO:tasks.workunit.client.0.smithi096.stdout:5/379: dread db/de/d10/d25/f40 [0,4194304] 0 2022-02-02T18:21:26.665 INFO:tasks.workunit.client.0.smithi096.stdout:5/380: chown db/d5c/d60/c7d 0 1 2022-02-02T18:21:26.665 INFO:tasks.workunit.client.0.smithi096.stdout:5/381: truncate db/de/f16 1419040 0 2022-02-02T18:21:26.666 INFO:tasks.workunit.client.0.smithi096.stdout:5/382: chown l8 1 1 2022-02-02T18:21:26.666 INFO:tasks.workunit.client.0.smithi096.stdout:5/383: truncate db/de/d10/d25/d4c/f63 791140 0 2022-02-02T18:21:26.667 INFO:tasks.workunit.client.0.smithi096.stdout:0/478: link d2/d1e/f35 d2/db/d24/d89/d91/fa4 0 2022-02-02T18:21:26.668 INFO:tasks.workunit.client.0.smithi096.stdout:4/445: mknod d3/d4/d20/d26/d36/d51/ca6 0 2022-02-02T18:21:26.670 INFO:tasks.workunit.client.0.smithi096.stdout:2/427: rename d2/d29/d5f/l6c to d2/d13/d42/d71/l87 0 2022-02-02T18:21:26.670 INFO:tasks.workunit.client.0.smithi096.stdout:2/428: dread - d2/d5e/d7c/f83 zero size 2022-02-02T18:21:26.671 INFO:tasks.workunit.client.0.smithi096.stdout:1/404: chown d15/d1b/d28/d47/c76 0 1 2022-02-02T18:21:26.672 INFO:tasks.workunit.client.0.smithi096.stdout:0/479: mkdir d2/db/d24/d4d/d53/da5 0 2022-02-02T18:21:26.673 INFO:tasks.workunit.client.0.smithi096.stdout:3/385: rename d2/df/d1c/c60 to d2/df/d14/d66/c88 0 2022-02-02T18:21:26.673 INFO:tasks.workunit.client.0.smithi096.stdout:0/480: truncate d2/db/d10/d27/f2d 1216050 0 2022-02-02T18:21:26.674 INFO:tasks.workunit.client.0.smithi096.stdout:5/384: dread db/d20/f29 [0,4194304] 0 2022-02-02T18:21:26.675 INFO:tasks.workunit.client.0.smithi096.stdout:7/377: rename d9/df/d12/d39/d4e/d6e/d72 to d9/df/d12/d14/d82 0 2022-02-02T18:21:26.675 INFO:tasks.workunit.client.0.smithi096.stdout:0/481: write d2/db/d10/d27/f73 [2137612,75654] 0 2022-02-02T18:21:26.676 INFO:tasks.workunit.client.0.smithi096.stdout:3/386: mkdir d2/df/d14/d2c/d31/d89 0 2022-02-02T18:21:26.676 INFO:tasks.workunit.client.0.smithi096.stdout:3/387: readlink d2/df/d1c/d5d/d69/d43/d72/l82 0 2022-02-02T18:21:26.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/388: fsync d2/df/d20/d33/f63 0 2022-02-02T18:21:26.677 INFO:tasks.workunit.client.0.smithi096.stdout:2/429: dread d2/d19/f70 [0,4194304] 0 2022-02-02T18:21:26.678 INFO:tasks.workunit.client.0.smithi096.stdout:8/326: dwrite d29/f62 [0,4194304] 0 2022-02-02T18:21:26.679 INFO:tasks.workunit.client.0.smithi096.stdout:4/446: rename d3/d27/d4a to d3/d60/d8d/da7 0 2022-02-02T18:21:26.680 INFO:tasks.workunit.client.0.smithi096.stdout:4/447: fsync d3/d27/f41 0 2022-02-02T18:21:26.680 INFO:tasks.workunit.client.0.smithi096.stdout:4/448: fsync d3/d27/f43 0 2022-02-02T18:21:26.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/327: dread d29/d40/f5c [0,4194304] 0 2022-02-02T18:21:26.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/328: fsync f22 0 2022-02-02T18:21:26.682 INFO:tasks.workunit.client.0.smithi096.stdout:8/329: fsync d29/f2b 0 2022-02-02T18:21:26.682 INFO:tasks.workunit.client.0.smithi096.stdout:8/330: creat d29/d2d/f6b x:0 0 0 2022-02-02T18:21:26.682 INFO:tasks.workunit.client.0.smithi096.stdout:8/331: dread - d29/d2d/f6b zero size 2022-02-02T18:21:26.683 INFO:tasks.workunit.client.0.smithi096.stdout:7/378: mkdir d9/df/d47/d37/d83 0 2022-02-02T18:21:26.683 INFO:tasks.workunit.client.0.smithi096.stdout:7/379: creat d9/df/d12/d39/d41/f84 x:0 0 0 2022-02-02T18:21:26.685 INFO:tasks.workunit.client.0.smithi096.stdout:3/389: creat d2/df/d1c/d5d/d69/d43/f8a x:0 0 0 2022-02-02T18:21:26.687 INFO:tasks.workunit.client.0.smithi096.stdout:5/385: rmdir db/de/d10/d25/d4c 39 2022-02-02T18:21:26.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/449: dread d3/d4/d14/f2d [0,4194304] 0 2022-02-02T18:21:26.689 INFO:tasks.workunit.client.0.smithi096.stdout:3/390: dread d2/df/d14/d2c/d74/f7b [0,4194304] 0 2022-02-02T18:21:26.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/430: mknod d2/d2a/c88 0 2022-02-02T18:21:26.690 INFO:tasks.workunit.client.0.smithi096.stdout:4/450: write d3/d4/d20/d4d/f5b [394827,2783] 0 2022-02-02T18:21:26.690 INFO:tasks.workunit.client.0.smithi096.stdout:4/451: fsync d3/d4/d20/d4d/f54 0 2022-02-02T18:21:26.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/452: fsync d3/d4/d14/d55/f9d 0 2022-02-02T18:21:26.700 INFO:tasks.workunit.client.0.smithi096.stdout:1/405: rename d15/f1a to d15/d1b/d28/d2c/d39/d6b/d8a/f8d 0 2022-02-02T18:21:26.702 INFO:tasks.workunit.client.0.smithi096.stdout:9/440: sync 2022-02-02T18:21:26.703 INFO:tasks.workunit.client.0.smithi096.stdout:9/441: write d1/db/f9a [335115,104735] 0 2022-02-02T18:21:26.704 INFO:tasks.workunit.client.0.smithi096.stdout:8/332: unlink d29/d4a/f5f 0 2022-02-02T18:21:26.705 INFO:tasks.workunit.client.0.smithi096.stdout:2/431: dwrite d2/d5e/d6d/d79/d66/f68 [0,4194304] 0 2022-02-02T18:21:26.706 INFO:tasks.workunit.client.0.smithi096.stdout:7/380: mkdir d9/df/d12/d39/d40/d85 0 2022-02-02T18:21:26.707 INFO:tasks.workunit.client.0.smithi096.stdout:0/482: getdents d2/db/d10 0 2022-02-02T18:21:26.707 INFO:tasks.workunit.client.0.smithi096.stdout:0/483: chown d2/db/d24/d4d/d54/c76 216669702 1 2022-02-02T18:21:26.707 INFO:tasks.workunit.client.0.smithi096.stdout:0/484: chown d2/db/d24/d4d/d54/c76 139721 1 2022-02-02T18:21:26.708 INFO:tasks.workunit.client.0.smithi096.stdout:3/391: truncate d2/df/d14/d16/f52 3602789 0 2022-02-02T18:21:26.708 INFO:tasks.workunit.client.0.smithi096.stdout:1/406: mkdir d15/d4d/d8e 0 2022-02-02T18:21:26.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/407: stat d15/d1b/d28/d3f 0 2022-02-02T18:21:26.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/408: read d15/d1b/d28/f3e [4113133,78067] 0 2022-02-02T18:21:26.710 INFO:tasks.workunit.client.0.smithi096.stdout:1/409: creat d15/d1b/d26/f8f x:0 0 0 2022-02-02T18:21:26.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/333: creat d29/d4e/f6c x:0 0 0 2022-02-02T18:21:26.711 INFO:tasks.workunit.client.0.smithi096.stdout:7/381: mknod d9/df/c86 0 2022-02-02T18:21:26.712 INFO:tasks.workunit.client.0.smithi096.stdout:7/382: chown d9/df/d47 14963 1 2022-02-02T18:21:26.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/440: sync 2022-02-02T18:21:26.717 INFO:tasks.workunit.client.0.smithi096.stdout:6/441: readlink d18/d24/d28/l46 0 2022-02-02T18:21:26.719 INFO:tasks.workunit.client.0.smithi096.stdout:3/392: creat d2/df/d14/d16/f8b x:0 0 0 2022-02-02T18:21:26.721 INFO:tasks.workunit.client.0.smithi096.stdout:7/383: link d9/df/d12/d14/c21 d9/df/d12/d39/d40/d85/c87 0 2022-02-02T18:21:26.721 INFO:tasks.workunit.client.0.smithi096.stdout:0/485: getdents d2/db/d37/d40/d8a 0 2022-02-02T18:21:26.723 INFO:tasks.workunit.client.0.smithi096.stdout:6/442: creat d18/d54/fa6 x:0 0 0 2022-02-02T18:21:26.725 INFO:tasks.workunit.client.0.smithi096.stdout:9/442: dwrite d1/f56 [0,4194304] 0 2022-02-02T18:21:26.726 INFO:tasks.workunit.client.0.smithi096.stdout:0/486: mknod d2/db/d7f/ca6 0 2022-02-02T18:21:26.727 INFO:tasks.workunit.client.0.smithi096.stdout:6/443: symlink d18/d54/d63/d7e/la7 0 2022-02-02T18:21:26.727 INFO:tasks.workunit.client.0.smithi096.stdout:7/384: getdents d9/df/d12/d39/d41 0 2022-02-02T18:21:26.731 INFO:tasks.workunit.client.0.smithi096.stdout:6/444: dread d18/d54/f43 [0,4194304] 0 2022-02-02T18:21:26.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/445: dread - d18/d54/d63/f9f zero size 2022-02-02T18:21:26.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/446: stat d18/l3f 0 2022-02-02T18:21:26.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/447: stat d18/d54/d63 0 2022-02-02T18:21:26.732 INFO:tasks.workunit.client.0.smithi096.stdout:9/443: mkdir d1/db/d1c/d2f/d78/da6 0 2022-02-02T18:21:26.733 INFO:tasks.workunit.client.0.smithi096.stdout:0/487: link d2/d1e/d67/f9c d2/d66/fa7 0 2022-02-02T18:21:26.734 INFO:tasks.workunit.client.0.smithi096.stdout:0/488: write d2/db/d37/f75 [856986,66872] 0 2022-02-02T18:21:26.734 INFO:tasks.workunit.client.0.smithi096.stdout:0/489: fsync d2/f15 0 2022-02-02T18:21:26.734 INFO:tasks.workunit.client.0.smithi096.stdout:7/385: write d9/df/d12/f6d [551413,3848] 0 2022-02-02T18:21:26.734 INFO:tasks.workunit.client.0.smithi096.stdout:7/386: truncate d9/df/d12/d14/f61 861343 0 2022-02-02T18:21:26.734 INFO:tasks.workunit.client.0.smithi096.stdout:7/387: dread - d9/df/d12/d39/d41/f84 zero size 2022-02-02T18:21:26.735 INFO:tasks.workunit.client.0.smithi096.stdout:6/448: symlink d18/d24/d28/d4a/la8 0 2022-02-02T18:21:26.737 INFO:tasks.workunit.client.0.smithi096.stdout:7/388: creat d9/df/d12/d39/d4e/f88 x:0 0 0 2022-02-02T18:21:26.737 INFO:tasks.workunit.client.0.smithi096.stdout:6/449: mknod d18/d24/d28/d4a/ca9 0 2022-02-02T18:21:26.738 INFO:tasks.workunit.client.0.smithi096.stdout:0/490: write d2/db/d10/d27/f73 [2875767,68258] 0 2022-02-02T18:21:26.739 INFO:tasks.workunit.client.0.smithi096.stdout:7/389: creat d9/df/d12/d39/d46/d7d/f89 x:0 0 0 2022-02-02T18:21:26.740 INFO:tasks.workunit.client.0.smithi096.stdout:7/390: readlink d9/df/d12/d39/d40/d51/l62 0 2022-02-02T18:21:26.741 INFO:tasks.workunit.client.0.smithi096.stdout:8/334: dwrite d29/d2d/f56 [0,4194304] 0 2022-02-02T18:21:26.741 INFO:tasks.workunit.client.0.smithi096.stdout:2/432: dwrite d2/d13/f64 [0,4194304] 0 2022-02-02T18:21:26.742 INFO:tasks.workunit.client.0.smithi096.stdout:8/335: write d29/f2b [422065,46546] 0 2022-02-02T18:21:26.742 INFO:tasks.workunit.client.0.smithi096.stdout:1/410: dwrite d15/d1b/d28/d2c/d4f/f89 [0,4194304] 0 2022-02-02T18:21:26.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/391: rename d9/df/d47/d19/f35 to d9/f8a 0 2022-02-02T18:21:26.744 INFO:tasks.workunit.client.0.smithi096.stdout:7/392: write d9/df/d47/d19/f2f [314333,117038] 0 2022-02-02T18:21:26.744 INFO:tasks.workunit.client.0.smithi096.stdout:7/393: readlink d9/df/d12/d39/d40/d51/l62 0 2022-02-02T18:21:26.748 INFO:tasks.workunit.client.0.smithi096.stdout:2/433: link d2/d5e/d6d/d79/f6a d2/d6/d1b/f89 0 2022-02-02T18:21:26.749 INFO:tasks.workunit.client.0.smithi096.stdout:2/434: chown d2/d5e/d6d/d79/l33 0 1 2022-02-02T18:21:26.749 INFO:tasks.workunit.client.0.smithi096.stdout:2/435: fsync d2/d2a/f34 0 2022-02-02T18:21:26.753 INFO:tasks.workunit.client.0.smithi096.stdout:1/411: link d15/d1b/d28/d2c/f38 d15/d1b/d26/d72/f90 0 2022-02-02T18:21:26.754 INFO:tasks.workunit.client.0.smithi096.stdout:9/444: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [4194304,4194304] 0 2022-02-02T18:21:26.755 INFO:tasks.workunit.client.0.smithi096.stdout:9/445: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/fa7 x:0 0 0 2022-02-02T18:21:26.755 INFO:tasks.workunit.client.0.smithi096.stdout:2/436: dread d2/d6/d1b/f39 [0,4194304] 0 2022-02-02T18:21:26.755 INFO:tasks.workunit.client.0.smithi096.stdout:3/393: dwrite d2/df/d1c/f29 [0,4194304] 0 2022-02-02T18:21:26.762 INFO:tasks.workunit.client.0.smithi096.stdout:2/437: dread d2/d5e/d6d/f7d [0,4194304] 0 2022-02-02T18:21:26.762 INFO:tasks.workunit.client.0.smithi096.stdout:2/438: chown d2/d13/d42/d71/f78 28 1 2022-02-02T18:21:26.764 INFO:tasks.workunit.client.0.smithi096.stdout:9/446: rename d1/d39/d8a/d97/l7e to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/la8 0 2022-02-02T18:21:26.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/394: symlink d2/df/d20/d33/d58/d7c/l8c 0 2022-02-02T18:21:26.769 INFO:tasks.workunit.client.0.smithi096.stdout:7/394: rmdir d9/df/d12/d39/d40 39 2022-02-02T18:21:26.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/395: write d2/df/d14/d11/f1f [7428182,67955] 0 2022-02-02T18:21:26.771 INFO:tasks.workunit.client.0.smithi096.stdout:7/395: mknod d9/df/d12/d39/d41/c8b 0 2022-02-02T18:21:26.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/396: rename d2/df/d36/d56 to d2/df/d36/d8d 0 2022-02-02T18:21:26.775 INFO:tasks.workunit.client.0.smithi096.stdout:7/396: unlink d9/df/d47/c63 0 2022-02-02T18:21:26.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/397: truncate d2/df/f24 2499134 0 2022-02-02T18:21:26.779 INFO:tasks.workunit.client.0.smithi096.stdout:7/397: write d9/df/d12/d39/d40/d51/f59 [4138238,51836] 0 2022-02-02T18:21:26.779 INFO:tasks.workunit.client.0.smithi096.stdout:7/398: chown d9/df/d12/d39/l6f 27781 1 2022-02-02T18:21:26.779 INFO:tasks.workunit.client.0.smithi096.stdout:7/399: creat d9/df/d12/d39/d4e/f8c x:0 0 0 2022-02-02T18:21:26.780 INFO:tasks.workunit.client.0.smithi096.stdout:1/412: dwrite d15/d1b/d26/f31 [0,4194304] 0 2022-02-02T18:21:26.780 INFO:tasks.workunit.client.0.smithi096.stdout:1/413: chown d15/d1b/d28/d2c/d4f/c62 2 1 2022-02-02T18:21:26.781 INFO:tasks.workunit.client.0.smithi096.stdout:4/453: sync 2022-02-02T18:21:26.781 INFO:tasks.workunit.client.0.smithi096.stdout:5/386: sync 2022-02-02T18:21:26.781 INFO:tasks.workunit.client.0.smithi096.stdout:5/387: dread - db/d5c/d2f/d46/f7b zero size 2022-02-02T18:21:26.782 INFO:tasks.workunit.client.0.smithi096.stdout:5/388: write db/de/d10/d25/f40 [4133617,111539] 0 2022-02-02T18:21:26.782 INFO:tasks.workunit.client.0.smithi096.stdout:7/400: creat d9/f8d x:0 0 0 2022-02-02T18:21:26.784 INFO:tasks.workunit.client.0.smithi096.stdout:7/401: write d9/df/d12/d39/d42/f5a [2432384,96836] 0 2022-02-02T18:21:26.786 INFO:tasks.workunit.client.0.smithi096.stdout:2/439: dwrite d2/d6/d1b/f5b [0,4194304] 0 2022-02-02T18:21:26.787 INFO:tasks.workunit.client.0.smithi096.stdout:4/454: mkdir d3/d60/da8 0 2022-02-02T18:21:26.787 INFO:tasks.workunit.client.0.smithi096.stdout:4/455: dread - d3/d4/d20/d26/d36/d51/f86 zero size 2022-02-02T18:21:26.788 INFO:tasks.workunit.client.0.smithi096.stdout:4/456: dread - d3/d4/d14/f9e zero size 2022-02-02T18:21:26.788 INFO:tasks.workunit.client.0.smithi096.stdout:5/389: creat db/de/d10/d27/f8f x:0 0 0 2022-02-02T18:21:26.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/402: symlink d9/df/d12/d39/d46/d7d/l8e 0 2022-02-02T18:21:26.792 INFO:tasks.workunit.client.0.smithi096.stdout:5/390: link db/de/d10/d25/d4c/f63 db/d5c/d2f/f90 0 2022-02-02T18:21:26.792 INFO:tasks.workunit.client.0.smithi096.stdout:5/391: fsync db/de/d2e/f41 0 2022-02-02T18:21:26.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/440: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:26.793 INFO:tasks.workunit.client.0.smithi096.stdout:4/457: getdents d3/d4 0 2022-02-02T18:21:26.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/441: mkdir d2/d6/d1b/d8a 0 2022-02-02T18:21:26.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/442: write d2/d5e/d7c/f83 [961946,82638] 0 2022-02-02T18:21:26.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/443: stat d2/d13/d42/d71/f7a 0 2022-02-02T18:21:26.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/444: chown d2/d6/d1b/f5b 369074 1 2022-02-02T18:21:26.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/445: dread - d2/d6/d1b/d3a/f3e zero size 2022-02-02T18:21:26.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/447: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f83 [0,4194304] 0 2022-02-02T18:21:26.797 INFO:tasks.workunit.client.0.smithi096.stdout:7/403: rename d9/df/d12/l4b to d9/df/d12/d14/l8f 0 2022-02-02T18:21:26.798 INFO:tasks.workunit.client.0.smithi096.stdout:5/392: dread db/d5c/f55 [0,4194304] 0 2022-02-02T18:21:26.799 INFO:tasks.workunit.client.0.smithi096.stdout:4/458: creat d3/d60/d8d/da7/fa9 x:0 0 0 2022-02-02T18:21:26.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/446: symlink d2/d19/d86/l8b 0 2022-02-02T18:21:26.803 INFO:tasks.workunit.client.0.smithi096.stdout:3/398: dwrite d2/df/d14/f10 [0,4194304] 0 2022-02-02T18:21:26.804 INFO:tasks.workunit.client.0.smithi096.stdout:3/399: write d2/df/d14/d2c/d31/f47 [4558320,72583] 0 2022-02-02T18:21:26.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/414: dwrite d15/d1b/d26/d59/f80 [0,4194304] 0 2022-02-02T18:21:26.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/415: creat d15/d1b/d28/d2c/d39/d71/f91 x:0 0 0 2022-02-02T18:21:26.805 INFO:tasks.workunit.client.0.smithi096.stdout:1/416: creat d15/d1b/d26/d72/f92 x:0 0 0 2022-02-02T18:21:26.805 INFO:tasks.workunit.client.0.smithi096.stdout:1/417: stat d15/d67/c73 0 2022-02-02T18:21:26.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/448: creat d1/db/d63/da2/fa9 x:0 0 0 2022-02-02T18:21:26.805 INFO:tasks.workunit.client.0.smithi096.stdout:3/400: write d2/df/d14/d11/f53 [179423,102451] 0 2022-02-02T18:21:26.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/404: symlink d9/df/d12/d39/d4e/l90 0 2022-02-02T18:21:26.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/405: chown d9/df/d12/d39/d41/f49 418442672 1 2022-02-02T18:21:26.807 INFO:tasks.workunit.client.0.smithi096.stdout:2/447: truncate d2/d6/db/f27 4007599 0 2022-02-02T18:21:26.807 INFO:tasks.workunit.client.0.smithi096.stdout:2/448: dread - d2/d6/d1b/d48/f82 zero size 2022-02-02T18:21:26.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/459: dread d3/d5a/f63 [0,4194304] 0 2022-02-02T18:21:26.812 INFO:tasks.workunit.client.0.smithi096.stdout:1/418: symlink d15/d1b/d26/d72/l93 0 2022-02-02T18:21:26.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/449: link d1/db/d1c/d2f/d78/d25/ca4 d1/db/d1c/d2f/d78/d25/d8e/d9d/caa 0 2022-02-02T18:21:26.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/450: truncate d1/db/d1c/d2f/f32 8666650 0 2022-02-02T18:21:26.818 INFO:tasks.workunit.client.0.smithi096.stdout:5/393: dwrite db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:26.821 INFO:tasks.workunit.client.0.smithi096.stdout:7/406: truncate d9/df/d12/d14/f61 593441 0 2022-02-02T18:21:26.822 INFO:tasks.workunit.client.0.smithi096.stdout:7/407: creat d9/df/d12/d39/d46/d7d/f91 x:0 0 0 2022-02-02T18:21:26.823 INFO:tasks.workunit.client.0.smithi096.stdout:2/449: symlink d2/d6/db/l8c 0 2022-02-02T18:21:26.823 INFO:tasks.workunit.client.0.smithi096.stdout:4/460: getdents d3/d4/d20/d26/d36/d51/d57 0 2022-02-02T18:21:26.827 INFO:tasks.workunit.client.0.smithi096.stdout:5/394: mknod db/de/d2e/d35/c91 0 2022-02-02T18:21:26.839 INFO:tasks.workunit.client.0.smithi096.stdout:3/401: rmdir d2 39 2022-02-02T18:21:26.839 INFO:tasks.workunit.client.0.smithi096.stdout:7/408: dread d9/f3e [0,4194304] 0 2022-02-02T18:21:26.842 INFO:tasks.workunit.client.0.smithi096.stdout:9/451: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f59 [0,4194304] 0 2022-02-02T18:21:26.842 INFO:tasks.workunit.client.0.smithi096.stdout:4/461: mknod d3/d4/d20/caa 0 2022-02-02T18:21:26.843 INFO:tasks.workunit.client.0.smithi096.stdout:5/395: mknod db/d5c/d2f/c92 0 2022-02-02T18:21:26.843 INFO:tasks.workunit.client.0.smithi096.stdout:5/396: dread - db/f6c zero size 2022-02-02T18:21:26.843 INFO:tasks.workunit.client.0.smithi096.stdout:5/397: write db/de/f2a [437170,100473] 0 2022-02-02T18:21:26.843 INFO:tasks.workunit.client.0.smithi096.stdout:5/398: chown db/de/d2e/f51 42 1 2022-02-02T18:21:26.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/402: rename d2/df/d34/c3f to d2/df/c8e 0 2022-02-02T18:21:26.850 INFO:tasks.workunit.client.0.smithi096.stdout:5/399: link db/d5c/d2f/f3d db/d5c/d60/f93 0 2022-02-02T18:21:26.850 INFO:tasks.workunit.client.0.smithi096.stdout:9/452: symlink d1/db/d1c/d2f/d78/d11/d1e/lab 0 2022-02-02T18:21:26.852 INFO:tasks.workunit.client.0.smithi096.stdout:8/336: sync 2022-02-02T18:21:26.852 INFO:tasks.workunit.client.0.smithi096.stdout:6/450: sync 2022-02-02T18:21:26.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/491: sync 2022-02-02T18:21:26.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/492: chown d2/d1e/l23 1557 1 2022-02-02T18:21:26.853 INFO:tasks.workunit.client.0.smithi096.stdout:8/337: fdatasync f1c 0 2022-02-02T18:21:26.853 INFO:tasks.workunit.client.0.smithi096.stdout:6/451: truncate d18/d24/f4d 1144889 0 2022-02-02T18:21:26.853 INFO:tasks.workunit.client.0.smithi096.stdout:6/452: chown d18/f26 0 1 2022-02-02T18:21:26.854 INFO:tasks.workunit.client.0.smithi096.stdout:8/338: stat l8 0 2022-02-02T18:21:26.854 INFO:tasks.workunit.client.0.smithi096.stdout:6/453: chown d18/d50/d6d/d95/f97 176989661 1 2022-02-02T18:21:26.854 INFO:tasks.workunit.client.0.smithi096.stdout:6/454: chown d18/l1d 131166147 1 2022-02-02T18:21:26.855 INFO:tasks.workunit.client.0.smithi096.stdout:9/453: mkdir d1/db/d1c/d2f/dac 0 2022-02-02T18:21:26.856 INFO:tasks.workunit.client.0.smithi096.stdout:0/493: creat d2/db/d24/d4d/d53/d58/fa8 x:0 0 0 2022-02-02T18:21:26.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/409: dread d9/df/d47/d19/f27 [0,4194304] 0 2022-02-02T18:21:26.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/450: dwrite d2/d6/d1b/d3a/f7f [0,4194304] 0 2022-02-02T18:21:26.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/451: creat d2/d6/d76/f8d x:0 0 0 2022-02-02T18:21:26.860 INFO:tasks.workunit.client.0.smithi096.stdout:0/494: rename d2/d1e/d67/f9c to d2/d66/d71/fa9 0 2022-02-02T18:21:26.860 INFO:tasks.workunit.client.0.smithi096.stdout:0/495: dread - d2/d1e/d67/f9e zero size 2022-02-02T18:21:26.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/400: rmdir db/d62 0 2022-02-02T18:21:26.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/401: fdatasync db/f6c 0 2022-02-02T18:21:26.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/402: chown db/de/d10/d25/c3a 77725 1 2022-02-02T18:21:26.864 INFO:tasks.workunit.client.0.smithi096.stdout:5/403: creat db/de/d2e/f94 x:0 0 0 2022-02-02T18:21:26.864 INFO:tasks.workunit.client.0.smithi096.stdout:5/404: creat db/de/d2e/d35/f95 x:0 0 0 2022-02-02T18:21:26.866 INFO:tasks.workunit.client.0.smithi096.stdout:3/403: dwrite d2/df/d20/d33/f63 [0,4194304] 0 2022-02-02T18:21:26.867 INFO:tasks.workunit.client.0.smithi096.stdout:3/404: fsync d2/df/f26 0 2022-02-02T18:21:26.867 INFO:tasks.workunit.client.0.smithi096.stdout:3/405: write d2/df/d14/f18 [4452663,83303] 0 2022-02-02T18:21:26.867 INFO:tasks.workunit.client.0.smithi096.stdout:3/406: write d2/df/d20/d33/f51 [1108170,1485] 0 2022-02-02T18:21:26.868 INFO:tasks.workunit.client.0.smithi096.stdout:5/405: creat db/de/d10/d27/d83/f96 x:0 0 0 2022-02-02T18:21:26.869 INFO:tasks.workunit.client.0.smithi096.stdout:4/462: dwrite d3/d4/d14/f66 [0,4194304] 0 2022-02-02T18:21:26.869 INFO:tasks.workunit.client.0.smithi096.stdout:4/463: write d3/d4/d20/d26/d36/d51/f86 [395474,35964] 0 2022-02-02T18:21:26.869 INFO:tasks.workunit.client.0.smithi096.stdout:4/464: stat d3/d60/d8d 0 2022-02-02T18:21:26.870 INFO:tasks.workunit.client.0.smithi096.stdout:3/407: dread d2/df/d1c/d5d/d69/f55 [0,4194304] 0 2022-02-02T18:21:26.871 INFO:tasks.workunit.client.0.smithi096.stdout:7/410: getdents d9/df/d47 0 2022-02-02T18:21:26.871 INFO:tasks.workunit.client.0.smithi096.stdout:7/411: getdents d9/df/d47/d37/d83 0 2022-02-02T18:21:26.871 INFO:tasks.workunit.client.0.smithi096.stdout:4/465: dread d3/d4/d14/f4b [0,4194304] 0 2022-02-02T18:21:26.871 INFO:tasks.workunit.client.0.smithi096.stdout:5/406: truncate db/d5c/d2f/d46/f5f 1637146 0 2022-02-02T18:21:26.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/452: mkdir d2/d13/d8e 0 2022-02-02T18:21:26.876 INFO:tasks.workunit.client.0.smithi096.stdout:4/466: write d3/d4/d20/d26/f5e [3500044,83231] 0 2022-02-02T18:21:26.881 INFO:tasks.workunit.client.0.smithi096.stdout:5/407: mkdir db/de/d10/d97 0 2022-02-02T18:21:26.881 INFO:tasks.workunit.client.0.smithi096.stdout:2/453: truncate d2/d2a/f30 3163291 0 2022-02-02T18:21:26.881 INFO:tasks.workunit.client.0.smithi096.stdout:5/408: write db/de/d2e/f8a [4334133,93309] 0 2022-02-02T18:21:26.882 INFO:tasks.workunit.client.0.smithi096.stdout:4/467: creat d3/d60/da8/fab x:0 0 0 2022-02-02T18:21:26.882 INFO:tasks.workunit.client.0.smithi096.stdout:4/468: fdatasync d3/d4/d14/f1f 0 2022-02-02T18:21:26.883 INFO:tasks.workunit.client.0.smithi096.stdout:3/408: dread d2/df/d14/d2c/d31/f40 [0,4194304] 0 2022-02-02T18:21:26.884 INFO:tasks.workunit.client.0.smithi096.stdout:5/409: rename db/de/d10/d25/d4c/f63 to db/de/d10/f98 0 2022-02-02T18:21:26.884 INFO:tasks.workunit.client.0.smithi096.stdout:5/410: truncate db/de/d2e/f94 63736 0 2022-02-02T18:21:26.884 INFO:tasks.workunit.client.0.smithi096.stdout:4/469: mknod d3/d60/cac 0 2022-02-02T18:21:26.887 INFO:tasks.workunit.client.0.smithi096.stdout:3/409: rename d2/df/d20/d33/d58/f67 to d2/df/d14/d11/f8f 0 2022-02-02T18:21:26.887 INFO:tasks.workunit.client.0.smithi096.stdout:3/410: fsync d2/df/d14/d2c/d31/f47 0 2022-02-02T18:21:26.889 INFO:tasks.workunit.client.0.smithi096.stdout:5/411: unlink db/de/d2e/d35/f47 0 2022-02-02T18:21:26.891 INFO:tasks.workunit.client.0.smithi096.stdout:7/412: dread d9/df/d12/f32 [4194304,4194304] 0 2022-02-02T18:21:26.891 INFO:tasks.workunit.client.0.smithi096.stdout:6/455: dwrite d18/f49 [0,4194304] 0 2022-02-02T18:21:26.893 INFO:tasks.workunit.client.0.smithi096.stdout:8/339: dwrite f23 [0,4194304] 0 2022-02-02T18:21:26.893 INFO:tasks.workunit.client.0.smithi096.stdout:9/454: dwrite d1/db/d48/d69/f7c [0,4194304] 0 2022-02-02T18:21:26.894 INFO:tasks.workunit.client.0.smithi096.stdout:9/455: truncate d1/db/d1c/d2f/d78/f95 433752 0 2022-02-02T18:21:26.895 INFO:tasks.workunit.client.0.smithi096.stdout:4/470: mknod d3/d27/cad 0 2022-02-02T18:21:26.895 INFO:tasks.workunit.client.0.smithi096.stdout:4/471: fdatasync d3/d5a/f87 0 2022-02-02T18:21:26.895 INFO:tasks.workunit.client.0.smithi096.stdout:4/472: chown d3/d4/d20/d4d/c92 239 1 2022-02-02T18:21:26.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/411: creat d2/d71/f90 x:0 0 0 2022-02-02T18:21:26.896 INFO:tasks.workunit.client.0.smithi096.stdout:4/473: write d3/d85/fa0 [708669,80164] 0 2022-02-02T18:21:26.896 INFO:tasks.workunit.client.0.smithi096.stdout:5/412: link db/de/f13 db/de/d10/d80/f99 0 2022-02-02T18:21:26.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/496: unlink d2/d66/d71/fa9 0 2022-02-02T18:21:26.902 INFO:tasks.workunit.client.0.smithi096.stdout:9/456: link d1/db/d1c/d2f/d78/d11/d1e/f53 d1/db/d1c/d2f/d78/d25/fad 0 2022-02-02T18:21:26.904 INFO:tasks.workunit.client.0.smithi096.stdout:3/412: mknod d2/df/c91 0 2022-02-02T18:21:26.906 INFO:tasks.workunit.client.0.smithi096.stdout:4/474: truncate d3/d27/f8c 35889 0 2022-02-02T18:21:26.907 INFO:tasks.workunit.client.0.smithi096.stdout:2/454: dwrite d2/d6/d1b/d3a/f44 [0,4194304] 0 2022-02-02T18:21:26.909 INFO:tasks.workunit.client.0.smithi096.stdout:3/413: dread d2/df/d20/d33/f3b [0,4194304] 0 2022-02-02T18:21:26.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/455: dread d2/d5e/d6d/d79/f6a [0,4194304] 0 2022-02-02T18:21:26.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/456: fdatasync d2/d13/f64 0 2022-02-02T18:21:26.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/457: unlink d2/c2c 0 2022-02-02T18:21:26.914 INFO:tasks.workunit.client.0.smithi096.stdout:2/458: fsync d2/d6/db/f27 0 2022-02-02T18:21:26.915 INFO:tasks.workunit.client.0.smithi096.stdout:4/475: dread d3/d4/d14/d55/f7d [0,4194304] 0 2022-02-02T18:21:26.915 INFO:tasks.workunit.client.0.smithi096.stdout:5/413: truncate db/de/d10/f15 7419595 0 2022-02-02T18:21:26.915 INFO:tasks.workunit.client.0.smithi096.stdout:0/497: rename d2/db/f20 to d2/db/d24/d4d/faa 0 2022-02-02T18:21:26.915 INFO:tasks.workunit.client.0.smithi096.stdout:0/498: truncate d2/d1e/d67/f9e 519174 0 2022-02-02T18:21:26.916 INFO:tasks.workunit.client.0.smithi096.stdout:3/414: write d2/df/d14/f10 [2428909,74020] 0 2022-02-02T18:21:26.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/457: mknod d1/db/d1c/d2f/d78/d25/dd/d49/cae 0 2022-02-02T18:21:26.917 INFO:tasks.workunit.client.0.smithi096.stdout:9/458: chown d1/db/d1c/d2f/d78/d11/f2d 0 1 2022-02-02T18:21:26.918 INFO:tasks.workunit.client.0.smithi096.stdout:2/459: write d2/d6/d1b/d3a/f7f [3079898,58720] 0 2022-02-02T18:21:26.919 INFO:tasks.workunit.client.0.smithi096.stdout:0/499: dread d2/db/d24/d89/d91/fa4 [0,4194304] 0 2022-02-02T18:21:26.919 INFO:tasks.workunit.client.0.smithi096.stdout:5/414: write db/d5c/f6f [2188032,16920] 0 2022-02-02T18:21:26.920 INFO:tasks.workunit.client.0.smithi096.stdout:5/415: chown db/de/d10/d80 998705 1 2022-02-02T18:21:26.922 INFO:tasks.workunit.client.0.smithi096.stdout:3/415: rename d2/df/d20/d33/f63 to d2/f92 0 2022-02-02T18:21:26.924 INFO:tasks.workunit.client.0.smithi096.stdout:2/460: link d2/d6/db/f27 d2/d6/db/f8f 0 2022-02-02T18:21:26.925 INFO:tasks.workunit.client.0.smithi096.stdout:0/500: creat d2/db/d10/fab x:0 0 0 2022-02-02T18:21:26.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/456: dwrite d18/d24/d73/f75 [0,4194304] 0 2022-02-02T18:21:26.926 INFO:tasks.workunit.client.0.smithi096.stdout:5/416: link db/lc db/d5c/d32/d70/d85/l9a 0 2022-02-02T18:21:26.927 INFO:tasks.workunit.client.0.smithi096.stdout:5/417: fdatasync db/de/d2e/d35/f81 0 2022-02-02T18:21:26.927 INFO:tasks.workunit.client.0.smithi096.stdout:3/416: mknod d2/df/d36/d8d/c93 0 2022-02-02T18:21:26.928 INFO:tasks.workunit.client.0.smithi096.stdout:8/340: dwrite d29/d2d/d42/f68 [0,4194304] 0 2022-02-02T18:21:26.928 INFO:tasks.workunit.client.0.smithi096.stdout:8/341: chown d29/d2d/f45 2 1 2022-02-02T18:21:26.929 INFO:tasks.workunit.client.0.smithi096.stdout:2/461: dread d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:26.930 INFO:tasks.workunit.client.0.smithi096.stdout:4/476: getdents d3/d60/da8 0 2022-02-02T18:21:26.930 INFO:tasks.workunit.client.0.smithi096.stdout:7/413: dwrite d9/df/d47/d19/f27 [0,4194304] 0 2022-02-02T18:21:26.930 INFO:tasks.workunit.client.0.smithi096.stdout:4/477: write d3/d27/f43 [557038,52109] 0 2022-02-02T18:21:26.931 INFO:tasks.workunit.client.0.smithi096.stdout:0/501: symlink d2/d62/lac 0 2022-02-02T18:21:26.932 INFO:tasks.workunit.client.0.smithi096.stdout:0/502: dread - d2/db/d24/d4d/d53/d58/fa8 zero size 2022-02-02T18:21:26.932 INFO:tasks.workunit.client.0.smithi096.stdout:5/418: truncate db/d5c/d60/f93 508668 0 2022-02-02T18:21:26.934 INFO:tasks.workunit.client.0.smithi096.stdout:3/417: mknod d2/df/d14/d66/c94 0 2022-02-02T18:21:26.936 INFO:tasks.workunit.client.0.smithi096.stdout:8/342: mkdir d29/d40/d6d 0 2022-02-02T18:21:26.936 INFO:tasks.workunit.client.0.smithi096.stdout:8/343: write d29/d40/f5c [1005495,117954] 0 2022-02-02T18:21:26.937 INFO:tasks.workunit.client.0.smithi096.stdout:3/418: write d2/df/d1c/d5d/d69/f42 [3510278,6661] 0 2022-02-02T18:21:26.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/419: write d2/df/d1c/d5d/d69/f42 [362013,35301] 0 2022-02-02T18:21:26.941 INFO:tasks.workunit.client.0.smithi096.stdout:7/414: symlink d9/df/d16/d25/l92 0 2022-02-02T18:21:26.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/503: unlink d2/db/d10/c25 0 2022-02-02T18:21:26.941 INFO:tasks.workunit.client.0.smithi096.stdout:4/478: dread d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:26.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/479: creat d3/d4/d20/d26/d36/d88/d98/fae x:0 0 0 2022-02-02T18:21:26.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/480: stat d3/d4/d50 0 2022-02-02T18:21:26.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/481: readlink d3/d4/l2c 0 2022-02-02T18:21:26.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/482: dread - d3/d60/d8d/da7/fa9 zero size 2022-02-02T18:21:26.942 INFO:tasks.workunit.client.0.smithi096.stdout:5/419: mknod db/d5c/d2f/c9b 0 2022-02-02T18:21:26.943 INFO:tasks.workunit.client.0.smithi096.stdout:4/483: read d3/d27/f41 [741340,98424] 0 2022-02-02T18:21:26.943 INFO:tasks.workunit.client.0.smithi096.stdout:4/484: chown d3/d4/d20/d26/d36/d88/d98 51890 1 2022-02-02T18:21:26.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/344: rename d29/f65 to d29/d2d/d47/f6e 0 2022-02-02T18:21:26.946 INFO:tasks.workunit.client.0.smithi096.stdout:7/415: dread d9/df/d47/d19/f1e [0,4194304] 0 2022-02-02T18:21:26.947 INFO:tasks.workunit.client.0.smithi096.stdout:2/462: rmdir d2/d5e/d7c 39 2022-02-02T18:21:26.948 INFO:tasks.workunit.client.0.smithi096.stdout:2/463: truncate d2/d6/fa 1172780 0 2022-02-02T18:21:26.948 INFO:tasks.workunit.client.0.smithi096.stdout:9/459: dwrite d1/db/d1c/d2f/d78/d11/d1e/f31 [0,4194304] 0 2022-02-02T18:21:26.954 INFO:tasks.workunit.client.0.smithi096.stdout:1/419: sync 2022-02-02T18:21:26.954 INFO:tasks.workunit.client.0.smithi096.stdout:1/420: chown d15/d1b/d28/d2c/d4f/c62 927502 1 2022-02-02T18:21:26.954 INFO:tasks.workunit.client.0.smithi096.stdout:1/421: creat d15/d1b/d26/d6f/f94 x:0 0 0 2022-02-02T18:21:26.955 INFO:tasks.workunit.client.0.smithi096.stdout:6/457: dwrite d18/d54/f6a [0,4194304] 0 2022-02-02T18:21:26.959 INFO:tasks.workunit.client.0.smithi096.stdout:1/422: dread d15/d1b/d28/d2c/d39/d71/f7d [0,4194304] 0 2022-02-02T18:21:26.959 INFO:tasks.workunit.client.0.smithi096.stdout:0/504: symlink d2/db/d37/d40/d8a/lad 0 2022-02-02T18:21:26.960 INFO:tasks.workunit.client.0.smithi096.stdout:4/485: symlink d3/d4/d20/d4d/laf 0 2022-02-02T18:21:26.960 INFO:tasks.workunit.client.0.smithi096.stdout:4/486: dread d3/f5d [0,4194304] 0 2022-02-02T18:21:26.963 INFO:tasks.workunit.client.0.smithi096.stdout:8/345: dwrite d29/d2d/f48 [0,4194304] 0 2022-02-02T18:21:26.965 INFO:tasks.workunit.client.0.smithi096.stdout:3/420: rename d2/f92 to d2/df/d1c/d5d/d69/d43/d72/f95 0 2022-02-02T18:21:26.966 INFO:tasks.workunit.client.0.smithi096.stdout:7/416: mkdir d9/df/d93 0 2022-02-02T18:21:26.970 INFO:tasks.workunit.client.0.smithi096.stdout:9/460: symlink d1/db/d1c/d2f/laf 0 2022-02-02T18:21:26.974 INFO:tasks.workunit.client.0.smithi096.stdout:5/420: dread db/d5c/d60/f93 [0,4194304] 0 2022-02-02T18:21:26.976 INFO:tasks.workunit.client.0.smithi096.stdout:6/458: dwrite d18/d50/f51 [0,4194304] 0 2022-02-02T18:21:26.980 INFO:tasks.workunit.client.0.smithi096.stdout:1/423: mknod d15/d1b/d28/d2c/c95 0 2022-02-02T18:21:26.982 INFO:tasks.workunit.client.0.smithi096.stdout:0/505: creat d2/db/d24/d4d/d54/fae x:0 0 0 2022-02-02T18:21:26.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/459: dread d18/f8a [0,4194304] 0 2022-02-02T18:21:26.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/460: unlink d18/d24/d28/d3e/c48 0 2022-02-02T18:21:26.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/461: write d18/d54/f4b [412784,10586] 0 2022-02-02T18:21:26.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/462: readlink d18/d54/d63/d7e/l94 0 2022-02-02T18:21:26.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/463: creat d18/d24/faa x:0 0 0 2022-02-02T18:21:26.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/487: symlink d3/d4/d20/d26/d36/lb0 0 2022-02-02T18:21:26.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/346: stat c26 0 2022-02-02T18:21:26.994 INFO:tasks.workunit.client.0.smithi096.stdout:3/421: rename d2/df/f24 to d2/df/d14/d66/f96 0 2022-02-02T18:21:26.995 INFO:tasks.workunit.client.0.smithi096.stdout:7/417: symlink d9/df/d12/d39/l94 0 2022-02-02T18:21:26.996 INFO:tasks.workunit.client.0.smithi096.stdout:9/461: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0 0 2022-02-02T18:21:26.997 INFO:tasks.workunit.client.0.smithi096.stdout:5/421: creat db/d5c/f9c x:0 0 0 2022-02-02T18:21:27.000 INFO:tasks.workunit.client.0.smithi096.stdout:0/506: creat d2/db/d24/d89/d8f/d95/faf x:0 0 0 2022-02-02T18:21:27.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/488: symlink d3/d4/d14/lb1 0 2022-02-02T18:21:27.007 INFO:tasks.workunit.client.0.smithi096.stdout:6/464: creat d18/d24/d28/d4a/d9d/fab x:0 0 0 2022-02-02T18:21:27.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/347: symlink d29/l6f 0 2022-02-02T18:21:27.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/348: write f1a [4791282,64759] 0 2022-02-02T18:21:27.009 INFO:tasks.workunit.client.0.smithi096.stdout:3/422: rename d2/df/d36/c3d to d2/df/d1c/d5d/d69/d43/c97 0 2022-02-02T18:21:27.009 INFO:tasks.workunit.client.0.smithi096.stdout:3/423: read d2/df/d14/d11/f53 [211222,19856] 0 2022-02-02T18:21:27.010 INFO:tasks.workunit.client.0.smithi096.stdout:3/424: chown d2/df/d14/d2c/d31/c44 11662786 1 2022-02-02T18:21:27.010 INFO:tasks.workunit.client.0.smithi096.stdout:7/418: mknod d9/df/d12/d14/d82/c95 0 2022-02-02T18:21:27.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/462: creat d1/db/d1c/d2f/d78/d11/fb1 x:0 0 0 2022-02-02T18:21:27.011 INFO:tasks.workunit.client.0.smithi096.stdout:5/422: truncate db/de/d10/d80/f99 2223678 0 2022-02-02T18:21:27.011 INFO:tasks.workunit.client.0.smithi096.stdout:3/425: dread d2/df/d34/f39 [0,4194304] 0 2022-02-02T18:21:27.012 INFO:tasks.workunit.client.0.smithi096.stdout:3/426: fdatasync d2/df/d14/d11/f1f 0 2022-02-02T18:21:27.012 INFO:tasks.workunit.client.0.smithi096.stdout:9/463: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f59 [3092638,106996] 0 2022-02-02T18:21:27.012 INFO:tasks.workunit.client.0.smithi096.stdout:9/464: readlink d1/db/d1c/d2f/d78/l7a 0 2022-02-02T18:21:27.013 INFO:tasks.workunit.client.0.smithi096.stdout:6/465: mkdir d18/d54/dac 0 2022-02-02T18:21:27.013 INFO:tasks.workunit.client.0.smithi096.stdout:8/349: mknod d29/d2d/d42/c70 0 2022-02-02T18:21:27.014 INFO:tasks.workunit.client.0.smithi096.stdout:0/507: dwrite d2/d1e/f5d [0,4194304] 0 2022-02-02T18:21:27.014 INFO:tasks.workunit.client.0.smithi096.stdout:0/508: dread - d2/db/d24/d4d/d54/fae zero size 2022-02-02T18:21:27.016 INFO:tasks.workunit.client.0.smithi096.stdout:4/489: rename d3/d4/d20/f76 to d3/d60/fb2 0 2022-02-02T18:21:27.016 INFO:tasks.workunit.client.0.smithi096.stdout:7/419: mknod d9/df/d47/d37/d83/c96 0 2022-02-02T18:21:27.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/423: unlink db/de/d2e/f8a 0 2022-02-02T18:21:27.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/509: read d2/db/d10/d27/f5b [3459497,78946] 0 2022-02-02T18:21:27.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/490: mknod d3/d4/d50/cb3 0 2022-02-02T18:21:27.024 INFO:tasks.workunit.client.0.smithi096.stdout:4/491: truncate d3/d4/d14/f2d 4574190 0 2022-02-02T18:21:27.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/424: unlink db/de/d10/d25/d4c/c84 0 2022-02-02T18:21:27.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/425: write db/de/d10/d25/d4c/f5d [1561755,2900] 0 2022-02-02T18:21:27.027 INFO:tasks.workunit.client.0.smithi096.stdout:0/510: creat d2/db/d10/d80/d93/fb0 x:0 0 0 2022-02-02T18:21:27.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/511: write d2/db/d10/f28 [771725,126869] 0 2022-02-02T18:21:27.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/512: write d2/f15 [4869416,22158] 0 2022-02-02T18:21:27.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/513: creat d2/db/d24/d89/d8f/d95/fb1 x:0 0 0 2022-02-02T18:21:27.032 INFO:tasks.workunit.client.0.smithi096.stdout:5/426: mkdir db/d5c/d2f/d46/d75/d9d 0 2022-02-02T18:21:27.039 INFO:tasks.workunit.client.0.smithi096.stdout:4/492: dread d3/d4/f40 [0,4194304] 0 2022-02-02T18:21:27.039 INFO:tasks.workunit.client.0.smithi096.stdout:4/493: dread - d3/f72 zero size 2022-02-02T18:21:27.040 INFO:tasks.workunit.client.0.smithi096.stdout:4/494: fdatasync d3/d4/d20/d26/f5e 0 2022-02-02T18:21:27.040 INFO:tasks.workunit.client.0.smithi096.stdout:0/514: rename d2/db/d10/f4a to d2/db/d10/d80/d93/da3/fb2 0 2022-02-02T18:21:27.041 INFO:tasks.workunit.client.0.smithi096.stdout:5/427: creat db/de/d10/d80/f9e x:0 0 0 2022-02-02T18:21:27.042 INFO:tasks.workunit.client.0.smithi096.stdout:0/515: mkdir d2/d1e/db3 0 2022-02-02T18:21:27.043 INFO:tasks.workunit.client.0.smithi096.stdout:0/516: chown d2/d66/d71/c7b 403 1 2022-02-02T18:21:27.043 INFO:tasks.workunit.client.0.smithi096.stdout:0/517: truncate d2/db/d37/f75 978236 0 2022-02-02T18:21:27.044 INFO:tasks.workunit.client.0.smithi096.stdout:5/428: symlink db/d5c/d2f/d46/d75/d9d/l9f 0 2022-02-02T18:21:27.045 INFO:tasks.workunit.client.0.smithi096.stdout:0/518: mkdir d2/db4 0 2022-02-02T18:21:27.055 INFO:tasks.workunit.client.0.smithi096.stdout:0/519: rename d2/c13 to d2/db/d10/d27/cb5 0 2022-02-02T18:21:27.056 INFO:tasks.workunit.client.0.smithi096.stdout:5/429: getdents db/de/d2e/d35 0 2022-02-02T18:21:27.056 INFO:tasks.workunit.client.0.smithi096.stdout:8/350: dwrite d29/d40/f5c [0,4194304] 0 2022-02-02T18:21:27.056 INFO:tasks.workunit.client.0.smithi096.stdout:0/520: unlink d2/db/d24/d4d/d54/c88 0 2022-02-02T18:21:27.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/430: rename db/d5c/d32/d70 to db/de/d10/d25/da0 0 2022-02-02T18:21:27.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/431: mkdir db/da1 0 2022-02-02T18:21:27.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/432: link db/d5c/d2f/f3d db/de/fa2 0 2022-02-02T18:21:27.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/433: readlink db/de/l5a 0 2022-02-02T18:21:27.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/434: chown db/d5c/d60/f8c 0 1 2022-02-02T18:21:27.058 INFO:tasks.workunit.client.0.smithi096.stdout:5/435: stat db/d5c/d61 0 2022-02-02T18:21:27.058 INFO:tasks.workunit.client.0.smithi096.stdout:5/436: mkdir db/d5c/d60/da3 0 2022-02-02T18:21:27.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/437: creat db/de/d10/fa4 x:0 0 0 2022-02-02T18:21:27.059 INFO:tasks.workunit.client.0.smithi096.stdout:6/466: dwrite d18/f8a [4194304,4194304] 0 2022-02-02T18:21:27.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/438: creat db/d20/fa5 x:0 0 0 2022-02-02T18:21:27.063 INFO:tasks.workunit.client.0.smithi096.stdout:8/351: dread f1c [0,4194304] 0 2022-02-02T18:21:27.063 INFO:tasks.workunit.client.0.smithi096.stdout:3/427: dwrite d2/df/d20/d33/f3b [0,4194304] 0 2022-02-02T18:21:27.063 INFO:tasks.workunit.client.0.smithi096.stdout:7/420: dwrite d9/df/d12/d39/d41/f6a [0,4194304] 0 2022-02-02T18:21:27.068 INFO:tasks.workunit.client.0.smithi096.stdout:4/495: dwrite d3/d4/d14/d55/f9d [0,4194304] 0 2022-02-02T18:21:27.068 INFO:tasks.workunit.client.0.smithi096.stdout:4/496: creat d3/fb4 x:0 0 0 2022-02-02T18:21:27.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/521: dread d2/db/d10/f28 [0,4194304] 0 2022-02-02T18:21:27.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/522: fdatasync d2/db/d10/d80/f9f 0 2022-02-02T18:21:27.081 INFO:tasks.workunit.client.0.smithi096.stdout:7/421: dread d9/df/d12/f57 [0,4194304] 0 2022-02-02T18:21:27.081 INFO:tasks.workunit.client.0.smithi096.stdout:7/422: read - d9/df/d12/d39/d42/f5b zero size 2022-02-02T18:21:27.082 INFO:tasks.workunit.client.0.smithi096.stdout:0/523: rename d2/db/d37/f75 to d2/db/d24/d89/d8f/fb6 0 2022-02-02T18:21:27.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/524: mknod d2/d62/cb7 0 2022-02-02T18:21:27.085 INFO:tasks.workunit.client.0.smithi096.stdout:0/525: creat d2/db/d37/d40/fb8 x:0 0 0 2022-02-02T18:21:27.087 INFO:tasks.workunit.client.0.smithi096.stdout:5/439: dwrite db/de/d10/d80/f99 [0,4194304] 0 2022-02-02T18:21:27.088 INFO:tasks.workunit.client.0.smithi096.stdout:3/428: dwrite d2/df/d1c/f28 [4194304,4194304] 0 2022-02-02T18:21:27.089 INFO:tasks.workunit.client.0.smithi096.stdout:0/526: truncate d2/d1e/f36 220161 0 2022-02-02T18:21:27.092 INFO:tasks.workunit.client.0.smithi096.stdout:5/440: rename db/d5c/d2f/d46/f78 to db/d5c/fa6 0 2022-02-02T18:21:27.093 INFO:tasks.workunit.client.0.smithi096.stdout:5/441: write db/d5c/d60/f8c [43833,124145] 0 2022-02-02T18:21:27.093 INFO:tasks.workunit.client.0.smithi096.stdout:5/442: truncate db/de/f54 391799 0 2022-02-02T18:21:27.093 INFO:tasks.workunit.client.0.smithi096.stdout:4/497: dwrite d3/f4f [0,4194304] 0 2022-02-02T18:21:27.094 INFO:tasks.workunit.client.0.smithi096.stdout:2/464: sync 2022-02-02T18:21:27.095 INFO:tasks.workunit.client.0.smithi096.stdout:4/498: write d3/f4f [3318338,10737] 0 2022-02-02T18:21:27.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/429: write d2/df/d20/f37 [1360236,111610] 0 2022-02-02T18:21:27.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/430: write d2/df/d36/f68 [887606,15209] 0 2022-02-02T18:21:27.097 INFO:tasks.workunit.client.0.smithi096.stdout:2/465: symlink d2/d13/d42/l90 0 2022-02-02T18:21:27.097 INFO:tasks.workunit.client.0.smithi096.stdout:2/466: dread - d2/d13/d42/d71/f7a zero size 2022-02-02T18:21:27.098 INFO:tasks.workunit.client.0.smithi096.stdout:7/423: dwrite d9/df/d12/d39/d41/f49 [0,4194304] 0 2022-02-02T18:21:27.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/431: rename d2/df/d14/d16/f52 to d2/df/d20/d33/f98 0 2022-02-02T18:21:27.100 INFO:tasks.workunit.client.0.smithi096.stdout:2/467: symlink d2/d2a/l91 0 2022-02-02T18:21:27.102 INFO:tasks.workunit.client.0.smithi096.stdout:2/468: dread d2/d6/fa [0,4194304] 0 2022-02-02T18:21:27.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/424: creat d9/df/d47/d37/d83/f97 x:0 0 0 2022-02-02T18:21:27.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/469: dread d2/d19/f70 [0,4194304] 0 2022-02-02T18:21:27.107 INFO:tasks.workunit.client.0.smithi096.stdout:4/499: dread d3/d4/d20/d26/f34 [0,4194304] 0 2022-02-02T18:21:27.108 INFO:tasks.workunit.client.0.smithi096.stdout:7/425: mkdir d9/df/d16/d25/d98 0 2022-02-02T18:21:27.108 INFO:tasks.workunit.client.0.smithi096.stdout:7/426: readlink d9/df/d12/d39/d40/d51/l62 0 2022-02-02T18:21:27.109 INFO:tasks.workunit.client.0.smithi096.stdout:2/470: unlink d2/d5e/d6d/d79/f4b 0 2022-02-02T18:21:27.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/443: dwrite db/de/d2e/d35/f95 [0,4194304] 0 2022-02-02T18:21:27.113 INFO:tasks.workunit.client.0.smithi096.stdout:4/500: link d3/d27/f41 d3/d60/d8d/fb5 0 2022-02-02T18:21:27.114 INFO:tasks.workunit.client.0.smithi096.stdout:4/501: creat d3/d5a/fb6 x:0 0 0 2022-02-02T18:21:27.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/427: creat d9/df/d54/f99 x:0 0 0 2022-02-02T18:21:27.117 INFO:tasks.workunit.client.0.smithi096.stdout:2/471: creat d2/d6/d1b/d8a/f92 x:0 0 0 2022-02-02T18:21:27.117 INFO:tasks.workunit.client.0.smithi096.stdout:2/472: write d2/d5e/d6d/f7d [905856,33317] 0 2022-02-02T18:21:27.118 INFO:tasks.workunit.client.0.smithi096.stdout:5/444: dread db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:27.124 INFO:tasks.workunit.client.0.smithi096.stdout:2/473: getdents d2/d29/d5f 0 2022-02-02T18:21:27.125 INFO:tasks.workunit.client.0.smithi096.stdout:2/474: creat d2/d6/f93 x:0 0 0 2022-02-02T18:21:27.125 INFO:tasks.workunit.client.0.smithi096.stdout:3/432: dwrite d2/df/d36/f68 [0,4194304] 0 2022-02-02T18:21:27.126 INFO:tasks.workunit.client.0.smithi096.stdout:2/475: creat d2/d13/f94 x:0 0 0 2022-02-02T18:21:27.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/433: write d2/df/f26 [8278467,119359] 0 2022-02-02T18:21:27.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/434: readlink d2/df/d14/lc 0 2022-02-02T18:21:27.129 INFO:tasks.workunit.client.0.smithi096.stdout:7/428: write d9/df/d47/d19/f27 [4156396,83109] 0 2022-02-02T18:21:27.129 INFO:tasks.workunit.client.0.smithi096.stdout:2/476: dread d2/d13/d42/d71/f78 [0,4194304] 0 2022-02-02T18:21:27.130 INFO:tasks.workunit.client.0.smithi096.stdout:3/435: dread d2/df/d14/d16/f23 [0,4194304] 0 2022-02-02T18:21:27.133 INFO:tasks.workunit.client.0.smithi096.stdout:7/429: mknod d9/df/d54/c9a 0 2022-02-02T18:21:27.135 INFO:tasks.workunit.client.0.smithi096.stdout:2/477: mknod d2/d6/d1b/d3a/c95 0 2022-02-02T18:21:27.135 INFO:tasks.workunit.client.0.smithi096.stdout:2/478: chown d2/d13/f94 357421343 1 2022-02-02T18:21:27.135 INFO:tasks.workunit.client.0.smithi096.stdout:4/502: dwrite d3/d5a/f87 [0,4194304] 0 2022-02-02T18:21:27.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/436: unlink d2/df/d34/l61 0 2022-02-02T18:21:27.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/437: write d2/df/f26 [3560643,115669] 0 2022-02-02T18:21:27.141 INFO:tasks.workunit.client.0.smithi096.stdout:7/430: rename d9/df/d47/d37/d83/c96 to d9/df/d12/d39/d40/c9b 0 2022-02-02T18:21:27.142 INFO:tasks.workunit.client.0.smithi096.stdout:7/431: creat d9/df/d12/d39/d4e/d6e/f9c x:0 0 0 2022-02-02T18:21:27.142 INFO:tasks.workunit.client.0.smithi096.stdout:7/432: truncate d9/df/d12/d14/f30 900405 0 2022-02-02T18:21:27.142 INFO:tasks.workunit.client.0.smithi096.stdout:7/433: chown d9/df/d47/l68 315945 1 2022-02-02T18:21:27.143 INFO:tasks.workunit.client.0.smithi096.stdout:7/434: write d9/df/d12/f3f [1356088,130691] 0 2022-02-02T18:21:27.143 INFO:tasks.workunit.client.0.smithi096.stdout:7/435: stat d9/df/d12/d39/d46/d7d/f89 0 2022-02-02T18:21:27.144 INFO:tasks.workunit.client.0.smithi096.stdout:3/438: dread d2/df/d14/d66/f96 [0,4194304] 0 2022-02-02T18:21:27.147 INFO:tasks.workunit.client.0.smithi096.stdout:4/503: mknod d3/d4/d20/d26/d36/d51/d57/cb7 0 2022-02-02T18:21:27.154 INFO:tasks.workunit.client.0.smithi096.stdout:7/436: symlink d9/df/d47/l9d 0 2022-02-02T18:21:27.154 INFO:tasks.workunit.client.0.smithi096.stdout:7/437: truncate d9/df/d12/d39/d41/f84 662978 0 2022-02-02T18:21:27.154 INFO:tasks.workunit.client.0.smithi096.stdout:7/438: write d9/df/d12/d39/d4e/f8c [369795,28264] 0 2022-02-02T18:21:27.156 INFO:tasks.workunit.client.0.smithi096.stdout:3/439: symlink d2/df/d20/l99 0 2022-02-02T18:21:27.156 INFO:tasks.workunit.client.0.smithi096.stdout:3/440: write d2/df/d14/d2c/d31/f47 [5253866,36114] 0 2022-02-02T18:21:27.156 INFO:tasks.workunit.client.0.smithi096.stdout:3/441: chown d2/df/d14/d16 1887100628 1 2022-02-02T18:21:27.157 INFO:tasks.workunit.client.0.smithi096.stdout:7/439: creat d9/df/d47/d60/f9e x:0 0 0 2022-02-02T18:21:27.159 INFO:tasks.workunit.client.0.smithi096.stdout:2/479: rmdir d2/d29/d5f 0 2022-02-02T18:21:27.161 INFO:tasks.workunit.client.0.smithi096.stdout:3/442: unlink d2/df/d14/l5f 0 2022-02-02T18:21:27.162 INFO:tasks.workunit.client.0.smithi096.stdout:4/504: getdents d3/d60 0 2022-02-02T18:21:27.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/505: read d3/f32 [3746752,3864] 0 2022-02-02T18:21:27.164 INFO:tasks.workunit.client.0.smithi096.stdout:2/480: creat d2/d5e/d7c/f96 x:0 0 0 2022-02-02T18:21:27.164 INFO:tasks.workunit.client.0.smithi096.stdout:2/481: truncate d2/d6/db/f4c 156347 0 2022-02-02T18:21:27.165 INFO:tasks.workunit.client.0.smithi096.stdout:3/443: dread d2/df/d14/f30 [0,4194304] 0 2022-02-02T18:21:27.165 INFO:tasks.workunit.client.0.smithi096.stdout:4/506: write d3/d4/d20/d26/f5e [2162831,115728] 0 2022-02-02T18:21:27.166 INFO:tasks.workunit.client.0.smithi096.stdout:4/507: write d3/d4/d20/d4d/f4e [4882330,123305] 0 2022-02-02T18:21:27.166 INFO:tasks.workunit.client.0.smithi096.stdout:2/482: rename d2/d6/d1b/d3a/l6b to d2/d13/d8e/l97 0 2022-02-02T18:21:27.167 INFO:tasks.workunit.client.0.smithi096.stdout:2/483: write d2/d5e/d7c/f96 [51677,122200] 0 2022-02-02T18:21:27.167 INFO:tasks.workunit.client.0.smithi096.stdout:3/444: symlink d2/df/d20/d33/d58/l9a 0 2022-02-02T18:21:27.168 INFO:tasks.workunit.client.0.smithi096.stdout:2/484: getdents d2/d5e 0 2022-02-02T18:21:27.168 INFO:tasks.workunit.client.0.smithi096.stdout:3/445: write d2/df/d1c/f28 [5096891,102873] 0 2022-02-02T18:21:27.168 INFO:tasks.workunit.client.0.smithi096.stdout:3/446: write d2/df/d20/d33/d58/f5e [696557,15831] 0 2022-02-02T18:21:27.178 INFO:tasks.workunit.client.0.smithi096.stdout:7/440: dwrite d9/df/d47/d60/f73 [0,4194304] 0 2022-02-02T18:21:27.180 INFO:tasks.workunit.client.0.smithi096.stdout:4/508: dread d3/d4/d14/f66 [0,4194304] 0 2022-02-02T18:21:27.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/509: chown d3/d4/d20 53 1 2022-02-02T18:21:27.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/510: truncate d3/f5d 102105 0 2022-02-02T18:21:27.182 INFO:tasks.workunit.client.0.smithi096.stdout:7/441: write d9/f8a [3800913,7607] 0 2022-02-02T18:21:27.182 INFO:tasks.workunit.client.0.smithi096.stdout:7/442: stat d9/df/d47/l68 0 2022-02-02T18:21:27.182 INFO:tasks.workunit.client.0.smithi096.stdout:7/443: chown d9/df/d12/d14/c21 3 1 2022-02-02T18:21:27.183 INFO:tasks.workunit.client.0.smithi096.stdout:7/444: chown d9/df/d16/d25/f55 3469368 1 2022-02-02T18:21:27.183 INFO:tasks.workunit.client.0.smithi096.stdout:7/445: fdatasync d9/df/d12/d14/f31 0 2022-02-02T18:21:27.183 INFO:tasks.workunit.client.0.smithi096.stdout:7/446: chown d9/df/d12/d39/d46 50317 1 2022-02-02T18:21:27.183 INFO:tasks.workunit.client.0.smithi096.stdout:7/447: creat d9/df/d47/d60/f9f x:0 0 0 2022-02-02T18:21:27.184 INFO:tasks.workunit.client.0.smithi096.stdout:4/511: mkdir d3/d5a/db8 0 2022-02-02T18:21:27.189 INFO:tasks.workunit.client.0.smithi096.stdout:4/512: dread d3/d4/d14/f66 [0,4194304] 0 2022-02-02T18:21:27.191 INFO:tasks.workunit.client.0.smithi096.stdout:2/485: dwrite d2/d6/d76/f8d [0,4194304] 0 2022-02-02T18:21:27.191 INFO:tasks.workunit.client.0.smithi096.stdout:3/447: dwrite d2/df/d14/f18 [4194304,4194304] 0 2022-02-02T18:21:27.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/486: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:27.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/487: write d2/d6/d1b/d3a/f7f [5200299,55031] 0 2022-02-02T18:21:27.195 INFO:tasks.workunit.client.0.smithi096.stdout:3/448: rename d2/df/c8e to d2/df/d34/c9b 0 2022-02-02T18:21:27.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/424: sync 2022-02-02T18:21:27.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/425: dread - d15/d4d/f81 zero size 2022-02-02T18:21:27.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/426: creat d15/d4d/f96 x:0 0 0 2022-02-02T18:21:27.201 INFO:tasks.workunit.client.0.smithi096.stdout:3/449: dread d2/df/d20/f5b [0,4194304] 0 2022-02-02T18:21:27.206 INFO:tasks.workunit.client.0.smithi096.stdout:2/488: mknod d2/d13/d43/d51/d5d/c98 0 2022-02-02T18:21:27.210 INFO:tasks.workunit.client.0.smithi096.stdout:1/427: mknod d15/d1b/d26/c97 0 2022-02-02T18:21:27.213 INFO:tasks.workunit.client.0.smithi096.stdout:3/450: stat d2/df/d1c/d5d/d69/d43/d72/f95 0 2022-02-02T18:21:27.216 INFO:tasks.workunit.client.0.smithi096.stdout:3/451: rename d2/df/d14/d16/f23 to d2/df/d1c/d5d/d69/f9c 0 2022-02-02T18:21:27.218 INFO:tasks.workunit.client.0.smithi096.stdout:3/452: getdents d2/df/d34 0 2022-02-02T18:21:27.218 INFO:tasks.workunit.client.0.smithi096.stdout:3/453: dread - d2/df/d36/f7f zero size 2022-02-02T18:21:27.219 INFO:tasks.workunit.client.0.smithi096.stdout:3/454: chown d2/df/d14/d2c/f87 216751 1 2022-02-02T18:21:27.223 INFO:tasks.workunit.client.0.smithi096.stdout:3/455: dread d2/df/d20/f5b [0,4194304] 0 2022-02-02T18:21:27.223 INFO:tasks.workunit.client.0.smithi096.stdout:3/456: readlink d2/df/d1c/d5d/d69/d43/l46 0 2022-02-02T18:21:27.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/457: symlink d2/df/d14/d16/l9d 0 2022-02-02T18:21:27.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/458: creat d2/f9e x:0 0 0 2022-02-02T18:21:27.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/459: mknod d2/df/d20/d33/d58/c9f 0 2022-02-02T18:21:27.227 INFO:tasks.workunit.client.0.smithi096.stdout:3/460: write d2/df/d14/f12 [958324,54357] 0 2022-02-02T18:21:27.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/428: dwrite d15/d1b/d28/d2c/d39/d71/f91 [0,4194304] 0 2022-02-02T18:21:27.228 INFO:tasks.workunit.client.0.smithi096.stdout:2/489: dwrite d2/d6/d1b/d3a/f44 [0,4194304] 0 2022-02-02T18:21:27.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/461: unlink d2/df/d14/d16/l9d 0 2022-02-02T18:21:27.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/462: dread - d2/df/d20/d4a/f62 zero size 2022-02-02T18:21:27.230 INFO:tasks.workunit.client.0.smithi096.stdout:2/490: dread d2/d5e/d7c/f83 [0,4194304] 0 2022-02-02T18:21:27.236 INFO:tasks.workunit.client.0.smithi096.stdout:3/463: mknod d2/df/d1c/d5d/d69/d43/ca0 0 2022-02-02T18:21:27.239 INFO:tasks.workunit.client.0.smithi096.stdout:2/491: rename d2/d6/d1b/l4f to d2/d6/d1b/l99 0 2022-02-02T18:21:27.239 INFO:tasks.workunit.client.0.smithi096.stdout:2/492: chown d2/d5e/d6d/f7d 1 1 2022-02-02T18:21:27.244 INFO:tasks.workunit.client.0.smithi096.stdout:2/493: unlink d2/d6/d76/f8d 0 2022-02-02T18:21:27.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/429: dwrite f11 [0,4194304] 0 2022-02-02T18:21:27.245 INFO:tasks.workunit.client.0.smithi096.stdout:2/494: read d2/d5e/d6d/d79/f6a [7851,47103] 0 2022-02-02T18:21:27.245 INFO:tasks.workunit.client.0.smithi096.stdout:2/495: readlink d2/d2a/l52 0 2022-02-02T18:21:27.245 INFO:tasks.workunit.client.0.smithi096.stdout:2/496: read - d2/d6/f93 zero size 2022-02-02T18:21:27.246 INFO:tasks.workunit.client.0.smithi096.stdout:2/497: mknod d2/d13/d42/c9a 0 2022-02-02T18:21:27.248 INFO:tasks.workunit.client.0.smithi096.stdout:1/430: rmdir d15/d1b/d26 39 2022-02-02T18:21:27.248 INFO:tasks.workunit.client.0.smithi096.stdout:2/498: truncate f1 1124087 0 2022-02-02T18:21:27.250 INFO:tasks.workunit.client.0.smithi096.stdout:1/431: creat d15/d1b/d28/d3f/f98 x:0 0 0 2022-02-02T18:21:27.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/464: dwrite d2/df/d14/f50 [0,4194304] 0 2022-02-02T18:21:27.251 INFO:tasks.workunit.client.0.smithi096.stdout:6/467: sync 2022-02-02T18:21:27.251 INFO:tasks.workunit.client.0.smithi096.stdout:9/465: sync 2022-02-02T18:21:27.251 INFO:tasks.workunit.client.0.smithi096.stdout:6/468: creat d18/d24/d28/fad x:0 0 0 2022-02-02T18:21:27.252 INFO:tasks.workunit.client.0.smithi096.stdout:2/499: mknod d2/d13/d43/d51/d5d/c9b 0 2022-02-02T18:21:27.252 INFO:tasks.workunit.client.0.smithi096.stdout:2/500: fdatasync d2/d19/f1c 0 2022-02-02T18:21:27.254 INFO:tasks.workunit.client.0.smithi096.stdout:2/501: write d2/d2a/f30 [10871,63276] 0 2022-02-02T18:21:27.258 INFO:tasks.workunit.client.0.smithi096.stdout:2/502: symlink d2/d19/d86/l9c 0 2022-02-02T18:21:27.271 INFO:tasks.workunit.client.0.smithi096.stdout:7/448: sync 2022-02-02T18:21:27.271 INFO:tasks.workunit.client.0.smithi096.stdout:5/445: sync 2022-02-02T18:21:27.272 INFO:tasks.workunit.client.0.smithi096.stdout:7/449: stat d9/df/d12/d39/d40/d85 0 2022-02-02T18:21:27.272 INFO:tasks.workunit.client.0.smithi096.stdout:0/527: sync 2022-02-02T18:21:27.272 INFO:tasks.workunit.client.0.smithi096.stdout:7/450: read d9/df/d12/f3f [1387682,38427] 0 2022-02-02T18:21:27.272 INFO:tasks.workunit.client.0.smithi096.stdout:8/352: sync 2022-02-02T18:21:27.274 INFO:tasks.workunit.client.0.smithi096.stdout:3/465: dwrite d2/df/d20/d33/f98 [0,4194304] 0 2022-02-02T18:21:27.274 INFO:tasks.workunit.client.0.smithi096.stdout:0/528: getdents d2/db/d24/d89/d8f 0 2022-02-02T18:21:27.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/469: dwrite d18/d24/f5b [0,4194304] 0 2022-02-02T18:21:27.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/470: creat d18/d24/d73/fae x:0 0 0 2022-02-02T18:21:27.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/471: stat d18/d50/f56 0 2022-02-02T18:21:27.276 INFO:tasks.workunit.client.0.smithi096.stdout:7/451: truncate d9/df/d47/d19/f27 3270377 0 2022-02-02T18:21:27.277 INFO:tasks.workunit.client.0.smithi096.stdout:3/466: symlink d2/df/d14/d66/la1 0 2022-02-02T18:21:27.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/529: mkdir d2/d1e/db9 0 2022-02-02T18:21:27.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/530: creat d2/db/d24/d4d/d53/d58/fba x:0 0 0 2022-02-02T18:21:27.282 INFO:tasks.workunit.client.0.smithi096.stdout:6/472: rename d18/c85 to d18/d54/d63/caf 0 2022-02-02T18:21:27.284 INFO:tasks.workunit.client.0.smithi096.stdout:8/353: rmdir d29/d2d 39 2022-02-02T18:21:27.286 INFO:tasks.workunit.client.0.smithi096.stdout:7/452: unlink d9/df/d16/d25/f55 0 2022-02-02T18:21:27.288 INFO:tasks.workunit.client.0.smithi096.stdout:3/467: mknod d2/df/d14/d2c/d31/ca2 0 2022-02-02T18:21:27.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/531: rmdir d2/db/d24/d4d/d53/da5 0 2022-02-02T18:21:27.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/446: dwrite db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:27.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/447: fdatasync db/d5c/d2f/d46/f5f 0 2022-02-02T18:21:27.292 INFO:tasks.workunit.client.0.smithi096.stdout:8/354: fdatasync f5 0 2022-02-02T18:21:27.294 INFO:tasks.workunit.client.0.smithi096.stdout:8/355: mknod d29/d2d/d47/c71 0 2022-02-02T18:21:27.295 INFO:tasks.workunit.client.0.smithi096.stdout:7/453: getdents d9/df/d12/d39/d4e 0 2022-02-02T18:21:27.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/356: rename d29/d2d/f2f to d29/d4e/f72 0 2022-02-02T18:21:27.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/357: fsync d29/d2d/f32 0 2022-02-02T18:21:27.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/358: chown d29/d2d/f56 82552 1 2022-02-02T18:21:27.304 INFO:tasks.workunit.client.0.smithi096.stdout:6/473: dwrite d18/d54/d63/f8d [0,4194304] 0 2022-02-02T18:21:27.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/532: dwrite d2/db/d24/d4d/d53/d58/fa8 [0,4194304] 0 2022-02-02T18:21:27.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/533: chown d2/db/d37/l44 1 1 2022-02-02T18:21:27.311 INFO:tasks.workunit.client.0.smithi096.stdout:6/474: symlink d18/d50/d8f/lb0 0 2022-02-02T18:21:27.315 INFO:tasks.workunit.client.0.smithi096.stdout:6/475: write d18/d54/f39 [3860752,8557] 0 2022-02-02T18:21:27.315 INFO:tasks.workunit.client.0.smithi096.stdout:6/476: unlink d18/f1c 0 2022-02-02T18:21:27.315 INFO:tasks.workunit.client.0.smithi096.stdout:6/477: write d18/d24/d73/f92 [374875,53201] 0 2022-02-02T18:21:27.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/478: fsync d18/f1a 0 2022-02-02T18:21:27.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/479: creat d18/d24/d28/d3e/fb1 x:0 0 0 2022-02-02T18:21:27.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/480: fdatasync d18/f3a 0 2022-02-02T18:21:27.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/481: rmdir d18/d54/dac 0 2022-02-02T18:21:27.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/482: dread - d18/d50/d8f/fa4 zero size 2022-02-02T18:21:27.322 INFO:tasks.workunit.client.0.smithi096.stdout:6/483: rename d18/f26 to d18/d50/d9a/fb2 0 2022-02-02T18:21:27.323 INFO:tasks.workunit.client.0.smithi096.stdout:6/484: mkdir d18/d54/d63/db3 0 2022-02-02T18:21:27.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/534: dread d2/db/d24/d4d/d53/d58/fa8 [0,4194304] 0 2022-02-02T18:21:27.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/535: creat d2/db/d24/fbb x:0 0 0 2022-02-02T18:21:27.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/536: fsync d2/db/d10/f2b 0 2022-02-02T18:21:27.325 INFO:tasks.workunit.client.0.smithi096.stdout:0/537: dread - d2/db/d10/fab zero size 2022-02-02T18:21:27.325 INFO:tasks.workunit.client.0.smithi096.stdout:6/485: symlink d18/d54/d63/db3/lb4 0 2022-02-02T18:21:27.326 INFO:tasks.workunit.client.0.smithi096.stdout:6/486: stat d18/d50/c83 0 2022-02-02T18:21:27.327 INFO:tasks.workunit.client.0.smithi096.stdout:5/448: dwrite db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:27.327 INFO:tasks.workunit.client.0.smithi096.stdout:5/449: stat db/d5c/d32/l44 0 2022-02-02T18:21:27.328 INFO:tasks.workunit.client.0.smithi096.stdout:7/454: dwrite d9/df/d54/f99 [0,4194304] 0 2022-02-02T18:21:27.328 INFO:tasks.workunit.client.0.smithi096.stdout:7/455: stat d9/df/d12/d39/d46/f7e 0 2022-02-02T18:21:27.330 INFO:tasks.workunit.client.0.smithi096.stdout:0/538: dread d2/db/fc [0,4194304] 0 2022-02-02T18:21:27.330 INFO:tasks.workunit.client.0.smithi096.stdout:0/539: dread - d2/d1e/fa0 zero size 2022-02-02T18:21:27.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/540: mknod d2/d1e/db9/cbc 0 2022-02-02T18:21:27.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/541: creat d2/fbd x:0 0 0 2022-02-02T18:21:27.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/542: fsync d2/db/f2a 0 2022-02-02T18:21:27.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/543: read - d2/d62/f72 zero size 2022-02-02T18:21:27.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/544: creat d2/db/d24/d89/d91/fbe x:0 0 0 2022-02-02T18:21:27.340 INFO:tasks.workunit.client.0.smithi096.stdout:0/545: creat d2/db/d37/d40/d8a/fbf x:0 0 0 2022-02-02T18:21:27.340 INFO:tasks.workunit.client.0.smithi096.stdout:0/546: stat d2/db 0 2022-02-02T18:21:27.341 INFO:tasks.workunit.client.0.smithi096.stdout:0/547: symlink d2/db/d37/d40/d8a/lc0 0 2022-02-02T18:21:27.343 INFO:tasks.workunit.client.0.smithi096.stdout:6/487: dwrite d18/d24/f36 [0,4194304] 0 2022-02-02T18:21:27.343 INFO:tasks.workunit.client.0.smithi096.stdout:6/488: fdatasync d18/d24/f2d 0 2022-02-02T18:21:27.344 INFO:tasks.workunit.client.0.smithi096.stdout:6/489: fdatasync d18/f31 0 2022-02-02T18:21:27.344 INFO:tasks.workunit.client.0.smithi096.stdout:6/490: write d18/d24/f4d [1351436,79740] 0 2022-02-02T18:21:27.345 INFO:tasks.workunit.client.0.smithi096.stdout:6/491: read d18/d24/d73/f75 [1221997,87498] 0 2022-02-02T18:21:27.345 INFO:tasks.workunit.client.0.smithi096.stdout:6/492: chown d18/d54/c55 506592983 1 2022-02-02T18:21:27.345 INFO:tasks.workunit.client.0.smithi096.stdout:6/493: write d18/f27 [181463,116638] 0 2022-02-02T18:21:27.346 INFO:tasks.workunit.client.0.smithi096.stdout:6/494: truncate d18/d24/d28/d3e/fb1 495446 0 2022-02-02T18:21:27.347 INFO:tasks.workunit.client.0.smithi096.stdout:0/548: dread d2/db/d37/d40/f4e [0,4194304] 0 2022-02-02T18:21:27.347 INFO:tasks.workunit.client.0.smithi096.stdout:0/549: chown d2/db/d24/d4d/d53/d58/fba 100 1 2022-02-02T18:21:27.348 INFO:tasks.workunit.client.0.smithi096.stdout:4/513: sync 2022-02-02T18:21:27.348 INFO:tasks.workunit.client.0.smithi096.stdout:4/514: readlink d3/d4/d50/la3 0 2022-02-02T18:21:27.352 INFO:tasks.workunit.client.0.smithi096.stdout:0/550: mkdir d2/d62/dc1 0 2022-02-02T18:21:27.352 INFO:tasks.workunit.client.0.smithi096.stdout:0/551: creat d2/d66/fc2 x:0 0 0 2022-02-02T18:21:27.353 INFO:tasks.workunit.client.0.smithi096.stdout:7/456: dwrite d9/df/d47/d19/f27 [0,4194304] 0 2022-02-02T18:21:27.353 INFO:tasks.workunit.client.0.smithi096.stdout:4/515: dread d3/d4/d14/f66 [0,4194304] 0 2022-02-02T18:21:27.353 INFO:tasks.workunit.client.0.smithi096.stdout:4/516: write d3/d4/d20/d26/d36/d88/d98/fae [437819,76651] 0 2022-02-02T18:21:27.354 INFO:tasks.workunit.client.0.smithi096.stdout:0/552: creat d2/d62/fc3 x:0 0 0 2022-02-02T18:21:27.362 INFO:tasks.workunit.client.0.smithi096.stdout:7/457: symlink d9/df/d12/d14/d82/la0 0 2022-02-02T18:21:27.364 INFO:tasks.workunit.client.0.smithi096.stdout:0/553: link d2/db/d37/c92 d2/cc4 0 2022-02-02T18:21:27.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/458: rmdir d9/df/d12/d39/d46 39 2022-02-02T18:21:27.367 INFO:tasks.workunit.client.0.smithi096.stdout:0/554: unlink d2/db/d24/d89/d8f/d95/faf 0 2022-02-02T18:21:27.367 INFO:tasks.workunit.client.0.smithi096.stdout:0/555: read - d2/db/d24/f90 zero size 2022-02-02T18:21:27.368 INFO:tasks.workunit.client.0.smithi096.stdout:0/556: write d2/f6b [151789,48504] 0 2022-02-02T18:21:27.369 INFO:tasks.workunit.client.0.smithi096.stdout:7/459: rmdir d9/df/d12/d39/d42 39 2022-02-02T18:21:27.369 INFO:tasks.workunit.client.0.smithi096.stdout:7/460: chown d9/df/d12/d39 4 1 2022-02-02T18:21:27.369 INFO:tasks.workunit.client.0.smithi096.stdout:7/461: truncate d9/df/d12/d14/f31 645693 0 2022-02-02T18:21:27.370 INFO:tasks.workunit.client.0.smithi096.stdout:7/462: creat d9/df/d16/fa1 x:0 0 0 2022-02-02T18:21:27.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/557: mkdir d2/db/d24/d89/d8f/d95/dc5 0 2022-02-02T18:21:27.371 INFO:tasks.workunit.client.0.smithi096.stdout:0/558: unlink d2/db/f2a 0 2022-02-02T18:21:27.371 INFO:tasks.workunit.client.0.smithi096.stdout:7/463: creat d9/df/d47/fa2 x:0 0 0 2022-02-02T18:21:27.372 INFO:tasks.workunit.client.0.smithi096.stdout:7/464: creat d9/df/d54/fa3 x:0 0 0 2022-02-02T18:21:27.375 INFO:tasks.workunit.client.0.smithi096.stdout:4/517: dwrite d3/d4/d14/f46 [0,4194304] 0 2022-02-02T18:21:27.375 INFO:tasks.workunit.client.0.smithi096.stdout:6/495: dwrite d18/f27 [0,4194304] 0 2022-02-02T18:21:27.375 INFO:tasks.workunit.client.0.smithi096.stdout:6/496: chown d18/d24/d28/d4a/ca2 160 1 2022-02-02T18:21:27.376 INFO:tasks.workunit.client.0.smithi096.stdout:0/559: unlink d2/db/d37/d40/l77 0 2022-02-02T18:21:27.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/518: mkdir d3/d4/db9 0 2022-02-02T18:21:27.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/519: write d3/d4/f23 [1886959,28] 0 2022-02-02T18:21:27.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/520: chown d3/d4/f1c 54746858 1 2022-02-02T18:21:27.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/521: readlink d3/d4/l2c 0 2022-02-02T18:21:27.379 INFO:tasks.workunit.client.0.smithi096.stdout:4/522: write d3/d4/d14/f66 [620660,97869] 0 2022-02-02T18:21:27.379 INFO:tasks.workunit.client.0.smithi096.stdout:6/497: mkdir d18/d54/d63/db3/db5 0 2022-02-02T18:21:27.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/560: dread d2/d1e/f36 [0,4194304] 0 2022-02-02T18:21:27.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/561: dread d2/db/d10/f28 [0,4194304] 0 2022-02-02T18:21:27.386 INFO:tasks.workunit.client.0.smithi096.stdout:4/523: rename d3/d4/d20/d26/d36/d51/c7f to d3/d4/d20/d26/d36/d51/d57/cba 0 2022-02-02T18:21:27.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/524: read d3/d4/d20/d4d/f4e [3321053,9870] 0 2022-02-02T18:21:27.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/525: dread - d3/d4/d90/f9f zero size 2022-02-02T18:21:27.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/526: fdatasync d3/d4/d20/d26/d36/f8a 0 2022-02-02T18:21:27.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/498: mknod d18/cb6 0 2022-02-02T18:21:27.388 INFO:tasks.workunit.client.0.smithi096.stdout:2/503: sync 2022-02-02T18:21:27.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/432: sync 2022-02-02T18:21:27.389 INFO:tasks.workunit.client.0.smithi096.stdout:9/466: sync 2022-02-02T18:21:27.389 INFO:tasks.workunit.client.0.smithi096.stdout:9/467: readlink d1/db/d1c/d2f/l43 0 2022-02-02T18:21:27.391 INFO:tasks.workunit.client.0.smithi096.stdout:2/504: write d2/d6/d1b/d3a/f7f [75439,67177] 0 2022-02-02T18:21:27.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/562: rename d2/db/d37/d40/c5c to d2/d62/dc1/cc6 0 2022-02-02T18:21:27.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/563: truncate d2/db/d37/d40/d8a/fbf 197672 0 2022-02-02T18:21:27.392 INFO:tasks.workunit.client.0.smithi096.stdout:4/527: symlink d3/d4/d20/lbb 0 2022-02-02T18:21:27.392 INFO:tasks.workunit.client.0.smithi096.stdout:4/528: fsync d3/d4/d14/f75 0 2022-02-02T18:21:27.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/499: write d18/d24/d28/d3e/f62 [1121415,21921] 0 2022-02-02T18:21:27.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/500: fdatasync d18/d50/f61 0 2022-02-02T18:21:27.393 INFO:tasks.workunit.client.0.smithi096.stdout:6/501: truncate d18/d24/d28/d4a/d9d/fab 352767 0 2022-02-02T18:21:27.393 INFO:tasks.workunit.client.0.smithi096.stdout:6/502: unlink d18/l5c 0 2022-02-02T18:21:27.395 INFO:tasks.workunit.client.0.smithi096.stdout:2/505: dread d2/d13/d42/d71/f78 [0,4194304] 0 2022-02-02T18:21:27.395 INFO:tasks.workunit.client.0.smithi096.stdout:1/433: creat d15/d74/f99 x:0 0 0 2022-02-02T18:21:27.396 INFO:tasks.workunit.client.0.smithi096.stdout:9/468: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/cb2 0 2022-02-02T18:21:27.396 INFO:tasks.workunit.client.0.smithi096.stdout:9/469: creat d1/db/d48/fb3 x:0 0 0 2022-02-02T18:21:27.396 INFO:tasks.workunit.client.0.smithi096.stdout:0/564: truncate d2/db/f84 2961555 0 2022-02-02T18:21:27.396 INFO:tasks.workunit.client.0.smithi096.stdout:0/565: truncate d2/db/d10/d27/f2d 2004617 0 2022-02-02T18:21:27.397 INFO:tasks.workunit.client.0.smithi096.stdout:0/566: creat d2/db/fc7 x:0 0 0 2022-02-02T18:21:27.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/529: truncate d3/d4/f1c 2897294 0 2022-02-02T18:21:27.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/530: truncate d3/d27/f8c 534722 0 2022-02-02T18:21:27.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/531: write d3/d27/f39 [1780442,105448] 0 2022-02-02T18:21:27.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/532: write d3/d4/d20/d26/d36/d88/d98/fa4 [660704,77204] 0 2022-02-02T18:21:27.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/533: write d3/d4/f37 [665390,60402] 0 2022-02-02T18:21:27.399 INFO:tasks.workunit.client.0.smithi096.stdout:4/534: read d3/f4f [4088036,49365] 0 2022-02-02T18:21:27.399 INFO:tasks.workunit.client.0.smithi096.stdout:1/434: creat d15/d67/f9a x:0 0 0 2022-02-02T18:21:27.399 INFO:tasks.workunit.client.0.smithi096.stdout:2/506: link d2/d13/l35 d2/d6/d1b/d3a/l9d 0 2022-02-02T18:21:27.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/470: mknod d1/db/d1c/d2f/d78/cb4 0 2022-02-02T18:21:27.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/471: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/c33 223 1 2022-02-02T18:21:27.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/472: creat d1/d39/d8a/d97/fb5 x:0 0 0 2022-02-02T18:21:27.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/535: dread d3/d4/d20/d26/f34 [0,4194304] 0 2022-02-02T18:21:27.403 INFO:tasks.workunit.client.0.smithi096.stdout:9/473: write d1/db/d1c/d2f/d78/d25/d8e/d9d/fa5 [4115837,58023] 0 2022-02-02T18:21:27.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/503: mknod d18/d24/d28/d3e/cb7 0 2022-02-02T18:21:27.411 INFO:tasks.workunit.client.0.smithi096.stdout:4/536: dread d3/d60/d8d/fb5 [0,4194304] 0 2022-02-02T18:21:27.411 INFO:tasks.workunit.client.0.smithi096.stdout:9/474: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/cb6 0 2022-02-02T18:21:27.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/537: mkdir d3/d4/d14/d55/dbc 0 2022-02-02T18:21:27.414 INFO:tasks.workunit.client.0.smithi096.stdout:4/538: mkdir d3/d60/dbd 0 2022-02-02T18:21:27.415 INFO:tasks.workunit.client.0.smithi096.stdout:4/539: chown d3/d4/d14/lb1 6 1 2022-02-02T18:21:27.417 INFO:tasks.workunit.client.0.smithi096.stdout:4/540: mknod d3/d60/cbe 0 2022-02-02T18:21:27.418 INFO:tasks.workunit.client.0.smithi096.stdout:4/541: fsync d3/d4/d20/d26/d36/f56 0 2022-02-02T18:21:27.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/507: dwrite d2/d6/db/f8f [0,4194304] 0 2022-02-02T18:21:27.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/508: fsync d2/d5e/d6d/d79/f6a 0 2022-02-02T18:21:27.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/509: dread - d2/d6/d1b/d3a/f3e zero size 2022-02-02T18:21:27.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/510: readlink l0 0 2022-02-02T18:21:27.422 INFO:tasks.workunit.client.0.smithi096.stdout:6/504: dread d18/d50/f61 [0,4194304] 0 2022-02-02T18:21:27.423 INFO:tasks.workunit.client.0.smithi096.stdout:2/511: rename d2/f24 to d2/d5e/f9e 0 2022-02-02T18:21:27.423 INFO:tasks.workunit.client.0.smithi096.stdout:2/512: chown d2/d5e/d6d/d79/d81 1 1 2022-02-02T18:21:27.426 INFO:tasks.workunit.client.0.smithi096.stdout:2/513: rmdir d2/d6/d1b/d3a 39 2022-02-02T18:21:27.426 INFO:tasks.workunit.client.0.smithi096.stdout:2/514: chown d2/d6/d1b/l3c 8431 1 2022-02-02T18:21:27.426 INFO:tasks.workunit.client.0.smithi096.stdout:9/475: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [0,4194304] 0 2022-02-02T18:21:27.426 INFO:tasks.workunit.client.0.smithi096.stdout:9/476: fsync d1/f36 0 2022-02-02T18:21:27.427 INFO:tasks.workunit.client.0.smithi096.stdout:1/435: dwrite d15/d1b/d28/d47/f5c [0,4194304] 0 2022-02-02T18:21:27.428 INFO:tasks.workunit.client.0.smithi096.stdout:1/436: write d15/d1b/d28/f61 [1875156,26711] 0 2022-02-02T18:21:27.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/515: mkdir d2/d19/d9f 0 2022-02-02T18:21:27.429 INFO:tasks.workunit.client.0.smithi096.stdout:9/477: creat d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fb7 x:0 0 0 2022-02-02T18:21:27.435 INFO:tasks.workunit.client.0.smithi096.stdout:1/437: mknod d15/d1b/d28/d2c/d39/d6b/d8a/c9b 0 2022-02-02T18:21:27.436 INFO:tasks.workunit.client.0.smithi096.stdout:1/438: dread - d15/d1b/d26/d6f/f7a zero size 2022-02-02T18:21:27.436 INFO:tasks.workunit.client.0.smithi096.stdout:9/478: creat d1/db/d1c/d2f/d78/d25/d8e/fb8 x:0 0 0 2022-02-02T18:21:27.437 INFO:tasks.workunit.client.0.smithi096.stdout:1/439: creat d15/d1b/d28/d2c/d39/d6b/d8a/f9c x:0 0 0 2022-02-02T18:21:27.437 INFO:tasks.workunit.client.0.smithi096.stdout:1/440: stat d15/d4d/d8e 0 2022-02-02T18:21:27.438 INFO:tasks.workunit.client.0.smithi096.stdout:1/441: symlink d15/d1b/d26/d6f/l9d 0 2022-02-02T18:21:27.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/505: dwrite d18/d50/f56 [0,4194304] 0 2022-02-02T18:21:27.442 INFO:tasks.workunit.client.0.smithi096.stdout:6/506: mkdir d18/d24/d28/d4a/db8 0 2022-02-02T18:21:27.447 INFO:tasks.workunit.client.0.smithi096.stdout:6/507: dread d18/d54/f4b [0,4194304] 0 2022-02-02T18:21:27.449 INFO:tasks.workunit.client.0.smithi096.stdout:2/516: dwrite d2/d6/d1b/d3a/f3e [0,4194304] 0 2022-02-02T18:21:27.450 INFO:tasks.workunit.client.0.smithi096.stdout:6/508: read d18/d24/d28/d3e/f44 [94774,101039] 0 2022-02-02T18:21:27.450 INFO:tasks.workunit.client.0.smithi096.stdout:6/509: write d18/d54/f4b [481176,98642] 0 2022-02-02T18:21:27.457 INFO:tasks.workunit.client.0.smithi096.stdout:9/479: dwrite d1/d39/d8a/d97/fb5 [0,4194304] 0 2022-02-02T18:21:27.460 INFO:tasks.workunit.client.0.smithi096.stdout:1/442: getdents d15/d1b/d26/d6f 0 2022-02-02T18:21:27.460 INFO:tasks.workunit.client.0.smithi096.stdout:1/443: truncate d15/d1b/d28/d2c/d39/d6b/d8a/f9c 369857 0 2022-02-02T18:21:27.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/444: dread d15/d1b/d28/f3e [0,4194304] 0 2022-02-02T18:21:27.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/445: readlink d15/d1b/d26/l35 0 2022-02-02T18:21:27.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/446: creat d15/d1b/d28/d2c/d39/d71/f9e x:0 0 0 2022-02-02T18:21:27.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/447: read - d15/d1b/d28/d2c/f5a zero size 2022-02-02T18:21:27.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/448: write d15/d1b/d28/f61 [2686116,79760] 0 2022-02-02T18:21:27.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/468: sync 2022-02-02T18:21:27.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/450: sync 2022-02-02T18:21:27.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/480: mknod d1/cb9 0 2022-02-02T18:21:27.469 INFO:tasks.workunit.client.0.smithi096.stdout:8/359: sync 2022-02-02T18:21:27.469 INFO:tasks.workunit.client.0.smithi096.stdout:5/451: dread - db/de/d10/fa4 zero size 2022-02-02T18:21:27.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/481: chown d1/db/d1c/d2f/d78/da6 3372647 1 2022-02-02T18:21:27.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/452: getdents db/de/d10/d25 0 2022-02-02T18:21:27.471 INFO:tasks.workunit.client.0.smithi096.stdout:6/510: getdents d18/d50 0 2022-02-02T18:21:27.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/482: mknod d1/db/d48/cba 0 2022-02-02T18:21:27.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/483: truncate d1/db/d1c/d2f/d78/f92 1355134 0 2022-02-02T18:21:27.473 INFO:tasks.workunit.client.0.smithi096.stdout:5/453: mkdir db/d5c/d60/da7 0 2022-02-02T18:21:27.474 INFO:tasks.workunit.client.0.smithi096.stdout:5/454: readlink db/l66 0 2022-02-02T18:21:27.474 INFO:tasks.workunit.client.0.smithi096.stdout:5/455: write db/de/f16 [1549682,58414] 0 2022-02-02T18:21:27.475 INFO:tasks.workunit.client.0.smithi096.stdout:5/456: mknod db/de/ca8 0 2022-02-02T18:21:27.477 INFO:tasks.workunit.client.0.smithi096.stdout:5/457: symlink db/de/d10/d25/da0/d85/la9 0 2022-02-02T18:21:27.477 INFO:tasks.workunit.client.0.smithi096.stdout:5/458: chown db/de/d10/d27/f4d 1858140044 1 2022-02-02T18:21:27.482 INFO:tasks.workunit.client.0.smithi096.stdout:5/459: write db/de/d2e/d35/f34 [109826,117825] 0 2022-02-02T18:21:27.485 INFO:tasks.workunit.client.0.smithi096.stdout:5/460: mknod db/de/d10/d80/caa 0 2022-02-02T18:21:27.485 INFO:tasks.workunit.client.0.smithi096.stdout:5/461: creat db/d20/fab x:0 0 0 2022-02-02T18:21:27.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/462: creat db/de/d10/d27/d83/fac x:0 0 0 2022-02-02T18:21:27.496 INFO:tasks.workunit.client.0.smithi096.stdout:1/449: dwrite d15/d1b/d28/d47/f79 [0,4194304] 0 2022-02-02T18:21:27.496 INFO:tasks.workunit.client.0.smithi096.stdout:1/450: dread - d15/d1b/d28/d3f/f98 zero size 2022-02-02T18:21:27.516 INFO:tasks.workunit.client.0.smithi096.stdout:6/511: dwrite d18/f8a [4194304,4194304] 0 2022-02-02T18:21:27.516 INFO:tasks.workunit.client.0.smithi096.stdout:6/512: getdents d18/d54/d63/db3/db5 0 2022-02-02T18:21:27.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/513: symlink d18/d24/d28/lb9 0 2022-02-02T18:21:27.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/514: dread - d18/d50/f88 zero size 2022-02-02T18:21:27.518 INFO:tasks.workunit.client.0.smithi096.stdout:8/360: dwrite f5 [0,4194304] 0 2022-02-02T18:21:27.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/515: symlink d18/d54/d63/d7e/lba 0 2022-02-02T18:21:27.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/463: dwrite db/d5c/d2f/f3d [0,4194304] 0 2022-02-02T18:21:27.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/464: fdatasync db/f1b 0 2022-02-02T18:21:27.520 INFO:tasks.workunit.client.0.smithi096.stdout:3/469: dwrite d2/df/d20/d33/f51 [0,4194304] 0 2022-02-02T18:21:27.520 INFO:tasks.workunit.client.0.smithi096.stdout:1/451: dwrite d15/d1b/d28/d3f/f98 [0,4194304] 0 2022-02-02T18:21:27.520 INFO:tasks.workunit.client.0.smithi096.stdout:9/484: dwrite d1/db/d1c/d2f/d78/d11/d1e/f31 [0,4194304] 0 2022-02-02T18:21:27.525 INFO:tasks.workunit.client.0.smithi096.stdout:5/465: unlink db/de/d10/d27/f8f 0 2022-02-02T18:21:27.526 INFO:tasks.workunit.client.0.smithi096.stdout:5/466: write db/de/d2e/d35/f37 [807555,88338] 0 2022-02-02T18:21:27.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/452: getdents d15/d1b/d26 0 2022-02-02T18:21:27.538 INFO:tasks.workunit.client.0.smithi096.stdout:9/485: unlink d1/db/d1c/c4d 0 2022-02-02T18:21:27.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/486: read d1/db/d1c/d2f/d78/f95 [349116,108054] 0 2022-02-02T18:21:27.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/361: rmdir d29 39 2022-02-02T18:21:27.542 INFO:tasks.workunit.client.0.smithi096.stdout:5/467: truncate db/d5c/f55 3914429 0 2022-02-02T18:21:27.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/468: write db/de/d10/d27/d83/f96 [768614,125441] 0 2022-02-02T18:21:27.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/469: fsync db/de/f13 0 2022-02-02T18:21:27.544 INFO:tasks.workunit.client.0.smithi096.stdout:1/453: unlink d15/d1b/d28/d2c/d4f/c62 0 2022-02-02T18:21:27.545 INFO:tasks.workunit.client.0.smithi096.stdout:6/516: dwrite d18/d54/f39 [0,4194304] 0 2022-02-02T18:21:27.546 INFO:tasks.workunit.client.0.smithi096.stdout:5/470: truncate f3 1525382 0 2022-02-02T18:21:27.546 INFO:tasks.workunit.client.0.smithi096.stdout:8/362: creat d29/d2d/d42/f73 x:0 0 0 2022-02-02T18:21:27.547 INFO:tasks.workunit.client.0.smithi096.stdout:9/487: dread d1/f2c [0,4194304] 0 2022-02-02T18:21:27.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/363: truncate f5 5191128 0 2022-02-02T18:21:27.547 INFO:tasks.workunit.client.0.smithi096.stdout:1/454: mkdir d15/d1b/d26/d6f/d9f 0 2022-02-02T18:21:27.548 INFO:tasks.workunit.client.0.smithi096.stdout:1/455: read d15/d1b/d26/f49 [3170739,23797] 0 2022-02-02T18:21:27.549 INFO:tasks.workunit.client.0.smithi096.stdout:9/488: truncate d1/db/d48/f8d 105300 0 2022-02-02T18:21:27.549 INFO:tasks.workunit.client.0.smithi096.stdout:3/470: dwrite d2/df/d1c/d5d/d69/f42 [0,4194304] 0 2022-02-02T18:21:27.549 INFO:tasks.workunit.client.0.smithi096.stdout:6/517: getdents d18/d50/d8f 0 2022-02-02T18:21:27.551 INFO:tasks.workunit.client.0.smithi096.stdout:1/456: mknod d15/d1b/d28/d2c/d4f/d51/ca0 0 2022-02-02T18:21:27.551 INFO:tasks.workunit.client.0.smithi096.stdout:1/457: chown d15/d1b/d26/f49 1 1 2022-02-02T18:21:27.551 INFO:tasks.workunit.client.0.smithi096.stdout:1/458: fsync d15/d1b/d26/f31 0 2022-02-02T18:21:27.551 INFO:tasks.workunit.client.0.smithi096.stdout:5/471: getdents db/d20 0 2022-02-02T18:21:27.552 INFO:tasks.workunit.client.0.smithi096.stdout:5/472: stat db/d5c/d2f/d46/d75/d9d/l9f 0 2022-02-02T18:21:27.552 INFO:tasks.workunit.client.0.smithi096.stdout:5/473: chown db/de/f2a 433 1 2022-02-02T18:21:27.552 INFO:tasks.workunit.client.0.smithi096.stdout:5/474: write db/de/d10/d25/d4c/f65 [657974,31371] 0 2022-02-02T18:21:27.554 INFO:tasks.workunit.client.0.smithi096.stdout:7/465: sync 2022-02-02T18:21:27.554 INFO:tasks.workunit.client.0.smithi096.stdout:0/567: sync 2022-02-02T18:21:27.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/466: write d9/fd [5801619,77231] 0 2022-02-02T18:21:27.562 INFO:tasks.workunit.client.0.smithi096.stdout:3/471: rmdir d2/df/d14/d2c/d31/d89 0 2022-02-02T18:21:27.563 INFO:tasks.workunit.client.0.smithi096.stdout:6/518: truncate d18/d24/d28/d3e/fb1 534420 0 2022-02-02T18:21:27.564 INFO:tasks.workunit.client.0.smithi096.stdout:1/459: link d15/d1b/d26/l33 d15/d1b/d26/d72/la1 0 2022-02-02T18:21:27.565 INFO:tasks.workunit.client.0.smithi096.stdout:5/475: symlink db/de/d10/d97/lad 0 2022-02-02T18:21:27.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/460: read d15/d1b/d28/d2c/d39/d71/f91 [2098929,48207] 0 2022-02-02T18:21:27.574 INFO:tasks.workunit.client.0.smithi096.stdout:0/568: dwrite d2/db/d10/d27/f2d [0,4194304] 0 2022-02-02T18:21:27.575 INFO:tasks.workunit.client.0.smithi096.stdout:9/489: rmdir d1/db/d1c 39 2022-02-02T18:21:27.575 INFO:tasks.workunit.client.0.smithi096.stdout:9/490: fsync d1/db/d1c/d2f/d78/d11/d1e/f31 0 2022-02-02T18:21:27.578 INFO:tasks.workunit.client.0.smithi096.stdout:7/467: chown d9/df/d12/c1c 0 1 2022-02-02T18:21:27.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/542: sync 2022-02-02T18:21:27.580 INFO:tasks.workunit.client.0.smithi096.stdout:2/517: sync 2022-02-02T18:21:27.586 INFO:tasks.workunit.client.0.smithi096.stdout:2/518: write d2/d6/d1b/d3a/f44 [1125126,14205] 0 2022-02-02T18:21:27.587 INFO:tasks.workunit.client.0.smithi096.stdout:9/491: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb x:0 0 0 2022-02-02T18:21:27.587 INFO:tasks.workunit.client.0.smithi096.stdout:4/543: dread d3/d4/d50/fa2 [0,4194304] 0 2022-02-02T18:21:27.587 INFO:tasks.workunit.client.0.smithi096.stdout:4/544: chown d3/d27/f43 0 1 2022-02-02T18:21:27.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/468: mkdir d9/df/d12/d39/d46/da4 0 2022-02-02T18:21:27.592 INFO:tasks.workunit.client.0.smithi096.stdout:9/492: creat d1/db/d1c/d2f/d78/d11/d3c/fbc x:0 0 0 2022-02-02T18:21:27.593 INFO:tasks.workunit.client.0.smithi096.stdout:7/469: mkdir d9/df/d47/d60/da5 0 2022-02-02T18:21:27.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/476: dwrite db/de/d2e/d35/f81 [0,4194304] 0 2022-02-02T18:21:27.594 INFO:tasks.workunit.client.0.smithi096.stdout:0/569: dwrite d2/db/d10/f33 [0,4194304] 0 2022-02-02T18:21:27.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/472: dwrite d2/df/d14/f18 [0,4194304] 0 2022-02-02T18:21:27.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/570: read d2/db/d37/f3e [284598,79946] 0 2022-02-02T18:21:27.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/571: readlink d2/db/d10/l5a 0 2022-02-02T18:21:27.596 INFO:tasks.workunit.client.0.smithi096.stdout:0/572: truncate d2/d66/fa7 583928 0 2022-02-02T18:21:27.596 INFO:tasks.workunit.client.0.smithi096.stdout:0/573: truncate d2/db/d37/f7a 1539309 0 2022-02-02T18:21:27.596 INFO:tasks.workunit.client.0.smithi096.stdout:6/519: rename d18/d54 to d18/d50/d8f/dbb 0 2022-02-02T18:21:27.597 INFO:tasks.workunit.client.0.smithi096.stdout:9/493: link d1/db/d1c/d2f/d78/d25/ca d1/db/d1c/d2f/d78/d11/cbd 0 2022-02-02T18:21:27.598 INFO:tasks.workunit.client.0.smithi096.stdout:9/494: write d1/db/d1c/d2f/d78/d11/d3c/f79 [955574,94133] 0 2022-02-02T18:21:27.599 INFO:tasks.workunit.client.0.smithi096.stdout:9/495: truncate d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb 483312 0 2022-02-02T18:21:27.600 INFO:tasks.workunit.client.0.smithi096.stdout:0/574: dread d2/db/d37/f3e [0,4194304] 0 2022-02-02T18:21:27.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/477: dread db/de/d2e/f51 [0,4194304] 0 2022-02-02T18:21:27.603 INFO:tasks.workunit.client.0.smithi096.stdout:3/473: mkdir d2/df/d1c/d5d/da3 0 2022-02-02T18:21:27.604 INFO:tasks.workunit.client.0.smithi096.stdout:6/520: creat d18/d50/d8f/dbb/fbc x:0 0 0 2022-02-02T18:21:27.606 INFO:tasks.workunit.client.0.smithi096.stdout:0/575: rename d2/d1e/fa0 to d2/db/d24/d4d/d61/fc8 0 2022-02-02T18:21:27.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/474: mkdir d2/df/d36/da4 0 2022-02-02T18:21:27.610 INFO:tasks.workunit.client.0.smithi096.stdout:6/521: mkdir d18/d50/d8f/dbb/d63/d7e/dbd 0 2022-02-02T18:21:27.610 INFO:tasks.workunit.client.0.smithi096.stdout:6/522: fdatasync d18/d50/d8f/dbb/f6b 0 2022-02-02T18:21:27.611 INFO:tasks.workunit.client.0.smithi096.stdout:6/523: fsync d18/d50/f88 0 2022-02-02T18:21:27.611 INFO:tasks.workunit.client.0.smithi096.stdout:6/524: fsync d18/f31 0 2022-02-02T18:21:27.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/519: dwrite d2/d6/db/f38 [0,4194304] 0 2022-02-02T18:21:27.612 INFO:tasks.workunit.client.0.smithi096.stdout:5/478: getdents db/de/d10/d25/d4c 0 2022-02-02T18:21:27.613 INFO:tasks.workunit.client.0.smithi096.stdout:5/479: write db/de/d2e/d35/f37 [906546,130273] 0 2022-02-02T18:21:27.614 INFO:tasks.workunit.client.0.smithi096.stdout:3/475: rename d2/df/d14/d2c/d31/f49 to d2/df/d20/d33/d58/d7c/fa5 0 2022-02-02T18:21:27.615 INFO:tasks.workunit.client.0.smithi096.stdout:3/476: fsync d2/df/d34/f39 0 2022-02-02T18:21:27.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/545: dwrite d3/d60/d8d/da7/fa9 [0,4194304] 0 2022-02-02T18:21:27.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/546: write d3/d4/d90/f9f [734097,66264] 0 2022-02-02T18:21:27.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/525: unlink d18/d50/d8f/dbb/d63/caf 0 2022-02-02T18:21:27.617 INFO:tasks.workunit.client.0.smithi096.stdout:0/576: rmdir d2/d66 39 2022-02-02T18:21:27.618 INFO:tasks.workunit.client.0.smithi096.stdout:2/520: creat d2/d5e/d6d/fa0 x:0 0 0 2022-02-02T18:21:27.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/477: rmdir d2/df/d20/d33 39 2022-02-02T18:21:27.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/478: write d2/df/d20/f5b [890579,40921] 0 2022-02-02T18:21:27.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/479: read - d2/df/d36/f7f zero size 2022-02-02T18:21:27.620 INFO:tasks.workunit.client.0.smithi096.stdout:4/547: symlink d3/d60/d8d/da7/lbf 0 2022-02-02T18:21:27.620 INFO:tasks.workunit.client.0.smithi096.stdout:4/548: readlink d3/d4/d20/d4d/l95 0 2022-02-02T18:21:27.621 INFO:tasks.workunit.client.0.smithi096.stdout:4/549: creat d3/d60/d8d/fc0 x:0 0 0 2022-02-02T18:21:27.622 INFO:tasks.workunit.client.0.smithi096.stdout:6/526: creat d18/d50/d8f/dbb/d63/db3/db5/fbe x:0 0 0 2022-02-02T18:21:27.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/527: fsync d18/d24/f5b 0 2022-02-02T18:21:27.623 INFO:tasks.workunit.client.0.smithi096.stdout:2/521: truncate d2/d19/f1c 301525 0 2022-02-02T18:21:27.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/480: mkdir d2/df/da6 0 2022-02-02T18:21:27.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/528: symlink d18/d50/d8f/dbb/d63/db3/lbf 0 2022-02-02T18:21:27.626 INFO:tasks.workunit.client.0.smithi096.stdout:5/480: dread db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:27.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/529: creat d18/d24/d28/fc0 x:0 0 0 2022-02-02T18:21:27.627 INFO:tasks.workunit.client.0.smithi096.stdout:2/522: mknod d2/d13/d42/d71/ca1 0 2022-02-02T18:21:27.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/481: rename d2/df/d14/d2c/l78 to d2/df/d36/la7 0 2022-02-02T18:21:27.631 INFO:tasks.workunit.client.0.smithi096.stdout:0/577: dread d2/db/d24/d4d/d54/f55 [0,4194304] 0 2022-02-02T18:21:27.631 INFO:tasks.workunit.client.0.smithi096.stdout:5/481: write db/d5c/d2f/f3d [3931745,118146] 0 2022-02-02T18:21:27.632 INFO:tasks.workunit.client.0.smithi096.stdout:6/530: rmdir d18/d50/d9a 39 2022-02-02T18:21:27.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/482: mkdir d2/df/d14/d2c/d31/da8 0 2022-02-02T18:21:27.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/483: write d2/df/d1c/d5d/f79 [354675,49968] 0 2022-02-02T18:21:27.633 INFO:tasks.workunit.client.0.smithi096.stdout:5/482: read db/f1b [224247,31299] 0 2022-02-02T18:21:27.636 INFO:tasks.workunit.client.0.smithi096.stdout:0/578: creat d2/db4/fc9 x:0 0 0 2022-02-02T18:21:27.636 INFO:tasks.workunit.client.0.smithi096.stdout:0/579: stat d2/db/d10/c96 0 2022-02-02T18:21:27.641 INFO:tasks.workunit.client.0.smithi096.stdout:2/523: dread d2/f72 [0,4194304] 0 2022-02-02T18:21:27.642 INFO:tasks.workunit.client.0.smithi096.stdout:3/484: mknod d2/df/d34/d76/ca9 0 2022-02-02T18:21:27.643 INFO:tasks.workunit.client.0.smithi096.stdout:5/483: rename db/f1b to db/d5c/d60/da7/fae 0 2022-02-02T18:21:27.644 INFO:tasks.workunit.client.0.smithi096.stdout:5/484: chown db/d5c/d2f/d46/f74 396415 1 2022-02-02T18:21:27.644 INFO:tasks.workunit.client.0.smithi096.stdout:5/485: readlink db/de/d2e/l87 0 2022-02-02T18:21:27.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/470: dwrite d9/df/d47/d60/f9e [0,4194304] 0 2022-02-02T18:21:27.645 INFO:tasks.workunit.client.0.smithi096.stdout:9/496: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f86 [0,4194304] 0 2022-02-02T18:21:27.646 INFO:tasks.workunit.client.0.smithi096.stdout:0/580: mkdir d2/db/d10/d80/d93/da3/dca 0 2022-02-02T18:21:27.646 INFO:tasks.workunit.client.0.smithi096.stdout:0/581: dread - d2/db/d24/d4d/d54/fae zero size 2022-02-02T18:21:27.648 INFO:tasks.workunit.client.0.smithi096.stdout:3/485: mkdir d2/df/d14/d11/daa 0 2022-02-02T18:21:27.649 INFO:tasks.workunit.client.0.smithi096.stdout:2/524: mknod d2/d5e/d6d/ca2 0 2022-02-02T18:21:27.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/531: dwrite d18/d24/f33 [0,4194304] 0 2022-02-02T18:21:27.653 INFO:tasks.workunit.client.0.smithi096.stdout:4/550: dwrite d3/d27/f43 [0,4194304] 0 2022-02-02T18:21:27.654 INFO:tasks.workunit.client.0.smithi096.stdout:4/551: chown d3/d60/dbd 6075 1 2022-02-02T18:21:27.654 INFO:tasks.workunit.client.0.smithi096.stdout:4/552: chown d3/d4/d20/f22 44207276 1 2022-02-02T18:21:27.655 INFO:tasks.workunit.client.0.smithi096.stdout:9/497: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26 39 2022-02-02T18:21:27.655 INFO:tasks.workunit.client.0.smithi096.stdout:9/498: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/c33 733 1 2022-02-02T18:21:27.656 INFO:tasks.workunit.client.0.smithi096.stdout:9/499: chown d1/db/d63/l88 241 1 2022-02-02T18:21:27.656 INFO:tasks.workunit.client.0.smithi096.stdout:3/486: creat d2/df/d20/d33/d58/d7c/fab x:0 0 0 2022-02-02T18:21:27.657 INFO:tasks.workunit.client.0.smithi096.stdout:2/525: symlink d2/d5e/d7c/la3 0 2022-02-02T18:21:27.657 INFO:tasks.workunit.client.0.smithi096.stdout:2/526: fsync d2/d6/d1b/f39 0 2022-02-02T18:21:27.657 INFO:tasks.workunit.client.0.smithi096.stdout:2/527: rename d2/d5e to d2/d5e/d7c/da4 22 2022-02-02T18:21:27.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/553: write d3/d5a/f5f [931638,37936] 0 2022-02-02T18:21:27.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/554: fsync d3/d5a/fb6 0 2022-02-02T18:21:27.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/555: creat d3/d4/d20/d26/d36/d51/fc1 x:0 0 0 2022-02-02T18:21:27.668 INFO:tasks.workunit.client.0.smithi096.stdout:2/528: symlink d2/d13/d42/d71/la5 0 2022-02-02T18:21:27.669 INFO:tasks.workunit.client.0.smithi096.stdout:2/529: chown d2/d6/d1b/d48 509376 1 2022-02-02T18:21:27.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/530: unlink d2/d5e/d7c/f96 0 2022-02-02T18:21:27.672 INFO:tasks.workunit.client.0.smithi096.stdout:2/531: creat d2/d5e/d6d/d79/d66/fa6 x:0 0 0 2022-02-02T18:21:27.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/487: dread d2/df/d1c/f29 [0,4194304] 0 2022-02-02T18:21:27.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/488: stat d2/df/d34/d76/ca9 0 2022-02-02T18:21:27.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/489: fdatasync d2/df/d20/d33/d58/d7c/fab 0 2022-02-02T18:21:27.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/490: write d2/df/f26 [8802330,28469] 0 2022-02-02T18:21:27.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/491: truncate d2/df/d1c/f59 685035 0 2022-02-02T18:21:27.684 INFO:tasks.workunit.client.0.smithi096.stdout:7/471: dwrite d9/df/d12/d39/d42/f5b [0,4194304] 0 2022-02-02T18:21:27.687 INFO:tasks.workunit.client.0.smithi096.stdout:5/486: dwrite db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:27.688 INFO:tasks.workunit.client.0.smithi096.stdout:5/487: dread - db/de/d10/d27/f4d zero size 2022-02-02T18:21:27.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/556: dwrite d3/d4/d14/f66 [4194304,4194304] 0 2022-02-02T18:21:27.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/557: chown d3/d4/l7 1264 1 2022-02-02T18:21:27.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/558: write d3/d85/fa0 [1512884,58866] 0 2022-02-02T18:21:27.689 INFO:tasks.workunit.client.0.smithi096.stdout:7/472: write d9/df/d12/d39/d41/f49 [1909534,45635] 0 2022-02-02T18:21:27.689 INFO:tasks.workunit.client.0.smithi096.stdout:7/473: fsync d9/fd 0 2022-02-02T18:21:27.690 INFO:tasks.workunit.client.0.smithi096.stdout:7/474: write d9/df/d12/d39/f75 [60757,3548] 0 2022-02-02T18:21:27.690 INFO:tasks.workunit.client.0.smithi096.stdout:5/488: dread db/de/d10/d25/d4c/f65 [0,4194304] 0 2022-02-02T18:21:27.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/559: mkdir d3/d60/dc2 0 2022-02-02T18:21:27.692 INFO:tasks.workunit.client.0.smithi096.stdout:5/489: rmdir db/d5c/d2f/d46 39 2022-02-02T18:21:27.693 INFO:tasks.workunit.client.0.smithi096.stdout:5/490: mknod db/d5c/caf 0 2022-02-02T18:21:27.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/491: creat db/de/d10/d80/fb0 x:0 0 0 2022-02-02T18:21:27.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/492: link db/d5c/d2f/d46/f5f db/de/d2e/fb1 0 2022-02-02T18:21:27.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/560: read d3/d27/f30 [2165637,64893] 0 2022-02-02T18:21:27.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/561: dread - d3/d4/d20/d26/d36/d51/fc1 zero size 2022-02-02T18:21:27.697 INFO:tasks.workunit.client.0.smithi096.stdout:4/562: stat d3/l2a 0 2022-02-02T18:21:27.697 INFO:tasks.workunit.client.0.smithi096.stdout:6/532: dwrite d18/d50/d8f/dbb/f6a [0,4194304] 0 2022-02-02T18:21:27.698 INFO:tasks.workunit.client.0.smithi096.stdout:9/500: dwrite d1/db/d1c/d2f/d78/d25/fad [8388608,4194304] 0 2022-02-02T18:21:27.699 INFO:tasks.workunit.client.0.smithi096.stdout:9/501: truncate d1/db/d1c/f6e 1018537 0 2022-02-02T18:21:27.699 INFO:tasks.workunit.client.0.smithi096.stdout:2/532: dwrite d2/d13/d42/d71/f7a [0,4194304] 0 2022-02-02T18:21:27.703 INFO:tasks.workunit.client.0.smithi096.stdout:4/563: write d3/f10 [3258898,101651] 0 2022-02-02T18:21:27.705 INFO:tasks.workunit.client.0.smithi096.stdout:6/533: creat d18/d24/d73/d79/fc1 x:0 0 0 2022-02-02T18:21:27.708 INFO:tasks.workunit.client.0.smithi096.stdout:9/502: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/d9f 0 2022-02-02T18:21:27.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/461: sync 2022-02-02T18:21:27.710 INFO:tasks.workunit.client.0.smithi096.stdout:8/364: sync 2022-02-02T18:21:27.712 INFO:tasks.workunit.client.0.smithi096.stdout:2/533: rename d2/c18 to d2/d13/d43/d80/ca7 0 2022-02-02T18:21:27.712 INFO:tasks.workunit.client.0.smithi096.stdout:2/534: readlink d2/d6/d1b/d3a/l3d 0 2022-02-02T18:21:27.713 INFO:tasks.workunit.client.0.smithi096.stdout:2/535: write d2/d6/d1b/d3a/f3e [5201617,89025] 0 2022-02-02T18:21:27.715 INFO:tasks.workunit.client.0.smithi096.stdout:9/503: rmdir d1/d39/d8a 39 2022-02-02T18:21:27.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/504: write d1/db/d48/d69/f9c [525048,119672] 0 2022-02-02T18:21:27.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/462: mkdir d15/d1b/d26/da2 0 2022-02-02T18:21:27.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/463: chown d15/d1b/d28/d2c/c6a 6 1 2022-02-02T18:21:27.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/365: rename d29/l4b to d29/d4e/l74 0 2022-02-02T18:21:27.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/505: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/cbe 0 2022-02-02T18:21:27.725 INFO:tasks.workunit.client.0.smithi096.stdout:9/506: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f59 [12090,19219] 0 2022-02-02T18:21:27.726 INFO:tasks.workunit.client.0.smithi096.stdout:9/507: fdatasync d1/db/d1c/d2f/d78/d25/d8e/fb8 0 2022-02-02T18:21:27.726 INFO:tasks.workunit.client.0.smithi096.stdout:9/508: fdatasync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb 0 2022-02-02T18:21:27.727 INFO:tasks.workunit.client.0.smithi096.stdout:1/464: mkdir d15/d1b/d26/d72/da3 0 2022-02-02T18:21:27.728 INFO:tasks.workunit.client.0.smithi096.stdout:9/509: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f5b [0,4194304] 0 2022-02-02T18:21:27.731 INFO:tasks.workunit.client.0.smithi096.stdout:5/493: dwrite db/de/f2a [0,4194304] 0 2022-02-02T18:21:27.732 INFO:tasks.workunit.client.0.smithi096.stdout:8/366: dread d29/d2d/f45 [0,4194304] 0 2022-02-02T18:21:27.732 INFO:tasks.workunit.client.0.smithi096.stdout:5/494: creat db/de/d10/d27/fb2 x:0 0 0 2022-02-02T18:21:27.733 INFO:tasks.workunit.client.0.smithi096.stdout:4/564: dwrite f1 [0,4194304] 0 2022-02-02T18:21:27.734 INFO:tasks.workunit.client.0.smithi096.stdout:1/465: rmdir d15/d1b/d26/da2 0 2022-02-02T18:21:27.735 INFO:tasks.workunit.client.0.smithi096.stdout:2/536: dwrite d2/d6/db/f27 [0,4194304] 0 2022-02-02T18:21:27.735 INFO:tasks.workunit.client.0.smithi096.stdout:8/367: mknod d29/d40/d6d/c75 0 2022-02-02T18:21:27.736 INFO:tasks.workunit.client.0.smithi096.stdout:5/495: creat db/de/d10/d25/d4c/fb3 x:0 0 0 2022-02-02T18:21:27.737 INFO:tasks.workunit.client.0.smithi096.stdout:5/496: fdatasync f3 0 2022-02-02T18:21:27.737 INFO:tasks.workunit.client.0.smithi096.stdout:4/565: symlink d3/d4/d14/d55/lc3 0 2022-02-02T18:21:27.738 INFO:tasks.workunit.client.0.smithi096.stdout:5/497: dread db/de/d10/d25/f45 [0,4194304] 0 2022-02-02T18:21:27.738 INFO:tasks.workunit.client.0.smithi096.stdout:1/466: creat d15/d1b/d28/d2c/d4f/d51/fa4 x:0 0 0 2022-02-02T18:21:27.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/498: write db/de/d10/d27/f36 [1011824,10554] 0 2022-02-02T18:21:27.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/499: dread - db/de/d10/d27/fb2 zero size 2022-02-02T18:21:27.741 INFO:tasks.workunit.client.0.smithi096.stdout:2/537: rename d2/d6/d76/f84 to d2/d29/fa8 0 2022-02-02T18:21:27.741 INFO:tasks.workunit.client.0.smithi096.stdout:2/538: fsync d2/d5e/d6d/d79/d66/f68 0 2022-02-02T18:21:27.741 INFO:tasks.workunit.client.0.smithi096.stdout:2/539: readlink d2/d19/d86/l9c 0 2022-02-02T18:21:27.742 INFO:tasks.workunit.client.0.smithi096.stdout:8/368: symlink d29/d40/d6d/l76 0 2022-02-02T18:21:27.743 INFO:tasks.workunit.client.0.smithi096.stdout:8/369: truncate d29/d2d/f32 1011499 0 2022-02-02T18:21:27.743 INFO:tasks.workunit.client.0.smithi096.stdout:6/534: dwrite d18/d24/d28/d3e/f41 [0,4194304] 0 2022-02-02T18:21:27.743 INFO:tasks.workunit.client.0.smithi096.stdout:6/535: write d18/d50/d8f/dbb/d63/db3/db5/fbe [314651,71369] 0 2022-02-02T18:21:27.744 INFO:tasks.workunit.client.0.smithi096.stdout:1/467: rmdir d15/d1b/d28/d2c/d84 0 2022-02-02T18:21:27.744 INFO:tasks.workunit.client.0.smithi096.stdout:1/468: truncate d15/d1b/d28/d2c/f4c 4561163 0 2022-02-02T18:21:27.745 INFO:tasks.workunit.client.0.smithi096.stdout:6/536: write d18/f19 [6089329,129836] 0 2022-02-02T18:21:27.745 INFO:tasks.workunit.client.0.smithi096.stdout:5/500: rmdir db/d5c/d2f/d46/d7f 0 2022-02-02T18:21:27.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/566: rename d3/d4/d20/d26/d36/l64 to d3/d60/d8d/lc4 0 2022-02-02T18:21:27.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/567: chown d3/d5a/c6a 241 1 2022-02-02T18:21:27.755 INFO:tasks.workunit.client.0.smithi096.stdout:8/370: dread f17 [0,4194304] 0 2022-02-02T18:21:27.760 INFO:tasks.workunit.client.0.smithi096.stdout:1/469: mknod d15/d1b/d28/d2c/d39/d6b/d8a/ca5 0 2022-02-02T18:21:27.760 INFO:tasks.workunit.client.0.smithi096.stdout:1/470: dread - d15/d1b/d28/d47/f86 zero size 2022-02-02T18:21:27.761 INFO:tasks.workunit.client.0.smithi096.stdout:6/537: mkdir d18/d50/d8f/dbb/d63/dc2 0 2022-02-02T18:21:27.762 INFO:tasks.workunit.client.0.smithi096.stdout:5/501: creat db/d5c/d2f/d46/fb4 x:0 0 0 2022-02-02T18:21:27.763 INFO:tasks.workunit.client.0.smithi096.stdout:5/502: fdatasync f3 0 2022-02-02T18:21:27.763 INFO:tasks.workunit.client.0.smithi096.stdout:5/503: truncate db/de/d10/d80/fb0 996081 0 2022-02-02T18:21:27.763 INFO:tasks.workunit.client.0.smithi096.stdout:8/371: rmdir d29 39 2022-02-02T18:21:27.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/540: dwrite d2/d6/fa [0,4194304] 0 2022-02-02T18:21:27.767 INFO:tasks.workunit.client.0.smithi096.stdout:9/510: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f59 [4194304,4194304] 0 2022-02-02T18:21:27.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/471: link d15/d1b/f25 d15/d1b/d28/d2c/d39/d6b/d8a/fa6 0 2022-02-02T18:21:27.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/472: write d15/d1b/d26/d6f/f82 [61178,112430] 0 2022-02-02T18:21:27.768 INFO:tasks.workunit.client.0.smithi096.stdout:8/372: rename d29/d2d/d42/f68 to d29/d2d/f77 0 2022-02-02T18:21:27.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/473: truncate d15/d1b/d26/d72/f7f 908742 0 2022-02-02T18:21:27.771 INFO:tasks.workunit.client.0.smithi096.stdout:6/538: write d18/f3a [3598833,64901] 0 2022-02-02T18:21:27.772 INFO:tasks.workunit.client.0.smithi096.stdout:6/539: write d18/d50/d8f/fa4 [197468,20095] 0 2022-02-02T18:21:27.772 INFO:tasks.workunit.client.0.smithi096.stdout:2/541: write d2/d6/fa [1022193,65710] 0 2022-02-02T18:21:27.776 INFO:tasks.workunit.client.0.smithi096.stdout:8/373: unlink d29/f62 0 2022-02-02T18:21:27.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/540: chown d18/d24/d28/d3e/f5f 24 1 2022-02-02T18:21:27.780 INFO:tasks.workunit.client.0.smithi096.stdout:2/542: mkdir d2/d13/d43/d51/d73/da9 0 2022-02-02T18:21:27.781 INFO:tasks.workunit.client.0.smithi096.stdout:8/374: mknod d29/d2d/c78 0 2022-02-02T18:21:27.783 INFO:tasks.workunit.client.0.smithi096.stdout:6/541: creat d18/d50/d8f/dbb/d63/dc2/fc3 x:0 0 0 2022-02-02T18:21:27.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/543: creat d2/d13/d43/d51/d73/da9/faa x:0 0 0 2022-02-02T18:21:27.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/544: read - d2/d6/d1b/d48/f82 zero size 2022-02-02T18:21:27.788 INFO:tasks.workunit.client.0.smithi096.stdout:6/542: rename d18/d50/d8f/dbb/d63/d7e to d18/d50/d8f/dc4 0 2022-02-02T18:21:27.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/582: sync 2022-02-02T18:21:27.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/583: chown d2/d1e/l23 40 1 2022-02-02T18:21:27.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/545: unlink d2/d6/db/c31 0 2022-02-02T18:21:27.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/546: chown d2/d13/d43/d51/d73 304 1 2022-02-02T18:21:27.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/547: fdatasync d2/d5e/d6d/f7d 0 2022-02-02T18:21:27.793 INFO:tasks.workunit.client.0.smithi096.stdout:0/584: unlink d2/d1e/f2e 0 2022-02-02T18:21:27.794 INFO:tasks.workunit.client.0.smithi096.stdout:0/585: getdents d2/db/d24/d89/d8f/da1 0 2022-02-02T18:21:27.794 INFO:tasks.workunit.client.0.smithi096.stdout:4/568: dwrite d3/d4/d14/f9e [0,4194304] 0 2022-02-02T18:21:27.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/375: dread f5 [0,4194304] 0 2022-02-02T18:21:27.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/586: dread d2/d66/fa7 [0,4194304] 0 2022-02-02T18:21:27.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/376: mkdir d29/d58/d79 0 2022-02-02T18:21:27.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/377: unlink d29/f3e 0 2022-02-02T18:21:27.799 INFO:tasks.workunit.client.0.smithi096.stdout:5/504: dwrite db/de/d2e/f41 [0,4194304] 0 2022-02-02T18:21:27.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/505: chown db/d5c/d2f/d46/f73 366415 1 2022-02-02T18:21:27.800 INFO:tasks.workunit.client.0.smithi096.stdout:0/587: rename d2/fbd to d2/db/d37/fcb 0 2022-02-02T18:21:27.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/506: dread db/de/d10/d80/fb0 [0,4194304] 0 2022-02-02T18:21:27.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/507: truncate db/d5c/d2f/d46/fb4 876785 0 2022-02-02T18:21:27.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/378: chown c1e 34423845 1 2022-02-02T18:21:27.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/379: dread - d29/d2d/d42/f59 zero size 2022-02-02T18:21:27.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/380: fdatasync d29/f34 0 2022-02-02T18:21:27.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/548: dread d2/d6/d1b/d48/f4d [0,4194304] 0 2022-02-02T18:21:27.805 INFO:tasks.workunit.client.0.smithi096.stdout:1/474: dwrite d15/d1b/d28/f58 [0,4194304] 0 2022-02-02T18:21:27.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/511: dwrite d1/db/d1c/f64 [0,4194304] 0 2022-02-02T18:21:27.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/549: fdatasync d2/d6/f41 0 2022-02-02T18:21:27.811 INFO:tasks.workunit.client.0.smithi096.stdout:0/588: truncate d2/db/d10/f2b 144730 0 2022-02-02T18:21:27.811 INFO:tasks.workunit.client.0.smithi096.stdout:0/589: creat d2/d1e/fcc x:0 0 0 2022-02-02T18:21:27.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/569: dwrite d3/d85/f9b [0,4194304] 0 2022-02-02T18:21:27.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/570: write d3/d4/d90/f9f [1535122,77576] 0 2022-02-02T18:21:27.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/571: write d3/d4/d20/d26/d36/d88/d98/fa4 [295715,15868] 0 2022-02-02T18:21:27.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/572: creat d3/d4/d20/d26/d36/fc5 x:0 0 0 2022-02-02T18:21:27.813 INFO:tasks.workunit.client.0.smithi096.stdout:4/573: dread - d3/d60/f79 zero size 2022-02-02T18:21:27.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/508: symlink db/d5c/lb5 0 2022-02-02T18:21:27.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/381: mkdir d29/d58/d7a 0 2022-02-02T18:21:27.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/550: dread d2/d6/d1b/f39 [0,4194304] 0 2022-02-02T18:21:27.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/551: fdatasync d2/d5e/d6d/d79/d66/fa6 0 2022-02-02T18:21:27.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/543: dwrite d18/d24/d28/f35 [0,4194304] 0 2022-02-02T18:21:27.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/544: chown d18/d24/d28/c30 9 1 2022-02-02T18:21:27.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/545: write d18/d24/f33 [4536935,42605] 0 2022-02-02T18:21:27.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/546: read - d18/d50/d6d/d95/f97 zero size 2022-02-02T18:21:27.821 INFO:tasks.workunit.client.0.smithi096.stdout:9/512: rmdir d1/db/d1c/d2f/d78/d25/d8e/d9d 39 2022-02-02T18:21:27.822 INFO:tasks.workunit.client.0.smithi096.stdout:9/513: truncate d1/db/f9a 723438 0 2022-02-02T18:21:27.822 INFO:tasks.workunit.client.0.smithi096.stdout:9/514: chown d1/db/d1c/d2f/d78/d11/d1e/d38 18415 1 2022-02-02T18:21:27.826 INFO:tasks.workunit.client.0.smithi096.stdout:0/590: mkdir d2/db/d24/d89/d8f/d95/dcd 0 2022-02-02T18:21:27.826 INFO:tasks.workunit.client.0.smithi096.stdout:0/591: write d2/db/d24/d4d/d61/fc8 [207664,67711] 0 2022-02-02T18:21:27.828 INFO:tasks.workunit.client.0.smithi096.stdout:7/475: sync 2022-02-02T18:21:27.828 INFO:tasks.workunit.client.0.smithi096.stdout:3/492: sync 2022-02-02T18:21:27.828 INFO:tasks.workunit.client.0.smithi096.stdout:7/476: write d9/f8d [457867,117223] 0 2022-02-02T18:21:27.829 INFO:tasks.workunit.client.0.smithi096.stdout:4/574: getdents d3/d27 0 2022-02-02T18:21:27.829 INFO:tasks.workunit.client.0.smithi096.stdout:4/575: write d3/d4/d20/d26/d36/d51/f86 [1335217,118067] 0 2022-02-02T18:21:27.830 INFO:tasks.workunit.client.0.smithi096.stdout:5/509: link db/de/d10/d25/f45 db/de/fb6 0 2022-02-02T18:21:27.831 INFO:tasks.workunit.client.0.smithi096.stdout:5/510: write db/de/d10/d27/d83/fac [177240,82813] 0 2022-02-02T18:21:27.831 INFO:tasks.workunit.client.0.smithi096.stdout:4/576: dread d3/d27/f41 [0,4194304] 0 2022-02-02T18:21:27.832 INFO:tasks.workunit.client.0.smithi096.stdout:4/577: read d3/d4/d20/d26/d36/d51/f86 [928382,33938] 0 2022-02-02T18:21:27.832 INFO:tasks.workunit.client.0.smithi096.stdout:2/552: mknod d2/d5e/cab 0 2022-02-02T18:21:27.833 INFO:tasks.workunit.client.0.smithi096.stdout:4/578: write d3/f10 [3822657,16107] 0 2022-02-02T18:21:27.833 INFO:tasks.workunit.client.0.smithi096.stdout:4/579: readlink d3/d4/d20/d4d/laf 0 2022-02-02T18:21:27.833 INFO:tasks.workunit.client.0.smithi096.stdout:6/547: creat d18/d50/d8f/dbb/d63/db3/db5/fc5 x:0 0 0 2022-02-02T18:21:27.834 INFO:tasks.workunit.client.0.smithi096.stdout:6/548: write d18/d50/f88 [715757,100925] 0 2022-02-02T18:21:27.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/592: mknod d2/db/d24/d4d/d61/cce 0 2022-02-02T18:21:27.835 INFO:tasks.workunit.client.0.smithi096.stdout:3/493: creat d2/df/d20/d4a/fac x:0 0 0 2022-02-02T18:21:27.835 INFO:tasks.workunit.client.0.smithi096.stdout:3/494: stat d2/df/d34/d76/ca9 0 2022-02-02T18:21:27.835 INFO:tasks.workunit.client.0.smithi096.stdout:3/495: chown d2/df/d1c/d5d/d69/d43/f8a 1337474058 1 2022-02-02T18:21:27.836 INFO:tasks.workunit.client.0.smithi096.stdout:7/477: creat d9/df/d12/d39/d40/d51/fa6 x:0 0 0 2022-02-02T18:21:27.837 INFO:tasks.workunit.client.0.smithi096.stdout:5/511: mkdir db/d5c/d2f/db7 0 2022-02-02T18:21:27.837 INFO:tasks.workunit.client.0.smithi096.stdout:2/553: getdents d2/d6/d1b/d3a 0 2022-02-02T18:21:27.837 INFO:tasks.workunit.client.0.smithi096.stdout:2/554: creat d2/d13/d42/d71/fac x:0 0 0 2022-02-02T18:21:27.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/580: mkdir d3/d60/d8d/dc6 0 2022-02-02T18:21:27.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/581: write d3/d4/d20/d26/d36/fc5 [80774,101605] 0 2022-02-02T18:21:27.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/582: readlink d3/l15 0 2022-02-02T18:21:27.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/583: creat d3/d85/fc7 x:0 0 0 2022-02-02T18:21:27.841 INFO:tasks.workunit.client.0.smithi096.stdout:4/584: creat d3/d4/d20/d26/d36/fc8 x:0 0 0 2022-02-02T18:21:27.841 INFO:tasks.workunit.client.0.smithi096.stdout:4/585: chown d3/d60/d8d/lc4 3546815 1 2022-02-02T18:21:27.841 INFO:tasks.workunit.client.0.smithi096.stdout:6/549: creat d18/d50/d6d/fc6 x:0 0 0 2022-02-02T18:21:27.842 INFO:tasks.workunit.client.0.smithi096.stdout:1/475: rename d15/d74 to d15/d1b/d26/d72/da3/da7 0 2022-02-02T18:21:27.842 INFO:tasks.workunit.client.0.smithi096.stdout:1/476: rename d15/d1b to d15/d1b/d28/d2c/d39/d71/da8 22 2022-02-02T18:21:27.843 INFO:tasks.workunit.client.0.smithi096.stdout:0/593: mkdir d2/db/d24/d89/d8f/d95/dcd/dcf 0 2022-02-02T18:21:27.843 INFO:tasks.workunit.client.0.smithi096.stdout:0/594: dread - d2/db/d24/fbb zero size 2022-02-02T18:21:27.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/496: creat d2/df/da6/fad x:0 0 0 2022-02-02T18:21:27.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/497: getdents d2/df/d1c/d5d/da3 0 2022-02-02T18:21:27.847 INFO:tasks.workunit.client.0.smithi096.stdout:2/555: mkdir d2/d13/d42/d71/dad 0 2022-02-02T18:21:27.847 INFO:tasks.workunit.client.0.smithi096.stdout:6/550: rmdir d18/d50/d8f/dbb/d63/db3 39 2022-02-02T18:21:27.848 INFO:tasks.workunit.client.0.smithi096.stdout:2/556: chown d2/d13/d42/d71/c74 4 1 2022-02-02T18:21:27.848 INFO:tasks.workunit.client.0.smithi096.stdout:6/551: chown d18/d50/d6d 493 1 2022-02-02T18:21:27.849 INFO:tasks.workunit.client.0.smithi096.stdout:8/382: rename d29/d2d/d47/c71 to d29/d4a/d5b/c7b 0 2022-02-02T18:21:27.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/515: rename d1/db/d1c/d2f/d78/da6 to d1/db/d1c/d2f/d78/d11/d1e/d66/dbf 0 2022-02-02T18:21:27.854 INFO:tasks.workunit.client.0.smithi096.stdout:9/516: write d1/db/d1c/d2f/f5a [1121071,98037] 0 2022-02-02T18:21:27.854 INFO:tasks.workunit.client.0.smithi096.stdout:0/595: rmdir d2/db/d37/d40/d8a 39 2022-02-02T18:21:27.854 INFO:tasks.workunit.client.0.smithi096.stdout:0/596: write d2/d1e/fcc [115245,47077] 0 2022-02-02T18:21:27.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/597: chown d2/d1e/d67 35 1 2022-02-02T18:21:27.857 INFO:tasks.workunit.client.0.smithi096.stdout:6/552: fsync d18/d50/d8f/dbb/d63/db3/db5/fc5 0 2022-02-02T18:21:27.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/477: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:27.858 INFO:tasks.workunit.client.0.smithi096.stdout:4/586: dread d3/d4/d20/d26/f5e [0,4194304] 0 2022-02-02T18:21:27.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/498: write d2/df/d14/d66/f96 [1034410,21257] 0 2022-02-02T18:21:27.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/499: creat d2/df/d20/d33/d58/d7c/fae x:0 0 0 2022-02-02T18:21:27.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/500: stat d2/df/d14/d2c/d74/f7b 0 2022-02-02T18:21:27.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/501: creat d2/df/d20/d33/d58/d7c/faf x:0 0 0 2022-02-02T18:21:27.861 INFO:tasks.workunit.client.0.smithi096.stdout:3/502: fdatasync d2/df/d1c/d5d/d69/f9c 0 2022-02-02T18:21:27.861 INFO:tasks.workunit.client.0.smithi096.stdout:0/598: write d2/d66/d71/f82 [3335808,101946] 0 2022-02-02T18:21:27.861 INFO:tasks.workunit.client.0.smithi096.stdout:9/517: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/fc0 x:0 0 0 2022-02-02T18:21:27.863 INFO:tasks.workunit.client.0.smithi096.stdout:6/553: creat d18/d50/d8f/dbb/d63/fc7 x:0 0 0 2022-02-02T18:21:27.864 INFO:tasks.workunit.client.0.smithi096.stdout:1/478: unlink d15/d1b/d28/d2c/d4f/c52 0 2022-02-02T18:21:27.865 INFO:tasks.workunit.client.0.smithi096.stdout:4/587: creat d3/d60/fc9 x:0 0 0 2022-02-02T18:21:27.868 INFO:tasks.workunit.client.0.smithi096.stdout:3/503: creat d2/df/d14/d16/fb0 x:0 0 0 2022-02-02T18:21:27.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/504: chown d2/df/d14/d11/daa 1763 1 2022-02-02T18:21:27.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/505: fsync d2/df/d20/d33/f98 0 2022-02-02T18:21:27.870 INFO:tasks.workunit.client.0.smithi096.stdout:0/599: symlink d2/db/d10/d80/d93/da3/ld0 0 2022-02-02T18:21:27.870 INFO:tasks.workunit.client.0.smithi096.stdout:9/518: dread d1/db/d1c/d2f/f51 [0,4194304] 0 2022-02-02T18:21:27.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/554: mkdir d18/d24/d28/d4a/d9d/dc8 0 2022-02-02T18:21:27.871 INFO:tasks.workunit.client.0.smithi096.stdout:1/479: getdents d15/d1b/d26 0 2022-02-02T18:21:27.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/557: dwrite d2/d5e/d6d/d79/f1d [4194304,4194304] 0 2022-02-02T18:21:27.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/558: write d2/d6/db/f4c [552793,46622] 0 2022-02-02T18:21:27.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/559: creat d2/fae x:0 0 0 2022-02-02T18:21:27.873 INFO:tasks.workunit.client.0.smithi096.stdout:3/506: unlink d2/df/d14/d11/f1f 0 2022-02-02T18:21:27.874 INFO:tasks.workunit.client.0.smithi096.stdout:3/507: write d2/df/d20/d33/d58/d7c/fab [960126,105131] 0 2022-02-02T18:21:27.874 INFO:tasks.workunit.client.0.smithi096.stdout:9/519: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/cc1 0 2022-02-02T18:21:27.874 INFO:tasks.workunit.client.0.smithi096.stdout:6/555: write d18/d24/d28/d3e/f62 [315565,67016] 0 2022-02-02T18:21:27.877 INFO:tasks.workunit.client.0.smithi096.stdout:6/556: write d18/d50/d8f/dbb/f3b [6446159,122422] 0 2022-02-02T18:21:27.877 INFO:tasks.workunit.client.0.smithi096.stdout:6/557: chown c11 293795 1 2022-02-02T18:21:27.878 INFO:tasks.workunit.client.0.smithi096.stdout:4/588: fsync d3/d60/fc9 0 2022-02-02T18:21:27.879 INFO:tasks.workunit.client.0.smithi096.stdout:7/478: dwrite d9/df/d47/fa2 [0,4194304] 0 2022-02-02T18:21:27.879 INFO:tasks.workunit.client.0.smithi096.stdout:7/479: truncate d9/df/d12/d39/d41/f4f 296314 0 2022-02-02T18:21:27.880 INFO:tasks.workunit.client.0.smithi096.stdout:3/508: write d2/df/d1c/d5d/d69/f55 [1079244,19867] 0 2022-02-02T18:21:27.882 INFO:tasks.workunit.client.0.smithi096.stdout:9/520: symlink d1/d39/d8a/d97/lc2 0 2022-02-02T18:21:27.883 INFO:tasks.workunit.client.0.smithi096.stdout:1/480: dread d15/d1b/d28/d2c/d39/d6b/d8a/fa6 [0,4194304] 0 2022-02-02T18:21:27.883 INFO:tasks.workunit.client.0.smithi096.stdout:8/383: dwrite d29/d2d/d42/f73 [0,4194304] 0 2022-02-02T18:21:27.886 INFO:tasks.workunit.client.0.smithi096.stdout:6/558: rename d18/d50/d8f/dbb/f6b to d18/d50/d8f/dc4/dbd/fc9 0 2022-02-02T18:21:27.889 INFO:tasks.workunit.client.0.smithi096.stdout:0/600: dwrite d2/d1e/d67/f9e [0,4194304] 0 2022-02-02T18:21:27.890 INFO:tasks.workunit.client.0.smithi096.stdout:3/509: write d2/df/d36/f68 [3585329,91316] 0 2022-02-02T18:21:27.890 INFO:tasks.workunit.client.0.smithi096.stdout:4/589: creat d3/d4/db9/fca x:0 0 0 2022-02-02T18:21:27.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/601: dread d2/db/d24/f9a [0,4194304] 0 2022-02-02T18:21:27.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/602: read d2/db/fc [4879457,50949] 0 2022-02-02T18:21:27.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/603: fsync d2/db/fc 0 2022-02-02T18:21:27.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/604: write d2/d1e/d67/f9e [1172962,30105] 0 2022-02-02T18:21:27.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/605: fsync d2/db/d10/d80/f9f 0 2022-02-02T18:21:27.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/606: unlink d2/db/d10/c52 0 2022-02-02T18:21:27.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/607: chown d2/db/d37/d40/d8a 484653 1 2022-02-02T18:21:27.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/608: unlink d2/db/d10/fab 0 2022-02-02T18:21:27.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/609: readlink d2/db/d37/d40/l6c 0 2022-02-02T18:21:27.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/610: write d2/db/d37/fcb [474470,71859] 0 2022-02-02T18:21:27.900 INFO:tasks.workunit.client.0.smithi096.stdout:9/521: creat d1/db/d1c/d2f/d78/d11/d1e/d66/fc3 x:0 0 0 2022-02-02T18:21:27.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/560: dwrite d2/d6/fa [0,4194304] 0 2022-02-02T18:21:27.901 INFO:tasks.workunit.client.0.smithi096.stdout:7/480: dwrite d9/df/d54/fa3 [0,4194304] 0 2022-02-02T18:21:27.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/481: mknod d15/d1b/d28/d2c/ca9 0 2022-02-02T18:21:27.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/384: creat d29/d58/d79/f7c x:0 0 0 2022-02-02T18:21:27.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/611: getdents d2/d1e/db9 0 2022-02-02T18:21:27.909 INFO:tasks.workunit.client.0.smithi096.stdout:9/522: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/lc4 0 2022-02-02T18:21:27.909 INFO:tasks.workunit.client.0.smithi096.stdout:9/523: truncate d1/db/d1c/f64 4284719 0 2022-02-02T18:21:27.909 INFO:tasks.workunit.client.0.smithi096.stdout:9/524: write d1/f34 [1101760,16542] 0 2022-02-02T18:21:27.910 INFO:tasks.workunit.client.0.smithi096.stdout:2/561: unlink d2/d19/f1c 0 2022-02-02T18:21:27.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/481: rename d9/df/d12/d14/c21 to d9/df/ca7 0 2022-02-02T18:21:27.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/590: dwrite d3/d85/fc7 [0,4194304] 0 2022-02-02T18:21:27.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/559: getdents d18/d50/d6d 0 2022-02-02T18:21:27.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/560: dread - d18/d50/d8f/dbb/d63/fc7 zero size 2022-02-02T18:21:27.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/561: creat d18/d24/fca x:0 0 0 2022-02-02T18:21:27.917 INFO:tasks.workunit.client.0.smithi096.stdout:6/562: dread d18/d50/d8f/fa4 [0,4194304] 0 2022-02-02T18:21:27.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/563: write d18/d50/d6d/d95/f97 [415197,85278] 0 2022-02-02T18:21:27.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/591: write d3/d4/d20/d26/d36/f56 [2052076,86996] 0 2022-02-02T18:21:27.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/592: write d3/d4/d20/d26/d36/f8a [783670,12556] 0 2022-02-02T18:21:27.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/510: rmdir d2/df/d14/d16 39 2022-02-02T18:21:27.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/511: write d2/df/d20/d33/d58/d7c/fa5 [488285,43205] 0 2022-02-02T18:21:27.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/512: readlink d2/df/d20/d33/d58/l9a 0 2022-02-02T18:21:27.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/612: dwrite d2/d1e/f35 [0,4194304] 0 2022-02-02T18:21:27.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/525: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fc5 x:0 0 0 2022-02-02T18:21:27.925 INFO:tasks.workunit.client.0.smithi096.stdout:2/562: creat d2/d5e/d6d/d79/d81/faf x:0 0 0 2022-02-02T18:21:27.929 INFO:tasks.workunit.client.0.smithi096.stdout:1/482: rename d15/d1b/d28/f61 to d15/d1b/d28/d2c/d4f/faa 0 2022-02-02T18:21:27.929 INFO:tasks.workunit.client.0.smithi096.stdout:7/482: mknod d9/df/d12/d39/d40/d6b/ca8 0 2022-02-02T18:21:27.937 INFO:tasks.workunit.client.0.smithi096.stdout:6/564: mknod d18/d50/d9a/ccb 0 2022-02-02T18:21:27.938 INFO:tasks.workunit.client.0.smithi096.stdout:1/483: dread d15/d1b/d26/d72/f90 [0,4194304] 0 2022-02-02T18:21:27.938 INFO:tasks.workunit.client.0.smithi096.stdout:1/484: write d15/d1b/d28/d2c/f5a [540022,74636] 0 2022-02-02T18:21:27.938 INFO:tasks.workunit.client.0.smithi096.stdout:4/593: mknod d3/d4/d20/d26/d36/d88/d98/ccb 0 2022-02-02T18:21:27.940 INFO:tasks.workunit.client.0.smithi096.stdout:3/513: creat d2/df/d1c/fb1 x:0 0 0 2022-02-02T18:21:27.941 INFO:tasks.workunit.client.0.smithi096.stdout:3/514: write d2/df/d20/d33/f3b [1964818,53345] 0 2022-02-02T18:21:27.945 INFO:tasks.workunit.client.0.smithi096.stdout:0/613: mknod d2/db/d24/d89/d8f/d95/dcd/dcf/cd1 0 2022-02-02T18:21:27.946 INFO:tasks.workunit.client.0.smithi096.stdout:5/512: sync 2022-02-02T18:21:27.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/526: mkdir d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6 0 2022-02-02T18:21:27.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/483: truncate d9/df/d47/d19/f1e 1210791 0 2022-02-02T18:21:27.951 INFO:tasks.workunit.client.0.smithi096.stdout:8/385: rename d29/l41 to d29/d58/d79/l7d 0 2022-02-02T18:21:27.958 INFO:tasks.workunit.client.0.smithi096.stdout:3/515: dwrite d2/d71/f90 [0,4194304] 0 2022-02-02T18:21:27.959 INFO:tasks.workunit.client.0.smithi096.stdout:6/565: unlink d18/d50/d8f/dbb/d63/f8d 0 2022-02-02T18:21:27.959 INFO:tasks.workunit.client.0.smithi096.stdout:1/485: creat d15/d1b/d26/d59/fab x:0 0 0 2022-02-02T18:21:27.961 INFO:tasks.workunit.client.0.smithi096.stdout:4/594: symlink d3/d4/lcc 0 2022-02-02T18:21:27.961 INFO:tasks.workunit.client.0.smithi096.stdout:4/595: chown d3/d27 3405530 1 2022-02-02T18:21:27.964 INFO:tasks.workunit.client.0.smithi096.stdout:5/513: truncate db/d5c/d60/da7/fae 340959 0 2022-02-02T18:21:27.964 INFO:tasks.workunit.client.0.smithi096.stdout:5/514: chown db/de/ca8 887 1 2022-02-02T18:21:27.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/484: rename d9/df/d12/d14/l3c to d9/df/d12/d39/d46/da4/la9 0 2022-02-02T18:21:27.966 INFO:tasks.workunit.client.0.smithi096.stdout:8/386: creat d29/d2d/f7e x:0 0 0 2022-02-02T18:21:27.970 INFO:tasks.workunit.client.0.smithi096.stdout:6/566: creat d18/d50/fcc x:0 0 0 2022-02-02T18:21:27.971 INFO:tasks.workunit.client.0.smithi096.stdout:1/486: unlink d15/d4d/c50 0 2022-02-02T18:21:27.971 INFO:tasks.workunit.client.0.smithi096.stdout:1/487: fdatasync d15/d1b/d28/f58 0 2022-02-02T18:21:27.972 INFO:tasks.workunit.client.0.smithi096.stdout:1/488: dread - d15/d1b/d28/d47/f86 zero size 2022-02-02T18:21:27.972 INFO:tasks.workunit.client.0.smithi096.stdout:1/489: write d15/d4d/f65 [495784,64914] 0 2022-02-02T18:21:27.973 INFO:tasks.workunit.client.0.smithi096.stdout:4/596: mknod d3/d4/d20/d26/d36/ccd 0 2022-02-02T18:21:27.973 INFO:tasks.workunit.client.0.smithi096.stdout:5/515: truncate db/de/d10/d25/d4c/f65 259825 0 2022-02-02T18:21:27.975 INFO:tasks.workunit.client.0.smithi096.stdout:9/527: dwrite d1/db/d1c/d2f/f55 [8388608,4194304] 0 2022-02-02T18:21:27.976 INFO:tasks.workunit.client.0.smithi096.stdout:9/528: creat d1/db/d1c/d2f/d78/d11/d3c/fc7 x:0 0 0 2022-02-02T18:21:27.977 INFO:tasks.workunit.client.0.smithi096.stdout:8/387: creat d29/d58/d7a/f7f x:0 0 0 2022-02-02T18:21:27.977 INFO:tasks.workunit.client.0.smithi096.stdout:1/490: mknod d15/d1b/d26/d6f/cac 0 2022-02-02T18:21:27.978 INFO:tasks.workunit.client.0.smithi096.stdout:6/567: truncate d18/f23 469558 0 2022-02-02T18:21:27.978 INFO:tasks.workunit.client.0.smithi096.stdout:3/516: dwrite d2/df/d14/f50 [0,4194304] 0 2022-02-02T18:21:27.979 INFO:tasks.workunit.client.0.smithi096.stdout:4/597: creat d3/d5a/db8/fce x:0 0 0 2022-02-02T18:21:27.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/516: rename db/d5c/d32/c88 to db/d5c/d2f/d46/d75/cb8 0 2022-02-02T18:21:27.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/517: write db/de/d10/d27/f4d [528306,92002] 0 2022-02-02T18:21:27.981 INFO:tasks.workunit.client.0.smithi096.stdout:8/388: dread f1f [0,4194304] 0 2022-02-02T18:21:27.982 INFO:tasks.workunit.client.0.smithi096.stdout:8/389: write f1f [3503265,69] 0 2022-02-02T18:21:27.983 INFO:tasks.workunit.client.0.smithi096.stdout:8/390: truncate d29/f3a 553806 0 2022-02-02T18:21:27.987 INFO:tasks.workunit.client.0.smithi096.stdout:6/568: mknod d18/d24/d73/d79/ccd 0 2022-02-02T18:21:27.989 INFO:tasks.workunit.client.0.smithi096.stdout:4/598: mkdir d3/d4/d20/d26/d36/d51/d57/dcf 0 2022-02-02T18:21:27.990 INFO:tasks.workunit.client.0.smithi096.stdout:7/485: dwrite d9/f3e [0,4194304] 0 2022-02-02T18:21:27.991 INFO:tasks.workunit.client.0.smithi096.stdout:1/491: rename d15/d1b/d28/d2c/d4f/d51/fa4 to d15/d1b/d26/d72/fad 0 2022-02-02T18:21:27.991 INFO:tasks.workunit.client.0.smithi096.stdout:1/492: chown f13 654426 1 2022-02-02T18:21:27.991 INFO:tasks.workunit.client.0.smithi096.stdout:7/486: dread d9/df/d54/f7a [0,4194304] 0 2022-02-02T18:21:27.992 INFO:tasks.workunit.client.0.smithi096.stdout:7/487: chown d9/df/d12/d39/d4e/d6e/f9c 174599144 1 2022-02-02T18:21:27.993 INFO:tasks.workunit.client.0.smithi096.stdout:5/518: symlink db/da1/lb9 0 2022-02-02T18:21:28.022 INFO:tasks.workunit.client.0.smithi096.stdout:6/569: symlink d18/d50/lce 0 2022-02-02T18:21:28.022 INFO:tasks.workunit.client.0.smithi096.stdout:3/517: dwrite d2/df/d14/d16/f8b [0,4194304] 0 2022-02-02T18:21:28.022 INFO:tasks.workunit.client.0.smithi096.stdout:3/518: dread - d2/df/d20/d4a/f62 zero size 2022-02-02T18:21:28.023 INFO:tasks.workunit.client.0.smithi096.stdout:8/391: dwrite d29/f3a [0,4194304] 0 2022-02-02T18:21:28.024 INFO:tasks.workunit.client.0.smithi096.stdout:6/570: write d18/f1a [3913443,64388] 0 2022-02-02T18:21:28.026 INFO:tasks.workunit.client.0.smithi096.stdout:1/493: mknod d15/d1b/d28/d2c/d39/d71/cae 0 2022-02-02T18:21:28.027 INFO:tasks.workunit.client.0.smithi096.stdout:1/494: write d15/d1b/d28/d2c/f5d [709374,39256] 0 2022-02-02T18:21:28.027 INFO:tasks.workunit.client.0.smithi096.stdout:7/488: mknod d9/df/d44/caa 0 2022-02-02T18:21:28.028 INFO:tasks.workunit.client.0.smithi096.stdout:4/599: dwrite d3/d4/d20/d26/d36/f44 [0,4194304] 0 2022-02-02T18:21:28.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/519: mknod db/d5c/d60/da7/cba 0 2022-02-02T18:21:28.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/520: stat db/d5c/d60 0 2022-02-02T18:21:28.030 INFO:tasks.workunit.client.0.smithi096.stdout:1/495: dread d15/d1b/d26/d6f/f82 [0,4194304] 0 2022-02-02T18:21:28.031 INFO:tasks.workunit.client.0.smithi096.stdout:1/496: fsync d15/d1b/d26/d72/f83 0 2022-02-02T18:21:28.033 INFO:tasks.workunit.client.0.smithi096.stdout:3/519: unlink d2/df/d14/d2c/d31/c44 0 2022-02-02T18:21:28.040 INFO:tasks.workunit.client.0.smithi096.stdout:6/571: creat d18/d50/d8f/dbb/d63/db3/fcf x:0 0 0 2022-02-02T18:21:28.047 INFO:tasks.workunit.client.0.smithi096.stdout:4/600: mkdir d3/d60/d8d/dc6/dd0 0 2022-02-02T18:21:28.048 INFO:tasks.workunit.client.0.smithi096.stdout:1/497: symlink d15/d1b/d26/d59/laf 0 2022-02-02T18:21:28.050 INFO:tasks.workunit.client.0.smithi096.stdout:6/572: symlink d18/d50/d8f/dbb/d63/ld0 0 2022-02-02T18:21:28.050 INFO:tasks.workunit.client.0.smithi096.stdout:6/573: chown d18/l67 759 1 2022-02-02T18:21:28.050 INFO:tasks.workunit.client.0.smithi096.stdout:6/574: chown d18/d24/d28/d4a/c57 126505 1 2022-02-02T18:21:28.050 INFO:tasks.workunit.client.0.smithi096.stdout:6/575: stat d18/d50/d8f/dc4/l94 0 2022-02-02T18:21:28.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/601: rename d3/d4/d20/d26/d36/d51/d57/c69 to d3/d4/d20/d26/d36/cd1 0 2022-02-02T18:21:28.052 INFO:tasks.workunit.client.0.smithi096.stdout:1/498: link c4 d15/d1b/cb0 0 2022-02-02T18:21:28.054 INFO:tasks.workunit.client.0.smithi096.stdout:2/563: sync 2022-02-02T18:21:28.055 INFO:tasks.workunit.client.0.smithi096.stdout:2/564: chown d2/d13/d43/d51/d73/da9 0 1 2022-02-02T18:21:28.056 INFO:tasks.workunit.client.0.smithi096.stdout:6/576: write d18/d24/d28/f87 [3628356,12623] 0 2022-02-02T18:21:28.056 INFO:tasks.workunit.client.0.smithi096.stdout:7/489: dwrite d9/df/d12/d39/d4e/d6e/f74 [0,4194304] 0 2022-02-02T18:21:28.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/521: dwrite db/f6c [0,4194304] 0 2022-02-02T18:21:28.057 INFO:tasks.workunit.client.0.smithi096.stdout:3/520: dwrite d2/df/d20/d4a/f62 [0,4194304] 0 2022-02-02T18:21:28.061 INFO:tasks.workunit.client.0.smithi096.stdout:5/522: mknod db/d5c/cbb 0 2022-02-02T18:21:28.063 INFO:tasks.workunit.client.0.smithi096.stdout:3/521: write d2/df/d36/f68 [1701891,52295] 0 2022-02-02T18:21:28.063 INFO:tasks.workunit.client.0.smithi096.stdout:7/490: rmdir d9/df/d16/d25 39 2022-02-02T18:21:28.064 INFO:tasks.workunit.client.0.smithi096.stdout:3/522: read d2/df/d14/d2c/d74/f7b [1327720,61161] 0 2022-02-02T18:21:28.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/523: mknod d2/cb2 0 2022-02-02T18:21:28.066 INFO:tasks.workunit.client.0.smithi096.stdout:6/577: read d18/d50/f61 [80528,38629] 0 2022-02-02T18:21:28.067 INFO:tasks.workunit.client.0.smithi096.stdout:3/524: creat d2/df/d34/fb3 x:0 0 0 2022-02-02T18:21:28.068 INFO:tasks.workunit.client.0.smithi096.stdout:3/525: dread - d2/df/d34/fb3 zero size 2022-02-02T18:21:28.068 INFO:tasks.workunit.client.0.smithi096.stdout:3/526: write d2/df/d1c/d5d/d69/d43/d72/f75 [790702,71006] 0 2022-02-02T18:21:28.068 INFO:tasks.workunit.client.0.smithi096.stdout:3/527: creat d2/df/da6/fb4 x:0 0 0 2022-02-02T18:21:28.069 INFO:tasks.workunit.client.0.smithi096.stdout:6/578: link d18/d50/c65 d18/cd1 0 2022-02-02T18:21:28.069 INFO:tasks.workunit.client.0.smithi096.stdout:6/579: dread - d18/d24/d28/fc0 zero size 2022-02-02T18:21:28.072 INFO:tasks.workunit.client.0.smithi096.stdout:6/580: dread d18/d24/d28/d3e/f62 [0,4194304] 0 2022-02-02T18:21:28.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/491: dread d9/df/d16/f2a [0,4194304] 0 2022-02-02T18:21:28.073 INFO:tasks.workunit.client.0.smithi096.stdout:6/581: truncate d18/d24/f2d 305396 0 2022-02-02T18:21:28.073 INFO:tasks.workunit.client.0.smithi096.stdout:6/582: readlink d18/d50/d6d/l84 0 2022-02-02T18:21:28.073 INFO:tasks.workunit.client.0.smithi096.stdout:6/583: write d18/d50/d8f/dbb/d63/db3/db5/fc5 [531457,41475] 0 2022-02-02T18:21:28.074 INFO:tasks.workunit.client.0.smithi096.stdout:6/584: write d18/f19 [1989664,77666] 0 2022-02-02T18:21:28.075 INFO:tasks.workunit.client.0.smithi096.stdout:6/585: symlink d18/d24/d28/ld2 0 2022-02-02T18:21:28.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/492: dread d9/df/d16/f2a [0,4194304] 0 2022-02-02T18:21:28.076 INFO:tasks.workunit.client.0.smithi096.stdout:5/523: dread db/de/f2a [0,4194304] 0 2022-02-02T18:21:28.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/493: symlink d9/df/d47/d60/da5/lab 0 2022-02-02T18:21:28.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/494: chown d9/df/d12/c1c 34113 1 2022-02-02T18:21:28.079 INFO:tasks.workunit.client.0.smithi096.stdout:7/495: truncate d9/df/d12/d39/d41/f6a 3085336 0 2022-02-02T18:21:28.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/524: write db/de/fa2 [1384256,118227] 0 2022-02-02T18:21:28.082 INFO:tasks.workunit.client.0.smithi096.stdout:4/602: dwrite d3/d60/d8d/da7/f6e [0,4194304] 0 2022-02-02T18:21:28.083 INFO:tasks.workunit.client.0.smithi096.stdout:7/496: mkdir d9/df/d12/d39/d41/dac 0 2022-02-02T18:21:28.083 INFO:tasks.workunit.client.0.smithi096.stdout:1/499: dwrite d15/d1b/d26/d6f/f82 [0,4194304] 0 2022-02-02T18:21:28.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/525: symlink db/de/d2e/d35/lbc 0 2022-02-02T18:21:28.086 INFO:tasks.workunit.client.0.smithi096.stdout:4/603: truncate d3/d4/d14/f58 87246 0 2022-02-02T18:21:28.088 INFO:tasks.workunit.client.0.smithi096.stdout:7/497: creat d9/df/d16/d25/fad x:0 0 0 2022-02-02T18:21:28.096 INFO:tasks.workunit.client.0.smithi096.stdout:1/500: rename d15/d1b/d28/d2c/d39/d6b/d8a/f8d to d15/d1b/d26/d59/fb1 0 2022-02-02T18:21:28.099 INFO:tasks.workunit.client.0.smithi096.stdout:5/526: mkdir db/dbd 0 2022-02-02T18:21:28.099 INFO:tasks.workunit.client.0.smithi096.stdout:5/527: creat db/d5c/d60/fbe x:0 0 0 2022-02-02T18:21:28.103 INFO:tasks.workunit.client.0.smithi096.stdout:4/604: symlink d3/d60/da8/ld2 0 2022-02-02T18:21:28.103 INFO:tasks.workunit.client.0.smithi096.stdout:7/498: creat d9/df/d16/d25/d98/fae x:0 0 0 2022-02-02T18:21:28.105 INFO:tasks.workunit.client.0.smithi096.stdout:5/528: symlink db/d5c/d2f/d46/d75/d9d/lbf 0 2022-02-02T18:21:28.105 INFO:tasks.workunit.client.0.smithi096.stdout:5/529: chown db/de/d10/d97 254831 1 2022-02-02T18:21:28.107 INFO:tasks.workunit.client.0.smithi096.stdout:4/605: mknod d3/d60/d8d/dc6/cd3 0 2022-02-02T18:21:28.108 INFO:tasks.workunit.client.0.smithi096.stdout:7/499: creat d9/faf x:0 0 0 2022-02-02T18:21:28.110 INFO:tasks.workunit.client.0.smithi096.stdout:5/530: unlink db/d5c/d2f/f6e 0 2022-02-02T18:21:28.111 INFO:tasks.workunit.client.0.smithi096.stdout:5/531: chown db/de/d10/f98 191 1 2022-02-02T18:21:28.111 INFO:tasks.workunit.client.0.smithi096.stdout:5/532: creat db/de/d10/d27/d83/fc0 x:0 0 0 2022-02-02T18:21:28.112 INFO:tasks.workunit.client.0.smithi096.stdout:7/500: mknod d9/df/d16/d25/d98/cb0 0 2022-02-02T18:21:28.113 INFO:tasks.workunit.client.0.smithi096.stdout:7/501: dread d9/df/d12/d39/d40/f6c [0,4194304] 0 2022-02-02T18:21:28.113 INFO:tasks.workunit.client.0.smithi096.stdout:7/502: readlink d9/df/d12/d39/d42/l7f 0 2022-02-02T18:21:28.114 INFO:tasks.workunit.client.0.smithi096.stdout:1/501: dwrite d15/f27 [0,4194304] 0 2022-02-02T18:21:28.114 INFO:tasks.workunit.client.0.smithi096.stdout:7/503: write d9/df/d16/f28 [6977516,119281] 0 2022-02-02T18:21:28.115 INFO:tasks.workunit.client.0.smithi096.stdout:5/533: rename db/d5c/f55 to db/d20/fc1 0 2022-02-02T18:21:28.115 INFO:tasks.workunit.client.0.smithi096.stdout:1/502: creat d15/d1b/d26/d72/da3/da7/fb2 x:0 0 0 2022-02-02T18:21:28.116 INFO:tasks.workunit.client.0.smithi096.stdout:7/504: mkdir d9/df/d47/d37/d83/db1 0 2022-02-02T18:21:28.117 INFO:tasks.workunit.client.0.smithi096.stdout:1/503: dread - d15/f22 zero size 2022-02-02T18:21:28.118 INFO:tasks.workunit.client.0.smithi096.stdout:7/505: symlink d9/df/d47/d60/da5/lb2 0 2022-02-02T18:21:28.124 INFO:tasks.workunit.client.0.smithi096.stdout:5/534: rmdir db/d5c 39 2022-02-02T18:21:28.128 INFO:tasks.workunit.client.0.smithi096.stdout:1/504: rename d15/d1b/d26/f8f to d15/d1b/d28/d2c/d39/d6b/d8a/fb3 0 2022-02-02T18:21:28.129 INFO:tasks.workunit.client.0.smithi096.stdout:1/505: mknod d15/d1b/d26/d72/cb4 0 2022-02-02T18:21:28.129 INFO:tasks.workunit.client.0.smithi096.stdout:1/506: dread - d15/d1b/d28/d2c/d39/d71/f9e zero size 2022-02-02T18:21:28.145 INFO:tasks.workunit.client.0.smithi096.stdout:0/614: sync 2022-02-02T18:21:28.146 INFO:tasks.workunit.client.0.smithi096.stdout:0/615: chown d2/d66/f98 484243 1 2022-02-02T18:21:28.147 INFO:tasks.workunit.client.0.smithi096.stdout:0/616: getdents d2/db/d24/d4d/d54 0 2022-02-02T18:21:28.150 INFO:tasks.workunit.client.0.smithi096.stdout:7/506: dwrite d9/df/d12/d39/d42/f5a [0,4194304] 0 2022-02-02T18:21:28.153 INFO:tasks.workunit.client.0.smithi096.stdout:5/535: dwrite db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:28.155 INFO:tasks.workunit.client.0.smithi096.stdout:1/507: dwrite d15/d1b/d28/d2c/f5a [0,4194304] 0 2022-02-02T18:21:28.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/536: mkdir db/d5c/d60/da3/dc2 0 2022-02-02T18:21:28.162 INFO:tasks.workunit.client.0.smithi096.stdout:1/508: rename c4 to d15/d1b/d28/cb5 0 2022-02-02T18:21:28.163 INFO:tasks.workunit.client.0.smithi096.stdout:1/509: dread - d15/d1b/d26/d72/f83 zero size 2022-02-02T18:21:28.163 INFO:tasks.workunit.client.0.smithi096.stdout:1/510: chown d15/d1b/d28/c2b 242 1 2022-02-02T18:21:28.164 INFO:tasks.workunit.client.0.smithi096.stdout:0/617: dread d2/db/d10/d27/f2d [0,4194304] 0 2022-02-02T18:21:28.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/537: creat db/de/d10/d25/fc3 x:0 0 0 2022-02-02T18:21:28.164 INFO:tasks.workunit.client.0.smithi096.stdout:1/511: mkdir d15/d1b/d26/d72/da3/da7/db6 0 2022-02-02T18:21:28.165 INFO:tasks.workunit.client.0.smithi096.stdout:1/512: fdatasync d15/d1b/d28/f3e 0 2022-02-02T18:21:28.165 INFO:tasks.workunit.client.0.smithi096.stdout:0/618: rename d2/db/d24/fbb to d2/db/d7f/fd2 0 2022-02-02T18:21:28.168 INFO:tasks.workunit.client.0.smithi096.stdout:5/538: rename f3 to db/de/d10/d25/da0/fc4 0 2022-02-02T18:21:28.168 INFO:tasks.workunit.client.0.smithi096.stdout:5/539: fdatasync db/de/d10/d27/d83/fac 0 2022-02-02T18:21:28.169 INFO:tasks.workunit.client.0.smithi096.stdout:7/507: dwrite d9/df/d16/d25/d98/fae [0,4194304] 0 2022-02-02T18:21:28.169 INFO:tasks.workunit.client.0.smithi096.stdout:7/508: stat d9/df/d12/d39/l94 0 2022-02-02T18:21:28.170 INFO:tasks.workunit.client.0.smithi096.stdout:7/509: fdatasync d9/df/d47/d60/f73 0 2022-02-02T18:21:28.170 INFO:tasks.workunit.client.0.smithi096.stdout:0/619: symlink d2/db/d10/d27/ld3 0 2022-02-02T18:21:28.171 INFO:tasks.workunit.client.0.smithi096.stdout:5/540: symlink db/d5c/d60/lc5 0 2022-02-02T18:21:28.173 INFO:tasks.workunit.client.0.smithi096.stdout:0/620: creat d2/db/d24/d89/fd4 x:0 0 0 2022-02-02T18:21:28.178 INFO:tasks.workunit.client.0.smithi096.stdout:7/510: dread d9/df/d12/d39/d4e/d6e/f74 [0,4194304] 0 2022-02-02T18:21:28.178 INFO:tasks.workunit.client.0.smithi096.stdout:7/511: truncate d9/df/d12/d39/d46/d7d/f91 870710 0 2022-02-02T18:21:28.189 INFO:tasks.workunit.client.0.smithi096.stdout:1/513: dwrite d15/d1b/d28/d2c/d39/d6b/d8a/f9c [0,4194304] 0 2022-02-02T18:21:28.190 INFO:tasks.workunit.client.0.smithi096.stdout:1/514: dread - d15/d1b/d26/d6f/f94 zero size 2022-02-02T18:21:28.190 INFO:tasks.workunit.client.0.smithi096.stdout:5/541: dwrite db/d20/fab [0,4194304] 0 2022-02-02T18:21:28.192 INFO:tasks.workunit.client.0.smithi096.stdout:1/515: mknod d15/d1b/cb7 0 2022-02-02T18:21:28.194 INFO:tasks.workunit.client.0.smithi096.stdout:5/542: creat db/d5c/d60/da7/fc6 x:0 0 0 2022-02-02T18:21:28.195 INFO:tasks.workunit.client.0.smithi096.stdout:1/516: symlink d15/d4d/lb8 0 2022-02-02T18:21:28.195 INFO:tasks.workunit.client.0.smithi096.stdout:5/543: creat db/d5c/d2f/fc7 x:0 0 0 2022-02-02T18:21:28.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/517: mkdir d15/d1b/d28/d2c/d39/d6b/d8a/db9 0 2022-02-02T18:21:28.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/518: dread - d15/d1b/d26/d72/da3/da7/f99 zero size 2022-02-02T18:21:28.197 INFO:tasks.workunit.client.0.smithi096.stdout:5/544: symlink db/d5c/d2f/d46/d75/lc8 0 2022-02-02T18:21:28.203 INFO:tasks.workunit.client.0.smithi096.stdout:1/519: write d15/d1b/d26/f49 [1960514,75841] 0 2022-02-02T18:21:28.206 INFO:tasks.workunit.client.0.smithi096.stdout:0/621: dwrite d2/db/d37/d40/d8a/f94 [0,4194304] 0 2022-02-02T18:21:28.207 INFO:tasks.workunit.client.0.smithi096.stdout:7/512: dwrite d9/df/d16/d25/d98/fae [0,4194304] 0 2022-02-02T18:21:28.213 INFO:tasks.workunit.client.0.smithi096.stdout:5/545: dread db/de/d10/d80/f99 [0,4194304] 0 2022-02-02T18:21:28.218 INFO:tasks.workunit.client.0.smithi096.stdout:8/392: sync 2022-02-02T18:21:28.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/529: sync 2022-02-02T18:21:28.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/530: write d1/db/d1c/d2f/d78/f18 [4956153,54580] 0 2022-02-02T18:21:28.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/531: chown d1/db/d1c/d2f/d78/c81 22 1 2022-02-02T18:21:28.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/532: dread - d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fb7 zero size 2022-02-02T18:21:28.220 INFO:tasks.workunit.client.0.smithi096.stdout:7/513: stat d9/df/d12/d39/d46/c5c 0 2022-02-02T18:21:28.220 INFO:tasks.workunit.client.0.smithi096.stdout:7/514: chown d9/df/d47/d19/f2f 10522972 1 2022-02-02T18:21:28.220 INFO:tasks.workunit.client.0.smithi096.stdout:7/515: rename d9/df/d47/d60/da5 to d9/df/d47/d60/da5/db3 22 2022-02-02T18:21:28.221 INFO:tasks.workunit.client.0.smithi096.stdout:0/622: getdents d2/db/d24/d4d/d53/d58 0 2022-02-02T18:21:28.222 INFO:tasks.workunit.client.0.smithi096.stdout:0/623: readlink d2/db/d37/d40/d8a/lad 0 2022-02-02T18:21:28.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/533: write d1/db/d48/d69/f7c [3357779,57467] 0 2022-02-02T18:21:28.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/534: fdatasync d1/db/d48/f8d 0 2022-02-02T18:21:28.223 INFO:tasks.workunit.client.0.smithi096.stdout:5/546: link db/de/d10/d27/d83/fac db/d5c/d32/fc9 0 2022-02-02T18:21:28.223 INFO:tasks.workunit.client.0.smithi096.stdout:5/547: chown db/d5c/l89 9 1 2022-02-02T18:21:28.223 INFO:tasks.workunit.client.0.smithi096.stdout:7/516: readlink d9/df/d12/l67 0 2022-02-02T18:21:28.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/517: mkdir d9/df/d47/d37/d83/db4 0 2022-02-02T18:21:28.225 INFO:tasks.workunit.client.0.smithi096.stdout:7/518: dread - d9/df/d16/d25/fad zero size 2022-02-02T18:21:28.226 INFO:tasks.workunit.client.0.smithi096.stdout:0/624: truncate d2/fa 1108112 0 2022-02-02T18:21:28.227 INFO:tasks.workunit.client.0.smithi096.stdout:7/519: mknod d9/df/d12/d39/d41/dac/cb5 0 2022-02-02T18:21:28.228 INFO:tasks.workunit.client.0.smithi096.stdout:7/520: mknod d9/df/d93/cb6 0 2022-02-02T18:21:28.230 INFO:tasks.workunit.client.0.smithi096.stdout:7/521: stat d9/l79 0 2022-02-02T18:21:28.230 INFO:tasks.workunit.client.0.smithi096.stdout:5/548: dread db/d5c/d2f/d46/f74 [0,4194304] 0 2022-02-02T18:21:28.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/522: mkdir d9/df/d47/db7 0 2022-02-02T18:21:28.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/523: fdatasync d9/df/d12/f6d 0 2022-02-02T18:21:28.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/524: chown d9/f8d 3904 1 2022-02-02T18:21:28.233 INFO:tasks.workunit.client.0.smithi096.stdout:5/549: getdents db/d5c/d2f 0 2022-02-02T18:21:28.234 INFO:tasks.workunit.client.0.smithi096.stdout:7/525: write d9/df/d54/fa3 [1102033,96878] 0 2022-02-02T18:21:28.236 INFO:tasks.workunit.client.0.smithi096.stdout:5/550: mknod db/de/d10/d25/d4c/cca 0 2022-02-02T18:21:28.236 INFO:tasks.workunit.client.0.smithi096.stdout:5/551: chown db/d5c/d2f/c3b 23 1 2022-02-02T18:21:28.237 INFO:tasks.workunit.client.0.smithi096.stdout:7/526: mkdir d9/df/d54/db8 0 2022-02-02T18:21:28.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/552: rmdir db/d5c/d2f/d46/d75 39 2022-02-02T18:21:28.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/527: symlink d9/df/d47/db7/lb9 0 2022-02-02T18:21:28.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/528: creat d9/df/d16/d25/d98/fba x:0 0 0 2022-02-02T18:21:28.239 INFO:tasks.workunit.client.0.smithi096.stdout:7/529: creat d9/df/d16/d25/d98/fbb x:0 0 0 2022-02-02T18:21:28.239 INFO:tasks.workunit.client.0.smithi096.stdout:5/553: mknod db/ccb 0 2022-02-02T18:21:28.241 INFO:tasks.workunit.client.0.smithi096.stdout:5/554: mkdir db/da1/dcc 0 2022-02-02T18:21:28.246 INFO:tasks.workunit.client.0.smithi096.stdout:8/393: dwrite d29/d4e/f72 [0,4194304] 0 2022-02-02T18:21:28.247 INFO:tasks.workunit.client.0.smithi096.stdout:8/394: chown d29/d40/l54 50500 1 2022-02-02T18:21:28.248 INFO:tasks.workunit.client.0.smithi096.stdout:8/395: write d29/f2b [1516811,92507] 0 2022-02-02T18:21:28.248 INFO:tasks.workunit.client.0.smithi096.stdout:8/396: stat d29/d40/c66 0 2022-02-02T18:21:28.248 INFO:tasks.workunit.client.0.smithi096.stdout:0/625: dwrite d2/db/d37/f3e [0,4194304] 0 2022-02-02T18:21:28.249 INFO:tasks.workunit.client.0.smithi096.stdout:0/626: write d2/db/d10/d27/f73 [462950,75994] 0 2022-02-02T18:21:28.250 INFO:tasks.workunit.client.0.smithi096.stdout:0/627: unlink d2/db/l6e 0 2022-02-02T18:21:28.250 INFO:tasks.workunit.client.0.smithi096.stdout:8/397: fsync d29/f2b 0 2022-02-02T18:21:28.258 INFO:tasks.workunit.client.0.smithi096.stdout:8/398: rename d29/d2d/c5d to d29/d2d/d42/c80 0 2022-02-02T18:21:28.259 INFO:tasks.workunit.client.0.smithi096.stdout:0/628: truncate d2/db/d10/f39 160834 0 2022-02-02T18:21:28.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/399: write d29/f3a [5203420,57353] 0 2022-02-02T18:21:28.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/400: chown d29/d2d 0 1 2022-02-02T18:21:28.260 INFO:tasks.workunit.client.0.smithi096.stdout:8/401: mkdir d29/d4a/d5b/d81 0 2022-02-02T18:21:28.274 INFO:tasks.workunit.client.0.smithi096.stdout:8/402: dread d29/f34 [0,4194304] 0 2022-02-02T18:21:28.275 INFO:tasks.workunit.client.0.smithi096.stdout:7/530: dwrite d9/df/d54/f7a [0,4194304] 0 2022-02-02T18:21:28.275 INFO:tasks.workunit.client.0.smithi096.stdout:8/403: mknod d29/d4a/d5b/d81/c82 0 2022-02-02T18:21:28.276 INFO:tasks.workunit.client.0.smithi096.stdout:8/404: readlink d29/d2d/l3b 0 2022-02-02T18:21:28.276 INFO:tasks.workunit.client.0.smithi096.stdout:2/565: sync 2022-02-02T18:21:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:27 smithi159 conmon[35668]: cluster 2022-02-02T18:21:26.825751+0000 mgr.smithi096.shfutl (mgr.14162) 268 : cluster 2022-02-02T18:21:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:27 smithi159 conmon[35668]: [DBG] pgmap v217: 65 pgs: 65 active+clean; 927 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 102 MiB/s wr, 744 op/s 2022-02-02T18:21:28.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/555: dwrite db/d5c/d60/f8c [0,4194304] 0 2022-02-02T18:21:28.278 INFO:tasks.workunit.client.0.smithi096.stdout:8/405: rmdir d29/d4a/d5b 39 2022-02-02T18:21:28.284 INFO:tasks.workunit.client.0.smithi096.stdout:5/556: rename db/de/d10/d80/f9e to db/d5c/d2f/d46/d75/fcd 0 2022-02-02T18:21:28.286 INFO:tasks.workunit.client.0.smithi096.stdout:7/531: dread d9/df/d54/f99 [0,4194304] 0 2022-02-02T18:21:28.288 INFO:tasks.workunit.client.0.smithi096.stdout:2/566: rmdir d2/d5e/d6d/d79 39 2022-02-02T18:21:28.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/557: rmdir db/de/d10/d25/da0/d85 39 2022-02-02T18:21:28.290 INFO:tasks.workunit.client.0.smithi096.stdout:7/532: symlink d9/df/d16/lbc 0 2022-02-02T18:21:28.291 INFO:tasks.workunit.client.0.smithi096.stdout:3/528: sync 2022-02-02T18:21:28.291 INFO:tasks.workunit.client.0.smithi096.stdout:4/606: sync 2022-02-02T18:21:28.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/586: sync 2022-02-02T18:21:28.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/520: sync 2022-02-02T18:21:28.292 INFO:tasks.workunit.client.0.smithi096.stdout:2/567: mkdir d2/d13/d42/d71/dad/db0 0 2022-02-02T18:21:28.292 INFO:tasks.workunit.client.0.smithi096.stdout:2/568: dread - d2/d6/f93 zero size 2022-02-02T18:21:28.293 INFO:tasks.workunit.client.0.smithi096.stdout:8/406: dwrite f22 [0,4194304] 0 2022-02-02T18:21:28.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/607: dread d3/d4/d20/d26/d36/d88/d98/fae [0,4194304] 0 2022-02-02T18:21:28.294 INFO:tasks.workunit.client.0.smithi096.stdout:7/533: symlink d9/df/d47/d19/lbd 0 2022-02-02T18:21:28.294 INFO:tasks.workunit.client.0.smithi096.stdout:7/534: stat d9/df/c23 0 2022-02-02T18:21:28.295 INFO:tasks.workunit.client.0.smithi096.stdout:3/529: truncate d2/df/d20/d4a/f62 1102120 0 2022-02-02T18:21:28.296 INFO:tasks.workunit.client.0.smithi096.stdout:1/521: mknod d15/d4d/d8e/cba 0 2022-02-02T18:21:28.297 INFO:tasks.workunit.client.0.smithi096.stdout:2/569: symlink d2/d19/lb1 0 2022-02-02T18:21:28.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/407: mkdir d29/d40/d6d/d83 0 2022-02-02T18:21:28.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/408: dread - d29/d4e/f6c zero size 2022-02-02T18:21:28.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/558: getdents db/de/d10 0 2022-02-02T18:21:28.304 INFO:tasks.workunit.client.0.smithi096.stdout:4/608: mknod d3/cd4 0 2022-02-02T18:21:28.306 INFO:tasks.workunit.client.0.smithi096.stdout:7/535: rename d9/df/d12/d14/l1f to d9/df/d47/lbe 0 2022-02-02T18:21:28.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/536: chown d9/df/d12/d39/d40/c9b 1 1 2022-02-02T18:21:28.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/537: creat d9/df/d16/fbf x:0 0 0 2022-02-02T18:21:28.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/538: readlink d9/df/d47/d19/lbd 0 2022-02-02T18:21:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:27 smithi096 conmon[32067]: cluster 2022-02-02T18:21:26.825751+0000 mgr.smithi096.shfutl (mgr.14162) 268 : cluster [DBG] 2022-02-02T18:21:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:27 smithi096 conmon[32067]: pgmap v217: 65 pgs: 65 active+clean; 927 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 102 MiB/s wr, 744 op/s 2022-02-02T18:21:28.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/570: mkdir d2/d5e/d6d/db2 0 2022-02-02T18:21:28.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/571: fdatasync d2/d5e/d7c/f83 0 2022-02-02T18:21:28.310 INFO:tasks.workunit.client.0.smithi096.stdout:2/572: write f1 [31849,25189] 0 2022-02-02T18:21:28.310 INFO:tasks.workunit.client.0.smithi096.stdout:5/559: creat db/d5c/d2f/d46/d75/d9d/fce x:0 0 0 2022-02-02T18:21:28.312 INFO:tasks.workunit.client.0.smithi096.stdout:3/530: mkdir d2/df/d1c/db5 0 2022-02-02T18:21:28.312 INFO:tasks.workunit.client.0.smithi096.stdout:3/531: readlink d2/l85 0 2022-02-02T18:21:28.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/539: write d9/df/d54/fa3 [2712668,54686] 0 2022-02-02T18:21:28.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/540: fdatasync d9/df/d12/d39/d40/d51/f59 0 2022-02-02T18:21:28.313 INFO:tasks.workunit.client.0.smithi096.stdout:2/573: mkdir d2/d19/d86/db3 0 2022-02-02T18:21:28.314 INFO:tasks.workunit.client.0.smithi096.stdout:3/532: truncate d2/df/d14/d2c/d31/f47 2997174 0 2022-02-02T18:21:28.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/587: dwrite d18/d24/d28/f87 [0,4194304] 0 2022-02-02T18:21:28.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/588: write d18/f27 [4181585,18672] 0 2022-02-02T18:21:28.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/589: fdatasync d18/d24/d28/fc0 0 2022-02-02T18:21:28.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/590: creat d18/d24/d73/d79/fd3 x:0 0 0 2022-02-02T18:21:28.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/591: getdents d18/d24/d28/d4a/db8 0 2022-02-02T18:21:28.321 INFO:tasks.workunit.client.0.smithi096.stdout:6/592: creat d18/d50/d6d/d95/fd4 x:0 0 0 2022-02-02T18:21:28.325 INFO:tasks.workunit.client.0.smithi096.stdout:8/409: dread d29/d2d/f45 [0,4194304] 0 2022-02-02T18:21:28.326 INFO:tasks.workunit.client.0.smithi096.stdout:2/574: dread d2/d6/d1b/f89 [0,4194304] 0 2022-02-02T18:21:28.327 INFO:tasks.workunit.client.0.smithi096.stdout:8/410: rmdir d29/d4a/d5b/d81 39 2022-02-02T18:21:28.327 INFO:tasks.workunit.client.0.smithi096.stdout:8/411: fsync d29/d2d/f48 0 2022-02-02T18:21:28.328 INFO:tasks.workunit.client.0.smithi096.stdout:8/412: truncate f23 4845104 0 2022-02-02T18:21:28.330 INFO:tasks.workunit.client.0.smithi096.stdout:8/413: rename d29/d2d/f45 to d29/f84 0 2022-02-02T18:21:28.331 INFO:tasks.workunit.client.0.smithi096.stdout:1/522: dwrite d15/d1b/d26/f42 [0,4194304] 0 2022-02-02T18:21:28.331 INFO:tasks.workunit.client.0.smithi096.stdout:1/523: fdatasync d15/d1b/d28/d2c/f4c 0 2022-02-02T18:21:28.333 INFO:tasks.workunit.client.0.smithi096.stdout:2/575: write d2/d6/db/f8f [1678528,43841] 0 2022-02-02T18:21:28.336 INFO:tasks.workunit.client.0.smithi096.stdout:1/524: write d15/d1b/d28/d2c/d4f/f89 [617758,100503] 0 2022-02-02T18:21:28.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/414: write f21 [1372700,83529] 0 2022-02-02T18:21:28.337 INFO:tasks.workunit.client.0.smithi096.stdout:2/576: rename d2/d19/l23 to d2/d5e/d6d/lb4 0 2022-02-02T18:21:28.339 INFO:tasks.workunit.client.0.smithi096.stdout:1/525: truncate d15/d1b/d26/d59/f80 2192383 0 2022-02-02T18:21:28.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/577: unlink d2/d5e/d6d/f7d 0 2022-02-02T18:21:28.343 INFO:tasks.workunit.client.0.smithi096.stdout:1/526: rename d15/d1b/d28/d2c/d4f/faa to d15/d4d/d8e/fbb 0 2022-02-02T18:21:28.343 INFO:tasks.workunit.client.0.smithi096.stdout:1/527: chown d15/d1b/d28/f44 10 1 2022-02-02T18:21:28.350 INFO:tasks.workunit.client.0.smithi096.stdout:4/609: dwrite d3/d4/d14/f2d [0,4194304] 0 2022-02-02T18:21:28.353 INFO:tasks.workunit.client.0.smithi096.stdout:1/528: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:28.358 INFO:tasks.workunit.client.0.smithi096.stdout:1/529: link d15/d1b/c21 d15/d1b/d26/d6f/d9f/cbc 0 2022-02-02T18:21:28.359 INFO:tasks.workunit.client.0.smithi096.stdout:1/530: mkdir d15/d1b/d26/d72/dbd 0 2022-02-02T18:21:28.360 INFO:tasks.workunit.client.0.smithi096.stdout:1/531: symlink d15/d4d/d8e/lbe 0 2022-02-02T18:21:28.360 INFO:tasks.workunit.client.0.smithi096.stdout:1/532: creat d15/d1b/fbf x:0 0 0 2022-02-02T18:21:28.362 INFO:tasks.workunit.client.0.smithi096.stdout:1/533: rename d15/d1b/d28/d47/c76 to d15/d1b/d26/d72/da3/cc0 0 2022-02-02T18:21:28.363 INFO:tasks.workunit.client.0.smithi096.stdout:1/534: chown d15/d1b/d28/f44 1977322 1 2022-02-02T18:21:28.365 INFO:tasks.workunit.client.0.smithi096.stdout:1/535: symlink d15/d1b/d26/d72/da3/da7/db6/lc1 0 2022-02-02T18:21:28.366 INFO:tasks.workunit.client.0.smithi096.stdout:9/535: sync 2022-02-02T18:21:28.367 INFO:tasks.workunit.client.0.smithi096.stdout:9/536: fdatasync d1/db/d1c/d2f/d78/d11/d1e/f65 0 2022-02-02T18:21:28.367 INFO:tasks.workunit.client.0.smithi096.stdout:9/537: fdatasync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/f94 0 2022-02-02T18:21:28.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/536: mkdir d15/d1b/d28/d2c/d39/d6b/dc2 0 2022-02-02T18:21:28.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/537: chown d15/d1b/d28/d2c/c3c 8 1 2022-02-02T18:21:28.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/538: stat d15/d1b/d26/d72/dbd 0 2022-02-02T18:21:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:1/539: creat d15/d1b/d28/d2c/d4f/d51/fc3 x:0 0 0 2022-02-02T18:21:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:1/540: fdatasync d15/d1b/f8c 0 2022-02-02T18:21:28.370 INFO:tasks.workunit.client.0.smithi096.stdout:9/538: unlink d1/d39/f60 0 2022-02-02T18:21:28.371 INFO:tasks.workunit.client.0.smithi096.stdout:3/533: dwrite d2/d71/f83 [0,4194304] 0 2022-02-02T18:21:28.371 INFO:tasks.workunit.client.0.smithi096.stdout:6/593: dwrite d18/d24/d73/f92 [0,4194304] 0 2022-02-02T18:21:28.371 INFO:tasks.workunit.client.0.smithi096.stdout:6/594: chown d18/d24/d28/fc0 2011012924 1 2022-02-02T18:21:28.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/560: dwrite db/d20/f29 [0,4194304] 0 2022-02-02T18:21:28.372 INFO:tasks.workunit.client.0.smithi096.stdout:8/415: dwrite f19 [4194304,4194304] 0 2022-02-02T18:21:28.372 INFO:tasks.workunit.client.0.smithi096.stdout:9/539: write d1/db/d1c/d2f/d78/d11/d1e/f53 [4980554,115217] 0 2022-02-02T18:21:28.372 INFO:tasks.workunit.client.0.smithi096.stdout:4/610: dwrite d3/d4/d20/d26/d36/d88/f99 [0,4194304] 0 2022-02-02T18:21:28.372 INFO:tasks.workunit.client.0.smithi096.stdout:4/611: stat d3/d4/d20/d26/d36/d51/l84 0 2022-02-02T18:21:28.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/541: rename d15/d4d/f96 to d15/d1b/d28/d2c/d4f/d51/fc4 0 2022-02-02T18:21:28.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/542: chown d15/d4d/lb8 6007615 1 2022-02-02T18:21:28.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/543: chown d15/d1b/d26/c30 494411218 1 2022-02-02T18:21:28.375 INFO:tasks.workunit.client.0.smithi096.stdout:3/534: symlink d2/df/d14/d11/lb6 0 2022-02-02T18:21:28.375 INFO:tasks.workunit.client.0.smithi096.stdout:3/535: chown d2/df/d36/f7f 32875 1 2022-02-02T18:21:28.381 INFO:tasks.workunit.client.0.smithi096.stdout:4/612: dread d3/d27/f30 [0,4194304] 0 2022-02-02T18:21:28.382 INFO:tasks.workunit.client.0.smithi096.stdout:5/561: mknod db/d5c/d2f/ccf 0 2022-02-02T18:21:28.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/416: mkdir d29/d40/d6d/d85 0 2022-02-02T18:21:28.385 INFO:tasks.workunit.client.0.smithi096.stdout:5/562: dread db/de/d10/d25/da0/fc4 [0,4194304] 0 2022-02-02T18:21:28.386 INFO:tasks.workunit.client.0.smithi096.stdout:9/540: mkdir d1/db/d1c/d2f/dc8 0 2022-02-02T18:21:28.395 INFO:tasks.workunit.client.0.smithi096.stdout:3/536: dwrite d2/df/d14/f30 [0,4194304] 0 2022-02-02T18:21:28.396 INFO:tasks.workunit.client.0.smithi096.stdout:1/544: mknod d15/d1b/d28/cc5 0 2022-02-02T18:21:28.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/613: mkdir d3/d4/d20/d26/d36/d51/dd5 0 2022-02-02T18:21:28.399 INFO:tasks.workunit.client.0.smithi096.stdout:8/417: rename f21 to d29/d40/d6d/d85/f86 0 2022-02-02T18:21:28.399 INFO:tasks.workunit.client.0.smithi096.stdout:8/418: write d29/d2d/f3f [1343968,89416] 0 2022-02-02T18:21:28.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/419: write d29/d2d/d47/f6e [39382,101154] 0 2022-02-02T18:21:28.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/537: dread d2/df/d14/d2c/d31/f40 [0,4194304] 0 2022-02-02T18:21:28.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/541: link d1/f6 d1/db/d1c/d2f/dac/fc9 0 2022-02-02T18:21:28.402 INFO:tasks.workunit.client.0.smithi096.stdout:1/545: creat d15/d1b/d28/fc6 x:0 0 0 2022-02-02T18:21:28.404 INFO:tasks.workunit.client.0.smithi096.stdout:8/420: mkdir d29/d2d/d87 0 2022-02-02T18:21:28.404 INFO:tasks.workunit.client.0.smithi096.stdout:0/629: sync 2022-02-02T18:21:28.404 INFO:tasks.workunit.client.0.smithi096.stdout:5/563: dwrite db/d20/f29 [0,4194304] 0 2022-02-02T18:21:28.406 INFO:tasks.workunit.client.0.smithi096.stdout:3/538: creat d2/df/d14/d11/fb7 x:0 0 0 2022-02-02T18:21:28.407 INFO:tasks.workunit.client.0.smithi096.stdout:3/539: chown d2/df/d1c/d5d 758542 1 2022-02-02T18:21:28.407 INFO:tasks.workunit.client.0.smithi096.stdout:3/540: readlink d2/df/d20/d33/l6a 0 2022-02-02T18:21:28.407 INFO:tasks.workunit.client.0.smithi096.stdout:3/541: chown d2/df/d36/f68 606 1 2022-02-02T18:21:28.408 INFO:tasks.workunit.client.0.smithi096.stdout:9/542: mkdir d1/db/d1c/d2f/d78/d11/dca 0 2022-02-02T18:21:28.409 INFO:tasks.workunit.client.0.smithi096.stdout:4/614: dread f1 [0,4194304] 0 2022-02-02T18:21:28.409 INFO:tasks.workunit.client.0.smithi096.stdout:9/543: dread d1/db/d48/f8d [0,4194304] 0 2022-02-02T18:21:28.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/546: rmdir d15/d1b/d26/d72/dbd 0 2022-02-02T18:21:28.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/547: write d15/d1b/d26/d59/fab [1043660,89254] 0 2022-02-02T18:21:28.412 INFO:tasks.workunit.client.0.smithi096.stdout:1/548: read d15/f2e [2879364,107678] 0 2022-02-02T18:21:28.414 INFO:tasks.workunit.client.0.smithi096.stdout:8/421: mknod d29/d4e/c88 0 2022-02-02T18:21:28.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/422: read f5 [3643829,93005] 0 2022-02-02T18:21:28.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/423: write d29/d4e/f72 [909468,104176] 0 2022-02-02T18:21:28.418 INFO:tasks.workunit.client.0.smithi096.stdout:5/564: truncate db/de/fa2 305392 0 2022-02-02T18:21:28.420 INFO:tasks.workunit.client.0.smithi096.stdout:3/542: creat d2/df/d20/d33/fb8 x:0 0 0 2022-02-02T18:21:28.420 INFO:tasks.workunit.client.0.smithi096.stdout:3/543: readlink d2/df/d20/d33/l6a 0 2022-02-02T18:21:28.428 INFO:tasks.workunit.client.0.smithi096.stdout:0/630: dwrite d2/db/d37/d40/d8a/fbf [0,4194304] 0 2022-02-02T18:21:28.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/565: write db/d5c/d60/f8c [3741588,50460] 0 2022-02-02T18:21:28.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/566: chown db/de/d10/f98 466402206 1 2022-02-02T18:21:28.430 INFO:tasks.workunit.client.0.smithi096.stdout:5/567: write db/d20/fc1 [4910843,111431] 0 2022-02-02T18:21:28.433 INFO:tasks.workunit.client.0.smithi096.stdout:0/631: rename d2/db/f84 to d2/db/d10/fd5 0 2022-02-02T18:21:28.441 INFO:tasks.workunit.client.0.smithi096.stdout:5/568: dread db/de/d10/f18 [0,4194304] 0 2022-02-02T18:21:28.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/569: dread db/f6c [0,4194304] 0 2022-02-02T18:21:28.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/570: creat db/de/d10/d80/fd0 x:0 0 0 2022-02-02T18:21:28.453 INFO:tasks.workunit.client.0.smithi096.stdout:5/571: chown db/d5c/d2f/c3b 250 1 2022-02-02T18:21:28.456 INFO:tasks.workunit.client.0.smithi096.stdout:5/572: rename db/de/d10/d25/d4c/fb3 to db/de/d10/d25/da0/fd1 0 2022-02-02T18:21:28.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/541: sync 2022-02-02T18:21:28.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/542: truncate d9/df/d12/d39/d4e/f8c 674856 0 2022-02-02T18:21:28.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/549: dwrite d15/d1b/d26/d72/f83 [0,4194304] 0 2022-02-02T18:21:28.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/550: creat d15/d4d/fc7 x:0 0 0 2022-02-02T18:21:28.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/551: fdatasync d15/d1b/d28/f3e 0 2022-02-02T18:21:28.459 INFO:tasks.workunit.client.0.smithi096.stdout:5/573: unlink db/de/d10/d25/da0/fc4 0 2022-02-02T18:21:28.460 INFO:tasks.workunit.client.0.smithi096.stdout:3/544: dwrite d2/df/d14/d66/f96 [0,4194304] 0 2022-02-02T18:21:28.460 INFO:tasks.workunit.client.0.smithi096.stdout:9/544: dwrite d1/db/d1c/d2f/dac/fc9 [0,4194304] 0 2022-02-02T18:21:28.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/574: write db/d5c/d2f/d46/f74 [2784414,107075] 0 2022-02-02T18:21:28.460 INFO:tasks.workunit.client.0.smithi096.stdout:9/545: write d1/db/d1c/d2f/f3b [338984,68948] 0 2022-02-02T18:21:28.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/543: creat d9/df/d12/d39/d4e/fc0 x:0 0 0 2022-02-02T18:21:28.462 INFO:tasks.workunit.client.0.smithi096.stdout:8/424: dwrite d29/d2d/f6b [0,4194304] 0 2022-02-02T18:21:28.462 INFO:tasks.workunit.client.0.smithi096.stdout:8/425: fdatasync d29/d2d/d42/f61 0 2022-02-02T18:21:28.462 INFO:tasks.workunit.client.0.smithi096.stdout:0/632: dwrite d2/d66/d71/f82 [0,4194304] 0 2022-02-02T18:21:28.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/552: mknod d15/d1b/d26/d6f/cc8 0 2022-02-02T18:21:28.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/553: creat d15/d4d/fc9 x:0 0 0 2022-02-02T18:21:28.467 INFO:tasks.workunit.client.0.smithi096.stdout:3/545: unlink d2/df/d14/d2c/f87 0 2022-02-02T18:21:28.467 INFO:tasks.workunit.client.0.smithi096.stdout:3/546: creat d2/df/d34/fb9 x:0 0 0 2022-02-02T18:21:28.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/547: readlink d2/df/d14/lc 0 2022-02-02T18:21:28.469 INFO:tasks.workunit.client.0.smithi096.stdout:5/575: rename db/de/f13 to db/de/d2e/d35/fd2 0 2022-02-02T18:21:28.469 INFO:tasks.workunit.client.0.smithi096.stdout:5/576: read - db/d5c/d2f/d46/d75/d9d/fce zero size 2022-02-02T18:21:28.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/546: link d1/db/d1c/d2f/d78/d25/d8e/d9d/caa d1/db/d1c/d2f/dc8/ccb 0 2022-02-02T18:21:28.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/554: dread d15/d1b/d28/f3e [0,4194304] 0 2022-02-02T18:21:28.473 INFO:tasks.workunit.client.0.smithi096.stdout:7/544: creat d9/df/d12/d39/d40/fc1 x:0 0 0 2022-02-02T18:21:28.477 INFO:tasks.workunit.client.0.smithi096.stdout:8/426: symlink d29/d2d/d87/l89 0 2022-02-02T18:21:28.478 INFO:tasks.workunit.client.0.smithi096.stdout:7/545: dread d9/df/d54/f99 [0,4194304] 0 2022-02-02T18:21:28.490 INFO:tasks.workunit.client.0.smithi096.stdout:0/633: rename d2/d66 to d2/db/d24/d89/d8f/d95/dcd/dcf/dd6 0 2022-02-02T18:21:28.491 INFO:tasks.workunit.client.0.smithi096.stdout:0/634: creat d2/db/d37/fd7 x:0 0 0 2022-02-02T18:21:28.491 INFO:tasks.workunit.client.0.smithi096.stdout:0/635: chown d2/db/d24/d4d/d53/c86 339306 1 2022-02-02T18:21:28.491 INFO:tasks.workunit.client.0.smithi096.stdout:0/636: creat d2/db/d10/d80/fd8 x:0 0 0 2022-02-02T18:21:28.492 INFO:tasks.workunit.client.0.smithi096.stdout:5/577: creat db/d5c/d2f/d46/d75/fd3 x:0 0 0 2022-02-02T18:21:28.492 INFO:tasks.workunit.client.0.smithi096.stdout:5/578: truncate db/d5c/d2f/d46/d75/fd3 976134 0 2022-02-02T18:21:28.493 INFO:tasks.workunit.client.0.smithi096.stdout:9/547: truncate d1/db/d1c/f6e 75135 0 2022-02-02T18:21:28.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/578: sync 2022-02-02T18:21:28.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/555: mknod d15/d1b/d28/d2c/d39/d71/cca 0 2022-02-02T18:21:28.496 INFO:tasks.workunit.client.0.smithi096.stdout:2/579: read d2/d6/d1b/d48/f4d [3639565,50142] 0 2022-02-02T18:21:28.498 INFO:tasks.workunit.client.0.smithi096.stdout:2/580: dread d2/d13/d43/d51/f69 [0,4194304] 0 2022-02-02T18:21:28.500 INFO:tasks.workunit.client.0.smithi096.stdout:6/595: sync 2022-02-02T18:21:28.500 INFO:tasks.workunit.client.0.smithi096.stdout:4/615: sync 2022-02-02T18:21:28.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/546: dwrite d9/df/d12/d39/d41/f6a [0,4194304] 0 2022-02-02T18:21:28.503 INFO:tasks.workunit.client.0.smithi096.stdout:3/548: rename d2/df/d20/d4a/fac to d2/df/d14/d66/fba 0 2022-02-02T18:21:28.503 INFO:tasks.workunit.client.0.smithi096.stdout:3/549: write d2/df/d14/d11/fb7 [731278,63160] 0 2022-02-02T18:21:28.505 INFO:tasks.workunit.client.0.smithi096.stdout:5/579: mkdir db/da1/dcc/dd4 0 2022-02-02T18:21:28.507 INFO:tasks.workunit.client.0.smithi096.stdout:9/548: creat d1/db/d1c/d2f/d78/d11/d1e/d66/dbf/fcc x:0 0 0 2022-02-02T18:21:28.507 INFO:tasks.workunit.client.0.smithi096.stdout:5/580: write db/d5c/fa6 [2765352,116580] 0 2022-02-02T18:21:28.507 INFO:tasks.workunit.client.0.smithi096.stdout:5/581: readlink db/d20/l2c 0 2022-02-02T18:21:28.508 INFO:tasks.workunit.client.0.smithi096.stdout:9/549: read d1/f56 [756571,69763] 0 2022-02-02T18:21:28.508 INFO:tasks.workunit.client.0.smithi096.stdout:1/556: creat d15/d4d/d8e/fcb x:0 0 0 2022-02-02T18:21:28.509 INFO:tasks.workunit.client.0.smithi096.stdout:9/550: write d1/f6 [4735242,117335] 0 2022-02-02T18:21:28.510 INFO:tasks.workunit.client.0.smithi096.stdout:5/582: dread db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:28.510 INFO:tasks.workunit.client.0.smithi096.stdout:5/583: chown db/d5c/d2f 285568 1 2022-02-02T18:21:28.510 INFO:tasks.workunit.client.0.smithi096.stdout:5/584: dread - db/d5c/d2f/d46/d75/d9d/fce zero size 2022-02-02T18:21:28.510 INFO:tasks.workunit.client.0.smithi096.stdout:9/551: read d1/db/d1c/d2f/d78/d25/dd/f5d [891152,89883] 0 2022-02-02T18:21:28.511 INFO:tasks.workunit.client.0.smithi096.stdout:9/552: write d1/db/d1c/f6e [1086677,5893] 0 2022-02-02T18:21:28.513 INFO:tasks.workunit.client.0.smithi096.stdout:4/616: mknod d3/d60/da8/cd6 0 2022-02-02T18:21:28.513 INFO:tasks.workunit.client.0.smithi096.stdout:7/547: unlink d9/df/d47/db7/lb9 0 2022-02-02T18:21:28.514 INFO:tasks.workunit.client.0.smithi096.stdout:4/617: readlink d3/d4/d20/lbb 0 2022-02-02T18:21:28.514 INFO:tasks.workunit.client.0.smithi096.stdout:4/618: creat d3/d60/d8d/fd7 x:0 0 0 2022-02-02T18:21:28.515 INFO:tasks.workunit.client.0.smithi096.stdout:8/427: rename d29/d2d/d42/l55 to d29/d58/d7a/l8a 0 2022-02-02T18:21:28.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/596: dwrite d18/d24/f8e [0,4194304] 0 2022-02-02T18:21:28.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/585: creat db/da1/dcc/fd5 x:0 0 0 2022-02-02T18:21:28.518 INFO:tasks.workunit.client.0.smithi096.stdout:2/581: getdents d2/d5e/d6d 0 2022-02-02T18:21:28.518 INFO:tasks.workunit.client.0.smithi096.stdout:2/582: write d2/d6/f93 [951302,92599] 0 2022-02-02T18:21:28.519 INFO:tasks.workunit.client.0.smithi096.stdout:9/553: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd 0 2022-02-02T18:21:28.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/548: unlink d9/df/d12/d39/d40/fc1 0 2022-02-02T18:21:28.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/549: chown d9/df/d16/d25/d98/cb0 131 1 2022-02-02T18:21:28.523 INFO:tasks.workunit.client.0.smithi096.stdout:8/428: dread d29/f3c [0,4194304] 0 2022-02-02T18:21:28.523 INFO:tasks.workunit.client.0.smithi096.stdout:8/429: chown d29/d4e/c69 4449110 1 2022-02-02T18:21:28.524 INFO:tasks.workunit.client.0.smithi096.stdout:8/430: dread d29/d2d/f2e [0,4194304] 0 2022-02-02T18:21:28.527 INFO:tasks.workunit.client.0.smithi096.stdout:2/583: dread d2/d6/d1b/f5b [0,4194304] 0 2022-02-02T18:21:28.527 INFO:tasks.workunit.client.0.smithi096.stdout:2/584: dread - d2/d13/f94 zero size 2022-02-02T18:21:28.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/637: rename d2/db/d24/d4d/d53/d58/fa8 to d2/db/d24/d89/d8f/d95/dcd/dcf/fd9 0 2022-02-02T18:21:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/638: creat d2/db/fda x:0 0 0 2022-02-02T18:21:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/639: dread - d2/db/d37/d40/fb8 zero size 2022-02-02T18:21:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/557: getdents d15/d67 0 2022-02-02T18:21:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/558: truncate d15/d1b/d28/fc6 968770 0 2022-02-02T18:21:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/559: creat d15/fcc x:0 0 0 2022-02-02T18:21:28.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/560: dread - d15/f22 zero size 2022-02-02T18:21:28.529 INFO:tasks.workunit.client.0.smithi096.stdout:6/597: symlink d18/d50/d8f/dc4/ld5 0 2022-02-02T18:21:28.530 INFO:tasks.workunit.client.0.smithi096.stdout:6/598: truncate d18/d24/f2d 663059 0 2022-02-02T18:21:28.530 INFO:tasks.workunit.client.0.smithi096.stdout:4/619: dwrite d3/d4/d50/fa2 [0,4194304] 0 2022-02-02T18:21:28.531 INFO:tasks.workunit.client.0.smithi096.stdout:5/586: link db/d5c/d2f/d46/f5f db/de/d10/fd6 0 2022-02-02T18:21:28.531 INFO:tasks.workunit.client.0.smithi096.stdout:4/620: write d3/d27/f43 [169348,106153] 0 2022-02-02T18:21:28.533 INFO:tasks.workunit.client.0.smithi096.stdout:0/640: write d2/db/f63 [10096,52955] 0 2022-02-02T18:21:28.535 INFO:tasks.workunit.client.0.smithi096.stdout:7/550: getdents d9/df/d12/d39/d46 0 2022-02-02T18:21:28.535 INFO:tasks.workunit.client.0.smithi096.stdout:8/431: link d29/d2d/f7e d29/d2d/f8b 0 2022-02-02T18:21:28.537 INFO:tasks.workunit.client.0.smithi096.stdout:3/550: rename d2/df/d1c/d5d/d69/f42 to d2/df/d14/d2c/d31/fbb 0 2022-02-02T18:21:28.539 INFO:tasks.workunit.client.0.smithi096.stdout:6/599: link d18/d24/faa d18/d24/d28/d4a/db8/fd6 0 2022-02-02T18:21:28.542 INFO:tasks.workunit.client.0.smithi096.stdout:0/641: mknod d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/d71/cdb 0 2022-02-02T18:21:28.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/551: write d2/df/d14/d11/fb7 [223121,124810] 0 2022-02-02T18:21:28.544 INFO:tasks.workunit.client.0.smithi096.stdout:8/432: unlink d29/d2d/f6b 0 2022-02-02T18:21:28.545 INFO:tasks.workunit.client.0.smithi096.stdout:0/642: write d2/d1e/d67/f9e [4035229,32616] 0 2022-02-02T18:21:28.552 INFO:tasks.workunit.client.0.smithi096.stdout:2/585: dwrite d2/d6/d1b/d3a/f44 [0,4194304] 0 2022-02-02T18:21:28.554 INFO:tasks.workunit.client.0.smithi096.stdout:3/552: creat d2/df/d14/d2c/d31/da8/fbc x:0 0 0 2022-02-02T18:21:28.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/554: rename d1/db/d1c/d2f/d78/f92 to d1/db/d1c/d2f/d78/d11/d1e/d47/fce 0 2022-02-02T18:21:28.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/551: dwrite d9/df/d16/d25/fad [0,4194304] 0 2022-02-02T18:21:28.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/552: readlink d9/df/d12/d39/d42/l7f 0 2022-02-02T18:21:28.557 INFO:tasks.workunit.client.0.smithi096.stdout:9/555: dread d1/db/d1c/d2f/d78/f95 [0,4194304] 0 2022-02-02T18:21:28.557 INFO:tasks.workunit.client.0.smithi096.stdout:9/556: chown d1/db/d1c/d2f/d78/d25/d8e/d9d/caa 395192 1 2022-02-02T18:21:28.557 INFO:tasks.workunit.client.0.smithi096.stdout:9/557: read - d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fb7 zero size 2022-02-02T18:21:28.558 INFO:tasks.workunit.client.0.smithi096.stdout:8/433: symlink d29/d2d/d47/l8c 0 2022-02-02T18:21:28.560 INFO:tasks.workunit.client.0.smithi096.stdout:2/586: mkdir d2/d6/d1b/d8a/db5 0 2022-02-02T18:21:28.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/553: creat d9/df/d47/d37/d83/db1/fc2 x:0 0 0 2022-02-02T18:21:28.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/554: fdatasync d9/f8d 0 2022-02-02T18:21:28.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/555: truncate d9/df/d12/d39/d4e/d6e/f9c 850859 0 2022-02-02T18:21:28.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/561: rename d15/d1b/d26/d72/da3/da7/l7b to d15/d1b/d26/d72/da3/da7/db6/lcd 0 2022-02-02T18:21:28.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/562: chown d15/d1b/d28/d2c/f5d 1130288 1 2022-02-02T18:21:28.569 INFO:tasks.workunit.client.0.smithi096.stdout:1/563: getdents d15/d1b/d26/d72 0 2022-02-02T18:21:28.573 INFO:tasks.workunit.client.0.smithi096.stdout:5/587: dwrite db/d20/fc1 [4194304,4194304] 0 2022-02-02T18:21:28.574 INFO:tasks.workunit.client.0.smithi096.stdout:0/643: dwrite d2/db/d24/d89/d8f/fb6 [0,4194304] 0 2022-02-02T18:21:28.576 INFO:tasks.workunit.client.0.smithi096.stdout:6/600: rename d18/d24/d28/f87 to d18/d24/d28/d3e/fd7 0 2022-02-02T18:21:28.581 INFO:tasks.workunit.client.0.smithi096.stdout:2/587: dread d2/d13/d42/d71/f7a [0,4194304] 0 2022-02-02T18:21:28.583 INFO:tasks.workunit.client.0.smithi096.stdout:0/644: mkdir d2/db/d10/d80/d93/da3/ddc 0 2022-02-02T18:21:28.584 INFO:tasks.workunit.client.0.smithi096.stdout:0/645: chown d2/d1e/fcc 999304 1 2022-02-02T18:21:28.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/601: symlink d18/d24/d28/d4a/d9d/ld8 0 2022-02-02T18:21:28.589 INFO:tasks.workunit.client.0.smithi096.stdout:6/602: write d18/d24/f5b [1426233,4063] 0 2022-02-02T18:21:28.596 INFO:tasks.workunit.client.0.smithi096.stdout:9/558: dwrite d1/db/d1c/d2f/d78/d11/d1e/f53 [8388608,4194304] 0 2022-02-02T18:21:28.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/556: dwrite d9/df/d12/d39/d4e/fc0 [0,4194304] 0 2022-02-02T18:21:28.596 INFO:tasks.workunit.client.0.smithi096.stdout:2/588: dread d2/d6/d1b/d3a/f3e [0,4194304] 0 2022-02-02T18:21:28.598 INFO:tasks.workunit.client.0.smithi096.stdout:6/603: link d18/d24/d28/d4a/db8/fd6 d18/d24/d28/d4a/d9d/fd9 0 2022-02-02T18:21:28.598 INFO:tasks.workunit.client.0.smithi096.stdout:6/604: write d18/d50/d8f/dbb/fbc [1036292,61229] 0 2022-02-02T18:21:28.599 INFO:tasks.workunit.client.0.smithi096.stdout:6/605: dread - d18/d50/d8f/dbb/d63/db3/fcf zero size 2022-02-02T18:21:28.599 INFO:tasks.workunit.client.0.smithi096.stdout:6/606: truncate d18/d24/d73/d79/fd3 712383 0 2022-02-02T18:21:28.599 INFO:tasks.workunit.client.0.smithi096.stdout:6/607: readlink d18/l89 0 2022-02-02T18:21:28.599 INFO:tasks.workunit.client.0.smithi096.stdout:6/608: unlink d18/cb6 0 2022-02-02T18:21:28.601 INFO:tasks.workunit.client.0.smithi096.stdout:8/434: dwrite d29/d2d/d42/f51 [0,4194304] 0 2022-02-02T18:21:28.602 INFO:tasks.workunit.client.0.smithi096.stdout:1/564: dwrite d15/d1b/d28/d2c/f38 [0,4194304] 0 2022-02-02T18:21:28.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/557: write d9/df/d16/f28 [913377,63340] 0 2022-02-02T18:21:28.603 INFO:tasks.workunit.client.0.smithi096.stdout:2/589: creat d2/d5e/d6d/fb6 x:0 0 0 2022-02-02T18:21:28.603 INFO:tasks.workunit.client.0.smithi096.stdout:5/588: dwrite db/d5c/d60/fbe [0,4194304] 0 2022-02-02T18:21:28.604 INFO:tasks.workunit.client.0.smithi096.stdout:5/589: creat db/de/d10/d27/fd7 x:0 0 0 2022-02-02T18:21:28.604 INFO:tasks.workunit.client.0.smithi096.stdout:5/590: stat db/de/d10/d25/da0/d85/la9 0 2022-02-02T18:21:28.608 INFO:tasks.workunit.client.0.smithi096.stdout:6/609: creat d18/d50/d8f/dc4/dbd/fda x:0 0 0 2022-02-02T18:21:28.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/646: rename d2/db4 to d2/db/d10/d80/d93/da3/ddd 0 2022-02-02T18:21:28.610 INFO:tasks.workunit.client.0.smithi096.stdout:0/647: chown d2/db/d10/l83 221662 1 2022-02-02T18:21:28.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/565: mkdir d15/d1b/d26/d72/dce 0 2022-02-02T18:21:28.616 INFO:tasks.workunit.client.0.smithi096.stdout:2/590: symlink d2/d6/lb7 0 2022-02-02T18:21:28.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/591: chown d2/d19/d86 1616 1 2022-02-02T18:21:28.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/591: mkdir db/de/d10/d25/d4c/dd8 0 2022-02-02T18:21:28.625 INFO:tasks.workunit.client.0.smithi096.stdout:6/610: link d18/d50/d8f/dc4/c98 d18/d24/d28/d4a/d9d/dc8/cdb 0 2022-02-02T18:21:28.625 INFO:tasks.workunit.client.0.smithi096.stdout:6/611: write d18/d24/faa [444505,24339] 0 2022-02-02T18:21:28.626 INFO:tasks.workunit.client.0.smithi096.stdout:0/648: mkdir d2/db/dde 0 2022-02-02T18:21:28.626 INFO:tasks.workunit.client.0.smithi096.stdout:0/649: write d2/db/d10/d80/f9f [1020052,60551] 0 2022-02-02T18:21:28.627 INFO:tasks.workunit.client.0.smithi096.stdout:1/566: rename d15/d1b/d28/d2c/d4f/d51/fc4 to d15/d1b/fcf 0 2022-02-02T18:21:28.628 INFO:tasks.workunit.client.0.smithi096.stdout:2/592: mknod d2/d13/d43/d51/cb8 0 2022-02-02T18:21:28.628 INFO:tasks.workunit.client.0.smithi096.stdout:2/593: dread - d2/d5e/d6d/fb6 zero size 2022-02-02T18:21:28.628 INFO:tasks.workunit.client.0.smithi096.stdout:2/594: chown d2/d5e/d6d/d79/l33 929273 1 2022-02-02T18:21:28.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/592: rmdir db/de/d10/d25/da0/d85 39 2022-02-02T18:21:28.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/593: stat db/de/d10/d27/f2b 0 2022-02-02T18:21:28.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/595: write d2/d6/db/f27 [2491161,122954] 0 2022-02-02T18:21:28.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/596: write d2/fae [788182,29890] 0 2022-02-02T18:21:28.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/435: dwrite d29/d2d/d47/f6e [0,4194304] 0 2022-02-02T18:21:28.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/559: dwrite d1/d39/d8a/d97/fb5 [0,4194304] 0 2022-02-02T18:21:28.634 INFO:tasks.workunit.client.0.smithi096.stdout:6/612: mknod d18/d50/d9a/cdc 0 2022-02-02T18:21:28.634 INFO:tasks.workunit.client.0.smithi096.stdout:7/558: dwrite d9/df/d16/d25/d98/fbb [0,4194304] 0 2022-02-02T18:21:28.635 INFO:tasks.workunit.client.0.smithi096.stdout:8/436: write d29/d2d/d42/f51 [2664858,61985] 0 2022-02-02T18:21:28.635 INFO:tasks.workunit.client.0.smithi096.stdout:0/650: rename d2/db/d24/d89/d8f/d95/dcd/dcf/cd1 to d2/db/d24/d89/d8f/d95/dcd/cdf 0 2022-02-02T18:21:28.636 INFO:tasks.workunit.client.0.smithi096.stdout:0/651: truncate d2/f69 312942 0 2022-02-02T18:21:28.637 INFO:tasks.workunit.client.0.smithi096.stdout:8/437: write d29/d2d/d47/f6e [2353594,70367] 0 2022-02-02T18:21:28.637 INFO:tasks.workunit.client.0.smithi096.stdout:1/567: symlink d15/d1b/d26/d72/dce/ld0 0 2022-02-02T18:21:28.641 INFO:tasks.workunit.client.0.smithi096.stdout:2/597: creat d2/d13/d43/d80/fb9 x:0 0 0 2022-02-02T18:21:28.641 INFO:tasks.workunit.client.0.smithi096.stdout:2/598: readlink d2/d6/d1b/d3a/l61 0 2022-02-02T18:21:28.644 INFO:tasks.workunit.client.0.smithi096.stdout:9/560: symlink d1/d39/lcf 0 2022-02-02T18:21:28.645 INFO:tasks.workunit.client.0.smithi096.stdout:5/594: dwrite db/de/d10/d27/d83/fc0 [0,4194304] 0 2022-02-02T18:21:28.645 INFO:tasks.workunit.client.0.smithi096.stdout:6/613: creat d18/d50/d9a/fdd x:0 0 0 2022-02-02T18:21:28.646 INFO:tasks.workunit.client.0.smithi096.stdout:9/561: write d1/db/f72 [7234916,81396] 0 2022-02-02T18:21:28.651 INFO:tasks.workunit.client.0.smithi096.stdout:7/559: unlink d9/df/d12/d39/d4e/l90 0 2022-02-02T18:21:28.655 INFO:tasks.workunit.client.0.smithi096.stdout:9/562: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [8388608,4194304] 0 2022-02-02T18:21:28.656 INFO:tasks.workunit.client.0.smithi096.stdout:8/438: rename d29/f3c to d29/d4a/d5b/d81/f8d 0 2022-02-02T18:21:28.658 INFO:tasks.workunit.client.0.smithi096.stdout:1/568: symlink d15/d1b/d28/d2c/d39/d6b/d8a/ld1 0 2022-02-02T18:21:28.658 INFO:tasks.workunit.client.0.smithi096.stdout:1/569: chown d15/d1b/d26/d59/f80 3552 1 2022-02-02T18:21:28.658 INFO:tasks.workunit.client.0.smithi096.stdout:1/570: write d15/d1b/d26/d59/fab [1232582,70720] 0 2022-02-02T18:21:28.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/621: sync 2022-02-02T18:21:28.662 INFO:tasks.workunit.client.0.smithi096.stdout:5/595: symlink db/de/d10/d25/ld9 0 2022-02-02T18:21:28.663 INFO:tasks.workunit.client.0.smithi096.stdout:3/553: sync 2022-02-02T18:21:28.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/614: mknod d18/d50/d8f/dbb/d63/dc2/cde 0 2022-02-02T18:21:28.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/615: stat d18/d50/d8f/dbb/f39 0 2022-02-02T18:21:28.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/616: chown d18/d50/d6d/d95 1127653 1 2022-02-02T18:21:28.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/617: readlink d18/l67 0 2022-02-02T18:21:28.664 INFO:tasks.workunit.client.0.smithi096.stdout:6/618: creat d18/d50/d8f/dbb/d63/db3/fdf x:0 0 0 2022-02-02T18:21:28.666 INFO:tasks.workunit.client.0.smithi096.stdout:5/596: write db/d20/fc1 [5858208,6860] 0 2022-02-02T18:21:28.668 INFO:tasks.workunit.client.0.smithi096.stdout:7/560: mknod d9/df/d12/d39/d46/cc3 0 2022-02-02T18:21:28.668 INFO:tasks.workunit.client.0.smithi096.stdout:0/652: rmdir d2/db/d24/d89/d91 39 2022-02-02T18:21:28.669 INFO:tasks.workunit.client.0.smithi096.stdout:7/561: write d9/df/d12/d14/f30 [807705,6636] 0 2022-02-02T18:21:28.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/599: rename d2/d5e/d6d/d79/f1d to d2/d13/d43/d51/fba 0 2022-02-02T18:21:28.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/600: write d2/fae [1772967,82453] 0 2022-02-02T18:21:28.672 INFO:tasks.workunit.client.0.smithi096.stdout:8/439: creat d29/d4e/f8e x:0 0 0 2022-02-02T18:21:28.673 INFO:tasks.workunit.client.0.smithi096.stdout:1/571: mkdir d15/d1b/d26/d59/dd2 0 2022-02-02T18:21:28.676 INFO:tasks.workunit.client.0.smithi096.stdout:6/619: symlink d18/le0 0 2022-02-02T18:21:28.677 INFO:tasks.workunit.client.0.smithi096.stdout:5/597: mknod db/d5c/d60/da7/cda 0 2022-02-02T18:21:28.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/622: dwrite d3/d4/d20/d26/d36/f56 [0,4194304] 0 2022-02-02T18:21:28.678 INFO:tasks.workunit.client.0.smithi096.stdout:0/653: creat d2/db/d10/d80/d93/da3/dca/fe0 x:0 0 0 2022-02-02T18:21:28.678 INFO:tasks.workunit.client.0.smithi096.stdout:0/654: truncate d2/db/d24/d89/fd4 866240 0 2022-02-02T18:21:28.679 INFO:tasks.workunit.client.0.smithi096.stdout:0/655: truncate d2/d1e/d67/f70 2008530 0 2022-02-02T18:21:28.679 INFO:tasks.workunit.client.0.smithi096.stdout:0/656: write d2/db/d10/d80/f9f [1747723,84101] 0 2022-02-02T18:21:28.679 INFO:tasks.workunit.client.0.smithi096.stdout:0/657: stat d2/db/fc7 0 2022-02-02T18:21:28.681 INFO:tasks.workunit.client.0.smithi096.stdout:7/562: creat d9/df/d12/d14/d82/fc4 x:0 0 0 2022-02-02T18:21:28.681 INFO:tasks.workunit.client.0.smithi096.stdout:7/563: dread - d9/df/d47/d37/d83/f97 zero size 2022-02-02T18:21:28.681 INFO:tasks.workunit.client.0.smithi096.stdout:7/564: readlink d9/df/d12/d39/l6f 0 2022-02-02T18:21:28.682 INFO:tasks.workunit.client.0.smithi096.stdout:9/563: getdents d1/db/d1c/d2f/d78/d11/d1e/d66 0 2022-02-02T18:21:28.683 INFO:tasks.workunit.client.0.smithi096.stdout:2/601: creat d2/d5e/d6d/d79/fbb x:0 0 0 2022-02-02T18:21:28.684 INFO:tasks.workunit.client.0.smithi096.stdout:2/602: fdatasync d2/d6/db/fc 0 2022-02-02T18:21:28.684 INFO:tasks.workunit.client.0.smithi096.stdout:2/603: write d2/d29/f32 [930335,125869] 0 2022-02-02T18:21:28.685 INFO:tasks.workunit.client.0.smithi096.stdout:2/604: write d2/d13/d43/f47 [174064,48732] 0 2022-02-02T18:21:28.686 INFO:tasks.workunit.client.0.smithi096.stdout:1/572: rename d15/d1b/d28/d2c/d39/d71/f91 to d15/d1b/d28/d2c/d39/d6b/fd3 0 2022-02-02T18:21:28.687 INFO:tasks.workunit.client.0.smithi096.stdout:1/573: write d15/d4d/d8e/fcb [452998,89451] 0 2022-02-02T18:21:28.687 INFO:tasks.workunit.client.0.smithi096.stdout:8/440: dread fc [0,4194304] 0 2022-02-02T18:21:28.687 INFO:tasks.workunit.client.0.smithi096.stdout:0/658: dread d2/db/d24/f30 [0,4194304] 0 2022-02-02T18:21:28.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/623: mkdir d3/d4/d20/d26/d36/d88/dd8 0 2022-02-02T18:21:28.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/624: truncate d3/d4/d20/f22 4832357 0 2022-02-02T18:21:28.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/625: write d3/d5a/db8/fce [773761,51868] 0 2022-02-02T18:21:28.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/626: dread - d3/d60/d8d/f9a zero size 2022-02-02T18:21:28.693 INFO:tasks.workunit.client.0.smithi096.stdout:8/441: creat d29/d40/f8f x:0 0 0 2022-02-02T18:21:28.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/598: creat db/de/d2e/d35/fdb x:0 0 0 2022-02-02T18:21:28.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/599: chown db/d5c/d2f/d46/f73 79 1 2022-02-02T18:21:28.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/600: chown db/d5c/d32/f4b 161821145 1 2022-02-02T18:21:28.698 INFO:tasks.workunit.client.0.smithi096.stdout:0/659: rename d2/db/d24/d89/fd4 to d2/db/d10/d80/d93/da3/fe1 0 2022-02-02T18:21:28.699 INFO:tasks.workunit.client.0.smithi096.stdout:0/660: dread - d2/db/d10/d80/d93/da3/dca/fe0 zero size 2022-02-02T18:21:28.699 INFO:tasks.workunit.client.0.smithi096.stdout:8/442: stat cd 0 2022-02-02T18:21:28.699 INFO:tasks.workunit.client.0.smithi096.stdout:8/443: truncate d29/d58/d7a/f7f 376582 0 2022-02-02T18:21:28.699 INFO:tasks.workunit.client.0.smithi096.stdout:8/444: chown d29/d40/d6d/d83 42208 1 2022-02-02T18:21:28.703 INFO:tasks.workunit.client.0.smithi096.stdout:0/661: symlink d2/db/d24/le2 0 2022-02-02T18:21:28.703 INFO:tasks.workunit.client.0.smithi096.stdout:5/601: write db/d5c/f5e [5317833,97982] 0 2022-02-02T18:21:28.703 INFO:tasks.workunit.client.0.smithi096.stdout:7/565: write d9/f8a [426900,59126] 0 2022-02-02T18:21:28.703 INFO:tasks.workunit.client.0.smithi096.stdout:7/566: write d9/df/d47/d37/d83/f97 [473718,26153] 0 2022-02-02T18:21:28.704 INFO:tasks.workunit.client.0.smithi096.stdout:0/662: creat d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/fe3 x:0 0 0 2022-02-02T18:21:28.706 INFO:tasks.workunit.client.0.smithi096.stdout:6/620: dwrite d18/d50/d8f/fa0 [0,4194304] 0 2022-02-02T18:21:28.706 INFO:tasks.workunit.client.0.smithi096.stdout:8/445: dread f19 [0,4194304] 0 2022-02-02T18:21:28.706 INFO:tasks.workunit.client.0.smithi096.stdout:6/621: creat d18/d50/d8f/dbb/d63/db3/fe1 x:0 0 0 2022-02-02T18:21:28.706 INFO:tasks.workunit.client.0.smithi096.stdout:6/622: read - d18/d50/d8f/dbb/d63/db3/fcf zero size 2022-02-02T18:21:28.707 INFO:tasks.workunit.client.0.smithi096.stdout:7/567: link d9/fd d9/df/d12/d39/d46/d7d/fc5 0 2022-02-02T18:21:28.707 INFO:tasks.workunit.client.0.smithi096.stdout:0/663: mknod d2/db/d24/d89/d8f/d95/ce4 0 2022-02-02T18:21:28.708 INFO:tasks.workunit.client.0.smithi096.stdout:7/568: chown d9/df/c86 0 1 2022-02-02T18:21:28.708 INFO:tasks.workunit.client.0.smithi096.stdout:0/664: chown d2/db/d24/c41 8 1 2022-02-02T18:21:28.708 INFO:tasks.workunit.client.0.smithi096.stdout:7/569: fsync d9/df/d16/f2a 0 2022-02-02T18:21:28.709 INFO:tasks.workunit.client.0.smithi096.stdout:5/602: dread db/de/d2e/d35/fd2 [0,4194304] 0 2022-02-02T18:21:28.713 INFO:tasks.workunit.client.0.smithi096.stdout:8/446: dread d29/d2d/d42/f61 [0,4194304] 0 2022-02-02T18:21:28.713 INFO:tasks.workunit.client.0.smithi096.stdout:8/447: fdatasync d29/d4e/f6c 0 2022-02-02T18:21:28.714 INFO:tasks.workunit.client.0.smithi096.stdout:8/448: write d29/d2d/f56 [2057839,62114] 0 2022-02-02T18:21:28.715 INFO:tasks.workunit.client.0.smithi096.stdout:8/449: write d29/d2d/f3d [1317265,47503] 0 2022-02-02T18:21:28.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/564: dwrite d1/db/d1c/d2f/d78/d25/fad [0,4194304] 0 2022-02-02T18:21:28.717 INFO:tasks.workunit.client.0.smithi096.stdout:9/565: chown d1/db/d48/fb3 2 1 2022-02-02T18:21:28.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/450: creat d29/d40/d6d/f90 x:0 0 0 2022-02-02T18:21:28.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/451: creat d29/d58/d7a/f91 x:0 0 0 2022-02-02T18:21:28.719 INFO:tasks.workunit.client.0.smithi096.stdout:1/574: dwrite d15/d1b/d26/d6f/f94 [0,4194304] 0 2022-02-02T18:21:28.719 INFO:tasks.workunit.client.0.smithi096.stdout:5/603: dread db/de/d2e/d35/f95 [0,4194304] 0 2022-02-02T18:21:28.720 INFO:tasks.workunit.client.0.smithi096.stdout:5/604: chown db/de/d10 1 1 2022-02-02T18:21:28.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/575: creat d15/d1b/d26/d72/da3/fd4 x:0 0 0 2022-02-02T18:21:28.730 INFO:tasks.workunit.client.0.smithi096.stdout:5/605: symlink db/da1/ldc 0 2022-02-02T18:21:28.730 INFO:tasks.workunit.client.0.smithi096.stdout:5/606: creat db/da1/dcc/fdd x:0 0 0 2022-02-02T18:21:28.733 INFO:tasks.workunit.client.0.smithi096.stdout:2/605: truncate d2/d6/d1b/d48/f4d 2723161 0 2022-02-02T18:21:28.742 INFO:tasks.workunit.client.0.smithi096.stdout:1/576: rmdir d15/d1b/d28/d2c/d39/d6b/dc2 0 2022-02-02T18:21:28.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/607: write db/de/d2e/f94 [403659,49812] 0 2022-02-02T18:21:28.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/608: chown db/de/d10/d27/fd7 98327 1 2022-02-02T18:21:28.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/609: truncate db/de/d10/d25/d4c/f5d 2238940 0 2022-02-02T18:21:28.745 INFO:tasks.workunit.client.0.smithi096.stdout:0/665: dwrite d2/d1e/f5d [4194304,4194304] 0 2022-02-02T18:21:28.745 INFO:tasks.workunit.client.0.smithi096.stdout:2/606: creat d2/d5e/fbc x:0 0 0 2022-02-02T18:21:28.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/452: dwrite d29/f33 [0,4194304] 0 2022-02-02T18:21:28.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/453: readlink d29/l2c 0 2022-02-02T18:21:28.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/454: chown d29/l6f 22 1 2022-02-02T18:21:28.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/455: read - d29/d2d/d42/f67 zero size 2022-02-02T18:21:28.748 INFO:tasks.workunit.client.0.smithi096.stdout:6/623: dwrite d18/d24/fca [0,4194304] 0 2022-02-02T18:21:28.748 INFO:tasks.workunit.client.0.smithi096.stdout:1/577: dread d15/d1b/f6e [0,4194304] 0 2022-02-02T18:21:28.748 INFO:tasks.workunit.client.0.smithi096.stdout:1/578: chown d15/d1b/d28/d2c/d39/d6b 32 1 2022-02-02T18:21:28.748 INFO:tasks.workunit.client.0.smithi096.stdout:9/566: dwrite d1/db/d1c/d2f/d78/d11/d1e/d66/dbf/fcc [0,4194304] 0 2022-02-02T18:21:28.749 INFO:tasks.workunit.client.0.smithi096.stdout:9/567: chown d1/db/d1c/d2f/f32 910 1 2022-02-02T18:21:28.750 INFO:tasks.workunit.client.0.smithi096.stdout:5/610: mknod db/d5c/d60/da3/cde 0 2022-02-02T18:21:28.750 INFO:tasks.workunit.client.0.smithi096.stdout:0/666: creat d2/db/d24/d4d/d61/fe5 x:0 0 0 2022-02-02T18:21:28.751 INFO:tasks.workunit.client.0.smithi096.stdout:2/607: rename d2/d6/f41 to d2/d13/d43/d51/d5d/fbd 0 2022-02-02T18:21:28.754 INFO:tasks.workunit.client.0.smithi096.stdout:8/456: mknod d29/d58/d79/c92 0 2022-02-02T18:21:28.759 INFO:tasks.workunit.client.0.smithi096.stdout:1/579: symlink d15/d4d/ld5 0 2022-02-02T18:21:28.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/568: truncate d1/db/d1c/f64 485840 0 2022-02-02T18:21:28.764 INFO:tasks.workunit.client.0.smithi096.stdout:5/611: truncate db/de/d10/d27/d83/f96 696358 0 2022-02-02T18:21:28.764 INFO:tasks.workunit.client.0.smithi096.stdout:5/612: readlink db/da1/lb9 0 2022-02-02T18:21:28.765 INFO:tasks.workunit.client.0.smithi096.stdout:0/667: creat d2/db/d10/d80/d93/da3/ddc/fe6 x:0 0 0 2022-02-02T18:21:28.765 INFO:tasks.workunit.client.0.smithi096.stdout:0/668: chown d2/db/d37/f3e 36 1 2022-02-02T18:21:28.766 INFO:tasks.workunit.client.0.smithi096.stdout:0/669: fdatasync d2/db/d10/d27/f5b 0 2022-02-02T18:21:28.767 INFO:tasks.workunit.client.0.smithi096.stdout:1/580: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:28.767 INFO:tasks.workunit.client.0.smithi096.stdout:1/581: dread - d15/d1b/d26/d72/da3/fd4 zero size 2022-02-02T18:21:28.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/582: creat d15/d4d/fd6 x:0 0 0 2022-02-02T18:21:28.768 INFO:tasks.workunit.client.0.smithi096.stdout:5/613: write db/de/fa2 [54374,39021] 0 2022-02-02T18:21:28.769 INFO:tasks.workunit.client.0.smithi096.stdout:5/614: read db/d5c/d60/f8c [656912,36784] 0 2022-02-02T18:21:28.769 INFO:tasks.workunit.client.0.smithi096.stdout:5/615: write db/de/fb6 [479732,125022] 0 2022-02-02T18:21:28.769 INFO:tasks.workunit.client.0.smithi096.stdout:5/616: readlink db/d20/l2c 0 2022-02-02T18:21:28.773 INFO:tasks.workunit.client.0.smithi096.stdout:2/608: dwrite d2/d6/d1b/f5b [0,4194304] 0 2022-02-02T18:21:28.773 INFO:tasks.workunit.client.0.smithi096.stdout:9/569: getdents d1/db/d1c/d2f/d78/d25/d8e 0 2022-02-02T18:21:28.775 INFO:tasks.workunit.client.0.smithi096.stdout:6/624: dwrite d18/d24/f8e [0,4194304] 0 2022-02-02T18:21:28.775 INFO:tasks.workunit.client.0.smithi096.stdout:6/625: stat c11 0 2022-02-02T18:21:28.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/670: link d2/db/d24/f90 d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/d71/fe7 0 2022-02-02T18:21:28.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/671: fdatasync d2/db/d24/d89/d8f/d95/fb1 0 2022-02-02T18:21:28.778 INFO:tasks.workunit.client.0.smithi096.stdout:5/617: symlink db/de/d10/d25/da0/ldf 0 2022-02-02T18:21:28.778 INFO:tasks.workunit.client.0.smithi096.stdout:5/618: truncate db/de/d10/d27/f4d 688122 0 2022-02-02T18:21:28.778 INFO:tasks.workunit.client.0.smithi096.stdout:5/619: chown db/d5c/d2f/d46/f5f 16177 1 2022-02-02T18:21:28.780 INFO:tasks.workunit.client.0.smithi096.stdout:8/457: getdents d29/d40 0 2022-02-02T18:21:28.780 INFO:tasks.workunit.client.0.smithi096.stdout:5/620: dread db/de/d10/d25/d4c/f5d [0,4194304] 0 2022-02-02T18:21:28.781 INFO:tasks.workunit.client.0.smithi096.stdout:0/672: write d2/db/d37/d40/f4e [79377,72110] 0 2022-02-02T18:21:28.785 INFO:tasks.workunit.client.0.smithi096.stdout:6/626: rmdir d18/d24/d28/d4a 39 2022-02-02T18:21:28.786 INFO:tasks.workunit.client.0.smithi096.stdout:2/609: getdents d2/d13/d42/d71 0 2022-02-02T18:21:28.787 INFO:tasks.workunit.client.0.smithi096.stdout:6/627: write d18/d24/f5b [2528557,40265] 0 2022-02-02T18:21:28.788 INFO:tasks.workunit.client.0.smithi096.stdout:6/628: stat d18/d50/lce 0 2022-02-02T18:21:28.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/629: mknod d18/d24/ce2 0 2022-02-02T18:21:28.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/630: creat d18/d24/d73/fe3 x:0 0 0 2022-02-02T18:21:28.791 INFO:tasks.workunit.client.0.smithi096.stdout:6/631: symlink d18/d24/d28/d4a/db8/le4 0 2022-02-02T18:21:28.792 INFO:tasks.workunit.client.0.smithi096.stdout:0/673: dread d2/db/d24/d4d/faa [0,4194304] 0 2022-02-02T18:21:28.792 INFO:tasks.workunit.client.0.smithi096.stdout:0/674: chown d2/db/d24/d4d/d53/d58 57771503 1 2022-02-02T18:21:28.793 INFO:tasks.workunit.client.0.smithi096.stdout:6/632: rmdir d18/d24/d28/d4a/d9d/dc8 39 2022-02-02T18:21:28.793 INFO:tasks.workunit.client.0.smithi096.stdout:6/633: creat d18/d50/d6d/d95/fe5 x:0 0 0 2022-02-02T18:21:28.794 INFO:tasks.workunit.client.0.smithi096.stdout:0/675: symlink d2/db/d24/le8 0 2022-02-02T18:21:28.794 INFO:tasks.workunit.client.0.smithi096.stdout:0/676: truncate d2/db/d10/d80/d93/da3/fe1 1575625 0 2022-02-02T18:21:28.795 INFO:tasks.workunit.client.0.smithi096.stdout:5/621: dread db/d5c/d2f/f3d [0,4194304] 0 2022-02-02T18:21:28.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/610: dread d2/d6/fa [0,4194304] 0 2022-02-02T18:21:28.798 INFO:tasks.workunit.client.0.smithi096.stdout:5/622: symlink db/de/d10/d25/d4c/le0 0 2022-02-02T18:21:28.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/570: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb [0,4194304] 0 2022-02-02T18:21:28.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/611: unlink d2/d5e/d6d/ca2 0 2022-02-02T18:21:28.804 INFO:tasks.workunit.client.0.smithi096.stdout:5/623: rename db/d5c/d60/f93 to db/de/d10/d80/fe1 0 2022-02-02T18:21:28.804 INFO:tasks.workunit.client.0.smithi096.stdout:0/677: dread d2/db/d10/d80/d93/da3/fb2 [0,4194304] 0 2022-02-02T18:21:28.804 INFO:tasks.workunit.client.0.smithi096.stdout:5/624: chown db/de/d2e/d35/fdb 497749 1 2022-02-02T18:21:28.804 INFO:tasks.workunit.client.0.smithi096.stdout:0/678: truncate d2/db/d24/d4d/d53/d58/fba 539628 0 2022-02-02T18:21:28.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/625: write db/de/d10/d27/d83/fac [1117846,9594] 0 2022-02-02T18:21:28.805 INFO:tasks.workunit.client.0.smithi096.stdout:8/458: dwrite d29/d4a/d5b/d81/f8d [0,4194304] 0 2022-02-02T18:21:28.806 INFO:tasks.workunit.client.0.smithi096.stdout:6/634: dread d18/f1a [0,4194304] 0 2022-02-02T18:21:28.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/571: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/ld0 0 2022-02-02T18:21:28.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/572: read - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/fc0 zero size 2022-02-02T18:21:28.807 INFO:tasks.workunit.client.0.smithi096.stdout:8/459: write fc [7644030,91009] 0 2022-02-02T18:21:28.807 INFO:tasks.workunit.client.0.smithi096.stdout:8/460: chown d29/d4a/d5b 107760689 1 2022-02-02T18:21:28.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/635: creat d18/d50/d8f/fe6 x:0 0 0 2022-02-02T18:21:28.810 INFO:tasks.workunit.client.0.smithi096.stdout:0/679: dread d2/db/d24/d89/d91/fa4 [0,4194304] 0 2022-02-02T18:21:28.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/573: mkdir d1/dd1 0 2022-02-02T18:21:28.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/574: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f5b [1400431,44278] 0 2022-02-02T18:21:28.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/575: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/cb6 0 2022-02-02T18:21:28.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/576: truncate d1/db/d1c/d2f/d78/d11/d1e/d38/f7f 870676 0 2022-02-02T18:21:28.819 INFO:tasks.workunit.client.0.smithi096.stdout:8/461: creat d29/d2d/d47/f93 x:0 0 0 2022-02-02T18:21:28.819 INFO:tasks.workunit.client.0.smithi096.stdout:6/636: symlink d18/d50/d8f/dbb/le7 0 2022-02-02T18:21:28.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/637: fsync d18/d50/fcc 0 2022-02-02T18:21:28.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/638: truncate d18/d50/f88 1063069 0 2022-02-02T18:21:28.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/680: rename d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/d71 to d2/db/d24/d89/d8f/da1/de9 0 2022-02-02T18:21:28.821 INFO:tasks.workunit.client.0.smithi096.stdout:9/577: mkdir d1/db/d1c/d2f/dd2 0 2022-02-02T18:21:28.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/612: dwrite d2/d13/d42/d71/f7a [0,4194304] 0 2022-02-02T18:21:28.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/613: chown d2/d13/d42/d71/ca1 1863 1 2022-02-02T18:21:28.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/614: write d2/d5e/d7c/f83 [1558426,82523] 0 2022-02-02T18:21:28.824 INFO:tasks.workunit.client.0.smithi096.stdout:8/462: unlink d29/d2d/d42/f61 0 2022-02-02T18:21:28.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/639: mkdir d18/d50/d6d/d95/de8 0 2022-02-02T18:21:28.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/640: write d18/d50/d8f/dbb/d63/db3/db5/fbe [373407,10913] 0 2022-02-02T18:21:28.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/641: dread - d18/d24/d28/fad zero size 2022-02-02T18:21:28.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/681: mknod d2/db/d37/d40/cea 0 2022-02-02T18:21:28.826 INFO:tasks.workunit.client.0.smithi096.stdout:6/642: write d18/d50/d8f/fa0 [3599434,101236] 0 2022-02-02T18:21:28.826 INFO:tasks.workunit.client.0.smithi096.stdout:6/643: readlink d18/d50/d8f/dbb/l3c 0 2022-02-02T18:21:28.828 INFO:tasks.workunit.client.0.smithi096.stdout:6/644: write d18/d50/f61 [3489604,128723] 0 2022-02-02T18:21:28.828 INFO:tasks.workunit.client.0.smithi096.stdout:6/645: fsync d18/d50/d8f/dbb/f3b 0 2022-02-02T18:21:28.829 INFO:tasks.workunit.client.0.smithi096.stdout:2/615: rmdir d2/d19/d86 39 2022-02-02T18:21:28.829 INFO:tasks.workunit.client.0.smithi096.stdout:8/463: mknod d29/d2d/d87/c94 0 2022-02-02T18:21:28.829 INFO:tasks.workunit.client.0.smithi096.stdout:8/464: fsync d29/d2d/d42/f53 0 2022-02-02T18:21:28.830 INFO:tasks.workunit.client.0.smithi096.stdout:9/578: dread d1/db/d1c/d2f/d78/f18 [0,4194304] 0 2022-02-02T18:21:28.830 INFO:tasks.workunit.client.0.smithi096.stdout:0/682: symlink d2/db/d24/d4d/d61/leb 0 2022-02-02T18:21:28.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/646: link d18/d50/d8f/dc4/ld5 d18/d50/d8f/dbb/d63/db3/db5/le9 0 2022-02-02T18:21:28.831 INFO:tasks.workunit.client.0.smithi096.stdout:2/616: truncate d2/f9 3450954 0 2022-02-02T18:21:28.833 INFO:tasks.workunit.client.0.smithi096.stdout:8/465: rename d29/d2d/d42/f67 to d29/d2d/d42/f95 0 2022-02-02T18:21:28.835 INFO:tasks.workunit.client.0.smithi096.stdout:9/579: creat d1/db/d1c/d2f/d78/d11/d1e/d47/fd3 x:0 0 0 2022-02-02T18:21:28.835 INFO:tasks.workunit.client.0.smithi096.stdout:8/466: write d29/f34 [3641962,57417] 0 2022-02-02T18:21:28.837 INFO:tasks.workunit.client.0.smithi096.stdout:6/647: getdents d18/d24/d28/d4a/d9d/dc8 0 2022-02-02T18:21:28.837 INFO:tasks.workunit.client.0.smithi096.stdout:6/648: chown d18/d50/d8f/dc4 1059749 1 2022-02-02T18:21:28.837 INFO:tasks.workunit.client.0.smithi096.stdout:6/649: chown d18/d50/fcc 102224614 1 2022-02-02T18:21:28.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/467: read f1c [2821500,104444] 0 2022-02-02T18:21:28.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/468: read d29/f3a [3517537,48836] 0 2022-02-02T18:21:28.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/469: write d29/d4e/f6c [520607,119736] 0 2022-02-02T18:21:28.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/470: dread - d29/d58/d79/f7c zero size 2022-02-02T18:21:28.838 INFO:tasks.workunit.client.0.smithi096.stdout:9/580: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f86 [2180516,64040] 0 2022-02-02T18:21:28.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/617: symlink d2/d5e/d6d/d79/lbe 0 2022-02-02T18:21:28.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/618: write d2/d5e/d6d/d79/f6a [1629725,36624] 0 2022-02-02T18:21:28.839 INFO:tasks.workunit.client.0.smithi096.stdout:6/650: mknod d18/d50/cea 0 2022-02-02T18:21:28.844 INFO:tasks.workunit.client.0.smithi096.stdout:9/581: symlink d1/d39/ld4 0 2022-02-02T18:21:28.846 INFO:tasks.workunit.client.0.smithi096.stdout:2/619: link f1 d2/d13/d42/d71/dad/db0/fbf 0 2022-02-02T18:21:28.847 INFO:tasks.workunit.client.0.smithi096.stdout:8/471: truncate d29/d2d/f3f 236189 0 2022-02-02T18:21:28.847 INFO:tasks.workunit.client.0.smithi096.stdout:8/472: stat d29 0 2022-02-02T18:21:28.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/620: mkdir d2/d6/d1b/dc0 0 2022-02-02T18:21:28.850 INFO:tasks.workunit.client.0.smithi096.stdout:2/621: readlink d2/d13/d43/l4a 0 2022-02-02T18:21:28.850 INFO:tasks.workunit.client.0.smithi096.stdout:2/622: write d2/d5e/d6d/d79/d66/fa6 [957259,52811] 0 2022-02-02T18:21:28.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/623: dread - d2/d13/d43/d80/fb9 zero size 2022-02-02T18:21:28.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/624: write d2/d5e/fbc [958631,58333] 0 2022-02-02T18:21:28.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/625: write d2/d13/d43/d51/d73/da9/faa [962193,55647] 0 2022-02-02T18:21:28.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/626: dread - d2/d5e/d6d/fb6 zero size 2022-02-02T18:21:28.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/554: sync 2022-02-02T18:21:28.852 INFO:tasks.workunit.client.0.smithi096.stdout:8/473: getdents d29/d40/d6d/d85 0 2022-02-02T18:21:28.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/582: read d1/db/d1c/f64 [94191,67943] 0 2022-02-02T18:21:28.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/583: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l1d 3 1 2022-02-02T18:21:28.856 INFO:tasks.workunit.client.0.smithi096.stdout:2/627: link d2/d13/d42/d71/dad/db0/fbf d2/d13/d43/d51/fc1 0 2022-02-02T18:21:28.856 INFO:tasks.workunit.client.0.smithi096.stdout:2/628: chown d2/d13/d43/d51/f85 15029 1 2022-02-02T18:21:28.857 INFO:tasks.workunit.client.0.smithi096.stdout:8/474: symlink d29/d40/l96 0 2022-02-02T18:21:28.857 INFO:tasks.workunit.client.0.smithi096.stdout:8/475: read - d29/d2d/f7e zero size 2022-02-02T18:21:28.857 INFO:tasks.workunit.client.0.smithi096.stdout:9/584: creat d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fd5 x:0 0 0 2022-02-02T18:21:28.857 INFO:tasks.workunit.client.0.smithi096.stdout:9/585: truncate d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fc5 950834 0 2022-02-02T18:21:28.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/586: readlink d1/d39/lcf 0 2022-02-02T18:21:28.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/555: rename d2/df/d1c/f28 to d2/d71/fbd 0 2022-02-02T18:21:28.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/629: rmdir d2/d13/d43 39 2022-02-02T18:21:28.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/630: dread - d2/d13/d43/d51/f85 zero size 2022-02-02T18:21:28.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/476: getdents d29/d4a/d5b 0 2022-02-02T18:21:28.861 INFO:tasks.workunit.client.0.smithi096.stdout:2/631: write d2/d6/d1b/d48/f4d [1294529,85623] 0 2022-02-02T18:21:28.862 INFO:tasks.workunit.client.0.smithi096.stdout:8/477: write d29/f3a [414443,52873] 0 2022-02-02T18:21:28.862 INFO:tasks.workunit.client.0.smithi096.stdout:3/556: mkdir d2/df/d14/dbe 0 2022-02-02T18:21:28.863 INFO:tasks.workunit.client.0.smithi096.stdout:0/683: dwrite d2/db/d24/d89/d8f/da1/de9/fe7 [0,4194304] 0 2022-02-02T18:21:28.864 INFO:tasks.workunit.client.0.smithi096.stdout:0/684: write d2/db/d24/d4d/d61/fc8 [647062,113477] 0 2022-02-02T18:21:28.865 INFO:tasks.workunit.client.0.smithi096.stdout:6/651: dwrite d18/d50/d9a/fdd [0,4194304] 0 2022-02-02T18:21:28.865 INFO:tasks.workunit.client.0.smithi096.stdout:8/478: dread f1f [0,4194304] 0 2022-02-02T18:21:28.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/652: dread d18/f23 [0,4194304] 0 2022-02-02T18:21:28.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/653: fdatasync d18/d50/d8f/dbb/d63/f6f 0 2022-02-02T18:21:28.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/654: write d18/d50/d8f/fa0 [3510599,66775] 0 2022-02-02T18:21:28.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/655: write d18/d50/d6d/d95/fe5 [118405,82295] 0 2022-02-02T18:21:28.902 INFO:tasks.workunit.client.0.smithi096.stdout:9/587: dwrite d1/db/d1c/d2f/d78/d11/f30 [0,4194304] 0 2022-02-02T18:21:28.903 INFO:tasks.workunit.client.0.smithi096.stdout:3/557: dwrite d2/df/d20/d33/fb8 [0,4194304] 0 2022-02-02T18:21:28.903 INFO:tasks.workunit.client.0.smithi096.stdout:3/558: truncate d2/df/d20/d33/d58/d7c/fae 273068 0 2022-02-02T18:21:28.903 INFO:tasks.workunit.client.0.smithi096.stdout:3/559: write d2/df/d1c/d5d/f79 [709853,76236] 0 2022-02-02T18:21:28.905 INFO:tasks.workunit.client.0.smithi096.stdout:9/588: mknod d1/db/d1c/d2f/dc8/cd6 0 2022-02-02T18:21:28.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/632: dwrite d2/fae [0,4194304] 0 2022-02-02T18:21:28.907 INFO:tasks.workunit.client.0.smithi096.stdout:8/479: dwrite f1c [0,4194304] 0 2022-02-02T18:21:28.907 INFO:tasks.workunit.client.0.smithi096.stdout:6/656: dwrite d18/d50/f61 [0,4194304] 0 2022-02-02T18:21:28.910 INFO:tasks.workunit.client.0.smithi096.stdout:3/560: mkdir d2/df/d1c/d5d/dbf 0 2022-02-02T18:21:28.911 INFO:tasks.workunit.client.0.smithi096.stdout:3/561: creat d2/df/d14/d11/fc0 x:0 0 0 2022-02-02T18:21:28.912 INFO:tasks.workunit.client.0.smithi096.stdout:4/627: sync 2022-02-02T18:21:28.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/570: sync 2022-02-02T18:21:28.914 INFO:tasks.workunit.client.0.smithi096.stdout:7/571: dread d9/df/d12/d14/f30 [0,4194304] 0 2022-02-02T18:21:28.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/589: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/fd7 x:0 0 0 2022-02-02T18:21:28.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/590: readlink d1/d39/lcf 0 2022-02-02T18:21:28.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/591: write d1/d39/d8a/d97/fa0 [996383,29825] 0 2022-02-02T18:21:28.917 INFO:tasks.workunit.client.0.smithi096.stdout:9/592: truncate d1/db/d1c/d2f/dac/fc9 8368499 0 2022-02-02T18:21:28.917 INFO:tasks.workunit.client.0.smithi096.stdout:9/593: fsync d1/db/d1c/d2f/d78/d25/d8e/d9d/fa5 0 2022-02-02T18:21:28.919 INFO:tasks.workunit.client.0.smithi096.stdout:2/633: symlink d2/d13/d43/d51/d73/lc2 0 2022-02-02T18:21:28.921 INFO:tasks.workunit.client.0.smithi096.stdout:2/634: fsync d2/d13/d43/d51/d5d/fbd 0 2022-02-02T18:21:28.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/657: symlink d18/d24/d28/d4a/d9d/leb 0 2022-02-02T18:21:28.922 INFO:tasks.workunit.client.0.smithi096.stdout:6/658: chown d18/d50/d8f/dbb/d63/c91 167035723 1 2022-02-02T18:21:28.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/480: dwrite d29/d2d/d42/f95 [0,4194304] 0 2022-02-02T18:21:28.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/481: chown d29/d40/d6d/d83 2184123 1 2022-02-02T18:21:28.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/562: link d2/df/d14/d11/c64 d2/df/d36/da4/cc1 0 2022-02-02T18:21:28.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/563: write d2/df/d1c/f59 [1042296,85881] 0 2022-02-02T18:21:28.925 INFO:tasks.workunit.client.0.smithi096.stdout:4/628: symlink d3/d4/d20/d26/d36/ld9 0 2022-02-02T18:21:28.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/659: dread d18/d24/f2d [0,4194304] 0 2022-02-02T18:21:28.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/482: read d29/d2d/d47/f6e [3728217,56194] 0 2022-02-02T18:21:28.926 INFO:tasks.workunit.client.0.smithi096.stdout:6/660: dread d18/d24/d73/d79/fd3 [0,4194304] 0 2022-02-02T18:21:28.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/661: creat d18/d50/d9a/fec x:0 0 0 2022-02-02T18:21:28.931 INFO:tasks.workunit.client.0.smithi096.stdout:3/564: creat d2/df/d14/d11/daa/fc2 x:0 0 0 2022-02-02T18:21:28.931 INFO:tasks.workunit.client.0.smithi096.stdout:8/483: creat d29/d2d/d87/f97 x:0 0 0 2022-02-02T18:21:28.932 INFO:tasks.workunit.client.0.smithi096.stdout:3/565: write d2/df/d14/f12 [8259861,60999] 0 2022-02-02T18:21:28.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/662: mkdir d18/d50/d8f/dbb/d63/db3/ded 0 2022-02-02T18:21:28.937 INFO:tasks.workunit.client.0.smithi096.stdout:2/635: rmdir d2/d5e 39 2022-02-02T18:21:28.938 INFO:tasks.workunit.client.0.smithi096.stdout:3/566: creat d2/df/d20/fc3 x:0 0 0 2022-02-02T18:21:28.938 INFO:tasks.workunit.client.0.smithi096.stdout:3/567: write d2/df/da6/fad [1036064,102041] 0 2022-02-02T18:21:28.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/568: readlink d2/df/d20/d33/l6a 0 2022-02-02T18:21:28.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/569: fdatasync d2/d71/f83 0 2022-02-02T18:21:28.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/663: symlink d18/d50/d8f/dbb/lee 0 2022-02-02T18:21:28.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/664: chown d18/l1d 2808 1 2022-02-02T18:21:28.941 INFO:tasks.workunit.client.0.smithi096.stdout:6/665: truncate d18/d50/d8f/dbb/d63/db3/fe1 746980 0 2022-02-02T18:21:28.941 INFO:tasks.workunit.client.0.smithi096.stdout:2/636: rename d2/d6/d1b/f5b to d2/d13/d8e/fc3 0 2022-02-02T18:21:28.942 INFO:tasks.workunit.client.0.smithi096.stdout:6/666: symlink d18/d50/d6d/d95/de8/lef 0 2022-02-02T18:21:28.946 INFO:tasks.workunit.client.0.smithi096.stdout:2/637: creat d2/d13/d43/d51/d5d/fc4 x:0 0 0 2022-02-02T18:21:28.946 INFO:tasks.workunit.client.0.smithi096.stdout:7/572: dwrite d9/df/d16/d25/d98/fae [4194304,4194304] 0 2022-02-02T18:21:28.947 INFO:tasks.workunit.client.0.smithi096.stdout:7/573: stat d9/df/d12/d39/d40/f69 0 2022-02-02T18:21:28.947 INFO:tasks.workunit.client.0.smithi096.stdout:6/667: mknod d18/d50/d8f/dbb/cf0 0 2022-02-02T18:21:28.949 INFO:tasks.workunit.client.0.smithi096.stdout:6/668: mkdir d18/d50/d8f/df1 0 2022-02-02T18:21:28.950 INFO:tasks.workunit.client.0.smithi096.stdout:6/669: mkdir d18/d24/d28/d4a/db8/df2 0 2022-02-02T18:21:28.958 INFO:tasks.workunit.client.0.smithi096.stdout:3/570: rename d2/df/d36/da4 to d2/df/d20/dc4 0 2022-02-02T18:21:28.960 INFO:tasks.workunit.client.0.smithi096.stdout:2/638: rename d2/fae to d2/d13/d43/d51/fc5 0 2022-02-02T18:21:28.961 INFO:tasks.workunit.client.0.smithi096.stdout:3/571: mknod d2/df/d14/d2c/d74/cc5 0 2022-02-02T18:21:28.961 INFO:tasks.workunit.client.0.smithi096.stdout:3/572: fdatasync d2/df/d20/f5b 0 2022-02-02T18:21:28.961 INFO:tasks.workunit.client.0.smithi096.stdout:3/573: write d2/df/d14/d2c/d31/fbb [4683383,49835] 0 2022-02-02T18:21:28.962 INFO:tasks.workunit.client.0.smithi096.stdout:9/594: dwrite d1/f56 [0,4194304] 0 2022-02-02T18:21:28.962 INFO:tasks.workunit.client.0.smithi096.stdout:9/595: chown d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fd5 171242 1 2022-02-02T18:21:28.963 INFO:tasks.workunit.client.0.smithi096.stdout:6/670: rename d18/d24/d28/d4a/ca2 to d18/d24/d73/cf3 0 2022-02-02T18:21:28.965 INFO:tasks.workunit.client.0.smithi096.stdout:2/639: link d2/d2a/l91 d2/d13/d8e/lc6 0 2022-02-02T18:21:28.965 INFO:tasks.workunit.client.0.smithi096.stdout:4/629: dwrite d3/d5a/f87 [0,4194304] 0 2022-02-02T18:21:28.966 INFO:tasks.workunit.client.0.smithi096.stdout:4/630: read d3/d4/d14/d55/f7d [115522,72709] 0 2022-02-02T18:21:28.966 INFO:tasks.workunit.client.0.smithi096.stdout:8/484: dwrite d29/d58/d79/f7c [0,4194304] 0 2022-02-02T18:21:28.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/574: dwrite d9/df/d12/d39/d41/f4f [0,4194304] 0 2022-02-02T18:21:28.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/575: creat d9/df/d47/fc6 x:0 0 0 2022-02-02T18:21:28.978 INFO:tasks.workunit.client.0.smithi096.stdout:7/576: dread d9/fd [4194304,4194304] 0 2022-02-02T18:21:28.980 INFO:tasks.workunit.client.0.smithi096.stdout:6/671: symlink d18/d50/d8f/df1/lf4 0 2022-02-02T18:21:28.982 INFO:tasks.workunit.client.0.smithi096.stdout:2/640: mkdir d2/d13/d42/d71/dad/db0/dc7 0 2022-02-02T18:21:28.982 INFO:tasks.workunit.client.0.smithi096.stdout:2/641: write d2/d5e/d6d/d79/d66/f68 [4543284,45755] 0 2022-02-02T18:21:28.986 INFO:tasks.workunit.client.0.smithi096.stdout:7/577: mknod d9/df/d16/d25/cc7 0 2022-02-02T18:21:28.987 INFO:tasks.workunit.client.0.smithi096.stdout:6/672: mknod d18/d50/d8f/dbb/cf5 0 2022-02-02T18:21:28.987 INFO:tasks.workunit.client.0.smithi096.stdout:7/578: write d9/df/d16/f2a [628408,12439] 0 2022-02-02T18:21:28.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/596: dwrite d1/db/d1c/d2f/f6a [0,4194304] 0 2022-02-02T18:21:28.988 INFO:tasks.workunit.client.0.smithi096.stdout:2/642: rename d2/d5e/d6d/d79/fbb to d2/d6/db/fc8 0 2022-02-02T18:21:28.989 INFO:tasks.workunit.client.0.smithi096.stdout:9/597: write d1/db/d1c/d2f/d78/d11/f2d [2494362,81232] 0 2022-02-02T18:21:28.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/598: fdatasync d1/d39/d8a/d97/fb5 0 2022-02-02T18:21:28.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/599: creat d1/db/fd8 x:0 0 0 2022-02-02T18:21:28.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/600: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fd9 x:0 0 0 2022-02-02T18:21:28.990 INFO:tasks.workunit.client.0.smithi096.stdout:6/673: link d18/d50/d8f/dbb/cf5 d18/d24/d73/d79/cf6 0 2022-02-02T18:21:28.991 INFO:tasks.workunit.client.0.smithi096.stdout:6/674: dread - d18/d24/d28/f78 zero size 2022-02-02T18:21:28.991 INFO:tasks.workunit.client.0.smithi096.stdout:7/579: creat d9/df/d47/d37/d83/db4/fc8 x:0 0 0 2022-02-02T18:21:28.992 INFO:tasks.workunit.client.0.smithi096.stdout:6/675: dread d18/d24/d28/d4a/d9d/fd9 [0,4194304] 0 2022-02-02T18:21:28.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/485: dwrite d29/d2d/f32 [0,4194304] 0 2022-02-02T18:21:28.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/486: write f5 [4187447,57749] 0 2022-02-02T18:21:28.994 INFO:tasks.workunit.client.0.smithi096.stdout:2/643: creat d2/d5e/d6d/d79/fc9 x:0 0 0 2022-02-02T18:21:29.002 INFO:tasks.workunit.client.0.smithi096.stdout:3/574: truncate d2/df/d14/d2c/d31/fbb 1854818 0 2022-02-02T18:21:29.003 INFO:tasks.workunit.client.0.smithi096.stdout:9/601: truncate d1/db/d1c/d2f/f5a 84238 0 2022-02-02T18:21:29.006 INFO:tasks.workunit.client.0.smithi096.stdout:6/676: symlink d18/d50/d8f/dbb/d63/db3/ded/lf7 0 2022-02-02T18:21:29.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/644: dwrite d2/d6/d1b/d48/f4d [0,4194304] 0 2022-02-02T18:21:29.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/645: chown d2/d13/l35 60 1 2022-02-02T18:21:29.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/646: read f1 [256911,89420] 0 2022-02-02T18:21:29.017 INFO:tasks.workunit.client.0.smithi096.stdout:8/487: creat d29/d40/f98 x:0 0 0 2022-02-02T18:21:29.017 INFO:tasks.workunit.client.0.smithi096.stdout:8/488: stat d29/d2d/d47/l8c 0 2022-02-02T18:21:29.019 INFO:tasks.workunit.client.0.smithi096.stdout:5/626: sync 2022-02-02T18:21:29.020 INFO:tasks.workunit.client.0.smithi096.stdout:5/627: unlink db/de/d10/d27/c68 0 2022-02-02T18:21:29.020 INFO:tasks.workunit.client.0.smithi096.stdout:5/628: truncate db/de/d10/d25/fc3 821170 0 2022-02-02T18:21:29.020 INFO:tasks.workunit.client.0.smithi096.stdout:1/583: sync 2022-02-02T18:21:29.020 INFO:tasks.workunit.client.0.smithi096.stdout:1/584: truncate d15/d1b/d26/d72/f90 4395860 0 2022-02-02T18:21:29.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/602: symlink d1/db/d1c/d2f/d78/d11/d3c/lda 0 2022-02-02T18:21:29.021 INFO:tasks.workunit.client.0.smithi096.stdout:3/575: dwrite d2/df/d14/f18 [4194304,4194304] 0 2022-02-02T18:21:29.022 INFO:tasks.workunit.client.0.smithi096.stdout:6/677: symlink d18/d24/d28/lf8 0 2022-02-02T18:21:29.022 INFO:tasks.workunit.client.0.smithi096.stdout:6/678: creat d18/d50/d6d/d95/ff9 x:0 0 0 2022-02-02T18:21:29.025 INFO:tasks.workunit.client.0.smithi096.stdout:8/489: symlink d29/d58/d7a/l99 0 2022-02-02T18:21:29.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/629: mkdir db/d5c/d60/da7/de2 0 2022-02-02T18:21:29.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/630: creat db/de/d2e/d35/fe3 x:0 0 0 2022-02-02T18:21:29.033 INFO:tasks.workunit.client.0.smithi096.stdout:1/585: creat d15/d1b/d26/d72/da3/da7/db6/fd7 x:0 0 0 2022-02-02T18:21:29.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/576: creat d2/df/d1c/db5/fc6 x:0 0 0 2022-02-02T18:21:29.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/577: chown d2/df/d1c/d5d/d69/d43/l46 69616 1 2022-02-02T18:21:29.036 INFO:tasks.workunit.client.0.smithi096.stdout:1/586: write f11 [3733452,74458] 0 2022-02-02T18:21:29.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/587: creat d15/d1b/d28/d2c/d39/d6b/d8a/fd8 x:0 0 0 2022-02-02T18:21:29.038 INFO:tasks.workunit.client.0.smithi096.stdout:9/603: dwrite d1/db/d1c/d2f/d78/d11/f30 [0,4194304] 0 2022-02-02T18:21:29.038 INFO:tasks.workunit.client.0.smithi096.stdout:9/604: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fd9 [739438,53242] 0 2022-02-02T18:21:29.039 INFO:tasks.workunit.client.0.smithi096.stdout:8/490: unlink d29/d40/f8f 0 2022-02-02T18:21:29.040 INFO:tasks.workunit.client.0.smithi096.stdout:8/491: unlink cd 0 2022-02-02T18:21:29.042 INFO:tasks.workunit.client.0.smithi096.stdout:3/578: rmdir d2/df/d14/d16 39 2022-02-02T18:21:29.043 INFO:tasks.workunit.client.0.smithi096.stdout:3/579: readlink d2/df/d14/d66/la1 0 2022-02-02T18:21:29.043 INFO:tasks.workunit.client.0.smithi096.stdout:8/492: read d29/d2d/d47/f6e [2267768,64843] 0 2022-02-02T18:21:29.044 INFO:tasks.workunit.client.0.smithi096.stdout:8/493: chown d29/f2b 1055985894 1 2022-02-02T18:21:29.044 INFO:tasks.workunit.client.0.smithi096.stdout:2/647: rename d2/d6/d76 to d2/d13/d42/d71/dad/db0/dc7/dca 0 2022-02-02T18:21:29.046 INFO:tasks.workunit.client.0.smithi096.stdout:1/588: creat d15/d1b/d28/d2c/d39/fd9 x:0 0 0 2022-02-02T18:21:29.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/580: symlink d2/df/d34/lc7 0 2022-02-02T18:21:29.049 INFO:tasks.workunit.client.0.smithi096.stdout:8/494: symlink d29/d4a/d5b/d81/l9a 0 2022-02-02T18:21:29.051 INFO:tasks.workunit.client.0.smithi096.stdout:5/631: rename db/d5c/d2f/d46/f74 to db/de/d10/d25/d4c/fe4 0 2022-02-02T18:21:29.055 INFO:tasks.workunit.client.0.smithi096.stdout:2/648: rmdir d2/d5e/d6d/db2 0 2022-02-02T18:21:29.056 INFO:tasks.workunit.client.0.smithi096.stdout:9/605: dwrite d1/f34 [0,4194304] 0 2022-02-02T18:21:29.056 INFO:tasks.workunit.client.0.smithi096.stdout:1/589: creat d15/d1b/d28/d2c/d39/d6b/d8a/db9/fda x:0 0 0 2022-02-02T18:21:29.058 INFO:tasks.workunit.client.0.smithi096.stdout:9/606: link d1/db/d1c/d2f/d78/d11/d1e/d66/l91 d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/ldb 0 2022-02-02T18:21:29.058 INFO:tasks.workunit.client.0.smithi096.stdout:1/590: unlink d15/d1b/cb0 0 2022-02-02T18:21:29.059 INFO:tasks.workunit.client.0.smithi096.stdout:1/591: truncate d15/d1b/d28/d2c/d39/d6b/d8a/fa6 5172929 0 2022-02-02T18:21:29.060 INFO:tasks.workunit.client.0.smithi096.stdout:1/592: symlink d15/d1b/d26/d72/ldb 0 2022-02-02T18:21:29.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/607: read d1/f36 [3456079,109037] 0 2022-02-02T18:21:29.064 INFO:tasks.workunit.client.0.smithi096.stdout:1/593: rename d15/d1b/d26/d6f to d15/d1b/d26/d72/da3/da7/ddc 0 2022-02-02T18:21:29.067 INFO:tasks.workunit.client.0.smithi096.stdout:9/608: write d1/db/d1c/d2f/d78/d11/f2d [1617615,84208] 0 2022-02-02T18:21:29.068 INFO:tasks.workunit.client.0.smithi096.stdout:1/594: link f11 d15/d1b/d26/d72/fdd 0 2022-02-02T18:21:29.068 INFO:tasks.workunit.client.0.smithi096.stdout:1/595: fsync d15/d1b/d26/d72/da3/da7/ddc/f82 0 2022-02-02T18:21:29.070 INFO:tasks.workunit.client.0.smithi096.stdout:9/609: rename d1/db/d1c/d2f/d78/d25/dd/f5d to d1/db/d1c/d2f/d78/fdc 0 2022-02-02T18:21:29.073 INFO:tasks.workunit.client.0.smithi096.stdout:9/610: rename d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f1f to d1/db/d1c/d2f/d78/d25/dd/d49/fdd 0 2022-02-02T18:21:29.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/685: sync 2022-02-02T18:21:29.079 INFO:tasks.workunit.client.0.smithi096.stdout:0/686: write d2/db/d10/f33 [881079,58824] 0 2022-02-02T18:21:29.079 INFO:tasks.workunit.client.0.smithi096.stdout:0/687: getdents d2/db/d24/d89/d8f/d95/dc5 0 2022-02-02T18:21:29.083 INFO:tasks.workunit.client.0.smithi096.stdout:3/581: dwrite d2/f9e [0,4194304] 0 2022-02-02T18:21:29.096 INFO:tasks.workunit.client.0.smithi096.stdout:5/632: dwrite db/de/d10/d25/da0/f82 [0,4194304] 0 2022-02-02T18:21:29.099 INFO:tasks.workunit.client.0.smithi096.stdout:8/495: dwrite d29/d2d/f56 [0,4194304] 0 2022-02-02T18:21:29.102 INFO:tasks.workunit.client.0.smithi096.stdout:1/596: dwrite d15/d1b/d28/fc6 [0,4194304] 0 2022-02-02T18:21:29.102 INFO:tasks.workunit.client.0.smithi096.stdout:1/597: write d15/d1b/d26/d72/da3/fd4 [30839,102333] 0 2022-02-02T18:21:29.103 INFO:tasks.workunit.client.0.smithi096.stdout:9/611: dwrite d1/db/d1c/d2f/d78/d11/d1e/d47/fce [0,4194304] 0 2022-02-02T18:21:29.105 INFO:tasks.workunit.client.0.smithi096.stdout:1/598: write d15/d1b/d26/f49 [1410598,10606] 0 2022-02-02T18:21:29.105 INFO:tasks.workunit.client.0.smithi096.stdout:1/599: fsync d15/d1b/d28/d2c/d4f/d51/fc3 0 2022-02-02T18:21:29.105 INFO:tasks.workunit.client.0.smithi096.stdout:2/649: dwrite d2/d2a/f30 [0,4194304] 0 2022-02-02T18:21:29.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/650: fsync d2/d6/d1b/f39 0 2022-02-02T18:21:29.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/651: dread - d2/d29/fa8 zero size 2022-02-02T18:21:29.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/652: truncate d2/d5e/d6d/d79/fc9 224457 0 2022-02-02T18:21:29.106 INFO:tasks.workunit.client.0.smithi096.stdout:3/582: dwrite d2/df/d1c/d5d/d69/d43/d72/f75 [0,4194304] 0 2022-02-02T18:21:29.107 INFO:tasks.workunit.client.0.smithi096.stdout:0/688: rmdir d2/db/d10/d80/d93 39 2022-02-02T18:21:29.108 INFO:tasks.workunit.client.0.smithi096.stdout:0/689: stat d2/db/d24/d89/d8f 0 2022-02-02T18:21:29.108 INFO:tasks.workunit.client.0.smithi096.stdout:0/690: chown d2/db/d37/c92 243348258 1 2022-02-02T18:21:29.108 INFO:tasks.workunit.client.0.smithi096.stdout:0/691: write d2/d1e/f35 [4268605,95506] 0 2022-02-02T18:21:29.108 INFO:tasks.workunit.client.0.smithi096.stdout:2/653: write d2/d5e/f9e [1472971,123941] 0 2022-02-02T18:21:29.109 INFO:tasks.workunit.client.0.smithi096.stdout:2/654: stat d2/d19/d9f 0 2022-02-02T18:21:29.109 INFO:tasks.workunit.client.0.smithi096.stdout:3/583: dread d2/df/d34/f39 [0,4194304] 0 2022-02-02T18:21:29.109 INFO:tasks.workunit.client.0.smithi096.stdout:3/584: fsync d2/df/d34/f39 0 2022-02-02T18:21:29.116 INFO:tasks.workunit.client.0.smithi096.stdout:9/612: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f59 [0,4194304] 0 2022-02-02T18:21:29.116 INFO:tasks.workunit.client.0.smithi096.stdout:9/613: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fc5 [1239922,92095] 0 2022-02-02T18:21:29.125 INFO:tasks.workunit.client.0.smithi096.stdout:1/600: dwrite d15/d1b/d26/d72/f90 [0,4194304] 0 2022-02-02T18:21:29.135 INFO:tasks.workunit.client.0.smithi096.stdout:9/614: dwrite d1/db/d1c/d2f/f54 [0,4194304] 0 2022-02-02T18:21:29.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/633: rename db/d5c/l89 to db/d5c/d2f/d46/le5 0 2022-02-02T18:21:29.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/631: sync 2022-02-02T18:21:29.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/632: write d3/d4/d20/d4d/f54 [848654,14980] 0 2022-02-02T18:21:29.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/633: creat d3/d60/d8d/fda x:0 0 0 2022-02-02T18:21:29.213 INFO:tasks.workunit.client.0.smithi096.stdout:0/692: mknod d2/db/d37/d40/cec 0 2022-02-02T18:21:29.213 INFO:tasks.workunit.client.0.smithi096.stdout:0/693: dread - d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/f98 zero size 2022-02-02T18:21:29.214 INFO:tasks.workunit.client.0.smithi096.stdout:2/655: creat d2/d6/fcb x:0 0 0 2022-02-02T18:21:29.214 INFO:tasks.workunit.client.0.smithi096.stdout:3/585: rmdir d2/df/d20/d33/d58 39 2022-02-02T18:21:29.215 INFO:tasks.workunit.client.0.smithi096.stdout:1/601: link d15/f2a d15/d1b/d26/d72/da3/da7/ddc/d9f/fde 0 2022-02-02T18:21:29.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/615: link d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/ld0 d1/db/d1c/d2f/d78/d25/dd/d49/lde 0 2022-02-02T18:21:29.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/496: link c25 d29/d2d/d42/c9b 0 2022-02-02T18:21:29.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/497: readlink d29/d2d/l3b 0 2022-02-02T18:21:29.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/634: creat d3/d4/d20/fdb x:0 0 0 2022-02-02T18:21:29.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/635: creat d3/d4/d20/d26/d36/d51/fdc x:0 0 0 2022-02-02T18:21:29.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/636: fdatasync d3/d4/f24 0 2022-02-02T18:21:29.237 INFO:tasks.workunit.client.0.smithi096.stdout:8/498: dread d29/d2d/d42/f73 [0,4194304] 0 2022-02-02T18:21:29.240 INFO:tasks.workunit.client.0.smithi096.stdout:0/694: truncate d2/db/d10/f28 221966 0 2022-02-02T18:21:29.241 INFO:tasks.workunit.client.0.smithi096.stdout:2/656: rmdir d2/d19/d9f 0 2022-02-02T18:21:29.242 INFO:tasks.workunit.client.0.smithi096.stdout:2/657: fdatasync d2/d29/fa8 0 2022-02-02T18:21:29.243 INFO:tasks.workunit.client.0.smithi096.stdout:4/637: dread d3/d4/d20/d26/f2f [0,4194304] 0 2022-02-02T18:21:29.243 INFO:tasks.workunit.client.0.smithi096.stdout:3/586: creat d2/df/d1c/d5d/d6d/fc8 x:0 0 0 2022-02-02T18:21:29.244 INFO:tasks.workunit.client.0.smithi096.stdout:3/587: fdatasync d2/df/d14/f30 0 2022-02-02T18:21:29.244 INFO:tasks.workunit.client.0.smithi096.stdout:3/588: fdatasync d2/df/d20/f5b 0 2022-02-02T18:21:29.244 INFO:tasks.workunit.client.0.smithi096.stdout:3/589: stat d2/df/d14/d2c/d74/cc5 0 2022-02-02T18:21:29.245 INFO:tasks.workunit.client.0.smithi096.stdout:6/679: sync 2022-02-02T18:21:29.245 INFO:tasks.workunit.client.0.smithi096.stdout:7/580: sync 2022-02-02T18:21:29.245 INFO:tasks.workunit.client.0.smithi096.stdout:1/602: symlink d15/d1b/d28/d2c/d39/d6b/ldf 0 2022-02-02T18:21:29.249 INFO:tasks.workunit.client.0.smithi096.stdout:9/616: creat d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/fdf x:0 0 0 2022-02-02T18:21:29.249 INFO:tasks.workunit.client.0.smithi096.stdout:9/617: creat d1/db/d48/d69/fe0 x:0 0 0 2022-02-02T18:21:29.250 INFO:tasks.workunit.client.0.smithi096.stdout:0/695: dread d2/db/d10/d27/f2d [0,4194304] 0 2022-02-02T18:21:29.251 INFO:tasks.workunit.client.0.smithi096.stdout:0/696: write d2/db/d10/d80/d93/fb0 [744981,21304] 0 2022-02-02T18:21:29.251 INFO:tasks.workunit.client.0.smithi096.stdout:3/590: dread d2/df/d14/d2c/d74/f7b [0,4194304] 0 2022-02-02T18:21:29.255 INFO:tasks.workunit.client.0.smithi096.stdout:8/499: symlink d29/d2d/d47/l9c 0 2022-02-02T18:21:29.256 INFO:tasks.workunit.client.0.smithi096.stdout:2/658: creat d2/d6/d1b/dc0/fcc x:0 0 0 2022-02-02T18:21:29.256 INFO:tasks.workunit.client.0.smithi096.stdout:2/659: unlink d2/d19/f59 0 2022-02-02T18:21:29.260 INFO:tasks.workunit.client.0.smithi096.stdout:4/638: link d3/d4/d20/f22 d3/d27/fdd 0 2022-02-02T18:21:29.260 INFO:tasks.workunit.client.0.smithi096.stdout:4/639: chown d3/d60/d8d/da7 13 1 2022-02-02T18:21:29.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/697: dread d2/db/d37/d40/d8a/fbf [0,4194304] 0 2022-02-02T18:21:29.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/581: unlink d9/df/d47/d60/da5/lab 0 2022-02-02T18:21:29.266 INFO:tasks.workunit.client.0.smithi096.stdout:6/680: creat d18/ffa x:0 0 0 2022-02-02T18:21:29.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/603: mknod d15/d1b/d28/ce0 0 2022-02-02T18:21:29.270 INFO:tasks.workunit.client.0.smithi096.stdout:9/618: creat d1/fe1 x:0 0 0 2022-02-02T18:21:29.270 INFO:tasks.workunit.client.0.smithi096.stdout:3/591: mknod d2/df/d14/d16/cc9 0 2022-02-02T18:21:29.271 INFO:tasks.workunit.client.0.smithi096.stdout:5/634: sync 2022-02-02T18:21:29.272 INFO:tasks.workunit.client.0.smithi096.stdout:5/635: write db/de/fa2 [1182487,103902] 0 2022-02-02T18:21:29.272 INFO:tasks.workunit.client.0.smithi096.stdout:8/500: creat d29/d40/d6d/d85/f9d x:0 0 0 2022-02-02T18:21:29.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/604: write d15/d1b/f2f [764072,63468] 0 2022-02-02T18:21:29.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/681: dread d18/d24/d28/d3e/f62 [0,4194304] 0 2022-02-02T18:21:29.275 INFO:tasks.workunit.client.0.smithi096.stdout:4/640: unlink d3/d4/d50/cb3 0 2022-02-02T18:21:29.276 INFO:tasks.workunit.client.0.smithi096.stdout:9/619: creat d1/db/d1c/d2f/dc8/fe2 x:0 0 0 2022-02-02T18:21:29.278 INFO:tasks.workunit.client.0.smithi096.stdout:3/592: creat d2/df/d1c/d5d/da3/fca x:0 0 0 2022-02-02T18:21:29.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/593: read d2/df/d1c/f59 [558238,86285] 0 2022-02-02T18:21:29.280 INFO:tasks.workunit.client.0.smithi096.stdout:8/501: symlink d29/d2d/d47/l9e 0 2022-02-02T18:21:29.281 INFO:tasks.workunit.client.0.smithi096.stdout:1/605: creat d15/d1b/d28/d47/fe1 x:0 0 0 2022-02-02T18:21:29.281 INFO:tasks.workunit.client.0.smithi096.stdout:8/502: creat d29/d4e/f9f x:0 0 0 2022-02-02T18:21:29.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/641: write d3/d4/d14/f2d [3861659,84546] 0 2022-02-02T18:21:29.285 INFO:tasks.workunit.client.0.smithi096.stdout:2/660: dwrite d2/d5e/f9e [0,4194304] 0 2022-02-02T18:21:29.285 INFO:tasks.workunit.client.0.smithi096.stdout:7/582: rename d9/df/d47/d19/l2c to d9/lc9 0 2022-02-02T18:21:29.291 INFO:tasks.workunit.client.0.smithi096.stdout:1/606: creat d15/d1b/d26/d72/dce/fe2 x:0 0 0 2022-02-02T18:21:29.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/661: rename d2/d6/d1b/l3c to d2/d6/lcd 0 2022-02-02T18:21:29.297 INFO:tasks.workunit.client.0.smithi096.stdout:2/662: truncate d2/d13/d43/d80/fb9 393971 0 2022-02-02T18:21:29.297 INFO:tasks.workunit.client.0.smithi096.stdout:5/636: dwrite f6 [0,4194304] 0 2022-02-02T18:21:29.297 INFO:tasks.workunit.client.0.smithi096.stdout:5/637: chown f6 1218333 1 2022-02-02T18:21:29.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/638: mkdir db/de/d10/d25/d4c/de6 0 2022-02-02T18:21:29.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/698: dwrite d2/db/d24/d89/d8f/da1/de9/f82 [0,4194304] 0 2022-02-02T18:21:29.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/699: dread - d2/db/d37/fd7 zero size 2022-02-02T18:21:29.311 INFO:tasks.workunit.client.0.smithi096.stdout:0/700: creat d2/db/d7f/fed x:0 0 0 2022-02-02T18:21:29.324 INFO:tasks.workunit.client.0.smithi096.stdout:7/583: dread d9/df/d12/f32 [0,4194304] 0 2022-02-02T18:21:29.326 INFO:tasks.workunit.client.0.smithi096.stdout:7/584: creat d9/df/d12/d14/fca x:0 0 0 2022-02-02T18:21:29.326 INFO:tasks.workunit.client.0.smithi096.stdout:7/585: mknod d9/df/d12/d14/d82/ccb 0 2022-02-02T18:21:29.335 INFO:tasks.workunit.client.0.smithi096.stdout:6/682: dwrite d18/d24/d28/d3e/f5f [0,4194304] 0 2022-02-02T18:21:29.338 INFO:tasks.workunit.client.0.smithi096.stdout:6/683: rename d18/d50/d6d/d95 to d18/d24/d73/dfb 0 2022-02-02T18:21:29.362 INFO:tasks.workunit.client.0.smithi096.stdout:4/642: dwrite d3/d4/d20/fdb [0,4194304] 0 2022-02-02T18:21:29.364 INFO:tasks.workunit.client.0.smithi096.stdout:3/594: dwrite d2/df/d14/d2c/d31/fbb [0,4194304] 0 2022-02-02T18:21:29.365 INFO:tasks.workunit.client.0.smithi096.stdout:2/663: dwrite d2/d13/d43/d51/fc1 [0,4194304] 0 2022-02-02T18:21:29.367 INFO:tasks.workunit.client.0.smithi096.stdout:2/664: write d2/d6/d1b/d8a/f92 [920288,72949] 0 2022-02-02T18:21:29.367 INFO:tasks.workunit.client.0.smithi096.stdout:8/503: dwrite d29/d2d/f77 [0,4194304] 0 2022-02-02T18:21:29.367 INFO:tasks.workunit.client.0.smithi096.stdout:1/607: dwrite d15/d1b/d26/d72/da3/da7/db6/fd7 [0,4194304] 0 2022-02-02T18:21:29.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/608: write d15/d1b/d28/d2c/d39/d6b/d8a/fb3 [243662,20390] 0 2022-02-02T18:21:29.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/609: dread - d15/d1b/d28/d47/fe1 zero size 2022-02-02T18:21:29.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/595: symlink d2/df/d14/dbe/lcb 0 2022-02-02T18:21:29.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/596: chown d2/df/d14/d11/c64 8075877 1 2022-02-02T18:21:29.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/597: readlink d2/df/d34/lc7 0 2022-02-02T18:21:29.369 INFO:tasks.workunit.client.0.smithi096.stdout:3/598: chown d2/df/d14/d16/l38 19316 1 2022-02-02T18:21:29.370 INFO:tasks.workunit.client.0.smithi096.stdout:5/639: dwrite db/de/f54 [0,4194304] 0 2022-02-02T18:21:29.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/701: dwrite d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/fa7 [0,4194304] 0 2022-02-02T18:21:29.370 INFO:tasks.workunit.client.0.smithi096.stdout:5/640: fsync db/d5c/d60/da7/fc6 0 2022-02-02T18:21:29.371 INFO:tasks.workunit.client.0.smithi096.stdout:0/702: fdatasync d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/fc2 0 2022-02-02T18:21:29.372 INFO:tasks.workunit.client.0.smithi096.stdout:0/703: write d2/db/fc7 [643878,83158] 0 2022-02-02T18:21:29.379 INFO:tasks.workunit.client.0.smithi096.stdout:7/586: dwrite d9/df/d12/d39/d4e/fc0 [0,4194304] 0 2022-02-02T18:21:29.382 INFO:tasks.workunit.client.0.smithi096.stdout:1/610: dread d15/d1b/d26/f42 [0,4194304] 0 2022-02-02T18:21:29.383 INFO:tasks.workunit.client.0.smithi096.stdout:2/665: dread d2/d6/d1b/d3a/f7f [0,4194304] 0 2022-02-02T18:21:29.388 INFO:tasks.workunit.client.0.smithi096.stdout:0/704: symlink d2/db/d10/lee 0 2022-02-02T18:21:29.389 INFO:tasks.workunit.client.0.smithi096.stdout:1/611: creat d15/d1b/d26/d72/fe3 x:0 0 0 2022-02-02T18:21:29.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/666: creat d2/d29/fce x:0 0 0 2022-02-02T18:21:29.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/641: mknod db/de/d2e/ce7 0 2022-02-02T18:21:29.391 INFO:tasks.workunit.client.0.smithi096.stdout:5/642: chown db/de/d10/d27/d83/fac 0 1 2022-02-02T18:21:29.391 INFO:tasks.workunit.client.0.smithi096.stdout:5/643: stat db/d5c/d2f/d46 0 2022-02-02T18:21:29.391 INFO:tasks.workunit.client.0.smithi096.stdout:5/644: truncate db/de/d10/d27/d83/fac 1259912 0 2022-02-02T18:21:29.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/705: creat d2/db/d24/d89/d8f/d95/dcd/fef x:0 0 0 2022-02-02T18:21:29.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/667: rename d2/d13/d8e/l97 to d2/lcf 0 2022-02-02T18:21:29.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/668: readlink d2/d2a/l91 0 2022-02-02T18:21:29.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/669: chown d2/d6/d1b/d3a/l57 173015077 1 2022-02-02T18:21:29.394 INFO:tasks.workunit.client.0.smithi096.stdout:5/645: symlink db/de/d10/d25/d4c/de6/le8 0 2022-02-02T18:21:29.395 INFO:tasks.workunit.client.0.smithi096.stdout:8/504: dwrite d29/f3a [0,4194304] 0 2022-02-02T18:21:29.396 INFO:tasks.workunit.client.0.smithi096.stdout:8/505: readlink d29/d2d/d47/l9c 0 2022-02-02T18:21:29.396 INFO:tasks.workunit.client.0.smithi096.stdout:3/599: dwrite d2/df/d14/f30 [0,4194304] 0 2022-02-02T18:21:29.396 INFO:tasks.workunit.client.0.smithi096.stdout:4/643: dwrite d3/d4/d20/d4d/f4e [0,4194304] 0 2022-02-02T18:21:29.396 INFO:tasks.workunit.client.0.smithi096.stdout:3/600: write d2/df/d14/d11/daa/fc2 [195652,29282] 0 2022-02-02T18:21:29.397 INFO:tasks.workunit.client.0.smithi096.stdout:3/601: write d2/df/d14/d2c/d31/f40 [4831088,73188] 0 2022-02-02T18:21:29.399 INFO:tasks.workunit.client.0.smithi096.stdout:5/646: write db/d5c/f5e [870806,40528] 0 2022-02-02T18:21:29.399 INFO:tasks.workunit.client.0.smithi096.stdout:5/647: truncate db/d5c/f9c 1036778 0 2022-02-02T18:21:29.402 INFO:tasks.workunit.client.0.smithi096.stdout:3/602: symlink d2/df/d1c/d5d/lcc 0 2022-02-02T18:21:29.412 INFO:tasks.workunit.client.0.smithi096.stdout:5/648: mknod db/de/d10/d25/d4c/ce9 0 2022-02-02T18:21:29.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/506: getdents d29/d4e 0 2022-02-02T18:21:29.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/507: read f1f [537807,57931] 0 2022-02-02T18:21:29.417 INFO:tasks.workunit.client.0.smithi096.stdout:3/603: mkdir d2/df/d36/d8d/dcd 0 2022-02-02T18:21:29.418 INFO:tasks.workunit.client.0.smithi096.stdout:8/508: symlink d29/d2d/d87/la0 0 2022-02-02T18:21:29.423 INFO:tasks.workunit.client.0.smithi096.stdout:5/649: read db/de/d2e/f51 [1208410,109710] 0 2022-02-02T18:21:29.424 INFO:tasks.workunit.client.0.smithi096.stdout:5/650: chown db/de/d2e/f51 1372610 1 2022-02-02T18:21:29.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/604: mkdir d2/df/d20/d33/d58/dce 0 2022-02-02T18:21:29.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/605: chown d2/df/d14/d16/fb0 9826542 1 2022-02-02T18:21:29.426 INFO:tasks.workunit.client.0.smithi096.stdout:5/651: read db/d5c/d2f/f90 [137548,77093] 0 2022-02-02T18:21:29.427 INFO:tasks.workunit.client.0.smithi096.stdout:1/612: dwrite d15/d1b/d28/d2c/d39/d71/f7d [0,4194304] 0 2022-02-02T18:21:29.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/606: write d2/d71/fbd [8183641,42354] 0 2022-02-02T18:21:29.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/607: stat d2/df/d1c/d5d/c6b 0 2022-02-02T18:21:29.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/608: fsync d2/df/d14/d16/fb0 0 2022-02-02T18:21:29.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/609: chown d2/df/d14/d2c/d31/l65 4 1 2022-02-02T18:21:29.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/652: unlink db/de/d2e/d35/fd2 0 2022-02-02T18:21:29.432 INFO:tasks.workunit.client.0.smithi096.stdout:1/613: dread d15/d1b/d28/f58 [0,4194304] 0 2022-02-02T18:21:29.432 INFO:tasks.workunit.client.0.smithi096.stdout:1/614: truncate d15/d4d/d8e/fbb 2954013 0 2022-02-02T18:21:29.433 INFO:tasks.workunit.client.0.smithi096.stdout:0/706: dwrite d2/db/d37/fcb [0,4194304] 0 2022-02-02T18:21:29.434 INFO:tasks.workunit.client.0.smithi096.stdout:4/644: dwrite d3/fb4 [0,4194304] 0 2022-02-02T18:21:29.434 INFO:tasks.workunit.client.0.smithi096.stdout:4/645: write d3/d60/d8d/f9a [25378,123900] 0 2022-02-02T18:21:29.435 INFO:tasks.workunit.client.0.smithi096.stdout:1/615: creat d15/d1b/d28/d2c/d39/d6b/fe4 x:0 0 0 2022-02-02T18:21:29.435 INFO:tasks.workunit.client.0.smithi096.stdout:1/616: chown d15/d4d/ld5 1466 1 2022-02-02T18:21:29.435 INFO:tasks.workunit.client.0.smithi096.stdout:2/670: dwrite d2/d13/d43/d51/f69 [0,4194304] 0 2022-02-02T18:21:29.438 INFO:tasks.workunit.client.0.smithi096.stdout:9/620: sync 2022-02-02T18:21:29.438 INFO:tasks.workunit.client.0.smithi096.stdout:9/621: dread - d1/db/d1c/d2f/d78/d11/d1e/d66/fc3 zero size 2022-02-02T18:21:29.440 INFO:tasks.workunit.client.0.smithi096.stdout:0/707: mknod d2/db/d10/cf0 0 2022-02-02T18:21:29.441 INFO:tasks.workunit.client.0.smithi096.stdout:0/708: chown d2/db/d10/d27/ld3 33489 1 2022-02-02T18:21:29.443 INFO:tasks.workunit.client.0.smithi096.stdout:1/617: mkdir d15/d1b/d28/d2c/d39/de5 0 2022-02-02T18:21:29.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/618: chown d15/d1b/d26/d59/laf 17288 1 2022-02-02T18:21:29.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/619: creat d15/d4d/d8e/fe6 x:0 0 0 2022-02-02T18:21:29.446 INFO:tasks.workunit.client.0.smithi096.stdout:2/671: mkdir d2/d6/d1b/dd0 0 2022-02-02T18:21:29.447 INFO:tasks.workunit.client.0.smithi096.stdout:2/672: dread - d2/d29/fce zero size 2022-02-02T18:21:29.448 INFO:tasks.workunit.client.0.smithi096.stdout:0/709: symlink d2/db/d24/d89/d8f/d95/dcd/lf1 0 2022-02-02T18:21:29.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/620: rename d15/d1b/f1c to d15/d1b/d26/d59/fe7 0 2022-02-02T18:21:29.451 INFO:tasks.workunit.client.0.smithi096.stdout:1/621: chown d15/d1b 1008000 1 2022-02-02T18:21:29.452 INFO:tasks.workunit.client.0.smithi096.stdout:2/673: truncate d2/d5e/d6d/d79/d66/fa6 903375 0 2022-02-02T18:21:29.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/622: rmdir d1/db/d63/da2 39 2022-02-02T18:21:29.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/623: fdatasync d1/db/d1c/d2f/d78/d11/d3c/f79 0 2022-02-02T18:21:29.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/624: stat d1/fe1 0 2022-02-02T18:21:29.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/509: dwrite fc [0,4194304] 0 2022-02-02T18:21:29.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/510: chown d29/d58/d7a 33528256 1 2022-02-02T18:21:29.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/511: fdatasync d29/d2d/f48 0 2022-02-02T18:21:29.456 INFO:tasks.workunit.client.0.smithi096.stdout:1/622: link d15/d1b/d28/d2c/c41 d15/d1b/d26/d72/ce8 0 2022-02-02T18:21:29.456 INFO:tasks.workunit.client.0.smithi096.stdout:1/623: fsync d15/d1b/d28/d47/f79 0 2022-02-02T18:21:29.457 INFO:tasks.workunit.client.0.smithi096.stdout:2/674: symlink d2/d5e/d6d/ld1 0 2022-02-02T18:21:29.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/653: dwrite db/de/d10/f15 [0,4194304] 0 2022-02-02T18:21:29.458 INFO:tasks.workunit.client.0.smithi096.stdout:5/654: getdents db/de/d10/d25/d4c/dd8 0 2022-02-02T18:21:29.461 INFO:tasks.workunit.client.0.smithi096.stdout:3/610: dwrite d2/df/d20/d4a/f62 [0,4194304] 0 2022-02-02T18:21:29.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/655: dread db/de/fa2 [0,4194304] 0 2022-02-02T18:21:29.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/512: symlink d29/d2d/d47/la1 0 2022-02-02T18:21:29.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/513: creat d29/d2d/d47/fa2 x:0 0 0 2022-02-02T18:21:29.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/675: mkdir d2/d6/dd2 0 2022-02-02T18:21:29.465 INFO:tasks.workunit.client.0.smithi096.stdout:5/656: write db/d20/f29 [4876791,31352] 0 2022-02-02T18:21:29.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/611: mkdir d2/df/d20/d33/d58/dce/dcf 0 2022-02-02T18:21:29.472 INFO:tasks.workunit.client.0.smithi096.stdout:0/710: truncate d2/db/d37/fcb 3929718 0 2022-02-02T18:21:29.472 INFO:tasks.workunit.client.0.smithi096.stdout:0/711: dread - d2/d62/fc3 zero size 2022-02-02T18:21:29.472 INFO:tasks.workunit.client.0.smithi096.stdout:0/712: chown d2/db/d24/d89/d8f/d95/dc5 97533 1 2022-02-02T18:21:29.473 INFO:tasks.workunit.client.0.smithi096.stdout:0/713: fsync d2/db/d24/d89/d8f/da1/de9/f82 0 2022-02-02T18:21:29.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/514: symlink d29/d40/d6d/la3 0 2022-02-02T18:21:29.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/515: fdatasync f1f 0 2022-02-02T18:21:29.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/516: fdatasync d29/d4a/d5b/f64 0 2022-02-02T18:21:29.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/657: mknod db/de/d10/d25/cea 0 2022-02-02T18:21:29.482 INFO:tasks.workunit.client.0.smithi096.stdout:3/612: rename d2/df/d20/d33/l6a to d2/df/d20/d33/d58/dce/dcf/ld0 0 2022-02-02T18:21:29.482 INFO:tasks.workunit.client.0.smithi096.stdout:5/658: rename db to db/da1/dcc/deb 22 2022-02-02T18:21:29.482 INFO:tasks.workunit.client.0.smithi096.stdout:5/659: creat db/de/d10/d27/d83/fec x:0 0 0 2022-02-02T18:21:29.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/624: dwrite d15/f2e [0,4194304] 0 2022-02-02T18:21:29.485 INFO:tasks.workunit.client.0.smithi096.stdout:0/714: mknod d2/db/d24/d4d/cf2 0 2022-02-02T18:21:29.485 INFO:tasks.workunit.client.0.smithi096.stdout:3/613: dread d2/df/d20/d33/d58/d7c/fa5 [0,4194304] 0 2022-02-02T18:21:29.486 INFO:tasks.workunit.client.0.smithi096.stdout:8/517: unlink f22 0 2022-02-02T18:21:29.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/660: creat db/dbd/fed x:0 0 0 2022-02-02T18:21:29.490 INFO:tasks.workunit.client.0.smithi096.stdout:2/676: dwrite d2/d13/d43/d51/fc1 [0,4194304] 0 2022-02-02T18:21:29.491 INFO:tasks.workunit.client.0.smithi096.stdout:1/625: mkdir d15/d1b/d26/d72/de9 0 2022-02-02T18:21:29.492 INFO:tasks.workunit.client.0.smithi096.stdout:1/626: creat d15/d1b/d28/d2c/d39/d71/fea x:0 0 0 2022-02-02T18:21:29.492 INFO:tasks.workunit.client.0.smithi096.stdout:9/625: dwrite d1/db/d1c/d2f/f54 [0,4194304] 0 2022-02-02T18:21:29.493 INFO:tasks.workunit.client.0.smithi096.stdout:0/715: rename c0 to d2/db/d24/cf3 0 2022-02-02T18:21:29.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/614: mkdir d2/df/d1c/d5d/dbf/dd1 0 2022-02-02T18:21:29.493 INFO:tasks.workunit.client.0.smithi096.stdout:2/677: mknod d2/d19/d86/cd3 0 2022-02-02T18:21:29.496 INFO:tasks.workunit.client.0.smithi096.stdout:9/626: mkdir d1/db/d48/de3 0 2022-02-02T18:21:29.497 INFO:tasks.workunit.client.0.smithi096.stdout:9/627: write d1/db/d1c/d2f/f5a [514718,9119] 0 2022-02-02T18:21:29.504 INFO:tasks.workunit.client.0.smithi096.stdout:2/678: read d2/d6/d1b/d3a/f44 [2634419,74516] 0 2022-02-02T18:21:29.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/716: rmdir d2/d62 39 2022-02-02T18:21:29.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/679: unlink d2/d13/f64 0 2022-02-02T18:21:29.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/680: fdatasync d2/f72 0 2022-02-02T18:21:29.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/681: stat d2/d5e/d6d/fb6 0 2022-02-02T18:21:29.514 INFO:tasks.workunit.client.0.smithi096.stdout:6/684: sync 2022-02-02T18:21:29.515 INFO:tasks.workunit.client.0.smithi096.stdout:9/628: dread d1/d39/d8a/d97/fb5 [0,4194304] 0 2022-02-02T18:21:29.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/685: link d18/d50/c96 d18/d24/d73/dfb/cfc 0 2022-02-02T18:21:29.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/629: mkdir d1/de4 0 2022-02-02T18:21:29.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/630: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fd9 [748173,9400] 0 2022-02-02T18:21:29.526 INFO:tasks.workunit.client.0.smithi096.stdout:8/518: dwrite f1f [0,4194304] 0 2022-02-02T18:21:29.526 INFO:tasks.workunit.client.0.smithi096.stdout:6/686: unlink d18/d24/d28/d3e/f44 0 2022-02-02T18:21:29.528 INFO:tasks.workunit.client.0.smithi096.stdout:5/661: dwrite db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:29.530 INFO:tasks.workunit.client.0.smithi096.stdout:8/519: creat d29/fa4 x:0 0 0 2022-02-02T18:21:29.532 INFO:tasks.workunit.client.0.smithi096.stdout:6/687: mknod d18/d50/d8f/dbb/d63/dc2/cfd 0 2022-02-02T18:21:29.532 INFO:tasks.workunit.client.0.smithi096.stdout:6/688: write d18/d50/d8f/dbb/f43 [2464543,53243] 0 2022-02-02T18:21:29.533 INFO:tasks.workunit.client.0.smithi096.stdout:5/662: write db/de/d10/d80/fe1 [1867658,43869] 0 2022-02-02T18:21:29.534 INFO:tasks.workunit.client.0.smithi096.stdout:8/520: mkdir d29/d2d/d87/da5 0 2022-02-02T18:21:29.535 INFO:tasks.workunit.client.0.smithi096.stdout:2/682: dwrite d2/d13/d43/d51/fc1 [0,4194304] 0 2022-02-02T18:21:29.535 INFO:tasks.workunit.client.0.smithi096.stdout:2/683: chown d2/d13/d42/d71/fac 196528 1 2022-02-02T18:21:29.535 INFO:tasks.workunit.client.0.smithi096.stdout:9/631: rename d1/db/d48/d69 to d1/db/d48/de3/de5 0 2022-02-02T18:21:29.536 INFO:tasks.workunit.client.0.smithi096.stdout:5/663: getdents db/de/d10/d80 0 2022-02-02T18:21:29.537 INFO:tasks.workunit.client.0.smithi096.stdout:8/521: creat d29/d4a/d5b/fa6 x:0 0 0 2022-02-02T18:21:29.538 INFO:tasks.workunit.client.0.smithi096.stdout:6/689: rename d18/d50/d8f/dbb/d63/ld0 to d18/d50/d6d/lfe 0 2022-02-02T18:21:29.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/632: symlink d1/db/d1c/d2f/dac/le6 0 2022-02-02T18:21:29.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/633: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/fe7 x:0 0 0 2022-02-02T18:21:29.540 INFO:tasks.workunit.client.0.smithi096.stdout:5/664: creat db/de/d10/d80/fee x:0 0 0 2022-02-02T18:21:29.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/522: write d29/d40/f5c [3816003,111667] 0 2022-02-02T18:21:29.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/523: chown d29/d4a/d5b/fa6 69435680 1 2022-02-02T18:21:29.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/524: readlink d29/d4a/d5b/d81/l9a 0 2022-02-02T18:21:29.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/525: stat f1c 0 2022-02-02T18:21:29.542 INFO:tasks.workunit.client.0.smithi096.stdout:1/627: dwrite d15/f2e [4194304,4194304] 0 2022-02-02T18:21:29.542 INFO:tasks.workunit.client.0.smithi096.stdout:6/690: rename c1 to d18/d24/d28/d4a/d9d/cff 0 2022-02-02T18:21:29.543 INFO:tasks.workunit.client.0.smithi096.stdout:6/691: chown d18/d24/d73/cf3 805948 1 2022-02-02T18:21:29.543 INFO:tasks.workunit.client.0.smithi096.stdout:6/692: chown d18/d24/f8e 29350537 1 2022-02-02T18:21:29.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/615: dwrite d2/df/d36/f68 [0,4194304] 0 2022-02-02T18:21:29.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/717: dwrite d2/db/d24/d89/d8f/d95/dcd/fef [0,4194304] 0 2022-02-02T18:21:29.545 INFO:tasks.workunit.client.0.smithi096.stdout:9/634: creat d1/db/d1c/d2f/d78/d11/d1e/d38/fe8 x:0 0 0 2022-02-02T18:21:29.545 INFO:tasks.workunit.client.0.smithi096.stdout:9/635: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f5b 1 1 2022-02-02T18:21:29.552 INFO:tasks.workunit.client.0.smithi096.stdout:8/526: mkdir d29/da7 0 2022-02-02T18:21:29.553 INFO:tasks.workunit.client.0.smithi096.stdout:1/628: mknod d15/d1b/d28/ceb 0 2022-02-02T18:21:29.556 INFO:tasks.workunit.client.0.smithi096.stdout:5/665: rename db/d5c/d60/da3 to db/de/d10/d25/d4c/dd8/def 0 2022-02-02T18:21:29.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/616: creat d2/df/fd2 x:0 0 0 2022-02-02T18:21:29.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/718: symlink d2/db/d37/d40/lf4 0 2022-02-02T18:21:29.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/719: stat d2/db/fc7 0 2022-02-02T18:21:29.562 INFO:tasks.workunit.client.0.smithi096.stdout:2/684: dwrite d2/d6/fa [0,4194304] 0 2022-02-02T18:21:29.562 INFO:tasks.workunit.client.0.smithi096.stdout:2/685: readlink d2/d19/lb1 0 2022-02-02T18:21:29.563 INFO:tasks.workunit.client.0.smithi096.stdout:8/527: mknod d29/d2d/d87/ca8 0 2022-02-02T18:21:29.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/528: creat d29/d2d/d87/fa9 x:0 0 0 2022-02-02T18:21:29.565 INFO:tasks.workunit.client.0.smithi096.stdout:9/636: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f86 [0,4194304] 0 2022-02-02T18:21:29.566 INFO:tasks.workunit.client.0.smithi096.stdout:3/617: truncate d2/df/f3e 3812887 0 2022-02-02T18:21:29.572 INFO:tasks.workunit.client.0.smithi096.stdout:2/686: link d2/d13/d43/d51/d5d/fc4 d2/d5e/d6d/d79/d81/fd4 0 2022-02-02T18:21:29.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/637: mknod d1/db/d1c/ce9 0 2022-02-02T18:21:29.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/638: chown d1/db/d1c 342 1 2022-02-02T18:21:29.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/639: truncate d1/db/d1c/d2f/d78/d11/fb1 265069 0 2022-02-02T18:21:29.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/640: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f57 zero size 2022-02-02T18:21:29.574 INFO:tasks.workunit.client.0.smithi096.stdout:9/641: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f90 zero size 2022-02-02T18:21:29.575 INFO:tasks.workunit.client.0.smithi096.stdout:1/629: getdents d15/d1b/d28/d2c/d4f 0 2022-02-02T18:21:29.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/687: stat d2/d6/lcd 0 2022-02-02T18:21:29.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/688: chown d2/d13/d43/d51/d5d/fc4 43298 1 2022-02-02T18:21:29.576 INFO:tasks.workunit.client.0.smithi096.stdout:9/642: mknod d1/d39/cea 0 2022-02-02T18:21:29.581 INFO:tasks.workunit.client.0.smithi096.stdout:9/643: mkdir d1/db/d48/de3/de5/deb 0 2022-02-02T18:21:29.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/630: write f11 [836943,66513] 0 2022-02-02T18:21:29.594 INFO:tasks.workunit.client.0.smithi096.stdout:0/720: dwrite d2/d1e/fcc [0,4194304] 0 2022-02-02T18:21:29.595 INFO:tasks.workunit.client.0.smithi096.stdout:9/644: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb [0,4194304] 0 2022-02-02T18:21:29.599 INFO:tasks.workunit.client.0.smithi096.stdout:9/645: truncate d1/db/d1c/f84 119937 0 2022-02-02T18:21:29.600 INFO:tasks.workunit.client.0.smithi096.stdout:9/646: creat d1/db/d1c/d2f/d78/d11/d1e/d38/fec x:0 0 0 2022-02-02T18:21:29.600 INFO:tasks.workunit.client.0.smithi096.stdout:9/647: truncate d1/db/d1c/d2f/d78/d25/d8e/fb8 105221 0 2022-02-02T18:21:29.600 INFO:tasks.workunit.client.0.smithi096.stdout:9/648: fdatasync d1/f56 0 2022-02-02T18:21:29.600 INFO:tasks.workunit.client.0.smithi096.stdout:9/649: fsync d1/db/d1c/d2f/d78/d11/d1e/f53 0 2022-02-02T18:21:29.601 INFO:tasks.workunit.client.0.smithi096.stdout:6/693: dwrite d18/d24/d28/d3e/fd7 [4194304,4194304] 0 2022-02-02T18:21:29.601 INFO:tasks.workunit.client.0.smithi096.stdout:1/631: dread d15/d1b/d28/d47/f5c [0,4194304] 0 2022-02-02T18:21:29.602 INFO:tasks.workunit.client.0.smithi096.stdout:1/632: fsync d15/d1b/d28/d2c/d39/d6b/fe4 0 2022-02-02T18:21:29.602 INFO:tasks.workunit.client.0.smithi096.stdout:1/633: chown d15/d1b/l4b 1580 1 2022-02-02T18:21:29.602 INFO:tasks.workunit.client.0.smithi096.stdout:0/721: dread d2/db/d37/d40/d8a/fbf [0,4194304] 0 2022-02-02T18:21:29.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/650: creat d1/db/d48/de3/de5/deb/fed x:0 0 0 2022-02-02T18:21:29.605 INFO:tasks.workunit.client.0.smithi096.stdout:6/694: symlink d18/d50/d8f/dbb/d63/l100 0 2022-02-02T18:21:29.606 INFO:tasks.workunit.client.0.smithi096.stdout:3/618: dwrite d2/df/d14/f18 [4194304,4194304] 0 2022-02-02T18:21:29.608 INFO:tasks.workunit.client.0.smithi096.stdout:0/722: rmdir d2/db/d10/d80/d93/da3/ddc 39 2022-02-02T18:21:29.608 INFO:tasks.workunit.client.0.smithi096.stdout:2/689: dwrite d2/d6/d1b/f39 [0,4194304] 0 2022-02-02T18:21:29.609 INFO:tasks.workunit.client.0.smithi096.stdout:1/634: rename d15/d1b/d26/l3d to d15/lec 0 2022-02-02T18:21:29.609 INFO:tasks.workunit.client.0.smithi096.stdout:1/635: write d15/d4d/fc7 [527632,47596] 0 2022-02-02T18:21:29.609 INFO:tasks.workunit.client.0.smithi096.stdout:1/636: chown d15/d1b/d26/d59 439 1 2022-02-02T18:21:29.610 INFO:tasks.workunit.client.0.smithi096.stdout:0/723: read d2/d1e/d67/f70 [1232194,17544] 0 2022-02-02T18:21:29.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/651: mkdir d1/d39/d8a/d97/dee 0 2022-02-02T18:21:29.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/666: dwrite db/de/d10/d27/fd7 [0,4194304] 0 2022-02-02T18:21:29.611 INFO:tasks.workunit.client.0.smithi096.stdout:8/529: dwrite f19 [0,4194304] 0 2022-02-02T18:21:29.612 INFO:tasks.workunit.client.0.smithi096.stdout:9/652: write d1/db/d1c/d2f/d78/d11/d1e/d38/f7f [837651,41117] 0 2022-02-02T18:21:29.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/587: sync 2022-02-02T18:21:29.613 INFO:tasks.workunit.client.0.smithi096.stdout:4/646: sync 2022-02-02T18:21:29.614 INFO:tasks.workunit.client.0.smithi096.stdout:4/647: stat d3/d4/d20/d26/f34 0 2022-02-02T18:21:29.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/530: dread d29/f2b [0,4194304] 0 2022-02-02T18:21:29.616 INFO:tasks.workunit.client.0.smithi096.stdout:2/690: dread d2/d6/d1b/f89 [0,4194304] 0 2022-02-02T18:21:29.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/691: write d2/d6/fcb [200770,127319] 0 2022-02-02T18:21:29.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/648: mkdir d3/d4/d20/d26/d36/d88/dde 0 2022-02-02T18:21:29.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/653: symlink d1/db/d1c/d2f/d78/d25/dd/lef 0 2022-02-02T18:21:29.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/654: write d1/db/d1c/d2f/d78/d11/d1e/d47/fd3 [818303,57832] 0 2022-02-02T18:21:29.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/655: stat d1/db/d1c/d2f/d78/d11/d1e/d47/fce 0 2022-02-02T18:21:29.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/649: truncate d3/d4/d20/f22 1209857 0 2022-02-02T18:21:29.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/650: fdatasync d3/f32 0 2022-02-02T18:21:29.632 INFO:tasks.workunit.client.0.smithi096.stdout:5/667: write db/de/d10/d80/fb0 [148520,9971] 0 2022-02-02T18:21:29.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/531: write f23 [3580177,28326] 0 2022-02-02T18:21:29.634 INFO:tasks.workunit.client.0.smithi096.stdout:4/651: write d3/f10 [2438675,20274] 0 2022-02-02T18:21:29.638 INFO:tasks.workunit.client.0.smithi096.stdout:8/532: symlink d29/d58/laa 0 2022-02-02T18:21:29.640 INFO:tasks.workunit.client.0.smithi096.stdout:8/533: mknod d29/d40/d6d/d83/cab 0 2022-02-02T18:21:29.640 INFO:tasks.workunit.client.0.smithi096.stdout:8/534: write d29/d4e/f9f [582375,30469] 0 2022-02-02T18:21:29.641 INFO:tasks.workunit.client.0.smithi096.stdout:9/656: dread d1/db/d1c/d2f/f6a [0,4194304] 0 2022-02-02T18:21:29.641 INFO:tasks.workunit.client.0.smithi096.stdout:9/657: chown d1/db/d1c/d2f/dc8 1 1 2022-02-02T18:21:29.642 INFO:tasks.workunit.client.0.smithi096.stdout:8/535: read d29/f34 [3620434,27593] 0 2022-02-02T18:21:29.642 INFO:tasks.workunit.client.0.smithi096.stdout:8/536: truncate d29/d2d/d42/f59 634241 0 2022-02-02T18:21:29.643 INFO:tasks.workunit.client.0.smithi096.stdout:9/658: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/l61 0 2022-02-02T18:21:29.644 INFO:tasks.workunit.client.0.smithi096.stdout:8/537: symlink d29/d2d/lac 0 2022-02-02T18:21:29.645 INFO:tasks.workunit.client.0.smithi096.stdout:3/619: dwrite d2/df/d34/fb3 [0,4194304] 0 2022-02-02T18:21:29.645 INFO:tasks.workunit.client.0.smithi096.stdout:9/659: symlink d1/de4/lf0 0 2022-02-02T18:21:29.647 INFO:tasks.workunit.client.0.smithi096.stdout:3/620: mkdir d2/df/d34/d76/dd3 0 2022-02-02T18:21:29.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/538: write d29/f33 [7605269,22966] 0 2022-02-02T18:21:29.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/539: chown d29/d2d/c36 371606 1 2022-02-02T18:21:29.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/540: chown d29/d40/f49 3 1 2022-02-02T18:21:29.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/695: dwrite d18/f19 [4194304,4194304] 0 2022-02-02T18:21:29.650 INFO:tasks.workunit.client.0.smithi096.stdout:2/692: dwrite d2/d13/d43/d51/fba [0,4194304] 0 2022-02-02T18:21:29.651 INFO:tasks.workunit.client.0.smithi096.stdout:2/693: creat d2/d6/d1b/d8a/fd5 x:0 0 0 2022-02-02T18:21:29.655 INFO:tasks.workunit.client.0.smithi096.stdout:3/621: write d2/df/d14/f50 [3622666,122633] 0 2022-02-02T18:21:29.656 INFO:tasks.workunit.client.0.smithi096.stdout:2/694: mknod d2/d6/d1b/d8a/cd6 0 2022-02-02T18:21:29.658 INFO:tasks.workunit.client.0.smithi096.stdout:2/695: creat d2/d13/d43/fd7 x:0 0 0 2022-02-02T18:21:29.658 INFO:tasks.workunit.client.0.smithi096.stdout:2/696: fdatasync d2/d5e/d6d/d79/fc9 0 2022-02-02T18:21:29.658 INFO:tasks.workunit.client.0.smithi096.stdout:2/697: stat d2/d13/d43/d51/d73/l7e 0 2022-02-02T18:21:29.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/698: dread - d2/d13/d43/fd7 zero size 2022-02-02T18:21:29.660 INFO:tasks.workunit.client.0.smithi096.stdout:2/699: symlink d2/d19/d86/ld8 0 2022-02-02T18:21:29.660 INFO:tasks.workunit.client.0.smithi096.stdout:1/637: dwrite d15/d1b/f8c [0,4194304] 0 2022-02-02T18:21:29.663 INFO:tasks.workunit.client.0.smithi096.stdout:8/541: dread f1f [0,4194304] 0 2022-02-02T18:21:29.663 INFO:tasks.workunit.client.0.smithi096.stdout:7/588: dwrite d9/df/d12/f6d [0,4194304] 0 2022-02-02T18:21:29.664 INFO:tasks.workunit.client.0.smithi096.stdout:8/542: write d29/d2d/d47/fa2 [1042551,11148] 0 2022-02-02T18:21:29.664 INFO:tasks.workunit.client.0.smithi096.stdout:7/589: creat d9/df/d12/d39/d4e/fcc x:0 0 0 2022-02-02T18:21:29.664 INFO:tasks.workunit.client.0.smithi096.stdout:7/590: readlink d9/df/d12/d39/d46/d7d/l8e 0 2022-02-02T18:21:29.664 INFO:tasks.workunit.client.0.smithi096.stdout:7/591: stat d9/df/d12 0 2022-02-02T18:21:29.664 INFO:tasks.workunit.client.0.smithi096.stdout:2/700: mknod d2/d13/d43/d80/cd9 0 2022-02-02T18:21:29.665 INFO:tasks.workunit.client.0.smithi096.stdout:6/696: dread d18/d50/d8f/dbb/f3b [4194304,4194304] 0 2022-02-02T18:21:29.666 INFO:tasks.workunit.client.0.smithi096.stdout:5/668: dwrite db/f6c [0,4194304] 0 2022-02-02T18:21:29.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/652: getdents d3/d4/d20/d26/d36/d88 0 2022-02-02T18:21:29.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/653: write d3/d60/f79 [812393,28871] 0 2022-02-02T18:21:29.667 INFO:tasks.workunit.client.0.smithi096.stdout:9/660: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/fa7 [0,4194304] 0 2022-02-02T18:21:29.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/697: dread d18/d24/d73/dfb/fe5 [0,4194304] 0 2022-02-02T18:21:29.669 INFO:tasks.workunit.client.0.smithi096.stdout:1/638: dread d15/d1b/d26/d59/f80 [0,4194304] 0 2022-02-02T18:21:29.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/543: mkdir d29/d4e/dad 0 2022-02-02T18:21:29.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/544: truncate d29/d2d/f32 4861911 0 2022-02-02T18:21:29.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/701: rename d2/d13/d43/d51/d5d/fc4 to d2/d13/d43/d51/fda 0 2022-02-02T18:21:29.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/702: chown d2/d6/d1b/f39 1510357061 1 2022-02-02T18:21:29.673 INFO:tasks.workunit.client.0.smithi096.stdout:6/698: write d18/d24/d73/f75 [1525479,2056] 0 2022-02-02T18:21:29.676 INFO:tasks.workunit.client.0.smithi096.stdout:5/669: creat db/de/ff0 x:0 0 0 2022-02-02T18:21:29.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/654: unlink d3/d4/d20/l61 0 2022-02-02T18:21:29.679 INFO:tasks.workunit.client.0.smithi096.stdout:5/670: dread db/de/d10/d25/d4c/f5d [0,4194304] 0 2022-02-02T18:21:29.683 INFO:tasks.workunit.client.0.smithi096.stdout:9/661: unlink d1/db/d1c/d2f/f51 0 2022-02-02T18:21:29.685 INFO:tasks.workunit.client.0.smithi096.stdout:2/703: dread d2/d6/d1b/d3a/f44 [0,4194304] 0 2022-02-02T18:21:29.686 INFO:tasks.workunit.client.0.smithi096.stdout:2/704: dread - d2/d13/d42/d71/fac zero size 2022-02-02T18:21:29.686 INFO:tasks.workunit.client.0.smithi096.stdout:2/705: readlink d2/d6/d1b/l77 0 2022-02-02T18:21:29.686 INFO:tasks.workunit.client.0.smithi096.stdout:1/639: creat d15/d1b/d26/d72/de9/fed x:0 0 0 2022-02-02T18:21:29.692 INFO:tasks.workunit.client.0.smithi096.stdout:4/655: stat d3/d60/d8d/da7/c96 0 2022-02-02T18:21:29.693 INFO:tasks.workunit.client.0.smithi096.stdout:4/656: write d3/d4/f1c [4911256,82925] 0 2022-02-02T18:21:29.693 INFO:tasks.workunit.client.0.smithi096.stdout:4/657: stat d3/d4/d20/d26/d36/fc5 0 2022-02-02T18:21:29.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/671: rename db/de/d10/d27/d83/fac to db/de/d10/d27/ff1 0 2022-02-02T18:21:29.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/672: readlink db/de/d10/d25/da0/l7c 0 2022-02-02T18:21:29.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/662: unlink d1/db/d1c/d2f/d78/d25/dd/d49/fdd 0 2022-02-02T18:21:29.696 INFO:tasks.workunit.client.0.smithi096.stdout:2/706: creat d2/d13/d42/fdb x:0 0 0 2022-02-02T18:21:29.698 INFO:tasks.workunit.client.0.smithi096.stdout:1/640: rmdir d15/d1b/d28/d2c/d4f 39 2022-02-02T18:21:29.701 INFO:tasks.workunit.client.0.smithi096.stdout:4/658: mkdir d3/d4/d20/d26/d36/d88/dd8/ddf 0 2022-02-02T18:21:29.702 INFO:tasks.workunit.client.0.smithi096.stdout:8/545: dwrite d29/d4e/f8e [0,4194304] 0 2022-02-02T18:21:29.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/673: mknod db/de/d2e/d35/cf2 0 2022-02-02T18:21:29.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/674: chown c2 15376 1 2022-02-02T18:21:29.703 INFO:tasks.workunit.client.0.smithi096.stdout:3/622: dwrite d2/df/d34/fb3 [4194304,4194304] 0 2022-02-02T18:21:29.703 INFO:tasks.workunit.client.0.smithi096.stdout:6/699: dwrite d18/d50/d6d/fc6 [0,4194304] 0 2022-02-02T18:21:29.704 INFO:tasks.workunit.client.0.smithi096.stdout:6/700: creat d18/d50/d8f/dbb/d63/f101 x:0 0 0 2022-02-02T18:21:29.705 INFO:tasks.workunit.client.0.smithi096.stdout:9/663: getdents d1/db/d1c/d2f/dac 0 2022-02-02T18:21:29.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/641: symlink d15/d1b/d28/d2c/d39/d6b/lee 0 2022-02-02T18:21:29.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/659: creat d3/d60/dc2/fe0 x:0 0 0 2022-02-02T18:21:29.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/546: truncate f1c 969570 0 2022-02-02T18:21:29.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/547: write d29/d40/f5c [5141602,126084] 0 2022-02-02T18:21:29.720 INFO:tasks.workunit.client.0.smithi096.stdout:5/675: creat db/d5c/d60/da7/de2/ff3 x:0 0 0 2022-02-02T18:21:29.720 INFO:tasks.workunit.client.0.smithi096.stdout:5/676: chown db/de/f16 1024 1 2022-02-02T18:21:29.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/623: symlink d2/df/d1c/d5d/ld4 0 2022-02-02T18:21:29.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/664: truncate d1/f36 190496 0 2022-02-02T18:21:29.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/665: chown d1/db/d48/cba 80685 1 2022-02-02T18:21:29.726 INFO:tasks.workunit.client.0.smithi096.stdout:2/707: getdents d2/d13/d43 0 2022-02-02T18:21:29.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/642: mknod d15/d1b/cef 0 2022-02-02T18:21:29.729 INFO:tasks.workunit.client.0.smithi096.stdout:6/701: dwrite d18/d50/d8f/dbb/f6a [0,4194304] 0 2022-02-02T18:21:29.730 INFO:tasks.workunit.client.0.smithi096.stdout:6/702: truncate d18/d50/d8f/dbb/d63/db3/fcf 257425 0 2022-02-02T18:21:29.730 INFO:tasks.workunit.client.0.smithi096.stdout:3/624: write d2/df/d20/d4a/f62 [677130,13724] 0 2022-02-02T18:21:29.731 INFO:tasks.workunit.client.0.smithi096.stdout:4/660: mkdir d3/d4/d20/d26/d36/d88/dd8/de1 0 2022-02-02T18:21:29.732 INFO:tasks.workunit.client.0.smithi096.stdout:4/661: read - d3/d60/d8d/fc0 zero size 2022-02-02T18:21:29.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/548: mkdir d29/d4a/d5b/d81/dae 0 2022-02-02T18:21:29.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/549: fsync f1f 0 2022-02-02T18:21:29.739 INFO:tasks.workunit.client.0.smithi096.stdout:2/708: mkdir d2/d13/d43/d51/d5d/ddc 0 2022-02-02T18:21:29.740 INFO:tasks.workunit.client.0.smithi096.stdout:1/643: mkdir d15/d1b/d26/d72/da3/da7/ddc/df0 0 2022-02-02T18:21:29.743 INFO:tasks.workunit.client.0.smithi096.stdout:5/677: dwrite db/de/f2a [0,4194304] 0 2022-02-02T18:21:29.743 INFO:tasks.workunit.client.0.smithi096.stdout:5/678: creat db/de/d10/d25/d4c/ff4 x:0 0 0 2022-02-02T18:21:29.744 INFO:tasks.workunit.client.0.smithi096.stdout:8/550: dread d29/d4e/f72 [0,4194304] 0 2022-02-02T18:21:29.744 INFO:tasks.workunit.client.0.smithi096.stdout:8/551: write f17 [1022699,114308] 0 2022-02-02T18:21:29.745 INFO:tasks.workunit.client.0.smithi096.stdout:8/552: chown c1e 10 1 2022-02-02T18:21:29.746 INFO:tasks.workunit.client.0.smithi096.stdout:4/662: symlink d3/d85/le2 0 2022-02-02T18:21:29.752 INFO:tasks.workunit.client.0.smithi096.stdout:9/666: dwrite d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fb7 [0,4194304] 0 2022-02-02T18:21:29.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/553: symlink d29/d58/laf 0 2022-02-02T18:21:29.752 INFO:tasks.workunit.client.0.smithi096.stdout:2/709: truncate d2/d5e/d6d/d79/f6a 312031 0 2022-02-02T18:21:29.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/663: creat d3/d4/d20/d26/d36/d51/d57/dcf/fe3 x:0 0 0 2022-02-02T18:21:29.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/664: write d3/d60/fb2 [614717,38720] 0 2022-02-02T18:21:29.757 INFO:tasks.workunit.client.0.smithi096.stdout:8/554: creat d29/d4e/dad/fb0 x:0 0 0 2022-02-02T18:21:29.757 INFO:tasks.workunit.client.0.smithi096.stdout:4/665: mkdir d3/d5a/db8/de4 0 2022-02-02T18:21:29.758 INFO:tasks.workunit.client.0.smithi096.stdout:4/666: truncate d3/d60/f79 578790 0 2022-02-02T18:21:29.760 INFO:tasks.workunit.client.0.smithi096.stdout:9/667: write d1/f34 [1777244,36608] 0 2022-02-02T18:21:29.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/668: fdatasync d1/db/f72 0 2022-02-02T18:21:29.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/669: chown d1/db/d1c/d2f/d78/d11/d1e/d66/l91 57758 1 2022-02-02T18:21:29.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/670: fdatasync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f42 0 2022-02-02T18:21:29.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/671: fdatasync d1/fe1 0 2022-02-02T18:21:29.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/672: write d1/db/d1c/d2f/f3b [4914264,106558] 0 2022-02-02T18:21:29.763 INFO:tasks.workunit.client.0.smithi096.stdout:9/673: rename d1/db/d1c/d2f/d78/d11/d1e/d66/fc3 to d1/db/d48/de3/de5/deb/ff1 0 2022-02-02T18:21:29.764 INFO:tasks.workunit.client.0.smithi096.stdout:9/674: readlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l1d 0 2022-02-02T18:21:29.764 INFO:tasks.workunit.client.0.smithi096.stdout:9/675: write d1/db/f99 [21386,89488] 0 2022-02-02T18:21:29.765 INFO:tasks.workunit.client.0.smithi096.stdout:9/676: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/ff2 x:0 0 0 2022-02-02T18:21:29.767 INFO:tasks.workunit.client.0.smithi096.stdout:3/625: dwrite d2/df/da6/fb4 [0,4194304] 0 2022-02-02T18:21:29.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/626: mkdir d2/d71/dd5 0 2022-02-02T18:21:29.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/627: fsync d2/df/d34/fb9 0 2022-02-02T18:21:29.772 INFO:tasks.workunit.client.0.smithi096.stdout:2/710: dwrite d2/d6/d1b/d3a/f3e [4194304,4194304] 0 2022-02-02T18:21:29.773 INFO:tasks.workunit.client.0.smithi096.stdout:0/724: sync 2022-02-02T18:21:29.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/703: dwrite d18/d50/f61 [0,4194304] 0 2022-02-02T18:21:29.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/725: dread d2/db/d10/d80/d93/da3/fb2 [0,4194304] 0 2022-02-02T18:21:29.778 INFO:tasks.workunit.client.0.smithi096.stdout:7/592: sync 2022-02-02T18:21:29.779 INFO:tasks.workunit.client.0.smithi096.stdout:3/628: creat d2/df/d14/d73/fd6 x:0 0 0 2022-02-02T18:21:29.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/677: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/fa7 [0,4194304] 0 2022-02-02T18:21:29.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/678: dread - d1/db/d48/de3/de5/deb/fed zero size 2022-02-02T18:21:29.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/679: fdatasync d1/d39/d8a/d97/fa0 0 2022-02-02T18:21:29.782 INFO:tasks.workunit.client.0.smithi096.stdout:6/704: unlink d18/d50/d8f/dbb/d63/dc2/fc3 0 2022-02-02T18:21:29.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/726: getdents d2/db/d37 0 2022-02-02T18:21:29.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/727: fsync d2/db/d10/d27/f5b 0 2022-02-02T18:21:29.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/728: dread - d2/db/d10/d80/d93/da3/ddd/fc9 zero size 2022-02-02T18:21:29.785 INFO:tasks.workunit.client.0.smithi096.stdout:0/729: chown d2/db/d10/d80/d93/da3/ddc 969950024 1 2022-02-02T18:21:29.785 INFO:tasks.workunit.client.0.smithi096.stdout:7/593: unlink d9/f8a 0 2022-02-02T18:21:29.787 INFO:tasks.workunit.client.0.smithi096.stdout:3/629: mknod d2/df/d1c/d5d/d69/d43/cd7 0 2022-02-02T18:21:29.787 INFO:tasks.workunit.client.0.smithi096.stdout:3/630: write d2/df/d1c/d5d/d69/d43/d72/f75 [4619486,93576] 0 2022-02-02T18:21:29.787 INFO:tasks.workunit.client.0.smithi096.stdout:3/631: write d2/df/d14/d2c/d31/fbb [4900057,6070] 0 2022-02-02T18:21:29.788 INFO:tasks.workunit.client.0.smithi096.stdout:9/680: mkdir d1/db/d1c/d2f/d78/d11/d1e/d47/df3 0 2022-02-02T18:21:29.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/705: unlink d18/d50/d9a/cdc 0 2022-02-02T18:21:29.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/706: truncate d18/d24/d73/d79/fc1 473231 0 2022-02-02T18:21:29.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/730: mknod d2/db/d10/d80/d93/da3/ddd/cf5 0 2022-02-02T18:21:29.793 INFO:tasks.workunit.client.0.smithi096.stdout:6/707: rename d18/f27 to d18/d50/d6d/f102 0 2022-02-02T18:21:29.796 INFO:tasks.workunit.client.0.smithi096.stdout:4/667: dwrite d3/d4/f23 [0,4194304] 0 2022-02-02T18:21:29.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/711: dread d2/d13/d43/d51/f69 [0,4194304] 0 2022-02-02T18:21:29.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/712: stat d2/d6/dd2 0 2022-02-02T18:21:29.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/713: write d2/d5e/d6d/d79/d81/faf [394480,18688] 0 2022-02-02T18:21:29.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/714: truncate d2/d6/d1b/d48/f82 337656 0 2022-02-02T18:21:29.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/555: dwrite d29/d2d/f77 [4194304,4194304] 0 2022-02-02T18:21:29.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/731: getdents d2/d62/dc1 0 2022-02-02T18:21:29.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/708: mknod d18/d24/d73/dfb/c103 0 2022-02-02T18:21:29.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/668: truncate d3/d4/d20/d4d/f4e 1449642 0 2022-02-02T18:21:29.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/669: readlink d3/d60/d8d/lc4 0 2022-02-02T18:21:29.803 INFO:tasks.workunit.client.0.smithi096.stdout:2/715: creat d2/d5e/d6d/d79/d66/fdd x:0 0 0 2022-02-02T18:21:29.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/556: symlink d29/d58/d63/lb1 0 2022-02-02T18:21:29.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/557: chown f1f 74466156 1 2022-02-02T18:21:29.805 INFO:tasks.workunit.client.0.smithi096.stdout:8/558: creat d29/d4a/d5b/fb2 x:0 0 0 2022-02-02T18:21:29.806 INFO:tasks.workunit.client.0.smithi096.stdout:0/732: mkdir d2/db/d24/d89/d8f/d95/dcd/dcf/df6 0 2022-02-02T18:21:29.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/709: dread d18/d24/d73/f75 [0,4194304] 0 2022-02-02T18:21:29.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/716: rename d2/d6/db/f27 to d2/d5e/d6d/fde 0 2022-02-02T18:21:29.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/717: write d2/d2a/f34 [778958,55996] 0 2022-02-02T18:21:29.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/718: dread - d2/d6/d1b/dc0/fcc zero size 2022-02-02T18:21:29.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/719: write d2/d13/d43/d80/fb9 [287560,40204] 0 2022-02-02T18:21:29.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/720: readlink d2/d13/d43/l4a 0 2022-02-02T18:21:29.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/670: rmdir d3/d60/d8d/da7 39 2022-02-02T18:21:29.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/733: rmdir d2/d1e/d67 39 2022-02-02T18:21:29.828 INFO:tasks.workunit.client.0.smithi096.stdout:0/734: dread d2/d1e/f5d [4194304,4194304] 0 2022-02-02T18:21:29.828 INFO:tasks.workunit.client.0.smithi096.stdout:0/735: fsync d2/db/d10/fd5 0 2022-02-02T18:21:29.829 INFO:tasks.workunit.client.0.smithi096.stdout:0/736: creat d2/d1e/db3/ff7 x:0 0 0 2022-02-02T18:21:29.831 INFO:tasks.workunit.client.0.smithi096.stdout:0/737: rename d2/db/d10/d80/d93/da3/ddd/cf5 to d2/db/d10/d80/d93/da3/cf8 0 2022-02-02T18:21:29.835 INFO:tasks.workunit.client.0.smithi096.stdout:7/594: dwrite d9/df/d12/d39/d4e/f88 [0,4194304] 0 2022-02-02T18:21:29.842 INFO:tasks.workunit.client.0.smithi096.stdout:7/595: link d9/df/d47/l9d d9/df/d47/d60/lcd 0 2022-02-02T18:21:29.845 INFO:tasks.workunit.client.0.smithi096.stdout:7/596: rename d9/df/f10 to d9/df/d12/d39/d46/da4/fce 0 2022-02-02T18:21:29.846 INFO:tasks.workunit.client.0.smithi096.stdout:3/632: dwrite d2/df/d34/f39 [0,4194304] 0 2022-02-02T18:21:29.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/597: creat d9/df/d12/d39/d40/d85/fcf x:0 0 0 2022-02-02T18:21:29.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/598: readlink d9/df/d12/l67 0 2022-02-02T18:21:29.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/599: dread - d9/df/d12/d39/f7b zero size 2022-02-02T18:21:29.853 INFO:tasks.workunit.client.0.smithi096.stdout:8/559: dwrite f1c [0,4194304] 0 2022-02-02T18:21:29.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/681: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/fe7 [0,4194304] 0 2022-02-02T18:21:29.854 INFO:tasks.workunit.client.0.smithi096.stdout:9/682: chown d1/db/d1c/d2f/d78/d11/d3c/fbc 5388 1 2022-02-02T18:21:29.854 INFO:tasks.workunit.client.0.smithi096.stdout:9/683: truncate d1/db/d1c/d2f/d78/d11/fb1 1282962 0 2022-02-02T18:21:29.854 INFO:tasks.workunit.client.0.smithi096.stdout:9/684: chown d1/db/d1c/d2f/dac/fc9 276362068 1 2022-02-02T18:21:29.854 INFO:tasks.workunit.client.0.smithi096.stdout:9/685: chown d1/db/d1c/d2f/d78/d11/d1e/f31 87 1 2022-02-02T18:21:29.855 INFO:tasks.workunit.client.0.smithi096.stdout:9/686: chown d1/d39 178778 1 2022-02-02T18:21:29.855 INFO:tasks.workunit.client.0.smithi096.stdout:9/687: read - d1/db/d1c/d2f/d78/d11/d1e/d47/f98 zero size 2022-02-02T18:21:29.855 INFO:tasks.workunit.client.0.smithi096.stdout:9/688: chown d1/db/d1c/d2f/d78/d11/d1e/d66/l91 7423672 1 2022-02-02T18:21:29.855 INFO:tasks.workunit.client.0.smithi096.stdout:6/710: dwrite d18/d24/d28/d3e/fd7 [4194304,4194304] 0 2022-02-02T18:21:29.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/711: chown d18/d50/d8f/dbb/d63 7564664 1 2022-02-02T18:21:29.856 INFO:tasks.workunit.client.0.smithi096.stdout:4/671: dwrite d3/d4/d20/d26/f34 [4194304,4194304] 0 2022-02-02T18:21:29.856 INFO:tasks.workunit.client.0.smithi096.stdout:0/738: dwrite d2/db/d7f/fed [0,4194304] 0 2022-02-02T18:21:29.856 INFO:tasks.workunit.client.0.smithi096.stdout:3/633: dread d2/d71/fbd [4194304,4194304] 0 2022-02-02T18:21:29.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/672: creat d3/d5a/db8/fe5 x:0 0 0 2022-02-02T18:21:29.857 INFO:tasks.workunit.client.0.smithi096.stdout:0/739: truncate d2/db/d24/d89/d8f/da1/de9/f82 4349232 0 2022-02-02T18:21:29.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/673: chown d3/d4/d20/d26/d36/d51 735333941 1 2022-02-02T18:21:29.857 INFO:tasks.workunit.client.0.smithi096.stdout:0/740: dread - d2/db/d10/d80/d93/da3/dca/fe0 zero size 2022-02-02T18:21:29.858 INFO:tasks.workunit.client.0.smithi096.stdout:7/600: creat d9/df/d44/fd0 x:0 0 0 2022-02-02T18:21:29.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/689: mknod d1/db/d63/da2/cf4 0 2022-02-02T18:21:29.867 INFO:tasks.workunit.client.0.smithi096.stdout:7/601: dread d9/df/d12/d39/d4e/f88 [0,4194304] 0 2022-02-02T18:21:29.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/712: link d18/d24/d73/dfb/fd4 d18/d50/d8f/dbb/f104 0 2022-02-02T18:21:29.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/713: creat d18/d50/d8f/dbb/d63/f105 x:0 0 0 2022-02-02T18:21:29.871 INFO:tasks.workunit.client.0.smithi096.stdout:0/741: dwrite d2/db/d24/d4d/d61/fc8 [0,4194304] 0 2022-02-02T18:21:29.874 INFO:tasks.workunit.client.0.smithi096.stdout:0/742: symlink d2/db/d24/d89/lf9 0 2022-02-02T18:21:29.875 INFO:tasks.workunit.client.0.smithi096.stdout:9/690: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f42 [0,4194304] 0 2022-02-02T18:21:29.876 INFO:tasks.workunit.client.0.smithi096.stdout:8/560: rename d29/d40 to d29/d4e/dad/db3 0 2022-02-02T18:21:29.876 INFO:tasks.workunit.client.0.smithi096.stdout:8/561: fdatasync d29/d2d/f32 0 2022-02-02T18:21:29.880 INFO:tasks.workunit.client.0.smithi096.stdout:9/691: write d1/f6 [7062406,91925] 0 2022-02-02T18:21:29.881 INFO:tasks.workunit.client.0.smithi096.stdout:3/634: rename d2/df/c6e to d2/df/d1c/d5d/dbf/dd1/cd8 0 2022-02-02T18:21:29.881 INFO:tasks.workunit.client.0.smithi096.stdout:0/743: rmdir d2/d1e 39 2022-02-02T18:21:29.885 INFO:tasks.workunit.client.0.smithi096.stdout:4/674: fsync d3/d5a/db8/fe5 0 2022-02-02T18:21:29.885 INFO:tasks.workunit.client.0.smithi096.stdout:4/675: stat d3/d4/d20/d26/d36/lb0 0 2022-02-02T18:21:29.886 INFO:tasks.workunit.client.0.smithi096.stdout:9/692: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/lf5 0 2022-02-02T18:21:29.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/635: creat d2/df/d36/d8d/fd9 x:0 0 0 2022-02-02T18:21:29.887 INFO:tasks.workunit.client.0.smithi096.stdout:9/693: write d1/db/d1c/d2f/d78/d11/f2d [2989273,33621] 0 2022-02-02T18:21:29.888 INFO:tasks.workunit.client.0.smithi096.stdout:4/676: rename d3/d4/d50/la3 to d3/le6 0 2022-02-02T18:21:29.888 INFO:tasks.workunit.client.0.smithi096.stdout:4/677: write d3/d27/f30 [1403011,31615] 0 2022-02-02T18:21:29.889 INFO:tasks.workunit.client.0.smithi096.stdout:4/678: fsync d3/d85/f9b 0 2022-02-02T18:21:29.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/636: creat d2/df/d14/dbe/fda x:0 0 0 2022-02-02T18:21:29.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/637: creat d2/df/d14/d2c/d31/da8/fdb x:0 0 0 2022-02-02T18:21:29.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/744: getdents d2/db/d10/d27 0 2022-02-02T18:21:29.892 INFO:tasks.workunit.client.0.smithi096.stdout:9/694: link d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/c82 d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/cf6 0 2022-02-02T18:21:29.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/714: dwrite d18/d24/f36 [0,4194304] 0 2022-02-02T18:21:29.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/715: chown d18/d50/d8f/dbb/l70 15239 1 2022-02-02T18:21:29.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/716: chown d18/d50/d8f/dbb/f3b 6453 1 2022-02-02T18:21:29.895 INFO:tasks.workunit.client.0.smithi096.stdout:8/562: dwrite d29/d4e/f8e [0,4194304] 0 2022-02-02T18:21:29.895 INFO:tasks.workunit.client.0.smithi096.stdout:8/563: dread - d29/d4e/dad/fb0 zero size 2022-02-02T18:21:29.895 INFO:tasks.workunit.client.0.smithi096.stdout:4/679: link d3/d60/d8d/da7/lbf d3/d4/d20/le7 0 2022-02-02T18:21:29.897 INFO:tasks.workunit.client.0.smithi096.stdout:3/638: symlink d2/df/d14/d73/ldc 0 2022-02-02T18:21:29.897 INFO:tasks.workunit.client.0.smithi096.stdout:8/564: dread d29/d2d/d42/f73 [0,4194304] 0 2022-02-02T18:21:29.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/745: creat d2/db/d24/d89/d8f/ffa x:0 0 0 2022-02-02T18:21:29.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/746: chown d2/c1f 2378189 1 2022-02-02T18:21:29.899 INFO:tasks.workunit.client.0.smithi096.stdout:9/695: symlink d1/db/d1c/d2f/d78/d25/d8e/lf7 0 2022-02-02T18:21:29.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/717: link d18/d24/d73/dfb/fe5 d18/d50/d8f/dbb/d63/db3/f106 0 2022-02-02T18:21:29.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/718: chown d18/d24/d28/ld2 7916694 1 2022-02-02T18:21:29.901 INFO:tasks.workunit.client.0.smithi096.stdout:4/680: dread f1 [0,4194304] 0 2022-02-02T18:21:29.901 INFO:tasks.workunit.client.0.smithi096.stdout:4/681: getdents d3/d85/da5 0 2022-02-02T18:21:29.902 INFO:tasks.workunit.client.0.smithi096.stdout:4/682: write d3/d4/f40 [380666,122817] 0 2022-02-02T18:21:29.902 INFO:tasks.workunit.client.0.smithi096.stdout:4/683: readlink d3/d4/d20/lbb 0 2022-02-02T18:21:29.906 INFO:tasks.workunit.client.0.smithi096.stdout:8/565: rename d29/d2d/c36 to d29/d58/d79/cb4 0 2022-02-02T18:21:29.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/639: link d2/df/d14/d66/c7e d2/df/d34/d76/cdd 0 2022-02-02T18:21:29.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/747: mkdir d2/db/d24/d89/d8f/d95/dfb 0 2022-02-02T18:21:29.913 INFO:tasks.workunit.client.0.smithi096.stdout:9/696: stat d1/db/d1c/d2f/d78/c45 0 2022-02-02T18:21:29.914 INFO:tasks.workunit.client.0.smithi096.stdout:9/697: fdatasync d1/db/d1c/d2f/d78/d11/f30 0 2022-02-02T18:21:29.918 INFO:tasks.workunit.client.0.smithi096.stdout:3/640: link d2/df/d1c/d5d/d69/d43/cd7 d2/df/d20/d33/d58/dce/cde 0 2022-02-02T18:21:29.918 INFO:tasks.workunit.client.0.smithi096.stdout:3/641: chown d2/df/d20/d33/d58/d7c/faf 44368 1 2022-02-02T18:21:29.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/642: fdatasync d2/df/f3e 0 2022-02-02T18:21:29.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/643: chown d2/df/d14 176906391 1 2022-02-02T18:21:29.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/748: symlink d2/db/d24/d4d/d53/lfc 0 2022-02-02T18:21:29.921 INFO:tasks.workunit.client.0.smithi096.stdout:0/749: write d2/db/d10/d80/f9f [2377460,10301] 0 2022-02-02T18:21:29.923 INFO:tasks.workunit.client.0.smithi096.stdout:3/644: link d2/df/d14/d11/l2d d2/d71/ldf 0 2022-02-02T18:21:29.925 INFO:tasks.workunit.client.0.smithi096.stdout:3/645: creat d2/df/d14/d16/fe0 x:0 0 0 2022-02-02T18:21:29.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/719: dwrite d18/d50/d8f/dbb/f104 [0,4194304] 0 2022-02-02T18:21:29.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/720: chown d18/d24/d73/dfb/de8 70629 1 2022-02-02T18:21:29.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/721: write d18/d50/d8f/dbb/d63/f101 [667333,108990] 0 2022-02-02T18:21:29.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/722: truncate d18/d24/d28/d4a/db8/fd6 858189 0 2022-02-02T18:21:29.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/723: creat d18/d50/d8f/dc4/dbd/f107 x:0 0 0 2022-02-02T18:21:29.936 INFO:tasks.workunit.client.0.smithi096.stdout:6/724: symlink d18/d24/d28/d4a/d9d/l108 0 2022-02-02T18:21:29.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/725: symlink d18/d50/d8f/dc4/l109 0 2022-02-02T18:21:29.940 INFO:tasks.workunit.client.0.smithi096.stdout:4/684: dwrite d3/d4/d14/f46 [4194304,4194304] 0 2022-02-02T18:21:29.940 INFO:tasks.workunit.client.0.smithi096.stdout:4/685: write d3/d27/f3a [1284489,57873] 0 2022-02-02T18:21:29.940 INFO:tasks.workunit.client.0.smithi096.stdout:8/566: dwrite d29/d4a/d5b/f64 [0,4194304] 0 2022-02-02T18:21:29.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/750: dwrite d2/db/d24/d89/d8f/d95/fb1 [0,4194304] 0 2022-02-02T18:21:29.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/751: creat d2/db/d37/d40/ffd x:0 0 0 2022-02-02T18:21:29.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/752: fdatasync d2/db/d10/d80/d93/da3/ddd/fc9 0 2022-02-02T18:21:29.942 INFO:tasks.workunit.client.0.smithi096.stdout:6/726: write d18/d50/d8f/dbb/f39 [1847506,51253] 0 2022-02-02T18:21:29.943 INFO:tasks.workunit.client.0.smithi096.stdout:6/727: chown d18/d50/d8f/dc4/dbd 1397064 1 2022-02-02T18:21:29.943 INFO:tasks.workunit.client.0.smithi096.stdout:4/686: creat d3/d60/dbd/fe8 x:0 0 0 2022-02-02T18:21:29.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/567: mknod d29/d4a/cb5 0 2022-02-02T18:21:29.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/568: write f5 [5644590,112522] 0 2022-02-02T18:21:29.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/569: write d29/d58/d7a/f7f [986735,50264] 0 2022-02-02T18:21:29.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/570: read d29/f34 [3520375,48003] 0 2022-02-02T18:21:29.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/571: stat d29/d2d/d42/f59 0 2022-02-02T18:21:29.956 INFO:tasks.workunit.client.0.smithi096.stdout:6/728: symlink d18/d50/d6d/l10a 0 2022-02-02T18:21:29.957 INFO:tasks.workunit.client.0.smithi096.stdout:4/687: unlink d3/fb4 0 2022-02-02T18:21:29.958 INFO:tasks.workunit.client.0.smithi096.stdout:0/753: dwrite d2/db/d10/d80/fd8 [0,4194304] 0 2022-02-02T18:21:29.958 INFO:tasks.workunit.client.0.smithi096.stdout:0/754: readlink d2/db/d10/l5a 0 2022-02-02T18:21:29.958 INFO:tasks.workunit.client.0.smithi096.stdout:0/755: creat d2/db/d24/d89/d8f/d95/dcd/ffe x:0 0 0 2022-02-02T18:21:29.960 INFO:tasks.workunit.client.0.smithi096.stdout:0/756: read d2/db/d24/d89/d8f/d95/dcd/fef [2036609,56958] 0 2022-02-02T18:21:29.960 INFO:tasks.workunit.client.0.smithi096.stdout:8/572: mkdir d29/d4e/dad/db3/d6d/db6 0 2022-02-02T18:21:29.969 INFO:tasks.workunit.client.0.smithi096.stdout:6/729: getdents d18/d24/d28/d4a/d9d 0 2022-02-02T18:21:29.973 INFO:tasks.workunit.client.0.smithi096.stdout:8/573: rmdir d29/d4e/dad/db3/d6d/db6 0 2022-02-02T18:21:29.973 INFO:tasks.workunit.client.0.smithi096.stdout:8/574: write f1f [3750995,111856] 0 2022-02-02T18:21:29.974 INFO:tasks.workunit.client.0.smithi096.stdout:4/688: getdents d3/d4/d14 0 2022-02-02T18:21:29.975 INFO:tasks.workunit.client.0.smithi096.stdout:6/730: unlink d18/d24/d28/d4a/d9d/fab 0 2022-02-02T18:21:29.978 INFO:tasks.workunit.client.0.smithi096.stdout:0/757: dwrite d2/f69 [0,4194304] 0 2022-02-02T18:21:29.978 INFO:tasks.workunit.client.0.smithi096.stdout:0/758: creat d2/db/d37/d40/fff x:0 0 0 2022-02-02T18:21:29.980 INFO:tasks.workunit.client.0.smithi096.stdout:0/759: read d2/d1e/f35 [2388341,60869] 0 2022-02-02T18:21:29.991 INFO:tasks.workunit.client.0.smithi096.stdout:0/760: dread d2/db/d24/d4d/d61/fc8 [0,4194304] 0 2022-02-02T18:21:29.991 INFO:tasks.workunit.client.0.smithi096.stdout:0/761: write d2/db/d10/f33 [4637409,30752] 0 2022-02-02T18:21:29.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/762: creat d2/db/d10/d27/f100 x:0 0 0 2022-02-02T18:21:29.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/763: chown d2/d62/l9d 5715804 1 2022-02-02T18:21:29.995 INFO:tasks.workunit.client.0.smithi096.stdout:0/764: creat d2/db/d24/d89/d8f/d95/dcd/f101 x:0 0 0 2022-02-02T18:21:29.996 INFO:tasks.workunit.client.0.smithi096.stdout:0/765: read d2/db/d10/f2b [12930,85997] 0 2022-02-02T18:21:29.996 INFO:tasks.workunit.client.0.smithi096.stdout:0/766: truncate d2/db/d37/f7a 2024656 0 2022-02-02T18:21:29.997 INFO:tasks.workunit.client.0.smithi096.stdout:0/767: mkdir d2/db/d24/d4d/d53/d58/d102 0 2022-02-02T18:21:29.997 INFO:tasks.workunit.client.0.smithi096.stdout:0/768: truncate d2/db/d37/f3e 2604286 0 2022-02-02T18:21:29.998 INFO:tasks.workunit.client.0.smithi096.stdout:0/769: fsync d2/db/d24/d89/d8f/da1/de9/fe7 0 2022-02-02T18:21:29.998 INFO:tasks.workunit.client.0.smithi096.stdout:0/770: mkdir d2/db/d24/d4d/d54/d103 0 2022-02-02T18:21:29.999 INFO:tasks.workunit.client.0.smithi096.stdout:6/731: dwrite d18/d24/d73/dfb/ff9 [0,4194304] 0 2022-02-02T18:21:30.000 INFO:tasks.workunit.client.0.smithi096.stdout:8/575: dwrite d29/d4e/f8e [0,4194304] 0 2022-02-02T18:21:30.000 INFO:tasks.workunit.client.0.smithi096.stdout:8/576: dread - d29/d2d/d87/f97 zero size 2022-02-02T18:21:30.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/771: rename d2/db/fc to d2/d1e/db9/f104 0 2022-02-02T18:21:30.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/772: dread - d2/db/d10/d27/f100 zero size 2022-02-02T18:21:30.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/773: truncate d2/d62/f72 1024928 0 2022-02-02T18:21:30.002 INFO:tasks.workunit.client.0.smithi096.stdout:0/774: fdatasync d2/db/d37/fcb 0 2022-02-02T18:21:30.002 INFO:tasks.workunit.client.0.smithi096.stdout:0/775: read d2/db/d24/f9a [49179,45478] 0 2022-02-02T18:21:30.006 INFO:tasks.workunit.client.0.smithi096.stdout:6/732: symlink d18/d50/l10b 0 2022-02-02T18:21:30.010 INFO:tasks.workunit.client.0.smithi096.stdout:0/776: symlink d2/d1e/d67/l105 0 2022-02-02T18:21:30.010 INFO:tasks.workunit.client.0.smithi096.stdout:0/777: write d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/fa7 [4587831,5694] 0 2022-02-02T18:21:30.010 INFO:tasks.workunit.client.0.smithi096.stdout:0/778: chown d2/db/d24/d4d/d54/c64 119611 1 2022-02-02T18:21:30.011 INFO:tasks.workunit.client.0.smithi096.stdout:6/733: rename d18/d50/d8f/fa0 to d18/d50/d8f/df1/f10c 0 2022-02-02T18:21:30.011 INFO:tasks.workunit.client.0.smithi096.stdout:6/734: creat d18/d50/d9a/f10d x:0 0 0 2022-02-02T18:21:30.013 INFO:tasks.workunit.client.0.smithi096.stdout:0/779: creat d2/db/d24/d89/d8f/d95/dfb/f106 x:0 0 0 2022-02-02T18:21:30.017 INFO:tasks.workunit.client.0.smithi096.stdout:6/735: unlink l16 0 2022-02-02T18:21:30.018 INFO:tasks.workunit.client.0.smithi096.stdout:8/577: dwrite d29/d4e/dad/db3/d6d/d85/f86 [0,4194304] 0 2022-02-02T18:21:30.019 INFO:tasks.workunit.client.0.smithi096.stdout:8/578: chown d29/d4a/d5b/d81/l9a 2366 1 2022-02-02T18:21:30.020 INFO:tasks.workunit.client.0.smithi096.stdout:8/579: write d29/d2d/d47/f6e [1519749,122931] 0 2022-02-02T18:21:30.020 INFO:tasks.workunit.client.0.smithi096.stdout:8/580: write d29/d2d/d42/f59 [1228911,77977] 0 2022-02-02T18:21:30.022 INFO:tasks.workunit.client.0.smithi096.stdout:8/581: link c1e d29/d2d/cb7 0 2022-02-02T18:21:30.023 INFO:tasks.workunit.client.0.smithi096.stdout:8/582: link d29/d2d/d47/l60 d29/d2d/d87/lb8 0 2022-02-02T18:21:30.023 INFO:tasks.workunit.client.0.smithi096.stdout:8/583: truncate d29/d58/d79/f7c 1214719 0 2022-02-02T18:21:30.025 INFO:tasks.workunit.client.0.smithi096.stdout:5/679: sync 2022-02-02T18:21:30.025 INFO:tasks.workunit.client.0.smithi096.stdout:1/644: sync 2022-02-02T18:21:30.026 INFO:tasks.workunit.client.0.smithi096.stdout:2/721: sync 2022-02-02T18:21:30.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/680: chown db/d5c/d2f/c92 11 1 2022-02-02T18:21:30.026 INFO:tasks.workunit.client.0.smithi096.stdout:1/645: readlink d15/d1b/d26/l2d 0 2022-02-02T18:21:30.026 INFO:tasks.workunit.client.0.smithi096.stdout:1/646: getdents d15/d1b/d26/d72/da3/da7/ddc/df0 0 2022-02-02T18:21:30.027 INFO:tasks.workunit.client.0.smithi096.stdout:8/584: mkdir d29/d4e/dad/db3/d6d/d83/db9 0 2022-02-02T18:21:30.027 INFO:tasks.workunit.client.0.smithi096.stdout:2/722: mknod d2/d19/d86/cdf 0 2022-02-02T18:21:30.028 INFO:tasks.workunit.client.0.smithi096.stdout:1/647: truncate d15/d1b/d28/d2c/d39/d71/f7d 2014910 0 2022-02-02T18:21:30.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/723: symlink d2/d13/d42/d71/dad/le0 0 2022-02-02T18:21:30.030 INFO:tasks.workunit.client.0.smithi096.stdout:2/724: read d2/d6/f93 [657137,67338] 0 2022-02-02T18:21:30.031 INFO:tasks.workunit.client.0.smithi096.stdout:1/648: rename d15/d1b/d28/l66 to d15/d1b/d26/d72/dce/lf1 0 2022-02-02T18:21:30.033 INFO:tasks.workunit.client.0.smithi096.stdout:2/725: rename d2/d5e/d6d/d79/d66/fdd to d2/d13/d42/d71/fe1 0 2022-02-02T18:21:30.033 INFO:tasks.workunit.client.0.smithi096.stdout:2/726: write d2/d6/d1b/dc0/fcc [311654,80107] 0 2022-02-02T18:21:30.034 INFO:tasks.workunit.client.0.smithi096.stdout:1/649: write d15/d1b/d26/d72/da3/da7/ddc/f82 [1439130,65963] 0 2022-02-02T18:21:30.036 INFO:tasks.workunit.client.0.smithi096.stdout:2/727: rename d2/d13/d42/d71/dad/db0/fbf to d2/d13/d42/d71/dad/db0/dc7/dca/fe2 0 2022-02-02T18:21:30.036 INFO:tasks.workunit.client.0.smithi096.stdout:2/728: fsync d2/d13/d43/d51/fc5 0 2022-02-02T18:21:30.036 INFO:tasks.workunit.client.0.smithi096.stdout:2/729: chown d2/d6/d1b/dc0/fcc 35613 1 2022-02-02T18:21:30.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/730: mkdir d2/d19/de3 0 2022-02-02T18:21:30.038 INFO:tasks.workunit.client.0.smithi096.stdout:1/650: getdents d15/d1b/d28/d2c/d39/d71 0 2022-02-02T18:21:30.038 INFO:tasks.workunit.client.0.smithi096.stdout:1/651: write d15/f22 [830901,64962] 0 2022-02-02T18:21:30.039 INFO:tasks.workunit.client.0.smithi096.stdout:5/681: dread db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:30.040 INFO:tasks.workunit.client.0.smithi096.stdout:5/682: getdents db/de/d10 0 2022-02-02T18:21:30.041 INFO:tasks.workunit.client.0.smithi096.stdout:1/652: getdents d15/d1b/d28/d2c/d39 0 2022-02-02T18:21:30.042 INFO:tasks.workunit.client.0.smithi096.stdout:0/780: dwrite d2/db/d24/d89/d8f/d95/dcd/ffe [0,4194304] 0 2022-02-02T18:21:30.043 INFO:tasks.workunit.client.0.smithi096.stdout:0/781: truncate d2/db/d24/d89/d8f/ffa 706083 0 2022-02-02T18:21:30.047 INFO:tasks.workunit.client.0.smithi096.stdout:6/736: dwrite d18/d50/f88 [0,4194304] 0 2022-02-02T18:21:30.047 INFO:tasks.workunit.client.0.smithi096.stdout:8/585: dwrite d29/d2d/d42/f73 [0,4194304] 0 2022-02-02T18:21:30.047 INFO:tasks.workunit.client.0.smithi096.stdout:8/586: chown d29/d2d/d47/l9c 0 1 2022-02-02T18:21:30.048 INFO:tasks.workunit.client.0.smithi096.stdout:1/653: rmdir d15/d1b/d26/d72/da3 39 2022-02-02T18:21:30.050 INFO:tasks.workunit.client.0.smithi096.stdout:0/782: truncate d2/db/d24/d4d/d61/fc8 4053027 0 2022-02-02T18:21:30.057 INFO:tasks.workunit.client.0.smithi096.stdout:6/737: rename d18/d50/d9a/fec to d18/d50/d8f/dbb/d63/dc2/f10e 0 2022-02-02T18:21:30.057 INFO:tasks.workunit.client.0.smithi096.stdout:8/587: link d29/d4e/dad/db3/l96 d29/d58/lba 0 2022-02-02T18:21:30.057 INFO:tasks.workunit.client.0.smithi096.stdout:8/588: creat d29/d4a/d5b/fbb x:0 0 0 2022-02-02T18:21:30.069 INFO:tasks.workunit.client.0.smithi096.stdout:2/731: dwrite d2/d6/d1b/d3a/f7f [4194304,4194304] 0 2022-02-02T18:21:30.069 INFO:tasks.workunit.client.0.smithi096.stdout:2/732: write d2/d5e/d6d/fb6 [778686,68496] 0 2022-02-02T18:21:30.070 INFO:tasks.workunit.client.0.smithi096.stdout:5/683: dwrite db/d5c/d2f/d46/f73 [0,4194304] 0 2022-02-02T18:21:30.070 INFO:tasks.workunit.client.0.smithi096.stdout:0/783: dwrite d2/db/d24/d89/d8f/ffa [0,4194304] 0 2022-02-02T18:21:30.071 INFO:tasks.workunit.client.0.smithi096.stdout:2/733: dread d2/d5e/d6d/d79/d66/fa6 [0,4194304] 0 2022-02-02T18:21:30.083 INFO:tasks.workunit.client.0.smithi096.stdout:5/684: readlink db/de/d2e/l31 0 2022-02-02T18:21:30.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/784: mknod d2/d1e/c107 0 2022-02-02T18:21:30.085 INFO:tasks.workunit.client.0.smithi096.stdout:0/785: write d2/d1e/f35 [2924643,79286] 0 2022-02-02T18:21:30.085 INFO:tasks.workunit.client.0.smithi096.stdout:0/786: chown d2/db/dde 0 1 2022-02-02T18:21:30.085 INFO:tasks.workunit.client.0.smithi096.stdout:0/787: truncate d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/f98 162605 0 2022-02-02T18:21:30.086 INFO:tasks.workunit.client.0.smithi096.stdout:0/788: truncate d2/db/d24/d89/d8f/da1/de9/f82 4685486 0 2022-02-02T18:21:30.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/789: rmdir d2/db/d24/d4d/d54 39 2022-02-02T18:21:30.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/790: readlink d2/d62/lac 0 2022-02-02T18:21:30.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/791: symlink d2/db/d37/d5f/l108 0 2022-02-02T18:21:30.089 INFO:tasks.workunit.client.0.smithi096.stdout:2/734: dwrite d2/d13/d42/d71/fe1 [0,4194304] 0 2022-02-02T18:21:30.089 INFO:tasks.workunit.client.0.smithi096.stdout:2/735: fsync d2/d6/d1b/d48/f4d 0 2022-02-02T18:21:30.091 INFO:tasks.workunit.client.0.smithi096.stdout:9/698: sync 2022-02-02T18:21:30.091 INFO:tasks.workunit.client.0.smithi096.stdout:7/602: sync 2022-02-02T18:21:30.092 INFO:tasks.workunit.client.0.smithi096.stdout:5/685: dread db/d20/fc1 [0,4194304] 0 2022-02-02T18:21:30.092 INFO:tasks.workunit.client.0.smithi096.stdout:5/686: chown db/de/d2e/d35 101956 1 2022-02-02T18:21:30.094 INFO:tasks.workunit.client.0.smithi096.stdout:2/736: mkdir d2/d13/d42/d71/dad/db0/de4 0 2022-02-02T18:21:30.101 INFO:tasks.workunit.client.0.smithi096.stdout:2/737: dread d2/d6/f93 [0,4194304] 0 2022-02-02T18:21:30.102 INFO:tasks.workunit.client.0.smithi096.stdout:2/738: rmdir d2/d6/d1b 39 2022-02-02T18:21:30.102 INFO:tasks.workunit.client.0.smithi096.stdout:2/739: chown d2/d19/d86/db3 991681340 1 2022-02-02T18:21:30.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/603: dread d9/df/d12/f6d [0,4194304] 0 2022-02-02T18:21:30.109 INFO:tasks.workunit.client.0.smithi096.stdout:7/604: rename d9/df/d12/d39/f75 to d9/df/d12/d39/d4e/fd1 0 2022-02-02T18:21:30.114 INFO:tasks.workunit.client.0.smithi096.stdout:7/605: write d9/fd [2862108,16903] 0 2022-02-02T18:21:30.116 INFO:tasks.workunit.client.0.smithi096.stdout:7/606: mknod d9/df/d12/d39/d42/cd2 0 2022-02-02T18:21:30.125 INFO:tasks.workunit.client.0.smithi096.stdout:5/687: dwrite db/d5c/d60/da7/de2/ff3 [0,4194304] 0 2022-02-02T18:21:30.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/699: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/f7f [0,4194304] 0 2022-02-02T18:21:30.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/700: truncate d1/f36 631489 0 2022-02-02T18:21:30.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/701: read - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/ff2 zero size 2022-02-02T18:21:30.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/702: creat d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/ff8 x:0 0 0 2022-02-02T18:21:30.127 INFO:tasks.workunit.client.0.smithi096.stdout:2/740: dwrite d2/d5e/fbc [0,4194304] 0 2022-02-02T18:21:30.128 INFO:tasks.workunit.client.0.smithi096.stdout:5/688: mknod db/d5c/d60/cf5 0 2022-02-02T18:21:30.128 INFO:tasks.workunit.client.0.smithi096.stdout:5/689: write db/de/fb6 [1637144,37143] 0 2022-02-02T18:21:30.131 INFO:tasks.workunit.client.0.smithi096.stdout:7/607: rmdir d9/df/d12/d39/d4e 39 2022-02-02T18:21:30.132 INFO:tasks.workunit.client.0.smithi096.stdout:7/608: read f2 [204228,11053] 0 2022-02-02T18:21:30.133 INFO:tasks.workunit.client.0.smithi096.stdout:9/703: mknod d1/db/d1c/d2f/dac/cf9 0 2022-02-02T18:21:30.133 INFO:tasks.workunit.client.0.smithi096.stdout:7/609: read d9/df/d12/d39/d41/f4f [1637590,46707] 0 2022-02-02T18:21:30.133 INFO:tasks.workunit.client.0.smithi096.stdout:7/610: fsync d9/df/d12/d39/d46/f7e 0 2022-02-02T18:21:30.136 INFO:tasks.workunit.client.0.smithi096.stdout:4/689: sync 2022-02-02T18:21:30.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/646: sync 2022-02-02T18:21:30.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/647: chown d2/df/d14/d2c/d31/da8 396994 1 2022-02-02T18:21:30.137 INFO:tasks.workunit.client.0.smithi096.stdout:3/648: truncate d2/df/d14/d11/fc0 718936 0 2022-02-02T18:21:30.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/690: dread d3/f5d [0,4194304] 0 2022-02-02T18:21:30.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/691: fsync d3/d85/fc7 0 2022-02-02T18:21:30.138 INFO:tasks.workunit.client.0.smithi096.stdout:9/704: rename d1/db/d1c/d2f/d78/d11/d1e/d38/d68/cc1 to d1/db/d48/de3/de5/cfa 0 2022-02-02T18:21:30.138 INFO:tasks.workunit.client.0.smithi096.stdout:9/705: write d1/db/fd8 [343494,18764] 0 2022-02-02T18:21:30.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/692: write d3/d4/d14/f46 [2216174,69828] 0 2022-02-02T18:21:30.139 INFO:tasks.workunit.client.0.smithi096.stdout:7/611: mkdir d9/df/d47/dd3 0 2022-02-02T18:21:30.140 INFO:tasks.workunit.client.0.smithi096.stdout:2/741: getdents d2/d6/d1b/d8a 0 2022-02-02T18:21:30.140 INFO:tasks.workunit.client.0.smithi096.stdout:2/742: stat d2/d6/d1b/dd0 0 2022-02-02T18:21:30.141 INFO:tasks.workunit.client.0.smithi096.stdout:3/649: unlink d2/df/fd2 0 2022-02-02T18:21:30.142 INFO:tasks.workunit.client.0.smithi096.stdout:9/706: symlink d1/db/d1c/d2f/d78/d11/d1e/d47/lfb 0 2022-02-02T18:21:30.142 INFO:tasks.workunit.client.0.smithi096.stdout:9/707: chown d1/db/d48/fb3 18926583 1 2022-02-02T18:21:30.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/693: symlink d3/d4/d20/d4d/le9 0 2022-02-02T18:21:30.144 INFO:tasks.workunit.client.0.smithi096.stdout:7/612: mkdir d9/df/d12/d39/d40/d6b/dd4 0 2022-02-02T18:21:30.144 INFO:tasks.workunit.client.0.smithi096.stdout:7/613: fsync d9/df/d12/d39/d42/f5a 0 2022-02-02T18:21:30.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/743: creat d2/d19/de3/fe5 x:0 0 0 2022-02-02T18:21:30.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/744: write d2/d6/d1b/d48/f4d [4921828,99390] 0 2022-02-02T18:21:30.146 INFO:tasks.workunit.client.0.smithi096.stdout:3/650: mkdir d2/df/d14/d2c/d31/da8/de1 0 2022-02-02T18:21:30.146 INFO:tasks.workunit.client.0.smithi096.stdout:2/745: creat d2/d13/d42/d71/dad/db0/dc7/dca/fe6 x:0 0 0 2022-02-02T18:21:30.147 INFO:tasks.workunit.client.0.smithi096.stdout:3/651: symlink d2/df/d20/d33/d58/dce/dcf/le2 0 2022-02-02T18:21:30.149 INFO:tasks.workunit.client.0.smithi096.stdout:7/614: dread d9/df/d12/f3f [0,4194304] 0 2022-02-02T18:21:30.149 INFO:tasks.workunit.client.0.smithi096.stdout:2/746: symlink d2/d6/d1b/dc0/le7 0 2022-02-02T18:21:30.149 INFO:tasks.workunit.client.0.smithi096.stdout:2/747: chown d2/d5e/d6d/d79/fc9 962650 1 2022-02-02T18:21:30.150 INFO:tasks.workunit.client.0.smithi096.stdout:2/748: mknod d2/d5e/d7c/ce8 0 2022-02-02T18:21:30.151 INFO:tasks.workunit.client.0.smithi096.stdout:2/749: symlink d2/d13/d43/d80/le9 0 2022-02-02T18:21:30.152 INFO:tasks.workunit.client.0.smithi096.stdout:9/708: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [4194304,4194304] 0 2022-02-02T18:21:30.152 INFO:tasks.workunit.client.0.smithi096.stdout:2/750: write d2/d6/f93 [106377,88455] 0 2022-02-02T18:21:30.153 INFO:tasks.workunit.client.0.smithi096.stdout:2/751: fsync d2/d13/d42/fdb 0 2022-02-02T18:21:30.155 INFO:tasks.workunit.client.0.smithi096.stdout:2/752: truncate d2/d13/d43/d51/fba 5498485 0 2022-02-02T18:21:30.168 INFO:tasks.workunit.client.0.smithi096.stdout:4/694: dwrite d3/d4/d20/d26/d36/d88/d98/fae [0,4194304] 0 2022-02-02T18:21:30.175 INFO:tasks.workunit.client.0.smithi096.stdout:4/695: write d3/d4/d20/d26/d36/f44 [2535793,83533] 0 2022-02-02T18:21:30.175 INFO:tasks.workunit.client.0.smithi096.stdout:3/652: dwrite d2/df/da6/fad [0,4194304] 0 2022-02-02T18:21:30.179 INFO:tasks.workunit.client.0.smithi096.stdout:9/709: dwrite d1/d39/d8a/d97/fb5 [0,4194304] 0 2022-02-02T18:21:30.180 INFO:tasks.workunit.client.0.smithi096.stdout:4/696: unlink d3/d60/d8d/fb5 0 2022-02-02T18:21:30.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/710: link d1/db/d1c/d2f/d78/d11/d1e/d47/lfb d1/db/d1c/d2f/d78/d25/lfc 0 2022-02-02T18:21:30.186 INFO:tasks.workunit.client.0.smithi096.stdout:4/697: mknod d3/d4/d14/cea 0 2022-02-02T18:21:30.187 INFO:tasks.workunit.client.0.smithi096.stdout:9/711: truncate d1/db/d1c/d2f/f55 10409384 0 2022-02-02T18:21:30.187 INFO:tasks.workunit.client.0.smithi096.stdout:9/712: chown d1/db/d48/de3/de5/fe0 11794126 1 2022-02-02T18:21:30.188 INFO:tasks.workunit.client.0.smithi096.stdout:3/653: dread d2/d71/f83 [0,4194304] 0 2022-02-02T18:21:30.189 INFO:tasks.workunit.client.0.smithi096.stdout:4/698: symlink d3/d60/d8d/dc6/dd0/leb 0 2022-02-02T18:21:30.190 INFO:tasks.workunit.client.0.smithi096.stdout:9/713: creat d1/db/d1c/d2f/dd2/ffd x:0 0 0 2022-02-02T18:21:30.192 INFO:tasks.workunit.client.0.smithi096.stdout:3/654: creat d2/df/d34/d76/dd3/fe3 x:0 0 0 2022-02-02T18:21:30.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/714: mkdir d1/db/d1c/d2f/d78/d11/d1e/dfe 0 2022-02-02T18:21:30.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/715: creat d1/db/d1c/d2f/d78/d11/d3c/fff x:0 0 0 2022-02-02T18:21:30.197 INFO:tasks.workunit.client.0.smithi096.stdout:4/699: rmdir d3/d4/d20/d26/d36/d88/d98 39 2022-02-02T18:21:30.197 INFO:tasks.workunit.client.0.smithi096.stdout:4/700: chown d3/d5a 465 1 2022-02-02T18:21:30.203 INFO:tasks.workunit.client.0.smithi096.stdout:9/716: rename d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fb7 to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/f100 0 2022-02-02T18:21:30.203 INFO:tasks.workunit.client.0.smithi096.stdout:9/717: dread - d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/ff8 zero size 2022-02-02T18:21:30.203 INFO:tasks.workunit.client.0.smithi096.stdout:9/718: dread - d1/db/d1c/d2f/d78/d11/d3c/fc7 zero size 2022-02-02T18:21:30.204 INFO:tasks.workunit.client.0.smithi096.stdout:9/719: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f101 x:0 0 0 2022-02-02T18:21:30.204 INFO:tasks.workunit.client.0.smithi096.stdout:4/701: rename d3/d5a/db8/fce to d3/d4/d20/d26/d36/fec 0 2022-02-02T18:21:30.207 INFO:tasks.workunit.client.0.smithi096.stdout:9/720: rename d1/db/d1c/d2f/d78/cb4 to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/c102 0 2022-02-02T18:21:30.207 INFO:tasks.workunit.client.0.smithi096.stdout:9/721: chown d1/db/d1c/d2f/d78/d11/d3c/f79 38166 1 2022-02-02T18:21:30.208 INFO:tasks.workunit.client.0.smithi096.stdout:9/722: dread d1/db/d1c/f84 [0,4194304] 0 2022-02-02T18:21:30.208 INFO:tasks.workunit.client.0.smithi096.stdout:4/702: mknod d3/d4/d20/d26/d36/d88/ced 0 2022-02-02T18:21:30.209 INFO:tasks.workunit.client.0.smithi096.stdout:9/723: symlink d1/db/d48/de3/de5/l103 0 2022-02-02T18:21:30.210 INFO:tasks.workunit.client.0.smithi096.stdout:9/724: chown d1/d39 22466039 1 2022-02-02T18:21:30.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/725: mknod d1/db/d1c/d2f/d78/d11/d1e/c104 0 2022-02-02T18:21:30.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/726: write d1/db/d63/da2/fa9 [886605,105061] 0 2022-02-02T18:21:30.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/727: chown d1/db/d1c/d2f/d78/c81 1125432 1 2022-02-02T18:21:30.211 INFO:tasks.workunit.client.0.smithi096.stdout:3/655: dwrite d2/df/d14/d16/f8b [0,4194304] 0 2022-02-02T18:21:30.212 INFO:tasks.workunit.client.0.smithi096.stdout:3/656: creat d2/d71/fe4 x:0 0 0 2022-02-02T18:21:30.212 INFO:tasks.workunit.client.0.smithi096.stdout:9/728: unlink d1/f2c 0 2022-02-02T18:21:30.213 INFO:tasks.workunit.client.0.smithi096.stdout:9/729: readlink d1/de4/lf0 0 2022-02-02T18:21:30.213 INFO:tasks.workunit.client.0.smithi096.stdout:3/657: read d2/df/d14/d2c/d31/fbb [2259085,17267] 0 2022-02-02T18:21:30.221 INFO:tasks.workunit.client.0.smithi096.stdout:9/730: rename d1/f6 to d1/db/d1c/d2f/f105 0 2022-02-02T18:21:30.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/731: fdatasync d1/db/fd8 0 2022-02-02T18:21:30.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/732: getdents d1/dd1 0 2022-02-02T18:21:30.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/733: read d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [5752192,30557] 0 2022-02-02T18:21:30.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/734: chown d1/db/d1c/d2f/d78/d25 1363 1 2022-02-02T18:21:30.223 INFO:tasks.workunit.client.0.smithi096.stdout:9/735: chown d1/db/d1c/d2f/dac/le6 0 1 2022-02-02T18:21:30.223 INFO:tasks.workunit.client.0.smithi096.stdout:8/589: sync 2022-02-02T18:21:30.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/738: sync 2022-02-02T18:21:30.224 INFO:tasks.workunit.client.0.smithi096.stdout:0/792: sync 2022-02-02T18:21:30.224 INFO:tasks.workunit.client.0.smithi096.stdout:1/654: sync 2022-02-02T18:21:30.224 INFO:tasks.workunit.client.0.smithi096.stdout:8/590: creat d29/d2d/fbc x:0 0 0 2022-02-02T18:21:30.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/736: mknod d1/d39/d8a/d97/dee/c106 0 2022-02-02T18:21:30.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/737: truncate d1/db/d1c/d2f/f55 11203653 0 2022-02-02T18:21:30.228 INFO:tasks.workunit.client.0.smithi096.stdout:6/739: mknod d18/c10f 0 2022-02-02T18:21:30.228 INFO:tasks.workunit.client.0.smithi096.stdout:6/740: truncate d18/d50/d8f/dbb/d63/db3/db5/fbe 1033930 0 2022-02-02T18:21:30.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/793: link d2/db/d10/f39 d2/db/d10/d80/f109 0 2022-02-02T18:21:30.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/655: truncate d15/d1b/d26/f49 3559469 0 2022-02-02T18:21:30.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/794: stat d2/db/f19 0 2022-02-02T18:21:30.229 INFO:tasks.workunit.client.0.smithi096.stdout:9/738: creat d1/de4/f107 x:0 0 0 2022-02-02T18:21:30.230 INFO:tasks.workunit.client.0.smithi096.stdout:6/741: write d18/d50/d8f/dbb/d63/db3/fcf [244181,47304] 0 2022-02-02T18:21:30.230 INFO:tasks.workunit.client.0.smithi096.stdout:1/656: getdents d15/d1b/d26/d72/da3 0 2022-02-02T18:21:30.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/657: creat d15/d1b/d26/ff2 x:0 0 0 2022-02-02T18:21:30.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/591: dread d29/d2d/f56 [0,4194304] 0 2022-02-02T18:21:30.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/592: write d29/d2d/d47/f93 [339074,30470] 0 2022-02-02T18:21:30.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/593: rename d29/d2d/d47/la1 to d29/d4e/dad/db3/d6d/d83/db9/lbd 0 2022-02-02T18:21:30.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/658: write d15/d1b/d26/d72/da3/da7/db6/fd7 [67885,4442] 0 2022-02-02T18:21:30.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/659: chown d15/d4d/ld5 525451 1 2022-02-02T18:21:30.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/660: readlink d15/d1b/d28/d2c/d39/d6b/lee 0 2022-02-02T18:21:30.237 INFO:tasks.workunit.client.0.smithi096.stdout:8/594: symlink d29/d4a/d5b/lbe 0 2022-02-02T18:21:30.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/661: mkdir d15/d1b/d28/d2c/d39/d6b/df3 0 2022-02-02T18:21:30.240 INFO:tasks.workunit.client.0.smithi096.stdout:3/658: dwrite d2/df/d36/f7f [0,4194304] 0 2022-02-02T18:21:30.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/595: link d29/f3a d29/fbf 0 2022-02-02T18:21:30.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/596: chown d29/d2d/lac 0 1 2022-02-02T18:21:30.242 INFO:tasks.workunit.client.0.smithi096.stdout:8/597: mknod d29/cc0 0 2022-02-02T18:21:30.242 INFO:tasks.workunit.client.0.smithi096.stdout:6/742: dread d18/f8a [4194304,4194304] 0 2022-02-02T18:21:30.244 INFO:tasks.workunit.client.0.smithi096.stdout:6/743: mknod d18/d24/d28/d4a/d9d/c110 0 2022-02-02T18:21:30.245 INFO:tasks.workunit.client.0.smithi096.stdout:6/744: chown d18/d50/d8f/dbb/d63/db3/db5 245 1 2022-02-02T18:21:30.245 INFO:tasks.workunit.client.0.smithi096.stdout:6/745: readlink d18/d50/d8f/dc4/l94 0 2022-02-02T18:21:30.250 INFO:tasks.workunit.client.0.smithi096.stdout:6/746: rename d18/d24/d73/fae to d18/d50/d8f/dbb/d63/dc2/f111 0 2022-02-02T18:21:30.251 INFO:tasks.workunit.client.0.smithi096.stdout:0/795: dwrite d2/db/d24/d4d/d54/fae [0,4194304] 0 2022-02-02T18:21:30.251 INFO:tasks.workunit.client.0.smithi096.stdout:0/796: readlink d2/d1e/d67/l105 0 2022-02-02T18:21:30.251 INFO:tasks.workunit.client.0.smithi096.stdout:0/797: readlink d2/db/d10/d27/l79 0 2022-02-02T18:21:30.251 INFO:tasks.workunit.client.0.smithi096.stdout:1/662: dread d15/d1b/f29 [0,4194304] 0 2022-02-02T18:21:30.252 INFO:tasks.workunit.client.0.smithi096.stdout:1/663: chown d15/d1b/d28/d47 3077329 1 2022-02-02T18:21:30.256 INFO:tasks.workunit.client.0.smithi096.stdout:0/798: mkdir d2/db/d24/d4d/d53/d58/d10a 0 2022-02-02T18:21:30.257 INFO:tasks.workunit.client.0.smithi096.stdout:0/799: rmdir d2 39 2022-02-02T18:21:30.257 INFO:tasks.workunit.client.0.smithi096.stdout:0/800: truncate d2/db/d37/d40/ffd 970824 0 2022-02-02T18:21:30.262 INFO:tasks.workunit.client.0.smithi096.stdout:0/801: creat d2/db/d24/d89/d8f/da1/f10b x:0 0 0 2022-02-02T18:21:30.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/802: write d2/db/d24/d89/d8f/d95/dcd/dcf/dd6/fe3 [912920,122531] 0 2022-02-02T18:21:30.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/803: truncate d2/d62/f72 2063761 0 2022-02-02T18:21:30.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/804: write d2/db/d10/d27/f5b [1152182,1853] 0 2022-02-02T18:21:30.265 INFO:tasks.workunit.client.0.smithi096.stdout:3/659: dwrite d2/df/d20/f5b [0,4194304] 0 2022-02-02T18:21:30.265 INFO:tasks.workunit.client.0.smithi096.stdout:3/660: write d2/df/d14/d11/fc0 [1589130,17232] 0 2022-02-02T18:21:30.266 INFO:tasks.workunit.client.0.smithi096.stdout:0/805: write d2/db/d24/d89/d8f/da1/de9/f82 [4163348,114645] 0 2022-02-02T18:21:30.268 INFO:tasks.workunit.client.0.smithi096.stdout:8/598: dwrite d29/f2b [0,4194304] 0 2022-02-02T18:21:30.268 INFO:tasks.workunit.client.0.smithi096.stdout:8/599: creat d29/d2d/d42/fc1 x:0 0 0 2022-02-02T18:21:30.269 INFO:tasks.workunit.client.0.smithi096.stdout:0/806: unlink d2/db/d24/le8 0 2022-02-02T18:21:30.272 INFO:tasks.workunit.client.0.smithi096.stdout:0/807: symlink d2/db/d10/d80/d93/l10c 0 2022-02-02T18:21:30.272 INFO:tasks.workunit.client.0.smithi096.stdout:0/808: fdatasync d2/db/fda 0 2022-02-02T18:21:30.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/809: readlink d2/db/d24/d89/d8f/d95/dcd/lf1 0 2022-02-02T18:21:30.273 INFO:tasks.workunit.client.0.smithi096.stdout:8/600: dread f17 [0,4194304] 0 2022-02-02T18:21:30.275 INFO:tasks.workunit.client.0.smithi096.stdout:0/810: link d2/l59 d2/db/d24/d89/d8f/d95/dfb/l10d 0 2022-02-02T18:21:30.275 INFO:tasks.workunit.client.0.smithi096.stdout:8/601: mkdir d29/d4e/dad/dc2 0 2022-02-02T18:21:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:29 smithi159 conmon[35668]: cluster 2022-02-02T18:21:28.826188+0000 mgr.smithi096.shfutl 2022-02-02T18:21:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:29 smithi159 conmon[35668]: (mgr.14162) 269 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 109 MiB/s wr, 331 op/s 2022-02-02T18:21:30.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/811: creat d2/d1e/d67/f10e x:0 0 0 2022-02-02T18:21:30.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/812: write d2/db/d24/d89/d8f/d95/dcd/fef [5016396,7018] 0 2022-02-02T18:21:30.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/813: chown d2/db/d24/cf3 62897 1 2022-02-02T18:21:30.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/814: write d2/db/d7f/fed [4621445,3952] 0 2022-02-02T18:21:30.278 INFO:tasks.workunit.client.0.smithi096.stdout:6/747: dwrite d18/d24/d73/fe3 [0,4194304] 0 2022-02-02T18:21:30.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/815: rmdir d2/db/d24/d4d/d65 39 2022-02-02T18:21:30.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/748: symlink d18/d24/d73/dfb/l112 0 2022-02-02T18:21:30.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/664: dwrite d15/d1b/d26/d72/da3/da7/f99 [0,4194304] 0 2022-02-02T18:21:30.292 INFO:tasks.workunit.client.0.smithi096.stdout:0/816: dread d2/db/d37/fcb [0,4194304] 0 2022-02-02T18:21:30.293 INFO:tasks.workunit.client.0.smithi096.stdout:1/665: dread d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:30.293 INFO:tasks.workunit.client.0.smithi096.stdout:0/817: mknod d2/db/dde/c10f 0 2022-02-02T18:21:30.294 INFO:tasks.workunit.client.0.smithi096.stdout:0/818: creat d2/db/d24/d89/d8f/da1/f110 x:0 0 0 2022-02-02T18:21:30.294 INFO:tasks.workunit.client.0.smithi096.stdout:1/666: rmdir d15/d1b/d26/d72/da3/da7/ddc 39 2022-02-02T18:21:30.296 INFO:tasks.workunit.client.0.smithi096.stdout:0/819: rename d2/db/d37/f3e to d2/db/d24/d89/d8f/da1/f111 0 2022-02-02T18:21:30.298 INFO:tasks.workunit.client.0.smithi096.stdout:0/820: truncate d2/db/f19 373511 0 2022-02-02T18:21:30.299 INFO:tasks.workunit.client.0.smithi096.stdout:1/667: rmdir d15/d1b/d28/d3f 39 2022-02-02T18:21:30.300 INFO:tasks.workunit.client.0.smithi096.stdout:1/668: write ff [1778131,19382] 0 2022-02-02T18:21:30.301 INFO:tasks.workunit.client.0.smithi096.stdout:1/669: readlink d15/d1b/d28/d2c/d4f/d51/l55 0 2022-02-02T18:21:30.301 INFO:tasks.workunit.client.0.smithi096.stdout:1/670: fsync d15/d1b/d26/ff2 0 2022-02-02T18:21:30.301 INFO:tasks.workunit.client.0.smithi096.stdout:1/671: read - d15/d1b/d26/d72/da3/da7/fb2 zero size 2022-02-02T18:21:30.302 INFO:tasks.workunit.client.0.smithi096.stdout:1/672: mknod d15/d1b/d28/d2c/d4f/cf4 0 2022-02-02T18:21:30.302 INFO:tasks.workunit.client.0.smithi096.stdout:3/661: dwrite d2/df/da6/fb4 [0,4194304] 0 2022-02-02T18:21:30.303 INFO:tasks.workunit.client.0.smithi096.stdout:1/673: unlink d15/d1b/d28/c3a 0 2022-02-02T18:21:30.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/674: getdents d15/d1b/d28/d2c 0 2022-02-02T18:21:30.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/675: chown d15/d1b/d26/f49 1 1 2022-02-02T18:21:30.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/676: truncate d15/d1b/d26/d72/da3/da7/fb2 805782 0 2022-02-02T18:21:30.306 INFO:tasks.workunit.client.0.smithi096.stdout:6/749: dwrite d18/f8a [4194304,4194304] 0 2022-02-02T18:21:30.306 INFO:tasks.workunit.client.0.smithi096.stdout:8/602: dwrite f5 [4194304,4194304] 0 2022-02-02T18:21:30.307 INFO:tasks.workunit.client.0.smithi096.stdout:8/603: fsync d29/d4a/d5b/fbb 0 2022-02-02T18:21:30.307 INFO:tasks.workunit.client.0.smithi096.stdout:1/677: write d15/d1b/d28/d2c/f5a [144500,16123] 0 2022-02-02T18:21:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:29 smithi096 conmon[32067]: cluster 2022-02-02T18:21:28.826188 2022-02-02T18:21:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:29 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 269 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 109 MiB/s wr, 331 op/s 2022-02-02T18:21:30.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/750: dread d18/d50/d8f/dbb/fbc [0,4194304] 0 2022-02-02T18:21:30.311 INFO:tasks.workunit.client.0.smithi096.stdout:0/821: truncate d2/db/d7f/fed 746330 0 2022-02-02T18:21:30.313 INFO:tasks.workunit.client.0.smithi096.stdout:8/604: rename d29/d2d/d42/f59 to d29/d58/d63/fc3 0 2022-02-02T18:21:30.313 INFO:tasks.workunit.client.0.smithi096.stdout:8/605: write d29/d2d/d87/f97 [1027755,120970] 0 2022-02-02T18:21:30.317 INFO:tasks.workunit.client.0.smithi096.stdout:3/662: dwrite d2/df/d1c/db5/fc6 [0,4194304] 0 2022-02-02T18:21:30.317 INFO:tasks.workunit.client.0.smithi096.stdout:3/663: write d2/d71/fe4 [357480,48579] 0 2022-02-02T18:21:30.318 INFO:tasks.workunit.client.0.smithi096.stdout:0/822: symlink d2/db/d24/d89/l112 0 2022-02-02T18:21:30.319 INFO:tasks.workunit.client.0.smithi096.stdout:5/690: sync 2022-02-02T18:21:30.320 INFO:tasks.workunit.client.0.smithi096.stdout:1/678: rename d15/d1b/d28/f58 to d15/d1b/d28/d2c/d39/d6b/d8a/db9/ff5 0 2022-02-02T18:21:30.321 INFO:tasks.workunit.client.0.smithi096.stdout:1/679: fsync d15/d1b/d26/d72/da3/da7/fb2 0 2022-02-02T18:21:30.323 INFO:tasks.workunit.client.0.smithi096.stdout:6/751: rmdir d18/d24/d73/d79 39 2022-02-02T18:21:30.330 INFO:tasks.workunit.client.0.smithi096.stdout:2/753: sync 2022-02-02T18:21:30.330 INFO:tasks.workunit.client.0.smithi096.stdout:4/703: sync 2022-02-02T18:21:30.330 INFO:tasks.workunit.client.0.smithi096.stdout:7/615: sync 2022-02-02T18:21:30.331 INFO:tasks.workunit.client.0.smithi096.stdout:4/704: chown d3/d5a/d91 7 1 2022-02-02T18:21:30.331 INFO:tasks.workunit.client.0.smithi096.stdout:4/705: write d3/d4/d14/f4b [577012,22166] 0 2022-02-02T18:21:30.332 INFO:tasks.workunit.client.0.smithi096.stdout:2/754: write d2/d6/d1b/d8a/f92 [686556,128939] 0 2022-02-02T18:21:30.334 INFO:tasks.workunit.client.0.smithi096.stdout:3/664: creat d2/df/d20/fe5 x:0 0 0 2022-02-02T18:21:30.335 INFO:tasks.workunit.client.0.smithi096.stdout:3/665: truncate d2/df/d14/d16/fb0 349160 0 2022-02-02T18:21:30.335 INFO:tasks.workunit.client.0.smithi096.stdout:3/666: fdatasync d2/df/d14/d11/daa/fc2 0 2022-02-02T18:21:30.335 INFO:tasks.workunit.client.0.smithi096.stdout:5/691: mkdir db/de/d10/d25/d4c/df6 0 2022-02-02T18:21:30.335 INFO:tasks.workunit.client.0.smithi096.stdout:5/692: chown db/d5c/f5e 2036218732 1 2022-02-02T18:21:30.336 INFO:tasks.workunit.client.0.smithi096.stdout:5/693: chown db/da1/dcc 481 1 2022-02-02T18:21:30.336 INFO:tasks.workunit.client.0.smithi096.stdout:1/680: dwrite d15/d1b/d28/d2c/d39/d6b/d8a/db9/ff5 [0,4194304] 0 2022-02-02T18:21:30.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/606: rmdir d29/d58/d7a 39 2022-02-02T18:21:30.338 INFO:tasks.workunit.client.0.smithi096.stdout:3/667: write d2/df/d14/f50 [971332,37359] 0 2022-02-02T18:21:30.339 INFO:tasks.workunit.client.0.smithi096.stdout:9/739: sync 2022-02-02T18:21:30.339 INFO:tasks.workunit.client.0.smithi096.stdout:2/755: symlink d2/d19/d86/lea 0 2022-02-02T18:21:30.340 INFO:tasks.workunit.client.0.smithi096.stdout:1/681: dread d15/d1b/d28/d2c/f4c [0,4194304] 0 2022-02-02T18:21:30.341 INFO:tasks.workunit.client.0.smithi096.stdout:0/823: rename d2/db/d24/d89/d8f/d95/dcd/dcf to d2/db/d37/d113 0 2022-02-02T18:21:30.342 INFO:tasks.workunit.client.0.smithi096.stdout:6/752: getdents d18/d24/d28/d3e 0 2022-02-02T18:21:30.344 INFO:tasks.workunit.client.0.smithi096.stdout:3/668: creat d2/df/d1c/d5d/fe6 x:0 0 0 2022-02-02T18:21:30.345 INFO:tasks.workunit.client.0.smithi096.stdout:3/669: read d2/df/d20/d33/d58/d7c/fae [108375,9625] 0 2022-02-02T18:21:30.345 INFO:tasks.workunit.client.0.smithi096.stdout:3/670: chown d2/df/d1c/d5d/f48 278082744 1 2022-02-02T18:21:30.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/740: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/f108 x:0 0 0 2022-02-02T18:21:30.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/741: readlink d1/db/d1c/d2f/dac/le6 0 2022-02-02T18:21:30.346 INFO:tasks.workunit.client.0.smithi096.stdout:7/616: dwrite d9/df/d12/d39/d4e/d6e/f74 [0,4194304] 0 2022-02-02T18:21:30.347 INFO:tasks.workunit.client.0.smithi096.stdout:3/671: read d2/df/d20/f37 [1422580,105642] 0 2022-02-02T18:21:30.347 INFO:tasks.workunit.client.0.smithi096.stdout:3/672: creat d2/df/da6/fe7 x:0 0 0 2022-02-02T18:21:30.348 INFO:tasks.workunit.client.0.smithi096.stdout:7/617: write f2 [2512595,128080] 0 2022-02-02T18:21:30.349 INFO:tasks.workunit.client.0.smithi096.stdout:2/756: mknod d2/d6/d1b/d8a/ceb 0 2022-02-02T18:21:30.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/607: dread d29/fbf [0,4194304] 0 2022-02-02T18:21:30.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/694: link db/de/d10/d25/c6a db/de/d2e/cf7 0 2022-02-02T18:21:30.351 INFO:tasks.workunit.client.0.smithi096.stdout:1/682: mknod d15/d1b/d26/d72/da3/da7/ddc/d9f/cf6 0 2022-02-02T18:21:30.352 INFO:tasks.workunit.client.0.smithi096.stdout:2/757: dread d2/d5e/d6d/d79/d66/fa6 [0,4194304] 0 2022-02-02T18:21:30.354 INFO:tasks.workunit.client.0.smithi096.stdout:4/706: rename d3/d27/f8c to d3/d5a/db8/fee 0 2022-02-02T18:21:30.355 INFO:tasks.workunit.client.0.smithi096.stdout:0/824: creat d2/db/d10/d80/d93/da3/dca/f114 x:0 0 0 2022-02-02T18:21:30.356 INFO:tasks.workunit.client.0.smithi096.stdout:9/742: mknod d1/db/d1c/c109 0 2022-02-02T18:21:30.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/695: mknod db/de/d10/d27/cf8 0 2022-02-02T18:21:30.360 INFO:tasks.workunit.client.0.smithi096.stdout:8/608: mkdir d29/d2d/d87/dc4 0 2022-02-02T18:21:30.361 INFO:tasks.workunit.client.0.smithi096.stdout:2/758: unlink d2/c15 0 2022-02-02T18:21:30.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/618: rename d9/df/d12/f3f to d9/df/d16/d25/fd5 0 2022-02-02T18:21:30.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/619: dread - d9/df/d12/d39/d4e/fcc zero size 2022-02-02T18:21:30.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/609: creat d29/d4e/dad/db3/d6d/d85/fc5 x:0 0 0 2022-02-02T18:21:30.367 INFO:tasks.workunit.client.0.smithi096.stdout:2/759: mkdir d2/d13/d42/d71/dad/db0/dc7/dca/dec 0 2022-02-02T18:21:30.369 INFO:tasks.workunit.client.0.smithi096.stdout:7/620: write d9/df/d16/d25/d98/fbb [3965346,47357] 0 2022-02-02T18:21:30.370 INFO:tasks.workunit.client.0.smithi096.stdout:1/683: rename d15/d1b/d28/d2c/f38 to d15/d1b/d28/d2c/d4f/ff7 0 2022-02-02T18:21:30.370 INFO:tasks.workunit.client.0.smithi096.stdout:1/684: write d15/d1b/d28/d47/fe1 [1000663,93433] 0 2022-02-02T18:21:30.372 INFO:tasks.workunit.client.0.smithi096.stdout:3/673: dwrite d2/df/d1c/d5d/d69/f9c [0,4194304] 0 2022-02-02T18:21:30.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/685: link d15/d1b/d26/l2d d15/d1b/d28/d2c/d4f/d51/lf8 0 2022-02-02T18:21:30.376 INFO:tasks.workunit.client.0.smithi096.stdout:7/621: getdents d9/df/d12/d14/d82 0 2022-02-02T18:21:30.382 INFO:tasks.workunit.client.0.smithi096.stdout:1/686: chown d15/d1b/d28/d47/f63 1565793511 1 2022-02-02T18:21:30.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/622: write d9/df/d12/d39/d4e/d6e/f74 [1766908,23890] 0 2022-02-02T18:21:30.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/687: mknod d15/d1b/d26/d72/cf9 0 2022-02-02T18:21:30.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/610: dread d29/d2d/f77 [0,4194304] 0 2022-02-02T18:21:30.384 INFO:tasks.workunit.client.0.smithi096.stdout:7/623: link d9/df/d12/d39/d40/c78 d9/df/d47/d37/cd6 0 2022-02-02T18:21:30.385 INFO:tasks.workunit.client.0.smithi096.stdout:1/688: symlink d15/lfa 0 2022-02-02T18:21:30.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/611: link d29/d2d/f8b d29/d4e/dad/dc2/fc6 0 2022-02-02T18:21:30.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/624: stat d9/df/d12/d39/d40/l5e 0 2022-02-02T18:21:30.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/625: chown d9/df/d12/d39/d40/d85 157744050 1 2022-02-02T18:21:30.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/689: mknod d15/d1b/d26/d72/da3/da7/cfb 0 2022-02-02T18:21:30.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/612: link d29/d2d/f3d d29/d4e/dad/db3/d6d/d85/fc7 0 2022-02-02T18:21:30.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/613: fdatasync d29/d4e/dad/db3/d6d/d85/fc5 0 2022-02-02T18:21:30.390 INFO:tasks.workunit.client.0.smithi096.stdout:8/614: creat d29/d58/d79/fc8 x:0 0 0 2022-02-02T18:21:30.390 INFO:tasks.workunit.client.0.smithi096.stdout:7/626: mkdir d9/df/d12/d39/d46/d7d/dd7 0 2022-02-02T18:21:30.391 INFO:tasks.workunit.client.0.smithi096.stdout:8/615: creat d29/d2d/d87/da5/fc9 x:0 0 0 2022-02-02T18:21:30.391 INFO:tasks.workunit.client.0.smithi096.stdout:8/616: fsync f19 0 2022-02-02T18:21:30.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/627: mknod d9/df/d16/d25/d98/cd8 0 2022-02-02T18:21:30.392 INFO:tasks.workunit.client.0.smithi096.stdout:8/617: rmdir d29/d58 39 2022-02-02T18:21:30.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/618: write d29/d2d/fbc [46062,38854] 0 2022-02-02T18:21:30.393 INFO:tasks.workunit.client.0.smithi096.stdout:7/628: creat d9/df/d54/db8/fd9 x:0 0 0 2022-02-02T18:21:30.394 INFO:tasks.workunit.client.0.smithi096.stdout:7/629: chown d9/df/d16/d25/l92 2108965996 1 2022-02-02T18:21:30.394 INFO:tasks.workunit.client.0.smithi096.stdout:8/619: truncate d29/d2d/f48 2572668 0 2022-02-02T18:21:30.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/753: dwrite d18/f3a [0,4194304] 0 2022-02-02T18:21:30.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/754: readlink lc 0 2022-02-02T18:21:30.396 INFO:tasks.workunit.client.0.smithi096.stdout:8/620: mkdir d29/d4a/d5b/dca 0 2022-02-02T18:21:30.396 INFO:tasks.workunit.client.0.smithi096.stdout:8/621: stat d29/d2d/d87/da5/fc9 0 2022-02-02T18:21:30.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/696: dwrite db/de/d10/d27/d83/fec [0,4194304] 0 2022-02-02T18:21:30.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/707: dwrite d3/d4/d14/f9e [0,4194304] 0 2022-02-02T18:21:30.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/622: write f23 [3310705,32561] 0 2022-02-02T18:21:30.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/623: chown d29/d58/d79/fc8 1668295919 1 2022-02-02T18:21:30.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/624: write d29/d2d/d42/fc1 [21444,120313] 0 2022-02-02T18:21:30.399 INFO:tasks.workunit.client.0.smithi096.stdout:9/743: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:30.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/674: dwrite d2/df/d14/f18 [4194304,4194304] 0 2022-02-02T18:21:30.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/675: write d2/df/d1c/d5d/f79 [903373,96349] 0 2022-02-02T18:21:30.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/676: chown d2/df/d20/fe5 687922447 1 2022-02-02T18:21:30.401 INFO:tasks.workunit.client.0.smithi096.stdout:3/677: creat d2/d71/fe8 x:0 0 0 2022-02-02T18:21:30.401 INFO:tasks.workunit.client.0.smithi096.stdout:7/630: write d9/df/d16/d25/d98/fae [2428166,80340] 0 2022-02-02T18:21:30.402 INFO:tasks.workunit.client.0.smithi096.stdout:1/690: dread d15/d1b/d28/fc6 [0,4194304] 0 2022-02-02T18:21:30.410 INFO:tasks.workunit.client.0.smithi096.stdout:5/697: rename db/d5c/d2f/d46/d75/d9d/fce to db/de/d10/d25/d4c/dd8/ff9 0 2022-02-02T18:21:30.411 INFO:tasks.workunit.client.0.smithi096.stdout:4/708: creat d3/d4/d20/d26/d36/d88/dd8/de1/fef x:0 0 0 2022-02-02T18:21:30.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/709: fsync d3/d4/d14/f66 0 2022-02-02T18:21:30.412 INFO:tasks.workunit.client.0.smithi096.stdout:8/625: mknod d29/d4e/dad/ccb 0 2022-02-02T18:21:30.415 INFO:tasks.workunit.client.0.smithi096.stdout:9/744: getdents d1/db/d1c/d2f/dac 0 2022-02-02T18:21:30.416 INFO:tasks.workunit.client.0.smithi096.stdout:6/755: dwrite d18/d50/d8f/dbb/f39 [0,4194304] 0 2022-02-02T18:21:30.419 INFO:tasks.workunit.client.0.smithi096.stdout:3/678: rmdir d2/df/d14/d66 39 2022-02-02T18:21:30.419 INFO:tasks.workunit.client.0.smithi096.stdout:3/679: truncate d2/df/d36/f68 4324169 0 2022-02-02T18:21:30.420 INFO:tasks.workunit.client.0.smithi096.stdout:1/691: mknod d15/d1b/d26/d59/cfc 0 2022-02-02T18:21:30.421 INFO:tasks.workunit.client.0.smithi096.stdout:1/692: write d15/d1b/d28/d2c/d39/d6b/d8a/db9/ff5 [1745678,119169] 0 2022-02-02T18:21:30.422 INFO:tasks.workunit.client.0.smithi096.stdout:1/693: read d15/d1b/d28/d47/f63 [94868,119011] 0 2022-02-02T18:21:30.423 INFO:tasks.workunit.client.0.smithi096.stdout:1/694: truncate d15/d1b/fbf 807297 0 2022-02-02T18:21:30.429 INFO:tasks.workunit.client.0.smithi096.stdout:4/710: dwrite d3/d5a/f68 [0,4194304] 0 2022-02-02T18:21:30.432 INFO:tasks.workunit.client.0.smithi096.stdout:8/626: truncate d29/d4e/dad/db3/f44 147634 0 2022-02-02T18:21:30.432 INFO:tasks.workunit.client.0.smithi096.stdout:8/627: stat d29/d58/d7a/f91 0 2022-02-02T18:21:30.434 INFO:tasks.workunit.client.0.smithi096.stdout:9/745: creat d1/db/d1c/d2f/d78/d11/f10a x:0 0 0 2022-02-02T18:21:30.436 INFO:tasks.workunit.client.0.smithi096.stdout:6/756: mkdir d18/d50/d6d/d113 0 2022-02-02T18:21:30.438 INFO:tasks.workunit.client.0.smithi096.stdout:1/695: creat d15/d1b/d26/d72/da3/da7/ffd x:0 0 0 2022-02-02T18:21:30.439 INFO:tasks.workunit.client.0.smithi096.stdout:1/696: write d15/d1b/d28/d2c/d39/d6b/d8a/fa6 [3658176,110763] 0 2022-02-02T18:21:30.440 INFO:tasks.workunit.client.0.smithi096.stdout:1/697: creat d15/d1b/d26/d59/ffe x:0 0 0 2022-02-02T18:21:30.443 INFO:tasks.workunit.client.0.smithi096.stdout:5/698: rename db/d5c/d2f/d46 to db/de/d10/d25/d4c/dd8/def/dc2/dfa 0 2022-02-02T18:21:30.444 INFO:tasks.workunit.client.0.smithi096.stdout:5/699: creat db/de/d10/d27/d83/ffb x:0 0 0 2022-02-02T18:21:30.446 INFO:tasks.workunit.client.0.smithi096.stdout:6/757: symlink d18/d24/d28/d4a/db8/l114 0 2022-02-02T18:21:30.446 INFO:tasks.workunit.client.0.smithi096.stdout:6/758: truncate d18/d50/d8f/dbb/d63/db3/fcf 959814 0 2022-02-02T18:21:30.452 INFO:tasks.workunit.client.0.smithi096.stdout:8/628: dwrite d29/f34 [0,4194304] 0 2022-02-02T18:21:30.453 INFO:tasks.workunit.client.0.smithi096.stdout:8/629: dread - d29/d4e/dad/fb0 zero size 2022-02-02T18:21:30.453 INFO:tasks.workunit.client.0.smithi096.stdout:3/680: rename d2/df/d14/c2a to d2/df/da6/ce9 0 2022-02-02T18:21:30.455 INFO:tasks.workunit.client.0.smithi096.stdout:5/700: dread db/de/f54 [0,4194304] 0 2022-02-02T18:21:30.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/759: dread d18/d24/d28/d3e/fd7 [0,4194304] 0 2022-02-02T18:21:30.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/711: rmdir d3/d60 39 2022-02-02T18:21:30.463 INFO:tasks.workunit.client.0.smithi096.stdout:6/760: read d18/d50/d8f/df1/f10c [1806042,82685] 0 2022-02-02T18:21:30.463 INFO:tasks.workunit.client.0.smithi096.stdout:5/701: dread db/de/d10/d25/d4c/dd8/def/dc2/dfa/f73 [0,4194304] 0 2022-02-02T18:21:30.463 INFO:tasks.workunit.client.0.smithi096.stdout:5/702: read - db/de/d10/d80/fee zero size 2022-02-02T18:21:30.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/712: link d3/d4/d20/d26/f34 d3/d4/d20/d26/d36/d51/d57/ff0 0 2022-02-02T18:21:30.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/761: link d18/d50/d9a/f10d d18/d24/d28/d4a/db8/f115 0 2022-02-02T18:21:30.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/703: symlink db/de/d10/d25/d4c/dd8/lfc 0 2022-02-02T18:21:30.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/704: read - db/d5c/d2f/fc7 zero size 2022-02-02T18:21:30.471 INFO:tasks.workunit.client.0.smithi096.stdout:6/762: mkdir d18/d50/d9a/d116 0 2022-02-02T18:21:30.472 INFO:tasks.workunit.client.0.smithi096.stdout:5/705: rmdir db/de/d10/d25/d4c/de6 39 2022-02-02T18:21:30.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/698: rename d15/d1b/d28/d2c/d39/d6b to d15/d1b/d26/d72/dff 0 2022-02-02T18:21:30.475 INFO:tasks.workunit.client.0.smithi096.stdout:6/763: mkdir d18/d50/d8f/dbb/d63/dc2/d117 0 2022-02-02T18:21:30.479 INFO:tasks.workunit.client.0.smithi096.stdout:4/713: dread d3/d85/fc7 [0,4194304] 0 2022-02-02T18:21:30.479 INFO:tasks.workunit.client.0.smithi096.stdout:4/714: dread - d3/d4/d20/d26/d36/d51/d57/dcf/fe3 zero size 2022-02-02T18:21:30.483 INFO:tasks.workunit.client.0.smithi096.stdout:4/715: creat d3/d60/d8d/ff1 x:0 0 0 2022-02-02T18:21:30.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/630: rename d29/d4a to d29/d4e/dad/dcc 0 2022-02-02T18:21:30.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/631: unlink d29/d2d/f3d 0 2022-02-02T18:21:30.485 INFO:tasks.workunit.client.0.smithi096.stdout:4/716: rename d3/f5d to d3/d4/d14/ff2 0 2022-02-02T18:21:30.486 INFO:tasks.workunit.client.0.smithi096.stdout:4/717: write d3/d4/d20/d26/d36/d51/fc1 [585202,106059] 0 2022-02-02T18:21:30.490 INFO:tasks.workunit.client.0.smithi096.stdout:0/825: sync 2022-02-02T18:21:30.493 INFO:tasks.workunit.client.0.smithi096.stdout:0/826: mknod d2/db/d37/d113/dd6/c115 0 2022-02-02T18:21:30.496 INFO:tasks.workunit.client.0.smithi096.stdout:0/827: creat d2/db/d37/d113/df6/f116 x:0 0 0 2022-02-02T18:21:30.497 INFO:tasks.workunit.client.0.smithi096.stdout:0/828: symlink d2/db/d24/d4d/d61/l117 0 2022-02-02T18:21:30.499 INFO:tasks.workunit.client.0.smithi096.stdout:0/829: unlink d2/d1e/d67/f9e 0 2022-02-02T18:21:30.499 INFO:tasks.workunit.client.0.smithi096.stdout:0/830: rmdir d2/db/d37/d113/dd6 39 2022-02-02T18:21:30.501 INFO:tasks.workunit.client.0.smithi096.stdout:0/831: creat d2/db/d37/d40/d8a/f118 x:0 0 0 2022-02-02T18:21:30.502 INFO:tasks.workunit.client.0.smithi096.stdout:0/832: creat d2/db/d37/d5f/f119 x:0 0 0 2022-02-02T18:21:30.511 INFO:tasks.workunit.client.0.smithi096.stdout:5/706: dwrite db/de/d2e/d35/f34 [0,4194304] 0 2022-02-02T18:21:30.512 INFO:tasks.workunit.client.0.smithi096.stdout:1/699: dwrite d15/d1b/d28/f4a [0,4194304] 0 2022-02-02T18:21:30.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/700: creat d15/d4d/f100 x:0 0 0 2022-02-02T18:21:30.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/701: creat d15/d1b/d28/d2c/d4f/d51/f101 x:0 0 0 2022-02-02T18:21:30.514 INFO:tasks.workunit.client.0.smithi096.stdout:6/764: dwrite d18/f19 [4194304,4194304] 0 2022-02-02T18:21:30.514 INFO:tasks.workunit.client.0.smithi096.stdout:4/718: dwrite d3/d4/d14/f9e [4194304,4194304] 0 2022-02-02T18:21:30.514 INFO:tasks.workunit.client.0.smithi096.stdout:4/719: write d3/d60/dc2/fe0 [1021281,6632] 0 2022-02-02T18:21:30.515 INFO:tasks.workunit.client.0.smithi096.stdout:8/632: dwrite d29/d2d/d87/fa9 [0,4194304] 0 2022-02-02T18:21:30.515 INFO:tasks.workunit.client.0.smithi096.stdout:8/633: chown d29/d58/d79/c92 22533 1 2022-02-02T18:21:30.516 INFO:tasks.workunit.client.0.smithi096.stdout:5/707: rename db/d5c/caf to db/d5c/d2f/db7/cfd 0 2022-02-02T18:21:30.516 INFO:tasks.workunit.client.0.smithi096.stdout:1/702: symlink d15/d1b/d26/d59/dd2/l102 0 2022-02-02T18:21:30.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/720: write d3/d5a/f68 [2998211,68304] 0 2022-02-02T18:21:30.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/721: chown d3/d4/d20/d26/d36/f56 9327 1 2022-02-02T18:21:30.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/765: mkdir d18/d50/d9a/d116/d118 0 2022-02-02T18:21:30.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/766: readlink d18/d24/l5a 0 2022-02-02T18:21:30.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/708: mkdir db/de/d10/d25/da0/dfe 0 2022-02-02T18:21:30.521 INFO:tasks.workunit.client.0.smithi096.stdout:1/703: creat d15/d1b/f103 x:0 0 0 2022-02-02T18:21:30.524 INFO:tasks.workunit.client.0.smithi096.stdout:4/722: creat d3/ff3 x:0 0 0 2022-02-02T18:21:30.525 INFO:tasks.workunit.client.0.smithi096.stdout:4/723: read d3/d4/d20/d26/d36/d51/f86 [1254290,95346] 0 2022-02-02T18:21:30.525 INFO:tasks.workunit.client.0.smithi096.stdout:6/767: creat d18/d24/d28/d4a/db8/f119 x:0 0 0 2022-02-02T18:21:30.526 INFO:tasks.workunit.client.0.smithi096.stdout:6/768: dread - d18/d50/d8f/dbb/fa6 zero size 2022-02-02T18:21:30.526 INFO:tasks.workunit.client.0.smithi096.stdout:0/833: dwrite d2/db/d24/d89/d8f/da1/de9/fe7 [0,4194304] 0 2022-02-02T18:21:30.528 INFO:tasks.workunit.client.0.smithi096.stdout:6/769: mknod d18/d50/d8f/c11a 0 2022-02-02T18:21:30.530 INFO:tasks.workunit.client.0.smithi096.stdout:4/724: dread d3/d5a/f5f [0,4194304] 0 2022-02-02T18:21:30.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/709: dread db/de/f2a [0,4194304] 0 2022-02-02T18:21:30.539 INFO:tasks.workunit.client.0.smithi096.stdout:8/634: dwrite d29/d2d/f2e [0,4194304] 0 2022-02-02T18:21:30.540 INFO:tasks.workunit.client.0.smithi096.stdout:0/834: mknod d2/db/d10/d80/d93/da3/ddc/c11a 0 2022-02-02T18:21:30.540 INFO:tasks.workunit.client.0.smithi096.stdout:1/704: dwrite d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:30.541 INFO:tasks.workunit.client.0.smithi096.stdout:1/705: chown d15/d1b/d28/d2c/d4f/cf4 1330732229 1 2022-02-02T18:21:30.542 INFO:tasks.workunit.client.0.smithi096.stdout:4/725: rename d3/d4/d14 to d3/d4/d20/d26/d36/d88/dde/df4 0 2022-02-02T18:21:30.542 INFO:tasks.workunit.client.0.smithi096.stdout:5/710: write db/de/d10/d80/fd0 [907632,15789] 0 2022-02-02T18:21:30.542 INFO:tasks.workunit.client.0.smithi096.stdout:5/711: chown db/d20/fc1 3001346 1 2022-02-02T18:21:30.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/712: write db/de/d2e/d35/fdb [1046129,117406] 0 2022-02-02T18:21:30.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/713: fdatasync db/d20/f29 0 2022-02-02T18:21:30.544 INFO:tasks.workunit.client.0.smithi096.stdout:4/726: write d3/d4/d20/d26/f2f [3352756,101093] 0 2022-02-02T18:21:30.545 INFO:tasks.workunit.client.0.smithi096.stdout:4/727: truncate d3/d4/f23 4264334 0 2022-02-02T18:21:30.545 INFO:tasks.workunit.client.0.smithi096.stdout:4/728: fdatasync d3/d4/d20/d4d/f5b 0 2022-02-02T18:21:30.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/631: sync 2022-02-02T18:21:30.548 INFO:tasks.workunit.client.0.smithi096.stdout:2/760: sync 2022-02-02T18:21:30.549 INFO:tasks.workunit.client.0.smithi096.stdout:7/632: write d9/f8d [495455,74140] 0 2022-02-02T18:21:30.549 INFO:tasks.workunit.client.0.smithi096.stdout:8/635: symlink d29/d2d/d42/lcd 0 2022-02-02T18:21:30.553 INFO:tasks.workunit.client.0.smithi096.stdout:0/835: rename d2/db/d7f/c8b to d2/d62/c11b 0 2022-02-02T18:21:30.554 INFO:tasks.workunit.client.0.smithi096.stdout:3/681: sync 2022-02-02T18:21:30.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/746: sync 2022-02-02T18:21:30.555 INFO:tasks.workunit.client.0.smithi096.stdout:3/682: dread - d2/df/d20/fe5 zero size 2022-02-02T18:21:30.555 INFO:tasks.workunit.client.0.smithi096.stdout:3/683: stat d2/df/d1c/d5d/d69/l21 0 2022-02-02T18:21:30.555 INFO:tasks.workunit.client.0.smithi096.stdout:9/747: write d1/db/d1c/d2f/d78/d11/d1e/d38/fec [73023,14846] 0 2022-02-02T18:21:30.555 INFO:tasks.workunit.client.0.smithi096.stdout:9/748: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f83 0 2022-02-02T18:21:30.556 INFO:tasks.workunit.client.0.smithi096.stdout:5/714: getdents db/de/d10/d25/d4c/dd8 0 2022-02-02T18:21:30.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/729: creat d3/d4/d20/d26/d36/d88/dde/ff5 x:0 0 0 2022-02-02T18:21:30.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/761: creat d2/d13/fed x:0 0 0 2022-02-02T18:21:30.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/762: write d2/d13/d43/d51/d73/da9/faa [568438,110248] 0 2022-02-02T18:21:30.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/633: creat d9/df/d12/d39/d4e/d6e/fda x:0 0 0 2022-02-02T18:21:30.558 INFO:tasks.workunit.client.0.smithi096.stdout:8/636: mkdir d29/d2d/d87/dc4/dce 0 2022-02-02T18:21:30.559 INFO:tasks.workunit.client.0.smithi096.stdout:2/763: dread d2/d6/d1b/f89 [0,4194304] 0 2022-02-02T18:21:30.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/836: mkdir d2/db/d24/d89/d8f/d95/d11c 0 2022-02-02T18:21:30.561 INFO:tasks.workunit.client.0.smithi096.stdout:3/684: truncate d2/df/d36/f68 4076830 0 2022-02-02T18:21:30.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/749: rename d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f5b to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f10b 0 2022-02-02T18:21:30.562 INFO:tasks.workunit.client.0.smithi096.stdout:5/715: rmdir db/de/d10/d25/d4c/dd8/def/dc2/dfa 39 2022-02-02T18:21:30.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/634: symlink d9/df/d12/d39/d46/d7d/dd7/ldb 0 2022-02-02T18:21:30.565 INFO:tasks.workunit.client.0.smithi096.stdout:3/685: symlink d2/df/d20/d33/d58/lea 0 2022-02-02T18:21:30.567 INFO:tasks.workunit.client.0.smithi096.stdout:9/750: mkdir d1/db/d1c/d2f/d78/d11/d1e/d47/df3/d10c 0 2022-02-02T18:21:30.570 INFO:tasks.workunit.client.0.smithi096.stdout:3/686: dread d2/df/d14/d11/fb7 [0,4194304] 0 2022-02-02T18:21:30.573 INFO:tasks.workunit.client.0.smithi096.stdout:7/635: mkdir d9/df/d16/ddc 0 2022-02-02T18:21:30.574 INFO:tasks.workunit.client.0.smithi096.stdout:2/764: getdents d2/d6/d1b/d48 0 2022-02-02T18:21:30.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/751: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/fa7 [2015905,46500] 0 2022-02-02T18:21:30.578 INFO:tasks.workunit.client.0.smithi096.stdout:5/716: getdents db/de/d10/d25 0 2022-02-02T18:21:30.582 INFO:tasks.workunit.client.0.smithi096.stdout:9/752: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/c10d 0 2022-02-02T18:21:30.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/636: dread d9/df/d12/d39/d42/f5b [0,4194304] 0 2022-02-02T18:21:30.583 INFO:tasks.workunit.client.0.smithi096.stdout:5/717: link db/d5c/d2f/ccf db/de/d10/d25/d4c/df6/cff 0 2022-02-02T18:21:30.584 INFO:tasks.workunit.client.0.smithi096.stdout:3/687: link d2/df/d14/d16/cc9 d2/df/d1c/ceb 0 2022-02-02T18:21:30.585 INFO:tasks.workunit.client.0.smithi096.stdout:5/718: dread db/de/d10/d25/d4c/f65 [0,4194304] 0 2022-02-02T18:21:30.587 INFO:tasks.workunit.client.0.smithi096.stdout:5/719: creat db/de/d10/d25/f100 x:0 0 0 2022-02-02T18:21:30.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/720: write db/d20/f29 [5167944,84910] 0 2022-02-02T18:21:30.590 INFO:tasks.workunit.client.0.smithi096.stdout:3/688: write d2/df/da6/fb4 [2455871,72745] 0 2022-02-02T18:21:30.595 INFO:tasks.workunit.client.0.smithi096.stdout:4/730: dwrite d3/d5a/f68 [4194304,4194304] 0 2022-02-02T18:21:30.596 INFO:tasks.workunit.client.0.smithi096.stdout:0/837: dwrite d2/db/d10/d80/d93/da3/ddc/fe6 [0,4194304] 0 2022-02-02T18:21:30.598 INFO:tasks.workunit.client.0.smithi096.stdout:4/731: truncate d3/d60/d8d/da7/f8f 836880 0 2022-02-02T18:21:30.598 INFO:tasks.workunit.client.0.smithi096.stdout:4/732: chown d3/l15 32326 1 2022-02-02T18:21:30.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/838: symlink d2/db/l11d 0 2022-02-02T18:21:30.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/839: dread d2/db/d24/f90 [0,4194304] 0 2022-02-02T18:21:30.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/840: symlink d2/db/d24/d89/d8f/d95/dc5/l11e 0 2022-02-02T18:21:30.620 INFO:tasks.workunit.client.0.smithi096.stdout:0/841: truncate d2/d1e/f35 4243338 0 2022-02-02T18:21:30.621 INFO:tasks.workunit.client.0.smithi096.stdout:0/842: getdents d2/db/d37/d113/dd6 0 2022-02-02T18:21:30.621 INFO:tasks.workunit.client.0.smithi096.stdout:0/843: dread - d2/db/d37/fd7 zero size 2022-02-02T18:21:30.621 INFO:tasks.workunit.client.0.smithi096.stdout:0/844: fsync d2/db/d24/d89/d8f/da1/f110 0 2022-02-02T18:21:30.622 INFO:tasks.workunit.client.0.smithi096.stdout:8/637: dwrite d29/fa4 [0,4194304] 0 2022-02-02T18:21:30.622 INFO:tasks.workunit.client.0.smithi096.stdout:8/638: truncate fc 12808618 0 2022-02-02T18:21:30.626 INFO:tasks.workunit.client.0.smithi096.stdout:8/639: link d29/f3a d29/d58/d63/fcf 0 2022-02-02T18:21:30.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/637: dwrite d9/df/d47/d37/d83/db1/fc2 [0,4194304] 0 2022-02-02T18:21:30.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/638: chown d9/df/d12/d39/d4e/c80 463820085 1 2022-02-02T18:21:30.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/639: creat d9/df/d12/d14/fdd x:0 0 0 2022-02-02T18:21:30.650 INFO:tasks.workunit.client.0.smithi096.stdout:9/753: dwrite d1/f36 [0,4194304] 0 2022-02-02T18:21:30.651 INFO:tasks.workunit.client.0.smithi096.stdout:3/689: dwrite d2/df/d20/d4a/f62 [0,4194304] 0 2022-02-02T18:21:30.651 INFO:tasks.workunit.client.0.smithi096.stdout:5/721: dwrite db/de/d10/d25/da0/fd1 [0,4194304] 0 2022-02-02T18:21:30.652 INFO:tasks.workunit.client.0.smithi096.stdout:7/640: creat d9/df/d47/dd3/fde x:0 0 0 2022-02-02T18:21:30.653 INFO:tasks.workunit.client.0.smithi096.stdout:0/845: dwrite d2/db/d24/d89/d8f/fb6 [4194304,4194304] 0 2022-02-02T18:21:30.653 INFO:tasks.workunit.client.0.smithi096.stdout:0/846: write d2/db/d10/d80/f109 [598693,111061] 0 2022-02-02T18:21:30.654 INFO:tasks.workunit.client.0.smithi096.stdout:9/754: rename d1/db/d1c/d2f/f54 to d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f10e 0 2022-02-02T18:21:30.655 INFO:tasks.workunit.client.0.smithi096.stdout:3/690: symlink d2/df/d14/d2c/d31/lec 0 2022-02-02T18:21:30.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/770: sync 2022-02-02T18:21:30.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/771: chown d18/d50/l68 30003 1 2022-02-02T18:21:30.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/772: dread d18/d24/d28/d4a/db8/fd6 [0,4194304] 0 2022-02-02T18:21:30.665 INFO:tasks.workunit.client.0.smithi096.stdout:3/691: dread d2/df/d14/d2c/d31/fbb [0,4194304] 0 2022-02-02T18:21:30.667 INFO:tasks.workunit.client.0.smithi096.stdout:7/641: mknod d9/df/d47/d19/cdf 0 2022-02-02T18:21:30.670 INFO:tasks.workunit.client.0.smithi096.stdout:1/706: sync 2022-02-02T18:21:30.673 INFO:tasks.workunit.client.0.smithi096.stdout:3/692: dread d2/df/f3e [0,4194304] 0 2022-02-02T18:21:30.674 INFO:tasks.workunit.client.0.smithi096.stdout:6/773: rename d18/d50/d8f/dbb/f104 to d18/d24/d73/dfb/f11b 0 2022-02-02T18:21:30.675 INFO:tasks.workunit.client.0.smithi096.stdout:0/847: dwrite d2/db/d24/d89/d91/fa4 [0,4194304] 0 2022-02-02T18:21:30.675 INFO:tasks.workunit.client.0.smithi096.stdout:0/848: truncate d2/db/d37/d113/dd6/fc2 437043 0 2022-02-02T18:21:30.675 INFO:tasks.workunit.client.0.smithi096.stdout:5/722: rmdir db/dbd 39 2022-02-02T18:21:30.676 INFO:tasks.workunit.client.0.smithi096.stdout:3/693: write d2/df/d20/d33/f51 [1740455,2210] 0 2022-02-02T18:21:30.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/694: fdatasync d2/df/d36/d8d/fd9 0 2022-02-02T18:21:30.677 INFO:tasks.workunit.client.0.smithi096.stdout:7/642: rmdir d9/df/d16/ddc 0 2022-02-02T18:21:30.678 INFO:tasks.workunit.client.0.smithi096.stdout:7/643: creat d9/df/d12/d39/d40/d85/fe0 x:0 0 0 2022-02-02T18:21:30.679 INFO:tasks.workunit.client.0.smithi096.stdout:1/707: link d15/d1b/d26/d72/fad d15/d1b/f104 0 2022-02-02T18:21:30.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/774: creat d18/d24/d73/d79/f11c x:0 0 0 2022-02-02T18:21:30.682 INFO:tasks.workunit.client.0.smithi096.stdout:0/849: link d2/db/d24/d4d/faa d2/d1e/d67/f11f 0 2022-02-02T18:21:30.685 INFO:tasks.workunit.client.0.smithi096.stdout:1/708: creat d15/d1b/d28/d2c/d4f/f105 x:0 0 0 2022-02-02T18:21:30.685 INFO:tasks.workunit.client.0.smithi096.stdout:1/709: creat d15/d1b/d26/d72/f106 x:0 0 0 2022-02-02T18:21:30.685 INFO:tasks.workunit.client.0.smithi096.stdout:1/710: write d15/d1b/d26/d72/f7f [203625,76505] 0 2022-02-02T18:21:30.696 INFO:tasks.workunit.client.0.smithi096.stdout:7/644: dread d9/df/d12/d39/d46/d7d/fc5 [0,4194304] 0 2022-02-02T18:21:30.708 INFO:tasks.workunit.client.0.smithi096.stdout:5/723: dwrite db/d5c/d61/f8b [0,4194304] 0 2022-02-02T18:21:30.709 INFO:tasks.workunit.client.0.smithi096.stdout:3/695: dwrite d2/df/d20/d33/d58/d7c/faf [0,4194304] 0 2022-02-02T18:21:30.710 INFO:tasks.workunit.client.0.smithi096.stdout:3/696: readlink d2/df/d14/l70 0 2022-02-02T18:21:30.710 INFO:tasks.workunit.client.0.smithi096.stdout:0/850: dwrite d2/db/d7f/fed [0,4194304] 0 2022-02-02T18:21:30.713 INFO:tasks.workunit.client.0.smithi096.stdout:5/724: mknod db/de/d10/d80/c101 0 2022-02-02T18:21:30.713 INFO:tasks.workunit.client.0.smithi096.stdout:5/725: fdatasync db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/fd3 0 2022-02-02T18:21:30.714 INFO:tasks.workunit.client.0.smithi096.stdout:5/726: creat db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/f102 x:0 0 0 2022-02-02T18:21:30.715 INFO:tasks.workunit.client.0.smithi096.stdout:5/727: symlink db/d5c/d2f/db7/l103 0 2022-02-02T18:21:30.732 INFO:tasks.workunit.client.0.smithi096.stdout:0/851: dwrite d2/d1e/f36 [0,4194304] 0 2022-02-02T18:21:30.733 INFO:tasks.workunit.client.0.smithi096.stdout:0/852: creat d2/db/d24/d89/d8f/d95/dcd/f120 x:0 0 0 2022-02-02T18:21:30.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/728: dwrite db/de/d10/d27/ff1 [0,4194304] 0 2022-02-02T18:21:30.734 INFO:tasks.workunit.client.0.smithi096.stdout:0/853: symlink d2/db/d24/d4d/d53/d58/l121 0 2022-02-02T18:21:30.736 INFO:tasks.workunit.client.0.smithi096.stdout:0/854: dread d2/db/d10/f39 [0,4194304] 0 2022-02-02T18:21:30.750 INFO:tasks.workunit.client.0.smithi096.stdout:2/765: sync 2022-02-02T18:21:30.751 INFO:tasks.workunit.client.0.smithi096.stdout:8/640: sync 2022-02-02T18:21:30.751 INFO:tasks.workunit.client.0.smithi096.stdout:4/733: sync 2022-02-02T18:21:30.751 INFO:tasks.workunit.client.0.smithi096.stdout:4/734: truncate d3/d4/d20/d26/d36/d51/f53 4699738 0 2022-02-02T18:21:30.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/641: link d29/d4e/dad/db3/d6d/d85/fc7 d29/d4e/dad/dcc/d5b/dca/fd0 0 2022-02-02T18:21:30.753 INFO:tasks.workunit.client.0.smithi096.stdout:8/642: mkdir d29/d4e/dad/dcc/d5b/dd1 0 2022-02-02T18:21:30.758 INFO:tasks.workunit.client.0.smithi096.stdout:0/855: dwrite d2/db/d10/d80/d93/da3/fb2 [0,4194304] 0 2022-02-02T18:21:30.760 INFO:tasks.workunit.client.0.smithi096.stdout:0/856: symlink d2/db/d10/d80/d93/l122 0 2022-02-02T18:21:30.762 INFO:tasks.workunit.client.0.smithi096.stdout:0/857: write d2/db/d7f/fed [3900502,36808] 0 2022-02-02T18:21:30.763 INFO:tasks.workunit.client.0.smithi096.stdout:0/858: symlink d2/d1e/d67/l123 0 2022-02-02T18:21:30.763 INFO:tasks.workunit.client.0.smithi096.stdout:0/859: chown d2/db/d24/d89/d8f 352908 1 2022-02-02T18:21:30.767 INFO:tasks.workunit.client.0.smithi096.stdout:2/766: dwrite d2/d13/fed [0,4194304] 0 2022-02-02T18:21:30.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/767: creat d2/fee x:0 0 0 2022-02-02T18:21:30.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/768: chown d2/d13/l7b 7 1 2022-02-02T18:21:30.772 INFO:tasks.workunit.client.0.smithi096.stdout:2/769: write d2/d6/d1b/d8a/f92 [1394469,105375] 0 2022-02-02T18:21:30.772 INFO:tasks.workunit.client.0.smithi096.stdout:2/770: mknod d2/d13/d43/d51/d5d/cef 0 2022-02-02T18:21:30.774 INFO:tasks.workunit.client.0.smithi096.stdout:2/771: dread d2/d5e/d6d/d79/d66/fa6 [0,4194304] 0 2022-02-02T18:21:30.775 INFO:tasks.workunit.client.0.smithi096.stdout:2/772: write d2/d6/d1b/d3a/f44 [3086205,100330] 0 2022-02-02T18:21:30.776 INFO:tasks.workunit.client.0.smithi096.stdout:9/755: sync 2022-02-02T18:21:30.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/860: dread d2/db/d24/d89/d8f/da1/de9/f82 [0,4194304] 0 2022-02-02T18:21:30.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/861: creat d2/db/d10/d80/d93/da3/dca/f124 x:0 0 0 2022-02-02T18:21:30.777 INFO:tasks.workunit.client.0.smithi096.stdout:9/756: dread d1/db/d1c/d2f/d78/d11/d1e/d38/fec [0,4194304] 0 2022-02-02T18:21:30.777 INFO:tasks.workunit.client.0.smithi096.stdout:9/757: fdatasync d1/db/d1c/d2f/d78/d25/d8e/fb8 0 2022-02-02T18:21:30.778 INFO:tasks.workunit.client.0.smithi096.stdout:9/758: chown d1/db/d1c/d2f/d78/d11/d1e/d47/f98 9 1 2022-02-02T18:21:30.778 INFO:tasks.workunit.client.0.smithi096.stdout:9/759: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/c9b 0 2022-02-02T18:21:30.778 INFO:tasks.workunit.client.0.smithi096.stdout:2/773: truncate d2/d6/f93 135794 0 2022-02-02T18:21:30.780 INFO:tasks.workunit.client.0.smithi096.stdout:9/760: dread d1/d39/f70 [0,4194304] 0 2022-02-02T18:21:30.780 INFO:tasks.workunit.client.0.smithi096.stdout:9/761: fsync d1/db/f99 0 2022-02-02T18:21:30.780 INFO:tasks.workunit.client.0.smithi096.stdout:2/774: write d2/d13/d42/d71/dad/db0/dc7/dca/fe2 [739154,122374] 0 2022-02-02T18:21:30.780 INFO:tasks.workunit.client.0.smithi096.stdout:0/862: creat d2/db/f125 x:0 0 0 2022-02-02T18:21:30.781 INFO:tasks.workunit.client.0.smithi096.stdout:0/863: read d2/db/d10/d80/fd8 [1890248,12460] 0 2022-02-02T18:21:30.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/762: creat d1/db/d1c/d2f/d78/d25/f10f x:0 0 0 2022-02-02T18:21:30.782 INFO:tasks.workunit.client.0.smithi096.stdout:2/775: mknod d2/d5e/d6d/d79/d66/cf0 0 2022-02-02T18:21:30.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/864: unlink d2/db/d10/d80/d93/da3/ddc/fe6 0 2022-02-02T18:21:30.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/865: fdatasync d2/db/f125 0 2022-02-02T18:21:30.785 INFO:tasks.workunit.client.0.smithi096.stdout:9/763: mkdir d1/db/d1c/d2f/d78/d11/d1e/dfe/d110 0 2022-02-02T18:21:30.786 INFO:tasks.workunit.client.0.smithi096.stdout:2/776: mkdir d2/d19/d86/df1 0 2022-02-02T18:21:30.788 INFO:tasks.workunit.client.0.smithi096.stdout:0/866: rename d2/db/d24/d89/d8f/d95/dcd/fef to d2/db/d37/d113/df6/f126 0 2022-02-02T18:21:30.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/867: creat d2/db/d24/d4d/d54/f127 x:0 0 0 2022-02-02T18:21:30.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/868: write d2/db/d10/d27/f100 [582499,65940] 0 2022-02-02T18:21:30.791 INFO:tasks.workunit.client.0.smithi096.stdout:0/869: write d2/db/d24/d89/d91/fa4 [4954251,61894] 0 2022-02-02T18:21:30.791 INFO:tasks.workunit.client.0.smithi096.stdout:0/870: write d2/db/d37/d113/fd9 [2009572,120446] 0 2022-02-02T18:21:30.792 INFO:tasks.workunit.client.0.smithi096.stdout:0/871: read d2/db/f29 [562398,108920] 0 2022-02-02T18:21:30.793 INFO:tasks.workunit.client.0.smithi096.stdout:0/872: truncate d2/db/d37/d5f/f119 1001401 0 2022-02-02T18:21:30.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/777: dread d2/d19/f70 [0,4194304] 0 2022-02-02T18:21:30.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/778: fsync d2/d5e/d7c/f83 0 2022-02-02T18:21:30.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/873: rename d2/db/dde to d2/d1e/d67/d128 0 2022-02-02T18:21:30.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/874: write d2/db/d24/d4d/d53/d58/fba [879725,71562] 0 2022-02-02T18:21:30.810 INFO:tasks.workunit.client.0.smithi096.stdout:2/779: dwrite d2/d6/db/fc8 [0,4194304] 0 2022-02-02T18:21:30.811 INFO:tasks.workunit.client.0.smithi096.stdout:2/780: write d2/d5e/d6d/d79/fc9 [324577,124113] 0 2022-02-02T18:21:30.811 INFO:tasks.workunit.client.0.smithi096.stdout:9/764: dwrite d1/db/d1c/d2f/d78/d25/ff [0,4194304] 0 2022-02-02T18:21:30.812 INFO:tasks.workunit.client.0.smithi096.stdout:0/875: dread d2/db/d24/d89/d8f/d95/fb1 [0,4194304] 0 2022-02-02T18:21:30.819 INFO:tasks.workunit.client.0.smithi096.stdout:9/765: truncate d1/db/d63/f80 3883713 0 2022-02-02T18:21:30.819 INFO:tasks.workunit.client.0.smithi096.stdout:9/766: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/f7b zero size 2022-02-02T18:21:30.820 INFO:tasks.workunit.client.0.smithi096.stdout:9/767: truncate d1/db/d1c/d2f/dc8/fe2 583668 0 2022-02-02T18:21:30.820 INFO:tasks.workunit.client.0.smithi096.stdout:9/768: chown d1/db/d1c/d2f/f55 4377 1 2022-02-02T18:21:30.820 INFO:tasks.workunit.client.0.smithi096.stdout:9/769: chown d1/db/d1c/d2f/dd2 0 1 2022-02-02T18:21:30.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/876: mknod d2/d62/c129 0 2022-02-02T18:21:30.821 INFO:tasks.workunit.client.0.smithi096.stdout:9/770: read d1/db/d1c/d2f/f55 [2614762,88435] 0 2022-02-02T18:21:30.822 INFO:tasks.workunit.client.0.smithi096.stdout:0/877: creat d2/db/d37/f12a x:0 0 0 2022-02-02T18:21:30.823 INFO:tasks.workunit.client.0.smithi096.stdout:0/878: truncate d2/d1e/db3/ff7 860741 0 2022-02-02T18:21:30.823 INFO:tasks.workunit.client.0.smithi096.stdout:0/879: unlink d2/db/d24/c41 0 2022-02-02T18:21:30.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/771: rmdir d1/db/d1c/d2f/d78/d11/d1e/d66 39 2022-02-02T18:21:30.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/781: dwrite d2/d5e/f9e [0,4194304] 0 2022-02-02T18:21:30.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/782: truncate d2/d5e/d6d/fa0 277718 0 2022-02-02T18:21:30.830 INFO:tasks.workunit.client.0.smithi096.stdout:2/783: mknod d2/d13/d43/d51/cf2 0 2022-02-02T18:21:30.830 INFO:tasks.workunit.client.0.smithi096.stdout:2/784: getdents d2/d13/d42/d71/dad/db0/de4 0 2022-02-02T18:21:30.830 INFO:tasks.workunit.client.0.smithi096.stdout:2/785: dread - d2/d13/f94 zero size 2022-02-02T18:21:30.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/775: sync 2022-02-02T18:21:30.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/776: getdents d18/d50/d9a/d116/d118 0 2022-02-02T18:21:30.832 INFO:tasks.workunit.client.0.smithi096.stdout:2/786: write d2/d6/d1b/f39 [1636067,61305] 0 2022-02-02T18:21:30.833 INFO:tasks.workunit.client.0.smithi096.stdout:2/787: getdents d2/d6/d1b/d48 0 2022-02-02T18:21:30.833 INFO:tasks.workunit.client.0.smithi096.stdout:2/788: chown d2/d13/d42/d71/dad/db0/dc7/dca 4062573 1 2022-02-02T18:21:30.833 INFO:tasks.workunit.client.0.smithi096.stdout:6/777: creat d18/d24/d73/dfb/f11d x:0 0 0 2022-02-02T18:21:30.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/789: creat d2/d13/d43/d51/d73/ff3 x:0 0 0 2022-02-02T18:21:30.835 INFO:tasks.workunit.client.0.smithi096.stdout:6/778: mknod d18/d24/d28/d4a/c11e 0 2022-02-02T18:21:30.836 INFO:tasks.workunit.client.0.smithi096.stdout:2/790: creat d2/d13/d42/d71/dad/ff4 x:0 0 0 2022-02-02T18:21:30.837 INFO:tasks.workunit.client.0.smithi096.stdout:2/791: fsync d2/d5e/d6d/d79/d66/f68 0 2022-02-02T18:21:30.837 INFO:tasks.workunit.client.0.smithi096.stdout:2/792: write d2/d13/d42/d71/f7a [4953646,39887] 0 2022-02-02T18:21:30.838 INFO:tasks.workunit.client.0.smithi096.stdout:6/779: symlink d18/l11f 0 2022-02-02T18:21:30.838 INFO:tasks.workunit.client.0.smithi096.stdout:6/780: write d18/d50/d8f/dbb/f4b [1540569,19028] 0 2022-02-02T18:21:30.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/793: mknod d2/d19/d86/df1/cf5 0 2022-02-02T18:21:30.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/794: write d2/d13/d42/d71/dad/ff4 [818388,90830] 0 2022-02-02T18:21:30.840 INFO:tasks.workunit.client.0.smithi096.stdout:2/795: rename d2/d13/d42/d71/dad to d2/d13/d42/d71/dad/db0/df6 22 2022-02-02T18:21:30.840 INFO:tasks.workunit.client.0.smithi096.stdout:2/796: write d2/d6/d1b/f89 [1039127,2003] 0 2022-02-02T18:21:30.841 INFO:tasks.workunit.client.0.smithi096.stdout:6/781: mkdir d18/d50/d9a/d116/d120 0 2022-02-02T18:21:30.846 INFO:tasks.workunit.client.0.smithi096.stdout:0/880: dwrite d2/f69 [4194304,4194304] 0 2022-02-02T18:21:30.848 INFO:tasks.workunit.client.0.smithi096.stdout:9/772: dwrite d1/db/d1c/d2f/f6a [0,4194304] 0 2022-02-02T18:21:30.848 INFO:tasks.workunit.client.0.smithi096.stdout:9/773: fsync d1/db/d1c/d2f/d78/d11/d1e/d38/f7f 0 2022-02-02T18:21:30.848 INFO:tasks.workunit.client.0.smithi096.stdout:9/774: fdatasync d1/db/d1c/d2f/d78/d11/d3c/f41 0 2022-02-02T18:21:30.861 INFO:tasks.workunit.client.0.smithi096.stdout:9/775: getdents d1/db/d1c/d2f/d78/d11/d1e/d66/dbf 0 2022-02-02T18:21:30.861 INFO:tasks.workunit.client.0.smithi096.stdout:0/881: dread d2/f69 [0,4194304] 0 2022-02-02T18:21:30.861 INFO:tasks.workunit.client.0.smithi096.stdout:0/882: creat d2/db/d24/d89/d8f/d95/dfb/f12b x:0 0 0 2022-02-02T18:21:30.862 INFO:tasks.workunit.client.0.smithi096.stdout:9/776: write d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/ff8 [843479,119920] 0 2022-02-02T18:21:30.862 INFO:tasks.workunit.client.0.smithi096.stdout:0/883: creat d2/d1e/d67/f12c x:0 0 0 2022-02-02T18:21:30.863 INFO:tasks.workunit.client.0.smithi096.stdout:9/777: symlink d1/db/d1c/d2f/d78/d25/l111 0 2022-02-02T18:21:30.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/797: dwrite d2/d13/d42/d71/dad/db0/dc7/dca/fe6 [0,4194304] 0 2022-02-02T18:21:30.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/798: creat d2/d13/d42/d71/dad/ff7 x:0 0 0 2022-02-02T18:21:30.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/799: creat d2/d5e/d6d/d79/d66/ff8 x:0 0 0 2022-02-02T18:21:30.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/782: dwrite d18/d50/d8f/dbb/d63/db3/fdf [0,4194304] 0 2022-02-02T18:21:30.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/783: readlink d18/d50/d8f/dc4/lba 0 2022-02-02T18:21:30.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/800: read d2/d6/db/f8f [1011645,13075] 0 2022-02-02T18:21:30.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/801: fdatasync d2/d6/d1b/dc0/fcc 0 2022-02-02T18:21:30.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/802: read - d2/d13/f94 zero size 2022-02-02T18:21:30.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/803: creat d2/d19/d86/db3/ff9 x:0 0 0 2022-02-02T18:21:30.876 INFO:tasks.workunit.client.0.smithi096.stdout:9/778: dread d1/db/d1c/d2f/f55 [0,4194304] 0 2022-02-02T18:21:30.877 INFO:tasks.workunit.client.0.smithi096.stdout:0/884: dread d2/db/d10/f33 [0,4194304] 0 2022-02-02T18:21:30.880 INFO:tasks.workunit.client.0.smithi096.stdout:8/643: sync 2022-02-02T18:21:30.880 INFO:tasks.workunit.client.0.smithi096.stdout:3/697: sync 2022-02-02T18:21:30.880 INFO:tasks.workunit.client.0.smithi096.stdout:1/711: sync 2022-02-02T18:21:30.881 INFO:tasks.workunit.client.0.smithi096.stdout:4/735: sync 2022-02-02T18:21:30.881 INFO:tasks.workunit.client.0.smithi096.stdout:5/729: sync 2022-02-02T18:21:30.881 INFO:tasks.workunit.client.0.smithi096.stdout:7/645: sync 2022-02-02T18:21:30.882 INFO:tasks.workunit.client.0.smithi096.stdout:1/712: truncate d15/d4d/fc9 335094 0 2022-02-02T18:21:30.882 INFO:tasks.workunit.client.0.smithi096.stdout:7/646: write d9/df/d16/fbf [859785,38091] 0 2022-02-02T18:21:30.883 INFO:tasks.workunit.client.0.smithi096.stdout:5/730: write db/de/d10/d27/ff1 [3611570,96682] 0 2022-02-02T18:21:30.883 INFO:tasks.workunit.client.0.smithi096.stdout:5/731: write db/de/d10/d27/d83/ffb [911390,19802] 0 2022-02-02T18:21:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:2/804: creat d2/d13/d42/d71/dad/db0/de4/ffa x:0 0 0 2022-02-02T18:21:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:2/805: chown d2/d6/dd2 0 1 2022-02-02T18:21:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:2/806: fsync d2/d13/d42/fdb 0 2022-02-02T18:21:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:9/779: mkdir d1/db/d1c/d2f/d78/d11/d112 0 2022-02-02T18:21:30.885 INFO:tasks.workunit.client.0.smithi096.stdout:9/780: readlink d1/db/d1c/d2f/d78/d11/d1e/d38/l40 0 2022-02-02T18:21:30.885 INFO:tasks.workunit.client.0.smithi096.stdout:0/885: rename d2/db/d37/d40/cea to d2/db/d24/d89/d8f/d95/c12d 0 2022-02-02T18:21:30.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/698: creat d2/df/d20/d33/d58/fed x:0 0 0 2022-02-02T18:21:30.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/699: chown d2/df/d20 250690 1 2022-02-02T18:21:30.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/644: mknod d29/d2d/d42/cd2 0 2022-02-02T18:21:30.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/645: chown d29/d4e/dad/dcc/d5b/d81/dae 55660304 1 2022-02-02T18:21:30.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/646: unlink d29/d2d/f48 0 2022-02-02T18:21:30.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/647: chown d29/d4e/dad/dcc/d5b/fbb 1340157 1 2022-02-02T18:21:30.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/648: fsync d29/d4e/dad/dcc/d5b/f64 0 2022-02-02T18:21:30.893 INFO:tasks.workunit.client.0.smithi096.stdout:5/732: symlink db/de/d2e/d35/l104 0 2022-02-02T18:21:30.895 INFO:tasks.workunit.client.0.smithi096.stdout:1/713: rename d15/d1b/d26/d72/fdd to d15/f107 0 2022-02-02T18:21:30.895 INFO:tasks.workunit.client.0.smithi096.stdout:1/714: fdatasync d15/d1b/f2f 0 2022-02-02T18:21:30.896 INFO:tasks.workunit.client.0.smithi096.stdout:0/886: mkdir d2/db/d24/d4d/d53/d12e 0 2022-02-02T18:21:30.896 INFO:tasks.workunit.client.0.smithi096.stdout:0/887: chown d2/db/d10/c1a 42 1 2022-02-02T18:21:30.898 INFO:tasks.workunit.client.0.smithi096.stdout:3/700: link d2/df/d14/d11/f53 d2/df/d20/fee 0 2022-02-02T18:21:30.900 INFO:tasks.workunit.client.0.smithi096.stdout:7/647: rmdir d9/df/d12/d14 39 2022-02-02T18:21:30.901 INFO:tasks.workunit.client.0.smithi096.stdout:7/648: write d9/df/d47/d19/f2f [6059757,57907] 0 2022-02-02T18:21:30.901 INFO:tasks.workunit.client.0.smithi096.stdout:8/649: dread d29/d2d/f2e [0,4194304] 0 2022-02-02T18:21:30.902 INFO:tasks.workunit.client.0.smithi096.stdout:5/733: mkdir db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d105 0 2022-02-02T18:21:30.903 INFO:tasks.workunit.client.0.smithi096.stdout:5/734: dread db/d5c/f9c [0,4194304] 0 2022-02-02T18:21:30.904 INFO:tasks.workunit.client.0.smithi096.stdout:1/715: rmdir d15/d1b/d26/d72/dff/d8a/db9 39 2022-02-02T18:21:30.906 INFO:tasks.workunit.client.0.smithi096.stdout:0/888: rename d2/db/d10/d27/l79 to d2/d1e/db9/l12f 0 2022-02-02T18:21:30.907 INFO:tasks.workunit.client.0.smithi096.stdout:3/701: getdents d2/df/d14/d2c/d74 0 2022-02-02T18:21:30.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/702: readlink d2/df/d14/d2c/d31/lec 0 2022-02-02T18:21:30.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/703: chown d2/df/d20/d33/f3b 1283378 1 2022-02-02T18:21:30.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/704: stat d2/df/d20/d33/d58/d7c/faf 0 2022-02-02T18:21:30.908 INFO:tasks.workunit.client.0.smithi096.stdout:7/649: symlink d9/df/d16/d25/d98/le1 0 2022-02-02T18:21:30.909 INFO:tasks.workunit.client.0.smithi096.stdout:8/650: symlink d29/d2d/d42/ld3 0 2022-02-02T18:21:30.910 INFO:tasks.workunit.client.0.smithi096.stdout:8/651: read - d29/d2d/f8b zero size 2022-02-02T18:21:30.910 INFO:tasks.workunit.client.0.smithi096.stdout:8/652: fdatasync d29/d58/d79/fc8 0 2022-02-02T18:21:30.910 INFO:tasks.workunit.client.0.smithi096.stdout:8/653: write d29/d4e/f6c [1453153,120701] 0 2022-02-02T18:21:30.911 INFO:tasks.workunit.client.0.smithi096.stdout:1/716: symlink d15/d1b/d26/d59/dd2/l108 0 2022-02-02T18:21:30.912 INFO:tasks.workunit.client.0.smithi096.stdout:8/654: symlink d29/d4e/dad/ld4 0 2022-02-02T18:21:30.912 INFO:tasks.workunit.client.0.smithi096.stdout:0/889: rmdir d2/d1e/d67 39 2022-02-02T18:21:30.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/807: dwrite d2/d5e/d6d/d79/d81/faf [0,4194304] 0 2022-02-02T18:21:30.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/736: dwrite d3/d4/d20/d26/d36/d88/dde/df4/f4b [0,4194304] 0 2022-02-02T18:21:30.915 INFO:tasks.workunit.client.0.smithi096.stdout:2/808: rename d2/d6/db/f38 to d2/d13/d43/ffb 0 2022-02-02T18:21:30.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/737: truncate d3/d4/d20/d26/d36/d88/dde/df4/f29 1943880 0 2022-02-02T18:21:30.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/738: chown d3/d4/d20/d26/d36/d88/dde/df4/d55/dbc 1042964 1 2022-02-02T18:21:30.920 INFO:tasks.workunit.client.0.smithi096.stdout:5/735: dread db/d5c/f6f [0,4194304] 0 2022-02-02T18:21:30.920 INFO:tasks.workunit.client.0.smithi096.stdout:5/736: dread - db/de/d2e/d35/fe3 zero size 2022-02-02T18:21:30.921 INFO:tasks.workunit.client.0.smithi096.stdout:2/809: mknod d2/d13/d42/d71/dad/db0/cfc 0 2022-02-02T18:21:30.928 INFO:tasks.workunit.client.0.smithi096.stdout:4/739: symlink d3/d5a/db8/lf6 0 2022-02-02T18:21:30.928 INFO:tasks.workunit.client.0.smithi096.stdout:4/740: write d3/d60/d8d/fc0 [842084,97358] 0 2022-02-02T18:21:30.930 INFO:tasks.workunit.client.0.smithi096.stdout:5/737: symlink db/de/d10/l106 0 2022-02-02T18:21:30.930 INFO:tasks.workunit.client.0.smithi096.stdout:5/738: read - db/de/d10/fa4 zero size 2022-02-02T18:21:30.930 INFO:tasks.workunit.client.0.smithi096.stdout:1/717: write d15/d1b/f8c [306047,16464] 0 2022-02-02T18:21:30.930 INFO:tasks.workunit.client.0.smithi096.stdout:8/655: dread d29/d4e/dad/dcc/d5b/dca/fd0 [0,4194304] 0 2022-02-02T18:21:30.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/741: truncate d3/d27/f39 482523 0 2022-02-02T18:21:30.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/742: fdatasync d3/d4/d50/fa2 0 2022-02-02T18:21:30.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/743: truncate d3/d60/d8d/f9a 1066331 0 2022-02-02T18:21:30.932 INFO:tasks.workunit.client.0.smithi096.stdout:1/718: read d15/d4d/d8e/fcb [441793,117997] 0 2022-02-02T18:21:30.932 INFO:tasks.workunit.client.0.smithi096.stdout:1/719: chown d15/d1b/f6e 20 1 2022-02-02T18:21:30.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/739: creat db/de/d10/d25/d4c/dd8/def/f107 x:0 0 0 2022-02-02T18:21:30.934 INFO:tasks.workunit.client.0.smithi096.stdout:8/656: mknod d29/d2d/d87/cd5 0 2022-02-02T18:21:30.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/740: chown db/de/d10/d80/fb0 17515 1 2022-02-02T18:21:30.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/744: write d3/d27/f41 [748226,82100] 0 2022-02-02T18:21:30.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/745: stat d3/d27/c71 0 2022-02-02T18:21:30.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/746: creat d3/d5a/db8/ff7 x:0 0 0 2022-02-02T18:21:30.936 INFO:tasks.workunit.client.0.smithi096.stdout:3/705: dwrite d2/df/d14/d66/fba [0,4194304] 0 2022-02-02T18:21:30.937 INFO:tasks.workunit.client.0.smithi096.stdout:8/657: rename d29/d2d/f32 to d29/d2d/d87/da5/fd6 0 2022-02-02T18:21:30.938 INFO:tasks.workunit.client.0.smithi096.stdout:5/741: mknod db/de/d10/d25/d4c/dd8/c108 0 2022-02-02T18:21:30.938 INFO:tasks.workunit.client.0.smithi096.stdout:2/810: dread d2/d13/d8e/fc3 [0,4194304] 0 2022-02-02T18:21:30.938 INFO:tasks.workunit.client.0.smithi096.stdout:2/811: readlink d2/lcf 0 2022-02-02T18:21:30.939 INFO:tasks.workunit.client.0.smithi096.stdout:4/747: creat d3/d4/d20/d26/d36/d88/ff8 x:0 0 0 2022-02-02T18:21:30.939 INFO:tasks.workunit.client.0.smithi096.stdout:8/658: read d29/f33 [3674663,16652] 0 2022-02-02T18:21:30.941 INFO:tasks.workunit.client.0.smithi096.stdout:5/742: creat db/da1/f109 x:0 0 0 2022-02-02T18:21:30.941 INFO:tasks.workunit.client.0.smithi096.stdout:5/743: chown db/de/d10/d25/da0/d85/l9a 2397 1 2022-02-02T18:21:30.941 INFO:tasks.workunit.client.0.smithi096.stdout:5/744: stat db/de/d10/d25/l86 0 2022-02-02T18:21:30.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/812: write d2/d13/d42/d71/fe1 [2569971,126217] 0 2022-02-02T18:21:30.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/748: getdents d3/d4/d20/d26/d36/d88/dd8 0 2022-02-02T18:21:30.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/890: dwrite d2/db/d24/d89/d8f/fb6 [0,4194304] 0 2022-02-02T18:21:30.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/891: write d2/db/d24/d4d/d54/f55 [5472838,129241] 0 2022-02-02T18:21:30.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/745: fsync db/de/d2e/f41 0 2022-02-02T18:21:30.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/659: write d29/d4e/dad/dcc/d5b/d81/f8d [2644407,130470] 0 2022-02-02T18:21:30.946 INFO:tasks.workunit.client.0.smithi096.stdout:2/813: creat d2/d6/dd2/ffd x:0 0 0 2022-02-02T18:21:30.946 INFO:tasks.workunit.client.0.smithi096.stdout:4/749: getdents d3/d27 0 2022-02-02T18:21:30.946 INFO:tasks.workunit.client.0.smithi096.stdout:5/746: mkdir db/dbd/d10a 0 2022-02-02T18:21:30.948 INFO:tasks.workunit.client.0.smithi096.stdout:4/750: write d3/d4/d20/f22 [163532,123488] 0 2022-02-02T18:21:30.948 INFO:tasks.workunit.client.0.smithi096.stdout:4/751: creat d3/d60/d8d/ff9 x:0 0 0 2022-02-02T18:21:30.948 INFO:tasks.workunit.client.0.smithi096.stdout:2/814: rmdir d2/d6/d1b 39 2022-02-02T18:21:30.949 INFO:tasks.workunit.client.0.smithi096.stdout:2/815: dread d2/d5e/d6d/fa0 [0,4194304] 0 2022-02-02T18:21:30.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/816: mkdir d2/d5e/d7c/dfe 0 2022-02-02T18:21:30.954 INFO:tasks.workunit.client.0.smithi096.stdout:1/720: dwrite d15/d1b/d26/d72/dff/d8a/fa6 [0,4194304] 0 2022-02-02T18:21:30.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/817: mknod d2/d19/d86/db3/cff 0 2022-02-02T18:21:30.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/818: dread - d2/fee zero size 2022-02-02T18:21:30.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/819: fsync d2/d5e/d6d/fa0 0 2022-02-02T18:21:30.956 INFO:tasks.workunit.client.0.smithi096.stdout:2/820: mkdir d2/d6/d1b/d48/d100 0 2022-02-02T18:21:30.958 INFO:tasks.workunit.client.0.smithi096.stdout:2/821: mknod d2/d13/d43/d51/d5d/ddc/c101 0 2022-02-02T18:21:30.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/650: dwrite d9/df/d12/d39/d46/d7d/f91 [0,4194304] 0 2022-02-02T18:21:30.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/651: chown d9/df/d12/f45 235 1 2022-02-02T18:21:30.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/652: write d9/df/d16/d25/d98/fba [505485,8913] 0 2022-02-02T18:21:30.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/653: creat d9/df/d47/d60/fe2 x:0 0 0 2022-02-02T18:21:30.962 INFO:tasks.workunit.client.0.smithi096.stdout:2/822: symlink d2/d19/d86/db3/l102 0 2022-02-02T18:21:30.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/660: dwrite d29/d2d/fbc [0,4194304] 0 2022-02-02T18:21:30.975 INFO:tasks.workunit.client.0.smithi096.stdout:7/654: mkdir d9/df/d47/db7/de3 0 2022-02-02T18:21:30.977 INFO:tasks.workunit.client.0.smithi096.stdout:8/661: mknod d29/d58/d63/cd7 0 2022-02-02T18:21:30.978 INFO:tasks.workunit.client.0.smithi096.stdout:7/655: unlink d9/df/d12/d39/d4e/d6e/fda 0 2022-02-02T18:21:30.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/662: creat d29/d58/fd8 x:0 0 0 2022-02-02T18:21:30.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/656: stat d9/df/d12/d14/f30 0 2022-02-02T18:21:30.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/657: chown d9/df/d16/fbf 2 1 2022-02-02T18:21:30.982 INFO:tasks.workunit.client.0.smithi096.stdout:8/663: rename d29/d2d/d87/dc4 to d29/d4e/dad/dcc/d5b/dd9 0 2022-02-02T18:21:30.982 INFO:tasks.workunit.client.0.smithi096.stdout:3/706: dwrite d2/df/d1c/d5d/da3/fca [0,4194304] 0 2022-02-02T18:21:30.982 INFO:tasks.workunit.client.0.smithi096.stdout:3/707: write d2/df/d1c/d5d/f79 [1911910,86032] 0 2022-02-02T18:21:30.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/658: creat d9/df/d12/fe4 x:0 0 0 2022-02-02T18:21:30.984 INFO:tasks.workunit.client.0.smithi096.stdout:7/659: read - d9/df/d12/d14/d82/fc4 zero size 2022-02-02T18:21:30.987 INFO:tasks.workunit.client.0.smithi096.stdout:4/752: dwrite d3/d60/fb2 [0,4194304] 0 2022-02-02T18:21:30.987 INFO:tasks.workunit.client.0.smithi096.stdout:4/753: fsync d3/d4/d90/f9f 0 2022-02-02T18:21:30.988 INFO:tasks.workunit.client.0.smithi096.stdout:1/721: dwrite d15/d1b/d28/d47/fe1 [0,4194304] 0 2022-02-02T18:21:30.989 INFO:tasks.workunit.client.0.smithi096.stdout:3/708: rename d2/df/d14/d11/f53 to d2/df/d20/fef 0 2022-02-02T18:21:30.990 INFO:tasks.workunit.client.0.smithi096.stdout:3/709: creat d2/df/d14/dbe/ff0 x:0 0 0 2022-02-02T18:21:30.991 INFO:tasks.workunit.client.0.smithi096.stdout:2/823: dwrite d2/d13/d8e/fc3 [0,4194304] 0 2022-02-02T18:21:30.993 INFO:tasks.workunit.client.0.smithi096.stdout:4/754: getdents d3/d60 0 2022-02-02T18:21:31.004 INFO:tasks.workunit.client.0.smithi096.stdout:1/722: unlink d15/d4d/d8e/cba 0 2022-02-02T18:21:31.005 INFO:tasks.workunit.client.0.smithi096.stdout:1/723: truncate d15/f27 4952575 0 2022-02-02T18:21:31.007 INFO:tasks.workunit.client.0.smithi096.stdout:3/710: symlink d2/df/d14/d2c/d31/da8/lf1 0 2022-02-02T18:21:31.007 INFO:tasks.workunit.client.0.smithi096.stdout:3/711: fsync d2/d71/fe8 0 2022-02-02T18:21:31.010 INFO:tasks.workunit.client.0.smithi096.stdout:4/755: rename d3/d4/d20/d26/d36/d88/d98/ccb to d3/d60/dbd/cfa 0 2022-02-02T18:21:31.010 INFO:tasks.workunit.client.0.smithi096.stdout:4/756: truncate d3/d4/d20/d26/d36/d88/dd8/de1/fef 511038 0 2022-02-02T18:21:31.010 INFO:tasks.workunit.client.0.smithi096.stdout:4/757: fdatasync d3/d60/d8d/da7/f6e 0 2022-02-02T18:21:31.010 INFO:tasks.workunit.client.0.smithi096.stdout:4/758: chown d3/d4/d20/d26/d36/d51 208481 1 2022-02-02T18:21:31.011 INFO:tasks.workunit.client.0.smithi096.stdout:1/724: unlink d15/d1b/d26/d72/da3/da7/db6/lcd 0 2022-02-02T18:21:31.012 INFO:tasks.workunit.client.0.smithi096.stdout:1/725: stat d15/d1b/d28/d3f/f98 0 2022-02-02T18:21:31.012 INFO:tasks.workunit.client.0.smithi096.stdout:8/664: dwrite d29/d2d/fbc [0,4194304] 0 2022-02-02T18:21:31.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/660: dwrite d9/df/d12/d39/d4e/d6e/f9c [0,4194304] 0 2022-02-02T18:21:31.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/661: write d9/df/d12/d14/f50 [1046337,109064] 0 2022-02-02T18:21:31.013 INFO:tasks.workunit.client.0.smithi096.stdout:3/712: chown d2/df/d1c/c57 11140 1 2022-02-02T18:21:31.014 INFO:tasks.workunit.client.0.smithi096.stdout:4/759: write d3/d5a/f68 [2575712,10892] 0 2022-02-02T18:21:31.014 INFO:tasks.workunit.client.0.smithi096.stdout:2/824: dwrite d2/d6/d1b/dc0/fcc [0,4194304] 0 2022-02-02T18:21:31.015 INFO:tasks.workunit.client.0.smithi096.stdout:2/825: readlink d2/d19/d86/lea 0 2022-02-02T18:21:31.019 INFO:tasks.workunit.client.0.smithi096.stdout:8/665: creat d29/d4e/dad/db3/d6d/d85/fda x:0 0 0 2022-02-02T18:21:31.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/662: getdents d9/df/d47 0 2022-02-02T18:21:31.020 INFO:tasks.workunit.client.0.smithi096.stdout:7/663: fsync f2 0 2022-02-02T18:21:31.024 INFO:tasks.workunit.client.0.smithi096.stdout:3/713: rename d2/df/d20/d33/d58/dce/dcf/ld0 to d2/d71/dd5/lf2 0 2022-02-02T18:21:31.025 INFO:tasks.workunit.client.0.smithi096.stdout:2/826: mknod d2/d13/d42/d71/c103 0 2022-02-02T18:21:31.025 INFO:tasks.workunit.client.0.smithi096.stdout:2/827: fdatasync d2/d5e/d6d/d79/d66/f68 0 2022-02-02T18:21:31.025 INFO:tasks.workunit.client.0.smithi096.stdout:8/666: truncate d29/d4e/f6c 694754 0 2022-02-02T18:21:31.027 INFO:tasks.workunit.client.0.smithi096.stdout:3/714: mkdir d2/df/d14/d2c/d74/df3 0 2022-02-02T18:21:31.027 INFO:tasks.workunit.client.0.smithi096.stdout:3/715: write d2/df/d14/d2c/d31/fbb [499826,117089] 0 2022-02-02T18:21:31.028 INFO:tasks.workunit.client.0.smithi096.stdout:8/667: mkdir d29/d4e/dad/ddb 0 2022-02-02T18:21:31.030 INFO:tasks.workunit.client.0.smithi096.stdout:3/716: rmdir d2/df/d34/d76/dd3 39 2022-02-02T18:21:31.032 INFO:tasks.workunit.client.0.smithi096.stdout:3/717: mkdir d2/df/d14/d2c/df4 0 2022-02-02T18:21:31.033 INFO:tasks.workunit.client.0.smithi096.stdout:3/718: rmdir d2/df/d34/d76 39 2022-02-02T18:21:31.033 INFO:tasks.workunit.client.0.smithi096.stdout:3/719: stat d2/df/d20/fc3 0 2022-02-02T18:21:31.035 INFO:tasks.workunit.client.0.smithi096.stdout:3/720: read d2/df/d20/d33/f98 [3938691,50474] 0 2022-02-02T18:21:31.038 INFO:tasks.workunit.client.0.smithi096.stdout:3/721: dread d2/df/d20/fef [0,4194304] 0 2022-02-02T18:21:31.047 INFO:tasks.workunit.client.0.smithi096.stdout:4/760: dwrite d3/d60/d8d/fc0 [0,4194304] 0 2022-02-02T18:21:31.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/761: mkdir d3/d4/d20/d26/d36/d88/dde/dfb 0 2022-02-02T18:21:31.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/762: write d3/d4/d20/d26/d36/d88/d98/fae [4271375,111135] 0 2022-02-02T18:21:31.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/763: stat d3/d4/d20/d26/d36/d88/dde/df4/d55/dbc 0 2022-02-02T18:21:31.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/764: creat d3/d60/dbd/ffc x:0 0 0 2022-02-02T18:21:31.052 INFO:tasks.workunit.client.0.smithi096.stdout:4/765: truncate d3/d27/f43 1160126 0 2022-02-02T18:21:31.055 INFO:tasks.workunit.client.0.smithi096.stdout:7/664: dwrite d9/df/d12/d39/d40/f69 [0,4194304] 0 2022-02-02T18:21:31.055 INFO:tasks.workunit.client.0.smithi096.stdout:7/665: fsync d9/df/d12/d14/f31 0 2022-02-02T18:21:31.058 INFO:tasks.workunit.client.0.smithi096.stdout:7/666: mknod d9/df/d47/d37/ce5 0 2022-02-02T18:21:31.069 INFO:tasks.workunit.client.0.smithi096.stdout:2/828: dwrite d2/d19/f70 [0,4194304] 0 2022-02-02T18:21:31.071 INFO:tasks.workunit.client.0.smithi096.stdout:2/829: symlink d2/d6/d1b/dc0/l104 0 2022-02-02T18:21:31.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/830: write d2/d13/d43/d51/d73/da9/faa [1004875,45803] 0 2022-02-02T18:21:31.072 INFO:tasks.workunit.client.0.smithi096.stdout:7/667: dread d9/df/d47/d37/d83/db1/fc2 [0,4194304] 0 2022-02-02T18:21:31.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/668: fsync d9/df/d47/d19/f1e 0 2022-02-02T18:21:31.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/669: chown d9/df/d47/fa2 23823 1 2022-02-02T18:21:31.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/670: write d9/df/d16/fa1 [320513,23144] 0 2022-02-02T18:21:31.075 INFO:tasks.workunit.client.0.smithi096.stdout:1/726: dwrite d15/d1b/d28/d47/f63 [0,4194304] 0 2022-02-02T18:21:31.076 INFO:tasks.workunit.client.0.smithi096.stdout:1/727: readlink d15/d1b/d28/d2c/l46 0 2022-02-02T18:21:31.076 INFO:tasks.workunit.client.0.smithi096.stdout:1/728: write d15/d67/f9a [787284,58605] 0 2022-02-02T18:21:31.077 INFO:tasks.workunit.client.0.smithi096.stdout:1/729: readlink d15/lfa 0 2022-02-02T18:21:31.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/671: symlink d9/df/d12/d39/d46/d7d/dd7/le6 0 2022-02-02T18:21:31.078 INFO:tasks.workunit.client.0.smithi096.stdout:7/672: fsync d9/df/d47/d19/f1e 0 2022-02-02T18:21:31.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/668: dwrite d29/d4e/f72 [0,4194304] 0 2022-02-02T18:21:31.078 INFO:tasks.workunit.client.0.smithi096.stdout:3/722: dwrite d2/df/d1c/d5d/fe6 [0,4194304] 0 2022-02-02T18:21:31.079 INFO:tasks.workunit.client.0.smithi096.stdout:7/673: creat d9/df/d47/fe7 x:0 0 0 2022-02-02T18:21:31.080 INFO:tasks.workunit.client.0.smithi096.stdout:3/723: write d2/df/d1c/d5d/fe6 [1259408,69045] 0 2022-02-02T18:21:31.081 INFO:tasks.workunit.client.0.smithi096.stdout:4/766: dwrite d3/d4/d20/d26/d36/d88/dde/df4/f58 [0,4194304] 0 2022-02-02T18:21:31.081 INFO:tasks.workunit.client.0.smithi096.stdout:4/767: creat d3/d4/d20/d26/d36/d51/ffd x:0 0 0 2022-02-02T18:21:31.081 INFO:tasks.workunit.client.0.smithi096.stdout:4/768: creat d3/d5a/ffe x:0 0 0 2022-02-02T18:21:31.088 INFO:tasks.workunit.client.0.smithi096.stdout:8/669: dread d29/fa4 [0,4194304] 0 2022-02-02T18:21:31.089 INFO:tasks.workunit.client.0.smithi096.stdout:7/674: rename d9/df/d12/f45 to d9/df/d12/d39/d40/fe8 0 2022-02-02T18:21:31.090 INFO:tasks.workunit.client.0.smithi096.stdout:3/724: rmdir d2/df/d1c/d5d/d69/d43 39 2022-02-02T18:21:31.091 INFO:tasks.workunit.client.0.smithi096.stdout:2/831: dwrite f1 [0,4194304] 0 2022-02-02T18:21:31.093 INFO:tasks.workunit.client.0.smithi096.stdout:4/769: symlink d3/d4/d20/d26/d36/d88/dd8/lff 0 2022-02-02T18:21:31.095 INFO:tasks.workunit.client.0.smithi096.stdout:8/670: creat d29/d4e/dad/dcc/d5b/dd9/dce/fdc x:0 0 0 2022-02-02T18:21:31.095 INFO:tasks.workunit.client.0.smithi096.stdout:8/671: chown d29/d4e/dad/db3/d6d/c75 34 1 2022-02-02T18:21:31.096 INFO:tasks.workunit.client.0.smithi096.stdout:4/770: dread d3/d60/f79 [0,4194304] 0 2022-02-02T18:21:31.096 INFO:tasks.workunit.client.0.smithi096.stdout:8/672: write d29/d2d/d87/da5/fc9 [206493,90875] 0 2022-02-02T18:21:31.096 INFO:tasks.workunit.client.0.smithi096.stdout:8/673: read - d29/d4e/dad/dcc/d5b/fa6 zero size 2022-02-02T18:21:31.097 INFO:tasks.workunit.client.0.smithi096.stdout:1/730: dwrite d15/d1b/d26/d59/ffe [0,4194304] 0 2022-02-02T18:21:31.097 INFO:tasks.workunit.client.0.smithi096.stdout:7/675: link d9/df/d16/f2a d9/df/d12/d39/d40/fe9 0 2022-02-02T18:21:31.098 INFO:tasks.workunit.client.0.smithi096.stdout:7/676: stat d9/df/d12/d39/d42/l64 0 2022-02-02T18:21:31.099 INFO:tasks.workunit.client.0.smithi096.stdout:2/832: mknod d2/d5e/d6d/c105 0 2022-02-02T18:21:31.099 INFO:tasks.workunit.client.0.smithi096.stdout:2/833: dread - d2/d5e/d6d/d79/d81/fd4 zero size 2022-02-02T18:21:31.103 INFO:tasks.workunit.client.0.smithi096.stdout:3/725: dread d2/df/da6/fb4 [0,4194304] 0 2022-02-02T18:21:31.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/784: sync 2022-02-02T18:21:31.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/785: chown d18/d24/d28/d4a/d9d/dc8 20 1 2022-02-02T18:21:31.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/786: stat d18/d24/d73/dfb/f97 0 2022-02-02T18:21:31.106 INFO:tasks.workunit.client.0.smithi096.stdout:6/787: readlink d18/d50/d8f/dbb/d63/db3/db5/le9 0 2022-02-02T18:21:31.106 INFO:tasks.workunit.client.0.smithi096.stdout:8/674: write d29/f2b [2713389,88828] 0 2022-02-02T18:21:31.106 INFO:tasks.workunit.client.0.smithi096.stdout:8/675: stat d29/d58/d7a 0 2022-02-02T18:21:31.107 INFO:tasks.workunit.client.0.smithi096.stdout:3/726: link d2/df/da6/fad d2/df/d14/d16/ff5 0 2022-02-02T18:21:31.108 INFO:tasks.workunit.client.0.smithi096.stdout:1/731: read d15/d1b/d28/d47/f53 [1996153,43936] 0 2022-02-02T18:21:31.108 INFO:tasks.workunit.client.0.smithi096.stdout:1/732: truncate d15/d1b/d26/d72/dff/fe4 46642 0 2022-02-02T18:21:31.109 INFO:tasks.workunit.client.0.smithi096.stdout:6/788: rename c15 to d18/d50/d8f/dbb/d63/dc2/d117/c121 0 2022-02-02T18:21:31.110 INFO:tasks.workunit.client.0.smithi096.stdout:6/789: creat d18/d50/f122 x:0 0 0 2022-02-02T18:21:31.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/834: dread d2/d13/d43/d51/fc1 [0,4194304] 0 2022-02-02T18:21:31.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/727: mknod d2/df/d14/d2c/cf6 0 2022-02-02T18:21:31.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/728: fdatasync d2/df/d20/d33/fb8 0 2022-02-02T18:21:31.112 INFO:tasks.workunit.client.0.smithi096.stdout:0/892: sync 2022-02-02T18:21:31.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/747: sync 2022-02-02T18:21:31.113 INFO:tasks.workunit.client.0.smithi096.stdout:9/781: sync 2022-02-02T18:21:31.113 INFO:tasks.workunit.client.0.smithi096.stdout:9/782: creat d1/db/d1c/d2f/dc8/f113 x:0 0 0 2022-02-02T18:21:31.113 INFO:tasks.workunit.client.0.smithi096.stdout:1/733: mknod d15/d1b/d26/d72/da3/da7/c109 0 2022-02-02T18:21:31.115 INFO:tasks.workunit.client.0.smithi096.stdout:2/835: rmdir d2/d5e/d6d/d79/d81 39 2022-02-02T18:21:31.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/676: dread d29/d4e/dad/db3/f49 [0,4194304] 0 2022-02-02T18:21:31.116 INFO:tasks.workunit.client.0.smithi096.stdout:5/748: dread db/de/d10/d80/fd0 [0,4194304] 0 2022-02-02T18:21:31.117 INFO:tasks.workunit.client.0.smithi096.stdout:3/729: creat d2/df/d1c/d5d/d69/ff7 x:0 0 0 2022-02-02T18:21:31.117 INFO:tasks.workunit.client.0.smithi096.stdout:2/836: write d2/f72 [1533936,37602] 0 2022-02-02T18:21:31.118 INFO:tasks.workunit.client.0.smithi096.stdout:2/837: write d2/d2a/f34 [343980,41753] 0 2022-02-02T18:21:31.118 INFO:tasks.workunit.client.0.smithi096.stdout:2/838: stat d2/d13/d43/l4a 0 2022-02-02T18:21:31.119 INFO:tasks.workunit.client.0.smithi096.stdout:2/839: stat d2/d13/d43/d51/fc1 0 2022-02-02T18:21:31.119 INFO:tasks.workunit.client.0.smithi096.stdout:2/840: write d2/d13/d42/d71/fe1 [5198347,71946] 0 2022-02-02T18:21:31.120 INFO:tasks.workunit.client.0.smithi096.stdout:9/783: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l114 0 2022-02-02T18:21:31.121 INFO:tasks.workunit.client.0.smithi096.stdout:9/784: chown d1/db/d1c/d2f/d78/d11/d3c/fbc 11 1 2022-02-02T18:21:31.121 INFO:tasks.workunit.client.0.smithi096.stdout:9/785: creat d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/f115 x:0 0 0 2022-02-02T18:21:31.122 INFO:tasks.workunit.client.0.smithi096.stdout:1/734: mknod d15/d1b/c10a 0 2022-02-02T18:21:31.122 INFO:tasks.workunit.client.0.smithi096.stdout:1/735: write d15/d1b/d28/d2c/d39/d71/f9e [803908,127440] 0 2022-02-02T18:21:31.122 INFO:tasks.workunit.client.0.smithi096.stdout:1/736: fdatasync d15/d1b/d26/d72/fad 0 2022-02-02T18:21:31.124 INFO:tasks.workunit.client.0.smithi096.stdout:7/677: dwrite d9/df/d12/d39/d46/d7d/fc5 [0,4194304] 0 2022-02-02T18:21:31.124 INFO:tasks.workunit.client.0.smithi096.stdout:8/677: symlink d29/d2d/d42/ldd 0 2022-02-02T18:21:31.124 INFO:tasks.workunit.client.0.smithi096.stdout:8/678: write d29/d58/d63/fcf [6262412,111965] 0 2022-02-02T18:21:31.125 INFO:tasks.workunit.client.0.smithi096.stdout:4/771: dwrite d3/d60/fc9 [0,4194304] 0 2022-02-02T18:21:31.125 INFO:tasks.workunit.client.0.smithi096.stdout:8/679: read d29/d4e/dad/db3/f44 [111552,103584] 0 2022-02-02T18:21:31.126 INFO:tasks.workunit.client.0.smithi096.stdout:5/749: mkdir db/d5c/d60/da7/de2/d10b 0 2022-02-02T18:21:31.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/730: link d2/df/d14/f10 d2/df/d14/dbe/ff8 0 2022-02-02T18:21:31.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/731: write d2/df/f26 [8947293,50043] 0 2022-02-02T18:21:31.134 INFO:tasks.workunit.client.0.smithi096.stdout:0/893: dwrite d2/db/d10/d80/d93/da3/fe1 [0,4194304] 0 2022-02-02T18:21:31.135 INFO:tasks.workunit.client.0.smithi096.stdout:4/772: link d3/d4/d20/d26/c2b d3/d60/d8d/dc6/c100 0 2022-02-02T18:21:31.136 INFO:tasks.workunit.client.0.smithi096.stdout:8/680: symlink d29/d4e/dad/dcc/d5b/d81/dae/lde 0 2022-02-02T18:21:31.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/750: link db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/cb8 db/de/d10/d25/da0/dfe/c10c 0 2022-02-02T18:21:31.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/732: symlink d2/df/d36/d8d/dcd/lf9 0 2022-02-02T18:21:31.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/733: stat d2/df/d14/dbe/ff0 0 2022-02-02T18:21:31.139 INFO:tasks.workunit.client.0.smithi096.stdout:1/737: getdents d15/d1b/d28/d2c/d4f 0 2022-02-02T18:21:31.139 INFO:tasks.workunit.client.0.smithi096.stdout:1/738: write d15/d1b/d26/f77 [133798,37511] 0 2022-02-02T18:21:31.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/678: rmdir d9/df/d47/d60/da5 39 2022-02-02T18:21:31.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/679: write d9/df/d12/d39/d46/d7d/f89 [270088,7413] 0 2022-02-02T18:21:31.142 INFO:tasks.workunit.client.0.smithi096.stdout:2/841: dwrite d2/d6/fcb [0,4194304] 0 2022-02-02T18:21:31.143 INFO:tasks.workunit.client.0.smithi096.stdout:0/894: symlink d2/d1e/d67/d128/l130 0 2022-02-02T18:21:31.143 INFO:tasks.workunit.client.0.smithi096.stdout:0/895: write d2/d1e/db3/ff7 [1884809,104289] 0 2022-02-02T18:21:31.146 INFO:tasks.workunit.client.0.smithi096.stdout:3/734: write d2/df/d14/d16/ff5 [2101334,77774] 0 2022-02-02T18:21:31.149 INFO:tasks.workunit.client.0.smithi096.stdout:6/790: rmdir d18/d50/d8f/dbb/d63/dc2 39 2022-02-02T18:21:31.149 INFO:tasks.workunit.client.0.smithi096.stdout:8/681: unlink d29/d4e/dad/db3/f44 0 2022-02-02T18:21:31.155 INFO:tasks.workunit.client.0.smithi096.stdout:1/739: dread d15/d1b/d26/d59/ffe [0,4194304] 0 2022-02-02T18:21:31.156 INFO:tasks.workunit.client.0.smithi096.stdout:7/680: rename d9/faf to d9/df/d47/d19/fea 0 2022-02-02T18:21:31.162 INFO:tasks.workunit.client.0.smithi096.stdout:4/773: dwrite d3/d4/d20/d26/d36/d88/dde/df4/f1f [0,4194304] 0 2022-02-02T18:21:31.169 INFO:tasks.workunit.client.0.smithi096.stdout:3/735: mkdir d2/df/d20/dc4/dfa 0 2022-02-02T18:21:31.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/751: dwrite db/de/f2a [4194304,4194304] 0 2022-02-02T18:21:31.171 INFO:tasks.workunit.client.0.smithi096.stdout:8/682: truncate d29/f84 2021411 0 2022-02-02T18:21:31.172 INFO:tasks.workunit.client.0.smithi096.stdout:0/896: dwrite d2/db/d24/d89/d91/fbe [0,4194304] 0 2022-02-02T18:21:31.173 INFO:tasks.workunit.client.0.smithi096.stdout:3/736: symlink d2/df/d1c/d5d/dbf/lfb 0 2022-02-02T18:21:31.173 INFO:tasks.workunit.client.0.smithi096.stdout:3/737: chown d2/df/d1c/d5d/da3 256 1 2022-02-02T18:21:31.174 INFO:tasks.workunit.client.0.smithi096.stdout:5/752: mknod db/d20/c10d 0 2022-02-02T18:21:31.175 INFO:tasks.workunit.client.0.smithi096.stdout:6/791: rmdir d18/d24/d28/d4a/db8 39 2022-02-02T18:21:31.175 INFO:tasks.workunit.client.0.smithi096.stdout:6/792: dread - d18/d24/d28/f78 zero size 2022-02-02T18:21:31.176 INFO:tasks.workunit.client.0.smithi096.stdout:6/793: truncate d18/d24/d28/f78 89894 0 2022-02-02T18:21:31.176 INFO:tasks.workunit.client.0.smithi096.stdout:0/897: write d2/d1e/d67/f11f [8071073,80345] 0 2022-02-02T18:21:31.177 INFO:tasks.workunit.client.0.smithi096.stdout:8/683: rename d29/d4e/dad/db3/d6d/d85/fda to d29/d2d/d87/fdf 0 2022-02-02T18:21:31.180 INFO:tasks.workunit.client.0.smithi096.stdout:5/753: symlink db/de/d10/d25/d4c/l10e 0 2022-02-02T18:21:31.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/754: chown c2 924 1 2022-02-02T18:21:31.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/755: write db/de/d10/d27/fd7 [4699819,114941] 0 2022-02-02T18:21:31.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/756: truncate db/de/d10/fa4 629820 0 2022-02-02T18:21:31.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/757: readlink db/de/d10/d25/da0/d85/la9 0 2022-02-02T18:21:31.182 INFO:tasks.workunit.client.0.smithi096.stdout:4/774: dread d3/d85/fc7 [0,4194304] 0 2022-02-02T18:21:31.183 INFO:tasks.workunit.client.0.smithi096.stdout:6/794: creat d18/d24/d28/d4a/d9d/f123 x:0 0 0 2022-02-02T18:21:31.183 INFO:tasks.workunit.client.0.smithi096.stdout:0/898: unlink d2/db/d7f/ca6 0 2022-02-02T18:21:31.184 INFO:tasks.workunit.client.0.smithi096.stdout:8/684: symlink d29/d4e/dad/dcc/d5b/dd1/le0 0 2022-02-02T18:21:31.185 INFO:tasks.workunit.client.0.smithi096.stdout:8/685: fdatasync d29/d4e/dad/db3/f49 0 2022-02-02T18:21:31.187 INFO:tasks.workunit.client.0.smithi096.stdout:4/775: mknod d3/d85/c101 0 2022-02-02T18:21:31.189 INFO:tasks.workunit.client.0.smithi096.stdout:8/686: mknod d29/d4e/dad/ce1 0 2022-02-02T18:21:31.190 INFO:tasks.workunit.client.0.smithi096.stdout:8/687: chown d29/d58/d7a 38403 1 2022-02-02T18:21:31.192 INFO:tasks.workunit.client.0.smithi096.stdout:8/688: mknod d29/d2d/ce2 0 2022-02-02T18:21:31.194 INFO:tasks.workunit.client.0.smithi096.stdout:4/776: rename d3/d5a/db8 to d3/d4/d20/d26/d36/d102 0 2022-02-02T18:21:31.195 INFO:tasks.workunit.client.0.smithi096.stdout:4/777: fsync d3/d60/fb2 0 2022-02-02T18:21:31.196 INFO:tasks.workunit.client.0.smithi096.stdout:2/842: dwrite d2/d6/db/f8f [0,4194304] 0 2022-02-02T18:21:31.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/740: dwrite d15/d1b/d28/d47/f5c [4194304,4194304] 0 2022-02-02T18:21:31.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/741: creat d15/d1b/d26/d72/dce/f10b x:0 0 0 2022-02-02T18:21:31.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/742: stat d15/d1b/d26/d59/ffe 0 2022-02-02T18:21:31.197 INFO:tasks.workunit.client.0.smithi096.stdout:7/681: dwrite d9/df/d47/fc6 [0,4194304] 0 2022-02-02T18:21:31.198 INFO:tasks.workunit.client.0.smithi096.stdout:2/843: write d2/d29/f32 [1051166,103503] 0 2022-02-02T18:21:31.198 INFO:tasks.workunit.client.0.smithi096.stdout:2/844: read - d2/fee zero size 2022-02-02T18:21:31.200 INFO:tasks.workunit.client.0.smithi096.stdout:2/845: write d2/d6/d1b/d3a/f7f [6874920,125246] 0 2022-02-02T18:21:31.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/738: dwrite d2/df/d1c/d5d/da3/fca [0,4194304] 0 2022-02-02T18:21:31.210 INFO:tasks.workunit.client.0.smithi096.stdout:7/682: chown d9/l17 254911 1 2022-02-02T18:21:31.216 INFO:tasks.workunit.client.0.smithi096.stdout:0/899: dwrite d2/db/d24/d89/d91/fbe [0,4194304] 0 2022-02-02T18:21:31.223 INFO:tasks.workunit.client.0.smithi096.stdout:1/743: rmdir d15/d4d 39 2022-02-02T18:21:31.225 INFO:tasks.workunit.client.0.smithi096.stdout:8/689: dwrite d29/d2d/d42/f53 [0,4194304] 0 2022-02-02T18:21:31.226 INFO:tasks.workunit.client.0.smithi096.stdout:8/690: fsync d29/d4e/dad/db3/d6d/d85/fc7 0 2022-02-02T18:21:31.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/795: dwrite d18/d24/d73/f75 [0,4194304] 0 2022-02-02T18:21:31.227 INFO:tasks.workunit.client.0.smithi096.stdout:2/846: dwrite d2/d5e/d6d/fde [0,4194304] 0 2022-02-02T18:21:31.228 INFO:tasks.workunit.client.0.smithi096.stdout:3/739: mkdir d2/df/d14/d11/daa/dfc 0 2022-02-02T18:21:31.230 INFO:tasks.workunit.client.0.smithi096.stdout:7/683: mknod d9/df/d16/d25/d98/ceb 0 2022-02-02T18:21:31.232 INFO:tasks.workunit.client.0.smithi096.stdout:0/900: dwrite d2/db/d10/d80/d93/fb0 [0,4194304] 0 2022-02-02T18:21:31.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/796: creat d18/d50/d6d/f124 x:0 0 0 2022-02-02T18:21:31.237 INFO:tasks.workunit.client.0.smithi096.stdout:9/786: sync 2022-02-02T18:21:31.237 INFO:tasks.workunit.client.0.smithi096.stdout:9/787: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f101 zero size 2022-02-02T18:21:31.238 INFO:tasks.workunit.client.0.smithi096.stdout:2/847: getdents d2/d6/d1b/d8a 0 2022-02-02T18:21:31.238 INFO:tasks.workunit.client.0.smithi096.stdout:3/740: creat d2/df/d36/d8d/ffd x:0 0 0 2022-02-02T18:21:31.239 INFO:tasks.workunit.client.0.smithi096.stdout:7/684: unlink d9/df/d16/d25/fd5 0 2022-02-02T18:21:31.240 INFO:tasks.workunit.client.0.smithi096.stdout:0/901: rmdir d2/d1e/db9 39 2022-02-02T18:21:31.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/691: truncate d29/d4e/dad/db3/d6d/d85/f86 3129276 0 2022-02-02T18:21:31.242 INFO:tasks.workunit.client.0.smithi096.stdout:8/692: chown d29/d4e/f8e 772 1 2022-02-02T18:21:31.243 INFO:tasks.workunit.client.0.smithi096.stdout:9/788: dread d1/db/d1c/d2f/d78/d11/d3c/f79 [0,4194304] 0 2022-02-02T18:21:31.243 INFO:tasks.workunit.client.0.smithi096.stdout:9/789: dread - d1/db/d1c/d2f/d78/d11/d3c/fc7 zero size 2022-02-02T18:21:31.243 INFO:tasks.workunit.client.0.smithi096.stdout:9/790: chown d1/d39/d8a/d97 13 1 2022-02-02T18:21:31.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/744: dwrite d15/d1b/d28/d2c/f34 [0,4194304] 0 2022-02-02T18:21:31.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/745: chown d15/d1b/d28/fc6 17 1 2022-02-02T18:21:31.244 INFO:tasks.workunit.client.0.smithi096.stdout:8/693: read f19 [1513066,23339] 0 2022-02-02T18:21:31.244 INFO:tasks.workunit.client.0.smithi096.stdout:6/797: link d18/d50/d8f/dc4/lba d18/d50/d8f/dc4/dbd/l125 0 2022-02-02T18:21:31.245 INFO:tasks.workunit.client.0.smithi096.stdout:3/741: link d2/df/d1c/d5d/d69/d43/cd7 d2/df/d1c/db5/cfe 0 2022-02-02T18:21:31.245 INFO:tasks.workunit.client.0.smithi096.stdout:3/742: write d2/df/d1c/d5d/d69/f55 [1879381,32500] 0 2022-02-02T18:21:31.246 INFO:tasks.workunit.client.0.smithi096.stdout:7/685: symlink d9/df/d16/d25/d98/lec 0 2022-02-02T18:21:31.246 INFO:tasks.workunit.client.0.smithi096.stdout:1/746: write d15/f3b [880084,127999] 0 2022-02-02T18:21:31.247 INFO:tasks.workunit.client.0.smithi096.stdout:2/848: dread d2/d13/d8e/fc3 [0,4194304] 0 2022-02-02T18:21:31.247 INFO:tasks.workunit.client.0.smithi096.stdout:8/694: rename d29/d4e/dad/db3/f5c to d29/d4e/dad/db3/d6d/d83/db9/fe3 0 2022-02-02T18:21:31.252 INFO:tasks.workunit.client.0.smithi096.stdout:7/686: symlink d9/df/d12/d39/d40/d6b/dd4/led 0 2022-02-02T18:21:31.257 INFO:tasks.workunit.client.0.smithi096.stdout:2/849: creat d2/d6/d1b/d8a/db5/f106 x:0 0 0 2022-02-02T18:21:31.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/695: dread d29/fa4 [0,4194304] 0 2022-02-02T18:21:31.260 INFO:tasks.workunit.client.0.smithi096.stdout:3/743: rename d2/df/d20/d33/d58/l81 to d2/df/d1c/d5d/da3/lff 0 2022-02-02T18:21:31.260 INFO:tasks.workunit.client.0.smithi096.stdout:3/744: write d2/df/da6/fe7 [480333,13666] 0 2022-02-02T18:21:31.261 INFO:tasks.workunit.client.0.smithi096.stdout:7/687: truncate d9/df/d12/d39/d40/d51/f59 1017446 0 2022-02-02T18:21:31.263 INFO:tasks.workunit.client.0.smithi096.stdout:8/696: mkdir d29/d4e/dad/de4 0 2022-02-02T18:21:31.264 INFO:tasks.workunit.client.0.smithi096.stdout:3/745: mkdir d2/df/d20/d33/d58/dce/dcf/d100 0 2022-02-02T18:21:31.265 INFO:tasks.workunit.client.0.smithi096.stdout:6/798: dread d18/d24/d73/fe3 [0,4194304] 0 2022-02-02T18:21:31.265 INFO:tasks.workunit.client.0.smithi096.stdout:6/799: fsync d18/d50/d8f/dbb/f53 0 2022-02-02T18:21:31.266 INFO:tasks.workunit.client.0.smithi096.stdout:7/688: rename d9/df/d47/lbe to d9/df/d12/d14/d82/lee 0 2022-02-02T18:21:31.266 INFO:tasks.workunit.client.0.smithi096.stdout:7/689: readlink d9/df/d47/d60/lcd 0 2022-02-02T18:21:31.267 INFO:tasks.workunit.client.0.smithi096.stdout:8/697: getdents d29/d4e/dad/dcc 0 2022-02-02T18:21:31.270 INFO:tasks.workunit.client.0.smithi096.stdout:8/698: creat d29/d4e/dad/dcc/d5b/d81/dae/fe5 x:0 0 0 2022-02-02T18:21:31.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/690: getdents d9/df/d12/d39 0 2022-02-02T18:21:31.274 INFO:tasks.workunit.client.0.smithi096.stdout:8/699: mknod d29/d58/d63/ce6 0 2022-02-02T18:21:31.275 INFO:tasks.workunit.client.0.smithi096.stdout:8/700: chown d29/d2d/f7e 2682 1 2022-02-02T18:21:31.275 INFO:tasks.workunit.client.0.smithi096.stdout:8/701: stat d29/d4e/dad/db3/d6d 0 2022-02-02T18:21:31.275 INFO:tasks.workunit.client.0.smithi096.stdout:9/791: dwrite d1/db/d1c/d2f/dc8/f113 [0,4194304] 0 2022-02-02T18:21:31.279 INFO:tasks.workunit.client.0.smithi096.stdout:7/691: creat d9/df/d12/d39/d41/dac/fef x:0 0 0 2022-02-02T18:21:31.280 INFO:tasks.workunit.client.0.smithi096.stdout:8/702: write d29/d4e/dad/db3/d6d/d85/f9d [944065,86171] 0 2022-02-02T18:21:31.281 INFO:tasks.workunit.client.0.smithi096.stdout:1/747: dwrite d15/d1b/d26/d72/de9/fed [0,4194304] 0 2022-02-02T18:21:31.281 INFO:tasks.workunit.client.0.smithi096.stdout:1/748: write d15/d1b/d26/f42 [4423978,5919] 0 2022-02-02T18:21:31.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/749: dread d15/d1b/d26/d72/dff/d8a/fb3 [0,4194304] 0 2022-02-02T18:21:31.285 INFO:tasks.workunit.client.0.smithi096.stdout:1/750: fsync d15/d1b/d26/f31 0 2022-02-02T18:21:31.286 INFO:tasks.workunit.client.0.smithi096.stdout:3/746: dwrite d2/df/d14/d66/f96 [0,4194304] 0 2022-02-02T18:21:31.286 INFO:tasks.workunit.client.0.smithi096.stdout:9/792: getdents d1/db/d1c/d2f/d78/d25/dd 0 2022-02-02T18:21:31.288 INFO:tasks.workunit.client.0.smithi096.stdout:7/692: symlink d9/df/d12/d39/d40/lf0 0 2022-02-02T18:21:31.289 INFO:tasks.workunit.client.0.smithi096.stdout:8/703: getdents d29/d4e/dad/db3/d6d/d83 0 2022-02-02T18:21:31.290 INFO:tasks.workunit.client.0.smithi096.stdout:1/751: dread d15/d1b/d26/d59/ffe [0,4194304] 0 2022-02-02T18:21:31.292 INFO:tasks.workunit.client.0.smithi096.stdout:2/850: dwrite d2/d6/fcb [0,4194304] 0 2022-02-02T18:21:31.294 INFO:tasks.workunit.client.0.smithi096.stdout:2/851: write d2/d29/f32 [239363,52979] 0 2022-02-02T18:21:31.295 INFO:tasks.workunit.client.0.smithi096.stdout:3/747: creat d2/df/d14/d66/f101 x:0 0 0 2022-02-02T18:21:31.295 INFO:tasks.workunit.client.0.smithi096.stdout:3/748: creat d2/df/d1c/d5d/da3/f102 x:0 0 0 2022-02-02T18:21:31.295 INFO:tasks.workunit.client.0.smithi096.stdout:6/800: dwrite d18/d50/f122 [0,4194304] 0 2022-02-02T18:21:31.295 INFO:tasks.workunit.client.0.smithi096.stdout:6/801: chown d18/d24/d28/c99 86742 1 2022-02-02T18:21:31.296 INFO:tasks.workunit.client.0.smithi096.stdout:6/802: readlink d18/d50/d8f/df1/lf4 0 2022-02-02T18:21:31.296 INFO:tasks.workunit.client.0.smithi096.stdout:9/793: truncate d1/db/d1c/d2f/d78/d11/d1e/d47/fce 1201984 0 2022-02-02T18:21:31.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/693: rename d9/f70 to d9/df/d47/d37/d83/db4/ff1 0 2022-02-02T18:21:31.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/694: readlink d9/lc9 0 2022-02-02T18:21:31.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/695: dread - d9/df/d47/d37/d83/db4/fc8 zero size 2022-02-02T18:21:31.302 INFO:tasks.workunit.client.0.smithi096.stdout:1/752: symlink d15/d1b/d26/d72/dff/d8a/l10c 0 2022-02-02T18:21:31.302 INFO:tasks.workunit.client.0.smithi096.stdout:1/753: write d15/d1b/d26/f49 [3793497,21932] 0 2022-02-02T18:21:31.302 INFO:tasks.workunit.client.0.smithi096.stdout:1/754: chown d15/d1b/d28/d2c/d4f/d51/l78 229 1 2022-02-02T18:21:31.303 INFO:tasks.workunit.client.0.smithi096.stdout:2/852: creat d2/d19/f107 x:0 0 0 2022-02-02T18:21:31.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/755: write ff [3322016,125793] 0 2022-02-02T18:21:31.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/756: chown d15/d1b/d26/d72/dce 128 1 2022-02-02T18:21:31.305 INFO:tasks.workunit.client.0.smithi096.stdout:6/803: link d18/d24/d73/dfb/fe5 d18/d24/f126 0 2022-02-02T18:21:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:31 smithi096 conmon[32067]: cluster 2022-02-02T18:21:30.826621+0000 mgr.smithi096.shfutl ( 2022-02-02T18:21:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:31 smithi096 conmon[32067]: mgr.14162) 270 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 1.1 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 63 MiB/s rd, 121 MiB/s wr, 341 op/s 2022-02-02T18:21:31.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/696: creat d9/df/d12/d39/d4e/ff2 x:0 0 0 2022-02-02T18:21:31.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/853: link d2/d6/d1b/d3a/l57 d2/d13/d43/d51/d5d/l108 0 2022-02-02T18:21:31.311 INFO:tasks.workunit.client.0.smithi096.stdout:1/757: creat d15/f10d x:0 0 0 2022-02-02T18:21:31.311 INFO:tasks.workunit.client.0.smithi096.stdout:1/758: stat d15/d1b/d28/d2c 0 2022-02-02T18:21:31.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/804: mknod d18/d50/d8f/c127 0 2022-02-02T18:21:31.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/805: fsync d18/d24/d73/f92 0 2022-02-02T18:21:31.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/697: symlink d9/df/d16/d25/lf3 0 2022-02-02T18:21:31.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/698: dread - d9/df/d44/fd0 zero size 2022-02-02T18:21:31.315 INFO:tasks.workunit.client.0.smithi096.stdout:8/704: dwrite d29/d4e/dad/dcc/d5b/fa6 [0,4194304] 0 2022-02-02T18:21:31.315 INFO:tasks.workunit.client.0.smithi096.stdout:8/705: fdatasync f5 0 2022-02-02T18:21:31.315 INFO:tasks.workunit.client.0.smithi096.stdout:1/759: rename d15/d4d/lb8 to d15/d1b/d28/l10e 0 2022-02-02T18:21:31.316 INFO:tasks.workunit.client.0.smithi096.stdout:3/749: dwrite d2/df/d14/d16/fe0 [0,4194304] 0 2022-02-02T18:21:31.317 INFO:tasks.workunit.client.0.smithi096.stdout:3/750: stat d2/df/d20/d33/d58/d7c/l8c 0 2022-02-02T18:21:31.322 INFO:tasks.workunit.client.0.smithi096.stdout:7/699: unlink d9/df/d47/d60/lcd 0 2022-02-02T18:21:31.323 INFO:tasks.workunit.client.0.smithi096.stdout:7/700: unlink d9/df/d12/d39/d40/lf0 0 2022-02-02T18:21:31.329 INFO:tasks.workunit.client.0.smithi096.stdout:7/701: dread d9/df/d12/d39/d42/f5b [0,4194304] 0 2022-02-02T18:21:31.329 INFO:tasks.workunit.client.0.smithi096.stdout:7/702: write d9/df/d12/f6d [4971190,30703] 0 2022-02-02T18:21:31.334 INFO:tasks.workunit.client.0.smithi096.stdout:8/706: dwrite d29/d2d/d47/fa2 [0,4194304] 0 2022-02-02T18:21:31.335 INFO:tasks.workunit.client.0.smithi096.stdout:8/707: write d29/d58/d79/fc8 [11365,52088] 0 2022-02-02T18:21:31.335 INFO:tasks.workunit.client.0.smithi096.stdout:8/708: readlink d29/l2c 0 2022-02-02T18:21:31.341 INFO:tasks.workunit.client.0.smithi096.stdout:6/806: rmdir d18 39 2022-02-02T18:21:31.344 INFO:tasks.workunit.client.0.smithi096.stdout:1/760: getdents d15/d1b/d26/d72/dce 0 2022-02-02T18:21:31.344 INFO:tasks.workunit.client.0.smithi096.stdout:1/761: truncate d15/d1b/d26/d72/dce/fe2 466106 0 2022-02-02T18:21:31.346 INFO:tasks.workunit.client.0.smithi096.stdout:3/751: rmdir d2/df/d14/dbe 39 2022-02-02T18:21:31.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/709: rename d29/d2d/d87/f97 to d29/d4e/dad/ddb/fe7 0 2022-02-02T18:21:31.353 INFO:tasks.workunit.client.0.smithi096.stdout:1/762: unlink d15/d1b/d26/d72/cf9 0 2022-02-02T18:21:31.353 INFO:tasks.workunit.client.0.smithi096.stdout:1/763: write d15/d1b/d26/d72/da3/da7/ffd [16970,62186] 0 2022-02-02T18:21:31.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/703: rmdir d9/df/d12/d39/d4e/d6e 39 2022-02-02T18:21:31.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/752: mkdir d2/df/d14/d11/daa/dfc/d103 0 2022-02-02T18:21:31.356 INFO:tasks.workunit.client.0.smithi096.stdout:3/753: dread d2/df/da6/fe7 [0,4194304] 0 2022-02-02T18:21:31.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/754: truncate d2/d71/fe4 1399776 0 2022-02-02T18:21:31.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/755: truncate d2/df/d14/dbe/ff0 545039 0 2022-02-02T18:21:31.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/756: chown d2/df/d14/d73 746373 1 2022-02-02T18:21:31.360 INFO:tasks.workunit.client.0.smithi096.stdout:7/704: getdents d9/df/d47/d60 0 2022-02-02T18:21:31.362 INFO:tasks.workunit.client.0.smithi096.stdout:7/705: rename d9/df/d12/d39/d40/d85/fe0 to d9/df/d12/d39/d4e/d6e/ff4 0 2022-02-02T18:21:31.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/706: unlink d9/df/d12/d39/d40/d85/c87 0 2022-02-02T18:21:31.364 INFO:tasks.workunit.client.0.smithi096.stdout:7/707: fdatasync d9/df/d12/d39/d46/f7e 0 2022-02-02T18:21:31.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/708: rename d9/l11 to d9/lf5 0 2022-02-02T18:21:31.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/709: creat d9/df/d12/d39/d40/d85/ff6 x:0 0 0 2022-02-02T18:21:31.367 INFO:tasks.workunit.client.0.smithi096.stdout:7/710: creat d9/df/d47/d37/ff7 x:0 0 0 2022-02-02T18:21:31.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/764: dread d15/d1b/f2f [0,4194304] 0 2022-02-02T18:21:31.368 INFO:tasks.workunit.client.0.smithi096.stdout:7/711: creat d9/df/d12/d39/ff8 x:0 0 0 2022-02-02T18:21:31.369 INFO:tasks.workunit.client.0.smithi096.stdout:1/765: mknod d15/d1b/d28/d2c/d39/de5/c10f 0 2022-02-02T18:21:31.370 INFO:tasks.workunit.client.0.smithi096.stdout:7/712: link d9/df/d12/d14/c34 d9/df/d12/d39/d40/d6b/dd4/cf9 0 2022-02-02T18:21:31.371 INFO:tasks.workunit.client.0.smithi096.stdout:1/766: truncate d15/d1b/d26/f77 97283 0 2022-02-02T18:21:31.372 INFO:tasks.workunit.client.0.smithi096.stdout:7/713: mkdir d9/df/d12/d39/d41/dfa 0 2022-02-02T18:21:31.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/767: creat d15/d1b/d28/d47/f110 x:0 0 0 2022-02-02T18:21:31.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/768: creat d15/d1b/d26/d72/de9/f111 x:0 0 0 2022-02-02T18:21:31.373 INFO:tasks.workunit.client.0.smithi096.stdout:7/714: mkdir d9/df/d47/d19/dfb 0 2022-02-02T18:21:31.374 INFO:tasks.workunit.client.0.smithi096.stdout:7/715: fdatasync d9/df/d54/db8/fd9 0 2022-02-02T18:21:31.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/710: dwrite d29/d2d/f56 [0,4194304] 0 2022-02-02T18:21:31.374 INFO:tasks.workunit.client.0.smithi096.stdout:3/757: dwrite d2/df/d14/d11/f8f [0,4194304] 0 2022-02-02T18:21:31.375 INFO:tasks.workunit.client.0.smithi096.stdout:1/769: creat d15/d1b/d28/d2c/d39/de5/f112 x:0 0 0 2022-02-02T18:21:31.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/711: rename d29/d4e/dad/db3/d6d/d83/cab to d29/d4e/dad/db3/ce8 0 2022-02-02T18:21:31.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/712: creat d29/d4e/dad/dcc/d5b/d81/dae/fe9 x:0 0 0 2022-02-02T18:21:31.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/770: mkdir d15/d1b/d26/d72/da3/da7/ddc/d113 0 2022-02-02T18:21:31.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/713: dread d29/d2d/f2e [0,4194304] 0 2022-02-02T18:21:31.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/714: write d29/d2d/f7e [537697,118034] 0 2022-02-02T18:21:31.384 INFO:tasks.workunit.client.0.smithi096.stdout:7/716: dread d9/df/d12/d39/d4e/d6e/f74 [0,4194304] 0 2022-02-02T18:21:31.385 INFO:tasks.workunit.client.0.smithi096.stdout:7/717: dread - d9/df/d44/fd0 zero size 2022-02-02T18:21:31.385 INFO:tasks.workunit.client.0.smithi096.stdout:3/758: getdents d2/d71 0 2022-02-02T18:21:31.389 INFO:tasks.workunit.client.0.smithi096.stdout:1/771: rename d15/d4d/d8e to d15/d1b/d28/d114 0 2022-02-02T18:21:31.389 INFO:tasks.workunit.client.0.smithi096.stdout:1/772: fdatasync d15/d1b/d26/d72/da3/da7/fb2 0 2022-02-02T18:21:31.391 INFO:tasks.workunit.client.0.smithi096.stdout:8/715: mkdir d29/d58/d79/dea 0 2022-02-02T18:21:31.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/716: mkdir d29/d2d/d87/da5/deb 0 2022-02-02T18:21:31.394 INFO:tasks.workunit.client.0.smithi096.stdout:8/717: chown d29/d4e/dad/ddb 7715 1 2022-02-02T18:21:31.394 INFO:tasks.workunit.client.0.smithi096.stdout:8/718: fsync d29/f3a 0 2022-02-02T18:21:31.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/758: sync 2022-02-02T18:21:31.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/778: sync 2022-02-02T18:21:31.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/719: mkdir d29/d4e/dad/dcc/d5b/d81/dec 0 2022-02-02T18:21:31.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/720: readlink d29/d58/d7a/l99 0 2022-02-02T18:21:31.400 INFO:tasks.workunit.client.0.smithi096.stdout:4/779: mkdir d3/d5a/d103 0 2022-02-02T18:21:31.401 INFO:tasks.workunit.client.0.smithi096.stdout:3/759: rename d2/df/d14/d11 to d2/df/d34/d76/dd3/d104 0 2022-02-02T18:21:31.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/780: creat d3/d60/d8d/dc6/dd0/f104 x:0 0 0 2022-02-02T18:21:31.407 INFO:tasks.workunit.client.0.smithi096.stdout:5/759: dread db/de/d2e/d35/f95 [0,4194304] 0 2022-02-02T18:21:31.407 INFO:tasks.workunit.client.0.smithi096.stdout:5/760: chown db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/d9d/l9f 94276688 1 2022-02-02T18:21:31.409 INFO:tasks.workunit.client.0.smithi096.stdout:7/718: dwrite d9/f8d [0,4194304] 0 2022-02-02T18:21:31.410 INFO:tasks.workunit.client.0.smithi096.stdout:7/719: chown d9/df/d47/l68 1665864 1 2022-02-02T18:21:31.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/721: dread f1c [0,4194304] 0 2022-02-02T18:21:31.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/722: readlink d29/d2d/d47/l60 0 2022-02-02T18:21:31.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/773: dwrite d15/f22 [0,4194304] 0 2022-02-02T18:21:31.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/781: write d3/f32 [685772,96495] 0 2022-02-02T18:21:31.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/782: creat d3/d4/d20/d26/d36/d88/f105 x:0 0 0 2022-02-02T18:21:31.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/783: truncate d3/d4/d20/d4d/f54 1046224 0 2022-02-02T18:21:31.413 INFO:tasks.workunit.client.0.smithi096.stdout:4/784: write d3/d85/fc7 [1298220,45426] 0 2022-02-02T18:21:31.413 INFO:tasks.workunit.client.0.smithi096.stdout:7/720: rename d9/df/d47/d60/fe2 to d9/df/d12/d39/d41/ffc 0 2022-02-02T18:21:31.413 INFO:tasks.workunit.client.0.smithi096.stdout:7/721: fdatasync d9/df/d12/d39/d40/d85/fcf 0 2022-02-02T18:21:31.414 INFO:tasks.workunit.client.0.smithi096.stdout:1/774: write d15/d1b/d26/d59/fb1 [3242511,48360] 0 2022-02-02T18:21:31.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/723: unlink d29/d4e/dad/dcc/d5b/d81/l9a 0 2022-02-02T18:21:31.422 INFO:tasks.workunit.client.0.smithi096.stdout:7/722: rename d9/df/d12/d39/d41/f4f to d9/df/d12/d39/d40/d85/ffd 0 2022-02-02T18:21:31.423 INFO:tasks.workunit.client.0.smithi096.stdout:8/724: creat d29/d58/d63/fed x:0 0 0 2022-02-02T18:21:31.441 INFO:tasks.workunit.client.0.smithi096.stdout:3/760: dwrite d2/df/d34/d76/dd3/d104/fc0 [0,4194304] 0 2022-02-02T18:21:31.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/723: dwrite d9/df/d12/d39/d41/ffc [0,4194304] 0 2022-02-02T18:21:31.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/761: dwrite db/de/d2e/d35/f34 [0,4194304] 0 2022-02-02T18:21:31.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/762: unlink db/de/d2e/d35/fdb 0 2022-02-02T18:21:31.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/763: truncate db/d5c/d61/f8b 4952839 0 2022-02-02T18:21:31.454 INFO:tasks.workunit.client.0.smithi096.stdout:1/775: dwrite d15/d1b/d28/d2c/d39/de5/f112 [0,4194304] 0 2022-02-02T18:21:31.456 INFO:tasks.workunit.client.0.smithi096.stdout:8/725: dwrite d29/d2d/d87/fa9 [0,4194304] 0 2022-02-02T18:21:31.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/776: write d15/f2a [1585190,50980] 0 2022-02-02T18:21:31.462 INFO:tasks.workunit.client.0.smithi096.stdout:8/726: link d29/d4e/f9f d29/d4e/dad/dcc/d5b/d81/fee 0 2022-02-02T18:21:31.464 INFO:tasks.workunit.client.0.smithi096.stdout:1/777: mknod d15/d67/c115 0 2022-02-02T18:21:31.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/778: symlink d15/d1b/d26/d72/da3/da7/ddc/df0/l116 0 2022-02-02T18:21:31.466 INFO:tasks.workunit.client.0.smithi096.stdout:8/727: write d29/d2d/d42/f95 [3786223,48648] 0 2022-02-02T18:21:31.472 INFO:tasks.workunit.client.0.smithi096.stdout:3/761: dwrite d2/df/d14/d66/fba [4194304,4194304] 0 2022-02-02T18:21:31.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/762: unlink d2/df/d20/d33/f51 0 2022-02-02T18:21:31.479 INFO:tasks.workunit.client.0.smithi096.stdout:3/763: creat d2/df/d20/dc4/f105 x:0 0 0 2022-02-02T18:21:31.481 INFO:tasks.workunit.client.0.smithi096.stdout:3/764: creat d2/df/d14/d2c/d74/df3/f106 x:0 0 0 2022-02-02T18:21:31.481 INFO:tasks.workunit.client.0.smithi096.stdout:3/765: fsync d2/df/d20/fe5 0 2022-02-02T18:21:31.481 INFO:tasks.workunit.client.0.smithi096.stdout:3/766: dread - d2/df/d14/d66/f101 zero size 2022-02-02T18:21:31.482 INFO:tasks.workunit.client.0.smithi096.stdout:7/724: dwrite d9/df/d47/d60/f9f [0,4194304] 0 2022-02-02T18:21:31.483 INFO:tasks.workunit.client.0.smithi096.stdout:5/764: dwrite db/d5c/d61/f8b [0,4194304] 0 2022-02-02T18:21:31.486 INFO:tasks.workunit.client.0.smithi096.stdout:3/767: dread d2/d71/f83 [0,4194304] 0 2022-02-02T18:21:31.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/765: rename db/de/d10/fa4 to db/de/d10/d25/d4c/f10f 0 2022-02-02T18:21:31.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/725: rmdir d9/df/d47/dd3 39 2022-02-02T18:21:31.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/726: chown d9/df/d12/l67 162 1 2022-02-02T18:21:31.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/727: creat d9/df/d54/ffe x:0 0 0 2022-02-02T18:21:31.491 INFO:tasks.workunit.client.0.smithi096.stdout:1/779: dwrite d15/d1b/d28/d2c/d39/d71/f7d [0,4194304] 0 2022-02-02T18:21:31.492 INFO:tasks.workunit.client.0.smithi096.stdout:7/728: fdatasync d9/df/d47/d60/f9e 0 2022-02-02T18:21:31.492 INFO:tasks.workunit.client.0.smithi096.stdout:7/729: fsync d9/df/d12/d39/d40/d51/fa6 0 2022-02-02T18:21:31.492 INFO:tasks.workunit.client.0.smithi096.stdout:3/768: truncate d2/df/d14/f12 2421781 0 2022-02-02T18:21:31.493 INFO:tasks.workunit.client.0.smithi096.stdout:8/728: dwrite d29/d2d/fbc [0,4194304] 0 2022-02-02T18:21:31.494 INFO:tasks.workunit.client.0.smithi096.stdout:3/769: mkdir d2/df/d34/d76/dd3/d104/daa/dfc/d107 0 2022-02-02T18:21:31.495 INFO:tasks.workunit.client.0.smithi096.stdout:8/729: mkdir d29/d2d/d87/def 0 2022-02-02T18:21:31.498 INFO:tasks.workunit.client.0.smithi096.stdout:3/770: mkdir d2/df/d20/d4a/d108 0 2022-02-02T18:21:31.499 INFO:tasks.workunit.client.0.smithi096.stdout:8/730: creat d29/d4e/dad/dcc/ff0 x:0 0 0 2022-02-02T18:21:31.500 INFO:tasks.workunit.client.0.smithi096.stdout:1/780: dread f13 [0,4194304] 0 2022-02-02T18:21:31.500 INFO:tasks.workunit.client.0.smithi096.stdout:1/781: fdatasync d15/d1b/d26/d72/dff/fd3 0 2022-02-02T18:21:31.501 INFO:tasks.workunit.client.0.smithi096.stdout:3/771: write d2/d71/f83 [2531774,53595] 0 2022-02-02T18:21:31.501 INFO:tasks.workunit.client.0.smithi096.stdout:3/772: chown d2/df/d1c/d5d/dbf/lfb 14318 1 2022-02-02T18:21:31.501 INFO:tasks.workunit.client.0.smithi096.stdout:1/782: dread d15/d1b/d26/d72/dff/fe4 [0,4194304] 0 2022-02-02T18:21:31.504 INFO:tasks.workunit.client.0.smithi096.stdout:1/783: rename d15/d1b/d26/d72/dff/d8a/f9c to d15/d1b/d26/d72/da3/da7/ddc/d9f/f117 0 2022-02-02T18:21:31.504 INFO:tasks.workunit.client.0.smithi096.stdout:0/902: sync 2022-02-02T18:21:31.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/903: read d2/db/d24/f9a [271862,56247] 0 2022-02-02T18:21:31.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/904: dread - d2/db/f125 zero size 2022-02-02T18:21:31.505 INFO:tasks.workunit.client.0.smithi096.stdout:1/784: write d15/d1b/d26/f31 [2990571,104658] 0 2022-02-02T18:21:31.506 INFO:tasks.workunit.client.0.smithi096.stdout:1/785: getdents d15/d1b/d26/d72/dff/df3 0 2022-02-02T18:21:31.507 INFO:tasks.workunit.client.0.smithi096.stdout:0/905: rename d2/db/d10/d27/f5b to d2/db/d37/d40/d8a/f131 0 2022-02-02T18:21:31.507 INFO:tasks.workunit.client.0.smithi096.stdout:0/906: readlink d2/db/d24/d4d/d53/d58/l121 0 2022-02-02T18:21:31.508 INFO:tasks.workunit.client.0.smithi096.stdout:1/786: creat d15/d1b/d26/d59/dd2/f118 x:0 0 0 2022-02-02T18:21:31.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/907: mkdir d2/db/d37/d113/d132 0 2022-02-02T18:21:31.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/787: mknod d15/d1b/d26/d72/da3/da7/ddc/df0/c119 0 2022-02-02T18:21:31.512 INFO:tasks.workunit.client.0.smithi096.stdout:0/908: symlink d2/db/d24/d4d/d54/d103/l133 0 2022-02-02T18:21:31.513 INFO:tasks.workunit.client.0.smithi096.stdout:0/909: truncate d2/db/d24/d4d/d61/fe5 404456 0 2022-02-02T18:21:31.513 INFO:tasks.workunit.client.0.smithi096.stdout:0/910: creat d2/db/d24/d4d/d53/d58/d102/f134 x:0 0 0 2022-02-02T18:21:31.514 INFO:tasks.workunit.client.0.smithi096.stdout:0/911: symlink d2/d1e/db3/l135 0 2022-02-02T18:21:31.514 INFO:tasks.workunit.client.0.smithi096.stdout:1/788: dread d15/d4d/fc7 [0,4194304] 0 2022-02-02T18:21:31.517 INFO:tasks.workunit.client.0.smithi096.stdout:1/789: creat d15/d1b/d28/d3f/f11a x:0 0 0 2022-02-02T18:21:31.521 INFO:tasks.workunit.client.0.smithi096.stdout:3/773: truncate d2/df/d14/f12 2043048 0 2022-02-02T18:21:31.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/774: symlink d2/l109 0 2022-02-02T18:21:31.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/775: chown d2/df/d36/d8d/c93 3 1 2022-02-02T18:21:31.524 INFO:tasks.workunit.client.0.smithi096.stdout:0/912: dread d2/db/d37/d40/d8a/f94 [0,4194304] 0 2022-02-02T18:21:31.524 INFO:tasks.workunit.client.0.smithi096.stdout:3/776: getdents d2/df/d1c/d5d/d69 0 2022-02-02T18:21:31.525 INFO:tasks.workunit.client.0.smithi096.stdout:3/777: mknod d2/df/da6/c10a 0 2022-02-02T18:21:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:31 smithi159 conmon[35668]: cluster 2022-02-02T18:21:30.826621+0000 mgr.smithi096.shfutl (mgr.14162) 270 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 1.1 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 63 MiB/s rd, 121 MiB/s wr, 341 op/s 2022-02-02T18:21:31.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/790: dread d15/d4d/f65 [0,4194304] 0 2022-02-02T18:21:31.531 INFO:tasks.workunit.client.0.smithi096.stdout:1/791: mkdir d15/d1b/d26/d59/d11b 0 2022-02-02T18:21:31.532 INFO:tasks.workunit.client.0.smithi096.stdout:1/792: write d15/d1b/f104 [260673,85694] 0 2022-02-02T18:21:31.532 INFO:tasks.workunit.client.0.smithi096.stdout:1/793: creat d15/d1b/d26/d72/f11c x:0 0 0 2022-02-02T18:21:31.532 INFO:tasks.workunit.client.0.smithi096.stdout:1/794: chown d15/d1b/d26/d72/dff/c6d 59 1 2022-02-02T18:21:31.533 INFO:tasks.workunit.client.0.smithi096.stdout:1/795: creat d15/d1b/d26/d72/f11d x:0 0 0 2022-02-02T18:21:31.534 INFO:tasks.workunit.client.0.smithi096.stdout:1/796: unlink d15/d1b/d26/f49 0 2022-02-02T18:21:31.535 INFO:tasks.workunit.client.0.smithi096.stdout:1/797: mkdir d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e 0 2022-02-02T18:21:31.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/913: dwrite d2/db/d37/d40/d8a/f94 [4194304,4194304] 0 2022-02-02T18:21:31.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/914: fdatasync d2/db/d37/d5f/f119 0 2022-02-02T18:21:31.543 INFO:tasks.workunit.client.0.smithi096.stdout:0/915: mknod d2/db/d10/d80/d93/da3/c136 0 2022-02-02T18:21:31.545 INFO:tasks.workunit.client.0.smithi096.stdout:0/916: dread d2/db/d37/d113/dd6/f98 [0,4194304] 0 2022-02-02T18:21:31.550 INFO:tasks.workunit.client.0.smithi096.stdout:0/917: write d2/f4 [3971062,26333] 0 2022-02-02T18:21:31.550 INFO:tasks.workunit.client.0.smithi096.stdout:0/918: write d2/db/d10/d80/d93/da3/ddd/fc9 [863048,3177] 0 2022-02-02T18:21:31.551 INFO:tasks.workunit.client.0.smithi096.stdout:0/919: symlink d2/db/d24/d89/d8f/d95/l137 0 2022-02-02T18:21:31.552 INFO:tasks.workunit.client.0.smithi096.stdout:1/798: dwrite d15/d1b/d26/f77 [0,4194304] 0 2022-02-02T18:21:31.552 INFO:tasks.workunit.client.0.smithi096.stdout:0/920: creat d2/db/d24/d4d/d53/d12e/f138 x:0 0 0 2022-02-02T18:21:31.556 INFO:tasks.workunit.client.0.smithi096.stdout:0/921: getdents d2/d1e/d67 0 2022-02-02T18:21:31.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/922: symlink d2/db/d10/d80/d93/da3/ddd/l139 0 2022-02-02T18:21:31.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/923: readlink d2/db/d37/d5f/l108 0 2022-02-02T18:21:31.558 INFO:tasks.workunit.client.0.smithi096.stdout:0/924: chown d2/db/d37/d113/dd6 1526176 1 2022-02-02T18:21:31.559 INFO:tasks.workunit.client.0.smithi096.stdout:1/799: dread d15/d1b/d28/d2c/d4f/f89 [0,4194304] 0 2022-02-02T18:21:31.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/925: creat d2/db/d24/d89/d8f/da1/de9/f13a x:0 0 0 2022-02-02T18:21:31.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/926: dread - d2/db/d37/f12a zero size 2022-02-02T18:21:31.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/927: write d2/db/d10/d80/d93/da3/dca/f114 [458528,90019] 0 2022-02-02T18:21:31.560 INFO:tasks.workunit.client.0.smithi096.stdout:0/928: chown d2/db/d37/d40/l6c 0 1 2022-02-02T18:21:31.560 INFO:tasks.workunit.client.0.smithi096.stdout:9/794: sync 2022-02-02T18:21:31.560 INFO:tasks.workunit.client.0.smithi096.stdout:2/854: sync 2022-02-02T18:21:31.560 INFO:tasks.workunit.client.0.smithi096.stdout:9/795: chown d1/db/d1c/d2f/d78/d11/d3c/c7d 4635329 1 2022-02-02T18:21:31.561 INFO:tasks.workunit.client.0.smithi096.stdout:1/800: mknod d15/d1b/d26/d72/dff/d8a/db9/c11f 0 2022-02-02T18:21:31.561 INFO:tasks.workunit.client.0.smithi096.stdout:1/801: fdatasync d15/d1b/d26/d59/fab 0 2022-02-02T18:21:31.562 INFO:tasks.workunit.client.0.smithi096.stdout:2/855: symlink d2/d6/d1b/d8a/l109 0 2022-02-02T18:21:31.563 INFO:tasks.workunit.client.0.smithi096.stdout:1/802: creat d15/d1b/d26/d72/da3/f120 x:0 0 0 2022-02-02T18:21:31.564 INFO:tasks.workunit.client.0.smithi096.stdout:2/856: symlink d2/d6/dd2/l10a 0 2022-02-02T18:21:31.567 INFO:tasks.workunit.client.0.smithi096.stdout:2/857: rename d2/d19/de3/fe5 to d2/d13/d43/d51/d73/f10b 0 2022-02-02T18:21:31.568 INFO:tasks.workunit.client.0.smithi096.stdout:2/858: mknod d2/d6/dd2/c10c 0 2022-02-02T18:21:31.594 INFO:tasks.workunit.client.0.smithi096.stdout:2/859: dwrite d2/d5e/d6d/d79/d66/ff8 [0,4194304] 0 2022-02-02T18:21:31.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/796: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f10b [0,4194304] 0 2022-02-02T18:21:31.603 INFO:tasks.workunit.client.0.smithi096.stdout:0/929: dwrite d2/db/d37/d40/d8a/f118 [0,4194304] 0 2022-02-02T18:21:31.604 INFO:tasks.workunit.client.0.smithi096.stdout:1/803: dwrite d15/d1b/d26/d72/dff/d8a/db9/fda [0,4194304] 0 2022-02-02T18:21:31.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/860: dwrite d2/d19/d86/db3/ff9 [0,4194304] 0 2022-02-02T18:21:31.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/804: symlink d15/d1b/d26/d59/dd2/l121 0 2022-02-02T18:21:31.615 INFO:tasks.workunit.client.0.smithi096.stdout:2/861: dread d2/d5e/d7c/f83 [0,4194304] 0 2022-02-02T18:21:31.617 INFO:tasks.workunit.client.0.smithi096.stdout:1/805: mkdir d15/d1b/d26/d72/da3/d122 0 2022-02-02T18:21:31.618 INFO:tasks.workunit.client.0.smithi096.stdout:1/806: rmdir d15/d1b/d28/d2c/d39 39 2022-02-02T18:21:31.618 INFO:tasks.workunit.client.0.smithi096.stdout:1/807: creat d15/d1b/d28/d3f/f123 x:0 0 0 2022-02-02T18:21:31.618 INFO:tasks.workunit.client.0.smithi096.stdout:1/808: dread - d15/d1b/d26/d72/fe3 zero size 2022-02-02T18:21:31.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/809: creat d15/d1b/d28/d2c/d39/d71/f124 x:0 0 0 2022-02-02T18:21:31.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/810: creat d15/d1b/d26/d72/da3/da7/ddc/f125 x:0 0 0 2022-02-02T18:21:31.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/811: dread - d15/d1b/d28/d2c/d39/fd9 zero size 2022-02-02T18:21:31.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/812: fdatasync f11 0 2022-02-02T18:21:31.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/813: fdatasync d15/d1b/d26/d59/ffe 0 2022-02-02T18:21:31.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/807: sync 2022-02-02T18:21:31.623 INFO:tasks.workunit.client.0.smithi096.stdout:7/730: sync 2022-02-02T18:21:31.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/778: sync 2022-02-02T18:21:31.623 INFO:tasks.workunit.client.0.smithi096.stdout:7/731: write d9/df/d12/d39/d4e/ff2 [481423,98711] 0 2022-02-02T18:21:31.624 INFO:tasks.workunit.client.0.smithi096.stdout:4/785: sync 2022-02-02T18:21:31.624 INFO:tasks.workunit.client.0.smithi096.stdout:4/786: dread - d3/d60/dbd/ffc zero size 2022-02-02T18:21:31.625 INFO:tasks.workunit.client.0.smithi096.stdout:1/814: getdents d15/d1b/d28/d2c/d39 0 2022-02-02T18:21:31.625 INFO:tasks.workunit.client.0.smithi096.stdout:0/930: dwrite d2/db/d24/d89/d8f/d95/fb1 [0,4194304] 0 2022-02-02T18:21:31.625 INFO:tasks.workunit.client.0.smithi096.stdout:5/766: sync 2022-02-02T18:21:31.625 INFO:tasks.workunit.client.0.smithi096.stdout:8/731: sync 2022-02-02T18:21:31.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/808: creat d18/d24/d28/d3e/f128 x:0 0 0 2022-02-02T18:21:31.627 INFO:tasks.workunit.client.0.smithi096.stdout:7/732: link d9/df/d12/d39/d40/fe8 d9/df/d12/d39/d46/d7d/dd7/fff 0 2022-02-02T18:21:31.628 INFO:tasks.workunit.client.0.smithi096.stdout:4/787: rename d3/d4/d20/d26/d36/d88/dde/df4/f4b to d3/d4/d20/d26/d36/d102/f106 0 2022-02-02T18:21:31.629 INFO:tasks.workunit.client.0.smithi096.stdout:4/788: creat d3/d60/d8d/dc6/dd0/f107 x:0 0 0 2022-02-02T18:21:31.630 INFO:tasks.workunit.client.0.smithi096.stdout:3/779: dread d2/df/d20/fee [0,4194304] 0 2022-02-02T18:21:31.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/732: truncate d29/d4e/f72 1468446 0 2022-02-02T18:21:31.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/733: creat d29/d58/d63/ff1 x:0 0 0 2022-02-02T18:21:31.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/734: dread - d29/d4e/dad/dcc/d5b/fbb zero size 2022-02-02T18:21:31.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/735: creat d29/d58/ff2 x:0 0 0 2022-02-02T18:21:31.632 INFO:tasks.workunit.client.0.smithi096.stdout:1/815: mknod d15/d1b/d28/d2c/d39/d71/c126 0 2022-02-02T18:21:31.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/862: dwrite d2/d6/db/f8f [0,4194304] 0 2022-02-02T18:21:31.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/863: dread - d2/d19/f107 zero size 2022-02-02T18:21:31.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/864: creat d2/d13/d43/d51/d73/da9/f10d x:0 0 0 2022-02-02T18:21:31.633 INFO:tasks.workunit.client.0.smithi096.stdout:6/809: creat d18/d50/d9a/d116/d120/f129 x:0 0 0 2022-02-02T18:21:31.636 INFO:tasks.workunit.client.0.smithi096.stdout:0/931: rename d2/db/d10/d80/d93/da3/ddd/l139 to d2/db/d37/l13b 0 2022-02-02T18:21:31.638 INFO:tasks.workunit.client.0.smithi096.stdout:4/789: mkdir d3/d4/d90/d108 0 2022-02-02T18:21:31.645 INFO:tasks.workunit.client.0.smithi096.stdout:8/736: link l9 d29/d2d/lf3 0 2022-02-02T18:21:31.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/816: getdents d15/d1b/d26/d72/dff/d8a 0 2022-02-02T18:21:31.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/817: stat d15/d4d/l56 0 2022-02-02T18:21:31.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/818: truncate d15/d1b/d28/d2c/d39/d71/f124 329519 0 2022-02-02T18:21:31.649 INFO:tasks.workunit.client.0.smithi096.stdout:8/737: dread d29/d4e/f9f [0,4194304] 0 2022-02-02T18:21:31.651 INFO:tasks.workunit.client.0.smithi096.stdout:2/865: mkdir d2/d13/d43/d80/d10e 0 2022-02-02T18:21:31.651 INFO:tasks.workunit.client.0.smithi096.stdout:6/810: creat d18/d24/f12a x:0 0 0 2022-02-02T18:21:31.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/811: write d18/d24/d28/d4a/db8/f115 [757203,39488] 0 2022-02-02T18:21:31.653 INFO:tasks.workunit.client.0.smithi096.stdout:0/932: symlink d2/d1e/d67/d128/l13c 0 2022-02-02T18:21:31.653 INFO:tasks.workunit.client.0.smithi096.stdout:0/933: dread - d2/db/d37/f12a zero size 2022-02-02T18:21:31.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/767: dwrite db/d20/fc1 [4194304,4194304] 0 2022-02-02T18:21:31.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/768: write f6 [4309344,129148] 0 2022-02-02T18:21:31.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/769: write db/de/d10/d80/fee [12989,12891] 0 2022-02-02T18:21:31.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/770: truncate db/de/d2e/f51 1774704 0 2022-02-02T18:21:31.655 INFO:tasks.workunit.client.0.smithi096.stdout:5/771: readlink db/d5c/d2f/l56 0 2022-02-02T18:21:31.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/819: rename d15/d1b/d28/d2c/d39/c7e to d15/d1b/d28/d2c/c127 0 2022-02-02T18:21:31.656 INFO:tasks.workunit.client.0.smithi096.stdout:1/820: chown d15/d1b/d26/d72/da3/da7/ddc/d9f 4614265 1 2022-02-02T18:21:31.656 INFO:tasks.workunit.client.0.smithi096.stdout:8/738: mkdir d29/d4e/dad/db3/d6d/d83/db9/df4 0 2022-02-02T18:21:31.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/812: link d18/d50/d8f/dbb/f6a d18/d24/d28/f12b 0 2022-02-02T18:21:31.659 INFO:tasks.workunit.client.0.smithi096.stdout:1/821: creat d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f128 x:0 0 0 2022-02-02T18:21:31.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/739: symlink d29/lf5 0 2022-02-02T18:21:31.662 INFO:tasks.workunit.client.0.smithi096.stdout:1/822: truncate d15/f2e 2170780 0 2022-02-02T18:21:31.664 INFO:tasks.workunit.client.0.smithi096.stdout:1/823: creat d15/d4d/f129 x:0 0 0 2022-02-02T18:21:31.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/733: dwrite d9/df/d12/d39/d4e/f88 [0,4194304] 0 2022-02-02T18:21:31.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/740: read d29/d4e/dad/db3/d6d/d85/f86 [843455,296] 0 2022-02-02T18:21:31.667 INFO:tasks.workunit.client.0.smithi096.stdout:5/772: dread db/de/f2a [0,4194304] 0 2022-02-02T18:21:31.667 INFO:tasks.workunit.client.0.smithi096.stdout:1/824: symlink d15/d1b/d28/d2c/d4f/l12a 0 2022-02-02T18:21:31.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/780: dwrite d2/df/d1c/d5d/d69/d43/d72/f95 [4194304,4194304] 0 2022-02-02T18:21:31.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/781: unlink d2/df/d14/d2c/d31/ca2 0 2022-02-02T18:21:31.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/782: stat d2/df/d14/d66/f101 0 2022-02-02T18:21:31.668 INFO:tasks.workunit.client.0.smithi096.stdout:4/790: dwrite d3/d60/d8d/da7/f8f [0,4194304] 0 2022-02-02T18:21:31.668 INFO:tasks.workunit.client.0.smithi096.stdout:4/791: fsync d3/d4/d20/d26/d36/f44 0 2022-02-02T18:21:31.668 INFO:tasks.workunit.client.0.smithi096.stdout:7/734: write d9/df/d12/f6d [2774714,106567] 0 2022-02-02T18:21:31.669 INFO:tasks.workunit.client.0.smithi096.stdout:5/773: read db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/fd3 [107251,123382] 0 2022-02-02T18:21:31.669 INFO:tasks.workunit.client.0.smithi096.stdout:1/825: creat d15/d67/f12b x:0 0 0 2022-02-02T18:21:31.671 INFO:tasks.workunit.client.0.smithi096.stdout:6/813: dread d18/d50/d8f/dbb/d63/db3/fdf [0,4194304] 0 2022-02-02T18:21:31.671 INFO:tasks.workunit.client.0.smithi096.stdout:6/814: write d18/d50/d8f/dbb/d63/db3/f106 [810783,72630] 0 2022-02-02T18:21:31.672 INFO:tasks.workunit.client.0.smithi096.stdout:3/783: mkdir d2/df/d1c/db5/d10b 0 2022-02-02T18:21:31.675 INFO:tasks.workunit.client.0.smithi096.stdout:5/774: link db/d20/c33 db/d5c/d2f/db7/c110 0 2022-02-02T18:21:31.675 INFO:tasks.workunit.client.0.smithi096.stdout:2/866: dwrite d2/d13/d43/d51/fba [4194304,4194304] 0 2022-02-02T18:21:31.676 INFO:tasks.workunit.client.0.smithi096.stdout:6/815: rmdir d18/d24/d28/d4a/db8 39 2022-02-02T18:21:31.676 INFO:tasks.workunit.client.0.smithi096.stdout:2/867: write d2/d13/d43/f47 [43026,30848] 0 2022-02-02T18:21:31.676 INFO:tasks.workunit.client.0.smithi096.stdout:2/868: chown d2/d13/d43/l5c 183636373 1 2022-02-02T18:21:31.677 INFO:tasks.workunit.client.0.smithi096.stdout:7/735: rmdir d9/df/d12/d39/d40/d85 39 2022-02-02T18:21:31.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/784: mkdir d2/d71/d10c 0 2022-02-02T18:21:31.678 INFO:tasks.workunit.client.0.smithi096.stdout:7/736: stat d9/df/d12/d39/d41/f6a 0 2022-02-02T18:21:31.679 INFO:tasks.workunit.client.0.smithi096.stdout:6/816: symlink d18/d24/d28/d4a/db8/l12c 0 2022-02-02T18:21:31.680 INFO:tasks.workunit.client.0.smithi096.stdout:3/785: read d2/df/d14/f10 [3001195,78561] 0 2022-02-02T18:21:31.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/786: creat d2/df/d14/d2c/d74/df3/f10d x:0 0 0 2022-02-02T18:21:31.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/787: readlink d2/df/d1c/d5d/lcc 0 2022-02-02T18:21:31.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/788: dread - d2/df/d1c/d5d/d6d/fc8 zero size 2022-02-02T18:21:31.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/789: chown d2/df/d20/d33/d58 64054 1 2022-02-02T18:21:31.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/790: chown d2/d71/fe4 55850 1 2022-02-02T18:21:31.683 INFO:tasks.workunit.client.0.smithi096.stdout:3/791: mknod d2/df/d14/d2c/d74/df3/c10e 0 2022-02-02T18:21:31.687 INFO:tasks.workunit.client.0.smithi096.stdout:3/792: getdents d2/df/d36 0 2022-02-02T18:21:31.687 INFO:tasks.workunit.client.0.smithi096.stdout:3/793: chown d2/df/d20/d33/d58/dce/dcf 58361466 1 2022-02-02T18:21:31.690 INFO:tasks.workunit.client.0.smithi096.stdout:0/934: dwrite d2/db/f29 [4194304,4194304] 0 2022-02-02T18:21:31.691 INFO:tasks.workunit.client.0.smithi096.stdout:5/775: dread db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:31.695 INFO:tasks.workunit.client.0.smithi096.stdout:7/737: dread d9/df/d47/d60/f9e [0,4194304] 0 2022-02-02T18:21:31.695 INFO:tasks.workunit.client.0.smithi096.stdout:7/738: chown d9/df/d16/fbf 108 1 2022-02-02T18:21:31.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/792: dwrite d3/d4/d20/d26/d36/d51/d57/ff0 [4194304,4194304] 0 2022-02-02T18:21:31.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/793: write d3/d27/fdd [1312674,122830] 0 2022-02-02T18:21:31.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/935: unlink d2/db/d10/d80/d93/da3/ddd/fc9 0 2022-02-02T18:21:31.698 INFO:tasks.workunit.client.0.smithi096.stdout:0/936: write d2/db/d24/d89/d91/fbe [2883644,40520] 0 2022-02-02T18:21:31.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/739: mknod d9/df/d44/c100 0 2022-02-02T18:21:31.700 INFO:tasks.workunit.client.0.smithi096.stdout:7/740: fdatasync d9/df/d47/fc6 0 2022-02-02T18:21:31.703 INFO:tasks.workunit.client.0.smithi096.stdout:0/937: mkdir d2/db/d24/d89/d8f/d95/dfb/d13d 0 2022-02-02T18:21:31.704 INFO:tasks.workunit.client.0.smithi096.stdout:4/794: getdents d3/d4/d20/d26/d36/d88/dd8/de1 0 2022-02-02T18:21:31.705 INFO:tasks.workunit.client.0.smithi096.stdout:7/741: write d9/df/d16/d25/d98/fae [6236296,83083] 0 2022-02-02T18:21:31.709 INFO:tasks.workunit.client.0.smithi096.stdout:7/742: getdents d9/df/d12/d39/d4e 0 2022-02-02T18:21:31.709 INFO:tasks.workunit.client.0.smithi096.stdout:7/743: creat d9/df/d16/d25/f101 x:0 0 0 2022-02-02T18:21:31.709 INFO:tasks.workunit.client.0.smithi096.stdout:7/744: truncate d9/df/d12/d39/d4e/f8c 1361676 0 2022-02-02T18:21:31.712 INFO:tasks.workunit.client.0.smithi096.stdout:4/795: rmdir d3/d85/da5 0 2022-02-02T18:21:31.715 INFO:tasks.workunit.client.0.smithi096.stdout:7/745: rename d9/df/d54/db8/fd9 to d9/df/d47/db7/de3/f102 0 2022-02-02T18:21:31.726 INFO:tasks.workunit.client.0.smithi096.stdout:6/817: dwrite d18/d50/f56 [0,4194304] 0 2022-02-02T18:21:31.727 INFO:tasks.workunit.client.0.smithi096.stdout:2/869: dwrite d2/d19/f70 [0,4194304] 0 2022-02-02T18:21:31.727 INFO:tasks.workunit.client.0.smithi096.stdout:2/870: creat d2/d13/d43/d51/d73/f10f x:0 0 0 2022-02-02T18:21:31.728 INFO:tasks.workunit.client.0.smithi096.stdout:6/818: mkdir d18/d50/d8f/dbb/d63/db3/d12d 0 2022-02-02T18:21:31.730 INFO:tasks.workunit.client.0.smithi096.stdout:2/871: symlink d2/d13/d43/l110 0 2022-02-02T18:21:31.731 INFO:tasks.workunit.client.0.smithi096.stdout:2/872: mknod d2/d29/c111 0 2022-02-02T18:21:31.731 INFO:tasks.workunit.client.0.smithi096.stdout:2/873: fdatasync d2/d6/d1b/d48/f82 0 2022-02-02T18:21:31.731 INFO:tasks.workunit.client.0.smithi096.stdout:2/874: fdatasync d2/d5e/fbc 0 2022-02-02T18:21:31.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/875: mkdir d2/d13/d42/d71/dad/db0/de4/d112 0 2022-02-02T18:21:31.733 INFO:tasks.workunit.client.0.smithi096.stdout:2/876: mknod d2/d13/d42/d71/dad/db0/c113 0 2022-02-02T18:21:31.733 INFO:tasks.workunit.client.0.smithi096.stdout:2/877: chown d2/d13/d43/d80/cd9 818284539 1 2022-02-02T18:21:31.733 INFO:tasks.workunit.client.0.smithi096.stdout:2/878: write d2/d13/f94 [735053,33968] 0 2022-02-02T18:21:31.733 INFO:tasks.workunit.client.0.smithi096.stdout:6/819: write d18/d24/d28/d3e/f5f [1847057,130746] 0 2022-02-02T18:21:31.734 INFO:tasks.workunit.client.0.smithi096.stdout:6/820: dread - d18/d50/d8f/dbb/fa6 zero size 2022-02-02T18:21:31.735 INFO:tasks.workunit.client.0.smithi096.stdout:3/794: dwrite d2/df/d34/fb3 [4194304,4194304] 0 2022-02-02T18:21:31.735 INFO:tasks.workunit.client.0.smithi096.stdout:3/795: fdatasync d2/df/d1c/f29 0 2022-02-02T18:21:31.736 INFO:tasks.workunit.client.0.smithi096.stdout:3/796: unlink d2/df/d20/d33/f98 0 2022-02-02T18:21:31.736 INFO:tasks.workunit.client.0.smithi096.stdout:3/797: fsync d2/df/d1c/d5d/d6d/fc8 0 2022-02-02T18:21:31.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/746: dwrite d9/f8d [4194304,4194304] 0 2022-02-02T18:21:31.736 INFO:tasks.workunit.client.0.smithi096.stdout:5/776: dwrite db/de/d10/d25/d4c/dd8/def/dc2/dfa/f7b [0,4194304] 0 2022-02-02T18:21:31.740 INFO:tasks.workunit.client.0.smithi096.stdout:3/798: write d2/df/d36/f7f [1013396,57530] 0 2022-02-02T18:21:31.754 INFO:tasks.workunit.client.0.smithi096.stdout:2/879: dwrite d2/d5e/fbc [0,4194304] 0 2022-02-02T18:21:31.755 INFO:tasks.workunit.client.0.smithi096.stdout:5/777: rename db/de/l5a to db/de/l111 0 2022-02-02T18:21:31.758 INFO:tasks.workunit.client.0.smithi096.stdout:3/799: creat d2/d71/d10c/f10f x:0 0 0 2022-02-02T18:21:31.761 INFO:tasks.workunit.client.0.smithi096.stdout:2/880: unlink d2/d13/d43/d51/d73/da9/faa 0 2022-02-02T18:21:31.761 INFO:tasks.workunit.client.0.smithi096.stdout:2/881: readlink d2/d6/d1b/l99 0 2022-02-02T18:21:31.762 INFO:tasks.workunit.client.0.smithi096.stdout:5/778: mkdir db/da1/dcc/d112 0 2022-02-02T18:21:31.765 INFO:tasks.workunit.client.0.smithi096.stdout:5/779: symlink db/de/d10/d25/d4c/l113 0 2022-02-02T18:21:31.765 INFO:tasks.workunit.client.0.smithi096.stdout:5/780: chown db/de/d10/d25/cea 813992 1 2022-02-02T18:21:31.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/800: dread d2/df/d20/d33/d58/d7c/faf [0,4194304] 0 2022-02-02T18:21:31.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/801: truncate d2/df/d20/fef 5459168 0 2022-02-02T18:21:31.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/802: readlink d2/df/d14/l2e 0 2022-02-02T18:21:31.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/803: chown d2/df/d14/dbe/lcb 190 1 2022-02-02T18:21:31.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/882: dread d2/d5e/d6d/d79/d81/faf [0,4194304] 0 2022-02-02T18:21:31.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/883: dread d2/d6/f93 [0,4194304] 0 2022-02-02T18:21:31.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/884: truncate d2/d13/d43/d51/d73/f10f 557093 0 2022-02-02T18:21:31.774 INFO:tasks.workunit.client.0.smithi096.stdout:3/804: dread d2/df/d14/f12 [0,4194304] 0 2022-02-02T18:21:31.774 INFO:tasks.workunit.client.0.smithi096.stdout:3/805: fsync d2/df/da6/fe7 0 2022-02-02T18:21:31.774 INFO:tasks.workunit.client.0.smithi096.stdout:3/806: dread - d2/d71/d10c/f10f zero size 2022-02-02T18:21:31.775 INFO:tasks.workunit.client.0.smithi096.stdout:3/807: read d2/d71/f90 [210253,72611] 0 2022-02-02T18:21:31.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/808: rmdir d2/df/d1c/d5d/d6d 39 2022-02-02T18:21:31.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/809: chown d2/df/d14/d66/c88 1028327466 1 2022-02-02T18:21:31.777 INFO:tasks.workunit.client.0.smithi096.stdout:3/810: chown d2/df/d14/d2c/d74/f7b 201569453 1 2022-02-02T18:21:31.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/811: creat d2/df/d34/d76/dd3/d104/daa/dfc/d103/f110 x:0 0 0 2022-02-02T18:21:31.780 INFO:tasks.workunit.client.0.smithi096.stdout:9/797: sync 2022-02-02T18:21:31.780 INFO:tasks.workunit.client.0.smithi096.stdout:9/798: fdatasync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d6f/f94 0 2022-02-02T18:21:31.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/799: truncate d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/ff2 297568 0 2022-02-02T18:21:31.781 INFO:tasks.workunit.client.0.smithi096.stdout:3/812: unlink d2/df/d14/d73/fd6 0 2022-02-02T18:21:31.782 INFO:tasks.workunit.client.0.smithi096.stdout:3/813: chown d2/df/d1c/f29 38523 1 2022-02-02T18:21:31.782 INFO:tasks.workunit.client.0.smithi096.stdout:9/800: rename d1/db/d1c/d2f/d78/d25/d8e/lf7 to d1/db/d1c/d2f/d78/d11/l116 0 2022-02-02T18:21:31.784 INFO:tasks.workunit.client.0.smithi096.stdout:9/801: rename d1/db/d63/da2/cf4 to d1/db/d1c/d2f/d78/d11/d1e/dfe/d110/c117 0 2022-02-02T18:21:31.789 INFO:tasks.workunit.client.0.smithi096.stdout:3/814: dread d2/df/d14/d66/f96 [0,4194304] 0 2022-02-02T18:21:31.790 INFO:tasks.workunit.client.0.smithi096.stdout:3/815: symlink d2/df/d1c/d5d/dbf/l111 0 2022-02-02T18:21:31.790 INFO:tasks.workunit.client.0.smithi096.stdout:3/816: chown d2/df/d14/d2c/d31/da8/lf1 65129 1 2022-02-02T18:21:31.793 INFO:tasks.workunit.client.0.smithi096.stdout:5/781: dwrite db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/fcd [0,4194304] 0 2022-02-02T18:21:31.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/885: dwrite d2/d6/f93 [0,4194304] 0 2022-02-02T18:21:31.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/886: fsync d2/d5e/f9e 0 2022-02-02T18:21:31.802 INFO:tasks.workunit.client.0.smithi096.stdout:3/817: dread d2/df/d14/d16/fe0 [0,4194304] 0 2022-02-02T18:21:31.804 INFO:tasks.workunit.client.0.smithi096.stdout:3/818: dread d2/df/d20/d33/d58/f5e [0,4194304] 0 2022-02-02T18:21:31.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/887: dwrite d2/d13/d43/d51/fc5 [0,4194304] 0 2022-02-02T18:21:31.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/888: dread - d2/d13/d43/d51/d73/da9/f10d zero size 2022-02-02T18:21:31.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/889: getdents d2/d13/d43/d80/d10e 0 2022-02-02T18:21:31.824 INFO:tasks.workunit.client.0.smithi096.stdout:3/819: dwrite d2/df/d20/f37 [4194304,4194304] 0 2022-02-02T18:21:31.826 INFO:tasks.workunit.client.0.smithi096.stdout:3/820: rename d2/d71/f83 to d2/df/d34/d76/dd3/d104/daa/dfc/f112 0 2022-02-02T18:21:31.828 INFO:tasks.workunit.client.0.smithi096.stdout:3/821: rename d2/df/d20/d33/d58/f5e to d2/df/da6/f113 0 2022-02-02T18:21:31.828 INFO:tasks.workunit.client.0.smithi096.stdout:3/822: stat d2/f9e 0 2022-02-02T18:21:31.830 INFO:tasks.workunit.client.0.smithi096.stdout:0/938: sync 2022-02-02T18:21:31.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/741: sync 2022-02-02T18:21:31.831 INFO:tasks.workunit.client.0.smithi096.stdout:1/826: sync 2022-02-02T18:21:31.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/742: chown d29/d2d/lac 5 1 2022-02-02T18:21:31.832 INFO:tasks.workunit.client.0.smithi096.stdout:1/827: readlink d15/d1b/d28/d2c/l46 0 2022-02-02T18:21:31.832 INFO:tasks.workunit.client.0.smithi096.stdout:8/743: creat d29/d4e/dad/ff6 x:0 0 0 2022-02-02T18:21:31.833 INFO:tasks.workunit.client.0.smithi096.stdout:0/939: unlink d2/db/d37/d113/df6/f116 0 2022-02-02T18:21:31.833 INFO:tasks.workunit.client.0.smithi096.stdout:0/940: creat d2/db/d24/d89/d8f/da1/de9/f13e x:0 0 0 2022-02-02T18:21:31.833 INFO:tasks.workunit.client.0.smithi096.stdout:0/941: truncate d2/db/d10/f2b 575661 0 2022-02-02T18:21:31.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/890: dwrite d2/d13/d43/d51/d73/f10f [0,4194304] 0 2022-02-02T18:21:31.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/891: write d2/d6/f93 [4636351,80222] 0 2022-02-02T18:21:31.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/892: truncate d2/d13/d43/d51/f85 471919 0 2022-02-02T18:21:31.835 INFO:tasks.workunit.client.0.smithi096.stdout:0/942: unlink d2/db/fc7 0 2022-02-02T18:21:31.836 INFO:tasks.workunit.client.0.smithi096.stdout:0/943: write d2/db/d37/d40/d8a/f94 [6961723,9254] 0 2022-02-02T18:21:31.838 INFO:tasks.workunit.client.0.smithi096.stdout:2/893: creat d2/d6/db/f114 x:0 0 0 2022-02-02T18:21:31.839 INFO:tasks.workunit.client.0.smithi096.stdout:8/744: getdents d29/d4e/dad/dcc 0 2022-02-02T18:21:31.839 INFO:tasks.workunit.client.0.smithi096.stdout:8/745: write d29/d58/d79/fc8 [352229,113622] 0 2022-02-02T18:21:31.839 INFO:tasks.workunit.client.0.smithi096.stdout:8/746: fsync d29/d4e/f72 0 2022-02-02T18:21:31.840 INFO:tasks.workunit.client.0.smithi096.stdout:0/944: write d2/db/d10/f33 [1915052,28001] 0 2022-02-02T18:21:31.842 INFO:tasks.workunit.client.0.smithi096.stdout:2/894: truncate d2/d6/d1b/d3a/f44 455104 0 2022-02-02T18:21:31.845 INFO:tasks.workunit.client.0.smithi096.stdout:8/747: mknod d29/d4e/dad/dcc/d5b/dca/cf7 0 2022-02-02T18:21:31.845 INFO:tasks.workunit.client.0.smithi096.stdout:8/748: stat d29/d58/d79/fc8 0 2022-02-02T18:21:31.846 INFO:tasks.workunit.client.0.smithi096.stdout:0/945: symlink d2/db/d24/d89/d8f/da1/l13f 0 2022-02-02T18:21:31.848 INFO:tasks.workunit.client.0.smithi096.stdout:2/895: rename d2/d29/f32 to d2/d13/d43/d80/f115 0 2022-02-02T18:21:31.850 INFO:tasks.workunit.client.0.smithi096.stdout:8/749: link d29/c39 d29/cf8 0 2022-02-02T18:21:31.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/896: creat d2/d6/d1b/dd0/f116 x:0 0 0 2022-02-02T18:21:31.854 INFO:tasks.workunit.client.0.smithi096.stdout:1/828: dwrite d15/d1b/d26/f42 [4194304,4194304] 0 2022-02-02T18:21:31.855 INFO:tasks.workunit.client.0.smithi096.stdout:1/829: chown d15/d1b/d26/d72/dff/df3 38844 1 2022-02-02T18:21:31.856 INFO:tasks.workunit.client.0.smithi096.stdout:8/750: mknod d29/d4e/dad/db3/d6d/cf9 0 2022-02-02T18:21:31.859 INFO:tasks.workunit.client.0.smithi096.stdout:2/897: truncate d2/d5e/fbc 1769695 0 2022-02-02T18:21:31.863 INFO:tasks.workunit.client.0.smithi096.stdout:1/830: mknod d15/d1b/d26/d72/da3/da7/ddc/c12c 0 2022-02-02T18:21:31.864 INFO:tasks.workunit.client.0.smithi096.stdout:8/751: creat d29/d4e/dad/ddb/ffa x:0 0 0 2022-02-02T18:21:31.865 INFO:tasks.workunit.client.0.smithi096.stdout:1/831: truncate d15/d1b/d28/d2c/d4f/f89 3021217 0 2022-02-02T18:21:31.865 INFO:tasks.workunit.client.0.smithi096.stdout:1/832: chown d15/d67/f12b 1582983202 1 2022-02-02T18:21:31.865 INFO:tasks.workunit.client.0.smithi096.stdout:1/833: readlink d15/d1b/d26/d59/dd2/l108 0 2022-02-02T18:21:31.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/834: write d15/d1b/d26/d72/dff/d8a/fd8 [1040601,9335] 0 2022-02-02T18:21:31.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/835: read - d15/d1b/d26/d72/dce/f10b zero size 2022-02-02T18:21:31.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/836: write d15/d1b/d28/d47/f86 [986236,41758] 0 2022-02-02T18:21:31.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/837: fdatasync d15/d1b/d26/d59/f80 0 2022-02-02T18:21:31.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/752: mknod d29/d2d/d87/def/cfb 0 2022-02-02T18:21:31.867 INFO:tasks.workunit.client.0.smithi096.stdout:1/838: mknod d15/d1b/d26/d59/dd2/c12d 0 2022-02-02T18:21:31.868 INFO:tasks.workunit.client.0.smithi096.stdout:8/753: mkdir d29/d58/d79/dea/dfc 0 2022-02-02T18:21:31.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/898: dread d2/d5e/d6d/fde [0,4194304] 0 2022-02-02T18:21:31.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/899: read - d2/d19/f107 zero size 2022-02-02T18:21:31.870 INFO:tasks.workunit.client.0.smithi096.stdout:1/839: mkdir d15/d1b/d26/d72/da3/da7/d12e 0 2022-02-02T18:21:31.870 INFO:tasks.workunit.client.0.smithi096.stdout:4/796: sync 2022-02-02T18:21:31.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/900: rename d2/d6/d1b/dc0/l104 to d2/d13/d42/d71/dad/db0/dc7/dca/dec/l117 0 2022-02-02T18:21:31.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/840: symlink d15/d1b/d26/d59/dd2/l12f 0 2022-02-02T18:21:31.875 INFO:tasks.workunit.client.0.smithi096.stdout:1/841: readlink d15/d1b/l4b 0 2022-02-02T18:21:31.877 INFO:tasks.workunit.client.0.smithi096.stdout:1/842: mknod d15/d1b/d26/d72/da3/da7/ddc/c130 0 2022-02-02T18:21:31.877 INFO:tasks.workunit.client.0.smithi096.stdout:1/843: chown d15/d1b/d28/d2c/d39/de5/c10f 43193896 1 2022-02-02T18:21:31.877 INFO:tasks.workunit.client.0.smithi096.stdout:1/844: fsync d15/d1b/d26/d72/dff/d8a/fb3 0 2022-02-02T18:21:31.883 INFO:tasks.workunit.client.0.smithi096.stdout:4/797: rename d3/d4/d20/d26/d36/d88/dde to d3/d4/d20/d26/d36/d102/d109 0 2022-02-02T18:21:31.885 INFO:tasks.workunit.client.0.smithi096.stdout:8/754: dread d29/d2d/f30 [0,4194304] 0 2022-02-02T18:21:31.885 INFO:tasks.workunit.client.0.smithi096.stdout:1/845: getdents d15/d1b/d26/d59 0 2022-02-02T18:21:31.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/846: write d15/d1b/d26/f77 [4796334,56135] 0 2022-02-02T18:21:31.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/847: fdatasync d15/d67/f12b 0 2022-02-02T18:21:31.887 INFO:tasks.workunit.client.0.smithi096.stdout:8/755: mknod d29/d4e/dad/dcc/d5b/dca/cfd 0 2022-02-02T18:21:31.888 INFO:tasks.workunit.client.0.smithi096.stdout:1/848: rename d15/d1b/d26/c5b to d15/c131 0 2022-02-02T18:21:31.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/756: symlink d29/d4e/dad/db3/d6d/d83/db9/df4/lfe 0 2022-02-02T18:21:31.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/757: creat d29/d2d/d47/fff x:0 0 0 2022-02-02T18:21:31.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/758: rename d29/d4e/dad/dcc/d5b/d81/fee to d29/d2d/d87/def/f100 0 2022-02-02T18:21:31.893 INFO:tasks.workunit.client.0.smithi096.stdout:8/759: chown d29/d58/d63/cd7 0 1 2022-02-02T18:21:31.893 INFO:tasks.workunit.client.0.smithi096.stdout:8/760: write d29/d58/d7a/f7f [496063,715] 0 2022-02-02T18:21:31.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/901: dwrite d2/d13/d43/d51/d73/ff3 [0,4194304] 0 2022-02-02T18:21:31.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/902: write d2/d5e/d6d/d79/d81/fd4 [396460,114137] 0 2022-02-02T18:21:31.900 INFO:tasks.workunit.client.0.smithi096.stdout:2/903: write d2/d6/fcb [185154,6934] 0 2022-02-02T18:21:31.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/904: getdents d2/d19/d86 0 2022-02-02T18:21:31.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/905: read - d2/d13/d43/d51/d73/da9/f10d zero size 2022-02-02T18:21:31.902 INFO:tasks.workunit.client.0.smithi096.stdout:2/906: mknod d2/d13/d43/d51/d5d/c118 0 2022-02-02T18:21:31.903 INFO:tasks.workunit.client.0.smithi096.stdout:2/907: dread d2/d6/d1b/d48/f82 [0,4194304] 0 2022-02-02T18:21:31.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/908: rmdir d2/d6/db 39 2022-02-02T18:21:31.909 INFO:tasks.workunit.client.0.smithi096.stdout:2/909: unlink d2/d6/fcb 0 2022-02-02T18:21:31.909 INFO:tasks.workunit.client.0.smithi096.stdout:2/910: fsync f1 0 2022-02-02T18:21:31.909 INFO:tasks.workunit.client.0.smithi096.stdout:2/911: fdatasync d2/d29/fce 0 2022-02-02T18:21:31.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/912: dread d2/d5e/d6d/fb6 [0,4194304] 0 2022-02-02T18:21:31.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/913: stat d2/d13/d43/d80/cd9 0 2022-02-02T18:21:31.913 INFO:tasks.workunit.client.0.smithi096.stdout:8/761: dwrite f17 [0,4194304] 0 2022-02-02T18:21:31.920 INFO:tasks.workunit.client.0.smithi096.stdout:4/798: dwrite d3/d4/d20/d26/d36/d102/d109/df4/f9e [0,4194304] 0 2022-02-02T18:21:31.923 INFO:tasks.workunit.client.0.smithi096.stdout:2/914: dread d2/f9 [0,4194304] 0 2022-02-02T18:21:31.923 INFO:tasks.workunit.client.0.smithi096.stdout:2/915: fsync d2/d13/d43/f47 0 2022-02-02T18:21:31.924 INFO:tasks.workunit.client.0.smithi096.stdout:4/799: link d3/d4/d20/d4d/l95 d3/d60/d8d/da7/l10a 0 2022-02-02T18:21:31.932 INFO:tasks.workunit.client.0.smithi096.stdout:4/800: dread d3/d4/d20/d26/d36/d102/f106 [0,4194304] 0 2022-02-02T18:21:31.932 INFO:tasks.workunit.client.0.smithi096.stdout:4/801: chown d3/d4/d50/l81 626 1 2022-02-02T18:21:31.932 INFO:tasks.workunit.client.0.smithi096.stdout:2/916: dread d2/d13/d42/d71/f7a [0,4194304] 0 2022-02-02T18:21:31.933 INFO:tasks.workunit.client.0.smithi096.stdout:4/802: write d3/d4/d20/d4d/f54 [729311,18434] 0 2022-02-02T18:21:31.935 INFO:tasks.workunit.client.0.smithi096.stdout:2/917: unlink d2/d13/d43/d80/le9 0 2022-02-02T18:21:31.935 INFO:tasks.workunit.client.0.smithi096.stdout:2/918: creat d2/d13/d43/d51/d73/da9/f119 x:0 0 0 2022-02-02T18:21:31.935 INFO:tasks.workunit.client.0.smithi096.stdout:2/919: stat d2/d19/d86/l8b 0 2022-02-02T18:21:31.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/803: mknod d3/c10b 0 2022-02-02T18:21:31.937 INFO:tasks.workunit.client.0.smithi096.stdout:7/747: sync 2022-02-02T18:21:31.938 INFO:tasks.workunit.client.0.smithi096.stdout:9/802: sync 2022-02-02T18:21:31.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/821: sync 2022-02-02T18:21:31.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/822: chown d18/d24/d73/dfb/cfc 1084397 1 2022-02-02T18:21:31.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/823: fdatasync d18/d50/d8f/dbb/d63/f6f 0 2022-02-02T18:21:31.940 INFO:tasks.workunit.client.0.smithi096.stdout:2/920: rmdir d2/d5e/d6d/d79/d81 39 2022-02-02T18:21:31.941 INFO:tasks.workunit.client.0.smithi096.stdout:4/804: rmdir d3/d4/d20/d26/d36/d88/d98 39 2022-02-02T18:21:31.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/921: rmdir d2/d13/d42/d71/dad/db0 39 2022-02-02T18:21:31.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/922: chown d2/d5e/cab 2 1 2022-02-02T18:21:31.944 INFO:tasks.workunit.client.0.smithi096.stdout:2/923: creat d2/d13/d42/d71/dad/db0/dc7/f11a x:0 0 0 2022-02-02T18:21:31.946 INFO:tasks.workunit.client.0.smithi096.stdout:2/924: rmdir d2/d6/db 39 2022-02-02T18:21:31.946 INFO:tasks.workunit.client.0.smithi096.stdout:2/925: chown d2/d6/db/f8f 11 1 2022-02-02T18:21:31.946 INFO:tasks.workunit.client.0.smithi096.stdout:9/803: dread d1/db/d1c/d2f/d78/fdc [0,4194304] 0 2022-02-02T18:21:31.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/804: readlink d1/db/l1b 0 2022-02-02T18:21:31.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/805: readlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/l73 0 2022-02-02T18:21:31.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/806: truncate d1/db/d48/f8d 506262 0 2022-02-02T18:21:31.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/807: dread - d1/db/d1c/d2f/d78/d11/d3c/f41 zero size 2022-02-02T18:21:31.948 INFO:tasks.workunit.client.0.smithi096.stdout:2/926: creat d2/d5e/d7c/dfe/f11b x:0 0 0 2022-02-02T18:21:31.948 INFO:tasks.workunit.client.0.smithi096.stdout:2/927: fsync d2/d6/d1b/d8a/db5/f106 0 2022-02-02T18:21:31.951 INFO:tasks.workunit.client.0.smithi096.stdout:2/928: dread d2/d6/db/f8f [0,4194304] 0 2022-02-02T18:21:31.952 INFO:tasks.workunit.client.0.smithi096.stdout:9/808: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f118 x:0 0 0 2022-02-02T18:21:31.952 INFO:tasks.workunit.client.0.smithi096.stdout:9/809: truncate d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f42 4401624 0 2022-02-02T18:21:31.952 INFO:tasks.workunit.client.0.smithi096.stdout:9/810: chown d1/db/d1c/d2f/d78/d11/d3c/lda 0 1 2022-02-02T18:21:31.953 INFO:tasks.workunit.client.0.smithi096.stdout:2/929: truncate d2/d6/fa 2934314 0 2022-02-02T18:21:31.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/811: unlink d1/db/d1c/d2f/d78/d11/f2d 0 2022-02-02T18:21:31.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/930: mknod d2/d13/d42/d71/dad/db0/dc7/dca/c11c 0 2022-02-02T18:21:31.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/931: chown d2/d13/d43/d51/d73/da9 260 1 2022-02-02T18:21:31.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/932: write d2/d5e/d7c/f83 [1011501,34904] 0 2022-02-02T18:21:31.956 INFO:tasks.workunit.client.0.smithi096.stdout:9/812: mknod d1/db/d1c/d2f/d78/d11/d1e/d66/c119 0 2022-02-02T18:21:31.956 INFO:tasks.workunit.client.0.smithi096.stdout:2/933: write d2/d13/d43/d51/fc1 [2351984,83584] 0 2022-02-02T18:21:31.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/813: symlink d1/db/d1c/d2f/d78/d11/d3c/l11a 0 2022-02-02T18:21:31.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/814: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f57 [291685,90903] 0 2022-02-02T18:21:31.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/815: chown d1/db/d1c/d2f/d78/d11/d1e/f65 13606 1 2022-02-02T18:21:31.958 INFO:tasks.workunit.client.0.smithi096.stdout:2/934: link d2/d5e/d6d/d79/l33 d2/d13/d8e/l11d 0 2022-02-02T18:21:31.959 INFO:tasks.workunit.client.0.smithi096.stdout:9/816: rmdir d1/db/d1c/d2f/d78/d25/d8e 39 2022-02-02T18:21:31.959 INFO:tasks.workunit.client.0.smithi096.stdout:9/817: write d1/db/d63/da2/fa9 [1474071,31808] 0 2022-02-02T18:21:31.960 INFO:tasks.workunit.client.0.smithi096.stdout:2/935: link d2/d5e/d6d/ld1 d2/d5e/d6d/d79/d66/l11e 0 2022-02-02T18:21:31.961 INFO:tasks.workunit.client.0.smithi096.stdout:2/936: fdatasync d2/d13/d43/d51/fda 0 2022-02-02T18:21:31.962 INFO:tasks.workunit.client.0.smithi096.stdout:9/818: rename d1/db/d1c/f64 to d1/db/d1c/d2f/d78/d11/dca/f11b 0 2022-02-02T18:21:31.963 INFO:tasks.workunit.client.0.smithi096.stdout:9/819: readlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/l73 0 2022-02-02T18:21:31.963 INFO:tasks.workunit.client.0.smithi096.stdout:9/820: write d1/db/d48/de3/de5/deb/ff1 [232426,85998] 0 2022-02-02T18:21:31.964 INFO:tasks.workunit.client.0.smithi096.stdout:9/821: dread d1/db/d1c/d2f/f5a [0,4194304] 0 2022-02-02T18:21:31.966 INFO:tasks.workunit.client.0.smithi096.stdout:9/822: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/f11c x:0 0 0 2022-02-02T18:21:31.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/748: dwrite d9/df/d12/d39/d4e/ff2 [0,4194304] 0 2022-02-02T18:21:31.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/749: fsync d9/df/d16/d25/d98/fba 0 2022-02-02T18:21:31.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/750: fsync d9/df/d47/d37/ff7 0 2022-02-02T18:21:31.968 INFO:tasks.workunit.client.0.smithi096.stdout:6/824: dwrite d18/d24/d73/d79/f93 [0,4194304] 0 2022-02-02T18:21:31.968 INFO:tasks.workunit.client.0.smithi096.stdout:9/823: getdents d1/db/d1c/d2f/d78/d25/d8e 0 2022-02-02T18:21:31.969 INFO:tasks.workunit.client.0.smithi096.stdout:9/824: chown d1/db/f72 9075803 1 2022-02-02T18:21:31.973 INFO:tasks.workunit.client.0.smithi096.stdout:7/751: symlink d9/df/d47/db7/de3/l103 0 2022-02-02T18:21:31.974 INFO:tasks.workunit.client.0.smithi096.stdout:7/752: rename d9/df/d16/d25/d98/le1 to d9/df/d16/d25/d98/l104 0 2022-02-02T18:21:31.976 INFO:tasks.workunit.client.0.smithi096.stdout:7/753: mkdir d9/df/d16/d25/d98/d105 0 2022-02-02T18:21:31.976 INFO:tasks.workunit.client.0.smithi096.stdout:7/754: creat d9/df/d47/d37/d83/db1/f106 x:0 0 0 2022-02-02T18:21:31.978 INFO:tasks.workunit.client.0.smithi096.stdout:7/755: rmdir d9/df/d12/d39/d41 39 2022-02-02T18:21:31.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/756: unlink d9/df/d12/d39/d4e/d6e/ff4 0 2022-02-02T18:21:31.981 INFO:tasks.workunit.client.0.smithi096.stdout:7/757: getdents d9/df/d12/d39/d40/d85 0 2022-02-02T18:21:31.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/825: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fd9 [0,4194304] 0 2022-02-02T18:21:31.991 INFO:tasks.workunit.client.0.smithi096.stdout:6/825: dwrite fb [0,4194304] 0 2022-02-02T18:21:31.991 INFO:tasks.workunit.client.0.smithi096.stdout:6/826: stat d18/d50/d8f/dbb/d63/f9f 0 2022-02-02T18:21:31.997 INFO:tasks.workunit.client.0.smithi096.stdout:6/827: rmdir d18/d24/d28 39 2022-02-02T18:21:31.999 INFO:tasks.workunit.client.0.smithi096.stdout:6/828: dread d18/d24/d28/d3e/f62 [0,4194304] 0 2022-02-02T18:21:31.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/826: getdents d1/db/d1c/d2f/d78/d11/d3c 0 2022-02-02T18:21:31.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/827: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/ld0 1517 1 2022-02-02T18:21:31.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/828: fsync d1/db/fd8 0 2022-02-02T18:21:32.000 INFO:tasks.workunit.client.0.smithi096.stdout:9/829: write d1/d39/f70 [215484,50939] 0 2022-02-02T18:21:32.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/758: dwrite d9/df/d12/d39/d41/f49 [0,4194304] 0 2022-02-02T18:21:32.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/759: chown d9/df/d12/d14/f61 11581886 1 2022-02-02T18:21:32.001 INFO:tasks.workunit.client.0.smithi096.stdout:6/829: creat d18/d50/f12e x:0 0 0 2022-02-02T18:21:32.003 INFO:tasks.workunit.client.0.smithi096.stdout:7/760: creat d9/df/d12/d39/d40/d6b/dd4/f107 x:0 0 0 2022-02-02T18:21:32.004 INFO:tasks.workunit.client.0.smithi096.stdout:6/830: symlink d18/d24/d28/d4a/db8/l12f 0 2022-02-02T18:21:32.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/830: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e 39 2022-02-02T18:21:32.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/831: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/f11c zero size 2022-02-02T18:21:32.014 INFO:tasks.workunit.client.0.smithi096.stdout:9/832: rename d1/db/d1c/d2f/d78/d11/d1e/d47/fd3 to d1/db/d1c/d2f/d78/d25/dd/f11d 0 2022-02-02T18:21:32.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/833: creat d1/db/d63/da2/f11e x:0 0 0 2022-02-02T18:21:32.016 INFO:tasks.workunit.client.0.smithi096.stdout:9/834: chown d1/db/d1c/d2f/d78/d11/d112 0 1 2022-02-02T18:21:32.016 INFO:tasks.workunit.client.0.smithi096.stdout:9/835: rename d1/db/d1c/d2f to d1/db/d1c/d2f/d78/d11f 22 2022-02-02T18:21:32.017 INFO:tasks.workunit.client.0.smithi096.stdout:9/836: rmdir d1/db/d1c/d2f/d78/d11/d112 0 2022-02-02T18:21:32.017 INFO:tasks.workunit.client.0.smithi096.stdout:9/837: chown d1/f56 85605 1 2022-02-02T18:21:32.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/838: symlink d1/db/d63/da2/l120 0 2022-02-02T18:21:32.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/839: rename d1/db/d1c/d2f/d78/d11/d1e/d38/fe8 to d1/db/d1c/d2f/d78/d11/d1e/d47/df3/f121 0 2022-02-02T18:21:32.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/840: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f101 [299957,885] 0 2022-02-02T18:21:32.024 INFO:tasks.workunit.client.0.smithi096.stdout:6/831: dwrite d18/d24/d28/d4a/db8/f115 [0,4194304] 0 2022-02-02T18:21:32.024 INFO:tasks.workunit.client.0.smithi096.stdout:6/832: write d18/d50/d8f/dbb/f53 [454567,109048] 0 2022-02-02T18:21:32.026 INFO:tasks.workunit.client.0.smithi096.stdout:6/833: rename d18/d50/d8f/dc4/dbd/fc9 to d18/d50/d8f/f130 0 2022-02-02T18:21:32.027 INFO:tasks.workunit.client.0.smithi096.stdout:6/834: getdents d18/d24/d73/dfb 0 2022-02-02T18:21:32.069 INFO:tasks.workunit.client.0.smithi096.stdout:0/946: sync 2022-02-02T18:21:32.070 INFO:tasks.workunit.client.0.smithi096.stdout:5/782: sync 2022-02-02T18:21:32.070 INFO:tasks.workunit.client.0.smithi096.stdout:3/823: sync 2022-02-02T18:21:32.071 INFO:tasks.workunit.client.0.smithi096.stdout:3/824: write d2/df/d20/dc4/f105 [1012320,115291] 0 2022-02-02T18:21:32.071 INFO:tasks.workunit.client.0.smithi096.stdout:3/825: write d2/df/d14/d2c/d74/df3/f106 [984836,58707] 0 2022-02-02T18:21:32.072 INFO:tasks.workunit.client.0.smithi096.stdout:0/947: link d2/d1e/d67/f12c d2/db/d24/d89/d91/f140 0 2022-02-02T18:21:32.072 INFO:tasks.workunit.client.0.smithi096.stdout:0/948: dread - d2/db/d24/d89/d8f/da1/f10b zero size 2022-02-02T18:21:32.072 INFO:tasks.workunit.client.0.smithi096.stdout:5/783: truncate db/d20/fa5 2323225 0 2022-02-02T18:21:32.078 INFO:tasks.workunit.client.0.smithi096.stdout:5/784: dread db/de/d2e/fb1 [0,4194304] 0 2022-02-02T18:21:32.078 INFO:tasks.workunit.client.0.smithi096.stdout:5/785: chown db/d5c/d32 10539619 1 2022-02-02T18:21:32.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/786: chown db/de/d10/d25/d4c/cca 39 1 2022-02-02T18:21:32.080 INFO:tasks.workunit.client.0.smithi096.stdout:5/787: rmdir db/de/d10 39 2022-02-02T18:21:32.081 INFO:tasks.workunit.client.0.smithi096.stdout:5/788: unlink db/de/d2e/fb1 0 2022-02-02T18:21:32.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/789: getdents db/de/d10/d27 0 2022-02-02T18:21:32.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/790: fsync db/de/d10/d25/d4c/dd8/def/dc2/dfa/f73 0 2022-02-02T18:21:32.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/791: truncate db/d5c/d60/da7/de2/ff3 4415525 0 2022-02-02T18:21:32.086 INFO:tasks.workunit.client.0.smithi096.stdout:5/792: write db/de/d10/d25/d4c/dd8/def/dc2/dfa/f5f [1950591,62887] 0 2022-02-02T18:21:32.089 INFO:tasks.workunit.client.0.smithi096.stdout:0/949: dwrite d2/db/d24/d89/d8f/d95/dcd/f120 [0,4194304] 0 2022-02-02T18:21:32.089 INFO:tasks.workunit.client.0.smithi096.stdout:0/950: dread - d2/db/d10/d80/d93/da3/dca/fe0 zero size 2022-02-02T18:21:32.090 INFO:tasks.workunit.client.0.smithi096.stdout:3/826: dwrite d2/df/d14/d2c/d31/da8/fbc [0,4194304] 0 2022-02-02T18:21:32.090 INFO:tasks.workunit.client.0.smithi096.stdout:0/951: write d2/db/d24/d89/d91/fa4 [3809127,76681] 0 2022-02-02T18:21:32.091 INFO:tasks.workunit.client.0.smithi096.stdout:0/952: write d2/db/d37/d40/f4e [2356936,75293] 0 2022-02-02T18:21:32.099 INFO:tasks.workunit.client.0.smithi096.stdout:0/953: dread d2/db/d24/d89/d91/fbe [0,4194304] 0 2022-02-02T18:21:32.100 INFO:tasks.workunit.client.0.smithi096.stdout:0/954: chown d2/db/d37/d113/fd9 19 1 2022-02-02T18:21:32.100 INFO:tasks.workunit.client.0.smithi096.stdout:0/955: write d2/db/d24/d89/d8f/d95/dcd/ffe [3877927,22981] 0 2022-02-02T18:21:32.108 INFO:tasks.workunit.client.0.smithi096.stdout:3/827: dwrite d2/df/d20/d33/d58/fed [0,4194304] 0 2022-02-02T18:21:32.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/828: unlink d2/df/d34/f39 0 2022-02-02T18:21:32.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/829: chown d2/df/d1c/d5d/d69/d43/c97 1894588 1 2022-02-02T18:21:32.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/830: fsync d2/df/d14/d66/f96 0 2022-02-02T18:21:32.113 INFO:tasks.workunit.client.0.smithi096.stdout:3/831: write d2/df/d14/d2c/d31/da8/fbc [3576510,18382] 0 2022-02-02T18:21:32.113 INFO:tasks.workunit.client.0.smithi096.stdout:0/956: dread d2/db/f29 [4194304,4194304] 0 2022-02-02T18:21:32.114 INFO:tasks.workunit.client.0.smithi096.stdout:3/832: truncate d2/df/d34/d76/dd3/d104/f2b 784251 0 2022-02-02T18:21:32.115 INFO:tasks.workunit.client.0.smithi096.stdout:3/833: fdatasync d2/df/d1c/d5d/d69/d43/d72/f75 0 2022-02-02T18:21:32.117 INFO:tasks.workunit.client.0.smithi096.stdout:0/957: getdents d2/db/d24/d89/d8f/d95 0 2022-02-02T18:21:32.121 INFO:tasks.workunit.client.0.smithi096.stdout:0/958: creat d2/db/d37/d113/f141 x:0 0 0 2022-02-02T18:21:32.122 INFO:tasks.workunit.client.0.smithi096.stdout:0/959: chown d2/d1e/d67/d128/l130 237615939 1 2022-02-02T18:21:32.122 INFO:tasks.workunit.client.0.smithi096.stdout:0/960: creat d2/db/d37/d113/df6/f142 x:0 0 0 2022-02-02T18:21:32.122 INFO:tasks.workunit.client.0.smithi096.stdout:0/961: write d2/db/d24/d4d/d53/d12e/f138 [789548,45644] 0 2022-02-02T18:21:32.123 INFO:tasks.workunit.client.0.smithi096.stdout:0/962: creat d2/db/d37/d40/d8a/f143 x:0 0 0 2022-02-02T18:21:32.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/834: rename d2/df/d1c/db5 to d2/df/d1c/d114 0 2022-02-02T18:21:32.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/835: truncate d2/df/d20/d33/f3b 4757427 0 2022-02-02T18:21:32.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/836: write d2/df/d14/f12 [2829279,72585] 0 2022-02-02T18:21:32.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/837: readlink d2/df/d1c/d5d/d69/d43/l46 0 2022-02-02T18:21:32.128 INFO:tasks.workunit.client.0.smithi096.stdout:0/963: rmdir d2/db/d24/d89/d8f/d95/dfb 39 2022-02-02T18:21:32.129 INFO:tasks.workunit.client.0.smithi096.stdout:0/964: chown d2/db/d24/d89/d8f/da1/l13f 625 1 2022-02-02T18:21:32.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/838: mkdir d2/df/d1c/d5d/dbf/dd1/d115 0 2022-02-02T18:21:32.131 INFO:tasks.workunit.client.0.smithi096.stdout:0/965: rmdir d2/db/d24/d4d/d53 39 2022-02-02T18:21:32.146 INFO:tasks.workunit.client.0.smithi096.stdout:0/966: dwrite d2/db/d10/d80/d93/da3/fb2 [0,4194304] 0 2022-02-02T18:21:32.148 INFO:tasks.workunit.client.0.smithi096.stdout:0/967: creat d2/db/d24/d89/d8f/d95/dfb/d13d/f144 x:0 0 0 2022-02-02T18:21:32.148 INFO:tasks.workunit.client.0.smithi096.stdout:0/968: chown d2/d1e/d67/f70 9498378 1 2022-02-02T18:21:32.148 INFO:tasks.workunit.client.0.smithi096.stdout:0/969: creat d2/db/d24/d4d/d53/d12e/f145 x:0 0 0 2022-02-02T18:21:32.149 INFO:tasks.workunit.client.0.smithi096.stdout:0/970: mkdir d2/db/d10/d80/d146 0 2022-02-02T18:21:32.149 INFO:tasks.workunit.client.0.smithi096.stdout:0/971: fdatasync d2/db/fda 0 2022-02-02T18:21:32.150 INFO:tasks.workunit.client.0.smithi096.stdout:0/972: read d2/d1e/f5d [814856,35100] 0 2022-02-02T18:21:32.151 INFO:tasks.workunit.client.0.smithi096.stdout:0/973: mknod d2/db/d10/c147 0 2022-02-02T18:21:32.151 INFO:tasks.workunit.client.0.smithi096.stdout:0/974: read d2/db/d24/d4d/d53/d12e/f138 [44341,125909] 0 2022-02-02T18:21:32.153 INFO:tasks.workunit.client.0.smithi096.stdout:0/975: link d2/db/d37/d40/d8a/f94 d2/d1e/db9/f148 0 2022-02-02T18:21:32.153 INFO:tasks.workunit.client.0.smithi096.stdout:0/976: creat d2/db/d24/d4d/d61/f149 x:0 0 0 2022-02-02T18:21:32.155 INFO:tasks.workunit.client.0.smithi096.stdout:0/977: rename d2/d1e/d67/d128/l130 to d2/d1e/db9/l14a 0 2022-02-02T18:21:32.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/978: rename d2/db/d24/d4d/d53/d58/fba to d2/db/d24/d89/d8f/da1/de9/f14b 0 2022-02-02T18:21:32.157 INFO:tasks.workunit.client.0.smithi096.stdout:0/979: mknod d2/d62/dc1/c14c 0 2022-02-02T18:21:32.159 INFO:tasks.workunit.client.0.smithi096.stdout:0/980: creat d2/db/d10/d80/d93/da3/ddc/f14d x:0 0 0 2022-02-02T18:21:32.179 INFO:tasks.workunit.client.0.smithi096.stdout:0/981: dwrite d2/db/d10/d80/d93/da3/dca/f114 [0,4194304] 0 2022-02-02T18:21:32.180 INFO:tasks.workunit.client.0.smithi096.stdout:0/982: fdatasync d2/db/d37/d40/d8a/f131 0 2022-02-02T18:21:32.180 INFO:tasks.workunit.client.0.smithi096.stdout:0/983: stat d2/db/d10/d27/f73 0 2022-02-02T18:21:32.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/984: creat d2/db/d37/d5f/f14e x:0 0 0 2022-02-02T18:21:32.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/985: stat d2/db/d10/d80/d93/da3/c136 0 2022-02-02T18:21:32.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/986: write d2/db/d10/f16 [4549003,13453] 0 2022-02-02T18:21:32.182 INFO:tasks.workunit.client.0.smithi096.stdout:0/987: truncate d2/db/d24/d89/d8f/d95/dcd/f120 2561388 0 2022-02-02T18:21:32.192 INFO:tasks.workunit.client.0.smithi096.stdout:8/762: sync 2022-02-02T18:21:32.193 INFO:tasks.workunit.client.0.smithi096.stdout:1/849: sync 2022-02-02T18:21:32.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/763: read - d29/d2d/d47/fff zero size 2022-02-02T18:21:32.194 INFO:tasks.workunit.client.0.smithi096.stdout:1/850: rmdir d15/d1b/d28/d2c 39 2022-02-02T18:21:32.239 INFO:tasks.workunit.client.0.smithi096.stdout:8/764: dwrite f1c [0,4194304] 0 2022-02-02T18:21:32.245 INFO:tasks.workunit.client.0.smithi096.stdout:8/765: dread d29/d4e/dad/db3/d6d/d85/f86 [0,4194304] 0 2022-02-02T18:21:32.252 INFO:tasks.workunit.client.0.smithi096.stdout:8/766: dread d29/d2d/d47/fa2 [0,4194304] 0 2022-02-02T18:21:32.253 INFO:tasks.workunit.client.0.smithi096.stdout:8/767: creat d29/d58/f101 x:0 0 0 2022-02-02T18:21:32.257 INFO:tasks.workunit.client.0.smithi096.stdout:8/768: rename d29/d4e/dad to d29/da7/d102 0 2022-02-02T18:21:32.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/769: creat d29/da7/d102/db3/d6d/f103 x:0 0 0 2022-02-02T18:21:32.260 INFO:tasks.workunit.client.0.smithi096.stdout:7/761: sync 2022-02-02T18:21:32.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/841: sync 2022-02-02T18:21:32.260 INFO:tasks.workunit.client.0.smithi096.stdout:2/937: sync 2022-02-02T18:21:32.260 INFO:tasks.workunit.client.0.smithi096.stdout:4/805: sync 2022-02-02T18:21:32.261 INFO:tasks.workunit.client.0.smithi096.stdout:7/762: chown d9/df/d47/d37/d83/db4/ff1 20359 1 2022-02-02T18:21:32.261 INFO:tasks.workunit.client.0.smithi096.stdout:9/842: write d1/db/d1c/d2f/d78/d11/f10a [973330,75683] 0 2022-02-02T18:21:32.261 INFO:tasks.workunit.client.0.smithi096.stdout:8/770: mkdir d29/da7/d102/dcc/d5b/dd9/d104 0 2022-02-02T18:21:32.261 INFO:tasks.workunit.client.0.smithi096.stdout:8/771: chown d29/d58/d63/ff1 41203 1 2022-02-02T18:21:32.262 INFO:tasks.workunit.client.0.smithi096.stdout:7/763: mknod d9/df/d12/d39/d40/c108 0 2022-02-02T18:21:32.263 INFO:tasks.workunit.client.0.smithi096.stdout:8/772: write d29/da7/d102/dcc/d5b/d81/f8d [2936735,116476] 0 2022-02-02T18:21:32.263 INFO:tasks.workunit.client.0.smithi096.stdout:9/843: unlink d1/db/d1c/d2f/d78/d11/dca/f11b 0 2022-02-02T18:21:32.263 INFO:tasks.workunit.client.0.smithi096.stdout:9/844: chown d1/db/d1c/d2f 29757 1 2022-02-02T18:21:32.263 INFO:tasks.workunit.client.0.smithi096.stdout:9/845: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f122 x:0 0 0 2022-02-02T18:21:32.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/938: rmdir d2/d6 39 2022-02-02T18:21:32.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/939: chown d2/d13/d42/d71/dad/db0/dc7/f11a 2825898 1 2022-02-02T18:21:32.266 INFO:tasks.workunit.client.0.smithi096.stdout:2/940: creat d2/d13/d42/d71/dad/db0/de4/f11f x:0 0 0 2022-02-02T18:21:32.266 INFO:tasks.workunit.client.0.smithi096.stdout:2/941: dread - d2/d6/db/f114 zero size 2022-02-02T18:21:32.267 INFO:tasks.workunit.client.0.smithi096.stdout:7/764: creat d9/df/d12/d39/d46/da4/f109 x:0 0 0 2022-02-02T18:21:32.267 INFO:tasks.workunit.client.0.smithi096.stdout:8/773: mknod d29/da7/d102/dcc/d5b/d81/c105 0 2022-02-02T18:21:32.267 INFO:tasks.workunit.client.0.smithi096.stdout:4/806: dread d3/d4/d20/d26/d36/d88/d98/fae [0,4194304] 0 2022-02-02T18:21:32.269 INFO:tasks.workunit.client.0.smithi096.stdout:2/942: truncate d2/d13/d43/f47 671086 0 2022-02-02T18:21:32.272 INFO:tasks.workunit.client.0.smithi096.stdout:7/765: rename d9/df/d47/fa2 to d9/df/d12/d39/d46/da4/f10a 0 2022-02-02T18:21:32.273 INFO:tasks.workunit.client.0.smithi096.stdout:4/807: mkdir d3/d5a/d103/d10c 0 2022-02-02T18:21:32.275 INFO:tasks.workunit.client.0.smithi096.stdout:7/766: write d9/df/d16/f28 [12087600,128364] 0 2022-02-02T18:21:32.276 INFO:tasks.workunit.client.0.smithi096.stdout:2/943: rename d2/d13/d42/d71/fe1 to d2/d13/d43/f120 0 2022-02-02T18:21:32.280 INFO:tasks.workunit.client.0.smithi096.stdout:7/767: creat d9/df/f10b x:0 0 0 2022-02-02T18:21:32.284 INFO:tasks.workunit.client.0.smithi096.stdout:2/944: unlink d2/d13/d42/d71/f7a 0 2022-02-02T18:21:32.284 INFO:tasks.workunit.client.0.smithi096.stdout:7/768: truncate d9/df/d47/d19/f2f 1999795 0 2022-02-02T18:21:32.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/808: dread d3/d85/fc7 [0,4194304] 0 2022-02-02T18:21:32.285 INFO:tasks.workunit.client.0.smithi096.stdout:7/769: unlink d9/lc9 0 2022-02-02T18:21:32.285 INFO:tasks.workunit.client.0.smithi096.stdout:2/945: creat d2/f121 x:0 0 0 2022-02-02T18:21:32.287 INFO:tasks.workunit.client.0.smithi096.stdout:4/809: dread d3/d4/f37 [0,4194304] 0 2022-02-02T18:21:32.287 INFO:tasks.workunit.client.0.smithi096.stdout:7/770: getdents d9/df/d47/dd3 0 2022-02-02T18:21:32.288 INFO:tasks.workunit.client.0.smithi096.stdout:9/846: dwrite d1/db/d1c/d2f/d78/d11/d3c/fff [0,4194304] 0 2022-02-02T18:21:32.289 INFO:tasks.workunit.client.0.smithi096.stdout:2/946: symlink d2/d6/l122 0 2022-02-02T18:21:32.290 INFO:tasks.workunit.client.0.smithi096.stdout:2/947: write d2/d5e/d6d/fa0 [322244,8235] 0 2022-02-02T18:21:32.291 INFO:tasks.workunit.client.0.smithi096.stdout:7/771: dread d9/df/d16/fbf [0,4194304] 0 2022-02-02T18:21:32.292 INFO:tasks.workunit.client.0.smithi096.stdout:8/774: dwrite d29/d58/d63/fc3 [0,4194304] 0 2022-02-02T18:21:32.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/847: rename d1/db/d1c/d2f/d78/d11/d1e/d47/da3/fd5 to d1/db/d48/de3/f123 0 2022-02-02T18:21:32.293 INFO:tasks.workunit.client.0.smithi096.stdout:9/848: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f118 1 1 2022-02-02T18:21:32.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/849: read d1/db/d1c/d2f/d78/fdc [238085,20512] 0 2022-02-02T18:21:32.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/850: write d1/db/d1c/d2f/d78/d11/d3c/f79 [1373195,123886] 0 2022-02-02T18:21:32.295 INFO:tasks.workunit.client.0.smithi096.stdout:2/948: symlink d2/d6/dd2/l123 0 2022-02-02T18:21:32.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/949: creat d2/d13/d42/d71/dad/f124 x:0 0 0 2022-02-02T18:21:32.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/950: chown d2/d13/d42/d71/l87 230 1 2022-02-02T18:21:32.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/951: write d2/d5e/d6d/d79/fc9 [683379,42035] 0 2022-02-02T18:21:32.297 INFO:tasks.workunit.client.0.smithi096.stdout:8/775: dread d29/d2d/f8b [0,4194304] 0 2022-02-02T18:21:32.297 INFO:tasks.workunit.client.0.smithi096.stdout:8/776: write d29/d2d/f37 [427408,81327] 0 2022-02-02T18:21:32.297 INFO:tasks.workunit.client.0.smithi096.stdout:8/777: fsync d29/f33 0 2022-02-02T18:21:32.299 INFO:tasks.workunit.client.0.smithi096.stdout:7/772: symlink d9/df/d12/d39/l10c 0 2022-02-02T18:21:32.301 INFO:tasks.workunit.client.0.smithi096.stdout:8/778: dread d29/d2d/d87/def/f100 [0,4194304] 0 2022-02-02T18:21:32.301 INFO:tasks.workunit.client.0.smithi096.stdout:8/779: readlink d29/d2d/d47/l60 0 2022-02-02T18:21:32.308 INFO:tasks.workunit.client.0.smithi096.stdout:4/810: dwrite d3/d4/d20/d26/d36/d51/d57/ff0 [0,4194304] 0 2022-02-02T18:21:32.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/952: mkdir d2/d5e/d7c/d125 0 2022-02-02T18:21:32.312 INFO:tasks.workunit.client.0.smithi096.stdout:8/780: rename d29/d2d/f56 to d29/d2d/d87/da5/f106 0 2022-02-02T18:21:32.318 INFO:tasks.workunit.client.0.smithi096.stdout:5/793: sync 2022-02-02T18:21:32.318 INFO:tasks.workunit.client.0.smithi096.stdout:3/839: sync 2022-02-02T18:21:32.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/835: sync 2022-02-02T18:21:32.319 INFO:tasks.workunit.client.0.smithi096.stdout:5/794: write db/dbd/fed [325142,94192] 0 2022-02-02T18:21:32.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/953: mkdir d2/d13/d43/d126 0 2022-02-02T18:21:32.320 INFO:tasks.workunit.client.0.smithi096.stdout:9/851: dwrite d1/d39/d8a/d97/fa0 [0,4194304] 0 2022-02-02T18:21:32.321 INFO:tasks.workunit.client.0.smithi096.stdout:7/773: dread d9/df/d16/f28 [8388608,4194304] 0 2022-02-02T18:21:32.321 INFO:tasks.workunit.client.0.smithi096.stdout:4/811: rename d3/c3c to d3/d60/d8d/dc6/dd0/c10d 0 2022-02-02T18:21:32.326 INFO:tasks.workunit.client.0.smithi096.stdout:5/795: symlink db/de/d10/d25/d4c/dd8/l114 0 2022-02-02T18:21:32.329 INFO:tasks.workunit.client.0.smithi096.stdout:6/836: mkdir d18/d50/d9a/d131 0 2022-02-02T18:21:32.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/812: dread d3/d5a/f63 [0,4194304] 0 2022-02-02T18:21:32.331 INFO:tasks.workunit.client.0.smithi096.stdout:2/954: unlink d2/d13/d42/fdb 0 2022-02-02T18:21:32.333 INFO:tasks.workunit.client.0.smithi096.stdout:9/852: mknod d1/d39/d8a/d97/dee/c124 0 2022-02-02T18:21:32.334 INFO:tasks.workunit.client.0.smithi096.stdout:9/853: write d1/db/d48/de3/de5/f9c [229349,112564] 0 2022-02-02T18:21:32.335 INFO:tasks.workunit.client.0.smithi096.stdout:7/774: readlink d9/df/d12/l33 0 2022-02-02T18:21:32.335 INFO:tasks.workunit.client.0.smithi096.stdout:9/854: fsync d1/db/d63/da2/f11e 0 2022-02-02T18:21:32.335 INFO:tasks.workunit.client.0.smithi096.stdout:7/775: stat d9/df/d12/d39/d42/f5a 0 2022-02-02T18:21:32.335 INFO:tasks.workunit.client.0.smithi096.stdout:7/776: chown d9/df/d44/c100 12 1 2022-02-02T18:21:32.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/781: rmdir d29/d2d/d42 39 2022-02-02T18:21:32.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/782: readlink d29/d58/d63/lb1 0 2022-02-02T18:21:32.337 INFO:tasks.workunit.client.0.smithi096.stdout:5/796: link db/de/d10/d25/d4c/df6/cff db/da1/dcc/c115 0 2022-02-02T18:21:32.337 INFO:tasks.workunit.client.0.smithi096.stdout:5/797: write db/de/d10/d27/fd7 [5380515,56330] 0 2022-02-02T18:21:32.338 INFO:tasks.workunit.client.0.smithi096.stdout:5/798: write db/da1/f109 [703946,85460] 0 2022-02-02T18:21:32.338 INFO:tasks.workunit.client.0.smithi096.stdout:5/799: chown db/de/d2e/d35/f95 44536 1 2022-02-02T18:21:32.338 INFO:tasks.workunit.client.0.smithi096.stdout:5/800: stat db/de/d10/f98 0 2022-02-02T18:21:32.339 INFO:tasks.workunit.client.0.smithi096.stdout:1/851: sync 2022-02-02T18:21:32.339 INFO:tasks.workunit.client.0.smithi096.stdout:0/988: sync 2022-02-02T18:21:32.339 INFO:tasks.workunit.client.0.smithi096.stdout:7/777: link d9/df/d12/d39/d46/d7d/f91 d9/df/d12/d14/f10d 0 2022-02-02T18:21:32.340 INFO:tasks.workunit.client.0.smithi096.stdout:8/783: rmdir d29/da7/d102/dc2 39 2022-02-02T18:21:32.341 INFO:tasks.workunit.client.0.smithi096.stdout:0/989: write d2/f6b [2654679,26042] 0 2022-02-02T18:21:32.341 INFO:tasks.workunit.client.0.smithi096.stdout:7/778: dread d9/df/d47/d37/d83/f97 [0,4194304] 0 2022-02-02T18:21:32.341 INFO:tasks.workunit.client.0.smithi096.stdout:3/840: dwrite d2/df/d14/f18 [8388608,4194304] 0 2022-02-02T18:21:32.342 INFO:tasks.workunit.client.0.smithi096.stdout:3/841: chown d2/df/d1c/d5d/d6d/c80 167 1 2022-02-02T18:21:32.342 INFO:tasks.workunit.client.0.smithi096.stdout:5/801: creat db/da1/dcc/d112/f116 x:0 0 0 2022-02-02T18:21:32.343 INFO:tasks.workunit.client.0.smithi096.stdout:1/852: symlink d15/d1b/d26/d72/dce/l132 0 2022-02-02T18:21:32.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/813: dread d3/d4/d20/d4d/f4e [0,4194304] 0 2022-02-02T18:21:32.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/814: creat d3/d60/d8d/dc6/dd0/f10e x:0 0 0 2022-02-02T18:21:32.345 INFO:tasks.workunit.client.0.smithi096.stdout:8/784: rmdir d29/da7/d102/dcc/d5b/dd9/dce 39 2022-02-02T18:21:32.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/855: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [4194304,4194304] 0 2022-02-02T18:21:32.347 INFO:tasks.workunit.client.0.smithi096.stdout:6/837: dread d18/d50/d9a/fdd [0,4194304] 0 2022-02-02T18:21:32.354 INFO:tasks.workunit.client.0.smithi096.stdout:2/955: dwrite d2/d6/d1b/dd0/f116 [0,4194304] 0 2022-02-02T18:21:32.354 INFO:tasks.workunit.client.0.smithi096.stdout:2/956: creat d2/d13/d43/d51/d5d/f127 x:0 0 0 2022-02-02T18:21:32.354 INFO:tasks.workunit.client.0.smithi096.stdout:5/802: creat db/de/d10/d25/da0/dfe/f117 x:0 0 0 2022-02-02T18:21:32.354 INFO:tasks.workunit.client.0.smithi096.stdout:1/853: creat d15/d1b/d26/d72/dff/d8a/db9/f133 x:0 0 0 2022-02-02T18:21:32.355 INFO:tasks.workunit.client.0.smithi096.stdout:1/854: dread - d15/f10d zero size 2022-02-02T18:21:32.355 INFO:tasks.workunit.client.0.smithi096.stdout:4/815: mkdir d3/d4/d20/d26/d36/d102/d109/dfb/d10f 0 2022-02-02T18:21:32.356 INFO:tasks.workunit.client.0.smithi096.stdout:5/803: write db/de/d10/d25/d4c/f5d [1567847,84355] 0 2022-02-02T18:21:32.356 INFO:tasks.workunit.client.0.smithi096.stdout:9/856: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/l125 0 2022-02-02T18:21:32.356 INFO:tasks.workunit.client.0.smithi096.stdout:6/838: mkdir d18/d50/d8f/dbb/d63/db3/d132 0 2022-02-02T18:21:32.357 INFO:tasks.workunit.client.0.smithi096.stdout:6/839: stat d18/f49 0 2022-02-02T18:21:32.358 INFO:tasks.workunit.client.0.smithi096.stdout:0/990: getdents d2/db/d10/d80 0 2022-02-02T18:21:32.358 INFO:tasks.workunit.client.0.smithi096.stdout:0/991: write d2/db/d37/d5f/f119 [1225166,23783] 0 2022-02-02T18:21:32.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/842: dread d2/df/d1c/d5d/da3/fca [0,4194304] 0 2022-02-02T18:21:32.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/843: creat d2/df/d20/d33/d58/f116 x:0 0 0 2022-02-02T18:21:32.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/844: read - d2/df/d1c/d5d/da3/f102 zero size 2022-02-02T18:21:32.360 INFO:tasks.workunit.client.0.smithi096.stdout:3/845: creat d2/df/d14/d16/f117 x:0 0 0 2022-02-02T18:21:32.360 INFO:tasks.workunit.client.0.smithi096.stdout:7/779: symlink d9/df/d12/d39/d40/l10e 0 2022-02-02T18:21:32.361 INFO:tasks.workunit.client.0.smithi096.stdout:7/780: chown d9/df/d12/d14/fdd 1664905 1 2022-02-02T18:21:32.361 INFO:tasks.workunit.client.0.smithi096.stdout:8/785: dwrite d29/d58/f101 [0,4194304] 0 2022-02-02T18:21:32.367 INFO:tasks.workunit.client.0.smithi096.stdout:2/957: link d2/d13/d42/d71/dad/le0 d2/d13/d43/d51/d5d/l128 0 2022-02-02T18:21:32.369 INFO:tasks.workunit.client.0.smithi096.stdout:4/816: truncate d3/d4/d20/d26/f2f 631537 0 2022-02-02T18:21:32.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/855: rename d15/d1b/d28/d2c/c127 to d15/d1b/d26/d72/da3/da7/d12e/c134 0 2022-02-02T18:21:32.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/856: write d15/d1b/d26/d72/da3/da7/ffd [955012,116343] 0 2022-02-02T18:21:32.373 INFO:tasks.workunit.client.0.smithi096.stdout:6/840: mkdir d18/d24/d28/d3e/d133 0 2022-02-02T18:21:32.374 INFO:tasks.workunit.client.0.smithi096.stdout:5/804: dwrite db/de/fb6 [0,4194304] 0 2022-02-02T18:21:32.382 INFO:tasks.workunit.client.0.smithi096.stdout:3/846: link d2/df/da6/fb4 d2/df/d14/d16/f118 0 2022-02-02T18:21:32.382 INFO:tasks.workunit.client.0.smithi096.stdout:3/847: chown d2/df/d34/lc7 6051 1 2022-02-02T18:21:32.383 INFO:tasks.workunit.client.0.smithi096.stdout:3/848: dread - d2/df/d1c/d5d/d69/d43/f8a zero size 2022-02-02T18:21:32.383 INFO:tasks.workunit.client.0.smithi096.stdout:3/849: fsync d2/df/d14/d66/f96 0 2022-02-02T18:21:32.384 INFO:tasks.workunit.client.0.smithi096.stdout:7/781: creat d9/df/d47/d60/f10f x:0 0 0 2022-02-02T18:21:32.384 INFO:tasks.workunit.client.0.smithi096.stdout:7/782: fdatasync d9/df/d16/f28 0 2022-02-02T18:21:32.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/857: dwrite d1/db/d48/de3/de5/f9c [0,4194304] 0 2022-02-02T18:21:32.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/858: fsync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/f108 0 2022-02-02T18:21:32.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/859: chown d1/d39/d8a/d97 2885935 1 2022-02-02T18:21:32.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/786: getdents d29/d58/d7a 0 2022-02-02T18:21:32.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/787: dread - d29/da7/d102/fb0 zero size 2022-02-02T18:21:32.387 INFO:tasks.workunit.client.0.smithi096.stdout:2/958: creat d2/d13/d42/d71/dad/db0/f129 x:0 0 0 2022-02-02T18:21:32.387 INFO:tasks.workunit.client.0.smithi096.stdout:2/959: creat d2/d5e/d7c/dfe/f12a x:0 0 0 2022-02-02T18:21:32.388 INFO:tasks.workunit.client.0.smithi096.stdout:2/960: write d2/d13/d43/d51/d73/da9/f119 [679387,1712] 0 2022-02-02T18:21:32.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/857: dwrite d15/d1b/d26/d72/f92 [0,4194304] 0 2022-02-02T18:21:32.389 INFO:tasks.workunit.client.0.smithi096.stdout:4/817: rmdir d3/d4/d90/d108 0 2022-02-02T18:21:32.390 INFO:tasks.workunit.client.0.smithi096.stdout:0/992: rename d2/db/f125 to d2/db/d10/d80/d93/da3/f14f 0 2022-02-02T18:21:32.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/805: mknod db/de/d10/d25/da0/d85/c118 0 2022-02-02T18:21:32.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/806: readlink db/d5c/d61/l77 0 2022-02-02T18:21:32.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/807: write db/de/d10/d80/fee [989238,112834] 0 2022-02-02T18:21:32.398 INFO:tasks.workunit.client.0.smithi096.stdout:3/850: symlink d2/df/d14/d2c/d74/l119 0 2022-02-02T18:21:32.404 INFO:tasks.workunit.client.0.smithi096.stdout:1/858: mknod d15/d1b/d28/d2c/d39/de5/c135 0 2022-02-02T18:21:32.404 INFO:tasks.workunit.client.0.smithi096.stdout:1/859: creat d15/d1b/d26/f136 x:0 0 0 2022-02-02T18:21:32.405 INFO:tasks.workunit.client.0.smithi096.stdout:9/860: dwrite d1/db/d1c/d2f/d78/d11/d1e/d47/df3/f121 [0,4194304] 0 2022-02-02T18:21:32.406 INFO:tasks.workunit.client.0.smithi096.stdout:4/818: unlink d3/d4/c97 0 2022-02-02T18:21:32.406 INFO:tasks.workunit.client.0.smithi096.stdout:4/819: write d3/d4/d20/d26/d36/d88/ff8 [945169,28999] 0 2022-02-02T18:21:32.407 INFO:tasks.workunit.client.0.smithi096.stdout:5/808: symlink db/de/d10/d27/d83/l119 0 2022-02-02T18:21:32.410 INFO:tasks.workunit.client.0.smithi096.stdout:8/788: mknod d29/da7/d102/db3/d6d/d85/c107 0 2022-02-02T18:21:32.412 INFO:tasks.workunit.client.0.smithi096.stdout:1/860: unlink d15/lfa 0 2022-02-02T18:21:32.413 INFO:tasks.workunit.client.0.smithi096.stdout:1/861: read - d15/d1b/d26/ff2 zero size 2022-02-02T18:21:32.416 INFO:tasks.workunit.client.0.smithi096.stdout:7/783: rename d9/df/d12/d39/d40/c9b to d9/df/d47/d37/c110 0 2022-02-02T18:21:32.418 INFO:tasks.workunit.client.0.smithi096.stdout:3/851: dwrite d2/df/d14/dbe/ff0 [0,4194304] 0 2022-02-02T18:21:32.418 INFO:tasks.workunit.client.0.smithi096.stdout:5/809: getdents db/de/d10/d25/d4c/de6 0 2022-02-02T18:21:32.419 INFO:tasks.workunit.client.0.smithi096.stdout:8/789: symlink d29/d58/l108 0 2022-02-02T18:21:32.419 INFO:tasks.workunit.client.0.smithi096.stdout:8/790: stat d29/da7/d102/db3/c4f 0 2022-02-02T18:21:32.419 INFO:tasks.workunit.client.0.smithi096.stdout:8/791: fsync d29/f34 0 2022-02-02T18:21:32.421 INFO:tasks.workunit.client.0.smithi096.stdout:1/862: mknod d15/d1b/d26/d72/dce/c137 0 2022-02-02T18:21:32.421 INFO:tasks.workunit.client.0.smithi096.stdout:1/863: creat d15/d1b/d26/d72/da3/da7/f138 x:0 0 0 2022-02-02T18:21:32.422 INFO:tasks.workunit.client.0.smithi096.stdout:1/864: write d15/d4d/fd6 [565750,105580] 0 2022-02-02T18:21:32.422 INFO:tasks.workunit.client.0.smithi096.stdout:1/865: dread - d15/d1b/d26/d72/f106 zero size 2022-02-02T18:21:32.422 INFO:tasks.workunit.client.0.smithi096.stdout:1/866: read - d15/d1b/d26/d72/da3/da7/f138 zero size 2022-02-02T18:21:32.423 INFO:tasks.workunit.client.0.smithi096.stdout:5/810: write db/de/d2e/f41 [3544874,52101] 0 2022-02-02T18:21:32.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/820: rename d3/d27/f43 to d3/d4/d50/f110 0 2022-02-02T18:21:32.424 INFO:tasks.workunit.client.0.smithi096.stdout:9/861: dwrite d1/db/d1c/d2f/d78/d11/d3c/f79 [0,4194304] 0 2022-02-02T18:21:32.424 INFO:tasks.workunit.client.0.smithi096.stdout:9/862: dread - d1/db/d1c/d2f/d78/d11/d1e/f65 zero size 2022-02-02T18:21:32.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/852: mkdir d2/df/d34/d76/dd3/d104/daa/dfc/d103/d11a 0 2022-02-02T18:21:32.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/853: stat d2/df/d1c/d5d/dbf 0 2022-02-02T18:21:32.426 INFO:tasks.workunit.client.0.smithi096.stdout:8/792: creat d29/d58/d7a/f109 x:0 0 0 2022-02-02T18:21:32.427 INFO:tasks.workunit.client.0.smithi096.stdout:1/867: truncate d15/d1b/d28/d2c/f4c 2281319 0 2022-02-02T18:21:32.428 INFO:tasks.workunit.client.0.smithi096.stdout:5/811: creat db/dbd/d10a/f11a x:0 0 0 2022-02-02T18:21:32.430 INFO:tasks.workunit.client.0.smithi096.stdout:7/784: rename d9/df/d93/cb6 to d9/df/d47/d37/d83/db1/c111 0 2022-02-02T18:21:32.431 INFO:tasks.workunit.client.0.smithi096.stdout:4/821: creat d3/d4/d20/d26/d36/d88/dd8/de1/f111 x:0 0 0 2022-02-02T18:21:32.431 INFO:tasks.workunit.client.0.smithi096.stdout:4/822: chown d3/d85/fc7 0 1 2022-02-02T18:21:32.432 INFO:tasks.workunit.client.0.smithi096.stdout:4/823: write d3/d60/d8d/fc0 [541906,50362] 0 2022-02-02T18:21:32.434 INFO:tasks.workunit.client.0.smithi096.stdout:9/863: creat d1/d39/d8a/d97/dee/f126 x:0 0 0 2022-02-02T18:21:32.435 INFO:tasks.workunit.client.0.smithi096.stdout:3/854: mkdir d2/df/d1c/d5d/dbf/dd1/d115/d11b 0 2022-02-02T18:21:32.437 INFO:tasks.workunit.client.0.smithi096.stdout:8/793: creat d29/da7/d102/de4/f10a x:0 0 0 2022-02-02T18:21:32.443 INFO:tasks.workunit.client.0.smithi096.stdout:1/868: link d15/d1b/d26/d72/ldb d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/l139 0 2022-02-02T18:21:32.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/869: read d15/d1b/d26/d72/fad [283061,78619] 0 2022-02-02T18:21:32.449 INFO:tasks.workunit.client.0.smithi096.stdout:5/812: symlink db/l11b 0 2022-02-02T18:21:32.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/785: fdatasync d9/df/d12/d39/d40/d85/fcf 0 2022-02-02T18:21:32.452 INFO:tasks.workunit.client.0.smithi096.stdout:7/786: write d9/fd [2400140,44181] 0 2022-02-02T18:21:32.452 INFO:tasks.workunit.client.0.smithi096.stdout:7/787: write d9/df/d47/d37/d83/db4/fc8 [952909,58884] 0 2022-02-02T18:21:32.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/864: rename d1/db/d48/de3/de5/deb/ff1 to d1/db/d1c/d2f/f127 0 2022-02-02T18:21:32.454 INFO:tasks.workunit.client.0.smithi096.stdout:3/855: mkdir d2/df/d36/d8d/d11c 0 2022-02-02T18:21:32.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/794: symlink d29/d58/d63/l10b 0 2022-02-02T18:21:32.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/795: fsync d29/da7/d102/db3/d6d/f90 0 2022-02-02T18:21:32.456 INFO:tasks.workunit.client.0.smithi096.stdout:1/870: unlink d15/d1b/d28/d3f/c87 0 2022-02-02T18:21:32.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/813: mknod db/de/d10/d25/d4c/df6/c11c 0 2022-02-02T18:21:32.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/788: rename d9/df/d12/d39/d41/dac/fef to d9/df/d47/f112 0 2022-02-02T18:21:32.462 INFO:tasks.workunit.client.0.smithi096.stdout:9/865: getdents d1/db/d1c/d2f/d78/d11/dca 0 2022-02-02T18:21:32.463 INFO:tasks.workunit.client.0.smithi096.stdout:3/856: symlink d2/df/d1c/d5d/d6d/l11d 0 2022-02-02T18:21:32.465 INFO:tasks.workunit.client.0.smithi096.stdout:5/814: mknod db/d20/c11d 0 2022-02-02T18:21:32.466 INFO:tasks.workunit.client.0.smithi096.stdout:5/815: creat db/de/d10/d25/f11e x:0 0 0 2022-02-02T18:21:32.466 INFO:tasks.workunit.client.0.smithi096.stdout:5/816: fdatasync db/de/d10/d25/d4c/dd8/def/dc2/dfa/f5f 0 2022-02-02T18:21:32.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/857: truncate d2/df/da6/fb4 2424315 0 2022-02-02T18:21:32.468 INFO:tasks.workunit.client.0.smithi096.stdout:3/858: dread - d2/d71/d10c/f10f zero size 2022-02-02T18:21:32.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/817: mknod db/da1/dcc/dd4/c11f 0 2022-02-02T18:21:32.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/818: fdatasync db/de/d2e/d35/f81 0 2022-02-02T18:21:32.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/819: write db/d5c/d2f/fc7 [624292,80667] 0 2022-02-02T18:21:32.473 INFO:tasks.workunit.client.0.smithi096.stdout:3/859: creat d2/d71/f11e x:0 0 0 2022-02-02T18:21:32.473 INFO:tasks.workunit.client.0.smithi096.stdout:3/860: truncate d2/df/d34/d76/dd3/d104/daa/dfc/d103/f110 51065 0 2022-02-02T18:21:32.476 INFO:tasks.workunit.client.0.smithi096.stdout:6/841: sync 2022-02-02T18:21:32.479 INFO:tasks.workunit.client.0.smithi096.stdout:6/842: creat d18/d50/d6d/d113/f134 x:0 0 0 2022-02-02T18:21:32.479 INFO:tasks.workunit.client.0.smithi096.stdout:6/843: write d18/d24/d28/f78 [381932,125672] 0 2022-02-02T18:21:32.479 INFO:tasks.workunit.client.0.smithi096.stdout:6/844: truncate d18/d50/d8f/dc4/dbd/fda 1012563 0 2022-02-02T18:21:32.492 INFO:tasks.workunit.client.0.smithi096.stdout:6/845: dread d18/d50/d8f/dbb/f6a [0,4194304] 0 2022-02-02T18:21:32.495 INFO:tasks.workunit.client.0.smithi096.stdout:6/846: rmdir d18/d24 39 2022-02-02T18:21:32.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/847: rename fb to d18/d50/d9a/d131/f135 0 2022-02-02T18:21:32.498 INFO:tasks.workunit.client.0.smithi096.stdout:6/848: symlink d18/d24/d28/d4a/d9d/l136 0 2022-02-02T18:21:32.500 INFO:tasks.workunit.client.0.smithi096.stdout:6/849: mkdir d18/d50/d8f/dc4/dbd/d137 0 2022-02-02T18:21:32.501 INFO:tasks.workunit.client.0.smithi096.stdout:6/850: creat d18/d50/d9a/d116/f138 x:0 0 0 2022-02-02T18:21:32.502 INFO:tasks.workunit.client.0.smithi096.stdout:6/851: dread d18/d24/d28/d3e/fb1 [0,4194304] 0 2022-02-02T18:21:32.504 INFO:tasks.workunit.client.0.smithi096.stdout:6/852: creat d18/d50/d8f/dbb/d63/db3/d12d/f139 x:0 0 0 2022-02-02T18:21:32.506 INFO:tasks.workunit.client.0.smithi096.stdout:8/796: dwrite d29/da7/d102/db3/d6d/f103 [0,4194304] 0 2022-02-02T18:21:32.509 INFO:tasks.workunit.client.0.smithi096.stdout:1/871: dwrite d15/f27 [0,4194304] 0 2022-02-02T18:21:32.509 INFO:tasks.workunit.client.0.smithi096.stdout:9/866: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/f108 [0,4194304] 0 2022-02-02T18:21:32.510 INFO:tasks.workunit.client.0.smithi096.stdout:7/789: dwrite d9/df/d12/d39/d40/d51/fa6 [0,4194304] 0 2022-02-02T18:21:32.511 INFO:tasks.workunit.client.0.smithi096.stdout:3/861: dwrite d2/df/d34/d76/dd3/fe3 [0,4194304] 0 2022-02-02T18:21:32.511 INFO:tasks.workunit.client.0.smithi096.stdout:3/862: chown d2/df/d14/d2c/d31/da8 1237607011 1 2022-02-02T18:21:32.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/863: readlink d2/df/d1c/d5d/lcc 0 2022-02-02T18:21:32.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/864: write d2/df/d20/f37 [8785225,32911] 0 2022-02-02T18:21:32.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/797: rmdir d29/d58/d79/dea/dfc 0 2022-02-02T18:21:32.512 INFO:tasks.workunit.client.0.smithi096.stdout:5/820: dwrite db/d20/fc1 [0,4194304] 0 2022-02-02T18:21:32.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/798: write d29/d58/ff2 [716499,6163] 0 2022-02-02T18:21:32.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/872: write d15/d1b/d26/d59/f80 [862180,114082] 0 2022-02-02T18:21:32.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/790: mknod d9/df/d47/d37/c113 0 2022-02-02T18:21:32.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/853: dread d18/f3a [0,4194304] 0 2022-02-02T18:21:32.524 INFO:tasks.workunit.client.0.smithi096.stdout:3/865: dread d2/df/d14/f10 [4194304,4194304] 0 2022-02-02T18:21:32.524 INFO:tasks.workunit.client.0.smithi096.stdout:3/866: fsync d2/df/d34/d76/dd3/d104/f2b 0 2022-02-02T18:21:32.527 INFO:tasks.workunit.client.0.smithi096.stdout:6/854: dread d18/d50/d9a/fb2 [0,4194304] 0 2022-02-02T18:21:32.528 INFO:tasks.workunit.client.0.smithi096.stdout:6/855: chown d18/d24/d28/f78 24422 1 2022-02-02T18:21:32.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/867: dwrite d1/db/d1c/d2f/f32 [8388608,4194304] 0 2022-02-02T18:21:32.530 INFO:tasks.workunit.client.0.smithi096.stdout:9/868: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fc5 26 1 2022-02-02T18:21:32.532 INFO:tasks.workunit.client.0.smithi096.stdout:8/799: mknod d29/d58/c10c 0 2022-02-02T18:21:32.533 INFO:tasks.workunit.client.0.smithi096.stdout:5/821: creat db/de/d10/d25/d4c/de6/f120 x:0 0 0 2022-02-02T18:21:32.535 INFO:tasks.workunit.client.0.smithi096.stdout:1/873: rename d15/d1b/d28/d2c/d4f/f105 to d15/d1b/d26/d72/da3/d122/f13a 0 2022-02-02T18:21:32.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/791: creat d9/df/d12/d39/d46/d7d/dd7/f114 x:0 0 0 2022-02-02T18:21:32.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/792: chown d9/df/d12/d14/d82 12361 1 2022-02-02T18:21:32.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/793: getdents d9/df/d12/d39/d40/d85 0 2022-02-02T18:21:32.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/794: chown d9/df/d12/d39/d46/d7d/dd7 13223625 1 2022-02-02T18:21:32.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/795: stat d9/df/d47/d60/f9e 0 2022-02-02T18:21:32.539 INFO:tasks.workunit.client.0.smithi096.stdout:6/856: creat d18/d50/d8f/dbb/d63/f13a x:0 0 0 2022-02-02T18:21:32.540 INFO:tasks.workunit.client.0.smithi096.stdout:5/822: write db/de/d10/d25/f40 [3989533,39714] 0 2022-02-02T18:21:32.540 INFO:tasks.workunit.client.0.smithi096.stdout:5/823: stat db/da1/dcc 0 2022-02-02T18:21:32.540 INFO:tasks.workunit.client.0.smithi096.stdout:5/824: chown db/de/d2e/d35/f95 29008270 1 2022-02-02T18:21:32.541 INFO:tasks.workunit.client.0.smithi096.stdout:2/961: sync 2022-02-02T18:21:32.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/993: sync 2022-02-02T18:21:32.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/867: rename d2/d71/fe8 to d2/df/d1c/d5d/d69/f11f 0 2022-02-02T18:21:32.546 INFO:tasks.workunit.client.0.smithi096.stdout:1/874: unlink d15/d1b/d28/d2c/d4f/ff7 0 2022-02-02T18:21:32.546 INFO:tasks.workunit.client.0.smithi096.stdout:7/796: dread d9/df/d12/d39/d46/da4/f10a [0,4194304] 0 2022-02-02T18:21:32.547 INFO:tasks.workunit.client.0.smithi096.stdout:1/875: write d15/d1b/f104 [225564,72169] 0 2022-02-02T18:21:32.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/800: dwrite d29/d2d/d47/fff [0,4194304] 0 2022-02-02T18:21:32.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/801: write d29/da7/d102/ddb/ffa [562545,32123] 0 2022-02-02T18:21:32.549 INFO:tasks.workunit.client.0.smithi096.stdout:0/994: truncate d2/db/d24/d4d/d54/fae 1018067 0 2022-02-02T18:21:32.550 INFO:tasks.workunit.client.0.smithi096.stdout:1/876: dread d15/d1b/d28/f44 [0,4194304] 0 2022-02-02T18:21:32.550 INFO:tasks.workunit.client.0.smithi096.stdout:1/877: creat d15/d1b/d26/d72/da3/da7/ddc/f13b x:0 0 0 2022-02-02T18:21:32.550 INFO:tasks.workunit.client.0.smithi096.stdout:1/878: creat d15/d1b/d26/d72/f13c x:0 0 0 2022-02-02T18:21:32.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/868: mknod d2/df/d14/d73/c120 0 2022-02-02T18:21:32.558 INFO:tasks.workunit.client.0.smithi096.stdout:3/869: truncate d2/df/d1c/d5d/d69/f11f 12454 0 2022-02-02T18:21:32.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/797: read - d9/df/d12/d39/d40/d6b/dd4/f107 zero size 2022-02-02T18:21:32.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/798: write d9/df/d12/d39/d4e/ff2 [3994538,58985] 0 2022-02-02T18:21:32.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/799: chown d9/df/d12/f57 345184397 1 2022-02-02T18:21:32.560 INFO:tasks.workunit.client.0.smithi096.stdout:3/870: write d2/f9e [3654803,10814] 0 2022-02-02T18:21:32.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/869: truncate d1/db/d1c/d2f/f55 1713626 0 2022-02-02T18:21:32.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/870: chown d1/db/d1c/d2f/d78/d11/c46 0 1 2022-02-02T18:21:32.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/871: creat d1/db/d48/de3/de5/deb/f128 x:0 0 0 2022-02-02T18:21:32.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/872: write d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/fdf [903248,55171] 0 2022-02-02T18:21:32.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/873: write d1/db/d1c/d2f/d78/d11/d1e/d47/f98 [514083,35358] 0 2022-02-02T18:21:32.562 INFO:tasks.workunit.client.0.smithi096.stdout:4/824: sync 2022-02-02T18:21:32.562 INFO:tasks.workunit.client.0.smithi096.stdout:4/825: write d3/d4/d20/d26/d36/d88/f105 [789116,28312] 0 2022-02-02T18:21:32.563 INFO:tasks.workunit.client.0.smithi096.stdout:1/879: write d15/d1b/d28/d3f/f98 [4072080,94277] 0 2022-02-02T18:21:32.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/800: read d9/df/d47/d19/f27 [351890,31647] 0 2022-02-02T18:21:32.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/880: read d15/d1b/d26/d59/fe7 [3833041,109495] 0 2022-02-02T18:21:32.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/881: dread - d15/d4d/f100 zero size 2022-02-02T18:21:32.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/882: fsync d15/d1b/d26/d72/f11d 0 2022-02-02T18:21:32.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/874: rename d1/db/d1c/d2f/f6a to d1/db/d48/de3/de5/f129 0 2022-02-02T18:21:32.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/875: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f122 zero size 2022-02-02T18:21:32.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/876: write d1/db/d1c/d2f/d78/d11/d1e/d38/f7b [819400,126671] 0 2022-02-02T18:21:32.569 INFO:tasks.workunit.client.0.smithi096.stdout:3/871: write d2/d71/f90 [343761,100375] 0 2022-02-02T18:21:32.570 INFO:tasks.workunit.client.0.smithi096.stdout:2/962: dwrite d2/d5e/d6d/d79/d81/faf [0,4194304] 0 2022-02-02T18:21:32.570 INFO:tasks.workunit.client.0.smithi096.stdout:2/963: creat d2/d13/d43/d51/d5d/f12b x:0 0 0 2022-02-02T18:21:32.570 INFO:tasks.workunit.client.0.smithi096.stdout:4/826: creat d3/d4/d20/d26/d36/d102/d109/dfb/f112 x:0 0 0 2022-02-02T18:21:32.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/827: creat d3/f113 x:0 0 0 2022-02-02T18:21:32.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/828: chown d3/d4/d20/d26/d36/d102/d109 4 1 2022-02-02T18:21:32.571 INFO:tasks.workunit.client.0.smithi096.stdout:5/825: truncate db/d20/f29 3736223 0 2022-02-02T18:21:32.572 INFO:tasks.workunit.client.0.smithi096.stdout:5/826: chown db/d5c/f9c 27914951 1 2022-02-02T18:21:32.573 INFO:tasks.workunit.client.0.smithi096.stdout:1/883: write d15/d1b/d26/d72/da3/da7/f99 [3107138,3057] 0 2022-02-02T18:21:32.573 INFO:tasks.workunit.client.0.smithi096.stdout:6/857: dwrite d18/d50/d9a/fdd [0,4194304] 0 2022-02-02T18:21:32.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/802: dwrite d29/fbf [0,4194304] 0 2022-02-02T18:21:32.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/877: link d1/db/d48/de3/de5/deb/f128 d1/db/d1c/d2f/d78/d11/dca/f12a 0 2022-02-02T18:21:32.584 INFO:tasks.workunit.client.0.smithi096.stdout:2/964: rename d2/d6/d1b/dc0/fcc to d2/d5e/d6d/f12c 0 2022-02-02T18:21:32.584 INFO:tasks.workunit.client.0.smithi096.stdout:2/965: chown d2/d5e/d6d/fb6 339 1 2022-02-02T18:21:32.585 INFO:tasks.workunit.client.0.smithi096.stdout:4/829: mknod d3/d4/d20/d26/d36/d51/c114 0 2022-02-02T18:21:32.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/801: getdents d9/df/d16/d25 0 2022-02-02T18:21:32.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/884: mknod d15/d1b/d26/d72/dff/c13d 0 2022-02-02T18:21:32.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/885: readlink d15/d1b/d26/l35 0 2022-02-02T18:21:32.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/886: fsync d15/d1b/d26/d72/dff/d8a/db9/f133 0 2022-02-02T18:21:32.590 INFO:tasks.workunit.client.0.smithi096.stdout:3/872: dwrite d2/df/d14/d2c/d74/df3/f10d [0,4194304] 0 2022-02-02T18:21:32.592 INFO:tasks.workunit.client.0.smithi096.stdout:7/802: write d9/df/d12/d39/d4e/f88 [663578,57913] 0 2022-02-02T18:21:32.593 INFO:tasks.workunit.client.0.smithi096.stdout:6/858: mknod d18/d24/d73/dfb/de8/c13b 0 2022-02-02T18:21:32.594 INFO:tasks.workunit.client.0.smithi096.stdout:8/803: mkdir d29/da7/d102/db3/d10d 0 2022-02-02T18:21:32.596 INFO:tasks.workunit.client.0.smithi096.stdout:9/878: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/f7f 0 2022-02-02T18:21:32.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/827: rename db/de/d10/d25/c67 to db/dbd/d10a/c121 0 2022-02-02T18:21:32.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/830: dwrite d3/d4/d20/d26/d36/d102/d109/df4/f9e [4194304,4194304] 0 2022-02-02T18:21:32.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/831: write d3/d4/d20/d26/d36/fc5 [205901,108007] 0 2022-02-02T18:21:32.604 INFO:tasks.workunit.client.0.smithi096.stdout:2/966: mknod d2/d13/d42/d71/dad/c12d 0 2022-02-02T18:21:32.604 INFO:tasks.workunit.client.0.smithi096.stdout:2/967: write d2/d13/d42/d71/dad/db0/de4/ffa [550623,113700] 0 2022-02-02T18:21:32.605 INFO:tasks.workunit.client.0.smithi096.stdout:1/887: getdents d15/d1b/d28/d2c 0 2022-02-02T18:21:32.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/803: link d9/df/d12/d39/l10c d9/df/l115 0 2022-02-02T18:21:32.610 INFO:tasks.workunit.client.0.smithi096.stdout:6/859: symlink d18/d50/d8f/dbb/d63/db3/db5/l13c 0 2022-02-02T18:21:32.612 INFO:tasks.workunit.client.0.smithi096.stdout:3/873: dwrite d2/df/d20/d33/d58/d7c/faf [0,4194304] 0 2022-02-02T18:21:32.613 INFO:tasks.workunit.client.0.smithi096.stdout:6/860: write d18/d24/d28/d3e/fd7 [7737905,54874] 0 2022-02-02T18:21:32.614 INFO:tasks.workunit.client.0.smithi096.stdout:3/874: write d2/df/d14/d2c/d31/f47 [2533650,121629] 0 2022-02-02T18:21:32.614 INFO:tasks.workunit.client.0.smithi096.stdout:3/875: dread - d2/df/d1c/d5d/d6d/fc8 zero size 2022-02-02T18:21:32.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/804: symlink d29/d2d/d87/da5/deb/l10e 0 2022-02-02T18:21:32.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/805: write d29/fa4 [2956977,87770] 0 2022-02-02T18:21:32.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/806: fdatasync d29/d4e/f9f 0 2022-02-02T18:21:32.616 INFO:tasks.workunit.client.0.smithi096.stdout:9/879: mkdir d1/d39/d8a/d97/dee/d12b 0 2022-02-02T18:21:32.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/828: rmdir db/d5c/d32 39 2022-02-02T18:21:32.620 INFO:tasks.workunit.client.0.smithi096.stdout:4/832: creat d3/d4/d20/d26/d36/d102/f115 x:0 0 0 2022-02-02T18:21:32.620 INFO:tasks.workunit.client.0.smithi096.stdout:4/833: unlink d3/c1a 0 2022-02-02T18:21:32.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/829: write db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/fcd [1329788,76972] 0 2022-02-02T18:21:32.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/888: mkdir d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d13e 0 2022-02-02T18:21:32.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/830: write db/de/d2e/f41 [1563829,13924] 0 2022-02-02T18:21:32.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/861: rmdir d18/d24/d28/d4a/d9d 39 2022-02-02T18:21:32.624 INFO:tasks.workunit.client.0.smithi096.stdout:2/968: dwrite d2/d5e/d6d/fde [4194304,4194304] 0 2022-02-02T18:21:32.625 INFO:tasks.workunit.client.0.smithi096.stdout:3/876: creat d2/df/d1c/d5d/dbf/dd1/d115/f121 x:0 0 0 2022-02-02T18:21:32.629 INFO:tasks.workunit.client.0.smithi096.stdout:9/880: mkdir d1/db/d1c/d2f/d12c 0 2022-02-02T18:21:32.629 INFO:tasks.workunit.client.0.smithi096.stdout:9/881: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/ff2 [638900,26948] 0 2022-02-02T18:21:32.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/834: unlink d3/l49 0 2022-02-02T18:21:32.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/807: dwrite d29/d58/f101 [0,4194304] 0 2022-02-02T18:21:32.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/889: link d15/d1b/f8c d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f13f 0 2022-02-02T18:21:32.634 INFO:tasks.workunit.client.0.smithi096.stdout:6/862: write d18/d24/d28/d3e/f41 [953573,10179] 0 2022-02-02T18:21:32.634 INFO:tasks.workunit.client.0.smithi096.stdout:1/890: getdents d15/d1b/d26/d59/d11b 0 2022-02-02T18:21:32.634 INFO:tasks.workunit.client.0.smithi096.stdout:7/804: getdents d9/df/d44 0 2022-02-02T18:21:32.636 INFO:tasks.workunit.client.0.smithi096.stdout:5/831: truncate db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/fd3 369286 0 2022-02-02T18:21:32.639 INFO:tasks.workunit.client.0.smithi096.stdout:2/969: mkdir d2/d13/d42/d12e 0 2022-02-02T18:21:32.639 INFO:tasks.workunit.client.0.smithi096.stdout:2/970: dread - d2/d13/d43/d51/d73/da9/f10d zero size 2022-02-02T18:21:32.641 INFO:tasks.workunit.client.0.smithi096.stdout:9/882: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/cbe 0 2022-02-02T18:21:32.645 INFO:tasks.workunit.client.0.smithi096.stdout:8/808: getdents d29/da7/d102/db3/d6d/d83/db9 0 2022-02-02T18:21:32.648 INFO:tasks.workunit.client.0.smithi096.stdout:6/863: rename d18/d50/d8f/dbb/l58 to d18/d50/d9a/d116/d120/l13d 0 2022-02-02T18:21:32.652 INFO:tasks.workunit.client.0.smithi096.stdout:8/809: dread d29/d2d/d87/def/f100 [0,4194304] 0 2022-02-02T18:21:32.658 INFO:tasks.workunit.client.0.smithi096.stdout:9/883: creat d1/db/d1c/d2f/d78/f12d x:0 0 0 2022-02-02T18:21:32.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/864: getdents d18/d50/d9a 0 2022-02-02T18:21:32.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/865: read d18/d24/f126 [61744,69944] 0 2022-02-02T18:21:32.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/810: rename d29/d2d/d42/lcd to d29/da7/d102/db3/d6d/l10f 0 2022-02-02T18:21:32.663 INFO:tasks.workunit.client.0.smithi096.stdout:8/811: rmdir d29/da7/d102/dcc/d5b/dd9 39 2022-02-02T18:21:32.664 INFO:tasks.workunit.client.0.smithi096.stdout:8/812: symlink d29/d2d/l110 0 2022-02-02T18:21:32.665 INFO:tasks.workunit.client.0.smithi096.stdout:8/813: rename d29 to d29/da7/d102/dcc/d5b/d81/dec/d111 22 2022-02-02T18:21:32.665 INFO:tasks.workunit.client.0.smithi096.stdout:8/814: readlink d29/da7/d102/dcc/d5b/d81/dae/lde 0 2022-02-02T18:21:32.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/815: mkdir d29/da7/d102/dcc/d5b/d81/dec/d112 0 2022-02-02T18:21:32.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/816: creat d29/d2d/d87/da5/f113 x:0 0 0 2022-02-02T18:21:32.667 INFO:tasks.workunit.client.0.smithi096.stdout:8/817: rename d29/d2d/l110 to d29/da7/d102/dcc/d5b/dd9/dce/l114 0 2022-02-02T18:21:32.669 INFO:tasks.workunit.client.0.smithi096.stdout:8/818: rmdir d29/da7/d102/dcc/d5b/d81/dec/d112 0 2022-02-02T18:21:32.669 INFO:tasks.workunit.client.0.smithi096.stdout:8/819: fsync d29/da7/d102/fb0 0 2022-02-02T18:21:32.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/820: mknod d29/da7/d102/dcc/d5b/dd1/c115 0 2022-02-02T18:21:32.676 INFO:tasks.workunit.client.0.smithi096.stdout:1/891: dwrite d15/d1b/d28/d47/f86 [0,4194304] 0 2022-02-02T18:21:32.677 INFO:tasks.workunit.client.0.smithi096.stdout:2/971: dwrite d2/d6/fa [0,4194304] 0 2022-02-02T18:21:32.677 INFO:tasks.workunit.client.0.smithi096.stdout:2/972: chown d2/d13/d43/d51 664030115 1 2022-02-02T18:21:32.678 INFO:tasks.workunit.client.0.smithi096.stdout:4/835: dwrite d3/d4/d20/d26/d36/d102/f106 [0,4194304] 0 2022-02-02T18:21:32.678 INFO:tasks.workunit.client.0.smithi096.stdout:4/836: chown d3/d4/d20/d26/d36/d51/l67 1 1 2022-02-02T18:21:32.678 INFO:tasks.workunit.client.0.smithi096.stdout:9/884: dwrite d1/db/d48/fb3 [0,4194304] 0 2022-02-02T18:21:32.679 INFO:tasks.workunit.client.0.smithi096.stdout:9/885: fsync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f122 0 2022-02-02T18:21:32.679 INFO:tasks.workunit.client.0.smithi096.stdout:6/866: dread d18/d50/f122 [0,4194304] 0 2022-02-02T18:21:32.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/805: dwrite d9/df/d12/d14/fdd [0,4194304] 0 2022-02-02T18:21:32.679 INFO:tasks.workunit.client.0.smithi096.stdout:6/867: readlink d18/d50/l68 0 2022-02-02T18:21:32.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/868: fsync d18/d24/f5b 0 2022-02-02T18:21:32.680 INFO:tasks.workunit.client.0.smithi096.stdout:1/892: write d15/d1b/d26/f31 [4137070,86736] 0 2022-02-02T18:21:32.681 INFO:tasks.workunit.client.0.smithi096.stdout:2/973: mkdir d2/d6/dd2/d12f 0 2022-02-02T18:21:32.681 INFO:tasks.workunit.client.0.smithi096.stdout:2/974: stat d2/d19/de3 0 2022-02-02T18:21:32.681 INFO:tasks.workunit.client.0.smithi096.stdout:1/893: dread d15/d1b/d28/d2c/d39/d71/f124 [0,4194304] 0 2022-02-02T18:21:32.681 INFO:tasks.workunit.client.0.smithi096.stdout:1/894: read - d15/d1b/d26/d72/dce/f10b zero size 2022-02-02T18:21:32.682 INFO:tasks.workunit.client.0.smithi096.stdout:1/895: write d15/d4d/f81 [155244,73746] 0 2022-02-02T18:21:32.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/806: symlink d9/df/d47/db7/l116 0 2022-02-02T18:21:32.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/807: chown d9/df/d16/f28 12600237 1 2022-02-02T18:21:32.694 INFO:tasks.workunit.client.0.smithi096.stdout:1/896: mkdir d15/d1b/d26/d72/da3/da7/d140 0 2022-02-02T18:21:32.696 INFO:tasks.workunit.client.0.smithi096.stdout:2/975: dread d2/d5e/d6d/fa0 [0,4194304] 0 2022-02-02T18:21:32.697 INFO:tasks.workunit.client.0.smithi096.stdout:1/897: creat d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d13e/f141 x:0 0 0 2022-02-02T18:21:32.697 INFO:tasks.workunit.client.0.smithi096.stdout:1/898: write d15/d1b/d28/d2c/d39/d71/f9e [1602631,94378] 0 2022-02-02T18:21:32.697 INFO:tasks.workunit.client.0.smithi096.stdout:1/899: read d15/d1b/d28/f3e [1705737,17035] 0 2022-02-02T18:21:32.705 INFO:tasks.workunit.client.0.smithi096.stdout:7/808: dread f2 [0,4194304] 0 2022-02-02T18:21:32.706 INFO:tasks.workunit.client.0.smithi096.stdout:0/995: sync 2022-02-02T18:21:32.708 INFO:tasks.workunit.client.0.smithi096.stdout:0/996: mkdir d2/db/d24/d4d/d53/d150 0 2022-02-02T18:21:32.709 INFO:tasks.workunit.client.0.smithi096.stdout:0/997: chown d2/db/d24/d89/d8f/d95/dcd/f120 87638 1 2022-02-02T18:21:32.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/976: dread d2/d5e/d6d/d79/f6a [0,4194304] 0 2022-02-02T18:21:32.711 INFO:tasks.workunit.client.0.smithi096.stdout:2/977: rename d2/d13/d42/d71/dad/db0/cfc to d2/d13/d42/d71/dad/db0/de4/c130 0 2022-02-02T18:21:32.712 INFO:tasks.workunit.client.0.smithi096.stdout:2/978: read d2/f9 [1423728,113111] 0 2022-02-02T18:21:32.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/979: creat d2/d6/dd2/f131 x:0 0 0 2022-02-02T18:21:32.727 INFO:tasks.workunit.client.0.smithi096.stdout:8/821: dwrite d29/d2d/d47/fa2 [0,4194304] 0 2022-02-02T18:21:32.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/980: dread d2/d13/d43/d51/f69 [0,4194304] 0 2022-02-02T18:21:32.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/981: write d2/d5e/d6d/d79/f6a [1747610,13081] 0 2022-02-02T18:21:32.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/982: chown d2/d13/d43/d51/d5d/l108 374489297 1 2022-02-02T18:21:32.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/983: write d2/d29/fa8 [903110,94969] 0 2022-02-02T18:21:32.729 INFO:tasks.workunit.client.0.smithi096.stdout:2/984: unlink d2/f72 0 2022-02-02T18:21:32.729 INFO:tasks.workunit.client.0.smithi096.stdout:2/985: write d2/fee [99955,11420] 0 2022-02-02T18:21:32.729 INFO:tasks.workunit.client.0.smithi096.stdout:8/822: mkdir d29/d58/d7a/d116 0 2022-02-02T18:21:32.729 INFO:tasks.workunit.client.0.smithi096.stdout:8/823: truncate d29/d58/d79/f7c 1251501 0 2022-02-02T18:21:32.729 INFO:tasks.workunit.client.0.smithi096.stdout:8/824: chown d29/da7/d102/db3/l5e 4239 1 2022-02-02T18:21:32.730 INFO:tasks.workunit.client.0.smithi096.stdout:2/986: rename d2/d6/d1b/d3a/c95 to d2/d6/dd2/d12f/c132 0 2022-02-02T18:21:32.731 INFO:tasks.workunit.client.0.smithi096.stdout:8/825: mknod d29/da7/d102/dcc/d5b/dd9/dce/c117 0 2022-02-02T18:21:32.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/987: link d2/d6/d1b/d8a/l109 d2/d13/d42/l133 0 2022-02-02T18:21:32.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/826: unlink d29/f34 0 2022-02-02T18:21:32.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/827: creat d29/d58/d79/f118 x:0 0 0 2022-02-02T18:21:32.737 INFO:tasks.workunit.client.0.smithi096.stdout:8/828: symlink d29/da7/d102/dcc/d5b/d81/dae/l119 0 2022-02-02T18:21:32.738 INFO:tasks.workunit.client.0.smithi096.stdout:9/886: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/fec [0,4194304] 0 2022-02-02T18:21:32.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/837: dwrite d3/d4/d20/d26/d36/d102/d109/ff5 [0,4194304] 0 2022-02-02T18:21:32.738 INFO:tasks.workunit.client.0.smithi096.stdout:1/900: dwrite d15/d1b/d26/d59/f80 [0,4194304] 0 2022-02-02T18:21:32.739 INFO:tasks.workunit.client.0.smithi096.stdout:2/988: dread d2/d13/d43/ffb [0,4194304] 0 2022-02-02T18:21:32.739 INFO:tasks.workunit.client.0.smithi096.stdout:7/809: dwrite d9/df/d47/d19/f1e [0,4194304] 0 2022-02-02T18:21:32.740 INFO:tasks.workunit.client.0.smithi096.stdout:0/998: dwrite d2/db/d37/d40/fb8 [0,4194304] 0 2022-02-02T18:21:32.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/829: rmdir d29/d58 39 2022-02-02T18:21:32.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/830: read - d29/d58/d79/f118 zero size 2022-02-02T18:21:32.757 INFO:tasks.workunit.client.0.smithi096.stdout:2/989: dwrite d2/d13/d43/d80/f115 [0,4194304] 0 2022-02-02T18:21:32.757 INFO:tasks.workunit.client.0.smithi096.stdout:2/990: chown d2/d13/d43/d51/d5d/f127 3 1 2022-02-02T18:21:32.757 INFO:tasks.workunit.client.0.smithi096.stdout:1/901: link d15/d1b/d26/d72/da3/da7/ddc/f13b d15/d1b/d26/d72/da3/da7/ddc/d113/f142 0 2022-02-02T18:21:32.758 INFO:tasks.workunit.client.0.smithi096.stdout:2/991: write d2/d5e/d6d/d79/fc9 [271620,101077] 0 2022-02-02T18:21:32.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/810: link d9/df/d16/d25/d98/ceb d9/df/d12/d39/d41/c117 0 2022-02-02T18:21:32.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/999: mknod d2/d1e/db9/c151 0 2022-02-02T18:21:32.765 INFO:tasks.workunit.client.0.smithi096.stdout:9/887: rmdir d1/db/d48/de3/de5/deb 39 2022-02-02T18:21:32.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/992: truncate d2/d6/d1b/d3a/f44 21162 0 2022-02-02T18:21:32.767 INFO:tasks.workunit.client.0.smithi096.stdout:7/811: symlink d9/df/d12/d39/d4e/l118 0 2022-02-02T18:21:32.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/902: rename d15/d1b/d26/d72/da3/da7/ddc/f82 to d15/d1b/d28/d47/f143 0 2022-02-02T18:21:32.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/993: mknod d2/d13/d42/d71/dad/db0/c134 0 2022-02-02T18:21:32.770 INFO:tasks.workunit.client.0.smithi096.stdout:7/812: creat d9/df/d93/f119 x:0 0 0 2022-02-02T18:21:32.771 INFO:tasks.workunit.client.0.smithi096.stdout:8/831: dwrite f1c [4194304,4194304] 0 2022-02-02T18:21:32.771 INFO:tasks.workunit.client.0.smithi096.stdout:5/832: sync 2022-02-02T18:21:32.773 INFO:tasks.workunit.client.0.smithi096.stdout:9/888: rename d1/db/d1c/d2f/d78/d25/dd/d49/cae to d1/db/d1c/d2f/dd2/c12e 0 2022-02-02T18:21:32.775 INFO:tasks.workunit.client.0.smithi096.stdout:1/903: link d15/f2a d15/d1b/d26/d72/dff/d8a/db9/f144 0 2022-02-02T18:21:32.776 INFO:tasks.workunit.client.0.smithi096.stdout:2/994: symlink d2/d13/d42/d12e/l135 0 2022-02-02T18:21:32.777 INFO:tasks.workunit.client.0.smithi096.stdout:2/995: write d2/d13/d43/d51/fc1 [599288,110243] 0 2022-02-02T18:21:32.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/877: sync 2022-02-02T18:21:32.781 INFO:tasks.workunit.client.0.smithi096.stdout:5/833: creat db/d5c/d2f/db7/f122 x:0 0 0 2022-02-02T18:21:32.784 INFO:tasks.workunit.client.0.smithi096.stdout:9/889: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d12f 0 2022-02-02T18:21:32.785 INFO:tasks.workunit.client.0.smithi096.stdout:9/890: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/f100 [315646,74128] 0 2022-02-02T18:21:32.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/813: mkdir d9/df/d12/d39/d40/d11a 0 2022-02-02T18:21:32.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/814: stat d9/df/d12/d39/d40/d6b/ca8 0 2022-02-02T18:21:32.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/815: write d9/df/d12/d39/ff8 [95392,122663] 0 2022-02-02T18:21:32.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/816: truncate d9/f3e 4728365 0 2022-02-02T18:21:32.790 INFO:tasks.workunit.client.0.smithi096.stdout:8/832: dwrite d29/d2d/d47/f93 [0,4194304] 0 2022-02-02T18:21:32.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/891: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/fbb [0,4194304] 0 2022-02-02T18:21:32.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/833: creat d29/da7/d102/db3/d6d/d85/f11a x:0 0 0 2022-02-02T18:21:32.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/892: creat d1/db/d1c/d2f/d78/d11/d1e/d47/f130 x:0 0 0 2022-02-02T18:21:32.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/893: dread - d1/de4/f107 zero size 2022-02-02T18:21:32.798 INFO:tasks.workunit.client.0.smithi096.stdout:3/878: getdents d2/df/d34/d76/dd3/d104/daa/dfc/d103 0 2022-02-02T18:21:32.798 INFO:tasks.workunit.client.0.smithi096.stdout:5/834: rmdir db/de/d10/d25/d4c/de6 39 2022-02-02T18:21:32.799 INFO:tasks.workunit.client.0.smithi096.stdout:5/835: write db/de/d10/d27/d83/ffb [35879,79913] 0 2022-02-02T18:21:32.800 INFO:tasks.workunit.client.0.smithi096.stdout:8/834: creat d29/d58/d63/f11b x:0 0 0 2022-02-02T18:21:32.801 INFO:tasks.workunit.client.0.smithi096.stdout:8/835: chown d29/da7/d102/db3/d6d/d83/db9 2405615 1 2022-02-02T18:21:32.803 INFO:tasks.workunit.client.0.smithi096.stdout:3/879: truncate d2/df/d20/d33/d58/fed 3280556 0 2022-02-02T18:21:32.803 INFO:tasks.workunit.client.0.smithi096.stdout:3/880: chown d2/df/d34/d76/dd3/d104/daa/dfc/d103/f110 1405 1 2022-02-02T18:21:32.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/894: rename d1/db/d1c/d2f/d78/d25/dd to d1/db/d1c/d2f/d78/d131 0 2022-02-02T18:21:32.808 INFO:tasks.workunit.client.0.smithi096.stdout:5/836: rename db/de/d10/d25/d4c/fe4 to db/de/d10/d25/d4c/dd8/def/dc2/dfa/f123 0 2022-02-02T18:21:32.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/837: read - db/de/d10/d25/d4c/dd8/def/f107 zero size 2022-02-02T18:21:32.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/838: stat db/de/d2e/f94 0 2022-02-02T18:21:32.810 INFO:tasks.workunit.client.0.smithi096.stdout:7/817: dwrite d9/df/d47/dd3/fde [0,4194304] 0 2022-02-02T18:21:32.810 INFO:tasks.workunit.client.0.smithi096.stdout:7/818: fdatasync d9/df/d12/d14/fca 0 2022-02-02T18:21:32.811 INFO:tasks.workunit.client.0.smithi096.stdout:3/881: rename d2/df/d34/d76/dd3/fe3 to d2/df/d20/d4a/d108/f122 0 2022-02-02T18:21:32.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/869: sync 2022-02-02T18:21:32.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/839: creat db/de/d10/d25/d4c/dd8/def/dc2/dfa/f124 x:0 0 0 2022-02-02T18:21:32.814 INFO:tasks.workunit.client.0.smithi096.stdout:5/840: creat db/de/d10/d27/d83/f125 x:0 0 0 2022-02-02T18:21:32.814 INFO:tasks.workunit.client.0.smithi096.stdout:5/841: truncate db/de/d10/d25/d4c/ff4 24405 0 2022-02-02T18:21:32.815 INFO:tasks.workunit.client.0.smithi096.stdout:7/819: mkdir d9/df/d16/d25/d98/d11b 0 2022-02-02T18:21:32.816 INFO:tasks.workunit.client.0.smithi096.stdout:8/836: dwrite d29/d58/d79/f118 [0,4194304] 0 2022-02-02T18:21:32.818 INFO:tasks.workunit.client.0.smithi096.stdout:3/882: creat d2/df/d34/d76/dd3/d104/daa/dfc/d103/d11a/f123 x:0 0 0 2022-02-02T18:21:32.818 INFO:tasks.workunit.client.0.smithi096.stdout:3/883: chown d2/df/d14/f50 1989052 1 2022-02-02T18:21:32.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/870: rename d18/d24/d28/d3e/f62 to d18/d24/d73/dfb/f13e 0 2022-02-02T18:21:32.832 INFO:tasks.workunit.client.0.smithi096.stdout:3/884: rename d2/df/d34/d76/dd3/d104/l2d to d2/df/d1c/d5d/da3/l124 0 2022-02-02T18:21:32.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/820: dwrite d9/df/d12/d39/d42/f5a [4194304,4194304] 0 2022-02-02T18:21:32.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/821: fsync f2 0 2022-02-02T18:21:32.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/822: chown d9/df/d54/f99 149 1 2022-02-02T18:21:32.833 INFO:tasks.workunit.client.0.smithi096.stdout:5/842: symlink db/de/d2e/l126 0 2022-02-02T18:21:32.834 INFO:tasks.workunit.client.0.smithi096.stdout:3/885: mknod d2/df/d34/c125 0 2022-02-02T18:21:32.834 INFO:tasks.workunit.client.0.smithi096.stdout:3/886: fdatasync d2/df/d20/fef 0 2022-02-02T18:21:32.837 INFO:tasks.workunit.client.0.smithi096.stdout:7/823: rmdir d9/df/d12/d39/d40/d6b 39 2022-02-02T18:21:32.837 INFO:tasks.workunit.client.0.smithi096.stdout:7/824: unlink d9/l13 0 2022-02-02T18:21:32.839 INFO:tasks.workunit.client.0.smithi096.stdout:5/843: truncate db/de/d10/fd6 1592952 0 2022-02-02T18:21:32.839 INFO:tasks.workunit.client.0.smithi096.stdout:5/844: stat db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75 0 2022-02-02T18:21:32.841 INFO:tasks.workunit.client.0.smithi096.stdout:3/887: creat d2/df/d20/d33/d58/dce/f126 x:0 0 0 2022-02-02T18:21:32.841 INFO:tasks.workunit.client.0.smithi096.stdout:3/888: dread - d2/df/d36/d8d/ffd zero size 2022-02-02T18:21:32.841 INFO:tasks.workunit.client.0.smithi096.stdout:3/889: chown d2/df/d14/lc 175893635 1 2022-02-02T18:21:32.844 INFO:tasks.workunit.client.0.smithi096.stdout:5/845: truncate db/d5c/d32/fc9 3959921 0 2022-02-02T18:21:32.846 INFO:tasks.workunit.client.0.smithi096.stdout:6/871: dwrite d18/d24/d28/f35 [0,4194304] 0 2022-02-02T18:21:32.846 INFO:tasks.workunit.client.0.smithi096.stdout:6/872: chown d18/d50/d6d/d113/f134 2043160 1 2022-02-02T18:21:32.847 INFO:tasks.workunit.client.0.smithi096.stdout:7/825: rename d9/df/d47/d60 to d9/df/d47/d37/d83/d11c 0 2022-02-02T18:21:32.852 INFO:tasks.workunit.client.0.smithi096.stdout:3/890: dread d2/df/d14/f10 [4194304,4194304] 0 2022-02-02T18:21:32.852 INFO:tasks.workunit.client.0.smithi096.stdout:3/891: fdatasync d2/df/d34/fb9 0 2022-02-02T18:21:32.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/892: mknod d2/df/d36/d8d/dcd/c127 0 2022-02-02T18:21:32.856 INFO:tasks.workunit.client.0.smithi096.stdout:5/846: dread db/de/d10/d25/d4c/dd8/def/dc2/dfa/f7b [0,4194304] 0 2022-02-02T18:21:32.863 INFO:tasks.workunit.client.0.smithi096.stdout:7/826: dread d9/f3e [0,4194304] 0 2022-02-02T18:21:32.863 INFO:tasks.workunit.client.0.smithi096.stdout:7/827: fsync d9/df/d54/f7a 0 2022-02-02T18:21:32.864 INFO:tasks.workunit.client.0.smithi096.stdout:7/828: readlink d9/df/d12/d14/d82/la0 0 2022-02-02T18:21:32.865 INFO:tasks.workunit.client.0.smithi096.stdout:6/873: dwrite d18/d50/d8f/df1/f10c [0,4194304] 0 2022-02-02T18:21:32.865 INFO:tasks.workunit.client.0.smithi096.stdout:7/829: write d9/df/d12/d39/d40/d51/fa6 [770361,1673] 0 2022-02-02T18:21:32.865 INFO:tasks.workunit.client.0.smithi096.stdout:7/830: write d9/df/d93/f119 [887235,125957] 0 2022-02-02T18:21:32.867 INFO:tasks.workunit.client.0.smithi096.stdout:4/838: sync 2022-02-02T18:21:32.867 INFO:tasks.workunit.client.0.smithi096.stdout:6/874: rename d18/d50/d8f/dbb/cf0 to d18/d24/d28/d3e/d133/c13f 0 2022-02-02T18:21:32.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/875: write d18/d50/d8f/dbb/d63/db3/fcf [1074708,122463] 0 2022-02-02T18:21:32.868 INFO:tasks.workunit.client.0.smithi096.stdout:7/831: symlink d9/df/d12/d39/d41/l11d 0 2022-02-02T18:21:32.869 INFO:tasks.workunit.client.0.smithi096.stdout:4/839: mknod d3/d60/dc2/c116 0 2022-02-02T18:21:32.869 INFO:tasks.workunit.client.0.smithi096.stdout:5/847: dread db/d5c/d60/f8c [0,4194304] 0 2022-02-02T18:21:32.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/876: creat d18/d50/d6d/f140 x:0 0 0 2022-02-02T18:21:32.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/877: fsync d18/d24/d28/d4a/db8/fd6 0 2022-02-02T18:21:32.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/878: chown d18/d24/d73/dfb/de8 28365 1 2022-02-02T18:21:32.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/879: chown d18/d24/d28/l46 195 1 2022-02-02T18:21:32.871 INFO:tasks.workunit.client.0.smithi096.stdout:4/840: mknod d3/d4/d20/d26/d36/d102/d109/df4/d55/c117 0 2022-02-02T18:21:32.872 INFO:tasks.workunit.client.0.smithi096.stdout:5/848: link db/de/d10/fd6 db/d5c/d60/f127 0 2022-02-02T18:21:32.873 INFO:tasks.workunit.client.0.smithi096.stdout:4/841: mkdir d3/d4/d20/d26/d36/d102/d109/d118 0 2022-02-02T18:21:32.873 INFO:tasks.workunit.client.0.smithi096.stdout:4/842: chown d3/l31 5828196 1 2022-02-02T18:21:32.874 INFO:tasks.workunit.client.0.smithi096.stdout:4/843: stat d3/d5a/f87 0 2022-02-02T18:21:32.874 INFO:tasks.workunit.client.0.smithi096.stdout:5/849: truncate db/de/d10/d27/fd7 936093 0 2022-02-02T18:21:32.877 INFO:tasks.workunit.client.0.smithi096.stdout:4/844: getdents d3/d4/d20/d26/d36/d51/d57/dcf 0 2022-02-02T18:21:32.877 INFO:tasks.workunit.client.0.smithi096.stdout:4/845: readlink d3/d60/da8/ld2 0 2022-02-02T18:21:32.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/893: dwrite d2/d71/fe4 [0,4194304] 0 2022-02-02T18:21:32.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/894: chown d2/df/d20/d4a/d108/f122 332 1 2022-02-02T18:21:32.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/895: stat d2/df/d36/d8d/ffd 0 2022-02-02T18:21:32.880 INFO:tasks.workunit.client.0.smithi096.stdout:4/846: mkdir d3/d4/d20/d26/d36/d88/d119 0 2022-02-02T18:21:32.881 INFO:tasks.workunit.client.0.smithi096.stdout:7/832: dread d9/df/d12/d39/d40/fe9 [0,4194304] 0 2022-02-02T18:21:32.881 INFO:tasks.workunit.client.0.smithi096.stdout:7/833: readlink d9/df/d12/d39/l94 0 2022-02-02T18:21:32.881 INFO:tasks.workunit.client.0.smithi096.stdout:7/834: fdatasync d9/df/d12/d39/d40/d6b/dd4/f107 0 2022-02-02T18:21:32.881 INFO:tasks.workunit.client.0.smithi096.stdout:7/835: stat d9/l17 0 2022-02-02T18:21:32.882 INFO:tasks.workunit.client.0.smithi096.stdout:7/836: write d9/df/d12/fe4 [391166,7342] 0 2022-02-02T18:21:32.882 INFO:tasks.workunit.client.0.smithi096.stdout:4/847: write d3/d85/fa0 [656314,130027] 0 2022-02-02T18:21:32.889 INFO:tasks.workunit.client.0.smithi096.stdout:6/880: dwrite d18/d24/f36 [0,4194304] 0 2022-02-02T18:21:32.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/896: mknod d2/df/d1c/d5d/d69/d43/d72/c128 0 2022-02-02T18:21:32.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/897: creat d2/df/d14/d2c/d31/da8/f129 x:0 0 0 2022-02-02T18:21:32.892 INFO:tasks.workunit.client.0.smithi096.stdout:7/837: rename d9/df/d47/d37/d83/d11c/f9e to d9/df/d47/d37/d83/d11c/f11e 0 2022-02-02T18:21:32.893 INFO:tasks.workunit.client.0.smithi096.stdout:4/848: link d3/d4/d20/d26/d36/d102/d109/df4/d55/c117 d3/d4/d20/d26/d36/d102/d109/df4/d55/c11a 0 2022-02-02T18:21:32.895 INFO:tasks.workunit.client.0.smithi096.stdout:6/881: mknod d18/d50/d8f/dbb/d63/dc2/d117/c141 0 2022-02-02T18:21:32.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/996: sync 2022-02-02T18:21:32.896 INFO:tasks.workunit.client.0.smithi096.stdout:1/904: sync 2022-02-02T18:21:32.897 INFO:tasks.workunit.client.0.smithi096.stdout:8/837: sync 2022-02-02T18:21:32.897 INFO:tasks.workunit.client.0.smithi096.stdout:9/895: sync 2022-02-02T18:21:32.897 INFO:tasks.workunit.client.0.smithi096.stdout:9/896: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f90 zero size 2022-02-02T18:21:32.898 INFO:tasks.workunit.client.0.smithi096.stdout:4/849: write d3/d60/d8d/da7/f6e [3852832,56665] 0 2022-02-02T18:21:32.901 INFO:tasks.workunit.client.0.smithi096.stdout:6/882: mknod d18/d24/d28/d4a/db8/df2/c142 0 2022-02-02T18:21:32.903 INFO:tasks.workunit.client.0.smithi096.stdout:8/838: mknod d29/d58/c11c 0 2022-02-02T18:21:32.904 INFO:tasks.workunit.client.0.smithi096.stdout:8/839: chown d29/d2d/c78 222848 1 2022-02-02T18:21:32.904 INFO:tasks.workunit.client.0.smithi096.stdout:7/838: getdents d9/df/d47/d37/d83/db1 0 2022-02-02T18:21:32.905 INFO:tasks.workunit.client.0.smithi096.stdout:8/840: truncate d29/d2d/f31 1359888 0 2022-02-02T18:21:32.907 INFO:tasks.workunit.client.0.smithi096.stdout:7/839: mkdir d9/df/d47/dd3/d11f 0 2022-02-02T18:21:32.908 INFO:tasks.workunit.client.0.smithi096.stdout:8/841: creat d29/d58/d7a/d116/f11d x:0 0 0 2022-02-02T18:21:32.908 INFO:tasks.workunit.client.0.smithi096.stdout:8/842: fsync f5 0 2022-02-02T18:21:32.908 INFO:tasks.workunit.client.0.smithi096.stdout:8/843: chown d29/d58/fd8 4370931 1 2022-02-02T18:21:32.909 INFO:tasks.workunit.client.0.smithi096.stdout:8/844: readlink l9 0 2022-02-02T18:21:32.909 INFO:tasks.workunit.client.0.smithi096.stdout:3/898: dwrite d2/df/d34/d76/dd3/d104/fb7 [0,4194304] 0 2022-02-02T18:21:32.911 INFO:tasks.workunit.client.0.smithi096.stdout:7/840: link d9/df/d12/d39/d46/d7d/f89 d9/df/d12/d39/d40/d6b/f120 0 2022-02-02T18:21:32.912 INFO:tasks.workunit.client.0.smithi096.stdout:8/845: creat d29/da7/d102/dcc/d5b/d81/f11e x:0 0 0 2022-02-02T18:21:32.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/997: dread d2/d5e/d6d/d79/d66/f68 [0,4194304] 0 2022-02-02T18:21:32.912 INFO:tasks.workunit.client.0.smithi096.stdout:9/897: dread d1/db/d48/de3/de5/f129 [0,4194304] 0 2022-02-02T18:21:32.914 INFO:tasks.workunit.client.0.smithi096.stdout:4/850: dread d3/d4/d20/d26/d36/d102/d109/df4/f9e [0,4194304] 0 2022-02-02T18:21:32.916 INFO:tasks.workunit.client.0.smithi096.stdout:2/998: truncate d2/d13/d43/d51/fc1 302200 0 2022-02-02T18:21:32.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/851: symlink d3/d4/d20/l11b 0 2022-02-02T18:21:32.920 INFO:tasks.workunit.client.0.smithi096.stdout:6/883: write d18/d50/d8f/dbb/f6a [1498809,120302] 0 2022-02-02T18:21:32.920 INFO:tasks.workunit.client.0.smithi096.stdout:6/884: creat d18/d50/d9a/d116/d120/f143 x:0 0 0 2022-02-02T18:21:32.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/885: creat d18/d50/d9a/d116/f144 x:0 0 0 2022-02-02T18:21:32.932 INFO:tasks.workunit.client.0.smithi096.stdout:1/905: dwrite d15/d1b/d26/d72/dff/d8a/fa6 [4194304,4194304] 0 2022-02-02T18:21:32.932 INFO:tasks.workunit.client.0.smithi096.stdout:9/898: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f10b [0,4194304] 0 2022-02-02T18:21:32.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/886: write d18/d50/d8f/df1/f10c [1928109,112236] 0 2022-02-02T18:21:32.933 INFO:tasks.workunit.client.0.smithi096.stdout:9/899: truncate d1/db/d1c/d2f/d78/f18 4038631 0 2022-02-02T18:21:32.934 INFO:tasks.workunit.client.0.smithi096.stdout:9/900: chown d1/db/d1c/d2f/d78/d11/d3c 837216 1 2022-02-02T18:21:32.934 INFO:tasks.workunit.client.0.smithi096.stdout:1/906: mknod d15/d1b/d26/d72/da3/da7/d140/c145 0 2022-02-02T18:21:32.936 INFO:tasks.workunit.client.0.smithi096.stdout:6/887: creat d18/d50/d8f/dbb/f145 x:0 0 0 2022-02-02T18:21:32.937 INFO:tasks.workunit.client.0.smithi096.stdout:6/888: fdatasync d18/d50/d6d/f124 0 2022-02-02T18:21:32.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/889: mkdir d18/d24/d73/d146 0 2022-02-02T18:21:32.941 INFO:tasks.workunit.client.0.smithi096.stdout:9/901: write d1/db/d1c/d2f/d78/d11/f30 [3215662,117613] 0 2022-02-02T18:21:32.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/852: dread d3/d4/d20/d26/d36/d102/d109/ff5 [0,4194304] 0 2022-02-02T18:21:32.943 INFO:tasks.workunit.client.0.smithi096.stdout:3/899: dwrite d2/df/d14/d2c/d31/f47 [0,4194304] 0 2022-02-02T18:21:32.943 INFO:tasks.workunit.client.0.smithi096.stdout:9/902: write d1/db/d1c/d2f/d78/d11/d3c/f79 [1921294,76256] 0 2022-02-02T18:21:32.944 INFO:tasks.workunit.client.0.smithi096.stdout:8/846: dwrite d29/d2d/d47/fff [0,4194304] 0 2022-02-02T18:21:32.945 INFO:tasks.workunit.client.0.smithi096.stdout:3/900: rename d2/df/d14/d2c/d74/df3/c10e to d2/d71/c12a 0 2022-02-02T18:21:32.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/901: creat d2/df/d20/d4a/f12b x:0 0 0 2022-02-02T18:21:32.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/902: chown d2/df/d14/l70 463 1 2022-02-02T18:21:32.946 INFO:tasks.workunit.client.0.smithi096.stdout:7/841: dwrite d9/df/d12/d39/d40/d6b/f120 [0,4194304] 0 2022-02-02T18:21:32.948 INFO:tasks.workunit.client.0.smithi096.stdout:3/903: write d2/df/d20/fef [1071822,88894] 0 2022-02-02T18:21:32.950 INFO:tasks.workunit.client.0.smithi096.stdout:8/847: symlink d29/d2d/d87/da5/deb/l11f 0 2022-02-02T18:21:32.951 INFO:tasks.workunit.client.0.smithi096.stdout:8/848: chown d29/da7/d102/db3/c4f 0 1 2022-02-02T18:21:32.951 INFO:tasks.workunit.client.0.smithi096.stdout:8/849: fsync d29/da7/d102/dcc/d5b/fb2 0 2022-02-02T18:21:32.952 INFO:tasks.workunit.client.0.smithi096.stdout:8/850: write d29/da7/d102/dcc/d5b/d81/f8d [4423332,120731] 0 2022-02-02T18:21:32.952 INFO:tasks.workunit.client.0.smithi096.stdout:1/907: dread d15/d1b/d26/d72/da3/da7/ddc/f94 [0,4194304] 0 2022-02-02T18:21:32.953 INFO:tasks.workunit.client.0.smithi096.stdout:9/903: write d1/db/f72 [7787962,66730] 0 2022-02-02T18:21:32.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/904: chown d1/db/d1c/d2f/d78/d11/d1e/d47/f98 38626 1 2022-02-02T18:21:32.957 INFO:tasks.workunit.client.0.smithi096.stdout:1/908: creat d15/d1b/d28/d47/f146 x:0 0 0 2022-02-02T18:21:32.957 INFO:tasks.workunit.client.0.smithi096.stdout:7/842: symlink d9/df/d16/l121 0 2022-02-02T18:21:32.957 INFO:tasks.workunit.client.0.smithi096.stdout:1/909: chown d15/d1b/d26/d72/dff/d8a/fd8 165331 1 2022-02-02T18:21:32.959 INFO:tasks.workunit.client.0.smithi096.stdout:3/904: dread d2/f9e [0,4194304] 0 2022-02-02T18:21:32.959 INFO:tasks.workunit.client.0.smithi096.stdout:3/905: readlink d2/df/d1c/d5d/lcc 0 2022-02-02T18:21:32.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/905: truncate d1/db/d1c/d2f/d78/d11/d1e/d66/dbf/fcc 3453131 0 2022-02-02T18:21:32.960 INFO:tasks.workunit.client.0.smithi096.stdout:1/910: symlink d15/d1b/d28/d2c/d39/l147 0 2022-02-02T18:21:32.960 INFO:tasks.workunit.client.0.smithi096.stdout:1/911: readlink d15/d1b/d26/l35 0 2022-02-02T18:21:32.961 INFO:tasks.workunit.client.0.smithi096.stdout:9/906: readlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/l52 0 2022-02-02T18:21:32.961 INFO:tasks.workunit.client.0.smithi096.stdout:1/912: fdatasync d15/d1b/d28/d114/fbb 0 2022-02-02T18:21:32.961 INFO:tasks.workunit.client.0.smithi096.stdout:9/907: fsync d1/db/d1c/d2f/d78/d11/d1e/f9e 0 2022-02-02T18:21:32.961 INFO:tasks.workunit.client.0.smithi096.stdout:7/843: mkdir d9/df/d12/d39/d40/d122 0 2022-02-02T18:21:32.962 INFO:tasks.workunit.client.0.smithi096.stdout:7/844: mknod d9/df/d47/d37/c123 0 2022-02-02T18:21:32.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/845: creat d9/df/d47/d19/f124 x:0 0 0 2022-02-02T18:21:32.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/846: fsync d9/df/d12/d39/d40/d85/ffd 0 2022-02-02T18:21:32.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/847: readlink d9/df/d12/d39/d4e/l118 0 2022-02-02T18:21:32.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/848: dread - d9/df/d47/d37/d83/db1/f106 zero size 2022-02-02T18:21:32.969 INFO:tasks.workunit.client.0.smithi096.stdout:6/890: dwrite d18/ffa [0,4194304] 0 2022-02-02T18:21:32.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/851: dwrite d29/da7/d102/dcc/d5b/fbb [0,4194304] 0 2022-02-02T18:21:32.973 INFO:tasks.workunit.client.0.smithi096.stdout:6/891: write d18/d50/d6d/f102 [3849355,93917] 0 2022-02-02T18:21:32.973 INFO:tasks.workunit.client.0.smithi096.stdout:6/892: dread - d18/d50/f12e zero size 2022-02-02T18:21:32.976 INFO:tasks.workunit.client.0.smithi096.stdout:9/908: dwrite d1/f8 [4194304,4194304] 0 2022-02-02T18:21:32.977 INFO:tasks.workunit.client.0.smithi096.stdout:8/852: link d29/da7/d102/db3/d6d/la3 d29/da7/d102/dc2/l120 0 2022-02-02T18:21:32.979 INFO:tasks.workunit.client.0.smithi096.stdout:9/909: read d1/db/d1c/d2f/f3b [825204,24548] 0 2022-02-02T18:21:32.979 INFO:tasks.workunit.client.0.smithi096.stdout:6/893: mknod d18/d50/d6d/c147 0 2022-02-02T18:21:32.980 INFO:tasks.workunit.client.0.smithi096.stdout:6/894: dread d18/d50/d8f/fa4 [0,4194304] 0 2022-02-02T18:21:32.980 INFO:tasks.workunit.client.0.smithi096.stdout:6/895: dread - d18/d50/d9a/d116/d120/f143 zero size 2022-02-02T18:21:32.981 INFO:tasks.workunit.client.0.smithi096.stdout:1/913: rmdir d15/d1b/d28/d47 39 2022-02-02T18:21:32.982 INFO:tasks.workunit.client.0.smithi096.stdout:7/849: rmdir d9/df/d12 39 2022-02-02T18:21:32.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/850: dread - d9/df/d47/d19/f124 zero size 2022-02-02T18:21:32.985 INFO:tasks.workunit.client.0.smithi096.stdout:8/853: creat d29/da7/d102/db3/d6d/d85/f121 x:0 0 0 2022-02-02T18:21:32.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/910: truncate d1/f34 998097 0 2022-02-02T18:21:32.987 INFO:tasks.workunit.client.0.smithi096.stdout:9/911: fdatasync d1/db/d1c/d2f/f127 0 2022-02-02T18:21:32.987 INFO:tasks.workunit.client.0.smithi096.stdout:9/912: chown d1/db/d1c/d2f/d78/d131/lef 9686058 1 2022-02-02T18:21:32.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/851: creat d9/df/d12/d39/d40/d6b/f125 x:0 0 0 2022-02-02T18:21:32.989 INFO:tasks.workunit.client.0.smithi096.stdout:7/852: chown d9/df/d12/d39/d41/ffc 313 1 2022-02-02T18:21:32.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/914: getdents d15/d67 0 2022-02-02T18:21:32.993 INFO:tasks.workunit.client.0.smithi096.stdout:7/853: creat d9/df/d44/f126 x:0 0 0 2022-02-02T18:21:32.993 INFO:tasks.workunit.client.0.smithi096.stdout:7/854: getdents d9/df/d16/d25/d98/d105 0 2022-02-02T18:21:32.994 INFO:tasks.workunit.client.0.smithi096.stdout:7/855: chown f2 3 1 2022-02-02T18:21:32.998 INFO:tasks.workunit.client.0.smithi096.stdout:7/856: rmdir d9/df/d12/d39/d40/d51 39 2022-02-02T18:21:33.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/857: link d9/df/c23 d9/df/d12/d39/d40/d85/c127 0 2022-02-02T18:21:33.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/858: dread d9/df/d16/d25/fad [0,4194304] 0 2022-02-02T18:21:33.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/859: chown d9/df/d12/d39/d42/f5a 365 1 2022-02-02T18:21:33.014 INFO:tasks.workunit.client.0.smithi096.stdout:7/860: creat d9/df/d47/d37/d83/db4/f128 x:0 0 0 2022-02-02T18:21:33.015 INFO:tasks.workunit.client.0.smithi096.stdout:7/861: rename d9/df/d44/c100 to d9/df/d12/d39/d46/c129 0 2022-02-02T18:21:33.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/913: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f57 [0,4194304] 0 2022-02-02T18:21:33.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/914: chown d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6 1863680 1 2022-02-02T18:21:33.016 INFO:tasks.workunit.client.0.smithi096.stdout:1/915: dwrite d15/f22 [0,4194304] 0 2022-02-02T18:21:33.017 INFO:tasks.workunit.client.0.smithi096.stdout:7/862: rename d9/df/d12/d39/d46/da4/f109 to d9/df/d12/d39/d4e/f12a 0 2022-02-02T18:21:33.017 INFO:tasks.workunit.client.0.smithi096.stdout:6/896: dwrite d18/d24/d73/d79/f93 [0,4194304] 0 2022-02-02T18:21:33.017 INFO:tasks.workunit.client.0.smithi096.stdout:6/897: chown d18/d24/d28/l46 370 1 2022-02-02T18:21:33.018 INFO:tasks.workunit.client.0.smithi096.stdout:8/854: dwrite f1a [0,4194304] 0 2022-02-02T18:21:33.018 INFO:tasks.workunit.client.0.smithi096.stdout:8/855: readlink d29/d2d/d87/lb8 0 2022-02-02T18:21:33.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/915: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/c132 0 2022-02-02T18:21:33.020 INFO:tasks.workunit.client.0.smithi096.stdout:1/916: link d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d13e/f141 d15/d1b/d26/d72/dff/d8a/db9/f148 0 2022-02-02T18:21:33.021 INFO:tasks.workunit.client.0.smithi096.stdout:1/917: fsync d15/d1b/d26/d72/da3/da7/db6/fd7 0 2022-02-02T18:21:33.021 INFO:tasks.workunit.client.0.smithi096.stdout:7/863: getdents d9/df/d12/d39/d41/dac 0 2022-02-02T18:21:33.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/864: chown d9/df/d12/d39/d46/f7e 6727 1 2022-02-02T18:21:33.024 INFO:tasks.workunit.client.0.smithi096.stdout:6/898: rename d18/d50/d6d/d113/f134 to d18/d24/f148 0 2022-02-02T18:21:33.025 INFO:tasks.workunit.client.0.smithi096.stdout:8/856: mknod d29/d2d/d87/c122 0 2022-02-02T18:21:33.025 INFO:tasks.workunit.client.0.smithi096.stdout:6/899: mknod d18/d24/d28/d3e/c149 0 2022-02-02T18:21:33.027 INFO:tasks.workunit.client.0.smithi096.stdout:6/900: mknod d18/d24/d28/c14a 0 2022-02-02T18:21:33.030 INFO:tasks.workunit.client.0.smithi096.stdout:6/901: creat d18/d24/d28/d4a/db8/f14b x:0 0 0 2022-02-02T18:21:33.036 INFO:tasks.workunit.client.0.smithi096.stdout:6/902: truncate d18/f8a 1891925 0 2022-02-02T18:21:33.037 INFO:tasks.workunit.client.0.smithi096.stdout:6/903: chown d18/d24/d28/d4a/db8/le4 11478535 1 2022-02-02T18:21:33.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/918: dread d15/f107 [0,4194304] 0 2022-02-02T18:21:33.039 INFO:tasks.workunit.client.0.smithi096.stdout:1/919: symlink d15/d4d/l149 0 2022-02-02T18:21:33.050 INFO:tasks.workunit.client.0.smithi096.stdout:9/916: dwrite d1/db/d63/da2/fa9 [0,4194304] 0 2022-02-02T18:21:33.059 INFO:tasks.workunit.client.0.smithi096.stdout:7/865: dwrite d9/df/d12/d39/d4e/f8c [0,4194304] 0 2022-02-02T18:21:33.059 INFO:tasks.workunit.client.0.smithi096.stdout:8/857: dwrite d29/fbf [0,4194304] 0 2022-02-02T18:21:33.059 INFO:tasks.workunit.client.0.smithi096.stdout:8/858: write d29/d58/ff2 [1546393,16601] 0 2022-02-02T18:21:33.060 INFO:tasks.workunit.client.0.smithi096.stdout:8/859: truncate d29/da7/d102/db3/d6d/d85/f86 2180025 0 2022-02-02T18:21:33.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/917: creat d1/db/d1c/d2f/d78/d11/d3c/f133 x:0 0 0 2022-02-02T18:21:33.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/918: write d1/db/d1c/d2f/d78/d11/fb1 [2086680,78218] 0 2022-02-02T18:21:33.062 INFO:tasks.workunit.client.0.smithi096.stdout:7/866: creat d9/df/d12/d39/d40/d11a/f12b x:0 0 0 2022-02-02T18:21:33.062 INFO:tasks.workunit.client.0.smithi096.stdout:7/867: readlink d9/df/d12/d14/d82/lee 0 2022-02-02T18:21:33.063 INFO:tasks.workunit.client.0.smithi096.stdout:7/868: fdatasync d9/df/d12/d39/d42/f5b 0 2022-02-02T18:21:33.063 INFO:tasks.workunit.client.0.smithi096.stdout:6/904: dwrite d18/d24/d28/d4a/db8/fd6 [0,4194304] 0 2022-02-02T18:21:33.064 INFO:tasks.workunit.client.0.smithi096.stdout:8/860: mknod d29/da7/d102/dcc/d5b/dca/c123 0 2022-02-02T18:21:33.064 INFO:tasks.workunit.client.0.smithi096.stdout:8/861: fsync d29/d2d/d47/fa2 0 2022-02-02T18:21:33.064 INFO:tasks.workunit.client.0.smithi096.stdout:8/862: chown d29/f33 7720 1 2022-02-02T18:21:33.065 INFO:tasks.workunit.client.0.smithi096.stdout:8/863: write d29/d58/d7a/f91 [874296,85579] 0 2022-02-02T18:21:33.065 INFO:tasks.workunit.client.0.smithi096.stdout:1/920: dwrite d15/d1b/d26/d72/da3/da7/ddc/f7a [0,4194304] 0 2022-02-02T18:21:33.082 INFO:tasks.workunit.client.0.smithi096.stdout:6/905: dread d18/d50/d6d/fc6 [0,4194304] 0 2022-02-02T18:21:33.082 INFO:tasks.workunit.client.0.smithi096.stdout:9/919: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d [0,4194304] 0 2022-02-02T18:21:33.085 INFO:tasks.workunit.client.0.smithi096.stdout:6/906: creat d18/d50/d9a/d116/d118/f14c x:0 0 0 2022-02-02T18:21:33.085 INFO:tasks.workunit.client.0.smithi096.stdout:6/907: truncate d18/d24/d28/d4a/db8/f14b 536770 0 2022-02-02T18:21:33.086 INFO:tasks.workunit.client.0.smithi096.stdout:9/920: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/ld0 0 2022-02-02T18:21:33.086 INFO:tasks.workunit.client.0.smithi096.stdout:9/921: creat d1/db/d1c/d2f/d78/d11/d1e/d47/f134 x:0 0 0 2022-02-02T18:21:33.086 INFO:tasks.workunit.client.0.smithi096.stdout:9/922: write d1/f34 [1476275,3029] 0 2022-02-02T18:21:33.088 INFO:tasks.workunit.client.0.smithi096.stdout:9/923: fsync d1/db/d1c/d2f/d78/d11/f30 0 2022-02-02T18:21:33.088 INFO:tasks.workunit.client.0.smithi096.stdout:6/908: creat d18/d24/d28/f14d x:0 0 0 2022-02-02T18:21:33.088 INFO:tasks.workunit.client.0.smithi096.stdout:6/909: creat d18/d50/d9a/d116/f14e x:0 0 0 2022-02-02T18:21:33.093 INFO:tasks.workunit.client.0.smithi096.stdout:5/850: sync 2022-02-02T18:21:33.094 INFO:tasks.workunit.client.0.smithi096.stdout:5/851: fsync db/d5c/f5e 0 2022-02-02T18:21:33.094 INFO:tasks.workunit.client.0.smithi096.stdout:5/852: getdents db/de/d10 0 2022-02-02T18:21:33.095 INFO:tasks.workunit.client.0.smithi096.stdout:5/853: creat db/de/d10/d25/d4c/dd8/def/dc2/dfa/f128 x:0 0 0 2022-02-02T18:21:33.096 INFO:tasks.workunit.client.0.smithi096.stdout:5/854: mkdir db/d5c/d60/da7/de2/d129 0 2022-02-02T18:21:33.098 INFO:tasks.workunit.client.0.smithi096.stdout:5/855: rename db/d5c/d60/da7/fc6 to db/de/f12a 0 2022-02-02T18:21:33.099 INFO:tasks.workunit.client.0.smithi096.stdout:7/869: dwrite d9/df/d47/d37/d83/d11c/f9f [0,4194304] 0 2022-02-02T18:21:33.099 INFO:tasks.workunit.client.0.smithi096.stdout:7/870: fdatasync d9/df/d12/d39/d4e/f12a 0 2022-02-02T18:21:33.099 INFO:tasks.workunit.client.0.smithi096.stdout:8/864: dwrite d29/da7/d102/db3/f49 [0,4194304] 0 2022-02-02T18:21:33.101 INFO:tasks.workunit.client.0.smithi096.stdout:5/856: creat db/de/d10/f12b x:0 0 0 2022-02-02T18:21:33.101 INFO:tasks.workunit.client.0.smithi096.stdout:8/865: read d29/d58/d63/fc3 [904416,96919] 0 2022-02-02T18:21:33.101 INFO:tasks.workunit.client.0.smithi096.stdout:1/921: dwrite f13 [4194304,4194304] 0 2022-02-02T18:21:33.102 INFO:tasks.workunit.client.0.smithi096.stdout:6/910: dread d18/d24/f36 [0,4194304] 0 2022-02-02T18:21:33.102 INFO:tasks.workunit.client.0.smithi096.stdout:7/871: link d9/df/d47/d19/f1e d9/df/d47/dd3/f12c 0 2022-02-02T18:21:33.103 INFO:tasks.workunit.client.0.smithi096.stdout:5/857: mknod db/d5c/d60/da7/de2/d10b/c12c 0 2022-02-02T18:21:33.104 INFO:tasks.workunit.client.0.smithi096.stdout:6/911: mkdir d18/d24/d28/d4a/db8/d14f 0 2022-02-02T18:21:33.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/872: symlink d9/df/d12/d14/l12d 0 2022-02-02T18:21:33.107 INFO:tasks.workunit.client.0.smithi096.stdout:6/912: link d18/d24/d73/d79/ccd d18/d50/d8f/dbb/d63/db3/c150 0 2022-02-02T18:21:33.109 INFO:tasks.workunit.client.0.smithi096.stdout:7/873: rename d9/df/d12/d39/d46/f7e to d9/df/d12/d39/d40/d122/f12e 0 2022-02-02T18:21:33.111 INFO:tasks.workunit.client.0.smithi096.stdout:6/913: creat d18/d50/d9a/d131/f151 x:0 0 0 2022-02-02T18:21:33.113 INFO:tasks.workunit.client.0.smithi096.stdout:7/874: rmdir d9/df/d47/d37/d83/d11c/da5 39 2022-02-02T18:21:33.116 INFO:tasks.workunit.client.0.smithi096.stdout:6/914: getdents d18/d50/d9a/d116 0 2022-02-02T18:21:33.117 INFO:tasks.workunit.client.0.smithi096.stdout:6/915: write d18/d50/d8f/df1/f10c [5078529,118039] 0 2022-02-02T18:21:33.117 INFO:tasks.workunit.client.0.smithi096.stdout:6/916: write d18/f23 [338055,22471] 0 2022-02-02T18:21:33.119 INFO:tasks.workunit.client.0.smithi096.stdout:6/917: rename d18/d50/d8f/dbb/d63/db3/ded/lf7 to d18/d24/d73/dfb/de8/l152 0 2022-02-02T18:21:33.120 INFO:tasks.workunit.client.0.smithi096.stdout:6/918: mknod d18/d24/d28/c153 0 2022-02-02T18:21:33.120 INFO:tasks.workunit.client.0.smithi096.stdout:6/919: chown d18/d50/d8f/dbb/d63/dc2/f111 15 1 2022-02-02T18:21:33.122 INFO:tasks.workunit.client.0.smithi096.stdout:6/920: rename d18/l1d to d18/d50/d8f/dbb/d63/db3/l154 0 2022-02-02T18:21:33.123 INFO:tasks.workunit.client.0.smithi096.stdout:1/922: dwrite d15/d1b/d26/d72/dff/d8a/db9/fda [0,4194304] 0 2022-02-02T18:21:33.124 INFO:tasks.workunit.client.0.smithi096.stdout:1/923: readlink d15/l1f 0 2022-02-02T18:21:33.125 INFO:tasks.workunit.client.0.smithi096.stdout:6/921: creat d18/d24/d28/d4a/db8/d14f/f155 x:0 0 0 2022-02-02T18:21:33.125 INFO:tasks.workunit.client.0.smithi096.stdout:6/922: fsync d18/d24/d28/d4a/db8/fd6 0 2022-02-02T18:21:33.126 INFO:tasks.workunit.client.0.smithi096.stdout:6/923: truncate d18/d24/d28/d4a/db8/f14b 599514 0 2022-02-02T18:21:33.126 INFO:tasks.workunit.client.0.smithi096.stdout:5/858: dwrite db/de/d10/f18 [4194304,4194304] 0 2022-02-02T18:21:33.127 INFO:tasks.workunit.client.0.smithi096.stdout:5/859: readlink db/d5c/d61/l77 0 2022-02-02T18:21:33.127 INFO:tasks.workunit.client.0.smithi096.stdout:5/860: chown db/d5c/d32 757707 1 2022-02-02T18:21:33.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/875: dread d9/f8d [4194304,4194304] 0 2022-02-02T18:21:33.128 INFO:tasks.workunit.client.0.smithi096.stdout:1/924: rename d15/d1b/d28/d2c/d39/d71/f124 to d15/d4d/f14a 0 2022-02-02T18:21:33.130 INFO:tasks.workunit.client.0.smithi096.stdout:6/924: mkdir d18/d24/d73/d146/d156 0 2022-02-02T18:21:33.130 INFO:tasks.workunit.client.0.smithi096.stdout:6/925: write d18/d50/d9a/d116/f144 [989681,16344] 0 2022-02-02T18:21:33.130 INFO:tasks.workunit.client.0.smithi096.stdout:6/926: readlink d18/d24/d28/l7d 0 2022-02-02T18:21:33.131 INFO:tasks.workunit.client.0.smithi096.stdout:5/861: symlink db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d105/l12d 0 2022-02-02T18:21:33.132 INFO:tasks.workunit.client.0.smithi096.stdout:7/876: rename d9/df/d47/d37/d83/db1/fc2 to d9/df/d47/d37/d83/d11c/f12f 0 2022-02-02T18:21:33.132 INFO:tasks.workunit.client.0.smithi096.stdout:7/877: getdents d9/df/d47/dd3/d11f 0 2022-02-02T18:21:33.133 INFO:tasks.workunit.client.0.smithi096.stdout:1/925: mknod d15/d1b/c14b 0 2022-02-02T18:21:33.135 INFO:tasks.workunit.client.0.smithi096.stdout:6/927: symlink d18/d24/d28/d4a/db8/l157 0 2022-02-02T18:21:33.136 INFO:tasks.workunit.client.0.smithi096.stdout:6/928: write d18/d50/d9a/fdd [4952218,2956] 0 2022-02-02T18:21:33.136 INFO:tasks.workunit.client.0.smithi096.stdout:5/862: mknod db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d105/c12e 0 2022-02-02T18:21:33.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/863: write db/d5c/d2f/db7/f122 [613417,96284] 0 2022-02-02T18:21:33.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/864: creat db/d5c/d60/da7/f12f x:0 0 0 2022-02-02T18:21:33.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/865: write db/d5c/f9c [1828898,79265] 0 2022-02-02T18:21:33.138 INFO:tasks.workunit.client.0.smithi096.stdout:5/866: write db/de/d10/d27/ff1 [1076194,26181] 0 2022-02-02T18:21:33.138 INFO:tasks.workunit.client.0.smithi096.stdout:1/926: rename d15/d1b/d26/d72/da3/da7/ddc/cc8 to d15/d1b/d26/d72/da3/da7/db6/c14c 0 2022-02-02T18:21:33.139 INFO:tasks.workunit.client.0.smithi096.stdout:1/927: write d15/d1b/d28/d2c/d4f/d51/fc3 [1034976,58808] 0 2022-02-02T18:21:33.139 INFO:tasks.workunit.client.0.smithi096.stdout:1/928: stat d15/d1b/d28/d47/f143 0 2022-02-02T18:21:33.139 INFO:tasks.workunit.client.0.smithi096.stdout:6/929: creat d18/d24/d28/d4a/d9d/f158 x:0 0 0 2022-02-02T18:21:33.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/867: symlink db/de/d10/d27/d83/l130 0 2022-02-02T18:21:33.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/868: fdatasync db/de/d10/d80/fb0 0 2022-02-02T18:21:33.142 INFO:tasks.workunit.client.0.smithi096.stdout:1/929: mkdir d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d14d 0 2022-02-02T18:21:33.142 INFO:tasks.workunit.client.0.smithi096.stdout:6/930: truncate d18/d24/f4d 88963 0 2022-02-02T18:21:33.142 INFO:tasks.workunit.client.0.smithi096.stdout:5/869: creat db/de/d10/d25/d4c/dd8/f131 x:0 0 0 2022-02-02T18:21:33.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/931: rename d18/d50/d8f/dc4/dbd/d137 to d18/d50/d6d/d159 0 2022-02-02T18:21:33.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/932: write d18/d24/d28/d4a/db8/f119 [754443,102369] 0 2022-02-02T18:21:33.145 INFO:tasks.workunit.client.0.smithi096.stdout:6/933: write d18/d24/d28/d4a/db8/f119 [1380937,77194] 0 2022-02-02T18:21:33.145 INFO:tasks.workunit.client.0.smithi096.stdout:1/930: getdents d15/d1b/d28/d2c/d4f/d51 0 2022-02-02T18:21:33.146 INFO:tasks.workunit.client.0.smithi096.stdout:6/934: getdents d18/d24/d73/d79 0 2022-02-02T18:21:33.147 INFO:tasks.workunit.client.0.smithi096.stdout:1/931: rename d15/d1b/d26/d72/dff/d8a/fa6 to d15/d1b/d26/d72/da3/da7/d12e/f14e 0 2022-02-02T18:21:33.147 INFO:tasks.workunit.client.0.smithi096.stdout:1/932: chown d15/d1b/d26/d72/da3/da7 1294770047 1 2022-02-02T18:21:33.148 INFO:tasks.workunit.client.0.smithi096.stdout:6/935: creat d18/d24/d73/dfb/f15a x:0 0 0 2022-02-02T18:21:33.149 INFO:tasks.workunit.client.0.smithi096.stdout:6/936: chown d18/d50/d8f/dbb/f3b 0 1 2022-02-02T18:21:33.150 INFO:tasks.workunit.client.0.smithi096.stdout:5/870: dread db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:33.151 INFO:tasks.workunit.client.0.smithi096.stdout:7/878: dwrite d9/df/d12/d39/d40/d51/fa6 [0,4194304] 0 2022-02-02T18:21:33.155 INFO:tasks.workunit.client.0.smithi096.stdout:5/871: mkdir db/da1/dcc/d112/d132 0 2022-02-02T18:21:33.158 INFO:tasks.workunit.client.0.smithi096.stdout:7/879: creat d9/df/d47/dd3/d11f/f130 x:0 0 0 2022-02-02T18:21:33.158 INFO:tasks.workunit.client.0.smithi096.stdout:7/880: stat d9/df/d12/d39/d46/d7d/dd7/f114 0 2022-02-02T18:21:33.159 INFO:tasks.workunit.client.0.smithi096.stdout:5/872: mkdir db/de/d10/d133 0 2022-02-02T18:21:33.163 INFO:tasks.workunit.client.0.smithi096.stdout:7/881: creat d9/df/d12/d39/d40/d122/f131 x:0 0 0 2022-02-02T18:21:33.163 INFO:tasks.workunit.client.0.smithi096.stdout:7/882: dread - d9/df/d47/db7/de3/f102 zero size 2022-02-02T18:21:33.166 INFO:tasks.workunit.client.0.smithi096.stdout:5/873: unlink db/d5c/d2f/c92 0 2022-02-02T18:21:33.168 INFO:tasks.workunit.client.0.smithi096.stdout:7/883: rename d9/df/d54/f99 to d9/df/d12/d39/f132 0 2022-02-02T18:21:33.168 INFO:tasks.workunit.client.0.smithi096.stdout:7/884: chown d9/df/d16/d25/cc7 360467 1 2022-02-02T18:21:33.170 INFO:tasks.workunit.client.0.smithi096.stdout:7/885: mknod d9/c133 0 2022-02-02T18:21:33.170 INFO:tasks.workunit.client.0.smithi096.stdout:7/886: chown d9/df/d16/d25/d98 298747 1 2022-02-02T18:21:33.170 INFO:tasks.workunit.client.0.smithi096.stdout:6/937: dread d18/f19 [0,4194304] 0 2022-02-02T18:21:33.171 INFO:tasks.workunit.client.0.smithi096.stdout:1/933: dwrite d15/d1b/d26/d72/da3/da7/ffd [0,4194304] 0 2022-02-02T18:21:33.174 INFO:tasks.workunit.client.0.smithi096.stdout:5/874: dread db/de/d2e/d35/f81 [0,4194304] 0 2022-02-02T18:21:33.176 INFO:tasks.workunit.client.0.smithi096.stdout:6/938: creat d18/d24/d73/dfb/de8/f15b x:0 0 0 2022-02-02T18:21:33.177 INFO:tasks.workunit.client.0.smithi096.stdout:5/875: rename db/l8d to db/da1/dcc/d112/d132/l134 0 2022-02-02T18:21:33.181 INFO:tasks.workunit.client.0.smithi096.stdout:6/939: mkdir d18/d50/d8f/dbb/d63/dc2/d15c 0 2022-02-02T18:21:33.198 INFO:tasks.workunit.client.0.smithi096.stdout:1/934: dwrite d15/d1b/d28/d2c/d4f/d51/f101 [0,4194304] 0 2022-02-02T18:21:33.199 INFO:tasks.workunit.client.0.smithi096.stdout:1/935: write d15/d1b/d28/fc6 [2257704,38815] 0 2022-02-02T18:21:33.204 INFO:tasks.workunit.client.0.smithi096.stdout:6/940: dwrite d18/d24/d28/d3e/f128 [0,4194304] 0 2022-02-02T18:21:33.205 INFO:tasks.workunit.client.0.smithi096.stdout:6/941: creat d18/d50/f15d x:0 0 0 2022-02-02T18:21:33.205 INFO:tasks.workunit.client.0.smithi096.stdout:6/942: write d18/d50/f122 [4515443,10937] 0 2022-02-02T18:21:33.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/876: dwrite db/de/d10/f98 [0,4194304] 0 2022-02-02T18:21:33.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/877: fdatasync db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/f102 0 2022-02-02T18:21:33.206 INFO:tasks.workunit.client.0.smithi096.stdout:6/943: read d18/f3a [2013721,89841] 0 2022-02-02T18:21:33.207 INFO:tasks.workunit.client.0.smithi096.stdout:6/944: dread d18/d50/d8f/dbb/f53 [0,4194304] 0 2022-02-02T18:21:33.212 INFO:tasks.workunit.client.0.smithi096.stdout:2/999: sync 2022-02-02T18:21:33.215 INFO:tasks.workunit.client.0.smithi096.stdout:6/945: mkdir d18/d24/d15e 0 2022-02-02T18:21:33.216 INFO:tasks.workunit.client.0.smithi096.stdout:6/946: mknod d18/d50/d8f/dbb/d63/db3/ded/c15f 0 2022-02-02T18:21:33.217 INFO:tasks.workunit.client.0.smithi096.stdout:6/947: creat d18/f160 x:0 0 0 2022-02-02T18:21:33.218 INFO:tasks.workunit.client.0.smithi096.stdout:6/948: symlink d18/d50/d9a/d131/l161 0 2022-02-02T18:21:33.219 INFO:tasks.workunit.client.0.smithi096.stdout:6/949: truncate d18/d24/d73/d79/fc1 1351658 0 2022-02-02T18:21:33.219 INFO:tasks.workunit.client.0.smithi096.stdout:6/950: creat d18/d50/d8f/dbb/d63/dc2/d15c/f162 x:0 0 0 2022-02-02T18:21:33.220 INFO:tasks.workunit.client.0.smithi096.stdout:6/951: readlink l13 0 2022-02-02T18:21:33.221 INFO:tasks.workunit.client.0.smithi096.stdout:6/952: getdents d18/d50 0 2022-02-02T18:21:33.222 INFO:tasks.workunit.client.0.smithi096.stdout:6/953: creat d18/f163 x:0 0 0 2022-02-02T18:21:33.223 INFO:tasks.workunit.client.0.smithi096.stdout:6/954: rename d18/d50/d6d/l84 to d18/d24/d73/d79/l164 0 2022-02-02T18:21:33.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/955: mkdir d18/d165 0 2022-02-02T18:21:33.225 INFO:tasks.workunit.client.0.smithi096.stdout:6/956: write d18/f1a [5104218,125192] 0 2022-02-02T18:21:33.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/957: mknod d18/d24/d28/d3e/c166 0 2022-02-02T18:21:33.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/958: write d18/d50/d8f/fa4 [642416,94132] 0 2022-02-02T18:21:33.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/959: chown d18/d50/d8f/dbb/d63/db3/db5/le9 5 1 2022-02-02T18:21:33.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/960: dread - d18/d50/d9a/d116/d118/f14c zero size 2022-02-02T18:21:33.230 INFO:tasks.workunit.client.0.smithi096.stdout:6/961: mkdir d18/d24/d73/d167 0 2022-02-02T18:21:33.231 INFO:tasks.workunit.client.0.smithi096.stdout:6/962: readlink d18/d24/d28/ld2 0 2022-02-02T18:21:33.231 INFO:tasks.workunit.client.0.smithi096.stdout:6/963: chown d18/d24/d28/d4a/d9d/f158 6013 1 2022-02-02T18:21:33.231 INFO:tasks.workunit.client.0.smithi096.stdout:6/964: chown d18/d50/d8f/dc4/dbd 3328 1 2022-02-02T18:21:33.231 INFO:tasks.workunit.client.0.smithi096.stdout:6/965: dread d18/d50/d8f/dbb/f43 [0,4194304] 0 2022-02-02T18:21:33.232 INFO:tasks.workunit.client.0.smithi096.stdout:6/966: symlink d18/d24/d73/d79/l168 0 2022-02-02T18:21:33.233 INFO:tasks.workunit.client.0.smithi096.stdout:6/967: rename d18/d24/d28/d3e/c7f to d18/d50/d8f/dbb/c169 0 2022-02-02T18:21:33.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/968: rename d18/d50/d8f/dc4/dbd/l125 to d18/d165/l16a 0 2022-02-02T18:21:33.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/969: chown d18/d24/d73/d79/fd3 558498047 1 2022-02-02T18:21:33.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/970: dread - d18/d50/d9a/d116/f138 zero size 2022-02-02T18:21:33.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/971: creat d18/d50/d8f/dbb/d63/db3/d12d/f16b x:0 0 0 2022-02-02T18:21:33.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/972: dread d18/f49 [0,4194304] 0 2022-02-02T18:21:33.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/973: chown d18/d50/d8f/dbb/d63/dc2/d117/c121 3955 1 2022-02-02T18:21:33.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/906: sync 2022-02-02T18:21:33.250 INFO:tasks.workunit.client.0.smithi096.stdout:4/853: sync 2022-02-02T18:21:33.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/854: mkdir d3/d4/d20/d26/d36/d102/d109/dfb/d10f/d11c 0 2022-02-02T18:21:33.252 INFO:tasks.workunit.client.0.smithi096.stdout:3/907: symlink d2/df/d34/d76/dd3/l12c 0 2022-02-02T18:21:33.252 INFO:tasks.workunit.client.0.smithi096.stdout:3/908: creat d2/df/d14/d73/f12d x:0 0 0 2022-02-02T18:21:33.253 INFO:tasks.workunit.client.0.smithi096.stdout:3/909: write d2/df/d20/d33/d58/d7c/fa5 [665073,30908] 0 2022-02-02T18:21:33.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/855: truncate d3/d4/d50/fa2 974883 0 2022-02-02T18:21:33.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/856: read d3/d4/d20/d26/d36/d51/f86 [889160,22472] 0 2022-02-02T18:21:33.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/857: chown d3/d4/d20/d4d 311546 1 2022-02-02T18:21:33.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/858: readlink d3/d4/d20/l82 0 2022-02-02T18:21:33.255 INFO:tasks.workunit.client.0.smithi096.stdout:6/974: dwrite d18/d50/d8f/f130 [0,4194304] 0 2022-02-02T18:21:33.255 INFO:tasks.workunit.client.0.smithi096.stdout:4/859: write d3/d4/d20/d26/d36/d88/d98/fa4 [515968,77979] 0 2022-02-02T18:21:33.256 INFO:tasks.workunit.client.0.smithi096.stdout:6/975: mkdir d18/d50/d8f/dbb/d63/d16c 0 2022-02-02T18:21:33.257 INFO:tasks.workunit.client.0.smithi096.stdout:6/976: creat d18/d24/d73/dfb/de8/f16d x:0 0 0 2022-02-02T18:21:33.258 INFO:tasks.workunit.client.0.smithi096.stdout:4/860: mknod d3/d60/d8d/dc6/c11d 0 2022-02-02T18:21:33.258 INFO:tasks.workunit.client.0.smithi096.stdout:4/861: fsync d3/d27/f78 0 2022-02-02T18:21:33.261 INFO:tasks.workunit.client.0.smithi096.stdout:4/862: mkdir d3/d4/d20/d26/d36/d102/d109/dfb/d11e 0 2022-02-02T18:21:33.263 INFO:tasks.workunit.client.0.smithi096.stdout:4/863: mkdir d3/d60/da8/d11f 0 2022-02-02T18:21:33.266 INFO:tasks.workunit.client.0.smithi096.stdout:4/864: write d3/d5a/f87 [1857674,110212] 0 2022-02-02T18:21:33.268 INFO:tasks.workunit.client.0.smithi096.stdout:4/865: mkdir d3/d60/da8/d120 0 2022-02-02T18:21:33.269 INFO:tasks.workunit.client.0.smithi096.stdout:4/866: stat d3/d4/d20/d26/d36/d88/d119 0 2022-02-02T18:21:33.269 INFO:tasks.workunit.client.0.smithi096.stdout:4/867: chown d3/c70 1727742 1 2022-02-02T18:21:33.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/868: creat d3/d4/d20/d26/d36/d88/d119/f121 x:0 0 0 2022-02-02T18:21:33.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/869: read - d3/d4/d20/d26/d36/d102/f115 zero size 2022-02-02T18:21:33.271 INFO:tasks.workunit.client.0.smithi096.stdout:4/870: rename d3/d4/d20/d4d/f5b to d3/d4/d20/d4d/f122 0 2022-02-02T18:21:33.277 INFO:tasks.workunit.client.0.smithi096.stdout:6/977: dwrite d18/d50/f56 [0,4194304] 0 2022-02-02T18:21:33.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/978: rename d18/d50/d8f/dbb/le7 to d18/d50/d9a/l16e 0 2022-02-02T18:21:33.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/979: write d18/d50/d8f/dbb/d63/f105 [169882,1432] 0 2022-02-02T18:21:33.281 INFO:tasks.workunit.client.0.smithi096.stdout:6/980: truncate d18/d50/d8f/dbb/f39 529466 0 2022-02-02T18:21:33.282 INFO:tasks.workunit.client.0.smithi096.stdout:6/981: chown d18/d24/d73/dfb/f15a 2 1 2022-02-02T18:21:33.282 INFO:tasks.workunit.client.0.smithi096.stdout:6/982: read - d18/d24/d73/dfb/f15a zero size 2022-02-02T18:21:33.282 INFO:tasks.workunit.client.0.smithi096.stdout:4/871: dread d3/d5a/f68 [0,4194304] 0 2022-02-02T18:21:33.284 INFO:tasks.workunit.client.0.smithi096.stdout:4/872: unlink d3/d4/d20/f22 0 2022-02-02T18:21:33.286 INFO:tasks.workunit.client.0.smithi096.stdout:4/873: creat d3/d4/d20/d26/d36/d51/dd5/f123 x:0 0 0 2022-02-02T18:21:33.287 INFO:tasks.workunit.client.0.smithi096.stdout:8/866: sync 2022-02-02T18:21:33.287 INFO:tasks.workunit.client.0.smithi096.stdout:9/924: sync 2022-02-02T18:21:33.287 INFO:tasks.workunit.client.0.smithi096.stdout:7/887: sync 2022-02-02T18:21:33.287 INFO:tasks.workunit.client.0.smithi096.stdout:1/936: sync 2022-02-02T18:21:33.288 INFO:tasks.workunit.client.0.smithi096.stdout:7/888: truncate d9/df/d12/d39/d40/d122/f131 846205 0 2022-02-02T18:21:33.290 INFO:tasks.workunit.client.0.smithi096.stdout:4/874: unlink d3/d60/fc9 0 2022-02-02T18:21:33.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/925: rename d1/d39/f70 to d1/d39/d8a/d97/dee/d12b/f135 0 2022-02-02T18:21:33.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/875: unlink d3/d27/ca1 0 2022-02-02T18:21:33.295 INFO:tasks.workunit.client.0.smithi096.stdout:9/926: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f136 x:0 0 0 2022-02-02T18:21:33.295 INFO:tasks.workunit.client.0.smithi096.stdout:7/889: mkdir d9/d134 0 2022-02-02T18:21:33.296 INFO:tasks.workunit.client.0.smithi096.stdout:7/890: getdents d9/d134 0 2022-02-02T18:21:33.297 INFO:tasks.workunit.client.0.smithi096.stdout:9/927: mkdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d137 0 2022-02-02T18:21:33.298 INFO:tasks.workunit.client.0.smithi096.stdout:9/928: rename d1/db/d63/da2/l120 to d1/db/d1c/d2f/d78/d11/d1e/d66/dbf/l138 0 2022-02-02T18:21:33.298 INFO:tasks.workunit.client.0.smithi096.stdout:9/929: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f122 1872348 1 2022-02-02T18:21:33.298 INFO:tasks.workunit.client.0.smithi096.stdout:9/930: chown d1/db/d1c/d2f/d78/d25/d8e/fb8 0 1 2022-02-02T18:21:33.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/876: write d3/d60/fb2 [2920944,36157] 0 2022-02-02T18:21:33.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/867: dread d29/da7/d102/dcc/d5b/d81/f8d [0,4194304] 0 2022-02-02T18:21:33.299 INFO:tasks.workunit.client.0.smithi096.stdout:9/931: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/f139 x:0 0 0 2022-02-02T18:21:33.300 INFO:tasks.workunit.client.0.smithi096.stdout:8/868: getdents d29/da7/d102 0 2022-02-02T18:21:33.300 INFO:tasks.workunit.client.0.smithi096.stdout:8/869: readlink d29/da7/d102/db3/d6d/d83/db9/lbd 0 2022-02-02T18:21:33.301 INFO:tasks.workunit.client.0.smithi096.stdout:9/932: creat d1/db/d1c/d2f/d78/d11/d1e/d66/f13a x:0 0 0 2022-02-02T18:21:33.302 INFO:tasks.workunit.client.0.smithi096.stdout:4/877: getdents d3/d4/d90 0 2022-02-02T18:21:33.302 INFO:tasks.workunit.client.0.smithi096.stdout:4/878: creat d3/d4/db9/f124 x:0 0 0 2022-02-02T18:21:33.302 INFO:tasks.workunit.client.0.smithi096.stdout:4/879: fdatasync d3/d4/f23 0 2022-02-02T18:21:33.303 INFO:tasks.workunit.client.0.smithi096.stdout:8/870: creat d29/d4e/f124 x:0 0 0 2022-02-02T18:21:33.309 INFO:tasks.workunit.client.0.smithi096.stdout:4/880: dread d3/d4/d20/d26/d36/fc5 [0,4194304] 0 2022-02-02T18:21:33.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/983: dwrite d18/d50/f88 [0,4194304] 0 2022-02-02T18:21:33.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/984: truncate d18/d24/d28/fad 436102 0 2022-02-02T18:21:33.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/985: write d18/d50/d9a/d116/d118/f14c [886971,57098] 0 2022-02-02T18:21:33.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/986: write d18/d24/fca [4646282,107995] 0 2022-02-02T18:21:33.311 INFO:tasks.workunit.client.0.smithi096.stdout:4/881: symlink d3/d4/d20/d26/d36/d88/dd8/ddf/l125 0 2022-02-02T18:21:33.311 INFO:tasks.workunit.client.0.smithi096.stdout:4/882: chown d3/d4/f1c 2 1 2022-02-02T18:21:33.312 INFO:tasks.workunit.client.0.smithi096.stdout:1/937: dwrite d15/d1b/d28/f44 [0,4194304] 0 2022-02-02T18:21:33.312 INFO:tasks.workunit.client.0.smithi096.stdout:1/938: creat d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f14f x:0 0 0 2022-02-02T18:21:33.313 INFO:tasks.workunit.client.0.smithi096.stdout:6/987: creat d18/d165/f16f x:0 0 0 2022-02-02T18:21:33.313 INFO:tasks.workunit.client.0.smithi096.stdout:6/988: creat d18/d50/d6d/d113/f170 x:0 0 0 2022-02-02T18:21:33.314 INFO:tasks.workunit.client.0.smithi096.stdout:6/989: readlink d18/d50/d8f/dbb/lee 0 2022-02-02T18:21:33.314 INFO:tasks.workunit.client.0.smithi096.stdout:8/871: dread d29/d2d/f2e [0,4194304] 0 2022-02-02T18:21:33.314 INFO:tasks.workunit.client.0.smithi096.stdout:8/872: creat d29/da7/d102/dcc/d5b/d81/f125 x:0 0 0 2022-02-02T18:21:33.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/990: symlink d18/d50/d8f/dbb/d63/db3/l171 0 2022-02-02T18:21:33.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/991: write d18/d24/d73/d79/f11c [899149,89398] 0 2022-02-02T18:21:33.332 INFO:tasks.workunit.client.0.smithi096.stdout:6/992: creat d18/d50/d6d/d113/f172 x:0 0 0 2022-02-02T18:21:33.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/993: truncate d18/f160 65467 0 2022-02-02T18:21:33.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/994: write d18/d50/d8f/dbb/d63/db3/fe1 [1056440,81967] 0 2022-02-02T18:21:33.334 INFO:tasks.workunit.client.0.smithi096.stdout:9/933: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/f100 [0,4194304] 0 2022-02-02T18:21:33.335 INFO:tasks.workunit.client.0.smithi096.stdout:9/934: write d1/db/d48/de3/de5/deb/f128 [325860,97842] 0 2022-02-02T18:21:33.335 INFO:tasks.workunit.client.0.smithi096.stdout:4/883: getdents d3/d4/d20/d26/d36/d88/d119 0 2022-02-02T18:21:33.335 INFO:tasks.workunit.client.0.smithi096.stdout:4/884: creat d3/d60/d8d/f126 x:0 0 0 2022-02-02T18:21:33.336 INFO:tasks.workunit.client.0.smithi096.stdout:4/885: write d3/d4/db9/f124 [73741,70472] 0 2022-02-02T18:21:33.336 INFO:tasks.workunit.client.0.smithi096.stdout:6/995: mknod d18/c173 0 2022-02-02T18:21:33.336 INFO:tasks.workunit.client.0.smithi096.stdout:6/996: readlink d18/d50/l68 0 2022-02-02T18:21:33.337 INFO:tasks.workunit.client.0.smithi096.stdout:6/997: truncate d18/d50/d9a/fdd 4361483 0 2022-02-02T18:21:33.338 INFO:tasks.workunit.client.0.smithi096.stdout:6/998: write d18/f19 [2140302,51341] 0 2022-02-02T18:21:33.338 INFO:tasks.workunit.client.0.smithi096.stdout:9/935: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0 39 2022-02-02T18:21:33.340 INFO:tasks.workunit.client.0.smithi096.stdout:6/999: dread d18/f160 [0,4194304] 0 2022-02-02T18:21:33.352 INFO:tasks.workunit.client.0.smithi096.stdout:1/939: dwrite d15/d1b/d28/d47/f110 [0,4194304] 0 2022-02-02T18:21:33.352 INFO:tasks.workunit.client.0.smithi096.stdout:8/873: dwrite f23 [0,4194304] 0 2022-02-02T18:21:33.354 INFO:tasks.workunit.client.0.smithi096.stdout:1/940: symlink d15/d67/l150 0 2022-02-02T18:21:33.354 INFO:tasks.workunit.client.0.smithi096.stdout:1/941: dread - d15/d1b/d26/f136 zero size 2022-02-02T18:21:33.354 INFO:tasks.workunit.client.0.smithi096.stdout:1/942: creat d15/d1b/d26/d72/de9/f151 x:0 0 0 2022-02-02T18:21:33.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/874: creat d29/da7/d102/dcc/d5b/dd9/d104/f126 x:0 0 0 2022-02-02T18:21:33.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/875: chown d29/d2d/d87/da5/fd6 891417 1 2022-02-02T18:21:33.360 INFO:tasks.workunit.client.0.smithi096.stdout:4/886: dwrite d3/d85/fc7 [0,4194304] 0 2022-02-02T18:21:33.360 INFO:tasks.workunit.client.0.smithi096.stdout:4/887: chown d3/d60/d8d/da7/c7e 57 1 2022-02-02T18:21:33.361 INFO:tasks.workunit.client.0.smithi096.stdout:1/943: link d15/d1b/d28/d2c/c3c d15/d1b/d26/d59/dd2/c152 0 2022-02-02T18:21:33.361 INFO:tasks.workunit.client.0.smithi096.stdout:9/936: dwrite d1/db/d1c/d2f/dc8/fe2 [0,4194304] 0 2022-02-02T18:21:33.363 INFO:tasks.workunit.client.0.smithi096.stdout:8/876: mkdir d29/da7/d102/dc2/d127 0 2022-02-02T18:21:33.368 INFO:tasks.workunit.client.0.smithi096.stdout:9/937: write d1/db/d1c/d2f/f105 [622605,52148] 0 2022-02-02T18:21:33.371 INFO:tasks.workunit.client.0.smithi096.stdout:4/888: truncate d3/d4/d20/d26/d36/fc5 84723 0 2022-02-02T18:21:33.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/877: mkdir d29/d2d/d42/d128 0 2022-02-02T18:21:33.376 INFO:tasks.workunit.client.0.smithi096.stdout:4/889: creat d3/d4/d50/f127 x:0 0 0 2022-02-02T18:21:33.376 INFO:tasks.workunit.client.0.smithi096.stdout:4/890: read d3/d4/d20/d26/d36/d102/fee [468616,64489] 0 2022-02-02T18:21:33.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/891: write d3/d60/d8d/fd7 [199708,77526] 0 2022-02-02T18:21:33.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/878: mkdir d29/d2d/d42/d128/d129 0 2022-02-02T18:21:33.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/892: unlink d3/d4/d20/d26/d36/d102/d109/df4/c73 0 2022-02-02T18:21:33.382 INFO:tasks.workunit.client.0.smithi096.stdout:1/944: dwrite d15/d4d/f65 [0,4194304] 0 2022-02-02T18:21:33.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/879: write d29/f2b [1345331,45725] 0 2022-02-02T18:21:33.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/880: unlink d29/da7/d102/dcc/d5b/d81/c105 0 2022-02-02T18:21:33.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/881: creat d29/da7/d102/dcc/d5b/d81/f12a x:0 0 0 2022-02-02T18:21:33.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/882: chown d29/d2d/d87/def/f100 6302 1 2022-02-02T18:21:33.385 INFO:tasks.workunit.client.0.smithi096.stdout:5/878: sync 2022-02-02T18:21:33.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/945: mkdir d15/d1b/d28/d47/d153 0 2022-02-02T18:21:33.390 INFO:tasks.workunit.client.0.smithi096.stdout:1/946: dread d15/d1b/d28/d2c/f5d [0,4194304] 0 2022-02-02T18:21:33.391 INFO:tasks.workunit.client.0.smithi096.stdout:4/893: rmdir d3/d4/d20/d26/d36/d102/d109/df4 39 2022-02-02T18:21:33.391 INFO:tasks.workunit.client.0.smithi096.stdout:4/894: creat d3/d4/d20/d26/d36/d102/f128 x:0 0 0 2022-02-02T18:21:33.392 INFO:tasks.workunit.client.0.smithi096.stdout:3/910: sync 2022-02-02T18:21:33.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/891: sync 2022-02-02T18:21:33.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/892: fdatasync d9/df/d12/d39/d40/d6b/f120 0 2022-02-02T18:21:33.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/883: getdents d29/da7/d102/db3/d6d 0 2022-02-02T18:21:33.394 INFO:tasks.workunit.client.0.smithi096.stdout:5/879: symlink db/de/d10/d25/da0/dfe/l135 0 2022-02-02T18:21:33.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/895: link d3/d4/d20/d26/d36/d51/fc1 d3/d4/d20/d26/d36/d102/f129 0 2022-02-02T18:21:33.398 INFO:tasks.workunit.client.0.smithi096.stdout:3/911: unlink d2/d71/c12a 0 2022-02-02T18:21:33.400 INFO:tasks.workunit.client.0.smithi096.stdout:7/893: creat d9/df/d16/d25/f135 x:0 0 0 2022-02-02T18:21:33.400 INFO:tasks.workunit.client.0.smithi096.stdout:7/894: write d9/df/f10b [222830,56714] 0 2022-02-02T18:21:33.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/896: unlink d3/d4/d20/d26/d36/d102/d109/df4/f66 0 2022-02-02T18:21:33.403 INFO:tasks.workunit.client.0.smithi096.stdout:7/895: rmdir d9/df/d12/d14 39 2022-02-02T18:21:33.405 INFO:tasks.workunit.client.0.smithi096.stdout:4/897: mkdir d3/d4/d20/d26/d12a 0 2022-02-02T18:21:33.405 INFO:tasks.workunit.client.0.smithi096.stdout:4/898: chown d3/d60/dbd/fe8 201499 1 2022-02-02T18:21:33.405 INFO:tasks.workunit.client.0.smithi096.stdout:4/899: readlink d3/d4/d20/d4d/le9 0 2022-02-02T18:21:33.406 INFO:tasks.workunit.client.0.smithi096.stdout:5/880: write db/d5c/d2f/f90 [2995652,129493] 0 2022-02-02T18:21:33.406 INFO:tasks.workunit.client.0.smithi096.stdout:7/896: link d9/df/d47/d19/f27 d9/df/d44/f136 0 2022-02-02T18:21:33.408 INFO:tasks.workunit.client.0.smithi096.stdout:4/900: symlink d3/d4/d20/d26/d36/l12b 0 2022-02-02T18:21:33.411 INFO:tasks.workunit.client.0.smithi096.stdout:5/881: symlink db/da1/dcc/l136 0 2022-02-02T18:21:33.411 INFO:tasks.workunit.client.0.smithi096.stdout:5/882: read - db/de/d10/d25/d4c/dd8/def/f107 zero size 2022-02-02T18:21:33.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/901: write d3/d4/d20/d26/d36/d51/d57/ff0 [5815268,115575] 0 2022-02-02T18:21:33.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/902: getdents d3/d4/d20/d26/d36/d102/d109/d118 0 2022-02-02T18:21:33.413 INFO:tasks.workunit.client.0.smithi096.stdout:5/883: truncate db/de/d2e/d35/f37 61211 0 2022-02-02T18:21:33.413 INFO:tasks.workunit.client.0.smithi096.stdout:5/884: creat db/de/d10/f137 x:0 0 0 2022-02-02T18:21:33.414 INFO:tasks.workunit.client.0.smithi096.stdout:4/903: creat d3/d60/f12c x:0 0 0 2022-02-02T18:21:33.415 INFO:tasks.workunit.client.0.smithi096.stdout:4/904: creat d3/d85/f12d x:0 0 0 2022-02-02T18:21:33.415 INFO:tasks.workunit.client.0.smithi096.stdout:4/905: write d3/d4/d20/d26/d36/d51/f53 [1321307,79544] 0 2022-02-02T18:21:33.417 INFO:tasks.workunit.client.0.smithi096.stdout:4/906: creat d3/d4/d20/d26/d36/d102/d109/dfb/d11e/f12e x:0 0 0 2022-02-02T18:21:33.418 INFO:tasks.workunit.client.0.smithi096.stdout:4/907: symlink d3/d4/d20/d26/d12a/l12f 0 2022-02-02T18:21:33.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/908: write d3/d60/fb2 [1369052,66314] 0 2022-02-02T18:21:33.422 INFO:tasks.workunit.client.0.smithi096.stdout:4/909: unlink d3/d4/d20/d26/d36/d102/d109/df4/f29 0 2022-02-02T18:21:33.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/910: dread d3/d85/fa0 [0,4194304] 0 2022-02-02T18:21:33.430 INFO:tasks.workunit.client.0.smithi096.stdout:4/911: mkdir d3/d4/d20/d26/d36/d102/d109/d118/d130 0 2022-02-02T18:21:33.430 INFO:tasks.workunit.client.0.smithi096.stdout:4/912: read - d3/d60/d8d/ff1 zero size 2022-02-02T18:21:33.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/884: dwrite d29/da7/d102/dcc/d5b/fa6 [0,4194304] 0 2022-02-02T18:21:33.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/885: readlink d29/d2d/d42/ldd 0 2022-02-02T18:21:33.441 INFO:tasks.workunit.client.0.smithi096.stdout:3/912: dwrite d2/df/d36/f68 [0,4194304] 0 2022-02-02T18:21:33.441 INFO:tasks.workunit.client.0.smithi096.stdout:4/913: dread d3/f10 [0,4194304] 0 2022-02-02T18:21:33.442 INFO:tasks.workunit.client.0.smithi096.stdout:3/913: creat d2/df/d20/dc4/f12e x:0 0 0 2022-02-02T18:21:33.442 INFO:tasks.workunit.client.0.smithi096.stdout:8/886: mknod d29/da7/d102/db3/d6d/c12b 0 2022-02-02T18:21:33.443 INFO:tasks.workunit.client.0.smithi096.stdout:4/914: mkdir d3/d4/d20/d26/d36/d88/d98/d131 0 2022-02-02T18:21:33.444 INFO:tasks.workunit.client.0.smithi096.stdout:5/885: dwrite db/de/d10/d25/f40 [0,4194304] 0 2022-02-02T18:21:33.444 INFO:tasks.workunit.client.0.smithi096.stdout:5/886: readlink db/de/d2e/l31 0 2022-02-02T18:21:33.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/947: dwrite d15/d1b/d26/d72/f90 [0,4194304] 0 2022-02-02T18:21:33.444 INFO:tasks.workunit.client.0.smithi096.stdout:7/897: dwrite d9/df/d47/d37/d83/f97 [0,4194304] 0 2022-02-02T18:21:33.445 INFO:tasks.workunit.client.0.smithi096.stdout:8/887: mkdir d29/da7/d12c 0 2022-02-02T18:21:33.447 INFO:tasks.workunit.client.0.smithi096.stdout:4/915: rename d3/d60/d8d/dc6/dd0/c10d to d3/d60/d8d/c132 0 2022-02-02T18:21:33.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/916: mkdir d3/d60/d8d/d133 0 2022-02-02T18:21:33.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/917: dread - d3/d60/d8d/dc6/dd0/f104 zero size 2022-02-02T18:21:33.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/918: dread d3/d4/d20/d26/d36/d88/dd8/de1/fef [0,4194304] 0 2022-02-02T18:21:33.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/898: rename d9/df/d12/d39/d40/d6b/dd4/f107 to d9/df/d12/d39/d41/dfa/f137 0 2022-02-02T18:21:33.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/887: rmdir db/dbd/d10a 39 2022-02-02T18:21:33.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/888: creat db/de/d2e/d35/f138 x:0 0 0 2022-02-02T18:21:33.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/889: mkdir db/d5c/d60/d139 0 2022-02-02T18:21:33.462 INFO:tasks.workunit.client.0.smithi096.stdout:5/890: unlink db/de/d10/d27/c7a 0 2022-02-02T18:21:33.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/899: rename d9/df/d47/d37/d83/db4 to d9/df/d16/d25/d98/d138 0 2022-02-02T18:21:33.466 INFO:tasks.workunit.client.0.smithi096.stdout:5/891: mknod db/da1/dcc/c13a 0 2022-02-02T18:21:33.467 INFO:tasks.workunit.client.0.smithi096.stdout:7/900: creat d9/df/d12/d39/d40/d6b/dd4/f139 x:0 0 0 2022-02-02T18:21:33.468 INFO:tasks.workunit.client.0.smithi096.stdout:7/901: write d9/df/d16/fa1 [68426,96007] 0 2022-02-02T18:21:33.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/902: creat d9/df/d16/f13a x:0 0 0 2022-02-02T18:21:33.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/903: write d9/df/d54/fa3 [1135031,22959] 0 2022-02-02T18:21:33.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/904: dread - d9/df/d47/d37/ff7 zero size 2022-02-02T18:21:33.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/892: symlink db/d5c/d60/l13b 0 2022-02-02T18:21:33.476 INFO:tasks.workunit.client.0.smithi096.stdout:3/914: dwrite d2/df/d20/d4a/f12b [0,4194304] 0 2022-02-02T18:21:33.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/948: dwrite d15/d1b/d26/d72/f11c [0,4194304] 0 2022-02-02T18:21:33.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/888: dwrite d29/da7/d102/db3/d6d/f103 [4194304,4194304] 0 2022-02-02T18:21:33.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/889: fdatasync d29/d58/d7a/f91 0 2022-02-02T18:21:33.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/893: mkdir db/de/d10/d27/d13c 0 2022-02-02T18:21:33.484 INFO:tasks.workunit.client.0.smithi096.stdout:4/919: dwrite d3/d4/d20/d26/d36/d102/fee [0,4194304] 0 2022-02-02T18:21:33.487 INFO:tasks.workunit.client.0.smithi096.stdout:3/915: rename d2/df/d1c/d5d/dbf/dd1/d115/f121 to d2/df/d20/d4a/d108/f12f 0 2022-02-02T18:21:33.489 INFO:tasks.workunit.client.0.smithi096.stdout:7/905: dwrite d9/df/d12/d39/f7b [0,4194304] 0 2022-02-02T18:21:33.490 INFO:tasks.workunit.client.0.smithi096.stdout:7/906: chown d9/df/d47/d19/cdf 1 1 2022-02-02T18:21:33.495 INFO:tasks.workunit.client.0.smithi096.stdout:9/938: sync 2022-02-02T18:21:33.504 INFO:tasks.workunit.client.0.smithi096.stdout:5/894: rename db/de/d10/d25/c71 to db/d5c/d61/c13d 0 2022-02-02T18:21:33.511 INFO:tasks.workunit.client.0.smithi096.stdout:7/907: creat d9/df/d12/d39/d40/d51/f13b x:0 0 0 2022-02-02T18:21:33.511 INFO:tasks.workunit.client.0.smithi096.stdout:7/908: fdatasync d9/df/d16/fbf 0 2022-02-02T18:21:33.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/890: getdents d29/d2d/d87 0 2022-02-02T18:21:33.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/891: creat d29/f12d x:0 0 0 2022-02-02T18:21:33.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/892: chown d29/d2d/d87/da5/deb/l11f 6902507 1 2022-02-02T18:21:33.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/893: dread - d29/d58/d63/fed zero size 2022-02-02T18:21:33.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/894: chown d29/da7/d102/db3/d6d/f90 3 1 2022-02-02T18:21:33.514 INFO:tasks.workunit.client.0.smithi096.stdout:4/920: dwrite d3/d4/d20/d26/d36/d51/d57/ff0 [0,4194304] 0 2022-02-02T18:21:33.514 INFO:tasks.workunit.client.0.smithi096.stdout:3/916: dread d2/df/d14/d66/fba [0,4194304] 0 2022-02-02T18:21:33.514 INFO:tasks.workunit.client.0.smithi096.stdout:9/939: creat d1/db/d1c/d2f/d78/d11/d1e/d47/df3/d10c/f13b x:0 0 0 2022-02-02T18:21:33.515 INFO:tasks.workunit.client.0.smithi096.stdout:5/895: mkdir db/da1/dcc/d13e 0 2022-02-02T18:21:33.515 INFO:tasks.workunit.client.0.smithi096.stdout:7/909: mknod d9/df/d12/d14/c13c 0 2022-02-02T18:21:33.516 INFO:tasks.workunit.client.0.smithi096.stdout:8/895: creat d29/da7/f12e x:0 0 0 2022-02-02T18:21:33.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/921: creat d3/d60/da8/f134 x:0 0 0 2022-02-02T18:21:33.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/917: rmdir d2/df/d34/d76/dd3/d104/daa/dfc 39 2022-02-02T18:21:33.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/918: stat d2/df/d20/c4f 0 2022-02-02T18:21:33.519 INFO:tasks.workunit.client.0.smithi096.stdout:8/896: read d29/d4e/f8e [2960666,31] 0 2022-02-02T18:21:33.519 INFO:tasks.workunit.client.0.smithi096.stdout:5/896: creat db/de/d10/d80/f13f x:0 0 0 2022-02-02T18:21:33.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/922: dread d3/d4/f1c [0,4194304] 0 2022-02-02T18:21:33.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/910: rename d9/df/d12/d39/d40/d85/fcf to d9/df/d12/d14/f13d 0 2022-02-02T18:21:33.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/911: creat d9/df/d54/f13e x:0 0 0 2022-02-02T18:21:33.522 INFO:tasks.workunit.client.0.smithi096.stdout:7/912: chown d9/df/d12/d39/d41/dfa 15060581 1 2022-02-02T18:21:33.522 INFO:tasks.workunit.client.0.smithi096.stdout:1/949: dwrite d15/d1b/d26/d72/f11c [4194304,4194304] 0 2022-02-02T18:21:33.523 INFO:tasks.workunit.client.0.smithi096.stdout:1/950: chown d15/d1b/d28/d114/lbe 1719 1 2022-02-02T18:21:33.523 INFO:tasks.workunit.client.0.smithi096.stdout:5/897: dread db/de/d10/d27/d83/ffb [0,4194304] 0 2022-02-02T18:21:33.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/919: symlink d2/df/d34/d76/dd3/d104/daa/dfc/l130 0 2022-02-02T18:21:33.523 INFO:tasks.workunit.client.0.smithi096.stdout:5/898: write f6 [2082750,59778] 0 2022-02-02T18:21:33.527 INFO:tasks.workunit.client.0.smithi096.stdout:9/940: rmdir d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26 39 2022-02-02T18:21:33.528 INFO:tasks.workunit.client.0.smithi096.stdout:8/897: rmdir d29/da7/d102/dcc/d5b/dca 39 2022-02-02T18:21:33.529 INFO:tasks.workunit.client.0.smithi096.stdout:8/898: truncate d29/d2d/d87/da5/f113 11751 0 2022-02-02T18:21:33.529 INFO:tasks.workunit.client.0.smithi096.stdout:4/923: stat d3/d4/d20/d4d/l95 0 2022-02-02T18:21:33.535 INFO:tasks.workunit.client.0.smithi096.stdout:5/899: link db/de/d10/f18 db/dbd/f140 0 2022-02-02T18:21:33.535 INFO:tasks.workunit.client.0.smithi096.stdout:5/900: write db/de/d10/d25/f100 [531110,104863] 0 2022-02-02T18:21:33.536 INFO:tasks.workunit.client.0.smithi096.stdout:8/899: mknod d29/da7/d102/db3/d6d/d83/db9/c12f 0 2022-02-02T18:21:33.536 INFO:tasks.workunit.client.0.smithi096.stdout:8/900: fsync d29/d2d/f37 0 2022-02-02T18:21:33.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/913: rename d9/df/d12/d39/d41/ffc to d9/f13f 0 2022-02-02T18:21:33.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/914: dread - d9/df/d47/f112 zero size 2022-02-02T18:21:33.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/901: dread db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:33.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/902: write db/de/d10/d25/f100 [690638,41274] 0 2022-02-02T18:21:33.540 INFO:tasks.workunit.client.0.smithi096.stdout:5/903: fdatasync db/de/d10/d27/d83/fec 0 2022-02-02T18:21:33.540 INFO:tasks.workunit.client.0.smithi096.stdout:1/951: rename d15/d1b/d28/d2c/c3c to d15/d1b/d26/d72/da3/c154 0 2022-02-02T18:21:33.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/915: write d9/df/d12/d39/d4e/fc0 [2549071,106852] 0 2022-02-02T18:21:33.543 INFO:tasks.workunit.client.0.smithi096.stdout:8/901: unlink d29/da7/d102/db3/d6d/d85/fc5 0 2022-02-02T18:21:33.543 INFO:tasks.workunit.client.0.smithi096.stdout:3/920: dwrite d2/df/d34/d76/dd3/d104/daa/dfc/d103/f110 [0,4194304] 0 2022-02-02T18:21:33.546 INFO:tasks.workunit.client.0.smithi096.stdout:5/904: creat db/d5c/d60/da7/de2/d10b/f141 x:0 0 0 2022-02-02T18:21:33.547 INFO:tasks.workunit.client.0.smithi096.stdout:7/916: mknod d9/df/d12/d39/c140 0 2022-02-02T18:21:33.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/917: write d9/df/d44/fd0 [670592,107140] 0 2022-02-02T18:21:33.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/902: rename d29/d58/d63/l10b to d29/da7/l130 0 2022-02-02T18:21:33.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/921: mkdir d2/df/d1c/d5d/d131 0 2022-02-02T18:21:33.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/922: creat d2/df/d14/d73/f132 x:0 0 0 2022-02-02T18:21:33.553 INFO:tasks.workunit.client.0.smithi096.stdout:9/941: dwrite d1/f56 [0,4194304] 0 2022-02-02T18:21:33.553 INFO:tasks.workunit.client.0.smithi096.stdout:9/942: read d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f101 [197931,34466] 0 2022-02-02T18:21:33.554 INFO:tasks.workunit.client.0.smithi096.stdout:5/905: creat db/d5c/d60/da7/de2/d129/f142 x:0 0 0 2022-02-02T18:21:33.555 INFO:tasks.workunit.client.0.smithi096.stdout:8/903: write d29/d4e/f8e [4132153,9506] 0 2022-02-02T18:21:33.555 INFO:tasks.workunit.client.0.smithi096.stdout:3/923: symlink d2/df/d20/d33/d58/d7c/l133 0 2022-02-02T18:21:33.556 INFO:tasks.workunit.client.0.smithi096.stdout:5/906: creat db/da1/dcc/d13e/f143 x:0 0 0 2022-02-02T18:21:33.557 INFO:tasks.workunit.client.0.smithi096.stdout:3/924: stat d2/df/d1c/d114/cfe 0 2022-02-02T18:21:33.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/907: symlink db/de/d10/d25/da0/dfe/l144 0 2022-02-02T18:21:33.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/908: creat db/de/f145 x:0 0 0 2022-02-02T18:21:33.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/909: fdatasync db/d5c/d60/da7/fae 0 2022-02-02T18:21:33.560 INFO:tasks.workunit.client.0.smithi096.stdout:5/910: fsync db/de/d10/d27/ff1 0 2022-02-02T18:21:33.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/918: rename d9/df/d12/d39/d40/d6b/dd4 to d9/df/d12/d14/d141 0 2022-02-02T18:21:33.561 INFO:tasks.workunit.client.0.smithi096.stdout:7/919: dread d9/df/d16/fbf [0,4194304] 0 2022-02-02T18:21:33.562 INFO:tasks.workunit.client.0.smithi096.stdout:7/920: write d9/df/d47/fc6 [3530725,119888] 0 2022-02-02T18:21:33.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/943: rename d1/db/d1c/d2f/d78/d11/d1e/d47/f130 to d1/db/d63/da2/f13c 0 2022-02-02T18:21:33.566 INFO:tasks.workunit.client.0.smithi096.stdout:4/924: dwrite d3/d4/d50/fa2 [0,4194304] 0 2022-02-02T18:21:33.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/952: dwrite d15/d1b/d26/d59/ffe [0,4194304] 0 2022-02-02T18:21:33.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/953: fdatasync d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f128 0 2022-02-02T18:21:33.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/954: readlink d15/d1b/d26/l2d 0 2022-02-02T18:21:33.567 INFO:tasks.workunit.client.0.smithi096.stdout:7/921: symlink d9/df/d12/d14/d82/l142 0 2022-02-02T18:21:33.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/904: rename d29/d4e/l74 to d29/d58/d79/l131 0 2022-02-02T18:21:33.577 INFO:tasks.workunit.client.0.smithi096.stdout:4/925: mknod d3/d60/d8d/dc6/dd0/c135 0 2022-02-02T18:21:33.578 INFO:tasks.workunit.client.0.smithi096.stdout:7/922: mkdir d9/df/d12/d39/d46/d143 0 2022-02-02T18:21:33.580 INFO:tasks.workunit.client.0.smithi096.stdout:1/955: rename d15/d1b/d28/d2c/d4f/d51/ca0 to d15/d1b/d26/d72/da3/da7/d140/c155 0 2022-02-02T18:21:33.581 INFO:tasks.workunit.client.0.smithi096.stdout:8/905: mkdir d29/da7/d102/db3/d10d/d132 0 2022-02-02T18:21:33.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/923: link d9/df/d12/f6d d9/df/d12/d39/d41/f144 0 2022-02-02T18:21:33.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/924: stat d9/df/d16/d25 0 2022-02-02T18:21:33.583 INFO:tasks.workunit.client.0.smithi096.stdout:1/956: creat d15/d1b/d26/d72/da3/da7/ddc/d9f/f156 x:0 0 0 2022-02-02T18:21:33.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/925: mkdir d9/df/d12/d39/d41/dac/d145 0 2022-02-02T18:21:33.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/957: write d15/d1b/d28/d2c/f5a [1346166,32549] 0 2022-02-02T18:21:33.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/958: stat d15/d1b/d28/d47/f5c 0 2022-02-02T18:21:33.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/926: mkdir d9/df/d93/d146 0 2022-02-02T18:21:33.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/927: chown d9/df/d12/d39/d4e/fc0 9 1 2022-02-02T18:21:33.589 INFO:tasks.workunit.client.0.smithi096.stdout:1/959: symlink d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d13e/l157 0 2022-02-02T18:21:33.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/911: dwrite db/de/d10/d25/d4c/f65 [0,4194304] 0 2022-02-02T18:21:33.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/912: write db/de/d10/d25/d4c/f10f [692586,94280] 0 2022-02-02T18:21:33.590 INFO:tasks.workunit.client.0.smithi096.stdout:3/925: dwrite d2/df/d1c/d5d/d69/ff7 [0,4194304] 0 2022-02-02T18:21:33.591 INFO:tasks.workunit.client.0.smithi096.stdout:7/928: unlink d9/df/d47/db7/de3/l103 0 2022-02-02T18:21:33.591 INFO:tasks.workunit.client.0.smithi096.stdout:5/913: read db/de/d10/d25/d4c/dd8/def/dc2/dfa/f7b [739491,53445] 0 2022-02-02T18:21:33.592 INFO:tasks.workunit.client.0.smithi096.stdout:1/960: mkdir d15/d1b/d28/d2c/d4f/d51/d158 0 2022-02-02T18:21:33.596 INFO:tasks.workunit.client.0.smithi096.stdout:9/944: dwrite d1/db/d1c/d2f/d78/f95 [0,4194304] 0 2022-02-02T18:21:33.596 INFO:tasks.workunit.client.0.smithi096.stdout:9/945: read - d1/d39/d8a/d97/dee/f126 zero size 2022-02-02T18:21:33.597 INFO:tasks.workunit.client.0.smithi096.stdout:3/926: truncate d2/df/d14/d16/ff5 1982702 0 2022-02-02T18:21:33.598 INFO:tasks.workunit.client.0.smithi096.stdout:5/914: creat db/f146 x:0 0 0 2022-02-02T18:21:33.598 INFO:tasks.workunit.client.0.smithi096.stdout:5/915: truncate db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/f102 392197 0 2022-02-02T18:21:33.599 INFO:tasks.workunit.client.0.smithi096.stdout:1/961: mkdir d15/d1b/d26/d72/dff/d8a/d159 0 2022-02-02T18:21:33.601 INFO:tasks.workunit.client.0.smithi096.stdout:9/946: symlink d1/db/d48/l13d 0 2022-02-02T18:21:33.601 INFO:tasks.workunit.client.0.smithi096.stdout:9/947: fdatasync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f118 0 2022-02-02T18:21:33.601 INFO:tasks.workunit.client.0.smithi096.stdout:9/948: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e 479 1 2022-02-02T18:21:33.602 INFO:tasks.workunit.client.0.smithi096.stdout:3/927: truncate d2/df/d20/d4a/f62 4084405 0 2022-02-02T18:21:33.602 INFO:tasks.workunit.client.0.smithi096.stdout:1/962: write d15/d1b/d28/f3e [4393696,28849] 0 2022-02-02T18:21:33.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/949: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/l13e 0 2022-02-02T18:21:33.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/926: dwrite d3/d4/d20/d26/f34 [0,4194304] 0 2022-02-02T18:21:33.604 INFO:tasks.workunit.client.0.smithi096.stdout:9/950: read d1/f36 [1445049,63288] 0 2022-02-02T18:21:33.604 INFO:tasks.workunit.client.0.smithi096.stdout:4/927: creat d3/d4/d20/d26/d36/d102/d109/df4/f136 x:0 0 0 2022-02-02T18:21:33.604 INFO:tasks.workunit.client.0.smithi096.stdout:9/951: write d1/db/d1c/d2f/d78/d11/d3c/fc7 [334591,45632] 0 2022-02-02T18:21:33.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/928: symlink d3/d5a/d91/l137 0 2022-02-02T18:21:33.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/929: creat d3/d4/d20/d26/d36/d51/dd5/f138 x:0 0 0 2022-02-02T18:21:33.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/930: chown d3/d4/d20/d26/d36/d88/d119/f121 189 1 2022-02-02T18:21:33.608 INFO:tasks.workunit.client.0.smithi096.stdout:9/952: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/c33 0 2022-02-02T18:21:33.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/953: mkdir d1/db/d1c/d2f/d78/d25/d8e/d9d/dc6/d13f 0 2022-02-02T18:21:33.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/954: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f118 [309385,74390] 0 2022-02-02T18:21:33.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/929: dwrite d9/df/d12/d14/fca [0,4194304] 0 2022-02-02T18:21:33.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/930: creat d9/df/d44/f147 x:0 0 0 2022-02-02T18:21:33.615 INFO:tasks.workunit.client.0.smithi096.stdout:9/955: symlink d1/db/d1c/d2f/d78/d25/l140 0 2022-02-02T18:21:33.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/916: fdatasync f6 0 2022-02-02T18:21:33.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/906: dwrite d29/f33 [0,4194304] 0 2022-02-02T18:21:33.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/907: write d29/d58/d79/f7c [2164475,40745] 0 2022-02-02T18:21:33.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/917: dread db/d20/fa5 [0,4194304] 0 2022-02-02T18:21:33.620 INFO:tasks.workunit.client.0.smithi096.stdout:7/931: mkdir d9/df/d148 0 2022-02-02T18:21:33.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/932: chown d9/c133 0 1 2022-02-02T18:21:33.625 INFO:tasks.workunit.client.0.smithi096.stdout:8/908: creat d29/d2d/d87/f133 x:0 0 0 2022-02-02T18:21:33.627 INFO:tasks.workunit.client.0.smithi096.stdout:9/956: dread d1/db/d1c/d2f/d78/d11/d3c/f79 [0,4194304] 0 2022-02-02T18:21:33.628 INFO:tasks.workunit.client.0.smithi096.stdout:9/957: chown d1/db/d1c/d2f/d78/d11/d1e/lab 1 1 2022-02-02T18:21:33.628 INFO:tasks.workunit.client.0.smithi096.stdout:9/958: stat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/f101 0 2022-02-02T18:21:33.628 INFO:tasks.workunit.client.0.smithi096.stdout:9/959: stat d1/db/d1c/d2f/d78/d11/d1e/d47/df3/f121 0 2022-02-02T18:21:33.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/918: mknod db/de/d10/d25/d4c/dd8/def/dc2/c147 0 2022-02-02T18:21:33.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/919: write db/de/d10/d25/d4c/dd8/def/dc2/dfa/f123 [649493,50186] 0 2022-02-02T18:21:33.633 INFO:tasks.workunit.client.0.smithi096.stdout:9/960: creat d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/d137/f141 x:0 0 0 2022-02-02T18:21:33.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/961: dread - d1/db/d1c/d2f/d78/d11/d1e/d38/d68/fd7 zero size 2022-02-02T18:21:33.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/928: dwrite d2/df/d1c/f59 [0,4194304] 0 2022-02-02T18:21:33.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/963: dwrite d15/d1b/d28/f44 [0,4194304] 0 2022-02-02T18:21:33.637 INFO:tasks.workunit.client.0.smithi096.stdout:3/929: write d2/df/d14/d2c/d31/f47 [2909623,32962] 0 2022-02-02T18:21:33.637 INFO:tasks.workunit.client.0.smithi096.stdout:3/930: stat d2/df/d20/d33/f3b 0 2022-02-02T18:21:33.640 INFO:tasks.workunit.client.0.smithi096.stdout:8/909: rmdir d29/d58/d7a/d116 39 2022-02-02T18:21:33.643 INFO:tasks.workunit.client.0.smithi096.stdout:8/910: write d29/d2d/d42/f73 [4011235,61425] 0 2022-02-02T18:21:33.646 INFO:tasks.workunit.client.0.smithi096.stdout:9/962: stat d1/db/d1c/d2f/d78/d25/d8e/d9d/caa 0 2022-02-02T18:21:33.647 INFO:tasks.workunit.client.0.smithi096.stdout:5/920: dwrite db/d5c/d60/da7/de2/d129/f142 [0,4194304] 0 2022-02-02T18:21:33.648 INFO:tasks.workunit.client.0.smithi096.stdout:1/964: dread d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f13f [0,4194304] 0 2022-02-02T18:21:33.656 INFO:tasks.workunit.client.0.smithi096.stdout:1/965: dread d15/f2a [0,4194304] 0 2022-02-02T18:21:33.660 INFO:tasks.workunit.client.0.smithi096.stdout:3/931: mknod d2/df/d1c/d5d/dbf/c134 0 2022-02-02T18:21:33.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/963: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f90 [170553,55632] 0 2022-02-02T18:21:33.669 INFO:tasks.workunit.client.0.smithi096.stdout:5/921: symlink db/de/d10/d25/d4c/dd8/l148 0 2022-02-02T18:21:33.669 INFO:tasks.workunit.client.0.smithi096.stdout:5/922: truncate db/de/d10/d25/d4c/dd8/def/dc2/dfa/f128 186169 0 2022-02-02T18:21:33.670 INFO:tasks.workunit.client.0.smithi096.stdout:5/923: truncate db/de/d10/d25/d4c/dd8/ff9 214384 0 2022-02-02T18:21:33.670 INFO:tasks.workunit.client.0.smithi096.stdout:5/924: write db/de/f12a [383613,110502] 0 2022-02-02T18:21:33.670 INFO:tasks.workunit.client.0.smithi096.stdout:5/925: chown db/d20/fab 257006 1 2022-02-02T18:21:33.673 INFO:tasks.workunit.client.0.smithi096.stdout:1/966: mkdir d15/d1b/d26/d72/dff/d8a/d159/d15a 0 2022-02-02T18:21:33.675 INFO:tasks.workunit.client.0.smithi096.stdout:3/932: link d2/df/d20/d4a/f62 d2/df/f135 0 2022-02-02T18:21:33.678 INFO:tasks.workunit.client.0.smithi096.stdout:3/933: link d2/df/da6/ce9 d2/df/d20/d33/d58/dce/dcf/c136 0 2022-02-02T18:21:33.680 INFO:tasks.workunit.client.0.smithi096.stdout:1/967: rmdir d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/d13e 39 2022-02-02T18:21:33.680 INFO:tasks.workunit.client.0.smithi096.stdout:1/968: truncate d15/d1b/d26/d72/dff/d8a/db9/fda 4859886 0 2022-02-02T18:21:33.680 INFO:tasks.workunit.client.0.smithi096.stdout:1/969: read - d15/d1b/d28/d47/f146 zero size 2022-02-02T18:21:33.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/934: creat d2/df/d20/d33/d58/dce/dcf/d100/f137 x:0 0 0 2022-02-02T18:21:33.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/935: fsync d2/df/d36/d8d/ffd 0 2022-02-02T18:21:33.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/936: chown d2/df/d1c/d5d/d6d/l11d 1708 1 2022-02-02T18:21:33.682 INFO:tasks.workunit.client.0.smithi096.stdout:9/964: dwrite d1/db/d1c/d2f/f5a [0,4194304] 0 2022-02-02T18:21:33.682 INFO:tasks.workunit.client.0.smithi096.stdout:9/965: creat d1/d39/d8a/d97/f142 x:0 0 0 2022-02-02T18:21:33.683 INFO:tasks.workunit.client.0.smithi096.stdout:5/926: rename db/da1 to db/de/d10/d27/d83/d149 0 2022-02-02T18:21:33.683 INFO:tasks.workunit.client.0.smithi096.stdout:1/970: getdents d15/d1b/d26/d72/da3/da7/d140 0 2022-02-02T18:21:33.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/971: creat d15/d1b/d26/d59/dd2/f15b x:0 0 0 2022-02-02T18:21:33.686 INFO:tasks.workunit.client.0.smithi096.stdout:1/972: dread d15/d1b/f104 [0,4194304] 0 2022-02-02T18:21:33.686 INFO:tasks.workunit.client.0.smithi096.stdout:9/966: dread d1/db/d1c/d2f/d78/d11/fb1 [0,4194304] 0 2022-02-02T18:21:33.688 INFO:tasks.workunit.client.0.smithi096.stdout:5/927: creat db/dbd/d10a/f14a x:0 0 0 2022-02-02T18:21:33.691 INFO:tasks.workunit.client.0.smithi096.stdout:1/973: mkdir d15/d1b/d28/d47/d153/d15c 0 2022-02-02T18:21:33.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/928: symlink db/de/d10/d25/l14b 0 2022-02-02T18:21:33.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/929: chown db/d20/l2c 8262 1 2022-02-02T18:21:33.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/974: creat d15/d1b/d28/d47/d153/d15c/f15d x:0 0 0 2022-02-02T18:21:33.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/975: chown f13 0 1 2022-02-02T18:21:33.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/930: dread db/d5c/f5e [0,4194304] 0 2022-02-02T18:21:33.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/931: write db/de/d10/d25/da0/dfe/f117 [899443,46667] 0 2022-02-02T18:21:33.712 INFO:tasks.workunit.client.0.smithi096.stdout:5/932: mknod db/dbd/c14c 0 2022-02-02T18:21:33.720 INFO:tasks.workunit.client.0.smithi096.stdout:3/937: dwrite d2/df/d1c/d5d/fe6 [0,4194304] 0 2022-02-02T18:21:33.721 INFO:tasks.workunit.client.0.smithi096.stdout:1/976: dwrite d15/d1b/d26/d72/fe3 [0,4194304] 0 2022-02-02T18:21:33.721 INFO:tasks.workunit.client.0.smithi096.stdout:1/977: truncate d15/d1b/d26/d72/da3/da7/f138 425661 0 2022-02-02T18:21:33.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/978: chown d15/d1b/d26/d72/da3/da7/ddc/d9f/d11e/f13f 42667 1 2022-02-02T18:21:33.722 INFO:tasks.workunit.client.0.smithi096.stdout:9/967: dwrite d1/db/d1c/d2f/d78/f12d [0,4194304] 0 2022-02-02T18:21:33.722 INFO:tasks.workunit.client.0.smithi096.stdout:3/938: creat d2/df/d20/dc4/dfa/f138 x:0 0 0 2022-02-02T18:21:33.724 INFO:tasks.workunit.client.0.smithi096.stdout:1/979: mkdir d15/d1b/d28/d2c/d4f/d51/d158/d15e 0 2022-02-02T18:21:33.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/980: readlink d15/d1b/d28/d2c/l46 0 2022-02-02T18:21:33.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/981: write d15/d1b/f6e [733906,92326] 0 2022-02-02T18:21:33.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/982: write d15/d4d/f14a [367797,23491] 0 2022-02-02T18:21:33.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/983: readlink d15/d1b/d28/d2c/l46 0 2022-02-02T18:21:33.729 INFO:tasks.workunit.client.0.smithi096.stdout:9/968: creat d1/db/d1c/d2f/d78/d11/d1e/d66/dbf/f143 x:0 0 0 2022-02-02T18:21:33.730 INFO:tasks.workunit.client.0.smithi096.stdout:3/939: symlink d2/df/d36/l139 0 2022-02-02T18:21:33.732 INFO:tasks.workunit.client.0.smithi096.stdout:1/984: mkdir d15/d1b/d26/d72/da3/da7/ddc/d113/d15f 0 2022-02-02T18:21:33.732 INFO:tasks.workunit.client.0.smithi096.stdout:1/985: write d15/d1b/d26/d72/da3/da7/ddc/d9f/f156 [312588,31414] 0 2022-02-02T18:21:33.733 INFO:tasks.workunit.client.0.smithi096.stdout:1/986: write d15/d67/f9a [623178,66795] 0 2022-02-02T18:21:33.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/933: dwrite db/d5c/d2f/db7/f122 [0,4194304] 0 2022-02-02T18:21:33.734 INFO:tasks.workunit.client.0.smithi096.stdout:9/969: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/d8f/dcd/l144 0 2022-02-02T18:21:33.734 INFO:tasks.workunit.client.0.smithi096.stdout:3/940: mknod d2/df/d1c/d5d/dbf/c13a 0 2022-02-02T18:21:33.735 INFO:tasks.workunit.client.0.smithi096.stdout:3/941: dread d2/df/d34/d76/dd3/d104/daa/fc2 [0,4194304] 0 2022-02-02T18:21:33.736 INFO:tasks.workunit.client.0.smithi096.stdout:1/987: unlink d15/d1b/d26/d72/dff/d8a/db9/f148 0 2022-02-02T18:21:33.736 INFO:tasks.workunit.client.0.smithi096.stdout:1/988: truncate d15/d1b/d26/d72/f106 308960 0 2022-02-02T18:21:33.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/934: getdents db/de/d10/d97 0 2022-02-02T18:21:33.743 INFO:tasks.workunit.client.0.smithi096.stdout:9/970: symlink d1/db/d1c/d2f/d78/d11/d1e/d38/l145 0 2022-02-02T18:21:33.744 INFO:tasks.workunit.client.0.smithi096.stdout:3/942: getdents d2/df/d1c/d5d/d6d 0 2022-02-02T18:21:33.744 INFO:tasks.workunit.client.0.smithi096.stdout:3/943: rename d2/df to d2/df/d14/d2c/df4/d13b 22 2022-02-02T18:21:33.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/935: dread db/de/d10/d27/fd7 [0,4194304] 0 2022-02-02T18:21:33.746 INFO:tasks.workunit.client.0.smithi096.stdout:1/989: link d15/d1b/c14b d15/d1b/d28/d2c/d39/de5/c160 0 2022-02-02T18:21:33.749 INFO:tasks.workunit.client.0.smithi096.stdout:5/936: rename db/de/d2e/f41 to db/d5c/d60/d139/f14d 0 2022-02-02T18:21:33.752 INFO:tasks.workunit.client.0.smithi096.stdout:5/937: rename db/de/d10/d25/d4c/l113 to db/de/d10/d25/d4c/df6/l14e 0 2022-02-02T18:21:33.752 INFO:tasks.workunit.client.0.smithi096.stdout:5/938: unlink db/de/d10/d27/c28 0 2022-02-02T18:21:33.753 INFO:tasks.workunit.client.0.smithi096.stdout:9/971: dread d1/db/d1c/d2f/d78/f95 [0,4194304] 0 2022-02-02T18:21:33.753 INFO:tasks.workunit.client.0.smithi096.stdout:9/972: fsync d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/f3d 0 2022-02-02T18:21:33.755 INFO:tasks.workunit.client.0.smithi096.stdout:7/933: sync 2022-02-02T18:21:33.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/931: sync 2022-02-02T18:21:33.755 INFO:tasks.workunit.client.0.smithi096.stdout:1/990: dread d15/d1b/d28/d47/f79 [0,4194304] 0 2022-02-02T18:21:33.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/932: truncate d3/d60/d8d/ff9 5303 0 2022-02-02T18:21:33.756 INFO:tasks.workunit.client.0.smithi096.stdout:9/973: write d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d4e/f83 [1177262,15048] 0 2022-02-02T18:21:33.756 INFO:tasks.workunit.client.0.smithi096.stdout:8/911: sync 2022-02-02T18:21:33.757 INFO:tasks.workunit.client.0.smithi096.stdout:7/934: getdents d9/df/d12/d14/d141 0 2022-02-02T18:21:33.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/933: getdents d3/d4/d20/d26/d36/d51/d57 0 2022-02-02T18:21:33.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/934: readlink d3/d4/l7 0 2022-02-02T18:21:33.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/935: creat d3/d60/d8d/dc6/dd0/f139 x:0 0 0 2022-02-02T18:21:33.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/936: write d3/d4/d20/d26/d36/d88/d98/fa4 [587516,79939] 0 2022-02-02T18:21:33.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/937: write d3/d27/f41 [1551121,43488] 0 2022-02-02T18:21:33.761 INFO:tasks.workunit.client.0.smithi096.stdout:8/912: link d29/f12d d29/da7/d102/ddb/f134 0 2022-02-02T18:21:33.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/938: mknod d3/d4/d90/c13a 0 2022-02-02T18:21:33.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/939: write d3/d60/f12c [17935,109517] 0 2022-02-02T18:21:33.765 INFO:tasks.workunit.client.0.smithi096.stdout:8/913: creat d29/d2d/d87/def/f135 x:0 0 0 2022-02-02T18:21:33.765 INFO:tasks.workunit.client.0.smithi096.stdout:8/914: readlink d29/da7/d102/db3/l6a 0 2022-02-02T18:21:33.770 INFO:tasks.workunit.client.0.smithi096.stdout:8/915: dread d29/d2d/f3f [0,4194304] 0 2022-02-02T18:21:33.774 INFO:tasks.workunit.client.0.smithi096.stdout:8/916: mkdir d29/d2d/d42/d136 0 2022-02-02T18:21:33.787 INFO:tasks.workunit.client.0.smithi096.stdout:8/917: dread d29/da7/d102/dcc/d5b/f64 [0,4194304] 0 2022-02-02T18:21:33.788 INFO:tasks.workunit.client.0.smithi096.stdout:8/918: rename d29/d58/d7a/l99 to d29/da7/d102/dc2/l137 0 2022-02-02T18:21:33.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/974: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/f108 [0,4194304] 0 2022-02-02T18:21:33.797 INFO:tasks.workunit.client.0.smithi096.stdout:1/991: dwrite d15/f2a [0,4194304] 0 2022-02-02T18:21:33.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/975: chown d1/db 1544594140 1 2022-02-02T18:21:33.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/976: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/c146 0 2022-02-02T18:21:33.799 INFO:tasks.workunit.client.0.smithi096.stdout:7/935: dwrite d9/df/d12/d39/d41/dfa/f137 [0,4194304] 0 2022-02-02T18:21:33.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/939: dwrite db/de/d2e/d35/fe3 [0,4194304] 0 2022-02-02T18:21:33.800 INFO:tasks.workunit.client.0.smithi096.stdout:1/992: rename d15/d1b/d26/d59 to d15/d1b/d26/d72/dff/d8a/d159/d161 0 2022-02-02T18:21:33.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/940: creat db/d5c/d60/da7/de2/f14f x:0 0 0 2022-02-02T18:21:33.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/940: dwrite d3/d4/d20/d26/d36/f56 [0,4194304] 0 2022-02-02T18:21:33.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/936: write d9/df/d12/d39/d4e/f8c [1463239,71859] 0 2022-02-02T18:21:33.804 INFO:tasks.workunit.client.0.smithi096.stdout:9/977: rename d1/db/d1c/f6e to d1/db/d1c/d2f/d78/d25/f147 0 2022-02-02T18:21:33.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/993: mknod d15/d1b/d28/c162 0 2022-02-02T18:21:33.805 INFO:tasks.workunit.client.0.smithi096.stdout:4/941: getdents d3/d5a/d103 0 2022-02-02T18:21:33.805 INFO:tasks.workunit.client.0.smithi096.stdout:4/942: chown d3/d5a 0 1 2022-02-02T18:21:33.806 INFO:tasks.workunit.client.0.smithi096.stdout:4/943: fsync d3/f32 0 2022-02-02T18:21:33.807 INFO:tasks.workunit.client.0.smithi096.stdout:7/937: rmdir d9/df/d93/d146 0 2022-02-02T18:21:33.808 INFO:tasks.workunit.client.0.smithi096.stdout:8/919: dwrite d29/d58/d63/fed [0,4194304] 0 2022-02-02T18:21:33.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/920: getdents d29/d2d/d42/d128/d129 0 2022-02-02T18:21:33.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/941: rename db/de/d10/d25/d4c/dd8/def/dc2/dfa/d75/lc8 to db/d5c/d60/d139/l150 0 2022-02-02T18:21:33.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/942: chown db/de/d10/d25/c6a 2 1 2022-02-02T18:21:33.811 INFO:tasks.workunit.client.0.smithi096.stdout:9/978: mknod d1/db/d1c/d2f/d78/d11/d1e/d66/c148 0 2022-02-02T18:21:33.817 INFO:tasks.workunit.client.0.smithi096.stdout:1/994: mkdir d15/d1b/d26/d72/da3/da7/d140/d163 0 2022-02-02T18:21:33.821 INFO:tasks.workunit.client.0.smithi096.stdout:7/938: unlink d9/df/d16/d25/d98/fbb 0 2022-02-02T18:21:33.827 INFO:tasks.workunit.client.0.smithi096.stdout:5/943: symlink db/de/d10/d27/l151 0 2022-02-02T18:21:33.829 INFO:tasks.workunit.client.0.smithi096.stdout:4/944: dwrite d3/d4/d20/d26/d36/d88/ff8 [0,4194304] 0 2022-02-02T18:21:33.829 INFO:tasks.workunit.client.0.smithi096.stdout:4/945: fsync d3/d4/d20/d26/d36/d102/d109/df4/f1f 0 2022-02-02T18:21:33.829 INFO:tasks.workunit.client.0.smithi096.stdout:4/946: read - d3/d60/d8d/dc6/dd0/f104 zero size 2022-02-02T18:21:33.829 INFO:tasks.workunit.client.0.smithi096.stdout:9/979: mknod d1/db/d1c/d2f/d78/d11/d1e/d38/d68/c149 0 2022-02-02T18:21:33.830 INFO:tasks.workunit.client.0.smithi096.stdout:5/944: write db/de/fb6 [959216,112658] 0 2022-02-02T18:21:33.830 INFO:tasks.workunit.client.0.smithi096.stdout:5/945: fsync db/dbd/d10a/f14a 0 2022-02-02T18:21:33.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/921: dwrite f23 [4194304,4194304] 0 2022-02-02T18:21:33.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/922: chown d29/da7/d102/db3/l5e 451060 1 2022-02-02T18:21:33.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/923: chown d29/da7/d102/db3/d6d/c75 1 1 2022-02-02T18:21:33.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/924: fsync d29/da7/d102/dcc/d5b/d81/f12a 0 2022-02-02T18:21:33.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/925: chown d29/d2d/d47/l9c 10481867 1 2022-02-02T18:21:33.831 INFO:tasks.workunit.client.0.smithi096.stdout:1/995: symlink d15/d1b/d26/d72/dff/l164 0 2022-02-02T18:21:33.831 INFO:tasks.workunit.client.0.smithi096.stdout:1/996: chown d15/d1b/d26/d72/f13c 57164191 1 2022-02-02T18:21:33.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/939: rename d9/df/d47/d37/d83/db1 to d9/df/d16/d25/d149 0 2022-02-02T18:21:33.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/940: fsync f2 0 2022-02-02T18:21:33.841 INFO:tasks.workunit.client.0.smithi096.stdout:3/944: sync 2022-02-02T18:21:33.841 INFO:tasks.workunit.client.0.smithi096.stdout:9/980: chown d1/db/d48/de3/de5/f9c 209648168 1 2022-02-02T18:21:33.841 INFO:tasks.workunit.client.0.smithi096.stdout:9/981: chown d1/db/d1c/d2f/d78/d11/d1e/d38/d68/f86 25054167 1 2022-02-02T18:21:33.844 INFO:tasks.workunit.client.0.smithi096.stdout:5/946: mkdir db/d5c/d60/d152 0 2022-02-02T18:21:33.845 INFO:tasks.workunit.client.0.smithi096.stdout:8/926: creat d29/da7/d102/db3/d6d/d83/db9/f138 x:0 0 0 2022-02-02T18:21:33.845 INFO:tasks.workunit.client.0.smithi096.stdout:8/927: write d29/d2d/f3f [175871,77960] 0 2022-02-02T18:21:33.846 INFO:tasks.workunit.client.0.smithi096.stdout:7/941: mkdir d9/df/d12/d39/d46/d143/d14a 0 2022-02-02T18:21:33.846 INFO:tasks.workunit.client.0.smithi096.stdout:7/942: creat d9/df/d12/d39/d40/d51/f14b x:0 0 0 2022-02-02T18:21:33.847 INFO:tasks.workunit.client.0.smithi096.stdout:4/947: dread d3/d27/fdd [0,4194304] 0 2022-02-02T18:21:33.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/982: symlink d1/l14a 0 2022-02-02T18:21:33.849 INFO:tasks.workunit.client.0.smithi096.stdout:9/983: symlink d1/db/d1c/d2f/d78/l14b 0 2022-02-02T18:21:33.849 INFO:tasks.workunit.client.0.smithi096.stdout:7/943: mknod d9/df/d44/c14c 0 2022-02-02T18:21:33.849 INFO:tasks.workunit.client.0.smithi096.stdout:7/944: stat d9/df/d12/d39/d40/d51/f14b 0 2022-02-02T18:21:33.849 INFO:tasks.workunit.client.0.smithi096.stdout:7/945: write d9/df/d16/d25/d98/d138/fc8 [972227,67036] 0 2022-02-02T18:21:33.850 INFO:tasks.workunit.client.0.smithi096.stdout:9/984: dread - d1/db/d63/da2/f11e zero size 2022-02-02T18:21:33.854 INFO:tasks.workunit.client.0.smithi096.stdout:5/947: dread db/de/d2e/d35/f95 [0,4194304] 0 2022-02-02T18:21:33.855 INFO:tasks.workunit.client.0.smithi096.stdout:5/948: write db/de/d10/d25/d4c/dd8/f131 [988615,8975] 0 2022-02-02T18:21:33.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/948: write f1 [1743379,104358] 0 2022-02-02T18:21:33.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/949: truncate d3/d60/d8d/ff9 450702 0 2022-02-02T18:21:33.861 INFO:tasks.workunit.client.0.smithi096.stdout:4/950: symlink d3/d4/d20/d26/d36/d88/d98/l13b 0 2022-02-02T18:21:33.865 INFO:tasks.workunit.client.0.smithi096.stdout:9/985: dread d1/db/d48/de3/de5/f9c [0,4194304] 0 2022-02-02T18:21:33.865 INFO:tasks.workunit.client.0.smithi096.stdout:4/951: rename d3/d4/d20/d26/d36/d88/dd8/de1 to d3/d4/d20/d26/d13c 0 2022-02-02T18:21:33.880 INFO:tasks.workunit.client.0.smithi096.stdout:9/986: dread d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d6d/fd9 [0,4194304] 0 2022-02-02T18:21:33.887 INFO:tasks.workunit.client.0.smithi096.stdout:1/997: dwrite d15/d1b/d28/d3f/f123 [0,4194304] 0 2022-02-02T18:21:33.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/945: dwrite d2/df/f26 [8388608,4194304] 0 2022-02-02T18:21:33.890 INFO:tasks.workunit.client.0.smithi096.stdout:3/946: write d2/df/d34/d76/dd3/d104/daa/dfc/d103/d11a/f123 [619283,51883] 0 2022-02-02T18:21:33.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/928: dwrite d29/d2d/d42/f73 [0,4194304] 0 2022-02-02T18:21:33.892 INFO:tasks.workunit.client.0.smithi096.stdout:1/998: mkdir d15/d1b/d26/d72/da3/da7/d140/d165 0 2022-02-02T18:21:33.892 INFO:tasks.workunit.client.0.smithi096.stdout:1/999: truncate d15/d1b/d28/d47/d153/d15c/f15d 183310 0 2022-02-02T18:21:33.893 INFO:tasks.workunit.client.0.smithi096.stdout:5/949: dwrite db/f146 [0,4194304] 0 2022-02-02T18:21:33.893 INFO:tasks.workunit.client.0.smithi096.stdout:7/946: dwrite d9/df/d12/d39/d4e/f12a [0,4194304] 0 2022-02-02T18:21:33.901 INFO:tasks.workunit.client.0.smithi096.stdout:7/947: creat d9/df/d16/d25/d98/d11b/f14d x:0 0 0 2022-02-02T18:21:33.907 INFO:tasks.workunit.client.0.smithi096.stdout:7/948: creat d9/df/d12/d39/d40/f14e x:0 0 0 2022-02-02T18:21:33.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/947: dwrite d2/df/d14/d2c/d74/f7b [4194304,4194304] 0 2022-02-02T18:21:33.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/948: fsync d2/df/d1c/d5d/da3/f102 0 2022-02-02T18:21:33.919 INFO:tasks.workunit.client.0.smithi096.stdout:3/949: symlink d2/df/d14/d2c/d31/l13c 0 2022-02-02T18:21:33.921 INFO:tasks.workunit.client.0.smithi096.stdout:5/950: dwrite db/de/d10/d27/d83/d149/dcc/fd5 [0,4194304] 0 2022-02-02T18:21:33.921 INFO:tasks.workunit.client.0.smithi096.stdout:7/949: dread d9/df/d47/d37/d83/d11c/f12f [0,4194304] 0 2022-02-02T18:21:33.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/950: stat d9/df/d12/d39/d46/d7d/l8e 0 2022-02-02T18:21:33.922 INFO:tasks.workunit.client.0.smithi096.stdout:3/950: symlink d2/df/d1c/d5d/l13d 0 2022-02-02T18:21:33.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/929: dwrite d29/d2d/d42/f51 [0,4194304] 0 2022-02-02T18:21:33.928 INFO:tasks.workunit.client.0.smithi096.stdout:8/930: mkdir d29/d2d/d42/d136/d139 0 2022-02-02T18:21:33.928 INFO:tasks.workunit.client.0.smithi096.stdout:7/951: mknod d9/df/d47/db7/de3/c14f 0 2022-02-02T18:21:33.929 INFO:tasks.workunit.client.0.smithi096.stdout:7/952: rmdir d9/df/d12/d39/d4e/d6e 39 2022-02-02T18:21:33.929 INFO:tasks.workunit.client.0.smithi096.stdout:7/953: write d9/df/d16/fa1 [126029,9516] 0 2022-02-02T18:21:33.930 INFO:tasks.workunit.client.0.smithi096.stdout:8/931: dread d29/d2d/d87/da5/fc9 [0,4194304] 0 2022-02-02T18:21:33.932 INFO:tasks.workunit.client.0.smithi096.stdout:8/932: getdents d29/da7/d102/db3/d6d 0 2022-02-02T18:21:33.932 INFO:tasks.workunit.client.0.smithi096.stdout:8/933: write d29/d58/fd8 [971381,88754] 0 2022-02-02T18:21:33.932 INFO:tasks.workunit.client.0.smithi096.stdout:8/934: fsync d29/d58/d63/fed 0 2022-02-02T18:21:33.932 INFO:tasks.workunit.client.0.smithi096.stdout:3/951: dread d2/df/d1c/d114/fc6 [0,4194304] 0 2022-02-02T18:21:33.933 INFO:tasks.workunit.client.0.smithi096.stdout:8/935: link f1f d29/d2d/d42/d136/d139/f13a 0 2022-02-02T18:21:33.935 INFO:tasks.workunit.client.0.smithi096.stdout:3/952: rename d2/df/d14/f10 to d2/df/d14/d2c/d31/f13e 0 2022-02-02T18:21:33.936 INFO:tasks.workunit.client.0.smithi096.stdout:3/953: stat d2/df/d36/l139 0 2022-02-02T18:21:33.936 INFO:tasks.workunit.client.0.smithi096.stdout:3/954: chown d2/df/d14/d2c/d31/da8/lf1 0 1 2022-02-02T18:21:33.936 INFO:tasks.workunit.client.0.smithi096.stdout:8/936: link d29/fa4 d29/da7/d102/de4/f13b 0 2022-02-02T18:21:33.937 INFO:tasks.workunit.client.0.smithi096.stdout:3/955: symlink d2/df/d14/d2c/df4/l13f 0 2022-02-02T18:21:33.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/956: mkdir d2/df/d20/d33/d58/dce/dcf/d100/d140 0 2022-02-02T18:21:33.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/957: dread - d2/df/d1c/fb1 zero size 2022-02-02T18:21:33.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/954: dread d9/df/d12/d39/d46/da4/fce [0,4194304] 0 2022-02-02T18:21:33.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/955: chown d9/df/d47/db7/l116 17 1 2022-02-02T18:21:33.940 INFO:tasks.workunit.client.0.smithi096.stdout:7/956: stat d9/df/d12/c1c 0 2022-02-02T18:21:33.940 INFO:tasks.workunit.client.0.smithi096.stdout:8/937: getdents d29/d2d/d87/da5 0 2022-02-02T18:21:33.941 INFO:tasks.workunit.client.0.smithi096.stdout:7/957: rename d9/df/d12/f6d to d9/df/d12/d39/d4e/f150 0 2022-02-02T18:21:33.941 INFO:tasks.workunit.client.0.smithi096.stdout:7/958: symlink d9/df/d12/d39/d46/d7d/l151 0 2022-02-02T18:21:33.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/951: dwrite db/de/d10/d27/d83/d149/dcc/fd5 [0,4194304] 0 2022-02-02T18:21:33.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/952: fdatasync db/de/d10/fd6 0 2022-02-02T18:21:33.961 INFO:tasks.workunit.client.0.smithi096.stdout:5/953: dwrite db/d20/f29 [0,4194304] 0 2022-02-02T18:21:33.962 INFO:tasks.workunit.client.0.smithi096.stdout:5/954: mkdir db/de/d10/d27/d83/d149/dcc/d112/d153 0 2022-02-02T18:21:33.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/955: rename db/de/d10 to db/de/d2e/d154 0 2022-02-02T18:21:33.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/956: fsync db/de/d2e/d154/d27/d83/d149/dcc/d13e/f143 0 2022-02-02T18:21:33.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/957: symlink db/de/d2e/d154/d27/d83/d149/dcc/l155 0 2022-02-02T18:21:33.971 INFO:tasks.workunit.client.0.smithi096.stdout:5/958: symlink db/de/d2e/d154/l156 0 2022-02-02T18:21:33.971 INFO:tasks.workunit.client.0.smithi096.stdout:5/959: stat db/d5c/d2f/ccf 0 2022-02-02T18:21:33.973 INFO:tasks.workunit.client.0.smithi096.stdout:5/960: rename db/de/d2e/d154/d27/d83/d149/dcc/fd5 to db/dbd/d10a/f157 0 2022-02-02T18:21:33.974 INFO:tasks.workunit.client.0.smithi096.stdout:5/961: write db/de/d2e/d154/d25/d4c/f65 [1848722,123074] 0 2022-02-02T18:21:33.976 INFO:tasks.workunit.client.0.smithi096.stdout:5/962: link db/de/d2e/d154/f137 db/de/d2e/d154/d25/d4c/f158 0 2022-02-02T18:21:33.977 INFO:tasks.workunit.client.0.smithi096.stdout:5/963: link db/de/d2e/d154/d25/d4c/df6/l14e db/de/d2e/d154/d27/d83/d149/dcc/d112/l159 0 2022-02-02T18:21:33.977 INFO:tasks.workunit.client.0.smithi096.stdout:5/964: chown db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/cb8 349 1 2022-02-02T18:21:33.978 INFO:tasks.workunit.client.0.smithi096.stdout:5/965: creat db/de/d2e/d154/d25/d4c/dd8/def/dc2/f15a x:0 0 0 2022-02-02T18:21:33.979 INFO:tasks.workunit.client.0.smithi096.stdout:5/966: stat db/de/d2e/d35/l104 0 2022-02-02T18:21:33.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/967: mkdir db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d15b 0 2022-02-02T18:21:33.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/968: readlink db/de/d2e/d154/d25/d4c/le0 0 2022-02-02T18:21:33.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/969: stat db/de/d2e/d154 0 2022-02-02T18:21:33.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/970: fsync db/de/d2e/d154/d27/f2b 0 2022-02-02T18:21:33.981 INFO:tasks.workunit.client.0.smithi096.stdout:5/971: stat db/de/d2e/d154/d27/f4d 0 2022-02-02T18:21:33.981 INFO:tasks.workunit.client.0.smithi096.stdout:5/972: mknod db/de/d2e/d154/d25/d4c/c15c 0 2022-02-02T18:21:33.982 INFO:tasks.workunit.client.0.smithi096.stdout:5/973: getdents db/d20 0 2022-02-02T18:21:33.982 INFO:tasks.workunit.client.0.smithi096.stdout:5/974: mknod db/dbd/d10a/c15d 0 2022-02-02T18:21:33.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/975: getdents db/d5c/d60/d139 0 2022-02-02T18:21:33.998 INFO:tasks.workunit.client.0.smithi096.stdout:5/976: dwrite db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/fcd [0,4194304] 0 2022-02-02T18:21:34.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/977: dread f6 [0,4194304] 0 2022-02-02T18:21:34.019 INFO:tasks.workunit.client.0.smithi096.stdout:5/978: dwrite db/de/d2e/d154/f137 [0,4194304] 0 2022-02-02T18:21:34.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/987: sync 2022-02-02T18:21:34.022 INFO:tasks.workunit.client.0.smithi096.stdout:4/952: sync 2022-02-02T18:21:34.024 INFO:tasks.workunit.client.0.smithi096.stdout:9/988: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/db0/f108 0 2022-02-02T18:21:34.026 INFO:tasks.workunit.client.0.smithi096.stdout:9/989: unlink d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/d2b/d76/c96 0 2022-02-02T18:21:34.031 INFO:tasks.workunit.client.0.smithi096.stdout:9/990: dread d1/db/d1c/d2f/d78/d11/d1e/d38/f7b [0,4194304] 0 2022-02-02T18:21:34.043 INFO:tasks.workunit.client.0.smithi096.stdout:4/953: dwrite d3/f72 [0,4194304] 0 2022-02-02T18:21:34.052 INFO:tasks.workunit.client.0.smithi096.stdout:9/991: dwrite d1/db/d1c/d2f/d78/d11/d1e/d38/d68/d26/f136 [0,4194304] 0 2022-02-02T18:21:34.055 INFO:tasks.workunit.client.0.smithi096.stdout:9/992: rename d1/db/d1c/d2f/d78/d25/ca4 to d1/db/d1c/d2f/d78/d11/d1e/d47/df3/c14c 0 2022-02-02T18:21:34.057 INFO:tasks.workunit.client.0.smithi096.stdout:9/993: unlink d1/db/d1c/d2f/d78/d25/d8e/d9d/fa5 0 2022-02-02T18:21:34.057 INFO:tasks.workunit.client.0.smithi096.stdout:9/994: truncate d1/db/d1c/d2f/d78/d11/fb1 2859835 0 2022-02-02T18:21:34.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/995: dread d1/db/d1c/d2f/f127 [0,4194304] 0 2022-02-02T18:21:34.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/996: creat d1/db/d1c/d2f/d78/d11/d1e/d47/df3/d10c/f14d x:0 0 0 2022-02-02T18:21:34.062 INFO:tasks.workunit.client.0.smithi096.stdout:4/954: dwrite d3/d4/d20/d26/d36/d51/d57/ff0 [0,4194304] 0 2022-02-02T18:21:34.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/997: read d1/db/f72 [1431154,121629] 0 2022-02-02T18:21:34.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/998: stat d1/db/d48/l13d 0 2022-02-02T18:21:34.063 INFO:tasks.workunit.client.0.smithi096.stdout:9/999: readlink d1/db/d1c/d2f/d78/d131/lef 0 2022-02-02T18:21:34.064 INFO:tasks.workunit.client.0.smithi096.stdout:4/955: creat d3/d4/d20/d26/d36/d102/d109/dfb/d10f/f13d x:0 0 0 2022-02-02T18:21:34.066 INFO:tasks.workunit.client.0.smithi096.stdout:4/956: rename d3/d4/d20/d26/d36/d88/d119 to d3/d4/d20/d26/d36/d88/dd8/ddf/d13e 0 2022-02-02T18:21:34.067 INFO:tasks.workunit.client.0.smithi096.stdout:4/957: mknod d3/d4/d20/d26/d36/d102/d109/dfb/d11e/c13f 0 2022-02-02T18:21:34.077 INFO:tasks.workunit.client.0.smithi096.stdout:3/958: sync 2022-02-02T18:21:34.082 INFO:tasks.workunit.client.0.smithi096.stdout:4/958: dwrite d3/d60/f79 [0,4194304] 0 2022-02-02T18:21:34.087 INFO:tasks.workunit.client.0.smithi096.stdout:3/959: dread d2/df/d14/f50 [0,4194304] 0 2022-02-02T18:21:34.088 INFO:tasks.workunit.client.0.smithi096.stdout:3/960: write d2/df/da6/fad [1997851,44861] 0 2022-02-02T18:21:34.088 INFO:tasks.workunit.client.0.smithi096.stdout:3/961: stat d2/df/f26 0 2022-02-02T18:21:34.092 INFO:tasks.workunit.client.0.smithi096.stdout:4/959: dread d3/d4/d20/d26/d36/d102/d109/df4/f2d [0,4194304] 0 2022-02-02T18:21:34.138 INFO:tasks.workunit.client.0.smithi096.stdout:7/959: sync 2022-02-02T18:21:34.138 INFO:tasks.workunit.client.0.smithi096.stdout:8/938: sync 2022-02-02T18:21:34.140 INFO:tasks.workunit.client.0.smithi096.stdout:5/979: sync 2022-02-02T18:21:34.140 INFO:tasks.workunit.client.0.smithi096.stdout:8/939: write d29/da7/d102/dcc/d5b/d81/f8d [3128355,75051] 0 2022-02-02T18:21:34.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/980: dwrite db/dbd/d10a/f14a [0,4194304] 0 2022-02-02T18:21:34.166 INFO:tasks.workunit.client.0.smithi096.stdout:5/981: chown db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/d9d 132685 1 2022-02-02T18:21:34.166 INFO:tasks.workunit.client.0.smithi096.stdout:7/960: dwrite d9/df/d12/d39/d4e/ff2 [0,4194304] 0 2022-02-02T18:21:34.218 INFO:tasks.workunit.client.0.smithi096.stdout:8/940: mknod d29/d2d/d47/c13c 0 2022-02-02T18:21:34.219 INFO:tasks.workunit.client.0.smithi096.stdout:8/941: read d29/d58/d79/f118 [3176713,90410] 0 2022-02-02T18:21:34.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/942: write d29/d2d/d87/da5/fc9 [49695,9814] 0 2022-02-02T18:21:34.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/943: chown d29/da7/f12e 1029356 1 2022-02-02T18:21:34.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/944: dread - d29/da7/d102/fb0 zero size 2022-02-02T18:21:34.221 INFO:tasks.workunit.client.0.smithi096.stdout:8/945: write d29/da7/d102/dcc/ff0 [108052,118676] 0 2022-02-02T18:21:34.221 INFO:tasks.workunit.client.0.smithi096.stdout:5/982: mkdir db/de/d2e/d154/d25/da0/d85/d15e 0 2022-02-02T18:21:34.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/961: mkdir d9/df/d16/d25/d98/d138/d152 0 2022-02-02T18:21:34.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/962: chown d9/df/d12/d39/d41/dac/d145 778767685 1 2022-02-02T18:21:34.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/963: chown d9/df/d12/f57 25621 1 2022-02-02T18:21:34.225 INFO:tasks.workunit.client.0.smithi096.stdout:8/946: unlink d29/d58/laf 0 2022-02-02T18:21:34.226 INFO:tasks.workunit.client.0.smithi096.stdout:5/983: mkdir db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d105/d15f 0 2022-02-02T18:21:34.228 INFO:tasks.workunit.client.0.smithi096.stdout:3/962: sync 2022-02-02T18:21:34.228 INFO:tasks.workunit.client.0.smithi096.stdout:7/964: creat d9/df/d12/d39/d46/f153 x:0 0 0 2022-02-02T18:21:34.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/960: sync 2022-02-02T18:21:34.228 INFO:tasks.workunit.client.0.smithi096.stdout:7/965: truncate d9/df/d16/f13a 64136 0 2022-02-02T18:21:34.229 INFO:tasks.workunit.client.0.smithi096.stdout:7/966: read d9/df/d16/fbf [543212,15406] 0 2022-02-02T18:21:34.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/947: getdents d29/da7/d102/db3 0 2022-02-02T18:21:34.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/984: creat db/de/d2e/d154/d25/da0/f160 x:0 0 0 2022-02-02T18:21:34.236 INFO:tasks.workunit.client.0.smithi096.stdout:4/961: creat d3/d5a/d103/f140 x:0 0 0 2022-02-02T18:21:34.239 INFO:tasks.workunit.client.0.smithi096.stdout:3/963: rename d2/df/d1c/d5d/d131 to d2/df/d1c/d114/d10b/d141 0 2022-02-02T18:21:34.239 INFO:tasks.workunit.client.0.smithi096.stdout:3/964: getdents d2/df/d14/d2c/d31/da8/de1 0 2022-02-02T18:21:34.239 INFO:tasks.workunit.client.0.smithi096.stdout:3/965: readlink d2/df/d14/l2e 0 2022-02-02T18:21:34.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/948: dread d29/da7/d102/dcc/d5b/f64 [0,4194304] 0 2022-02-02T18:21:34.240 INFO:tasks.workunit.client.0.smithi096.stdout:7/967: mkdir d9/df/d12/d39/d40/d85/d154 0 2022-02-02T18:21:34.242 INFO:tasks.workunit.client.0.smithi096.stdout:3/966: link d2/df/d20/dc4/f105 d2/df/d20/d33/d58/dce/dcf/d100/d140/f142 0 2022-02-02T18:21:34.243 INFO:tasks.workunit.client.0.smithi096.stdout:8/949: rmdir d29/da7/d102/dcc/d5b/dd1 39 2022-02-02T18:21:34.243 INFO:tasks.workunit.client.0.smithi096.stdout:7/968: truncate d9/df/d12/d39/d40/d51/f59 65989 0 2022-02-02T18:21:34.257 INFO:tasks.workunit.client.0.smithi096.stdout:7/969: dread d9/df/d16/d25/d98/fae [0,4194304] 0 2022-02-02T18:21:34.257 INFO:tasks.workunit.client.0.smithi096.stdout:7/970: chown d9/df/d12/d14/d141/f139 770082402 1 2022-02-02T18:21:34.257 INFO:tasks.workunit.client.0.smithi096.stdout:7/971: write d9/df/d47/db7/de3/f102 [116729,78760] 0 2022-02-02T18:21:34.266 INFO:tasks.workunit.client.0.smithi096.stdout:5/985: dwrite db/de/d2e/f51 [0,4194304] 0 2022-02-02T18:21:34.270 INFO:tasks.workunit.client.0.smithi096.stdout:5/986: creat db/de/d2e/d154/d25/d4c/dd8/f161 x:0 0 0 2022-02-02T18:21:34.271 INFO:tasks.workunit.client.0.smithi096.stdout:4/962: dwrite d3/d4/d20/d26/d36/d102/d109/dfb/d11e/f12e [0,4194304] 0 2022-02-02T18:21:34.271 INFO:tasks.workunit.client.0.smithi096.stdout:4/963: readlink d3/d4/d20/d26/d36/lb0 0 2022-02-02T18:21:34.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/972: dread d9/df/d12/d39/d41/f6a [0,4194304] 0 2022-02-02T18:21:34.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/973: fdatasync d9/df/d16/f29 0 2022-02-02T18:21:34.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:33 smithi159 conmon[35668]: cluster 2022-02-02T18:21:32.827146+0000 mgr.smithi096.shfutl (mgr.14162) 271 : 2022-02-02T18:21:34.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:33 smithi159 conmon[35668]: cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 1.9 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 125 MiB/s rd, 249 MiB/s wr, 540 op/s 2022-02-02T18:21:34.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/987: truncate db/de/d2e/d154/f137 2584886 0 2022-02-02T18:21:34.281 INFO:tasks.workunit.client.0.smithi096.stdout:5/988: write db/de/d2e/d154/d25/d4c/f10f [220236,57378] 0 2022-02-02T18:21:34.283 INFO:tasks.workunit.client.0.smithi096.stdout:4/964: mkdir d3/d4/d20/d26/d36/d102/d109/d141 0 2022-02-02T18:21:34.299 INFO:tasks.workunit.client.0.smithi096.stdout:3/967: rename d2/df/d20/dc4 to d2/df/d14/d73/d143 0 2022-02-02T18:21:34.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/989: mknod db/de/d2e/d154/d25/d4c/dd8/def/dc2/dfa/d75/d9d/d15b/c162 0 2022-02-02T18:21:34.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/990: read - db/de/d2e/d154/d27/d83/d149/dcc/d112/f116 zero size 2022-02-02T18:21:34.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/991: write db/de/d2e/d154/d27/fb2 [694331,18077] 0 2022-02-02T18:21:34.304 INFO:tasks.workunit.client.0.smithi096.stdout:7/974: rmdir d9/df/d54 39 2022-02-02T18:21:34.304 INFO:tasks.workunit.client.0.smithi096.stdout:3/968: write d2/df/d1c/d5d/d69/f55 [1502512,23724] 0 2022-02-02T18:21:34.307 INFO:tasks.workunit.client.0.smithi096.stdout:4/965: rename d3/d60/d8d/da7/c7e to d3/d60/dbd/c142 0 2022-02-02T18:21:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:33 smithi096 conmon[32067]: cluster 2022-02-02T18:21:32.827146+0000 mgr.smithi096.shfutl (mgr.14162) 271 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 1.9 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 125 MiB/s rd, 249 MiB/s wr, 540 op/s 2022-02-02T18:21:34.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/966: dwrite d3/d60/fb2 [0,4194304] 0 2022-02-02T18:21:34.345 INFO:tasks.workunit.client.0.smithi096.stdout:4/967: write d3/d4/d20/d26/f5e [901466,68560] 0 2022-02-02T18:21:34.346 INFO:tasks.workunit.client.0.smithi096.stdout:5/992: dwrite db/de/d2e/d35/fe3 [0,4194304] 0 2022-02-02T18:21:34.348 INFO:tasks.workunit.client.0.smithi096.stdout:3/969: dwrite d2/df/d14/d66/f101 [0,4194304] 0 2022-02-02T18:21:34.348 INFO:tasks.workunit.client.0.smithi096.stdout:3/970: read - d2/d71/f11e zero size 2022-02-02T18:21:34.348 INFO:tasks.workunit.client.0.smithi096.stdout:4/968: symlink d3/d4/d20/d26/d36/d102/d109/d118/d130/l143 0 2022-02-02T18:21:34.348 INFO:tasks.workunit.client.0.smithi096.stdout:5/993: write db/de/f16 [999554,68786] 0 2022-02-02T18:21:34.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/994: dread - db/de/d2e/d154/d25/d4c/dd8/f161 zero size 2022-02-02T18:21:34.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/995: chown db/de/d2e/d35/l104 1390628 1 2022-02-02T18:21:34.349 INFO:tasks.workunit.client.0.smithi096.stdout:4/969: write d3/d4/f24 [499858,13648] 0 2022-02-02T18:21:34.349 INFO:tasks.workunit.client.0.smithi096.stdout:7/975: dwrite d9/f3e [0,4194304] 0 2022-02-02T18:21:34.350 INFO:tasks.workunit.client.0.smithi096.stdout:7/976: read d9/df/f10b [172648,120898] 0 2022-02-02T18:21:34.350 INFO:tasks.workunit.client.0.smithi096.stdout:3/971: link d2/df/d14/d2c/d31/l13c d2/df/d14/d2c/d74/l144 0 2022-02-02T18:21:34.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/972: write d2/df/d20/d33/d58/d7c/fab [762853,93470] 0 2022-02-02T18:21:34.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/973: write d2/df/d36/d8d/fd9 [674630,113413] 0 2022-02-02T18:21:34.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/977: dread d9/df/d12/d14/f50 [0,4194304] 0 2022-02-02T18:21:34.359 INFO:tasks.workunit.client.0.smithi096.stdout:4/970: mknod d3/d4/d20/d26/d12a/c144 0 2022-02-02T18:21:34.361 INFO:tasks.workunit.client.0.smithi096.stdout:3/974: mkdir d2/df/d20/d4a/d108/d145 0 2022-02-02T18:21:34.361 INFO:tasks.workunit.client.0.smithi096.stdout:4/971: write d3/d60/dc2/fe0 [281499,91729] 0 2022-02-02T18:21:34.361 INFO:tasks.workunit.client.0.smithi096.stdout:4/972: dread - d3/d5a/d103/f140 zero size 2022-02-02T18:21:34.363 INFO:tasks.workunit.client.0.smithi096.stdout:3/975: write d2/df/d20/fee [1142732,56170] 0 2022-02-02T18:21:34.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/978: rename d9/df/d16/d25/d98/d138 to d9/df/d12/d39/d46/d7d/dd7/d155 0 2022-02-02T18:21:34.365 INFO:tasks.workunit.client.0.smithi096.stdout:4/973: mkdir d3/d4/db9/d145 0 2022-02-02T18:21:34.365 INFO:tasks.workunit.client.0.smithi096.stdout:4/974: write d3/d5a/d103/f140 [749994,1251] 0 2022-02-02T18:21:34.365 INFO:tasks.workunit.client.0.smithi096.stdout:4/975: readlink d3/d60/d8d/da7/lbf 0 2022-02-02T18:21:34.366 INFO:tasks.workunit.client.0.smithi096.stdout:3/976: creat d2/df/d14/d2c/d31/f146 x:0 0 0 2022-02-02T18:21:34.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/979: creat d9/df/d47/db7/de3/f156 x:0 0 0 2022-02-02T18:21:34.368 INFO:tasks.workunit.client.0.smithi096.stdout:5/996: dwrite db/de/d2e/d154/d27/d83/f125 [0,4194304] 0 2022-02-02T18:21:34.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/977: mknod d2/df/d14/d73/c147 0 2022-02-02T18:21:34.369 INFO:tasks.workunit.client.0.smithi096.stdout:5/997: write db/de/f16 [12366,72870] 0 2022-02-02T18:21:34.369 INFO:tasks.workunit.client.0.smithi096.stdout:7/980: write d9/df/d12/d39/d40/fe8 [1079522,128455] 0 2022-02-02T18:21:34.370 INFO:tasks.workunit.client.0.smithi096.stdout:4/976: dread d3/f10 [0,4194304] 0 2022-02-02T18:21:34.370 INFO:tasks.workunit.client.0.smithi096.stdout:4/977: chown d3/d4/d20 1 1 2022-02-02T18:21:34.373 INFO:tasks.workunit.client.0.smithi096.stdout:5/998: creat db/d5c/d60/d139/f163 x:0 0 0 2022-02-02T18:21:34.373 INFO:tasks.workunit.client.0.smithi096.stdout:5/999: write db/dbd/d10a/f11a [900849,15971] 0 2022-02-02T18:21:34.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/950: sync 2022-02-02T18:21:34.377 INFO:tasks.workunit.client.0.smithi096.stdout:7/981: rmdir d9/df/d47/dd3/d11f 39 2022-02-02T18:21:34.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/951: write d29/da7/d102/ff6 [493884,126524] 0 2022-02-02T18:21:34.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/952: fdatasync d29/fa4 0 2022-02-02T18:21:34.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/953: chown d29/f12d 7300222 1 2022-02-02T18:21:34.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/954: chown d29/d58/l108 50871 1 2022-02-02T18:21:34.380 INFO:tasks.workunit.client.0.smithi096.stdout:7/982: link d9/df/d12/d39/d40/d51/l62 d9/df/d12/d39/d40/d122/l157 0 2022-02-02T18:21:34.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/955: mknod d29/da7/d102/dcc/d5b/c13d 0 2022-02-02T18:21:34.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/983: mknod d9/df/d12/d39/d40/d122/c158 0 2022-02-02T18:21:34.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/956: rename d29/da7/d102/db3/d6d/f103 to d29/d58/d7a/d116/f13e 0 2022-02-02T18:21:34.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/957: truncate d29/da7/d102/dcc/d5b/dd9/dce/fdc 805492 0 2022-02-02T18:21:34.391 INFO:tasks.workunit.client.0.smithi096.stdout:7/984: truncate d9/df/d12/f32 2718128 0 2022-02-02T18:21:34.391 INFO:tasks.workunit.client.0.smithi096.stdout:8/958: symlink d29/d2d/d87/def/l13f 0 2022-02-02T18:21:34.391 INFO:tasks.workunit.client.0.smithi096.stdout:8/959: dread - d29/d58/d7a/f109 zero size 2022-02-02T18:21:34.392 INFO:tasks.workunit.client.0.smithi096.stdout:8/960: dread d29/d2d/d87/da5/fd6 [4194304,4194304] 0 2022-02-02T18:21:34.392 INFO:tasks.workunit.client.0.smithi096.stdout:8/961: truncate d29/da7/d102/db3/d6d/d85/f9d 2039543 0 2022-02-02T18:21:34.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/985: link d9/df/d47/d37/d83/d11c/da5/lb2 d9/df/d47/d19/l159 0 2022-02-02T18:21:34.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/962: getdents d29/da7/d102/db3/d6d/d83 0 2022-02-02T18:21:34.393 INFO:tasks.workunit.client.0.smithi096.stdout:7/986: symlink d9/df/d12/d39/d40/d11a/l15a 0 2022-02-02T18:21:34.394 INFO:tasks.workunit.client.0.smithi096.stdout:8/963: creat d29/da7/d102/dcc/d5b/dd9/f140 x:0 0 0 2022-02-02T18:21:34.397 INFO:tasks.workunit.client.0.smithi096.stdout:7/987: creat d9/df/d148/f15b x:0 0 0 2022-02-02T18:21:34.397 INFO:tasks.workunit.client.0.smithi096.stdout:3/978: dwrite d2/df/da6/fb4 [0,4194304] 0 2022-02-02T18:21:34.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/978: dwrite d3/d27/f41 [0,4194304] 0 2022-02-02T18:21:34.399 INFO:tasks.workunit.client.0.smithi096.stdout:7/988: rmdir d9/df/d54 39 2022-02-02T18:21:34.403 INFO:tasks.workunit.client.0.smithi096.stdout:7/989: truncate d9/df/d93/f119 776089 0 2022-02-02T18:21:34.406 INFO:tasks.workunit.client.0.smithi096.stdout:7/990: mknod d9/c15c 0 2022-02-02T18:21:34.408 INFO:tasks.workunit.client.0.smithi096.stdout:7/991: write d9/df/d12/d39/d4e/f150 [3217439,105082] 0 2022-02-02T18:21:34.411 INFO:tasks.workunit.client.0.smithi096.stdout:7/992: mkdir d9/df/d54/d15d 0 2022-02-02T18:21:34.411 INFO:tasks.workunit.client.0.smithi096.stdout:7/993: fsync d9/df/d16/d25/f135 0 2022-02-02T18:21:34.412 INFO:tasks.workunit.client.0.smithi096.stdout:7/994: stat d9/df/d47/d37/c123 0 2022-02-02T18:21:34.421 INFO:tasks.workunit.client.0.smithi096.stdout:7/995: dread d9/df/d47/d37/d83/d11c/f9f [0,4194304] 0 2022-02-02T18:21:34.422 INFO:tasks.workunit.client.0.smithi096.stdout:7/996: truncate d9/df/d12/d39/d40/d11a/f12b 656002 0 2022-02-02T18:21:34.424 INFO:tasks.workunit.client.0.smithi096.stdout:7/997: mknod d9/df/d12/d39/d40/d85/d154/c15e 0 2022-02-02T18:21:34.424 INFO:tasks.workunit.client.0.smithi096.stdout:8/964: dwrite d29/da7/d102/db3/f98 [0,4194304] 0 2022-02-02T18:21:34.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/979: dwrite d2/df/d1c/d5d/d69/d43/d72/f95 [0,4194304] 0 2022-02-02T18:21:34.427 INFO:tasks.workunit.client.0.smithi096.stdout:4/979: dwrite d3/d4/d20/d26/d36/d51/dd5/f138 [0,4194304] 0 2022-02-02T18:21:34.427 INFO:tasks.workunit.client.0.smithi096.stdout:4/980: chown d3/d4/d20/lbb 1824560 1 2022-02-02T18:21:34.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/981: creat d3/d4/d20/d26/d36/d102/d109/dfb/f146 x:0 0 0 2022-02-02T18:21:34.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/982: dread - d3/f113 zero size 2022-02-02T18:21:34.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/983: truncate d3/ff3 747831 0 2022-02-02T18:21:34.432 INFO:tasks.workunit.client.0.smithi096.stdout:8/965: mkdir d29/d58/d79/d141 0 2022-02-02T18:21:34.432 INFO:tasks.workunit.client.0.smithi096.stdout:8/966: chown d29/l2c 10 1 2022-02-02T18:21:34.434 INFO:tasks.workunit.client.0.smithi096.stdout:3/980: mknod d2/df/da6/c148 0 2022-02-02T18:21:34.438 INFO:tasks.workunit.client.0.smithi096.stdout:4/984: symlink d3/d4/d20/d26/d36/d88/dd8/ddf/d13e/l147 0 2022-02-02T18:21:34.439 INFO:tasks.workunit.client.0.smithi096.stdout:8/967: mkdir d29/da7/d102/dc2/d142 0 2022-02-02T18:21:34.440 INFO:tasks.workunit.client.0.smithi096.stdout:4/985: truncate d3/d4/d20/d26/d36/d51/d57/ff0 5567934 0 2022-02-02T18:21:34.442 INFO:tasks.workunit.client.0.smithi096.stdout:8/968: mkdir d29/da7/d102/dc2/d142/d143 0 2022-02-02T18:21:34.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/998: dwrite d9/df/d54/fa3 [0,4194304] 0 2022-02-02T18:21:34.447 INFO:tasks.workunit.client.0.smithi096.stdout:4/986: truncate d3/d4/d20/d26/d36/d51/dd5/f138 2217984 0 2022-02-02T18:21:34.451 INFO:tasks.workunit.client.0.smithi096.stdout:8/969: dread d29/d4e/f8e [0,4194304] 0 2022-02-02T18:21:34.451 INFO:tasks.workunit.client.0.smithi096.stdout:4/987: getdents d3/d27 0 2022-02-02T18:21:34.453 INFO:tasks.workunit.client.0.smithi096.stdout:4/988: mkdir d3/d4/d20/d26/d12a/d148 0 2022-02-02T18:21:34.454 INFO:tasks.workunit.client.0.smithi096.stdout:3/981: dwrite d2/df/d34/d76/dd3/d104/fc0 [0,4194304] 0 2022-02-02T18:21:34.454 INFO:tasks.workunit.client.0.smithi096.stdout:3/982: chown d2/df/d36/la7 28301 1 2022-02-02T18:21:34.455 INFO:tasks.workunit.client.0.smithi096.stdout:4/989: symlink d3/d4/d20/d26/d36/d102/d109/df4/d55/dbc/l149 0 2022-02-02T18:21:34.456 INFO:tasks.workunit.client.0.smithi096.stdout:7/999: write d9/df/d12/d39/d40/d51/f59 [410716,106593] 0 2022-02-02T18:21:34.458 INFO:tasks.workunit.client.0.smithi096.stdout:3/983: truncate d2/df/d14/d2c/d31/da8/fbc 3432501 0 2022-02-02T18:21:34.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/990: unlink d3/d85/c101 0 2022-02-02T18:21:34.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/991: read d3/d4/d20/d26/d36/d102/d109/df4/d55/f9d [1783069,103991] 0 2022-02-02T18:21:34.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/992: read - d3/d4/d20/d26/d36/d51/dd5/f123 zero size 2022-02-02T18:21:34.462 INFO:tasks.workunit.client.0.smithi096.stdout:8/970: dread d29/d58/f101 [0,4194304] 0 2022-02-02T18:21:34.462 INFO:tasks.workunit.client.0.smithi096.stdout:3/984: creat d2/df/d1c/d114/d10b/f149 x:0 0 0 2022-02-02T18:21:34.462 INFO:tasks.workunit.client.0.smithi096.stdout:3/985: truncate d2/df/d1c/d5d/f79 2463854 0 2022-02-02T18:21:34.463 INFO:tasks.workunit.client.0.smithi096.stdout:8/971: mknod d29/d2d/c144 0 2022-02-02T18:21:34.464 INFO:tasks.workunit.client.0.smithi096.stdout:8/972: creat d29/d4e/f145 x:0 0 0 2022-02-02T18:21:34.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/993: symlink d3/d4/db9/d145/l14a 0 2022-02-02T18:21:34.465 INFO:tasks.workunit.client.0.smithi096.stdout:4/994: chown d3/d4/d20/d26/d36/d88/dd8/ddf/d13e 462 1 2022-02-02T18:21:34.466 INFO:tasks.workunit.client.0.smithi096.stdout:3/986: rename d2/df/d36/d8d/ffd to d2/df/d34/d76/dd3/f14a 0 2022-02-02T18:21:34.468 INFO:tasks.workunit.client.0.smithi096.stdout:4/995: creat d3/d4/d20/d26/d36/d102/d109/f14b x:0 0 0 2022-02-02T18:21:34.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/987: symlink d2/df/d20/d33/d58/dce/dcf/d100/d140/l14b 0 2022-02-02T18:21:34.471 INFO:tasks.workunit.client.0.smithi096.stdout:4/996: mknod d3/d60/da8/d11f/c14c 0 2022-02-02T18:21:34.472 INFO:tasks.workunit.client.0.smithi096.stdout:4/997: write d3/f4f [1130460,33723] 0 2022-02-02T18:21:34.473 INFO:tasks.workunit.client.0.smithi096.stdout:3/988: link d2/df/d14/d2c/cf6 d2/df/d20/d33/d58/dce/dcf/d100/c14c 0 2022-02-02T18:21:34.474 INFO:tasks.workunit.client.0.smithi096.stdout:3/989: getdents d2/df/d34/d76/dd3/d104/daa 0 2022-02-02T18:21:34.474 INFO:tasks.workunit.client.0.smithi096.stdout:3/990: mknod d2/df/d34/d76/dd3/d104/daa/dfc/c14d 0 2022-02-02T18:21:34.475 INFO:tasks.workunit.client.0.smithi096.stdout:3/991: creat d2/df/d1c/d5d/d69/d43/f14e x:0 0 0 2022-02-02T18:21:34.476 INFO:tasks.workunit.client.0.smithi096.stdout:3/992: symlink d2/df/d20/d33/d58/dce/l14f 0 2022-02-02T18:21:34.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/993: write d2/df/d14/d73/d143/dfa/f138 [30997,111282] 0 2022-02-02T18:21:34.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/973: dwrite d29/d2d/d47/f6e [0,4194304] 0 2022-02-02T18:21:34.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/974: chown d29/lf5 451 1 2022-02-02T18:21:34.500 INFO:tasks.workunit.client.0.smithi096.stdout:3/994: dwrite d2/df/d14/d66/f101 [0,4194304] 0 2022-02-02T18:21:34.501 INFO:tasks.workunit.client.0.smithi096.stdout:4/998: dwrite d3/d60/da8/f134 [0,4194304] 0 2022-02-02T18:21:34.502 INFO:tasks.workunit.client.0.smithi096.stdout:3/995: creat d2/df/d14/dbe/f150 x:0 0 0 2022-02-02T18:21:34.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/999: link d3/d4/d20/d26/d36/d102/d109/df4/d55/c117 d3/d60/d8d/c14d 0 2022-02-02T18:21:34.507 INFO:tasks.workunit.client.0.smithi096.stdout:8/975: dwrite d29/d2d/d47/fff [4194304,4194304] 0 2022-02-02T18:21:34.507 INFO:tasks.workunit.client.0.smithi096.stdout:8/976: fdatasync d29/da7/f12e 0 2022-02-02T18:21:34.509 INFO:tasks.workunit.client.0.smithi096.stdout:8/977: creat d29/da7/d102/dc2/d127/f146 x:0 0 0 2022-02-02T18:21:34.513 INFO:tasks.workunit.client.0.smithi096.stdout:8/978: rename d29/da7/d102/dcc/d5b/d81/f8d to d29/da7/d102/db3/d6d/d83/db9/df4/f147 0 2022-02-02T18:21:34.535 INFO:tasks.workunit.client.0.smithi096.stdout:8/979: dread d29/da7/d102/ff6 [0,4194304] 0 2022-02-02T18:21:34.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/980: rename f17 to d29/da7/d102/dc2/d142/d143/f148 0 2022-02-02T18:21:34.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/981: getdents d29/da7/d102/dcc/d5b/dd1 0 2022-02-02T18:21:34.550 INFO:tasks.workunit.client.0.smithi096.stdout:8/982: rmdir d29/da7/d102 39 2022-02-02T18:21:34.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/983: dwrite d29/d58/d63/ff1 [0,4194304] 0 2022-02-02T18:21:34.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/984: dread d29/d58/d79/fc8 [0,4194304] 0 2022-02-02T18:21:34.566 INFO:tasks.workunit.client.0.smithi096.stdout:8/985: mknod d29/d2d/c149 0 2022-02-02T18:21:34.567 INFO:tasks.workunit.client.0.smithi096.stdout:8/986: symlink d29/da7/d102/dcc/d5b/d81/dec/l14a 0 2022-02-02T18:21:34.567 INFO:tasks.workunit.client.0.smithi096.stdout:8/987: chown d29/d58/d7a/f7f 574411 1 2022-02-02T18:21:34.569 INFO:tasks.workunit.client.0.smithi096.stdout:8/988: creat d29/da7/d102/dcc/d5b/dd9/dce/f14b x:0 0 0 2022-02-02T18:21:34.576 INFO:tasks.workunit.client.0.smithi096.stdout:8/989: dread d29/f2b [0,4194304] 0 2022-02-02T18:21:34.577 INFO:tasks.workunit.client.0.smithi096.stdout:8/990: creat d29/da7/d102/dcc/d5b/dd9/d104/f14c x:0 0 0 2022-02-02T18:21:34.578 INFO:tasks.workunit.client.0.smithi096.stdout:8/991: dread d29/d58/d7a/f7f [0,4194304] 0 2022-02-02T18:21:34.579 INFO:tasks.workunit.client.0.smithi096.stdout:8/992: write d29/d58/d79/f118 [3713248,47083] 0 2022-02-02T18:21:34.581 INFO:tasks.workunit.client.0.smithi096.stdout:8/993: symlink d29/da7/d102/dc2/d127/l14d 0 2022-02-02T18:21:34.581 INFO:tasks.workunit.client.0.smithi096.stdout:8/994: chown d29/d2d/lac 1025722213 1 2022-02-02T18:21:34.581 INFO:tasks.workunit.client.0.smithi096.stdout:8/995: creat d29/da7/d102/dcc/d5b/d81/f14e x:0 0 0 2022-02-02T18:21:34.588 INFO:tasks.workunit.client.0.smithi096.stdout:8/996: dread d29/d2d/d47/fa2 [0,4194304] 0 2022-02-02T18:21:34.589 INFO:tasks.workunit.client.0.smithi096.stdout:8/997: creat d29/da7/d102/dcc/f14f x:0 0 0 2022-02-02T18:21:34.590 INFO:tasks.workunit.client.0.smithi096.stdout:8/998: mkdir d29/da7/d102/d150 0 2022-02-02T18:21:34.591 INFO:tasks.workunit.client.0.smithi096.stdout:8/999: creat d29/d2d/d42/f151 x:0 0 0 2022-02-02T18:21:34.966 INFO:tasks.workunit.client.0.smithi096.stdout:3/996: sync 2022-02-02T18:21:34.971 INFO:tasks.workunit.client.0.smithi096.stdout:3/997: rename d2/df/d14/lc to d2/df/d1c/d114/d10b/l151 0 2022-02-02T18:21:34.971 INFO:tasks.workunit.client.0.smithi096.stdout:3/998: chown d2/df/d14/d2c/df4 7554 1 2022-02-02T18:21:34.972 INFO:tasks.workunit.client.0.smithi096.stdout:3/999: creat d2/df/d20/d33/d58/dce/dcf/d100/d140/f152 x:0 0 0 2022-02-02T18:21:34.975 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm -rf -- ./tmp.kPwonJpaO0 2022-02-02T18:21:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:35 smithi159 conmon[35668]: cluster 2022-02-02T18:21:34.827723+0000 mgr.smithi096.shfutl (mgr.14162) 272 : cluster [DBG] 2022-02-02T18:21:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:35 smithi159 conmon[35668]: pgmap v221: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 129 MiB/s rd, 256 MiB/s wr, 413 op/s 2022-02-02T18:21:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:35 smithi159 conmon[35668]: cluster 2022-02-02T18:21:34.955935+0000 mon.smithi096 (mon.0) 566 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:21:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:35 smithi096 conmon[32067]: cluster 2022-02-02T18:21:34.827723+0000 mgr.smithi096.shfutl (mgr.14162) 272 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 129 MiB/s rd, 256 MiB/s wr, 413 op/s 2022-02-02T18:21:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:35 smithi096 conmon[32067]: cluster 2022-02-02T18:21:34.955935+0000 mon.smithi096 (mon 2022-02-02T18:21:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:35 smithi096 conmon[32067]: .0) 566 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:21:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:37 smithi159 conmon[35668]: cluster 2022-02-02T18:21:36.828186+0000 mgr.smithi096.shfutl (mgr.14162) 273 : cluster [DBG] 2022-02-02T18:21:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:37 smithi159 conmon[35668]: pgmap v222: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 156 MiB/s rd, 319 MiB/s wr, 507 op/s 2022-02-02T18:21:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:37 smithi096 conmon[32067]: cluster 2022-02-02T18:21:36.828186+0000 mgr.smithi096.shfutl ( 2022-02-02T18:21:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:37 smithi096 conmon[32067]: mgr.14162) 273 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 156 MiB/s rd, 319 MiB/s wr, 507 op/s 2022-02-02T18:21:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:39 smithi159 conmon[35668]: cluster 2022-02-02T18:21:38.828545 2022-02-02T18:21:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:39 smithi159 conmon[35668]: +0000 mgr.smithi096.shfutl (mgr.14162) 274 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 115 MiB/s rd, 242 MiB/s wr, 361 op/s 2022-02-02T18:21:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:39 smithi096 conmon[32067]: cluster 2022-02-02T18:21:38.828545+0000 mgr.smithi096.shfutl 2022-02-02T18:21:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:39 smithi096 conmon[32067]: (mgr.14162) 274 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 115 MiB/s rd, 242 MiB/s wr, 361 op/s 2022-02-02T18:21:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 -- 172.21.15.96:0/3463079402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3704060270 msgr2=0x7f37040f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 --2- 172.21.15.96:0/3463079402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3704060270 0x7f37040f9340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f36f4004660 tx=0x7f36f4009b30).stop 2022-02-02T18:21:40.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 -- 172.21.15.96:0/3463079402 shutdown_connections 2022-02-02T18:21:40.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 --2- 172.21.15.96:0/3463079402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37040f9830 0x7f37040fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 --2- 172.21.15.96:0/3463079402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3704060270 0x7f37040f9340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.593+0000 7f37089a3700 1 -- 172.21.15.96:0/3463079402 >> 172.21.15.96:0/3463079402 conn(0x7f37040f0d40 msgr2=0x7f37040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 -- 172.21.15.96:0/3463079402 shutdown_connections 2022-02-02T18:21:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 -- 172.21.15.96:0/3463079402 wait complete. 2022-02-02T18:21:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 Processor -- start 2022-02-02T18:21:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 -- start start 2022-02-02T18:21:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.594+0000 7f37089a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f37089a3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37041079a0 con 0x7f37040f9830 2022-02-02T18:21:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f37089a3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704107ae0 con 0x7f3704060270 2022-02-02T18:21:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f370259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52552/0 (socket says 172.21.15.96:52552) 2022-02-02T18:21:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f370259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56654/0 (socket says 172.21.15.96:56654) 2022-02-02T18:21:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 -- 172.21.15.96:0/1179656081 learned_addr learned my addr 172.21.15.96:0/1179656081 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 -- 172.21.15.96:0/1179656081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 msgr2=0x7f3704106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 -- 172.21.15.96:0/1179656081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f4005040 con 0x7f37040f9830 2022-02-02T18:21:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f370259c700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:21:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f3701d9b700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f36f800e7c0 tx=0x7f36f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36f80092e0 con 0x7f37040f9830 2022-02-02T18:21:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704108480 con 0x7f37040f9830 2022-02-02T18:21:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f36f800f040 con 0x7f37040f9830 2022-02-02T18:21:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36f8014830 con 0x7f37040f9830 2022-02-02T18:21:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.595+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3704108a40 con 0x7f37040f9830 2022-02-02T18:21:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f36f8009440 con 0x7f37040f9830 2022-02-02T18:21:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3704045ad0 con 0x7f37040f9830 2022-02-02T18:21:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f36f2ffd700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 0x7f36ec05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f36f8075f90 con 0x7f37040f9830 2022-02-02T18:21:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f370259c700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 0x7f36ec05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.597+0000 7f370259c700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 0x7f36ec05e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f36f4005010 tx=0x7f36f4016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.601+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f36f80472b0 con 0x7f37040f9830 2022-02-02T18:21:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.798+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3704108c60 con 0x7f36ec05c2b0 2022-02-02T18:21:40.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.799+0000 7f36f2ffd700 1 -- 172.21.15.96:0/1179656081 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f3704108c60 con 0x7f36ec05c2b0 2022-02-02T18:21:40.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 msgr2=0x7f36ec05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 0x7f36ec05e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f36f4005010 tx=0x7f36f4016040).stop 2022-02-02T18:21:40.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 msgr2=0x7f37041073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f36f800e7c0 tx=0x7f36f800b040).stop 2022-02-02T18:21:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 shutdown_connections 2022-02-02T18:21:40.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f36ec05c2b0 0x7f36ec05e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704060270 0x7f3704106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 --2- 172.21.15.96:0/1179656081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37040f9830 0x7f37041073f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 >> 172.21.15.96:0/1179656081 conn(0x7f37040f0d40 msgr2=0x7f37040f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:40.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 shutdown_connections 2022-02-02T18:21:40.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.801+0000 7f37089a3700 1 -- 172.21.15.96:0/1179656081 wait complete. 2022-02-02T18:21:40.814 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:21:40.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 -- 172.21.15.96:0/2385421372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f77d0 msgr2=0x7f7f740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/2385421372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f77d0 0x7f7f740f7c30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7f64004660 tx=0x7f7f64009b30).stop 2022-02-02T18:21:40.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 -- 172.21.15.96:0/2385421372 shutdown_connections 2022-02-02T18:21:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/2385421372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f77d0 0x7f7f740f7c30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/2385421372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f6530 0x7f7f740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.904+0000 7f7f7aebc700 1 -- 172.21.15.96:0/2385421372 >> 172.21.15.96:0/2385421372 conn(0x7f7f740f1c90 msgr2=0x7f7f740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.905+0000 7f7f7aebc700 1 -- 172.21.15.96:0/2385421372 shutdown_connections 2022-02-02T18:21:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.905+0000 7f7f7aebc700 1 -- 172.21.15.96:0/2385421372 wait complete. 2022-02-02T18:21:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 Processor -- start 2022-02-02T18:21:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 -- start start 2022-02-02T18:21:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f77d0 0x7f7f74107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74107830 con 0x7f7f740f6530 2022-02-02T18:21:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f7aebc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74108040 con 0x7f7f740f77d0 2022-02-02T18:21:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52560/0 (socket says 172.21.15.96:52560) 2022-02-02T18:21:40.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 -- 172.21.15.96:0/3876046916 learned_addr learned my addr 172.21.15.96:0/3876046916 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:40.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f796b9700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f77d0 0x7f7f74107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 -- 172.21.15.96:0/3876046916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f77d0 msgr2=0x7f7f74107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:40.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f77d0 0x7f7f74107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.906+0000 7f7f79eba700 1 -- 172.21.15.96:0/3876046916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64005040 con 0x7f7f740f6530 2022-02-02T18:21:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f79eba700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7f7000e7c0 tx=0x7f7f7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f700092e0 con 0x7f7f740f6530 2022-02-02T18:21:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f7000f040 con 0x7f7f740f6530 2022-02-02T18:21:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f741082c0 con 0x7f7f740f6530 2022-02-02T18:21:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f700147e0 con 0x7f7f740f6530 2022-02-02T18:21:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.907+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f74108880 con 0x7f7f740f6530 2022-02-02T18:21:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.908+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74059100 con 0x7f7f740f6530 2022-02-02T18:21:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.908+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7f7001b030 con 0x7f7f740f6530 2022-02-02T18:21:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.908+0000 7f7f6a7fc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 0x7f7f6005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.909+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7f70075c10 con 0x7f7f740f6530 2022-02-02T18:21:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.909+0000 7f7f796b9700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 0x7f7f6005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.909+0000 7f7f796b9700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 0x7f7f6005e7c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7f64005010 tx=0x7f7f64016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:40.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:40.913+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7f700489a0 con 0x7f7f740f6530 2022-02-02T18:21:41.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.100+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 --> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f740008d0 con 0x7f7f6005c300 2022-02-02T18:21:41.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.108+0000 7f7f6a7fc700 1 -- 172.21.15.96:0/3876046916 <== mgr.14162 v2:172.21.15.96:6800/4170397281 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2662 (secure 0 0 0) 0x7f7f740008d0 con 0x7f7f6005c300 2022-02-02T18:21:41.111 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T18:21:41.112 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 114s ago 6m 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:21:41.112 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (6m) 114s ago 6m 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:21:41.113 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (5m) 119s ago 5m 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:21:41.113 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4m) 114s ago 5m 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:21:41.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2m) 114s ago 2m 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:21:41.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2m) 114s ago 2m 16.2.4 8d91d370c2b8 02d535f62526 2022-02-02T18:21:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2m) 119s ago 2m 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:21:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2m) 119s ago 2m 16.2.4 8d91d370c2b8 1be2a63e320d 2022-02-02T18:21:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (7m) 114s ago 7m 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:21:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (5m) 119s ago 5m 16.2.4 8d91d370c2b8 744df187ddef 2022-02-02T18:21:41.115 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (7m) 114s ago 7m 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:21:41.115 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (5m) 119s ago 5m 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:21:41.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (5m) 114s ago 5m 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:21:41.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (5m) 119s ago 5m 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:21:41.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 114s ago 4m 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:21:41.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 114s ago 4m 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:21:41.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 114s ago 4m 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:21:41.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4m) 119s ago 4m 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:21:41.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3m) 119s ago 3m 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:21:41.118 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3m) 119s ago 3m 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:21:41.118 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4m) 114s ago 5m 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:21:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.109+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 msgr2=0x7f7f6005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.109+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 0x7f7f6005e7c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7f64005010 tx=0x7f7f64016040).stop 2022-02-02T18:21:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.109+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 msgr2=0x7f7f74106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.109+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7f7000e7c0 tx=0x7f7f7000b040).stop 2022-02-02T18:21:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 shutdown_connections 2022-02-02T18:21:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f7f6005c300 0x7f7f6005e7c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f740f6530 0x7f7f74106d40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 --2- 172.21.15.96:0/3876046916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f740f77d0 0x7f7f74107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 >> 172.21.15.96:0/3876046916 conn(0x7f7f740f1c90 msgr2=0x7f7f740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 shutdown_connections 2022-02-02T18:21:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.110+0000 7f7f7aebc700 1 -- 172.21.15.96:0/3876046916 wait complete. 2022-02-02T18:21:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- 172.21.15.96:0/2936944647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 msgr2=0x7f15ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 --2- 172.21.15.96:0/2936944647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac0f6cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f159c004660 tx=0x7f159c009b30).stop 2022-02-02T18:21:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- 172.21.15.96:0/2936944647 shutdown_connections 2022-02-02T18:21:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 --2- 172.21.15.96:0/2936944647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac0f6cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 --2- 172.21.15.96:0/2936944647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- 172.21.15.96:0/2936944647 >> 172.21.15.96:0/2936944647 conn(0x7f15ac0f0d40 msgr2=0x7f15ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- 172.21.15.96:0/2936944647 shutdown_connections 2022-02-02T18:21:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- 172.21.15.96:0/2936944647 wait complete. 2022-02-02T18:21:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 Processor -- start 2022-02-02T18:21:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.215+0000 7f15b17cd700 1 -- start start 2022-02-02T18:21:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15b17cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15b17cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15b17cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac106920 con 0x7f15ac0f6860 2022-02-02T18:21:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15b17cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac107130 con 0x7f15ac0f55c0 2022-02-02T18:21:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aaffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aaffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56672/0 (socket says 172.21.15.96:56672) 2022-02-02T18:21:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aaffd700 1 -- 172.21.15.96:0/4243805379 learned_addr learned my addr 172.21.15.96:0/4243805379 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aa7fc700 1 -- 172.21.15.96:0/4243805379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 msgr2=0x7f15ac105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aa7fc700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aa7fc700 1 -- 172.21.15.96:0/4243805379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c005040 con 0x7f15ac0f6860 2022-02-02T18:21:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aaffd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:21:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15aa7fc700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac106320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f159c000c00 tx=0x7f159c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c007ba0 con 0x7f15ac0f6860 2022-02-02T18:21:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac107350 con 0x7f15ac0f6860 2022-02-02T18:21:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.216+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f159c0097d0 con 0x7f15ac0f6860 2022-02-02T18:21:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.217+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c01a460 con 0x7f15ac0f6860 2022-02-02T18:21:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.217+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac107850 con 0x7f15ac0f6860 2022-02-02T18:21:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.217+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0f49b0 con 0x7f15ac0f6860 2022-02-02T18:21:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.218+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f159c018040 con 0x7f15ac0f6860 2022-02-02T18:21:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.218+0000 7f15937fe700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 0x7f159405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.219+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f159c07a940 con 0x7f15ac0f6860 2022-02-02T18:21:41.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.219+0000 7f15aaffd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 0x7f159405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.219+0000 7f15aaffd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 0x7f159405e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f15ac105ba0 tx=0x7f15a000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:41.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.222+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f159c04d6a0 con 0x7f15ac0f6860 2022-02-02T18:21:41.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.518+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15ac045ad0 con 0x7f15ac0f6860 2022-02-02T18:21:41.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.518+0000 7f15937fe700 1 -- 172.21.15.96:0/4243805379 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f159c050cc0 con 0x7f15ac0f6860 2022-02-02T18:21:41.526 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:21:41.526 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:21:41.526 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:21:41.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:41.527 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:21:41.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:21:41.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:41.528 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:21:41.528 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:21:41.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:41.528 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:21:41.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:21:41.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:21:41.529 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:21:41.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T18:21:41.529 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:21:41.530 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:21:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 msgr2=0x7f159405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 0x7f159405e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f15ac105ba0 tx=0x7f15a000b040).stop 2022-02-02T18:21:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 msgr2=0x7f15ac106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac106320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f159c000c00 tx=0x7f159c009b30).stop 2022-02-02T18:21:41.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 shutdown_connections 2022-02-02T18:21:41.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7f159405c2b0 0x7f159405e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac0f55c0 0x7f15ac105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 --2- 172.21.15.96:0/4243805379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15ac0f6860 0x7f15ac106320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 >> 172.21.15.96:0/4243805379 conn(0x7f15ac0f0d40 msgr2=0x7f15ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 shutdown_connections 2022-02-02T18:21:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.520+0000 7f15b17cd700 1 -- 172.21.15.96:0/4243805379 wait complete. 2022-02-02T18:21:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 -- 172.21.15.96:0/1711108138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f55c0 msgr2=0x7fa4280f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 --2- 172.21.15.96:0/1711108138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f55c0 0x7fa4280f59e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa418004660 tx=0x7fa418009b30).stop 2022-02-02T18:21:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 -- 172.21.15.96:0/1711108138 shutdown_connections 2022-02-02T18:21:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 --2- 172.21.15.96:0/1711108138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f6860 0x7fa4280f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 --2- 172.21.15.96:0/1711108138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f55c0 0x7fa4280f59e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 -- 172.21.15.96:0/1711108138 >> 172.21.15.96:0/1711108138 conn(0x7fa4280f0d40 msgr2=0x7fa4280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 -- 172.21.15.96:0/1711108138 shutdown_connections 2022-02-02T18:21:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.622+0000 7fa42de82700 1 -- 172.21.15.96:0/1711108138 wait complete. 2022-02-02T18:21:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 Processor -- start 2022-02-02T18:21:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 -- start start 2022-02-02T18:21:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f55c0 0x7fa428105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428106950 con 0x7fa4280f6860 2022-02-02T18:21:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa42de82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428107160 con 0x7fa4280f55c0 2022-02-02T18:21:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52580/0 (socket says 172.21.15.96:52580) 2022-02-02T18:21:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 -- 172.21.15.96:0/857141031 learned_addr learned my addr 172.21.15.96:0/857141031 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:21:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa4277fe700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f55c0 0x7fa428105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 -- 172.21.15.96:0/857141031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f55c0 msgr2=0x7fa428105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f55c0 0x7fa428105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.623+0000 7fa426ffd700 1 -- 172.21.15.96:0/857141031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418005040 con 0x7fa4280f6860 2022-02-02T18:21:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa426ffd700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa410010a00 tx=0x7fa41000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4100094c0 con 0x7fa4280f6860 2022-02-02T18:21:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428107380 con 0x7fa4280f6860 2022-02-02T18:21:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa410010e90 con 0x7fa4280f6860 2022-02-02T18:21:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa410007db0 con 0x7fa4280f6860 2022-02-02T18:21:41.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.624+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa428107910 con 0x7fa4280f6860 2022-02-02T18:21:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.625+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4280f49b0 con 0x7fa4280f6860 2022-02-02T18:21:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.625+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa410022070 con 0x7fa4280f6860 2022-02-02T18:21:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.625+0000 7fa41ffff700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 0x7fa41405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:21:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.626+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa410078680 con 0x7fa4280f6860 2022-02-02T18:21:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.626+0000 7fa4277fe700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 0x7fa41405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:21:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.626+0000 7fa4277fe700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 0x7fa41405e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa418000c00 tx=0x7fa418016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:21:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.630+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa41004b360 con 0x7fa4280f6860 2022-02-02T18:21:41.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.830+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa428045ad0 con 0x7fa4280f6860 2022-02-02T18:21:41.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.831+0000 7fa41ffff700 1 -- 172.21.15.96:0/857141031 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1655 (secure 0 0 0) 0x7fa410016020 con 0x7fa4280f6860 2022-02-02T18:21:41.834 INFO:teuthology.orchestra.run.smithi096.stdout:e17 2022-02-02T18:21:41.835 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:21:41.835 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:21:41.836 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:21:41.836 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:41.836 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:21:41.836 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:21:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 17 2022-02-02T18:21:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:21:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:21:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:21:34.948030+0000 2022-02-02T18:21:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:21:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:21:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:21:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:21:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:21:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:21:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:21:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:21:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:21:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:21:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:21:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:21:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:21:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:21:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:21:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:21:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:21:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:21:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:21:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:21:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:21:41.843 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:21:41.843 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:21:41.843 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:21:41.843 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:41.843 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:21:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.832+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 msgr2=0x7fa41405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.832+0000 7fa42de82700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 0x7fa41405e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa418000c00 tx=0x7fa418016040).stop 2022-02-02T18:21:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.832+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 msgr2=0x7fa428106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:21:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.832+0000 7fa42de82700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa410010a00 tx=0x7fa41000b040).stop 2022-02-02T18:21:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 shutdown_connections 2022-02-02T18:21:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:6800/4170397281,v1:172.21.15.96:6801/4170397281] conn(0x7fa41405c2b0 0x7fa41405e770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4280f55c0 0x7fa428105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 --2- 172.21.15.96:0/857141031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4280f6860 0x7fa428106350 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:21:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 >> 172.21.15.96:0/857141031 conn(0x7fa4280f0d40 msgr2=0x7fa4280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:21:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 shutdown_connections 2022-02-02T18:21:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:21:41.833+0000 7fa42de82700 1 -- 172.21.15.96:0/857141031 wait complete. 2022-02-02T18:21:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2022-02-02T18:21:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: audit 2022-02-02T18:21:40.799626+0000 mgr.smithi096.shfutl ( 2022-02-02T18:21:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: mgr.14162) 275 : audit [DBG] from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: cluster 2022-02-02T18:21:40.828858+0000 mgr.smithi096.shfutl (mgr.14162) 276 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 108 MiB/s rd, 226 MiB/s wr, 352 op/s 2022-02-02T18:21:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: audit 2022-02-02T18:21:41.518984+0000 2022-02-02T18:21:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: mon.smithi096 (mon.0) 567 : audit [DBG] from='client.? 172.21.15.96:0/4243805379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:21:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: audit 2022-02-02T18:21:41.831692+0000 mon.smithi096 2022-02-02T18:21:42.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:41 smithi159 conmon[35668]: (mon.0) 568 : audit [DBG] from='client.? 172.21.15.96:0/857141031' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:21:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: audit 2022-02-02T18:21:40.799626 2022-02-02T18:21:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: +0000 mgr.smithi096.shfutl (mgr.14162) 275 : audit [DBG] from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: cluster 2022-02-02T18:21:40.828858+0000 mgr.smithi096.shfutl (mgr.14162) 276 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 108 MiB/s rd, 226 MiB/s wr, 352 op/s 2022-02-02T18:21:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: audit 2022-02-02T18:21:41.518984+0000 mon.smithi096 (mon.0) 567 : audit [DBG] from='client.? 172.21.15.96:0/4243805379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:21:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: audit 2022-02-02T18:21:41.831692+0000 mon.smithi096 (mon.0 2022-02-02T18:21:42.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:41 smithi096 conmon[32067]: ) 568 : audit [DBG] from='client.? 172.21.15.96:0/857141031' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:21:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:42 smithi096 conmon[32067]: audit 2022-02-02T18:21:41.101689+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:21:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:42 smithi096 conmon[32067]: ) 277 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:42 smithi159 conmon[35668]: audit 2022-02-02T18:21:41.101689+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:21:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:42 smithi159 conmon[35668]: 277 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:21:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:43 smithi159 conmon[35668]: cluster 2022-02-02T18:21:42.829468+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:21:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:43 smithi159 conmon[35668]: ) 278 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 102 MiB/s rd, 213 MiB/s wr, 387 op/s 2022-02-02T18:21:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:43 smithi096 conmon[32067]: cluster 2022-02-02T18:21:42.829468+0000 mgr.smithi096.shfutl (mgr.14162) 278 : cluster 2022-02-02T18:21:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:43 smithi096 conmon[32067]: [DBG] pgmap v225: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 102 MiB/s rd, 213 MiB/s wr, 387 op/s 2022-02-02T18:21:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:44 smithi159 conmon[35668]: cluster 2022-02-02T18:21:44.829969+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:21:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:44 smithi159 conmon[35668]: 279 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 85 MiB/s wr, 195 op/s 2022-02-02T18:21:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:44 smithi096 conmon[32067]: cluster 2022-02-02T18:21:44.829969+0000 mgr.smithi096.shfutl (mgr.14162) 2022-02-02T18:21:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:44 smithi096 conmon[32067]: 279 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 85 MiB/s wr, 195 op/s 2022-02-02T18:21:46.726 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-02-02T18:21:46.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-02-02T18:21:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:47 smithi159 conmon[35668]: cluster 2022-02-02T18:21:46.830408+0000 mgr.smithi096.shfutl 2022-02-02T18:21:48.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:47 smithi159 conmon[35668]: (mgr.14162) 280 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 750 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 73 MiB/s wr, 234 op/s 2022-02-02T18:21:48.107 INFO:tasks.workunit.client.1.smithi159.stdout:7/84: sync 2022-02-02T18:21:48.107 INFO:tasks.workunit.client.1.smithi159.stdout:4/28: sync 2022-02-02T18:21:48.107 INFO:tasks.workunit.client.1.smithi159.stdout:5/27: sync 2022-02-02T18:21:48.108 INFO:tasks.workunit.client.1.smithi159.stdout:2/4: sync 2022-02-02T18:21:48.108 INFO:tasks.workunit.client.1.smithi159.stdout:2/5: write - no filename 2022-02-02T18:21:48.108 INFO:tasks.workunit.client.1.smithi159.stdout:0/5: sync 2022-02-02T18:21:48.108 INFO:tasks.workunit.client.1.smithi159.stdout:7/85: rename d3/d19 to d3/d19/d1c 22 2022-02-02T18:21:48.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/6: stat f0 0 2022-02-02T18:21:48.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/7: readlink - no filename 2022-02-02T18:21:48.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/8: write f0 [46075,66951] 0 2022-02-02T18:21:48.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/66: sync 2022-02-02T18:21:48.109 INFO:tasks.workunit.client.1.smithi159.stdout:6/13: sync 2022-02-02T18:21:48.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/14: fdatasync f1 0 2022-02-02T18:21:48.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/26: sync 2022-02-02T18:21:48.110 INFO:tasks.workunit.client.1.smithi159.stdout:8/44: sync 2022-02-02T18:21:48.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/27: dread - f3 zero size 2022-02-02T18:21:48.111 INFO:tasks.workunit.client.1.smithi159.stdout:8/45: dread - d1/fb zero size 2022-02-02T18:21:48.111 INFO:tasks.workunit.client.1.smithi159.stdout:7/86: symlink d3/d5/l1d 0 2022-02-02T18:21:48.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/9: mkdir d1 0 2022-02-02T18:21:48.112 INFO:tasks.workunit.client.1.smithi159.stdout:6/15: mknod c5 0 2022-02-02T18:21:48.112 INFO:tasks.workunit.client.1.smithi159.stdout:6/16: stat f3 0 2022-02-02T18:21:48.113 INFO:tasks.workunit.client.1.smithi159.stdout:6/17: dread - f1 zero size 2022-02-02T18:21:48.113 INFO:tasks.workunit.client.1.smithi159.stdout:2/6: symlink l0 0 2022-02-02T18:21:48.113 INFO:tasks.workunit.client.1.smithi159.stdout:1/32: sync 2022-02-02T18:21:48.113 INFO:tasks.workunit.client.1.smithi159.stdout:1/33: creat fb x:0 0 0 2022-02-02T18:21:48.114 INFO:tasks.workunit.client.1.smithi159.stdout:3/67: mknod dd/c15 0 2022-02-02T18:21:48.114 INFO:tasks.workunit.client.1.smithi159.stdout:9/28: mknod d4/c5 0 2022-02-02T18:21:48.114 INFO:tasks.workunit.client.1.smithi159.stdout:8/46: mkdir d1/dc 0 2022-02-02T18:21:48.116 INFO:tasks.workunit.client.1.smithi159.stdout:0/10: creat d1/f2 x:0 0 0 2022-02-02T18:21:48.116 INFO:tasks.workunit.client.1.smithi159.stdout:0/11: dread - d1/f2 zero size 2022-02-02T18:21:48.116 INFO:tasks.workunit.client.1.smithi159.stdout:0/12: creat d1/f3 x:0 0 0 2022-02-02T18:21:48.117 INFO:tasks.workunit.client.1.smithi159.stdout:0/13: creat d1/f4 x:0 0 0 2022-02-02T18:21:48.117 INFO:tasks.workunit.client.1.smithi159.stdout:0/14: truncate d1/f4 34552 0 2022-02-02T18:21:48.117 INFO:tasks.workunit.client.1.smithi159.stdout:2/7: creat f1 x:0 0 0 2022-02-02T18:21:48.118 INFO:tasks.workunit.client.1.smithi159.stdout:2/8: chown f1 618187479 1 2022-02-02T18:21:48.118 INFO:tasks.workunit.client.1.smithi159.stdout:1/34: symlink lc 0 2022-02-02T18:21:48.119 INFO:tasks.workunit.client.1.smithi159.stdout:1/35: creat fd x:0 0 0 2022-02-02T18:21:48.119 INFO:tasks.workunit.client.1.smithi159.stdout:1/36: chown f1 8259945 1 2022-02-02T18:21:48.121 INFO:tasks.workunit.client.1.smithi159.stdout:9/29: rename d4/c5 to d4/c6 0 2022-02-02T18:21:48.122 INFO:tasks.workunit.client.1.smithi159.stdout:8/47: mkdir d1/dd 0 2022-02-02T18:21:48.123 INFO:tasks.workunit.client.1.smithi159.stdout:8/48: creat d1/fe x:0 0 0 2022-02-02T18:21:48.123 INFO:tasks.workunit.client.1.smithi159.stdout:8/49: write d1/fa [639208,24736] 0 2022-02-02T18:21:48.123 INFO:tasks.workunit.client.1.smithi159.stdout:8/50: dread - d1/fe zero size 2022-02-02T18:21:48.129 INFO:tasks.workunit.client.1.smithi159.stdout:9/30: creat d4/f7 x:0 0 0 2022-02-02T18:21:48.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/29: dwrite d0/f3 [0,4194304] 0 2022-02-02T18:21:48.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/30: chown d0/f3 731088 1 2022-02-02T18:21:48.132 INFO:tasks.workunit.client.1.smithi159.stdout:1/37: unlink l8 0 2022-02-02T18:21:48.138 INFO:tasks.workunit.client.1.smithi159.stdout:8/51: mknod d1/cf 0 2022-02-02T18:21:48.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/87: dwrite d3/d5/d8/f11 [0,4194304] 0 2022-02-02T18:21:48.148 INFO:tasks.workunit.client.1.smithi159.stdout:6/18: dwrite f1 [0,4194304] 0 2022-02-02T18:21:48.150 INFO:tasks.workunit.client.1.smithi159.stdout:9/31: dwrite d4/f7 [0,4194304] 0 2022-02-02T18:21:48.151 INFO:tasks.workunit.client.1.smithi159.stdout:3/68: getdents dd 0 2022-02-02T18:21:48.151 INFO:tasks.workunit.client.1.smithi159.stdout:9/32: write d4/f7 [1098468,65051] 0 2022-02-02T18:21:48.152 INFO:tasks.workunit.client.1.smithi159.stdout:9/33: chown f3 5 1 2022-02-02T18:21:48.155 INFO:tasks.workunit.client.1.smithi159.stdout:7/88: dread d3/fb [4194304,4194304] 0 2022-02-02T18:21:48.156 INFO:tasks.workunit.client.1.smithi159.stdout:2/9: getdents . 0 2022-02-02T18:21:48.156 INFO:tasks.workunit.client.1.smithi159.stdout:2/10: dread - f1 zero size 2022-02-02T18:21:48.157 INFO:tasks.workunit.client.1.smithi159.stdout:0/15: fsync d1/f4 0 2022-02-02T18:21:48.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/16: creat d1/f5 x:0 0 0 2022-02-02T18:21:48.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/17: truncate d1/f5 530411 0 2022-02-02T18:21:48.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/18: creat d1/f6 x:0 0 0 2022-02-02T18:21:48.159 INFO:tasks.workunit.client.1.smithi159.stdout:1/38: write f4 [906721,50129] 0 2022-02-02T18:21:48.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/52: rmdir d1 39 2022-02-02T18:21:48.164 INFO:tasks.workunit.client.1.smithi159.stdout:3/69: mkdir dd/d16 0 2022-02-02T18:21:48.168 INFO:tasks.workunit.client.1.smithi159.stdout:7/89: mknod d3/d5/c1e 0 2022-02-02T18:21:48.168 INFO:tasks.workunit.client.1.smithi159.stdout:2/11: mknod c2 0 2022-02-02T18:21:48.169 INFO:tasks.workunit.client.1.smithi159.stdout:7/90: fdatasync d3/f14 0 2022-02-02T18:21:48.169 INFO:tasks.workunit.client.1.smithi159.stdout:7/91: read - d3/d6/f17 zero size 2022-02-02T18:21:48.171 INFO:tasks.workunit.client.1.smithi159.stdout:6/19: write f3 [833017,10190] 0 2022-02-02T18:21:48.172 INFO:tasks.workunit.client.1.smithi159.stdout:8/53: mknod d1/dd/c10 0 2022-02-02T18:21:48.172 INFO:tasks.workunit.client.1.smithi159.stdout:8/54: write d1/fb [116708,42889] 0 2022-02-02T18:21:48.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/34: getdents d4 0 2022-02-02T18:21:48.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/35: chown d4 1782 1 2022-02-02T18:21:48.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/36: truncate f3 135121 0 2022-02-02T18:21:48.177 INFO:tasks.workunit.client.1.smithi159.stdout:2/12: dread - f1 zero size 2022-02-02T18:21:48.178 INFO:tasks.workunit.client.1.smithi159.stdout:7/92: mknod d3/c1f 0 2022-02-02T18:21:48.181 INFO:tasks.workunit.client.1.smithi159.stdout:6/20: creat f6 x:0 0 0 2022-02-02T18:21:48.181 INFO:tasks.workunit.client.1.smithi159.stdout:6/21: chown f6 309212 1 2022-02-02T18:21:48.182 INFO:tasks.workunit.client.1.smithi159.stdout:8/55: mknod d1/dd/c11 0 2022-02-02T18:21:48.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/37: rename d4/f7 to d4/f8 0 2022-02-02T18:21:48.183 INFO:tasks.workunit.client.1.smithi159.stdout:4/31: dwrite d0/f5 [0,4194304] 0 2022-02-02T18:21:48.183 INFO:tasks.workunit.client.1.smithi159.stdout:4/32: chown d0/l4 5861 1 2022-02-02T18:21:48.184 INFO:tasks.workunit.client.1.smithi159.stdout:2/13: symlink l3 0 2022-02-02T18:21:48.186 INFO:tasks.workunit.client.1.smithi159.stdout:9/38: mknod d4/c9 0 2022-02-02T18:21:48.187 INFO:tasks.workunit.client.1.smithi159.stdout:9/39: dread f3 [0,4194304] 0 2022-02-02T18:21:48.191 INFO:tasks.workunit.client.1.smithi159.stdout:4/33: symlink d0/d8/le 0 2022-02-02T18:21:48.191 INFO:tasks.workunit.client.1.smithi159.stdout:2/14: readlink l0 0 2022-02-02T18:21:48.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/19: getdents d1 0 2022-02-02T18:21:48.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/40: creat d4/fa x:0 0 0 2022-02-02T18:21:48.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/41: creat d4/fb x:0 0 0 2022-02-02T18:21:48.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/42: dread - d4/fa zero size 2022-02-02T18:21:48.196 INFO:tasks.workunit.client.1.smithi159.stdout:3/70: write f5 [810783,128558] 0 2022-02-02T18:21:48.196 INFO:tasks.workunit.client.1.smithi159.stdout:8/56: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:48.197 INFO:tasks.workunit.client.1.smithi159.stdout:4/34: creat d0/ff x:0 0 0 2022-02-02T18:21:48.199 INFO:tasks.workunit.client.1.smithi159.stdout:2/15: unlink l0 0 2022-02-02T18:21:48.199 INFO:tasks.workunit.client.1.smithi159.stdout:2/16: write f1 [230321,4861] 0 2022-02-02T18:21:48.199 INFO:tasks.workunit.client.1.smithi159.stdout:2/17: unlink c2 0 2022-02-02T18:21:48.200 INFO:tasks.workunit.client.1.smithi159.stdout:0/20: symlink d1/l7 0 2022-02-02T18:21:48.205 INFO:tasks.workunit.client.1.smithi159.stdout:2/18: dread f1 [0,4194304] 0 2022-02-02T18:21:48.206 INFO:tasks.workunit.client.1.smithi159.stdout:2/19: read f1 [7099,105747] 0 2022-02-02T18:21:48.206 INFO:tasks.workunit.client.1.smithi159.stdout:2/20: rmdir - no directory 2022-02-02T18:21:48.206 INFO:tasks.workunit.client.1.smithi159.stdout:2/21: fdatasync f1 0 2022-02-02T18:21:48.207 INFO:tasks.workunit.client.1.smithi159.stdout:4/35: creat d0/d8/f10 x:0 0 0 2022-02-02T18:21:48.207 INFO:tasks.workunit.client.1.smithi159.stdout:4/36: creat d0/f11 x:0 0 0 2022-02-02T18:21:48.209 INFO:tasks.workunit.client.1.smithi159.stdout:0/21: creat d1/f8 x:0 0 0 2022-02-02T18:21:48.209 INFO:tasks.workunit.client.1.smithi159.stdout:6/22: dread f1 [0,4194304] 0 2022-02-02T18:21:48.210 INFO:tasks.workunit.client.1.smithi159.stdout:3/71: mknod dd/c17 0 2022-02-02T18:21:48.214 INFO:tasks.workunit.client.1.smithi159.stdout:2/22: rename l3 to l4 0 2022-02-02T18:21:48.214 INFO:tasks.workunit.client.1.smithi159.stdout:2/23: fdatasync f1 0 2022-02-02T18:21:48.215 INFO:tasks.workunit.client.1.smithi159.stdout:0/22: symlink d1/l9 0 2022-02-02T18:21:48.217 INFO:tasks.workunit.client.1.smithi159.stdout:2/24: symlink l5 0 2022-02-02T18:21:48.217 INFO:tasks.workunit.client.1.smithi159.stdout:2/25: fdatasync f1 0 2022-02-02T18:21:48.218 INFO:tasks.workunit.client.1.smithi159.stdout:2/26: readlink l4 0 2022-02-02T18:21:48.219 INFO:tasks.workunit.client.1.smithi159.stdout:6/23: read f1 [3783310,123687] 0 2022-02-02T18:21:48.219 INFO:tasks.workunit.client.1.smithi159.stdout:6/24: rmdir - no directory 2022-02-02T18:21:48.219 INFO:tasks.workunit.client.1.smithi159.stdout:6/25: fsync f1 0 2022-02-02T18:21:48.219 INFO:tasks.workunit.client.1.smithi159.stdout:6/26: truncate f6 946237 0 2022-02-02T18:21:48.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/23: rename d1/f6 to d1/fa 0 2022-02-02T18:21:48.220 INFO:tasks.workunit.client.1.smithi159.stdout:6/27: write f3 [3689715,108197] 0 2022-02-02T18:21:48.221 INFO:tasks.workunit.client.1.smithi159.stdout:6/28: creat f7 x:0 0 0 2022-02-02T18:21:48.229 INFO:tasks.workunit.client.1.smithi159.stdout:3/72: getdents dd 0 2022-02-02T18:21:48.230 INFO:tasks.workunit.client.1.smithi159.stdout:3/73: write f7 [111198,2112] 0 2022-02-02T18:21:48.230 INFO:tasks.workunit.client.1.smithi159.stdout:6/29: dread f1 [0,4194304] 0 2022-02-02T18:21:48.230 INFO:tasks.workunit.client.1.smithi159.stdout:6/30: dread - f7 zero size 2022-02-02T18:21:48.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/74: creat dd/f18 x:0 0 0 2022-02-02T18:21:48.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/75: chown f5 36 1 2022-02-02T18:21:48.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/76: fsync dd/f11 0 2022-02-02T18:21:48.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/77: chown dd/c17 37975298 1 2022-02-02T18:21:48.232 INFO:tasks.workunit.client.1.smithi159.stdout:0/24: link d1/f5 d1/fb 0 2022-02-02T18:21:48.235 INFO:tasks.workunit.client.1.smithi159.stdout:3/78: rename dd/d16 to dd/d19 0 2022-02-02T18:21:48.236 INFO:tasks.workunit.client.1.smithi159.stdout:2/27: dwrite f1 [0,4194304] 0 2022-02-02T18:21:48.236 INFO:tasks.workunit.client.1.smithi159.stdout:4/37: dwrite d0/d8/f10 [0,4194304] 0 2022-02-02T18:21:48.237 INFO:tasks.workunit.client.1.smithi159.stdout:8/57: dwrite d1/fe [0,4194304] 0 2022-02-02T18:21:48.240 INFO:tasks.workunit.client.1.smithi159.stdout:3/79: unlink l8 0 2022-02-02T18:21:48.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/25: rmdir d1 39 2022-02-02T18:21:48.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/26: fsync d1/fa 0 2022-02-02T18:21:48.249 INFO:tasks.workunit.client.1.smithi159.stdout:0/27: creat d1/fc x:0 0 0 2022-02-02T18:21:48.249 INFO:tasks.workunit.client.1.smithi159.stdout:0/28: write d1/f8 [169162,15318] 0 2022-02-02T18:21:48.250 INFO:tasks.workunit.client.1.smithi159.stdout:2/28: symlink l6 0 2022-02-02T18:21:48.252 INFO:tasks.workunit.client.1.smithi159.stdout:0/29: mkdir d1/dd 0 2022-02-02T18:21:48.253 INFO:tasks.workunit.client.1.smithi159.stdout:2/29: symlink l7 0 2022-02-02T18:21:48.253 INFO:tasks.workunit.client.1.smithi159.stdout:3/80: dread fc [0,4194304] 0 2022-02-02T18:21:48.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/30: creat d1/fe x:0 0 0 2022-02-02T18:21:48.254 INFO:tasks.workunit.client.1.smithi159.stdout:4/38: write d0/f5 [4077650,29655] 0 2022-02-02T18:21:48.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/31: symlink d1/dd/lf 0 2022-02-02T18:21:48.261 INFO:tasks.workunit.client.1.smithi159.stdout:0/32: creat d1/f10 x:0 0 0 2022-02-02T18:21:48.261 INFO:tasks.workunit.client.1.smithi159.stdout:0/33: write d1/f8 [650768,57861] 0 2022-02-02T18:21:48.261 INFO:tasks.workunit.client.1.smithi159.stdout:6/31: dwrite f6 [0,4194304] 0 2022-02-02T18:21:48.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/32: fsync f1 0 2022-02-02T18:21:48.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/33: write f7 [742068,62421] 0 2022-02-02T18:21:48.262 INFO:tasks.workunit.client.1.smithi159.stdout:8/58: dwrite d1/f4 [0,4194304] 0 2022-02-02T18:21:48.263 INFO:tasks.workunit.client.1.smithi159.stdout:2/30: link f1 f8 0 2022-02-02T18:21:48.263 INFO:tasks.workunit.client.1.smithi159.stdout:0/34: write d1/f4 [249350,62245] 0 2022-02-02T18:21:48.264 INFO:tasks.workunit.client.1.smithi159.stdout:8/59: write d1/fa [396072,78056] 0 2022-02-02T18:21:48.264 INFO:tasks.workunit.client.1.smithi159.stdout:8/60: chown d1/dd 251 1 2022-02-02T18:21:48.265 INFO:tasks.workunit.client.1.smithi159.stdout:0/35: fdatasync d1/f2 0 2022-02-02T18:21:48.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/36: mkdir d1/d11 0 2022-02-02T18:21:48.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/37: fsync d1/f2 0 2022-02-02T18:21:48.276 INFO:tasks.workunit.client.1.smithi159.stdout:0/38: symlink d1/dd/l12 0 2022-02-02T18:21:48.277 INFO:tasks.workunit.client.1.smithi159.stdout:0/39: dread d1/f5 [0,4194304] 0 2022-02-02T18:21:48.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/40: mknod d1/c13 0 2022-02-02T18:21:48.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/41: stat d1/dd 0 2022-02-02T18:21:48.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/42: rename d1/d11 to d1/d11/d14 22 2022-02-02T18:21:48.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/43: readlink d1/l7 0 2022-02-02T18:21:48.283 INFO:tasks.workunit.client.1.smithi159.stdout:0/44: rename d1/l9 to d1/dd/l15 0 2022-02-02T18:21:48.285 INFO:tasks.workunit.client.1.smithi159.stdout:6/34: dread f6 [0,4194304] 0 2022-02-02T18:21:48.289 INFO:tasks.workunit.client.1.smithi159.stdout:8/61: unlink d1/fb 0 2022-02-02T18:21:48.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/62: symlink d1/dd/l12 0 2022-02-02T18:21:48.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/63: chown d1/dd/c11 20325 1 2022-02-02T18:21:48.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/64: rename d1 to d1/d13 22 2022-02-02T18:21:48.293 INFO:tasks.workunit.client.1.smithi159.stdout:8/65: symlink d1/dc/l14 0 2022-02-02T18:21:48.294 INFO:tasks.workunit.client.1.smithi159.stdout:3/81: dwrite f7 [0,4194304] 0 2022-02-02T18:21:48.294 INFO:tasks.workunit.client.1.smithi159.stdout:6/35: dread f1 [0,4194304] 0 2022-02-02T18:21:48.296 INFO:tasks.workunit.client.1.smithi159.stdout:6/36: write f6 [2733325,91283] 0 2022-02-02T18:21:48.298 INFO:tasks.workunit.client.1.smithi159.stdout:3/82: creat dd/d19/f1a x:0 0 0 2022-02-02T18:21:48.298 INFO:tasks.workunit.client.1.smithi159.stdout:4/39: dwrite d0/f5 [0,4194304] 0 2022-02-02T18:21:48.301 INFO:tasks.workunit.client.1.smithi159.stdout:6/37: rename c0 to c8 0 2022-02-02T18:21:48.303 INFO:tasks.workunit.client.1.smithi159.stdout:6/38: symlink l9 0 2022-02-02T18:21:48.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/31: dwrite f8 [0,4194304] 0 2022-02-02T18:21:48.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/32: readlink l4 0 2022-02-02T18:21:48.304 INFO:tasks.workunit.client.1.smithi159.stdout:2/33: getdents . 0 2022-02-02T18:21:48.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:47 smithi096 conmon[32067]: cluster 2022-02-02T18:21:46.830408+0000 mgr.smithi096.shfutl (mgr.14162) 280 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 750 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 73 MiB/s wr, 234 op/s 2022-02-02T18:21:48.321 INFO:tasks.workunit.client.1.smithi159.stdout:2/34: dread f8 [0,4194304] 0 2022-02-02T18:21:48.321 INFO:tasks.workunit.client.1.smithi159.stdout:0/45: dwrite d1/f3 [0,4194304] 0 2022-02-02T18:21:48.322 INFO:tasks.workunit.client.1.smithi159.stdout:0/46: write d1/fe [417094,99499] 0 2022-02-02T18:21:48.324 INFO:tasks.workunit.client.1.smithi159.stdout:2/35: creat f9 x:0 0 0 2022-02-02T18:21:48.324 INFO:tasks.workunit.client.1.smithi159.stdout:8/66: dwrite d1/f4 [0,4194304] 0 2022-02-02T18:21:48.325 INFO:tasks.workunit.client.1.smithi159.stdout:8/67: chown d1/dd/l12 25286384 1 2022-02-02T18:21:48.327 INFO:tasks.workunit.client.1.smithi159.stdout:0/47: unlink d1/l7 0 2022-02-02T18:21:48.327 INFO:tasks.workunit.client.1.smithi159.stdout:0/48: write d1/fe [419867,78042] 0 2022-02-02T18:21:48.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/49: fdatasync d1/f5 0 2022-02-02T18:21:48.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/50: read - d1/fa zero size 2022-02-02T18:21:48.329 INFO:tasks.workunit.client.1.smithi159.stdout:0/51: write d1/f8 [1096957,83988] 0 2022-02-02T18:21:48.329 INFO:tasks.workunit.client.1.smithi159.stdout:0/52: dread - d1/f10 zero size 2022-02-02T18:21:48.329 INFO:tasks.workunit.client.1.smithi159.stdout:2/36: mkdir da 0 2022-02-02T18:21:48.330 INFO:tasks.workunit.client.1.smithi159.stdout:2/37: chown l4 3815994 1 2022-02-02T18:21:48.331 INFO:tasks.workunit.client.1.smithi159.stdout:2/38: mknod da/cb 0 2022-02-02T18:21:48.332 INFO:tasks.workunit.client.1.smithi159.stdout:3/83: dwrite f5 [4194304,4194304] 0 2022-02-02T18:21:48.332 INFO:tasks.workunit.client.1.smithi159.stdout:3/84: dread - dd/f11 zero size 2022-02-02T18:21:48.332 INFO:tasks.workunit.client.1.smithi159.stdout:0/53: read d1/f8 [148729,3497] 0 2022-02-02T18:21:48.339 INFO:tasks.workunit.client.1.smithi159.stdout:8/68: getdents d1 0 2022-02-02T18:21:48.339 INFO:tasks.workunit.client.1.smithi159.stdout:3/85: creat dd/d19/f1b x:0 0 0 2022-02-02T18:21:48.340 INFO:tasks.workunit.client.1.smithi159.stdout:3/86: creat dd/f1c x:0 0 0 2022-02-02T18:21:48.353 INFO:tasks.workunit.client.1.smithi159.stdout:6/39: dread f3 [0,4194304] 0 2022-02-02T18:21:48.353 INFO:tasks.workunit.client.1.smithi159.stdout:0/54: dwrite d1/f10 [0,4194304] 0 2022-02-02T18:21:48.355 INFO:tasks.workunit.client.1.smithi159.stdout:8/69: dread d1/fe [0,4194304] 0 2022-02-02T18:21:48.356 INFO:tasks.workunit.client.1.smithi159.stdout:6/40: write f1 [2606938,75761] 0 2022-02-02T18:21:48.357 INFO:tasks.workunit.client.1.smithi159.stdout:8/70: write d1/fe [664425,57824] 0 2022-02-02T18:21:48.357 INFO:tasks.workunit.client.1.smithi159.stdout:0/55: mknod d1/dd/c16 0 2022-02-02T18:21:48.359 INFO:tasks.workunit.client.1.smithi159.stdout:8/71: symlink d1/l15 0 2022-02-02T18:21:48.360 INFO:tasks.workunit.client.1.smithi159.stdout:0/56: mknod d1/d11/c17 0 2022-02-02T18:21:48.360 INFO:tasks.workunit.client.1.smithi159.stdout:0/57: chown d1/d11 5229266 1 2022-02-02T18:21:48.361 INFO:tasks.workunit.client.1.smithi159.stdout:8/72: creat d1/dd/f16 x:0 0 0 2022-02-02T18:21:48.362 INFO:tasks.workunit.client.1.smithi159.stdout:3/87: dwrite dd/f18 [0,4194304] 0 2022-02-02T18:21:48.363 INFO:tasks.workunit.client.1.smithi159.stdout:0/58: symlink d1/dd/l18 0 2022-02-02T18:21:48.363 INFO:tasks.workunit.client.1.smithi159.stdout:0/59: dread - d1/fc zero size 2022-02-02T18:21:48.368 INFO:tasks.workunit.client.1.smithi159.stdout:3/88: symlink dd/l1d 0 2022-02-02T18:21:48.372 INFO:tasks.workunit.client.1.smithi159.stdout:3/89: write f5 [4858428,8716] 0 2022-02-02T18:21:48.372 INFO:tasks.workunit.client.1.smithi159.stdout:3/90: chown f5 26722 1 2022-02-02T18:21:48.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/91: readlink dd/l14 0 2022-02-02T18:21:48.374 INFO:tasks.workunit.client.1.smithi159.stdout:3/92: creat dd/d19/f1e x:0 0 0 2022-02-02T18:21:48.381 INFO:tasks.workunit.client.1.smithi159.stdout:6/41: dread f1 [0,4194304] 0 2022-02-02T18:21:48.381 INFO:tasks.workunit.client.1.smithi159.stdout:6/42: chown c4 23725284 1 2022-02-02T18:21:48.388 INFO:tasks.workunit.client.1.smithi159.stdout:6/43: link f6 fa 0 2022-02-02T18:21:48.388 INFO:tasks.workunit.client.1.smithi159.stdout:6/44: chown c5 5072163 1 2022-02-02T18:21:48.388 INFO:tasks.workunit.client.1.smithi159.stdout:6/45: chown c4 1431 1 2022-02-02T18:21:48.389 INFO:tasks.workunit.client.1.smithi159.stdout:6/46: readlink l9 0 2022-02-02T18:21:48.389 INFO:tasks.workunit.client.1.smithi159.stdout:0/60: dwrite d1/fc [0,4194304] 0 2022-02-02T18:21:48.389 INFO:tasks.workunit.client.1.smithi159.stdout:0/61: chown d1/f3 1806116 1 2022-02-02T18:21:48.390 INFO:tasks.workunit.client.1.smithi159.stdout:0/62: read - d1/fa zero size 2022-02-02T18:21:48.391 INFO:tasks.workunit.client.1.smithi159.stdout:3/93: rmdir dd 39 2022-02-02T18:21:48.394 INFO:tasks.workunit.client.1.smithi159.stdout:3/94: creat dd/f1f x:0 0 0 2022-02-02T18:21:48.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/47: dread f6 [0,4194304] 0 2022-02-02T18:21:48.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/48: chown f6 126318 1 2022-02-02T18:21:48.413 INFO:tasks.workunit.client.1.smithi159.stdout:6/49: rename c8 to cb 0 2022-02-02T18:21:48.413 INFO:tasks.workunit.client.1.smithi159.stdout:6/50: creat fc x:0 0 0 2022-02-02T18:21:48.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/51: fsync f3 0 2022-02-02T18:21:48.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/52: creat fd x:0 0 0 2022-02-02T18:21:48.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/53: creat fe x:0 0 0 2022-02-02T18:21:48.416 INFO:tasks.workunit.client.1.smithi159.stdout:6/54: mkdir df 0 2022-02-02T18:21:48.418 INFO:tasks.workunit.client.1.smithi159.stdout:0/63: dwrite d1/f5 [0,4194304] 0 2022-02-02T18:21:48.424 INFO:tasks.workunit.client.1.smithi159.stdout:0/64: mkdir d1/d19 0 2022-02-02T18:21:48.425 INFO:tasks.workunit.client.1.smithi159.stdout:3/95: dwrite dd/d19/f1e [0,4194304] 0 2022-02-02T18:21:48.429 INFO:tasks.workunit.client.1.smithi159.stdout:3/96: mkdir dd/d20 0 2022-02-02T18:21:48.429 INFO:tasks.workunit.client.1.smithi159.stdout:3/97: chown l4 1052724 1 2022-02-02T18:21:48.432 INFO:tasks.workunit.client.1.smithi159.stdout:6/55: link cb df/c10 0 2022-02-02T18:21:48.437 INFO:tasks.workunit.client.1.smithi159.stdout:3/98: link dd/l13 dd/d19/l21 0 2022-02-02T18:21:48.439 INFO:tasks.workunit.client.1.smithi159.stdout:6/56: dread f1 [0,4194304] 0 2022-02-02T18:21:48.443 INFO:tasks.workunit.client.1.smithi159.stdout:3/99: creat dd/d20/f22 x:0 0 0 2022-02-02T18:21:48.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/100: rmdir dd/d19 39 2022-02-02T18:21:48.450 INFO:tasks.workunit.client.1.smithi159.stdout:3/101: creat dd/d19/f23 x:0 0 0 2022-02-02T18:21:48.451 INFO:tasks.workunit.client.1.smithi159.stdout:0/65: dread d1/f3 [0,4194304] 0 2022-02-02T18:21:48.451 INFO:tasks.workunit.client.1.smithi159.stdout:0/66: chown d1/dd/l18 7042319 1 2022-02-02T18:21:48.455 INFO:tasks.workunit.client.1.smithi159.stdout:0/67: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:48.458 INFO:tasks.workunit.client.1.smithi159.stdout:0/68: rename d1/f4 to d1/dd/f1a 0 2022-02-02T18:21:48.460 INFO:tasks.workunit.client.1.smithi159.stdout:6/57: dwrite f7 [0,4194304] 0 2022-02-02T18:21:48.460 INFO:tasks.workunit.client.1.smithi159.stdout:0/69: link d1/dd/l12 d1/l1b 0 2022-02-02T18:21:48.466 INFO:tasks.workunit.client.1.smithi159.stdout:6/58: creat df/f11 x:0 0 0 2022-02-02T18:21:48.467 INFO:tasks.workunit.client.1.smithi159.stdout:0/70: creat d1/f1c x:0 0 0 2022-02-02T18:21:48.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/71: mkdir d1/d11/d1d 0 2022-02-02T18:21:48.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/72: readlink d1/l1b 0 2022-02-02T18:21:48.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/73: readlink d1/dd/l15 0 2022-02-02T18:21:48.471 INFO:tasks.workunit.client.1.smithi159.stdout:0/74: chown d1/fe 3 1 2022-02-02T18:21:48.472 INFO:tasks.workunit.client.1.smithi159.stdout:0/75: creat d1/d11/f1e x:0 0 0 2022-02-02T18:21:48.484 INFO:tasks.workunit.client.1.smithi159.stdout:6/59: getdents df 0 2022-02-02T18:21:48.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/60: creat df/f12 x:0 0 0 2022-02-02T18:21:48.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/76: dread d1/fc [0,4194304] 0 2022-02-02T18:21:48.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/77: fsync d1/f1c 0 2022-02-02T18:21:48.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/78: chown d1/f10 100037052 1 2022-02-02T18:21:48.491 INFO:tasks.workunit.client.1.smithi159.stdout:0/79: read d1/f5 [3380446,17424] 0 2022-02-02T18:21:48.492 INFO:tasks.workunit.client.1.smithi159.stdout:0/80: link d1/dd/l15 d1/d11/d1d/l1f 0 2022-02-02T18:21:48.492 INFO:tasks.workunit.client.1.smithi159.stdout:0/81: stat f0 0 2022-02-02T18:21:48.493 INFO:tasks.workunit.client.1.smithi159.stdout:0/82: write d1/fb [4868295,101744] 0 2022-02-02T18:21:48.493 INFO:tasks.workunit.client.1.smithi159.stdout:0/83: write d1/f8 [778737,61320] 0 2022-02-02T18:21:48.509 INFO:tasks.workunit.client.1.smithi159.stdout:6/61: dwrite fc [0,4194304] 0 2022-02-02T18:21:48.511 INFO:tasks.workunit.client.1.smithi159.stdout:6/62: mknod df/c13 0 2022-02-02T18:21:48.513 INFO:tasks.workunit.client.1.smithi159.stdout:6/63: creat df/f14 x:0 0 0 2022-02-02T18:21:48.514 INFO:tasks.workunit.client.1.smithi159.stdout:6/64: creat df/f15 x:0 0 0 2022-02-02T18:21:48.526 INFO:tasks.workunit.client.1.smithi159.stdout:6/65: unlink df/f11 0 2022-02-02T18:21:48.526 INFO:tasks.workunit.client.1.smithi159.stdout:6/66: write df/f12 [18378,66962] 0 2022-02-02T18:21:48.527 INFO:tasks.workunit.client.1.smithi159.stdout:6/67: creat df/f16 x:0 0 0 2022-02-02T18:21:48.527 INFO:tasks.workunit.client.1.smithi159.stdout:6/68: read - df/f14 zero size 2022-02-02T18:21:48.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/69: read fc [1338073,84143] 0 2022-02-02T18:21:48.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/70: truncate df/f16 918080 0 2022-02-02T18:21:48.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/71: rename df/f12 to df/f17 0 2022-02-02T18:21:48.533 INFO:tasks.workunit.client.1.smithi159.stdout:6/72: dread df/f16 [0,4194304] 0 2022-02-02T18:21:48.535 INFO:tasks.workunit.client.1.smithi159.stdout:6/73: read fa [60372,122381] 0 2022-02-02T18:21:48.541 INFO:tasks.workunit.client.1.smithi159.stdout:6/74: dread f6 [0,4194304] 0 2022-02-02T18:21:48.541 INFO:tasks.workunit.client.1.smithi159.stdout:6/75: write fe [851549,31454] 0 2022-02-02T18:21:48.542 INFO:tasks.workunit.client.1.smithi159.stdout:6/76: creat df/f18 x:0 0 0 2022-02-02T18:21:48.548 INFO:tasks.workunit.client.1.smithi159.stdout:6/77: rename c5 to df/c19 0 2022-02-02T18:21:48.551 INFO:tasks.workunit.client.1.smithi159.stdout:6/78: write f6 [2528314,84573] 0 2022-02-02T18:21:48.551 INFO:tasks.workunit.client.1.smithi159.stdout:6/79: chown f6 3377 1 2022-02-02T18:21:48.578 INFO:tasks.workunit.client.1.smithi159.stdout:6/80: dwrite df/f16 [0,4194304] 0 2022-02-02T18:21:48.584 INFO:tasks.workunit.client.1.smithi159.stdout:6/81: creat df/f1a x:0 0 0 2022-02-02T18:21:48.584 INFO:tasks.workunit.client.1.smithi159.stdout:6/82: read - df/f1a zero size 2022-02-02T18:21:48.585 INFO:tasks.workunit.client.1.smithi159.stdout:6/83: creat df/f1b x:0 0 0 2022-02-02T18:21:48.587 INFO:tasks.workunit.client.1.smithi159.stdout:6/84: mknod df/c1c 0 2022-02-02T18:21:48.590 INFO:tasks.workunit.client.1.smithi159.stdout:6/85: symlink df/l1d 0 2022-02-02T18:21:48.590 INFO:tasks.workunit.client.1.smithi159.stdout:6/86: write fe [1510396,559] 0 2022-02-02T18:21:48.620 INFO:tasks.workunit.client.1.smithi159.stdout:6/87: dwrite fa [0,4194304] 0 2022-02-02T18:21:48.622 INFO:tasks.workunit.client.1.smithi159.stdout:6/88: creat df/f1e x:0 0 0 2022-02-02T18:21:48.622 INFO:tasks.workunit.client.1.smithi159.stdout:6/89: fsync df/f18 0 2022-02-02T18:21:48.639 INFO:tasks.workunit.client.1.smithi159.stdout:6/90: dread fc [0,4194304] 0 2022-02-02T18:21:48.640 INFO:tasks.workunit.client.1.smithi159.stdout:6/91: read - df/f1e zero size 2022-02-02T18:21:48.643 INFO:tasks.workunit.client.1.smithi159.stdout:6/92: mkdir df/d1f 0 2022-02-02T18:21:48.643 INFO:tasks.workunit.client.1.smithi159.stdout:6/93: mkdir df/d1f/d20 0 2022-02-02T18:21:48.644 INFO:tasks.workunit.client.1.smithi159.stdout:6/94: chown df/f1b 158 1 2022-02-02T18:21:48.645 INFO:tasks.workunit.client.1.smithi159.stdout:6/95: mknod df/d1f/c21 0 2022-02-02T18:21:48.646 INFO:tasks.workunit.client.1.smithi159.stdout:6/96: stat df/c19 0 2022-02-02T18:21:48.646 INFO:tasks.workunit.client.1.smithi159.stdout:6/97: read - fd zero size 2022-02-02T18:21:48.646 INFO:tasks.workunit.client.1.smithi159.stdout:6/98: write df/f1a [993122,113314] 0 2022-02-02T18:21:48.646 INFO:tasks.workunit.client.1.smithi159.stdout:6/99: write df/f1a [1061222,125291] 0 2022-02-02T18:21:48.647 INFO:tasks.workunit.client.1.smithi159.stdout:6/100: write f7 [853649,94351] 0 2022-02-02T18:21:48.649 INFO:tasks.workunit.client.1.smithi159.stdout:6/101: mknod df/d1f/c22 0 2022-02-02T18:21:48.672 INFO:tasks.workunit.client.1.smithi159.stdout:6/102: dwrite fe [0,4194304] 0 2022-02-02T18:21:48.672 INFO:tasks.workunit.client.1.smithi159.stdout:6/103: write df/f1e [471013,71937] 0 2022-02-02T18:21:49.109 INFO:tasks.workunit.client.1.smithi159.stdout:5/28: sync 2022-02-02T18:21:49.110 INFO:tasks.workunit.client.1.smithi159.stdout:5/29: creat d9/fc x:0 0 0 2022-02-02T18:21:49.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/30: dwrite f8 [0,4194304] 0 2022-02-02T18:21:49.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/31: creat d9/fd x:0 0 0 2022-02-02T18:21:49.158 INFO:tasks.workunit.client.1.smithi159.stdout:5/32: truncate f8 1158166 0 2022-02-02T18:21:49.179 INFO:tasks.workunit.client.1.smithi159.stdout:5/33: dwrite f8 [0,4194304] 0 2022-02-02T18:21:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: cephadm 2022-02-02T18:21:48.088523+0000 mgr.smithi096.shfutl (mgr.14162) 281 : cephadm [INF] Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:21:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: audit 2022-02-02T18:21:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: 2022-02-02T18:21:48.092418+0000 mon.smithi096 (mon.0) 569 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:21:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: audit 2022-02-02T18:21:48.093078+0000 mon.smithi096 (mon.0) 570 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:21:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: audit 2022-02-02T18:21:48.093763+0000 mon.smithi096 (mon.0) 571 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:21:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: audit 2022-02-02T18:21:48.094420+0000 mon.smithi096 (mon.0) 572 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:21:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: cephadm 2022-02-02T18:21:48.095177+0000 mgr.smithi096.shfutl (mgr.14162) 282 : cephadm [INF] Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:21:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:49 smithi159 conmon[35668]: cluster 2022-02-02T18:21:48.830944+0000 mgr.smithi096.shfutl (mgr.14162) 283 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 621 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 122 op/s 2022-02-02T18:21:49.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: cephadm 2022-02-02T18:21:48.088523+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:21:49.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: ) 281 : cephadm [INF] Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:21:49.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: audit 2022-02-02T18:21:48.092418+0000 mon.smithi096 (mon.0) 569 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:21:49.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: audit 2022-02-02T18:21:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 2022-02-02T18:21:48.093078+0000 mon.smithi096 (mon.0) 570 : audit [INF] 2022-02-02T18:21:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:21:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: audit 2022-02-02T18:21:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 2022-02-02T18:21:48.093763+0000 mon.smithi096 (mon. 2022-02-02T18:21:49.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 0) 571 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:21:49.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:21:49.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 18:21:48.094420+0000 mon.smithi096 (mon. 2022-02-02T18:21:49.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 0) 572 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:21:49.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: cephadm 2022-02-02 2022-02-02T18:21:49.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: T18:21:48.095177+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:21:49.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: .14162) 282 : cephadm [INF] Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:21:49.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:21:49.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 02-02T18:21:48.830944+0000 2022-02-02T18:21:49.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14162) 283 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 621 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 122 op/s 2022-02-02T18:21:49.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:49 smithi096 conmon[32067]: 2022-02-02T18:21:49.979 INFO:tasks.workunit.client.1.smithi159.stdout:1/39: sync 2022-02-02T18:21:49.980 INFO:tasks.workunit.client.1.smithi159.stdout:7/93: sync 2022-02-02T18:21:49.980 INFO:tasks.workunit.client.1.smithi159.stdout:9/43: sync 2022-02-02T18:21:49.982 INFO:tasks.workunit.client.1.smithi159.stdout:7/94: truncate d3/fb 4678622 0 2022-02-02T18:21:49.982 INFO:tasks.workunit.client.1.smithi159.stdout:7/95: chown d3/d5/d8/f11 10832 1 2022-02-02T18:21:49.983 INFO:tasks.workunit.client.1.smithi159.stdout:7/96: write d3/d5/f12 [585118,29818] 0 2022-02-02T18:21:49.983 INFO:tasks.workunit.client.1.smithi159.stdout:7/97: dread - d3/d5/f1b zero size 2022-02-02T18:21:49.984 INFO:tasks.workunit.client.1.smithi159.stdout:7/98: rename d3/d5/f12 to d3/d5/f20 0 2022-02-02T18:21:49.986 INFO:tasks.workunit.client.1.smithi159.stdout:9/44: unlink d4/f8 0 2022-02-02T18:21:49.988 INFO:tasks.workunit.client.1.smithi159.stdout:7/99: creat d3/d19/f21 x:0 0 0 2022-02-02T18:21:49.989 INFO:tasks.workunit.client.1.smithi159.stdout:9/45: rename d4/fa to d4/fc 0 2022-02-02T18:21:49.989 INFO:tasks.workunit.client.1.smithi159.stdout:9/46: fdatasync d4/fb 0 2022-02-02T18:21:49.991 INFO:tasks.workunit.client.1.smithi159.stdout:7/100: write d3/f14 [3256625,115083] 0 2022-02-02T18:21:49.991 INFO:tasks.workunit.client.1.smithi159.stdout:9/47: read f3 [51978,120963] 0 2022-02-02T18:21:49.992 INFO:tasks.workunit.client.1.smithi159.stdout:7/101: link d3/d5/d8/f11 d3/d18/f22 0 2022-02-02T18:21:49.998 INFO:tasks.workunit.client.1.smithi159.stdout:1/40: dwrite f7 [0,4194304] 0 2022-02-02T18:21:49.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/41: readlink la 0 2022-02-02T18:21:49.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/42: creat fe x:0 0 0 2022-02-02T18:21:50.007 INFO:tasks.workunit.client.1.smithi159.stdout:9/48: rename d4/fc to d4/fd 0 2022-02-02T18:21:50.007 INFO:tasks.workunit.client.1.smithi159.stdout:9/49: truncate d4/fb 439418 0 2022-02-02T18:21:50.007 INFO:tasks.workunit.client.1.smithi159.stdout:9/50: write f3 [1088377,17505] 0 2022-02-02T18:21:50.020 INFO:tasks.workunit.client.1.smithi159.stdout:1/43: dwrite fd [0,4194304] 0 2022-02-02T18:21:50.020 INFO:tasks.workunit.client.1.smithi159.stdout:1/44: dread - fb zero size 2022-02-02T18:21:50.029 INFO:tasks.workunit.client.1.smithi159.stdout:7/102: dwrite d3/d5/f20 [0,4194304] 0 2022-02-02T18:21:50.030 INFO:tasks.workunit.client.1.smithi159.stdout:9/51: dwrite d4/fb [0,4194304] 0 2022-02-02T18:21:50.031 INFO:tasks.workunit.client.1.smithi159.stdout:9/52: read f3 [978086,60256] 0 2022-02-02T18:21:50.032 INFO:tasks.workunit.client.1.smithi159.stdout:9/53: chown d4 123199030 1 2022-02-02T18:21:50.034 INFO:tasks.workunit.client.1.smithi159.stdout:1/45: write f1 [529860,36348] 0 2022-02-02T18:21:50.036 INFO:tasks.workunit.client.1.smithi159.stdout:1/46: mkdir df 0 2022-02-02T18:21:50.036 INFO:tasks.workunit.client.1.smithi159.stdout:1/47: write fb [70217,59355] 0 2022-02-02T18:21:50.036 INFO:tasks.workunit.client.1.smithi159.stdout:1/48: unlink l9 0 2022-02-02T18:21:50.038 INFO:tasks.workunit.client.1.smithi159.stdout:1/49: rename la to df/l10 0 2022-02-02T18:21:50.038 INFO:tasks.workunit.client.1.smithi159.stdout:7/103: dread d3/d5/d8/fd [0,4194304] 0 2022-02-02T18:21:50.042 INFO:tasks.workunit.client.1.smithi159.stdout:1/50: symlink df/l11 0 2022-02-02T18:21:50.042 INFO:tasks.workunit.client.1.smithi159.stdout:1/51: fdatasync fd 0 2022-02-02T18:21:50.044 INFO:tasks.workunit.client.1.smithi159.stdout:7/104: rename d3/c15 to d3/d19/c23 0 2022-02-02T18:21:50.044 INFO:tasks.workunit.client.1.smithi159.stdout:7/105: readlink d3/d5/le 0 2022-02-02T18:21:50.045 INFO:tasks.workunit.client.1.smithi159.stdout:7/106: write d3/d5/d8/f11 [3291053,94716] 0 2022-02-02T18:21:50.045 INFO:tasks.workunit.client.1.smithi159.stdout:7/107: creat d3/d5/d8/f24 x:0 0 0 2022-02-02T18:21:50.046 INFO:tasks.workunit.client.1.smithi159.stdout:7/108: write d3/d5/f1b [952438,65258] 0 2022-02-02T18:21:50.046 INFO:tasks.workunit.client.1.smithi159.stdout:7/109: write d3/d5/f1b [1998861,128596] 0 2022-02-02T18:21:50.048 INFO:tasks.workunit.client.1.smithi159.stdout:1/52: mknod df/c12 0 2022-02-02T18:21:50.051 INFO:tasks.workunit.client.1.smithi159.stdout:7/110: symlink d3/d6/l25 0 2022-02-02T18:21:50.052 INFO:tasks.workunit.client.1.smithi159.stdout:7/111: write d3/d5/d8/f11 [4535040,90491] 0 2022-02-02T18:21:50.053 INFO:tasks.workunit.client.1.smithi159.stdout:1/53: rename fd to df/f13 0 2022-02-02T18:21:50.054 INFO:tasks.workunit.client.1.smithi159.stdout:7/112: symlink d3/d5/l26 0 2022-02-02T18:21:50.055 INFO:tasks.workunit.client.1.smithi159.stdout:1/54: mkdir df/d14 0 2022-02-02T18:21:50.057 INFO:tasks.workunit.client.1.smithi159.stdout:9/54: dwrite f3 [0,4194304] 0 2022-02-02T18:21:50.058 INFO:tasks.workunit.client.1.smithi159.stdout:1/55: read f7 [2602414,127916] 0 2022-02-02T18:21:50.059 INFO:tasks.workunit.client.1.smithi159.stdout:9/55: rename d4/c9 to d4/ce 0 2022-02-02T18:21:50.069 INFO:tasks.workunit.client.1.smithi159.stdout:9/56: dread d4/fb [0,4194304] 0 2022-02-02T18:21:50.070 INFO:tasks.workunit.client.1.smithi159.stdout:9/57: write d4/fb [224443,111673] 0 2022-02-02T18:21:50.072 INFO:tasks.workunit.client.1.smithi159.stdout:9/58: stat d4/ce 0 2022-02-02T18:21:50.072 INFO:tasks.workunit.client.1.smithi159.stdout:9/59: creat d4/ff x:0 0 0 2022-02-02T18:21:50.072 INFO:tasks.workunit.client.1.smithi159.stdout:9/60: write d4/fd [722223,5654] 0 2022-02-02T18:21:50.072 INFO:tasks.workunit.client.1.smithi159.stdout:9/61: truncate d4/ff 69155 0 2022-02-02T18:21:50.076 INFO:tasks.workunit.client.1.smithi159.stdout:7/113: dwrite d3/d5/f1b [0,4194304] 0 2022-02-02T18:21:50.079 INFO:tasks.workunit.client.1.smithi159.stdout:7/114: mkdir d3/d27 0 2022-02-02T18:21:50.081 INFO:tasks.workunit.client.1.smithi159.stdout:7/115: rename d3/d5/l26 to d3/d5/l28 0 2022-02-02T18:21:50.082 INFO:tasks.workunit.client.1.smithi159.stdout:9/62: fsync d4/ff 0 2022-02-02T18:21:50.083 INFO:tasks.workunit.client.1.smithi159.stdout:9/63: rename f3 to d4/f10 0 2022-02-02T18:21:50.084 INFO:tasks.workunit.client.1.smithi159.stdout:9/64: chown d4/fb 2037 1 2022-02-02T18:21:50.084 INFO:tasks.workunit.client.1.smithi159.stdout:9/65: chown d4/f10 4 1 2022-02-02T18:21:50.090 INFO:tasks.workunit.client.1.smithi159.stdout:9/66: truncate d4/f10 1684597 0 2022-02-02T18:21:50.091 INFO:tasks.workunit.client.1.smithi159.stdout:9/67: write d4/ff [712942,10779] 0 2022-02-02T18:21:50.091 INFO:tasks.workunit.client.1.smithi159.stdout:9/68: unlink d4/fb 0 2022-02-02T18:21:50.091 INFO:tasks.workunit.client.1.smithi159.stdout:9/69: read d4/ff [288353,64378] 0 2022-02-02T18:21:50.091 INFO:tasks.workunit.client.1.smithi159.stdout:9/70: creat d4/f11 x:0 0 0 2022-02-02T18:21:50.092 INFO:tasks.workunit.client.1.smithi159.stdout:9/71: read d4/fd [17943,20425] 0 2022-02-02T18:21:50.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/116: dwrite d3/d19/f21 [0,4194304] 0 2022-02-02T18:21:50.101 INFO:tasks.workunit.client.1.smithi159.stdout:9/72: dread d4/fd [0,4194304] 0 2022-02-02T18:21:50.130 INFO:tasks.workunit.client.1.smithi159.stdout:6/104: sync 2022-02-02T18:21:50.130 INFO:tasks.workunit.client.1.smithi159.stdout:0/84: sync 2022-02-02T18:21:50.130 INFO:tasks.workunit.client.1.smithi159.stdout:2/39: sync 2022-02-02T18:21:50.131 INFO:tasks.workunit.client.1.smithi159.stdout:8/73: sync 2022-02-02T18:21:50.131 INFO:tasks.workunit.client.1.smithi159.stdout:3/102: sync 2022-02-02T18:21:50.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/85: write d1/fc [4669187,103599] 0 2022-02-02T18:21:50.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/40: sync 2022-02-02T18:21:50.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/86: write f0 [607638,102045] 0 2022-02-02T18:21:50.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/34: sync 2022-02-02T18:21:50.132 INFO:tasks.workunit.client.1.smithi159.stdout:6/105: mknod df/d1f/d20/c23 0 2022-02-02T18:21:50.133 INFO:tasks.workunit.client.1.smithi159.stdout:6/106: write f3 [1262529,128307] 0 2022-02-02T18:21:50.133 INFO:tasks.workunit.client.1.smithi159.stdout:8/74: creat d1/f17 x:0 0 0 2022-02-02T18:21:50.135 INFO:tasks.workunit.client.1.smithi159.stdout:3/103: link dd/f1f dd/d19/f24 0 2022-02-02T18:21:50.136 INFO:tasks.workunit.client.1.smithi159.stdout:5/35: mkdir d9/de 0 2022-02-02T18:21:50.136 INFO:tasks.workunit.client.1.smithi159.stdout:5/36: dread - d9/fd zero size 2022-02-02T18:21:50.138 INFO:tasks.workunit.client.1.smithi159.stdout:8/75: symlink d1/l18 0 2022-02-02T18:21:50.138 INFO:tasks.workunit.client.1.smithi159.stdout:8/76: chown d1/dd 4 1 2022-02-02T18:21:50.139 INFO:tasks.workunit.client.1.smithi159.stdout:0/87: dread f0 [0,4194304] 0 2022-02-02T18:21:50.139 INFO:tasks.workunit.client.1.smithi159.stdout:6/107: symlink df/l24 0 2022-02-02T18:21:50.140 INFO:tasks.workunit.client.1.smithi159.stdout:8/77: symlink d1/dc/l19 0 2022-02-02T18:21:50.140 INFO:tasks.workunit.client.1.smithi159.stdout:8/78: write d1/f17 [22549,117926] 0 2022-02-02T18:21:50.141 INFO:tasks.workunit.client.1.smithi159.stdout:0/88: symlink d1/dd/l20 0 2022-02-02T18:21:50.142 INFO:tasks.workunit.client.1.smithi159.stdout:0/89: dread - d1/f2 zero size 2022-02-02T18:21:50.143 INFO:tasks.workunit.client.1.smithi159.stdout:0/90: symlink d1/d11/l21 0 2022-02-02T18:21:50.143 INFO:tasks.workunit.client.1.smithi159.stdout:4/41: dread d0/f5 [0,4194304] 0 2022-02-02T18:21:50.143 INFO:tasks.workunit.client.1.smithi159.stdout:3/104: read dd/d19/f1e [252800,95311] 0 2022-02-02T18:21:50.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/42: write d0/ff [34790,75485] 0 2022-02-02T18:21:50.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/43: write d0/f11 [708538,65516] 0 2022-02-02T18:21:50.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/44: fsync d0/f5 0 2022-02-02T18:21:50.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/105: getdents dd 0 2022-02-02T18:21:50.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/106: truncate dd/d19/f24 616210 0 2022-02-02T18:21:50.149 INFO:tasks.workunit.client.1.smithi159.stdout:8/79: dread d1/fe [0,4194304] 0 2022-02-02T18:21:50.150 INFO:tasks.workunit.client.1.smithi159.stdout:3/107: mknod dd/c25 0 2022-02-02T18:21:50.151 INFO:tasks.workunit.client.1.smithi159.stdout:8/80: mkdir d1/dd/d1a 0 2022-02-02T18:21:50.152 INFO:tasks.workunit.client.1.smithi159.stdout:2/40: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:50.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/81: mknod d1/c1b 0 2022-02-02T18:21:50.153 INFO:tasks.workunit.client.1.smithi159.stdout:3/108: write fc [572387,41240] 0 2022-02-02T18:21:50.153 INFO:tasks.workunit.client.1.smithi159.stdout:4/45: write d0/f11 [316782,129635] 0 2022-02-02T18:21:50.160 INFO:tasks.workunit.client.1.smithi159.stdout:2/41: mkdir da/dc 0 2022-02-02T18:21:50.163 INFO:tasks.workunit.client.1.smithi159.stdout:3/109: mknod dd/d20/c26 0 2022-02-02T18:21:50.163 INFO:tasks.workunit.client.1.smithi159.stdout:5/37: dwrite f7 [0,4194304] 0 2022-02-02T18:21:50.164 INFO:tasks.workunit.client.1.smithi159.stdout:8/82: mknod d1/dc/c1c 0 2022-02-02T18:21:50.164 INFO:tasks.workunit.client.1.smithi159.stdout:8/83: write d1/f5 [5114581,43067] 0 2022-02-02T18:21:50.165 INFO:tasks.workunit.client.1.smithi159.stdout:8/84: write d1/fe [2509173,24206] 0 2022-02-02T18:21:50.166 INFO:tasks.workunit.client.1.smithi159.stdout:5/38: creat d9/de/ff x:0 0 0 2022-02-02T18:21:50.167 INFO:tasks.workunit.client.1.smithi159.stdout:0/91: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:50.167 INFO:tasks.workunit.client.1.smithi159.stdout:0/92: chown d1/d11/d1d 1111676 1 2022-02-02T18:21:50.168 INFO:tasks.workunit.client.1.smithi159.stdout:0/93: chown d1/f3 125 1 2022-02-02T18:21:50.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/46: dread d0/f6 [0,4194304] 0 2022-02-02T18:21:50.189 INFO:tasks.workunit.client.1.smithi159.stdout:4/47: unlink d0/fb 0 2022-02-02T18:21:50.190 INFO:tasks.workunit.client.1.smithi159.stdout:4/48: mknod d0/c12 0 2022-02-02T18:21:50.190 INFO:tasks.workunit.client.1.smithi159.stdout:4/49: readlink d0/d8/le 0 2022-02-02T18:21:50.190 INFO:tasks.workunit.client.1.smithi159.stdout:4/50: creat d0/f13 x:0 0 0 2022-02-02T18:21:50.191 INFO:tasks.workunit.client.1.smithi159.stdout:4/51: fdatasync d0/f3 0 2022-02-02T18:21:50.191 INFO:tasks.workunit.client.1.smithi159.stdout:4/52: mkdir d0/d8/d14 0 2022-02-02T18:21:50.192 INFO:tasks.workunit.client.1.smithi159.stdout:4/53: unlink d0/f13 0 2022-02-02T18:21:50.197 INFO:tasks.workunit.client.1.smithi159.stdout:4/54: dread d0/f5 [0,4194304] 0 2022-02-02T18:21:50.205 INFO:tasks.workunit.client.1.smithi159.stdout:5/39: dwrite f8 [0,4194304] 0 2022-02-02T18:21:50.205 INFO:tasks.workunit.client.1.smithi159.stdout:5/40: write d9/fc [21904,61744] 0 2022-02-02T18:21:50.206 INFO:tasks.workunit.client.1.smithi159.stdout:3/110: dwrite dd/d20/f22 [0,4194304] 0 2022-02-02T18:21:50.207 INFO:tasks.workunit.client.1.smithi159.stdout:0/94: dwrite d1/fb [0,4194304] 0 2022-02-02T18:21:50.207 INFO:tasks.workunit.client.1.smithi159.stdout:5/41: rename d9/ca to d9/c10 0 2022-02-02T18:21:50.210 INFO:tasks.workunit.client.1.smithi159.stdout:5/42: symlink d9/l11 0 2022-02-02T18:21:50.211 INFO:tasks.workunit.client.1.smithi159.stdout:5/43: write d9/de/ff [642590,23229] 0 2022-02-02T18:21:50.211 INFO:tasks.workunit.client.1.smithi159.stdout:8/85: truncate d1/f5 498629 0 2022-02-02T18:21:50.212 INFO:tasks.workunit.client.1.smithi159.stdout:2/42: dwrite f9 [0,4194304] 0 2022-02-02T18:21:50.214 INFO:tasks.workunit.client.1.smithi159.stdout:3/111: getdents dd/d19 0 2022-02-02T18:21:50.214 INFO:tasks.workunit.client.1.smithi159.stdout:8/86: symlink d1/dd/d1a/l1d 0 2022-02-02T18:21:50.215 INFO:tasks.workunit.client.1.smithi159.stdout:8/87: write d1/fe [4473816,127455] 0 2022-02-02T18:21:50.216 INFO:tasks.workunit.client.1.smithi159.stdout:2/43: creat da/dc/fd x:0 0 0 2022-02-02T18:21:50.219 INFO:tasks.workunit.client.1.smithi159.stdout:4/55: getdents d0/d8 0 2022-02-02T18:21:50.219 INFO:tasks.workunit.client.1.smithi159.stdout:4/56: fdatasync d0/f6 0 2022-02-02T18:21:50.220 INFO:tasks.workunit.client.1.smithi159.stdout:4/57: unlink d0/c12 0 2022-02-02T18:21:50.224 INFO:tasks.workunit.client.1.smithi159.stdout:8/88: rename d1/dd/c11 to d1/c1e 0 2022-02-02T18:21:50.224 INFO:tasks.workunit.client.1.smithi159.stdout:8/89: creat d1/f1f x:0 0 0 2022-02-02T18:21:50.226 INFO:tasks.workunit.client.1.smithi159.stdout:3/112: link dd/c15 dd/d20/c27 0 2022-02-02T18:21:50.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/113: link dd/f1c dd/f28 0 2022-02-02T18:21:50.234 INFO:tasks.workunit.client.1.smithi159.stdout:0/95: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:50.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/96: fdatasync d1/f10 0 2022-02-02T18:21:50.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/97: write d1/dd/f1a [1277903,43620] 0 2022-02-02T18:21:50.244 INFO:tasks.workunit.client.1.smithi159.stdout:2/44: dwrite f1 [0,4194304] 0 2022-02-02T18:21:50.246 INFO:tasks.workunit.client.1.smithi159.stdout:5/44: dwrite d9/de/ff [0,4194304] 0 2022-02-02T18:21:50.247 INFO:tasks.workunit.client.1.smithi159.stdout:5/45: read d9/fb [16749,128235] 0 2022-02-02T18:21:50.248 INFO:tasks.workunit.client.1.smithi159.stdout:5/46: mkdir d9/de/d12 0 2022-02-02T18:21:50.249 INFO:tasks.workunit.client.1.smithi159.stdout:5/47: stat f8 0 2022-02-02T18:21:50.249 INFO:tasks.workunit.client.1.smithi159.stdout:5/48: chown d9/c10 14556852 1 2022-02-02T18:21:50.249 INFO:tasks.workunit.client.1.smithi159.stdout:5/49: write d9/fb [831576,109867] 0 2022-02-02T18:21:50.250 INFO:tasks.workunit.client.1.smithi159.stdout:2/45: write f8 [4898830,125780] 0 2022-02-02T18:21:50.250 INFO:tasks.workunit.client.1.smithi159.stdout:2/46: chown da/dc/fd 240088778 1 2022-02-02T18:21:50.251 INFO:tasks.workunit.client.1.smithi159.stdout:2/47: dread - da/dc/fd zero size 2022-02-02T18:21:50.251 INFO:tasks.workunit.client.1.smithi159.stdout:5/50: write d9/de/ff [536698,36543] 0 2022-02-02T18:21:50.251 INFO:tasks.workunit.client.1.smithi159.stdout:5/51: stat d9/de 0 2022-02-02T18:21:50.252 INFO:tasks.workunit.client.1.smithi159.stdout:2/48: rename l7 to da/dc/le 0 2022-02-02T18:21:50.253 INFO:tasks.workunit.client.1.smithi159.stdout:5/52: mknod d9/de/c13 0 2022-02-02T18:21:50.255 INFO:tasks.workunit.client.1.smithi159.stdout:2/49: truncate f9 3367324 0 2022-02-02T18:21:50.255 INFO:tasks.workunit.client.1.smithi159.stdout:2/50: write da/dc/fd [20156,2448] 0 2022-02-02T18:21:50.256 INFO:tasks.workunit.client.1.smithi159.stdout:2/51: creat da/dc/ff x:0 0 0 2022-02-02T18:21:50.256 INFO:tasks.workunit.client.1.smithi159.stdout:2/52: chown l6 4132299 1 2022-02-02T18:21:50.258 INFO:tasks.workunit.client.1.smithi159.stdout:2/53: symlink da/dc/l10 0 2022-02-02T18:21:50.258 INFO:tasks.workunit.client.1.smithi159.stdout:8/90: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:21:50.259 INFO:tasks.workunit.client.1.smithi159.stdout:3/114: fsync dd/f1c 0 2022-02-02T18:21:50.260 INFO:tasks.workunit.client.1.smithi159.stdout:3/115: getdents dd/d19 0 2022-02-02T18:21:50.261 INFO:tasks.workunit.client.1.smithi159.stdout:0/98: dwrite d1/f3 [4194304,4194304] 0 2022-02-02T18:21:50.261 INFO:tasks.workunit.client.1.smithi159.stdout:3/116: stat dd/c15 0 2022-02-02T18:21:50.263 INFO:tasks.workunit.client.1.smithi159.stdout:3/117: rename dd/c15 to dd/d19/c29 0 2022-02-02T18:21:50.264 INFO:tasks.workunit.client.1.smithi159.stdout:3/118: dread dd/d19/f24 [0,4194304] 0 2022-02-02T18:21:50.265 INFO:tasks.workunit.client.1.smithi159.stdout:3/119: write dd/d19/f1b [225806,62785] 0 2022-02-02T18:21:50.272 INFO:tasks.workunit.client.1.smithi159.stdout:0/99: dread d1/f10 [0,4194304] 0 2022-02-02T18:21:50.275 INFO:tasks.workunit.client.1.smithi159.stdout:4/58: dwrite d0/f6 [0,4194304] 0 2022-02-02T18:21:50.277 INFO:tasks.workunit.client.1.smithi159.stdout:0/100: link d1/f10 d1/d11/d1d/f22 0 2022-02-02T18:21:50.278 INFO:tasks.workunit.client.1.smithi159.stdout:0/101: chown d1/dd 191860203 1 2022-02-02T18:21:50.278 INFO:tasks.workunit.client.1.smithi159.stdout:4/59: mkdir d0/d8/d15 0 2022-02-02T18:21:50.279 INFO:tasks.workunit.client.1.smithi159.stdout:0/102: write d1/f8 [352542,4570] 0 2022-02-02T18:21:50.280 INFO:tasks.workunit.client.1.smithi159.stdout:4/60: write d0/d8/f10 [7866,47977] 0 2022-02-02T18:21:50.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/103: mknod d1/dd/c23 0 2022-02-02T18:21:50.283 INFO:tasks.workunit.client.1.smithi159.stdout:4/61: creat d0/d8/d14/f16 x:0 0 0 2022-02-02T18:21:50.285 INFO:tasks.workunit.client.1.smithi159.stdout:4/62: dread d0/ff [0,4194304] 0 2022-02-02T18:21:50.300 INFO:tasks.workunit.client.1.smithi159.stdout:0/104: dwrite f0 [0,4194304] 0 2022-02-02T18:21:50.300 INFO:tasks.workunit.client.1.smithi159.stdout:2/54: dwrite f9 [0,4194304] 0 2022-02-02T18:21:50.301 INFO:tasks.workunit.client.1.smithi159.stdout:4/63: rmdir d0 39 2022-02-02T18:21:50.304 INFO:tasks.workunit.client.1.smithi159.stdout:2/55: symlink da/dc/l11 0 2022-02-02T18:21:50.304 INFO:tasks.workunit.client.1.smithi159.stdout:4/64: creat d0/f17 x:0 0 0 2022-02-02T18:21:50.305 INFO:tasks.workunit.client.1.smithi159.stdout:0/105: symlink d1/l24 0 2022-02-02T18:21:50.306 INFO:tasks.workunit.client.1.smithi159.stdout:2/56: rename da/dc/ff to da/dc/f12 0 2022-02-02T18:21:50.308 INFO:tasks.workunit.client.1.smithi159.stdout:2/57: write f1 [6918312,51505] 0 2022-02-02T18:21:50.310 INFO:tasks.workunit.client.1.smithi159.stdout:2/58: rename da/dc/fd to da/dc/f13 0 2022-02-02T18:21:50.316 INFO:tasks.workunit.client.1.smithi159.stdout:0/106: dread d1/fc [0,4194304] 0 2022-02-02T18:21:50.316 INFO:tasks.workunit.client.1.smithi159.stdout:0/107: readlink d1/dd/lf 0 2022-02-02T18:21:50.317 INFO:tasks.workunit.client.1.smithi159.stdout:0/108: write d1/dd/f1a [1653312,105230] 0 2022-02-02T18:21:50.317 INFO:tasks.workunit.client.1.smithi159.stdout:0/109: chown d1/d11/d1d 29174008 1 2022-02-02T18:21:50.317 INFO:tasks.workunit.client.1.smithi159.stdout:0/110: chown d1/dd/c16 706 1 2022-02-02T18:21:50.323 INFO:tasks.workunit.client.1.smithi159.stdout:2/59: getdents da/dc 0 2022-02-02T18:21:50.323 INFO:tasks.workunit.client.1.smithi159.stdout:2/60: chown f1 12 1 2022-02-02T18:21:50.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/65: dwrite d0/f3 [0,4194304] 0 2022-02-02T18:21:50.335 INFO:tasks.workunit.client.1.smithi159.stdout:4/66: dread d0/f3 [0,4194304] 0 2022-02-02T18:21:50.336 INFO:tasks.workunit.client.1.smithi159.stdout:4/67: chown d0/f17 3312 1 2022-02-02T18:21:50.337 INFO:tasks.workunit.client.1.smithi159.stdout:4/68: mknod d0/c18 0 2022-02-02T18:21:50.337 INFO:tasks.workunit.client.1.smithi159.stdout:4/69: chown d0/f5 408854186 1 2022-02-02T18:21:50.337 INFO:tasks.workunit.client.1.smithi159.stdout:2/61: dread f9 [0,4194304] 0 2022-02-02T18:21:50.338 INFO:tasks.workunit.client.1.smithi159.stdout:2/62: dread da/dc/f13 [0,4194304] 0 2022-02-02T18:21:50.339 INFO:tasks.workunit.client.1.smithi159.stdout:2/63: fsync f1 0 2022-02-02T18:21:50.340 INFO:tasks.workunit.client.1.smithi159.stdout:2/64: stat da/cb 0 2022-02-02T18:21:50.340 INFO:tasks.workunit.client.1.smithi159.stdout:4/70: link d0/ff d0/d8/d15/f19 0 2022-02-02T18:21:50.340 INFO:tasks.workunit.client.1.smithi159.stdout:4/71: fdatasync d0/f5 0 2022-02-02T18:21:50.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/65: symlink da/l14 0 2022-02-02T18:21:50.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/66: getdents da/dc 0 2022-02-02T18:21:50.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/67: write f8 [6148470,112035] 0 2022-02-02T18:21:50.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/68: write da/dc/f12 [1022144,126781] 0 2022-02-02T18:21:50.347 INFO:tasks.workunit.client.1.smithi159.stdout:4/72: dread d0/d8/f10 [0,4194304] 0 2022-02-02T18:21:50.357 INFO:tasks.workunit.client.1.smithi159.stdout:2/69: dwrite da/dc/f13 [0,4194304] 0 2022-02-02T18:21:50.358 INFO:tasks.workunit.client.1.smithi159.stdout:2/70: read da/dc/f12 [907192,24563] 0 2022-02-02T18:21:50.359 INFO:tasks.workunit.client.1.smithi159.stdout:4/73: truncate d0/f6 1034243 0 2022-02-02T18:21:50.361 INFO:tasks.workunit.client.1.smithi159.stdout:4/74: write d0/d8/f10 [1745736,88971] 0 2022-02-02T18:21:50.362 INFO:tasks.workunit.client.1.smithi159.stdout:4/75: write d0/f3 [892900,11829] 0 2022-02-02T18:21:50.362 INFO:tasks.workunit.client.1.smithi159.stdout:4/76: chown d0/f6 15380005 1 2022-02-02T18:21:50.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/71: rmdir da 39 2022-02-02T18:21:50.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/77: rename d0/f17 to d0/d8/d15/f1a 0 2022-02-02T18:21:50.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/78: truncate d0/ff 278025 0 2022-02-02T18:21:50.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/72: truncate f9 180575 0 2022-02-02T18:21:50.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/73: write f1 [9375042,84428] 0 2022-02-02T18:21:50.427 INFO:tasks.workunit.client.1.smithi159.stdout:4/79: symlink d0/d8/l1b 0 2022-02-02T18:21:50.430 INFO:tasks.workunit.client.1.smithi159.stdout:2/74: read da/dc/f13 [1597078,15458] 0 2022-02-02T18:21:50.433 INFO:tasks.workunit.client.1.smithi159.stdout:2/75: symlink da/l15 0 2022-02-02T18:21:50.433 INFO:tasks.workunit.client.1.smithi159.stdout:2/76: fsync da/dc/f13 0 2022-02-02T18:21:50.434 INFO:tasks.workunit.client.1.smithi159.stdout:4/80: read d0/d8/f10 [1928314,117104] 0 2022-02-02T18:21:50.435 INFO:tasks.workunit.client.1.smithi159.stdout:2/77: creat da/f16 x:0 0 0 2022-02-02T18:21:50.435 INFO:tasks.workunit.client.1.smithi159.stdout:2/78: chown da/dc/l11 2188400 1 2022-02-02T18:21:50.435 INFO:tasks.workunit.client.1.smithi159.stdout:2/79: dread - da/f16 zero size 2022-02-02T18:21:50.436 INFO:tasks.workunit.client.1.smithi159.stdout:2/80: write da/dc/f12 [227829,124344] 0 2022-02-02T18:21:50.437 INFO:tasks.workunit.client.1.smithi159.stdout:4/81: dread d0/d8/f10 [0,4194304] 0 2022-02-02T18:21:50.444 INFO:tasks.workunit.client.1.smithi159.stdout:2/81: symlink da/dc/l17 0 2022-02-02T18:21:50.444 INFO:tasks.workunit.client.1.smithi159.stdout:2/82: stat da/dc/f12 0 2022-02-02T18:21:50.446 INFO:tasks.workunit.client.1.smithi159.stdout:4/82: rename d0/d8/d14/f16 to d0/d8/f1c 0 2022-02-02T18:21:50.447 INFO:tasks.workunit.client.1.smithi159.stdout:4/83: write d0/d8/f10 [3768449,97979] 0 2022-02-02T18:21:50.447 INFO:tasks.workunit.client.1.smithi159.stdout:4/84: chown d0/d8/la 17257651 1 2022-02-02T18:21:50.447 INFO:tasks.workunit.client.1.smithi159.stdout:4/85: chown d0/d8/f10 3400168 1 2022-02-02T18:21:50.448 INFO:tasks.workunit.client.1.smithi159.stdout:4/86: rename d0/d8 to d0/d8/d14/d1d 22 2022-02-02T18:21:50.454 INFO:tasks.workunit.client.1.smithi159.stdout:2/83: dread f8 [0,4194304] 0 2022-02-02T18:21:50.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/84: write f9 [705566,60476] 0 2022-02-02T18:21:50.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/85: stat da/cb 0 2022-02-02T18:21:50.465 INFO:tasks.workunit.client.1.smithi159.stdout:2/86: dread da/dc/f13 [0,4194304] 0 2022-02-02T18:21:50.470 INFO:tasks.workunit.client.1.smithi159.stdout:4/87: dwrite d0/f6 [0,4194304] 0 2022-02-02T18:21:50.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/88: read - d0/d8/f1c zero size 2022-02-02T18:21:50.471 INFO:tasks.workunit.client.1.smithi159.stdout:2/87: unlink da/l15 0 2022-02-02T18:21:50.472 INFO:tasks.workunit.client.1.smithi159.stdout:2/88: write da/f16 [94997,84378] 0 2022-02-02T18:21:50.487 INFO:tasks.workunit.client.1.smithi159.stdout:4/89: dwrite d0/ff [0,4194304] 0 2022-02-02T18:21:50.494 INFO:tasks.workunit.client.1.smithi159.stdout:2/89: dwrite da/f16 [0,4194304] 0 2022-02-02T18:21:50.496 INFO:tasks.workunit.client.1.smithi159.stdout:4/90: truncate d0/ff 4114823 0 2022-02-02T18:21:50.498 INFO:tasks.workunit.client.1.smithi159.stdout:2/90: dread da/dc/f13 [0,4194304] 0 2022-02-02T18:21:50.499 INFO:tasks.workunit.client.1.smithi159.stdout:2/91: chown da/dc 3 1 2022-02-02T18:21:50.505 INFO:tasks.workunit.client.1.smithi159.stdout:4/91: link d0/ff d0/f1e 0 2022-02-02T18:21:50.523 INFO:tasks.workunit.client.1.smithi159.stdout:2/92: dwrite f1 [0,4194304] 0 2022-02-02T18:21:50.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/92: dwrite d0/ff [0,4194304] 0 2022-02-02T18:21:50.526 INFO:tasks.workunit.client.1.smithi159.stdout:4/93: symlink d0/d8/d15/l1f 0 2022-02-02T18:21:50.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/93: dread f8 [0,4194304] 0 2022-02-02T18:21:50.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/94: unlink d0/ld 0 2022-02-02T18:21:50.535 INFO:tasks.workunit.client.1.smithi159.stdout:4/95: creat d0/d8/f20 x:0 0 0 2022-02-02T18:21:50.536 INFO:tasks.workunit.client.1.smithi159.stdout:4/96: dread - d0/d8/f20 zero size 2022-02-02T18:21:50.536 INFO:tasks.workunit.client.1.smithi159.stdout:4/97: write d0/d8/f1c [711218,130110] 0 2022-02-02T18:21:50.536 INFO:tasks.workunit.client.1.smithi159.stdout:4/98: write d0/d8/f20 [893280,90544] 0 2022-02-02T18:21:50.537 INFO:tasks.workunit.client.1.smithi159.stdout:4/99: creat d0/f21 x:0 0 0 2022-02-02T18:21:50.537 INFO:tasks.workunit.client.1.smithi159.stdout:4/100: write d0/d8/f1c [603132,89401] 0 2022-02-02T18:21:50.542 INFO:tasks.workunit.client.1.smithi159.stdout:2/94: truncate f8 8837391 0 2022-02-02T18:21:50.542 INFO:tasks.workunit.client.1.smithi159.stdout:2/95: fdatasync f9 0 2022-02-02T18:21:50.543 INFO:tasks.workunit.client.1.smithi159.stdout:2/96: chown l5 114690017 1 2022-02-02T18:21:50.543 INFO:tasks.workunit.client.1.smithi159.stdout:4/101: truncate d0/f6 2032348 0 2022-02-02T18:21:50.544 INFO:tasks.workunit.client.1.smithi159.stdout:2/97: creat da/dc/f18 x:0 0 0 2022-02-02T18:21:50.546 INFO:tasks.workunit.client.1.smithi159.stdout:2/98: symlink da/l19 0 2022-02-02T18:21:50.546 INFO:tasks.workunit.client.1.smithi159.stdout:2/99: creat da/dc/f1a x:0 0 0 2022-02-02T18:21:50.549 INFO:tasks.workunit.client.1.smithi159.stdout:2/100: mknod da/dc/c1b 0 2022-02-02T18:21:50.551 INFO:tasks.workunit.client.1.smithi159.stdout:2/101: mkdir da/d1c 0 2022-02-02T18:21:50.553 INFO:tasks.workunit.client.1.smithi159.stdout:2/102: rename da/dc/f12 to da/dc/f1d 0 2022-02-02T18:21:50.556 INFO:tasks.workunit.client.1.smithi159.stdout:2/103: symlink da/d1c/l1e 0 2022-02-02T18:21:50.558 INFO:tasks.workunit.client.1.smithi159.stdout:2/104: creat da/d1c/f1f x:0 0 0 2022-02-02T18:21:50.560 INFO:tasks.workunit.client.1.smithi159.stdout:2/105: mknod da/d1c/c20 0 2022-02-02T18:21:50.579 INFO:tasks.workunit.client.1.smithi159.stdout:4/102: dwrite d0/d8/f1c [0,4194304] 0 2022-02-02T18:21:50.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/103: fdatasync d0/f5 0 2022-02-02T18:21:50.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/104: chown d0/d8/la 475587 1 2022-02-02T18:21:50.585 INFO:tasks.workunit.client.1.smithi159.stdout:2/106: dwrite da/dc/f1a [0,4194304] 0 2022-02-02T18:21:50.585 INFO:tasks.workunit.client.1.smithi159.stdout:2/107: dread - da/dc/f18 zero size 2022-02-02T18:21:50.589 INFO:tasks.workunit.client.1.smithi159.stdout:2/108: write da/dc/f1a [2055895,62323] 0 2022-02-02T18:21:50.590 INFO:tasks.workunit.client.1.smithi159.stdout:2/109: rmdir da/dc 39 2022-02-02T18:21:50.590 INFO:tasks.workunit.client.1.smithi159.stdout:2/110: chown da/d1c/l1e 600139 1 2022-02-02T18:21:50.592 INFO:tasks.workunit.client.1.smithi159.stdout:2/111: truncate f1 1965125 0 2022-02-02T18:21:50.592 INFO:tasks.workunit.client.1.smithi159.stdout:2/112: fsync da/dc/f18 0 2022-02-02T18:21:50.594 INFO:tasks.workunit.client.1.smithi159.stdout:2/113: write da/dc/f1a [2467704,10623] 0 2022-02-02T18:21:50.598 INFO:tasks.workunit.client.1.smithi159.stdout:2/114: mknod da/c21 0 2022-02-02T18:21:50.604 INFO:tasks.workunit.client.1.smithi159.stdout:4/105: dwrite d0/f6 [0,4194304] 0 2022-02-02T18:21:50.607 INFO:tasks.workunit.client.1.smithi159.stdout:4/106: mknod d0/d8/c22 0 2022-02-02T18:21:50.611 INFO:tasks.workunit.client.1.smithi159.stdout:2/115: dread f1 [0,4194304] 0 2022-02-02T18:21:50.619 INFO:tasks.workunit.client.1.smithi159.stdout:4/107: dread d0/f1e [0,4194304] 0 2022-02-02T18:21:50.619 INFO:tasks.workunit.client.1.smithi159.stdout:4/108: chown d0/d8/f1c 303782 1 2022-02-02T18:21:50.621 INFO:tasks.workunit.client.1.smithi159.stdout:4/109: rename d0/d8/d15/f1a to d0/d8/d14/f23 0 2022-02-02T18:21:50.623 INFO:tasks.workunit.client.1.smithi159.stdout:4/110: mkdir d0/d8/d24 0 2022-02-02T18:21:50.623 INFO:tasks.workunit.client.1.smithi159.stdout:4/111: stat d0/d8/f1c 0 2022-02-02T18:21:50.626 INFO:tasks.workunit.client.1.smithi159.stdout:4/112: rmdir d0/d8/d14 39 2022-02-02T18:21:50.626 INFO:tasks.workunit.client.1.smithi159.stdout:4/113: chown d0/d8/le 29172459 1 2022-02-02T18:21:50.627 INFO:tasks.workunit.client.1.smithi159.stdout:4/114: dread - d0/d8/d14/f23 zero size 2022-02-02T18:21:50.638 INFO:tasks.workunit.client.1.smithi159.stdout:4/115: link d0/d8/d14/f23 d0/f25 0 2022-02-02T18:21:50.640 INFO:tasks.workunit.client.1.smithi159.stdout:4/116: mknod d0/d8/c26 0 2022-02-02T18:21:50.641 INFO:tasks.workunit.client.1.smithi159.stdout:4/117: creat d0/d8/d15/f27 x:0 0 0 2022-02-02T18:21:50.646 INFO:tasks.workunit.client.1.smithi159.stdout:2/116: dwrite da/dc/f1a [0,4194304] 0 2022-02-02T18:21:50.652 INFO:tasks.workunit.client.1.smithi159.stdout:2/117: mknod da/c22 0 2022-02-02T18:21:50.655 INFO:tasks.workunit.client.1.smithi159.stdout:2/118: rename da/dc/l11 to da/dc/l23 0 2022-02-02T18:21:50.655 INFO:tasks.workunit.client.1.smithi159.stdout:2/119: dread - da/dc/f18 zero size 2022-02-02T18:21:50.657 INFO:tasks.workunit.client.1.smithi159.stdout:2/120: mknod da/dc/c24 0 2022-02-02T18:21:50.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/121: readlink l5 0 2022-02-02T18:21:50.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/122: dread - da/dc/f18 zero size 2022-02-02T18:21:50.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/123: mkdir da/d1c/d25 0 2022-02-02T18:21:50.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/124: creat da/d1c/f26 x:0 0 0 2022-02-02T18:21:50.673 INFO:tasks.workunit.client.1.smithi159.stdout:2/125: rmdir da/d1c 39 2022-02-02T18:21:50.673 INFO:tasks.workunit.client.1.smithi159.stdout:2/126: chown da/d1c/d25 1 1 2022-02-02T18:21:50.674 INFO:tasks.workunit.client.1.smithi159.stdout:2/127: getdents da/dc 0 2022-02-02T18:21:50.681 INFO:tasks.workunit.client.1.smithi159.stdout:2/128: truncate da/f16 1726309 0 2022-02-02T18:21:50.684 INFO:tasks.workunit.client.1.smithi159.stdout:2/129: symlink da/l27 0 2022-02-02T18:21:50.685 INFO:tasks.workunit.client.1.smithi159.stdout:2/130: write f9 [1454021,74898] 0 2022-02-02T18:21:50.689 INFO:tasks.workunit.client.1.smithi159.stdout:2/131: creat da/d1c/f28 x:0 0 0 2022-02-02T18:21:50.690 INFO:tasks.workunit.client.1.smithi159.stdout:2/132: mkdir da/d1c/d29 0 2022-02-02T18:21:50.694 INFO:tasks.workunit.client.1.smithi159.stdout:2/133: creat da/d1c/d29/f2a x:0 0 0 2022-02-02T18:21:50.694 INFO:tasks.workunit.client.1.smithi159.stdout:2/134: write da/d1c/d29/f2a [800462,75806] 0 2022-02-02T18:21:50.695 INFO:tasks.workunit.client.1.smithi159.stdout:2/135: chown da/dc/le 0 1 2022-02-02T18:21:50.695 INFO:tasks.workunit.client.1.smithi159.stdout:2/136: readlink da/l19 0 2022-02-02T18:21:50.695 INFO:tasks.workunit.client.1.smithi159.stdout:2/137: read - da/d1c/f1f zero size 2022-02-02T18:21:50.696 INFO:tasks.workunit.client.1.smithi159.stdout:2/138: rename da/d1c/l1e to da/l2b 0 2022-02-02T18:21:50.718 INFO:tasks.workunit.client.1.smithi159.stdout:2/139: dwrite f8 [0,4194304] 0 2022-02-02T18:21:50.718 INFO:tasks.workunit.client.1.smithi159.stdout:2/140: creat da/d1c/d29/f2c x:0 0 0 2022-02-02T18:21:50.721 INFO:tasks.workunit.client.1.smithi159.stdout:2/141: symlink da/d1c/d29/l2d 0 2022-02-02T18:21:50.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/142: dwrite f8 [0,4194304] 0 2022-02-02T18:21:50.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/143: dread - da/dc/f18 zero size 2022-02-02T18:21:50.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/144: unlink da/cb 0 2022-02-02T18:21:50.743 INFO:tasks.workunit.client.1.smithi159.stdout:2/145: write da/d1c/f28 [789790,44628] 0 2022-02-02T18:21:50.748 INFO:tasks.workunit.client.1.smithi159.stdout:2/146: write f1 [367098,30212] 0 2022-02-02T18:21:50.750 INFO:tasks.workunit.client.1.smithi159.stdout:2/147: symlink da/d1c/l2e 0 2022-02-02T18:21:50.750 INFO:tasks.workunit.client.1.smithi159.stdout:2/148: readlink da/dc/le 0 2022-02-02T18:21:50.764 INFO:tasks.workunit.client.1.smithi159.stdout:1/56: sync 2022-02-02T18:21:50.771 INFO:tasks.workunit.client.1.smithi159.stdout:2/149: dread da/dc/f1a [0,4194304] 0 2022-02-02T18:21:50.773 INFO:tasks.workunit.client.1.smithi159.stdout:2/150: symlink da/l2f 0 2022-02-02T18:21:50.773 INFO:tasks.workunit.client.1.smithi159.stdout:2/151: truncate da/d1c/d29/f2c 463674 0 2022-02-02T18:21:50.773 INFO:tasks.workunit.client.1.smithi159.stdout:2/152: dread - da/d1c/f1f zero size 2022-02-02T18:21:50.774 INFO:tasks.workunit.client.1.smithi159.stdout:2/153: dread - da/dc/f18 zero size 2022-02-02T18:21:50.774 INFO:tasks.workunit.client.1.smithi159.stdout:2/154: write da/d1c/f26 [480229,49212] 0 2022-02-02T18:21:50.775 INFO:tasks.workunit.client.1.smithi159.stdout:1/57: dread f1 [0,4194304] 0 2022-02-02T18:21:50.777 INFO:tasks.workunit.client.1.smithi159.stdout:1/58: creat df/d14/f15 x:0 0 0 2022-02-02T18:21:50.777 INFO:tasks.workunit.client.1.smithi159.stdout:1/59: chown c6 6639 1 2022-02-02T18:21:50.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/60: mkdir df/d14/d16 0 2022-02-02T18:21:50.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/61: write f1 [5414361,7055] 0 2022-02-02T18:21:50.780 INFO:tasks.workunit.client.1.smithi159.stdout:1/62: creat df/d14/f17 x:0 0 0 2022-02-02T18:21:50.780 INFO:tasks.workunit.client.1.smithi159.stdout:1/63: unlink fb 0 2022-02-02T18:21:50.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/155: write da/f16 [251275,107755] 0 2022-02-02T18:21:50.783 INFO:tasks.workunit.client.1.smithi159.stdout:2/156: dread da/d1c/d29/f2c [0,4194304] 0 2022-02-02T18:21:50.784 INFO:tasks.workunit.client.1.smithi159.stdout:2/157: fsync da/d1c/f1f 0 2022-02-02T18:21:50.808 INFO:tasks.workunit.client.1.smithi159.stdout:2/158: dwrite da/d1c/d29/f2a [0,4194304] 0 2022-02-02T18:21:50.809 INFO:tasks.workunit.client.1.smithi159.stdout:1/64: creat df/f18 x:0 0 0 2022-02-02T18:21:50.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/65: symlink df/l19 0 2022-02-02T18:21:50.814 INFO:tasks.workunit.client.1.smithi159.stdout:1/66: symlink df/l1a 0 2022-02-02T18:21:50.830 INFO:tasks.workunit.client.1.smithi159.stdout:2/159: dwrite da/d1c/f28 [0,4194304] 0 2022-02-02T18:21:50.834 INFO:tasks.workunit.client.1.smithi159.stdout:2/160: mkdir da/d30 0 2022-02-02T18:21:50.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/161: dread da/dc/f1a [0,4194304] 0 2022-02-02T18:21:50.843 INFO:tasks.workunit.client.1.smithi159.stdout:2/162: write da/dc/f1d [1872599,74852] 0 2022-02-02T18:21:50.859 INFO:tasks.workunit.client.1.smithi159.stdout:2/163: dwrite f1 [0,4194304] 0 2022-02-02T18:21:50.860 INFO:tasks.workunit.client.1.smithi159.stdout:2/164: write da/dc/f1d [1429977,114106] 0 2022-02-02T18:21:50.861 INFO:tasks.workunit.client.1.smithi159.stdout:2/165: write f1 [4311922,76681] 0 2022-02-02T18:21:50.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/166: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:50.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/167: fdatasync da/d1c/f28 0 2022-02-02T18:21:50.883 INFO:tasks.workunit.client.1.smithi159.stdout:2/168: chown da/d30 27973885 1 2022-02-02T18:21:50.899 INFO:tasks.workunit.client.1.smithi159.stdout:2/169: dwrite f1 [0,4194304] 0 2022-02-02T18:21:50.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/170: rename l4 to da/d1c/l31 0 2022-02-02T18:21:50.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/171: fsync da/dc/f18 0 2022-02-02T18:21:50.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/172: creat da/d1c/f32 x:0 0 0 2022-02-02T18:21:50.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/173: creat da/d1c/d29/f33 x:0 0 0 2022-02-02T18:21:50.902 INFO:tasks.workunit.client.1.smithi159.stdout:2/174: creat da/d30/f34 x:0 0 0 2022-02-02T18:21:50.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/175: write da/d1c/f28 [3057937,97564] 0 2022-02-02T18:21:50.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/176: unlink da/c21 0 2022-02-02T18:21:50.905 INFO:tasks.workunit.client.1.smithi159.stdout:2/177: symlink da/l35 0 2022-02-02T18:21:50.906 INFO:tasks.workunit.client.1.smithi159.stdout:2/178: chown da/f16 60497153 1 2022-02-02T18:21:50.907 INFO:tasks.workunit.client.1.smithi159.stdout:2/179: symlink da/d1c/l36 0 2022-02-02T18:21:50.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/180: creat da/dc/f37 x:0 0 0 2022-02-02T18:21:50.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/181: truncate da/d1c/d29/f33 1025497 0 2022-02-02T18:21:50.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/182: dread - da/dc/f37 zero size 2022-02-02T18:21:50.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/183: symlink da/l38 0 2022-02-02T18:21:50.910 INFO:tasks.workunit.client.1.smithi159.stdout:2/184: symlink da/dc/l39 0 2022-02-02T18:21:50.911 INFO:tasks.workunit.client.1.smithi159.stdout:2/185: stat da/d1c/d29/l2d 0 2022-02-02T18:21:50.921 INFO:tasks.workunit.client.1.smithi159.stdout:2/186: dread da/d1c/f28 [0,4194304] 0 2022-02-02T18:21:50.922 INFO:tasks.workunit.client.1.smithi159.stdout:2/187: mknod da/d1c/d25/c3a 0 2022-02-02T18:21:50.922 INFO:tasks.workunit.client.1.smithi159.stdout:2/188: chown da/dc/c1b 21989 1 2022-02-02T18:21:50.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/189: link da/d30/f34 da/f3b 0 2022-02-02T18:21:50.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/190: creat da/d1c/f3c x:0 0 0 2022-02-02T18:21:50.924 INFO:tasks.workunit.client.1.smithi159.stdout:2/191: symlink da/d1c/d29/l3d 0 2022-02-02T18:21:50.924 INFO:tasks.workunit.client.1.smithi159.stdout:2/192: write da/d1c/d29/f2c [923273,96740] 0 2022-02-02T18:21:50.925 INFO:tasks.workunit.client.1.smithi159.stdout:2/193: write f1 [2509528,110293] 0 2022-02-02T18:21:50.925 INFO:tasks.workunit.client.1.smithi159.stdout:2/194: read - da/d30/f34 zero size 2022-02-02T18:21:50.927 INFO:tasks.workunit.client.1.smithi159.stdout:2/195: unlink da/d1c/l2e 0 2022-02-02T18:21:50.937 INFO:tasks.workunit.client.1.smithi159.stdout:2/196: fsync da/dc/f37 0 2022-02-02T18:21:50.937 INFO:tasks.workunit.client.1.smithi159.stdout:2/197: dread - da/d30/f34 zero size 2022-02-02T18:21:50.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/198: mkdir da/d30/d3e 0 2022-02-02T18:21:50.958 INFO:tasks.workunit.client.1.smithi159.stdout:2/199: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:50.962 INFO:tasks.workunit.client.1.smithi159.stdout:2/200: dread da/d1c/f26 [0,4194304] 0 2022-02-02T18:21:51.020 INFO:tasks.workunit.client.1.smithi159.stdout:6/108: sync 2022-02-02T18:21:51.035 INFO:tasks.workunit.client.1.smithi159.stdout:6/109: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:51.036 INFO:tasks.workunit.client.1.smithi159.stdout:6/110: dread - df/f14 zero size 2022-02-02T18:21:51.036 INFO:tasks.workunit.client.1.smithi159.stdout:6/111: write fd [434168,80148] 0 2022-02-02T18:21:51.038 INFO:tasks.workunit.client.1.smithi159.stdout:6/112: mknod df/d1f/c25 0 2022-02-02T18:21:51.059 INFO:tasks.workunit.client.1.smithi159.stdout:6/113: dwrite df/f1a [0,4194304] 0 2022-02-02T18:21:51.062 INFO:tasks.workunit.client.1.smithi159.stdout:6/114: dread df/f1e [0,4194304] 0 2022-02-02T18:21:51.064 INFO:tasks.workunit.client.1.smithi159.stdout:6/115: mknod df/d1f/d20/c26 0 2022-02-02T18:21:51.064 INFO:tasks.workunit.client.1.smithi159.stdout:6/116: chown df/l1d 61205887 1 2022-02-02T18:21:51.064 INFO:tasks.workunit.client.1.smithi159.stdout:6/117: write fe [4358883,84866] 0 2022-02-02T18:21:51.079 INFO:tasks.workunit.client.1.smithi159.stdout:6/118: dread f6 [0,4194304] 0 2022-02-02T18:21:51.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/119: link f7 df/d1f/f27 0 2022-02-02T18:21:51.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/120: symlink df/l28 0 2022-02-02T18:21:51.083 INFO:tasks.workunit.client.1.smithi159.stdout:6/121: mknod df/c29 0 2022-02-02T18:21:51.085 INFO:tasks.workunit.client.1.smithi159.stdout:6/122: dread df/f17 [0,4194304] 0 2022-02-02T18:21:51.085 INFO:tasks.workunit.client.1.smithi159.stdout:6/123: write df/f14 [604160,93563] 0 2022-02-02T18:21:51.086 INFO:tasks.workunit.client.1.smithi159.stdout:6/124: mkdir df/d1f/d2a 0 2022-02-02T18:21:51.087 INFO:tasks.workunit.client.1.smithi159.stdout:6/125: link df/d1f/c22 df/d1f/d2a/c2b 0 2022-02-02T18:21:51.088 INFO:tasks.workunit.client.1.smithi159.stdout:6/126: truncate fc 1853434 0 2022-02-02T18:21:51.090 INFO:tasks.workunit.client.1.smithi159.stdout:6/127: creat df/d1f/d2a/f2c x:0 0 0 2022-02-02T18:21:51.096 INFO:tasks.workunit.client.1.smithi159.stdout:6/128: unlink df/d1f/d2a/f2c 0 2022-02-02T18:21:51.096 INFO:tasks.workunit.client.1.smithi159.stdout:6/129: chown f7 1 1 2022-02-02T18:21:51.190 INFO:tasks.workunit.client.1.smithi159.stdout:7/117: sync 2022-02-02T18:21:51.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/53: sync 2022-02-02T18:21:51.191 INFO:tasks.workunit.client.1.smithi159.stdout:9/73: sync 2022-02-02T18:21:51.191 INFO:tasks.workunit.client.1.smithi159.stdout:8/91: sync 2022-02-02T18:21:51.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/118: chown d3/d5/d8 110 1 2022-02-02T18:21:51.192 INFO:tasks.workunit.client.1.smithi159.stdout:5/54: fdatasync d9/de/ff 0 2022-02-02T18:21:51.192 INFO:tasks.workunit.client.1.smithi159.stdout:9/74: dread - d4/f11 zero size 2022-02-02T18:21:51.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/111: sync 2022-02-02T18:21:51.192 INFO:tasks.workunit.client.1.smithi159.stdout:3/120: sync 2022-02-02T18:21:51.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/112: chown d1/dd 1 1 2022-02-02T18:21:51.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/113: stat d1/dd/c16 0 2022-02-02T18:21:51.193 INFO:tasks.workunit.client.1.smithi159.stdout:4/118: sync 2022-02-02T18:21:51.193 INFO:tasks.workunit.client.1.smithi159.stdout:5/55: creat d9/de/f14 x:0 0 0 2022-02-02T18:21:51.194 INFO:tasks.workunit.client.1.smithi159.stdout:8/92: creat d1/dd/d1a/f20 x:0 0 0 2022-02-02T18:21:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:8/93: write d1/dd/f16 [608193,775] 0 2022-02-02T18:21:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:8/94: fdatasync d1/dd/d1a/f20 0 2022-02-02T18:21:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/75: link d4/ce d4/c12 0 2022-02-02T18:21:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/76: creat d4/f13 x:0 0 0 2022-02-02T18:21:51.196 INFO:tasks.workunit.client.1.smithi159.stdout:3/121: mkdir dd/d20/d2a 0 2022-02-02T18:21:51.198 INFO:tasks.workunit.client.1.smithi159.stdout:9/77: dread d4/f10 [0,4194304] 0 2022-02-02T18:21:51.199 INFO:tasks.workunit.client.1.smithi159.stdout:5/56: rename d9/de/ff to d9/f15 0 2022-02-02T18:21:51.200 INFO:tasks.workunit.client.1.smithi159.stdout:5/57: creat d9/de/f16 x:0 0 0 2022-02-02T18:21:51.200 INFO:tasks.workunit.client.1.smithi159.stdout:5/58: fsync f7 0 2022-02-02T18:21:51.200 INFO:tasks.workunit.client.1.smithi159.stdout:7/119: getdents d3/d5/d8 0 2022-02-02T18:21:51.201 INFO:tasks.workunit.client.1.smithi159.stdout:0/114: unlink d1/dd/l12 0 2022-02-02T18:21:51.204 INFO:tasks.workunit.client.1.smithi159.stdout:3/122: creat dd/d19/f2b x:0 0 0 2022-02-02T18:21:51.208 INFO:tasks.workunit.client.1.smithi159.stdout:8/95: getdents d1 0 2022-02-02T18:21:51.208 INFO:tasks.workunit.client.1.smithi159.stdout:7/120: mkdir d3/d27/d29 0 2022-02-02T18:21:51.209 INFO:tasks.workunit.client.1.smithi159.stdout:0/115: read d1/fc [1391808,26592] 0 2022-02-02T18:21:51.209 INFO:tasks.workunit.client.1.smithi159.stdout:0/116: chown d1/fb 20399500 1 2022-02-02T18:21:51.210 INFO:tasks.workunit.client.1.smithi159.stdout:3/123: mknod dd/d20/d2a/c2c 0 2022-02-02T18:21:51.210 INFO:tasks.workunit.client.1.smithi159.stdout:3/124: dread - dd/ff zero size 2022-02-02T18:21:51.210 INFO:tasks.workunit.client.1.smithi159.stdout:3/125: write dd/d19/f23 [1098,38674] 0 2022-02-02T18:21:51.211 INFO:tasks.workunit.client.1.smithi159.stdout:8/96: symlink d1/l21 0 2022-02-02T18:21:51.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/121: truncate d3/d18/f22 2803633 0 2022-02-02T18:21:51.217 INFO:tasks.workunit.client.1.smithi159.stdout:7/122: rename d3/d18 to d3/d2a 0 2022-02-02T18:21:51.219 INFO:tasks.workunit.client.1.smithi159.stdout:3/126: symlink dd/l2d 0 2022-02-02T18:21:51.219 INFO:tasks.workunit.client.1.smithi159.stdout:3/127: fsync dd/d20/f22 0 2022-02-02T18:21:51.220 INFO:tasks.workunit.client.1.smithi159.stdout:3/128: write dd/d19/f2b [213258,101815] 0 2022-02-02T18:21:51.220 INFO:tasks.workunit.client.1.smithi159.stdout:3/129: chown dd/d20/f22 90862 1 2022-02-02T18:21:51.220 INFO:tasks.workunit.client.1.smithi159.stdout:7/123: mknod d3/d27/d29/c2b 0 2022-02-02T18:21:51.221 INFO:tasks.workunit.client.1.smithi159.stdout:4/119: dwrite d0/f3 [0,4194304] 0 2022-02-02T18:21:51.221 INFO:tasks.workunit.client.1.smithi159.stdout:8/97: rename d1/l2 to d1/l22 0 2022-02-02T18:21:51.224 INFO:tasks.workunit.client.1.smithi159.stdout:8/98: mknod d1/dd/d1a/c23 0 2022-02-02T18:21:51.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/130: dread f7 [0,4194304] 0 2022-02-02T18:21:51.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/131: chown dd 91698 1 2022-02-02T18:21:51.239 INFO:tasks.workunit.client.1.smithi159.stdout:9/78: dwrite d4/f11 [0,4194304] 0 2022-02-02T18:21:51.239 INFO:tasks.workunit.client.1.smithi159.stdout:9/79: chown d4/f11 6871474 1 2022-02-02T18:21:51.239 INFO:tasks.workunit.client.1.smithi159.stdout:0/117: dwrite d1/fa [0,4194304] 0 2022-02-02T18:21:51.240 INFO:tasks.workunit.client.1.smithi159.stdout:3/132: dread dd/d19/f1b [0,4194304] 0 2022-02-02T18:21:51.246 INFO:tasks.workunit.client.1.smithi159.stdout:4/120: dread d0/d8/f1c [0,4194304] 0 2022-02-02T18:21:51.246 INFO:tasks.workunit.client.1.smithi159.stdout:4/121: stat d0/l4 0 2022-02-02T18:21:51.246 INFO:tasks.workunit.client.1.smithi159.stdout:4/122: chown d0/f1e 345 1 2022-02-02T18:21:51.247 INFO:tasks.workunit.client.1.smithi159.stdout:4/123: creat d0/d8/f28 x:0 0 0 2022-02-02T18:21:51.247 INFO:tasks.workunit.client.1.smithi159.stdout:4/124: creat d0/f29 x:0 0 0 2022-02-02T18:21:51.333 INFO:tasks.workunit.client.1.smithi159.stdout:4/125: read d0/d8/f10 [2376668,54428] 0 2022-02-02T18:21:51.334 INFO:tasks.workunit.client.1.smithi159.stdout:4/126: chown d0 4094162 1 2022-02-02T18:21:51.335 INFO:tasks.workunit.client.1.smithi159.stdout:0/118: read d1/dd/f1a [827903,114676] 0 2022-02-02T18:21:51.336 INFO:tasks.workunit.client.1.smithi159.stdout:9/80: link d4/f13 d4/f14 0 2022-02-02T18:21:51.339 INFO:tasks.workunit.client.1.smithi159.stdout:3/133: dread dd/f1f [0,4194304] 0 2022-02-02T18:21:51.339 INFO:tasks.workunit.client.1.smithi159.stdout:5/59: dwrite f7 [0,4194304] 0 2022-02-02T18:21:51.346 INFO:tasks.workunit.client.1.smithi159.stdout:0/119: rename d1/f2 to d1/d19/f25 0 2022-02-02T18:21:51.352 INFO:tasks.workunit.client.1.smithi159.stdout:0/120: mknod d1/d11/c26 0 2022-02-02T18:21:51.354 INFO:tasks.workunit.client.1.smithi159.stdout:3/134: rename l4 to dd/d20/l2e 0 2022-02-02T18:21:51.359 INFO:tasks.workunit.client.1.smithi159.stdout:3/135: mknod dd/d20/c2f 0 2022-02-02T18:21:51.359 INFO:tasks.workunit.client.1.smithi159.stdout:7/124: dwrite d3/d6/f17 [0,4194304] 0 2022-02-02T18:21:51.361 INFO:tasks.workunit.client.1.smithi159.stdout:8/99: dwrite d1/dd/f16 [0,4194304] 0 2022-02-02T18:21:51.361 INFO:tasks.workunit.client.1.smithi159.stdout:9/81: dwrite d4/f14 [0,4194304] 0 2022-02-02T18:21:51.362 INFO:tasks.workunit.client.1.smithi159.stdout:9/82: readlink - no filename 2022-02-02T18:21:51.362 INFO:tasks.workunit.client.1.smithi159.stdout:3/136: dread dd/f1f [0,4194304] 0 2022-02-02T18:21:51.362 INFO:tasks.workunit.client.1.smithi159.stdout:3/137: truncate dd/ff 970749 0 2022-02-02T18:21:51.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/125: mkdir d3/d2a/d2c 0 2022-02-02T18:21:51.368 INFO:tasks.workunit.client.1.smithi159.stdout:4/127: getdents d0 0 2022-02-02T18:21:51.368 INFO:tasks.workunit.client.1.smithi159.stdout:4/128: chown d0/d8/f10 957 1 2022-02-02T18:21:51.368 INFO:tasks.workunit.client.1.smithi159.stdout:4/129: creat d0/d8/d15/f2a x:0 0 0 2022-02-02T18:21:51.369 INFO:tasks.workunit.client.1.smithi159.stdout:0/121: unlink d1/d11/c26 0 2022-02-02T18:21:51.373 INFO:tasks.workunit.client.1.smithi159.stdout:5/60: dwrite f1 [0,4194304] 0 2022-02-02T18:21:51.374 INFO:tasks.workunit.client.1.smithi159.stdout:3/138: link dd/d19/f1a dd/d20/f30 0 2022-02-02T18:21:51.376 INFO:tasks.workunit.client.1.smithi159.stdout:7/126: rename d3/d5/f1b to d3/f2d 0 2022-02-02T18:21:51.377 INFO:tasks.workunit.client.1.smithi159.stdout:8/100: symlink d1/dc/l24 0 2022-02-02T18:21:51.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/122: write d1/dd/f1a [1868576,57937] 0 2022-02-02T18:21:51.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/123: unlink d1/d11/f1e 0 2022-02-02T18:21:51.381 INFO:tasks.workunit.client.1.smithi159.stdout:9/83: getdents d4 0 2022-02-02T18:21:51.385 INFO:tasks.workunit.client.1.smithi159.stdout:3/139: dread dd/d19/f1e [0,4194304] 0 2022-02-02T18:21:51.386 INFO:tasks.workunit.client.1.smithi159.stdout:3/140: write f7 [4249825,119926] 0 2022-02-02T18:21:51.388 INFO:tasks.workunit.client.1.smithi159.stdout:7/127: mkdir d3/d5/d8/d2e 0 2022-02-02T18:21:51.389 INFO:tasks.workunit.client.1.smithi159.stdout:5/61: dwrite d9/de/f16 [0,4194304] 0 2022-02-02T18:21:51.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/101: mknod d1/dd/c25 0 2022-02-02T18:21:51.391 INFO:tasks.workunit.client.1.smithi159.stdout:4/130: fsync d0/d8/d15/f2a 0 2022-02-02T18:21:51.393 INFO:tasks.workunit.client.1.smithi159.stdout:0/124: symlink d1/dd/l27 0 2022-02-02T18:21:51.395 INFO:tasks.workunit.client.1.smithi159.stdout:3/141: mkdir dd/d20/d2a/d31 0 2022-02-02T18:21:51.395 INFO:tasks.workunit.client.1.smithi159.stdout:3/142: truncate f9 308374 0 2022-02-02T18:21:51.395 INFO:tasks.workunit.client.1.smithi159.stdout:3/143: fsync dd/f1f 0 2022-02-02T18:21:51.396 INFO:tasks.workunit.client.1.smithi159.stdout:3/144: fdatasync dd/d20/f30 0 2022-02-02T18:21:51.397 INFO:tasks.workunit.client.1.smithi159.stdout:7/128: rename d3/d5/d8/d2e to d3/d19/d2f 0 2022-02-02T18:21:51.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/62: symlink d9/l17 0 2022-02-02T18:21:51.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/63: dread - d9/fd zero size 2022-02-02T18:21:51.401 INFO:tasks.workunit.client.1.smithi159.stdout:4/131: creat d0/f2b x:0 0 0 2022-02-02T18:21:51.401 INFO:tasks.workunit.client.1.smithi159.stdout:4/132: chown d0/d8 26036 1 2022-02-02T18:21:51.402 INFO:tasks.workunit.client.1.smithi159.stdout:4/133: write d0/d8/f28 [657192,87861] 0 2022-02-02T18:21:51.402 INFO:tasks.workunit.client.1.smithi159.stdout:4/134: chown d0/d8/d14 26765257 1 2022-02-02T18:21:51.403 INFO:tasks.workunit.client.1.smithi159.stdout:9/84: dwrite d4/fd [0,4194304] 0 2022-02-02T18:21:51.403 INFO:tasks.workunit.client.1.smithi159.stdout:0/125: link d1/dd/c16 d1/d11/c28 0 2022-02-02T18:21:51.406 INFO:tasks.workunit.client.1.smithi159.stdout:7/129: mknod d3/d19/c30 0 2022-02-02T18:21:51.408 INFO:tasks.workunit.client.1.smithi159.stdout:5/64: creat d9/de/d12/f18 x:0 0 0 2022-02-02T18:21:51.409 INFO:tasks.workunit.client.1.smithi159.stdout:8/102: mkdir d1/d26 0 2022-02-02T18:21:51.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/135: symlink d0/d8/d14/l2c 0 2022-02-02T18:21:51.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/136: creat d0/f2d x:0 0 0 2022-02-02T18:21:51.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/137: chown d0/c9 1057 1 2022-02-02T18:21:51.414 INFO:tasks.workunit.client.1.smithi159.stdout:9/85: mknod d4/c15 0 2022-02-02T18:21:51.418 INFO:tasks.workunit.client.1.smithi159.stdout:0/126: creat d1/d19/f29 x:0 0 0 2022-02-02T18:21:51.418 INFO:tasks.workunit.client.1.smithi159.stdout:5/65: dread d9/de/f16 [0,4194304] 0 2022-02-02T18:21:51.419 INFO:tasks.workunit.client.1.smithi159.stdout:9/86: creat d4/f16 x:0 0 0 2022-02-02T18:21:51.420 INFO:tasks.workunit.client.1.smithi159.stdout:8/103: rename d1/fe to d1/dc/f27 0 2022-02-02T18:21:51.420 INFO:tasks.workunit.client.1.smithi159.stdout:3/145: dwrite dd/d19/f1e [0,4194304] 0 2022-02-02T18:21:51.424 INFO:tasks.workunit.client.1.smithi159.stdout:0/127: fsync d1/f8 0 2022-02-02T18:21:51.428 INFO:tasks.workunit.client.1.smithi159.stdout:0/128: rename d1/d11/c28 to d1/d11/d1d/c2a 0 2022-02-02T18:21:51.428 INFO:tasks.workunit.client.1.smithi159.stdout:0/129: chown d1/dd/l20 145121283 1 2022-02-02T18:21:51.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/87: write d4/f14 [3137055,77197] 0 2022-02-02T18:21:51.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/88: creat d4/f17 x:0 0 0 2022-02-02T18:21:51.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/89: creat d4/f18 x:0 0 0 2022-02-02T18:21:51.432 INFO:tasks.workunit.client.1.smithi159.stdout:3/146: dread dd/d20/f22 [0,4194304] 0 2022-02-02T18:21:51.432 INFO:tasks.workunit.client.1.smithi159.stdout:3/147: chown f9 2 1 2022-02-02T18:21:51.433 INFO:tasks.workunit.client.1.smithi159.stdout:7/130: dwrite d3/d2a/f22 [0,4194304] 0 2022-02-02T18:21:51.446 INFO:tasks.workunit.client.1.smithi159.stdout:5/66: dwrite d9/de/f14 [0,4194304] 0 2022-02-02T18:21:51.447 INFO:tasks.workunit.client.1.smithi159.stdout:9/90: mkdir d4/d19 0 2022-02-02T18:21:51.447 INFO:tasks.workunit.client.1.smithi159.stdout:3/148: creat dd/d20/d2a/f32 x:0 0 0 2022-02-02T18:21:51.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/149: dread - dd/f28 zero size 2022-02-02T18:21:51.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/150: chown dd/d20/d2a/c2c 2 1 2022-02-02T18:21:51.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/151: stat f7 0 2022-02-02T18:21:51.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/152: fdatasync dd/d20/d2a/f32 0 2022-02-02T18:21:51.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/153: chown f5 2631327 1 2022-02-02T18:21:51.449 INFO:tasks.workunit.client.1.smithi159.stdout:3/154: write dd/f1c [464793,70069] 0 2022-02-02T18:21:51.452 INFO:tasks.workunit.client.1.smithi159.stdout:5/67: rename d9/de/f14 to d9/de/d12/f19 0 2022-02-02T18:21:51.457 INFO:tasks.workunit.client.1.smithi159.stdout:3/155: rename dd/d20/f22 to dd/d19/f33 0 2022-02-02T18:21:51.459 INFO:tasks.workunit.client.1.smithi159.stdout:3/156: creat dd/f34 x:0 0 0 2022-02-02T18:21:51.461 INFO:tasks.workunit.client.1.smithi159.stdout:3/157: mkdir dd/d19/d35 0 2022-02-02T18:21:51.463 INFO:tasks.workunit.client.1.smithi159.stdout:7/131: dwrite d3/d2a/f22 [0,4194304] 0 2022-02-02T18:21:51.472 INFO:tasks.workunit.client.1.smithi159.stdout:3/158: dread dd/f1f [0,4194304] 0 2022-02-02T18:21:51.473 INFO:tasks.workunit.client.1.smithi159.stdout:3/159: chown f5 1699930885 1 2022-02-02T18:21:51.477 INFO:tasks.workunit.client.1.smithi159.stdout:3/160: rename cb to dd/d20/c36 0 2022-02-02T18:21:51.479 INFO:tasks.workunit.client.1.smithi159.stdout:3/161: link dd/d19/f1e dd/d20/d2a/d31/f37 0 2022-02-02T18:21:51.480 INFO:tasks.workunit.client.1.smithi159.stdout:0/130: dwrite d1/fa [0,4194304] 0 2022-02-02T18:21:51.484 INFO:tasks.workunit.client.1.smithi159.stdout:0/131: dread d1/dd/f1a [0,4194304] 0 2022-02-02T18:21:51.484 INFO:tasks.workunit.client.1.smithi159.stdout:0/132: creat d1/d11/f2b x:0 0 0 2022-02-02T18:21:51.485 INFO:tasks.workunit.client.1.smithi159.stdout:0/133: read f0 [836356,86270] 0 2022-02-02T18:21:51.487 INFO:tasks.workunit.client.1.smithi159.stdout:0/134: link f0 d1/f2c 0 2022-02-02T18:21:51.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/135: readlink d1/d11/l21 0 2022-02-02T18:21:51.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/136: stat d1/d11/d1d/f22 0 2022-02-02T18:21:51.489 INFO:tasks.workunit.client.1.smithi159.stdout:9/91: dwrite d4/f11 [0,4194304] 0 2022-02-02T18:21:51.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/137: symlink d1/l2d 0 2022-02-02T18:21:51.491 INFO:tasks.workunit.client.1.smithi159.stdout:9/92: link d4/f17 d4/d19/f1a 0 2022-02-02T18:21:51.492 INFO:tasks.workunit.client.1.smithi159.stdout:7/132: dwrite d3/f14 [0,4194304] 0 2022-02-02T18:21:51.492 INFO:tasks.workunit.client.1.smithi159.stdout:7/133: readlink d3/d6/l25 0 2022-02-02T18:21:51.493 INFO:tasks.workunit.client.1.smithi159.stdout:7/134: symlink d3/d5/l31 0 2022-02-02T18:21:51.499 INFO:tasks.workunit.client.1.smithi159.stdout:5/68: dwrite f1 [0,4194304] 0 2022-02-02T18:21:51.499 INFO:tasks.workunit.client.1.smithi159.stdout:5/69: fdatasync d9/de/d12/f18 0 2022-02-02T18:21:51.499 INFO:tasks.workunit.client.1.smithi159.stdout:0/138: symlink d1/l2e 0 2022-02-02T18:21:51.499 INFO:tasks.workunit.client.1.smithi159.stdout:0/139: chown d1/f8 0 1 2022-02-02T18:21:51.499 INFO:tasks.workunit.client.1.smithi159.stdout:0/140: chown d1/dd/l20 151070195 1 2022-02-02T18:21:51.500 INFO:tasks.workunit.client.1.smithi159.stdout:3/162: dread dd/f1c [0,4194304] 0 2022-02-02T18:21:51.500 INFO:tasks.workunit.client.1.smithi159.stdout:0/141: creat d1/d19/f2f x:0 0 0 2022-02-02T18:21:51.505 INFO:tasks.workunit.client.1.smithi159.stdout:0/142: write d1/f10 [4218990,89191] 0 2022-02-02T18:21:51.510 INFO:tasks.workunit.client.1.smithi159.stdout:0/143: write d1/f5 [3828862,40124] 0 2022-02-02T18:21:51.518 INFO:tasks.workunit.client.1.smithi159.stdout:9/93: dwrite d4/f11 [4194304,4194304] 0 2022-02-02T18:21:51.518 INFO:tasks.workunit.client.1.smithi159.stdout:5/70: dwrite f7 [4194304,4194304] 0 2022-02-02T18:21:51.519 INFO:tasks.workunit.client.1.smithi159.stdout:5/71: creat d9/de/d12/f1a x:0 0 0 2022-02-02T18:21:51.524 INFO:tasks.workunit.client.1.smithi159.stdout:9/94: mkdir d4/d1b 0 2022-02-02T18:21:51.527 INFO:tasks.workunit.client.1.smithi159.stdout:3/163: rmdir dd/d20 39 2022-02-02T18:21:51.534 INFO:tasks.workunit.client.1.smithi159.stdout:0/144: dwrite d1/dd/f1a [0,4194304] 0 2022-02-02T18:21:51.534 INFO:tasks.workunit.client.1.smithi159.stdout:0/145: truncate d1/d19/f29 832394 0 2022-02-02T18:21:51.535 INFO:tasks.workunit.client.1.smithi159.stdout:9/95: mkdir d4/d19/d1c 0 2022-02-02T18:21:51.538 INFO:tasks.workunit.client.1.smithi159.stdout:3/164: dread f9 [0,4194304] 0 2022-02-02T18:21:51.544 INFO:tasks.workunit.client.1.smithi159.stdout:0/146: link d1/dd/lf d1/l30 0 2022-02-02T18:21:51.546 INFO:tasks.workunit.client.1.smithi159.stdout:3/165: unlink dd/ff 0 2022-02-02T18:21:51.546 INFO:tasks.workunit.client.1.smithi159.stdout:0/147: dread d1/d19/f29 [0,4194304] 0 2022-02-02T18:21:51.548 INFO:tasks.workunit.client.1.smithi159.stdout:5/72: dwrite d9/fd [0,4194304] 0 2022-02-02T18:21:51.548 INFO:tasks.workunit.client.1.smithi159.stdout:5/73: stat l2 0 2022-02-02T18:21:51.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/166: mkdir dd/d19/d38 0 2022-02-02T18:21:51.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/167: write dd/d19/f1a [889352,55888] 0 2022-02-02T18:21:51.549 INFO:tasks.workunit.client.1.smithi159.stdout:0/148: truncate d1/f8 1334367 0 2022-02-02T18:21:51.554 INFO:tasks.workunit.client.1.smithi159.stdout:5/74: dread d9/fc [0,4194304] 0 2022-02-02T18:21:51.554 INFO:tasks.workunit.client.1.smithi159.stdout:5/75: chown f8 6899 1 2022-02-02T18:21:51.555 INFO:tasks.workunit.client.1.smithi159.stdout:5/76: read d9/fc [59240,6160] 0 2022-02-02T18:21:51.555 INFO:tasks.workunit.client.1.smithi159.stdout:3/168: truncate dd/d19/f1e 958844 0 2022-02-02T18:21:51.555 INFO:tasks.workunit.client.1.smithi159.stdout:3/169: stat dd/d19/d38 0 2022-02-02T18:21:51.557 INFO:tasks.workunit.client.1.smithi159.stdout:9/96: dwrite d4/f10 [0,4194304] 0 2022-02-02T18:21:51.558 INFO:tasks.workunit.client.1.smithi159.stdout:5/77: link d9/de/d12/f19 d9/de/d12/f1b 0 2022-02-02T18:21:51.559 INFO:tasks.workunit.client.1.smithi159.stdout:3/170: mknod dd/d20/d2a/c39 0 2022-02-02T18:21:51.559 INFO:tasks.workunit.client.1.smithi159.stdout:5/78: truncate f8 3913986 0 2022-02-02T18:21:51.559 INFO:tasks.workunit.client.1.smithi159.stdout:5/79: creat d9/f1c x:0 0 0 2022-02-02T18:21:51.560 INFO:tasks.workunit.client.1.smithi159.stdout:3/171: mkdir dd/d20/d2a/d3a 0 2022-02-02T18:21:51.563 INFO:tasks.workunit.client.1.smithi159.stdout:3/172: link dd/d20/d2a/c39 dd/d20/d2a/d3a/c3b 0 2022-02-02T18:21:51.563 INFO:tasks.workunit.client.1.smithi159.stdout:5/80: getdents d9/de 0 2022-02-02T18:21:51.564 INFO:tasks.workunit.client.1.smithi159.stdout:5/81: fsync d9/fc 0 2022-02-02T18:21:51.570 INFO:tasks.workunit.client.1.smithi159.stdout:3/173: read dd/f1f [370411,48473] 0 2022-02-02T18:21:51.575 INFO:tasks.workunit.client.1.smithi159.stdout:3/174: rename f5 to dd/d20/f3c 0 2022-02-02T18:21:51.575 INFO:tasks.workunit.client.1.smithi159.stdout:3/175: write dd/f34 [953437,37317] 0 2022-02-02T18:21:51.576 INFO:tasks.workunit.client.1.smithi159.stdout:0/149: dwrite d1/d11/d1d/f22 [0,4194304] 0 2022-02-02T18:21:51.577 INFO:tasks.workunit.client.1.smithi159.stdout:0/150: unlink d1/dd/l20 0 2022-02-02T18:21:51.577 INFO:tasks.workunit.client.1.smithi159.stdout:0/151: creat d1/d19/f31 x:0 0 0 2022-02-02T18:21:51.582 INFO:tasks.workunit.client.1.smithi159.stdout:0/152: unlink d1/d19/f31 0 2022-02-02T18:21:51.583 INFO:tasks.workunit.client.1.smithi159.stdout:0/153: truncate d1/f2c 2215100 0 2022-02-02T18:21:51.585 INFO:tasks.workunit.client.1.smithi159.stdout:0/154: mknod d1/d19/c32 0 2022-02-02T18:21:51.591 INFO:tasks.workunit.client.1.smithi159.stdout:0/155: creat d1/dd/f33 x:0 0 0 2022-02-02T18:21:51.591 INFO:tasks.workunit.client.1.smithi159.stdout:0/156: stat d1/d19/f2f 0 2022-02-02T18:21:51.591 INFO:tasks.workunit.client.1.smithi159.stdout:0/157: chown d1/d11/f2b 3151 1 2022-02-02T18:21:51.593 INFO:tasks.workunit.client.1.smithi159.stdout:0/158: mkdir d1/d11/d1d/d34 0 2022-02-02T18:21:51.593 INFO:tasks.workunit.client.1.smithi159.stdout:0/159: creat d1/d11/f35 x:0 0 0 2022-02-02T18:21:51.600 INFO:tasks.workunit.client.1.smithi159.stdout:5/82: dwrite f7 [0,4194304] 0 2022-02-02T18:21:51.601 INFO:tasks.workunit.client.1.smithi159.stdout:9/97: dwrite d4/f11 [4194304,4194304] 0 2022-02-02T18:21:51.601 INFO:tasks.workunit.client.1.smithi159.stdout:0/160: rename d1/l30 to d1/d11/d1d/d34/l36 0 2022-02-02T18:21:51.601 INFO:tasks.workunit.client.1.smithi159.stdout:0/161: readlink d1/d11/d1d/l1f 0 2022-02-02T18:21:51.601 INFO:tasks.workunit.client.1.smithi159.stdout:0/162: creat d1/d11/f37 x:0 0 0 2022-02-02T18:21:51.602 INFO:tasks.workunit.client.1.smithi159.stdout:0/163: readlink d1/dd/l27 0 2022-02-02T18:21:51.602 INFO:tasks.workunit.client.1.smithi159.stdout:9/98: symlink d4/l1d 0 2022-02-02T18:21:51.602 INFO:tasks.workunit.client.1.smithi159.stdout:9/99: chown d4/d1b 23582625 1 2022-02-02T18:21:51.606 INFO:tasks.workunit.client.1.smithi159.stdout:3/176: dwrite dd/d20/d2a/f32 [0,4194304] 0 2022-02-02T18:21:51.607 INFO:tasks.workunit.client.1.smithi159.stdout:3/177: dread dd/f1f [0,4194304] 0 2022-02-02T18:21:51.612 INFO:tasks.workunit.client.1.smithi159.stdout:0/164: mkdir d1/d11/d38 0 2022-02-02T18:21:51.616 INFO:tasks.workunit.client.1.smithi159.stdout:3/178: link f7 dd/d19/d38/f3d 0 2022-02-02T18:21:51.619 INFO:tasks.workunit.client.1.smithi159.stdout:3/179: rename dd/d20/c2f to dd/d20/c3e 0 2022-02-02T18:21:51.624 INFO:tasks.workunit.client.1.smithi159.stdout:3/180: mkdir dd/d19/d38/d3f 0 2022-02-02T18:21:51.624 INFO:tasks.workunit.client.1.smithi159.stdout:3/181: truncate dd/d19/f23 978401 0 2022-02-02T18:21:51.625 INFO:tasks.workunit.client.1.smithi159.stdout:3/182: dread f9 [0,4194304] 0 2022-02-02T18:21:51.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/183: mknod dd/d20/d2a/d31/c40 0 2022-02-02T18:21:51.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/184: truncate dd/d19/f2b 1232064 0 2022-02-02T18:21:51.628 INFO:tasks.workunit.client.1.smithi159.stdout:3/185: link dd/l1d dd/d19/d38/l41 0 2022-02-02T18:21:51.630 INFO:tasks.workunit.client.1.smithi159.stdout:5/83: dwrite d9/f1c [0,4194304] 0 2022-02-02T18:21:51.631 INFO:tasks.workunit.client.1.smithi159.stdout:0/165: dwrite d1/d11/f35 [0,4194304] 0 2022-02-02T18:21:51.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/186: rename dd/d20/d2a/f32 to dd/d20/d2a/d31/f42 0 2022-02-02T18:21:51.632 INFO:tasks.workunit.client.1.smithi159.stdout:9/100: dwrite d4/f18 [0,4194304] 0 2022-02-02T18:21:51.632 INFO:tasks.workunit.client.1.smithi159.stdout:9/101: chown d4/c12 13219569 1 2022-02-02T18:21:51.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/187: write dd/d19/d38/f3d [2902170,104590] 0 2022-02-02T18:21:51.653 INFO:tasks.workunit.client.1.smithi159.stdout:3/188: rename dd/d20/c36 to dd/d20/d2a/d3a/c43 0 2022-02-02T18:21:51.655 INFO:tasks.workunit.client.1.smithi159.stdout:3/189: creat dd/d19/d35/f44 x:0 0 0 2022-02-02T18:21:51.655 INFO:tasks.workunit.client.1.smithi159.stdout:3/190: fdatasync fc 0 2022-02-02T18:21:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:3/191: creat dd/d20/d2a/d3a/f45 x:0 0 0 2022-02-02T18:21:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:3/192: fsync dd/d20/f30 0 2022-02-02T18:21:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:3/193: creat dd/d19/f46 x:0 0 0 2022-02-02T18:21:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:3/194: readlink dd/l14 0 2022-02-02T18:21:51.658 INFO:tasks.workunit.client.1.smithi159.stdout:3/195: chown dd/l13 0 1 2022-02-02T18:21:51.658 INFO:tasks.workunit.client.1.smithi159.stdout:3/196: rmdir dd/d19/d38 39 2022-02-02T18:21:51.659 INFO:tasks.workunit.client.1.smithi159.stdout:3/197: rename dd/d19/f1a to dd/d19/d38/f47 0 2022-02-02T18:21:51.659 INFO:tasks.workunit.client.1.smithi159.stdout:3/198: truncate fc 1542603 0 2022-02-02T18:21:51.660 INFO:tasks.workunit.client.1.smithi159.stdout:3/199: truncate dd/d19/f1b 337532 0 2022-02-02T18:21:51.661 INFO:tasks.workunit.client.1.smithi159.stdout:3/200: creat dd/d19/d38/f48 x:0 0 0 2022-02-02T18:21:51.663 INFO:tasks.workunit.client.1.smithi159.stdout:3/201: rename dd/c17 to dd/d20/d2a/c49 0 2022-02-02T18:21:51.665 INFO:tasks.workunit.client.1.smithi159.stdout:3/202: truncate dd/d19/f33 2302236 0 2022-02-02T18:21:51.666 INFO:tasks.workunit.client.1.smithi159.stdout:9/102: dwrite d4/ff [0,4194304] 0 2022-02-02T18:21:51.667 INFO:tasks.workunit.client.1.smithi159.stdout:0/166: dwrite d1/d19/f25 [0,4194304] 0 2022-02-02T18:21:51.668 INFO:tasks.workunit.client.1.smithi159.stdout:5/84: dwrite d9/de/f16 [0,4194304] 0 2022-02-02T18:21:51.668 INFO:tasks.workunit.client.1.smithi159.stdout:5/85: write d9/fc [64852,90377] 0 2022-02-02T18:21:51.674 INFO:tasks.workunit.client.1.smithi159.stdout:9/103: rmdir d4/d1b 0 2022-02-02T18:21:51.675 INFO:tasks.workunit.client.1.smithi159.stdout:9/104: readlink d4/l1d 0 2022-02-02T18:21:51.676 INFO:tasks.workunit.client.1.smithi159.stdout:0/167: link d1/d19/f29 d1/d19/f39 0 2022-02-02T18:21:51.684 INFO:tasks.workunit.client.1.smithi159.stdout:5/86: rename d9/c10 to d9/c1d 0 2022-02-02T18:21:51.684 INFO:tasks.workunit.client.1.smithi159.stdout:5/87: creat d9/de/d12/f1e x:0 0 0 2022-02-02T18:21:51.684 INFO:tasks.workunit.client.1.smithi159.stdout:9/105: link d4/f17 d4/d19/f1e 0 2022-02-02T18:21:51.691 INFO:tasks.workunit.client.1.smithi159.stdout:1/67: sync 2022-02-02T18:21:51.691 INFO:tasks.workunit.client.1.smithi159.stdout:1/68: stat df/d14 0 2022-02-02T18:21:51.704 INFO:tasks.workunit.client.1.smithi159.stdout:1/69: dread f7 [0,4194304] 0 2022-02-02T18:21:51.706 INFO:tasks.workunit.client.1.smithi159.stdout:1/70: rename c6 to df/c1b 0 2022-02-02T18:21:51.707 INFO:tasks.workunit.client.1.smithi159.stdout:3/203: dwrite dd/d19/d38/f3d [0,4194304] 0 2022-02-02T18:21:51.707 INFO:tasks.workunit.client.1.smithi159.stdout:1/71: write df/d14/f17 [532032,1287] 0 2022-02-02T18:21:51.707 INFO:tasks.workunit.client.1.smithi159.stdout:1/72: write df/f18 [415721,93694] 0 2022-02-02T18:21:51.709 INFO:tasks.workunit.client.1.smithi159.stdout:1/73: rename df/l10 to df/l1c 0 2022-02-02T18:21:51.713 INFO:tasks.workunit.client.1.smithi159.stdout:1/74: fsync df/f18 0 2022-02-02T18:21:51.713 INFO:tasks.workunit.client.1.smithi159.stdout:5/88: dwrite d9/de/d12/f1a [0,4194304] 0 2022-02-02T18:21:51.722 INFO:tasks.workunit.client.1.smithi159.stdout:5/89: dread d9/de/f16 [0,4194304] 0 2022-02-02T18:21:51.722 INFO:tasks.workunit.client.1.smithi159.stdout:5/90: rmdir d9/de 39 2022-02-02T18:21:51.734 INFO:tasks.workunit.client.1.smithi159.stdout:1/75: dwrite fe [0,4194304] 0 2022-02-02T18:21:51.734 INFO:tasks.workunit.client.1.smithi159.stdout:3/204: dwrite dd/d19/f2b [0,4194304] 0 2022-02-02T18:21:51.735 INFO:tasks.workunit.client.1.smithi159.stdout:3/205: write dd/f1f [985583,33906] 0 2022-02-02T18:21:51.737 INFO:tasks.workunit.client.1.smithi159.stdout:1/76: dread f4 [0,4194304] 0 2022-02-02T18:21:51.737 INFO:tasks.workunit.client.1.smithi159.stdout:1/77: write df/d14/f15 [309324,31789] 0 2022-02-02T18:21:51.737 INFO:tasks.workunit.client.1.smithi159.stdout:1/78: truncate f4 1150767 0 2022-02-02T18:21:51.739 INFO:tasks.workunit.client.1.smithi159.stdout:3/206: creat dd/d20/d2a/f4a x:0 0 0 2022-02-02T18:21:51.739 INFO:tasks.workunit.client.1.smithi159.stdout:1/79: symlink df/d14/l1d 0 2022-02-02T18:21:51.740 INFO:tasks.workunit.client.1.smithi159.stdout:3/207: rename dd/d20/d2a/c49 to dd/d20/d2a/d3a/c4b 0 2022-02-02T18:21:51.742 INFO:tasks.workunit.client.1.smithi159.stdout:5/91: dread d9/fb [0,4194304] 0 2022-02-02T18:21:51.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/92: stat f8 0 2022-02-02T18:21:51.743 INFO:tasks.workunit.client.1.smithi159.stdout:1/80: rename f1 to df/f1e 0 2022-02-02T18:21:51.745 INFO:tasks.workunit.client.1.smithi159.stdout:1/81: fdatasync df/d14/f17 0 2022-02-02T18:21:51.746 INFO:tasks.workunit.client.1.smithi159.stdout:3/208: unlink dd/d20/l2e 0 2022-02-02T18:21:51.747 INFO:tasks.workunit.client.1.smithi159.stdout:5/93: truncate f7 2916142 0 2022-02-02T18:21:51.747 INFO:tasks.workunit.client.1.smithi159.stdout:5/94: chown d9/c1d 55 1 2022-02-02T18:21:51.748 INFO:tasks.workunit.client.1.smithi159.stdout:1/82: truncate df/f18 297117 0 2022-02-02T18:21:51.749 INFO:tasks.workunit.client.1.smithi159.stdout:5/95: write d9/de/d12/f1b [1306169,55637] 0 2022-02-02T18:21:51.751 INFO:tasks.workunit.client.1.smithi159.stdout:1/83: truncate df/f1e 3626636 0 2022-02-02T18:21:51.751 INFO:tasks.workunit.client.1.smithi159.stdout:1/84: chown df/d14 16229 1 2022-02-02T18:21:51.753 INFO:tasks.workunit.client.1.smithi159.stdout:5/96: mknod d9/c1f 0 2022-02-02T18:21:51.757 INFO:tasks.workunit.client.1.smithi159.stdout:1/85: creat df/d14/d16/f1f x:0 0 0 2022-02-02T18:21:51.760 INFO:tasks.workunit.client.1.smithi159.stdout:1/86: symlink df/d14/d16/l20 0 2022-02-02T18:21:51.760 INFO:tasks.workunit.client.1.smithi159.stdout:1/87: chown df/c12 132750 1 2022-02-02T18:21:51.761 INFO:tasks.workunit.client.1.smithi159.stdout:1/88: mkdir df/d21 0 2022-02-02T18:21:51.765 INFO:tasks.workunit.client.1.smithi159.stdout:3/209: dwrite dd/f28 [0,4194304] 0 2022-02-02T18:21:51.765 INFO:tasks.workunit.client.1.smithi159.stdout:3/210: creat dd/d19/d35/f4c x:0 0 0 2022-02-02T18:21:51.778 INFO:tasks.workunit.client.1.smithi159.stdout:1/89: rmdir df/d14/d16 39 2022-02-02T18:21:51.781 INFO:tasks.workunit.client.1.smithi159.stdout:1/90: dread df/f1e [0,4194304] 0 2022-02-02T18:21:51.783 INFO:tasks.workunit.client.1.smithi159.stdout:1/91: creat df/d14/d16/f22 x:0 0 0 2022-02-02T18:21:51.783 INFO:tasks.workunit.client.1.smithi159.stdout:5/97: dwrite d9/de/d12/f1a [0,4194304] 0 2022-02-02T18:21:51.787 INFO:tasks.workunit.client.1.smithi159.stdout:5/98: link d9/de/f16 d9/de/d12/f20 0 2022-02-02T18:21:51.789 INFO:tasks.workunit.client.1.smithi159.stdout:5/99: mkdir d9/de/d21 0 2022-02-02T18:21:51.790 INFO:tasks.workunit.client.1.smithi159.stdout:5/100: rename d9/fb to d9/de/f22 0 2022-02-02T18:21:51.791 INFO:tasks.workunit.client.1.smithi159.stdout:5/101: truncate d9/f1c 1673148 0 2022-02-02T18:21:51.800 INFO:tasks.workunit.client.1.smithi159.stdout:1/92: dwrite fe [0,4194304] 0 2022-02-02T18:21:51.802 INFO:tasks.workunit.client.1.smithi159.stdout:5/102: dread d9/f15 [0,4194304] 0 2022-02-02T18:21:51.802 INFO:tasks.workunit.client.1.smithi159.stdout:5/103: read d9/fc [148625,38292] 0 2022-02-02T18:21:51.804 INFO:tasks.workunit.client.1.smithi159.stdout:1/93: mkdir df/d21/d23 0 2022-02-02T18:21:51.805 INFO:tasks.workunit.client.1.smithi159.stdout:1/94: mknod df/d14/d16/c24 0 2022-02-02T18:21:51.806 INFO:tasks.workunit.client.1.smithi159.stdout:1/95: symlink df/d21/d23/l25 0 2022-02-02T18:21:51.807 INFO:tasks.workunit.client.1.smithi159.stdout:1/96: fsync fe 0 2022-02-02T18:21:51.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/97: rename df/d14/f15 to df/f26 0 2022-02-02T18:21:51.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/98: dread - df/d14/d16/f1f zero size 2022-02-02T18:21:51.811 INFO:tasks.workunit.client.1.smithi159.stdout:1/99: read df/f26 [231599,112434] 0 2022-02-02T18:21:51.811 INFO:tasks.workunit.client.1.smithi159.stdout:1/100: read - df/d14/d16/f22 zero size 2022-02-02T18:21:51.816 INFO:tasks.workunit.client.1.smithi159.stdout:1/101: fsync df/f26 0 2022-02-02T18:21:51.816 INFO:tasks.workunit.client.1.smithi159.stdout:1/102: chown df/f13 198095 1 2022-02-02T18:21:51.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/103: getdents df/d14/d16 0 2022-02-02T18:21:51.829 INFO:tasks.workunit.client.1.smithi159.stdout:5/104: dwrite f8 [4194304,4194304] 0 2022-02-02T18:21:51.831 INFO:tasks.workunit.client.1.smithi159.stdout:5/105: unlink d9/c1d 0 2022-02-02T18:21:51.832 INFO:tasks.workunit.client.1.smithi159.stdout:5/106: mkdir d9/de/d12/d23 0 2022-02-02T18:21:51.833 INFO:tasks.workunit.client.1.smithi159.stdout:1/104: dread df/f13 [0,4194304] 0 2022-02-02T18:21:51.833 INFO:tasks.workunit.client.1.smithi159.stdout:5/107: write d9/de/d12/f1b [1719230,103176] 0 2022-02-02T18:21:51.834 INFO:tasks.workunit.client.1.smithi159.stdout:1/105: rename df/l1a to df/d14/d16/l27 0 2022-02-02T18:21:51.836 INFO:tasks.workunit.client.1.smithi159.stdout:1/106: symlink df/l28 0 2022-02-02T18:21:51.837 INFO:tasks.workunit.client.1.smithi159.stdout:1/107: fdatasync df/f26 0 2022-02-02T18:21:51.837 INFO:tasks.workunit.client.1.smithi159.stdout:1/108: rmdir df/d14/d16 39 2022-02-02T18:21:51.838 INFO:tasks.workunit.client.1.smithi159.stdout:1/109: dread - df/d14/d16/f22 zero size 2022-02-02T18:21:51.841 INFO:tasks.workunit.client.1.smithi159.stdout:5/108: rename d9/de to d9/d24 0 2022-02-02T18:21:51.848 INFO:tasks.workunit.client.1.smithi159.stdout:5/109: dread f8 [0,4194304] 0 2022-02-02T18:21:51.849 INFO:tasks.workunit.client.1.smithi159.stdout:5/110: truncate f7 1226295 0 2022-02-02T18:21:51.856 INFO:tasks.workunit.client.1.smithi159.stdout:1/110: dwrite df/d14/d16/f1f [0,4194304] 0 2022-02-02T18:21:51.856 INFO:tasks.workunit.client.1.smithi159.stdout:1/111: readlink df/l19 0 2022-02-02T18:21:51.876 INFO:tasks.workunit.client.1.smithi159.stdout:1/112: creat df/d21/d23/f29 x:0 0 0 2022-02-02T18:21:51.877 INFO:tasks.workunit.client.1.smithi159.stdout:1/113: chown df/f18 249624626 1 2022-02-02T18:21:51.887 INFO:tasks.workunit.client.1.smithi159.stdout:5/111: dwrite f1 [0,4194304] 0 2022-02-02T18:21:51.887 INFO:tasks.workunit.client.1.smithi159.stdout:1/114: dread fe [0,4194304] 0 2022-02-02T18:21:51.889 INFO:tasks.workunit.client.1.smithi159.stdout:5/112: mknod d9/d24/d12/c25 0 2022-02-02T18:21:51.889 INFO:tasks.workunit.client.1.smithi159.stdout:5/113: rename d9/d24/d12/c25 to d9/d24/d12/d23/c26 0 2022-02-02T18:21:51.890 INFO:tasks.workunit.client.1.smithi159.stdout:1/115: getdents df 0 2022-02-02T18:21:51.891 INFO:tasks.workunit.client.1.smithi159.stdout:5/114: mknod d9/d24/d12/c27 0 2022-02-02T18:21:51.892 INFO:tasks.workunit.client.1.smithi159.stdout:1/116: rename l0 to df/d14/l2a 0 2022-02-02T18:21:51.893 INFO:tasks.workunit.client.1.smithi159.stdout:1/117: mkdir df/d2b 0 2022-02-02T18:21:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:1/118: chown df/d14 138061378 1 2022-02-02T18:21:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:1/119: write df/f1e [4351956,22726] 0 2022-02-02T18:21:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:1/120: creat df/d21/d23/f2c x:0 0 0 2022-02-02T18:21:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:1/121: write df/f26 [366744,15265] 0 2022-02-02T18:21:51.897 INFO:tasks.workunit.client.1.smithi159.stdout:1/122: dread fe [0,4194304] 0 2022-02-02T18:21:51.899 INFO:tasks.workunit.client.1.smithi159.stdout:5/115: dread f8 [4194304,4194304] 0 2022-02-02T18:21:51.901 INFO:tasks.workunit.client.1.smithi159.stdout:5/116: read d9/d24/d12/f1a [65179,41217] 0 2022-02-02T18:21:51.901 INFO:tasks.workunit.client.1.smithi159.stdout:5/117: write d9/f1c [2037672,83022] 0 2022-02-02T18:21:51.902 INFO:tasks.workunit.client.1.smithi159.stdout:5/118: write d9/d24/d12/f1b [1354373,77426] 0 2022-02-02T18:21:51.902 INFO:tasks.workunit.client.1.smithi159.stdout:5/119: chown d9/fc 31730004 1 2022-02-02T18:21:51.903 INFO:tasks.workunit.client.1.smithi159.stdout:5/120: mkdir d9/d28 0 2022-02-02T18:21:51.903 INFO:tasks.workunit.client.1.smithi159.stdout:5/121: readlink l2 0 2022-02-02T18:21:51.904 INFO:tasks.workunit.client.1.smithi159.stdout:1/123: link df/d14/l2a df/d21/d23/l2d 0 2022-02-02T18:21:51.904 INFO:tasks.workunit.client.1.smithi159.stdout:1/124: readlink df/d14/d16/l20 0 2022-02-02T18:21:51.905 INFO:tasks.workunit.client.1.smithi159.stdout:5/122: creat d9/d24/d12/f29 x:0 0 0 2022-02-02T18:21:51.906 INFO:tasks.workunit.client.1.smithi159.stdout:5/123: read f7 [623058,101822] 0 2022-02-02T18:21:51.906 INFO:tasks.workunit.client.1.smithi159.stdout:1/125: rmdir df 39 2022-02-02T18:21:51.908 INFO:tasks.workunit.client.1.smithi159.stdout:1/126: creat df/d2b/f2e x:0 0 0 2022-02-02T18:21:51.912 INFO:tasks.workunit.client.1.smithi159.stdout:5/124: rmdir d9/d24/d12 39 2022-02-02T18:21:51.913 INFO:tasks.workunit.client.1.smithi159.stdout:5/125: getdents d9/d24/d12 0 2022-02-02T18:21:51.913 INFO:tasks.workunit.client.1.smithi159.stdout:5/126: getdents d9/d24/d12 0 2022-02-02T18:21:51.932 INFO:tasks.workunit.client.1.smithi159.stdout:5/127: dwrite d9/d24/f16 [0,4194304] 0 2022-02-02T18:21:51.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/127: dwrite df/d14/d16/f1f [0,4194304] 0 2022-02-02T18:21:51.934 INFO:tasks.workunit.client.1.smithi159.stdout:6/130: sync 2022-02-02T18:21:51.935 INFO:tasks.workunit.client.1.smithi159.stdout:2/201: sync 2022-02-02T18:21:51.935 INFO:tasks.workunit.client.1.smithi159.stdout:6/131: creat df/d1f/d2a/f2d x:0 0 0 2022-02-02T18:21:51.935 INFO:tasks.workunit.client.1.smithi159.stdout:6/132: readlink df/l1d 0 2022-02-02T18:21:51.938 INFO:tasks.workunit.client.1.smithi159.stdout:6/133: rename fc to df/f2e 0 2022-02-02T18:21:51.958 INFO:tasks.workunit.client.1.smithi159.stdout:5/128: dread f1 [0,4194304] 0 2022-02-02T18:21:51.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/129: creat d9/d28/f2a x:0 0 0 2022-02-02T18:21:51.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/130: chown d9/d24/f16 1065870029 1 2022-02-02T18:21:51.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/131: creat d9/d24/d12/f2b x:0 0 0 2022-02-02T18:21:51.962 INFO:tasks.workunit.client.1.smithi159.stdout:2/202: dwrite da/dc/f18 [0,4194304] 0 2022-02-02T18:21:51.963 INFO:tasks.workunit.client.1.smithi159.stdout:2/203: write da/d1c/d29/f2c [1644664,76414] 0 2022-02-02T18:21:51.963 INFO:tasks.workunit.client.1.smithi159.stdout:1/128: dwrite df/f1e [0,4194304] 0 2022-02-02T18:21:51.965 INFO:tasks.workunit.client.1.smithi159.stdout:2/204: mkdir da/d1c/d29/d3f 0 2022-02-02T18:21:51.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/129: mknod df/d14/c2f 0 2022-02-02T18:21:51.966 INFO:tasks.workunit.client.1.smithi159.stdout:5/132: write d9/fd [332378,18578] 0 2022-02-02T18:21:51.967 INFO:tasks.workunit.client.1.smithi159.stdout:5/133: dread - d9/d24/d12/f18 zero size 2022-02-02T18:21:51.968 INFO:tasks.workunit.client.1.smithi159.stdout:1/130: rename df/d21/d23/l25 to df/d14/d16/l30 0 2022-02-02T18:21:51.970 INFO:tasks.workunit.client.1.smithi159.stdout:1/131: rename df/f13 to df/d21/d23/f31 0 2022-02-02T18:21:51.971 INFO:tasks.workunit.client.1.smithi159.stdout:6/134: dwrite f3 [0,4194304] 0 2022-02-02T18:21:51.971 INFO:tasks.workunit.client.1.smithi159.stdout:6/135: write fd [664072,29292] 0 2022-02-02T18:21:51.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/134: read f1 [3220753,113452] 0 2022-02-02T18:21:51.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/135: dread - d9/d24/d12/f29 zero size 2022-02-02T18:21:51.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/136: chown d9/d28/f2a 1 1 2022-02-02T18:21:51.973 INFO:tasks.workunit.client.1.smithi159.stdout:1/132: creat df/f32 x:0 0 0 2022-02-02T18:21:51.973 INFO:tasks.workunit.client.1.smithi159.stdout:1/133: chown df/f26 1764 1 2022-02-02T18:21:51.973 INFO:tasks.workunit.client.1.smithi159.stdout:1/134: write df/f18 [1130098,126781] 0 2022-02-02T18:21:51.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/135: creat df/d14/f33 x:0 0 0 2022-02-02T18:21:51.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/136: dread - df/d14/f33 zero size 2022-02-02T18:21:51.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/137: readlink l3 0 2022-02-02T18:21:51.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/138: write df/d2b/f2e [474359,86329] 0 2022-02-02T18:21:51.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/139: truncate df/d14/f17 1128110 0 2022-02-02T18:21:51.975 INFO:tasks.workunit.client.1.smithi159.stdout:5/137: rename d9/d24/c13 to d9/d24/c2c 0 2022-02-02T18:21:51.975 INFO:tasks.workunit.client.1.smithi159.stdout:5/138: readlink d9/l11 0 2022-02-02T18:21:51.977 INFO:tasks.workunit.client.1.smithi159.stdout:1/140: write f7 [1069637,7245] 0 2022-02-02T18:21:51.994 INFO:tasks.workunit.client.1.smithi159.stdout:6/136: dwrite df/d1f/f27 [0,4194304] 0 2022-02-02T18:21:51.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/137: write f1 [711348,11112] 0 2022-02-02T18:21:51.996 INFO:tasks.workunit.client.1.smithi159.stdout:6/138: readlink df/l24 0 2022-02-02T18:21:51.996 INFO:tasks.workunit.client.1.smithi159.stdout:1/141: rename df/d21/d23/f31 to df/d14/f34 0 2022-02-02T18:21:51.997 INFO:tasks.workunit.client.1.smithi159.stdout:2/205: dwrite da/d1c/d29/f2a [0,4194304] 0 2022-02-02T18:21:51.998 INFO:tasks.workunit.client.1.smithi159.stdout:6/139: mkdir df/d1f/d2a/d2f 0 2022-02-02T18:21:51.998 INFO:tasks.workunit.client.1.smithi159.stdout:5/139: dwrite d9/d24/f22 [4194304,4194304] 0 2022-02-02T18:21:51.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/142: mkdir df/d14/d16/d35 0 2022-02-02T18:21:52.003 INFO:tasks.workunit.client.1.smithi159.stdout:1/143: dread df/d14/f34 [0,4194304] 0 2022-02-02T18:21:52.003 INFO:tasks.workunit.client.1.smithi159.stdout:2/206: getdents da/dc 0 2022-02-02T18:21:52.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/140: rename fe to df/f30 0 2022-02-02T18:21:52.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/141: write df/f1e [1020723,111221] 0 2022-02-02T18:21:52.008 INFO:tasks.workunit.client.1.smithi159.stdout:2/207: rename da/dc to da/d40 0 2022-02-02T18:21:52.008 INFO:tasks.workunit.client.1.smithi159.stdout:2/208: unlink da/d1c/f3c 0 2022-02-02T18:21:52.011 INFO:tasks.workunit.client.1.smithi159.stdout:1/144: dread df/f26 [0,4194304] 0 2022-02-02T18:21:52.014 INFO:tasks.workunit.client.1.smithi159.stdout:2/209: symlink da/d40/l41 0 2022-02-02T18:21:52.015 INFO:tasks.workunit.client.1.smithi159.stdout:1/145: symlink df/d14/l36 0 2022-02-02T18:21:52.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/210: mkdir da/d1c/d42 0 2022-02-02T18:21:52.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/211: creat da/d30/f43 x:0 0 0 2022-02-02T18:21:52.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/212: fdatasync da/d1c/d29/f33 0 2022-02-02T18:21:52.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/213: creat da/f44 x:0 0 0 2022-02-02T18:21:52.017 INFO:tasks.workunit.client.1.smithi159.stdout:1/146: link df/d14/d16/l27 df/d14/d16/d35/l37 0 2022-02-02T18:21:52.019 INFO:tasks.workunit.client.1.smithi159.stdout:2/214: mkdir da/d1c/d42/d45 0 2022-02-02T18:21:52.021 INFO:tasks.workunit.client.1.smithi159.stdout:1/147: creat df/d14/d16/f38 x:0 0 0 2022-02-02T18:21:52.022 INFO:tasks.workunit.client.1.smithi159.stdout:2/215: mknod da/d40/c46 0 2022-02-02T18:21:52.025 INFO:tasks.workunit.client.1.smithi159.stdout:2/216: mkdir da/d1c/d47 0 2022-02-02T18:21:52.027 INFO:tasks.workunit.client.1.smithi159.stdout:5/140: dwrite f4 [0,4194304] 0 2022-02-02T18:21:52.028 INFO:tasks.workunit.client.1.smithi159.stdout:6/142: dwrite df/f1a [0,4194304] 0 2022-02-02T18:21:52.032 INFO:tasks.workunit.client.1.smithi159.stdout:2/217: write da/d40/f18 [1760100,48937] 0 2022-02-02T18:21:52.033 INFO:tasks.workunit.client.1.smithi159.stdout:2/218: fsync da/f16 0 2022-02-02T18:21:52.033 INFO:tasks.workunit.client.1.smithi159.stdout:2/219: write da/f44 [913277,84860] 0 2022-02-02T18:21:52.034 INFO:tasks.workunit.client.1.smithi159.stdout:2/220: mkdir da/d48 0 2022-02-02T18:21:52.040 INFO:tasks.workunit.client.1.smithi159.stdout:5/141: dread d9/d24/d12/f1b [0,4194304] 0 2022-02-02T18:21:52.048 INFO:tasks.workunit.client.1.smithi159.stdout:1/148: dwrite df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:21:52.048 INFO:tasks.workunit.client.1.smithi159.stdout:1/149: write df/d14/f17 [1707578,2552] 0 2022-02-02T18:21:52.048 INFO:tasks.workunit.client.1.smithi159.stdout:1/150: write df/d21/d23/f2c [179413,123118] 0 2022-02-02T18:21:52.051 INFO:tasks.workunit.client.1.smithi159.stdout:6/143: dwrite f7 [0,4194304] 0 2022-02-02T18:21:52.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/151: link df/d21/d23/f29 df/d14/f39 0 2022-02-02T18:21:52.051 INFO:tasks.workunit.client.1.smithi159.stdout:6/144: dread - df/f1b zero size 2022-02-02T18:21:52.053 INFO:tasks.workunit.client.1.smithi159.stdout:1/152: rename df/f32 to df/f3a 0 2022-02-02T18:21:52.054 INFO:tasks.workunit.client.1.smithi159.stdout:6/145: creat df/d1f/d2a/d2f/f31 x:0 0 0 2022-02-02T18:21:52.054 INFO:tasks.workunit.client.1.smithi159.stdout:6/146: stat fa 0 2022-02-02T18:21:52.055 INFO:tasks.workunit.client.1.smithi159.stdout:1/153: mknod df/d21/d23/c3b 0 2022-02-02T18:21:52.056 INFO:tasks.workunit.client.1.smithi159.stdout:1/154: symlink df/l3c 0 2022-02-02T18:21:52.057 INFO:tasks.workunit.client.1.smithi159.stdout:1/155: write df/d2b/f2e [267411,86538] 0 2022-02-02T18:21:52.057 INFO:tasks.workunit.client.1.smithi159.stdout:1/156: readlink df/d21/d23/l2d 0 2022-02-02T18:21:52.059 INFO:tasks.workunit.client.1.smithi159.stdout:6/147: write f6 [3698926,12140] 0 2022-02-02T18:21:52.059 INFO:tasks.workunit.client.1.smithi159.stdout:1/157: rename df/l28 to df/d14/d16/d35/l3d 0 2022-02-02T18:21:52.060 INFO:tasks.workunit.client.1.smithi159.stdout:5/142: dwrite d9/d28/f2a [0,4194304] 0 2022-02-02T18:21:52.060 INFO:tasks.workunit.client.1.smithi159.stdout:5/143: chown d9/d24/c2c 2 1 2022-02-02T18:21:52.062 INFO:tasks.workunit.client.1.smithi159.stdout:6/148: symlink df/d1f/d20/l32 0 2022-02-02T18:21:52.062 INFO:tasks.workunit.client.1.smithi159.stdout:6/149: dread - df/f15 zero size 2022-02-02T18:21:52.093 INFO:tasks.workunit.client.1.smithi159.stdout:1/158: dwrite df/f1e [0,4194304] 0 2022-02-02T18:21:52.096 INFO:tasks.workunit.client.1.smithi159.stdout:2/221: dwrite da/d1c/d29/f2c [0,4194304] 0 2022-02-02T18:21:52.097 INFO:tasks.workunit.client.1.smithi159.stdout:6/150: dwrite f7 [0,4194304] 0 2022-02-02T18:21:52.097 INFO:tasks.workunit.client.1.smithi159.stdout:5/144: dwrite d9/d24/f22 [4194304,4194304] 0 2022-02-02T18:21:52.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/222: symlink da/d40/l49 0 2022-02-02T18:21:52.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/223: read - da/f3b zero size 2022-02-02T18:21:52.115 INFO:tasks.workunit.client.1.smithi159.stdout:2/224: creat da/d1c/d47/f4a x:0 0 0 2022-02-02T18:21:52.115 INFO:tasks.workunit.client.1.smithi159.stdout:2/225: fsync da/d30/f34 0 2022-02-02T18:21:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/226: dread - da/d30/f43 zero size 2022-02-02T18:21:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:5/145: dread d9/d24/f16 [0,4194304] 0 2022-02-02T18:21:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:5/146: truncate d9/d28/f2a 5123747 0 2022-02-02T18:21:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:5/147: fdatasync f8 0 2022-02-02T18:21:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:5/148: rmdir d9/d28 39 2022-02-02T18:21:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:2/227: write da/d1c/d29/f2c [2640990,127862] 0 2022-02-02T18:21:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:2/228: write da/d40/f37 [304387,98165] 0 2022-02-02T18:21:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:2/229: creat da/d1c/d29/f4b x:0 0 0 2022-02-02T18:21:52.119 INFO:tasks.workunit.client.1.smithi159.stdout:2/230: fdatasync da/d1c/f1f 0 2022-02-02T18:21:52.119 INFO:tasks.workunit.client.1.smithi159.stdout:5/149: link f8 d9/d24/f2d 0 2022-02-02T18:21:52.119 INFO:tasks.workunit.client.1.smithi159.stdout:2/231: dread da/d1c/d29/f33 [0,4194304] 0 2022-02-02T18:21:52.120 INFO:tasks.workunit.client.1.smithi159.stdout:5/150: read f4 [6538511,70370] 0 2022-02-02T18:21:52.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/232: link da/c22 da/d30/c4c 0 2022-02-02T18:21:52.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/233: chown da/l27 840847990 1 2022-02-02T18:21:52.122 INFO:tasks.workunit.client.1.smithi159.stdout:1/159: dwrite df/d2b/f2e [0,4194304] 0 2022-02-02T18:21:52.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/151: unlink f8 0 2022-02-02T18:21:52.124 INFO:tasks.workunit.client.1.smithi159.stdout:5/152: write f7 [593621,52756] 0 2022-02-02T18:21:52.133 INFO:tasks.workunit.client.1.smithi159.stdout:2/234: rename da/d1c/c20 to da/d1c/d42/d45/c4d 0 2022-02-02T18:21:52.134 INFO:tasks.workunit.client.1.smithi159.stdout:2/235: write da/f16 [1238049,3469] 0 2022-02-02T18:21:52.146 INFO:tasks.workunit.client.1.smithi159.stdout:1/160: dwrite df/d14/f17 [0,4194304] 0 2022-02-02T18:21:52.149 INFO:tasks.workunit.client.1.smithi159.stdout:1/161: mknod df/d14/c3e 0 2022-02-02T18:21:52.149 INFO:tasks.workunit.client.1.smithi159.stdout:1/162: truncate df/f18 2088255 0 2022-02-02T18:21:52.149 INFO:tasks.workunit.client.1.smithi159.stdout:1/163: write df/d14/d16/f22 [523015,119555] 0 2022-02-02T18:21:52.150 INFO:tasks.workunit.client.1.smithi159.stdout:1/164: mkdir df/d14/d16/d35/d3f 0 2022-02-02T18:21:52.150 INFO:tasks.workunit.client.1.smithi159.stdout:5/153: dwrite d9/d24/d12/f18 [0,4194304] 0 2022-02-02T18:21:52.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/154: chown d9/d24/d12/f2b 110 1 2022-02-02T18:21:52.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/165: symlink df/d21/d23/l40 0 2022-02-02T18:21:52.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/236: dwrite da/f44 [0,4194304] 0 2022-02-02T18:21:52.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/237: creat da/d30/f4e x:0 0 0 2022-02-02T18:21:52.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/238: truncate da/d1c/d29/f2a 4420112 0 2022-02-02T18:21:52.154 INFO:tasks.workunit.client.1.smithi159.stdout:1/166: symlink df/d2b/l41 0 2022-02-02T18:21:52.156 INFO:tasks.workunit.client.1.smithi159.stdout:2/239: mknod da/d1c/d29/d3f/c4f 0 2022-02-02T18:21:52.158 INFO:tasks.workunit.client.1.smithi159.stdout:1/167: creat df/d14/d16/d35/f42 x:0 0 0 2022-02-02T18:21:52.163 INFO:tasks.workunit.client.1.smithi159.stdout:2/240: link da/d1c/d42/d45/c4d da/d1c/d29/c50 0 2022-02-02T18:21:52.165 INFO:tasks.workunit.client.1.smithi159.stdout:1/168: symlink df/d21/d23/l43 0 2022-02-02T18:21:52.166 INFO:tasks.workunit.client.1.smithi159.stdout:1/169: write df/f1e [2429356,59833] 0 2022-02-02T18:21:52.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/241: rename da/d40/f18 to da/d1c/d29/d3f/f51 0 2022-02-02T18:21:52.171 INFO:tasks.workunit.client.1.smithi159.stdout:5/155: dwrite f1 [4194304,4194304] 0 2022-02-02T18:21:52.173 INFO:tasks.workunit.client.1.smithi159.stdout:1/170: creat df/d14/d16/d35/d3f/f44 x:0 0 0 2022-02-02T18:21:52.174 INFO:tasks.workunit.client.1.smithi159.stdout:1/171: chown df/d2b 1726 1 2022-02-02T18:21:52.176 INFO:tasks.workunit.client.1.smithi159.stdout:5/156: rename d9/d28 to d9/d2e 0 2022-02-02T18:21:52.177 INFO:tasks.workunit.client.1.smithi159.stdout:1/172: dread f7 [0,4194304] 0 2022-02-02T18:21:52.178 INFO:tasks.workunit.client.1.smithi159.stdout:5/157: chown d9/d24/d12/f2b 82974 1 2022-02-02T18:21:52.178 INFO:tasks.workunit.client.1.smithi159.stdout:5/158: readlink d9/l11 0 2022-02-02T18:21:52.180 INFO:tasks.workunit.client.1.smithi159.stdout:5/159: symlink d9/d2e/l2f 0 2022-02-02T18:21:52.180 INFO:tasks.workunit.client.1.smithi159.stdout:5/160: stat d9/l11 0 2022-02-02T18:21:52.180 INFO:tasks.workunit.client.1.smithi159.stdout:5/161: write d9/d24/d12/f2b [819934,119030] 0 2022-02-02T18:21:52.180 INFO:tasks.workunit.client.1.smithi159.stdout:5/162: fdatasync d9/d24/d12/f1a 0 2022-02-02T18:21:52.182 INFO:tasks.workunit.client.1.smithi159.stdout:5/163: write d9/d24/f16 [2963773,53675] 0 2022-02-02T18:21:52.182 INFO:tasks.workunit.client.1.smithi159.stdout:2/242: rmdir da/d1c 39 2022-02-02T18:21:52.187 INFO:tasks.workunit.client.1.smithi159.stdout:5/164: creat d9/d24/d12/d23/f30 x:0 0 0 2022-02-02T18:21:52.188 INFO:tasks.workunit.client.1.smithi159.stdout:2/243: mknod da/d1c/d47/c52 0 2022-02-02T18:21:52.188 INFO:tasks.workunit.client.1.smithi159.stdout:2/244: creat da/f53 x:0 0 0 2022-02-02T18:21:52.192 INFO:tasks.workunit.client.1.smithi159.stdout:5/165: symlink d9/d24/l31 0 2022-02-02T18:21:52.195 INFO:tasks.workunit.client.1.smithi159.stdout:1/173: dwrite df/d14/f33 [0,4194304] 0 2022-02-02T18:21:52.196 INFO:tasks.workunit.client.1.smithi159.stdout:5/166: getdents d9/d24/d12 0 2022-02-02T18:21:52.196 INFO:tasks.workunit.client.1.smithi159.stdout:5/167: readlink d9/d24/l31 0 2022-02-02T18:21:52.197 INFO:tasks.workunit.client.1.smithi159.stdout:5/168: write d9/fd [45,124929] 0 2022-02-02T18:21:52.198 INFO:tasks.workunit.client.1.smithi159.stdout:5/169: fsync d9/d24/f22 0 2022-02-02T18:21:52.200 INFO:tasks.workunit.client.1.smithi159.stdout:5/170: write f4 [6761229,21271] 0 2022-02-02T18:21:52.201 INFO:tasks.workunit.client.1.smithi159.stdout:2/245: getdents da/d1c/d47 0 2022-02-02T18:21:52.203 INFO:tasks.workunit.client.1.smithi159.stdout:2/246: mkdir da/d1c/d47/d54 0 2022-02-02T18:21:52.203 INFO:tasks.workunit.client.1.smithi159.stdout:5/171: symlink d9/d24/d12/d23/l32 0 2022-02-02T18:21:52.204 INFO:tasks.workunit.client.1.smithi159.stdout:1/174: dread df/d14/f17 [0,4194304] 0 2022-02-02T18:21:52.204 INFO:tasks.workunit.client.1.smithi159.stdout:2/247: truncate da/d40/f1d 1919862 0 2022-02-02T18:21:52.207 INFO:tasks.workunit.client.1.smithi159.stdout:1/175: rename df/f3a to df/d14/d16/f45 0 2022-02-02T18:21:52.208 INFO:tasks.workunit.client.1.smithi159.stdout:2/248: mkdir da/d1c/d29/d3f/d55 0 2022-02-02T18:21:52.208 INFO:tasks.workunit.client.1.smithi159.stdout:2/249: truncate da/d1c/d47/f4a 154758 0 2022-02-02T18:21:52.208 INFO:tasks.workunit.client.1.smithi159.stdout:2/250: chown da/f16 6 1 2022-02-02T18:21:52.213 INFO:tasks.workunit.client.1.smithi159.stdout:2/251: creat da/d30/d3e/f56 x:0 0 0 2022-02-02T18:21:52.214 INFO:tasks.workunit.client.1.smithi159.stdout:2/252: read - da/d30/f4e zero size 2022-02-02T18:21:52.214 INFO:tasks.workunit.client.1.smithi159.stdout:2/253: stat da/f16 0 2022-02-02T18:21:52.219 INFO:tasks.workunit.client.1.smithi159.stdout:5/172: truncate f4 4429880 0 2022-02-02T18:21:52.221 INFO:tasks.workunit.client.1.smithi159.stdout:5/173: creat d9/d24/f33 x:0 0 0 2022-02-02T18:21:52.223 INFO:tasks.workunit.client.1.smithi159.stdout:5/174: mknod d9/c34 0 2022-02-02T18:21:52.229 INFO:tasks.workunit.client.1.smithi159.stdout:1/176: dwrite fe [0,4194304] 0 2022-02-02T18:21:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:5/175: getdents d9/d24/d12/d23 0 2022-02-02T18:21:52.234 INFO:tasks.workunit.client.1.smithi159.stdout:1/177: truncate df/d14/d16/f1f 4153458 0 2022-02-02T18:21:52.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/176: mknod d9/d2e/c35 0 2022-02-02T18:21:52.237 INFO:tasks.workunit.client.1.smithi159.stdout:1/178: write df/d21/d23/f29 [3623613,8493] 0 2022-02-02T18:21:52.237 INFO:tasks.workunit.client.1.smithi159.stdout:1/179: fdatasync df/f1e 0 2022-02-02T18:21:52.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/177: mkdir d9/d2e/d36 0 2022-02-02T18:21:52.240 INFO:tasks.workunit.client.1.smithi159.stdout:1/180: unlink df/d21/d23/f2c 0 2022-02-02T18:21:52.242 INFO:tasks.workunit.client.1.smithi159.stdout:1/181: rename df/d14/f34 to df/d14/d16/d35/d3f/f46 0 2022-02-02T18:21:52.265 INFO:tasks.workunit.client.1.smithi159.stdout:1/182: dwrite df/d14/d16/f38 [0,4194304] 0 2022-02-02T18:21:52.266 INFO:tasks.workunit.client.1.smithi159.stdout:5/178: dwrite f1 [0,4194304] 0 2022-02-02T18:21:52.267 INFO:tasks.workunit.client.1.smithi159.stdout:1/183: mknod df/d21/c47 0 2022-02-02T18:21:52.271 INFO:tasks.workunit.client.1.smithi159.stdout:5/179: rename d9/d24/d12 to d9/d24/d37 0 2022-02-02T18:21:52.272 INFO:tasks.workunit.client.1.smithi159.stdout:1/184: getdents df/d14 0 2022-02-02T18:21:52.274 INFO:tasks.workunit.client.1.smithi159.stdout:1/185: rename df/c12 to df/d21/d23/c48 0 2022-02-02T18:21:52.275 INFO:tasks.workunit.client.1.smithi159.stdout:5/180: dread d9/d24/d37/f1b [0,4194304] 0 2022-02-02T18:21:52.275 INFO:tasks.workunit.client.1.smithi159.stdout:1/186: mkdir df/d21/d23/d49 0 2022-02-02T18:21:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:51 smithi159 conmon[35668]: cluster 2022-02-02T18:21:50.831328+0000 mgr.smithi096.shfutl (mgr.14162) 284 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 575 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 126 op/s 2022-02-02T18:21:52.277 INFO:tasks.workunit.client.1.smithi159.stdout:5/181: mkdir d9/d24/d38 0 2022-02-02T18:21:52.277 INFO:tasks.workunit.client.1.smithi159.stdout:5/182: unlink d9/f15 0 2022-02-02T18:21:52.277 INFO:tasks.workunit.client.1.smithi159.stdout:5/183: write d9/d24/f33 [344798,75077] 0 2022-02-02T18:21:52.279 INFO:tasks.workunit.client.1.smithi159.stdout:5/184: dread d9/fc [0,4194304] 0 2022-02-02T18:21:52.280 INFO:tasks.workunit.client.1.smithi159.stdout:5/185: read d9/d24/d37/f2b [717619,84279] 0 2022-02-02T18:21:52.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/186: rename d9/fd to d9/f39 0 2022-02-02T18:21:52.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/187: stat d9/d24/d37/f2b 0 2022-02-02T18:21:52.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/188: dread - d9/d24/d37/f29 zero size 2022-02-02T18:21:52.283 INFO:tasks.workunit.client.1.smithi159.stdout:5/189: write d9/d24/f16 [3020880,110174] 0 2022-02-02T18:21:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:1/187: dwrite df/d2b/f2e [0,4194304] 0 2022-02-02T18:21:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:1/188: chown df/d2b/f2e 0 1 2022-02-02T18:21:52.299 INFO:tasks.workunit.client.1.smithi159.stdout:1/189: rename df/d14/d16/d35/d3f to df/d14/d16/d4a 0 2022-02-02T18:21:52.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/190: mkdir df/d14/d16/d4b 0 2022-02-02T18:21:52.304 INFO:tasks.workunit.client.1.smithi159.stdout:1/191: symlink df/d14/d16/d4b/l4c 0 2022-02-02T18:21:52.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/138: sync 2022-02-02T18:21:52.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/139: read d0/ff [1826522,30042] 0 2022-02-02T18:21:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:51 smithi096 conmon[32067]: cluster 2022-02-02T18:21:50.831328+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:21:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:51 smithi096 conmon[32067]: ) 284 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 575 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 126 op/s 2022-02-02T18:21:52.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/140: unlink d0/f1e 0 2022-02-02T18:21:52.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/141: stat d0/c2 0 2022-02-02T18:21:52.310 INFO:tasks.workunit.client.1.smithi159.stdout:4/142: dread - d0/d8/d15/f2a zero size 2022-02-02T18:21:52.310 INFO:tasks.workunit.client.1.smithi159.stdout:5/190: dwrite f4 [0,4194304] 0 2022-02-02T18:21:52.310 INFO:tasks.workunit.client.1.smithi159.stdout:5/191: stat d9/d24/d37/f29 0 2022-02-02T18:21:52.310 INFO:tasks.workunit.client.1.smithi159.stdout:5/192: write d9/fc [780605,115991] 0 2022-02-02T18:21:52.312 INFO:tasks.workunit.client.1.smithi159.stdout:5/193: creat d9/d24/d37/f3a x:0 0 0 2022-02-02T18:21:52.314 INFO:tasks.workunit.client.1.smithi159.stdout:5/194: write d9/d24/d37/f20 [985865,34130] 0 2022-02-02T18:21:52.317 INFO:tasks.workunit.client.1.smithi159.stdout:5/195: dread d9/d24/d37/f2b [0,4194304] 0 2022-02-02T18:21:52.317 INFO:tasks.workunit.client.1.smithi159.stdout:5/196: stat d9/d24/d37/f3a 0 2022-02-02T18:21:52.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/143: dwrite d0/d8/f20 [0,4194304] 0 2022-02-02T18:21:52.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/144: stat d0/d8/f10 0 2022-02-02T18:21:52.329 INFO:tasks.workunit.client.1.smithi159.stdout:4/145: creat d0/d8/d15/f2e x:0 0 0 2022-02-02T18:21:52.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/197: dwrite d9/d24/d37/f19 [0,4194304] 0 2022-02-02T18:21:52.335 INFO:tasks.workunit.client.1.smithi159.stdout:5/198: chown d9/d2e/c35 63526295 1 2022-02-02T18:21:52.335 INFO:tasks.workunit.client.1.smithi159.stdout:5/199: chown d9/c34 561906 1 2022-02-02T18:21:52.336 INFO:tasks.workunit.client.1.smithi159.stdout:5/200: dread d9/d24/d37/f2b [0,4194304] 0 2022-02-02T18:21:52.336 INFO:tasks.workunit.client.1.smithi159.stdout:5/201: readlink d9/d24/d37/d23/l32 0 2022-02-02T18:21:52.338 INFO:tasks.workunit.client.1.smithi159.stdout:5/202: rmdir d9/d24/d37 39 2022-02-02T18:21:52.338 INFO:tasks.workunit.client.1.smithi159.stdout:5/203: chown d9/d24/f22 31 1 2022-02-02T18:21:52.338 INFO:tasks.workunit.client.1.smithi159.stdout:5/204: truncate d9/d24/d37/f3a 106702 0 2022-02-02T18:21:52.358 INFO:tasks.workunit.client.1.smithi159.stdout:5/205: dwrite d9/d24/d37/f3a [0,4194304] 0 2022-02-02T18:21:52.359 INFO:tasks.workunit.client.1.smithi159.stdout:5/206: chown d9/d24/d37/d23/f30 14207295 1 2022-02-02T18:21:52.378 INFO:tasks.workunit.client.1.smithi159.stdout:5/207: dwrite d9/d24/d37/f1a [4194304,4194304] 0 2022-02-02T18:21:52.379 INFO:tasks.workunit.client.1.smithi159.stdout:8/104: sync 2022-02-02T18:21:52.379 INFO:tasks.workunit.client.1.smithi159.stdout:7/135: sync 2022-02-02T18:21:52.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/168: sync 2022-02-02T18:21:52.381 INFO:tasks.workunit.client.1.smithi159.stdout:7/136: link d3/d5/d8/f11 d3/d19/f32 0 2022-02-02T18:21:52.382 INFO:tasks.workunit.client.1.smithi159.stdout:0/169: symlink d1/dd/l3a 0 2022-02-02T18:21:52.382 INFO:tasks.workunit.client.1.smithi159.stdout:0/170: unlink d1/dd/c23 0 2022-02-02T18:21:52.382 INFO:tasks.workunit.client.1.smithi159.stdout:0/171: write d1/f2c [2373000,68495] 0 2022-02-02T18:21:52.383 INFO:tasks.workunit.client.1.smithi159.stdout:5/208: rename d9/c34 to d9/d24/c3b 0 2022-02-02T18:21:52.384 INFO:tasks.workunit.client.1.smithi159.stdout:5/209: write d9/d24/d37/f19 [3471025,105985] 0 2022-02-02T18:21:52.385 INFO:tasks.workunit.client.1.smithi159.stdout:5/210: write d9/d24/d37/f2b [1260721,26045] 0 2022-02-02T18:21:52.385 INFO:tasks.workunit.client.1.smithi159.stdout:5/211: stat d9/f1c 0 2022-02-02T18:21:52.386 INFO:tasks.workunit.client.1.smithi159.stdout:7/137: creat d3/d27/d29/f33 x:0 0 0 2022-02-02T18:21:52.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/212: mkdir d9/d24/d38/d3c 0 2022-02-02T18:21:52.387 INFO:tasks.workunit.client.1.smithi159.stdout:8/105: rename d1/dc/f27 to d1/f28 0 2022-02-02T18:21:52.388 INFO:tasks.workunit.client.1.smithi159.stdout:7/138: write d3/d2a/f22 [3091391,55892] 0 2022-02-02T18:21:52.389 INFO:tasks.workunit.client.1.smithi159.stdout:4/146: dwrite d0/f3 [4194304,4194304] 0 2022-02-02T18:21:52.389 INFO:tasks.workunit.client.1.smithi159.stdout:4/147: stat d0/d8/d15/l1f 0 2022-02-02T18:21:52.390 INFO:tasks.workunit.client.1.smithi159.stdout:4/148: dread - d0/d8/d14/f23 zero size 2022-02-02T18:21:52.390 INFO:tasks.workunit.client.1.smithi159.stdout:4/149: dread - d0/d8/d15/f2a zero size 2022-02-02T18:21:52.399 INFO:tasks.workunit.client.1.smithi159.stdout:0/172: rename d1/l2d to d1/dd/l3b 0 2022-02-02T18:21:52.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/213: creat d9/d24/d21/f3d x:0 0 0 2022-02-02T18:21:52.401 INFO:tasks.workunit.client.1.smithi159.stdout:4/150: symlink d0/l2f 0 2022-02-02T18:21:52.403 INFO:tasks.workunit.client.1.smithi159.stdout:8/106: rename d1/dd/d1a/f20 to d1/dd/f29 0 2022-02-02T18:21:52.404 INFO:tasks.workunit.client.1.smithi159.stdout:0/173: creat d1/f3c x:0 0 0 2022-02-02T18:21:52.405 INFO:tasks.workunit.client.1.smithi159.stdout:4/151: mkdir d0/d8/d30 0 2022-02-02T18:21:52.408 INFO:tasks.workunit.client.1.smithi159.stdout:8/107: fsync d1/f28 0 2022-02-02T18:21:52.411 INFO:tasks.workunit.client.1.smithi159.stdout:7/139: rename d3/d5/d8 to d3/d19/d2f/d34 0 2022-02-02T18:21:52.411 INFO:tasks.workunit.client.1.smithi159.stdout:7/140: read d3/f14 [2793510,20023] 0 2022-02-02T18:21:52.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/174: mkdir d1/d19/d3d 0 2022-02-02T18:21:52.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/175: truncate d1/dd/f33 443867 0 2022-02-02T18:21:52.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/152: link d0/d8/c26 d0/d8/d30/c31 0 2022-02-02T18:21:52.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/153: truncate d0/f29 989984 0 2022-02-02T18:21:52.415 INFO:tasks.workunit.client.1.smithi159.stdout:5/214: dread d9/f39 [0,4194304] 0 2022-02-02T18:21:52.417 INFO:tasks.workunit.client.1.smithi159.stdout:8/108: mknod d1/c2a 0 2022-02-02T18:21:52.418 INFO:tasks.workunit.client.1.smithi159.stdout:4/154: symlink d0/d8/d15/l32 0 2022-02-02T18:21:52.420 INFO:tasks.workunit.client.1.smithi159.stdout:8/109: symlink d1/d26/l2b 0 2022-02-02T18:21:52.421 INFO:tasks.workunit.client.1.smithi159.stdout:4/155: mkdir d0/d8/d14/d33 0 2022-02-02T18:21:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/215: dread d9/f39 [0,4194304] 0 2022-02-02T18:21:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:5/216: truncate d9/d24/d37/f29 154488 0 2022-02-02T18:21:52.428 INFO:tasks.workunit.client.1.smithi159.stdout:4/156: creat d0/d8/d14/f34 x:0 0 0 2022-02-02T18:21:52.428 INFO:tasks.workunit.client.1.smithi159.stdout:4/157: write d0/f25 [279765,130816] 0 2022-02-02T18:21:52.429 INFO:tasks.workunit.client.1.smithi159.stdout:8/110: getdents d1/dd/d1a 0 2022-02-02T18:21:52.430 INFO:tasks.workunit.client.1.smithi159.stdout:7/141: dwrite d3/f14 [0,4194304] 0 2022-02-02T18:21:52.430 INFO:tasks.workunit.client.1.smithi159.stdout:8/111: mkdir d1/dd/d2c 0 2022-02-02T18:21:52.435 INFO:tasks.workunit.client.1.smithi159.stdout:8/112: readlink d1/l18 0 2022-02-02T18:21:52.435 INFO:tasks.workunit.client.1.smithi159.stdout:7/142: getdents d3/d19 0 2022-02-02T18:21:52.439 INFO:tasks.workunit.client.1.smithi159.stdout:8/113: rename d1/f5 to d1/d26/f2d 0 2022-02-02T18:21:52.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/143: rename d3/d2a to d3/d2a/d35 22 2022-02-02T18:21:52.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/144: fsync d3/f14 0 2022-02-02T18:21:52.440 INFO:tasks.workunit.client.1.smithi159.stdout:8/114: write d1/fa [1131363,126856] 0 2022-02-02T18:21:52.440 INFO:tasks.workunit.client.1.smithi159.stdout:4/158: dread d0/d8/f10 [0,4194304] 0 2022-02-02T18:21:52.440 INFO:tasks.workunit.client.1.smithi159.stdout:4/159: truncate d0/d8/d14/f23 787852 0 2022-02-02T18:21:52.443 INFO:tasks.workunit.client.1.smithi159.stdout:7/145: write d3/d19/f32 [2612861,31073] 0 2022-02-02T18:21:52.444 INFO:tasks.workunit.client.1.smithi159.stdout:7/146: symlink d3/d27/d29/l36 0 2022-02-02T18:21:52.445 INFO:tasks.workunit.client.1.smithi159.stdout:7/147: stat d3/d27/d29/l36 0 2022-02-02T18:21:52.445 INFO:tasks.workunit.client.1.smithi159.stdout:7/148: mknod d3/d5/c37 0 2022-02-02T18:21:52.446 INFO:tasks.workunit.client.1.smithi159.stdout:8/115: dread d1/d26/f2d [0,4194304] 0 2022-02-02T18:21:52.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/149: creat d3/d19/d2f/f38 x:0 0 0 2022-02-02T18:21:52.447 INFO:tasks.workunit.client.1.smithi159.stdout:8/116: creat d1/dc/f2e x:0 0 0 2022-02-02T18:21:52.448 INFO:tasks.workunit.client.1.smithi159.stdout:7/150: stat d3/d6/cc 0 2022-02-02T18:21:52.448 INFO:tasks.workunit.client.1.smithi159.stdout:7/151: mknod d3/d19/d2f/d34/c39 0 2022-02-02T18:21:52.449 INFO:tasks.workunit.client.1.smithi159.stdout:7/152: rename d3/d19/f21 to d3/d19/f3a 0 2022-02-02T18:21:52.451 INFO:tasks.workunit.client.1.smithi159.stdout:7/153: link d3/d19/d2f/d34/f24 d3/d27/f3b 0 2022-02-02T18:21:52.451 INFO:tasks.workunit.client.1.smithi159.stdout:7/154: write d3/d27/d29/f33 [922773,12505] 0 2022-02-02T18:21:52.453 INFO:tasks.workunit.client.1.smithi159.stdout:8/117: dread d1/f28 [0,4194304] 0 2022-02-02T18:21:52.454 INFO:tasks.workunit.client.1.smithi159.stdout:5/217: dwrite f1 [0,4194304] 0 2022-02-02T18:21:52.455 INFO:tasks.workunit.client.1.smithi159.stdout:5/218: fdatasync d9/d24/d37/f1a 0 2022-02-02T18:21:52.455 INFO:tasks.workunit.client.1.smithi159.stdout:5/219: mknod d9/d24/d37/c3e 0 2022-02-02T18:21:52.456 INFO:tasks.workunit.client.1.smithi159.stdout:5/220: creat d9/d24/d37/d23/f3f x:0 0 0 2022-02-02T18:21:52.456 INFO:tasks.workunit.client.1.smithi159.stdout:5/221: stat d9/d24/d37/d23/c26 0 2022-02-02T18:21:52.460 INFO:tasks.workunit.client.1.smithi159.stdout:4/160: dwrite d0/d8/d15/f2e [0,4194304] 0 2022-02-02T18:21:52.460 INFO:tasks.workunit.client.1.smithi159.stdout:4/161: stat d0/d8/d15/f27 0 2022-02-02T18:21:52.461 INFO:tasks.workunit.client.1.smithi159.stdout:7/155: dread d3/d6/f17 [0,4194304] 0 2022-02-02T18:21:52.463 INFO:tasks.workunit.client.1.smithi159.stdout:4/162: rename d0/f6 to d0/d8/d14/d33/f35 0 2022-02-02T18:21:52.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/156: write d3/d19/f3a [81467,21930] 0 2022-02-02T18:21:52.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/157: dread - d3/d27/f3b zero size 2022-02-02T18:21:52.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/158: chown d3/d5/l31 454832 1 2022-02-02T18:21:52.465 INFO:tasks.workunit.client.1.smithi159.stdout:8/118: dread d1/f4 [0,4194304] 0 2022-02-02T18:21:52.466 INFO:tasks.workunit.client.1.smithi159.stdout:7/159: symlink d3/d6/l3c 0 2022-02-02T18:21:52.467 INFO:tasks.workunit.client.1.smithi159.stdout:4/163: fsync d0/f25 0 2022-02-02T18:21:52.467 INFO:tasks.workunit.client.1.smithi159.stdout:5/222: dread d9/d24/d37/f18 [0,4194304] 0 2022-02-02T18:21:52.468 INFO:tasks.workunit.client.1.smithi159.stdout:8/119: unlink d1/dc/f2e 0 2022-02-02T18:21:52.468 INFO:tasks.workunit.client.1.smithi159.stdout:8/120: creat d1/dd/f2f x:0 0 0 2022-02-02T18:21:52.469 INFO:tasks.workunit.client.1.smithi159.stdout:7/160: symlink d3/d5/l3d 0 2022-02-02T18:21:52.470 INFO:tasks.workunit.client.1.smithi159.stdout:7/161: fdatasync d3/f2d 0 2022-02-02T18:21:52.473 INFO:tasks.workunit.client.1.smithi159.stdout:4/164: mkdir d0/d8/d14/d36 0 2022-02-02T18:21:52.475 INFO:tasks.workunit.client.1.smithi159.stdout:5/223: symlink d9/d24/d21/l40 0 2022-02-02T18:21:52.477 INFO:tasks.workunit.client.1.smithi159.stdout:8/121: link d1/dd/d1a/l1d d1/d26/l30 0 2022-02-02T18:21:52.478 INFO:tasks.workunit.client.1.smithi159.stdout:5/224: creat d9/d24/f41 x:0 0 0 2022-02-02T18:21:52.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/165: dread d0/f5 [0,4194304] 0 2022-02-02T18:21:52.480 INFO:tasks.workunit.client.1.smithi159.stdout:7/162: dread d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:21:52.480 INFO:tasks.workunit.client.1.smithi159.stdout:8/122: mkdir d1/dd/d31 0 2022-02-02T18:21:52.480 INFO:tasks.workunit.client.1.smithi159.stdout:8/123: chown d1/dd/c10 911648 1 2022-02-02T18:21:52.480 INFO:tasks.workunit.client.1.smithi159.stdout:7/163: read - d3/d19/d2f/f38 zero size 2022-02-02T18:21:52.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/124: creat d1/dd/d1a/f32 x:0 0 0 2022-02-02T18:21:52.484 INFO:tasks.workunit.client.1.smithi159.stdout:8/125: symlink d1/dc/l33 0 2022-02-02T18:21:52.492 INFO:tasks.workunit.client.1.smithi159.stdout:4/166: dread d0/d8/f1c [0,4194304] 0 2022-02-02T18:21:52.493 INFO:tasks.workunit.client.1.smithi159.stdout:4/167: chown d0/d8/la 540737097 1 2022-02-02T18:21:52.497 INFO:tasks.workunit.client.1.smithi159.stdout:5/225: dread d9/d24/f22 [0,4194304] 0 2022-02-02T18:21:52.497 INFO:tasks.workunit.client.1.smithi159.stdout:5/226: write d9/d24/d37/f29 [341646,108819] 0 2022-02-02T18:21:52.497 INFO:tasks.workunit.client.1.smithi159.stdout:5/227: creat d9/f42 x:0 0 0 2022-02-02T18:21:52.500 INFO:tasks.workunit.client.1.smithi159.stdout:7/164: dwrite d3/d2a/f22 [0,4194304] 0 2022-02-02T18:21:52.508 INFO:tasks.workunit.client.1.smithi159.stdout:7/165: dread d3/d19/f32 [0,4194304] 0 2022-02-02T18:21:52.509 INFO:tasks.workunit.client.1.smithi159.stdout:7/166: symlink d3/d19/d2f/d34/l3e 0 2022-02-02T18:21:52.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/168: dwrite d0/d8/d14/f23 [0,4194304] 0 2022-02-02T18:21:52.525 INFO:tasks.workunit.client.1.smithi159.stdout:8/126: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:21:52.525 INFO:tasks.workunit.client.1.smithi159.stdout:8/127: write d1/dd/f29 [248994,99094] 0 2022-02-02T18:21:52.526 INFO:tasks.workunit.client.1.smithi159.stdout:5/228: dwrite d9/d24/d37/d23/f3f [0,4194304] 0 2022-02-02T18:21:52.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/128: mknod d1/dc/c34 0 2022-02-02T18:21:52.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/129: chown d1/l21 7760690 1 2022-02-02T18:21:52.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/130: write d1/dd/f16 [4239478,97949] 0 2022-02-02T18:21:52.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/131: chown d1/dd/c25 4295 1 2022-02-02T18:21:52.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/132: stat d1/fa 0 2022-02-02T18:21:52.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/133: dread - d1/dd/d1a/f32 zero size 2022-02-02T18:21:52.530 INFO:tasks.workunit.client.1.smithi159.stdout:8/134: dread - d1/dd/d1a/f32 zero size 2022-02-02T18:21:52.530 INFO:tasks.workunit.client.1.smithi159.stdout:5/229: link d9/d24/d21/f3d d9/d2e/d36/f43 0 2022-02-02T18:21:52.531 INFO:tasks.workunit.client.1.smithi159.stdout:8/135: mkdir d1/dc/d35 0 2022-02-02T18:21:52.532 INFO:tasks.workunit.client.1.smithi159.stdout:5/230: mkdir d9/d24/d21/d44 0 2022-02-02T18:21:52.536 INFO:tasks.workunit.client.1.smithi159.stdout:5/231: truncate f7 742423 0 2022-02-02T18:21:52.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/232: dread d9/d24/f2d [0,4194304] 0 2022-02-02T18:21:52.549 INFO:tasks.workunit.client.1.smithi159.stdout:8/136: truncate d1/d26/f2d 1644248 0 2022-02-02T18:21:52.550 INFO:tasks.workunit.client.1.smithi159.stdout:8/137: chown d1/dc/l19 295494522 1 2022-02-02T18:21:52.550 INFO:tasks.workunit.client.1.smithi159.stdout:8/138: rename d1/d26 to d1/d26/d36 22 2022-02-02T18:21:52.563 INFO:tasks.workunit.client.1.smithi159.stdout:5/233: dwrite d9/d24/d37/f20 [0,4194304] 0 2022-02-02T18:21:52.581 INFO:tasks.workunit.client.1.smithi159.stdout:5/234: dwrite f7 [0,4194304] 0 2022-02-02T18:21:52.582 INFO:tasks.workunit.client.1.smithi159.stdout:5/235: symlink d9/d2e/l45 0 2022-02-02T18:21:52.582 INFO:tasks.workunit.client.1.smithi159.stdout:5/236: chown d9/d2e/d36 7678137 1 2022-02-02T18:21:52.584 INFO:tasks.workunit.client.1.smithi159.stdout:5/237: rename d9/d2e/d36 to d9/d24/d46 0 2022-02-02T18:21:52.585 INFO:tasks.workunit.client.1.smithi159.stdout:5/238: creat d9/f47 x:0 0 0 2022-02-02T18:21:52.590 INFO:tasks.workunit.client.1.smithi159.stdout:5/239: truncate d9/d24/d37/f1a 1148936 0 2022-02-02T18:21:52.591 INFO:tasks.workunit.client.1.smithi159.stdout:5/240: link d9/d24/d37/f3a d9/d24/d46/f48 0 2022-02-02T18:21:52.592 INFO:tasks.workunit.client.1.smithi159.stdout:5/241: link d9/d24/d37/f18 d9/d24/d37/f49 0 2022-02-02T18:21:52.594 INFO:tasks.workunit.client.1.smithi159.stdout:5/242: write d9/d2e/f2a [427601,76212] 0 2022-02-02T18:21:52.595 INFO:tasks.workunit.client.1.smithi159.stdout:5/243: stat d9/d24/f33 0 2022-02-02T18:21:52.596 INFO:tasks.workunit.client.1.smithi159.stdout:5/244: write d9/d24/f2d [3462090,64958] 0 2022-02-02T18:21:52.596 INFO:tasks.workunit.client.1.smithi159.stdout:5/245: rmdir d9/d2e 39 2022-02-02T18:21:52.596 INFO:tasks.workunit.client.1.smithi159.stdout:5/246: stat d9/d24/d37/f29 0 2022-02-02T18:21:52.596 INFO:tasks.workunit.client.1.smithi159.stdout:5/247: dread - d9/d24/d37/d23/f30 zero size 2022-02-02T18:21:52.597 INFO:tasks.workunit.client.1.smithi159.stdout:5/248: rmdir d9/d24/d37 39 2022-02-02T18:21:52.602 INFO:tasks.workunit.client.1.smithi159.stdout:5/249: rename d9/d24/d46 to d9/d24/d4a 0 2022-02-02T18:21:52.604 INFO:tasks.workunit.client.1.smithi159.stdout:5/250: mkdir d9/d24/d37/d23/d4b 0 2022-02-02T18:21:52.605 INFO:tasks.workunit.client.1.smithi159.stdout:5/251: mknod d9/d24/d38/d3c/c4c 0 2022-02-02T18:21:52.622 INFO:tasks.workunit.client.1.smithi159.stdout:5/252: dwrite d9/d24/d37/f3a [0,4194304] 0 2022-02-02T18:21:52.624 INFO:tasks.workunit.client.1.smithi159.stdout:5/253: write d9/d24/d37/f3a [2081754,103295] 0 2022-02-02T18:21:52.624 INFO:tasks.workunit.client.1.smithi159.stdout:5/254: fsync d9/d24/d37/f19 0 2022-02-02T18:21:52.625 INFO:tasks.workunit.client.1.smithi159.stdout:5/255: creat d9/d24/d37/d23/f4d x:0 0 0 2022-02-02T18:21:52.626 INFO:tasks.workunit.client.1.smithi159.stdout:5/256: write f7 [4186240,35991] 0 2022-02-02T18:21:52.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/257: symlink d9/d24/d37/d23/d4b/l4e 0 2022-02-02T18:21:52.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/258: creat d9/d24/d37/d23/f4f x:0 0 0 2022-02-02T18:21:52.649 INFO:tasks.workunit.client.1.smithi159.stdout:5/259: dwrite d9/f1c [0,4194304] 0 2022-02-02T18:21:52.653 INFO:tasks.workunit.client.1.smithi159.stdout:5/260: getdents d9/d24/d37/d23/d4b 0 2022-02-02T18:21:52.661 INFO:tasks.workunit.client.1.smithi159.stdout:5/261: dread d9/d24/d37/f1b [0,4194304] 0 2022-02-02T18:21:52.664 INFO:tasks.workunit.client.1.smithi159.stdout:5/262: unlink d9/d24/d37/d23/c26 0 2022-02-02T18:21:52.664 INFO:tasks.workunit.client.1.smithi159.stdout:5/263: write d9/d24/d37/d23/f30 [789113,61799] 0 2022-02-02T18:21:52.669 INFO:tasks.workunit.client.1.smithi159.stdout:9/106: sync 2022-02-02T18:21:52.670 INFO:tasks.workunit.client.1.smithi159.stdout:9/107: dread - d4/d19/f1e zero size 2022-02-02T18:21:52.681 INFO:tasks.workunit.client.1.smithi159.stdout:9/108: dread d4/f10 [0,4194304] 0 2022-02-02T18:21:52.684 INFO:tasks.workunit.client.1.smithi159.stdout:9/109: mkdir d4/d19/d1c/d1f 0 2022-02-02T18:21:52.685 INFO:tasks.workunit.client.1.smithi159.stdout:9/110: creat d4/d19/d1c/d1f/f20 x:0 0 0 2022-02-02T18:21:52.686 INFO:tasks.workunit.client.1.smithi159.stdout:9/111: write d4/d19/f1a [287994,96368] 0 2022-02-02T18:21:52.686 INFO:tasks.workunit.client.1.smithi159.stdout:9/112: chown d4/d19/d1c 79 1 2022-02-02T18:21:52.686 INFO:tasks.workunit.client.1.smithi159.stdout:9/113: mkdir d4/d19/d1c/d21 0 2022-02-02T18:21:52.694 INFO:tasks.workunit.client.1.smithi159.stdout:9/114: fdatasync d4/f17 0 2022-02-02T18:21:52.696 INFO:tasks.workunit.client.1.smithi159.stdout:9/115: mkdir d4/d19/d1c/d21/d22 0 2022-02-02T18:21:52.697 INFO:tasks.workunit.client.1.smithi159.stdout:9/116: rename d4/d19/d1c to d4/d19/d1c/d21/d23 22 2022-02-02T18:21:52.698 INFO:tasks.workunit.client.1.smithi159.stdout:9/117: dread d4/f17 [0,4194304] 0 2022-02-02T18:21:52.699 INFO:tasks.workunit.client.1.smithi159.stdout:9/118: truncate d4/f14 385370 0 2022-02-02T18:21:52.700 INFO:tasks.workunit.client.1.smithi159.stdout:9/119: chown d4/f16 394572982 1 2022-02-02T18:21:52.700 INFO:tasks.workunit.client.1.smithi159.stdout:9/120: creat d4/d19/d1c/d1f/f24 x:0 0 0 2022-02-02T18:21:52.701 INFO:tasks.workunit.client.1.smithi159.stdout:9/121: symlink d4/l25 0 2022-02-02T18:21:52.702 INFO:tasks.workunit.client.1.smithi159.stdout:9/122: link d4/d19/d1c/d1f/f20 d4/d19/d1c/d1f/f26 0 2022-02-02T18:21:52.816 INFO:tasks.workunit.client.1.smithi159.stdout:9/123: creat d4/d19/d1c/d21/f27 x:0 0 0 2022-02-02T18:21:52.825 INFO:tasks.workunit.client.1.smithi159.stdout:9/124: write d4/f14 [832841,85829] 0 2022-02-02T18:21:52.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/125: dwrite d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:21:52.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/126: stat d4/d19/d1c/d1f/f24 0 2022-02-02T18:21:52.856 INFO:tasks.workunit.client.1.smithi159.stdout:9/127: dread d4/f14 [0,4194304] 0 2022-02-02T18:21:52.880 INFO:tasks.workunit.client.1.smithi159.stdout:9/128: dwrite d4/f18 [0,4194304] 0 2022-02-02T18:21:52.881 INFO:tasks.workunit.client.1.smithi159.stdout:9/129: fdatasync d4/ff 0 2022-02-02T18:21:52.881 INFO:tasks.workunit.client.1.smithi159.stdout:9/130: write d4/f16 [751979,22083] 0 2022-02-02T18:21:52.884 INFO:tasks.workunit.client.1.smithi159.stdout:9/131: creat d4/d19/f28 x:0 0 0 2022-02-02T18:21:52.885 INFO:tasks.workunit.client.1.smithi159.stdout:9/132: truncate d4/d19/d1c/d1f/f26 3528053 0 2022-02-02T18:21:52.888 INFO:tasks.workunit.client.1.smithi159.stdout:9/133: dread d4/d19/f1e [0,4194304] 0 2022-02-02T18:21:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/134: dwrite d4/fd [4194304,4194304] 0 2022-02-02T18:21:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/135: write d4/d19/f1e [570515,14708] 0 2022-02-02T18:21:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/136: chown d4/d19 6684987 1 2022-02-02T18:21:52.912 INFO:tasks.workunit.client.1.smithi159.stdout:9/137: creat d4/f29 x:0 0 0 2022-02-02T18:21:52.913 INFO:tasks.workunit.client.1.smithi159.stdout:9/138: mkdir d4/d2a 0 2022-02-02T18:21:52.914 INFO:tasks.workunit.client.1.smithi159.stdout:9/139: readlink d4/l1d 0 2022-02-02T18:21:52.914 INFO:tasks.workunit.client.1.smithi159.stdout:9/140: mknod d4/d19/d1c/c2b 0 2022-02-02T18:21:52.915 INFO:tasks.workunit.client.1.smithi159.stdout:9/141: dread - d4/d19/d1c/d1f/f24 zero size 2022-02-02T18:21:52.916 INFO:tasks.workunit.client.1.smithi159.stdout:9/142: mknod d4/d19/d1c/c2c 0 2022-02-02T18:21:52.916 INFO:tasks.workunit.client.1.smithi159.stdout:9/143: readlink d4/l25 0 2022-02-02T18:21:52.917 INFO:tasks.workunit.client.1.smithi159.stdout:9/144: mknod d4/d19/d1c/d21/d22/c2d 0 2022-02-02T18:21:52.919 INFO:tasks.workunit.client.1.smithi159.stdout:9/145: rmdir d4/d19/d1c/d1f 39 2022-02-02T18:21:52.919 INFO:tasks.workunit.client.1.smithi159.stdout:9/146: chown d4/f14 425 1 2022-02-02T18:21:52.934 INFO:tasks.workunit.client.1.smithi159.stdout:9/147: dwrite d4/f14 [0,4194304] 0 2022-02-02T18:21:52.935 INFO:tasks.workunit.client.1.smithi159.stdout:9/148: getdents d4/d19 0 2022-02-02T18:21:52.936 INFO:tasks.workunit.client.1.smithi159.stdout:9/149: link d4/d19/f1a d4/d2a/f2e 0 2022-02-02T18:21:52.937 INFO:tasks.workunit.client.1.smithi159.stdout:9/150: write d4/d19/f1a [204858,71198] 0 2022-02-02T18:21:52.938 INFO:tasks.workunit.client.1.smithi159.stdout:9/151: mknod d4/d19/d1c/d21/c2f 0 2022-02-02T18:21:52.939 INFO:tasks.workunit.client.1.smithi159.stdout:9/152: rmdir d4/d2a 39 2022-02-02T18:21:52.942 INFO:tasks.workunit.client.1.smithi159.stdout:3/211: sync 2022-02-02T18:21:52.943 INFO:tasks.workunit.client.1.smithi159.stdout:3/212: read f7 [2808579,27981] 0 2022-02-02T18:21:52.946 INFO:tasks.workunit.client.1.smithi159.stdout:3/213: creat dd/d19/d38/d3f/f4d x:0 0 0 2022-02-02T18:21:52.947 INFO:tasks.workunit.client.1.smithi159.stdout:3/214: truncate dd/d19/d35/f4c 252293 0 2022-02-02T18:21:52.947 INFO:tasks.workunit.client.1.smithi159.stdout:3/215: write dd/d19/f46 [108388,54087] 0 2022-02-02T18:21:52.954 INFO:tasks.workunit.client.1.smithi159.stdout:4/169: sync 2022-02-02T18:21:52.954 INFO:tasks.workunit.client.1.smithi159.stdout:6/151: sync 2022-02-02T18:21:52.954 INFO:tasks.workunit.client.1.smithi159.stdout:0/176: sync 2022-02-02T18:21:52.954 INFO:tasks.workunit.client.1.smithi159.stdout:1/192: sync 2022-02-02T18:21:52.955 INFO:tasks.workunit.client.1.smithi159.stdout:2/254: sync 2022-02-02T18:21:52.955 INFO:tasks.workunit.client.1.smithi159.stdout:1/193: rename df to df/d4d 22 2022-02-02T18:21:52.955 INFO:tasks.workunit.client.1.smithi159.stdout:8/139: sync 2022-02-02T18:21:52.956 INFO:tasks.workunit.client.1.smithi159.stdout:7/167: sync 2022-02-02T18:21:52.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/264: sync 2022-02-02T18:21:52.957 INFO:tasks.workunit.client.1.smithi159.stdout:1/194: dread df/f26 [0,4194304] 0 2022-02-02T18:21:52.957 INFO:tasks.workunit.client.1.smithi159.stdout:4/170: link d0/d8/d14/f34 d0/d8/d30/f37 0 2022-02-02T18:21:52.958 INFO:tasks.workunit.client.1.smithi159.stdout:4/171: truncate d0/d8/d14/f34 37343 0 2022-02-02T18:21:52.958 INFO:tasks.workunit.client.1.smithi159.stdout:4/172: fsync d0/f21 0 2022-02-02T18:21:52.958 INFO:tasks.workunit.client.1.smithi159.stdout:3/216: dread dd/d19/f2b [0,4194304] 0 2022-02-02T18:21:52.958 INFO:tasks.workunit.client.1.smithi159.stdout:5/265: write d9/d24/f2d [4667931,14720] 0 2022-02-02T18:21:52.962 INFO:tasks.workunit.client.1.smithi159.stdout:3/217: read dd/d19/f1e [820183,106845] 0 2022-02-02T18:21:52.962 INFO:tasks.workunit.client.1.smithi159.stdout:3/218: fsync dd/f28 0 2022-02-02T18:21:52.962 INFO:tasks.workunit.client.1.smithi159.stdout:6/152: mknod df/d1f/d2a/d2f/c33 0 2022-02-02T18:21:52.962 INFO:tasks.workunit.client.1.smithi159.stdout:6/153: write df/f17 [1075522,84255] 0 2022-02-02T18:21:52.965 INFO:tasks.workunit.client.1.smithi159.stdout:8/140: link d1/dc/l24 d1/dd/l37 0 2022-02-02T18:21:52.966 INFO:tasks.workunit.client.1.smithi159.stdout:4/173: mknod d0/d8/c38 0 2022-02-02T18:21:52.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/219: link dd/f11 dd/d19/f4e 0 2022-02-02T18:21:52.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/220: chown dd/d20/d2a/d3a 540 1 2022-02-02T18:21:52.969 INFO:tasks.workunit.client.1.smithi159.stdout:9/153: dwrite d4/f16 [0,4194304] 0 2022-02-02T18:21:52.971 INFO:tasks.workunit.client.1.smithi159.stdout:4/174: getdents d0/d8/d14 0 2022-02-02T18:21:52.976 INFO:tasks.workunit.client.1.smithi159.stdout:4/175: mknod d0/d8/d14/d33/c39 0 2022-02-02T18:21:52.979 INFO:tasks.workunit.client.1.smithi159.stdout:4/176: mkdir d0/d8/d24/d3a 0 2022-02-02T18:21:52.979 INFO:tasks.workunit.client.1.smithi159.stdout:4/177: write d0/f21 [207275,59592] 0 2022-02-02T18:21:52.979 INFO:tasks.workunit.client.1.smithi159.stdout:9/154: write d4/f10 [2854625,71746] 0 2022-02-02T18:21:52.985 INFO:tasks.workunit.client.1.smithi159.stdout:6/154: dread df/f30 [0,4194304] 0 2022-02-02T18:21:52.985 INFO:tasks.workunit.client.1.smithi159.stdout:6/155: unlink df/c19 0 2022-02-02T18:21:52.986 INFO:tasks.workunit.client.1.smithi159.stdout:6/156: fdatasync f3 0 2022-02-02T18:21:52.988 INFO:tasks.workunit.client.1.smithi159.stdout:6/157: creat df/d1f/f34 x:0 0 0 2022-02-02T18:21:53.005 INFO:tasks.workunit.client.1.smithi159.stdout:5/266: dwrite f4 [4194304,4194304] 0 2022-02-02T18:21:53.006 INFO:tasks.workunit.client.1.smithi159.stdout:2/255: dwrite da/d40/f1d [0,4194304] 0 2022-02-02T18:21:53.006 INFO:tasks.workunit.client.1.smithi159.stdout:8/141: dwrite d1/fa [0,4194304] 0 2022-02-02T18:21:53.008 INFO:tasks.workunit.client.1.smithi159.stdout:5/267: dread d9/d24/d37/f29 [0,4194304] 0 2022-02-02T18:21:53.009 INFO:tasks.workunit.client.1.smithi159.stdout:0/177: dwrite d1/f3 [0,4194304] 0 2022-02-02T18:21:53.010 INFO:tasks.workunit.client.1.smithi159.stdout:2/256: link da/d40/le da/d1c/d47/d54/l57 0 2022-02-02T18:21:53.010 INFO:tasks.workunit.client.1.smithi159.stdout:3/221: dwrite dd/d19/f4e [0,4194304] 0 2022-02-02T18:21:53.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/178: dwrite d0/f25 [4194304,4194304] 0 2022-02-02T18:21:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:8/142: mknod d1/d26/c38 0 2022-02-02T18:21:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:8/143: fdatasync d1/dd/f16 0 2022-02-02T18:21:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:5/268: read d9/d24/d37/f20 [1733560,83692] 0 2022-02-02T18:21:53.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/222: write dd/d19/d38/f47 [274858,24146] 0 2022-02-02T18:21:53.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/223: stat dd/f28 0 2022-02-02T18:21:53.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/224: truncate dd/d19/f2b 5102767 0 2022-02-02T18:21:53.015 INFO:tasks.workunit.client.1.smithi159.stdout:3/225: write dd/d19/f1b [483959,30991] 0 2022-02-02T18:21:53.015 INFO:tasks.workunit.client.1.smithi159.stdout:3/226: stat dd/d19/d35/f4c 0 2022-02-02T18:21:53.016 INFO:tasks.workunit.client.1.smithi159.stdout:3/227: read dd/d19/d38/f3d [1853988,58229] 0 2022-02-02T18:21:53.016 INFO:tasks.workunit.client.1.smithi159.stdout:3/228: creat dd/d19/d35/f4f x:0 0 0 2022-02-02T18:21:53.016 INFO:tasks.workunit.client.1.smithi159.stdout:3/229: chown dd/d20/c27 1 1 2022-02-02T18:21:53.016 INFO:tasks.workunit.client.1.smithi159.stdout:0/178: mknod d1/d11/d1d/d34/c3e 0 2022-02-02T18:21:53.018 INFO:tasks.workunit.client.1.smithi159.stdout:9/155: dread d4/f10 [0,4194304] 0 2022-02-02T18:21:53.027 INFO:tasks.workunit.client.1.smithi159.stdout:3/230: dread dd/f1c [0,4194304] 0 2022-02-02T18:21:53.029 INFO:tasks.workunit.client.1.smithi159.stdout:2/257: creat da/d1c/d42/d45/f58 x:0 0 0 2022-02-02T18:21:53.029 INFO:tasks.workunit.client.1.smithi159.stdout:2/258: chown da/f53 592783825 1 2022-02-02T18:21:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:2/259: truncate da/f16 2516639 0 2022-02-02T18:21:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:2/260: write da/d30/d3e/f56 [17634,15993] 0 2022-02-02T18:21:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:8/144: chown d1/l6 21584 1 2022-02-02T18:21:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:8/145: creat d1/dd/d1a/f39 x:0 0 0 2022-02-02T18:21:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:8/146: fsync d1/dd/f2f 0 2022-02-02T18:21:53.031 INFO:tasks.workunit.client.1.smithi159.stdout:5/269: symlink d9/d24/d37/d23/l50 0 2022-02-02T18:21:53.031 INFO:tasks.workunit.client.1.smithi159.stdout:5/270: chown d9/d24/d4a 6044936 1 2022-02-02T18:21:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:6/158: rename df/d1f to df/d35 0 2022-02-02T18:21:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:6/159: chown df/f16 26145 1 2022-02-02T18:21:53.036 INFO:tasks.workunit.client.1.smithi159.stdout:3/231: rename dd/d20/d2a/d31/f37 to dd/d19/d38/d3f/f50 0 2022-02-02T18:21:53.037 INFO:tasks.workunit.client.1.smithi159.stdout:3/232: stat dd/d20/d2a/f4a 0 2022-02-02T18:21:53.037 INFO:tasks.workunit.client.1.smithi159.stdout:3/233: chown dd 0 1 2022-02-02T18:21:53.037 INFO:tasks.workunit.client.1.smithi159.stdout:4/179: dwrite d0/d8/d15/f27 [0,4194304] 0 2022-02-02T18:21:53.038 INFO:tasks.workunit.client.1.smithi159.stdout:8/147: symlink d1/dc/d35/l3a 0 2022-02-02T18:21:53.042 INFO:tasks.workunit.client.1.smithi159.stdout:5/271: unlink d9/d24/c3b 0 2022-02-02T18:21:53.044 INFO:tasks.workunit.client.1.smithi159.stdout:3/234: mkdir dd/d20/d2a/d3a/d51 0 2022-02-02T18:21:53.046 INFO:tasks.workunit.client.1.smithi159.stdout:0/179: dwrite d1/f3 [4194304,4194304] 0 2022-02-02T18:21:53.046 INFO:tasks.workunit.client.1.smithi159.stdout:0/180: chown d1/f8 3 1 2022-02-02T18:21:53.047 INFO:tasks.workunit.client.1.smithi159.stdout:4/180: creat d0/d8/d14/d33/f3b x:0 0 0 2022-02-02T18:21:53.047 INFO:tasks.workunit.client.1.smithi159.stdout:4/181: creat d0/d8/f3c x:0 0 0 2022-02-02T18:21:53.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/148: mknod d1/dc/c3b 0 2022-02-02T18:21:53.049 INFO:tasks.workunit.client.1.smithi159.stdout:9/156: dwrite d4/f16 [0,4194304] 0 2022-02-02T18:21:53.049 INFO:tasks.workunit.client.1.smithi159.stdout:9/157: write d4/d19/f1e [1313566,86499] 0 2022-02-02T18:21:53.050 INFO:tasks.workunit.client.1.smithi159.stdout:9/158: chown d4 832076 1 2022-02-02T18:21:53.050 INFO:tasks.workunit.client.1.smithi159.stdout:9/159: readlink d4/l1d 0 2022-02-02T18:21:53.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/272: link d9/d2e/l45 d9/d24/d38/l51 0 2022-02-02T18:21:53.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/273: stat d9/l11 0 2022-02-02T18:21:53.053 INFO:tasks.workunit.client.1.smithi159.stdout:5/274: mkdir d9/d24/d4a/d52 0 2022-02-02T18:21:53.057 INFO:tasks.workunit.client.1.smithi159.stdout:0/181: rename d1/l1b to d1/dd/l3f 0 2022-02-02T18:21:53.058 INFO:tasks.workunit.client.1.smithi159.stdout:8/149: unlink d1/f1f 0 2022-02-02T18:21:53.059 INFO:tasks.workunit.client.1.smithi159.stdout:5/275: write d9/f1c [1034844,10500] 0 2022-02-02T18:21:53.060 INFO:tasks.workunit.client.1.smithi159.stdout:2/261: dwrite da/d1c/f26 [0,4194304] 0 2022-02-02T18:21:53.060 INFO:tasks.workunit.client.1.smithi159.stdout:2/262: fsync da/d1c/f26 0 2022-02-02T18:21:53.061 INFO:tasks.workunit.client.1.smithi159.stdout:2/263: fsync da/d40/f1a 0 2022-02-02T18:21:53.061 INFO:tasks.workunit.client.1.smithi159.stdout:5/276: write d9/d24/d37/f18 [1337647,107174] 0 2022-02-02T18:21:53.061 INFO:tasks.workunit.client.1.smithi159.stdout:4/182: rename d0/l2f to d0/d8/d30/l3d 0 2022-02-02T18:21:53.061 INFO:tasks.workunit.client.1.smithi159.stdout:8/150: rename d1 to d1/dd/d31/d3c 22 2022-02-02T18:21:53.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/151: write d1/dd/f16 [4485696,57219] 0 2022-02-02T18:21:53.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/152: read - d1/dd/d1a/f39 zero size 2022-02-02T18:21:53.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/153: write d1/dd/d1a/f39 [996076,89320] 0 2022-02-02T18:21:53.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/154: unlink d1/f4 0 2022-02-02T18:21:53.063 INFO:tasks.workunit.client.1.smithi159.stdout:0/182: creat d1/d19/d3d/f40 x:0 0 0 2022-02-02T18:21:53.063 INFO:tasks.workunit.client.1.smithi159.stdout:0/183: chown d1/d11/d1d/d34 53378 1 2022-02-02T18:21:53.063 INFO:tasks.workunit.client.1.smithi159.stdout:5/277: creat d9/d2e/f53 x:0 0 0 2022-02-02T18:21:53.067 INFO:tasks.workunit.client.1.smithi159.stdout:4/183: symlink d0/l3e 0 2022-02-02T18:21:53.068 INFO:tasks.workunit.client.1.smithi159.stdout:6/160: dwrite df/f16 [0,4194304] 0 2022-02-02T18:21:53.068 INFO:tasks.workunit.client.1.smithi159.stdout:8/155: mknod d1/dd/d1a/c3d 0 2022-02-02T18:21:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/184: truncate d1/fe 1168229 0 2022-02-02T18:21:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/185: write d1/d19/f39 [1170588,28250] 0 2022-02-02T18:21:53.071 INFO:tasks.workunit.client.1.smithi159.stdout:6/161: creat df/d35/f36 x:0 0 0 2022-02-02T18:21:53.072 INFO:tasks.workunit.client.1.smithi159.stdout:6/162: fsync df/f16 0 2022-02-02T18:21:53.073 INFO:tasks.workunit.client.1.smithi159.stdout:9/160: dwrite d4/ff [4194304,4194304] 0 2022-02-02T18:21:53.075 INFO:tasks.workunit.client.1.smithi159.stdout:8/156: link d1/dd/f29 d1/dd/d31/f3e 0 2022-02-02T18:21:53.075 INFO:tasks.workunit.client.1.smithi159.stdout:8/157: readlink d1/d26/l30 0 2022-02-02T18:21:53.076 INFO:tasks.workunit.client.1.smithi159.stdout:3/235: rmdir dd/d19/d38/d3f 39 2022-02-02T18:21:53.079 INFO:tasks.workunit.client.1.smithi159.stdout:4/184: dread d0/d8/d14/d33/f35 [0,4194304] 0 2022-02-02T18:21:53.080 INFO:tasks.workunit.client.1.smithi159.stdout:4/185: fdatasync d0/d8/f10 0 2022-02-02T18:21:53.080 INFO:tasks.workunit.client.1.smithi159.stdout:0/186: link d1/d11/d1d/f22 d1/d19/d3d/f41 0 2022-02-02T18:21:53.081 INFO:tasks.workunit.client.1.smithi159.stdout:6/163: creat df/d35/d2a/d2f/f37 x:0 0 0 2022-02-02T18:21:53.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/164: chown fa 26631 1 2022-02-02T18:21:53.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/165: readlink l9 0 2022-02-02T18:21:53.083 INFO:tasks.workunit.client.1.smithi159.stdout:9/161: creat d4/d19/d1c/d1f/f30 x:0 0 0 2022-02-02T18:21:53.084 INFO:tasks.workunit.client.1.smithi159.stdout:9/162: write d4/f13 [2955405,127054] 0 2022-02-02T18:21:53.089 INFO:tasks.workunit.client.1.smithi159.stdout:6/166: write f1 [5329014,14963] 0 2022-02-02T18:21:53.089 INFO:tasks.workunit.client.1.smithi159.stdout:6/167: fdatasync df/d35/f36 0 2022-02-02T18:21:53.090 INFO:tasks.workunit.client.1.smithi159.stdout:2/264: dwrite da/f3b [0,4194304] 0 2022-02-02T18:21:53.091 INFO:tasks.workunit.client.1.smithi159.stdout:8/158: creat d1/dd/d31/f3f x:0 0 0 2022-02-02T18:21:53.092 INFO:tasks.workunit.client.1.smithi159.stdout:4/186: symlink d0/d8/d24/l3f 0 2022-02-02T18:21:53.093 INFO:tasks.workunit.client.1.smithi159.stdout:0/187: mkdir d1/d11/d38/d42 0 2022-02-02T18:21:53.095 INFO:tasks.workunit.client.1.smithi159.stdout:6/168: link df/d35/d2a/d2f/f37 df/d35/f38 0 2022-02-02T18:21:53.095 INFO:tasks.workunit.client.1.smithi159.stdout:6/169: dread - df/f15 zero size 2022-02-02T18:21:53.095 INFO:tasks.workunit.client.1.smithi159.stdout:6/170: dread - df/f1b zero size 2022-02-02T18:21:53.097 INFO:tasks.workunit.client.1.smithi159.stdout:5/278: dwrite d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:21:53.098 INFO:tasks.workunit.client.1.smithi159.stdout:6/171: read df/d35/f27 [3738176,89309] 0 2022-02-02T18:21:53.098 INFO:tasks.workunit.client.1.smithi159.stdout:6/172: chown df/d35/c25 4 1 2022-02-02T18:21:53.104 INFO:tasks.workunit.client.1.smithi159.stdout:4/187: fsync d0/f21 0 2022-02-02T18:21:53.104 INFO:tasks.workunit.client.1.smithi159.stdout:4/188: rename d0 to d0/d8/d14/d36/d40 22 2022-02-02T18:21:53.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/159: getdents d1/d26 0 2022-02-02T18:21:53.106 INFO:tasks.workunit.client.1.smithi159.stdout:0/188: link d1/d19/f29 d1/d19/f43 0 2022-02-02T18:21:53.107 INFO:tasks.workunit.client.1.smithi159.stdout:3/236: dwrite f7 [0,4194304] 0 2022-02-02T18:21:53.107 INFO:tasks.workunit.client.1.smithi159.stdout:2/265: dread da/d40/f1a [0,4194304] 0 2022-02-02T18:21:53.108 INFO:tasks.workunit.client.1.smithi159.stdout:4/189: mkdir d0/d8/d41 0 2022-02-02T18:21:53.110 INFO:tasks.workunit.client.1.smithi159.stdout:0/189: rename d1/d11/d1d/f22 to d1/d11/d1d/f44 0 2022-02-02T18:21:53.111 INFO:tasks.workunit.client.1.smithi159.stdout:0/190: chown d1/d19/f25 2867812 1 2022-02-02T18:21:53.115 INFO:tasks.workunit.client.1.smithi159.stdout:9/163: dwrite d4/d19/d1c/d21/f27 [0,4194304] 0 2022-02-02T18:21:53.116 INFO:tasks.workunit.client.1.smithi159.stdout:5/279: rmdir d9/d24 39 2022-02-02T18:21:53.116 INFO:tasks.workunit.client.1.smithi159.stdout:4/190: link d0/d8/d15/f2e d0/d8/d24/f42 0 2022-02-02T18:21:53.117 INFO:tasks.workunit.client.1.smithi159.stdout:5/280: creat d9/d2e/f54 x:0 0 0 2022-02-02T18:21:53.126 INFO:tasks.workunit.client.1.smithi159.stdout:2/266: dread da/d1c/f26 [0,4194304] 0 2022-02-02T18:21:53.126 INFO:tasks.workunit.client.1.smithi159.stdout:2/267: chown da/d30/f43 700281 1 2022-02-02T18:21:53.127 INFO:tasks.workunit.client.1.smithi159.stdout:9/164: rename d4/f18 to d4/d19/f31 0 2022-02-02T18:21:53.131 INFO:tasks.workunit.client.1.smithi159.stdout:8/160: dwrite d1/fa [0,4194304] 0 2022-02-02T18:21:53.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/191: symlink d0/d8/d24/l43 0 2022-02-02T18:21:53.138 INFO:tasks.workunit.client.1.smithi159.stdout:5/281: link d9/d2e/c35 d9/d24/d38/d3c/c55 0 2022-02-02T18:21:53.138 INFO:tasks.workunit.client.1.smithi159.stdout:5/282: write d9/d24/d37/f3a [4785646,61078] 0 2022-02-02T18:21:53.139 INFO:tasks.workunit.client.1.smithi159.stdout:2/268: mkdir da/d1c/d29/d3f/d59 0 2022-02-02T18:21:53.141 INFO:tasks.workunit.client.1.smithi159.stdout:8/161: mknod d1/dd/c40 0 2022-02-02T18:21:53.141 INFO:tasks.workunit.client.1.smithi159.stdout:8/162: chown d1/f28 1937 1 2022-02-02T18:21:53.141 INFO:tasks.workunit.client.1.smithi159.stdout:8/163: chown d1/dd/d31 14 1 2022-02-02T18:21:53.141 INFO:tasks.workunit.client.1.smithi159.stdout:2/269: read da/f16 [2268225,117609] 0 2022-02-02T18:21:53.142 INFO:tasks.workunit.client.1.smithi159.stdout:2/270: chown da/d1c 1 1 2022-02-02T18:21:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:9/165: dwrite d4/f29 [0,4194304] 0 2022-02-02T18:21:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:4/192: mknod d0/d8/d30/c44 0 2022-02-02T18:21:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:5/283: mknod d9/d24/d38/c56 0 2022-02-02T18:21:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:5/284: write d9/f47 [58859,49552] 0 2022-02-02T18:21:53.144 INFO:tasks.workunit.client.1.smithi159.stdout:2/271: write da/f44 [3394951,77733] 0 2022-02-02T18:21:53.147 INFO:tasks.workunit.client.1.smithi159.stdout:9/166: dread d4/f10 [0,4194304] 0 2022-02-02T18:21:53.150 INFO:tasks.workunit.client.1.smithi159.stdout:0/191: truncate d1/fe 825239 0 2022-02-02T18:21:53.151 INFO:tasks.workunit.client.1.smithi159.stdout:4/193: rmdir d0/d8/d24 39 2022-02-02T18:21:53.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/272: mkdir da/d1c/d29/d3f/d5a 0 2022-02-02T18:21:53.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/273: readlink da/d40/le 0 2022-02-02T18:21:53.155 INFO:tasks.workunit.client.1.smithi159.stdout:9/167: mknod d4/d2a/c32 0 2022-02-02T18:21:53.155 INFO:tasks.workunit.client.1.smithi159.stdout:9/168: read d4/f11 [4741147,4018] 0 2022-02-02T18:21:53.156 INFO:tasks.workunit.client.1.smithi159.stdout:0/192: link d1/d19/f39 d1/d19/d3d/f45 0 2022-02-02T18:21:53.160 INFO:tasks.workunit.client.1.smithi159.stdout:4/194: write d0/d8/d15/f19 [4702533,429] 0 2022-02-02T18:21:53.160 INFO:tasks.workunit.client.1.smithi159.stdout:4/195: creat d0/d8/d14/d33/f45 x:0 0 0 2022-02-02T18:21:53.162 INFO:tasks.workunit.client.1.smithi159.stdout:9/169: rename d4/c6 to d4/d19/d1c/d21/c33 0 2022-02-02T18:21:53.162 INFO:tasks.workunit.client.1.smithi159.stdout:9/170: stat d4/d2a 0 2022-02-02T18:21:53.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/196: creat d0/d8/d24/d3a/f46 x:0 0 0 2022-02-02T18:21:53.166 INFO:tasks.workunit.client.1.smithi159.stdout:8/164: dwrite d1/dd/d31/f3f [0,4194304] 0 2022-02-02T18:21:53.167 INFO:tasks.workunit.client.1.smithi159.stdout:9/171: rename d4/ff to d4/d2a/f34 0 2022-02-02T18:21:53.167 INFO:tasks.workunit.client.1.smithi159.stdout:5/285: dwrite d9/d24/d37/d23/f4f [0,4194304] 0 2022-02-02T18:21:53.168 INFO:tasks.workunit.client.1.smithi159.stdout:9/172: write d4/d2a/f34 [4673176,28279] 0 2022-02-02T18:21:53.168 INFO:tasks.workunit.client.1.smithi159.stdout:4/197: mkdir d0/d8/d14/d33/d47 0 2022-02-02T18:21:53.169 INFO:tasks.workunit.client.1.smithi159.stdout:4/198: chown d0/d8/d14/d36 15999280 1 2022-02-02T18:21:53.175 INFO:tasks.workunit.client.1.smithi159.stdout:4/199: dread d0/d8/f10 [0,4194304] 0 2022-02-02T18:21:53.191 INFO:tasks.workunit.client.1.smithi159.stdout:0/193: dwrite d1/fb [0,4194304] 0 2022-02-02T18:21:53.191 INFO:tasks.workunit.client.1.smithi159.stdout:0/194: chown d1/d11/d1d/f44 53884546 1 2022-02-02T18:21:53.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/286: dwrite d9/d24/f41 [0,4194304] 0 2022-02-02T18:21:53.198 INFO:tasks.workunit.client.1.smithi159.stdout:8/165: truncate d1/f8 2294202 0 2022-02-02T18:21:53.199 INFO:tasks.workunit.client.1.smithi159.stdout:8/166: write d1/dd/f29 [754872,48953] 0 2022-02-02T18:21:53.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/200: rename d0/d8/d24/l43 to d0/d8/d14/d33/l48 0 2022-02-02T18:21:53.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/201: write d0/d8/d30/f37 [165400,98353] 0 2022-02-02T18:21:53.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/202: write d0/f11 [1049050,87373] 0 2022-02-02T18:21:53.202 INFO:tasks.workunit.client.1.smithi159.stdout:0/195: mknod d1/d19/c46 0 2022-02-02T18:21:53.203 INFO:tasks.workunit.client.1.smithi159.stdout:5/287: symlink d9/d24/d38/l57 0 2022-02-02T18:21:53.204 INFO:tasks.workunit.client.1.smithi159.stdout:8/167: dread d1/f28 [0,4194304] 0 2022-02-02T18:21:53.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/168: write d1/dd/d1a/f32 [119408,40480] 0 2022-02-02T18:21:53.212 INFO:tasks.workunit.client.1.smithi159.stdout:9/173: getdents d4/d19/d1c/d21 0 2022-02-02T18:21:53.214 INFO:tasks.workunit.client.1.smithi159.stdout:4/203: rename d0/l3e to d0/d8/d14/d33/l49 0 2022-02-02T18:21:53.216 INFO:tasks.workunit.client.1.smithi159.stdout:0/196: mkdir d1/d11/d38/d42/d47 0 2022-02-02T18:21:53.216 INFO:tasks.workunit.client.1.smithi159.stdout:0/197: readlink d1/dd/l27 0 2022-02-02T18:21:53.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/198: rename d1/f5 to d1/d11/d38/d42/d47/f48 0 2022-02-02T18:21:53.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/199: write d1/f3c [404296,64888] 0 2022-02-02T18:21:53.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/200: chown d1/f10 89344315 1 2022-02-02T18:21:53.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/201: write d1/d11/f35 [4542593,48645] 0 2022-02-02T18:21:53.224 INFO:tasks.workunit.client.1.smithi159.stdout:0/202: rename d1/fa to d1/d19/f49 0 2022-02-02T18:21:53.225 INFO:tasks.workunit.client.1.smithi159.stdout:0/203: creat d1/d11/d1d/d34/f4a x:0 0 0 2022-02-02T18:21:53.227 INFO:tasks.workunit.client.1.smithi159.stdout:5/288: dwrite d9/d24/f2d [0,4194304] 0 2022-02-02T18:21:53.228 INFO:tasks.workunit.client.1.smithi159.stdout:5/289: mknod d9/d24/d37/c58 0 2022-02-02T18:21:53.229 INFO:tasks.workunit.client.1.smithi159.stdout:5/290: readlink d9/d24/l31 0 2022-02-02T18:21:53.230 INFO:tasks.workunit.client.1.smithi159.stdout:5/291: symlink d9/d24/d21/d44/l59 0 2022-02-02T18:21:53.230 INFO:tasks.workunit.client.1.smithi159.stdout:5/292: fsync d9/d24/f33 0 2022-02-02T18:21:53.235 INFO:tasks.workunit.client.1.smithi159.stdout:5/293: symlink d9/d24/d4a/l5a 0 2022-02-02T18:21:53.235 INFO:tasks.workunit.client.1.smithi159.stdout:5/294: chown d9/l17 19 1 2022-02-02T18:21:53.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/295: write f1 [746614,125590] 0 2022-02-02T18:21:53.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/296: creat d9/d24/d21/d44/f5b x:0 0 0 2022-02-02T18:21:53.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/297: unlink d9/d24/d37/f1a 0 2022-02-02T18:21:53.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/298: mknod d9/d24/d21/c5c 0 2022-02-02T18:21:53.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/299: dread d9/d24/d37/f3a [4194304,4194304] 0 2022-02-02T18:21:53.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/300: chown d9/f42 120117420 1 2022-02-02T18:21:53.242 INFO:tasks.workunit.client.1.smithi159.stdout:5/301: truncate d9/d24/d37/f3a 5510865 0 2022-02-02T18:21:53.242 INFO:tasks.workunit.client.1.smithi159.stdout:5/302: readlink d9/d2e/l45 0 2022-02-02T18:21:53.242 INFO:tasks.workunit.client.1.smithi159.stdout:5/303: creat d9/d2e/f5d x:0 0 0 2022-02-02T18:21:53.243 INFO:tasks.workunit.client.1.smithi159.stdout:5/304: truncate d9/f47 627800 0 2022-02-02T18:21:53.243 INFO:tasks.workunit.client.1.smithi159.stdout:5/305: write d9/d24/d37/f29 [268968,109232] 0 2022-02-02T18:21:53.257 INFO:tasks.workunit.client.1.smithi159.stdout:5/306: dwrite d9/d24/d37/d23/f3f [0,4194304] 0 2022-02-02T18:21:53.257 INFO:tasks.workunit.client.1.smithi159.stdout:5/307: dread - d9/d24/d4a/f43 zero size 2022-02-02T18:21:53.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/308: fdatasync d9/d24/d21/f3d 0 2022-02-02T18:21:53.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/309: stat d9/d2e/l2f 0 2022-02-02T18:21:53.259 INFO:tasks.workunit.client.1.smithi159.stdout:5/310: mknod d9/d24/c5e 0 2022-02-02T18:21:53.259 INFO:tasks.workunit.client.1.smithi159.stdout:5/311: mknod d9/d24/d37/d23/c5f 0 2022-02-02T18:21:53.260 INFO:tasks.workunit.client.1.smithi159.stdout:5/312: unlink d9/d24/d37/f1b 0 2022-02-02T18:21:53.278 INFO:tasks.workunit.client.1.smithi159.stdout:5/313: dwrite d9/d24/d37/d23/f3f [4194304,4194304] 0 2022-02-02T18:21:53.279 INFO:tasks.workunit.client.1.smithi159.stdout:5/314: fdatasync d9/f47 0 2022-02-02T18:21:53.279 INFO:tasks.workunit.client.1.smithi159.stdout:5/315: chown d9/d24/d4a/d52 7 1 2022-02-02T18:21:53.279 INFO:tasks.workunit.client.1.smithi159.stdout:5/316: write d9/d2e/f53 [982093,73497] 0 2022-02-02T18:21:53.281 INFO:tasks.workunit.client.1.smithi159.stdout:5/317: rename d9/d24/d4a/f43 to d9/d24/d38/f60 0 2022-02-02T18:21:53.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/318: rename d9/d24/d37/d23/d4b to d9/d24/d38/d3c/d61 0 2022-02-02T18:21:53.284 INFO:tasks.workunit.client.1.smithi159.stdout:5/319: symlink d9/d24/d37/l62 0 2022-02-02T18:21:53.301 INFO:tasks.workunit.client.1.smithi159.stdout:5/320: dwrite d9/d24/d37/f19 [0,4194304] 0 2022-02-02T18:21:53.302 INFO:tasks.workunit.client.1.smithi159.stdout:5/321: write d9/d24/d37/d23/f4d [477366,122386] 0 2022-02-02T18:21:53.302 INFO:tasks.workunit.client.1.smithi159.stdout:5/322: mkdir d9/d2e/d63 0 2022-02-02T18:21:53.311 INFO:tasks.workunit.client.1.smithi159.stdout:5/323: dread d9/f39 [0,4194304] 0 2022-02-02T18:21:53.312 INFO:tasks.workunit.client.1.smithi159.stdout:5/324: creat d9/d24/d38/f64 x:0 0 0 2022-02-02T18:21:53.314 INFO:tasks.workunit.client.1.smithi159.stdout:5/325: rename d9/d24/d37/f19 to d9/d24/d21/d44/f65 0 2022-02-02T18:21:53.331 INFO:tasks.workunit.client.1.smithi159.stdout:5/326: dwrite d9/d24/d37/f49 [4194304,4194304] 0 2022-02-02T18:21:53.333 INFO:tasks.workunit.client.1.smithi159.stdout:5/327: creat d9/d24/d21/f66 x:0 0 0 2022-02-02T18:21:53.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/328: write d9/d24/f16 [196766,65725] 0 2022-02-02T18:21:53.335 INFO:tasks.workunit.client.1.smithi159.stdout:5/329: write f1 [3177279,302] 0 2022-02-02T18:21:53.335 INFO:tasks.workunit.client.1.smithi159.stdout:5/330: unlink f1 0 2022-02-02T18:21:53.345 INFO:tasks.workunit.client.1.smithi159.stdout:5/331: rmdir d9/d2e 39 2022-02-02T18:21:53.345 INFO:tasks.workunit.client.1.smithi159.stdout:5/332: chown d9/f1c 0 1 2022-02-02T18:21:53.345 INFO:tasks.workunit.client.1.smithi159.stdout:5/333: rmdir d9/d2e 39 2022-02-02T18:21:53.347 INFO:tasks.workunit.client.1.smithi159.stdout:5/334: symlink d9/l67 0 2022-02-02T18:21:53.348 INFO:tasks.workunit.client.1.smithi159.stdout:5/335: mkdir d9/d24/d37/d23/d68 0 2022-02-02T18:21:53.350 INFO:tasks.workunit.client.1.smithi159.stdout:5/336: creat d9/d24/d37/d23/d68/f69 x:0 0 0 2022-02-02T18:21:53.353 INFO:tasks.workunit.client.1.smithi159.stdout:5/337: chown d9/d24/d37/d23/l50 78 1 2022-02-02T18:21:53.354 INFO:tasks.workunit.client.1.smithi159.stdout:5/338: mknod d9/d24/d38/c6a 0 2022-02-02T18:21:53.355 INFO:tasks.workunit.client.1.smithi159.stdout:5/339: write d9/d24/d37/f20 [205158,42833] 0 2022-02-02T18:21:53.360 INFO:tasks.workunit.client.1.smithi159.stdout:5/340: dread d9/f39 [0,4194304] 0 2022-02-02T18:21:53.362 INFO:tasks.workunit.client.1.smithi159.stdout:5/341: dread d9/d24/d37/d23/f30 [0,4194304] 0 2022-02-02T18:21:53.362 INFO:tasks.workunit.client.1.smithi159.stdout:5/342: chown d9/d24/d37/l62 39756337 1 2022-02-02T18:21:53.363 INFO:tasks.workunit.client.1.smithi159.stdout:5/343: write d9/d24/f41 [2713492,80821] 0 2022-02-02T18:21:53.365 INFO:tasks.workunit.client.1.smithi159.stdout:5/344: rename d9/d24/d37/f49 to d9/d2e/d63/f6b 0 2022-02-02T18:21:53.367 INFO:tasks.workunit.client.1.smithi159.stdout:5/345: fdatasync d9/d2e/f53 0 2022-02-02T18:21:53.368 INFO:tasks.workunit.client.1.smithi159.stdout:5/346: rmdir d9/d24/d38/d3c/d61 39 2022-02-02T18:21:53.368 INFO:tasks.workunit.client.1.smithi159.stdout:5/347: write d9/d24/d37/d23/d68/f69 [511140,128121] 0 2022-02-02T18:21:53.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/348: dwrite d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:21:53.388 INFO:tasks.workunit.client.1.smithi159.stdout:5/349: creat d9/d24/d38/d3c/f6c x:0 0 0 2022-02-02T18:21:53.389 INFO:tasks.workunit.client.1.smithi159.stdout:5/350: getdents d9/d24/d21/d44 0 2022-02-02T18:21:53.391 INFO:tasks.workunit.client.1.smithi159.stdout:5/351: creat d9/d24/f6d x:0 0 0 2022-02-02T18:21:53.392 INFO:tasks.workunit.client.1.smithi159.stdout:5/352: readlink d9/d24/l31 0 2022-02-02T18:21:53.392 INFO:tasks.workunit.client.1.smithi159.stdout:5/353: chown d9/l67 19727051 1 2022-02-02T18:21:53.395 INFO:tasks.workunit.client.1.smithi159.stdout:5/354: creat d9/d24/d21/d44/f6e x:0 0 0 2022-02-02T18:21:53.395 INFO:tasks.workunit.client.1.smithi159.stdout:5/355: stat d9/f39 0 2022-02-02T18:21:53.415 INFO:tasks.workunit.client.1.smithi159.stdout:5/356: dwrite d9/d24/f41 [4194304,4194304] 0 2022-02-02T18:21:53.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/357: creat d9/d24/d37/d23/f6f x:0 0 0 2022-02-02T18:21:53.418 INFO:tasks.workunit.client.1.smithi159.stdout:5/358: creat d9/d2e/f70 x:0 0 0 2022-02-02T18:21:53.420 INFO:tasks.workunit.client.1.smithi159.stdout:5/359: mkdir d9/d2e/d71 0 2022-02-02T18:21:53.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/360: mkdir d9/d24/d72 0 2022-02-02T18:21:53.442 INFO:tasks.workunit.client.1.smithi159.stdout:5/361: dwrite d9/f39 [0,4194304] 0 2022-02-02T18:21:53.444 INFO:tasks.workunit.client.1.smithi159.stdout:5/362: link d9/d24/d37/f29 d9/d24/d38/f73 0 2022-02-02T18:21:53.446 INFO:tasks.workunit.client.1.smithi159.stdout:5/363: creat d9/d24/d4a/d52/f74 x:0 0 0 2022-02-02T18:21:53.448 INFO:tasks.workunit.client.1.smithi159.stdout:5/364: write d9/d24/f2d [3479031,51189] 0 2022-02-02T18:21:53.448 INFO:tasks.workunit.client.1.smithi159.stdout:5/365: chown d9/c1f 598979982 1 2022-02-02T18:21:53.470 INFO:tasks.workunit.client.1.smithi159.stdout:5/366: dwrite d9/d24/d21/d44/f65 [0,4194304] 0 2022-02-02T18:21:53.470 INFO:tasks.workunit.client.1.smithi159.stdout:5/367: write d9/d24/d38/f64 [291827,128599] 0 2022-02-02T18:21:53.470 INFO:tasks.workunit.client.1.smithi159.stdout:5/368: truncate d9/d2e/f53 1474193 0 2022-02-02T18:21:53.471 INFO:tasks.workunit.client.1.smithi159.stdout:5/369: readlink d9/d24/d38/l51 0 2022-02-02T18:21:53.550 INFO:tasks.workunit.client.1.smithi159.stdout:7/168: sync 2022-02-02T18:21:54.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/169: unlink c2 0 2022-02-02T18:21:54.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/170: creat d3/d19/d2f/d34/f3f x:0 0 0 2022-02-02T18:21:54.086 INFO:tasks.workunit.client.1.smithi159.stdout:7/171: creat d3/d6/f40 x:0 0 0 2022-02-02T18:21:54.086 INFO:tasks.workunit.client.1.smithi159.stdout:7/172: write d3/d19/d2f/d34/f3f [91437,20748] 0 2022-02-02T18:21:54.086 INFO:tasks.workunit.client.1.smithi159.stdout:7/173: symlink d3/l41 0 2022-02-02T18:21:54.086 INFO:tasks.workunit.client.1.smithi159.stdout:7/174: creat d3/d6/f42 x:0 0 0 2022-02-02T18:21:54.086 INFO:tasks.workunit.client.1.smithi159.stdout:7/175: link d3/l41 d3/d5/l43 0 2022-02-02T18:21:54.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/176: rmdir d3/d27/d29 39 2022-02-02T18:21:54.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/177: unlink d3/d6/l3c 0 2022-02-02T18:21:54.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/178: truncate d3/d19/d2f/d34/f24 384086 0 2022-02-02T18:21:54.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/179: creat d3/d19/d2f/f44 x:0 0 0 2022-02-02T18:21:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:7/180: dwrite d3/d19/d2f/d34/f24 [0,4194304] 0 2022-02-02T18:21:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:7/181: creat d3/d5/f45 x:0 0 0 2022-02-02T18:21:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:7/182: creat d3/d19/d2f/d34/f46 x:0 0 0 2022-02-02T18:21:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:7/183: truncate d3/f2d 1411856 0 2022-02-02T18:21:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:7/184: rename d3/d6/f42 to d3/d2a/f47 0 2022-02-02T18:21:54.089 INFO:tasks.workunit.client.1.smithi159.stdout:7/185: getdents d3/d5 0 2022-02-02T18:21:54.089 INFO:tasks.workunit.client.1.smithi159.stdout:7/186: fdatasync d3/d2a/f47 0 2022-02-02T18:21:54.089 INFO:tasks.workunit.client.1.smithi159.stdout:7/187: symlink d3/d5/l48 0 2022-02-02T18:21:54.089 INFO:tasks.workunit.client.1.smithi159.stdout:7/188: rename d3/c4 to d3/d2a/d2c/c49 0 2022-02-02T18:21:54.090 INFO:tasks.workunit.client.1.smithi159.stdout:7/189: chown d3/d27/d29/l36 59840 1 2022-02-02T18:21:54.090 INFO:tasks.workunit.client.1.smithi159.stdout:7/190: dwrite d3/d19/d2f/f44 [0,4194304] 0 2022-02-02T18:21:54.090 INFO:tasks.workunit.client.1.smithi159.stdout:7/191: dwrite d3/f2d [0,4194304] 0 2022-02-02T18:21:54.091 INFO:tasks.workunit.client.1.smithi159.stdout:7/192: rmdir d3/d19/d2f 39 2022-02-02T18:21:54.091 INFO:tasks.workunit.client.1.smithi159.stdout:7/193: mkdir d3/d2a/d4a 0 2022-02-02T18:21:54.091 INFO:tasks.workunit.client.1.smithi159.stdout:7/194: getdents d3/d27/d29 0 2022-02-02T18:21:54.091 INFO:tasks.workunit.client.1.smithi159.stdout:7/195: dwrite d3/d2a/f22 [0,4194304] 0 2022-02-02T18:21:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/196: dread d3/f14 [0,4194304] 0 2022-02-02T18:21:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/197: dwrite d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:21:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/198: mknod d3/d19/d2f/d34/c4b 0 2022-02-02T18:21:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/199: dwrite d3/d6/f17 [0,4194304] 0 2022-02-02T18:21:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/200: getdents d3/d27/d29 0 2022-02-02T18:21:54.093 INFO:tasks.workunit.client.1.smithi159.stdout:7/201: link d3/f2d d3/d19/d2f/f4c 0 2022-02-02T18:21:54.093 INFO:tasks.workunit.client.1.smithi159.stdout:7/202: rmdir d3/d27/d29 39 2022-02-02T18:21:54.093 INFO:tasks.workunit.client.1.smithi159.stdout:7/203: fdatasync d3/d19/d2f/f4c 0 2022-02-02T18:21:54.093 INFO:tasks.workunit.client.1.smithi159.stdout:7/204: fdatasync d3/d19/d2f/d34/f24 0 2022-02-02T18:21:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/205: stat d3/d27/d29/c2b 0 2022-02-02T18:21:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/206: dwrite d3/fb [0,4194304] 0 2022-02-02T18:21:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/207: chown d3/d19/d2f/d34/f3f 0 1 2022-02-02T18:21:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/208: link d3/d19/d2f/d34/f24 d3/d6/f4d 0 2022-02-02T18:21:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/209: dread d3/d19/d2f/d34/f24 [0,4194304] 0 2022-02-02T18:21:54.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/210: creat d3/f4e x:0 0 0 2022-02-02T18:21:54.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/211: truncate d3/d5/f45 59922 0 2022-02-02T18:21:54.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/212: dwrite d3/d19/d2f/d34/f46 [0,4194304] 0 2022-02-02T18:21:54.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/213: write d3/f2d [5049058,46214] 0 2022-02-02T18:21:54.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/214: truncate d3/d19/f3a 2120443 0 2022-02-02T18:21:54.096 INFO:tasks.workunit.client.1.smithi159.stdout:7/215: write d3/d5/f45 [939630,94818] 0 2022-02-02T18:21:54.096 INFO:tasks.workunit.client.1.smithi159.stdout:7/216: creat d3/d19/d2f/d34/f4f x:0 0 0 2022-02-02T18:21:54.096 INFO:tasks.workunit.client.1.smithi159.stdout:7/217: creat d3/d19/d2f/f50 x:0 0 0 2022-02-02T18:21:54.096 INFO:tasks.workunit.client.1.smithi159.stdout:7/218: chown d3/d19/c23 184585 1 2022-02-02T18:21:54.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/219: dwrite d3/d19/d2f/d34/f11 [0,4194304] 0 2022-02-02T18:21:54.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/220: mknod d3/d19/c51 0 2022-02-02T18:21:54.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/221: dread d3/d2a/f22 [0,4194304] 0 2022-02-02T18:21:54.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/222: write d3/fb [4917965,20825] 0 2022-02-02T18:21:54.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/223: mkdir d3/d52 0 2022-02-02T18:21:54.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/224: dread - d3/d19/d2f/f38 zero size 2022-02-02T18:21:54.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/225: fdatasync d3/d19/d2f/f4c 0 2022-02-02T18:21:54.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/226: write d3/d19/d2f/f50 [85927,83233] 0 2022-02-02T18:21:54.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/227: symlink d3/d27/d29/l53 0 2022-02-02T18:21:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/228: creat d3/d6/f54 x:0 0 0 2022-02-02T18:21:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/229: dwrite d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:21:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/230: creat d3/d2a/f55 x:0 0 0 2022-02-02T18:21:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/231: getdents d3/d2a/d2c 0 2022-02-02T18:21:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/232: chown d3/d5/le 5 1 2022-02-02T18:21:54.100 INFO:tasks.workunit.client.1.smithi159.stdout:7/233: rename d3/d19 to d3/d5/d56 0 2022-02-02T18:21:54.100 INFO:tasks.workunit.client.1.smithi159.stdout:7/234: rename d3/d5/d56/d2f/d34 to d3/d5/d56/d57 0 2022-02-02T18:21:54.100 INFO:tasks.workunit.client.1.smithi159.stdout:7/235: symlink d3/d5/d56/d57/l58 0 2022-02-02T18:21:54.101 INFO:tasks.workunit.client.1.smithi159.stdout:7/236: chown d3/d27/d29/l53 47464420 1 2022-02-02T18:21:54.101 INFO:tasks.workunit.client.1.smithi159.stdout:7/237: read d3/d5/d56/d57/fd [2823872,99027] 0 2022-02-02T18:21:54.101 INFO:tasks.workunit.client.1.smithi159.stdout:7/238: readlink d3/d5/d56/d57/l58 0 2022-02-02T18:21:54.101 INFO:tasks.workunit.client.1.smithi159.stdout:7/239: write d3/d5/d56/d57/f3f [1129489,111708] 0 2022-02-02T18:21:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/240: dread d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:21:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/241: write d3/d5/f20 [4099016,95487] 0 2022-02-02T18:21:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/242: dread d3/d5/d56/d57/f24 [0,4194304] 0 2022-02-02T18:21:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/243: truncate d3/d5/d56/f3a 2982784 0 2022-02-02T18:21:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/244: mkdir d3/d2a/d4a/d59 0 2022-02-02T18:21:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/245: creat d3/d2a/d2c/f5a x:0 0 0 2022-02-02T18:21:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/246: mkdir d3/d5/d56/d2f/d5b 0 2022-02-02T18:21:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/247: read - d3/d2a/f55 zero size 2022-02-02T18:21:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/248: getdents d3/d5/d56/d57 0 2022-02-02T18:21:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/249: dwrite d3/d6/f4d [0,4194304] 0 2022-02-02T18:21:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/250: dread d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:21:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/251: write d3/d5/d56/f3a [2018524,10108] 0 2022-02-02T18:21:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/252: dwrite d3/f2d [0,4194304] 0 2022-02-02T18:21:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/253: dread d3/d5/d56/d57/f24 [0,4194304] 0 2022-02-02T18:21:54.105 INFO:tasks.workunit.client.1.smithi159.stdout:7/254: rmdir d3/d6 39 2022-02-02T18:21:54.105 INFO:tasks.workunit.client.1.smithi159.stdout:7/255: chown d3/d2a/d4a/d59 26708 1 2022-02-02T18:21:54.105 INFO:tasks.workunit.client.1.smithi159.stdout:7/256: write d3/d6/f4d [3212700,54384] 0 2022-02-02T18:21:54.106 INFO:tasks.workunit.client.1.smithi159.stdout:7/257: dwrite d3/d2a/d2c/f5a [0,4194304] 0 2022-02-02T18:21:54.107 INFO:tasks.workunit.client.1.smithi159.stdout:7/258: dwrite d3/d5/d56/f32 [0,4194304] 0 2022-02-02T18:21:54.107 INFO:tasks.workunit.client.1.smithi159.stdout:7/259: dwrite d3/d2a/f47 [0,4194304] 0 2022-02-02T18:21:54.108 INFO:tasks.workunit.client.1.smithi159.stdout:7/260: link d3/d5/d56/c23 d3/d52/c5c 0 2022-02-02T18:21:54.108 INFO:tasks.workunit.client.1.smithi159.stdout:7/261: mkdir d3/d2a/d5d 0 2022-02-02T18:21:54.109 INFO:tasks.workunit.client.1.smithi159.stdout:1/195: sync 2022-02-02T18:21:54.109 INFO:tasks.workunit.client.1.smithi159.stdout:6/173: sync 2022-02-02T18:21:54.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/237: sync 2022-02-02T18:21:54.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/174: mknod df/c39 0 2022-02-02T18:21:54.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/175: creat df/d35/d2a/d2f/f3a x:0 0 0 2022-02-02T18:21:54.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/176: read - df/d35/d2a/f2d zero size 2022-02-02T18:21:54.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/196: dread f7 [0,4194304] 0 2022-02-02T18:21:54.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/197: chown df/d14/d16 1747839 1 2022-02-02T18:21:54.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/198: dread df/d14/d16/f38 [0,4194304] 0 2022-02-02T18:21:54.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/199: read df/d14/d16/f22 [347224,120343] 0 2022-02-02T18:21:54.112 INFO:tasks.workunit.client.1.smithi159.stdout:1/200: creat df/d21/d23/d49/f4e x:0 0 0 2022-02-02T18:21:54.112 INFO:tasks.workunit.client.1.smithi159.stdout:1/201: mknod df/d14/d16/d35/c4f 0 2022-02-02T18:21:54.113 INFO:tasks.workunit.client.1.smithi159.stdout:7/262: dwrite d3/d6/f40 [0,4194304] 0 2022-02-02T18:21:54.113 INFO:tasks.workunit.client.1.smithi159.stdout:1/202: truncate df/d21/d23/d49/f4e 112834 0 2022-02-02T18:21:54.113 INFO:tasks.workunit.client.1.smithi159.stdout:1/203: write df/d14/d16/f1f [23237,106221] 0 2022-02-02T18:21:54.114 INFO:tasks.workunit.client.1.smithi159.stdout:1/204: write f7 [3074899,71499] 0 2022-02-02T18:21:54.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/177: dwrite df/f18 [0,4194304] 0 2022-02-02T18:21:54.114 INFO:tasks.workunit.client.1.smithi159.stdout:7/263: mkdir d3/d27/d29/d5e 0 2022-02-02T18:21:54.115 INFO:tasks.workunit.client.1.smithi159.stdout:7/264: write d3/d5/d56/d2f/f50 [768167,33466] 0 2022-02-02T18:21:54.115 INFO:tasks.workunit.client.1.smithi159.stdout:3/238: dwrite dd/d19/d38/f48 [0,4194304] 0 2022-02-02T18:21:54.116 INFO:tasks.workunit.client.1.smithi159.stdout:1/205: symlink df/d14/d16/d4a/l50 0 2022-02-02T18:21:54.116 INFO:tasks.workunit.client.1.smithi159.stdout:6/178: dread f1 [4194304,4194304] 0 2022-02-02T18:21:54.116 INFO:tasks.workunit.client.1.smithi159.stdout:6/179: chown df/f1b 26212049 1 2022-02-02T18:21:54.117 INFO:tasks.workunit.client.1.smithi159.stdout:1/206: rename df/f26 to df/d14/d16/d4a/f51 0 2022-02-02T18:21:54.117 INFO:tasks.workunit.client.1.smithi159.stdout:6/180: creat df/d35/d2a/f3b x:0 0 0 2022-02-02T18:21:54.117 INFO:tasks.workunit.client.1.smithi159.stdout:7/265: link d3/d5/l43 d3/d5/d56/d2f/l5f 0 2022-02-02T18:21:54.118 INFO:tasks.workunit.client.1.smithi159.stdout:1/207: read df/d14/f33 [1204805,131032] 0 2022-02-02T18:21:54.118 INFO:tasks.workunit.client.1.smithi159.stdout:1/208: creat df/d14/d16/d4b/f52 x:0 0 0 2022-02-02T18:21:54.118 INFO:tasks.workunit.client.1.smithi159.stdout:1/209: mknod df/d14/c53 0 2022-02-02T18:21:54.119 INFO:tasks.workunit.client.1.smithi159.stdout:1/210: write df/f1e [3816693,94189] 0 2022-02-02T18:21:54.119 INFO:tasks.workunit.client.1.smithi159.stdout:3/239: dwrite dd/d19/d38/f48 [0,4194304] 0 2022-02-02T18:21:54.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/240: readlink dd/l14 0 2022-02-02T18:21:54.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/241: fdatasync dd/f11 0 2022-02-02T18:21:54.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/242: mkdir dd/d19/d38/d3f/d52 0 2022-02-02T18:21:54.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/243: mkdir dd/d19/d35/d53 0 2022-02-02T18:21:54.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/244: write dd/d19/f1b [963233,124810] 0 2022-02-02T18:21:54.122 INFO:tasks.workunit.client.1.smithi159.stdout:3/245: write dd/d19/f23 [2011720,110732] 0 2022-02-02T18:21:54.122 INFO:tasks.workunit.client.1.smithi159.stdout:3/246: write dd/d20/f30 [1842779,118061] 0 2022-02-02T18:21:54.122 INFO:tasks.workunit.client.1.smithi159.stdout:3/247: truncate dd/d19/d35/f4c 832899 0 2022-02-02T18:21:54.123 INFO:tasks.workunit.client.1.smithi159.stdout:7/266: dread d3/fb [0,4194304] 0 2022-02-02T18:21:54.123 INFO:tasks.workunit.client.1.smithi159.stdout:3/248: read fc [619702,87714] 0 2022-02-02T18:21:54.124 INFO:tasks.workunit.client.1.smithi159.stdout:3/249: stat dd/d19/d35 0 2022-02-02T18:21:54.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/267: read d3/d5/f20 [742771,56077] 0 2022-02-02T18:21:54.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/268: creat d3/f60 x:0 0 0 2022-02-02T18:21:54.125 INFO:tasks.workunit.client.1.smithi159.stdout:3/250: getdents dd/d20/d2a 0 2022-02-02T18:21:54.125 INFO:tasks.workunit.client.1.smithi159.stdout:6/181: dwrite df/f16 [0,4194304] 0 2022-02-02T18:21:54.126 INFO:tasks.workunit.client.1.smithi159.stdout:6/182: chown df/f1b 6397186 1 2022-02-02T18:21:54.126 INFO:tasks.workunit.client.1.smithi159.stdout:1/211: dread df/d14/f33 [0,4194304] 0 2022-02-02T18:21:54.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/269: dread d3/fb [0,4194304] 0 2022-02-02T18:21:54.127 INFO:tasks.workunit.client.1.smithi159.stdout:6/183: rmdir df 39 2022-02-02T18:21:54.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/270: creat d3/d27/d29/f61 x:0 0 0 2022-02-02T18:21:54.128 INFO:tasks.workunit.client.1.smithi159.stdout:7/271: stat d3/d52 0 2022-02-02T18:21:54.128 INFO:tasks.workunit.client.1.smithi159.stdout:7/272: mknod d3/d5/d56/d2f/d5b/c62 0 2022-02-02T18:21:54.129 INFO:tasks.workunit.client.1.smithi159.stdout:6/184: symlink df/l3c 0 2022-02-02T18:21:54.129 INFO:tasks.workunit.client.1.smithi159.stdout:1/212: dwrite df/d14/d16/d35/f42 [0,4194304] 0 2022-02-02T18:21:54.130 INFO:tasks.workunit.client.1.smithi159.stdout:1/213: stat df/d14/d16/l20 0 2022-02-02T18:21:54.130 INFO:tasks.workunit.client.1.smithi159.stdout:1/214: chown lc 236 1 2022-02-02T18:21:54.130 INFO:tasks.workunit.client.1.smithi159.stdout:1/215: fsync df/d14/d16/d4b/f52 0 2022-02-02T18:21:54.131 INFO:tasks.workunit.client.1.smithi159.stdout:1/216: chown fe 0 1 2022-02-02T18:21:54.131 INFO:tasks.workunit.client.1.smithi159.stdout:1/217: creat df/d21/f54 x:0 0 0 2022-02-02T18:21:54.131 INFO:tasks.workunit.client.1.smithi159.stdout:3/251: dwrite fc [0,4194304] 0 2022-02-02T18:21:54.132 INFO:tasks.workunit.client.1.smithi159.stdout:3/252: link dd/d19/f33 dd/d20/f54 0 2022-02-02T18:21:54.132 INFO:tasks.workunit.client.1.smithi159.stdout:3/253: link dd/f1f dd/d19/d38/f55 0 2022-02-02T18:21:54.132 INFO:tasks.workunit.client.1.smithi159.stdout:3/254: read - dd/d20/d2a/d3a/f45 zero size 2022-02-02T18:21:54.133 INFO:tasks.workunit.client.1.smithi159.stdout:7/273: dwrite d3/d6/f4d [0,4194304] 0 2022-02-02T18:21:54.133 INFO:tasks.workunit.client.1.smithi159.stdout:7/274: creat d3/d2a/d2c/f63 x:0 0 0 2022-02-02T18:21:54.134 INFO:tasks.workunit.client.1.smithi159.stdout:3/255: write dd/d19/f2b [3411866,124925] 0 2022-02-02T18:21:54.139 INFO:tasks.workunit.client.1.smithi159.stdout:7/275: truncate d3/d2a/f22 4158385 0 2022-02-02T18:21:54.139 INFO:tasks.workunit.client.1.smithi159.stdout:7/276: write d3/d6/f54 [575875,30649] 0 2022-02-02T18:21:54.139 INFO:tasks.workunit.client.1.smithi159.stdout:3/256: symlink dd/d19/l56 0 2022-02-02T18:21:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/257: readlink dd/d19/d38/l41 0 2022-02-02T18:21:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/258: chown dd/d20/f3c 511804 1 2022-02-02T18:21:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/277: symlink d3/d27/d29/d5e/l64 0 2022-02-02T18:21:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/278: chown d3/d52 337 1 2022-02-02T18:21:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/279: mknod d3/d5/d56/d57/c65 0 2022-02-02T18:21:54.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/280: rmdir d3/d2a/d4a/d59 0 2022-02-02T18:21:54.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/281: creat d3/d27/f66 x:0 0 0 2022-02-02T18:21:54.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/282: truncate d3/d5/d56/d2f/f4c 503354 0 2022-02-02T18:21:54.142 INFO:tasks.workunit.client.1.smithi159.stdout:6/185: dwrite df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:21:54.142 INFO:tasks.workunit.client.1.smithi159.stdout:7/283: unlink d3/d6/l25 0 2022-02-02T18:21:54.142 INFO:tasks.workunit.client.1.smithi159.stdout:6/186: mknod df/d35/d2a/d2f/c3d 0 2022-02-02T18:21:54.142 INFO:tasks.workunit.client.1.smithi159.stdout:6/187: write df/f1b [105932,116125] 0 2022-02-02T18:21:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:6/188: stat df/l1d 0 2022-02-02T18:21:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/284: mknod d3/d27/d29/c67 0 2022-02-02T18:21:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/218: dwrite df/d14/f39 [4194304,4194304] 0 2022-02-02T18:21:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/219: chown df/d14/d16/d4a/l50 112217 1 2022-02-02T18:21:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:3/259: dread fc [0,4194304] 0 2022-02-02T18:21:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/189: dread f7 [0,4194304] 0 2022-02-02T18:21:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/190: write f7 [2265534,38714] 0 2022-02-02T18:21:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:3/260: creat dd/d20/d2a/d31/f57 x:0 0 0 2022-02-02T18:21:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:1/220: rmdir df/d2b 39 2022-02-02T18:21:54.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/221: rename df/f1e to df/d14/d16/d4b/f55 0 2022-02-02T18:21:54.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/222: write df/d14/d16/f22 [1008645,34177] 0 2022-02-02T18:21:54.145 INFO:tasks.workunit.client.1.smithi159.stdout:6/191: dwrite df/d35/d2a/d2f/f37 [0,4194304] 0 2022-02-02T18:21:54.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/285: truncate d3/d6/f4d 3642373 0 2022-02-02T18:21:54.146 INFO:tasks.workunit.client.1.smithi159.stdout:6/192: getdents df/d35 0 2022-02-02T18:21:54.146 INFO:tasks.workunit.client.1.smithi159.stdout:6/193: chown df/d35 836065 1 2022-02-02T18:21:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:3/261: rmdir dd 39 2022-02-02T18:21:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/223: getdents df/d21 0 2022-02-02T18:21:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/224: write df/d14/d16/d4a/f44 [938623,130507] 0 2022-02-02T18:21:54.149 INFO:tasks.workunit.client.1.smithi159.stdout:2/274: sync 2022-02-02T18:21:54.149 INFO:tasks.workunit.client.1.smithi159.stdout:5/370: sync 2022-02-02T18:21:54.149 INFO:tasks.workunit.client.1.smithi159.stdout:8/169: sync 2022-02-02T18:21:54.149 INFO:tasks.workunit.client.1.smithi159.stdout:8/170: creat d1/dc/f41 x:0 0 0 2022-02-02T18:21:54.150 INFO:tasks.workunit.client.1.smithi159.stdout:9/174: sync 2022-02-02T18:21:54.150 INFO:tasks.workunit.client.1.smithi159.stdout:4/204: sync 2022-02-02T18:21:54.150 INFO:tasks.workunit.client.1.smithi159.stdout:0/204: sync 2022-02-02T18:21:54.150 INFO:tasks.workunit.client.1.smithi159.stdout:0/205: fsync d1/d19/d3d/f41 0 2022-02-02T18:21:54.151 INFO:tasks.workunit.client.1.smithi159.stdout:7/286: mkdir d3/d27/d29/d68 0 2022-02-02T18:21:54.151 INFO:tasks.workunit.client.1.smithi159.stdout:2/275: dread da/d1c/d29/f33 [0,4194304] 0 2022-02-02T18:21:54.151 INFO:tasks.workunit.client.1.smithi159.stdout:8/171: link d1/f28 d1/dd/d2c/f42 0 2022-02-02T18:21:54.152 INFO:tasks.workunit.client.1.smithi159.stdout:9/175: symlink d4/d19/d1c/d1f/l35 0 2022-02-02T18:21:54.152 INFO:tasks.workunit.client.1.smithi159.stdout:4/205: mknod d0/d8/d14/d33/c4a 0 2022-02-02T18:21:54.152 INFO:tasks.workunit.client.1.smithi159.stdout:4/206: chown d0/d8/d24/l3f 216055 1 2022-02-02T18:21:54.153 INFO:tasks.workunit.client.1.smithi159.stdout:0/206: mkdir d1/dd/d4b 0 2022-02-02T18:21:54.153 INFO:tasks.workunit.client.1.smithi159.stdout:7/287: creat d3/d27/d29/d5e/f69 x:0 0 0 2022-02-02T18:21:54.155 INFO:tasks.workunit.client.1.smithi159.stdout:5/371: rename l2 to d9/d24/d37/l75 0 2022-02-02T18:21:54.155 INFO:tasks.workunit.client.1.smithi159.stdout:2/276: creat da/d1c/f5b x:0 0 0 2022-02-02T18:21:54.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/172: mknod d1/dc/d35/c43 0 2022-02-02T18:21:54.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/173: stat d1/dc/c3b 0 2022-02-02T18:21:54.157 INFO:tasks.workunit.client.1.smithi159.stdout:9/176: creat d4/d19/f36 x:0 0 0 2022-02-02T18:21:54.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/207: creat d1/d11/d38/f4c x:0 0 0 2022-02-02T18:21:54.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/208: readlink d1/d11/d1d/l1f 0 2022-02-02T18:21:54.159 INFO:tasks.workunit.client.1.smithi159.stdout:5/372: truncate f7 4996033 0 2022-02-02T18:21:54.161 INFO:tasks.workunit.client.1.smithi159.stdout:2/277: creat da/d1c/d29/d3f/f5c x:0 0 0 2022-02-02T18:21:54.163 INFO:tasks.workunit.client.1.smithi159.stdout:8/174: mknod d1/dd/d2c/c44 0 2022-02-02T18:21:54.165 INFO:tasks.workunit.client.1.smithi159.stdout:9/177: mknod d4/d19/d1c/d21/c37 0 2022-02-02T18:21:54.167 INFO:tasks.workunit.client.1.smithi159.stdout:0/209: creat d1/d11/d38/d42/f4d x:0 0 0 2022-02-02T18:21:54.168 INFO:tasks.workunit.client.1.smithi159.stdout:5/373: truncate d9/d24/f2d 4039324 0 2022-02-02T18:21:54.168 INFO:tasks.workunit.client.1.smithi159.stdout:5/374: chown d9/d2e/f70 163241310 1 2022-02-02T18:21:54.168 INFO:tasks.workunit.client.1.smithi159.stdout:5/375: readlink d9/d24/l31 0 2022-02-02T18:21:54.169 INFO:tasks.workunit.client.1.smithi159.stdout:5/376: chown d9/d24/d38/d3c/d61 47247715 1 2022-02-02T18:21:54.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/278: unlink da/d1c/d29/l3d 0 2022-02-02T18:21:54.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:53 smithi159 conmon[35668]: cluster 2022-02-02T18:21:52.831855+0000 mgr.smithi096.shfutl (mgr.14162) 285 : cluster 2022-02-02T18:21:54.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:53 smithi159 conmon[35668]: [DBG] pgmap v230: 65 pgs: 65 active+clean; 510 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 29 MiB/s wr, 252 op/s 2022-02-02T18:21:54.172 INFO:tasks.workunit.client.1.smithi159.stdout:8/175: link d1/d26/f2d d1/dc/d35/f45 0 2022-02-02T18:21:54.173 INFO:tasks.workunit.client.1.smithi159.stdout:8/176: fdatasync d1/dd/f29 0 2022-02-02T18:21:54.178 INFO:tasks.workunit.client.1.smithi159.stdout:0/210: link d1/d19/f25 d1/d11/d1d/d34/f4e 0 2022-02-02T18:21:54.178 INFO:tasks.workunit.client.1.smithi159.stdout:0/211: chown d1/d19 9505773 1 2022-02-02T18:21:54.179 INFO:tasks.workunit.client.1.smithi159.stdout:5/377: truncate d9/d24/f16 3411275 0 2022-02-02T18:21:54.179 INFO:tasks.workunit.client.1.smithi159.stdout:5/378: truncate d9/d24/d4a/d52/f74 528650 0 2022-02-02T18:21:54.179 INFO:tasks.workunit.client.1.smithi159.stdout:8/177: creat d1/dc/d35/f46 x:0 0 0 2022-02-02T18:21:54.180 INFO:tasks.workunit.client.1.smithi159.stdout:2/279: truncate da/d1c/d29/d3f/f51 3409836 0 2022-02-02T18:21:54.181 INFO:tasks.workunit.client.1.smithi159.stdout:2/280: readlink da/d40/le 0 2022-02-02T18:21:54.181 INFO:tasks.workunit.client.1.smithi159.stdout:8/178: read d1/dd/d2c/f42 [3722468,130233] 0 2022-02-02T18:21:54.181 INFO:tasks.workunit.client.1.smithi159.stdout:3/262: dwrite dd/d20/d2a/d31/f42 [4194304,4194304] 0 2022-02-02T18:21:54.184 INFO:tasks.workunit.client.1.smithi159.stdout:3/263: getdents dd/d20 0 2022-02-02T18:21:54.184 INFO:tasks.workunit.client.1.smithi159.stdout:3/264: chown dd/d19/f2b 1479742 1 2022-02-02T18:21:54.185 INFO:tasks.workunit.client.1.smithi159.stdout:3/265: truncate dd/d20/d2a/d3a/f45 418743 0 2022-02-02T18:21:54.195 INFO:tasks.workunit.client.1.smithi159.stdout:3/266: write dd/d19/d35/f4c [176782,88037] 0 2022-02-02T18:21:54.197 INFO:tasks.workunit.client.1.smithi159.stdout:8/179: dread d1/f28 [0,4194304] 0 2022-02-02T18:21:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:3/267: rename dd/d20/d2a/d31/f42 to dd/d19/d38/d3f/d52/f58 0 2022-02-02T18:21:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:7/288: dwrite d3/d27/d29/d5e/f69 [0,4194304] 0 2022-02-02T18:21:54.202 INFO:tasks.workunit.client.1.smithi159.stdout:1/225: dwrite df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:21:54.202 INFO:tasks.workunit.client.1.smithi159.stdout:2/281: dread da/d1c/d29/f2c [0,4194304] 0 2022-02-02T18:21:54.205 INFO:tasks.workunit.client.1.smithi159.stdout:7/289: rmdir d3/d2a/d5d 0 2022-02-02T18:21:54.209 INFO:tasks.workunit.client.1.smithi159.stdout:4/207: dwrite d0/d8/d14/f23 [0,4194304] 0 2022-02-02T18:21:54.211 INFO:tasks.workunit.client.1.smithi159.stdout:0/212: dwrite d1/d19/f29 [0,4194304] 0 2022-02-02T18:21:54.212 INFO:tasks.workunit.client.1.smithi159.stdout:0/213: creat d1/dd/f4f x:0 0 0 2022-02-02T18:21:54.212 INFO:tasks.workunit.client.1.smithi159.stdout:0/214: creat d1/d11/d38/d42/f50 x:0 0 0 2022-02-02T18:21:54.212 INFO:tasks.workunit.client.1.smithi159.stdout:3/268: creat dd/d19/d35/f59 x:0 0 0 2022-02-02T18:21:54.213 INFO:tasks.workunit.client.1.smithi159.stdout:2/282: link da/d40/le da/d1c/d47/l5d 0 2022-02-02T18:21:54.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/290: write d3/d5/f45 [860027,108168] 0 2022-02-02T18:21:54.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/291: creat d3/d27/d29/f6a x:0 0 0 2022-02-02T18:21:54.214 INFO:tasks.workunit.client.1.smithi159.stdout:9/178: dwrite d4/f17 [0,4194304] 0 2022-02-02T18:21:54.214 INFO:tasks.workunit.client.1.smithi159.stdout:6/194: dwrite df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:21:54.215 INFO:tasks.workunit.client.1.smithi159.stdout:6/195: fdatasync df/d35/d2a/f2d 0 2022-02-02T18:21:54.215 INFO:tasks.workunit.client.1.smithi159.stdout:6/196: chown df/d35/d2a/d2f 1901433901 1 2022-02-02T18:21:54.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/379: dwrite d9/d2e/d63/f6b [0,4194304] 0 2022-02-02T18:21:54.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/380: fsync d9/d24/d38/f64 0 2022-02-02T18:21:54.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/180: getdents d1/dd/d31 0 2022-02-02T18:21:54.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/181: readlink d1/l22 0 2022-02-02T18:21:54.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/182: write d1/dd/d2c/f42 [2208631,80239] 0 2022-02-02T18:21:54.224 INFO:tasks.workunit.client.1.smithi159.stdout:4/208: mkdir d0/d8/d14/d36/d4b 0 2022-02-02T18:21:54.225 INFO:tasks.workunit.client.1.smithi159.stdout:1/226: dwrite df/d2b/f2e [0,4194304] 0 2022-02-02T18:21:54.234 INFO:tasks.workunit.client.1.smithi159.stdout:0/215: creat d1/d11/d38/d42/d47/f51 x:0 0 0 2022-02-02T18:21:54.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/269: creat dd/d19/d35/d53/f5a x:0 0 0 2022-02-02T18:21:54.241 INFO:tasks.workunit.client.1.smithi159.stdout:2/283: rename da/d1c/l36 to da/d1c/d42/l5e 0 2022-02-02T18:21:54.241 INFO:tasks.workunit.client.1.smithi159.stdout:6/197: rename df to df/d35/d2a/d2f/d3e 22 2022-02-02T18:21:54.241 INFO:tasks.workunit.client.1.smithi159.stdout:2/284: read - da/d1c/d42/d45/f58 zero size 2022-02-02T18:21:54.242 INFO:tasks.workunit.client.1.smithi159.stdout:2/285: write da/d40/f1d [997073,28277] 0 2022-02-02T18:21:54.242 INFO:tasks.workunit.client.1.smithi159.stdout:7/292: mkdir d3/d27/d29/d6b 0 2022-02-02T18:21:54.246 INFO:tasks.workunit.client.1.smithi159.stdout:5/381: mknod d9/d2e/c76 0 2022-02-02T18:21:54.246 INFO:tasks.workunit.client.1.smithi159.stdout:5/382: creat d9/f77 x:0 0 0 2022-02-02T18:21:54.248 INFO:tasks.workunit.client.1.smithi159.stdout:8/183: fdatasync d1/f17 0 2022-02-02T18:21:54.248 INFO:tasks.workunit.client.1.smithi159.stdout:8/184: chown d1/dd/f16 646187 1 2022-02-02T18:21:54.249 INFO:tasks.workunit.client.1.smithi159.stdout:4/209: mknod d0/d8/d41/c4c 0 2022-02-02T18:21:54.249 INFO:tasks.workunit.client.1.smithi159.stdout:4/210: truncate d0/f21 307979 0 2022-02-02T18:21:54.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/227: rmdir df/d14/d16/d4a 39 2022-02-02T18:21:54.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/228: write df/d14/d16/d4b/f52 [629838,95897] 0 2022-02-02T18:21:54.255 INFO:tasks.workunit.client.1.smithi159.stdout:1/229: dread df/d14/d16/d4a/f46 [0,4194304] 0 2022-02-02T18:21:54.255 INFO:tasks.workunit.client.1.smithi159.stdout:3/270: rmdir dd/d20/d2a/d3a 39 2022-02-02T18:21:54.256 INFO:tasks.workunit.client.1.smithi159.stdout:6/198: mkdir df/d35/d2a/d3f 0 2022-02-02T18:21:54.258 INFO:tasks.workunit.client.1.smithi159.stdout:2/286: rmdir da/d1c/d29/d3f/d55 0 2022-02-02T18:21:54.260 INFO:tasks.workunit.client.1.smithi159.stdout:7/293: link d3/d2a/d2c/c49 d3/d27/c6c 0 2022-02-02T18:21:54.261 INFO:tasks.workunit.client.1.smithi159.stdout:9/179: getdents d4 0 2022-02-02T18:21:54.264 INFO:tasks.workunit.client.1.smithi159.stdout:4/211: creat d0/d8/d41/f4d x:0 0 0 2022-02-02T18:21:54.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/216: link d1/fc d1/d11/d1d/f52 0 2022-02-02T18:21:54.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/217: unlink d1/d11/f37 0 2022-02-02T18:21:54.272 INFO:tasks.workunit.client.1.smithi159.stdout:6/199: mknod df/c40 0 2022-02-02T18:21:54.273 INFO:tasks.workunit.client.1.smithi159.stdout:2/287: rename f1 to da/d1c/d47/d54/f5f 0 2022-02-02T18:21:54.275 INFO:tasks.workunit.client.1.smithi159.stdout:5/383: dwrite d9/d24/d37/d23/f3f [4194304,4194304] 0 2022-02-02T18:21:54.276 INFO:tasks.workunit.client.1.smithi159.stdout:8/185: dread d1/dd/d31/f3f [0,4194304] 0 2022-02-02T18:21:54.283 INFO:tasks.workunit.client.1.smithi159.stdout:9/180: rename d4/f13 to d4/d19/d1c/d21/f38 0 2022-02-02T18:21:54.288 INFO:tasks.workunit.client.1.smithi159.stdout:6/200: link df/d35/d2a/c2b df/c41 0 2022-02-02T18:21:54.288 INFO:tasks.workunit.client.1.smithi159.stdout:6/201: stat df/f15 0 2022-02-02T18:21:54.288 INFO:tasks.workunit.client.1.smithi159.stdout:6/202: chown f1 3 1 2022-02-02T18:21:54.289 INFO:tasks.workunit.client.1.smithi159.stdout:6/203: dread - df/d35/d2a/f3b zero size 2022-02-02T18:21:54.289 INFO:tasks.workunit.client.1.smithi159.stdout:6/204: chown df/c29 56064470 1 2022-02-02T18:21:54.292 INFO:tasks.workunit.client.1.smithi159.stdout:0/218: rename f0 to d1/d11/d38/f53 0 2022-02-02T18:21:54.294 INFO:tasks.workunit.client.1.smithi159.stdout:3/271: dwrite dd/d19/d35/f4f [0,4194304] 0 2022-02-02T18:21:54.294 INFO:tasks.workunit.client.1.smithi159.stdout:1/230: dread df/d14/d16/f1f [0,4194304] 0 2022-02-02T18:21:54.294 INFO:tasks.workunit.client.1.smithi159.stdout:3/272: fsync dd/d19/d35/f59 0 2022-02-02T18:21:54.295 INFO:tasks.workunit.client.1.smithi159.stdout:6/205: dread f1 [4194304,4194304] 0 2022-02-02T18:21:54.295 INFO:tasks.workunit.client.1.smithi159.stdout:0/219: link d1/d11/f35 d1/dd/f54 0 2022-02-02T18:21:54.296 INFO:tasks.workunit.client.1.smithi159.stdout:2/288: dread da/d1c/d29/f2a [0,4194304] 0 2022-02-02T18:21:54.298 INFO:tasks.workunit.client.1.smithi159.stdout:1/231: link df/d14/c2f df/d14/d16/c56 0 2022-02-02T18:21:54.301 INFO:tasks.workunit.client.1.smithi159.stdout:3/273: creat dd/d19/d38/d3f/d52/f5b x:0 0 0 2022-02-02T18:21:54.301 INFO:tasks.workunit.client.1.smithi159.stdout:6/206: unlink df/f1a 0 2022-02-02T18:21:54.302 INFO:tasks.workunit.client.1.smithi159.stdout:6/207: truncate df/f15 837956 0 2022-02-02T18:21:54.302 INFO:tasks.workunit.client.1.smithi159.stdout:0/220: mknod d1/d19/d3d/c55 0 2022-02-02T18:21:54.306 INFO:tasks.workunit.client.1.smithi159.stdout:2/289: symlink da/d30/d3e/l60 0 2022-02-02T18:21:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:53 smithi096 conmon[32067]: cluster 2022-02-02T18:21:52.831855+0000 mgr.smithi096.shfutl 2022-02-02T18:21:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:53 smithi096 conmon[32067]: (mgr.14162) 285 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 510 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 29 MiB/s wr, 252 op/s 2022-02-02T18:21:54.308 INFO:tasks.workunit.client.1.smithi159.stdout:1/232: creat df/d14/f57 x:0 0 0 2022-02-02T18:21:54.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/212: dwrite d0/d8/d14/d33/f35 [0,4194304] 0 2022-02-02T18:21:54.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/213: write d0/d8/f1c [4798313,59112] 0 2022-02-02T18:21:54.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/214: getdents d0/d8/d14/d36/d4b 0 2022-02-02T18:21:54.309 INFO:tasks.workunit.client.1.smithi159.stdout:0/221: truncate d1/d11/d38/d42/d47/f48 4957369 0 2022-02-02T18:21:54.310 INFO:tasks.workunit.client.1.smithi159.stdout:2/290: write da/f16 [1926306,111279] 0 2022-02-02T18:21:54.311 INFO:tasks.workunit.client.1.smithi159.stdout:4/215: rename d0/f21 to d0/d8/d14/d33/d47/f4e 0 2022-02-02T18:21:54.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/222: unlink d1/d19/f43 0 2022-02-02T18:21:54.313 INFO:tasks.workunit.client.1.smithi159.stdout:0/223: write d1/d19/f49 [3508265,39123] 0 2022-02-02T18:21:54.314 INFO:tasks.workunit.client.1.smithi159.stdout:2/291: mkdir da/d40/d61 0 2022-02-02T18:21:54.315 INFO:tasks.workunit.client.1.smithi159.stdout:4/216: unlink d0/c9 0 2022-02-02T18:21:54.318 INFO:tasks.workunit.client.1.smithi159.stdout:2/292: link da/d30/c4c da/d1c/c62 0 2022-02-02T18:21:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:4/217: rmdir d0/d8/d24/d3a 39 2022-02-02T18:21:54.322 INFO:tasks.workunit.client.1.smithi159.stdout:2/293: write da/d30/f34 [292566,5216] 0 2022-02-02T18:21:54.324 INFO:tasks.workunit.client.1.smithi159.stdout:1/233: dread df/d14/d16/f1f [0,4194304] 0 2022-02-02T18:21:54.324 INFO:tasks.workunit.client.1.smithi159.stdout:1/234: readlink df/l3c 0 2022-02-02T18:21:54.326 INFO:tasks.workunit.client.1.smithi159.stdout:4/218: dread d0/f11 [0,4194304] 0 2022-02-02T18:21:54.326 INFO:tasks.workunit.client.1.smithi159.stdout:6/208: dread f6 [0,4194304] 0 2022-02-02T18:21:54.326 INFO:tasks.workunit.client.1.smithi159.stdout:6/209: write df/f2e [2757716,78124] 0 2022-02-02T18:21:54.327 INFO:tasks.workunit.client.1.smithi159.stdout:6/210: fsync df/d35/d2a/f2d 0 2022-02-02T18:21:54.327 INFO:tasks.workunit.client.1.smithi159.stdout:1/235: mknod df/d14/d16/d4a/c58 0 2022-02-02T18:21:54.330 INFO:tasks.workunit.client.1.smithi159.stdout:3/274: dwrite dd/d19/d35/f59 [0,4194304] 0 2022-02-02T18:21:54.331 INFO:tasks.workunit.client.1.smithi159.stdout:3/275: fdatasync dd/f11 0 2022-02-02T18:21:54.331 INFO:tasks.workunit.client.1.smithi159.stdout:1/236: rmdir df/d14/d16/d35 39 2022-02-02T18:21:54.332 INFO:tasks.workunit.client.1.smithi159.stdout:5/384: dwrite d9/fc [0,4194304] 0 2022-02-02T18:21:54.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/181: dwrite d4/f17 [4194304,4194304] 0 2022-02-02T18:21:54.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/182: chown d4/f29 224368 1 2022-02-02T18:21:54.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/294: dwrite d3/d5/f45 [0,4194304] 0 2022-02-02T18:21:54.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/295: chown d3/d27/d29 292875203 1 2022-02-02T18:21:54.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/296: chown d3/d5/d56/d57/f24 596657753 1 2022-02-02T18:21:54.341 INFO:tasks.workunit.client.1.smithi159.stdout:3/276: dread dd/f1f [0,4194304] 0 2022-02-02T18:21:54.345 INFO:tasks.workunit.client.1.smithi159.stdout:0/224: dwrite d1/f3 [0,4194304] 0 2022-02-02T18:21:54.345 INFO:tasks.workunit.client.1.smithi159.stdout:6/211: dwrite df/f18 [0,4194304] 0 2022-02-02T18:21:54.345 INFO:tasks.workunit.client.1.smithi159.stdout:9/183: write d4/d19/f1e [2768748,116660] 0 2022-02-02T18:21:54.357 INFO:tasks.workunit.client.1.smithi159.stdout:1/237: truncate df/d14/d16/f38 3047707 0 2022-02-02T18:21:54.359 INFO:tasks.workunit.client.1.smithi159.stdout:5/385: truncate d9/d2e/f2a 2035135 0 2022-02-02T18:21:54.360 INFO:tasks.workunit.client.1.smithi159.stdout:5/386: stat d9/d24/d37/d23/d68 0 2022-02-02T18:21:54.362 INFO:tasks.workunit.client.1.smithi159.stdout:0/225: dread d1/f3 [4194304,4194304] 0 2022-02-02T18:21:54.363 INFO:tasks.workunit.client.1.smithi159.stdout:0/226: dread - d1/d11/d38/d42/f4d zero size 2022-02-02T18:21:54.363 INFO:tasks.workunit.client.1.smithi159.stdout:7/297: truncate d3/d5/f20 3364428 0 2022-02-02T18:21:54.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/277: creat dd/d19/d38/d3f/f5c x:0 0 0 2022-02-02T18:21:54.365 INFO:tasks.workunit.client.1.smithi159.stdout:6/212: dwrite df/d35/d2a/d2f/f31 [0,4194304] 0 2022-02-02T18:21:54.365 INFO:tasks.workunit.client.1.smithi159.stdout:6/213: fsync df/d35/f36 0 2022-02-02T18:21:54.365 INFO:tasks.workunit.client.1.smithi159.stdout:5/387: dread d9/d24/d37/d23/d68/f69 [0,4194304] 0 2022-02-02T18:21:54.366 INFO:tasks.workunit.client.1.smithi159.stdout:9/184: mknod d4/d19/d1c/c39 0 2022-02-02T18:21:54.366 INFO:tasks.workunit.client.1.smithi159.stdout:0/227: write d1/f8 [460320,15267] 0 2022-02-02T18:21:54.367 INFO:tasks.workunit.client.1.smithi159.stdout:7/298: link d3/d2a/d2c/c49 d3/d6/c6d 0 2022-02-02T18:21:54.367 INFO:tasks.workunit.client.1.smithi159.stdout:7/299: fdatasync d3/d5/d56/d57/fd 0 2022-02-02T18:21:54.368 INFO:tasks.workunit.client.1.smithi159.stdout:3/278: mknod dd/d19/d38/d3f/c5d 0 2022-02-02T18:21:54.369 INFO:tasks.workunit.client.1.smithi159.stdout:3/279: fsync dd/d20/f30 0 2022-02-02T18:21:54.369 INFO:tasks.workunit.client.1.smithi159.stdout:1/238: dread df/d14/f39 [0,4194304] 0 2022-02-02T18:21:54.370 INFO:tasks.workunit.client.1.smithi159.stdout:6/214: rmdir df/d35/d2a 39 2022-02-02T18:21:54.371 INFO:tasks.workunit.client.1.smithi159.stdout:9/185: link d4/c15 d4/d19/d1c/d1f/c3a 0 2022-02-02T18:21:54.376 INFO:tasks.workunit.client.1.smithi159.stdout:0/228: mkdir d1/d11/d38/d42/d56 0 2022-02-02T18:21:54.376 INFO:tasks.workunit.client.1.smithi159.stdout:0/229: creat d1/d11/d1d/d34/f57 x:0 0 0 2022-02-02T18:21:54.382 INFO:tasks.workunit.client.1.smithi159.stdout:3/280: dread dd/d19/d35/f4f [0,4194304] 0 2022-02-02T18:21:54.382 INFO:tasks.workunit.client.1.smithi159.stdout:3/281: fsync fc 0 2022-02-02T18:21:54.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/300: truncate d3/d5/d56/d57/f11 254068 0 2022-02-02T18:21:54.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/301: write d3/d2a/f47 [4871237,44583] 0 2022-02-02T18:21:54.384 INFO:tasks.workunit.client.1.smithi159.stdout:7/302: read - d3/d2a/f55 zero size 2022-02-02T18:21:54.384 INFO:tasks.workunit.client.1.smithi159.stdout:3/282: dread dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:21:54.385 INFO:tasks.workunit.client.1.smithi159.stdout:6/215: rmdir df/d35/d2a 39 2022-02-02T18:21:54.385 INFO:tasks.workunit.client.1.smithi159.stdout:6/216: write df/d35/f34 [823631,14654] 0 2022-02-02T18:21:54.386 INFO:tasks.workunit.client.1.smithi159.stdout:0/230: chown d1/f1c 2027745 1 2022-02-02T18:21:54.387 INFO:tasks.workunit.client.1.smithi159.stdout:0/231: fsync d1/d19/d3d/f45 0 2022-02-02T18:21:54.387 INFO:tasks.workunit.client.1.smithi159.stdout:7/303: stat d3/d27/c6c 0 2022-02-02T18:21:54.388 INFO:tasks.workunit.client.1.smithi159.stdout:9/186: symlink d4/d19/l3b 0 2022-02-02T18:21:54.388 INFO:tasks.workunit.client.1.smithi159.stdout:9/187: creat d4/d19/d1c/d1f/f3c x:0 0 0 2022-02-02T18:21:54.389 INFO:tasks.workunit.client.1.smithi159.stdout:3/283: symlink dd/d20/d2a/d31/l5e 0 2022-02-02T18:21:54.389 INFO:tasks.workunit.client.1.smithi159.stdout:7/304: dread d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:21:54.390 INFO:tasks.workunit.client.1.smithi159.stdout:1/239: rmdir df/d21/d23/d49 39 2022-02-02T18:21:54.391 INFO:tasks.workunit.client.1.smithi159.stdout:0/232: truncate d1/fb 4427353 0 2022-02-02T18:21:54.391 INFO:tasks.workunit.client.1.smithi159.stdout:0/233: dread - d1/d19/f2f zero size 2022-02-02T18:21:54.394 INFO:tasks.workunit.client.1.smithi159.stdout:7/305: write d3/d5/d56/d57/fd [3233607,46186] 0 2022-02-02T18:21:54.395 INFO:tasks.workunit.client.1.smithi159.stdout:7/306: read - d3/d27/d29/f61 zero size 2022-02-02T18:21:54.396 INFO:tasks.workunit.client.1.smithi159.stdout:9/188: mknod d4/d19/c3d 0 2022-02-02T18:21:54.399 INFO:tasks.workunit.client.1.smithi159.stdout:3/284: mknod dd/d20/d2a/d3a/c5f 0 2022-02-02T18:21:54.399 INFO:tasks.workunit.client.1.smithi159.stdout:3/285: chown dd/d19/f23 1216 1 2022-02-02T18:21:54.401 INFO:tasks.workunit.client.1.smithi159.stdout:1/240: creat df/d14/d16/d4a/f59 x:0 0 0 2022-02-02T18:21:54.407 INFO:tasks.workunit.client.1.smithi159.stdout:7/307: dread d3/d5/d56/d57/f46 [0,4194304] 0 2022-02-02T18:21:54.410 INFO:tasks.workunit.client.1.smithi159.stdout:1/241: dread f4 [0,4194304] 0 2022-02-02T18:21:54.419 INFO:tasks.workunit.client.1.smithi159.stdout:7/308: dread d3/fb [0,4194304] 0 2022-02-02T18:21:54.421 INFO:tasks.workunit.client.1.smithi159.stdout:9/189: dwrite d4/d19/f36 [0,4194304] 0 2022-02-02T18:21:54.421 INFO:tasks.workunit.client.1.smithi159.stdout:9/190: creat d4/d19/f3e x:0 0 0 2022-02-02T18:21:54.429 INFO:tasks.workunit.client.1.smithi159.stdout:1/242: dread df/d21/d23/f29 [4194304,4194304] 0 2022-02-02T18:21:54.432 INFO:tasks.workunit.client.1.smithi159.stdout:1/243: rename df/d14/f33 to df/d14/f5a 0 2022-02-02T18:21:54.434 INFO:tasks.workunit.client.1.smithi159.stdout:0/234: dwrite d1/d19/f39 [0,4194304] 0 2022-02-02T18:21:54.434 INFO:tasks.workunit.client.1.smithi159.stdout:0/235: chown d1/d19/d3d 1 1 2022-02-02T18:21:54.435 INFO:tasks.workunit.client.1.smithi159.stdout:3/286: dwrite dd/d19/d35/f59 [0,4194304] 0 2022-02-02T18:21:54.439 INFO:tasks.workunit.client.1.smithi159.stdout:1/244: rename df/d2b to df/d14/d16/d4b/d5b 0 2022-02-02T18:21:54.440 INFO:tasks.workunit.client.1.smithi159.stdout:3/287: dread dd/d19/f46 [0,4194304] 0 2022-02-02T18:21:54.442 INFO:tasks.workunit.client.1.smithi159.stdout:1/245: creat df/d21/f5c x:0 0 0 2022-02-02T18:21:54.456 INFO:tasks.workunit.client.1.smithi159.stdout:7/309: dwrite d3/d27/d29/f6a [0,4194304] 0 2022-02-02T18:21:54.456 INFO:tasks.workunit.client.1.smithi159.stdout:7/310: dread - d3/f4e zero size 2022-02-02T18:21:54.456 INFO:tasks.workunit.client.1.smithi159.stdout:7/311: write d3/d27/f3b [4228245,55126] 0 2022-02-02T18:21:54.457 INFO:tasks.workunit.client.1.smithi159.stdout:7/312: stat d3/d2a/f22 0 2022-02-02T18:21:54.457 INFO:tasks.workunit.client.1.smithi159.stdout:9/191: dwrite d4/f17 [8388608,4194304] 0 2022-02-02T18:21:54.458 INFO:tasks.workunit.client.1.smithi159.stdout:0/236: dwrite d1/f1c [0,4194304] 0 2022-02-02T18:21:54.458 INFO:tasks.workunit.client.1.smithi159.stdout:0/237: chown d1/d19/f25 3066 1 2022-02-02T18:21:54.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/288: mkdir dd/d20/d60 0 2022-02-02T18:21:54.540 INFO:tasks.workunit.client.1.smithi159.stdout:1/246: rename df/d14/d16/f22 to df/d21/d23/d49/f5d 0 2022-02-02T18:21:54.541 INFO:tasks.workunit.client.1.smithi159.stdout:1/247: write df/d14/d16/f45 [482647,37356] 0 2022-02-02T18:21:54.541 INFO:tasks.workunit.client.1.smithi159.stdout:1/248: truncate df/d21/f5c 1044577 0 2022-02-02T18:21:54.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/249: readlink df/d14/d16/l20 0 2022-02-02T18:21:54.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/250: write df/d21/f5c [352098,103587] 0 2022-02-02T18:21:54.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/251: fsync df/d14/d16/d4b/f55 0 2022-02-02T18:21:54.571 INFO:tasks.workunit.client.1.smithi159.stdout:9/192: rmdir d4/d19/d1c/d21 39 2022-02-02T18:21:54.686 INFO:tasks.workunit.client.1.smithi159.stdout:0/238: mknod d1/dd/c58 0 2022-02-02T18:21:54.686 INFO:tasks.workunit.client.1.smithi159.stdout:0/239: fsync d1/d19/f49 0 2022-02-02T18:21:54.687 INFO:tasks.workunit.client.1.smithi159.stdout:3/289: mknod dd/d19/c61 0 2022-02-02T18:21:54.688 INFO:tasks.workunit.client.1.smithi159.stdout:0/240: write d1/f3c [200830,26385] 0 2022-02-02T18:21:54.690 INFO:tasks.workunit.client.1.smithi159.stdout:0/241: read d1/d19/f29 [497480,58354] 0 2022-02-02T18:21:54.703 INFO:tasks.workunit.client.1.smithi159.stdout:1/252: getdents df/d14/d16/d35 0 2022-02-02T18:21:54.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/313: getdents d3/d27 0 2022-02-02T18:21:54.808 INFO:tasks.workunit.client.1.smithi159.stdout:0/242: rename d1/d19/d3d/c55 to d1/d19/d3d/c59 0 2022-02-02T18:21:54.809 INFO:tasks.workunit.client.1.smithi159.stdout:0/243: readlink d1/dd/l3b 0 2022-02-02T18:21:54.809 INFO:tasks.workunit.client.1.smithi159.stdout:0/244: write d1/d11/d38/d42/f4d [575323,129503] 0 2022-02-02T18:21:54.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/253: truncate df/d21/d23/f29 739893 0 2022-02-02T18:21:54.811 INFO:tasks.workunit.client.1.smithi159.stdout:7/314: rename d3/d27/d29/f6a to d3/d27/d29/d6b/f6e 0 2022-02-02T18:21:54.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/315: dread d3/d5/d56/f32 [0,4194304] 0 2022-02-02T18:21:55.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/290: symlink dd/l62 0 2022-02-02T18:21:55.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/291: rename dd to dd/d19/d38/d63 22 2022-02-02T18:21:55.121 INFO:tasks.workunit.client.1.smithi159.stdout:0/245: creat d1/f5a x:0 0 0 2022-02-02T18:21:55.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/246: readlink d1/dd/lf 0 2022-02-02T18:21:55.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/247: truncate d1/f10 4665793 0 2022-02-02T18:21:55.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/248: creat d1/d19/f5b x:0 0 0 2022-02-02T18:21:55.123 INFO:tasks.workunit.client.1.smithi159.stdout:1/254: unlink df/d14/d16/f1f 0 2022-02-02T18:21:55.123 INFO:tasks.workunit.client.1.smithi159.stdout:1/255: chown df/d14/f57 45011436 1 2022-02-02T18:21:55.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/316: mkdir d3/d27/d6f 0 2022-02-02T18:21:55.125 INFO:tasks.workunit.client.1.smithi159.stdout:3/292: dread dd/f28 [0,4194304] 0 2022-02-02T18:21:55.126 INFO:tasks.workunit.client.1.smithi159.stdout:0/249: mknod d1/d11/d38/c5c 0 2022-02-02T18:21:55.126 INFO:tasks.workunit.client.1.smithi159.stdout:3/293: write dd/d19/d38/f48 [1371550,63894] 0 2022-02-02T18:21:55.127 INFO:tasks.workunit.client.1.smithi159.stdout:1/256: symlink df/d14/d16/d4b/d5b/l5e 0 2022-02-02T18:21:55.269 INFO:tasks.workunit.client.1.smithi159.stdout:6/217: sync 2022-02-02T18:21:55.269 INFO:tasks.workunit.client.1.smithi159.stdout:2/294: sync 2022-02-02T18:21:55.270 INFO:tasks.workunit.client.1.smithi159.stdout:8/186: sync 2022-02-02T18:21:55.270 INFO:tasks.workunit.client.1.smithi159.stdout:4/219: sync 2022-02-02T18:21:55.271 INFO:tasks.workunit.client.1.smithi159.stdout:9/193: sync 2022-02-02T18:21:55.271 INFO:tasks.workunit.client.1.smithi159.stdout:9/194: chown d4/d19/c3d 31250800 1 2022-02-02T18:21:55.272 INFO:tasks.workunit.client.1.smithi159.stdout:4/220: fdatasync d0/d8/d14/d33/d47/f4e 0 2022-02-02T18:21:55.272 INFO:tasks.workunit.client.1.smithi159.stdout:5/388: sync 2022-02-02T18:21:55.272 INFO:tasks.workunit.client.1.smithi159.stdout:5/389: chown d9/l17 170058 1 2022-02-02T18:21:55.273 INFO:tasks.workunit.client.1.smithi159.stdout:9/195: creat d4/d19/d1c/d1f/f3f x:0 0 0 2022-02-02T18:21:55.274 INFO:tasks.workunit.client.1.smithi159.stdout:5/390: write d9/fc [3615209,121083] 0 2022-02-02T18:21:55.274 INFO:tasks.workunit.client.1.smithi159.stdout:5/391: read d9/f47 [94689,15508] 0 2022-02-02T18:21:55.274 INFO:tasks.workunit.client.1.smithi159.stdout:5/392: stat d9/d24/d37/d23/d68/f69 0 2022-02-02T18:21:55.288 INFO:tasks.workunit.client.1.smithi159.stdout:2/295: dwrite da/d1c/f32 [0,4194304] 0 2022-02-02T18:21:55.288 INFO:tasks.workunit.client.1.smithi159.stdout:2/296: read - da/d1c/d29/f4b zero size 2022-02-02T18:21:55.511 INFO:tasks.workunit.client.1.smithi159.stdout:7/317: symlink d3/d27/l70 0 2022-02-02T18:21:55.512 INFO:tasks.workunit.client.1.smithi159.stdout:0/250: getdents d1/d11 0 2022-02-02T18:21:55.512 INFO:tasks.workunit.client.1.smithi159.stdout:1/257: symlink df/d21/d23/l5f 0 2022-02-02T18:21:55.516 INFO:tasks.workunit.client.1.smithi159.stdout:6/218: truncate df/d35/f38 1386301 0 2022-02-02T18:21:55.518 INFO:tasks.workunit.client.1.smithi159.stdout:8/187: symlink d1/dc/d35/l47 0 2022-02-02T18:21:55.518 INFO:tasks.workunit.client.1.smithi159.stdout:8/188: chown d1/fa 161816 1 2022-02-02T18:21:55.519 INFO:tasks.workunit.client.1.smithi159.stdout:8/189: fdatasync d1/dd/d2c/f42 0 2022-02-02T18:21:55.519 INFO:tasks.workunit.client.1.smithi159.stdout:4/221: truncate d0/d8/d15/f2e 1352406 0 2022-02-02T18:21:55.523 INFO:tasks.workunit.client.1.smithi159.stdout:9/196: rename d4/d19/d1c/d21/f38 to d4/d2a/f40 0 2022-02-02T18:21:55.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/190: dread d1/fa [0,4194304] 0 2022-02-02T18:21:55.527 INFO:tasks.workunit.client.1.smithi159.stdout:2/297: link da/d1c/d29/l2d da/d1c/d29/l63 0 2022-02-02T18:21:55.528 INFO:tasks.workunit.client.1.smithi159.stdout:7/318: stat d3/l41 0 2022-02-02T18:21:55.528 INFO:tasks.workunit.client.1.smithi159.stdout:7/319: creat d3/d27/d29/f71 x:0 0 0 2022-02-02T18:21:55.529 INFO:tasks.workunit.client.1.smithi159.stdout:0/251: link d1/dd/c58 d1/d11/d1d/c5d 0 2022-02-02T18:21:55.530 INFO:tasks.workunit.client.1.smithi159.stdout:2/298: write da/d40/f1d [3108331,34844] 0 2022-02-02T18:21:55.530 INFO:tasks.workunit.client.1.smithi159.stdout:4/222: mkdir d0/d8/d24/d4f 0 2022-02-02T18:21:55.531 INFO:tasks.workunit.client.1.smithi159.stdout:0/252: dread d1/fe [0,4194304] 0 2022-02-02T18:21:55.532 INFO:tasks.workunit.client.1.smithi159.stdout:9/197: mkdir d4/d19/d1c/d21/d41 0 2022-02-02T18:21:55.532 INFO:tasks.workunit.client.1.smithi159.stdout:4/223: write d0/f25 [4193614,128423] 0 2022-02-02T18:21:55.533 INFO:tasks.workunit.client.1.smithi159.stdout:6/219: rename df/d35/d20 to df/d35/d2a/d3f/d42 0 2022-02-02T18:21:55.533 INFO:tasks.workunit.client.1.smithi159.stdout:6/220: write df/f1b [530270,22171] 0 2022-02-02T18:21:55.534 INFO:tasks.workunit.client.1.smithi159.stdout:6/221: fsync df/d35/f27 0 2022-02-02T18:21:55.534 INFO:tasks.workunit.client.1.smithi159.stdout:1/258: dwrite df/d14/d16/d4a/f59 [0,4194304] 0 2022-02-02T18:21:55.535 INFO:tasks.workunit.client.1.smithi159.stdout:1/259: creat df/d14/d16/f60 x:0 0 0 2022-02-02T18:21:55.535 INFO:tasks.workunit.client.1.smithi159.stdout:8/191: mkdir d1/d26/d48 0 2022-02-02T18:21:55.542 INFO:tasks.workunit.client.1.smithi159.stdout:0/253: truncate d1/d19/f25 3837612 0 2022-02-02T18:21:55.544 INFO:tasks.workunit.client.1.smithi159.stdout:9/198: mkdir d4/d19/d42 0 2022-02-02T18:21:55.545 INFO:tasks.workunit.client.1.smithi159.stdout:4/224: link d0/d8/f10 d0/d8/d14/d33/f50 0 2022-02-02T18:21:55.548 INFO:tasks.workunit.client.1.smithi159.stdout:1/260: creat df/d14/d16/d4b/d5b/f61 x:0 0 0 2022-02-02T18:21:55.549 INFO:tasks.workunit.client.1.smithi159.stdout:1/261: creat df/f62 x:0 0 0 2022-02-02T18:21:55.551 INFO:tasks.workunit.client.1.smithi159.stdout:8/192: mkdir d1/d26/d48/d49 0 2022-02-02T18:21:55.551 INFO:tasks.workunit.client.1.smithi159.stdout:2/299: dwrite da/d1c/d47/f4a [0,4194304] 0 2022-02-02T18:21:55.552 INFO:tasks.workunit.client.1.smithi159.stdout:2/300: truncate da/d1c/f32 4780580 0 2022-02-02T18:21:55.552 INFO:tasks.workunit.client.1.smithi159.stdout:2/301: chown da/d1c/d47/l5d 26327 1 2022-02-02T18:21:55.552 INFO:tasks.workunit.client.1.smithi159.stdout:4/225: rmdir d0/d8/d24/d3a 39 2022-02-02T18:21:55.554 INFO:tasks.workunit.client.1.smithi159.stdout:7/320: rename d3/d52/c5c to d3/d5/d56/c72 0 2022-02-02T18:21:55.554 INFO:tasks.workunit.client.1.smithi159.stdout:9/199: dread d4/d19/d1c/d1f/f26 [0,4194304] 0 2022-02-02T18:21:55.555 INFO:tasks.workunit.client.1.smithi159.stdout:1/262: dread df/d14/f5a [0,4194304] 0 2022-02-02T18:21:55.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/193: mkdir d1/dd/d31/d4a 0 2022-02-02T18:21:55.562 INFO:tasks.workunit.client.1.smithi159.stdout:2/302: dread da/f3b [0,4194304] 0 2022-02-02T18:21:55.563 INFO:tasks.workunit.client.1.smithi159.stdout:2/303: stat da/d1c/d47/c52 0 2022-02-02T18:21:55.563 INFO:tasks.workunit.client.1.smithi159.stdout:6/222: write df/d35/f38 [459502,32110] 0 2022-02-02T18:21:55.564 INFO:tasks.workunit.client.1.smithi159.stdout:4/226: mknod d0/d8/d24/c51 0 2022-02-02T18:21:55.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/321: truncate d3/d27/d29/d6b/f6e 1076850 0 2022-02-02T18:21:55.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/322: creat d3/d27/d29/d5e/f73 x:0 0 0 2022-02-02T18:21:55.566 INFO:tasks.workunit.client.1.smithi159.stdout:9/200: mkdir d4/d19/d42/d43 0 2022-02-02T18:21:55.567 INFO:tasks.workunit.client.1.smithi159.stdout:7/323: read d3/d5/d56/d57/f3f [927136,79830] 0 2022-02-02T18:21:55.567 INFO:tasks.workunit.client.1.smithi159.stdout:4/227: creat d0/d8/d24/d4f/f52 x:0 0 0 2022-02-02T18:21:55.571 INFO:tasks.workunit.client.1.smithi159.stdout:7/324: chown d3/d5/l28 16360084 1 2022-02-02T18:21:55.573 INFO:tasks.workunit.client.1.smithi159.stdout:4/228: creat d0/d8/d14/d33/d47/f53 x:0 0 0 2022-02-02T18:21:55.574 INFO:tasks.workunit.client.1.smithi159.stdout:4/229: write d0/d8/d24/d4f/f52 [897618,105787] 0 2022-02-02T18:21:55.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/263: dwrite df/d14/f57 [0,4194304] 0 2022-02-02T18:21:55.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/264: fsync df/d14/f17 0 2022-02-02T18:21:55.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/265: readlink df/d14/d16/l20 0 2022-02-02T18:21:55.576 INFO:tasks.workunit.client.1.smithi159.stdout:7/325: mkdir d3/d27/d29/d68/d74 0 2022-02-02T18:21:55.576 INFO:tasks.workunit.client.1.smithi159.stdout:4/230: stat d0/d8/c26 0 2022-02-02T18:21:55.577 INFO:tasks.workunit.client.1.smithi159.stdout:4/231: chown d0/d8/d14/d33/f50 55052156 1 2022-02-02T18:21:55.579 INFO:tasks.workunit.client.1.smithi159.stdout:4/232: creat d0/d8/d14/d36/d4b/f54 x:0 0 0 2022-02-02T18:21:55.580 INFO:tasks.workunit.client.1.smithi159.stdout:1/266: write fe [1684683,30474] 0 2022-02-02T18:21:55.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/233: mknod d0/c55 0 2022-02-02T18:21:55.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/234: read - d0/d8/f3c zero size 2022-02-02T18:21:55.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/235: chown d0/ff 7441492 1 2022-02-02T18:21:55.581 INFO:tasks.workunit.client.1.smithi159.stdout:1/267: symlink df/d21/d23/l63 0 2022-02-02T18:21:55.581 INFO:tasks.workunit.client.1.smithi159.stdout:1/268: write df/d14/d16/f38 [3573316,70051] 0 2022-02-02T18:21:55.582 INFO:tasks.workunit.client.1.smithi159.stdout:1/269: write df/d14/d16/d4b/d5b/f61 [427614,91778] 0 2022-02-02T18:21:55.583 INFO:tasks.workunit.client.1.smithi159.stdout:6/223: dread df/f1b [0,4194304] 0 2022-02-02T18:21:55.583 INFO:tasks.workunit.client.1.smithi159.stdout:4/236: mkdir d0/d8/d14/d33/d47/d56 0 2022-02-02T18:21:55.584 INFO:tasks.workunit.client.1.smithi159.stdout:4/237: write d0/d8/d14/d33/d47/f4e [523080,76729] 0 2022-02-02T18:21:55.585 INFO:tasks.workunit.client.1.smithi159.stdout:1/270: mkdir df/d14/d16/d4b/d5b/d64 0 2022-02-02T18:21:55.585 INFO:tasks.workunit.client.1.smithi159.stdout:1/271: stat df/d21/d23/f29 0 2022-02-02T18:21:55.586 INFO:tasks.workunit.client.1.smithi159.stdout:4/238: link d0/d8/d30/f37 d0/d8/d15/f57 0 2022-02-02T18:21:55.586 INFO:tasks.workunit.client.1.smithi159.stdout:9/201: dread d4/fd [0,4194304] 0 2022-02-02T18:21:55.587 INFO:tasks.workunit.client.1.smithi159.stdout:1/272: truncate df/d14/f39 280866 0 2022-02-02T18:21:55.588 INFO:tasks.workunit.client.1.smithi159.stdout:4/239: creat d0/d8/d24/d3a/f58 x:0 0 0 2022-02-02T18:21:55.590 INFO:tasks.workunit.client.1.smithi159.stdout:1/273: link df/d21/d23/l2d df/d21/d23/l65 0 2022-02-02T18:21:55.590 INFO:tasks.workunit.client.1.smithi159.stdout:1/274: creat df/d21/f66 x:0 0 0 2022-02-02T18:21:55.590 INFO:tasks.workunit.client.1.smithi159.stdout:1/275: truncate df/f62 877893 0 2022-02-02T18:21:55.591 INFO:tasks.workunit.client.1.smithi159.stdout:4/240: symlink d0/d8/d14/d33/d47/l59 0 2022-02-02T18:21:55.593 INFO:tasks.workunit.client.1.smithi159.stdout:1/276: link df/d14/d16/l27 df/d21/l67 0 2022-02-02T18:21:55.593 INFO:tasks.workunit.client.1.smithi159.stdout:1/277: chown df/l1c 69 1 2022-02-02T18:21:55.593 INFO:tasks.workunit.client.1.smithi159.stdout:4/241: mkdir d0/d8/d41/d5a 0 2022-02-02T18:21:55.594 INFO:tasks.workunit.client.1.smithi159.stdout:9/202: read d4/d19/f31 [2683887,106280] 0 2022-02-02T18:21:55.594 INFO:tasks.workunit.client.1.smithi159.stdout:9/203: dread - d4/d19/d1c/d1f/f3f zero size 2022-02-02T18:21:55.595 INFO:tasks.workunit.client.1.smithi159.stdout:4/242: creat d0/f5b x:0 0 0 2022-02-02T18:21:55.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/204: truncate d4/fd 6769758 0 2022-02-02T18:21:55.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/205: chown d4/d19/l3b 1 1 2022-02-02T18:21:55.607 INFO:tasks.workunit.client.1.smithi159.stdout:4/243: dread d0/d8/d14/d33/f35 [0,4194304] 0 2022-02-02T18:21:55.607 INFO:tasks.workunit.client.1.smithi159.stdout:4/244: creat d0/d8/d24/d4f/f5c x:0 0 0 2022-02-02T18:21:55.611 INFO:tasks.workunit.client.1.smithi159.stdout:0/254: dwrite d1/d11/d1d/d34/f4e [0,4194304] 0 2022-02-02T18:21:55.612 INFO:tasks.workunit.client.1.smithi159.stdout:0/255: creat d1/d11/d1d/f5e x:0 0 0 2022-02-02T18:21:55.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/326: dwrite d3/d6/f40 [0,4194304] 0 2022-02-02T18:21:55.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/327: chown d3/d5/f45 1010166208 1 2022-02-02T18:21:55.618 INFO:tasks.workunit.client.1.smithi159.stdout:0/256: dread d1/f3c [0,4194304] 0 2022-02-02T18:21:55.620 INFO:tasks.workunit.client.1.smithi159.stdout:8/194: dwrite d1/dc/d35/f45 [0,4194304] 0 2022-02-02T18:21:55.620 INFO:tasks.workunit.client.1.smithi159.stdout:8/195: dread - d1/dd/f2f zero size 2022-02-02T18:21:55.620 INFO:tasks.workunit.client.1.smithi159.stdout:2/304: dwrite da/d1c/d29/d3f/f51 [0,4194304] 0 2022-02-02T18:21:55.621 INFO:tasks.workunit.client.1.smithi159.stdout:8/196: symlink d1/dd/d1a/l4b 0 2022-02-02T18:21:55.621 INFO:tasks.workunit.client.1.smithi159.stdout:8/197: stat d1/dd/f29 0 2022-02-02T18:21:55.623 INFO:tasks.workunit.client.1.smithi159.stdout:2/305: rename da/d40/f1a to da/d1c/d47/f64 0 2022-02-02T18:21:55.623 INFO:tasks.workunit.client.1.smithi159.stdout:2/306: fdatasync da/d1c/f28 0 2022-02-02T18:21:55.624 INFO:tasks.workunit.client.1.smithi159.stdout:6/224: dwrite f3 [0,4194304] 0 2022-02-02T18:21:55.624 INFO:tasks.workunit.client.1.smithi159.stdout:6/225: rename df/d35/d2a to df/d35/d2a/d43 22 2022-02-02T18:21:55.625 INFO:tasks.workunit.client.1.smithi159.stdout:6/226: write df/d35/d2a/d2f/f37 [1521067,73238] 0 2022-02-02T18:21:55.625 INFO:tasks.workunit.client.1.smithi159.stdout:1/278: dwrite df/d14/f17 [0,4194304] 0 2022-02-02T18:21:55.626 INFO:tasks.workunit.client.1.smithi159.stdout:9/206: dwrite d4/d19/f31 [0,4194304] 0 2022-02-02T18:21:55.627 INFO:tasks.workunit.client.1.smithi159.stdout:7/328: write d3/d27/d29/d5e/f69 [1843155,102620] 0 2022-02-02T18:21:55.627 INFO:tasks.workunit.client.1.smithi159.stdout:8/198: read d1/f28 [13707,103597] 0 2022-02-02T18:21:55.628 INFO:tasks.workunit.client.1.smithi159.stdout:2/307: symlink da/d40/d61/l65 0 2022-02-02T18:21:55.629 INFO:tasks.workunit.client.1.smithi159.stdout:8/199: write d1/dd/d31/f3f [667875,57711] 0 2022-02-02T18:21:55.639 INFO:tasks.workunit.client.1.smithi159.stdout:6/227: dread df/f1b [0,4194304] 0 2022-02-02T18:21:55.640 INFO:tasks.workunit.client.1.smithi159.stdout:1/279: mkdir df/d14/d68 0 2022-02-02T18:21:55.640 INFO:tasks.workunit.client.1.smithi159.stdout:2/308: dread da/d30/f34 [0,4194304] 0 2022-02-02T18:21:55.640 INFO:tasks.workunit.client.1.smithi159.stdout:6/228: write f6 [1547194,73274] 0 2022-02-02T18:21:55.644 INFO:tasks.workunit.client.1.smithi159.stdout:8/200: mknod d1/d26/d48/c4c 0 2022-02-02T18:21:55.649 INFO:tasks.workunit.client.1.smithi159.stdout:9/207: dwrite d4/f14 [0,4194304] 0 2022-02-02T18:21:55.649 INFO:tasks.workunit.client.1.smithi159.stdout:9/208: chown d4/f17 3 1 2022-02-02T18:21:55.649 INFO:tasks.workunit.client.1.smithi159.stdout:9/209: write d4/d19/f3e [775492,45435] 0 2022-02-02T18:21:55.650 INFO:tasks.workunit.client.1.smithi159.stdout:1/280: mkdir df/d21/d23/d49/d69 0 2022-02-02T18:21:55.650 INFO:tasks.workunit.client.1.smithi159.stdout:0/257: dwrite d1/d11/d38/d42/f50 [0,4194304] 0 2022-02-02T18:21:55.651 INFO:tasks.workunit.client.1.smithi159.stdout:6/229: rename df/f30 to df/d35/d2a/d3f/f44 0 2022-02-02T18:21:55.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/230: readlink df/l1d 0 2022-02-02T18:21:55.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/201: symlink d1/l4d 0 2022-02-02T18:21:55.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/202: write d1/dd/d31/f3f [4836982,126349] 0 2022-02-02T18:21:55.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/203: readlink d1/l6 0 2022-02-02T18:21:55.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/210: rename d4/d19/d1c/d1f/f26 to d4/d19/d1c/f44 0 2022-02-02T18:21:55.660 INFO:tasks.workunit.client.1.smithi159.stdout:6/231: dread f1 [4194304,4194304] 0 2022-02-02T18:21:55.660 INFO:tasks.workunit.client.1.smithi159.stdout:1/281: rmdir df/d14/d16/d4b 39 2022-02-02T18:21:55.665 INFO:tasks.workunit.client.1.smithi159.stdout:2/309: dwrite f9 [0,4194304] 0 2022-02-02T18:21:55.666 INFO:tasks.workunit.client.1.smithi159.stdout:8/204: rename d1/d26/l2b to d1/dd/d31/d4a/l4e 0 2022-02-02T18:21:55.668 INFO:tasks.workunit.client.1.smithi159.stdout:9/211: creat d4/d19/d1c/d21/f45 x:0 0 0 2022-02-02T18:21:55.669 INFO:tasks.workunit.client.1.smithi159.stdout:9/212: fdatasync d4/d19/d1c/f44 0 2022-02-02T18:21:55.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/232: creat df/d35/d2a/d2f/f45 x:0 0 0 2022-02-02T18:21:55.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/233: write df/f14 [1053711,51763] 0 2022-02-02T18:21:55.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/234: creat df/d35/d2a/d2f/f46 x:0 0 0 2022-02-02T18:21:55.671 INFO:tasks.workunit.client.1.smithi159.stdout:0/258: dwrite d1/d19/f5b [0,4194304] 0 2022-02-02T18:21:55.672 INFO:tasks.workunit.client.1.smithi159.stdout:0/259: write d1/f3c [49012,52697] 0 2022-02-02T18:21:55.674 INFO:tasks.workunit.client.1.smithi159.stdout:1/282: mknod df/d14/c6a 0 2022-02-02T18:21:55.675 INFO:tasks.workunit.client.1.smithi159.stdout:2/310: rmdir da/d1c/d25 39 2022-02-02T18:21:55.675 INFO:tasks.workunit.client.1.smithi159.stdout:2/311: read - da/d1c/f1f zero size 2022-02-02T18:21:55.676 INFO:tasks.workunit.client.1.smithi159.stdout:8/205: truncate d1/dd/f16 627918 0 2022-02-02T18:21:55.789 INFO:tasks.workunit.client.1.smithi159.stdout:9/213: mknod d4/d19/d1c/d21/d41/c46 0 2022-02-02T18:21:55.793 INFO:tasks.workunit.client.1.smithi159.stdout:6/235: rmdir df/d35/d2a/d3f/d42 39 2022-02-02T18:21:55.793 INFO:tasks.workunit.client.1.smithi159.stdout:6/236: chown df/d35 43052 1 2022-02-02T18:21:55.794 INFO:tasks.workunit.client.1.smithi159.stdout:6/237: chown df/d35/f36 1210715 1 2022-02-02T18:21:55.796 INFO:tasks.workunit.client.1.smithi159.stdout:0/260: rename d1/dd/l15 to d1/d11/d38/d42/d47/l5f 0 2022-02-02T18:21:55.798 INFO:tasks.workunit.client.1.smithi159.stdout:0/261: write d1/fb [2444573,52190] 0 2022-02-02T18:21:55.798 INFO:tasks.workunit.client.1.smithi159.stdout:0/262: creat d1/dd/f60 x:0 0 0 2022-02-02T18:21:55.798 INFO:tasks.workunit.client.1.smithi159.stdout:1/283: truncate df/d14/d16/d4b/f52 65145 0 2022-02-02T18:21:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:1/284: chown df/c1b 139 1 2022-02-02T18:21:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:1/285: write df/d14/d16/d4a/f46 [1673469,57480] 0 2022-02-02T18:21:55.800 INFO:tasks.workunit.client.1.smithi159.stdout:1/286: write df/d14/d16/d4b/d5b/f61 [723503,93424] 0 2022-02-02T18:21:55.800 INFO:tasks.workunit.client.1.smithi159.stdout:2/312: creat da/d1c/d29/d3f/d5a/f66 x:0 0 0 2022-02-02T18:21:55.801 INFO:tasks.workunit.client.1.smithi159.stdout:1/287: write df/d14/d16/d4a/f46 [1067568,71066] 0 2022-02-02T18:21:55.802 INFO:tasks.workunit.client.1.smithi159.stdout:9/214: symlink d4/d19/d42/l47 0 2022-02-02T18:21:55.808 INFO:tasks.workunit.client.1.smithi159.stdout:0/263: truncate d1/dd/f1a 2250345 0 2022-02-02T18:21:55.808 INFO:tasks.workunit.client.1.smithi159.stdout:0/264: chown d1/d11/f2b 471320 1 2022-02-02T18:21:55.810 INFO:tasks.workunit.client.1.smithi159.stdout:2/313: symlink da/d30/d3e/l67 0 2022-02-02T18:21:55.810 INFO:tasks.workunit.client.1.smithi159.stdout:0/265: write d1/d19/f29 [2500271,12733] 0 2022-02-02T18:21:55.812 INFO:tasks.workunit.client.1.smithi159.stdout:8/206: rename d1/cf to d1/dd/d31/c4f 0 2022-02-02T18:21:55.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/207: write d1/dd/d1a/f32 [357781,11830] 0 2022-02-02T18:21:55.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/208: creat d1/dc/d35/f50 x:0 0 0 2022-02-02T18:21:55.814 INFO:tasks.workunit.client.1.smithi159.stdout:8/209: chown d1/dd/d31/f3f 47483 1 2022-02-02T18:21:55.815 INFO:tasks.workunit.client.1.smithi159.stdout:0/266: mknod d1/d11/d38/d42/c61 0 2022-02-02T18:21:55.821 INFO:tasks.workunit.client.1.smithi159.stdout:8/210: unlink d1/dc/d35/l3a 0 2022-02-02T18:21:55.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/238: dwrite f6 [0,4194304] 0 2022-02-02T18:21:55.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/239: unlink df/f1b 0 2022-02-02T18:21:55.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/240: mkdir df/d35/d2a/d3f/d42/d47 0 2022-02-02T18:21:55.828 INFO:tasks.workunit.client.1.smithi159.stdout:6/241: write df/f2e [3428502,51841] 0 2022-02-02T18:21:55.829 INFO:tasks.workunit.client.1.smithi159.stdout:6/242: creat df/d35/d2a/d3f/f48 x:0 0 0 2022-02-02T18:21:55.829 INFO:tasks.workunit.client.1.smithi159.stdout:6/243: stat df/l28 0 2022-02-02T18:21:55.834 INFO:tasks.workunit.client.1.smithi159.stdout:0/267: dwrite d1/dd/f33 [0,4194304] 0 2022-02-02T18:21:55.838 INFO:tasks.workunit.client.1.smithi159.stdout:0/268: link d1/dd/l27 d1/d11/d1d/l62 0 2022-02-02T18:21:55.840 INFO:tasks.workunit.client.1.smithi159.stdout:0/269: rename d1/d11/d38/d42/f4d to d1/d11/f63 0 2022-02-02T18:21:55.841 INFO:tasks.workunit.client.1.smithi159.stdout:0/270: creat d1/d11/d1d/d34/f64 x:0 0 0 2022-02-02T18:21:55.844 INFO:tasks.workunit.client.1.smithi159.stdout:8/211: dwrite d1/dc/d35/f46 [0,4194304] 0 2022-02-02T18:21:55.845 INFO:tasks.workunit.client.1.smithi159.stdout:0/271: symlink d1/d11/d38/d42/l65 0 2022-02-02T18:21:55.846 INFO:tasks.workunit.client.1.smithi159.stdout:0/272: read - d1/d11/d38/d42/d47/f51 zero size 2022-02-02T18:21:55.846 INFO:tasks.workunit.client.1.smithi159.stdout:0/273: dread - d1/d19/f2f zero size 2022-02-02T18:21:55.849 INFO:tasks.workunit.client.1.smithi159.stdout:8/212: symlink d1/dd/d2c/l51 0 2022-02-02T18:21:55.851 INFO:tasks.workunit.client.1.smithi159.stdout:6/244: truncate df/f2e 1420191 0 2022-02-02T18:21:55.851 INFO:tasks.workunit.client.1.smithi159.stdout:6/245: readlink df/l28 0 2022-02-02T18:21:55.852 INFO:tasks.workunit.client.1.smithi159.stdout:0/274: symlink d1/d19/d3d/l66 0 2022-02-02T18:21:55.853 INFO:tasks.workunit.client.1.smithi159.stdout:8/213: getdents d1/d26/d48 0 2022-02-02T18:21:55.854 INFO:tasks.workunit.client.1.smithi159.stdout:6/246: write f1 [1010192,90275] 0 2022-02-02T18:21:55.855 INFO:tasks.workunit.client.1.smithi159.stdout:8/214: rename d1/dd/c25 to d1/dc/d35/c52 0 2022-02-02T18:21:55.861 INFO:tasks.workunit.client.1.smithi159.stdout:0/275: rmdir d1/d11/d38 39 2022-02-02T18:21:55.862 INFO:tasks.workunit.client.1.smithi159.stdout:0/276: chown d1/d11/d38/c5c 765 1 2022-02-02T18:21:55.864 INFO:tasks.workunit.client.1.smithi159.stdout:8/215: mkdir d1/dd/d1a/d53 0 2022-02-02T18:21:55.864 INFO:tasks.workunit.client.1.smithi159.stdout:8/216: truncate d1/f17 940320 0 2022-02-02T18:21:55.864 INFO:tasks.workunit.client.1.smithi159.stdout:8/217: chown d1/c1e 0 1 2022-02-02T18:21:55.865 INFO:tasks.workunit.client.1.smithi159.stdout:8/218: creat d1/dd/d1a/d53/f54 x:0 0 0 2022-02-02T18:21:55.866 INFO:tasks.workunit.client.1.smithi159.stdout:8/219: chown d1/dd/d1a/c3d 44458 1 2022-02-02T18:21:55.873 INFO:tasks.workunit.client.1.smithi159.stdout:6/247: dwrite df/d35/f38 [0,4194304] 0 2022-02-02T18:21:55.874 INFO:tasks.workunit.client.1.smithi159.stdout:0/277: dread d1/d19/f25 [0,4194304] 0 2022-02-02T18:21:55.874 INFO:tasks.workunit.client.1.smithi159.stdout:0/278: chown d1/d19/d3d/c59 91977 1 2022-02-02T18:21:55.876 INFO:tasks.workunit.client.1.smithi159.stdout:6/248: symlink df/d35/d2a/d3f/d42/d47/l49 0 2022-02-02T18:21:55.876 INFO:tasks.workunit.client.1.smithi159.stdout:6/249: dread - df/d35/d2a/d3f/f48 zero size 2022-02-02T18:21:55.877 INFO:tasks.workunit.client.1.smithi159.stdout:6/250: write df/f15 [1295774,43313] 0 2022-02-02T18:21:55.898 INFO:tasks.workunit.client.1.smithi159.stdout:0/279: dwrite d1/d19/f25 [0,4194304] 0 2022-02-02T18:21:55.899 INFO:tasks.workunit.client.1.smithi159.stdout:6/251: dwrite f7 [0,4194304] 0 2022-02-02T18:21:55.900 INFO:tasks.workunit.client.1.smithi159.stdout:0/280: unlink d1/d11/d1d/c5d 0 2022-02-02T18:21:55.902 INFO:tasks.workunit.client.1.smithi159.stdout:0/281: unlink d1/d11/d38/d42/f50 0 2022-02-02T18:21:55.920 INFO:tasks.workunit.client.1.smithi159.stdout:0/282: dread d1/dd/f54 [0,4194304] 0 2022-02-02T18:21:55.920 INFO:tasks.workunit.client.1.smithi159.stdout:0/283: creat d1/d11/d1d/d34/f67 x:0 0 0 2022-02-02T18:21:55.927 INFO:tasks.workunit.client.1.smithi159.stdout:6/252: dwrite df/f18 [4194304,4194304] 0 2022-02-02T18:21:55.928 INFO:tasks.workunit.client.1.smithi159.stdout:6/253: rmdir df/d35/d2a/d3f/d42/d47 39 2022-02-02T18:21:55.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/254: write fd [627149,21952] 0 2022-02-02T18:21:55.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/255: fsync df/d35/f34 0 2022-02-02T18:21:55.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/256: chown df/f17 103611104 1 2022-02-02T18:21:55.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/257: fsync df/d35/d2a/d2f/f37 0 2022-02-02T18:21:55.931 INFO:tasks.workunit.client.1.smithi159.stdout:6/258: creat df/d35/d2a/d2f/f4a x:0 0 0 2022-02-02T18:21:55.931 INFO:tasks.workunit.client.1.smithi159.stdout:6/259: creat df/d35/d2a/d3f/d42/f4b x:0 0 0 2022-02-02T18:21:55.931 INFO:tasks.workunit.client.1.smithi159.stdout:6/260: chown df/c13 52 1 2022-02-02T18:21:55.933 INFO:tasks.workunit.client.1.smithi159.stdout:6/261: rename df/l1d to df/d35/d2a/d3f/d42/d47/l4c 0 2022-02-02T18:21:55.934 INFO:tasks.workunit.client.1.smithi159.stdout:6/262: stat df/d35/d2a/d3f/f44 0 2022-02-02T18:21:55.935 INFO:tasks.workunit.client.1.smithi159.stdout:6/263: write df/d35/f34 [516949,117879] 0 2022-02-02T18:21:55.935 INFO:tasks.workunit.client.1.smithi159.stdout:6/264: fdatasync df/f17 0 2022-02-02T18:21:55.948 INFO:tasks.workunit.client.1.smithi159.stdout:6/265: dwrite df/f17 [0,4194304] 0 2022-02-02T18:21:55.955 INFO:tasks.workunit.client.1.smithi159.stdout:6/266: rmdir df/d35/d2a/d2f 39 2022-02-02T18:21:55.955 INFO:tasks.workunit.client.1.smithi159.stdout:6/267: write df/d35/d2a/d2f/f31 [4391202,25182] 0 2022-02-02T18:21:55.958 INFO:tasks.workunit.client.1.smithi159.stdout:6/268: mknod df/d35/d2a/d3f/d42/c4d 0 2022-02-02T18:21:55.975 INFO:tasks.workunit.client.1.smithi159.stdout:6/269: dwrite df/d35/d2a/d3f/f44 [0,4194304] 0 2022-02-02T18:21:55.976 INFO:tasks.workunit.client.1.smithi159.stdout:6/270: mknod df/c4e 0 2022-02-02T18:21:55.977 INFO:tasks.workunit.client.1.smithi159.stdout:6/271: symlink df/d35/d2a/d2f/l4f 0 2022-02-02T18:21:55.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/272: rename df/d35/d2a/d3f/d42/d47/l49 to df/d35/d2a/d3f/l50 0 2022-02-02T18:21:55.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/273: write df/d35/d2a/f2d [745441,77448] 0 2022-02-02T18:21:55.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/274: link df/c4e df/d35/d2a/d3f/d42/c51 0 2022-02-02T18:21:55.980 INFO:tasks.workunit.client.1.smithi159.stdout:6/275: creat df/d35/d2a/f52 x:0 0 0 2022-02-02T18:21:55.982 INFO:tasks.workunit.client.1.smithi159.stdout:6/276: write df/d35/d2a/d2f/f37 [4140396,110161] 0 2022-02-02T18:21:55.984 INFO:tasks.workunit.client.1.smithi159.stdout:6/277: mknod df/d35/d2a/d2f/c53 0 2022-02-02T18:21:55.984 INFO:tasks.workunit.client.1.smithi159.stdout:6/278: read df/f15 [1304679,52797] 0 2022-02-02T18:21:56.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/279: dwrite df/d35/d2a/f2d [0,4194304] 0 2022-02-02T18:21:56.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/280: write df/d35/f36 [1005907,114282] 0 2022-02-02T18:21:56.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/281: mkdir df/d35/d54 0 2022-02-02T18:21:56.009 INFO:tasks.workunit.client.1.smithi159.stdout:6/282: mkdir df/d35/d2a/d3f/d55 0 2022-02-02T18:21:56.014 INFO:tasks.workunit.client.1.smithi159.stdout:6/283: mknod df/d35/d2a/c56 0 2022-02-02T18:21:56.019 INFO:tasks.workunit.client.1.smithi159.stdout:6/284: rename df/f17 to df/d35/f57 0 2022-02-02T18:21:56.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:55 smithi159 conmon[35668]: cluster 2022-02-02T18:21:54.832187+0000 mgr.smithi096.shfutl (mgr.14162) 286 2022-02-02T18:21:56.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:55 smithi159 conmon[35668]: : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 548 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 33 MiB/s wr, 226 op/s 2022-02-02T18:21:56.043 INFO:tasks.workunit.client.1.smithi159.stdout:6/285: dwrite fd [0,4194304] 0 2022-02-02T18:21:56.043 INFO:tasks.workunit.client.1.smithi159.stdout:6/286: dread - df/d35/d2a/f52 zero size 2022-02-02T18:21:56.059 INFO:tasks.workunit.client.1.smithi159.stdout:6/287: dwrite df/d35/f34 [0,4194304] 0 2022-02-02T18:21:56.059 INFO:tasks.workunit.client.1.smithi159.stdout:6/288: creat df/d35/d2a/d3f/f58 x:0 0 0 2022-02-02T18:21:56.061 INFO:tasks.workunit.client.1.smithi159.stdout:6/289: mkdir df/d35/d2a/d3f/d42/d47/d59 0 2022-02-02T18:21:56.062 INFO:tasks.workunit.client.1.smithi159.stdout:6/290: symlink df/d35/d54/l5a 0 2022-02-02T18:21:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:55 smithi096 conmon[32067]: cluster 2022-02-02T18:21:54.832187+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:21:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:55 smithi096 conmon[32067]: .14162) 286 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 548 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 33 MiB/s wr, 226 op/s 2022-02-02T18:21:58.164 INFO:tasks.workunit.client.1.smithi159.stdout:5/393: getdents d9/d2e/d63 0 2022-02-02T18:21:58.171 INFO:tasks.workunit.client.1.smithi159.stdout:5/394: dread d9/d24/d37/f20 [0,4194304] 0 2022-02-02T18:21:58.188 INFO:tasks.workunit.client.1.smithi159.stdout:5/395: dwrite d9/d2e/f2a [0,4194304] 0 2022-02-02T18:21:58.189 INFO:tasks.workunit.client.1.smithi159.stdout:5/396: chown d9/l11 899843 1 2022-02-02T18:21:58.189 INFO:tasks.workunit.client.1.smithi159.stdout:5/397: fdatasync d9/d24/f16 0 2022-02-02T18:21:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:1/288: sync 2022-02-02T18:21:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:0/284: sync 2022-02-02T18:21:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:8/220: sync 2022-02-02T18:21:58.199 INFO:tasks.workunit.client.1.smithi159.stdout:6/291: sync 2022-02-02T18:21:58.199 INFO:tasks.workunit.client.1.smithi159.stdout:9/215: sync 2022-02-02T18:21:58.200 INFO:tasks.workunit.client.1.smithi159.stdout:5/398: creat d9/d24/d21/f78 x:0 0 0 2022-02-02T18:21:58.200 INFO:tasks.workunit.client.1.smithi159.stdout:3/294: sync 2022-02-02T18:21:58.200 INFO:tasks.workunit.client.1.smithi159.stdout:7/329: sync 2022-02-02T18:21:58.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/245: sync 2022-02-02T18:21:58.200 INFO:tasks.workunit.client.1.smithi159.stdout:3/295: dread - dd/d20/d2a/d31/f57 zero size 2022-02-02T18:21:58.201 INFO:tasks.workunit.client.1.smithi159.stdout:4/246: chown d0/d8/d14/d33 5853342 1 2022-02-02T18:21:58.201 INFO:tasks.workunit.client.1.smithi159.stdout:2/314: sync 2022-02-02T18:21:58.201 INFO:tasks.workunit.client.1.smithi159.stdout:2/315: unlink da/l27 0 2022-02-02T18:21:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:6/292: creat df/d35/d54/f5b x:0 0 0 2022-02-02T18:21:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:6/293: creat df/d35/d2a/f5c x:0 0 0 2022-02-02T18:21:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:8/221: creat d1/d26/d48/f55 x:0 0 0 2022-02-02T18:21:58.203 INFO:tasks.workunit.client.1.smithi159.stdout:8/222: read d1/dd/d31/f3e [385955,98451] 0 2022-02-02T18:21:58.205 INFO:tasks.workunit.client.1.smithi159.stdout:0/285: rename d1/d11/d38/d42/d47/f48 to d1/d11/f68 0 2022-02-02T18:21:58.206 INFO:tasks.workunit.client.1.smithi159.stdout:9/216: dread d4/d2a/f34 [4194304,4194304] 0 2022-02-02T18:21:58.207 INFO:tasks.workunit.client.1.smithi159.stdout:5/399: rmdir d9/d24/d4a 39 2022-02-02T18:21:58.207 INFO:tasks.workunit.client.1.smithi159.stdout:1/289: mknod df/d14/d16/d4a/c6b 0 2022-02-02T18:21:58.207 INFO:tasks.workunit.client.1.smithi159.stdout:1/290: chown df/d14/d16/c56 835 1 2022-02-02T18:21:58.208 INFO:tasks.workunit.client.1.smithi159.stdout:3/296: creat dd/d20/f64 x:0 0 0 2022-02-02T18:21:58.208 INFO:tasks.workunit.client.1.smithi159.stdout:3/297: readlink dd/d19/l56 0 2022-02-02T18:21:58.209 INFO:tasks.workunit.client.1.smithi159.stdout:3/298: chown dd/d19/c29 475 1 2022-02-02T18:21:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:7/330: dread d3/d6/f4d [0,4194304] 0 2022-02-02T18:21:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:7/331: write d3/d5/d56/d2f/f4c [1431333,29569] 0 2022-02-02T18:21:58.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/400: write d9/d24/d37/f1e [3952780,45890] 0 2022-02-02T18:21:58.218 INFO:tasks.workunit.client.1.smithi159.stdout:4/247: mkdir d0/d8/d30/d5d 0 2022-02-02T18:21:58.219 INFO:tasks.workunit.client.1.smithi159.stdout:6/294: symlink df/d35/d2a/d3f/d42/d47/l5d 0 2022-02-02T18:21:58.219 INFO:tasks.workunit.client.1.smithi159.stdout:0/286: link d1/d11/d1d/f44 d1/d19/f69 0 2022-02-02T18:21:58.219 INFO:tasks.workunit.client.1.smithi159.stdout:2/316: symlink da/d1c/d29/d3f/d5a/l68 0 2022-02-02T18:21:58.222 INFO:tasks.workunit.client.1.smithi159.stdout:8/223: rename d1/dc/l33 to d1/dd/d2c/l56 0 2022-02-02T18:21:58.223 INFO:tasks.workunit.client.1.smithi159.stdout:9/217: truncate d4/d19/d1c/f44 2638451 0 2022-02-02T18:21:58.224 INFO:tasks.workunit.client.1.smithi159.stdout:1/291: mkdir df/d21/d23/d49/d69/d6c 0 2022-02-02T18:21:58.225 INFO:tasks.workunit.client.1.smithi159.stdout:4/248: stat d0/d8/d14/d33/l49 0 2022-02-02T18:21:58.226 INFO:tasks.workunit.client.1.smithi159.stdout:6/295: creat df/d35/d2a/d3f/d42/d47/f5e x:0 0 0 2022-02-02T18:21:58.228 INFO:tasks.workunit.client.1.smithi159.stdout:2/317: truncate da/d1c/d29/f2c 2038774 0 2022-02-02T18:21:58.229 INFO:tasks.workunit.client.1.smithi159.stdout:9/218: symlink d4/l48 0 2022-02-02T18:21:58.232 INFO:tasks.workunit.client.1.smithi159.stdout:6/296: mknod df/d35/d2a/d2f/c5f 0 2022-02-02T18:21:58.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/297: dread fa [0,4194304] 0 2022-02-02T18:21:58.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/298: chown df/f16 859 1 2022-02-02T18:21:58.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/299: readlink df/d35/d2a/d2f/l4f 0 2022-02-02T18:21:58.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/219: rmdir d4/d19 39 2022-02-02T18:21:58.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/220: write d4/d19/d1c/d1f/f3f [681661,58711] 0 2022-02-02T18:21:58.264 INFO:tasks.workunit.client.1.smithi159.stdout:3/299: dwrite dd/d20/f3c [0,4194304] 0 2022-02-02T18:21:58.266 INFO:tasks.workunit.client.1.smithi159.stdout:3/300: dread dd/d19/f24 [0,4194304] 0 2022-02-02T18:21:58.266 INFO:tasks.workunit.client.1.smithi159.stdout:3/301: truncate dd/d19/f4e 4700478 0 2022-02-02T18:21:58.267 INFO:tasks.workunit.client.1.smithi159.stdout:3/302: write dd/d19/d35/f4f [2876062,29824] 0 2022-02-02T18:21:58.271 INFO:tasks.workunit.client.1.smithi159.stdout:3/303: read dd/d20/f3c [3215112,63620] 0 2022-02-02T18:21:58.273 INFO:tasks.workunit.client.1.smithi159.stdout:3/304: creat dd/f65 x:0 0 0 2022-02-02T18:21:58.275 INFO:tasks.workunit.client.1.smithi159.stdout:5/401: dwrite d9/d2e/f70 [0,4194304] 0 2022-02-02T18:21:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:57 smithi159 conmon[35668]: cluster 2022-02-02T18:21:56.832709+0000 mgr.smithi096.shfutl (mgr.14162) 287 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 864 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 MiB/s rd, 88 MiB/s wr, 352 op/s 2022-02-02T18:21:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:57 smithi159 conmon[35668]: audit 2022-02-02T18:21:57.443452+0000 mon.smithi096 (mon.0) 573 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:21:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:57 smithi159 conmon[35668]: audit 2022-02-02T18:21:57.444072+0000 mon.smithi096 (mon.0) 574 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:21:58.278 INFO:tasks.workunit.client.1.smithi159.stdout:9/221: dread d4/f17 [0,4194304] 0 2022-02-02T18:21:58.279 INFO:tasks.workunit.client.1.smithi159.stdout:5/402: getdents d9 0 2022-02-02T18:21:58.279 INFO:tasks.workunit.client.1.smithi159.stdout:9/222: truncate d4/d19/f36 40436 0 2022-02-02T18:21:58.279 INFO:tasks.workunit.client.1.smithi159.stdout:9/223: fdatasync d4/d2a/f34 0 2022-02-02T18:21:58.280 INFO:tasks.workunit.client.1.smithi159.stdout:9/224: mknod d4/d2a/c49 0 2022-02-02T18:21:58.280 INFO:tasks.workunit.client.1.smithi159.stdout:2/318: dwrite da/d1c/f5b [0,4194304] 0 2022-02-02T18:21:58.281 INFO:tasks.workunit.client.1.smithi159.stdout:4/249: dwrite d0/f25 [4194304,4194304] 0 2022-02-02T18:21:58.282 INFO:tasks.workunit.client.1.smithi159.stdout:0/287: dwrite d1/fc [0,4194304] 0 2022-02-02T18:21:58.284 INFO:tasks.workunit.client.1.smithi159.stdout:1/292: dwrite f4 [0,4194304] 0 2022-02-02T18:21:58.284 INFO:tasks.workunit.client.1.smithi159.stdout:1/293: read - df/d21/f54 zero size 2022-02-02T18:21:58.284 INFO:tasks.workunit.client.1.smithi159.stdout:6/300: dwrite df/f14 [0,4194304] 0 2022-02-02T18:21:58.290 INFO:tasks.workunit.client.1.smithi159.stdout:8/224: dwrite d1/dc/d35/f46 [0,4194304] 0 2022-02-02T18:21:58.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/225: chown d1/dc/l24 126792 1 2022-02-02T18:21:58.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/226: fsync d1/dd/d2c/f42 0 2022-02-02T18:21:58.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/227: creat d1/d26/d48/f57 x:0 0 0 2022-02-02T18:21:58.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/228: readlink d1/dd/d2c/l51 0 2022-02-02T18:21:58.291 INFO:tasks.workunit.client.1.smithi159.stdout:0/288: rename d1/dd/l3f to d1/d11/d1d/d34/l6a 0 2022-02-02T18:21:58.292 INFO:tasks.workunit.client.1.smithi159.stdout:0/289: rename d1/d19 to d1/d19/d6b 22 2022-02-02T18:21:58.292 INFO:tasks.workunit.client.1.smithi159.stdout:9/225: dread d4/f10 [0,4194304] 0 2022-02-02T18:21:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/319: dread da/d40/f1d [0,4194304] 0 2022-02-02T18:21:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:6/301: mkdir df/d35/d2a/d3f/d42/d47/d60 0 2022-02-02T18:21:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:6/302: dread - df/d35/d54/f5b zero size 2022-02-02T18:21:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:0/290: mknod d1/d11/d38/c6c 0 2022-02-02T18:21:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:0/291: chown d1/d11/d1d/d34/f4a 1 1 2022-02-02T18:21:58.300 INFO:tasks.workunit.client.1.smithi159.stdout:0/292: chown d1/d19/f29 107 1 2022-02-02T18:21:58.300 INFO:tasks.workunit.client.1.smithi159.stdout:0/293: fdatasync d1/d19/f49 0 2022-02-02T18:21:58.300 INFO:tasks.workunit.client.1.smithi159.stdout:9/226: getdents d4/d19/d1c/d1f 0 2022-02-02T18:21:58.301 INFO:tasks.workunit.client.1.smithi159.stdout:3/305: dwrite dd/d19/d38/d3f/d52/f58 [0,4194304] 0 2022-02-02T18:21:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:57 smithi096 conmon[32067]: cluster 2022-02-02T18:21:56.832709+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:21:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:57 smithi096 conmon[32067]: 14162) 287 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 864 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 MiB/s rd, 88 MiB/s wr, 352 op/s 2022-02-02T18:21:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:57 smithi096 conmon[32067]: audit 2022-02-02T18:21:57.443452+0000 mon.smithi096 (mon.0) 573 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:21:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:57 smithi096 conmon[32067]: audit 2022-02-02T18:21:57.444072+0000 mon.smithi096 (mon.0) 574 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:21:58.309 INFO:tasks.workunit.client.1.smithi159.stdout:2/320: rename da/d1c/f28 to da/d1c/d25/f69 0 2022-02-02T18:21:58.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/294: dread d1/d19/f5b [0,4194304] 0 2022-02-02T18:21:58.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/295: chown d1/d19/f25 696464 1 2022-02-02T18:21:58.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/296: chown d1/f3 1955859 1 2022-02-02T18:21:58.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/297: creat d1/dd/f6d x:0 0 0 2022-02-02T18:21:58.315 INFO:tasks.workunit.client.1.smithi159.stdout:6/303: write fd [2323711,4867] 0 2022-02-02T18:21:58.316 INFO:tasks.workunit.client.1.smithi159.stdout:9/227: rename d4/l48 to d4/d19/d1c/d21/d22/l4a 0 2022-02-02T18:21:58.316 INFO:tasks.workunit.client.1.smithi159.stdout:5/403: dwrite d9/d2e/f5d [0,4194304] 0 2022-02-02T18:21:58.317 INFO:tasks.workunit.client.1.smithi159.stdout:5/404: readlink d9/d24/d21/d44/l59 0 2022-02-02T18:21:58.320 INFO:tasks.workunit.client.1.smithi159.stdout:6/304: unlink df/d35/c25 0 2022-02-02T18:21:58.320 INFO:tasks.workunit.client.1.smithi159.stdout:5/405: dread d9/d24/d38/f73 [0,4194304] 0 2022-02-02T18:21:58.321 INFO:tasks.workunit.client.1.smithi159.stdout:9/228: symlink d4/d2a/l4b 0 2022-02-02T18:21:58.322 INFO:tasks.workunit.client.1.smithi159.stdout:6/305: mkdir df/d35/d2a/d3f/d42/d47/d60/d61 0 2022-02-02T18:21:58.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/306: chown df/d35/c21 50275724 1 2022-02-02T18:21:58.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/307: chown df/c29 44 1 2022-02-02T18:21:58.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/308: write df/d35/d2a/d3f/d42/d47/f5e [475604,30634] 0 2022-02-02T18:21:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:6/309: write df/f14 [2199012,16457] 0 2022-02-02T18:21:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:9/229: rmdir d4/d19/d1c/d21/d22 39 2022-02-02T18:21:58.326 INFO:tasks.workunit.client.1.smithi159.stdout:9/230: mkdir d4/d19/d1c/d1f/d4c 0 2022-02-02T18:21:58.326 INFO:tasks.workunit.client.1.smithi159.stdout:9/231: stat d4/d19/d1c 0 2022-02-02T18:21:58.326 INFO:tasks.workunit.client.1.smithi159.stdout:9/232: fsync d4/d19/f3e 0 2022-02-02T18:21:58.327 INFO:tasks.workunit.client.1.smithi159.stdout:2/321: dread da/d1c/d29/d3f/f51 [0,4194304] 0 2022-02-02T18:21:58.329 INFO:tasks.workunit.client.1.smithi159.stdout:9/233: creat d4/d19/d1c/d1f/f4d x:0 0 0 2022-02-02T18:21:58.329 INFO:tasks.workunit.client.1.smithi159.stdout:9/234: truncate d4/f29 4537939 0 2022-02-02T18:21:58.329 INFO:tasks.workunit.client.1.smithi159.stdout:9/235: chown d4/d19/d1c/d1f/f30 23466 1 2022-02-02T18:21:58.330 INFO:tasks.workunit.client.1.smithi159.stdout:2/322: creat da/d1c/d29/f6a x:0 0 0 2022-02-02T18:21:58.330 INFO:tasks.workunit.client.1.smithi159.stdout:5/406: dread d9/d24/f33 [0,4194304] 0 2022-02-02T18:21:58.331 INFO:tasks.workunit.client.1.smithi159.stdout:5/407: fsync d9/d24/d37/f3a 0 2022-02-02T18:21:58.331 INFO:tasks.workunit.client.1.smithi159.stdout:5/408: write d9/f77 [455829,90069] 0 2022-02-02T18:21:58.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/310: rename df/d35/d54 to df/d35/d2a/d3f/d42/d47/d60/d62 0 2022-02-02T18:21:58.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/409: rename d9/d24/d37/c27 to d9/d2e/d71/c79 0 2022-02-02T18:21:58.337 INFO:tasks.workunit.client.1.smithi159.stdout:4/250: dwrite d0/d8/f28 [0,4194304] 0 2022-02-02T18:21:58.337 INFO:tasks.workunit.client.1.smithi159.stdout:4/251: readlink d0/d8/le 0 2022-02-02T18:21:58.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/229: dwrite d1/dd/d2c/f42 [0,4194304] 0 2022-02-02T18:21:58.337 INFO:tasks.workunit.client.1.smithi159.stdout:6/311: write f1 [4394180,103255] 0 2022-02-02T18:21:58.338 INFO:tasks.workunit.client.1.smithi159.stdout:5/410: creat d9/f7a x:0 0 0 2022-02-02T18:21:58.340 INFO:tasks.workunit.client.1.smithi159.stdout:4/252: write d0/d8/f28 [1075101,57271] 0 2022-02-02T18:21:58.340 INFO:tasks.workunit.client.1.smithi159.stdout:4/253: creat d0/d8/d41/f5e x:0 0 0 2022-02-02T18:21:58.341 INFO:tasks.workunit.client.1.smithi159.stdout:3/306: dwrite dd/f1f [0,4194304] 0 2022-02-02T18:21:58.341 INFO:tasks.workunit.client.1.smithi159.stdout:3/307: dread - dd/d20/d2a/f4a zero size 2022-02-02T18:21:58.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/230: mknod d1/d26/d48/c58 0 2022-02-02T18:21:58.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/231: stat d1/dd/d2c/f42 0 2022-02-02T18:21:58.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/232: write d1/dd/f2f [409441,21921] 0 2022-02-02T18:21:58.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/254: truncate d0/d8/d14/d33/f50 3770831 0 2022-02-02T18:21:58.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/255: read - d0/f2d zero size 2022-02-02T18:21:58.344 INFO:tasks.workunit.client.1.smithi159.stdout:5/411: unlink d9/d24/d37/f29 0 2022-02-02T18:21:58.344 INFO:tasks.workunit.client.1.smithi159.stdout:5/412: truncate d9/f1c 4796672 0 2022-02-02T18:21:58.345 INFO:tasks.workunit.client.1.smithi159.stdout:8/233: getdents d1/dd/d31 0 2022-02-02T18:21:58.350 INFO:tasks.workunit.client.1.smithi159.stdout:5/413: link d9/d24/f33 d9/d2e/d63/f7b 0 2022-02-02T18:21:58.353 INFO:tasks.workunit.client.1.smithi159.stdout:8/234: write d1/dc/d35/f46 [3412197,120300] 0 2022-02-02T18:21:58.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/308: mkdir dd/d66 0 2022-02-02T18:21:58.361 INFO:tasks.workunit.client.1.smithi159.stdout:3/309: chown dd/f1f 1 1 2022-02-02T18:21:58.361 INFO:tasks.workunit.client.1.smithi159.stdout:4/256: creat d0/d8/d14/d36/f5f x:0 0 0 2022-02-02T18:21:58.361 INFO:tasks.workunit.client.1.smithi159.stdout:3/310: chown dd/d19/f1e 1932 1 2022-02-02T18:21:58.363 INFO:tasks.workunit.client.1.smithi159.stdout:3/311: rename dd/d19/c29 to dd/d19/d38/d3f/d52/c67 0 2022-02-02T18:21:58.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/312: fsync dd/f34 0 2022-02-02T18:21:58.364 INFO:tasks.workunit.client.1.smithi159.stdout:6/312: dread df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:21:58.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/313: creat dd/d20/d2a/f68 x:0 0 0 2022-02-02T18:21:58.368 INFO:tasks.workunit.client.1.smithi159.stdout:6/313: mknod df/c63 0 2022-02-02T18:21:58.372 INFO:tasks.workunit.client.1.smithi159.stdout:4/257: dread d0/ff [0,4194304] 0 2022-02-02T18:21:58.374 INFO:tasks.workunit.client.1.smithi159.stdout:2/323: dwrite da/d1c/d29/d3f/f5c [0,4194304] 0 2022-02-02T18:21:58.375 INFO:tasks.workunit.client.1.smithi159.stdout:9/236: dwrite d4/d19/f1a [0,4194304] 0 2022-02-02T18:21:58.375 INFO:tasks.workunit.client.1.smithi159.stdout:9/237: dread - d4/d19/d1c/d1f/f30 zero size 2022-02-02T18:21:58.376 INFO:tasks.workunit.client.1.smithi159.stdout:4/258: rename d0/d8/d14/f23 to d0/d8/d24/d3a/f60 0 2022-02-02T18:21:58.377 INFO:tasks.workunit.client.1.smithi159.stdout:4/259: read d0/d8/f20 [260541,95198] 0 2022-02-02T18:21:58.378 INFO:tasks.workunit.client.1.smithi159.stdout:9/238: mknod d4/d19/d1c/d1f/d4c/c4e 0 2022-02-02T18:21:58.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/239: truncate d4/d19/d1c/d1f/f3c 855780 0 2022-02-02T18:21:58.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/240: stat d4/d19/d1c/d1f/f24 0 2022-02-02T18:21:58.380 INFO:tasks.workunit.client.1.smithi159.stdout:6/314: read fd [2614376,70009] 0 2022-02-02T18:21:58.381 INFO:tasks.workunit.client.1.smithi159.stdout:5/414: dwrite d9/d24/d38/f60 [0,4194304] 0 2022-02-02T18:21:58.381 INFO:tasks.workunit.client.1.smithi159.stdout:5/415: write d9/d2e/f5d [4766149,67821] 0 2022-02-02T18:21:58.386 INFO:tasks.workunit.client.1.smithi159.stdout:6/315: creat df/d35/d2a/d2f/f64 x:0 0 0 2022-02-02T18:21:58.390 INFO:tasks.workunit.client.1.smithi159.stdout:8/235: dwrite d1/dc/d35/f50 [0,4194304] 0 2022-02-02T18:21:58.390 INFO:tasks.workunit.client.1.smithi159.stdout:6/316: unlink fa 0 2022-02-02T18:21:58.392 INFO:tasks.workunit.client.1.smithi159.stdout:2/324: rename da/d1c/d29/d3f to da/d1c/d47/d6b 0 2022-02-02T18:21:58.392 INFO:tasks.workunit.client.1.smithi159.stdout:2/325: chown da/d1c/d47/c52 33904 1 2022-02-02T18:21:58.392 INFO:tasks.workunit.client.1.smithi159.stdout:2/326: fsync da/d1c/f1f 0 2022-02-02T18:21:58.393 INFO:tasks.workunit.client.1.smithi159.stdout:8/236: getdents d1/dd/d31/d4a 0 2022-02-02T18:21:58.396 INFO:tasks.workunit.client.1.smithi159.stdout:5/416: write f7 [27507,56551] 0 2022-02-02T18:21:58.397 INFO:tasks.workunit.client.1.smithi159.stdout:6/317: mkdir df/d35/d2a/d3f/d65 0 2022-02-02T18:21:58.402 INFO:tasks.workunit.client.1.smithi159.stdout:2/327: getdents da/d30 0 2022-02-02T18:21:58.406 INFO:tasks.workunit.client.1.smithi159.stdout:2/328: mkdir da/d40/d61/d6c 0 2022-02-02T18:21:58.408 INFO:tasks.workunit.client.1.smithi159.stdout:6/318: write df/d35/f38 [717621,82860] 0 2022-02-02T18:21:58.408 INFO:tasks.workunit.client.1.smithi159.stdout:9/241: dwrite d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:21:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:4/260: dwrite d0/d8/d15/f2e [0,4194304] 0 2022-02-02T18:21:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:2/329: rename da/d30 to da/d48/d6d 0 2022-02-02T18:21:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:2/330: chown da/d40/l23 52 1 2022-02-02T18:21:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:2/331: dread - da/f53 zero size 2022-02-02T18:21:58.412 INFO:tasks.workunit.client.1.smithi159.stdout:2/332: write da/d1c/d47/d6b/f51 [2840309,55406] 0 2022-02-02T18:21:58.412 INFO:tasks.workunit.client.1.smithi159.stdout:2/333: creat da/d1c/f6e x:0 0 0 2022-02-02T18:21:58.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/319: write f6 [4776815,93367] 0 2022-02-02T18:21:58.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/320: truncate f1 9088158 0 2022-02-02T18:21:58.415 INFO:tasks.workunit.client.1.smithi159.stdout:6/321: dread - df/d35/d2a/d2f/f64 zero size 2022-02-02T18:21:58.418 INFO:tasks.workunit.client.1.smithi159.stdout:9/242: link d4/ce d4/d19/d1c/d1f/d4c/c4f 0 2022-02-02T18:21:58.418 INFO:tasks.workunit.client.1.smithi159.stdout:9/243: chown d4/d19/d1c/d1f/c3a 65735 1 2022-02-02T18:21:58.420 INFO:tasks.workunit.client.1.smithi159.stdout:6/322: truncate df/f15 102376 0 2022-02-02T18:21:58.420 INFO:tasks.workunit.client.1.smithi159.stdout:6/323: chown f1 12984726 1 2022-02-02T18:21:58.420 INFO:tasks.workunit.client.1.smithi159.stdout:6/324: stat df/d35/d2a/d3f/d42/d47/d60/d62/f5b 0 2022-02-02T18:21:58.421 INFO:tasks.workunit.client.1.smithi159.stdout:6/325: fsync df/d35/d2a/d3f/d42/f4b 0 2022-02-02T18:21:58.422 INFO:tasks.workunit.client.1.smithi159.stdout:9/244: mknod d4/c50 0 2022-02-02T18:21:58.422 INFO:tasks.workunit.client.1.smithi159.stdout:8/237: dwrite d1/dd/f16 [0,4194304] 0 2022-02-02T18:21:58.423 INFO:tasks.workunit.client.1.smithi159.stdout:5/417: dwrite d9/d24/f22 [4194304,4194304] 0 2022-02-02T18:21:58.436 INFO:tasks.workunit.client.1.smithi159.stdout:6/326: dread f1 [4194304,4194304] 0 2022-02-02T18:21:58.440 INFO:tasks.workunit.client.1.smithi159.stdout:4/261: dwrite d0/d8/d24/d3a/f46 [0,4194304] 0 2022-02-02T18:21:58.441 INFO:tasks.workunit.client.1.smithi159.stdout:9/245: dwrite d4/f11 [0,4194304] 0 2022-02-02T18:21:58.441 INFO:tasks.workunit.client.1.smithi159.stdout:6/327: write df/d35/f57 [2654146,120319] 0 2022-02-02T18:21:58.442 INFO:tasks.workunit.client.1.smithi159.stdout:6/328: chown df/c40 21 1 2022-02-02T18:21:58.442 INFO:tasks.workunit.client.1.smithi159.stdout:2/334: dwrite da/d1c/d29/f6a [0,4194304] 0 2022-02-02T18:21:58.443 INFO:tasks.workunit.client.1.smithi159.stdout:6/329: write df/d35/d2a/d3f/f44 [435461,6181] 0 2022-02-02T18:21:58.448 INFO:tasks.workunit.client.1.smithi159.stdout:8/238: truncate d1/dd/f16 2558883 0 2022-02-02T18:21:58.449 INFO:tasks.workunit.client.1.smithi159.stdout:5/418: truncate f7 2245897 0 2022-02-02T18:21:58.449 INFO:tasks.workunit.client.1.smithi159.stdout:5/419: readlink d9/l11 0 2022-02-02T18:21:58.450 INFO:tasks.workunit.client.1.smithi159.stdout:5/420: chown d9/d2e/f54 4969 1 2022-02-02T18:21:58.450 INFO:tasks.workunit.client.1.smithi159.stdout:4/262: mkdir d0/d8/d15/d61 0 2022-02-02T18:21:58.451 INFO:tasks.workunit.client.1.smithi159.stdout:4/263: fsync d0/d8/d14/d36/d4b/f54 0 2022-02-02T18:21:58.451 INFO:tasks.workunit.client.1.smithi159.stdout:4/264: dread d0/f29 [0,4194304] 0 2022-02-02T18:21:58.451 INFO:tasks.workunit.client.1.smithi159.stdout:4/265: chown d0/d8/d15/d61 35927 1 2022-02-02T18:21:58.451 INFO:tasks.workunit.client.1.smithi159.stdout:4/266: creat d0/d8/d14/d36/f62 x:0 0 0 2022-02-02T18:21:58.452 INFO:tasks.workunit.client.1.smithi159.stdout:2/335: creat da/d1c/d47/d6b/d59/f6f x:0 0 0 2022-02-02T18:21:58.453 INFO:tasks.workunit.client.1.smithi159.stdout:6/330: mkdir df/d35/d2a/d3f/d42/d47/d59/d66 0 2022-02-02T18:21:58.455 INFO:tasks.workunit.client.1.smithi159.stdout:8/239: rename d1/dd/d31/f3e to d1/d26/f59 0 2022-02-02T18:21:58.459 INFO:tasks.workunit.client.1.smithi159.stdout:4/267: dread d0/ff [0,4194304] 0 2022-02-02T18:21:58.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/336: mkdir da/d1c/d42/d70 0 2022-02-02T18:21:58.460 INFO:tasks.workunit.client.1.smithi159.stdout:2/337: chown da/d1c/d47/f4a 7 1 2022-02-02T18:21:58.460 INFO:tasks.workunit.client.1.smithi159.stdout:2/338: chown da/d1c/f6e 38 1 2022-02-02T18:21:58.461 INFO:tasks.workunit.client.1.smithi159.stdout:8/240: rename d1/l21 to d1/l5a 0 2022-02-02T18:21:58.463 INFO:tasks.workunit.client.1.smithi159.stdout:8/241: creat d1/f5b x:0 0 0 2022-02-02T18:21:58.463 INFO:tasks.workunit.client.1.smithi159.stdout:6/331: dread f7 [0,4194304] 0 2022-02-02T18:21:58.465 INFO:tasks.workunit.client.1.smithi159.stdout:8/242: read d1/dc/d35/f45 [3704943,62046] 0 2022-02-02T18:21:58.465 INFO:tasks.workunit.client.1.smithi159.stdout:8/243: write d1/d26/d48/f57 [821196,9103] 0 2022-02-02T18:21:58.470 INFO:tasks.workunit.client.1.smithi159.stdout:2/339: dread da/d1c/d47/d6b/f5c [0,4194304] 0 2022-02-02T18:21:58.471 INFO:tasks.workunit.client.1.smithi159.stdout:2/340: write da/d1c/d25/f69 [5176158,106702] 0 2022-02-02T18:21:58.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/268: dread d0/f5 [0,4194304] 0 2022-02-02T18:21:58.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/269: truncate d0/d8/d14/d33/f3b 376541 0 2022-02-02T18:21:58.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/270: write d0/f2d [669619,90919] 0 2022-02-02T18:21:58.475 INFO:tasks.workunit.client.1.smithi159.stdout:4/271: write d0/d8/d15/f2e [1752680,18781] 0 2022-02-02T18:21:58.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/272: symlink d0/d8/d15/d61/l63 0 2022-02-02T18:21:58.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/273: creat d0/d8/d14/d33/f64 x:0 0 0 2022-02-02T18:21:58.480 INFO:tasks.workunit.client.1.smithi159.stdout:4/274: write d0/f5b [283551,40668] 0 2022-02-02T18:21:58.480 INFO:tasks.workunit.client.1.smithi159.stdout:4/275: chown d0/f2d 1 1 2022-02-02T18:21:58.490 INFO:tasks.workunit.client.1.smithi159.stdout:4/276: write d0/d8/f10 [2705142,68617] 0 2022-02-02T18:21:58.490 INFO:tasks.workunit.client.1.smithi159.stdout:9/246: dwrite d4/d19/f28 [0,4194304] 0 2022-02-02T18:21:58.490 INFO:tasks.workunit.client.1.smithi159.stdout:2/341: dread da/d1c/d29/f2a [0,4194304] 0 2022-02-02T18:21:58.490 INFO:tasks.workunit.client.1.smithi159.stdout:9/247: chown d4/l25 216234731 1 2022-02-02T18:21:58.491 INFO:tasks.workunit.client.1.smithi159.stdout:8/244: dwrite d1/dd/d1a/f32 [0,4194304] 0 2022-02-02T18:21:58.492 INFO:tasks.workunit.client.1.smithi159.stdout:4/277: symlink d0/d8/d14/d36/d4b/l65 0 2022-02-02T18:21:58.493 INFO:tasks.workunit.client.1.smithi159.stdout:9/248: symlink d4/d19/d1c/l51 0 2022-02-02T18:21:58.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/245: mknod d1/d26/d48/d49/c5c 0 2022-02-02T18:21:58.498 INFO:tasks.workunit.client.1.smithi159.stdout:8/246: mkdir d1/dc/d35/d5d 0 2022-02-02T18:21:58.501 INFO:tasks.workunit.client.1.smithi159.stdout:2/342: dread da/d1c/d29/f6a [0,4194304] 0 2022-02-02T18:21:58.503 INFO:tasks.workunit.client.1.smithi159.stdout:2/343: creat da/d48/f71 x:0 0 0 2022-02-02T18:21:58.503 INFO:tasks.workunit.client.1.smithi159.stdout:2/344: stat da/l35 0 2022-02-02T18:21:58.504 INFO:tasks.workunit.client.1.smithi159.stdout:2/345: getdents da/d1c/d25 0 2022-02-02T18:21:58.508 INFO:tasks.workunit.client.1.smithi159.stdout:2/346: creat da/d1c/d42/f72 x:0 0 0 2022-02-02T18:21:58.511 INFO:tasks.workunit.client.1.smithi159.stdout:2/347: mkdir da/d1c/d25/d73 0 2022-02-02T18:21:58.512 INFO:tasks.workunit.client.1.smithi159.stdout:4/278: dwrite d0/d8/d15/f2a [0,4194304] 0 2022-02-02T18:21:58.513 INFO:tasks.workunit.client.1.smithi159.stdout:2/348: link da/d48/d6d/d3e/l60 da/d1c/d25/d73/l74 0 2022-02-02T18:21:58.514 INFO:tasks.workunit.client.1.smithi159.stdout:2/349: write da/d1c/d25/f69 [3963284,32988] 0 2022-02-02T18:21:58.516 INFO:tasks.workunit.client.1.smithi159.stdout:2/350: write da/d1c/f5b [442181,26822] 0 2022-02-02T18:21:58.516 INFO:tasks.workunit.client.1.smithi159.stdout:4/279: rename d0/d8/d41/d5a to d0/d66 0 2022-02-02T18:21:58.519 INFO:tasks.workunit.client.1.smithi159.stdout:2/351: rename da/d48/d6d/f4e to da/f75 0 2022-02-02T18:21:58.520 INFO:tasks.workunit.client.1.smithi159.stdout:2/352: read da/d1c/d29/f2c [868379,25141] 0 2022-02-02T18:21:58.521 INFO:tasks.workunit.client.1.smithi159.stdout:4/280: creat d0/d8/d24/f67 x:0 0 0 2022-02-02T18:21:58.527 INFO:tasks.workunit.client.1.smithi159.stdout:2/353: mkdir da/d1c/d76 0 2022-02-02T18:21:58.532 INFO:tasks.workunit.client.1.smithi159.stdout:4/281: rename d0/d8/d14/d36/f62 to d0/d8/d24/f68 0 2022-02-02T18:21:58.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/354: symlink da/d1c/d47/d6b/l77 0 2022-02-02T18:21:58.532 INFO:tasks.workunit.client.1.smithi159.stdout:4/282: write d0/d8/d24/f67 [27081,87757] 0 2022-02-02T18:21:58.533 INFO:tasks.workunit.client.1.smithi159.stdout:2/355: read da/d1c/d47/d6b/f5c [253730,17504] 0 2022-02-02T18:21:58.533 INFO:tasks.workunit.client.1.smithi159.stdout:2/356: fsync da/f53 0 2022-02-02T18:21:58.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/283: truncate d0/d8/d24/d3a/f46 3697039 0 2022-02-02T18:21:58.536 INFO:tasks.workunit.client.1.smithi159.stdout:4/284: getdents d0/d8 0 2022-02-02T18:21:58.538 INFO:tasks.workunit.client.1.smithi159.stdout:4/285: link d0/d8/d15/f27 d0/d8/d15/f69 0 2022-02-02T18:21:58.539 INFO:tasks.workunit.client.1.smithi159.stdout:2/357: write da/d40/f13 [845115,97717] 0 2022-02-02T18:21:58.540 INFO:tasks.workunit.client.1.smithi159.stdout:2/358: read da/d1c/d29/f2c [1936577,17915] 0 2022-02-02T18:21:58.542 INFO:tasks.workunit.client.1.smithi159.stdout:4/286: rename d0/d8/d14/d33/f35 to d0/d8/d30/f6a 0 2022-02-02T18:21:58.562 INFO:tasks.workunit.client.1.smithi159.stdout:2/359: dwrite da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:21:58.564 INFO:tasks.workunit.client.1.smithi159.stdout:2/360: creat da/d1c/d76/f78 x:0 0 0 2022-02-02T18:21:58.567 INFO:tasks.workunit.client.1.smithi159.stdout:2/361: creat da/d1c/d47/f79 x:0 0 0 2022-02-02T18:21:58.568 INFO:tasks.workunit.client.1.smithi159.stdout:2/362: truncate da/d1c/d76/f78 295113 0 2022-02-02T18:21:58.569 INFO:tasks.workunit.client.1.smithi159.stdout:2/363: write da/f3b [480437,80176] 0 2022-02-02T18:21:58.571 INFO:tasks.workunit.client.1.smithi159.stdout:4/287: truncate d0/f25 4702283 0 2022-02-02T18:21:58.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/288: chown d0/d8/d24/f68 59 1 2022-02-02T18:21:58.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/289: fsync d0/d8/d14/f34 0 2022-02-02T18:21:58.573 INFO:tasks.workunit.client.1.smithi159.stdout:4/290: mknod d0/d8/d14/d33/c6b 0 2022-02-02T18:21:58.584 INFO:tasks.workunit.client.1.smithi159.stdout:4/291: rmdir d0/d8/d14/d33 39 2022-02-02T18:21:58.584 INFO:tasks.workunit.client.1.smithi159.stdout:4/292: chown d0/d8/f10 0 1 2022-02-02T18:21:58.584 INFO:tasks.workunit.client.1.smithi159.stdout:4/293: getdents d0/d8/d30/d5d 0 2022-02-02T18:21:58.589 INFO:tasks.workunit.client.1.smithi159.stdout:4/294: symlink d0/l6c 0 2022-02-02T18:21:58.590 INFO:tasks.workunit.client.1.smithi159.stdout:4/295: write d0/d8/f3c [582912,127894] 0 2022-02-02T18:21:58.610 INFO:tasks.workunit.client.1.smithi159.stdout:2/364: dwrite da/d1c/f26 [0,4194304] 0 2022-02-02T18:21:58.614 INFO:tasks.workunit.client.1.smithi159.stdout:2/365: dread da/d1c/d29/f33 [0,4194304] 0 2022-02-02T18:21:58.614 INFO:tasks.workunit.client.1.smithi159.stdout:4/296: dwrite d0/f5b [0,4194304] 0 2022-02-02T18:21:58.617 INFO:tasks.workunit.client.1.smithi159.stdout:2/366: symlink da/d48/l7a 0 2022-02-02T18:21:58.618 INFO:tasks.workunit.client.1.smithi159.stdout:2/367: creat da/d1c/d47/d6b/d5a/f7b x:0 0 0 2022-02-02T18:21:58.644 INFO:tasks.workunit.client.1.smithi159.stdout:4/297: dwrite d0/f3 [0,4194304] 0 2022-02-02T18:21:58.644 INFO:tasks.workunit.client.1.smithi159.stdout:4/298: write d0/d8/d41/f4d [500531,41308] 0 2022-02-02T18:21:58.646 INFO:tasks.workunit.client.1.smithi159.stdout:4/299: creat d0/d8/d15/d61/f6d x:0 0 0 2022-02-02T18:21:58.647 INFO:tasks.workunit.client.1.smithi159.stdout:2/368: dwrite da/d1c/d47/d6b/f5c [0,4194304] 0 2022-02-02T18:21:58.649 INFO:tasks.workunit.client.1.smithi159.stdout:4/300: symlink d0/d8/d30/l6e 0 2022-02-02T18:21:58.649 INFO:tasks.workunit.client.1.smithi159.stdout:4/301: chown d0/d8/d14 526 1 2022-02-02T18:21:58.649 INFO:tasks.workunit.client.1.smithi159.stdout:4/302: fsync d0/d8/d24/d3a/f60 0 2022-02-02T18:21:58.651 INFO:tasks.workunit.client.1.smithi159.stdout:2/369: mkdir da/d1c/d47/d6b/d7c 0 2022-02-02T18:21:58.653 INFO:tasks.workunit.client.1.smithi159.stdout:4/303: rename d0/d8/le to d0/d8/d15/l6f 0 2022-02-02T18:21:58.654 INFO:tasks.workunit.client.1.smithi159.stdout:2/370: write da/f44 [3577871,40985] 0 2022-02-02T18:21:58.661 INFO:tasks.workunit.client.1.smithi159.stdout:4/304: dread d0/ff [0,4194304] 0 2022-02-02T18:21:58.663 INFO:tasks.workunit.client.1.smithi159.stdout:4/305: link d0/d8/d24/l3f d0/d8/d30/d5d/l70 0 2022-02-02T18:21:58.667 INFO:tasks.workunit.client.1.smithi159.stdout:4/306: rename d0/d8/d15/f19 to d0/d8/d14/f71 0 2022-02-02T18:21:58.668 INFO:tasks.workunit.client.1.smithi159.stdout:2/371: dread da/d48/d6d/f34 [0,4194304] 0 2022-02-02T18:21:58.669 INFO:tasks.workunit.client.1.smithi159.stdout:2/372: creat da/f7d x:0 0 0 2022-02-02T18:21:58.669 INFO:tasks.workunit.client.1.smithi159.stdout:2/373: truncate da/f75 379090 0 2022-02-02T18:21:58.686 INFO:tasks.workunit.client.1.smithi159.stdout:2/374: truncate da/f44 1411637 0 2022-02-02T18:21:58.687 INFO:tasks.workunit.client.1.smithi159.stdout:2/375: mkdir da/d1c/d47/d6b/d5a/d7e 0 2022-02-02T18:21:58.689 INFO:tasks.workunit.client.1.smithi159.stdout:2/376: creat da/d48/d6d/d3e/f7f x:0 0 0 2022-02-02T18:21:58.690 INFO:tasks.workunit.client.1.smithi159.stdout:2/377: dread - da/d1c/f1f zero size 2022-02-02T18:21:58.690 INFO:tasks.workunit.client.1.smithi159.stdout:2/378: unlink da/f16 0 2022-02-02T18:21:58.694 INFO:tasks.workunit.client.1.smithi159.stdout:4/307: dwrite d0/d8/d14/f71 [0,4194304] 0 2022-02-02T18:21:58.696 INFO:tasks.workunit.client.1.smithi159.stdout:4/308: link d0/d8/d30/f6a d0/d8/d24/d4f/f72 0 2022-02-02T18:21:58.705 INFO:tasks.workunit.client.1.smithi159.stdout:4/309: write d0/d8/d24/d3a/f46 [1160065,51133] 0 2022-02-02T18:21:58.705 INFO:tasks.workunit.client.1.smithi159.stdout:4/310: chown d0/d8/d14/d33/d47/f53 1152720 1 2022-02-02T18:21:58.708 INFO:tasks.workunit.client.1.smithi159.stdout:4/311: creat d0/d66/f73 x:0 0 0 2022-02-02T18:21:58.708 INFO:tasks.workunit.client.1.smithi159.stdout:4/312: creat d0/d8/d41/f74 x:0 0 0 2022-02-02T18:21:58.711 INFO:tasks.workunit.client.1.smithi159.stdout:4/313: truncate d0/d8/d15/f2e 3322447 0 2022-02-02T18:21:58.712 INFO:tasks.workunit.client.1.smithi159.stdout:4/314: creat d0/d8/d30/f75 x:0 0 0 2022-02-02T18:21:58.714 INFO:tasks.workunit.client.1.smithi159.stdout:4/315: mkdir d0/d8/d24/d76 0 2022-02-02T18:21:58.714 INFO:tasks.workunit.client.1.smithi159.stdout:2/379: dwrite da/d48/f71 [0,4194304] 0 2022-02-02T18:21:58.715 INFO:tasks.workunit.client.1.smithi159.stdout:2/380: getdents da/d1c/d47/d6b/d5a/d7e 0 2022-02-02T18:21:58.716 INFO:tasks.workunit.client.1.smithi159.stdout:4/316: link d0/d8/la d0/d8/d15/d61/l77 0 2022-02-02T18:21:58.722 INFO:tasks.workunit.client.1.smithi159.stdout:4/317: read d0/d8/d15/f27 [860683,96799] 0 2022-02-02T18:21:58.723 INFO:tasks.workunit.client.1.smithi159.stdout:2/381: creat da/d1c/d47/d6b/f80 x:0 0 0 2022-02-02T18:21:58.724 INFO:tasks.workunit.client.1.smithi159.stdout:2/382: chown da/l35 786932421 1 2022-02-02T18:21:58.724 INFO:tasks.workunit.client.1.smithi159.stdout:2/383: write da/d48/d6d/d3e/f7f [1045928,33196] 0 2022-02-02T18:21:58.724 INFO:tasks.workunit.client.1.smithi159.stdout:2/384: creat da/d1c/d42/f81 x:0 0 0 2022-02-02T18:21:58.734 INFO:tasks.workunit.client.1.smithi159.stdout:4/318: dread d0/d8/d15/f27 [0,4194304] 0 2022-02-02T18:21:58.738 INFO:tasks.workunit.client.1.smithi159.stdout:4/319: dread d0/d8/d14/f34 [0,4194304] 0 2022-02-02T18:21:58.739 INFO:tasks.workunit.client.1.smithi159.stdout:2/385: dwrite da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:21:58.739 INFO:tasks.workunit.client.1.smithi159.stdout:4/320: creat d0/d8/d24/d76/f78 x:0 0 0 2022-02-02T18:21:58.740 INFO:tasks.workunit.client.1.smithi159.stdout:4/321: chown d0/d66/f73 6096844 1 2022-02-02T18:21:58.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/386: creat da/d1c/d47/d6b/d5a/d7e/f82 x:0 0 0 2022-02-02T18:21:58.751 INFO:tasks.workunit.client.1.smithi159.stdout:4/322: write d0/d8/d41/f4d [208483,9719] 0 2022-02-02T18:21:58.753 INFO:tasks.workunit.client.1.smithi159.stdout:4/323: rename d0/c2 to d0/d8/d30/d5d/c79 0 2022-02-02T18:21:58.759 INFO:tasks.workunit.client.1.smithi159.stdout:2/387: dwrite da/d1c/d47/d54/f5f [8388608,4194304] 0 2022-02-02T18:21:58.759 INFO:tasks.workunit.client.1.smithi159.stdout:2/388: write da/d1c/f1f [187083,126222] 0 2022-02-02T18:21:58.759 INFO:tasks.workunit.client.1.smithi159.stdout:2/389: truncate da/d1c/f1f 628139 0 2022-02-02T18:21:58.760 INFO:tasks.workunit.client.1.smithi159.stdout:2/390: write da/d48/d6d/f43 [892058,33136] 0 2022-02-02T18:21:58.767 INFO:tasks.workunit.client.1.smithi159.stdout:4/324: dwrite d0/d8/d24/f68 [0,4194304] 0 2022-02-02T18:21:58.770 INFO:tasks.workunit.client.1.smithi159.stdout:4/325: creat d0/d8/d14/d33/d47/d56/f7a x:0 0 0 2022-02-02T18:21:58.787 INFO:tasks.workunit.client.1.smithi159.stdout:2/391: dwrite da/d48/d6d/f43 [0,4194304] 0 2022-02-02T18:21:58.789 INFO:tasks.workunit.client.1.smithi159.stdout:2/392: mkdir da/d48/d83 0 2022-02-02T18:21:58.791 INFO:tasks.workunit.client.1.smithi159.stdout:2/393: getdents da 0 2022-02-02T18:21:58.794 INFO:tasks.workunit.client.1.smithi159.stdout:2/394: unlink da/f75 0 2022-02-02T18:21:58.796 INFO:tasks.workunit.client.1.smithi159.stdout:2/395: symlink da/d1c/d47/l84 0 2022-02-02T18:21:58.798 INFO:tasks.workunit.client.1.smithi159.stdout:2/396: rename da/d1c/d25/d73/l74 to da/d48/d6d/d3e/l85 0 2022-02-02T18:21:58.799 INFO:tasks.workunit.client.1.smithi159.stdout:4/326: dwrite d0/d8/d15/f2a [0,4194304] 0 2022-02-02T18:21:58.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/327: truncate d0/ff 453679 0 2022-02-02T18:21:58.812 INFO:tasks.workunit.client.1.smithi159.stdout:4/328: dread - d0/d8/d14/d33/f45 zero size 2022-02-02T18:21:58.812 INFO:tasks.workunit.client.1.smithi159.stdout:4/329: fdatasync d0/d8/d24/f42 0 2022-02-02T18:21:58.812 INFO:tasks.workunit.client.1.smithi159.stdout:4/330: truncate d0/d8/d15/f57 47891 0 2022-02-02T18:21:58.813 INFO:tasks.workunit.client.1.smithi159.stdout:4/331: readlink d0/d8/d30/l6e 0 2022-02-02T18:21:58.813 INFO:tasks.workunit.client.1.smithi159.stdout:4/332: readlink d0/d8/d15/d61/l77 0 2022-02-02T18:21:58.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/397: dwrite da/d1c/d47/d6b/f80 [0,4194304] 0 2022-02-02T18:21:58.840 INFO:tasks.workunit.client.1.smithi159.stdout:4/333: dwrite d0/f3 [8388608,4194304] 0 2022-02-02T18:21:58.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/398: dwrite da/d1c/d29/f6a [0,4194304] 0 2022-02-02T18:21:58.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/399: fsync da/d1c/d25/f69 0 2022-02-02T18:21:58.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/334: dread d0/f5b [0,4194304] 0 2022-02-02T18:21:58.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/335: chown d0/f2b 24 1 2022-02-02T18:21:58.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/336: fsync d0/d8/d15/f27 0 2022-02-02T18:21:58.850 INFO:tasks.workunit.client.1.smithi159.stdout:2/400: mknod da/c86 0 2022-02-02T18:21:58.851 INFO:tasks.workunit.client.1.smithi159.stdout:2/401: creat da/d1c/d76/f87 x:0 0 0 2022-02-02T18:21:58.872 INFO:tasks.workunit.client.1.smithi159.stdout:4/337: dwrite d0/d8/d14/d33/d47/f4e [0,4194304] 0 2022-02-02T18:21:58.872 INFO:tasks.workunit.client.1.smithi159.stdout:4/338: fsync d0/d8/d15/f69 0 2022-02-02T18:21:58.874 INFO:tasks.workunit.client.1.smithi159.stdout:4/339: mkdir d0/d7b 0 2022-02-02T18:21:58.879 INFO:tasks.workunit.client.1.smithi159.stdout:2/402: dwrite f9 [0,4194304] 0 2022-02-02T18:21:58.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/403: creat da/d40/f88 x:0 0 0 2022-02-02T18:21:58.895 INFO:tasks.workunit.client.1.smithi159.stdout:4/340: dwrite d0/d8/d41/f5e [0,4194304] 0 2022-02-02T18:21:58.896 INFO:tasks.workunit.client.1.smithi159.stdout:4/341: write d0/d8/d24/d4f/f72 [2209798,110563] 0 2022-02-02T18:21:58.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/404: dread da/d1c/d47/f64 [0,4194304] 0 2022-02-02T18:21:58.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/405: stat da/d1c/d25 0 2022-02-02T18:21:58.905 INFO:tasks.workunit.client.1.smithi159.stdout:2/406: dread - da/d1c/d47/d6b/d59/f6f zero size 2022-02-02T18:21:58.906 INFO:tasks.workunit.client.1.smithi159.stdout:2/407: creat da/d48/d83/f89 x:0 0 0 2022-02-02T18:21:58.907 INFO:tasks.workunit.client.1.smithi159.stdout:2/408: creat da/d1c/d42/d70/f8a x:0 0 0 2022-02-02T18:21:58.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/409: creat da/d1c/d47/d6b/d7c/f8b x:0 0 0 2022-02-02T18:21:58.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/410: creat da/d1c/d76/f8c x:0 0 0 2022-02-02T18:21:58.910 INFO:tasks.workunit.client.1.smithi159.stdout:2/411: truncate da/d48/d6d/f34 3429990 0 2022-02-02T18:21:58.910 INFO:tasks.workunit.client.1.smithi159.stdout:2/412: fdatasync da/d1c/d29/f6a 0 2022-02-02T18:21:58.911 INFO:tasks.workunit.client.1.smithi159.stdout:2/413: creat da/d48/d6d/f8d x:0 0 0 2022-02-02T18:21:58.913 INFO:tasks.workunit.client.1.smithi159.stdout:2/414: rename da/d1c/d47/d6b/c4f to da/c8e 0 2022-02-02T18:21:58.914 INFO:tasks.workunit.client.1.smithi159.stdout:2/415: dread - da/d1c/d47/f79 zero size 2022-02-02T18:21:58.915 INFO:tasks.workunit.client.1.smithi159.stdout:4/342: dread d0/d8/d14/d33/d47/f4e [0,4194304] 0 2022-02-02T18:21:58.923 INFO:tasks.workunit.client.1.smithi159.stdout:4/343: dread d0/d8/d41/f4d [0,4194304] 0 2022-02-02T18:21:58.925 INFO:tasks.workunit.client.1.smithi159.stdout:4/344: creat d0/d8/f7c x:0 0 0 2022-02-02T18:21:58.925 INFO:tasks.workunit.client.1.smithi159.stdout:4/345: fsync d0/d8/d14/d36/d4b/f54 0 2022-02-02T18:21:58.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/416: dwrite da/d40/f1d [0,4194304] 0 2022-02-02T18:21:58.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/417: getdents da/d40/d61/d6c 0 2022-02-02T18:21:58.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/418: stat da/d1c/d25/c3a 0 2022-02-02T18:21:58.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/419: readlink da/d40/le 0 2022-02-02T18:21:58.940 INFO:tasks.workunit.client.1.smithi159.stdout:2/420: dread - da/d1c/f6e zero size 2022-02-02T18:21:58.940 INFO:tasks.workunit.client.1.smithi159.stdout:2/421: creat da/d40/d61/f8f x:0 0 0 2022-02-02T18:21:58.941 INFO:tasks.workunit.client.1.smithi159.stdout:2/422: read da/d1c/f26 [4095078,85328] 0 2022-02-02T18:21:58.949 INFO:tasks.workunit.client.1.smithi159.stdout:2/423: dread da/d1c/d25/f69 [0,4194304] 0 2022-02-02T18:21:58.950 INFO:tasks.workunit.client.1.smithi159.stdout:2/424: symlink da/d40/d61/d6c/l90 0 2022-02-02T18:21:58.951 INFO:tasks.workunit.client.1.smithi159.stdout:2/425: symlink da/d1c/d29/l91 0 2022-02-02T18:21:58.951 INFO:tasks.workunit.client.1.smithi159.stdout:2/426: creat da/d48/d6d/f92 x:0 0 0 2022-02-02T18:21:58.951 INFO:tasks.workunit.client.1.smithi159.stdout:2/427: stat da/d1c 0 2022-02-02T18:21:58.952 INFO:tasks.workunit.client.1.smithi159.stdout:2/428: read da/d1c/f1f [32429,73271] 0 2022-02-02T18:21:58.953 INFO:tasks.workunit.client.1.smithi159.stdout:2/429: write f8 [1967101,112962] 0 2022-02-02T18:22:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:59 smithi159 conmon[35668]: cluster 2022-02-02T18:21:58.833097+0000 mgr.smithi096.shfutl (mgr.14162) 288 : cluster 2022-02-02T18:22:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:21:59 smithi159 conmon[35668]: [DBG] pgmap v233: 65 pgs: 65 active+clean; 881 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 MiB/s rd, 93 MiB/s wr, 309 op/s 2022-02-02T18:22:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:59 smithi096 conmon[32067]: cluster 2022-02-02T18:21:58.833097+0000 mgr.smithi096.shfutl 2022-02-02T18:22:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:21:59 smithi096 conmon[32067]: (mgr.14162) 288 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 881 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 MiB/s rd, 93 MiB/s wr, 309 op/s 2022-02-02T18:22:00.586 INFO:tasks.workunit.client.1.smithi159.stdout:9/249: sync 2022-02-02T18:22:00.594 INFO:tasks.workunit.client.1.smithi159.stdout:9/250: mknod d4/d19/d1c/d1f/c52 0 2022-02-02T18:22:00.594 INFO:tasks.workunit.client.1.smithi159.stdout:9/251: chown d4/d2a/f34 102236773 1 2022-02-02T18:22:00.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/252: symlink d4/d19/l53 0 2022-02-02T18:22:00.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/253: chown d4/d19/d1c/f44 25655853 1 2022-02-02T18:22:00.598 INFO:tasks.workunit.client.1.smithi159.stdout:9/254: creat d4/d19/d1c/f54 x:0 0 0 2022-02-02T18:22:00.613 INFO:tasks.workunit.client.1.smithi159.stdout:9/255: dread d4/d19/f1a [8388608,4194304] 0 2022-02-02T18:22:00.617 INFO:tasks.workunit.client.1.smithi159.stdout:9/256: dread d4/d2a/f34 [4194304,4194304] 0 2022-02-02T18:22:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:01 smithi159 conmon[35668]: cluster 2022-02-02T18:22:00.833521+0000 mgr.smithi096.shfutl (mgr.14162) 289 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 894 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 47 MiB/s rd, 96 MiB/s wr, 332 op/s 2022-02-02T18:22:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:01 smithi096 conmon[32067]: cluster 2022-02-02T18:22:00.833521+0000 mgr.smithi096.shfutl (mgr.14162 2022-02-02T18:22:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:01 smithi096 conmon[32067]: ) 289 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 894 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 47 MiB/s rd, 96 MiB/s wr, 332 op/s 2022-02-02T18:22:04.163 INFO:tasks.workunit.client.1.smithi159.stdout:1/294: sync 2022-02-02T18:22:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:3/314: sync 2022-02-02T18:22:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:2/430: sync 2022-02-02T18:22:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:9/257: sync 2022-02-02T18:22:04.165 INFO:tasks.workunit.client.1.smithi159.stdout:6/332: sync 2022-02-02T18:22:04.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/421: sync 2022-02-02T18:22:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/346: sync 2022-02-02T18:22:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/347: write d0/f29 [1332909,109243] 0 2022-02-02T18:22:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/348: chown d0/d8/d15/d61/f6d 53976183 1 2022-02-02T18:22:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:0/298: sync 2022-02-02T18:22:04.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/247: sync 2022-02-02T18:22:04.168 INFO:tasks.workunit.client.1.smithi159.stdout:7/332: sync 2022-02-02T18:22:04.168 INFO:tasks.workunit.client.1.smithi159.stdout:7/333: chown d3/d5/d56/d2f/d5b 0 1 2022-02-02T18:22:04.168 INFO:tasks.workunit.client.1.smithi159.stdout:7/334: fsync d3/d6/f40 0 2022-02-02T18:22:04.170 INFO:tasks.workunit.client.1.smithi159.stdout:9/258: mkdir d4/d19/d1c/d21/d22/d55 0 2022-02-02T18:22:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:6/333: symlink df/d35/d2a/d3f/d42/d47/d59/d66/l67 0 2022-02-02T18:22:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:1/295: rmdir df/d14/d16/d4b/d5b/d64 0 2022-02-02T18:22:04.173 INFO:tasks.workunit.client.1.smithi159.stdout:1/296: fsync df/d14/d16/d4a/f44 0 2022-02-02T18:22:04.177 INFO:tasks.workunit.client.1.smithi159.stdout:8/248: mknod d1/dd/d31/d4a/c5e 0 2022-02-02T18:22:04.178 INFO:tasks.workunit.client.1.smithi159.stdout:9/259: getdents d4 0 2022-02-02T18:22:04.182 INFO:tasks.workunit.client.1.smithi159.stdout:4/349: creat d0/d8/d30/d5d/f7d x:0 0 0 2022-02-02T18:22:04.182 INFO:tasks.workunit.client.1.smithi159.stdout:4/350: read - d0/d8/d14/d33/d47/f53 zero size 2022-02-02T18:22:04.182 INFO:tasks.workunit.client.1.smithi159.stdout:6/334: rename df/f15 to df/d35/d2a/d2f/f68 0 2022-02-02T18:22:04.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/351: mkdir d0/d8/d30/d7e 0 2022-02-02T18:22:04.188 INFO:tasks.workunit.client.1.smithi159.stdout:1/297: mkdir df/d14/d16/d6d 0 2022-02-02T18:22:04.188 INFO:tasks.workunit.client.1.smithi159.stdout:6/335: dread f7 [0,4194304] 0 2022-02-02T18:22:04.190 INFO:tasks.workunit.client.1.smithi159.stdout:1/298: mknod df/c6e 0 2022-02-02T18:22:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:6/336: unlink df/d35/d2a/d3f/d42/d47/d60/d62/l5a 0 2022-02-02T18:22:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:6/337: write fd [5079483,22891] 0 2022-02-02T18:22:04.196 INFO:tasks.workunit.client.1.smithi159.stdout:6/338: write df/d35/d2a/d3f/f44 [1321903,83235] 0 2022-02-02T18:22:04.196 INFO:tasks.workunit.client.1.smithi159.stdout:6/339: fsync df/d35/d2a/d2f/f4a 0 2022-02-02T18:22:04.197 INFO:tasks.workunit.client.1.smithi159.stdout:9/260: write d4/f11 [295895,91763] 0 2022-02-02T18:22:04.197 INFO:tasks.workunit.client.1.smithi159.stdout:9/261: truncate d4/f14 4773125 0 2022-02-02T18:22:04.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/340: creat df/d35/d2a/d3f/d42/d47/d60/d61/f69 x:0 0 0 2022-02-02T18:22:04.202 INFO:tasks.workunit.client.1.smithi159.stdout:9/262: unlink d4/f17 0 2022-02-02T18:22:04.203 INFO:tasks.workunit.client.1.smithi159.stdout:6/341: mkdir df/d35/d2a/d3f/d55/d6a 0 2022-02-02T18:22:04.204 INFO:tasks.workunit.client.1.smithi159.stdout:1/299: dread df/d14/d16/d4a/f59 [0,4194304] 0 2022-02-02T18:22:04.204 INFO:tasks.workunit.client.1.smithi159.stdout:1/300: write df/d14/f39 [1010459,42606] 0 2022-02-02T18:22:04.205 INFO:tasks.workunit.client.1.smithi159.stdout:4/352: write d0/d8/d41/f5e [1479889,91492] 0 2022-02-02T18:22:04.206 INFO:tasks.workunit.client.1.smithi159.stdout:6/342: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d6b 0 2022-02-02T18:22:04.207 INFO:tasks.workunit.client.1.smithi159.stdout:4/353: symlink d0/d8/d30/d7e/l7f 0 2022-02-02T18:22:04.209 INFO:tasks.workunit.client.1.smithi159.stdout:6/343: creat df/d35/d2a/d3f/d65/f6c x:0 0 0 2022-02-02T18:22:04.210 INFO:tasks.workunit.client.1.smithi159.stdout:4/354: mknod d0/d8/d14/d33/d47/c80 0 2022-02-02T18:22:04.210 INFO:tasks.workunit.client.1.smithi159.stdout:4/355: chown d0/d8/d14/d33/c6b 1238 1 2022-02-02T18:22:04.210 INFO:tasks.workunit.client.1.smithi159.stdout:4/356: truncate d0/d8/d14/d33/f45 533510 0 2022-02-02T18:22:04.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/301: dread f7 [0,4194304] 0 2022-02-02T18:22:04.211 INFO:tasks.workunit.client.1.smithi159.stdout:3/315: dwrite dd/f18 [0,4194304] 0 2022-02-02T18:22:04.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/344: link df/d35/d2a/d3f/d42/c26 df/d35/d2a/d3f/c6d 0 2022-02-02T18:22:04.212 INFO:tasks.workunit.client.1.smithi159.stdout:2/431: dwrite da/d1c/d29/f6a [0,4194304] 0 2022-02-02T18:22:04.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/345: write f1 [5682616,63096] 0 2022-02-02T18:22:04.215 INFO:tasks.workunit.client.1.smithi159.stdout:5/422: dwrite d9/d24/f16 [0,4194304] 0 2022-02-02T18:22:04.216 INFO:tasks.workunit.client.1.smithi159.stdout:7/335: dwrite d3/d27/d29/f61 [0,4194304] 0 2022-02-02T18:22:04.217 INFO:tasks.workunit.client.1.smithi159.stdout:1/302: rename df/d21/d23/l63 to df/d14/d16/d35/l6f 0 2022-02-02T18:22:04.217 INFO:tasks.workunit.client.1.smithi159.stdout:1/303: readlink df/d14/d16/l27 0 2022-02-02T18:22:04.217 INFO:tasks.workunit.client.1.smithi159.stdout:0/299: dwrite d1/dd/f6d [0,4194304] 0 2022-02-02T18:22:04.218 INFO:tasks.workunit.client.1.smithi159.stdout:5/423: truncate d9/d24/d21/d44/f65 1201928 0 2022-02-02T18:22:04.219 INFO:tasks.workunit.client.1.smithi159.stdout:5/424: symlink d9/d24/d37/d23/d68/l7c 0 2022-02-02T18:22:04.220 INFO:tasks.workunit.client.1.smithi159.stdout:5/425: chown d9/d24/d38/f73 42375 1 2022-02-02T18:22:04.223 INFO:tasks.workunit.client.1.smithi159.stdout:9/263: dread d4/d19/f31 [0,4194304] 0 2022-02-02T18:22:04.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/426: creat d9/d24/d37/f7d x:0 0 0 2022-02-02T18:22:04.239 INFO:tasks.workunit.client.1.smithi159.stdout:5/427: write d9/f7a [883109,124875] 0 2022-02-02T18:22:04.239 INFO:tasks.workunit.client.1.smithi159.stdout:5/428: dread - d9/d24/d21/f66 zero size 2022-02-02T18:22:04.240 INFO:tasks.workunit.client.1.smithi159.stdout:3/316: mkdir dd/d66/d69 0 2022-02-02T18:22:04.241 INFO:tasks.workunit.client.1.smithi159.stdout:3/317: stat dd/d19/f23 0 2022-02-02T18:22:04.241 INFO:tasks.workunit.client.1.smithi159.stdout:2/432: creat da/d48/d6d/f93 x:0 0 0 2022-02-02T18:22:04.241 INFO:tasks.workunit.client.1.smithi159.stdout:2/433: chown da/d48/d6d 1930 1 2022-02-02T18:22:04.241 INFO:tasks.workunit.client.1.smithi159.stdout:2/434: truncate da/d1c/d47/d6b/d5a/f66 42950 0 2022-02-02T18:22:04.242 INFO:tasks.workunit.client.1.smithi159.stdout:2/435: read - da/d1c/d42/d70/f8a zero size 2022-02-02T18:22:04.244 INFO:tasks.workunit.client.1.smithi159.stdout:4/357: rmdir d0 39 2022-02-02T18:22:04.244 INFO:tasks.workunit.client.1.smithi159.stdout:5/429: creat d9/d24/d37/d23/d68/f7e x:0 0 0 2022-02-02T18:22:04.247 INFO:tasks.workunit.client.1.smithi159.stdout:5/430: creat d9/d24/d21/d44/f7f x:0 0 0 2022-02-02T18:22:04.247 INFO:tasks.workunit.client.1.smithi159.stdout:5/431: creat d9/d24/d21/f80 x:0 0 0 2022-02-02T18:22:04.248 INFO:tasks.workunit.client.1.smithi159.stdout:5/432: dread - d9/d24/d21/d44/f6e zero size 2022-02-02T18:22:04.256 INFO:tasks.workunit.client.1.smithi159.stdout:6/346: dwrite fd [0,4194304] 0 2022-02-02T18:22:04.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/304: creat df/d14/d68/f70 x:0 0 0 2022-02-02T18:22:04.257 INFO:tasks.workunit.client.1.smithi159.stdout:9/264: mkdir d4/d19/d1c/d21/d56 0 2022-02-02T18:22:04.259 INFO:tasks.workunit.client.1.smithi159.stdout:0/300: mknod d1/d11/d38/c6e 0 2022-02-02T18:22:04.263 INFO:tasks.workunit.client.1.smithi159.stdout:4/358: creat d0/d8/d14/d33/d47/d56/f81 x:0 0 0 2022-02-02T18:22:04.263 INFO:tasks.workunit.client.1.smithi159.stdout:6/347: truncate df/f16 4106169 0 2022-02-02T18:22:04.266 INFO:tasks.workunit.client.1.smithi159.stdout:5/433: write d9/d24/d37/d23/f3f [4711946,37502] 0 2022-02-02T18:22:04.266 INFO:tasks.workunit.client.1.smithi159.stdout:5/434: creat d9/d24/d21/f81 x:0 0 0 2022-02-02T18:22:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:9/265: truncate d4/d19/f36 141639 0 2022-02-02T18:22:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/305: mknod df/d14/d16/d6d/c71 0 2022-02-02T18:22:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/306: chown df/d21/d23/d49/d69 0 1 2022-02-02T18:22:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/318: dwrite dd/d19/d38/d3f/f4d [0,4194304] 0 2022-02-02T18:22:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/319: truncate dd/d19/d38/f55 4309012 0 2022-02-02T18:22:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/320: read - dd/d19/d38/d3f/d52/f5b zero size 2022-02-02T18:22:04.273 INFO:tasks.workunit.client.1.smithi159.stdout:5/435: dread d9/d24/d37/f3a [4194304,4194304] 0 2022-02-02T18:22:04.273 INFO:tasks.workunit.client.1.smithi159.stdout:4/359: dread d0/d8/d30/f37 [0,4194304] 0 2022-02-02T18:22:04.274 INFO:tasks.workunit.client.1.smithi159.stdout:9/266: creat d4/d19/f57 x:0 0 0 2022-02-02T18:22:04.275 INFO:tasks.workunit.client.1.smithi159.stdout:6/348: write df/d35/d2a/d3f/f44 [1531269,8945] 0 2022-02-02T18:22:04.275 INFO:tasks.workunit.client.1.smithi159.stdout:2/436: dwrite f9 [0,4194304] 0 2022-02-02T18:22:04.275 INFO:tasks.workunit.client.1.smithi159.stdout:2/437: readlink da/d48/d6d/d3e/l85 0 2022-02-02T18:22:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:03 smithi159 conmon[35668]: cluster 2022-02-02T18:22:02.833988+0000 mgr.smithi096.shfutl (mgr.14162) 290 : cluster 2022-02-02T18:22:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:03 smithi159 conmon[35668]: [DBG] pgmap v235: 65 pgs: 65 active+clean; 968 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 54 MiB/s rd, 110 MiB/s wr, 404 op/s 2022-02-02T18:22:04.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:03 smithi159 conmon[35668]: audit 2022-02-02T18:22:03.774914+0000 mon.smithi096 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:04.278 INFO:tasks.workunit.client.1.smithi159.stdout:5/436: symlink d9/d24/d38/d3c/d61/l82 0 2022-02-02T18:22:04.278 INFO:tasks.workunit.client.1.smithi159.stdout:9/267: symlink d4/l58 0 2022-02-02T18:22:04.281 INFO:tasks.workunit.client.1.smithi159.stdout:2/438: rename da/d40/l41 to da/d40/d61/l94 0 2022-02-02T18:22:04.282 INFO:tasks.workunit.client.1.smithi159.stdout:2/439: chown da/d1c/f32 8725932 1 2022-02-02T18:22:04.282 INFO:tasks.workunit.client.1.smithi159.stdout:2/440: chown da/d1c/d76/f8c 158 1 2022-02-02T18:22:04.282 INFO:tasks.workunit.client.1.smithi159.stdout:9/268: chown d4/d19/d1c/d21/d22/c2d 544644158 1 2022-02-02T18:22:04.283 INFO:tasks.workunit.client.1.smithi159.stdout:9/269: readlink d4/l58 0 2022-02-02T18:22:04.286 INFO:tasks.workunit.client.1.smithi159.stdout:0/301: dwrite d1/d11/d1d/d34/f4a [0,4194304] 0 2022-02-02T18:22:04.286 INFO:tasks.workunit.client.1.smithi159.stdout:2/441: rename da/d1c/d76/f8c to da/d48/d83/f95 0 2022-02-02T18:22:04.293 INFO:tasks.workunit.client.1.smithi159.stdout:9/270: mkdir d4/d19/d1c/d21/d56/d59 0 2022-02-02T18:22:04.293 INFO:tasks.workunit.client.1.smithi159.stdout:9/271: stat d4/f14 0 2022-02-02T18:22:04.297 INFO:tasks.workunit.client.1.smithi159.stdout:0/302: mknod d1/dd/c6f 0 2022-02-02T18:22:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/272: creat d4/d19/d1c/d21/d56/d59/f5a x:0 0 0 2022-02-02T18:22:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/442: rmdir da/d1c/d47/d6b/d59 39 2022-02-02T18:22:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/443: readlink l6 0 2022-02-02T18:22:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/444: write da/d1c/d42/f81 [237102,30878] 0 2022-02-02T18:22:04.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/303: write d1/d19/f29 [1572684,36304] 0 2022-02-02T18:22:04.305 INFO:tasks.workunit.client.1.smithi159.stdout:9/273: rename d4/d19/d42/d43 to d4/d19/d1c/d21/d56/d5b 0 2022-02-02T18:22:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:03 smithi096 conmon[32067]: cluster 2022-02-02T18:22:02.833988+0000 mgr.smithi096.shfutl ( 2022-02-02T18:22:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:03 smithi096 conmon[32067]: mgr.14162) 290 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 968 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 54 MiB/s rd, 110 MiB/s wr, 404 op/s 2022-02-02T18:22:04.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:03 smithi096 conmon[32067]: audit 2022-02-02T18:22:03.774914+0000 mon.smithi096 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:04.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/274: mknod d4/d19/d1c/d1f/d4c/c5c 0 2022-02-02T18:22:04.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/275: fdatasync d4/d19/d1c/d1f/f24 0 2022-02-02T18:22:04.311 INFO:tasks.workunit.client.1.smithi159.stdout:9/276: readlink d4/d19/d1c/l51 0 2022-02-02T18:22:04.312 INFO:tasks.workunit.client.1.smithi159.stdout:4/360: dwrite d0/f2d [0,4194304] 0 2022-02-02T18:22:04.313 INFO:tasks.workunit.client.1.smithi159.stdout:3/321: dwrite dd/d19/d35/f44 [0,4194304] 0 2022-02-02T18:22:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:4/361: rename d0/d8/d15/d61/f6d to d0/d8/d30/d7e/f82 0 2022-02-02T18:22:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:5/437: dwrite d9/d2e/f5d [4194304,4194304] 0 2022-02-02T18:22:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:6/349: dwrite df/d35/d2a/d3f/d42/f4b [0,4194304] 0 2022-02-02T18:22:04.317 INFO:tasks.workunit.client.1.smithi159.stdout:5/438: dread - d9/d24/d21/f80 zero size 2022-02-02T18:22:04.318 INFO:tasks.workunit.client.1.smithi159.stdout:4/362: write d0/d8/d14/d33/f50 [1079471,38838] 0 2022-02-02T18:22:04.318 INFO:tasks.workunit.client.1.smithi159.stdout:4/363: readlink d0/d8/l1b 0 2022-02-02T18:22:04.320 INFO:tasks.workunit.client.1.smithi159.stdout:5/439: rename d9/d24/d37/c3e to d9/d24/d37/d23/c83 0 2022-02-02T18:22:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:9/277: write d4/d19/f3e [255403,34836] 0 2022-02-02T18:22:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:9/278: dread - d4/d19/d1c/d1f/f4d zero size 2022-02-02T18:22:04.324 INFO:tasks.workunit.client.1.smithi159.stdout:9/279: chown d4/d19/d1c/d1f/c3a 13938134 1 2022-02-02T18:22:04.325 INFO:tasks.workunit.client.1.smithi159.stdout:6/350: mkdir df/d35/d2a/d3f/d55/d6a/d6e 0 2022-02-02T18:22:04.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/322: creat dd/d20/d2a/d3a/f6a x:0 0 0 2022-02-02T18:22:04.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/323: read - dd/d20/d2a/f68 zero size 2022-02-02T18:22:04.326 INFO:tasks.workunit.client.1.smithi159.stdout:4/364: link d0/d8/d14/l2c d0/d8/d30/d5d/l83 0 2022-02-02T18:22:04.326 INFO:tasks.workunit.client.1.smithi159.stdout:4/365: chown d0/d8/la 124205 1 2022-02-02T18:22:04.327 INFO:tasks.workunit.client.1.smithi159.stdout:9/280: rename d4/l25 to d4/d2a/l5d 0 2022-02-02T18:22:04.328 INFO:tasks.workunit.client.1.smithi159.stdout:2/445: dwrite da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:22:04.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/366: symlink d0/d8/d30/l84 0 2022-02-02T18:22:04.329 INFO:tasks.workunit.client.1.smithi159.stdout:3/324: symlink dd/d19/d35/d53/l6b 0 2022-02-02T18:22:04.335 INFO:tasks.workunit.client.1.smithi159.stdout:6/351: write df/f14 [2167670,126323] 0 2022-02-02T18:22:04.337 INFO:tasks.workunit.client.1.smithi159.stdout:2/446: mknod da/d1c/d47/d6b/d59/c96 0 2022-02-02T18:22:04.339 INFO:tasks.workunit.client.1.smithi159.stdout:3/325: creat dd/d19/d38/f6c x:0 0 0 2022-02-02T18:22:04.343 INFO:tasks.workunit.client.1.smithi159.stdout:6/352: rename df/c41 to df/d35/d2a/d3f/d65/c6f 0 2022-02-02T18:22:04.343 INFO:tasks.workunit.client.1.smithi159.stdout:6/353: fsync df/f2e 0 2022-02-02T18:22:04.345 INFO:tasks.workunit.client.1.smithi159.stdout:6/354: mknod df/d35/d2a/d3f/d42/d47/c70 0 2022-02-02T18:22:04.346 INFO:tasks.workunit.client.1.smithi159.stdout:9/281: dwrite d4/d19/d1c/d1f/f3f [0,4194304] 0 2022-02-02T18:22:04.347 INFO:tasks.workunit.client.1.smithi159.stdout:2/447: unlink da/l35 0 2022-02-02T18:22:04.349 INFO:tasks.workunit.client.1.smithi159.stdout:6/355: link df/d35/d2a/d3f/d42/f4b df/d35/f71 0 2022-02-02T18:22:04.350 INFO:tasks.workunit.client.1.smithi159.stdout:6/356: chown df/d35/d2a/d3f/d65/f6c 7833 1 2022-02-02T18:22:04.350 INFO:tasks.workunit.client.1.smithi159.stdout:6/357: write df/d35/d2a/d2f/f37 [3184080,68098] 0 2022-02-02T18:22:04.351 INFO:tasks.workunit.client.1.smithi159.stdout:6/358: write df/d35/f57 [5039946,8666] 0 2022-02-02T18:22:04.353 INFO:tasks.workunit.client.1.smithi159.stdout:9/282: creat d4/d2a/f5e x:0 0 0 2022-02-02T18:22:04.355 INFO:tasks.workunit.client.1.smithi159.stdout:6/359: rename df/d35/d2a/d3f/d42/c4d to df/d35/d2a/d3f/d42/d47/d59/c72 0 2022-02-02T18:22:04.356 INFO:tasks.workunit.client.1.smithi159.stdout:2/448: getdents da/d1c/d42/d70 0 2022-02-02T18:22:04.356 INFO:tasks.workunit.client.1.smithi159.stdout:2/449: write da/d48/d6d/f34 [4142680,112097] 0 2022-02-02T18:22:04.357 INFO:tasks.workunit.client.1.smithi159.stdout:2/450: fdatasync da/d1c/d47/d6b/d5a/f66 0 2022-02-02T18:22:04.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/283: write d4/d19/d1c/d1f/f20 [1528915,37204] 0 2022-02-02T18:22:04.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/367: write d0/d8/d41/f5e [50100,22801] 0 2022-02-02T18:22:04.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/368: chown d0/f25 19 1 2022-02-02T18:22:04.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/369: dread - d0/d8/d30/d7e/f82 zero size 2022-02-02T18:22:04.359 INFO:tasks.workunit.client.1.smithi159.stdout:6/360: creat df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f73 x:0 0 0 2022-02-02T18:22:04.359 INFO:tasks.workunit.client.1.smithi159.stdout:6/361: dread df/d35/d2a/d2f/f68 [0,4194304] 0 2022-02-02T18:22:04.360 INFO:tasks.workunit.client.1.smithi159.stdout:2/451: mknod da/d1c/d76/c97 0 2022-02-02T18:22:04.360 INFO:tasks.workunit.client.1.smithi159.stdout:2/452: dread - da/d1c/d29/f4b zero size 2022-02-02T18:22:04.363 INFO:tasks.workunit.client.1.smithi159.stdout:3/326: dwrite dd/d19/d35/f59 [0,4194304] 0 2022-02-02T18:22:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:4/370: getdents d0/d8/d30/d7e 0 2022-02-02T18:22:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:4/371: stat d0/d8/d15/f57 0 2022-02-02T18:22:04.371 INFO:tasks.workunit.client.1.smithi159.stdout:9/284: dread d4/d19/f1e [0,4194304] 0 2022-02-02T18:22:04.375 INFO:tasks.workunit.client.1.smithi159.stdout:2/453: link da/d48/d6d/d3e/f56 da/d40/f98 0 2022-02-02T18:22:04.375 INFO:tasks.workunit.client.1.smithi159.stdout:6/362: creat df/d35/f74 x:0 0 0 2022-02-02T18:22:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:2/454: write da/d40/f37 [425098,103602] 0 2022-02-02T18:22:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:2/455: creat da/d48/d6d/f99 x:0 0 0 2022-02-02T18:22:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:2/456: creat da/d48/f9a x:0 0 0 2022-02-02T18:22:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:6/363: write df/d35/f36 [927625,55107] 0 2022-02-02T18:22:04.377 INFO:tasks.workunit.client.1.smithi159.stdout:6/364: write df/d35/d2a/d2f/f68 [480280,38232] 0 2022-02-02T18:22:04.378 INFO:tasks.workunit.client.1.smithi159.stdout:3/327: mknod dd/d20/d2a/d3a/c6d 0 2022-02-02T18:22:04.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/328: read dd/d19/d35/f4c [581197,87638] 0 2022-02-02T18:22:04.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/329: fsync dd/f34 0 2022-02-02T18:22:04.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/330: write dd/d20/d2a/f4a [441866,20626] 0 2022-02-02T18:22:04.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/285: write d4/d19/f1a [3720880,59130] 0 2022-02-02T18:22:04.381 INFO:tasks.workunit.client.1.smithi159.stdout:2/457: creat da/d1c/d47/d54/f9b x:0 0 0 2022-02-02T18:22:04.381 INFO:tasks.workunit.client.1.smithi159.stdout:2/458: creat da/d48/d6d/d3e/f9c x:0 0 0 2022-02-02T18:22:04.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/365: mknod df/d35/d2a/d3f/c75 0 2022-02-02T18:22:04.384 INFO:tasks.workunit.client.1.smithi159.stdout:9/286: mknod d4/d19/d1c/c5f 0 2022-02-02T18:22:04.384 INFO:tasks.workunit.client.1.smithi159.stdout:9/287: chown d4/d19/d1c/d1f/f20 3352 1 2022-02-02T18:22:04.385 INFO:tasks.workunit.client.1.smithi159.stdout:2/459: symlink da/d40/d61/l9d 0 2022-02-02T18:22:04.386 INFO:tasks.workunit.client.1.smithi159.stdout:6/366: mknod df/d35/d2a/d3f/d42/d47/d59/c76 0 2022-02-02T18:22:04.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/288: mknod d4/c60 0 2022-02-02T18:22:04.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/289: write d4/d19/f57 [423201,15356] 0 2022-02-02T18:22:04.392 INFO:tasks.workunit.client.1.smithi159.stdout:2/460: symlink da/d48/l9e 0 2022-02-02T18:22:04.393 INFO:tasks.workunit.client.1.smithi159.stdout:6/367: mknod df/d35/d2a/c77 0 2022-02-02T18:22:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:6/368: truncate df/d35/d2a/d3f/f48 818124 0 2022-02-02T18:22:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:6/369: fdatasync df/d35/f74 0 2022-02-02T18:22:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:2/461: rename da/d1c/f6e to da/d1c/d25/f9f 0 2022-02-02T18:22:04.398 INFO:tasks.workunit.client.1.smithi159.stdout:3/331: write f9 [1205414,102025] 0 2022-02-02T18:22:04.399 INFO:tasks.workunit.client.1.smithi159.stdout:3/332: write dd/d20/d2a/f68 [535602,78362] 0 2022-02-02T18:22:04.399 INFO:tasks.workunit.client.1.smithi159.stdout:3/333: fsync dd/d19/f24 0 2022-02-02T18:22:04.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/370: read df/d35/f34 [1557890,76496] 0 2022-02-02T18:22:04.400 INFO:tasks.workunit.client.1.smithi159.stdout:2/462: creat da/d1c/d47/fa0 x:0 0 0 2022-02-02T18:22:04.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/371: creat df/d35/f78 x:0 0 0 2022-02-02T18:22:04.401 INFO:tasks.workunit.client.1.smithi159.stdout:6/372: chown df/d35/d2a/d3f/d55 32686085 1 2022-02-02T18:22:04.401 INFO:tasks.workunit.client.1.smithi159.stdout:2/463: creat da/d1c/d47/d54/fa1 x:0 0 0 2022-02-02T18:22:04.401 INFO:tasks.workunit.client.1.smithi159.stdout:2/464: dread - da/d1c/d42/f72 zero size 2022-02-02T18:22:04.402 INFO:tasks.workunit.client.1.smithi159.stdout:3/334: dread dd/f11 [4194304,4194304] 0 2022-02-02T18:22:04.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/373: mknod df/d35/d2a/d3f/d55/c79 0 2022-02-02T18:22:04.409 INFO:tasks.workunit.client.1.smithi159.stdout:6/374: rename df/f18 to df/d35/d2a/f7a 0 2022-02-02T18:22:04.410 INFO:tasks.workunit.client.1.smithi159.stdout:9/290: dwrite d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:22:04.417 INFO:tasks.workunit.client.1.smithi159.stdout:9/291: mkdir d4/d19/d1c/d21/d22/d61 0 2022-02-02T18:22:04.431 INFO:tasks.workunit.client.1.smithi159.stdout:2/465: dwrite da/d1c/d29/f6a [0,4194304] 0 2022-02-02T18:22:04.432 INFO:tasks.workunit.client.1.smithi159.stdout:2/466: truncate da/f7d 277385 0 2022-02-02T18:22:04.434 INFO:tasks.workunit.client.1.smithi159.stdout:2/467: creat da/d1c/d47/d6b/d59/fa2 x:0 0 0 2022-02-02T18:22:04.435 INFO:tasks.workunit.client.1.smithi159.stdout:2/468: dread - da/d48/d6d/d3e/f9c zero size 2022-02-02T18:22:04.435 INFO:tasks.workunit.client.1.smithi159.stdout:6/375: dwrite df/f1e [0,4194304] 0 2022-02-02T18:22:04.437 INFO:tasks.workunit.client.1.smithi159.stdout:9/292: dwrite d4/f14 [0,4194304] 0 2022-02-02T18:22:04.438 INFO:tasks.workunit.client.1.smithi159.stdout:6/376: mkdir df/d35/d7b 0 2022-02-02T18:22:04.439 INFO:tasks.workunit.client.1.smithi159.stdout:9/293: link d4/d2a/f5e d4/d19/d1c/d21/d56/d5b/f62 0 2022-02-02T18:22:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:6/377: rename df/d35/d2a/d2f/c53 to df/d35/d2a/d3f/d42/d47/d59/c7c 0 2022-02-02T18:22:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:6/378: chown df/d35/d2a/d3f/d42/c23 45975 1 2022-02-02T18:22:04.442 INFO:tasks.workunit.client.1.smithi159.stdout:9/294: symlink d4/d19/d1c/d1f/l63 0 2022-02-02T18:22:04.443 INFO:tasks.workunit.client.1.smithi159.stdout:6/379: symlink df/d35/d2a/d3f/d42/d47/d60/d62/l7d 0 2022-02-02T18:22:04.444 INFO:tasks.workunit.client.1.smithi159.stdout:6/380: rename df/d35/d2a/d2f/f4a to df/d35/d2a/d3f/d42/d47/d60/d62/f7e 0 2022-02-02T18:22:04.446 INFO:tasks.workunit.client.1.smithi159.stdout:2/469: dread da/d40/f98 [0,4194304] 0 2022-02-02T18:22:04.447 INFO:tasks.workunit.client.1.smithi159.stdout:2/470: read da/d1c/d76/f78 [256763,54981] 0 2022-02-02T18:22:04.448 INFO:tasks.workunit.client.1.smithi159.stdout:2/471: mknod da/d1c/d47/d6b/d7c/ca3 0 2022-02-02T18:22:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:2/472: mknod da/ca4 0 2022-02-02T18:22:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:2/473: creat da/d48/d6d/d3e/fa5 x:0 0 0 2022-02-02T18:22:04.450 INFO:tasks.workunit.client.1.smithi159.stdout:2/474: stat l6 0 2022-02-02T18:22:04.452 INFO:tasks.workunit.client.1.smithi159.stdout:2/475: dread da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:22:04.454 INFO:tasks.workunit.client.1.smithi159.stdout:2/476: mknod da/d1c/d76/ca6 0 2022-02-02T18:22:04.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/477: truncate da/d48/d6d/d3e/f7f 1464525 0 2022-02-02T18:22:04.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/478: fdatasync da/d1c/d47/d6b/d5a/d7e/f82 0 2022-02-02T18:22:04.456 INFO:tasks.workunit.client.1.smithi159.stdout:2/479: symlink da/d1c/d25/d73/la7 0 2022-02-02T18:22:04.456 INFO:tasks.workunit.client.1.smithi159.stdout:2/480: creat da/d40/d61/fa8 x:0 0 0 2022-02-02T18:22:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:9/295: dwrite d4/d19/d1c/d1f/f3c [0,4194304] 0 2022-02-02T18:22:04.487 INFO:tasks.workunit.client.1.smithi159.stdout:9/296: mknod d4/c64 0 2022-02-02T18:22:04.488 INFO:tasks.workunit.client.1.smithi159.stdout:9/297: write d4/d19/d1c/d21/f27 [725608,33446] 0 2022-02-02T18:22:04.492 INFO:tasks.workunit.client.1.smithi159.stdout:9/298: mknod d4/d19/d42/c65 0 2022-02-02T18:22:04.493 INFO:tasks.workunit.client.1.smithi159.stdout:9/299: symlink d4/d19/d1c/l66 0 2022-02-02T18:22:04.494 INFO:tasks.workunit.client.1.smithi159.stdout:9/300: chown d4/d19/d1c/c2c 809257 1 2022-02-02T18:22:04.494 INFO:tasks.workunit.client.1.smithi159.stdout:9/301: creat d4/d19/d1c/f67 x:0 0 0 2022-02-02T18:22:04.496 INFO:tasks.workunit.client.1.smithi159.stdout:9/302: creat d4/d19/d1c/d21/d41/f68 x:0 0 0 2022-02-02T18:22:04.496 INFO:tasks.workunit.client.1.smithi159.stdout:9/303: write d4/d19/d1c/d1f/f3f [4204394,4007] 0 2022-02-02T18:22:04.497 INFO:tasks.workunit.client.1.smithi159.stdout:9/304: fdatasync d4/d19/f57 0 2022-02-02T18:22:04.503 INFO:tasks.workunit.client.1.smithi159.stdout:9/305: dread d4/d2a/f40 [0,4194304] 0 2022-02-02T18:22:04.504 INFO:tasks.workunit.client.1.smithi159.stdout:9/306: write d4/d19/f1a [2965674,80183] 0 2022-02-02T18:22:04.505 INFO:tasks.workunit.client.1.smithi159.stdout:9/307: rename d4/d19/d1c/d21/c37 to d4/d19/d1c/d1f/c69 0 2022-02-02T18:22:04.506 INFO:tasks.workunit.client.1.smithi159.stdout:9/308: creat d4/f6a x:0 0 0 2022-02-02T18:22:04.507 INFO:tasks.workunit.client.1.smithi159.stdout:9/309: write d4/d19/d1c/d1f/f3f [3049975,53448] 0 2022-02-02T18:22:04.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/310: creat d4/d19/d1c/d1f/d4c/f6b x:0 0 0 2022-02-02T18:22:04.509 INFO:tasks.workunit.client.1.smithi159.stdout:9/311: write d4/d19/f1e [7188159,4431] 0 2022-02-02T18:22:04.510 INFO:tasks.workunit.client.1.smithi159.stdout:9/312: chown d4/fd 0 1 2022-02-02T18:22:04.510 INFO:tasks.workunit.client.1.smithi159.stdout:9/313: truncate d4/d19/d1c/d1f/f24 331925 0 2022-02-02T18:22:04.511 INFO:tasks.workunit.client.1.smithi159.stdout:9/314: creat d4/d19/d1c/d21/d22/d55/f6c x:0 0 0 2022-02-02T18:22:04.512 INFO:tasks.workunit.client.1.smithi159.stdout:9/315: read - d4/d19/d1c/d21/d56/d59/f5a zero size 2022-02-02T18:22:04.512 INFO:tasks.workunit.client.1.smithi159.stdout:9/316: write d4/d2a/f2e [3709742,52961] 0 2022-02-02T18:22:04.513 INFO:tasks.workunit.client.1.smithi159.stdout:9/317: creat d4/d19/d1c/d21/d56/d5b/f6d x:0 0 0 2022-02-02T18:22:04.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/318: creat d4/d2a/f6e x:0 0 0 2022-02-02T18:22:04.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/319: dread - d4/d19/d1c/f54 zero size 2022-02-02T18:22:04.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/320: truncate d4/f6a 529486 0 2022-02-02T18:22:04.515 INFO:tasks.workunit.client.1.smithi159.stdout:9/321: fsync d4/d19/d1c/d1f/f30 0 2022-02-02T18:22:04.515 INFO:tasks.workunit.client.1.smithi159.stdout:9/322: write d4/f16 [3244402,100087] 0 2022-02-02T18:22:04.532 INFO:tasks.workunit.client.1.smithi159.stdout:9/323: dwrite d4/d2a/f6e [0,4194304] 0 2022-02-02T18:22:04.533 INFO:tasks.workunit.client.1.smithi159.stdout:9/324: truncate d4/d19/d1c/d21/d56/d5b/f62 251379 0 2022-02-02T18:22:04.533 INFO:tasks.workunit.client.1.smithi159.stdout:9/325: write d4/f14 [285734,107402] 0 2022-02-02T18:22:04.577 INFO:tasks.workunit.client.1.smithi159.stdout:9/326: mkdir d4/d19/d6f 0 2022-02-02T18:22:04.577 INFO:tasks.workunit.client.1.smithi159.stdout:9/327: creat d4/d19/d1c/d21/d41/f70 x:0 0 0 2022-02-02T18:22:04.578 INFO:tasks.workunit.client.1.smithi159.stdout:9/328: rename d4/d19 to d4/d19/d1c/d21/d22/d71 22 2022-02-02T18:22:04.578 INFO:tasks.workunit.client.1.smithi159.stdout:9/329: chown d4/d19/d1c/f44 1011 1 2022-02-02T18:22:04.578 INFO:tasks.workunit.client.1.smithi159.stdout:9/330: write d4/d19/d1c/d21/d41/f70 [691678,102516] 0 2022-02-02T18:22:04.579 INFO:tasks.workunit.client.1.smithi159.stdout:9/331: creat d4/d19/d1c/d1f/f72 x:0 0 0 2022-02-02T18:22:04.597 INFO:tasks.workunit.client.1.smithi159.stdout:9/332: dwrite d4/d19/d1c/d21/d56/d5b/f62 [0,4194304] 0 2022-02-02T18:22:04.600 INFO:tasks.workunit.client.1.smithi159.stdout:9/333: rename d4/d19/d1c/d21/d22/l4a to d4/d19/d1c/l73 0 2022-02-02T18:22:04.621 INFO:tasks.workunit.client.1.smithi159.stdout:9/334: dwrite d4/d19/d1c/d21/f27 [0,4194304] 0 2022-02-02T18:22:04.624 INFO:tasks.workunit.client.1.smithi159.stdout:9/335: rename d4/d19/d1c/d21/d22/d61 to d4/d19/d6f/d74 0 2022-02-02T18:22:04.624 INFO:tasks.workunit.client.1.smithi159.stdout:9/336: chown d4/c50 31690563 1 2022-02-02T18:22:04.627 INFO:tasks.workunit.client.1.smithi159.stdout:9/337: mknod d4/c75 0 2022-02-02T18:22:04.630 INFO:tasks.workunit.client.1.smithi159.stdout:9/338: creat d4/d19/f76 x:0 0 0 2022-02-02T18:22:04.630 INFO:tasks.workunit.client.1.smithi159.stdout:9/339: fdatasync d4/d19/d1c/d1f/d4c/f6b 0 2022-02-02T18:22:04.632 INFO:tasks.workunit.client.1.smithi159.stdout:9/340: rename d4/d19/d1c/d21/c33 to d4/c77 0 2022-02-02T18:22:04.633 INFO:tasks.workunit.client.1.smithi159.stdout:9/341: mkdir d4/d19/d6f/d78 0 2022-02-02T18:22:04.641 INFO:tasks.workunit.client.1.smithi159.stdout:9/342: fsync d4/d2a/f40 0 2022-02-02T18:22:04.641 INFO:tasks.workunit.client.1.smithi159.stdout:9/343: stat d4/d19/d42 0 2022-02-02T18:22:04.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/344: write d4/d19/f36 [499392,39636] 0 2022-02-02T18:22:04.644 INFO:tasks.workunit.client.1.smithi159.stdout:9/345: unlink d4/f14 0 2022-02-02T18:22:04.645 INFO:tasks.workunit.client.1.smithi159.stdout:9/346: creat d4/d19/d1c/f79 x:0 0 0 2022-02-02T18:22:04.645 INFO:tasks.workunit.client.1.smithi159.stdout:9/347: chown d4/d19/f1a 307 1 2022-02-02T18:22:04.648 INFO:tasks.workunit.client.1.smithi159.stdout:9/348: mkdir d4/d7a 0 2022-02-02T18:22:04.657 INFO:tasks.workunit.client.1.smithi159.stdout:9/349: dread d4/f11 [0,4194304] 0 2022-02-02T18:22:04.679 INFO:tasks.workunit.client.1.smithi159.stdout:9/350: dwrite d4/d19/d1c/d1f/f72 [0,4194304] 0 2022-02-02T18:22:04.681 INFO:tasks.workunit.client.1.smithi159.stdout:9/351: rmdir d4/d19/d1c/d21/d56 39 2022-02-02T18:22:04.681 INFO:tasks.workunit.client.1.smithi159.stdout:9/352: truncate d4/d19/d1c/f67 445992 0 2022-02-02T18:22:04.683 INFO:tasks.workunit.client.1.smithi159.stdout:9/353: link d4/d19/f76 d4/d19/d42/f7b 0 2022-02-02T18:22:04.683 INFO:tasks.workunit.client.1.smithi159.stdout:9/354: write d4/d19/d1c/f67 [850804,72658] 0 2022-02-02T18:22:04.690 INFO:tasks.workunit.client.1.smithi159.stdout:9/355: write d4/fd [3185807,1300] 0 2022-02-02T18:22:04.690 INFO:tasks.workunit.client.1.smithi159.stdout:9/356: write d4/d19/d1c/d21/d22/d55/f6c [402137,41569] 0 2022-02-02T18:22:04.690 INFO:tasks.workunit.client.1.smithi159.stdout:9/357: stat d4/d19/d1c/d21/d56/d59/f5a 0 2022-02-02T18:22:04.690 INFO:tasks.workunit.client.1.smithi159.stdout:9/358: chown d4/d19/d1c/d21/d41/f68 113833 1 2022-02-02T18:22:04.691 INFO:tasks.workunit.client.1.smithi159.stdout:9/359: creat d4/d19/d1c/d21/d41/f7c x:0 0 0 2022-02-02T18:22:04.691 INFO:tasks.workunit.client.1.smithi159.stdout:9/360: chown d4/d2a/f2e 1 1 2022-02-02T18:22:04.722 INFO:tasks.workunit.client.1.smithi159.stdout:9/361: dwrite d4/d19/d1c/d21/d41/f70 [0,4194304] 0 2022-02-02T18:22:04.723 INFO:tasks.workunit.client.1.smithi159.stdout:9/362: fdatasync d4/d19/f28 0 2022-02-02T18:22:04.747 INFO:tasks.workunit.client.1.smithi159.stdout:9/363: dwrite d4/d19/d1c/d1f/f72 [4194304,4194304] 0 2022-02-02T18:22:04.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/364: write d4/d19/d1c/d1f/f30 [791718,5606] 0 2022-02-02T18:22:04.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/365: chown d4/d2a 45190250 1 2022-02-02T18:22:04.754 INFO:tasks.workunit.client.1.smithi159.stdout:9/366: write d4/d2a/f34 [5514746,32777] 0 2022-02-02T18:22:04.755 INFO:tasks.workunit.client.1.smithi159.stdout:9/367: getdents d4/d19/d1c/d21/d41 0 2022-02-02T18:22:04.756 INFO:tasks.workunit.client.1.smithi159.stdout:9/368: read d4/d19/f1e [5277687,83326] 0 2022-02-02T18:22:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/369: getdents d4/d19/d1c/d21/d56/d5b 0 2022-02-02T18:22:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/370: creat d4/d19/d1c/d21/d56/d59/f7d x:0 0 0 2022-02-02T18:22:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/371: creat d4/d19/d1c/f7e x:0 0 0 2022-02-02T18:22:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/372: fsync d4/d19/d1c/d21/f27 0 2022-02-02T18:22:04.763 INFO:tasks.workunit.client.1.smithi159.stdout:9/373: symlink d4/d19/d1c/d21/l7f 0 2022-02-02T18:22:04.765 INFO:tasks.workunit.client.1.smithi159.stdout:9/374: link d4/f6a d4/d19/d1c/d21/d56/d59/f80 0 2022-02-02T18:22:04.766 INFO:tasks.workunit.client.1.smithi159.stdout:9/375: chown d4/d19/d1c/f54 19 1 2022-02-02T18:22:04.767 INFO:tasks.workunit.client.1.smithi159.stdout:9/376: creat d4/d19/d1c/d21/d56/d5b/f81 x:0 0 0 2022-02-02T18:22:04.770 INFO:tasks.workunit.client.1.smithi159.stdout:9/377: truncate d4/d2a/f40 4485818 0 2022-02-02T18:22:04.774 INFO:tasks.workunit.client.1.smithi159.stdout:9/378: unlink d4/d19/d1c/f79 0 2022-02-02T18:22:04.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/379: dwrite d4/d19/d1c/d21/d41/f70 [4194304,4194304] 0 2022-02-02T18:22:04.794 INFO:tasks.workunit.client.1.smithi159.stdout:9/380: creat d4/d19/d1c/d21/d56/d5b/f82 x:0 0 0 2022-02-02T18:22:04.796 INFO:tasks.workunit.client.1.smithi159.stdout:9/381: mknod d4/d19/d1c/d21/d56/d5b/c83 0 2022-02-02T18:22:04.821 INFO:tasks.workunit.client.1.smithi159.stdout:9/382: dwrite d4/d2a/f2e [4194304,4194304] 0 2022-02-02T18:22:04.823 INFO:tasks.workunit.client.1.smithi159.stdout:9/383: mknod d4/d19/c84 0 2022-02-02T18:22:04.823 INFO:tasks.workunit.client.1.smithi159.stdout:9/384: fdatasync d4/d19/d1c/d1f/f20 0 2022-02-02T18:22:05.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: audit 2022-02-02T18:22:04.280661+0000 mon.smithi096 (mon.0) 576 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:05.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: 2022-02-02T18:22:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: audit 2022-02-02T18:22:04.286292+0000 mon.smithi096 (mon.0) 577 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:04.287374+0000 mgr.smithi096.shfutl (mgr.14162) 291 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:22:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: cephadm 2022-02- 2022-02-02T18:22:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: 02T18:22:04.291040+0000 mgr.smithi096.shfutl (mgr.14162) 292 : cephadm [INF] Failing over to other MGR 2022-02-02T18:22:05.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: audit 2022-02-02T18:22:04.291636+0000 mon.smithi096 (mon 2022-02-02T18:22:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: .0) 578 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr fail", "who": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: cluster 2022-02-02T18: 2022-02-02T18:22:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: 22:04.314428+0000 mon.smithi096 (mon.0) 579 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2022-02-02T18:22:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: cluster 2022-02-02T18:22:04.834339+0000 mgr.smithi096.shfutl 2022-02-02T18:22:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:05 smithi096 conmon[32067]: (mgr.14162) 293 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 990 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 48 MiB/s rd, 98 MiB/s wr, 328 op/s 2022-02-02T18:22:05.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: audit 2022-02-02T18:22:04.280661+0000 mon.smithi096 (mon.0 2022-02-02T18:22:05.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: ) 576 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:05.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: audit 2022-02-02T18:22:04.286292+0000 mon.smithi096 (mon.0) 577 : audit [DBG] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:05.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:04.287374+0000 mgr.smithi096.shfutl (mgr.14162) 291 2022-02-02T18:22:05.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:22:05.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:05.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: 2022-02-02T18:22:04.291040+0000 2022-02-02T18:22:05.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14162) 292 : cephadm [INF] 2022-02-02T18:22:05.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: Failing over to other MGR 2022-02-02T18:22:05.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:22:05.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: 02T18:22:04.291636+0000 mon.smithi096 (mon 2022-02-02T18:22:05.643 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: .0) 578 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr fail", "who": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:05.643 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:22:05.643 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: -02-02T18:22:04.314428+0000 2022-02-02T18:22:05.643 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: mon.smithi096 (mon.0) 579 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2022-02-02T18:22:05.643 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: 2022-02-02T18:22:05.644 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: cluster 2022-02-02 2022-02-02T18:22:05.644 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:05 smithi159 conmon[35668]: T18:22:04.834339+0000 mgr.smithi096.shfutl (mgr.14162) 293 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 990 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 48 MiB/s rd, 98 MiB/s wr, 328 op/s 2022-02-02T18:22:05.820 INFO:tasks.workunit.client.1.smithi159.stdout:8/249: sync 2022-02-02T18:22:05.826 INFO:tasks.workunit.client.1.smithi159.stdout:8/250: unlink d1/f28 0 2022-02-02T18:22:05.826 INFO:tasks.workunit.client.1.smithi159.stdout:8/251: write d1/dd/d1a/f39 [1135302,93216] 0 2022-02-02T18:22:05.838 INFO:tasks.workunit.client.1.smithi159.stdout:8/252: dread d1/dd/d1a/f32 [0,4194304] 0 2022-02-02T18:22:05.841 INFO:tasks.workunit.client.1.smithi159.stdout:8/253: mkdir d1/dc/d35/d5f 0 2022-02-02T18:22:05.842 INFO:tasks.workunit.client.1.smithi159.stdout:8/254: read d1/d26/f2d [2705943,2168] 0 2022-02-02T18:22:05.842 INFO:tasks.workunit.client.1.smithi159.stdout:8/255: write d1/d26/d48/f57 [1545509,72793] 0 2022-02-02T18:22:05.843 INFO:tasks.workunit.client.1.smithi159.stdout:8/256: creat d1/dd/d1a/d53/f60 x:0 0 0 2022-02-02T18:22:05.845 INFO:tasks.workunit.client.1.smithi159.stdout:8/257: creat d1/dc/d35/d5f/f61 x:0 0 0 2022-02-02T18:22:05.846 INFO:tasks.workunit.client.1.smithi159.stdout:8/258: read d1/dc/d35/f46 [3911521,128788] 0 2022-02-02T18:22:05.865 INFO:tasks.workunit.client.1.smithi159.stdout:8/259: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:22:05.868 INFO:tasks.workunit.client.1.smithi159.stdout:8/260: link d1/dc/c1c d1/dd/d1a/d53/c62 0 2022-02-02T18:22:05.870 INFO:tasks.workunit.client.1.smithi159.stdout:8/261: truncate d1/dc/d35/f46 482538 0 2022-02-02T18:22:05.881 INFO:tasks.workunit.client.1.smithi159.stdout:8/262: truncate d1/dd/d2c/f42 3966078 0 2022-02-02T18:22:05.882 INFO:tasks.workunit.client.1.smithi159.stdout:8/263: truncate d1/dd/d1a/f32 239411 0 2022-02-02T18:22:05.883 INFO:tasks.workunit.client.1.smithi159.stdout:8/264: chown d1/dc/d35 1 1 2022-02-02T18:22:05.884 INFO:tasks.workunit.client.1.smithi159.stdout:8/265: rename d1/f5b to d1/dd/d1a/f63 0 2022-02-02T18:22:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:8/266: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:22:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:8/267: dread - d1/d26/d48/f55 zero size 2022-02-02T18:22:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:8/268: chown d1/dd/d2c/c44 1906618765 1 2022-02-02T18:22:05.913 INFO:tasks.workunit.client.1.smithi159.stdout:8/269: symlink d1/d26/d48/l64 0 2022-02-02T18:22:06.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: audit 2022-02-02T18:22:05.282746+0000 mon.smithi096 (mon.0 2022-02-02T18:22:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: ) 580 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "mgr fail", "who": "smithi096.shfutl"}]': finished 2022-02-02T18:22:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: cluster 2022-02-02T18:22:05.282802+0000 mon.smithi096 (mon.0) 581 : cluster [DBG] mgrmap e18: smithi159.jrxkfz(active, starting, since 0.989958s) 2022-02-02T18:22:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: cluster 2022-02-02T18:22:05.529521+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 582 : cluster [INF] Active manager daemon smithi159.jrxkfz restarted 2022-02-02T18:22:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: cluster 2022-02-02T18 2022-02-02T18:22:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: :22:05.530098+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 583 : cluster [INF] Activating manager daemon smithi159.jrxkfz 2022-02-02T18:22:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: cluster 2022-02-02 2022-02-02T18:22:06.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: T18:22:05.532425+0000 mon.smithi096 (mon 2022-02-02T18:22:06.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: .0) 584 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2022-02-02T18:22:06.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:06.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 02-02T18:22:05.532742+0000 mon.smithi096 2022-02-02T18:22:06.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: (mon.0) 585 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:22:06.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:06.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: -02-02T18:22:05.533240+0000 mon.smithi096 2022-02-02T18:22:06.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: (mon.0) 586 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:06.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:06.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 02-02T18:22:05.537306+0000 2022-02-02T18:22:06.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: mon.smithi096 (mon.0) 587 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:22:06.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 2022-02-02T18:22:05.537736+0000 2022-02-02T18:22:06.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: mon.smithi096 (mon.0) 588 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:06.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:06 smithi096 conmon[32067]: 2022-02-02T18:22:06.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit 2022-02-02T18:22:05.282746+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:06.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 580 : audit [INF] from='mgr.14162 172.21.15.96:0/4257036032' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "mgr fail", "who": "smithi096.shfutl"}]': finished 2022-02-02T18:22:06.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: cluster 2022-02-02T18:22:05.282802+0000 mon.smithi096 (mon.0) 581 : cluster [DBG] mgrmap e18: smithi159.jrxkfz(active, starting, since 0.989958s) 2022-02-02T18:22:06.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: cluster 2022-02-02T18:22:06.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 2022-02-02T18:22:05.529521+0000 mon.smithi096 (mon.0) 582 : cluster [INF] 2022-02-02T18:22:06.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: Active manager daemon smithi159.jrxkfz restarted 2022-02-02T18:22:06.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: cluster 2022-02- 2022-02-02T18:22:06.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 02T18:22:05.530098+0000 2022-02-02T18:22:06.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: mon.smithi096 (mon.0) 583 : cluster 2022-02-02T18:22:06.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: [INF] Activating manager daemon smithi159.jrxkfz 2022-02-02T18:22:06.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: cluster 2022-02-02T18:22:06.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 2022-02-02T18:22 2022-02-02T18:22:06.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: :05.532425+0000 mon.smithi096 (mon.0 2022-02-02T18:22:06.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: ) 584 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2022-02-02T18:22:06.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:06.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 02-02T18:22:05. 2022-02-02T18:22:06.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 532742+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:06.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 585 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:22:06.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 2022-02- 2022-02-02T18:22:06.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 02T18:22:05.533240+0000 2022-02-02T18:22:06.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: mon.smithi096 (mon.0) 586 : 2022-02-02T18:22:06.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:06.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:06.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: -02-02T18:22:05. 2022-02-02T18:22:06.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 537306+0000 mon.smithi096 (mon.0) 587 2022-02-02T18:22:06.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:22:06.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: 2022-02-02T18:22:05 2022-02-02T18:22:06.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: .537736+0000 mon.smithi096 (mon.0 2022-02-02T18:22:06.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:06 smithi159 conmon[35668]: ) 588 : audit [DBG] from='mgr.? 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:06.803 INFO:tasks.workunit.client.1.smithi159.stdout:7/336: sync 2022-02-02T18:22:06.806 INFO:tasks.workunit.client.1.smithi159.stdout:7/337: truncate d3/d27/d29/f61 2336392 0 2022-02-02T18:22:06.807 INFO:tasks.workunit.client.1.smithi159.stdout:7/338: truncate d3/d27/d29/d5e/f69 959584 0 2022-02-02T18:22:06.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/339: rename d3/d5/l48 to d3/d2a/l75 0 2022-02-02T18:22:06.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/340: read - d3/d2a/d2c/f63 zero size 2022-02-02T18:22:06.842 INFO:tasks.workunit.client.1.smithi159.stdout:7/341: dwrite d3/d27/d29/f61 [0,4194304] 0 2022-02-02T18:22:06.871 INFO:tasks.workunit.client.1.smithi159.stdout:7/342: dwrite d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:22:06.873 INFO:tasks.workunit.client.1.smithi159.stdout:7/343: creat d3/d27/d29/f76 x:0 0 0 2022-02-02T18:22:06.904 INFO:tasks.workunit.client.1.smithi159.stdout:7/344: dwrite d3/d5/d56/d2f/f50 [0,4194304] 0 2022-02-02T18:22:06.906 INFO:tasks.workunit.client.1.smithi159.stdout:7/345: getdents d3/d5/d56/d57 0 2022-02-02T18:22:06.908 INFO:tasks.workunit.client.1.smithi159.stdout:7/346: rename d3/d5/le to d3/d6/l77 0 2022-02-02T18:22:06.923 INFO:tasks.workunit.client.1.smithi159.stdout:7/347: dread d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:22:06.923 INFO:tasks.workunit.client.1.smithi159.stdout:7/348: chown d3/d27/f3b 494966 1 2022-02-02T18:22:06.928 INFO:tasks.workunit.client.1.smithi159.stdout:7/349: symlink d3/d5/l78 0 2022-02-02T18:22:06.928 INFO:tasks.workunit.client.1.smithi159.stdout:7/350: write d3/d5/d56/d2f/f38 [804356,103140] 0 2022-02-02T18:22:06.931 INFO:tasks.workunit.client.1.smithi159.stdout:7/351: write d3/d5/f45 [3790711,34933] 0 2022-02-02T18:22:06.932 INFO:tasks.workunit.client.1.smithi159.stdout:7/352: readlink d3/d5/d56/d2f/l5f 0 2022-02-02T18:22:06.942 INFO:tasks.workunit.client.1.smithi159.stdout:7/353: rename d3/d52 to d3/d2a/d4a/d79 0 2022-02-02T18:22:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:7/354: mkdir d3/d2a/d2c/d7a 0 2022-02-02T18:22:06.949 INFO:tasks.workunit.client.1.smithi159.stdout:7/355: link d3/d5/d56/d2f/f44 d3/d5/d56/f7b 0 2022-02-02T18:22:06.951 INFO:tasks.workunit.client.1.smithi159.stdout:7/356: unlink d3/d5/d56/d57/l3e 0 2022-02-02T18:22:06.951 INFO:tasks.workunit.client.1.smithi159.stdout:7/357: write d3/d27/f66 [331032,98676] 0 2022-02-02T18:22:06.953 INFO:tasks.workunit.client.1.smithi159.stdout:7/358: rename d3/d5/d56/d2f/l5f to d3/d27/d29/d6b/l7c 0 2022-02-02T18:22:06.954 INFO:tasks.workunit.client.1.smithi159.stdout:7/359: getdents d3/d5/d56/d2f/d5b 0 2022-02-02T18:22:06.959 INFO:tasks.workunit.client.1.smithi159.stdout:7/360: write d3/d2a/d2c/f5a [3555849,85663] 0 2022-02-02T18:22:06.960 INFO:tasks.workunit.client.1.smithi159.stdout:7/361: chown d3/d2a/f55 2827797 1 2022-02-02T18:22:06.961 INFO:tasks.workunit.client.1.smithi159.stdout:7/362: mkdir d3/d2a/d4a/d7d 0 2022-02-02T18:22:07.007 INFO:tasks.workunit.client.1.smithi159.stdout:7/363: dwrite d3/d27/d29/d5e/f69 [0,4194304] 0 2022-02-02T18:22:07.034 INFO:tasks.workunit.client.1.smithi159.stdout:7/364: dwrite d3/d27/d29/f33 [0,4194304] 0 2022-02-02T18:22:07.036 INFO:tasks.workunit.client.1.smithi159.stdout:7/365: rmdir d3/d2a/d2c 39 2022-02-02T18:22:07.057 INFO:tasks.workunit.client.1.smithi159.stdout:7/366: dwrite d3/d27/d29/f33 [4194304,4194304] 0 2022-02-02T18:22:07.058 INFO:tasks.workunit.client.1.smithi159.stdout:7/367: fdatasync d3/d5/d56/d57/f3f 0 2022-02-02T18:22:07.060 INFO:tasks.workunit.client.1.smithi159.stdout:7/368: creat d3/d27/d6f/f7e x:0 0 0 2022-02-02T18:22:07.061 INFO:tasks.workunit.client.1.smithi159.stdout:7/369: fsync d3/d2a/f47 0 2022-02-02T18:22:07.066 INFO:tasks.workunit.client.1.smithi159.stdout:7/370: rename d3/d27/d29/f33 to d3/d5/f7f 0 2022-02-02T18:22:07.067 INFO:tasks.workunit.client.1.smithi159.stdout:7/371: mkdir d3/d27/d29/d5e/d80 0 2022-02-02T18:22:07.067 INFO:tasks.workunit.client.1.smithi159.stdout:7/372: write d3/f60 [94210,13673] 0 2022-02-02T18:22:07.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/373: write d3/d5/d56/d2f/f4c [1455320,1739] 0 2022-02-02T18:22:07.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/374: read - d3/f4e zero size 2022-02-02T18:22:07.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/375: truncate d3/d27/d6f/f7e 302289 0 2022-02-02T18:22:07.071 INFO:tasks.workunit.client.1.smithi159.stdout:7/376: creat d3/d5/d56/f81 x:0 0 0 2022-02-02T18:22:07.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/377: unlink d3/d5/d56/c30 0 2022-02-02T18:22:07.076 INFO:tasks.workunit.client.1.smithi159.stdout:7/378: mkdir d3/d27/d29/d82 0 2022-02-02T18:22:07.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/379: dread d3/d5/f20 [0,4194304] 0 2022-02-02T18:22:07.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/380: mknod d3/d27/d29/d82/c83 0 2022-02-02T18:22:07.108 INFO:tasks.workunit.client.1.smithi159.stdout:7/381: getdents d3/d5/d56/d57 0 2022-02-02T18:22:07.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/382: dwrite d3/d27/d29/f71 [0,4194304] 0 2022-02-02T18:22:07.209 INFO:tasks.workunit.client.1.smithi159.stdout:1/307: sync 2022-02-02T18:22:07.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/308: link df/d14/d16/d4b/d5b/l41 df/d21/d23/d49/d69/d6c/l72 0 2022-02-02T18:22:07.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/309: chown f4 72 1 2022-02-02T18:22:07.212 INFO:tasks.workunit.client.1.smithi159.stdout:1/310: symlink df/d14/d16/d6d/l73 0 2022-02-02T18:22:07.212 INFO:tasks.workunit.client.1.smithi159.stdout:1/311: write df/d21/f66 [560096,59128] 0 2022-02-02T18:22:07.212 INFO:tasks.workunit.client.1.smithi159.stdout:1/312: read df/d21/f5c [713530,103532] 0 2022-02-02T18:22:07.213 INFO:tasks.workunit.client.1.smithi159.stdout:1/313: creat df/d14/d16/d4a/f74 x:0 0 0 2022-02-02T18:22:07.220 INFO:tasks.workunit.client.1.smithi159.stdout:1/314: read df/d21/d23/f29 [432185,57938] 0 2022-02-02T18:22:07.222 INFO:tasks.workunit.client.1.smithi159.stdout:1/315: symlink df/d14/l75 0 2022-02-02T18:22:07.231 INFO:tasks.workunit.client.1.smithi159.stdout:1/316: mknod df/d14/d16/d6d/c76 0 2022-02-02T18:22:07.241 INFO:tasks.workunit.client.1.smithi159.stdout:7/383: dwrite d3/d2a/d2c/f63 [0,4194304] 0 2022-02-02T18:22:07.242 INFO:tasks.workunit.client.1.smithi159.stdout:7/384: dread - d3/d27/d29/d5e/f73 zero size 2022-02-02T18:22:07.242 INFO:tasks.workunit.client.1.smithi159.stdout:7/385: fdatasync d3/d27/f3b 0 2022-02-02T18:22:07.242 INFO:tasks.workunit.client.1.smithi159.stdout:1/317: rename df/d14/f17 to df/d14/d16/d4b/d5b/f77 0 2022-02-02T18:22:07.244 INFO:tasks.workunit.client.1.smithi159.stdout:7/386: symlink d3/d6/l84 0 2022-02-02T18:22:07.246 INFO:tasks.workunit.client.1.smithi159.stdout:1/318: unlink df/d14/d16/d4b/d5b/l5e 0 2022-02-02T18:22:07.247 INFO:tasks.workunit.client.1.smithi159.stdout:7/387: dread d3/fb [4194304,4194304] 0 2022-02-02T18:22:07.253 INFO:tasks.workunit.client.1.smithi159.stdout:1/319: mknod df/d14/d68/c78 0 2022-02-02T18:22:07.253 INFO:tasks.workunit.client.1.smithi159.stdout:7/388: creat d3/d2a/d2c/d7a/f85 x:0 0 0 2022-02-02T18:22:07.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/320: symlink df/d21/d23/l79 0 2022-02-02T18:22:07.261 INFO:tasks.workunit.client.1.smithi159.stdout:1/321: rename df/d21/d23/c3b to df/d14/d68/c7a 0 2022-02-02T18:22:07.262 INFO:tasks.workunit.client.1.smithi159.stdout:1/322: getdents df/d14/d16/d6d 0 2022-02-02T18:22:07.263 INFO:tasks.workunit.client.1.smithi159.stdout:1/323: creat df/d14/d16/d6d/f7b x:0 0 0 2022-02-02T18:22:07.282 INFO:tasks.workunit.client.1.smithi159.stdout:1/324: dread df/d14/d16/d4b/d5b/f77 [0,4194304] 0 2022-02-02T18:22:07.285 INFO:tasks.workunit.client.1.smithi159.stdout:1/325: creat df/d21/d23/f7c x:0 0 0 2022-02-02T18:22:07.288 INFO:tasks.workunit.client.1.smithi159.stdout:1/326: dread df/d21/f66 [0,4194304] 0 2022-02-02T18:22:07.289 INFO:tasks.workunit.client.1.smithi159.stdout:1/327: truncate df/d14/d16/d4b/d5b/f2e 400304 0 2022-02-02T18:22:07.315 INFO:tasks.workunit.client.1.smithi159.stdout:1/328: dwrite df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:22:07.348 INFO:tasks.workunit.client.1.smithi159.stdout:1/329: dwrite df/d21/d23/d49/f4e [0,4194304] 0 2022-02-02T18:22:07.359 INFO:tasks.workunit.client.1.smithi159.stdout:0/304: sync 2022-02-02T18:22:07.360 INFO:tasks.workunit.client.1.smithi159.stdout:4/372: sync 2022-02-02T18:22:07.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/335: sync 2022-02-02T18:22:07.360 INFO:tasks.workunit.client.1.smithi159.stdout:4/373: chown d0/d8/d41 56145 1 2022-02-02T18:22:07.361 INFO:tasks.workunit.client.1.smithi159.stdout:3/336: fsync dd/d20/d2a/f68 0 2022-02-02T18:22:07.361 INFO:tasks.workunit.client.1.smithi159.stdout:4/374: fsync d0/f3 0 2022-02-02T18:22:07.361 INFO:tasks.workunit.client.1.smithi159.stdout:5/440: sync 2022-02-02T18:22:07.361 INFO:tasks.workunit.client.1.smithi159.stdout:5/441: chown d9/d24/d38/d3c/d61/l82 0 1 2022-02-02T18:22:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:1/330: write df/d14/d16/d4a/f51 [2044183,33589] 0 2022-02-02T18:22:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:1/331: fdatasync df/d14/d16/d4a/f74 0 2022-02-02T18:22:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:6/381: sync 2022-02-02T18:22:07.365 INFO:tasks.workunit.client.1.smithi159.stdout:3/337: dread dd/f34 [0,4194304] 0 2022-02-02T18:22:07.365 INFO:tasks.workunit.client.1.smithi159.stdout:3/338: chown dd/d19/d38/d3f/d52/c67 668 1 2022-02-02T18:22:07.365 INFO:tasks.workunit.client.1.smithi159.stdout:3/339: write dd/d19/f1b [1959922,117627] 0 2022-02-02T18:22:07.372 INFO:tasks.workunit.client.1.smithi159.stdout:0/305: symlink d1/dd/d4b/l70 0 2022-02-02T18:22:07.372 INFO:tasks.workunit.client.1.smithi159.stdout:0/306: dread - d1/d11/f2b zero size 2022-02-02T18:22:07.372 INFO:tasks.workunit.client.1.smithi159.stdout:0/307: readlink d1/d11/d38/d42/d47/l5f 0 2022-02-02T18:22:07.373 INFO:tasks.workunit.client.1.smithi159.stdout:4/375: symlink d0/d8/d24/l85 0 2022-02-02T18:22:07.373 INFO:tasks.workunit.client.1.smithi159.stdout:4/376: fdatasync d0/d8/d24/d3a/f46 0 2022-02-02T18:22:07.373 INFO:tasks.workunit.client.1.smithi159.stdout:1/332: mknod df/d21/d23/d49/c7d 0 2022-02-02T18:22:07.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/442: write d9/d24/d37/f1e [1129388,4926] 0 2022-02-02T18:22:07.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/443: getdents d9/d24/d72 0 2022-02-02T18:22:07.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/444: readlink d9/d24/d37/d23/l50 0 2022-02-02T18:22:07.376 INFO:tasks.workunit.client.1.smithi159.stdout:5/445: chown d9/d2e/d71/c79 93 1 2022-02-02T18:22:07.376 INFO:tasks.workunit.client.1.smithi159.stdout:5/446: dread - d9/d24/d37/d23/d68/f7e zero size 2022-02-02T18:22:07.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/308: rename d1/d11/d1d/d34/f4e to d1/d11/d1d/d34/f71 0 2022-02-02T18:22:07.377 INFO:tasks.workunit.client.1.smithi159.stdout:4/377: read d0/d8/d15/f27 [1237569,9845] 0 2022-02-02T18:22:07.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/309: rename d1/d11/f2b to d1/d11/d38/d42/d56/f72 0 2022-02-02T18:22:07.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/310: readlink d1/d11/l21 0 2022-02-02T18:22:07.381 INFO:tasks.workunit.client.1.smithi159.stdout:1/333: dread df/d14/d16/d4b/f55 [0,4194304] 0 2022-02-02T18:22:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:1/334: dread - df/d14/d16/d6d/f7b zero size 2022-02-02T18:22:07.383 INFO:tasks.workunit.client.1.smithi159.stdout:4/378: dread d0/d8/d14/d33/f45 [0,4194304] 0 2022-02-02T18:22:07.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/379: symlink d0/l86 0 2022-02-02T18:22:07.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/380: stat d0/l4 0 2022-02-02T18:22:07.389 INFO:tasks.workunit.client.1.smithi159.stdout:4/381: mknod d0/d8/d14/d36/c87 0 2022-02-02T18:22:07.391 INFO:tasks.workunit.client.1.smithi159.stdout:4/382: creat d0/d8/d14/d36/f88 x:0 0 0 2022-02-02T18:22:07.391 INFO:tasks.workunit.client.1.smithi159.stdout:0/311: dread d1/d19/d3d/f45 [0,4194304] 0 2022-02-02T18:22:07.391 INFO:tasks.workunit.client.1.smithi159.stdout:0/312: truncate d1/d19/f2f 341508 0 2022-02-02T18:22:07.392 INFO:tasks.workunit.client.1.smithi159.stdout:0/313: fsync d1/f5a 0 2022-02-02T18:22:07.392 INFO:tasks.workunit.client.1.smithi159.stdout:4/383: rmdir d0/d8/d41 39 2022-02-02T18:22:07.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/335: rename f4 to df/d14/d16/f7e 0 2022-02-02T18:22:07.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/336: write df/d21/f5c [1887642,54706] 0 2022-02-02T18:22:07.401 INFO:tasks.workunit.client.1.smithi159.stdout:0/314: getdents d1/d11/d1d/d34 0 2022-02-02T18:22:07.401 INFO:tasks.workunit.client.1.smithi159.stdout:0/315: fdatasync d1/d11/d1d/d34/f67 0 2022-02-02T18:22:07.407 INFO:tasks.workunit.client.1.smithi159.stdout:0/316: creat d1/d11/f73 x:0 0 0 2022-02-02T18:22:07.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/317: truncate d1/d19/f29 1327122 0 2022-02-02T18:22:07.434 INFO:tasks.workunit.client.1.smithi159.stdout:4/384: dwrite d0/d8/d14/d33/f45 [0,4194304] 0 2022-02-02T18:22:07.434 INFO:tasks.workunit.client.1.smithi159.stdout:4/385: fdatasync d0/d8/d14/d33/f45 0 2022-02-02T18:22:07.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/337: dwrite df/d14/d16/d4b/d5b/f61 [0,4194304] 0 2022-02-02T18:22:07.436 INFO:tasks.workunit.client.1.smithi159.stdout:4/386: creat d0/d8/d24/d76/f89 x:0 0 0 2022-02-02T18:22:07.437 INFO:tasks.workunit.client.1.smithi159.stdout:0/318: dwrite d1/d11/d38/f4c [0,4194304] 0 2022-02-02T18:22:07.437 INFO:tasks.workunit.client.1.smithi159.stdout:0/319: readlink d1/dd/l18 0 2022-02-02T18:22:07.440 INFO:tasks.workunit.client.1.smithi159.stdout:1/338: mknod df/d21/d23/d49/d69/d6c/c7f 0 2022-02-02T18:22:07.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/339: symlink df/d21/d23/d49/d69/l80 0 2022-02-02T18:22:07.448 INFO:tasks.workunit.client.1.smithi159.stdout:1/340: mkdir df/d21/d23/d49/d69/d81 0 2022-02-02T18:22:07.451 INFO:tasks.workunit.client.1.smithi159.stdout:0/320: dread d1/dd/f54 [0,4194304] 0 2022-02-02T18:22:07.454 INFO:tasks.workunit.client.1.smithi159.stdout:1/341: truncate df/d21/d23/d49/f5d 872978 0 2022-02-02T18:22:07.457 INFO:tasks.workunit.client.1.smithi159.stdout:1/342: mkdir df/d21/d23/d49/d82 0 2022-02-02T18:22:07.491 INFO:tasks.workunit.client.1.smithi159.stdout:4/387: dwrite d0/d8/d14/d33/f50 [0,4194304] 0 2022-02-02T18:22:07.491 INFO:tasks.workunit.client.1.smithi159.stdout:4/388: fsync d0/d8/d14/d36/d4b/f54 0 2022-02-02T18:22:07.493 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: cluster 2022-02-02T18:22:06.314934+0000 mon.smithi096 (mon.0) 589 : cluster [DBG] mgrmap e19: smithi159.jrxkfz(active, starting, since 0.785006s) 2022-02-02T18:22:07.493 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.316141+0000 mon.smithi159 (mon.1) 14 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:07.493 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.316288+0000 mon.smithi159 (mon.1) 15 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:07.494 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.316650+0000 mon.smithi159 (mon.1) 16 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:07.494 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.316989+0000 mon.smithi159 (mon.1) 17 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:22:07.494 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.317286+0000 mon.smithi159 (mon.1) 18 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:07.494 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.317592+0000 mon.smithi159 (mon.1) 19 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:22:07.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.317931+0000 mon.smithi159 (mon.1) 20 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:07.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:07.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 2022-02-02T18:22:06.318153+0000 mon.smithi159 (mon.1) 21 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:22:07.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.318366+0000 mon.smithi159 (mon.1) 22 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:22:07.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.318572+0000 mon.smithi159 (mon.1) 23 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:22:07.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.318813+0000 mon.smithi159 (mon.1) 24 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:22:07.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.319099+0000 mon.smithi159 (mon.1) 25 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:22:07.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.319328+0000 mon.smithi159 (mon.1) 26 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:22:07.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.320420+0000 mon.smithi159 (mon.1) 27 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:22:07.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.320913+0000 mon.smithi159 (mon.1) 28 2022-02-02T18:22:07.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:22:07.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06.321477+0000 mon.smithi159 (mon.1) 29 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:22:07.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: cluster 2022-02-02T18:22:06.352665 2022-02-02T18:22:07.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 590 : cluster [INF] 2022-02-02T18:22:07.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: Manager daemon smithi159.jrxkfz is now available 2022-02-02T18:22:07.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06 2022-02-02T18:22:07.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: .372189+0000 mon.smithi159 (mon.1) 30 : audit 2022-02-02T18:22:07.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:07.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:22:07.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: -02T18:22:06.374724+0000 mon.smithi159 (mon. 2022-02-02T18:22:07.499 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 1) 31 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:07.500 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:07.500 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 18:22:06.381346+0000 mon.smithi159 (mon.1 2022-02-02T18:22:07.500 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: ) 32 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T18:22:07.500 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:22:07.501 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 02T18:22:06.381490+0000 mon.smithi096 (mon 2022-02-02T18:22:07.501 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: .0) 591 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T18:22:07.501 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:07.501 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 02-02T18:22:06.388818+0000 2022-02-02T18:22:07.501 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: mon.smithi096 (mon.0) 592 : audit [INF] 2022-02-02T18:22:07.502 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:07.502 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:07.502 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 02-02T18:22:06.403354+0000 mon.smithi159 (mon.1) 33 2022-02-02T18:22:07.502 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:07.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:06. 2022-02-02T18:22:07.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 403501+0000 mon.smithi096 (mon.0) 593 : audit [INF] 2022-02-02T18:22:07.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:07.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02T18:22:07.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: 2022-02-02T18:22:06.410622+0000 mon.smithi159 ( 2022-02-02T18:22:07.504 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: mon.1) 34 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:07.504 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:22:07.504 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: -02T18:22:06.410689+0000 mon.smithi096 2022-02-02T18:22:07.504 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: (mon.0) 594 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:07.504 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:22:07.505 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: T18:22:06.425180+0000 mon.smithi096 (mon.0 2022-02-02T18:22:07.505 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:07 smithi096 conmon[32067]: ) 595 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:07.508 INFO:tasks.workunit.client.1.smithi159.stdout:0/321: dwrite d1/d11/d38/f4c [0,4194304] 0 2022-02-02T18:22:07.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: cluster 2022-02-02T18:22:06.314934+0000 mon.smithi096 (mon.0) 589 : cluster [DBG] mgrmap e19: smithi159.jrxkfz(active, starting, since 0.785006s) 2022-02-02T18:22:07.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.316141+0000 mon.smithi159 (mon.1) 14 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:07.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.316288+0000 mon.smithi159 (mon.1) 15 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:07.602 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.316650+0000 mon.smithi159 (mon.1) 16 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:07.602 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.316989+0000 mon.smithi159 (mon.1) 17 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:22:07.602 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.317286+0000 mon.smithi159 (mon.1) 18 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:07.602 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.317592+0000 mon.smithi159 (mon.1) 19 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:22:07.603 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.317931+0000 mon.smithi159 (mon.1) 20 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:07.603 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.318153+0000 mon.smithi159 (mon.1) 21 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:22:07.603 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.318366+0000 mon.smithi159 (mon.1) 22 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:22:07.603 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.318572+0000 mon.smithi159 (mon.1) 23 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:22:07.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.318813+0000 mon.smithi159 (mon.1) 24 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:22:07.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.319099+0000 mon.smithi159 (mon.1) 25 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:22:07.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.319328+0000 mon.smithi159 (mon.1) 26 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:22:07.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.320420+0000 mon.smithi159 (mon.1) 27 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:22:07.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.320913+0000 mon.smithi159 (mon.1) 28 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:22:07.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.321477+0000 mon.smithi159 (mon.1) 29 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:22:07.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: cluster 2022-02-02T18:22:06.352665+0000 mon.smithi096 (mon.0) 590 : cluster [INF] Manager daemon smithi159.jrxkfz is now available 2022-02-02T18:22:07.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.372189+0000 mon.smithi159 (mon.1) 30 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:07.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.374724+0000 mon.smithi159 (mon.1) 31 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:07.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.381346+0000 mon.smithi159 (mon.1) 32 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T18:22:07.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.381490+0000 mon.smithi096 (mon.0) 591 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T18:22:07.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.388818+0000 mon.smithi096 (mon.0) 592 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:07.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.403354+0000 mon.smithi159 (mon.1) 33 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.403501+0000 mon.smithi096 (mon.0) 593 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.410622+0000 mon.smithi159 (mon.1) 34 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.410689+0000 mon.smithi096 (mon.0) 594 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.jrxkfz/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:07 smithi159 conmon[35668]: audit 2022-02-02T18:22:06.425180+0000 mon.smithi096 (mon.0) 595 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:08.657 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:06.774950+0000 mgr.smithi159.jrxkfz (mgr 2022-02-02T18:22:08.657 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: .14586) 1 : cephadm [INF] Deploying cephadm binary to smithi096 2022-02-02T18:22:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:06.775804+0000 mgr.smithi159.jrxkfz (mgr.14586) 2 : cephadm [INF] 2022-02-02T18:22:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: Deploying cephadm binary to smithi159 2022-02-02T18:22:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 02-02T18:22:07.321983+0000 mon.smithi096 ( 2022-02-02T18:22:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: mon.0) 596 : audit [INF] 2022-02-02T18:22:08.659 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2022-02-02T18:22:08.659 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: cluster 2022-02-02T18:22:07 2022-02-02T18:22:08.659 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: .322064+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:08.659 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 597 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2022-02-02T18:22:08.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: cluster 2022-02-02T18:22:08.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:08.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 07.336772+0000 mon.smithi096 (mon. 2022-02-02T18:22:08.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 0) 598 : cluster [DBG] mgrmap e20: smithi159.jrxkfz(active, since 1.80684s) 2022-02-02T18:22:08.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: audit 2022-02-02T18:22:08.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:08.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 07.340908+0000 mon.smithi159 (mon. 2022-02-02T18:22:08.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 1) 35 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T18:22:08.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 2022-02-02T18:22:08.662 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:22:08.662 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 18:22:07.345288+0000 mon.smithi096 2022-02-02T18:22:08.662 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: (mon.0) 599 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T18:22:08.662 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:08 smithi159 conmon[35668]: 2022-02-02T18:22:08.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:06.774950+0000 mgr.smithi159.jrxkfz (mgr.14586) 1 : 2022-02-02T18:22:08.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: cephadm [INF] Deploying cephadm binary to smithi096 2022-02-02T18:22:08.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:06.775804+0000 mgr.smithi159.jrxkfz (mgr.14586) 2 : cephadm [INF] Deploying cephadm binary to smithi159 2022-02-02T18:22:08.816 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: audit 2022-02-02T18:22:07.321983+0000 mon.smithi096 (mon.0) 596 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2022-02-02T18:22:08.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: cluster 2022-02-02T18:22:07.322064+0000 mon.smithi096 (mon.0) 597 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2022-02-02T18:22:08.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: cluster 2022-02-02T18:22:07.336772+0000 mon.smithi096 (mon.0) 598 : cluster [DBG] mgrmap e20: smithi159.jrxkfz(active, since 1.80684s) 2022-02-02T18:22:08.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: audit 2022-02-02T18:22:07.340908+0000 mon.smithi159 (mon.1) 35 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T18:22:08.817 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:08 smithi096 conmon[32067]: audit 2022-02-02T18:22:07.345288+0000 mon.smithi096 (mon.0) 599 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T18:22:09.595 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: cluster 2022-02-02T18:22:07.360026+0000 mgr.smithi159.jrxkfz ( 2022-02-02T18:22:09.595 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: mgr.14586) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:09.596 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: cluster 2022-02-02T18:22:08.320538+0000 mgr.smithi159.jrxkfz (mgr.14586) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:09.596 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: audit 2022-02-02T18:22:08.335102+0000 mon.smithi096 (mon.0) 600 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-02-02T18:22:09.596 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: cluster 2022-02-02T18:22:08.335183+0000 mon.smithi096 (mon.0) 601 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2022-02-02T18:22:09.596 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: cluster 2022-02-02T18:22:08.341200+0000 mon.smithi096 (mon.0) 602 : cluster [DBG] mgrmap e21: smithi159.jrxkfz(active, since 2s) 2022-02-02T18:22:09.596 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: audit 2022-02-02T18:22:08.778032+0000 mon.smithi096 (mon.0) 603 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:09.597 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:09 smithi096 conmon[32067]: audit 2022-02-02T18:22:09.177786+0000 mon.smithi096 (mon.0) 604 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:09.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: cluster 2022-02-02T18:22:07.360026+0000 mgr.smithi159.jrxkfz (mgr.14586) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:09.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: cluster 2022-02-02T18:22:08.320538+0000 mgr.smithi159.jrxkfz (mgr.14586) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:09.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: audit 2022-02-02T18:22:08.335102+0000 mon.smithi096 (mon.0) 600 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-02-02T18:22:09.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: cluster 2022-02-02T18:22:08.335183+0000 mon.smithi096 (mon.0) 601 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2022-02-02T18:22:09.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: cluster 2022-02-02T18:22:08.341200+0000 mon.smithi096 (mon.0) 602 : cluster [DBG] mgrmap e21: smithi159.jrxkfz(active, since 2s) 2022-02-02T18:22:09.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: audit 2022-02-02T18:22:08.778032+0000 mon.smithi096 (mon.0) 603 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:09.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:09 smithi159 conmon[35668]: audit 2022-02-02T18:22:09.177786+0000 mon.smithi096 (mon.0) 604 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:10 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:08.654612+0000 2022-02-02T18:22:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:10 smithi159 conmon[35668]: mgr.smithi159.jrxkfz (mgr.14586) 5 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Bus STARTING 2022-02-02T18:22:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:10 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:08.771539+0000 mgr.smithi159.jrxkfz (mgr.14586) 6 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Serving on https://172.21.15.159:7150 2022-02-02T18:22:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:10 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:08.771675+0000 mgr.smithi159.jrxkfz (mgr.14586) 7 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Bus STARTED 2022-02-02T18:22:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:10 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:08.654612+0000 2022-02-02T18:22:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:10 smithi096 conmon[32067]: mgr.smithi159.jrxkfz (mgr.14586) 5 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Bus STARTING 2022-02-02T18:22:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:10 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:08.771539+0000 mgr.smithi159.jrxkfz (mgr.14586) 6 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Serving on https://172.21.15.159:7150 2022-02-02T18:22:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:10 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:08.771675+0000 mgr.smithi159.jrxkfz (mgr.14586) 7 : cephadm [INF] [02/Feb/2022:18:22:08] ENGINE Bus STARTED 2022-02-02T18:22:11.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:11 smithi159 conmon[35668]: cluster 2022-02-02T18:22:10.320856+0000 mgr.smithi159.jrxkfz (mgr.14586) 2022-02-02T18:22:11.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:11 smithi159 conmon[35668]: 8 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:11.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:11 smithi159 conmon[35668]: cluster 2022-02-02T18:22:10.350438+0000 mon.smithi096 (mon.0) 605 : cluster [DBG] mgrmap e22: smithi159.jrxkfz(active, since 4s) 2022-02-02T18:22:11.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:11 smithi159 conmon[35668]: audit 2022-02-02T18:22:11.238297+0000 mon.smithi096 (mon.0) 606 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:11.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:11 smithi096 conmon[32067]: cluster 2022-02-02T18:22:10.320856+0000 mgr.smithi159.jrxkfz (mgr.14586) 8 : cluster 2022-02-02T18:22:11.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:11 smithi096 conmon[32067]: [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:11.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:11 smithi096 conmon[32067]: cluster 2022-02-02T18:22:10.350438+0000 mon.smithi096 (mon.0) 605 : cluster [DBG] mgrmap e22: smithi159.jrxkfz(active, since 4s) 2022-02-02T18:22:11.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:11 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:22:11.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:11 smithi096 conmon[32067]: 02T18:22:11.238297+0000 mon.smithi096 (mon.0) 606 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:11.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 -- 172.21.15.96:0/2764876207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f5d00 msgr2=0x7f23c00f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:11.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/2764876207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f5d00 0x7f23c00f80f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f23b80099e0 tx=0x7f23b8004d10).stop 2022-02-02T18:22:11.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 -- 172.21.15.96:0/2764876207 shutdown_connections 2022-02-02T18:22:11.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/2764876207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f85e0 0x7f23c00fa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:22:11.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/2764876207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f5d00 0x7f23c00f80f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:11.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 -- 172.21.15.96:0/2764876207 >> 172.21.15.96:0/2764876207 conn(0x7f23c00efec0 msgr2=0x7f23c00f2300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:11.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 -- 172.21.15.96:0/2764876207 shutdown_connections 2022-02-02T18:22:11.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.972+0000 7f23c6f2f700 1 -- 172.21.15.96:0/2764876207 wait complete. 2022-02-02T18:22:11.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 Processor -- start 2022-02-02T18:22:11.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 -- start start 2022-02-02T18:22:11.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 0x7f23c010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:11.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 0x7f23c010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:11.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c010e040 con 0x7f23c00f85e0 2022-02-02T18:22:11.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.973+0000 7f23c6f2f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c010e8f0 con 0x7f23c00f5d00 2022-02-02T18:22:11.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.974+0000 7f23c5f2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 0x7f23c010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:11.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.974+0000 7f23c5f2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 0x7f23c010d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56734/0 (socket says 172.21.15.96:56734) 2022-02-02T18:22:11.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.974+0000 7f23c5f2d700 1 -- 172.21.15.96:0/4277197347 learned_addr learned my addr 172.21.15.96:0/4277197347 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:11.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.974+0000 7f23c572c700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 0x7f23c010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:11.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c572c700 1 -- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 msgr2=0x7f23c010d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:11.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c572c700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 0x7f23c010d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:11.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c572c700 1 -- 172.21.15.96:0/4277197347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009640 con 0x7f23c00f85e0 2022-02-02T18:22:11.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c572c700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 0x7f23c010da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f23b0009360 tx=0x7f23b0006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:11.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23b0013640 con 0x7f23c00f85e0 2022-02-02T18:22:11.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23b0013c50 con 0x7f23c00f85e0 2022-02-02T18:22:11.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c010ebd0 con 0x7f23c00f85e0 2022-02-02T18:22:11.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23b0012bc0 con 0x7f23c00f85e0 2022-02-02T18:22:11.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.975+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c010f110 con 0x7f23c00f85e0 2022-02-02T18:22:11.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.976+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c0059100 con 0x7f23c00f85e0 2022-02-02T18:22:11.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.977+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 22) v1 ==== 41617+0+0 (secure 0 0 0) 0x7f23b001a060 con 0x7f23c00f85e0 2022-02-02T18:22:11.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.977+0000 7f23be7fc700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 0x7f23a8036ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:11.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.977+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f23b0046780 con 0x7f23c00f85e0 2022-02-02T18:22:11.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.978+0000 7f23c5f2d700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 0x7f23a8036ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:11.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.980+0000 7f23c5f2d700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 0x7f23a8036ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f23b8003380 tx=0x7f23b8004d10).ready entity=mgr.14586 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:11.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:11.983+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f23b0012e80 con 0x7f23c00f85e0 2022-02-02T18:22:12.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.212+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 --> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23c00f49f0 con 0x7f23a80345f0 2022-02-02T18:22:12.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.214+0000 7f23be7fc700 1 -- 172.21.15.96:0/4277197347 <== mgr.14586 v2:172.21.15.159:6828/1667203026 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f23c00f49f0 con 0x7f23a80345f0 2022-02-02T18:22:12.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 msgr2=0x7f23a8036ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 0x7f23a8036ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f23b8003380 tx=0x7f23b8004d10).stop 2022-02-02T18:22:12.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 msgr2=0x7f23c010da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 0x7f23c010da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f23b0009360 tx=0x7f23b0006e30).stop 2022-02-02T18:22:12.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 shutdown_connections 2022-02-02T18:22:12.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c00f5d00 0x7f23c010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f23a80345f0 0x7f23a8036ab0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 --2- 172.21.15.96:0/4277197347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23c00f85e0 0x7f23c010da00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 >> 172.21.15.96:0/4277197347 conn(0x7f23c00efec0 msgr2=0x7f23c00f2300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:12.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 shutdown_connections 2022-02-02T18:22:12.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.216+0000 7f23c6f2f700 1 -- 172.21.15.96:0/4277197347 wait complete. 2022-02-02T18:22:12.229 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:22:12.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/1466911680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f66e0 msgr2=0x7fd7e00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 --2- 172.21.15.96:0/1466911680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f66e0 0x7fd7e00f6b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fd7d0004660 tx=0x7fd7d0009b30).stop 2022-02-02T18:22:12.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/1466911680 shutdown_connections 2022-02-02T18:22:12.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 --2- 172.21.15.96:0/1466911680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f7980 0x7fd7e00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 --2- 172.21.15.96:0/1466911680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f66e0 0x7fd7e00f6b00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/1466911680 >> 172.21.15.96:0/1466911680 conn(0x7fd7e00f1e40 msgr2=0x7fd7e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:12.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/1466911680 shutdown_connections 2022-02-02T18:22:12.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.328+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/1466911680 wait complete. 2022-02-02T18:22:12.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 Processor -- start 2022-02-02T18:22:12.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 -- start start 2022-02-02T18:22:12.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f7980 0x7fd7e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e010aba0 con 0x7fd7e00f7980 2022-02-02T18:22:12.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e7bc5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e010ace0 con 0x7fd7e00f66e0 2022-02-02T18:22:12.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e5961700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:12.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e5961700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56744/0 (socket says 172.21.15.96:56744) 2022-02-02T18:22:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.329+0000 7fd7e5961700 1 -- 172.21.15.96:0/903670566 learned_addr learned my addr 172.21.15.96:0/903670566 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e5160700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f7980 0x7fd7e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e5961700 1 -- 172.21.15.96:0/903670566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f7980 msgr2=0x7fd7e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e5961700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f7980 0x7fd7e0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e5961700 1 -- 172.21.15.96:0/903670566 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0005040 con 0x7fd7e00f66e0 2022-02-02T18:22:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e5961700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd7d0014040 tx=0x7fd7d000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d0019070 con 0x7fd7e00f66e0 2022-02-02T18:22:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd7d0007e70 con 0x7fd7e00f66e0 2022-02-02T18:22:12.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.330+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/903670566 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e010af60 con 0x7fd7e00f66e0 2022-02-02T18:22:12.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.331+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/903670566 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e010b4c0 con 0x7fd7e00f66e0 2022-02-02T18:22:12.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.331+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d0014d70 con 0x7fd7e00f66e0 2022-02-02T18:22:12.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.331+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 22) v1 ==== 41617+0+0 (secure 0 0 0) 0x7fd7d0025070 con 0x7fd7e00f66e0 2022-02-02T18:22:12.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.332+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/903670566 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c8004fa0 con 0x7fd7e00f66e0 2022-02-02T18:22:12.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.332+0000 7fd7d67fc700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 0x7fd7cc036aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.332+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7fd7d0047210 con 0x7fd7e00f66e0 2022-02-02T18:22:12.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.332+0000 7fd7e5160700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 0x7fd7cc036aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:12.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.332+0000 7fd7e5160700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 0x7fd7cc036aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd7dc007fd0 tx=0x7fd7dc00b040).ready entity=mgr.14586 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:12.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.338+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7fd7d000f300 con 0x7fd7e00f66e0 2022-02-02T18:22:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.358+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 23) v1 ==== 77541+0+0 (secure 0 0 0) 0x7fd7d001dc60 con 0x7fd7e00f66e0 2022-02-02T18:22:12.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.529+0000 7fd7e7bc5700 1 -- 172.21.15.96:0/903670566 --> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7c8000bc0 con 0x7fd7cc0345e0 2022-02-02T18:22:12.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: cluster 2022-02-02T18:22:11.370361+0000 mon.smithi096 (mon.0) 607 : cluster [DBG] Standby manager daemon smithi096.shfutl started 2022-02-02T18:22:12.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: audit 2022-02-02T18:22:11.372280+0000 mon.smithi096 (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/crt"}]: dispatch 2022-02-02T18:22:12.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: audit 2022-02-02T18:22:11.373037+0000 mon.smithi096 (mon.0) 609 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:12.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: audit 2022-02-02T18:22:11.375508+0000 mon.smithi096 (mon.0) 610 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/key"}]: dispatch 2022-02-02T18:22:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: audit 2022-02-02T18:22:11.375848+0000 mon.smithi096 (mon.0) 611 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: audit 2022-02-02T18:22:12.214693+0000 mgr.smithi159.jrxkfz (mgr.14586) 9 : audit [DBG] from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:12 smithi096 conmon[32067]: cluster 2022-02-02T18:22:12.321144+0000 mgr.smithi159.jrxkfz (mgr.14586) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:12.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.544+0000 7fd7d67fc700 1 -- 172.21.15.96:0/903670566 <== mgr.14586 v2:172.21.15.159:6828/1667203026 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd7c8000bc0 con 0x7fd7cc0345e0 2022-02-02T18:22:12.548 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:22:12.548 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 2m ago 6m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:22:12.548 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (6m) 2m ago 6m 6983k - 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:22:12.549 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (6m) 8s ago 6m 7151k - 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:22:12.549 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 2m ago 6m 31.7M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:22:12.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2m) 2m ago 2m 13.5M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:22:12.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2m) 2m ago 2m 14.4M - 16.2.4 8d91d370c2b8 02d535f62526 2022-02-02T18:22:12.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2m) 8s ago 2m 2724M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:22:12.551 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2m) 8s ago 2m 2741M - 16.2.4 8d91d370c2b8 1be2a63e320d 2022-02-02T18:22:12.551 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:9283 running (7m) 2m ago 7m 426M - 16.2.4 8d91d370c2b8 8b463695d98b 2022-02-02T18:22:12.551 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (15s) 8s ago 6m 43.8M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 8dc57f23335d 2022-02-02T18:22:12.552 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (7m) 2m ago 7m 91.5M 2048M 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:22:12.552 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (6m) 8s ago 6m 65.5M 2048M 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:22:12.553 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (6m) 2m ago 6m 18.1M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:22:12.553 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (5m) 8s ago 5m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:22:12.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 2m ago 5m 48.7M 4096M 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:22:12.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 2m ago 5m 49.6M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:22:12.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 2m ago 4m 50.1M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:22:12.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4m) 8s ago 4m 695M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:22:12.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4m) 8s ago 4m 544M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:22:12.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3m) 8s ago 3m 602M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:22:12.555 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (5m) 2m ago 6m 32.6M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:22:12.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 msgr2=0x7fd7cc036aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 0x7fd7cc036aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd7dc007fd0 tx=0x7fd7dc00b040).stop 2022-02-02T18:22:12.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 msgr2=0x7fd7e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd7d0014040 tx=0x7fd7d000b040).stop 2022-02-02T18:22:12.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 shutdown_connections 2022-02-02T18:22:12.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7e00f66e0 0x7fd7e006b9a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7fd7cc0345e0 0x7fd7cc036aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 --2- 172.21.15.96:0/903670566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7e00f7980 0x7fd7e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 >> 172.21.15.96:0/903670566 conn(0x7fd7e00f1e40 msgr2=0x7fd7e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:12.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 shutdown_connections 2022-02-02T18:22:12.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.547+0000 7fd7c3fff700 1 -- 172.21.15.96:0/903670566 wait complete. 2022-02-02T18:22:12.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 -- 172.21.15.96:0/1135192117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f5340 msgr2=0x7f62e00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1135192117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f5340 0x7f62e00f7ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f62d0004660 tx=0x7f62d0009b30).stop 2022-02-02T18:22:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 -- 172.21.15.96:0/1135192117 shutdown_connections 2022-02-02T18:22:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1135192117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f5340 0x7f62e00f7ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1135192117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f49a0 0x7f62e00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 -- 172.21.15.96:0/1135192117 >> 172.21.15.96:0/1135192117 conn(0x7f62e00f04c0 msgr2=0x7f62e00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 -- 172.21.15.96:0/1135192117 shutdown_connections 2022-02-02T18:22:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.664+0000 7f62e7b53700 1 -- 172.21.15.96:0/1135192117 wait complete. 2022-02-02T18:22:12.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 Processor -- start 2022-02-02T18:22:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 -- start start 2022-02-02T18:22:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 0x7f62e00f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00f5f30 con 0x7f62e00f5340 2022-02-02T18:22:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e7b53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00f6070 con 0x7f62e00f49a0 2022-02-02T18:22:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e50ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e58ef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 0x7f62e00f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e50ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52652/0 (socket says 172.21.15.96:52652) 2022-02-02T18:22:12.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e50ee700 1 -- 172.21.15.96:0/1734815065 learned_addr learned my addr 172.21.15.96:0/1734815065 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e58ef700 1 -- 172.21.15.96:0/1734815065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 msgr2=0x7f62e00f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e58ef700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e58ef700 1 -- 172.21.15.96:0/1734815065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0005040 con 0x7f62e00f49a0 2022-02-02T18:22:12.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.665+0000 7f62e50ee700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:22:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62e58ef700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 0x7f62e00f7550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62e005f480 tx=0x7f62dc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc0092e0 con 0x7f62e00f49a0 2022-02-02T18:22:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00f6350 con 0x7f62e00f49a0 2022-02-02T18:22:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62dc00f040 con 0x7f62e00f49a0 2022-02-02T18:22:12.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc0147a0 con 0x7f62e00f49a0 2022-02-02T18:22:12.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.666+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e010ef40 con 0x7f62e00f49a0 2022-02-02T18:22:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.667+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e0045ad0 con 0x7f62e00f49a0 2022-02-02T18:22:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.667+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) v1 ==== 77541+0+0 (secure 0 0 0) 0x7f62dc01b030 con 0x7f62e00f49a0 2022-02-02T18:22:12.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.668+0000 7f62d67fc700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 0x7f62cc062d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.668+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f62dc07b950 con 0x7f62e00f49a0 2022-02-02T18:22:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.668+0000 7f62e50ee700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 0x7f62cc062d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.668+0000 7f62e50ee700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 0x7f62cc062d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f62d0005010 tx=0x7f62d0016040).ready entity=mgr.14586 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:12.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:12.676+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f62dc049fa0 con 0x7f62e00f49a0 2022-02-02T18:22:12.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: cluster 2022-02-02T18:22:11.370361 2022-02-02T18:22:12.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 607 : cluster [DBG] Standby manager daemon smithi096.shfutl started 2022-02-02T18:22:12.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit 2022-02-02T18:22:11. 2022-02-02T18:22:12.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 372280+0000 mon.smithi096 (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/crt"}]: dispatch 2022-02-02T18:22:12.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:12.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 11.373037+0000 mon.smithi096 (mon.0) 609 : 2022-02-02T18:22:12.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:12.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 2022-02-02T18:22:11.375508+0000 2022-02-02T18:22:12.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: mon.smithi096 (mon.0) 610 : audit [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/key"}]: dispatch 2022-02-02T18:22:12.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 2022-02-02T18:22:12.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:12.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 11.375848+0000 mon.smithi096 (mon.0) 611 : audit 2022-02-02T18:22:12.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: [DBG] from='mgr.? 172.21.15.96:0/632970320' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:12.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:22:12.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: T18:22:12.214693+0000 mgr.smithi159.jrxkfz (mgr. 2022-02-02T18:22:12.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 14586) 9 : audit [DBG] from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:12.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: cluster 2022-02-02T18:22:12.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: 2022-02-02T18:22:12 2022-02-02T18:22:12.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: .321144+0000 mgr.smithi159.jrxkfz (mgr.14586) 10 : cluster 2022-02-02T18:22:12.699 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:12 smithi159 conmon[35668]: [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:13.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.044+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62e00ff000 con 0x7f62e00f49a0 2022-02-02T18:22:13.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.045+0000 7f62d67fc700 1 -- 172.21.15.96:0/1734815065 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+785 (secure 0 0 0) 0x7f62dc019330 con 0x7f62e00f49a0 2022-02-02T18:22:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:22:13.049 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:22:13.049 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:22:13.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:13.050 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:22:13.050 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2022-02-02T18:22:13.051 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 1 2022-02-02T18:22:13.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:13.051 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:22:13.052 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:22:13.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:13.053 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:22:13.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:22:13.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:13.054 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:22:13.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13, 2022-02-02T18:22:13.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 1 2022-02-02T18:22:13.056 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:22:13.056 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:22:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 msgr2=0x7f62cc062d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 0x7f62cc062d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f62d0005010 tx=0x7f62d0016040).stop 2022-02-02T18:22:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 msgr2=0x7f62e00f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 0x7f62e00f7550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62e005f480 tx=0x7f62dc00b040).stop 2022-02-02T18:22:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 shutdown_connections 2022-02-02T18:22:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e00f49a0 0x7f62e00f7550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f62cc0608c0 0x7f62cc062d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 --2- 172.21.15.96:0/1734815065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00f5340 0x7f62e00f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 >> 172.21.15.96:0/1734815065 conn(0x7f62e00f04c0 msgr2=0x7f62e00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 shutdown_connections 2022-02-02T18:22:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.047+0000 7f62e7b53700 1 -- 172.21.15.96:0/1734815065 wait complete. 2022-02-02T18:22:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 -- 172.21.15.96:0/644681179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f55c0 msgr2=0x7f4f900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 --2- 172.21.15.96:0/644681179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f55c0 0x7f4f900f59e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4f800045a0 tx=0x7f4f80009b30).stop 2022-02-02T18:22:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 -- 172.21.15.96:0/644681179 shutdown_connections 2022-02-02T18:22:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 --2- 172.21.15.96:0/644681179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6860 0x7f4f900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 --2- 172.21.15.96:0/644681179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f55c0 0x7f4f900f59e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 -- 172.21.15.96:0/644681179 >> 172.21.15.96:0/644681179 conn(0x7f4f900f0d40 msgr2=0x7f4f900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 -- 172.21.15.96:0/644681179 shutdown_connections 2022-02-02T18:22:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.158+0000 7f4f98189700 1 -- 172.21.15.96:0/644681179 wait complete. 2022-02-02T18:22:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 Processor -- start 2022-02-02T18:22:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 -- start start 2022-02-02T18:22:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 0x7f4f90104d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90105870 con 0x7f4f900f55c0 2022-02-02T18:22:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f98189700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90106080 con 0x7f4f900f6860 2022-02-02T18:22:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95f25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 0x7f4f90104d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95724700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95f25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 0x7f4f90104d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52660/0 (socket says 172.21.15.96:52660) 2022-02-02T18:22:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95f25700 1 -- 172.21.15.96:0/415199390 learned_addr learned my addr 172.21.15.96:0/415199390 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95724700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:56764/0 (socket says 172.21.15.96:56764) 2022-02-02T18:22:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95724700 1 -- 172.21.15.96:0/415199390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 msgr2=0x7f4f90104d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95724700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 0x7f4f90104d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.159+0000 7f4f95724700 1 -- 172.21.15.96:0/415199390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80005040 con 0x7f4f900f6860 2022-02-02T18:22:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f95724700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4f8c00e7c0 tx=0x7f4f8c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8c0092e0 con 0x7f4f900f6860 2022-02-02T18:22:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f8c00f040 con 0x7f4f900f6860 2022-02-02T18:22:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f90106300 con 0x7f4f900f6860 2022-02-02T18:22:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8c014850 con 0x7f4f900f6860 2022-02-02T18:22:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.160+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f901068c0 con 0x7f4f900f6860 2022-02-02T18:22:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.161+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f900f49b0 con 0x7f4f900f6860 2022-02-02T18:22:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.161+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) v1 ==== 77541+0+0 (secure 0 0 0) 0x7f4f8c01b030 con 0x7f4f900f6860 2022-02-02T18:22:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.162+0000 7f4f867fc700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 0x7f4f7c062d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.162+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f4f8c07b820 con 0x7f4f900f6860 2022-02-02T18:22:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.162+0000 7f4f95f25700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 0x7f4f7c062d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.162+0000 7f4f95f25700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 0x7f4f7c062d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4f80004cc0 tx=0x7f4f8000b040).ready entity=mgr.14586 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.166+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f4f8c049f20 con 0x7f4f900f6860 2022-02-02T18:22:13.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.396+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f900fce00 con 0x7f4f900f6860 2022-02-02T18:22:13.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.724+0000 7f4f867fc700 1 -- 172.21.15.96:0/415199390 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1655 (secure 0 0 0) 0x7f4f900fce00 con 0x7f4f900f6860 2022-02-02T18:22:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:e17 2022-02-02T18:22:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:22:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:22:13.729 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:22:13.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:13.729 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:22:13.729 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:22:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 17 2022-02-02T18:22:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:22:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:22:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:21:34.948030+0000 2022-02-02T18:22:13.731 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:22:13.731 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:22:13.731 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:22:13.731 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:22:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:22:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:22:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:22:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:22:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:22:13.733 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:22:13.733 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:22:13.733 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24263,1=24273} 2022-02-02T18:22:13.733 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:22:13.734 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:22:13.734 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:22:13.734 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:22:13.734 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:22:13.734 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:22:13.735 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:22:13.735 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:22:13.735 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24263} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1329095382,v1:172.21.15.159:6825/1329095382]] 2022-02-02T18:22:13.735 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:14444} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765]] 2022-02-02T18:22:13.736 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:22:13.736 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:22:13.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:13.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 msgr2=0x7f4f7c062d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 0x7f4f7c062d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4f80004cc0 tx=0x7f4f8000b040).stop 2022-02-02T18:22:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 msgr2=0x7f4f90105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4f8c00e7c0 tx=0x7f4f8c00b040).stop 2022-02-02T18:22:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 shutdown_connections 2022-02-02T18:22:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:6828/1667203026,v1:172.21.15.159:6829/1667203026] conn(0x7f4f7c0608c0 0x7f4f7c062d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f55c0 0x7f4f90104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 --2- 172.21.15.96:0/415199390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f6860 0x7f4f90105270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.728+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 >> 172.21.15.96:0/415199390 conn(0x7f4f900f0d40 msgr2=0x7f4f900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.730+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 shutdown_connections 2022-02-02T18:22:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:13.730+0000 7f4f98189700 1 -- 172.21.15.96:0/415199390 wait complete. 2022-02-02T18:22:13.740 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2022-02-02T18:22:14.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: cluster 2022-02-02T18:22:12.355368+0000 mon.smithi096 (mon.0) 612 2022-02-02T18:22:14.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: : cluster [DBG] mgrmap e23: smithi159.jrxkfz(active, since 6s), standbys: smithi096.shfutl 2022-02-02T18:22:14.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.359359+0000 mon.smithi159 (mon.1) 36 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:14.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.594851 2022-02-02T18:22:14.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 613 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T18:22:14.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:22:14.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: T18:22:12.595334+0000 mon.smithi159 (mon.1) 37 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:14.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:14.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: 02-02T18:22:12.595589+0000 mon.smithi159 (mon.1 2022-02-02T18:22:14.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: ) 38 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:14.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022-02-02T18:22:13 2022-02-02T18:22:14.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: .045672+0000 mon.smithi159 (mon.1) 39 : audit [DBG] from='client.? 172.21.15.96:0/1734815065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:22:14.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: 2022-02-02T18:22:14.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:22:14.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: -02T18:22:13.200196+0000 mon.smithi096 (mon.0) 614 : audit 2022-02-02T18:22:14.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:13 smithi159 conmon[35668]: [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T18:22:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: cluster 2022-02-02T18:22:12 2022-02-02T18:22:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: .355368+0000 mon.smithi096 (mon.0) 612 : cluster [DBG] mgrmap e23: smithi159.jrxkfz(active, since 6s), standbys: smithi096.shfutl 2022-02-02T18:22:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022-02-02T18:22:12. 2022-02-02T18:22:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 359359+0000 mon.smithi159 (mon.1) 36 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 2022-02-02T18:22:14.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022-02-02T18:22:14.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 2022-02- 2022-02-02T18:22:14.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 02T18:22:12.594851+0000 mon.smithi096 (mon 2022-02-02T18:22:14.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: .0) 613 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T18:22:14.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:14.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: -02-02T18:22:12. 2022-02-02T18:22:14.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 595334+0000 mon.smithi159 (mon.1) 2022-02-02T18:22:14.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 37 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:14.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:14.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: -02-02T18:22:12. 2022-02-02T18:22:14.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 595589+0000 mon.smithi159 (mon.1) 2022-02-02T18:22:14.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 38 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:14.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:14.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: -02-02T18:22:13. 2022-02-02T18:22:14.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 045672+0000 mon.smithi159 (mon.1) 2022-02-02T18:22:14.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 39 : audit [DBG] from='client.? 172.21.15.96:0/1734815065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:22:14.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:14.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: -02-02T18:22:13. 2022-02-02T18:22:14.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 200196+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:14.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:13 smithi096 conmon[32067]: 614 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T18:22:14.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:12 2022-02-02T18:22:14.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: .531307+0000 mgr.smithi159.jrxkfz (mgr.14586) 11 : audit [DBG] from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:14.970 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.202256+0000 mon.smithi159 (mon.1) 40 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T18:22:14.970 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.721252+0000 mon.smithi159 (mon.1) 41 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T18:22:14.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.721951+0000 mon.smithi159 (mon.1) 42 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:14.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.722168+0000 mon.smithi159 (mon.1) 43 : audit [DBG] from='client.? 172.21.15.96:0/415199390' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:22:14.972 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.722322+0000 mon.smithi159 (mon.1) 44 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:14.972 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:13.724207+0000 mon.smithi096 (mon.0) 615 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:14.973 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:14.135449+0000 mon.smithi096 (mon.0) 616 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:14.973 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: cluster 2022-02-02T18:22:14.321611+0000 mgr.smithi159.jrxkfz (mgr.14586) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 295 op/s 2022-02-02T18:22:14.974 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:14 smithi096 conmon[32067]: audit 2022-02-02T18:22:14.709521+0000 mon.smithi096 (mon.0) 617 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:15.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:12.531307+0000 mgr.smithi159.jrxkfz (mgr.14586) 11 : audit [DBG] from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:15.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.202256+0000 mon.smithi159 (mon.1) 40 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T18:22:15.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.721252+0000 mon.smithi159 (mon.1) 41 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T18:22:15.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.721951+0000 mon.smithi159 (mon.1) 42 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:15.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.722168+0000 mon.smithi159 (mon.1) 43 : 2022-02-02T18:22:15.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit [DBG] from='client.? 172.21.15.96:0/415199390' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:22:15.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.722322+0000 mon.smithi159 (mon.1) 44 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:15.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:13.724207+0000 mon.smithi096 (mon.0) 615 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:15.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:14.135449+0000 mon.smithi096 (mon.0) 616 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:15.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: cluster 2022-02-02T18:22:14.321611+0000 mgr.smithi159.jrxkfz (mgr.14586) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 295 op/s 2022-02-02T18:22:15.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:14 smithi159 conmon[35668]: audit 2022-02-02T18:22:14.709521+0000 mon.smithi096 (mon.0) 617 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:16.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:15 smithi096 conmon[32067]: audit 2022-02-02T18:22:14.981133+0000 mon.smithi096 (mon.0) 618 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:15 smithi159 conmon[35668]: audit 2022-02-02T18:22:14.981133+0000 mon.smithi096 (mon.0 2022-02-02T18:22:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:15 smithi159 conmon[35668]: ) 618 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:17.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:16 smithi159 conmon[35668]: cluster 2022-02-02T18:22:16.321947+0000 mgr.smithi159.jrxkfz (mgr.14586) 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2022-02-02T18:22:17.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:16 smithi096 conmon[32067]: cluster 2022-02-02T18:22:16.321947+0000 mgr.smithi159.jrxkfz (mgr.14586) 2022-02-02T18:22:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:16 smithi096 conmon[32067]: 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2022-02-02T18:22:18.820 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:17.622546+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:18.820 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: 619 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.821 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:17.624652+0000 mon.smithi159 (mon.1) 45 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.821 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:17.624729+0000 mon.smithi096 (mon.0) 620 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.821 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.203089+0000 mon.smithi096 (mon.0) 621 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.821 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.205182+0000 mon.smithi159 (mon.1) 46 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.822 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.205258+0000 mon.smithi096 (mon.0) 622 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.822 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: cluster 2022-02-02T18:22:18.206758+0000 mgr.smithi159.jrxkfz (mgr.14586) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 366 op/s 2022-02-02T18:22:18.822 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.209338+0000 mon.smithi096 (mon.0) 623 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.822 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.213481+0000 mon.smithi096 (mon.0) 624 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.221571+0000 mon.smithi096 (mon.0) 625 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.227449+0000 mon.smithi096 (mon.0) 626 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.233777+0000 mon.smithi096 (mon.0) 627 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.244932+0000 mon.smithi159 (mon.1) 47 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:18.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: audit 2022-02-02T18:22:18.248908+0000 mon.smithi096 (mon.0) 628 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.824 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:18 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:18.250994+0000 mgr.smithi159.jrxkfz (mgr.14586) 15 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:22:18.958 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:17.622546+0000 mon.smithi096 (mon.0) 619 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.958 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:17.624652+0000 mon.smithi159 (mon.1) 45 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.959 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:17.624729+0000 mon.smithi096 (mon.0) 620 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.959 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.203089+0000 mon.smithi096 (mon.0) 621 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.959 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.205182+0000 mon.smithi159 (mon.1) 46 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.959 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.205258+0000 mon.smithi096 (mon.0) 622 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:18.959 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: cluster 2022-02-02T18:22:18.206758+0000 mgr.smithi159.jrxkfz (mgr.14586) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 366 op/s 2022-02-02T18:22:18.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.209338+0000 mon.smithi096 (mon.0) 623 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.213481+0000 mon.smithi096 (mon.0) 624 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.221571+0000 mon.smithi096 (mon.0) 625 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.227449+0000 mon.smithi096 (mon.0) 626 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.233777+0000 mon.smithi096 (mon.0) 627 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.244932+0000 mon.smithi159 (mon.1) 47 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:18.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: audit 2022-02-02T18:22:18.248908+0000 mon.smithi096 (mon.0) 628 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:18.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:18 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:18.250994+0000 mgr.smithi159.jrxkfz (mgr.14586) 15 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:22:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: cluster 2022-02-02T18:22:19.200245+0000 mon.smithi096 (mon.0) 629 : cluster [WRN] 2022-02-02T18:22:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:22:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: audit 2022-02-02T18:22:19.681447+0000 mon.smithi096 (mon.0) 630 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: audit 2022-02-02T18:22:19.682564+0000 mon.smithi159 (mon.1) 48 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: 2022-02-02T18:22:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: audit 2022-02-02T18:22:19.682612+0000 mon.smithi096 (mon.0 2022-02-02T18:22:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: ) 631 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: audit 2022-02-02T18:22:19.683714+0000 mon.smithi159 2022-02-02T18:22:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: (mon.1) 49 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:22:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: audit 2022-02-02T18:22:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: 2022-02-02T18:22:19. 2022-02-02T18:22:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: 684392+0000 mon.smithi159 (mon.1) 50 : audit 2022-02-02T18:22:20.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:19 smithi159 conmon[35668]: [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: cluster 2022-02-02T18:22:19.200245+0000 mon.smithi096 (mon.0) 629 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:22:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: audit 2022-02-02T18:22:19.681447+0000 mon.smithi096 (mon.0) 630 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: audit 2022-02-02T18:22:19.682564+0000 mon.smithi159 (mon.1) 48 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: audit 2022-02-02T18:22:19.682612+0000 mon.smithi096 (mon.0) 631 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: audit 2022-02-02T18:22:19.683714+0000 mon.smithi159 (mon.1) 49 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:22:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:19 smithi096 conmon[32067]: audit 2022-02-02T18:22:19.684392+0000 mon.smithi159 (mon.1) 50 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:21.252 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:20 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:19.677215+0000 mgr.smithi159.jrxkfz (mgr.14586) 16 : cephadm [INF] Upgrade: Updating mgr.smithi096.shfutl 2022-02-02T18:22:21.252 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:20 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:19.685115+0000 mgr.smithi159.jrxkfz (mgr.14586) 17 : cephadm [INF] Deploying daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:22:21.253 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:20 smithi096 conmon[32067]: cluster 2022-02-02T18:22:20.207125+0000 mgr.smithi159.jrxkfz (mgr.14586) 18 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 305 op/s 2022-02-02T18:22:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:20 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:19.677215+0000 mgr.smithi159.jrxkfz ( 2022-02-02T18:22:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:20 smithi159 conmon[35668]: mgr.14586) 16 : cephadm [INF] Upgrade: Updating mgr.smithi096.shfutl 2022-02-02T18:22:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:20 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:19.685115+0000 mgr.smithi159.jrxkfz (mgr.14586) 17 : cephadm [INF] Deploying daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:22:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:20 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:22:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:20 smithi159 conmon[35668]: 02-02T18:22:20.207125+0000 mgr.smithi159.jrxkfz (mgr.14586) 18 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 305 op/s 2022-02-02T18:22:22.721 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:22 smithi096 conmon[32067]: audit 2022-02-02T18:22:21.397785+0000 mon.smithi096 (mon.0) 632 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:22.721 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:22 smithi096 conmon[32067]: cluster 2022-02-02T18:22:22.207477+0000 mgr.smithi159.jrxkfz (mgr.14586) 19 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 305 op/s 2022-02-02T18:22:22.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:22 smithi159 conmon[35668]: audit 2022-02-02T18:22:21.397785+0000 mon.smithi096 (mon.0) 632 2022-02-02T18:22:22.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:22 smithi159 conmon[35668]: : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:22 smithi159 conmon[35668]: cluster 2022-02-02T18:22:22.207477+0000 mgr.smithi159.jrxkfz (mgr.14586) 19 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 305 op/s 2022-02-02T18:22:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: audit 2022-02-02T18:22:22.850866+0000 mon.smithi096 (mon.0) 633 : audit [INF] 2022-02-02T18:22:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:24.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: audit 2022-02-02T18:22:22.852540+0000 mon.smithi159 (mon.1) 51 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:24.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: audit 2022-02-02T18:22:22.853538+0000 mon.smithi159 (mon.1) 52 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:24.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: audit 2022-02-02T18:22:22.854123+0000 mon.smithi159 (mon.1) 53 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:22:24.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: cephadm 2022- 2022-02-02T18:22:24.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: 02-02T18:22:22.854668+0000 mgr.smithi159.jrxkfz (mgr.14586) 20 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:22:24.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: cluster 2022-02-02T18:22:23.082333+0000 mon.smithi096 (mon.0) 634 : cluster 2022-02-02T18:22:24.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: [INF] daemon mds.cephfs.smithi159.shbucd restarted 2022-02-02T18:22:24.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: cluster 2022-02-02T18:22:23.088382+0000 mon.smithi096 2022-02-02T18:22:24.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:23 smithi159 conmon[35668]: (mon.0) 635 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2022-02-02T18:22:24.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: audit 2022-02-02T18:22:22.850866 2022-02-02T18:22:24.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 633 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:24.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: audit 2022-02-02T18:22:22.852540+0000 mon.smithi159 (mon 2022-02-02T18:22:24.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: .1) 51 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:24.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:24.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: 18:22:22.853538+0000 mon.smithi159 ( 2022-02-02T18:22:24.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: mon.1) 52 : audit [DBG] 2022-02-02T18:22:24.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:24.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:22:24.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: 02T18:22:22.854123+0000 2022-02-02T18:22:24.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: mon.smithi159 (mon.1) 53 : audit [INF] 2022-02-02T18:22:24.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:22:24.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: cephadm 2022-02-02T 2022-02-02T18:22:24.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: 18:22:22.854668+0000 mgr.smithi159.jrxkfz 2022-02-02T18:22:24.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: (mgr.14586) 20 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:22:24.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: 2022-02-02T18:22:24.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: cluster 2022-02-02T 2022-02-02T18:22:24.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: 18:22:23.082333+0000 mon.smithi096 ( 2022-02-02T18:22:24.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: mon.0) 634 : cluster [INF] daemon mds.cephfs.smithi159.shbucd restarted 2022-02-02T18:22:24.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:22:24.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: -02-02T18:22:23 2022-02-02T18:22:24.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: .088382+0000 mon.smithi096 (mon.0) 635 : cluster [DBG] 2022-02-02T18:22:24.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:23 smithi096 conmon[32067]: osdmap e47: 6 total, 6 up, 6 in 2022-02-02T18:22:25.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022-02-02T18:22:23.849180+0000 mon.smithi096 ( 2022-02-02T18:22:25.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: mon.0) 636 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T18:22:25.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022-02-02T18:22:23.854836+0000 mon.smithi096 (mon.0) 637 : cluster [DBG] 2022-02-02T18:22:25.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:boot 2022-02-02T18:22:25.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:22:25.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: -02T18:22:23.854890+0000 mon.smithi096 (mon.0) 638 : cluster 2022-02-02T18:22:25.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: [INF] Standby daemon mds.cephfs.smithi096.pitrsc assigned to filesystem cephfs as rank 0 2022-02-02T18:22:25.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022-02-02T 2022-02-02T18:22:25.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: 18:22:23.855158+0000 mon.smithi096 (mon. 2022-02-02T18:22:25.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: 0) 639 : cluster [DBG] fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2022-02-02T18:22:25.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:25.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: 02-02T18:22:23.860160+0000 mon.smithi159 2022-02-02T18:22:25.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: (mon.1) 54 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:25.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022-02-02T18 2022-02-02T18:22:25.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: :22:23.862347+0000 mon.smithi096 (mon.0) 640 : 2022-02-02T18:22:25.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:25.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:22:25.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: 02-02T18:22:24.207834+0000 2022-02-02T18:22:25.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: mgr.smithi159.jrxkfz (mgr.14586) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2022-02-02T18:22:25.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:24 smithi096 conmon[32067]: 2022-02-02T18:22:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022-02-02T18:22:23.849180+0000 mon.smithi096 (mon.0) 636 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T18:22:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022-02-02T18:22:23.854836+0000 mon.smithi096 (mon.0) 637 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:boot 2022-02-02T18:22:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022-02-02T18:22:23.854890+0000 mon.smithi096 (mon.0) 638 : cluster [INF] Standby daemon mds.cephfs.smithi096.pitrsc assigned to filesystem cephfs as rank 0 2022-02-02T18:22:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:22:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: -02-02T18:22:23.855158+0000 mon.smithi096 (mon.0) 639 : cluster [DBG] fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2022-02-02T18:22:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: audit 2022-02-02T18:22:23 2022-02-02T18:22:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: .860160+0000 mon.smithi159 (mon.1) 54 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022-02 2022-02-02T18:22:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: -02T18:22:23.862347+0000 mon.smithi096 (mon.0) 640 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: cluster 2022-02-02T18:22:24.207834+0000 mgr.smithi159.jrxkfz (mgr 2022-02-02T18:22:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:24 smithi159 conmon[35668]: .14586) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2022-02-02T18:22:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:25 smithi159 conmon[35668]: cluster 2022-02-02T18:22:24.971117+0000 mon.smithi096 2022-02-02T18:22:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:25 smithi159 conmon[35668]: (mon.0) 641 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:resolve 2022-02-02T18:22:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:25 smithi159 conmon[35668]: cluster 2022-02-02T18:22:24.971176+0000 mon.smithi096 (mon.0) 642 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:25 smithi096 conmon[32067]: cluster 2022-02-02T18:22:24.971117+0000 mon.smithi096 (mon.0) 641 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:resolve 2022-02-02T18:22:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:25 smithi096 conmon[32067]: cluster 2022-02-02T18:22:24.971176+0000 mon.smithi096 (mon.0) 642 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:26.989 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:26 smithi096 conmon[32067]: cluster 2022-02-02T18:22:25.981720+0000 mon.smithi096 2022-02-02T18:22:26.989 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:26 smithi096 conmon[32067]: (mon.0) 643 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:reconnect 2022-02-02T18:22:26.990 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:26 smithi096 conmon[32067]: cluster 2022-02-02T18:22:25.981778+0000 mon.smithi096 (mon.0) 644 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:26.990 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:26 smithi096 conmon[32067]: cluster 2022-02-02T18:22: 2022-02-02T18:22:26.990 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:26 smithi096 conmon[32067]: 26.208158+0000 mgr.smithi159.jrxkfz (mgr.14586) 22 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2022-02-02T18:22:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:26 smithi159 conmon[35668]: cluster 2022-02-02T18:22:25.981720+0000 mon.smithi096 (mon.0) 643 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:reconnect 2022-02-02T18:22:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:26 smithi159 conmon[35668]: 2022-02-02T18:22:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:26 smithi159 conmon[35668]: cluster 2022-02-02T18:22:25.981778+0000 mon.smithi096 (mon.0) 644 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:26 smithi159 conmon[35668]: cluster 2022-02-02T18:22:26.208158+0000 mgr.smithi159.jrxkfz (mgr.14586) 22 : cluster [DBG] 2022-02-02T18:22:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:26 smithi159 conmon[35668]: pgmap v16: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2022-02-02T18:22:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:27 smithi159 conmon[35668]: cluster 2022-02-02T18:22:26.989324+0000 mon.smithi096 (mon.0) 645 : 2022-02-02T18:22:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:27 smithi159 conmon[35668]: cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:rejoin 2022-02-02T18:22:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:27 smithi159 conmon[35668]: cluster 2022-02-02T18:22:26.989377+0000 mon.smithi096 (mon.0) 646 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:27 smithi096 conmon[32067]: cluster 2022-02-02T18:22:26.989324+0000 mon.smithi096 (mon.0 2022-02-02T18:22:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:27 smithi096 conmon[32067]: ) 645 : cluster [DBG] mds.? [v2:172.21.15.96:6826/581960765,v1:172.21.15.96:6827/581960765] up:rejoin 2022-02-02T18:22:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:27 smithi096 conmon[32067]: cluster 2022-02-02T18:22:26.989377+0000 mon.smithi096 (mon.0) 646 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:29.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: cluster 2022-02-02T18:22:27.991448+0000 2022-02-02T18:22:29.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: mon.smithi096 (mon.0) 647 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:standby 2022-02-02T18:22:29.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: cluster 2022-02-02T18:22:27.991496+0000 mon.smithi096 (mon.0 2022-02-02T18:22:29.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: ) 648 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:29.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: cluster 2022-02- 2022-02-02T18:22:29.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: 02T18:22:28.208625+0000 2022-02-02T18:22:29.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: mgr.smithi159.jrxkfz (mgr.14586) 23 : cluster 2022-02-02T18:22:29.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:28 smithi159 conmon[35668]: [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:29.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:22:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: -02-02T18:22:27.991448+0000 mon.smithi096 (mon.0) 647 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:standby 2022-02-02T18:22:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: cluster 2022-02-02T18:22:27.991496 2022-02-02T18:22:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 648 : cluster [DBG] 2022-02-02T18:22:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: cluster 2022-02-02T18:22 2022-02-02T18:22:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: :28.208625+0000 mgr.smithi159.jrxkfz (mgr.14586) 2022-02-02T18:22:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:28 smithi096 conmon[32067]: 23 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: cluster 2022-02-02T18:22:29.654700 2022-02-02T18:22:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 649 : cluster [DBG] Standby manager daemon smithi096.shfutl restarted 2022-02-02T18:22:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: cluster 2022-02-02T18:22:29 2022-02-02T18:22:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: .654955+0000 mon.smithi096 (mon.0) 650 : cluster [DBG] Standby manager daemon smithi096.shfutl started 2022-02-02T18:22:30.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: 02-02T18:22:29.657393+0000 mon.smithi096 ( 2022-02-02T18:22:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: mon.0) 651 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/crt"}]: dispatch 2022-02-02T18:22:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:22:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: -02T18:22:29.657777+0000 2022-02-02T18:22:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: mon.smithi096 (mon.0) 652 : audit 2022-02-02T18:22:30.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:30.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:22:30.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: -02T18:22:29.659878 2022-02-02T18:22:30.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 653 : 2022-02-02T18:22:30.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/key"}]: dispatch 2022-02-02T18:22:30.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: audit 2022-02-02T18:22:30.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:30.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: 29.660778+0000 mon.smithi096 (mon. 2022-02-02T18:22:30.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: 0) 654 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:30.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:29 smithi159 conmon[35668]: 2022-02-02T18:22:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: cluster 2022-02-02T18:22:29.654700+0000 mon.smithi096 (mon.0) 649 : cluster [DBG] 2022-02-02T18:22:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: Standby manager daemon smithi096.shfutl restarted 2022-02-02T18:22:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: cluster 2022-02-02T18:22:29.654955+0000 mon.smithi096 (mon.0) 650 : cluster [DBG] Standby manager daemon smithi096.shfutl started 2022-02-02T18:22:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: audit 2022-02-02T18:22:29.657393+0000 2022-02-02T18:22:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: mon.smithi096 (mon.0) 651 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/crt"}]: dispatch 2022-02-02T18:22:30.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:30.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: -02-02T18:22:29.657777+0000 2022-02-02T18:22:30.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: mon.smithi096 (mon.0) 652 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:30.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: 2022-02-02T18:22:30.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:30.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: -02-02T18:22:29.659878+0000 mon.smithi096 (mon. 2022-02-02T18:22:30.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: 0) 653 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.shfutl/key"}]: dispatch 2022-02-02T18:22:30.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:30.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: 18:22:29.660778+0000 mon.smithi096 (mon. 2022-02-02T18:22:30.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:29 smithi096 conmon[32067]: 0) 654 : audit [DBG] from='mgr.? 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: cluster 2022-02-02T18:22:30.005587+0000 2022-02-02T18:22:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: mon.smithi096 (mon.0) 655 : cluster [DBG] mgrmap e24: smithi159.jrxkfz(active, since 24s), standbys: smithi096.shfutl 2022-02-02T18:22:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: audit 2022-02-02T18:22:30.032364+0000 mon.smithi096 (mon.0 2022-02-02T18:22:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: ) 656 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: cluster 2022-02-02T18:22:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: 2022-02-02T18:22:30. 2022-02-02T18:22:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: 208987+0000 mgr.smithi159.jrxkfz (mgr.14586) 24 : cluster 2022-02-02T18:22:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: 02-02T18:22:30.872719+0000 2022-02-02T18:22:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: mon.smithi096 (mon.0) 657 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:31 smithi159 conmon[35668]: 2022-02-02T18:22:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:31 smithi096 conmon[32067]: cluster 2022-02-02T18:22:30.005587+0000 mon.smithi096 (mon.0) 655 : cluster [DBG] mgrmap e24: smithi159.jrxkfz(active, since 24s), standbys: smithi096.shfutl 2022-02-02T18:22:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:31 smithi096 conmon[32067]: audit 2022-02-02T18:22:30.032364+0000 mon.smithi096 (mon.0) 656 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:31 smithi096 conmon[32067]: cluster 2022-02-02T18:22:30.208987+0000 mgr.smithi159.jrxkfz (mgr.14586) 24 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:31 smithi096 conmon[32067]: audit 2022-02-02T18:22:30.872719+0000 mon.smithi096 (mon.0) 657 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:33.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:33 smithi159 conmon[35668]: cluster 2022-02-02T18:22:32.209353+0000 mgr.smithi159.jrxkfz (mgr.14586 2022-02-02T18:22:33.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:33 smithi159 conmon[35668]: ) 25 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:33 smithi096 conmon[32067]: cluster 2022-02-02T18:22:32.209353+0000 mgr.smithi159.jrxkfz (mgr.14586) 25 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 279 op/s 2022-02-02T18:22:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:34 smithi159 conmon[35668]: cluster 2022-02-02T18:22:34.209824+0000 mgr.smithi159.jrxkfz (mgr.14586) 26 2022-02-02T18:22:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:34 smithi159 conmon[35668]: : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 140 op/s 2022-02-02T18:22:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:34 smithi096 conmon[32067]: cluster 2022-02-02T18:22:34.209824+0000 mgr.smithi159.jrxkfz 2022-02-02T18:22:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:34 smithi096 conmon[32067]: (mgr.14586) 26 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 140 op/s 2022-02-02T18:22:36.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02T18:22:35.514035 2022-02-02T18:22:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 658 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cluster 2022-02-02T18: 2022-02-02T18:22:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: 22:35.516173+0000 mgr.smithi159.jrxkfz (mgr.14586) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2022-02-02T18:22:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:22:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: 02-02T18:22:35.516373+0000 mgr.smithi159.jrxkfz (mgr 2022-02-02T18:22:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: .14586) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 167 op/s 2022-02-02T18:22:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:22:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: 22:35.519145+0000 mon.smithi096 (mon.0) 659 : 2022-02-02T18:22:36.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:36.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02T18:22:35.527903 2022-02-02T18:22:36.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: +0000 mon.smithi159 (mon.1) 55 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:36.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:35.529913+0000 mgr.smithi159.jrxkfz (mgr.14586) 29 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:22:36.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:35.531944+0000 mgr.smithi159.jrxkfz 2022-02-02T18:22:36.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: (mgr.14586) 30 : cephadm [INF] Failing over to other MGR 2022-02-02T18:22:36.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:22:36.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: T18:22:35.532114+0000 mon.smithi096 (mon 2022-02-02T18:22:36.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: .0) 660 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:36.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02T18:22:35.532150+0000 2022-02-02T18:22:36.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: mon.smithi159 (mon.1) 56 : audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:36.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cluster 2022-02-02T18:22: 2022-02-02T18:22:36.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: 35.539534+0000 mon.smithi096 (mon.0) 661 : cluster [DBG] 2022-02-02T18:22:36.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: osdmap e48: 6 total, 6 up, 6 in 2022-02-02T18:22:36.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:22:36.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: -02-02T18:22:35.668216+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:36.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: 662 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:22:36.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: audit 2022-02-02T18:22 2022-02-02T18:22:36.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: :36.400861+0000 mon.smithi096 (mon.0) 663 : audit 2022-02-02T18:22:36.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:36 smithi159 conmon[35668]: [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:36.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022-02-02T18:22:35.514035+0000 mon.smithi096 2022-02-02T18:22:36.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: (mon.0) 658 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cluster 2022-02-02T18:22:35.516173+0000 mgr.smithi159.jrxkfz (mgr.14586) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2022-02-02T18:22:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cluster 2022-02-02T18:22:35.516373+0000 mgr.smithi159.jrxkfz (mgr.14586) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 167 op/s 2022-02-02T18:22:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022-02-02T18:22:35.519145+0000 mon.smithi096 (mon.0) 659 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022-02-02T18:22:35.527903+0000 mon.smithi159 (mon.1) 55 : audit [DBG] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cephadm 2022-02 2022-02-02T18:22:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: -02T18:22:35.529913+0000 mgr.smithi159.jrxkfz (mgr.14586) 29 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:22:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cephadm 2022-02-02T18 2022-02-02T18:22:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: :22:35.531944+0000 mgr.smithi159.jrxkfz (mgr.14586) 30 : cephadm 2022-02-02T18:22:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: [INF] Failing over to other MGR 2022-02-02T18:22:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: 2022-02-02T18:22:35.532114+0000 mon.smithi096 (mon 2022-02-02T18:22:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: .0) 660 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: 02-02T18: 2022-02-02T18:22:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: 22:35.532150+0000 mon.smithi159 (mon.1) 56 : 2022-02-02T18:22:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit [INF] from='mgr.14586 172.21.15.159:0/1894995676' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cluster 2022-02-02T18:22:35 2022-02-02T18:22:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: .539534+0000 mon.smithi096 (mon.0) 661 : cluster 2022-02-02T18:22:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: [DBG] osdmap e48: 6 total, 6 up, 6 in 2022-02-02T18:22:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:22:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: -02T18:22:35.668216 2022-02-02T18:22:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 662 : cluster [DBG] 2022-02-02T18:22:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:22:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: -02-02T18:22:36.400861+0000 2022-02-02T18:22:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: mon.smithi096 (mon.0) 663 : audit 2022-02-02T18:22:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:36 smithi096 conmon[32067]: [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' 2022-02-02T18:22:37.684 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: cluster 2022-02-02T18:22:36.512027+0000 mon.smithi096 (mon.0) 664 : cluster [WRN] Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:22:37.684 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22: 2022-02-02T18:22:37.684 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 36.529974+0000 mon.smithi096 (mon.0) 665 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]': finished 2022-02-02T18:22:37.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: cluster 2022-02-02T18:22:36.531441+0000 mon.smithi096 (mon.0) 666 : cluster [DBG] mgrmap e25: smithi096.shfutl(active, starting, since 0.998762s), standbys: smithi159.jrxkfz 2022-02-02T18:22:37.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:36.532933+0000 mon.smithi096 (mon 2022-02-02T18:22:37.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: .0) 667 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:37.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:22:37.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 22:36.533145+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 0) 668 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:37.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:37.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 02-02T18:22:36.533303+0000 2022-02-02T18:22:37.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: mon.smithi096 (mon.0) 669 : audit 2022-02-02T18:22:37.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:37.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02 2022-02-02T18:22:37.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02T18:22:36.533477+0000 mon.smithi096 ( 2022-02-02T18:22:37.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: mon.0) 670 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:22:37.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22:36. 2022-02-02T18:22:37.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 533858+0000 mon.smithi096 (mon.0) 671 : 2022-02-02T18:22:37.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:22:37.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:37.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 02-02T18:22:36.534057 2022-02-02T18:22:37.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 672 : audit 2022-02-02T18:22:37.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:37.689 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:22:37.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 02T18:22:36.536175+0000 2022-02-02T18:22:37.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: mon.smithi096 (mon.0) 673 : audit 2022-02-02T18:22:37.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:37.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22 2022-02-02T18:22:37.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: :36.536432+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 0) 674 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:37.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:37.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 02-02T18:22:36.536689 2022-02-02T18:22:37.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 675 : 2022-02-02T18:22:37.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:22:37.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02 2022-02-02T18:22:37.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: T18:22:36.536992+0000 mon.smithi096 2022-02-02T18:22:37.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: (mon.0) 676 : audit [DBG] 2022-02-02T18:22:37.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:22:37.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.693 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02 2022-02-02T18:22:37.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02T18:22:36. 2022-02-02T18:22:37.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 537270+0000 mon.smithi096 (mon.0) 677 2022-02-02T18:22:37.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:22:37.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36. 2022-02-02T18:22:37.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 537542+0000 mon.smithi096 (mon.0) 678 2022-02-02T18:22:37.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:22:37.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36.537843 2022-02-02T18:22:37.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 679 : 2022-02-02T18:22:37.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:22:37.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18: 2022-02-02T18:22:37.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 22:36.538031+0000 mon.smithi096 ( 2022-02-02T18:22:37.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: mon.0) 680 : audit [DBG] 2022-02-02T18:22:37.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:22:37.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:22:37.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 02-02T18:22:36.538253 2022-02-02T18:22:37.697 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 681 : 2022-02-02T18:22:37.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:22:37.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:37.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 36.538511+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 0) 682 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:22:37.699 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.699 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36 2022-02-02T18:22:37.699 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: .539150+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.699 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 683 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:22:37.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:22:37.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36 2022-02-02T18:22:37.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: .575007+0000 mon.smithi096 (mon.0 2022-02-02T18:22:37.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: ) 684 : cluster [INF] Manager daemon smithi096.shfutl is now available 2022-02-02T18:22:37.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: cephadm 2022 2022-02-02T18:22:37.701 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36. 2022-02-02T18:22:37.701 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 588327+0000 mgr.smithi096.shfutl (mgr.14628) 2022-02-02T18:22:37.701 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 1 : cephadm [INF] inventory: adjusted host smithi159 addr 'smithi159' -> '172.21.15.159' 2022-02-02T18:22:37.701 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.701 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:37.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 36.596092+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 0) 685 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:37.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36 2022-02-02T18:22:37.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: .607835+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 686 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:37.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36. 2022-02-02T18:22:37.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 611447+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.704 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 687 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:37.704 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.704 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36.625182 2022-02-02T18:22:37.704 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 688 2022-02-02T18:22:37.704 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:37.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022 2022-02-02T18:22:37.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: -02-02T18:22:36. 2022-02-02T18:22:37.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 627506+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 689 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:22:37.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:37.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:37.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 36.633169+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:22:37.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 14628) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:22:37.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22:37.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22 2022-02-02T18:22:37.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: :36.644742+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 0) 690 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:37.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18:22:37.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18: 2022-02-02T18:22:37.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 22:36.682764+0000 mon.smithi096 2022-02-02T18:22:37.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: (mon.0) 691 : audit [INF] 2022-02-02T18:22:37.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:37.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: audit 2022-02-02T18:22:37.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: 2022-02-02T18 2022-02-02T18:22:37.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: :22:37.475116+0000 mon.smithi096 2022-02-02T18:22:37.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: (mon.0) 692 : audit 2022-02-02T18:22:37.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:37 smithi159 conmon[35668]: [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:37.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: cluster 2022-02-02T18:22:36.512027+0000 mon.smithi096 (mon.0) 664 : cluster 2022-02-02T18:22:37.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: [WRN] Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:22:37.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.529974+0000 mon.smithi096 (mon.0) 665 : audit [INF] from='mgr.14586 ' entity='mgr.smithi159.jrxkfz' cmd='[{"prefix": "mgr fail", "who": "smithi159.jrxkfz"}]': finished 2022-02-02T18:22:37.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: cluster 2022-02-02T18:22:36.531441 2022-02-02T18:22:37.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 666 : cluster [DBG] mgrmap e25: smithi096.shfutl(active, starting, since 0.998762s), standbys: smithi159.jrxkfz 2022-02-02T18:22:37.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:22:37.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 02T18:22:36.532933+0000 mon.smithi096 (mon.0) 667 : audit [DBG] 2022-02-02T18:22:37.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:22:37.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:37.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 2022-02-02T18:22:36.533145+0000 mon.smithi096 (mon.0) 668 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:22:37.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.533303+0000 mon.smithi096 2022-02-02T18:22:37.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: (mon.0) 669 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:37.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:37.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 2022-02-02T18:22:36.533477+0000 mon.smithi096 2022-02-02T18:22:37.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: (mon.0) 670 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:22:37.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:37.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 18:22:36.533858+0000 mon.smithi096 (mon.0) 671 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:22:37.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.534057+0000 2022-02-02T18:22:37.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: mon.smithi096 (mon.0) 672 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:22:37.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:37.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 2022-02-02T18:22:36.536175+0000 mon.smithi096 (mon.0) 673 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:22:37.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.536432+0000 mon.smithi096 (mon. 2022-02-02T18:22:37.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 0) 674 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:22:37.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:22:37.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: -02T18:22:36.536689+0000 mon.smithi096 (mon.0) 675 : audit [DBG] 2022-02-02T18:22:37.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:22:37.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36 2022-02-02T18:22:37.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: .536992+0000 mon.smithi096 (mon.0) 676 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:22:37.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:22:37.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 02T18:22:36.537270+0000 mon.smithi096 (mon.0) 677 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:22:37.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36 2022-02-02T18:22:37.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: .537542+0000 mon.smithi096 (mon.0) 678 : audit [DBG] 2022-02-02T18:22:37.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:22:37.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22: 2022-02-02T18:22:37.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 36.537843+0000 mon.smithi096 (mon.0) 679 : 2022-02-02T18:22:37.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:22:37.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:37.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 18:22:36.538031+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 680 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:22:37.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.538253+0000 2022-02-02T18:22:37.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: mon.smithi096 (mon.0) 681 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:22:37.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:22:37.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: T18:22:36.538511+0000 mon.smithi096 (mon.0) 682 : audit [DBG] 2022-02-02T18:22:37.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:22:37.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:37.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 02-02T18:22:36.539150+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 683 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:22:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: cluster 2022-02-02T18:22:36. 2022-02-02T18:22:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 575007+0000 mon.smithi096 (mon.0) 684 : cluster [INF] 2022-02-02T18:22:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: Manager daemon smithi096.shfutl is now available 2022-02-02T18:22:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: cephadm 2022-02-02T 2022-02-02T18:22:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 18:22:36.588327+0000 mgr.smithi096.shfutl (mgr.14628) 1 : cephadm [INF] inventory: adjusted host smithi159 addr 'smithi159' -> '172.21.15.159' 2022-02-02T18:22:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36 2022-02-02T18:22:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: .596092+0000 mon.smithi096 (mon.0) 685 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 2022-02-02T18:22:37.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:37.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 2022-02-02T18:22:36.607835+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 686 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:37.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:22:37.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: -02T18:22:36.611447+0000 mon.smithi096 (mon.0) 687 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:37.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.625182+0000 mon.smithi096 2022-02-02T18:22:37.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: (mon.0) 688 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:37.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T 2022-02-02T18:22:37.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 18:22:36.627506+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:37.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: 689 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:22:37.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:36.633169+0000 mgr.smithi096.shfutl ( 2022-02-02T18:22:37.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: mgr.14628) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:22:37.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:36.644742 2022-02-02T18:22:37.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 690 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:22:37.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22 2022-02-02T18:22:37.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: :36.682764+0000 mon.smithi096 (mon.0) 691 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:22:37.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: audit 2022-02-02T18:22:37.475116+0000 2022-02-02T18:22:37.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:37 smithi096 conmon[32067]: mon.smithi096 (mon.0) 692 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:38.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:37.355271+0000 mgr.smithi096.shfutl (mgr.14628) 2022-02-02T18:22:38.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: 3 : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Bus STARTING 2022-02-02T18:22:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:37.469837+0000 mgr.smithi096.shfutl (mgr.14628) 4 : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:22:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:37.470078+0000 mgr.smithi096.shfutl 2022-02-02T18:22:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: (mgr.14628) 5 : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Bus STARTED 2022-02-02T18:22:38.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: cluster 2022-02-02T18:22:38.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: 2022-02-02T18:22: 2022-02-02T18:22:38.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: 37.535240+0000 mon.smithi096 (mon.0) 693 : cluster 2022-02-02T18:22:38.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: [DBG] mgrmap e26: smithi096.shfutl(active, since 2s), standbys: smithi159.jrxkfz 2022-02-02T18:22:38.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: cluster 2022-02-02T18:22:38.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: 2022-02-02T18:22:37 2022-02-02T18:22:38.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: .544124+0000 mgr.smithi096.shfutl (mgr.14628 2022-02-02T18:22:38.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:38 smithi159 conmon[35668]: ) 6 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:38.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:37.355271+0000 mgr.smithi096.shfutl (mgr.14628) 3 2022-02-02T18:22:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Bus STARTING 2022-02-02T18:22:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:37.469837+0000 mgr.smithi096.shfutl (mgr.14628) 4 : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:22:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:37.470078+0000 mgr.smithi096.shfutl (mgr.14628) 5 : cephadm [INF] [02/Feb/2022:18:22:37] ENGINE Bus STARTED 2022-02-02T18:22:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: cluster 2022-02-02T18:22:37.535240+0000 mon.smithi096 (mon.0) 693 : cluster [DBG] mgrmap e26: smithi096.shfutl(active, since 2s), standbys: smithi159.jrxkfz 2022-02-02T18:22:38.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:38 smithi096 conmon[32067]: cluster 2022-02-02T18:22:37.544124+0000 mgr.smithi096.shfutl (mgr.14628) 6 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:39 smithi096 conmon[32067]: cluster 2022-02-02T18:22:38.527728+0000 mon.smithi096 (mon.0) 694 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2022-02-02T18:22:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:39 smithi096 conmon[32067]: cluster 2022-02-02T18:22:38.538239+0000 mgr.smithi096.shfutl (mgr.14628) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:39.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:39 smithi096 conmon[32067]: cluster 2022-02-02T18:22:38.539740+0000 mon.smithi096 (mon.0) 695 : cluster [DBG] mgrmap e27: smithi096.shfutl(active, since 3s), standbys: smithi159.jrxkfz 2022-02-02T18:22:39.925 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:39 smithi159 conmon[35668]: cluster 2022-02-02T18:22:38.527728+0000 mon.smithi096 2022-02-02T18:22:39.925 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:39 smithi159 conmon[35668]: (mon.0) 694 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2022-02-02T18:22:39.925 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:39 smithi159 conmon[35668]: cluster 2022-02-02T18:22:38.538239+0000 mgr.smithi096.shfutl (mgr.14628) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:39.925 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:39 smithi159 conmon[35668]: cluster 2022-02-02T18:22:38.539740+0000 mon.smithi096 (mon.0) 695 : cluster [DBG] mgrmap e27: smithi096.shfutl(active, since 3s), standbys: smithi159.jrxkfz 2022-02-02T18:22:41.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:41 smithi159 conmon[35668]: cluster 2022-02-02T18:22:40.538730+0000 mgr.smithi096.shfutl (mgr.14628) 2022-02-02T18:22:41.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:41 smithi159 conmon[35668]: 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:41 smithi096 conmon[32067]: cluster 2022-02-02T18:22: 2022-02-02T18:22:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:41 smithi096 conmon[32067]: 40.538730+0000 mgr.smithi096.shfutl (mgr.14628) 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2022-02-02T18:22:42.878 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:42 smithi159 conmon[35668]: cluster 2022-02-02T18:22:41.732000+0000 mon.smithi096 (mon.0) 696 : cluster [INF] 2022-02-02T18:22:42.878 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:42 smithi159 conmon[35668]: daemon mds.cephfs.smithi096.pitrsc restarted 2022-02-02T18:22:42.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:42 smithi159 conmon[35668]: cluster 2022-02-02T18:22:41.735942+0000 mon.smithi096 (mon.0) 697 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2022-02-02T18:22:42.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:42 smithi159 conmon[35668]: audit 2022-02-02T18:22:42.394941+0000 mon.smithi096 (mon.0) 698 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: cluster 2022-02-02T18:22:41 2022-02-02T18:22:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: .732000+0000 mon.smithi096 (mon.0) 696 : cluster [INF] daemon mds.cephfs.smithi096.pitrsc restarted 2022-02-02T18:22:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: cluster 2022-02- 2022-02-02T18:22:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: 02T18:22:41.735942+0000 mon.smithi096 (mon.0) 697 : 2022-02-02T18:22:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2022-02-02T18:22:43.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:22:43.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: T18:22:42.394941+0000 mon.smithi096 (mon 2022-02-02T18:22:43.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:42 smithi096 conmon[32067]: .0) 698 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:43.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22:42.539064+0000 mgr.smithi096.shfutl (mgr.14628) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.0 KiB/s rd, 205 B/s wr, 4 op/s 2022-02-02T18:22:43.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 2022-02-02T18:22:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22:42.601370+0000 mon.smithi096 (mon.0) 699 : cluster [DBG] mds.? [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:boot 2022-02-02T18:22:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22:42.601427+0000 mon.smithi096 (mon.0) 700 : cluster [INF] Standby daemon mds.cephfs.smithi159.shbucd assigned to filesystem cephfs as rank 0 2022-02-02T18:22:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22:42.601808+0000 mon.smithi096 (mon.0) 701 : cluster [DBG] fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:22:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T18:22:43.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 2022-02-02T18:22:42.601949+0000 mon.smithi096 (mon.0) 702 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:43.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22 2022-02-02T18:22:43.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: :42.605601+0000 mon.smithi096 (mon.0) 703 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:43.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22: 2022-02-02T18:22:43.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 43.128522+0000 mon.smithi096 (mon.0) 704 : cluster [DBG] Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:22:43.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: cluster 2022-02-02T18:22: 2022-02-02T18:22:43.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 43.128644+0000 mon.smithi096 (mon.0) 705 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:22:43.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T18:22 2022-02-02T18:22:43.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: :43.132141+0000 mon.smithi159 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:22:43.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:22:43.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 18:22:43.132803+0000 mon.smithi159 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:43.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 2022-02-02T18:22:43.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:22:43.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: :22:43.135471+0000 mon.smithi159 (mon.1) 59 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:22:43.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T18:22:43.135861+0000 mon.smithi159 (mon.1) 2022-02-02T18:22:43.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 60 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:43.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: audit 2022-02-02T18:22:43.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: 2022-02-02T18:22:43.276587+0000 mon.smithi096 (mon.0) 706 : audit 2022-02-02T18:22:43.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:43 smithi159 conmon[35668]: [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 -- 172.21.15.96:0/2798382540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f6540 msgr2=0x7f37740f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 --2- 172.21.15.96:0/2798382540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f6540 0x7f37740f6960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f3764004660 tx=0x7f3764009b30).stop 2022-02-02T18:22:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 -- 172.21.15.96:0/2798382540 shutdown_connections 2022-02-02T18:22:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 --2- 172.21.15.96:0/2798382540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f77e0 0x7f37740f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 --2- 172.21.15.96:0/2798382540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f6540 0x7f37740f6960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 -- 172.21.15.96:0/2798382540 >> 172.21.15.96:0/2798382540 conn(0x7f37740f1ca0 msgr2=0x7f37740f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.841+0000 7f3779370700 1 -- 172.21.15.96:0/2798382540 shutdown_connections 2022-02-02T18:22:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 -- 172.21.15.96:0/2798382540 wait complete. 2022-02-02T18:22:43.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 Processor -- start 2022-02-02T18:22:43.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 -- start start 2022-02-02T18:22:43.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 0x7f377406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377406a380 con 0x7f37740f77e0 2022-02-02T18:22:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.842+0000 7f3779370700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377406a4c0 con 0x7f37740f6540 2022-02-02T18:22:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f3772ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 0x7f377406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:43.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52826/0 (socket says 172.21.15.96:52826) 2022-02-02T18:22:43.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 -- 172.21.15.96:0/2589011101 learned_addr learned my addr 172.21.15.96:0/2589011101 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:43.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 -- 172.21.15.96:0/2589011101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 msgr2=0x7f377406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:43.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 0x7f377406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 -- 172.21.15.96:0/2589011101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f37740f77e0 2022-02-02T18:22:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f3772ffd700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 0x7f377406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:22:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f37727fc700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f37680026d0 tx=0x7f3768009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37680079c0 con 0x7f37740f77e0 2022-02-02T18:22:43.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377406a7a0 con 0x7f37740f77e0 2022-02-02T18:22:43.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f376800f040 con 0x7f37740f77e0 2022-02-02T18:22:43.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37680148b0 con 0x7f37740f77e0 2022-02-02T18:22:43.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.843+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410ee10 con 0x7f37740f77e0 2022-02-02T18:22:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.845+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 82746+0+0 (secure 0 0 0) 0x7f3768007b20 con 0x7f37740f77e0 2022-02-02T18:22:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.845+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774045ad0 con 0x7f37740f77e0 2022-02-02T18:22:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.845+0000 7f375b7fe700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 0x7f375c067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.846+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f37680817b0 con 0x7f37740f77e0 2022-02-02T18:22:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.846+0000 7f3772ffd700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 0x7f375c067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.846+0000 7f3772ffd700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 0x7f375c067210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3764013690 tx=0x7f3764009b30).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:43.850+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f376804faf0 con 0x7f37740f77e0 2022-02-02T18:22:43.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02-02T18:22:42.539064+0000 2022-02-02T18:22:43.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14628) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.0 KiB/s rd, 205 B/s wr, 4 op/s 2022-02-02T18:22:43.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02-02T18:22:42.601370+0000 2022-02-02T18:22:43.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.smithi096 (mon.0) 699 : cluster [DBG] mds.? [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:boot 2022-02-02T18:22:43.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02-02T 2022-02-02T18:22:43.861 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 18:22:42.601427+0000 mon.smithi096 (mon. 2022-02-02T18:22:43.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 0) 700 : cluster [INF] Standby daemon mds.cephfs.smithi159.shbucd assigned to filesystem cephfs as rank 0 2022-02-02T18:22:43.862 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:22:43.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: -02T18:22:42.601808+0000 mon.smithi096 2022-02-02T18:22:43.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: (mon.0) 701 : cluster [DBG] fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:22:43.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:43.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 02-02T18:22:42.601949+0000 2022-02-02T18:22:43.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.smithi096 (mon.0) 702 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:22:43.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02-02T18:22:43.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:42.605601+0000 mon.smithi096 ( 2022-02-02T18:22:43.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.0) 703 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:43.865 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022-02- 2022-02-02T18:22:43.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 02T18:22:43.128522+0000 mon.smithi096 ( 2022-02-02T18:22:43.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.0) 704 : cluster [DBG] Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:22:43.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:22:43.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 02-02T18:22:43.128644+0000 2022-02-02T18:22:43.866 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.smithi096 (mon.0) 705 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:22:43.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022-02-02T18:22:43.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.132141+0000 mon.smithi159 2022-02-02T18:22:43.867 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:22:43.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:43.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 02-02T18:22:43.132803+0000 2022-02-02T18:22:43.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.smithi159 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:22:43.868 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:43.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: -02-02T18:22:43.135471+0000 mon.smithi159 (mon 2022-02-02T18:22:43.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: .1) 59 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:22:43.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:22:43.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: -02T18:22:43.135861+0000 2022-02-02T18:22:43.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.smithi159 (mon.1) 60 : audit [DBG] from='mgr.? 172.21.15.159:0/4146705592' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:22:43.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: audit 2022-02-02T18:22:43.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: 2022-02-02T18:22:43.276587+0000 mon.smithi096 ( 2022-02-02T18:22:43.870 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:43 smithi096 conmon[32067]: mon.0) 706 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:44.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.052+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 --> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37740fee10 con 0x7f375c064d50 2022-02-02T18:22:44.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.053+0000 7f375b7fe700 1 -- 172.21.15.96:0/2589011101 <== mgr.14628 v2:172.21.15.96:6800/2712195896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+257 (secure 0 0 0) 0x7f37740fee10 con 0x7f375c064d50 2022-02-02T18:22:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 msgr2=0x7f375c067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 0x7f375c067210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3764013690 tx=0x7f3764009b30).stop 2022-02-02T18:22:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 msgr2=0x7f3774069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f37680026d0 tx=0x7f3768009de0).stop 2022-02-02T18:22:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 shutdown_connections 2022-02-02T18:22:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37740f6540 0x7f377406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f375c064d50 0x7f375c067210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 --2- 172.21.15.96:0/2589011101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37740f77e0 0x7f3774069e20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 >> 172.21.15.96:0/2589011101 conn(0x7f37740f1ca0 msgr2=0x7f37740fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 shutdown_connections 2022-02-02T18:22:44.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.055+0000 7f3779370700 1 -- 172.21.15.96:0/2589011101 wait complete. 2022-02-02T18:22:44.069 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:22:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 -- 172.21.15.96:0/3651233725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 msgr2=0x7f74e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 --2- 172.21.15.96:0/3651233725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e80f6cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f74e4004660 tx=0x7f74e4009b30).stop 2022-02-02T18:22:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 -- 172.21.15.96:0/3651233725 shutdown_connections 2022-02-02T18:22:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 --2- 172.21.15.96:0/3651233725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e80f6cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 --2- 172.21.15.96:0/3651233725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 -- 172.21.15.96:0/3651233725 >> 172.21.15.96:0/3651233725 conn(0x7f74e80f0d40 msgr2=0x7f74e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 -- 172.21.15.96:0/3651233725 shutdown_connections 2022-02-02T18:22:44.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.164+0000 7f74efce3700 1 -- 172.21.15.96:0/3651233725 wait complete. 2022-02-02T18:22:44.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 Processor -- start 2022-02-02T18:22:44.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 -- start start 2022-02-02T18:22:44.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e81090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8109b60 con 0x7f74e80f6860 2022-02-02T18:22:44.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74efce3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8109ca0 con 0x7f74e80f55c0 2022-02-02T18:22:44.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52836/0 (socket says 172.21.15.96:52836) 2022-02-02T18:22:44.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 -- 172.21.15.96:0/355569730 learned_addr learned my addr 172.21.15.96:0/355569730 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74eda7f700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e81090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 -- 172.21.15.96:0/355569730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 msgr2=0x7f74e81090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e81090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74ed27e700 1 -- 172.21.15.96:0/355569730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4005040 con 0x7f74e80f6860 2022-02-02T18:22:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.165+0000 7f74eda7f700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e81090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:22:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74ed27e700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f74e4000c00 tx=0x7f74e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4019070 con 0x7f74e80f6860 2022-02-02T18:22:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e810a5e0 con 0x7f74e80f6860 2022-02-02T18:22:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e810ab40 con 0x7f74e80f6860 2022-02-02T18:22:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f74e4007e70 con 0x7f74e80f6860 2022-02-02T18:22:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.166+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4014ce0 con 0x7f74e80f6860 2022-02-02T18:22:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.167+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d0004fa0 con 0x7f74e80f6860 2022-02-02T18:22:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.167+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 82746+0+0 (secure 0 0 0) 0x7f74e4025070 con 0x7f74e80f6860 2022-02-02T18:22:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.168+0000 7f74de7fc700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 0x7f74d4067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.168+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f74e4082650 con 0x7f74e80f6860 2022-02-02T18:22:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.168+0000 7f74eda7f700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 0x7f74d4067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.168+0000 7f74eda7f700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 0x7f74d4067240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f74e80f66c0 tx=0x7f74d800b040).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.172+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f74e40543c0 con 0x7f74e80f6860 2022-02-02T18:22:44.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.355+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 --> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74d0000bc0 con 0x7f74d4064d80 2022-02-02T18:22:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.364+0000 7f74de7fc700 1 -- 172.21.15.96:0/355569730 <== mgr.14628 v2:172.21.15.96:6800/2712195896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f74d0000bc0 con 0x7f74d4064d80 2022-02-02T18:22:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:22:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 0s ago 7m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:22:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 0s ago 7m 6983k - 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:22:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (6m) 1s ago 6m 7155k - 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:22:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 0s ago 6m 40.0M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:22:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3m) 0s ago 3m 626M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:22:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (7s) 0s ago 3m - - 16.2.4 8d91d370c2b8 c2f4dbaa5b91 2022-02-02T18:22:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3m) 1s ago 3m 4927M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:22:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (25s) 1s ago 3m 13.8M - 16.2.4 8d91d370c2b8 eaf9e1d22a73 2022-02-02T18:22:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (22s) 0s ago 8m 442M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:22:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (47s) 1s ago 6m 65.6M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 8dc57f23335d 2022-02-02T18:22:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 0s ago 8m 101M 2048M 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:22:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (6m) 1s ago 6m 85.2M 2048M 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:22:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (6m) 0s ago 6m 18.2M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:22:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 1s ago 6m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:22:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 0s ago 6m 747M 4096M 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:22:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 0s ago 5m 779M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:22:44.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 0s ago 5m 623M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:22:44.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (5m) 1s ago 5m 857M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:22:44.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4m) 1s ago 4m 670M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:22:44.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4m) 1s ago 4m 760M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:22:44.373 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (5m) 0s ago 6m 43.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:22:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 msgr2=0x7f74d4067240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 0x7f74d4067240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f74e80f66c0 tx=0x7f74d800b040).stop 2022-02-02T18:22:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 msgr2=0x7f74e81095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f74e4000c00 tx=0x7f74e400b040).stop 2022-02-02T18:22:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 shutdown_connections 2022-02-02T18:22:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e80f55c0 0x7f74e81090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f74d4064d80 0x7f74d4067240 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 --2- 172.21.15.96:0/355569730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e80f6860 0x7f74e81095b0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0x7f74e4000c00 tx=0x7f74e400b040).stop 2022-02-02T18:22:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 >> 172.21.15.96:0/355569730 conn(0x7f74e80f0d40 msgr2=0x7f74e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 shutdown_connections 2022-02-02T18:22:44.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.367+0000 7f74efce3700 1 -- 172.21.15.96:0/355569730 wait complete. 2022-02-02T18:22:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 -- 172.21.15.96:0/3512814508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f6860 msgr2=0x7f07800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 --2- 172.21.15.96:0/3512814508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f6860 0x7f07800f6cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f0774004660 tx=0x7f0774009b30).stop 2022-02-02T18:22:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 -- 172.21.15.96:0/3512814508 shutdown_connections 2022-02-02T18:22:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 --2- 172.21.15.96:0/3512814508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f6860 0x7f07800f6cc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 --2- 172.21.15.96:0/3512814508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f55c0 0x7f07800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 -- 172.21.15.96:0/3512814508 >> 172.21.15.96:0/3512814508 conn(0x7f07800f0d40 msgr2=0x7f07800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 -- 172.21.15.96:0/3512814508 shutdown_connections 2022-02-02T18:22:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.468+0000 7f0784df3700 1 -- 172.21.15.96:0/3512814508 wait complete. 2022-02-02T18:22:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 Processor -- start 2022-02-02T18:22:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 -- start start 2022-02-02T18:22:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f6860 0x7f0780109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780109bb0 con 0x7f07800f55c0 2022-02-02T18:22:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f0784df3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780109cf0 con 0x7f07800f6860 2022-02-02T18:22:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f077e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f077e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52844/0 (socket says 172.21.15.96:52844) 2022-02-02T18:22:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f077e59c700 1 -- 172.21.15.96:0/1277957201 learned_addr learned my addr 172.21.15.96:0/1277957201 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.469+0000 7f077dd9b700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f6860 0x7f0780109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f077e59c700 1 -- 172.21.15.96:0/1277957201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f6860 msgr2=0x7f0780109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f077e59c700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f6860 0x7f0780109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f077e59c700 1 -- 172.21.15.96:0/1277957201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774005040 con 0x7f07800f55c0 2022-02-02T18:22:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f077e59c700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f077800d8d0 tx=0x7f0778004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077800b4b0 con 0x7f07800f55c0 2022-02-02T18:22:44.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078010a690 con 0x7f07800f55c0 2022-02-02T18:22:44.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f077800f040 con 0x7f07800f55c0 2022-02-02T18:22:44.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0778013990 con 0x7f07800f55c0 2022-02-02T18:22:44.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.470+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078010ac50 con 0x7f07800f55c0 2022-02-02T18:22:44.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.471+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0764004fa0 con 0x7f07800f55c0 2022-02-02T18:22:44.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.471+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 82746+0+0 (secure 0 0 0) 0x7f077801a030 con 0x7f07800f55c0 2022-02-02T18:22:44.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.472+0000 7f076effd700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 0x7f07680671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.472+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0778081690 con 0x7f07800f55c0 2022-02-02T18:22:44.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.472+0000 7f077dd9b700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 0x7f07680671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:44.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.472+0000 7f077dd9b700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 0x7f07680671c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0774004630 tx=0x7f0774009b30).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.477+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f07780533a0 con 0x7f07800f55c0 2022-02-02T18:22:44.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.694+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 29) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f077807f850 con 0x7f07800f55c0 2022-02-02T18:22:44.842 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:44 smithi159 conmon[35668]: cluster 2022-02-02T18:22:43.612410+0000 mon.smithi096 (mon.0) 707 : cluster [DBG] 2022-02-02T18:22:44.842 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:44 smithi159 conmon[35668]: mgrmap e28: smithi096.shfutl(active, since 8s), standbys: smithi159.jrxkfz 2022-02-02T18:22:44.842 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:44 smithi159 conmon[35668]: audit 2022-02-02T18:22:43.690216+0000 mon.smithi096 (mon.0) 708 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:44.843 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:44 smithi159 conmon[35668]: audit 2022-02-02T18:22:44.517308+0000 mon.smithi096 (mon.0) 709 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:44.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.725+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0764005e80 con 0x7f07800f55c0 2022-02-02T18:22:44.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:44 smithi096 conmon[32067]: cluster 2022-02-02T18:22:43.612410+0000 mon.smithi096 (mon.0) 707 : cluster 2022-02-02T18:22:44.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:44 smithi096 conmon[32067]: [DBG] mgrmap e28: smithi096.shfutl(active, since 8s), standbys: smithi159.jrxkfz 2022-02-02T18:22:44.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:44 smithi096 conmon[32067]: audit 2022-02-02T18:22:43.690216+0000 mon.smithi096 (mon.0) 708 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:44.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:44 smithi096 conmon[32067]: audit 2022-02-02T18:22:44.517308+0000 mon.smithi096 (mon.0) 709 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:44.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.725+0000 7f076effd700 1 -- 172.21.15.96:0/1277957201 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+691 (secure 0 0 0) 0x7f077806e830 con 0x7f07800f55c0 2022-02-02T18:22:44.845 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:22:44.846 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:22:44.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:22:44.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:44.846 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:22:44.847 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:22:44.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:44.847 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:22:44.847 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:22:44.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:44.848 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:22:44.848 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:22:44.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:22:44.848 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:22:44.849 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12, 2022-02-02T18:22:44.849 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:22:44.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:22:44.849 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:22:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.727+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 msgr2=0x7f07680671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.727+0000 7f0784df3700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 0x7f07680671c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0774004630 tx=0x7f0774009b30).stop 2022-02-02T18:22:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.727+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 msgr2=0x7f0780109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.727+0000 7f0784df3700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f077800d8d0 tx=0x7f0778004f00).stop 2022-02-02T18:22:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 shutdown_connections 2022-02-02T18:22:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f0768064d00 0x7f07680671c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07800f55c0 0x7f0780109110 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 --2- 172.21.15.96:0/1277957201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07800f6860 0x7f0780109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 >> 172.21.15.96:0/1277957201 conn(0x7f07800f0d40 msgr2=0x7f078005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 shutdown_connections 2022-02-02T18:22:44.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.728+0000 7f0784df3700 1 -- 172.21.15.96:0/1277957201 wait complete. 2022-02-02T18:22:44.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 -- 172.21.15.96:0/679739314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f5430 msgr2=0x7f8e840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/679739314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f5430 0x7f8e840f5850 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8e74004660 tx=0x7f8e74009b30).stop 2022-02-02T18:22:44.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 -- 172.21.15.96:0/679739314 shutdown_connections 2022-02-02T18:22:44.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/679739314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f66d0 0x7f8e840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/679739314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f5430 0x7f8e840f5850 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.830+0000 7f8e8af1c700 1 -- 172.21.15.96:0/679739314 >> 172.21.15.96:0/679739314 conn(0x7f8e840f0b90 msgr2=0x7f8e840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 -- 172.21.15.96:0/679739314 shutdown_connections 2022-02-02T18:22:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 -- 172.21.15.96:0/679739314 wait complete. 2022-02-02T18:22:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 Processor -- start 2022-02-02T18:22:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 -- start start 2022-02-02T18:22:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f5430 0x7f8e840f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840f7f70 con 0x7f8e840f66d0 2022-02-02T18:22:44.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e8af1c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840f80b0 con 0x7f8e840f5430 2022-02-02T18:22:44.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e89719700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e89719700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52856/0 (socket says 172.21.15.96:52856) 2022-02-02T18:22:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e89719700 1 -- 172.21.15.96:0/1305660476 learned_addr learned my addr 172.21.15.96:0/1305660476 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:22:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.831+0000 7f8e89f1a700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f5430 0x7f8e840f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:22:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e89719700 1 -- 172.21.15.96:0/1305660476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f5430 msgr2=0x7f8e840f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e89719700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f5430 0x7f8e840f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:44.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e89719700 1 -- 172.21.15.96:0/1305660476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74005040 con 0x7f8e840f66d0 2022-02-02T18:22:44.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e89719700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f8e800026d0 tx=0x7f8e80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e800079c0 con 0x7f8e840f66d0 2022-02-02T18:22:44.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e8000f040 con 0x7f8e840f66d0 2022-02-02T18:22:44.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e840f8390 con 0x7f8e840f66d0 2022-02-02T18:22:44.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e800148b0 con 0x7f8e840f66d0 2022-02-02T18:22:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.832+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8410edd0 con 0x7f8e840f66d0 2022-02-02T18:22:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.833+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84045ad0 con 0x7f8e840f66d0 2022-02-02T18:22:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.834+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 29) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f8e80007b20 con 0x7f8e840f66d0 2022-02-02T18:22:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.834+0000 7f8e7a7fc700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 0x7f8e700672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:22:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.834+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f8e80081790 con 0x7f8e840f66d0 2022-02-02T18:22:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.834+0000 7f8e89f1a700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 0x7f8e700672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:22:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.835+0000 7f8e89f1a700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 0x7f8e700672d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e74013690 tx=0x7f8e74009b30).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:22:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:44.838+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f8e8004fb20 con 0x7f8e840f66d0 2022-02-02T18:22:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.069+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e840fdbf0 con 0x7f8e840f66d0 2022-02-02T18:22:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.069+0000 7f8e7a7fc700 1 -- 172.21.15.96:0/1305660476 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1641 (secure 0 0 0) 0x7f8e80053140 con 0x7f8e840f66d0 2022-02-02T18:22:45.074 INFO:teuthology.orchestra.run.smithi096.stdout:e25 2022-02-02T18:22:45.074 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:22:45.074 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:22:45.075 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:22:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:45.075 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:22:45.075 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:22:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 25 2022-02-02T18:22:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:22:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:22:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:22:42.601458+0000 2022-02-02T18:22:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:22:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:22:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:22:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:22:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:22:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:22:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:22:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 49 2022-02-02T18:22:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:22:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:22:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:22:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24423,1=24273} 2022-02-02T18:22:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:22:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:22:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:22:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:22:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:22:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:22:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:22:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:22:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24423} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240]] 2022-02-02T18:22:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:22:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:22:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:45.082 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:22:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:22:45.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:24447} state up:standby seq 2 addr [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779]] 2022-02-02T18:22:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 msgr2=0x7f8e700672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 0x7f8e700672d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e74013690 tx=0x7f8e74009b30).stop 2022-02-02T18:22:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 msgr2=0x7f8e840f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:22:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f8e800026d0 tx=0x7f8e80009de0).stop 2022-02-02T18:22:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 shutdown_connections 2022-02-02T18:22:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e840f5430 0x7f8e840f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8e70064e10 0x7f8e700672d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 --2- 172.21.15.96:0/1305660476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e840f66d0 0x7f8e840f7a10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:22:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 >> 172.21.15.96:0/1305660476 conn(0x7f8e840f0b90 msgr2=0x7f8e8405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:22:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 shutdown_connections 2022-02-02T18:22:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:22:45.071+0000 7f8e8af1c700 1 -- 172.21.15.96:0/1305660476 wait complete. 2022-02-02T18:22:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 25 2022-02-02T18:22:45.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: audit 2022-02-02T18:22:44.054381+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:22:45.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: 14628) 10 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:45.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: audit 2022-02-02T18:22:44.357352+0000 mgr.smithi096.shfutl (mgr.14628) 11 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:45.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: cluster 2022-02-02T18:22:44.539618+0000 mgr.smithi096.shfutl (mgr.14628) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2022-02-02T18:22:45.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: cluster 2022-02-02T18:22:44.696235+0000 mon.smithi096 (mon.0) 710 : cluster [DBG] mgrmap e29: smithi096.shfutl(active, since 9s), standbys: smithi159.jrxkfz 2022-02-02T18:22:45.978 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: audit 2022-02-02T18:22:44.727208+0000 mon.smithi096 (mon.0) 711 : audit [DBG] from='client.? 172.21.15.96:0/1277957201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:22:45.978 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:45 smithi096 conmon[32067]: audit 2022-02-02T18:22:45.071295+0000 mon.smithi096 (mon.0) 712 : audit [DBG] from='client.? 172.21.15.96:0/1305660476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:22:46.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: audit 2022-02-02T18:22:44.054381+0000 mgr.smithi096.shfutl (mgr.14628) 10 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:46.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: audit 2022-02-02T18:22:44.357352+0000 mgr.smithi096.shfutl (mgr.14628) 11 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:22:46.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: cluster 2022-02-02T18:22:44.539618+0000 mgr.smithi096.shfutl (mgr.14628) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2022-02-02T18:22:46.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: cluster 2022-02-02T18:22:44.696235+0000 mon.smithi096 (mon.0) 710 : cluster [DBG] mgrmap e29: smithi096.shfutl(active, since 9s), standbys: smithi159.jrxkfz 2022-02-02T18:22:46.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: audit 2022-02-02T18:22:44.727208+0000 mon.smithi096 (mon.0) 711 : audit [DBG] from='client.? 172.21.15.96:0/1277957201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:22:46.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:45 smithi159 conmon[35668]: audit 2022-02-02T18:22:45.071295+0000 mon.smithi096 (mon.0) 712 : audit [DBG] from='client.? 172.21.15.96:0/1305660476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:22:47.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: audit 2022-02-02T18:22:46.290054+0000 mon.smithi096 (mon.0) 713 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:47.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: audit 2022-02-02T18:22:46.291057+0000 mon.smithi096 (mon.0) 714 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: cluster 2022-02-02T18:22:46.539948+0000 mgr.smithi096.shfutl (mgr.14628) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2022-02-02T18:22:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: cluster 2022-02-02T18:22:46.695275+0000 mon.smithi096 (mon.0) 715 : cluster [DBG] mds.? [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:standby 2022-02-02T18:22:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: cluster 2022-02-02T18:22:46.695314+0000 mon.smithi096 (mon.0) 716 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:resolve 2022-02-02T18:22:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:47 smithi096 conmon[32067]: cluster 2022-02-02T18:22:46.695353+0000 mon.smithi096 (mon.0) 717 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:47.653 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: audit 2022-02-02T18:22:46.290054+0000 mon.smithi096 (mon.0) 713 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:47.653 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: audit 2022-02-02T18:22:46.291057+0000 2022-02-02T18:22:47.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: mon.smithi096 (mon.0) 714 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:47.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: cluster 2022-02-02T18:22:46.539948+0000 mgr.smithi096.shfutl (mgr.14628) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2022-02-02T18:22:47.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: cluster 2022-02-02T18:22:46.695275+0000 mon.smithi096 (mon.0) 715 : cluster [DBG] mds.? [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:standby 2022-02-02T18:22:47.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: cluster 2022-02-02T18:22:46.695314+0000 mon.smithi096 (mon.0) 716 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:resolve 2022-02-02T18:22:47.655 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:47 smithi159 conmon[35668]: cluster 2022-02-02T18:22:46.695353+0000 mon.smithi096 (mon.0) 717 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:48.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: audit 2022-02-02T18:22:47.608974+0000 mon.smithi096 (mon.0) 718 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:48.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: audit 2022-02-02T18:22:47.610036+0000 mon.smithi096 (mon.0) 719 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:48.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: audit 2022-02-02T18:22:47.615603+0000 mon.smithi096 (mon.0) 720 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:48.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: audit 2022-02-02T18:22:47.620539+0000 mon.smithi096 (mon.0) 721 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:48.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: cluster 2022-02-02T18:22:47.696407+0000 mon.smithi096 (mon.0) 722 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:reconnect 2022-02-02T18:22:48.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: cluster 2022-02-02T18:22:47.696464+0000 mon.smithi096 (mon.0) 723 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:48.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: cluster 2022-02-02T18 2022-02-02T18:22:48.965 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: :22:47.717178+0000 mds.cephfs.smithi159.shbucd (mds.0) 1 : cluster [DBG] reconnect by client.24303 v1:172.21.15.96:0/1417773195 after 0.0219999 2022-02-02T18:22:48.965 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:48 smithi159 conmon[35668]: cluster 2022-02-02T18:22:47.717647+0000 mds.cephfs.smithi159.shbucd (mds.0) 2 : cluster [DBG] reconnect by client.24307 v1:192.168.0.1:0/2904487504 after 0.0219999 2022-02-02T18:22:49.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: audit 2022-02-02T18:22:47.608974+0000 mon.smithi096 (mon. 2022-02-02T18:22:49.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: 0) 718 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:49.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: audit 2022-02-02T18:22:47.610036+0000 mon.smithi096 (mon.0) 719 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:22:49.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: audit 2022-02-02T18:22:47.615603+0000 mon.smithi096 (mon.0) 720 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:49.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: audit 2022-02-02T18:22:47.620539+0000 mon.smithi096 (mon.0) 721 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:22:49.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: cluster 2022-02-02T18:22:47.696407+0000 mon.smithi096 (mon.0) 722 : cluster [DBG] 2022-02-02T18:22:49.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:reconnect 2022-02-02T18:22:49.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: cluster 2022-02-02T18:22:47.696464+0000 mon.smithi096 (mon.0) 723 : cluster [DBG] 2022-02-02T18:22:49.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:49.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: cluster 2022-02-02T18:22:49.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: 2022-02-02T18:22:47.717178+0000 2022-02-02T18:22:49.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: mds.cephfs.smithi159.shbucd (mds.0) 1 : cluster [DBG] reconnect by client.24303 v1:172.21.15.96:0/1417773195 after 0.0219999 2022-02-02T18:22:49.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:22:49.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: -02T18:22:47.717647+0000 mds.cephfs.smithi159.shbucd (mds.0) 2022-02-02T18:22:49.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:48 smithi096 conmon[32067]: 2 : cluster [DBG] reconnect by client.24307 v1:192.168.0.1:0/2904487504 after 0.0219999 2022-02-02T18:22:50.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: cluster 2022-02-02T18:22:48.540500+0000 mgr.smithi096.shfutl (mgr.14628) 14 : cluster [DBG] 2022-02-02T18:22:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:22:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: cluster 2022-02-02T18:22:48.700506+0000 mon.smithi096 (mon.0) 724 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:rejoin 2022-02-02T18:22:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: cluster 2022-02-02T18:22:48.700564+0000 mon.smithi096 (mon.0) 725 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: audit 2022-02-02T18:22:48.964681+0000 mon.smithi096 (mon.0) 726 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:50.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: audit 2022-02-02T18:22:48.965422+0000 mon.smithi096 (mon.0) 727 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:22:50.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:49 smithi159 conmon[35668]: audit 2022-02-02T18:22:48.966110+0000 mon.smithi096 (mon.0) 728 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:50.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: cluster 2022-02-02T18:22:48.540500+0000 mgr.smithi096.shfutl (mgr.14628) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:22:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: cluster 2022-02-02T18:22:48.700506+0000 mon.smithi096 (mon.0) 724 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:rejoin 2022-02-02T18:22:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: cluster 2022-02-02T18:22:48.700564+0000 mon.smithi096 (mon.0) 725 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:22:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: T18:22:48.964681+0000 mon.smithi096 (mon.0) 726 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:22:50.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: audit 2022-02-02T18: 2022-02-02T18:22:50.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: 22:48.965422+0000 mon.smithi096 (mon.0) 727 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:22:50.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:22:50.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: 02-02T18:22:48.966110+0000 mon.smithi096 ( 2022-02-02T18:22:50.063 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:49 smithi096 conmon[32067]: mon.0) 728 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:22:50.727 INFO:tasks.workunit.client.1.smithi159.stdout:1/343: symlink df/d14/d16/d35/l83 0 2022-02-02T18:22:50.727 INFO:tasks.workunit.client.1.smithi159.stdout:0/322: truncate d1/dd/f6d 1144050 0 2022-02-02T18:22:50.731 INFO:tasks.workunit.client.1.smithi159.stdout:4/389: getdents d0 0 2022-02-02T18:22:50.750 INFO:tasks.workunit.client.1.smithi159.stdout:0/323: chown d1/d11/d38/d42/d47 1 1 2022-02-02T18:22:50.752 INFO:tasks.workunit.client.1.smithi159.stdout:0/324: fdatasync d1/f2c 0 2022-02-02T18:22:50.757 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2022-02-02T18:22:50.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-02-02T18:22:50.759 INFO:tasks.workunit.client.1.smithi159.stdout:0/325: truncate d1/d19/d3d/f41 1595817 0 2022-02-02T18:22:50.760 INFO:tasks.workunit.client.1.smithi159.stdout:1/344: write fe [3098950,48406] 0 2022-02-02T18:22:50.763 INFO:tasks.workunit.client.1.smithi159.stdout:6/382: sync 2022-02-02T18:22:50.764 INFO:tasks.workunit.client.1.smithi159.stdout:8/270: sync 2022-02-02T18:22:50.764 INFO:tasks.workunit.client.1.smithi159.stdout:7/389: sync 2022-02-02T18:22:50.765 INFO:tasks.workunit.client.1.smithi159.stdout:3/340: sync 2022-02-02T18:22:50.765 INFO:tasks.workunit.client.1.smithi159.stdout:9/385: sync 2022-02-02T18:22:50.766 INFO:tasks.workunit.client.1.smithi159.stdout:5/447: sync 2022-02-02T18:22:50.766 INFO:tasks.workunit.client.1.smithi159.stdout:2/481: sync 2022-02-02T18:22:50.768 INFO:tasks.workunit.client.1.smithi159.stdout:4/390: creat d0/d8/d14/d33/d47/d56/f8a x:0 0 0 2022-02-02T18:22:50.771 INFO:tasks.workunit.client.1.smithi159.stdout:0/326: mkdir d1/d19/d3d/d74 0 2022-02-02T18:22:50.772 INFO:tasks.workunit.client.1.smithi159.stdout:5/448: read d9/f77 [36375,80029] 0 2022-02-02T18:22:50.775 INFO:tasks.workunit.client.1.smithi159.stdout:5/449: rmdir d9/d24/d38 39 2022-02-02T18:22:50.779 INFO:tasks.workunit.client.1.smithi159.stdout:5/450: read d9/d24/d37/d23/f4d [155988,61093] 0 2022-02-02T18:22:50.779 INFO:tasks.workunit.client.1.smithi159.stdout:5/451: chown d9/d24/d37/d23/c5f 69 1 2022-02-02T18:22:50.787 INFO:tasks.workunit.client.1.smithi159.stdout:5/452: dread d9/d24/f22 [4194304,4194304] 0 2022-02-02T18:22:50.790 INFO:tasks.workunit.client.1.smithi159.stdout:5/453: mknod d9/d24/d38/c84 0 2022-02-02T18:22:50.791 INFO:tasks.workunit.client.1.smithi159.stdout:3/341: symlink dd/d66/d69/l6e 0 2022-02-02T18:22:50.792 INFO:tasks.workunit.client.1.smithi159.stdout:0/327: truncate d1/d11/d1d/f52 1439216 0 2022-02-02T18:22:50.794 INFO:tasks.workunit.client.1.smithi159.stdout:5/454: mkdir d9/d24/d4a/d52/d85 0 2022-02-02T18:22:50.797 INFO:tasks.workunit.client.1.smithi159.stdout:5/455: fdatasync d9/d24/d21/f81 0 2022-02-02T18:22:50.798 INFO:tasks.workunit.client.1.smithi159.stdout:7/390: creat d3/d5/d56/d2f/f86 x:0 0 0 2022-02-02T18:22:50.801 INFO:tasks.workunit.client.1.smithi159.stdout:2/482: creat da/d1c/d47/d6b/fa9 x:0 0 0 2022-02-02T18:22:50.802 INFO:tasks.workunit.client.1.smithi159.stdout:6/383: mknod df/d35/d2a/d3f/c7f 0 2022-02-02T18:22:50.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/271: link d1/dd/c40 d1/dc/c65 0 2022-02-02T18:22:50.804 INFO:tasks.workunit.client.1.smithi159.stdout:9/386: chown d4/d19/d1c/d1f/d4c/c5c 7579474 1 2022-02-02T18:22:50.809 INFO:tasks.workunit.client.1.smithi159.stdout:1/345: dwrite df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:22:50.815 INFO:tasks.workunit.client.1.smithi159.stdout:6/384: chown df/d35/d2a/d3f/d65/f6c 448314 1 2022-02-02T18:22:50.815 INFO:tasks.workunit.client.1.smithi159.stdout:8/272: stat d1/d26/c38 0 2022-02-02T18:22:50.818 INFO:tasks.workunit.client.1.smithi159.stdout:3/342: stat dd/d20/d2a/d3a/c43 0 2022-02-02T18:22:50.820 INFO:tasks.workunit.client.1.smithi159.stdout:2/483: symlink da/d1c/d25/laa 0 2022-02-02T18:22:50.821 INFO:tasks.workunit.client.1.smithi159.stdout:1/346: chown df/d14/d68/c7a 64 1 2022-02-02T18:22:50.825 INFO:tasks.workunit.client.1.smithi159.stdout:4/391: rename d0/d8/c38 to d0/d8/d30/d5d/c8b 0 2022-02-02T18:22:50.826 INFO:tasks.workunit.client.1.smithi159.stdout:7/391: write d3/d6/f4d [4739731,25258] 0 2022-02-02T18:22:50.831 INFO:tasks.workunit.client.1.smithi159.stdout:1/347: symlink df/d21/d23/d49/d82/l84 0 2022-02-02T18:22:50.834 INFO:tasks.workunit.client.1.smithi159.stdout:3/343: dread dd/f1c [0,4194304] 0 2022-02-02T18:22:50.835 INFO:tasks.workunit.client.1.smithi159.stdout:9/387: fdatasync d4/d19/d1c/d21/d56/d5b/f6d 0 2022-02-02T18:22:50.836 INFO:tasks.workunit.client.1.smithi159.stdout:7/392: chown d3/d27 1963 1 2022-02-02T18:22:50.840 INFO:tasks.workunit.client.1.smithi159.stdout:5/456: dwrite d9/d24/f6d [0,4194304] 0 2022-02-02T18:22:50.846 INFO:tasks.workunit.client.1.smithi159.stdout:2/484: chown da/d40/d61/l9d 2 1 2022-02-02T18:22:50.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/348: mkdir df/d14/d85 0 2022-02-02T18:22:50.847 INFO:tasks.workunit.client.1.smithi159.stdout:3/344: write f9 [1983074,35221] 0 2022-02-02T18:22:50.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/328: dwrite d1/d11/d1d/d34/f57 [0,4194304] 0 2022-02-02T18:22:50.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/329: chown d1/d19/d3d 222179034 1 2022-02-02T18:22:50.850 INFO:tasks.workunit.client.1.smithi159.stdout:8/273: link d1/l22 d1/dc/d35/d5d/l66 0 2022-02-02T18:22:50.851 INFO:tasks.workunit.client.1.smithi159.stdout:5/457: write d9/d24/d21/d44/f65 [989058,29045] 0 2022-02-02T18:22:50.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/458: creat d9/d24/d37/d23/f86 x:0 0 0 2022-02-02T18:22:50.853 INFO:tasks.workunit.client.1.smithi159.stdout:1/349: chown df/d21/d23/f7c 0 1 2022-02-02T18:22:50.854 INFO:tasks.workunit.client.1.smithi159.stdout:5/459: chown d9/d24/d38/l57 403 1 2022-02-02T18:22:50.857 INFO:tasks.workunit.client.1.smithi159.stdout:5/460: link d9/d24/f6d d9/d24/d21/d44/f87 0 2022-02-02T18:22:50.857 INFO:tasks.workunit.client.1.smithi159.stdout:5/461: chown d9/d24/d21/d44/f87 1344 1 2022-02-02T18:22:50.859 INFO:tasks.workunit.client.1.smithi159.stdout:5/462: mkdir d9/d24/d38/d88 0 2022-02-02T18:22:50.863 INFO:tasks.workunit.client.1.smithi159.stdout:7/393: mkdir d3/d27/d29/d82/d87 0 2022-02-02T18:22:50.864 INFO:tasks.workunit.client.1.smithi159.stdout:5/463: mknod d9/d24/d38/c89 0 2022-02-02T18:22:50.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/464: chown d9/d24/d38/l57 4770741 1 2022-02-02T18:22:50.866 INFO:tasks.workunit.client.1.smithi159.stdout:5/465: creat d9/d24/f8a x:0 0 0 2022-02-02T18:22:50.867 INFO:tasks.workunit.client.1.smithi159.stdout:7/394: chown d3/d27/d29/f61 244755 1 2022-02-02T18:22:50.867 INFO:tasks.workunit.client.1.smithi159.stdout:1/350: chown df/d14/d16/d6d/c76 94 1 2022-02-02T18:22:50.869 INFO:tasks.workunit.client.1.smithi159.stdout:7/395: stat d3/d6/l84 0 2022-02-02T18:22:50.870 INFO:tasks.workunit.client.1.smithi159.stdout:0/330: dread d1/fb [0,4194304] 0 2022-02-02T18:22:50.870 INFO:tasks.workunit.client.1.smithi159.stdout:7/396: getdents d3/d5/d56 0 2022-02-02T18:22:50.873 INFO:tasks.workunit.client.1.smithi159.stdout:7/397: fdatasync d3/d6/f54 0 2022-02-02T18:22:50.874 INFO:tasks.workunit.client.1.smithi159.stdout:8/274: dread d1/d26/d48/f57 [0,4194304] 0 2022-02-02T18:22:50.879 INFO:tasks.workunit.client.1.smithi159.stdout:7/398: unlink d3/d5/d56/d2f/f50 0 2022-02-02T18:22:50.881 INFO:tasks.workunit.client.1.smithi159.stdout:7/399: symlink d3/d5/d56/l88 0 2022-02-02T18:22:50.888 INFO:tasks.workunit.client.1.smithi159.stdout:4/392: dwrite d0/d8/f20 [0,4194304] 0 2022-02-02T18:22:50.897 INFO:tasks.workunit.client.1.smithi159.stdout:9/388: dwrite d4/d19/d1c/d21/d41/f7c [0,4194304] 0 2022-02-02T18:22:50.990 INFO:tasks.workunit.client.1.smithi159.stdout:8/275: dread d1/dc/f41 [0,4194304] 0 2022-02-02T18:22:50.991 INFO:tasks.workunit.client.1.smithi159.stdout:6/385: rename df/d35/d2a/d3f/d42/d47/d60 to df/d35/d2a/d2f/d80 0 2022-02-02T18:22:50.992 INFO:tasks.workunit.client.1.smithi159.stdout:3/345: dwrite dd/d19/f24 [0,4194304] 0 2022-02-02T18:22:50.998 INFO:tasks.workunit.client.1.smithi159.stdout:7/400: write d3/d27/d29/f71 [4462904,103782] 0 2022-02-02T18:22:50.999 INFO:tasks.workunit.client.1.smithi159.stdout:6/386: read df/d35/d2a/d3f/f44 [1656744,51303] 0 2022-02-02T18:22:51.001 INFO:tasks.workunit.client.1.smithi159.stdout:2/485: rename da/d1c/d29 to da/d1c/d25/d73/dab 0 2022-02-02T18:22:51.004 INFO:tasks.workunit.client.1.smithi159.stdout:6/387: creat df/d35/d2a/d3f/d42/f81 x:0 0 0 2022-02-02T18:22:51.005 INFO:tasks.workunit.client.1.smithi159.stdout:5/466: rename d9/d24/d37/f7d to d9/d24/d4a/f8b 0 2022-02-02T18:22:51.009 INFO:tasks.workunit.client.1.smithi159.stdout:6/388: dread df/d35/f36 [0,4194304] 0 2022-02-02T18:22:51.011 INFO:tasks.workunit.client.1.smithi159.stdout:6/389: creat df/d35/d2a/d3f/d42/f82 x:0 0 0 2022-02-02T18:22:51.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/331: rename d1/d11/d38/c5c to d1/d19/d3d/d74/c75 0 2022-02-02T18:22:51.015 INFO:tasks.workunit.client.1.smithi159.stdout:7/401: write d3/d5/d56/d2f/f38 [1611491,112369] 0 2022-02-02T18:22:51.016 INFO:tasks.workunit.client.1.smithi159.stdout:9/389: dwrite d4/d2a/f34 [4194304,4194304] 0 2022-02-02T18:22:51.018 INFO:tasks.workunit.client.1.smithi159.stdout:8/276: rename d1/dc/d35 to d1/dd/d2c/d67 0 2022-02-02T18:22:51.025 INFO:tasks.workunit.client.1.smithi159.stdout:9/390: creat d4/d19/d42/f85 x:0 0 0 2022-02-02T18:22:51.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:48 2022-02-02T18:22:51.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: .963334+0000 mgr.smithi096.shfutl (mgr.14628) 15 : cephadm [INF] Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:22:51.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: cephadm 2022-02-02T18:22:48.966768+0000 mgr.smithi096.shfutl (mgr.14628) 16 : cephadm [INF] Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:22:51.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: cluster 2022-02-02T18:22:49.702571+0000 mon.smithi096 (mon.0) 729 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:clientreplay 2022-02-02T18:22:51.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: cluster 2022-02-02T18:22:49.702651+0000 mon.smithi096 (mon.0) 730 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:clientreplay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:51.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:50 smithi159 conmon[35668]: cluster 2022-02-02T18:22:49.784966+0000 mon.smithi096 (mon.0) 731 : cluster [INF] daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:22:51.028 INFO:tasks.workunit.client.1.smithi159.stdout:0/332: rmdir d1/dd/d4b 39 2022-02-02T18:22:51.030 INFO:tasks.workunit.client.1.smithi159.stdout:6/390: symlink df/d35/d2a/d2f/d80/d62/l83 0 2022-02-02T18:22:51.035 INFO:tasks.workunit.client.1.smithi159.stdout:0/333: chown d1/d19/d3d/f40 14901 1 2022-02-02T18:22:51.036 INFO:tasks.workunit.client.1.smithi159.stdout:7/402: truncate d3/d2a/d2c/d7a/f85 647110 0 2022-02-02T18:22:51.037 INFO:tasks.workunit.client.1.smithi159.stdout:0/334: fdatasync d1/d11/f35 0 2022-02-02T18:22:51.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/335: fsync d1/d19/d3d/f45 0 2022-02-02T18:22:51.043 INFO:tasks.workunit.client.1.smithi159.stdout:5/467: dwrite d9/d2e/f70 [0,4194304] 0 2022-02-02T18:22:51.045 INFO:tasks.workunit.client.1.smithi159.stdout:9/391: creat d4/d19/d1c/d1f/d4c/f86 x:0 0 0 2022-02-02T18:22:51.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/468: mkdir d9/d24/d38/d3c/d8c 0 2022-02-02T18:22:51.046 INFO:tasks.workunit.client.1.smithi159.stdout:0/336: creat d1/d19/d3d/f76 x:0 0 0 2022-02-02T18:22:51.047 INFO:tasks.workunit.client.1.smithi159.stdout:5/469: rmdir d9/d24/d72 0 2022-02-02T18:22:51.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/346: rename dd/d20/f3c to dd/d20/d2a/d3a/f6f 0 2022-02-02T18:22:51.048 INFO:tasks.workunit.client.1.smithi159.stdout:8/277: mknod d1/dd/d2c/d67/d5f/c68 0 2022-02-02T18:22:51.049 INFO:tasks.workunit.client.1.smithi159.stdout:5/470: fsync d9/d2e/d63/f6b 0 2022-02-02T18:22:51.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/471: fdatasync d9/d2e/f2a 0 2022-02-02T18:22:51.051 INFO:tasks.workunit.client.1.smithi159.stdout:7/403: symlink d3/d27/d29/d5e/d80/l89 0 2022-02-02T18:22:51.052 INFO:tasks.workunit.client.1.smithi159.stdout:5/472: mkdir d9/d24/d4a/d8d 0 2022-02-02T18:22:51.053 INFO:tasks.workunit.client.1.smithi159.stdout:0/337: creat d1/d19/d3d/d74/f77 x:0 0 0 2022-02-02T18:22:51.056 INFO:tasks.workunit.client.1.smithi159.stdout:5/473: mkdir d9/d24/d38/d3c/d8e 0 2022-02-02T18:22:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:48.963334+0000 mgr.smithi096.shfutl (mgr.14628) 15 : cephadm [INF] Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:22:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: cephadm 2022-02-02T18:22:48.966768+0000 mgr.smithi096.shfutl (mgr.14628) 16 : cephadm [INF] Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:22:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: cluster 2022-02-02T18:22:49.702571+0000 2022-02-02T18:22:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: mon.smithi096 (mon.0) 729 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:clientreplay 2022-02-02T18:22:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: cluster 2022-02-02T18: 2022-02-02T18:22:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: 22:49.702651+0000 mon.smithi096 (mon.0) 730 : cluster [DBG] fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:clientreplay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: cluster 2022-02-02T18:22:49.784966+0000 2022-02-02T18:22:51.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:50 smithi096 conmon[32067]: mon.smithi096 (mon.0) 731 : cluster [INF] daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:22:51.059 INFO:tasks.workunit.client.1.smithi159.stdout:5/474: link d9/d2e/f70 d9/f8f 0 2022-02-02T18:22:51.062 INFO:tasks.workunit.client.1.smithi159.stdout:5/475: symlink d9/d24/d38/d3c/d8c/l90 0 2022-02-02T18:22:51.064 INFO:tasks.workunit.client.1.smithi159.stdout:5/476: mkdir d9/d24/d4a/d91 0 2022-02-02T18:22:51.068 DEBUG:teuthology.parallel:result is None 2022-02-02T18:22:51.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/338: dread d1/f1c [0,4194304] 0 2022-02-02T18:22:51.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/404: creat d3/d2a/d4a/d79/f8a x:0 0 0 2022-02-02T18:22:51.070 INFO:tasks.workunit.client.1.smithi159.stdout:9/392: mkdir d4/d2a/d87 0 2022-02-02T18:22:51.071 INFO:tasks.workunit.client.1.smithi159.stdout:6/391: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d6b/d84 0 2022-02-02T18:22:51.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/486: rename da/d1c/d25/d73/la7 to da/d1c/d42/d45/lac 0 2022-02-02T18:22:51.076 INFO:tasks.workunit.client.1.smithi159.stdout:0/339: creat d1/d19/f78 x:0 0 0 2022-02-02T18:22:51.077 INFO:tasks.workunit.client.1.smithi159.stdout:9/393: stat d4/d19/c3d 0 2022-02-02T18:22:51.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/477: write d9/d24/d37/f1e [4006809,48567] 0 2022-02-02T18:22:51.082 INFO:tasks.workunit.client.1.smithi159.stdout:9/394: dread - d4/d19/d1c/d21/f45 zero size 2022-02-02T18:22:51.083 INFO:tasks.workunit.client.1.smithi159.stdout:5/478: fdatasync d9/f7a 0 2022-02-02T18:22:51.085 INFO:tasks.workunit.client.1.smithi159.stdout:6/392: truncate df/d35/f74 104506 0 2022-02-02T18:22:51.087 INFO:tasks.workunit.client.1.smithi159.stdout:5/479: link d9/d24/d37/d23/d68/l7c d9/d24/d4a/d8d/l92 0 2022-02-02T18:22:51.088 INFO:tasks.workunit.client.1.smithi159.stdout:5/480: creat d9/d24/f93 x:0 0 0 2022-02-02T18:22:51.088 INFO:tasks.workunit.client.1.smithi159.stdout:5/481: getdents d9/d24/d4a/d52/d85 0 2022-02-02T18:22:51.089 INFO:tasks.workunit.client.1.smithi159.stdout:6/393: dread - df/d35/d2a/d2f/d80/d62/f5b zero size 2022-02-02T18:22:51.091 INFO:tasks.workunit.client.1.smithi159.stdout:2/487: creat da/d48/d6d/d3e/fad x:0 0 0 2022-02-02T18:22:51.091 INFO:tasks.workunit.client.1.smithi159.stdout:8/278: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:22:51.092 INFO:tasks.workunit.client.1.smithi159.stdout:6/394: creat df/d35/d2a/d2f/f85 x:0 0 0 2022-02-02T18:22:51.097 INFO:tasks.workunit.client.1.smithi159.stdout:6/395: chown df/d35/d2a/f3b 24509 1 2022-02-02T18:22:51.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/405: dwrite d3/d5/d56/d2f/f86 [0,4194304] 0 2022-02-02T18:22:51.099 INFO:tasks.workunit.client.1.smithi159.stdout:5/482: write d9/d24/d37/d23/d68/f69 [947250,37957] 0 2022-02-02T18:22:51.099 INFO:tasks.workunit.client.1.smithi159.stdout:0/340: write d1/d19/f69 [240074,103479] 0 2022-02-02T18:22:51.100 INFO:tasks.workunit.client.1.smithi159.stdout:3/347: rename dd/ce to dd/d19/d38/d3f/d52/c70 0 2022-02-02T18:22:51.100 INFO:tasks.workunit.client.1.smithi159.stdout:8/279: symlink d1/dd/d2c/d67/l69 0 2022-02-02T18:22:51.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/488: write da/d48/d6d/f92 [715597,21780] 0 2022-02-02T18:22:51.102 INFO:tasks.workunit.client.1.smithi159.stdout:5/483: rename d9/d24/d21/f3d to d9/d24/d38/d88/f94 0 2022-02-02T18:22:51.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/406: readlink d3/d5/l78 0 2022-02-02T18:22:51.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/341: dread d1/d19/d3d/f45 [0,4194304] 0 2022-02-02T18:22:51.116 INFO:tasks.workunit.client.1.smithi159.stdout:7/407: truncate d3/f2d 691808 0 2022-02-02T18:22:51.116 INFO:tasks.workunit.client.1.smithi159.stdout:0/342: dread - d1/dd/f4f zero size 2022-02-02T18:22:51.117 INFO:tasks.workunit.client.1.smithi159.stdout:5/484: write d9/d24/f2d [1890340,76746] 0 2022-02-02T18:22:51.118 INFO:tasks.workunit.client.1.smithi159.stdout:0/343: read d1/f2c [1993024,110070] 0 2022-02-02T18:22:51.119 INFO:tasks.workunit.client.1.smithi159.stdout:5/485: truncate d9/d24/f22 8486555 0 2022-02-02T18:22:51.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/348: unlink dd/d19/d38/d3f/d52/c67 0 2022-02-02T18:22:51.124 INFO:tasks.workunit.client.1.smithi159.stdout:9/395: dwrite d4/d19/d1c/f54 [0,4194304] 0 2022-02-02T18:22:51.130 INFO:tasks.workunit.client.1.smithi159.stdout:3/349: symlink dd/d20/d2a/d3a/l71 0 2022-02-02T18:22:51.130 INFO:tasks.workunit.client.1.smithi159.stdout:8/280: write d1/dd/d1a/f32 [158525,63974] 0 2022-02-02T18:22:51.134 INFO:tasks.workunit.client.1.smithi159.stdout:8/281: mknod d1/dd/c6a 0 2022-02-02T18:22:51.136 INFO:tasks.workunit.client.1.smithi159.stdout:7/408: write d3/f60 [210564,32185] 0 2022-02-02T18:22:51.138 INFO:tasks.workunit.client.1.smithi159.stdout:3/350: dread - dd/d19/d35/d53/f5a zero size 2022-02-02T18:22:51.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/409: mkdir d3/d2a/d4a/d79/d8b 0 2022-02-02T18:22:51.147 INFO:tasks.workunit.client.1.smithi159.stdout:7/410: readlink d3/d27/l70 0 2022-02-02T18:22:51.155 INFO:tasks.workunit.client.1.smithi159.stdout:7/411: dread d3/d5/d56/d57/f24 [0,4194304] 0 2022-02-02T18:22:51.155 INFO:tasks.workunit.client.1.smithi159.stdout:6/396: dwrite df/d35/d2a/d2f/f64 [0,4194304] 0 2022-02-02T18:22:51.157 INFO:tasks.workunit.client.1.smithi159.stdout:7/412: mkdir d3/d2a/d4a/d79/d8b/d8c 0 2022-02-02T18:22:51.157 INFO:tasks.workunit.client.1.smithi159.stdout:5/486: dwrite d9/d24/d4a/f48 [0,4194304] 0 2022-02-02T18:22:51.158 INFO:tasks.workunit.client.1.smithi159.stdout:8/282: dread d1/dd/d1a/f39 [0,4194304] 0 2022-02-02T18:22:51.160 INFO:tasks.workunit.client.1.smithi159.stdout:5/487: creat d9/d24/d37/d23/d68/f95 x:0 0 0 2022-02-02T18:22:51.160 INFO:tasks.workunit.client.1.smithi159.stdout:5/488: dread - d9/d24/d37/d23/f86 zero size 2022-02-02T18:22:51.161 INFO:tasks.workunit.client.1.smithi159.stdout:7/413: dread - d3/d2a/f55 zero size 2022-02-02T18:22:51.161 INFO:tasks.workunit.client.1.smithi159.stdout:6/397: dread df/d35/f74 [0,4194304] 0 2022-02-02T18:22:51.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/414: creat d3/d27/d29/d82/f8d x:0 0 0 2022-02-02T18:22:51.165 INFO:tasks.workunit.client.1.smithi159.stdout:7/415: dread d3/d5/d56/d57/f11 [0,4194304] 0 2022-02-02T18:22:51.166 INFO:tasks.workunit.client.1.smithi159.stdout:7/416: readlink d3/d27/d29/l53 0 2022-02-02T18:22:51.179 INFO:tasks.workunit.client.1.smithi159.stdout:7/417: dread d3/d2a/f47 [0,4194304] 0 2022-02-02T18:22:51.180 INFO:tasks.workunit.client.1.smithi159.stdout:7/418: mknod d3/d27/c8e 0 2022-02-02T18:22:51.181 INFO:tasks.workunit.client.1.smithi159.stdout:7/419: unlink d3/d5/d56/c72 0 2022-02-02T18:22:51.182 INFO:tasks.workunit.client.1.smithi159.stdout:7/420: readlink d3/l41 0 2022-02-02T18:22:51.182 INFO:tasks.workunit.client.1.smithi159.stdout:7/421: chown d3/d5/d56 17050 1 2022-02-02T18:22:51.183 INFO:tasks.workunit.client.1.smithi159.stdout:7/422: truncate d3/f14 5775088 0 2022-02-02T18:22:51.185 INFO:tasks.workunit.client.1.smithi159.stdout:2/489: dwrite da/d1c/d47/d6b/d5a/d7e/f82 [0,4194304] 0 2022-02-02T18:22:51.186 INFO:tasks.workunit.client.1.smithi159.stdout:9/396: dwrite d4/d19/d1c/d21/f27 [0,4194304] 0 2022-02-02T18:22:51.186 INFO:tasks.workunit.client.1.smithi159.stdout:9/397: chown d4/d2a/d87 75742 1 2022-02-02T18:22:51.187 INFO:tasks.workunit.client.1.smithi159.stdout:3/351: dwrite dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:22:51.187 INFO:tasks.workunit.client.1.smithi159.stdout:9/398: readlink d4/d2a/l5d 0 2022-02-02T18:22:51.188 INFO:tasks.workunit.client.1.smithi159.stdout:0/344: dwrite d1/dd/f60 [0,4194304] 0 2022-02-02T18:22:51.189 INFO:tasks.workunit.client.1.smithi159.stdout:2/490: dread da/d40/f37 [0,4194304] 0 2022-02-02T18:22:51.192 INFO:tasks.workunit.client.1.smithi159.stdout:6/398: write df/d35/d2a/d2f/d80/d62/f5b [191619,125673] 0 2022-02-02T18:22:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:3/352: fsync dd/d19/f46 0 2022-02-02T18:22:51.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/399: dread - d4/d19/d1c/d1f/f4d zero size 2022-02-02T18:22:51.209 INFO:tasks.workunit.client.1.smithi159.stdout:9/400: dread d4/d19/d1c/d1f/f24 [0,4194304] 0 2022-02-02T18:22:51.213 INFO:tasks.workunit.client.1.smithi159.stdout:0/345: truncate d1/d19/d3d/f41 1378406 0 2022-02-02T18:22:51.214 INFO:tasks.workunit.client.1.smithi159.stdout:3/353: mknod dd/d19/d35/d53/c72 0 2022-02-02T18:22:51.215 INFO:tasks.workunit.client.1.smithi159.stdout:0/346: chown d1/d19/f2f 561363 1 2022-02-02T18:22:51.217 INFO:tasks.workunit.client.1.smithi159.stdout:3/354: mknod dd/d20/d2a/d3a/d51/c73 0 2022-02-02T18:22:51.217 INFO:tasks.workunit.client.1.smithi159.stdout:0/347: rename d1/dd/d4b to d1/dd/d4b/d79 22 2022-02-02T18:22:51.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/348: chown d1/d11/d1d/d34/f67 66985 1 2022-02-02T18:22:51.219 INFO:tasks.workunit.client.1.smithi159.stdout:0/349: getdents d1/dd 0 2022-02-02T18:22:51.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/350: mknod d1/d19/d3d/d74/c7a 0 2022-02-02T18:22:51.224 INFO:tasks.workunit.client.1.smithi159.stdout:3/355: dread fc [0,4194304] 0 2022-02-02T18:22:51.224 INFO:tasks.workunit.client.1.smithi159.stdout:9/401: dread d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:22:51.227 INFO:tasks.workunit.client.1.smithi159.stdout:7/423: dwrite d3/f4e [0,4194304] 0 2022-02-02T18:22:51.228 INFO:tasks.workunit.client.1.smithi159.stdout:5/489: dwrite d9/d24/d37/d23/f4f [0,4194304] 0 2022-02-02T18:22:51.228 INFO:tasks.workunit.client.1.smithi159.stdout:8/283: dwrite d1/d26/d48/f57 [0,4194304] 0 2022-02-02T18:22:51.229 INFO:tasks.workunit.client.1.smithi159.stdout:5/490: dread - d9/d24/d38/d3c/f6c zero size 2022-02-02T18:22:51.230 INFO:tasks.workunit.client.1.smithi159.stdout:5/491: creat d9/d24/d38/d88/f96 x:0 0 0 2022-02-02T18:22:51.238 INFO:tasks.workunit.client.1.smithi159.stdout:0/351: dwrite d1/d19/f78 [0,4194304] 0 2022-02-02T18:22:51.243 INFO:tasks.workunit.client.1.smithi159.stdout:9/402: write d4/d19/d1c/d21/d22/d55/f6c [1082932,107453] 0 2022-02-02T18:22:51.244 INFO:tasks.workunit.client.1.smithi159.stdout:0/352: creat d1/d19/d3d/f7b x:0 0 0 2022-02-02T18:22:51.245 INFO:tasks.workunit.client.1.smithi159.stdout:3/356: rename dd/l1d to dd/d66/l74 0 2022-02-02T18:22:51.247 INFO:tasks.workunit.client.1.smithi159.stdout:8/284: creat d1/dd/d1a/d53/f6b x:0 0 0 2022-02-02T18:22:51.249 INFO:tasks.workunit.client.1.smithi159.stdout:0/353: truncate d1/dd/f33 5180348 0 2022-02-02T18:22:51.252 INFO:tasks.workunit.client.1.smithi159.stdout:0/354: write d1/d11/d38/f53 [3216997,8142] 0 2022-02-02T18:22:51.253 INFO:tasks.workunit.client.1.smithi159.stdout:0/355: readlink d1/dd/d4b/l70 0 2022-02-02T18:22:51.253 INFO:tasks.workunit.client.1.smithi159.stdout:3/357: dread dd/d19/d38/f47 [0,4194304] 0 2022-02-02T18:22:51.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/356: mkdir d1/d11/d38/d7c 0 2022-02-02T18:22:51.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/357: chown d1/dd/d4b 112663049 1 2022-02-02T18:22:51.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/358: mkdir d1/dd/d4b/d7d 0 2022-02-02T18:22:51.258 INFO:tasks.workunit.client.1.smithi159.stdout:9/403: dread d4/d19/d1c/d1f/f72 [0,4194304] 0 2022-02-02T18:22:51.260 INFO:tasks.workunit.client.1.smithi159.stdout:9/404: creat d4/d19/f88 x:0 0 0 2022-02-02T18:22:51.262 INFO:tasks.workunit.client.1.smithi159.stdout:7/424: dwrite d3/d27/d29/f71 [4194304,4194304] 0 2022-02-02T18:22:51.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/405: rename d4/d19/d1c/l51 to d4/d19/d1c/d21/d22/l89 0 2022-02-02T18:22:51.264 INFO:tasks.workunit.client.1.smithi159.stdout:3/358: dread dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:22:51.265 INFO:tasks.workunit.client.1.smithi159.stdout:7/425: fsync d3/d27/f3b 0 2022-02-02T18:22:51.267 INFO:tasks.workunit.client.1.smithi159.stdout:9/406: readlink d4/d19/l53 0 2022-02-02T18:22:51.268 INFO:tasks.workunit.client.1.smithi159.stdout:3/359: chown dd/f1c 40375008 1 2022-02-02T18:22:51.270 INFO:tasks.workunit.client.1.smithi159.stdout:9/407: read d4/f10 [3199897,74147] 0 2022-02-02T18:22:51.270 INFO:tasks.workunit.client.1.smithi159.stdout:3/360: creat dd/d20/d2a/f75 x:0 0 0 2022-02-02T18:22:51.274 INFO:tasks.workunit.client.1.smithi159.stdout:9/408: truncate d4/d19/d1c/d1f/f3c 2075698 0 2022-02-02T18:22:51.282 INFO:tasks.workunit.client.1.smithi159.stdout:7/426: symlink d3/d5/d56/d57/l8f 0 2022-02-02T18:22:51.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/409: mknod d4/d19/d1c/d21/d41/c8a 0 2022-02-02T18:22:51.286 INFO:tasks.workunit.client.1.smithi159.stdout:9/410: truncate d4/d19/d1c/d21/d41/f7c 4230988 0 2022-02-02T18:22:51.287 INFO:tasks.workunit.client.1.smithi159.stdout:7/427: symlink d3/d27/d29/d68/l90 0 2022-02-02T18:22:51.291 INFO:tasks.workunit.client.1.smithi159.stdout:9/411: symlink d4/d19/d6f/l8b 0 2022-02-02T18:22:51.292 INFO:tasks.workunit.client.1.smithi159.stdout:8/285: dwrite d1/dd/d1a/d53/f60 [0,4194304] 0 2022-02-02T18:22:51.301 INFO:tasks.workunit.client.1.smithi159.stdout:7/428: unlink d3/d27/d29/d6b/l7c 0 2022-02-02T18:22:51.303 INFO:tasks.workunit.client.1.smithi159.stdout:8/286: write d1/f17 [557005,103925] 0 2022-02-02T18:22:51.303 INFO:tasks.workunit.client.1.smithi159.stdout:8/287: chown d1/dd/d1a/f32 1566729597 1 2022-02-02T18:22:51.312 INFO:tasks.workunit.client.1.smithi159.stdout:7/429: dread d3/f4e [0,4194304] 0 2022-02-02T18:22:51.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/361: dwrite dd/d20/d2a/f4a [0,4194304] 0 2022-02-02T18:22:51.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/430: unlink d3/d5/d56/f3a 0 2022-02-02T18:22:51.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/431: chown d3/d6/f17 6 1 2022-02-02T18:22:51.329 INFO:tasks.workunit.client.1.smithi159.stdout:8/288: dwrite d1/dd/d1a/d53/f54 [0,4194304] 0 2022-02-02T18:22:51.332 INFO:tasks.workunit.client.1.smithi159.stdout:8/289: mknod d1/d26/d48/c6c 0 2022-02-02T18:22:51.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/290: chown d1/dd/d2c/l56 939553 1 2022-02-02T18:22:51.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/291: readlink d1/dd/d1a/l4b 0 2022-02-02T18:22:51.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/432: dwrite d3/d5/d56/d57/f46 [0,4194304] 0 2022-02-02T18:22:51.358 INFO:tasks.workunit.client.1.smithi159.stdout:8/292: dwrite d1/f17 [0,4194304] 0 2022-02-02T18:22:51.359 INFO:tasks.workunit.client.1.smithi159.stdout:7/433: creat d3/d27/d29/d68/d74/f91 x:0 0 0 2022-02-02T18:22:51.359 INFO:tasks.workunit.client.1.smithi159.stdout:8/293: creat d1/dd/d1a/d53/f6d x:0 0 0 2022-02-02T18:22:51.360 INFO:tasks.workunit.client.1.smithi159.stdout:7/434: creat d3/d2a/d4a/d79/d8b/d8c/f92 x:0 0 0 2022-02-02T18:22:51.360 INFO:tasks.workunit.client.1.smithi159.stdout:7/435: write d3/f4e [1963148,13436] 0 2022-02-02T18:22:51.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/294: dwrite d1/d26/d48/f55 [0,4194304] 0 2022-02-02T18:22:51.391 INFO:tasks.workunit.client.1.smithi159.stdout:7/436: dwrite d3/d27/d29/f71 [4194304,4194304] 0 2022-02-02T18:22:51.392 INFO:tasks.workunit.client.1.smithi159.stdout:8/295: getdents d1 0 2022-02-02T18:22:51.397 INFO:tasks.workunit.client.1.smithi159.stdout:8/296: truncate d1/dd/d2c/f42 4906135 0 2022-02-02T18:22:51.398 INFO:tasks.workunit.client.1.smithi159.stdout:8/297: readlink d1/dc/l19 0 2022-02-02T18:22:51.398 INFO:tasks.workunit.client.1.smithi159.stdout:8/298: truncate d1/dd/d1a/d53/f60 4523009 0 2022-02-02T18:22:51.399 INFO:tasks.workunit.client.1.smithi159.stdout:8/299: readlink d1/dd/l37 0 2022-02-02T18:22:51.403 INFO:tasks.workunit.client.1.smithi159.stdout:8/300: unlink d1/dc/c1c 0 2022-02-02T18:22:51.413 INFO:tasks.workunit.client.1.smithi159.stdout:7/437: dwrite d3/d2a/d2c/f63 [0,4194304] 0 2022-02-02T18:22:51.415 INFO:tasks.workunit.client.1.smithi159.stdout:7/438: creat d3/d27/d29/d82/f93 x:0 0 0 2022-02-02T18:22:51.418 INFO:tasks.workunit.client.1.smithi159.stdout:7/439: rename d3/d27/l70 to d3/d2a/d4a/d79/l94 0 2022-02-02T18:22:51.427 INFO:tasks.workunit.client.1.smithi159.stdout:8/301: dwrite d1/dd/d1a/f39 [0,4194304] 0 2022-02-02T18:22:51.427 INFO:tasks.workunit.client.1.smithi159.stdout:8/302: fdatasync d1/dd/d1a/d53/f6d 0 2022-02-02T18:22:51.433 INFO:tasks.workunit.client.1.smithi159.stdout:8/303: dread d1/dd/d2c/d67/f46 [0,4194304] 0 2022-02-02T18:22:51.435 INFO:tasks.workunit.client.1.smithi159.stdout:8/304: read d1/dd/d2c/f42 [3326065,78399] 0 2022-02-02T18:22:51.435 INFO:tasks.workunit.client.1.smithi159.stdout:8/305: chown d1/dd/d2c/d67/l69 64355 1 2022-02-02T18:22:51.436 INFO:tasks.workunit.client.1.smithi159.stdout:8/306: rmdir d1 39 2022-02-02T18:22:51.436 INFO:tasks.workunit.client.1.smithi159.stdout:8/307: creat d1/dd/d1a/f6e x:0 0 0 2022-02-02T18:22:51.438 INFO:tasks.workunit.client.1.smithi159.stdout:8/308: mknod d1/dd/d1a/d53/c6f 0 2022-02-02T18:22:51.445 INFO:tasks.workunit.client.1.smithi159.stdout:8/309: write d1/dd/f29 [1673564,110855] 0 2022-02-02T18:22:51.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/440: dwrite d3/d27/d29/d5e/f69 [0,4194304] 0 2022-02-02T18:22:51.479 INFO:tasks.workunit.client.1.smithi159.stdout:7/441: dwrite d3/d5/d56/d2f/f38 [0,4194304] 0 2022-02-02T18:22:51.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/310: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:22:51.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/311: dread - d1/dd/d1a/d53/f6b zero size 2022-02-02T18:22:51.484 INFO:tasks.workunit.client.1.smithi159.stdout:8/312: rename d1/dd/d1a/d53/c6f to d1/dd/d1a/c70 0 2022-02-02T18:22:51.493 INFO:tasks.workunit.client.1.smithi159.stdout:8/313: write d1/dd/d2c/d67/f50 [1737136,13351] 0 2022-02-02T18:22:51.493 INFO:tasks.workunit.client.1.smithi159.stdout:8/314: dread - d1/dd/d2c/d67/d5f/f61 zero size 2022-02-02T18:22:51.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/315: mknod d1/dd/d2c/d67/d5d/c71 0 2022-02-02T18:22:51.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/316: fsync d1/dc/f41 0 2022-02-02T18:22:51.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/317: truncate d1/dd/d1a/f6e 870598 0 2022-02-02T18:22:51.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/318: truncate d1/f8 1629535 0 2022-02-02T18:22:51.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/319: dread - d1/dd/d1a/f63 zero size 2022-02-02T18:22:51.497 INFO:tasks.workunit.client.1.smithi159.stdout:8/320: truncate d1/fa 2876101 0 2022-02-02T18:22:51.500 INFO:tasks.workunit.client.1.smithi159.stdout:7/442: dwrite d3/d2a/d4a/d79/d8b/d8c/f92 [0,4194304] 0 2022-02-02T18:22:51.505 INFO:tasks.workunit.client.1.smithi159.stdout:7/443: dread d3/d5/d56/d57/f24 [0,4194304] 0 2022-02-02T18:22:51.507 INFO:tasks.workunit.client.1.smithi159.stdout:7/444: truncate d3/fb 5415218 0 2022-02-02T18:22:51.508 INFO:tasks.workunit.client.1.smithi159.stdout:7/445: fdatasync d3/d5/d56/d2f/f44 0 2022-02-02T18:22:51.515 INFO:tasks.workunit.client.1.smithi159.stdout:7/446: write d3/d6/f17 [4554729,8479] 0 2022-02-02T18:22:51.516 INFO:tasks.workunit.client.1.smithi159.stdout:7/447: read d3/d27/f66 [71409,42810] 0 2022-02-02T18:22:51.517 INFO:tasks.workunit.client.1.smithi159.stdout:7/448: mkdir d3/d5/d95 0 2022-02-02T18:22:51.525 INFO:tasks.workunit.client.1.smithi159.stdout:8/321: dwrite d1/dd/d1a/f63 [0,4194304] 0 2022-02-02T18:22:51.527 INFO:tasks.workunit.client.1.smithi159.stdout:7/449: symlink d3/d2a/d4a/l96 0 2022-02-02T18:22:51.527 INFO:tasks.workunit.client.1.smithi159.stdout:7/450: chown d3/d27/d29/d6b 67 1 2022-02-02T18:22:51.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/322: getdents d1/d26 0 2022-02-02T18:22:51.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/323: fdatasync d1/dd/d2c/d67/f46 0 2022-02-02T18:22:51.529 INFO:tasks.workunit.client.1.smithi159.stdout:7/451: getdents d3/d2a/d2c/d7a 0 2022-02-02T18:22:51.531 INFO:tasks.workunit.client.1.smithi159.stdout:7/452: fsync d3/d5/d56/d2f/f38 0 2022-02-02T18:22:51.531 INFO:tasks.workunit.client.1.smithi159.stdout:8/324: truncate d1/d26/d48/f57 592749 0 2022-02-02T18:22:51.534 INFO:tasks.workunit.client.1.smithi159.stdout:8/325: creat d1/dd/d1a/d53/f72 x:0 0 0 2022-02-02T18:22:51.536 INFO:tasks.workunit.client.1.smithi159.stdout:7/453: unlink d3/d5/d56/d2f/d5b/c62 0 2022-02-02T18:22:51.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/326: dwrite d1/d26/f59 [0,4194304] 0 2022-02-02T18:22:51.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/327: dread - d1/dd/d1a/d53/f6b zero size 2022-02-02T18:22:51.560 INFO:tasks.workunit.client.1.smithi159.stdout:7/454: dwrite d3/d2a/d2c/d7a/f85 [0,4194304] 0 2022-02-02T18:22:51.563 INFO:tasks.workunit.client.1.smithi159.stdout:8/328: symlink d1/dd/d1a/d53/l73 0 2022-02-02T18:22:51.564 INFO:tasks.workunit.client.1.smithi159.stdout:8/329: write d1/d26/f59 [3159227,23451] 0 2022-02-02T18:22:51.564 INFO:tasks.workunit.client.1.smithi159.stdout:8/330: creat d1/dd/d1a/d53/f74 x:0 0 0 2022-02-02T18:22:51.567 INFO:tasks.workunit.client.1.smithi159.stdout:7/455: truncate d3/d2a/d2c/f63 1691165 0 2022-02-02T18:22:51.570 INFO:tasks.workunit.client.1.smithi159.stdout:8/331: mkdir d1/dd/d31/d4a/d75 0 2022-02-02T18:22:51.571 INFO:tasks.workunit.client.1.smithi159.stdout:8/332: write d1/dc/f41 [1781341,60003] 0 2022-02-02T18:22:51.574 INFO:tasks.workunit.client.1.smithi159.stdout:7/456: rename d3/d27/d29/d5e/f69 to d3/d5/d56/d2f/d5b/f97 0 2022-02-02T18:22:51.577 INFO:tasks.workunit.client.1.smithi159.stdout:7/457: unlink d3/d5/d56/d57/l8f 0 2022-02-02T18:22:51.578 INFO:tasks.workunit.client.1.smithi159.stdout:7/458: read d3/d5/f20 [2408384,45826] 0 2022-02-02T18:22:51.579 INFO:tasks.workunit.client.1.smithi159.stdout:7/459: write d3/d5/d56/d57/f46 [556567,97574] 0 2022-02-02T18:22:51.581 INFO:tasks.workunit.client.1.smithi159.stdout:8/333: dread d1/dd/d1a/d53/f60 [0,4194304] 0 2022-02-02T18:22:51.581 INFO:tasks.workunit.client.1.smithi159.stdout:8/334: chown d1/dd/d2c/d67/d5f/f61 1442727643 1 2022-02-02T18:22:51.581 INFO:tasks.workunit.client.1.smithi159.stdout:8/335: fsync d1/dd/d2c/f42 0 2022-02-02T18:22:51.582 INFO:tasks.workunit.client.1.smithi159.stdout:8/336: chown d1/c2a 1977781 1 2022-02-02T18:22:51.582 INFO:tasks.workunit.client.1.smithi159.stdout:7/460: creat d3/d27/d29/d6b/f98 x:0 0 0 2022-02-02T18:22:51.584 INFO:tasks.workunit.client.1.smithi159.stdout:8/337: fsync d1/dd/f16 0 2022-02-02T18:22:51.587 INFO:tasks.workunit.client.1.smithi159.stdout:7/461: rmdir d3/d27/d29/d82/d87 0 2022-02-02T18:22:51.587 INFO:tasks.workunit.client.1.smithi159.stdout:7/462: dread - d3/d27/d29/d6b/f98 zero size 2022-02-02T18:22:51.589 INFO:tasks.workunit.client.1.smithi159.stdout:8/338: getdents d1/dd/d1a 0 2022-02-02T18:22:51.590 INFO:tasks.workunit.client.1.smithi159.stdout:8/339: symlink d1/l76 0 2022-02-02T18:22:51.591 INFO:tasks.workunit.client.1.smithi159.stdout:8/340: truncate d1/dd/d1a/f63 2944977 0 2022-02-02T18:22:51.609 INFO:tasks.workunit.client.1.smithi159.stdout:7/463: dwrite d3/d5/d56/d2f/f86 [4194304,4194304] 0 2022-02-02T18:22:51.612 INFO:tasks.workunit.client.1.smithi159.stdout:7/464: mkdir d3/d2a/d4a/d79/d8b/d8c/d99 0 2022-02-02T18:22:51.631 INFO:tasks.workunit.client.1.smithi159.stdout:7/465: dwrite d3/d5/d56/f32 [0,4194304] 0 2022-02-02T18:22:51.655 INFO:tasks.workunit.client.1.smithi159.stdout:7/466: dwrite d3/d5/f7f [8388608,4194304] 0 2022-02-02T18:22:51.655 INFO:tasks.workunit.client.1.smithi159.stdout:7/467: creat d3/d2a/f9a x:0 0 0 2022-02-02T18:22:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/468: truncate d3/d27/d6f/f7e 938049 0 2022-02-02T18:22:51.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/469: truncate d3/d27/d29/f71 1631541 0 2022-02-02T18:22:51.659 INFO:tasks.workunit.client.1.smithi159.stdout:7/470: rename d3/d27/d29/d68/d74/f91 to d3/d5/d56/d2f/f9b 0 2022-02-02T18:22:51.660 INFO:tasks.workunit.client.1.smithi159.stdout:7/471: write d3/d5/d56/d2f/f44 [3078787,21542] 0 2022-02-02T18:22:51.662 INFO:tasks.workunit.client.1.smithi159.stdout:7/472: truncate d3/d6/f40 497910 0 2022-02-02T18:22:51.663 INFO:tasks.workunit.client.1.smithi159.stdout:7/473: mknod d3/d27/d29/d5e/c9c 0 2022-02-02T18:22:51.665 INFO:tasks.workunit.client.1.smithi159.stdout:7/474: mknod d3/d27/d29/d5e/d80/c9d 0 2022-02-02T18:22:51.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/475: rmdir d3/d2a/d2c/d7a 39 2022-02-02T18:22:51.670 INFO:tasks.workunit.client.1.smithi159.stdout:7/476: rename d3/d5/l28 to d3/d2a/d4a/d79/d8b/d8c/d99/l9e 0 2022-02-02T18:22:51.672 INFO:tasks.workunit.client.1.smithi159.stdout:7/477: mknod d3/d2a/c9f 0 2022-02-02T18:22:51.679 INFO:tasks.workunit.client.1.smithi159.stdout:7/478: mknod d3/d27/d6f/ca0 0 2022-02-02T18:22:51.683 INFO:tasks.workunit.client.1.smithi159.stdout:7/479: dread d3/d27/d29/f71 [0,4194304] 0 2022-02-02T18:22:51.684 INFO:tasks.workunit.client.1.smithi159.stdout:7/480: mkdir d3/d2a/d4a/da1 0 2022-02-02T18:22:51.704 INFO:tasks.workunit.client.1.smithi159.stdout:7/481: dwrite d3/d2a/d2c/f63 [0,4194304] 0 2022-02-02T18:22:51.705 INFO:tasks.workunit.client.1.smithi159.stdout:7/482: stat d3/d27/d29/d82 0 2022-02-02T18:22:51.709 INFO:tasks.workunit.client.1.smithi159.stdout:7/483: write d3/d6/f40 [1070963,88438] 0 2022-02-02T18:22:51.710 INFO:tasks.workunit.client.1.smithi159.stdout:7/484: unlink d3/d5/d56/f7b 0 2022-02-02T18:22:51.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/485: dread d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:22:51.715 INFO:tasks.workunit.client.1.smithi159.stdout:7/486: mkdir d3/d27/d6f/da2 0 2022-02-02T18:22:51.716 INFO:tasks.workunit.client.1.smithi159.stdout:7/487: symlink d3/d5/d56/d57/la3 0 2022-02-02T18:22:51.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/488: stat d3/d5/f45 0 2022-02-02T18:22:51.718 INFO:tasks.workunit.client.1.smithi159.stdout:7/489: read d3/d2a/d2c/d7a/f85 [3198136,38127] 0 2022-02-02T18:22:51.718 INFO:tasks.workunit.client.1.smithi159.stdout:7/490: stat d3/d27/d29/d5e/l64 0 2022-02-02T18:22:51.719 INFO:tasks.workunit.client.1.smithi159.stdout:7/491: symlink d3/d5/d56/d57/la4 0 2022-02-02T18:22:51.721 INFO:tasks.workunit.client.1.smithi159.stdout:7/492: dread d3/d6/f54 [0,4194304] 0 2022-02-02T18:22:51.736 INFO:tasks.workunit.client.1.smithi159.stdout:7/493: dwrite d3/d2a/d2c/f63 [0,4194304] 0 2022-02-02T18:22:51.738 INFO:tasks.workunit.client.1.smithi159.stdout:7/494: creat d3/d2a/d4a/d7d/fa5 x:0 0 0 2022-02-02T18:22:51.745 INFO:tasks.workunit.client.1.smithi159.stdout:7/495: dread d3/d2a/d2c/d7a/f85 [0,4194304] 0 2022-02-02T18:22:51.746 INFO:tasks.workunit.client.1.smithi159.stdout:7/496: mknod d3/d5/d95/ca6 0 2022-02-02T18:22:51.754 INFO:tasks.workunit.client.1.smithi159.stdout:7/497: dread d3/d5/d56/d57/f11 [0,4194304] 0 2022-02-02T18:22:51.756 INFO:tasks.workunit.client.1.smithi159.stdout:7/498: dread d3/fb [4194304,4194304] 0 2022-02-02T18:22:51.757 INFO:tasks.workunit.client.1.smithi159.stdout:7/499: mkdir d3/d27/d29/d6b/da7 0 2022-02-02T18:22:51.758 INFO:tasks.workunit.client.1.smithi159.stdout:7/500: truncate d3/d2a/d2c/f5a 2222027 0 2022-02-02T18:22:51.759 INFO:tasks.workunit.client.1.smithi159.stdout:7/501: write d3/d2a/f22 [2093229,24723] 0 2022-02-02T18:22:51.760 INFO:tasks.workunit.client.1.smithi159.stdout:7/502: symlink d3/d27/d6f/la8 0 2022-02-02T18:22:51.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/503: rename d3/d27/d29/d82/c83 to d3/d2a/d4a/d79/ca9 0 2022-02-02T18:22:51.763 INFO:tasks.workunit.client.1.smithi159.stdout:7/504: mkdir d3/d27/d29/d5e/d80/daa 0 2022-02-02T18:22:51.764 INFO:tasks.workunit.client.1.smithi159.stdout:7/505: dread d3/f2d [0,4194304] 0 2022-02-02T18:22:51.765 INFO:tasks.workunit.client.1.smithi159.stdout:7/506: mkdir d3/d5/d56/d2f/d5b/dab 0 2022-02-02T18:22:51.771 INFO:tasks.workunit.client.1.smithi159.stdout:7/507: rmdir d3/d27/d29/d6b 39 2022-02-02T18:22:51.776 INFO:tasks.workunit.client.1.smithi159.stdout:7/508: symlink d3/d5/lac 0 2022-02-02T18:22:51.777 INFO:tasks.workunit.client.1.smithi159.stdout:7/509: chown d3/d2a/d4a/d79/d8b 2 1 2022-02-02T18:22:51.777 INFO:tasks.workunit.client.1.smithi159.stdout:7/510: write d3/d2a/f22 [446612,96940] 0 2022-02-02T18:22:51.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/511: truncate d3/d27/d29/d82/f8d 974537 0 2022-02-02T18:22:51.779 INFO:tasks.workunit.client.1.smithi159.stdout:7/512: link d3/f60 d3/d5/d56/fad 0 2022-02-02T18:22:51.779 INFO:tasks.workunit.client.1.smithi159.stdout:7/513: fdatasync d3/d5/f20 0 2022-02-02T18:22:51.782 INFO:tasks.workunit.client.1.smithi159.stdout:7/514: dread d3/d6/f4d [0,4194304] 0 2022-02-02T18:22:51.802 INFO:tasks.workunit.client.1.smithi159.stdout:7/515: dwrite d3/d5/d56/f81 [0,4194304] 0 2022-02-02T18:22:51.804 INFO:tasks.workunit.client.1.smithi159.stdout:7/516: symlink d3/d2a/d4a/d79/d8b/lae 0 2022-02-02T18:22:51.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/517: symlink d3/d6/laf 0 2022-02-02T18:22:51.815 INFO:tasks.workunit.client.1.smithi159.stdout:7/518: dread d3/d2a/f47 [0,4194304] 0 2022-02-02T18:22:51.818 INFO:tasks.workunit.client.1.smithi159.stdout:7/519: fsync d3/d6/f40 0 2022-02-02T18:22:51.819 INFO:tasks.workunit.client.1.smithi159.stdout:7/520: write d3/d27/d29/d82/f8d [810028,46296] 0 2022-02-02T18:22:51.820 INFO:tasks.workunit.client.1.smithi159.stdout:7/521: mknod d3/d27/d29/d82/cb0 0 2022-02-02T18:22:51.821 INFO:tasks.workunit.client.1.smithi159.stdout:7/522: truncate d3/d2a/d2c/f63 4977308 0 2022-02-02T18:22:51.821 INFO:tasks.workunit.client.1.smithi159.stdout:7/523: read d3/d5/d56/d2f/f38 [2420352,22741] 0 2022-02-02T18:22:51.822 INFO:tasks.workunit.client.1.smithi159.stdout:7/524: read d3/d2a/d4a/d79/d8b/d8c/f92 [3666847,105194] 0 2022-02-02T18:22:51.823 INFO:tasks.workunit.client.1.smithi159.stdout:7/525: write d3/d5/f20 [1317005,34779] 0 2022-02-02T18:22:51.844 INFO:tasks.workunit.client.1.smithi159.stdout:7/526: dwrite d3/d5/d56/d2f/f38 [0,4194304] 0 2022-02-02T18:22:51.848 INFO:tasks.workunit.client.1.smithi159.stdout:7/527: write d3/d2a/f47 [1568326,58891] 0 2022-02-02T18:22:51.873 INFO:tasks.workunit.client.1.smithi159.stdout:7/528: dwrite d3/d27/d29/d82/f93 [0,4194304] 0 2022-02-02T18:22:51.874 INFO:tasks.workunit.client.1.smithi159.stdout:7/529: mknod d3/d27/d29/d5e/d80/daa/cb1 0 2022-02-02T18:22:51.875 INFO:tasks.workunit.client.1.smithi159.stdout:7/530: creat d3/d5/d56/d2f/fb2 x:0 0 0 2022-02-02T18:22:51.898 INFO:tasks.workunit.client.1.smithi159.stdout:7/531: dwrite d3/d6/f54 [0,4194304] 0 2022-02-02T18:22:51.900 INFO:tasks.workunit.client.1.smithi159.stdout:7/532: readlink d3/d6/l77 0 2022-02-02T18:22:51.902 INFO:tasks.workunit.client.1.smithi159.stdout:7/533: creat d3/d27/d29/d6b/da7/fb3 x:0 0 0 2022-02-02T18:22:51.903 INFO:tasks.workunit.client.1.smithi159.stdout:7/534: write d3/d5/d56/d2f/fb2 [206721,11684] 0 2022-02-02T18:22:51.904 INFO:tasks.workunit.client.1.smithi159.stdout:7/535: chown d3/d6/l84 58 1 2022-02-02T18:22:51.905 INFO:tasks.workunit.client.1.smithi159.stdout:7/536: creat d3/d2a/d2c/fb4 x:0 0 0 2022-02-02T18:22:51.905 INFO:tasks.workunit.client.1.smithi159.stdout:7/537: write d3/d5/d56/d2f/fb2 [1122518,120445] 0 2022-02-02T18:22:51.907 INFO:tasks.workunit.client.1.smithi159.stdout:7/538: symlink d3/d2a/d4a/lb5 0 2022-02-02T18:22:51.908 INFO:tasks.workunit.client.1.smithi159.stdout:7/539: creat d3/d5/d56/d2f/d5b/dab/fb6 x:0 0 0 2022-02-02T18:22:51.922 INFO:tasks.workunit.client.1.smithi159.stdout:7/540: dwrite d3/d5/d56/d2f/d5b/f97 [0,4194304] 0 2022-02-02T18:22:51.923 INFO:tasks.workunit.client.1.smithi159.stdout:7/541: mkdir d3/d27/db7 0 2022-02-02T18:22:51.935 INFO:tasks.workunit.client.1.smithi159.stdout:7/542: dread d3/d5/d56/d2f/f86 [0,4194304] 0 2022-02-02T18:22:51.936 INFO:tasks.workunit.client.1.smithi159.stdout:7/543: creat d3/d2a/d4a/d79/d8b/d8c/d99/fb8 x:0 0 0 2022-02-02T18:22:51.937 INFO:tasks.workunit.client.1.smithi159.stdout:7/544: symlink d3/d27/d29/d5e/lb9 0 2022-02-02T18:22:51.938 INFO:tasks.workunit.client.1.smithi159.stdout:7/545: link d3/d6/l84 d3/d27/d29/d6b/da7/lba 0 2022-02-02T18:22:51.941 INFO:tasks.workunit.client.1.smithi159.stdout:7/546: dread d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:22:51.941 INFO:tasks.workunit.client.1.smithi159.stdout:7/547: write d3/d5/d56/d57/f46 [4611917,2490] 0 2022-02-02T18:22:51.942 INFO:tasks.workunit.client.1.smithi159.stdout:7/548: readlink d3/d2a/d4a/d79/d8b/lae 0 2022-02-02T18:22:51.942 INFO:tasks.workunit.client.1.smithi159.stdout:7/549: chown d3/d27/d29/d5e/d80/c9d 733 1 2022-02-02T18:22:51.943 INFO:tasks.workunit.client.1.smithi159.stdout:7/550: truncate d3/d27/f3b 5743024 0 2022-02-02T18:22:51.943 INFO:tasks.workunit.client.1.smithi159.stdout:7/551: creat d3/d2a/d2c/fbb x:0 0 0 2022-02-02T18:22:51.943 INFO:tasks.workunit.client.1.smithi159.stdout:7/552: chown d3/d2a/d4a/d79/d8b/d8c 2 1 2022-02-02T18:22:51.944 INFO:tasks.workunit.client.1.smithi159.stdout:7/553: creat d3/d2a/d4a/d7d/fbc x:0 0 0 2022-02-02T18:22:51.944 INFO:tasks.workunit.client.1.smithi159.stdout:7/554: chown d3/d5/d56/c51 258480 1 2022-02-02T18:22:51.945 INFO:tasks.workunit.client.1.smithi159.stdout:7/555: symlink d3/d5/lbd 0 2022-02-02T18:22:52.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022-02-02T18:22:50.541097+0000 mgr.smithi096.shfutl (mgr. 2022-02-02T18:22:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: 14628) 17 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:22:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022-02-02T18:22:50.704415+0000 mon.smithi096 (mon.0) 732 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T18:22:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022-02-02T18:22:50.704450+0000 mon.smithi096 (mon.0) 733 : cluster 2022-02-02T18:22:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: [INF] Cluster is now healthy 2022-02-02T18:22:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:22:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: -02-02T18:22:50.711516+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: 734 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:active 2022-02-02T18:22:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022-02-02T18:22 2022-02-02T18:22:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: :50.733316+0000 mon.smithi096 (mon.0) 735 : 2022-02-02T18:22:52.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:52.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: cluster 2022-02-02T18:22:50.736700+0000 mon.smithi096 2022-02-02T18:22:52.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: (mon.0) 736 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:22:52.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: audit 2022-02-02T18:22:51.624066+0000 2022-02-02T18:22:52.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:51 smithi159 conmon[35668]: mon.smithi096 (mon.0) 737 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022-02-02T18:22:50.541097+0000 2022-02-02T18:22:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14628) 17 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:22:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022-02-02T18:22:50.704415+0000 mon.smithi096 (mon.0) 732 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T18:22:52.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022-02-02T18:22:50.704450+0000 mon.smithi096 (mon.0) 733 : cluster [INF] Cluster is now healthy 2022-02-02T18:22:52.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022-02-02T18:22:50. 2022-02-02T18:22:52.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 711516+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:52.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 734 : cluster [DBG] mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:active 2022-02-02T18:22:52.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022- 2022-02-02T18:22:52.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 02-02T18:22:50. 2022-02-02T18:22:52.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 733316+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:52.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 735 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:22:52.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: cluster 2022 2022-02-02T18:22:52.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: -02-02T18:22:50. 2022-02-02T18:22:52.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 736700+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:52.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 736 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:22:52.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: audit 2022 2022-02-02T18:22:52.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: -02-02T18:22:51. 2022-02-02T18:22:52.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 624066+0000 mon.smithi096 (mon.0) 2022-02-02T18:22:52.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:51 smithi096 conmon[32067]: 737 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:22:54.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:53 smithi159 conmon[35668]: cluster 2022-02-02T18:22:52.541435+0000 mgr.smithi096.shfutl (mgr.14628) 18 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 6.7 MiB/s wr, 23 op/s 2022-02-02T18:22:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:53 smithi096 conmon[32067]: cluster 2022-02-02T18:22:52.541435+0000 mgr.smithi096.shfutl (mgr.14628) 2022-02-02T18:22:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:53 smithi096 conmon[32067]: 18 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 6.7 MiB/s wr, 23 op/s 2022-02-02T18:22:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:54 smithi159 conmon[35668]: cluster 2022-02-02T18:22:54.541910+0000 mgr.smithi096.shfutl (mgr.14628) 19 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 75 op/s 2022-02-02T18:22:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:54 smithi159 conmon[35668]: 2022-02-02T18:22:55.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:54 smithi096 conmon[32067]: cluster 2022-02-02T18:22:54.541910+0000 mgr.smithi096.shfutl (mgr.14628) 19 : cluster [DBG] 2022-02-02T18:22:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:54 smithi096 conmon[32067]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 75 op/s 2022-02-02T18:22:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:57 smithi159 conmon[35668]: cluster 2022-02-02T18:22:56.542340+0000 mgr.smithi096.shfutl (mgr.14628) 20 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 71 op/s 2022-02-02T18:22:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:57 smithi096 conmon[32067]: cluster 2022-02-02T18:22:56.542340+0000 mgr.smithi096.shfutl (mgr.14628) 20 : cluster [DBG] 2022-02-02T18:22:58.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:57 smithi096 conmon[32067]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 71 op/s 2022-02-02T18:22:59.849 INFO:tasks.workunit.client.1.smithi159.stdout:9/412: sync 2022-02-02T18:22:59.850 INFO:tasks.workunit.client.1.smithi159.stdout:7/556: sync 2022-02-02T18:22:59.850 INFO:tasks.workunit.client.1.smithi159.stdout:6/399: sync 2022-02-02T18:22:59.850 INFO:tasks.workunit.client.1.smithi159.stdout:4/393: sync 2022-02-02T18:22:59.850 INFO:tasks.workunit.client.1.smithi159.stdout:2/491: sync 2022-02-02T18:22:59.851 INFO:tasks.workunit.client.1.smithi159.stdout:3/362: sync 2022-02-02T18:22:59.851 INFO:tasks.workunit.client.1.smithi159.stdout:1/351: sync 2022-02-02T18:22:59.851 INFO:tasks.workunit.client.1.smithi159.stdout:8/341: sync 2022-02-02T18:22:59.851 INFO:tasks.workunit.client.1.smithi159.stdout:0/359: sync 2022-02-02T18:22:59.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/492: sync 2022-02-02T18:22:59.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/493: fdatasync d9/d24/d21/d44/f5b 0 2022-02-02T18:22:59.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/494: dread - d9/d24/d21/f66 zero size 2022-02-02T18:22:59.854 INFO:tasks.workunit.client.1.smithi159.stdout:2/492: read da/d1c/d47/d6b/f5c [1086776,72527] 0 2022-02-02T18:22:59.854 INFO:tasks.workunit.client.1.smithi159.stdout:5/495: rmdir d9/d24/d37/d23/d68 39 2022-02-02T18:22:59.856 INFO:tasks.workunit.client.1.smithi159.stdout:6/400: dread f1 [0,4194304] 0 2022-02-02T18:22:59.857 INFO:tasks.workunit.client.1.smithi159.stdout:6/401: chown df/d35/d2a/d3f/d65 10 1 2022-02-02T18:22:59.857 INFO:tasks.workunit.client.1.smithi159.stdout:7/557: mkdir d3/d5/d95/dbe 0 2022-02-02T18:22:59.858 INFO:tasks.workunit.client.1.smithi159.stdout:9/413: getdents d4/d19/d1c/d1f 0 2022-02-02T18:22:59.859 INFO:tasks.workunit.client.1.smithi159.stdout:1/352: write df/d14/d16/d6d/f7b [64572,38528] 0 2022-02-02T18:22:59.861 INFO:tasks.workunit.client.1.smithi159.stdout:2/493: creat da/d1c/d47/d6b/d5a/fae x:0 0 0 2022-02-02T18:22:59.862 INFO:tasks.workunit.client.1.smithi159.stdout:5/496: write d9/d24/f22 [1378201,73258] 0 2022-02-02T18:22:59.863 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:22:59 smithi159 conmon[35668]: cluster 2022-02-02T18:22:58.543020+0000 mgr.smithi096.shfutl (mgr.14628) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 91 op/s 2022-02-02T18:22:59.864 INFO:tasks.workunit.client.1.smithi159.stdout:0/360: rmdir d1 39 2022-02-02T18:22:59.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/497: creat d9/d24/d21/f97 x:0 0 0 2022-02-02T18:22:59.865 INFO:tasks.workunit.client.1.smithi159.stdout:1/353: dread - df/d14/d16/d4a/f74 zero size 2022-02-02T18:22:59.866 INFO:tasks.workunit.client.1.smithi159.stdout:5/498: getdents d9/d24/d38/d3c 0 2022-02-02T18:22:59.868 INFO:tasks.workunit.client.1.smithi159.stdout:5/499: truncate d9/d24/d38/f64 696402 0 2022-02-02T18:22:59.869 INFO:tasks.workunit.client.1.smithi159.stdout:4/394: mknod d0/d8/d14/d36/d4b/c8c 0 2022-02-02T18:22:59.871 INFO:tasks.workunit.client.1.smithi159.stdout:2/494: mkdir da/d40/daf 0 2022-02-02T18:22:59.872 INFO:tasks.workunit.client.1.smithi159.stdout:8/342: dread d1/dd/d2c/d67/f45 [0,4194304] 0 2022-02-02T18:22:59.875 INFO:tasks.workunit.client.1.smithi159.stdout:3/363: rename dd/d19/f23 to dd/d20/d2a/d31/f76 0 2022-02-02T18:22:59.876 INFO:tasks.workunit.client.1.smithi159.stdout:1/354: symlink df/d14/d16/d4a/l86 0 2022-02-02T18:22:59.880 INFO:tasks.workunit.client.1.smithi159.stdout:1/355: readlink df/d14/l75 0 2022-02-02T18:22:59.886 INFO:tasks.workunit.client.1.smithi159.stdout:1/356: rmdir df/d14/d16/d4a 39 2022-02-02T18:22:59.887 INFO:tasks.workunit.client.1.smithi159.stdout:8/343: dread d1/dd/d1a/d53/f60 [0,4194304] 0 2022-02-02T18:22:59.891 INFO:tasks.workunit.client.1.smithi159.stdout:6/402: rename df/d35/d2a/d2f/f31 to df/d35/d2a/d3f/d42/d47/f86 0 2022-02-02T18:22:59.891 INFO:tasks.workunit.client.1.smithi159.stdout:4/395: dread d0/d8/d15/f2a [0,4194304] 0 2022-02-02T18:22:59.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/344: dread d1/dd/d1a/f6e [0,4194304] 0 2022-02-02T18:22:59.894 INFO:tasks.workunit.client.1.smithi159.stdout:9/414: dwrite d4/d2a/f6e [0,4194304] 0 2022-02-02T18:22:59.896 INFO:tasks.workunit.client.1.smithi159.stdout:3/364: write dd/d19/d35/f4c [1038685,121406] 0 2022-02-02T18:22:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:8/345: symlink d1/dd/d31/d4a/d75/l77 0 2022-02-02T18:22:59.898 INFO:tasks.workunit.client.1.smithi159.stdout:8/346: dread - d1/dd/d1a/d53/f74 zero size 2022-02-02T18:22:59.900 INFO:tasks.workunit.client.1.smithi159.stdout:4/396: unlink d0/f29 0 2022-02-02T18:22:59.901 INFO:tasks.workunit.client.1.smithi159.stdout:6/403: dread - df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f73 zero size 2022-02-02T18:22:59.904 INFO:tasks.workunit.client.1.smithi159.stdout:8/347: creat d1/dd/d31/d4a/d75/f78 x:0 0 0 2022-02-02T18:22:59.924 INFO:tasks.workunit.client.1.smithi159.stdout:2/495: dwrite da/d40/d61/f8f [0,4194304] 0 2022-02-02T18:22:59.925 INFO:tasks.workunit.client.1.smithi159.stdout:1/357: dwrite df/d14/d16/f7e [4194304,4194304] 0 2022-02-02T18:23:00.055 INFO:tasks.workunit.client.1.smithi159.stdout:0/361: rename d1/d19/d3d/d74 to d1/d11/d38/d7e 0 2022-02-02T18:23:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:22:59 smithi096 conmon[32067]: cluster 2022-02-02T18:22:58.543020+0000 mgr.smithi096.shfutl (mgr.14628) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 91 op/s 2022-02-02T18:23:00.058 INFO:tasks.workunit.client.1.smithi159.stdout:5/500: rename d9/d24/f33 to d9/d24/d4a/d8d/f98 0 2022-02-02T18:23:00.059 INFO:tasks.workunit.client.1.smithi159.stdout:8/348: readlink d1/dc/l24 0 2022-02-02T18:23:00.060 INFO:tasks.workunit.client.1.smithi159.stdout:6/404: truncate df/d35/f78 757790 0 2022-02-02T18:23:00.061 INFO:tasks.workunit.client.1.smithi159.stdout:6/405: dread df/d35/f74 [0,4194304] 0 2022-02-02T18:23:00.062 INFO:tasks.workunit.client.1.smithi159.stdout:2/496: chown da/d48/d6d/f8d 833 1 2022-02-02T18:23:00.064 INFO:tasks.workunit.client.1.smithi159.stdout:1/358: mkdir df/d21/d23/d49/d82/d87 0 2022-02-02T18:23:00.068 INFO:tasks.workunit.client.1.smithi159.stdout:3/365: getdents dd/d19/d38/d3f/d52 0 2022-02-02T18:23:00.069 INFO:tasks.workunit.client.1.smithi159.stdout:5/501: dread d9/f8f [0,4194304] 0 2022-02-02T18:23:00.075 INFO:tasks.workunit.client.1.smithi159.stdout:9/415: dwrite d4/d19/d1c/d21/d56/d59/f7d [0,4194304] 0 2022-02-02T18:23:00.077 INFO:tasks.workunit.client.1.smithi159.stdout:6/406: mknod df/d35/d2a/d2f/d80/d61/c87 0 2022-02-02T18:23:00.077 INFO:tasks.workunit.client.1.smithi159.stdout:6/407: dread - df/d35/d2a/d2f/f85 zero size 2022-02-02T18:23:00.078 INFO:tasks.workunit.client.1.smithi159.stdout:2/497: rename da/d40/l49 to da/lb0 0 2022-02-02T18:23:00.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/366: write dd/d20/d2a/d3a/f45 [806752,81553] 0 2022-02-02T18:23:00.085 INFO:tasks.workunit.client.1.smithi159.stdout:3/367: write dd/d20/d2a/f4a [3739827,51126] 0 2022-02-02T18:23:00.089 INFO:tasks.workunit.client.1.smithi159.stdout:9/416: creat d4/d19/d1c/d21/d56/d5b/f8c x:0 0 0 2022-02-02T18:23:00.090 INFO:tasks.workunit.client.1.smithi159.stdout:9/417: dread - d4/d19/d1c/d1f/f4d zero size 2022-02-02T18:23:00.091 INFO:tasks.workunit.client.1.smithi159.stdout:6/408: dread df/d35/d2a/d3f/f48 [0,4194304] 0 2022-02-02T18:23:00.092 INFO:tasks.workunit.client.1.smithi159.stdout:1/359: rename df/d21/d23/d49/d69/d6c/c7f to df/d21/d23/d49/d69/d81/c88 0 2022-02-02T18:23:00.093 INFO:tasks.workunit.client.1.smithi159.stdout:5/502: rename d9/d24/d21/d44/f5b to d9/f99 0 2022-02-02T18:23:00.096 INFO:tasks.workunit.client.1.smithi159.stdout:3/368: fsync dd/f65 0 2022-02-02T18:23:00.098 INFO:tasks.workunit.client.1.smithi159.stdout:5/503: unlink d9/d2e/l2f 0 2022-02-02T18:23:00.100 INFO:tasks.workunit.client.1.smithi159.stdout:5/504: truncate d9/f8f 3342639 0 2022-02-02T18:23:00.100 INFO:tasks.workunit.client.1.smithi159.stdout:1/360: chown df/d14/d16/l27 11346544 1 2022-02-02T18:23:00.101 INFO:tasks.workunit.client.1.smithi159.stdout:5/505: mkdir d9/d24/d4a/d8d/d9a 0 2022-02-02T18:23:00.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/369: rmdir dd/d20 39 2022-02-02T18:23:00.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/506: link d9/d24/d21/d44/f7f d9/d2e/d71/f9b 0 2022-02-02T18:23:00.106 INFO:tasks.workunit.client.1.smithi159.stdout:5/507: truncate f7 1953989 0 2022-02-02T18:23:00.108 INFO:tasks.workunit.client.1.smithi159.stdout:5/508: read - d9/d24/d21/f78 zero size 2022-02-02T18:23:00.109 INFO:tasks.workunit.client.1.smithi159.stdout:6/409: rename df/d35/d2a/d2f/d80/d62 to df/d35/d2a/d3f/d42/d47/d59/d66/d88 0 2022-02-02T18:23:00.110 INFO:tasks.workunit.client.1.smithi159.stdout:5/509: creat d9/d24/d21/f9c x:0 0 0 2022-02-02T18:23:00.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/510: fdatasync d9/d24/f41 0 2022-02-02T18:23:00.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/511: write d9/d24/d37/d23/f3f [3574980,81993] 0 2022-02-02T18:23:00.144 INFO:tasks.workunit.client.1.smithi159.stdout:5/512: creat d9/d24/d4a/d52/f9d x:0 0 0 2022-02-02T18:23:00.149 INFO:tasks.workunit.client.1.smithi159.stdout:8/349: symlink d1/dd/d2c/d67/d5d/l79 0 2022-02-02T18:23:00.149 INFO:tasks.workunit.client.1.smithi159.stdout:6/410: mkdir df/d35/d2a/d3f/d42/d89 0 2022-02-02T18:23:00.150 INFO:tasks.workunit.client.1.smithi159.stdout:3/370: mkdir dd/d66/d69/d77 0 2022-02-02T18:23:00.150 INFO:tasks.workunit.client.1.smithi159.stdout:2/498: link da/d40/c24 da/d1c/d25/d73/dab/cb1 0 2022-02-02T18:23:00.150 INFO:tasks.workunit.client.1.smithi159.stdout:7/558: sync 2022-02-02T18:23:00.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/513: getdents d9/d24/d4a 0 2022-02-02T18:23:00.151 INFO:tasks.workunit.client.1.smithi159.stdout:7/559: dread - d3/d5/d56/d2f/d5b/dab/fb6 zero size 2022-02-02T18:23:00.151 INFO:tasks.workunit.client.1.smithi159.stdout:7/560: fsync d3/d5/d56/d2f/d5b/dab/fb6 0 2022-02-02T18:23:00.152 INFO:tasks.workunit.client.1.smithi159.stdout:0/362: dread d1/f3c [0,4194304] 0 2022-02-02T18:23:00.152 INFO:tasks.workunit.client.1.smithi159.stdout:6/411: read df/d35/d2a/d2f/f3a [1242946,12395] 0 2022-02-02T18:23:00.153 INFO:tasks.workunit.client.1.smithi159.stdout:6/412: fsync df/d35/d2a/d2f/f64 0 2022-02-02T18:23:00.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/350: rename d1/l18 to d1/dd/d1a/l7a 0 2022-02-02T18:23:00.154 INFO:tasks.workunit.client.1.smithi159.stdout:0/363: dread - d1/f5a zero size 2022-02-02T18:23:00.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/499: rmdir da/d1c/d47/d6b/d5a 39 2022-02-02T18:23:00.155 INFO:tasks.workunit.client.1.smithi159.stdout:6/413: fsync df/d35/f71 0 2022-02-02T18:23:00.156 INFO:tasks.workunit.client.1.smithi159.stdout:5/514: rename d9/d24/d21/f97 to d9/d24/d38/d88/f9e 0 2022-02-02T18:23:00.156 INFO:tasks.workunit.client.1.smithi159.stdout:5/515: dread - d9/f99 zero size 2022-02-02T18:23:00.157 INFO:tasks.workunit.client.1.smithi159.stdout:5/516: fdatasync d9/d24/d38/f64 0 2022-02-02T18:23:00.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/364: creat d1/dd/f7f x:0 0 0 2022-02-02T18:23:00.159 INFO:tasks.workunit.client.1.smithi159.stdout:2/500: creat da/fb2 x:0 0 0 2022-02-02T18:23:00.159 INFO:tasks.workunit.client.1.smithi159.stdout:6/414: readlink df/l28 0 2022-02-02T18:23:00.159 INFO:tasks.workunit.client.1.smithi159.stdout:5/517: readlink d9/l17 0 2022-02-02T18:23:00.160 INFO:tasks.workunit.client.1.smithi159.stdout:2/501: creat da/fb3 x:0 0 0 2022-02-02T18:23:00.160 INFO:tasks.workunit.client.1.smithi159.stdout:6/415: chown df/d35/d2a/d3f/d42/d47/l5d 9066 1 2022-02-02T18:23:00.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/351: rename d1/dd/d2c/d67/d5f/f61 to d1/f7b 0 2022-02-02T18:23:00.163 INFO:tasks.workunit.client.1.smithi159.stdout:2/502: creat da/d1c/d47/d6b/d59/fb4 x:0 0 0 2022-02-02T18:23:00.163 INFO:tasks.workunit.client.1.smithi159.stdout:7/561: dread d3/d2a/d2c/f5a [0,4194304] 0 2022-02-02T18:23:00.164 INFO:tasks.workunit.client.1.smithi159.stdout:6/416: creat df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f8a x:0 0 0 2022-02-02T18:23:00.165 INFO:tasks.workunit.client.1.smithi159.stdout:3/371: dread dd/d19/f4e [0,4194304] 0 2022-02-02T18:23:00.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/503: mkdir da/d1c/d25/d73/dab/db5 0 2022-02-02T18:23:00.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/504: write da/fb3 [1043987,59921] 0 2022-02-02T18:23:00.169 INFO:tasks.workunit.client.1.smithi159.stdout:7/562: mknod d3/d27/d29/d5e/cbf 0 2022-02-02T18:23:00.172 INFO:tasks.workunit.client.1.smithi159.stdout:1/361: dwrite df/d14/d68/f70 [0,4194304] 0 2022-02-02T18:23:00.172 INFO:tasks.workunit.client.1.smithi159.stdout:9/418: dwrite d4/f6a [0,4194304] 0 2022-02-02T18:23:00.175 INFO:tasks.workunit.client.1.smithi159.stdout:0/365: dread d1/dd/f60 [0,4194304] 0 2022-02-02T18:23:00.180 INFO:tasks.workunit.client.1.smithi159.stdout:0/366: mknod d1/d11/d1d/d34/c80 0 2022-02-02T18:23:00.181 INFO:tasks.workunit.client.1.smithi159.stdout:0/367: dread - d1/d19/d3d/f40 zero size 2022-02-02T18:23:00.182 INFO:tasks.workunit.client.1.smithi159.stdout:0/368: readlink d1/dd/lf 0 2022-02-02T18:23:00.183 INFO:tasks.workunit.client.1.smithi159.stdout:8/352: write d1/f8 [951021,37728] 0 2022-02-02T18:23:00.184 INFO:tasks.workunit.client.1.smithi159.stdout:0/369: mknod d1/d11/d38/d7c/c81 0 2022-02-02T18:23:00.186 INFO:tasks.workunit.client.1.smithi159.stdout:0/370: link d1/d11/f68 d1/d19/d3d/f82 0 2022-02-02T18:23:00.187 INFO:tasks.workunit.client.1.smithi159.stdout:5/518: dwrite d9/d24/d37/d23/d68/f69 [0,4194304] 0 2022-02-02T18:23:00.188 INFO:tasks.workunit.client.1.smithi159.stdout:0/371: creat d1/d11/d1d/d34/f83 x:0 0 0 2022-02-02T18:23:00.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/563: dwrite d3/d2a/d2c/fb4 [0,4194304] 0 2022-02-02T18:23:00.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/564: getdents d3/d2a/d2c/d7a 0 2022-02-02T18:23:00.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/372: symlink d1/d11/d38/l84 0 2022-02-02T18:23:00.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/373: chown d1/d19/f2f 357 1 2022-02-02T18:23:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:0/374: read d1/d11/d1d/d34/f4a [835612,39422] 0 2022-02-02T18:23:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:0/375: chown d1/d11/d38/d7e/f77 45 1 2022-02-02T18:23:00.204 INFO:tasks.workunit.client.1.smithi159.stdout:5/519: dread d9/d2e/d63/f6b [0,4194304] 0 2022-02-02T18:23:00.204 INFO:tasks.workunit.client.1.smithi159.stdout:8/353: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:23:00.206 INFO:tasks.workunit.client.1.smithi159.stdout:8/354: symlink d1/dd/d31/d4a/d75/l7c 0 2022-02-02T18:23:00.208 INFO:tasks.workunit.client.1.smithi159.stdout:5/520: rename d9/d24/d38/c84 to d9/c9f 0 2022-02-02T18:23:00.216 INFO:tasks.workunit.client.1.smithi159.stdout:8/355: dread d1/d26/d48/f55 [0,4194304] 0 2022-02-02T18:23:00.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/376: dwrite d1/d19/d3d/f82 [4194304,4194304] 0 2022-02-02T18:23:00.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/377: chown d1/f3c 60141771 1 2022-02-02T18:23:00.222 INFO:tasks.workunit.client.1.smithi159.stdout:0/378: chown d1/d11/d1d/d34/l6a 3 1 2022-02-02T18:23:00.224 INFO:tasks.workunit.client.1.smithi159.stdout:0/379: chown d1/d11/d38/d42/d47/f51 19 1 2022-02-02T18:23:00.224 INFO:tasks.workunit.client.1.smithi159.stdout:0/380: fdatasync d1/dd/f6d 0 2022-02-02T18:23:00.225 INFO:tasks.workunit.client.1.smithi159.stdout:0/381: creat d1/d11/d1d/d34/f85 x:0 0 0 2022-02-02T18:23:00.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/382: truncate d1/d19/f78 3619068 0 2022-02-02T18:23:00.228 INFO:tasks.workunit.client.1.smithi159.stdout:0/383: mknod d1/d11/d1d/d34/c86 0 2022-02-02T18:23:00.236 INFO:tasks.workunit.client.1.smithi159.stdout:8/356: dwrite d1/dd/d2c/d67/f46 [0,4194304] 0 2022-02-02T18:23:00.237 INFO:tasks.workunit.client.1.smithi159.stdout:2/505: truncate da/d1c/d47/d6b/d5a/f7b 632750 0 2022-02-02T18:23:00.238 INFO:tasks.workunit.client.1.smithi159.stdout:6/417: mknod df/d35/d2a/d3f/d55/d6a/d6e/c8b 0 2022-02-02T18:23:00.242 INFO:tasks.workunit.client.1.smithi159.stdout:8/357: mknod d1/d26/d48/d49/c7d 0 2022-02-02T18:23:00.247 INFO:tasks.workunit.client.1.smithi159.stdout:5/521: dwrite d9/d24/d4a/d52/f74 [0,4194304] 0 2022-02-02T18:23:00.249 INFO:tasks.workunit.client.1.smithi159.stdout:6/418: chown df/c39 316 1 2022-02-02T18:23:00.252 INFO:tasks.workunit.client.1.smithi159.stdout:7/565: unlink d3/d5/d56/d2f/f86 0 2022-02-02T18:23:00.253 INFO:tasks.workunit.client.1.smithi159.stdout:5/522: readlink d9/d24/l31 0 2022-02-02T18:23:00.255 INFO:tasks.workunit.client.1.smithi159.stdout:8/358: getdents d1/dd/d1a/d53 0 2022-02-02T18:23:00.255 INFO:tasks.workunit.client.1.smithi159.stdout:7/566: truncate d3/d5/f45 3620992 0 2022-02-02T18:23:00.256 INFO:tasks.workunit.client.1.smithi159.stdout:5/523: truncate d9/f47 525190 0 2022-02-02T18:23:00.257 INFO:tasks.workunit.client.1.smithi159.stdout:1/362: mknod df/d14/d16/d4b/d5b/c89 0 2022-02-02T18:23:00.258 INFO:tasks.workunit.client.1.smithi159.stdout:8/359: rmdir d1/dd/d2c/d67 39 2022-02-02T18:23:00.258 INFO:tasks.workunit.client.1.smithi159.stdout:7/567: write d3/d2a/d2c/fb4 [2840900,11505] 0 2022-02-02T18:23:00.258 INFO:tasks.workunit.client.1.smithi159.stdout:7/568: chown d3/d5/d56/d2f/f4c 16792 1 2022-02-02T18:23:00.258 INFO:tasks.workunit.client.1.smithi159.stdout:7/569: write d3/d6/f40 [1464516,98883] 0 2022-02-02T18:23:00.260 INFO:tasks.workunit.client.1.smithi159.stdout:8/360: getdents d1/d26 0 2022-02-02T18:23:00.265 INFO:tasks.workunit.client.1.smithi159.stdout:2/506: write da/d1c/d76/f78 [955846,43360] 0 2022-02-02T18:23:00.266 INFO:tasks.workunit.client.1.smithi159.stdout:9/419: write d4/d19/f76 [478282,70396] 0 2022-02-02T18:23:00.266 INFO:tasks.workunit.client.1.smithi159.stdout:9/420: readlink d4/d19/l53 0 2022-02-02T18:23:00.266 INFO:tasks.workunit.client.1.smithi159.stdout:6/419: symlink df/d35/d2a/d3f/d42/d47/d59/d66/d6b/l8c 0 2022-02-02T18:23:00.267 INFO:tasks.workunit.client.1.smithi159.stdout:1/363: creat df/f8a x:0 0 0 2022-02-02T18:23:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:6/420: fdatasync df/d35/f34 0 2022-02-02T18:23:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:2/507: dread - da/d1c/d76/f87 zero size 2022-02-02T18:23:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:7/570: creat d3/d6/fc0 x:0 0 0 2022-02-02T18:23:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:5/524: write d9/d24/d37/d23/f4d [204834,11554] 0 2022-02-02T18:23:00.272 INFO:tasks.workunit.client.1.smithi159.stdout:5/525: read - d9/f42 zero size 2022-02-02T18:23:00.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/384: dwrite d1/d11/d1d/d34/f4a [0,4194304] 0 2022-02-02T18:23:00.279 INFO:tasks.workunit.client.1.smithi159.stdout:6/421: mknod df/d35/d2a/d3f/d42/d47/d59/d66/c8d 0 2022-02-02T18:23:00.280 INFO:tasks.workunit.client.1.smithi159.stdout:2/508: mknod da/d40/d61/d6c/cb6 0 2022-02-02T18:23:00.282 INFO:tasks.workunit.client.1.smithi159.stdout:1/364: dread df/d14/d16/d35/f42 [0,4194304] 0 2022-02-02T18:23:00.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/385: dread d1/dd/f33 [0,4194304] 0 2022-02-02T18:23:00.285 INFO:tasks.workunit.client.1.smithi159.stdout:0/386: getdents d1/d11/d38/d7c 0 2022-02-02T18:23:00.287 INFO:tasks.workunit.client.1.smithi159.stdout:6/422: rmdir df/d35/d2a/d3f/d65 39 2022-02-02T18:23:00.292 INFO:tasks.workunit.client.1.smithi159.stdout:6/423: truncate df/d35/d2a/d2f/f45 624297 0 2022-02-02T18:23:00.292 INFO:tasks.workunit.client.1.smithi159.stdout:6/424: chown df/c40 163569725 1 2022-02-02T18:23:00.293 INFO:tasks.workunit.client.1.smithi159.stdout:6/425: creat df/d35/f8e x:0 0 0 2022-02-02T18:23:00.294 INFO:tasks.workunit.client.1.smithi159.stdout:6/426: chown df/d35/d2a/d3f/d42/d47/l5d 499727 1 2022-02-02T18:23:00.294 INFO:tasks.workunit.client.1.smithi159.stdout:0/387: rename d1/d19/d3d/c59 to d1/d11/d38/d42/d47/c87 0 2022-02-02T18:23:00.295 INFO:tasks.workunit.client.1.smithi159.stdout:6/427: getdents df/d35/d7b 0 2022-02-02T18:23:00.296 INFO:tasks.workunit.client.1.smithi159.stdout:1/365: dread df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:00.297 INFO:tasks.workunit.client.1.smithi159.stdout:0/388: creat d1/d11/f88 x:0 0 0 2022-02-02T18:23:00.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/509: rename da/d48/d6d/d3e/l60 to da/d48/lb7 0 2022-02-02T18:23:00.306 INFO:tasks.workunit.client.1.smithi159.stdout:0/389: rename d1/d11/d1d/l62 to d1/d11/d38/d42/d56/l89 0 2022-02-02T18:23:00.318 INFO:tasks.workunit.client.1.smithi159.stdout:6/428: dread df/d35/f38 [0,4194304] 0 2022-02-02T18:23:00.319 INFO:tasks.workunit.client.1.smithi159.stdout:6/429: truncate df/d35/d2a/d2f/f37 5131453 0 2022-02-02T18:23:00.320 INFO:tasks.workunit.client.1.smithi159.stdout:6/430: chown df/d35/d2a/d2f/d80/d61/f69 9836309 1 2022-02-02T18:23:00.321 INFO:tasks.workunit.client.1.smithi159.stdout:0/390: dread d1/d11/d1d/d34/f71 [0,4194304] 0 2022-02-02T18:23:00.321 INFO:tasks.workunit.client.1.smithi159.stdout:0/391: write d1/d11/d1d/f44 [1549567,25028] 0 2022-02-02T18:23:00.322 INFO:tasks.workunit.client.1.smithi159.stdout:0/392: truncate d1/d11/f88 167174 0 2022-02-02T18:23:00.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/571: dwrite d3/d27/d6f/f7e [0,4194304] 0 2022-02-02T18:23:00.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/431: dread df/d35/f74 [0,4194304] 0 2022-02-02T18:23:00.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/572: write d3/d27/d29/d82/f8d [1144298,18138] 0 2022-02-02T18:23:00.335 INFO:tasks.workunit.client.1.smithi159.stdout:1/366: dwrite df/f62 [0,4194304] 0 2022-02-02T18:23:00.337 INFO:tasks.workunit.client.1.smithi159.stdout:6/432: dread df/d35/d2a/d2f/f64 [0,4194304] 0 2022-02-02T18:23:00.339 INFO:tasks.workunit.client.1.smithi159.stdout:2/510: dwrite da/d48/d83/f89 [0,4194304] 0 2022-02-02T18:23:00.340 INFO:tasks.workunit.client.1.smithi159.stdout:6/433: write df/d35/f71 [2888667,90931] 0 2022-02-02T18:23:00.340 INFO:tasks.workunit.client.1.smithi159.stdout:1/367: rename df/d14/d16/d35 to df/d14/d16/d4a/d8b 0 2022-02-02T18:23:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/573: write d3/f14 [2460433,68926] 0 2022-02-02T18:23:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/511: mknod da/d40/daf/cb8 0 2022-02-02T18:23:00.348 INFO:tasks.workunit.client.1.smithi159.stdout:1/368: rename df/d14/d16/d4a/c6b to df/d14/d16/d4a/c8c 0 2022-02-02T18:23:00.351 INFO:tasks.workunit.client.1.smithi159.stdout:2/512: rename f8 to da/d1c/d42/fb9 0 2022-02-02T18:23:00.352 INFO:tasks.workunit.client.1.smithi159.stdout:6/434: dread df/d35/d2a/f2d [0,4194304] 0 2022-02-02T18:23:00.353 INFO:tasks.workunit.client.1.smithi159.stdout:1/369: dread - df/d14/d16/d4a/f74 zero size 2022-02-02T18:23:00.358 INFO:tasks.workunit.client.1.smithi159.stdout:6/435: rename df/d35/d2a/c56 to df/d35/d2a/d3f/d42/d47/c8f 0 2022-02-02T18:23:00.361 INFO:tasks.workunit.client.1.smithi159.stdout:0/393: dwrite d1/d11/f73 [0,4194304] 0 2022-02-02T18:23:00.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/574: dwrite d3/d2a/f22 [0,4194304] 0 2022-02-02T18:23:00.363 INFO:tasks.workunit.client.1.smithi159.stdout:6/436: dread df/d35/d2a/d2f/f68 [0,4194304] 0 2022-02-02T18:23:00.367 INFO:tasks.workunit.client.1.smithi159.stdout:7/575: unlink d3/d2a/d4a/d7d/fa5 0 2022-02-02T18:23:00.372 INFO:tasks.workunit.client.1.smithi159.stdout:7/576: mknod d3/d27/d29/d68/cc1 0 2022-02-02T18:23:00.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/394: dwrite d1/d19/d3d/f7b [0,4194304] 0 2022-02-02T18:23:00.378 INFO:tasks.workunit.client.1.smithi159.stdout:1/370: write f7 [4883031,13395] 0 2022-02-02T18:23:00.379 INFO:tasks.workunit.client.1.smithi159.stdout:0/395: write d1/d11/f73 [1160174,55082] 0 2022-02-02T18:23:00.381 INFO:tasks.workunit.client.1.smithi159.stdout:0/396: read d1/fc [288611,27412] 0 2022-02-02T18:23:00.382 INFO:tasks.workunit.client.1.smithi159.stdout:7/577: write d3/d5/d56/d57/f4f [36486,86828] 0 2022-02-02T18:23:00.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/578: chown d3/d27 21353569 1 2022-02-02T18:23:00.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/579: write d3/d2a/d4a/d79/f8a [503624,39684] 0 2022-02-02T18:23:00.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/580: chown d3/d5/d56/d57/ca 8668 1 2022-02-02T18:23:00.384 INFO:tasks.workunit.client.1.smithi159.stdout:7/581: write d3/d27/d6f/f7e [4303778,32796] 0 2022-02-02T18:23:00.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/397: symlink d1/d11/d38/d42/l8a 0 2022-02-02T18:23:00.388 INFO:tasks.workunit.client.1.smithi159.stdout:0/398: dread - d1/d11/d38/d42/d47/f51 zero size 2022-02-02T18:23:00.390 INFO:tasks.workunit.client.1.smithi159.stdout:7/582: symlink d3/d27/d29/d68/lc2 0 2022-02-02T18:23:00.394 INFO:tasks.workunit.client.1.smithi159.stdout:0/399: dread d1/d11/d1d/d34/f71 [0,4194304] 0 2022-02-02T18:23:00.398 INFO:tasks.workunit.client.1.smithi159.stdout:0/400: rename d1/d11/d1d/l1f to d1/d19/d3d/l8b 0 2022-02-02T18:23:00.398 INFO:tasks.workunit.client.1.smithi159.stdout:0/401: write d1/d11/d1d/d34/f85 [194263,50723] 0 2022-02-02T18:23:00.419 INFO:tasks.workunit.client.1.smithi159.stdout:6/437: dwrite f7 [0,4194304] 0 2022-02-02T18:23:00.419 INFO:tasks.workunit.client.1.smithi159.stdout:6/438: chown df/d35/d7b 3436789 1 2022-02-02T18:23:00.420 INFO:tasks.workunit.client.1.smithi159.stdout:7/583: write d3/d5/f45 [4449785,94865] 0 2022-02-02T18:23:00.421 INFO:tasks.workunit.client.1.smithi159.stdout:7/584: mknod d3/d27/d29/d68/cc3 0 2022-02-02T18:23:00.423 INFO:tasks.workunit.client.1.smithi159.stdout:6/439: rename df/d35/d2a/d3f/d42/d47/d59/c72 to df/d35/d2a/d2f/d80/c90 0 2022-02-02T18:23:00.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/513: dwrite f9 [0,4194304] 0 2022-02-02T18:23:00.425 INFO:tasks.workunit.client.1.smithi159.stdout:1/371: dwrite df/d14/d16/d4a/d8b/f42 [0,4194304] 0 2022-02-02T18:23:00.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/514: chown da/f3b 14117170 1 2022-02-02T18:23:00.428 INFO:tasks.workunit.client.1.smithi159.stdout:7/585: rename d3/d27/d29/d5e/d80/c9d to d3/d5/d56/d2f/cc4 0 2022-02-02T18:23:00.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/372: write fe [2291865,22832] 0 2022-02-02T18:23:00.430 INFO:tasks.workunit.client.1.smithi159.stdout:6/440: unlink df/l28 0 2022-02-02T18:23:00.432 INFO:tasks.workunit.client.1.smithi159.stdout:1/373: creat df/d14/d16/d4b/d5b/f8d x:0 0 0 2022-02-02T18:23:00.432 INFO:tasks.workunit.client.1.smithi159.stdout:1/374: write df/d14/d16/d6d/f7b [275614,91779] 0 2022-02-02T18:23:00.433 INFO:tasks.workunit.client.1.smithi159.stdout:1/375: dread - df/f8a zero size 2022-02-02T18:23:00.434 INFO:tasks.workunit.client.1.smithi159.stdout:2/515: symlink da/d1c/d47/d6b/d7c/lba 0 2022-02-02T18:23:00.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/586: rename d3/d27/d29/d82 to d3/d27/d29/d6b/dc5 0 2022-02-02T18:23:00.440 INFO:tasks.workunit.client.1.smithi159.stdout:2/516: mknod da/d40/cbb 0 2022-02-02T18:23:00.440 INFO:tasks.workunit.client.1.smithi159.stdout:2/517: fsync da/d1c/d47/d6b/d59/fb4 0 2022-02-02T18:23:00.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/587: mknod d3/d5/d56/d2f/d5b/dab/cc6 0 2022-02-02T18:23:00.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/588: dread - d3/d6/fc0 zero size 2022-02-02T18:23:00.448 INFO:tasks.workunit.client.1.smithi159.stdout:6/441: write df/d35/d2a/d2f/f37 [865017,57157] 0 2022-02-02T18:23:00.453 INFO:tasks.workunit.client.1.smithi159.stdout:0/402: dwrite d1/d19/d3d/f40 [0,4194304] 0 2022-02-02T18:23:00.453 INFO:tasks.workunit.client.1.smithi159.stdout:6/442: mkdir df/d35/d2a/d3f/d91 0 2022-02-02T18:23:00.454 INFO:tasks.workunit.client.1.smithi159.stdout:0/403: creat d1/dd/f8c x:0 0 0 2022-02-02T18:23:00.456 INFO:tasks.workunit.client.1.smithi159.stdout:0/404: write d1/d11/f35 [330508,121314] 0 2022-02-02T18:23:00.458 INFO:tasks.workunit.client.1.smithi159.stdout:6/443: truncate df/d35/d2a/f7a 4482433 0 2022-02-02T18:23:00.459 INFO:tasks.workunit.client.1.smithi159.stdout:0/405: mkdir d1/d11/d8d 0 2022-02-02T18:23:00.459 INFO:tasks.workunit.client.1.smithi159.stdout:6/444: truncate df/d35/f27 4793060 0 2022-02-02T18:23:00.460 INFO:tasks.workunit.client.1.smithi159.stdout:0/406: symlink d1/d11/d8d/l8e 0 2022-02-02T18:23:00.462 INFO:tasks.workunit.client.1.smithi159.stdout:0/407: mknod d1/d11/d1d/c8f 0 2022-02-02T18:23:00.462 INFO:tasks.workunit.client.1.smithi159.stdout:0/408: fsync d1/d19/d3d/f40 0 2022-02-02T18:23:00.463 INFO:tasks.workunit.client.1.smithi159.stdout:0/409: creat d1/d11/d38/d7e/f90 x:0 0 0 2022-02-02T18:23:00.464 INFO:tasks.workunit.client.1.smithi159.stdout:1/376: dwrite df/d14/d16/d4a/f59 [0,4194304] 0 2022-02-02T18:23:00.465 INFO:tasks.workunit.client.1.smithi159.stdout:0/410: mknod d1/d11/d38/d42/c91 0 2022-02-02T18:23:00.466 INFO:tasks.workunit.client.1.smithi159.stdout:0/411: mkdir d1/d11/d1d/d34/d92 0 2022-02-02T18:23:00.468 INFO:tasks.workunit.client.1.smithi159.stdout:1/377: link df/d14/d16/d6d/c76 df/d14/d16/d4b/d5b/c8e 0 2022-02-02T18:23:00.469 INFO:tasks.workunit.client.1.smithi159.stdout:0/412: mknod d1/d11/d1d/d34/c93 0 2022-02-02T18:23:00.474 INFO:tasks.workunit.client.1.smithi159.stdout:0/413: mkdir d1/d11/d38/d94 0 2022-02-02T18:23:00.474 INFO:tasks.workunit.client.1.smithi159.stdout:0/414: creat d1/d11/d38/f95 x:0 0 0 2022-02-02T18:23:00.477 INFO:tasks.workunit.client.1.smithi159.stdout:0/415: symlink d1/dd/l96 0 2022-02-02T18:23:00.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/378: write df/d14/d16/f45 [961553,128854] 0 2022-02-02T18:23:00.488 INFO:tasks.workunit.client.1.smithi159.stdout:1/379: dread df/d14/d16/f7e [4194304,4194304] 0 2022-02-02T18:23:00.493 INFO:tasks.workunit.client.1.smithi159.stdout:0/416: write d1/d11/d38/f4c [4174500,5852] 0 2022-02-02T18:23:00.503 INFO:tasks.workunit.client.1.smithi159.stdout:6/445: dwrite f3 [0,4194304] 0 2022-02-02T18:23:00.506 INFO:tasks.workunit.client.1.smithi159.stdout:6/446: link f6 df/d35/d2a/d2f/d80/f92 0 2022-02-02T18:23:00.508 INFO:tasks.workunit.client.1.smithi159.stdout:6/447: mknod df/d35/d2a/d3f/d42/c93 0 2022-02-02T18:23:00.520 INFO:tasks.workunit.client.1.smithi159.stdout:0/417: dwrite d1/fb [4194304,4194304] 0 2022-02-02T18:23:00.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/380: dwrite df/d14/d16/f38 [0,4194304] 0 2022-02-02T18:23:00.524 INFO:tasks.workunit.client.1.smithi159.stdout:1/381: dread - df/d14/d16/f60 zero size 2022-02-02T18:23:00.524 INFO:tasks.workunit.client.1.smithi159.stdout:6/448: write df/f1e [705595,104500] 0 2022-02-02T18:23:00.533 INFO:tasks.workunit.client.1.smithi159.stdout:0/418: link d1/d19/f39 d1/d11/d38/d42/d56/f97 0 2022-02-02T18:23:00.534 INFO:tasks.workunit.client.1.smithi159.stdout:1/382: mknod df/d21/d23/c8f 0 2022-02-02T18:23:00.534 INFO:tasks.workunit.client.1.smithi159.stdout:0/419: creat d1/dd/f98 x:0 0 0 2022-02-02T18:23:00.563 INFO:tasks.workunit.client.1.smithi159.stdout:0/420: dwrite d1/d19/f39 [0,4194304] 0 2022-02-02T18:23:00.563 INFO:tasks.workunit.client.1.smithi159.stdout:0/421: getdents d1/d11/d38/d94 0 2022-02-02T18:23:00.577 INFO:tasks.workunit.client.1.smithi159.stdout:1/383: dwrite df/d14/d16/f45 [0,4194304] 0 2022-02-02T18:23:00.580 INFO:tasks.workunit.client.1.smithi159.stdout:1/384: creat df/d14/d16/d6d/f90 x:0 0 0 2022-02-02T18:23:00.582 INFO:tasks.workunit.client.1.smithi159.stdout:1/385: creat df/d14/f91 x:0 0 0 2022-02-02T18:23:00.590 INFO:tasks.workunit.client.1.smithi159.stdout:6/449: dwrite df/d35/d2a/f3b [0,4194304] 0 2022-02-02T18:23:00.590 INFO:tasks.workunit.client.1.smithi159.stdout:0/422: dwrite d1/d19/d3d/f82 [0,4194304] 0 2022-02-02T18:23:00.590 INFO:tasks.workunit.client.1.smithi159.stdout:0/423: write d1/d11/f88 [48058,102642] 0 2022-02-02T18:23:00.592 INFO:tasks.workunit.client.1.smithi159.stdout:0/424: symlink d1/d19/l99 0 2022-02-02T18:23:00.592 INFO:tasks.workunit.client.1.smithi159.stdout:0/425: write d1/d19/d3d/f76 [677009,36874] 0 2022-02-02T18:23:00.594 INFO:tasks.workunit.client.1.smithi159.stdout:0/426: mknod d1/d11/d1d/c9a 0 2022-02-02T18:23:00.599 INFO:tasks.workunit.client.1.smithi159.stdout:1/386: dwrite fe [0,4194304] 0 2022-02-02T18:23:00.600 INFO:tasks.workunit.client.1.smithi159.stdout:1/387: getdents df/d21/d23/d49 0 2022-02-02T18:23:00.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/388: chown df/d21/d23/d49 162 1 2022-02-02T18:23:00.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/389: chown df 1 1 2022-02-02T18:23:00.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/390: chown df/d14/d16/l20 89153 1 2022-02-02T18:23:00.603 INFO:tasks.workunit.client.1.smithi159.stdout:1/391: rename df/d14/d16/d4a/d8b/f42 to df/d21/d23/d49/d82/f92 0 2022-02-02T18:23:00.606 INFO:tasks.workunit.client.1.smithi159.stdout:1/392: rmdir df/d14/d85 0 2022-02-02T18:23:00.607 INFO:tasks.workunit.client.1.smithi159.stdout:1/393: truncate df/f62 4180907 0 2022-02-02T18:23:00.611 INFO:tasks.workunit.client.1.smithi159.stdout:6/450: dwrite df/d35/d2a/d3f/d42/d47/d59/d66/d88/f5b [0,4194304] 0 2022-02-02T18:23:00.620 INFO:tasks.workunit.client.1.smithi159.stdout:6/451: dread df/d35/d2a/d2f/d80/f92 [0,4194304] 0 2022-02-02T18:23:00.621 INFO:tasks.workunit.client.1.smithi159.stdout:1/394: dread df/d14/f5a [0,4194304] 0 2022-02-02T18:23:00.631 INFO:tasks.workunit.client.1.smithi159.stdout:0/427: dwrite d1/dd/f1a [0,4194304] 0 2022-02-02T18:23:00.632 INFO:tasks.workunit.client.1.smithi159.stdout:6/452: write df/d35/d2a/d2f/d80/f92 [5603335,82996] 0 2022-02-02T18:23:00.632 INFO:tasks.workunit.client.1.smithi159.stdout:0/428: symlink d1/d11/d38/d7e/l9b 0 2022-02-02T18:23:00.635 INFO:tasks.workunit.client.1.smithi159.stdout:6/453: rename df/d35/d2a/d2f/f46 to df/d35/d2a/d2f/d80/d61/f94 0 2022-02-02T18:23:00.636 INFO:tasks.workunit.client.1.smithi159.stdout:0/429: link d1/dd/f1a d1/d19/f9c 0 2022-02-02T18:23:00.639 INFO:tasks.workunit.client.1.smithi159.stdout:6/454: rename df/d35/d2a/d3f/d42/f81 to df/d35/d2a/d3f/d42/d47/d59/d66/f95 0 2022-02-02T18:23:00.639 INFO:tasks.workunit.client.1.smithi159.stdout:6/455: readlink df/d35/d2a/d3f/d42/d47/l5d 0 2022-02-02T18:23:00.639 INFO:tasks.workunit.client.1.smithi159.stdout:0/430: symlink d1/d11/d38/d42/d56/l9d 0 2022-02-02T18:23:00.639 INFO:tasks.workunit.client.1.smithi159.stdout:0/431: chown d1/dd/f98 23791 1 2022-02-02T18:23:00.640 INFO:tasks.workunit.client.1.smithi159.stdout:0/432: getdents d1/d11/d38/d42/d47 0 2022-02-02T18:23:00.640 INFO:tasks.workunit.client.1.smithi159.stdout:6/456: unlink df/d35/d2a/d3f/d42/d47/d59/d66/d6b/l8c 0 2022-02-02T18:23:00.641 INFO:tasks.workunit.client.1.smithi159.stdout:6/457: chown df/d35/d2a/d3f/d65 0 1 2022-02-02T18:23:00.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/458: write df/d35/d2a/f2d [2361450,25460] 0 2022-02-02T18:23:00.651 INFO:tasks.workunit.client.1.smithi159.stdout:6/459: creat df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f96 x:0 0 0 2022-02-02T18:23:00.651 INFO:tasks.workunit.client.1.smithi159.stdout:6/460: chown df/d35/d2a/f3b 555138547 1 2022-02-02T18:23:00.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/461: mkdir df/d35/d2a/d3f/d42/d47/d59/d97 0 2022-02-02T18:23:00.653 INFO:tasks.workunit.client.1.smithi159.stdout:1/395: dwrite df/d21/f5c [0,4194304] 0 2022-02-02T18:23:00.668 INFO:tasks.workunit.client.1.smithi159.stdout:1/396: write df/d14/d16/d4a/f51 [1268032,113004] 0 2022-02-02T18:23:00.672 INFO:tasks.workunit.client.1.smithi159.stdout:4/397: sync 2022-02-02T18:23:00.673 INFO:tasks.workunit.client.1.smithi159.stdout:4/398: dread - d0/d8/d24/d76/f78 zero size 2022-02-02T18:23:00.674 INFO:tasks.workunit.client.1.smithi159.stdout:6/462: dwrite df/d35/d2a/d2f/d80/f92 [0,4194304] 0 2022-02-02T18:23:00.676 INFO:tasks.workunit.client.1.smithi159.stdout:4/399: stat d0/d8/d15/d61/l63 0 2022-02-02T18:23:00.678 INFO:tasks.workunit.client.1.smithi159.stdout:4/400: dread d0/d8/d14/f34 [0,4194304] 0 2022-02-02T18:23:00.679 INFO:tasks.workunit.client.1.smithi159.stdout:6/463: rename df/d35/d2a/d2f/f37 to df/d35/d2a/d3f/d42/d47/d59/d66/d88/f98 0 2022-02-02T18:23:00.682 INFO:tasks.workunit.client.1.smithi159.stdout:6/464: link f7 df/d35/d2a/d2f/f99 0 2022-02-02T18:23:00.684 INFO:tasks.workunit.client.1.smithi159.stdout:6/465: rename df/d35/d2a/d3f/d42/d47/d59/d66/d88/l83 to df/d35/d2a/d3f/d42/d47/d59/d66/d6b/d84/l9a 0 2022-02-02T18:23:00.687 INFO:tasks.workunit.client.1.smithi159.stdout:4/401: write d0/d8/f28 [4508192,44199] 0 2022-02-02T18:23:00.689 INFO:tasks.workunit.client.1.smithi159.stdout:4/402: creat d0/d8/d24/d76/f8d x:0 0 0 2022-02-02T18:23:00.690 INFO:tasks.workunit.client.1.smithi159.stdout:4/403: chown d0/d8/d14/d33/d47/d56/f7a 7921 1 2022-02-02T18:23:00.690 INFO:tasks.workunit.client.1.smithi159.stdout:4/404: chown d0/d8/d15/l6f 1 1 2022-02-02T18:23:00.692 INFO:tasks.workunit.client.1.smithi159.stdout:4/405: creat d0/d8/d14/f8e x:0 0 0 2022-02-02T18:23:00.694 INFO:tasks.workunit.client.1.smithi159.stdout:6/466: rename df/d35/d2a/f2d to df/d35/d2a/d3f/d55/d6a/f9b 0 2022-02-02T18:23:00.698 INFO:tasks.workunit.client.1.smithi159.stdout:4/406: mknod d0/d8/d14/d33/d47/c8f 0 2022-02-02T18:23:00.707 INFO:tasks.workunit.client.1.smithi159.stdout:4/407: write d0/d8/d30/d7e/f82 [797460,33843] 0 2022-02-02T18:23:00.707 INFO:tasks.workunit.client.1.smithi159.stdout:4/408: fdatasync d0/d8/d14/f8e 0 2022-02-02T18:23:00.710 INFO:tasks.workunit.client.1.smithi159.stdout:4/409: unlink d0/d8/c22 0 2022-02-02T18:23:00.725 INFO:tasks.workunit.client.1.smithi159.stdout:6/467: dwrite df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f73 [0,4194304] 0 2022-02-02T18:23:00.729 INFO:tasks.workunit.client.1.smithi159.stdout:6/468: creat df/d35/d2a/d3f/d55/d6a/d6e/f9c x:0 0 0 2022-02-02T18:23:00.730 INFO:tasks.workunit.client.1.smithi159.stdout:6/469: fsync df/d35/d2a/f5c 0 2022-02-02T18:23:00.731 INFO:tasks.workunit.client.1.smithi159.stdout:6/470: readlink df/d35/d2a/d3f/d42/d47/l4c 0 2022-02-02T18:23:00.738 INFO:tasks.workunit.client.1.smithi159.stdout:6/471: getdents df 0 2022-02-02T18:23:00.740 INFO:tasks.workunit.client.1.smithi159.stdout:6/472: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d6b/d84/d9d 0 2022-02-02T18:23:00.741 INFO:tasks.workunit.client.1.smithi159.stdout:6/473: getdents df/d35/d7b 0 2022-02-02T18:23:00.741 INFO:tasks.workunit.client.1.smithi159.stdout:6/474: fsync f3 0 2022-02-02T18:23:00.745 INFO:tasks.workunit.client.1.smithi159.stdout:4/410: dwrite d0/d8/f20 [0,4194304] 0 2022-02-02T18:23:00.747 INFO:tasks.workunit.client.1.smithi159.stdout:6/475: dread df/d35/d2a/d3f/d42/d47/f5e [0,4194304] 0 2022-02-02T18:23:00.756 INFO:tasks.workunit.client.1.smithi159.stdout:4/411: write d0/f2d [277087,77074] 0 2022-02-02T18:23:00.757 INFO:tasks.workunit.client.1.smithi159.stdout:6/476: write df/d35/d2a/f7a [3878940,85025] 0 2022-02-02T18:23:00.759 INFO:tasks.workunit.client.1.smithi159.stdout:6/477: symlink df/d35/d2a/d3f/d42/d89/l9e 0 2022-02-02T18:23:00.760 INFO:tasks.workunit.client.1.smithi159.stdout:6/478: truncate df/f16 2573774 0 2022-02-02T18:23:00.761 INFO:tasks.workunit.client.1.smithi159.stdout:6/479: dread df/d35/f74 [0,4194304] 0 2022-02-02T18:23:00.761 INFO:tasks.workunit.client.1.smithi159.stdout:6/480: creat df/d35/d2a/d3f/d55/d6a/d6e/f9f x:0 0 0 2022-02-02T18:23:00.762 INFO:tasks.workunit.client.1.smithi159.stdout:6/481: read - df/d35/d2a/d3f/d42/d47/d59/d66/f95 zero size 2022-02-02T18:23:00.767 INFO:tasks.workunit.client.1.smithi159.stdout:4/412: dread d0/f5b [0,4194304] 0 2022-02-02T18:23:00.767 INFO:tasks.workunit.client.1.smithi159.stdout:6/482: write df/d35/d2a/d3f/d42/f4b [3663883,74581] 0 2022-02-02T18:23:00.769 INFO:tasks.workunit.client.1.smithi159.stdout:4/413: dread d0/d8/f3c [0,4194304] 0 2022-02-02T18:23:00.770 INFO:tasks.workunit.client.1.smithi159.stdout:4/414: creat d0/d8/d30/d5d/f90 x:0 0 0 2022-02-02T18:23:00.773 INFO:tasks.workunit.client.1.smithi159.stdout:4/415: truncate d0/d8/d14/d36/f88 1005235 0 2022-02-02T18:23:00.777 INFO:tasks.workunit.client.1.smithi159.stdout:6/483: write df/d35/d2a/d2f/f3a [1691985,130387] 0 2022-02-02T18:23:00.779 INFO:tasks.workunit.client.1.smithi159.stdout:6/484: unlink df/d35/d2a/d3f/d65/c6f 0 2022-02-02T18:23:00.780 INFO:tasks.workunit.client.1.smithi159.stdout:6/485: creat df/d35/d2a/d2f/fa0 x:0 0 0 2022-02-02T18:23:00.782 INFO:tasks.workunit.client.1.smithi159.stdout:6/486: symlink df/la1 0 2022-02-02T18:23:00.782 INFO:tasks.workunit.client.1.smithi159.stdout:4/416: truncate d0/d8/f20 590821 0 2022-02-02T18:23:00.786 INFO:tasks.workunit.client.1.smithi159.stdout:4/417: getdents d0/d8/d15 0 2022-02-02T18:23:00.790 INFO:tasks.workunit.client.1.smithi159.stdout:4/418: truncate d0/d8/d24/d4f/f52 1021284 0 2022-02-02T18:23:00.800 INFO:tasks.workunit.client.1.smithi159.stdout:4/419: write d0/d8/d24/d76/f78 [536739,124184] 0 2022-02-02T18:23:00.801 INFO:tasks.workunit.client.1.smithi159.stdout:4/420: getdents d0/d8/d14/d33/d47 0 2022-02-02T18:23:00.802 INFO:tasks.workunit.client.1.smithi159.stdout:4/421: creat d0/d8/d30/f91 x:0 0 0 2022-02-02T18:23:00.810 INFO:tasks.workunit.client.1.smithi159.stdout:6/487: dwrite df/d35/d2a/d3f/f58 [0,4194304] 0 2022-02-02T18:23:00.824 INFO:tasks.workunit.client.1.smithi159.stdout:3/372: sync 2022-02-02T18:23:00.824 INFO:tasks.workunit.client.1.smithi159.stdout:3/373: chown dd/d20/c3e 129038 1 2022-02-02T18:23:00.831 INFO:tasks.workunit.client.1.smithi159.stdout:4/422: dwrite d0/d8/d24/d3a/f60 [4194304,4194304] 0 2022-02-02T18:23:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:4/423: mknod d0/d8/d30/d5d/c92 0 2022-02-02T18:23:00.835 INFO:tasks.workunit.client.1.smithi159.stdout:4/424: creat d0/d8/d15/d61/f93 x:0 0 0 2022-02-02T18:23:00.836 INFO:tasks.workunit.client.1.smithi159.stdout:4/425: symlink d0/d66/l94 0 2022-02-02T18:23:00.865 INFO:tasks.workunit.client.1.smithi159.stdout:3/374: dwrite dd/d19/f2b [0,4194304] 0 2022-02-02T18:23:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:4/426: dwrite d0/d8/d15/f27 [4194304,4194304] 0 2022-02-02T18:23:00.869 INFO:tasks.workunit.client.1.smithi159.stdout:4/427: chown d0/d8/d30/f75 0 1 2022-02-02T18:23:00.871 INFO:tasks.workunit.client.1.smithi159.stdout:4/428: creat d0/d8/d15/d61/f95 x:0 0 0 2022-02-02T18:23:00.872 INFO:tasks.workunit.client.1.smithi159.stdout:4/429: mknod d0/d8/d14/d36/c96 0 2022-02-02T18:23:00.874 INFO:tasks.workunit.client.1.smithi159.stdout:4/430: unlink d0/d8/d14/d33/d47/d56/f81 0 2022-02-02T18:23:00.876 INFO:tasks.workunit.client.1.smithi159.stdout:4/431: creat d0/d8/d30/d5d/f97 x:0 0 0 2022-02-02T18:23:00.876 INFO:tasks.workunit.client.1.smithi159.stdout:4/432: getdents d0/d8/d30/d7e 0 2022-02-02T18:23:00.877 INFO:tasks.workunit.client.1.smithi159.stdout:4/433: mkdir d0/d8/d30/d7e/d98 0 2022-02-02T18:23:00.907 INFO:tasks.workunit.client.1.smithi159.stdout:3/375: dwrite dd/d20/f54 [0,4194304] 0 2022-02-02T18:23:00.908 INFO:tasks.workunit.client.1.smithi159.stdout:4/434: dwrite d0/d8/d41/f4d [0,4194304] 0 2022-02-02T18:23:00.917 INFO:tasks.workunit.client.1.smithi159.stdout:4/435: write d0/d8/d15/f57 [202533,70823] 0 2022-02-02T18:23:00.940 INFO:tasks.workunit.client.1.smithi159.stdout:3/376: dwrite dd/d19/d35/d53/f5a [0,4194304] 0 2022-02-02T18:23:00.945 INFO:tasks.workunit.client.1.smithi159.stdout:3/377: unlink dd/c25 0 2022-02-02T18:23:00.946 INFO:tasks.workunit.client.1.smithi159.stdout:4/436: dread d0/d8/d14/f34 [0,4194304] 0 2022-02-02T18:23:00.946 INFO:tasks.workunit.client.1.smithi159.stdout:4/437: write d0/d8/d15/f27 [4286707,15532] 0 2022-02-02T18:23:00.947 INFO:tasks.workunit.client.1.smithi159.stdout:3/378: truncate dd/f11 4022034 0 2022-02-02T18:23:00.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/379: dread fc [0,4194304] 0 2022-02-02T18:23:00.955 INFO:tasks.workunit.client.1.smithi159.stdout:3/380: truncate dd/d19/f2b 3831248 0 2022-02-02T18:23:00.956 INFO:tasks.workunit.client.1.smithi159.stdout:3/381: readlink dd/d19/l21 0 2022-02-02T18:23:00.959 INFO:tasks.workunit.client.1.smithi159.stdout:3/382: rename dd/d19/d38/f47 to dd/d20/d60/f78 0 2022-02-02T18:23:00.961 INFO:tasks.workunit.client.1.smithi159.stdout:3/383: creat dd/d66/d69/f79 x:0 0 0 2022-02-02T18:23:00.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/384: write f7 [1391991,10771] 0 2022-02-02T18:23:00.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/385: chown dd/d19/d35/f44 7240 1 2022-02-02T18:23:00.978 INFO:tasks.workunit.client.1.smithi159.stdout:3/386: truncate fc 3770004 0 2022-02-02T18:23:00.979 INFO:tasks.workunit.client.1.smithi159.stdout:9/421: sync 2022-02-02T18:23:00.979 INFO:tasks.workunit.client.1.smithi159.stdout:8/361: sync 2022-02-02T18:23:00.981 INFO:tasks.workunit.client.1.smithi159.stdout:8/362: stat d1/dd/d2c/d67/l47 0 2022-02-02T18:23:00.984 INFO:tasks.workunit.client.1.smithi159.stdout:8/363: link d1/d26/d48/c4c d1/d26/d48/c7e 0 2022-02-02T18:23:00.985 INFO:tasks.workunit.client.1.smithi159.stdout:8/364: truncate d1/dd/d1a/f6e 1008921 0 2022-02-02T18:23:00.995 INFO:tasks.workunit.client.1.smithi159.stdout:8/365: write d1/f7b [360455,41982] 0 2022-02-02T18:23:00.997 INFO:tasks.workunit.client.1.smithi159.stdout:8/366: fsync d1/dd/f2f 0 2022-02-02T18:23:00.998 INFO:tasks.workunit.client.1.smithi159.stdout:8/367: chown d1/l76 488 1 2022-02-02T18:23:00.999 INFO:tasks.workunit.client.1.smithi159.stdout:8/368: mkdir d1/d26/d48/d7f 0 2022-02-02T18:23:01.001 INFO:tasks.workunit.client.1.smithi159.stdout:8/369: rename d1/dd/d2c/d67/f45 to d1/dd/d1a/d53/f80 0 2022-02-02T18:23:01.003 INFO:tasks.workunit.client.1.smithi159.stdout:8/370: creat d1/dc/f81 x:0 0 0 2022-02-02T18:23:01.003 INFO:tasks.workunit.client.1.smithi159.stdout:9/422: dwrite d4/d2a/f34 [4194304,4194304] 0 2022-02-02T18:23:01.004 INFO:tasks.workunit.client.1.smithi159.stdout:8/371: mknod d1/dd/c82 0 2022-02-02T18:23:01.006 INFO:tasks.workunit.client.1.smithi159.stdout:9/423: unlink d4/d19/d1c/d1f/d4c/c4e 0 2022-02-02T18:23:01.007 INFO:tasks.workunit.client.1.smithi159.stdout:9/424: creat d4/d19/d1c/d21/f8d x:0 0 0 2022-02-02T18:23:01.030 INFO:tasks.workunit.client.1.smithi159.stdout:9/425: read d4/fd [3298836,30173] 0 2022-02-02T18:23:01.031 INFO:tasks.workunit.client.1.smithi159.stdout:8/372: dread d1/dd/d31/f3f [0,4194304] 0 2022-02-02T18:23:01.031 INFO:tasks.workunit.client.1.smithi159.stdout:8/373: chown d1/l76 44281829 1 2022-02-02T18:23:01.034 INFO:tasks.workunit.client.1.smithi159.stdout:9/426: rename d4/d19/c84 to d4/d19/d1c/d21/d41/c8e 0 2022-02-02T18:23:01.042 INFO:tasks.workunit.client.1.smithi159.stdout:9/427: write d4/d19/d1c/d1f/f72 [7913513,16233] 0 2022-02-02T18:23:01.045 INFO:tasks.workunit.client.1.smithi159.stdout:9/428: write d4/d19/d1c/f7e [746458,22228] 0 2022-02-02T18:23:01.046 INFO:tasks.workunit.client.1.smithi159.stdout:9/429: stat d4/d19/d1c/d1f/l35 0 2022-02-02T18:23:01.046 INFO:tasks.workunit.client.1.smithi159.stdout:9/430: fdatasync d4/d19/d1c/d1f/d4c/f86 0 2022-02-02T18:23:01.048 INFO:tasks.workunit.client.1.smithi159.stdout:9/431: rename d4/d19/d42/f7b to d4/d19/d6f/d74/f8f 0 2022-02-02T18:23:01.049 INFO:tasks.workunit.client.1.smithi159.stdout:9/432: chown d4/d2a/f2e 264070031 1 2022-02-02T18:23:01.051 INFO:tasks.workunit.client.1.smithi159.stdout:9/433: mkdir d4/d19/d1c/d1f/d90 0 2022-02-02T18:23:01.077 INFO:tasks.workunit.client.1.smithi159.stdout:9/434: dwrite d4/d2a/f5e [0,4194304] 0 2022-02-02T18:23:01.079 INFO:tasks.workunit.client.1.smithi159.stdout:9/435: symlink d4/d19/d1c/l91 0 2022-02-02T18:23:01.083 INFO:tasks.workunit.client.1.smithi159.stdout:9/436: link d4/d19/d1c/c5f d4/c92 0 2022-02-02T18:23:01.098 INFO:tasks.workunit.client.1.smithi159.stdout:9/437: dread d4/d2a/f5e [0,4194304] 0 2022-02-02T18:23:01.104 INFO:tasks.workunit.client.1.smithi159.stdout:9/438: write d4/d19/d1c/d21/f27 [3868853,123967] 0 2022-02-02T18:23:01.121 INFO:tasks.workunit.client.1.smithi159.stdout:9/439: dread d4/d19/d1c/f54 [0,4194304] 0 2022-02-02T18:23:01.123 INFO:tasks.workunit.client.1.smithi159.stdout:9/440: symlink d4/d19/d1c/d21/d22/l93 0 2022-02-02T18:23:01.123 INFO:tasks.workunit.client.1.smithi159.stdout:9/441: write d4/d19/d1c/d21/f8d [520459,4488] 0 2022-02-02T18:23:01.124 INFO:tasks.workunit.client.1.smithi159.stdout:9/442: creat d4/d19/d42/f94 x:0 0 0 2022-02-02T18:23:01.124 INFO:tasks.workunit.client.1.smithi159.stdout:9/443: fsync d4/d19/d1c/d1f/f3f 0 2022-02-02T18:23:01.145 INFO:tasks.workunit.client.1.smithi159.stdout:9/444: dwrite d4/f10 [0,4194304] 0 2022-02-02T18:23:01.146 INFO:tasks.workunit.client.1.smithi159.stdout:9/445: chown d4/d19/d1c/l66 624 1 2022-02-02T18:23:01.147 INFO:tasks.workunit.client.1.smithi159.stdout:9/446: chown d4/d19/d1c/d21/d56/d59 0 1 2022-02-02T18:23:01.148 INFO:tasks.workunit.client.1.smithi159.stdout:9/447: readlink d4/d19/l3b 0 2022-02-02T18:23:01.157 INFO:tasks.workunit.client.1.smithi159.stdout:9/448: rename d4/d19/d1c/d21/d56/d5b to d4/d19/d1c/d21/d95 0 2022-02-02T18:23:01.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/449: creat d4/f96 x:0 0 0 2022-02-02T18:23:01.160 INFO:tasks.workunit.client.1.smithi159.stdout:9/450: rename d4/d19/d1c/l91 to d4/d19/d1c/l97 0 2022-02-02T18:23:01.161 INFO:tasks.workunit.client.1.smithi159.stdout:9/451: truncate d4/d19/d1c/d21/f45 389954 0 2022-02-02T18:23:01.163 INFO:tasks.workunit.client.1.smithi159.stdout:9/452: link d4/d19/d1c/d1f/f72 d4/d19/d1c/d1f/f98 0 2022-02-02T18:23:01.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/453: write d4/d19/f31 [2261805,96564] 0 2022-02-02T18:23:01.174 INFO:tasks.workunit.client.1.smithi159.stdout:9/454: readlink d4/d19/d1c/l73 0 2022-02-02T18:23:01.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/455: mknod d4/d2a/c99 0 2022-02-02T18:23:01.175 INFO:tasks.workunit.client.1.smithi159.stdout:9/456: rmdir d4/d19/d1c/d21/d56 39 2022-02-02T18:23:01.211 INFO:tasks.workunit.client.1.smithi159.stdout:9/457: dwrite d4/d19/d1c/d1f/d4c/f86 [0,4194304] 0 2022-02-02T18:23:01.211 INFO:tasks.workunit.client.1.smithi159.stdout:9/458: chown d4/d2a/f5e 3298 1 2022-02-02T18:23:01.212 INFO:tasks.workunit.client.1.smithi159.stdout:9/459: rmdir d4/d19/d1c/d21/d95 39 2022-02-02T18:23:01.213 INFO:tasks.workunit.client.1.smithi159.stdout:9/460: truncate d4/f10 875351 0 2022-02-02T18:23:01.218 INFO:tasks.workunit.client.1.smithi159.stdout:5/526: sync 2022-02-02T18:23:01.218 INFO:tasks.workunit.client.1.smithi159.stdout:2/518: sync 2022-02-02T18:23:01.221 INFO:tasks.workunit.client.1.smithi159.stdout:2/519: fdatasync da/d48/d6d/f43 0 2022-02-02T18:23:01.223 INFO:tasks.workunit.client.1.smithi159.stdout:2/520: creat da/d1c/d47/fbc x:0 0 0 2022-02-02T18:23:01.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/527: dread d9/d24/f41 [4194304,4194304] 0 2022-02-02T18:23:01.242 INFO:tasks.workunit.client.1.smithi159.stdout:5/528: truncate d9/d24/d37/d23/f3f 5599575 0 2022-02-02T18:23:01.244 INFO:tasks.workunit.client.1.smithi159.stdout:5/529: rmdir d9/d24/d38/d3c/d8e 0 2022-02-02T18:23:01.244 INFO:tasks.workunit.client.1.smithi159.stdout:5/530: dread - d9/d24/d21/d44/f6e zero size 2022-02-02T18:23:01.247 INFO:tasks.workunit.client.1.smithi159.stdout:9/461: dwrite d4/d19/d1c/d21/d56/d59/f80 [0,4194304] 0 2022-02-02T18:23:01.252 INFO:tasks.workunit.client.1.smithi159.stdout:2/521: dwrite da/d1c/d42/f81 [0,4194304] 0 2022-02-02T18:23:01.255 INFO:tasks.workunit.client.1.smithi159.stdout:2/522: mkdir da/d48/d83/dbd 0 2022-02-02T18:23:01.257 INFO:tasks.workunit.client.1.smithi159.stdout:2/523: symlink da/d40/lbe 0 2022-02-02T18:23:01.275 INFO:tasks.workunit.client.1.smithi159.stdout:2/524: write da/d48/d6d/f99 [616305,106218] 0 2022-02-02T18:23:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: cluster 2022-02-02T18:22:59.968182+0000 mon.smithi096 (mon.0) 2022-02-02T18:23:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: 738 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: cluster 2022-02-02T18:23:00.543401+0000 mgr.smithi096.shfutl (mgr.14628) 22 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 87 op/s 2022-02-02T18:23:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: audit 2022-02-02T18:23:00.707584+0000 mon.smithi096 (mon.0) 739 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: audit 2022-02-02T18:23:00.708479+0000 mon.smithi096 (mon.0) 740 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: audit 2022-02-02T18:23:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: 2022-02-02T18:23:00.709494+0000 mon.smithi096 (mon.0) 741 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:23:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: T18:23:00.710087+0000 mon.smithi096 (mon.0 2022-02-02T18:23:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: ) 742 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:01.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: cephadm 2022-02 2022-02-02T18:23:01.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: -02T18:23:00.710695+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:23:01.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:00 smithi159 conmon[35668]: .14628) 23 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:01.280 INFO:tasks.workunit.client.1.smithi159.stdout:2/525: mknod da/d40/d61/d6c/cbf 0 2022-02-02T18:23:01.280 INFO:tasks.workunit.client.1.smithi159.stdout:5/531: dwrite d9/d24/d37/f18 [0,4194304] 0 2022-02-02T18:23:01.280 INFO:tasks.workunit.client.1.smithi159.stdout:2/526: readlink l6 0 2022-02-02T18:23:01.280 INFO:tasks.workunit.client.1.smithi159.stdout:9/462: dwrite d4/f96 [0,4194304] 0 2022-02-02T18:23:01.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/463: chown d4/d19/d1c/d21/d95/f81 27846598 1 2022-02-02T18:23:01.282 INFO:tasks.workunit.client.1.smithi159.stdout:2/527: truncate da/d1c/d25/f69 4473558 0 2022-02-02T18:23:01.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/464: dread d4/d19/f36 [0,4194304] 0 2022-02-02T18:23:01.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/465: write d4/d19/d42/f85 [257403,47095] 0 2022-02-02T18:23:01.289 INFO:tasks.workunit.client.1.smithi159.stdout:2/528: dread - da/d1c/d42/d70/f8a zero size 2022-02-02T18:23:01.290 INFO:tasks.workunit.client.1.smithi159.stdout:2/529: readlink da/d1c/d47/d6b/d5a/l68 0 2022-02-02T18:23:01.291 INFO:tasks.workunit.client.1.smithi159.stdout:2/530: stat da/d1c/d47/d54 0 2022-02-02T18:23:01.293 INFO:tasks.workunit.client.1.smithi159.stdout:9/466: write d4/d19/d1c/f44 [2013198,27709] 0 2022-02-02T18:23:01.295 INFO:tasks.workunit.client.1.smithi159.stdout:2/531: mknod da/d1c/d25/d73/cc0 0 2022-02-02T18:23:01.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/532: creat da/d48/fc1 x:0 0 0 2022-02-02T18:23:01.298 INFO:tasks.workunit.client.1.smithi159.stdout:2/533: fsync da/f53 0 2022-02-02T18:23:01.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/467: write d4/f96 [1252683,16905] 0 2022-02-02T18:23:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: cluster 2022-02-02T18:22:59.968182+0000 mon.smithi096 (mon. 2022-02-02T18:23:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: 0) 738 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: cluster 2022-02-02T18:23:00.543401+0000 mgr.smithi096.shfutl (mgr.14628) 22 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 87 op/s 2022-02-02T18:23:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: audit 2022-02-02T18:23:00. 2022-02-02T18:23:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: 707584+0000 mon.smithi096 (mon.0) 739 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:23:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: T18:23:00.708479+0000 mon.smithi096 (mon.0) 740 : audit 2022-02-02T18:23:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: audit 2022-02-02T18:23:00. 2022-02-02T18:23:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: 709494+0000 mon.smithi096 (mon.0) 741 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: audit 2022-02- 2022-02-02T18:23:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: 02T18:23:00.710087+0000 mon.smithi096 (mon 2022-02-02T18:23:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: .0) 742 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: cephadm 2022-02- 2022-02-02T18:23:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: 02T18:23:00.710695+0000 mgr.smithi096.shfutl (mgr 2022-02-02T18:23:01.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:00 smithi096 conmon[32067]: .14628) 23 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:01.311 INFO:tasks.workunit.client.1.smithi159.stdout:5/532: dwrite d9/d24/d38/d88/f94 [0,4194304] 0 2022-02-02T18:23:01.312 INFO:tasks.workunit.client.1.smithi159.stdout:5/533: fdatasync d9/d2e/f5d 0 2022-02-02T18:23:01.332 INFO:tasks.workunit.client.1.smithi159.stdout:2/534: dwrite da/d1c/d42/fb9 [4194304,4194304] 0 2022-02-02T18:23:01.333 INFO:tasks.workunit.client.1.smithi159.stdout:5/534: write d9/fc [3489967,83297] 0 2022-02-02T18:23:01.337 INFO:tasks.workunit.client.1.smithi159.stdout:9/468: dwrite d4/fd [0,4194304] 0 2022-02-02T18:23:01.340 INFO:tasks.workunit.client.1.smithi159.stdout:5/535: rename d9/d24/d37/d23/f30 to d9/d2e/d63/fa0 0 2022-02-02T18:23:01.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/469: truncate d4/d19/d1c/d21/d95/f81 684168 0 2022-02-02T18:23:01.342 INFO:tasks.workunit.client.1.smithi159.stdout:9/470: chown d4/l1d 108 1 2022-02-02T18:23:01.344 INFO:tasks.workunit.client.1.smithi159.stdout:9/471: mkdir d4/d19/d1c/d21/d41/d9a 0 2022-02-02T18:23:01.345 INFO:tasks.workunit.client.1.smithi159.stdout:9/472: symlink d4/d19/d1c/d21/d41/d9a/l9b 0 2022-02-02T18:23:01.348 INFO:tasks.workunit.client.1.smithi159.stdout:9/473: unlink d4/d19/f88 0 2022-02-02T18:23:01.360 INFO:tasks.workunit.client.1.smithi159.stdout:1/397: sync 2022-02-02T18:23:01.360 INFO:tasks.workunit.client.1.smithi159.stdout:0/433: sync 2022-02-02T18:23:01.361 INFO:tasks.workunit.client.1.smithi159.stdout:7/589: sync 2022-02-02T18:23:01.364 INFO:tasks.workunit.client.1.smithi159.stdout:1/398: rmdir df/d14 39 2022-02-02T18:23:01.368 INFO:tasks.workunit.client.1.smithi159.stdout:1/399: mkdir df/d14/d16/d4b/d93 0 2022-02-02T18:23:01.369 INFO:tasks.workunit.client.1.smithi159.stdout:7/590: rmdir d3/d27/d29/d68/d74 0 2022-02-02T18:23:01.371 INFO:tasks.workunit.client.1.smithi159.stdout:7/591: truncate d3/d6/f17 3380099 0 2022-02-02T18:23:01.372 INFO:tasks.workunit.client.1.smithi159.stdout:7/592: truncate d3/f2d 715188 0 2022-02-02T18:23:01.374 INFO:tasks.workunit.client.1.smithi159.stdout:1/400: dread df/d21/d23/d49/f5d [0,4194304] 0 2022-02-02T18:23:01.375 INFO:tasks.workunit.client.1.smithi159.stdout:7/593: truncate d3/d2a/f55 898666 0 2022-02-02T18:23:01.375 INFO:tasks.workunit.client.1.smithi159.stdout:7/594: write d3/d2a/d2c/fbb [761130,76294] 0 2022-02-02T18:23:01.375 INFO:tasks.workunit.client.1.smithi159.stdout:7/595: symlink d3/d5/d56/d2f/d5b/lc7 0 2022-02-02T18:23:01.376 INFO:tasks.workunit.client.1.smithi159.stdout:7/596: creat d3/d2a/d4a/d7d/fc8 x:0 0 0 2022-02-02T18:23:01.377 INFO:tasks.workunit.client.1.smithi159.stdout:7/597: chown d3/d5/d56/d57/c65 2074480 1 2022-02-02T18:23:01.378 INFO:tasks.workunit.client.1.smithi159.stdout:7/598: creat d3/d5/d95/fc9 x:0 0 0 2022-02-02T18:23:01.378 INFO:tasks.workunit.client.1.smithi159.stdout:2/535: dwrite da/d1c/d47/d6b/f51 [4194304,4194304] 0 2022-02-02T18:23:01.381 INFO:tasks.workunit.client.1.smithi159.stdout:9/474: dwrite d4/d19/d1c/f44 [0,4194304] 0 2022-02-02T18:23:01.381 INFO:tasks.workunit.client.1.smithi159.stdout:9/475: fsync d4/fd 0 2022-02-02T18:23:01.382 INFO:tasks.workunit.client.1.smithi159.stdout:9/476: creat d4/d19/d1c/d21/d22/f9c x:0 0 0 2022-02-02T18:23:01.383 INFO:tasks.workunit.client.1.smithi159.stdout:9/477: chown d4/d19/d1c/d1f/f72 6143965 1 2022-02-02T18:23:01.383 INFO:tasks.workunit.client.1.smithi159.stdout:9/478: chown d4/d2a/c99 592 1 2022-02-02T18:23:01.384 INFO:tasks.workunit.client.1.smithi159.stdout:9/479: creat d4/d2a/f9d x:0 0 0 2022-02-02T18:23:01.385 INFO:tasks.workunit.client.1.smithi159.stdout:5/536: dwrite d9/d24/d4a/d8d/f98 [0,4194304] 0 2022-02-02T18:23:01.385 INFO:tasks.workunit.client.1.smithi159.stdout:7/599: dread d3/d27/d29/d6b/dc5/f8d [0,4194304] 0 2022-02-02T18:23:01.388 INFO:tasks.workunit.client.1.smithi159.stdout:5/537: symlink d9/d2e/la1 0 2022-02-02T18:23:01.389 INFO:tasks.workunit.client.1.smithi159.stdout:9/480: stat d4/d19/d1c/d21/d41/c8e 0 2022-02-02T18:23:01.390 INFO:tasks.workunit.client.1.smithi159.stdout:1/401: dread df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:23:01.399 INFO:tasks.workunit.client.1.smithi159.stdout:2/536: write da/d48/d6d/d3e/f7f [1909650,105468] 0 2022-02-02T18:23:01.401 INFO:tasks.workunit.client.1.smithi159.stdout:1/402: truncate df/d14/d16/d4a/f44 2009698 0 2022-02-02T18:23:01.404 INFO:tasks.workunit.client.1.smithi159.stdout:2/537: dread - da/d1c/d42/d45/f58 zero size 2022-02-02T18:23:01.406 INFO:tasks.workunit.client.1.smithi159.stdout:1/403: rename df/d14/d16/d6d/l73 to df/d14/d16/d4b/l94 0 2022-02-02T18:23:01.407 INFO:tasks.workunit.client.1.smithi159.stdout:1/404: readlink df/d14/d16/d4b/l94 0 2022-02-02T18:23:01.407 INFO:tasks.workunit.client.1.smithi159.stdout:2/538: mknod da/d1c/d47/d6b/cc2 0 2022-02-02T18:23:01.408 INFO:tasks.workunit.client.1.smithi159.stdout:2/539: write da/d48/d6d/f99 [834331,20264] 0 2022-02-02T18:23:01.409 INFO:tasks.workunit.client.1.smithi159.stdout:2/540: mknod da/d1c/d47/d6b/cc3 0 2022-02-02T18:23:01.414 INFO:tasks.workunit.client.1.smithi159.stdout:5/538: dwrite d9/d24/d38/f64 [0,4194304] 0 2022-02-02T18:23:01.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/539: symlink d9/la2 0 2022-02-02T18:23:01.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/540: chown d9/f8f 0 1 2022-02-02T18:23:01.418 INFO:tasks.workunit.client.1.smithi159.stdout:5/541: stat d9/d24/d38/l57 0 2022-02-02T18:23:01.418 INFO:tasks.workunit.client.1.smithi159.stdout:7/600: dwrite d3/d5/d56/fad [0,4194304] 0 2022-02-02T18:23:01.418 INFO:tasks.workunit.client.1.smithi159.stdout:7/601: fdatasync d3/d5/d95/fc9 0 2022-02-02T18:23:01.420 INFO:tasks.workunit.client.1.smithi159.stdout:5/542: link d9/l11 d9/d24/la3 0 2022-02-02T18:23:01.421 INFO:tasks.workunit.client.1.smithi159.stdout:5/543: readlink d9/d24/d37/l75 0 2022-02-02T18:23:01.427 INFO:tasks.workunit.client.1.smithi159.stdout:7/602: write d3/d2a/f22 [1828685,34116] 0 2022-02-02T18:23:01.429 INFO:tasks.workunit.client.1.smithi159.stdout:7/603: dread d3/d27/f66 [0,4194304] 0 2022-02-02T18:23:01.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/405: write df/d14/d16/d4a/f46 [931590,95654] 0 2022-02-02T18:23:01.437 INFO:tasks.workunit.client.1.smithi159.stdout:7/604: symlink d3/d2a/d4a/d79/d8b/d8c/lca 0 2022-02-02T18:23:01.440 INFO:tasks.workunit.client.1.smithi159.stdout:1/406: chown l3 3799 1 2022-02-02T18:23:01.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/407: dread df/d14/d16/f7e [4194304,4194304] 0 2022-02-02T18:23:01.444 INFO:tasks.workunit.client.1.smithi159.stdout:5/544: dwrite d9/d24/d4a/d8d/f98 [0,4194304] 0 2022-02-02T18:23:01.445 INFO:tasks.workunit.client.1.smithi159.stdout:5/545: truncate d9/d24/d37/d23/d68/f95 563790 0 2022-02-02T18:23:01.445 INFO:tasks.workunit.client.1.smithi159.stdout:5/546: rename d9/d2e to d9/d2e/da4 22 2022-02-02T18:23:01.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/408: symlink df/d21/d23/d49/d69/l95 0 2022-02-02T18:23:01.448 INFO:tasks.workunit.client.1.smithi159.stdout:5/547: rename d9/d24/d4a/d52/f9d to d9/d2e/d63/fa5 0 2022-02-02T18:23:01.451 INFO:tasks.workunit.client.1.smithi159.stdout:5/548: write d9/d24/d37/d23/f4d [67224,66029] 0 2022-02-02T18:23:01.451 INFO:tasks.workunit.client.1.smithi159.stdout:1/409: chown df/d14/f39 671 1 2022-02-02T18:23:01.460 INFO:tasks.workunit.client.1.smithi159.stdout:1/410: dread fe [0,4194304] 0 2022-02-02T18:23:01.462 INFO:tasks.workunit.client.1.smithi159.stdout:1/411: fdatasync df/d14/f57 0 2022-02-02T18:23:01.463 INFO:tasks.workunit.client.1.smithi159.stdout:1/412: creat df/d21/d23/d49/d69/f96 x:0 0 0 2022-02-02T18:23:01.464 INFO:tasks.workunit.client.1.smithi159.stdout:1/413: chown df/d21/f5c 18692790 1 2022-02-02T18:23:01.464 INFO:tasks.workunit.client.1.smithi159.stdout:1/414: creat df/d21/d23/d49/d82/f97 x:0 0 0 2022-02-02T18:23:01.470 INFO:tasks.workunit.client.1.smithi159.stdout:1/415: write f7 [2383360,96778] 0 2022-02-02T18:23:01.472 INFO:tasks.workunit.client.1.smithi159.stdout:1/416: chown df/d14/l2a 31 1 2022-02-02T18:23:01.473 INFO:tasks.workunit.client.1.smithi159.stdout:1/417: truncate fe 3902425 0 2022-02-02T18:23:01.473 INFO:tasks.workunit.client.1.smithi159.stdout:1/418: write df/d21/d23/d49/d69/f96 [253300,26134] 0 2022-02-02T18:23:01.474 INFO:tasks.workunit.client.1.smithi159.stdout:1/419: write df/d14/d16/d4a/f46 [3006604,36243] 0 2022-02-02T18:23:01.475 INFO:tasks.workunit.client.1.smithi159.stdout:5/549: dwrite d9/d24/d4a/d52/f74 [0,4194304] 0 2022-02-02T18:23:01.477 INFO:tasks.workunit.client.1.smithi159.stdout:5/550: chown d9/d24/f16 240444 1 2022-02-02T18:23:01.478 INFO:tasks.workunit.client.1.smithi159.stdout:5/551: chown d9/f1c 280805189 1 2022-02-02T18:23:01.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/420: dwrite df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:01.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/421: fdatasync df/d14/d16/f45 0 2022-02-02T18:23:01.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/422: chown df/d14/l75 0 1 2022-02-02T18:23:01.512 INFO:tasks.workunit.client.1.smithi159.stdout:5/552: dwrite d9/d24/d38/f73 [0,4194304] 0 2022-02-02T18:23:01.512 INFO:tasks.workunit.client.1.smithi159.stdout:5/553: chown d9/d24/d21/d44/f87 5491 1 2022-02-02T18:23:01.512 INFO:tasks.workunit.client.1.smithi159.stdout:1/423: rename df/d14/d16/d4a/l86 to df/d21/d23/d49/d82/d87/l98 0 2022-02-02T18:23:01.514 INFO:tasks.workunit.client.1.smithi159.stdout:5/554: chown d9/d24/d21/f80 2915 1 2022-02-02T18:23:01.514 INFO:tasks.workunit.client.1.smithi159.stdout:1/424: symlink df/d14/d16/d4a/l99 0 2022-02-02T18:23:01.515 INFO:tasks.workunit.client.1.smithi159.stdout:5/555: read d9/f77 [135350,78944] 0 2022-02-02T18:23:01.516 INFO:tasks.workunit.client.1.smithi159.stdout:5/556: fdatasync d9/fc 0 2022-02-02T18:23:01.516 INFO:tasks.workunit.client.1.smithi159.stdout:5/557: chown d9/f77 10 1 2022-02-02T18:23:01.516 INFO:tasks.workunit.client.1.smithi159.stdout:5/558: stat d9/d2e/d63/f6b 0 2022-02-02T18:23:01.517 INFO:tasks.workunit.client.1.smithi159.stdout:5/559: mknod d9/d2e/ca6 0 2022-02-02T18:23:01.519 INFO:tasks.workunit.client.1.smithi159.stdout:5/560: symlink d9/d24/d4a/d8d/la7 0 2022-02-02T18:23:01.528 INFO:tasks.workunit.client.1.smithi159.stdout:6/488: sync 2022-02-02T18:23:01.529 INFO:tasks.workunit.client.1.smithi159.stdout:3/387: sync 2022-02-02T18:23:01.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/438: sync 2022-02-02T18:23:01.533 INFO:tasks.workunit.client.1.smithi159.stdout:6/489: mkdir df/d35/da2 0 2022-02-02T18:23:01.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/439: mknod d0/d8/d30/d5d/c99 0 2022-02-02T18:23:01.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/440: write d0/d8/d14/d33/d47/d56/f8a [558033,101505] 0 2022-02-02T18:23:01.535 INFO:tasks.workunit.client.1.smithi159.stdout:4/441: fsync d0/d8/d14/d33/d47/f53 0 2022-02-02T18:23:01.535 INFO:tasks.workunit.client.1.smithi159.stdout:4/442: stat d0/d8/d24/d4f 0 2022-02-02T18:23:01.535 INFO:tasks.workunit.client.1.smithi159.stdout:3/388: creat dd/d19/d38/d3f/f7a x:0 0 0 2022-02-02T18:23:01.539 INFO:tasks.workunit.client.1.smithi159.stdout:6/490: link df/d35/d2a/d3f/f58 df/d35/d2a/d3f/d55/d6a/d6e/fa3 0 2022-02-02T18:23:01.541 INFO:tasks.workunit.client.1.smithi159.stdout:4/443: rmdir d0/d8/d24/d76 39 2022-02-02T18:23:01.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/425: dwrite df/d14/d16/d4b/d5b/f77 [0,4194304] 0 2022-02-02T18:23:01.544 INFO:tasks.workunit.client.1.smithi159.stdout:1/426: dread df/d21/d23/d49/f5d [0,4194304] 0 2022-02-02T18:23:01.544 INFO:tasks.workunit.client.1.smithi159.stdout:6/491: creat df/d35/d2a/d3f/d55/fa4 x:0 0 0 2022-02-02T18:23:01.546 INFO:tasks.workunit.client.1.smithi159.stdout:3/389: rename dd/d19/d38/d3f/d52/c70 to dd/d20/d2a/d3a/d51/c7b 0 2022-02-02T18:23:01.547 INFO:tasks.workunit.client.1.smithi159.stdout:1/427: truncate df/d14/d16/d4a/f59 1172569 0 2022-02-02T18:23:01.549 INFO:tasks.workunit.client.1.smithi159.stdout:4/444: link d0/f25 d0/d8/d14/d33/d47/f9a 0 2022-02-02T18:23:01.549 INFO:tasks.workunit.client.1.smithi159.stdout:4/445: fsync d0/f3 0 2022-02-02T18:23:01.558 INFO:tasks.workunit.client.1.smithi159.stdout:3/390: dread dd/d20/f54 [0,4194304] 0 2022-02-02T18:23:01.571 INFO:tasks.workunit.client.1.smithi159.stdout:1/428: write df/d14/d16/d4a/f59 [42193,107348] 0 2022-02-02T18:23:01.574 INFO:tasks.workunit.client.1.smithi159.stdout:1/429: read df/d14/d68/f70 [2006013,23768] 0 2022-02-02T18:23:01.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/430: creat df/d21/d23/f9a x:0 0 0 2022-02-02T18:23:01.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/431: mkdir df/d21/d23/d49/d69/d81/d9b 0 2022-02-02T18:23:01.576 INFO:tasks.workunit.client.1.smithi159.stdout:1/432: mkdir df/d9c 0 2022-02-02T18:23:01.577 INFO:tasks.workunit.client.1.smithi159.stdout:1/433: symlink df/d14/d16/d4b/d93/l9d 0 2022-02-02T18:23:01.578 INFO:tasks.workunit.client.1.smithi159.stdout:1/434: creat df/d21/d23/d49/d82/f9e x:0 0 0 2022-02-02T18:23:01.580 INFO:tasks.workunit.client.1.smithi159.stdout:1/435: symlink df/d14/d16/d6d/l9f 0 2022-02-02T18:23:01.581 INFO:tasks.workunit.client.1.smithi159.stdout:1/436: fdatasync df/d14/d16/f7e 0 2022-02-02T18:23:01.581 INFO:tasks.workunit.client.1.smithi159.stdout:1/437: chown df/d14/f91 3431718 1 2022-02-02T18:23:01.605 INFO:tasks.workunit.client.1.smithi159.stdout:3/391: dwrite dd/d66/d69/f79 [0,4194304] 0 2022-02-02T18:23:01.606 INFO:tasks.workunit.client.1.smithi159.stdout:6/492: dwrite df/d35/f36 [0,4194304] 0 2022-02-02T18:23:01.609 INFO:tasks.workunit.client.1.smithi159.stdout:4/446: dwrite d0/f5b [0,4194304] 0 2022-02-02T18:23:01.610 INFO:tasks.workunit.client.1.smithi159.stdout:3/392: write dd/d19/d38/f3d [3287965,55868] 0 2022-02-02T18:23:01.610 INFO:tasks.workunit.client.1.smithi159.stdout:3/393: read dd/d19/d38/d3f/d52/f58 [2126720,59313] 0 2022-02-02T18:23:01.613 INFO:tasks.workunit.client.1.smithi159.stdout:6/493: link df/d35/c22 df/d35/d2a/d2f/ca5 0 2022-02-02T18:23:01.618 INFO:tasks.workunit.client.1.smithi159.stdout:1/438: write df/f18 [2976000,67677] 0 2022-02-02T18:23:01.618 INFO:tasks.workunit.client.1.smithi159.stdout:1/439: chown df/d14/d16/d4a/f59 3470 1 2022-02-02T18:23:01.619 INFO:tasks.workunit.client.1.smithi159.stdout:1/440: truncate df/d21/d23/d49/d82/f9e 110255 0 2022-02-02T18:23:01.620 INFO:tasks.workunit.client.1.smithi159.stdout:3/394: rename c3 to dd/d66/c7c 0 2022-02-02T18:23:01.621 INFO:tasks.workunit.client.1.smithi159.stdout:4/447: dread d0/d8/f28 [0,4194304] 0 2022-02-02T18:23:01.622 INFO:tasks.workunit.client.1.smithi159.stdout:6/494: truncate df/d35/f36 2573 0 2022-02-02T18:23:01.625 INFO:tasks.workunit.client.1.smithi159.stdout:1/441: mkdir df/d14/d16/d4b/da0 0 2022-02-02T18:23:01.628 INFO:tasks.workunit.client.1.smithi159.stdout:3/395: read dd/d19/d38/d3f/f50 [482950,47761] 0 2022-02-02T18:23:01.629 INFO:tasks.workunit.client.1.smithi159.stdout:6/495: rmdir df/d35/d2a/d3f/d42/d47/d59/d66/d6b/d84 39 2022-02-02T18:23:01.631 INFO:tasks.workunit.client.1.smithi159.stdout:4/448: truncate d0/d8/d24/d4f/f5c 398972 0 2022-02-02T18:23:01.637 INFO:tasks.workunit.client.1.smithi159.stdout:3/396: mkdir dd/d19/d38/d3f/d7d 0 2022-02-02T18:23:01.641 INFO:tasks.workunit.client.1.smithi159.stdout:3/397: link dd/d19/d38/d3f/f4d dd/d20/d2a/d3a/d51/f7e 0 2022-02-02T18:23:01.645 INFO:tasks.workunit.client.1.smithi159.stdout:4/449: truncate d0/f5b 3869766 0 2022-02-02T18:23:01.646 INFO:tasks.workunit.client.1.smithi159.stdout:1/442: dwrite df/d14/d68/f70 [0,4194304] 0 2022-02-02T18:23:01.646 INFO:tasks.workunit.client.1.smithi159.stdout:1/443: fsync df/d21/d23/f29 0 2022-02-02T18:23:01.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/496: dread df/d35/f71 [0,4194304] 0 2022-02-02T18:23:01.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/497: truncate df/d35/d2a/d3f/d55/d6a/d6e/f9c 91738 0 2022-02-02T18:23:01.655 INFO:tasks.workunit.client.1.smithi159.stdout:1/444: dread df/d14/d16/d4b/d5b/f77 [0,4194304] 0 2022-02-02T18:23:01.656 INFO:tasks.workunit.client.1.smithi159.stdout:6/498: read df/d35/d2a/d2f/f3a [4086949,28135] 0 2022-02-02T18:23:01.678 INFO:tasks.workunit.client.1.smithi159.stdout:1/445: mkdir df/d21/d23/d49/da1 0 2022-02-02T18:23:01.679 INFO:tasks.workunit.client.1.smithi159.stdout:1/446: read df/d14/f5a [2249042,83750] 0 2022-02-02T18:23:01.682 INFO:tasks.workunit.client.1.smithi159.stdout:6/499: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6 0 2022-02-02T18:23:01.682 INFO:tasks.workunit.client.1.smithi159.stdout:6/500: chown df/d35/d2a/d3f/d42/d47/d59/d66/d6b 2 1 2022-02-02T18:23:01.682 INFO:tasks.workunit.client.1.smithi159.stdout:6/501: readlink df/d35/d2a/d3f/d42/d47/l4c 0 2022-02-02T18:23:01.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/502: chown df/f2e 200896 1 2022-02-02T18:23:01.683 INFO:tasks.workunit.client.1.smithi159.stdout:8/374: sync 2022-02-02T18:23:01.685 INFO:tasks.workunit.client.1.smithi159.stdout:4/450: dwrite d0/f5b [4194304,4194304] 0 2022-02-02T18:23:01.686 INFO:tasks.workunit.client.1.smithi159.stdout:4/451: fsync d0/d8/d14/d36/f88 0 2022-02-02T18:23:01.687 INFO:tasks.workunit.client.1.smithi159.stdout:4/452: stat d0/f25 0 2022-02-02T18:23:01.687 INFO:tasks.workunit.client.1.smithi159.stdout:4/453: chown d0/d8/d41/f4d 91816707 1 2022-02-02T18:23:01.691 INFO:tasks.workunit.client.1.smithi159.stdout:4/454: dread d0/d8/d24/d4f/f52 [0,4194304] 0 2022-02-02T18:23:01.692 INFO:tasks.workunit.client.1.smithi159.stdout:8/375: read d1/dd/d31/f3f [997151,112142] 0 2022-02-02T18:23:01.692 INFO:tasks.workunit.client.1.smithi159.stdout:6/503: dread df/f1e [0,4194304] 0 2022-02-02T18:23:01.692 INFO:tasks.workunit.client.1.smithi159.stdout:4/455: mkdir d0/d8/d30/d7e/d98/d9b 0 2022-02-02T18:23:01.696 INFO:tasks.workunit.client.1.smithi159.stdout:8/376: symlink d1/dd/d31/l83 0 2022-02-02T18:23:01.698 INFO:tasks.workunit.client.1.smithi159.stdout:8/377: creat d1/dd/d31/d4a/d75/f84 x:0 0 0 2022-02-02T18:23:01.700 INFO:tasks.workunit.client.1.smithi159.stdout:8/378: symlink d1/dd/d2c/d67/d5f/l85 0 2022-02-02T18:23:01.702 INFO:tasks.workunit.client.1.smithi159.stdout:8/379: creat d1/dd/d1a/f86 x:0 0 0 2022-02-02T18:23:01.705 INFO:tasks.workunit.client.1.smithi159.stdout:4/456: write d0/d8/d15/f69 [913344,5583] 0 2022-02-02T18:23:01.706 INFO:tasks.workunit.client.1.smithi159.stdout:8/380: dread d1/d26/d48/f55 [0,4194304] 0 2022-02-02T18:23:01.707 INFO:tasks.workunit.client.1.smithi159.stdout:6/504: dwrite df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f96 [0,4194304] 0 2022-02-02T18:23:01.707 INFO:tasks.workunit.client.1.smithi159.stdout:4/457: mkdir d0/d8/d30/d7e/d9c 0 2022-02-02T18:23:01.708 INFO:tasks.workunit.client.1.smithi159.stdout:8/381: symlink d1/dd/d31/l87 0 2022-02-02T18:23:01.709 INFO:tasks.workunit.client.1.smithi159.stdout:8/382: getdents d1/dd/d31/d4a 0 2022-02-02T18:23:01.709 INFO:tasks.workunit.client.1.smithi159.stdout:8/383: dread - d1/dd/d31/d4a/d75/f78 zero size 2022-02-02T18:23:01.710 INFO:tasks.workunit.client.1.smithi159.stdout:6/505: mkdir df/d35/d2a/d2f/da7 0 2022-02-02T18:23:01.710 INFO:tasks.workunit.client.1.smithi159.stdout:6/506: write df/d35/d2a/d3f/d55/d6a/d6e/f9c [125559,79823] 0 2022-02-02T18:23:01.712 INFO:tasks.workunit.client.1.smithi159.stdout:6/507: truncate df/d35/d2a/d3f/d42/d47/d59/d66/d88/f98 2861484 0 2022-02-02T18:23:01.714 INFO:tasks.workunit.client.1.smithi159.stdout:6/508: mkdir df/d35/d2a/d2f/d80/d61/da8 0 2022-02-02T18:23:01.714 INFO:tasks.workunit.client.1.smithi159.stdout:6/509: truncate df/d35/d2a/d3f/d42/d47/d59/d66/d88/f5b 3107848 0 2022-02-02T18:23:01.717 INFO:tasks.workunit.client.1.smithi159.stdout:6/510: symlink df/d35/d2a/d3f/d42/d47/d59/d97/la9 0 2022-02-02T18:23:01.718 INFO:tasks.workunit.client.1.smithi159.stdout:8/384: write d1/dd/d1a/d53/f80 [4535975,1947] 0 2022-02-02T18:23:01.720 INFO:tasks.workunit.client.1.smithi159.stdout:8/385: symlink d1/d26/l88 0 2022-02-02T18:23:01.721 INFO:tasks.workunit.client.1.smithi159.stdout:8/386: write d1/f7b [752756,104416] 0 2022-02-02T18:23:01.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/387: write d1/dd/d1a/d53/f54 [3206014,46613] 0 2022-02-02T18:23:01.728 INFO:tasks.workunit.client.1.smithi159.stdout:8/388: mkdir d1/d26/d48/d7f/d89 0 2022-02-02T18:23:01.728 INFO:tasks.workunit.client.1.smithi159.stdout:8/389: chown d1/dc/l19 1150600 1 2022-02-02T18:23:01.729 INFO:tasks.workunit.client.1.smithi159.stdout:8/390: dread - d1/dd/d1a/d53/f6d zero size 2022-02-02T18:23:01.732 INFO:tasks.workunit.client.1.smithi159.stdout:8/391: mkdir d1/dd/d2c/d67/d5f/d8a 0 2022-02-02T18:23:01.735 INFO:tasks.workunit.client.1.smithi159.stdout:8/392: symlink d1/d26/d48/d49/l8b 0 2022-02-02T18:23:01.736 INFO:tasks.workunit.client.1.smithi159.stdout:8/393: rename d1/l15 to d1/dd/d2c/d67/l8c 0 2022-02-02T18:23:01.743 INFO:tasks.workunit.client.1.smithi159.stdout:6/511: dwrite df/d35/d2a/d3f/f58 [4194304,4194304] 0 2022-02-02T18:23:01.745 INFO:tasks.workunit.client.1.smithi159.stdout:6/512: chown df/d35/d2a/d3f/c6d 3 1 2022-02-02T18:23:01.749 INFO:tasks.workunit.client.1.smithi159.stdout:6/513: dread df/d35/f74 [0,4194304] 0 2022-02-02T18:23:01.751 INFO:tasks.workunit.client.1.smithi159.stdout:6/514: creat df/faa x:0 0 0 2022-02-02T18:23:01.758 INFO:tasks.workunit.client.1.smithi159.stdout:8/394: dwrite d1/dd/f2f [0,4194304] 0 2022-02-02T18:23:01.758 INFO:tasks.workunit.client.1.smithi159.stdout:8/395: dread - d1/dd/d31/d4a/d75/f78 zero size 2022-02-02T18:23:01.775 INFO:tasks.workunit.client.1.smithi159.stdout:6/515: dwrite df/d35/d2a/d2f/d80/d61/f94 [0,4194304] 0 2022-02-02T18:23:01.775 INFO:tasks.workunit.client.1.smithi159.stdout:6/516: fdatasync df/d35/d2a/d3f/f58 0 2022-02-02T18:23:01.776 INFO:tasks.workunit.client.1.smithi159.stdout:6/517: fsync df/d35/d2a/d2f/f85 0 2022-02-02T18:23:01.778 INFO:tasks.workunit.client.1.smithi159.stdout:6/518: truncate df/d35/f71 2657013 0 2022-02-02T18:23:01.779 INFO:tasks.workunit.client.1.smithi159.stdout:6/519: creat df/d35/d2a/d3f/fab x:0 0 0 2022-02-02T18:23:01.781 INFO:tasks.workunit.client.1.smithi159.stdout:6/520: rename df/d35/d2a/d3f/d42/d47/d59/d66/f95 to df/d35/d2a/d3f/d42/d47/d59/d66/d6b/d84/fac 0 2022-02-02T18:23:01.782 INFO:tasks.workunit.client.1.smithi159.stdout:6/521: chown df/d35/d2a/d3f/f44 15079 1 2022-02-02T18:23:01.787 INFO:tasks.workunit.client.1.smithi159.stdout:8/396: dwrite d1/dd/d1a/d53/f60 [4194304,4194304] 0 2022-02-02T18:23:01.787 INFO:tasks.workunit.client.1.smithi159.stdout:8/397: chown d1/dc/f81 13 1 2022-02-02T18:23:01.793 INFO:tasks.workunit.client.1.smithi159.stdout:6/522: dread f6 [0,4194304] 0 2022-02-02T18:23:01.793 INFO:tasks.workunit.client.1.smithi159.stdout:6/523: fsync df/d35/d2a/f7a 0 2022-02-02T18:23:01.794 INFO:tasks.workunit.client.1.smithi159.stdout:6/524: creat df/d35/d2a/d2f/fad x:0 0 0 2022-02-02T18:23:01.796 INFO:tasks.workunit.client.1.smithi159.stdout:6/525: symlink df/d35/d2a/d3f/d42/d47/d59/d66/d6b/lae 0 2022-02-02T18:23:01.811 INFO:tasks.workunit.client.1.smithi159.stdout:8/398: dwrite d1/d26/f59 [0,4194304] 0 2022-02-02T18:23:01.813 INFO:tasks.workunit.client.1.smithi159.stdout:6/526: dwrite df/d35/d2a/d2f/fa0 [0,4194304] 0 2022-02-02T18:23:01.813 INFO:tasks.workunit.client.1.smithi159.stdout:6/527: write df/d35/d2a/d3f/d55/d6a/d6e/f9c [1044932,74504] 0 2022-02-02T18:23:01.813 INFO:tasks.workunit.client.1.smithi159.stdout:6/528: readlink df/d35/d2a/d3f/d42/d47/d59/d66/d6b/lae 0 2022-02-02T18:23:01.817 INFO:tasks.workunit.client.1.smithi159.stdout:8/399: dread d1/dd/d1a/d53/f80 [4194304,4194304] 0 2022-02-02T18:23:01.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/529: write df/d35/f78 [1585485,53430] 0 2022-02-02T18:23:01.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/530: symlink df/d35/da2/laf 0 2022-02-02T18:23:01.824 INFO:tasks.workunit.client.1.smithi159.stdout:6/531: chown df/f1e 507019434 1 2022-02-02T18:23:01.824 INFO:tasks.workunit.client.1.smithi159.stdout:6/532: chown df/d35/c21 47807 1 2022-02-02T18:23:01.833 INFO:tasks.workunit.client.1.smithi159.stdout:6/533: dread df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:23:01.833 INFO:tasks.workunit.client.1.smithi159.stdout:6/534: dread - df/d35/d2a/d2f/d80/d61/f69 zero size 2022-02-02T18:23:01.834 INFO:tasks.workunit.client.1.smithi159.stdout:6/535: chown df/d35/d2a/d3f/d42/d47/d59/d66/d6b/f8a 12 1 2022-02-02T18:23:01.834 INFO:tasks.workunit.client.1.smithi159.stdout:6/536: getdents df/d35/d2a/d3f/d91 0 2022-02-02T18:23:01.834 INFO:tasks.workunit.client.1.smithi159.stdout:6/537: creat df/d35/d2a/d3f/d55/d6a/d6e/fb0 x:0 0 0 2022-02-02T18:23:01.835 INFO:tasks.workunit.client.1.smithi159.stdout:6/538: rename df/d35/d2a/d3f/d42/d47/d59/d66/l67 to df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/lb1 0 2022-02-02T18:23:01.857 INFO:tasks.workunit.client.1.smithi159.stdout:6/539: dwrite f1 [4194304,4194304] 0 2022-02-02T18:23:01.860 INFO:tasks.workunit.client.1.smithi159.stdout:6/540: write df/d35/d2a/f7a [17121,117274] 0 2022-02-02T18:23:01.862 INFO:tasks.workunit.client.1.smithi159.stdout:6/541: creat df/d35/d2a/d3f/d42/d47/fb2 x:0 0 0 2022-02-02T18:23:01.863 INFO:tasks.workunit.client.1.smithi159.stdout:6/542: creat df/d35/d2a/d3f/d42/d47/d59/fb3 x:0 0 0 2022-02-02T18:23:01.866 INFO:tasks.workunit.client.1.smithi159.stdout:6/543: rename df/d35/d2a/d3f/d42/d47/d59/d66/d6b to df/d35/d7b/db4 0 2022-02-02T18:23:01.868 INFO:tasks.workunit.client.1.smithi159.stdout:6/544: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d88/db5 0 2022-02-02T18:23:01.874 INFO:tasks.workunit.client.1.smithi159.stdout:0/434: sync 2022-02-02T18:23:01.876 INFO:tasks.workunit.client.1.smithi159.stdout:0/435: rename d1/dd/l96 to d1/d11/d38/d7c/l9e 0 2022-02-02T18:23:01.895 INFO:tasks.workunit.client.1.smithi159.stdout:0/436: dwrite d1/d11/d38/f4c [4194304,4194304] 0 2022-02-02T18:23:01.899 INFO:tasks.workunit.client.1.smithi159.stdout:0/437: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:01.919 INFO:tasks.workunit.client.1.smithi159.stdout:0/438: dwrite d1/f3 [0,4194304] 0 2022-02-02T18:23:01.935 INFO:tasks.workunit.client.1.smithi159.stdout:0/439: dwrite d1/d11/d1d/d34/f83 [0,4194304] 0 2022-02-02T18:23:01.937 INFO:tasks.workunit.client.1.smithi159.stdout:0/440: link d1/d11/d1d/d34/f71 d1/d11/d38/d7e/f9f 0 2022-02-02T18:23:01.939 INFO:tasks.workunit.client.1.smithi159.stdout:0/441: mkdir d1/d11/d1d/d34/da0 0 2022-02-02T18:23:01.939 INFO:tasks.workunit.client.1.smithi159.stdout:0/442: fdatasync d1/dd/f4f 0 2022-02-02T18:23:01.942 INFO:tasks.workunit.client.1.smithi159.stdout:0/443: rename d1/f3c to d1/dd/d4b/d7d/fa1 0 2022-02-02T18:23:01.943 INFO:tasks.workunit.client.1.smithi159.stdout:0/444: fdatasync d1/dd/f8c 0 2022-02-02T18:23:01.944 INFO:tasks.workunit.client.1.smithi159.stdout:0/445: fdatasync d1/d11/d1d/f44 0 2022-02-02T18:23:01.945 INFO:tasks.workunit.client.1.smithi159.stdout:0/446: symlink d1/d11/d38/d42/d47/la2 0 2022-02-02T18:23:01.946 INFO:tasks.workunit.client.1.smithi159.stdout:0/447: getdents d1/d11 0 2022-02-02T18:23:01.951 INFO:tasks.workunit.client.1.smithi159.stdout:0/448: write d1/dd/d4b/d7d/fa1 [726532,10963] 0 2022-02-02T18:23:01.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/449: truncate d1/d11/d38/d42/d56/f72 805593 0 2022-02-02T18:23:01.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/450: creat d1/d11/d38/d7c/fa3 x:0 0 0 2022-02-02T18:23:01.953 INFO:tasks.workunit.client.1.smithi159.stdout:0/451: mknod d1/dd/ca4 0 2022-02-02T18:23:01.963 INFO:tasks.workunit.client.1.smithi159.stdout:0/452: dread d1/f3 [4194304,4194304] 0 2022-02-02T18:23:01.964 INFO:tasks.workunit.client.1.smithi159.stdout:0/453: creat d1/dd/fa5 x:0 0 0 2022-02-02T18:23:01.967 INFO:tasks.workunit.client.1.smithi159.stdout:0/454: dread d1/dd/f33 [0,4194304] 0 2022-02-02T18:23:01.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/455: rmdir d1 39 2022-02-02T18:23:01.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/456: chown d1/dd/f33 0 1 2022-02-02T18:23:01.969 INFO:tasks.workunit.client.1.smithi159.stdout:0/457: symlink d1/la6 0 2022-02-02T18:23:01.971 INFO:tasks.workunit.client.1.smithi159.stdout:0/458: mkdir d1/dd/d4b/da7 0 2022-02-02T18:23:01.977 INFO:tasks.workunit.client.1.smithi159.stdout:0/459: write d1/d11/d38/d7e/f9f [4158595,19879] 0 2022-02-02T18:23:01.978 INFO:tasks.workunit.client.1.smithi159.stdout:0/460: mkdir d1/dd/d4b/da7/da8 0 2022-02-02T18:23:01.980 INFO:tasks.workunit.client.1.smithi159.stdout:0/461: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:01.981 INFO:tasks.workunit.client.1.smithi159.stdout:0/462: symlink d1/dd/d4b/d7d/la9 0 2022-02-02T18:23:01.982 INFO:tasks.workunit.client.1.smithi159.stdout:0/463: rename d1/d11/d38/d42/d47/f51 to d1/d11/d38/faa 0 2022-02-02T18:23:01.984 INFO:tasks.workunit.client.1.smithi159.stdout:0/464: rename d1/d19/d3d/l66 to d1/d11/d1d/lab 0 2022-02-02T18:23:01.985 INFO:tasks.workunit.client.1.smithi159.stdout:0/465: creat d1/d11/d38/d94/fac x:0 0 0 2022-02-02T18:23:01.986 INFO:tasks.workunit.client.1.smithi159.stdout:0/466: truncate d1/dd/f8c 274531 0 2022-02-02T18:23:01.986 INFO:tasks.workunit.client.1.smithi159.stdout:0/467: rename d1/d11/d1d/d34/c80 to d1/d11/d38/d7e/cad 0 2022-02-02T18:23:01.988 INFO:tasks.workunit.client.1.smithi159.stdout:0/468: rename d1/dd/f7f to d1/d11/d38/d94/fae 0 2022-02-02T18:23:01.988 INFO:tasks.workunit.client.1.smithi159.stdout:0/469: write d1/d19/d3d/f7b [535603,113304] 0 2022-02-02T18:23:01.989 INFO:tasks.workunit.client.1.smithi159.stdout:0/470: read - d1/d11/d1d/f5e zero size 2022-02-02T18:23:01.996 INFO:tasks.workunit.client.1.smithi159.stdout:0/471: rename d1/d11/d1d to d1/d11/d38/d42/daf 0 2022-02-02T18:23:01.997 INFO:tasks.workunit.client.1.smithi159.stdout:0/472: fsync d1/d19/d3d/f76 0 2022-02-02T18:23:01.997 INFO:tasks.workunit.client.1.smithi159.stdout:0/473: fdatasync d1/d19/d3d/f76 0 2022-02-02T18:23:01.998 INFO:tasks.workunit.client.1.smithi159.stdout:0/474: write d1/d11/d38/d42/daf/d34/f4a [1461558,108108] 0 2022-02-02T18:23:01.998 INFO:tasks.workunit.client.1.smithi159.stdout:0/475: readlink d1/d11/d38/d42/l8a 0 2022-02-02T18:23:01.999 INFO:tasks.workunit.client.1.smithi159.stdout:0/476: rmdir d1/d11/d38/d7e 39 2022-02-02T18:23:02.001 INFO:tasks.workunit.client.1.smithi159.stdout:0/477: mkdir d1/d11/d38/d42/d47/db0 0 2022-02-02T18:23:02.001 INFO:tasks.workunit.client.1.smithi159.stdout:0/478: fdatasync d1/d11/d38/d42/daf/d34/f85 0 2022-02-02T18:23:02.002 INFO:tasks.workunit.client.1.smithi159.stdout:0/479: dread d1/dd/f8c [0,4194304] 0 2022-02-02T18:23:02.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/480: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:02.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/481: chown d1/dd/d4b 31 1 2022-02-02T18:23:02.004 INFO:tasks.workunit.client.1.smithi159.stdout:0/482: creat d1/d11/d8d/fb1 x:0 0 0 2022-02-02T18:23:02.005 INFO:tasks.workunit.client.1.smithi159.stdout:0/483: creat d1/dd/d4b/d7d/fb2 x:0 0 0 2022-02-02T18:23:02.007 INFO:tasks.workunit.client.1.smithi159.stdout:0/484: dread d1/d19/d3d/f41 [0,4194304] 0 2022-02-02T18:23:02.009 INFO:tasks.workunit.client.1.smithi159.stdout:0/485: write d1/d19/f39 [3978666,58852] 0 2022-02-02T18:23:02.009 INFO:tasks.workunit.client.1.smithi159.stdout:0/486: truncate d1/dd/f8c 1307105 0 2022-02-02T18:23:02.030 INFO:tasks.workunit.client.1.smithi159.stdout:0/487: dwrite d1/d11/d38/d42/daf/d34/f4a [0,4194304] 0 2022-02-02T18:23:02.036 INFO:tasks.workunit.client.1.smithi159.stdout:0/488: rename d1/dd/d4b/l70 to d1/d19/lb3 0 2022-02-02T18:23:02.047 INFO:tasks.workunit.client.1.smithi159.stdout:0/489: dread d1/d11/d38/d42/d56/f97 [0,4194304] 0 2022-02-02T18:23:02.063 INFO:tasks.workunit.client.1.smithi159.stdout:0/490: dwrite d1/d19/f29 [4194304,4194304] 0 2022-02-02T18:23:02.066 INFO:tasks.workunit.client.1.smithi159.stdout:0/491: fsync d1/dd/d4b/d7d/fa1 0 2022-02-02T18:23:02.067 INFO:tasks.workunit.client.1.smithi159.stdout:0/492: creat d1/dd/d4b/d7d/fb4 x:0 0 0 2022-02-02T18:23:02.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/493: mkdir d1/d11/d38/d42/db5 0 2022-02-02T18:23:02.070 INFO:tasks.workunit.client.1.smithi159.stdout:0/494: symlink d1/dd/d4b/d7d/lb6 0 2022-02-02T18:23:02.073 INFO:tasks.workunit.client.1.smithi159.stdout:7/605: sync 2022-02-02T18:23:02.073 INFO:tasks.workunit.client.1.smithi159.stdout:5/561: sync 2022-02-02T18:23:02.073 INFO:tasks.workunit.client.1.smithi159.stdout:9/481: sync 2022-02-02T18:23:02.074 INFO:tasks.workunit.client.1.smithi159.stdout:2/541: sync 2022-02-02T18:23:02.076 INFO:tasks.workunit.client.1.smithi159.stdout:2/542: symlink da/d1c/d47/d6b/d5a/d7e/lc4 0 2022-02-02T18:23:02.076 INFO:tasks.workunit.client.1.smithi159.stdout:2/543: chown da/d40/d61/f8f 478339303 1 2022-02-02T18:23:02.077 INFO:tasks.workunit.client.1.smithi159.stdout:7/606: write d3/d27/d29/d6b/dc5/f93 [1813343,26047] 0 2022-02-02T18:23:02.077 INFO:tasks.workunit.client.1.smithi159.stdout:7/607: truncate d3/d5/d56/d2f/d5b/dab/fb6 490750 0 2022-02-02T18:23:02.077 INFO:tasks.workunit.client.1.smithi159.stdout:2/544: creat da/d1c/d25/fc5 x:0 0 0 2022-02-02T18:23:02.091 INFO:tasks.workunit.client.1.smithi159.stdout:9/482: dread d4/d19/d1c/d1f/f3f [0,4194304] 0 2022-02-02T18:23:02.093 INFO:tasks.workunit.client.1.smithi159.stdout:9/483: dread d4/d19/d1c/d21/f45 [0,4194304] 0 2022-02-02T18:23:02.093 INFO:tasks.workunit.client.1.smithi159.stdout:9/484: stat d4/d19/d1c/d1f/d4c 0 2022-02-02T18:23:02.093 INFO:tasks.workunit.client.1.smithi159.stdout:9/485: write d4/d19/d1c/d21/d95/f8c [947082,46747] 0 2022-02-02T18:23:02.094 INFO:tasks.workunit.client.1.smithi159.stdout:9/486: creat d4/d19/d1c/d21/d56/f9e x:0 0 0 2022-02-02T18:23:02.095 INFO:tasks.workunit.client.1.smithi159.stdout:9/487: chown d4/c60 1019432298 1 2022-02-02T18:23:02.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/545: write da/d48/d6d/d3e/f56 [1903868,117979] 0 2022-02-02T18:23:02.102 INFO:tasks.workunit.client.1.smithi159.stdout:0/495: dwrite d1/d11/d38/d42/daf/f5e [0,4194304] 0 2022-02-02T18:23:02.103 INFO:tasks.workunit.client.1.smithi159.stdout:2/546: unlink da/d40/lbe 0 2022-02-02T18:23:02.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/562: dwrite d9/d24/d37/d23/d68/f7e [0,4194304] 0 2022-02-02T18:23:02.105 INFO:tasks.workunit.client.1.smithi159.stdout:5/563: chown d9 5253962 1 2022-02-02T18:23:02.105 INFO:tasks.workunit.client.1.smithi159.stdout:2/547: stat da/d1c/d42/d45/c4d 0 2022-02-02T18:23:02.106 INFO:tasks.workunit.client.1.smithi159.stdout:0/496: rename d1/d19/f29 to d1/d11/d38/d42/daf/d34/da0/fb7 0 2022-02-02T18:23:02.106 INFO:tasks.workunit.client.1.smithi159.stdout:9/488: write d4/d19/d1c/d1f/f3c [497818,4360] 0 2022-02-02T18:23:02.107 INFO:tasks.workunit.client.1.smithi159.stdout:2/548: mknod da/d48/d6d/d3e/cc6 0 2022-02-02T18:23:02.109 INFO:tasks.workunit.client.1.smithi159.stdout:9/489: mknod d4/d19/d1c/d21/d56/d59/c9f 0 2022-02-02T18:23:02.109 INFO:tasks.workunit.client.1.smithi159.stdout:9/490: truncate d4/d19/d1c/d1f/d4c/f86 4561701 0 2022-02-02T18:23:02.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/497: readlink d1/l2e 0 2022-02-02T18:23:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:0/498: truncate d1/dd/f8c 2344965 0 2022-02-02T18:23:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:0/499: stat d1/d11/d38/d42 0 2022-02-02T18:23:02.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/564: chown d9/d24/d38/d3c/d61/l4e 491175 1 2022-02-02T18:23:02.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/565: stat d9 0 2022-02-02T18:23:02.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/566: write d9/d2e/d63/fa5 [715612,92280] 0 2022-02-02T18:23:02.112 INFO:tasks.workunit.client.1.smithi159.stdout:9/491: write d4/d2a/f6e [2808233,35589] 0 2022-02-02T18:23:02.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/500: write d1/f2c [341415,2604] 0 2022-02-02T18:23:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/492: mknod d4/d19/d1c/d1f/d90/ca0 0 2022-02-02T18:23:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/493: readlink d4/d19/d1c/l97 0 2022-02-02T18:23:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/494: mkdir d4/d2a/d87/da1 0 2022-02-02T18:23:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/495: read - d4/d19/d1c/d21/d56/f9e zero size 2022-02-02T18:23:02.114 INFO:tasks.workunit.client.1.smithi159.stdout:5/567: symlink d9/la8 0 2022-02-02T18:23:02.116 INFO:tasks.workunit.client.1.smithi159.stdout:0/501: symlink d1/d11/d38/lb8 0 2022-02-02T18:23:02.116 INFO:tasks.workunit.client.1.smithi159.stdout:9/496: mknod d4/d19/d42/ca2 0 2022-02-02T18:23:02.117 INFO:tasks.workunit.client.1.smithi159.stdout:0/502: mknod d1/d11/d38/d7c/cb9 0 2022-02-02T18:23:02.118 INFO:tasks.workunit.client.1.smithi159.stdout:0/503: fsync d1/d11/d38/f53 0 2022-02-02T18:23:02.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/504: symlink d1/d11/d38/d42/lba 0 2022-02-02T18:23:02.124 INFO:tasks.workunit.client.1.smithi159.stdout:9/497: write d4/d19/d1c/d1f/f24 [1199811,108055] 0 2022-02-02T18:23:02.131 INFO:tasks.workunit.client.1.smithi159.stdout:9/498: dread d4/d2a/f2e [0,4194304] 0 2022-02-02T18:23:02.132 INFO:tasks.workunit.client.1.smithi159.stdout:9/499: symlink d4/d19/d1c/d1f/d90/la3 0 2022-02-02T18:23:02.146 INFO:tasks.workunit.client.1.smithi159.stdout:9/500: dwrite d4/d19/d1c/d21/d95/f6d [0,4194304] 0 2022-02-02T18:23:02.149 INFO:tasks.workunit.client.1.smithi159.stdout:9/501: symlink d4/d19/d1c/d21/d56/la4 0 2022-02-02T18:23:02.162 INFO:tasks.workunit.client.1.smithi159.stdout:3/398: sync 2022-02-02T18:23:02.162 INFO:tasks.workunit.client.1.smithi159.stdout:3/399: fsync fc 0 2022-02-02T18:23:02.185 INFO:tasks.workunit.client.1.smithi159.stdout:9/502: dwrite d4/d19/d1c/d21/d41/f68 [0,4194304] 0 2022-02-02T18:23:02.186 INFO:tasks.workunit.client.1.smithi159.stdout:3/400: dwrite dd/d19/d38/d3f/d52/f5b [0,4194304] 0 2022-02-02T18:23:02.188 INFO:tasks.workunit.client.1.smithi159.stdout:3/401: chown dd/l62 617704 1 2022-02-02T18:23:02.271 INFO:tasks.workunit.client.1.smithi159.stdout:9/503: rmdir d4/d19 39 2022-02-02T18:23:02.272 INFO:tasks.workunit.client.1.smithi159.stdout:9/504: write d4/d19/d1c/d1f/f3f [3734849,48146] 0 2022-02-02T18:23:02.272 INFO:tasks.workunit.client.1.smithi159.stdout:9/505: write d4/d19/d1c/d21/d56/d59/f7d [4753458,39851] 0 2022-02-02T18:23:02.275 INFO:tasks.workunit.client.1.smithi159.stdout:9/506: mknod d4/d19/d1c/d21/d22/ca5 0 2022-02-02T18:23:02.275 INFO:tasks.workunit.client.1.smithi159.stdout:9/507: fsync d4/d19/d1c/d1f/f20 0 2022-02-02T18:23:02.277 INFO:tasks.workunit.client.1.smithi159.stdout:9/508: creat d4/d2a/d87/da1/fa6 x:0 0 0 2022-02-02T18:23:02.283 INFO:tasks.workunit.client.1.smithi159.stdout:3/402: dread dd/f18 [0,4194304] 0 2022-02-02T18:23:02.286 INFO:tasks.workunit.client.1.smithi159.stdout:3/403: fdatasync dd/d20/f64 0 2022-02-02T18:23:02.296 INFO:tasks.workunit.client.1.smithi159.stdout:9/509: dwrite d4/d19/d1c/d1f/d4c/f86 [4194304,4194304] 0 2022-02-02T18:23:02.296 INFO:tasks.workunit.client.1.smithi159.stdout:3/404: dread dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:23:02.299 INFO:tasks.workunit.client.1.smithi159.stdout:3/405: link dd/d20/d2a/f75 dd/d66/d69/d77/f7f 0 2022-02-02T18:23:02.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/406: rename dd/d19/d35/d53 to dd/d19/d38/d3f/d80 0 2022-02-02T18:23:02.303 INFO:tasks.workunit.client.1.smithi159.stdout:3/407: getdents dd/d20/d2a 0 2022-02-02T18:23:02.313 INFO:tasks.workunit.client.1.smithi159.stdout:9/510: dwrite d4/d2a/f34 [4194304,4194304] 0 2022-02-02T18:23:02.316 INFO:tasks.workunit.client.1.smithi159.stdout:9/511: creat d4/d19/d6f/d78/fa7 x:0 0 0 2022-02-02T18:23:02.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/408: write dd/d19/d35/f44 [2487583,36576] 0 2022-02-02T18:23:02.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/512: dwrite d4/d19/d1c/d1f/d4c/f86 [0,4194304] 0 2022-02-02T18:23:02.335 INFO:tasks.workunit.client.1.smithi159.stdout:9/513: mkdir d4/d19/d1c/d21/da8 0 2022-02-02T18:23:02.336 INFO:tasks.workunit.client.1.smithi159.stdout:9/514: chown d4/d19/d1c/l66 5120 1 2022-02-02T18:23:02.338 INFO:tasks.workunit.client.1.smithi159.stdout:9/515: write d4/d19/d1c/d21/d95/f6d [3640405,4904] 0 2022-02-02T18:23:02.339 INFO:tasks.workunit.client.1.smithi159.stdout:9/516: write d4/d19/d42/f85 [570565,53029] 0 2022-02-02T18:23:02.339 INFO:tasks.workunit.client.1.smithi159.stdout:3/409: dread dd/d19/f2b [0,4194304] 0 2022-02-02T18:23:02.342 INFO:tasks.workunit.client.1.smithi159.stdout:3/410: dread dd/d20/d2a/d3a/f45 [0,4194304] 0 2022-02-02T18:23:02.343 INFO:tasks.workunit.client.1.smithi159.stdout:3/411: chown dd/d19/d35/f4f 1 1 2022-02-02T18:23:02.346 INFO:tasks.workunit.client.1.smithi159.stdout:3/412: link dd/d20/d2a/d3a/c3b dd/d19/d38/d3f/d7d/c81 0 2022-02-02T18:23:02.346 INFO:tasks.workunit.client.1.smithi159.stdout:3/413: chown dd/d19/c61 0 1 2022-02-02T18:23:02.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/517: dwrite d4/f10 [0,4194304] 0 2022-02-02T18:23:02.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/518: chown d4/d19/d6f/d78/fa7 24 1 2022-02-02T18:23:02.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/414: dwrite fc [0,4194304] 0 2022-02-02T18:23:02.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/519: write d4/d19/f57 [935032,103016] 0 2022-02-02T18:23:02.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/520: truncate d4/d19/d6f/d74/f8f 1082616 0 2022-02-02T18:23:02.369 INFO:tasks.workunit.client.1.smithi159.stdout:3/415: stat dd/d20/c27 0 2022-02-02T18:23:02.370 INFO:tasks.workunit.client.1.smithi159.stdout:9/521: creat d4/d2a/fa9 x:0 0 0 2022-02-02T18:23:02.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/416: mkdir dd/d66/d82 0 2022-02-02T18:23:02.377 INFO:tasks.workunit.client.1.smithi159.stdout:4/458: sync 2022-02-02T18:23:02.377 INFO:tasks.workunit.client.1.smithi159.stdout:9/522: rename d4/d19/d1c/l73 to d4/d19/d1c/d21/d22/laa 0 2022-02-02T18:23:02.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/523: chown d4/c77 506959962 1 2022-02-02T18:23:02.381 INFO:tasks.workunit.client.1.smithi159.stdout:3/417: symlink dd/d66/d69/l83 0 2022-02-02T18:23:02.383 INFO:tasks.workunit.client.1.smithi159.stdout:4/459: getdents d0/d8/d15/d61 0 2022-02-02T18:23:02.389 INFO:tasks.workunit.client.1.smithi159.stdout:9/524: symlink d4/d19/d6f/d78/lab 0 2022-02-02T18:23:02.389 INFO:tasks.workunit.client.1.smithi159.stdout:3/418: creat dd/d66/d69/f84 x:0 0 0 2022-02-02T18:23:02.397 INFO:tasks.workunit.client.1.smithi159.stdout:1/447: sync 2022-02-02T18:23:02.398 INFO:tasks.workunit.client.1.smithi159.stdout:7/608: sync 2022-02-02T18:23:02.398 INFO:tasks.workunit.client.1.smithi159.stdout:6/545: sync 2022-02-02T18:23:02.398 INFO:tasks.workunit.client.1.smithi159.stdout:8/400: sync 2022-02-02T18:23:02.398 INFO:tasks.workunit.client.1.smithi159.stdout:8/401: getdents d1/dd/d2c/d67/d5f/d8a 0 2022-02-02T18:23:02.399 INFO:tasks.workunit.client.1.smithi159.stdout:8/402: fdatasync d1/dc/f41 0 2022-02-02T18:23:02.399 INFO:tasks.workunit.client.1.smithi159.stdout:1/448: write df/d14/d16/f45 [4980348,49056] 0 2022-02-02T18:23:02.399 INFO:tasks.workunit.client.1.smithi159.stdout:1/449: readlink df/d14/d16/d4b/l94 0 2022-02-02T18:23:02.402 INFO:tasks.workunit.client.1.smithi159.stdout:6/546: creat df/d35/d2a/d3f/d55/d6a/d6e/fb6 x:0 0 0 2022-02-02T18:23:02.407 INFO:tasks.workunit.client.1.smithi159.stdout:1/450: rmdir df/d21/d23/d49/d69 39 2022-02-02T18:23:02.408 INFO:tasks.workunit.client.1.smithi159.stdout:7/609: truncate d3/d27/d29/f61 4021591 0 2022-02-02T18:23:02.409 INFO:tasks.workunit.client.1.smithi159.stdout:7/610: dread - d3/d6/fc0 zero size 2022-02-02T18:23:02.409 INFO:tasks.workunit.client.1.smithi159.stdout:1/451: creat df/d14/d16/d4b/da0/fa2 x:0 0 0 2022-02-02T18:23:02.410 INFO:tasks.workunit.client.1.smithi159.stdout:3/419: rename dd/f1f to dd/d20/d60/f85 0 2022-02-02T18:23:02.411 INFO:tasks.workunit.client.1.smithi159.stdout:6/547: symlink df/d35/d7b/db4/lb7 0 2022-02-02T18:23:02.413 INFO:tasks.workunit.client.1.smithi159.stdout:7/611: write d3/d5/f20 [1964659,42148] 0 2022-02-02T18:23:02.413 INFO:tasks.workunit.client.1.smithi159.stdout:7/612: chown d3/d5/d56/d2f/d5b/dab/cc6 587733506 1 2022-02-02T18:23:02.413 INFO:tasks.workunit.client.1.smithi159.stdout:3/420: mkdir dd/d19/d38/d3f/d7d/d86 0 2022-02-02T18:23:02.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/548: readlink df/d35/d2a/d3f/l50 0 2022-02-02T18:23:02.414 INFO:tasks.workunit.client.1.smithi159.stdout:7/613: truncate d3/d5/d56/d57/f11 1984824 0 2022-02-02T18:23:02.417 INFO:tasks.workunit.client.1.smithi159.stdout:6/549: creat df/d35/d7b/db4/d84/d9d/fb8 x:0 0 0 2022-02-02T18:23:02.417 INFO:tasks.workunit.client.1.smithi159.stdout:6/550: dread - df/d35/d2a/d2f/fad zero size 2022-02-02T18:23:02.417 INFO:tasks.workunit.client.1.smithi159.stdout:1/452: dread df/d14/d16/d4b/d5b/f2e [0,4194304] 0 2022-02-02T18:23:02.424 INFO:tasks.workunit.client.1.smithi159.stdout:7/614: rename d3/d5/d56/f81 to d3/d2a/d2c/fcb 0 2022-02-02T18:23:02.424 INFO:tasks.workunit.client.1.smithi159.stdout:6/551: mknod df/d35/d2a/d3f/d42/d47/d59/d66/d88/cb9 0 2022-02-02T18:23:02.425 INFO:tasks.workunit.client.1.smithi159.stdout:6/552: fdatasync df/d35/d2a/d3f/d65/f6c 0 2022-02-02T18:23:02.425 INFO:tasks.workunit.client.1.smithi159.stdout:6/553: chown df/d35 2655256 1 2022-02-02T18:23:02.425 INFO:tasks.workunit.client.1.smithi159.stdout:1/453: unlink df/d14/c3e 0 2022-02-02T18:23:02.426 INFO:tasks.workunit.client.1.smithi159.stdout:9/525: dwrite d4/d19/d1c/d1f/f4d [0,4194304] 0 2022-02-02T18:23:02.426 INFO:tasks.workunit.client.1.smithi159.stdout:8/403: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:23:02.426 INFO:tasks.workunit.client.1.smithi159.stdout:7/615: rename d3/d2a/d4a/d79 to d3/d2a/dcc 0 2022-02-02T18:23:02.428 INFO:tasks.workunit.client.1.smithi159.stdout:8/404: symlink d1/dd/d2c/l8d 0 2022-02-02T18:23:02.429 INFO:tasks.workunit.client.1.smithi159.stdout:8/405: chown d1/d26/d48/d49/c7d 2076820 1 2022-02-02T18:23:02.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/526: link d4/d19/l3b d4/d19/d1c/d21/da8/lac 0 2022-02-02T18:23:02.432 INFO:tasks.workunit.client.1.smithi159.stdout:8/406: rename d1/l9 to d1/dc/l8e 0 2022-02-02T18:23:02.434 INFO:tasks.workunit.client.1.smithi159.stdout:6/554: rmdir df/d35/d2a/d2f 39 2022-02-02T18:23:02.436 INFO:tasks.workunit.client.1.smithi159.stdout:7/616: link d3/d5/d56/c23 d3/d5/d56/ccd 0 2022-02-02T18:23:02.437 INFO:tasks.workunit.client.1.smithi159.stdout:6/555: rmdir df/d35/d2a/d3f/d55/d6a 39 2022-02-02T18:23:02.437 INFO:tasks.workunit.client.1.smithi159.stdout:6/556: readlink df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/lb1 0 2022-02-02T18:23:02.439 INFO:tasks.workunit.client.1.smithi159.stdout:6/557: creat df/d35/d2a/d3f/d65/fba x:0 0 0 2022-02-02T18:23:02.441 INFO:tasks.workunit.client.1.smithi159.stdout:9/527: rename d4/d19/d1c/d21/d56/d59/f80 to d4/d19/d42/fad 0 2022-02-02T18:23:02.442 INFO:tasks.workunit.client.1.smithi159.stdout:3/421: dwrite dd/d19/f46 [0,4194304] 0 2022-02-02T18:23:02.443 INFO:tasks.workunit.client.1.smithi159.stdout:6/558: mknod df/d35/d2a/d3f/d42/d47/cbb 0 2022-02-02T18:23:02.443 INFO:tasks.workunit.client.1.smithi159.stdout:6/559: chown df/d35/d2a/d3f/d55/d6a/d6e/f9f 230130 1 2022-02-02T18:23:02.445 INFO:tasks.workunit.client.1.smithi159.stdout:3/422: readlink dd/l13 0 2022-02-02T18:23:02.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/454: dwrite df/d14/d16/f38 [0,4194304] 0 2022-02-02T18:23:02.447 INFO:tasks.workunit.client.1.smithi159.stdout:3/423: truncate dd/f34 376091 0 2022-02-02T18:23:02.448 INFO:tasks.workunit.client.1.smithi159.stdout:3/424: write dd/d66/d69/f84 [856164,125616] 0 2022-02-02T18:23:02.450 INFO:tasks.workunit.client.1.smithi159.stdout:9/528: write d4/d19/d1c/d21/d95/f6d [2586609,83299] 0 2022-02-02T18:23:02.451 INFO:tasks.workunit.client.1.smithi159.stdout:8/407: write d1/dd/f29 [1016992,83450] 0 2022-02-02T18:23:02.455 INFO:tasks.workunit.client.1.smithi159.stdout:9/529: mknod d4/d19/d6f/d78/cae 0 2022-02-02T18:23:02.456 INFO:tasks.workunit.client.1.smithi159.stdout:3/425: symlink dd/d19/d38/d3f/d80/l87 0 2022-02-02T18:23:02.456 INFO:tasks.workunit.client.1.smithi159.stdout:3/426: write dd/d19/d38/f3d [5229928,41296] 0 2022-02-02T18:23:02.458 INFO:tasks.workunit.client.1.smithi159.stdout:1/455: dread df/d14/d16/f7e [0,4194304] 0 2022-02-02T18:23:02.459 INFO:tasks.workunit.client.1.smithi159.stdout:1/456: fdatasync df/d14/d16/d4a/f59 0 2022-02-02T18:23:02.465 INFO:tasks.workunit.client.1.smithi159.stdout:8/408: read d1/dd/d2c/f42 [4890005,20726] 0 2022-02-02T18:23:02.465 INFO:tasks.workunit.client.1.smithi159.stdout:8/409: fsync d1/dd/f16 0 2022-02-02T18:23:02.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/560: dread df/d35/d2a/d3f/d55/d6a/d6e/f9c [0,4194304] 0 2022-02-02T18:23:02.466 INFO:tasks.workunit.client.1.smithi159.stdout:7/617: dread d3/d2a/dcc/d8b/d8c/f92 [0,4194304] 0 2022-02-02T18:23:02.466 INFO:tasks.workunit.client.1.smithi159.stdout:3/427: write dd/d19/f4e [3032492,5945] 0 2022-02-02T18:23:02.466 INFO:tasks.workunit.client.1.smithi159.stdout:9/530: mkdir d4/d19/d42/daf 0 2022-02-02T18:23:02.468 INFO:tasks.workunit.client.1.smithi159.stdout:7/618: rmdir d3/d2a/dcc 39 2022-02-02T18:23:02.468 INFO:tasks.workunit.client.1.smithi159.stdout:8/410: symlink d1/dc/l8f 0 2022-02-02T18:23:02.469 INFO:tasks.workunit.client.1.smithi159.stdout:9/531: write d4/d19/d1c/f44 [594995,109183] 0 2022-02-02T18:23:02.469 INFO:tasks.workunit.client.1.smithi159.stdout:9/532: chown d4/d19/d1c/d21/d95/f6d 251029180 1 2022-02-02T18:23:02.470 INFO:tasks.workunit.client.1.smithi159.stdout:8/411: mknod d1/dd/d31/d4a/c90 0 2022-02-02T18:23:02.470 INFO:tasks.workunit.client.1.smithi159.stdout:3/428: symlink dd/d19/d38/l88 0 2022-02-02T18:23:02.471 INFO:tasks.workunit.client.1.smithi159.stdout:8/412: unlink d1/dd/d31/d4a/d75/f84 0 2022-02-02T18:23:02.472 INFO:tasks.workunit.client.1.smithi159.stdout:3/429: chown dd/d20/f64 27 1 2022-02-02T18:23:02.474 INFO:tasks.workunit.client.1.smithi159.stdout:8/413: creat d1/dd/d2c/d67/d5d/f91 x:0 0 0 2022-02-02T18:23:02.481 INFO:tasks.workunit.client.1.smithi159.stdout:7/619: dread d3/d5/d56/fad [0,4194304] 0 2022-02-02T18:23:02.482 INFO:tasks.workunit.client.1.smithi159.stdout:3/430: fdatasync dd/d20/d2a/d31/f57 0 2022-02-02T18:23:02.482 INFO:tasks.workunit.client.1.smithi159.stdout:7/620: chown d3/d27 1705909 1 2022-02-02T18:23:02.486 INFO:tasks.workunit.client.1.smithi159.stdout:8/414: dread d1/dd/d2c/d67/f50 [0,4194304] 0 2022-02-02T18:23:02.486 INFO:tasks.workunit.client.1.smithi159.stdout:3/431: creat dd/d20/f89 x:0 0 0 2022-02-02T18:23:02.487 INFO:tasks.workunit.client.1.smithi159.stdout:8/415: creat d1/dd/f92 x:0 0 0 2022-02-02T18:23:02.489 INFO:tasks.workunit.client.1.smithi159.stdout:8/416: symlink d1/dd/d31/d4a/d75/l93 0 2022-02-02T18:23:02.491 INFO:tasks.workunit.client.1.smithi159.stdout:3/432: dread dd/d19/f24 [0,4194304] 0 2022-02-02T18:23:02.493 INFO:tasks.workunit.client.1.smithi159.stdout:8/417: rename d1/dc/c3b to d1/d26/d48/d49/c94 0 2022-02-02T18:23:02.494 INFO:tasks.workunit.client.1.smithi159.stdout:8/418: write d1/dd/d1a/d53/f74 [473407,65940] 0 2022-02-02T18:23:02.494 INFO:tasks.workunit.client.1.smithi159.stdout:8/419: truncate d1/dd/d1a/d53/f60 3599589 0 2022-02-02T18:23:02.497 INFO:tasks.workunit.client.1.smithi159.stdout:3/433: dread dd/d20/d2a/d31/f76 [0,4194304] 0 2022-02-02T18:23:02.497 INFO:tasks.workunit.client.1.smithi159.stdout:6/561: dwrite f3 [0,4194304] 0 2022-02-02T18:23:02.499 INFO:tasks.workunit.client.1.smithi159.stdout:6/562: getdents df/d35/da2 0 2022-02-02T18:23:02.501 INFO:tasks.workunit.client.1.smithi159.stdout:6/563: rmdir df/d35/d2a/d3f/d55/d6a/d6e 39 2022-02-02T18:23:02.502 INFO:tasks.workunit.client.1.smithi159.stdout:6/564: getdents df/d35/d7b/db4/d84 0 2022-02-02T18:23:02.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/434: dread dd/d19/d38/d3f/d52/f5b [0,4194304] 0 2022-02-02T18:23:02.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/533: dwrite d4/f10 [4194304,4194304] 0 2022-02-02T18:23:02.521 INFO:tasks.workunit.client.1.smithi159.stdout:9/534: chown d4/d7a 824122 1 2022-02-02T18:23:02.521 INFO:tasks.workunit.client.1.smithi159.stdout:3/435: getdents dd/d20 0 2022-02-02T18:23:02.523 INFO:tasks.workunit.client.1.smithi159.stdout:9/535: chown d4/d19/d1c/c2c 25889411 1 2022-02-02T18:23:02.524 INFO:tasks.workunit.client.1.smithi159.stdout:3/436: mkdir dd/d19/d38/d3f/d80/d8a 0 2022-02-02T18:23:02.526 INFO:tasks.workunit.client.1.smithi159.stdout:9/536: creat d4/d19/d1c/d21/d56/d59/fb0 x:0 0 0 2022-02-02T18:23:02.527 INFO:tasks.workunit.client.1.smithi159.stdout:3/437: mknod dd/d20/d2a/c8b 0 2022-02-02T18:23:02.528 INFO:tasks.workunit.client.1.smithi159.stdout:3/438: getdents dd/d19/d38/d3f/d7d 0 2022-02-02T18:23:02.530 INFO:tasks.workunit.client.1.smithi159.stdout:7/621: dwrite d3/d27/d29/f76 [0,4194304] 0 2022-02-02T18:23:02.531 INFO:tasks.workunit.client.1.smithi159.stdout:9/537: mkdir d4/d19/d6f/d74/db1 0 2022-02-02T18:23:02.533 INFO:tasks.workunit.client.1.smithi159.stdout:9/538: rmdir d4/d19/d1c/d21 39 2022-02-02T18:23:02.535 INFO:tasks.workunit.client.1.smithi159.stdout:6/565: dwrite df/d35/d2a/d3f/f48 [0,4194304] 0 2022-02-02T18:23:02.535 INFO:tasks.workunit.client.1.smithi159.stdout:6/566: dread - df/d35/d2a/d3f/fab zero size 2022-02-02T18:23:02.535 INFO:tasks.workunit.client.1.smithi159.stdout:7/622: rename d3/d27/d29/d5e/l64 to d3/d27/d29/d5e/lce 0 2022-02-02T18:23:02.536 INFO:tasks.workunit.client.1.smithi159.stdout:7/623: dread - d3/d2a/dcc/d8b/d8c/d99/fb8 zero size 2022-02-02T18:23:02.537 INFO:tasks.workunit.client.1.smithi159.stdout:7/624: write d3/d2a/dcc/d8b/d8c/f92 [1555661,80645] 0 2022-02-02T18:23:02.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/439: write dd/d19/f1e [1749784,101239] 0 2022-02-02T18:23:02.551 INFO:tasks.workunit.client.1.smithi159.stdout:3/440: creat dd/d19/d35/f8c x:0 0 0 2022-02-02T18:23:02.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/441: creat dd/d20/d60/f8d x:0 0 0 2022-02-02T18:23:02.553 INFO:tasks.workunit.client.1.smithi159.stdout:8/420: dwrite d1/dd/d31/f3f [4194304,4194304] 0 2022-02-02T18:23:02.555 INFO:tasks.workunit.client.1.smithi159.stdout:7/625: dwrite d3/d2a/d4a/d7d/fbc [0,4194304] 0 2022-02-02T18:23:02.555 INFO:tasks.workunit.client.1.smithi159.stdout:8/421: unlink d1/dc/l19 0 2022-02-02T18:23:02.558 INFO:tasks.workunit.client.1.smithi159.stdout:3/442: dread dd/d19/f2b [0,4194304] 0 2022-02-02T18:23:02.558 INFO:tasks.workunit.client.1.smithi159.stdout:3/443: chown dd/d19/d38/d3f/d7d 0 1 2022-02-02T18:23:02.559 INFO:tasks.workunit.client.1.smithi159.stdout:8/422: rmdir d1/dd/d1a/d53 39 2022-02-02T18:23:02.559 INFO:tasks.workunit.client.1.smithi159.stdout:8/423: chown d1/dd/d1a/f63 2562712 1 2022-02-02T18:23:02.559 INFO:tasks.workunit.client.1.smithi159.stdout:8/424: chown d1/dd/d2c/d67/d5d/l66 500845 1 2022-02-02T18:23:02.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/425: chown d1/d26 738300 1 2022-02-02T18:23:02.560 INFO:tasks.workunit.client.1.smithi159.stdout:3/444: dread - dd/d19/d38/d3f/f5c zero size 2022-02-02T18:23:02.562 INFO:tasks.workunit.client.1.smithi159.stdout:3/445: link dd/d20/d2a/d31/f76 dd/d20/d2a/d3a/f8e 0 2022-02-02T18:23:02.563 INFO:tasks.workunit.client.1.smithi159.stdout:3/446: readlink dd/d66/d69/l6e 0 2022-02-02T18:23:02.563 INFO:tasks.workunit.client.1.smithi159.stdout:3/447: chown dd/d19/d38 4242402 1 2022-02-02T18:23:02.563 INFO:tasks.workunit.client.1.smithi159.stdout:8/426: rename d1/dd/d2c/d67/d5d to d1/d26/d48/d7f/d89/d95 0 2022-02-02T18:23:02.568 INFO:tasks.workunit.client.1.smithi159.stdout:8/427: dread d1/dd/f16 [0,4194304] 0 2022-02-02T18:23:02.584 INFO:tasks.workunit.client.1.smithi159.stdout:7/626: dwrite d3/d2a/dcc/d8b/d8c/f92 [0,4194304] 0 2022-02-02T18:23:02.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/448: dread f7 [0,4194304] 0 2022-02-02T18:23:02.585 INFO:tasks.workunit.client.1.smithi159.stdout:3/449: creat dd/d19/d35/f8f x:0 0 0 2022-02-02T18:23:02.587 INFO:tasks.workunit.client.1.smithi159.stdout:3/450: truncate dd/d19/d38/d3f/d80/f5a 2156835 0 2022-02-02T18:23:02.587 INFO:tasks.workunit.client.1.smithi159.stdout:3/451: chown dd/d20/d2a/d3a/f8e 511248 1 2022-02-02T18:23:02.588 INFO:tasks.workunit.client.1.smithi159.stdout:3/452: read dd/d19/f4e [2020680,101718] 0 2022-02-02T18:23:02.590 INFO:tasks.workunit.client.1.smithi159.stdout:8/428: dwrite d1/dc/f81 [0,4194304] 0 2022-02-02T18:23:02.594 INFO:tasks.workunit.client.1.smithi159.stdout:8/429: rename d1/d26/l88 to d1/dd/d2c/d67/l96 0 2022-02-02T18:23:02.598 INFO:tasks.workunit.client.1.smithi159.stdout:8/430: link d1/d26/d48/l64 d1/dd/d31/l97 0 2022-02-02T18:23:02.600 INFO:tasks.workunit.client.1.smithi159.stdout:8/431: mkdir d1/d26/d48/d98 0 2022-02-02T18:23:02.602 INFO:tasks.workunit.client.1.smithi159.stdout:8/432: mkdir d1/d26/d48/d99 0 2022-02-02T18:23:02.603 INFO:tasks.workunit.client.1.smithi159.stdout:8/433: getdents d1/dd/d2c/d67/d5f 0 2022-02-02T18:23:02.603 INFO:tasks.workunit.client.1.smithi159.stdout:8/434: dread - d1/dd/d1a/f86 zero size 2022-02-02T18:23:02.606 INFO:tasks.workunit.client.1.smithi159.stdout:7/627: dwrite d3/d2a/dcc/d8b/d8c/f92 [0,4194304] 0 2022-02-02T18:23:02.606 INFO:tasks.workunit.client.1.smithi159.stdout:8/435: unlink d1/dd/d31/c4f 0 2022-02-02T18:23:02.607 INFO:tasks.workunit.client.1.smithi159.stdout:8/436: creat d1/dd/d1a/f9a x:0 0 0 2022-02-02T18:23:02.608 INFO:tasks.workunit.client.1.smithi159.stdout:7/628: creat d3/d27/d6f/fcf x:0 0 0 2022-02-02T18:23:02.608 INFO:tasks.workunit.client.1.smithi159.stdout:7/629: read d3/d2a/d2c/fcb [2954200,19536] 0 2022-02-02T18:23:02.610 INFO:tasks.workunit.client.1.smithi159.stdout:8/437: rename d1/dd/d1a/d53/f60 to d1/d26/d48/d49/f9b 0 2022-02-02T18:23:02.610 INFO:tasks.workunit.client.1.smithi159.stdout:8/438: write d1/dd/d1a/f9a [631795,97440] 0 2022-02-02T18:23:02.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/630: truncate d3/d6/f4d 1760425 0 2022-02-02T18:23:02.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/631: creat d3/d5/d56/d2f/d5b/dab/fd0 x:0 0 0 2022-02-02T18:23:02.612 INFO:tasks.workunit.client.1.smithi159.stdout:7/632: readlink d3/d5/lbd 0 2022-02-02T18:23:02.612 INFO:tasks.workunit.client.1.smithi159.stdout:8/439: truncate d1/d26/d48/f55 155188 0 2022-02-02T18:23:02.612 INFO:tasks.workunit.client.1.smithi159.stdout:8/440: chown d1/dd/d2c/f42 7 1 2022-02-02T18:23:02.613 INFO:tasks.workunit.client.1.smithi159.stdout:8/441: getdents d1/dd 0 2022-02-02T18:23:02.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/453: dwrite dd/d20/d2a/d3a/d51/f7e [0,4194304] 0 2022-02-02T18:23:02.616 INFO:tasks.workunit.client.1.smithi159.stdout:3/454: write dd/d20/d60/f85 [4656884,66177] 0 2022-02-02T18:23:02.616 INFO:tasks.workunit.client.1.smithi159.stdout:3/455: fsync dd/d19/d38/d3f/d52/f58 0 2022-02-02T18:23:02.617 INFO:tasks.workunit.client.1.smithi159.stdout:3/456: creat dd/d20/d2a/d31/f90 x:0 0 0 2022-02-02T18:23:02.618 INFO:tasks.workunit.client.1.smithi159.stdout:3/457: getdents dd/d66 0 2022-02-02T18:23:02.619 INFO:tasks.workunit.client.1.smithi159.stdout:3/458: creat dd/d20/d2a/d3a/f91 x:0 0 0 2022-02-02T18:23:02.628 INFO:tasks.workunit.client.1.smithi159.stdout:3/459: rename dd/d20/d2a/d3a to dd/d66/d92 0 2022-02-02T18:23:02.629 INFO:tasks.workunit.client.1.smithi159.stdout:3/460: chown dd/d66/d92/d51/f7e 13739329 1 2022-02-02T18:23:02.629 INFO:tasks.workunit.client.1.smithi159.stdout:3/461: dread - dd/d20/d2a/d31/f57 zero size 2022-02-02T18:23:02.635 INFO:tasks.workunit.client.1.smithi159.stdout:3/462: dread dd/d66/d69/f79 [0,4194304] 0 2022-02-02T18:23:02.638 INFO:tasks.workunit.client.1.smithi159.stdout:7/633: write d3/d27/d29/f61 [3590724,123440] 0 2022-02-02T18:23:02.639 INFO:tasks.workunit.client.1.smithi159.stdout:8/442: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:23:02.639 INFO:tasks.workunit.client.1.smithi159.stdout:8/443: write d1/dc/f81 [4035574,116723] 0 2022-02-02T18:23:02.641 INFO:tasks.workunit.client.1.smithi159.stdout:7/634: rename d3/d5/d95/fc9 to d3/d5/d56/d2f/fd1 0 2022-02-02T18:23:02.642 INFO:tasks.workunit.client.1.smithi159.stdout:8/444: creat d1/d26/f9c x:0 0 0 2022-02-02T18:23:02.642 INFO:tasks.workunit.client.1.smithi159.stdout:8/445: chown d1/dd/f2f 979708368 1 2022-02-02T18:23:02.644 INFO:tasks.workunit.client.1.smithi159.stdout:7/635: rename d3/d2a/d2c/fcb to d3/d5/d56/d2f/d5b/fd2 0 2022-02-02T18:23:02.655 INFO:tasks.workunit.client.1.smithi159.stdout:7/636: rename d3/d5/d56/d2f/d5b/dab to d3/d2a/d2c/dd3 0 2022-02-02T18:23:02.656 INFO:tasks.workunit.client.1.smithi159.stdout:7/637: dread - d3/d2a/d4a/d7d/fc8 zero size 2022-02-02T18:23:02.676 INFO:tasks.workunit.client.1.smithi159.stdout:8/446: dwrite d1/dd/d1a/f6e [0,4194304] 0 2022-02-02T18:23:02.678 INFO:tasks.workunit.client.1.smithi159.stdout:8/447: read d1/dd/d2c/f42 [3194827,5012] 0 2022-02-02T18:23:02.678 INFO:tasks.workunit.client.1.smithi159.stdout:8/448: stat d1/d26/c38 0 2022-02-02T18:23:02.678 INFO:tasks.workunit.client.1.smithi159.stdout:3/463: dwrite dd/d66/d92/f8e [0,4194304] 0 2022-02-02T18:23:02.678 INFO:tasks.workunit.client.1.smithi159.stdout:7/638: dwrite d3/d5/d56/d2f/fb2 [0,4194304] 0 2022-02-02T18:23:02.679 INFO:tasks.workunit.client.1.smithi159.stdout:7/639: write d3/d5/d56/d2f/f9b [352560,107055] 0 2022-02-02T18:23:02.679 INFO:tasks.workunit.client.1.smithi159.stdout:3/464: creat dd/d66/d92/f93 x:0 0 0 2022-02-02T18:23:02.680 INFO:tasks.workunit.client.1.smithi159.stdout:8/449: unlink d1/dd/d2c/l8d 0 2022-02-02T18:23:02.688 INFO:tasks.workunit.client.1.smithi159.stdout:3/465: mkdir dd/d19/d38/d94 0 2022-02-02T18:23:02.688 INFO:tasks.workunit.client.1.smithi159.stdout:3/466: creat dd/d19/d38/d3f/d7d/f95 x:0 0 0 2022-02-02T18:23:02.688 INFO:tasks.workunit.client.1.smithi159.stdout:3/467: fsync dd/d66/d69/d77/f7f 0 2022-02-02T18:23:02.688 INFO:tasks.workunit.client.1.smithi159.stdout:3/468: chown dd/d66/c7c 259 1 2022-02-02T18:23:02.689 INFO:tasks.workunit.client.1.smithi159.stdout:3/469: readlink la 0 2022-02-02T18:23:02.689 INFO:tasks.workunit.client.1.smithi159.stdout:3/470: chown dd/d20/d2a/f68 978663213 1 2022-02-02T18:23:02.690 INFO:tasks.workunit.client.1.smithi159.stdout:3/471: creat dd/d19/d38/d94/f96 x:0 0 0 2022-02-02T18:23:02.690 INFO:tasks.workunit.client.1.smithi159.stdout:3/472: stat dd/l13 0 2022-02-02T18:23:02.691 INFO:tasks.workunit.client.1.smithi159.stdout:3/473: chown dd/d20/c3e 17 1 2022-02-02T18:23:02.691 INFO:tasks.workunit.client.1.smithi159.stdout:3/474: truncate dd/d19/d38/f55 4229030 0 2022-02-02T18:23:02.695 INFO:tasks.workunit.client.1.smithi159.stdout:3/475: mkdir dd/d19/d38/d3f/d80/d97 0 2022-02-02T18:23:02.696 INFO:tasks.workunit.client.1.smithi159.stdout:3/476: chown dd/d20/d2a/d31/l5e 61089 1 2022-02-02T18:23:02.697 INFO:tasks.workunit.client.1.smithi159.stdout:7/640: dwrite d3/d2a/d2c/dd3/fb6 [0,4194304] 0 2022-02-02T18:23:02.698 INFO:tasks.workunit.client.1.smithi159.stdout:3/477: mknod dd/d19/d38/d3f/d80/d97/c98 0 2022-02-02T18:23:02.700 INFO:tasks.workunit.client.1.smithi159.stdout:8/450: dwrite d1/dd/d1a/d53/f74 [0,4194304] 0 2022-02-02T18:23:02.700 INFO:tasks.workunit.client.1.smithi159.stdout:3/478: creat dd/d19/d35/f99 x:0 0 0 2022-02-02T18:23:02.704 INFO:tasks.workunit.client.1.smithi159.stdout:8/451: mkdir d1/dd/d31/d4a/d75/d9d 0 2022-02-02T18:23:02.705 INFO:tasks.workunit.client.1.smithi159.stdout:8/452: getdents d1/d26/d48/d98 0 2022-02-02T18:23:02.706 INFO:tasks.workunit.client.1.smithi159.stdout:7/641: rename d3/d5/d56/l88 to d3/d5/ld4 0 2022-02-02T18:23:02.706 INFO:tasks.workunit.client.1.smithi159.stdout:3/479: fdatasync dd/d19/d35/f59 0 2022-02-02T18:23:02.706 INFO:tasks.workunit.client.1.smithi159.stdout:3/480: write dd/d66/d92/f45 [921102,100886] 0 2022-02-02T18:23:02.707 INFO:tasks.workunit.client.1.smithi159.stdout:3/481: write dd/d19/d38/d3f/d52/f58 [6564939,7961] 0 2022-02-02T18:23:02.707 INFO:tasks.workunit.client.1.smithi159.stdout:3/482: fdatasync dd/d19/d35/f8f 0 2022-02-02T18:23:02.708 INFO:tasks.workunit.client.1.smithi159.stdout:0/505: sync 2022-02-02T18:23:02.708 INFO:tasks.workunit.client.1.smithi159.stdout:5/568: sync 2022-02-02T18:23:02.708 INFO:tasks.workunit.client.1.smithi159.stdout:2/549: sync 2022-02-02T18:23:02.709 INFO:tasks.workunit.client.1.smithi159.stdout:2/550: dread - da/d1c/d47/d6b/fa9 zero size 2022-02-02T18:23:02.712 INFO:tasks.workunit.client.1.smithi159.stdout:2/551: fsync da/d1c/d47/d6b/d59/fa2 0 2022-02-02T18:23:02.714 INFO:tasks.workunit.client.1.smithi159.stdout:3/483: rmdir dd/d19/d38/d94 39 2022-02-02T18:23:02.714 INFO:tasks.workunit.client.1.smithi159.stdout:8/453: dread d1/dd/d1a/d53/f74 [0,4194304] 0 2022-02-02T18:23:02.715 INFO:tasks.workunit.client.1.smithi159.stdout:8/454: read - d1/dd/d31/d4a/d75/f78 zero size 2022-02-02T18:23:02.715 INFO:tasks.workunit.client.1.smithi159.stdout:7/642: dread d3/d5/d56/d2f/f9b [0,4194304] 0 2022-02-02T18:23:02.715 INFO:tasks.workunit.client.1.smithi159.stdout:7/643: rename d3/d2a/dcc/d8b to d3/d2a/dcc/d8b/d8c/d99/dd5 22 2022-02-02T18:23:02.715 INFO:tasks.workunit.client.1.smithi159.stdout:7/644: chown d3/d5/d56/d2f/f4c 943034850 1 2022-02-02T18:23:02.716 INFO:tasks.workunit.client.1.smithi159.stdout:2/552: chown da/d40/d61/l94 25622 1 2022-02-02T18:23:02.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/645: symlink d3/d27/d6f/da2/ld6 0 2022-02-02T18:23:02.717 INFO:tasks.workunit.client.1.smithi159.stdout:2/553: fdatasync da/d1c/d47/d6b/d7c/f8b 0 2022-02-02T18:23:02.719 INFO:tasks.workunit.client.1.smithi159.stdout:8/455: read d1/d26/d48/d49/f9b [1490143,101817] 0 2022-02-02T18:23:02.720 INFO:tasks.workunit.client.1.smithi159.stdout:8/456: symlink d1/d26/d48/d7f/d89/l9e 0 2022-02-02T18:23:02.722 INFO:tasks.workunit.client.1.smithi159.stdout:8/457: mkdir d1/dd/d31/d4a/d75/d9d/d9f 0 2022-02-02T18:23:02.723 INFO:tasks.workunit.client.1.smithi159.stdout:8/458: dread - d1/dd/d1a/d53/f6d zero size 2022-02-02T18:23:02.723 INFO:tasks.workunit.client.1.smithi159.stdout:8/459: write d1/dd/d1a/d53/f74 [3439380,48051] 0 2022-02-02T18:23:02.724 INFO:tasks.workunit.client.1.smithi159.stdout:8/460: stat d1/d26/d48/d49/c7d 0 2022-02-02T18:23:02.727 INFO:tasks.workunit.client.1.smithi159.stdout:8/461: mknod d1/d26/d48/ca0 0 2022-02-02T18:23:02.729 INFO:tasks.workunit.client.1.smithi159.stdout:2/554: mkdir da/d1c/d47/dc7 0 2022-02-02T18:23:02.731 INFO:tasks.workunit.client.1.smithi159.stdout:8/462: link d1/dd/d31/d4a/c5e d1/dd/d2c/d67/ca1 0 2022-02-02T18:23:02.733 INFO:tasks.workunit.client.1.smithi159.stdout:2/555: mknod da/d1c/d47/d6b/d5a/d7e/cc8 0 2022-02-02T18:23:02.734 INFO:tasks.workunit.client.1.smithi159.stdout:0/506: write d1/d19/f49 [814871,107611] 0 2022-02-02T18:23:02.734 INFO:tasks.workunit.client.1.smithi159.stdout:0/507: dread - d1/d11/d38/faa zero size 2022-02-02T18:23:02.734 INFO:tasks.workunit.client.1.smithi159.stdout:0/508: write d1/d11/d38/d7e/f77 [652802,23187] 0 2022-02-02T18:23:02.735 INFO:tasks.workunit.client.1.smithi159.stdout:8/463: rename d1/dd/d2c/d67/l96 to d1/d26/d48/d7f/d89/d95/la2 0 2022-02-02T18:23:02.736 INFO:tasks.workunit.client.1.smithi159.stdout:8/464: read d1/dd/d2c/d67/f50 [925588,23464] 0 2022-02-02T18:23:02.740 INFO:tasks.workunit.client.1.smithi159.stdout:8/465: rename d1/d26/d48/c58 to d1/d26/d48/ca3 0 2022-02-02T18:23:02.742 INFO:tasks.workunit.client.1.smithi159.stdout:8/466: link d1/d26/f2d d1/dd/d2c/d67/fa4 0 2022-02-02T18:23:02.746 INFO:tasks.workunit.client.1.smithi159.stdout:8/467: getdents d1/dd/d31/d4a/d75 0 2022-02-02T18:23:02.746 INFO:tasks.workunit.client.1.smithi159.stdout:3/484: truncate dd/d19/d38/d3f/d52/f58 5434126 0 2022-02-02T18:23:02.746 INFO:tasks.workunit.client.1.smithi159.stdout:0/509: dread d1/f3 [4194304,4194304] 0 2022-02-02T18:23:02.747 INFO:tasks.workunit.client.1.smithi159.stdout:0/510: creat d1/dd/d4b/d7d/fbb x:0 0 0 2022-02-02T18:23:02.747 INFO:tasks.workunit.client.1.smithi159.stdout:0/511: chown d1/d19/f69 86 1 2022-02-02T18:23:02.747 INFO:tasks.workunit.client.1.smithi159.stdout:0/512: chown d1/dd/d4b/d7d/lb6 775 1 2022-02-02T18:23:02.750 INFO:tasks.workunit.client.1.smithi159.stdout:3/485: readlink dd/l2d 0 2022-02-02T18:23:02.750 INFO:tasks.workunit.client.1.smithi159.stdout:7/646: write d3/d6/f4d [2306563,80932] 0 2022-02-02T18:23:02.751 INFO:tasks.workunit.client.1.smithi159.stdout:0/513: write d1/d11/d38/d7e/f77 [127427,95031] 0 2022-02-02T18:23:02.753 INFO:tasks.workunit.client.1.smithi159.stdout:3/486: getdents dd/d19/d38/d3f/d7d 0 2022-02-02T18:23:02.753 INFO:tasks.workunit.client.1.smithi159.stdout:3/487: dread - dd/d20/f89 zero size 2022-02-02T18:23:02.754 INFO:tasks.workunit.client.1.smithi159.stdout:0/514: dread d1/dd/d4b/d7d/fa1 [0,4194304] 0 2022-02-02T18:23:02.755 INFO:tasks.workunit.client.1.smithi159.stdout:2/556: write da/d48/d6d/d3e/f9c [194254,56957] 0 2022-02-02T18:23:02.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/557: chown da/d1c/d47/d54/fa1 18213752 1 2022-02-02T18:23:02.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/558: rename da/d1c/d47 to da/d1c/d47/dc7/dc9 22 2022-02-02T18:23:02.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/559: write da/d48/d6d/f99 [1788908,88652] 0 2022-02-02T18:23:02.757 INFO:tasks.workunit.client.1.smithi159.stdout:0/515: unlink d1/d11/d38/f95 0 2022-02-02T18:23:02.758 INFO:tasks.workunit.client.1.smithi159.stdout:0/516: creat d1/d11/d38/d42/daf/fbc x:0 0 0 2022-02-02T18:23:02.763 INFO:tasks.workunit.client.1.smithi159.stdout:8/468: dwrite d1/d26/d48/d49/f9b [4194304,4194304] 0 2022-02-02T18:23:02.763 INFO:tasks.workunit.client.1.smithi159.stdout:5/569: dwrite d9/f42 [0,4194304] 0 2022-02-02T18:23:02.764 INFO:tasks.workunit.client.1.smithi159.stdout:8/469: write d1/dd/d2c/f42 [4440196,66194] 0 2022-02-02T18:23:02.764 INFO:tasks.workunit.client.1.smithi159.stdout:7/647: write d3/d6/f17 [4130145,63923] 0 2022-02-02T18:23:02.765 INFO:tasks.workunit.client.1.smithi159.stdout:7/648: fsync d3/d27/d6f/fcf 0 2022-02-02T18:23:02.771 INFO:tasks.workunit.client.1.smithi159.stdout:7/649: truncate d3/d5/d56/fad 819919 0 2022-02-02T18:23:02.773 INFO:tasks.workunit.client.1.smithi159.stdout:7/650: rmdir d3/d2a/dcc/d8b 39 2022-02-02T18:23:02.773 INFO:tasks.workunit.client.1.smithi159.stdout:8/470: truncate d1/dd/f29 354916 0 2022-02-02T18:23:02.776 INFO:tasks.workunit.client.1.smithi159.stdout:5/570: dread d9/d2e/d63/fa0 [0,4194304] 0 2022-02-02T18:23:02.776 INFO:tasks.workunit.client.1.smithi159.stdout:5/571: chown d9/d24/d38/d3c/d61/l4e 145668 1 2022-02-02T18:23:02.777 INFO:tasks.workunit.client.1.smithi159.stdout:8/471: truncate d1/dd/d1a/f39 1620032 0 2022-02-02T18:23:02.781 INFO:tasks.workunit.client.1.smithi159.stdout:5/572: symlink d9/d24/d4a/la9 0 2022-02-02T18:23:02.781 INFO:tasks.workunit.client.1.smithi159.stdout:0/517: write d1/d11/d38/d42/daf/d34/f67 [794001,90437] 0 2022-02-02T18:23:02.781 INFO:tasks.workunit.client.1.smithi159.stdout:0/518: dread - d1/d11/d8d/fb1 zero size 2022-02-02T18:23:02.782 INFO:tasks.workunit.client.1.smithi159.stdout:8/472: mkdir d1/d26/d48/d99/da5 0 2022-02-02T18:23:02.784 INFO:tasks.workunit.client.1.smithi159.stdout:3/488: dwrite dd/d20/d2a/d31/f57 [0,4194304] 0 2022-02-02T18:23:02.788 INFO:tasks.workunit.client.1.smithi159.stdout:7/651: dread d3/d5/d56/d2f/fb2 [0,4194304] 0 2022-02-02T18:23:02.788 INFO:tasks.workunit.client.1.smithi159.stdout:2/560: dwrite da/d48/d6d/d3e/f9c [0,4194304] 0 2022-02-02T18:23:02.788 INFO:tasks.workunit.client.1.smithi159.stdout:5/573: mkdir d9/d24/d38/d3c/daa 0 2022-02-02T18:23:02.793 INFO:tasks.workunit.client.1.smithi159.stdout:3/489: dread dd/d19/f24 [0,4194304] 0 2022-02-02T18:23:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:5/574: mknod d9/d24/d4a/d8d/d9a/cab 0 2022-02-02T18:23:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/473: rename d1/dc/l24 to d1/la6 0 2022-02-02T18:23:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/474: chown d1/dd/f29 287 1 2022-02-02T18:23:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/475: write d1/d26/d48/d7f/d89/d95/f91 [757080,36810] 0 2022-02-02T18:23:02.795 INFO:tasks.workunit.client.1.smithi159.stdout:4/460: sync 2022-02-02T18:23:02.797 INFO:tasks.workunit.client.1.smithi159.stdout:9/539: sync 2022-02-02T18:23:02.798 INFO:tasks.workunit.client.1.smithi159.stdout:9/540: truncate d4/d2a/fa9 230030 0 2022-02-02T18:23:02.798 INFO:tasks.workunit.client.1.smithi159.stdout:1/457: sync 2022-02-02T18:23:02.798 INFO:tasks.workunit.client.1.smithi159.stdout:6/567: sync 2022-02-02T18:23:02.799 INFO:tasks.workunit.client.1.smithi159.stdout:6/568: chown df/d35/d2a/d3f/d42/d47/d59/d97 240044204 1 2022-02-02T18:23:02.799 INFO:tasks.workunit.client.1.smithi159.stdout:8/476: symlink d1/dd/d1a/la7 0 2022-02-02T18:23:02.800 INFO:tasks.workunit.client.1.smithi159.stdout:8/477: chown d1/d26/d48/c4c 45 1 2022-02-02T18:23:02.800 INFO:tasks.workunit.client.1.smithi159.stdout:8/478: chown d1/d26/d48/d7f/d89/d95/c71 531 1 2022-02-02T18:23:02.800 INFO:tasks.workunit.client.1.smithi159.stdout:8/479: creat d1/d26/d48/d99/da5/fa8 x:0 0 0 2022-02-02T18:23:02.803 INFO:tasks.workunit.client.1.smithi159.stdout:4/461: creat d0/d8/d41/f9d x:0 0 0 2022-02-02T18:23:02.803 INFO:tasks.workunit.client.1.smithi159.stdout:9/541: link d4/d19/d1c/d1f/f98 d4/d7a/fb2 0 2022-02-02T18:23:02.803 INFO:tasks.workunit.client.1.smithi159.stdout:3/490: rename f9 to dd/d66/d82/f9a 0 2022-02-02T18:23:02.807 INFO:tasks.workunit.client.1.smithi159.stdout:3/491: creat dd/d66/f9b x:0 0 0 2022-02-02T18:23:02.807 INFO:tasks.workunit.client.1.smithi159.stdout:3/492: write dd/d19/d35/f8f [138716,114073] 0 2022-02-02T18:23:02.818 INFO:tasks.workunit.client.1.smithi159.stdout:8/480: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:02.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/458: write df/d14/d16/f45 [4965603,50454] 0 2022-02-02T18:23:02.819 INFO:tasks.workunit.client.1.smithi159.stdout:5/575: dread d9/f42 [0,4194304] 0 2022-02-02T18:23:02.819 INFO:tasks.workunit.client.1.smithi159.stdout:5/576: creat d9/d24/d4a/d91/fac x:0 0 0 2022-02-02T18:23:02.820 INFO:tasks.workunit.client.1.smithi159.stdout:5/577: fsync d9/d2e/d63/fa5 0 2022-02-02T18:23:02.827 INFO:tasks.workunit.client.1.smithi159.stdout:7/652: dwrite d3/d5/d56/d2f/d5b/f97 [0,4194304] 0 2022-02-02T18:23:02.828 INFO:tasks.workunit.client.1.smithi159.stdout:7/653: fdatasync d3/d2a/d4a/d7d/fbc 0 2022-02-02T18:23:02.836 INFO:tasks.workunit.client.1.smithi159.stdout:4/462: getdents d0/d8/d41 0 2022-02-02T18:23:02.840 INFO:tasks.workunit.client.1.smithi159.stdout:0/519: dwrite d1/d11/d38/d42/daf/f52 [0,4194304] 0 2022-02-02T18:23:02.852 INFO:tasks.workunit.client.1.smithi159.stdout:1/459: dwrite df/d14/d16/f7e [4194304,4194304] 0 2022-02-02T18:23:02.855 INFO:tasks.workunit.client.1.smithi159.stdout:1/460: mkdir df/d21/d23/d49/d69/d81/da3 0 2022-02-02T18:23:02.857 INFO:tasks.workunit.client.1.smithi159.stdout:9/542: write d4/d2a/f2e [12192015,27571] 0 2022-02-02T18:23:02.858 INFO:tasks.workunit.client.1.smithi159.stdout:1/461: mknod df/d14/d16/d4a/d8b/ca4 0 2022-02-02T18:23:02.862 INFO:tasks.workunit.client.1.smithi159.stdout:9/543: creat d4/d19/d1c/d21/d56/d59/fb3 x:0 0 0 2022-02-02T18:23:02.862 INFO:tasks.workunit.client.1.smithi159.stdout:9/544: stat d4/l1d 0 2022-02-02T18:23:02.864 INFO:tasks.workunit.client.1.smithi159.stdout:1/462: symlink df/d21/d23/d49/d82/la5 0 2022-02-02T18:23:02.864 INFO:tasks.workunit.client.1.smithi159.stdout:1/463: chown df/d14/d68/c7a 36286 1 2022-02-02T18:23:02.865 INFO:tasks.workunit.client.1.smithi159.stdout:9/545: truncate d4/f29 2335950 0 2022-02-02T18:23:02.865 INFO:tasks.workunit.client.1.smithi159.stdout:1/464: getdents df 0 2022-02-02T18:23:02.867 INFO:tasks.workunit.client.1.smithi159.stdout:2/561: dwrite da/d1c/d47/d6b/d59/f6f [0,4194304] 0 2022-02-02T18:23:02.867 INFO:tasks.workunit.client.1.smithi159.stdout:1/465: creat df/d14/d16/d4a/fa6 x:0 0 0 2022-02-02T18:23:02.868 INFO:tasks.workunit.client.1.smithi159.stdout:7/654: dwrite d3/d27/d6f/f7e [0,4194304] 0 2022-02-02T18:23:02.869 INFO:tasks.workunit.client.1.smithi159.stdout:2/562: write da/d48/d83/f89 [5218372,21498] 0 2022-02-02T18:23:02.869 INFO:tasks.workunit.client.1.smithi159.stdout:0/520: dwrite d1/dd/d4b/d7d/fbb [0,4194304] 0 2022-02-02T18:23:02.870 INFO:tasks.workunit.client.1.smithi159.stdout:0/521: dread - d1/d11/d8d/fb1 zero size 2022-02-02T18:23:02.874 INFO:tasks.workunit.client.1.smithi159.stdout:7/655: creat d3/d27/fd7 x:0 0 0 2022-02-02T18:23:02.877 INFO:tasks.workunit.client.1.smithi159.stdout:2/563: rename da/d1c/d47/d6b/fa9 to da/d48/d6d/d3e/fca 0 2022-02-02T18:23:02.879 INFO:tasks.workunit.client.1.smithi159.stdout:2/564: creat da/d1c/d47/d6b/fcb x:0 0 0 2022-02-02T18:23:02.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/565: mkdir da/d1c/d47/d6b/d5a/dcc 0 2022-02-02T18:23:02.884 INFO:tasks.workunit.client.1.smithi159.stdout:8/481: dwrite d1/f17 [0,4194304] 0 2022-02-02T18:23:02.884 INFO:tasks.workunit.client.1.smithi159.stdout:0/522: dread d1/fb [0,4194304] 0 2022-02-02T18:23:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:0/523: mknod d1/dd/d4b/d7d/cbd 0 2022-02-02T18:23:02.890 INFO:tasks.workunit.client.1.smithi159.stdout:0/524: rmdir d1/d11/d38/d42/daf/d34/da0 39 2022-02-02T18:23:02.890 INFO:tasks.workunit.client.1.smithi159.stdout:5/578: dwrite d9/d2e/f53 [0,4194304] 0 2022-02-02T18:23:02.891 INFO:tasks.workunit.client.1.smithi159.stdout:5/579: dread - d9/d24/d38/d3c/f6c zero size 2022-02-02T18:23:02.892 INFO:tasks.workunit.client.1.smithi159.stdout:5/580: write d9/d24/d38/f64 [4641118,119068] 0 2022-02-02T18:23:02.896 INFO:tasks.workunit.client.1.smithi159.stdout:5/581: link d9/d24/f6d d9/d24/d4a/fad 0 2022-02-02T18:23:02.897 INFO:tasks.workunit.client.1.smithi159.stdout:9/546: dwrite d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:23:02.897 INFO:tasks.workunit.client.1.smithi159.stdout:9/547: chown d4/d19/d6f/d74/db1 7919 1 2022-02-02T18:23:02.902 INFO:tasks.workunit.client.1.smithi159.stdout:1/466: rmdir df/d21/d23 39 2022-02-02T18:23:02.906 INFO:tasks.workunit.client.1.smithi159.stdout:1/467: symlink df/d14/d68/la7 0 2022-02-02T18:23:02.908 INFO:tasks.workunit.client.1.smithi159.stdout:1/468: mkdir df/d14/d16/da8 0 2022-02-02T18:23:02.911 INFO:tasks.workunit.client.1.smithi159.stdout:1/469: creat df/d14/d16/d4a/d8b/fa9 x:0 0 0 2022-02-02T18:23:02.914 INFO:tasks.workunit.client.1.smithi159.stdout:1/470: link df/d14/l75 df/d14/d16/d4a/d8b/laa 0 2022-02-02T18:23:02.922 INFO:tasks.workunit.client.1.smithi159.stdout:7/656: dwrite d3/d5/d56/fad [0,4194304] 0 2022-02-02T18:23:02.924 INFO:tasks.workunit.client.1.smithi159.stdout:8/482: dwrite d1/dd/d1a/d53/f6b [0,4194304] 0 2022-02-02T18:23:02.925 INFO:tasks.workunit.client.1.smithi159.stdout:9/548: write d4/d19/d1c/d21/d56/d59/f5a [169974,55090] 0 2022-02-02T18:23:02.925 INFO:tasks.workunit.client.1.smithi159.stdout:4/463: dwrite d0/d8/d24/d4f/f52 [0,4194304] 0 2022-02-02T18:23:02.925 INFO:tasks.workunit.client.1.smithi159.stdout:0/525: dwrite d1/d11/d38/d42/daf/d34/f67 [0,4194304] 0 2022-02-02T18:23:02.926 INFO:tasks.workunit.client.1.smithi159.stdout:7/657: chown d3/c1f 426717009 1 2022-02-02T18:23:02.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/566: write da/d1c/d47/f4a [627572,9368] 0 2022-02-02T18:23:02.927 INFO:tasks.workunit.client.1.smithi159.stdout:8/483: write d1/dd/d31/f3f [2354759,68123] 0 2022-02-02T18:23:02.927 INFO:tasks.workunit.client.1.smithi159.stdout:8/484: chown d1/dd/d1a/d53/f6b 68425 1 2022-02-02T18:23:02.928 INFO:tasks.workunit.client.1.smithi159.stdout:5/582: write f7 [1486830,65861] 0 2022-02-02T18:23:02.928 INFO:tasks.workunit.client.1.smithi159.stdout:8/485: symlink d1/dd/d2c/la9 0 2022-02-02T18:23:02.929 INFO:tasks.workunit.client.1.smithi159.stdout:8/486: read d1/dd/d2c/d67/f50 [3217961,125983] 0 2022-02-02T18:23:02.929 INFO:tasks.workunit.client.1.smithi159.stdout:8/487: truncate d1/dd/d1a/d53/f6d 404768 0 2022-02-02T18:23:02.930 INFO:tasks.workunit.client.1.smithi159.stdout:9/549: truncate d4/d19/d1c/d21/d56/d59/f7d 3142601 0 2022-02-02T18:23:02.930 INFO:tasks.workunit.client.1.smithi159.stdout:9/550: read d4/d19/d1c/d21/f45 [166648,71042] 0 2022-02-02T18:23:02.931 INFO:tasks.workunit.client.1.smithi159.stdout:8/488: unlink d1/d26/d48/d49/l8b 0 2022-02-02T18:23:02.933 INFO:tasks.workunit.client.1.smithi159.stdout:1/471: dwrite df/d21/d23/d49/d82/f9e [0,4194304] 0 2022-02-02T18:23:02.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/583: read d9/fc [1716514,27495] 0 2022-02-02T18:23:02.944 INFO:tasks.workunit.client.1.smithi159.stdout:1/472: dread df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:02.951 INFO:tasks.workunit.client.1.smithi159.stdout:0/526: dwrite d1/dd/d4b/d7d/fb4 [0,4194304] 0 2022-02-02T18:23:02.984 INFO:tasks.workunit.client.1.smithi159.stdout:7/658: mknod d3/d2a/d2c/dd3/cd8 0 2022-02-02T18:23:02.988 INFO:tasks.workunit.client.1.smithi159.stdout:8/489: mkdir d1/d26/d48/d7f/d89/d95/daa 0 2022-02-02T18:23:02.990 INFO:tasks.workunit.client.1.smithi159.stdout:2/567: rmdir da/d1c/d42/d70 39 2022-02-02T18:23:02.990 INFO:tasks.workunit.client.1.smithi159.stdout:2/568: stat da/d48/fc1 0 2022-02-02T18:23:02.990 INFO:tasks.workunit.client.1.smithi159.stdout:2/569: dread - da/d1c/d42/d70/f8a zero size 2022-02-02T18:23:02.995 INFO:tasks.workunit.client.1.smithi159.stdout:4/464: mknod d0/d8/d14/d33/d47/d56/c9e 0 2022-02-02T18:23:02.997 INFO:tasks.workunit.client.1.smithi159.stdout:8/490: dread d1/dc/f41 [0,4194304] 0 2022-02-02T18:23:02.998 INFO:tasks.workunit.client.1.smithi159.stdout:0/527: dwrite d1/d11/d38/d42/d56/f97 [4194304,4194304] 0 2022-02-02T18:23:02.998 INFO:tasks.workunit.client.1.smithi159.stdout:1/473: mknod df/cab 0 2022-02-02T18:23:03.000 INFO:tasks.workunit.client.1.smithi159.stdout:8/491: rmdir d1/dd/d2c 39 2022-02-02T18:23:03.001 INFO:tasks.workunit.client.1.smithi159.stdout:7/659: link d3/d5/d56/d2f/d5b/f97 d3/d27/db7/fd9 0 2022-02-02T18:23:03.001 INFO:tasks.workunit.client.1.smithi159.stdout:0/528: write d1/d19/f9c [1547549,6105] 0 2022-02-02T18:23:03.002 INFO:tasks.workunit.client.1.smithi159.stdout:8/492: dread d1/dd/d1a/f32 [0,4194304] 0 2022-02-02T18:23:03.002 INFO:tasks.workunit.client.1.smithi159.stdout:8/493: fdatasync d1/dd/d2c/f42 0 2022-02-02T18:23:03.002 INFO:tasks.workunit.client.1.smithi159.stdout:8/494: fdatasync d1/d26/d48/d7f/d89/d95/f91 0 2022-02-02T18:23:03.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/529: creat d1/d11/d38/d42/daf/fbe x:0 0 0 2022-02-02T18:23:03.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/530: truncate d1/dd/d4b/d7d/fb2 586739 0 2022-02-02T18:23:03.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/531: write d1/d11/d38/d42/daf/d34/f4a [4256265,32314] 0 2022-02-02T18:23:03.004 INFO:tasks.workunit.client.1.smithi159.stdout:0/532: creat d1/fbf x:0 0 0 2022-02-02T18:23:03.004 INFO:tasks.workunit.client.1.smithi159.stdout:0/533: fsync d1/f2c 0 2022-02-02T18:23:03.005 INFO:tasks.workunit.client.1.smithi159.stdout:0/534: readlink d1/d11/d38/d7e/l9b 0 2022-02-02T18:23:03.005 INFO:tasks.workunit.client.1.smithi159.stdout:8/495: symlink d1/lab 0 2022-02-02T18:23:03.005 INFO:tasks.workunit.client.1.smithi159.stdout:8/496: write d1/d26/d48/f55 [588869,49440] 0 2022-02-02T18:23:03.005 INFO:tasks.workunit.client.1.smithi159.stdout:9/551: link d4/d19/d1c/f54 d4/d19/d1c/d21/fb4 0 2022-02-02T18:23:03.006 INFO:tasks.workunit.client.1.smithi159.stdout:8/497: symlink d1/dd/d2c/d67/lac 0 2022-02-02T18:23:03.007 INFO:tasks.workunit.client.1.smithi159.stdout:1/474: mkdir df/d21/d23/d49/da1/dac 0 2022-02-02T18:23:03.007 INFO:tasks.workunit.client.1.smithi159.stdout:1/475: chown df/f18 2 1 2022-02-02T18:23:03.009 INFO:tasks.workunit.client.1.smithi159.stdout:4/465: rmdir d0/d8/d30/d7e/d98/d9b 0 2022-02-02T18:23:03.012 INFO:tasks.workunit.client.1.smithi159.stdout:1/476: chown df/d14/d16/d4a/d8b/c4f 251382386 1 2022-02-02T18:23:03.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/477: read - df/d14/f91 zero size 2022-02-02T18:23:03.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/478: chown df/d21/d23/d49/d82/la5 1942773 1 2022-02-02T18:23:03.014 INFO:tasks.workunit.client.1.smithi159.stdout:2/570: rename da/d1c/d25/d73/dab/f2a to da/d48/fcd 0 2022-02-02T18:23:03.020 INFO:tasks.workunit.client.1.smithi159.stdout:1/479: mkdir df/d14/d68/dad 0 2022-02-02T18:23:03.021 INFO:tasks.workunit.client.1.smithi159.stdout:1/480: truncate df/d14/d16/d4a/d8b/fa9 887465 0 2022-02-02T18:23:03.022 INFO:tasks.workunit.client.1.smithi159.stdout:7/660: rename d3/d27/d29/d6b/dc5/f8d to d3/d2a/d4a/d7d/fda 0 2022-02-02T18:23:03.023 INFO:tasks.workunit.client.1.smithi159.stdout:1/481: creat df/fae x:0 0 0 2022-02-02T18:23:03.024 INFO:tasks.workunit.client.1.smithi159.stdout:1/482: getdents df/d21/d23/d49/da1/dac 0 2022-02-02T18:23:03.024 INFO:tasks.workunit.client.1.smithi159.stdout:7/661: symlink d3/d27/d29/d6b/da7/ldb 0 2022-02-02T18:23:03.026 INFO:tasks.workunit.client.1.smithi159.stdout:8/498: rename d1/d26/d48/d7f/d89 to d1/dad 0 2022-02-02T18:23:03.027 INFO:tasks.workunit.client.1.smithi159.stdout:0/535: dread d1/d19/f39 [4194304,4194304] 0 2022-02-02T18:23:03.028 INFO:tasks.workunit.client.1.smithi159.stdout:0/536: fdatasync d1/d11/d38/d42/daf/d34/f83 0 2022-02-02T18:23:03.028 INFO:tasks.workunit.client.1.smithi159.stdout:0/537: chown d1/dd/d4b/d7d/fbb 27043 1 2022-02-02T18:23:03.030 INFO:tasks.workunit.client.1.smithi159.stdout:1/483: getdents df/d14/d16/d4b/da0 0 2022-02-02T18:23:03.034 INFO:tasks.workunit.client.1.smithi159.stdout:8/499: rename d1/d26/f59 to d1/fae 0 2022-02-02T18:23:03.036 INFO:tasks.workunit.client.1.smithi159.stdout:9/552: dwrite d4/d19/f76 [0,4194304] 0 2022-02-02T18:23:03.041 INFO:tasks.workunit.client.1.smithi159.stdout:9/553: getdents d4/d19/d6f/d78 0 2022-02-02T18:23:03.042 INFO:tasks.workunit.client.1.smithi159.stdout:8/500: creat d1/dd/faf x:0 0 0 2022-02-02T18:23:03.042 INFO:tasks.workunit.client.1.smithi159.stdout:0/538: rename d1/d11/d38/d42/daf/d34/d92 to d1/dd/d4b/dc0 0 2022-02-02T18:23:03.043 INFO:tasks.workunit.client.1.smithi159.stdout:0/539: stat d1/dd/f6d 0 2022-02-02T18:23:03.043 INFO:tasks.workunit.client.1.smithi159.stdout:0/540: chown d1/dd/d4b/da7 217203 1 2022-02-02T18:23:03.044 INFO:tasks.workunit.client.1.smithi159.stdout:9/554: dread d4/d19/d1c/d1f/f24 [0,4194304] 0 2022-02-02T18:23:03.046 INFO:tasks.workunit.client.1.smithi159.stdout:9/555: creat d4/d19/d6f/d74/db1/fb5 x:0 0 0 2022-02-02T18:23:03.046 INFO:tasks.workunit.client.1.smithi159.stdout:2/571: write da/d1c/f5b [3326026,15168] 0 2022-02-02T18:23:03.047 INFO:tasks.workunit.client.1.smithi159.stdout:2/572: chown da/d48/d6d/f43 807011 1 2022-02-02T18:23:03.047 INFO:tasks.workunit.client.1.smithi159.stdout:2/573: stat da/fb2 0 2022-02-02T18:23:03.049 INFO:tasks.workunit.client.1.smithi159.stdout:8/501: unlink d1/dd/f2f 0 2022-02-02T18:23:03.049 INFO:tasks.workunit.client.1.smithi159.stdout:0/541: rmdir d1/d19/d3d 39 2022-02-02T18:23:03.050 INFO:tasks.workunit.client.1.smithi159.stdout:9/556: symlink d4/d19/d1c/d21/d22/d55/lb6 0 2022-02-02T18:23:03.051 INFO:tasks.workunit.client.1.smithi159.stdout:0/542: mkdir d1/dd/d4b/da7/dc1 0 2022-02-02T18:23:03.052 INFO:tasks.workunit.client.1.smithi159.stdout:8/502: symlink d1/dd/d2c/d67/lb0 0 2022-02-02T18:23:03.052 INFO:tasks.workunit.client.1.smithi159.stdout:8/503: fdatasync d1/dd/faf 0 2022-02-02T18:23:03.054 INFO:tasks.workunit.client.1.smithi159.stdout:7/662: write d3/d5/d56/d2f/f4c [1601376,47041] 0 2022-02-02T18:23:03.054 INFO:tasks.workunit.client.1.smithi159.stdout:1/484: dwrite df/f62 [0,4194304] 0 2022-02-02T18:23:03.055 INFO:tasks.workunit.client.1.smithi159.stdout:9/557: write d4/d19/d1c/d1f/f98 [2827902,7534] 0 2022-02-02T18:23:03.055 INFO:tasks.workunit.client.1.smithi159.stdout:7/663: write d3/d5/f45 [4158030,108312] 0 2022-02-02T18:23:03.055 INFO:tasks.workunit.client.1.smithi159.stdout:4/466: dwrite d0/d8/d14/d36/d4b/f54 [0,4194304] 0 2022-02-02T18:23:03.056 INFO:tasks.workunit.client.1.smithi159.stdout:1/485: getdents df/d21/d23/d49/d82/d87 0 2022-02-02T18:23:03.063 INFO:tasks.workunit.client.1.smithi159.stdout:1/486: symlink df/d21/d23/d49/da1/dac/laf 0 2022-02-02T18:23:03.065 INFO:tasks.workunit.client.1.smithi159.stdout:1/487: chown df/d14/c53 247 1 2022-02-02T18:23:03.065 INFO:tasks.workunit.client.1.smithi159.stdout:2/574: write da/d48/d6d/f93 [955585,13405] 0 2022-02-02T18:23:03.068 INFO:tasks.workunit.client.1.smithi159.stdout:7/664: symlink d3/d6/ldc 0 2022-02-02T18:23:03.068 INFO:tasks.workunit.client.1.smithi159.stdout:7/665: chown d3/d2a/d4a/l96 117346 1 2022-02-02T18:23:03.069 INFO:tasks.workunit.client.1.smithi159.stdout:2/575: stat da/d1c/d47/l5d 0 2022-02-02T18:23:03.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/666: creat d3/d2a/d4a/d7d/fdd x:0 0 0 2022-02-02T18:23:03.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/667: chown d3/d2a/d2c/dd3/fb6 3 1 2022-02-02T18:23:03.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/668: truncate d3/d27/d29/d6b/da7/fb3 50933 0 2022-02-02T18:23:03.071 INFO:tasks.workunit.client.1.smithi159.stdout:7/669: creat d3/d27/db7/fde x:0 0 0 2022-02-02T18:23:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/670: getdents d3/d2a/d4a 0 2022-02-02T18:23:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:2/576: mkdir da/dce 0 2022-02-02T18:23:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/671: fsync d3/d5/d56/d57/f4f 0 2022-02-02T18:23:03.075 INFO:tasks.workunit.client.1.smithi159.stdout:9/558: write d4/f29 [1733213,25348] 0 2022-02-02T18:23:03.076 INFO:tasks.workunit.client.1.smithi159.stdout:2/577: dread da/d1c/d47/d6b/d5a/f66 [0,4194304] 0 2022-02-02T18:23:03.078 INFO:tasks.workunit.client.1.smithi159.stdout:0/543: dwrite d1/d11/d38/d7e/f90 [0,4194304] 0 2022-02-02T18:23:03.079 INFO:tasks.workunit.client.1.smithi159.stdout:2/578: readlink l5 0 2022-02-02T18:23:03.079 INFO:tasks.workunit.client.1.smithi159.stdout:9/559: rename d4/d19/d1c/d1f/d4c to d4/d7a/db7 0 2022-02-02T18:23:03.083 INFO:tasks.workunit.client.1.smithi159.stdout:2/579: truncate da/d48/d6d/f92 530939 0 2022-02-02T18:23:03.083 INFO:tasks.workunit.client.1.smithi159.stdout:2/580: write da/d1c/d47/fbc [994319,58776] 0 2022-02-02T18:23:03.086 INFO:tasks.workunit.client.1.smithi159.stdout:8/504: dwrite d1/dd/d1a/f39 [0,4194304] 0 2022-02-02T18:23:03.086 INFO:tasks.workunit.client.1.smithi159.stdout:2/581: fdatasync da/d1c/d25/d73/dab/f33 0 2022-02-02T18:23:03.089 INFO:tasks.workunit.client.1.smithi159.stdout:2/582: write da/d1c/d42/f81 [3980186,107085] 0 2022-02-02T18:23:03.090 INFO:tasks.workunit.client.1.smithi159.stdout:8/505: dread d1/f7b [0,4194304] 0 2022-02-02T18:23:03.091 INFO:tasks.workunit.client.1.smithi159.stdout:8/506: chown d1/dd/d2c/f42 1 1 2022-02-02T18:23:03.091 INFO:tasks.workunit.client.1.smithi159.stdout:4/467: write d0/d8/d15/f2e [923451,16264] 0 2022-02-02T18:23:03.091 INFO:tasks.workunit.client.1.smithi159.stdout:4/468: chown d0/d8/d14/d36 25162 1 2022-02-02T18:23:03.092 INFO:tasks.workunit.client.1.smithi159.stdout:0/544: write d1/d19/f2f [804697,31249] 0 2022-02-02T18:23:03.093 INFO:tasks.workunit.client.1.smithi159.stdout:0/545: symlink d1/d11/d38/d42/daf/d34/da0/lc2 0 2022-02-02T18:23:03.094 INFO:tasks.workunit.client.1.smithi159.stdout:4/469: creat d0/d8/d24/d4f/f9f x:0 0 0 2022-02-02T18:23:03.105 INFO:tasks.workunit.client.1.smithi159.stdout:2/583: link da/d1c/f1f da/d1c/d25/d73/dab/db5/fcf 0 2022-02-02T18:23:03.107 INFO:tasks.workunit.client.1.smithi159.stdout:2/584: truncate da/d1c/d25/d73/dab/f4b 115071 0 2022-02-02T18:23:03.107 INFO:tasks.workunit.client.1.smithi159.stdout:2/585: write da/d48/d6d/d3e/fca [256562,81515] 0 2022-02-02T18:23:03.109 INFO:tasks.workunit.client.1.smithi159.stdout:2/586: mknod da/d48/d83/dbd/cd0 0 2022-02-02T18:23:03.109 INFO:tasks.workunit.client.1.smithi159.stdout:2/587: chown da/d1c/d25/d73/dab/db5/fcf 205324 1 2022-02-02T18:23:03.111 INFO:tasks.workunit.client.1.smithi159.stdout:7/672: truncate d3/f2d 762786 0 2022-02-02T18:23:03.116 INFO:tasks.workunit.client.1.smithi159.stdout:7/673: rename d3/d27/d6f/ca0 to d3/d5/d56/d2f/cdf 0 2022-02-02T18:23:03.134 INFO:tasks.workunit.client.1.smithi159.stdout:8/507: dwrite d1/dd/d2c/d67/fa4 [0,4194304] 0 2022-02-02T18:23:03.135 INFO:tasks.workunit.client.1.smithi159.stdout:8/508: mknod d1/dad/cb1 0 2022-02-02T18:23:03.136 INFO:tasks.workunit.client.1.smithi159.stdout:8/509: symlink d1/d26/d48/d49/lb2 0 2022-02-02T18:23:03.138 INFO:tasks.workunit.client.1.smithi159.stdout:4/470: dwrite d0/d8/d15/d61/f93 [0,4194304] 0 2022-02-02T18:23:03.139 INFO:tasks.workunit.client.1.smithi159.stdout:0/546: dwrite d1/f3 [4194304,4194304] 0 2022-02-02T18:23:03.141 INFO:tasks.workunit.client.1.smithi159.stdout:2/588: dwrite da/d40/d61/f8f [0,4194304] 0 2022-02-02T18:23:03.142 INFO:tasks.workunit.client.1.smithi159.stdout:7/674: dwrite d3/d5/d56/f32 [0,4194304] 0 2022-02-02T18:23:03.142 INFO:tasks.workunit.client.1.smithi159.stdout:4/471: mknod d0/d66/ca0 0 2022-02-02T18:23:03.143 INFO:tasks.workunit.client.1.smithi159.stdout:0/547: readlink d1/l24 0 2022-02-02T18:23:03.144 INFO:tasks.workunit.client.1.smithi159.stdout:0/548: dread d1/d19/d3d/f41 [0,4194304] 0 2022-02-02T18:23:03.149 INFO:tasks.workunit.client.1.smithi159.stdout:0/549: rename d1/d11/d38/d42/daf/c2a to d1/dd/d4b/da7/cc3 0 2022-02-02T18:23:03.150 INFO:tasks.workunit.client.1.smithi159.stdout:7/675: unlink d3/d27/d6f/la8 0 2022-02-02T18:23:03.152 INFO:tasks.workunit.client.1.smithi159.stdout:7/676: creat d3/d5/d56/d2f/fe0 x:0 0 0 2022-02-02T18:23:03.158 INFO:tasks.workunit.client.1.smithi159.stdout:4/472: dread d0/d8/d15/f2a [0,4194304] 0 2022-02-02T18:23:03.159 INFO:tasks.workunit.client.1.smithi159.stdout:8/510: dwrite d1/dd/d2c/f42 [4194304,4194304] 0 2022-02-02T18:23:03.159 INFO:tasks.workunit.client.1.smithi159.stdout:8/511: truncate d1/dd/d2c/d67/f50 5117984 0 2022-02-02T18:23:03.162 INFO:tasks.workunit.client.1.smithi159.stdout:2/589: write da/d1c/d47/d6b/f80 [916253,120771] 0 2022-02-02T18:23:03.163 INFO:tasks.workunit.client.1.smithi159.stdout:2/590: dread da/d1c/d47/d6b/d5a/f66 [0,4194304] 0 2022-02-02T18:23:03.165 INFO:tasks.workunit.client.1.smithi159.stdout:2/591: read da/d1c/d47/d6b/d5a/d7e/f82 [2768633,73827] 0 2022-02-02T18:23:03.166 INFO:tasks.workunit.client.1.smithi159.stdout:8/512: mkdir d1/d26/d48/d49/db3 0 2022-02-02T18:23:03.166 INFO:tasks.workunit.client.1.smithi159.stdout:8/513: stat d1/dc/f41 0 2022-02-02T18:23:03.166 INFO:tasks.workunit.client.1.smithi159.stdout:2/592: getdents da/d1c/d47/d54 0 2022-02-02T18:23:03.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/593: write da/d1c/d42/fb9 [12454978,45044] 0 2022-02-02T18:23:03.169 INFO:tasks.workunit.client.1.smithi159.stdout:4/473: write d0/d8/d24/d4f/f5c [1044610,68345] 0 2022-02-02T18:23:03.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/550: dwrite d1/d11/d38/d42/daf/fbc [0,4194304] 0 2022-02-02T18:23:03.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/551: read - d1/d11/d8d/fb1 zero size 2022-02-02T18:23:03.171 INFO:tasks.workunit.client.1.smithi159.stdout:2/594: dread - da/d1c/d47/f79 zero size 2022-02-02T18:23:03.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/474: truncate d0/d8/d24/d76/f89 356900 0 2022-02-02T18:23:03.173 INFO:tasks.workunit.client.1.smithi159.stdout:0/552: write d1/d11/d38/d7e/f9f [3773482,41357] 0 2022-02-02T18:23:03.174 INFO:tasks.workunit.client.1.smithi159.stdout:0/553: truncate d1/d19/f49 5059079 0 2022-02-02T18:23:03.174 INFO:tasks.workunit.client.1.smithi159.stdout:0/554: creat d1/d11/d38/d94/fc4 x:0 0 0 2022-02-02T18:23:03.177 INFO:tasks.workunit.client.1.smithi159.stdout:4/475: creat d0/d8/d14/d33/d47/fa1 x:0 0 0 2022-02-02T18:23:03.178 INFO:tasks.workunit.client.1.smithi159.stdout:0/555: symlink d1/d19/lc5 0 2022-02-02T18:23:03.181 INFO:tasks.workunit.client.1.smithi159.stdout:4/476: read d0/d8/f28 [2492007,60244] 0 2022-02-02T18:23:03.183 INFO:tasks.workunit.client.1.smithi159.stdout:0/556: creat d1/dd/d4b/da7/da8/fc6 x:0 0 0 2022-02-02T18:23:03.184 INFO:tasks.workunit.client.1.smithi159.stdout:4/477: rename d0/d8/d30/f75 to d0/d8/d14/fa2 0 2022-02-02T18:23:03.186 INFO:tasks.workunit.client.1.smithi159.stdout:8/514: dwrite d1/fae [0,4194304] 0 2022-02-02T18:23:03.186 INFO:tasks.workunit.client.1.smithi159.stdout:8/515: dread - d1/d26/d48/d99/da5/fa8 zero size 2022-02-02T18:23:03.186 INFO:tasks.workunit.client.1.smithi159.stdout:8/516: dread - d1/dd/f92 zero size 2022-02-02T18:23:03.187 INFO:tasks.workunit.client.1.smithi159.stdout:8/517: stat d1/dd/d2c/d67/lac 0 2022-02-02T18:23:03.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/478: rmdir d0/d8/d24 39 2022-02-02T18:23:03.191 INFO:tasks.workunit.client.1.smithi159.stdout:2/595: dwrite da/d48/d6d/f93 [0,4194304] 0 2022-02-02T18:23:03.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/557: dread d1/f3 [4194304,4194304] 0 2022-02-02T18:23:03.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/558: chown d1/d19/d3d/l8b 51 1 2022-02-02T18:23:03.195 INFO:tasks.workunit.client.1.smithi159.stdout:2/596: truncate da/d48/d83/f95 794241 0 2022-02-02T18:23:03.195 INFO:tasks.workunit.client.1.smithi159.stdout:2/597: chown da/d1c/d47/d54/fa1 773977667 1 2022-02-02T18:23:03.195 INFO:tasks.workunit.client.1.smithi159.stdout:2/598: chown da/d1c/d76/f87 3731 1 2022-02-02T18:23:03.196 INFO:tasks.workunit.client.1.smithi159.stdout:0/559: truncate d1/d11/d38/d42/daf/d34/f64 924881 0 2022-02-02T18:23:03.196 INFO:tasks.workunit.client.1.smithi159.stdout:0/560: fsync d1/fc 0 2022-02-02T18:23:03.197 INFO:tasks.workunit.client.1.smithi159.stdout:2/599: mkdir da/d1c/d25/d73/dab/dd1 0 2022-02-02T18:23:03.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/479: write d0/d8/d14/d33/d47/d56/f7a [997408,22711] 0 2022-02-02T18:23:03.204 INFO:tasks.workunit.client.1.smithi159.stdout:2/600: rename da/d1c/d47/d54/l57 to da/d40/d61/ld2 0 2022-02-02T18:23:03.204 INFO:tasks.workunit.client.1.smithi159.stdout:2/601: truncate da/f53 759282 0 2022-02-02T18:23:03.206 INFO:tasks.workunit.client.1.smithi159.stdout:4/480: mkdir d0/d8/d14/da3 0 2022-02-02T18:23:03.207 INFO:tasks.workunit.client.1.smithi159.stdout:4/481: chown d0/d8/d14/d33/l49 32384247 1 2022-02-02T18:23:03.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/602: unlink da/d1c/d47/d6b/d59/c96 0 2022-02-02T18:23:03.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/603: write da/d48/d6d/d3e/fca [1266882,73958] 0 2022-02-02T18:23:03.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/604: write da/fb2 [884353,102763] 0 2022-02-02T18:23:03.213 INFO:tasks.workunit.client.1.smithi159.stdout:4/482: read d0/d8/d14/d36/d4b/f54 [3295388,15808] 0 2022-02-02T18:23:03.213 INFO:tasks.workunit.client.1.smithi159.stdout:4/483: readlink d0/d8/d15/l1f 0 2022-02-02T18:23:03.217 INFO:tasks.workunit.client.1.smithi159.stdout:0/561: dwrite d1/d19/f9c [0,4194304] 0 2022-02-02T18:23:03.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/562: truncate d1/d11/f73 5204260 0 2022-02-02T18:23:03.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/563: link d1/fc d1/fc7 0 2022-02-02T18:23:03.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/564: dwrite d1/d19/f2f [0,4194304] 0 2022-02-02T18:23:03.236 INFO:tasks.workunit.client.1.smithi159.stdout:0/565: chown d1/d19/d3d/f76 3852022 1 2022-02-02T18:23:03.240 INFO:tasks.workunit.client.1.smithi159.stdout:0/566: unlink d1/d19/f78 0 2022-02-02T18:23:03.241 INFO:tasks.workunit.client.1.smithi159.stdout:0/567: dread - d1/dd/d4b/da7/da8/fc6 zero size 2022-02-02T18:23:03.244 INFO:tasks.workunit.client.1.smithi159.stdout:0/568: unlink d1/d11/d38/d42/daf/d34/f85 0 2022-02-02T18:23:03.244 INFO:tasks.workunit.client.1.smithi159.stdout:0/569: truncate d1/d11/d38/d94/fc4 577540 0 2022-02-02T18:23:03.245 INFO:tasks.workunit.client.1.smithi159.stdout:0/570: write d1/dd/f1a [87057,90667] 0 2022-02-02T18:23:03.245 INFO:tasks.workunit.client.1.smithi159.stdout:0/571: stat d1/d11/d38/lb8 0 2022-02-02T18:23:03.268 INFO:tasks.workunit.client.1.smithi159.stdout:4/484: write d0/d8/d14/d36/f5f [384974,71283] 0 2022-02-02T18:23:03.270 INFO:tasks.workunit.client.1.smithi159.stdout:4/485: creat d0/d8/fa4 x:0 0 0 2022-02-02T18:23:03.270 INFO:tasks.workunit.client.1.smithi159.stdout:0/572: dwrite d1/d11/d38/d42/daf/d34/f64 [0,4194304] 0 2022-02-02T18:23:03.272 INFO:tasks.workunit.client.1.smithi159.stdout:4/486: creat d0/fa5 x:0 0 0 2022-02-02T18:23:03.272 INFO:tasks.workunit.client.1.smithi159.stdout:4/487: write d0/d8/d14/d33/d47/f53 [544252,83853] 0 2022-02-02T18:23:03.273 INFO:tasks.workunit.client.1.smithi159.stdout:4/488: chown d0/d8/l1b 0 1 2022-02-02T18:23:03.279 INFO:tasks.workunit.client.1.smithi159.stdout:4/489: rmdir d0/d8/d14/d33/d47/d56 39 2022-02-02T18:23:03.288 INFO:tasks.workunit.client.1.smithi159.stdout:2/605: dwrite da/d1c/d47/d6b/d5a/f7b [0,4194304] 0 2022-02-02T18:23:03.292 INFO:tasks.workunit.client.1.smithi159.stdout:2/606: symlink da/d1c/d42/ld3 0 2022-02-02T18:23:03.293 INFO:tasks.workunit.client.1.smithi159.stdout:0/573: dwrite d1/dd/d4b/da7/da8/fc6 [0,4194304] 0 2022-02-02T18:23:03.293 INFO:tasks.workunit.client.1.smithi159.stdout:0/574: stat d1/d11/d38/d42/daf/fbe 0 2022-02-02T18:23:03.293 INFO:tasks.workunit.client.1.smithi159.stdout:0/575: readlink d1/d11/d38/d42/l8a 0 2022-02-02T18:23:03.296 INFO:tasks.workunit.client.1.smithi159.stdout:0/576: rename d1/d11/d38/d42/daf/d34/c3e to d1/d11/d38/d42/daf/d34/cc8 0 2022-02-02T18:23:03.297 INFO:tasks.workunit.client.1.smithi159.stdout:0/577: chown d1/d11/d38/d7e 24246889 1 2022-02-02T18:23:03.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/607: chown da/d1c/d47/f64 1282 1 2022-02-02T18:23:03.298 INFO:tasks.workunit.client.1.smithi159.stdout:0/578: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:03.299 INFO:tasks.workunit.client.1.smithi159.stdout:0/579: creat d1/d11/d8d/fc9 x:0 0 0 2022-02-02T18:23:03.300 INFO:tasks.workunit.client.1.smithi159.stdout:2/608: link da/d48/d6d/d3e/cc6 da/d1c/d42/cd4 0 2022-02-02T18:23:03.300 INFO:tasks.workunit.client.1.smithi159.stdout:0/580: creat d1/dd/d4b/da7/dc1/fca x:0 0 0 2022-02-02T18:23:03.301 INFO:tasks.workunit.client.1.smithi159.stdout:4/490: write d0/d8/d41/f5e [2553663,122062] 0 2022-02-02T18:23:03.302 INFO:tasks.workunit.client.1.smithi159.stdout:4/491: creat d0/d8/d14/d36/fa6 x:0 0 0 2022-02-02T18:23:03.303 INFO:tasks.workunit.client.1.smithi159.stdout:4/492: creat d0/d8/d24/d4f/fa7 x:0 0 0 2022-02-02T18:23:03.304 INFO:tasks.workunit.client.1.smithi159.stdout:4/493: creat d0/d8/d24/d4f/fa8 x:0 0 0 2022-02-02T18:23:03.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/494: creat d0/d8/d15/d61/fa9 x:0 0 0 2022-02-02T18:23:03.306 INFO:tasks.workunit.client.1.smithi159.stdout:4/495: write d0/d8/d14/d36/f88 [682864,79149] 0 2022-02-02T18:23:03.307 INFO:tasks.workunit.client.1.smithi159.stdout:4/496: dread - d0/d8/fa4 zero size 2022-02-02T18:23:03.310 INFO:tasks.workunit.client.1.smithi159.stdout:0/581: write d1/d11/d38/d7e/f77 [364402,55949] 0 2022-02-02T18:23:03.313 INFO:tasks.workunit.client.1.smithi159.stdout:0/582: link d1/d11/d38/d42/daf/d34/c86 d1/dd/ccb 0 2022-02-02T18:23:03.313 INFO:tasks.workunit.client.1.smithi159.stdout:0/583: dread - d1/d11/d38/d94/fae zero size 2022-02-02T18:23:03.316 INFO:tasks.workunit.client.1.smithi159.stdout:0/584: rename d1/d11/d38/f53 to d1/d11/d38/d42/d47/db0/fcc 0 2022-02-02T18:23:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/609: dwrite da/d1c/d76/f87 [0,4194304] 0 2022-02-02T18:23:03.344 INFO:tasks.workunit.client.1.smithi159.stdout:2/610: creat da/d1c/d25/d73/dab/db5/fd5 x:0 0 0 2022-02-02T18:23:03.345 INFO:tasks.workunit.client.1.smithi159.stdout:2/611: truncate da/d40/d61/fa8 968499 0 2022-02-02T18:23:03.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/585: dwrite d1/d19/d3d/f45 [0,4194304] 0 2022-02-02T18:23:03.350 INFO:tasks.workunit.client.1.smithi159.stdout:0/586: creat d1/d11/d38/d42/d47/fcd x:0 0 0 2022-02-02T18:23:03.354 INFO:tasks.workunit.client.1.smithi159.stdout:4/497: dwrite d0/d8/d24/f67 [0,4194304] 0 2022-02-02T18:23:03.354 INFO:tasks.workunit.client.1.smithi159.stdout:4/498: write d0/d8/d24/d4f/fa7 [812726,5036] 0 2022-02-02T18:23:03.364 INFO:tasks.workunit.client.1.smithi159.stdout:6/569: sync 2022-02-02T18:23:03.386 INFO:tasks.workunit.client.1.smithi159.stdout:2/612: dwrite da/d40/f88 [0,4194304] 0 2022-02-02T18:23:03.399 INFO:tasks.workunit.client.1.smithi159.stdout:2/613: write da/d40/f1d [3706070,100301] 0 2022-02-02T18:23:03.400 INFO:tasks.workunit.client.1.smithi159.stdout:2/614: write da/d48/d6d/d3e/fca [2165091,28308] 0 2022-02-02T18:23:03.400 INFO:tasks.workunit.client.1.smithi159.stdout:2/615: creat da/d1c/d47/fd6 x:0 0 0 2022-02-02T18:23:03.401 INFO:tasks.workunit.client.1.smithi159.stdout:2/616: chown da/d48/d6d/d3e/f7f 6 1 2022-02-02T18:23:03.402 INFO:tasks.workunit.client.1.smithi159.stdout:2/617: mkdir da/d1c/dd7 0 2022-02-02T18:23:03.432 INFO:tasks.workunit.client.1.smithi159.stdout:2/618: dwrite da/d1c/d25/f9f [0,4194304] 0 2022-02-02T18:23:03.441 INFO:tasks.workunit.client.1.smithi159.stdout:2/619: write da/d1c/d42/d70/f8a [213818,58513] 0 2022-02-02T18:23:03.441 INFO:tasks.workunit.client.1.smithi159.stdout:2/620: dread - da/d1c/d47/fd6 zero size 2022-02-02T18:23:03.442 INFO:tasks.workunit.client.1.smithi159.stdout:2/621: fdatasync da/d1c/d25/d73/dab/f4b 0 2022-02-02T18:23:03.443 INFO:tasks.workunit.client.1.smithi159.stdout:2/622: mkdir da/d1c/d47/d6b/d5a/dd8 0 2022-02-02T18:23:03.445 INFO:tasks.workunit.client.1.smithi159.stdout:2/623: chown da/d40/l17 109911521 1 2022-02-02T18:23:03.446 INFO:tasks.workunit.client.1.smithi159.stdout:2/624: creat da/d1c/d47/d54/fd9 x:0 0 0 2022-02-02T18:23:03.462 INFO:tasks.workunit.client.1.smithi159.stdout:2/625: dwrite da/d48/d83/f89 [4194304,4194304] 0 2022-02-02T18:23:03.464 INFO:tasks.workunit.client.1.smithi159.stdout:2/626: rename da/d48/f9a to da/d40/daf/fda 0 2022-02-02T18:23:03.465 INFO:tasks.workunit.client.1.smithi159.stdout:2/627: creat da/d1c/d47/fdb x:0 0 0 2022-02-02T18:23:03.466 INFO:tasks.workunit.client.1.smithi159.stdout:2/628: truncate da/d1c/d47/fa0 719597 0 2022-02-02T18:23:03.467 INFO:tasks.workunit.client.1.smithi159.stdout:2/629: stat da/d1c/d25/f9f 0 2022-02-02T18:23:03.467 INFO:tasks.workunit.client.1.smithi159.stdout:2/630: dread - da/d1c/d47/fdb zero size 2022-02-02T18:23:03.473 INFO:tasks.workunit.client.1.smithi159.stdout:2/631: dread da/d40/f13 [0,4194304] 0 2022-02-02T18:23:03.475 INFO:tasks.workunit.client.1.smithi159.stdout:2/632: creat da/d40/daf/fdc x:0 0 0 2022-02-02T18:23:03.476 INFO:tasks.workunit.client.1.smithi159.stdout:2/633: creat da/d48/d6d/d3e/fdd x:0 0 0 2022-02-02T18:23:03.478 INFO:tasks.workunit.client.1.smithi159.stdout:2/634: mkdir da/d40/dde 0 2022-02-02T18:23:03.479 INFO:tasks.workunit.client.1.smithi159.stdout:2/635: mkdir da/d1c/d47/d6b/d5a/d7e/ddf 0 2022-02-02T18:23:03.480 INFO:tasks.workunit.client.1.smithi159.stdout:2/636: chown da/d40/l10 88879146 1 2022-02-02T18:23:03.480 INFO:tasks.workunit.client.1.smithi159.stdout:2/637: read - da/d48/fc1 zero size 2022-02-02T18:23:03.499 INFO:tasks.workunit.client.1.smithi159.stdout:1/488: sync 2022-02-02T18:23:03.500 INFO:tasks.workunit.client.1.smithi159.stdout:3/493: sync 2022-02-02T18:23:03.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/489: fdatasync df/d14/d16/f60 0 2022-02-02T18:23:03.500 INFO:tasks.workunit.client.1.smithi159.stdout:3/494: write dd/d19/d38/d94/f96 [643858,3355] 0 2022-02-02T18:23:03.502 INFO:tasks.workunit.client.1.smithi159.stdout:3/495: creat dd/d19/d38/d3f/d7d/f9c x:0 0 0 2022-02-02T18:23:03.502 INFO:tasks.workunit.client.1.smithi159.stdout:3/496: chown dd/d66/d92/d51/f7e 142157650 1 2022-02-02T18:23:03.502 INFO:tasks.workunit.client.1.smithi159.stdout:1/490: symlink df/d14/d16/d4a/lb0 0 2022-02-02T18:23:03.503 INFO:tasks.workunit.client.1.smithi159.stdout:5/584: sync 2022-02-02T18:23:03.505 INFO:tasks.workunit.client.1.smithi159.stdout:2/638: dwrite da/d1c/d47/d6b/d5a/d7e/f82 [0,4194304] 0 2022-02-02T18:23:03.506 INFO:tasks.workunit.client.1.smithi159.stdout:3/497: creat dd/d19/d38/d3f/d80/d8a/f9d x:0 0 0 2022-02-02T18:23:03.506 INFO:tasks.workunit.client.1.smithi159.stdout:1/491: readlink df/d14/d16/d4a/l50 0 2022-02-02T18:23:03.506 INFO:tasks.workunit.client.1.smithi159.stdout:1/492: truncate df/d14/d16/d4b/da0/fa2 997063 0 2022-02-02T18:23:03.508 INFO:tasks.workunit.client.1.smithi159.stdout:3/498: write dd/d19/d35/f4c [1666491,46562] 0 2022-02-02T18:23:03.508 INFO:tasks.workunit.client.1.smithi159.stdout:3/499: stat dd/d20/d2a/d31 0 2022-02-02T18:23:03.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/493: dread df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:03.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/494: readlink df/d14/d16/d4a/d8b/laa 0 2022-02-02T18:23:03.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/495: fdatasync df/d14/f5a 0 2022-02-02T18:23:03.510 INFO:tasks.workunit.client.1.smithi159.stdout:1/496: chown df/d21/d23/d49/da1/dac/laf 311 1 2022-02-02T18:23:03.511 INFO:tasks.workunit.client.1.smithi159.stdout:2/639: mknod da/d1c/d42/d70/ce0 0 2022-02-02T18:23:03.514 INFO:tasks.workunit.client.1.smithi159.stdout:1/497: creat df/d21/d23/fb1 x:0 0 0 2022-02-02T18:23:03.515 INFO:tasks.workunit.client.1.smithi159.stdout:1/498: chown df/d14/l75 1868399 1 2022-02-02T18:23:03.515 INFO:tasks.workunit.client.1.smithi159.stdout:1/499: fsync df/d14/d16/d4b/d5b/f2e 0 2022-02-02T18:23:03.517 INFO:tasks.workunit.client.1.smithi159.stdout:5/585: dread d9/d24/d38/d88/f94 [0,4194304] 0 2022-02-02T18:23:03.519 INFO:tasks.workunit.client.1.smithi159.stdout:5/586: truncate d9/d24/d37/d23/d68/f7e 477865 0 2022-02-02T18:23:03.520 INFO:tasks.workunit.client.1.smithi159.stdout:3/500: rename dd/f28 to dd/f9e 0 2022-02-02T18:23:03.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/500: dread df/d21/f66 [0,4194304] 0 2022-02-02T18:23:03.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/501: read - df/d14/f91 zero size 2022-02-02T18:23:03.523 INFO:tasks.workunit.client.1.smithi159.stdout:3/501: write dd/d20/d2a/d31/f57 [3094000,94903] 0 2022-02-02T18:23:03.524 INFO:tasks.workunit.client.1.smithi159.stdout:3/502: creat dd/d19/d38/d3f/d80/d8a/f9f x:0 0 0 2022-02-02T18:23:03.525 INFO:tasks.workunit.client.1.smithi159.stdout:2/640: read da/d48/d83/f95 [225372,27635] 0 2022-02-02T18:23:03.529 INFO:tasks.workunit.client.1.smithi159.stdout:3/503: creat dd/d19/d38/d3f/d80/fa0 x:0 0 0 2022-02-02T18:23:03.531 INFO:tasks.workunit.client.1.smithi159.stdout:3/504: mkdir dd/d66/da1 0 2022-02-02T18:23:03.534 INFO:tasks.workunit.client.1.smithi159.stdout:2/641: dread da/d1c/d42/fb9 [8388608,4194304] 0 2022-02-02T18:23:03.539 INFO:tasks.workunit.client.1.smithi159.stdout:2/642: write f9 [3621273,88678] 0 2022-02-02T18:23:03.540 INFO:tasks.workunit.client.1.smithi159.stdout:2/643: symlink da/d1c/d47/d6b/d5a/d7e/le1 0 2022-02-02T18:23:03.541 INFO:tasks.workunit.client.1.smithi159.stdout:2/644: symlink da/d1c/d47/dc7/le2 0 2022-02-02T18:23:03.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/587: dwrite d9/d2e/f53 [0,4194304] 0 2022-02-02T18:23:03.547 INFO:tasks.workunit.client.1.smithi159.stdout:1/502: dwrite df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:03.548 INFO:tasks.workunit.client.1.smithi159.stdout:3/505: dread dd/d19/f2b [0,4194304] 0 2022-02-02T18:23:03.551 INFO:tasks.workunit.client.1.smithi159.stdout:1/503: rename c5 to df/d21/d23/d49/d69/d6c/cb2 0 2022-02-02T18:23:03.551 INFO:tasks.workunit.client.1.smithi159.stdout:1/504: dread - df/d14/d16/d4b/d5b/f8d zero size 2022-02-02T18:23:03.551 INFO:tasks.workunit.client.1.smithi159.stdout:1/505: write df/d14/f91 [854224,61174] 0 2022-02-02T18:23:03.553 INFO:tasks.workunit.client.1.smithi159.stdout:1/506: symlink df/d14/d16/lb3 0 2022-02-02T18:23:03.553 INFO:tasks.workunit.client.1.smithi159.stdout:3/506: write dd/d20/f54 [2873386,81828] 0 2022-02-02T18:23:03.556 INFO:tasks.workunit.client.1.smithi159.stdout:2/645: write da/d40/f37 [1057128,62635] 0 2022-02-02T18:23:03.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/507: mknod dd/d66/d82/ca2 0 2022-02-02T18:23:03.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/508: chown dd/d66/f9b 129 1 2022-02-02T18:23:03.558 INFO:tasks.workunit.client.1.smithi159.stdout:2/646: chown da/d48/f71 243 1 2022-02-02T18:23:03.560 INFO:tasks.workunit.client.1.smithi159.stdout:2/647: creat da/d1c/d47/d6b/d7c/fe3 x:0 0 0 2022-02-02T18:23:03.560 INFO:tasks.workunit.client.1.smithi159.stdout:2/648: chown da/d1c/d76 0 1 2022-02-02T18:23:03.567 INFO:tasks.workunit.client.1.smithi159.stdout:5/588: dwrite d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:23:03.567 INFO:tasks.workunit.client.1.smithi159.stdout:5/589: creat d9/d24/d4a/d91/fae x:0 0 0 2022-02-02T18:23:03.569 INFO:tasks.workunit.client.1.smithi159.stdout:5/590: mknod d9/d24/d38/d3c/d61/caf 0 2022-02-02T18:23:03.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/591: dread - d9/d24/d21/f9c zero size 2022-02-02T18:23:03.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/592: creat d9/d24/fb0 x:0 0 0 2022-02-02T18:23:03.571 INFO:tasks.workunit.client.1.smithi159.stdout:5/593: truncate d9/d24/fb0 316249 0 2022-02-02T18:23:03.577 INFO:tasks.workunit.client.1.smithi159.stdout:5/594: dread d9/f47 [0,4194304] 0 2022-02-02T18:23:03.578 INFO:tasks.workunit.client.1.smithi159.stdout:3/509: dwrite dd/d19/d38/d3f/d52/f5b [0,4194304] 0 2022-02-02T18:23:03.580 INFO:tasks.workunit.client.1.smithi159.stdout:3/510: mkdir dd/d19/d38/d94/da3 0 2022-02-02T18:23:03.580 INFO:tasks.workunit.client.1.smithi159.stdout:3/511: chown dd/f1c 14 1 2022-02-02T18:23:03.581 INFO:tasks.workunit.client.1.smithi159.stdout:3/512: mkdir dd/d66/da1/da4 0 2022-02-02T18:23:03.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/513: getdents dd/d20/d60 0 2022-02-02T18:23:03.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/514: creat dd/d19/d38/d3f/d7d/fa5 x:0 0 0 2022-02-02T18:23:03.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/515: chown dd 70 1 2022-02-02T18:23:03.588 INFO:tasks.workunit.client.1.smithi159.stdout:2/649: dwrite da/d1c/d25/d73/dab/f2c [0,4194304] 0 2022-02-02T18:23:03.588 INFO:tasks.workunit.client.1.smithi159.stdout:3/516: read dd/d66/d92/f6f [1288589,77955] 0 2022-02-02T18:23:03.593 INFO:tasks.workunit.client.1.smithi159.stdout:3/517: link dd/f9e dd/d19/d38/d3f/d80/d8a/fa6 0 2022-02-02T18:23:03.594 INFO:tasks.workunit.client.1.smithi159.stdout:3/518: write dd/d66/d92/f93 [377307,90798] 0 2022-02-02T18:23:03.594 INFO:tasks.workunit.client.1.smithi159.stdout:3/519: creat dd/d66/d69/fa7 x:0 0 0 2022-02-02T18:23:03.596 INFO:tasks.workunit.client.1.smithi159.stdout:3/520: rename dd/d20/d60/f8d to dd/d20/d60/fa8 0 2022-02-02T18:23:03.596 INFO:tasks.workunit.client.1.smithi159.stdout:3/521: chown dd/d20/d2a/f75 892704681 1 2022-02-02T18:23:03.597 INFO:tasks.workunit.client.1.smithi159.stdout:3/522: write dd/d20/d60/f85 [5264747,115766] 0 2022-02-02T18:23:03.598 INFO:tasks.workunit.client.1.smithi159.stdout:2/650: dread da/d1c/d47/d6b/f5c [0,4194304] 0 2022-02-02T18:23:03.598 INFO:tasks.workunit.client.1.smithi159.stdout:2/651: write da/d48/d6d/d3e/fad [57922,128198] 0 2022-02-02T18:23:03.599 INFO:tasks.workunit.client.1.smithi159.stdout:5/595: dwrite d9/d2e/d63/f6b [4194304,4194304] 0 2022-02-02T18:23:03.599 INFO:tasks.workunit.client.1.smithi159.stdout:3/523: rename dd/d19/f2b to dd/d19/d35/fa9 0 2022-02-02T18:23:03.601 INFO:tasks.workunit.client.1.smithi159.stdout:5/596: mkdir d9/d2e/db1 0 2022-02-02T18:23:03.602 INFO:tasks.workunit.client.1.smithi159.stdout:5/597: creat d9/fb2 x:0 0 0 2022-02-02T18:23:03.602 INFO:tasks.workunit.client.1.smithi159.stdout:5/598: write d9/d24/d38/f60 [4914649,44040] 0 2022-02-02T18:23:03.604 INFO:tasks.workunit.client.1.smithi159.stdout:5/599: creat d9/d2e/db1/fb3 x:0 0 0 2022-02-02T18:23:03.608 INFO:tasks.workunit.client.1.smithi159.stdout:5/600: unlink d9/l17 0 2022-02-02T18:23:03.609 INFO:tasks.workunit.client.1.smithi159.stdout:2/652: dread da/d1c/d42/f81 [0,4194304] 0 2022-02-02T18:23:03.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/524: dwrite dd/d19/d38/d3f/d80/f5a [0,4194304] 0 2022-02-02T18:23:03.637 INFO:tasks.workunit.client.1.smithi159.stdout:3/525: chown dd/d20/f89 110184 1 2022-02-02T18:23:03.638 INFO:tasks.workunit.client.1.smithi159.stdout:3/526: chown dd/c12 1048 1 2022-02-02T18:23:03.639 INFO:tasks.workunit.client.1.smithi159.stdout:5/601: dwrite d9/d24/d4a/d91/fae [0,4194304] 0 2022-02-02T18:23:03.640 INFO:tasks.workunit.client.1.smithi159.stdout:2/653: dwrite da/d48/d6d/f93 [0,4194304] 0 2022-02-02T18:23:03.642 INFO:tasks.workunit.client.1.smithi159.stdout:5/602: creat d9/d24/d21/d44/fb4 x:0 0 0 2022-02-02T18:23:03.644 INFO:tasks.workunit.client.1.smithi159.stdout:2/654: mknod da/d1c/d47/ce4 0 2022-02-02T18:23:03.645 INFO:tasks.workunit.client.1.smithi159.stdout:5/603: rename d9/f8f to d9/d24/d38/d3c/d8c/fb5 0 2022-02-02T18:23:03.645 INFO:tasks.workunit.client.1.smithi159.stdout:2/655: dread - da/d1c/d47/d54/f9b zero size 2022-02-02T18:23:03.645 INFO:tasks.workunit.client.1.smithi159.stdout:2/656: chown da/d1c 1589937 1 2022-02-02T18:23:03.646 INFO:tasks.workunit.client.1.smithi159.stdout:2/657: write da/d1c/d47/d6b/d7c/fe3 [200597,19882] 0 2022-02-02T18:23:03.646 INFO:tasks.workunit.client.1.smithi159.stdout:5/604: creat d9/d24/d21/d44/fb6 x:0 0 0 2022-02-02T18:23:03.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/527: dread dd/d19/f46 [0,4194304] 0 2022-02-02T18:23:03.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/528: dread - dd/d20/f64 zero size 2022-02-02T18:23:03.672 INFO:tasks.workunit.client.1.smithi159.stdout:2/658: write da/d1c/d47/f64 [4963874,93505] 0 2022-02-02T18:23:03.672 INFO:tasks.workunit.client.1.smithi159.stdout:2/659: fdatasync da/d48/d6d/d3e/fdd 0 2022-02-02T18:23:03.674 INFO:tasks.workunit.client.1.smithi159.stdout:2/660: mknod da/d1c/d42/d70/ce5 0 2022-02-02T18:23:03.674 INFO:tasks.workunit.client.1.smithi159.stdout:6/570: sync 2022-02-02T18:23:03.674 INFO:tasks.workunit.client.1.smithi159.stdout:8/518: sync 2022-02-02T18:23:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:7/677: sync 2022-02-02T18:23:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:6/571: stat df/d35/d2a/d2f/f85 0 2022-02-02T18:23:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:6/572: stat f1 0 2022-02-02T18:23:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:6/573: dread - df/d35/d2a/d2f/f85 zero size 2022-02-02T18:23:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:7/678: creat d3/d5/d95/fe1 x:0 0 0 2022-02-02T18:23:03.676 INFO:tasks.workunit.client.1.smithi159.stdout:9/560: sync 2022-02-02T18:23:03.676 INFO:tasks.workunit.client.1.smithi159.stdout:4/499: sync 2022-02-02T18:23:03.676 INFO:tasks.workunit.client.1.smithi159.stdout:5/605: dwrite d9/d24/d38/d3c/d8c/fb5 [0,4194304] 0 2022-02-02T18:23:03.677 INFO:tasks.workunit.client.1.smithi159.stdout:3/529: dwrite dd/d19/d38/d3f/f50 [0,4194304] 0 2022-02-02T18:23:03.677 INFO:tasks.workunit.client.1.smithi159.stdout:8/519: rename d1/d26/d48/c6c to d1/dad/d95/cb4 0 2022-02-02T18:23:03.678 INFO:tasks.workunit.client.1.smithi159.stdout:2/661: write da/d1c/d76/f87 [1332031,5366] 0 2022-02-02T18:23:03.678 INFO:tasks.workunit.client.1.smithi159.stdout:7/679: creat d3/d2a/dcc/d8b/d8c/d99/fe2 x:0 0 0 2022-02-02T18:23:03.678 INFO:tasks.workunit.client.1.smithi159.stdout:7/680: dread - d3/d5/d56/d2f/fd1 zero size 2022-02-02T18:23:03.679 INFO:tasks.workunit.client.1.smithi159.stdout:9/561: creat d4/d7a/db7/fb8 x:0 0 0 2022-02-02T18:23:03.681 INFO:tasks.workunit.client.1.smithi159.stdout:4/500: link d0/d8/f20 d0/d8/d14/da3/faa 0 2022-02-02T18:23:03.682 INFO:tasks.workunit.client.1.smithi159.stdout:4/501: write d0/d8/d24/d4f/fa7 [126915,32788] 0 2022-02-02T18:23:03.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/574: unlink df/l24 0 2022-02-02T18:23:03.688 INFO:tasks.workunit.client.1.smithi159.stdout:2/662: rmdir da/d1c/d76 39 2022-02-02T18:23:03.688 INFO:tasks.workunit.client.1.smithi159.stdout:2/663: truncate da/d1c/d47/d6b/d5a/fae 859805 0 2022-02-02T18:23:03.689 INFO:tasks.workunit.client.1.smithi159.stdout:7/681: truncate d3/d5/f7f 11803679 0 2022-02-02T18:23:03.689 INFO:tasks.workunit.client.1.smithi159.stdout:9/562: mkdir d4/d19/d1c/d21/da8/db9 0 2022-02-02T18:23:03.690 INFO:tasks.workunit.client.1.smithi159.stdout:4/502: creat d0/d8/d41/fab x:0 0 0 2022-02-02T18:23:03.693 INFO:tasks.workunit.client.1.smithi159.stdout:9/563: chown d4/d19/d1c/d21/d95/c83 138 1 2022-02-02T18:23:03.694 INFO:tasks.workunit.client.1.smithi159.stdout:9/564: chown d4/d2a/d87/da1/fa6 105894225 1 2022-02-02T18:23:03.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/575: link df/d35/d7b/db4/d84/fac df/d35/d2a/d2f/d80/d61/fbc 0 2022-02-02T18:23:03.700 INFO:tasks.workunit.client.1.smithi159.stdout:2/664: symlink da/d40/d61/d6c/le6 0 2022-02-02T18:23:03.703 INFO:tasks.workunit.client.1.smithi159.stdout:8/520: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:23:03.704 INFO:tasks.workunit.client.1.smithi159.stdout:8/521: creat d1/dd/d31/d4a/d75/fb5 x:0 0 0 2022-02-02T18:23:03.705 INFO:tasks.workunit.client.1.smithi159.stdout:8/522: truncate d1/d26/f2d 1072391 0 2022-02-02T18:23:03.707 INFO:tasks.workunit.client.1.smithi159.stdout:4/503: dread d0/d8/d24/f42 [0,4194304] 0 2022-02-02T18:23:03.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/565: link d4/d19/l53 d4/d19/d1c/d21/d22/lba 0 2022-02-02T18:23:03.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/566: write d4/d2a/f9d [748004,10165] 0 2022-02-02T18:23:03.708 INFO:tasks.workunit.client.1.smithi159.stdout:5/606: dwrite d9/d24/d21/f81 [0,4194304] 0 2022-02-02T18:23:03.711 INFO:tasks.workunit.client.1.smithi159.stdout:5/607: readlink d9/d24/d21/d44/l59 0 2022-02-02T18:23:03.713 INFO:tasks.workunit.client.1.smithi159.stdout:2/665: link da/d48/d6d/d3e/f56 da/d40/d61/d6c/fe7 0 2022-02-02T18:23:03.714 INFO:tasks.workunit.client.1.smithi159.stdout:5/608: dread - d9/d24/d21/f66 zero size 2022-02-02T18:23:03.714 INFO:tasks.workunit.client.1.smithi159.stdout:5/609: rename d9/d24/d4a/d52/d85 to d9/d24/d4a/d52/d85/db7 22 2022-02-02T18:23:03.716 INFO:tasks.workunit.client.1.smithi159.stdout:0/587: sync 2022-02-02T18:23:03.716 INFO:tasks.workunit.client.1.smithi159.stdout:0/588: truncate d1/d11/d38/d42/daf/f44 1903228 0 2022-02-02T18:23:03.717 INFO:tasks.workunit.client.1.smithi159.stdout:5/610: mknod d9/d24/d38/d88/cb8 0 2022-02-02T18:23:03.717 INFO:tasks.workunit.client.1.smithi159.stdout:3/530: dwrite dd/d20/d2a/d31/f76 [0,4194304] 0 2022-02-02T18:23:03.718 INFO:tasks.workunit.client.1.smithi159.stdout:0/589: creat d1/d11/d38/d42/d47/db0/fce x:0 0 0 2022-02-02T18:23:03.721 INFO:tasks.workunit.client.1.smithi159.stdout:0/590: write d1/d11/d38/d42/daf/f52 [2909610,29865] 0 2022-02-02T18:23:03.721 INFO:tasks.workunit.client.1.smithi159.stdout:0/591: dread - d1/d11/d8d/fc9 zero size 2022-02-02T18:23:03.724 INFO:tasks.workunit.client.1.smithi159.stdout:2/666: creat da/d1c/d47/d6b/fe8 x:0 0 0 2022-02-02T18:23:03.724 INFO:tasks.workunit.client.1.smithi159.stdout:4/504: symlink d0/d8/d14/d36/lac 0 2022-02-02T18:23:03.725 INFO:tasks.workunit.client.1.smithi159.stdout:3/531: creat dd/d20/d60/faa x:0 0 0 2022-02-02T18:23:03.725 INFO:tasks.workunit.client.1.smithi159.stdout:6/576: rmdir df 39 2022-02-02T18:23:03.725 INFO:tasks.workunit.client.1.smithi159.stdout:6/577: fsync df/d35/d7b/db4/f73 0 2022-02-02T18:23:03.726 INFO:tasks.workunit.client.1.smithi159.stdout:4/505: rmdir d0/d8/d14/da3 39 2022-02-02T18:23:03.727 INFO:tasks.workunit.client.1.smithi159.stdout:7/682: write d3/fb [892098,15015] 0 2022-02-02T18:23:03.728 INFO:tasks.workunit.client.1.smithi159.stdout:4/506: write d0/d8/d24/d3a/f60 [6683778,105018] 0 2022-02-02T18:23:03.728 INFO:tasks.workunit.client.1.smithi159.stdout:8/523: dwrite d1/d26/d48/d49/f9b [4194304,4194304] 0 2022-02-02T18:23:03.729 INFO:tasks.workunit.client.1.smithi159.stdout:8/524: dread - d1/d26/f9c zero size 2022-02-02T18:23:03.729 INFO:tasks.workunit.client.1.smithi159.stdout:3/532: symlink dd/d66/d69/d77/lab 0 2022-02-02T18:23:03.732 INFO:tasks.workunit.client.1.smithi159.stdout:6/578: dread df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:23:03.733 INFO:tasks.workunit.client.1.smithi159.stdout:3/533: creat dd/d19/d38/fac x:0 0 0 2022-02-02T18:23:03.733 INFO:tasks.workunit.client.1.smithi159.stdout:3/534: chown dd/d66/d69 40 1 2022-02-02T18:23:03.734 INFO:tasks.workunit.client.1.smithi159.stdout:7/683: mkdir d3/d27/d29/d6b/de3 0 2022-02-02T18:23:03.735 INFO:tasks.workunit.client.1.smithi159.stdout:4/507: mkdir d0/d8/d14/d36/dad 0 2022-02-02T18:23:03.735 INFO:tasks.workunit.client.1.smithi159.stdout:4/508: chown d0/d8/d14/fa2 257 1 2022-02-02T18:23:03.736 INFO:tasks.workunit.client.1.smithi159.stdout:3/535: rename dd/d19/d38/l88 to dd/d20/d60/lad 0 2022-02-02T18:23:03.737 INFO:tasks.workunit.client.1.smithi159.stdout:7/684: mknod d3/d2a/d2c/dd3/ce4 0 2022-02-02T18:23:03.739 INFO:tasks.workunit.client.1.smithi159.stdout:2/667: write da/d48/d83/f95 [1525642,50163] 0 2022-02-02T18:23:03.739 INFO:tasks.workunit.client.1.smithi159.stdout:2/668: fdatasync da/d40/f1d 0 2022-02-02T18:23:03.739 INFO:tasks.workunit.client.1.smithi159.stdout:2/669: chown da/d1c/d47/d6b/cc2 4447132 1 2022-02-02T18:23:03.739 INFO:tasks.workunit.client.1.smithi159.stdout:5/611: dwrite d9/d2e/f2a [4194304,4194304] 0 2022-02-02T18:23:03.740 INFO:tasks.workunit.client.1.smithi159.stdout:5/612: chown d9/d2e/d63/fa5 11 1 2022-02-02T18:23:03.740 INFO:tasks.workunit.client.1.smithi159.stdout:4/509: mkdir d0/d8/d30/d7e/d9c/dae 0 2022-02-02T18:23:03.741 INFO:tasks.workunit.client.1.smithi159.stdout:7/685: mknod d3/d2a/dcc/d8b/ce5 0 2022-02-02T18:23:03.741 INFO:tasks.workunit.client.1.smithi159.stdout:2/670: creat da/d1c/d47/fe9 x:0 0 0 2022-02-02T18:23:03.742 INFO:tasks.workunit.client.1.smithi159.stdout:4/510: mknod d0/d8/d30/d7e/d9c/caf 0 2022-02-02T18:23:03.744 INFO:tasks.workunit.client.1.smithi159.stdout:7/686: unlink d3/d5/d56/fad 0 2022-02-02T18:23:03.744 INFO:tasks.workunit.client.1.smithi159.stdout:7/687: truncate d3/d2a/d4a/d7d/fc8 565676 0 2022-02-02T18:23:03.745 INFO:tasks.workunit.client.1.smithi159.stdout:6/579: dread df/d35/d7b/db4/f96 [0,4194304] 0 2022-02-02T18:23:03.745 INFO:tasks.workunit.client.1.smithi159.stdout:4/511: rename d0/d8/d24/f67 to d0/d8/d30/d7e/d98/fb0 0 2022-02-02T18:23:03.748 INFO:tasks.workunit.client.1.smithi159.stdout:6/580: rename df/d35/d7b/db4/lae to df/d35/d2a/d3f/d91/lbd 0 2022-02-02T18:23:03.749 INFO:tasks.workunit.client.1.smithi159.stdout:4/512: rmdir d0/d8/d24 39 2022-02-02T18:23:03.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/688: rmdir d3/d2a/d2c 39 2022-02-02T18:23:03.750 INFO:tasks.workunit.client.1.smithi159.stdout:0/592: getdents d1/d11/d38/d7e 0 2022-02-02T18:23:03.753 INFO:tasks.workunit.client.1.smithi159.stdout:8/525: symlink d1/d26/d48/d98/lb6 0 2022-02-02T18:23:03.753 INFO:tasks.workunit.client.1.smithi159.stdout:3/536: unlink dd/d19/d38/f48 0 2022-02-02T18:23:03.753 INFO:tasks.workunit.client.1.smithi159.stdout:7/689: creat d3/d27/d6f/fe6 x:0 0 0 2022-02-02T18:23:03.754 INFO:tasks.workunit.client.1.smithi159.stdout:3/537: creat dd/d19/fae x:0 0 0 2022-02-02T18:23:03.757 INFO:tasks.workunit.client.1.smithi159.stdout:5/613: creat d9/d24/d37/d23/d68/fb9 x:0 0 0 2022-02-02T18:23:03.774 INFO:tasks.workunit.client.1.smithi159.stdout:8/526: rename d1/dd/d31/d4a to d1/db7 0 2022-02-02T18:23:03.774 INFO:tasks.workunit.client.1.smithi159.stdout:8/527: fdatasync d1/dd/d2c/d67/f50 0 2022-02-02T18:23:03.776 INFO:tasks.workunit.client.1.smithi159.stdout:8/528: link d1/l6 d1/d26/d48/d99/lb8 0 2022-02-02T18:23:03.776 INFO:tasks.workunit.client.1.smithi159.stdout:3/538: rename dd/d20/d2a/c8b to dd/d66/caf 0 2022-02-02T18:23:03.778 INFO:tasks.workunit.client.1.smithi159.stdout:3/539: rmdir dd/d19/d38/d94/da3 0 2022-02-02T18:23:03.779 INFO:tasks.workunit.client.1.smithi159.stdout:3/540: mkdir dd/d66/d69/db0 0 2022-02-02T18:23:03.780 INFO:tasks.workunit.client.1.smithi159.stdout:3/541: fdatasync dd/d19/d35/f44 0 2022-02-02T18:23:03.780 INFO:tasks.workunit.client.1.smithi159.stdout:3/542: rename dd/d19/d38/d3f/d80 to dd/d19/d38/d3f/d80/d97/db1 22 2022-02-02T18:23:03.781 INFO:tasks.workunit.client.1.smithi159.stdout:3/543: creat dd/d66/d69/d77/fb2 x:0 0 0 2022-02-02T18:23:03.787 INFO:tasks.workunit.client.1.smithi159.stdout:2/671: dwrite da/d1c/d25/d73/dab/f33 [0,4194304] 0 2022-02-02T18:23:03.793 INFO:tasks.workunit.client.1.smithi159.stdout:7/690: dwrite d3/d27/d29/d6b/f98 [0,4194304] 0 2022-02-02T18:23:03.793 INFO:tasks.workunit.client.1.smithi159.stdout:2/672: mknod da/d1c/d47/cea 0 2022-02-02T18:23:03.799 INFO:tasks.workunit.client.1.smithi159.stdout:0/593: dwrite d1/d11/d38/d42/d47/fcd [0,4194304] 0 2022-02-02T18:23:03.800 INFO:tasks.workunit.client.1.smithi159.stdout:0/594: chown d1/d19/d3d/l8b 835303 1 2022-02-02T18:23:03.800 INFO:tasks.workunit.client.1.smithi159.stdout:5/614: dwrite d9/d24/d37/d23/f86 [0,4194304] 0 2022-02-02T18:23:03.801 INFO:tasks.workunit.client.1.smithi159.stdout:7/691: mkdir d3/d5/d56/d2f/de7 0 2022-02-02T18:23:03.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/529: dwrite d1/f7b [0,4194304] 0 2022-02-02T18:23:03.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/530: write d1/dd/d1a/d53/f6d [1042238,14117] 0 2022-02-02T18:23:03.804 INFO:tasks.workunit.client.1.smithi159.stdout:6/581: write df/d35/d2a/d3f/d42/d47/f86 [378953,22851] 0 2022-02-02T18:23:03.804 INFO:tasks.workunit.client.1.smithi159.stdout:6/582: read - df/d35/d2a/f5c zero size 2022-02-02T18:23:03.805 INFO:tasks.workunit.client.1.smithi159.stdout:6/583: readlink df/d35/da2/laf 0 2022-02-02T18:23:03.805 INFO:tasks.workunit.client.1.smithi159.stdout:0/595: symlink d1/d11/d38/d42/d56/lcf 0 2022-02-02T18:23:03.806 INFO:tasks.workunit.client.1.smithi159.stdout:2/673: rename da/l2b to da/d1c/d47/d6b/d5a/d7e/ddf/leb 0 2022-02-02T18:23:03.806 INFO:tasks.workunit.client.1.smithi159.stdout:7/692: link d3/d27/f66 d3/d5/d95/dbe/fe8 0 2022-02-02T18:23:03.806 INFO:tasks.workunit.client.1.smithi159.stdout:7/693: fsync d3/d2a/f47 0 2022-02-02T18:23:03.807 INFO:tasks.workunit.client.1.smithi159.stdout:4/513: dwrite d0/d8/d41/f5e [0,4194304] 0 2022-02-02T18:23:03.807 INFO:tasks.workunit.client.1.smithi159.stdout:3/544: dwrite dd/d20/f89 [0,4194304] 0 2022-02-02T18:23:03.807 INFO:tasks.workunit.client.1.smithi159.stdout:3/545: chown dd/d19/d38/d3f/d52 1764196398 1 2022-02-02T18:23:03.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/694: rename d3/d2a/d4a/d7d/fc8 to d3/d2a/d2c/dd3/fe9 0 2022-02-02T18:23:03.811 INFO:tasks.workunit.client.1.smithi159.stdout:8/531: mknod d1/d26/d48/d49/db3/cb9 0 2022-02-02T18:23:03.811 INFO:tasks.workunit.client.1.smithi159.stdout:8/532: write d1/dd/d2c/d67/fa4 [673089,21249] 0 2022-02-02T18:23:03.812 INFO:tasks.workunit.client.1.smithi159.stdout:8/533: readlink d1/dd/d2c/l56 0 2022-02-02T18:23:03.812 INFO:tasks.workunit.client.1.smithi159.stdout:8/534: chown d1/d26/f2d 907 1 2022-02-02T18:23:03.812 INFO:tasks.workunit.client.1.smithi159.stdout:2/674: dread da/d40/f88 [0,4194304] 0 2022-02-02T18:23:03.813 INFO:tasks.workunit.client.1.smithi159.stdout:5/615: mkdir d9/d24/d37/d23/dba 0 2022-02-02T18:23:03.814 INFO:tasks.workunit.client.1.smithi159.stdout:8/535: creat d1/dc/fba x:0 0 0 2022-02-02T18:23:03.814 INFO:tasks.workunit.client.1.smithi159.stdout:4/514: creat d0/d8/d15/fb1 x:0 0 0 2022-02-02T18:23:03.815 INFO:tasks.workunit.client.1.smithi159.stdout:5/616: mknod d9/d24/d4a/d8d/cbb 0 2022-02-02T18:23:03.815 INFO:tasks.workunit.client.1.smithi159.stdout:5/617: fdatasync d9/d24/f16 0 2022-02-02T18:23:03.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/584: rename df/d35/d2a/d3f/d65/f6c to df/d35/d7b/db4/d84/d9d/fbe 0 2022-02-02T18:23:03.820 INFO:tasks.workunit.client.1.smithi159.stdout:0/596: unlink d1/c13 0 2022-02-02T18:23:03.823 INFO:tasks.workunit.client.1.smithi159.stdout:5/618: symlink d9/d24/d4a/d52/lbc 0 2022-02-02T18:23:03.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/585: mknod df/d35/da2/cbf 0 2022-02-02T18:23:03.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/586: dread - df/d35/d2a/d3f/d65/fba zero size 2022-02-02T18:23:03.824 INFO:tasks.workunit.client.1.smithi159.stdout:4/515: write d0/d8/d30/d7e/f82 [461352,84799] 0 2022-02-02T18:23:03.826 INFO:tasks.workunit.client.1.smithi159.stdout:5/619: rename d9/d24/c5e to d9/d2e/db1/cbd 0 2022-02-02T18:23:03.828 INFO:tasks.workunit.client.1.smithi159.stdout:5/620: rename d9/d24/d38/d88/f9e to d9/d24/d37/d23/dba/fbe 0 2022-02-02T18:23:03.831 INFO:tasks.workunit.client.1.smithi159.stdout:0/597: symlink d1/d19/d3d/ld0 0 2022-02-02T18:23:03.832 INFO:tasks.workunit.client.1.smithi159.stdout:3/546: unlink dd/d19/f33 0 2022-02-02T18:23:03.832 INFO:tasks.workunit.client.1.smithi159.stdout:3/547: creat dd/d20/d60/fb3 x:0 0 0 2022-02-02T18:23:03.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/695: unlink d3/d5/c37 0 2022-02-02T18:23:03.833 INFO:tasks.workunit.client.1.smithi159.stdout:8/536: dwrite d1/dc/f41 [0,4194304] 0 2022-02-02T18:23:03.833 INFO:tasks.workunit.client.1.smithi159.stdout:5/621: symlink d9/d24/d37/d23/d68/lbf 0 2022-02-02T18:23:03.834 INFO:tasks.workunit.client.1.smithi159.stdout:0/598: symlink d1/dd/d4b/da7/da8/ld1 0 2022-02-02T18:23:03.836 INFO:tasks.workunit.client.1.smithi159.stdout:4/516: mknod d0/d8/d14/d33/d47/d56/cb2 0 2022-02-02T18:23:03.838 INFO:tasks.workunit.client.1.smithi159.stdout:7/696: dread d3/d5/d56/d2f/fb2 [0,4194304] 0 2022-02-02T18:23:03.839 INFO:tasks.workunit.client.1.smithi159.stdout:4/517: read d0/d8/d15/d61/f93 [1216205,89369] 0 2022-02-02T18:23:03.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/675: dread da/d1c/d25/d73/dab/f6a [0,4194304] 0 2022-02-02T18:23:03.844 INFO:tasks.workunit.client.1.smithi159.stdout:7/697: truncate d3/d27/d29/d5e/f73 959780 0 2022-02-02T18:23:03.844 INFO:tasks.workunit.client.1.smithi159.stdout:7/698: chown d3/d5/d95/fe1 2218 1 2022-02-02T18:23:03.845 INFO:tasks.workunit.client.1.smithi159.stdout:7/699: chown d3/d5/d95/dbe 3876855 1 2022-02-02T18:23:03.845 INFO:tasks.workunit.client.1.smithi159.stdout:8/537: creat d1/d26/fbb x:0 0 0 2022-02-02T18:23:03.845 INFO:tasks.workunit.client.1.smithi159.stdout:5/622: stat d9/d24/d37/f3a 0 2022-02-02T18:23:03.845 INFO:tasks.workunit.client.1.smithi159.stdout:8/538: stat d1/db7/d75/l77 0 2022-02-02T18:23:03.846 INFO:tasks.workunit.client.1.smithi159.stdout:5/623: dread - d9/d24/d21/d44/fb4 zero size 2022-02-02T18:23:03.846 INFO:tasks.workunit.client.1.smithi159.stdout:0/599: truncate d1/dd/d4b/da7/da8/fc6 2212955 0 2022-02-02T18:23:03.846 INFO:tasks.workunit.client.1.smithi159.stdout:0/600: chown d1/d11/d38/d7c/l9e 4 1 2022-02-02T18:23:03.847 INFO:tasks.workunit.client.1.smithi159.stdout:8/539: truncate d1/dd/d2c/d67/f50 3109142 0 2022-02-02T18:23:03.847 INFO:tasks.workunit.client.1.smithi159.stdout:5/624: creat d9/d2e/d71/fc0 x:0 0 0 2022-02-02T18:23:03.847 INFO:tasks.workunit.client.1.smithi159.stdout:2/676: mkdir da/d1c/d42/d70/dec 0 2022-02-02T18:23:03.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/677: readlink da/l14 0 2022-02-02T18:23:03.849 INFO:tasks.workunit.client.1.smithi159.stdout:5/625: rmdir d9/d24/d4a 39 2022-02-02T18:23:03.849 INFO:tasks.workunit.client.1.smithi159.stdout:0/601: symlink d1/dd/ld2 0 2022-02-02T18:23:03.849 INFO:tasks.workunit.client.1.smithi159.stdout:7/700: rename d3/d27/f3b to d3/d5/d56/d57/fea 0 2022-02-02T18:23:03.850 INFO:tasks.workunit.client.1.smithi159.stdout:8/540: unlink d1/dd/d2c/d67/c52 0 2022-02-02T18:23:03.851 INFO:tasks.workunit.client.1.smithi159.stdout:7/701: mkdir d3/d2a/d4a/d7d/deb 0 2022-02-02T18:23:03.851 INFO:tasks.workunit.client.1.smithi159.stdout:7/702: fsync d3/d2a/d2c/fb4 0 2022-02-02T18:23:03.852 INFO:tasks.workunit.client.1.smithi159.stdout:0/602: symlink d1/dd/d4b/da7/dc1/ld3 0 2022-02-02T18:23:03.853 INFO:tasks.workunit.client.1.smithi159.stdout:2/678: write da/d48/d6d/f93 [2322854,112643] 0 2022-02-02T18:23:03.853 INFO:tasks.workunit.client.1.smithi159.stdout:2/679: write da/d48/d6d/d3e/fad [867996,72739] 0 2022-02-02T18:23:03.854 INFO:tasks.workunit.client.1.smithi159.stdout:0/603: symlink d1/dd/d4b/da7/dc1/ld4 0 2022-02-02T18:23:03.854 INFO:tasks.workunit.client.1.smithi159.stdout:8/541: mknod d1/dd/d31/cbc 0 2022-02-02T18:23:03.855 INFO:tasks.workunit.client.1.smithi159.stdout:2/680: mknod da/d1c/d47/d6b/d59/ced 0 2022-02-02T18:23:03.860 INFO:tasks.workunit.client.1.smithi159.stdout:3/548: dwrite dd/d66/d92/f91 [0,4194304] 0 2022-02-02T18:23:03.862 INFO:tasks.workunit.client.1.smithi159.stdout:6/587: dwrite f3 [0,4194304] 0 2022-02-02T18:23:03.865 INFO:tasks.workunit.client.1.smithi159.stdout:7/703: dread d3/d27/d29/d6b/f98 [0,4194304] 0 2022-02-02T18:23:03.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/704: readlink d3/d5/ld4 0 2022-02-02T18:23:03.866 INFO:tasks.workunit.client.1.smithi159.stdout:8/542: dread d1/dd/d31/f3f [4194304,4194304] 0 2022-02-02T18:23:03.867 INFO:tasks.workunit.client.1.smithi159.stdout:8/543: fdatasync d1/d26/d48/f55 0 2022-02-02T18:23:03.867 INFO:tasks.workunit.client.1.smithi159.stdout:4/518: write d0/d8/f3c [479810,30500] 0 2022-02-02T18:23:03.869 INFO:tasks.workunit.client.1.smithi159.stdout:6/588: readlink df/d35/d2a/d3f/d42/l32 0 2022-02-02T18:23:03.875 INFO:tasks.workunit.client.1.smithi159.stdout:2/681: dwrite da/d40/f98 [4194304,4194304] 0 2022-02-02T18:23:03.878 INFO:tasks.workunit.client.1.smithi159.stdout:8/544: mkdir d1/dd/d2c/d67/d5f/d8a/dbd 0 2022-02-02T18:23:03.878 INFO:tasks.workunit.client.1.smithi159.stdout:8/545: read - d1/dc/fba zero size 2022-02-02T18:23:03.879 INFO:tasks.workunit.client.1.smithi159.stdout:3/549: rmdir dd/d19/d38 39 2022-02-02T18:23:03.879 INFO:tasks.workunit.client.1.smithi159.stdout:0/604: getdents d1/dd/d4b/da7/dc1 0 2022-02-02T18:23:03.879 INFO:tasks.workunit.client.1.smithi159.stdout:0/605: stat d1/dd/lf 0 2022-02-02T18:23:03.881 INFO:tasks.workunit.client.1.smithi159.stdout:6/589: mkdir df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0 0 2022-02-02T18:23:03.894 INFO:tasks.workunit.client.1.smithi159.stdout:7/705: mknod d3/d5/d56/d2f/cec 0 2022-02-02T18:23:03.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/682: symlink da/dce/lee 0 2022-02-02T18:23:03.895 INFO:tasks.workunit.client.1.smithi159.stdout:4/519: link d0/d8/d15/f2a d0/d8/fb3 0 2022-02-02T18:23:03.896 INFO:tasks.workunit.client.1.smithi159.stdout:6/590: rmdir df/d35/d2a/d3f/d42/d47 39 2022-02-02T18:23:03.897 INFO:tasks.workunit.client.1.smithi159.stdout:7/706: symlink d3/d5/d56/d2f/de7/led 0 2022-02-02T18:23:03.898 INFO:tasks.workunit.client.1.smithi159.stdout:2/683: creat da/d1c/d42/fef x:0 0 0 2022-02-02T18:23:03.899 INFO:tasks.workunit.client.1.smithi159.stdout:2/684: fsync da/d1c/d47/fdb 0 2022-02-02T18:23:03.899 INFO:tasks.workunit.client.1.smithi159.stdout:4/520: stat d0/d8/d30/c31 0 2022-02-02T18:23:03.900 INFO:tasks.workunit.client.1.smithi159.stdout:4/521: truncate d0/d8/d41/f9d 198652 0 2022-02-02T18:23:03.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/685: creat da/d1c/d25/d73/ff0 x:0 0 0 2022-02-02T18:23:03.903 INFO:tasks.workunit.client.1.smithi159.stdout:4/522: link d0/d8/d41/f5e d0/d8/d30/d7e/d98/fb4 0 2022-02-02T18:23:03.905 INFO:tasks.workunit.client.1.smithi159.stdout:6/591: rename df/d35/d7b/db4/f8a to df/d35/d2a/d3f/d42/d47/fc1 0 2022-02-02T18:23:03.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/686: mkdir da/d1c/dd7/df1 0 2022-02-02T18:23:03.909 INFO:tasks.workunit.client.1.smithi159.stdout:6/592: creat df/d35/d2a/d3f/d42/fc2 x:0 0 0 2022-02-02T18:23:03.911 INFO:tasks.workunit.client.1.smithi159.stdout:7/707: rename d3/d2a/d2c/dd3 to d3/d27/d29/d5e/d80/dee 0 2022-02-02T18:23:03.914 INFO:tasks.workunit.client.1.smithi159.stdout:3/550: dwrite dd/d19/d38/d3f/d7d/fa5 [0,4194304] 0 2022-02-02T18:23:03.914 INFO:tasks.workunit.client.1.smithi159.stdout:5/626: dwrite d9/d24/d37/d23/f4f [0,4194304] 0 2022-02-02T18:23:03.915 INFO:tasks.workunit.client.1.smithi159.stdout:8/546: dwrite d1/dd/d1a/d53/f74 [0,4194304] 0 2022-02-02T18:23:03.917 INFO:tasks.workunit.client.1.smithi159.stdout:8/547: mkdir d1/d26/d48/d49/dbe 0 2022-02-02T18:23:03.918 INFO:tasks.workunit.client.1.smithi159.stdout:8/548: mknod d1/dd/d2c/d67/d5f/d8a/cbf 0 2022-02-02T18:23:03.919 INFO:tasks.workunit.client.1.smithi159.stdout:8/549: mkdir d1/d26/d48/d49/dbe/dc0 0 2022-02-02T18:23:03.920 INFO:tasks.workunit.client.1.smithi159.stdout:5/627: write d9/d24/f16 [660985,118162] 0 2022-02-02T18:23:03.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/628: rename d9/d24/d4a/d52/d85 to d9/d24/d4a/d91/dc1 0 2022-02-02T18:23:03.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/629: truncate f7 2043434 0 2022-02-02T18:23:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/523: dwrite d0/d8/d14/d36/f88 [0,4194304] 0 2022-02-02T18:23:03.934 INFO:tasks.workunit.client.1.smithi159.stdout:0/606: dwrite d1/f1c [4194304,4194304] 0 2022-02-02T18:23:03.936 INFO:tasks.workunit.client.1.smithi159.stdout:8/550: dwrite d1/f8 [0,4194304] 0 2022-02-02T18:23:03.936 INFO:tasks.workunit.client.1.smithi159.stdout:8/551: chown d1/dd/d31/f3f 2259 1 2022-02-02T18:23:03.936 INFO:tasks.workunit.client.1.smithi159.stdout:8/552: truncate d1/dd/d2c/d67/f50 3121670 0 2022-02-02T18:23:03.938 INFO:tasks.workunit.client.1.smithi159.stdout:8/553: chown d1/dc/l14 105773259 1 2022-02-02T18:23:03.942 INFO:tasks.workunit.client.1.smithi159.stdout:0/607: getdents d1/d11/d38/d42/d47/db0 0 2022-02-02T18:23:03.942 INFO:tasks.workunit.client.1.smithi159.stdout:5/630: write d9/d24/d37/d23/f6f [384757,13506] 0 2022-02-02T18:23:03.945 INFO:tasks.workunit.client.1.smithi159.stdout:0/608: unlink d1/d11/d38/d42/daf/fbe 0 2022-02-02T18:23:03.945 INFO:tasks.workunit.client.1.smithi159.stdout:0/609: creat d1/d11/d8d/fd5 x:0 0 0 2022-02-02T18:23:03.949 INFO:tasks.workunit.client.1.smithi159.stdout:8/554: dread d1/dd/d1a/d53/f54 [0,4194304] 0 2022-02-02T18:23:03.950 INFO:tasks.workunit.client.1.smithi159.stdout:5/631: mknod d9/d2e/cc2 0 2022-02-02T18:23:03.953 INFO:tasks.workunit.client.1.smithi159.stdout:8/555: creat d1/dd/d2c/d67/fc1 x:0 0 0 2022-02-02T18:23:03.953 INFO:tasks.workunit.client.1.smithi159.stdout:8/556: write d1/dd/d1a/f32 [385541,90635] 0 2022-02-02T18:23:03.953 INFO:tasks.workunit.client.1.smithi159.stdout:5/632: chown d9/l67 0 1 2022-02-02T18:23:03.954 INFO:tasks.workunit.client.1.smithi159.stdout:5/633: symlink d9/d24/d38/d3c/d8c/lc3 0 2022-02-02T18:23:03.958 INFO:tasks.workunit.client.1.smithi159.stdout:0/610: dread d1/d19/f39 [4194304,4194304] 0 2022-02-02T18:23:03.959 INFO:tasks.workunit.client.1.smithi159.stdout:8/557: dread d1/dd/d1a/d53/f74 [0,4194304] 0 2022-02-02T18:23:03.960 INFO:tasks.workunit.client.1.smithi159.stdout:8/558: symlink d1/dad/d95/daa/lc2 0 2022-02-02T18:23:03.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/687: symlink da/d1c/lf2 0 2022-02-02T18:23:03.962 INFO:tasks.workunit.client.1.smithi159.stdout:8/559: read d1/d26/d48/d49/f9b [8109808,35218] 0 2022-02-02T18:23:03.962 INFO:tasks.workunit.client.1.smithi159.stdout:8/560: write d1/dd/d1a/f9a [1079752,16953] 0 2022-02-02T18:23:03.963 INFO:tasks.workunit.client.1.smithi159.stdout:6/593: rmdir df/d35/d2a/d3f/d42/d47/d59/d66/d88/db5 0 2022-02-02T18:23:03.971 INFO:tasks.workunit.client.1.smithi159.stdout:0/611: dread d1/d11/d38/d42/daf/d34/f67 [0,4194304] 0 2022-02-02T18:23:03.973 INFO:tasks.workunit.client.1.smithi159.stdout:4/524: creat d0/d8/d30/d5d/fb5 x:0 0 0 2022-02-02T18:23:03.974 INFO:tasks.workunit.client.1.smithi159.stdout:7/708: rmdir d3/d5/d56/d2f 39 2022-02-02T18:23:03.979 INFO:tasks.workunit.client.1.smithi159.stdout:0/612: fsync d1/d11/d8d/fd5 0 2022-02-02T18:23:03.980 INFO:tasks.workunit.client.1.smithi159.stdout:8/561: dread d1/fa [0,4194304] 0 2022-02-02T18:23:03.980 INFO:tasks.workunit.client.1.smithi159.stdout:8/562: dread - d1/dd/d1a/d53/f72 zero size 2022-02-02T18:23:03.982 INFO:tasks.workunit.client.1.smithi159.stdout:6/594: dwrite df/d35/f78 [0,4194304] 0 2022-02-02T18:23:03.982 INFO:tasks.workunit.client.1.smithi159.stdout:8/563: mkdir d1/db7/d75/dc3 0 2022-02-02T18:23:03.983 INFO:tasks.workunit.client.1.smithi159.stdout:8/564: read d1/dd/f16 [1694500,86199] 0 2022-02-02T18:23:03.989 INFO:tasks.workunit.client.1.smithi159.stdout:7/709: creat d3/d2a/d2c/fef x:0 0 0 2022-02-02T18:23:03.991 INFO:tasks.workunit.client.1.smithi159.stdout:4/525: symlink d0/d8/d14/d36/d4b/lb6 0 2022-02-02T18:23:03.992 INFO:tasks.workunit.client.1.smithi159.stdout:2/688: rename da/d40/c1b to da/d1c/d25/d73/cf3 0 2022-02-02T18:23:03.995 INFO:tasks.workunit.client.1.smithi159.stdout:7/710: symlink d3/d2a/d4a/da1/lf0 0 2022-02-02T18:23:03.996 INFO:tasks.workunit.client.1.smithi159.stdout:2/689: creat da/d48/ff4 x:0 0 0 2022-02-02T18:23:03.997 INFO:tasks.workunit.client.1.smithi159.stdout:0/613: dwrite d1/dd/f8c [0,4194304] 0 2022-02-02T18:23:03.998 INFO:tasks.workunit.client.1.smithi159.stdout:0/614: unlink d1/d11/d38/d7c/c81 0 2022-02-02T18:23:04.001 INFO:tasks.workunit.client.1.smithi159.stdout:6/595: rename df/d35/d2a/d3f/c75 to df/d35/d2a/d3f/d42/cc3 0 2022-02-02T18:23:04.003 INFO:tasks.workunit.client.1.smithi159.stdout:2/690: getdents da/d40 0 2022-02-02T18:23:04.003 INFO:tasks.workunit.client.1.smithi159.stdout:7/711: dread d3/d5/d56/d2f/d5b/fd2 [0,4194304] 0 2022-02-02T18:23:04.004 INFO:tasks.workunit.client.1.smithi159.stdout:6/596: creat df/d35/d2a/d2f/d80/d61/da8/fc4 x:0 0 0 2022-02-02T18:23:04.005 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:03 smithi159 conmon[35668]: cluster 2022-02-02T18:23:02.543773+0000 2022-02-02T18:23:04.006 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:03 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14628) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 19 MiB/s rd, 27 MiB/s wr, 97 op/s 2022-02-02T18:23:04.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/597: creat df/fc5 x:0 0 0 2022-02-02T18:23:04.008 INFO:tasks.workunit.client.1.smithi159.stdout:6/598: write df/d35/d2a/d3f/d55/d6a/f9b [339440,54779] 0 2022-02-02T18:23:04.010 INFO:tasks.workunit.client.1.smithi159.stdout:6/599: rename df/c4e to df/d35/da2/cc6 0 2022-02-02T18:23:04.011 INFO:tasks.workunit.client.1.smithi159.stdout:4/526: dread d0/f2d [0,4194304] 0 2022-02-02T18:23:04.012 INFO:tasks.workunit.client.1.smithi159.stdout:6/600: write f6 [5447137,130687] 0 2022-02-02T18:23:04.013 INFO:tasks.workunit.client.1.smithi159.stdout:4/527: fsync d0/d8/d24/f68 0 2022-02-02T18:23:04.027 INFO:tasks.workunit.client.1.smithi159.stdout:7/712: dread d3/d5/d56/d2f/f38 [0,4194304] 0 2022-02-02T18:23:04.034 INFO:tasks.workunit.client.1.smithi159.stdout:2/691: dwrite da/d40/d61/f8f [0,4194304] 0 2022-02-02T18:23:04.036 INFO:tasks.workunit.client.1.smithi159.stdout:2/692: mkdir da/d1c/d25/d73/dab/df5 0 2022-02-02T18:23:04.041 INFO:tasks.workunit.client.1.smithi159.stdout:6/601: dwrite df/d35/d2a/d3f/fab [0,4194304] 0 2022-02-02T18:23:04.046 INFO:tasks.workunit.client.1.smithi159.stdout:6/602: mknod df/d35/d2a/d3f/d42/d47/cc7 0 2022-02-02T18:23:04.047 INFO:tasks.workunit.client.1.smithi159.stdout:6/603: read df/d35/d2a/d3f/d42/d47/f5e [82976,49784] 0 2022-02-02T18:23:04.048 INFO:tasks.workunit.client.1.smithi159.stdout:6/604: stat df/d35/d2a/d2f/d80/d61/fbc 0 2022-02-02T18:23:04.050 INFO:tasks.workunit.client.1.smithi159.stdout:6/605: fdatasync fd 0 2022-02-02T18:23:04.050 INFO:tasks.workunit.client.1.smithi159.stdout:6/606: chown df/d35/d2a/d3f/d55/fa4 4495423 1 2022-02-02T18:23:04.051 INFO:tasks.workunit.client.1.smithi159.stdout:6/607: creat df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/fc8 x:0 0 0 2022-02-02T18:23:04.054 INFO:tasks.workunit.client.1.smithi159.stdout:6/608: mknod df/d35/d2a/d3f/d42/d47/d59/d66/cc9 0 2022-02-02T18:23:04.054 INFO:tasks.workunit.client.1.smithi159.stdout:4/528: dwrite d0/d8/d14/d33/f50 [4194304,4194304] 0 2022-02-02T18:23:04.055 INFO:tasks.workunit.client.1.smithi159.stdout:6/609: fdatasync df/d35/d2a/d2f/f64 0 2022-02-02T18:23:04.056 INFO:tasks.workunit.client.1.smithi159.stdout:6/610: getdents df/d35/d2a/d3f/d55/d6a 0 2022-02-02T18:23:04.057 INFO:tasks.workunit.client.1.smithi159.stdout:4/529: write d0/f25 [3511481,24882] 0 2022-02-02T18:23:04.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/611: symlink df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/lca 0 2022-02-02T18:23:04.058 INFO:tasks.workunit.client.1.smithi159.stdout:7/713: dwrite d3/d2a/dcc/d8b/d8c/d99/fe2 [0,4194304] 0 2022-02-02T18:23:04.059 INFO:tasks.workunit.client.1.smithi159.stdout:7/714: truncate d3/d2a/dcc/d8b/d8c/d99/fb8 348 0 2022-02-02T18:23:04.059 INFO:tasks.workunit.client.1.smithi159.stdout:7/715: fdatasync d3/d27/db7/fd9 0 2022-02-02T18:23:04.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:03 smithi096 conmon[32067]: cluster 2022-02-02T18:23:02.543773+0000 mgr.smithi096.shfutl (mgr.14628) 24 2022-02-02T18:23:04.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:03 smithi096 conmon[32067]: : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 19 MiB/s rd, 27 MiB/s wr, 97 op/s 2022-02-02T18:23:04.061 INFO:tasks.workunit.client.1.smithi159.stdout:7/716: write d3/d2a/dcc/d8b/d8c/d99/fe2 [2328851,110052] 0 2022-02-02T18:23:04.062 INFO:tasks.workunit.client.1.smithi159.stdout:7/717: fsync d3/d5/d56/d2f/fd1 0 2022-02-02T18:23:04.064 INFO:tasks.workunit.client.1.smithi159.stdout:7/718: mkdir d3/d2a/dcc/d8b/df1 0 2022-02-02T18:23:04.065 INFO:tasks.workunit.client.1.smithi159.stdout:7/719: getdents d3/d5/d56 0 2022-02-02T18:23:04.066 INFO:tasks.workunit.client.1.smithi159.stdout:7/720: read d3/d5/d95/dbe/fe8 [327324,21603] 0 2022-02-02T18:23:04.068 INFO:tasks.workunit.client.1.smithi159.stdout:2/693: dwrite da/d40/d61/f8f [0,4194304] 0 2022-02-02T18:23:04.068 INFO:tasks.workunit.client.1.smithi159.stdout:7/721: mknod d3/d27/d29/cf2 0 2022-02-02T18:23:04.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/722: creat d3/d5/d95/ff3 x:0 0 0 2022-02-02T18:23:04.070 INFO:tasks.workunit.client.1.smithi159.stdout:2/694: dread - da/d48/d6d/d3e/fa5 zero size 2022-02-02T18:23:04.071 INFO:tasks.workunit.client.1.smithi159.stdout:7/723: creat d3/ff4 x:0 0 0 2022-02-02T18:23:04.072 INFO:tasks.workunit.client.1.smithi159.stdout:2/695: symlink da/d40/dde/lf6 0 2022-02-02T18:23:04.072 INFO:tasks.workunit.client.1.smithi159.stdout:2/696: read - da/d1c/d47/d6b/d59/fb4 zero size 2022-02-02T18:23:04.073 INFO:tasks.workunit.client.1.smithi159.stdout:4/530: dwrite d0/d8/d30/f91 [0,4194304] 0 2022-02-02T18:23:04.091 INFO:tasks.workunit.client.1.smithi159.stdout:2/697: rmdir da/d40/d61 39 2022-02-02T18:23:04.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/724: dwrite d3/d27/db7/fd9 [4194304,4194304] 0 2022-02-02T18:23:04.124 INFO:tasks.workunit.client.1.smithi159.stdout:1/507: sync 2022-02-02T18:23:04.124 INFO:tasks.workunit.client.1.smithi159.stdout:1/508: fdatasync df/d14/f57 0 2022-02-02T18:23:04.125 INFO:tasks.workunit.client.1.smithi159.stdout:1/509: chown df/d14/l2a 1225598 1 2022-02-02T18:23:04.126 INFO:tasks.workunit.client.1.smithi159.stdout:2/698: creat da/d1c/d42/d70/ff7 x:0 0 0 2022-02-02T18:23:04.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/725: read - d3/d5/d95/fe1 zero size 2022-02-02T18:23:04.127 INFO:tasks.workunit.client.1.smithi159.stdout:1/510: truncate df/d14/f57 142815 0 2022-02-02T18:23:04.134 INFO:tasks.workunit.client.1.smithi159.stdout:2/699: dread da/d1c/d25/f9f [0,4194304] 0 2022-02-02T18:23:04.136 INFO:tasks.workunit.client.1.smithi159.stdout:7/726: dread d3/d27/d29/d5e/d80/dee/fb6 [0,4194304] 0 2022-02-02T18:23:04.137 INFO:tasks.workunit.client.1.smithi159.stdout:7/727: write d3/d27/d29/d5e/d80/dee/fb6 [699095,23851] 0 2022-02-02T18:23:04.142 INFO:tasks.workunit.client.1.smithi159.stdout:2/700: symlink da/d1c/d76/lf8 0 2022-02-02T18:23:04.142 INFO:tasks.workunit.client.1.smithi159.stdout:2/701: chown da/d1c/d42/cd4 6365957 1 2022-02-02T18:23:04.142 INFO:tasks.workunit.client.1.smithi159.stdout:2/702: creat da/d40/daf/ff9 x:0 0 0 2022-02-02T18:23:04.143 INFO:tasks.workunit.client.1.smithi159.stdout:4/531: rename d0/d8/d14 to d0/d8/d41/db7 0 2022-02-02T18:23:04.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/532: truncate d0/d8/d24/d76/f78 822581 0 2022-02-02T18:23:04.146 INFO:tasks.workunit.client.1.smithi159.stdout:2/703: creat da/d1c/d42/d45/ffa x:0 0 0 2022-02-02T18:23:04.147 INFO:tasks.workunit.client.1.smithi159.stdout:2/704: dread - da/d48/d6d/d3e/fa5 zero size 2022-02-02T18:23:04.148 INFO:tasks.workunit.client.1.smithi159.stdout:1/511: rename df/f62 to df/d14/d68/dad/fb4 0 2022-02-02T18:23:04.149 INFO:tasks.workunit.client.1.smithi159.stdout:4/533: chown d0/d8/d24/d4f/f72 3544256 1 2022-02-02T18:23:04.151 INFO:tasks.workunit.client.1.smithi159.stdout:2/705: creat da/d1c/d47/d6b/d5a/ffb x:0 0 0 2022-02-02T18:23:04.153 INFO:tasks.workunit.client.1.smithi159.stdout:4/534: readlink d0/d8/d30/l6e 0 2022-02-02T18:23:04.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/706: chown da/c86 3124 1 2022-02-02T18:23:04.155 INFO:tasks.workunit.client.1.smithi159.stdout:7/728: rename d3/d27/d29/l36 to d3/d27/d6f/da2/lf5 0 2022-02-02T18:23:04.155 INFO:tasks.workunit.client.1.smithi159.stdout:4/535: dread d0/d8/d15/f57 [0,4194304] 0 2022-02-02T18:23:04.158 INFO:tasks.workunit.client.1.smithi159.stdout:1/512: rename df/d21/d23/l65 to df/d21/d23/d49/d69/d81/lb5 0 2022-02-02T18:23:04.159 INFO:tasks.workunit.client.1.smithi159.stdout:7/729: dread d3/d2a/dcc/d8b/d8c/d99/fb8 [0,4194304] 0 2022-02-02T18:23:04.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/730: creat d3/d2a/dcc/d8b/df1/ff6 x:0 0 0 2022-02-02T18:23:04.162 INFO:tasks.workunit.client.1.smithi159.stdout:2/707: dread da/d40/f98 [0,4194304] 0 2022-02-02T18:23:04.163 INFO:tasks.workunit.client.1.smithi159.stdout:2/708: write da/d48/d6d/d3e/fad [1947499,95897] 0 2022-02-02T18:23:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:7/731: creat d3/d5/d95/dbe/ff7 x:0 0 0 2022-02-02T18:23:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:7/732: stat d3/d2a/dcc/d8b/d8c 0 2022-02-02T18:23:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:7/733: dread d3/f4e [0,4194304] 0 2022-02-02T18:23:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:7/734: creat d3/d5/d95/ff8 x:0 0 0 2022-02-02T18:23:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:7/735: stat d3/d5/d56/d2f/fe0 0 2022-02-02T18:23:04.180 INFO:tasks.workunit.client.1.smithi159.stdout:7/736: write d3/d27/d6f/f7e [2748986,32208] 0 2022-02-02T18:23:04.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/536: dwrite d0/d8/d30/d5d/fb5 [0,4194304] 0 2022-02-02T18:23:04.181 INFO:tasks.workunit.client.1.smithi159.stdout:1/513: dwrite df/f8a [0,4194304] 0 2022-02-02T18:23:04.181 INFO:tasks.workunit.client.1.smithi159.stdout:1/514: write df/d14/d16/d4a/d8b/fa9 [1321461,79831] 0 2022-02-02T18:23:04.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/537: chown d0/d8/d24/d3a/f58 459682467 1 2022-02-02T18:23:04.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/538: chown d0/d8/d24/d4f/f9f 854 1 2022-02-02T18:23:04.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/737: write d3/d2a/d2c/f5a [1651982,94699] 0 2022-02-02T18:23:04.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/738: chown d3/d5/d56/d2f/cdf 83400559 1 2022-02-02T18:23:04.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/739: truncate d3/d5/d95/dbe/ff7 715533 0 2022-02-02T18:23:04.191 INFO:tasks.workunit.client.1.smithi159.stdout:1/515: creat df/d21/d23/d49/d69/d6c/fb6 x:0 0 0 2022-02-02T18:23:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:4/539: dread d0/d8/d41/db7/d33/d47/f53 [0,4194304] 0 2022-02-02T18:23:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:7/740: creat d3/d27/d29/d6b/de3/ff9 x:0 0 0 2022-02-02T18:23:04.193 INFO:tasks.workunit.client.1.smithi159.stdout:1/516: creat df/d21/d23/d49/d69/d81/da3/fb7 x:0 0 0 2022-02-02T18:23:04.193 INFO:tasks.workunit.client.1.smithi159.stdout:1/517: dread - df/d14/d16/d4b/d5b/f8d zero size 2022-02-02T18:23:04.194 INFO:tasks.workunit.client.1.smithi159.stdout:4/540: symlink d0/d8/d30/d7e/d9c/lb8 0 2022-02-02T18:23:04.198 INFO:tasks.workunit.client.1.smithi159.stdout:4/541: symlink d0/d8/d41/db7/d36/lb9 0 2022-02-02T18:23:04.213 INFO:tasks.workunit.client.1.smithi159.stdout:2/709: dwrite da/d40/daf/fda [0,4194304] 0 2022-02-02T18:23:04.214 INFO:tasks.workunit.client.1.smithi159.stdout:4/542: dwrite d0/d8/d24/d4f/f9f [0,4194304] 0 2022-02-02T18:23:04.216 INFO:tasks.workunit.client.1.smithi159.stdout:7/741: truncate d3/d5/d56/d2f/d5b/f97 7928948 0 2022-02-02T18:23:04.217 INFO:tasks.workunit.client.1.smithi159.stdout:2/710: creat da/d1c/d47/d6b/ffc x:0 0 0 2022-02-02T18:23:04.222 INFO:tasks.workunit.client.1.smithi159.stdout:2/711: link da/d1c/d47/d6b/d5a/d7e/le1 da/d40/dde/lfd 0 2022-02-02T18:23:04.223 INFO:tasks.workunit.client.1.smithi159.stdout:2/712: write da/d48/d6d/d3e/fdd [754929,82265] 0 2022-02-02T18:23:04.223 INFO:tasks.workunit.client.1.smithi159.stdout:7/742: getdents d3/d5/d95/dbe 0 2022-02-02T18:23:04.225 INFO:tasks.workunit.client.1.smithi159.stdout:2/713: rmdir da/d1c/d47/d6b/d5a/d7e/ddf 39 2022-02-02T18:23:04.231 INFO:tasks.workunit.client.1.smithi159.stdout:2/714: link da/d1c/d47/d6b/d5a/d7e/cc8 da/d1c/d47/d6b/cfe 0 2022-02-02T18:23:04.231 INFO:tasks.workunit.client.1.smithi159.stdout:2/715: read - da/d48/ff4 zero size 2022-02-02T18:23:04.252 INFO:tasks.workunit.client.1.smithi159.stdout:4/543: dwrite d0/d8/d41/f5e [0,4194304] 0 2022-02-02T18:23:04.252 INFO:tasks.workunit.client.1.smithi159.stdout:4/544: fsync d0/d8/d30/d7e/d98/fb4 0 2022-02-02T18:23:04.253 INFO:tasks.workunit.client.1.smithi159.stdout:7/743: dwrite d3/d27/d29/d5e/f73 [0,4194304] 0 2022-02-02T18:23:04.254 INFO:tasks.workunit.client.1.smithi159.stdout:7/744: chown d3/d27/d29/d5e/lce 35 1 2022-02-02T18:23:04.254 INFO:tasks.workunit.client.1.smithi159.stdout:4/545: symlink d0/d66/lba 0 2022-02-02T18:23:04.255 INFO:tasks.workunit.client.1.smithi159.stdout:1/518: dwrite df/d14/d16/d4b/d5b/f61 [4194304,4194304] 0 2022-02-02T18:23:04.260 INFO:tasks.workunit.client.1.smithi159.stdout:1/519: symlink df/d21/d23/d49/lb8 0 2022-02-02T18:23:04.263 INFO:tasks.workunit.client.1.smithi159.stdout:1/520: write df/d14/d16/d4b/d5b/f77 [334305,81582] 0 2022-02-02T18:23:04.265 INFO:tasks.workunit.client.1.smithi159.stdout:1/521: symlink df/d14/d68/dad/lb9 0 2022-02-02T18:23:04.266 INFO:tasks.workunit.client.1.smithi159.stdout:1/522: creat df/d14/d68/dad/fba x:0 0 0 2022-02-02T18:23:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/523: rename df/d14/d16/l27 to df/d14/d68/lbb 0 2022-02-02T18:23:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/524: write df/d14/f91 [1830027,62430] 0 2022-02-02T18:23:04.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/525: creat df/d21/d23/d49/d82/fbc x:0 0 0 2022-02-02T18:23:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:1/526: dread - df/d21/f54 zero size 2022-02-02T18:23:04.279 INFO:tasks.workunit.client.1.smithi159.stdout:7/745: dwrite d3/d27/db7/fde [0,4194304] 0 2022-02-02T18:23:04.280 INFO:tasks.workunit.client.1.smithi159.stdout:4/546: truncate d0/d8/d41/f5e 3784533 0 2022-02-02T18:23:04.282 INFO:tasks.workunit.client.1.smithi159.stdout:2/716: dwrite da/d48/f71 [0,4194304] 0 2022-02-02T18:23:04.283 INFO:tasks.workunit.client.1.smithi159.stdout:4/547: creat d0/d8/d24/d4f/fbb x:0 0 0 2022-02-02T18:23:04.293 INFO:tasks.workunit.client.1.smithi159.stdout:1/527: dwrite df/d21/f5c [0,4194304] 0 2022-02-02T18:23:04.293 INFO:tasks.workunit.client.1.smithi159.stdout:7/746: mknod d3/d2a/cfa 0 2022-02-02T18:23:04.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/548: mknod d0/d66/cbc 0 2022-02-02T18:23:04.296 INFO:tasks.workunit.client.1.smithi159.stdout:4/549: stat d0/d8/d41/db7/d33/d47/fa1 0 2022-02-02T18:23:04.296 INFO:tasks.workunit.client.1.smithi159.stdout:4/550: write d0/d8/d41/db7/f34 [987143,41452] 0 2022-02-02T18:23:04.296 INFO:tasks.workunit.client.1.smithi159.stdout:1/528: rename df/d14/d16/d4a/f74 to df/d21/d23/d49/d69/d6c/fbd 0 2022-02-02T18:23:04.298 INFO:tasks.workunit.client.1.smithi159.stdout:4/551: getdents d0/d8/d30/d7e/d9c 0 2022-02-02T18:23:04.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/717: write da/d1c/d47/d6b/d5a/f66 [629201,77845] 0 2022-02-02T18:23:04.300 INFO:tasks.workunit.client.1.smithi159.stdout:4/552: write d0/f25 [2376154,28197] 0 2022-02-02T18:23:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/529: creat df/d14/d68/fbe x:0 0 0 2022-02-02T18:23:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/530: dread - df/d21/d23/d49/d69/d6c/fb6 zero size 2022-02-02T18:23:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:4/553: creat d0/d8/d30/d7e/fbd x:0 0 0 2022-02-02T18:23:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/718: mkdir da/d48/d83/dff 0 2022-02-02T18:23:04.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/719: fdatasync da/d1c/d47/d6b/f51 0 2022-02-02T18:23:04.304 INFO:tasks.workunit.client.1.smithi159.stdout:7/747: dread d3/d2a/d2c/f63 [0,4194304] 0 2022-02-02T18:23:04.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/554: unlink d0/d8/d30/d7e/d98/fb0 0 2022-02-02T18:23:04.305 INFO:tasks.workunit.client.1.smithi159.stdout:2/720: truncate da/d1c/d47/d54/f5f 3648214 0 2022-02-02T18:23:04.306 INFO:tasks.workunit.client.1.smithi159.stdout:7/748: rmdir d3/d2a/d2c/d7a 39 2022-02-02T18:23:04.307 INFO:tasks.workunit.client.1.smithi159.stdout:4/555: rmdir d0/d8/d41/db7/d36 39 2022-02-02T18:23:04.308 INFO:tasks.workunit.client.1.smithi159.stdout:2/721: fsync da/d1c/f26 0 2022-02-02T18:23:04.308 INFO:tasks.workunit.client.1.smithi159.stdout:1/531: dread df/d14/d16/f45 [0,4194304] 0 2022-02-02T18:23:04.309 INFO:tasks.workunit.client.1.smithi159.stdout:1/532: chown df/d21/d23/d49/d69/d81/da3 261342 1 2022-02-02T18:23:04.309 INFO:tasks.workunit.client.1.smithi159.stdout:1/533: dread - df/d21/f54 zero size 2022-02-02T18:23:04.310 INFO:tasks.workunit.client.1.smithi159.stdout:2/722: write da/d1c/d47/d6b/d5a/f7b [3978519,86082] 0 2022-02-02T18:23:04.310 INFO:tasks.workunit.client.1.smithi159.stdout:7/749: mkdir d3/d27/d29/d6b/dc5/dfb 0 2022-02-02T18:23:04.311 INFO:tasks.workunit.client.1.smithi159.stdout:1/534: write df/d14/d68/dad/fb4 [135109,110569] 0 2022-02-02T18:23:04.311 INFO:tasks.workunit.client.1.smithi159.stdout:1/535: write df/d14/f5a [553933,115389] 0 2022-02-02T18:23:04.313 INFO:tasks.workunit.client.1.smithi159.stdout:4/556: mknod d0/d8/d30/d5d/cbe 0 2022-02-02T18:23:04.317 INFO:tasks.workunit.client.1.smithi159.stdout:4/557: creat d0/d8/d41/db7/d33/fbf x:0 0 0 2022-02-02T18:23:04.318 INFO:tasks.workunit.client.1.smithi159.stdout:4/558: getdents d0/d8/d30/d7e/d9c 0 2022-02-02T18:23:04.318 INFO:tasks.workunit.client.1.smithi159.stdout:4/559: chown d0/d8/d41/db7/d36/fa6 386795 1 2022-02-02T18:23:04.318 INFO:tasks.workunit.client.1.smithi159.stdout:7/750: truncate d3/d5/f7f 8273814 0 2022-02-02T18:23:04.319 INFO:tasks.workunit.client.1.smithi159.stdout:7/751: read d3/f4e [3929532,44243] 0 2022-02-02T18:23:04.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/752: truncate d3/d5/f20 755547 0 2022-02-02T18:23:04.321 INFO:tasks.workunit.client.1.smithi159.stdout:4/560: mkdir d0/d8/d41/db7/d33/dc0 0 2022-02-02T18:23:04.321 INFO:tasks.workunit.client.1.smithi159.stdout:4/561: chown d0/d8/d41/db7/d36 86344 1 2022-02-02T18:23:04.322 INFO:tasks.workunit.client.1.smithi159.stdout:4/562: readlink d0/d8/l1b 0 2022-02-02T18:23:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/753: symlink d3/d2a/dcc/d8b/df1/lfc 0 2022-02-02T18:23:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/754: fsync d3/d27/d6f/fe6 0 2022-02-02T18:23:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/755: creat d3/d27/d29/d6b/da7/ffd x:0 0 0 2022-02-02T18:23:04.324 INFO:tasks.workunit.client.1.smithi159.stdout:2/723: dread da/d1c/d25/d73/dab/f6a [0,4194304] 0 2022-02-02T18:23:04.325 INFO:tasks.workunit.client.1.smithi159.stdout:4/563: link d0/d8/d41/f9d d0/d8/d41/db7/d36/dad/fc1 0 2022-02-02T18:23:04.328 INFO:tasks.workunit.client.1.smithi159.stdout:1/536: dread df/d21/d23/d49/f4e [0,4194304] 0 2022-02-02T18:23:04.337 INFO:tasks.workunit.client.1.smithi159.stdout:2/724: dread da/d1c/d47/d6b/f51 [4194304,4194304] 0 2022-02-02T18:23:04.346 INFO:tasks.workunit.client.1.smithi159.stdout:7/756: mknod d3/d27/d29/d6b/dc5/cfe 0 2022-02-02T18:23:04.348 INFO:tasks.workunit.client.1.smithi159.stdout:7/757: fdatasync d3/d6/f40 0 2022-02-02T18:23:04.348 INFO:tasks.workunit.client.1.smithi159.stdout:7/758: write d3/d2a/d4a/d7d/fda [2189101,116986] 0 2022-02-02T18:23:04.352 INFO:tasks.workunit.client.1.smithi159.stdout:1/537: mkdir df/d14/dbf 0 2022-02-02T18:23:04.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/567: sync 2022-02-02T18:23:04.353 INFO:tasks.workunit.client.1.smithi159.stdout:2/725: link da/d48/d6d/d3e/f9c da/d48/d6d/d3e/f100 0 2022-02-02T18:23:04.354 INFO:tasks.workunit.client.1.smithi159.stdout:9/568: write d4/d19/d1c/d1f/f20 [3820273,65161] 0 2022-02-02T18:23:04.355 INFO:tasks.workunit.client.1.smithi159.stdout:1/538: link df/d14/d16/l20 df/lc0 0 2022-02-02T18:23:04.355 INFO:tasks.workunit.client.1.smithi159.stdout:1/539: stat df/d21/d23/fb1 0 2022-02-02T18:23:04.358 INFO:tasks.workunit.client.1.smithi159.stdout:2/726: unlink da/d1c/d47/d6b/d5a/d7e/lc4 0 2022-02-02T18:23:04.358 INFO:tasks.workunit.client.1.smithi159.stdout:7/759: truncate d3/f14 1098979 0 2022-02-02T18:23:04.359 INFO:tasks.workunit.client.1.smithi159.stdout:2/727: write da/d1c/d42/f81 [683590,110471] 0 2022-02-02T18:23:04.360 INFO:tasks.workunit.client.1.smithi159.stdout:1/540: creat df/d14/d16/d4b/da0/fc1 x:0 0 0 2022-02-02T18:23:04.361 INFO:tasks.workunit.client.1.smithi159.stdout:9/569: mknod d4/d19/d1c/d21/d22/cbb 0 2022-02-02T18:23:04.362 INFO:tasks.workunit.client.1.smithi159.stdout:4/564: dwrite d0/d8/f1c [0,4194304] 0 2022-02-02T18:23:04.363 INFO:tasks.workunit.client.1.smithi159.stdout:7/760: rename d3/d2a/d4a/d7d/fbc to d3/d27/d29/d5e/d80/daa/fff 0 2022-02-02T18:23:04.363 INFO:tasks.workunit.client.1.smithi159.stdout:7/761: write d3/d27/d29/d5e/d80/dee/fe9 [1095495,11880] 0 2022-02-02T18:23:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:2/728: creat da/d1c/d47/f101 x:0 0 0 2022-02-02T18:23:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:2/729: readlink da/d1c/d25/laa 0 2022-02-02T18:23:04.368 INFO:tasks.workunit.client.1.smithi159.stdout:7/762: rename d3/d5/d56/d57/c4b to d3/d5/d95/dbe/c100 0 2022-02-02T18:23:04.368 INFO:tasks.workunit.client.1.smithi159.stdout:7/763: fsync d3/d27/d29/d5e/f73 0 2022-02-02T18:23:04.370 INFO:tasks.workunit.client.1.smithi159.stdout:2/730: symlink da/d1c/d25/d73/dab/l102 0 2022-02-02T18:23:04.370 INFO:tasks.workunit.client.1.smithi159.stdout:2/731: stat da/d1c/d47/d6b/d5a/f66 0 2022-02-02T18:23:04.374 INFO:tasks.workunit.client.1.smithi159.stdout:2/732: creat da/d1c/d47/d6b/d7c/f103 x:0 0 0 2022-02-02T18:23:04.375 INFO:tasks.workunit.client.1.smithi159.stdout:4/565: rename d0/d8/l1b to d0/d8/d30/d7e/lc2 0 2022-02-02T18:23:04.380 INFO:tasks.workunit.client.1.smithi159.stdout:2/733: unlink da/d1c/d25/laa 0 2022-02-02T18:23:04.385 INFO:tasks.workunit.client.1.smithi159.stdout:9/570: dwrite d4/d19/d1c/d21/d22/f9c [0,4194304] 0 2022-02-02T18:23:04.386 INFO:tasks.workunit.client.1.smithi159.stdout:9/571: read d4/d19/d1c/d1f/f3f [2018190,103292] 0 2022-02-02T18:23:04.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/572: fdatasync d4/d19/d1c/d1f/f30 0 2022-02-02T18:23:04.397 INFO:tasks.workunit.client.1.smithi159.stdout:2/734: dread da/d1c/d47/f4a [0,4194304] 0 2022-02-02T18:23:04.398 INFO:tasks.workunit.client.1.smithi159.stdout:2/735: write da/d1c/d47/d6b/d5a/fae [833502,80445] 0 2022-02-02T18:23:04.403 INFO:tasks.workunit.client.1.smithi159.stdout:7/764: dwrite d3/d5/d56/d57/f11 [0,4194304] 0 2022-02-02T18:23:04.405 INFO:tasks.workunit.client.1.smithi159.stdout:7/765: getdents d3/d27/d29/d6b/da7 0 2022-02-02T18:23:04.414 INFO:tasks.workunit.client.1.smithi159.stdout:4/566: dwrite d0/d8/d41/db7/d36/f5f [0,4194304] 0 2022-02-02T18:23:04.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/567: dread - d0/d8/d30/d5d/f90 zero size 2022-02-02T18:23:04.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/568: chown d0/d8/d24/d76 11145 1 2022-02-02T18:23:04.416 INFO:tasks.workunit.client.1.smithi159.stdout:4/569: dread - d0/d8/f7c zero size 2022-02-02T18:23:04.422 INFO:tasks.workunit.client.1.smithi159.stdout:9/573: dwrite d4/d19/d6f/d74/db1/fb5 [0,4194304] 0 2022-02-02T18:23:04.422 INFO:tasks.workunit.client.1.smithi159.stdout:2/736: fsync da/d1c/d47/d6b/d5a/fae 0 2022-02-02T18:23:04.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/737: dread - da/d40/daf/ff9 zero size 2022-02-02T18:23:04.424 INFO:tasks.workunit.client.1.smithi159.stdout:4/570: dread d0/d8/f20 [0,4194304] 0 2022-02-02T18:23:04.425 INFO:tasks.workunit.client.1.smithi159.stdout:1/541: dwrite df/d21/f66 [0,4194304] 0 2022-02-02T18:23:04.425 INFO:tasks.workunit.client.1.smithi159.stdout:1/542: creat df/d14/d16/d4b/da0/fc2 x:0 0 0 2022-02-02T18:23:04.428 INFO:tasks.workunit.client.1.smithi159.stdout:7/766: dwrite d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:23:04.431 INFO:tasks.workunit.client.1.smithi159.stdout:1/543: dread df/d14/d16/d4a/d8b/fa9 [0,4194304] 0 2022-02-02T18:23:04.434 INFO:tasks.workunit.client.1.smithi159.stdout:9/574: dread d4/d19/d1c/d1f/f20 [0,4194304] 0 2022-02-02T18:23:04.436 INFO:tasks.workunit.client.1.smithi159.stdout:7/767: mkdir d3/d2a/d4a/d7d/deb/d101 0 2022-02-02T18:23:04.437 INFO:tasks.workunit.client.1.smithi159.stdout:1/544: rmdir df/d21/d23 39 2022-02-02T18:23:04.438 INFO:tasks.workunit.client.1.smithi159.stdout:9/575: fdatasync d4/d19/d1c/f67 0 2022-02-02T18:23:04.440 INFO:tasks.workunit.client.1.smithi159.stdout:4/571: mkdir d0/d8/d41/db7/d33/d47/d56/dc3 0 2022-02-02T18:23:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/545: truncate df/d21/f5c 3257233 0 2022-02-02T18:23:04.442 INFO:tasks.workunit.client.1.smithi159.stdout:7/768: link d3/d2a/l75 d3/d5/d56/d2f/d5b/l102 0 2022-02-02T18:23:04.444 INFO:tasks.workunit.client.1.smithi159.stdout:7/769: creat d3/d5/d56/d57/f103 x:0 0 0 2022-02-02T18:23:04.445 INFO:tasks.workunit.client.1.smithi159.stdout:7/770: readlink d3/d5/ld4 0 2022-02-02T18:23:04.445 INFO:tasks.workunit.client.1.smithi159.stdout:1/546: symlink df/d21/lc3 0 2022-02-02T18:23:04.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/547: mknod df/d14/cc4 0 2022-02-02T18:23:04.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/548: chown df/d14/d16/d4a/c8c 3 1 2022-02-02T18:23:04.448 INFO:tasks.workunit.client.1.smithi159.stdout:2/738: dwrite da/d48/d6d/d3e/fad [0,4194304] 0 2022-02-02T18:23:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/549: symlink df/d14/lc5 0 2022-02-02T18:23:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/550: chown df/d14/d16/d4b/d5b/c8e 532 1 2022-02-02T18:23:04.450 INFO:tasks.workunit.client.1.smithi159.stdout:1/551: write df/d21/d23/d49/d69/f96 [1143587,89239] 0 2022-02-02T18:23:04.451 INFO:tasks.workunit.client.1.smithi159.stdout:9/576: dread d4/d19/d1c/d21/f27 [0,4194304] 0 2022-02-02T18:23:04.451 INFO:tasks.workunit.client.1.smithi159.stdout:7/771: write d3/d5/d56/d57/f46 [3631341,42350] 0 2022-02-02T18:23:04.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/572: dread d0/d8/d24/d76/f89 [0,4194304] 0 2022-02-02T18:23:04.454 INFO:tasks.workunit.client.1.smithi159.stdout:4/573: fdatasync d0/d8/d24/f68 0 2022-02-02T18:23:04.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/739: mkdir da/d1c/d47/d6b/d104 0 2022-02-02T18:23:04.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/740: read - da/d1c/d25/fc5 zero size 2022-02-02T18:23:04.460 INFO:tasks.workunit.client.1.smithi159.stdout:2/741: write da/d1c/d76/f87 [4920010,93164] 0 2022-02-02T18:23:04.460 INFO:tasks.workunit.client.1.smithi159.stdout:2/742: truncate da/d1c/d47/d6b/d59/fb4 547218 0 2022-02-02T18:23:04.463 INFO:tasks.workunit.client.1.smithi159.stdout:9/577: mkdir d4/d7a/dbc 0 2022-02-02T18:23:04.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/772: rmdir d3/d6 39 2022-02-02T18:23:04.465 INFO:tasks.workunit.client.1.smithi159.stdout:9/578: write d4/d7a/db7/f86 [2370006,99299] 0 2022-02-02T18:23:04.468 INFO:tasks.workunit.client.1.smithi159.stdout:7/773: creat d3/d27/d29/d5e/d80/f104 x:0 0 0 2022-02-02T18:23:04.470 INFO:tasks.workunit.client.1.smithi159.stdout:2/743: unlink da/d48/ff4 0 2022-02-02T18:23:04.471 INFO:tasks.workunit.client.1.smithi159.stdout:9/579: getdents d4/d19/d6f/d74 0 2022-02-02T18:23:04.475 INFO:tasks.workunit.client.1.smithi159.stdout:7/774: mkdir d3/d2a/dcc/d8b/df1/d105 0 2022-02-02T18:23:04.475 INFO:tasks.workunit.client.1.smithi159.stdout:7/775: fdatasync d3/d2a/f47 0 2022-02-02T18:23:04.476 INFO:tasks.workunit.client.1.smithi159.stdout:7/776: read d3/d2a/d2c/f63 [1166658,82607] 0 2022-02-02T18:23:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/552: dwrite df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:23:04.478 INFO:tasks.workunit.client.1.smithi159.stdout:9/580: link d4/d19/d1c/d1f/c52 d4/d19/d1c/d21/d41/cbd 0 2022-02-02T18:23:04.485 INFO:tasks.workunit.client.1.smithi159.stdout:1/553: creat df/d21/d23/d49/d82/fc6 x:0 0 0 2022-02-02T18:23:04.486 INFO:tasks.workunit.client.1.smithi159.stdout:9/581: mknod d4/d19/d6f/d74/db1/cbe 0 2022-02-02T18:23:04.486 INFO:tasks.workunit.client.1.smithi159.stdout:1/554: dread - df/d14/d16/f60 zero size 2022-02-02T18:23:04.486 INFO:tasks.workunit.client.1.smithi159.stdout:1/555: readlink df/d14/d68/lbb 0 2022-02-02T18:23:04.487 INFO:tasks.workunit.client.1.smithi159.stdout:1/556: chown df/d14/lc5 1 1 2022-02-02T18:23:04.488 INFO:tasks.workunit.client.1.smithi159.stdout:1/557: rename df/d14/d16/d4a/lb0 to df/d14/d16/d4b/da0/lc7 0 2022-02-02T18:23:04.489 INFO:tasks.workunit.client.1.smithi159.stdout:4/574: dwrite d0/d8/d41/db7/f71 [0,4194304] 0 2022-02-02T18:23:04.490 INFO:tasks.workunit.client.1.smithi159.stdout:9/582: link d4/d19/d1c/d21/d56/d59/f7d d4/d19/d1c/d21/d41/fbf 0 2022-02-02T18:23:04.491 INFO:tasks.workunit.client.1.smithi159.stdout:1/558: mknod df/d21/d23/d49/d69/d81/da3/cc8 0 2022-02-02T18:23:04.491 INFO:tasks.workunit.client.1.smithi159.stdout:1/559: readlink df/l1c 0 2022-02-02T18:23:04.497 INFO:tasks.workunit.client.1.smithi159.stdout:9/583: fsync d4/d19/d1c/d21/d41/f70 0 2022-02-02T18:23:04.501 INFO:tasks.workunit.client.1.smithi159.stdout:1/560: unlink df/d14/d16/d6d/f7b 0 2022-02-02T18:23:04.502 INFO:tasks.workunit.client.1.smithi159.stdout:1/561: fdatasync df/fae 0 2022-02-02T18:23:04.504 INFO:tasks.workunit.client.1.smithi159.stdout:1/562: mknod df/d14/d68/cc9 0 2022-02-02T18:23:04.505 INFO:tasks.workunit.client.1.smithi159.stdout:7/777: dread d3/d5/d56/d2f/f44 [0,4194304] 0 2022-02-02T18:23:04.509 INFO:tasks.workunit.client.1.smithi159.stdout:2/744: dwrite da/d1c/d47/d54/f9b [0,4194304] 0 2022-02-02T18:23:04.513 INFO:tasks.workunit.client.1.smithi159.stdout:2/745: creat da/d40/f105 x:0 0 0 2022-02-02T18:23:04.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/584: write d4/d19/d1c/d21/d95/f82 [146401,122642] 0 2022-02-02T18:23:04.516 INFO:tasks.workunit.client.1.smithi159.stdout:2/746: truncate da/d48/d6d/d3e/f7f 75301 0 2022-02-02T18:23:04.517 INFO:tasks.workunit.client.1.smithi159.stdout:3/551: sync 2022-02-02T18:23:04.519 INFO:tasks.workunit.client.1.smithi159.stdout:2/747: fsync da/f7d 0 2022-02-02T18:23:04.523 INFO:tasks.workunit.client.1.smithi159.stdout:3/552: mkdir dd/d19/d38/d3f/d52/db4 0 2022-02-02T18:23:04.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/575: dwrite d0/d8/d24/d4f/fbb [0,4194304] 0 2022-02-02T18:23:04.530 INFO:tasks.workunit.client.1.smithi159.stdout:6/612: sync 2022-02-02T18:23:04.531 INFO:tasks.workunit.client.1.smithi159.stdout:5/634: sync 2022-02-02T18:23:04.531 INFO:tasks.workunit.client.1.smithi159.stdout:8/565: sync 2022-02-02T18:23:04.531 INFO:tasks.workunit.client.1.smithi159.stdout:0/615: sync 2022-02-02T18:23:04.531 INFO:tasks.workunit.client.1.smithi159.stdout:0/616: fdatasync d1/d11/d38/faa 0 2022-02-02T18:23:04.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/613: creat df/d35/d2a/d3f/d65/fcb x:0 0 0 2022-02-02T18:23:04.536 INFO:tasks.workunit.client.1.smithi159.stdout:5/635: mknod d9/d2e/db1/cc4 0 2022-02-02T18:23:04.538 INFO:tasks.workunit.client.1.smithi159.stdout:3/553: dread dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:23:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/566: mknod d1/d26/d48/d7f/cc4 0 2022-02-02T18:23:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/567: chown d1/dd/d2c/la9 42541 1 2022-02-02T18:23:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/568: readlink d1/dc/l14 0 2022-02-02T18:23:04.543 INFO:tasks.workunit.client.1.smithi159.stdout:5/636: write d9/d24/d37/d23/f3f [2389237,42409] 0 2022-02-02T18:23:04.543 INFO:tasks.workunit.client.1.smithi159.stdout:3/554: mkdir dd/d66/da1/db5 0 2022-02-02T18:23:04.547 INFO:tasks.workunit.client.1.smithi159.stdout:9/585: dwrite d4/d19/d6f/d74/db1/fb5 [0,4194304] 0 2022-02-02T18:23:04.548 INFO:tasks.workunit.client.1.smithi159.stdout:3/555: mkdir dd/d66/d82/db6 0 2022-02-02T18:23:04.549 INFO:tasks.workunit.client.1.smithi159.stdout:0/617: rename d1/d11/d38/d42/daf/d34/l36 to d1/dd/d4b/ld6 0 2022-02-02T18:23:04.549 INFO:tasks.workunit.client.1.smithi159.stdout:0/618: readlink d1/d11/d38/d42/daf/d34/l6a 0 2022-02-02T18:23:04.550 INFO:tasks.workunit.client.1.smithi159.stdout:9/586: truncate d4/d2a/f2e 726804 0 2022-02-02T18:23:04.551 INFO:tasks.workunit.client.1.smithi159.stdout:0/619: mkdir d1/d11/d38/d94/dd7 0 2022-02-02T18:23:04.553 INFO:tasks.workunit.client.1.smithi159.stdout:3/556: chown dd/d20/d60/lad 31493 1 2022-02-02T18:23:04.553 INFO:tasks.workunit.client.1.smithi159.stdout:5/637: dread f7 [0,4194304] 0 2022-02-02T18:23:04.553 INFO:tasks.workunit.client.1.smithi159.stdout:5/638: dread - d9/d24/d21/d44/fb6 zero size 2022-02-02T18:23:04.555 INFO:tasks.workunit.client.1.smithi159.stdout:5/639: creat d9/d24/d4a/fc5 x:0 0 0 2022-02-02T18:23:04.555 INFO:tasks.workunit.client.1.smithi159.stdout:9/587: creat d4/d19/d1c/d21/d95/fc0 x:0 0 0 2022-02-02T18:23:04.557 INFO:tasks.workunit.client.1.smithi159.stdout:0/620: mkdir d1/d11/d38/dd8 0 2022-02-02T18:23:04.561 INFO:tasks.workunit.client.1.smithi159.stdout:7/778: dwrite d3/d5/d56/d2f/f38 [0,4194304] 0 2022-02-02T18:23:04.561 INFO:tasks.workunit.client.1.smithi159.stdout:0/621: getdents d1/d19 0 2022-02-02T18:23:04.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/779: mknod d3/d2a/d4a/d7d/deb/d101/c106 0 2022-02-02T18:23:04.567 INFO:tasks.workunit.client.1.smithi159.stdout:7/780: rename d3/d5/d95/dbe to d3/d107 0 2022-02-02T18:23:04.568 INFO:tasks.workunit.client.1.smithi159.stdout:3/557: dread dd/d19/d38/d3f/d7d/fa5 [0,4194304] 0 2022-02-02T18:23:04.569 INFO:tasks.workunit.client.1.smithi159.stdout:1/563: dwrite df/d14/d16/d4b/f55 [0,4194304] 0 2022-02-02T18:23:04.569 INFO:tasks.workunit.client.1.smithi159.stdout:3/558: creat dd/d66/fb7 x:0 0 0 2022-02-02T18:23:04.569 INFO:tasks.workunit.client.1.smithi159.stdout:1/564: dread - df/d14/d16/d4b/da0/fc1 zero size 2022-02-02T18:23:04.569 INFO:tasks.workunit.client.1.smithi159.stdout:3/559: write dd/d19/d38/d3f/f50 [4612801,109925] 0 2022-02-02T18:23:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:3/560: chown dd/d19/d38/d3f/d80/l87 341505522 1 2022-02-02T18:23:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:7/781: rmdir d3/d2a/dcc/d8b/d8c 39 2022-02-02T18:23:04.577 INFO:tasks.workunit.client.1.smithi159.stdout:2/748: dwrite da/f7d [0,4194304] 0 2022-02-02T18:23:04.577 INFO:tasks.workunit.client.1.smithi159.stdout:2/749: fdatasync da/d48/d6d/d3e/fca 0 2022-02-02T18:23:04.580 INFO:tasks.workunit.client.1.smithi159.stdout:6/614: dwrite df/d35/d2a/d2f/d80/d61/f94 [0,4194304] 0 2022-02-02T18:23:04.580 INFO:tasks.workunit.client.1.smithi159.stdout:6/615: creat df/d35/d2a/d2f/d80/d61/da8/fcc x:0 0 0 2022-02-02T18:23:04.585 INFO:tasks.workunit.client.1.smithi159.stdout:9/588: write d4/d19/f36 [1136468,85668] 0 2022-02-02T18:23:04.593 INFO:tasks.workunit.client.1.smithi159.stdout:9/589: creat d4/d19/fc1 x:0 0 0 2022-02-02T18:23:04.593 INFO:tasks.workunit.client.1.smithi159.stdout:9/590: readlink d4/d19/d1c/l97 0 2022-02-02T18:23:04.594 INFO:tasks.workunit.client.1.smithi159.stdout:6/616: dread fd [0,4194304] 0 2022-02-02T18:23:04.594 INFO:tasks.workunit.client.1.smithi159.stdout:6/617: chown df/d35/d2a/f5c 1 1 2022-02-02T18:23:04.595 INFO:tasks.workunit.client.1.smithi159.stdout:6/618: read df/d35/d2a/d3f/d42/d47/f5e [248783,98642] 0 2022-02-02T18:23:04.595 INFO:tasks.workunit.client.1.smithi159.stdout:6/619: chown df/d35/f78 25855120 1 2022-02-02T18:23:04.597 INFO:tasks.workunit.client.1.smithi159.stdout:6/620: mknod df/d35/d2a/d3f/d55/d6a/d6e/ccd 0 2022-02-02T18:23:04.602 INFO:tasks.workunit.client.1.smithi159.stdout:7/782: dwrite d3/d5/d56/d57/f11 [0,4194304] 0 2022-02-02T18:23:04.603 INFO:tasks.workunit.client.1.smithi159.stdout:7/783: getdents d3/d2a/d4a 0 2022-02-02T18:23:04.603 INFO:tasks.workunit.client.1.smithi159.stdout:0/622: dwrite d1/d19/d3d/f45 [4194304,4194304] 0 2022-02-02T18:23:04.605 INFO:tasks.workunit.client.1.smithi159.stdout:3/561: dwrite dd/d66/d69/f79 [0,4194304] 0 2022-02-02T18:23:04.615 INFO:tasks.workunit.client.1.smithi159.stdout:9/591: write d4/d2a/f40 [2502351,63489] 0 2022-02-02T18:23:04.615 INFO:tasks.workunit.client.1.smithi159.stdout:0/623: dread d1/d11/f35 [0,4194304] 0 2022-02-02T18:23:04.617 INFO:tasks.workunit.client.1.smithi159.stdout:9/592: mknod d4/d19/d1c/d21/d22/d55/cc2 0 2022-02-02T18:23:04.617 INFO:tasks.workunit.client.1.smithi159.stdout:0/624: mknod d1/dd/d4b/da7/dc1/cd9 0 2022-02-02T18:23:04.624 INFO:tasks.workunit.client.1.smithi159.stdout:2/750: write da/d1c/f32 [3688987,58573] 0 2022-02-02T18:23:04.624 INFO:tasks.workunit.client.1.smithi159.stdout:2/751: chown da/d1c/d47/d6b/d5a/fae 0 1 2022-02-02T18:23:04.624 INFO:tasks.workunit.client.1.smithi159.stdout:7/784: dwrite d3/d27/d29/d5e/d80/daa/fff [0,4194304] 0 2022-02-02T18:23:04.625 INFO:tasks.workunit.client.1.smithi159.stdout:7/785: chown d3/d27/d29/d68/l90 13 1 2022-02-02T18:23:04.625 INFO:tasks.workunit.client.1.smithi159.stdout:7/786: write d3/f14 [1903519,112396] 0 2022-02-02T18:23:04.625 INFO:tasks.workunit.client.1.smithi159.stdout:0/625: write d1/d11/d38/d42/daf/f5e [476379,5440] 0 2022-02-02T18:23:04.628 INFO:tasks.workunit.client.1.smithi159.stdout:0/626: symlink d1/d19/lda 0 2022-02-02T18:23:04.631 INFO:tasks.workunit.client.1.smithi159.stdout:0/627: creat d1/dd/d4b/da7/dc1/fdb x:0 0 0 2022-02-02T18:23:04.632 INFO:tasks.workunit.client.1.smithi159.stdout:2/752: symlink da/d1c/d76/l106 0 2022-02-02T18:23:04.632 INFO:tasks.workunit.client.1.smithi159.stdout:2/753: truncate da/d1c/d47/d6b/fe8 640171 0 2022-02-02T18:23:04.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/562: write dd/d19/d38/d3f/f5c [220038,97980] 0 2022-02-02T18:23:04.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/563: truncate dd/d19/d38/d3f/d80/d8a/f9f 852044 0 2022-02-02T18:23:04.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/564: dread - dd/d66/f9b zero size 2022-02-02T18:23:04.634 INFO:tasks.workunit.client.1.smithi159.stdout:3/565: fdatasync dd/d19/d35/fa9 0 2022-02-02T18:23:04.634 INFO:tasks.workunit.client.1.smithi159.stdout:2/754: mknod da/d1c/d47/d6b/d59/c107 0 2022-02-02T18:23:04.634 INFO:tasks.workunit.client.1.smithi159.stdout:2/755: fdatasync da/d48/fc1 0 2022-02-02T18:23:04.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/566: rename dd/d20/c26 to dd/d19/d38/d3f/d52/db4/cb8 0 2022-02-02T18:23:04.637 INFO:tasks.workunit.client.1.smithi159.stdout:3/567: mknod dd/d19/d38/d94/cb9 0 2022-02-02T18:23:04.639 INFO:tasks.workunit.client.1.smithi159.stdout:0/628: rmdir d1/d19 39 2022-02-02T18:23:04.640 INFO:tasks.workunit.client.1.smithi159.stdout:0/629: fsync d1/d11/d38/d94/fc4 0 2022-02-02T18:23:04.644 INFO:tasks.workunit.client.1.smithi159.stdout:3/568: dread dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:04.645 INFO:tasks.workunit.client.1.smithi159.stdout:3/569: write fc [5060050,44881] 0 2022-02-02T18:23:04.645 INFO:tasks.workunit.client.1.smithi159.stdout:3/570: read dd/d19/d38/d3f/f5c [251973,73035] 0 2022-02-02T18:23:04.645 INFO:tasks.workunit.client.1.smithi159.stdout:3/571: write dd/d19/d35/f8c [894608,12135] 0 2022-02-02T18:23:04.648 INFO:tasks.workunit.client.1.smithi159.stdout:3/572: rename dd/d66/c7c to dd/d66/d69/cba 0 2022-02-02T18:23:04.648 INFO:tasks.workunit.client.1.smithi159.stdout:3/573: chown dd/d19/d38/d3f/d80/d8a/fa6 979021 1 2022-02-02T18:23:04.649 INFO:tasks.workunit.client.1.smithi159.stdout:0/630: dread d1/d11/d38/d42/d47/db0/fcc [0,4194304] 0 2022-02-02T18:23:04.651 INFO:tasks.workunit.client.1.smithi159.stdout:9/593: dwrite d4/d19/d1c/d21/d56/d59/f5a [0,4194304] 0 2022-02-02T18:23:04.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/621: dwrite df/d35/f57 [4194304,4194304] 0 2022-02-02T18:23:04.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/622: creat df/d35/d2a/d2f/d80/d61/da8/fce x:0 0 0 2022-02-02T18:23:04.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/623: chown df/d35/d2a/d3f/d42/d47/d59 144698 1 2022-02-02T18:23:04.653 INFO:tasks.workunit.client.1.smithi159.stdout:0/631: rmdir d1/d11 39 2022-02-02T18:23:04.653 INFO:tasks.workunit.client.1.smithi159.stdout:0/632: readlink d1/dd/d4b/d7d/la9 0 2022-02-02T18:23:04.654 INFO:tasks.workunit.client.1.smithi159.stdout:1/565: dwrite df/d21/d23/d49/f4e [4194304,4194304] 0 2022-02-02T18:23:04.654 INFO:tasks.workunit.client.1.smithi159.stdout:0/633: rename d1/d11/d8d/fb1 to d1/dd/d4b/da7/da8/fdc 0 2022-02-02T18:23:04.655 INFO:tasks.workunit.client.1.smithi159.stdout:0/634: chown d1/d11/d8d 6181348 1 2022-02-02T18:23:04.655 INFO:tasks.workunit.client.1.smithi159.stdout:9/594: truncate d4/d19/f76 1684657 0 2022-02-02T18:23:04.656 INFO:tasks.workunit.client.1.smithi159.stdout:1/566: creat df/d14/d16/d4b/fca x:0 0 0 2022-02-02T18:23:04.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/595: mknod d4/d7a/dbc/cc3 0 2022-02-02T18:23:04.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/596: stat d4/d19/d1c/d21/d22/cbb 0 2022-02-02T18:23:04.660 INFO:tasks.workunit.client.1.smithi159.stdout:0/635: mkdir d1/dd/d4b/ddd 0 2022-02-02T18:23:04.660 INFO:tasks.workunit.client.1.smithi159.stdout:0/636: creat d1/dd/d4b/da7/dc1/fde x:0 0 0 2022-02-02T18:23:04.661 INFO:tasks.workunit.client.1.smithi159.stdout:6/624: link df/d35/d2a/d2f/fad df/d35/d2a/fcf 0 2022-02-02T18:23:04.661 INFO:tasks.workunit.client.1.smithi159.stdout:7/787: dwrite d3/d27/d29/d6b/dc5/f93 [0,4194304] 0 2022-02-02T18:23:04.662 INFO:tasks.workunit.client.1.smithi159.stdout:1/567: creat df/d21/d23/d49/d82/d87/fcb x:0 0 0 2022-02-02T18:23:04.662 INFO:tasks.workunit.client.1.smithi159.stdout:1/568: read df/d14/d16/d4a/d8b/fa9 [922544,99031] 0 2022-02-02T18:23:04.664 INFO:tasks.workunit.client.1.smithi159.stdout:6/625: creat df/d35/d2a/d3f/d55/d6a/fd0 x:0 0 0 2022-02-02T18:23:04.668 INFO:tasks.workunit.client.1.smithi159.stdout:3/574: dwrite dd/d66/d69/f84 [0,4194304] 0 2022-02-02T18:23:04.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/626: dread df/d35/d2a/d3f/d42/d47/d59/d66/d88/f98 [0,4194304] 0 2022-02-02T18:23:04.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/627: chown df/d35/d2a/d3f/d65/fcb 29 1 2022-02-02T18:23:04.671 INFO:tasks.workunit.client.1.smithi159.stdout:1/569: chown df/d14/d16/d4a/c58 71 1 2022-02-02T18:23:04.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/628: dread - df/d35/d2a/d2f/d80/d61/da8/fc4 zero size 2022-02-02T18:23:04.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/629: chown df/d35/d2a/d3f/d42/d47/l4c 1 1 2022-02-02T18:23:04.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/630: chown df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/fc8 81146 1 2022-02-02T18:23:04.672 INFO:tasks.workunit.client.1.smithi159.stdout:9/597: symlink d4/d19/d1c/d1f/lc4 0 2022-02-02T18:23:04.675 INFO:tasks.workunit.client.1.smithi159.stdout:7/788: mknod d3/d27/d29/d6b/dc5/c108 0 2022-02-02T18:23:04.679 INFO:tasks.workunit.client.1.smithi159.stdout:1/570: readlink df/d21/d23/l5f 0 2022-02-02T18:23:04.680 INFO:tasks.workunit.client.1.smithi159.stdout:9/598: creat d4/d7a/dbc/fc5 x:0 0 0 2022-02-02T18:23:04.685 INFO:tasks.workunit.client.1.smithi159.stdout:9/599: mknod d4/d19/d1c/d21/d41/d9a/cc6 0 2022-02-02T18:23:04.685 INFO:tasks.workunit.client.1.smithi159.stdout:0/637: dwrite d1/d11/d38/d42/daf/d34/f57 [0,4194304] 0 2022-02-02T18:23:04.686 INFO:tasks.workunit.client.1.smithi159.stdout:0/638: write d1/d11/d38/faa [436861,6196] 0 2022-02-02T18:23:04.686 INFO:tasks.workunit.client.1.smithi159.stdout:3/575: mkdir dd/d19/d38/d3f/dbb 0 2022-02-02T18:23:04.688 INFO:tasks.workunit.client.1.smithi159.stdout:0/639: creat d1/d11/d38/d94/dd7/fdf x:0 0 0 2022-02-02T18:23:04.688 INFO:tasks.workunit.client.1.smithi159.stdout:0/640: chown d1/d11/d38/d7c 446391 1 2022-02-02T18:23:04.689 INFO:tasks.workunit.client.1.smithi159.stdout:1/571: rename df/d9c to df/d14/d16/d4b/dcc 0 2022-02-02T18:23:04.698 INFO:tasks.workunit.client.1.smithi159.stdout:7/789: dwrite d3/d27/d29/f61 [4194304,4194304] 0 2022-02-02T18:23:04.698 INFO:tasks.workunit.client.1.smithi159.stdout:7/790: creat d3/d27/db7/f109 x:0 0 0 2022-02-02T18:23:04.699 INFO:tasks.workunit.client.1.smithi159.stdout:7/791: creat d3/d5/d95/f10a x:0 0 0 2022-02-02T18:23:04.781 INFO:tasks.workunit.client.1.smithi159.stdout:1/572: dread df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:04.782 INFO:tasks.workunit.client.1.smithi159.stdout:0/641: dread d1/d11/f68 [4194304,4194304] 0 2022-02-02T18:23:04.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/600: truncate d4/d19/d1c/d1f/f24 737278 0 2022-02-02T18:23:04.794 INFO:tasks.workunit.client.1.smithi159.stdout:3/576: truncate dd/d19/d35/fa9 3116511 0 2022-02-02T18:23:04.794 INFO:tasks.workunit.client.1.smithi159.stdout:3/577: stat dd/d19/d38 0 2022-02-02T18:23:04.801 INFO:tasks.workunit.client.1.smithi159.stdout:1/573: creat df/d21/d23/fcd x:0 0 0 2022-02-02T18:23:04.802 INFO:tasks.workunit.client.1.smithi159.stdout:9/601: mkdir d4/d19/d6f/d74/db1/dc7 0 2022-02-02T18:23:04.805 INFO:tasks.workunit.client.1.smithi159.stdout:9/602: mkdir d4/d19/d6f/d74/db1/dc7/dc8 0 2022-02-02T18:23:04.805 INFO:tasks.workunit.client.1.smithi159.stdout:9/603: chown d4/c92 2746148 1 2022-02-02T18:23:04.808 INFO:tasks.workunit.client.1.smithi159.stdout:3/578: dread dd/d19/f4e [0,4194304] 0 2022-02-02T18:23:04.809 INFO:tasks.workunit.client.1.smithi159.stdout:9/604: mkdir d4/d19/d1c/d21/d95/dc9 0 2022-02-02T18:23:04.810 INFO:tasks.workunit.client.1.smithi159.stdout:9/605: truncate d4/d19/d1c/d21/d95/f82 206756 0 2022-02-02T18:23:04.811 INFO:tasks.workunit.client.1.smithi159.stdout:0/642: dwrite d1/d11/f68 [4194304,4194304] 0 2022-02-02T18:23:04.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/574: dread df/d14/d16/d4a/f46 [0,4194304] 0 2022-02-02T18:23:04.815 INFO:tasks.workunit.client.1.smithi159.stdout:9/606: link d4/d2a/f40 d4/d19/d1c/fca 0 2022-02-02T18:23:04.817 INFO:tasks.workunit.client.1.smithi159.stdout:9/607: creat d4/d2a/d87/fcb x:0 0 0 2022-02-02T18:23:04.818 INFO:tasks.workunit.client.1.smithi159.stdout:9/608: write d4/d7a/db7/fb8 [480733,53024] 0 2022-02-02T18:23:04.819 INFO:tasks.workunit.client.1.smithi159.stdout:9/609: write d4/d19/d42/f85 [14062,37454] 0 2022-02-02T18:23:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:0/643: rmdir d1/d11/d38 39 2022-02-02T18:23:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:9/610: mknod d4/d2a/d87/ccc 0 2022-02-02T18:23:04.823 INFO:tasks.workunit.client.1.smithi159.stdout:7/792: rmdir d3/d27 39 2022-02-02T18:23:04.825 INFO:tasks.workunit.client.1.smithi159.stdout:1/575: rename df/d21/d23/d49/d69/d81/da3 to df/d21/dce 0 2022-02-02T18:23:04.826 INFO:tasks.workunit.client.1.smithi159.stdout:0/644: read d1/d11/d38/f4c [1506308,111875] 0 2022-02-02T18:23:04.827 INFO:tasks.workunit.client.1.smithi159.stdout:9/611: creat d4/d19/d6f/d74/db1/dc7/dc8/fcd x:0 0 0 2022-02-02T18:23:04.832 INFO:tasks.workunit.client.1.smithi159.stdout:7/793: truncate d3/f4e 1896115 0 2022-02-02T18:23:04.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/576: symlink df/d21/d23/d49/d69/d6c/lcf 0 2022-02-02T18:23:04.835 INFO:tasks.workunit.client.1.smithi159.stdout:1/577: rename df/d14/d16/d4b/f52 to df/fd0 0 2022-02-02T18:23:04.841 INFO:tasks.workunit.client.1.smithi159.stdout:3/579: dwrite dd/d66/d92/f93 [0,4194304] 0 2022-02-02T18:23:04.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/580: creat dd/d20/d2a/d31/fbc x:0 0 0 2022-02-02T18:23:04.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/612: dread d4/f96 [0,4194304] 0 2022-02-02T18:23:04.847 INFO:tasks.workunit.client.1.smithi159.stdout:3/581: dread dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:04.847 INFO:tasks.workunit.client.1.smithi159.stdout:9/613: mkdir d4/dce 0 2022-02-02T18:23:04.850 INFO:tasks.workunit.client.1.smithi159.stdout:3/582: rename dd/d66/d92/f8e to dd/d66/da1/db5/fbd 0 2022-02-02T18:23:04.851 INFO:tasks.workunit.client.1.smithi159.stdout:9/614: dread d4/d19/f36 [0,4194304] 0 2022-02-02T18:23:04.853 INFO:tasks.workunit.client.1.smithi159.stdout:3/583: read dd/d19/f24 [2681198,59487] 0 2022-02-02T18:23:04.854 INFO:tasks.workunit.client.1.smithi159.stdout:1/578: dread df/d21/f66 [0,4194304] 0 2022-02-02T18:23:04.855 INFO:tasks.workunit.client.1.smithi159.stdout:7/794: dwrite d3/d5/d56/d2f/fe0 [0,4194304] 0 2022-02-02T18:23:04.857 INFO:tasks.workunit.client.1.smithi159.stdout:0/645: dwrite d1/d19/d3d/f7b [0,4194304] 0 2022-02-02T18:23:04.859 INFO:tasks.workunit.client.1.smithi159.stdout:0/646: mknod d1/d11/ce0 0 2022-02-02T18:23:04.859 INFO:tasks.workunit.client.1.smithi159.stdout:3/584: write dd/d66/d69/f79 [2714412,51955] 0 2022-02-02T18:23:04.861 INFO:tasks.workunit.client.1.smithi159.stdout:3/585: getdents dd/d19/d38 0 2022-02-02T18:23:04.862 INFO:tasks.workunit.client.1.smithi159.stdout:7/795: write d3/d5/d56/d2f/f4c [3701316,99098] 0 2022-02-02T18:23:04.863 INFO:tasks.workunit.client.1.smithi159.stdout:7/796: creat d3/d27/d29/d6b/da7/f10b x:0 0 0 2022-02-02T18:23:04.864 INFO:tasks.workunit.client.1.smithi159.stdout:7/797: fsync d3/d2a/d2c/fef 0 2022-02-02T18:23:04.866 INFO:tasks.workunit.client.1.smithi159.stdout:1/579: dread df/f8a [0,4194304] 0 2022-02-02T18:23:04.867 INFO:tasks.workunit.client.1.smithi159.stdout:1/580: stat df/d14/d16/d4a/f44 0 2022-02-02T18:23:04.867 INFO:tasks.workunit.client.1.smithi159.stdout:9/615: dread d4/d19/d42/f85 [0,4194304] 0 2022-02-02T18:23:04.870 INFO:tasks.workunit.client.1.smithi159.stdout:1/581: unlink df/f18 0 2022-02-02T18:23:04.872 INFO:tasks.workunit.client.1.smithi159.stdout:0/647: dread d1/d11/d38/f4c [4194304,4194304] 0 2022-02-02T18:23:04.872 INFO:tasks.workunit.client.1.smithi159.stdout:9/616: rename d4/d19/d1c/d1f/f3f to d4/d19/d1c/d21/d56/d59/fcf 0 2022-02-02T18:23:04.873 INFO:tasks.workunit.client.1.smithi159.stdout:0/648: truncate d1/fc 3972034 0 2022-02-02T18:23:04.874 INFO:tasks.workunit.client.1.smithi159.stdout:1/582: rmdir df/d21/dce 39 2022-02-02T18:23:04.875 INFO:tasks.workunit.client.1.smithi159.stdout:1/583: write df/d14/f57 [1125183,74908] 0 2022-02-02T18:23:04.875 INFO:tasks.workunit.client.1.smithi159.stdout:1/584: fsync fe 0 2022-02-02T18:23:04.875 INFO:tasks.workunit.client.1.smithi159.stdout:0/649: creat d1/dd/d4b/da7/fe1 x:0 0 0 2022-02-02T18:23:04.876 INFO:tasks.workunit.client.1.smithi159.stdout:9/617: creat d4/d7a/fd0 x:0 0 0 2022-02-02T18:23:04.876 INFO:tasks.workunit.client.1.smithi159.stdout:9/618: fsync d4/d19/d1c/d21/d41/f7c 0 2022-02-02T18:23:04.882 INFO:tasks.workunit.client.1.smithi159.stdout:9/619: mkdir d4/d19/d1c/d21/da8/db9/dd1 0 2022-02-02T18:23:04.884 INFO:tasks.workunit.client.1.smithi159.stdout:9/620: link d4/d19/d6f/d78/lab d4/d19/d6f/d74/db1/dc7/ld2 0 2022-02-02T18:23:04.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/621: dread d4/d19/d1c/d1f/f4d [0,4194304] 0 2022-02-02T18:23:04.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/622: stat d4/d19/d1c/d21/d56/d59/fb0 0 2022-02-02T18:23:04.900 INFO:tasks.workunit.client.1.smithi159.stdout:9/623: rmdir d4/d7a/db7 39 2022-02-02T18:23:04.901 INFO:tasks.workunit.client.1.smithi159.stdout:9/624: rmdir d4/dce 0 2022-02-02T18:23:04.903 INFO:tasks.workunit.client.1.smithi159.stdout:9/625: symlink d4/d19/d1c/d21/d22/d55/ld3 0 2022-02-02T18:23:04.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/586: dwrite dd/d19/d38/f3d [0,4194304] 0 2022-02-02T18:23:04.904 INFO:tasks.workunit.client.1.smithi159.stdout:9/626: symlink d4/d19/d6f/d74/db1/ld4 0 2022-02-02T18:23:04.905 INFO:tasks.workunit.client.1.smithi159.stdout:7/798: dwrite d3/d2a/dcc/d8b/d8c/d99/fe2 [0,4194304] 0 2022-02-02T18:23:04.905 INFO:tasks.workunit.client.1.smithi159.stdout:7/799: chown d3/d6/l84 26505723 1 2022-02-02T18:23:04.905 INFO:tasks.workunit.client.1.smithi159.stdout:1/585: dwrite df/d14/d16/d6d/f90 [0,4194304] 0 2022-02-02T18:23:04.906 INFO:tasks.workunit.client.1.smithi159.stdout:1/586: fdatasync df/d21/d23/d49/d69/f96 0 2022-02-02T18:23:04.906 INFO:tasks.workunit.client.1.smithi159.stdout:0/650: dwrite d1/dd/d4b/da7/dc1/fde [0,4194304] 0 2022-02-02T18:23:04.908 INFO:tasks.workunit.client.1.smithi159.stdout:0/651: symlink d1/d11/d38/d42/d47/db0/le2 0 2022-02-02T18:23:04.908 INFO:tasks.workunit.client.1.smithi159.stdout:0/652: chown d1/d19/d3d/f45 4 1 2022-02-02T18:23:04.909 INFO:tasks.workunit.client.1.smithi159.stdout:0/653: truncate d1/d11/d8d/fd5 923299 0 2022-02-02T18:23:04.909 INFO:tasks.workunit.client.1.smithi159.stdout:0/654: chown d1/d11/d38/d42/db5 28287377 1 2022-02-02T18:23:04.927 INFO:tasks.workunit.client.1.smithi159.stdout:0/655: rename d1/dd/c58 to d1/dd/d4b/ce3 0 2022-02-02T18:23:04.927 INFO:tasks.workunit.client.1.smithi159.stdout:0/656: readlink d1/d11/d38/d42/lba 0 2022-02-02T18:23:04.927 INFO:tasks.workunit.client.1.smithi159.stdout:0/657: fdatasync d1/f3 0 2022-02-02T18:23:04.931 INFO:tasks.workunit.client.1.smithi159.stdout:3/587: write dd/d66/d92/f6a [144385,121796] 0 2022-02-02T18:23:04.931 INFO:tasks.workunit.client.1.smithi159.stdout:3/588: truncate dd/d19/d35/f44 4452620 0 2022-02-02T18:23:04.931 INFO:tasks.workunit.client.1.smithi159.stdout:9/627: mknod d4/d2a/d87/da1/cd5 0 2022-02-02T18:23:04.934 INFO:tasks.workunit.client.1.smithi159.stdout:7/800: getdents d3/d2a 0 2022-02-02T18:23:04.934 INFO:tasks.workunit.client.1.smithi159.stdout:7/801: dread - d3/d5/d95/ff8 zero size 2022-02-02T18:23:04.942 INFO:tasks.workunit.client.1.smithi159.stdout:9/628: rename d4/c60 to d4/d19/d6f/d74/db1/dc7/dc8/cd6 0 2022-02-02T18:23:04.944 INFO:tasks.workunit.client.1.smithi159.stdout:7/802: symlink d3/d27/d29/d5e/d80/daa/l10c 0 2022-02-02T18:23:04.945 INFO:tasks.workunit.client.1.smithi159.stdout:1/587: getdents df/d14/d16/d6d 0 2022-02-02T18:23:04.947 INFO:tasks.workunit.client.1.smithi159.stdout:3/589: mkdir dd/d66/d92/dbe 0 2022-02-02T18:23:04.947 INFO:tasks.workunit.client.1.smithi159.stdout:9/629: mkdir d4/d19/d42/daf/dd7 0 2022-02-02T18:23:04.949 INFO:tasks.workunit.client.1.smithi159.stdout:3/590: dread dd/d19/d38/d3f/d80/d8a/f9f [0,4194304] 0 2022-02-02T18:23:04.949 INFO:tasks.workunit.client.1.smithi159.stdout:7/803: stat d3/d5/d56/d57/f3f 0 2022-02-02T18:23:04.949 INFO:tasks.workunit.client.1.smithi159.stdout:7/804: write d3/d2a/dcc/d8b/d8c/d99/fb8 [999605,12516] 0 2022-02-02T18:23:04.950 INFO:tasks.workunit.client.1.smithi159.stdout:1/588: creat df/d21/d23/d49/da1/dac/fd1 x:0 0 0 2022-02-02T18:23:04.951 INFO:tasks.workunit.client.1.smithi159.stdout:9/630: creat d4/d19/d42/daf/dd7/fd8 x:0 0 0 2022-02-02T18:23:04.952 INFO:tasks.workunit.client.1.smithi159.stdout:9/631: write d4/d19/d6f/d74/f8f [1296853,59441] 0 2022-02-02T18:23:04.953 INFO:tasks.workunit.client.1.smithi159.stdout:7/805: creat d3/d27/d6f/da2/f10d x:0 0 0 2022-02-02T18:23:04.954 INFO:tasks.workunit.client.1.smithi159.stdout:7/806: dread d3/d107/ff7 [0,4194304] 0 2022-02-02T18:23:04.955 INFO:tasks.workunit.client.1.smithi159.stdout:1/589: creat df/d14/d16/da8/fd2 x:0 0 0 2022-02-02T18:23:04.956 INFO:tasks.workunit.client.1.smithi159.stdout:3/591: symlink dd/d20/d2a/lbf 0 2022-02-02T18:23:04.958 INFO:tasks.workunit.client.1.smithi159.stdout:9/632: mknod d4/d19/d6f/d74/cd9 0 2022-02-02T18:23:04.958 INFO:tasks.workunit.client.1.smithi159.stdout:9/633: readlink d4/d19/d1c/d21/da8/lac 0 2022-02-02T18:23:04.959 INFO:tasks.workunit.client.1.smithi159.stdout:1/590: creat df/d14/d16/d4b/fd3 x:0 0 0 2022-02-02T18:23:04.962 INFO:tasks.workunit.client.1.smithi159.stdout:3/592: symlink dd/d66/da1/lc0 0 2022-02-02T18:23:04.963 INFO:tasks.workunit.client.1.smithi159.stdout:3/593: chown dd/d19/d38/d3f/d80/c72 391116395 1 2022-02-02T18:23:04.963 INFO:tasks.workunit.client.1.smithi159.stdout:3/594: creat dd/d66/d69/d77/fc1 x:0 0 0 2022-02-02T18:23:04.964 INFO:tasks.workunit.client.1.smithi159.stdout:3/595: truncate dd/d66/f9b 32241 0 2022-02-02T18:23:04.964 INFO:tasks.workunit.client.1.smithi159.stdout:1/591: mkdir df/d21/d23/d49/da1/dd4 0 2022-02-02T18:23:04.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/592: readlink df/d14/lc5 0 2022-02-02T18:23:04.965 INFO:tasks.workunit.client.1.smithi159.stdout:9/634: write d4/d19/d1c/d21/d41/fbf [64276,128358] 0 2022-02-02T18:23:04.966 INFO:tasks.workunit.client.1.smithi159.stdout:9/635: stat d4/d19/d6f/d74/f8f 0 2022-02-02T18:23:04.966 INFO:tasks.workunit.client.1.smithi159.stdout:9/636: mknod d4/d19/d6f/d74/db1/dc7/cda 0 2022-02-02T18:23:04.967 INFO:tasks.workunit.client.1.smithi159.stdout:3/596: getdents dd/d66 0 2022-02-02T18:23:04.967 INFO:tasks.workunit.client.1.smithi159.stdout:7/807: dread d3/d27/db7/fde [0,4194304] 0 2022-02-02T18:23:04.969 INFO:tasks.workunit.client.1.smithi159.stdout:9/637: truncate d4/d2a/f5e 1305543 0 2022-02-02T18:23:04.970 INFO:tasks.workunit.client.1.smithi159.stdout:3/597: symlink dd/d66/d69/db0/lc2 0 2022-02-02T18:23:04.970 INFO:tasks.workunit.client.1.smithi159.stdout:9/638: mknod d4/d2a/d87/cdb 0 2022-02-02T18:23:04.971 INFO:tasks.workunit.client.1.smithi159.stdout:7/808: mknod d3/d27/d29/d6b/da7/c10e 0 2022-02-02T18:23:04.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/576: sync 2022-02-02T18:23:04.976 INFO:tasks.workunit.client.1.smithi159.stdout:9/639: dread d4/d19/d6f/d74/db1/fb5 [0,4194304] 0 2022-02-02T18:23:04.979 INFO:tasks.workunit.client.1.smithi159.stdout:4/577: link d0/d8/d41/db7/d33/d47/d56/cb2 d0/d8/d41/cc4 0 2022-02-02T18:23:04.980 INFO:tasks.workunit.client.1.smithi159.stdout:4/578: fdatasync d0/d8/d15/f69 0 2022-02-02T18:23:04.980 INFO:tasks.workunit.client.1.smithi159.stdout:9/640: creat d4/d19/d1c/fdc x:0 0 0 2022-02-02T18:23:04.982 INFO:tasks.workunit.client.1.smithi159.stdout:7/809: mkdir d3/d27/d10f 0 2022-02-02T18:23:04.982 INFO:tasks.workunit.client.1.smithi159.stdout:7/810: dread - d3/d27/d6f/fcf zero size 2022-02-02T18:23:04.983 INFO:tasks.workunit.client.1.smithi159.stdout:7/811: creat d3/d5/d95/f110 x:0 0 0 2022-02-02T18:23:04.983 INFO:tasks.workunit.client.1.smithi159.stdout:7/812: chown d3/f14 0 1 2022-02-02T18:23:04.984 INFO:tasks.workunit.client.1.smithi159.stdout:4/579: getdents d0/d8/d41/db7/d36/d4b 0 2022-02-02T18:23:04.985 INFO:tasks.workunit.client.1.smithi159.stdout:7/813: mknod d3/d2a/d4a/c111 0 2022-02-02T18:23:04.986 INFO:tasks.workunit.client.1.smithi159.stdout:7/814: chown d3/d5/d56/d57/ca 1991167 1 2022-02-02T18:23:04.986 INFO:tasks.workunit.client.1.smithi159.stdout:4/580: readlink d0/d8/d30/l3d 0 2022-02-02T18:23:04.987 INFO:tasks.workunit.client.1.smithi159.stdout:4/581: fdatasync d0/d66/f73 0 2022-02-02T18:23:04.990 INFO:tasks.workunit.client.1.smithi159.stdout:3/598: dwrite dd/d19/d38/d3f/f7a [0,4194304] 0 2022-02-02T18:23:04.993 INFO:tasks.workunit.client.1.smithi159.stdout:1/593: dwrite df/d14/d16/d4b/d5b/f2e [0,4194304] 0 2022-02-02T18:23:04.994 INFO:tasks.workunit.client.1.smithi159.stdout:1/594: fsync df/d21/f54 0 2022-02-02T18:23:04.995 INFO:tasks.workunit.client.1.smithi159.stdout:3/599: symlink dd/d19/d38/d3f/dbb/lc3 0 2022-02-02T18:23:05.003 INFO:tasks.workunit.client.1.smithi159.stdout:3/600: mknod dd/d66/cc4 0 2022-02-02T18:23:05.004 INFO:tasks.workunit.client.1.smithi159.stdout:3/601: read dd/d19/d35/fa9 [1306521,56522] 0 2022-02-02T18:23:05.006 INFO:tasks.workunit.client.1.smithi159.stdout:1/595: rename df/d14/d16/d4b/d5b/l41 to df/d21/d23/d49/d82/d87/ld5 0 2022-02-02T18:23:05.007 INFO:tasks.workunit.client.1.smithi159.stdout:3/602: write dd/d20/f64 [497605,76963] 0 2022-02-02T18:23:05.008 INFO:tasks.workunit.client.1.smithi159.stdout:1/596: creat df/d14/d16/d4a/fd6 x:0 0 0 2022-02-02T18:23:05.009 INFO:tasks.workunit.client.1.smithi159.stdout:9/641: dwrite d4/d19/d1c/d1f/f98 [4194304,4194304] 0 2022-02-02T18:23:05.009 INFO:tasks.workunit.client.1.smithi159.stdout:3/603: getdents dd 0 2022-02-02T18:23:05.010 INFO:tasks.workunit.client.1.smithi159.stdout:3/604: write dd/d19/d35/f4c [2409400,35033] 0 2022-02-02T18:23:05.011 INFO:tasks.workunit.client.1.smithi159.stdout:1/597: creat df/d21/d23/d49/da1/fd7 x:0 0 0 2022-02-02T18:23:05.012 INFO:tasks.workunit.client.1.smithi159.stdout:1/598: fsync df/d21/d23/d49/d69/d6c/fbd 0 2022-02-02T18:23:05.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/599: creat df/d21/d23/d49/da1/dac/fd8 x:0 0 0 2022-02-02T18:23:05.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/642: getdents d4/d19/d1c 0 2022-02-02T18:23:05.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/605: creat dd/d66/da1/db5/fc5 x:0 0 0 2022-02-02T18:23:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:1/600: symlink df/d21/d23/d49/d69/ld9 0 2022-02-02T18:23:05.016 INFO:tasks.workunit.client.1.smithi159.stdout:9/643: mkdir d4/d19/d1c/d21/da8/db9/ddd 0 2022-02-02T18:23:05.017 INFO:tasks.workunit.client.1.smithi159.stdout:7/815: dwrite d3/d27/db7/fde [4194304,4194304] 0 2022-02-02T18:23:05.018 INFO:tasks.workunit.client.1.smithi159.stdout:4/582: dwrite d0/f25 [0,4194304] 0 2022-02-02T18:23:05.019 INFO:tasks.workunit.client.1.smithi159.stdout:3/606: read dd/f9e [3318808,34844] 0 2022-02-02T18:23:05.020 INFO:tasks.workunit.client.1.smithi159.stdout:3/607: chown dd/d66/d92/f6a 1433159 1 2022-02-02T18:23:05.027 INFO:tasks.workunit.client.1.smithi159.stdout:1/601: unlink df/d14/d16/d4a/f59 0 2022-02-02T18:23:05.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/602: chown df/d14/d16/d6d 181307398 1 2022-02-02T18:23:05.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/603: creat df/d14/d68/dad/fda x:0 0 0 2022-02-02T18:23:05.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/604: read - df/d21/d23/d49/da1/dac/fd8 zero size 2022-02-02T18:23:05.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/605: symlink df/d21/d23/d49/ldb 0 2022-02-02T18:23:05.032 INFO:tasks.workunit.client.1.smithi159.stdout:7/816: getdents d3/d2a/d2c 0 2022-02-02T18:23:05.033 INFO:tasks.workunit.client.1.smithi159.stdout:7/817: write d3/d27/d29/d6b/da7/f10b [284705,89785] 0 2022-02-02T18:23:05.033 INFO:tasks.workunit.client.1.smithi159.stdout:7/818: write d3/d6/f4d [2649008,88182] 0 2022-02-02T18:23:05.033 INFO:tasks.workunit.client.1.smithi159.stdout:4/583: getdents d0/d8/d30/d5d 0 2022-02-02T18:23:05.035 INFO:tasks.workunit.client.1.smithi159.stdout:7/819: rmdir d3/d27/d29/d5e/d80/dee 39 2022-02-02T18:23:05.035 INFO:tasks.workunit.client.1.smithi159.stdout:7/820: mkdir d3/d27/d10f/d112 0 2022-02-02T18:23:05.036 INFO:tasks.workunit.client.1.smithi159.stdout:4/584: mknod d0/d8/d15/cc5 0 2022-02-02T18:23:05.036 INFO:tasks.workunit.client.1.smithi159.stdout:7/821: mknod d3/d27/d10f/c113 0 2022-02-02T18:23:05.038 INFO:tasks.workunit.client.1.smithi159.stdout:3/608: dwrite dd/d20/d2a/f75 [0,4194304] 0 2022-02-02T18:23:05.039 INFO:tasks.workunit.client.1.smithi159.stdout:7/822: rename d3/d5/d56/d57/f4f to d3/d27/d29/f114 0 2022-02-02T18:23:05.039 INFO:tasks.workunit.client.1.smithi159.stdout:7/823: chown d3/d5/d56/d2f/fd1 181132469 1 2022-02-02T18:23:05.040 INFO:tasks.workunit.client.1.smithi159.stdout:7/824: read d3/d5/f20 [401862,40374] 0 2022-02-02T18:23:05.041 INFO:tasks.workunit.client.1.smithi159.stdout:4/585: symlink d0/d8/d24/d76/lc6 0 2022-02-02T18:23:05.046 INFO:tasks.workunit.client.1.smithi159.stdout:1/606: dread df/d14/d16/d4b/f55 [0,4194304] 0 2022-02-02T18:23:05.046 INFO:tasks.workunit.client.1.smithi159.stdout:1/607: fdatasync df/d14/d16/d4b/da0/fc2 0 2022-02-02T18:23:05.046 INFO:tasks.workunit.client.1.smithi159.stdout:1/608: read - df/d21/d23/f7c zero size 2022-02-02T18:23:05.047 INFO:tasks.workunit.client.1.smithi159.stdout:7/825: symlink d3/d2a/dcc/d8b/df1/d105/l115 0 2022-02-02T18:23:05.047 INFO:tasks.workunit.client.1.smithi159.stdout:4/586: creat d0/d8/d41/db7/d33/dc0/fc7 x:0 0 0 2022-02-02T18:23:05.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/609: mknod dd/d19/d38/d3f/cc6 0 2022-02-02T18:23:05.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/610: write dd/d66/da1/db5/fc5 [398854,45579] 0 2022-02-02T18:23:05.048 INFO:tasks.workunit.client.1.smithi159.stdout:3/611: truncate dd/d19/d38/d3f/f5c 937806 0 2022-02-02T18:23:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:4/587: write d0/d8/d41/db7/d33/d47/d56/f7a [771275,39535] 0 2022-02-02T18:23:05.050 INFO:tasks.workunit.client.1.smithi159.stdout:4/588: read - d0/f2b zero size 2022-02-02T18:23:05.054 INFO:tasks.workunit.client.1.smithi159.stdout:4/589: read d0/d8/d15/f57 [664679,115636] 0 2022-02-02T18:23:05.054 INFO:tasks.workunit.client.1.smithi159.stdout:4/590: fsync d0/d8/d15/f27 0 2022-02-02T18:23:05.107 INFO:tasks.workunit.client.1.smithi159.stdout:7/826: rename d3/d27/d6f/fe6 to d3/d2a/dcc/d8b/df1/d105/f116 0 2022-02-02T18:23:05.107 INFO:tasks.workunit.client.1.smithi159.stdout:9/644: dwrite d4/d19/f3e [0,4194304] 0 2022-02-02T18:23:05.107 INFO:tasks.workunit.client.1.smithi159.stdout:9/645: write d4/d19/d1c/f44 [5127179,61574] 0 2022-02-02T18:23:05.109 INFO:tasks.workunit.client.1.smithi159.stdout:1/609: dwrite df/d14/d16/f60 [0,4194304] 0 2022-02-02T18:23:05.109 INFO:tasks.workunit.client.1.smithi159.stdout:1/610: chown df/d14/d16/f38 526474372 1 2022-02-02T18:23:05.126 INFO:tasks.workunit.client.1.smithi159.stdout:1/611: mknod df/d14/d16/d4b/da0/cdc 0 2022-02-02T18:23:05.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/827: dwrite d3/d5/d95/ff8 [0,4194304] 0 2022-02-02T18:23:05.127 INFO:tasks.workunit.client.1.smithi159.stdout:1/612: write df/f8a [3832366,105584] 0 2022-02-02T18:23:05.128 INFO:tasks.workunit.client.1.smithi159.stdout:9/646: truncate d4/d19/d1c/d21/d22/d55/f6c 935838 0 2022-02-02T18:23:05.134 INFO:tasks.workunit.client.1.smithi159.stdout:7/828: mkdir d3/d27/d29/d5e/d80/daa/d117 0 2022-02-02T18:23:05.134 INFO:tasks.workunit.client.1.smithi159.stdout:7/829: write d3/d27/d29/d5e/d80/dee/fd0 [290352,12770] 0 2022-02-02T18:23:05.136 INFO:tasks.workunit.client.1.smithi159.stdout:4/591: rename d0/d8/d30/d7e/d98 to d0/d7b/dc8 0 2022-02-02T18:23:05.136 INFO:tasks.workunit.client.1.smithi159.stdout:7/830: dread d3/d27/d29/d6b/da7/fb3 [0,4194304] 0 2022-02-02T18:23:05.137 INFO:tasks.workunit.client.1.smithi159.stdout:7/831: fdatasync d3/d2a/dcc/d8b/d8c/d99/fb8 0 2022-02-02T18:23:05.138 INFO:tasks.workunit.client.1.smithi159.stdout:1/613: creat df/d21/d23/d49/d69/fdd x:0 0 0 2022-02-02T18:23:05.138 INFO:tasks.workunit.client.1.smithi159.stdout:1/614: fdatasync df/d14/d16/d4a/f44 0 2022-02-02T18:23:05.139 INFO:tasks.workunit.client.1.smithi159.stdout:7/832: creat d3/d27/f118 x:0 0 0 2022-02-02T18:23:05.141 INFO:tasks.workunit.client.1.smithi159.stdout:1/615: chown df/d21/c47 121 1 2022-02-02T18:23:05.141 INFO:tasks.workunit.client.1.smithi159.stdout:1/616: chown df/d21/f66 3641885 1 2022-02-02T18:23:05.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/617: mkdir df/d14/d16/d4b/dcc/dde 0 2022-02-02T18:23:05.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/618: dread - df/fae zero size 2022-02-02T18:23:05.149 INFO:tasks.workunit.client.1.smithi159.stdout:3/612: dwrite dd/d19/d38/d3f/d80/d8a/fa6 [0,4194304] 0 2022-02-02T18:23:05.150 INFO:tasks.workunit.client.1.smithi159.stdout:9/647: rename d4/f6a to d4/d2a/fde 0 2022-02-02T18:23:05.150 INFO:tasks.workunit.client.1.smithi159.stdout:9/648: stat d4/d19/d1c/d21/f45 0 2022-02-02T18:23:05.151 INFO:tasks.workunit.client.1.smithi159.stdout:7/833: dread d3/d27/d29/d6b/f6e [0,4194304] 0 2022-02-02T18:23:05.152 INFO:tasks.workunit.client.1.smithi159.stdout:8/569: sync 2022-02-02T18:23:05.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/570: rename d1/d26/d48/d49/lb2 to d1/dd/d2c/d67/lc5 0 2022-02-02T18:23:05.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/571: write d1/dd/d2c/d67/f50 [3736614,81997] 0 2022-02-02T18:23:05.156 INFO:tasks.workunit.client.1.smithi159.stdout:4/592: write d0/f5 [208980,108864] 0 2022-02-02T18:23:05.156 INFO:tasks.workunit.client.1.smithi159.stdout:4/593: write d0/d8/d30/d5d/f90 [160800,24561] 0 2022-02-02T18:23:05.156 INFO:tasks.workunit.client.1.smithi159.stdout:3/613: creat dd/d66/d92/fc7 x:0 0 0 2022-02-02T18:23:05.157 INFO:tasks.workunit.client.1.smithi159.stdout:3/614: readlink dd/d20/d60/lad 0 2022-02-02T18:23:05.158 INFO:tasks.workunit.client.1.smithi159.stdout:8/572: symlink d1/d26/lc6 0 2022-02-02T18:23:05.158 INFO:tasks.workunit.client.1.smithi159.stdout:8/573: dread - d1/dd/f92 zero size 2022-02-02T18:23:05.158 INFO:tasks.workunit.client.1.smithi159.stdout:8/574: write d1/d26/fbb [844919,63308] 0 2022-02-02T18:23:05.159 INFO:tasks.workunit.client.1.smithi159.stdout:9/649: mkdir d4/d19/d1c/d21/d95/dc9/ddf 0 2022-02-02T18:23:05.159 INFO:tasks.workunit.client.1.smithi159.stdout:7/834: rmdir d3/d2a 39 2022-02-02T18:23:05.159 INFO:tasks.workunit.client.1.smithi159.stdout:7/835: write d3/d6/f17 [4314415,99175] 0 2022-02-02T18:23:05.160 INFO:tasks.workunit.client.1.smithi159.stdout:8/575: link d1/dd/d2c/d67/ca1 d1/dd/d2c/d67/d5f/d8a/cc7 0 2022-02-02T18:23:05.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/576: stat d1/d26 0 2022-02-02T18:23:05.161 INFO:tasks.workunit.client.1.smithi159.stdout:1/619: symlink df/d21/d23/ldf 0 2022-02-02T18:23:05.161 INFO:tasks.workunit.client.1.smithi159.stdout:1/620: chown df/d14/d16/d4b/l94 7 1 2022-02-02T18:23:05.161 INFO:tasks.workunit.client.1.smithi159.stdout:4/594: rename d0 to d0/d8/d41/db7/d36/dc9 22 2022-02-02T18:23:05.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/595: fdatasync d0/d8/d41/db7/d36/fa6 0 2022-02-02T18:23:05.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/596: truncate d0/d8/f20 1632099 0 2022-02-02T18:23:05.163 INFO:tasks.workunit.client.1.smithi159.stdout:4/597: write d0/d8/d41/db7/d33/d47/f9a [5534770,90537] 0 2022-02-02T18:23:05.298 INFO:tasks.workunit.client.1.smithi159.stdout:3/615: mkdir dd/d66/d69/db0/dc8 0 2022-02-02T18:23:05.309 INFO:tasks.workunit.client.1.smithi159.stdout:8/577: dread d1/dd/d1a/d53/f54 [0,4194304] 0 2022-02-02T18:23:05.309 INFO:tasks.workunit.client.1.smithi159.stdout:8/578: symlink d1/dd/lc8 0 2022-02-02T18:23:05.309 INFO:tasks.workunit.client.1.smithi159.stdout:8/579: fdatasync d1/dd/d1a/d53/f72 0 2022-02-02T18:23:05.310 INFO:tasks.workunit.client.1.smithi159.stdout:1/621: link df/d21/d23/d49/d82/f9e df/d14/d16/d4b/da0/fe0 0 2022-02-02T18:23:05.310 INFO:tasks.workunit.client.1.smithi159.stdout:8/580: unlink d1/d26/d48/c7e 0 2022-02-02T18:23:05.310 INFO:tasks.workunit.client.1.smithi159.stdout:8/581: chown d1/dc/l14 57 1 2022-02-02T18:23:05.311 INFO:tasks.workunit.client.1.smithi159.stdout:3/616: symlink dd/d66/d69/d77/lc9 0 2022-02-02T18:23:05.311 INFO:tasks.workunit.client.1.smithi159.stdout:8/582: write d1/dd/d1a/d53/f80 [312218,22475] 0 2022-02-02T18:23:05.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/836: mkdir d3/d27/d29/d5e/d80/d119 0 2022-02-02T18:23:05.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/837: fdatasync d3/d27/f118 0 2022-02-02T18:23:05.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/838: fsync d3/d5/d56/d57/f103 0 2022-02-02T18:23:05.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/583: write d1/dd/d1a/d53/f80 [834459,76959] 0 2022-02-02T18:23:05.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/584: write d1/f17 [4264676,292] 0 2022-02-02T18:23:05.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/585: chown d1/dd/c82 3205 1 2022-02-02T18:23:05.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/586: mkdir d1/dad/dc9 0 2022-02-02T18:23:05.313 INFO:tasks.workunit.client.1.smithi159.stdout:8/587: write d1/dd/d1a/f9a [940182,53897] 0 2022-02-02T18:23:05.313 INFO:tasks.workunit.client.1.smithi159.stdout:1/622: creat df/fe1 x:0 0 0 2022-02-02T18:23:05.313 INFO:tasks.workunit.client.1.smithi159.stdout:8/588: unlink d1/l22 0 2022-02-02T18:23:05.313 INFO:tasks.workunit.client.1.smithi159.stdout:8/589: stat d1/d26/d48/d99 0 2022-02-02T18:23:05.314 INFO:tasks.workunit.client.1.smithi159.stdout:3/617: mknod dd/d19/d38/d3f/d7d/cca 0 2022-02-02T18:23:05.314 INFO:tasks.workunit.client.1.smithi159.stdout:1/623: read df/d14/d68/dad/fb4 [2627698,124345] 0 2022-02-02T18:23:05.314 INFO:tasks.workunit.client.1.smithi159.stdout:7/839: truncate d3/d5/f45 2278584 0 2022-02-02T18:23:05.314 INFO:tasks.workunit.client.1.smithi159.stdout:7/840: readlink d3/d2a/dcc/l94 0 2022-02-02T18:23:05.315 INFO:tasks.workunit.client.1.smithi159.stdout:4/598: dwrite d0/d8/d24/d4f/fbb [0,4194304] 0 2022-02-02T18:23:05.315 INFO:tasks.workunit.client.1.smithi159.stdout:7/841: mkdir d3/d2a/dcc/d11a 0 2022-02-02T18:23:05.315 INFO:tasks.workunit.client.1.smithi159.stdout:9/650: write d4/d19/f28 [3211076,47705] 0 2022-02-02T18:23:05.315 INFO:tasks.workunit.client.1.smithi159.stdout:9/651: truncate d4/d19/f76 2071125 0 2022-02-02T18:23:05.316 INFO:tasks.workunit.client.1.smithi159.stdout:9/652: creat d4/d19/d42/daf/dd7/fe0 x:0 0 0 2022-02-02T18:23:05.316 INFO:tasks.workunit.client.1.smithi159.stdout:7/842: symlink d3/d5/d56/d2f/d5b/l11b 0 2022-02-02T18:23:05.316 INFO:tasks.workunit.client.1.smithi159.stdout:4/599: unlink d0/d8/d41/db7/d33/d47/l59 0 2022-02-02T18:23:05.316 INFO:tasks.workunit.client.1.smithi159.stdout:4/600: dread - d0/d8/d30/d5d/f7d zero size 2022-02-02T18:23:05.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/843: read d3/d5/f7f [6454906,74890] 0 2022-02-02T18:23:05.317 INFO:tasks.workunit.client.1.smithi159.stdout:4/601: link d0/d8/d30/d5d/fb5 d0/d8/d41/db7/d33/d47/d56/fca 0 2022-02-02T18:23:05.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/844: symlink d3/d2a/d4a/d7d/deb/d101/l11c 0 2022-02-02T18:23:05.317 INFO:tasks.workunit.client.1.smithi159.stdout:4/602: creat d0/d8/d41/db7/d33/d47/d56/fcb x:0 0 0 2022-02-02T18:23:05.317 INFO:tasks.workunit.client.1.smithi159.stdout:4/603: creat d0/fcc x:0 0 0 2022-02-02T18:23:05.318 INFO:tasks.workunit.client.1.smithi159.stdout:3/618: write dd/f34 [783413,12522] 0 2022-02-02T18:23:05.318 INFO:tasks.workunit.client.1.smithi159.stdout:3/619: rename dd/d19/d38/d3f/d80/f5a to dd/d19/d38/d3f/d52/fcb 0 2022-02-02T18:23:05.318 INFO:tasks.workunit.client.1.smithi159.stdout:8/590: dwrite d1/dad/d95/f91 [0,4194304] 0 2022-02-02T18:23:05.318 INFO:tasks.workunit.client.1.smithi159.stdout:3/620: dread dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:05.319 INFO:tasks.workunit.client.1.smithi159.stdout:1/624: dwrite df/d21/d23/d49/da1/dac/fd8 [0,4194304] 0 2022-02-02T18:23:05.319 INFO:tasks.workunit.client.1.smithi159.stdout:8/591: mkdir d1/dd/d2c/d67/d5f/d8a/dbd/dca 0 2022-02-02T18:23:05.319 INFO:tasks.workunit.client.1.smithi159.stdout:8/592: unlink d1/dd/d2c/d67/f46 0 2022-02-02T18:23:05.319 INFO:tasks.workunit.client.1.smithi159.stdout:8/593: chown d1/dd/d31/l83 0 1 2022-02-02T18:23:05.319 INFO:tasks.workunit.client.1.smithi159.stdout:7/845: dread d3/d27/d29/d5e/d80/dee/fd0 [0,4194304] 0 2022-02-02T18:23:05.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/846: getdents d3/d2a 0 2022-02-02T18:23:05.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/621: write dd/d66/d69/f79 [1379259,77194] 0 2022-02-02T18:23:05.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/622: readlink la 0 2022-02-02T18:23:05.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/623: readlink dd/d19/d38/d3f/d80/l87 0 2022-02-02T18:23:05.320 INFO:tasks.workunit.client.1.smithi159.stdout:9/653: dwrite d4/d2a/f5e [0,4194304] 0 2022-02-02T18:23:05.321 INFO:tasks.workunit.client.1.smithi159.stdout:9/654: chown d4/d19/d42/daf/dd7/fe0 120829540 1 2022-02-02T18:23:05.321 INFO:tasks.workunit.client.1.smithi159.stdout:1/625: unlink df/d14/c53 0 2022-02-02T18:23:05.321 INFO:tasks.workunit.client.1.smithi159.stdout:7/847: symlink d3/d2a/l11d 0 2022-02-02T18:23:05.321 INFO:tasks.workunit.client.1.smithi159.stdout:8/594: mkdir d1/dd/d31/dcb 0 2022-02-02T18:23:05.322 INFO:tasks.workunit.client.1.smithi159.stdout:1/626: link df/d14/l2a df/d21/d23/d49/d82/d87/le2 0 2022-02-02T18:23:05.322 INFO:tasks.workunit.client.1.smithi159.stdout:7/848: dread d3/d6/f40 [0,4194304] 0 2022-02-02T18:23:05.322 INFO:tasks.workunit.client.1.smithi159.stdout:1/627: rmdir df/d14/d68/dad 39 2022-02-02T18:23:05.322 INFO:tasks.workunit.client.1.smithi159.stdout:1/628: creat df/d21/d23/d49/d69/d81/d9b/fe3 x:0 0 0 2022-02-02T18:23:05.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/849: rename d3/d2a/d4a/d7d/fdd to d3/d27/d29/d68/f11e 0 2022-02-02T18:23:05.323 INFO:tasks.workunit.client.1.smithi159.stdout:3/624: dread fc [0,4194304] 0 2022-02-02T18:23:05.323 INFO:tasks.workunit.client.1.smithi159.stdout:4/604: dwrite d0/d8/d41/db7/d33/fbf [0,4194304] 0 2022-02-02T18:23:05.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/850: write d3/d27/d29/d5e/d80/daa/fff [3345246,81243] 0 2022-02-02T18:23:05.323 INFO:tasks.workunit.client.1.smithi159.stdout:7/851: truncate d3/d27/d29/d6b/dc5/f93 1346627 0 2022-02-02T18:23:05.324 INFO:tasks.workunit.client.1.smithi159.stdout:3/625: unlink dd/d66/d92/l71 0 2022-02-02T18:23:05.324 INFO:tasks.workunit.client.1.smithi159.stdout:3/626: chown dd/d66/d92/d51/c73 0 1 2022-02-02T18:23:05.324 INFO:tasks.workunit.client.1.smithi159.stdout:9/655: dwrite d4/d19/d42/daf/dd7/fe0 [0,4194304] 0 2022-02-02T18:23:05.324 INFO:tasks.workunit.client.1.smithi159.stdout:7/852: truncate d3/d2a/f55 666498 0 2022-02-02T18:23:05.325 INFO:tasks.workunit.client.1.smithi159.stdout:7/853: fsync d3/d5/d56/d2f/d5b/f97 0 2022-02-02T18:23:05.325 INFO:tasks.workunit.client.1.smithi159.stdout:4/605: write d0/f25 [6399458,60326] 0 2022-02-02T18:23:05.325 INFO:tasks.workunit.client.1.smithi159.stdout:9/656: rename d4/d19/d1c/d21/da8/db9/ddd to d4/d19/d1c/de1 0 2022-02-02T18:23:05.325 INFO:tasks.workunit.client.1.smithi159.stdout:9/657: chown d4/d2a/d87/fcb 487906 1 2022-02-02T18:23:05.325 INFO:tasks.workunit.client.1.smithi159.stdout:9/658: creat d4/d19/d6f/d74/db1/dc7/dc8/fe2 x:0 0 0 2022-02-02T18:23:05.326 INFO:tasks.workunit.client.1.smithi159.stdout:7/854: symlink d3/d2a/d4a/d7d/l11f 0 2022-02-02T18:23:05.326 INFO:tasks.workunit.client.1.smithi159.stdout:4/606: dread d0/d8/d30/d5d/fb5 [0,4194304] 0 2022-02-02T18:23:05.326 INFO:tasks.workunit.client.1.smithi159.stdout:9/659: dread d4/d19/d1c/d21/d22/d55/f6c [0,4194304] 0 2022-02-02T18:23:05.326 INFO:tasks.workunit.client.1.smithi159.stdout:9/660: read - d4/d2a/d87/da1/fa6 zero size 2022-02-02T18:23:05.327 INFO:tasks.workunit.client.1.smithi159.stdout:7/855: dread d3/d27/d29/f114 [0,4194304] 0 2022-02-02T18:23:05.327 INFO:tasks.workunit.client.1.smithi159.stdout:7/856: mknod d3/d107/c120 0 2022-02-02T18:23:05.327 INFO:tasks.workunit.client.1.smithi159.stdout:7/857: mknod d3/d2a/d4a/da1/c121 0 2022-02-02T18:23:05.327 INFO:tasks.workunit.client.1.smithi159.stdout:1/629: dwrite df/d14/d16/d4a/fa6 [0,4194304] 0 2022-02-02T18:23:05.327 INFO:tasks.workunit.client.1.smithi159.stdout:7/858: dread d3/d27/d29/d6b/da7/f10b [0,4194304] 0 2022-02-02T18:23:05.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/595: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:23:05.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/627: dwrite dd/d19/d38/d3f/d80/d8a/fa6 [0,4194304] 0 2022-02-02T18:23:05.328 INFO:tasks.workunit.client.1.smithi159.stdout:1/630: mknod df/d14/dbf/ce4 0 2022-02-02T18:23:05.328 INFO:tasks.workunit.client.1.smithi159.stdout:1/631: creat df/d14/d16/da8/fe5 x:0 0 0 2022-02-02T18:23:05.329 INFO:tasks.workunit.client.1.smithi159.stdout:1/632: creat df/d14/dbf/fe6 x:0 0 0 2022-02-02T18:23:05.329 INFO:tasks.workunit.client.1.smithi159.stdout:1/633: dread - df/d21/d23/fcd zero size 2022-02-02T18:23:05.329 INFO:tasks.workunit.client.1.smithi159.stdout:1/634: write df/d14/d68/dad/fda [647567,43063] 0 2022-02-02T18:23:05.329 INFO:tasks.workunit.client.1.smithi159.stdout:8/596: symlink d1/dd/d31/dcb/lcc 0 2022-02-02T18:23:05.330 INFO:tasks.workunit.client.1.smithi159.stdout:8/597: fdatasync d1/dd/d2c/f42 0 2022-02-02T18:23:05.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:04 smithi159 conmon[35668]: cluster 2022-02-02T18:23:04.544205+0000 mgr.smithi096.shfutl (mgr.14628) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 148 op/s 2022-02-02T18:23:05.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:04 smithi096 conmon[32067]: cluster 2022-02-02T18:23:04.544205+0000 2022-02-02T18:23:05.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:04 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14628) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 148 op/s 2022-02-02T18:23:05.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/598: write d1/fae [1702563,121805] 0 2022-02-02T18:23:05.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/599: write d1/dd/d1a/d53/f74 [3231788,56714] 0 2022-02-02T18:23:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:1/635: mkdir df/d21/d23/de7 0 2022-02-02T18:23:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:1/636: unlink df/fe1 0 2022-02-02T18:23:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:1/637: truncate df/d21/f54 985675 0 2022-02-02T18:23:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:1/638: dread df/d14/d16/d4b/da0/fa2 [0,4194304] 0 2022-02-02T18:23:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/859: dread d3/d5/d56/d2f/fe0 [0,4194304] 0 2022-02-02T18:23:05.337 INFO:tasks.workunit.client.1.smithi159.stdout:7/860: chown d3/ff4 549914292 1 2022-02-02T18:23:05.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/600: creat d1/dad/d95/fcd x:0 0 0 2022-02-02T18:23:05.337 INFO:tasks.workunit.client.1.smithi159.stdout:9/661: dwrite d4/d19/d1c/d21/d95/f6d [0,4194304] 0 2022-02-02T18:23:05.337 INFO:tasks.workunit.client.1.smithi159.stdout:9/662: rmdir d4/d19/d1c/d21 39 2022-02-02T18:23:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:7/861: rename d3/d2a/d2c/d7a to d3/d6/d122 0 2022-02-02T18:23:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:3/628: dwrite dd/d66/fb7 [0,4194304] 0 2022-02-02T18:23:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:4/607: dwrite d0/d8/d30/f37 [0,4194304] 0 2022-02-02T18:23:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:8/601: rmdir d1/dd/d1a/d53 39 2022-02-02T18:23:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:5/640: sync 2022-02-02T18:23:05.339 INFO:tasks.workunit.client.1.smithi159.stdout:6/631: sync 2022-02-02T18:23:05.339 INFO:tasks.workunit.client.1.smithi159.stdout:2/756: sync 2022-02-02T18:23:05.339 INFO:tasks.workunit.client.1.smithi159.stdout:7/862: creat d3/d5/d56/d2f/d5b/f123 x:0 0 0 2022-02-02T18:23:05.339 INFO:tasks.workunit.client.1.smithi159.stdout:2/757: chown da/d1c/d76/ca6 803670 1 2022-02-02T18:23:05.340 INFO:tasks.workunit.client.1.smithi159.stdout:9/663: mknod d4/d19/d1c/d21/d56/ce3 0 2022-02-02T18:23:05.340 INFO:tasks.workunit.client.1.smithi159.stdout:9/664: chown d4/d19/d1c/d1f/f72 6 1 2022-02-02T18:23:05.340 INFO:tasks.workunit.client.1.smithi159.stdout:7/863: mknod d3/d27/d29/d5e/d80/dee/c124 0 2022-02-02T18:23:05.340 INFO:tasks.workunit.client.1.smithi159.stdout:7/864: symlink d3/d27/d29/d6b/dc5/dfb/l125 0 2022-02-02T18:23:05.340 INFO:tasks.workunit.client.1.smithi159.stdout:9/665: getdents d4/d2a/d87 0 2022-02-02T18:23:05.341 INFO:tasks.workunit.client.1.smithi159.stdout:1/639: dwrite df/d14/f91 [0,4194304] 0 2022-02-02T18:23:05.341 INFO:tasks.workunit.client.1.smithi159.stdout:7/865: creat d3/d2a/dcc/f126 x:0 0 0 2022-02-02T18:23:05.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/758: write da/d1c/d47/d6b/f51 [6456558,127635] 0 2022-02-02T18:23:05.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/666: creat d4/d19/d1c/d1f/d90/fe4 x:0 0 0 2022-02-02T18:23:05.342 INFO:tasks.workunit.client.1.smithi159.stdout:1/640: rename df/d14/dbf/fe6 to df/d21/d23/d49/d82/d87/fe8 0 2022-02-02T18:23:05.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/759: dread da/f53 [0,4194304] 0 2022-02-02T18:23:05.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/760: write da/d1c/d25/d73/ff0 [280149,28562] 0 2022-02-02T18:23:05.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/761: chown da/d1c/d42/d45/c4d 769437 1 2022-02-02T18:23:05.342 INFO:tasks.workunit.client.1.smithi159.stdout:9/667: link d4/d19/f3e d4/fe5 0 2022-02-02T18:23:05.343 INFO:tasks.workunit.client.1.smithi159.stdout:2/762: read da/d1c/d47/d54/f9b [1992017,87681] 0 2022-02-02T18:23:05.343 INFO:tasks.workunit.client.1.smithi159.stdout:2/763: chown da/d1c/d47/dc7 6873 1 2022-02-02T18:23:05.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/608: dwrite d0/d8/f20 [0,4194304] 0 2022-02-02T18:23:05.343 INFO:tasks.workunit.client.1.smithi159.stdout:7/866: symlink d3/d27/d29/d6b/dc5/l127 0 2022-02-02T18:23:05.344 INFO:tasks.workunit.client.1.smithi159.stdout:0/658: sync 2022-02-02T18:23:05.344 INFO:tasks.workunit.client.1.smithi159.stdout:0/659: truncate d1/d11/d8d/fc9 34062 0 2022-02-02T18:23:05.344 INFO:tasks.workunit.client.1.smithi159.stdout:0/660: readlink d1/d11/d38/d42/d47/db0/le2 0 2022-02-02T18:23:05.344 INFO:tasks.workunit.client.1.smithi159.stdout:9/668: read d4/d19/d1c/d1f/f3c [1011637,75241] 0 2022-02-02T18:23:05.344 INFO:tasks.workunit.client.1.smithi159.stdout:2/764: rename da/d1c/d47/d6b/cc3 to da/d1c/d47/d6b/d5a/c108 0 2022-02-02T18:23:05.345 INFO:tasks.workunit.client.1.smithi159.stdout:0/661: link d1/d11/d38/d42/d47/l5f d1/d11/d38/le4 0 2022-02-02T18:23:05.345 INFO:tasks.workunit.client.1.smithi159.stdout:0/662: write d1/d11/f35 [5535176,38966] 0 2022-02-02T18:23:05.345 INFO:tasks.workunit.client.1.smithi159.stdout:0/663: symlink d1/d11/d38/d7c/le5 0 2022-02-02T18:23:05.346 INFO:tasks.workunit.client.1.smithi159.stdout:6/632: dwrite df/d35/d7b/db4/d84/d9d/fbe [0,4194304] 0 2022-02-02T18:23:05.346 INFO:tasks.workunit.client.1.smithi159.stdout:6/633: dread df/d35/d2a/d2f/f99 [4194304,4194304] 0 2022-02-02T18:23:05.347 INFO:tasks.workunit.client.1.smithi159.stdout:0/664: write d1/d19/d3d/f40 [191062,57282] 0 2022-02-02T18:23:05.347 INFO:tasks.workunit.client.1.smithi159.stdout:5/641: dwrite d9/d24/d4a/d91/fac [0,4194304] 0 2022-02-02T18:23:05.347 INFO:tasks.workunit.client.1.smithi159.stdout:0/665: dread d1/d11/d38/d94/fc4 [0,4194304] 0 2022-02-02T18:23:05.347 INFO:tasks.workunit.client.1.smithi159.stdout:0/666: readlink d1/d11/d38/d42/daf/d34/da0/lc2 0 2022-02-02T18:23:05.347 INFO:tasks.workunit.client.1.smithi159.stdout:3/629: write dd/f18 [4874144,119317] 0 2022-02-02T18:23:05.348 INFO:tasks.workunit.client.1.smithi159.stdout:0/667: mkdir d1/d11/d38/d94/dd7/de6 0 2022-02-02T18:23:05.348 INFO:tasks.workunit.client.1.smithi159.stdout:3/630: mknod dd/d66/d69/ccc 0 2022-02-02T18:23:05.349 INFO:tasks.workunit.client.1.smithi159.stdout:5/642: mknod d9/d24/d37/d23/d68/cc6 0 2022-02-02T18:23:05.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/668: getdents d1/dd 0 2022-02-02T18:23:05.353 INFO:tasks.workunit.client.1.smithi159.stdout:6/634: unlink df/d35/d2a/d3f/d42/d47/d59/c76 0 2022-02-02T18:23:05.353 INFO:tasks.workunit.client.1.smithi159.stdout:3/631: getdents dd/d20 0 2022-02-02T18:23:05.353 INFO:tasks.workunit.client.1.smithi159.stdout:6/635: write df/d35/d2a/d3f/d65/fba [267815,88103] 0 2022-02-02T18:23:05.354 INFO:tasks.workunit.client.1.smithi159.stdout:6/636: stat df/d35/d7b/db4/d84/l9a 0 2022-02-02T18:23:05.354 INFO:tasks.workunit.client.1.smithi159.stdout:3/632: creat dd/d66/d69/d77/fcd x:0 0 0 2022-02-02T18:23:05.354 INFO:tasks.workunit.client.1.smithi159.stdout:5/643: link d9/l67 d9/d24/lc7 0 2022-02-02T18:23:05.355 INFO:tasks.workunit.client.1.smithi159.stdout:0/669: write d1/dd/f54 [1835405,53588] 0 2022-02-02T18:23:05.356 INFO:tasks.workunit.client.1.smithi159.stdout:8/602: dwrite d1/d26/fbb [0,4194304] 0 2022-02-02T18:23:05.356 INFO:tasks.workunit.client.1.smithi159.stdout:8/603: dread - d1/d26/f9c zero size 2022-02-02T18:23:05.356 INFO:tasks.workunit.client.1.smithi159.stdout:8/604: chown d1/d26 22822 1 2022-02-02T18:23:05.356 INFO:tasks.workunit.client.1.smithi159.stdout:8/605: write d1/dd/faf [640772,129696] 0 2022-02-02T18:23:05.357 INFO:tasks.workunit.client.1.smithi159.stdout:6/637: creat df/d35/d2a/d3f/d42/d47/d59/d97/fd1 x:0 0 0 2022-02-02T18:23:05.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/669: dread d4/d19/f3e [0,4194304] 0 2022-02-02T18:23:05.358 INFO:tasks.workunit.client.1.smithi159.stdout:9/670: mkdir d4/d19/d1c/d21/d41/d9a/de6 0 2022-02-02T18:23:05.361 INFO:tasks.workunit.client.1.smithi159.stdout:9/671: mkdir d4/d19/de7 0 2022-02-02T18:23:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:0/670: creat d1/dd/d4b/ddd/fe7 x:0 0 0 2022-02-02T18:23:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/867: dwrite d3/d2a/f47 [0,4194304] 0 2022-02-02T18:23:05.363 INFO:tasks.workunit.client.1.smithi159.stdout:1/641: dwrite df/d21/d23/d49/da1/fd7 [0,4194304] 0 2022-02-02T18:23:05.363 INFO:tasks.workunit.client.1.smithi159.stdout:5/644: mknod d9/d2e/cc8 0 2022-02-02T18:23:05.363 INFO:tasks.workunit.client.1.smithi159.stdout:5/645: creat d9/d2e/db1/fc9 x:0 0 0 2022-02-02T18:23:05.364 INFO:tasks.workunit.client.1.smithi159.stdout:8/606: truncate d1/dc/f41 1638583 0 2022-02-02T18:23:05.365 INFO:tasks.workunit.client.1.smithi159.stdout:8/607: creat d1/dd/fce x:0 0 0 2022-02-02T18:23:05.365 INFO:tasks.workunit.client.1.smithi159.stdout:9/672: mknod d4/d19/d6f/d74/ce8 0 2022-02-02T18:23:05.366 INFO:tasks.workunit.client.1.smithi159.stdout:7/868: mkdir d3/d107/d128 0 2022-02-02T18:23:05.368 INFO:tasks.workunit.client.1.smithi159.stdout:1/642: creat df/d21/d23/d49/d69/d81/fe9 x:0 0 0 2022-02-02T18:23:05.369 INFO:tasks.workunit.client.1.smithi159.stdout:3/633: dread dd/d66/d92/f91 [0,4194304] 0 2022-02-02T18:23:05.369 INFO:tasks.workunit.client.1.smithi159.stdout:3/634: read - dd/d66/d69/d77/fc1 zero size 2022-02-02T18:23:05.371 INFO:tasks.workunit.client.1.smithi159.stdout:8/608: chown d1/fa 34836 1 2022-02-02T18:23:05.372 INFO:tasks.workunit.client.1.smithi159.stdout:0/671: rename d1/f8 to d1/dd/d4b/fe8 0 2022-02-02T18:23:05.374 INFO:tasks.workunit.client.1.smithi159.stdout:5/646: dread d9/d24/d37/f18 [4194304,4194304] 0 2022-02-02T18:23:05.375 INFO:tasks.workunit.client.1.smithi159.stdout:8/609: creat d1/d26/d48/d49/fcf x:0 0 0 2022-02-02T18:23:05.375 INFO:tasks.workunit.client.1.smithi159.stdout:8/610: write d1/dd/d1a/d53/f72 [1009404,29094] 0 2022-02-02T18:23:05.376 INFO:tasks.workunit.client.1.smithi159.stdout:4/609: dwrite d0/d8/d24/d4f/f52 [0,4194304] 0 2022-02-02T18:23:05.377 INFO:tasks.workunit.client.1.smithi159.stdout:9/673: rename d4/d19/d6f/d74/ce8 to d4/d19/d1c/de1/ce9 0 2022-02-02T18:23:05.377 INFO:tasks.workunit.client.1.smithi159.stdout:5/647: rmdir d9/d24/d38 39 2022-02-02T18:23:05.378 INFO:tasks.workunit.client.1.smithi159.stdout:5/648: fsync d9/d2e/f2a 0 2022-02-02T18:23:05.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/674: fdatasync d4/d19/f1a 0 2022-02-02T18:23:05.381 INFO:tasks.workunit.client.1.smithi159.stdout:9/675: rmdir d4/d19/d1c/d21/d95 39 2022-02-02T18:23:05.382 INFO:tasks.workunit.client.1.smithi159.stdout:9/676: stat d4/d19/d1c/d21/d22/cbb 0 2022-02-02T18:23:05.383 INFO:tasks.workunit.client.1.smithi159.stdout:4/610: dread d0/d8/d15/f2a [0,4194304] 0 2022-02-02T18:23:05.387 INFO:tasks.workunit.client.1.smithi159.stdout:6/638: dwrite df/d35/d7b/db4/d84/fac [0,4194304] 0 2022-02-02T18:23:05.387 INFO:tasks.workunit.client.1.smithi159.stdout:8/611: dread d1/dd/d1a/f39 [0,4194304] 0 2022-02-02T18:23:05.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/649: dread d9/d24/d37/d23/d68/f7e [0,4194304] 0 2022-02-02T18:23:05.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/650: write d9/d24/d21/f9c [504023,76119] 0 2022-02-02T18:23:05.401 INFO:tasks.workunit.client.1.smithi159.stdout:5/651: read - d9/d24/d37/d23/dba/fbe zero size 2022-02-02T18:23:05.402 INFO:tasks.workunit.client.1.smithi159.stdout:1/643: dread df/d14/d16/d4a/f44 [0,4194304] 0 2022-02-02T18:23:05.402 INFO:tasks.workunit.client.1.smithi159.stdout:1/644: dread - df/d21/d23/d49/d82/fc6 zero size 2022-02-02T18:23:05.403 INFO:tasks.workunit.client.1.smithi159.stdout:1/645: read df/d21/d23/d49/d69/f96 [818382,67304] 0 2022-02-02T18:23:05.405 INFO:tasks.workunit.client.1.smithi159.stdout:8/612: creat d1/db7/d75/d9d/fd0 x:0 0 0 2022-02-02T18:23:05.406 INFO:tasks.workunit.client.1.smithi159.stdout:4/611: write d0/f5 [3573113,60688] 0 2022-02-02T18:23:05.409 INFO:tasks.workunit.client.1.smithi159.stdout:8/613: write d1/dd/d31/f3f [5371013,50280] 0 2022-02-02T18:23:05.416 INFO:tasks.workunit.client.1.smithi159.stdout:4/612: mkdir d0/d8/d41/db7/da3/dcd 0 2022-02-02T18:23:05.416 INFO:tasks.workunit.client.1.smithi159.stdout:1/646: read f7 [1100693,104079] 0 2022-02-02T18:23:05.419 INFO:tasks.workunit.client.1.smithi159.stdout:0/672: dwrite d1/d11/d38/d94/fc4 [0,4194304] 0 2022-02-02T18:23:05.422 INFO:tasks.workunit.client.1.smithi159.stdout:6/639: dwrite fd [4194304,4194304] 0 2022-02-02T18:23:05.422 INFO:tasks.workunit.client.1.smithi159.stdout:6/640: fsync df/d35/d2a/f7a 0 2022-02-02T18:23:05.423 INFO:tasks.workunit.client.1.smithi159.stdout:3/635: dread dd/d66/d69/f79 [0,4194304] 0 2022-02-02T18:23:05.424 INFO:tasks.workunit.client.1.smithi159.stdout:7/869: dwrite d3/d5/d56/d57/f46 [0,4194304] 0 2022-02-02T18:23:05.424 INFO:tasks.workunit.client.1.smithi159.stdout:7/870: chown d3/d5/d56/d2f/d5b/fd2 35878261 1 2022-02-02T18:23:05.426 INFO:tasks.workunit.client.1.smithi159.stdout:1/647: write df/d14/d16/d4a/fa6 [88369,2706] 0 2022-02-02T18:23:05.427 INFO:tasks.workunit.client.1.smithi159.stdout:1/648: readlink df/d14/d68/la7 0 2022-02-02T18:23:05.428 INFO:tasks.workunit.client.1.smithi159.stdout:0/673: creat d1/d11/d38/d7e/fe9 x:0 0 0 2022-02-02T18:23:05.429 INFO:tasks.workunit.client.1.smithi159.stdout:1/649: creat df/d14/d16/d4b/d5b/fea x:0 0 0 2022-02-02T18:23:05.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/650: dread - df/d21/d23/d49/d82/fc6 zero size 2022-02-02T18:23:05.434 INFO:tasks.workunit.client.1.smithi159.stdout:1/651: getdents df/d21 0 2022-02-02T18:23:05.435 INFO:tasks.workunit.client.1.smithi159.stdout:0/674: link d1/d19/l99 d1/d11/d38/d42/d56/lea 0 2022-02-02T18:23:05.435 INFO:tasks.workunit.client.1.smithi159.stdout:7/871: rename d3/f2d to d3/d27/d29/d5e/d80/daa/f129 0 2022-02-02T18:23:05.436 INFO:tasks.workunit.client.1.smithi159.stdout:1/652: mkdir df/d21/deb 0 2022-02-02T18:23:05.436 INFO:tasks.workunit.client.1.smithi159.stdout:2/765: dwrite da/d1c/d25/d73/dab/db5/fcf [0,4194304] 0 2022-02-02T18:23:05.438 INFO:tasks.workunit.client.1.smithi159.stdout:0/675: stat d1/d11/d38/c6e 0 2022-02-02T18:23:05.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/872: mkdir d3/d2a/d12a 0 2022-02-02T18:23:05.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/873: fsync d3/d5/f20 0 2022-02-02T18:23:05.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/874: fsync d3/d5/d56/d57/f24 0 2022-02-02T18:23:05.439 INFO:tasks.workunit.client.1.smithi159.stdout:7/875: creat d3/d2a/dcc/d8b/d8c/d99/f12b x:0 0 0 2022-02-02T18:23:05.440 INFO:tasks.workunit.client.1.smithi159.stdout:1/653: creat df/d14/d16/d4b/dcc/fec x:0 0 0 2022-02-02T18:23:05.444 INFO:tasks.workunit.client.1.smithi159.stdout:3/636: dread dd/d66/d92/d51/f7e [0,4194304] 0 2022-02-02T18:23:05.444 INFO:tasks.workunit.client.1.smithi159.stdout:3/637: chown dd/d66/da1 105303 1 2022-02-02T18:23:05.447 INFO:tasks.workunit.client.1.smithi159.stdout:3/638: creat dd/d66/d92/dbe/fce x:0 0 0 2022-02-02T18:23:05.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/654: chown df/d21/d23/c48 132018 1 2022-02-02T18:23:05.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/676: mknod d1/d11/d38/d42/d56/ceb 0 2022-02-02T18:23:05.449 INFO:tasks.workunit.client.1.smithi159.stdout:4/613: dwrite d0/d8/d41/f4d [0,4194304] 0 2022-02-02T18:23:05.450 INFO:tasks.workunit.client.1.smithi159.stdout:4/614: stat d0/d8/fb3 0 2022-02-02T18:23:05.450 INFO:tasks.workunit.client.1.smithi159.stdout:3/639: truncate dd/d19/f1e 87390 0 2022-02-02T18:23:05.454 INFO:tasks.workunit.client.1.smithi159.stdout:0/677: symlink d1/dd/d4b/ddd/lec 0 2022-02-02T18:23:05.457 INFO:tasks.workunit.client.1.smithi159.stdout:6/641: dread df/d35/d7b/db4/d84/fac [0,4194304] 0 2022-02-02T18:23:05.458 INFO:tasks.workunit.client.1.smithi159.stdout:6/642: dread - df/d35/d2a/d3f/d42/fc2 zero size 2022-02-02T18:23:05.458 INFO:tasks.workunit.client.1.smithi159.stdout:8/614: dwrite d1/dd/d1a/f9a [0,4194304] 0 2022-02-02T18:23:05.460 INFO:tasks.workunit.client.1.smithi159.stdout:1/655: link df/c1b df/d14/d68/ced 0 2022-02-02T18:23:05.462 INFO:tasks.workunit.client.1.smithi159.stdout:1/656: write df/d14/d16/d6d/f90 [3966190,97183] 0 2022-02-02T18:23:05.463 INFO:tasks.workunit.client.1.smithi159.stdout:3/640: creat dd/d19/d38/d3f/d52/fcf x:0 0 0 2022-02-02T18:23:05.463 INFO:tasks.workunit.client.1.smithi159.stdout:4/615: mknod d0/d8/d41/db7/d36/d4b/cce 0 2022-02-02T18:23:05.463 INFO:tasks.workunit.client.1.smithi159.stdout:8/615: write d1/dd/d31/f3f [3570899,70564] 0 2022-02-02T18:23:05.464 INFO:tasks.workunit.client.1.smithi159.stdout:6/643: getdents df/d35/d2a/d3f/d65 0 2022-02-02T18:23:05.467 INFO:tasks.workunit.client.1.smithi159.stdout:0/678: dread d1/d11/d38/d42/d56/f97 [0,4194304] 0 2022-02-02T18:23:05.469 INFO:tasks.workunit.client.1.smithi159.stdout:1/657: rename df/d21/d23/d49/f4e to df/d21/d23/d49/d69/d6c/fee 0 2022-02-02T18:23:05.470 INFO:tasks.workunit.client.1.smithi159.stdout:4/616: unlink d0/fa5 0 2022-02-02T18:23:05.476 INFO:tasks.workunit.client.1.smithi159.stdout:7/876: dwrite d3/d27/d29/d6b/da7/ffd [0,4194304] 0 2022-02-02T18:23:05.477 INFO:tasks.workunit.client.1.smithi159.stdout:6/644: mkdir df/d35/d2a/d2f/dd2 0 2022-02-02T18:23:05.478 INFO:tasks.workunit.client.1.smithi159.stdout:1/658: symlink df/lef 0 2022-02-02T18:23:05.478 INFO:tasks.workunit.client.1.smithi159.stdout:3/641: symlink dd/d19/d35/ld0 0 2022-02-02T18:23:05.478 INFO:tasks.workunit.client.1.smithi159.stdout:8/616: dread d1/dd/f29 [0,4194304] 0 2022-02-02T18:23:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:0/679: dread d1/d11/d38/d42/daf/fbc [0,4194304] 0 2022-02-02T18:23:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:0/680: readlink d1/d11/d38/d7c/l9e 0 2022-02-02T18:23:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:0/681: fsync d1/d19/d3d/f76 0 2022-02-02T18:23:05.482 INFO:tasks.workunit.client.1.smithi159.stdout:5/652: dwrite d9/f39 [0,4194304] 0 2022-02-02T18:23:05.482 INFO:tasks.workunit.client.1.smithi159.stdout:1/659: mkdir df/d21/d23/d49/da1/dac/df0 0 2022-02-02T18:23:05.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/617: read d1/dd/d1a/d53/f72 [515494,24740] 0 2022-02-02T18:23:05.484 INFO:tasks.workunit.client.1.smithi159.stdout:0/682: rename d1/d11/d38/d42/daf/d34/da0 to d1/d11/d38/d42/db5/ded 0 2022-02-02T18:23:05.485 INFO:tasks.workunit.client.1.smithi159.stdout:0/683: readlink d1/d11/d38/d42/d56/lcf 0 2022-02-02T18:23:05.485 INFO:tasks.workunit.client.1.smithi159.stdout:6/645: rename df/d35/d7b/db4/d84/d9d/fb8 to df/d35/d7b/db4/d84/d9d/fd3 0 2022-02-02T18:23:05.486 INFO:tasks.workunit.client.1.smithi159.stdout:8/618: mknod d1/dad/d95/cd1 0 2022-02-02T18:23:05.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/646: read df/d35/d2a/d3f/fab [2857267,29823] 0 2022-02-02T18:23:05.488 INFO:tasks.workunit.client.1.smithi159.stdout:5/653: dread d9/f7a [0,4194304] 0 2022-02-02T18:23:05.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/684: link d1/dd/f1a d1/d11/d38/d42/fee 0 2022-02-02T18:23:05.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/685: chown d1/d11/d38/d7e/f90 3 1 2022-02-02T18:23:05.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/686: write d1/dd/fa5 [898747,92585] 0 2022-02-02T18:23:05.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/687: chown d1/f2c 0 1 2022-02-02T18:23:05.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/688: chown d1/dd/f54 35291 1 2022-02-02T18:23:05.490 INFO:tasks.workunit.client.1.smithi159.stdout:0/689: chown d1/d11/d38/d42/db5 3855835 1 2022-02-02T18:23:05.490 INFO:tasks.workunit.client.1.smithi159.stdout:8/619: link d1/dd/d2c/d67/ca1 d1/d26/d48/d49/dbe/dc0/cd2 0 2022-02-02T18:23:05.491 INFO:tasks.workunit.client.1.smithi159.stdout:0/690: write d1/dd/d4b/d7d/fa1 [553560,105153] 0 2022-02-02T18:23:05.494 INFO:tasks.workunit.client.1.smithi159.stdout:1/660: symlink df/d21/d23/d49/da1/lf1 0 2022-02-02T18:23:05.494 INFO:tasks.workunit.client.1.smithi159.stdout:1/661: write df/d21/d23/d49/d69/d81/d9b/fe3 [776166,30660] 0 2022-02-02T18:23:05.495 INFO:tasks.workunit.client.1.smithi159.stdout:6/647: truncate df/d35/f27 1870206 0 2022-02-02T18:23:05.495 INFO:tasks.workunit.client.1.smithi159.stdout:6/648: dread - df/d35/d2a/d3f/d42/d47/fb2 zero size 2022-02-02T18:23:05.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/620: symlink d1/dd/d1a/d53/ld3 0 2022-02-02T18:23:05.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/621: write d1/dd/d1a/f39 [4457964,5687] 0 2022-02-02T18:23:05.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/622: dread - d1/dad/d95/fcd zero size 2022-02-02T18:23:05.496 INFO:tasks.workunit.client.1.smithi159.stdout:1/662: symlink df/d14/d68/lf2 0 2022-02-02T18:23:05.503 INFO:tasks.workunit.client.1.smithi159.stdout:6/649: mkdir df/d35/d2a/d3f/d65/dd4 0 2022-02-02T18:23:05.503 INFO:tasks.workunit.client.1.smithi159.stdout:1/663: mkdir df/d14/d16/d4a/df3 0 2022-02-02T18:23:05.508 INFO:tasks.workunit.client.1.smithi159.stdout:6/650: mknod df/d35/d2a/d3f/d42/d47/d59/d66/cd5 0 2022-02-02T18:23:05.508 INFO:tasks.workunit.client.1.smithi159.stdout:6/651: stat df/d35/d2a/d3f/d55/d6a/d6e/c8b 0 2022-02-02T18:23:05.514 INFO:tasks.workunit.client.1.smithi159.stdout:4/617: dwrite d0/d8/d41/f5e [0,4194304] 0 2022-02-02T18:23:05.518 INFO:tasks.workunit.client.1.smithi159.stdout:1/664: dread df/d21/d23/d49/da1/dac/fd8 [0,4194304] 0 2022-02-02T18:23:05.519 INFO:tasks.workunit.client.1.smithi159.stdout:6/652: write df/d35/d2a/d3f/d42/d47/f86 [3529527,115548] 0 2022-02-02T18:23:05.521 INFO:tasks.workunit.client.1.smithi159.stdout:8/623: dwrite d1/dd/f29 [0,4194304] 0 2022-02-02T18:23:05.521 INFO:tasks.workunit.client.1.smithi159.stdout:8/624: readlink d1/db7/l4e 0 2022-02-02T18:23:05.522 INFO:tasks.workunit.client.1.smithi159.stdout:8/625: truncate d1/dd/f92 522790 0 2022-02-02T18:23:05.522 INFO:tasks.workunit.client.1.smithi159.stdout:7/877: dwrite d3/d27/d29/f61 [4194304,4194304] 0 2022-02-02T18:23:05.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/665: truncate df/f8a 3806922 0 2022-02-02T18:23:05.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/618: mknod d0/d66/ccf 0 2022-02-02T18:23:05.526 INFO:tasks.workunit.client.1.smithi159.stdout:7/878: creat d3/d2a/dcc/f12c x:0 0 0 2022-02-02T18:23:05.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/626: rename d1/dd/faf to d1/d26/d48/d98/fd4 0 2022-02-02T18:23:05.528 INFO:tasks.workunit.client.1.smithi159.stdout:5/654: dwrite d9/f42 [4194304,4194304] 0 2022-02-02T18:23:05.529 INFO:tasks.workunit.client.1.smithi159.stdout:7/879: creat d3/d6/d122/f12d x:0 0 0 2022-02-02T18:23:05.530 INFO:tasks.workunit.client.1.smithi159.stdout:7/880: fdatasync d3/d2a/f47 0 2022-02-02T18:23:05.530 INFO:tasks.workunit.client.1.smithi159.stdout:6/653: mknod df/d35/d2a/d3f/d42/d47/d59/d66/cd6 0 2022-02-02T18:23:05.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/619: dread d0/f25 [4194304,4194304] 0 2022-02-02T18:23:05.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/620: dread - d0/d8/d15/d61/fa9 zero size 2022-02-02T18:23:05.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/627: dread d1/dd/d1a/d53/f54 [0,4194304] 0 2022-02-02T18:23:05.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/628: fdatasync d1/dd/fce 0 2022-02-02T18:23:05.541 INFO:tasks.workunit.client.1.smithi159.stdout:8/629: creat d1/dad/dc9/fd5 x:0 0 0 2022-02-02T18:23:05.542 INFO:tasks.workunit.client.1.smithi159.stdout:5/655: dread d9/d24/d4a/d52/f74 [0,4194304] 0 2022-02-02T18:23:05.546 INFO:tasks.workunit.client.1.smithi159.stdout:0/691: dwrite d1/dd/fa5 [0,4194304] 0 2022-02-02T18:23:05.547 INFO:tasks.workunit.client.1.smithi159.stdout:6/654: getdents df/d35/d2a/d3f/d55/d6a 0 2022-02-02T18:23:05.549 INFO:tasks.workunit.client.1.smithi159.stdout:7/881: mknod d3/d27/d29/d6b/c12e 0 2022-02-02T18:23:05.550 INFO:tasks.workunit.client.1.smithi159.stdout:6/655: rmdir df 39 2022-02-02T18:23:05.551 INFO:tasks.workunit.client.1.smithi159.stdout:7/882: rmdir d3/d107 39 2022-02-02T18:23:05.552 INFO:tasks.workunit.client.1.smithi159.stdout:6/656: truncate df/d35/d2a/d3f/d55/d6a/f9b 3959507 0 2022-02-02T18:23:05.552 INFO:tasks.workunit.client.1.smithi159.stdout:4/621: dread d0/d8/d41/db7/d33/d47/f4e [0,4194304] 0 2022-02-02T18:23:05.553 INFO:tasks.workunit.client.1.smithi159.stdout:6/657: fdatasync df/d35/d2a/d2f/d80/d61/f94 0 2022-02-02T18:23:05.553 INFO:tasks.workunit.client.1.smithi159.stdout:6/658: read - df/d35/d2a/d3f/d42/d47/fb2 zero size 2022-02-02T18:23:05.554 INFO:tasks.workunit.client.1.smithi159.stdout:5/656: symlink d9/d24/d37/d23/dba/lca 0 2022-02-02T18:23:05.554 INFO:tasks.workunit.client.1.smithi159.stdout:8/630: creat d1/db7/d75/dc3/fd6 x:0 0 0 2022-02-02T18:23:05.555 INFO:tasks.workunit.client.1.smithi159.stdout:7/883: creat d3/d27/d29/d5e/d80/daa/d117/f12f x:0 0 0 2022-02-02T18:23:05.555 INFO:tasks.workunit.client.1.smithi159.stdout:7/884: chown d3/d5 1304356 1 2022-02-02T18:23:05.555 INFO:tasks.workunit.client.1.smithi159.stdout:4/622: fdatasync d0/d8/f10 0 2022-02-02T18:23:05.555 INFO:tasks.workunit.client.1.smithi159.stdout:4/623: fdatasync d0/f2b 0 2022-02-02T18:23:05.555 INFO:tasks.workunit.client.1.smithi159.stdout:4/624: fdatasync d0/d8/f28 0 2022-02-02T18:23:05.556 INFO:tasks.workunit.client.1.smithi159.stdout:4/625: fsync d0/d8/d41/db7/f71 0 2022-02-02T18:23:05.557 INFO:tasks.workunit.client.1.smithi159.stdout:5/657: creat d9/d24/d37/d23/dba/fcb x:0 0 0 2022-02-02T18:23:05.557 INFO:tasks.workunit.client.1.smithi159.stdout:7/885: chown d3/fb 1056421916 1 2022-02-02T18:23:05.557 INFO:tasks.workunit.client.1.smithi159.stdout:0/692: mkdir d1/d11/d38/d42/d56/def 0 2022-02-02T18:23:05.558 INFO:tasks.workunit.client.1.smithi159.stdout:5/658: getdents d9/d24/d4a/d8d 0 2022-02-02T18:23:05.558 INFO:tasks.workunit.client.1.smithi159.stdout:0/693: write d1/f10 [2663834,62915] 0 2022-02-02T18:23:05.558 INFO:tasks.workunit.client.1.smithi159.stdout:0/694: dread - d1/dd/f4f zero size 2022-02-02T18:23:05.558 INFO:tasks.workunit.client.1.smithi159.stdout:7/886: symlink d3/d27/d29/d5e/d80/d119/l130 0 2022-02-02T18:23:05.559 INFO:tasks.workunit.client.1.smithi159.stdout:0/695: write d1/dd/d4b/d7d/fb4 [3046663,122217] 0 2022-02-02T18:23:05.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/631: rename d1/db7/d75/l77 to d1/d26/d48/ld7 0 2022-02-02T18:23:05.561 INFO:tasks.workunit.client.1.smithi159.stdout:5/659: symlink d9/d24/d4a/lcc 0 2022-02-02T18:23:05.561 INFO:tasks.workunit.client.1.smithi159.stdout:5/660: write d9/d24/d4a/fc5 [906299,53124] 0 2022-02-02T18:23:05.561 INFO:tasks.workunit.client.1.smithi159.stdout:5/661: chown d9/d24/d37/d23/d68/cc6 314884 1 2022-02-02T18:23:05.562 INFO:tasks.workunit.client.1.smithi159.stdout:4/626: link d0/f3 d0/d8/d41/db7/d33/d47/d56/fd0 0 2022-02-02T18:23:05.562 INFO:tasks.workunit.client.1.smithi159.stdout:0/696: unlink d1/dd/d4b/da7/dc1/fca 0 2022-02-02T18:23:05.563 INFO:tasks.workunit.client.1.smithi159.stdout:7/887: rename d3/d27/d29/d5e/d80/d119/l130 to d3/d27/d29/d5e/l131 0 2022-02-02T18:23:05.563 INFO:tasks.workunit.client.1.smithi159.stdout:8/632: creat d1/dd/d2c/d67/d5f/d8a/dbd/dca/fd8 x:0 0 0 2022-02-02T18:23:05.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/888: symlink d3/d27/d29/d6b/dc5/dfb/l132 0 2022-02-02T18:23:05.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/889: dread - d3/d5/d56/d2f/d5b/f123 zero size 2022-02-02T18:23:05.564 INFO:tasks.workunit.client.1.smithi159.stdout:7/890: readlink d3/d5/d56/d2f/de7/led 0 2022-02-02T18:23:05.565 INFO:tasks.workunit.client.1.smithi159.stdout:4/627: symlink d0/d8/d30/d5d/ld1 0 2022-02-02T18:23:05.565 INFO:tasks.workunit.client.1.smithi159.stdout:8/633: truncate d1/fa 2143618 0 2022-02-02T18:23:05.565 INFO:tasks.workunit.client.1.smithi159.stdout:8/634: truncate d1/dd/d2c/d67/fc1 295906 0 2022-02-02T18:23:05.566 INFO:tasks.workunit.client.1.smithi159.stdout:5/662: getdents d9/d24/d21 0 2022-02-02T18:23:05.569 INFO:tasks.workunit.client.1.smithi159.stdout:0/697: link d1/d11/d38/d42/db5/ded/fb7 d1/d11/d38/d42/ff0 0 2022-02-02T18:23:05.571 INFO:tasks.workunit.client.1.smithi159.stdout:7/891: mkdir d3/d27/d6f/d133 0 2022-02-02T18:23:05.571 INFO:tasks.workunit.client.1.smithi159.stdout:8/635: rename d1/db7/d75/l93 to d1/d26/d48/d49/dbe/dc0/ld9 0 2022-02-02T18:23:05.574 INFO:tasks.workunit.client.1.smithi159.stdout:7/892: creat d3/d27/d6f/f134 x:0 0 0 2022-02-02T18:23:05.577 INFO:tasks.workunit.client.1.smithi159.stdout:7/893: creat d3/d2a/d4a/f135 x:0 0 0 2022-02-02T18:23:05.577 INFO:tasks.workunit.client.1.smithi159.stdout:8/636: symlink d1/dad/dc9/lda 0 2022-02-02T18:23:05.578 INFO:tasks.workunit.client.1.smithi159.stdout:5/663: dread d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:23:05.578 INFO:tasks.workunit.client.1.smithi159.stdout:8/637: creat d1/dad/d95/fdb x:0 0 0 2022-02-02T18:23:05.579 INFO:tasks.workunit.client.1.smithi159.stdout:8/638: readlink d1/d26/d48/d99/lb8 0 2022-02-02T18:23:05.579 INFO:tasks.workunit.client.1.smithi159.stdout:7/894: creat d3/d2a/d4a/d7d/deb/f136 x:0 0 0 2022-02-02T18:23:05.579 INFO:tasks.workunit.client.1.smithi159.stdout:7/895: chown d3/d5/d56/d2f/de7/led 14308638 1 2022-02-02T18:23:05.580 INFO:tasks.workunit.client.1.smithi159.stdout:8/639: mknod d1/dd/d2c/d67/d5f/d8a/cdc 0 2022-02-02T18:23:05.580 INFO:tasks.workunit.client.1.smithi159.stdout:5/664: write d9/d24/d37/d23/f3f [5094720,13753] 0 2022-02-02T18:23:05.586 INFO:tasks.workunit.client.1.smithi159.stdout:6/659: dread df/d35/d2a/d3f/d55/d6a/f9b [0,4194304] 0 2022-02-02T18:23:05.586 INFO:tasks.workunit.client.1.smithi159.stdout:7/896: symlink d3/d2a/dcc/d11a/l137 0 2022-02-02T18:23:05.586 INFO:tasks.workunit.client.1.smithi159.stdout:7/897: chown d3/d27/db7/fde 10035061 1 2022-02-02T18:23:05.587 INFO:tasks.workunit.client.1.smithi159.stdout:8/640: unlink d1/d26/c38 0 2022-02-02T18:23:05.587 INFO:tasks.workunit.client.1.smithi159.stdout:8/641: write d1/dad/d95/fcd [17581,22477] 0 2022-02-02T18:23:05.588 INFO:tasks.workunit.client.1.smithi159.stdout:5/665: link d9/d24/d21/f66 d9/d24/d21/d44/fcd 0 2022-02-02T18:23:05.588 INFO:tasks.workunit.client.1.smithi159.stdout:5/666: dread - d9/d2e/d71/f9b zero size 2022-02-02T18:23:05.589 INFO:tasks.workunit.client.1.smithi159.stdout:5/667: write d9/d24/d38/f60 [5414235,33111] 0 2022-02-02T18:23:05.589 INFO:tasks.workunit.client.1.smithi159.stdout:7/898: write d3/d6/f17 [2547450,68472] 0 2022-02-02T18:23:05.590 INFO:tasks.workunit.client.1.smithi159.stdout:5/668: creat d9/d24/d4a/d91/dc1/fce x:0 0 0 2022-02-02T18:23:05.590 INFO:tasks.workunit.client.1.smithi159.stdout:5/669: stat d9/d24/d37/d23/d68/f95 0 2022-02-02T18:23:05.592 INFO:tasks.workunit.client.1.smithi159.stdout:5/670: symlink d9/d2e/d63/lcf 0 2022-02-02T18:23:05.593 INFO:tasks.workunit.client.1.smithi159.stdout:7/899: rename d3/d27/d29/d5e/d80 to d3/d6/d138 0 2022-02-02T18:23:05.594 INFO:tasks.workunit.client.1.smithi159.stdout:5/671: truncate d9/d24/d21/d44/f87 4072018 0 2022-02-02T18:23:05.594 INFO:tasks.workunit.client.1.smithi159.stdout:5/672: truncate d9/d24/f93 242836 0 2022-02-02T18:23:05.595 INFO:tasks.workunit.client.1.smithi159.stdout:5/673: truncate d9/d2e/f53 491157 0 2022-02-02T18:23:05.595 INFO:tasks.workunit.client.1.smithi159.stdout:7/900: truncate d3/d27/d29/f76 406853 0 2022-02-02T18:23:05.596 INFO:tasks.workunit.client.1.smithi159.stdout:0/698: dwrite d1/f2c [0,4194304] 0 2022-02-02T18:23:05.597 INFO:tasks.workunit.client.1.smithi159.stdout:7/901: creat d3/d5/d56/d2f/de7/f139 x:0 0 0 2022-02-02T18:23:05.597 INFO:tasks.workunit.client.1.smithi159.stdout:7/902: stat d3/d5/d56/d57/fea 0 2022-02-02T18:23:05.597 INFO:tasks.workunit.client.1.smithi159.stdout:7/903: fdatasync d3/d6/f40 0 2022-02-02T18:23:05.598 INFO:tasks.workunit.client.1.smithi159.stdout:5/674: truncate d9/f1c 1784242 0 2022-02-02T18:23:05.599 INFO:tasks.workunit.client.1.smithi159.stdout:0/699: symlink d1/dd/d4b/ddd/lf1 0 2022-02-02T18:23:05.600 INFO:tasks.workunit.client.1.smithi159.stdout:7/904: getdents d3/d6/d138 0 2022-02-02T18:23:05.600 INFO:tasks.workunit.client.1.smithi159.stdout:7/905: chown d3/d27/d29/d6b/da7/ldb 6 1 2022-02-02T18:23:05.601 INFO:tasks.workunit.client.1.smithi159.stdout:0/700: mknod d1/dd/cf2 0 2022-02-02T18:23:05.601 INFO:tasks.workunit.client.1.smithi159.stdout:6/660: dread df/d35/f57 [0,4194304] 0 2022-02-02T18:23:05.602 INFO:tasks.workunit.client.1.smithi159.stdout:7/906: mkdir d3/d2a/dcc/d8b/df1/d13a 0 2022-02-02T18:23:05.603 INFO:tasks.workunit.client.1.smithi159.stdout:0/701: creat d1/d11/d38/d42/ff3 x:0 0 0 2022-02-02T18:23:05.603 INFO:tasks.workunit.client.1.smithi159.stdout:7/907: getdents d3/d5/d56/d2f 0 2022-02-02T18:23:05.603 INFO:tasks.workunit.client.1.smithi159.stdout:7/908: fdatasync d3/ff4 0 2022-02-02T18:23:05.604 INFO:tasks.workunit.client.1.smithi159.stdout:6/661: mkdir df/d35/d2a/d3f/d42/dd7 0 2022-02-02T18:23:05.606 INFO:tasks.workunit.client.1.smithi159.stdout:7/909: link d3/d5/d56/c51 d3/d2a/d4a/d7d/deb/c13b 0 2022-02-02T18:23:05.607 INFO:tasks.workunit.client.1.smithi159.stdout:4/628: dwrite d0/d8/d24/f42 [0,4194304] 0 2022-02-02T18:23:05.608 INFO:tasks.workunit.client.1.smithi159.stdout:0/702: read d1/d11/d38/d42/daf/d34/f64 [32487,124787] 0 2022-02-02T18:23:05.608 INFO:tasks.workunit.client.1.smithi159.stdout:0/703: creat d1/dd/d4b/da7/da8/ff4 x:0 0 0 2022-02-02T18:23:05.608 INFO:tasks.workunit.client.1.smithi159.stdout:8/642: dwrite d1/dd/d1a/f39 [4194304,4194304] 0 2022-02-02T18:23:05.609 INFO:tasks.workunit.client.1.smithi159.stdout:5/675: dread d9/d24/f22 [4194304,4194304] 0 2022-02-02T18:23:05.610 INFO:tasks.workunit.client.1.smithi159.stdout:6/662: rename df/c29 to df/d35/d2a/d3f/d42/dd7/cd8 0 2022-02-02T18:23:05.610 INFO:tasks.workunit.client.1.smithi159.stdout:6/663: fsync df/d35/d2a/d2f/f99 0 2022-02-02T18:23:05.615 INFO:tasks.workunit.client.1.smithi159.stdout:8/643: link d1/db7/d75/fb5 d1/dd/d2c/d67/d5f/d8a/dbd/dca/fdd 0 2022-02-02T18:23:05.615 INFO:tasks.workunit.client.1.smithi159.stdout:4/629: creat d0/d7b/dc8/fd2 x:0 0 0 2022-02-02T18:23:05.617 INFO:tasks.workunit.client.1.smithi159.stdout:5/676: symlink d9/d2e/d71/ld0 0 2022-02-02T18:23:05.617 INFO:tasks.workunit.client.1.smithi159.stdout:5/677: readlink d9/d24/d21/l40 0 2022-02-02T18:23:05.618 INFO:tasks.workunit.client.1.smithi159.stdout:6/664: creat df/d35/d2a/d3f/d42/d47/fd9 x:0 0 0 2022-02-02T18:23:05.618 INFO:tasks.workunit.client.1.smithi159.stdout:6/665: fsync df/d35/f57 0 2022-02-02T18:23:05.621 INFO:tasks.workunit.client.1.smithi159.stdout:4/630: rename d0/d8/d41/db7/d33/d47/d56/f7a to d0/d8/d30/fd3 0 2022-02-02T18:23:05.621 INFO:tasks.workunit.client.1.smithi159.stdout:0/704: write d1/dd/fa5 [3104312,64773] 0 2022-02-02T18:23:05.626 INFO:tasks.workunit.client.1.smithi159.stdout:4/631: unlink d0/d8/d30/d5d/f97 0 2022-02-02T18:23:05.640 INFO:tasks.workunit.client.1.smithi159.stdout:0/705: dread d1/d11/d38/d42/daf/d34/f67 [0,4194304] 0 2022-02-02T18:23:05.644 INFO:tasks.workunit.client.1.smithi159.stdout:7/910: dwrite d3/d5/d95/f10a [0,4194304] 0 2022-02-02T18:23:05.644 INFO:tasks.workunit.client.1.smithi159.stdout:7/911: chown d3/d2a/dcc/d8b/df1/lfc 12731 1 2022-02-02T18:23:05.645 INFO:tasks.workunit.client.1.smithi159.stdout:7/912: write d3/d6/d138/dee/fb6 [3774944,86027] 0 2022-02-02T18:23:05.647 INFO:tasks.workunit.client.1.smithi159.stdout:7/913: mkdir d3/d2a/d4a/d7d/d13c 0 2022-02-02T18:23:05.649 INFO:tasks.workunit.client.1.smithi159.stdout:7/914: unlink d3/d2a/dcc/d8b/df1/d105/f116 0 2022-02-02T18:23:05.650 INFO:tasks.workunit.client.1.smithi159.stdout:7/915: symlink d3/d27/d10f/l13d 0 2022-02-02T18:23:05.651 INFO:tasks.workunit.client.1.smithi159.stdout:7/916: truncate d3/d5/d56/d2f/fb2 4357066 0 2022-02-02T18:23:05.651 INFO:tasks.workunit.client.1.smithi159.stdout:7/917: creat d3/d2a/d2c/f13e x:0 0 0 2022-02-02T18:23:05.652 INFO:tasks.workunit.client.1.smithi159.stdout:7/918: chown d3/d5/d56/d57/fd 337 1 2022-02-02T18:23:05.653 INFO:tasks.workunit.client.1.smithi159.stdout:7/919: rename d3/d27/db7/fde to d3/d27/db7/f13f 0 2022-02-02T18:23:05.654 INFO:tasks.workunit.client.1.smithi159.stdout:7/920: fdatasync d3/d5/d56/d57/f3f 0 2022-02-02T18:23:05.654 INFO:tasks.workunit.client.1.smithi159.stdout:7/921: dread - d3/d2a/dcc/f126 zero size 2022-02-02T18:23:05.654 INFO:tasks.workunit.client.1.smithi159.stdout:7/922: dread - d3/d27/d6f/f134 zero size 2022-02-02T18:23:05.657 INFO:tasks.workunit.client.1.smithi159.stdout:8/644: dwrite d1/dc/fba [0,4194304] 0 2022-02-02T18:23:05.659 INFO:tasks.workunit.client.1.smithi159.stdout:4/632: dwrite d0/d8/d41/db7/f71 [0,4194304] 0 2022-02-02T18:23:05.661 INFO:tasks.workunit.client.1.smithi159.stdout:6/666: dwrite df/d35/d2a/d3f/f58 [8388608,4194304] 0 2022-02-02T18:23:05.662 INFO:tasks.workunit.client.1.smithi159.stdout:4/633: rename d0/d8/d30/d7e/d9c/dae to d0/d8/d41/db7/d36/d4b/dd4 0 2022-02-02T18:23:05.662 INFO:tasks.workunit.client.1.smithi159.stdout:4/634: readlink d0/d8/d41/db7/d36/lb9 0 2022-02-02T18:23:05.662 INFO:tasks.workunit.client.1.smithi159.stdout:6/667: write df/d35/d2a/d3f/d55/d6a/f9b [669738,52541] 0 2022-02-02T18:23:05.663 INFO:tasks.workunit.client.1.smithi159.stdout:6/668: chown df/d35/d2a/d3f/d42/d47/fb2 13 1 2022-02-02T18:23:05.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/669: symlink df/lda 0 2022-02-02T18:23:05.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/670: mknod df/d35/d7b/cdb 0 2022-02-02T18:23:05.671 INFO:tasks.workunit.client.1.smithi159.stdout:6/671: truncate df/d35/d2a/d3f/d42/fc2 386258 0 2022-02-02T18:23:05.673 INFO:tasks.workunit.client.1.smithi159.stdout:4/635: dread d0/d8/f28 [0,4194304] 0 2022-02-02T18:23:05.675 INFO:tasks.workunit.client.1.smithi159.stdout:6/672: link df/d35/d2a/d3f/d65/fcb df/d35/d2a/d3f/d91/fdc 0 2022-02-02T18:23:05.677 INFO:tasks.workunit.client.1.smithi159.stdout:4/636: mknod d0/d8/d30/d7e/d9c/cd5 0 2022-02-02T18:23:05.680 INFO:tasks.workunit.client.1.smithi159.stdout:6/673: getdents df/d35/d2a/d2f 0 2022-02-02T18:23:05.681 INFO:tasks.workunit.client.1.smithi159.stdout:6/674: write df/d35/f38 [1222170,16988] 0 2022-02-02T18:23:05.682 INFO:tasks.workunit.client.1.smithi159.stdout:6/675: read - df/d35/d2a/d2f/d80/d61/f69 zero size 2022-02-02T18:23:05.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/676: symlink df/d35/d2a/d3f/d55/d6a/ldd 0 2022-02-02T18:23:05.685 INFO:tasks.workunit.client.1.smithi159.stdout:6/677: read df/d35/d2a/d2f/d80/d61/fbc [2649757,37901] 0 2022-02-02T18:23:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:8/645: mknod d1/dd/d2c/d67/d5f/cde 0 2022-02-02T18:23:05.716 INFO:tasks.workunit.client.1.smithi159.stdout:7/923: dwrite d3/d27/d29/d6b/da7/fb3 [0,4194304] 0 2022-02-02T18:23:05.717 INFO:tasks.workunit.client.1.smithi159.stdout:7/924: chown d3/d6/d122 24 1 2022-02-02T18:23:05.726 INFO:tasks.workunit.client.1.smithi159.stdout:8/646: mknod d1/d26/cdf 0 2022-02-02T18:23:05.727 INFO:tasks.workunit.client.1.smithi159.stdout:7/925: dread d3/d2a/f47 [0,4194304] 0 2022-02-02T18:23:05.728 INFO:tasks.workunit.client.1.smithi159.stdout:5/678: write d9/d24/d37/f3a [5070966,24456] 0 2022-02-02T18:23:05.728 INFO:tasks.workunit.client.1.smithi159.stdout:8/647: creat d1/d26/fe0 x:0 0 0 2022-02-02T18:23:05.728 INFO:tasks.workunit.client.1.smithi159.stdout:8/648: fsync d1/fa 0 2022-02-02T18:23:05.729 INFO:tasks.workunit.client.1.smithi159.stdout:7/926: chown d3/d5/c1e 64268 1 2022-02-02T18:23:05.729 INFO:tasks.workunit.client.1.smithi159.stdout:7/927: write d3/d5/d95/ff3 [543598,71279] 0 2022-02-02T18:23:05.730 INFO:tasks.workunit.client.1.smithi159.stdout:8/649: creat d1/dd/d1a/d53/fe1 x:0 0 0 2022-02-02T18:23:05.730 INFO:tasks.workunit.client.1.smithi159.stdout:8/650: getdents d1/d26/d48/d98 0 2022-02-02T18:23:05.731 INFO:tasks.workunit.client.1.smithi159.stdout:7/928: mkdir d3/d27/d29/d6b/dc5/dfb/d140 0 2022-02-02T18:23:05.731 INFO:tasks.workunit.client.1.smithi159.stdout:7/929: readlink d3/d27/d6f/da2/lf5 0 2022-02-02T18:23:05.732 INFO:tasks.workunit.client.1.smithi159.stdout:8/651: creat d1/db7/d75/d9d/d9f/fe2 x:0 0 0 2022-02-02T18:23:05.732 INFO:tasks.workunit.client.1.smithi159.stdout:8/652: creat d1/dd/d1a/d53/fe3 x:0 0 0 2022-02-02T18:23:05.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/653: chown d1/dd/d2c/d67/d5f/d8a 21962245 1 2022-02-02T18:23:05.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/654: write d1/d26/d48/d49/fcf [610642,73006] 0 2022-02-02T18:23:05.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/655: read d1/fa [1442719,14600] 0 2022-02-02T18:23:05.735 INFO:tasks.workunit.client.1.smithi159.stdout:5/679: truncate d9/d24/d38/f60 4789880 0 2022-02-02T18:23:05.735 INFO:tasks.workunit.client.1.smithi159.stdout:5/680: read - d9/d2e/db1/fc9 zero size 2022-02-02T18:23:05.736 INFO:tasks.workunit.client.1.smithi159.stdout:5/681: creat d9/d2e/d71/fd1 x:0 0 0 2022-02-02T18:23:05.738 INFO:tasks.workunit.client.1.smithi159.stdout:7/930: symlink d3/l141 0 2022-02-02T18:23:05.739 INFO:tasks.workunit.client.1.smithi159.stdout:5/682: rename d9/d24/d21/d44 to d9/d24/d38/d3c/d8c/dd2 0 2022-02-02T18:23:05.739 INFO:tasks.workunit.client.1.smithi159.stdout:7/931: creat d3/d6/d138/daa/f142 x:0 0 0 2022-02-02T18:23:05.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/656: dread d1/d26/d48/d49/fcf [0,4194304] 0 2022-02-02T18:23:05.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/657: chown d1/dd/d1a/d53/fe3 112471 1 2022-02-02T18:23:05.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/658: chown d1/dad/d95/fdb 1174 1 2022-02-02T18:23:05.742 INFO:tasks.workunit.client.1.smithi159.stdout:8/659: truncate d1/dd/d1a/f6e 4198383 0 2022-02-02T18:23:05.742 INFO:tasks.workunit.client.1.smithi159.stdout:5/683: write d9/d24/f22 [2272697,116744] 0 2022-02-02T18:23:05.742 INFO:tasks.workunit.client.1.smithi159.stdout:5/684: chown d9/d24/d4a/d91/dc1 66134 1 2022-02-02T18:23:05.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/685: read d9/d24/f16 [2036000,19012] 0 2022-02-02T18:23:05.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/686: write d9/d24/d38/d3c/d8c/dd2/f65 [1784776,97879] 0 2022-02-02T18:23:05.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/687: truncate d9/d24/d37/d23/d68/f7e 1381503 0 2022-02-02T18:23:05.744 INFO:tasks.workunit.client.1.smithi159.stdout:5/688: stat d9/d24/d4a/d8d/f98 0 2022-02-02T18:23:05.751 INFO:tasks.workunit.client.1.smithi159.stdout:7/932: dread d3/d27/d29/f71 [0,4194304] 0 2022-02-02T18:23:05.751 INFO:tasks.workunit.client.1.smithi159.stdout:7/933: creat d3/d2a/dcc/d8b/d8c/d99/f143 x:0 0 0 2022-02-02T18:23:05.752 INFO:tasks.workunit.client.1.smithi159.stdout:7/934: chown d3/d107 7453520 1 2022-02-02T18:23:05.752 INFO:tasks.workunit.client.1.smithi159.stdout:7/935: chown d3/d5/d56/d2f/cdf 3618078 1 2022-02-02T18:23:05.752 INFO:tasks.workunit.client.1.smithi159.stdout:7/936: chown d3/d5/d56/d2f/cc4 0 1 2022-02-02T18:23:05.752 INFO:tasks.workunit.client.1.smithi159.stdout:5/689: write d9/d24/d38/d88/f94 [435674,43877] 0 2022-02-02T18:23:05.755 INFO:tasks.workunit.client.1.smithi159.stdout:7/937: dread d3/d2a/dcc/d8b/d8c/d99/fb8 [0,4194304] 0 2022-02-02T18:23:05.755 INFO:tasks.workunit.client.1.smithi159.stdout:7/938: fsync d3/d5/d56/d2f/f4c 0 2022-02-02T18:23:05.760 INFO:tasks.workunit.client.1.smithi159.stdout:5/690: fdatasync d9/d24/d38/d3c/d8c/dd2/f65 0 2022-02-02T18:23:05.760 INFO:tasks.workunit.client.1.smithi159.stdout:5/691: write d9/f39 [4270273,57503] 0 2022-02-02T18:23:05.764 INFO:tasks.workunit.client.1.smithi159.stdout:7/939: dread d3/d5/d56/d57/f24 [0,4194304] 0 2022-02-02T18:23:05.767 INFO:tasks.workunit.client.1.smithi159.stdout:8/660: dwrite d1/db7/d75/d9d/d9f/fe2 [0,4194304] 0 2022-02-02T18:23:05.769 INFO:tasks.workunit.client.1.smithi159.stdout:5/692: dread d9/d2e/f5d [0,4194304] 0 2022-02-02T18:23:05.770 INFO:tasks.workunit.client.1.smithi159.stdout:8/661: mkdir d1/dd/d2c/d67/d5f/d8a/de4 0 2022-02-02T18:23:05.770 INFO:tasks.workunit.client.1.smithi159.stdout:8/662: fsync d1/dd/d2c/d67/fa4 0 2022-02-02T18:23:05.771 INFO:tasks.workunit.client.1.smithi159.stdout:5/693: rename d9/la2 to d9/d24/d4a/d91/ld3 0 2022-02-02T18:23:05.772 INFO:tasks.workunit.client.1.smithi159.stdout:8/663: symlink d1/d26/d48/d98/le5 0 2022-02-02T18:23:05.773 INFO:tasks.workunit.client.1.smithi159.stdout:5/694: readlink d9/d24/d37/l62 0 2022-02-02T18:23:05.775 INFO:tasks.workunit.client.1.smithi159.stdout:5/695: getdents d9/d24/d4a/d52 0 2022-02-02T18:23:05.777 INFO:tasks.workunit.client.1.smithi159.stdout:5/696: creat d9/d24/d4a/d8d/d9a/fd4 x:0 0 0 2022-02-02T18:23:05.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/940: getdents d3 0 2022-02-02T18:23:05.779 INFO:tasks.workunit.client.1.smithi159.stdout:5/697: stat d9/d24/lc7 0 2022-02-02T18:23:05.779 INFO:tasks.workunit.client.1.smithi159.stdout:5/698: creat d9/d24/d38/d3c/daa/fd5 x:0 0 0 2022-02-02T18:23:05.787 INFO:tasks.workunit.client.1.smithi159.stdout:7/941: dread d3/d6/d138/dee/fb6 [0,4194304] 0 2022-02-02T18:23:05.788 INFO:tasks.workunit.client.1.smithi159.stdout:5/699: rename d9/d24/d37/d23 to d9/d24/d38/d3c/d61/dd6 0 2022-02-02T18:23:05.789 INFO:tasks.workunit.client.1.smithi159.stdout:8/664: dwrite d1/dd/d2c/d67/fc1 [0,4194304] 0 2022-02-02T18:23:05.790 INFO:tasks.workunit.client.1.smithi159.stdout:8/665: chown d1/dd/f29 28501439 1 2022-02-02T18:23:05.790 INFO:tasks.workunit.client.1.smithi159.stdout:8/666: chown d1/dd/d2c/d67/d5f/d8a/dbd/dca/fd8 423289621 1 2022-02-02T18:23:05.790 INFO:tasks.workunit.client.1.smithi159.stdout:7/942: mkdir d3/d2a/d2c/d144 0 2022-02-02T18:23:05.791 INFO:tasks.workunit.client.1.smithi159.stdout:5/700: read d9/d24/d38/d3c/d61/dd6/f4d [562548,103883] 0 2022-02-02T18:23:05.793 INFO:tasks.workunit.client.1.smithi159.stdout:8/667: mknod d1/dd/d2c/d67/d5f/d8a/dbd/dca/ce6 0 2022-02-02T18:23:05.793 INFO:tasks.workunit.client.1.smithi159.stdout:5/701: readlink d9/d2e/l45 0 2022-02-02T18:23:05.794 INFO:tasks.workunit.client.1.smithi159.stdout:5/702: chown d9/d24/lc7 0 1 2022-02-02T18:23:05.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/668: readlink d1/lab 0 2022-02-02T18:23:05.795 INFO:tasks.workunit.client.1.smithi159.stdout:8/669: write d1/db7/d75/f78 [480881,60102] 0 2022-02-02T18:23:05.795 INFO:tasks.workunit.client.1.smithi159.stdout:5/703: truncate d9/d2e/d63/f7b 5037507 0 2022-02-02T18:23:05.795 INFO:tasks.workunit.client.1.smithi159.stdout:7/943: rmdir d3/d27/d29/d6b/dc5/dfb/d140 0 2022-02-02T18:23:05.800 INFO:tasks.workunit.client.1.smithi159.stdout:5/704: truncate d9/d24/d38/d3c/d8c/dd2/f87 3343567 0 2022-02-02T18:23:05.800 INFO:tasks.workunit.client.1.smithi159.stdout:5/705: fsync d9/f47 0 2022-02-02T18:23:05.801 INFO:tasks.workunit.client.1.smithi159.stdout:5/706: chown d9/d2e/db1/cc4 1287 1 2022-02-02T18:23:05.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/670: dread d1/fae [0,4194304] 0 2022-02-02T18:23:05.804 INFO:tasks.workunit.client.1.smithi159.stdout:8/671: fdatasync d1/fae 0 2022-02-02T18:23:05.805 INFO:tasks.workunit.client.1.smithi159.stdout:8/672: mkdir d1/dc/de7 0 2022-02-02T18:23:05.819 INFO:tasks.workunit.client.1.smithi159.stdout:8/673: dread d1/dc/fba [0,4194304] 0 2022-02-02T18:23:05.819 INFO:tasks.workunit.client.1.smithi159.stdout:8/674: chown d1/dad 1907475 1 2022-02-02T18:23:05.820 INFO:tasks.workunit.client.1.smithi159.stdout:8/675: mkdir d1/db7/d75/de8 0 2022-02-02T18:23:05.820 INFO:tasks.workunit.client.1.smithi159.stdout:8/676: stat d1/dc/f81 0 2022-02-02T18:23:05.820 INFO:tasks.workunit.client.1.smithi159.stdout:8/677: chown d1/d26/d48/d98 0 1 2022-02-02T18:23:05.821 INFO:tasks.workunit.client.1.smithi159.stdout:8/678: stat d1/dd/lc8 0 2022-02-02T18:23:05.828 INFO:tasks.workunit.client.1.smithi159.stdout:9/677: sync 2022-02-02T18:23:05.829 INFO:tasks.workunit.client.1.smithi159.stdout:9/678: read d4/fe5 [976579,128215] 0 2022-02-02T18:23:05.829 INFO:tasks.workunit.client.1.smithi159.stdout:9/679: write d4/d19/d1c/f7e [1005745,71224] 0 2022-02-02T18:23:05.830 INFO:tasks.workunit.client.1.smithi159.stdout:9/680: truncate d4/d7a/fd0 177735 0 2022-02-02T18:23:05.830 INFO:tasks.workunit.client.1.smithi159.stdout:9/681: chown d4/d19/d42/daf/dd7/fe0 16503 1 2022-02-02T18:23:05.831 INFO:tasks.workunit.client.1.smithi159.stdout:7/944: dwrite d3/d6/d122/f85 [0,4194304] 0 2022-02-02T18:23:05.831 INFO:tasks.workunit.client.1.smithi159.stdout:7/945: dread - d3/d6/fc0 zero size 2022-02-02T18:23:05.831 INFO:tasks.workunit.client.1.smithi159.stdout:9/682: symlink d4/d19/d1c/d21/da8/lea 0 2022-02-02T18:23:05.832 INFO:tasks.workunit.client.1.smithi159.stdout:5/707: dwrite d9/d24/f41 [0,4194304] 0 2022-02-02T18:23:05.832 INFO:tasks.workunit.client.1.smithi159.stdout:5/708: fdatasync d9/f1c 0 2022-02-02T18:23:05.832 INFO:tasks.workunit.client.1.smithi159.stdout:9/683: write d4/fe5 [3522777,116498] 0 2022-02-02T18:23:05.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/946: dread d3/d6/f40 [0,4194304] 0 2022-02-02T18:23:05.834 INFO:tasks.workunit.client.1.smithi159.stdout:9/684: unlink d4/d19/d1c/c2c 0 2022-02-02T18:23:05.836 INFO:tasks.workunit.client.1.smithi159.stdout:7/947: getdents d3/d27/d6f/da2 0 2022-02-02T18:23:05.836 INFO:tasks.workunit.client.1.smithi159.stdout:7/948: readlink d3/d27/d29/d6b/dc5/dfb/l132 0 2022-02-02T18:23:05.837 INFO:tasks.workunit.client.1.smithi159.stdout:8/679: dread d1/dc/f81 [0,4194304] 0 2022-02-02T18:23:05.837 INFO:tasks.workunit.client.1.smithi159.stdout:9/685: mknod d4/d19/d6f/d74/db1/dc7/ceb 0 2022-02-02T18:23:05.846 INFO:tasks.workunit.client.1.smithi159.stdout:8/680: unlink d1/db7/l4e 0 2022-02-02T18:23:05.847 INFO:tasks.workunit.client.1.smithi159.stdout:8/681: rmdir d1/d26/d48 39 2022-02-02T18:23:05.848 INFO:tasks.workunit.client.1.smithi159.stdout:8/682: stat d1/db7/d75/d9d/d9f/fe2 0 2022-02-02T18:23:05.850 INFO:tasks.workunit.client.1.smithi159.stdout:8/683: rmdir d1/dad/d95 39 2022-02-02T18:23:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:9/686: dread d4/d19/f76 [0,4194304] 0 2022-02-02T18:23:05.853 INFO:tasks.workunit.client.1.smithi159.stdout:8/684: mknod d1/d26/ce9 0 2022-02-02T18:23:05.853 INFO:tasks.workunit.client.1.smithi159.stdout:8/685: chown d1/d26/d48/d98/fd4 5096998 1 2022-02-02T18:23:05.853 INFO:tasks.workunit.client.1.smithi159.stdout:8/686: truncate d1/dc/f41 4633 0 2022-02-02T18:23:05.855 INFO:tasks.workunit.client.1.smithi159.stdout:8/687: symlink d1/d26/d48/d49/dbe/dc0/lea 0 2022-02-02T18:23:05.856 INFO:tasks.workunit.client.1.smithi159.stdout:8/688: mkdir d1/db7/d75/deb 0 2022-02-02T18:23:05.857 INFO:tasks.workunit.client.1.smithi159.stdout:9/687: rmdir d4/d7a 39 2022-02-02T18:23:05.858 INFO:tasks.workunit.client.1.smithi159.stdout:5/709: dwrite d9/d2e/d63/fa5 [0,4194304] 0 2022-02-02T18:23:05.867 INFO:tasks.workunit.client.1.smithi159.stdout:8/689: rename d1/d26/d48/d49/dbe to d1/dd/d31/dec 0 2022-02-02T18:23:05.870 INFO:tasks.workunit.client.1.smithi159.stdout:9/688: dread d4/d19/f31 [0,4194304] 0 2022-02-02T18:23:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:7/949: dwrite d3/d2a/d2c/fb4 [0,4194304] 0 2022-02-02T18:23:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:9/689: chown d4/d19/d1c/d21/d56/d59/fb0 51 1 2022-02-02T18:23:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:7/950: creat d3/d2a/d4a/f145 x:0 0 0 2022-02-02T18:23:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:7/951: write d3/d27/d6f/da2/f10d [681215,88288] 0 2022-02-02T18:23:05.873 INFO:tasks.workunit.client.1.smithi159.stdout:8/690: unlink d1/la6 0 2022-02-02T18:23:05.874 INFO:tasks.workunit.client.1.smithi159.stdout:8/691: write d1/dd/fce [410599,90443] 0 2022-02-02T18:23:05.874 INFO:tasks.workunit.client.1.smithi159.stdout:8/692: creat d1/d26/d48/d99/da5/fed x:0 0 0 2022-02-02T18:23:05.877 INFO:tasks.workunit.client.1.smithi159.stdout:5/710: rename d9/d24/d38 to d9/d2e/dd7 0 2022-02-02T18:23:05.878 INFO:tasks.workunit.client.1.smithi159.stdout:9/690: unlink d4/d19/d1c/d1f/l35 0 2022-02-02T18:23:05.879 INFO:tasks.workunit.client.1.smithi159.stdout:9/691: truncate d4/d19/d1c/d21/d22/f9c 1896974 0 2022-02-02T18:23:05.880 INFO:tasks.workunit.client.1.smithi159.stdout:9/692: chown d4/d2a/fde 591648228 1 2022-02-02T18:23:05.882 INFO:tasks.workunit.client.1.smithi159.stdout:9/693: write d4/d19/f1e [646210,9205] 0 2022-02-02T18:23:05.883 INFO:tasks.workunit.client.1.smithi159.stdout:5/711: mknod d9/d2e/dd7/d3c/d61/dd6/cd8 0 2022-02-02T18:23:05.890 INFO:tasks.workunit.client.1.smithi159.stdout:9/694: dread d4/d19/d1c/d21/f27 [0,4194304] 0 2022-02-02T18:23:05.901 INFO:tasks.workunit.client.1.smithi159.stdout:9/695: dread d4/d19/d1c/d21/d41/fbf [0,4194304] 0 2022-02-02T18:23:05.902 INFO:tasks.workunit.client.1.smithi159.stdout:9/696: stat d4/d19/f1e 0 2022-02-02T18:23:05.903 INFO:tasks.workunit.client.1.smithi159.stdout:9/697: dread d4/d19/d42/f85 [0,4194304] 0 2022-02-02T18:23:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:7/952: dwrite d3/d5/d56/d2f/d5b/f123 [0,4194304] 0 2022-02-02T18:23:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:8/693: dwrite d1/dd/d1a/d53/f80 [0,4194304] 0 2022-02-02T18:23:05.912 INFO:tasks.workunit.client.1.smithi159.stdout:8/694: readlink d1/d26/d48/l64 0 2022-02-02T18:23:05.912 INFO:tasks.workunit.client.1.smithi159.stdout:5/712: dwrite d9/d24/d4a/d8d/f98 [0,4194304] 0 2022-02-02T18:23:05.915 INFO:tasks.workunit.client.1.smithi159.stdout:7/953: rename d3/d2a/l11d to d3/d2a/dcc/d8b/df1/d105/l146 0 2022-02-02T18:23:05.920 INFO:tasks.workunit.client.1.smithi159.stdout:7/954: truncate d3/d5/d56/d57/f46 2000857 0 2022-02-02T18:23:05.924 INFO:tasks.workunit.client.1.smithi159.stdout:7/955: link d3/d2a/c9f d3/d27/d29/d68/c147 0 2022-02-02T18:23:05.925 INFO:tasks.workunit.client.1.smithi159.stdout:7/956: write d3/d27/d6f/da2/f10d [217977,34970] 0 2022-02-02T18:23:05.930 INFO:tasks.workunit.client.1.smithi159.stdout:7/957: mkdir d3/d27/d29/d6b/d148 0 2022-02-02T18:23:05.930 INFO:tasks.workunit.client.1.smithi159.stdout:5/713: creat d9/d24/d4a/d52/fd9 x:0 0 0 2022-02-02T18:23:05.930 INFO:tasks.workunit.client.1.smithi159.stdout:5/714: chown d9/d2e/dd7/d3c/d61/dd6/d68 1174 1 2022-02-02T18:23:05.934 INFO:tasks.workunit.client.1.smithi159.stdout:5/715: symlink d9/d2e/lda 0 2022-02-02T18:23:05.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/716: symlink d9/d2e/dd7/d3c/d61/ldb 0 2022-02-02T18:23:05.936 INFO:tasks.workunit.client.1.smithi159.stdout:8/695: dwrite d1/dd/d2c/d67/fa4 [0,4194304] 0 2022-02-02T18:23:05.942 INFO:tasks.workunit.client.1.smithi159.stdout:5/717: link d9/d2e/f2a d9/d2e/fdc 0 2022-02-02T18:23:05.945 INFO:tasks.workunit.client.1.smithi159.stdout:7/958: dread d3/d5/d56/d2f/f4c [0,4194304] 0 2022-02-02T18:23:05.946 INFO:tasks.workunit.client.1.smithi159.stdout:7/959: fsync d3/d2a/dcc/d8b/df1/ff6 0 2022-02-02T18:23:05.946 INFO:tasks.workunit.client.1.smithi159.stdout:5/718: dread d9/d2e/dd7/d3c/d61/dd6/f4d [0,4194304] 0 2022-02-02T18:23:05.948 INFO:tasks.workunit.client.1.smithi159.stdout:5/719: creat d9/d24/d37/fdd x:0 0 0 2022-02-02T18:23:05.951 INFO:tasks.workunit.client.1.smithi159.stdout:7/960: dread d3/d5/d56/d57/f46 [0,4194304] 0 2022-02-02T18:23:05.952 INFO:tasks.workunit.client.1.smithi159.stdout:7/961: mkdir d3/d2a/d4a/d7d/deb/d101/d149 0 2022-02-02T18:23:05.952 INFO:tasks.workunit.client.1.smithi159.stdout:7/962: chown d3/d27/db7/fd9 5567757 1 2022-02-02T18:23:05.953 INFO:tasks.workunit.client.1.smithi159.stdout:2/766: sync 2022-02-02T18:23:05.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/642: sync 2022-02-02T18:23:05.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/643: write dd/d20/d60/fa8 [85515,127394] 0 2022-02-02T18:23:05.954 INFO:tasks.workunit.client.1.smithi159.stdout:7/963: symlink d3/d5/d56/l14a 0 2022-02-02T18:23:05.964 INFO:tasks.workunit.client.1.smithi159.stdout:8/696: dwrite d1/dd/d2c/d67/d5f/d8a/dbd/dca/fdd [0,4194304] 0 2022-02-02T18:23:05.973 INFO:tasks.workunit.client.1.smithi159.stdout:3/644: write dd/d20/d60/f85 [2373107,7341] 0 2022-02-02T18:23:05.973 INFO:tasks.workunit.client.1.smithi159.stdout:7/964: dread d3/d5/d56/d2f/fe0 [0,4194304] 0 2022-02-02T18:23:05.977 INFO:tasks.workunit.client.1.smithi159.stdout:5/720: dwrite d9/d24/f41 [8388608,4194304] 0 2022-02-02T18:23:05.977 INFO:tasks.workunit.client.1.smithi159.stdout:2/767: dwrite da/d1c/d25/d73/dab/f33 [0,4194304] 0 2022-02-02T18:23:05.981 INFO:tasks.workunit.client.1.smithi159.stdout:5/721: mknod d9/d2e/dd7/d3c/d61/cde 0 2022-02-02T18:23:05.982 INFO:tasks.workunit.client.1.smithi159.stdout:3/645: unlink dd/d20/d2a/lbf 0 2022-02-02T18:23:05.982 INFO:tasks.workunit.client.1.smithi159.stdout:3/646: fsync dd/d20/f30 0 2022-02-02T18:23:05.982 INFO:tasks.workunit.client.1.smithi159.stdout:3/647: stat dd/d19/d38 0 2022-02-02T18:23:05.983 INFO:tasks.workunit.client.1.smithi159.stdout:5/722: chown d9/d2e/dd7/f73 1080 1 2022-02-02T18:23:05.983 INFO:tasks.workunit.client.1.smithi159.stdout:2/768: creat da/d1c/d47/d6b/d7c/f109 x:0 0 0 2022-02-02T18:23:05.983 INFO:tasks.workunit.client.1.smithi159.stdout:2/769: write da/d1c/d47/d6b/d59/fb4 [1110851,85883] 0 2022-02-02T18:23:05.983 INFO:tasks.workunit.client.1.smithi159.stdout:2/770: write da/d1c/d25/d73/dab/db5/fd5 [653286,10994] 0 2022-02-02T18:23:05.983 INFO:tasks.workunit.client.1.smithi159.stdout:2/771: truncate da/d1c/d47/d6b/d5a/f66 956829 0 2022-02-02T18:23:05.984 INFO:tasks.workunit.client.1.smithi159.stdout:5/723: creat d9/d2e/d71/fdf x:0 0 0 2022-02-02T18:23:05.984 INFO:tasks.workunit.client.1.smithi159.stdout:3/648: unlink dd/d19/d38/d3f/f4d 0 2022-02-02T18:23:05.985 INFO:tasks.workunit.client.1.smithi159.stdout:5/724: rename d9/d2e/db1/fb3 to d9/fe0 0 2022-02-02T18:23:05.985 INFO:tasks.workunit.client.1.smithi159.stdout:2/772: mkdir da/d1c/d42/d70/dec/d10a 0 2022-02-02T18:23:05.986 INFO:tasks.workunit.client.1.smithi159.stdout:3/649: truncate dd/d19/f46 2678652 0 2022-02-02T18:23:05.987 INFO:tasks.workunit.client.1.smithi159.stdout:2/773: write da/d1c/d76/f78 [163777,92476] 0 2022-02-02T18:23:05.989 INFO:tasks.workunit.client.1.smithi159.stdout:8/697: dwrite d1/dd/d1a/f6e [0,4194304] 0 2022-02-02T18:23:05.989 INFO:tasks.workunit.client.1.smithi159.stdout:8/698: write d1/dc/fba [4499298,77432] 0 2022-02-02T18:23:05.989 INFO:tasks.workunit.client.1.smithi159.stdout:2/774: symlink da/dce/l10b 0 2022-02-02T18:23:05.992 INFO:tasks.workunit.client.1.smithi159.stdout:2/775: symlink da/d1c/d25/d73/l10c 0 2022-02-02T18:23:05.999 INFO:tasks.workunit.client.1.smithi159.stdout:2/776: symlink da/d1c/dd7/df1/l10d 0 2022-02-02T18:23:06.005 INFO:tasks.workunit.client.1.smithi159.stdout:7/965: write d3/d27/d29/d6b/f6e [767889,73940] 0 2022-02-02T18:23:06.006 INFO:tasks.workunit.client.1.smithi159.stdout:7/966: chown d3/d2a/d4a/d7d/l11f 1394845 1 2022-02-02T18:23:06.006 INFO:tasks.workunit.client.1.smithi159.stdout:5/725: dwrite d9/d24/d4a/d91/dc1/fce [0,4194304] 0 2022-02-02T18:23:06.007 INFO:tasks.workunit.client.1.smithi159.stdout:5/726: chown d9/d24/d4a/d8d/f98 10890650 1 2022-02-02T18:23:06.007 INFO:tasks.workunit.client.1.smithi159.stdout:5/727: dread - d9/d2e/dd7/d3c/d61/dd6/dba/fcb zero size 2022-02-02T18:23:06.007 INFO:tasks.workunit.client.1.smithi159.stdout:5/728: truncate d9/d2e/dd7/d3c/d61/dd6/dba/fbe 850901 0 2022-02-02T18:23:06.009 INFO:tasks.workunit.client.1.smithi159.stdout:7/967: rmdir d3/d5/d56 39 2022-02-02T18:23:06.012 INFO:tasks.workunit.client.1.smithi159.stdout:7/968: rename d3/d27/d10f/d112 to d3/d27/d29/d6b/dc5/d14b 0 2022-02-02T18:23:06.012 INFO:tasks.workunit.client.1.smithi159.stdout:7/969: fsync d3/d5/f7f 0 2022-02-02T18:23:06.013 INFO:tasks.workunit.client.1.smithi159.stdout:2/777: dread da/d48/d6d/d3e/f100 [0,4194304] 0 2022-02-02T18:23:06.014 INFO:tasks.workunit.client.1.smithi159.stdout:2/778: fdatasync da/d48/d6d/d3e/fdd 0 2022-02-02T18:23:06.014 INFO:tasks.workunit.client.1.smithi159.stdout:7/970: mkdir d3/d107/d14c 0 2022-02-02T18:23:06.015 INFO:tasks.workunit.client.1.smithi159.stdout:5/729: dread d9/d24/f93 [0,4194304] 0 2022-02-02T18:23:06.020 INFO:tasks.workunit.client.1.smithi159.stdout:8/699: dwrite d1/dd/d2c/d67/f50 [0,4194304] 0 2022-02-02T18:23:06.021 INFO:tasks.workunit.client.1.smithi159.stdout:2/779: mknod da/d40/d61/d6c/c10e 0 2022-02-02T18:23:06.024 INFO:tasks.workunit.client.1.smithi159.stdout:2/780: dread da/d48/d6d/d3e/fdd [0,4194304] 0 2022-02-02T18:23:06.024 INFO:tasks.workunit.client.1.smithi159.stdout:2/781: readlink da/d48/lb7 0 2022-02-02T18:23:06.029 INFO:tasks.workunit.client.1.smithi159.stdout:2/782: link da/d1c/d42/ld3 da/d1c/d25/l10f 0 2022-02-02T18:23:06.033 INFO:tasks.workunit.client.1.smithi159.stdout:2/783: dread da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:23:06.033 INFO:tasks.workunit.client.1.smithi159.stdout:5/730: dread d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:23:06.034 INFO:tasks.workunit.client.1.smithi159.stdout:8/700: write d1/dd/d1a/f39 [7341388,65766] 0 2022-02-02T18:23:06.034 INFO:tasks.workunit.client.1.smithi159.stdout:5/731: truncate d9/d24/d21/f80 923376 0 2022-02-02T18:23:06.035 INFO:tasks.workunit.client.1.smithi159.stdout:8/701: write d1/dd/fce [1332285,103565] 0 2022-02-02T18:23:06.036 INFO:tasks.workunit.client.1.smithi159.stdout:2/784: creat da/f110 x:0 0 0 2022-02-02T18:23:06.036 INFO:tasks.workunit.client.1.smithi159.stdout:2/785: write da/d1c/d42/f81 [4662799,453] 0 2022-02-02T18:23:06.037 INFO:tasks.workunit.client.1.smithi159.stdout:8/702: symlink d1/dad/d95/lee 0 2022-02-02T18:23:06.037 INFO:tasks.workunit.client.1.smithi159.stdout:8/703: readlink d1/dad/d95/lee 0 2022-02-02T18:23:06.040 INFO:tasks.workunit.client.1.smithi159.stdout:8/704: rename d1/f7b to d1/db7/fef 0 2022-02-02T18:23:06.040 INFO:tasks.workunit.client.1.smithi159.stdout:2/786: mkdir da/d1c/d47/d6b/d5a/d7e/d111 0 2022-02-02T18:23:06.041 INFO:tasks.workunit.client.1.smithi159.stdout:7/971: dwrite d3/d6/d138/daa/d117/f12f [0,4194304] 0 2022-02-02T18:23:06.042 INFO:tasks.workunit.client.1.smithi159.stdout:3/650: dwrite dd/d66/d92/f6f [4194304,4194304] 0 2022-02-02T18:23:06.043 INFO:tasks.workunit.client.1.smithi159.stdout:8/705: rmdir d1/dad/d95/daa 39 2022-02-02T18:23:06.044 INFO:tasks.workunit.client.1.smithi159.stdout:7/972: creat d3/d2a/dcc/d11a/f14d x:0 0 0 2022-02-02T18:23:06.044 INFO:tasks.workunit.client.1.smithi159.stdout:7/973: truncate d3/d5/f45 2304830 0 2022-02-02T18:23:06.045 INFO:tasks.workunit.client.1.smithi159.stdout:7/974: write d3/d2a/dcc/d11a/f14d [55397,36358] 0 2022-02-02T18:23:06.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/651: mkdir dd/d19/d38/d3f/dd1 0 2022-02-02T18:23:06.047 INFO:tasks.workunit.client.1.smithi159.stdout:7/975: rmdir d3/d6/d138/daa 39 2022-02-02T18:23:06.049 INFO:tasks.workunit.client.1.smithi159.stdout:3/652: mknod dd/d19/d38/d3f/d80/d8a/cd2 0 2022-02-02T18:23:06.049 INFO:tasks.workunit.client.1.smithi159.stdout:3/653: write dd/d66/d69/fa7 [421345,43438] 0 2022-02-02T18:23:06.049 INFO:tasks.workunit.client.1.smithi159.stdout:3/654: write dd/d20/d60/fa8 [99211,86438] 0 2022-02-02T18:23:06.050 INFO:tasks.workunit.client.1.smithi159.stdout:7/976: creat d3/d27/d6f/d133/f14e x:0 0 0 2022-02-02T18:23:06.051 INFO:tasks.workunit.client.1.smithi159.stdout:8/706: dread d1/dad/d95/fcd [0,4194304] 0 2022-02-02T18:23:06.052 INFO:tasks.workunit.client.1.smithi159.stdout:8/707: write d1/fae [2742175,107531] 0 2022-02-02T18:23:06.052 INFO:tasks.workunit.client.1.smithi159.stdout:8/708: chown d1/dc/f81 188051 1 2022-02-02T18:23:06.054 INFO:tasks.workunit.client.1.smithi159.stdout:7/977: read d3/d27/d29/d6b/dc5/f93 [240262,110986] 0 2022-02-02T18:23:06.054 INFO:tasks.workunit.client.1.smithi159.stdout:7/978: chown d3/d27/d29/d6b/f6e 10 1 2022-02-02T18:23:06.055 INFO:tasks.workunit.client.1.smithi159.stdout:7/979: truncate d3/d5/d95/ff8 2075777 0 2022-02-02T18:23:06.055 INFO:tasks.workunit.client.1.smithi159.stdout:7/980: truncate d3/d2a/dcc/f12c 282852 0 2022-02-02T18:23:06.056 INFO:tasks.workunit.client.1.smithi159.stdout:8/709: symlink d1/lf0 0 2022-02-02T18:23:06.057 INFO:tasks.workunit.client.1.smithi159.stdout:8/710: symlink d1/d26/d48/d99/lf1 0 2022-02-02T18:23:06.063 INFO:tasks.workunit.client.1.smithi159.stdout:5/732: dwrite d9/d2e/d63/f6b [0,4194304] 0 2022-02-02T18:23:06.067 INFO:tasks.workunit.client.1.smithi159.stdout:8/711: write d1/dd/d2c/d67/fc1 [3468783,71617] 0 2022-02-02T18:23:06.067 INFO:tasks.workunit.client.1.smithi159.stdout:2/787: dwrite da/d1c/d47/d6b/ffc [0,4194304] 0 2022-02-02T18:23:06.067 INFO:tasks.workunit.client.1.smithi159.stdout:2/788: write da/d1c/d47/d6b/fcb [913966,28327] 0 2022-02-02T18:23:06.070 INFO:tasks.workunit.client.1.smithi159.stdout:8/712: unlink d1/dad/d95/fcd 0 2022-02-02T18:23:06.070 INFO:tasks.workunit.client.1.smithi159.stdout:8/713: chown d1/dd/d2c/d67/lb0 13735 1 2022-02-02T18:23:06.071 INFO:tasks.workunit.client.1.smithi159.stdout:5/733: dread d9/d24/d21/f9c [0,4194304] 0 2022-02-02T18:23:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/789: rename da/l2f to da/d1c/d47/d6b/d7c/l112 0 2022-02-02T18:23:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/790: read - da/d48/d6d/f8d zero size 2022-02-02T18:23:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/791: dread - da/d40/daf/fdc zero size 2022-02-02T18:23:06.074 INFO:tasks.workunit.client.1.smithi159.stdout:2/792: creat da/d1c/dd7/df1/f113 x:0 0 0 2022-02-02T18:23:06.076 INFO:tasks.workunit.client.1.smithi159.stdout:8/714: rename d1/dd/d1a/d53/fe3 to d1/ff2 0 2022-02-02T18:23:06.076 INFO:tasks.workunit.client.1.smithi159.stdout:3/655: dwrite dd/d19/d35/fa9 [0,4194304] 0 2022-02-02T18:23:06.077 INFO:tasks.workunit.client.1.smithi159.stdout:7/981: dwrite d3/d5/d56/d2f/d5b/fd2 [4194304,4194304] 0 2022-02-02T18:23:06.078 INFO:tasks.workunit.client.1.smithi159.stdout:8/715: rename d1/dad/dc9/fd5 to d1/d26/d48/d49/ff3 0 2022-02-02T18:23:06.083 INFO:tasks.workunit.client.1.smithi159.stdout:3/656: rename dd/d19/d35/f4f to dd/d19/d38/fd3 0 2022-02-02T18:23:06.083 INFO:tasks.workunit.client.1.smithi159.stdout:7/982: rmdir d3/d2a/dcc/d8b/d8c/d99 39 2022-02-02T18:23:06.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/983: write d3/f14 [978444,19465] 0 2022-02-02T18:23:06.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/984: fsync d3/d2a/d2c/fb4 0 2022-02-02T18:23:06.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/985: write d3/d27/d29/d6b/da7/f10b [827584,110795] 0 2022-02-02T18:23:06.085 INFO:tasks.workunit.client.1.smithi159.stdout:3/657: mkdir dd/d66/d82/dd4 0 2022-02-02T18:23:06.087 INFO:tasks.workunit.client.1.smithi159.stdout:5/734: dread d9/d2e/f2a [0,4194304] 0 2022-02-02T18:23:06.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/658: write dd/d20/d60/f78 [1958626,119784] 0 2022-02-02T18:23:06.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/659: truncate dd/d20/d60/fa8 1039936 0 2022-02-02T18:23:06.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/660: dread - dd/d20/d60/fb3 zero size 2022-02-02T18:23:06.088 INFO:tasks.workunit.client.1.smithi159.stdout:8/716: rename d1/fa to d1/d26/d48/ff4 0 2022-02-02T18:23:06.088 INFO:tasks.workunit.client.1.smithi159.stdout:8/717: fsync d1/db7/d75/f78 0 2022-02-02T18:23:06.088 INFO:tasks.workunit.client.1.smithi159.stdout:3/661: symlink dd/d66/d69/db0/ld5 0 2022-02-02T18:23:06.088 INFO:tasks.workunit.client.1.smithi159.stdout:3/662: chown dd/d19/d38/d3f/d52/db4/cb8 315 1 2022-02-02T18:23:06.089 INFO:tasks.workunit.client.1.smithi159.stdout:3/663: fsync dd/d19/d38/d3f/d80/d8a/f9f 0 2022-02-02T18:23:06.089 INFO:tasks.workunit.client.1.smithi159.stdout:8/718: mkdir d1/dc/de7/df5 0 2022-02-02T18:23:06.090 INFO:tasks.workunit.client.1.smithi159.stdout:7/986: rename d3/d2a/d12a to d3/d2a/dcc/d8b/df1/d105/d14f 0 2022-02-02T18:23:06.090 INFO:tasks.workunit.client.1.smithi159.stdout:5/735: getdents d9/d2e 0 2022-02-02T18:23:06.090 INFO:tasks.workunit.client.1.smithi159.stdout:5/736: creat d9/d24/d4a/d8d/d9a/fe1 x:0 0 0 2022-02-02T18:23:06.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/987: mkdir d3/d2a/d4a/d7d/deb/d101/d150 0 2022-02-02T18:23:06.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/988: chown d3/d2a/dcc/d8b/d8c/d99 7944924 1 2022-02-02T18:23:06.099 INFO:tasks.workunit.client.1.smithi159.stdout:7/989: chown d3/d5/l1d 20520572 1 2022-02-02T18:23:06.099 INFO:tasks.workunit.client.1.smithi159.stdout:8/719: rename d1/dd/d2c/d67/d5f/d8a/dbd to d1/dd/d2c/df6 0 2022-02-02T18:23:06.100 INFO:tasks.workunit.client.1.smithi159.stdout:3/664: mknod dd/d66/d92/cd6 0 2022-02-02T18:23:06.100 INFO:tasks.workunit.client.1.smithi159.stdout:3/665: chown dd/d20/f30 802 1 2022-02-02T18:23:06.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/793: write da/d1c/d25/f69 [1404955,74404] 0 2022-02-02T18:23:06.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/666: write dd/d66/d92/f45 [685230,96568] 0 2022-02-02T18:23:06.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/794: chown da/d1c/d76/c97 115788 1 2022-02-02T18:23:06.108 INFO:tasks.workunit.client.1.smithi159.stdout:3/667: read dd/d20/d2a/f4a [1196750,42329] 0 2022-02-02T18:23:06.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/668: dread - dd/d20/d2a/d31/fbc zero size 2022-02-02T18:23:06.110 INFO:tasks.workunit.client.1.smithi159.stdout:2/795: write da/d1c/d25/d73/dab/f33 [4072940,123084] 0 2022-02-02T18:23:06.113 INFO:tasks.workunit.client.1.smithi159.stdout:7/990: dread d3/d6/d122/f85 [0,4194304] 0 2022-02-02T18:23:06.116 INFO:tasks.workunit.client.1.smithi159.stdout:3/669: symlink dd/d66/d69/db0/dc8/ld7 0 2022-02-02T18:23:06.120 INFO:tasks.workunit.client.1.smithi159.stdout:7/991: mkdir d3/d5/d95/d151 0 2022-02-02T18:23:06.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/992: write d3/fb [896376,57631] 0 2022-02-02T18:23:06.129 INFO:tasks.workunit.client.1.smithi159.stdout:2/796: rename da/d1c/d47/d6b/d7c/lba to da/d1c/d42/d45/l114 0 2022-02-02T18:23:06.130 INFO:tasks.workunit.client.1.smithi159.stdout:7/993: creat d3/d2a/dcc/f152 x:0 0 0 2022-02-02T18:23:06.133 INFO:tasks.workunit.client.1.smithi159.stdout:3/670: mknod dd/d19/d38/d3f/cd8 0 2022-02-02T18:23:06.138 INFO:tasks.workunit.client.1.smithi159.stdout:7/994: unlink d3/fb 0 2022-02-02T18:23:06.138 INFO:tasks.workunit.client.1.smithi159.stdout:7/995: write d3/d2a/dcc/f152 [263665,58112] 0 2022-02-02T18:23:06.144 INFO:tasks.workunit.client.1.smithi159.stdout:7/996: rename d3/d2a/dcc/d8b to d3/d153 0 2022-02-02T18:23:06.171 INFO:tasks.workunit.client.1.smithi159.stdout:3/671: dwrite dd/d66/d69/f84 [4194304,4194304] 0 2022-02-02T18:23:06.171 INFO:tasks.workunit.client.1.smithi159.stdout:2/797: dwrite da/d1c/d42/f72 [0,4194304] 0 2022-02-02T18:23:06.173 INFO:tasks.workunit.client.1.smithi159.stdout:3/672: mkdir dd/d66/d82/dd4/dd9 0 2022-02-02T18:23:06.173 INFO:tasks.workunit.client.1.smithi159.stdout:3/673: stat dd/d19/d38/d3f/cd8 0 2022-02-02T18:23:06.175 INFO:tasks.workunit.client.1.smithi159.stdout:8/720: link d1/dd/d1a/d53/c62 d1/dad/d95/cf7 0 2022-02-02T18:23:06.175 INFO:tasks.workunit.client.1.smithi159.stdout:3/674: creat dd/d19/d38/d3f/dbb/fda x:0 0 0 2022-02-02T18:23:06.181 INFO:tasks.workunit.client.1.smithi159.stdout:2/798: dread da/d48/d6d/d3e/f56 [4194304,4194304] 0 2022-02-02T18:23:06.194 INFO:tasks.workunit.client.1.smithi159.stdout:2/799: write da/d1c/d47/fa0 [1166554,126975] 0 2022-02-02T18:23:06.194 INFO:tasks.workunit.client.1.smithi159.stdout:3/675: dwrite dd/d20/d2a/f75 [0,4194304] 0 2022-02-02T18:23:06.205 INFO:tasks.workunit.client.1.smithi159.stdout:2/800: dread da/d48/fcd [0,4194304] 0 2022-02-02T18:23:06.206 INFO:tasks.workunit.client.1.smithi159.stdout:2/801: mknod da/d1c/d42/d70/c115 0 2022-02-02T18:23:06.209 INFO:tasks.workunit.client.1.smithi159.stdout:2/802: dread da/d48/d6d/d3e/f56 [0,4194304] 0 2022-02-02T18:23:06.228 INFO:tasks.workunit.client.1.smithi159.stdout:2/803: dwrite da/d48/d6d/d3e/f100 [0,4194304] 0 2022-02-02T18:23:06.234 INFO:tasks.workunit.client.1.smithi159.stdout:2/804: write da/d48/f71 [605170,90339] 0 2022-02-02T18:23:06.234 INFO:tasks.workunit.client.1.smithi159.stdout:2/805: unlink da/d1c/d47/fa0 0 2022-02-02T18:23:06.248 INFO:tasks.workunit.client.1.smithi159.stdout:2/806: dwrite da/d40/d61/d6c/fe7 [0,4194304] 0 2022-02-02T18:23:06.248 INFO:tasks.workunit.client.1.smithi159.stdout:2/807: truncate da/d48/d6d/d3e/f7f 231420 0 2022-02-02T18:23:06.249 INFO:tasks.workunit.client.1.smithi159.stdout:2/808: link da/d1c/d42/d45/c4d da/d1c/d47/dc7/c116 0 2022-02-02T18:23:06.250 INFO:tasks.workunit.client.1.smithi159.stdout:2/809: chown da/d40/c46 0 1 2022-02-02T18:23:06.250 INFO:tasks.workunit.client.1.smithi159.stdout:2/810: fdatasync da/d1c/d47/f79 0 2022-02-02T18:23:06.258 INFO:tasks.workunit.client.1.smithi159.stdout:2/811: truncate da/d40/f98 5019854 0 2022-02-02T18:23:06.258 INFO:tasks.workunit.client.1.smithi159.stdout:2/812: rmdir da/d48/d83 39 2022-02-02T18:23:06.260 INFO:tasks.workunit.client.1.smithi159.stdout:2/813: creat da/dce/f117 x:0 0 0 2022-02-02T18:23:06.260 INFO:tasks.workunit.client.1.smithi159.stdout:2/814: truncate da/d1c/d47/d6b/ffc 2162006 0 2022-02-02T18:23:06.262 INFO:tasks.workunit.client.1.smithi159.stdout:2/815: getdents da/d40/daf 0 2022-02-02T18:23:06.263 INFO:tasks.workunit.client.1.smithi159.stdout:2/816: mkdir da/d1c/d25/d73/dab/df5/d118 0 2022-02-02T18:23:06.264 INFO:tasks.workunit.client.1.smithi159.stdout:2/817: mkdir da/d1c/d25/d73/dab/d119 0 2022-02-02T18:23:06.275 INFO:tasks.workunit.client.1.smithi159.stdout:2/818: truncate da/d1c/d47/d6b/ffc 425881 0 2022-02-02T18:23:06.276 INFO:tasks.workunit.client.1.smithi159.stdout:2/819: mknod da/d48/d83/dff/c11a 0 2022-02-02T18:23:06.278 INFO:tasks.workunit.client.1.smithi159.stdout:2/820: symlink da/d48/d6d/l11b 0 2022-02-02T18:23:06.280 INFO:tasks.workunit.client.1.smithi159.stdout:2/821: getdents da/d1c/dd7/df1 0 2022-02-02T18:23:06.283 INFO:tasks.workunit.client.1.smithi159.stdout:2/822: unlink da/d1c/d42/d45/f58 0 2022-02-02T18:23:06.283 INFO:tasks.workunit.client.1.smithi159.stdout:2/823: getdents da/d1c/d25/d73/dab/df5/d118 0 2022-02-02T18:23:06.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/824: dwrite da/d40/daf/ff9 [0,4194304] 0 2022-02-02T18:23:06.319 INFO:tasks.workunit.client.1.smithi159.stdout:2/825: dwrite da/d48/d6d/d3e/f100 [0,4194304] 0 2022-02-02T18:23:06.321 INFO:tasks.workunit.client.1.smithi159.stdout:2/826: symlink da/d1c/d47/d6b/d5a/d7e/l11c 0 2022-02-02T18:23:06.321 INFO:tasks.workunit.client.1.smithi159.stdout:2/827: mkdir da/d1c/d42/d70/dec/d10a/d11d 0 2022-02-02T18:23:06.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/828: dwrite da/f44 [0,4194304] 0 2022-02-02T18:23:06.344 INFO:tasks.workunit.client.1.smithi159.stdout:2/829: mkdir da/d1c/d47/dc7/d11e 0 2022-02-02T18:23:06.345 INFO:tasks.workunit.client.1.smithi159.stdout:2/830: truncate da/d1c/d47/d6b/f80 1472911 0 2022-02-02T18:23:06.348 INFO:tasks.workunit.client.1.smithi159.stdout:2/831: link da/d40/l10 da/d48/l11f 0 2022-02-02T18:23:06.348 INFO:tasks.workunit.client.1.smithi159.stdout:2/832: readlink da/d1c/d25/l10f 0 2022-02-02T18:23:06.349 INFO:tasks.workunit.client.1.smithi159.stdout:2/833: write da/d1c/f5b [3644175,19390] 0 2022-02-02T18:23:06.350 INFO:tasks.workunit.client.1.smithi159.stdout:2/834: chown l5 935245 1 2022-02-02T18:23:06.367 INFO:tasks.workunit.client.1.smithi159.stdout:2/835: dwrite da/d40/f88 [0,4194304] 0 2022-02-02T18:23:06.367 INFO:tasks.workunit.client.1.smithi159.stdout:2/836: fsync da/fb2 0 2022-02-02T18:23:06.370 INFO:tasks.workunit.client.1.smithi159.stdout:2/837: mkdir da/d1c/d47/d120 0 2022-02-02T18:23:06.371 INFO:tasks.workunit.client.1.smithi159.stdout:2/838: mkdir da/d1c/d47/d6b/d59/d121 0 2022-02-02T18:23:06.372 INFO:tasks.workunit.client.1.smithi159.stdout:2/839: truncate da/d1c/d42/d45/ffa 462279 0 2022-02-02T18:23:06.386 INFO:tasks.workunit.client.1.smithi159.stdout:2/840: dwrite da/d1c/d47/fe9 [0,4194304] 0 2022-02-02T18:23:06.394 INFO:tasks.workunit.client.1.smithi159.stdout:2/841: dread da/d48/f71 [0,4194304] 0 2022-02-02T18:23:06.395 INFO:tasks.workunit.client.1.smithi159.stdout:2/842: creat da/d40/d61/d6c/f122 x:0 0 0 2022-02-02T18:23:06.396 INFO:tasks.workunit.client.1.smithi159.stdout:2/843: write da/d40/f1d [737392,44193] 0 2022-02-02T18:23:06.396 INFO:tasks.workunit.client.1.smithi159.stdout:2/844: creat da/d1c/d25/d73/dab/dd1/f123 x:0 0 0 2022-02-02T18:23:06.397 INFO:tasks.workunit.client.1.smithi159.stdout:2/845: symlink da/d1c/d25/d73/dab/df5/l124 0 2022-02-02T18:23:06.398 INFO:tasks.workunit.client.1.smithi159.stdout:2/846: creat da/d1c/d42/d70/dec/f125 x:0 0 0 2022-02-02T18:23:06.415 INFO:tasks.workunit.client.1.smithi159.stdout:2/847: dwrite da/d1c/d47/d6b/d5a/d7e/f82 [0,4194304] 0 2022-02-02T18:23:06.415 INFO:tasks.workunit.client.1.smithi159.stdout:2/848: fsync da/d1c/d25/f69 0 2022-02-02T18:23:06.415 INFO:tasks.workunit.client.1.smithi159.stdout:2/849: readlink da/d1c/d47/d6b/d5a/l68 0 2022-02-02T18:23:06.416 INFO:tasks.workunit.client.1.smithi159.stdout:2/850: truncate da/d1c/d25/d73/dab/dd1/f123 742792 0 2022-02-02T18:23:06.416 INFO:tasks.workunit.client.1.smithi159.stdout:2/851: truncate da/d40/d61/f8f 4333241 0 2022-02-02T18:23:06.416 INFO:tasks.workunit.client.1.smithi159.stdout:2/852: stat da/d1c/d47/d6b/d59/f6f 0 2022-02-02T18:23:06.417 INFO:tasks.workunit.client.1.smithi159.stdout:2/853: rmdir da/d1c/d47/d6b/d5a/dcc 0 2022-02-02T18:23:06.419 INFO:tasks.workunit.client.1.smithi159.stdout:2/854: creat da/d1c/dd7/f126 x:0 0 0 2022-02-02T18:23:06.421 INFO:tasks.workunit.client.1.smithi159.stdout:2/855: symlink da/d48/d6d/d3e/l127 0 2022-02-02T18:23:06.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/856: mkdir da/d1c/d25/d128 0 2022-02-02T18:23:06.443 INFO:tasks.workunit.client.1.smithi159.stdout:2/857: dwrite da/d48/d6d/d3e/f9c [0,4194304] 0 2022-02-02T18:23:06.446 INFO:tasks.workunit.client.1.smithi159.stdout:2/858: mkdir da/d1c/d25/d73/dab/df5/d118/d129 0 2022-02-02T18:23:06.447 INFO:tasks.workunit.client.1.smithi159.stdout:2/859: fsync da/d1c/d47/d6b/fcb 0 2022-02-02T18:23:06.448 INFO:tasks.workunit.client.1.smithi159.stdout:2/860: mknod da/d1c/c12a 0 2022-02-02T18:23:06.450 INFO:tasks.workunit.client.1.smithi159.stdout:2/861: unlink da/d40/dde/lfd 0 2022-02-02T18:23:06.451 INFO:tasks.workunit.client.1.smithi159.stdout:2/862: creat da/d1c/d47/f12b x:0 0 0 2022-02-02T18:23:06.453 INFO:tasks.workunit.client.1.smithi159.stdout:2/863: creat da/d48/d6d/f12c x:0 0 0 2022-02-02T18:23:06.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/864: creat da/d40/d61/f12d x:0 0 0 2022-02-02T18:23:06.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/865: fsync da/d1c/d25/d73/dab/db5/fd5 0 2022-02-02T18:23:06.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/866: chown da/d48/d6d/d3e 0 1 2022-02-02T18:23:06.456 INFO:tasks.workunit.client.1.smithi159.stdout:2/867: creat da/d1c/d25/d73/f12e x:0 0 0 2022-02-02T18:23:06.457 INFO:tasks.workunit.client.1.smithi159.stdout:2/868: creat da/d1c/d42/d45/f12f x:0 0 0 2022-02-02T18:23:06.457 INFO:tasks.workunit.client.1.smithi159.stdout:2/869: write da/d1c/d25/d73/dab/f4b [966694,6770] 0 2022-02-02T18:23:06.458 INFO:tasks.workunit.client.1.smithi159.stdout:2/870: write da/d1c/d42/f72 [3014809,49045] 0 2022-02-02T18:23:06.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/871: dread da/d1c/d25/d73/ff0 [0,4194304] 0 2022-02-02T18:23:06.461 INFO:tasks.workunit.client.1.smithi159.stdout:2/872: mknod da/d1c/d25/d73/c130 0 2022-02-02T18:23:06.464 INFO:tasks.workunit.client.1.smithi159.stdout:2/873: rename da/d40/l17 to da/d1c/d47/d6b/d59/d121/l131 0 2022-02-02T18:23:06.464 INFO:tasks.workunit.client.1.smithi159.stdout:2/874: fdatasync da/d1c/d47/d6b/d5a/f7b 0 2022-02-02T18:23:06.466 INFO:tasks.workunit.client.1.smithi159.stdout:2/875: rmdir da/d1c/d47/d6b/d5a/dd8 0 2022-02-02T18:23:06.476 INFO:tasks.workunit.client.1.smithi159.stdout:2/876: dread da/d40/f1d [0,4194304] 0 2022-02-02T18:23:06.482 INFO:tasks.workunit.client.1.smithi159.stdout:2/877: chown da/d1c/d47/l84 4524 1 2022-02-02T18:23:06.483 INFO:tasks.workunit.client.1.smithi159.stdout:2/878: write da/d1c/d25/d73/dab/f4b [1815740,76823] 0 2022-02-02T18:23:06.483 INFO:tasks.workunit.client.1.smithi159.stdout:2/879: write da/d1c/d42/fef [67622,102493] 0 2022-02-02T18:23:06.484 INFO:tasks.workunit.client.1.smithi159.stdout:2/880: dread - da/d1c/d47/fd6 zero size 2022-02-02T18:23:06.484 INFO:tasks.workunit.client.1.smithi159.stdout:2/881: write da/d48/d6d/d3e/fca [934348,102862] 0 2022-02-02T18:23:06.492 INFO:tasks.workunit.client.1.smithi159.stdout:2/882: rmdir da/d1c/d47/d6b/d5a 39 2022-02-02T18:23:06.510 INFO:tasks.workunit.client.1.smithi159.stdout:2/883: dwrite da/d40/f98 [0,4194304] 0 2022-02-02T18:23:06.510 INFO:tasks.workunit.client.1.smithi159.stdout:2/884: truncate da/d1c/d47/d6b/d5a/ffb 528063 0 2022-02-02T18:23:06.511 INFO:tasks.workunit.client.1.smithi159.stdout:2/885: write da/d1c/d25/d73/dab/db5/fd5 [1617422,92418] 0 2022-02-02T18:23:06.512 INFO:tasks.workunit.client.1.smithi159.stdout:2/886: read - da/d1c/d47/d54/fa1 zero size 2022-02-02T18:23:06.514 INFO:tasks.workunit.client.1.smithi159.stdout:2/887: creat da/d1c/dd7/df1/f132 x:0 0 0 2022-02-02T18:23:06.527 INFO:tasks.workunit.client.1.smithi159.stdout:2/888: dread da/d40/f98 [0,4194304] 0 2022-02-02T18:23:06.529 INFO:tasks.workunit.client.1.smithi159.stdout:2/889: link da/d1c/d47/d6b/d7c/l112 da/d1c/d25/d128/l133 0 2022-02-02T18:23:06.529 INFO:tasks.workunit.client.1.smithi159.stdout:2/890: chown da/d1c/f1f 311206 1 2022-02-02T18:23:06.530 INFO:tasks.workunit.client.1.smithi159.stdout:2/891: getdents da/d1c/d47/dc7 0 2022-02-02T18:23:06.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/892: truncate da/d1c/f32 3965482 0 2022-02-02T18:23:06.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/893: truncate da/d1c/d25/d73/dab/db5/fcf 4435587 0 2022-02-02T18:23:06.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/894: chown da/d48/d6d/d3e/l127 3343 1 2022-02-02T18:23:06.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/895: chown da/d48/d6d/l11b 80405960 1 2022-02-02T18:23:06.533 INFO:tasks.workunit.client.1.smithi159.stdout:2/896: write da/d40/f1d [3645736,67316] 0 2022-02-02T18:23:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:07 smithi159 conmon[35668]: cluster 2022-02-02T18:23:06.544526+0000 mgr.smithi096.shfutl (mgr.14628) 26 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 19 MiB/s rd, 35 MiB/s wr, 92 op/s 2022-02-02T18:23:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:07 smithi159 conmon[35668]: 2022-02-02T18:23:08.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:07 smithi096 conmon[32067]: cluster 2022-02-02T18:23:06.544526+0000 mgr.smithi096.shfutl (mgr.14628) 26 : cluster [DBG] 2022-02-02T18:23:08.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:07 smithi096 conmon[32067]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 19 MiB/s rd, 35 MiB/s wr, 92 op/s 2022-02-02T18:23:09.120 INFO:tasks.workunit.client.1.smithi159.stdout:1/666: sync 2022-02-02T18:23:09.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/667: chown df/cab 32340 1 2022-02-02T18:23:09.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/637: sync 2022-02-02T18:23:09.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/638: dread - d0/f2b zero size 2022-02-02T18:23:09.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/639: chown d0/f3 70179 1 2022-02-02T18:23:09.122 INFO:tasks.workunit.client.1.smithi159.stdout:9/698: sync 2022-02-02T18:23:09.123 INFO:tasks.workunit.client.1.smithi159.stdout:6/678: sync 2022-02-02T18:23:09.123 INFO:tasks.workunit.client.1.smithi159.stdout:0/706: sync 2022-02-02T18:23:09.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/737: sync 2022-02-02T18:23:09.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/738: chown d9/f7a 23 1 2022-02-02T18:23:09.124 INFO:tasks.workunit.client.1.smithi159.stdout:5/739: chown d9/d2e/dd7/d3c/d8c/dd2/fb6 86 1 2022-02-02T18:23:09.124 INFO:tasks.workunit.client.1.smithi159.stdout:3/676: sync 2022-02-02T18:23:09.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/997: sync 2022-02-02T18:23:09.125 INFO:tasks.workunit.client.1.smithi159.stdout:8/721: sync 2022-02-02T18:23:09.126 INFO:tasks.workunit.client.1.smithi159.stdout:2/897: sync 2022-02-02T18:23:09.133 INFO:tasks.workunit.client.1.smithi159.stdout:5/740: mknod d9/d2e/db1/ce2 0 2022-02-02T18:23:09.140 INFO:tasks.workunit.client.1.smithi159.stdout:0/707: dread d1/d11/d38/d42/daf/d34/f71 [0,4194304] 0 2022-02-02T18:23:09.144 INFO:tasks.workunit.client.1.smithi159.stdout:5/741: symlink d9/d2e/d71/le3 0 2022-02-02T18:23:09.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/708: mknod d1/d11/d38/d94/cf5 0 2022-02-02T18:23:09.146 INFO:tasks.workunit.client.1.smithi159.stdout:8/722: unlink d1/dd/d1a/d53/f80 0 2022-02-02T18:23:09.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/723: symlink d1/dc/de7/df5/lf8 0 2022-02-02T18:23:09.156 INFO:tasks.workunit.client.1.smithi159.stdout:5/742: link d9/d24/d4a/l5a d9/d24/d37/le4 0 2022-02-02T18:23:09.157 INFO:tasks.workunit.client.1.smithi159.stdout:8/724: link d1/dd/d2c/d67/d5f/d8a/cdc d1/dc/de7/cf9 0 2022-02-02T18:23:09.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/725: unlink d1/d26/d48/d99/da5/fa8 0 2022-02-02T18:23:09.162 INFO:tasks.workunit.client.1.smithi159.stdout:8/726: write d1/dd/d1a/f32 [965148,67658] 0 2022-02-02T18:23:09.178 INFO:tasks.workunit.client.1.smithi159.stdout:0/709: dwrite d1/d11/d38/d42/daf/d34/f57 [0,4194304] 0 2022-02-02T18:23:09.179 INFO:tasks.workunit.client.1.smithi159.stdout:1/668: write df/d21/f5c [3332139,127848] 0 2022-02-02T18:23:09.179 INFO:tasks.workunit.client.1.smithi159.stdout:1/669: truncate df/d14/f91 4289598 0 2022-02-02T18:23:09.189 INFO:tasks.workunit.client.1.smithi159.stdout:5/743: dwrite d9/d2e/f53 [0,4194304] 0 2022-02-02T18:23:09.190 INFO:tasks.workunit.client.1.smithi159.stdout:5/744: truncate d9/d2e/dd7/d88/f96 619184 0 2022-02-02T18:23:09.190 INFO:tasks.workunit.client.1.smithi159.stdout:5/745: write d9/d2e/dd7/d3c/daa/fd5 [989131,31869] 0 2022-02-02T18:23:09.190 INFO:tasks.workunit.client.1.smithi159.stdout:5/746: write d9/d2e/db1/fc9 [154023,123288] 0 2022-02-02T18:23:09.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/710: write d1/fe [1586989,77125] 0 2022-02-02T18:23:09.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/711: fsync d1/d11/d38/d42/daf/d34/f64 0 2022-02-02T18:23:09.204 INFO:tasks.workunit.client.1.smithi159.stdout:9/699: creat d4/d19/d1c/d21/da8/fec x:0 0 0 2022-02-02T18:23:09.211 INFO:tasks.workunit.client.1.smithi159.stdout:7/998: creat d3/d5/d56/f154 x:0 0 0 2022-02-02T18:23:09.212 INFO:tasks.workunit.client.1.smithi159.stdout:3/677: symlink dd/d66/d69/db0/dc8/ldb 0 2022-02-02T18:23:09.213 INFO:tasks.workunit.client.1.smithi159.stdout:5/747: dwrite d9/d24/d4a/d8d/d9a/fe1 [0,4194304] 0 2022-02-02T18:23:09.214 INFO:tasks.workunit.client.1.smithi159.stdout:2/898: mkdir da/d40/daf/d134 0 2022-02-02T18:23:09.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/748: symlink d9/d2e/le5 0 2022-02-02T18:23:09.220 INFO:tasks.workunit.client.1.smithi159.stdout:4/640: rename d0/d8/d41/db7/d33/d47/f4e to d0/d8/d15/d61/fd6 0 2022-02-02T18:23:09.221 INFO:tasks.workunit.client.1.smithi159.stdout:5/749: write d9/d24/f93 [928006,75696] 0 2022-02-02T18:23:09.224 INFO:tasks.workunit.client.1.smithi159.stdout:8/727: rename d1/db7/d75/d9d/d9f/fe2 to d1/d26/d48/d49/ffa 0 2022-02-02T18:23:09.227 INFO:tasks.workunit.client.1.smithi159.stdout:0/712: rename d1/d11/d38/d42/c91 to d1/dd/d4b/da7/dc1/cf6 0 2022-02-02T18:23:09.227 INFO:tasks.workunit.client.1.smithi159.stdout:0/713: fsync d1/dd/d4b/da7/dc1/fde 0 2022-02-02T18:23:09.229 INFO:tasks.workunit.client.1.smithi159.stdout:0/714: truncate d1/f10 1004365 0 2022-02-02T18:23:09.229 INFO:tasks.workunit.client.1.smithi159.stdout:0/715: stat d1/d11/d38/d42/daf/d34/f67 0 2022-02-02T18:23:09.230 INFO:tasks.workunit.client.1.smithi159.stdout:6/679: unlink df/d35/d2a/d3f/d42/d47/d59/d66/d88/l7d 0 2022-02-02T18:23:09.230 INFO:tasks.workunit.client.1.smithi159.stdout:3/678: unlink dd/d19/d35/f4c 0 2022-02-02T18:23:09.232 INFO:tasks.workunit.client.1.smithi159.stdout:5/750: rename d9/d2e/dd7/d88/f96 to d9/d2e/dd7/d3c/d8c/dd2/fe6 0 2022-02-02T18:23:09.236 INFO:tasks.workunit.client.1.smithi159.stdout:6/680: dread f7 [0,4194304] 0 2022-02-02T18:23:09.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/751: chown d9/d2e/d71/c79 370865 1 2022-02-02T18:23:09.237 INFO:tasks.workunit.client.1.smithi159.stdout:5/752: write d9/d2e/dd7/d3c/d61/dd6/d68/fb9 [363033,122254] 0 2022-02-02T18:23:09.237 INFO:tasks.workunit.client.1.smithi159.stdout:6/681: write df/d35/d2a/d3f/d65/fba [147257,89289] 0 2022-02-02T18:23:09.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/753: write d9/d24/d4a/d52/f74 [1167489,122065] 0 2022-02-02T18:23:09.240 INFO:tasks.workunit.client.1.smithi159.stdout:5/754: creat d9/d2e/dd7/d3c/d8c/dd2/fe7 x:0 0 0 2022-02-02T18:23:09.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/755: rmdir d9/d24/d4a/d8d 39 2022-02-02T18:23:09.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/756: chown d9/d24/d4a/d91/fae 22 1 2022-02-02T18:23:09.241 INFO:tasks.workunit.client.1.smithi159.stdout:5/757: dread - d9/d2e/dd7/d3c/d8c/dd2/f7f zero size 2022-02-02T18:23:09.241 INFO:tasks.workunit.client.1.smithi159.stdout:1/670: unlink lc 0 2022-02-02T18:23:09.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/700: mkdir d4/d19/d1c/d21/d41/ded 0 2022-02-02T18:23:09.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/701: chown d4/d19/d42/fad 1 1 2022-02-02T18:23:09.243 INFO:tasks.workunit.client.1.smithi159.stdout:0/716: rmdir d1/dd/d4b/da7/dc1 39 2022-02-02T18:23:09.244 INFO:tasks.workunit.client.1.smithi159.stdout:0/717: fsync d1/d11/d38/d7e/f77 0 2022-02-02T18:23:09.244 INFO:tasks.workunit.client.1.smithi159.stdout:6/682: mkdir df/d35/d2a/d3f/d42/d47/d59/d97/dde 0 2022-02-02T18:23:09.247 INFO:tasks.workunit.client.1.smithi159.stdout:8/728: dwrite d1/dd/d1a/f9a [4194304,4194304] 0 2022-02-02T18:23:09.247 INFO:tasks.workunit.client.1.smithi159.stdout:8/729: stat d1/dd/d2c/d67/lac 0 2022-02-02T18:23:09.247 INFO:tasks.workunit.client.1.smithi159.stdout:9/702: write d4/d19/d1c/d21/d95/f62 [413715,85183] 0 2022-02-02T18:23:09.248 INFO:tasks.workunit.client.1.smithi159.stdout:3/679: rename dd/d66/d69/fa7 to dd/d66/d92/fdc 0 2022-02-02T18:23:09.249 INFO:tasks.workunit.client.1.smithi159.stdout:1/671: link df/d21/d23/l79 df/d14/d16/d4a/df3/lf4 0 2022-02-02T18:23:09.250 INFO:tasks.workunit.client.1.smithi159.stdout:8/730: write d1/dd/d1a/d53/f6b [734846,58255] 0 2022-02-02T18:23:09.250 INFO:tasks.workunit.client.1.smithi159.stdout:5/758: rename d9/d24/d21/f80 to d9/d2e/dd7/d3c/daa/fe8 0 2022-02-02T18:23:09.250 INFO:tasks.workunit.client.1.smithi159.stdout:5/759: creat d9/d2e/db1/fe9 x:0 0 0 2022-02-02T18:23:09.251 INFO:tasks.workunit.client.1.smithi159.stdout:9/703: chown d4/d2a/l4b 235278318 1 2022-02-02T18:23:09.251 INFO:tasks.workunit.client.1.smithi159.stdout:9/704: write d4/f10 [3430062,127560] 0 2022-02-02T18:23:09.252 INFO:tasks.workunit.client.1.smithi159.stdout:3/680: creat dd/d19/d38/d3f/d80/fdd x:0 0 0 2022-02-02T18:23:09.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/731: mkdir d1/db7/d75/de8/dfb 0 2022-02-02T18:23:09.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/732: fsync d1/dd/d2c/df6/dca/fd8 0 2022-02-02T18:23:09.253 INFO:tasks.workunit.client.1.smithi159.stdout:9/705: creat d4/d19/d1c/d1f/fee x:0 0 0 2022-02-02T18:23:09.253 INFO:tasks.workunit.client.1.smithi159.stdout:5/760: rmdir d9 39 2022-02-02T18:23:09.254 INFO:tasks.workunit.client.1.smithi159.stdout:3/681: symlink dd/d66/d82/db6/lde 0 2022-02-02T18:23:09.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/706: write d4/d19/d1c/d21/d56/d59/fcf [1268692,42974] 0 2022-02-02T18:23:09.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/718: rename d1/d11/d38/d42/daf/c8f to d1/d11/d38/d94/dd7/de6/cf7 0 2022-02-02T18:23:09.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/719: dread - d1/dd/d4b/da7/da8/fdc zero size 2022-02-02T18:23:09.256 INFO:tasks.workunit.client.1.smithi159.stdout:3/682: creat dd/d19/d38/d3f/d80/fdf x:0 0 0 2022-02-02T18:23:09.256 INFO:tasks.workunit.client.1.smithi159.stdout:3/683: chown dd/d66/d69/db0/dc8/ld7 8 1 2022-02-02T18:23:09.256 INFO:tasks.workunit.client.1.smithi159.stdout:3/684: dread - dd/d66/d92/fc7 zero size 2022-02-02T18:23:09.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/720: write d1/dd/d4b/da7/da8/fc6 [247562,111477] 0 2022-02-02T18:23:09.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/721: fdatasync d1/d11/d38/d42/daf/d34/f67 0 2022-02-02T18:23:09.257 INFO:tasks.workunit.client.1.smithi159.stdout:1/672: rename fe to df/d14/d16/d4b/dcc/dde/ff5 0 2022-02-02T18:23:09.259 INFO:tasks.workunit.client.1.smithi159.stdout:5/761: fdatasync d9/d24/d21/f78 0 2022-02-02T18:23:09.259 INFO:tasks.workunit.client.1.smithi159.stdout:5/762: dread - d9/d2e/dd7/d3c/d8c/dd2/f6e zero size 2022-02-02T18:23:09.259 INFO:tasks.workunit.client.1.smithi159.stdout:8/733: write d1/dd/d1a/d53/f54 [46668,33120] 0 2022-02-02T18:23:09.260 INFO:tasks.workunit.client.1.smithi159.stdout:0/722: rmdir d1/dd 39 2022-02-02T18:23:09.260 INFO:tasks.workunit.client.1.smithi159.stdout:0/723: chown d1/d11/d38/f4c 78 1 2022-02-02T18:23:09.261 INFO:tasks.workunit.client.1.smithi159.stdout:1/673: rename df/d21/d23/d49/d69/d6c/cb2 to df/d21/d23/d49/d82/d87/cf6 0 2022-02-02T18:23:09.261 INFO:tasks.workunit.client.1.smithi159.stdout:1/674: creat df/d21/d23/d49/da1/dac/ff7 x:0 0 0 2022-02-02T18:23:09.261 INFO:tasks.workunit.client.1.smithi159.stdout:1/675: dread - df/d21/d23/d49/d82/d87/fcb zero size 2022-02-02T18:23:09.262 INFO:tasks.workunit.client.1.smithi159.stdout:1/676: truncate df/d14/d16/da8/fe5 723110 0 2022-02-02T18:23:09.262 INFO:tasks.workunit.client.1.smithi159.stdout:5/763: symlink d9/d24/d4a/d8d/d9a/lea 0 2022-02-02T18:23:09.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/677: write df/d14/d16/d4b/da0/fa2 [754979,99350] 0 2022-02-02T18:23:09.273 INFO:tasks.workunit.client.1.smithi159.stdout:0/724: creat d1/dd/d4b/d7d/ff8 x:0 0 0 2022-02-02T18:23:09.281 INFO:tasks.workunit.client.1.smithi159.stdout:1/678: getdents df/d14/d68 0 2022-02-02T18:23:09.282 INFO:tasks.workunit.client.1.smithi159.stdout:0/725: mkdir d1/d11/d38/d42/df9 0 2022-02-02T18:23:09.284 INFO:tasks.workunit.client.1.smithi159.stdout:1/679: creat df/d21/dce/ff8 x:0 0 0 2022-02-02T18:23:09.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/726: link d1/d19/lc5 d1/d11/d38/d42/df9/lfa 0 2022-02-02T18:23:09.285 INFO:tasks.workunit.client.1.smithi159.stdout:0/727: write d1/d11/d38/d94/fae [374918,77684] 0 2022-02-02T18:23:09.285 INFO:tasks.workunit.client.1.smithi159.stdout:1/680: chown df/d21/d23/l2d 33800007 1 2022-02-02T18:23:09.299 INFO:tasks.workunit.client.1.smithi159.stdout:8/734: dwrite d1/dd/d1a/d53/f72 [0,4194304] 0 2022-02-02T18:23:09.301 INFO:tasks.workunit.client.1.smithi159.stdout:8/735: symlink d1/dad/lfc 0 2022-02-02T18:23:09.302 INFO:tasks.workunit.client.1.smithi159.stdout:8/736: stat d1/dd/c40 0 2022-02-02T18:23:09.302 INFO:tasks.workunit.client.1.smithi159.stdout:8/737: chown d1/d26/d48/d99 4006 1 2022-02-02T18:23:09.310 INFO:tasks.workunit.client.1.smithi159.stdout:3/685: dwrite dd/d20/f64 [0,4194304] 0 2022-02-02T18:23:09.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/707: dwrite d4/d19/f76 [0,4194304] 0 2022-02-02T18:23:09.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/708: write d4/d19/d1c/fdc [422836,52577] 0 2022-02-02T18:23:09.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/709: fsync d4/d2a/f9d 0 2022-02-02T18:23:09.311 INFO:tasks.workunit.client.1.smithi159.stdout:9/710: write d4/d19/d6f/d78/fa7 [76383,1041] 0 2022-02-02T18:23:09.311 INFO:tasks.workunit.client.1.smithi159.stdout:9/711: write d4/d2a/fa9 [1020404,13607] 0 2022-02-02T18:23:09.312 INFO:tasks.workunit.client.1.smithi159.stdout:9/712: write d4/d7a/db7/fb8 [77247,3691] 0 2022-02-02T18:23:09.312 INFO:tasks.workunit.client.1.smithi159.stdout:9/713: fdatasync d4/d19/d1c/d1f/f3c 0 2022-02-02T18:23:09.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/686: write dd/d19/d38/d3f/d80/d8a/f9f [390031,85220] 0 2022-02-02T18:23:09.313 INFO:tasks.workunit.client.1.smithi159.stdout:3/687: chown dd/d19/d38/d3f/d80/fdd 1 1 2022-02-02T18:23:09.313 INFO:tasks.workunit.client.1.smithi159.stdout:9/714: link d4/d7a/dbc/cc3 d4/d19/d6f/cef 0 2022-02-02T18:23:09.313 INFO:tasks.workunit.client.1.smithi159.stdout:9/715: truncate d4/d19/f57 1569209 0 2022-02-02T18:23:09.314 INFO:tasks.workunit.client.1.smithi159.stdout:3/688: creat dd/d19/d38/d3f/dd1/fe0 x:0 0 0 2022-02-02T18:23:09.314 INFO:tasks.workunit.client.1.smithi159.stdout:3/689: chown dd/d66/f9b 904 1 2022-02-02T18:23:09.316 INFO:tasks.workunit.client.1.smithi159.stdout:3/690: write dd/d66/d69/f84 [2404454,125268] 0 2022-02-02T18:23:09.317 INFO:tasks.workunit.client.1.smithi159.stdout:6/683: dwrite df/f14 [4194304,4194304] 0 2022-02-02T18:23:09.317 INFO:tasks.workunit.client.1.smithi159.stdout:3/691: write dd/d19/d35/f99 [287577,37350] 0 2022-02-02T18:23:09.318 INFO:tasks.workunit.client.1.smithi159.stdout:9/716: rename d4/d7a/db7/f6b to d4/d7a/db7/ff0 0 2022-02-02T18:23:09.318 INFO:tasks.workunit.client.1.smithi159.stdout:3/692: dread dd/d66/f9b [0,4194304] 0 2022-02-02T18:23:09.319 INFO:tasks.workunit.client.1.smithi159.stdout:1/681: dwrite df/d14/d16/d4b/da0/fc2 [0,4194304] 0 2022-02-02T18:23:09.320 INFO:tasks.workunit.client.1.smithi159.stdout:6/684: dread df/d35/d2a/d2f/f68 [0,4194304] 0 2022-02-02T18:23:09.320 INFO:tasks.workunit.client.1.smithi159.stdout:0/728: dwrite d1/d19/f39 [0,4194304] 0 2022-02-02T18:23:09.321 INFO:tasks.workunit.client.1.smithi159.stdout:0/729: fdatasync d1/dd/f4f 0 2022-02-02T18:23:09.324 INFO:tasks.workunit.client.1.smithi159.stdout:0/730: unlink d1/d11/d38/d42/ff0 0 2022-02-02T18:23:09.324 INFO:tasks.workunit.client.1.smithi159.stdout:0/731: creat d1/d11/d38/d7e/ffb x:0 0 0 2022-02-02T18:23:09.325 INFO:tasks.workunit.client.1.smithi159.stdout:0/732: fdatasync d1/dd/d4b/da7/fe1 0 2022-02-02T18:23:09.325 INFO:tasks.workunit.client.1.smithi159.stdout:0/733: readlink d1/dd/d4b/ddd/lec 0 2022-02-02T18:23:09.338 INFO:tasks.workunit.client.1.smithi159.stdout:9/717: creat d4/d19/ff1 x:0 0 0 2022-02-02T18:23:09.338 INFO:tasks.workunit.client.1.smithi159.stdout:9/718: fdatasync d4/d7a/db7/f86 0 2022-02-02T18:23:09.338 INFO:tasks.workunit.client.1.smithi159.stdout:9/719: readlink d4/d19/d6f/d74/db1/ld4 0 2022-02-02T18:23:09.339 INFO:tasks.workunit.client.1.smithi159.stdout:9/720: stat d4/d19/d1c/d21/d41/f68 0 2022-02-02T18:23:09.351 INFO:tasks.workunit.client.1.smithi159.stdout:6/685: link df/d35/d2a/d3f/d42/d47/cbb df/d35/d2a/d3f/d42/cdf 0 2022-02-02T18:23:09.378 INFO:tasks.workunit.client.1.smithi159.stdout:9/721: dwrite d4/d7a/db7/ff0 [0,4194304] 0 2022-02-02T18:23:09.393 INFO:tasks.workunit.client.1.smithi159.stdout:9/722: mkdir d4/d2a/df2 0 2022-02-02T18:23:09.393 INFO:tasks.workunit.client.1.smithi159.stdout:9/723: write d4/d19/d1c/d1f/f24 [743161,43048] 0 2022-02-02T18:23:09.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/724: write d4/d19/d1c/d1f/f20 [1881742,97400] 0 2022-02-02T18:23:09.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/725: truncate d4/f96 2779555 0 2022-02-02T18:23:09.412 INFO:tasks.workunit.client.1.smithi159.stdout:7/999: write d3/d2a/f55 [723681,121120] 0 2022-02-02T18:23:09.429 INFO:tasks.workunit.client.1.smithi159.stdout:2/899: unlink da/d1c/d42/d70/ff7 0 2022-02-02T18:23:09.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/726: write d4/f11 [61766,63239] 0 2022-02-02T18:23:09.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/727: chown d4/d19/d1c/fca 237113812 1 2022-02-02T18:23:09.431 INFO:tasks.workunit.client.1.smithi159.stdout:2/900: write da/d1c/d42/fb9 [2933496,73107] 0 2022-02-02T18:23:09.431 INFO:tasks.workunit.client.1.smithi159.stdout:2/901: readlink da/d48/d6d/d3e/l85 0 2022-02-02T18:23:09.432 INFO:tasks.workunit.client.1.smithi159.stdout:2/902: truncate da/d1c/d25/d73/f12e 733499 0 2022-02-02T18:23:09.432 INFO:tasks.workunit.client.1.smithi159.stdout:9/728: mknod d4/d19/d6f/d74/db1/dc7/dc8/cf3 0 2022-02-02T18:23:09.434 INFO:tasks.workunit.client.1.smithi159.stdout:9/729: truncate d4/d19/d1c/d1f/f30 228687 0 2022-02-02T18:23:09.434 INFO:tasks.workunit.client.1.smithi159.stdout:9/730: write d4/d19/d1c/fdc [1404799,110824] 0 2022-02-02T18:23:09.436 INFO:tasks.workunit.client.1.smithi159.stdout:9/731: readlink d4/d19/d42/l47 0 2022-02-02T18:23:09.436 INFO:tasks.workunit.client.1.smithi159.stdout:9/732: stat d4/d2a/c99 0 2022-02-02T18:23:09.436 INFO:tasks.workunit.client.1.smithi159.stdout:9/733: write d4/d2a/fa9 [1084155,62058] 0 2022-02-02T18:23:09.457 INFO:tasks.workunit.client.1.smithi159.stdout:2/903: dwrite da/d1c/f5b [4194304,4194304] 0 2022-02-02T18:23:09.458 INFO:tasks.workunit.client.1.smithi159.stdout:9/734: dwrite d4/d19/d1c/d21/d41/fbf [0,4194304] 0 2022-02-02T18:23:09.469 INFO:tasks.workunit.client.1.smithi159.stdout:9/735: dread d4/d19/d42/fad [0,4194304] 0 2022-02-02T18:23:09.475 INFO:tasks.workunit.client.1.smithi159.stdout:2/904: rename da/d1c/d42/d70/dec to da/d40/daf/d134/d135 0 2022-02-02T18:23:09.479 INFO:tasks.workunit.client.1.smithi159.stdout:9/736: dread d4/d2a/f6e [0,4194304] 0 2022-02-02T18:23:09.480 INFO:tasks.workunit.client.1.smithi159.stdout:9/737: creat d4/d19/d6f/ff4 x:0 0 0 2022-02-02T18:23:09.480 INFO:tasks.workunit.client.1.smithi159.stdout:9/738: write d4/d19/d1c/d21/d95/f82 [247421,79850] 0 2022-02-02T18:23:09.499 INFO:tasks.workunit.client.1.smithi159.stdout:9/739: dwrite d4/d2a/d87/fcb [0,4194304] 0 2022-02-02T18:23:09.501 INFO:tasks.workunit.client.1.smithi159.stdout:9/740: creat d4/d19/ff5 x:0 0 0 2022-02-02T18:23:09.502 INFO:tasks.workunit.client.1.smithi159.stdout:2/905: dwrite da/d40/daf/fda [0,4194304] 0 2022-02-02T18:23:09.502 INFO:tasks.workunit.client.1.smithi159.stdout:2/906: chown da/d1c/dd7/f126 0 1 2022-02-02T18:23:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.068496+0000 mon.smithi096 (mon.0) 743 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: cluster 2022-02-02T18:23:08.545042+0000 mgr.smithi096.shfutl (mgr.14628) 27 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 228 op/s 2022-02-02T18:23:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: cluster 2022-02-02T18:23:08.688762+0000 mon.smithi096 (mon.0) 744 : cluster [DBG] Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: cluster 2022-02-02T18:23:08.688884+0000 mon.smithi096 (mon.0) 745 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.690860+0000 mon.smithi096 (mon.0) 746 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:23:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.691376+0000 mon.smithi096 (mon.0) 747 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:23:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.693370+0000 mon.smithi096 (mon.0) 748 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:23:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.694261+0000 mon.smithi096 (mon.0) 749 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:23:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:09 smithi159 conmon[35668]: audit 2022-02-02T18:23:08.903278+0000 mon.smithi096 (mon.0) 750 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:09.535 INFO:tasks.workunit.client.1.smithi159.stdout:2/907: dwrite da/d48/d6d/f92 [0,4194304] 0 2022-02-02T18:23:09.535 INFO:tasks.workunit.client.1.smithi159.stdout:2/908: stat da/d40/d61/d6c/f122 0 2022-02-02T18:23:09.536 INFO:tasks.workunit.client.1.smithi159.stdout:9/741: dwrite d4/d19/d6f/d74/f8f [0,4194304] 0 2022-02-02T18:23:09.536 INFO:tasks.workunit.client.1.smithi159.stdout:9/742: creat d4/d19/d1c/d21/d41/d9a/de6/ff6 x:0 0 0 2022-02-02T18:23:09.537 INFO:tasks.workunit.client.1.smithi159.stdout:9/743: creat d4/d19/d1c/d1f/ff7 x:0 0 0 2022-02-02T18:23:09.537 INFO:tasks.workunit.client.1.smithi159.stdout:2/909: mknod da/d40/daf/c136 0 2022-02-02T18:23:09.540 INFO:tasks.workunit.client.1.smithi159.stdout:2/910: rename da/d1c/d47/d6b/d5a/d7e/d111 to da/d1c/d47/d6b/d137 0 2022-02-02T18:23:09.541 INFO:tasks.workunit.client.1.smithi159.stdout:2/911: mknod da/d1c/d76/c138 0 2022-02-02T18:23:09.552 INFO:tasks.workunit.client.1.smithi159.stdout:2/912: dread da/d40/daf/fda [0,4194304] 0 2022-02-02T18:23:09.555 INFO:tasks.workunit.client.1.smithi159.stdout:2/913: rename da/d40/d61 to da/d1c/d42/d139 0 2022-02-02T18:23:09.556 INFO:tasks.workunit.client.1.smithi159.stdout:2/914: stat da/d48/d6d/f99 0 2022-02-02T18:23:09.556 INFO:tasks.workunit.client.1.smithi159.stdout:2/915: chown da/d48/d6d/d3e/f9c 38 1 2022-02-02T18:23:09.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/916: creat da/d1c/d47/d6b/d137/f13a x:0 0 0 2022-02-02T18:23:09.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/917: chown da/d1c/d25/l10f 0 1 2022-02-02T18:23:09.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022-02-02T18:23:08.068496+0000 mon.smithi096 (mon.0) 743 : audit 2022-02-02T18:23:09.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: cluster 2022-02-02T18:23:08.545042+0000 mgr.smithi096.shfutl (mgr.14628) 27 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 228 op/s 2022-02-02T18:23:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: cluster 2022-02 2022-02-02T18:23:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: -02T18:23:08.688762 2022-02-02T18:23:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: +0000 mon.smithi096 (mon.0) 744 : 2022-02-02T18:23:09.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: cluster [DBG] Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:09.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: cluster 2022-02-02T18:23:09.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: 2022-02-02T18:23: 2022-02-02T18:23:09.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: 08.688884+0000 mon.smithi096 (mon.0) 745 : 2022-02-02T18:23:09.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:09.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022- 2022-02-02T18:23:09.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: 02-02T18:23:08.690860+0000 2022-02-02T18:23:09.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: mon.smithi096 (mon.0) 746 : audit 2022-02-02T18:23:09.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:23:09.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022-02-02 2022-02-02T18:23:09.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: T18:23:08.691376+0000 mon.smithi096 (mon. 2022-02-02T18:23:09.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: 0) 747 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:23:09.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022-02 2022-02-02T18:23:09.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: -02T18:23:08.693370+0000 mon.smithi096 2022-02-02T18:23:09.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: (mon.0) 748 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:23:09.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022 2022-02-02T18:23:09.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: -02-02T18:23:08 2022-02-02T18:23:09.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: .694261+0000 mon.smithi096 (mon.0) 749 : audit [DBG] from='mgr.? 172.21.15.159:0/2814419765' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:23:09.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: audit 2022-02-02T18:23:08.903278+0000 2022-02-02T18:23:09.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:09 smithi096 conmon[32067]: mon.smithi096 (mon.0) 750 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:09.565 INFO:tasks.workunit.client.1.smithi159.stdout:9/744: dwrite d4/d19/f31 [0,4194304] 0 2022-02-02T18:23:09.566 INFO:tasks.workunit.client.1.smithi159.stdout:9/745: readlink d4/d19/d1c/d21/d56/la4 0 2022-02-02T18:23:09.566 INFO:tasks.workunit.client.1.smithi159.stdout:2/918: symlink da/d1c/d47/dc7/l13b 0 2022-02-02T18:23:09.566 INFO:tasks.workunit.client.1.smithi159.stdout:9/746: mknod d4/d19/d1c/d21/cf8 0 2022-02-02T18:23:09.567 INFO:tasks.workunit.client.1.smithi159.stdout:2/919: creat da/d1c/d42/d70/f13c x:0 0 0 2022-02-02T18:23:09.567 INFO:tasks.workunit.client.1.smithi159.stdout:2/920: write da/d1c/d47/d6b/d59/fa2 [506059,97258] 0 2022-02-02T18:23:09.567 INFO:tasks.workunit.client.1.smithi159.stdout:2/921: chown da/d1c/d25/d73/ff0 19052 1 2022-02-02T18:23:09.567 INFO:tasks.workunit.client.1.smithi159.stdout:9/747: symlink d4/d19/d1c/d21/d56/d59/lf9 0 2022-02-02T18:23:09.568 INFO:tasks.workunit.client.1.smithi159.stdout:2/922: link da/d48/d6d/d3e/fad da/d1c/d76/f13d 0 2022-02-02T18:23:09.568 INFO:tasks.workunit.client.1.smithi159.stdout:9/748: getdents d4/d2a 0 2022-02-02T18:23:09.568 INFO:tasks.workunit.client.1.smithi159.stdout:2/923: truncate da/d40/daf/d134/d135/f125 440718 0 2022-02-02T18:23:09.568 INFO:tasks.workunit.client.1.smithi159.stdout:9/749: symlink d4/d19/d1c/d21/d56/d59/lfa 0 2022-02-02T18:23:09.568 INFO:tasks.workunit.client.1.smithi159.stdout:2/924: creat da/d48/d83/f13e x:0 0 0 2022-02-02T18:23:09.569 INFO:tasks.workunit.client.1.smithi159.stdout:9/750: link d4/d19/d6f/d74/db1/dc7/dc8/cd6 d4/d19/d1c/d21/d95/cfb 0 2022-02-02T18:23:09.571 INFO:tasks.workunit.client.1.smithi159.stdout:2/925: dread da/d40/f88 [0,4194304] 0 2022-02-02T18:23:09.573 INFO:tasks.workunit.client.1.smithi159.stdout:2/926: unlink da/d1c/d25/d73/dab/db5/fd5 0 2022-02-02T18:23:09.574 INFO:tasks.workunit.client.1.smithi159.stdout:2/927: rename da/d1c/f26 to da/d48/d83/dff/f13f 0 2022-02-02T18:23:09.575 INFO:tasks.workunit.client.1.smithi159.stdout:2/928: mknod da/d1c/d47/d6b/d7c/c140 0 2022-02-02T18:23:09.580 INFO:tasks.workunit.client.1.smithi159.stdout:9/751: dwrite d4/d19/d1c/d1f/d90/fe4 [0,4194304] 0 2022-02-02T18:23:09.583 INFO:tasks.workunit.client.1.smithi159.stdout:9/752: unlink d4/d19/d1c/d21/d56/f9e 0 2022-02-02T18:23:09.604 INFO:tasks.workunit.client.1.smithi159.stdout:9/753: dwrite d4/d19/d42/fad [4194304,4194304] 0 2022-02-02T18:23:09.605 INFO:tasks.workunit.client.1.smithi159.stdout:9/754: chown d4/d2a/c32 546755 1 2022-02-02T18:23:09.607 INFO:tasks.workunit.client.1.smithi159.stdout:9/755: rmdir d4/d19/d6f/d74/db1 39 2022-02-02T18:23:09.613 INFO:tasks.workunit.client.1.smithi159.stdout:9/756: dread d4/d19/d1c/fca [0,4194304] 0 2022-02-02T18:23:09.614 INFO:tasks.workunit.client.1.smithi159.stdout:9/757: dread d4/d19/d1c/d21/f45 [0,4194304] 0 2022-02-02T18:23:09.615 INFO:tasks.workunit.client.1.smithi159.stdout:9/758: write d4/f11 [7180665,46837] 0 2022-02-02T18:23:09.620 INFO:tasks.workunit.client.1.smithi159.stdout:9/759: write d4/d19/d1c/d21/d22/d55/f6c [585931,50347] 0 2022-02-02T18:23:09.620 INFO:tasks.workunit.client.1.smithi159.stdout:9/760: symlink d4/d19/d1c/d21/d41/ded/lfc 0 2022-02-02T18:23:09.621 INFO:tasks.workunit.client.1.smithi159.stdout:9/761: mkdir d4/d19/d1c/d21/d41/d9a/de6/dfd 0 2022-02-02T18:23:09.622 INFO:tasks.workunit.client.1.smithi159.stdout:9/762: stat d4/d19/d6f/d74/db1/fb5 0 2022-02-02T18:23:09.622 INFO:tasks.workunit.client.1.smithi159.stdout:9/763: dread - d4/d19/ff1 zero size 2022-02-02T18:23:09.635 INFO:tasks.workunit.client.1.smithi159.stdout:9/764: dwrite d4/d19/d1c/f7e [0,4194304] 0 2022-02-02T18:23:09.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/765: symlink d4/d19/d1c/d1f/lfe 0 2022-02-02T18:23:09.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/766: symlink d4/d19/d1c/d21/d41/d9a/lff 0 2022-02-02T18:23:09.648 INFO:tasks.workunit.client.1.smithi159.stdout:9/767: dread d4/d19/f76 [0,4194304] 0 2022-02-02T18:23:09.650 INFO:tasks.workunit.client.1.smithi159.stdout:9/768: unlink d4/d19/d42/l47 0 2022-02-02T18:23:09.651 INFO:tasks.workunit.client.1.smithi159.stdout:9/769: symlink d4/d19/d1c/d1f/d90/l100 0 2022-02-02T18:23:09.655 INFO:tasks.workunit.client.1.smithi159.stdout:9/770: getdents d4/d19/d1c/d1f 0 2022-02-02T18:23:09.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/771: creat d4/d19/d1c/d21/f101 x:0 0 0 2022-02-02T18:23:09.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/772: readlink d4/d19/d1c/d21/d41/d9a/lff 0 2022-02-02T18:23:09.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/773: mknod d4/d19/d1c/d21/d41/ded/c102 0 2022-02-02T18:23:09.660 INFO:tasks.workunit.client.1.smithi159.stdout:9/774: chown d4/d19/d1c/d1f/f24 12386 1 2022-02-02T18:23:09.660 INFO:tasks.workunit.client.1.smithi159.stdout:9/775: write d4/d7a/db7/ff0 [106496,102891] 0 2022-02-02T18:23:09.678 INFO:tasks.workunit.client.1.smithi159.stdout:9/776: dwrite d4/d19/d1c/d1f/fee [0,4194304] 0 2022-02-02T18:23:09.680 INFO:tasks.workunit.client.1.smithi159.stdout:9/777: creat d4/d19/d1c/d21/d56/d59/f103 x:0 0 0 2022-02-02T18:23:09.680 INFO:tasks.workunit.client.1.smithi159.stdout:9/778: fdatasync d4/d2a/f9d 0 2022-02-02T18:23:09.681 INFO:tasks.workunit.client.1.smithi159.stdout:9/779: truncate d4/d19/d1c/d1f/f72 3004616 0 2022-02-02T18:23:09.691 INFO:tasks.workunit.client.1.smithi159.stdout:9/780: write d4/d7a/fb2 [1339009,118804] 0 2022-02-02T18:23:09.710 INFO:tasks.workunit.client.1.smithi159.stdout:9/781: dwrite d4/d19/d1c/d21/d56/d59/f7d [0,4194304] 0 2022-02-02T18:23:09.956 INFO:tasks.workunit.client.1.smithi159.stdout:0/734: sync 2022-02-02T18:23:09.957 INFO:tasks.workunit.client.1.smithi159.stdout:4/641: sync 2022-02-02T18:23:09.957 INFO:tasks.workunit.client.1.smithi159.stdout:3/693: sync 2022-02-02T18:23:09.957 INFO:tasks.workunit.client.1.smithi159.stdout:8/738: sync 2022-02-02T18:23:09.957 INFO:tasks.workunit.client.1.smithi159.stdout:5/764: sync 2022-02-02T18:23:09.958 INFO:tasks.workunit.client.1.smithi159.stdout:6/686: sync 2022-02-02T18:23:09.958 INFO:tasks.workunit.client.1.smithi159.stdout:1/682: sync 2022-02-02T18:23:09.958 INFO:tasks.workunit.client.1.smithi159.stdout:0/735: stat d1/dd/d4b/da7/fe1 0 2022-02-02T18:23:09.958 INFO:tasks.workunit.client.1.smithi159.stdout:5/765: write d9/d2e/dd7/d3c/d61/dd6/d68/fb9 [415296,125039] 0 2022-02-02T18:23:09.959 INFO:tasks.workunit.client.1.smithi159.stdout:5/766: read - d9/d24/d4a/d52/fd9 zero size 2022-02-02T18:23:09.959 INFO:tasks.workunit.client.1.smithi159.stdout:0/736: creat d1/dd/ffc x:0 0 0 2022-02-02T18:23:09.960 INFO:tasks.workunit.client.1.smithi159.stdout:8/739: creat d1/db7/d75/de8/ffd x:0 0 0 2022-02-02T18:23:09.960 INFO:tasks.workunit.client.1.smithi159.stdout:1/683: mkdir df/d14/d16/df9 0 2022-02-02T18:23:09.962 INFO:tasks.workunit.client.1.smithi159.stdout:5/767: rename d9/d2e/dd7/d3c/d61/dd6/f6f to d9/feb 0 2022-02-02T18:23:09.962 INFO:tasks.workunit.client.1.smithi159.stdout:5/768: truncate d9/d2e/db1/fe9 27588 0 2022-02-02T18:23:09.963 INFO:tasks.workunit.client.1.smithi159.stdout:1/684: symlink df/d21/d23/d49/da1/dac/lfa 0 2022-02-02T18:23:09.964 INFO:tasks.workunit.client.1.smithi159.stdout:1/685: rmdir df/d14/d16/d4a/d8b 39 2022-02-02T18:23:09.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/686: fdatasync df/d21/f54 0 2022-02-02T18:23:09.965 INFO:tasks.workunit.client.1.smithi159.stdout:0/737: dread d1/d11/f35 [0,4194304] 0 2022-02-02T18:23:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:6/687: dread df/d35/d2a/d2f/fa0 [0,4194304] 0 2022-02-02T18:23:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:1/687: mkdir df/d14/d16/d4b/dcc/dde/dfb 0 2022-02-02T18:23:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:1/688: creat df/ffc x:0 0 0 2022-02-02T18:23:09.968 INFO:tasks.workunit.client.1.smithi159.stdout:1/689: chown df/d14/f57 241226791 1 2022-02-02T18:23:09.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/738: symlink d1/dd/d4b/d7d/lfd 0 2022-02-02T18:23:09.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/739: chown d1/d11/d38/d42/d47/db0/fcc 25305053 1 2022-02-02T18:23:09.969 INFO:tasks.workunit.client.1.smithi159.stdout:0/740: creat d1/d11/d38/d42/d47/db0/ffe x:0 0 0 2022-02-02T18:23:09.969 INFO:tasks.workunit.client.1.smithi159.stdout:0/741: chown d1/dd/ca4 6483 1 2022-02-02T18:23:09.970 INFO:tasks.workunit.client.1.smithi159.stdout:0/742: dread - d1/d11/d38/d7e/fe9 zero size 2022-02-02T18:23:09.970 INFO:tasks.workunit.client.1.smithi159.stdout:1/690: mknod df/d14/d16/df9/cfd 0 2022-02-02T18:23:09.971 INFO:tasks.workunit.client.1.smithi159.stdout:0/743: truncate d1/d11/d38/d42/fee 1291324 0 2022-02-02T18:23:09.971 INFO:tasks.workunit.client.1.smithi159.stdout:0/744: truncate d1/dd/d4b/da7/fe1 317582 0 2022-02-02T18:23:09.971 INFO:tasks.workunit.client.1.smithi159.stdout:6/688: rename df/d35/f36 to df/d35/d2a/d3f/d42/d47/d59/fe0 0 2022-02-02T18:23:09.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/691: creat df/d14/d16/d4a/df3/ffe x:0 0 0 2022-02-02T18:23:09.975 INFO:tasks.workunit.client.1.smithi159.stdout:3/694: dread f7 [0,4194304] 0 2022-02-02T18:23:09.976 INFO:tasks.workunit.client.1.smithi159.stdout:5/769: dread d9/d2e/dd7/d3c/daa/fd5 [0,4194304] 0 2022-02-02T18:23:09.976 INFO:tasks.workunit.client.1.smithi159.stdout:5/770: fsync d9/d2e/dd7/d3c/d8c/fb5 0 2022-02-02T18:23:09.978 INFO:tasks.workunit.client.1.smithi159.stdout:1/692: mkdir df/d14/d16/d4a/d8b/dff 0 2022-02-02T18:23:09.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/695: rename dd/d66/d92/c3b to dd/d19/d38/d3f/ce1 0 2022-02-02T18:23:09.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/696: getdents dd/d66/d82/dd4/dd9 0 2022-02-02T18:23:09.991 INFO:tasks.workunit.client.1.smithi159.stdout:4/642: dwrite d0/d8/d41/f4d [0,4194304] 0 2022-02-02T18:23:09.991 INFO:tasks.workunit.client.1.smithi159.stdout:4/643: dread - d0/d8/d24/d4f/fa8 zero size 2022-02-02T18:23:09.991 INFO:tasks.workunit.client.1.smithi159.stdout:1/693: dread df/d14/d16/d6d/f90 [0,4194304] 0 2022-02-02T18:23:09.991 INFO:tasks.workunit.client.1.smithi159.stdout:1/694: fsync df/d21/f5c 0 2022-02-02T18:23:09.997 INFO:tasks.workunit.client.1.smithi159.stdout:3/697: write dd/d66/fb7 [2006601,68106] 0 2022-02-02T18:23:09.998 INFO:tasks.workunit.client.1.smithi159.stdout:3/698: mknod dd/d66/d82/dd4/dd9/ce2 0 2022-02-02T18:23:09.999 INFO:tasks.workunit.client.1.smithi159.stdout:3/699: write dd/d19/d38/d3f/d52/fcf [465154,97735] 0 2022-02-02T18:23:10.000 INFO:tasks.workunit.client.1.smithi159.stdout:3/700: symlink dd/d66/d82/db6/le3 0 2022-02-02T18:23:10.004 INFO:tasks.workunit.client.1.smithi159.stdout:3/701: write dd/d20/d2a/f4a [592740,52466] 0 2022-02-02T18:23:10.005 INFO:tasks.workunit.client.1.smithi159.stdout:6/689: dwrite df/d35/d7b/db4/d84/d9d/fbe [0,4194304] 0 2022-02-02T18:23:10.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/690: chown df/d35/d2a/d2f/d80/d61/da8/fc4 1401734 1 2022-02-02T18:23:10.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/691: stat df/d35/d7b/db4/d84/d9d/fd3 0 2022-02-02T18:23:10.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/692: stat df/d35/d2a/d3f/d42/d47/d59/d97/la9 0 2022-02-02T18:23:10.007 INFO:tasks.workunit.client.1.smithi159.stdout:3/702: mknod dd/d66/da1/ce4 0 2022-02-02T18:23:10.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/693: truncate f3 3365344 0 2022-02-02T18:23:10.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/694: chown df/d35/d2a/d3f/d42/d47/l4c 3 1 2022-02-02T18:23:10.010 INFO:tasks.workunit.client.1.smithi159.stdout:8/740: dwrite d1/dd/d2c/f42 [0,4194304] 0 2022-02-02T18:23:10.011 INFO:tasks.workunit.client.1.smithi159.stdout:1/695: dwrite df/d14/d16/d4b/fd3 [0,4194304] 0 2022-02-02T18:23:10.011 INFO:tasks.workunit.client.1.smithi159.stdout:1/696: dread - df/d21/d23/fb1 zero size 2022-02-02T18:23:10.012 INFO:tasks.workunit.client.1.smithi159.stdout:5/771: dwrite d9/f99 [0,4194304] 0 2022-02-02T18:23:10.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/745: dwrite d1/d11/d38/d42/daf/f52 [4194304,4194304] 0 2022-02-02T18:23:10.013 INFO:tasks.workunit.client.1.smithi159.stdout:8/741: creat d1/dad/d95/daa/ffe x:0 0 0 2022-02-02T18:23:10.013 INFO:tasks.workunit.client.1.smithi159.stdout:8/742: fsync d1/dd/d1a/d53/f72 0 2022-02-02T18:23:10.014 INFO:tasks.workunit.client.1.smithi159.stdout:5/772: creat d9/d2e/dd7/d88/fec x:0 0 0 2022-02-02T18:23:10.014 INFO:tasks.workunit.client.1.smithi159.stdout:1/697: mkdir df/d21/dce/d100 0 2022-02-02T18:23:10.016 INFO:tasks.workunit.client.1.smithi159.stdout:8/743: creat d1/fff x:0 0 0 2022-02-02T18:23:10.019 INFO:tasks.workunit.client.1.smithi159.stdout:4/644: write d0/d8/d24/d4f/f72 [3837571,22096] 0 2022-02-02T18:23:10.019 INFO:tasks.workunit.client.1.smithi159.stdout:4/645: chown d0/d8/d41/db7/d36/f5f 3362148 1 2022-02-02T18:23:10.023 INFO:tasks.workunit.client.1.smithi159.stdout:4/646: creat d0/d8/d41/db7/d33/d47/d56/fd7 x:0 0 0 2022-02-02T18:23:10.024 INFO:tasks.workunit.client.1.smithi159.stdout:3/703: dread dd/d20/f54 [0,4194304] 0 2022-02-02T18:23:10.026 INFO:tasks.workunit.client.1.smithi159.stdout:3/704: write dd/d19/d38/d94/f96 [416386,88409] 0 2022-02-02T18:23:10.027 INFO:tasks.workunit.client.1.smithi159.stdout:4/647: mknod d0/d8/d41/db7/d33/dc0/cd8 0 2022-02-02T18:23:10.027 INFO:tasks.workunit.client.1.smithi159.stdout:0/746: getdents d1/dd 0 2022-02-02T18:23:10.027 INFO:tasks.workunit.client.1.smithi159.stdout:0/747: truncate d1/d11/d38/d42/ff3 436211 0 2022-02-02T18:23:10.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/698: rename df/d21/l67 to df/d21/d23/d49/d69/l101 0 2022-02-02T18:23:10.028 INFO:tasks.workunit.client.1.smithi159.stdout:0/748: write d1/d11/d38/d42/ff3 [125978,2457] 0 2022-02-02T18:23:10.029 INFO:tasks.workunit.client.1.smithi159.stdout:0/749: mknod d1/dd/cff 0 2022-02-02T18:23:10.029 INFO:tasks.workunit.client.1.smithi159.stdout:1/699: symlink df/d14/d16/d4b/da0/l102 0 2022-02-02T18:23:10.030 INFO:tasks.workunit.client.1.smithi159.stdout:0/750: truncate d1/d11/d38/d42/daf/d34/f71 1193257 0 2022-02-02T18:23:10.030 INFO:tasks.workunit.client.1.smithi159.stdout:3/705: dread dd/d19/f1e [0,4194304] 0 2022-02-02T18:23:10.031 INFO:tasks.workunit.client.1.smithi159.stdout:0/751: chown d1/d11/f63 75157770 1 2022-02-02T18:23:10.031 INFO:tasks.workunit.client.1.smithi159.stdout:4/648: mkdir d0/d8/d15/d61/dd9 0 2022-02-02T18:23:10.031 INFO:tasks.workunit.client.1.smithi159.stdout:4/649: write d0/d8/d30/d5d/f90 [1140382,12787] 0 2022-02-02T18:23:10.032 INFO:tasks.workunit.client.1.smithi159.stdout:0/752: write d1/d11/d38/d42/daf/d34/f4a [3880054,21098] 0 2022-02-02T18:23:10.033 INFO:tasks.workunit.client.1.smithi159.stdout:4/650: mknod d0/d8/d15/d61/dd9/cda 0 2022-02-02T18:23:10.034 INFO:tasks.workunit.client.1.smithi159.stdout:6/695: dwrite df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/fc8 [0,4194304] 0 2022-02-02T18:23:10.035 INFO:tasks.workunit.client.1.smithi159.stdout:1/700: link df/d21/d23/d49/d69/d6c/l72 df/d21/deb/l103 0 2022-02-02T18:23:10.038 INFO:tasks.workunit.client.1.smithi159.stdout:1/701: symlink df/d21/dce/d100/l104 0 2022-02-02T18:23:10.038 INFO:tasks.workunit.client.1.smithi159.stdout:1/702: chown df/d21/f5c 1999829 1 2022-02-02T18:23:10.040 INFO:tasks.workunit.client.1.smithi159.stdout:4/651: dread d0/d8/d41/db7/d33/d47/f53 [0,4194304] 0 2022-02-02T18:23:10.042 INFO:tasks.workunit.client.1.smithi159.stdout:4/652: link d0/d8/d30/d7e/d9c/lb8 d0/d8/d30/ldb 0 2022-02-02T18:23:10.047 INFO:tasks.workunit.client.1.smithi159.stdout:4/653: rmdir d0/d7b/dc8 39 2022-02-02T18:23:10.047 INFO:tasks.workunit.client.1.smithi159.stdout:6/696: dread df/d35/d2a/d3f/f44 [0,4194304] 0 2022-02-02T18:23:10.047 INFO:tasks.workunit.client.1.smithi159.stdout:6/697: stat f6 0 2022-02-02T18:23:10.049 INFO:tasks.workunit.client.1.smithi159.stdout:6/698: truncate df/d35/f57 5505118 0 2022-02-02T18:23:10.049 INFO:tasks.workunit.client.1.smithi159.stdout:6/699: fsync df/d35/d2a/d2f/f85 0 2022-02-02T18:23:10.049 INFO:tasks.workunit.client.1.smithi159.stdout:1/703: dread df/d21/d23/f29 [0,4194304] 0 2022-02-02T18:23:10.050 INFO:tasks.workunit.client.1.smithi159.stdout:4/654: mknod d0/d66/cdc 0 2022-02-02T18:23:10.050 INFO:tasks.workunit.client.1.smithi159.stdout:4/655: chown d0/d8/d30/d5d/ld1 1 1 2022-02-02T18:23:10.053 INFO:tasks.workunit.client.1.smithi159.stdout:6/700: rename f6 to df/d35/d2a/d2f/fe1 0 2022-02-02T18:23:10.055 INFO:tasks.workunit.client.1.smithi159.stdout:4/656: creat d0/d8/d24/fdd x:0 0 0 2022-02-02T18:23:10.055 INFO:tasks.workunit.client.1.smithi159.stdout:6/701: creat df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/fe2 x:0 0 0 2022-02-02T18:23:10.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/702: creat df/d35/d2a/d3f/d91/fe3 x:0 0 0 2022-02-02T18:23:10.061 INFO:tasks.workunit.client.1.smithi159.stdout:6/703: symlink df/d35/le4 0 2022-02-02T18:23:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:0/753: dwrite d1/fc7 [4194304,4194304] 0 2022-02-02T18:23:10.101 INFO:tasks.workunit.client.1.smithi159.stdout:1/704: dwrite df/d21/d23/fb1 [0,4194304] 0 2022-02-02T18:23:10.102 INFO:tasks.workunit.client.1.smithi159.stdout:4/657: dwrite d0/d8/d24/d4f/fbb [0,4194304] 0 2022-02-02T18:23:10.103 INFO:tasks.workunit.client.1.smithi159.stdout:1/705: creat df/d14/d16/d4b/dcc/f105 x:0 0 0 2022-02-02T18:23:10.104 INFO:tasks.workunit.client.1.smithi159.stdout:6/704: dwrite df/d35/d7b/db4/f73 [0,4194304] 0 2022-02-02T18:23:10.105 INFO:tasks.workunit.client.1.smithi159.stdout:3/706: dwrite dd/d19/d38/fd3 [4194304,4194304] 0 2022-02-02T18:23:10.105 INFO:tasks.workunit.client.1.smithi159.stdout:1/706: creat df/d14/d68/f106 x:0 0 0 2022-02-02T18:23:10.107 INFO:tasks.workunit.client.1.smithi159.stdout:0/754: write d1/d19/f5b [3777947,87020] 0 2022-02-02T18:23:10.107 INFO:tasks.workunit.client.1.smithi159.stdout:0/755: readlink d1/dd/d4b/ddd/lec 0 2022-02-02T18:23:10.108 INFO:tasks.workunit.client.1.smithi159.stdout:0/756: creat d1/dd/d4b/d7d/f100 x:0 0 0 2022-02-02T18:23:10.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/757: mknod d1/dd/c101 0 2022-02-02T18:23:10.112 INFO:tasks.workunit.client.1.smithi159.stdout:4/658: unlink d0/d8/d41/db7/d36/d4b/cce 0 2022-02-02T18:23:10.113 INFO:tasks.workunit.client.1.smithi159.stdout:2/929: sync 2022-02-02T18:23:10.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/782: sync 2022-02-02T18:23:10.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/783: readlink d4/l1d 0 2022-02-02T18:23:10.114 INFO:tasks.workunit.client.1.smithi159.stdout:2/930: chown da/d1c/d25/d73/dab/df5/d118 1986 1 2022-02-02T18:23:10.114 INFO:tasks.workunit.client.1.smithi159.stdout:2/931: write da/f110 [15884,57009] 0 2022-02-02T18:23:10.116 INFO:tasks.workunit.client.1.smithi159.stdout:3/707: rmdir dd/d66/d82/db6 39 2022-02-02T18:23:10.117 INFO:tasks.workunit.client.1.smithi159.stdout:3/708: dread dd/d19/f1e [0,4194304] 0 2022-02-02T18:23:10.117 INFO:tasks.workunit.client.1.smithi159.stdout:6/705: creat df/d35/d7b/db4/fe5 x:0 0 0 2022-02-02T18:23:10.118 INFO:tasks.workunit.client.1.smithi159.stdout:1/707: symlink df/d21/d23/d49/d82/d87/l107 0 2022-02-02T18:23:10.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/709: unlink dd/d19/d38/d3f/d52/fcb 0 2022-02-02T18:23:10.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/932: symlink da/l141 0 2022-02-02T18:23:10.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/659: symlink d0/d8/lde 0 2022-02-02T18:23:10.123 INFO:tasks.workunit.client.1.smithi159.stdout:2/933: creat da/d48/d6d/d3e/f142 x:0 0 0 2022-02-02T18:23:10.124 INFO:tasks.workunit.client.1.smithi159.stdout:4/660: creat d0/d8/d41/db7/d36/dad/fdf x:0 0 0 2022-02-02T18:23:10.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/758: dwrite d1/d11/d38/d42/d47/db0/fcc [4194304,4194304] 0 2022-02-02T18:23:10.134 INFO:tasks.workunit.client.1.smithi159.stdout:0/759: symlink d1/d11/d38/d42/d56/def/l102 0 2022-02-02T18:23:10.135 INFO:tasks.workunit.client.1.smithi159.stdout:2/934: write da/d48/d83/dff/f13f [1902501,128209] 0 2022-02-02T18:23:10.135 INFO:tasks.workunit.client.1.smithi159.stdout:0/760: creat d1/d11/d38/d42/d47/f103 x:0 0 0 2022-02-02T18:23:10.136 INFO:tasks.workunit.client.1.smithi159.stdout:0/761: chown d1/d11/d38/d42/d47/f103 15 1 2022-02-02T18:23:10.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/706: dwrite df/d35/d2a/d2f/d80/d61/da8/fcc [0,4194304] 0 2022-02-02T18:23:10.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/762: write d1/d11/d38/d7e/f9f [51384,75356] 0 2022-02-02T18:23:10.147 INFO:tasks.workunit.client.1.smithi159.stdout:6/707: getdents df/d35/d2a/d3f 0 2022-02-02T18:23:10.149 INFO:tasks.workunit.client.1.smithi159.stdout:6/708: mknod df/d35/ce6 0 2022-02-02T18:23:10.160 INFO:tasks.workunit.client.1.smithi159.stdout:6/709: dread df/d35/d2a/d2f/f3a [0,4194304] 0 2022-02-02T18:23:10.168 INFO:tasks.workunit.client.1.smithi159.stdout:3/710: dwrite dd/d19/d38/f6c [0,4194304] 0 2022-02-02T18:23:10.170 INFO:tasks.workunit.client.1.smithi159.stdout:6/710: dread df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/fc8 [0,4194304] 0 2022-02-02T18:23:10.171 INFO:tasks.workunit.client.1.smithi159.stdout:0/763: dwrite d1/dd/d4b/da7/dc1/fdb [0,4194304] 0 2022-02-02T18:23:10.171 INFO:tasks.workunit.client.1.smithi159.stdout:3/711: mkdir dd/d66/da1/da4/de5 0 2022-02-02T18:23:10.171 INFO:tasks.workunit.client.1.smithi159.stdout:4/661: dwrite d0/d8/d15/f57 [0,4194304] 0 2022-02-02T18:23:10.173 INFO:tasks.workunit.client.1.smithi159.stdout:6/711: truncate df/d35/d2a/d2f/f64 2100478 0 2022-02-02T18:23:10.175 INFO:tasks.workunit.client.1.smithi159.stdout:3/712: dread dd/d66/d82/f9a [0,4194304] 0 2022-02-02T18:23:10.176 INFO:tasks.workunit.client.1.smithi159.stdout:4/662: symlink d0/le0 0 2022-02-02T18:23:10.177 INFO:tasks.workunit.client.1.smithi159.stdout:3/713: creat dd/d20/d2a/fe6 x:0 0 0 2022-02-02T18:23:10.179 INFO:tasks.workunit.client.1.smithi159.stdout:4/663: truncate d0/d8/d30/d5d/fb5 1606237 0 2022-02-02T18:23:10.183 INFO:tasks.workunit.client.1.smithi159.stdout:3/714: symlink dd/d19/d35/le7 0 2022-02-02T18:23:10.183 INFO:tasks.workunit.client.1.smithi159.stdout:3/715: creat dd/d19/d38/d3f/d52/fe8 x:0 0 0 2022-02-02T18:23:10.185 INFO:tasks.workunit.client.1.smithi159.stdout:3/716: getdents dd/d66/d82/db6 0 2022-02-02T18:23:10.191 INFO:tasks.workunit.client.1.smithi159.stdout:3/717: unlink dd/d66/d92/f93 0 2022-02-02T18:23:10.191 INFO:tasks.workunit.client.1.smithi159.stdout:3/718: fsync dd/f9e 0 2022-02-02T18:23:10.191 INFO:tasks.workunit.client.1.smithi159.stdout:3/719: chown dd/d19/d38/d3f/d52/f5b 2 1 2022-02-02T18:23:10.193 INFO:tasks.workunit.client.1.smithi159.stdout:3/720: rename dd/d19/c61 to dd/d66/d69/ce9 0 2022-02-02T18:23:10.194 INFO:tasks.workunit.client.1.smithi159.stdout:0/764: dwrite d1/d11/d38/d94/fc4 [4194304,4194304] 0 2022-02-02T18:23:10.194 INFO:tasks.workunit.client.1.smithi159.stdout:3/721: symlink dd/d66/da1/da4/de5/lea 0 2022-02-02T18:23:10.205 INFO:tasks.workunit.client.1.smithi159.stdout:6/712: dwrite df/fc5 [0,4194304] 0 2022-02-02T18:23:10.208 INFO:tasks.workunit.client.1.smithi159.stdout:6/713: link df/d35/d2a/d3f/d65/fcb df/d35/d2a/d3f/d42/d89/fe7 0 2022-02-02T18:23:10.210 INFO:tasks.workunit.client.1.smithi159.stdout:6/714: symlink df/d35/d7b/db4/le8 0 2022-02-02T18:23:10.211 INFO:tasks.workunit.client.1.smithi159.stdout:6/715: mkdir df/d35/d2a/d3f/d55/d6a/de9 0 2022-02-02T18:23:10.211 INFO:tasks.workunit.client.1.smithi159.stdout:6/716: mknod df/d35/d2a/d3f/d65/cea 0 2022-02-02T18:23:10.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/717: rmdir df/d35/d2a/d2f/d80/d61 39 2022-02-02T18:23:10.217 INFO:tasks.workunit.client.1.smithi159.stdout:4/664: dwrite d0/d8/d41/db7/d33/d47/fa1 [0,4194304] 0 2022-02-02T18:23:10.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/765: dwrite d1/d11/f35 [0,4194304] 0 2022-02-02T18:23:10.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/766: readlink d1/d11/d38/d42/db5/ded/lc2 0 2022-02-02T18:23:10.221 INFO:tasks.workunit.client.1.smithi159.stdout:3/722: dwrite dd/d20/d2a/fe6 [0,4194304] 0 2022-02-02T18:23:10.221 INFO:tasks.workunit.client.1.smithi159.stdout:3/723: fdatasync dd/d19/f4e 0 2022-02-02T18:23:10.222 INFO:tasks.workunit.client.1.smithi159.stdout:3/724: read - dd/d66/d92/dbe/fce zero size 2022-02-02T18:23:10.222 INFO:tasks.workunit.client.1.smithi159.stdout:6/718: dread df/d35/d2a/f7a [0,4194304] 0 2022-02-02T18:23:10.223 INFO:tasks.workunit.client.1.smithi159.stdout:6/719: truncate df/d35/d2a/d3f/d42/d47/fd9 552236 0 2022-02-02T18:23:10.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/725: link dd/f11 dd/d66/d92/dbe/feb 0 2022-02-02T18:23:10.233 INFO:tasks.workunit.client.1.smithi159.stdout:3/726: chown dd/d66/d69/d77/lab 1015002 1 2022-02-02T18:23:10.233 INFO:tasks.workunit.client.1.smithi159.stdout:3/727: stat dd/d66/d92/dbe/fce 0 2022-02-02T18:23:10.233 INFO:tasks.workunit.client.1.smithi159.stdout:0/767: dread d1/d11/d38/d42/db5/ded/fb7 [0,4194304] 0 2022-02-02T18:23:10.233 INFO:tasks.workunit.client.1.smithi159.stdout:4/665: rename d0/d8/d41/db7/d36/f5f to d0/d8/d15/fe1 0 2022-02-02T18:23:10.234 INFO:tasks.workunit.client.1.smithi159.stdout:6/720: mkdir df/d35/d2a/d2f/d80/d61/deb 0 2022-02-02T18:23:10.234 INFO:tasks.workunit.client.1.smithi159.stdout:6/721: fsync df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/fe2 0 2022-02-02T18:23:10.235 INFO:tasks.workunit.client.1.smithi159.stdout:6/722: write df/d35/d2a/f5c [697086,54767] 0 2022-02-02T18:23:10.236 INFO:tasks.workunit.client.1.smithi159.stdout:4/666: creat d0/d8/d24/d3a/fe2 x:0 0 0 2022-02-02T18:23:10.236 INFO:tasks.workunit.client.1.smithi159.stdout:4/667: getdents d0/d8/d41/db7/d33/d47 0 2022-02-02T18:23:10.237 INFO:tasks.workunit.client.1.smithi159.stdout:4/668: mknod d0/d8/d41/db7/da3/dcd/ce3 0 2022-02-02T18:23:10.238 INFO:tasks.workunit.client.1.smithi159.stdout:4/669: chown d0/d8/d41/db7/da3/dcd 540 1 2022-02-02T18:23:10.238 INFO:tasks.workunit.client.1.smithi159.stdout:4/670: stat d0/d8/d15/d61/l77 0 2022-02-02T18:23:10.239 INFO:tasks.workunit.client.1.smithi159.stdout:4/671: write d0/d8/d15/fe1 [4265607,26487] 0 2022-02-02T18:23:10.241 INFO:tasks.workunit.client.1.smithi159.stdout:0/768: write d1/dd/f33 [150332,9020] 0 2022-02-02T18:23:10.241 INFO:tasks.workunit.client.1.smithi159.stdout:0/769: read d1/f1c [7314571,17824] 0 2022-02-02T18:23:10.241 INFO:tasks.workunit.client.1.smithi159.stdout:0/770: chown d1/d11/d38/d42/daf/d34 1588781329 1 2022-02-02T18:23:10.243 INFO:tasks.workunit.client.1.smithi159.stdout:0/771: creat d1/d11/d38/d42/db5/f104 x:0 0 0 2022-02-02T18:23:10.244 INFO:tasks.workunit.client.1.smithi159.stdout:0/772: truncate d1/d19/d3d/f41 1317239 0 2022-02-02T18:23:10.244 INFO:tasks.workunit.client.1.smithi159.stdout:3/728: dwrite dd/f34 [0,4194304] 0 2022-02-02T18:23:10.244 INFO:tasks.workunit.client.1.smithi159.stdout:3/729: write dd/d19/d38/d3f/dd1/fe0 [471187,49661] 0 2022-02-02T18:23:10.253 INFO:tasks.workunit.client.1.smithi159.stdout:4/672: rename d0/d8/d24/d76/f89 to d0/d8/d30/d7e/d9c/fe4 0 2022-02-02T18:23:10.253 INFO:tasks.workunit.client.1.smithi159.stdout:4/673: stat d0/d8/d30/d5d 0 2022-02-02T18:23:10.255 INFO:tasks.workunit.client.1.smithi159.stdout:3/730: creat dd/d66/d69/fec x:0 0 0 2022-02-02T18:23:10.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/773: rename d1/d11/d38/d42/d56/l89 to d1/d11/d38/d42/daf/d34/l105 0 2022-02-02T18:23:10.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/774: chown d1/l24 532726 1 2022-02-02T18:23:10.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/775: dread - d1/d11/d38/d42/d47/f103 zero size 2022-02-02T18:23:10.257 INFO:tasks.workunit.client.1.smithi159.stdout:0/776: write d1/dd/d4b/d7d/ff8 [679222,83341] 0 2022-02-02T18:23:10.258 INFO:tasks.workunit.client.1.smithi159.stdout:0/777: truncate d1/d11/f68 6068465 0 2022-02-02T18:23:10.258 INFO:tasks.workunit.client.1.smithi159.stdout:3/731: rmdir dd/d66/da1/da4/de5 39 2022-02-02T18:23:10.260 INFO:tasks.workunit.client.1.smithi159.stdout:0/778: rename d1/dd/d4b/d7d/fb4 to d1/d11/d38/d42/d56/def/f106 0 2022-02-02T18:23:10.260 INFO:tasks.workunit.client.1.smithi159.stdout:0/779: fsync d1/d19/d3d/f76 0 2022-02-02T18:23:10.260 INFO:tasks.workunit.client.1.smithi159.stdout:3/732: write dd/d19/d38/d3f/d52/f58 [154910,59600] 0 2022-02-02T18:23:10.263 INFO:tasks.workunit.client.1.smithi159.stdout:0/780: dread d1/dd/d4b/d7d/fa1 [0,4194304] 0 2022-02-02T18:23:10.263 INFO:tasks.workunit.client.1.smithi159.stdout:0/781: chown d1/d19/lb3 1870 1 2022-02-02T18:23:10.267 INFO:tasks.workunit.client.1.smithi159.stdout:8/744: sync 2022-02-02T18:23:10.267 INFO:tasks.workunit.client.1.smithi159.stdout:5/773: sync 2022-02-02T18:23:10.267 INFO:tasks.workunit.client.1.smithi159.stdout:5/774: chown d9/d24/d4a/f8b 11 1 2022-02-02T18:23:10.285 INFO:tasks.workunit.client.1.smithi159.stdout:5/775: dwrite d9/d2e/dd7/d3c/d8c/fb5 [0,4194304] 0 2022-02-02T18:23:10.332 INFO:tasks.workunit.client.1.smithi159.stdout:0/782: symlink d1/d11/d38/d94/l107 0 2022-02-02T18:23:10.333 INFO:tasks.workunit.client.1.smithi159.stdout:8/745: creat d1/d26/d48/d7f/f100 x:0 0 0 2022-02-02T18:23:10.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/776: mkdir d9/d2e/dd7/d3c/daa/ded 0 2022-02-02T18:23:10.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/746: mknod d1/db7/d75/de8/dfb/c101 0 2022-02-02T18:23:10.353 INFO:tasks.workunit.client.1.smithi159.stdout:5/777: dwrite d9/d24/d4a/d8d/f98 [0,4194304] 0 2022-02-02T18:23:10.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/747: unlink d1/dc/c65 0 2022-02-02T18:23:10.384 INFO:tasks.workunit.client.1.smithi159.stdout:8/748: write d1/dd/d1a/d53/f6d [1812829,100949] 0 2022-02-02T18:23:10.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/778: mknod d9/d2e/dd7/d3c/d61/cee 0 2022-02-02T18:23:10.388 INFO:tasks.workunit.client.1.smithi159.stdout:5/779: rmdir d9/d24 39 2022-02-02T18:23:10.415 INFO:tasks.workunit.client.1.smithi159.stdout:8/749: dwrite d1/d26/d48/ff4 [0,4194304] 0 2022-02-02T18:23:10.416 INFO:tasks.workunit.client.1.smithi159.stdout:8/750: chown d1/l6 32502466 1 2022-02-02T18:23:10.417 INFO:tasks.workunit.client.1.smithi159.stdout:8/751: rename d1/d26/lc6 to d1/dad/dc9/l102 0 2022-02-02T18:23:10.417 INFO:tasks.workunit.client.1.smithi159.stdout:8/752: getdents d1/dd/d1a/d53 0 2022-02-02T18:23:10.417 INFO:tasks.workunit.client.1.smithi159.stdout:8/753: mknod d1/db7/d75/c103 0 2022-02-02T18:23:10.419 INFO:tasks.workunit.client.1.smithi159.stdout:8/754: mknod d1/d26/d48/d49/c104 0 2022-02-02T18:23:10.419 INFO:tasks.workunit.client.1.smithi159.stdout:5/780: dwrite d9/f42 [0,4194304] 0 2022-02-02T18:23:10.420 INFO:tasks.workunit.client.1.smithi159.stdout:5/781: mknod d9/d2e/dd7/d3c/daa/ded/cef 0 2022-02-02T18:23:10.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/782: creat d9/d2e/db1/ff0 x:0 0 0 2022-02-02T18:23:10.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/783: link d9/d2e/db1/cc4 d9/d24/d4a/d8d/cf1 0 2022-02-02T18:23:10.424 INFO:tasks.workunit.client.1.smithi159.stdout:8/755: write d1/dd/d2c/df6/dca/fdd [1275892,87523] 0 2022-02-02T18:23:10.424 INFO:tasks.workunit.client.1.smithi159.stdout:8/756: truncate d1/db7/d75/de8/ffd 583357 0 2022-02-02T18:23:10.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/784: unlink d9/d2e/dd7/d3c/d61/dd6/c5f 0 2022-02-02T18:23:10.425 INFO:tasks.workunit.client.1.smithi159.stdout:5/785: fdatasync d9/d2e/dd7/d3c/d61/dd6/d68/f95 0 2022-02-02T18:23:10.425 INFO:tasks.workunit.client.1.smithi159.stdout:8/757: rename d1/l5a to d1/dd/d2c/df6/dca/l105 0 2022-02-02T18:23:10.426 INFO:tasks.workunit.client.1.smithi159.stdout:5/786: symlink d9/d2e/dd7/d3c/lf2 0 2022-02-02T18:23:10.427 INFO:tasks.workunit.client.1.smithi159.stdout:5/787: mknod d9/d24/d4a/d8d/cf3 0 2022-02-02T18:23:10.427 INFO:tasks.workunit.client.1.smithi159.stdout:5/788: write d9/d24/f16 [5020589,17887] 0 2022-02-02T18:23:10.427 INFO:tasks.workunit.client.1.smithi159.stdout:5/789: mknod d9/d24/d21/cf4 0 2022-02-02T18:23:10.432 INFO:tasks.workunit.client.1.smithi159.stdout:8/758: dread d1/dd/d2c/d67/fc1 [0,4194304] 0 2022-02-02T18:23:10.435 INFO:tasks.workunit.client.1.smithi159.stdout:8/759: truncate d1/dd/d1a/f9a 7648752 0 2022-02-02T18:23:10.438 INFO:tasks.workunit.client.1.smithi159.stdout:2/935: sync 2022-02-02T18:23:10.439 INFO:tasks.workunit.client.1.smithi159.stdout:9/784: sync 2022-02-02T18:23:10.439 INFO:tasks.workunit.client.1.smithi159.stdout:1/708: sync 2022-02-02T18:23:10.440 INFO:tasks.workunit.client.1.smithi159.stdout:2/936: chown da/d40/daf/d134/d135/f125 163522437 1 2022-02-02T18:23:10.441 INFO:tasks.workunit.client.1.smithi159.stdout:5/790: dread d9/d2e/d63/f7b [0,4194304] 0 2022-02-02T18:23:10.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:10 smithi159 conmon[35668]: cluster 2022-02-02T18:23:09.080952+0000 mon.smithi096 (mon.0) 751 : cluster 2022-02-02T18:23:10.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:10 smithi159 conmon[35668]: [DBG] mgrmap e30: smithi096.shfutl(active, since 33s), standbys: smithi159.jrxkfz 2022-02-02T18:23:10.445 INFO:tasks.workunit.client.1.smithi159.stdout:8/760: symlink d1/db7/d75/d9d/l106 0 2022-02-02T18:23:10.446 INFO:tasks.workunit.client.1.smithi159.stdout:8/761: write d1/d26/d48/d7f/f100 [2046,36074] 0 2022-02-02T18:23:10.447 INFO:tasks.workunit.client.1.smithi159.stdout:9/785: dread d4/d19/d1c/d21/d22/d55/f6c [0,4194304] 0 2022-02-02T18:23:10.447 INFO:tasks.workunit.client.1.smithi159.stdout:9/786: chown d4/d2a/f9d 1401 1 2022-02-02T18:23:10.448 INFO:tasks.workunit.client.1.smithi159.stdout:9/787: creat d4/d19/d1c/d21/d41/d9a/de6/f104 x:0 0 0 2022-02-02T18:23:10.448 INFO:tasks.workunit.client.1.smithi159.stdout:9/788: truncate d4/d19/d1c/d21/d41/fbf 5066169 0 2022-02-02T18:23:10.449 INFO:tasks.workunit.client.1.smithi159.stdout:2/937: creat da/d1c/d47/f143 x:0 0 0 2022-02-02T18:23:10.449 INFO:tasks.workunit.client.1.smithi159.stdout:8/762: rmdir d1/d26/d48/d98 39 2022-02-02T18:23:10.451 INFO:tasks.workunit.client.1.smithi159.stdout:9/789: creat d4/d19/d1c/d21/d56/f105 x:0 0 0 2022-02-02T18:23:10.452 INFO:tasks.workunit.client.1.smithi159.stdout:9/790: stat d4/d19/d1c/l97 0 2022-02-02T18:23:10.452 INFO:tasks.workunit.client.1.smithi159.stdout:9/791: dread - d4/d19/fc1 zero size 2022-02-02T18:23:10.454 INFO:tasks.workunit.client.1.smithi159.stdout:1/709: dread df/d14/f39 [0,4194304] 0 2022-02-02T18:23:10.454 INFO:tasks.workunit.client.1.smithi159.stdout:1/710: dread - df/d21/d23/f7c zero size 2022-02-02T18:23:10.455 INFO:tasks.workunit.client.1.smithi159.stdout:1/711: mknod df/d14/d16/d4b/da0/c108 0 2022-02-02T18:23:10.458 INFO:tasks.workunit.client.1.smithi159.stdout:2/938: rename da/d1c/d42/d139/f12d to da/d1c/d42/d70/f144 0 2022-02-02T18:23:10.458 INFO:tasks.workunit.client.1.smithi159.stdout:2/939: truncate da/d1c/dd7/f126 639937 0 2022-02-02T18:23:10.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/940: chown da/d1c/d25/d73/dab/df5/d118/d129 0 1 2022-02-02T18:23:10.460 INFO:tasks.workunit.client.1.smithi159.stdout:2/941: symlink da/d1c/d42/l145 0 2022-02-02T18:23:10.461 INFO:tasks.workunit.client.1.smithi159.stdout:2/942: truncate da/d48/d6d/f12c 815490 0 2022-02-02T18:23:10.465 INFO:tasks.workunit.client.1.smithi159.stdout:2/943: link da/d1c/d42/d139/l9d da/d1c/d47/dc7/d11e/l146 0 2022-02-02T18:23:10.467 INFO:tasks.workunit.client.1.smithi159.stdout:2/944: chown da/d1c/d42 1011 1 2022-02-02T18:23:10.467 INFO:tasks.workunit.client.1.smithi159.stdout:9/792: rename d4/d19/d6f/d74/db1/dc7/ceb to d4/c106 0 2022-02-02T18:23:10.467 INFO:tasks.workunit.client.1.smithi159.stdout:9/793: fsync d4/d2a/f9d 0 2022-02-02T18:23:10.469 INFO:tasks.workunit.client.1.smithi159.stdout:5/791: dwrite d9/d24/f2d [0,4194304] 0 2022-02-02T18:23:10.469 INFO:tasks.workunit.client.1.smithi159.stdout:5/792: creat d9/d2e/dd7/d88/ff5 x:0 0 0 2022-02-02T18:23:10.471 INFO:tasks.workunit.client.1.smithi159.stdout:5/793: mknod d9/d2e/dd7/d3c/d61/dd6/d68/cf6 0 2022-02-02T18:23:10.472 INFO:tasks.workunit.client.1.smithi159.stdout:5/794: symlink d9/lf7 0 2022-02-02T18:23:10.473 INFO:tasks.workunit.client.1.smithi159.stdout:8/763: dwrite d1/dd/d2c/df6/dca/fd8 [0,4194304] 0 2022-02-02T18:23:10.474 INFO:tasks.workunit.client.1.smithi159.stdout:2/945: dread da/d1c/d25/d73/dab/db5/fcf [0,4194304] 0 2022-02-02T18:23:10.475 INFO:tasks.workunit.client.1.smithi159.stdout:5/795: creat d9/d2e/dd7/d3c/d61/dd6/d68/ff8 x:0 0 0 2022-02-02T18:23:10.475 INFO:tasks.workunit.client.1.smithi159.stdout:1/712: rmdir df/d14/d16/d4b/da0 39 2022-02-02T18:23:10.475 INFO:tasks.workunit.client.1.smithi159.stdout:9/794: dread d4/d19/d1c/f7e [0,4194304] 0 2022-02-02T18:23:10.479 INFO:tasks.workunit.client.1.smithi159.stdout:9/795: unlink d4/d19/d1c/d21/da8/lea 0 2022-02-02T18:23:10.480 INFO:tasks.workunit.client.1.smithi159.stdout:9/796: symlink d4/d19/d6f/d74/db1/dc7/dc8/l107 0 2022-02-02T18:23:10.482 INFO:tasks.workunit.client.1.smithi159.stdout:9/797: truncate d4/d2a/fde 7703958 0 2022-02-02T18:23:10.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/764: rename d1/dd/d2c/d67/d5f to d1/d26/d48/d107 0 2022-02-02T18:23:10.484 INFO:tasks.workunit.client.1.smithi159.stdout:1/713: dread df/d21/d23/d49/d82/f9e [0,4194304] 0 2022-02-02T18:23:10.485 INFO:tasks.workunit.client.1.smithi159.stdout:9/798: rename d4/d19/d1c/d21/d41/ded to d4/d19/d6f/d74/d108 0 2022-02-02T18:23:10.485 INFO:tasks.workunit.client.1.smithi159.stdout:8/765: creat d1/dc/de7/df5/f108 x:0 0 0 2022-02-02T18:23:10.486 INFO:tasks.workunit.client.1.smithi159.stdout:9/799: truncate d4/d7a/db7/ff0 1372897 0 2022-02-02T18:23:10.487 INFO:tasks.workunit.client.1.smithi159.stdout:1/714: mkdir df/d14/d16/d4b/d109 0 2022-02-02T18:23:10.488 INFO:tasks.workunit.client.1.smithi159.stdout:1/715: write df/d14/d16/d4b/d5b/f8d [42239,95265] 0 2022-02-02T18:23:10.489 INFO:tasks.workunit.client.1.smithi159.stdout:1/716: mkdir df/d14/d16/d4b/dcc/dde/d10a 0 2022-02-02T18:23:10.491 INFO:tasks.workunit.client.1.smithi159.stdout:1/717: write df/d21/d23/d49/d82/f9e [2285728,39658] 0 2022-02-02T18:23:10.492 INFO:tasks.workunit.client.1.smithi159.stdout:1/718: fdatasync f7 0 2022-02-02T18:23:10.493 INFO:tasks.workunit.client.1.smithi159.stdout:1/719: creat df/d14/d16/d4b/dcc/f10b x:0 0 0 2022-02-02T18:23:10.494 INFO:tasks.workunit.client.1.smithi159.stdout:1/720: truncate df/d14/d16/f60 5175302 0 2022-02-02T18:23:10.494 INFO:tasks.workunit.client.1.smithi159.stdout:5/796: dwrite d9/d24/d4a/d52/fd9 [0,4194304] 0 2022-02-02T18:23:10.495 INFO:tasks.workunit.client.1.smithi159.stdout:1/721: creat df/d21/deb/f10c x:0 0 0 2022-02-02T18:23:10.496 INFO:tasks.workunit.client.1.smithi159.stdout:1/722: mknod df/d21/d23/d49/da1/dac/c10d 0 2022-02-02T18:23:10.496 INFO:tasks.workunit.client.1.smithi159.stdout:1/723: stat df/d14/d16/d4b/dcc/dde 0 2022-02-02T18:23:10.497 INFO:tasks.workunit.client.1.smithi159.stdout:1/724: mknod df/d14/d16/d4a/d8b/dff/c10e 0 2022-02-02T18:23:10.498 INFO:tasks.workunit.client.1.smithi159.stdout:1/725: creat df/d21/deb/f10f x:0 0 0 2022-02-02T18:23:10.502 INFO:tasks.workunit.client.1.smithi159.stdout:8/766: dwrite d1/dd/d1a/f86 [0,4194304] 0 2022-02-02T18:23:10.532 INFO:tasks.workunit.client.1.smithi159.stdout:8/767: dwrite d1/dd/d2c/d67/fc1 [0,4194304] 0 2022-02-02T18:23:10.534 INFO:tasks.workunit.client.1.smithi159.stdout:8/768: write d1/dd/d2c/df6/dca/fd8 [1348166,61369] 0 2022-02-02T18:23:10.534 INFO:tasks.workunit.client.1.smithi159.stdout:8/769: write d1/d26/d48/f55 [1565967,33673] 0 2022-02-02T18:23:10.534 INFO:tasks.workunit.client.1.smithi159.stdout:5/797: dwrite d9/d2e/d63/fa0 [0,4194304] 0 2022-02-02T18:23:10.535 INFO:tasks.workunit.client.1.smithi159.stdout:1/726: dwrite df/d14/d16/d4b/dcc/f10b [0,4194304] 0 2022-02-02T18:23:10.537 INFO:tasks.workunit.client.1.smithi159.stdout:5/798: dread d9/f77 [0,4194304] 0 2022-02-02T18:23:10.537 INFO:tasks.workunit.client.1.smithi159.stdout:5/799: dread - d9/d2e/d71/f9b zero size 2022-02-02T18:23:10.538 INFO:tasks.workunit.client.1.smithi159.stdout:8/770: truncate d1/d26/f2d 2553404 0 2022-02-02T18:23:10.539 INFO:tasks.workunit.client.1.smithi159.stdout:5/800: creat d9/d2e/d63/ff9 x:0 0 0 2022-02-02T18:23:10.539 INFO:tasks.workunit.client.1.smithi159.stdout:5/801: chown d9/f47 11 1 2022-02-02T18:23:10.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/771: rmdir d1/d26/d48 39 2022-02-02T18:23:10.540 INFO:tasks.workunit.client.1.smithi159.stdout:5/802: symlink d9/d2e/dd7/d3c/daa/lfa 0 2022-02-02T18:23:10.541 INFO:tasks.workunit.client.1.smithi159.stdout:5/803: dread - d9/d2e/dd7/d88/ff5 zero size 2022-02-02T18:23:10.541 INFO:tasks.workunit.client.1.smithi159.stdout:8/772: readlink d1/dd/d1a/l1d 0 2022-02-02T18:23:10.541 INFO:tasks.workunit.client.1.smithi159.stdout:5/804: chown d9/d24/c2c 91 1 2022-02-02T18:23:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:10 smithi096 conmon[32067]: cluster 2022-02-02T18:23:09.080952+0000 mon.smithi096 2022-02-02T18:23:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:10 smithi096 conmon[32067]: (mon.0) 751 : cluster [DBG] mgrmap e30: smithi096.shfutl(active, since 33s), standbys: smithi159.jrxkfz 2022-02-02T18:23:10.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/805: dwrite d9/d2e/dd7/f73 [4194304,4194304] 0 2022-02-02T18:23:10.577 INFO:tasks.workunit.client.1.smithi159.stdout:6/723: sync 2022-02-02T18:23:10.579 INFO:tasks.workunit.client.1.smithi159.stdout:6/724: mkdir df/d35/d2a/d3f/d42/dec 0 2022-02-02T18:23:10.580 INFO:tasks.workunit.client.1.smithi159.stdout:6/725: truncate df/d35/d2a/d3f/d55/d6a/d6e/fa3 7219136 0 2022-02-02T18:23:10.581 INFO:tasks.workunit.client.1.smithi159.stdout:8/773: write d1/d26/d48/f55 [1290276,94477] 0 2022-02-02T18:23:10.582 INFO:tasks.workunit.client.1.smithi159.stdout:8/774: mknod d1/db7/c109 0 2022-02-02T18:23:10.582 INFO:tasks.workunit.client.1.smithi159.stdout:6/726: getdents df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0 0 2022-02-02T18:23:10.583 INFO:tasks.workunit.client.1.smithi159.stdout:6/727: chown df/d35/d2a/d2f/d80/f92 126579102 1 2022-02-02T18:23:10.584 INFO:tasks.workunit.client.1.smithi159.stdout:6/728: mkdir df/d35/d2a/d2f/d80/d61/deb/ded 0 2022-02-02T18:23:10.584 INFO:tasks.workunit.client.1.smithi159.stdout:6/729: dread - df/d35/d2a/d2f/d80/d61/f69 zero size 2022-02-02T18:23:10.585 INFO:tasks.workunit.client.1.smithi159.stdout:8/775: read d1/dd/d2c/f42 [2254317,32766] 0 2022-02-02T18:23:10.585 INFO:tasks.workunit.client.1.smithi159.stdout:5/806: dwrite d9/d2e/dd7/d3c/d8c/dd2/fb6 [0,4194304] 0 2022-02-02T18:23:10.586 INFO:tasks.workunit.client.1.smithi159.stdout:5/807: readlink d9/d24/la3 0 2022-02-02T18:23:10.586 INFO:tasks.workunit.client.1.smithi159.stdout:5/808: readlink d9/d2e/dd7/d3c/lf2 0 2022-02-02T18:23:10.587 INFO:tasks.workunit.client.1.smithi159.stdout:6/730: rename df/d35/d2a/d3f/d42/cc3 to df/d35/d2a/d2f/da7/cee 0 2022-02-02T18:23:10.587 INFO:tasks.workunit.client.1.smithi159.stdout:8/776: write d1/dd/d2c/d67/fa4 [1939408,100909] 0 2022-02-02T18:23:10.587 INFO:tasks.workunit.client.1.smithi159.stdout:6/731: readlink l9 0 2022-02-02T18:23:10.588 INFO:tasks.workunit.client.1.smithi159.stdout:6/732: getdents df/d35/d2a/d3f/d42/dec 0 2022-02-02T18:23:10.588 INFO:tasks.workunit.client.1.smithi159.stdout:8/777: creat d1/dc/f10a x:0 0 0 2022-02-02T18:23:10.589 INFO:tasks.workunit.client.1.smithi159.stdout:6/733: unlink df/d35/d2a/d2f/f85 0 2022-02-02T18:23:10.592 INFO:tasks.workunit.client.1.smithi159.stdout:8/778: mknod d1/dd/d31/c10b 0 2022-02-02T18:23:10.592 INFO:tasks.workunit.client.1.smithi159.stdout:6/734: mknod df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/cef 0 2022-02-02T18:23:10.596 INFO:tasks.workunit.client.1.smithi159.stdout:8/779: getdents d1/d26/d48/d99/da5 0 2022-02-02T18:23:10.596 INFO:tasks.workunit.client.1.smithi159.stdout:8/780: write d1/dd/d2c/d67/fa4 [2753669,83604] 0 2022-02-02T18:23:10.602 INFO:tasks.workunit.client.1.smithi159.stdout:8/781: write d1/d26/d48/f57 [124264,71712] 0 2022-02-02T18:23:10.605 INFO:tasks.workunit.client.1.smithi159.stdout:8/782: rename d1/dd/d2c/d67/lb0 to d1/dd/d1a/d53/l10c 0 2022-02-02T18:23:10.611 INFO:tasks.workunit.client.1.smithi159.stdout:5/809: dwrite d9/d24/d37/f20 [4194304,4194304] 0 2022-02-02T18:23:10.611 INFO:tasks.workunit.client.1.smithi159.stdout:5/810: fdatasync d9/d24/f93 0 2022-02-02T18:23:10.611 INFO:tasks.workunit.client.1.smithi159.stdout:5/811: fdatasync d9/d24/f8a 0 2022-02-02T18:23:10.612 INFO:tasks.workunit.client.1.smithi159.stdout:5/812: rename d9/d24/d4a/d91/fae to d9/d24/d4a/d91/ffb 0 2022-02-02T18:23:10.615 INFO:tasks.workunit.client.1.smithi159.stdout:8/783: dread d1/dd/f16 [0,4194304] 0 2022-02-02T18:23:10.617 INFO:tasks.workunit.client.1.smithi159.stdout:8/784: link d1/fff d1/d26/d48/d107/d8a/f10d 0 2022-02-02T18:23:10.618 INFO:tasks.workunit.client.1.smithi159.stdout:8/785: rmdir d1/d26/d48 39 2022-02-02T18:23:10.620 INFO:tasks.workunit.client.1.smithi159.stdout:8/786: rename d1/dad/d95/lee to d1/dad/l10e 0 2022-02-02T18:23:10.621 INFO:tasks.workunit.client.1.smithi159.stdout:6/735: dwrite df/d35/f34 [4194304,4194304] 0 2022-02-02T18:23:10.621 INFO:tasks.workunit.client.1.smithi159.stdout:8/787: symlink d1/dc/l10f 0 2022-02-02T18:23:10.625 INFO:tasks.workunit.client.1.smithi159.stdout:6/736: getdents df/d35/d2a/d3f/d42/d47/d59/d66/d88 0 2022-02-02T18:23:10.626 INFO:tasks.workunit.client.1.smithi159.stdout:6/737: readlink df/d35/d2a/d3f/l50 0 2022-02-02T18:23:10.630 INFO:tasks.workunit.client.1.smithi159.stdout:8/788: dread d1/dd/f29 [0,4194304] 0 2022-02-02T18:23:10.631 INFO:tasks.workunit.client.1.smithi159.stdout:5/813: dwrite d9/f47 [0,4194304] 0 2022-02-02T18:23:10.632 INFO:tasks.workunit.client.1.smithi159.stdout:5/814: read d9/d2e/dd7/f73 [2764531,79248] 0 2022-02-02T18:23:10.633 INFO:tasks.workunit.client.1.smithi159.stdout:5/815: write d9/d2e/dd7/d3c/d8c/dd2/fe6 [256404,92731] 0 2022-02-02T18:23:10.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/816: mkdir d9/dfc 0 2022-02-02T18:23:10.635 INFO:tasks.workunit.client.1.smithi159.stdout:5/817: dread - d9/d2e/dd7/d3c/f6c zero size 2022-02-02T18:23:10.635 INFO:tasks.workunit.client.1.smithi159.stdout:5/818: dread - d9/d2e/d63/ff9 zero size 2022-02-02T18:23:10.636 INFO:tasks.workunit.client.1.smithi159.stdout:5/819: mkdir d9/d24/d4a/d52/dfd 0 2022-02-02T18:23:10.637 INFO:tasks.workunit.client.1.smithi159.stdout:5/820: truncate d9/d2e/d63/f6b 4332308 0 2022-02-02T18:23:10.640 INFO:tasks.workunit.client.1.smithi159.stdout:5/821: symlink d9/d2e/dd7/d3c/d61/dd6/d68/lfe 0 2022-02-02T18:23:10.642 INFO:tasks.workunit.client.1.smithi159.stdout:5/822: unlink d9/d24/d21/f78 0 2022-02-02T18:23:10.646 INFO:tasks.workunit.client.1.smithi159.stdout:6/738: dwrite df/d35/d2a/f5c [0,4194304] 0 2022-02-02T18:23:10.649 INFO:tasks.workunit.client.1.smithi159.stdout:6/739: rename df/la1 to df/d35/d2a/d3f/d91/lf0 0 2022-02-02T18:23:10.649 INFO:tasks.workunit.client.1.smithi159.stdout:6/740: dread - df/d35/d2a/d2f/d80/d61/da8/fce zero size 2022-02-02T18:23:10.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/741: chown df/d35/d7b/db4/f96 17602 1 2022-02-02T18:23:10.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/742: mkdir df/d35/d2a/d3f/d42/dec/df1 0 2022-02-02T18:23:10.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/743: symlink df/d35/d2a/d3f/lf2 0 2022-02-02T18:23:10.652 INFO:tasks.workunit.client.1.smithi159.stdout:6/744: write df/d35/d2a/d3f/d42/d47/fd9 [1027511,58423] 0 2022-02-02T18:23:10.652 INFO:tasks.workunit.client.1.smithi159.stdout:8/789: dwrite d1/d26/d48/f55 [0,4194304] 0 2022-02-02T18:23:10.653 INFO:tasks.workunit.client.1.smithi159.stdout:6/745: creat df/d35/d2a/d3f/d42/d47/ff3 x:0 0 0 2022-02-02T18:23:10.654 INFO:tasks.workunit.client.1.smithi159.stdout:6/746: stat df/d35/d2a/d2f/d80/c90 0 2022-02-02T18:23:10.654 INFO:tasks.workunit.client.1.smithi159.stdout:6/747: getdents df/d35/d2a/d3f/d55/d6a/de9 0 2022-02-02T18:23:10.654 INFO:tasks.workunit.client.1.smithi159.stdout:6/748: dread - df/d35/d2a/d3f/d55/d6a/fd0 zero size 2022-02-02T18:23:10.654 INFO:tasks.workunit.client.1.smithi159.stdout:6/749: truncate df/d35/f71 3611995 0 2022-02-02T18:23:10.675 INFO:tasks.workunit.client.1.smithi159.stdout:8/790: dwrite d1/d26/f2d [0,4194304] 0 2022-02-02T18:23:10.675 INFO:tasks.workunit.client.1.smithi159.stdout:8/791: fsync d1/db7/d75/de8/ffd 0 2022-02-02T18:23:10.678 INFO:tasks.workunit.client.1.smithi159.stdout:6/750: dwrite df/d35/d2a/d2f/f45 [0,4194304] 0 2022-02-02T18:23:10.681 INFO:tasks.workunit.client.1.smithi159.stdout:6/751: rename df/d35/d2a/d3f/d55/d6a/d6e/fb6 to df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/ff4 0 2022-02-02T18:23:10.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/752: write df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/fc8 [3110196,18071] 0 2022-02-02T18:23:10.685 INFO:tasks.workunit.client.1.smithi159.stdout:6/753: rmdir df/d35/d2a/d3f/d55 39 2022-02-02T18:23:10.685 INFO:tasks.workunit.client.1.smithi159.stdout:6/754: dread - df/d35/d2a/d3f/d55/d6a/fd0 zero size 2022-02-02T18:23:10.694 INFO:tasks.workunit.client.1.smithi159.stdout:8/792: dwrite d1/d26/d48/d98/fd4 [0,4194304] 0 2022-02-02T18:23:10.697 INFO:tasks.workunit.client.1.smithi159.stdout:8/793: mkdir d1/dd/d110 0 2022-02-02T18:23:10.704 INFO:tasks.workunit.client.1.smithi159.stdout:6/755: dwrite df/d35/f71 [0,4194304] 0 2022-02-02T18:23:10.705 INFO:tasks.workunit.client.1.smithi159.stdout:6/756: chown df/d35/d2a/d3f/d55 173 1 2022-02-02T18:23:10.705 INFO:tasks.workunit.client.1.smithi159.stdout:6/757: fdatasync df/f16 0 2022-02-02T18:23:10.708 INFO:tasks.workunit.client.1.smithi159.stdout:6/758: read df/d35/d2a/d2f/d80/d61/f94 [3194193,121772] 0 2022-02-02T18:23:10.708 INFO:tasks.workunit.client.1.smithi159.stdout:6/759: fdatasync df/d35/d2a/d3f/d55/d6a/d6e/fb0 0 2022-02-02T18:23:10.708 INFO:tasks.workunit.client.1.smithi159.stdout:6/760: dread - df/d35/d2a/fcf zero size 2022-02-02T18:23:10.709 INFO:tasks.workunit.client.1.smithi159.stdout:6/761: mknod df/d35/d7b/db4/d84/cf5 0 2022-02-02T18:23:10.710 INFO:tasks.workunit.client.1.smithi159.stdout:6/762: symlink df/d35/d7b/db4/d84/d9d/lf6 0 2022-02-02T18:23:10.714 INFO:tasks.workunit.client.1.smithi159.stdout:6/763: link df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/cef df/d35/d2a/d2f/d80/d61/cf7 0 2022-02-02T18:23:10.714 INFO:tasks.workunit.client.1.smithi159.stdout:6/764: truncate df/d35/d2a/d2f/fe1 2020328 0 2022-02-02T18:23:10.715 INFO:tasks.workunit.client.1.smithi159.stdout:6/765: mkdir df/d35/d2a/d2f/d80/d61/deb/df8 0 2022-02-02T18:23:10.730 INFO:tasks.workunit.client.1.smithi159.stdout:8/794: dwrite d1/d26/d48/d49/f9b [0,4194304] 0 2022-02-02T18:23:10.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/766: dwrite df/d35/d7b/db4/d84/d9d/fd3 [0,4194304] 0 2022-02-02T18:23:10.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/767: read df/d35/d2a/d3f/d65/fba [56268,99061] 0 2022-02-02T18:23:10.735 INFO:tasks.workunit.client.1.smithi159.stdout:6/768: write df/d35/d7b/db4/d84/d9d/fd3 [1324421,13609] 0 2022-02-02T18:23:10.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/795: dread d1/d26/d48/ff4 [0,4194304] 0 2022-02-02T18:23:10.743 INFO:tasks.workunit.client.1.smithi159.stdout:8/796: creat d1/d26/d48/d98/f111 x:0 0 0 2022-02-02T18:23:10.743 INFO:tasks.workunit.client.1.smithi159.stdout:8/797: read - d1/ff2 zero size 2022-02-02T18:23:10.751 INFO:tasks.workunit.client.1.smithi159.stdout:8/798: dread d1/dd/d1a/d53/f74 [0,4194304] 0 2022-02-02T18:23:10.752 INFO:tasks.workunit.client.1.smithi159.stdout:8/799: creat d1/dc/de7/f112 x:0 0 0 2022-02-02T18:23:10.754 INFO:tasks.workunit.client.1.smithi159.stdout:8/800: rename d1/dd/d1a/f6e to d1/dd/d31/dec/dc0/f113 0 2022-02-02T18:23:10.754 INFO:tasks.workunit.client.1.smithi159.stdout:8/801: chown d1/dad/d95/fdb 144251 1 2022-02-02T18:23:10.756 INFO:tasks.workunit.client.1.smithi159.stdout:8/802: dread d1/dd/fce [0,4194304] 0 2022-02-02T18:23:10.757 INFO:tasks.workunit.client.1.smithi159.stdout:8/803: creat d1/d26/d48/d7f/f114 x:0 0 0 2022-02-02T18:23:10.758 INFO:tasks.workunit.client.1.smithi159.stdout:8/804: symlink d1/db7/d75/l115 0 2022-02-02T18:23:10.758 INFO:tasks.workunit.client.1.smithi159.stdout:8/805: fdatasync d1/dc/f10a 0 2022-02-02T18:23:10.759 INFO:tasks.workunit.client.1.smithi159.stdout:8/806: rename d1/dd/d1a/d53/ld3 to d1/dd/d110/l116 0 2022-02-02T18:23:10.767 INFO:tasks.workunit.client.1.smithi159.stdout:8/807: dread d1/dd/d31/dec/dc0/f113 [0,4194304] 0 2022-02-02T18:23:10.768 INFO:tasks.workunit.client.1.smithi159.stdout:8/808: fdatasync d1/d26/d48/f57 0 2022-02-02T18:23:10.774 INFO:tasks.workunit.client.1.smithi159.stdout:8/809: dread d1/dd/d1a/d53/f72 [0,4194304] 0 2022-02-02T18:23:10.781 INFO:tasks.workunit.client.1.smithi159.stdout:8/810: dread d1/dd/d1a/f86 [0,4194304] 0 2022-02-02T18:23:10.787 INFO:tasks.workunit.client.1.smithi159.stdout:8/811: getdents d1/dd/d1a/d53 0 2022-02-02T18:23:10.787 INFO:tasks.workunit.client.1.smithi159.stdout:8/812: chown d1/dc/f41 767583 1 2022-02-02T18:23:10.788 INFO:tasks.workunit.client.1.smithi159.stdout:8/813: write d1/dd/d1a/d53/fe1 [417983,28895] 0 2022-02-02T18:23:10.788 INFO:tasks.workunit.client.1.smithi159.stdout:8/814: write d1/dd/d1a/d53/f74 [4054114,115070] 0 2022-02-02T18:23:10.789 INFO:tasks.workunit.client.1.smithi159.stdout:8/815: truncate d1/dd/d1a/f9a 4735468 0 2022-02-02T18:23:10.789 INFO:tasks.workunit.client.1.smithi159.stdout:8/816: mknod d1/dd/d31/dcb/c117 0 2022-02-02T18:23:10.790 INFO:tasks.workunit.client.1.smithi159.stdout:8/817: readlink d1/l4d 0 2022-02-02T18:23:10.793 INFO:tasks.workunit.client.1.smithi159.stdout:3/733: sync 2022-02-02T18:23:10.793 INFO:tasks.workunit.client.1.smithi159.stdout:4/674: sync 2022-02-02T18:23:10.793 INFO:tasks.workunit.client.1.smithi159.stdout:0/783: sync 2022-02-02T18:23:10.795 INFO:tasks.workunit.client.1.smithi159.stdout:4/675: getdents d0/d8/d24/d4f 0 2022-02-02T18:23:10.796 INFO:tasks.workunit.client.1.smithi159.stdout:0/784: creat d1/d11/d38/f108 x:0 0 0 2022-02-02T18:23:10.796 INFO:tasks.workunit.client.1.smithi159.stdout:4/676: truncate d0/d8/d24/d3a/f60 8999688 0 2022-02-02T18:23:10.797 INFO:tasks.workunit.client.1.smithi159.stdout:4/677: getdents d0/d66 0 2022-02-02T18:23:10.797 INFO:tasks.workunit.client.1.smithi159.stdout:0/785: symlink d1/d11/d38/d42/d47/l109 0 2022-02-02T18:23:10.797 INFO:tasks.workunit.client.1.smithi159.stdout:0/786: fdatasync d1/d19/f69 0 2022-02-02T18:23:10.798 INFO:tasks.workunit.client.1.smithi159.stdout:4/678: creat d0/d8/d41/db7/d36/d4b/fe5 x:0 0 0 2022-02-02T18:23:10.798 INFO:tasks.workunit.client.1.smithi159.stdout:0/787: symlink d1/dd/d4b/da7/dc1/l10a 0 2022-02-02T18:23:10.799 INFO:tasks.workunit.client.1.smithi159.stdout:4/679: rmdir d0/d8/d41/db7 39 2022-02-02T18:23:10.800 INFO:tasks.workunit.client.1.smithi159.stdout:0/788: write d1/d19/d3d/f40 [642193,22456] 0 2022-02-02T18:23:10.800 INFO:tasks.workunit.client.1.smithi159.stdout:0/789: truncate d1/dd/f98 933675 0 2022-02-02T18:23:10.801 INFO:tasks.workunit.client.1.smithi159.stdout:4/680: getdents d0/d8/d15/d61/dd9 0 2022-02-02T18:23:10.802 INFO:tasks.workunit.client.1.smithi159.stdout:0/790: getdents d1/dd/d4b/ddd 0 2022-02-02T18:23:10.802 INFO:tasks.workunit.client.1.smithi159.stdout:0/791: chown d1/d11/d38/d42/d56/lcf 989064 1 2022-02-02T18:23:10.802 INFO:tasks.workunit.client.1.smithi159.stdout:0/792: readlink d1/d19/lda 0 2022-02-02T18:23:10.803 INFO:tasks.workunit.client.1.smithi159.stdout:4/681: mknod d0/d7b/dc8/ce6 0 2022-02-02T18:23:10.803 INFO:tasks.workunit.client.1.smithi159.stdout:0/793: mkdir d1/dd/d4b/ddd/d10b 0 2022-02-02T18:23:10.805 INFO:tasks.workunit.client.1.smithi159.stdout:3/734: dread fc [0,4194304] 0 2022-02-02T18:23:10.807 INFO:tasks.workunit.client.1.smithi159.stdout:3/735: unlink dd/d19/d38/f3d 0 2022-02-02T18:23:10.810 INFO:tasks.workunit.client.1.smithi159.stdout:0/794: write d1/d11/f35 [4126290,3096] 0 2022-02-02T18:23:10.812 INFO:tasks.workunit.client.1.smithi159.stdout:0/795: mkdir d1/d11/d38/d42/daf/d10c 0 2022-02-02T18:23:10.812 INFO:tasks.workunit.client.1.smithi159.stdout:0/796: write d1/d11/d38/d7e/f90 [5147293,67726] 0 2022-02-02T18:23:10.821 INFO:tasks.workunit.client.1.smithi159.stdout:8/818: dwrite d1/d26/d48/d49/f9b [0,4194304] 0 2022-02-02T18:23:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:8/819: link d1/d26/d48/d107/d8a/f10d d1/dad/d95/daa/f118 0 2022-02-02T18:23:10.825 INFO:tasks.workunit.client.1.smithi159.stdout:8/820: link d1/d26/d48/ff4 d1/db7/f119 0 2022-02-02T18:23:10.825 INFO:tasks.workunit.client.1.smithi159.stdout:8/821: read d1/dd/d1a/d53/fe1 [243676,13406] 0 2022-02-02T18:23:10.826 INFO:tasks.workunit.client.1.smithi159.stdout:4/682: dwrite d0/d8/d41/db7/da3/faa [4194304,4194304] 0 2022-02-02T18:23:10.827 INFO:tasks.workunit.client.1.smithi159.stdout:8/822: creat d1/dd/d31/dcb/f11a x:0 0 0 2022-02-02T18:23:10.830 INFO:tasks.workunit.client.1.smithi159.stdout:0/797: dread d1/d19/d3d/f45 [4194304,4194304] 0 2022-02-02T18:23:10.830 INFO:tasks.workunit.client.1.smithi159.stdout:8/823: unlink d1/d26/ce9 0 2022-02-02T18:23:10.831 INFO:tasks.workunit.client.1.smithi159.stdout:8/824: mkdir d1/dd/d2c/df6/dca/d11b 0 2022-02-02T18:23:10.839 INFO:tasks.workunit.client.1.smithi159.stdout:3/736: dwrite dd/d19/d38/d3f/d80/fa0 [0,4194304] 0 2022-02-02T18:23:10.840 INFO:tasks.workunit.client.1.smithi159.stdout:0/798: dread d1/fc [0,4194304] 0 2022-02-02T18:23:10.841 INFO:tasks.workunit.client.1.smithi159.stdout:8/825: dread d1/d26/fbb [0,4194304] 0 2022-02-02T18:23:10.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/737: mknod dd/d66/d69/db0/ced 0 2022-02-02T18:23:10.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/738: fsync dd/f18 0 2022-02-02T18:23:10.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/739: chown dd/d66/d69/l83 46957 1 2022-02-02T18:23:10.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/740: truncate dd/d20/d2a/d31/fbc 332433 0 2022-02-02T18:23:10.843 INFO:tasks.workunit.client.1.smithi159.stdout:0/799: read d1/d11/d38/d42/daf/f5e [2044588,101418] 0 2022-02-02T18:23:10.847 INFO:tasks.workunit.client.1.smithi159.stdout:0/800: truncate d1/f5a 1033424 0 2022-02-02T18:23:10.847 INFO:tasks.workunit.client.1.smithi159.stdout:0/801: fdatasync d1/d19/d3d/f82 0 2022-02-02T18:23:10.847 INFO:tasks.workunit.client.1.smithi159.stdout:0/802: chown d1/dd/d4b/da7/cc3 44008462 1 2022-02-02T18:23:10.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/803: truncate d1/d19/f69 1604855 0 2022-02-02T18:23:10.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/804: chown d1/dd/d4b/d7d/f100 10108333 1 2022-02-02T18:23:10.848 INFO:tasks.workunit.client.1.smithi159.stdout:3/741: rename dd/d66/da1 to dd/d19/d38/d3f/d80/dee 0 2022-02-02T18:23:10.848 INFO:tasks.workunit.client.1.smithi159.stdout:3/742: write fc [980119,129722] 0 2022-02-02T18:23:10.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/805: mkdir d1/d11/d38/d7e/d10d 0 2022-02-02T18:23:10.849 INFO:tasks.workunit.client.1.smithi159.stdout:3/743: truncate dd/d19/d38/d3f/d52/f5b 1914398 0 2022-02-02T18:23:10.850 INFO:tasks.workunit.client.1.smithi159.stdout:3/744: mknod dd/d19/d38/d3f/d7d/d86/cef 0 2022-02-02T18:23:10.850 INFO:tasks.workunit.client.1.smithi159.stdout:4/683: dwrite d0/d8/d15/d61/fa9 [0,4194304] 0 2022-02-02T18:23:10.853 INFO:tasks.workunit.client.1.smithi159.stdout:3/745: creat dd/d66/ff0 x:0 0 0 2022-02-02T18:23:10.855 INFO:tasks.workunit.client.1.smithi159.stdout:4/684: mkdir d0/d7b/dc8/de7 0 2022-02-02T18:23:10.858 INFO:tasks.workunit.client.1.smithi159.stdout:3/746: rename dd/d19/fae to dd/d19/d38/d3f/d80/dee/da4/ff1 0 2022-02-02T18:23:10.863 INFO:tasks.workunit.client.1.smithi159.stdout:3/747: dread dd/d66/d92/f45 [0,4194304] 0 2022-02-02T18:23:10.864 INFO:tasks.workunit.client.1.smithi159.stdout:3/748: mknod dd/d19/d38/d3f/d52/cf2 0 2022-02-02T18:23:10.873 INFO:tasks.workunit.client.1.smithi159.stdout:3/749: dread dd/d66/d92/d51/f7e [0,4194304] 0 2022-02-02T18:23:10.874 INFO:tasks.workunit.client.1.smithi159.stdout:3/750: truncate dd/d19/f24 35538 0 2022-02-02T18:23:10.875 INFO:tasks.workunit.client.1.smithi159.stdout:3/751: symlink dd/d19/d38/d3f/d7d/d86/lf3 0 2022-02-02T18:23:10.876 INFO:tasks.workunit.client.1.smithi159.stdout:4/685: dwrite d0/f2d [0,4194304] 0 2022-02-02T18:23:10.877 INFO:tasks.workunit.client.1.smithi159.stdout:4/686: getdents d0/d8/d41/db7 0 2022-02-02T18:23:10.878 INFO:tasks.workunit.client.1.smithi159.stdout:3/752: unlink dd/d20/f89 0 2022-02-02T18:23:10.878 INFO:tasks.workunit.client.1.smithi159.stdout:3/753: write dd/d66/d69/d77/fcd [910188,1736] 0 2022-02-02T18:23:10.880 INFO:tasks.workunit.client.1.smithi159.stdout:3/754: symlink dd/d19/d38/lf4 0 2022-02-02T18:23:10.880 INFO:tasks.workunit.client.1.smithi159.stdout:3/755: chown dd/d19/d38/d3f/f7a 213972 1 2022-02-02T18:23:10.880 INFO:tasks.workunit.client.1.smithi159.stdout:3/756: dread - dd/d66/d69/d77/fc1 zero size 2022-02-02T18:23:10.882 INFO:tasks.workunit.client.1.smithi159.stdout:4/687: rename d0/d8/f10 to d0/d8/d30/d5d/fe8 0 2022-02-02T18:23:10.883 INFO:tasks.workunit.client.1.smithi159.stdout:3/757: creat dd/d19/d38/d3f/d80/dee/ff5 x:0 0 0 2022-02-02T18:23:10.886 INFO:tasks.workunit.client.1.smithi159.stdout:3/758: creat dd/d19/ff6 x:0 0 0 2022-02-02T18:23:10.888 INFO:tasks.workunit.client.1.smithi159.stdout:3/759: creat dd/d20/ff7 x:0 0 0 2022-02-02T18:23:10.895 INFO:tasks.workunit.client.1.smithi159.stdout:4/688: truncate d0/d8/f20 3537277 0 2022-02-02T18:23:10.896 INFO:tasks.workunit.client.1.smithi159.stdout:4/689: rmdir d0/d8/d30/d7e 39 2022-02-02T18:23:10.896 INFO:tasks.workunit.client.1.smithi159.stdout:4/690: fdatasync d0/d8/f3c 0 2022-02-02T18:23:10.897 INFO:tasks.workunit.client.1.smithi159.stdout:4/691: symlink d0/d8/d24/le9 0 2022-02-02T18:23:10.916 INFO:tasks.workunit.client.1.smithi159.stdout:3/760: dwrite dd/d19/d38/d3f/d52/f58 [0,4194304] 0 2022-02-02T18:23:10.926 INFO:tasks.workunit.client.1.smithi159.stdout:4/692: dwrite d0/d8/fb3 [0,4194304] 0 2022-02-02T18:23:10.927 INFO:tasks.workunit.client.1.smithi159.stdout:4/693: dread - d0/d8/d24/d4f/fa8 zero size 2022-02-02T18:23:10.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/694: chown d0/d8/d30/l84 224 1 2022-02-02T18:23:10.930 INFO:tasks.workunit.client.1.smithi159.stdout:4/695: mkdir d0/d8/d30/d7e/dea 0 2022-02-02T18:23:10.931 INFO:tasks.workunit.client.1.smithi159.stdout:4/696: unlink d0/d8/d30/d5d/c8b 0 2022-02-02T18:23:10.934 INFO:tasks.workunit.client.1.smithi159.stdout:4/697: link d0/d8/d41/db7/d33/fbf d0/d8/d30/feb 0 2022-02-02T18:23:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:4/698: chown d0/d8/d24/d76/f78 332 1 2022-02-02T18:23:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:4/699: dread - d0/d8/d41/db7/d36/fa6 zero size 2022-02-02T18:23:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:4/700: fdatasync d0/d8/d41/db7/d33/d47/f53 0 2022-02-02T18:23:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:4/701: stat d0/d8/d24/d3a 0 2022-02-02T18:23:10.936 INFO:tasks.workunit.client.1.smithi159.stdout:4/702: write d0/d8/d15/d61/f95 [598135,20267] 0 2022-02-02T18:23:10.936 INFO:tasks.workunit.client.1.smithi159.stdout:4/703: stat d0/d8/d24/fdd 0 2022-02-02T18:23:10.936 INFO:tasks.workunit.client.1.smithi159.stdout:4/704: write d0/d8/d30/d5d/f90 [247399,52489] 0 2022-02-02T18:23:10.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/705: read d0/d8/d41/db7/d33/d47/f53 [196497,21658] 0 2022-02-02T18:23:10.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/706: mkdir d0/dec 0 2022-02-02T18:23:10.938 INFO:tasks.workunit.client.1.smithi159.stdout:4/707: read d0/d8/d41/db7/d33/d47/d56/f8a [394440,104820] 0 2022-02-02T18:23:10.949 INFO:tasks.workunit.client.1.smithi159.stdout:4/708: dread d0/d8/f20 [0,4194304] 0 2022-02-02T18:23:10.949 INFO:tasks.workunit.client.1.smithi159.stdout:4/709: creat d0/d8/d41/db7/d36/d4b/fed x:0 0 0 2022-02-02T18:23:10.950 INFO:tasks.workunit.client.1.smithi159.stdout:4/710: creat d0/d7b/fee x:0 0 0 2022-02-02T18:23:10.951 INFO:tasks.workunit.client.1.smithi159.stdout:4/711: creat d0/d8/d41/db7/d33/dc0/fef x:0 0 0 2022-02-02T18:23:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:4/712: creat d0/d8/d24/d3a/ff0 x:0 0 0 2022-02-02T18:23:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:3/761: dwrite dd/d19/f1b [0,4194304] 0 2022-02-02T18:23:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:4/713: dread - d0/d8/f7c zero size 2022-02-02T18:23:10.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/762: symlink dd/d66/d69/db0/lf8 0 2022-02-02T18:23:10.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/763: readlink dd/d19/d38/d3f/d80/l87 0 2022-02-02T18:23:10.955 INFO:tasks.workunit.client.1.smithi159.stdout:3/764: rmdir dd/d19/d38/d3f/d80/dee/da4 39 2022-02-02T18:23:10.957 INFO:tasks.workunit.client.1.smithi159.stdout:3/765: creat dd/d66/d82/ff9 x:0 0 0 2022-02-02T18:23:10.957 INFO:tasks.workunit.client.1.smithi159.stdout:3/766: truncate dd/d20/d60/fa8 1393374 0 2022-02-02T18:23:10.958 INFO:tasks.workunit.client.1.smithi159.stdout:3/767: mkdir dd/d20/dfa 0 2022-02-02T18:23:10.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/768: creat dd/d66/d92/ffb x:0 0 0 2022-02-02T18:23:10.963 INFO:tasks.workunit.client.1.smithi159.stdout:3/769: rename c2 to dd/d19/d38/d3f/dbb/cfc 0 2022-02-02T18:23:10.965 INFO:tasks.workunit.client.1.smithi159.stdout:3/770: write dd/d19/d38/d3f/d80/dee/db5/fbd [1701853,108932] 0 2022-02-02T18:23:10.966 INFO:tasks.workunit.client.1.smithi159.stdout:4/714: write d0/d8/d41/f74 [836640,114663] 0 2022-02-02T18:23:10.969 INFO:tasks.workunit.client.1.smithi159.stdout:3/771: unlink dd/d66/d92/d51/c7b 0 2022-02-02T18:23:10.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/715: unlink d0/d8/d41/db7/d33/c6b 0 2022-02-02T18:23:10.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/716: chown d0/d8/d41/c4c 548 1 2022-02-02T18:23:10.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/717: creat d0/d8/d41/db7/d36/d4b/ff1 x:0 0 0 2022-02-02T18:23:10.971 INFO:tasks.workunit.client.1.smithi159.stdout:4/718: creat d0/d8/d41/db7/d33/d47/ff2 x:0 0 0 2022-02-02T18:23:10.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/719: fsync d0/d8/d41/f9d 0 2022-02-02T18:23:10.974 INFO:tasks.workunit.client.1.smithi159.stdout:4/720: link d0/d8/d30/d7e/lc2 d0/d8/d41/db7/d33/d47/d56/lf3 0 2022-02-02T18:23:10.975 INFO:tasks.workunit.client.1.smithi159.stdout:4/721: mknod d0/d8/d41/db7/d33/cf4 0 2022-02-02T18:23:10.976 INFO:tasks.workunit.client.1.smithi159.stdout:4/722: write d0/d8/f28 [5210770,105137] 0 2022-02-02T18:23:10.976 INFO:tasks.workunit.client.1.smithi159.stdout:4/723: unlink d0/d8/d30/d7e/d9c/lb8 0 2022-02-02T18:23:10.977 INFO:tasks.workunit.client.1.smithi159.stdout:4/724: rmdir d0/d8/d24/d76 39 2022-02-02T18:23:10.981 INFO:tasks.workunit.client.1.smithi159.stdout:4/725: write d0/f3 [5168898,7377] 0 2022-02-02T18:23:10.981 INFO:tasks.workunit.client.1.smithi159.stdout:4/726: fsync d0/d8/f20 0 2022-02-02T18:23:10.989 INFO:tasks.workunit.client.1.smithi159.stdout:3/772: dwrite dd/d66/f9b [0,4194304] 0 2022-02-02T18:23:10.990 INFO:tasks.workunit.client.1.smithi159.stdout:3/773: fsync dd/d19/d38/d3f/d80/fdf 0 2022-02-02T18:23:10.990 INFO:tasks.workunit.client.1.smithi159.stdout:3/774: stat dd/d19/d38/d3f/d80/d8a/fa6 0 2022-02-02T18:23:11.003 INFO:tasks.workunit.client.1.smithi159.stdout:3/775: dwrite dd/d20/d2a/f75 [4194304,4194304] 0 2022-02-02T18:23:11.004 INFO:tasks.workunit.client.1.smithi159.stdout:3/776: write dd/d19/d38/d3f/d80/d8a/f9d [405180,118774] 0 2022-02-02T18:23:11.004 INFO:tasks.workunit.client.1.smithi159.stdout:3/777: fsync dd/d20/f64 0 2022-02-02T18:23:11.004 INFO:tasks.workunit.client.1.smithi159.stdout:3/778: dread - dd/f65 zero size 2022-02-02T18:23:11.007 INFO:tasks.workunit.client.1.smithi159.stdout:3/779: mkdir dd/d19/d35/dfd 0 2022-02-02T18:23:11.009 INFO:tasks.workunit.client.1.smithi159.stdout:3/780: rename dd/d20/d2a/d31/fbc to dd/d66/d82/dd4/ffe 0 2022-02-02T18:23:11.011 INFO:tasks.workunit.client.1.smithi159.stdout:3/781: creat dd/d19/d35/dfd/fff x:0 0 0 2022-02-02T18:23:11.012 INFO:tasks.workunit.client.1.smithi159.stdout:3/782: read - dd/d19/d38/d3f/d80/fdf zero size 2022-02-02T18:23:11.012 INFO:tasks.workunit.client.1.smithi159.stdout:3/783: mkdir dd/d66/d69/d100 0 2022-02-02T18:23:11.013 INFO:tasks.workunit.client.1.smithi159.stdout:3/784: symlink dd/d66/d69/db0/dc8/l101 0 2022-02-02T18:23:11.013 INFO:tasks.workunit.client.1.smithi159.stdout:3/785: fdatasync dd/d20/d2a/f4a 0 2022-02-02T18:23:11.016 INFO:tasks.workunit.client.1.smithi159.stdout:3/786: symlink dd/d66/d82/db6/l102 0 2022-02-02T18:23:11.017 INFO:tasks.workunit.client.1.smithi159.stdout:3/787: fsync dd/d66/fb7 0 2022-02-02T18:23:11.017 INFO:tasks.workunit.client.1.smithi159.stdout:3/788: write dd/d19/d38/d3f/dbb/fda [204030,6537] 0 2022-02-02T18:23:11.018 INFO:tasks.workunit.client.1.smithi159.stdout:3/789: rename dd/d19/d38/lf4 to dd/d19/d38/d3f/d80/dee/da4/l103 0 2022-02-02T18:23:11.018 INFO:tasks.workunit.client.1.smithi159.stdout:3/790: truncate fc 5827030 0 2022-02-02T18:23:11.019 INFO:tasks.workunit.client.1.smithi159.stdout:3/791: getdents dd/d66/d69/d100 0 2022-02-02T18:23:11.019 INFO:tasks.workunit.client.1.smithi159.stdout:3/792: fdatasync dd/f18 0 2022-02-02T18:23:11.039 INFO:tasks.workunit.client.1.smithi159.stdout:3/793: dwrite dd/d66/d69/d77/fb2 [0,4194304] 0 2022-02-02T18:23:11.039 INFO:tasks.workunit.client.1.smithi159.stdout:3/794: write dd/d19/d38/d3f/d80/dee/ff5 [973811,41357] 0 2022-02-02T18:23:11.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/795: truncate dd/d20/d2a/d31/f57 2454172 0 2022-02-02T18:23:11.042 INFO:tasks.workunit.client.1.smithi159.stdout:3/796: dread dd/d20/d2a/f68 [0,4194304] 0 2022-02-02T18:23:11.044 INFO:tasks.workunit.client.1.smithi159.stdout:3/797: mkdir dd/d19/d104 0 2022-02-02T18:23:11.044 INFO:tasks.workunit.client.1.smithi159.stdout:3/798: write dd/d19/d38/d3f/d80/fa0 [5055089,59756] 0 2022-02-02T18:23:11.046 INFO:tasks.workunit.client.1.smithi159.stdout:3/799: mknod dd/d19/d38/d3f/c105 0 2022-02-02T18:23:11.050 INFO:tasks.workunit.client.1.smithi159.stdout:3/800: unlink dd/d19/d38/fd3 0 2022-02-02T18:23:11.051 INFO:tasks.workunit.client.1.smithi159.stdout:3/801: link dd/d20/c27 dd/d19/d38/d3f/d80/dee/db5/c106 0 2022-02-02T18:23:11.052 INFO:tasks.workunit.client.1.smithi159.stdout:3/802: unlink dd/d19/d35/f8c 0 2022-02-02T18:23:11.061 INFO:tasks.workunit.client.1.smithi159.stdout:3/803: dread dd/d20/d2a/d31/f76 [0,4194304] 0 2022-02-02T18:23:11.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/804: truncate dd/f11 2640203 0 2022-02-02T18:23:11.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/805: chown dd/d19/d38/d3f/d80/dee/lc0 60543650 1 2022-02-02T18:23:11.064 INFO:tasks.workunit.client.1.smithi159.stdout:3/806: chown dd/d19/f4e 3 1 2022-02-02T18:23:11.064 INFO:tasks.workunit.client.1.smithi159.stdout:3/807: fdatasync dd/d20/d60/f85 0 2022-02-02T18:23:11.065 INFO:tasks.workunit.client.1.smithi159.stdout:3/808: readlink la 0 2022-02-02T18:23:11.065 INFO:tasks.workunit.client.1.smithi159.stdout:3/809: read dd/d19/d35/f8f [36148,56396] 0 2022-02-02T18:23:11.072 INFO:tasks.workunit.client.1.smithi159.stdout:3/810: dread dd/d66/d92/d51/f7e [0,4194304] 0 2022-02-02T18:23:11.073 INFO:tasks.workunit.client.1.smithi159.stdout:3/811: write dd/d19/d38/d3f/d52/fe8 [232405,88908] 0 2022-02-02T18:23:11.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/812: dwrite dd/d19/d35/f8f [0,4194304] 0 2022-02-02T18:23:11.102 INFO:tasks.workunit.client.1.smithi159.stdout:3/813: dwrite dd/d19/d38/d3f/dd1/fe0 [0,4194304] 0 2022-02-02T18:23:11.104 INFO:tasks.workunit.client.1.smithi159.stdout:3/814: mknod dd/d19/d38/d3f/dd1/c107 0 2022-02-02T18:23:11.104 INFO:tasks.workunit.client.1.smithi159.stdout:3/815: chown dd/d19/d38/fac 1839619759 1 2022-02-02T18:23:11.105 INFO:tasks.workunit.client.1.smithi159.stdout:3/816: chown dd/d19/d38/d3f/d80/dee 1 1 2022-02-02T18:23:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:3/817: dwrite dd/d20/d60/faa [0,4194304] 0 2022-02-02T18:23:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:3/818: truncate dd/d19/d38/d3f/dbb/fda 897985 0 2022-02-02T18:23:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:3/819: truncate dd/d19/d38/d3f/d7d/f9c 483595 0 2022-02-02T18:23:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:3/820: write dd/d66/d92/f45 [1194677,126884] 0 2022-02-02T18:23:11.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/821: dread dd/d66/d69/d77/fcd [0,4194304] 0 2022-02-02T18:23:11.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/822: dwrite dd/f34 [4194304,4194304] 0 2022-02-02T18:23:11.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/823: write dd/d19/d38/d3f/d80/dee/db5/fc5 [745642,50586] 0 2022-02-02T18:23:11.141 INFO:tasks.workunit.client.1.smithi159.stdout:3/824: mkdir dd/d66/d69/db0/dc8/d108 0 2022-02-02T18:23:11.142 INFO:tasks.workunit.client.1.smithi159.stdout:3/825: mknod dd/d19/d38/d3f/d80/d8a/c109 0 2022-02-02T18:23:11.142 INFO:tasks.workunit.client.1.smithi159.stdout:3/826: stat dd/d19/d35/f59 0 2022-02-02T18:23:11.144 INFO:tasks.workunit.client.1.smithi159.stdout:3/827: rename dd/f1c to dd/d19/d38/d3f/d80/d97/f10a 0 2022-02-02T18:23:11.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/727: sync 2022-02-02T18:23:11.146 INFO:tasks.workunit.client.1.smithi159.stdout:2/946: sync 2022-02-02T18:23:11.146 INFO:tasks.workunit.client.1.smithi159.stdout:9/800: sync 2022-02-02T18:23:11.147 INFO:tasks.workunit.client.1.smithi159.stdout:2/947: mknod da/dce/c147 0 2022-02-02T18:23:11.147 INFO:tasks.workunit.client.1.smithi159.stdout:2/948: unlink da/d1c/dd7/df1/l10d 0 2022-02-02T18:23:11.148 INFO:tasks.workunit.client.1.smithi159.stdout:1/728: mknod df/d21/d23/de7/c110 0 2022-02-02T18:23:11.149 INFO:tasks.workunit.client.1.smithi159.stdout:2/949: rmdir da/dce 39 2022-02-02T18:23:11.150 INFO:tasks.workunit.client.1.smithi159.stdout:1/729: getdents df/d21/dce 0 2022-02-02T18:23:11.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/730: mkdir df/d14/d16/d4b/dcc/dde/d10a/d111 0 2022-02-02T18:23:11.151 INFO:tasks.workunit.client.1.smithi159.stdout:2/950: rename da/d1c/d47/d54/fa1 to da/d1c/d25/d73/dab/df5/f148 0 2022-02-02T18:23:11.152 INFO:tasks.workunit.client.1.smithi159.stdout:2/951: write da/d1c/d42/d45/ffa [1090894,51879] 0 2022-02-02T18:23:11.152 INFO:tasks.workunit.client.1.smithi159.stdout:9/801: write d4/d2a/f6e [3849315,30113] 0 2022-02-02T18:23:11.153 INFO:tasks.workunit.client.1.smithi159.stdout:1/731: creat df/d14/d16/d4b/dcc/dde/d10a/f112 x:0 0 0 2022-02-02T18:23:11.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/952: unlink da/d1c/d42/d139/d6c/f122 0 2022-02-02T18:23:11.160 INFO:tasks.workunit.client.1.smithi159.stdout:1/732: creat df/d21/d23/d49/d69/d81/f113 x:0 0 0 2022-02-02T18:23:11.167 INFO:tasks.workunit.client.1.smithi159.stdout:3/828: dwrite dd/d66/fb7 [0,4194304] 0 2022-02-02T18:23:11.181 INFO:tasks.workunit.client.1.smithi159.stdout:2/953: dwrite da/d1c/d47/fbc [0,4194304] 0 2022-02-02T18:23:11.182 INFO:tasks.workunit.client.1.smithi159.stdout:2/954: chown da/d1c/d47/f64 1 1 2022-02-02T18:23:11.183 INFO:tasks.workunit.client.1.smithi159.stdout:2/955: rename da to da/d48/d6d/d3e/d149 22 2022-02-02T18:23:11.184 INFO:tasks.workunit.client.1.smithi159.stdout:2/956: truncate da/d40/f37 233512 0 2022-02-02T18:23:11.185 INFO:tasks.workunit.client.1.smithi159.stdout:2/957: chown da/d1c/d47/d6b/d59/fb4 147 1 2022-02-02T18:23:11.186 INFO:tasks.workunit.client.1.smithi159.stdout:2/958: creat da/d1c/d25/d128/f14a x:0 0 0 2022-02-02T18:23:11.187 INFO:tasks.workunit.client.1.smithi159.stdout:2/959: write da/d1c/d47/d6b/d59/fa2 [1366083,69499] 0 2022-02-02T18:23:11.187 INFO:tasks.workunit.client.1.smithi159.stdout:2/960: write da/d1c/d47/f12b [198545,10015] 0 2022-02-02T18:23:11.188 INFO:tasks.workunit.client.1.smithi159.stdout:2/961: creat da/dce/f14b x:0 0 0 2022-02-02T18:23:11.188 INFO:tasks.workunit.client.1.smithi159.stdout:1/733: dwrite df/d14/d16/d4b/d5b/fea [0,4194304] 0 2022-02-02T18:23:11.191 INFO:tasks.workunit.client.1.smithi159.stdout:2/962: write da/d1c/d76/f87 [2106977,5343] 0 2022-02-02T18:23:11.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/734: rename df/d21/dce to df/d21/d23/d49/da1/d114 0 2022-02-02T18:23:11.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/735: fdatasync df/d21/deb/f10c 0 2022-02-02T18:23:11.193 INFO:tasks.workunit.client.1.smithi159.stdout:2/963: unlink da/d40/cbb 0 2022-02-02T18:23:11.194 INFO:tasks.workunit.client.1.smithi159.stdout:2/964: chown da/d1c/d47/d6b/d59/d121/l131 139917740 1 2022-02-02T18:23:11.194 INFO:tasks.workunit.client.1.smithi159.stdout:1/736: link df/d21/d23/d49/da1/lf1 df/d21/d23/d49/da1/dd4/l115 0 2022-02-02T18:23:11.200 INFO:tasks.workunit.client.1.smithi159.stdout:9/802: dwrite d4/f16 [0,4194304] 0 2022-02-02T18:23:11.200 INFO:tasks.workunit.client.1.smithi159.stdout:9/803: write d4/d19/d1c/f67 [8348,88189] 0 2022-02-02T18:23:11.202 INFO:tasks.workunit.client.1.smithi159.stdout:2/965: dread da/d1c/d47/d6b/d5a/f7b [0,4194304] 0 2022-02-02T18:23:11.202 INFO:tasks.workunit.client.1.smithi159.stdout:2/966: fdatasync da/d1c/d47/d6b/ffc 0 2022-02-02T18:23:11.205 INFO:tasks.workunit.client.1.smithi159.stdout:1/737: dread df/d14/f91 [0,4194304] 0 2022-02-02T18:23:11.205 INFO:tasks.workunit.client.1.smithi159.stdout:3/829: dwrite dd/d19/d38/d3f/d52/fcf [0,4194304] 0 2022-02-02T18:23:11.209 INFO:tasks.workunit.client.1.smithi159.stdout:3/830: mkdir dd/d66/d82/dd4/d10b 0 2022-02-02T18:23:11.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/738: creat df/d14/d16/d4b/dcc/dde/f116 x:0 0 0 2022-02-02T18:23:11.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/739: stat df/d14/d16/da8/fe5 0 2022-02-02T18:23:11.212 INFO:tasks.workunit.client.1.smithi159.stdout:1/740: getdents df/d14/d16/da8 0 2022-02-02T18:23:11.213 INFO:tasks.workunit.client.1.smithi159.stdout:3/831: read dd/d19/d35/fa9 [1390502,102899] 0 2022-02-02T18:23:11.214 INFO:tasks.workunit.client.1.smithi159.stdout:3/832: mkdir dd/d19/d35/d10c 0 2022-02-02T18:23:11.219 INFO:tasks.workunit.client.1.smithi159.stdout:3/833: write dd/d19/d35/fa9 [3244446,67243] 0 2022-02-02T18:23:11.219 INFO:tasks.workunit.client.1.smithi159.stdout:3/834: fsync dd/d19/d35/f8f 0 2022-02-02T18:23:11.220 INFO:tasks.workunit.client.1.smithi159.stdout:9/804: dwrite d4/d2a/d87/da1/fa6 [0,4194304] 0 2022-02-02T18:23:11.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/805: readlink d4/d19/d6f/d74/d108/lfc 0 2022-02-02T18:23:11.221 INFO:tasks.workunit.client.1.smithi159.stdout:3/835: symlink dd/d66/d82/db6/l10d 0 2022-02-02T18:23:11.222 INFO:tasks.workunit.client.1.smithi159.stdout:3/836: chown dd/d66/d69/f84 7360 1 2022-02-02T18:23:11.224 INFO:tasks.workunit.client.1.smithi159.stdout:9/806: dread d4/d19/d6f/d78/fa7 [0,4194304] 0 2022-02-02T18:23:11.224 INFO:tasks.workunit.client.1.smithi159.stdout:9/807: readlink d4/d19/d1c/d1f/lc4 0 2022-02-02T18:23:11.226 INFO:tasks.workunit.client.1.smithi159.stdout:9/808: unlink d4/d7a/fd0 0 2022-02-02T18:23:11.226 INFO:tasks.workunit.client.1.smithi159.stdout:9/809: read - d4/d19/d42/daf/dd7/fd8 zero size 2022-02-02T18:23:11.227 INFO:tasks.workunit.client.1.smithi159.stdout:9/810: truncate d4/d19/d6f/d74/db1/fb5 1205108 0 2022-02-02T18:23:11.230 INFO:tasks.workunit.client.1.smithi159.stdout:3/837: write dd/f34 [3824281,5201] 0 2022-02-02T18:23:11.230 INFO:tasks.workunit.client.1.smithi159.stdout:3/838: fdatasync dd/d20/f54 0 2022-02-02T18:23:11.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/839: getdents dd/d66/d69/d100 0 2022-02-02T18:23:11.231 INFO:tasks.workunit.client.1.smithi159.stdout:2/967: dwrite da/d1c/d47/d6b/d5a/d7e/f82 [0,4194304] 0 2022-02-02T18:23:11.231 INFO:tasks.workunit.client.1.smithi159.stdout:2/968: truncate da/d48/fcd 5294340 0 2022-02-02T18:23:11.232 INFO:tasks.workunit.client.1.smithi159.stdout:2/969: fdatasync da/d1c/d47/fe9 0 2022-02-02T18:23:11.233 INFO:tasks.workunit.client.1.smithi159.stdout:1/741: dwrite df/d21/d23/d49/d69/d81/f113 [0,4194304] 0 2022-02-02T18:23:11.234 INFO:tasks.workunit.client.1.smithi159.stdout:1/742: write df/d21/d23/d49/da1/d114/fb7 [563409,47215] 0 2022-02-02T18:23:11.234 INFO:tasks.workunit.client.1.smithi159.stdout:1/743: chown df/d21/d23/d49/d69/d81/d9b 1 1 2022-02-02T18:23:11.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/840: write f7 [2218514,11302] 0 2022-02-02T18:23:11.241 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:11 smithi159 conmon[35668]: cluster 2022-02-02T18:23:10.545389+0000 mgr.smithi096.shfutl (mgr.14628) 28 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 114 MiB/s wr, 208 op/s 2022-02-02T18:23:11.243 INFO:tasks.workunit.client.1.smithi159.stdout:1/744: creat df/d14/d16/df9/f117 x:0 0 0 2022-02-02T18:23:11.244 INFO:tasks.workunit.client.1.smithi159.stdout:3/841: symlink dd/d19/d35/d10c/l10e 0 2022-02-02T18:23:11.245 INFO:tasks.workunit.client.1.smithi159.stdout:3/842: getdents dd/d19/d38/d3f/d52/db4 0 2022-02-02T18:23:11.246 INFO:tasks.workunit.client.1.smithi159.stdout:3/843: rmdir dd/d66/d69/db0 39 2022-02-02T18:23:11.247 INFO:tasks.workunit.client.1.smithi159.stdout:3/844: read dd/d19/d38/d3f/d52/f58 [4638502,39143] 0 2022-02-02T18:23:11.250 INFO:tasks.workunit.client.1.smithi159.stdout:9/811: dwrite d4/d19/d1c/d21/d56/d59/f7d [0,4194304] 0 2022-02-02T18:23:11.252 INFO:tasks.workunit.client.1.smithi159.stdout:3/845: getdents dd/d20/d60 0 2022-02-02T18:23:11.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/812: creat d4/d19/d1c/d21/da8/db9/dd1/f109 x:0 0 0 2022-02-02T18:23:11.257 INFO:tasks.workunit.client.1.smithi159.stdout:2/970: write da/d1c/d42/d139/fa8 [194020,37958] 0 2022-02-02T18:23:11.260 INFO:tasks.workunit.client.1.smithi159.stdout:8/826: sync 2022-02-02T18:23:11.260 INFO:tasks.workunit.client.1.smithi159.stdout:5/823: sync 2022-02-02T18:23:11.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/769: sync 2022-02-02T18:23:11.264 INFO:tasks.workunit.client.1.smithi159.stdout:6/770: mknod df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/cf9 0 2022-02-02T18:23:11.266 INFO:tasks.workunit.client.1.smithi159.stdout:6/771: mknod df/d35/d2a/d2f/d80/d61/deb/df8/cfa 0 2022-02-02T18:23:11.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/772: mkdir df/d35/d2a/d3f/d55/d6a/d6e/dfb 0 2022-02-02T18:23:11.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/745: dwrite df/d21/d23/f29 [4194304,4194304] 0 2022-02-02T18:23:11.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/746: mkdir df/d14/d16/d4b/dcc/dde/d10a/d118 0 2022-02-02T18:23:11.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/747: fsync df/d14/d16/d4b/d5b/f61 0 2022-02-02T18:23:11.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/748: stat df/d14/d16/d4b/d5b/f8d 0 2022-02-02T18:23:11.272 INFO:tasks.workunit.client.1.smithi159.stdout:6/773: unlink df/d35/d2a/f52 0 2022-02-02T18:23:11.273 INFO:tasks.workunit.client.1.smithi159.stdout:1/749: mkdir df/d14/d16/df9/d119 0 2022-02-02T18:23:11.274 INFO:tasks.workunit.client.1.smithi159.stdout:1/750: mknod df/d14/d16/d4b/da0/c11a 0 2022-02-02T18:23:11.276 INFO:tasks.workunit.client.1.smithi159.stdout:5/824: dread d9/d24/f6d [0,4194304] 0 2022-02-02T18:23:11.277 INFO:tasks.workunit.client.1.smithi159.stdout:5/825: mknod d9/d24/d4a/d8d/cff 0 2022-02-02T18:23:11.278 INFO:tasks.workunit.client.1.smithi159.stdout:6/774: dread df/d35/d2a/d3f/f44 [0,4194304] 0 2022-02-02T18:23:11.278 INFO:tasks.workunit.client.1.smithi159.stdout:6/775: chown df/d35/d2a/d3f/d65 1 1 2022-02-02T18:23:11.279 INFO:tasks.workunit.client.1.smithi159.stdout:6/776: mknod df/d35/d2a/d3f/d42/d89/cfc 0 2022-02-02T18:23:11.280 INFO:tasks.workunit.client.1.smithi159.stdout:6/777: write df/d35/d7b/db4/d84/fac [3299846,24334] 0 2022-02-02T18:23:11.280 INFO:tasks.workunit.client.1.smithi159.stdout:6/778: read - df/d35/d2a/d3f/d42/d47/fb2 zero size 2022-02-02T18:23:11.281 INFO:tasks.workunit.client.1.smithi159.stdout:6/779: stat df/f1e 0 2022-02-02T18:23:11.283 INFO:tasks.workunit.client.1.smithi159.stdout:5/826: mkdir d9/d24/d4a/d52/d100 0 2022-02-02T18:23:11.284 INFO:tasks.workunit.client.1.smithi159.stdout:3/846: dwrite dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:11.284 INFO:tasks.workunit.client.1.smithi159.stdout:6/780: rename df/d35/d2a/d3f/d42/d47/d59/fb3 to df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/ffd 0 2022-02-02T18:23:11.284 INFO:tasks.workunit.client.1.smithi159.stdout:6/781: dread - df/d35/d2a/d3f/d42/d47/fb2 zero size 2022-02-02T18:23:11.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/813: dwrite d4/d7a/db7/fb8 [0,4194304] 0 2022-02-02T18:23:11.286 INFO:tasks.workunit.client.1.smithi159.stdout:3/847: getdents dd/d66/d82/dd4/dd9 0 2022-02-02T18:23:11.286 INFO:tasks.workunit.client.1.smithi159.stdout:3/848: chown dd/l62 12 1 2022-02-02T18:23:11.286 INFO:tasks.workunit.client.1.smithi159.stdout:5/827: rename d9/d2e/c35 to d9/d2e/dd7/d3c/d61/dd6/dba/c101 0 2022-02-02T18:23:11.287 INFO:tasks.workunit.client.1.smithi159.stdout:5/828: creat d9/dfc/f102 x:0 0 0 2022-02-02T18:23:11.289 INFO:tasks.workunit.client.1.smithi159.stdout:3/849: getdents dd/d19/d38/d3f 0 2022-02-02T18:23:11.289 INFO:tasks.workunit.client.1.smithi159.stdout:3/850: write dd/f9e [4564617,107008] 0 2022-02-02T18:23:11.289 INFO:tasks.workunit.client.1.smithi159.stdout:5/829: creat d9/d2e/dd7/d3c/d8c/dd2/f103 x:0 0 0 2022-02-02T18:23:11.290 INFO:tasks.workunit.client.1.smithi159.stdout:5/830: fdatasync d9/fe0 0 2022-02-02T18:23:11.290 INFO:tasks.workunit.client.1.smithi159.stdout:8/827: dwrite d1/d26/d48/d98/f111 [0,4194304] 0 2022-02-02T18:23:11.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/828: fsync d1/db7/d75/de8/ffd 0 2022-02-02T18:23:11.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/829: fdatasync d1/d26/d48/d7f/f100 0 2022-02-02T18:23:11.293 INFO:tasks.workunit.client.1.smithi159.stdout:8/830: rmdir d1/dd/d31/dec/dc0 39 2022-02-02T18:23:11.295 INFO:tasks.workunit.client.1.smithi159.stdout:9/814: rename d4/d19/d6f/d78/lab to d4/d19/d1c/d21/da8/db9/dd1/l10a 0 2022-02-02T18:23:11.296 INFO:tasks.workunit.client.1.smithi159.stdout:0/806: sync 2022-02-02T18:23:11.296 INFO:tasks.workunit.client.1.smithi159.stdout:3/851: mkdir dd/d19/d38/d3f/d52/d10f 0 2022-02-02T18:23:11.296 INFO:tasks.workunit.client.1.smithi159.stdout:3/852: fsync dd/f11 0 2022-02-02T18:23:11.296 INFO:tasks.workunit.client.1.smithi159.stdout:3/853: getdents dd/d19/d38/d3f 0 2022-02-02T18:23:11.297 INFO:tasks.workunit.client.1.smithi159.stdout:3/854: creat dd/d19/d38/d3f/dbb/f110 x:0 0 0 2022-02-02T18:23:11.297 INFO:tasks.workunit.client.1.smithi159.stdout:1/751: dwrite df/d14/d16/d4b/dcc/dde/d10a/f112 [0,4194304] 0 2022-02-02T18:23:11.298 INFO:tasks.workunit.client.1.smithi159.stdout:3/855: read dd/f34 [8021303,8203] 0 2022-02-02T18:23:11.298 INFO:tasks.workunit.client.1.smithi159.stdout:0/807: mkdir d1/dd/d4b/da7/da8/d10e 0 2022-02-02T18:23:11.299 INFO:tasks.workunit.client.1.smithi159.stdout:9/815: symlink d4/d19/d1c/d21/d22/l10b 0 2022-02-02T18:23:11.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/816: mkdir d4/d19/d1c/d21/d41/d9a/de6/d10c 0 2022-02-02T18:23:11.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/817: fsync d4/d19/d6f/d74/f8f 0 2022-02-02T18:23:11.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/818: truncate d4/d19/f1a 1294004 0 2022-02-02T18:23:11.302 INFO:tasks.workunit.client.1.smithi159.stdout:9/819: readlink d4/d19/d1c/d21/d41/d9a/l9b 0 2022-02-02T18:23:11.302 INFO:tasks.workunit.client.1.smithi159.stdout:0/808: rmdir d1/d11/d38/d94/dd7/de6 39 2022-02-02T18:23:11.303 INFO:tasks.workunit.client.1.smithi159.stdout:0/809: stat d1/d11/d38/d42/daf/d34/c86 0 2022-02-02T18:23:11.303 INFO:tasks.workunit.client.1.smithi159.stdout:0/810: creat d1/d11/d8d/f10f x:0 0 0 2022-02-02T18:23:11.306 INFO:tasks.workunit.client.1.smithi159.stdout:0/811: truncate d1/d11/f63 1172589 0 2022-02-02T18:23:11.308 INFO:tasks.workunit.client.1.smithi159.stdout:4/727: sync 2022-02-02T18:23:11.309 INFO:tasks.workunit.client.1.smithi159.stdout:5/831: dread d9/d24/d21/f81 [0,4194304] 0 2022-02-02T18:23:11.312 INFO:tasks.workunit.client.1.smithi159.stdout:0/812: creat d1/dd/d4b/f110 x:0 0 0 2022-02-02T18:23:11.312 INFO:tasks.workunit.client.1.smithi159.stdout:6/782: write df/d35/d2a/d3f/d42/d47/f5e [868616,98850] 0 2022-02-02T18:23:11.313 INFO:tasks.workunit.client.1.smithi159.stdout:3/856: dread dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:11.313 INFO:tasks.workunit.client.1.smithi159.stdout:8/831: dread d1/dd/d2c/df6/dca/fdd [0,4194304] 0 2022-02-02T18:23:11.313 INFO:tasks.workunit.client.1.smithi159.stdout:8/832: stat d1/db7/f119 0 2022-02-02T18:23:11.314 INFO:tasks.workunit.client.1.smithi159.stdout:3/857: write dd/d19/d38/d3f/d80/d8a/f9f [124854,88221] 0 2022-02-02T18:23:11.314 INFO:tasks.workunit.client.1.smithi159.stdout:0/813: symlink d1/d11/d38/d42/d56/l111 0 2022-02-02T18:23:11.315 INFO:tasks.workunit.client.1.smithi159.stdout:5/832: read d9/d2e/dd7/d3c/d8c/dd2/fb6 [1274438,87778] 0 2022-02-02T18:23:11.316 INFO:tasks.workunit.client.1.smithi159.stdout:3/858: rename dd/d19/d35/f8f to dd/d19/d38/d3f/d7d/d86/f111 0 2022-02-02T18:23:11.317 INFO:tasks.workunit.client.1.smithi159.stdout:2/971: dwrite da/d40/f13 [0,4194304] 0 2022-02-02T18:23:11.319 INFO:tasks.workunit.client.1.smithi159.stdout:0/814: write d1/f2c [6927330,78021] 0 2022-02-02T18:23:11.323 INFO:tasks.workunit.client.1.smithi159.stdout:0/815: rename d1/d11/d38/d42/df9/lfa to d1/d19/l112 0 2022-02-02T18:23:11.324 INFO:tasks.workunit.client.1.smithi159.stdout:1/752: write df/d21/d23/d49/f5d [1179008,106647] 0 2022-02-02T18:23:11.325 INFO:tasks.workunit.client.1.smithi159.stdout:1/753: write df/d14/d16/d4a/fa6 [357387,15183] 0 2022-02-02T18:23:11.326 INFO:tasks.workunit.client.1.smithi159.stdout:4/728: symlink d0/d8/d30/d5d/lf5 0 2022-02-02T18:23:11.327 INFO:tasks.workunit.client.1.smithi159.stdout:4/729: symlink d0/d66/lf6 0 2022-02-02T18:23:11.328 INFO:tasks.workunit.client.1.smithi159.stdout:6/783: dread df/f1e [0,4194304] 0 2022-02-02T18:23:11.328 INFO:tasks.workunit.client.1.smithi159.stdout:6/784: dread - df/d35/d7b/db4/fe5 zero size 2022-02-02T18:23:11.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/816: rename d1/d19/d3d/f41 to d1/d11/d38/d7e/f113 0 2022-02-02T18:23:11.329 INFO:tasks.workunit.client.1.smithi159.stdout:0/817: mknod d1/d11/c114 0 2022-02-02T18:23:11.330 INFO:tasks.workunit.client.1.smithi159.stdout:6/785: link df/c39 df/d35/d2a/d3f/cfe 0 2022-02-02T18:23:11.331 INFO:tasks.workunit.client.1.smithi159.stdout:8/833: dread d1/d26/f2d [0,4194304] 0 2022-02-02T18:23:11.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/786: symlink df/d35/d2a/d3f/d55/d6a/d6e/dfb/lff 0 2022-02-02T18:23:11.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/818: dread d1/d11/d38/d7e/f113 [0,4194304] 0 2022-02-02T18:23:11.337 INFO:tasks.workunit.client.1.smithi159.stdout:1/754: dread df/d14/d16/d4a/f46 [0,4194304] 0 2022-02-02T18:23:11.339 INFO:tasks.workunit.client.1.smithi159.stdout:0/819: unlink d1/d19/c46 0 2022-02-02T18:23:11.340 INFO:tasks.workunit.client.1.smithi159.stdout:1/755: mknod df/d21/d23/d49/da1/d114/d100/c11b 0 2022-02-02T18:23:11.340 INFO:tasks.workunit.client.1.smithi159.stdout:2/972: dwrite da/d1c/d42/d70/f8a [0,4194304] 0 2022-02-02T18:23:11.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/973: write da/d1c/d76/f13d [4640487,76016] 0 2022-02-02T18:23:11.341 INFO:tasks.workunit.client.1.smithi159.stdout:2/974: dread - da/d1c/d25/fc5 zero size 2022-02-02T18:23:11.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/820: creat d1/d11/d38/d42/f115 x:0 0 0 2022-02-02T18:23:11.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/821: fsync d1/d11/d38/faa 0 2022-02-02T18:23:11.342 INFO:tasks.workunit.client.1.smithi159.stdout:1/756: read df/d21/f5c [952375,23673] 0 2022-02-02T18:23:11.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/730: dread d0/d8/d41/f4d [0,4194304] 0 2022-02-02T18:23:11.344 INFO:tasks.workunit.client.1.smithi159.stdout:0/822: mknod d1/d11/d38/d42/d47/db0/c116 0 2022-02-02T18:23:11.345 INFO:tasks.workunit.client.1.smithi159.stdout:1/757: write df/d21/f5c [928952,79147] 0 2022-02-02T18:23:11.346 INFO:tasks.workunit.client.1.smithi159.stdout:2/975: rename da/d1c/d42/d45/l114 to da/d48/d6d/l14c 0 2022-02-02T18:23:11.347 INFO:tasks.workunit.client.1.smithi159.stdout:4/731: dread d0/d8/d41/db7/d33/f3b [0,4194304] 0 2022-02-02T18:23:11.347 INFO:tasks.workunit.client.1.smithi159.stdout:4/732: stat d0/d8/d30/fd3 0 2022-02-02T18:23:11.348 INFO:tasks.workunit.client.1.smithi159.stdout:4/733: chown d0/d8/d24/d76 389 1 2022-02-02T18:23:11.351 INFO:tasks.workunit.client.1.smithi159.stdout:8/834: dread d1/d26/d48/d98/fd4 [0,4194304] 0 2022-02-02T18:23:11.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/823: rename d1/d11/d38/d42/d47/db0/le2 to d1/d11/d38/d7e/l117 0 2022-02-02T18:23:11.353 INFO:tasks.workunit.client.1.smithi159.stdout:0/824: mknod d1/d11/d38/d42/db5/c118 0 2022-02-02T18:23:11.354 INFO:tasks.workunit.client.1.smithi159.stdout:8/835: mknod d1/dd/d1a/c11c 0 2022-02-02T18:23:11.354 INFO:tasks.workunit.client.1.smithi159.stdout:2/976: link da/d48/d6d/d3e/fca da/d1c/d25/d73/dab/d119/f14d 0 2022-02-02T18:23:11.355 INFO:tasks.workunit.client.1.smithi159.stdout:2/977: chown da/d1c/d47/d6b/d59 51 1 2022-02-02T18:23:11.355 INFO:tasks.workunit.client.1.smithi159.stdout:0/825: mkdir d1/dd/d119 0 2022-02-02T18:23:11.356 INFO:tasks.workunit.client.1.smithi159.stdout:0/826: creat d1/d11/d8d/f11a x:0 0 0 2022-02-02T18:23:11.356 INFO:tasks.workunit.client.1.smithi159.stdout:8/836: mknod d1/dd/d31/dec/dc0/c11d 0 2022-02-02T18:23:11.361 INFO:tasks.workunit.client.1.smithi159.stdout:0/827: creat d1/d11/d38/d42/df9/f11b x:0 0 0 2022-02-02T18:23:11.361 INFO:tasks.workunit.client.1.smithi159.stdout:5/833: dwrite d9/d2e/d63/ff9 [0,4194304] 0 2022-02-02T18:23:11.362 INFO:tasks.workunit.client.1.smithi159.stdout:8/837: mknod d1/d26/d48/d49/db3/c11e 0 2022-02-02T18:23:11.362 INFO:tasks.workunit.client.1.smithi159.stdout:8/838: write d1/d26/d48/d49/ffa [5056668,31664] 0 2022-02-02T18:23:11.362 INFO:tasks.workunit.client.1.smithi159.stdout:2/978: symlink da/d1c/d47/d6b/d5a/l14e 0 2022-02-02T18:23:11.366 INFO:tasks.workunit.client.1.smithi159.stdout:3/859: dwrite dd/d20/d60/fa8 [0,4194304] 0 2022-02-02T18:23:11.371 INFO:tasks.workunit.client.1.smithi159.stdout:3/860: dread dd/d66/d82/f9a [0,4194304] 0 2022-02-02T18:23:11.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/861: getdents dd/d19 0 2022-02-02T18:23:11.374 INFO:tasks.workunit.client.1.smithi159.stdout:3/862: write dd/d19/d35/f99 [1056588,128778] 0 2022-02-02T18:23:11.374 INFO:tasks.workunit.client.1.smithi159.stdout:3/863: fdatasync dd/d20/d2a/d31/f76 0 2022-02-02T18:23:11.374 INFO:tasks.workunit.client.1.smithi159.stdout:3/864: truncate dd/d19/f24 336563 0 2022-02-02T18:23:11.375 INFO:tasks.workunit.client.1.smithi159.stdout:3/865: mknod dd/d19/d38/d3f/d80/dee/da4/c112 0 2022-02-02T18:23:11.376 INFO:tasks.workunit.client.1.smithi159.stdout:5/834: dread d9/d2e/dd7/d3c/d61/dd6/d68/f69 [0,4194304] 0 2022-02-02T18:23:11.376 INFO:tasks.workunit.client.1.smithi159.stdout:3/866: truncate dd/d19/d38/d3f/d52/f58 2965400 0 2022-02-02T18:23:11.376 INFO:tasks.workunit.client.1.smithi159.stdout:8/839: write d1/db7/f119 [1497378,20714] 0 2022-02-02T18:23:11.377 INFO:tasks.workunit.client.1.smithi159.stdout:5/835: creat d9/d2e/f104 x:0 0 0 2022-02-02T18:23:11.378 INFO:tasks.workunit.client.1.smithi159.stdout:3/867: creat dd/d19/d38/d3f/d80/dee/da4/de5/f113 x:0 0 0 2022-02-02T18:23:11.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/840: creat d1/dc/f11f x:0 0 0 2022-02-02T18:23:11.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/868: mknod dd/d19/d38/d94/c114 0 2022-02-02T18:23:11.379 INFO:tasks.workunit.client.1.smithi159.stdout:8/841: symlink d1/dd/d2c/df6/dca/l120 0 2022-02-02T18:23:11.379 INFO:tasks.workunit.client.1.smithi159.stdout:8/842: stat d1/d26 0 2022-02-02T18:23:11.379 INFO:tasks.workunit.client.1.smithi159.stdout:8/843: readlink d1/dad/d95/l79 0 2022-02-02T18:23:11.380 INFO:tasks.workunit.client.1.smithi159.stdout:5/836: symlink d9/d2e/dd7/d3c/l105 0 2022-02-02T18:23:11.380 INFO:tasks.workunit.client.1.smithi159.stdout:3/869: dread dd/d19/f24 [0,4194304] 0 2022-02-02T18:23:11.381 INFO:tasks.workunit.client.1.smithi159.stdout:3/870: write dd/d20/d2a/d31/f76 [3591592,124375] 0 2022-02-02T18:23:11.382 INFO:tasks.workunit.client.1.smithi159.stdout:5/837: unlink d9/d24/d4a/f8b 0 2022-02-02T18:23:11.384 INFO:tasks.workunit.client.1.smithi159.stdout:6/787: dwrite df/d35/d2a/d2f/fad [0,4194304] 0 2022-02-02T18:23:11.384 INFO:tasks.workunit.client.1.smithi159.stdout:3/871: read dd/d19/d38/d3f/f7a [38546,22149] 0 2022-02-02T18:23:11.386 INFO:tasks.workunit.client.1.smithi159.stdout:1/758: dwrite df/d14/d16/df9/f117 [0,4194304] 0 2022-02-02T18:23:11.388 INFO:tasks.workunit.client.1.smithi159.stdout:3/872: rmdir dd/d66/d82/dd4 39 2022-02-02T18:23:11.389 INFO:tasks.workunit.client.1.smithi159.stdout:2/979: dwrite da/d1c/d42/fef [0,4194304] 0 2022-02-02T18:23:11.389 INFO:tasks.workunit.client.1.smithi159.stdout:2/980: write da/d40/daf/fdc [440091,32270] 0 2022-02-02T18:23:11.390 INFO:tasks.workunit.client.1.smithi159.stdout:2/981: truncate da/d1c/d25/d128/f14a 824089 0 2022-02-02T18:23:11.395 INFO:tasks.workunit.client.1.smithi159.stdout:4/734: dwrite d0/d8/d24/f68 [0,4194304] 0 2022-02-02T18:23:11.395 INFO:tasks.workunit.client.1.smithi159.stdout:4/735: fdatasync d0/d8/d41/db7/d36/d4b/f54 0 2022-02-02T18:23:11.395 INFO:tasks.workunit.client.1.smithi159.stdout:4/736: fdatasync d0/d8/d24/d4f/fbb 0 2022-02-02T18:23:11.399 INFO:tasks.workunit.client.1.smithi159.stdout:1/759: unlink df/d14/dbf/ce4 0 2022-02-02T18:23:11.400 INFO:tasks.workunit.client.1.smithi159.stdout:1/760: chown df/d14/d16/d4a/f51 3751752 1 2022-02-02T18:23:11.404 INFO:tasks.workunit.client.1.smithi159.stdout:2/982: mknod da/d1c/d47/d6b/d5a/d7e/ddf/c14f 0 2022-02-02T18:23:11.404 INFO:tasks.workunit.client.1.smithi159.stdout:2/983: chown da/d1c/d25/d73/dab/f33 38601 1 2022-02-02T18:23:11.406 INFO:tasks.workunit.client.1.smithi159.stdout:0/828: rename d1/d11/d38/d42/d47 to d1/d11/d38/d11c 0 2022-02-02T18:23:11.408 INFO:tasks.workunit.client.1.smithi159.stdout:0/829: unlink d1/d11/f88 0 2022-02-02T18:23:11.408 INFO:tasks.workunit.client.1.smithi159.stdout:3/873: rename dd/d20/d60/faa to dd/d19/f115 0 2022-02-02T18:23:11.409 INFO:tasks.workunit.client.1.smithi159.stdout:3/874: chown dd/d66/d69/db0/dc8 989639907 1 2022-02-02T18:23:11.409 INFO:tasks.workunit.client.1.smithi159.stdout:2/984: creat da/d40/daf/d134/f150 x:0 0 0 2022-02-02T18:23:11.411 INFO:tasks.workunit.client.1.smithi159.stdout:4/737: rename d0/d8/d41/db7/d33/l49 to d0/d8/d24/d4f/lf7 0 2022-02-02T18:23:11.414 INFO:tasks.workunit.client.1.smithi159.stdout:4/738: getdents d0/d8/d30/d7e/dea 0 2022-02-02T18:23:11.414 INFO:tasks.workunit.client.1.smithi159.stdout:4/739: dread - d0/d8/f7c zero size 2022-02-02T18:23:11.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/740: chown d0/d8/d24/fdd 0 1 2022-02-02T18:23:11.415 INFO:tasks.workunit.client.1.smithi159.stdout:2/985: dread da/d1c/d47/d6b/d5a/f7b [0,4194304] 0 2022-02-02T18:23:11.416 INFO:tasks.workunit.client.1.smithi159.stdout:6/788: dwrite df/d35/d2a/d3f/d42/f82 [0,4194304] 0 2022-02-02T18:23:11.416 INFO:tasks.workunit.client.1.smithi159.stdout:6/789: chown df/d35/d2a/d2f/f68 1936465 1 2022-02-02T18:23:11.417 INFO:tasks.workunit.client.1.smithi159.stdout:1/761: rename df/d21/f66 to df/f11c 0 2022-02-02T18:23:11.417 INFO:tasks.workunit.client.1.smithi159.stdout:1/762: read - df/d21/d23/d49/da1/dac/fd1 zero size 2022-02-02T18:23:11.417 INFO:tasks.workunit.client.1.smithi159.stdout:2/986: creat da/d1c/f151 x:0 0 0 2022-02-02T18:23:11.421 INFO:tasks.workunit.client.1.smithi159.stdout:6/790: creat df/d35/d2a/d3f/d55/f100 x:0 0 0 2022-02-02T18:23:11.422 INFO:tasks.workunit.client.1.smithi159.stdout:6/791: rmdir df/d35/d2a/d2f/d80/d61 39 2022-02-02T18:23:11.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/987: chown da/d1c/d42/l5e 3 1 2022-02-02T18:23:11.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/838: dwrite d9/f47 [0,4194304] 0 2022-02-02T18:23:11.424 INFO:tasks.workunit.client.1.smithi159.stdout:6/792: getdents df/d35/d2a/d3f/d55/d6a 0 2022-02-02T18:23:11.424 INFO:tasks.workunit.client.1.smithi159.stdout:6/793: getdents df/d35/d2a/d3f/d55/d6a/de9 0 2022-02-02T18:23:11.425 INFO:tasks.workunit.client.1.smithi159.stdout:6/794: getdents df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0 0 2022-02-02T18:23:11.425 INFO:tasks.workunit.client.1.smithi159.stdout:0/830: rename d1/d11/d38/d94 to d1/d11/d38/d42/df9/d11d 0 2022-02-02T18:23:11.426 INFO:tasks.workunit.client.1.smithi159.stdout:4/741: dread d0/d8/d24/d4f/f9f [0,4194304] 0 2022-02-02T18:23:11.426 INFO:tasks.workunit.client.1.smithi159.stdout:4/742: fsync d0/d8/d41/db7/d33/d47/d56/fd7 0 2022-02-02T18:23:11.427 INFO:tasks.workunit.client.1.smithi159.stdout:2/988: symlink da/d1c/dd7/df1/l152 0 2022-02-02T18:23:11.428 INFO:tasks.workunit.client.1.smithi159.stdout:2/989: fsync da/d1c/d25/f69 0 2022-02-02T18:23:11.431 INFO:tasks.workunit.client.1.smithi159.stdout:5/839: mknod d9/d2e/d63/c106 0 2022-02-02T18:23:11.431 INFO:tasks.workunit.client.1.smithi159.stdout:5/840: stat d9/f42 0 2022-02-02T18:23:11.432 INFO:tasks.workunit.client.1.smithi159.stdout:0/831: getdents d1/d19 0 2022-02-02T18:23:11.434 INFO:tasks.workunit.client.1.smithi159.stdout:5/841: mknod d9/d2e/dd7/d3c/d8c/dd2/c107 0 2022-02-02T18:23:11.434 INFO:tasks.workunit.client.1.smithi159.stdout:5/842: write d9/d2e/d71/fc0 [20346,124499] 0 2022-02-02T18:23:11.435 INFO:tasks.workunit.client.1.smithi159.stdout:5/843: write d9/d24/d21/f81 [1669319,32170] 0 2022-02-02T18:23:11.435 INFO:tasks.workunit.client.1.smithi159.stdout:5/844: dread - d9/dfc/f102 zero size 2022-02-02T18:23:11.437 INFO:tasks.workunit.client.1.smithi159.stdout:2/990: dread da/d1c/d25/d73/dab/dd1/f123 [0,4194304] 0 2022-02-02T18:23:11.437 INFO:tasks.workunit.client.1.smithi159.stdout:2/991: fdatasync da/d48/fcd 0 2022-02-02T18:23:11.437 INFO:tasks.workunit.client.1.smithi159.stdout:5/845: truncate d9/d2e/dd7/d3c/f6c 735292 0 2022-02-02T18:23:11.438 INFO:tasks.workunit.client.1.smithi159.stdout:6/795: dread df/fc5 [0,4194304] 0 2022-02-02T18:23:11.438 INFO:tasks.workunit.client.1.smithi159.stdout:6/796: write df/d35/d2a/d2f/d80/d61/f94 [3185923,34194] 0 2022-02-02T18:23:11.439 INFO:tasks.workunit.client.1.smithi159.stdout:6/797: dread - df/d35/d2a/d3f/d55/f100 zero size 2022-02-02T18:23:11.439 INFO:tasks.workunit.client.1.smithi159.stdout:6/798: chown df/d35/d2a/d3f/d42/d47/d59/d66/cd6 0 1 2022-02-02T18:23:11.442 INFO:tasks.workunit.client.1.smithi159.stdout:6/799: creat df/d35/d2a/d2f/da7/f101 x:0 0 0 2022-02-02T18:23:11.443 INFO:tasks.workunit.client.1.smithi159.stdout:0/832: dread d1/d11/d38/d7e/f90 [0,4194304] 0 2022-02-02T18:23:11.443 INFO:tasks.workunit.client.1.smithi159.stdout:0/833: write d1/dd/ffc [289390,96172] 0 2022-02-02T18:23:11.445 INFO:tasks.workunit.client.1.smithi159.stdout:6/800: link df/d35/d2a/d3f/d42/fc2 df/d35/d2a/d2f/da7/f102 0 2022-02-02T18:23:11.445 INFO:tasks.workunit.client.1.smithi159.stdout:6/801: read - df/d35/d2a/d2f/d80/d61/da8/fc4 zero size 2022-02-02T18:23:11.445 INFO:tasks.workunit.client.1.smithi159.stdout:6/802: chown df/d35/d2a/f5c 455 1 2022-02-02T18:23:11.446 INFO:tasks.workunit.client.1.smithi159.stdout:2/992: creat da/d1c/d25/d73/dab/dd1/f153 x:0 0 0 2022-02-02T18:23:11.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/834: truncate d1/d19/d3d/f76 643739 0 2022-02-02T18:23:11.448 INFO:tasks.workunit.client.1.smithi159.stdout:1/763: dwrite df/d14/d16/d4a/d8b/fa9 [0,4194304] 0 2022-02-02T18:23:11.448 INFO:tasks.workunit.client.1.smithi159.stdout:1/764: chown df/d21/d23/ldf 22 1 2022-02-02T18:23:11.449 INFO:tasks.workunit.client.1.smithi159.stdout:3/875: dwrite dd/d66/d92/f6f [4194304,4194304] 0 2022-02-02T18:23:11.449 INFO:tasks.workunit.client.1.smithi159.stdout:6/803: dread df/d35/f57 [0,4194304] 0 2022-02-02T18:23:11.450 INFO:tasks.workunit.client.1.smithi159.stdout:6/804: dread - df/d35/d2a/d3f/d65/fcb zero size 2022-02-02T18:23:11.450 INFO:tasks.workunit.client.1.smithi159.stdout:2/993: rename da/d1c/d42/l145 to da/d48/d6d/d3e/l154 0 2022-02-02T18:23:11.451 INFO:tasks.workunit.client.1.smithi159.stdout:2/994: mkdir da/d1c/d42/d45/d155 0 2022-02-02T18:23:11.452 INFO:tasks.workunit.client.1.smithi159.stdout:4/743: dwrite d0/d8/d15/fb1 [0,4194304] 0 2022-02-02T18:23:11.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/744: readlink d0/d8/d15/l1f 0 2022-02-02T18:23:11.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/745: stat d0/d8/f28 0 2022-02-02T18:23:11.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/746: creat d0/d8/d41/db7/d33/d47/ff8 x:0 0 0 2022-02-02T18:23:11.454 INFO:tasks.workunit.client.1.smithi159.stdout:1/765: creat df/d21/d23/d49/d69/f11d x:0 0 0 2022-02-02T18:23:11.454 INFO:tasks.workunit.client.1.smithi159.stdout:2/995: read da/d1c/d42/d139/f8f [4039888,36836] 0 2022-02-02T18:23:11.455 INFO:tasks.workunit.client.1.smithi159.stdout:3/876: creat dd/d19/d38/d3f/d52/db4/f116 x:0 0 0 2022-02-02T18:23:11.455 INFO:tasks.workunit.client.1.smithi159.stdout:2/996: symlink da/d1c/d25/d73/l156 0 2022-02-02T18:23:11.456 INFO:tasks.workunit.client.1.smithi159.stdout:6/805: truncate df/f14 2221090 0 2022-02-02T18:23:11.459 INFO:tasks.workunit.client.1.smithi159.stdout:5/846: dwrite d9/d2e/dd7/d3c/d61/dd6/f3f [0,4194304] 0 2022-02-02T18:23:11.461 INFO:tasks.workunit.client.1.smithi159.stdout:4/747: mknod d0/d7b/dc8/de7/cf9 0 2022-02-02T18:23:11.461 INFO:tasks.workunit.client.1.smithi159.stdout:1/766: symlink df/d21/d23/d49/da1/dd4/l11e 0 2022-02-02T18:23:11.462 INFO:tasks.workunit.client.1.smithi159.stdout:5/847: truncate d9/d2e/d63/fa0 2160697 0 2022-02-02T18:23:11.464 INFO:tasks.workunit.client.1.smithi159.stdout:5/848: link d9/d24/f22 d9/d24/d4a/d52/f108 0 2022-02-02T18:23:11.464 INFO:tasks.workunit.client.1.smithi159.stdout:5/849: chown d9/d24/d4a/d91/dc1 13664 1 2022-02-02T18:23:11.466 INFO:tasks.workunit.client.1.smithi159.stdout:0/835: dread d1/d11/d38/d42/daf/d34/f4a [0,4194304] 0 2022-02-02T18:23:11.466 INFO:tasks.workunit.client.1.smithi159.stdout:0/836: chown d1/d11/d38/d42/daf/d10c 1377039 1 2022-02-02T18:23:11.466 INFO:tasks.workunit.client.1.smithi159.stdout:0/837: readlink d1/dd/d4b/ld6 0 2022-02-02T18:23:11.467 INFO:tasks.workunit.client.1.smithi159.stdout:6/806: getdents df/d35/d2a/d2f/d80/d61 0 2022-02-02T18:23:11.467 INFO:tasks.workunit.client.1.smithi159.stdout:5/850: rename d9/d2e/db1/ce2 to d9/d2e/d63/c109 0 2022-02-02T18:23:11.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/838: mkdir d1/dd/d119/d11e 0 2022-02-02T18:23:11.471 INFO:tasks.workunit.client.1.smithi159.stdout:3/877: mkdir dd/d66/d69/d117 0 2022-02-02T18:23:11.477 INFO:tasks.workunit.client.1.smithi159.stdout:0/839: link d1/dd/f6d d1/d11/f11f 0 2022-02-02T18:23:11.477 INFO:tasks.workunit.client.1.smithi159.stdout:6/807: mkdir df/d35/d2a/d3f/d55/d6a/d103 0 2022-02-02T18:23:11.478 INFO:tasks.workunit.client.1.smithi159.stdout:0/840: truncate d1/dd/d4b/d7d/fbb 4144720 0 2022-02-02T18:23:11.480 INFO:tasks.workunit.client.1.smithi159.stdout:1/767: mkdir df/d21/d23/d11f 0 2022-02-02T18:23:11.480 INFO:tasks.workunit.client.1.smithi159.stdout:3/878: link dd/d19/d38/d3f/d80/dee/da4/l103 dd/d66/d82/dd4/d10b/l118 0 2022-02-02T18:23:11.481 INFO:tasks.workunit.client.1.smithi159.stdout:0/841: rename d1/d11/d38/d42/f115 to d1/d11/d38/d11c/db0/f120 0 2022-02-02T18:23:11.481 INFO:tasks.workunit.client.1.smithi159.stdout:6/808: creat df/d35/d2a/d3f/f104 x:0 0 0 2022-02-02T18:23:11.482 INFO:tasks.workunit.client.1.smithi159.stdout:6/809: fdatasync df/d35/d7b/db4/f96 0 2022-02-02T18:23:11.482 INFO:tasks.workunit.client.1.smithi159.stdout:6/810: stat fd 0 2022-02-02T18:23:11.483 INFO:tasks.workunit.client.1.smithi159.stdout:3/879: creat dd/d19/d104/f119 x:0 0 0 2022-02-02T18:23:11.483 INFO:tasks.workunit.client.1.smithi159.stdout:3/880: dread - dd/d19/d38/d3f/d7d/f95 zero size 2022-02-02T18:23:11.484 INFO:tasks.workunit.client.1.smithi159.stdout:6/811: creat df/d35/d2a/d2f/d80/f105 x:0 0 0 2022-02-02T18:23:11.486 INFO:tasks.workunit.client.1.smithi159.stdout:3/881: creat dd/d19/d38/d94/f11a x:0 0 0 2022-02-02T18:23:11.486 INFO:tasks.workunit.client.1.smithi159.stdout:3/882: truncate dd/d19/d38/d3f/dbb/f110 483540 0 2022-02-02T18:23:11.488 INFO:tasks.workunit.client.1.smithi159.stdout:3/883: creat dd/d66/d69/d100/f11b x:0 0 0 2022-02-02T18:23:11.488 INFO:tasks.workunit.client.1.smithi159.stdout:6/812: rmdir df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6 39 2022-02-02T18:23:11.491 INFO:tasks.workunit.client.1.smithi159.stdout:3/884: creat dd/d19/d38/d3f/d80/dee/da4/f11c x:0 0 0 2022-02-02T18:23:11.491 INFO:tasks.workunit.client.1.smithi159.stdout:3/885: write dd/d20/d2a/d31/f90 [319981,5616] 0 2022-02-02T18:23:11.493 INFO:tasks.workunit.client.1.smithi159.stdout:4/748: dwrite d0/f2b [0,4194304] 0 2022-02-02T18:23:11.496 INFO:tasks.workunit.client.1.smithi159.stdout:3/886: write dd/d66/d69/d77/fb2 [3484268,15130] 0 2022-02-02T18:23:11.497 INFO:tasks.workunit.client.1.smithi159.stdout:4/749: rename d0/d7b/dc8/ce6 to d0/d7b/dc8/de7/cfa 0 2022-02-02T18:23:11.497 INFO:tasks.workunit.client.1.smithi159.stdout:1/768: dwrite df/d21/d23/d49/da1/d114/fb7 [0,4194304] 0 2022-02-02T18:23:11.503 INFO:tasks.workunit.client.1.smithi159.stdout:3/887: creat dd/d20/dfa/f11d x:0 0 0 2022-02-02T18:23:11.503 INFO:tasks.workunit.client.1.smithi159.stdout:3/888: chown dd/d19/d38/f6c 243449 1 2022-02-02T18:23:11.505 INFO:tasks.workunit.client.1.smithi159.stdout:4/750: read d0/ff [2864166,92355] 0 2022-02-02T18:23:11.517 INFO:tasks.workunit.client.1.smithi159.stdout:4/751: rmdir d0/d8/d30/d7e/dea 0 2022-02-02T18:23:11.520 INFO:tasks.workunit.client.1.smithi159.stdout:4/752: symlink d0/d8/d41/db7/lfb 0 2022-02-02T18:23:11.520 INFO:tasks.workunit.client.1.smithi159.stdout:4/753: truncate d0/d8/d41/db7/d33/dc0/fef 467373 0 2022-02-02T18:23:11.523 INFO:tasks.workunit.client.1.smithi159.stdout:4/754: rename d0/l86 to d0/d8/d41/db7/d33/d47/lfc 0 2022-02-02T18:23:11.523 INFO:tasks.workunit.client.1.smithi159.stdout:4/755: fdatasync d0/d7b/fee 0 2022-02-02T18:23:11.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/756: dread d0/d8/d30/d5d/fb5 [0,4194304] 0 2022-02-02T18:23:11.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/757: stat d0/d8/d41/db7/f71 0 2022-02-02T18:23:11.534 INFO:tasks.workunit.client.1.smithi159.stdout:5/851: dwrite d9/f77 [0,4194304] 0 2022-02-02T18:23:11.535 INFO:tasks.workunit.client.1.smithi159.stdout:5/852: truncate d9/d2e/f5d 8733821 0 2022-02-02T18:23:11.535 INFO:tasks.workunit.client.1.smithi159.stdout:4/758: creat d0/d8/d15/d61/dd9/ffd x:0 0 0 2022-02-02T18:23:11.536 INFO:tasks.workunit.client.1.smithi159.stdout:0/842: dwrite d1/dd/f1a [0,4194304] 0 2022-02-02T18:23:11.536 INFO:tasks.workunit.client.1.smithi159.stdout:0/843: stat d1/d11/d38/d7c 0 2022-02-02T18:23:11.536 INFO:tasks.workunit.client.1.smithi159.stdout:3/889: dwrite dd/d19/f46 [0,4194304] 0 2022-02-02T18:23:11.538 INFO:tasks.workunit.client.1.smithi159.stdout:1/769: dwrite df/d14/d16/d4a/df3/ffe [0,4194304] 0 2022-02-02T18:23:11.538 INFO:tasks.workunit.client.1.smithi159.stdout:1/770: readlink df/l1c 0 2022-02-02T18:23:11.538 INFO:tasks.workunit.client.1.smithi159.stdout:5/853: rename d9/c9f to d9/d24/d4a/d91/dc1/c10a 0 2022-02-02T18:23:11.539 INFO:tasks.workunit.client.1.smithi159.stdout:4/759: creat d0/d8/d41/db7/da3/ffe x:0 0 0 2022-02-02T18:23:11.540 INFO:tasks.workunit.client.1.smithi159.stdout:0/844: rename d1/d11/d38/d42/db5/ded to d1/d11/d8d/d121 0 2022-02-02T18:23:11.541 INFO:tasks.workunit.client.1.smithi159.stdout:1/771: symlink df/d14/d16/d4b/d109/l120 0 2022-02-02T18:23:11.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/772: truncate df/fae 857488 0 2022-02-02T18:23:11.542 INFO:tasks.workunit.client.1.smithi159.stdout:4/760: creat d0/d7b/dc8/fff x:0 0 0 2022-02-02T18:23:11.543 INFO:tasks.workunit.client.1.smithi159.stdout:4/761: write d0/fcc [1016026,95010] 0 2022-02-02T18:23:11.544 INFO:tasks.workunit.client.1.smithi159.stdout:5/854: write d9/d2e/dd7/d3c/d61/dd6/f86 [1878447,30043] 0 2022-02-02T18:23:11.544 INFO:tasks.workunit.client.1.smithi159.stdout:5/855: fdatasync d9/d24/f6d 0 2022-02-02T18:23:11.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/856: truncate d9/f1c 2687342 0 2022-02-02T18:23:11.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/857: fdatasync d9/d2e/dd7/f73 0 2022-02-02T18:23:11.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/858: dread - d9/d2e/dd7/d3c/d8c/dd2/f103 zero size 2022-02-02T18:23:11.545 INFO:tasks.workunit.client.1.smithi159.stdout:0/845: mkdir d1/d11/d38/d122 0 2022-02-02T18:23:11.546 INFO:tasks.workunit.client.1.smithi159.stdout:0/846: chown d1/d11/d38/d11c/db0/fce 1 1 2022-02-02T18:23:11.546 INFO:tasks.workunit.client.1.smithi159.stdout:4/762: creat d0/d8/d30/f100 x:0 0 0 2022-02-02T18:23:11.546 INFO:tasks.workunit.client.1.smithi159.stdout:4/763: chown d0/d7b/dc8 7 1 2022-02-02T18:23:11.547 INFO:tasks.workunit.client.1.smithi159.stdout:4/764: chown d0/d8/d30/ldb 3247 1 2022-02-02T18:23:11.547 INFO:tasks.workunit.client.1.smithi159.stdout:0/847: read d1/d19/d3d/f76 [14077,54496] 0 2022-02-02T18:23:11.550 INFO:tasks.workunit.client.1.smithi159.stdout:5/859: mkdir d9/d24/d4a/d8d/d9a/d10b 0 2022-02-02T18:23:11.551 INFO:tasks.workunit.client.1.smithi159.stdout:0/848: rmdir d1/dd/d4b/da7 39 2022-02-02T18:23:11.553 INFO:tasks.workunit.client.1.smithi159.stdout:5/860: symlink d9/d2e/dd7/d3c/d61/dd6/dba/l10c 0 2022-02-02T18:23:11.556 INFO:tasks.workunit.client.1.smithi159.stdout:0/849: symlink d1/d11/d38/d42/df9/d11d/dd7/l123 0 2022-02-02T18:23:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:11 smithi096 conmon[32067]: cluster 2022-02-02T18:23:10.545389+0000 mgr.smithi096.shfutl (mgr.14628) 2022-02-02T18:23:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:11 smithi096 conmon[32067]: 28 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 114 MiB/s wr, 208 op/s 2022-02-02T18:23:11.560 INFO:tasks.workunit.client.1.smithi159.stdout:5/861: getdents d9/d2e/dd7/d3c/d8c/dd2 0 2022-02-02T18:23:11.561 INFO:tasks.workunit.client.1.smithi159.stdout:5/862: write d9/d2e/dd7/d3c/d8c/dd2/fe6 [269669,77612] 0 2022-02-02T18:23:11.566 INFO:tasks.workunit.client.1.smithi159.stdout:3/890: dwrite dd/d19/d38/d3f/d52/fcf [0,4194304] 0 2022-02-02T18:23:11.567 INFO:tasks.workunit.client.1.smithi159.stdout:1/773: dwrite df/d21/d23/d49/d69/d6c/fb6 [0,4194304] 0 2022-02-02T18:23:11.572 INFO:tasks.workunit.client.1.smithi159.stdout:3/891: unlink dd/f11 0 2022-02-02T18:23:11.573 INFO:tasks.workunit.client.1.smithi159.stdout:3/892: truncate dd/d19/d38/d3f/d80/d8a/f9d 236155 0 2022-02-02T18:23:11.574 INFO:tasks.workunit.client.1.smithi159.stdout:3/893: mkdir dd/d66/d82/d11e 0 2022-02-02T18:23:11.577 INFO:tasks.workunit.client.1.smithi159.stdout:0/850: dwrite d1/dd/f54 [4194304,4194304] 0 2022-02-02T18:23:11.577 INFO:tasks.workunit.client.1.smithi159.stdout:3/894: rename dd/d19/d35/f99 to dd/d19/d38/d3f/d80/d8a/f11f 0 2022-02-02T18:23:11.578 INFO:tasks.workunit.client.1.smithi159.stdout:0/851: write d1/d11/d38/d11c/f103 [203938,71843] 0 2022-02-02T18:23:11.578 INFO:tasks.workunit.client.1.smithi159.stdout:0/852: chown d1/dd/ld2 41014 1 2022-02-02T18:23:11.578 INFO:tasks.workunit.client.1.smithi159.stdout:0/853: write d1/d11/d38/d42/daf/d34/f67 [3452178,98576] 0 2022-02-02T18:23:11.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/895: write dd/d19/d38/d3f/d52/fcf [901780,39427] 0 2022-02-02T18:23:11.591 INFO:tasks.workunit.client.1.smithi159.stdout:5/863: dwrite d9/d2e/dd7/d3c/d61/dd6/d68/f69 [0,4194304] 0 2022-02-02T18:23:11.593 INFO:tasks.workunit.client.1.smithi159.stdout:1/774: dwrite df/d21/d23/d49/d82/fc6 [0,4194304] 0 2022-02-02T18:23:11.594 INFO:tasks.workunit.client.1.smithi159.stdout:5/864: mkdir d9/d24/d37/d10d 0 2022-02-02T18:23:11.598 INFO:tasks.workunit.client.1.smithi159.stdout:1/775: link df/d21/lc3 df/d14/d16/d4b/dcc/dde/l121 0 2022-02-02T18:23:11.598 INFO:tasks.workunit.client.1.smithi159.stdout:1/776: dread - df/d21/d23/f7c zero size 2022-02-02T18:23:11.601 INFO:tasks.workunit.client.1.smithi159.stdout:3/896: dwrite dd/d66/fb7 [0,4194304] 0 2022-02-02T18:23:11.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/897: dread dd/d20/f64 [0,4194304] 0 2022-02-02T18:23:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:5/865: dwrite d9/d2e/db1/fe9 [0,4194304] 0 2022-02-02T18:23:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:5/866: stat d9/d2e/cc2 0 2022-02-02T18:23:11.616 INFO:tasks.workunit.client.1.smithi159.stdout:1/777: dwrite df/f11c [4194304,4194304] 0 2022-02-02T18:23:11.620 INFO:tasks.workunit.client.1.smithi159.stdout:5/867: rename d9/d24/d37/l75 to d9/d2e/dd7/d3c/d61/dd6/dba/l10e 0 2022-02-02T18:23:11.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/868: read d9/d2e/dd7/d3c/daa/fd5 [945127,29027] 0 2022-02-02T18:23:11.622 INFO:tasks.workunit.client.1.smithi159.stdout:5/869: fdatasync d9/d2e/dd7/d88/fec 0 2022-02-02T18:23:11.622 INFO:tasks.workunit.client.1.smithi159.stdout:5/870: write d9/f1c [3392955,90926] 0 2022-02-02T18:23:11.622 INFO:tasks.workunit.client.1.smithi159.stdout:5/871: chown d9/d2e/dd7/d3c/d61/dd6/f86 108650147 1 2022-02-02T18:23:11.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/898: dread fc [0,4194304] 0 2022-02-02T18:23:11.623 INFO:tasks.workunit.client.1.smithi159.stdout:3/899: creat dd/d19/d38/d3f/d80/d8a/f120 x:0 0 0 2022-02-02T18:23:11.623 INFO:tasks.workunit.client.1.smithi159.stdout:3/900: write dd/d66/d92/f6f [570075,23609] 0 2022-02-02T18:23:11.624 INFO:tasks.workunit.client.1.smithi159.stdout:1/778: dread df/d14/d16/d4b/da0/fc2 [0,4194304] 0 2022-02-02T18:23:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:5/872: mknod d9/d24/d37/c10f 0 2022-02-02T18:23:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:5/873: dread - d9/dfc/f102 zero size 2022-02-02T18:23:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:5/874: write d9/d24/d4a/fc5 [1726463,79511] 0 2022-02-02T18:23:11.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/901: mknod dd/d19/d38/d3f/d7d/d86/c121 0 2022-02-02T18:23:11.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/902: write dd/d66/d69/d100/f11b [744343,83423] 0 2022-02-02T18:23:11.627 INFO:tasks.workunit.client.1.smithi159.stdout:5/875: mknod d9/d2e/dd7/d3c/daa/ded/c110 0 2022-02-02T18:23:11.636 INFO:tasks.workunit.client.1.smithi159.stdout:1/779: dread df/d14/d16/d4a/d8b/fa9 [0,4194304] 0 2022-02-02T18:23:11.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/780: mknod df/d14/dbf/c122 0 2022-02-02T18:23:11.639 INFO:tasks.workunit.client.1.smithi159.stdout:1/781: readlink df/d21/d23/l2d 0 2022-02-02T18:23:11.640 INFO:tasks.workunit.client.1.smithi159.stdout:1/782: getdents df/d21/d23/d49/d69/d81/d9b 0 2022-02-02T18:23:11.640 INFO:tasks.workunit.client.1.smithi159.stdout:1/783: creat df/d14/d68/f123 x:0 0 0 2022-02-02T18:23:11.642 INFO:tasks.workunit.client.1.smithi159.stdout:1/784: creat df/d14/d16/d6d/f124 x:0 0 0 2022-02-02T18:23:11.644 INFO:tasks.workunit.client.1.smithi159.stdout:1/785: dread - df/d14/d16/d4b/dcc/dde/f116 zero size 2022-02-02T18:23:11.644 INFO:tasks.workunit.client.1.smithi159.stdout:1/786: rmdir df/d21/d23/d49/da1/dac/df0 0 2022-02-02T18:23:11.645 INFO:tasks.workunit.client.1.smithi159.stdout:1/787: mkdir df/d14/d16/d4a/df3/d125 0 2022-02-02T18:23:11.646 INFO:tasks.workunit.client.1.smithi159.stdout:1/788: write df/d21/deb/f10f [192886,43158] 0 2022-02-02T18:23:11.646 INFO:tasks.workunit.client.1.smithi159.stdout:5/876: dwrite d9/d2e/dd7/d3c/d61/dd6/f86 [0,4194304] 0 2022-02-02T18:23:11.647 INFO:tasks.workunit.client.1.smithi159.stdout:5/877: creat d9/d2e/dd7/d3c/d61/dd6/dba/f111 x:0 0 0 2022-02-02T18:23:11.648 INFO:tasks.workunit.client.1.smithi159.stdout:5/878: chown d9/d2e/dd7/d3c/daa/fe8 1490 1 2022-02-02T18:23:11.649 INFO:tasks.workunit.client.1.smithi159.stdout:5/879: rename d9/d2e/dd7/d3c/d8c/dd2/fe7 to d9/d24/d4a/d52/dfd/f112 0 2022-02-02T18:23:11.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/903: dwrite dd/d19/d38/d3f/f7a [0,4194304] 0 2022-02-02T18:23:11.658 INFO:tasks.workunit.client.1.smithi159.stdout:3/904: dread dd/d66/d92/fdc [0,4194304] 0 2022-02-02T18:23:11.675 INFO:tasks.workunit.client.1.smithi159.stdout:1/789: dwrite df/d14/d16/df9/f117 [0,4194304] 0 2022-02-02T18:23:11.676 INFO:tasks.workunit.client.1.smithi159.stdout:5/880: dwrite f4 [8388608,4194304] 0 2022-02-02T18:23:11.676 INFO:tasks.workunit.client.1.smithi159.stdout:5/881: read d9/d24/f6d [168537,32503] 0 2022-02-02T18:23:11.677 INFO:tasks.workunit.client.1.smithi159.stdout:1/790: creat df/d14/d16/d4b/da0/f126 x:0 0 0 2022-02-02T18:23:11.677 INFO:tasks.workunit.client.1.smithi159.stdout:1/791: creat df/f127 x:0 0 0 2022-02-02T18:23:11.678 INFO:tasks.workunit.client.1.smithi159.stdout:1/792: write df/d21/d23/d49/d82/fbc [1009219,109296] 0 2022-02-02T18:23:11.678 INFO:tasks.workunit.client.1.smithi159.stdout:3/905: dwrite dd/d19/f24 [0,4194304] 0 2022-02-02T18:23:11.681 INFO:tasks.workunit.client.1.smithi159.stdout:5/882: truncate d9/f99 2353055 0 2022-02-02T18:23:11.683 INFO:tasks.workunit.client.1.smithi159.stdout:5/883: unlink d9/d2e/dd7/d3c/l105 0 2022-02-02T18:23:11.685 INFO:tasks.workunit.client.1.smithi159.stdout:5/884: write d9/f7a [633042,33496] 0 2022-02-02T18:23:11.687 INFO:tasks.workunit.client.1.smithi159.stdout:3/906: link dd/d20/d60/f85 dd/d19/d38/f122 0 2022-02-02T18:23:11.689 INFO:tasks.workunit.client.1.smithi159.stdout:3/907: mkdir dd/d20/dfa/d123 0 2022-02-02T18:23:11.694 INFO:tasks.workunit.client.1.smithi159.stdout:3/908: dread - dd/d66/d92/dbe/fce zero size 2022-02-02T18:23:11.696 INFO:tasks.workunit.client.1.smithi159.stdout:3/909: creat dd/d66/d82/d11e/f124 x:0 0 0 2022-02-02T18:23:11.696 INFO:tasks.workunit.client.1.smithi159.stdout:3/910: dread dd/d19/d38/d3f/f50 [0,4194304] 0 2022-02-02T18:23:11.697 INFO:tasks.workunit.client.1.smithi159.stdout:1/793: dwrite f7 [0,4194304] 0 2022-02-02T18:23:11.698 INFO:tasks.workunit.client.1.smithi159.stdout:1/794: chown l3 32973043 1 2022-02-02T18:23:11.698 INFO:tasks.workunit.client.1.smithi159.stdout:1/795: chown f7 0 1 2022-02-02T18:23:11.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/885: dwrite d9/d2e/dd7/d88/ff5 [0,4194304] 0 2022-02-02T18:23:11.705 INFO:tasks.workunit.client.1.smithi159.stdout:5/886: creat d9/f113 x:0 0 0 2022-02-02T18:23:11.706 INFO:tasks.workunit.client.1.smithi159.stdout:5/887: mkdir d9/d24/d114 0 2022-02-02T18:23:11.708 INFO:tasks.workunit.client.1.smithi159.stdout:5/888: creat d9/d24/d4a/d52/d100/f115 x:0 0 0 2022-02-02T18:23:11.713 INFO:tasks.workunit.client.1.smithi159.stdout:5/889: dread d9/d2e/dd7/d3c/d61/dd6/d68/fb9 [0,4194304] 0 2022-02-02T18:23:11.713 INFO:tasks.workunit.client.1.smithi159.stdout:5/890: chown d9/d24/d4a/d52/fd9 535 1 2022-02-02T18:23:11.717 INFO:tasks.workunit.client.1.smithi159.stdout:1/796: dwrite df/d14/d16/f45 [0,4194304] 0 2022-02-02T18:23:11.718 INFO:tasks.workunit.client.1.smithi159.stdout:1/797: write df/d21/d23/d49/d69/d81/f113 [5002826,43051] 0 2022-02-02T18:23:11.718 INFO:tasks.workunit.client.1.smithi159.stdout:1/798: readlink df/d21/d23/d49/d69/ld9 0 2022-02-02T18:23:11.718 INFO:tasks.workunit.client.1.smithi159.stdout:1/799: write df/d14/d68/f123 [1046102,126699] 0 2022-02-02T18:23:11.719 INFO:tasks.workunit.client.1.smithi159.stdout:1/800: rename df/d14/d16/d4b/dcc/dde/d10a/f112 to df/d14/d16/d4a/df3/d125/f128 0 2022-02-02T18:23:11.730 INFO:tasks.workunit.client.1.smithi159.stdout:5/891: dwrite d9/d2e/dd7/d3c/d8c/dd2/f87 [0,4194304] 0 2022-02-02T18:23:11.732 INFO:tasks.workunit.client.1.smithi159.stdout:5/892: mknod d9/d24/d37/c116 0 2022-02-02T18:23:11.732 INFO:tasks.workunit.client.1.smithi159.stdout:5/893: creat d9/d24/d4a/d91/f117 x:0 0 0 2022-02-02T18:23:11.732 INFO:tasks.workunit.client.1.smithi159.stdout:5/894: fsync d9/d24/d4a/fad 0 2022-02-02T18:23:11.733 INFO:tasks.workunit.client.1.smithi159.stdout:1/801: dread df/d14/d68/f123 [0,4194304] 0 2022-02-02T18:23:11.735 INFO:tasks.workunit.client.1.smithi159.stdout:1/802: rmdir df/d21/d23/d49/da1/dac 39 2022-02-02T18:23:11.736 INFO:tasks.workunit.client.1.smithi159.stdout:1/803: mkdir df/d21/d129 0 2022-02-02T18:23:11.737 INFO:tasks.workunit.client.1.smithi159.stdout:1/804: write df/d14/d16/d4b/fca [878880,128839] 0 2022-02-02T18:23:11.738 INFO:tasks.workunit.client.1.smithi159.stdout:1/805: mknod df/d21/d23/d49/d69/d6c/c12a 0 2022-02-02T18:23:11.749 INFO:tasks.workunit.client.1.smithi159.stdout:1/806: dread df/d14/d16/d4b/fd3 [0,4194304] 0 2022-02-02T18:23:11.750 INFO:tasks.workunit.client.1.smithi159.stdout:5/895: dwrite d9/d24/d4a/d52/dfd/f112 [0,4194304] 0 2022-02-02T18:23:11.751 INFO:tasks.workunit.client.1.smithi159.stdout:5/896: fdatasync d9/f7a 0 2022-02-02T18:23:11.751 INFO:tasks.workunit.client.1.smithi159.stdout:5/897: fdatasync d9/d24/d4a/fc5 0 2022-02-02T18:23:11.752 INFO:tasks.workunit.client.1.smithi159.stdout:1/807: unlink df/d21/d23/d49/d69/f11d 0 2022-02-02T18:23:11.752 INFO:tasks.workunit.client.1.smithi159.stdout:1/808: write df/d21/d23/d49/da1/dac/fd1 [593000,52740] 0 2022-02-02T18:23:11.771 INFO:tasks.workunit.client.1.smithi159.stdout:1/809: dwrite df/d21/f54 [0,4194304] 0 2022-02-02T18:23:11.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/810: truncate df/d21/d23/d49/d69/d81/f113 4569861 0 2022-02-02T18:23:11.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/811: creat df/d21/deb/f12b x:0 0 0 2022-02-02T18:23:11.781 INFO:tasks.workunit.client.1.smithi159.stdout:1/812: read df/f11c [6542325,54252] 0 2022-02-02T18:23:11.783 INFO:tasks.workunit.client.1.smithi159.stdout:1/813: mkdir df/d14/d16/d4a/df3/d125/d12c 0 2022-02-02T18:23:11.787 INFO:tasks.workunit.client.1.smithi159.stdout:1/814: symlink df/d21/l12d 0 2022-02-02T18:23:11.788 INFO:tasks.workunit.client.1.smithi159.stdout:1/815: write df/d21/d23/d49/f5d [2324622,86018] 0 2022-02-02T18:23:11.788 INFO:tasks.workunit.client.1.smithi159.stdout:1/816: chown df/d14/d16/d4b/d5b/f61 1 1 2022-02-02T18:23:11.788 INFO:tasks.workunit.client.1.smithi159.stdout:1/817: symlink df/d14/d16/d4b/dcc/dde/d10a/d118/l12e 0 2022-02-02T18:23:11.807 INFO:tasks.workunit.client.1.smithi159.stdout:1/818: dwrite df/d21/d23/d49/f5d [0,4194304] 0 2022-02-02T18:23:11.808 INFO:tasks.workunit.client.1.smithi159.stdout:1/819: fdatasync df/d14/d16/d4b/da0/fc2 0 2022-02-02T18:23:11.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/820: dread df/d21/f5c [0,4194304] 0 2022-02-02T18:23:11.814 INFO:tasks.workunit.client.1.smithi159.stdout:1/821: getdents df/d14/d16/d4a/df3 0 2022-02-02T18:23:11.814 INFO:tasks.workunit.client.1.smithi159.stdout:1/822: write df/d21/d23/d49/d82/d87/fcb [608742,118313] 0 2022-02-02T18:23:11.814 INFO:tasks.workunit.client.1.smithi159.stdout:1/823: truncate df/d14/d16/f7e 1427456 0 2022-02-02T18:23:11.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/824: symlink df/d14/d16/d4b/dcc/l12f 0 2022-02-02T18:23:11.816 INFO:tasks.workunit.client.1.smithi159.stdout:1/825: creat df/d21/d23/d49/da1/dac/f130 x:0 0 0 2022-02-02T18:23:11.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/826: rename df/d21/d23/d49/f5d to df/d14/d16/d4b/dcc/dde/d10a/d118/f131 0 2022-02-02T18:23:11.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/827: write df/d14/d16/da8/fd2 [836426,4663] 0 2022-02-02T18:23:11.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/828: chown df/c6e 2 1 2022-02-02T18:23:11.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/829: chown df/d21/d23/f29 2074 1 2022-02-02T18:23:11.831 INFO:tasks.workunit.client.1.smithi159.stdout:1/830: dwrite df/d14/d68/dad/fb4 [0,4194304] 0 2022-02-02T18:23:11.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/831: mkdir df/d14/d132 0 2022-02-02T18:23:11.833 INFO:tasks.workunit.client.1.smithi159.stdout:1/832: stat df/d14/l2a 0 2022-02-02T18:23:11.833 INFO:tasks.workunit.client.1.smithi159.stdout:1/833: fsync df/d21/d23/f9a 0 2022-02-02T18:23:11.833 INFO:tasks.workunit.client.1.smithi159.stdout:1/834: link df/d21/d23/d49/d69/l101 df/d21/d23/d49/d69/d81/l133 0 2022-02-02T18:23:11.859 INFO:tasks.workunit.client.1.smithi159.stdout:1/835: dwrite df/d14/d16/d4b/dcc/f10b [0,4194304] 0 2022-02-02T18:23:11.859 INFO:tasks.workunit.client.1.smithi159.stdout:1/836: write df/d21/d23/d49/d82/f9e [4752301,49701] 0 2022-02-02T18:23:11.860 INFO:tasks.workunit.client.1.smithi159.stdout:1/837: creat df/d21/d23/d49/da1/dd4/f134 x:0 0 0 2022-02-02T18:23:11.861 INFO:tasks.workunit.client.1.smithi159.stdout:1/838: dread df/fd0 [0,4194304] 0 2022-02-02T18:23:11.862 INFO:tasks.workunit.client.1.smithi159.stdout:1/839: write df/d14/d68/f106 [480204,12475] 0 2022-02-02T18:23:11.862 INFO:tasks.workunit.client.1.smithi159.stdout:1/840: creat df/d14/d16/d4b/d5b/f135 x:0 0 0 2022-02-02T18:23:11.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/841: creat df/d14/d16/d4b/d109/f136 x:0 0 0 2022-02-02T18:23:11.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/842: chown df/d21/d23/d49/da1/d114/fb7 29128893 1 2022-02-02T18:23:11.864 INFO:tasks.workunit.client.1.smithi159.stdout:1/843: chown df/d21/d23/l5f 103638234 1 2022-02-02T18:23:11.864 INFO:tasks.workunit.client.1.smithi159.stdout:1/844: symlink df/d21/d23/d49/d69/d81/l137 0 2022-02-02T18:23:11.865 INFO:tasks.workunit.client.1.smithi159.stdout:1/845: symlink df/d21/d23/d49/d69/d81/d9b/l138 0 2022-02-02T18:23:11.866 INFO:tasks.workunit.client.1.smithi159.stdout:1/846: symlink df/d21/d23/d49/da1/dac/l139 0 2022-02-02T18:23:11.866 INFO:tasks.workunit.client.1.smithi159.stdout:1/847: write df/d21/deb/f12b [1044452,112749] 0 2022-02-02T18:23:11.866 INFO:tasks.workunit.client.1.smithi159.stdout:1/848: fsync df/d21/d23/d49/d69/f96 0 2022-02-02T18:23:11.866 INFO:tasks.workunit.client.1.smithi159.stdout:1/849: chown df/d21/f54 6570 1 2022-02-02T18:23:11.867 INFO:tasks.workunit.client.1.smithi159.stdout:1/850: dread df/fd0 [0,4194304] 0 2022-02-02T18:23:11.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/851: truncate df/d14/d16/f38 2312751 0 2022-02-02T18:23:11.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/852: getdents df/d14/d16/d4a 0 2022-02-02T18:23:11.869 INFO:tasks.workunit.client.1.smithi159.stdout:1/853: getdents df/d21/deb 0 2022-02-02T18:23:11.886 INFO:tasks.workunit.client.1.smithi159.stdout:9/820: sync 2022-02-02T18:23:11.887 INFO:tasks.workunit.client.1.smithi159.stdout:9/821: mkdir d4/d19/d1c/d1f/d90/d10d 0 2022-02-02T18:23:11.889 INFO:tasks.workunit.client.1.smithi159.stdout:9/822: creat d4/d19/d6f/d74/db1/dc7/dc8/f10e x:0 0 0 2022-02-02T18:23:11.889 INFO:tasks.workunit.client.1.smithi159.stdout:9/823: truncate d4/d7a/dbc/fc5 201570 0 2022-02-02T18:23:11.889 INFO:tasks.workunit.client.1.smithi159.stdout:9/824: write d4/d19/d1c/d1f/f98 [3079906,59297] 0 2022-02-02T18:23:11.984 INFO:tasks.workunit.client.1.smithi159.stdout:8/844: sync 2022-02-02T18:23:11.984 INFO:tasks.workunit.client.1.smithi159.stdout:2/997: sync 2022-02-02T18:23:11.984 INFO:tasks.workunit.client.1.smithi159.stdout:6/813: sync 2022-02-02T18:23:11.985 INFO:tasks.workunit.client.1.smithi159.stdout:5/898: sync 2022-02-02T18:23:11.985 INFO:tasks.workunit.client.1.smithi159.stdout:4/765: sync 2022-02-02T18:23:11.985 INFO:tasks.workunit.client.1.smithi159.stdout:0/854: sync 2022-02-02T18:23:11.985 INFO:tasks.workunit.client.1.smithi159.stdout:3/911: sync 2022-02-02T18:23:11.985 INFO:tasks.workunit.client.1.smithi159.stdout:4/766: unlink d0/f11 0 2022-02-02T18:23:11.986 INFO:tasks.workunit.client.1.smithi159.stdout:8/845: write d1/d26/fe0 [376126,80769] 0 2022-02-02T18:23:11.986 INFO:tasks.workunit.client.1.smithi159.stdout:8/846: creat d1/dd/d31/dcb/f121 x:0 0 0 2022-02-02T18:23:11.987 INFO:tasks.workunit.client.1.smithi159.stdout:2/998: getdents da/d1c/d47/d6b/d5a/d7e/ddf 0 2022-02-02T18:23:11.987 INFO:tasks.workunit.client.1.smithi159.stdout:5/899: link d9/d24/d37/fdd d9/d24/d4a/d52/dfd/f118 0 2022-02-02T18:23:11.988 INFO:tasks.workunit.client.1.smithi159.stdout:5/900: chown d9/f77 31012200 1 2022-02-02T18:23:11.989 INFO:tasks.workunit.client.1.smithi159.stdout:6/814: mknod df/d35/d7b/c106 0 2022-02-02T18:23:11.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/767: mknod d0/d8/d41/db7/da3/c101 0 2022-02-02T18:23:11.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/768: read d0/f5b [5165086,127582] 0 2022-02-02T18:23:11.990 INFO:tasks.workunit.client.1.smithi159.stdout:8/847: symlink d1/db7/d75/deb/l122 0 2022-02-02T18:23:11.990 INFO:tasks.workunit.client.1.smithi159.stdout:8/848: fdatasync d1/dad/d95/fdb 0 2022-02-02T18:23:11.991 INFO:tasks.workunit.client.1.smithi159.stdout:6/815: creat df/d35/d2a/d3f/d55/d6a/d103/f107 x:0 0 0 2022-02-02T18:23:11.992 INFO:tasks.workunit.client.1.smithi159.stdout:4/769: fsync d0/d8/d30/f37 0 2022-02-02T18:23:11.992 INFO:tasks.workunit.client.1.smithi159.stdout:5/901: write d9/d2e/dd7/d3c/d61/dd6/d68/f69 [3421359,56917] 0 2022-02-02T18:23:11.992 INFO:tasks.workunit.client.1.smithi159.stdout:5/902: chown d9/d2e/db1/cc4 48047 1 2022-02-02T18:23:11.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/770: mkdir d0/d7b/dc8/d102 0 2022-02-02T18:23:11.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/816: mknod df/d35/d2a/d3f/d42/d47/d59/d66/c108 0 2022-02-02T18:23:11.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/817: dread - df/d35/d2a/d3f/d42/d47/fc1 zero size 2022-02-02T18:23:11.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/818: fdatasync df/d35/d2a/d3f/f58 0 2022-02-02T18:23:11.996 INFO:tasks.workunit.client.1.smithi159.stdout:6/819: dread - df/d35/d2a/d3f/d55/d6a/d6e/fb0 zero size 2022-02-02T18:23:12.002 INFO:tasks.workunit.client.1.smithi159.stdout:5/903: dread d9/f1c [0,4194304] 0 2022-02-02T18:23:12.002 INFO:tasks.workunit.client.1.smithi159.stdout:4/771: write d0/d8/d24/d4f/f5c [190163,48273] 0 2022-02-02T18:23:12.003 INFO:tasks.workunit.client.1.smithi159.stdout:4/772: write d0/d7b/dc8/fff [83985,98010] 0 2022-02-02T18:23:12.003 INFO:tasks.workunit.client.1.smithi159.stdout:4/773: stat d0/d8/d15/l32 0 2022-02-02T18:23:12.003 INFO:tasks.workunit.client.1.smithi159.stdout:5/904: truncate d9/d2e/f53 937313 0 2022-02-02T18:23:12.009 INFO:tasks.workunit.client.1.smithi159.stdout:4/774: write d0/d8/d30/fd3 [646257,96784] 0 2022-02-02T18:23:12.011 INFO:tasks.workunit.client.1.smithi159.stdout:4/775: creat d0/d8/d30/d5d/f103 x:0 0 0 2022-02-02T18:23:12.011 INFO:tasks.workunit.client.1.smithi159.stdout:4/776: stat d0/d8/d30/d7e/f82 0 2022-02-02T18:23:12.012 INFO:tasks.workunit.client.1.smithi159.stdout:6/820: dread f3 [0,4194304] 0 2022-02-02T18:23:12.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/855: dwrite d1/d11/f73 [4194304,4194304] 0 2022-02-02T18:23:12.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/856: symlink d1/dd/d4b/ddd/l124 0 2022-02-02T18:23:12.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/857: chown d1/dd/f33 56 1 2022-02-02T18:23:12.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/858: mkdir d1/d11/d38/d42/df9/d125 0 2022-02-02T18:23:12.015 INFO:tasks.workunit.client.1.smithi159.stdout:4/777: rename d0/d7b/dc8/de7 to d0/d104 0 2022-02-02T18:23:12.016 INFO:tasks.workunit.client.1.smithi159.stdout:0/859: creat d1/d11/d38/d42/daf/f126 x:0 0 0 2022-02-02T18:23:12.016 INFO:tasks.workunit.client.1.smithi159.stdout:0/860: write d1/d11/d8d/fc9 [650297,30001] 0 2022-02-02T18:23:12.016 INFO:tasks.workunit.client.1.smithi159.stdout:0/861: creat d1/d11/d38/d42/db5/f127 x:0 0 0 2022-02-02T18:23:12.017 INFO:tasks.workunit.client.1.smithi159.stdout:0/862: creat d1/d11/d38/d42/df9/d125/f128 x:0 0 0 2022-02-02T18:23:12.019 INFO:tasks.workunit.client.1.smithi159.stdout:0/863: write d1/fc7 [2581850,65585] 0 2022-02-02T18:23:12.020 INFO:tasks.workunit.client.1.smithi159.stdout:8/849: dwrite d1/dc/f11f [0,4194304] 0 2022-02-02T18:23:12.020 INFO:tasks.workunit.client.1.smithi159.stdout:2/999: dwrite f9 [0,4194304] 0 2022-02-02T18:23:12.021 INFO:tasks.workunit.client.1.smithi159.stdout:0/864: write d1/d11/d38/d42/daf/d34/f57 [732207,22951] 0 2022-02-02T18:23:12.022 INFO:tasks.workunit.client.1.smithi159.stdout:0/865: creat d1/dd/d4b/da7/da8/d10e/f129 x:0 0 0 2022-02-02T18:23:12.029 INFO:tasks.workunit.client.1.smithi159.stdout:5/905: dread d9/d2e/dd7/d3c/d61/dd6/d68/f69 [0,4194304] 0 2022-02-02T18:23:12.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/778: rename d0/d8/d30 to d0/d7b/dc8/d102/d105 0 2022-02-02T18:23:12.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/779: chown d0/d8/d41/db7/d33/f3b 347 1 2022-02-02T18:23:12.031 INFO:tasks.workunit.client.1.smithi159.stdout:5/906: mkdir d9/d119 0 2022-02-02T18:23:12.033 INFO:tasks.workunit.client.1.smithi159.stdout:8/850: rename d1/dad/d95/daa/ffe to d1/d26/f123 0 2022-02-02T18:23:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:8/851: symlink d1/db7/d75/deb/l124 0 2022-02-02T18:23:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:5/907: write d9/d2e/dd7/d3c/d61/dd6/f4d [525258,8714] 0 2022-02-02T18:23:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:8/852: mknod d1/db7/c125 0 2022-02-02T18:23:12.035 INFO:tasks.workunit.client.1.smithi159.stdout:8/853: read d1/d26/fbb [3380416,123091] 0 2022-02-02T18:23:12.035 INFO:tasks.workunit.client.1.smithi159.stdout:8/854: unlink d1/dc/f81 0 2022-02-02T18:23:12.036 INFO:tasks.workunit.client.1.smithi159.stdout:5/908: truncate d9/d2e/dd7/d3c/d61/dd6/f86 176279 0 2022-02-02T18:23:12.036 INFO:tasks.workunit.client.1.smithi159.stdout:5/909: write d9/d2e/dd7/f73 [546392,46464] 0 2022-02-02T18:23:12.038 INFO:tasks.workunit.client.1.smithi159.stdout:8/855: symlink d1/dad/d95/l126 0 2022-02-02T18:23:12.039 INFO:tasks.workunit.client.1.smithi159.stdout:6/821: dwrite df/d35/d2a/d3f/d55/d6a/d6e/f9c [0,4194304] 0 2022-02-02T18:23:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:8/856: rename d1/dc/f11f to d1/dad/d95/daa/f127 0 2022-02-02T18:23:12.044 INFO:tasks.workunit.client.1.smithi159.stdout:4/780: dread d0/f5b [4194304,4194304] 0 2022-02-02T18:23:12.044 INFO:tasks.workunit.client.1.smithi159.stdout:4/781: dread - d0/d8/d41/db7/d33/d47/d56/fcb zero size 2022-02-02T18:23:12.045 INFO:tasks.workunit.client.1.smithi159.stdout:4/782: chown d0/d7b/dc8/d102/d105/d7e/f82 0 1 2022-02-02T18:23:12.051 INFO:tasks.workunit.client.1.smithi159.stdout:8/857: creat d1/dd/d31/dec/dc0/f128 x:0 0 0 2022-02-02T18:23:12.060 INFO:tasks.workunit.client.1.smithi159.stdout:6/822: write df/d35/d2a/d2f/f64 [744803,42543] 0 2022-02-02T18:23:12.061 INFO:tasks.workunit.client.1.smithi159.stdout:5/910: dwrite d9/d24/d4a/d91/ffb [4194304,4194304] 0 2022-02-02T18:23:12.061 INFO:tasks.workunit.client.1.smithi159.stdout:8/858: dread d1/dd/d1a/f9a [0,4194304] 0 2022-02-02T18:23:12.062 INFO:tasks.workunit.client.1.smithi159.stdout:6/823: mknod df/d35/d2a/d3f/d42/d47/d59/c109 0 2022-02-02T18:23:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:6/824: stat df/d35/d2a/d3f/d42/d47/d59/d66/c8d 0 2022-02-02T18:23:12.064 INFO:tasks.workunit.client.1.smithi159.stdout:4/783: dwrite d0/d7b/dc8/d102/d105/f100 [0,4194304] 0 2022-02-02T18:23:12.065 INFO:tasks.workunit.client.1.smithi159.stdout:8/859: mkdir d1/dad/d129 0 2022-02-02T18:23:12.065 INFO:tasks.workunit.client.1.smithi159.stdout:8/860: truncate d1/d26/d48/d7f/f114 146734 0 2022-02-02T18:23:12.065 INFO:tasks.workunit.client.1.smithi159.stdout:8/861: readlink d1/dd/d31/dcb/lcc 0 2022-02-02T18:23:12.066 INFO:tasks.workunit.client.1.smithi159.stdout:8/862: fdatasync d1/fae 0 2022-02-02T18:23:12.066 INFO:tasks.workunit.client.1.smithi159.stdout:4/784: creat d0/f106 x:0 0 0 2022-02-02T18:23:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:5/911: symlink d9/d2e/dd7/d3c/l11a 0 2022-02-02T18:23:12.067 INFO:tasks.workunit.client.1.smithi159.stdout:4/785: dread d0/d8/d15/d61/f95 [0,4194304] 0 2022-02-02T18:23:12.068 INFO:tasks.workunit.client.1.smithi159.stdout:8/863: creat d1/d26/f12a x:0 0 0 2022-02-02T18:23:12.069 INFO:tasks.workunit.client.1.smithi159.stdout:4/786: symlink d0/d7b/l107 0 2022-02-02T18:23:12.069 INFO:tasks.workunit.client.1.smithi159.stdout:4/787: write d0/d8/d41/db7/d36/d4b/fed [922695,68997] 0 2022-02-02T18:23:12.071 INFO:tasks.workunit.client.1.smithi159.stdout:5/912: rename d9/d2e/dd7/l51 to d9/d24/d4a/d8d/l11b 0 2022-02-02T18:23:12.071 INFO:tasks.workunit.client.1.smithi159.stdout:4/788: mkdir d0/d8/d41/db7/d108 0 2022-02-02T18:23:12.072 INFO:tasks.workunit.client.1.smithi159.stdout:4/789: read d0/d8/d41/db7/d36/f88 [2432850,23239] 0 2022-02-02T18:23:12.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/864: dread d1/dd/d1a/d53/f72 [0,4194304] 0 2022-02-02T18:23:12.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/865: chown d1/d26/d48/d98/fd4 2309 1 2022-02-02T18:23:12.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/866: read - d1/dad/d95/daa/f118 zero size 2022-02-02T18:23:12.074 INFO:tasks.workunit.client.1.smithi159.stdout:5/913: mkdir d9/d2e/dd7/d3c/d61/dd6/dba/d11c 0 2022-02-02T18:23:12.074 INFO:tasks.workunit.client.1.smithi159.stdout:5/914: dread - d9/d24/d4a/d8d/d9a/fd4 zero size 2022-02-02T18:23:12.074 INFO:tasks.workunit.client.1.smithi159.stdout:8/867: read d1/d26/fbb [1604567,17285] 0 2022-02-02T18:23:12.075 INFO:tasks.workunit.client.1.smithi159.stdout:8/868: mknod d1/db7/d75/d9d/d9f/c12b 0 2022-02-02T18:23:12.077 INFO:tasks.workunit.client.1.smithi159.stdout:5/915: mkdir d9/d24/d11d 0 2022-02-02T18:23:12.077 INFO:tasks.workunit.client.1.smithi159.stdout:8/869: mknod d1/db7/d75/de8/dfb/c12c 0 2022-02-02T18:23:12.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/916: creat d9/d2e/dd7/d3c/d8c/f11e x:0 0 0 2022-02-02T18:23:12.080 INFO:tasks.workunit.client.1.smithi159.stdout:8/870: rename d1/dc/l10f to d1/dd/d31/dec/dc0/l12d 0 2022-02-02T18:23:12.085 INFO:tasks.workunit.client.1.smithi159.stdout:4/790: dread d0/d7b/dc8/d102/d105/feb [0,4194304] 0 2022-02-02T18:23:12.085 INFO:tasks.workunit.client.1.smithi159.stdout:4/791: creat d0/d8/d15/d61/dd9/f109 x:0 0 0 2022-02-02T18:23:12.088 INFO:tasks.workunit.client.1.smithi159.stdout:5/917: dread d9/d24/f41 [4194304,4194304] 0 2022-02-02T18:23:12.089 INFO:tasks.workunit.client.1.smithi159.stdout:5/918: creat d9/d2e/f11f x:0 0 0 2022-02-02T18:23:12.093 INFO:tasks.workunit.client.1.smithi159.stdout:4/792: dread d0/d8/d41/db7/d36/f88 [0,4194304] 0 2022-02-02T18:23:12.095 INFO:tasks.workunit.client.1.smithi159.stdout:5/919: write d9/d2e/d63/fa0 [128326,81973] 0 2022-02-02T18:23:12.098 INFO:tasks.workunit.client.1.smithi159.stdout:4/793: write d0/d7b/dc8/d102/d105/f100 [3717679,84572] 0 2022-02-02T18:23:12.098 INFO:tasks.workunit.client.1.smithi159.stdout:4/794: stat d0/le0 0 2022-02-02T18:23:12.100 INFO:tasks.workunit.client.1.smithi159.stdout:4/795: creat d0/d8/d15/f10a x:0 0 0 2022-02-02T18:23:12.101 INFO:tasks.workunit.client.1.smithi159.stdout:8/871: dwrite d1/dd/d1a/d53/f6d [0,4194304] 0 2022-02-02T18:23:12.102 INFO:tasks.workunit.client.1.smithi159.stdout:4/796: symlink d0/d7b/dc8/d102/d105/l10b 0 2022-02-02T18:23:12.103 INFO:tasks.workunit.client.1.smithi159.stdout:4/797: write d0/d8/d41/db7/d36/d4b/f54 [3978574,44514] 0 2022-02-02T18:23:12.104 INFO:tasks.workunit.client.1.smithi159.stdout:8/872: mknod d1/d26/c12e 0 2022-02-02T18:23:12.104 INFO:tasks.workunit.client.1.smithi159.stdout:8/873: fdatasync d1/dd/d2c/df6/dca/fd8 0 2022-02-02T18:23:12.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/874: rename d1/d26/d48/d107/cde to d1/dc/de7/df5/c12f 0 2022-02-02T18:23:12.106 INFO:tasks.workunit.client.1.smithi159.stdout:4/798: creat d0/d8/d41/db7/d36/d4b/dd4/f10c x:0 0 0 2022-02-02T18:23:12.107 INFO:tasks.workunit.client.1.smithi159.stdout:4/799: stat d0/f5 0 2022-02-02T18:23:12.111 INFO:tasks.workunit.client.1.smithi159.stdout:9/825: sync 2022-02-02T18:23:12.112 INFO:tasks.workunit.client.1.smithi159.stdout:1/854: sync 2022-02-02T18:23:12.112 INFO:tasks.workunit.client.1.smithi159.stdout:9/826: readlink d4/d19/d1c/d21/d41/d9a/lff 0 2022-02-02T18:23:12.112 INFO:tasks.workunit.client.1.smithi159.stdout:1/855: dread - df/d21/d23/d49/da1/dac/ff7 zero size 2022-02-02T18:23:12.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/827: creat d4/d19/d1c/d21/d56/d59/f10f x:0 0 0 2022-02-02T18:23:12.118 INFO:tasks.workunit.client.1.smithi159.stdout:4/800: dread d0/d8/d15/f57 [0,4194304] 0 2022-02-02T18:23:12.119 INFO:tasks.workunit.client.1.smithi159.stdout:1/856: write df/d14/d16/f7e [1115652,28987] 0 2022-02-02T18:23:12.119 INFO:tasks.workunit.client.1.smithi159.stdout:4/801: symlink d0/d8/d41/db7/da3/l10d 0 2022-02-02T18:23:12.120 INFO:tasks.workunit.client.1.smithi159.stdout:1/857: unlink df/d21/d23/d49/da1/d114/d100/c11b 0 2022-02-02T18:23:12.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/858: fsync df/d14/d16/d4a/f46 0 2022-02-02T18:23:12.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/802: fdatasync d0/d8/d41/db7/d36/d4b/f54 0 2022-02-02T18:23:12.122 INFO:tasks.workunit.client.1.smithi159.stdout:1/859: getdents df/d14/d16/d4b/dcc/dde 0 2022-02-02T18:23:12.123 INFO:tasks.workunit.client.1.smithi159.stdout:4/803: truncate d0/d8/d41/db7/d33/d47/d56/fca 1421067 0 2022-02-02T18:23:12.126 INFO:tasks.workunit.client.1.smithi159.stdout:4/804: rename d0/l6c to d0/d7b/dc8/d102/d105/d7e/l10e 0 2022-02-02T18:23:12.128 INFO:tasks.workunit.client.1.smithi159.stdout:4/805: mknod d0/d7b/dc8/d102/d105/d7e/c10f 0 2022-02-02T18:23:12.128 INFO:tasks.workunit.client.1.smithi159.stdout:4/806: chown d0/d8/d15/d61/fd6 128331 1 2022-02-02T18:23:12.128 INFO:tasks.workunit.client.1.smithi159.stdout:8/875: dwrite d1/dd/d1a/d53/fe1 [0,4194304] 0 2022-02-02T18:23:12.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/807: read d0/d7b/dc8/d102/d105/d5d/fe8 [7935869,79604] 0 2022-02-02T18:23:12.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/808: chown d0/d8/d24/f42 7939 1 2022-02-02T18:23:12.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/809: write d0/d8/d41/db7/d33/d47/ff8 [815549,118772] 0 2022-02-02T18:23:12.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/810: mknod d0/d8/d41/db7/d33/c110 0 2022-02-02T18:23:12.143 INFO:tasks.workunit.client.1.smithi159.stdout:8/876: dread d1/f8 [0,4194304] 0 2022-02-02T18:23:12.144 INFO:tasks.workunit.client.1.smithi159.stdout:8/877: creat d1/dd/d1a/d53/f130 x:0 0 0 2022-02-02T18:23:12.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/878: mkdir d1/db7/d75/dc3/d131 0 2022-02-02T18:23:12.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/860: dwrite df/d21/deb/f12b [0,4194304] 0 2022-02-02T18:23:12.148 INFO:tasks.workunit.client.1.smithi159.stdout:4/811: dwrite d0/d7b/dc8/d102/d105/d7e/f82 [0,4194304] 0 2022-02-02T18:23:12.149 INFO:tasks.workunit.client.1.smithi159.stdout:1/861: mkdir df/d14/d16/d4a/df3/d13a 0 2022-02-02T18:23:12.149 INFO:tasks.workunit.client.1.smithi159.stdout:8/879: write d1/d26/d48/d49/ffa [1605498,105063] 0 2022-02-02T18:23:12.150 INFO:tasks.workunit.client.1.smithi159.stdout:8/880: truncate d1/dad/d95/daa/f127 53437 0 2022-02-02T18:23:12.151 INFO:tasks.workunit.client.1.smithi159.stdout:4/812: creat d0/dec/f111 x:0 0 0 2022-02-02T18:23:12.152 INFO:tasks.workunit.client.1.smithi159.stdout:8/881: write d1/dd/d2c/d67/fa4 [1916320,78327] 0 2022-02-02T18:23:12.152 INFO:tasks.workunit.client.1.smithi159.stdout:1/862: link df/d14/d16/d4b/d5b/f77 df/d14/d16/d4b/d109/f13b 0 2022-02-02T18:23:12.155 INFO:tasks.workunit.client.1.smithi159.stdout:1/863: symlink df/d21/d129/l13c 0 2022-02-02T18:23:12.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/882: creat d1/d26/d48/d107/d8a/de4/f132 x:0 0 0 2022-02-02T18:23:12.156 INFO:tasks.workunit.client.1.smithi159.stdout:8/883: fdatasync d1/dd/d2c/d67/f50 0 2022-02-02T18:23:12.157 INFO:tasks.workunit.client.1.smithi159.stdout:4/813: dread d0/d8/d41/db7/f34 [0,4194304] 0 2022-02-02T18:23:12.157 INFO:tasks.workunit.client.1.smithi159.stdout:1/864: creat df/d21/d23/d49/d69/d81/f13d x:0 0 0 2022-02-02T18:23:12.157 INFO:tasks.workunit.client.1.smithi159.stdout:1/865: write df/d14/d16/d4b/dcc/dde/f116 [324558,77766] 0 2022-02-02T18:23:12.158 INFO:tasks.workunit.client.1.smithi159.stdout:4/814: truncate d0/d8/d15/f2a 1934124 0 2022-02-02T18:23:12.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/884: rename d1/dd/d2c/df6/dca/l120 to d1/dd/d31/l133 0 2022-02-02T18:23:12.168 INFO:tasks.workunit.client.1.smithi159.stdout:4/815: rename d0/d7b/dc8/d102/d105/l3d to d0/d8/d41/db7/da3/dcd/l112 0 2022-02-02T18:23:12.168 INFO:tasks.workunit.client.1.smithi159.stdout:4/816: fsync d0/d8/d41/f74 0 2022-02-02T18:23:12.169 INFO:tasks.workunit.client.1.smithi159.stdout:4/817: stat d0/d7b/dc8/fd2 0 2022-02-02T18:23:12.169 INFO:tasks.workunit.client.1.smithi159.stdout:4/818: creat d0/d7b/dc8/f113 x:0 0 0 2022-02-02T18:23:12.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/819: rename d0/d8/d24/d4f/lf7 to d0/d8/d15/l114 0 2022-02-02T18:23:12.173 INFO:tasks.workunit.client.1.smithi159.stdout:4/820: truncate d0/d8/d15/f2e 3380733 0 2022-02-02T18:23:12.175 INFO:tasks.workunit.client.1.smithi159.stdout:4/821: rename d0/d66/l94 to d0/d7b/l115 0 2022-02-02T18:23:12.180 INFO:tasks.workunit.client.1.smithi159.stdout:1/866: dwrite df/d14/f39 [0,4194304] 0 2022-02-02T18:23:12.184 INFO:tasks.workunit.client.1.smithi159.stdout:8/885: dwrite d1/dd/d2c/f42 [4194304,4194304] 0 2022-02-02T18:23:12.195 INFO:tasks.workunit.client.1.smithi159.stdout:1/867: dwrite df/d14/d16/d4b/d5b/f135 [0,4194304] 0 2022-02-02T18:23:12.198 INFO:tasks.workunit.client.1.smithi159.stdout:1/868: truncate df/d14/d68/f70 2983206 0 2022-02-02T18:23:12.199 INFO:tasks.workunit.client.1.smithi159.stdout:1/869: mknod df/d21/d23/d11f/c13e 0 2022-02-02T18:23:12.200 INFO:tasks.workunit.client.1.smithi159.stdout:1/870: creat df/d14/d16/f13f x:0 0 0 2022-02-02T18:23:12.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/871: chown df/d14/cc4 33100 1 2022-02-02T18:23:12.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/872: chown df/d21/d23/c8f 43470 1 2022-02-02T18:23:12.202 INFO:tasks.workunit.client.1.smithi159.stdout:1/873: creat df/d14/d16/d4a/df3/d13a/f140 x:0 0 0 2022-02-02T18:23:12.202 INFO:tasks.workunit.client.1.smithi159.stdout:1/874: symlink df/d14/d16/d4b/dcc/dde/l141 0 2022-02-02T18:23:12.203 INFO:tasks.workunit.client.1.smithi159.stdout:1/875: symlink df/d21/d23/d11f/l142 0 2022-02-02T18:23:12.203 INFO:tasks.workunit.client.1.smithi159.stdout:1/876: fsync df/d21/d23/d49/da1/dac/ff7 0 2022-02-02T18:23:12.210 INFO:tasks.workunit.client.1.smithi159.stdout:4/822: dwrite d0/d7b/dc8/d102/d105/d7e/d9c/fe4 [0,4194304] 0 2022-02-02T18:23:12.211 INFO:tasks.workunit.client.1.smithi159.stdout:4/823: write d0/d8/d24/d4f/f5c [1132229,130978] 0 2022-02-02T18:23:12.213 INFO:tasks.workunit.client.1.smithi159.stdout:1/877: dread df/d14/d16/df9/f117 [0,4194304] 0 2022-02-02T18:23:12.215 INFO:tasks.workunit.client.1.smithi159.stdout:1/878: unlink df/d14/d16/d4b/d5b/f61 0 2022-02-02T18:23:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:1/879: chown df/d14/d16/d4a/l50 836901349 1 2022-02-02T18:23:12.223 INFO:tasks.workunit.client.1.smithi159.stdout:1/880: dread df/d14/d16/d4a/df3/d125/f128 [0,4194304] 0 2022-02-02T18:23:12.224 INFO:tasks.workunit.client.1.smithi159.stdout:1/881: mknod df/d14/d16/d4a/d8b/dff/c143 0 2022-02-02T18:23:12.224 INFO:tasks.workunit.client.1.smithi159.stdout:1/882: chown df/d14/d16/d4a/d8b/fa9 63 1 2022-02-02T18:23:12.225 INFO:tasks.workunit.client.1.smithi159.stdout:1/883: rmdir df/d14/d16/d4a/d8b 39 2022-02-02T18:23:12.232 INFO:tasks.workunit.client.1.smithi159.stdout:1/884: dread df/d14/f5a [0,4194304] 0 2022-02-02T18:23:12.233 INFO:tasks.workunit.client.1.smithi159.stdout:1/885: symlink df/d14/d16/d6d/l144 0 2022-02-02T18:23:12.243 INFO:tasks.workunit.client.1.smithi159.stdout:1/886: link df/d14/d16/c24 df/d14/d68/c145 0 2022-02-02T18:23:12.243 INFO:tasks.workunit.client.1.smithi159.stdout:1/887: unlink df/d21/d23/d49/d82/d87/fcb 0 2022-02-02T18:23:12.243 INFO:tasks.workunit.client.1.smithi159.stdout:1/888: stat df/d14/d68/fbe 0 2022-02-02T18:23:12.243 INFO:tasks.workunit.client.1.smithi159.stdout:1/889: mknod df/d14/d16/d4b/d5b/c146 0 2022-02-02T18:23:12.244 INFO:tasks.workunit.client.1.smithi159.stdout:1/890: write df/d14/d16/d4b/dcc/dde/d10a/d118/f131 [1260496,128572] 0 2022-02-02T18:23:12.244 INFO:tasks.workunit.client.1.smithi159.stdout:1/891: dread df/d14/d16/d4b/f55 [0,4194304] 0 2022-02-02T18:23:12.244 INFO:tasks.workunit.client.1.smithi159.stdout:1/892: truncate df/d14/d16/d4a/d8b/fa9 265544 0 2022-02-02T18:23:12.262 INFO:tasks.workunit.client.1.smithi159.stdout:1/893: dwrite df/f127 [0,4194304] 0 2022-02-02T18:23:12.268 INFO:tasks.workunit.client.1.smithi159.stdout:1/894: dread df/d21/d23/d49/d82/fbc [0,4194304] 0 2022-02-02T18:23:12.268 INFO:tasks.workunit.client.1.smithi159.stdout:1/895: write df/d21/deb/f10c [811092,36239] 0 2022-02-02T18:23:12.268 INFO:tasks.workunit.client.1.smithi159.stdout:1/896: getdents df/d14/d16/d4b/d5b 0 2022-02-02T18:23:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/897: symlink df/d14/d16/d4b/da0/l147 0 2022-02-02T18:23:12.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/898: stat df/ffc 0 2022-02-02T18:23:12.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/899: fsync df/d14/d16/d4b/d109/f13b 0 2022-02-02T18:23:12.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/900: chown df/d14/lc5 17654937 1 2022-02-02T18:23:12.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/901: symlink df/d21/d23/de7/l148 0 2022-02-02T18:23:12.271 INFO:tasks.workunit.client.1.smithi159.stdout:1/902: truncate df/d14/d16/d4b/da0/fc2 386456 0 2022-02-02T18:23:12.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/912: sync 2022-02-02T18:23:12.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/913: fsync dd/d19/d38/d3f/d80/dee/da4/de5/f113 0 2022-02-02T18:23:12.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/914: truncate dd/d19/f46 2070283 0 2022-02-02T18:23:12.276 INFO:tasks.workunit.client.1.smithi159.stdout:3/915: symlink dd/d66/d92/dbe/l125 0 2022-02-02T18:23:12.276 INFO:tasks.workunit.client.1.smithi159.stdout:3/916: chown dd/d19/d35 177782 1 2022-02-02T18:23:12.277 INFO:tasks.workunit.client.1.smithi159.stdout:3/917: readlink dd/d66/d69/db0/lf8 0 2022-02-02T18:23:12.277 INFO:tasks.workunit.client.1.smithi159.stdout:3/918: dread dd/d19/d38/d3f/f50 [0,4194304] 0 2022-02-02T18:23:12.280 INFO:tasks.workunit.client.1.smithi159.stdout:3/919: getdents dd/d20/d2a 0 2022-02-02T18:23:12.282 INFO:tasks.workunit.client.1.smithi159.stdout:3/920: symlink dd/d66/d69/db0/l126 0 2022-02-02T18:23:12.283 INFO:tasks.workunit.client.1.smithi159.stdout:3/921: creat dd/d66/d69/db0/dc8/d108/f127 x:0 0 0 2022-02-02T18:23:12.286 INFO:tasks.workunit.client.1.smithi159.stdout:3/922: mkdir dd/d66/d69/d128 0 2022-02-02T18:23:12.286 INFO:tasks.workunit.client.1.smithi159.stdout:3/923: creat dd/d20/f129 x:0 0 0 2022-02-02T18:23:12.287 INFO:tasks.workunit.client.1.smithi159.stdout:3/924: chown dd/d19/d38/d3f 75030110 1 2022-02-02T18:23:12.288 INFO:tasks.workunit.client.1.smithi159.stdout:3/925: truncate dd/d66/d92/f6f 3851512 0 2022-02-02T18:23:12.288 INFO:tasks.workunit.client.1.smithi159.stdout:3/926: read dd/d19/d38/d3f/f50 [51369,75225] 0 2022-02-02T18:23:12.289 INFO:tasks.workunit.client.1.smithi159.stdout:3/927: fdatasync dd/d66/d92/f45 0 2022-02-02T18:23:12.290 INFO:tasks.workunit.client.1.smithi159.stdout:1/903: dwrite df/d14/d16/d4b/d109/f13b [0,4194304] 0 2022-02-02T18:23:12.291 INFO:tasks.workunit.client.1.smithi159.stdout:1/904: truncate df/d14/d16/d4b/dcc/f10b 5171201 0 2022-02-02T18:23:12.291 INFO:tasks.workunit.client.1.smithi159.stdout:1/905: write df/d21/d23/d49/d69/fdd [424038,118815] 0 2022-02-02T18:23:12.293 INFO:tasks.workunit.client.1.smithi159.stdout:1/906: unlink df/d21/d23/d49/d69/d6c/c12a 0 2022-02-02T18:23:12.293 INFO:tasks.workunit.client.1.smithi159.stdout:1/907: creat df/d21/d23/d49/d82/d87/f149 x:0 0 0 2022-02-02T18:23:12.297 INFO:tasks.workunit.client.1.smithi159.stdout:1/908: creat df/d21/d129/f14a x:0 0 0 2022-02-02T18:23:12.298 INFO:tasks.workunit.client.1.smithi159.stdout:1/909: mkdir df/d21/d23/d49/d69/d81/d14b 0 2022-02-02T18:23:12.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/910: rename df/d14/d16/d4b/d5b/f2e to df/d14/d16/d4b/f14c 0 2022-02-02T18:23:12.313 INFO:tasks.workunit.client.1.smithi159.stdout:3/928: dwrite dd/d19/d38/d94/f96 [0,4194304] 0 2022-02-02T18:23:12.315 INFO:tasks.workunit.client.1.smithi159.stdout:3/929: mknod dd/d66/d82/dd4/d10b/c12a 0 2022-02-02T18:23:12.316 INFO:tasks.workunit.client.1.smithi159.stdout:1/911: dwrite df/d14/d16/d4b/d109/f136 [0,4194304] 0 2022-02-02T18:23:12.319 INFO:tasks.workunit.client.1.smithi159.stdout:1/912: symlink df/d21/d23/d49/da1/d114/d100/l14d 0 2022-02-02T18:23:12.321 INFO:tasks.workunit.client.1.smithi159.stdout:1/913: symlink df/d21/d23/d49/d69/d6c/l14e 0 2022-02-02T18:23:12.321 INFO:tasks.workunit.client.1.smithi159.stdout:1/914: readlink df/d14/d16/l20 0 2022-02-02T18:23:12.322 INFO:tasks.workunit.client.1.smithi159.stdout:3/930: dread dd/d20/f54 [0,4194304] 0 2022-02-02T18:23:12.322 INFO:tasks.workunit.client.1.smithi159.stdout:1/915: rename df/d21/d23/f7c to df/d21/d23/d49/da1/dd4/f14f 0 2022-02-02T18:23:12.324 INFO:tasks.workunit.client.1.smithi159.stdout:3/931: creat dd/d66/d69/db0/f12b x:0 0 0 2022-02-02T18:23:12.324 INFO:tasks.workunit.client.1.smithi159.stdout:1/916: mknod df/d14/d16/d4a/c150 0 2022-02-02T18:23:12.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/932: symlink dd/l12c 0 2022-02-02T18:23:12.329 INFO:tasks.workunit.client.1.smithi159.stdout:3/933: dread dd/d20/d60/f78 [0,4194304] 0 2022-02-02T18:23:12.329 INFO:tasks.workunit.client.1.smithi159.stdout:3/934: write dd/d20/d60/fb3 [919528,43999] 0 2022-02-02T18:23:12.331 INFO:tasks.workunit.client.1.smithi159.stdout:3/935: link dd/d19/d38/d3f/d80/d8a/f120 dd/d66/d82/d11e/f12d 0 2022-02-02T18:23:12.331 INFO:tasks.workunit.client.1.smithi159.stdout:3/936: dread - dd/d20/f129 zero size 2022-02-02T18:23:12.331 INFO:tasks.workunit.client.1.smithi159.stdout:3/937: creat dd/d66/d69/d100/f12e x:0 0 0 2022-02-02T18:23:12.332 INFO:tasks.workunit.client.1.smithi159.stdout:1/917: dread df/f8a [0,4194304] 0 2022-02-02T18:23:12.332 INFO:tasks.workunit.client.1.smithi159.stdout:3/938: mkdir dd/d66/d82/dd4/d12f 0 2022-02-02T18:23:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:3/939: write dd/d66/d82/ff9 [40306,79659] 0 2022-02-02T18:23:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:3/940: dread - dd/d20/dfa/f11d zero size 2022-02-02T18:23:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:3/941: mkdir dd/d19/d38/d3f/d80/d8a/d130 0 2022-02-02T18:23:12.334 INFO:tasks.workunit.client.1.smithi159.stdout:3/942: mkdir dd/d19/d38/d3f/d7d/d131 0 2022-02-02T18:23:12.334 INFO:tasks.workunit.client.1.smithi159.stdout:3/943: write dd/d66/d82/d11e/f12d [306758,121147] 0 2022-02-02T18:23:12.353 INFO:tasks.workunit.client.1.smithi159.stdout:1/918: dwrite df/d21/d23/f9a [0,4194304] 0 2022-02-02T18:23:12.354 INFO:tasks.workunit.client.1.smithi159.stdout:3/944: dwrite dd/d19/d38/d3f/d80/d97/f10a [0,4194304] 0 2022-02-02T18:23:12.355 INFO:tasks.workunit.client.1.smithi159.stdout:1/919: dread df/d21/d23/d49/d69/d81/d9b/fe3 [0,4194304] 0 2022-02-02T18:23:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:1/920: rmdir df/d21/d23/d49/d69/d81 39 2022-02-02T18:23:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:1/921: truncate df/d21/deb/f10f 898931 0 2022-02-02T18:23:12.359 INFO:tasks.workunit.client.1.smithi159.stdout:1/922: write df/d14/d16/d4a/d8b/fa9 [184759,43854] 0 2022-02-02T18:23:12.362 INFO:tasks.workunit.client.1.smithi159.stdout:1/923: getdents df/d14/d16/d4b/d109 0 2022-02-02T18:23:12.365 INFO:tasks.workunit.client.1.smithi159.stdout:1/924: rename df/ffc to df/d14/d16/d4a/df3/d13a/f151 0 2022-02-02T18:23:12.365 INFO:tasks.workunit.client.1.smithi159.stdout:1/925: read df/d21/d23/d49/d82/fc6 [990414,13721] 0 2022-02-02T18:23:12.369 INFO:tasks.workunit.client.1.smithi159.stdout:1/926: creat df/d14/d16/da8/f152 x:0 0 0 2022-02-02T18:23:12.370 INFO:tasks.workunit.client.1.smithi159.stdout:1/927: chown df/d21/d23/l40 0 1 2022-02-02T18:23:12.372 INFO:tasks.workunit.client.1.smithi159.stdout:1/928: creat df/d21/d23/d49/d82/f153 x:0 0 0 2022-02-02T18:23:12.374 INFO:tasks.workunit.client.1.smithi159.stdout:1/929: unlink df/d14/d16/d6d/l144 0 2022-02-02T18:23:12.375 INFO:tasks.workunit.client.1.smithi159.stdout:1/930: creat df/d14/d16/d4a/d8b/f154 x:0 0 0 2022-02-02T18:23:12.376 INFO:tasks.workunit.client.1.smithi159.stdout:1/931: write df/d14/d16/d4a/df3/d13a/f140 [678859,18916] 0 2022-02-02T18:23:12.376 INFO:tasks.workunit.client.1.smithi159.stdout:1/932: rename df/d14/d16/d4b/dcc/dde to df/d14/d16/d4b/dcc/dde/dfb/d155 22 2022-02-02T18:23:12.376 INFO:tasks.workunit.client.1.smithi159.stdout:1/933: dread df/d14/d16/da8/fe5 [0,4194304] 0 2022-02-02T18:23:12.377 INFO:tasks.workunit.client.1.smithi159.stdout:1/934: mknod df/d21/d23/de7/c156 0 2022-02-02T18:23:12.378 INFO:tasks.workunit.client.1.smithi159.stdout:1/935: chown df/d14/d16/d4a/d8b 1 1 2022-02-02T18:23:12.386 INFO:tasks.workunit.client.1.smithi159.stdout:1/936: dread df/d14/d16/d4a/f51 [0,4194304] 0 2022-02-02T18:23:12.387 INFO:tasks.workunit.client.1.smithi159.stdout:1/937: read df/d14/d16/d4b/fd3 [1744126,43733] 0 2022-02-02T18:23:12.388 INFO:tasks.workunit.client.1.smithi159.stdout:1/938: symlink df/d21/d23/d49/d69/d81/l157 0 2022-02-02T18:23:12.389 INFO:tasks.workunit.client.1.smithi159.stdout:1/939: symlink df/d14/d16/d4a/d8b/l158 0 2022-02-02T18:23:12.389 INFO:tasks.workunit.client.1.smithi159.stdout:1/940: stat df/d21/d23/l43 0 2022-02-02T18:23:12.392 INFO:tasks.workunit.client.1.smithi159.stdout:1/941: rename df/d14/d16/df9 to df/d14/d68/d159 0 2022-02-02T18:23:12.414 INFO:tasks.workunit.client.1.smithi159.stdout:1/942: dwrite df/d14/d16/f45 [4194304,4194304] 0 2022-02-02T18:23:12.415 INFO:tasks.workunit.client.1.smithi159.stdout:1/943: symlink df/d14/d68/d159/d119/l15a 0 2022-02-02T18:23:12.416 INFO:tasks.workunit.client.1.smithi159.stdout:1/944: rename df/l19 to df/d14/d16/d4b/dcc/l15b 0 2022-02-02T18:23:12.419 INFO:tasks.workunit.client.1.smithi159.stdout:1/945: dread df/d21/f5c [0,4194304] 0 2022-02-02T18:23:12.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/946: dread - df/d14/d68/fbe zero size 2022-02-02T18:23:12.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/947: chown df/d21/d23/d49/da1 537834950 1 2022-02-02T18:23:12.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/948: dread - df/d14/d16/f13f zero size 2022-02-02T18:23:12.427 INFO:tasks.workunit.client.1.smithi159.stdout:0/866: sync 2022-02-02T18:23:12.430 INFO:tasks.workunit.client.1.smithi159.stdout:0/867: symlink d1/d19/d3d/l12a 0 2022-02-02T18:23:12.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/949: dwrite df/d14/d16/d4a/fd6 [0,4194304] 0 2022-02-02T18:23:12.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/950: write df/d14/d16/d4b/d109/f13b [4685828,27786] 0 2022-02-02T18:23:12.443 INFO:tasks.workunit.client.1.smithi159.stdout:1/951: dread df/d21/d23/f9a [0,4194304] 0 2022-02-02T18:23:12.446 INFO:tasks.workunit.client.1.smithi159.stdout:0/868: dwrite d1/d11/d38/d42/df9/d11d/fae [0,4194304] 0 2022-02-02T18:23:12.446 INFO:tasks.workunit.client.1.smithi159.stdout:0/869: chown d1/d11/d38/d11c 10 1 2022-02-02T18:23:12.447 INFO:tasks.workunit.client.1.smithi159.stdout:0/870: fsync d1/d11/d38/d42/daf/f5e 0 2022-02-02T18:23:12.447 INFO:tasks.workunit.client.1.smithi159.stdout:1/952: read df/d14/d16/d4b/dcc/dde/ff5 [1392458,86121] 0 2022-02-02T18:23:12.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/871: chown d1/dd/d4b/ddd/lf1 7631 1 2022-02-02T18:23:12.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/872: write d1/dd/f4f [570981,94126] 0 2022-02-02T18:23:12.449 INFO:tasks.workunit.client.1.smithi159.stdout:0/873: truncate d1/dd/d4b/d7d/f100 429487 0 2022-02-02T18:23:12.449 INFO:tasks.workunit.client.1.smithi159.stdout:0/874: readlink d1/d19/lda 0 2022-02-02T18:23:12.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/953: rename df/d21/d23/d49/da1/dac/fd1 to df/d14/d16/d4a/df3/d125/f15c 0 2022-02-02T18:23:12.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/954: write df/d21/d23/d49/d69/d6c/fbd [1042281,123318] 0 2022-02-02T18:23:12.450 INFO:tasks.workunit.client.1.smithi159.stdout:0/875: creat d1/dd/d4b/f12b x:0 0 0 2022-02-02T18:23:12.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/876: mknod d1/dd/d4b/da7/c12c 0 2022-02-02T18:23:12.453 INFO:tasks.workunit.client.1.smithi159.stdout:0/877: mkdir d1/d11/d38/d42/df9/d11d/dd7/de6/d12d 0 2022-02-02T18:23:12.454 INFO:tasks.workunit.client.1.smithi159.stdout:0/878: creat d1/dd/d4b/d7d/f12e x:0 0 0 2022-02-02T18:23:12.456 INFO:tasks.workunit.client.1.smithi159.stdout:0/879: link d1/d11/d38/d11c/db0/c116 d1/dd/c12f 0 2022-02-02T18:23:12.457 INFO:tasks.workunit.client.1.smithi159.stdout:9/828: sync 2022-02-02T18:23:12.457 INFO:tasks.workunit.client.1.smithi159.stdout:3/945: sync 2022-02-02T18:23:12.457 INFO:tasks.workunit.client.1.smithi159.stdout:4/824: sync 2022-02-02T18:23:12.458 INFO:tasks.workunit.client.1.smithi159.stdout:8/886: sync 2022-02-02T18:23:12.458 INFO:tasks.workunit.client.1.smithi159.stdout:5/920: sync 2022-02-02T18:23:12.458 INFO:tasks.workunit.client.1.smithi159.stdout:6/825: sync 2022-02-02T18:23:12.458 INFO:tasks.workunit.client.1.smithi159.stdout:6/826: chown df/f1e 32103 1 2022-02-02T18:23:12.459 INFO:tasks.workunit.client.1.smithi159.stdout:5/921: fsync d9/d24/d4a/fad 0 2022-02-02T18:23:12.460 INFO:tasks.workunit.client.1.smithi159.stdout:5/922: dread d9/d24/fb0 [0,4194304] 0 2022-02-02T18:23:12.460 INFO:tasks.workunit.client.1.smithi159.stdout:0/880: symlink d1/d11/d38/l130 0 2022-02-02T18:23:12.460 INFO:tasks.workunit.client.1.smithi159.stdout:9/829: creat d4/d19/d6f/d74/f110 x:0 0 0 2022-02-02T18:23:12.460 INFO:tasks.workunit.client.1.smithi159.stdout:5/923: write d9/d2e/dd7/d88/ff5 [3998748,87095] 0 2022-02-02T18:23:12.461 INFO:tasks.workunit.client.1.smithi159.stdout:5/924: write d9/f47 [4401543,48698] 0 2022-02-02T18:23:12.461 INFO:tasks.workunit.client.1.smithi159.stdout:0/881: creat d1/dd/d119/f131 x:0 0 0 2022-02-02T18:23:12.461 INFO:tasks.workunit.client.1.smithi159.stdout:0/882: write d1/d11/d38/d42/db5/f127 [682069,69995] 0 2022-02-02T18:23:12.462 INFO:tasks.workunit.client.1.smithi159.stdout:3/946: mkdir dd/d19/d38/d132 0 2022-02-02T18:23:12.462 INFO:tasks.workunit.client.1.smithi159.stdout:5/925: truncate d9/d24/d4a/d8d/d9a/fe1 1463930 0 2022-02-02T18:23:12.464 INFO:tasks.workunit.client.1.smithi159.stdout:6/827: link df/d35/f27 df/d35/d2a/d3f/d55/d6a/f10a 0 2022-02-02T18:23:12.464 INFO:tasks.workunit.client.1.smithi159.stdout:9/830: mknod d4/d19/d6f/d74/db1/c111 0 2022-02-02T18:23:12.465 INFO:tasks.workunit.client.1.smithi159.stdout:9/831: stat d4/d19/d1c/d1f/f3c 0 2022-02-02T18:23:12.465 INFO:tasks.workunit.client.1.smithi159.stdout:4/825: mkdir d0/d8/d116 0 2022-02-02T18:23:12.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/828: rmdir df/d35/d2a/d2f/da7 39 2022-02-02T18:23:12.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/829: dread - df/d35/d2a/d3f/d42/d47/d59/d97/fd1 zero size 2022-02-02T18:23:12.472 INFO:tasks.workunit.client.1.smithi159.stdout:3/947: dread dd/d19/d38/f55 [0,4194304] 0 2022-02-02T18:23:12.473 INFO:tasks.workunit.client.1.smithi159.stdout:9/832: link d4/d19/d1c/d1f/d90/l100 d4/d19/d42/l112 0 2022-02-02T18:23:12.473 INFO:tasks.workunit.client.1.smithi159.stdout:6/830: mkdir df/d35/d2a/d3f/d55/d6a/de9/d10b 0 2022-02-02T18:23:12.473 INFO:tasks.workunit.client.1.smithi159.stdout:6/831: truncate df/d35/d2a/d3f/d55/d6a/fd0 635240 0 2022-02-02T18:23:12.473 INFO:tasks.workunit.client.1.smithi159.stdout:4/826: dread d0/d8/d41/db7/d33/d47/d56/fca [0,4194304] 0 2022-02-02T18:23:12.474 INFO:tasks.workunit.client.1.smithi159.stdout:5/926: write d9/d24/d4a/d91/dc1/fce [418571,85820] 0 2022-02-02T18:23:12.474 INFO:tasks.workunit.client.1.smithi159.stdout:3/948: link dd/d66/d69/ccc dd/d19/d35/dfd/c133 0 2022-02-02T18:23:12.476 INFO:tasks.workunit.client.1.smithi159.stdout:6/832: write df/fc5 [1629176,93469] 0 2022-02-02T18:23:12.477 INFO:tasks.workunit.client.1.smithi159.stdout:5/927: mkdir d9/d24/d4a/d52/dfd/d120 0 2022-02-02T18:23:12.477 INFO:tasks.workunit.client.1.smithi159.stdout:9/833: truncate d4/d2a/f34 2855348 0 2022-02-02T18:23:12.478 INFO:tasks.workunit.client.1.smithi159.stdout:4/827: creat d0/d7b/dc8/d102/d105/f117 x:0 0 0 2022-02-02T18:23:12.478 INFO:tasks.workunit.client.1.smithi159.stdout:6/833: creat df/d35/d2a/d2f/d80/f10c x:0 0 0 2022-02-02T18:23:12.479 INFO:tasks.workunit.client.1.smithi159.stdout:6/834: dread - df/d35/d2a/d2f/d80/d61/da8/fc4 zero size 2022-02-02T18:23:12.480 INFO:tasks.workunit.client.1.smithi159.stdout:4/828: mkdir d0/d104/d118 0 2022-02-02T18:23:12.483 INFO:tasks.workunit.client.1.smithi159.stdout:4/829: link d0/d8/d41/db7/da3/dcd/ce3 d0/d7b/c119 0 2022-02-02T18:23:12.490 INFO:tasks.workunit.client.1.smithi159.stdout:5/928: dread d9/d2e/dd7/d3c/d8c/dd2/fb6 [0,4194304] 0 2022-02-02T18:23:12.492 INFO:tasks.workunit.client.1.smithi159.stdout:5/929: mkdir d9/d24/d4a/d52/dfd/d121 0 2022-02-02T18:23:12.492 INFO:tasks.workunit.client.1.smithi159.stdout:5/930: dread - d9/d24/d4a/d8d/d9a/fd4 zero size 2022-02-02T18:23:12.493 INFO:tasks.workunit.client.1.smithi159.stdout:5/931: truncate d9/d2e/dd7/d3c/d61/dd6/dba/f111 64589 0 2022-02-02T18:23:12.493 INFO:tasks.workunit.client.1.smithi159.stdout:5/932: fsync d9/d24/d4a/d8d/d9a/fe1 0 2022-02-02T18:23:12.493 INFO:tasks.workunit.client.1.smithi159.stdout:5/933: unlink d9/d24/d4a/l5a 0 2022-02-02T18:23:12.493 INFO:tasks.workunit.client.1.smithi159.stdout:6/835: dread df/d35/d2a/fcf [0,4194304] 0 2022-02-02T18:23:12.494 INFO:tasks.workunit.client.1.smithi159.stdout:6/836: chown df/d35/d2a/d3f/d42/d47/c70 351339588 1 2022-02-02T18:23:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:6/837: stat df/d35/d2a/d3f/d55/d6a/d6e/fa3 0 2022-02-02T18:23:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:5/934: truncate d9/d24/d4a/d52/dfd/f112 1211900 0 2022-02-02T18:23:12.495 INFO:tasks.workunit.client.1.smithi159.stdout:0/883: dwrite d1/dd/f54 [0,4194304] 0 2022-02-02T18:23:12.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/887: dwrite d1/dd/d1a/d53/f130 [0,4194304] 0 2022-02-02T18:23:12.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/888: dread - d1/ff2 zero size 2022-02-02T18:23:12.497 INFO:tasks.workunit.client.1.smithi159.stdout:6/838: chown df/c10 165 1 2022-02-02T18:23:12.497 INFO:tasks.workunit.client.1.smithi159.stdout:5/935: mkdir d9/d24/d4a/d8d/d122 0 2022-02-02T18:23:12.498 INFO:tasks.workunit.client.1.smithi159.stdout:0/884: creat d1/d11/d38/d42/daf/f132 x:0 0 0 2022-02-02T18:23:12.499 INFO:tasks.workunit.client.1.smithi159.stdout:3/949: dwrite dd/d19/d38/d3f/f50 [0,4194304] 0 2022-02-02T18:23:12.499 INFO:tasks.workunit.client.1.smithi159.stdout:0/885: write d1/dd/d4b/f110 [383323,76152] 0 2022-02-02T18:23:12.499 INFO:tasks.workunit.client.1.smithi159.stdout:0/886: readlink d1/dd/l3b 0 2022-02-02T18:23:12.500 INFO:tasks.workunit.client.1.smithi159.stdout:0/887: fsync d1/d11/d8d/f11a 0 2022-02-02T18:23:12.500 INFO:tasks.workunit.client.1.smithi159.stdout:0/888: dread - d1/d11/d38/d11c/db0/f120 zero size 2022-02-02T18:23:12.500 INFO:tasks.workunit.client.1.smithi159.stdout:0/889: fdatasync d1/dd/f8c 0 2022-02-02T18:23:12.500 INFO:tasks.workunit.client.1.smithi159.stdout:9/834: getdents d4/d19/d6f/d74/db1 0 2022-02-02T18:23:12.502 INFO:tasks.workunit.client.1.smithi159.stdout:8/889: truncate d1/dd/f16 1691247 0 2022-02-02T18:23:12.504 INFO:tasks.workunit.client.1.smithi159.stdout:6/839: mknod df/d35/d2a/d3f/d91/c10d 0 2022-02-02T18:23:12.504 INFO:tasks.workunit.client.1.smithi159.stdout:6/840: write df/d35/d2a/d3f/d91/fe3 [639216,83953] 0 2022-02-02T18:23:12.504 INFO:tasks.workunit.client.1.smithi159.stdout:3/950: symlink dd/d66/d69/d77/l134 0 2022-02-02T18:23:12.506 INFO:tasks.workunit.client.1.smithi159.stdout:9/835: rename d4/d19/d6f/ff4 to d4/d2a/d87/da1/f113 0 2022-02-02T18:23:12.506 INFO:tasks.workunit.client.1.smithi159.stdout:9/836: readlink d4/d19/d1c/d1f/lfe 0 2022-02-02T18:23:12.507 INFO:tasks.workunit.client.1.smithi159.stdout:0/890: symlink d1/dd/d4b/da7/da8/d10e/l133 0 2022-02-02T18:23:12.507 INFO:tasks.workunit.client.1.smithi159.stdout:0/891: fdatasync d1/dd/f1a 0 2022-02-02T18:23:12.508 INFO:tasks.workunit.client.1.smithi159.stdout:0/892: dread - d1/d11/d8d/f10f zero size 2022-02-02T18:23:12.508 INFO:tasks.workunit.client.1.smithi159.stdout:8/890: creat d1/dd/d2c/df6/dca/d11b/f134 x:0 0 0 2022-02-02T18:23:12.509 INFO:tasks.workunit.client.1.smithi159.stdout:5/936: symlink d9/d2e/dd7/d3c/d61/dd6/d68/l123 0 2022-02-02T18:23:12.510 INFO:tasks.workunit.client.1.smithi159.stdout:6/841: creat df/d35/d2a/d3f/d42/d47/d59/f10e x:0 0 0 2022-02-02T18:23:12.510 INFO:tasks.workunit.client.1.smithi159.stdout:6/842: readlink df/d35/d2a/d3f/d42/l32 0 2022-02-02T18:23:12.510 INFO:tasks.workunit.client.1.smithi159.stdout:0/893: dread d1/dd/d4b/d7d/fa1 [0,4194304] 0 2022-02-02T18:23:12.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/951: mknod dd/d19/d104/c135 0 2022-02-02T18:23:12.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/952: chown dd/f34 15 1 2022-02-02T18:23:12.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/953: truncate dd/d19/d38/d3f/d52/db4/f116 221135 0 2022-02-02T18:23:12.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/954: dread - dd/d19/d38/d3f/d80/fdf zero size 2022-02-02T18:23:12.514 INFO:tasks.workunit.client.1.smithi159.stdout:3/955: readlink dd/d66/d69/db0/dc8/ld7 0 2022-02-02T18:23:12.514 INFO:tasks.workunit.client.1.smithi159.stdout:9/837: mkdir d4/d19/d6f/d74/db1/d114 0 2022-02-02T18:23:12.515 INFO:tasks.workunit.client.1.smithi159.stdout:8/891: creat d1/dd/d2c/df6/f135 x:0 0 0 2022-02-02T18:23:12.515 INFO:tasks.workunit.client.1.smithi159.stdout:8/892: chown d1/dad/d95/l79 32636 1 2022-02-02T18:23:12.516 INFO:tasks.workunit.client.1.smithi159.stdout:8/893: write d1/db7/d75/de8/ffd [112672,632] 0 2022-02-02T18:23:12.516 INFO:tasks.workunit.client.1.smithi159.stdout:6/843: creat df/d35/d2a/d2f/da7/f10f x:0 0 0 2022-02-02T18:23:12.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/956: truncate dd/d20/d2a/d31/f76 1891759 0 2022-02-02T18:23:12.517 INFO:tasks.workunit.client.1.smithi159.stdout:9/838: rmdir d4/d2a 39 2022-02-02T18:23:12.518 INFO:tasks.workunit.client.1.smithi159.stdout:3/957: unlink dd/d19/f46 0 2022-02-02T18:23:12.518 INFO:tasks.workunit.client.1.smithi159.stdout:3/958: write dd/d19/ff6 [398682,85709] 0 2022-02-02T18:23:12.518 INFO:tasks.workunit.client.1.smithi159.stdout:3/959: stat dd/d19/d38/d94/f96 0 2022-02-02T18:23:12.518 INFO:tasks.workunit.client.1.smithi159.stdout:3/960: chown dd/d66/d69/db0/dc8 50866612 1 2022-02-02T18:23:12.519 INFO:tasks.workunit.client.1.smithi159.stdout:8/894: truncate d1/dd/d1a/d53/fe1 1848564 0 2022-02-02T18:23:12.520 INFO:tasks.workunit.client.1.smithi159.stdout:9/839: rmdir d4/d2a/d87 39 2022-02-02T18:23:12.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/895: mkdir d1/dd/d2c/d67/d136 0 2022-02-02T18:23:12.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/896: chown d1/dad 116850611 1 2022-02-02T18:23:12.520 INFO:tasks.workunit.client.1.smithi159.stdout:3/961: symlink dd/d66/d82/dd4/l136 0 2022-02-02T18:23:12.522 INFO:tasks.workunit.client.1.smithi159.stdout:8/897: symlink d1/d26/d48/l137 0 2022-02-02T18:23:12.522 INFO:tasks.workunit.client.1.smithi159.stdout:8/898: fdatasync d1/d26/d48/d98/f111 0 2022-02-02T18:23:12.526 INFO:tasks.workunit.client.1.smithi159.stdout:6/844: getdents df/d35/d2a/d2f/da7 0 2022-02-02T18:23:12.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/845: symlink df/d35/d2a/d3f/d42/dec/l110 0 2022-02-02T18:23:12.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/846: stat df/d35/d7b/db4/fe5 0 2022-02-02T18:23:12.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/847: truncate df/d35/d2a/d3f/d91/fe3 1220244 0 2022-02-02T18:23:12.532 INFO:tasks.workunit.client.1.smithi159.stdout:3/962: dread dd/f18 [0,4194304] 0 2022-02-02T18:23:12.533 INFO:tasks.workunit.client.1.smithi159.stdout:3/963: chown dd/d66/ff0 56 1 2022-02-02T18:23:12.533 INFO:tasks.workunit.client.1.smithi159.stdout:3/964: truncate dd/d19/d38/d3f/d7d/f9c 800267 0 2022-02-02T18:23:12.535 INFO:tasks.workunit.client.1.smithi159.stdout:8/899: dread d1/dd/d1a/d53/f130 [0,4194304] 0 2022-02-02T18:23:12.536 INFO:tasks.workunit.client.1.smithi159.stdout:8/900: symlink d1/dd/d31/dec/dc0/l138 0 2022-02-02T18:23:12.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/901: chown d1/db7/d75/dc3/fd6 23 1 2022-02-02T18:23:12.542 INFO:tasks.workunit.client.1.smithi159.stdout:9/840: read d4/d2a/f34 [1285935,8824] 0 2022-02-02T18:23:12.544 INFO:tasks.workunit.client.1.smithi159.stdout:9/841: truncate d4/d19/f28 222196 0 2022-02-02T18:23:12.544 INFO:tasks.workunit.client.1.smithi159.stdout:3/965: dread dd/d19/d38/d3f/d52/f58 [0,4194304] 0 2022-02-02T18:23:12.546 INFO:tasks.workunit.client.1.smithi159.stdout:9/842: symlink d4/d19/d1c/l115 0 2022-02-02T18:23:12.548 INFO:tasks.workunit.client.1.smithi159.stdout:8/902: dread d1/dd/d2c/f42 [0,4194304] 0 2022-02-02T18:23:12.548 INFO:tasks.workunit.client.1.smithi159.stdout:3/966: unlink dd/d66/l74 0 2022-02-02T18:23:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:9/843: creat d4/d19/d6f/d74/db1/d114/f116 x:0 0 0 2022-02-02T18:23:12.550 INFO:tasks.workunit.client.1.smithi159.stdout:9/844: chown d4/d19/d6f/d74/db1/fb5 17195737 1 2022-02-02T18:23:12.550 INFO:tasks.workunit.client.1.smithi159.stdout:9/845: chown d4/d19/d42/f94 101 1 2022-02-02T18:23:12.552 INFO:tasks.workunit.client.1.smithi159.stdout:9/846: rename d4/d19/ff5 to d4/d2a/f117 0 2022-02-02T18:23:12.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/967: dread dd/d19/d38/d3f/d52/f58 [0,4194304] 0 2022-02-02T18:23:12.554 INFO:tasks.workunit.client.1.smithi159.stdout:9/847: unlink d4/d19/d6f/cef 0 2022-02-02T18:23:12.556 INFO:tasks.workunit.client.1.smithi159.stdout:3/968: link dd/d66/d69/d100/f12e dd/d20/d2a/d31/f137 0 2022-02-02T18:23:12.559 INFO:tasks.workunit.client.1.smithi159.stdout:0/894: dwrite d1/d11/d38/d42/df9/d11d/dd7/fdf [0,4194304] 0 2022-02-02T18:23:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/903: dread d1/dd/f29 [0,4194304] 0 2022-02-02T18:23:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/904: fdatasync d1/dd/d1a/d53/f74 0 2022-02-02T18:23:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/905: fsync d1/dd/d2c/f42 0 2022-02-02T18:23:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/906: fsync d1/dd/d1a/d53/f74 0 2022-02-02T18:23:12.561 INFO:tasks.workunit.client.1.smithi159.stdout:8/907: dread - d1/fff zero size 2022-02-02T18:23:12.561 INFO:tasks.workunit.client.1.smithi159.stdout:8/908: readlink d1/d26/d48/d98/le5 0 2022-02-02T18:23:12.561 INFO:tasks.workunit.client.1.smithi159.stdout:8/909: fsync d1/dd/d2c/df6/dca/fd8 0 2022-02-02T18:23:12.562 INFO:tasks.workunit.client.1.smithi159.stdout:3/969: dread dd/d19/d38/d3f/d80/d8a/fa6 [4194304,4194304] 0 2022-02-02T18:23:12.562 INFO:tasks.workunit.client.1.smithi159.stdout:0/895: unlink d1/dd/d4b/da7/fe1 0 2022-02-02T18:23:12.563 INFO:tasks.workunit.client.1.smithi159.stdout:0/896: creat d1/d11/d38/d42/f134 x:0 0 0 2022-02-02T18:23:12.564 INFO:tasks.workunit.client.1.smithi159.stdout:9/848: rename d4/d19/d1c/d21/d56/d59 to d4/d19/d1c/d21/da8/db9/dd1/d118 0 2022-02-02T18:23:12.570 INFO:tasks.workunit.client.1.smithi159.stdout:9/849: write d4/d19/d1c/d21/da8/db9/dd1/d118/f7d [121802,59774] 0 2022-02-02T18:23:12.571 INFO:tasks.workunit.client.1.smithi159.stdout:8/910: rename d1/dc to d1/dad/d129/d139 0 2022-02-02T18:23:12.572 INFO:tasks.workunit.client.1.smithi159.stdout:8/911: rmdir d1/dd/d110 39 2022-02-02T18:23:12.575 INFO:tasks.workunit.client.1.smithi159.stdout:8/912: rename d1/d26/d48/d49/c94 to d1/db7/d75/de8/c13a 0 2022-02-02T18:23:12.598 INFO:tasks.workunit.client.1.smithi159.stdout:0/897: dwrite d1/d19/f25 [0,4194304] 0 2022-02-02T18:23:12.600 INFO:tasks.workunit.client.1.smithi159.stdout:9/850: dwrite d4/d19/d1c/d21/d95/f6d [0,4194304] 0 2022-02-02T18:23:12.600 INFO:tasks.workunit.client.1.smithi159.stdout:3/970: dwrite dd/d19/d38/d3f/d80/dee/da4/f11c [0,4194304] 0 2022-02-02T18:23:12.600 INFO:tasks.workunit.client.1.smithi159.stdout:3/971: chown dd/d20/d2a/d31/l5e 125 1 2022-02-02T18:23:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:8/913: dwrite d1/dd/d2c/f42 [4194304,4194304] 0 2022-02-02T18:23:12.601 INFO:tasks.workunit.client.1.smithi159.stdout:8/914: dread - d1/d26/f9c zero size 2022-02-02T18:23:12.602 INFO:tasks.workunit.client.1.smithi159.stdout:0/898: link d1/d11/d38/d42/l8a d1/d19/d3d/l135 0 2022-02-02T18:23:12.602 INFO:tasks.workunit.client.1.smithi159.stdout:8/915: link d1/dd/d1a/d53/f6d d1/dad/d129/f13b 0 2022-02-02T18:23:12.603 INFO:tasks.workunit.client.1.smithi159.stdout:0/899: mknod d1/d11/d38/d42/df9/d11d/dd7/de6/c136 0 2022-02-02T18:23:12.603 INFO:tasks.workunit.client.1.smithi159.stdout:3/972: write dd/d19/d38/d3f/d80/fdf [1036761,10259] 0 2022-02-02T18:23:12.604 INFO:tasks.workunit.client.1.smithi159.stdout:8/916: creat d1/d26/d48/f13c x:0 0 0 2022-02-02T18:23:12.604 INFO:tasks.workunit.client.1.smithi159.stdout:3/973: read dd/f9e [4174617,95309] 0 2022-02-02T18:23:12.604 INFO:tasks.workunit.client.1.smithi159.stdout:3/974: chown dd/d19/d38/d3f/dbb/cfc 0 1 2022-02-02T18:23:12.605 INFO:tasks.workunit.client.1.smithi159.stdout:9/851: link d4/d19/f76 d4/d19/d1c/d21/f119 0 2022-02-02T18:23:12.606 INFO:tasks.workunit.client.1.smithi159.stdout:0/900: rename d1/d11/d38/d42/df9/d11d/fae to d1/d11/d38/d42/df9/d11d/dd7/de6/f137 0 2022-02-02T18:23:12.606 INFO:tasks.workunit.client.1.smithi159.stdout:0/901: chown d1/f10 12 1 2022-02-02T18:23:12.606 INFO:tasks.workunit.client.1.smithi159.stdout:0/902: readlink d1/dd/ld2 0 2022-02-02T18:23:12.607 INFO:tasks.workunit.client.1.smithi159.stdout:9/852: dread d4/d19/d6f/d78/fa7 [0,4194304] 0 2022-02-02T18:23:12.607 INFO:tasks.workunit.client.1.smithi159.stdout:3/975: creat dd/d66/d82/db6/f138 x:0 0 0 2022-02-02T18:23:12.608 INFO:tasks.workunit.client.1.smithi159.stdout:8/917: rename d1/dad/d95/la2 to d1/dd/d2c/df6/dca/d11b/l13d 0 2022-02-02T18:23:12.608 INFO:tasks.workunit.client.1.smithi159.stdout:8/918: chown d1/dad/d129/d139/l8f 117044989 1 2022-02-02T18:23:12.609 INFO:tasks.workunit.client.1.smithi159.stdout:8/919: write d1/d26/d48/d99/da5/fed [717913,89294] 0 2022-02-02T18:23:12.609 INFO:tasks.workunit.client.1.smithi159.stdout:8/920: fdatasync d1/dad/d95/daa/f127 0 2022-02-02T18:23:12.609 INFO:tasks.workunit.client.1.smithi159.stdout:8/921: creat d1/db7/d75/de8/f13e x:0 0 0 2022-02-02T18:23:12.609 INFO:tasks.workunit.client.1.smithi159.stdout:8/922: write d1/d26/d48/d49/ff3 [13951,15292] 0 2022-02-02T18:23:12.609 INFO:tasks.workunit.client.1.smithi159.stdout:8/923: fsync d1/d26/d48/d98/fd4 0 2022-02-02T18:23:12.610 INFO:tasks.workunit.client.1.smithi159.stdout:8/924: creat d1/d26/d48/d98/f13f x:0 0 0 2022-02-02T18:23:12.610 INFO:tasks.workunit.client.1.smithi159.stdout:9/853: mkdir d4/d19/de7/d11a 0 2022-02-02T18:23:12.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/976: mkdir dd/d19/d38/d3f/d80/d139 0 2022-02-02T18:23:12.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/977: chown dd/d19/f1b 399496314 1 2022-02-02T18:23:12.611 INFO:tasks.workunit.client.1.smithi159.stdout:8/925: mknod d1/db7/d75/d9d/c140 0 2022-02-02T18:23:12.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/978: mkdir dd/d19/d35/dfd/d13a 0 2022-02-02T18:23:12.612 INFO:tasks.workunit.client.1.smithi159.stdout:9/854: write d4/d2a/f6e [2081078,61035] 0 2022-02-02T18:23:12.613 INFO:tasks.workunit.client.1.smithi159.stdout:9/855: mknod d4/d19/d6f/d74/db1/c11b 0 2022-02-02T18:23:12.613 INFO:tasks.workunit.client.1.smithi159.stdout:9/856: chown d4/d19/d1c/d1f/fee 3879 1 2022-02-02T18:23:12.616 INFO:tasks.workunit.client.1.smithi159.stdout:9/857: unlink d4/d19/d6f/d74/db1/dc7/dc8/f10e 0 2022-02-02T18:23:12.618 INFO:tasks.workunit.client.1.smithi159.stdout:8/926: dread d1/dd/d1a/f9a [0,4194304] 0 2022-02-02T18:23:12.618 INFO:tasks.workunit.client.1.smithi159.stdout:8/927: stat d1/dd/d2c/d67/l47 0 2022-02-02T18:23:12.636 INFO:tasks.workunit.client.1.smithi159.stdout:0/903: dwrite d1/dd/f33 [0,4194304] 0 2022-02-02T18:23:12.636 INFO:tasks.workunit.client.1.smithi159.stdout:0/904: truncate d1/dd/d4b/d7d/ff8 1673487 0 2022-02-02T18:23:12.638 INFO:tasks.workunit.client.1.smithi159.stdout:3/979: dwrite dd/d20/ff7 [0,4194304] 0 2022-02-02T18:23:12.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/858: dwrite d4/d19/d1c/d21/f101 [0,4194304] 0 2022-02-02T18:23:12.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/859: write d4/d19/d42/f94 [902175,80158] 0 2022-02-02T18:23:12.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/860: symlink d4/d19/d1c/d21/d41/d9a/de6/d10c/l11c 0 2022-02-02T18:23:12.643 INFO:tasks.workunit.client.1.smithi159.stdout:9/861: truncate d4/d19/d1c/d1f/f24 80290 0 2022-02-02T18:23:12.644 INFO:tasks.workunit.client.1.smithi159.stdout:9/862: truncate d4/d19/d1c/d21/d41/f68 582199 0 2022-02-02T18:23:12.644 INFO:tasks.workunit.client.1.smithi159.stdout:9/863: chown d4/d19/d1c/d1f/fee 4801 1 2022-02-02T18:23:12.645 INFO:tasks.workunit.client.1.smithi159.stdout:8/928: rename d1/dd/d2c/df6/dca/d11b/l13d to d1/d26/d48/d7f/l141 0 2022-02-02T18:23:12.646 INFO:tasks.workunit.client.1.smithi159.stdout:9/864: mkdir d4/d7a/d11d 0 2022-02-02T18:23:12.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/865: chown d4/d19/d6f/d74/d108 0 1 2022-02-02T18:23:12.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/866: chown d4/d19/d6f/d74/db1/dc7/dc8/cd6 164999 1 2022-02-02T18:23:12.648 INFO:tasks.workunit.client.1.smithi159.stdout:8/929: mkdir d1/d26/d48/d107/d142 0 2022-02-02T18:23:12.648 INFO:tasks.workunit.client.1.smithi159.stdout:8/930: getdents d1/d26/d48/d99/da5 0 2022-02-02T18:23:12.649 INFO:tasks.workunit.client.1.smithi159.stdout:3/980: dread dd/d66/d69/f79 [0,4194304] 0 2022-02-02T18:23:12.649 INFO:tasks.workunit.client.1.smithi159.stdout:9/867: mkdir d4/d19/d6f/d11e 0 2022-02-02T18:23:12.649 INFO:tasks.workunit.client.1.smithi159.stdout:8/931: rmdir d1/d26/d48/d99/da5 39 2022-02-02T18:23:12.652 INFO:tasks.workunit.client.1.smithi159.stdout:8/932: rename d1/dd/d2c/c44 to d1/d26/c143 0 2022-02-02T18:23:12.653 INFO:tasks.workunit.client.1.smithi159.stdout:3/981: creat dd/d20/d60/f13b x:0 0 0 2022-02-02T18:23:12.654 INFO:tasks.workunit.client.1.smithi159.stdout:8/933: creat d1/dd/d31/dec/f144 x:0 0 0 2022-02-02T18:23:12.654 INFO:tasks.workunit.client.1.smithi159.stdout:8/934: creat d1/dad/dc9/f145 x:0 0 0 2022-02-02T18:23:12.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/935: creat d1/dd/d2c/d67/f146 x:0 0 0 2022-02-02T18:23:12.657 INFO:tasks.workunit.client.1.smithi159.stdout:9/868: unlink d4/c75 0 2022-02-02T18:23:12.659 INFO:tasks.workunit.client.1.smithi159.stdout:8/936: read d1/dd/f92 [119456,22587] 0 2022-02-02T18:23:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:3/982: dread dd/d19/d38/d3f/d52/f58 [0,4194304] 0 2022-02-02T18:23:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:3/983: chown dd/d66/d92/dbe/fce 7009840 1 2022-02-02T18:23:12.660 INFO:tasks.workunit.client.1.smithi159.stdout:3/984: truncate dd/d19/d38/d3f/d7d/f95 815607 0 2022-02-02T18:23:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:8/937: creat d1/d26/d48/d49/f147 x:0 0 0 2022-02-02T18:23:12.661 INFO:tasks.workunit.client.1.smithi159.stdout:8/938: creat d1/d26/d48/d107/f148 x:0 0 0 2022-02-02T18:23:12.662 INFO:tasks.workunit.client.1.smithi159.stdout:8/939: mkdir d1/db7/d75/de8/d149 0 2022-02-02T18:23:12.663 INFO:tasks.workunit.client.1.smithi159.stdout:8/940: chown d1/dad/d129/d139/l14 22513 1 2022-02-02T18:23:12.663 INFO:tasks.workunit.client.1.smithi159.stdout:3/985: mkdir dd/d19/d38/d132/d13c 0 2022-02-02T18:23:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:8/941: link d1/dd/d1a/d53/f130 d1/db7/d75/f14a 0 2022-02-02T18:23:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:8/942: readlink d1/dd/d2c/df6/dca/l105 0 2022-02-02T18:23:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:8/943: chown d1/d26/d48/d7f/f114 15608 1 2022-02-02T18:23:12.665 INFO:tasks.workunit.client.1.smithi159.stdout:3/986: truncate dd/d19/d38/d3f/d52/fe8 299184 0 2022-02-02T18:23:12.666 INFO:tasks.workunit.client.1.smithi159.stdout:8/944: write d1/dd/d1a/d53/f6d [3814159,47565] 0 2022-02-02T18:23:12.677 INFO:tasks.workunit.client.1.smithi159.stdout:9/869: dwrite d4/d19/d1c/d21/da8/fec [0,4194304] 0 2022-02-02T18:23:12.682 INFO:tasks.workunit.client.1.smithi159.stdout:9/870: mkdir d4/d19/d1c/d21/d11f 0 2022-02-02T18:23:12.688 INFO:tasks.workunit.client.1.smithi159.stdout:3/987: dwrite dd/d20/f54 [0,4194304] 0 2022-02-02T18:23:12.691 INFO:tasks.workunit.client.1.smithi159.stdout:3/988: truncate dd/d66/d92/d51/f7e 3043318 0 2022-02-02T18:23:12.692 INFO:tasks.workunit.client.1.smithi159.stdout:3/989: getdents dd/d66/d92/d51 0 2022-02-02T18:23:12.696 INFO:tasks.workunit.client.1.smithi159.stdout:3/990: dread dd/d19/ff6 [0,4194304] 0 2022-02-02T18:23:12.696 INFO:tasks.workunit.client.1.smithi159.stdout:3/991: write dd/d19/f1b [5207586,34937] 0 2022-02-02T18:23:12.697 INFO:tasks.workunit.client.1.smithi159.stdout:3/992: creat dd/d19/d38/d94/f13d x:0 0 0 2022-02-02T18:23:12.697 INFO:tasks.workunit.client.1.smithi159.stdout:9/871: dwrite d4/d19/d1c/d21/da8/db9/dd1/d118/fb3 [0,4194304] 0 2022-02-02T18:23:12.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/872: dread d4/d7a/db7/fb8 [0,4194304] 0 2022-02-02T18:23:12.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/873: stat d4/f10 0 2022-02-02T18:23:12.708 INFO:tasks.workunit.client.1.smithi159.stdout:9/874: creat d4/d7a/dbc/f120 x:0 0 0 2022-02-02T18:23:12.708 INFO:tasks.workunit.client.1.smithi159.stdout:9/875: chown d4/d19/d6f/d74/db1/dc7/dc8/cd6 86 1 2022-02-02T18:23:12.721 INFO:tasks.workunit.client.1.smithi159.stdout:3/993: dwrite dd/d19/d38/d3f/d80/d8a/f11f [0,4194304] 0 2022-02-02T18:23:12.722 INFO:tasks.workunit.client.1.smithi159.stdout:3/994: chown dd/d19/d38/d94/f11a 101783131 1 2022-02-02T18:23:12.722 INFO:tasks.workunit.client.1.smithi159.stdout:3/995: unlink dd/f34 0 2022-02-02T18:23:12.738 INFO:tasks.workunit.client.1.smithi159.stdout:3/996: dwrite dd/d19/d38/d3f/d80/d97/f10a [0,4194304] 0 2022-02-02T18:23:12.738 INFO:tasks.workunit.client.1.smithi159.stdout:3/997: creat dd/d19/d38/d3f/d80/dee/f13e x:0 0 0 2022-02-02T18:23:12.739 INFO:tasks.workunit.client.1.smithi159.stdout:3/998: chown dd/d66/d92/f6a 2583 1 2022-02-02T18:23:12.741 INFO:tasks.workunit.client.1.smithi159.stdout:3/999: dread dd/d20/f30 [0,4194304] 0 2022-02-02T18:23:12.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/830: sync 2022-02-02T18:23:12.971 INFO:tasks.workunit.client.1.smithi159.stdout:1/955: sync 2022-02-02T18:23:12.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/831: mkdir d0/d8/d41/db7/d33/d47/d56/d11a 0 2022-02-02T18:23:12.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/832: write d0/d8/d24/d4f/f5c [1335228,15778] 0 2022-02-02T18:23:12.979 INFO:tasks.workunit.client.1.smithi159.stdout:1/956: dread df/d14/f5a [0,4194304] 0 2022-02-02T18:23:12.979 INFO:tasks.workunit.client.1.smithi159.stdout:1/957: stat df/d14/d68/f123 0 2022-02-02T18:23:12.980 INFO:tasks.workunit.client.1.smithi159.stdout:1/958: rmdir df/d21/d23/d11f 39 2022-02-02T18:23:12.982 INFO:tasks.workunit.client.1.smithi159.stdout:1/959: rename df/d14/d16/d4a/c8c to df/d21/d23/d49/d69/c15d 0 2022-02-02T18:23:12.983 INFO:tasks.workunit.client.1.smithi159.stdout:1/960: write df/d14/f39 [2106642,116540] 0 2022-02-02T18:23:13.000 INFO:tasks.workunit.client.1.smithi159.stdout:1/961: dwrite df/d14/d16/d4b/d109/f13b [0,4194304] 0 2022-02-02T18:23:13.003 INFO:tasks.workunit.client.1.smithi159.stdout:1/962: mkdir df/d21/d23/d49/d15e 0 2022-02-02T18:23:13.003 INFO:tasks.workunit.client.1.smithi159.stdout:1/963: dread - df/d21/d23/d49/da1/d114/ff8 zero size 2022-02-02T18:23:13.004 INFO:tasks.workunit.client.1.smithi159.stdout:1/964: write df/d21/d23/d49/da1/dac/f130 [977689,121342] 0 2022-02-02T18:23:13.004 INFO:tasks.workunit.client.1.smithi159.stdout:1/965: dread df/d14/d16/d4a/f44 [0,4194304] 0 2022-02-02T18:23:13.006 INFO:tasks.workunit.client.1.smithi159.stdout:1/966: mknod df/d21/d23/d11f/c15f 0 2022-02-02T18:23:13.006 INFO:tasks.workunit.client.1.smithi159.stdout:1/967: stat df/d21/d23/de7/c110 0 2022-02-02T18:23:13.018 INFO:tasks.workunit.client.1.smithi159.stdout:1/968: dwrite df/d14/d16/d4a/d8b/fa9 [0,4194304] 0 2022-02-02T18:23:13.021 INFO:tasks.workunit.client.1.smithi159.stdout:1/969: creat df/d14/d16/d4b/f160 x:0 0 0 2022-02-02T18:23:13.022 INFO:tasks.workunit.client.1.smithi159.stdout:1/970: creat df/d14/d16/d4b/dcc/dde/d10a/d111/f161 x:0 0 0 2022-02-02T18:23:13.024 INFO:tasks.workunit.client.1.smithi159.stdout:1/971: dread df/d21/d23/d49/d69/fdd [0,4194304] 0 2022-02-02T18:23:13.025 INFO:tasks.workunit.client.1.smithi159.stdout:1/972: write df/d14/d16/d4b/d109/f136 [308023,80327] 0 2022-02-02T18:23:13.027 INFO:tasks.workunit.client.1.smithi159.stdout:1/973: mknod df/d14/d16/d4b/dcc/dde/c162 0 2022-02-02T18:23:13.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/974: symlink df/d21/d23/d49/d82/l163 0 2022-02-02T18:23:13.036 INFO:tasks.workunit.client.1.smithi159.stdout:0/905: sync 2022-02-02T18:23:13.036 INFO:tasks.workunit.client.1.smithi159.stdout:6/848: sync 2022-02-02T18:23:13.037 INFO:tasks.workunit.client.1.smithi159.stdout:5/937: sync 2022-02-02T18:23:13.037 INFO:tasks.workunit.client.1.smithi159.stdout:9/876: sync 2022-02-02T18:23:13.037 INFO:tasks.workunit.client.1.smithi159.stdout:8/945: sync 2022-02-02T18:23:13.038 INFO:tasks.workunit.client.1.smithi159.stdout:5/938: chown d9/d2e/dd7/d3c/d61/dd6/f4f 11538904 1 2022-02-02T18:23:13.038 INFO:tasks.workunit.client.1.smithi159.stdout:8/946: fsync d1/d26/d48/d107/f148 0 2022-02-02T18:23:13.043 INFO:tasks.workunit.client.1.smithi159.stdout:6/849: mknod df/d35/d2a/d3f/d42/d47/d59/d66/d88/c111 0 2022-02-02T18:23:13.047 INFO:tasks.workunit.client.1.smithi159.stdout:6/850: symlink df/d35/d2a/d3f/d55/l112 0 2022-02-02T18:23:13.052 INFO:tasks.workunit.client.1.smithi159.stdout:9/877: dread d4/f96 [0,4194304] 0 2022-02-02T18:23:13.054 INFO:tasks.workunit.client.1.smithi159.stdout:9/878: link d4/c92 d4/d19/d1c/d21/d41/d9a/de6/c121 0 2022-02-02T18:23:13.056 INFO:tasks.workunit.client.1.smithi159.stdout:9/879: symlink d4/d19/d1c/d21/d41/d9a/l122 0 2022-02-02T18:23:13.056 INFO:tasks.workunit.client.1.smithi159.stdout:9/880: creat d4/d19/d1c/d21/d41/d9a/de6/f123 x:0 0 0 2022-02-02T18:23:13.068 INFO:tasks.workunit.client.1.smithi159.stdout:1/975: dwrite df/d14/d16/d4b/f14c [4194304,4194304] 0 2022-02-02T18:23:13.070 INFO:tasks.workunit.client.1.smithi159.stdout:1/976: truncate df/f8a 3242663 0 2022-02-02T18:23:13.072 INFO:tasks.workunit.client.1.smithi159.stdout:1/977: rmdir df/d21/d23/d49/d15e 0 2022-02-02T18:23:13.073 INFO:tasks.workunit.client.1.smithi159.stdout:1/978: truncate df/d14/d16/d4a/fd6 431626 0 2022-02-02T18:23:13.074 INFO:tasks.workunit.client.1.smithi159.stdout:1/979: getdents df/d14/dbf 0 2022-02-02T18:23:13.076 INFO:tasks.workunit.client.1.smithi159.stdout:1/980: mkdir df/d14/d16/d4b/dcc/dde/d10a/d111/d164 0 2022-02-02T18:23:13.077 INFO:tasks.workunit.client.1.smithi159.stdout:1/981: creat df/d21/d23/d49/f165 x:0 0 0 2022-02-02T18:23:13.079 INFO:tasks.workunit.client.1.smithi159.stdout:1/982: write f7 [266003,18441] 0 2022-02-02T18:23:13.081 INFO:tasks.workunit.client.1.smithi159.stdout:0/906: dwrite d1/d19/d3d/f45 [8388608,4194304] 0 2022-02-02T18:23:13.082 INFO:tasks.workunit.client.1.smithi159.stdout:8/947: dwrite d1/dd/d1a/d53/f6b [0,4194304] 0 2022-02-02T18:23:13.083 INFO:tasks.workunit.client.1.smithi159.stdout:5/939: dwrite d9/d2e/dd7/f73 [0,4194304] 0 2022-02-02T18:23:13.084 INFO:tasks.workunit.client.1.smithi159.stdout:5/940: readlink d9/d2e/l45 0 2022-02-02T18:23:13.084 INFO:tasks.workunit.client.1.smithi159.stdout:6/851: dwrite df/d35/d2a/d3f/fab [0,4194304] 0 2022-02-02T18:23:13.085 INFO:tasks.workunit.client.1.smithi159.stdout:9/881: dwrite d4/d2a/d87/fcb [0,4194304] 0 2022-02-02T18:23:13.086 INFO:tasks.workunit.client.1.smithi159.stdout:0/907: write d1/d11/d38/d11c/db0/fcc [521980,93252] 0 2022-02-02T18:23:13.087 INFO:tasks.workunit.client.1.smithi159.stdout:5/941: creat d9/d2e/dd7/d3c/d8c/dd2/f124 x:0 0 0 2022-02-02T18:23:13.088 INFO:tasks.workunit.client.1.smithi159.stdout:0/908: symlink d1/d11/d38/d42/df9/d11d/dd7/de6/l138 0 2022-02-02T18:23:13.089 INFO:tasks.workunit.client.1.smithi159.stdout:5/942: truncate d9/d2e/dd7/d3c/d8c/dd2/f87 216856 0 2022-02-02T18:23:13.092 INFO:tasks.workunit.client.1.smithi159.stdout:9/882: truncate d4/d19/d1c/d1f/f3c 886232 0 2022-02-02T18:23:13.093 INFO:tasks.workunit.client.1.smithi159.stdout:6/852: dread df/d35/f38 [0,4194304] 0 2022-02-02T18:23:13.099 INFO:tasks.workunit.client.1.smithi159.stdout:6/853: link df/d35/d2a/d3f/d42/f4b df/d35/d2a/d3f/d55/d6a/de9/f113 0 2022-02-02T18:23:13.099 INFO:tasks.workunit.client.1.smithi159.stdout:6/854: readlink df/lda 0 2022-02-02T18:23:13.100 INFO:tasks.workunit.client.1.smithi159.stdout:6/855: mknod df/d35/d2a/d3f/d42/dd7/c114 0 2022-02-02T18:23:13.101 INFO:tasks.workunit.client.1.smithi159.stdout:0/909: dread d1/d11/d38/d42/fee [0,4194304] 0 2022-02-02T18:23:13.102 INFO:tasks.workunit.client.1.smithi159.stdout:5/943: dread d9/d2e/dd7/d3c/d8c/fb5 [0,4194304] 0 2022-02-02T18:23:13.103 INFO:tasks.workunit.client.1.smithi159.stdout:5/944: rename d9/d24/d4a/d52/lbc to d9/dfc/l125 0 2022-02-02T18:23:13.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/945: read - d9/d2e/dd7/d3c/d8c/dd2/fcd zero size 2022-02-02T18:23:13.104 INFO:tasks.workunit.client.1.smithi159.stdout:0/910: read d1/d19/f39 [2719013,31072] 0 2022-02-02T18:23:13.105 INFO:tasks.workunit.client.1.smithi159.stdout:6/856: read df/d35/d2a/d2f/f45 [1304963,43084] 0 2022-02-02T18:23:13.105 INFO:tasks.workunit.client.1.smithi159.stdout:5/946: unlink d9/d24/d4a/d8d/d9a/cab 0 2022-02-02T18:23:13.108 INFO:tasks.workunit.client.1.smithi159.stdout:0/911: symlink d1/d11/d38/d42/df9/d11d/l139 0 2022-02-02T18:23:13.110 INFO:tasks.workunit.client.1.smithi159.stdout:0/912: symlink d1/d11/d38/l13a 0 2022-02-02T18:23:13.110 INFO:tasks.workunit.client.1.smithi159.stdout:0/913: dread - d1/d11/d38/d7c/fa3 zero size 2022-02-02T18:23:13.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/947: getdents d9/d24/d4a/d8d 0 2022-02-02T18:23:13.111 INFO:tasks.workunit.client.1.smithi159.stdout:0/914: getdents d1/d11/d38/d42/daf/d34 0 2022-02-02T18:23:13.112 INFO:tasks.workunit.client.1.smithi159.stdout:1/983: dwrite df/d21/d23/f29 [4194304,4194304] 0 2022-02-02T18:23:13.113 INFO:tasks.workunit.client.1.smithi159.stdout:5/948: mknod d9/d2e/dd7/d3c/daa/ded/c126 0 2022-02-02T18:23:13.113 INFO:tasks.workunit.client.1.smithi159.stdout:5/949: write d9/fe0 [261274,6953] 0 2022-02-02T18:23:13.114 INFO:tasks.workunit.client.1.smithi159.stdout:1/984: write df/d21/d23/d49/d82/f9e [782332,45173] 0 2022-02-02T18:23:13.115 INFO:tasks.workunit.client.1.smithi159.stdout:0/915: link d1/dd/l27 d1/d11/d38/d7e/d10d/l13b 0 2022-02-02T18:23:13.119 INFO:tasks.workunit.client.1.smithi159.stdout:4/833: sync 2022-02-02T18:23:13.119 INFO:tasks.workunit.client.1.smithi159.stdout:4/834: dread - d0/f106 zero size 2022-02-02T18:23:13.125 INFO:tasks.workunit.client.1.smithi159.stdout:4/835: dread d0/d8/d41/db7/d33/fbf [0,4194304] 0 2022-02-02T18:23:13.126 INFO:tasks.workunit.client.1.smithi159.stdout:4/836: creat d0/d7b/dc8/d102/f11b x:0 0 0 2022-02-02T18:23:13.127 INFO:tasks.workunit.client.1.smithi159.stdout:4/837: chown d0/d7b/dc8/d102/d105/d5d/f7d 0 1 2022-02-02T18:23:13.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/838: rename d0/d7b/dc8/d102/d105/d7e/c10f to d0/d8/d41/db7/d33/d47/d56/dc3/c11c 0 2022-02-02T18:23:13.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/839: chown d0/d8/d15/f69 1404217 1 2022-02-02T18:23:13.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/840: write d0/d8/d24/d4f/fa7 [1815064,70093] 0 2022-02-02T18:23:13.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/841: chown d0/c55 9083 1 2022-02-02T18:23:13.130 INFO:tasks.workunit.client.1.smithi159.stdout:1/985: dread df/d14/d16/d4b/d109/f13b [0,4194304] 0 2022-02-02T18:23:13.130 INFO:tasks.workunit.client.1.smithi159.stdout:1/986: chown df/d14/d16/d4a/df3/lf4 920764471 1 2022-02-02T18:23:13.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/842: getdents d0/dec 0 2022-02-02T18:23:13.131 INFO:tasks.workunit.client.1.smithi159.stdout:1/987: unlink df/d14/d68/d159/cfd 0 2022-02-02T18:23:13.132 INFO:tasks.workunit.client.1.smithi159.stdout:4/843: getdents d0/d8/d24 0 2022-02-02T18:23:13.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/844: mknod d0/c11d 0 2022-02-02T18:23:13.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/845: chown d0/d8/d24/d4f/f9f 18176 1 2022-02-02T18:23:13.136 INFO:tasks.workunit.client.1.smithi159.stdout:6/857: dwrite df/d35/d2a/d3f/d42/d47/ff3 [0,4194304] 0 2022-02-02T18:23:13.136 INFO:tasks.workunit.client.1.smithi159.stdout:6/858: chown df/d35/d2a/d3f/d42/dd7/c114 3 1 2022-02-02T18:23:13.137 INFO:tasks.workunit.client.1.smithi159.stdout:6/859: chown df/d35/d2a/d3f/d55/d6a/de9/f113 23 1 2022-02-02T18:23:13.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/846: readlink d0/d7b/dc8/d102/d105/l84 0 2022-02-02T18:23:13.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/847: fsync d0/d7b/dc8/d102/d105/d5d/fb5 0 2022-02-02T18:23:13.138 INFO:tasks.workunit.client.1.smithi159.stdout:8/948: dwrite d1/dd/f92 [0,4194304] 0 2022-02-02T18:23:13.138 INFO:tasks.workunit.client.1.smithi159.stdout:5/950: dwrite d9/d2e/dd7/d3c/d61/dd6/f86 [0,4194304] 0 2022-02-02T18:23:13.139 INFO:tasks.workunit.client.1.smithi159.stdout:5/951: write d9/d2e/d71/fd1 [1029160,48235] 0 2022-02-02T18:23:13.139 INFO:tasks.workunit.client.1.smithi159.stdout:6/860: link df/d35/d2a/d3f/d42/f82 df/d35/d2a/d3f/d55/d6a/f115 0 2022-02-02T18:23:13.140 INFO:tasks.workunit.client.1.smithi159.stdout:5/952: dread d9/d2e/dd7/d3c/d61/dd6/d68/f95 [0,4194304] 0 2022-02-02T18:23:13.142 INFO:tasks.workunit.client.1.smithi159.stdout:0/916: dwrite d1/dd/f8c [0,4194304] 0 2022-02-02T18:23:13.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/861: unlink df/d35/d2a/d3f/d55/d6a/d6e/f9f 0 2022-02-02T18:23:13.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/917: rename d1/d19/f49 to d1/dd/d4b/ddd/f13c 0 2022-02-02T18:23:13.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/918: readlink d1/d19/lc5 0 2022-02-02T18:23:13.146 INFO:tasks.workunit.client.1.smithi159.stdout:5/953: dread d9/f7a [0,4194304] 0 2022-02-02T18:23:13.148 INFO:tasks.workunit.client.1.smithi159.stdout:5/954: rename d9/d24/d4a/f48 to d9/d24/d4a/d52/dfd/d120/f127 0 2022-02-02T18:23:13.150 INFO:tasks.workunit.client.1.smithi159.stdout:5/955: creat d9/f128 x:0 0 0 2022-02-02T18:23:13.150 INFO:tasks.workunit.client.1.smithi159.stdout:5/956: dread - d9/d2e/db1/ff0 zero size 2022-02-02T18:23:13.151 INFO:tasks.workunit.client.1.smithi159.stdout:4/848: mkdir d0/d7b/dc8/d102/d105/d7e/d11e 0 2022-02-02T18:23:13.151 INFO:tasks.workunit.client.1.smithi159.stdout:4/849: truncate d0/f106 224051 0 2022-02-02T18:23:13.152 INFO:tasks.workunit.client.1.smithi159.stdout:4/850: mknod d0/d8/d41/c11f 0 2022-02-02T18:23:13.152 INFO:tasks.workunit.client.1.smithi159.stdout:5/957: creat d9/d2e/dd7/d3c/f129 x:0 0 0 2022-02-02T18:23:13.152 INFO:tasks.workunit.client.1.smithi159.stdout:8/949: dread d1/db7/fef [0,4194304] 0 2022-02-02T18:23:13.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/950: dread - d1/dad/d129/d139/de7/df5/f108 zero size 2022-02-02T18:23:13.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/951: truncate d1/fff 84250 0 2022-02-02T18:23:13.153 INFO:tasks.workunit.client.1.smithi159.stdout:8/952: write d1/fff [531328,41236] 0 2022-02-02T18:23:13.154 INFO:tasks.workunit.client.1.smithi159.stdout:0/919: write d1/d11/d38/d42/daf/d34/f67 [1647916,111283] 0 2022-02-02T18:23:13.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/862: symlink df/d35/d2a/d3f/d42/d47/l116 0 2022-02-02T18:23:13.154 INFO:tasks.workunit.client.1.smithi159.stdout:4/851: creat d0/d8/d24/d76/f120 x:0 0 0 2022-02-02T18:23:13.155 INFO:tasks.workunit.client.1.smithi159.stdout:8/953: dread d1/db7/d75/f78 [0,4194304] 0 2022-02-02T18:23:13.155 INFO:tasks.workunit.client.1.smithi159.stdout:8/954: fdatasync d1/d26/d48/d49/ff3 0 2022-02-02T18:23:13.157 INFO:tasks.workunit.client.1.smithi159.stdout:1/988: dwrite df/d14/d16/d4a/f51 [4194304,4194304] 0 2022-02-02T18:23:13.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/920: symlink d1/d11/d38/d42/daf/d10c/l13d 0 2022-02-02T18:23:13.160 INFO:tasks.workunit.client.1.smithi159.stdout:6/863: truncate df/d35/d2a/d3f/d42/d47/f5e 914742 0 2022-02-02T18:23:13.160 INFO:tasks.workunit.client.1.smithi159.stdout:6/864: stat df/d35/d2a/fcf 0 2022-02-02T18:23:13.162 INFO:tasks.workunit.client.1.smithi159.stdout:8/955: rename d1/db7/d75/f14a to d1/dd/d2c/f14b 0 2022-02-02T18:23:13.164 INFO:tasks.workunit.client.1.smithi159.stdout:1/989: truncate df/d14/d16/d4a/f44 1302862 0 2022-02-02T18:23:13.165 INFO:tasks.workunit.client.1.smithi159.stdout:1/990: truncate df/d14/d68/fbe 442138 0 2022-02-02T18:23:13.165 INFO:tasks.workunit.client.1.smithi159.stdout:1/991: write df/d14/d16/da8/f152 [342344,31174] 0 2022-02-02T18:23:13.165 INFO:tasks.workunit.client.1.smithi159.stdout:8/956: rename d1/dd/d31/dcb/f11a to d1/db7/d75/dc3/f14c 0 2022-02-02T18:23:13.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/921: dread d1/d19/d3d/f40 [0,4194304] 0 2022-02-02T18:23:13.171 INFO:tasks.workunit.client.1.smithi159.stdout:0/922: dread - d1/d11/d38/d7e/fe9 zero size 2022-02-02T18:23:13.171 INFO:tasks.workunit.client.1.smithi159.stdout:0/923: read - d1/d11/d8d/f11a zero size 2022-02-02T18:23:13.175 INFO:tasks.workunit.client.1.smithi159.stdout:0/924: creat d1/dd/d4b/ddd/d10b/f13e x:0 0 0 2022-02-02T18:23:13.175 INFO:tasks.workunit.client.1.smithi159.stdout:0/925: getdents d1/d11/d38/d42/df9/d11d/dd7/de6/d12d 0 2022-02-02T18:23:13.176 INFO:tasks.workunit.client.1.smithi159.stdout:0/926: creat d1/dd/d4b/d7d/f13f x:0 0 0 2022-02-02T18:23:13.176 INFO:tasks.workunit.client.1.smithi159.stdout:4/852: write d0/d7b/dc8/d102/d105/d5d/f7d [611228,57237] 0 2022-02-02T18:23:13.177 INFO:tasks.workunit.client.1.smithi159.stdout:4/853: symlink d0/d7b/l121 0 2022-02-02T18:23:13.180 INFO:tasks.workunit.client.1.smithi159.stdout:0/927: truncate d1/d11/d38/d42/d56/f72 1205205 0 2022-02-02T18:23:13.181 INFO:tasks.workunit.client.1.smithi159.stdout:0/928: fdatasync d1/d11/d38/d42/d56/f97 0 2022-02-02T18:23:13.181 INFO:tasks.workunit.client.1.smithi159.stdout:0/929: truncate d1/dd/d4b/d7d/f12e 550364 0 2022-02-02T18:23:13.181 INFO:tasks.workunit.client.1.smithi159.stdout:0/930: chown d1/dd/d4b/d7d/f100 143 1 2022-02-02T18:23:13.181 INFO:tasks.workunit.client.1.smithi159.stdout:0/931: write d1/d11/d38/d42/fee [4614681,119760] 0 2022-02-02T18:23:13.182 INFO:tasks.workunit.client.1.smithi159.stdout:0/932: truncate d1/f3 8691442 0 2022-02-02T18:23:13.186 INFO:tasks.workunit.client.1.smithi159.stdout:0/933: write d1/dd/d4b/da7/da8/fc6 [1216377,93019] 0 2022-02-02T18:23:13.191 INFO:tasks.workunit.client.1.smithi159.stdout:6/865: dwrite df/f16 [0,4194304] 0 2022-02-02T18:23:13.192 INFO:tasks.workunit.client.1.smithi159.stdout:6/866: stat df/d35/d2a/d3f/d65 0 2022-02-02T18:23:13.192 INFO:tasks.workunit.client.1.smithi159.stdout:6/867: chown df/d35/d2a/d3f/d42/d47/fd9 598 1 2022-02-02T18:23:13.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/934: rename d1/d11/d38/d7e to d1/d19/d3d/d140 0 2022-02-02T18:23:13.194 INFO:tasks.workunit.client.1.smithi159.stdout:6/868: unlink df/d35/d2a/d3f/d65/fba 0 2022-02-02T18:23:13.195 INFO:tasks.workunit.client.1.smithi159.stdout:6/869: stat df/d35/d2a/d3f/f44 0 2022-02-02T18:23:13.195 INFO:tasks.workunit.client.1.smithi159.stdout:6/870: chown df/c63 4683 1 2022-02-02T18:23:13.195 INFO:tasks.workunit.client.1.smithi159.stdout:0/935: mkdir d1/d11/d38/d42/df9/d11d/dd7/de6/d12d/d141 0 2022-02-02T18:23:13.196 INFO:tasks.workunit.client.1.smithi159.stdout:0/936: symlink d1/dd/d4b/ddd/d10b/l142 0 2022-02-02T18:23:13.196 INFO:tasks.workunit.client.1.smithi159.stdout:0/937: chown d1/dd/d4b/f110 135542 1 2022-02-02T18:23:13.197 INFO:tasks.workunit.client.1.smithi159.stdout:0/938: truncate d1/dd/f54 3568971 0 2022-02-02T18:23:13.197 INFO:tasks.workunit.client.1.smithi159.stdout:0/939: link d1/dd/d4b/d7d/f13f d1/dd/d4b/d7d/f143 0 2022-02-02T18:23:13.207 INFO:tasks.workunit.client.1.smithi159.stdout:0/940: dread d1/d19/d3d/f82 [0,4194304] 0 2022-02-02T18:23:13.210 INFO:tasks.workunit.client.1.smithi159.stdout:0/941: link d1/d11/d38/d11c/db0/ffe d1/d19/d3d/d140/f144 0 2022-02-02T18:23:13.210 INFO:tasks.workunit.client.1.smithi159.stdout:0/942: dread - d1/d11/d38/d42/df9/d125/f128 zero size 2022-02-02T18:23:13.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/992: dwrite df/f127 [4194304,4194304] 0 2022-02-02T18:23:13.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/993: readlink df/d21/d23/de7/l148 0 2022-02-02T18:23:13.213 INFO:tasks.workunit.client.1.smithi159.stdout:8/957: dwrite d1/d26/d48/d49/ffa [0,4194304] 0 2022-02-02T18:23:13.213 INFO:tasks.workunit.client.1.smithi159.stdout:5/958: dwrite d9/d2e/d71/f9b [0,4194304] 0 2022-02-02T18:23:13.213 INFO:tasks.workunit.client.1.smithi159.stdout:6/871: dread df/d35/d7b/db4/f73 [0,4194304] 0 2022-02-02T18:23:13.214 INFO:tasks.workunit.client.1.smithi159.stdout:8/958: creat d1/d26/d48/d107/d8a/de4/f14d x:0 0 0 2022-02-02T18:23:13.214 INFO:tasks.workunit.client.1.smithi159.stdout:1/994: mkdir df/d14/d16/d4a/d8b/dff/d166 0 2022-02-02T18:23:13.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/959: dread d9/d2e/dd7/d3c/d8c/dd2/fe6 [0,4194304] 0 2022-02-02T18:23:13.216 INFO:tasks.workunit.client.1.smithi159.stdout:6/872: rmdir df/d35/d2a/d3f/d42/dec 39 2022-02-02T18:23:13.218 INFO:tasks.workunit.client.1.smithi159.stdout:1/995: creat df/d14/d16/d4a/d8b/dff/d166/f167 x:0 0 0 2022-02-02T18:23:13.218 INFO:tasks.workunit.client.1.smithi159.stdout:1/996: fsync df/d14/d16/d4b/da0/f126 0 2022-02-02T18:23:13.221 INFO:tasks.workunit.client.1.smithi159.stdout:5/960: symlink d9/d24/d4a/d8d/d9a/d10b/l12a 0 2022-02-02T18:23:13.223 INFO:tasks.workunit.client.1.smithi159.stdout:5/961: creat d9/d2e/d71/f12b x:0 0 0 2022-02-02T18:23:13.223 INFO:tasks.workunit.client.1.smithi159.stdout:5/962: mkdir d9/d24/d4a/d8d/d9a/d10b/d12c 0 2022-02-02T18:23:13.226 INFO:tasks.workunit.client.1.smithi159.stdout:5/963: link d9/d2e/la1 d9/l12d 0 2022-02-02T18:23:13.226 INFO:tasks.workunit.client.1.smithi159.stdout:1/997: rename df/d14/d68/d159 to df/d14/d16/d168 0 2022-02-02T18:23:13.227 INFO:tasks.workunit.client.1.smithi159.stdout:1/998: symlink df/d21/d23/d49/da1/dd4/l169 0 2022-02-02T18:23:13.228 INFO:tasks.workunit.client.1.smithi159.stdout:5/964: write d9/d2e/dd7/f64 [4108077,46972] 0 2022-02-02T18:23:13.228 INFO:tasks.workunit.client.1.smithi159.stdout:1/999: creat df/d14/d68/dad/f16a x:0 0 0 2022-02-02T18:23:13.242 INFO:tasks.workunit.client.1.smithi159.stdout:8/959: dwrite d1/d26/d48/d49/ff3 [0,4194304] 0 2022-02-02T18:23:13.242 INFO:tasks.workunit.client.1.smithi159.stdout:8/960: stat d1/d26/d48/d107/l85 0 2022-02-02T18:23:13.246 INFO:tasks.workunit.client.1.smithi159.stdout:8/961: rename d1/d26/d48/d7f/l141 to d1/dd/d2c/d67/l14e 0 2022-02-02T18:23:13.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/943: dwrite d1/dd/f54 [0,4194304] 0 2022-02-02T18:23:13.248 INFO:tasks.workunit.client.1.smithi159.stdout:6/873: dwrite df/d35/d2a/d3f/d42/f4b [0,4194304] 0 2022-02-02T18:23:13.249 INFO:tasks.workunit.client.1.smithi159.stdout:6/874: write df/d35/d2a/d3f/d42/fc2 [1043100,102957] 0 2022-02-02T18:23:13.250 INFO:tasks.workunit.client.1.smithi159.stdout:8/962: mknod d1/d26/d48/d99/da5/c14f 0 2022-02-02T18:23:13.251 INFO:tasks.workunit.client.1.smithi159.stdout:5/965: truncate d9/d2e/dd7/d3c/d8c/dd2/f7f 551849 0 2022-02-02T18:23:13.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/944: mknod d1/dd/d119/d11e/c145 0 2022-02-02T18:23:13.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/945: chown d1/dd/d4b/d7d/f143 7 1 2022-02-02T18:23:13.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/946: chown d1/d19/d3d/d140/c7a 46650 1 2022-02-02T18:23:13.265 INFO:tasks.workunit.client.1.smithi159.stdout:5/966: rmdir d9/d2e/dd7/d3c 39 2022-02-02T18:23:13.272 INFO:tasks.workunit.client.1.smithi159.stdout:0/947: mknod d1/d11/d38/d42/daf/c146 0 2022-02-02T18:23:13.273 INFO:tasks.workunit.client.1.smithi159.stdout:5/967: read d9/d2e/dd7/d3c/d8c/dd2/f87 [159932,80316] 0 2022-02-02T18:23:13.273 INFO:tasks.workunit.client.1.smithi159.stdout:5/968: creat d9/d2e/dd7/d3c/f12e x:0 0 0 2022-02-02T18:23:13.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/948: write d1/dd/d4b/da7/dc1/fdb [2406088,55120] 0 2022-02-02T18:23:13.275 INFO:tasks.workunit.client.1.smithi159.stdout:8/963: dwrite d1/dd/d2c/d67/f146 [0,4194304] 0 2022-02-02T18:23:13.276 INFO:tasks.workunit.client.1.smithi159.stdout:6/875: dwrite df/d35/d2a/d3f/d55/d6a/de9/f113 [0,4194304] 0 2022-02-02T18:23:13.276 INFO:tasks.workunit.client.1.smithi159.stdout:0/949: dread d1/dd/d4b/fe8 [0,4194304] 0 2022-02-02T18:23:13.276 INFO:tasks.workunit.client.1.smithi159.stdout:6/876: readlink df/d35/d2a/d3f/lf2 0 2022-02-02T18:23:13.280 INFO:tasks.workunit.client.1.smithi159.stdout:0/950: dread d1/d19/d3d/d140/f77 [0,4194304] 0 2022-02-02T18:23:13.281 INFO:tasks.workunit.client.1.smithi159.stdout:8/964: creat d1/dd/d2c/d67/f150 x:0 0 0 2022-02-02T18:23:13.282 INFO:tasks.workunit.client.1.smithi159.stdout:0/951: mkdir d1/d11/d38/d42/df9/d125/d147 0 2022-02-02T18:23:13.283 INFO:tasks.workunit.client.1.smithi159.stdout:0/952: mkdir d1/d11/d38/d11c/db0/d148 0 2022-02-02T18:23:13.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/953: write d1/d11/d38/d42/df9/d11d/fac [531634,36091] 0 2022-02-02T18:23:13.285 INFO:tasks.workunit.client.1.smithi159.stdout:0/954: mkdir d1/dd/d149 0 2022-02-02T18:23:13.287 INFO:tasks.workunit.client.1.smithi159.stdout:0/955: creat d1/d11/d38/d42/d56/f14a x:0 0 0 2022-02-02T18:23:13.290 INFO:tasks.workunit.client.1.smithi159.stdout:0/956: rename d1/d11/d38/d42/df9/d11d/dd7/de6/d12d to d1/dd/d4b/da7/da8/d10e/d14b 0 2022-02-02T18:23:13.295 INFO:tasks.workunit.client.1.smithi159.stdout:0/957: read d1/d11/d38/d11c/db0/fcc [2327228,68408] 0 2022-02-02T18:23:13.295 INFO:tasks.workunit.client.1.smithi159.stdout:0/958: fdatasync d1/d11/d38/d42/df9/d11d/dd7/de6/f137 0 2022-02-02T18:23:13.296 INFO:tasks.workunit.client.1.smithi159.stdout:0/959: rmdir d1/d11/d38/d42/daf/d34 39 2022-02-02T18:23:13.298 INFO:tasks.workunit.client.1.smithi159.stdout:0/960: rmdir d1/d11/d38/d42/df9/d125/d147 0 2022-02-02T18:23:13.298 INFO:tasks.workunit.client.1.smithi159.stdout:5/969: dwrite d9/d2e/dd7/d3c/d8c/dd2/fb6 [0,4194304] 0 2022-02-02T18:23:13.299 INFO:tasks.workunit.client.1.smithi159.stdout:5/970: chown d9/fe0 0 1 2022-02-02T18:23:13.299 INFO:tasks.workunit.client.1.smithi159.stdout:5/971: creat d9/d24/d4a/d8d/d9a/f12f x:0 0 0 2022-02-02T18:23:13.300 INFO:tasks.workunit.client.1.smithi159.stdout:0/961: creat d1/d11/d38/dd8/f14c x:0 0 0 2022-02-02T18:23:13.302 INFO:tasks.workunit.client.1.smithi159.stdout:0/962: mkdir d1/d11/d14d 0 2022-02-02T18:23:13.302 INFO:tasks.workunit.client.1.smithi159.stdout:0/963: stat d1/d11/d38/d42/daf/f132 0 2022-02-02T18:23:13.303 INFO:tasks.workunit.client.1.smithi159.stdout:8/965: dwrite d1/d26/d48/d7f/f114 [0,4194304] 0 2022-02-02T18:23:13.304 INFO:tasks.workunit.client.1.smithi159.stdout:5/972: rename d9/d24/c2c to d9/d2e/dd7/d3c/c130 0 2022-02-02T18:23:13.305 INFO:tasks.workunit.client.1.smithi159.stdout:5/973: read - d9/d2e/dd7/d3c/d8c/dd2/f6e zero size 2022-02-02T18:23:13.305 INFO:tasks.workunit.client.1.smithi159.stdout:6/877: dwrite df/d35/d2a/d3f/f58 [0,4194304] 0 2022-02-02T18:23:13.306 INFO:tasks.workunit.client.1.smithi159.stdout:6/878: write df/d35/d7b/db4/d84/d9d/fd3 [1363810,100369] 0 2022-02-02T18:23:13.307 INFO:tasks.workunit.client.1.smithi159.stdout:0/964: dread d1/d11/d38/d42/daf/f44 [0,4194304] 0 2022-02-02T18:23:13.308 INFO:tasks.workunit.client.1.smithi159.stdout:5/974: rename d9/d2e/le5 to d9/d24/d4a/d52/dfd/d121/l131 0 2022-02-02T18:23:13.308 INFO:tasks.workunit.client.1.smithi159.stdout:5/975: dread - d9/d2e/d71/f12b zero size 2022-02-02T18:23:13.308 INFO:tasks.workunit.client.1.smithi159.stdout:0/965: mkdir d1/d19/d3d/d140/d10d/d14e 0 2022-02-02T18:23:13.311 INFO:tasks.workunit.client.1.smithi159.stdout:8/966: write d1/dd/d2c/df6/dca/fdd [2117770,56453] 0 2022-02-02T18:23:13.313 INFO:tasks.workunit.client.1.smithi159.stdout:0/966: creat d1/d11/d38/d11c/db0/d148/f14f x:0 0 0 2022-02-02T18:23:13.314 INFO:tasks.workunit.client.1.smithi159.stdout:5/976: rmdir d9/d2e/dd7/d88 39 2022-02-02T18:23:13.317 INFO:tasks.workunit.client.1.smithi159.stdout:8/967: write d1/dd/d2c/df6/dca/fd8 [389538,94902] 0 2022-02-02T18:23:13.318 INFO:tasks.workunit.client.1.smithi159.stdout:8/968: truncate d1/dd/d2c/df6/dca/d11b/f134 391484 0 2022-02-02T18:23:13.319 INFO:tasks.workunit.client.1.smithi159.stdout:5/977: mkdir d9/d24/d4a/d132 0 2022-02-02T18:23:13.319 INFO:tasks.workunit.client.1.smithi159.stdout:0/967: symlink d1/d11/d38/d42/l150 0 2022-02-02T18:23:13.320 INFO:tasks.workunit.client.1.smithi159.stdout:6/879: dwrite df/d35/d2a/d3f/d91/fdc [0,4194304] 0 2022-02-02T18:23:13.321 INFO:tasks.workunit.client.1.smithi159.stdout:6/880: dread - df/d35/d2a/d3f/d55/f100 zero size 2022-02-02T18:23:13.322 INFO:tasks.workunit.client.1.smithi159.stdout:0/968: unlink d1/d11/d38/d42/df9/d11d/l107 0 2022-02-02T18:23:13.324 INFO:tasks.workunit.client.1.smithi159.stdout:8/969: dread d1/d26/d48/f57 [0,4194304] 0 2022-02-02T18:23:13.327 INFO:tasks.workunit.client.1.smithi159.stdout:8/970: truncate d1/d26/d48/d98/f111 2082335 0 2022-02-02T18:23:13.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/971: readlink d1/d26/d48/ld7 0 2022-02-02T18:23:13.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/972: read d1/dd/d1a/d53/f54 [3583768,39019] 0 2022-02-02T18:23:13.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/973: chown d1/dad/d95/daa 7040807 1 2022-02-02T18:23:13.329 INFO:tasks.workunit.client.1.smithi159.stdout:8/974: unlink d1/d26/d48/d107/d8a/de4/f14d 0 2022-02-02T18:23:13.330 INFO:tasks.workunit.client.1.smithi159.stdout:8/975: chown d1/dd/l12 85317 1 2022-02-02T18:23:13.334 INFO:tasks.workunit.client.1.smithi159.stdout:0/969: dread d1/d19/f9c [0,4194304] 0 2022-02-02T18:23:13.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/970: mkdir d1/dd/d151 0 2022-02-02T18:23:13.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/971: chown d1/d19/d3d/d140/f90 160787906 1 2022-02-02T18:23:13.341 INFO:tasks.workunit.client.1.smithi159.stdout:8/976: dread d1/dd/d1a/d53/f6d [0,4194304] 0 2022-02-02T18:23:13.350 INFO:tasks.workunit.client.1.smithi159.stdout:6/881: dwrite df/d35/d2a/d3f/d42/d47/f5e [0,4194304] 0 2022-02-02T18:23:13.357 INFO:tasks.workunit.client.1.smithi159.stdout:5/978: dwrite d9/d24/d37/f1e [0,4194304] 0 2022-02-02T18:23:13.359 INFO:tasks.workunit.client.1.smithi159.stdout:5/979: link d9/d2e/lda d9/d24/d4a/d8d/d122/l133 0 2022-02-02T18:23:13.360 INFO:tasks.workunit.client.1.smithi159.stdout:5/980: symlink d9/d2e/dd7/d3c/daa/ded/l134 0 2022-02-02T18:23:13.360 INFO:tasks.workunit.client.1.smithi159.stdout:5/981: truncate d9/d2e/db1/ff0 87853 0 2022-02-02T18:23:13.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/977: dwrite d1/d26/d48/d7f/f100 [0,4194304] 0 2022-02-02T18:23:13.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/978: dread - d1/dad/d129/d139/f10a zero size 2022-02-02T18:23:13.378 INFO:tasks.workunit.client.1.smithi159.stdout:0/972: dwrite d1/d11/d38/d11c/db0/f120 [0,4194304] 0 2022-02-02T18:23:13.379 INFO:tasks.workunit.client.1.smithi159.stdout:5/982: dread d9/d24/f2d [0,4194304] 0 2022-02-02T18:23:13.380 INFO:tasks.workunit.client.1.smithi159.stdout:8/979: creat d1/db7/d75/deb/f151 x:0 0 0 2022-02-02T18:23:13.382 INFO:tasks.workunit.client.1.smithi159.stdout:0/973: symlink d1/d11/d38/d42/d56/def/l152 0 2022-02-02T18:23:13.383 INFO:tasks.workunit.client.1.smithi159.stdout:6/882: dwrite df/d35/d2a/d2f/d80/d61/f94 [0,4194304] 0 2022-02-02T18:23:13.384 INFO:tasks.workunit.client.1.smithi159.stdout:5/983: creat d9/d24/d4a/d8d/d9a/d10b/f135 x:0 0 0 2022-02-02T18:23:13.385 INFO:tasks.workunit.client.1.smithi159.stdout:0/974: read d1/dd/f33 [4126619,98633] 0 2022-02-02T18:23:13.385 INFO:tasks.workunit.client.1.smithi159.stdout:0/975: readlink d1/d11/d38/d42/df9/d11d/dd7/de6/l138 0 2022-02-02T18:23:13.394 INFO:tasks.workunit.client.1.smithi159.stdout:6/883: dread df/d35/d2a/d2f/d80/d61/da8/fcc [0,4194304] 0 2022-02-02T18:23:13.399 INFO:tasks.workunit.client.1.smithi159.stdout:6/884: dread df/d35/d2a/d3f/d42/d47/d59/fe0 [0,4194304] 0 2022-02-02T18:23:13.399 INFO:tasks.workunit.client.1.smithi159.stdout:6/885: dread - df/d35/d2a/d2f/d80/f10c zero size 2022-02-02T18:23:13.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/886: write df/d35/d2a/d2f/d80/d61/da8/fce [450095,4824] 0 2022-02-02T18:23:13.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/887: fdatasync fd 0 2022-02-02T18:23:13.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/888: getdents df/d35/d2a/d2f/dd2 0 2022-02-02T18:23:13.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/889: fsync df/d35/d2a/d3f/d42/d47/d59/fe0 0 2022-02-02T18:23:13.401 INFO:tasks.workunit.client.1.smithi159.stdout:6/890: mkdir df/d117 0 2022-02-02T18:23:13.402 INFO:tasks.workunit.client.1.smithi159.stdout:6/891: getdents df/d35/d2a/d3f/d55 0 2022-02-02T18:23:13.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/892: unlink df/c39 0 2022-02-02T18:23:13.404 INFO:tasks.workunit.client.1.smithi159.stdout:0/976: dread d1/dd/d4b/ddd/f13c [0,4194304] 0 2022-02-02T18:23:13.405 INFO:tasks.workunit.client.1.smithi159.stdout:0/977: creat d1/d19/f153 x:0 0 0 2022-02-02T18:23:13.405 INFO:tasks.workunit.client.1.smithi159.stdout:0/978: chown d1/d11/d38/lb8 59761 1 2022-02-02T18:23:13.407 INFO:tasks.workunit.client.1.smithi159.stdout:0/979: write d1/d11/d38/d42/daf/f5e [1166853,123825] 0 2022-02-02T18:23:13.408 INFO:tasks.workunit.client.1.smithi159.stdout:5/984: dwrite d9/d24/d4a/d8d/d9a/fd4 [0,4194304] 0 2022-02-02T18:23:13.409 INFO:tasks.workunit.client.1.smithi159.stdout:8/980: dwrite d1/d26/fe0 [0,4194304] 0 2022-02-02T18:23:13.410 INFO:tasks.workunit.client.1.smithi159.stdout:0/980: symlink d1/d19/d3d/d140/d10d/l154 0 2022-02-02T18:23:13.411 INFO:tasks.workunit.client.1.smithi159.stdout:0/981: stat d1/dd/f6d 0 2022-02-02T18:23:13.411 INFO:tasks.workunit.client.1.smithi159.stdout:0/982: stat d1/dd/d4b/ddd/lf1 0 2022-02-02T18:23:13.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/983: read d1/d19/f9c [2056722,38235] 0 2022-02-02T18:23:13.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/984: truncate d1/dd/d4b/ddd/d10b/f13e 348930 0 2022-02-02T18:23:13.414 INFO:tasks.workunit.client.1.smithi159.stdout:8/981: link d1/dd/d1a/f9a d1/dd/d31/dcb/f152 0 2022-02-02T18:23:13.414 INFO:tasks.workunit.client.1.smithi159.stdout:8/982: dread - d1/d26/d48/d107/d8a/de4/f132 zero size 2022-02-02T18:23:13.414 INFO:tasks.workunit.client.1.smithi159.stdout:8/983: truncate d1/dad/d95/daa/f127 992670 0 2022-02-02T18:23:13.415 INFO:tasks.workunit.client.1.smithi159.stdout:0/985: creat d1/d11/d38/d42/df9/d11d/dd7/f155 x:0 0 0 2022-02-02T18:23:13.415 INFO:tasks.workunit.client.1.smithi159.stdout:0/986: truncate d1/d11/d38/d11c/db0/ffe 619871 0 2022-02-02T18:23:13.416 INFO:tasks.workunit.client.1.smithi159.stdout:8/984: write d1/db7/d75/fb5 [2931989,119852] 0 2022-02-02T18:23:13.416 INFO:tasks.workunit.client.1.smithi159.stdout:8/985: dread - d1/d26/d48/d107/d8a/de4/f132 zero size 2022-02-02T18:23:13.417 INFO:tasks.workunit.client.1.smithi159.stdout:0/987: mkdir d1/d11/d38/d42/df9/d11d/d156 0 2022-02-02T18:23:13.417 INFO:tasks.workunit.client.1.smithi159.stdout:0/988: stat d1/f2c 0 2022-02-02T18:23:13.417 INFO:tasks.workunit.client.1.smithi159.stdout:0/989: readlink d1/d11/d38/lb8 0 2022-02-02T18:23:13.417 INFO:tasks.workunit.client.1.smithi159.stdout:8/986: truncate d1/db7/d75/f78 34887 0 2022-02-02T18:23:13.418 INFO:tasks.workunit.client.1.smithi159.stdout:5/985: dread d9/fc [0,4194304] 0 2022-02-02T18:23:13.419 INFO:tasks.workunit.client.1.smithi159.stdout:8/987: link d1/f17 d1/dd/d2c/df6/dca/d11b/f153 0 2022-02-02T18:23:13.420 INFO:tasks.workunit.client.1.smithi159.stdout:5/986: mkdir d9/d2e/dd7/d3c/d8c/d136 0 2022-02-02T18:23:13.422 INFO:tasks.workunit.client.1.smithi159.stdout:0/990: dread d1/d19/d3d/d140/f90 [0,4194304] 0 2022-02-02T18:23:13.423 INFO:tasks.workunit.client.1.smithi159.stdout:6/893: dwrite df/d35/d2a/d3f/f48 [0,4194304] 0 2022-02-02T18:23:13.424 INFO:tasks.workunit.client.1.smithi159.stdout:6/894: stat df/d35/d2a/d3f/d55/d6a/d6e/fa3 0 2022-02-02T18:23:13.426 INFO:tasks.workunit.client.1.smithi159.stdout:6/895: unlink df/d35/d2a/d3f/d42/d47/d59/d66/d88/da6/dc0/ffd 0 2022-02-02T18:23:13.427 INFO:tasks.workunit.client.1.smithi159.stdout:5/987: rmdir d9/d2e/dd7/d3c/d61/dd6/dba/d11c 0 2022-02-02T18:23:13.428 INFO:tasks.workunit.client.1.smithi159.stdout:5/988: truncate d9/f42 8269436 0 2022-02-02T18:23:13.428 INFO:tasks.workunit.client.1.smithi159.stdout:5/989: creat d9/d24/d4a/d8d/d9a/f137 x:0 0 0 2022-02-02T18:23:13.429 INFO:tasks.workunit.client.1.smithi159.stdout:6/896: write df/d35/d7b/db4/d84/d9d/fbe [3089495,130005] 0 2022-02-02T18:23:13.434 INFO:tasks.workunit.client.1.smithi159.stdout:5/990: creat d9/d2e/dd7/d3c/d61/dd6/d68/f138 x:0 0 0 2022-02-02T18:23:13.435 INFO:tasks.workunit.client.1.smithi159.stdout:8/988: dread d1/db7/d75/fb5 [0,4194304] 0 2022-02-02T18:23:13.436 INFO:tasks.workunit.client.1.smithi159.stdout:5/991: creat d9/d24/d4a/f139 x:0 0 0 2022-02-02T18:23:13.439 INFO:tasks.workunit.client.1.smithi159.stdout:8/989: rename d1/db7/d75/d9d/fd0 to d1/db7/d75/de8/dfb/f154 0 2022-02-02T18:23:13.442 INFO:tasks.workunit.client.1.smithi159.stdout:8/990: creat d1/dad/d95/f155 x:0 0 0 2022-02-02T18:23:13.445 INFO:tasks.workunit.client.1.smithi159.stdout:0/991: dwrite d1/d11/d38/d11c/db0/ffe [0,4194304] 0 2022-02-02T18:23:13.446 INFO:tasks.workunit.client.1.smithi159.stdout:6/897: dread df/d35/d2a/d3f/d55/d6a/de9/f113 [0,4194304] 0 2022-02-02T18:23:13.446 INFO:tasks.workunit.client.1.smithi159.stdout:6/898: chown df/d35/d2a/d3f/c6d 23806311 1 2022-02-02T18:23:13.451 INFO:tasks.workunit.client.1.smithi159.stdout:0/992: link d1/d19/f9c d1/d11/d38/d11c/db0/f157 0 2022-02-02T18:23:13.453 INFO:tasks.workunit.client.1.smithi159.stdout:5/992: dwrite d9/d2e/dd7/d3c/d8c/f11e [0,4194304] 0 2022-02-02T18:23:13.464 INFO:tasks.workunit.client.1.smithi159.stdout:0/993: dread d1/d11/f35 [0,4194304] 0 2022-02-02T18:23:13.464 INFO:tasks.workunit.client.1.smithi159.stdout:0/994: stat d1/d19/d3d/l135 0 2022-02-02T18:23:13.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/899: dwrite df/d35/d2a/d2f/d80/d61/f94 [4194304,4194304] 0 2022-02-02T18:23:13.469 INFO:tasks.workunit.client.1.smithi159.stdout:6/900: rmdir df/d35/d7b/db4/d84 39 2022-02-02T18:23:13.471 INFO:tasks.workunit.client.1.smithi159.stdout:6/901: fdatasync df/d35/d2a/d3f/fab 0 2022-02-02T18:23:13.473 INFO:tasks.workunit.client.1.smithi159.stdout:6/902: truncate df/d35/d2a/d3f/d42/d47/fd9 169551 0 2022-02-02T18:23:13.474 INFO:tasks.workunit.client.1.smithi159.stdout:6/903: creat df/d35/d2a/d3f/d42/d47/d59/d66/f118 x:0 0 0 2022-02-02T18:23:13.476 INFO:tasks.workunit.client.1.smithi159.stdout:6/904: creat df/d35/d2a/d3f/d55/d6a/d6e/dfb/f119 x:0 0 0 2022-02-02T18:23:13.477 INFO:tasks.workunit.client.1.smithi159.stdout:6/905: mkdir df/d35/d2a/d2f/d80/d61/deb/ded/d11a 0 2022-02-02T18:23:13.478 INFO:tasks.workunit.client.1.smithi159.stdout:6/906: truncate df/d35/d2a/d3f/d42/d89/fe7 1197983 0 2022-02-02T18:23:13.478 INFO:tasks.workunit.client.1.smithi159.stdout:6/907: stat df/d35/d2a/d3f/d55/d6a/d6e/fb0 0 2022-02-02T18:23:13.480 INFO:tasks.workunit.client.1.smithi159.stdout:0/995: dwrite d1/d11/f68 [4194304,4194304] 0 2022-02-02T18:23:13.481 INFO:tasks.workunit.client.1.smithi159.stdout:6/908: read df/f14 [1122116,125243] 0 2022-02-02T18:23:13.481 INFO:tasks.workunit.client.1.smithi159.stdout:0/996: symlink d1/d11/d38/d42/db5/l158 0 2022-02-02T18:23:13.485 INFO:tasks.workunit.client.1.smithi159.stdout:0/997: dread d1/d19/d3d/f82 [0,4194304] 0 2022-02-02T18:23:13.487 INFO:tasks.workunit.client.1.smithi159.stdout:0/998: read d1/d19/d3d/f7b [1802767,61676] 0 2022-02-02T18:23:13.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/999: truncate d1/dd/f1a 2659438 0 2022-02-02T18:23:13.502 INFO:tasks.workunit.client.1.smithi159.stdout:6/909: dwrite df/d35/d2a/d3f/f48 [0,4194304] 0 2022-02-02T18:23:13.751 INFO:tasks.workunit.client.1.smithi159.stdout:9/883: sync 2022-02-02T18:23:13.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/884: symlink d4/d19/d1c/l124 0 2022-02-02T18:23:13.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/885: chown d4/d19/d1c/d1f/c52 512458673 1 2022-02-02T18:23:13.761 INFO:tasks.workunit.client.1.smithi159.stdout:9/886: dread d4/d19/f31 [0,4194304] 0 2022-02-02T18:23:13.762 INFO:tasks.workunit.client.1.smithi159.stdout:9/887: mknod d4/d19/d1c/d21/d95/c125 0 2022-02-02T18:23:13.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:13 smithi159 conmon[35668]: cluster 2022-02-02T18:23:12.545824+0000 mgr.smithi096.shfutl (mgr.14628) 29 2022-02-02T18:23:13.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:13 smithi159 conmon[35668]: : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 137 MiB/s wr, 232 op/s 2022-02-02T18:23:13.777 INFO:tasks.workunit.client.1.smithi159.stdout:9/888: dwrite d4/d19/d1c/d21/d95/f6d [4194304,4194304] 0 2022-02-02T18:23:13.777 INFO:tasks.workunit.client.1.smithi159.stdout:9/889: chown d4/d2a 258 1 2022-02-02T18:23:13.786 INFO:tasks.workunit.client.1.smithi159.stdout:9/890: dread d4/f10 [4194304,4194304] 0 2022-02-02T18:23:13.787 INFO:tasks.workunit.client.1.smithi159.stdout:9/891: truncate d4/d19/d1c/d21/d95/fc0 878826 0 2022-02-02T18:23:13.787 INFO:tasks.workunit.client.1.smithi159.stdout:9/892: mknod d4/d7a/d11d/c126 0 2022-02-02T18:23:13.811 INFO:tasks.workunit.client.1.smithi159.stdout:9/893: dwrite d4/d19/d1c/d21/d41/d9a/de6/ff6 [0,4194304] 0 2022-02-02T18:23:13.811 INFO:tasks.workunit.client.1.smithi159.stdout:9/894: chown d4/d19/d1c/d21/d95/dc9 12783 1 2022-02-02T18:23:13.811 INFO:tasks.workunit.client.1.smithi159.stdout:9/895: chown d4/d7a/d11d 177 1 2022-02-02T18:23:13.815 INFO:tasks.workunit.client.1.smithi159.stdout:9/896: dread d4/d2a/f34 [0,4194304] 0 2022-02-02T18:23:13.820 INFO:tasks.workunit.client.1.smithi159.stdout:9/897: truncate d4/d19/d1c/d21/d95/fc0 1113382 0 2022-02-02T18:23:13.822 INFO:tasks.workunit.client.1.smithi159.stdout:9/898: rename d4/d2a/d87/da1/cd5 to d4/d19/d1c/d1f/c127 0 2022-02-02T18:23:13.823 INFO:tasks.workunit.client.1.smithi159.stdout:9/899: mkdir d4/d19/d6f/d78/d128 0 2022-02-02T18:23:13.823 INFO:tasks.workunit.client.1.smithi159.stdout:9/900: readlink d4/d19/d1c/d21/d22/d55/ld3 0 2022-02-02T18:23:13.824 INFO:tasks.workunit.client.1.smithi159.stdout:9/901: mkdir d4/d7a/dbc/d129 0 2022-02-02T18:23:13.825 INFO:tasks.workunit.client.1.smithi159.stdout:8/991: sync 2022-02-02T18:23:13.825 INFO:tasks.workunit.client.1.smithi159.stdout:4/854: sync 2022-02-02T18:23:13.825 INFO:tasks.workunit.client.1.smithi159.stdout:9/902: creat d4/d7a/d11d/f12a x:0 0 0 2022-02-02T18:23:13.826 INFO:tasks.workunit.client.1.smithi159.stdout:8/992: creat d1/d26/d48/d98/f156 x:0 0 0 2022-02-02T18:23:13.826 INFO:tasks.workunit.client.1.smithi159.stdout:8/993: chown d1/d26/d48/d98/f156 44475 1 2022-02-02T18:23:13.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/903: write d4/d19/d6f/d74/f8f [4388713,40072] 0 2022-02-02T18:23:13.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/904: chown d4/d7a/d11d 7281 1 2022-02-02T18:23:13.828 INFO:tasks.workunit.client.1.smithi159.stdout:9/905: rename d4/d19/d1c/d1f/d90/l100 to d4/d19/d6f/d74/db1/dc7/l12b 0 2022-02-02T18:23:13.852 INFO:tasks.workunit.client.1.smithi159.stdout:4/855: dwrite d0/d8/d41/db7/d36/fa6 [0,4194304] 0 2022-02-02T18:23:13.853 INFO:tasks.workunit.client.1.smithi159.stdout:8/994: dwrite d1/d26/d48/d49/ff3 [0,4194304] 0 2022-02-02T18:23:13.855 INFO:tasks.workunit.client.1.smithi159.stdout:8/995: unlink d1/dd/d31/dcb/f121 0 2022-02-02T18:23:13.855 INFO:tasks.workunit.client.1.smithi159.stdout:8/996: write d1/d26/d48/d107/d8a/f10d [734895,83176] 0 2022-02-02T18:23:13.855 INFO:tasks.workunit.client.1.smithi159.stdout:8/997: creat d1/dad/d95/f157 x:0 0 0 2022-02-02T18:23:13.859 INFO:tasks.workunit.client.1.smithi159.stdout:4/856: mknod d0/d8/c122 0 2022-02-02T18:23:13.868 INFO:tasks.workunit.client.1.smithi159.stdout:4/857: dread d0/d8/d24/f68 [0,4194304] 0 2022-02-02T18:23:13.869 INFO:tasks.workunit.client.1.smithi159.stdout:4/858: mknod d0/d8/d24/d4f/c123 0 2022-02-02T18:23:13.869 INFO:tasks.workunit.client.1.smithi159.stdout:4/859: chown d0/d8/d15/d61/dd9/f109 41654061 1 2022-02-02T18:23:13.871 INFO:tasks.workunit.client.1.smithi159.stdout:4/860: rmdir d0/d7b/dc8/d102/d105/d7e/d11e 0 2022-02-02T18:23:13.872 INFO:tasks.workunit.client.1.smithi159.stdout:4/861: chown d0/d8/d15/l32 212740 1 2022-02-02T18:23:13.872 INFO:tasks.workunit.client.1.smithi159.stdout:8/998: dwrite d1/d26/d48/f13c [0,4194304] 0 2022-02-02T18:23:13.872 INFO:tasks.workunit.client.1.smithi159.stdout:8/999: readlink d1/d26/d48/d107/l85 0 2022-02-02T18:23:13.873 INFO:tasks.workunit.client.1.smithi159.stdout:4/862: creat d0/d8/d41/db7/d33/d47/d56/dc3/f124 x:0 0 0 2022-02-02T18:23:13.873 INFO:tasks.workunit.client.1.smithi159.stdout:4/863: stat d0/d66/ccf 0 2022-02-02T18:23:13.873 INFO:tasks.workunit.client.1.smithi159.stdout:4/864: chown d0/f106 7545393 1 2022-02-02T18:23:13.887 INFO:tasks.workunit.client.1.smithi159.stdout:4/865: dwrite d0/d8/d24/d4f/fa8 [0,4194304] 0 2022-02-02T18:23:13.894 INFO:tasks.workunit.client.1.smithi159.stdout:4/866: dread d0/ff [0,4194304] 0 2022-02-02T18:23:13.901 INFO:tasks.workunit.client.1.smithi159.stdout:4/867: dread d0/d7b/dc8/d102/d105/f100 [0,4194304] 0 2022-02-02T18:23:13.903 INFO:tasks.workunit.client.1.smithi159.stdout:4/868: symlink d0/d7b/dc8/d102/d105/d7e/l125 0 2022-02-02T18:23:13.912 INFO:tasks.workunit.client.1.smithi159.stdout:4/869: dread d0/d8/d41/db7/d33/d47/f9a [0,4194304] 0 2022-02-02T18:23:13.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/870: readlink d0/d8/d15/l32 0 2022-02-02T18:23:13.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/871: write d0/d8/d41/db7/d33/d47/ff2 [1014800,49317] 0 2022-02-02T18:23:13.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/872: creat d0/d8/d41/db7/d33/d47/d56/f126 x:0 0 0 2022-02-02T18:23:13.914 INFO:tasks.workunit.client.1.smithi159.stdout:4/873: unlink d0/d8/d41/db7/d36/d4b/f54 0 2022-02-02T18:23:13.914 INFO:tasks.workunit.client.1.smithi159.stdout:4/874: fdatasync d0/d7b/dc8/d102/d105/d5d/f103 0 2022-02-02T18:23:13.932 INFO:tasks.workunit.client.1.smithi159.stdout:4/875: dwrite d0/d8/d24/d4f/f72 [0,4194304] 0 2022-02-02T18:23:13.933 INFO:tasks.workunit.client.1.smithi159.stdout:4/876: dread d0/d8/d41/db7/d33/d47/d56/f8a [0,4194304] 0 2022-02-02T18:23:13.934 INFO:tasks.workunit.client.1.smithi159.stdout:4/877: mkdir d0/d7b/dc8/d102/d105/d7e/d9c/d127 0 2022-02-02T18:23:13.935 INFO:tasks.workunit.client.1.smithi159.stdout:4/878: read d0/d7b/dc8/d102/d105/f37 [330166,87643] 0 2022-02-02T18:23:13.936 INFO:tasks.workunit.client.1.smithi159.stdout:4/879: creat d0/d8/d15/d61/f128 x:0 0 0 2022-02-02T18:23:13.936 INFO:tasks.workunit.client.1.smithi159.stdout:4/880: fsync d0/d7b/dc8/d102/d105/d5d/fb5 0 2022-02-02T18:23:13.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/881: truncate d0/d8/d41/db7/d33/f45 1922225 0 2022-02-02T18:23:13.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/882: dread - d0/d8/d15/d61/dd9/ffd zero size 2022-02-02T18:23:13.938 INFO:tasks.workunit.client.1.smithi159.stdout:4/883: write d0/d8/f1c [424793,23237] 0 2022-02-02T18:23:13.940 INFO:tasks.workunit.client.1.smithi159.stdout:4/884: link d0/d8/fa4 d0/d8/d41/db7/f129 0 2022-02-02T18:23:13.940 INFO:tasks.workunit.client.1.smithi159.stdout:4/885: fdatasync d0/d8/d41/db7/d33/dc0/fef 0 2022-02-02T18:23:13.957 INFO:tasks.workunit.client.1.smithi159.stdout:4/886: dwrite d0/f2d [0,4194304] 0 2022-02-02T18:23:13.975 INFO:tasks.workunit.client.1.smithi159.stdout:4/887: dwrite d0/d7b/dc8/d102/d105/f91 [0,4194304] 0 2022-02-02T18:23:13.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/888: dwrite d0/d8/d15/fe1 [0,4194304] 0 2022-02-02T18:23:13.994 INFO:tasks.workunit.client.1.smithi159.stdout:5/993: sync 2022-02-02T18:23:13.994 INFO:tasks.workunit.client.1.smithi159.stdout:6/910: sync 2022-02-02T18:23:13.997 INFO:tasks.workunit.client.1.smithi159.stdout:6/911: mkdir df/d35/d2a/d3f/d42/d47/d59/d97/d11b 0 2022-02-02T18:23:13.997 INFO:tasks.workunit.client.1.smithi159.stdout:6/912: fsync df/d35/d2a/fcf 0 2022-02-02T18:23:13.998 INFO:tasks.workunit.client.1.smithi159.stdout:6/913: chown df/d35/d2a/d3f/f58 79192 1 2022-02-02T18:23:14.004 INFO:tasks.workunit.client.1.smithi159.stdout:4/889: dread d0/f2b [0,4194304] 0 2022-02-02T18:23:14.006 INFO:tasks.workunit.client.1.smithi159.stdout:4/890: mknod d0/d8/d24/d3a/c12a 0 2022-02-02T18:23:14.009 INFO:tasks.workunit.client.1.smithi159.stdout:5/994: dwrite d9/d2e/dd7/d3c/d8c/dd2/fe6 [0,4194304] 0 2022-02-02T18:23:14.012 INFO:tasks.workunit.client.1.smithi159.stdout:5/995: symlink d9/d24/d4a/d52/d100/l13a 0 2022-02-02T18:23:14.015 INFO:tasks.workunit.client.1.smithi159.stdout:5/996: link d9/d2e/d63/c109 d9/d2e/c13b 0 2022-02-02T18:23:14.016 INFO:tasks.workunit.client.1.smithi159.stdout:5/997: truncate d9/d2e/d71/f12b 400579 0 2022-02-02T18:23:14.016 INFO:tasks.workunit.client.1.smithi159.stdout:5/998: truncate d9/d2e/f54 476317 0 2022-02-02T18:23:14.017 INFO:tasks.workunit.client.1.smithi159.stdout:5/999: write d9/d2e/dd7/d3c/d61/dd6/dba/fbe [1181045,57920] 0 2022-02-02T18:23:14.025 INFO:tasks.workunit.client.1.smithi159.stdout:4/891: rename d0/d8/d41/db7/d33/d47/d56 to d0/d8/d24/d3a/d12b 0 2022-02-02T18:23:14.025 INFO:tasks.workunit.client.1.smithi159.stdout:4/892: symlink d0/d8/d15/d61/l12c 0 2022-02-02T18:23:14.025 INFO:tasks.workunit.client.1.smithi159.stdout:4/893: stat d0/d8/d41/db7/d33/d47/fa1 0 2022-02-02T18:23:14.026 INFO:tasks.workunit.client.1.smithi159.stdout:4/894: fdatasync d0/d8/d24/d4f/f72 0 2022-02-02T18:23:14.026 INFO:tasks.workunit.client.1.smithi159.stdout:4/895: dread d0/d8/d24/f68 [0,4194304] 0 2022-02-02T18:23:14.027 INFO:tasks.workunit.client.1.smithi159.stdout:4/896: truncate d0/d7b/dc8/d102/d105/d5d/f7d 1615505 0 2022-02-02T18:23:14.027 INFO:tasks.workunit.client.1.smithi159.stdout:4/897: readlink d0/d7b/dc8/d102/d105/d7e/lc2 0 2022-02-02T18:23:14.028 INFO:tasks.workunit.client.1.smithi159.stdout:4/898: getdents d0/d104 0 2022-02-02T18:23:14.028 INFO:tasks.workunit.client.1.smithi159.stdout:6/914: dwrite df/d35/f34 [4194304,4194304] 0 2022-02-02T18:23:14.029 INFO:tasks.workunit.client.1.smithi159.stdout:6/915: dread - df/d35/d2a/d2f/da7/f101 zero size 2022-02-02T18:23:14.029 INFO:tasks.workunit.client.1.smithi159.stdout:6/916: fsync df/f16 0 2022-02-02T18:23:14.029 INFO:tasks.workunit.client.1.smithi159.stdout:6/917: fsync df/d35/d2a/d3f/d55/d6a/f10a 0 2022-02-02T18:23:14.029 INFO:tasks.workunit.client.1.smithi159.stdout:4/899: write d0/d8/d41/db7/d33/fbf [1416986,20804] 0 2022-02-02T18:23:14.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/900: write d0/f106 [393675,95534] 0 2022-02-02T18:23:14.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/901: symlink d0/d66/l12d 0 2022-02-02T18:23:14.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/902: fdatasync d0/d8/d15/fb1 0 2022-02-02T18:23:14.031 INFO:tasks.workunit.client.1.smithi159.stdout:4/903: symlink d0/dec/l12e 0 2022-02-02T18:23:14.033 INFO:tasks.workunit.client.1.smithi159.stdout:4/904: symlink d0/d8/d41/db7/d108/l12f 0 2022-02-02T18:23:14.033 INFO:tasks.workunit.client.1.smithi159.stdout:4/905: creat d0/d8/d41/f130 x:0 0 0 2022-02-02T18:23:14.033 INFO:tasks.workunit.client.1.smithi159.stdout:4/906: chown d0/d7b/dc8/f113 106955644 1 2022-02-02T18:23:14.035 INFO:tasks.workunit.client.1.smithi159.stdout:4/907: symlink d0/d8/d24/d76/l131 0 2022-02-02T18:23:14.042 INFO:tasks.workunit.client.1.smithi159.stdout:6/918: dwrite df/d35/d2a/d2f/d80/d61/da8/fc4 [0,4194304] 0 2022-02-02T18:23:14.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/908: dread d0/d8/f20 [0,4194304] 0 2022-02-02T18:23:14.044 INFO:tasks.workunit.client.1.smithi159.stdout:4/909: write d0/d8/d41/db7/d36/d4b/dd4/f10c [855999,113130] 0 2022-02-02T18:23:14.044 INFO:tasks.workunit.client.1.smithi159.stdout:4/910: chown d0/d8/d41/db7/d36/lb9 0 1 2022-02-02T18:23:14.045 INFO:tasks.workunit.client.1.smithi159.stdout:4/911: read d0/d7b/dc8/fb4 [3491604,130857] 0 2022-02-02T18:23:14.050 INFO:tasks.workunit.client.1.smithi159.stdout:6/919: dread - df/d35/d2a/d3f/f104 zero size 2022-02-02T18:23:14.050 INFO:tasks.workunit.client.1.smithi159.stdout:6/920: fsync df/d35/d2a/d3f/d42/d47/fc1 0 2022-02-02T18:23:14.053 INFO:tasks.workunit.client.1.smithi159.stdout:4/912: rename d0/d8/d41/db7/d36/c96 to d0/d8/d24/d3a/c132 0 2022-02-02T18:23:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:13 smithi096 conmon[32067]: cluster 2022-02-02T18:23:12.545824+0000 mgr.smithi096.shfutl (mgr.14628) 29 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 137 MiB/s wr, 232 op/s 2022-02-02T18:23:14.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/921: mknod df/d35/d2a/d3f/c11c 0 2022-02-02T18:23:14.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/922: chown df/d35/f78 181 1 2022-02-02T18:23:14.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/923: creat df/d35/d2a/d3f/d42/d47/d59/d97/f11d x:0 0 0 2022-02-02T18:23:14.059 INFO:tasks.workunit.client.1.smithi159.stdout:6/924: chown df/d35/d2a/d3f/d55/d6a/d6e/dfb/lff 727651 1 2022-02-02T18:23:14.059 INFO:tasks.workunit.client.1.smithi159.stdout:4/913: mkdir d0/d7b/d133 0 2022-02-02T18:23:14.060 INFO:tasks.workunit.client.1.smithi159.stdout:4/914: mknod d0/d8/d24/c134 0 2022-02-02T18:23:14.063 INFO:tasks.workunit.client.1.smithi159.stdout:9/906: sync 2022-02-02T18:23:14.065 INFO:tasks.workunit.client.1.smithi159.stdout:9/907: write d4/d19/d1c/d1f/f72 [233560,56889] 0 2022-02-02T18:23:14.065 INFO:tasks.workunit.client.1.smithi159.stdout:9/908: fdatasync d4/d19/d1c/d1f/f4d 0 2022-02-02T18:23:14.067 INFO:tasks.workunit.client.1.smithi159.stdout:6/925: dread df/d35/d2a/d3f/d42/f82 [0,4194304] 0 2022-02-02T18:23:14.079 INFO:tasks.workunit.client.1.smithi159.stdout:4/915: dwrite d0/d8/d41/db7/f129 [0,4194304] 0 2022-02-02T18:23:14.092 INFO:tasks.workunit.client.1.smithi159.stdout:9/909: dwrite d4/f16 [0,4194304] 0 2022-02-02T18:23:14.118 INFO:tasks.workunit.client.1.smithi159.stdout:4/916: dwrite d0/d8/d41/db7/d33/fbf [4194304,4194304] 0 2022-02-02T18:23:14.123 INFO:tasks.workunit.client.1.smithi159.stdout:6/926: dwrite df/d35/f74 [0,4194304] 0 2022-02-02T18:23:14.128 INFO:tasks.workunit.client.1.smithi159.stdout:9/910: dwrite d4/d19/d1c/d21/da8/db9/dd1/d118/fcf [0,4194304] 0 2022-02-02T18:23:14.128 INFO:tasks.workunit.client.1.smithi159.stdout:4/917: creat d0/d104/f135 x:0 0 0 2022-02-02T18:23:14.129 INFO:tasks.workunit.client.1.smithi159.stdout:6/927: creat df/d35/d7b/f11e x:0 0 0 2022-02-02T18:23:14.130 INFO:tasks.workunit.client.1.smithi159.stdout:6/928: creat df/d35/d2a/d3f/d42/d47/d59/d97/f11f x:0 0 0 2022-02-02T18:23:14.130 INFO:tasks.workunit.client.1.smithi159.stdout:6/929: fsync df/d35/d2a/f5c 0 2022-02-02T18:23:14.131 INFO:tasks.workunit.client.1.smithi159.stdout:9/911: dread d4/d2a/f9d [0,4194304] 0 2022-02-02T18:23:14.131 INFO:tasks.workunit.client.1.smithi159.stdout:9/912: dread - d4/d19/fc1 zero size 2022-02-02T18:23:14.136 INFO:tasks.workunit.client.1.smithi159.stdout:6/930: creat df/d35/d2a/d3f/d42/dd7/f120 x:0 0 0 2022-02-02T18:23:14.136 INFO:tasks.workunit.client.1.smithi159.stdout:4/918: truncate d0/d8/d15/d61/fa9 1139066 0 2022-02-02T18:23:14.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/919: stat d0/d8/d24/d3a/ff0 0 2022-02-02T18:23:14.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/920: chown d0/d7b/dc8/d102/d105/d5d 14 1 2022-02-02T18:23:14.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/921: fsync d0/d8/d15/f2e 0 2022-02-02T18:23:14.143 INFO:tasks.workunit.client.1.smithi159.stdout:6/931: read df/d35/d2a/d2f/d80/d61/fbc [3319624,130655] 0 2022-02-02T18:23:14.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/922: dwrite d0/f3 [4194304,4194304] 0 2022-02-02T18:23:14.172 INFO:tasks.workunit.client.1.smithi159.stdout:6/932: dwrite df/d35/d2a/d3f/d42/d47/d59/d66/d88/f5b [0,4194304] 0 2022-02-02T18:23:14.173 INFO:tasks.workunit.client.1.smithi159.stdout:4/923: rmdir d0/d8/d24/d4f 39 2022-02-02T18:23:14.174 INFO:tasks.workunit.client.1.smithi159.stdout:6/933: creat df/d35/d2a/d3f/d55/d6a/f121 x:0 0 0 2022-02-02T18:23:14.176 INFO:tasks.workunit.client.1.smithi159.stdout:4/924: symlink d0/d8/d24/d76/l136 0 2022-02-02T18:23:14.178 INFO:tasks.workunit.client.1.smithi159.stdout:4/925: link d0/d8/d41/db7/d33/dc0/fef d0/d7b/f137 0 2022-02-02T18:23:14.179 INFO:tasks.workunit.client.1.smithi159.stdout:4/926: symlink d0/d104/l138 0 2022-02-02T18:23:14.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/927: link d0/d8/d41/db7/da3/dcd/ce3 d0/d8/d24/d3a/d12b/dc3/c139 0 2022-02-02T18:23:14.196 INFO:tasks.workunit.client.1.smithi159.stdout:6/934: dwrite df/d35/d2a/fcf [0,4194304] 0 2022-02-02T18:23:14.197 INFO:tasks.workunit.client.1.smithi159.stdout:6/935: write df/d35/d2a/d3f/d42/d47/d59/d97/f11d [784812,66038] 0 2022-02-02T18:23:14.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/936: truncate df/d35/d2a/d2f/d80/f92 2386097 0 2022-02-02T18:23:14.198 INFO:tasks.workunit.client.1.smithi159.stdout:4/928: dwrite d0/d7b/dc8/d102/d105/fd3 [0,4194304] 0 2022-02-02T18:23:14.199 INFO:tasks.workunit.client.1.smithi159.stdout:6/937: rmdir df/d35/d7b/db4/d84 39 2022-02-02T18:23:14.201 INFO:tasks.workunit.client.1.smithi159.stdout:4/929: creat d0/d7b/dc8/d102/d105/d7e/d9c/d127/f13a x:0 0 0 2022-02-02T18:23:14.201 INFO:tasks.workunit.client.1.smithi159.stdout:4/930: read d0/d8/d41/f9d [94568,32092] 0 2022-02-02T18:23:14.202 INFO:tasks.workunit.client.1.smithi159.stdout:6/938: creat df/d35/d2a/d3f/d42/f122 x:0 0 0 2022-02-02T18:23:14.203 INFO:tasks.workunit.client.1.smithi159.stdout:4/931: symlink d0/d8/d24/d3a/d12b/d11a/l13b 0 2022-02-02T18:23:14.203 INFO:tasks.workunit.client.1.smithi159.stdout:4/932: readlink d0/d8/d15/l1f 0 2022-02-02T18:23:14.204 INFO:tasks.workunit.client.1.smithi159.stdout:4/933: write d0/d66/f73 [259442,21153] 0 2022-02-02T18:23:14.204 INFO:tasks.workunit.client.1.smithi159.stdout:6/939: creat df/d35/d2a/d3f/d55/d6a/de9/d10b/f123 x:0 0 0 2022-02-02T18:23:14.205 INFO:tasks.workunit.client.1.smithi159.stdout:6/940: write df/d35/f8e [792778,18237] 0 2022-02-02T18:23:14.208 INFO:tasks.workunit.client.1.smithi159.stdout:4/934: mkdir d0/d104/d118/d13c 0 2022-02-02T18:23:14.208 INFO:tasks.workunit.client.1.smithi159.stdout:4/935: chown d0/d8/d15/d61/l12c 46459 1 2022-02-02T18:23:14.209 INFO:tasks.workunit.client.1.smithi159.stdout:4/936: fsync d0/d8/d41/db7/d33/fbf 0 2022-02-02T18:23:14.209 INFO:tasks.workunit.client.1.smithi159.stdout:6/941: creat df/d35/d2a/d3f/d42/d47/d59/d66/d88/f124 x:0 0 0 2022-02-02T18:23:14.211 INFO:tasks.workunit.client.1.smithi159.stdout:6/942: link df/d35/d2a/d3f/d42/d47/d59/d97/f11d df/d35/d2a/d2f/da7/f125 0 2022-02-02T18:23:14.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/943: write f7 [2168199,57209] 0 2022-02-02T18:23:14.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/944: stat df/d35/f38 0 2022-02-02T18:23:14.212 INFO:tasks.workunit.client.1.smithi159.stdout:4/937: rename d0/d8/d15/f10a to d0/d8/f13d 0 2022-02-02T18:23:14.214 INFO:tasks.workunit.client.1.smithi159.stdout:4/938: link d0/fcc d0/d8/d41/db7/da3/f13e 0 2022-02-02T18:23:14.215 INFO:tasks.workunit.client.1.smithi159.stdout:4/939: readlink d0/d8/d15/d61/l77 0 2022-02-02T18:23:14.216 INFO:tasks.workunit.client.1.smithi159.stdout:6/945: mkdir df/d35/d2a/d3f/d55/d6a/d6e/d126 0 2022-02-02T18:23:14.216 INFO:tasks.workunit.client.1.smithi159.stdout:6/946: fdatasync df/d35/d2a/fcf 0 2022-02-02T18:23:14.217 INFO:tasks.workunit.client.1.smithi159.stdout:6/947: write df/d35/d2a/d3f/fab [757413,120016] 0 2022-02-02T18:23:14.217 INFO:tasks.workunit.client.1.smithi159.stdout:6/948: stat df/d35/f78 0 2022-02-02T18:23:14.219 INFO:tasks.workunit.client.1.smithi159.stdout:4/940: creat d0/d8/d24/f13f x:0 0 0 2022-02-02T18:23:14.225 INFO:tasks.workunit.client.1.smithi159.stdout:6/949: rmdir df/d35/d2a/d3f/d42/d47/d59 39 2022-02-02T18:23:14.228 INFO:tasks.workunit.client.1.smithi159.stdout:4/941: dread d0/d7b/dc8/d102/d105/d7e/d9c/fe4 [0,4194304] 0 2022-02-02T18:23:14.236 INFO:tasks.workunit.client.1.smithi159.stdout:4/942: dread d0/d8/d41/db7/d36/f88 [0,4194304] 0 2022-02-02T18:23:14.243 INFO:tasks.workunit.client.1.smithi159.stdout:6/950: write df/f2e [377133,76891] 0 2022-02-02T18:23:14.244 INFO:tasks.workunit.client.1.smithi159.stdout:4/943: dread d0/d8/d24/d4f/fa8 [0,4194304] 0 2022-02-02T18:23:14.244 INFO:tasks.workunit.client.1.smithi159.stdout:6/951: symlink df/d35/d2a/d3f/d91/l127 0 2022-02-02T18:23:14.246 INFO:tasks.workunit.client.1.smithi159.stdout:4/944: dread d0/d8/d41/db7/d33/d47/ff8 [0,4194304] 0 2022-02-02T18:23:14.257 INFO:tasks.workunit.client.1.smithi159.stdout:6/952: dread df/d35/d2a/d3f/d55/d6a/d6e/fa3 [0,4194304] 0 2022-02-02T18:23:14.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/953: write df/d35/d2a/d2f/da7/f125 [993981,94420] 0 2022-02-02T18:23:14.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/954: fdatasync df/d35/d2a/d3f/d55/d6a/f10a 0 2022-02-02T18:23:14.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/955: readlink df/d35/d2a/d2f/l4f 0 2022-02-02T18:23:14.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/956: symlink df/d35/d2a/d3f/d55/d6a/d6e/l128 0 2022-02-02T18:23:14.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/957: fsync df/d35/d2a/d3f/d42/d47/d59/d66/d88/f124 0 2022-02-02T18:23:14.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/958: creat df/f129 x:0 0 0 2022-02-02T18:23:14.259 INFO:tasks.workunit.client.1.smithi159.stdout:6/959: truncate df/d35/d2a/d3f/d91/fdc 489998 0 2022-02-02T18:23:14.260 INFO:tasks.workunit.client.1.smithi159.stdout:6/960: mkdir df/d12a 0 2022-02-02T18:23:14.260 INFO:tasks.workunit.client.1.smithi159.stdout:6/961: creat df/d12a/f12b x:0 0 0 2022-02-02T18:23:14.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/962: mkdir df/d35/d2a/d3f/d42/d12c 0 2022-02-02T18:23:14.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/963: write df/d35/d2a/d3f/d42/d47/d59/d66/d88/f98 [3374013,57024] 0 2022-02-02T18:23:14.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/964: fsync df/d35/d2a/d2f/fa0 0 2022-02-02T18:23:14.264 INFO:tasks.workunit.client.1.smithi159.stdout:6/965: write df/d35/f57 [4953526,89725] 0 2022-02-02T18:23:14.265 INFO:tasks.workunit.client.1.smithi159.stdout:6/966: symlink df/d35/d2a/d3f/d55/d6a/d6e/d126/l12d 0 2022-02-02T18:23:14.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/945: dwrite d0/d7b/dc8/d102/d105/d7e/d9c/fe4 [0,4194304] 0 2022-02-02T18:23:14.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/946: creat d0/d8/d41/db7/d33/dc0/f140 x:0 0 0 2022-02-02T18:23:14.267 INFO:tasks.workunit.client.1.smithi159.stdout:6/967: symlink df/d35/d2a/d3f/d42/d47/d59/d66/d88/l12e 0 2022-02-02T18:23:14.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/968: write df/d35/d2a/d3f/d42/d47/f5e [1149665,25814] 0 2022-02-02T18:23:14.268 INFO:tasks.workunit.client.1.smithi159.stdout:4/947: write d0/d7b/dc8/d102/d105/fd3 [2531288,128501] 0 2022-02-02T18:23:14.270 INFO:tasks.workunit.client.1.smithi159.stdout:6/969: creat df/d35/d7b/f12f x:0 0 0 2022-02-02T18:23:14.271 INFO:tasks.workunit.client.1.smithi159.stdout:4/948: stat d0/d8/la 0 2022-02-02T18:23:14.271 INFO:tasks.workunit.client.1.smithi159.stdout:6/970: read df/d35/d2a/d2f/da7/f125 [922464,13481] 0 2022-02-02T18:23:14.271 INFO:tasks.workunit.client.1.smithi159.stdout:6/971: rmdir df/d35/d7b/db4/d84/d9d 39 2022-02-02T18:23:14.272 INFO:tasks.workunit.client.1.smithi159.stdout:4/949: read d0/f5 [1969346,126156] 0 2022-02-02T18:23:14.273 INFO:tasks.workunit.client.1.smithi159.stdout:6/972: mkdir df/d35/d2a/d3f/d42/d12c/d130 0 2022-02-02T18:23:14.273 INFO:tasks.workunit.client.1.smithi159.stdout:6/973: truncate df/d35/f57 6249638 0 2022-02-02T18:23:14.273 INFO:tasks.workunit.client.1.smithi159.stdout:4/950: read d0/d8/d41/db7/d33/d47/ff2 [182227,123545] 0 2022-02-02T18:23:14.274 INFO:tasks.workunit.client.1.smithi159.stdout:4/951: chown d0/d8/d41/db7/l2c 3 1 2022-02-02T18:23:14.280 INFO:tasks.workunit.client.1.smithi159.stdout:6/974: dread df/d35/d2a/d3f/d42/d47/ff3 [0,4194304] 0 2022-02-02T18:23:14.292 INFO:tasks.workunit.client.1.smithi159.stdout:4/952: dwrite d0/d8/d15/f69 [0,4194304] 0 2022-02-02T18:23:14.293 INFO:tasks.workunit.client.1.smithi159.stdout:4/953: getdents d0/d7b/dc8/d102/d105/d7e 0 2022-02-02T18:23:14.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/954: rename d0/d8/d41/db7/d36/d4b/l65 to d0/d8/d41/db7/d33/l141 0 2022-02-02T18:23:14.295 INFO:tasks.workunit.client.1.smithi159.stdout:6/975: write df/d35/d2a/d2f/d80/f92 [1633902,128849] 0 2022-02-02T18:23:14.299 INFO:tasks.workunit.client.1.smithi159.stdout:6/976: write df/d35/d2a/f7a [2528740,53632] 0 2022-02-02T18:23:14.301 INFO:tasks.workunit.client.1.smithi159.stdout:6/977: mknod df/d35/d7b/db4/c131 0 2022-02-02T18:23:14.302 INFO:tasks.workunit.client.1.smithi159.stdout:6/978: write df/d35/d7b/f11e [890365,106719] 0 2022-02-02T18:23:14.302 INFO:tasks.workunit.client.1.smithi159.stdout:6/979: creat df/d35/d2a/d3f/d55/d6a/d6e/dfb/f132 x:0 0 0 2022-02-02T18:23:14.302 INFO:tasks.workunit.client.1.smithi159.stdout:6/980: stat df/d35/d2a/d3f/d55/d6a/d6e 0 2022-02-02T18:23:14.302 INFO:tasks.workunit.client.1.smithi159.stdout:6/981: fsync df/faa 0 2022-02-02T18:23:14.322 INFO:tasks.workunit.client.1.smithi159.stdout:4/955: dwrite d0/d8/d41/db7/da3/ffe [0,4194304] 0 2022-02-02T18:23:14.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/982: dwrite df/d35/d2a/d3f/d91/fdc [0,4194304] 0 2022-02-02T18:23:14.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/956: creat d0/d8/d24/d3a/d12b/d11a/f142 x:0 0 0 2022-02-02T18:23:14.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/957: fsync d0/d8/d41/db7/d33/dc0/fef 0 2022-02-02T18:23:14.329 INFO:tasks.workunit.client.1.smithi159.stdout:4/958: read d0/d8/fa4 [144382,123931] 0 2022-02-02T18:23:14.330 INFO:tasks.workunit.client.1.smithi159.stdout:6/983: mkdir df/d35/d2a/d3f/d42/d47/d59/d97/d11b/d133 0 2022-02-02T18:23:14.330 INFO:tasks.workunit.client.1.smithi159.stdout:6/984: getdents df/d35/d2a/d3f/d42/d89 0 2022-02-02T18:23:14.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/985: rmdir df/d35/d2a/d3f 39 2022-02-02T18:23:14.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/986: truncate df/f129 120464 0 2022-02-02T18:23:14.337 INFO:tasks.workunit.client.1.smithi159.stdout:6/987: creat df/d35/d2a/d3f/d42/d47/d59/d66/f134 x:0 0 0 2022-02-02T18:23:14.340 INFO:tasks.workunit.client.1.smithi159.stdout:4/959: rename d0/d8/d41/db7/d36/dad to d0/d8/d24/d3a/d143 0 2022-02-02T18:23:14.342 INFO:tasks.workunit.client.1.smithi159.stdout:4/960: rename d0/d8/fb3 to d0/d8/d15/f144 0 2022-02-02T18:23:14.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/961: truncate d0/d8/d24/d3a/d12b/f126 958301 0 2022-02-02T18:23:14.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/962: chown d0/d8/d41/c4c 7377073 1 2022-02-02T18:23:14.344 INFO:tasks.workunit.client.1.smithi159.stdout:4/963: creat d0/d8/d24/d3a/d143/f145 x:0 0 0 2022-02-02T18:23:14.346 INFO:tasks.workunit.client.1.smithi159.stdout:9/913: sync 2022-02-02T18:23:14.347 INFO:tasks.workunit.client.1.smithi159.stdout:9/914: fsync d4/d19/d1c/d21/f101 0 2022-02-02T18:23:14.349 INFO:tasks.workunit.client.1.smithi159.stdout:9/915: link d4/d19/f28 d4/d19/d1c/d1f/d90/d10d/f12c 0 2022-02-02T18:23:14.349 INFO:tasks.workunit.client.1.smithi159.stdout:9/916: creat d4/d19/d1c/d21/da8/db9/dd1/f12d x:0 0 0 2022-02-02T18:23:14.349 INFO:tasks.workunit.client.1.smithi159.stdout:9/917: fdatasync d4/f11 0 2022-02-02T18:23:14.361 INFO:tasks.workunit.client.1.smithi159.stdout:6/988: dwrite df/d35/d2a/d3f/d42/f82 [0,4194304] 0 2022-02-02T18:23:14.363 INFO:tasks.workunit.client.1.smithi159.stdout:6/989: mknod df/d35/d2a/d2f/d80/d61/deb/c135 0 2022-02-02T18:23:14.364 INFO:tasks.workunit.client.1.smithi159.stdout:4/964: dwrite d0/d8/d15/f27 [4194304,4194304] 0 2022-02-02T18:23:14.366 INFO:tasks.workunit.client.1.smithi159.stdout:6/990: rename df/d35/d2a/d3f/d91/c10d to df/d35/d2a/d2f/d80/c136 0 2022-02-02T18:23:14.368 INFO:tasks.workunit.client.1.smithi159.stdout:6/991: creat df/d35/d2a/d3f/d42/dec/df1/f137 x:0 0 0 2022-02-02T18:23:14.369 INFO:tasks.workunit.client.1.smithi159.stdout:6/992: getdents df/d35/d7b/db4 0 2022-02-02T18:23:14.370 INFO:tasks.workunit.client.1.smithi159.stdout:6/993: chown df/d35/f8e 0 1 2022-02-02T18:23:14.371 INFO:tasks.workunit.client.1.smithi159.stdout:6/994: getdents df/d35/d2a/d3f/d65/dd4 0 2022-02-02T18:23:14.371 INFO:tasks.workunit.client.1.smithi159.stdout:6/995: chown df/d35/d2a/d3f/d42/d47/f5e 8647 1 2022-02-02T18:23:14.371 INFO:tasks.workunit.client.1.smithi159.stdout:6/996: creat df/d35/d2a/d3f/d42/dd7/f138 x:0 0 0 2022-02-02T18:23:14.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/918: dwrite d4/d19/d1c/d21/f119 [0,4194304] 0 2022-02-02T18:23:14.381 INFO:tasks.workunit.client.1.smithi159.stdout:4/965: dread d0/d8/d41/db7/f129 [0,4194304] 0 2022-02-02T18:23:14.382 INFO:tasks.workunit.client.1.smithi159.stdout:9/919: unlink d4/d19/d42/daf/dd7/fd8 0 2022-02-02T18:23:14.382 INFO:tasks.workunit.client.1.smithi159.stdout:4/966: mkdir d0/d7b/dc8/d102/d105/d7e/d9c/d127/d146 0 2022-02-02T18:23:14.390 INFO:tasks.workunit.client.1.smithi159.stdout:6/997: dwrite df/d35/d2a/d3f/d42/d47/fd9 [0,4194304] 0 2022-02-02T18:23:14.391 INFO:tasks.workunit.client.1.smithi159.stdout:6/998: creat df/d35/d2a/d2f/d80/d61/da8/f139 x:0 0 0 2022-02-02T18:23:14.391 INFO:tasks.workunit.client.1.smithi159.stdout:6/999: fsync df/d35/d2a/d3f/d55/d6a/d6e/fb0 0 2022-02-02T18:23:14.394 INFO:tasks.workunit.client.1.smithi159.stdout:4/967: dread d0/f2b [0,4194304] 0 2022-02-02T18:23:14.394 INFO:tasks.workunit.client.1.smithi159.stdout:4/968: creat d0/d104/f147 x:0 0 0 2022-02-02T18:23:14.394 INFO:tasks.workunit.client.1.smithi159.stdout:4/969: write d0/d8/d41/f130 [67939,123972] 0 2022-02-02T18:23:14.402 INFO:tasks.workunit.client.1.smithi159.stdout:9/920: dwrite d4/d19/d1c/d21/d41/f70 [0,4194304] 0 2022-02-02T18:23:14.402 INFO:tasks.workunit.client.1.smithi159.stdout:9/921: dread - d4/d19/d1c/d21/da8/db9/dd1/d118/f10f zero size 2022-02-02T18:23:14.404 INFO:tasks.workunit.client.1.smithi159.stdout:9/922: creat d4/d19/de7/d11a/f12e x:0 0 0 2022-02-02T18:23:14.409 INFO:tasks.workunit.client.1.smithi159.stdout:9/923: rename d4/d19/d1c/d21/d41/d9a/de6/c121 to d4/d19/d6f/d74/db1/dc7/c12f 0 2022-02-02T18:23:14.410 INFO:tasks.workunit.client.1.smithi159.stdout:9/924: fdatasync d4/d19/d1c/d1f/d90/fe4 0 2022-02-02T18:23:14.410 INFO:tasks.workunit.client.1.smithi159.stdout:9/925: truncate d4/d19/d1c/d21/d56/f105 103492 0 2022-02-02T18:23:14.411 INFO:tasks.workunit.client.1.smithi159.stdout:9/926: link d4/d19/ff1 d4/d19/d1c/d21/d95/dc9/ddf/f130 0 2022-02-02T18:23:14.412 INFO:tasks.workunit.client.1.smithi159.stdout:9/927: creat d4/d19/d6f/f131 x:0 0 0 2022-02-02T18:23:14.413 INFO:tasks.workunit.client.1.smithi159.stdout:9/928: symlink d4/d19/d6f/d74/db1/dc7/l132 0 2022-02-02T18:23:14.414 INFO:tasks.workunit.client.1.smithi159.stdout:9/929: creat d4/d7a/dbc/f133 x:0 0 0 2022-02-02T18:23:14.414 INFO:tasks.workunit.client.1.smithi159.stdout:9/930: truncate d4/d19/d6f/d74/db1/d114/f116 310216 0 2022-02-02T18:23:14.414 INFO:tasks.workunit.client.1.smithi159.stdout:9/931: write d4/d19/d1c/d1f/f98 [4010080,72717] 0 2022-02-02T18:23:14.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/970: dwrite d0/d8/d15/d61/f128 [0,4194304] 0 2022-02-02T18:23:14.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/971: chown d0/d8/d24/d3a/d12b/dc3/c139 6938745 1 2022-02-02T18:23:14.415 INFO:tasks.workunit.client.1.smithi159.stdout:4/972: creat d0/d8/d41/db7/d36/d4b/f148 x:0 0 0 2022-02-02T18:23:14.416 INFO:tasks.workunit.client.1.smithi159.stdout:9/932: getdents d4/d19/d6f/d74/d108 0 2022-02-02T18:23:14.417 INFO:tasks.workunit.client.1.smithi159.stdout:9/933: read d4/d19/d1c/f67 [917927,61726] 0 2022-02-02T18:23:14.421 INFO:tasks.workunit.client.1.smithi159.stdout:4/973: getdents d0/d8/d41/db7/da3/dcd 0 2022-02-02T18:23:14.421 INFO:tasks.workunit.client.1.smithi159.stdout:4/974: readlink d0/d8/d41/db7/d36/lac 0 2022-02-02T18:23:14.422 INFO:tasks.workunit.client.1.smithi159.stdout:4/975: readlink d0/d7b/dc8/d102/d105/d5d/lf5 0 2022-02-02T18:23:14.422 INFO:tasks.workunit.client.1.smithi159.stdout:4/976: readlink d0/dec/l12e 0 2022-02-02T18:23:14.422 INFO:tasks.workunit.client.1.smithi159.stdout:4/977: chown d0/d8/d41/f74 936634 1 2022-02-02T18:23:14.423 INFO:tasks.workunit.client.1.smithi159.stdout:9/934: symlink d4/d19/d6f/d74/db1/dc7/l134 0 2022-02-02T18:23:14.423 INFO:tasks.workunit.client.1.smithi159.stdout:4/978: link d0/d7b/dc8/d102/d105/fd3 d0/d8/d41/db7/d36/d4b/f149 0 2022-02-02T18:23:14.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/979: creat d0/d66/f14a x:0 0 0 2022-02-02T18:23:14.427 INFO:tasks.workunit.client.1.smithi159.stdout:9/935: getdents d4/d19/d42/daf/dd7 0 2022-02-02T18:23:14.428 INFO:tasks.workunit.client.1.smithi159.stdout:9/936: write d4/f16 [909854,17845] 0 2022-02-02T18:23:14.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/937: mkdir d4/d19/d1c/d21/da8/db9/dd1/d118/d135 0 2022-02-02T18:23:14.444 INFO:tasks.workunit.client.1.smithi159.stdout:4/980: dwrite d0/d7b/dc8/fff [0,4194304] 0 2022-02-02T18:23:14.445 INFO:tasks.workunit.client.1.smithi159.stdout:9/938: dread d4/d19/d1c/d21/d41/f7c [0,4194304] 0 2022-02-02T18:23:14.449 INFO:tasks.workunit.client.1.smithi159.stdout:9/939: symlink d4/d19/de7/l136 0 2022-02-02T18:23:14.449 INFO:tasks.workunit.client.1.smithi159.stdout:9/940: chown d4/d7a/dbc 0 1 2022-02-02T18:23:14.449 INFO:tasks.workunit.client.1.smithi159.stdout:9/941: fdatasync d4/d19/f1e 0 2022-02-02T18:23:14.449 INFO:tasks.workunit.client.1.smithi159.stdout:9/942: truncate d4/d7a/d11d/f12a 478759 0 2022-02-02T18:23:14.450 INFO:tasks.workunit.client.1.smithi159.stdout:9/943: getdents d4/d19/d6f/d74/d108 0 2022-02-02T18:23:14.473 INFO:tasks.workunit.client.1.smithi159.stdout:4/981: dwrite d0/d8/f28 [0,4194304] 0 2022-02-02T18:23:14.474 INFO:tasks.workunit.client.1.smithi159.stdout:4/982: mknod d0/d8/d41/db7/d36/d4b/c14b 0 2022-02-02T18:23:14.475 INFO:tasks.workunit.client.1.smithi159.stdout:4/983: symlink d0/d7b/l14c 0 2022-02-02T18:23:14.475 INFO:tasks.workunit.client.1.smithi159.stdout:4/984: creat d0/d8/d41/db7/d36/d4b/f14d x:0 0 0 2022-02-02T18:23:14.477 INFO:tasks.workunit.client.1.smithi159.stdout:4/985: rmdir d0/d7b/dc8/d102 39 2022-02-02T18:23:14.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/986: rename d0/d8/d24/d76/l136 to d0/d8/d116/l14e 0 2022-02-02T18:23:14.482 INFO:tasks.workunit.client.1.smithi159.stdout:4/987: rename d0/d8/d24/d4f/f72 to d0/d8/d41/db7/d36/d4b/f14f 0 2022-02-02T18:23:14.483 INFO:tasks.workunit.client.1.smithi159.stdout:4/988: mknod d0/dec/c150 0 2022-02-02T18:23:14.484 INFO:tasks.workunit.client.1.smithi159.stdout:4/989: link d0/f2d d0/d8/d41/db7/d108/f151 0 2022-02-02T18:23:14.485 INFO:tasks.workunit.client.1.smithi159.stdout:4/990: link d0/c11d d0/d104/c152 0 2022-02-02T18:23:14.486 INFO:tasks.workunit.client.1.smithi159.stdout:4/991: mknod d0/d7b/dc8/c153 0 2022-02-02T18:23:14.486 INFO:tasks.workunit.client.1.smithi159.stdout:4/992: truncate d0/d104/f147 487100 0 2022-02-02T18:23:14.487 INFO:tasks.workunit.client.1.smithi159.stdout:4/993: mknod d0/d7b/dc8/d102/c154 0 2022-02-02T18:23:14.490 INFO:tasks.workunit.client.1.smithi159.stdout:4/994: getdents d0/d8/d24/d76 0 2022-02-02T18:23:14.491 INFO:tasks.workunit.client.1.smithi159.stdout:4/995: chown d0/d8/d24/d3a/f60 1875 1 2022-02-02T18:23:14.509 INFO:tasks.workunit.client.1.smithi159.stdout:4/996: dwrite d0/d8/d41/db7/d108/f151 [0,4194304] 0 2022-02-02T18:23:14.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/997: dwrite d0/d7b/dc8/d102/d105/d7e/d9c/fe4 [4194304,4194304] 0 2022-02-02T18:23:14.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/998: dread - d0/d8/d41/db7/f8e zero size 2022-02-02T18:23:14.526 INFO:tasks.workunit.client.1.smithi159.stdout:4/999: creat d0/d8/d24/d3a/d143/f155 x:0 0 0 2022-02-02T18:23:14.691 INFO:tasks.workunit.client.1.smithi159.stdout:9/944: sync 2022-02-02T18:23:14.705 INFO:tasks.workunit.client.1.smithi159.stdout:9/945: dwrite d4/d19/f1e [0,4194304] 0 2022-02-02T18:23:14.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/946: write d4/d19/d1c/d21/d95/f62 [2624252,46474] 0 2022-02-02T18:23:14.708 INFO:tasks.workunit.client.1.smithi159.stdout:9/947: mknod d4/d19/d6f/d74/db1/c137 0 2022-02-02T18:23:14.709 INFO:tasks.workunit.client.1.smithi159.stdout:9/948: mkdir d4/d19/d1c/d21/d41/d138 0 2022-02-02T18:23:14.726 INFO:tasks.workunit.client.1.smithi159.stdout:9/949: dwrite d4/d19/f36 [0,4194304] 0 2022-02-02T18:23:14.732 INFO:tasks.workunit.client.1.smithi159.stdout:9/950: write d4/d19/d6f/d74/db1/fb5 [959992,31865] 0 2022-02-02T18:23:14.733 INFO:tasks.workunit.client.1.smithi159.stdout:9/951: chown d4/d19/d1c/d21/d95/dc9 672 1 2022-02-02T18:23:14.734 INFO:tasks.workunit.client.1.smithi159.stdout:9/952: rename d4/d7a/d11d/c126 to d4/d19/d1c/d21/d41/d9a/de6/dfd/c139 0 2022-02-02T18:23:14.735 INFO:tasks.workunit.client.1.smithi159.stdout:9/953: chown d4/d7a/d11d 2507 1 2022-02-02T18:23:14.736 INFO:tasks.workunit.client.1.smithi159.stdout:9/954: truncate d4/d2a/f40 2073816 0 2022-02-02T18:23:14.736 INFO:tasks.workunit.client.1.smithi159.stdout:9/955: chown d4/d19/d1c/d21/d95/f8c 235 1 2022-02-02T18:23:14.736 INFO:tasks.workunit.client.1.smithi159.stdout:9/956: stat d4/d19/d1c/d21/d41/f70 0 2022-02-02T18:23:14.736 INFO:tasks.workunit.client.1.smithi159.stdout:9/957: fdatasync d4/d19/d1c/d21/d41/f70 0 2022-02-02T18:23:14.736 INFO:tasks.workunit.client.1.smithi159.stdout:9/958: write d4/d19/d1c/d1f/f98 [4637994,24074] 0 2022-02-02T18:23:14.737 INFO:tasks.workunit.client.1.smithi159.stdout:9/959: stat d4/d19/d6f/d74/db1/dc7/dc8/cd6 0 2022-02-02T18:23:14.737 INFO:tasks.workunit.client.1.smithi159.stdout:9/960: rmdir d4/d19/d6f/d11e 0 2022-02-02T18:23:14.755 INFO:tasks.workunit.client.1.smithi159.stdout:9/961: dwrite d4/d2a/d87/da1/f113 [0,4194304] 0 2022-02-02T18:23:14.755 INFO:tasks.workunit.client.1.smithi159.stdout:9/962: chown d4/d19/d1c/d1f/fee 5902537 1 2022-02-02T18:23:14.757 INFO:tasks.workunit.client.1.smithi159.stdout:9/963: rename d4/f16 to d4/d19/d42/f13a 0 2022-02-02T18:23:14.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/964: creat d4/d19/d1c/d21/d41/d138/f13b x:0 0 0 2022-02-02T18:23:14.763 INFO:tasks.workunit.client.1.smithi159.stdout:9/965: rename d4/d19/d1c/d21/da8/lac to d4/d2a/l13c 0 2022-02-02T18:23:14.763 INFO:tasks.workunit.client.1.smithi159.stdout:9/966: chown d4/d7a/dbc/f133 506332258 1 2022-02-02T18:23:14.780 INFO:tasks.workunit.client.1.smithi159.stdout:9/967: dwrite d4/d19/d1c/d21/f8d [0,4194304] 0 2022-02-02T18:23:14.783 INFO:tasks.workunit.client.1.smithi159.stdout:9/968: creat d4/d19/d6f/d78/f13d x:0 0 0 2022-02-02T18:23:14.783 INFO:tasks.workunit.client.1.smithi159.stdout:9/969: creat d4/d19/d1c/d21/d41/d138/f13e x:0 0 0 2022-02-02T18:23:14.784 INFO:tasks.workunit.client.1.smithi159.stdout:9/970: creat d4/d7a/dbc/d129/f13f x:0 0 0 2022-02-02T18:23:14.785 INFO:tasks.workunit.client.1.smithi159.stdout:9/971: creat d4/d19/d6f/d74/db1/dc7/dc8/f140 x:0 0 0 2022-02-02T18:23:14.785 INFO:tasks.workunit.client.1.smithi159.stdout:9/972: write d4/d19/d1c/d1f/f98 [1733774,109889] 0 2022-02-02T18:23:14.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/973: dread d4/d2a/f2e [0,4194304] 0 2022-02-02T18:23:14.794 INFO:tasks.workunit.client.1.smithi159.stdout:9/974: creat d4/d19/d1c/d21/d22/d55/f141 x:0 0 0 2022-02-02T18:23:14.809 INFO:tasks.workunit.client.1.smithi159.stdout:9/975: dwrite d4/d19/d1c/d21/da8/db9/dd1/d118/f103 [0,4194304] 0 2022-02-02T18:23:14.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/976: dwrite d4/fd [0,4194304] 0 2022-02-02T18:23:14.827 INFO:tasks.workunit.client.1.smithi159.stdout:9/977: truncate d4/d2a/f34 1466459 0 2022-02-02T18:23:14.836 INFO:tasks.workunit.client.1.smithi159.stdout:9/978: read d4/d2a/f34 [315006,50183] 0 2022-02-02T18:23:14.837 INFO:tasks.workunit.client.1.smithi159.stdout:9/979: mknod d4/d19/d6f/d74/db1/c142 0 2022-02-02T18:23:14.838 INFO:tasks.workunit.client.1.smithi159.stdout:9/980: dread d4/d7a/d11d/f12a [0,4194304] 0 2022-02-02T18:23:14.865 INFO:tasks.workunit.client.1.smithi159.stdout:9/981: dwrite d4/d19/d1c/d1f/f30 [0,4194304] 0 2022-02-02T18:23:14.865 INFO:tasks.workunit.client.1.smithi159.stdout:9/982: truncate d4/d19/d6f/d78/fa7 212717 0 2022-02-02T18:23:14.867 INFO:tasks.workunit.client.1.smithi159.stdout:9/983: creat d4/d19/d1c/d21/d41/f143 x:0 0 0 2022-02-02T18:23:14.867 INFO:tasks.workunit.client.1.smithi159.stdout:9/984: creat d4/d19/d1c/d21/d41/d138/f144 x:0 0 0 2022-02-02T18:23:14.869 INFO:tasks.workunit.client.1.smithi159.stdout:9/985: mkdir d4/d19/d1c/de1/d145 0 2022-02-02T18:23:14.869 INFO:tasks.workunit.client.1.smithi159.stdout:9/986: chown d4/d19/d6f/d74/db1/dc7/l132 44244 1 2022-02-02T18:23:14.870 INFO:tasks.workunit.client.1.smithi159.stdout:9/987: write d4/d19/d1c/d21/da8/db9/dd1/d118/f7d [71330,101180] 0 2022-02-02T18:23:14.870 INFO:tasks.workunit.client.1.smithi159.stdout:9/988: creat d4/d19/d6f/d74/d108/f146 x:0 0 0 2022-02-02T18:23:14.872 INFO:tasks.workunit.client.1.smithi159.stdout:9/989: link d4/d19/d1c/d21/da8/db9/dd1/d118/f5a d4/d19/d1c/d21/f147 0 2022-02-02T18:23:14.895 INFO:tasks.workunit.client.1.smithi159.stdout:9/990: dwrite d4/d2a/d87/da1/fa6 [0,4194304] 0 2022-02-02T18:23:14.895 INFO:tasks.workunit.client.1.smithi159.stdout:9/991: chown d4/d19/d1c/c2b 853880618 1 2022-02-02T18:23:14.896 INFO:tasks.workunit.client.1.smithi159.stdout:9/992: creat d4/d19/d6f/d74/db1/d114/f148 x:0 0 0 2022-02-02T18:23:14.896 INFO:tasks.workunit.client.1.smithi159.stdout:9/993: mkdir d4/d19/d1c/d21/da8/db9/dd1/d118/d135/d149 0 2022-02-02T18:23:14.897 INFO:tasks.workunit.client.1.smithi159.stdout:9/994: rename d4/d19/d1c/d21/d22/ca5 to d4/d19/c14a 0 2022-02-02T18:23:14.898 INFO:tasks.workunit.client.1.smithi159.stdout:9/995: creat d4/d19/d1c/de1/f14b x:0 0 0 2022-02-02T18:23:14.905 INFO:tasks.workunit.client.1.smithi159.stdout:9/996: dread d4/d2a/fde [4194304,4194304] 0 2022-02-02T18:23:14.905 INFO:tasks.workunit.client.1.smithi159.stdout:9/997: stat d4/d19/d1c/d21/da8/db9/dd1/d118/f103 0 2022-02-02T18:23:14.905 INFO:tasks.workunit.client.1.smithi159.stdout:9/998: dread - d4/d19/d1c/d21/da8/db9/dd1/f12d zero size 2022-02-02T18:23:14.906 INFO:tasks.workunit.client.1.smithi159.stdout:9/999: write d4/d7a/db7/f86 [1814462,1190] 0 2022-02-02T18:23:14.910 INFO:tasks.workunit.client.1.smithi159.stderr:+ rm -rf -- ./tmp.y81vbMCDNG 2022-02-02T18:23:15.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 -- 172.21.15.96:0/4089574373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 msgr2=0x7f8bac0f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 --2- 172.21.15.96:0/4089574373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac0f4860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f8b9c004660 tx=0x7f8b9c009b30).stop 2022-02-02T18:23:15.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 -- 172.21.15.96:0/4089574373 shutdown_connections 2022-02-02T18:23:15.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 --2- 172.21.15.96:0/4089574373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac0f4860 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 --2- 172.21.15.96:0/4089574373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac0f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 -- 172.21.15.96:0/4089574373 >> 172.21.15.96:0/4089574373 conn(0x7f8bac0f04c0 msgr2=0x7f8bac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:15.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 -- 172.21.15.96:0/4089574373 shutdown_connections 2022-02-02T18:23:15.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.180+0000 7f8bb190e700 1 -- 172.21.15.96:0/4089574373 wait complete. 2022-02-02T18:23:15.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 Processor -- start 2022-02-02T18:23:15.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 -- start start 2022-02-02T18:23:15.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac107a20 con 0x7f8bac0f86e0 2022-02-02T18:23:15.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8bb190e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac107b60 con 0x7f8bac0f7d40 2022-02-02T18:23:15.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52886/0 (socket says 172.21.15.96:52886) 2022-02-02T18:23:15.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8baa7fc700 1 -- 172.21.15.96:0/895793094 learned_addr learned my addr 172.21.15.96:0/895793094 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:15.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.181+0000 7f8baaffd700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8baa7fc700 1 -- 172.21.15.96:0/895793094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 msgr2=0x7f8bac106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8baa7fc700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8baa7fc700 1 -- 172.21.15.96:0/895793094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c005040 con 0x7f8bac0f86e0 2022-02-02T18:23:15.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8baaffd700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:23:15.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8baa7fc700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f8b9c000c00 tx=0x7f8b9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b9c019070 con 0x7f8bac0f86e0 2022-02-02T18:23:15.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac1084a0 con 0x7f8bac0f86e0 2022-02-02T18:23:15.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b9c007e40 con 0x7f8bac0f86e0 2022-02-02T18:23:15.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b9c014c60 con 0x7f8bac0f86e0 2022-02-02T18:23:15.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.182+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac108a00 con 0x7f8bac0f86e0 2022-02-02T18:23:15.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.183+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac045ad0 con 0x7f8bac0f86e0 2022-02-02T18:23:15.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.183+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f8b9c025070 con 0x7f8bac0f86e0 2022-02-02T18:23:15.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.184+0000 7f8b937fe700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 0x7f8b94067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.184+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f8b9c082900 con 0x7f8bac0f86e0 2022-02-02T18:23:15.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.184+0000 7f8baaffd700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 0x7f8b94067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:15.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.184+0000 7f8baaffd700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 0x7f8b94067280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8ba0009fd0 tx=0x7f8ba000b040).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.188+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f8b9c0546c0 con 0x7f8bac0f86e0 2022-02-02T18:23:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:14 smithi159 conmon[35668]: cluster 2022-02-02T18:23:14.546322+0000 mgr.smithi096.shfutl (mgr.14628) 30 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 160 MiB/s wr, 305 op/s 2022-02-02T18:23:15.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:14 smithi096 conmon[32067]: cluster 2022-02-02T18:23:14.546322+0000 mgr.smithi096.shfutl (mgr.14628) 30 : 2022-02-02T18:23:15.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:14 smithi096 conmon[32067]: cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 160 MiB/s wr, 305 op/s 2022-02-02T18:23:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.386+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 --> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bac0ff060 con 0x7f8b94064dc0 2022-02-02T18:23:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.387+0000 7f8b937fe700 1 -- 172.21.15.96:0/895793094 <== mgr.14628 v2:172.21.15.96:6800/2712195896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f8ba000f040 con 0x7f8b94064dc0 2022-02-02T18:23:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 msgr2=0x7f8b94067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 0x7f8b94067280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8ba0009fd0 tx=0x7f8ba000b040).stop 2022-02-02T18:23:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 msgr2=0x7f8bac107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f8b9c000c00 tx=0x7f8b9c00b040).stop 2022-02-02T18:23:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 shutdown_connections 2022-02-02T18:23:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bac0f7d40 0x7f8bac106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f8b94064dc0 0x7f8b94067280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 --2- 172.21.15.96:0/895793094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bac0f86e0 0x7f8bac107470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 >> 172.21.15.96:0/895793094 conn(0x7f8bac0f04c0 msgr2=0x7f8bac0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 shutdown_connections 2022-02-02T18:23:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.389+0000 7f8bb190e700 1 -- 172.21.15.96:0/895793094 wait complete. 2022-02-02T18:23:15.403 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:23:15.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 -- 172.21.15.96:0/3347535687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 msgr2=0x7f22940f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3347535687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f8140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f2284004660 tx=0x7f2284009b30).stop 2022-02-02T18:23:15.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 -- 172.21.15.96:0/3347535687 shutdown_connections 2022-02-02T18:23:15.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3347535687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 0x7f22940f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3347535687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f8140 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 -- 172.21.15.96:0/3347535687 >> 172.21.15.96:0/3347535687 conn(0x7f22940f04c0 msgr2=0x7f22940f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:15.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 -- 172.21.15.96:0/3347535687 shutdown_connections 2022-02-02T18:23:15.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.496+0000 7f229a7e9700 1 -- 172.21.15.96:0/3347535687 wait complete. 2022-02-02T18:23:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 Processor -- start 2022-02-02T18:23:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 -- start start 2022-02-02T18:23:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 0x7f22940f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940f5fd0 con 0x7f22940f7d20 2022-02-02T18:23:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f229a7e9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940f6110 con 0x7f22940f86c0 2022-02-02T18:23:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52894/0 (socket says 172.21.15.96:52894) 2022-02-02T18:23:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 -- 172.21.15.96:0/3228390088 learned_addr learned my addr 172.21.15.96:0/3228390088 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f22937fe700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 0x7f22940f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 -- 172.21.15.96:0/3228390088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 msgr2=0x7f22940f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 0x7f22940f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.497+0000 7f2293fff700 1 -- 172.21.15.96:0/3228390088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284005040 con 0x7f22940f7d20 2022-02-02T18:23:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f2293fff700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2284002040 tx=0x7f228400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2284019070 con 0x7f22940f7d20 2022-02-02T18:23:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940f6390 con 0x7f22940f7d20 2022-02-02T18:23:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2284007e40 con 0x7f22940f7d20 2022-02-02T18:23:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2284014c60 con 0x7f22940f7d20 2022-02-02T18:23:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.498+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940f68f0 con 0x7f22940f7d20 2022-02-02T18:23:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.499+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294045ad0 con 0x7f22940f7d20 2022-02-02T18:23:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.499+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f2284025070 con 0x7f22940f7d20 2022-02-02T18:23:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.500+0000 7f2290ff9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 0x7f227c067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.500+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2284082990 con 0x7f22940f7d20 2022-02-02T18:23:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.500+0000 7f22937fe700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 0x7f227c067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.500+0000 7f22937fe700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 0x7f227c067280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2288009fd0 tx=0x7f228800b040).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.504+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f2284050d20 con 0x7f22940f7d20 2022-02-02T18:23:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.698+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 --> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2294057f10 con 0x7f227c064dc0 2022-02-02T18:23:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.708+0000 7f2290ff9700 1 -- 172.21.15.96:0/3228390088 <== mgr.14628 v2:172.21.15.96:6800/2712195896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2294057f10 con 0x7f227c064dc0 2022-02-02T18:23:15.712 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:23:15.712 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 32s ago 7m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:23:15.713 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 32s ago 7m 6983k - 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:23:15.713 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (7m) 7s ago 7m 7155k - 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:23:15.713 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (6m) 32s ago 7m 40.0M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:23:15.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3m) 32s ago 3m 626M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:23:15.714 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (38s) 32s ago 3m - - 16.2.4 8d91d370c2b8 c2f4dbaa5b91 2022-02-02T18:23:15.714 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3m) 7s ago 3m 4941M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:23:15.714 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (57s) 7s ago 3m 461M - 16.2.4 8d91d370c2b8 eaf9e1d22a73 2022-02-02T18:23:15.714 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (53s) 32s ago 8m 442M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:23:15.715 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (24s) 7s ago 7m 68.1M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:23:15.715 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 32s ago 8m 101M 2048M 16.2.4 8d91d370c2b8 f3470b7172a1 2022-02-02T18:23:15.715 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (7m) 7s ago 7m 94.2M 2048M 16.2.4 8d91d370c2b8 415162de66b1 2022-02-02T18:23:15.715 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (7m) 32s ago 7m 18.2M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:23:15.715 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 7s ago 6m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:23:15.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 32s ago 6m 747M 4096M 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:23:15.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 32s ago 6m 779M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:23:15.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 32s ago 5m 623M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:23:15.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (5m) 7s ago 5m 871M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:23:15.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (5m) 7s ago 5m 699M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:23:15.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (5m) 7s ago 5m 819M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:23:15.717 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (6m) 32s ago 7m 43.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:23:15.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 msgr2=0x7f227c067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 0x7f227c067280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2288009fd0 tx=0x7f228800b040).stop 2022-02-02T18:23:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 msgr2=0x7f22940f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2284002040 tx=0x7f228400b040).stop 2022-02-02T18:23:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 shutdown_connections 2022-02-02T18:23:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7f227c064dc0 0x7f227c067280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22940f7d20 0x7f22940f75f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 --2- 172.21.15.96:0/3228390088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22940f86c0 0x7f22940f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 >> 172.21.15.96:0/3228390088 conn(0x7f22940f04c0 msgr2=0x7f22940fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 shutdown_connections 2022-02-02T18:23:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.710+0000 7f229a7e9700 1 -- 172.21.15.96:0/3228390088 wait complete. 2022-02-02T18:23:15.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 -- 172.21.15.96:0/877403535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 msgr2=0x7efd0c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 --2- 172.21.15.96:0/877403535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c0f9110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7efd08004660 tx=0x7efd08009b30).stop 2022-02-02T18:23:15.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 -- 172.21.15.96:0/877403535 shutdown_connections 2022-02-02T18:23:15.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 --2- 172.21.15.96:0/877403535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 --2- 172.21.15.96:0/877403535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c0f9110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 -- 172.21.15.96:0/877403535 >> 172.21.15.96:0/877403535 conn(0x7efd0c0f0b90 msgr2=0x7efd0c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:15.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 -- 172.21.15.96:0/877403535 shutdown_connections 2022-02-02T18:23:15.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 -- 172.21.15.96:0/877403535 wait complete. 2022-02-02T18:23:15.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.817+0000 7efd1247e700 1 Processor -- start 2022-02-02T18:23:15.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 -- start start 2022-02-02T18:23:15.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c107830 con 0x7efd0c060310 2022-02-02T18:23:15.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c108040 con 0x7efd0c0f9690 2022-02-02T18:23:15.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52902/0 (socket says 172.21.15.96:52902) 2022-02-02T18:23:15.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd10c7b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:15.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 -- 172.21.15.96:0/2154206984 learned_addr learned my addr 172.21.15.96:0/2154206984 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:15.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 -- 172.21.15.96:0/2154206984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 msgr2=0x7efd0c107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:15.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:15.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 -- 172.21.15.96:0/2154206984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08005040 con 0x7efd0c060310 2022-02-02T18:23:15.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd10c7b700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:23:15.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1147c700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7efd08000c00 tx=0x7efd0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd08019070 con 0x7efd0c060310 2022-02-02T18:23:15.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.818+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c108260 con 0x7efd0c060310 2022-02-02T18:23:15.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.819+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd08007e70 con 0x7efd0c060310 2022-02-02T18:23:15.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.819+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd08014ce0 con 0x7efd0c060310 2022-02-02T18:23:15.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.819+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c1087c0 con 0x7efd0c060310 2022-02-02T18:23:15.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.820+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c059100 con 0x7efd0c060310 2022-02-02T18:23:15.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.820+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 82786+0+0 (secure 0 0 0) 0x7efd08025070 con 0x7efd0c060310 2022-02-02T18:23:15.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.820+0000 7efd01ffb700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 0x7efcf80672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:15.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.821+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7efd08082790 con 0x7efd0c060310 2022-02-02T18:23:15.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.821+0000 7efd10c7b700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 0x7efcf80672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:15.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.821+0000 7efd10c7b700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 0x7efcf80672d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efcfc009fd0 tx=0x7efcfc00b040).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:15.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:15.828+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7efd08050b20 con 0x7efd0c060310 2022-02-02T18:23:16.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.088+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd0c0008d0 con 0x7efd0c060310 2022-02-02T18:23:16.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.089+0000 7efd01ffb700 1 -- 172.21.15.96:0/2154206984 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+691 (secure 0 0 0) 0x7efd08023070 con 0x7efd0c060310 2022-02-02T18:23:16.093 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:23:16.093 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:23:16.094 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T18:23:16.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:16.094 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:23:16.094 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:23:16.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:16.095 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:23:16.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:23:16.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:16.096 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:23:16.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:23:16.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:16.097 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:23:16.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12, 2022-02-02T18:23:16.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:23:16.098 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:23:16.098 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:23:16.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 msgr2=0x7efcf80672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 0x7efcf80672d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efcfc009fd0 tx=0x7efcfc00b040).stop 2022-02-02T18:23:16.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 msgr2=0x7efd0c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7efd08000c00 tx=0x7efd0800b040).stop 2022-02-02T18:23:16.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 shutdown_connections 2022-02-02T18:23:16.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7efcf8064e10 0x7efcf80672d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c060310 0x7efd0c106d40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 --2- 172.21.15.96:0/2154206984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd0c0f9690 0x7efd0c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 >> 172.21.15.96:0/2154206984 conn(0x7efd0c0f0b90 msgr2=0x7efd0c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:16.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 shutdown_connections 2022-02-02T18:23:16.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.091+0000 7efd1247e700 1 -- 172.21.15.96:0/2154206984 wait complete. 2022-02-02T18:23:16.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- 172.21.15.96:0/3771659693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f5440 msgr2=0x7fab9c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 --2- 172.21.15.96:0/3771659693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f5860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fab8c0045a0 tx=0x7fab8c009b30).stop 2022-02-02T18:23:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- 172.21.15.96:0/3771659693 shutdown_connections 2022-02-02T18:23:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 --2- 172.21.15.96:0/3771659693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 --2- 172.21.15.96:0/3771659693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f5860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- 172.21.15.96:0/3771659693 >> 172.21.15.96:0/3771659693 conn(0x7fab9c0f0ba0 msgr2=0x7fab9c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- 172.21.15.96:0/3771659693 shutdown_connections 2022-02-02T18:23:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- 172.21.15.96:0/3771659693 wait complete. 2022-02-02T18:23:16.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 Processor -- start 2022-02-02T18:23:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.201+0000 7fab9b59e700 1 -- start start 2022-02-02T18:23:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0f7f80 con 0x7fab9c0f66e0 2022-02-02T18:23:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0f80c0 con 0x7fab9c0f5440 2022-02-02T18:23:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52912/0 (socket says 172.21.15.96:52912) 2022-02-02T18:23:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 -- 172.21.15.96:0/2684457328 learned_addr learned my addr 172.21.15.96:0/2684457328 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9a59c700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T18:23:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 -- 172.21.15.96:0/2684457328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 msgr2=0x7fab9c0f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 -- 172.21.15.96:0/2684457328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c005040 con 0x7fab9c0f66e0 2022-02-02T18:23:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9a59c700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:23:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab99d9b700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fab9000e7c0 tx=0x7fab9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab900092e0 con 0x7fab9c0f66e0 2022-02-02T18:23:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab9000f040 con 0x7fab9c0f66e0 2022-02-02T18:23:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c0f83a0 con 0x7fab9c0f66e0 2022-02-02T18:23:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab90014880 con 0x7fab9c0f66e0 2022-02-02T18:23:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.202+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c10ed60 con 0x7fab9c0f66e0 2022-02-02T18:23:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.203+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c045ad0 con 0x7fab9c0f66e0 2022-02-02T18:23:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.204+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 82786+0+0 (secure 0 0 0) 0x7fab9001b030 con 0x7fab9c0f66e0 2022-02-02T18:23:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.204+0000 7fab8affd700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 0x7fab840672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:16.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.204+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fab90081710 con 0x7fab9c0f66e0 2022-02-02T18:23:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.204+0000 7fab9a59c700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 0x7fab840672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.205+0000 7fab9a59c700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 0x7fab840672d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab8c004570 tx=0x7fab8c016040).ready entity=mgr.14628 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:16.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.209+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7fab9004faa0 con 0x7fab9c0f66e0 2022-02-02T18:23:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.444+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab9c0fdc00 con 0x7fab9c0f66e0 2022-02-02T18:23:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.445+0000 7fab8affd700 1 -- 172.21.15.96:0/2684457328 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1659 (secure 0 0 0) 0x7fab90019070 con 0x7fab9c0f66e0 2022-02-02T18:23:16.450 INFO:teuthology.orchestra.run.smithi096.stdout:e32 2022-02-02T18:23:16.451 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:23:16.451 INFO:teuthology.orchestra.run.smithi096.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:16.451 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:23:16.451 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:16.452 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:23:16.452 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:23:16.452 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 32 2022-02-02T18:23:16.453 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 2022-02-02T18:23:16.453 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:23:16.453 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:22:59.964896+0000 2022-02-02T18:23:16.453 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:23:16.453 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:23:16.454 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:23:16.454 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:23:16.454 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:23:16.454 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:23:16.455 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:23:16.455 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 49 2022-02-02T18:23:16.455 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:16.455 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:23:16.455 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:23:16.456 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24423,1=24273} 2022-02-02T18:23:16.456 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:23:16.456 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:23:16.456 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:23:16.457 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:23:16.457 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:23:16.457 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:23:16.458 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:23:16.458 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:23:16.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{0:24423} state up:active seq 12 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240]] 2022-02-02T18:23:16.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:24447} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779]] 2022-02-02T18:23:16.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]] 2022-02-02T18:23:16.459 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036]] 2022-02-02T18:23:16.459 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:16.459 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:16.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 msgr2=0x7fab840672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 0x7fab840672d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab8c004570 tx=0x7fab8c016040).stop 2022-02-02T18:23:16.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 msgr2=0x7fab9c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:16.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fab9000e7c0 tx=0x7fab9000b040).stop 2022-02-02T18:23:16.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 shutdown_connections 2022-02-02T18:23:16.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9c0f5440 0x7fab9c0f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:6800/2712195896,v1:172.21.15.96:6801/2712195896] conn(0x7fab84064e10 0x7fab840672d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 --2- 172.21.15.96:0/2684457328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab9c0f66e0 0x7fab9c0f7a20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 >> 172.21.15.96:0/2684457328 conn(0x7fab9c0f0ba0 msgr2=0x7fab9c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 shutdown_connections 2022-02-02T18:23:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:16.448+0000 7fab9b59e700 1 -- 172.21.15.96:0/2684457328 wait complete. 2022-02-02T18:23:16.463 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 32 2022-02-02T18:23:16.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.388659+0000 mgr.smithi096.shfutl (mgr.14628) 31 : audit [DBG] from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:16.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.609235+0000 mon.smithi096 (mon.0) 752 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:16.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.612804+0000 mon.smithi096 (mon.0) 753 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:16.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.617844+0000 mon.smithi096 (mon.0) 754 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:16.898 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.619347+0000 mon.smithi096 (mon.0) 755 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:16.898 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: cephadm 2022-02-02T18:23:15.620155+0000 mgr.smithi096.shfutl (mgr.14628) 32 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-02-02T18:23:16.898 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.624279+0000 mon.smithi096 (mon.0) 756 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:16.898 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.625139+0000 mon.smithi096 (mon.0) 757 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.shfutl"}]: dispatch 2022-02-02T18:23:16.899 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.629005+0000 mon.smithi096 (mon.0) 758 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.shfutl"}]': finished 2022-02-02T18:23:16.899 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.629701+0000 mon.smithi096 (mon.0) 759 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.jrxkfz"}]: dispatch 2022-02-02T18:23:16.899 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.633048+0000 mon.smithi096 (mon.0) 760 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.jrxkfz"}]': finished 2022-02-02T18:23:16.899 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.633923+0000 mon.smithi096 (mon.0) 761 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T18:23:16.900 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:15.700328+0000 mgr.smithi096.shfutl (mgr.14628) 33 : audit [DBG] from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:16.900 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:16.090410+0000 mon.smithi096 (mon.0) 762 : audit [DBG] from='client.? 172.21.15.96:0/2154206984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:16.900 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:16 smithi096 conmon[32067]: audit 2022-02-02T18:23:16.446711+0000 mon.smithi096 (mon.0) 763 : audit [DBG] from='client.? 172.21.15.96:0/2684457328' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:23:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.388659+0000 2022-02-02T18:23:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14628) 31 : audit [DBG] from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.609235+0000 mon.smithi096 (mon.0) 752 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.612804+0000 mon.smithi096 (mon.0) 753 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.617844+0000 mon.smithi096 (mon.0) 754 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:17.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.619347+0000 mon.smithi096 (mon.0) 755 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:17.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:15.620155+0000 mgr.smithi096.shfutl (mgr.14628) 32 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-02-02T18:23:17.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.624279+0000 mon.smithi096 (mon.0) 756 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:17.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.625139+0000 mon.smithi096 (mon.0) 757 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.shfutl"}]: dispatch 2022-02-02T18:23:17.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.629005+0000 mon.smithi096 (mon.0) 758 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.shfutl"}]': finished 2022-02-02T18:23:17.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.629701+0000 mon.smithi096 (mon.0) 759 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.jrxkfz"}]: dispatch 2022-02-02T18:23:17.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.633048+0000 mon.smithi096 (mon.0) 760 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.jrxkfz"}]': finished 2022-02-02T18:23:17.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.633923+0000 mon.smithi096 (mon.0) 761 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T18:23:17.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:15.700328+0000 mgr.smithi096.shfutl (mgr.14628) 33 : audit [DBG] from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:17.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:16.090410+0000 mon.smithi096 (mon.0) 762 : audit [DBG] from='client.? 172.21.15.96:0/2154206984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:17.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:16 smithi159 conmon[35668]: audit 2022-02-02T18:23:16.446711+0000 mon.smithi096 (mon.0) 763 : audit [DBG] from='client.? 172.21.15.96:0/2684457328' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:23:18.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:17 smithi096 conmon[32067]: cluster 2022-02-02T18:23:16.546709+0000 mgr.smithi096.shfutl (mgr.14628) 34 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 136 MiB/s wr, 243 op/s 2022-02-02T18:23:18.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:17 smithi096 conmon[32067]: audit 2022-02-02T18:23:17.193126+0000 mon.smithi096 (mon.0) 764 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:18.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:17 smithi096 conmon[32067]: audit 2022-02-02T18:23:17.193771+0000 mon.smithi096 (mon.0) 765 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:18.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:17 smithi096 conmon[32067]: audit 2022-02-02T18:23:17.194267+0000 mon.smithi096 (mon.0) 766 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:18.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:17 smithi096 conmon[32067]: audit 2022-02-02T18:23:17.194845+0000 mon.smithi096 (mon.0) 767 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:18.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: cluster 2022-02-02T18:23:16.546709+0000 2022-02-02T18:23:18.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: mgr.smithi096.shfutl (mgr.14628) 34 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 136 MiB/s wr, 243 op/s 2022-02-02T18:23:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: audit 2022-02-02T18:23:17.193126+0000 mon.smithi096 (mon.0) 764 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: 2022-02-02T18:23:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: audit 2022-02-02T18:23:17 2022-02-02T18:23:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: .193771+0000 mon.smithi096 (mon.0) 765 : audit [INF] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:23:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: 18:23:17.194267+0000 mon.smithi096 (mon.0) 766 2022-02-02T18:23:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: audit 2022-02-02T18:23:17 2022-02-02T18:23:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: .194845+0000 mon.smithi096 (mon.0) 767 : audit [DBG] 2022-02-02T18:23:18.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:17 smithi159 conmon[35668]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:18.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 systemd[1]: Stopping Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:23:18.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 conmon[32067]: cephadm 2022-02-02T18:23:17.189149+0000 2022-02-02T18:23:18.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 conmon[32067]: mgr.smithi096.shfutl (mgr.14628) 35 : cephadm [INF] Upgrade: Updating mon.smithi096 2022-02-02T18:23:18.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 conmon[32067]: cephadm 2022-02-02T18:23:17.195664+0000 mgr.smithi096.shfutl (mgr.14628) 36 : cephadm [INF] Deploying daemon mon.smithi096 on smithi096 2022-02-02T18:23:18.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 conmon[32067]: debug 2022-02-02T18:23:18.703+0000 7fc2fbeba700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi096 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T18:23:18.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:18 smithi096 conmon[32067]: debug 2022-02-02T18:23:18.703+0000 7fc2fbeba700 -1 mon.smithi096@0(leader) e2 *** Got Signal Terminated *** 2022-02-02T18:23:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:18 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:17.189149+0000 mgr.smithi096.shfutl (mgr.14628) 35 : cephadm [INF] Upgrade: Updating mon.smithi096 2022-02-02T18:23:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:18 smithi159 conmon[35668]: 2022-02-02T18:23:19.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:18 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:17.195664+0000 mgr.smithi096.shfutl (mgr.14628) 36 : cephadm [INF] Deploying daemon mon.smithi096 on smithi096 2022-02-02T18:23:19.294 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 bash[100932]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon.smithi096 2022-02-02T18:23:19.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 bash[100932]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon-smithi096" found: no such container 2022-02-02T18:23:19.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 bash[100932]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon.smithi096" found: no such container 2022-02-02T18:23:19.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi096.service: Succeeded. 2022-02-02T18:23:19.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 systemd[1]: Stopped Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:23:19.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 systemd[1]: Starting Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:23:20.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:19 smithi096 podman[101287]: 2022-02-02T18:23:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: set uid:gid to 167:167 (ceph:ceph) 2022-02-02T18:23:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev), process ceph-mon, pid 7 2022-02-02T18:23:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: pidfile_write: ignore empty --pid-file 2022-02-02T18:23:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: load: jerasure load: lrc 2022-02-02T18:23:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: RocksDB version: 6.15.5 2022-02-02T18:23:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T18:23:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Compile date Feb 2 2022 2022-02-02T18:23:20.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: DB SUMMARY 2022-02-02T18:23:20.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: DB Session ID: FLK1H8AD1IJG2HQWAQ6D 2022-02-02T18:23:20.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: CURRENT file: CURRENT 2022-02-02T18:23:20.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: IDENTITY file: IDENTITY 2022-02-02T18:23:20.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2022-02-02T18:23:20.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi096/store.db dir, Total Num: 1, files: 000014.sst 2022-02-02T18:23:20.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi096/store.db: 000012.log size: 9725268 ; 2022-02-02T18:23:20.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.error_if_exists: 0 2022-02-02T18:23:20.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.create_if_missing: 0 2022-02-02T18:23:20.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.paranoid_checks: 1 2022-02-02T18:23:20.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-02-02T18:23:20.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.env: 0x55ff42352860 2022-02-02T18:23:20.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.fs: Posix File System 2022-02-02T18:23:20.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.info_log: 0x55ff433e9e00 2022-02-02T18:23:20.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_file_opening_threads: 16 2022-02-02T18:23:20.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.statistics: (nil) 2022-02-02T18:23:20.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.use_fsync: 0 2022-02-02T18:23:20.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_log_file_size: 0 2022-02-02T18:23:20.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T18:23:20.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T18:23:20.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.keep_log_file_num: 1000 2022-02-02T18:23:20.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.recycle_log_file_num: 0 2022-02-02T18:23:20.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_fallocate: 1 2022-02-02T18:23:20.316 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_mmap_reads: 0 2022-02-02T18:23:20.316 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_mmap_writes: 0 2022-02-02T18:23:20.316 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.use_direct_reads: 0 2022-02-02T18:23:20.317 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T18:23:20.317 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.create_missing_column_families: 0 2022-02-02T18:23:20.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.db_log_dir: 2022-02-02T18:23:20.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi096/store.db 2022-02-02T18:23:20.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T18:23:20.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T18:23:20.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T18:23:20.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T18:23:20.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T18:23:20.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T18:23:20.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.advise_random_on_open: 1 2022-02-02T18:23:20.320 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.db_write_buffer_size: 0 2022-02-02T18:23:20.320 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.write_buffer_manager: 0x55ff434d8330 2022-02-02T18:23:20.320 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T18:23:20.320 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T18:23:20.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T18:23:20.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T18:23:20.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.rate_limiter: (nil) 2022-02-02T18:23:20.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T18:23:20.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.wal_recovery_mode: 2 2022-02-02T18:23:20.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.enable_thread_tracking: 0 2022-02-02T18:23:20.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.enable_pipelined_write: 0 2022-02-02T18:23:20.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.unordered_write: 0 2022-02-02T18:23:20.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T18:23:20.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T18:23:20.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T18:23:20.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T18:23:20.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.row_cache: None 2022-02-02T18:23:20.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.wal_filter: None 2022-02-02T18:23:20.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T18:23:20.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_ingest_behind: 0 2022-02-02T18:23:20.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.preserve_deletes: 0 2022-02-02T18:23:20.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.two_write_queues: 0 2022-02-02T18:23:20.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.manual_wal_flush: 0 2022-02-02T18:23:20.325 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.atomic_flush: 0 2022-02-02T18:23:20.325 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T18:23:20.325 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T18:23:20.325 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T18:23:20.326 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.log_readahead_size: 0 2022-02-02T18:23:20.326 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-02-02T18:23:20.326 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.best_efforts_recovery: 0 2022-02-02T18:23:20.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-02-02T18:23:20.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-02-02T18:23:20.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.allow_data_in_errors: 0 2022-02-02T18:23:20.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.db_host_id: __hostname__ 2022-02-02T18:23:20.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_background_jobs: 2 2022-02-02T18:23:20.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_background_compactions: -1 2022-02-02T18:23:20.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_subcompactions: 1 2022-02-02T18:23:20.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T18:23:20.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T18:23:20.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T18:23:20.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_total_wal_size: 0 2022-02-02T18:23:20.330 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T18:23:20.330 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T18:23:20.330 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T18:23:20.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T18:23:20.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_open_files: -1 2022-02-02T18:23:20.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bytes_per_sync: 0 2022-02-02T18:23:20.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T18:23:20.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T18:23:20.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_readahead_size: 0 2022-02-02T18:23:20.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_background_flushes: -1 2022-02-02T18:23:20.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Compression algorithms supported: 2022-02-02T18:23:20.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T18:23:20.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kZSTD supported: 0 2022-02-02T18:23:20.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kXpressCompression supported: 0 2022-02-02T18:23:20.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kLZ4HCCompression supported: 1 2022-02-02T18:23:20.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kLZ4Compression supported: 1 2022-02-02T18:23:20.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kBZip2Compression supported: 0 2022-02-02T18:23:20.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kZlibCompression supported: 1 2022-02-02T18:23:20.335 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: kSnappyCompression supported: 1 2022-02-02T18:23:20.335 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T18:23:20.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000008 2022-02-02T18:23:20.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2022-02-02T18:23:20.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T18:23:20.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.merge_operator: 2022-02-02T18:23:20.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_filter: None 2022-02-02T18:23:20.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_filter_factory: None 2022-02-02T18:23:20.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.sst_partitioner_factory: None 2022-02-02T18:23:20.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T18:23:20.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T18:23:20.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff433b5c20) 2022-02-02T18:23:20.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks: 1 2022-02-02T18:23:20.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T18:23:20.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T18:23:20.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_top_level_index_and_filter: 1 2022-02-02T18:23:20.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_type: 0 2022-02-02T18:23:20.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_index_type: 0 2022-02-02T18:23:20.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_shortening: 1 2022-02-02T18:23:20.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_hash_table_util_ratio: 0.750000 2022-02-02T18:23:20.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: hash_index_allow_collision: 1 2022-02-02T18:23:20.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: checksum: 1 2022-02-02T18:23:20.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: no_block_cache: 0 2022-02-02T18:23:20.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache: 0x55ff43420170 2022-02-02T18:23:20.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_name: BinnedLRUCache 2022-02-02T18:23:20.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_options: 2022-02-02T18:23:20.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: capacity : 536870912 2022-02-02T18:23:20.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: num_shard_bits : 4 2022-02-02T18:23:20.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: strict_capacity_limit : 0 2022-02-02T18:23:20.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: high_pri_pool_ratio: 0.000 2022-02-02T18:23:20.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_compressed: (nil) 2022-02-02T18:23:20.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: persistent_cache: (nil) 2022-02-02T18:23:20.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size: 4096 2022-02-02T18:23:20.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size_deviation: 10 2022-02-02T18:23:20.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_restart_interval: 16 2022-02-02T18:23:20.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_block_restart_interval: 1 2022-02-02T18:23:20.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: metadata_block_size: 4096 2022-02-02T18:23:20.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: partition_filters: 0 2022-02-02T18:23:20.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: use_delta_encoding: 1 2022-02-02T18:23:20.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T18:23:20.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: whole_key_filtering: 1 2022-02-02T18:23:20.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: verify_compression: 0 2022-02-02T18:23:20.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: read_amp_bytes_per_bit: 0 2022-02-02T18:23:20.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: format_version: 4 2022-02-02T18:23:20.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_index_compression: 1 2022-02-02T18:23:20.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_align: 0 2022-02-02T18:23:20.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.write_buffer_size: 33554432 2022-02-02T18:23:20.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_write_buffer_number: 2 2022-02-02T18:23:20.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression: NoCompression 2022-02-02T18:23:20.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression: Disabled 2022-02-02T18:23:20.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.prefix_extractor: nullptr 2022-02-02T18:23:20.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T18:23:20.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.num_levels: 7 2022-02-02T18:23:20.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T18:23:20.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T18:23:20.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T18:23:20.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T18:23:20.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T18:23:20.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T18:23:20.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T18:23:20.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:23:20.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-02-02T18:23:20.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T18:23:20.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T18:23:20.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.level: 32767 2022-02-02T18:23:20.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.strategy: 0 2022-02-02T18:23:20.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T18:23:20.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:23:20.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-02-02T18:23:20.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compression_opts.enabled: false 2022-02-02T18:23:20.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T18:23:20.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T18:23:20.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T18:23:20.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.target_file_size_base: 67108864 2022-02-02T18:23:20.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T18:23:20.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T18:23:20.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T18:23:20.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T18:23:20.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T18:23:20.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T18:23:20.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T18:23:20.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T18:23:20.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T18:23:20.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T18:23:20.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T18:23:20.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T18:23:20.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T18:23:20.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.arena_block_size: 4194304 2022-02-02T18:23:20.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T18:23:20.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T18:23:20.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T18:23:20.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.disable_auto_compactions: 0 2022-02-02T18:23:20.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T18:23:20.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T18:23:20.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T18:23:20.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T18:23:20.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T18:23:20.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T18:23:20.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T18:23:20.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T18:23:20.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T18:23:20.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T18:23:20.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.table_properties_collectors: 2022-02-02T18:23:20.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.inplace_update_support: 0 2022-02-02T18:23:20.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T18:23:20.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T18:23:20.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T18:23:20.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T18:23:20.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.bloom_locality: 0 2022-02-02T18:23:20.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.max_successive_merges: 0 2022-02-02T18:23:20.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T18:23:20.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.paranoid_file_checks: 0 2022-02-02T18:23:20.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.force_consistency_checks: 1 2022-02-02T18:23:20.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.report_bg_io_stats: 0 2022-02-02T18:23:20.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.ttl: 2592000 2022-02-02T18:23:20.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T18:23:20.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.enable_blob_files: false 2022-02-02T18:23:20.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.min_blob_size: 0 2022-02-02T18:23:20.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.blob_file_size: 268435456 2022-02-02T18:23:20.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.blob_compression_type: NoCompression 2022-02-02T18:23:20.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.enable_blob_garbage_collection: false 2022-02-02T18:23:20.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-02-02T18:23:20.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:20.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6536, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T18:23:20.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 12 2022-02-02T18:23:20.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:4083] Creating manifest 16 2022-02-02T18:23:20.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:20.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826200039108, "job": 1, "event": "recovery_started", "wal_files": [12]} 2022-02-02T18:23:20.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #12 mode 2 2022-02-02T18:23:20.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T18:23:20.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 bash[101132]: 75d7f2d934b3ba4ec3fc9f8f92dfa6a215c29d4ecbd22aa787425c3a372c566b 2022-02-02T18:23:20.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826200059424, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 17, "file_size": 9355929, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 9344447, "index_size": 8941, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 13037, "raw_average_key_size": 20, "raw_value_size": 9325850, "raw_average_value_size": 14571, "num_data_blocks": 402, "num_entries": 640, "num_deletions": 4, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643826200, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "b4554546-57c6-48f8-92d4-1fcd108975db", "db_session_id": "FLK1H8AD1IJG2HQWAQ6D"}} 2022-02-02T18:23:20.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:4083] Creating manifest 18 2022-02-02T18:23:20.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:20.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826200059837, "job": 1, "event": "recovery_finished"} 2022-02-02T18:23:20.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi096/store.db/000012.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-02-02T18:23:20.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55ff43406a80 2022-02-02T18:23:20.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: DB pointer 0x55ff43416000 2022-02-02T18:23:20.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2022-02-02T18:23:20.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-02-02T18:23:20.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** DB Stats ** 2022-02-02T18:23:20.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:20.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T18:23:20.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T18:23:20.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:23:20.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T18:23:20.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T18:23:20.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:23:20.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:20.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:20.371 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:20.371 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L0 1/0 8.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.371 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L6 1/0 17.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:20.371 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Sum 2/0 26.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.372 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.372 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.372 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:20.372 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:20.372 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:20.373 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.373 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:20.373 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Flush(GB): cumulative 0.009, interval 0.009 2022-02-02T18:23:20.373 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:23:20.374 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:23:20.374 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:23:20.374 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:23:20.374 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative compaction: 0.01 GB write, 381.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:20.375 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval compaction: 0.01 GB write, 381.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:20.375 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:23:20.375 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.376 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:23:20.376 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.376 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:20.377 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:20.377 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:20.378 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L0 1/0 8.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.378 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L6 1/0 17.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:20.378 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Sum 2/0 26.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.379 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:20.379 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.379 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:20.380 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:20.380 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:20.380 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 697.0 0.01 0.00 1 0.013 0 0 2022-02-02T18:23:20.381 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:20.381 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Flush(GB): cumulative 0.009, interval 0.000 2022-02-02T18:23:20.382 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:23:20.382 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:23:20.382 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:23:20.383 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:23:20.383 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative compaction: 0.01 GB write, 380.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:20.383 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:20.384 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:23:20.384 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.385 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:23:20.385 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: starting mon.smithi096 rank 0 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi096 fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:20.385 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???) e2 preinit fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:20.386 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).mds e32 new map 2022-02-02T18:23:20.386 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).mds e32 print_map 2022-02-02T18:23:20.386 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: e32 2022-02-02T18:23:20.387 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:23:20.387 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:20.387 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: legacy client fscid: 1 2022-02-02T18:23:20.387 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.388 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Filesystem 'cephfs' (1) 2022-02-02T18:23:20.388 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: fs_name cephfs 2022-02-02T18:23:20.388 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: epoch 32 2022-02-02T18:23:20.388 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:23:20.389 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:23:20.389 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: modified 2022-02-02T18:22:59.964896+0000 2022-02-02T18:23:20.389 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: tableserver 0 2022-02-02T18:23:20.390 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: root 0 2022-02-02T18:23:20.390 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: session_timeout 60 2022-02-02T18:23:20.390 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: session_autoclose 300 2022-02-02T18:23:20.390 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_file_size 1099511627776 2022-02-02T18:23:20.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: required_client_features {} 2022-02-02T18:23:20.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: last_failure 0 2022-02-02T18:23:20.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: last_failure_osd_epoch 49 2022-02-02T18:23:20.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:20.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_mds 2 2022-02-02T18:23:20.392 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: in 0,1 2022-02-02T18:23:20.392 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: up {0=24423,1=24273} 2022-02-02T18:23:20.392 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: failed 2022-02-02T18:23:20.392 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: damaged 2022-02-02T18:23:20.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: stopped 2022-02-02T18:23:20.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_pools [3] 2022-02-02T18:23:20.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: metadata_pool 2 2022-02-02T18:23:20.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: inline_data disabled 2022-02-02T18:23:20.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: balancer 2022-02-02T18:23:20.394 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: standby_count_wanted 1 2022-02-02T18:23:20.394 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi159.shbucd{0:24423} state up:active seq 12 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:20.394 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi096.pitrsc{0:24447} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:20.394 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:20.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:20.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2022-02-02T18:23:20.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2022-02-02T18:23:20.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:20.396 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:20.396 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:20.396 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 ceph-mon[101353]: mon.smithi096@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2022-02-02T18:23:20.396 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:20 smithi096 systemd[1]: Started Ceph mon.smithi096 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:23:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: audit 2022-02-02T18:23:18.710773+0000 mon.smithi159 (mon 2022-02-02T18:23:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: .1) 61 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: audit 2022-02-02T18:23:18.713958+0000 mon.smithi159 (mon.1) 2022-02-02T18:23:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 62 : audit [DBG] from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:23:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 02-02T18:23:20.270675+0000 mon.smithi096 (mon.0) 1 : cluster [INF] 2022-02-02T18:23:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: mon.smithi096 calling monitor election 2022-02-02T18:23:20.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:23:20.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 02-02T18:23:20.283666+0000 mon.smithi096 2022-02-02T18:23:20.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: (mon.0) 2 : cluster [INF] mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:23:20.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022-02-02T18:23:20.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 2022-02-02T18:23:20 2022-02-02T18:23:20.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: .287555+0000 mon.smithi096 (mon.0) 3 : cluster 2022-02-02T18:23:20.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: [DBG] monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:23:20.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022-02 2022-02-02T18:23:20.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: -02T18:23:20.287651+0000 mon.smithi096 ( 2022-02-02T18:23:20.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:20.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022-02-02T18:23:20.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 2022-02-02T18:23 2022-02-02T18:23:20.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: :20.287686+0000 mon.smithi096 (mon.0) 5 2022-02-02T18:23:20.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2022-02-02T18:23:20.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022-02-02T18:23:20.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 2022-02-02T18:23:20.288439+0000 2022-02-02T18:23:20.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: mon.smithi096 (mon.0) 6 : cluster [DBG] 2022-02-02T18:23:20.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: mgrmap e30: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:20.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022-02-02T18:23 2022-02-02T18:23:20.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: :20.294876+0000 mon.smithi096 (mon.0) 2022-02-02T18:23:20.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 7 : cluster [DBG] mgrmap e31: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:20.783 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:23:20.784 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 02-02T18:23:20.294908+0000 mon.smithi096 2022-02-02T18:23:20.784 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: (mon.0) 8 : cluster [INF] overall HEALTH_OK 2022-02-02T18:23:20.784 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: audit 2022 2022-02-02T18:23:20.784 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: -02-02T18:23:20.295037+0000 2022-02-02T18:23:20.785 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: mon.smithi096 (mon.0) 9 : audit [INF] from='mgr.14628 ' entity='' 2022-02-02T18:23:20.785 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:20 smithi159 conmon[35668]: 2022-02-02T18:23:27.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: cluster 2022-02-02T18:23:26.897323 2022-02-02T18:23:27.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 10 : cluster [INF] Active manager daemon smithi096.shfutl restarted 2022-02-02T18:23:27.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: cluster 2022-02-02T18: 2022-02-02T18:23:27.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: 23:26.897813+0000 mon.smithi096 (mon.0) 11 : cluster [INF] 2022-02-02T18:23:27.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: Activating manager daemon smithi096.shfutl 2022-02-02T18:23:27.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: cluster 2022- 2022-02-02T18:23:27.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: 02-02T18:23:26.902891+0000 mon.smithi096 ( 2022-02-02T18:23:27.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:26 smithi159 conmon[35668]: mon.0) 12 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2022-02-02T18:23:28.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cluster 2022-02-02T18:23:26.952216+0000 mon.smithi096 (mon. 2022-02-02T18:23:28.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 0) 13 : cluster [DBG] mgrmap e32: smithi096.shfutl(active, starting, since 0.054479s), standbys: smithi159.jrxkfz 2022-02-02T18:23:28.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26.958750+0000 mon.smithi096 (mon.0) 14 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:28.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26.958875+0000 mon.smithi096 (mon.0) 15 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:28.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26.961712+0000 2022-02-02T18:23:28.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: mon.smithi096 (mon.0) 16 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:23:28.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26.961920+0000 mon.smithi096 2022-02-02T18:23:28.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: (mon.0) 17 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:23:28.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:23:28.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 23:26.962128+0000 mon.smithi096 (mon.0) 18 : 2022-02-02T18:23:28.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:23:28.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26 2022-02-02T18:23:28.264 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: .962364+0000 mon.smithi096 (mon.0) 19 : audit 2022-02-02T18:23:28.264 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:23:28.264 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26.962566+0000 mon.smithi096 (mon 2022-02-02T18:23:28.264 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: .0) 20 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:23:28.264 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26 2022-02-02T18:23:28.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: .962739+0000 mon.smithi096 (mon.0) 21 : audit [DBG] 2022-02-02T18:23:28.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:23:28.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:28.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 2022-02-02T18:23:26.962921+0000 mon.smithi096 (mon. 2022-02-02T18:23:28.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 0) 22 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:23:28.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022 2022-02-02T18:23:28.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: -02-02T18:23:26. 2022-02-02T18:23:28.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 963110+0000 mon.smithi096 (mon.0) 23 : 2022-02-02T18:23:28.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:23:28.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18: 2022-02-02T18:23:28.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 23:26.963297+0000 mon.smithi096 (mon.0 2022-02-02T18:23:28.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: ) 24 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:23:28.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02- 2022-02-02T18:23:28.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 02T18:23:26.963500+0000 mon.smithi096 ( 2022-02-02T18:23:28.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: mon.0) 25 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:23:28.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18 2022-02-02T18:23:28.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: :23:26.963692+0000 mon.smithi096 (mon.0) 26 : 2022-02-02T18:23:28.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:23:28.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:28.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 2022-02-02T18:23:26.963890+0000 mon.smithi096 (mon.0 2022-02-02T18:23:28.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: ) 27 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:23:28.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022- 2022-02-02T18:23:28.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 02-02T18:23:26.964090+0000 mon.smithi096 (mon 2022-02-02T18:23:28.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: .0) 28 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:23:28.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T 2022-02-02T18:23:28.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 18:23:26.964356+0000 mon.smithi096 (mon.0) 29 2022-02-02T18:23:28.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:23:28.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:26 2022-02-02T18:23:28.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: .964683+0000 mon.smithi096 (mon.0) 30 : audit 2022-02-02T18:23:28.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:23:28.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cluster 2022 2022-02-02T18:23:28.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: -02-02T18:23:26.970707+0000 mon.smithi096 (mon.0) 31 2022-02-02T18:23:28.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: : cluster [INF] Manager daemon smithi096.shfutl is now available 2022-02-02T18:23:28.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23: 2022-02-02T18:23:28.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 26.989031+0000 mon.smithi096 (mon.0) 32 : audit 2022-02-02T18:23:28.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23 2022-02-02T18:23:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: :26.991519+0000 mon.smithi096 (mon.0) 33 2022-02-02T18:23:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02 2022-02-02T18:23:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: T18:23:26.992637+0000 mon.smithi096 (mon. 2022-02-02T18:23:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 0) 34 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23 2022-02-02T18:23:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: :26.996310+0000 mon.smithi096 (mon.0) 35 : audit [INF] 2022-02-02T18:23:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cephadm 2022-02 2022-02-02T18:23:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: -02T18:23:26.997257+0000 mgr.smithi096.shfutl (mgr.24491) 1 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:27.021890 2022-02-02T18:23:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: +0000 mon.smithi096 (mon.0) 36 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:23:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 2022-02-02T18:23:27.026589+0000 mon.smithi096 (mon.0) 37 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:23:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:27.243057+0000 mgr.smithi096.shfutl (mgr.24491) 2 : 2022-02-02T18:23:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cephadm [INF] [02/Feb/2022:18:23:27] ENGINE Bus STARTING 2022-02-02T18:23:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:27.389699+0000 mon.smithi096 ( 2022-02-02T18:23:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: mon.0) 38 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cluster 2022-02-02T18:23 2022-02-02T18:23:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: :27.494327+0000 mon.smithi096 (mon.0) 39 : cluster [DBG] Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: cluster 2022-02 2022-02-02T18:23:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: -02T18:23:27.494439+0000 mon.smithi096 (mon.0) 40 : cluster [DBG] Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:27.498298+0000 mon.smithi159 2022-02-02T18:23:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: (mon.1) 63 : audit [DBG] from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:23:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022 2022-02-02T18:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: -02-02T18:23:27.502774+0000 mon.smithi159 (mon.1) 64 : audit [DBG] from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:27.508163+0000 2022-02-02T18:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: mon.smithi159 (mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: audit 2022-02-02T18:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:27 smithi159 conmon[35668]: 2022-02-02T18:23:27.508984+0000 mon.smithi159 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:23:29.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:27.385857+0000 mgr.smithi096.shfutl (mgr.24491) 2022-02-02T18:23:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:28 smithi159 conmon[35668]: 3 : cephadm [INF] [02/Feb/2022:18:23:27] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:23:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:28 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:27.386003+0000 mgr.smithi096.shfutl (mgr.24491) 4 : cephadm [INF] [02/Feb/2022:18:23:27] ENGINE Bus STARTED 2022-02-02T18:23:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:28 smithi159 conmon[35668]: cluster 2022-02-02T18:23:27.972101+0000 mon.smithi096 (mon.0) 41 : cluster [DBG] mgrmap e33: smithi096.shfutl(active, since 1.07436s), standbys: smithi159.jrxkfz 2022-02-02T18:23:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:28 smithi159 conmon[35668]: cluster 2022-02-02T18:23:27.977783+0000 mgr.smithi096.shfutl (mgr.24491) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:30.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:29 smithi159 conmon[35668]: cluster 2022-02-02T18:23:28.961366+0000 mgr.smithi096.shfutl ( 2022-02-02T18:23:30.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:29 smithi159 conmon[35668]: mgr.24491) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:30.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:29 smithi159 conmon[35668]: cluster 2022-02-02T18:23:28.978517+0000 mon.smithi096 (mon.0) 42 : cluster [DBG] mgrmap e34: smithi096.shfutl(active, since 2s), standbys: smithi159.jrxkfz 2022-02-02T18:23:32.217 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:32 smithi159 conmon[35668]: cluster 2022-02-02T18:23:30.961933+0000 mgr.smithi096.shfutl 2022-02-02T18:23:32.218 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:32 smithi159 conmon[35668]: (mgr.24491) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:32.218 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:32 smithi159 conmon[35668]: audit 2022-02-02T18:23:31.416585+0000 mon.smithi096 (mon.0) 43 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:33.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:33 smithi159 conmon[35668]: audit 2022-02-02T18:23:32.223233+0000 mon.smithi096 (mon.0) 44 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:34.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:34 smithi159 conmon[35668]: cluster 2022-02-02T18:23:32.962306+0000 mgr.smithi096.shfutl (mgr.24491) 2022-02-02T18:23:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:34 smithi159 conmon[35668]: 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:34 smithi159 conmon[35668]: audit 2022-02-02T18:23:33.726891+0000 mon.smithi096 (mon.0) 45 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:35.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.522511+0000 mon.smithi096 (mon.0) 46 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:35.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.523514+0000 mon.smithi096 (mon.0) 47 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:35.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.904835+0000 mon.smithi096 (mon.0) 48 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:35.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.905845+0000 mon.smithi096 (mon.0) 49 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:35.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: cluster 2022-02-02T18:23:34.906960+0000 mgr.smithi096.shfutl (mgr.24491) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 93 KiB/s rd, 20 KiB/s wr, 6 op/s 2022-02-02T18:23:35.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.910149+0000 mon.smithi096 (mon.0) 50 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:35.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.915470+0000 mon.smithi096 (mon.0) 51 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:35.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.917177+0000 mon.smithi096 (mon.0) 52 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:35.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:35 smithi159 conmon[35668]: audit 2022-02-02T18:23:34.918034+0000 mon.smithi096 (mon.0) 53 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T18:23:36.811 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: cluster 2022-02-02T18:23:35.902936+0000 mon.smithi096 (mon 2022-02-02T18:23:36.812 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: .0) 54 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:23:36.812 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:36.237138+0000 mgr.smithi096.shfutl (mgr.24491) 10 : cephadm [INF] Upgrade: Updating mon.smithi159 2022-02-02T18:23:36.812 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: audit 2022-02-02T18:23:36.241414+0000 mon.smithi096 (mon.0) 55 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:36.812 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: audit 2022-02-02T18:23:36.242448+0000 mon.smithi096 (mon.0) 56 : audit [INF] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:36.812 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: audit 2022-02-02T18:23:36.243268+0000 mon.smithi096 (mon.0) 57 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:36.813 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: audit 2022-02-02T18:23:36.244095+0000 mon.smithi096 (mon.0) 58 : audit [DBG] from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:36.813 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:36 smithi159 conmon[35668]: cephadm 2022-02-02T18:23:36.245070+0000 mgr.smithi096.shfutl (mgr.24491) 11 : cephadm [INF] Deploying daemon mon.smithi159 on smithi159 2022-02-02T18:23:37.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:37 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:23:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:37 smithi159 conmon[35668]: debug 2022-02-02T18:23:37.529+0000 7efd430be700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T18:23:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:37 smithi159 conmon[35668]: debug 2022-02-02T18:23:37.529+0000 7efd430be700 -1 mon.smithi159@1(peon) e2 *** Got Signal Terminated *** 2022-02-02T18:23:38.121 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 bash[68485]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon.smithi159 2022-02-02T18:23:38.122 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 bash[68485]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon-smithi159" found: no such container 2022-02-02T18:23:38.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 bash[68485]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-mon.smithi159" found: no such container 2022-02-02T18:23:38.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@mon.smithi159.service: Succeeded. 2022-02-02T18:23:38.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 systemd[1]: Stopped Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:23:38.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 systemd[1]: Starting Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:23:38.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 podman[68831]: 2022-02-02T18:23:39.091 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: set uid:gid to 167:167 (ceph:ceph) 2022-02-02T18:23:39.091 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev), process ceph-mon, pid 7 2022-02-02T18:23:39.091 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: pidfile_write: ignore empty --pid-file 2022-02-02T18:23:39.092 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: load: jerasure load: lrc 2022-02-02T18:23:39.092 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: RocksDB version: 6.15.5 2022-02-02T18:23:39.092 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T18:23:39.093 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Compile date Feb 2 2022 2022-02-02T18:23:39.093 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: DB SUMMARY 2022-02-02T18:23:39.093 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: DB Session ID: 9BPPKABAUWHSQ9BAVZ2W 2022-02-02T18:23:39.094 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: CURRENT file: CURRENT 2022-02-02T18:23:39.094 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: IDENTITY file: IDENTITY 2022-02-02T18:23:39.094 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: MANIFEST file: MANIFEST-000005 size: 503 Bytes 2022-02-02T18:23:39.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 1, files: 000014.sst 2022-02-02T18:23:39.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000012.log size: 2485956 ; 2022-02-02T18:23:39.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.error_if_exists: 0 2022-02-02T18:23:39.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.create_if_missing: 0 2022-02-02T18:23:39.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.paranoid_checks: 1 2022-02-02T18:23:39.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-02-02T18:23:39.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.env: 0x55eb49a13860 2022-02-02T18:23:39.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.fs: Posix File System 2022-02-02T18:23:39.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.info_log: 0x55eb4b177e00 2022-02-02T18:23:39.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_file_opening_threads: 16 2022-02-02T18:23:39.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.statistics: (nil) 2022-02-02T18:23:39.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.use_fsync: 0 2022-02-02T18:23:39.098 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_log_file_size: 0 2022-02-02T18:23:39.098 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T18:23:39.098 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T18:23:39.098 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.keep_log_file_num: 1000 2022-02-02T18:23:39.099 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.recycle_log_file_num: 0 2022-02-02T18:23:39.099 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_fallocate: 1 2022-02-02T18:23:39.099 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_mmap_reads: 0 2022-02-02T18:23:39.099 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_mmap_writes: 0 2022-02-02T18:23:39.099 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.use_direct_reads: 0 2022-02-02T18:23:39.100 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T18:23:39.100 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.create_missing_column_families: 0 2022-02-02T18:23:39.101 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.db_log_dir: 2022-02-02T18:23:39.101 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi159/store.db 2022-02-02T18:23:39.101 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T18:23:39.101 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T18:23:39.102 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T18:23:39.102 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T18:23:39.102 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T18:23:39.103 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T18:23:39.103 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.advise_random_on_open: 1 2022-02-02T18:23:39.104 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.db_write_buffer_size: 0 2022-02-02T18:23:39.104 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.write_buffer_manager: 0x55eb4b266330 2022-02-02T18:23:39.105 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T18:23:39.105 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T18:23:39.105 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T18:23:39.106 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T18:23:39.106 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.rate_limiter: (nil) 2022-02-02T18:23:39.107 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T18:23:39.107 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.wal_recovery_mode: 2 2022-02-02T18:23:39.108 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.enable_thread_tracking: 0 2022-02-02T18:23:39.108 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.enable_pipelined_write: 0 2022-02-02T18:23:39.108 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.unordered_write: 0 2022-02-02T18:23:39.109 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T18:23:39.109 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T18:23:39.110 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T18:23:39.111 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T18:23:39.111 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.row_cache: None 2022-02-02T18:23:39.112 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.wal_filter: None 2022-02-02T18:23:39.112 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T18:23:39.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_ingest_behind: 0 2022-02-02T18:23:39.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.preserve_deletes: 0 2022-02-02T18:23:39.114 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.two_write_queues: 0 2022-02-02T18:23:39.114 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.manual_wal_flush: 0 2022-02-02T18:23:39.115 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.atomic_flush: 0 2022-02-02T18:23:39.115 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T18:23:39.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T18:23:39.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T18:23:39.116 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.log_readahead_size: 0 2022-02-02T18:23:39.117 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-02-02T18:23:39.117 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.best_efforts_recovery: 0 2022-02-02T18:23:39.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-02-02T18:23:39.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-02-02T18:23:39.119 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.allow_data_in_errors: 0 2022-02-02T18:23:39.119 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.db_host_id: __hostname__ 2022-02-02T18:23:39.120 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_background_jobs: 2 2022-02-02T18:23:39.120 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_background_compactions: -1 2022-02-02T18:23:39.121 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_subcompactions: 1 2022-02-02T18:23:39.121 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T18:23:39.121 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T18:23:39.122 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T18:23:39.122 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_total_wal_size: 0 2022-02-02T18:23:39.123 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T18:23:39.123 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T18:23:39.124 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T18:23:39.124 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T18:23:39.125 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_open_files: -1 2022-02-02T18:23:39.125 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bytes_per_sync: 0 2022-02-02T18:23:39.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T18:23:39.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T18:23:39.127 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_readahead_size: 0 2022-02-02T18:23:39.127 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_background_flushes: -1 2022-02-02T18:23:39.127 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Compression algorithms supported: 2022-02-02T18:23:39.128 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T18:23:39.128 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kZSTD supported: 0 2022-02-02T18:23:39.129 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kXpressCompression supported: 0 2022-02-02T18:23:39.129 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kLZ4HCCompression supported: 1 2022-02-02T18:23:39.130 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kLZ4Compression supported: 1 2022-02-02T18:23:39.130 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kBZip2Compression supported: 0 2022-02-02T18:23:39.131 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kZlibCompression supported: 1 2022-02-02T18:23:39.131 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: kSnappyCompression supported: 1 2022-02-02T18:23:39.131 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T18:23:39.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005 2022-02-02T18:23:39.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2022-02-02T18:23:39.133 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T18:23:39.133 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.merge_operator: 2022-02-02T18:23:39.133 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_filter: None 2022-02-02T18:23:39.133 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_filter_factory: None 2022-02-02T18:23:39.133 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.sst_partitioner_factory: None 2022-02-02T18:23:39.134 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T18:23:39.134 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T18:23:39.134 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eb4b143c20) 2022-02-02T18:23:39.134 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks: 1 2022-02-02T18:23:39.135 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T18:23:39.135 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T18:23:39.135 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_top_level_index_and_filter: 1 2022-02-02T18:23:39.135 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_type: 0 2022-02-02T18:23:39.135 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_index_type: 0 2022-02-02T18:23:39.136 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_shortening: 1 2022-02-02T18:23:39.136 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2022-02-02T18:23:39.136 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: hash_index_allow_collision: 1 2022-02-02T18:23:39.136 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: checksum: 1 2022-02-02T18:23:39.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: no_block_cache: 0 2022-02-02T18:23:39.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache: 0x55eb4b1ae170 2022-02-02T18:23:39.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_name: BinnedLRUCache 2022-02-02T18:23:39.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_options: 2022-02-02T18:23:39.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: capacity : 536870912 2022-02-02T18:23:39.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_shard_bits : 4 2022-02-02T18:23:39.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: strict_capacity_limit : 0 2022-02-02T18:23:39.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: high_pri_pool_ratio: 0.000 2022-02-02T18:23:39.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_compressed: (nil) 2022-02-02T18:23:39.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: persistent_cache: (nil) 2022-02-02T18:23:39.139 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size: 4096 2022-02-02T18:23:39.139 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size_deviation: 10 2022-02-02T18:23:39.139 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_restart_interval: 16 2022-02-02T18:23:39.139 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_block_restart_interval: 1 2022-02-02T18:23:39.140 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_block_size: 4096 2022-02-02T18:23:39.140 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: partition_filters: 0 2022-02-02T18:23:39.140 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: use_delta_encoding: 1 2022-02-02T18:23:39.140 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T18:23:39.140 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: whole_key_filtering: 1 2022-02-02T18:23:39.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: verify_compression: 0 2022-02-02T18:23:39.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: read_amp_bytes_per_bit: 0 2022-02-02T18:23:39.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: format_version: 4 2022-02-02T18:23:39.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_index_compression: 1 2022-02-02T18:23:39.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_align: 0 2022-02-02T18:23:39.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.write_buffer_size: 33554432 2022-02-02T18:23:39.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_write_buffer_number: 2 2022-02-02T18:23:39.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression: NoCompression 2022-02-02T18:23:39.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression: Disabled 2022-02-02T18:23:39.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.prefix_extractor: nullptr 2022-02-02T18:23:39.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T18:23:39.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.num_levels: 7 2022-02-02T18:23:39.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T18:23:39.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T18:23:39.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T18:23:39.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T18:23:39.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T18:23:39.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T18:23:39.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T18:23:39.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:23:39.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-02-02T18:23:39.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T18:23:39.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T18:23:39.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.level: 32767 2022-02-02T18:23:39.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.strategy: 0 2022-02-02T18:23:39.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T18:23:39.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T18:23:39.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-02-02T18:23:39.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compression_opts.enabled: false 2022-02-02T18:23:39.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T18:23:39.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T18:23:39.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T18:23:39.148 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.target_file_size_base: 67108864 2022-02-02T18:23:39.148 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T18:23:39.148 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T18:23:39.148 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T18:23:39.149 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T18:23:39.149 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T18:23:39.149 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T18:23:39.149 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T18:23:39.149 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T18:23:39.150 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T18:23:39.150 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T18:23:39.150 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T18:23:39.150 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T18:23:39.150 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T18:23:39.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.arena_block_size: 4194304 2022-02-02T18:23:39.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T18:23:39.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T18:23:39.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T18:23:39.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.disable_auto_compactions: 0 2022-02-02T18:23:39.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T18:23:39.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T18:23:39.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T18:23:39.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T18:23:39.153 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T18:23:39.153 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T18:23:39.153 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T18:23:39.153 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T18:23:39.154 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T18:23:39.154 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T18:23:39.154 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.table_properties_collectors: 2022-02-02T18:23:39.154 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.inplace_update_support: 0 2022-02-02T18:23:39.154 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T18:23:39.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T18:23:39.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T18:23:39.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T18:23:39.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.bloom_locality: 0 2022-02-02T18:23:39.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.max_successive_merges: 0 2022-02-02T18:23:39.156 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T18:23:39.156 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.paranoid_file_checks: 0 2022-02-02T18:23:39.156 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.force_consistency_checks: 1 2022-02-02T18:23:39.156 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.report_bg_io_stats: 0 2022-02-02T18:23:39.157 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.ttl: 2592000 2022-02-02T18:23:39.157 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T18:23:39.157 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.enable_blob_files: false 2022-02-02T18:23:39.157 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.min_blob_size: 0 2022-02-02T18:23:39.157 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.blob_file_size: 268435456 2022-02-02T18:23:39.158 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.blob_compression_type: NoCompression 2022-02-02T18:23:39.158 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.enable_blob_garbage_collection: false 2022-02-02T18:23:39.158 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-02-02T18:23:39.158 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:39.159 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 16, last_sequence is 9073, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T18:23:39.159 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 12 2022-02-02T18:23:39.159 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:4083] Creating manifest 16 2022-02-02T18:23:39.159 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:39.159 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826218832159, "job": 1, "event": "recovery_started", "wal_files": [12]} 2022-02-02T18:23:39.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #12 mode 2 2022-02-02T18:23:39.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T18:23:39.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826218836265, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 17, "file_size": 1633711, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 1631219, "index_size": 1237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 2170, "raw_average_key_size": 22, "raw_value_size": 1628232, "raw_average_value_size": 16960, "num_data_blocks": 55, "num_entries": 96, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643826218, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "7e206364-d97c-4920-89f7-e1080ca9dabe", "db_session_id": "9BPPKABAUWHSQ9BAVZ2W"}} 2022-02-02T18:23:39.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:4083] Creating manifest 18 2022-02-02T18:23:39.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T18:23:39.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643826218836683, "job": 1, "event": "recovery_finished"} 2022-02-02T18:23:39.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi159/store.db/000012.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-02-02T18:23:39.162 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55eb4b194a80 2022-02-02T18:23:39.162 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: DB pointer 0x55eb4b1a4000 2022-02-02T18:23:39.162 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2022-02-02T18:23:39.162 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-02-02T18:23:39.162 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** DB Stats ** 2022-02-02T18:23:39.163 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:39.163 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T18:23:39.163 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T18:23:39.163 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:23:39.163 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T18:23:39.164 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T18:23:39.164 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T18:23:39.164 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.164 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:39.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:39.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:39.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 1/0 1.56 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L6 1/0 22.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:39.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 2/0 24.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:39.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:39.167 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:39.167 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.167 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:39.167 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.002, interval 0.002 2022-02-02T18:23:39.167 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:23:39.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:23:39.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:23:39.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:23:39.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 232.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:39.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 232.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:39.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:23:39.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:23:39.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:39.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:39.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:39.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 1/0 1.56 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L6 1/0 22.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:39.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 2/0 24.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T18:23:39.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2022-02-02T18:23:39.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T18:23:39.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T18:23:39.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 829.6 0.00 0.00 1 0.002 0 0 2022-02-02T18:23:39.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T18:23:39.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.002, interval 0.000 2022-02-02T18:23:39.173 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T18:23:39.173 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T18:23:39.173 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T18:23:39.173 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T18:23:39.174 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 231.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:39.174 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T18:23:39.174 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T18:23:39.174 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.174 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T18:23:39.175 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: starting mon.smithi159 rank 1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:39.175 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???) e2 preinit fsid e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:39.175 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).mds e32 new map 2022-02-02T18:23:39.175 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).mds e32 print_map 2022-02-02T18:23:39.176 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: e32 2022-02-02T18:23:39.176 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:23:39.176 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:39.176 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: legacy client fscid: 1 2022-02-02T18:23:39.176 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.177 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Filesystem 'cephfs' (1) 2022-02-02T18:23:39.177 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: fs_name cephfs 2022-02-02T18:23:39.177 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: epoch 32 2022-02-02T18:23:39.177 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:23:39.177 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:23:39.178 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: modified 2022-02-02T18:22:59.964896+0000 2022-02-02T18:23:39.178 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: tableserver 0 2022-02-02T18:23:39.178 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: root 0 2022-02-02T18:23:39.178 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_timeout 60 2022-02-02T18:23:39.179 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_autoclose 300 2022-02-02T18:23:39.179 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_file_size 1099511627776 2022-02-02T18:23:39.179 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: required_client_features {} 2022-02-02T18:23:39.179 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure 0 2022-02-02T18:23:39.179 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure_osd_epoch 49 2022-02-02T18:23:39.180 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:39.180 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_mds 2 2022-02-02T18:23:39.180 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: in 0,1 2022-02-02T18:23:39.180 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: up {0=24423,1=24273} 2022-02-02T18:23:39.181 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: failed 2022-02-02T18:23:39.181 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: damaged 2022-02-02T18:23:39.181 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: stopped 2022-02-02T18:23:39.181 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_pools [3] 2022-02-02T18:23:39.181 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_pool 2 2022-02-02T18:23:39.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: inline_data disabled 2022-02-02T18:23:39.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: balancer 2022-02-02T18:23:39.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: standby_count_wanted 1 2022-02-02T18:23:39.182 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.shbucd{0:24423} state up:active seq 12 export targets 1 join_fscid=1 addr [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:39.183 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi096.pitrsc{0:24447} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:39.183 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:39.183 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:39.183 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.183 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2022-02-02T18:23:39.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2022-02-02T18:23:39.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:39.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:39.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T18:23:39.185 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 ceph-mon[69013]: mon.smithi159@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2022-02-02T18:23:39.185 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 bash[68677]: 6ced22c3b347e9a2b8d92b1d30d016234065178d981b817929092630683922f0 2022-02-02T18:23:39.185 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:38 smithi159 systemd[1]: Started Ceph mon.smithi159 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:23:40.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mkfs e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:40.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Applying service osd.None on host smithi159... 2022-02-02T18:23:40.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon osd.4 on smithi159 2022-02-02T18:23:40.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Applying service osd.None on host smithi159... 2022-02-02T18:23:40.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon osd.5 on smithi159 2022-02-02T18:23:40.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Saving service mds.cephfs spec with placement count:4 2022-02-02T18:23:40.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:23:40.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:23:40.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:23:40.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:23:40.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:23:40.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:23:40.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Target is version 17.0.0-10511-g78571b80 (unknown) 2022-02-02T18:23:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f'] 2022-02-02T18:23:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:23:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f on smithi159 2022-02-02T18:23:40.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:23:40.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:23:40.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:23:40.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Failing over to other MGR 2022-02-02T18:23:40.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying cephadm binary to smithi096 2022-02-02T18:23:40.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying cephadm binary to smithi159 2022-02-02T18:23:40.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:08] ENGINE Bus STARTING 2022-02-02T18:23:40.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:08] ENGINE Serving on https://172.21.15.159:7150 2022-02-02T18:23:40.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:08] ENGINE Bus STARTED 2022-02-02T18:23:40.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:23:40.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Updating mgr.smithi096.shfutl 2022-02-02T18:23:40.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:23:40.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:23:40.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Failing over to other MGR 2022-02-02T18:23:40.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: inventory: adjusted host smithi159 addr 'smithi159' -> '172.21.15.159' 2022-02-02T18:23:40.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:37] ENGINE Bus STARTING 2022-02-02T18:23:40.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:37] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:23:40.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:22:37] ENGINE Bus STARTED 2022-02-02T18:23:40.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:23:40.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:23:40.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:clientreplay 2022-02-02T18:23:40.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:clientreplay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:40.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:23:40.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:23:40.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T18:23:40.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Cluster is now healthy 2022-02-02T18:23:40.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:active 2022-02-02T18:23:40.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:40.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 6.7 MiB/s wr, 23 op/s 2022-02-02T18:23:40.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 75 op/s 2022-02-02T18:23:40.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 71 op/s 2022-02-02T18:23:40.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 91 op/s 2022-02-02T18:23:40.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 87 op/s 2022-02-02T18:23:40.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 19 MiB/s rd, 27 MiB/s wr, 97 op/s 2022-02-02T18:23:40.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 148 op/s 2022-02-02T18:23:40.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 19 MiB/s rd, 35 MiB/s wr, 92 op/s 2022-02-02T18:23:40.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 228 op/s 2022-02-02T18:23:40.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:40.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:40.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e30: smithi096.shfutl(active, since 33s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 114 MiB/s wr, 208 op/s 2022-02-02T18:23:40.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 137 MiB/s wr, 232 op/s 2022-02-02T18:23:40.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 160 MiB/s wr, 305 op/s 2022-02-02T18:23:40.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Setting container_image for all mgr 2022-02-02T18:23:40.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 136 MiB/s wr, 243 op/s 2022-02-02T18:23:40.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Updating mon.smithi096 2022-02-02T18:23:40.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:40.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:40.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mon.smithi096 on smithi096 2022-02-02T18:23:40.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mon.smithi096 calling monitor election 2022-02-02T18:23:40.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:23:40.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:23:40.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: osdmap e49: 6 total, 6 up, 6 in 2022-02-02T18:23:40.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e30: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e31: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: overall HEALTH_OK 2022-02-02T18:23:40.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.14628 ' entity='' 2022-02-02T18:23:40.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Active manager daemon smithi096.shfutl restarted 2022-02-02T18:23:40.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Activating manager daemon smithi096.shfutl 2022-02-02T18:23:40.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T18:23:40.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e32: smithi096.shfutl(active, starting, since 0.054479s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.303 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:23:40.304 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:23:40.304 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:23:40.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:23:40.305 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:23:40.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:23:40.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:23:40.306 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:23:40.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:23:40.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:23:40.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:23:40.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:23:40.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:23:40.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:23:40.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:23:40.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Manager daemon smithi096.shfutl is now available 2022-02-02T18:23:40.308 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:40.309 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:23:40.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:23:40.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:23:27] ENGINE Bus STARTING 2022-02-02T18:23:40.310 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:23:27] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:23:40.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [02/Feb/2022:18:23:27] ENGINE Bus STARTED 2022-02-02T18:23:40.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:40.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:40.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:23:40.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:23:40.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:23:40.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:23:40.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e33: smithi096.shfutl(active, since 1.07436s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v3: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v4: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e34: smithi096.shfutl(active, since 2s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v5: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.314 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v6: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:40.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:40.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v7: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 93 KiB/s rd, 20 KiB/s wr, 6 op/s 2022-02-02T18:23:40.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.317 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:40.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T18:23:40.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:23:40.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Upgrade: Updating mon.smithi159 2022-02-02T18:23:40.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:40.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:40.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Deploying daemon mon.smithi159 on smithi159 2022-02-02T18:23:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v8: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 15 KiB/s wr, 5 op/s 2022-02-02T18:23:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: pgmap v9: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 13 KiB/s wr, 6 op/s 2022-02-02T18:23:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2022-02-02T18:23:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T18:23:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: daemon mds.cephfs.smithi159.shbucd on smithi159 is in error state 2022-02-02T18:23:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mon.smithi096 calling monitor election 2022-02-02T18:23:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mon.smithi159 calling monitor election 2022-02-02T18:23:40.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:23:40.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: monmap e3: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:23:40.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.322 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T18:23:40.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: mgrmap e34: smithi096.shfutl(active, since 12s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.323 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2022-02-02T18:23:40.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T18:23:40.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: daemon mds.cephfs.smithi159.shbucd on smithi159 is in error state 2022-02-02T18:23:40.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.324 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:40.325 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: daemon mds.cephfs.smithi159.shbucd restarted 2022-02-02T18:23:40.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:39 smithi159 ceph-mon[69013]: osdmap e51: 6 total, 6 up, 6 in 2022-02-02T18:23:40.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mkfs e1d78c58-8453-11ec-8c35-001a4aab830c 2022-02-02T18:23:40.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Applying service osd.None on host smithi159... 2022-02-02T18:23:40.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon osd.4 on smithi159 2022-02-02T18:23:40.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Applying service osd.None on host smithi159... 2022-02-02T18:23:40.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon osd.5 on smithi159 2022-02-02T18:23:40.329 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Detected new or changed devices on smithi159 2022-02-02T18:23:40.330 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Saving service mds.cephfs spec with placement count:4 2022-02-02T18:23:40.330 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:23:40.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:23:40.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:23:40.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:23:40.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:23:40.331 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:78571b80ad21c56cce214a3fbfb0b1a080f78167 2022-02-02T18:23:40.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Target is version 17.0.0-10511-g78571b80 (unknown) 2022-02-02T18:23:40.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f'] 2022-02-02T18:23:40.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:23:40.332 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c7e1d12c0298b3a0780758675e56f926746bb5399d6448257564620e9c691f on smithi159 2022-02-02T18:23:40.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:23:40.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:23:40.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Need to upgrade myself (mgr.smithi096.shfutl) 2022-02-02T18:23:40.333 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Failing over to other MGR 2022-02-02T18:23:40.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying cephadm binary to smithi096 2022-02-02T18:23:40.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying cephadm binary to smithi159 2022-02-02T18:23:40.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:08] ENGINE Bus STARTING 2022-02-02T18:23:40.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:08] ENGINE Serving on https://172.21.15.159:7150 2022-02-02T18:23:40.335 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:08] ENGINE Bus STARTED 2022-02-02T18:23:40.335 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:23:40.335 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Updating mgr.smithi096.shfutl 2022-02-02T18:23:40.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:23:40.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Need to upgrade myself (mgr.smithi159.jrxkfz) 2022-02-02T18:23:40.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Failing over to other MGR 2022-02-02T18:23:40.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: inventory: adjusted host smithi159 addr 'smithi159' -> '172.21.15.159' 2022-02-02T18:23:40.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:37] ENGINE Bus STARTING 2022-02-02T18:23:40.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:37] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:23:40.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:22:37] ENGINE Bus STARTED 2022-02-02T18:23:40.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Updating mgr.smithi159.jrxkfz 2022-02-02T18:23:40.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:23:40.339 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:clientreplay 2022-02-02T18:23:40.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2/2 {0=cephfs.smithi159.shbucd=up:clientreplay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:40.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: daemon mds.cephfs.smithi159.shbucd is now active in filesystem cephfs as rank 0 2022-02-02T18:23:40.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.6 KiB/s wr, 12 op/s 2022-02-02T18:23:40.340 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T18:23:40.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Cluster is now healthy 2022-02-02T18:23:40.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mds.? [v2:172.21.15.159:6824/1598462240,v1:172.21.15.159:6825/1598462240] up:active 2022-02-02T18:23:40.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:40.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.341 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 6.7 MiB/s wr, 23 op/s 2022-02-02T18:23:40.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 75 op/s 2022-02-02T18:23:40.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 71 op/s 2022-02-02T18:23:40.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 16 MiB/s wr, 91 op/s 2022-02-02T18:23:40.342 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 87 op/s 2022-02-02T18:23:40.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.343 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 19 MiB/s rd, 27 MiB/s wr, 97 op/s 2022-02-02T18:23:40.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 148 op/s 2022-02-02T18:23:40.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 19 MiB/s rd, 35 MiB/s wr, 92 op/s 2022-02-02T18:23:40.344 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 228 op/s 2022-02-02T18:23:40.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:40.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:40.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e30: smithi096.shfutl(active, since 33s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.345 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 114 MiB/s wr, 208 op/s 2022-02-02T18:23:40.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 137 MiB/s wr, 232 op/s 2022-02-02T18:23:40.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 160 MiB/s wr, 305 op/s 2022-02-02T18:23:40.346 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Setting container_image for all mgr 2022-02-02T18:23:40.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 136 MiB/s wr, 243 op/s 2022-02-02T18:23:40.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Updating mon.smithi096 2022-02-02T18:23:40.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:40.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:40.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mon.smithi096 on smithi096 2022-02-02T18:23:40.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 172.21.15.96:0/105662917' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mon.smithi096 calling monitor election 2022-02-02T18:23:40.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:23:40.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:23:40.349 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: osdmap e49: 6 total, 6 up, 6 in 2022-02-02T18:23:40.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e30: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e31: smithi096.shfutl(active, since 44s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: overall HEALTH_OK 2022-02-02T18:23:40.350 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.14628 ' entity='' 2022-02-02T18:23:40.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Active manager daemon smithi096.shfutl restarted 2022-02-02T18:23:40.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Activating manager daemon smithi096.shfutl 2022-02-02T18:23:40.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T18:23:40.351 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e32: smithi096.shfutl(active, starting, since 0.054479s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:23:40.352 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.omlhix"}]: dispatch 2022-02-02T18:23:40.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:23:40.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:23:40.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi096.shfutl", "id": "smithi096.shfutl"}]: dispatch 2022-02-02T18:23:40.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr metadata", "who": "smithi159.jrxkfz", "id": "smithi159.jrxkfz"}]: dispatch 2022-02-02T18:23:40.353 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:23:40.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:23:40.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:23:40.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:23:40.354 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:23:40.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:23:40.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T18:23:40.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T18:23:40.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T18:23:40.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Manager daemon smithi096.shfutl is now available 2022-02-02T18:23:40.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.356 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:40.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:23:40.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:23:40.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:23:27] ENGINE Bus STARTING 2022-02-02T18:23:40.357 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:23:27] ENGINE Serving on https://172.21.15.96:7150 2022-02-02T18:23:40.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [02/Feb/2022:18:23:27] ENGINE Bus STARTED 2022-02-02T18:23:40.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Standby manager daemon smithi159.jrxkfz restarted 2022-02-02T18:23:40.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Standby manager daemon smithi159.jrxkfz started 2022-02-02T18:23:40.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/crt"}]: dispatch 2022-02-02T18:23:40.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T18:23:40.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.jrxkfz/key"}]: dispatch 2022-02-02T18:23:40.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.? 172.21.15.159:0/2924680007' entity='mgr.smithi159.jrxkfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T18:23:40.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e33: smithi096.shfutl(active, since 1.07436s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v3: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v4: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.360 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e34: smithi096.shfutl(active, since 2s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v5: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v6: 65 pgs: 65 active+clean; 740 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:23:40.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:40.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:23:40.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v7: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 93 KiB/s rd, 20 KiB/s wr, 6 op/s 2022-02-02T18:23:40.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:40.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T18:23:40.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T18:23:40.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Upgrade: Updating mon.smithi159 2022-02-02T18:23:40.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:40.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:40.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Deploying daemon mon.smithi159 on smithi159 2022-02-02T18:23:40.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v8: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 15 KiB/s wr, 5 op/s 2022-02-02T18:23:40.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: pgmap v9: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 13 KiB/s wr, 6 op/s 2022-02-02T18:23:40.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2022-02-02T18:23:40.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T18:23:40.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: daemon mds.cephfs.smithi159.shbucd on smithi159 is in error state 2022-02-02T18:23:40.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2022-02-02T18:23:40.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mon.smithi096 calling monitor election 2022-02-02T18:23:40.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mon.smithi159 calling monitor election 2022-02-02T18:23:40.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mon.smithi096 is new leader, mons smithi096,smithi159 in quorum (ranks 0,1) 2022-02-02T18:23:40.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: monmap e3: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} 2022-02-02T18:23:40.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: fsmap cephfs:2 {0=cephfs.smithi159.shbucd=up:active,1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 2022-02-02T18:23:40.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T18:23:40.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: mgrmap e34: smithi096.shfutl(active, since 12s), standbys: smithi159.jrxkfz 2022-02-02T18:23:40.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2022-02-02T18:23:40.368 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2022-02-02T18:23:40.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T18:23:40.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: daemon mds.cephfs.smithi159.shbucd on smithi159 is in error state 2022-02-02T18:23:40.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:40.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:23:40.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:40.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:23:40.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:23:40.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: daemon mds.cephfs.smithi159.shbucd restarted 2022-02-02T18:23:40.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:39 smithi096 ceph-mon[101353]: osdmap e51: 6 total, 6 up, 6 in 2022-02-02T18:23:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T18:23:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: mds.? [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] up:boot 2022-02-02T18:23:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: Standby daemon mds.cephfs.smithi096.pitrsc assigned to filesystem cephfs as rank 0 2022-02-02T18:23:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2022-02-02T18:23:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:23:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:40 smithi159 ceph-mon[69013]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:41.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T18:23:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: mds.? [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] up:boot 2022-02-02T18:23:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: Standby daemon mds.cephfs.smithi096.pitrsc assigned to filesystem cephfs as rank 0 2022-02-02T18:23:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2022-02-02T18:23:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.shbucd"}]: dispatch 2022-02-02T18:23:41.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:40 smithi096 ceph-mon[101353]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:replay,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:42.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:42 smithi159 ceph-mon[69013]: pgmap v11: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 14 KiB/s wr, 7 op/s 2022-02-02T18:23:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:42 smithi159 ceph-mon[69013]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:resolve 2022-02-02T18:23:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:42 smithi159 ceph-mon[69013]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:42 smithi096 ceph-mon[101353]: pgmap v11: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 14 KiB/s wr, 7 op/s 2022-02-02T18:23:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:42 smithi096 ceph-mon[101353]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:resolve 2022-02-02T18:23:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:42 smithi096 ceph-mon[101353]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:resolve,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:43.322 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: reconnect by client.24511 172.21.15.96:0/2676346973 after 0.000999977 2022-02-02T18:23:43.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: reconnect by client.34120 172.21.15.96:0/81214270 after 0.000999977 2022-02-02T18:23:43.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:reconnect 2022-02-02T18:23:43.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:43.323 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: reconnect by client.24303 v1:172.21.15.96:0/1417773195 after 0.0219995 2022-02-02T18:23:43.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: reconnect by client.24307 v1:192.168.0.1:0/2904487504 after 0.0229995 2022-02-02T18:23:43.324 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:43.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: reconnect by client.24511 172.21.15.96:0/2676346973 after 0.000999977 2022-02-02T18:23:43.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: reconnect by client.34120 172.21.15.96:0/81214270 after 0.000999977 2022-02-02T18:23:43.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:reconnect 2022-02-02T18:23:43.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:reconnect,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:43.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: reconnect by client.24303 v1:172.21.15.96:0/1417773195 after 0.0219995 2022-02-02T18:23:43.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: reconnect by client.24307 v1:192.168.0.1:0/2904487504 after 0.0229995 2022-02-02T18:23:43.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:44.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:44 smithi159 ceph-mon[69013]: pgmap v12: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 14 KiB/s wr, 7 op/s 2022-02-02T18:23:44.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:44 smithi159 ceph-mon[69013]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:rejoin 2022-02-02T18:23:44.354 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:44 smithi159 ceph-mon[69013]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:44.354 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:44.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:44 smithi096 ceph-mon[101353]: pgmap v12: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 14 KiB/s wr, 7 op/s 2022-02-02T18:23:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:44 smithi096 ceph-mon[101353]: mds.24447 [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] up:rejoin 2022-02-02T18:23:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:44 smithi096 ceph-mon[101353]: fsmap cephfs:2/2 {0=cephfs.smithi096.pitrsc=up:rejoin,1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T18:23:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:46 smithi159 ceph-mon[69013]: pgmap v13: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2022-02-02T18:23:46.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:46 smithi096 ceph-mon[101353]: pgmap v13: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2022-02-02T18:23:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 -- 172.21.15.96:0/1312375100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 msgr2=0x7f83000f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 --2- 172.21.15.96:0/1312375100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f83000f7de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f82f0004660 tx=0x7f82f0009b30).stop 2022-02-02T18:23:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 -- 172.21.15.96:0/1312375100 shutdown_connections 2022-02-02T18:23:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 --2- 172.21.15.96:0/1312375100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f83000f7de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 --2- 172.21.15.96:0/1312375100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f83000f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:23:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 -- 172.21.15.96:0/1312375100 >> 172.21.15.96:0/1312375100 conn(0x7f83000f1e40 msgr2=0x7f83000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 -- 172.21.15.96:0/1312375100 shutdown_connections 2022-02-02T18:23:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.565+0000 7f8304983700 1 -- 172.21.15.96:0/1312375100 wait complete. 2022-02-02T18:23:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 Processor -- start 2022-02-02T18:23:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 -- start start 2022-02-02T18:23:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f830006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830006a410 con 0x7f83000f7980 2022-02-02T18:23:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f8304983700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830006a550 con 0x7f83000f66e0 2022-02-02T18:23:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53294/0 (socket says 172.21.15.96:53294) 2022-02-02T18:23:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 -- 172.21.15.96:0/3742220077 learned_addr learned my addr 172.21.15.96:0/3742220077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fe59c700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f830006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 -- 172.21.15.96:0/3742220077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 msgr2=0x7f830006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f830006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fdd9b700 1 -- 172.21.15.96:0/3742220077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0005040 con 0x7f83000f7980 2022-02-02T18:23:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.566+0000 7f82fe59c700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f830006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:23:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f82fdd9b700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f82f0009990 tx=0x7f82f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:46.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82f0018070 con 0x7f83000f7980 2022-02-02T18:23:46.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f82f0007ca0 con 0x7f83000f7980 2022-02-02T18:23:46.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830006a7d0 con 0x7f83000f7980 2022-02-02T18:23:46.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82f001c620 con 0x7f83000f7980 2022-02-02T18:23:46.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.567+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830010efe0 con 0x7f83000f7980 2022-02-02T18:23:46.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.568+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300045ad0 con 0x7f83000f7980 2022-02-02T18:23:46.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.569+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f82f001d960 con 0x7f83000f7980 2022-02-02T18:23:46.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.569+0000 7f82eeffd700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 0x7f82e8067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.569+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f82f0083140 con 0x7f83000f7980 2022-02-02T18:23:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.569+0000 7f82fe59c700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 0x7f82e8067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.570+0000 7f82fe59c700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 0x7f82e8067300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f830006b730 tx=0x7f82f4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.574+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f82f00512b0 con 0x7f83000f7980 2022-02-02T18:23:46.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.757+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8300057f10 con 0x7f82e8064e40 2022-02-02T18:23:46.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.758+0000 7f82eeffd700 1 -- 172.21.15.96:0/3742220077 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+303 (secure 0 0 0) 0x7f8300057f10 con 0x7f82e8064e40 2022-02-02T18:23:46.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 msgr2=0x7f82e8067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 0x7f82e8067300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f830006b730 tx=0x7f82f4008040).stop 2022-02-02T18:23:46.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 msgr2=0x7f8300069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f82f0009990 tx=0x7f82f0009b30).stop 2022-02-02T18:23:46.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 shutdown_connections 2022-02-02T18:23:46.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f82e8064e40 0x7f82e8067300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83000f66e0 0x7f830006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 --2- 172.21.15.96:0/3742220077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83000f7980 0x7f8300069e20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 >> 172.21.15.96:0/3742220077 conn(0x7f83000f1e40 msgr2=0x7f83000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:46.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 shutdown_connections 2022-02-02T18:23:46.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.760+0000 7f8304983700 1 -- 172.21.15.96:0/3742220077 wait complete. 2022-02-02T18:23:46.773 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:23:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 -- 172.21.15.96:0/1350735615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f6860 msgr2=0x7f5e4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 --2- 172.21.15.96:0/1350735615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0f6cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5e40004660 tx=0x7f5e40009b30).stop 2022-02-02T18:23:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 -- 172.21.15.96:0/1350735615 shutdown_connections 2022-02-02T18:23:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 --2- 172.21.15.96:0/1350735615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0f6cc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 --2- 172.21.15.96:0/1350735615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.857+0000 7f5e52347700 1 -- 172.21.15.96:0/1350735615 >> 172.21.15.96:0/1350735615 conn(0x7f5e4c0f0d40 msgr2=0x7f5e4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.858+0000 7f5e52347700 1 -- 172.21.15.96:0/1350735615 shutdown_connections 2022-02-02T18:23:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.858+0000 7f5e52347700 1 -- 172.21.15.96:0/1350735615 wait complete. 2022-02-02T18:23:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.858+0000 7f5e52347700 1 Processor -- start 2022-02-02T18:23:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.858+0000 7f5e52347700 1 -- start start 2022-02-02T18:23:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0fc120 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0fc260 con 0x7f5e4c0f6860 2022-02-02T18:23:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53304/0 (socket says 172.21.15.96:53304) 2022-02-02T18:23:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 -- 172.21.15.96:0/2755530988 learned_addr learned my addr 172.21.15.96:0/2755530988 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4b7fe700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 -- 172.21.15.96:0/2755530988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 msgr2=0x7f5e4c0fbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0fbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 -- 172.21.15.96:0/2755530988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40005040 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4b7fe700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:23:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e4bfff700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e3c002700 tx=0x7f5e3c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3c009320 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e3c00f040 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3c014900 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c0fc540 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.859+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c10ef80 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.860+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c045ad0 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.861+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f5e3c009480 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.862+0000 7f5e48ff9700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 0x7f5e34067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.862+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5e3c081f40 con 0x7f5e4c0f55c0 2022-02-02T18:23:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.862+0000 7f5e4b7fe700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 0x7f5e34067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.862+0000 7f5e4b7fe700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 0x7f5e34067300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e40004630 tx=0x7f5e40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:46.866+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e3c050130 con 0x7f5e4c0f55c0 2022-02-02T18:23:47.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.045+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e4c057f10 con 0x7f5e34064e40 2022-02-02T18:23:47.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.054+0000 7f5e48ff9700 1 -- 172.21.15.96:0/2755530988 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5e4c057f10 con 0x7f5e34064e40 2022-02-02T18:23:47.060 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:23:47.060 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (7m) 13s ago 8m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:23:47.061 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (8m) 13s ago 8m 6983k - 16.2.4 8d91d370c2b8 6d7fc299f23e 2022-02-02T18:23:47.061 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (7m) 4s ago 7m 7155k - 16.2.4 8d91d370c2b8 8b3819917df1 2022-02-02T18:23:47.061 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 13s ago 8m 40.1M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:23:47.061 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4m) 13s ago 4m 654M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:23:47.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (69s) 13s ago 4m 418M - 16.2.4 8d91d370c2b8 c2f4dbaa5b91 2022-02-02T18:23:47.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4m) 4s ago 4m 5331M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:23:47.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (8s) 4s ago 4m 12.1M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:23:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (84s) 13s ago 9m 442M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:23:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (55s) 4s ago 7m 415M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:23:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (27s) 13s ago 9m 58.0M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:23:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (8s) 4s ago 7m 23.8M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:23:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (7m) 13s ago 7m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:23:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 4s ago 7m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:23:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (7m) 13s ago 7m 845M 4096M 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:23:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 13s ago 6m 898M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:23:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 13s ago 6m 708M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:23:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (6m) 4s ago 6m 937M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:23:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (5m) 4s ago 5m 795M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:23:47.066 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (5m) 4s ago 5m 865M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:23:47.066 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (6m) 13s ago 7m 47.3M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:23:47.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 msgr2=0x7f5e34067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 0x7f5e34067300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e40004630 tx=0x7f5e40009b30).stop 2022-02-02T18:23:47.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 msgr2=0x7f5e4c0fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e3c002700 tx=0x7f5e3c009d80).stop 2022-02-02T18:23:47.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 shutdown_connections 2022-02-02T18:23:47.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e34064e40 0x7f5e34067300 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c0f55c0 0x7f5e4c0fd740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 --2- 172.21.15.96:0/2755530988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e4c0f6860 0x7f5e4c0fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 >> 172.21.15.96:0/2755530988 conn(0x7f5e4c0f0d40 msgr2=0x7f5e4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:47.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 shutdown_connections 2022-02-02T18:23:47.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.057+0000 7f5e52347700 1 -- 172.21.15.96:0/2755530988 wait complete. 2022-02-02T18:23:47.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 -- 172.21.15.96:0/1967047790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 msgr2=0x7ff6ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 --2- 172.21.15.96:0/1967047790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec0f59e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff6dc004660 tx=0x7ff6dc009b30).stop 2022-02-02T18:23:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 -- 172.21.15.96:0/1967047790 shutdown_connections 2022-02-02T18:23:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 --2- 172.21.15.96:0/1967047790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 0x7ff6ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 --2- 172.21.15.96:0/1967047790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec0f59e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 -- 172.21.15.96:0/1967047790 >> 172.21.15.96:0/1967047790 conn(0x7ff6ec0f0d40 msgr2=0x7ff6ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:47.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 -- 172.21.15.96:0/1967047790 shutdown_connections 2022-02-02T18:23:47.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.155+0000 7ff6f2607700 1 -- 172.21.15.96:0/1967047790 wait complete. 2022-02-02T18:23:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 Processor -- start 2022-02-02T18:23:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 -- start start 2022-02-02T18:23:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 0x7ff6ec10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0603c0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6f2607700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec060500 con 0x7ff6ec0f6860 2022-02-02T18:23:47.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53314/0 (socket says 172.21.15.96:53314) 2022-02-02T18:23:47.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.156+0000 7ff6ebfff700 1 -- 172.21.15.96:0/3869546984 learned_addr learned my addr 172.21.15.96:0/3869546984 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:47.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6e3fff700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 0x7ff6ec10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6ebfff700 1 -- 172.21.15.96:0/3869546984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 msgr2=0x7ff6ec10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6ebfff700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 0x7ff6ec10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6ebfff700 1 -- 172.21.15.96:0/3869546984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc005040 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6ebfff700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff6dc013a70 tx=0x7ff6dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6dc018070 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec10c6e0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6dc0097d0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6dc01de80 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.157+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec10cc10 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.158+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec045ad0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.159+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7ff6dc007ba0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.159+0000 7ff6e97fa700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 0x7ff6d8067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.159+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff6dc083630 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.159+0000 7ff6e3fff700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 0x7ff6d8067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.160+0000 7ff6e3fff700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 0x7ff6d8067300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff6d4004c40 tx=0x7ff6d400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.164+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff6dc0517a0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.400+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6ec0fde50 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.400+0000 7ff6e97fa700 1 -- 172.21.15.96:0/3869546984 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+703 (secure 0 0 0) 0x7ff6dc054dc0 con 0x7ff6ec0f55c0 2022-02-02T18:23:47.404 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:23:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:23:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:23:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:23:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:23:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:23:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:23:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:23:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:23:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:23:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:23:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2022-02-02T18:23:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 4 2022-02-02T18:23:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:23:47.407 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:23:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 msgr2=0x7ff6d8067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 0x7ff6d8067300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff6d4004c40 tx=0x7ff6d400b040).stop 2022-02-02T18:23:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 msgr2=0x7ff6ec109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff6dc013a70 tx=0x7ff6dc009b30).stop 2022-02-02T18:23:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 shutdown_connections 2022-02-02T18:23:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d8064e40 0x7ff6d8067300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6ec0f55c0 0x7ff6ec109c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 --2- 172.21.15.96:0/3869546984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6ec0f6860 0x7ff6ec10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 >> 172.21.15.96:0/3869546984 conn(0x7ff6ec0f0d40 msgr2=0x7ff6ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 shutdown_connections 2022-02-02T18:23:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.402+0000 7ff6f2607700 1 -- 172.21.15.96:0/3869546984 wait complete. 2022-02-02T18:23:47.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 -- 172.21.15.96:0/2305011341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 msgr2=0x7f52180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 --2- 172.21.15.96:0/2305011341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f52180f7de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5208004660 tx=0x7f5208009b30).stop 2022-02-02T18:23:47.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 -- 172.21.15.96:0/2305011341 shutdown_connections 2022-02-02T18:23:47.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 --2- 172.21.15.96:0/2305011341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f52180f7de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 --2- 172.21.15.96:0/2305011341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f52180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.500+0000 7f521e0cf700 1 -- 172.21.15.96:0/2305011341 >> 172.21.15.96:0/2305011341 conn(0x7f52180f1e40 msgr2=0x7f52180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:47.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.501+0000 7f521e0cf700 1 -- 172.21.15.96:0/2305011341 shutdown_connections 2022-02-02T18:23:47.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.501+0000 7f521e0cf700 1 -- 172.21.15.96:0/2305011341 wait complete. 2022-02-02T18:23:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.501+0000 7f521e0cf700 1 Processor -- start 2022-02-02T18:23:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.501+0000 7f521e0cf700 1 -- start start 2022-02-02T18:23:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.501+0000 7f521e0cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f521806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f521e0cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f521e0cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521806a380 con 0x7f52180f7980 2022-02-02T18:23:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f521e0cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521806a4c0 con 0x7f52180f66e0 2022-02-02T18:23:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f52177fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f521806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53328/0 (socket says 172.21.15.96:53328) 2022-02-02T18:23:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 -- 172.21.15.96:0/1005666504 learned_addr learned my addr 172.21.15.96:0/1005666504 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:23:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 -- 172.21.15.96:0/1005666504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 msgr2=0x7f521806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f521806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 -- 172.21.15.96:0/1005666504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208005040 con 0x7f52180f7980 2022-02-02T18:23:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f52177fe700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f521806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:23:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f5216ffd700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5208000c00 tx=0x7f520800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5208019070 con 0x7f52180f7980 2022-02-02T18:23:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521806a740 con 0x7f52180f7980 2022-02-02T18:23:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5208007e70 con 0x7f52180f7980 2022-02-02T18:23:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.502+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5208014ce0 con 0x7f52180f7980 2022-02-02T18:23:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.503+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521806aca0 con 0x7f52180f7980 2022-02-02T18:23:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.504+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5218045ad0 con 0x7f52180f7980 2022-02-02T18:23:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.504+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f5208025070 con 0x7f52180f7980 2022-02-02T18:23:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.505+0000 7f520ffff700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 0x7f5204067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:23:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.505+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f52080829c0 con 0x7f52180f7980 2022-02-02T18:23:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.505+0000 7f52177fe700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 0x7f5204067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:23:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.505+0000 7f52177fe700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 0x7f5204067300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f521806b730 tx=0x7f520000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:23:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.509+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5208050b30 con 0x7f52180f7980 2022-02-02T18:23:47.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.727+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5218027a00 con 0x7f52180f7980 2022-02-02T18:23:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.728+0000 7f520ffff700 1 -- 172.21.15.96:0/1005666504 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f5208023070 con 0x7f52180f7980 2022-02-02T18:23:47.733 INFO:teuthology.orchestra.run.smithi096.stdout:e37 2022-02-02T18:23:47.733 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:23:47.734 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:47.734 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:23:47.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:47.735 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:23:47.735 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:23:47.736 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 37 2022-02-02T18:23:47.736 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:23:47.737 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:23:47.737 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:23:43.083542+0000 2022-02-02T18:23:47.737 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:23:47.738 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:23:47.738 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:23:47.739 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:23:47.739 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:23:47.740 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:23:47.740 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:23:47.740 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 51 2022-02-02T18:23:47.741 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:23:47.741 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:23:47.742 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:23:47.742 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24447,1=24273} 2022-02-02T18:23:47.743 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2022-02-02T18:23:47.743 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:23:47.744 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:23:47.744 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:23:47.744 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:23:47.745 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:23:47.745 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:23:47.746 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:23:47.746 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{0:24447} state up:rejoin seq 19 join_fscid=1 addr [v2:172.21.15.96:6826/3075106779,v1:172.21.15.96:6827/3075106779] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:47.747 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:47.747 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:23:47.747 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:47.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:47.748 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:23:47.749 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:23:47.749 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:23:47.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 msgr2=0x7f5204067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 0x7f5204067300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f521806b730 tx=0x7f520000b040).stop 2022-02-02T18:23:47.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 msgr2=0x7f5218069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:23:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5208000c00 tx=0x7f520800b040).stop 2022-02-02T18:23:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 shutdown_connections 2022-02-02T18:23:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5204064e40 0x7f5204067300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52180f66e0 0x7f521806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 --2- 172.21.15.96:0/1005666504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52180f7980 0x7f5218069e20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:23:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 >> 172.21.15.96:0/1005666504 conn(0x7f52180f1e40 msgr2=0x7f52180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:23:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 shutdown_connections 2022-02-02T18:23:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:23:47.730+0000 7f521e0cf700 1 -- 172.21.15.96:0/1005666504 wait complete. 2022-02-02T18:23:47.754 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 37 2022-02-02T18:23:48.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:48.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: pgmap v14: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2022-02-02T18:23:48.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:48.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3869546984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:48.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:48.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:48.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:48.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:48.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:48.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1005666504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:23:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: pgmap v14: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2022-02-02T18:23:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:23:48.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3869546984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:23:48.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:48.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:48.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:23:48.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:23:48.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:48.533 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1005666504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:23:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: pgmap v15: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2022-02-02T18:23:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: Reconfiguring mon.smithi096 (monmap changed)... 2022-02-02T18:23:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: Reconfiguring daemon mon.smithi096 on smithi096 2022-02-02T18:23:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T18:23:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:23:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:23:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: pgmap v15: 65 pgs: 65 active+clean; 740 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2022-02-02T18:23:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: Reconfiguring mon.smithi096 (monmap changed)... 2022-02-02T18:23:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: Reconfiguring daemon mon.smithi096 on smithi096 2022-02-02T18:23:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T18:23:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.shfutl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:23:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:23:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:50 smithi159 ceph-mon[69013]: Reconfiguring mgr.smithi096.shfutl (monmap changed)... 2022-02-02T18:23:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:50 smithi159 ceph-mon[69013]: Reconfiguring daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:23:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:50 smithi096 ceph-mon[101353]: Reconfiguring mgr.smithi096.shfutl (monmap changed)... 2022-02-02T18:23:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:50 smithi096 ceph-mon[101353]: Reconfiguring daemon mgr.smithi096.shfutl on smithi096 2022-02-02T18:23:51.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: pgmap v16: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 55 KiB/s wr, 5 op/s 2022-02-02T18:23:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: Reconfiguring crash.smithi096 (monmap changed)... 2022-02-02T18:23:51.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:23:51.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:51.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:51 smithi096 ceph-mon[101353]: Reconfiguring daemon crash.smithi096 on smithi096 2022-02-02T18:23:51.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: pgmap v16: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 55 KiB/s wr, 5 op/s 2022-02-02T18:23:51.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:51.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: Reconfiguring crash.smithi096 (monmap changed)... 2022-02-02T18:23:51.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:23:51.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:51.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:51 smithi159 ceph-mon[69013]: Reconfiguring daemon crash.smithi096 on smithi096 2022-02-02T18:23:52.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:52 smithi096 ceph-mon[101353]: pgmap v17: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 54 KiB/s wr, 5 op/s 2022-02-02T18:23:52.671 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:52.671 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:52 smithi096 ceph-mon[101353]: Reconfiguring osd.0 (monmap changed)... 2022-02-02T18:23:52.671 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:52 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.0 on smithi096 2022-02-02T18:23:53.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:52 smithi159 ceph-mon[69013]: pgmap v17: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 54 KiB/s wr, 5 op/s 2022-02-02T18:23:53.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:53.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:52 smithi159 ceph-mon[69013]: Reconfiguring osd.0 (monmap changed)... 2022-02-02T18:23:53.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:52 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.0 on smithi096 2022-02-02T18:23:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:53 smithi159 ceph-mon[69013]: Reconfiguring osd.1 (monmap changed)... 2022-02-02T18:23:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:53 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.1 on smithi096 2022-02-02T18:23:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:53 smithi096 ceph-mon[101353]: Reconfiguring osd.1 (monmap changed)... 2022-02-02T18:23:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:53 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.1 on smithi096 2022-02-02T18:23:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:54 smithi159 ceph-mon[69013]: pgmap v18: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 58 KiB/s wr, 8 op/s 2022-02-02T18:23:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:54 smithi159 ceph-mon[69013]: daemon mds.cephfs.smithi096.pitrsc restarted 2022-02-02T18:23:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:54 smithi159 ceph-mon[69013]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T18:23:55.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:54 smithi096 ceph-mon[101353]: pgmap v18: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 58 KiB/s wr, 8 op/s 2022-02-02T18:23:55.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:55.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:54 smithi096 ceph-mon[101353]: daemon mds.cephfs.smithi096.pitrsc restarted 2022-02-02T18:23:55.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:54 smithi096 ceph-mon[101353]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T18:23:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: Reconfiguring osd.2 (monmap changed)... 2022-02-02T18:23:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.2 on smithi096 2022-02-02T18:23:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2022-02-02T18:23:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: mds.? [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] up:boot 2022-02-02T18:23:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:23:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:23:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:23:56.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: Reconfiguring osd.2 (monmap changed)... 2022-02-02T18:23:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.2 on smithi096 2022-02-02T18:23:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2022-02-02T18:23:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: mds.? [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] up:boot 2022-02-02T18:23:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:23:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pitrsc"}]: dispatch 2022-02-02T18:23:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pitrsc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:23:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:57.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:57 smithi096 ceph-mon[101353]: pgmap v20: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 70 KiB/s wr, 7 op/s 2022-02-02T18:23:57.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:57 smithi096 ceph-mon[101353]: Reconfiguring mds.cephfs.smithi096.pitrsc (monmap changed)... 2022-02-02T18:23:57.336 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:57 smithi096 ceph-mon[101353]: Reconfiguring daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:23:57.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:57 smithi159 ceph-mon[69013]: pgmap v20: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 70 KiB/s wr, 7 op/s 2022-02-02T18:23:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:57 smithi159 ceph-mon[69013]: Reconfiguring mds.cephfs.smithi096.pitrsc (monmap changed)... 2022-02-02T18:23:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:57 smithi159 ceph-mon[69013]: Reconfiguring daemon mds.cephfs.smithi096.pitrsc on smithi096 2022-02-02T18:23:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:58.361 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:58.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:58 smithi096 ceph-mon[101353]: Reconfiguring mds.cephfs.smithi096.ghwylx (monmap changed)... 2022-02-02T18:23:58.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:23:58.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:58.362 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:58 smithi096 ceph-mon[101353]: Reconfiguring daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:23:58.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:58.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:58 smithi159 ceph-mon[69013]: Reconfiguring mds.cephfs.smithi096.ghwylx (monmap changed)... 2022-02-02T18:23:58.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.ghwylx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:23:58.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:58.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:58 smithi159 ceph-mon[69013]: Reconfiguring daemon mds.cephfs.smithi096.ghwylx on smithi096 2022-02-02T18:23:59.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:59 smithi159 ceph-mon[69013]: pgmap v21: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 61 KiB/s wr, 6 op/s 2022-02-02T18:23:59.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:59.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:23:59.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:23:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:23:59.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:59 smithi096 ceph-mon[101353]: pgmap v21: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 61 KiB/s wr, 6 op/s 2022-02-02T18:23:59.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:23:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:23:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:23:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: Reconfiguring crash.smithi159 (monmap changed)... 2022-02-02T18:24:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: Reconfiguring daemon crash.smithi159 on smithi159 2022-02-02T18:24:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:24:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:24:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:00.612 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: Reconfiguring crash.smithi159 (monmap changed)... 2022-02-02T18:24:00.612 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: Reconfiguring daemon crash.smithi159 on smithi159 2022-02-02T18:24:00.612 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:00.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.jrxkfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T18:24:00.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T18:24:00.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:01.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: pgmap v22: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2022-02-02T18:24:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: Reconfiguring mgr.smithi159.jrxkfz (monmap changed)... 2022-02-02T18:24:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: Reconfiguring daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:24:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:01.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:24:01.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:24:01.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:01.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: pgmap v22: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2022-02-02T18:24:01.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: Reconfiguring mgr.smithi159.jrxkfz (monmap changed)... 2022-02-02T18:24:01.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: Reconfiguring daemon mgr.smithi159.jrxkfz on smithi159 2022-02-02T18:24:01.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:01.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T18:24:01.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T18:24:01.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:02 smithi159 ceph-mon[69013]: Reconfiguring mon.smithi159 (monmap changed)... 2022-02-02T18:24:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:02 smithi159 ceph-mon[69013]: Reconfiguring daemon mon.smithi159 on smithi159 2022-02-02T18:24:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:02 smithi096 ceph-mon[101353]: Reconfiguring mon.smithi159 (monmap changed)... 2022-02-02T18:24:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:02 smithi096 ceph-mon[101353]: Reconfiguring daemon mon.smithi159 on smithi159 2022-02-02T18:24:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:03 smithi096 ceph-mon[101353]: pgmap v23: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2022-02-02T18:24:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:03 smithi096 ceph-mon[101353]: Reconfiguring osd.3 (monmap changed)... 2022-02-02T18:24:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:03 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.3 on smithi159 2022-02-02T18:24:03.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:03 smithi159 ceph-mon[69013]: pgmap v23: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2022-02-02T18:24:03.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:03.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:03 smithi159 ceph-mon[69013]: Reconfiguring osd.3 (monmap changed)... 2022-02-02T18:24:03.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:03 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.3 on smithi159 2022-02-02T18:24:04.636 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:04.637 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:04 smithi159 ceph-mon[69013]: Reconfiguring osd.4 (monmap changed)... 2022-02-02T18:24:04.637 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:04 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.4 on smithi159 2022-02-02T18:24:04.637 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:04 smithi159 ceph-mon[69013]: pgmap v24: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2022-02-02T18:24:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:04 smithi096 ceph-mon[101353]: Reconfiguring osd.4 (monmap changed)... 2022-02-02T18:24:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:04 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.4 on smithi159 2022-02-02T18:24:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:04 smithi096 ceph-mon[101353]: pgmap v24: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2022-02-02T18:24:05.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:05 smithi159 ceph-mon[69013]: Reconfiguring osd.5 (monmap changed)... 2022-02-02T18:24:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:05 smithi159 ceph-mon[69013]: Reconfiguring daemon osd.5 on smithi159 2022-02-02T18:24:06.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:06.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:05 smithi096 ceph-mon[101353]: Reconfiguring osd.5 (monmap changed)... 2022-02-02T18:24:06.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:05 smithi096 ceph-mon[101353]: Reconfiguring daemon osd.5 on smithi159 2022-02-02T18:24:07.001 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: pgmap v25: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2022-02-02T18:24:07.001 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:07.001 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: Reconfiguring mds.cephfs.smithi159.shbucd (monmap changed)... 2022-02-02T18:24:07.001 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:24:07.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:07.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:06 smithi159 ceph-mon[69013]: Reconfiguring daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:24:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: pgmap v25: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2022-02-02T18:24:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: Reconfiguring mds.cephfs.smithi159.shbucd (monmap changed)... 2022-02-02T18:24:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.shbucd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:24:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:06 smithi096 ceph-mon[101353]: Reconfiguring daemon mds.cephfs.smithi159.shbucd on smithi159 2022-02-02T18:24:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:07 smithi159 ceph-mon[69013]: Reconfiguring mds.cephfs.smithi159.omlhix (monmap changed)... 2022-02-02T18:24:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:24:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:08.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:07 smithi159 ceph-mon[69013]: Reconfiguring daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:24:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:07 smithi096 ceph-mon[101353]: Reconfiguring mds.cephfs.smithi159.omlhix (monmap changed)... 2022-02-02T18:24:08.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.omlhix", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T18:24:08.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:08.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:07 smithi096 ceph-mon[101353]: Reconfiguring daemon mds.cephfs.smithi159.omlhix on smithi159 2022-02-02T18:24:09.488 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: pgmap v26: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 3 op/s 2022-02-02T18:24:09.488 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:09.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:09.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:09.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:09.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: Upgrade: Setting container_image for all mon 2022-02-02T18:24:09.490 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:09.490 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]: dispatch 2022-02-02T18:24:09.490 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]': finished 2022-02-02T18:24:09.490 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2022-02-02T18:24:09.491 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2022-02-02T18:24:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: pgmap v26: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 3 op/s 2022-02-02T18:24:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: Upgrade: Setting container_image for all mon 2022-02-02T18:24:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]: dispatch 2022-02-02T18:24:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]': finished 2022-02-02T18:24:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2022-02-02T18:24:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2022-02-02T18:24:10.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: Upgrade: Updating crash.smithi096 (1/2) 2022-02-02T18:24:10.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:10.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:24:10.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:10.693 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: Deploying daemon crash.smithi096 on smithi096 2022-02-02T18:24:10.693 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:10 smithi096 ceph-mon[101353]: pgmap v27: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 3 op/s 2022-02-02T18:24:11.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: Upgrade: Updating crash.smithi096 (1/2) 2022-02-02T18:24:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:24:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: Deploying daemon crash.smithi096 on smithi096 2022-02-02T18:24:11.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:10 smithi159 ceph-mon[69013]: pgmap v27: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 3 op/s 2022-02-02T18:24:13.002 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:12 smithi096 ceph-mon[101353]: pgmap v28: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 2 op/s 2022-02-02T18:24:13.003 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:13.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:12 smithi159 ceph-mon[69013]: pgmap v28: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 2 op/s 2022-02-02T18:24:13.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:13.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: from='client.34150 -' entity='client.crash.smithi096' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:13.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:13.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: pgmap v29: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2022-02-02T18:24:13.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: from='client.34154 -' entity='client.crash.smithi096' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:13.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:13.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:13 smithi159 ceph-mon[69013]: pgmap v30: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 764 B/s wr, 2 op/s 2022-02-02T18:24:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: from='client.34150 -' entity='client.crash.smithi096' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: pgmap v29: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2022-02-02T18:24:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: from='client.34154 -' entity='client.crash.smithi096' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:14.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:13 smithi096 ceph-mon[101353]: pgmap v30: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 764 B/s wr, 2 op/s 2022-02-02T18:24:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: Health check failed: 2 daemons have recently crashed (RECENT_CRASH) 2022-02-02T18:24:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: Upgrade: Updating crash.smithi159 (2/2) 2022-02-02T18:24:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:24:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:14.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:14 smithi159 ceph-mon[69013]: Deploying daemon crash.smithi159 on smithi159 2022-02-02T18:24:15.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: Health check failed: 2 daemons have recently crashed (RECENT_CRASH) 2022-02-02T18:24:15.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: Upgrade: Updating crash.smithi159 (2/2) 2022-02-02T18:24:15.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:15.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T18:24:15.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:15.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:14 smithi096 ceph-mon[101353]: Deploying daemon crash.smithi159 on smithi159 2022-02-02T18:24:16.130 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:16 smithi159 ceph-mon[69013]: pgmap v31: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 764 B/s wr, 2 op/s 2022-02-02T18:24:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:16 smithi096 ceph-mon[101353]: pgmap v31: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 764 B/s wr, 2 op/s 2022-02-02T18:24:17.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:17.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:17.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:17.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:24:17.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:24:17.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='client.44123 -' entity='client.crash.smithi159' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:17.845 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:17.846 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:17 smithi096 ceph-mon[101353]: pgmap v32: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- 172.21.15.96:0/146793656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 msgr2=0x7f19080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 --2- 172.21.15.96:0/146793656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f19080f59e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f18f8004660 tx=0x7f18f8009b30).stop 2022-02-02T18:24:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- 172.21.15.96:0/146793656 shutdown_connections 2022-02-02T18:24:17.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 --2- 172.21.15.96:0/146793656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 0x7f19080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:17.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 --2- 172.21.15.96:0/146793656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f19080f59e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:17.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- 172.21.15.96:0/146793656 >> 172.21.15.96:0/146793656 conn(0x7f19080f0d40 msgr2=0x7f19080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:17.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- 172.21.15.96:0/146793656 shutdown_connections 2022-02-02T18:24:17.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- 172.21.15.96:0/146793656 wait complete. 2022-02-02T18:24:17.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 Processor -- start 2022-02-02T18:24:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.839+0000 7f190ca2a700 1 -- start start 2022-02-02T18:24:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:17.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 0x7f1908107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:17.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908107a40 con 0x7f19080f55c0 2022-02-02T18:24:17.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908107b80 con 0x7f19080f6860 2022-02-02T18:24:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53376/0 (socket says 172.21.15.96:53376) 2022-02-02T18:24:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 -- 172.21.15.96:0/4107956084 learned_addr learned my addr 172.21.15.96:0/4107956084 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f1905d9b700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 0x7f1908107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 -- 172.21.15.96:0/4107956084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 msgr2=0x7f1908107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 0x7f1908107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 -- 172.21.15.96:0/4107956084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8005040 con 0x7f19080f55c0 2022-02-02T18:24:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190659c700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f18f8004f60 tx=0x7f18f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f8018070 con 0x7f19080f55c0 2022-02-02T18:24:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19081084c0 con 0x7f19080f55c0 2022-02-02T18:24:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18f8009770 con 0x7f19080f55c0 2022-02-02T18:24:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f801c3c0 con 0x7f19080f55c0 2022-02-02T18:24:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.840+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1908108a20 con 0x7f19080f55c0 2022-02-02T18:24:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.841+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908045ad0 con 0x7f19080f55c0 2022-02-02T18:24:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.842+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f18f801c680 con 0x7f19080f55c0 2022-02-02T18:24:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.842+0000 7f18f6ffd700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 0x7f18f0067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.842+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f18f80838e0 con 0x7f19080f55c0 2022-02-02T18:24:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.842+0000 7f1905d9b700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 0x7f18f0067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.843+0000 7f1905d9b700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 0x7f18f0067300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f18fc007fd0 tx=0x7f18fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:17.846+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18f8055500 con 0x7f19080f55c0 2022-02-02T18:24:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:18.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:18.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:24:18.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:24:18.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='client.44123 -' entity='client.crash.smithi159' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:18.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:18.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:17 smithi159 ceph-mon[69013]: pgmap v32: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.048+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19081091d0 con 0x7f18f0064e40 2022-02-02T18:24:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.049+0000 7f18f6ffd700 1 -- 172.21.15.96:0/4107956084 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+305 (secure 0 0 0) 0x7f19081091d0 con 0x7f18f0064e40 2022-02-02T18:24:18.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.051+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 msgr2=0x7f18f0067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.051+0000 7f190ca2a700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 0x7f18f0067300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f18fc007fd0 tx=0x7f18fc009040).stop 2022-02-02T18:24:18.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.051+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 msgr2=0x7f1908106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.051+0000 7f190ca2a700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f18f8004f60 tx=0x7f18f8009b30).stop 2022-02-02T18:24:18.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 shutdown_connections 2022-02-02T18:24:18.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18f0064e40 0x7f18f0067300 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080f55c0 0x7f1908106fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 --2- 172.21.15.96:0/4107956084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080f6860 0x7f1908107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 >> 172.21.15.96:0/4107956084 conn(0x7f19080f0d40 msgr2=0x7f190805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 shutdown_connections 2022-02-02T18:24:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.052+0000 7f190ca2a700 1 -- 172.21.15.96:0/4107956084 wait complete. 2022-02-02T18:24:18.065 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:24:18.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 -- 172.21.15.96:0/865614733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 msgr2=0x7fc49c069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/865614733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c069e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc48c004660 tx=0x7fc48c009b30).stop 2022-02-02T18:24:18.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 -- 172.21.15.96:0/865614733 shutdown_connections 2022-02-02T18:24:18.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/865614733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/865614733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c069e60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 -- 172.21.15.96:0/865614733 >> 172.21.15.96:0/865614733 conn(0x7fc49c0f1e40 msgr2=0x7fc49c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 -- 172.21.15.96:0/865614733 shutdown_connections 2022-02-02T18:24:18.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.151+0000 7fc4a0c07700 1 -- 172.21.15.96:0/865614733 wait complete. 2022-02-02T18:24:18.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 Processor -- start 2022-02-02T18:24:18.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 -- start start 2022-02-02T18:24:18.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c1090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c109b70 con 0x7fc49c06b960 2022-02-02T18:24:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc4a0c07700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c109cb0 con 0x7fc49c06a350 2022-02-02T18:24:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.152+0000 7fc499d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc499d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53388/0 (socket says 172.21.15.96:53388) 2022-02-02T18:24:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc499d9b700 1 -- 172.21.15.96:0/3107851337 learned_addr learned my addr 172.21.15.96:0/3107851337 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc49a59c700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c1090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc49a59c700 1 -- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 msgr2=0x7fc49c1095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc49a59c700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc49a59c700 1 -- 172.21.15.96:0/3107851337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c005040 con 0x7fc49c06a350 2022-02-02T18:24:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc499d9b700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:24:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc49a59c700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c1090d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc48c011000 tx=0x7fc48c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c019070 con 0x7fc49c06a350 2022-02-02T18:24:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c10a5f0 con 0x7fc49c06a350 2022-02-02T18:24:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c10ab50 con 0x7fc49c06a350 2022-02-02T18:24:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc48c007e70 con 0x7fc49c06a350 2022-02-02T18:24:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.153+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c014c70 con 0x7fc49c06a350 2022-02-02T18:24:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.154+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c045ad0 con 0x7fc49c06a350 2022-02-02T18:24:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.155+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fc48c025070 con 0x7fc49c06a350 2022-02-02T18:24:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.155+0000 7fc48affd700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 0x7fc484067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.155+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc48c082900 con 0x7fc49c06a350 2022-02-02T18:24:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.155+0000 7fc499d9b700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 0x7fc484067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.156+0000 7fc499d9b700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 0x7fc484067300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc490007a30 tx=0x7fc49000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.159+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc48c054520 con 0x7fc49c06a350 2022-02-02T18:24:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.345+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc49c101210 con 0x7fc484064e40 2022-02-02T18:24:18.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.354+0000 7fc48affd700 1 -- 172.21.15.96:0/3107851337 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fc49c101210 con 0x7fc484064e40 2022-02-02T18:24:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:24:18.360 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (7m) 44s ago 8m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:24:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 starting - - - - 2022-02-02T18:24:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 starting - - - - 2022-02-02T18:24:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 44s ago 8m 40.1M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:24:18.362 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4m) 44s ago 4m 654M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:24:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (101s) 44s ago 4m 418M - 16.2.4 8d91d370c2b8 c2f4dbaa5b91 2022-02-02T18:24:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4m) 35s ago 4m 5331M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:24:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (39s) 35s ago 4m 12.1M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:24:18.363 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (116s) 44s ago 9m 442M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:24:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (87s) 35s ago 8m 415M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:24:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (58s) 44s ago 9m 58.0M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:24:18.364 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (39s) 35s ago 8m 23.8M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:24:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (8m) 44s ago 8m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:24:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 35s ago 8m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:24:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (7m) 44s ago 7m 845M 4096M 16.2.4 8d91d370c2b8 a7c22d549973 2022-02-02T18:24:18.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (7m) 44s ago 7m 898M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:24:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 44s ago 6m 708M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:24:18.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (6m) 35s ago 6m 937M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:24:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (6m) 35s ago 6m 795M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:24:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (6m) 35s ago 6m 865M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:24:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (7m) 44s ago 8m 47.3M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:24:18.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 msgr2=0x7fc484067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 0x7fc484067300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc490007a30 tx=0x7fc49000b040).stop 2022-02-02T18:24:18.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 msgr2=0x7fc49c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c1090d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc48c011000 tx=0x7fc48c00b040).stop 2022-02-02T18:24:18.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 shutdown_connections 2022-02-02T18:24:18.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc484064e40 0x7fc484067300 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc49c06a350 0x7fc49c1090d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 --2- 172.21.15.96:0/3107851337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc49c06b960 0x7fc49c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 >> 172.21.15.96:0/3107851337 conn(0x7fc49c0f1e40 msgr2=0x7fc49c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 shutdown_connections 2022-02-02T18:24:18.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.356+0000 7fc4a0c07700 1 -- 172.21.15.96:0/3107851337 wait complete. 2022-02-02T18:24:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 -- 172.21.15.96:0/2594527287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 msgr2=0x7f9f600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/2594527287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f6cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9f54004660 tx=0x7f9f54009b30).stop 2022-02-02T18:24:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 -- 172.21.15.96:0/2594527287 shutdown_connections 2022-02-02T18:24:18.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/2594527287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f6cc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/2594527287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 0x7f9f600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 -- 172.21.15.96:0/2594527287 >> 172.21.15.96:0/2594527287 conn(0x7f9f600f0d40 msgr2=0x7f9f600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 -- 172.21.15.96:0/2594527287 shutdown_connections 2022-02-02T18:24:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.457+0000 7f9f65dbc700 1 -- 172.21.15.96:0/2594527287 wait complete. 2022-02-02T18:24:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 Processor -- start 2022-02-02T18:24:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 -- start start 2022-02-02T18:24:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 0x7f9f600f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600f8100 con 0x7f9f600f6860 2022-02-02T18:24:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f65dbc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600f8240 con 0x7f9f600f55c0 2022-02-02T18:24:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53396/0 (socket says 172.21.15.96:53396) 2022-02-02T18:24:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f5effd700 1 -- 172.21.15.96:0/126628387 learned_addr learned my addr 172.21.15.96:0/126628387 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.458+0000 7f9f5f7fe700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 0x7f9f600f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f5effd700 1 -- 172.21.15.96:0/126628387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 msgr2=0x7f9f600f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f5effd700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 0x7f9f600f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f5effd700 1 -- 172.21.15.96:0/126628387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54005040 con 0x7f9f600f6860 2022-02-02T18:24:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f5effd700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9f54009990 tx=0x7f9f54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f54018070 con 0x7f9f600f6860 2022-02-02T18:24:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f54007ba0 con 0x7f9f600f6860 2022-02-02T18:24:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f600f84c0 con 0x7f9f600f6860 2022-02-02T18:24:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5401c3c0 con 0x7f9f600f6860 2022-02-02T18:24:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.459+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f600f8a20 con 0x7f9f600f6860 2022-02-02T18:24:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f9f5401c630 con 0x7f9f600f6860 2022-02-02T18:24:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60045ad0 con 0x7f9f600f6860 2022-02-02T18:24:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f47fff700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 0x7f9f48067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f54084580 con 0x7f9f600f6860 2022-02-02T18:24:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f5f7fe700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 0x7f9f48067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.461+0000 7f9f5f7fe700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 0x7f9f48067300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9f600f94b0 tx=0x7f9f5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.465+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f54052690 con 0x7f9f600f6860 2022-02-02T18:24:18.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.722+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f6010f660 con 0x7f9f600f6860 2022-02-02T18:24:18.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.722+0000 7f9f47fff700 1 -- 172.21.15.96:0/126628387 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+703 (secure 0 0 0) 0x7f9f54055cb0 con 0x7f9f600f6860 2022-02-02T18:24:18.725 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:24:18.725 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:24:18.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:24:18.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:18.726 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:24:18.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:24:18.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:18.727 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:24:18.727 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T18:24:18.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:18.728 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:24:18.728 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:24:18.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:18.728 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:24:18.728 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2022-02-02T18:24:18.729 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 4 2022-02-02T18:24:18.729 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:24:18.729 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:24:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 msgr2=0x7f9f48067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 0x7f9f48067300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9f600f94b0 tx=0x7f9f5000b040).stop 2022-02-02T18:24:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 msgr2=0x7f9f600f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9f54009990 tx=0x7f9f54009b30).stop 2022-02-02T18:24:18.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 shutdown_connections 2022-02-02T18:24:18.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f48064e40 0x7f9f48067300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f600f55c0 0x7f9f600f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 --2- 172.21.15.96:0/126628387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f600f6860 0x7f9f600f7ba0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 >> 172.21.15.96:0/126628387 conn(0x7f9f600f0d40 msgr2=0x7f9f6005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 shutdown_connections 2022-02-02T18:24:18.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.724+0000 7f9f65dbc700 1 -- 172.21.15.96:0/126628387 wait complete. 2022-02-02T18:24:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 -- 172.21.15.96:0/1230496388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 msgr2=0x7f58240fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 --2- 172.21.15.96:0/1230496388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f58240fb700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5820004660 tx=0x7f5820009b30).stop 2022-02-02T18:24:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 -- 172.21.15.96:0/1230496388 shutdown_connections 2022-02-02T18:24:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 --2- 172.21.15.96:0/1230496388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f58240fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 --2- 172.21.15.96:0/1230496388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f58240fb700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 -- 172.21.15.96:0/1230496388 >> 172.21.15.96:0/1230496388 conn(0x7f58240f0d40 msgr2=0x7f58240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 -- 172.21.15.96:0/1230496388 shutdown_connections 2022-02-02T18:24:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.825+0000 7f582b78b700 1 -- 172.21.15.96:0/1230496388 wait complete. 2022-02-02T18:24:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 Processor -- start 2022-02-02T18:24:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 -- start start 2022-02-02T18:24:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f5824109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824109bf0 con 0x7f58240602b0 2022-02-02T18:24:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f582b78b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824109d30 con 0x7f58240fbbf0 2022-02-02T18:24:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f5829527700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f5829527700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53406/0 (socket says 172.21.15.96:53406) 2022-02-02T18:24:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f5829527700 1 -- 172.21.15.96:0/2439734932 learned_addr learned my addr 172.21.15.96:0/2439734932 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.826+0000 7f5828d26700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f5824109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5829527700 1 -- 172.21.15.96:0/2439734932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 msgr2=0x7f5824109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5829527700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f5824109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5829527700 1 -- 172.21.15.96:0/2439734932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820005040 con 0x7f58240602b0 2022-02-02T18:24:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5828d26700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f5824109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:24:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5829527700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5820009990 tx=0x7f5820009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5820018070 con 0x7f58240602b0 2022-02-02T18:24:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5820007ba0 con 0x7f58240602b0 2022-02-02T18:24:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582410a670 con 0x7f58240602b0 2022-02-02T18:24:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582001c3c0 con 0x7f58240602b0 2022-02-02T18:24:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.827+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582410abd0 con 0x7f58240602b0 2022-02-02T18:24:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.828+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824045ad0 con 0x7f58240602b0 2022-02-02T18:24:18.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.829+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f582001d420 con 0x7f58240602b0 2022-02-02T18:24:18.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.829+0000 7f5819ffb700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 0x7f5810067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:18.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.829+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f58200836f0 con 0x7f58240602b0 2022-02-02T18:24:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.830+0000 7f5828d26700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 0x7f5810067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.830+0000 7f5828d26700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 0x7f5810067300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5824060080 tx=0x7f581400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:18.834+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5820055290 con 0x7f58240602b0 2022-02-02T18:24:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:18 smithi159 ceph-mon[69013]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:18 smithi159 ceph-mon[69013]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:19.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.052+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5824101170 con 0x7f58240602b0 2022-02-02T18:24:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:18 smithi096 ceph-mon[101353]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:18 smithi096 ceph-mon[101353]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:19.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.052+0000 7f5819ffb700 1 -- 172.21.15.96:0/2439734932 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f5820054e80 con 0x7f58240602b0 2022-02-02T18:24:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:e38 2022-02-02T18:24:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:24:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:24:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:24:19.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:24:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:24:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 38 2022-02-02T18:24:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:24:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:24:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:23:55.493666+0000 2022-02-02T18:24:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:24:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:24:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:24:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:24:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:24:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:24:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:24:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:24:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:24:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:24:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:24:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:24:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:24:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:24:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:24:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:24:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:24:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:24:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:24:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:24:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:24:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:24:19.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:19.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:19.065 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:24:19.066 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:19.066 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:24:19.066 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:24:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 msgr2=0x7f5810067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 0x7f5810067300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5824060080 tx=0x7f581400b040).stop 2022-02-02T18:24:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 msgr2=0x7f5824109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5820009990 tx=0x7f5820009b30).stop 2022-02-02T18:24:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 shutdown_connections 2022-02-02T18:24:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064e40 0x7f5810067300 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58240602b0 0x7f5824109150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 --2- 172.21.15.96:0/2439734932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58240fbbf0 0x7f5824109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 >> 172.21.15.96:0/2439734932 conn(0x7f58240f0d40 msgr2=0x7f58240f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:19.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 shutdown_connections 2022-02-02T18:24:19.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:19.055+0000 7f582b78b700 1 -- 172.21.15.96:0/2439734932 wait complete. 2022-02-02T18:24:19.070 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 38 2022-02-02T18:24:20.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:19 smithi159 ceph-mon[69013]: pgmap v33: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/126628387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2439734932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:24:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:19 smithi096 ceph-mon[101353]: pgmap v33: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/126628387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2439734932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:24:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:20 smithi159 ceph-mon[69013]: Health check update: 3 daemons have recently crashed (RECENT_CRASH) 2022-02-02T18:24:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:20 smithi096 ceph-mon[101353]: Health check update: 3 daemons have recently crashed (RECENT_CRASH) 2022-02-02T18:24:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:22 smithi159 ceph-mon[69013]: pgmap v34: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:22 smithi096 ceph-mon[101353]: pgmap v34: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 787 B/s wr, 2 op/s 2022-02-02T18:24:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:24 smithi096 ceph-mon[101353]: pgmap v35: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 715 B/s wr, 2 op/s 2022-02-02T18:24:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:24.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:24 smithi159 ceph-mon[69013]: pgmap v35: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 715 B/s wr, 2 op/s 2022-02-02T18:24:24.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:24.319 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:26.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:26.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:25 smithi159 ceph-mon[69013]: pgmap v36: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 785 B/s rd, 1 op/s 2022-02-02T18:24:26.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:26.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:25 smithi096 ceph-mon[101353]: pgmap v36: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 785 B/s rd, 1 op/s 2022-02-02T18:24:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: pgmap v37: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 785 B/s rd, 1 op/s 2022-02-02T18:24:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: Upgrade: Setting container_image for all crash 2022-02-02T18:24:28.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]: dispatch 2022-02-02T18:24:28.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]': finished 2022-02-02T18:24:28.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2022-02-02T18:24:28.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2022-02-02T18:24:28.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T18:24:28.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T18:24:28.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: Upgrade: osd.0 is safe to restart 2022-02-02T18:24:28.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:24:28.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:24:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: pgmap v37: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 785 B/s rd, 1 op/s 2022-02-02T18:24:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: Upgrade: Setting container_image for all crash 2022-02-02T18:24:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]: dispatch 2022-02-02T18:24:28.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]': finished 2022-02-02T18:24:28.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2022-02-02T18:24:28.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2022-02-02T18:24:28.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T18:24:28.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T18:24:28.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: Upgrade: osd.0 is safe to restart 2022-02-02T18:24:28.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:28.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:24:28.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:24:29.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:29 smithi096 ceph-mon[101353]: Upgrade: Updating osd.0 2022-02-02T18:24:29.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:29.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:29 smithi096 ceph-mon[101353]: Deploying daemon osd.0 on smithi096 2022-02-02T18:24:29.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:29 smithi159 ceph-mon[69013]: Upgrade: Updating osd.0 2022-02-02T18:24:29.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:29.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:29 smithi159 ceph-mon[69013]: Deploying daemon osd.0 on smithi096 2022-02-02T18:24:30.385 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:30 smithi096 ceph-mon[101353]: pgmap v38: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:24:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:30 smithi159 ceph-mon[69013]: pgmap v38: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:24:31.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:30 smithi096 systemd[1]: Stopping Ceph osd.0 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:24:31.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:30 smithi096 conmon[49697]: debug 2022-02-02T18:24:30.863+0000 7f32df9b2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:24:31.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:30 smithi096 conmon[49697]: debug 2022-02-02T18:24:30.863+0000 7f32df9b2700 -1 osd.0 52 *** Got signal Terminated *** 2022-02-02T18:24:31.058 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:30 smithi096 conmon[49697]: debug 2022-02-02T18:24:30.863+0000 7f32df9b2700 -1 osd.0 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:24:31.456 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.1 2022-02-02T18:24:31.456 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2022-02-02T18:24:31.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.2 2022-02-02T18:24:31.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.4 2022-02-02T18:24:31.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.3 2022-02-02T18:24:31.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.5 2022-02-02T18:24:31.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.1 2022-02-02T18:24:31.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.2 2022-02-02T18:24:31.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.4 2022-02-02T18:24:31.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.3 2022-02-02T18:24:31.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:31 smithi096 ceph-mon[101353]: osd.0 reported immediately failed by osd.5 2022-02-02T18:24:31.459 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:31 smithi096 bash[109513]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.0 2022-02-02T18:24:31.459 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:31 smithi096 bash[109513]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-0" found: no such container 2022-02-02T18:24:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.1 2022-02-02T18:24:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2022-02-02T18:24:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.2 2022-02-02T18:24:31.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.4 2022-02-02T18:24:31.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.3 2022-02-02T18:24:31.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.5 2022-02-02T18:24:31.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.1 2022-02-02T18:24:31.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.2 2022-02-02T18:24:31.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.4 2022-02-02T18:24:31.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.3 2022-02-02T18:24:31.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:31 smithi159 ceph-mon[69013]: osd.0 reported immediately failed by osd.5 2022-02-02T18:24:31.781 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:31 smithi096 bash[109513]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.0" found: no such container 2022-02-02T18:24:32.056 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:31 smithi096 podman[109838]: 2022-02-02T18:24:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:32 smithi159 ceph-mon[69013]: pgmap v39: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2022-02-02T18:24:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:32 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:24:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:32 smithi159 ceph-mon[69013]: osdmap e53: 6 total, 5 up, 6 in 2022-02-02T18:24:32.528 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:32 smithi096 ceph-mon[101353]: pgmap v39: 65 pgs: 65 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2022-02-02T18:24:32.528 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:32 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:24:32.529 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:32 smithi096 ceph-mon[101353]: osdmap e53: 6 total, 5 up, 6 in 2022-02-02T18:24:33.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:32 smithi096 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.0.service: Succeeded. 2022-02-02T18:24:33.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:32 smithi096 systemd[1]: Stopped Ceph osd.0 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:24:33.058 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:32 smithi096 systemd[1]: Starting Ceph osd.0 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:24:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:33 smithi159 ceph-mon[69013]: osdmap e54: 6 total, 5 up, 6 in 2022-02-02T18:24:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:33 smithi096 ceph-mon[101353]: osdmap e54: 6 total, 5 up, 6 in 2022-02-02T18:24:33.557 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 podman[110135]: 2022-02-02T18:24:34.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:24:34.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-02-02T18:24:34.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:24:34.058 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-02-02T18:24:34.058 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2022-02-02T18:24:34.058 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2022-02-02T18:24:34.059 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2022-02-02T18:24:34.059 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2022-02-02T18:24:34.059 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-02-02T18:24:34.059 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 bash[109982]: --> ceph-volume lvm activate successful for osd ID: 0 2022-02-02T18:24:34.060 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2022-02-02T18:24:34.060 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2022-02-02T18:24:34.060 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2022-02-02T18:24:34.060 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2022-02-02T18:24:34.060 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-02-02T18:24:34.061 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:33 smithi096 conmon[110175]: --> ceph-volume lvm activate successful for osd ID: 0 2022-02-02T18:24:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:34 smithi159 ceph-mon[69013]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:24:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:34 smithi096 ceph-mon[101353]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:24:34.557 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:34 smithi096 podman[110413]: 2022-02-02T18:24:35.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:34 smithi096 ceph-osd[110477]: -- 172.21.15.96:0/3283783440 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7bde68340 con 0x55a7bde2f000 2022-02-02T18:24:35.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:34 smithi096 bash[109982]: d0a408a5a7fa56bbb322c45f91868db8d309e047c41a387da9807907ff5df2bc 2022-02-02T18:24:35.057 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:34 smithi096 systemd[1]: Started Ceph osd.0 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:24:35.556 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:35 smithi096 conmon[110453]: 2022-02-02T18:24:35.150+0000 7f5146085240 -1 Falling back to public interface 2022-02-02T18:24:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: pgmap v43: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:36.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:24:36.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:24:36.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:35 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 4839/32682 objects degraded (14.806%), 33 pgs degraded (PG_DEGRADED) 2022-02-02T18:24:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: pgmap v43: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:24:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:24:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:24:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:35 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 4839/32682 objects degraded (14.806%), 33 pgs degraded (PG_DEGRADED) 2022-02-02T18:24:38.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:37 smithi159 ceph-mon[69013]: pgmap v44: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:37 smithi096 ceph-mon[101353]: pgmap v44: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:39 smithi159 ceph-mon[69013]: pgmap v45: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:40.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:39 smithi096 ceph-mon[101353]: pgmap v45: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:42 smithi096 ceph-mon[101353]: pgmap v46: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:42 smithi159 ceph-mon[69013]: pgmap v46: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:42.663 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:42 smithi096 conmon[110453]: 2022-02-02T18:24:42.385+0000 7f5146085240 -1 osd.0 52 log_to_monitors true 2022-02-02T18:24:43.328 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:43 smithi096 ceph-mon[101353]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T18:24:43.328 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 02 18:24:43 smithi096 conmon[110453]: 2022-02-02T18:24:43.079+0000 7f5137c21700 -1 osd.0 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:24:43.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:43 smithi159 ceph-mon[69013]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T18:24:44.447 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:44 smithi096 ceph-mon[101353]: pgmap v47: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:44.447 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:44 smithi096 ceph-mon[101353]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T18:24:44.448 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:44 smithi096 ceph-mon[101353]: osdmap e55: 6 total, 5 up, 6 in 2022-02-02T18:24:44.448 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:44 smithi096 ceph-mon[101353]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:24:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:44 smithi159 ceph-mon[69013]: pgmap v47: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:44 smithi159 ceph-mon[69013]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T18:24:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:44 smithi159 ceph-mon[69013]: osdmap e55: 6 total, 5 up, 6 in 2022-02-02T18:24:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:44 smithi159 ceph-mon[69013]: from='osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:24:45.104 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:24:45.104 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850] boot 2022-02-02T18:24:45.104 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: osdmap e56: 6 total, 6 up, 6 in 2022-02-02T18:24:45.105 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:24:45.105 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:45.105 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:45.105 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:45.105 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:24:45.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:45 smithi096 ceph-mon[101353]: osdmap e57: 6 total, 6 up, 6 in 2022-02-02T18:24:45.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:24:45.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: osd.0 [v2:172.21.15.96:6802/236715850,v1:172.21.15.96:6803/236715850] boot 2022-02-02T18:24:45.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: osdmap e56: 6 total, 6 up, 6 in 2022-02-02T18:24:45.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T18:24:45.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:45.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:45.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:24:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:24:45.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:45 smithi159 ceph-mon[69013]: osdmap e57: 6 total, 6 up, 6 in 2022-02-02T18:24:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:46 smithi159 ceph-mon[69013]: pgmap v50: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:46 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:24:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:46 smithi159 ceph-mon[69013]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2022-02-02T18:24:46.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:46 smithi096 ceph-mon[101353]: pgmap v50: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:46.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:46 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:24:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:46 smithi096 ceph-mon[101353]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2022-02-02T18:24:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:48 smithi159 ceph-mon[69013]: pgmap v52: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:48.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:48 smithi096 ceph-mon[101353]: pgmap v52: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4839/32682 objects degraded (14.806%) 2022-02-02T18:24:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 -- 172.21.15.96:0/3692652480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f66e0 msgr2=0x7f762c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 --2- 172.21.15.96:0/3692652480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f66e0 0x7f762c0f6b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7620004660 tx=0x7f7620009b30).stop 2022-02-02T18:24:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 -- 172.21.15.96:0/3692652480 shutdown_connections 2022-02-02T18:24:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 --2- 172.21.15.96:0/3692652480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f7980 0x7f762c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 --2- 172.21.15.96:0/3692652480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f66e0 0x7f762c0f6b00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 -- 172.21.15.96:0/3692652480 >> 172.21.15.96:0/3692652480 conn(0x7f762c0f1e40 msgr2=0x7f762c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 -- 172.21.15.96:0/3692652480 shutdown_connections 2022-02-02T18:24:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.168+0000 7f7632eac700 1 -- 172.21.15.96:0/3692652480 wait complete. 2022-02-02T18:24:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 Processor -- start 2022-02-02T18:24:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 -- start start 2022-02-02T18:24:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f66e0 0x7f762c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c06a380 con 0x7f762c0f7980 2022-02-02T18:24:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.169+0000 7f7632eac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c06a4c0 con 0x7f762c0f66e0 2022-02-02T18:24:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53492/0 (socket says 172.21.15.96:53492) 2022-02-02T18:24:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 -- 172.21.15.96:0/2944321549 learned_addr learned my addr 172.21.15.96:0/2944321549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f7630c48700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f66e0 0x7f762c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 -- 172.21.15.96:0/2944321549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f66e0 msgr2=0x7f762c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f66e0 0x7f762c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 -- 172.21.15.96:0/2944321549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620005040 con 0x7f762c0f7980 2022-02-02T18:24:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f762bfff700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f761800c530 tx=0x7f7618007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761800f650 con 0x7f762c0f7980 2022-02-02T18:24:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c06a7a0 con 0x7f762c0f7980 2022-02-02T18:24:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f761800fc60 con 0x7f762c0f7980 2022-02-02T18:24:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7618012c20 con 0x7f762c0f7980 2022-02-02T18:24:49.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.170+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c10efe0 con 0x7f762c0f7980 2022-02-02T18:24:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.171+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c045ad0 con 0x7f762c0f7980 2022-02-02T18:24:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.172+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f7618010070 con 0x7f762c0f7980 2022-02-02T18:24:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.172+0000 7f76297fa700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 0x7f761c067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.172+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f76180816f0 con 0x7f762c0f7980 2022-02-02T18:24:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.172+0000 7f7630c48700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 0x7f761c067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.173+0000 7f7630c48700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 0x7f761c067310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f762c06b730 tx=0x7f7620009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.177+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f761804f800 con 0x7f762c0f7980 2022-02-02T18:24:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.356+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f762c0fefb0 con 0x7f761c064e50 2022-02-02T18:24:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.357+0000 7f76297fa700 1 -- 172.21.15.96:0/2944321549 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f762c0fefb0 con 0x7f761c064e50 2022-02-02T18:24:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 msgr2=0x7f761c067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 0x7f761c067310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f762c06b730 tx=0x7f7620009b30).stop 2022-02-02T18:24:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 msgr2=0x7f762c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f761800c530 tx=0x7f7618007e20).stop 2022-02-02T18:24:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 shutdown_connections 2022-02-02T18:24:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f761c064e50 0x7f761c067310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f762c0f66e0 0x7f762c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 --2- 172.21.15.96:0/2944321549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f762c0f7980 0x7f762c069e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 >> 172.21.15.96:0/2944321549 conn(0x7f762c0f1e40 msgr2=0x7f762c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 shutdown_connections 2022-02-02T18:24:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.359+0000 7f7632eac700 1 -- 172.21.15.96:0/2944321549 wait complete. 2022-02-02T18:24:49.373 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:24:49.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 -- 172.21.15.96:0/2898897446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f66e0 msgr2=0x7fa1f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/2898897446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f66e0 0x7fa1f40f6b00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa1e4004660 tx=0x7fa1e4009b30).stop 2022-02-02T18:24:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 -- 172.21.15.96:0/2898897446 shutdown_connections 2022-02-02T18:24:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/2898897446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f7980 0x7fa1f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/2898897446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f66e0 0x7fa1f40f6b00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.458+0000 7fa1fa07d700 1 -- 172.21.15.96:0/2898897446 >> 172.21.15.96:0/2898897446 conn(0x7fa1f40f1e40 msgr2=0x7fa1f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:49.463 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:49 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4839/32682 objects degraded (14.806%), 33 pgs degraded) 2022-02-02T18:24:49.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 -- 172.21.15.96:0/2898897446 shutdown_connections 2022-02-02T18:24:49.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 -- 172.21.15.96:0/2898897446 wait complete. 2022-02-02T18:24:49.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 Processor -- start 2022-02-02T18:24:49.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 -- start start 2022-02-02T18:24:49.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f66e0 0x7fa1f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.459+0000 7fa1fa07d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1fa07d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406a380 con 0x7fa1f40f7980 2022-02-02T18:24:49.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1fa07d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406a4c0 con 0x7fa1f40f66e0 2022-02-02T18:24:49.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53502/0 (socket says 172.21.15.96:53502) 2022-02-02T18:24:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 -- 172.21.15.96:0/1395884947 learned_addr learned my addr 172.21.15.96:0/1395884947 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f37fe700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f66e0 0x7fa1f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 -- 172.21.15.96:0/1395884947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f66e0 msgr2=0x7fa1f406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f66e0 0x7fa1f406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 -- 172.21.15.96:0/1395884947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4005040 con 0x7fa1f40f7980 2022-02-02T18:24:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1f2ffd700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa1e80026d0 tx=0x7fa1e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e80079c0 con 0x7fa1f40f7980 2022-02-02T18:24:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa1e800f040 con 0x7fa1f40f7980 2022-02-02T18:24:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f406a7a0 con 0x7fa1f40f7980 2022-02-02T18:24:49.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e80148b0 con 0x7fa1f40f7980 2022-02-02T18:24:49.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.460+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f410efa0 con 0x7fa1f40f7980 2022-02-02T18:24:49.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.461+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4045ad0 con 0x7fa1f40f7980 2022-02-02T18:24:49.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.462+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fa1e8007b20 con 0x7fa1f40f7980 2022-02-02T18:24:49.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.462+0000 7fa1dbfff700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 0x7fa1dc067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.462+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa1e8081ae0 con 0x7fa1f40f7980 2022-02-02T18:24:49.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.462+0000 7fa1f37fe700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 0x7fa1dc067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.463+0000 7fa1f37fe700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 0x7fa1dc067360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa1e4013690 tx=0x7fa1e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.466+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa1e804fb30 con 0x7fa1f40f7980 2022-02-02T18:24:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:49 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4839/32682 objects degraded (14.806%), 33 pgs degraded) 2022-02-02T18:24:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.639+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1f40ff050 con 0x7fa1dc064ea0 2022-02-02T18:24:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.648+0000 7fa1dbfff700 1 -- 172.21.15.96:0/1395884947 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fa1e4019040 con 0x7fa1dc064ea0 2022-02-02T18:24:49.652 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:24:49.652 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (8m) 8s ago 9m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:24:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (37s) 8s ago 9m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:24:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (33s) 28s ago 8m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:24:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (8m) 8s ago 9m 40.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:24:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (5m) 8s ago 5m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:24:49.654 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (55s) 8s ago 5m 13.2M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:24:49.654 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (5m) 28s ago 5m 5337M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:24:49.654 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (70s) 28s ago 5m 13.5M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:24:49.654 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2m) 8s ago 10m 464M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:24:49.655 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (118s) 28s ago 8m 416M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:24:49.655 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (89s) 8s ago 10m 79.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:24:49.655 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (71s) 28s ago 8m 41.7M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:24:49.655 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (9m) 8s ago 9m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:24:49.656 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 28s ago 8m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:24:49.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (15s) 8s ago 8m 11.7M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:24:49.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (7m) 8s ago 7m 900M 4096M 16.2.4 8d91d370c2b8 3189b1924c50 2022-02-02T18:24:49.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (7m) 8s ago 7m 708M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:24:49.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (7m) 28s ago 7m 939M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:24:49.657 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (6m) 28s ago 6m 797M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:24:49.657 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (6m) 28s ago 6m 866M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:24:49.657 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (7m) 8s ago 8m 47.5M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:24:49.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 msgr2=0x7fa1dc067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 0x7fa1dc067360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa1e4013690 tx=0x7fa1e4009b30).stop 2022-02-02T18:24:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 msgr2=0x7fa1f4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa1e80026d0 tx=0x7fa1e8009de0).stop 2022-02-02T18:24:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 shutdown_connections 2022-02-02T18:24:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1dc064ea0 0x7fa1dc067360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f40f66e0 0x7fa1f406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 --2- 172.21.15.96:0/1395884947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1f40f7980 0x7fa1f4069e20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 >> 172.21.15.96:0/1395884947 conn(0x7fa1f40f1e40 msgr2=0x7fa1f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:49.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 shutdown_connections 2022-02-02T18:24:49.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.650+0000 7fa1fa07d700 1 -- 172.21.15.96:0/1395884947 wait complete. 2022-02-02T18:24:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 -- 172.21.15.96:0/1407860721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f7980 msgr2=0x7fb9180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 --2- 172.21.15.96:0/1407860721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f7980 0x7fb9180f7de0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb90c004660 tx=0x7fb90c009b30).stop 2022-02-02T18:24:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 -- 172.21.15.96:0/1407860721 shutdown_connections 2022-02-02T18:24:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 --2- 172.21.15.96:0/1407860721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f7980 0x7fb9180f7de0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 --2- 172.21.15.96:0/1407860721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f66e0 0x7fb9180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 -- 172.21.15.96:0/1407860721 >> 172.21.15.96:0/1407860721 conn(0x7fb9180f1e40 msgr2=0x7fb9180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 -- 172.21.15.96:0/1407860721 shutdown_connections 2022-02-02T18:24:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.747+0000 7fb91f431700 1 -- 172.21.15.96:0/1407860721 wait complete. 2022-02-02T18:24:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 Processor -- start 2022-02-02T18:24:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 -- start start 2022-02-02T18:24:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f7980 0x7fb918069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806a380 con 0x7fb9180f66e0 2022-02-02T18:24:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91f431700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806a4c0 con 0x7fb9180f7980 2022-02-02T18:24:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53510/0 (socket says 172.21.15.96:53510) 2022-02-02T18:24:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 -- 172.21.15.96:0/2450028798 learned_addr learned my addr 172.21.15.96:0/2450028798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91c9cc700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f7980 0x7fb918069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 -- 172.21.15.96:0/2450028798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f7980 msgr2=0x7fb918069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f7980 0x7fb918069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.748+0000 7fb91d1cd700 1 -- 172.21.15.96:0/2450028798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c005040 con 0x7fb9180f66e0 2022-02-02T18:24:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb91d1cd700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb90800d7f0 tx=0x7fb908004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90800f490 con 0x7fb9180f66e0 2022-02-02T18:24:49.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91806a7a0 con 0x7fb9180f66e0 2022-02-02T18:24:49.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb90800f040 con 0x7fb9180f66e0 2022-02-02T18:24:49.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9080139b0 con 0x7fb9180f66e0 2022-02-02T18:24:49.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.749+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91810ef90 con 0x7fb9180f66e0 2022-02-02T18:24:49.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.750+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fb90801a030 con 0x7fb9180f66e0 2022-02-02T18:24:49.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.750+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918045ad0 con 0x7fb9180f66e0 2022-02-02T18:24:49.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.751+0000 7fb915ffb700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 0x7fb900067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:49.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.751+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9080818b0 con 0x7fb9180f66e0 2022-02-02T18:24:49.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.751+0000 7fb91c9cc700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 0x7fb900067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:49.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.751+0000 7fb91c9cc700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 0x7fb900067300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb90c004630 tx=0x7fb90c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:49.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.755+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb90804ff80 con 0x7fb9180f66e0 2022-02-02T18:24:49.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.989+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9180fef70 con 0x7fb9180f66e0 2022-02-02T18:24:49.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.989+0000 7fb915ffb700 1 -- 172.21.15.96:0/2450028798 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+808 (secure 0 0 0) 0x7fb908053080 con 0x7fb9180f66e0 2022-02-02T18:24:49.993 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:24:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:24:49.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:24:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:24:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:24:49.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:24:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5, 2022-02-02T18:24:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 1 2022-02-02T18:24:49.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:24:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:24:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:24:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:24:49.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T18:24:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 5 2022-02-02T18:24:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:24:49.997 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:24:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 msgr2=0x7fb900067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 0x7fb900067300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb90c004630 tx=0x7fb90c009b30).stop 2022-02-02T18:24:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 msgr2=0x7fb91806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb90800d7f0 tx=0x7fb908004e80).stop 2022-02-02T18:24:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 shutdown_connections 2022-02-02T18:24:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb900064e40 0x7fb900067300 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9180f66e0 0x7fb91806b9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 --2- 172.21.15.96:0/2450028798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9180f7980 0x7fb918069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 >> 172.21.15.96:0/2450028798 conn(0x7fb9180f1e40 msgr2=0x7fb9180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 shutdown_connections 2022-02-02T18:24:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:49.992+0000 7fb91f431700 1 -- 172.21.15.96:0/2450028798 wait complete. 2022-02-02T18:24:50.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 -- 172.21.15.96:0/1781368737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 msgr2=0x7fa1780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:50.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 --2- 172.21.15.96:0/1781368737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa1780f6950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa168004660 tx=0x7fa168009b30).stop 2022-02-02T18:24:50.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 -- 172.21.15.96:0/1781368737 shutdown_connections 2022-02-02T18:24:50.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 --2- 172.21.15.96:0/1781368737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa1780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:24:50.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 --2- 172.21.15.96:0/1781368737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa1780f6950 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 -- 172.21.15.96:0/1781368737 >> 172.21.15.96:0/1781368737 conn(0x7fa1780f1c90 msgr2=0x7fa1780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:50.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 -- 172.21.15.96:0/1781368737 shutdown_connections 2022-02-02T18:24:50.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 -- 172.21.15.96:0/1781368737 wait complete. 2022-02-02T18:24:50.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.092+0000 7fa17cea0700 1 Processor -- start 2022-02-02T18:24:50.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa17cea0700 1 -- start start 2022-02-02T18:24:50.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa17cea0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:50.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa17cea0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa178069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:50.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa17cea0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17806a410 con 0x7fa1780f6530 2022-02-02T18:24:50.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa17cea0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17806a550 con 0x7fa1780f77d0 2022-02-02T18:24:50.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:50.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53520/0 (socket says 172.21.15.96:53520) 2022-02-02T18:24:50.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 -- 172.21.15.96:0/2257344829 learned_addr learned my addr 172.21.15.96:0/2257344829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:24:50.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa176ffd700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa178069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:50.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 -- 172.21.15.96:0/2257344829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 msgr2=0x7fa178069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:50.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa178069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 -- 172.21.15.96:0/2257344829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168005040 con 0x7fa1780f6530 2022-02-02T18:24:50.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa176ffd700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa178069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:24:50.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.093+0000 7fa1777fe700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa168004f60 tx=0x7fa168009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:50.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.094+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa168018070 con 0x7fa1780f6530 2022-02-02T18:24:50.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.094+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa168007ba0 con 0x7fa1780f6530 2022-02-02T18:24:50.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.094+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16801c620 con 0x7fa1780f6530 2022-02-02T18:24:50.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.094+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17806a7d0 con 0x7fa1780f6530 2022-02-02T18:24:50.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.094+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17810ede0 con 0x7fa1780f6530 2022-02-02T18:24:50.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.095+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178045ad0 con 0x7fa1780f6530 2022-02-02T18:24:50.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.095+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fa16801c8e0 con 0x7fa1780f6530 2022-02-02T18:24:50.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.096+0000 7fa16ffff700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 0x7fa164067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:24:50.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.096+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa1680839a0 con 0x7fa1780f6530 2022-02-02T18:24:50.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.096+0000 7fa176ffd700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 0x7fa164067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:24:50.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.096+0000 7fa176ffd700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 0x7fa164067350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa16000b8d0 tx=0x7fa160008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:24:50.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.100+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa168051ab0 con 0x7fa1780f6530 2022-02-02T18:24:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.301+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1780fee10 con 0x7fa1780f6530 2022-02-02T18:24:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.302+0000 7fa16ffff700 1 -- 172.21.15.96:0/2257344829 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1855 (secure 0 0 0) 0x7fa1680550d0 con 0x7fa1780f6530 2022-02-02T18:24:50.307 INFO:teuthology.orchestra.run.smithi096.stdout:e38 2022-02-02T18:24:50.307 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:24:50.308 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:24:50.308 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:24:50.309 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:50.309 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:24:50.310 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:24:50.310 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 38 2022-02-02T18:24:50.310 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:24:50.311 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:24:50.311 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:23:55.493666+0000 2022-02-02T18:24:50.312 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:24:50.312 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:24:50.313 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:24:50.313 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:24:50.314 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:24:50.314 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:24:50.314 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:24:50.315 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:24:50.315 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:24:50.316 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:24:50.316 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:24:50.317 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:24:50.318 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:24:50.319 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:24:50.319 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:24:50.319 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:24:50.320 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:24:50.320 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:24:50.321 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:24:50.321 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:24:50.321 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:24:50.322 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:24:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:50.322 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:50.323 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:24:50.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:24:50.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:24:50.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:24:50.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 msgr2=0x7fa164067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 0x7fa164067350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa16000b8d0 tx=0x7fa160008040).stop 2022-02-02T18:24:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 msgr2=0x7fa17806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:24:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa168004f60 tx=0x7fa168009b30).stop 2022-02-02T18:24:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 shutdown_connections 2022-02-02T18:24:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa164064e90 0x7fa164067350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1780f6530 0x7fa17806b9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 --2- 172.21.15.96:0/2257344829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1780f77d0 0x7fa178069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:24:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 >> 172.21.15.96:0/2257344829 conn(0x7fa1780f1c90 msgr2=0x7fa1780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:24:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 shutdown_connections 2022-02-02T18:24:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:24:50.305+0000 7fa17cea0700 1 -- 172.21.15.96:0/2257344829 wait complete. 2022-02-02T18:24:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 38 2022-02-02T18:24:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:50 smithi159 ceph-mon[69013]: pgmap v53: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2022-02-02T18:24:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:50 smithi159 ceph-mon[69013]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2450028798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:50 smithi096 ceph-mon[101353]: pgmap v53: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2022-02-02T18:24:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:50 smithi096 ceph-mon[101353]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2450028798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:24:51.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:51 smithi159 ceph-mon[69013]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:51.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2257344829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:24:51.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:51 smithi096 ceph-mon[101353]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:24:51.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2257344829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:24:52.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:52 smithi159 ceph-mon[69013]: pgmap v54: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 535 B/s rd, 0 op/s 2022-02-02T18:24:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:52 smithi096 ceph-mon[101353]: pgmap v54: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 535 B/s rd, 0 op/s 2022-02-02T18:24:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:54 smithi159 ceph-mon[69013]: pgmap v55: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 473 B/s rd, 0 op/s 2022-02-02T18:24:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:54 smithi096 ceph-mon[101353]: pgmap v55: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 473 B/s rd, 0 op/s 2022-02-02T18:24:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:56 smithi159 ceph-mon[69013]: pgmap v56: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2022-02-02T18:24:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:56 smithi096 ceph-mon[101353]: pgmap v56: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2022-02-02T18:24:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:58 smithi159 ceph-mon[69013]: pgmap v57: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 791 B/s rd, 1 op/s 2022-02-02T18:24:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:24:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:58 smithi096 ceph-mon[101353]: pgmap v57: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 791 B/s rd, 1 op/s 2022-02-02T18:24:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:24:58.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:24:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:00 smithi159 ceph-mon[69013]: pgmap v58: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2022-02-02T18:25:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:25:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:00 smithi096 ceph-mon[101353]: pgmap v58: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2022-02-02T18:25:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:25:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:01 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:25:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:01 smithi096 ceph-mon[101353]: Upgrade: osd.1 is safe to restart 2022-02-02T18:25:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:01 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2022-02-02T18:25:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:01 smithi159 ceph-mon[69013]: Upgrade: osd.1 is safe to restart 2022-02-02T18:25:02.647 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:02 smithi096 ceph-mon[101353]: pgmap v59: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2022-02-02T18:25:02.647 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:02 smithi096 ceph-mon[101353]: Upgrade: Updating osd.1 2022-02-02T18:25:02.647 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:02.648 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:02 smithi096 ceph-mon[101353]: Deploying daemon osd.1 on smithi096 2022-02-02T18:25:02.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:02 smithi159 ceph-mon[69013]: pgmap v59: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2022-02-02T18:25:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:02 smithi159 ceph-mon[69013]: Upgrade: Updating osd.1 2022-02-02T18:25:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:02 smithi159 ceph-mon[69013]: Deploying daemon osd.1 on smithi096 2022-02-02T18:25:04.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:03 smithi096 systemd[1]: Stopping Ceph osd.1 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:25:04.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:03 smithi096 conmon[54651]: debug 2022-02-02T18:25:03.856+0000 7f1d448f8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:25:04.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:03 smithi096 conmon[54651]: debug 2022-02-02T18:25:03.856+0000 7f1d448f8700 -1 osd.1 57 *** Got signal Terminated *** 2022-02-02T18:25:04.058 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:03 smithi096 conmon[54651]: debug 2022-02-02T18:25:03.856+0000 7f1d448f8700 -1 osd.1 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:25:04.411 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:04 smithi096 bash[114345]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.1 2022-02-02T18:25:04.411 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: pgmap v60: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2022-02-02T18:25:04.412 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.2 2022-02-02T18:25:04.412 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 failed (root=default,host=smithi096) (connection refused reported by osd.2) 2022-02-02T18:25:04.412 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.2 2022-02-02T18:25:04.412 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.0 2022-02-02T18:25:04.413 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.5 2022-02-02T18:25:04.413 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.4 2022-02-02T18:25:04.413 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.3 2022-02-02T18:25:04.413 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.0 2022-02-02T18:25:04.414 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.5 2022-02-02T18:25:04.414 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.4 2022-02-02T18:25:04.414 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:04 smithi096 ceph-mon[101353]: osd.1 reported immediately failed by osd.3 2022-02-02T18:25:04.757 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:04 smithi096 bash[114345]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-1" found: no such container 2022-02-02T18:25:04.758 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:04 smithi096 bash[114345]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.1" found: no such container 2022-02-02T18:25:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: pgmap v60: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2022-02-02T18:25:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.2 2022-02-02T18:25:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 failed (root=default,host=smithi096) (connection refused reported by osd.2) 2022-02-02T18:25:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.2 2022-02-02T18:25:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.0 2022-02-02T18:25:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.5 2022-02-02T18:25:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.4 2022-02-02T18:25:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.3 2022-02-02T18:25:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.0 2022-02-02T18:25:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.5 2022-02-02T18:25:04.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.4 2022-02-02T18:25:04.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:04 smithi159 ceph-mon[69013]: osd.1 reported immediately failed by osd.3 2022-02-02T18:25:05.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:04 smithi096 podman[114667]: 2022-02-02T18:25:05.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:05 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:25:05.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:05 smithi096 ceph-mon[101353]: osdmap e58: 6 total, 5 up, 6 in 2022-02-02T18:25:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:05 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:25:05.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:05 smithi159 ceph-mon[69013]: osdmap e58: 6 total, 5 up, 6 in 2022-02-02T18:25:06.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:05 smithi096 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.1.service: Succeeded. 2022-02-02T18:25:06.057 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:05 smithi096 systemd[1]: Stopped Ceph osd.1 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:25:06.058 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:05 smithi096 systemd[1]: Starting Ceph osd.1 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:25:06.363 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 podman[114969]: 2022-02-02T18:25:06.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:06 smithi096 ceph-mon[101353]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2022-02-02T18:25:06.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:06 smithi096 ceph-mon[101353]: osdmap e59: 6 total, 5 up, 6 in 2022-02-02T18:25:06.711 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:25:06.711 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-02-02T18:25:06.711 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:25:06.712 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-02-02T18:25:06.712 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2022-02-02T18:25:06.712 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2022-02-02T18:25:06.712 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2022-02-02T18:25:06.712 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2022-02-02T18:25:06.713 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-02-02T18:25:06.713 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 bash[114814]: --> ceph-volume lvm activate successful for osd ID: 1 2022-02-02T18:25:06.713 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2022-02-02T18:25:06.713 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2022-02-02T18:25:06.713 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2022-02-02T18:25:06.714 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2022-02-02T18:25:06.714 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-02-02T18:25:06.714 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:06 smithi096 conmon[115009]: --> ceph-volume lvm activate successful for osd ID: 1 2022-02-02T18:25:06.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:06 smithi159 ceph-mon[69013]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2022-02-02T18:25:06.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:06 smithi159 ceph-mon[69013]: osdmap e59: 6 total, 5 up, 6 in 2022-02-02T18:25:07.556 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:07 smithi096 podman[115246]: 2022-02-02T18:25:07.556 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:07 smithi096 ceph-osd[115310]: -- 172.21.15.96:0/861084413 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bbf573c340 con 0x55bbf5702c00 2022-02-02T18:25:07.556 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:07 smithi096 bash[114814]: 2e0a36314fd8b7878eedd3bde242e51f2fbe5044106f66f7f3794e566ca0b68d 2022-02-02T18:25:07.982 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:07 smithi096 systemd[1]: Started Ceph osd.1 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:25:08.306 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:08 smithi096 conmon[115286]: 2022-02-02T18:25:08.004+0000 7fc6d755b240 -1 Falling back to public interface 2022-02-02T18:25:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:25:08.830 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:08.831 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:08.831 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:25:08.832 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:25:08.832 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:08.834 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:25:08.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:08.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:08.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:25:08.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:25:08.840 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:09.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:09 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:25:09.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:09 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:25:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:10 smithi159 ceph-mon[69013]: pgmap v65: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:10 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 6189/32682 objects degraded (18.937%), 34 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:10 smithi096 ceph-mon[101353]: pgmap v65: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:10 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 6189/32682 objects degraded (18.937%), 34 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:11.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:11 smithi159 ceph-mon[69013]: pgmap v66: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:11.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:11 smithi096 ceph-mon[101353]: pgmap v66: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:13.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:14 smithi159 ceph-mon[69013]: pgmap v67: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:14 smithi096 ceph-mon[101353]: pgmap v67: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:15.185 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:14 smithi096 conmon[115286]: 2022-02-02T18:25:14.945+0000 7fc6d755b240 -1 osd.1 57 log_to_monitors true 2022-02-02T18:25:15.556 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 02 18:25:15 smithi096 conmon[115286]: 2022-02-02T18:25:15.388+0000 7fc6c68f2700 -1 osd.1 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:25:15.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:15.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:15 smithi096 ceph-mon[101353]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T18:25:15.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:15 smithi159 ceph-mon[69013]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T18:25:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:16.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:16 smithi096 ceph-mon[101353]: pgmap v68: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:16.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:16 smithi096 ceph-mon[101353]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T18:25:16.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:16 smithi096 ceph-mon[101353]: osdmap e60: 6 total, 5 up, 6 in 2022-02-02T18:25:16.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:16 smithi096 ceph-mon[101353]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:25:16.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:16 smithi159 ceph-mon[69013]: pgmap v68: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:16.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:16 smithi159 ceph-mon[69013]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T18:25:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:16 smithi159 ceph-mon[69013]: osdmap e60: 6 total, 5 up, 6 in 2022-02-02T18:25:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:16 smithi159 ceph-mon[69013]: from='osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:25:17.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:25:17.659 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530] boot 2022-02-02T18:25:17.659 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: osdmap e61: 6 total, 6 up, 6 in 2022-02-02T18:25:17.659 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:25:17.659 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: pgmap v71: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:17.660 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:17 smithi096 ceph-mon[101353]: osdmap e62: 6 total, 6 up, 6 in 2022-02-02T18:25:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:25:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: osd.1 [v2:172.21.15.96:6810/2265960530,v1:172.21.15.96:6811/2265960530] boot 2022-02-02T18:25:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: osdmap e61: 6 total, 6 up, 6 in 2022-02-02T18:25:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T18:25:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: pgmap v71: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 6189/32682 objects degraded (18.937%) 2022-02-02T18:25:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:17 smithi159 ceph-mon[69013]: osdmap e62: 6 total, 6 up, 6 in 2022-02-02T18:25:19.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:19.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:19.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:19.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:19 smithi159 ceph-mon[69013]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2022-02-02T18:25:19.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:19.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:19.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:19.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:19.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:19.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:19.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:19 smithi096 ceph-mon[101353]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2022-02-02T18:25:20.422 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:20 smithi096 ceph-mon[101353]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 1731/32682 objects degraded (5.296%) 2022-02-02T18:25:20.423 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:20 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 1731/32682 objects degraded (5.296%), 12 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:20.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 -- 172.21.15.96:0/3377137082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f55c0 msgr2=0x7f84600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 --2- 172.21.15.96:0/3377137082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f55c0 0x7f84600f59e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8450004660 tx=0x7f8450009b30).stop 2022-02-02T18:25:20.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 -- 172.21.15.96:0/3377137082 shutdown_connections 2022-02-02T18:25:20.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 --2- 172.21.15.96:0/3377137082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f6860 0x7f84600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 --2- 172.21.15.96:0/3377137082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f55c0 0x7f84600f59e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 -- 172.21.15.96:0/3377137082 >> 172.21.15.96:0/3377137082 conn(0x7f84600f0d40 msgr2=0x7f84600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:20.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 -- 172.21.15.96:0/3377137082 shutdown_connections 2022-02-02T18:25:20.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.420+0000 7f8465fe9700 1 -- 172.21.15.96:0/3377137082 wait complete. 2022-02-02T18:25:20.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 Processor -- start 2022-02-02T18:25:20.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 -- start start 2022-02-02T18:25:20.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f55c0 0x7f84600f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600f8100 con 0x7f84600f6860 2022-02-02T18:25:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f8465fe9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600f8240 con 0x7f84600f55c0 2022-02-02T18:25:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f845effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f845effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53602/0 (socket says 172.21.15.96:53602) 2022-02-02T18:25:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f845effd700 1 -- 172.21.15.96:0/1304219475 learned_addr learned my addr 172.21.15.96:0/1304219475 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.421+0000 7f845f7fe700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f55c0 0x7f84600f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f845effd700 1 -- 172.21.15.96:0/1304219475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f55c0 msgr2=0x7f84600f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f845effd700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f55c0 0x7f84600f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f845effd700 1 -- 172.21.15.96:0/1304219475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450005040 con 0x7f84600f6860 2022-02-02T18:25:20.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f845effd700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f844800c790 tx=0x7f8448007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:20.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448002590 con 0x7f84600f6860 2022-02-02T18:25:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84600f8520 con 0x7f84600f6860 2022-02-02T18:25:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8448002ba0 con 0x7f84600f6860 2022-02-02T18:25:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448013d90 con 0x7f84600f6860 2022-02-02T18:25:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.422+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846010efa0 con 0x7f84600f6860 2022-02-02T18:25:20.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.423+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460045ad0 con 0x7f84600f6860 2022-02-02T18:25:20.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.424+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f844801a060 con 0x7f84600f6860 2022-02-02T18:25:20.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.424+0000 7f8457fff700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 0x7f844c067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.425+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8448081dc0 con 0x7f84600f6860 2022-02-02T18:25:20.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.425+0000 7f845f7fe700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 0x7f844c067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.425+0000 7f845f7fe700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 0x7f844c067300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8450013690 tx=0x7f8450009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:20.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.429+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8448085030 con 0x7f84600f6860 2022-02-02T18:25:20.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:20 smithi159 ceph-mon[69013]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 53 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 1731/32682 objects degraded (5.296%) 2022-02-02T18:25:20.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:20 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 1731/32682 objects degraded (5.296%), 12 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.609+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84600faca0 con 0x7f844c064e40 2022-02-02T18:25:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.610+0000 7f8457fff700 1 -- 172.21.15.96:0/1304219475 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f84600faca0 con 0x7f844c064e40 2022-02-02T18:25:20.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 msgr2=0x7f844c067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 0x7f844c067300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8450013690 tx=0x7f8450009b30).stop 2022-02-02T18:25:20.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 msgr2=0x7f84600f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f844800c790 tx=0x7f8448007d70).stop 2022-02-02T18:25:20.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 shutdown_connections 2022-02-02T18:25:20.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f844c064e40 0x7f844c067300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f55c0 0x7f84600f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 --2- 172.21.15.96:0/1304219475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f6860 0x7f84600f7ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 >> 172.21.15.96:0/1304219475 conn(0x7f84600f0d40 msgr2=0x7f846005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:20.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 shutdown_connections 2022-02-02T18:25:20.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.612+0000 7f8465fe9700 1 -- 172.21.15.96:0/1304219475 wait complete. 2022-02-02T18:25:20.624 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:25:20.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 -- 172.21.15.96:0/3021978786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f6860 msgr2=0x7f030c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 --2- 172.21.15.96:0/3021978786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f6860 0x7f030c0f6cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0308004660 tx=0x7f0308009b30).stop 2022-02-02T18:25:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 -- 172.21.15.96:0/3021978786 shutdown_connections 2022-02-02T18:25:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 --2- 172.21.15.96:0/3021978786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f6860 0x7f030c0f6cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 --2- 172.21.15.96:0/3021978786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f55c0 0x7f030c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 -- 172.21.15.96:0/3021978786 >> 172.21.15.96:0/3021978786 conn(0x7f030c0f0d40 msgr2=0x7f030c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 -- 172.21.15.96:0/3021978786 shutdown_connections 2022-02-02T18:25:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.710+0000 7f03146d4700 1 -- 172.21.15.96:0/3021978786 wait complete. 2022-02-02T18:25:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 Processor -- start 2022-02-02T18:25:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 -- start start 2022-02-02T18:25:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f6860 0x7f030c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0f8100 con 0x7f030c0f55c0 2022-02-02T18:25:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f03146d4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0f8240 con 0x7f030c0f6860 2022-02-02T18:25:20.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f0312470700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f0312470700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53610/0 (socket says 172.21.15.96:53610) 2022-02-02T18:25:20.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.711+0000 7f0312470700 1 -- 172.21.15.96:0/4030095811 learned_addr learned my addr 172.21.15.96:0/4030095811 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:20.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0311c6f700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f6860 0x7f030c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0312470700 1 -- 172.21.15.96:0/4030095811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f6860 msgr2=0x7f030c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0312470700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f6860 0x7f030c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0312470700 1 -- 172.21.15.96:0/4030095811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308005040 con 0x7f030c0f55c0 2022-02-02T18:25:20.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0312470700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f02fc00c530 tx=0x7f02fc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:20.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02fc00f650 con 0x7f030c0f55c0 2022-02-02T18:25:20.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c0f8520 con 0x7f030c0f55c0 2022-02-02T18:25:20.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02fc00fc60 con 0x7f030c0f55c0 2022-02-02T18:25:20.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02fc012cb0 con 0x7f030c0f55c0 2022-02-02T18:25:20.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.712+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c10efa0 con 0x7f030c0f55c0 2022-02-02T18:25:20.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.713+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c045ad0 con 0x7f030c0f55c0 2022-02-02T18:25:20.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.713+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f02fc019030 con 0x7f030c0f55c0 2022-02-02T18:25:20.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.714+0000 7f0302ffd700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 0x7f02f8067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:20.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.714+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02fc081640 con 0x7f030c0f55c0 2022-02-02T18:25:20.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.714+0000 7f0311c6f700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 0x7f02f8067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:20.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.714+0000 7f0311c6f700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 0x7f02f8067300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0308004630 tx=0x7f0308009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:20.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.718+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02fc04f800 con 0x7f030c0f55c0 2022-02-02T18:25:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.891+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f030c0faca0 con 0x7f02f8064e40 2022-02-02T18:25:20.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.900+0000 7f0302ffd700 1 -- 172.21.15.96:0/4030095811 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f030c0faca0 con 0x7f02f8064e40 2022-02-02T18:25:20.902 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:25:20.902 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (8m) 6s ago 9m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:25:20.902 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (68s) 6s ago 9m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:25:20.902 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (64s) 59s ago 9m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:25:20.903 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (8m) 6s ago 9m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:25:20.903 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (5m) 6s ago 5m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:25:20.903 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (86s) 6s ago 5m 13.3M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:25:20.904 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (5m) 59s ago 5m 5337M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:25:20.904 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (102s) 59s ago 5m 13.5M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:25:20.904 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2m) 6s ago 10m 467M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:25:20.904 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2m) 59s ago 9m 416M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:25:20.904 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2m) 6s ago 11m 83.2M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:25:20.905 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (102s) 59s ago 9m 41.7M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:25:20.905 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (9m) 6s ago 9m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:25:20.905 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 59s ago 9m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:25:20.905 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (46s) 6s ago 8m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:25:20.906 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (13s) 6s ago 8m 12.1M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:25:20.906 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (7m) 6s ago 7m 711M 4096M 16.2.4 8d91d370c2b8 15a57f3ea1df 2022-02-02T18:25:20.906 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (7m) 59s ago 7m 939M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:25:20.906 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (7m) 59s ago 7m 797M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:25:20.907 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (7m) 59s ago 7m 866M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:25:20.907 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (8m) 6s ago 9m 47.7M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:25:20.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.901+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 msgr2=0x7f02f8067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.901+0000 7f03146d4700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 0x7f02f8067300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0308004630 tx=0x7f0308009b30).stop 2022-02-02T18:25:20.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 msgr2=0x7f030c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:20.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f02fc00c530 tx=0x7f02fc007e10).stop 2022-02-02T18:25:20.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 shutdown_connections 2022-02-02T18:25:20.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e40 0x7f02f8067300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f030c0f55c0 0x7f030c0f9720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 --2- 172.21.15.96:0/4030095811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0f6860 0x7f030c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:20.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 >> 172.21.15.96:0/4030095811 conn(0x7f030c0f0d40 msgr2=0x7f030c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:20.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 shutdown_connections 2022-02-02T18:25:20.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.902+0000 7f03146d4700 1 -- 172.21.15.96:0/4030095811 wait complete. 2022-02-02T18:25:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 -- 172.21.15.96:0/3307605749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 msgr2=0x7fd60c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 --2- 172.21.15.96:0/3307605749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c0f6cc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd608004660 tx=0x7fd608009b30).stop 2022-02-02T18:25:21.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 -- 172.21.15.96:0/3307605749 shutdown_connections 2022-02-02T18:25:21.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 --2- 172.21.15.96:0/3307605749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c0f6cc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 --2- 172.21.15.96:0/3307605749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 0x7fd60c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 -- 172.21.15.96:0/3307605749 >> 172.21.15.96:0/3307605749 conn(0x7fd60c0f0d40 msgr2=0x7fd60c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:21.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 -- 172.21.15.96:0/3307605749 shutdown_connections 2022-02-02T18:25:21.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 -- 172.21.15.96:0/3307605749 wait complete. 2022-02-02T18:25:21.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:20.999+0000 7fd613b91700 1 Processor -- start 2022-02-02T18:25:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd613b91700 1 -- start start 2022-02-02T18:25:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd613b91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 0x7fd60c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd613b91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd613b91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0603c0 con 0x7fd60c0f6860 2022-02-02T18:25:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd613b91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c060500 con 0x7fd60c0f55c0 2022-02-02T18:25:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53622/0 (socket says 172.21.15.96:53622) 2022-02-02T18:25:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 -- 172.21.15.96:0/1336693955 learned_addr learned my addr 172.21.15.96:0/1336693955 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61192d700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 0x7fd60c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 -- 172.21.15.96:0/1336693955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 msgr2=0x7fd60c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 0x7fd60c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 -- 172.21.15.96:0/1336693955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608005040 con 0x7fd60c0f6860 2022-02-02T18:25:21.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.000+0000 7fd61112c700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd608009da0 tx=0x7fd608009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.001+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd608018070 con 0x7fd60c0f6860 2022-02-02T18:25:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.001+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c10c6c0 con 0x7fd60c0f6860 2022-02-02T18:25:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.001+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd608007cf0 con 0x7fd60c0f6860 2022-02-02T18:25:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.001+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60801c620 con 0x7fd60c0f6860 2022-02-02T18:25:21.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.001+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c10cbf0 con 0x7fd60c0f6860 2022-02-02T18:25:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.002+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f4004fa0 con 0x7fd60c0f6860 2022-02-02T18:25:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.002+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fd60801c8a0 con 0x7fd60c0f6860 2022-02-02T18:25:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.002+0000 7fd6027fc700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 0x7fd5f8067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.003+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd608083910 con 0x7fd60c0f6860 2022-02-02T18:25:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.003+0000 7fd61192d700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 0x7fd5f8067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.003+0000 7fd61192d700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 0x7fd5f8067310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd60c060040 tx=0x7fd5fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:21.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.007+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd608051ae0 con 0x7fd60c0f6860 2022-02-02T18:25:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.238+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd5f4005e80 con 0x7fd60c0f6860 2022-02-02T18:25:21.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.239+0000 7fd6027fc700 1 -- 172.21.15.96:0/1336693955 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+808 (secure 0 0 0) 0x7fd608055100 con 0x7fd60c0f6860 2022-02-02T18:25:21.241 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:25:21.241 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:25:21.241 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:25:21.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:21.242 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:25:21.242 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:25:21.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:21.243 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:25:21.243 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:25:21.243 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:25:21.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:21.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:25:21.244 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:25:21.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:21.244 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:25:21.244 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8, 2022-02-02T18:25:21.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:25:21.245 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:25:21.245 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:25:21.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.240+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 msgr2=0x7fd5f8067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.240+0000 7fd613b91700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 0x7fd5f8067310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd60c060040 tx=0x7fd5fc009040).stop 2022-02-02T18:25:21.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.240+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 msgr2=0x7fd60c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.240+0000 7fd613b91700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd608009da0 tx=0x7fd608009b30).stop 2022-02-02T18:25:21.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 shutdown_connections 2022-02-02T18:25:21.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5f8064e50 0x7fd5f8067310 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c0f55c0 0x7fd60c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 --2- 172.21.15.96:0/1336693955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0f6860 0x7fd60c10c170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 >> 172.21.15.96:0/1336693955 conn(0x7fd60c0f0d40 msgr2=0x7fd60c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 shutdown_connections 2022-02-02T18:25:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.241+0000 7fd613b91700 1 -- 172.21.15.96:0/1336693955 wait complete. 2022-02-02T18:25:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:21 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1731/32682 objects degraded (5.296%), 12 pgs degraded) 2022-02-02T18:25:21.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 -- 172.21.15.96:0/4023481896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 msgr2=0x7fdb6c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 --2- 172.21.15.96:0/4023481896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c0f59e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdb60004660 tx=0x7fdb60009b30).stop 2022-02-02T18:25:21.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 -- 172.21.15.96:0/4023481896 shutdown_connections 2022-02-02T18:25:21.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 --2- 172.21.15.96:0/4023481896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 --2- 172.21.15.96:0/4023481896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c0f59e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 -- 172.21.15.96:0/4023481896 >> 172.21.15.96:0/4023481896 conn(0x7fdb6c0f0d40 msgr2=0x7fdb6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:21.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 -- 172.21.15.96:0/4023481896 shutdown_connections 2022-02-02T18:25:21.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 -- 172.21.15.96:0/4023481896 wait complete. 2022-02-02T18:25:21.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.340+0000 7fdb71f69700 1 Processor -- start 2022-02-02T18:25:21.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb71f69700 1 -- start start 2022-02-02T18:25:21.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb71f69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb71f69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb71f69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0603e0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb71f69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c060520 con 0x7fdb6c0f6860 2022-02-02T18:25:21.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53630/0 (socket says 172.21.15.96:53630) 2022-02-02T18:25:21.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 -- 172.21.15.96:0/656484260 learned_addr learned my addr 172.21.15.96:0/656484260 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:21.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6affd700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 -- 172.21.15.96:0/656484260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 msgr2=0x7fdb6c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 -- 172.21.15.96:0/656484260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60005040 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6affd700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:25:21.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.341+0000 7fdb6b7fe700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdb60013a70 tx=0x7fdb60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:21.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.342+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb60018070 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.342+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c10c6c0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.342+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb600097d0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.342+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6001c3c0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.342+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c10cc20 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.343+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c045ad0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.343+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 34) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fdb60007ba0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.343+0000 7fdb53fff700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 0x7fdb54067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:21.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.344+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdb60083780 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.344+0000 7fdb6affd700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 0x7fdb54067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:21.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.344+0000 7fdb6affd700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 0x7fdb54067300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdb5c009740 tx=0x7fdb5c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:21.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.348+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb60051950 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:21 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1731/32682 objects degraded (5.296%), 12 pgs degraded) 2022-02-02T18:25:21.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.551+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb6c0008d0 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.551+0000 7fdb53fff700 1 -- 172.21.15.96:0/656484260 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1855 (secure 0 0 0) 0x7fdb60054f70 con 0x7fdb6c0f55c0 2022-02-02T18:25:21.553 INFO:teuthology.orchestra.run.smithi096.stdout:e38 2022-02-02T18:25:21.553 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:25:21.554 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:25:21.554 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:25:21.554 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:21.554 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:25:21.555 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:25:21.555 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 38 2022-02-02T18:25:21.555 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:25:21.555 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:25:21.556 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:23:55.493666+0000 2022-02-02T18:25:21.556 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:25:21.556 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:25:21.556 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:25:21.556 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:25:21.557 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:25:21.557 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:25:21.557 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:25:21.557 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:25:21.557 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:25:21.558 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:25:21.558 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:25:21.558 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:25:21.558 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:25:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:25:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:25:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:25:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:25:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:25:21.560 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:25:21.560 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:25:21.560 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:25:21.560 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:25:21.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:21.561 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:21.561 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:25:21.561 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:21.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:25:21.562 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:25:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 msgr2=0x7fdb54067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 0x7fdb54067300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdb5c009740 tx=0x7fdb5c009be0).stop 2022-02-02T18:25:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 msgr2=0x7fdb6c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdb60013a70 tx=0x7fdb60009b30).stop 2022-02-02T18:25:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 shutdown_connections 2022-02-02T18:25:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb54064e40 0x7fdb54067300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb6c0f55c0 0x7fdb6c109c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 --2- 172.21.15.96:0/656484260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6c0f6860 0x7fdb6c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 >> 172.21.15.96:0/656484260 conn(0x7fdb6c0f0d40 msgr2=0x7fdb6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 shutdown_connections 2022-02-02T18:25:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:21.554+0000 7fdb71f69700 1 -- 172.21.15.96:0/656484260 wait complete. 2022-02-02T18:25:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 38 2022-02-02T18:25:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:22 smithi159 ceph-mon[69013]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:22 smithi159 ceph-mon[69013]: pgmap v74: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2022-02-02T18:25:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:22 smithi159 ceph-mon[69013]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1336693955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/656484260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:25:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:22 smithi096 ceph-mon[101353]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:22 smithi096 ceph-mon[101353]: pgmap v74: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2022-02-02T18:25:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:22 smithi096 ceph-mon[101353]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1336693955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/656484260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:25:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:24 smithi159 ceph-mon[69013]: pgmap v75: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 417 B/s rd, 0 op/s 2022-02-02T18:25:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:24 smithi096 ceph-mon[101353]: pgmap v75: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 417 B/s rd, 0 op/s 2022-02-02T18:25:26.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:26 smithi159 ceph-mon[69013]: pgmap v76: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 980 B/s rd, 2 op/s 2022-02-02T18:25:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:26 smithi096 ceph-mon[101353]: pgmap v76: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 980 B/s rd, 2 op/s 2022-02-02T18:25:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:28 smithi159 ceph-mon[69013]: pgmap v77: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2022-02-02T18:25:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:25:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:25:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:28 smithi096 ceph-mon[101353]: pgmap v77: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2022-02-02T18:25:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:25:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:25:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:29.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:29 smithi159 ceph-mon[69013]: mgrmap e35: smithi096.shfutl(active, since 2m), standbys: smithi159.jrxkfz 2022-02-02T18:25:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:29 smithi096 ceph-mon[101353]: mgrmap e35: smithi096.shfutl(active, since 2m), standbys: smithi159.jrxkfz 2022-02-02T18:25:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:30 smithi159 ceph-mon[69013]: pgmap v78: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2022-02-02T18:25:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:30 smithi096 ceph-mon[101353]: pgmap v78: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2022-02-02T18:25:32.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:32 smithi159 ceph-mon[69013]: pgmap v79: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:32 smithi096 ceph-mon[101353]: pgmap v79: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:34.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:34 smithi159 ceph-mon[69013]: pgmap v80: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:34.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:34 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:34 smithi159 ceph-mon[69013]: Upgrade: osd.2 is safe to restart 2022-02-02T18:25:34.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:34 smithi096 ceph-mon[101353]: pgmap v80: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:34.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:34 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2022-02-02T18:25:34.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:34 smithi096 ceph-mon[101353]: Upgrade: osd.2 is safe to restart 2022-02-02T18:25:35.679 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:35 smithi096 ceph-mon[101353]: Upgrade: Updating osd.2 2022-02-02T18:25:35.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:35.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:35 smithi096 ceph-mon[101353]: Deploying daemon osd.2 on smithi096 2022-02-02T18:25:35.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:35 smithi096 ceph-mon[101353]: pgmap v81: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:25:36.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:35 smithi159 ceph-mon[69013]: Upgrade: Updating osd.2 2022-02-02T18:25:36.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:35 smithi159 ceph-mon[69013]: Deploying daemon osd.2 on smithi096 2022-02-02T18:25:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:35 smithi159 ceph-mon[69013]: pgmap v81: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:25:37.306 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 systemd[1]: Stopping Ceph osd.2 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:25:37.307 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 conmon[60907]: debug 2022-02-02T18:25:37.139+0000 7f56ed093700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:25:37.307 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 conmon[60907]: debug 2022-02-02T18:25:37.139+0000 7f56ed093700 -1 osd.2 62 *** Got signal Terminated *** 2022-02-02T18:25:37.307 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 conmon[60907]: debug 2022-02-02T18:25:37.139+0000 7f56ed093700 -1 osd.2 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:25:37.719 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 bash[119240]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.2 2022-02-02T18:25:38.056 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 bash[119240]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-2" found: no such container 2022-02-02T18:25:38.057 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:37 smithi096 bash[119240]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.2" found: no such container 2022-02-02T18:25:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: pgmap v82: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:38.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.0 2022-02-02T18:25:38.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 failed (root=default,host=smithi096) (connection refused reported by osd.0) 2022-02-02T18:25:38.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.0 2022-02-02T18:25:38.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.1 2022-02-02T18:25:38.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.5 2022-02-02T18:25:38.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.4 2022-02-02T18:25:38.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.3 2022-02-02T18:25:38.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.1 2022-02-02T18:25:38.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.5 2022-02-02T18:25:38.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.4 2022-02-02T18:25:38.061 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:37 smithi096 ceph-mon[101353]: osd.2 reported immediately failed by osd.3 2022-02-02T18:25:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: pgmap v82: 65 pgs: 65 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:25:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.0 2022-02-02T18:25:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 failed (root=default,host=smithi096) (connection refused reported by osd.0) 2022-02-02T18:25:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.0 2022-02-02T18:25:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.1 2022-02-02T18:25:38.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.5 2022-02-02T18:25:38.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.4 2022-02-02T18:25:38.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.3 2022-02-02T18:25:38.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.1 2022-02-02T18:25:38.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.5 2022-02-02T18:25:38.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.4 2022-02-02T18:25:38.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:37 smithi159 ceph-mon[69013]: osd.2 reported immediately failed by osd.3 2022-02-02T18:25:38.556 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:38 smithi096 podman[119564]: 2022-02-02T18:25:38.957 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:38 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:25:38.957 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:38 smithi096 ceph-mon[101353]: osdmap e63: 6 total, 5 up, 6 in 2022-02-02T18:25:38.957 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:38 smithi096 ceph-mon[101353]: osdmap e64: 6 total, 5 up, 6 in 2022-02-02T18:25:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:38 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:25:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:38 smithi159 ceph-mon[69013]: osdmap e63: 6 total, 5 up, 6 in 2022-02-02T18:25:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:38 smithi159 ceph-mon[69013]: osdmap e64: 6 total, 5 up, 6 in 2022-02-02T18:25:39.306 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:38 smithi096 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.2.service: Succeeded. 2022-02-02T18:25:39.306 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:38 smithi096 systemd[1]: Stopped Ceph osd.2 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:25:39.306 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 systemd[1]: Starting Ceph osd.2 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:25:39.806 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 podman[119864]: 2022-02-02T18:25:40.111 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:39 smithi096 ceph-mon[101353]: pgmap v84: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:25:40.111 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:39 smithi096 ceph-mon[101353]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2022-02-02T18:25:40.112 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:25:40.112 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-02-02T18:25:40.112 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:25:40.113 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-02-02T18:25:40.113 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2022-02-02T18:25:40.113 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2022-02-02T18:25:40.113 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2022-02-02T18:25:40.114 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2022-02-02T18:25:40.114 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-02-02T18:25:40.114 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 bash[119710]: --> ceph-volume lvm activate successful for osd ID: 2 2022-02-02T18:25:40.114 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2022-02-02T18:25:40.115 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2022-02-02T18:25:40.115 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2022-02-02T18:25:40.115 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2022-02-02T18:25:40.115 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-02-02T18:25:40.115 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:39 smithi096 conmon[119904]: --> ceph-volume lvm activate successful for osd ID: 2 2022-02-02T18:25:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:39 smithi159 ceph-mon[69013]: pgmap v84: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:25:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:39 smithi159 ceph-mon[69013]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2022-02-02T18:25:40.969 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:40 smithi096 podman[120141]: 2022-02-02T18:25:40.969 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:40 smithi096 ceph-osd[120205]: -- 172.21.15.96:0/3133070645 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560ddbe4a340 con 0x560ddbe10c00 2022-02-02T18:25:40.970 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:40 smithi096 bash[119710]: c23723b53c21dceeb89694e704f01ab612845a8db75b600d6b202252e1976827 2022-02-02T18:25:41.306 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:40 smithi096 systemd[1]: Started Ceph osd.2 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:25:41.806 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:41 smithi096 conmon[120181]: 2022-02-02T18:25:41.399+0000 7fb5aa891240 -1 Falling back to public interface 2022-02-02T18:25:41.806 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:41 smithi096 conmon[120181]: 2022-02-02T18:25:42.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: pgmap v86: 65 pgs: 7 active+undersized+degraded, 20 peering, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1340/32682 objects degraded (4.100%) 2022-02-02T18:25:42.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:42.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:42.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:25:42.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:25:42.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:25:42.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:42 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 1340/32682 objects degraded (4.100%), 7 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: pgmap v86: 65 pgs: 7 active+undersized+degraded, 20 peering, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1340/32682 objects degraded (4.100%) 2022-02-02T18:25:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:25:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:25:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:25:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:42 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 1340/32682 objects degraded (4.100%), 7 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:43.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:44 smithi159 ceph-mon[69013]: pgmap v87: 65 pgs: 7 active+undersized+degraded, 20 peering, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1340/32682 objects degraded (4.100%) 2022-02-02T18:25:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:44 smithi096 ceph-mon[101353]: pgmap v87: 65 pgs: 7 active+undersized+degraded, 20 peering, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1340/32682 objects degraded (4.100%) 2022-02-02T18:25:45.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:45 smithi159 ceph-mon[69013]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 5 pgs peering) 2022-02-02T18:25:45.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:45 smithi159 ceph-mon[69013]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:25:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:45 smithi096 ceph-mon[101353]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 5 pgs peering) 2022-02-02T18:25:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:45 smithi096 ceph-mon[101353]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 1 up:standby-replay 2 up:standby, 1 failed 2022-02-02T18:25:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:46 smithi159 ceph-mon[69013]: pgmap v88: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:46 smithi096 ceph-mon[101353]: pgmap v88: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:47.806 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:47 smithi096 conmon[120181]: 2022-02-02T18:25:47.586+0000 7fb5aa891240 -1 osd.2 62 log_to_monitors true 2022-02-02T18:25:48.416 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:48 smithi096 ceph-mon[101353]: pgmap v89: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:48.416 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:48.417 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:48 smithi096 ceph-mon[101353]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T18:25:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:48 smithi159 ceph-mon[69013]: pgmap v89: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:48 smithi159 ceph-mon[69013]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T18:25:48.798 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 02 18:25:48 smithi096 conmon[120181]: 2022-02-02T18:25:48.414+0000 7fb59b42b700 -1 osd.2 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:25:49.475 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:49.476 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:49 smithi096 ceph-mon[101353]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T18:25:49.476 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:49 smithi096 ceph-mon[101353]: osdmap e65: 6 total, 5 up, 6 in 2022-02-02T18:25:49.476 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:49 smithi096 ceph-mon[101353]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:25:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:49.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:49 smithi159 ceph-mon[69013]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T18:25:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:49 smithi159 ceph-mon[69013]: osdmap e65: 6 total, 5 up, 6 in 2022-02-02T18:25:49.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:49 smithi159 ceph-mon[69013]: from='osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2022-02-02T18:25:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: pgmap v91: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:25:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075] boot 2022-02-02T18:25:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: osdmap e66: 6 total, 6 up, 6 in 2022-02-02T18:25:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:25:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:50 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 4729/32682 objects degraded (14.470%), 26 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: pgmap v91: 65 pgs: 26 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 4729/32682 objects degraded (14.470%) 2022-02-02T18:25:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:25:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: osd.2 [v2:172.21.15.96:6818/3226298075,v1:172.21.15.96:6819/3226298075] boot 2022-02-02T18:25:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: osdmap e66: 6 total, 6 up, 6 in 2022-02-02T18:25:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T18:25:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:50 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 4729/32682 objects degraded (14.470%), 26 pgs degraded (PG_DEGRADED) 2022-02-02T18:25:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- 172.21.15.96:0/4166426232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 msgr2=0x7fba900f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 --2- 172.21.15.96:0/4166426232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f9190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fba8c004660 tx=0x7fba8c009b30).stop 2022-02-02T18:25:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- 172.21.15.96:0/4166426232 shutdown_connections 2022-02-02T18:25:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 --2- 172.21.15.96:0/4166426232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 --2- 172.21.15.96:0/4166426232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f9190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- 172.21.15.96:0/4166426232 >> 172.21.15.96:0/4166426232 conn(0x7fba900f0b90 msgr2=0x7fba900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- 172.21.15.96:0/4166426232 shutdown_connections 2022-02-02T18:25:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- 172.21.15.96:0/4166426232 wait complete. 2022-02-02T18:25:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 Processor -- start 2022-02-02T18:25:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- start start 2022-02-02T18:25:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.655+0000 7fba964ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900f55f0 con 0x7fba90060290 2022-02-02T18:25:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba964ee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900f5730 con 0x7fba900f9710 2022-02-02T18:25:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53712/0 (socket says 172.21.15.96:53712) 2022-02-02T18:25:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 -- 172.21.15.96:0/210707726 learned_addr learned my addr 172.21.15.96:0/210707726 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba94ceb700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 -- 172.21.15.96:0/210707726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 msgr2=0x7fba900f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 -- 172.21.15.96:0/210707726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c005040 con 0x7fba90060290 2022-02-02T18:25:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba94ceb700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:25:51.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba954ec700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fba8c009990 tx=0x7fba8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:51.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8c018070 con 0x7fba90060290 2022-02-02T18:25:51.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba8c007ba0 con 0x7fba90060290 2022-02-02T18:25:51.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900f59b0 con 0x7fba90060290 2022-02-02T18:25:51.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.656+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8c01c3c0 con 0x7fba90060290 2022-02-02T18:25:51.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.657+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900f5f10 con 0x7fba90060290 2022-02-02T18:25:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.658+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba8c01d420 con 0x7fba90060290 2022-02-02T18:25:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.658+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90045ad0 con 0x7fba90060290 2022-02-02T18:25:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.658+0000 7fba85ffb700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 0x7fba7c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.658+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba8c083740 con 0x7fba90060290 2022-02-02T18:25:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.658+0000 7fba94ceb700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 0x7fba7c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.659+0000 7fba94ceb700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 0x7fba7c0672e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba90060060 tx=0x7fba80009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.663+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba8c0518a0 con 0x7fba90060290 2022-02-02T18:25:51.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:51 smithi159 ceph-mon[69013]: osdmap e67: 6 total, 6 up, 6 in 2022-02-02T18:25:51.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:51 smithi159 ceph-mon[69013]: pgmap v94: 65 pgs: 3 peering, 23 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4075/32682 objects degraded (12.469%) 2022-02-02T18:25:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:51 smithi096 ceph-mon[101353]: osdmap e67: 6 total, 6 up, 6 in 2022-02-02T18:25:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:51 smithi096 ceph-mon[101353]: pgmap v94: 65 pgs: 3 peering, 23 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4075/32682 objects degraded (12.469%) 2022-02-02T18:25:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.841+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba90057f10 con 0x7fba7c064e20 2022-02-02T18:25:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.842+0000 7fba85ffb700 1 -- 172.21.15.96:0/210707726 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7fba90057f10 con 0x7fba7c064e20 2022-02-02T18:25:51.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 msgr2=0x7fba7c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 0x7fba7c0672e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba90060060 tx=0x7fba80009c80).stop 2022-02-02T18:25:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 msgr2=0x7fba900f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fba8c009990 tx=0x7fba8c009b30).stop 2022-02-02T18:25:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 shutdown_connections 2022-02-02T18:25:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba7c064e20 0x7fba7c0672e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90060290 0x7fba900f6c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 --2- 172.21.15.96:0/210707726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba900f9710 0x7fba900f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 >> 172.21.15.96:0/210707726 conn(0x7fba900f0b90 msgr2=0x7fba900f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 shutdown_connections 2022-02-02T18:25:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.844+0000 7fba964ee700 1 -- 172.21.15.96:0/210707726 wait complete. 2022-02-02T18:25:51.855 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:25:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 -- 172.21.15.96:0/1717536458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f6530 msgr2=0x7fb4640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 --2- 172.21.15.96:0/1717536458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f6530 0x7fb4640f6950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb454004660 tx=0x7fb454009b30).stop 2022-02-02T18:25:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 -- 172.21.15.96:0/1717536458 shutdown_connections 2022-02-02T18:25:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 --2- 172.21.15.96:0/1717536458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f77d0 0x7fb4640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 --2- 172.21.15.96:0/1717536458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f6530 0x7fb4640f6950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 -- 172.21.15.96:0/1717536458 >> 172.21.15.96:0/1717536458 conn(0x7fb4640f1c90 msgr2=0x7fb4640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 -- 172.21.15.96:0/1717536458 shutdown_connections 2022-02-02T18:25:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.941+0000 7fb463fff700 1 -- 172.21.15.96:0/1717536458 wait complete. 2022-02-02T18:25:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 Processor -- start 2022-02-02T18:25:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 -- start start 2022-02-02T18:25:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f6530 0x7fb464106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641078f0 con 0x7fb4640f77d0 2022-02-02T18:25:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb463fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464108100 con 0x7fb4640f6530 2022-02-02T18:25:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb4627fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb4627fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53724/0 (socket says 172.21.15.96:53724) 2022-02-02T18:25:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.942+0000 7fb4627fc700 1 -- 172.21.15.96:0/419133457 learned_addr learned my addr 172.21.15.96:0/419133457 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb462ffd700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f6530 0x7fb464106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb4627fc700 1 -- 172.21.15.96:0/419133457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f6530 msgr2=0x7fb464106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb4627fc700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f6530 0x7fb464106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb4627fc700 1 -- 172.21.15.96:0/419133457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454005040 con 0x7fb4640f77d0 2022-02-02T18:25:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb4627fc700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb45800c530 tx=0x7fb458007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45800f650 con 0x7fb4640f77d0 2022-02-02T18:25:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464108380 con 0x7fb4640f77d0 2022-02-02T18:25:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb45800fc60 con 0x7fb4640f77d0 2022-02-02T18:25:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb458012cd0 con 0x7fb4640f77d0 2022-02-02T18:25:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.943+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464108940 con 0x7fb4640f77d0 2022-02-02T18:25:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.944+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464059100 con 0x7fb4640f77d0 2022-02-02T18:25:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.944+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb458010070 con 0x7fb4640f77d0 2022-02-02T18:25:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.945+0000 7fb44b7fe700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 0x7fb44c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.945+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb4580817b0 con 0x7fb4640f77d0 2022-02-02T18:25:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.945+0000 7fb462ffd700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 0x7fb44c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:51.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.945+0000 7fb462ffd700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 0x7fb44c0672e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb454004e30 tx=0x7fb454009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:51.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:51.949+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb45804f8b0 con 0x7fb4640f77d0 2022-02-02T18:25:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.122+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4640fee80 con 0x7fb44c064e20 2022-02-02T18:25:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.131+0000 7fb44b7fe700 1 -- 172.21.15.96:0/419133457 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fb4640fee80 con 0x7fb44c064e20 2022-02-02T18:25:52.133 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:25:52.133 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (9m) 4s ago 10m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:25:52.133 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (100s) 4s ago 10m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:25:52.134 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (96s) 90s ago 9m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:25:52.134 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (9m) 4s ago 10m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:25:52.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (6m) 4s ago 6m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:25:52.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (118s) 4s ago 6m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:25:52.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (6m) 90s ago 6m 5337M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:25:52.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2m) 90s ago 6m 13.5M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:25:52.135 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3m) 4s ago 11m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:25:52.136 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3m) 90s ago 9m 416M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:25:52.136 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2m) 4s ago 11m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:25:52.136 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2m) 90s ago 9m 41.7M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:25:52.136 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (10m) 4s ago 10m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:25:52.136 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 90s ago 9m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:25:52.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (77s) 4s ago 9m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:25:52.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (44s) 4s ago 8m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:25:52.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (11s) 4s ago 8m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:25:52.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (8m) 90s ago 8m 939M 4096M 16.2.4 8d91d370c2b8 75c7985b89c5 2022-02-02T18:25:52.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (7m) 90s ago 7m 797M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:25:52.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (7m) 90s ago 7m 866M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:25:52.138 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (9m) 4s ago 9m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:25:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 msgr2=0x7fb44c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 0x7fb44c0672e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb454004e30 tx=0x7fb454009b30).stop 2022-02-02T18:25:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 msgr2=0x7fb4641072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb45800c530 tx=0x7fb458007e20).stop 2022-02-02T18:25:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 shutdown_connections 2022-02-02T18:25:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb44c064e20 0x7fb44c0672e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4640f6530 0x7fb464106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 --2- 172.21.15.96:0/419133457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640f77d0 0x7fb4641072f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 >> 172.21.15.96:0/419133457 conn(0x7fb4640f1c90 msgr2=0x7fb4640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 shutdown_connections 2022-02-02T18:25:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.133+0000 7fb463fff700 1 -- 172.21.15.96:0/419133457 wait complete. 2022-02-02T18:25:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.231+0000 7f2d57fff700 1 -- 172.21.15.96:0/3922934662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f5440 msgr2=0x7f2d580f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 --2- 172.21.15.96:0/3922934662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f5440 0x7f2d580f5860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2d4c004660 tx=0x7f2d4c009b30).stop 2022-02-02T18:25:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 -- 172.21.15.96:0/3922934662 shutdown_connections 2022-02-02T18:25:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 --2- 172.21.15.96:0/3922934662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f66e0 0x7f2d580f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 --2- 172.21.15.96:0/3922934662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f5440 0x7f2d580f5860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 -- 172.21.15.96:0/3922934662 >> 172.21.15.96:0/3922934662 conn(0x7f2d580f0ba0 msgr2=0x7f2d580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 -- 172.21.15.96:0/3922934662 shutdown_connections 2022-02-02T18:25:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 -- 172.21.15.96:0/3922934662 wait complete. 2022-02-02T18:25:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 Processor -- start 2022-02-02T18:25:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.232+0000 7f2d57fff700 1 -- start start 2022-02-02T18:25:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f5440 0x7f2d58109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580603c0 con 0x7f2d580f66e0 2022-02-02T18:25:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58060500 con 0x7f2d580f5440 2022-02-02T18:25:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53732/0 (socket says 172.21.15.96:53732) 2022-02-02T18:25:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 -- 172.21.15.96:0/2021504785 learned_addr learned my addr 172.21.15.96:0/2021504785 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d56ffd700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f5440 0x7f2d58109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 -- 172.21.15.96:0/2021504785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f5440 msgr2=0x7f2d58109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f5440 0x7f2d58109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 -- 172.21.15.96:0/2021504785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c005040 con 0x7f2d580f66e0 2022-02-02T18:25:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d567fc700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f2d4800c790 tx=0x7f2d48007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4800e680 con 0x7f2d580f66e0 2022-02-02T18:25:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5810c570 con 0x7f2d580f66e0 2022-02-02T18:25:52.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d4800ec90 con 0x7f2d580f66e0 2022-02-02T18:25:52.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d48013d60 con 0x7f2d580f66e0 2022-02-02T18:25:52.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.233+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5810cb00 con 0x7f2d580f66e0 2022-02-02T18:25:52.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.234+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d58045ad0 con 0x7f2d580f66e0 2022-02-02T18:25:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.235+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d4801a060 con 0x7f2d580f66e0 2022-02-02T18:25:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.235+0000 7f2d3f7fe700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 0x7f2d400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.235+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2d48081c60 con 0x7f2d580f66e0 2022-02-02T18:25:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.235+0000 7f2d56ffd700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 0x7f2d400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.236+0000 7f2d56ffd700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 0x7f2d400672e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2d4c004e30 tx=0x7f2d4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.239+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d4804fd60 con 0x7f2d580f66e0 2022-02-02T18:25:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.470+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d58027a00 con 0x7f2d580f66e0 2022-02-02T18:25:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.471+0000 7f2d3f7fe700 1 -- 172.21.15.96:0/2021504785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+808 (secure 0 0 0) 0x7f2d48018070 con 0x7f2d580f66e0 2022-02-02T18:25:52.473 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:25:52.473 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:25:52.473 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:25:52.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:52.474 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:25:52.474 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:25:52.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:52.475 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:25:52.475 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3, 2022-02-02T18:25:52.475 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 3 2022-02-02T18:25:52.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:52.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:25:52.476 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:25:52.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:25:52.476 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:25:52.476 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-02-02T18:25:52.477 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 7 2022-02-02T18:25:52.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:25:52.477 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:25:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 msgr2=0x7f2d400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 0x7f2d400672e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2d4c004e30 tx=0x7f2d4c009b30).stop 2022-02-02T18:25:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 msgr2=0x7f2d5810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f2d4800c790 tx=0x7f2d48007d70).stop 2022-02-02T18:25:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 shutdown_connections 2022-02-02T18:25:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d40064e20 0x7f2d400672e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d580f5440 0x7f2d58109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 --2- 172.21.15.96:0/2021504785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d580f66e0 0x7f2d5810bfc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 >> 172.21.15.96:0/2021504785 conn(0x7f2d580f0ba0 msgr2=0x7f2d580fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 shutdown_connections 2022-02-02T18:25:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.473+0000 7f2d57fff700 1 -- 172.21.15.96:0/2021504785 wait complete. 2022-02-02T18:25:52.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- 172.21.15.96:0/3438448730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 msgr2=0x7fd4380f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 --2- 172.21.15.96:0/3438448730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd4380f6b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd42c004660 tx=0x7fd42c009b30).stop 2022-02-02T18:25:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- 172.21.15.96:0/3438448730 shutdown_connections 2022-02-02T18:25:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 --2- 172.21.15.96:0/3438448730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 0x7fd4380f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 --2- 172.21.15.96:0/3438448730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd4380f6b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- 172.21.15.96:0/3438448730 >> 172.21.15.96:0/3438448730 conn(0x7fd4380f1e40 msgr2=0x7fd4380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- 172.21.15.96:0/3438448730 shutdown_connections 2022-02-02T18:25:52.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- 172.21.15.96:0/3438448730 wait complete. 2022-02-02T18:25:52.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 Processor -- start 2022-02-02T18:25:52.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.571+0000 7fd43edd7700 1 -- start start 2022-02-02T18:25:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43edd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43edd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 0x7fd438069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43edd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43806a380 con 0x7fd4380f66e0 2022-02-02T18:25:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43edd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43806a4c0 con 0x7fd4380f7980 2022-02-02T18:25:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53740/0 (socket says 172.21.15.96:53740) 2022-02-02T18:25:52.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 -- 172.21.15.96:0/2611204495 learned_addr learned my addr 172.21.15.96:0/2611204495 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:25:52.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd437fff700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 0x7fd438069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 -- 172.21.15.96:0/2611204495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 msgr2=0x7fd438069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 0x7fd438069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 -- 172.21.15.96:0/2611204495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c005040 con 0x7fd4380f66e0 2022-02-02T18:25:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.572+0000 7fd43cb73700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd42c004f60 tx=0x7fd42c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.573+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd42c018070 con 0x7fd4380f66e0 2022-02-02T18:25:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.573+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd42c009770 con 0x7fd4380f66e0 2022-02-02T18:25:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.573+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43806a740 con 0x7fd4380f66e0 2022-02-02T18:25:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.573+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd42c01c3c0 con 0x7fd4380f66e0 2022-02-02T18:25:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.573+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43806aca0 con 0x7fd4380f66e0 2022-02-02T18:25:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.574+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd438045ad0 con 0x7fd4380f66e0 2022-02-02T18:25:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.574+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd42c01d420 con 0x7fd4380f66e0 2022-02-02T18:25:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.574+0000 7fd4357fa700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 0x7fd428067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:25:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.574+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd42c083840 con 0x7fd4380f66e0 2022-02-02T18:25:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.574+0000 7fd437fff700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 0x7fd428067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:25:52.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.575+0000 7fd437fff700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 0x7fd428067290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd4240041d0 tx=0x7fd424009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:25:52.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.579+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd42c051a00 con 0x7fd4380f66e0 2022-02-02T18:25:52.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:52.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:52.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:25:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:25:52.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2022-02-02T18:25:52.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:52.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:52.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2021504785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.780+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4380586e0 con 0x7fd4380f66e0 2022-02-02T18:25:52.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:52.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:52.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:25:52.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:25:52.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:25:52.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2022-02-02T18:25:52.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:52.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:25:52.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2021504785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:25:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.781+0000 7fd4357fa700 1 -- 172.21.15.96:0/2611204495 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1838 (secure 0 0 0) 0x7fd42c055020 con 0x7fd4380f66e0 2022-02-02T18:25:52.786 INFO:teuthology.orchestra.run.smithi096.stdout:e39 2022-02-02T18:25:52.786 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:25:52.787 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:25:52.787 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:25:52.787 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:52.787 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:25:52.787 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:25:52.788 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 39 2022-02-02T18:25:52.788 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:25:52.788 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:25:52.788 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:25:45.023937+0000 2022-02-02T18:25:52.789 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:25:52.789 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:25:52.789 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:25:52.789 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:25:52.790 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:25:52.790 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:25:52.790 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:25:52.790 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:25:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:25:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:25:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:25:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:25:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:25:52.792 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:25:52.792 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:25:52.792 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:25:52.792 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:25:52.793 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:25:52.793 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:25:52.793 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:25:52.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:25:52.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:25:52.794 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:52.794 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:52.794 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:25:52.794 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:25:52.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:25:52.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:25:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 msgr2=0x7fd428067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 0x7fd428067290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd4240041d0 tx=0x7fd424009040).stop 2022-02-02T18:25:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 msgr2=0x7fd43806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:25:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd42c004f60 tx=0x7fd42c009b30).stop 2022-02-02T18:25:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 shutdown_connections 2022-02-02T18:25:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd428064dd0 0x7fd428067290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4380f66e0 0x7fd43806b9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 --2- 172.21.15.96:0/2611204495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4380f7980 0x7fd438069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:25:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 >> 172.21.15.96:0/2611204495 conn(0x7fd4380f1e40 msgr2=0x7fd4380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:25:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 shutdown_connections 2022-02-02T18:25:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:25:52.783+0000 7fd43edd7700 1 -- 172.21.15.96:0/2611204495 wait complete. 2022-02-02T18:25:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 39 2022-02-02T18:25:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:53 smithi096 ceph-mon[101353]: pgmap v95: 65 pgs: 3 peering, 23 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4075/32682 objects degraded (12.469%) 2022-02-02T18:25:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2611204495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:25:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:53 smithi159 ceph-mon[69013]: pgmap v95: 65 pgs: 3 peering, 23 active+undersized+degraded, 1 active+undersized, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4075/32682 objects degraded (12.469%) 2022-02-02T18:25:53.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2611204495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:25:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:54 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4075/32682 objects degraded (12.469%), 23 pgs degraded) 2022-02-02T18:25:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:54 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4075/32682 objects degraded (12.469%), 23 pgs degraded) 2022-02-02T18:25:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:56 smithi159 ceph-mon[69013]: pgmap v96: 65 pgs: 3 peering, 62 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 485 B/s rd, 1 op/s 2022-02-02T18:25:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:56 smithi096 ceph-mon[101353]: pgmap v96: 65 pgs: 3 peering, 62 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 485 B/s rd, 1 op/s 2022-02-02T18:25:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:58 smithi159 ceph-mon[69013]: pgmap v97: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2022-02-02T18:25:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:25:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:25:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:58 smithi096 ceph-mon[101353]: pgmap v97: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2022-02-02T18:25:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:25:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:00 smithi159 ceph-mon[69013]: pgmap v98: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 878 B/s rd, 1 op/s 2022-02-02T18:26:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:00 smithi096 ceph-mon[101353]: pgmap v98: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 878 B/s rd, 1 op/s 2022-02-02T18:26:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:02 smithi159 ceph-mon[69013]: pgmap v99: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 793 B/s rd, 1 op/s 2022-02-02T18:26:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:02 smithi096 ceph-mon[101353]: pgmap v99: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 793 B/s rd, 1 op/s 2022-02-02T18:26:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:04 smithi159 ceph-mon[69013]: pgmap v100: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2022-02-02T18:26:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:04 smithi096 ceph-mon[101353]: pgmap v100: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2022-02-02T18:26:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:06 smithi159 ceph-mon[69013]: pgmap v101: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2022-02-02T18:26:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:06 smithi096 ceph-mon[101353]: pgmap v101: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2022-02-02T18:26:07.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:26:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:26:08.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:08 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:26:08.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:08 smithi159 ceph-mon[69013]: Upgrade: osd.3 is safe to restart 2022-02-02T18:26:08.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:08 smithi159 ceph-mon[69013]: pgmap v102: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:08.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:08 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2022-02-02T18:26:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:08 smithi096 ceph-mon[101353]: Upgrade: osd.3 is safe to restart 2022-02-02T18:26:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:08 smithi096 ceph-mon[101353]: pgmap v102: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:09 smithi159 ceph-mon[69013]: Upgrade: Updating osd.3 2022-02-02T18:26:09.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:09 smithi159 ceph-mon[69013]: Deploying daemon osd.3 on smithi159 2022-02-02T18:26:09.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:09 smithi096 ceph-mon[101353]: Upgrade: Updating osd.3 2022-02-02T18:26:09.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:09 smithi096 ceph-mon[101353]: Deploying daemon osd.3 on smithi159 2022-02-02T18:26:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:10 smithi159 ceph-mon[69013]: pgmap v103: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:10.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 systemd[1]: Stopping Ceph osd.3 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:26:10.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 conmon[42212]: debug 2022-02-02T18:26:10.130+0000 7f825ab00700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:26:10.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 conmon[42212]: debug 2022-02-02T18:26:10.130+0000 7f825ab00700 -1 osd.3 67 *** Got signal Terminated *** 2022-02-02T18:26:10.741 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 conmon[42212]: debug 2022-02-02T18:26:10.130+0000 7f825ab00700 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:26:10.741 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 bash[75656]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.3 2022-02-02T18:26:10.741 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 bash[75656]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-3" found: no such container 2022-02-02T18:26:10.741 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 bash[75656]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.3" found: no such container 2022-02-02T18:26:10.742 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:10 smithi096 ceph-mon[101353]: pgmap v103: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:11.276 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:10 smithi159 podman[75983]: 2022-02-02T18:26:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 failed (root=default,host=smithi159) (connection refused reported by osd.5) 2022-02-02T18:26:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:11 smithi159 ceph-mon[69013]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 failed (root=default,host=smithi159) (connection refused reported by osd.5) 2022-02-02T18:26:11.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.4 2022-02-02T18:26:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.5 2022-02-02T18:26:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:11.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.0 2022-02-02T18:26:11.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.1 2022-02-02T18:26:11.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:11 smithi096 ceph-mon[101353]: osd.3 reported immediately failed by osd.2 2022-02-02T18:26:12.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:11 smithi159 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.3.service: Succeeded. 2022-02-02T18:26:12.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:11 smithi159 systemd[1]: Stopped Ceph osd.3 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:26:12.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:11 smithi159 systemd[1]: Starting Ceph osd.3 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:26:12.525 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 podman[76286]: 2022-02-02T18:26:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:12 smithi159 ceph-mon[69013]: pgmap v104: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:12 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:26:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:12 smithi159 ceph-mon[69013]: osdmap e68: 6 total, 5 up, 6 in 2022-02-02T18:26:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:12 smithi096 ceph-mon[101353]: pgmap v104: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:12 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:26:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:12 smithi096 ceph-mon[101353]: osdmap e68: 6 total, 5 up, 6 in 2022-02-02T18:26:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:13.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:26:13.026 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-02-02T18:26:13.027 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:26:13.027 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-02-02T18:26:13.027 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2022-02-02T18:26:13.027 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2022-02-02T18:26:13.028 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2022-02-02T18:26:13.028 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2022-02-02T18:26:13.028 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-02-02T18:26:13.028 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 bash[76132]: --> ceph-volume lvm activate successful for osd ID: 3 2022-02-02T18:26:13.029 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2022-02-02T18:26:13.029 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2022-02-02T18:26:13.029 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2022-02-02T18:26:13.029 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2022-02-02T18:26:13.029 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-02-02T18:26:13.030 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:12 smithi159 conmon[76326]: --> ceph-volume lvm activate successful for osd ID: 3 2022-02-02T18:26:13.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:13 smithi159 ceph-mon[69013]: osdmap e69: 6 total, 5 up, 6 in 2022-02-02T18:26:13.458 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:13 smithi159 podman[76561]: 2022-02-02T18:26:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:13 smithi096 ceph-mon[101353]: osdmap e69: 6 total, 5 up, 6 in 2022-02-02T18:26:13.725 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:13 smithi159 bash[76132]: b9aab909b261f1c34b4152279475a9f99cba85b4e0eff1e218eaa7b2151d975f 2022-02-02T18:26:13.726 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:13 smithi159 ceph-osd[76626]: -- 172.21.15.159:0/2372300373 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55851761a340 con 0x5585175e1000 2022-02-02T18:26:13.726 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:13 smithi159 systemd[1]: Started Ceph osd.3 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:26:14.525 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:14 smithi159 conmon[76602]: 2022-02-02T18:26:14.058+0000 7ff067db0240 -1 Falling back to public interface 2022-02-02T18:26:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:26:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:26:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:26:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2022-02-02T18:26:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:26:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:26:14.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:15.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:15 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:26:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:15 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:26:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:16 smithi159 ceph-mon[69013]: pgmap v108: 65 pgs: 28 active+undersized+degraded, 2 stale+active+clean, 1 active+undersized, 34 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5072/32682 objects degraded (15.519%) 2022-02-02T18:26:16.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:16 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 5072/32682 objects degraded (15.519%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:16 smithi096 ceph-mon[101353]: pgmap v108: 65 pgs: 28 active+undersized+degraded, 2 stale+active+clean, 1 active+undersized, 34 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5072/32682 objects degraded (15.519%) 2022-02-02T18:26:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:16 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 5072/32682 objects degraded (15.519%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:18 smithi159 ceph-mon[69013]: pgmap v109: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:18.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:18 smithi096 ceph-mon[101353]: pgmap v109: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:19.947 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:19.947 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:19 smithi159 ceph-mon[69013]: pgmap v110: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:19 smithi096 ceph-mon[101353]: pgmap v110: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: pgmap v111: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2022-02-02T18:26:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:26:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:22 smithi159 ceph-mon[69013]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:26:22.530 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:22 smithi159 conmon[76602]: 2022-02-02T18:26:22.066+0000 7ff067db0240 -1 osd.3 67 log_to_monitors true 2022-02-02T18:26:22.530 INFO:journalctl@ceph.osd.3.smithi159.stdout:Feb 02 18:26:22 smithi159 conmon[76602]: 2022-02-02T18:26:22.288+0000 7ff058149700 -1 osd.3 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:26:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: pgmap v111: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:22.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2022-02-02T18:26:22.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:26:22.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:22 smithi096 ceph-mon[101353]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T18:26:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- 172.21.15.96:0/4107328432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f77d0 msgr2=0x7fec040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/4107328432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f77d0 0x7fec040f7c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7febf8004660 tx=0x7febf8009b30).stop 2022-02-02T18:26:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- 172.21.15.96:0/4107328432 shutdown_connections 2022-02-02T18:26:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/4107328432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f77d0 0x7fec040f7c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/4107328432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f6530 0x7fec040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- 172.21.15.96:0/4107328432 >> 172.21.15.96:0/4107328432 conn(0x7fec040f1cd0 msgr2=0x7fec040f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- 172.21.15.96:0/4107328432 shutdown_connections 2022-02-02T18:26:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- 172.21.15.96:0/4107328432 wait complete. 2022-02-02T18:26:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 Processor -- start 2022-02-02T18:26:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.885+0000 7fec0a6e1700 1 -- start start 2022-02-02T18:26:22.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec0a6e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:22.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec0a6e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f77d0 0x7fec04107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:22.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec0a6e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04107870 con 0x7fec040f6530 2022-02-02T18:26:22.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec0a6e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04108080 con 0x7fec040f77d0 2022-02-02T18:26:22.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:22.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53810/0 (socket says 172.21.15.96:53810) 2022-02-02T18:26:22.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 -- 172.21.15.96:0/1907181926 learned_addr learned my addr 172.21.15.96:0/1907181926 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:22.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec08ede700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f77d0 0x7fec04107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:22.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 -- 172.21.15.96:0/1907181926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f77d0 msgr2=0x7fec04107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:22.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f77d0 0x7fec04107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:22.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 -- 172.21.15.96:0/1907181926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8005040 con 0x7fec040f6530 2022-02-02T18:26:22.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec096df700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7febfc00d7f0 tx=0x7febfc004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:22.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febfc00f490 con 0x7fec040f6530 2022-02-02T18:26:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04108300 con 0x7fec040f6530 2022-02-02T18:26:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febfc00f040 con 0x7fec040f6530 2022-02-02T18:26:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.886+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febfc0139b0 con 0x7fec040f6530 2022-02-02T18:26:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.887+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec041088c0 con 0x7fec040f6530 2022-02-02T18:26:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.887+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04059100 con 0x7fec040f6530 2022-02-02T18:26:22.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.888+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7febfc01a030 con 0x7fec040f6530 2022-02-02T18:26:22.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.888+0000 7fec01ffb700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 0x7febec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:22.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.888+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6547+0+0 (secure 0 0 0) 0x7febfc081870 con 0x7fec040f6530 2022-02-02T18:26:22.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.888+0000 7fec08ede700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 0x7febec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:22.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.889+0000 7fec08ede700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 0x7febec0672e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7febf8004630 tx=0x7febf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:22.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:22.893+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7febfc04f970 con 0x7fec040f6530 2022-02-02T18:26:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.069+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec040fedd0 con 0x7febec064e20 2022-02-02T18:26:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.070+0000 7fec01ffb700 1 -- 172.21.15.96:0/1907181926 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fec040fedd0 con 0x7febec064e20 2022-02-02T18:26:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.071+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 msgr2=0x7febec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 0x7febec0672e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7febf8004630 tx=0x7febf8009b30).stop 2022-02-02T18:26:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 msgr2=0x7fec04106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7febfc00d7f0 tx=0x7febfc004e80).stop 2022-02-02T18:26:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 shutdown_connections 2022-02-02T18:26:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febec064e20 0x7febec0672e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec040f6530 0x7fec04106d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 --2- 172.21.15.96:0/1907181926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec040f77d0 0x7fec04107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 >> 172.21.15.96:0/1907181926 conn(0x7fec040f1cd0 msgr2=0x7fec040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 shutdown_connections 2022-02-02T18:26:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.072+0000 7fec0a6e1700 1 -- 172.21.15.96:0/1907181926 wait complete. 2022-02-02T18:26:23.083 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:26:23.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 -- 172.21.15.96:0/2904921880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f6530 msgr2=0x7fdfcc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 --2- 172.21.15.96:0/2904921880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc0f6950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdfbc004660 tx=0x7fdfbc009b30).stop 2022-02-02T18:26:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 -- 172.21.15.96:0/2904921880 shutdown_connections 2022-02-02T18:26:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 --2- 172.21.15.96:0/2904921880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 --2- 172.21.15.96:0/2904921880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc0f6950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 -- 172.21.15.96:0/2904921880 >> 172.21.15.96:0/2904921880 conn(0x7fdfcc0f1c90 msgr2=0x7fdfcc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 -- 172.21.15.96:0/2904921880 shutdown_connections 2022-02-02T18:26:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.172+0000 7fdfd1398700 1 -- 172.21.15.96:0/2904921880 wait complete. 2022-02-02T18:26:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 Processor -- start 2022-02-02T18:26:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 -- start start 2022-02-02T18:26:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1078c0 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfd1398700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc108100 con 0x7fdfcc0f6530 2022-02-02T18:26:23.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfcb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfcb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53822/0 (socket says 172.21.15.96:53822) 2022-02-02T18:26:23.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfcb7fe700 1 -- 172.21.15.96:0/1095919195 learned_addr learned my addr 172.21.15.96:0/1095919195 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:23.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.173+0000 7fdfcbfff700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfcb7fe700 1 -- 172.21.15.96:0/1095919195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f6530 msgr2=0x7fdfcc106dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfcb7fe700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc106dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfcb7fe700 1 -- 172.21.15.96:0/1095919195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc005040 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfcb7fe700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdfc00026d0 tx=0x7fdfc0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfc00079c0 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc1083e0 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdfc000f040 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfc00148b0 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.174+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc108920 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.175+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc059100 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.177+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdfc0007b20 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.177+0000 7fdfc8ff9700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 0x7fdfb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.177+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdfc0081d00 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.177+0000 7fdfcbfff700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 0x7fdfb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.178+0000 7fdfcbfff700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 0x7fdfb40672e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfbc013690 tx=0x7fdfbc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.181+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdfc004fe80 con 0x7fdfcc0f77d0 2022-02-02T18:26:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.379+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfcc0fee70 con 0x7fdfb4064e20 2022-02-02T18:26:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.389+0000 7fdfc8ff9700 1 -- 172.21.15.96:0/1095919195 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fdfcc0fee70 con 0x7fdfb4064e20 2022-02-02T18:26:23.390 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:26:23.390 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (9m) 35s ago 10m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:26:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2m) 35s ago 10m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:26:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2m) 5s ago 10m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:26:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (9m) 35s ago 10m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:26:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (6m) 35s ago 6m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:26:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2m) 35s ago 6m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:26:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (6m) 5s ago 6m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:26:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2m) 5s ago 6m 14.4M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:26:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4m) 35s ago 11m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:26:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3m) 5s ago 10m 417M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:26:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3m) 35s ago 12m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:26:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2m) 5s ago 10m 67.5M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:26:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (10m) 35s ago 10m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:26:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (10m) 5s ago 10m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:26:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (109s) 35s ago 9m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:26:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (76s) 35s ago 9m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:26:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (42s) 35s ago 9m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:26:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (10s) 5s ago 8m 15.7M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:26:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (8m) 5s ago 8m 807M 4096M 16.2.4 8d91d370c2b8 6e988535937f 2022-02-02T18:26:23.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (8m) 5s ago 8m 876M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:26:23.395 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (9m) 35s ago 10m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:26:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.390+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 msgr2=0x7fdfb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.390+0000 7fdfd1398700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 0x7fdfb40672e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfbc013690 tx=0x7fdfbc009b30).stop 2022-02-02T18:26:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.390+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 msgr2=0x7fdfcc1072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.390+0000 7fdfd1398700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdfc00026d0 tx=0x7fdfc0009de0).stop 2022-02-02T18:26:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 shutdown_connections 2022-02-02T18:26:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfb4064e20 0x7fdfb40672e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfcc0f6530 0x7fdfcc106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 --2- 172.21.15.96:0/1095919195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfcc0f77d0 0x7fdfcc1072c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 >> 172.21.15.96:0/1095919195 conn(0x7fdfcc0f1c90 msgr2=0x7fdfcc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 shutdown_connections 2022-02-02T18:26:23.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.391+0000 7fdfd1398700 1 -- 172.21.15.96:0/1095919195 wait complete. 2022-02-02T18:26:23.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 -- 172.21.15.96:0/985789376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 msgr2=0x7fe01c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 --2- 172.21.15.96:0/985789376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c0f6cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe004004660 tx=0x7fe004009b30).stop 2022-02-02T18:26:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 -- 172.21.15.96:0/985789376 shutdown_connections 2022-02-02T18:26:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 --2- 172.21.15.96:0/985789376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c0f6cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 --2- 172.21.15.96:0/985789376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 0x7fe01c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 -- 172.21.15.96:0/985789376 >> 172.21.15.96:0/985789376 conn(0x7fe01c0f0d40 msgr2=0x7fe01c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.491 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:23 smithi096 ceph-mon[101353]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T18:26:23.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:23 smithi096 ceph-mon[101353]: osdmap e70: 6 total, 5 up, 6 in 2022-02-02T18:26:23.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:23 smithi096 ceph-mon[101353]: from='osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:23.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:23 smithi096 ceph-mon[101353]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:23.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.488+0000 7fe02279e700 1 -- 172.21.15.96:0/985789376 shutdown_connections 2022-02-02T18:26:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 -- 172.21.15.96:0/985789376 wait complete. 2022-02-02T18:26:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 Processor -- start 2022-02-02T18:26:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 -- start start 2022-02-02T18:26:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 0x7fe01c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1069b0 con 0x7fe01c0f6860 2022-02-02T18:26:23.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe02279e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1071c0 con 0x7fe01c0f55c0 2022-02-02T18:26:23.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe013fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe013fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53842/0 (socket says 172.21.15.96:53842) 2022-02-02T18:26:23.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.489+0000 7fe013fff700 1 -- 172.21.15.96:0/3725542527 learned_addr learned my addr 172.21.15.96:0/3725542527 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:23.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe01bfff700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 0x7fe01c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe013fff700 1 -- 172.21.15.96:0/3725542527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 msgr2=0x7fe01c105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe013fff700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 0x7fe01c105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe013fff700 1 -- 172.21.15.96:0/3725542527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004005040 con 0x7fe01c0f6860 2022-02-02T18:26:23.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe013fff700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe004009990 tx=0x7fe004009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe004018070 con 0x7fe01c0f6860 2022-02-02T18:26:23.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c1073e0 con 0x7fe01c0f6860 2022-02-02T18:26:23.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe004007ba0 con 0x7fe01c0f6860 2022-02-02T18:26:23.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00401c3c0 con 0x7fe01c0f6860 2022-02-02T18:26:23.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.490+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c107940 con 0x7fe01c0f6860 2022-02-02T18:26:23.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.491+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000004fa0 con 0x7fe01c0f6860 2022-02-02T18:26:23.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.492+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe00401c680 con 0x7fe01c0f6860 2022-02-02T18:26:23.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.492+0000 7fe0197fa700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 0x7fe008067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.492+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe004083680 con 0x7fe01c0f6860 2022-02-02T18:26:23.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.492+0000 7fe01bfff700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 0x7fe008067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.493+0000 7fe01bfff700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 0x7fe008067290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe01c105c30 tx=0x7fe00c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.496+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0040519f0 con 0x7fe01c0f6860 2022-02-02T18:26:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.728+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe000005e80 con 0x7fe01c0f6860 2022-02-02T18:26:23.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.729+0000 7fe0197fa700 1 -- 172.21.15.96:0/3725542527 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+808 (secure 0 0 0) 0x7fe004054fd0 con 0x7fe01c0f6860 2022-02-02T18:26:23.731 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:26:23.731 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:26:23.731 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:26:23.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:23.732 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:26:23.732 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:26:23.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:23.732 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:26:23.732 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2, 2022-02-02T18:26:23.733 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 4 2022-02-02T18:26:23.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:23.733 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:26:23.733 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:26:23.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:23.734 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:26:23.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6, 2022-02-02T18:26:23.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 8 2022-02-02T18:26:23.734 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:26:23.735 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:26:23.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 msgr2=0x7fe008067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 0x7fe008067290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe01c105c30 tx=0x7fe00c00b040).stop 2022-02-02T18:26:23.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 msgr2=0x7fe01c1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe004009990 tx=0x7fe004009b30).stop 2022-02-02T18:26:23.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 shutdown_connections 2022-02-02T18:26:23.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe008064dd0 0x7fe008067290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe01c0f55c0 0x7fe01c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 --2- 172.21.15.96:0/3725542527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe01c0f6860 0x7fe01c1063b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 >> 172.21.15.96:0/3725542527 conn(0x7fe01c0f0d40 msgr2=0x7fe01c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 shutdown_connections 2022-02-02T18:26:23.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.731+0000 7fe02279e700 1 -- 172.21.15.96:0/3725542527 wait complete. 2022-02-02T18:26:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:23 smithi159 ceph-mon[69013]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T18:26:23.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:23 smithi159 ceph-mon[69013]: osdmap e70: 6 total, 5 up, 6 in 2022-02-02T18:26:23.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:23 smithi159 ceph-mon[69013]: from='osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:23.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:23 smithi159 ceph-mon[69013]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- 172.21.15.96:0/4268481090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f55c0 msgr2=0x7f96940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 --2- 172.21.15.96:0/4268481090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f55c0 0x7f96940f59e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9684004660 tx=0x7f9684009b30).stop 2022-02-02T18:26:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- 172.21.15.96:0/4268481090 shutdown_connections 2022-02-02T18:26:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 --2- 172.21.15.96:0/4268481090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f6860 0x7f96940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 --2- 172.21.15.96:0/4268481090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f55c0 0x7f96940f59e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- 172.21.15.96:0/4268481090 >> 172.21.15.96:0/4268481090 conn(0x7f96940f0d40 msgr2=0x7f96940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- 172.21.15.96:0/4268481090 shutdown_connections 2022-02-02T18:26:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- 172.21.15.96:0/4268481090 wait complete. 2022-02-02T18:26:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 Processor -- start 2022-02-02T18:26:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.830+0000 7f969c0b9700 1 -- start start 2022-02-02T18:26:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f55c0 0x7f9694109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940603c0 con 0x7f96940f6860 2022-02-02T18:26:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694060500 con 0x7f96940f55c0 2022-02-02T18:26:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53852/0 (socket says 172.21.15.96:53852) 2022-02-02T18:26:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 -- 172.21.15.96:0/55921888 learned_addr learned my addr 172.21.15.96:0/55921888 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699e55700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f55c0 0x7f9694109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 -- 172.21.15.96:0/55921888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f55c0 msgr2=0x7f9694109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f55c0 0x7f9694109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 -- 172.21.15.96:0/55921888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684005040 con 0x7f96940f6860 2022-02-02T18:26:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f9699654700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f96900026d0 tx=0x7f9690009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96900079c0 con 0x7f96940f6860 2022-02-02T18:26:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969410c780 con 0x7f96940f6860 2022-02-02T18:26:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f969000f040 con 0x7f96940f6860 2022-02-02T18:26:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96900137c0 con 0x7f96940f6860 2022-02-02T18:26:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.831+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969410cd10 con 0x7f96940f6860 2022-02-02T18:26:23.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.832+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96940f49b0 con 0x7f96940f6860 2022-02-02T18:26:23.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.833+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f96900090d0 con 0x7f96940f6860 2022-02-02T18:26:23.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.833+0000 7f968a7fc700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 0x7f9680067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:23.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.833+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9690081a40 con 0x7f96940f6860 2022-02-02T18:26:23.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.833+0000 7f9699e55700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 0x7f9680067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:23.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.834+0000 7f9699e55700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 0x7f9680067270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9694060040 tx=0x7f9684009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:23.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:23.837+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f969004fae0 con 0x7f96940f6860 2022-02-02T18:26:24.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.037+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9694045ad0 con 0x7f96940f6860 2022-02-02T18:26:24.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.038+0000 7f968a7fc700 1 -- 172.21.15.96:0/55921888 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1838 (secure 0 0 0) 0x7f9690053100 con 0x7f96940f6860 2022-02-02T18:26:24.040 INFO:teuthology.orchestra.run.smithi096.stdout:e39 2022-02-02T18:26:24.041 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:26:24.041 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:26:24.041 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:26:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:24.042 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:26:24.042 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:26:24.042 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 39 2022-02-02T18:26:24.043 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:26:24.043 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:26:24.043 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:25:45.023937+0000 2022-02-02T18:26:24.043 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:26:24.044 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:26:24.044 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:26:24.044 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:26:24.044 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:26:24.045 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:26:24.045 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:26:24.045 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:26:24.045 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:26:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:26:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:26:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:26:24.046 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:26:24.047 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:26:24.047 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:26:24.047 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:26:24.047 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:26:24.048 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:26:24.048 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:26:24.048 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:26:24.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:26:24.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:26:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:24.049 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:26:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:24.050 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:26:24.050 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:26:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.039+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 msgr2=0x7f9680067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:24.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.039+0000 7f969c0b9700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 0x7f9680067270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9694060040 tx=0x7f9684009b30).stop 2022-02-02T18:26:24.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.039+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 msgr2=0x7f969410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.039+0000 7f969c0b9700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f96900026d0 tx=0x7f9690009de0).stop 2022-02-02T18:26:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 shutdown_connections 2022-02-02T18:26:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9680064db0 0x7f9680067270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96940f55c0 0x7f9694109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 --2- 172.21.15.96:0/55921888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96940f6860 0x7f969410c1d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 >> 172.21.15.96:0/55921888 conn(0x7f96940f0d40 msgr2=0x7f96940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 shutdown_connections 2022-02-02T18:26:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:24.040+0000 7f969c0b9700 1 -- 172.21.15.96:0/55921888 wait complete. 2022-02-02T18:26:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 39 2022-02-02T18:26:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: pgmap v113: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:26:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125] boot 2022-02-02T18:26:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: osdmap e71: 6 total, 6 up, 6 in 2022-02-02T18:26:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:26:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3725542527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/55921888' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:26:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:24 smithi096 ceph-mon[101353]: osdmap e72: 6 total, 6 up, 6 in 2022-02-02T18:26:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: pgmap v113: 65 pgs: 37 active+undersized+degraded, 1 active+undersized, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6122/32682 objects degraded (18.732%) 2022-02-02T18:26:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:26:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: osd.3 [v2:172.21.15.159:6800/896030125,v1:172.21.15.159:6801/896030125] boot 2022-02-02T18:26:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: osdmap e71: 6 total, 6 up, 6 in 2022-02-02T18:26:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T18:26:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3725542527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/55921888' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:26:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:24 smithi159 ceph-mon[69013]: osdmap e72: 6 total, 6 up, 6 in 2022-02-02T18:26:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:25 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 6122/32682 objects degraded (18.732%), 37 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:25.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:25 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 6122/32682 objects degraded (18.732%), 37 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:26 smithi096 ceph-mon[101353]: pgmap v116: 65 pgs: 3 peering, 35 active+undersized+degraded, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 5788/32682 objects degraded (17.710%) 2022-02-02T18:26:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:26 smithi159 ceph-mon[69013]: pgmap v116: 65 pgs: 3 peering, 35 active+undersized+degraded, 27 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 5788/32682 objects degraded (17.710%) 2022-02-02T18:26:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:28 smithi159 ceph-mon[69013]: pgmap v117: 65 pgs: 3 peering, 28 active+undersized+degraded, 34 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4745/32682 objects degraded (14.519%) 2022-02-02T18:26:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:26:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:26:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:28 smithi096 ceph-mon[101353]: pgmap v117: 65 pgs: 3 peering, 28 active+undersized+degraded, 34 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4745/32682 objects degraded (14.519%) 2022-02-02T18:26:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:26:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:26:29.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:29 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4745/32682 objects degraded (14.519%), 28 pgs degraded) 2022-02-02T18:26:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:29 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4745/32682 objects degraded (14.519%), 28 pgs degraded) 2022-02-02T18:26:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:30 smithi159 ceph-mon[69013]: pgmap v118: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2022-02-02T18:26:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:30 smithi096 ceph-mon[101353]: pgmap v118: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2022-02-02T18:26:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:32 smithi159 ceph-mon[69013]: pgmap v119: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:32 smithi096 ceph-mon[101353]: pgmap v119: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:34 smithi159 ceph-mon[69013]: pgmap v120: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 540 B/s rd, 1 op/s 2022-02-02T18:26:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:34 smithi096 ceph-mon[101353]: pgmap v120: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 540 B/s rd, 1 op/s 2022-02-02T18:26:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:36 smithi159 ceph-mon[69013]: pgmap v121: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 977 B/s rd, 1 op/s 2022-02-02T18:26:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:36 smithi096 ceph-mon[101353]: pgmap v121: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 977 B/s rd, 1 op/s 2022-02-02T18:26:37.245 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:37.245 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:37 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:37.246 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:37 smithi159 ceph-mon[69013]: Upgrade: osd.4 is safe to restart 2022-02-02T18:26:37.246 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:37.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:37 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2022-02-02T18:26:37.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:37 smithi096 ceph-mon[101353]: Upgrade: osd.4 is safe to restart 2022-02-02T18:26:37.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:38.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:38 smithi159 ceph-mon[69013]: pgmap v122: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:38.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:38 smithi096 ceph-mon[101353]: pgmap v122: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:39.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:39 smithi159 ceph-mon[69013]: Upgrade: Updating osd.4 2022-02-02T18:26:39.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:39 smithi159 ceph-mon[69013]: Deploying daemon osd.4 on smithi159 2022-02-02T18:26:39.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:39 smithi096 ceph-mon[101353]: Upgrade: Updating osd.4 2022-02-02T18:26:39.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:39 smithi096 ceph-mon[101353]: Deploying daemon osd.4 on smithi159 2022-02-02T18:26:40.138 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:39 smithi159 systemd[1]: Stopping Ceph osd.4 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:26:40.139 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 conmon[47054]: debug 2022-02-02T18:26:40.033+0000 7f6413d8a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:26:40.139 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 conmon[47054]: debug 2022-02-02T18:26:40.033+0000 7f6413d8a700 -1 osd.4 72 *** Got signal Terminated *** 2022-02-02T18:26:40.139 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 conmon[47054]: debug 2022-02-02T18:26:40.033+0000 7f6413d8a700 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:26:40.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:40 smithi159 ceph-mon[69013]: pgmap v123: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:40 smithi096 ceph-mon[101353]: pgmap v123: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:26:40.659 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 bash[79808]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.4 2022-02-02T18:26:40.660 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 bash[79808]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-4" found: no such container 2022-02-02T18:26:40.660 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 bash[79808]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.4" found: no such container 2022-02-02T18:26:41.275 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:40 smithi159 podman[80138]: 2022-02-02T18:26:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 failed (root=default,host=smithi159) (connection refused reported by osd.0) 2022-02-02T18:26:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:41 smithi159 ceph-mon[69013]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 failed (root=default,host=smithi159) (connection refused reported by osd.0) 2022-02-02T18:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.2 2022-02-02T18:26:41.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:41.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.0 2022-02-02T18:26:41.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.3 2022-02-02T18:26:41.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.1 2022-02-02T18:26:41.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:41 smithi096 ceph-mon[101353]: osd.4 reported immediately failed by osd.5 2022-02-02T18:26:42.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:42 smithi159 ceph-mon[69013]: pgmap v124: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:42.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:42 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:26:42.152 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:41 smithi159 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.4.service: Succeeded. 2022-02-02T18:26:42.152 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:41 smithi159 systemd[1]: Stopped Ceph osd.4 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:26:42.152 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:41 smithi159 systemd[1]: Starting Ceph osd.4 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:26:42.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:42 smithi159 ceph-mon[69013]: osdmap e73: 6 total, 5 up, 6 in 2022-02-02T18:26:42.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:42.409 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 podman[80439]: 2022-02-02T18:26:42.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:42 smithi096 ceph-mon[101353]: pgmap v124: 65 pgs: 65 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:26:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:42 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:26:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:42 smithi096 ceph-mon[101353]: osdmap e73: 6 total, 5 up, 6 in 2022-02-02T18:26:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:43.026 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:26:43.026 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:26:43.026 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-02-02T18:26:43.026 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2022-02-02T18:26:43.027 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2022-02-02T18:26:43.027 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2022-02-02T18:26:43.027 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2022-02-02T18:26:43.027 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-02-02T18:26:43.028 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 bash[80285]: --> ceph-volume lvm activate successful for osd ID: 4 2022-02-02T18:26:43.028 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-02-02T18:26:43.028 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2022-02-02T18:26:43.028 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2022-02-02T18:26:43.028 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2022-02-02T18:26:43.029 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2022-02-02T18:26:43.029 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-02-02T18:26:43.029 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:42 smithi159 conmon[80479]: --> ceph-volume lvm activate successful for osd ID: 4 2022-02-02T18:26:43.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:43 smithi159 ceph-mon[69013]: osdmap e74: 6 total, 5 up, 6 in 2022-02-02T18:26:43.446 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:43 smithi159 podman[80716]: 2022-02-02T18:26:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:43 smithi096 ceph-mon[101353]: osdmap e74: 6 total, 5 up, 6 in 2022-02-02T18:26:43.775 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:43 smithi159 ceph-osd[80781]: -- 172.21.15.159:0/283168187 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556d8218a340 con 0x556d82150c00 2022-02-02T18:26:43.776 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:43 smithi159 bash[80285]: d955549d76b38603d5269e7a7672bd48aa0b5a971daa900dab58d629303dddf8 2022-02-02T18:26:43.776 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:43 smithi159 systemd[1]: Started Ceph osd.4 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:26:44.525 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:44 smithi159 conmon[80756]: 2022-02-02T18:26:44.080+0000 7fef8a8a7240 -1 Falling back to public interface 2022-02-02T18:26:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: pgmap v127: 65 pgs: 11 active+undersized+degraded, 5 stale+active+clean, 49 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1667/32682 objects degraded (5.101%) 2022-02-02T18:26:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 1667/32682 objects degraded (5.101%), 11 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:26:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:26:44.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: pgmap v127: 65 pgs: 11 active+undersized+degraded, 5 stale+active+clean, 49 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1667/32682 objects degraded (5.101%) 2022-02-02T18:26:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 1667/32682 objects degraded (5.101%), 11 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:26:44.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:26:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:45 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:26:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:45 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:26:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:46 smithi159 ceph-mon[69013]: pgmap v128: 65 pgs: 26 active+undersized+degraded, 1 stale+active+clean, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4674/32682 objects degraded (14.301%) 2022-02-02T18:26:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:46 smithi096 ceph-mon[101353]: pgmap v128: 65 pgs: 26 active+undersized+degraded, 1 stale+active+clean, 38 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4674/32682 objects degraded (14.301%) 2022-02-02T18:26:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:48 smithi159 ceph-mon[69013]: pgmap v129: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:48.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:48 smithi096 ceph-mon[101353]: pgmap v129: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:50.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:50 smithi159 ceph-mon[69013]: pgmap v130: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:50.477 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:50 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 6061/32682 objects degraded (18.545%), 34 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:50 smithi096 ceph-mon[101353]: pgmap v130: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:50 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 6061/32682 objects degraded (18.545%), 34 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:51.764 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:51 smithi159 conmon[80756]: 2022-02-02T18:26:51.432+0000 7fef8a8a7240 -1 osd.4 72 log_to_monitors true 2022-02-02T18:26:52.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: pgmap v131: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:52.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:52.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:52.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:52.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:26:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:26:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2022-02-02T18:26:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:26:52.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:51 smithi159 ceph-mon[69013]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:26:52.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: pgmap v131: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:52.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:52.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:52.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:26:52.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:26:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:26:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2022-02-02T18:26:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:26:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:51 smithi096 ceph-mon[101353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T18:26:52.525 INFO:journalctl@ceph.osd.4.smithi159.stdout:Feb 02 18:26:52 smithi159 conmon[80756]: 2022-02-02T18:26:52.239+0000 7fef7c443700 -1 osd.4 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:26:53.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:53 smithi159 ceph-mon[69013]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T18:26:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:53 smithi159 ceph-mon[69013]: from='osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:53 smithi159 ceph-mon[69013]: osdmap e75: 6 total, 5 up, 6 in 2022-02-02T18:26:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:53 smithi159 ceph-mon[69013]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:53 smithi096 ceph-mon[101353]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T18:26:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:53 smithi096 ceph-mon[101353]: from='osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:53 smithi096 ceph-mon[101353]: osdmap e75: 6 total, 5 up, 6 in 2022-02-02T18:26:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:53 smithi096 ceph-mon[101353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:26:54.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 -- 172.21.15.96:0/4160572801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 msgr2=0x7f6bec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 --2- 172.21.15.96:0/4160572801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec0f7c30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6be8004660 tx=0x7f6be8009b30).stop 2022-02-02T18:26:54.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 -- 172.21.15.96:0/4160572801 shutdown_connections 2022-02-02T18:26:54.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 --2- 172.21.15.96:0/4160572801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec0f7c30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 --2- 172.21.15.96:0/4160572801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 0x7f6bec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 -- 172.21.15.96:0/4160572801 >> 172.21.15.96:0/4160572801 conn(0x7f6bec0f1c90 msgr2=0x7f6bec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.149+0000 7f6bf246a700 1 -- 172.21.15.96:0/4160572801 shutdown_connections 2022-02-02T18:26:54.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 -- 172.21.15.96:0/4160572801 wait complete. 2022-02-02T18:26:54.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 Processor -- start 2022-02-02T18:26:54.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 -- start start 2022-02-02T18:26:54.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 0x7f6bec106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec107880 con 0x7f6bec0f77d0 2022-02-02T18:26:54.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf246a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec108090 con 0x7f6bec0f6530 2022-02-02T18:26:54.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf0c67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf0c67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53948/0 (socket says 172.21.15.96:53948) 2022-02-02T18:26:54.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.150+0000 7f6bf0c67700 1 -- 172.21.15.96:0/3181318857 learned_addr learned my addr 172.21.15.96:0/3181318857 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:54.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf1468700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 0x7f6bec106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf0c67700 1 -- 172.21.15.96:0/3181318857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 msgr2=0x7f6bec106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf0c67700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 0x7f6bec106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf0c67700 1 -- 172.21.15.96:0/3181318857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8005040 con 0x7f6bec0f77d0 2022-02-02T18:26:54.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf0c67700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6be8009990 tx=0x7f6be8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be8018070 con 0x7f6bec0f77d0 2022-02-02T18:26:54.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6be8007ba0 con 0x7f6bec0f77d0 2022-02-02T18:26:54.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be801c3c0 con 0x7f6bec0f77d0 2022-02-02T18:26:54.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec1082b0 con 0x7f6bec0f77d0 2022-02-02T18:26:54.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.151+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec108810 con 0x7f6bec0f77d0 2022-02-02T18:26:54.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.152+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec059100 con 0x7f6bec0f77d0 2022-02-02T18:26:54.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.153+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6be801d420 con 0x7f6bec0f77d0 2022-02-02T18:26:54.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.153+0000 7f6bddffb700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 0x7f6bd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.153+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6be80836a0 con 0x7f6bec0f77d0 2022-02-02T18:26:54.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.153+0000 7f6bf1468700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 0x7f6bd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.154+0000 7f6bf1468700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 0x7f6bd80672e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6bec106b00 tx=0x7f6be000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.158+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6be8051860 con 0x7f6bec0f77d0 2022-02-02T18:26:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.350+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bec0fee80 con 0x7f6bd8064e20 2022-02-02T18:26:54.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.351+0000 7f6bddffb700 1 -- 172.21.15.96:0/3181318857 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f6bec0fee80 con 0x7f6bd8064e20 2022-02-02T18:26:54.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 msgr2=0x7f6bd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 0x7f6bd80672e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6bec106b00 tx=0x7f6be000b040).stop 2022-02-02T18:26:54.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 msgr2=0x7f6bec107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6be8009990 tx=0x7f6be8009b30).stop 2022-02-02T18:26:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 shutdown_connections 2022-02-02T18:26:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bd8064e20 0x7f6bd80672e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bec0f6530 0x7f6bec106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 --2- 172.21.15.96:0/3181318857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bec0f77d0 0x7f6bec107280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 >> 172.21.15.96:0/3181318857 conn(0x7f6bec0f1c90 msgr2=0x7f6bec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 shutdown_connections 2022-02-02T18:26:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.353+0000 7f6bf246a700 1 -- 172.21.15.96:0/3181318857 wait complete. 2022-02-02T18:26:54.365 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:26:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 -- 172.21.15.96:0/1449649598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 msgr2=0x7f95980f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 --2- 172.21.15.96:0/1449649598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f95980f5850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9588004660 tx=0x7f9588009b30).stop 2022-02-02T18:26:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 -- 172.21.15.96:0/1449649598 shutdown_connections 2022-02-02T18:26:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 --2- 172.21.15.96:0/1449649598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f95980f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:26:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 --2- 172.21.15.96:0/1449649598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f95980f5850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 -- 172.21.15.96:0/1449649598 >> 172.21.15.96:0/1449649598 conn(0x7f95980f0b90 msgr2=0x7f95980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.452+0000 7f959c9de700 1 -- 172.21.15.96:0/1449649598 shutdown_connections 2022-02-02T18:26:54.456 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: pgmap v133: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:54.456 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:26:54.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065] boot 2022-02-02T18:26:54.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: osdmap e76: 6 total, 6 up, 6 in 2022-02-02T18:26:54.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:26:54.457 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:54 smithi096 ceph-mon[101353]: osdmap e77: 6 total, 6 up, 6 in 2022-02-02T18:26:54.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.453+0000 7f959c9de700 1 -- 172.21.15.96:0/1449649598 wait complete. 2022-02-02T18:26:54.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.453+0000 7f959c9de700 1 Processor -- start 2022-02-02T18:26:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.453+0000 7f959c9de700 1 -- start start 2022-02-02T18:26:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f959c9de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f959c9de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f9598107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f959c9de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95981079a0 con 0x7f95980f5430 2022-02-02T18:26:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f959c9de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598108120 con 0x7f95980f66d0 2022-02-02T18:26:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53958/0 (socket says 172.21.15.96:53958) 2022-02-02T18:26:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 -- 172.21.15.96:0/3170946865 learned_addr learned my addr 172.21.15.96:0/3170946865 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f9596ffd700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f9598107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 -- 172.21.15.96:0/3170946865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 msgr2=0x7f9598107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f9598107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 -- 172.21.15.96:0/3170946865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588005040 con 0x7f95980f5430 2022-02-02T18:26:54.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f9596ffd700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f9598107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:26:54.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.454+0000 7f95977fe700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9588004f60 tx=0x7f9588009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.455+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9588018070 con 0x7f95980f5430 2022-02-02T18:26:54.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.455+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598108340 con 0x7f95980f5430 2022-02-02T18:26:54.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.455+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95981088a0 con 0x7f95980f5430 2022-02-02T18:26:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.455+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9588007ba0 con 0x7f95980f5430 2022-02-02T18:26:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.455+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f958801c620 con 0x7f95980f5430 2022-02-02T18:26:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.456+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9578004fa0 con 0x7f95980f5430 2022-02-02T18:26:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.456+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f958801c890 con 0x7f95980f5430 2022-02-02T18:26:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.457+0000 7f957ffff700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 0x7f95800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.457+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95880837f0 con 0x7f95980f5430 2022-02-02T18:26:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.457+0000 7f9596ffd700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 0x7f95800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.457+0000 7f9596ffd700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 0x7f95800672e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f958c00b830 tx=0x7f958c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.461+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95880518f0 con 0x7f95980f5430 2022-02-02T18:26:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: pgmap v133: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6061/32682 objects degraded (18.545%) 2022-02-02T18:26:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:26:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: osd.4 [v2:172.21.15.159:6808/3473480065,v1:172.21.15.159:6809/3473480065] boot 2022-02-02T18:26:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: osdmap e76: 6 total, 6 up, 6 in 2022-02-02T18:26:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T18:26:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:54 smithi159 ceph-mon[69013]: osdmap e77: 6 total, 6 up, 6 in 2022-02-02T18:26:54.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.634+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9578000bc0 con 0x7f9580064e20 2022-02-02T18:26:54.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.643+0000 7f957ffff700 1 -- 172.21.15.96:0/3170946865 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f9578000bc0 con 0x7f9580064e20 2022-02-02T18:26:54.645 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:26:54.645 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (10m) 67s ago 11m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:26:54.645 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2m) 67s ago 11m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:26:54.646 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2m) 7s ago 10m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:26:54.646 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (10m) 67s ago 11m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:26:54.646 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (7m) 67s ago 7m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:26:54.646 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3m) 67s ago 7m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:26:54.647 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (7m) 7s ago 7m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:26:54.647 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3m) 7s ago 7m 14.6M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:26:54.647 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4m) 67s ago 12m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:26:54.647 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4m) 7s ago 10m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:26:54.648 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3m) 67s ago 12m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:26:54.648 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3m) 7s ago 10m 69.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:26:54.648 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (11m) 67s ago 11m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:26:54.649 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (10m) 7s ago 10m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:26:54.649 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2m) 67s ago 10m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:26:54.649 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (107s) 67s ago 9m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:26:54.650 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (74s) 67s ago 9m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:26:54.650 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (41s) 7s ago 9m 284M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:26:54.651 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (11s) 7s ago 8m 11.9M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:26:54.651 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (8m) 7s ago 8m 879M 4096M 16.2.4 8d91d370c2b8 a161e7382e83 2022-02-02T18:26:54.651 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (10m) 67s ago 10m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:26:54.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 msgr2=0x7f95800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 0x7f95800672e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f958c00b830 tx=0x7f958c008040).stop 2022-02-02T18:26:54.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 msgr2=0x7f9598106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9588004f60 tx=0x7f9588009b30).stop 2022-02-02T18:26:54.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 shutdown_connections 2022-02-02T18:26:54.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9580064e20 0x7f95800672e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95980f5430 0x7f9598106e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 --2- 172.21.15.96:0/3170946865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95980f66d0 0x7f9598107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 >> 172.21.15.96:0/3170946865 conn(0x7f95980f0b90 msgr2=0x7f959805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 shutdown_connections 2022-02-02T18:26:54.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.645+0000 7f959c9de700 1 -- 172.21.15.96:0/3170946865 wait complete. 2022-02-02T18:26:54.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 -- 172.21.15.96:0/289641715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f7980 msgr2=0x7fe0c80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/289641715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f7980 0x7fe0c80f7de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe0c4004660 tx=0x7fe0c4009b30).stop 2022-02-02T18:26:54.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 -- 172.21.15.96:0/289641715 shutdown_connections 2022-02-02T18:26:54.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/289641715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f7980 0x7fe0c80f7de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/289641715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f66e0 0x7fe0c80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 -- 172.21.15.96:0/289641715 >> 172.21.15.96:0/289641715 conn(0x7fe0c80f1e40 msgr2=0x7fe0c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 -- 172.21.15.96:0/289641715 shutdown_connections 2022-02-02T18:26:54.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.742+0000 7fe0cff6c700 1 -- 172.21.15.96:0/289641715 wait complete. 2022-02-02T18:26:54.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 Processor -- start 2022-02-02T18:26:54.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 -- start start 2022-02-02T18:26:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 0x7fe0c8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81079f0 con 0x7fe0c80f66e0 2022-02-02T18:26:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cff6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8107b30 con 0x7fe0c80f7980 2022-02-02T18:26:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cdd08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cdd08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53968/0 (socket says 172.21.15.96:53968) 2022-02-02T18:26:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.743+0000 7fe0cdd08700 1 -- 172.21.15.96:0/3351852190 learned_addr learned my addr 172.21.15.96:0/3351852190 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cd507700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 0x7fe0c8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cdd08700 1 -- 172.21.15.96:0/3351852190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 msgr2=0x7fe0c8107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cdd08700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 0x7fe0c8107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cdd08700 1 -- 172.21.15.96:0/3351852190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4005040 con 0x7fe0c80f66e0 2022-02-02T18:26:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cd507700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 0x7fe0c8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:26:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cdd08700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe0b800c530 tx=0x7fe0b8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b800f650 con 0x7fe0c80f66e0 2022-02-02T18:26:54.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c81084d0 con 0x7fe0c80f66e0 2022-02-02T18:26:54.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0b800fc60 con 0x7fe0c80f66e0 2022-02-02T18:26:54.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b8012d20 con 0x7fe0c80f66e0 2022-02-02T18:26:54.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.744+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c8108a90 con 0x7fe0c80f66e0 2022-02-02T18:26:54.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.746+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c8045ad0 con 0x7fe0c80f66e0 2022-02-02T18:26:54.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.746+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0b8019030 con 0x7fe0c80f66e0 2022-02-02T18:26:54.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.747+0000 7fe0be7fc700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 0x7fe0b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:54.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.747+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0b80816b0 con 0x7fe0c80f66e0 2022-02-02T18:26:54.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.747+0000 7fe0cd507700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 0x7fe0b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:54.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.747+0000 7fe0cd507700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 0x7fe0b4067290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe0c4009da0 tx=0x7fe0c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:54.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.751+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0b8053230 con 0x7fe0c80f66e0 2022-02-02T18:26:54.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.981+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0c80ff020 con 0x7fe0c80f66e0 2022-02-02T18:26:54.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.982+0000 7fe0be7fc700 1 -- 172.21.15.96:0/3351852190 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+808 (secure 0 0 0) 0x7fe0b8052e20 con 0x7fe0c80f66e0 2022-02-02T18:26:54.984 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:26:54.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:26:54.984 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:26:54.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:54.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:26:54.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:26:54.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:54.986 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:26:54.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2022-02-02T18:26:54.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 5 2022-02-02T18:26:54.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:54.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:26:54.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:26:54.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:26:54.987 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:26:54.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5, 2022-02-02T18:26:54.988 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 9 2022-02-02T18:26:54.988 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:26:54.988 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:26:54.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.983+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 msgr2=0x7fe0b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.983+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 0x7fe0b4067290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe0c4009da0 tx=0x7fe0c4009b30).stop 2022-02-02T18:26:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.983+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 msgr2=0x7fe0c8106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.983+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe0b800c530 tx=0x7fe0b8007e10).stop 2022-02-02T18:26:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 shutdown_connections 2022-02-02T18:26:54.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0b4064dd0 0x7fe0b4067290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c80f66e0 0x7fe0c8106f50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 --2- 172.21.15.96:0/3351852190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0c80f7980 0x7fe0c8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:54.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 >> 172.21.15.96:0/3351852190 conn(0x7fe0c80f1e40 msgr2=0x7fe0c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:54.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 shutdown_connections 2022-02-02T18:26:54.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:54.984+0000 7fe0cff6c700 1 -- 172.21.15.96:0/3351852190 wait complete. 2022-02-02T18:26:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.082+0000 7f9e3f339700 1 -- 172.21.15.96:0/226891220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 msgr2=0x7f9e380f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.082+0000 7f9e3f339700 1 --2- 172.21.15.96:0/226891220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e380f6e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9e34004660 tx=0x7f9e34009b30).stop 2022-02-02T18:26:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- 172.21.15.96:0/226891220 shutdown_connections 2022-02-02T18:26:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 --2- 172.21.15.96:0/226891220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e380f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:26:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 --2- 172.21.15.96:0/226891220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e380f6e70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- 172.21.15.96:0/226891220 >> 172.21.15.96:0/226891220 conn(0x7f9e380f0320 msgr2=0x7f9e380f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- 172.21.15.96:0/226891220 shutdown_connections 2022-02-02T18:26:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- 172.21.15.96:0/226891220 wait complete. 2022-02-02T18:26:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 Processor -- start 2022-02-02T18:26:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- start start 2022-02-02T18:26:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e3810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380f5510 con 0x7f9e380f6a50 2022-02-02T18:26:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.083+0000 7f9e3f339700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380f5650 con 0x7f9e380f73f0 2022-02-02T18:26:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53978/0 (socket says 172.21.15.96:53978) 2022-02-02T18:26:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 -- 172.21.15.96:0/3884025977 learned_addr learned my addr 172.21.15.96:0/3884025977 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:26:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3db36700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e3810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 -- 172.21.15.96:0/3884025977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 msgr2=0x7f9e3810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e3810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 -- 172.21.15.96:0/3884025977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34005040 con 0x7f9e380f6a50 2022-02-02T18:26:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3db36700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e3810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:26:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3e337700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9e34004f60 tx=0x7f9e34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:55.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e34018070 con 0x7f9e380f6a50 2022-02-02T18:26:55.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3810c530 con 0x7f9e380f6a50 2022-02-02T18:26:55.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e34007ba0 con 0x7f9e380f6a50 2022-02-02T18:26:55.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3401dea0 con 0x7f9e380f6a50 2022-02-02T18:26:55.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.084+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3810ca90 con 0x7f9e380f6a50 2022-02-02T18:26:55.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.085+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38045ad0 con 0x7f9e380f6a50 2022-02-02T18:26:55.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.086+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e3401d420 con 0x7f9e380f6a50 2022-02-02T18:26:55.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.086+0000 7f9e2effd700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 0x7f9e240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:26:55.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.086+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e34083990 con 0x7f9e380f6a50 2022-02-02T18:26:55.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.086+0000 7f9e3db36700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 0x7f9e240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:26:55.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.086+0000 7f9e3db36700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 0x7f9e240672e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9e2800b830 tx=0x7f9e28008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:26:55.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.090+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e34051a90 con 0x7f9e380f6a50 2022-02-02T18:26:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.292+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e380fdc90 con 0x7f9e380f6a50 2022-02-02T18:26:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.293+0000 7f9e2effd700 1 -- 172.21.15.96:0/3884025977 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1838 (secure 0 0 0) 0x7f9e340550b0 con 0x7f9e380f6a50 2022-02-02T18:26:55.295 INFO:teuthology.orchestra.run.smithi096.stdout:e39 2022-02-02T18:26:55.295 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:26:55.296 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:26:55.296 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:26:55.296 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:55.296 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:26:55.297 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:26:55.297 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 39 2022-02-02T18:26:55.297 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T18:26:55.297 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:26:55.298 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:25:45.023937+0000 2022-02-02T18:26:55.298 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:26:55.298 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:26:55.298 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:26:55.299 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:26:55.299 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:26:55.299 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:26:55.299 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:26:55.299 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 52 2022-02-02T18:26:55.300 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:26:55.300 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2022-02-02T18:26:55.300 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:26:55.301 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:26:55.301 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:26:55.302 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:26:55.302 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:26:55.302 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:26:55.302 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:26:55.303 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:26:55.303 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:26:55.303 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:26:55.303 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:26:55.304 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{1:14460} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.96:6828/3970357036,v1:172.21.15.96:6829/3970357036] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:26:55.304 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:55.304 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:55.304 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:26:55.305 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:26:55.305 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:26:55.305 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:26:55.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.294+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 msgr2=0x7f9e240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:55.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.294+0000 7f9e3f339700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 0x7f9e240672e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9e2800b830 tx=0x7f9e28008040).stop 2022-02-02T18:26:55.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.294+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 msgr2=0x7f9e38109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:26:55.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.294+0000 7f9e3f339700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9e34004f60 tx=0x7f9e34009b30).stop 2022-02-02T18:26:55.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 shutdown_connections 2022-02-02T18:26:55.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e24064e20 0x7f9e240672e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:55.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e380f6a50 0x7f9e38109a80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:55.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 --2- 172.21.15.96:0/3884025977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e380f73f0 0x7f9e3810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:26:55.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 >> 172.21.15.96:0/3884025977 conn(0x7f9e380f0320 msgr2=0x7f9e380fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:26:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 shutdown_connections 2022-02-02T18:26:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:26:55.295+0000 7f9e3f339700 1 -- 172.21.15.96:0/3884025977 wait complete. 2022-02-02T18:26:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 39 2022-02-02T18:26:55.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:55 smithi159 ceph-mon[69013]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:55.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3351852190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:55 smithi096 ceph-mon[101353]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3351852190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:26:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:56 smithi159 ceph-mon[69013]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:56 smithi159 ceph-mon[69013]: pgmap v136: 65 pgs: 1 peering, 33 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 5743/32682 objects degraded (17.572%) 2022-02-02T18:26:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:56 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 5743/32682 objects degraded (17.572%), 33 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3884025977' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:26:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:56 smithi096 ceph-mon[101353]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:26:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:56 smithi096 ceph-mon[101353]: pgmap v136: 65 pgs: 1 peering, 33 active+undersized+degraded, 31 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 5743/32682 objects degraded (17.572%) 2022-02-02T18:26:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:56 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 5743/32682 objects degraded (17.572%), 33 pgs degraded (PG_DEGRADED) 2022-02-02T18:26:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3884025977' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:26:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:58 smithi159 ceph-mon[69013]: pgmap v137: 65 pgs: 1 peering, 26 active+undersized+degraded, 38 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4703/32682 objects degraded (14.390%) 2022-02-02T18:26:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:58 smithi096 ceph-mon[101353]: pgmap v137: 65 pgs: 1 peering, 26 active+undersized+degraded, 38 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 4703/32682 objects degraded (14.390%) 2022-02-02T18:26:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:26:59.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:26:59 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4703/32682 objects degraded (14.390%), 26 pgs degraded) 2022-02-02T18:26:59.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:26:59 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4703/32682 objects degraded (14.390%), 26 pgs degraded) 2022-02-02T18:27:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:00 smithi159 ceph-mon[69013]: pgmap v138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2022-02-02T18:27:00.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:00 smithi096 ceph-mon[101353]: pgmap v138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2022-02-02T18:27:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:02 smithi159 ceph-mon[69013]: pgmap v139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:27:02.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:02 smithi096 ceph-mon[101353]: pgmap v139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:27:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:04 smithi159 ceph-mon[69013]: pgmap v140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 537 B/s rd, 1 op/s 2022-02-02T18:27:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:04 smithi096 ceph-mon[101353]: pgmap v140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 537 B/s rd, 1 op/s 2022-02-02T18:27:06.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:06 smithi159 ceph-mon[69013]: pgmap v141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2022-02-02T18:27:06.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:27:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:06 smithi096 ceph-mon[101353]: pgmap v141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2022-02-02T18:27:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:27:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:07 smithi159 ceph-mon[69013]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:27:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:07 smithi159 ceph-mon[69013]: Upgrade: osd.5 is safe to restart 2022-02-02T18:27:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:07 smithi096 ceph-mon[101353]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2022-02-02T18:27:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:07 smithi096 ceph-mon[101353]: Upgrade: osd.5 is safe to restart 2022-02-02T18:27:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:08 smithi159 ceph-mon[69013]: pgmap v142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:27:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:08 smithi159 ceph-mon[69013]: Upgrade: Updating osd.5 2022-02-02T18:27:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:08.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:08 smithi159 ceph-mon[69013]: Deploying daemon osd.5 on smithi159 2022-02-02T18:27:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:08 smithi096 ceph-mon[101353]: pgmap v142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T18:27:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:08 smithi096 ceph-mon[101353]: Upgrade: Updating osd.5 2022-02-02T18:27:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:08 smithi096 ceph-mon[101353]: Deploying daemon osd.5 on smithi159 2022-02-02T18:27:09.473 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 systemd[1]: Stopping Ceph osd.5 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:27:09.474 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 conmon[51955]: debug 2022-02-02T18:27:09.325+0000 7f983daca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T18:27:09.474 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 conmon[51955]: debug 2022-02-02T18:27:09.325+0000 7f983daca700 -1 osd.5 77 *** Got signal Terminated *** 2022-02-02T18:27:09.474 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 conmon[51955]: debug 2022-02-02T18:27:09.325+0000 7f983daca700 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T18:27:10.142 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 bash[83834]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.5 2022-02-02T18:27:10.142 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 bash[83834]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd-5" found: no such container 2022-02-02T18:27:10.142 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:09 smithi159 bash[83834]: Error: no container with name or ID "ceph-e1d78c58-8453-11ec-8c35-001a4aab830c-osd.5" found: no such container 2022-02-02T18:27:10.525 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:10 smithi159 podman[84149]: 2022-02-02T18:27:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: pgmap v143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:27:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 failed (root=default,host=smithi159) (connection refused reported by osd.1) 2022-02-02T18:27:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:10 smithi159 ceph-mon[69013]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: pgmap v143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T18:27:10.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 failed (root=default,host=smithi159) (connection refused reported by osd.1) 2022-02-02T18:27:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.4 2022-02-02T18:27:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.3 2022-02-02T18:27:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.0 2022-02-02T18:27:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.2 2022-02-02T18:27:10.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:10 smithi096 ceph-mon[101353]: osd.5 reported immediately failed by osd.1 2022-02-02T18:27:11.483 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:11 smithi159 ceph-mon[69013]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:27:11.484 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:11 smithi159 ceph-mon[69013]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2022-02-02T18:27:11.484 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:11 smithi159 ceph-mon[69013]: osdmap e78: 6 total, 5 up, 6 in 2022-02-02T18:27:11.484 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 systemd[1]: ceph-e1d78c58-8453-11ec-8c35-001a4aab830c@osd.5.service: Succeeded. 2022-02-02T18:27:11.485 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 systemd[1]: Stopped Ceph osd.5 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:27:11.485 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 systemd[1]: Starting Ceph osd.5 for e1d78c58-8453-11ec-8c35-001a4aab830c... 2022-02-02T18:27:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:11 smithi096 ceph-mon[101353]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T18:27:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:11 smithi096 ceph-mon[101353]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2022-02-02T18:27:11.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:11 smithi096 ceph-mon[101353]: osdmap e78: 6 total, 5 up, 6 in 2022-02-02T18:27:11.775 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 podman[84449]: 2022-02-02T18:27:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:12 smithi159 ceph-mon[69013]: pgmap v145: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2022-02-02T18:27:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:12 smithi159 ceph-mon[69013]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2022-02-02T18:27:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:12 smithi159 ceph-mon[69013]: osdmap e79: 6 total, 5 up, 6 in 2022-02-02T18:27:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:12.276 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:27:12.277 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-02-02T18:27:12.277 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: --> Failed to activate via raw: activate() got an unexpected keyword argument 'block_wal' 2022-02-02T18:27:12.277 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-02-02T18:27:12.277 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2022-02-02T18:27:12.278 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2022-02-02T18:27:12.278 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2022-02-02T18:27:12.278 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2022-02-02T18:27:12.278 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-02-02T18:27:12.279 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 bash[84295]: --> ceph-volume lvm activate successful for osd ID: 5 2022-02-02T18:27:12.279 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2022-02-02T18:27:12.279 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2022-02-02T18:27:12.279 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2022-02-02T18:27:12.280 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2022-02-02T18:27:12.280 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-02-02T18:27:12.280 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:11 smithi159 conmon[84490]: --> ceph-volume lvm activate successful for osd ID: 5 2022-02-02T18:27:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:12 smithi096 ceph-mon[101353]: pgmap v145: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2022-02-02T18:27:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:12 smithi096 ceph-mon[101353]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2022-02-02T18:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:12 smithi096 ceph-mon[101353]: osdmap e79: 6 total, 5 up, 6 in 2022-02-02T18:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:12.868 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:12 smithi159 podman[84727]: 2022-02-02T18:27:12.868 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:12 smithi159 ceph-osd[84791]: -- 172.21.15.159:0/2477495894 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55726df8e340 con 0x55726df54c00 2022-02-02T18:27:12.869 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:12 smithi159 bash[84295]: af68805d7b160ae85a4fdf20506f28340f64eee2cdde634fa967ac25efc8fc78 2022-02-02T18:27:13.275 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:12 smithi159 systemd[1]: Started Ceph osd.5 for e1d78c58-8453-11ec-8c35-001a4aab830c. 2022-02-02T18:27:13.775 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:13 smithi159 conmon[84767]: 2022-02-02T18:27:13.289+0000 7f62f929b240 -1 Falling back to public interface 2022-02-02T18:27:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: pgmap v147: 65 pgs: 17 active+undersized+degraded, 3 peering, 5 stale+active+clean, 40 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2613/32682 objects degraded (7.995%) 2022-02-02T18:27:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:13 smithi159 ceph-mon[69013]: Health check failed: Degraded data redundancy: 2613/32682 objects degraded (7.995%), 17 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: pgmap v147: 65 pgs: 17 active+undersized+degraded, 3 peering, 5 stale+active+clean, 40 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2613/32682 objects degraded (7.995%) 2022-02-02T18:27:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:13 smithi096 ceph-mon[101353]: Health check failed: Degraded data redundancy: 2613/32682 objects degraded (7.995%), 17 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:16 smithi159 ceph-mon[69013]: pgmap v148: 65 pgs: 25 active+undersized+degraded, 3 peering, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4375/32682 objects degraded (13.387%) 2022-02-02T18:27:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:16 smithi096 ceph-mon[101353]: pgmap v148: 65 pgs: 25 active+undersized+degraded, 3 peering, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4375/32682 objects degraded (13.387%) 2022-02-02T18:27:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:17 smithi159 ceph-mon[69013]: pgmap v149: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:18.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:18.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:17 smithi096 ceph-mon[101353]: pgmap v149: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:18.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:18 smithi159 ceph-mon[69013]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2022-02-02T18:27:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:18 smithi096 ceph-mon[101353]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2022-02-02T18:27:20.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:19 smithi159 ceph-mon[69013]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:20.026 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:19 smithi159 conmon[84767]: 2022-02-02T18:27:19.836+0000 7f62f929b240 -1 osd.5 77 log_to_monitors true 2022-02-02T18:27:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:19 smithi096 ceph-mon[101353]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:21.025 INFO:journalctl@ceph.osd.5.smithi159.stdout:Feb 02 18:27:20 smithi159 conmon[84767]: 2022-02-02T18:27:20.773+0000 7f62e8e33700 -1 osd.5 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-02-02T18:27:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:27:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:27:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 4742/32682 objects degraded (14.510%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:21.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2022-02-02T18:27:21.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2022-02-02T18:27:21.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2022-02-02T18:27:21.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2022-02-02T18:27:21.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2022-02-02T18:27:21.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2022-02-02T18:27:21.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2022-02-02T18:27:21.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2022-02-02T18:27:21.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2022-02-02T18:27:21.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2022-02-02T18:27:21.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2022-02-02T18:27:21.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2022-02-02T18:27:21.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2022-02-02T18:27:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:27:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T18:27:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 4742/32682 objects degraded (14.510%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2022-02-02T18:27:21.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2022-02-02T18:27:21.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2022-02-02T18:27:21.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2022-02-02T18:27:21.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2022-02-02T18:27:21.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2022-02-02T18:27:21.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2022-02-02T18:27:21.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2022-02-02T18:27:21.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2022-02-02T18:27:21.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2022-02-02T18:27:21.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2022-02-02T18:27:21.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2022-02-02T18:27:21.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2022-02-02T18:27:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: Upgrade: Setting container_image for all osd 2022-02-02T18:27:22.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: Upgrade: Setting require_osd_release to 17 quincy 2022-02-02T18:27:22.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2022-02-02T18:27:22.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T18:27:22.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:27:22.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2022-02-02T18:27:22.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: osdmap e80: 6 total, 5 up, 6 in 2022-02-02T18:27:22.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:27:22.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: Upgrade: Disabling standby-replay for filesystem cephfs 2022-02-02T18:27:22.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: pgmap v152: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:22.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:22.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2022-02-02T18:27:22.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:21 smithi159 ceph-mon[69013]: osdmap e81: 6 total, 5 up, 6 in 2022-02-02T18:27:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: Upgrade: Setting container_image for all osd 2022-02-02T18:27:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: Upgrade: Setting require_osd_release to 17 quincy 2022-02-02T18:27:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2022-02-02T18:27:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T18:27:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:27:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2022-02-02T18:27:22.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: osdmap e80: 6 total, 5 up, 6 in 2022-02-02T18:27:22.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2022-02-02T18:27:22.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: Upgrade: Disabling standby-replay for filesystem cephfs 2022-02-02T18:27:22.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: pgmap v152: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4742/32682 objects degraded (14.510%) 2022-02-02T18:27:22.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:22.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2022-02-02T18:27:22.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:21 smithi096 ceph-mon[101353]: osdmap e81: 6 total, 5 up, 6 in 2022-02-02T18:27:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2022-02-02T18:27:23.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby, 1 failed 2022-02-02T18:27:23.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:27:23.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:23.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368] boot 2022-02-02T18:27:23.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: osdmap e82: 6 total, 6 up, 6 in 2022-02-02T18:27:23.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:23.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:27:23.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:23.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:23.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:23.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:23.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: Upgrade: Scaling down filesystem cephfs 2022-02-02T18:27:23.029 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:23.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2022-02-02T18:27:23.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2022-02-02T18:27:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 2 up:standby, 1 failed 2022-02-02T18:27:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T18:27:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: osd.5 [v2:172.21.15.159:6816/1479852368,v1:172.21.15.159:6817/1479852368] boot 2022-02-02T18:27:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: osdmap e82: 6 total, 6 up, 6 in 2022-02-02T18:27:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T18:27:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:23.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:23.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: Upgrade: Scaling down filesystem cephfs 2022-02-02T18:27:23.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:23.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2022-02-02T18:27:23.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: pgmap v155: 65 pgs: 10 peering, 18 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 3753/32682 objects degraded (11.483%) 2022-02-02T18:27:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: osdmap e83: 6 total, 6 up, 6 in 2022-02-02T18:27:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2022-02-02T18:27:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: mds.? [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] up:boot 2022-02-02T18:27:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 3 up:standby, 1 failed 2022-02-02T18:27:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:27:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:24.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:23 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:24.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: pgmap v155: 65 pgs: 10 peering, 18 active+undersized+degraded, 37 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 3753/32682 objects degraded (11.483%) 2022-02-02T18:27:24.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: osdmap e83: 6 total, 6 up, 6 in 2022-02-02T18:27:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2022-02-02T18:27:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: mds.? [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] up:boot 2022-02-02T18:27:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: fsmap cephfs:1/2 {1=cephfs.smithi159.omlhix=up:active} 3 up:standby, 1 failed 2022-02-02T18:27:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.ghwylx"}]: dispatch 2022-02-02T18:27:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:24.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:23 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:25.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.407+0000 7fa3151b7700 1 -- 172.21.15.96:0/1026213089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3100f9690 msgr2=0x7fa3100fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.407+0000 7fa3151b7700 1 --2- 172.21.15.96:0/1026213089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3100f9690 0x7fa3100fbae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa304004660 tx=0x7fa304009b30).stop 2022-02-02T18:27:25.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 -- 172.21.15.96:0/1026213089 shutdown_connections 2022-02-02T18:27:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 --2- 172.21.15.96:0/1026213089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3100f9690 0x7fa3100fbae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 --2- 172.21.15.96:0/1026213089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa310060310 0x7fa3100f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:27:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 -- 172.21.15.96:0/1026213089 >> 172.21.15.96:0/1026213089 conn(0x7fa3100f0b90 msgr2=0x7fa3100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 -- 172.21.15.96:0/1026213089 shutdown_connections 2022-02-02T18:27:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 -- 172.21.15.96:0/1026213089 wait complete. 2022-02-02T18:27:25.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.408+0000 7fa3151b7700 1 Processor -- start 2022-02-02T18:27:25.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa3151b7700 1 -- start start 2022-02-02T18:27:25.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa3151b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa3151b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100f9690 0x7fa3101072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa3151b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310107950 con 0x7fa310060310 2022-02-02T18:27:25.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa3151b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310108100 con 0x7fa3100f9690 2022-02-02T18:27:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54072/0 (socket says 172.21.15.96:54072) 2022-02-02T18:27:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 -- 172.21.15.96:0/474536712 learned_addr learned my addr 172.21.15.96:0/474536712 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30f7fe700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100f9690 0x7fa3101072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 -- 172.21.15.96:0/474536712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100f9690 msgr2=0x7fa3101072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100f9690 0x7fa3101072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.409+0000 7fa30ffff700 1 -- 172.21.15.96:0/474536712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304005040 con 0x7fa310060310 2022-02-02T18:27:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa30ffff700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa30000b410 tx=0x7fa300006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3000125f0 con 0x7fa310060310 2022-02-02T18:27:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3101083e0 con 0x7fa310060310 2022-02-02T18:27:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa300012c00 con 0x7fa310060310 2022-02-02T18:27:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa300002ae0 con 0x7fa310060310 2022-02-02T18:27:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.410+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3101089a0 con 0x7fa310060310 2022-02-02T18:27:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.411+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310059100 con 0x7fa310060310 2022-02-02T18:27:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.411+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa30000f030 con 0x7fa310060310 2022-02-02T18:27:25.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.412+0000 7fa30cff9700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 0x7fa2f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.412+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa300081f10 con 0x7fa310060310 2022-02-02T18:27:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.412+0000 7fa30f7fe700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 0x7fa2f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.412+0000 7fa30f7fe700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 0x7fa2f80672e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa304004e30 tx=0x7fa304009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.416+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa300050010 con 0x7fa310060310 2022-02-02T18:27:25.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.594+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3100008d0 con 0x7fa2f8064e20 2022-02-02T18:27:25.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.595+0000 7fa30cff9700 1 -- 172.21.15.96:0/474536712 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa3100008d0 con 0x7fa2f8064e20 2022-02-02T18:27:25.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 msgr2=0x7fa2f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 0x7fa2f80672e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa304004e30 tx=0x7fa304009b30).stop 2022-02-02T18:27:25.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 msgr2=0x7fa310106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa30000b410 tx=0x7fa300006ef0).stop 2022-02-02T18:27:25.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 shutdown_connections 2022-02-02T18:27:25.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2f8064e20 0x7fa2f80672e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa310060310 0x7fa310106dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 --2- 172.21.15.96:0/474536712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100f9690 0x7fa3101072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.597+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 >> 172.21.15.96:0/474536712 conn(0x7fa3100f0b90 msgr2=0x7fa3100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:25.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.598+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 shutdown_connections 2022-02-02T18:27:25.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.598+0000 7fa3151b7700 1 -- 172.21.15.96:0/474536712 wait complete. 2022-02-02T18:27:25.608 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:27:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 -- 172.21.15.96:0/2552451409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f55c0 msgr2=0x7fa7240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2552451409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f55c0 0x7fa7240f59e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa718004660 tx=0x7fa718009b30).stop 2022-02-02T18:27:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 -- 172.21.15.96:0/2552451409 shutdown_connections 2022-02-02T18:27:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2552451409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f6860 0x7fa7240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2552451409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f55c0 0x7fa7240f59e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 -- 172.21.15.96:0/2552451409 >> 172.21.15.96:0/2552451409 conn(0x7fa7240f0d40 msgr2=0x7fa7240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.696+0000 7fa728bd7700 1 -- 172.21.15.96:0/2552451409 shutdown_connections 2022-02-02T18:27:25.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 -- 172.21.15.96:0/2552451409 wait complete. 2022-02-02T18:27:25.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 Processor -- start 2022-02-02T18:27:25.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 -- start start 2022-02-02T18:27:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f55c0 0x7fa7240f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240f8100 con 0x7fa7240f6860 2022-02-02T18:27:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.697+0000 7fa728bd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240f8240 con 0x7fa7240f55c0 2022-02-02T18:27:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54084/0 (socket says 172.21.15.96:54084) 2022-02-02T18:27:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 -- 172.21.15.96:0/2185699351 learned_addr learned my addr 172.21.15.96:0/2185699351 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa72259c700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f55c0 0x7fa7240f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 -- 172.21.15.96:0/2185699351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f55c0 msgr2=0x7fa7240f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f55c0 0x7fa7240f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 -- 172.21.15.96:0/2185699351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718005040 con 0x7fa7240f6860 2022-02-02T18:27:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa721d9b700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa7140026d0 tx=0x7fa714009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140079c0 con 0x7fa7240f6860 2022-02-02T18:27:25.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa71400f040 con 0x7fa7240f6860 2022-02-02T18:27:25.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7240f8520 con 0x7fa7240f6860 2022-02-02T18:27:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72410efa0 con 0x7fa7240f6860 2022-02-02T18:27:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.698+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140148b0 con 0x7fa7240f6860 2022-02-02T18:27:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.700+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa708004fa0 con 0x7fa7240f6860 2022-02-02T18:27:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.700+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa7140090d0 con 0x7fa7240f6860 2022-02-02T18:27:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.700+0000 7fa712ffd700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 0x7fa70c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.700+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa714081890 con 0x7fa7240f6860 2022-02-02T18:27:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.700+0000 7fa72259c700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 0x7fa70c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.701+0000 7fa72259c700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 0x7fa70c067290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa718013690 tx=0x7fa718009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.704+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa71404f990 con 0x7fa7240f6860 2022-02-02T18:27:25.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.877+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa708000bc0 con 0x7fa70c064dd0 2022-02-02T18:27:25.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.886+0000 7fa712ffd700 1 -- 172.21.15.96:0/2185699351 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fa708000bc0 con 0x7fa70c064dd0 2022-02-02T18:27:25.888 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:27:25.889 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (10m) 98s ago 11m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:27:25.889 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3m) 98s ago 11m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:27:25.889 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3m) 9s ago 11m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:27:25.890 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (10m) 98s ago 11m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:27:25.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (7m) 98s ago 7m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:27:25.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3m) 98s ago 7m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:27:25.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (7m) 9s ago 7m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:27:25.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3m) 9s ago 8m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:27:25.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (5m) 98s ago 13m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:27:25.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4m) 9s ago 11m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:27:25.891 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4m) 98s ago 13m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:27:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3m) 9s ago 11m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:27:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (11m) 98s ago 11m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:27:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 9s ago 11m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:27:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2m) 98s ago 10m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:27:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 98s ago 10m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:27:25.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (105s) 98s ago 10m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:27:25.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (72s) 9s ago 9m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:27:25.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (42s) 9s ago 9m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:27:25.894 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (13s) 9s ago 9m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:27:25.894 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (10m) 98s ago 11m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:27:25.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 msgr2=0x7fa70c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 0x7fa70c067290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa718013690 tx=0x7fa718009b30).stop 2022-02-02T18:27:25.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 msgr2=0x7fa7240f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa7140026d0 tx=0x7fa714009de0).stop 2022-02-02T18:27:25.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 shutdown_connections 2022-02-02T18:27:25.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa70c064dd0 0x7fa70c067290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7240f55c0 0x7fa7240f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 --2- 172.21.15.96:0/2185699351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7240f6860 0x7fa7240f7ba0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 >> 172.21.15.96:0/2185699351 conn(0x7fa7240f0d40 msgr2=0x7fa72405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:25.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.888+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 shutdown_connections 2022-02-02T18:27:25.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.889+0000 7fa728bd7700 1 -- 172.21.15.96:0/2185699351 wait complete. 2022-02-02T18:27:25.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 -- 172.21.15.96:0/1802451412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 msgr2=0x7fe0380f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 --2- 172.21.15.96:0/1802451412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe0380f6af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fe028004660 tx=0x7fe028009b30).stop 2022-02-02T18:27:25.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 -- 172.21.15.96:0/1802451412 shutdown_connections 2022-02-02T18:27:25.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 --2- 172.21.15.96:0/1802451412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 0x7fe0380f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 --2- 172.21.15.96:0/1802451412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe0380f6af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 -- 172.21.15.96:0/1802451412 >> 172.21.15.96:0/1802451412 conn(0x7fe0380f1e50 msgr2=0x7fe0380f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:25.989 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:25 smithi096 ceph-mon[101353]: pgmap v157: 65 pgs: 10 peering, 15 active+undersized+degraded, 40 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3067/32682 objects degraded (9.384%) 2022-02-02T18:27:25.989 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:25 smithi096 ceph-mon[101353]: Health check update: Degraded data redundancy: 3067/32682 objects degraded (9.384%), 15 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:25.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 -- 172.21.15.96:0/1802451412 shutdown_connections 2022-02-02T18:27:25.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.985+0000 7fe03fc98700 1 -- 172.21.15.96:0/1802451412 wait complete. 2022-02-02T18:27:25.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 Processor -- start 2022-02-02T18:27:25.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 -- start start 2022-02-02T18:27:25.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 0x7fe038107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038107a20 con 0x7fe0380f66d0 2022-02-02T18:27:25.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03fc98700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038107b60 con 0x7fe0380f7970 2022-02-02T18:27:25.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54092/0 (socket says 172.21.15.96:54092) 2022-02-02T18:27:25.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 -- 172.21.15.96:0/3118903152 learned_addr learned my addr 172.21.15.96:0/3118903152 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:25.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03d233700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 0x7fe038107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 -- 172.21.15.96:0/3118903152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 msgr2=0x7fe038107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:25.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 0x7fe038107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:25.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.986+0000 7fe03da34700 1 -- 172.21.15.96:0/3118903152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028005040 con 0x7fe0380f66d0 2022-02-02T18:27:25.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe03da34700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe028004f60 tx=0x7fe028009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe028018070 con 0x7fe0380f66d0 2022-02-02T18:27:25.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe028007ba0 con 0x7fe0380f66d0 2022-02-02T18:27:25.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0381084a0 con 0x7fe0380f66d0 2022-02-02T18:27:25.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe02801c620 con 0x7fe0380f66d0 2022-02-02T18:27:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.987+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe038108a00 con 0x7fe0380f66d0 2022-02-02T18:27:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.988+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe038045ad0 con 0x7fe0380f66d0 2022-02-02T18:27:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.988+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe02801c8e0 con 0x7fe0380f66d0 2022-02-02T18:27:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.989+0000 7fe02e7fc700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 0x7fe024067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.989+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe028083960 con 0x7fe0380f66d0 2022-02-02T18:27:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.989+0000 7fe03d233700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 0x7fe024067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.989+0000 7fe03d233700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 0x7fe024067290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe0340041d0 tx=0x7fe034009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:25.993+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe028055490 con 0x7fe0380f66d0 2022-02-02T18:27:26.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.223+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0380ff010 con 0x7fe0380f66d0 2022-02-02T18:27:26.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.224+0000 7fe02e7fc700 1 -- 172.21.15.96:0/3118903152 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe028055080 con 0x7fe0380f66d0 2022-02-02T18:27:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:27:26.226 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:27:26.227 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:27:26.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:26.227 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:27:26.228 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:27:26.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:26.228 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:27:26.228 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:27:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:27:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:27:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:26.230 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:27:26.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:27:26.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:27:26.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:27:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:27:26.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 msgr2=0x7fe024067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 0x7fe024067290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe0340041d0 tx=0x7fe034009040).stop 2022-02-02T18:27:26.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 msgr2=0x7fe038106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe028004f60 tx=0x7fe028009b30).stop 2022-02-02T18:27:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 shutdown_connections 2022-02-02T18:27:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe024064dd0 0x7fe024067290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380f66d0 0x7fe038106f80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 --2- 172.21.15.96:0/3118903152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0380f7970 0x7fe038107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 >> 172.21.15.96:0/3118903152 conn(0x7fe0380f1e50 msgr2=0x7fe0380fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 shutdown_connections 2022-02-02T18:27:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.226+0000 7fe03fc98700 1 -- 172.21.15.96:0/3118903152 wait complete. 2022-02-02T18:27:26.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:25 smithi159 ceph-mon[69013]: pgmap v157: 65 pgs: 10 peering, 15 active+undersized+degraded, 40 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3067/32682 objects degraded (9.384%) 2022-02-02T18:27:26.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:25 smithi159 ceph-mon[69013]: Health check update: Degraded data redundancy: 3067/32682 objects degraded (9.384%), 15 pgs degraded (PG_DEGRADED) 2022-02-02T18:27:26.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 -- 172.21.15.96:0/2065323839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 msgr2=0x7f3b300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 --2- 172.21.15.96:0/2065323839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b300f7de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3b24004660 tx=0x7f3b24009b30).stop 2022-02-02T18:27:26.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 -- 172.21.15.96:0/2065323839 shutdown_connections 2022-02-02T18:27:26.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 --2- 172.21.15.96:0/2065323839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b300f7de0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 --2- 172.21.15.96:0/2065323839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 -- 172.21.15.96:0/2065323839 >> 172.21.15.96:0/2065323839 conn(0x7f3b300f1e40 msgr2=0x7f3b300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:26.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 -- 172.21.15.96:0/2065323839 shutdown_connections 2022-02-02T18:27:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.326+0000 7f3b362c2700 1 -- 172.21.15.96:0/2065323839 wait complete. 2022-02-02T18:27:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 Processor -- start 2022-02-02T18:27:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 -- start start 2022-02-02T18:27:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b3006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006a380 con 0x7f3b300f7980 2022-02-02T18:27:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b362c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006a4c0 con 0x7f3b300f66e0 2022-02-02T18:27:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b2f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b2f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54104/0 (socket says 172.21.15.96:54104) 2022-02-02T18:27:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b2f7fe700 1 -- 172.21.15.96:0/582066862 learned_addr learned my addr 172.21.15.96:0/582066862 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.327+0000 7f3b2ffff700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b3006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2f7fe700 1 -- 172.21.15.96:0/582066862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 msgr2=0x7f3b3006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2f7fe700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b3006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2f7fe700 1 -- 172.21.15.96:0/582066862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24005040 con 0x7f3b300f7980 2022-02-02T18:27:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2ffff700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b3006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:27:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2f7fe700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3b24009990 tx=0x7f3b24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b24018070 con 0x7f3b300f7980 2022-02-02T18:27:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b24007ba0 con 0x7f3b300f7980 2022-02-02T18:27:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3006a740 con 0x7f3b300f7980 2022-02-02T18:27:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2401c3c0 con 0x7f3b300f7980 2022-02-02T18:27:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.328+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3006aca0 con 0x7f3b300f7980 2022-02-02T18:27:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.329+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30045ad0 con 0x7f3b300f7980 2022-02-02T18:27:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.329+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b2401d420 con 0x7f3b300f7980 2022-02-02T18:27:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.330+0000 7f3b2cff9700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 0x7f3b18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.330+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3b24083740 con 0x7f3b300f7980 2022-02-02T18:27:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.330+0000 7f3b2ffff700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 0x7f3b18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.330+0000 7f3b2ffff700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 0x7f3b18067290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3b3006b730 tx=0x7f3b20009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.334+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b240518a0 con 0x7f3b300f7980 2022-02-02T18:27:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.538+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b30027a00 con 0x7f3b300f7980 2022-02-02T18:27:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.539+0000 7f3b2cff9700 1 -- 172.21.15.96:0/582066862 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3b24054ec0 con 0x7f3b300f7980 2022-02-02T18:27:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:27:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:27:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:27:26.542 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:27:26.542 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:26.542 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:27:26.542 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:27:26.543 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:27:26.543 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:27:26.543 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:27:26.543 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:27:26.543 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:27:26.544 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:27:26.544 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:27:26.544 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:27:26.544 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:27:26.545 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:27:26.545 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:27:26.545 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:27:26.545 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:27:26.545 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:27:26.546 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:27:26.546 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:27:26.546 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:27:26.546 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:27:26.547 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:27:26.547 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:27:26.547 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:27:26.547 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:27:26.547 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:27:26.548 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:27:26.548 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:27:26.548 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:26.548 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:26.548 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:27:26.549 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:26.549 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:26.549 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:26.550 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 msgr2=0x7f3b18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 0x7f3b18067290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3b3006b730 tx=0x7f3b20009c00).stop 2022-02-02T18:27:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 msgr2=0x7f3b30069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3b24009990 tx=0x7f3b24009b30).stop 2022-02-02T18:27:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 shutdown_connections 2022-02-02T18:27:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b18064dd0 0x7f3b18067290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b300f66e0 0x7f3b3006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 --2- 172.21.15.96:0/582066862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b300f7980 0x7f3b30069e20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.540+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 >> 172.21.15.96:0/582066862 conn(0x7f3b300f1e40 msgr2=0x7f3b300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.541+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 shutdown_connections 2022-02-02T18:27:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:26.541+0000 7f3b362c2700 1 -- 172.21.15.96:0/582066862 wait complete. 2022-02-02T18:27:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:27:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:26 smithi096 ceph-mon[101353]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:26 smithi096 ceph-mon[101353]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3118903152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/582066862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:27:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:26 smithi159 ceph-mon[69013]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:26 smithi159 ceph-mon[69013]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3118903152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/582066862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:27:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:27 smithi096 ceph-mon[101353]: pgmap v158: 65 pgs: 10 peering, 55 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:27 smithi096 ceph-mon[101353]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3067/32682 objects degraded (9.384%), 15 pgs degraded) 2022-02-02T18:27:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:27:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:27:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:27 smithi159 ceph-mon[69013]: pgmap v158: 65 pgs: 10 peering, 55 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:27 smithi159 ceph-mon[69013]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3067/32682 objects degraded (9.384%), 15 pgs degraded) 2022-02-02T18:27:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:27:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:27:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:29 smithi096 ceph-mon[101353]: pgmap v159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:29 smithi159 ceph-mon[69013]: pgmap v159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:32 smithi159 ceph-mon[69013]: pgmap v160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:32 smithi096 ceph-mon[101353]: pgmap v160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:34 smithi159 ceph-mon[69013]: pgmap v161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:34 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:34 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:34 smithi096 ceph-mon[101353]: pgmap v161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:34 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:34 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:36 smithi159 ceph-mon[69013]: pgmap v162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:36 smithi096 ceph-mon[101353]: pgmap v162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:38 smithi159 ceph-mon[69013]: pgmap v163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:38 smithi096 ceph-mon[101353]: pgmap v163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:40 smithi159 ceph-mon[69013]: pgmap v164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:40 smithi096 ceph-mon[101353]: pgmap v164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:42 smithi159 ceph-mon[69013]: pgmap v165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:42.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:42 smithi096 ceph-mon[101353]: pgmap v165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:43.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:43.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:44 smithi159 ceph-mon[69013]: pgmap v166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:44 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:44 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:44.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:44 smithi096 ceph-mon[101353]: pgmap v166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:44.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:44 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:44 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:46 smithi159 ceph-mon[69013]: pgmap v167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:46 smithi096 ceph-mon[101353]: pgmap v167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:48 smithi159 ceph-mon[69013]: pgmap v168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:48 smithi096 ceph-mon[101353]: pgmap v168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:50 smithi159 ceph-mon[69013]: pgmap v169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:50 smithi096 ceph-mon[101353]: pgmap v169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:52.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:52 smithi159 ceph-mon[69013]: pgmap v170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:52.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:52 smithi096 ceph-mon[101353]: pgmap v170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:53.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:53.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:53.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:53.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:53.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:53.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:27:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:27:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:27:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:27:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:54 smithi159 ceph-mon[69013]: pgmap v171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:54 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:54 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:54 smithi096 ceph-mon[101353]: pgmap v171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:54 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:27:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:54 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:27:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:56 smithi159 ceph-mon[69013]: pgmap v172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:56 smithi096 ceph-mon[101353]: pgmap v172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:56.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 -- 172.21.15.96:0/1698181562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f66e0 msgr2=0x7f16e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 --2- 172.21.15.96:0/1698181562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f66e0 0x7f16e40f6b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f16d4004660 tx=0x7f16d4009b30).stop 2022-02-02T18:27:56.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 -- 172.21.15.96:0/1698181562 shutdown_connections 2022-02-02T18:27:56.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 --2- 172.21.15.96:0/1698181562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f7980 0x7f16e40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 --2- 172.21.15.96:0/1698181562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f66e0 0x7f16e40f6b00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 -- 172.21.15.96:0/1698181562 >> 172.21.15.96:0/1698181562 conn(0x7f16e40f1e40 msgr2=0x7f16e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:56.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 -- 172.21.15.96:0/1698181562 shutdown_connections 2022-02-02T18:27:56.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.654+0000 7f16ea333700 1 -- 172.21.15.96:0/1698181562 wait complete. 2022-02-02T18:27:56.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.655+0000 7f16ea333700 1 Processor -- start 2022-02-02T18:27:56.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.655+0000 7f16ea333700 1 -- start start 2022-02-02T18:27:56.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16ea333700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f66e0 0x7f16e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16ea333700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16ea333700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e406a380 con 0x7f16e40f7980 2022-02-02T18:27:56.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16ea333700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e406a4c0 con 0x7f16e40f66e0 2022-02-02T18:27:56.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54122/0 (socket says 172.21.15.96:54122) 2022-02-02T18:27:56.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 -- 172.21.15.96:0/1599062664 learned_addr learned my addr 172.21.15.96:0/1599062664 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:56.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e3fff700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f66e0 0x7f16e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 -- 172.21.15.96:0/1599062664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f66e0 msgr2=0x7f16e406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f66e0 0x7f16e406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 -- 172.21.15.96:0/1599062664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4005040 con 0x7f16e40f7980 2022-02-02T18:27:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.656+0000 7f16e37fe700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f16d800e7f0 tx=0x7f16d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.657+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d80092e0 con 0x7f16e40f7980 2022-02-02T18:27:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.657+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16d800f040 con 0x7f16e40f7980 2022-02-02T18:27:56.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.657+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e406a7a0 con 0x7f16e40f7980 2022-02-02T18:27:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.657+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d8014750 con 0x7f16e40f7980 2022-02-02T18:27:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.657+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e410ef90 con 0x7f16e40f7980 2022-02-02T18:27:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.658+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e4045ad0 con 0x7f16e40f7980 2022-02-02T18:27:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.658+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f16d801b030 con 0x7f16e40f7980 2022-02-02T18:27:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.659+0000 7f16e0ff9700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 0x7f16cc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.659+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f16d8081780 con 0x7f16e40f7980 2022-02-02T18:27:56.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.659+0000 7f16e3fff700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 0x7f16cc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.659+0000 7f16e3fff700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 0x7f16cc067270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f16d4000c00 tx=0x7f16d4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:56.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.663+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f16d804f930 con 0x7f16e40f7980 2022-02-02T18:27:56.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.841+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e4057f10 con 0x7f16cc064db0 2022-02-02T18:27:56.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.843+0000 7f16e0ff9700 1 -- 172.21.15.96:0/1599062664 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f16e4057f10 con 0x7f16cc064db0 2022-02-02T18:27:56.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 msgr2=0x7f16cc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 0x7f16cc067270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f16d4000c00 tx=0x7f16d4016040).stop 2022-02-02T18:27:56.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 msgr2=0x7f16e4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f16d800e7f0 tx=0x7f16d800b040).stop 2022-02-02T18:27:56.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 shutdown_connections 2022-02-02T18:27:56.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16cc064db0 0x7f16cc067270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e40f66e0 0x7f16e406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 --2- 172.21.15.96:0/1599062664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e40f7980 0x7f16e4069e20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 >> 172.21.15.96:0/1599062664 conn(0x7f16e40f1e40 msgr2=0x7f16e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:56.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.844+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 shutdown_connections 2022-02-02T18:27:56.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.845+0000 7f16ea333700 1 -- 172.21.15.96:0/1599062664 wait complete. 2022-02-02T18:27:56.856 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:27:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- 172.21.15.96:0/1369487172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 msgr2=0x7f2c440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 --2- 172.21.15.96:0/1369487172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c440f59e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2c38004660 tx=0x7f2c38009b30).stop 2022-02-02T18:27:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- 172.21.15.96:0/1369487172 shutdown_connections 2022-02-02T18:27:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 --2- 172.21.15.96:0/1369487172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 0x7f2c440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 --2- 172.21.15.96:0/1369487172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c440f59e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- 172.21.15.96:0/1369487172 >> 172.21.15.96:0/1369487172 conn(0x7f2c440f0d40 msgr2=0x7f2c440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- 172.21.15.96:0/1369487172 shutdown_connections 2022-02-02T18:27:56.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- 172.21.15.96:0/1369487172 wait complete. 2022-02-02T18:27:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 Processor -- start 2022-02-02T18:27:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.942+0000 7f2c4b016700 1 -- start start 2022-02-02T18:27:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c4b016700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 0x7f2c44106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c4b016700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c4b016700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44107a10 con 0x7f2c440f6860 2022-02-02T18:27:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c4b016700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44107b50 con 0x7f2c440f55c0 2022-02-02T18:27:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54132/0 (socket says 172.21.15.96:54132) 2022-02-02T18:27:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 -- 172.21.15.96:0/2186472723 learned_addr learned my addr 172.21.15.96:0/2186472723 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c48db2700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 0x7f2c44106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 -- 172.21.15.96:0/2186472723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 msgr2=0x7f2c44106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 0x7f2c44106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.943+0000 7f2c43fff700 1 -- 172.21.15.96:0/2186472723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38005040 con 0x7f2c440f6860 2022-02-02T18:27:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c43fff700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2c300026d0 tx=0x7f2c30009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:56.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c300079c0 con 0x7f2c440f6860 2022-02-02T18:27:56.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c3000f040 con 0x7f2c440f6860 2022-02-02T18:27:56.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441084f0 con 0x7f2c440f6860 2022-02-02T18:27:56.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c300148b0 con 0x7f2c440f6860 2022-02-02T18:27:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.944+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c44108ab0 con 0x7f2c440f6860 2022-02-02T18:27:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.945+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44045ad0 con 0x7f2c440f6860 2022-02-02T18:27:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.946+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c30007b20 con 0x7f2c440f6860 2022-02-02T18:27:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.946+0000 7f2c417fa700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 0x7f2c34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.946+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c300819e0 con 0x7f2c440f6860 2022-02-02T18:27:56.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.946+0000 7f2c48db2700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 0x7f2c34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:56.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.946+0000 7f2c48db2700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 0x7f2c34067290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2c38004630 tx=0x7f2c38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:56.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:56.950+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c30053510 con 0x7f2c440f6860 2022-02-02T18:27:57.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.125+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c440faca0 con 0x7f2c34064dd0 2022-02-02T18:27:57.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.135+0000 7f2c417fa700 1 -- 172.21.15.96:0/2186472723 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f2c440faca0 con 0x7f2c34064dd0 2022-02-02T18:27:57.137 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:27:57.137 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (11m) 2m ago 12m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:27:57.137 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3m) 2m ago 12m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:27:57.138 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3m) 40s ago 11m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:27:57.138 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (11m) 2m ago 12m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:27:57.138 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (8m) 2m ago 8m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:27:57.139 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4m) 2m ago 8m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:27:57.139 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (8m) 40s ago 8m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:27:57.139 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4m) 40s ago 8m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:27:57.139 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (5m) 2m ago 13m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:27:57.139 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (5m) 40s ago 11m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:27:57.140 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4m) 2m ago 13m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:27:57.141 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4m) 40s ago 11m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:27:57.141 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (12m) 2m ago 12m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:27:57.142 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 40s ago 11m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:27:57.142 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 2m ago 11m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:27:57.143 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 2m ago 10m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:27:57.143 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 2m ago 10m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:27:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (103s) 40s ago 10m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:27:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (73s) 40s ago 10m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:27:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (44s) 40s ago 9m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:27:57.145 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (11m) 2m ago 12m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:27:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 msgr2=0x7f2c34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 0x7f2c34067290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2c38004630 tx=0x7f2c38009b30).stop 2022-02-02T18:27:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 msgr2=0x7f2c44107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2c300026d0 tx=0x7f2c30009de0).stop 2022-02-02T18:27:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 shutdown_connections 2022-02-02T18:27:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c34064dd0 0x7f2c34067290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 0x7f2c44106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 --2- 172.21.15.96:0/2186472723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c44107460 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 >> 172.21.15.96:0/2186472723 conn(0x7f2c440f0d40 msgr2=0x7f2c4405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 shutdown_connections 2022-02-02T18:27:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.138+0000 7f2c4b016700 1 -- 172.21.15.96:0/2186472723 wait complete. 2022-02-02T18:27:57.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.234+0000 7f2839920700 1 -- 172.21.15.96:0/3036117382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 msgr2=0x7f28340f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.234+0000 7f2839920700 1 --2- 172.21.15.96:0/3036117382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28340f6b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2824004660 tx=0x7f2824009b30).stop 2022-02-02T18:27:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.234+0000 7f2839920700 1 -- 172.21.15.96:0/3036117382 shutdown_connections 2022-02-02T18:27:57.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.234+0000 7f2839920700 1 --2- 172.21.15.96:0/3036117382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28340f6b60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 --2- 172.21.15.96:0/3036117382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f28340f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 -- 172.21.15.96:0/3036117382 >> 172.21.15.96:0/3036117382 conn(0x7f28340f0bc0 msgr2=0x7f28340f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 -- 172.21.15.96:0/3036117382 shutdown_connections 2022-02-02T18:27:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 -- 172.21.15.96:0/3036117382 wait complete. 2022-02-02T18:27:57.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 Processor -- start 2022-02-02T18:27:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.235+0000 7f2839920700 1 -- start start 2022-02-02T18:27:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2839920700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f2834106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2839920700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2839920700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28341078f0 con 0x7f28340f6700 2022-02-02T18:27:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2839920700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834108100 con 0x7f28340f5460 2022-02-02T18:27:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54142/0 (socket says 172.21.15.96:54142) 2022-02-02T18:27:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 -- 172.21.15.96:0/770546180 learned_addr learned my addr 172.21.15.96:0/770546180 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2832ffd700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f2834106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 -- 172.21.15.96:0/770546180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 msgr2=0x7f2834106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f2834106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 -- 172.21.15.96:0/770546180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824005040 con 0x7f28340f6700 2022-02-02T18:27:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2832ffd700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f2834106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T18:27:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f28327fc700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2824009990 tx=0x7f2824009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2824018070 con 0x7f28340f6700 2022-02-02T18:27:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2834108320 con 0x7f28340f6700 2022-02-02T18:27:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.236+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2824007ba0 con 0x7f28340f6700 2022-02-02T18:27:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.237+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282401c620 con 0x7f28340f6700 2022-02-02T18:27:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.237+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2834108880 con 0x7f28340f6700 2022-02-02T18:27:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.238+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2834059100 con 0x7f28340f6700 2022-02-02T18:27:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.238+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f282401c8e0 con 0x7f28340f6700 2022-02-02T18:27:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.238+0000 7f281b7fe700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 0x7f281c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.239+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2824083850 con 0x7f28340f6700 2022-02-02T18:27:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.239+0000 7f2832ffd700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 0x7f281c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.239+0000 7f2832ffd700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 0x7f281c0672e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2834106b70 tx=0x7f2828009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.243+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2824051950 con 0x7f28340f6700 2022-02-02T18:27:57.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.473+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f283410d340 con 0x7f28340f6700 2022-02-02T18:27:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.473+0000 7f281b7fe700 1 -- 172.21.15.96:0/770546180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2824054f70 con 0x7f28340f6700 2022-02-02T18:27:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:27:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:27:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:27:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:27:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:27:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:27:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:27:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:27:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:27:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:27:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:27:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:27:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:27:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:27:57.480 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:27:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 msgr2=0x7f281c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 0x7f281c0672e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2834106b70 tx=0x7f2828009040).stop 2022-02-02T18:27:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 msgr2=0x7f28341072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2824009990 tx=0x7f2824009b30).stop 2022-02-02T18:27:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 shutdown_connections 2022-02-02T18:27:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f281c064e20 0x7f281c0672e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28340f5460 0x7f2834106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 --2- 172.21.15.96:0/770546180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28340f6700 0x7f28341072f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 >> 172.21.15.96:0/770546180 conn(0x7f28340f0bc0 msgr2=0x7f283405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 shutdown_connections 2022-02-02T18:27:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.475+0000 7f2839920700 1 -- 172.21.15.96:0/770546180 wait complete. 2022-02-02T18:27:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 -- 172.21.15.96:0/991323395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f55c0 msgr2=0x7f87040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 --2- 172.21.15.96:0/991323395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f55c0 0x7f87040f59e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f86f8004660 tx=0x7f86f8009b30).stop 2022-02-02T18:27:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 -- 172.21.15.96:0/991323395 shutdown_connections 2022-02-02T18:27:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 --2- 172.21.15.96:0/991323395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f5ed0 0x7f87040f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 --2- 172.21.15.96:0/991323395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f55c0 0x7f87040f59e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 -- 172.21.15.96:0/991323395 >> 172.21.15.96:0/991323395 conn(0x7f87040f0de0 msgr2=0x7f87040f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 -- 172.21.15.96:0/991323395 shutdown_connections 2022-02-02T18:27:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.573+0000 7f870972d700 1 -- 172.21.15.96:0/991323395 wait complete. 2022-02-02T18:27:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 Processor -- start 2022-02-02T18:27:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 -- start start 2022-02-02T18:27:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f55c0 0x7f8704105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704106910 con 0x7f87040f5ed0 2022-02-02T18:27:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f870972d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704106a50 con 0x7f87040f55c0 2022-02-02T18:27:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54152/0 (socket says 172.21.15.96:54152) 2022-02-02T18:27:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 -- 172.21.15.96:0/4271800117 learned_addr learned my addr 172.21.15.96:0/4271800117 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:27:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f8702ffd700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f55c0 0x7f8704105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 -- 172.21.15.96:0/4271800117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f55c0 msgr2=0x7f8704105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f55c0 0x7f8704105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.574+0000 7f87027fc700 1 -- 172.21.15.96:0/4271800117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8005040 con 0x7f87040f5ed0 2022-02-02T18:27:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f87027fc700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f86f40026d0 tx=0x7f86f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f40079c0 con 0x7f87040f5ed0 2022-02-02T18:27:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f86f400f040 con 0x7f87040f5ed0 2022-02-02T18:27:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87041073f0 con 0x7f87040f5ed0 2022-02-02T18:27:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f40148b0 con 0x7f87040f5ed0 2022-02-02T18:27:57.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.575+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87041079b0 con 0x7f87040f5ed0 2022-02-02T18:27:57.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.576+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704045ad0 con 0x7f87040f5ed0 2022-02-02T18:27:57.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.578+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f86f4007b20 con 0x7f87040f5ed0 2022-02-02T18:27:57.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.578+0000 7f86eb7fe700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 0x7f86ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:27:57.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.578+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f86f4081eb0 con 0x7f87040f5ed0 2022-02-02T18:27:57.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.578+0000 7f8702ffd700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 0x7f86ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:27:57.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.578+0000 7f8702ffd700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 0x7f86ec067290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f86f8004630 tx=0x7f86f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:27:57.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.581+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f86f4053920 con 0x7f87040f5ed0 2022-02-02T18:27:57.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.782+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8704027a00 con 0x7f87040f5ed0 2022-02-02T18:27:57.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.782+0000 7f86eb7fe700 1 -- 172.21.15.96:0/4271800117 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f86f4053510 con 0x7f87040f5ed0 2022-02-02T18:27:57.785 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:27:57.785 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:27:57.785 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:27:57.786 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:27:57.786 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:57.786 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:27:57.786 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:27:57.786 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:27:57.787 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:27:57.787 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:27:57.787 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:27:57.787 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:27:57.788 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:27:57.788 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:27:57.788 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:27:57.788 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:27:57.788 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:27:57.789 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:27:57.789 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:27:57.789 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:27:57.789 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:27:57.790 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:27:57.790 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:27:57.790 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:27:57.790 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:27:57.790 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:27:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:27:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:27:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:27:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:27:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:27:57.792 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:27:57.792 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:57.792 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:57.792 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:27:57.792 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:27:57.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:57.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:57.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:27:57.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 msgr2=0x7f86ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 0x7f86ec067290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f86f8004630 tx=0x7f86f8009b30).stop 2022-02-02T18:27:57.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 msgr2=0x7f8704106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:27:57.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f86f40026d0 tx=0x7f86f4009de0).stop 2022-02-02T18:27:57.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 shutdown_connections 2022-02-02T18:27:57.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86ec064dd0 0x7f86ec067290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87040f55c0 0x7f8704105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 --2- 172.21.15.96:0/4271800117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040f5ed0 0x7f8704106360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:27:57.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 >> 172.21.15.96:0/4271800117 conn(0x7f87040f0de0 msgr2=0x7f87040fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:27:57.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 shutdown_connections 2022-02-02T18:27:57.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:27:57.784+0000 7f870972d700 1 -- 172.21.15.96:0/4271800117 wait complete. 2022-02-02T18:27:57.797 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:27:58.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:58 smithi159 ceph-mon[69013]: pgmap v173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:58 smithi159 ceph-mon[69013]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:58 smithi159 ceph-mon[69013]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/770546180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:58.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:27:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4271800117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:27:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:58 smithi096 ceph-mon[101353]: pgmap v173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:27:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:58 smithi096 ceph-mon[101353]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:58 smithi096 ceph-mon[101353]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:27:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/770546180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:27:58.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:27:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4271800117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:28:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:00 smithi159 ceph-mon[69013]: pgmap v174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:00.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:00 smithi096 ceph-mon[101353]: pgmap v174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:02 smithi159 ceph-mon[69013]: pgmap v175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:02.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:02 smithi096 ceph-mon[101353]: pgmap v175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:03.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:03.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:03.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:03.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:03.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:03.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:04 smithi159 ceph-mon[69013]: pgmap v176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:04 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:04 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:04 smithi096 ceph-mon[101353]: pgmap v176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:04 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:04 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:06 smithi159 ceph-mon[69013]: pgmap v177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:06 smithi096 ceph-mon[101353]: pgmap v177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:08 smithi159 ceph-mon[69013]: pgmap v178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:08 smithi096 ceph-mon[101353]: pgmap v178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:10 smithi159 ceph-mon[69013]: pgmap v179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:10.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:10 smithi096 ceph-mon[101353]: pgmap v179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:12 smithi159 ceph-mon[69013]: pgmap v180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:12 smithi096 ceph-mon[101353]: pgmap v180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:13.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:13.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:13.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:13.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:13.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:13.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:13.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:13.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:13.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:13.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:14 smithi159 ceph-mon[69013]: pgmap v181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:14 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:14 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:14 smithi096 ceph-mon[101353]: pgmap v181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:14 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:14 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:16 smithi159 ceph-mon[69013]: pgmap v182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:16 smithi096 ceph-mon[101353]: pgmap v182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:18 smithi159 ceph-mon[69013]: pgmap v183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:18 smithi096 ceph-mon[101353]: pgmap v183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:20.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:20 smithi159 ceph-mon[69013]: pgmap v184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:20 smithi096 ceph-mon[101353]: pgmap v184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:22.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:22 smithi159 ceph-mon[69013]: pgmap v185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:22.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:22 smithi096 ceph-mon[101353]: pgmap v185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:23.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:23.456 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:23.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:23.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: pgmap v186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: pgmap v186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:25 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:25 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:26 smithi159 ceph-mon[69013]: pgmap v187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:26 smithi096 ceph-mon[101353]: pgmap v187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:28:27.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:28:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:28:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:28:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 -- 172.21.15.96:0/3444725640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 msgr2=0x7fd5d80f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3444725640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d80f7dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd5c4004660 tx=0x7fd5c4009b30).stop 2022-02-02T18:28:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 -- 172.21.15.96:0/3444725640 shutdown_connections 2022-02-02T18:28:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3444725640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d80f7dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3444725640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 0x7fd5d80f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 -- 172.21.15.96:0/3444725640 >> 172.21.15.96:0/3444725640 conn(0x7fd5d80f1e50 msgr2=0x7fd5d80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 -- 172.21.15.96:0/3444725640 shutdown_connections 2022-02-02T18:28:27.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 -- 172.21.15.96:0/3444725640 wait complete. 2022-02-02T18:28:27.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.896+0000 7fd5debb6700 1 Processor -- start 2022-02-02T18:28:27.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5debb6700 1 -- start start 2022-02-02T18:28:27.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5debb6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 0x7fd5d8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:27.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5debb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:27.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5debb6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d81079f0 con 0x7fd5d80f7970 2022-02-02T18:28:27.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5debb6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8107b30 con 0x7fd5d80f66d0 2022-02-02T18:28:27.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:27.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54170/0 (socket says 172.21.15.96:54170) 2022-02-02T18:28:27.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5d7fff700 1 -- 172.21.15.96:0/3761558578 learned_addr learned my addr 172.21.15.96:0/3761558578 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:27.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.897+0000 7fd5dc952700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 0x7fd5d8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:27.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d7fff700 1 -- 172.21.15.96:0/3761558578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 msgr2=0x7fd5d8106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:27.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d7fff700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 0x7fd5d8106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:27.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d7fff700 1 -- 172.21.15.96:0/3761558578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4005040 con 0x7fd5d80f7970 2022-02-02T18:28:27.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d7fff700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd5c4009990 tx=0x7fd5c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:27.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c4018070 con 0x7fd5d80f7970 2022-02-02T18:28:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5c4007ba0 con 0x7fd5d80f7970 2022-02-02T18:28:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8108470 con 0x7fd5d80f7970 2022-02-02T18:28:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c401c3c0 con 0x7fd5d80f7970 2022-02-02T18:28:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.898+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d81089d0 con 0x7fd5d80f7970 2022-02-02T18:28:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.899+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd5c401d420 con 0x7fd5d80f7970 2022-02-02T18:28:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.899+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d8045ad0 con 0x7fd5d80f7970 2022-02-02T18:28:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.900+0000 7fd5d57fa700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 0x7fd5c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.900+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd5c40836f0 con 0x7fd5d80f7970 2022-02-02T18:28:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.900+0000 7fd5dc952700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 0x7fd5c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.900+0000 7fd5dc952700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 0x7fd5c8067290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd5d80f77d0 tx=0x7fd5cc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:27.904+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5c4055160 con 0x7fd5d80f7970 2022-02-02T18:28:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.084+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5d8108c40 con 0x7fd5c8064dd0 2022-02-02T18:28:28.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.085+0000 7fd5d57fa700 1 -- 172.21.15.96:0/3761558578 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd5d8108c40 con 0x7fd5c8064dd0 2022-02-02T18:28:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.086+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 msgr2=0x7fd5c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.086+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 0x7fd5c8067290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd5d80f77d0 tx=0x7fd5cc00b040).stop 2022-02-02T18:28:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 msgr2=0x7fd5d8107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd5c4009990 tx=0x7fd5c4009b30).stop 2022-02-02T18:28:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 shutdown_connections 2022-02-02T18:28:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c8064dd0 0x7fd5c8067290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d80f66d0 0x7fd5d8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 --2- 172.21.15.96:0/3761558578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d80f7970 0x7fd5d8107440 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 >> 172.21.15.96:0/3761558578 conn(0x7fd5d80f1e50 msgr2=0x7fd5d80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 shutdown_connections 2022-02-02T18:28:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.087+0000 7fd5debb6700 1 -- 172.21.15.96:0/3761558578 wait complete. 2022-02-02T18:28:28.098 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:28:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 -- 172.21.15.96:0/3526665786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 msgr2=0x7fe4440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 --2- 172.21.15.96:0/3526665786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe4440f59e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe438004660 tx=0x7fe438009b30).stop 2022-02-02T18:28:28.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 -- 172.21.15.96:0/3526665786 shutdown_connections 2022-02-02T18:28:28.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 --2- 172.21.15.96:0/3526665786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 0x7fe4440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 --2- 172.21.15.96:0/3526665786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe4440f59e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 -- 172.21.15.96:0/3526665786 >> 172.21.15.96:0/3526665786 conn(0x7fe4440f0d40 msgr2=0x7fe4440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 -- 172.21.15.96:0/3526665786 shutdown_connections 2022-02-02T18:28:28.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.184+0000 7fe44b492700 1 -- 172.21.15.96:0/3526665786 wait complete. 2022-02-02T18:28:28.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 Processor -- start 2022-02-02T18:28:28.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 -- start start 2022-02-02T18:28:28.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 0x7fe44410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440603c0 con 0x7fe4440f55c0 2022-02-02T18:28:28.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44b492700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444060500 con 0x7fe4440f6860 2022-02-02T18:28:28.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44922e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.185+0000 7fe44922e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54178/0 (socket says 172.21.15.96:54178) 2022-02-02T18:28:28.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44922e700 1 -- 172.21.15.96:0/1622561329 learned_addr learned my addr 172.21.15.96:0/1622561329 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:28.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe448a2d700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 0x7fe44410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44922e700 1 -- 172.21.15.96:0/1622561329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 msgr2=0x7fe44410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44922e700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 0x7fe44410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44922e700 1 -- 172.21.15.96:0/1622561329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe438005040 con 0x7fe4440f55c0 2022-02-02T18:28:28.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44922e700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe438013a70 tx=0x7fe438009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe438018070 con 0x7fe4440f55c0 2022-02-02T18:28:28.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4380097d0 con 0x7fe4440f55c0 2022-02-02T18:28:28.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43801c3c0 con 0x7fe4440f55c0 2022-02-02T18:28:28.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44410c6e0 con 0x7fe4440f55c0 2022-02-02T18:28:28.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.186+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44410cc10 con 0x7fe4440f55c0 2022-02-02T18:28:28.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.187+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444045ad0 con 0x7fe4440f55c0 2022-02-02T18:28:28.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.188+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe438007ba0 con 0x7fe4440f55c0 2022-02-02T18:28:28.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.189+0000 7fe435ffb700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.189+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe438083640 con 0x7fe4440f55c0 2022-02-02T18:28:28.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.189+0000 7fe448a2d700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.189+0000 7fe448a2d700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 0x7fe430067290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe4400096c0 tx=0x7fe440009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.193+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe438051740 con 0x7fe4440f55c0 2022-02-02T18:28:28.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.367+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4440fdf30 con 0x7fe430064dd0 2022-02-02T18:28:28.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.377+0000 7fe435ffb700 1 -- 172.21.15.96:0/1622561329 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fe440009e20 con 0x7fe430064dd0 2022-02-02T18:28:28.379 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:28:28.379 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (11m) 2m ago 12m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:28:28.379 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4m) 2m ago 12m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:28:28.379 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4m) 71s ago 12m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:28:28.380 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (11m) 2m ago 12m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:28:28.380 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (8m) 2m ago 8m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:28:28.381 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4m) 2m ago 9m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:28:28.381 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (8m) 71s ago 8m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:28:28.382 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4m) 71s ago 9m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:28:28.382 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (6m) 2m ago 14m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:28:28.382 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (5m) 71s ago 12m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:28:28.383 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (5m) 2m ago 14m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:28:28.383 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4m) 71s ago 12m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:28:28.384 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (12m) 2m ago 12m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:28:28.384 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (12m) 71s ago 12m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:28:28.384 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 2m ago 11m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:28:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 2m ago 11m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:28:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 2m ago 11m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:28:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2m) 71s ago 10m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:28:28.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (105s) 71s ago 10m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:28:28.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (75s) 71s ago 10m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:28:28.387 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (11m) 2m ago 12m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:28:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.378+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 msgr2=0x7fe430067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.378+0000 7fe44b492700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 0x7fe430067290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe4400096c0 tx=0x7fe440009be0).stop 2022-02-02T18:28:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.378+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 msgr2=0x7fe444109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.378+0000 7fe44b492700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe438013a70 tx=0x7fe438009b30).stop 2022-02-02T18:28:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 shutdown_connections 2022-02-02T18:28:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4440f55c0 0x7fe444109c90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 --2- 172.21.15.96:0/1622561329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4440f6860 0x7fe44410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 >> 172.21.15.96:0/1622561329 conn(0x7fe4440f0d40 msgr2=0x7fe4440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 shutdown_connections 2022-02-02T18:28:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.379+0000 7fe44b492700 1 -- 172.21.15.96:0/1622561329 wait complete. 2022-02-02T18:28:28.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.476+0000 7fa52f59e700 1 -- 172.21.15.96:0/2058181192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 msgr2=0x7fa5300f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.476+0000 7fa52f59e700 1 --2- 172.21.15.96:0/2058181192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa5300f5850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa520004660 tx=0x7fa520009b30).stop 2022-02-02T18:28:28.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 -- 172.21.15.96:0/2058181192 shutdown_connections 2022-02-02T18:28:28.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 --2- 172.21.15.96:0/2058181192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 0x7fa5300f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 --2- 172.21.15.96:0/2058181192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa5300f5850 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 -- 172.21.15.96:0/2058181192 >> 172.21.15.96:0/2058181192 conn(0x7fa5300f0b90 msgr2=0x7fa5300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.480 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:28 smithi096 ceph-mon[101353]: pgmap v188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 -- 172.21.15.96:0/2058181192 shutdown_connections 2022-02-02T18:28:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.477+0000 7fa52f59e700 1 -- 172.21.15.96:0/2058181192 wait complete. 2022-02-02T18:28:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 Processor -- start 2022-02-02T18:28:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 -- start start 2022-02-02T18:28:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 0x7fa53010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300603c0 con 0x7fa5300f5430 2022-02-02T18:28:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa530060500 con 0x7fa5300f66d0 2022-02-02T18:28:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54188/0 (socket says 172.21.15.96:54188) 2022-02-02T18:28:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52e59c700 1 -- 172.21.15.96:0/345453510 learned_addr learned my addr 172.21.15.96:0/345453510 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.478+0000 7fa52dd9b700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 0x7fa53010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52e59c700 1 -- 172.21.15.96:0/345453510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 msgr2=0x7fa53010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52e59c700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 0x7fa53010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52e59c700 1 -- 172.21.15.96:0/345453510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520005040 con 0x7fa5300f5430 2022-02-02T18:28:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52e59c700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa520013a70 tx=0x7fa520009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa520018070 con 0x7fa5300f5430 2022-02-02T18:28:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa5200097d0 con 0x7fa5300f5430 2022-02-02T18:28:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53010c490 con 0x7fa5300f5430 2022-02-02T18:28:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52001de80 con 0x7fa5300f5430 2022-02-02T18:28:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.479+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53010c9c0 con 0x7fa5300f5430 2022-02-02T18:28:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.480+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa530045ad0 con 0x7fa5300f5430 2022-02-02T18:28:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.481+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa520007ba0 con 0x7fa5300f5430 2022-02-02T18:28:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.481+0000 7fa51effd700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 0x7fa5180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.481+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa520083650 con 0x7fa5300f5430 2022-02-02T18:28:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.481+0000 7fa52dd9b700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 0x7fa5180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.482+0000 7fa52dd9b700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 0x7fa5180672e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa524004c40 tx=0x7fa52400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.486+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa520051750 con 0x7fa5300f5430 2022-02-02T18:28:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:28 smithi159 ceph-mon[69013]: pgmap v188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:28.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.716+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5300fdd70 con 0x7fa5300f5430 2022-02-02T18:28:28.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.716+0000 7fa51effd700 1 -- 172.21.15.96:0/345453510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa520054d70 con 0x7fa5300f5430 2022-02-02T18:28:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:28:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:28:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:28:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:28:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:28:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:28:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:28:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:28:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:28:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:28:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:28:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:28:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:28:28.722 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:28:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 msgr2=0x7fa5180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 0x7fa5180672e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa524004c40 tx=0x7fa52400b040).stop 2022-02-02T18:28:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 msgr2=0x7fa530109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa520013a70 tx=0x7fa520009b30).stop 2022-02-02T18:28:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 shutdown_connections 2022-02-02T18:28:28.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa518064e20 0x7fa5180672e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5300f5430 0x7fa530109a40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 --2- 172.21.15.96:0/345453510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5300f66d0 0x7fa53010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 >> 172.21.15.96:0/345453510 conn(0x7fa5300f0b90 msgr2=0x7fa5300fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.718+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 shutdown_connections 2022-02-02T18:28:28.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.719+0000 7fa52f59e700 1 -- 172.21.15.96:0/345453510 wait complete. 2022-02-02T18:28:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 -- 172.21.15.96:0/2878759020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55c0 msgr2=0x7ffb180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/2878759020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55c0 0x7ffb180f59e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ffb08004660 tx=0x7ffb08009b30).stop 2022-02-02T18:28:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 -- 172.21.15.96:0/2878759020 shutdown_connections 2022-02-02T18:28:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/2878759020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f6860 0x7ffb180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/2878759020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55c0 0x7ffb180f59e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 -- 172.21.15.96:0/2878759020 >> 172.21.15.96:0/2878759020 conn(0x7ffb180f0d40 msgr2=0x7ffb180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 -- 172.21.15.96:0/2878759020 shutdown_connections 2022-02-02T18:28:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.816+0000 7ffb1e95e700 1 -- 172.21.15.96:0/2878759020 wait complete. 2022-02-02T18:28:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 Processor -- start 2022-02-02T18:28:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 -- start start 2022-02-02T18:28:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f55c0 0x7ffb18106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18107a30 con 0x7ffb180f6860 2022-02-02T18:28:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb1e95e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18107b70 con 0x7ffb180f55c0 2022-02-02T18:28:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54200/0 (socket says 172.21.15.96:54200) 2022-02-02T18:28:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.817+0000 7ffb177fe700 1 -- 172.21.15.96:0/634208125 learned_addr learned my addr 172.21.15.96:0/634208125 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb17fff700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f55c0 0x7ffb18106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb177fe700 1 -- 172.21.15.96:0/634208125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f55c0 msgr2=0x7ffb18106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb177fe700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f55c0 0x7ffb18106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb177fe700 1 -- 172.21.15.96:0/634208125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08005040 con 0x7ffb180f6860 2022-02-02T18:28:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb177fe700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ffb0c0026d0 tx=0x7ffb0c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c0079c0 con 0x7ffb180f6860 2022-02-02T18:28:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb18108510 con 0x7ffb180f6860 2022-02-02T18:28:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb0c00f040 con 0x7ffb180f6860 2022-02-02T18:28:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c0148b0 con 0x7ffb180f6860 2022-02-02T18:28:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.818+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb18108ad0 con 0x7ffb180f6860 2022-02-02T18:28:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.819+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18045ad0 con 0x7ffb180f6860 2022-02-02T18:28:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.819+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb0c007b20 con 0x7ffb180f6860 2022-02-02T18:28:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.820+0000 7ffb14ff9700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 0x7ffb00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.820+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffb0c0819e0 con 0x7ffb180f6860 2022-02-02T18:28:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.820+0000 7ffb17fff700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 0x7ffb00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.820+0000 7ffb17fff700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 0x7ffb00067290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffb08004630 tx=0x7ffb08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:28.824+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb0c053510 con 0x7ffb180f6860 2022-02-02T18:28:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.024+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb18027a00 con 0x7ffb180f6860 2022-02-02T18:28:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.024+0000 7ffb14ff9700 1 -- 172.21.15.96:0/634208125 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ffb0c053100 con 0x7ffb180f6860 2022-02-02T18:28:29.027 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:28:29.027 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:28:29.027 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:28:29.027 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:28:29.028 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:28:29.028 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:28:29.028 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:28:29.028 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:28:29.028 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:28:29.029 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:28:29.029 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:28:29.029 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:28:29.029 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:28:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:28:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:28:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:28:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:28:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:28:29.031 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:28:29.031 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:28:29.031 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:28:29.031 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:28:29.032 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:28:29.032 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:28:29.032 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:28:29.032 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:28:29.033 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:28:29.033 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:28:29.033 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:28:29.033 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:28:29.033 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:28:29.034 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:28:29.034 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:28:29.034 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:28:29.034 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:28:29.035 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:28:29.035 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:28:29.035 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:28:29.035 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:28:29.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 msgr2=0x7ffb00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 0x7ffb00067290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffb08004630 tx=0x7ffb08009b30).stop 2022-02-02T18:28:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 msgr2=0x7ffb18107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ffb0c0026d0 tx=0x7ffb0c009de0).stop 2022-02-02T18:28:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 shutdown_connections 2022-02-02T18:28:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb00064dd0 0x7ffb00067290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f55c0 0x7ffb18106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 --2- 172.21.15.96:0/634208125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6860 0x7ffb18107480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 >> 172.21.15.96:0/634208125 conn(0x7ffb180f0d40 msgr2=0x7ffb180f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.027+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 shutdown_connections 2022-02-02T18:28:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:29.028+0000 7ffb1e95e700 1 -- 172.21.15.96:0/634208125 wait complete. 2022-02-02T18:28:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:28:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:29 smithi096 ceph-mon[101353]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:28:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:29 smithi096 ceph-mon[101353]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:28:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/345453510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/634208125' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:28:29.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:29 smithi159 ceph-mon[69013]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:28:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:29 smithi159 ceph-mon[69013]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:28:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/345453510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/634208125' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:28:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:30 smithi096 ceph-mon[101353]: pgmap v189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:30.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:30 smithi159 ceph-mon[69013]: pgmap v189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:32 smithi096 ceph-mon[101353]: pgmap v190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:32 smithi159 ceph-mon[69013]: pgmap v190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: pgmap v191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: pgmap v191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:35 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:35 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:35 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:35.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:35 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:36 smithi096 ceph-mon[101353]: pgmap v192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:36 smithi159 ceph-mon[69013]: pgmap v192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:38 smithi096 ceph-mon[101353]: pgmap v193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:38 smithi159 ceph-mon[69013]: pgmap v193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:40 smithi096 ceph-mon[101353]: pgmap v194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:40 smithi159 ceph-mon[69013]: pgmap v194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:42.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:42 smithi096 ceph-mon[101353]: pgmap v195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:42 smithi159 ceph-mon[69013]: pgmap v195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: pgmap v196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: pgmap v196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:45 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:45 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:45 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:45 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:46 smithi159 ceph-mon[69013]: pgmap v197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:46 smithi096 ceph-mon[101353]: pgmap v197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:48 smithi159 ceph-mon[69013]: pgmap v198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:48 smithi096 ceph-mon[101353]: pgmap v198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:50 smithi159 ceph-mon[69013]: pgmap v199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:50.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:50 smithi096 ceph-mon[101353]: pgmap v199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:52 smithi159 ceph-mon[69013]: pgmap v200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:52 smithi096 ceph-mon[101353]: pgmap v200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: pgmap v201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: pgmap v201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:54.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:54.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:28:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:28:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:28:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:28:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:28:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:55 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:55 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:55 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:28:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:55 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:28:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:56 smithi159 ceph-mon[69013]: pgmap v202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:56 smithi096 ceph-mon[101353]: pgmap v202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:28:58 smithi159 ceph-mon[69013]: pgmap v203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:28:58 smithi096 ceph-mon[101353]: pgmap v203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:28:59.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 -- 172.21.15.96:0/2762140503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 msgr2=0x7f3bcc0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/2762140503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc0f6ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3bbc004660 tx=0x7f3bbc009b30).stop 2022-02-02T18:28:59.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 -- 172.21.15.96:0/2762140503 shutdown_connections 2022-02-02T18:28:59.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/2762140503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 0x7f3bcc0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/2762140503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc0f6ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.139+0000 7f3bd15e7700 1 -- 172.21.15.96:0/2762140503 >> 172.21.15.96:0/2762140503 conn(0x7f3bcc0f1e20 msgr2=0x7f3bcc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.140+0000 7f3bd15e7700 1 -- 172.21.15.96:0/2762140503 shutdown_connections 2022-02-02T18:28:59.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.140+0000 7f3bd15e7700 1 -- 172.21.15.96:0/2762140503 wait complete. 2022-02-02T18:28:59.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.140+0000 7f3bd15e7700 1 Processor -- start 2022-02-02T18:28:59.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.140+0000 7f3bd15e7700 1 -- start start 2022-02-02T18:28:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 0x7f3bcc107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc1079b0 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc107af0 con 0x7f3bcc0f7960 2022-02-02T18:28:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54216/0 (socket says 172.21.15.96:54216) 2022-02-02T18:28:59.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 -- 172.21.15.96:0/822886348 learned_addr learned my addr 172.21.15.96:0/822886348 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:59.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bca7fc700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 0x7f3bcc107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 -- 172.21.15.96:0/822886348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 msgr2=0x7f3bcc107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 0x7f3bcc107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 -- 172.21.15.96:0/822886348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc005040 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bcaffd700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3bbc013a70 tx=0x7f3bbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc018070 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc108430 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3bbc0097d0 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc01de80 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.141+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc108990 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.142+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc045ad0 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.143+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3bbc007ba0 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.143+0000 7f3bb37fe700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 0x7f3bb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.143+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3bbc0836d0 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.143+0000 7f3bca7fc700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 0x7f3bb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.144+0000 7f3bca7fc700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 0x7f3bb4067290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f3bc0004ce0 tx=0x7f3bc000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.148+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3bbc055180 con 0x7f3bcc0f66c0 2022-02-02T18:28:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.326+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bcc0fefc0 con 0x7f3bb4064dd0 2022-02-02T18:28:59.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.327+0000 7f3bb37fe700 1 -- 172.21.15.96:0/822886348 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3bcc0fefc0 con 0x7f3bb4064dd0 2022-02-02T18:28:59.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 msgr2=0x7f3bb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 0x7f3bb4067290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f3bc0004ce0 tx=0x7f3bc000b040).stop 2022-02-02T18:28:59.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 msgr2=0x7f3bcc106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3bbc013a70 tx=0x7f3bbc009b30).stop 2022-02-02T18:28:59.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 shutdown_connections 2022-02-02T18:28:59.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bb4064dd0 0x7f3bb4067290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bcc0f66c0 0x7f3bcc106f10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 --2- 172.21.15.96:0/822886348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bcc0f7960 0x7f3bcc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 >> 172.21.15.96:0/822886348 conn(0x7f3bcc0f1e20 msgr2=0x7f3bcc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 shutdown_connections 2022-02-02T18:28:59.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.329+0000 7f3bd15e7700 1 -- 172.21.15.96:0/822886348 wait complete. 2022-02-02T18:28:59.340 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:28:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 -- 172.21.15.96:0/2821813362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 msgr2=0x7f1ec00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/2821813362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f6b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1eac004660 tx=0x7f1eac009b30).stop 2022-02-02T18:28:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 -- 172.21.15.96:0/2821813362 shutdown_connections 2022-02-02T18:28:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/2821813362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f6b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/2821813362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 0x7f1ec00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 -- 172.21.15.96:0/2821813362 >> 172.21.15.96:0/2821813362 conn(0x7f1ec00f0b90 msgr2=0x7f1ec00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.427+0000 7f1ec5f81700 1 -- 172.21.15.96:0/2821813362 shutdown_connections 2022-02-02T18:28:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 -- 172.21.15.96:0/2821813362 wait complete. 2022-02-02T18:28:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 Processor -- start 2022-02-02T18:28:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 -- start start 2022-02-02T18:28:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 0x7f1ec00f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00f7f70 con 0x7f1ec00f66d0 2022-02-02T18:28:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.428+0000 7f1ec5f81700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00f80b0 con 0x7f1ec00f5430 2022-02-02T18:28:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54228/0 (socket says 172.21.15.96:54228) 2022-02-02T18:28:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 -- 172.21.15.96:0/599196638 learned_addr learned my addr 172.21.15.96:0/599196638 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:59.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ec4f7f700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 0x7f1ec00f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 -- 172.21.15.96:0/599196638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 msgr2=0x7f1ec00f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 0x7f1ec00f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 -- 172.21.15.96:0/599196638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac005040 con 0x7f1ec00f66d0 2022-02-02T18:28:59.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebffff700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1eac009830 tx=0x7f1eac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac018070 con 0x7f1ec00f66d0 2022-02-02T18:28:59.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1eac007ba0 con 0x7f1ec00f66d0 2022-02-02T18:28:59.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac01c3c0 con 0x7f1ec00f66d0 2022-02-02T18:28:59.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00f8330 con 0x7f1ec00f66d0 2022-02-02T18:28:59.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.429+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00f8840 con 0x7f1ec00f66d0 2022-02-02T18:28:59.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.430+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0045ad0 con 0x7f1ec00f66d0 2022-02-02T18:28:59.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.431+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1eac007d10 con 0x7f1ec00f66d0 2022-02-02T18:28:59.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.431+0000 7f1ebd7fa700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 0x7f1eb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.431+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1eac083640 con 0x7f1ec00f66d0 2022-02-02T18:28:59.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.431+0000 7f1ec4f7f700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 0x7f1eb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.432+0000 7f1ec4f7f700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 0x7f1eb00672e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1ec00f9320 tx=0x7f1eb400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.435+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1eac051800 con 0x7f1ec00f66d0 2022-02-02T18:28:59.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.609+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec00fab10 con 0x7f1eb0064e20 2022-02-02T18:28:59.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.618+0000 7f1ebd7fa700 1 -- 172.21.15.96:0/599196638 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f1ec00fab10 con 0x7f1eb0064e20 2022-02-02T18:28:59.619 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:28:59.619 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (12m) 3m ago 13m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:28:59.619 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4m) 3m ago 13m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:28:59.620 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4m) 102s ago 12m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:28:59.620 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (12m) 3m ago 13m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:28:59.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (9m) 3m ago 9m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:28:59.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (5m) 3m ago 9m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:28:59.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (9m) 102s ago 9m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:28:59.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (5m) 102s ago 9m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:28:59.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (6m) 3m ago 14m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:28:59.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (6m) 102s ago 12m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:28:59.622 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (5m) 3m ago 14m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:28:59.622 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (5m) 102s ago 12m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:28:59.622 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (13m) 3m ago 13m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:28:59.622 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (12m) 102s ago 12m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:28:59.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 3m ago 12m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:28:59.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 3m ago 11m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:28:59.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 3m ago 11m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:28:59.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2m) 102s ago 11m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:28:59.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2m) 102s ago 11m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:28:59.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (107s) 102s ago 10m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:28:59.624 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (12m) 3m ago 13m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:28:59.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 msgr2=0x7f1eb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 0x7f1eb00672e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1ec00f9320 tx=0x7f1eb400b040).stop 2022-02-02T18:28:59.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 msgr2=0x7f1ec00f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1eac009830 tx=0x7f1eac009b30).stop 2022-02-02T18:28:59.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 shutdown_connections 2022-02-02T18:28:59.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb0064e20 0x7f1eb00672e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec00f5430 0x7f1ec00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 --2- 172.21.15.96:0/599196638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec00f66d0 0x7f1ec00f7a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 >> 172.21.15.96:0/599196638 conn(0x7f1ec00f0b90 msgr2=0x7f1ec005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 shutdown_connections 2022-02-02T18:28:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.621+0000 7f1ec5f81700 1 -- 172.21.15.96:0/599196638 wait complete. 2022-02-02T18:28:59.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 -- 172.21.15.96:0/928222812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f6530 msgr2=0x7fe0940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 --2- 172.21.15.96:0/928222812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f6530 0x7fe0940f6950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe084004660 tx=0x7fe084009b30).stop 2022-02-02T18:28:59.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 -- 172.21.15.96:0/928222812 shutdown_connections 2022-02-02T18:28:59.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 --2- 172.21.15.96:0/928222812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f77d0 0x7fe0940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 --2- 172.21.15.96:0/928222812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f6530 0x7fe0940f6950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 -- 172.21.15.96:0/928222812 >> 172.21.15.96:0/928222812 conn(0x7fe0940f1c90 msgr2=0x7fe0940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 -- 172.21.15.96:0/928222812 shutdown_connections 2022-02-02T18:28:59.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.717+0000 7fe09b2df700 1 -- 172.21.15.96:0/928222812 wait complete. 2022-02-02T18:28:59.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 Processor -- start 2022-02-02T18:28:59.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 -- start start 2022-02-02T18:28:59.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f6530 0x7fe094068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe094069730 con 0x7fe0940f77d0 2022-02-02T18:28:59.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe09b2df700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe094069870 con 0x7fe0940f6530 2022-02-02T18:28:59.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe099adc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe099adc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54238/0 (socket says 172.21.15.96:54238) 2022-02-02T18:28:59.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.718+0000 7fe099adc700 1 -- 172.21.15.96:0/700554772 learned_addr learned my addr 172.21.15.96:0/700554772 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:28:59.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe09a2dd700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f6530 0x7fe094068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe099adc700 1 -- 172.21.15.96:0/700554772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f6530 msgr2=0x7fe094068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe099adc700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f6530 0x7fe094068c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe099adc700 1 -- 172.21.15.96:0/700554772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084005040 con 0x7fe0940f77d0 2022-02-02T18:28:59.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe099adc700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe09000e7f0 tx=0x7fe09000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0900092e0 con 0x7fe0940f77d0 2022-02-02T18:28:59.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe09000f040 con 0x7fe0940f77d0 2022-02-02T18:28:59.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe094110a90 con 0x7fe0940f77d0 2022-02-02T18:28:59.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe090014750 con 0x7fe0940f77d0 2022-02-02T18:28:59.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.719+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe094111050 con 0x7fe0940f77d0 2022-02-02T18:28:59.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.720+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe094045ad0 con 0x7fe0940f77d0 2022-02-02T18:28:59.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.721+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe09001b030 con 0x7fe0940f77d0 2022-02-02T18:28:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.721+0000 7fe08affd700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 0x7fe0800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:28:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.721+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe090081830 con 0x7fe0940f77d0 2022-02-02T18:28:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.721+0000 7fe09a2dd700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 0x7fe0800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:28:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.722+0000 7fe09a2dd700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 0x7fe0800672e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe084000c00 tx=0x7fe084016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:28:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.725+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe09004f9e0 con 0x7fe0940f77d0 2022-02-02T18:28:59.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.956+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe094027a00 con 0x7fe0940f77d0 2022-02-02T18:28:59.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.956+0000 7fe08affd700 1 -- 172.21.15.96:0/700554772 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe090053000 con 0x7fe0940f77d0 2022-02-02T18:28:59.957 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:28:59.958 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:28:59.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:28:59.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:59.959 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:28:59.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:28:59.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:59.959 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:28:59.960 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:28:59.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:59.960 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:28:59.960 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:28:59.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:28:59.961 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:28:59.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:28:59.962 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:28:59.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:28:59.962 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:28:59.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 msgr2=0x7fe0800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 0x7fe0800672e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe084000c00 tx=0x7fe084016040).stop 2022-02-02T18:28:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 msgr2=0x7fe094069130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:28:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe09000e7f0 tx=0x7fe09000b040).stop 2022-02-02T18:28:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 shutdown_connections 2022-02-02T18:28:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe080064e20 0x7fe0800672e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0940f6530 0x7fe094068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 --2- 172.21.15.96:0/700554772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0940f77d0 0x7fe094069130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:28:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 >> 172.21.15.96:0/700554772 conn(0x7fe0940f1c90 msgr2=0x7fe0940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:28:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 shutdown_connections 2022-02-02T18:28:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:28:59.958+0000 7fe09b2df700 1 -- 172.21.15.96:0/700554772 wait complete. 2022-02-02T18:29:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 -- 172.21.15.96:0/2720018296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f66e0 msgr2=0x7fc9080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 --2- 172.21.15.96:0/2720018296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f66e0 0x7fc9080f6b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc8f8004660 tx=0x7fc8f8009b30).stop 2022-02-02T18:29:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 -- 172.21.15.96:0/2720018296 shutdown_connections 2022-02-02T18:29:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 --2- 172.21.15.96:0/2720018296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f7980 0x7fc9080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 --2- 172.21.15.96:0/2720018296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f66e0 0x7fc9080f6b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 -- 172.21.15.96:0/2720018296 >> 172.21.15.96:0/2720018296 conn(0x7fc9080f1e40 msgr2=0x7fc9080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 -- 172.21.15.96:0/2720018296 shutdown_connections 2022-02-02T18:29:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.056+0000 7fc90cb10700 1 -- 172.21.15.96:0/2720018296 wait complete. 2022-02-02T18:29:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 Processor -- start 2022-02-02T18:29:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 -- start start 2022-02-02T18:29:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f66e0 0x7fc908106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908107a50 con 0x7fc9080f7980 2022-02-02T18:29:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90cb10700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908107b90 con 0x7fc9080f66e0 2022-02-02T18:29:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc905d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc905d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54248/0 (socket says 172.21.15.96:54248) 2022-02-02T18:29:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc905d9b700 1 -- 172.21.15.96:0/3417474183 learned_addr learned my addr 172.21.15.96:0/3417474183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:29:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.057+0000 7fc90659c700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f66e0 0x7fc908106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc905d9b700 1 -- 172.21.15.96:0/3417474183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f66e0 msgr2=0x7fc908106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc905d9b700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f66e0 0x7fc908106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc905d9b700 1 -- 172.21.15.96:0/3417474183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f8005040 con 0x7fc9080f7980 2022-02-02T18:29:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc905d9b700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc8fc0026d0 tx=0x7fc8fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8fc0079c0 con 0x7fc9080f7980 2022-02-02T18:29:00.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc908108530 con 0x7fc9080f7980 2022-02-02T18:29:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc8fc00f040 con 0x7fc9080f7980 2022-02-02T18:29:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8fc0148b0 con 0x7fc9080f7980 2022-02-02T18:29:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.058+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908108af0 con 0x7fc9080f7980 2022-02-02T18:29:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.059+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc908045ad0 con 0x7fc9080f7980 2022-02-02T18:29:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.059+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc8fc007b20 con 0x7fc9080f7980 2022-02-02T18:29:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.060+0000 7fc8f6ffd700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.060+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc8fc0819e0 con 0x7fc9080f7980 2022-02-02T18:29:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.060+0000 7fc90659c700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.060+0000 7fc90659c700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc8f8004630 tx=0x7fc8f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.064+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8fc053510 con 0x7fc9080f7980 2022-02-02T18:29:00.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.266+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc908027a00 con 0x7fc9080f7980 2022-02-02T18:29:00.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.267+0000 7fc8f6ffd700 1 -- 172.21.15.96:0/3417474183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc8fc053100 con 0x7fc9080f7980 2022-02-02T18:29:00.268 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:29:00.268 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:29:00.268 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:29:00.269 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:29:00.269 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:00.269 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:29:00.269 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:29:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:29:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:29:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:29:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:29:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:29:00.271 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:29:00.271 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:29:00.271 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:29:00.271 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:29:00.272 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:29:00.272 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:29:00.272 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:29:00.272 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:29:00.273 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:29:00.273 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:29:00.273 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:29:00.273 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:29:00.273 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:29:00.274 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:29:00.274 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:29:00.274 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:29:00.274 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:29:00.275 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:29:00.275 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:29:00.275 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:29:00.275 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:00.275 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:00.276 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:29:00.276 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:00.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:00.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:00.277 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 msgr2=0x7fc8f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc8f8004630 tx=0x7fc8f8009b30).stop 2022-02-02T18:29:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 msgr2=0x7fc9081074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc8fc0026d0 tx=0x7fc8fc009de0).stop 2022-02-02T18:29:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 shutdown_connections 2022-02-02T18:29:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9080f66e0 0x7fc908106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 --2- 172.21.15.96:0/3417474183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9080f7980 0x7fc9081074a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:00.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 >> 172.21.15.96:0/3417474183 conn(0x7fc9080f1e40 msgr2=0x7fc9080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:00.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 shutdown_connections 2022-02-02T18:29:00.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:00.269+0000 7fc90cb10700 1 -- 172.21.15.96:0/3417474183 wait complete. 2022-02-02T18:29:00.280 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:29:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:00 smithi159 ceph-mon[69013]: pgmap v204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:00 smithi159 ceph-mon[69013]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/700554772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3417474183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:29:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:00 smithi096 ceph-mon[101353]: pgmap v204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:00 smithi096 ceph-mon[101353]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/700554772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3417474183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:29:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:01 smithi159 ceph-mon[69013]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:01 smithi096 ceph-mon[101353]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:02 smithi159 ceph-mon[69013]: pgmap v205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:02 smithi096 ceph-mon[101353]: pgmap v205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: pgmap v206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: pgmap v206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:04.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:05 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:05 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:05 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:05 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:06 smithi159 ceph-mon[69013]: pgmap v207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:06 smithi096 ceph-mon[101353]: pgmap v207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:08 smithi159 ceph-mon[69013]: pgmap v208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:08 smithi096 ceph-mon[101353]: pgmap v208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:10 smithi159 ceph-mon[69013]: pgmap v209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:10 smithi096 ceph-mon[101353]: pgmap v209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:12 smithi159 ceph-mon[69013]: pgmap v210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:12 smithi096 ceph-mon[101353]: pgmap v210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: pgmap v211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: pgmap v211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:14.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:15 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:15 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:15.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:15 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:15.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:15 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:16 smithi159 ceph-mon[69013]: pgmap v212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:16 smithi096 ceph-mon[101353]: pgmap v212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:18 smithi159 ceph-mon[69013]: pgmap v213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:18 smithi096 ceph-mon[101353]: pgmap v213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:20 smithi159 ceph-mon[69013]: pgmap v214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:20 smithi096 ceph-mon[101353]: pgmap v214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:22 smithi159 ceph-mon[69013]: pgmap v215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:22 smithi096 ceph-mon[101353]: pgmap v215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: pgmap v216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: pgmap v216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:24.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:25 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:25 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:25 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:25.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:25 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:26 smithi159 ceph-mon[69013]: pgmap v217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:26 smithi096 ceph-mon[101353]: pgmap v217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:29:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:29:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:29:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:29:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:28 smithi159 ceph-mon[69013]: pgmap v218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:28 smithi096 ceph-mon[101353]: pgmap v218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:30.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1479406361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f5430 msgr2=0x7fdba40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1479406361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f5430 0x7fdba40f5850 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdba0004660 tx=0x7fdba0009b30).stop 2022-02-02T18:29:30.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1479406361 shutdown_connections 2022-02-02T18:29:30.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1479406361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f66d0 0x7fdba40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1479406361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f5430 0x7fdba40f5850 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1479406361 >> 172.21.15.96:0/1479406361 conn(0x7fdba40f0b90 msgr2=0x7fdba40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:30.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1479406361 shutdown_connections 2022-02-02T18:29:30.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1479406361 wait complete. 2022-02-02T18:29:30.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.380+0000 7fdbaa3a0700 1 Processor -- start 2022-02-02T18:29:30.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdbaa3a0700 1 -- start start 2022-02-02T18:29:30.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdbaa3a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f5430 0x7fdba410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdbaa3a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdbaa3a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40602b0 con 0x7fdba40f66d0 2022-02-02T18:29:30.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdbaa3a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40603f0 con 0x7fdba40f5430 2022-02-02T18:29:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54268/0 (socket says 172.21.15.96:54268) 2022-02-02T18:29:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 -- 172.21.15.96:0/1076359612 learned_addr learned my addr 172.21.15.96:0/1076359612 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:29:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba939e700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f5430 0x7fdba410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 -- 172.21.15.96:0/1076359612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f5430 msgr2=0x7fdba410beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f5430 0x7fdba410beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 -- 172.21.15.96:0/1076359612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdba40f66d0 2022-02-02T18:29:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.381+0000 7fdba8b9d700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fdb940026d0 tx=0x7fdb94009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.382+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb940079c0 con 0x7fdba40f66d0 2022-02-02T18:29:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.382+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba410e8a0 con 0x7fdba40f66d0 2022-02-02T18:29:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.382+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb9400f040 con 0x7fdba40f66d0 2022-02-02T18:29:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.382+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb940148b0 con 0x7fdba40f66d0 2022-02-02T18:29:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.382+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba410ed20 con 0x7fdba40f66d0 2022-02-02T18:29:30.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.383+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4045ad0 con 0x7fdba40f66d0 2022-02-02T18:29:30.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.383+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdb94007b20 con 0x7fdba40f66d0 2022-02-02T18:29:30.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.384+0000 7fdb99ffb700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 0x7fdb900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.384+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdb94081990 con 0x7fdba40f66d0 2022-02-02T18:29:30.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.384+0000 7fdba939e700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 0x7fdb900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.384+0000 7fdba939e700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 0x7fdb900672e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdba0013690 tx=0x7fdba0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.388+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb9404fa90 con 0x7fdba40f66d0 2022-02-02T18:29:30.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.566+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba4057f10 con 0x7fdb90064e20 2022-02-02T18:29:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.568+0000 7fdb99ffb700 1 -- 172.21.15.96:0/1076359612 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdba4057f10 con 0x7fdb90064e20 2022-02-02T18:29:30.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 msgr2=0x7fdb900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 0x7fdb900672e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdba0013690 tx=0x7fdba0009b30).stop 2022-02-02T18:29:30.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 msgr2=0x7fdba410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fdb940026d0 tx=0x7fdb94009de0).stop 2022-02-02T18:29:30.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 shutdown_connections 2022-02-02T18:29:30.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb90064e20 0x7fdb900672e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba40f5430 0x7fdba410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 --2- 172.21.15.96:0/1076359612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdba40f66d0 0x7fdba410e3b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 >> 172.21.15.96:0/1076359612 conn(0x7fdba40f0b90 msgr2=0x7fdba40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:30.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 shutdown_connections 2022-02-02T18:29:30.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.570+0000 7fdbaa3a0700 1 -- 172.21.15.96:0/1076359612 wait complete. 2022-02-02T18:29:30.580 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:29:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 -- 172.21.15.96:0/104058061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f5440 msgr2=0x7f72940f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 --2- 172.21.15.96:0/104058061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f5440 0x7f72940f5860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7290004660 tx=0x7f7290009b30).stop 2022-02-02T18:29:30.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 -- 172.21.15.96:0/104058061 shutdown_connections 2022-02-02T18:29:30.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 --2- 172.21.15.96:0/104058061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f66e0 0x7f72940f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 --2- 172.21.15.96:0/104058061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f5440 0x7f72940f5860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.668+0000 7f729b2c4700 1 -- 172.21.15.96:0/104058061 >> 172.21.15.96:0/104058061 conn(0x7f72940f0ba0 msgr2=0x7f72940f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 -- 172.21.15.96:0/104058061 shutdown_connections 2022-02-02T18:29:30.673 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:30 smithi096 ceph-mon[101353]: pgmap v219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 -- 172.21.15.96:0/104058061 wait complete. 2022-02-02T18:29:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 Processor -- start 2022-02-02T18:29:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 -- start start 2022-02-02T18:29:30.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f5440 0x7f7294105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72941067e0 con 0x7f72940f66e0 2022-02-02T18:29:30.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f729b2c4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294106fe0 con 0x7f72940f5440 2022-02-02T18:29:30.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f7299ac1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f7299ac1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54282/0 (socket says 172.21.15.96:54282) 2022-02-02T18:29:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.669+0000 7f7299ac1700 1 -- 172.21.15.96:0/424524829 learned_addr learned my addr 172.21.15.96:0/424524829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:29:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f729a2c2700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f5440 0x7f7294105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f7299ac1700 1 -- 172.21.15.96:0/424524829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f5440 msgr2=0x7f7294105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f7299ac1700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f5440 0x7f7294105d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f7299ac1700 1 -- 172.21.15.96:0/424524829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290005040 con 0x7f72940f66e0 2022-02-02T18:29:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f7299ac1700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f728400c530 tx=0x7f7284007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f728400f650 con 0x7f72940f66e0 2022-02-02T18:29:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72941072c0 con 0x7f72940f66e0 2022-02-02T18:29:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f728400fc60 con 0x7f72940f66e0 2022-02-02T18:29:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7284012c20 con 0x7f72940f66e0 2022-02-02T18:29:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.670+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7294107880 con 0x7f72940f66e0 2022-02-02T18:29:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.671+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c004fa0 con 0x7f72940f66e0 2022-02-02T18:29:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.671+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7284010070 con 0x7f72940f66e0 2022-02-02T18:29:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.672+0000 7f728affd700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 0x7f72800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.672+0000 7f729a2c2700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 0x7f72800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.672+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7284081690 con 0x7f72940f66e0 2022-02-02T18:29:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.672+0000 7f729a2c2700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 0x7f72800672e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7290004630 tx=0x7f7290009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.676+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7284053140 con 0x7f72940f66e0 2022-02-02T18:29:30.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:30 smithi159 ceph-mon[69013]: pgmap v219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.853+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f727c000bc0 con 0x7f7280064e20 2022-02-02T18:29:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.862+0000 7f728affd700 1 -- 172.21.15.96:0/424524829 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f727c000bc0 con 0x7f7280064e20 2022-02-02T18:29:30.863 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:29:30.863 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (12m) 3m ago 14m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:29:30.863 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 3m ago 13m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:29:30.864 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (5m) 2m ago 13m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:29:30.864 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (12m) 3m ago 13m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:29:30.864 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (9m) 3m ago 9m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:29:30.864 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (5m) 3m ago 10m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:29:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (10m) 2m ago 10m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:29:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (5m) 2m ago 10m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:29:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (7m) 3m ago 15m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:29:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (6m) 2m ago 13m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:29:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 3m ago 15m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:29:30.866 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (5m) 2m ago 13m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:29:30.866 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (13m) 3m ago 13m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:29:30.866 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (13m) 2m ago 13m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:29:30.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 3m ago 12m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:29:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 3m ago 12m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:29:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 3m ago 12m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:29:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3m) 2m ago 11m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:29:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2m) 2m ago 11m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:29:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2m) 2m ago 11m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:29:30.868 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (12m) 3m ago 13m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:29:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 msgr2=0x7f72800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 0x7f72800672e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7290004630 tx=0x7f7290009b30).stop 2022-02-02T18:29:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 msgr2=0x7f7294106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f728400c530 tx=0x7f7284007e20).stop 2022-02-02T18:29:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 shutdown_connections 2022-02-02T18:29:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7280064e20 0x7f72800672e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72940f5440 0x7f7294105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 --2- 172.21.15.96:0/424524829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72940f66e0 0x7f7294106230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 >> 172.21.15.96:0/424524829 conn(0x7f72940f0ba0 msgr2=0x7f72940fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 shutdown_connections 2022-02-02T18:29:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.864+0000 7f729b2c4700 1 -- 172.21.15.96:0/424524829 wait complete. 2022-02-02T18:29:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 -- 172.21.15.96:0/4214946403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f6700 msgr2=0x7f89580f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 --2- 172.21.15.96:0/4214946403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f6700 0x7f89580f6b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8948004660 tx=0x7f8948009b30).stop 2022-02-02T18:29:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 -- 172.21.15.96:0/4214946403 shutdown_connections 2022-02-02T18:29:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 --2- 172.21.15.96:0/4214946403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f6700 0x7f89580f6b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 --2- 172.21.15.96:0/4214946403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f5460 0x7f89580f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 -- 172.21.15.96:0/4214946403 >> 172.21.15.96:0/4214946403 conn(0x7f89580f0bc0 msgr2=0x7f89580f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.961+0000 7f895d8be700 1 -- 172.21.15.96:0/4214946403 shutdown_connections 2022-02-02T18:29:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 -- 172.21.15.96:0/4214946403 wait complete. 2022-02-02T18:29:30.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 Processor -- start 2022-02-02T18:29:30.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 -- start start 2022-02-02T18:29:30.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f6700 0x7f895810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89580603e0 con 0x7f89580f5460 2022-02-02T18:29:30.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.962+0000 7f895d8be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958060520 con 0x7f89580f6700 2022-02-02T18:29:30.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54290/0 (socket says 172.21.15.96:54290) 2022-02-02T18:29:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 -- 172.21.15.96:0/3975400433 learned_addr learned my addr 172.21.15.96:0/3975400433 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:29:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f89567fc700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f6700 0x7f895810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 -- 172.21.15.96:0/3975400433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f6700 msgr2=0x7f895810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f6700 0x7f895810bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 -- 172.21.15.96:0/3975400433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948005040 con 0x7f89580f5460 2022-02-02T18:29:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f8956ffd700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f894c002700 tx=0x7f894c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f894c009320 con 0x7f89580f5460 2022-02-02T18:29:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895810c540 con 0x7f89580f5460 2022-02-02T18:29:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f894c00f040 con 0x7f89580f5460 2022-02-02T18:29:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f894c014900 con 0x7f89580f5460 2022-02-02T18:29:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.963+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895810cb00 con 0x7f89580f5460 2022-02-02T18:29:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.965+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8958045ad0 con 0x7f89580f5460 2022-02-02T18:29:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.965+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f894c009480 con 0x7f89580f5460 2022-02-02T18:29:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.965+0000 7f893f7fe700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 0x7f89400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.965+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f894c081df0 con 0x7f89580f5460 2022-02-02T18:29:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.965+0000 7f89567fc700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 0x7f89400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.966+0000 7f89567fc700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 0x7f89400672e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8948004630 tx=0x7f8948009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:30.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:30.969+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f894c04fe30 con 0x7f89580f5460 2022-02-02T18:29:31.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.199+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8958027a00 con 0x7f89580f5460 2022-02-02T18:29:31.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.200+0000 7f893f7fe700 1 -- 172.21.15.96:0/3975400433 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f894c053450 con 0x7f89580f5460 2022-02-02T18:29:31.201 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:29:31.201 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:29:31.201 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:29:31.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:29:31.202 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:29:31.202 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:29:31.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:29:31.202 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:29:31.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:29:31.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:29:31.203 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:29:31.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:29:31.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:29:31.204 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:29:31.204 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:29:31.204 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:29:31.204 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:29:31.205 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:29:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 msgr2=0x7f89400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 0x7f89400672e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8948004630 tx=0x7f8948009b30).stop 2022-02-02T18:29:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 msgr2=0x7f8958109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f894c002700 tx=0x7f894c009d80).stop 2022-02-02T18:29:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 shutdown_connections 2022-02-02T18:29:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8940064e20 0x7f89400672e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89580f5460 0x7f8958109a90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 --2- 172.21.15.96:0/3975400433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580f6700 0x7f895810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 >> 172.21.15.96:0/3975400433 conn(0x7f89580f0bc0 msgr2=0x7f89580fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 shutdown_connections 2022-02-02T18:29:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.202+0000 7f895d8be700 1 -- 172.21.15.96:0/3975400433 wait complete. 2022-02-02T18:29:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 -- 172.21.15.96:0/1000425323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 msgr2=0x7f82580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 --2- 172.21.15.96:0/1000425323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82580f6cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8254004660 tx=0x7f8254009b30).stop 2022-02-02T18:29:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 -- 172.21.15.96:0/1000425323 shutdown_connections 2022-02-02T18:29:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 --2- 172.21.15.96:0/1000425323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82580f6cc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 --2- 172.21.15.96:0/1000425323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 0x7f82580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:29:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 -- 172.21.15.96:0/1000425323 >> 172.21.15.96:0/1000425323 conn(0x7f82580f0d40 msgr2=0x7f82580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 -- 172.21.15.96:0/1000425323 shutdown_connections 2022-02-02T18:29:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.299+0000 7f8260697700 1 -- 172.21.15.96:0/1000425323 wait complete. 2022-02-02T18:29:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 Processor -- start 2022-02-02T18:29:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 -- start start 2022-02-02T18:29:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 0x7f8258105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82581069e0 con 0x7f82580f6860 2022-02-02T18:29:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f8260697700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8258107290 con 0x7f82580f55c0 2022-02-02T18:29:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f825dc32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f825dc32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54302/0 (socket says 172.21.15.96:54302) 2022-02-02T18:29:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.300+0000 7f825dc32700 1 -- 172.21.15.96:0/1636124549 learned_addr learned my addr 172.21.15.96:0/1636124549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:29:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f825e433700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 0x7f8258105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f825dc32700 1 -- 172.21.15.96:0/1636124549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 msgr2=0x7f8258105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f825dc32700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 0x7f8258105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f825dc32700 1 -- 172.21.15.96:0/1636124549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254005040 con 0x7f82580f6860 2022-02-02T18:29:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f825dc32700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8254009990 tx=0x7f8254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8254018070 con 0x7f82580f6860 2022-02-02T18:29:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8254007ca0 con 0x7f82580f6860 2022-02-02T18:29:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8258107510 con 0x7f82580f6860 2022-02-02T18:29:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825401c620 con 0x7f82580f6860 2022-02-02T18:29:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.301+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82581079f0 con 0x7f82580f6860 2022-02-02T18:29:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.302+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8258045ad0 con 0x7f82580f6860 2022-02-02T18:29:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.303+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f825401d960 con 0x7f82580f6860 2022-02-02T18:29:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.303+0000 7f824effd700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 0x7f82440694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:29:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.303+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f82540837d0 con 0x7f82580f6860 2022-02-02T18:29:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.303+0000 7f825e433700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 0x7f82440694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:29:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.304+0000 7f825e433700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 0x7f82440694a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f82580f66c0 tx=0x7f8248008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:29:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.307+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8254055470 con 0x7f82580f6860 2022-02-02T18:29:31.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.510+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f82580ff830 con 0x7f82580f6860 2022-02-02T18:29:31.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.511+0000 7f824effd700 1 -- 172.21.15.96:0/1636124549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8254055060 con 0x7f82580f6860 2022-02-02T18:29:31.512 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:29:31.512 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:29:31.512 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:29:31.512 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:29:31.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:31.513 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:29:31.513 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:29:31.513 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:29:31.513 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:29:31.514 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:29:31.514 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:29:31.514 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:29:31.514 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:29:31.515 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:29:31.515 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:29:31.515 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:29:31.515 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:29:31.516 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:29:31.516 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:29:31.516 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:29:31.516 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:29:31.516 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:29:31.517 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:29:31.517 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:29:31.517 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:29:31.517 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:29:31.518 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:29:31.518 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:29:31.518 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:29:31.518 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:29:31.519 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:29:31.519 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:29:31.519 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:31.519 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:31.519 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:29:31.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:29:31.520 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:31.520 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:31.520 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:29:31.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 msgr2=0x7f82440694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 0x7f82440694a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f82580f66c0 tx=0x7f8248008040).stop 2022-02-02T18:29:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 msgr2=0x7f82581063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:29:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8254009990 tx=0x7f8254009b30).stop 2022-02-02T18:29:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 shutdown_connections 2022-02-02T18:29:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8244066fe0 0x7f82440694a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82580f55c0 0x7f8258105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 --2- 172.21.15.96:0/1636124549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82580f6860 0x7f82581063a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:29:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 >> 172.21.15.96:0/1636124549 conn(0x7f82580f0d40 msgr2=0x7f82580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:29:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 shutdown_connections 2022-02-02T18:29:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:29:31.513+0000 7f8260697700 1 -- 172.21.15.96:0/1636124549 wait complete. 2022-02-02T18:29:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:29:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3975400433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3975400433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:32 smithi159 ceph-mon[69013]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:32 smithi159 ceph-mon[69013]: pgmap v220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:32 smithi159 ceph-mon[69013]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1636124549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:29:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:32 smithi096 ceph-mon[101353]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:32 smithi096 ceph-mon[101353]: pgmap v220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:32 smithi096 ceph-mon[101353]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:29:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1636124549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:29:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: pgmap v221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: pgmap v221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:34.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:34.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:34.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:34.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:34.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:34.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:34.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:35 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:35 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:35.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:35 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:35.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:35 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:36 smithi159 ceph-mon[69013]: pgmap v222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:36 smithi096 ceph-mon[101353]: pgmap v222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:37 smithi159 ceph-mon[69013]: pgmap v223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:37 smithi096 ceph-mon[101353]: pgmap v223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:40.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:39 smithi159 ceph-mon[69013]: pgmap v224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:39 smithi096 ceph-mon[101353]: pgmap v224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:42.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:42 smithi159 ceph-mon[69013]: pgmap v225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:42 smithi096 ceph-mon[101353]: pgmap v225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:44.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: pgmap v226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:44.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: pgmap v226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:44.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:44.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:44.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:45 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:45 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:45 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:45 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:46 smithi159 ceph-mon[69013]: pgmap v227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:46 smithi096 ceph-mon[101353]: pgmap v227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:48 smithi159 ceph-mon[69013]: pgmap v228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:48 smithi096 ceph-mon[101353]: pgmap v228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:50 smithi159 ceph-mon[69013]: pgmap v229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:50 smithi096 ceph-mon[101353]: pgmap v229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:52.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:52 smithi159 ceph-mon[69013]: pgmap v230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:52 smithi096 ceph-mon[101353]: pgmap v230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: pgmap v231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: pgmap v231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:29:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:29:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:29:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:29:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:54.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:29:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:55 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:55 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:55 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:29:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:55 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:29:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:56 smithi159 ceph-mon[69013]: pgmap v232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:56 smithi096 ceph-mon[101353]: pgmap v232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:58.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:29:58 smithi159 ceph-mon[69013]: pgmap v233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:29:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:29:58 smithi096 ceph-mon[101353]: pgmap v233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: pgmap v234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:30:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T18:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: fs cephfs is degraded 2022-02-02T18:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T18:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: fs cephfs has 1 failed mds 2022-02-02T18:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-02-02T18:30:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: mds.cephfs.smithi096.pitrsc crashed on host smithi096 at 2022-02-02T18:22:26.459659Z 2022-02-02T18:30:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: mds.cephfs.smithi096.pitrsc crashed on host smithi096 at 2022-02-02T18:23:43.070058Z 2022-02-02T18:30:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:00 smithi159 ceph-mon[69013]: mds.cephfs.smithi159.shbucd crashed on host smithi159 at 2022-02-02T18:22:07.460849Z 2022-02-02T18:30:00.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: pgmap v234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:00.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:30:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T18:30:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: fs cephfs is degraded 2022-02-02T18:30:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T18:30:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: fs cephfs has 1 failed mds 2022-02-02T18:30:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-02-02T18:30:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: mds.cephfs.smithi096.pitrsc crashed on host smithi096 at 2022-02-02T18:22:26.459659Z 2022-02-02T18:30:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: mds.cephfs.smithi096.pitrsc crashed on host smithi096 at 2022-02-02T18:23:43.070058Z 2022-02-02T18:30:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:00 smithi096 ceph-mon[101353]: mds.cephfs.smithi159.shbucd crashed on host smithi159 at 2022-02-02T18:22:07.460849Z 2022-02-02T18:30:01.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 -- 172.21.15.96:0/645817776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 msgr2=0x7f07240f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 --2- 172.21.15.96:0/645817776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f07240f8120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f0714004660 tx=0x7f0714009b30).stop 2022-02-02T18:30:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 -- 172.21.15.96:0/645817776 shutdown_connections 2022-02-02T18:30:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 --2- 172.21.15.96:0/645817776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f07240f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 --2- 172.21.15.96:0/645817776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f07240f8120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.623+0000 7f072a437700 1 -- 172.21.15.96:0/645817776 >> 172.21.15.96:0/645817776 conn(0x7f07240f0540 msgr2=0x7f07240f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.624+0000 7f072a437700 1 -- 172.21.15.96:0/645817776 shutdown_connections 2022-02-02T18:30:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.624+0000 7f072a437700 1 -- 172.21.15.96:0/645817776 wait complete. 2022-02-02T18:30:01.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 Processor -- start 2022-02-02T18:30:01.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 -- start start 2022-02-02T18:30:01.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f0724107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724107a10 con 0x7f07240f7d00 2022-02-02T18:30:01.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f072a437700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724107b50 con 0x7f07240f8610 2022-02-02T18:30:01.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f0723fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f0723fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54320/0 (socket says 172.21.15.96:54320) 2022-02-02T18:30:01.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f0723fff700 1 -- 172.21.15.96:0/3287263845 learned_addr learned my addr 172.21.15.96:0/3287263845 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:01.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f07237fe700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f0724107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.625+0000 7f0723fff700 1 -- 172.21.15.96:0/3287263845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 msgr2=0x7f0724107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0723fff700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f0724107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0723fff700 1 -- 172.21.15.96:0/3287263845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714005040 con 0x7f07240f7d00 2022-02-02T18:30:01.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f07237fe700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f0724107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:30:01.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0723fff700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f0714009990 tx=0x7f0714009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:01.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0714018070 con 0x7f07240f7d00 2022-02-02T18:30:01.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724108490 con 0x7f07240f7d00 2022-02-02T18:30:01.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0714007ca0 con 0x7f07240f7d00 2022-02-02T18:30:01.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071401c620 con 0x7f07240f7d00 2022-02-02T18:30:01.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.626+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07241089f0 con 0x7f07240f7d00 2022-02-02T18:30:01.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.627+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724045ad0 con 0x7f07240f7d00 2022-02-02T18:30:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.627+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f071401d960 con 0x7f07240f7d00 2022-02-02T18:30:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.628+0000 7f0720ff9700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.628+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0714083700 con 0x7f07240f7d00 2022-02-02T18:30:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.628+0000 7f07237fe700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.628+0000 7f07237fe700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f07180041d0 tx=0x7f0718009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:01.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.632+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0714055230 con 0x7f07240f7d00 2022-02-02T18:30:01.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.811+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07240ff060 con 0x7f070c064dd0 2022-02-02T18:30:01.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.813+0000 7f0720ff9700 1 -- 172.21.15.96:0/3287263845 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0718004600 con 0x7f070c064dd0 2022-02-02T18:30:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.814+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 msgr2=0x7f070c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.814+0000 7f072a437700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f07180041d0 tx=0x7f0718009040).stop 2022-02-02T18:30:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.814+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 msgr2=0x7f0724106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.814+0000 7f072a437700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f0714009990 tx=0x7f0714009b30).stop 2022-02-02T18:30:01.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 shutdown_connections 2022-02-02T18:30:01.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07240f7d00 0x7f0724106f70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 --2- 172.21.15.96:0/3287263845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07240f8610 0x7f0724107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 >> 172.21.15.96:0/3287263845 conn(0x7f07240f0540 msgr2=0x7f07240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 shutdown_connections 2022-02-02T18:30:01.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.815+0000 7f072a437700 1 -- 172.21.15.96:0/3287263845 wait complete. 2022-02-02T18:30:01.826 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:30:01.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- 172.21.15.96:0/1700756306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f6860 msgr2=0x7fed940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 --2- 172.21.15.96:0/1700756306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f6860 0x7fed940f6cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fed80004660 tx=0x7fed80009b30).stop 2022-02-02T18:30:01.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- 172.21.15.96:0/1700756306 shutdown_connections 2022-02-02T18:30:01.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 --2- 172.21.15.96:0/1700756306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f6860 0x7fed940f6cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 --2- 172.21.15.96:0/1700756306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f55c0 0x7fed940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- 172.21.15.96:0/1700756306 >> 172.21.15.96:0/1700756306 conn(0x7fed940f0d40 msgr2=0x7fed940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:01.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- 172.21.15.96:0/1700756306 shutdown_connections 2022-02-02T18:30:01.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- 172.21.15.96:0/1700756306 wait complete. 2022-02-02T18:30:01.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 Processor -- start 2022-02-02T18:30:01.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.913+0000 7fed9add2700 1 -- start start 2022-02-02T18:30:01.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed9add2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed9add2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f6860 0x7fed9410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed9add2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940602b0 con 0x7fed940f55c0 2022-02-02T18:30:01.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed9add2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940603f0 con 0x7fed940f6860 2022-02-02T18:30:01.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54328/0 (socket says 172.21.15.96:54328) 2022-02-02T18:30:01.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 -- 172.21.15.96:0/2130067592 learned_addr learned my addr 172.21.15.96:0/2130067592 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:01.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed93fff700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f6860 0x7fed9410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 -- 172.21.15.96:0/2130067592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f6860 msgr2=0x7fed9410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:01.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f6860 0x7fed9410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:01.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 -- 172.21.15.96:0/2130067592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80005040 con 0x7fed940f55c0 2022-02-02T18:30:01.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.914+0000 7fed98b6e700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fed88002700 tx=0x7fed88009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:01.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.915+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed88009320 con 0x7fed940f55c0 2022-02-02T18:30:01.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.915+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9410ea60 con 0x7fed940f55c0 2022-02-02T18:30:01.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.915+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed8800f040 con 0x7fed940f55c0 2022-02-02T18:30:01.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.915+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed88014900 con 0x7fed940f55c0 2022-02-02T18:30:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.915+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9410eee0 con 0x7fed940f55c0 2022-02-02T18:30:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.916+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed94045ad0 con 0x7fed940f55c0 2022-02-02T18:30:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.916+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed88009480 con 0x7fed940f55c0 2022-02-02T18:30:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.917+0000 7fed917fa700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 0x7fed84067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.917+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed88081cc0 con 0x7fed940f55c0 2022-02-02T18:30:01.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.917+0000 7fed93fff700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 0x7fed84067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:01.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.917+0000 7fed93fff700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 0x7fed84067270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fed80004e30 tx=0x7fed80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:01.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:01.921+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed8804fe80 con 0x7fed940f55c0 2022-02-02T18:30:02.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.094+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed94057f10 con 0x7fed84064db0 2022-02-02T18:30:02.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.103+0000 7fed917fa700 1 -- 172.21.15.96:0/2130067592 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fed94057f10 con 0x7fed84064db0 2022-02-02T18:30:02.104 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:30:02.104 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (13m) 4m ago 14m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:30:02.105 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 4m ago 14m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:30:02.105 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (5m) 2m ago 13m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:30:02.105 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (13m) 4m ago 14m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:30:02.105 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (10m) 4m ago 10m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:30:02.106 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (6m) 4m ago 10m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:30:02.106 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (10m) 2m ago 10m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:30:02.106 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (6m) 2m ago 10m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:30:02.106 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (7m) 4m ago 15m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:30:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (7m) 2m ago 13m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:30:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 4m ago 15m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:30:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (6m) 2m ago 13m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:30:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (14m) 4m ago 14m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:30:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (13m) 2m ago 13m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:30:02.108 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 4m ago 13m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:30:02.108 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 4m ago 12m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:30:02.108 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 4m ago 12m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:30:02.108 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3m) 2m ago 12m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:30:02.109 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3m) 2m ago 12m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:30:02.109 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2m) 2m ago 11m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:30:02.109 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (13m) 4m ago 14m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:30:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.105+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 msgr2=0x7fed84067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.105+0000 7fed9add2700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 0x7fed84067270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fed80004e30 tx=0x7fed80009b30).stop 2022-02-02T18:30:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.105+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 msgr2=0x7fed9410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.105+0000 7fed9add2700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fed88002700 tx=0x7fed88009d80).stop 2022-02-02T18:30:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 shutdown_connections 2022-02-02T18:30:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed84064db0 0x7fed84067270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed940f55c0 0x7fed9410c070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 --2- 172.21.15.96:0/2130067592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed940f6860 0x7fed9410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 >> 172.21.15.96:0/2130067592 conn(0x7fed940f0d40 msgr2=0x7fed940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 shutdown_connections 2022-02-02T18:30:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.106+0000 7fed9add2700 1 -- 172.21.15.96:0/2130067592 wait complete. 2022-02-02T18:30:02.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 -- 172.21.15.96:0/3472560760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f66d0 msgr2=0x7f3d040f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 --2- 172.21.15.96:0/3472560760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f66d0 0x7f3d040f6b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f3cf0004660 tx=0x7f3cf0009b30).stop 2022-02-02T18:30:02.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 -- 172.21.15.96:0/3472560760 shutdown_connections 2022-02-02T18:30:02.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 --2- 172.21.15.96:0/3472560760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f66d0 0x7f3d040f6b30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 --2- 172.21.15.96:0/3472560760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f5430 0x7f3d040f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 -- 172.21.15.96:0/3472560760 >> 172.21.15.96:0/3472560760 conn(0x7f3d040f0b90 msgr2=0x7f3d040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:02.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 -- 172.21.15.96:0/3472560760 shutdown_connections 2022-02-02T18:30:02.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.203+0000 7f3d09cee700 1 -- 172.21.15.96:0/3472560760 wait complete. 2022-02-02T18:30:02.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 Processor -- start 2022-02-02T18:30:02.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 -- start start 2022-02-02T18:30:02.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f66d0 0x7f3d04109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041099e0 con 0x7f3d040f5430 2022-02-02T18:30:02.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d09cee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04109b20 con 0x7f3d040f66d0 2022-02-02T18:30:02.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d08cec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d08cec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54338/0 (socket says 172.21.15.96:54338) 2022-02-02T18:30:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.204+0000 7f3d08cec700 1 -- 172.21.15.96:0/1218803530 learned_addr learned my addr 172.21.15.96:0/1218803530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d03fff700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f66d0 0x7f3d04109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d08cec700 1 -- 172.21.15.96:0/1218803530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f66d0 msgr2=0x7f3d04109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d08cec700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f66d0 0x7f3d04109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d08cec700 1 -- 172.21.15.96:0/1218803530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0005040 con 0x7f3d040f5430 2022-02-02T18:30:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d08cec700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3cf800c790 tx=0x7f3cf8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8013630 con 0x7f3d040f5430 2022-02-02T18:30:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0410a4c0 con 0x7f3d040f5430 2022-02-02T18:30:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3cf8012860 con 0x7f3d040f5430 2022-02-02T18:30:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8002780 con 0x7f3d040f5430 2022-02-02T18:30:02.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.205+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0410aa80 con 0x7f3d040f5430 2022-02-02T18:30:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.206+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d04045ad0 con 0x7f3d040f5430 2022-02-02T18:30:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.206+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3cf8010070 con 0x7f3d040f5430 2022-02-02T18:30:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.207+0000 7f3d017fa700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 0x7f3cf40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.207+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3cf8081b30 con 0x7f3d040f5430 2022-02-02T18:30:02.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.207+0000 7f3d03fff700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 0x7f3cf40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.207+0000 7f3d03fff700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 0x7f3cf40672e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3cf0004630 tx=0x7f3cf0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:02.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.211+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3cf8053600 con 0x7f3d040f5430 2022-02-02T18:30:02.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.447+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d0410f560 con 0x7f3d040f5430 2022-02-02T18:30:02.449 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:02 smithi096 ceph-mon[101353]: pgmap v235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.448+0000 7f3d017fa700 1 -- 172.21.15.96:0/1218803530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3cf80531f0 con 0x7f3d040f5430 2022-02-02T18:30:02.450 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:30:02.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:30:02.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:30:02.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:02.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:30:02.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:30:02.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:02.451 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:30:02.452 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:30:02.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:02.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:30:02.452 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:30:02.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:02.453 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:30:02.453 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:30:02.453 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:30:02.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:30:02.454 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:30:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 msgr2=0x7f3cf40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 0x7f3cf40672e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3cf0004630 tx=0x7f3cf0009b30).stop 2022-02-02T18:30:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 msgr2=0x7f3d04108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3cf800c790 tx=0x7f3cf8007d90).stop 2022-02-02T18:30:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 shutdown_connections 2022-02-02T18:30:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cf4064e20 0x7f3cf40672e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d040f5430 0x7f3d04108f40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 --2- 172.21.15.96:0/1218803530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d040f66d0 0x7f3d04109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 >> 172.21.15.96:0/1218803530 conn(0x7f3d040f0b90 msgr2=0x7f3d0405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 shutdown_connections 2022-02-02T18:30:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.450+0000 7f3d09cee700 1 -- 172.21.15.96:0/1218803530 wait complete. 2022-02-02T18:30:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:02 smithi159 ceph-mon[69013]: pgmap v235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- 172.21.15.96:0/468800166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 msgr2=0x7f83340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 --2- 172.21.15.96:0/468800166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f83340f6b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8330004660 tx=0x7f8330009b30).stop 2022-02-02T18:30:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- 172.21.15.96:0/468800166 shutdown_connections 2022-02-02T18:30:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 --2- 172.21.15.96:0/468800166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f83340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 --2- 172.21.15.96:0/468800166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f83340f6b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- 172.21.15.96:0/468800166 >> 172.21.15.96:0/468800166 conn(0x7f83340f1e40 msgr2=0x7f83340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:02.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- 172.21.15.96:0/468800166 shutdown_connections 2022-02-02T18:30:02.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- 172.21.15.96:0/468800166 wait complete. 2022-02-02T18:30:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 Processor -- start 2022-02-02T18:30:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- start start 2022-02-02T18:30:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f8334069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833406a380 con 0x7f83340f66e0 2022-02-02T18:30:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.548+0000 7f833b4d2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833406a4c0 con 0x7f83340f7980 2022-02-02T18:30:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54348/0 (socket says 172.21.15.96:54348) 2022-02-02T18:30:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 -- 172.21.15.96:0/4218311617 learned_addr learned my addr 172.21.15.96:0/4218311617 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f8338a6d700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f8334069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 -- 172.21.15.96:0/4218311617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 msgr2=0x7f8334069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f8334069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 -- 172.21.15.96:0/4218311617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330005040 con 0x7f83340f66e0 2022-02-02T18:30:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f8338a6d700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f8334069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:30:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833926e700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8330014040 tx=0x7f833000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8330019070 con 0x7f83340f66e0 2022-02-02T18:30:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8330007e70 con 0x7f83340f66e0 2022-02-02T18:30:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833406a740 con 0x7f83340f66e0 2022-02-02T18:30:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8330014d50 con 0x7f83340f66e0 2022-02-02T18:30:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.549+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833406aca0 con 0x7f83340f66e0 2022-02-02T18:30:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.550+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8334045ad0 con 0x7f83340f66e0 2022-02-02T18:30:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.551+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8330025070 con 0x7f83340f66e0 2022-02-02T18:30:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.551+0000 7f8329ffb700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 0x7f8320067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.551+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8330082a60 con 0x7f83340f66e0 2022-02-02T18:30:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.551+0000 7f8338a6d700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 0x7f8320067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.552+0000 7f8338a6d700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 0x7f8320067290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8324009170 tx=0x7f832400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.555+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8330050c20 con 0x7f83340f66e0 2022-02-02T18:30:02.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.755+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83340fef70 con 0x7f83340f66e0 2022-02-02T18:30:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.756+0000 7f8329ffb700 1 -- 172.21.15.96:0/4218311617 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8330023020 con 0x7f83340f66e0 2022-02-02T18:30:02.757 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:30:02.757 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:30:02.758 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:30:02.758 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:30:02.758 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:02.758 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:30:02.759 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:30:02.760 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:30:02.760 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:30:02.760 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:30:02.760 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:30:02.760 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:30:02.761 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:30:02.761 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:30:02.761 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:30:02.761 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:30:02.762 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:30:02.762 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:30:02.762 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:30:02.763 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:30:02.763 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:30:02.763 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:30:02.763 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:30:02.763 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:30:02.764 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:30:02.764 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:30:02.764 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:30:02.764 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:30:02.765 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:30:02.765 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:30:02.765 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:30:02.765 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:30:02.765 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:02.766 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:02.766 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:30:02.766 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:02.766 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:02.767 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:02.767 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 msgr2=0x7f8320067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 0x7f8320067290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8324009170 tx=0x7f832400b040).stop 2022-02-02T18:30:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 msgr2=0x7f833406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8330014040 tx=0x7f833000b040).stop 2022-02-02T18:30:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 shutdown_connections 2022-02-02T18:30:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8320064dd0 0x7f8320067290 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83340f66e0 0x7f833406b9a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 --2- 172.21.15.96:0/4218311617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83340f7980 0x7f8334069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 >> 172.21.15.96:0/4218311617 conn(0x7f83340f1e40 msgr2=0x7f83340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.758+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 shutdown_connections 2022-02-02T18:30:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:02.759+0000 7f833b4d2700 1 -- 172.21.15.96:0/4218311617 wait complete. 2022-02-02T18:30:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:30:03.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:03 smithi159 ceph-mon[69013]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:03 smithi159 ceph-mon[69013]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1218803530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4218311617' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:30:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:03 smithi096 ceph-mon[101353]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:03 smithi096 ceph-mon[101353]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1218803530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4218311617' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:30:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: pgmap v236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: pgmap v236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:05 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:05 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:05 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:05 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:06 smithi159 ceph-mon[69013]: pgmap v237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:06 smithi096 ceph-mon[101353]: pgmap v237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:08 smithi159 ceph-mon[69013]: pgmap v238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:08 smithi096 ceph-mon[101353]: pgmap v238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:10 smithi159 ceph-mon[69013]: pgmap v239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:10 smithi096 ceph-mon[101353]: pgmap v239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:12 smithi159 ceph-mon[69013]: pgmap v240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:12 smithi096 ceph-mon[101353]: pgmap v240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: pgmap v241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: pgmap v241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:15 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:15 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:16 smithi159 ceph-mon[69013]: pgmap v242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:16 smithi096 ceph-mon[101353]: pgmap v242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:18 smithi159 ceph-mon[69013]: pgmap v243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:18 smithi096 ceph-mon[101353]: pgmap v243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:20 smithi159 ceph-mon[69013]: pgmap v244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:20 smithi096 ceph-mon[101353]: pgmap v244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:22.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:22 smithi159 ceph-mon[69013]: pgmap v245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:22 smithi096 ceph-mon[101353]: pgmap v245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:24 smithi159 ceph-mon[69013]: pgmap v246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:24 smithi096 ceph-mon[101353]: pgmap v246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:24.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:25.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:25.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:26 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:26 smithi159 ceph-mon[69013]: pgmap v247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:26 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:26 smithi096 ceph-mon[101353]: pgmap v247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:27.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:30:27.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:30:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:30:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:30:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:28 smithi159 ceph-mon[69013]: pgmap v248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:28 smithi096 ceph-mon[101353]: pgmap v248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:30 smithi159 ceph-mon[69013]: pgmap v249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:30 smithi096 ceph-mon[101353]: pgmap v249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:32 smithi159 ceph-mon[69013]: pgmap v250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:32 smithi096 ceph-mon[101353]: pgmap v250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 -- 172.21.15.96:0/2423026227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9840f9820 msgr2=0x7fd9840fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 --2- 172.21.15.96:0/2423026227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9840f9820 0x7fd9840fbc70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd978004660 tx=0x7fd978009b30).stop 2022-02-02T18:30:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 -- 172.21.15.96:0/2423026227 shutdown_connections 2022-02-02T18:30:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 --2- 172.21.15.96:0/2423026227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9840f9820 0x7fd9840fbc70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 --2- 172.21.15.96:0/2423026227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd984060310 0x7fd9840f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 -- 172.21.15.96:0/2423026227 >> 172.21.15.96:0/2423026227 conn(0x7fd9840f0d40 msgr2=0x7fd9840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 -- 172.21.15.96:0/2423026227 shutdown_connections 2022-02-02T18:30:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.871+0000 7fd98b89c700 1 -- 172.21.15.96:0/2423026227 wait complete. 2022-02-02T18:30:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 Processor -- start 2022-02-02T18:30:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 -- start start 2022-02-02T18:30:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 0x7fd9840f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 0x7fd9840f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840f5700 con 0x7fd984060310 2022-02-02T18:30:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd98b89c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840f5840 con 0x7fd9840f9820 2022-02-02T18:30:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd988e37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 0x7fd9840f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd988e37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 0x7fd9840f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:58472/0 (socket says 172.21.15.96:58472) 2022-02-02T18:30:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd988e37700 1 -- 172.21.15.96:0/1444257384 learned_addr learned my addr 172.21.15.96:0/1444257384 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.872+0000 7fd989638700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 0x7fd9840f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd989638700 1 -- 172.21.15.96:0/1444257384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 msgr2=0x7fd9840f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd989638700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 0x7fd9840f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd989638700 1 -- 172.21.15.96:0/1444257384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd978005040 con 0x7fd984060310 2022-02-02T18:30:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd989638700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 0x7fd9840f6d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd97400d750 tx=0x7fd974004de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97400f490 con 0x7fd984060310 2022-02-02T18:30:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9840f5b20 con 0x7fd984060310 2022-02-02T18:30:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd97400f040 con 0x7fd984060310 2022-02-02T18:30:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd974014a20 con 0x7fd984060310 2022-02-02T18:30:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.873+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98410ef70 con 0x7fd984060310 2022-02-02T18:30:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.874+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd984045ad0 con 0x7fd984060310 2022-02-02T18:30:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.875+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd97400f5f0 con 0x7fd984060310 2022-02-02T18:30:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.875+0000 7fd981ffb700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 0x7fd96c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.875+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9740821d0 con 0x7fd984060310 2022-02-02T18:30:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.875+0000 7fd988e37700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 0x7fd96c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.876+0000 7fd988e37700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 0x7fd96c067290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd978005010 tx=0x7fd978009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:32.880+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd974050330 con 0x7fd984060310 2022-02-02T18:30:33.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.057+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd984057f10 con 0x7fd96c064dd0 2022-02-02T18:30:33.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.058+0000 7fd981ffb700 1 -- 172.21.15.96:0/1444257384 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd984057f10 con 0x7fd96c064dd0 2022-02-02T18:30:33.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 msgr2=0x7fd96c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 0x7fd96c067290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd978005010 tx=0x7fd978009b30).stop 2022-02-02T18:30:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 msgr2=0x7fd9840f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 0x7fd9840f6d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd97400d750 tx=0x7fd974004de0).stop 2022-02-02T18:30:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 shutdown_connections 2022-02-02T18:30:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd96c064dd0 0x7fd96c067290 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd984060310 0x7fd9840f6d20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 --2- 172.21.15.96:0/1444257384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9840f9820 0x7fd9840f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 >> 172.21.15.96:0/1444257384 conn(0x7fd9840f0d40 msgr2=0x7fd9840f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 shutdown_connections 2022-02-02T18:30:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.060+0000 7fd98b89c700 1 -- 172.21.15.96:0/1444257384 wait complete. 2022-02-02T18:30:33.071 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:30:33.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 -- 172.21.15.96:0/1230402542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 msgr2=0x7efc140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/1230402542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc140f7c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7efc10004660 tx=0x7efc10009b30).stop 2022-02-02T18:30:33.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 -- 172.21.15.96:0/1230402542 shutdown_connections 2022-02-02T18:30:33.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/1230402542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc140f7c30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/1230402542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 0x7efc140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 -- 172.21.15.96:0/1230402542 >> 172.21.15.96:0/1230402542 conn(0x7efc140f1c90 msgr2=0x7efc140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 -- 172.21.15.96:0/1230402542 shutdown_connections 2022-02-02T18:30:33.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.159+0000 7efc1a3a0700 1 -- 172.21.15.96:0/1230402542 wait complete. 2022-02-02T18:30:33.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 Processor -- start 2022-02-02T18:30:33.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 -- start start 2022-02-02T18:30:33.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 0x7efc1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1406a380 con 0x7efc140f77d0 2022-02-02T18:30:33.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc1a3a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1406a4c0 con 0x7efc140f6530 2022-02-02T18:30:33.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.160+0000 7efc18b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54378/0 (socket says 172.21.15.96:54378) 2022-02-02T18:30:33.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 -- 172.21.15.96:0/4006859521 learned_addr learned my addr 172.21.15.96:0/4006859521 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:33.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc1939e700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 0x7efc1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 -- 172.21.15.96:0/4006859521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 msgr2=0x7efc1406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 0x7efc1406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 -- 172.21.15.96:0/4006859521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10005040 con 0x7efc140f77d0 2022-02-02T18:30:33.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc18b9d700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7efc10002040 tx=0x7efc1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc10019070 con 0x7efc140f77d0 2022-02-02T18:30:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1406a740 con 0x7efc140f77d0 2022-02-02T18:30:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc10007e70 con 0x7efc140f77d0 2022-02-02T18:30:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc10014e30 con 0x7efc140f77d0 2022-02-02T18:30:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.161+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1406aca0 con 0x7efc140f77d0 2022-02-02T18:30:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.163+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efc10025070 con 0x7efc140f77d0 2022-02-02T18:30:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.163+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14045ad0 con 0x7efc140f77d0 2022-02-02T18:30:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.163+0000 7efc09ffb700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 0x7efc00067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.163+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efc10082b60 con 0x7efc140f77d0 2022-02-02T18:30:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.163+0000 7efc1939e700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 0x7efc00067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.164+0000 7efc1939e700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 0x7efc00067280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efc1406b730 tx=0x7efc0400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.168+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efc10050b40 con 0x7efc140f77d0 2022-02-02T18:30:33.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.343+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc140fee00 con 0x7efc00064dc0 2022-02-02T18:30:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.352+0000 7efc09ffb700 1 -- 172.21.15.96:0/4006859521 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efc140fee00 con 0x7efc00064dc0 2022-02-02T18:30:33.353 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:30:33.353 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (13m) 4m ago 15m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:30:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (6m) 4m ago 14m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:30:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (6m) 3m ago 14m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:30:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (13m) 4m ago 14m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:30:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (11m) 4m ago 11m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:30:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (6m) 4m ago 11m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:30:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (11m) 3m ago 11m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:30:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (6m) 3m ago 11m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:30:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (8m) 4m ago 16m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:30:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (7m) 3m ago 14m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:30:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (7m) 4m ago 16m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:30:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (6m) 3m ago 14m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:30:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (14m) 4m ago 14m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:30:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (14m) 3m ago 14m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:30:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 4m ago 13m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:30:33.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 4m ago 13m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:30:33.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 4m ago 13m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:30:33.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4m) 3m ago 12m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:30:33.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3m) 3m ago 12m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:30:33.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3m) 3m ago 12m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:30:33.358 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (13m) 4m ago 14m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:30:33.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 msgr2=0x7efc00067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 0x7efc00067280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efc1406b730 tx=0x7efc0400b040).stop 2022-02-02T18:30:33.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 msgr2=0x7efc14069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7efc10002040 tx=0x7efc1000b040).stop 2022-02-02T18:30:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 shutdown_connections 2022-02-02T18:30:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc00064dc0 0x7efc00067280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc140f6530 0x7efc1406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 --2- 172.21.15.96:0/4006859521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc140f77d0 0x7efc14069e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 >> 172.21.15.96:0/4006859521 conn(0x7efc140f1c90 msgr2=0x7efc140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 shutdown_connections 2022-02-02T18:30:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.354+0000 7efc1a3a0700 1 -- 172.21.15.96:0/4006859521 wait complete. 2022-02-02T18:30:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 -- 172.21.15.96:0/1574295260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 msgr2=0x7f216c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 --2- 172.21.15.96:0/1574295260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c0f7c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f2158004660 tx=0x7f2158009b30).stop 2022-02-02T18:30:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 -- 172.21.15.96:0/1574295260 shutdown_connections 2022-02-02T18:30:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 --2- 172.21.15.96:0/1574295260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c0f7c30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 --2- 172.21.15.96:0/1574295260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 0x7f216c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:30:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 -- 172.21.15.96:0/1574295260 >> 172.21.15.96:0/1574295260 conn(0x7f216c0f1c90 msgr2=0x7f216c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 -- 172.21.15.96:0/1574295260 shutdown_connections 2022-02-02T18:30:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.451+0000 7f21718fc700 1 -- 172.21.15.96:0/1574295260 wait complete. 2022-02-02T18:30:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 Processor -- start 2022-02-02T18:30:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 -- start start 2022-02-02T18:30:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 0x7f216c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c107980 con 0x7f216c0f77d0 2022-02-02T18:30:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21718fc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c108100 con 0x7f216c0f6530 2022-02-02T18:30:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f216bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f216bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54388/0 (socket says 172.21.15.96:54388) 2022-02-02T18:30:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f216bfff700 1 -- 172.21.15.96:0/3401483314 learned_addr learned my addr 172.21.15.96:0/3401483314 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.452+0000 7f21708fa700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 0x7f216c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f216bfff700 1 -- 172.21.15.96:0/3401483314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 msgr2=0x7f216c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f216bfff700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 0x7f216c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f216bfff700 1 -- 172.21.15.96:0/3401483314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158005040 con 0x7f216c0f77d0 2022-02-02T18:30:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f216bfff700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2158009990 tx=0x7f2158009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2158018070 con 0x7f216c0f77d0 2022-02-02T18:30:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c108320 con 0x7f216c0f77d0 2022-02-02T18:30:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2158007ba0 con 0x7f216c0f77d0 2022-02-02T18:30:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f215801c620 con 0x7f216c0f77d0 2022-02-02T18:30:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.453+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c108880 con 0x7f216c0f77d0 2022-02-02T18:30:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.454+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c045ad0 con 0x7f216c0f77d0 2022-02-02T18:30:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.455+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f215801c8e0 con 0x7f216c0f77d0 2022-02-02T18:30:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.455+0000 7f21697fa700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 0x7f215c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.455+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2158083910 con 0x7f216c0f77d0 2022-02-02T18:30:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.455+0000 7f21708fa700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 0x7f215c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.455+0000 7f21708fa700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 0x7f215c0672e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f216c106b70 tx=0x7f2160008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.459+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2158051950 con 0x7f216c0f77d0 2022-02-02T18:30:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.687+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f216c027a00 con 0x7f216c0f77d0 2022-02-02T18:30:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.687+0000 7f21697fa700 1 -- 172.21.15.96:0/3401483314 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2158054f70 con 0x7f216c0f77d0 2022-02-02T18:30:33.689 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:30:33.689 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:30:33.689 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:30:33.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:33.690 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:30:33.690 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:30:33.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:33.691 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:30:33.691 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:30:33.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:33.691 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:30:33.691 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:30:33.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:30:33.692 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:30:33.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:30:33.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:30:33.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:30:33.693 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:30:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.689+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 msgr2=0x7f215c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.689+0000 7f21718fc700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 0x7f215c0672e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f216c106b70 tx=0x7f2160008040).stop 2022-02-02T18:30:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.689+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 msgr2=0x7f216c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.689+0000 7f21718fc700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2158009990 tx=0x7f2158009b30).stop 2022-02-02T18:30:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 shutdown_connections 2022-02-02T18:30:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f215c064e20 0x7f215c0672e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f216c0f6530 0x7f216c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 --2- 172.21.15.96:0/3401483314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f216c0f77d0 0x7f216c1072f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 >> 172.21.15.96:0/3401483314 conn(0x7f216c0f1c90 msgr2=0x7f216c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 shutdown_connections 2022-02-02T18:30:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.690+0000 7f21718fc700 1 -- 172.21.15.96:0/3401483314 wait complete. 2022-02-02T18:30:33.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 -- 172.21.15.96:0/2769418377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 msgr2=0x7fd56c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 --2- 172.21.15.96:0/2769418377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c0f6b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fd560004660 tx=0x7fd560009b30).stop 2022-02-02T18:30:33.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 -- 172.21.15.96:0/2769418377 shutdown_connections 2022-02-02T18:30:33.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 --2- 172.21.15.96:0/2769418377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 0x7fd56c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 --2- 172.21.15.96:0/2769418377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c0f6b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 -- 172.21.15.96:0/2769418377 >> 172.21.15.96:0/2769418377 conn(0x7fd56c0f1e40 msgr2=0x7fd56c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:33.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 -- 172.21.15.96:0/2769418377 shutdown_connections 2022-02-02T18:30:33.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 -- 172.21.15.96:0/2769418377 wait complete. 2022-02-02T18:30:33.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.787+0000 7fd5745b4700 1 Processor -- start 2022-02-02T18:30:33.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 -- start start 2022-02-02T18:30:33.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 0x7fd56c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c06a380 con 0x7fd56c0f66e0 2022-02-02T18:30:33.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c06a4c0 con 0x7fd56c0f7980 2022-02-02T18:30:33.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54394/0 (socket says 172.21.15.96:54394) 2022-02-02T18:30:33.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 -- 172.21.15.96:0/761243550 learned_addr learned my addr 172.21.15.96:0/761243550 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:30:33.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd571b4f700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 0x7fd56c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 -- 172.21.15.96:0/761243550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 msgr2=0x7fd56c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:33.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 0x7fd56c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:33.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 -- 172.21.15.96:0/761243550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560005040 con 0x7fd56c0f66e0 2022-02-02T18:30:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd572350700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd560004f60 tx=0x7fd560009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd560018070 con 0x7fd56c0f66e0 2022-02-02T18:30:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.788+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c06a740 con 0x7fd56c0f66e0 2022-02-02T18:30:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.789+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c06aca0 con 0x7fd56c0f66e0 2022-02-02T18:30:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.789+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd560007ba0 con 0x7fd56c0f66e0 2022-02-02T18:30:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.789+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56001c620 con 0x7fd56c0f66e0 2022-02-02T18:30:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.789+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554004fa0 con 0x7fd56c0f66e0 2022-02-02T18:30:33.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.790+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd56001d420 con 0x7fd56c0f66e0 2022-02-02T18:30:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.790+0000 7fd55effd700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 0x7fd558067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:30:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.790+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd560083860 con 0x7fd56c0f66e0 2022-02-02T18:30:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.790+0000 7fd571b4f700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 0x7fd558067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:30:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.791+0000 7fd571b4f700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 0x7fd558067290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd5680041d0 tx=0x7fd568009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:30:33.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.795+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd560051a20 con 0x7fd56c0f66e0 2022-02-02T18:30:33.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.994+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd554005e80 con 0x7fd56c0f66e0 2022-02-02T18:30:33.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.994+0000 7fd55effd700 1 -- 172.21.15.96:0/761243550 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd560055040 con 0x7fd56c0f66e0 2022-02-02T18:30:33.996 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:30:33.996 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:30:33.996 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:30:33.996 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:30:33.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:33.997 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:30:33.997 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:30:33.997 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:30:33.998 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:30:33.998 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:30:33.998 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:30:33.998 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:30:33.999 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:30:33.999 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:30:33.999 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:30:33.999 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:30:33.999 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:30:34.000 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:30:34.000 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:30:34.000 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:30:34.000 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:30:34.001 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:30:34.001 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:30:34.001 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:30:34.001 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:30:34.002 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:30:34.002 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:30:34.002 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:30:34.002 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:30:34.003 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:30:34.003 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:30:34.003 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:30:34.003 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:34.003 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:30:34.004 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:30:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:30:34.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 msgr2=0x7fd558067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:34.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 0x7fd558067290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd5680041d0 tx=0x7fd568009040).stop 2022-02-02T18:30:34.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 msgr2=0x7fd56c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:30:34.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd560004f60 tx=0x7fd560009b30).stop 2022-02-02T18:30:34.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 shutdown_connections 2022-02-02T18:30:34.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd558064dd0 0x7fd558067290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:34.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd56c0f66e0 0x7fd56c06b9a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:34.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 --2- 172.21.15.96:0/761243550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd56c0f7980 0x7fd56c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:30:34.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 >> 172.21.15.96:0/761243550 conn(0x7fd56c0f1e40 msgr2=0x7fd56c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:30:34.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 shutdown_connections 2022-02-02T18:30:34.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:30:33.996+0000 7fd5745b4700 1 -- 172.21.15.96:0/761243550 wait complete. 2022-02-02T18:30:34.009 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:30:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:34 smithi159 ceph-mon[69013]: pgmap v251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:34 smithi159 ceph-mon[69013]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:34 smithi159 ceph-mon[69013]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3401483314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/761243550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:30:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:34 smithi096 ceph-mon[101353]: pgmap v251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:34 smithi096 ceph-mon[101353]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:34 smithi096 ceph-mon[101353]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:30:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3401483314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/761243550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:30:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:36 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:36.619 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:36 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:36.620 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:36 smithi159 ceph-mon[69013]: pgmap v252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:36.621 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:36 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:36.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:36 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:36.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:36 smithi096 ceph-mon[101353]: pgmap v252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:38 smithi159 ceph-mon[69013]: pgmap v253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:38 smithi096 ceph-mon[101353]: pgmap v253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:40 smithi096 ceph-mon[101353]: pgmap v254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:40 smithi159 ceph-mon[69013]: pgmap v254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:42 smithi096 ceph-mon[101353]: pgmap v255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:42 smithi159 ceph-mon[69013]: pgmap v255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:44 smithi096 ceph-mon[101353]: pgmap v256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:44 smithi159 ceph-mon[69013]: pgmap v256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:46 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:46 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:46 smithi096 ceph-mon[101353]: pgmap v257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:46 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:46 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:46 smithi159 ceph-mon[69013]: pgmap v257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:48 smithi096 ceph-mon[101353]: pgmap v258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:48 smithi159 ceph-mon[69013]: pgmap v258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:50 smithi096 ceph-mon[101353]: pgmap v259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:50 smithi159 ceph-mon[69013]: pgmap v259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:52 smithi096 ceph-mon[101353]: pgmap v260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:52 smithi159 ceph-mon[69013]: pgmap v260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:54 smithi096 ceph-mon[101353]: pgmap v261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:54 smithi159 ceph-mon[69013]: pgmap v261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:30:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:30:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:30:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:30:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:30:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:56 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:56 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:56 smithi096 ceph-mon[101353]: pgmap v262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:56 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:30:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:56 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:30:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:56 smithi159 ceph-mon[69013]: pgmap v262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:30:58 smithi159 ceph-mon[69013]: pgmap v263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:30:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:30:58 smithi096 ceph-mon[101353]: pgmap v263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:00 smithi159 ceph-mon[69013]: pgmap v264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:00 smithi096 ceph-mon[101353]: pgmap v264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:02 smithi159 ceph-mon[69013]: pgmap v265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:02 smithi096 ceph-mon[101353]: pgmap v265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 -- 172.21.15.96:0/1733745976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 msgr2=0x7f47840f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 --2- 172.21.15.96:0/1733745976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f47840f5a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4774004660 tx=0x7f4774009b30).stop 2022-02-02T18:31:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 -- 172.21.15.96:0/1733745976 shutdown_connections 2022-02-02T18:31:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 --2- 172.21.15.96:0/1733745976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f47840f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:31:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 --2- 172.21.15.96:0/1733745976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f47840f5a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 -- 172.21.15.96:0/1733745976 >> 172.21.15.96:0/1733745976 conn(0x7f47840f0de0 msgr2=0x7f47840f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 -- 172.21.15.96:0/1733745976 shutdown_connections 2022-02-02T18:31:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.108+0000 7f478c226700 1 -- 172.21.15.96:0/1733745976 wait complete. 2022-02-02T18:31:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 Processor -- start 2022-02-02T18:31:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 -- start start 2022-02-02T18:31:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f4784106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841069a0 con 0x7f47840f55e0 2022-02-02T18:31:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f478c226700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784107250 con 0x7f47840f5ef0 2022-02-02T18:31:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f4789fc2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f4789fc2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54414/0 (socket says 172.21.15.96:54414) 2022-02-02T18:31:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.109+0000 7f4789fc2700 1 -- 172.21.15.96:0/94955346 learned_addr learned my addr 172.21.15.96:0/94955346 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f47897c1700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f4784106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f4789fc2700 1 -- 172.21.15.96:0/94955346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 msgr2=0x7f4784106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f4789fc2700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f4784106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f4789fc2700 1 -- 172.21.15.96:0/94955346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774005040 con 0x7f47840f55e0 2022-02-02T18:31:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f47897c1700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f4784106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:31:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f4789fc2700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f4774009990 tx=0x7f4774009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4774018070 con 0x7f47840f55e0 2022-02-02T18:31:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4774007ca0 con 0x7f47840f55e0 2022-02-02T18:31:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47841074d0 con 0x7f47840f55e0 2022-02-02T18:31:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f477401c620 con 0x7f47840f55e0 2022-02-02T18:31:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.110+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784107a30 con 0x7f47840f55e0 2022-02-02T18:31:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.111+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47840f4a70 con 0x7f47840f55e0 2022-02-02T18:31:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.112+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f477401d960 con 0x7f47840f55e0 2022-02-02T18:31:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.112+0000 7f477a7fc700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 0x7f4770067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.112+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4774083700 con 0x7f47840f55e0 2022-02-02T18:31:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.112+0000 7f47897c1700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 0x7f4770067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.112+0000 7f47897c1700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 0x7f4770067290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f478000a7e0 tx=0x7f4780008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.116+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4774055230 con 0x7f47840f55e0 2022-02-02T18:31:04.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.293+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47840008d0 con 0x7f4770064dd0 2022-02-02T18:31:04.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.295+0000 7f477a7fc700 1 -- 172.21.15.96:0/94955346 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f47840008d0 con 0x7f4770064dd0 2022-02-02T18:31:04.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 msgr2=0x7f4770067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 0x7f4770067290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f478000a7e0 tx=0x7f4780008040).stop 2022-02-02T18:31:04.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 msgr2=0x7f4784105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f4774009990 tx=0x7f4774009b30).stop 2022-02-02T18:31:04.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 shutdown_connections 2022-02-02T18:31:04.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4770064dd0 0x7f4770067290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47840f55e0 0x7f4784105e70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 --2- 172.21.15.96:0/94955346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47840f5ef0 0x7f4784106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.296+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 >> 172.21.15.96:0/94955346 conn(0x7f47840f0de0 msgr2=0x7f47840fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.297+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 shutdown_connections 2022-02-02T18:31:04.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.297+0000 7f478c226700 1 -- 172.21.15.96:0/94955346 wait complete. 2022-02-02T18:31:04.307 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:31:04.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2190156224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f55c0 msgr2=0x7fbf440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2190156224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f55c0 0x7fbf440f59e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fbf34004660 tx=0x7fbf34009b30).stop 2022-02-02T18:31:04.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2190156224 shutdown_connections 2022-02-02T18:31:04.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2190156224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f6860 0x7fbf440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2190156224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f55c0 0x7fbf440f59e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2190156224 >> 172.21.15.96:0/2190156224 conn(0x7fbf440f0d40 msgr2=0x7fbf440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.397 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:04 smithi096 ceph-mon[101353]: pgmap v266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:04.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.396+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2190156224 shutdown_connections 2022-02-02T18:31:04.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2190156224 wait complete. 2022-02-02T18:31:04.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 Processor -- start 2022-02-02T18:31:04.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 -- start start 2022-02-02T18:31:04.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f55c0 0x7fbf44106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44107a60 con 0x7fbf440f6860 2022-02-02T18:31:04.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf4bfd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44107ba0 con 0x7fbf440f55c0 2022-02-02T18:31:04.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf49572700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf49572700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54426/0 (socket says 172.21.15.96:54426) 2022-02-02T18:31:04.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.397+0000 7fbf49572700 1 -- 172.21.15.96:0/2203664823 learned_addr learned my addr 172.21.15.96:0/2203664823 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:04.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf49d73700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f55c0 0x7fbf44106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf49572700 1 -- 172.21.15.96:0/2203664823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f55c0 msgr2=0x7fbf44106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf49572700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f55c0 0x7fbf44106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf49572700 1 -- 172.21.15.96:0/2203664823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34005040 con 0x7fbf440f6860 2022-02-02T18:31:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf49572700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbf4000c510 tx=0x7fbf40007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4000f650 con 0x7fbf440f6860 2022-02-02T18:31:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf4000fc60 con 0x7fbf440f6860 2022-02-02T18:31:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf40012d00 con 0x7fbf440f6860 2022-02-02T18:31:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44108540 con 0x7fbf440f6860 2022-02-02T18:31:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.398+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf44108b00 con 0x7fbf440f6860 2022-02-02T18:31:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.399+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf44045ad0 con 0x7fbf440f6860 2022-02-02T18:31:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.399+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbf40010070 con 0x7fbf440f6860 2022-02-02T18:31:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.400+0000 7fbf3a7fc700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 0x7fbf30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.400+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbf40081750 con 0x7fbf440f6860 2022-02-02T18:31:04.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.400+0000 7fbf49d73700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 0x7fbf30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.400+0000 7fbf49d73700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 0x7fbf30067290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbf34004e30 tx=0x7fbf34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.404+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbf400477d0 con 0x7fbf440f6860 2022-02-02T18:31:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.575+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf440faca0 con 0x7fbf30064dd0 2022-02-02T18:31:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.584+0000 7fbf3a7fc700 1 -- 172.21.15.96:0/2203664823 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbf440faca0 con 0x7fbf30064dd0 2022-02-02T18:31:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:31:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (14m) 5m ago 15m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:31:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (6m) 5m ago 15m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:31:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (6m) 3m ago 15m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:31:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (14m) 5m ago 15m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:31:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (11m) 5m ago 11m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:31:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (7m) 5m ago 11m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:31:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (11m) 3m ago 11m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:31:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (7m) 3m ago 11m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:31:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (8m) 5m ago 16m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:31:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (8m) 3m ago 14m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:31:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (7m) 5m ago 16m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:31:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (7m) 3m ago 14m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:31:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (15m) 5m ago 15m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:31:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (14m) 3m ago 14m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:31:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 5m ago 14m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:31:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 5m ago 14m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:31:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 5m ago 13m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:31:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4m) 3m ago 13m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:31:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4m) 3m ago 13m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:31:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3m) 3m ago 12m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:31:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (14m) 5m ago 15m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:31:04.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 msgr2=0x7fbf30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 0x7fbf30067290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbf34004e30 tx=0x7fbf34009b30).stop 2022-02-02T18:31:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 msgr2=0x7fbf441074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbf4000c510 tx=0x7fbf40007e00).stop 2022-02-02T18:31:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 shutdown_connections 2022-02-02T18:31:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf30064dd0 0x7fbf30067290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf440f55c0 0x7fbf44106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 --2- 172.21.15.96:0/2203664823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf440f6860 0x7fbf441074b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 >> 172.21.15.96:0/2203664823 conn(0x7fbf440f0d40 msgr2=0x7fbf4405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 shutdown_connections 2022-02-02T18:31:04.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.586+0000 7fbf4bfd7700 1 -- 172.21.15.96:0/2203664823 wait complete. 2022-02-02T18:31:04.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.682+0000 7f54c8c74700 1 -- 172.21.15.96:0/1530234232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f6550 msgr2=0x7f54c40f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 --2- 172.21.15.96:0/1530234232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f6550 0x7f54c40f69b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f54b8004660 tx=0x7f54b8009b30).stop 2022-02-02T18:31:04.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 -- 172.21.15.96:0/1530234232 shutdown_connections 2022-02-02T18:31:04.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 --2- 172.21.15.96:0/1530234232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f6550 0x7f54c40f69b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 --2- 172.21.15.96:0/1530234232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f5bb0 0x7f54c40f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:31:04.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 -- 172.21.15.96:0/1530234232 >> 172.21.15.96:0/1530234232 conn(0x7f54c40f04c0 msgr2=0x7f54c40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 -- 172.21.15.96:0/1530234232 shutdown_connections 2022-02-02T18:31:04.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 -- 172.21.15.96:0/1530234232 wait complete. 2022-02-02T18:31:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 Processor -- start 2022-02-02T18:31:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.683+0000 7f54c8c74700 1 -- start start 2022-02-02T18:31:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c8c74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c8c74700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f6550 0x7f54c4107510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c8c74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4107b50 con 0x7f54c40f5bb0 2022-02-02T18:31:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c8c74700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4108400 con 0x7f54c40f6550 2022-02-02T18:31:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54434/0 (socket says 172.21.15.96:54434) 2022-02-02T18:31:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 -- 172.21.15.96:0/3468168855 learned_addr learned my addr 172.21.15.96:0/3468168855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c1d9b700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f6550 0x7f54c4107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 -- 172.21.15.96:0/3468168855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f6550 msgr2=0x7f54c4107510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f6550 0x7f54c4107510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 -- 172.21.15.96:0/3468168855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8005040 con 0x7f54c40f5bb0 2022-02-02T18:31:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.684+0000 7f54c259c700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f54b40093f0 tx=0x7f54b4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.685+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b4013640 con 0x7f54c40f5bb0 2022-02-02T18:31:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.685+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c4108680 con 0x7f54c40f5bb0 2022-02-02T18:31:04.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.685+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54b4013c50 con 0x7f54c40f5bb0 2022-02-02T18:31:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.685+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b4012c70 con 0x7f54c40f5bb0 2022-02-02T18:31:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.685+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c4108be0 con 0x7f54c40f5bb0 2022-02-02T18:31:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.686+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4045ad0 con 0x7f54c40f5bb0 2022-02-02T18:31:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.686+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f54b401a060 con 0x7f54c40f5bb0 2022-02-02T18:31:04.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.687+0000 7f54b2ffd700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 0x7f54ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.687+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f54b4081a50 con 0x7f54c40f5bb0 2022-02-02T18:31:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.687+0000 7f54c1d9b700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 0x7f54ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:04.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.687+0000 7f54c1d9b700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 0x7f54ac067290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f54b8004580 tx=0x7f54b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:04.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.691+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f54b4053580 con 0x7f54c40f5bb0 2022-02-02T18:31:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:04 smithi159 ceph-mon[69013]: pgmap v266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.926+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54c4027a00 con 0x7f54c40f5bb0 2022-02-02T18:31:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.926+0000 7f54b2ffd700 1 -- 172.21.15.96:0/3468168855 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f54b40182e0 con 0x7f54c40f5bb0 2022-02-02T18:31:04.926 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:31:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:31:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:31:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:31:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:31:04.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:04.928 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:31:04.928 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:31:04.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:04.928 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:31:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:31:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:31:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:31:04.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:31:04.930 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:31:04.930 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:31:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 msgr2=0x7f54ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 0x7f54ac067290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f54b8004580 tx=0x7f54b8009b30).stop 2022-02-02T18:31:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 msgr2=0x7f54c4107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f54b40093f0 tx=0x7f54b4006ec0).stop 2022-02-02T18:31:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 shutdown_connections 2022-02-02T18:31:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54ac064dd0 0x7f54ac067290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54c40f5bb0 0x7f54c4107020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 --2- 172.21.15.96:0/3468168855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40f6550 0x7f54c4107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 >> 172.21.15.96:0/3468168855 conn(0x7f54c40f04c0 msgr2=0x7f54c40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.928+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 shutdown_connections 2022-02-02T18:31:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:04.929+0000 7f54c8c74700 1 -- 172.21.15.96:0/3468168855 wait complete. 2022-02-02T18:31:05.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.025+0000 7f8cbd20b700 1 -- 172.21.15.96:0/998549926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f55c0 msgr2=0x7f8cb80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:05.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/998549926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f59e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f8cac004660 tx=0x7f8cac009b30).stop 2022-02-02T18:31:05.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 -- 172.21.15.96:0/998549926 shutdown_connections 2022-02-02T18:31:05.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/998549926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/998549926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f59e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 -- 172.21.15.96:0/998549926 >> 172.21.15.96:0/998549926 conn(0x7f8cb80f0d40 msgr2=0x7f8cb80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 -- 172.21.15.96:0/998549926 shutdown_connections 2022-02-02T18:31:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 -- 172.21.15.96:0/998549926 wait complete. 2022-02-02T18:31:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.026+0000 7f8cbd20b700 1 Processor -- start 2022-02-02T18:31:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cbd20b700 1 -- start start 2022-02-02T18:31:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cbd20b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cbd20b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cbd20b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80f8920 con 0x7f8cb80f6860 2022-02-02T18:31:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cbd20b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80f8a60 con 0x7f8cb80f55c0 2022-02-02T18:31:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54446/0 (socket says 172.21.15.96:54446) 2022-02-02T18:31:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 -- 172.21.15.96:0/2783655541 learned_addr learned my addr 172.21.15.96:0/2783655541 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb6d9d700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 -- 172.21.15.96:0/2783655541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f55c0 msgr2=0x7f8cb80f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 -- 172.21.15.96:0/2783655541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac005040 con 0x7f8cb80f6860 2022-02-02T18:31:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.027+0000 7f8cb659c700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8ca800c790 tx=0x7f8ca8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.028+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca800e680 con 0x7f8cb80f6860 2022-02-02T18:31:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.028+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80f8d40 con 0x7f8cb80f6860 2022-02-02T18:31:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.028+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ca800ec90 con 0x7f8cb80f6860 2022-02-02T18:31:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.028+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca8013d60 con 0x7f8cb80f6860 2022-02-02T18:31:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.028+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb810efa0 con 0x7f8cb80f6860 2022-02-02T18:31:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.029+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8045ad0 con 0x7f8cb80f6860 2022-02-02T18:31:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.029+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ca801a060 con 0x7f8cb80f6860 2022-02-02T18:31:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.030+0000 7f8c9f7fe700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 0x7f8ca0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.030+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8ca8081be0 con 0x7f8cb80f6860 2022-02-02T18:31:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.030+0000 7f8cb6d9d700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 0x7f8ca0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.030+0000 7f8cb6d9d700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 0x7f8ca0067290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8cac004e30 tx=0x7f8cac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:05.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.034+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ca804fc80 con 0x7f8cb80f6860 2022-02-02T18:31:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.235+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8cb80fdd80 con 0x7f8cb80f6860 2022-02-02T18:31:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.235+0000 7f8c9f7fe700 1 -- 172.21.15.96:0/2783655541 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8ca8018070 con 0x7f8cb80f6860 2022-02-02T18:31:05.236 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:31:05.236 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:31:05.236 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:31:05.237 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:31:05.237 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:05.237 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:31:05.237 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:31:05.237 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:31:05.238 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:31:05.238 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:31:05.238 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:31:05.238 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:31:05.239 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:31:05.239 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:31:05.239 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:31:05.239 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:31:05.239 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:31:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:31:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:31:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:31:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:31:05.241 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:31:05.241 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:31:05.241 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:31:05.241 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:31:05.241 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:31:05.242 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:31:05.242 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:31:05.242 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:31:05.242 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:31:05.243 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:31:05.243 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:31:05.243 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:05.243 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:05.243 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:31:05.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:05.244 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:05.244 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:05.244 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.238+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 msgr2=0x7f8ca0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.238+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 0x7f8ca0067290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8cac004e30 tx=0x7f8cac009b30).stop 2022-02-02T18:31:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.238+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 msgr2=0x7f8cb80f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.238+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8ca800c790 tx=0x7f8ca8007d70).stop 2022-02-02T18:31:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 shutdown_connections 2022-02-02T18:31:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ca0064dd0 0x7f8ca0067290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cb80f55c0 0x7f8cb80f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 --2- 172.21.15.96:0/2783655541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cb80f6860 0x7f8cb80f83c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 >> 172.21.15.96:0/2783655541 conn(0x7f8cb80f0d40 msgr2=0x7f8cb805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 shutdown_connections 2022-02-02T18:31:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:05.239+0000 7f8cbd20b700 1 -- 172.21.15.96:0/2783655541 wait complete. 2022-02-02T18:31:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:31:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:05.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:05.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3468168855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2783655541' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:31:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3468168855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:05.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2783655541' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:31:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:06 smithi159 ceph-mon[69013]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:06 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:06 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:06 smithi159 ceph-mon[69013]: pgmap v267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:06 smithi096 ceph-mon[101353]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:06 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:06 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:06 smithi096 ceph-mon[101353]: pgmap v267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:08 smithi159 ceph-mon[69013]: pgmap v268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:08 smithi096 ceph-mon[101353]: pgmap v268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:10 smithi159 ceph-mon[69013]: pgmap v269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:10 smithi096 ceph-mon[101353]: pgmap v269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:12 smithi159 ceph-mon[69013]: pgmap v270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:12 smithi096 ceph-mon[101353]: pgmap v270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:14 smithi159 ceph-mon[69013]: pgmap v271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:14 smithi096 ceph-mon[101353]: pgmap v271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:15.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:15.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:15.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:15.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:15.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:15.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:16 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:16 smithi159 ceph-mon[69013]: pgmap v272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:16 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:16 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:16 smithi096 ceph-mon[101353]: pgmap v272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:16 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:18 smithi159 ceph-mon[69013]: pgmap v273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:18 smithi096 ceph-mon[101353]: pgmap v273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:20 smithi159 ceph-mon[69013]: pgmap v274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:20 smithi096 ceph-mon[101353]: pgmap v274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:22 smithi159 ceph-mon[69013]: pgmap v275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:22 smithi096 ceph-mon[101353]: pgmap v275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:24 smithi159 ceph-mon[69013]: pgmap v276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:24 smithi096 ceph-mon[101353]: pgmap v276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:25.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:25.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:26 smithi159 ceph-mon[69013]: pgmap v277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:26 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:26 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:26 smithi096 ceph-mon[101353]: pgmap v277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:26 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:26 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:31:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:31:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:31:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:31:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:28 smithi159 ceph-mon[69013]: pgmap v278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:28 smithi096 ceph-mon[101353]: pgmap v278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:30 smithi159 ceph-mon[69013]: pgmap v279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:30 smithi096 ceph-mon[101353]: pgmap v279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:32 smithi159 ceph-mon[69013]: pgmap v280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:32 smithi096 ceph-mon[101353]: pgmap v280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:34 smithi159 ceph-mon[69013]: pgmap v281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:34.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:34 smithi096 ceph-mon[101353]: pgmap v281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 -- 172.21.15.96:0/1991370770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 msgr2=0x7fdd5c0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 --2- 172.21.15.96:0/1991370770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c0f6af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fdd50004660 tx=0x7fdd50009b30).stop 2022-02-02T18:31:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 -- 172.21.15.96:0/1991370770 shutdown_connections 2022-02-02T18:31:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 --2- 172.21.15.96:0/1991370770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 0x7fdd5c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 --2- 172.21.15.96:0/1991370770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c0f6af0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.352+0000 7fdd62c57700 1 -- 172.21.15.96:0/1991370770 >> 172.21.15.96:0/1991370770 conn(0x7fdd5c0f1e10 msgr2=0x7fdd5c0f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.353+0000 7fdd62c57700 1 -- 172.21.15.96:0/1991370770 shutdown_connections 2022-02-02T18:31:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.353+0000 7fdd62c57700 1 -- 172.21.15.96:0/1991370770 wait complete. 2022-02-02T18:31:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.353+0000 7fdd62c57700 1 Processor -- start 2022-02-02T18:31:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.353+0000 7fdd62c57700 1 -- start start 2022-02-02T18:31:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd62c57700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd62c57700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 0x7fdd5c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd62c57700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c06a380 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd62c57700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c06a4c0 con 0x7fdd5c0f7970 2022-02-02T18:31:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54462/0 (socket says 172.21.15.96:54462) 2022-02-02T18:31:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 -- 172.21.15.96:0/2021945145 learned_addr learned my addr 172.21.15.96:0/2021945145 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd5bfff700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 0x7fdd5c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 -- 172.21.15.96:0/2021945145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 msgr2=0x7fdd5c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 0x7fdd5c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 -- 172.21.15.96:0/2021945145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50005040 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.354+0000 7fdd609f3700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fdd50004f60 tx=0x7fdd50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.355+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd50018070 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.355+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c06a740 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.355+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd50009770 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.355+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5001c3c0 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.355+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c06aca0 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.356+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c045ad0 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.356+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdd5001d420 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.357+0000 7fdd597fa700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 0x7fdd4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.357+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdd50083880 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.357+0000 7fdd5bfff700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 0x7fdd4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.357+0000 7fdd5bfff700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 0x7fdd4c067290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdd48007fd0 tx=0x7fdd48009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.361+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdd50051a40 con 0x7fdd5c0f66d0 2022-02-02T18:31:35.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.540+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd5c0fefa0 con 0x7fdd4c064dd0 2022-02-02T18:31:35.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.541+0000 7fdd597fa700 1 -- 172.21.15.96:0/2021945145 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdd5c0fefa0 con 0x7fdd4c064dd0 2022-02-02T18:31:35.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.542+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 msgr2=0x7fdd4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.542+0000 7fdd62c57700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 0x7fdd4c067290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdd48007fd0 tx=0x7fdd48009040).stop 2022-02-02T18:31:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.542+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 msgr2=0x7fdd5c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fdd50004f60 tx=0x7fdd50009b30).stop 2022-02-02T18:31:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 shutdown_connections 2022-02-02T18:31:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd4c064dd0 0x7fdd4c067290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd5c0f66d0 0x7fdd5c06b9a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 --2- 172.21.15.96:0/2021945145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0f7970 0x7fdd5c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 >> 172.21.15.96:0/2021945145 conn(0x7fdd5c0f1e10 msgr2=0x7fdd5c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:35.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 shutdown_connections 2022-02-02T18:31:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.543+0000 7fdd62c57700 1 -- 172.21.15.96:0/2021945145 wait complete. 2022-02-02T18:31:35.552 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:31:35.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 -- 172.21.15.96:0/1852785226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 msgr2=0x7f2e6c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/1852785226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c0f6b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2e5c004660 tx=0x7f2e5c009b30).stop 2022-02-02T18:31:35.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 -- 172.21.15.96:0/1852785226 shutdown_connections 2022-02-02T18:31:35.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/1852785226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c0f6b30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/1852785226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:31:35.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 -- 172.21.15.96:0/1852785226 >> 172.21.15.96:0/1852785226 conn(0x7f2e6c0f0b90 msgr2=0x7f2e6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:35.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 -- 172.21.15.96:0/1852785226 shutdown_connections 2022-02-02T18:31:35.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 -- 172.21.15.96:0/1852785226 wait complete. 2022-02-02T18:31:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.641+0000 7f2e6b59e700 1 Processor -- start 2022-02-02T18:31:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6b59e700 1 -- start start 2022-02-02T18:31:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c060470 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0605b0 con 0x7f2e6c0f5430 2022-02-02T18:31:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54472/0 (socket says 172.21.15.96:54472) 2022-02-02T18:31:35.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 -- 172.21.15.96:0/2445375729 learned_addr learned my addr 172.21.15.96:0/2445375729 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:35.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 -- 172.21.15.96:0/2445375729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 msgr2=0x7f2e6c109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6a59c700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 -- 172.21.15.96:0/2445375729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c005040 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e6a59c700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:31:35.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e69d9b700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2e5c009990 tx=0x7f2e5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.642+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5c018070 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.643+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c10c590 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.643+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e5c007ca0 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.643+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5c01c620 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.643+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c10cac0 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.644+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e5c01d960 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.644+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c059100 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.644+0000 7f2e5affd700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 0x7f2e540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.644+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2e5c083250 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.644+0000 7f2e6a59c700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 0x7f2e540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.645+0000 7f2e6a59c700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 0x7f2e540672e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e6c060060 tx=0x7f2e60008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.649+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e5c051350 con 0x7f2e6c0f66d0 2022-02-02T18:31:35.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.822+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e6c0fde40 con 0x7f2e54064e20 2022-02-02T18:31:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.831+0000 7f2e5affd700 1 -- 172.21.15.96:0/2445375729 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2e6000a460 con 0x7f2e54064e20 2022-02-02T18:31:35.831 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:31:35.831 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (14m) 5m ago 16m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:31:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 5m ago 16m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:31:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (7m) 4m ago 15m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:31:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (14m) 5m ago 15m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:31:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (12m) 5m ago 12m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:31:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (7m) 5m ago 12m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:31:35.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (12m) 4m ago 12m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:31:35.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (7m) 4m ago 12m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:31:35.833 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (9m) 5m ago 17m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:31:35.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (8m) 4m ago 15m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:31:35.834 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 5m ago 17m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:31:35.834 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (7m) 4m ago 15m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:31:35.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (15m) 5m ago 15m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:31:35.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (15m) 4m ago 15m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:31:35.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (7m) 5m ago 14m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:31:35.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 5m ago 14m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:31:35.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 5m ago 14m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:31:35.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (5m) 4m ago 13m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:31:35.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4m) 4m ago 13m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:31:35.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4m) 4m ago 13m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:31:35.838 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (14m) 5m ago 15m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:31:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.833+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 msgr2=0x7f2e540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.833+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 0x7f2e540672e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e6c060060 tx=0x7f2e60008040).stop 2022-02-02T18:31:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.833+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 msgr2=0x7f2e6c10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.833+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2e5c009990 tx=0x7f2e5c009b30).stop 2022-02-02T18:31:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 shutdown_connections 2022-02-02T18:31:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e54064e20 0x7f2e540672e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6c0f5430 0x7f2e6c109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 --2- 172.21.15.96:0/2445375729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0f66d0 0x7f2e6c10bf90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 >> 172.21.15.96:0/2445375729 conn(0x7f2e6c0f0b90 msgr2=0x7f2e6c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 shutdown_connections 2022-02-02T18:31:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.834+0000 7f2e6b59e700 1 -- 172.21.15.96:0/2445375729 wait complete. 2022-02-02T18:31:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 -- 172.21.15.96:0/4013773811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 msgr2=0x7f20a40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 --2- 172.21.15.96:0/4013773811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f6b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2094004660 tx=0x7f2094009b30).stop 2022-02-02T18:31:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 -- 172.21.15.96:0/4013773811 shutdown_connections 2022-02-02T18:31:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 --2- 172.21.15.96:0/4013773811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f6b30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 --2- 172.21.15.96:0/4013773811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 0x7f20a40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 -- 172.21.15.96:0/4013773811 >> 172.21.15.96:0/4013773811 conn(0x7f20a40f0b90 msgr2=0x7f20a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 -- 172.21.15.96:0/4013773811 shutdown_connections 2022-02-02T18:31:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 -- 172.21.15.96:0/4013773811 wait complete. 2022-02-02T18:31:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.930+0000 7f20aaba1700 1 Processor -- start 2022-02-02T18:31:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20aaba1700 1 -- start start 2022-02-02T18:31:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20aaba1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 0x7f20a40f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20aaba1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20aaba1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40f8790 con 0x7f20a40f66d0 2022-02-02T18:31:35.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20aaba1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40f88d0 con 0x7f20a40f5430 2022-02-02T18:31:35.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54482/0 (socket says 172.21.15.96:54482) 2022-02-02T18:31:35.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 -- 172.21.15.96:0/788089698 learned_addr learned my addr 172.21.15.96:0/788089698 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:35.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a9b9f700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 0x7f20a40f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 -- 172.21.15.96:0/788089698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 msgr2=0x7f20a40f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:35.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 0x7f20a40f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:35.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 -- 172.21.15.96:0/788089698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2094005040 con 0x7f20a40f66d0 2022-02-02T18:31:35.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f20a939e700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2094009990 tx=0x7f2094009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.931+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2094018070 con 0x7f20a40f66d0 2022-02-02T18:31:35.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.932+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40f8b50 con 0x7f20a40f66d0 2022-02-02T18:31:35.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.932+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2094007ba0 con 0x7f20a40f66d0 2022-02-02T18:31:35.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.932+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f209401c3c0 con 0x7f20a40f66d0 2022-02-02T18:31:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.932+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a40f90b0 con 0x7f20a40f66d0 2022-02-02T18:31:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.933+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a4045ad0 con 0x7f20a40f66d0 2022-02-02T18:31:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.933+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f209401d420 con 0x7f20a40f66d0 2022-02-02T18:31:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.933+0000 7f209a7fc700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 0x7f20900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:35.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.933+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20940836b0 con 0x7f20a40f66d0 2022-02-02T18:31:35.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.933+0000 7f20a9b9f700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 0x7f20900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:35.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.934+0000 7f20a9b9f700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 0x7f20900672e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f20a40f9b40 tx=0x7f20a000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:35.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:35.938+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2094051810 con 0x7f20a40f66d0 2022-02-02T18:31:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.166+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20a40fdbf0 con 0x7f20a40f66d0 2022-02-02T18:31:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.166+0000 7f209a7fc700 1 -- 172.21.15.96:0/788089698 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2094054e30 con 0x7f20a40f66d0 2022-02-02T18:31:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:31:36.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:31:36.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:31:36.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:36.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:31:36.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:31:36.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:36.168 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:31:36.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:31:36.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:36.168 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:31:36.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:31:36.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:31:36.169 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:31:36.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:31:36.170 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:31:36.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:31:36.170 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:31:36.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 msgr2=0x7f20900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 0x7f20900672e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f20a40f9b40 tx=0x7f20a000b040).stop 2022-02-02T18:31:36.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 msgr2=0x7f20a40f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2094009990 tx=0x7f2094009b30).stop 2022-02-02T18:31:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 shutdown_connections 2022-02-02T18:31:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2090064e20 0x7f20900672e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a40f5430 0x7f20a40f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 --2- 172.21.15.96:0/788089698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20a40f66d0 0x7f20a40f8230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 >> 172.21.15.96:0/788089698 conn(0x7f20a40f0b90 msgr2=0x7f20a405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:36.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 shutdown_connections 2022-02-02T18:31:36.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.168+0000 7f20aaba1700 1 -- 172.21.15.96:0/788089698 wait complete. 2022-02-02T18:31:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 -- 172.21.15.96:0/3377831225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 msgr2=0x7f81100f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 --2- 172.21.15.96:0/3377831225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f81100f7d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f810c004660 tx=0x7f810c009b30).stop 2022-02-02T18:31:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 -- 172.21.15.96:0/3377831225 shutdown_connections 2022-02-02T18:31:36.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 --2- 172.21.15.96:0/3377831225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f81100f7d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 --2- 172.21.15.96:0/3377831225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f81100f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 -- 172.21.15.96:0/3377831225 >> 172.21.15.96:0/3377831225 conn(0x7f81100f04c0 msgr2=0x7f81100f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:36.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.267+0000 7f8118109700 1 -- 172.21.15.96:0/3377831225 shutdown_connections 2022-02-02T18:31:36.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: pgmap v282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:36.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:36.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:36.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:36.270 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:36.270 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:36.270 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:36.270 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.271 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.271 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.271 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.271 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:36.272 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/788089698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.268+0000 7f8118109700 1 -- 172.21.15.96:0/3377831225 wait complete. 2022-02-02T18:31:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.268+0000 7f8118109700 1 Processor -- start 2022-02-02T18:31:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.268+0000 7f8118109700 1 -- start start 2022-02-02T18:31:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8118109700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f8110107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8118109700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8118109700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110107c20 con 0x7f81100f53e0 2022-02-02T18:31:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8118109700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110107d60 con 0x7f81100f4a40 2022-02-02T18:31:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54490/0 (socket says 172.21.15.96:54490) 2022-02-02T18:31:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 -- 172.21.15.96:0/1712256413 learned_addr learned my addr 172.21.15.96:0/1712256413 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:31:36.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8115ea5700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f8110107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:36.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 -- 172.21.15.96:0/1712256413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 msgr2=0x7f8110107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f8110107180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 -- 172.21.15.96:0/1712256413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c005040 con 0x7f81100f53e0 2022-02-02T18:31:36.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8115ea5700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f8110107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:31:36.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81156a4700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f810c004f60 tx=0x7f810c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:36.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c018070 con 0x7f81100f53e0 2022-02-02T18:31:36.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.269+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101086a0 con 0x7f81100f53e0 2022-02-02T18:31:36.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.270+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f810c007ba0 con 0x7f81100f53e0 2022-02-02T18:31:36.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.270+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c01c620 con 0x7f81100f53e0 2022-02-02T18:31:36.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.270+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110108c00 con 0x7f81100f53e0 2022-02-02T18:31:36.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.271+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110045ad0 con 0x7f81100f53e0 2022-02-02T18:31:36.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.271+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f810c01c8e0 con 0x7f81100f53e0 2022-02-02T18:31:36.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.271+0000 7f81067fc700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 0x7f80fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:31:36.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.272+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f810c083960 con 0x7f81100f53e0 2022-02-02T18:31:36.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.272+0000 7f8115ea5700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 0x7f80fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:31:36.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.272+0000 7f8115ea5700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 0x7f80fc067290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8100004a90 tx=0x7f8100009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:31:36.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.276+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f810c055490 con 0x7f81100f53e0 2022-02-02T18:31:36.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.476+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81100ff0f0 con 0x7f81100f53e0 2022-02-02T18:31:36.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.476+0000 7f81067fc700 1 -- 172.21.15.96:0/1712256413 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f810c055080 con 0x7f81100f53e0 2022-02-02T18:31:36.476 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:31:36.476 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:31:36.477 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:31:36.477 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:31:36.477 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:36.477 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:31:36.478 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:31:36.478 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:31:36.478 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:31:36.478 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:31:36.479 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:31:36.479 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:31:36.479 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:31:36.479 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:31:36.480 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:31:36.480 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:31:36.480 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:31:36.480 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:31:36.480 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:31:36.481 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:31:36.481 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:31:36.481 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:31:36.481 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:31:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:31:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:31:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:31:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:31:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:31:36.483 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:31:36.483 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:31:36.483 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:31:36.483 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:31:36.484 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:36.484 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:36.484 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:31:36.484 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:31:36.485 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:36.485 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:36.485 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:31:36.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 msgr2=0x7f80fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 0x7f80fc067290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8100004a90 tx=0x7f8100009040).stop 2022-02-02T18:31:36.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 msgr2=0x7f8110107670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:31:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f810c004f60 tx=0x7f810c009b30).stop 2022-02-02T18:31:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 shutdown_connections 2022-02-02T18:31:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80fc064dd0 0x7f80fc067290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81100f4a40 0x7f8110107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 --2- 172.21.15.96:0/1712256413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81100f53e0 0x7f8110107670 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:31:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 >> 172.21.15.96:0/1712256413 conn(0x7f81100f04c0 msgr2=0x7f81100fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:31:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 shutdown_connections 2022-02-02T18:31:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:31:36.478+0000 7f8118109700 1 -- 172.21.15.96:0/1712256413 wait complete. 2022-02-02T18:31:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:31:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: pgmap v282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:36.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/788089698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:37 smithi159 ceph-mon[69013]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:37 smithi159 ceph-mon[69013]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1712256413' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:31:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:37 smithi096 ceph-mon[101353]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:37 smithi096 ceph-mon[101353]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:31:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1712256413' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:31:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:38 smithi159 ceph-mon[69013]: pgmap v283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:38 smithi096 ceph-mon[101353]: pgmap v283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:40 smithi159 ceph-mon[69013]: pgmap v284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:40 smithi096 ceph-mon[101353]: pgmap v284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:42 smithi159 ceph-mon[69013]: pgmap v285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:42 smithi096 ceph-mon[101353]: pgmap v285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:44 smithi159 ceph-mon[69013]: pgmap v286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:44 smithi096 ceph-mon[101353]: pgmap v286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: pgmap v287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:46 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: pgmap v287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:46 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:48 smithi159 ceph-mon[69013]: pgmap v288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:48.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:48 smithi096 ceph-mon[101353]: pgmap v288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:50 smithi159 ceph-mon[69013]: pgmap v289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:50.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:50 smithi096 ceph-mon[101353]: pgmap v289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:52 smithi159 ceph-mon[69013]: pgmap v290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:52.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:52 smithi096 ceph-mon[101353]: pgmap v290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:54 smithi159 ceph-mon[69013]: pgmap v291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:54.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:54 smithi096 ceph-mon[101353]: pgmap v291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: pgmap v292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:56 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: pgmap v292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:31:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:31:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:31:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:31:56.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:56 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:31:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:31:58 smithi159 ceph-mon[69013]: pgmap v293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:31:58.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:31:58 smithi096 ceph-mon[101353]: pgmap v293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:00 smithi159 ceph-mon[69013]: pgmap v294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:00.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:00 smithi096 ceph-mon[101353]: pgmap v294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:02 smithi159 ceph-mon[69013]: pgmap v295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:02.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:02 smithi096 ceph-mon[101353]: pgmap v295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:04 smithi159 ceph-mon[69013]: pgmap v296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:04.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:04 smithi096 ceph-mon[101353]: pgmap v296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: pgmap v297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: pgmap v297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 -- 172.21.15.96:0/1456087161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f66e0 msgr2=0x7f58dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 --2- 172.21.15.96:0/1456087161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f66e0 0x7f58dc0f6b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f58cc004660 tx=0x7f58cc009b30).stop 2022-02-02T18:32:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 -- 172.21.15.96:0/1456087161 shutdown_connections 2022-02-02T18:32:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 --2- 172.21.15.96:0/1456087161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f7980 0x7f58dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 --2- 172.21.15.96:0/1456087161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f66e0 0x7f58dc0f6b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 -- 172.21.15.96:0/1456087161 >> 172.21.15.96:0/1456087161 conn(0x7f58dc0f1e40 msgr2=0x7f58dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 -- 172.21.15.96:0/1456087161 shutdown_connections 2022-02-02T18:32:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 -- 172.21.15.96:0/1456087161 wait complete. 2022-02-02T18:32:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.589+0000 7f58e233d700 1 Processor -- start 2022-02-02T18:32:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58e233d700 1 -- start start 2022-02-02T18:32:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58e233d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f66e0 0x7f58dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58e233d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58e233d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc06a380 con 0x7f58dc0f7980 2022-02-02T18:32:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58e233d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc06a4c0 con 0x7f58dc0f66e0 2022-02-02T18:32:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54506/0 (socket says 172.21.15.96:54506) 2022-02-02T18:32:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 -- 172.21.15.96:0/3979247935 learned_addr learned my addr 172.21.15.96:0/3979247935 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58dbfff700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f66e0 0x7f58dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 -- 172.21.15.96:0/3979247935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f66e0 msgr2=0x7f58dc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f66e0 0x7f58dc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.590+0000 7f58db7fe700 1 -- 172.21.15.96:0/3979247935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc005040 con 0x7f58dc0f7980 2022-02-02T18:32:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58db7fe700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f58d0002700 tx=0x7f58d0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58d0009320 con 0x7f58dc0f7980 2022-02-02T18:32:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc06a7a0 con 0x7f58dc0f7980 2022-02-02T18:32:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f58d000f040 con 0x7f58dc0f7980 2022-02-02T18:32:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58d0014870 con 0x7f58dc0f7980 2022-02-02T18:32:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.591+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc10ef90 con 0x7f58dc0f7980 2022-02-02T18:32:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.592+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc045ad0 con 0x7f58dc0f7980 2022-02-02T18:32:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.593+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f58d0009480 con 0x7f58dc0f7980 2022-02-02T18:32:06.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.593+0000 7f58d8ff9700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 0x7f58c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.593+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f58d00821b0 con 0x7f58dc0f7980 2022-02-02T18:32:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.593+0000 7f58dbfff700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 0x7f58c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.594+0000 7f58dbfff700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 0x7f58c4067290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f58cc013690 tx=0x7f58cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.597+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f58d0050420 con 0x7f58dc0f7980 2022-02-02T18:32:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.778+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58dc0ff010 con 0x7f58c4064dd0 2022-02-02T18:32:06.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.779+0000 7f58d8ff9700 1 -- 172.21.15.96:0/3979247935 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f58dc0ff010 con 0x7f58c4064dd0 2022-02-02T18:32:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 msgr2=0x7f58c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 0x7f58c4067290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f58cc013690 tx=0x7f58cc009b30).stop 2022-02-02T18:32:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 msgr2=0x7f58dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f58d0002700 tx=0x7f58d0009e00).stop 2022-02-02T18:32:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 shutdown_connections 2022-02-02T18:32:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f58c4064dd0 0x7f58c4067290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58dc0f66e0 0x7f58dc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 --2- 172.21.15.96:0/3979247935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58dc0f7980 0x7f58dc069e20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 >> 172.21.15.96:0/3979247935 conn(0x7f58dc0f1e40 msgr2=0x7f58dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 shutdown_connections 2022-02-02T18:32:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.781+0000 7f58e233d700 1 -- 172.21.15.96:0/3979247935 wait complete. 2022-02-02T18:32:06.791 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:32:06.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 -- 172.21.15.96:0/396041707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f6860 msgr2=0x7ff5480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/396041707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f6860 0x7ff5480f6cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff530004660 tx=0x7ff530009b30).stop 2022-02-02T18:32:06.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 -- 172.21.15.96:0/396041707 shutdown_connections 2022-02-02T18:32:06.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/396041707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f6860 0x7ff5480f6cc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/396041707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f55c0 0x7ff5480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 -- 172.21.15.96:0/396041707 >> 172.21.15.96:0/396041707 conn(0x7ff5480f0d40 msgr2=0x7ff5480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:06.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 -- 172.21.15.96:0/396041707 shutdown_connections 2022-02-02T18:32:06.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.878+0000 7ff54ca9e700 1 -- 172.21.15.96:0/396041707 wait complete. 2022-02-02T18:32:06.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 Processor -- start 2022-02-02T18:32:06.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 -- start start 2022-02-02T18:32:06.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 0x7ff54810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480603c0 con 0x7ff5480f55c0 2022-02-02T18:32:06.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54ca9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548060500 con 0x7ff5480f6860 2022-02-02T18:32:06.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54512/0 (socket says 172.21.15.96:54512) 2022-02-02T18:32:06.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54659c700 1 -- 172.21.15.96:0/3307313901 learned_addr learned my addr 172.21.15.96:0/3307313901 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:06.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff545d9b700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 0x7ff54810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.879+0000 7ff54659c700 1 -- 172.21.15.96:0/3307313901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 msgr2=0x7ff54810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:06.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff54659c700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 0x7ff54810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:06.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff54659c700 1 -- 172.21.15.96:0/3307313901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530005040 con 0x7ff5480f55c0 2022-02-02T18:32:06.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff545d9b700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 0x7ff54810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:32:06.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff54659c700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff53800c530 tx=0x7ff538007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:06.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53800f650 con 0x7ff5480f55c0 2022-02-02T18:32:06.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff53800fc60 con 0x7ff5480f55c0 2022-02-02T18:32:06.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff538012d20 con 0x7ff5480f55c0 2022-02-02T18:32:06.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54810c720 con 0x7ff5480f55c0 2022-02-02T18:32:06.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.880+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54810ccb0 con 0x7ff5480f55c0 2022-02-02T18:32:06.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.881+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5480f49b0 con 0x7ff5480f55c0 2022-02-02T18:32:06.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.881+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff538019030 con 0x7ff5480f55c0 2022-02-02T18:32:06.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.882+0000 7ff53effd700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 0x7ff534067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:06.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.882+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff538081620 con 0x7ff5480f55c0 2022-02-02T18:32:06.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.882+0000 7ff545d9b700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 0x7ff534067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:06.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.882+0000 7ff545d9b700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 0x7ff534067290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff530009da0 tx=0x7ff530009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:06.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:06.886+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff53804f830 con 0x7ff5480f55c0 2022-02-02T18:32:07.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.059+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff548057f10 con 0x7ff534064dd0 2022-02-02T18:32:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.068+0000 7ff53effd700 1 -- 172.21.15.96:0/3307313901 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff548057f10 con 0x7ff534064dd0 2022-02-02T18:32:07.068 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:32:07.069 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (15m) 6m ago 16m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:32:07.069 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 6m ago 16m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:32:07.069 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (7m) 4m ago 16m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:32:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (15m) 6m ago 16m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:32:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (12m) 6m ago 12m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:32:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (8m) 6m ago 12m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:32:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (12m) 4m ago 12m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:32:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (8m) 4m ago 12m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:32:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (9m) 6m ago 17m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:32:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (9m) 4m ago 16m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:32:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 6m ago 17m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:32:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (8m) 4m ago 15m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:32:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (16m) 6m ago 16m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:32:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (15m) 4m ago 15m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:32:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (7m) 6m ago 15m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:32:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 6m ago 15m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:32:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 6m ago 14m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:32:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (5m) 4m ago 14m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:32:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (5m) 4m ago 14m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:32:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4m) 4m ago 13m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:32:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (15m) 6m ago 16m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:32:07.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 msgr2=0x7ff534067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 0x7ff534067290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff530009da0 tx=0x7ff530009b30).stop 2022-02-02T18:32:07.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 msgr2=0x7ff548109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff53800c530 tx=0x7ff538007e10).stop 2022-02-02T18:32:07.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 shutdown_connections 2022-02-02T18:32:07.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff534064dd0 0x7ff534067290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5480f55c0 0x7ff548109c70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 --2- 172.21.15.96:0/3307313901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5480f6860 0x7ff54810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 >> 172.21.15.96:0/3307313901 conn(0x7ff5480f0d40 msgr2=0x7ff5480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:07.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 shutdown_connections 2022-02-02T18:32:07.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.070+0000 7ff54ca9e700 1 -- 172.21.15.96:0/3307313901 wait complete. 2022-02-02T18:32:07.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1054193295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 msgr2=0x7f2f800fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1054193295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800fbc90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f2f70004660 tx=0x7f2f70009b30).stop 2022-02-02T18:32:07.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1054193295 shutdown_connections 2022-02-02T18:32:07.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1054193295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800fbc90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1054193295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 0x7f2f800f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:32:07.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1054193295 >> 172.21.15.96:0/1054193295 conn(0x7f2f800f0d40 msgr2=0x7f2f800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:07.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1054193295 shutdown_connections 2022-02-02T18:32:07.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.167+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1054193295 wait complete. 2022-02-02T18:32:07.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 Processor -- start 2022-02-02T18:32:07.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 -- start start 2022-02-02T18:32:07.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 0x7f2f800f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8010ac90 con 0x7f2f800f98a0 2022-02-02T18:32:07.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f84cbf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8010add0 con 0x7f2f80060290 2022-02-02T18:32:07.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f7dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f7dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54524/0 (socket says 172.21.15.96:54524) 2022-02-02T18:32:07.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f7dd9b700 1 -- 172.21.15.96:0/1125004010 learned_addr learned my addr 172.21.15.96:0/1125004010 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:07.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.168+0000 7f2f7e59c700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 0x7f2f800f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f7dd9b700 1 -- 172.21.15.96:0/1125004010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 msgr2=0x7f2f800f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f7dd9b700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 0x7f2f800f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f7dd9b700 1 -- 172.21.15.96:0/1125004010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70005040 con 0x7f2f800f98a0 2022-02-02T18:32:07.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f7dd9b700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f2f70004f60 tx=0x7f2f70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:07.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f70018070 con 0x7f2f800f98a0 2022-02-02T18:32:07.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800f5800 con 0x7f2f800f98a0 2022-02-02T18:32:07.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f70009770 con 0x7f2f800f98a0 2022-02-02T18:32:07.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7001c3c0 con 0x7f2f800f98a0 2022-02-02T18:32:07.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.169+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800f5d60 con 0x7f2f800f98a0 2022-02-02T18:32:07.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.170+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f80045ad0 con 0x7f2f800f98a0 2022-02-02T18:32:07.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.170+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f7001d420 con 0x7f2f800f98a0 2022-02-02T18:32:07.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.171+0000 7f2f76ffd700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 0x7f2f6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.171+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2f70083900 con 0x7f2f800f98a0 2022-02-02T18:32:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.171+0000 7f2f7e59c700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 0x7f2f6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.171+0000 7f2f7e59c700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 0x7f2f6c067290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2f800f6b30 tx=0x7f2f68008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.175+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f70051a00 con 0x7f2f800f98a0 2022-02-02T18:32:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.404+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f800f6080 con 0x7f2f800f98a0 2022-02-02T18:32:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.404+0000 7f2f76ffd700 1 -- 172.21.15.96:0/1125004010 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2f70055020 con 0x7f2f800f98a0 2022-02-02T18:32:07.407 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:32:07.407 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:32:07.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:32:07.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:07.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:32:07.408 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:32:07.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:07.408 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:32:07.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:32:07.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:07.409 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:32:07.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:32:07.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:07.410 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:32:07.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:32:07.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:32:07.410 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:32:07.411 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:32:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 msgr2=0x7f2f6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 0x7f2f6c067290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2f800f6b30 tx=0x7f2f68008040).stop 2022-02-02T18:32:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 msgr2=0x7f2f800f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f2f70004f60 tx=0x7f2f70009b30).stop 2022-02-02T18:32:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 shutdown_connections 2022-02-02T18:32:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f6c064dd0 0x7f2f6c067290 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f80060290 0x7f2f800f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 --2- 172.21.15.96:0/1125004010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f800f98a0 0x7f2f800f5220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 >> 172.21.15.96:0/1125004010 conn(0x7f2f800f0d40 msgr2=0x7f2f800f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 shutdown_connections 2022-02-02T18:32:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.406+0000 7f2f84cbf700 1 -- 172.21.15.96:0/1125004010 wait complete. 2022-02-02T18:32:07.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 -- 172.21.15.96:0/1678770958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 msgr2=0x7fb9b00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 --2- 172.21.15.96:0/1678770958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b00f6b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb9a4004660 tx=0x7fb9a4009b30).stop 2022-02-02T18:32:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 -- 172.21.15.96:0/1678770958 shutdown_connections 2022-02-02T18:32:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 --2- 172.21.15.96:0/1678770958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b00f6b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 --2- 172.21.15.96:0/1678770958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 0x7fb9b00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:32:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 -- 172.21.15.96:0/1678770958 >> 172.21.15.96:0/1678770958 conn(0x7fb9b00f0ba0 msgr2=0x7fb9b00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.503+0000 7fb9affff700 1 -- 172.21.15.96:0/1678770958 shutdown_connections 2022-02-02T18:32:07.505 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:07 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.504+0000 7fb9affff700 1 -- 172.21.15.96:0/1678770958 wait complete. 2022-02-02T18:32:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.504+0000 7fb9affff700 1 Processor -- start 2022-02-02T18:32:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.504+0000 7fb9affff700 1 -- start start 2022-02-02T18:32:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9affff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 0x7fb9b0105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9affff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0106850 con 0x7fb9b00f66e0 2022-02-02T18:32:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9affff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0106fc0 con 0x7fb9b00f5440 2022-02-02T18:32:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54534/0 (socket says 172.21.15.96:54534) 2022-02-02T18:32:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 -- 172.21.15.96:0/214842754 learned_addr learned my addr 172.21.15.96:0/214842754 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 0x7fb9b0105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 -- 172.21.15.96:0/214842754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 msgr2=0x7fb9b0105d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 0x7fb9b0105d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 -- 172.21.15.96:0/214842754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b00f66e0 2022-02-02T18:32:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9ae7fc700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb9a4009990 tx=0x7fb9a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a4018070 con 0x7fb9b00f66e0 2022-02-02T18:32:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9a4007ba0 con 0x7fb9b00f66e0 2022-02-02T18:32:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.505+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0107240 con 0x7fb9b00f66e0 2022-02-02T18:32:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.506+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a401c620 con 0x7fb9b00f66e0 2022-02-02T18:32:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.506+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b01077a0 con 0x7fb9b00f66e0 2022-02-02T18:32:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.507+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0045ad0 con 0x7fb9b00f66e0 2022-02-02T18:32:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.507+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9a401c8e0 con 0x7fb9b00f66e0 2022-02-02T18:32:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.508+0000 7fb9977fe700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 0x7fb9980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.508+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9a4083890 con 0x7fb9b00f66e0 2022-02-02T18:32:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.508+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 0x7fb9980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.508+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 0x7fb9980672e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb9a0006fd0 tx=0x7fb9a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.512+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9a4055530 con 0x7fb9b00f66e0 2022-02-02T18:32:07.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:07 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:07.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.712+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9b0107de0 con 0x7fb9b00f66e0 2022-02-02T18:32:07.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.713+0000 7fb9977fe700 1 -- 172.21.15.96:0/214842754 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb9a4055120 con 0x7fb9b00f66e0 2022-02-02T18:32:07.713 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:32:07.714 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:32:07.714 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:32:07.714 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:32:07.714 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:07.714 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:32:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:32:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:32:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:32:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:32:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:32:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:32:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:32:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:32:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:32:07.717 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:32:07.717 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:32:07.717 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:32:07.717 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:32:07.717 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:32:07.718 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:32:07.718 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:32:07.718 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:32:07.718 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:32:07.719 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:32:07.719 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:32:07.719 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:32:07.719 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:32:07.719 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:32:07.720 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:32:07.720 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:32:07.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:32:07.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:07.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:07.721 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:32:07.721 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:07.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:07.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:07.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:07.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.714+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 msgr2=0x7fb9980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 0x7fb9980672e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb9a0006fd0 tx=0x7fb9a0008040).stop 2022-02-02T18:32:07.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 msgr2=0x7fb9b0106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:07.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb9a4009990 tx=0x7fb9a4009b30).stop 2022-02-02T18:32:07.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 shutdown_connections 2022-02-02T18:32:07.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064e20 0x7fb9980672e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f5440 0x7fb9b0105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 --2- 172.21.15.96:0/214842754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0106210 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 >> 172.21.15.96:0/214842754 conn(0x7fb9b00f0ba0 msgr2=0x7fb9b00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 shutdown_connections 2022-02-02T18:32:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:07.715+0000 7fb9affff700 1 -- 172.21.15.96:0/214842754 wait complete. 2022-02-02T18:32:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:32:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:08 smithi159 ceph-mon[69013]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:08 smithi159 ceph-mon[69013]: pgmap v298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:08 smithi159 ceph-mon[69013]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1125004010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/214842754' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:32:08.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:08 smithi096 ceph-mon[101353]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:08 smithi096 ceph-mon[101353]: pgmap v298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:08 smithi096 ceph-mon[101353]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1125004010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/214842754' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:32:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:10 smithi159 ceph-mon[69013]: pgmap v299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:10.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:10 smithi096 ceph-mon[101353]: pgmap v299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:12 smithi159 ceph-mon[69013]: pgmap v300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:12.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:12 smithi096 ceph-mon[101353]: pgmap v300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:14 smithi159 ceph-mon[69013]: pgmap v301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:14 smithi096 ceph-mon[101353]: pgmap v301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: pgmap v302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: pgmap v302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:17 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:17 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:17.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:17 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:17 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:18 smithi159 ceph-mon[69013]: pgmap v303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:18 smithi096 ceph-mon[101353]: pgmap v303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:19.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:19 smithi159 ceph-mon[69013]: evicting unresponsive client smithi096:0 (24303), after 303.221 seconds 2022-02-02T18:32:19.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:19 smithi159 ceph-mon[69013]: Evicting (and blocklisting) client session 24303 (v1:172.21.15.96:0/1417773195) 2022-02-02T18:32:19.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:19 smithi159 ceph-mon[69013]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/1417773195"}]: dispatch 2022-02-02T18:32:19.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:19 smithi096 ceph-mon[101353]: evicting unresponsive client smithi096:0 (24303), after 303.221 seconds 2022-02-02T18:32:19.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:19 smithi096 ceph-mon[101353]: Evicting (and blocklisting) client session 24303 (v1:172.21.15.96:0/1417773195) 2022-02-02T18:32:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:19 smithi096 ceph-mon[101353]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/1417773195"}]: dispatch 2022-02-02T18:32:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:20 smithi159 ceph-mon[69013]: pgmap v304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:20 smithi159 ceph-mon[69013]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/1417773195"}]': finished 2022-02-02T18:32:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:20 smithi159 ceph-mon[69013]: osdmap e84: 6 total, 6 up, 6 in 2022-02-02T18:32:20.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:20 smithi096 ceph-mon[101353]: pgmap v304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:20 smithi096 ceph-mon[101353]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/1417773195"}]': finished 2022-02-02T18:32:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:20 smithi096 ceph-mon[101353]: osdmap e84: 6 total, 6 up, 6 in 2022-02-02T18:32:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:22 smithi159 ceph-mon[69013]: pgmap v306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 102 B/s wr, 0 op/s 2022-02-02T18:32:22.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:22 smithi096 ceph-mon[101353]: pgmap v306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 102 B/s wr, 0 op/s 2022-02-02T18:32:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:24 smithi159 ceph-mon[69013]: pgmap v307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2022-02-02T18:32:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:24 smithi159 ceph-mon[69013]: evicting unresponsive client smithi159:1 (24307), after 302.313 seconds 2022-02-02T18:32:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:24 smithi159 ceph-mon[69013]: Evicting (and blocklisting) client session 24307 (v1:192.168.0.1:0/2904487504) 2022-02-02T18:32:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:24 smithi159 ceph-mon[69013]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:192.168.0.1:0/2904487504"}]: dispatch 2022-02-02T18:32:24.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:24 smithi096 ceph-mon[101353]: pgmap v307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2022-02-02T18:32:24.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:24 smithi096 ceph-mon[101353]: evicting unresponsive client smithi159:1 (24307), after 302.313 seconds 2022-02-02T18:32:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:24 smithi096 ceph-mon[101353]: Evicting (and blocklisting) client session 24307 (v1:192.168.0.1:0/2904487504) 2022-02-02T18:32:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:24 smithi096 ceph-mon[101353]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:192.168.0.1:0/2904487504"}]: dispatch 2022-02-02T18:32:25.528 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:25 smithi096 ceph-mon[101353]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:192.168.0.1:0/2904487504"}]': finished 2022-02-02T18:32:25.528 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:25 smithi096 ceph-mon[101353]: osdmap e85: 6 total, 6 up, 6 in 2022-02-02T18:32:25.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:25 smithi159 ceph-mon[69013]: from='mds.1 [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654]' entity='mds.cephfs.smithi159.omlhix' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:192.168.0.1:0/2904487504"}]': finished 2022-02-02T18:32:25.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:25 smithi159 ceph-mon[69013]: osdmap e85: 6 total, 6 up, 6 in 2022-02-02T18:32:26.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: pgmap v309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2022-02-02T18:32:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: pgmap v309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2022-02-02T18:32:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:27.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:27 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:27 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:32:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:32:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:27 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:27 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:32:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:32:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:28 smithi096 ceph-mon[101353]: pgmap v310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2022-02-02T18:32:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:28 smithi159 ceph-mon[69013]: pgmap v310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2022-02-02T18:32:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:30 smithi096 ceph-mon[101353]: pgmap v311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 533 B/s wr, 0 op/s 2022-02-02T18:32:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:30 smithi159 ceph-mon[69013]: pgmap v311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 533 B/s wr, 0 op/s 2022-02-02T18:32:32.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:32 smithi096 ceph-mon[101353]: pgmap v312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 409 B/s wr, 0 op/s 2022-02-02T18:32:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:32 smithi159 ceph-mon[69013]: pgmap v312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 409 B/s wr, 0 op/s 2022-02-02T18:32:34.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:34 smithi096 ceph-mon[101353]: pgmap v313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2022-02-02T18:32:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:34 smithi159 ceph-mon[69013]: pgmap v313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2022-02-02T18:32:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: pgmap v314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 193 B/s wr, 0 op/s 2022-02-02T18:32:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: pgmap v314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 193 B/s wr, 0 op/s 2022-02-02T18:32:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:37 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:37 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:37.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:37 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:37 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 -- 172.21.15.96:0/1762366887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 msgr2=0x7f57380f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1762366887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f57380f59e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5728004660 tx=0x7f5728009b30).stop 2022-02-02T18:32:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 -- 172.21.15.96:0/1762366887 shutdown_connections 2022-02-02T18:32:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1762366887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 0x7f57380f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1762366887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f57380f59e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 -- 172.21.15.96:0/1762366887 >> 172.21.15.96:0/1762366887 conn(0x7f57380f0d40 msgr2=0x7f57380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 -- 172.21.15.96:0/1762366887 shutdown_connections 2022-02-02T18:32:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.828+0000 7f573f6fa700 1 -- 172.21.15.96:0/1762366887 wait complete. 2022-02-02T18:32:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 Processor -- start 2022-02-02T18:32:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 -- start start 2022-02-02T18:32:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 0x7f5738106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738106910 con 0x7f57380f55c0 2022-02-02T18:32:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573f6fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738106a50 con 0x7f57380f6860 2022-02-02T18:32:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54552/0 (socket says 172.21.15.96:54552) 2022-02-02T18:32:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 -- 172.21.15.96:0/1930626899 learned_addr learned my addr 172.21.15.96:0/1930626899 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573cc95700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 0x7f5738106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 -- 172.21.15.96:0/1930626899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 msgr2=0x7f5738106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 0x7f5738106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.829+0000 7f573d496700 1 -- 172.21.15.96:0/1930626899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728005040 con 0x7f57380f55c0 2022-02-02T18:32:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f573d496700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5728004f60 tx=0x7f5728009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5728018070 con 0x7f57380f55c0 2022-02-02T18:32:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5738107390 con 0x7f57380f55c0 2022-02-02T18:32:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5728007ba0 con 0x7f57380f55c0 2022-02-02T18:32:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f572801c620 con 0x7f57380f55c0 2022-02-02T18:32:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.830+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57381078f0 con 0x7f57380f55c0 2022-02-02T18:32:37.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.831+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738045ad0 con 0x7f57380f55c0 2022-02-02T18:32:37.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.832+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f572801d420 con 0x7f57380f55c0 2022-02-02T18:32:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.832+0000 7f572dffb700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 0x7f5724067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.832+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5728083d90 con 0x7f57380f55c0 2022-02-02T18:32:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.832+0000 7f573cc95700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 0x7f5724067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.833+0000 7f573cc95700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 0x7f5724067290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5734007fd0 tx=0x7f5734009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:37.836+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f57280558f0 con 0x7f57380f55c0 2022-02-02T18:32:38.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.015+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57380fdef0 con 0x7f5724064dd0 2022-02-02T18:32:38.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.017+0000 7f572dffb700 1 -- 172.21.15.96:0/1930626899 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f57380fdef0 con 0x7f5724064dd0 2022-02-02T18:32:38.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 msgr2=0x7f5724067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 0x7f5724067290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5734007fd0 tx=0x7f5734009040).stop 2022-02-02T18:32:38.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 msgr2=0x7f5738105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5728004f60 tx=0x7f5728009b30).stop 2022-02-02T18:32:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 shutdown_connections 2022-02-02T18:32:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5724064dd0 0x7f5724067290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57380f55c0 0x7f5738105e70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 --2- 172.21.15.96:0/1930626899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57380f6860 0x7f5738106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 >> 172.21.15.96:0/1930626899 conn(0x7f57380f0d40 msgr2=0x7f57380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 shutdown_connections 2022-02-02T18:32:38.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.019+0000 7f573f6fa700 1 -- 172.21.15.96:0/1930626899 wait complete. 2022-02-02T18:32:38.028 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:32:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- 172.21.15.96:0/2811797970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 msgr2=0x7f2ea80f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 --2- 172.21.15.96:0/2811797970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea80f6900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2e90004660 tx=0x7f2e90009b30).stop 2022-02-02T18:32:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- 172.21.15.96:0/2811797970 shutdown_connections 2022-02-02T18:32:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 --2- 172.21.15.96:0/2811797970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea80f6900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 --2- 172.21.15.96:0/2811797970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 0x7f2ea80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- 172.21.15.96:0/2811797970 >> 172.21.15.96:0/2811797970 conn(0x7f2ea80f0de0 msgr2=0x7f2ea80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- 172.21.15.96:0/2811797970 shutdown_connections 2022-02-02T18:32:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- 172.21.15.96:0/2811797970 wait complete. 2022-02-02T18:32:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 Processor -- start 2022-02-02T18:32:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.117+0000 7f2eaead6700 1 -- start start 2022-02-02T18:32:38.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2eaead6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 0x7f2ea8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2eaead6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2eaead6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8060540 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2eaead6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8060680 con 0x7f2ea80f55c0 2022-02-02T18:32:38.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54562/0 (socket says 172.21.15.96:54562) 2022-02-02T18:32:38.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 -- 172.21.15.96:0/3870569573 learned_addr learned my addr 172.21.15.96:0/3870569573 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:38.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2eac872700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 0x7f2ea8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 -- 172.21.15.96:0/3870569573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 msgr2=0x7f2ea8109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 0x7f2ea8109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 -- 172.21.15.96:0/3870569573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90005040 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea7fff700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2e90009990 tx=0x7f2e90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.118+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e90018070 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.119+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea810c6c0 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.119+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e90007ba0 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.119+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9001c3c0 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.119+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea810cc20 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.120+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e9001d420 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.120+0000 7f2ea57fa700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 0x7f2e94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.120+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2e900836f0 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.120+0000 7f2eac872700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 0x7f2e94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.121+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea8045ad0 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.121+0000 7f2eac872700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 0x7f2e94067290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2ea80601c0 tx=0x7f2ea0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.125+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e90051860 con 0x7f2ea80f5ed0 2022-02-02T18:32:38.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.298+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ea80fde80 con 0x7f2e94064dd0 2022-02-02T18:32:38.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.307+0000 7f2ea57fa700 1 -- 172.21.15.96:0/3870569573 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2ea80fde80 con 0x7f2e94064dd0 2022-02-02T18:32:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:32:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (16m) 6m ago 17m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:32:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (8m) 6m ago 17m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:32:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (8m) 5m ago 16m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:32:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (15m) 6m ago 16m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:32:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (13m) 6m ago 13m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:32:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (8m) 6m ago 13m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:32:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (13m) 5m ago 13m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:32:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (8m) 5m ago 13m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:32:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (10m) 6m ago 18m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:32:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (9m) 5m ago 16m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:32:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (9m) 6m ago 18m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:32:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (8m) 5m ago 16m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:32:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (16m) 6m ago 16m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:32:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (16m) 5m ago 16m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:32:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (8m) 6m ago 15m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:32:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (7m) 6m ago 15m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:32:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 6m ago 15m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:32:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (6m) 5m ago 14m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:32:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (5m) 5m ago 14m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:32:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (5m) 5m ago 14m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:32:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (15m) 6m ago 16m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:32:38.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.309+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 msgr2=0x7f2e94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.309+0000 7f2eaead6700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 0x7f2e94067290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2ea80601c0 tx=0x7f2ea0009040).stop 2022-02-02T18:32:38.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.309+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 msgr2=0x7f2ea810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2e90009990 tx=0x7f2e90009b30).stop 2022-02-02T18:32:38.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 shutdown_connections 2022-02-02T18:32:38.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e94064dd0 0x7f2e94067290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea80f55c0 0x7f2ea8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 --2- 172.21.15.96:0/3870569573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ea80f5ed0 0x7f2ea810c170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 >> 172.21.15.96:0/3870569573 conn(0x7f2ea80f0de0 msgr2=0x7f2ea80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 shutdown_connections 2022-02-02T18:32:38.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.310+0000 7f2eaead6700 1 -- 172.21.15.96:0/3870569573 wait complete. 2022-02-02T18:32:38.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 -- 172.21.15.96:0/2035787747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 msgr2=0x7fafdc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 --2- 172.21.15.96:0/2035787747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc0f6cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fafcc004660 tx=0x7fafcc009b30).stop 2022-02-02T18:32:38.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 -- 172.21.15.96:0/2035787747 shutdown_connections 2022-02-02T18:32:38.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 --2- 172.21.15.96:0/2035787747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc0f6cc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 --2- 172.21.15.96:0/2035787747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 0x7fafdc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 -- 172.21.15.96:0/2035787747 >> 172.21.15.96:0/2035787747 conn(0x7fafdc0f0d40 msgr2=0x7fafdc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.409 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:38 smithi096 ceph-mon[101353]: pgmap v315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2022-02-02T18:32:38.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 -- 172.21.15.96:0/2035787747 shutdown_connections 2022-02-02T18:32:38.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.408+0000 7fafe12ba700 1 -- 172.21.15.96:0/2035787747 wait complete. 2022-02-02T18:32:38.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 Processor -- start 2022-02-02T18:32:38.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 -- start start 2022-02-02T18:32:38.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 0x7fafdc10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0602b0 con 0x7fafdc0f6860 2022-02-02T18:32:38.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafe12ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0603f0 con 0x7fafdc0f55c0 2022-02-02T18:32:38.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54570/0 (socket says 172.21.15.96:54570) 2022-02-02T18:32:38.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 -- 172.21.15.96:0/4255078102 learned_addr learned my addr 172.21.15.96:0/4255078102 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:38.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafdaffd700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 0x7fafdc10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 -- 172.21.15.96:0/4255078102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 msgr2=0x7fafdc10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 0x7fafdc10c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 -- 172.21.15.96:0/4255078102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc005040 con 0x7fafdc0f6860 2022-02-02T18:32:38.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.409+0000 7fafda7fc700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fafcc009990 tx=0x7fafcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.410+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc018070 con 0x7fafdc0f6860 2022-02-02T18:32:38.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.410+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafcc007ba0 con 0x7fafdc0f6860 2022-02-02T18:32:38.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.410+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc10ea60 con 0x7fafdc0f6860 2022-02-02T18:32:38.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.410+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc01c3c0 con 0x7fafdc0f6860 2022-02-02T18:32:38.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.410+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc10ee30 con 0x7fafdc0f6860 2022-02-02T18:32:38.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.411+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc045ad0 con 0x7fafdc0f6860 2022-02-02T18:32:38.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.411+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fafcc01c680 con 0x7fafdc0f6860 2022-02-02T18:32:38.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.411+0000 7fafc37fe700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 0x7fafc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.411+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fafcc083740 con 0x7fafdc0f6860 2022-02-02T18:32:38.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.411+0000 7fafdaffd700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 0x7fafc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.412+0000 7fafdaffd700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 0x7fafc4067290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fafdc060040 tx=0x7fafd000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.416+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fafcc0518d0 con 0x7fafdc0f6860 2022-02-02T18:32:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.646+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafdc027a00 con 0x7fafdc0f6860 2022-02-02T18:32:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.647+0000 7fafc37fe700 1 -- 172.21.15.96:0/4255078102 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fafcc054ef0 con 0x7fafdc0f6860 2022-02-02T18:32:38.646 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:32:38.647 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:32:38.647 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:32:38.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:38.647 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:32:38.648 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:32:38.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:38.648 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:32:38.648 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:32:38.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:38.649 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:32:38.649 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:32:38.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:32:38.649 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:32:38.650 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:32:38.650 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:32:38.650 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:32:38.650 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:32:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 msgr2=0x7fafc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 0x7fafc4067290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fafdc060040 tx=0x7fafd000b040).stop 2022-02-02T18:32:38.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 msgr2=0x7fafdc10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fafcc009990 tx=0x7fafcc009b30).stop 2022-02-02T18:32:38.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 shutdown_connections 2022-02-02T18:32:38.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.648+0000 7fafe12ba700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafc4064dd0 0x7fafc4067290 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.649+0000 7fafe12ba700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafdc0f55c0 0x7fafdc10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.649+0000 7fafe12ba700 1 --2- 172.21.15.96:0/4255078102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafdc0f6860 0x7fafdc10e570 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.649+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 >> 172.21.15.96:0/4255078102 conn(0x7fafdc0f0d40 msgr2=0x7fafdc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.649+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 shutdown_connections 2022-02-02T18:32:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.649+0000 7fafe12ba700 1 -- 172.21.15.96:0/4255078102 wait complete. 2022-02-02T18:32:38.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 -- 172.21.15.96:0/278499057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 msgr2=0x7fa7a80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 --2- 172.21.15.96:0/278499057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80f6cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa794004660 tx=0x7fa794009b30).stop 2022-02-02T18:32:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 -- 172.21.15.96:0/278499057 shutdown_connections 2022-02-02T18:32:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 --2- 172.21.15.96:0/278499057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80f6cc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 --2- 172.21.15.96:0/278499057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 -- 172.21.15.96:0/278499057 >> 172.21.15.96:0/278499057 conn(0x7fa7a80f0d40 msgr2=0x7fa7a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 -- 172.21.15.96:0/278499057 shutdown_connections 2022-02-02T18:32:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.749+0000 7fa7af23d700 1 -- 172.21.15.96:0/278499057 wait complete. 2022-02-02T18:32:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 Processor -- start 2022-02-02T18:32:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 -- start start 2022-02-02T18:32:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80ff4b0 con 0x7fa7a80f6860 2022-02-02T18:32:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7af23d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80ff5f0 con 0x7fa7a80f55c0 2022-02-02T18:32:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54580/0 (socket says 172.21.15.96:54580) 2022-02-02T18:32:38.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7a7fff700 1 -- 172.21.15.96:0/4021439597 learned_addr learned my addr 172.21.15.96:0/4021439597 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:32:38.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.750+0000 7fa7acfd9700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a7fff700 1 -- 172.21.15.96:0/4021439597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 msgr2=0x7fa7a80fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a7fff700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80fe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a7fff700 1 -- 172.21.15.96:0/4021439597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794005040 con 0x7fa7a80f6860 2022-02-02T18:32:38.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7acfd9700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:32:38.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a7fff700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa794009990 tx=0x7fa794009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa794018070 con 0x7fa7a80f6860 2022-02-02T18:32:38.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a80fff00 con 0x7fa7a80f6860 2022-02-02T18:32:38.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa794007ca0 con 0x7fa7a80f6860 2022-02-02T18:32:38.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79401c620 con 0x7fa7a80f6860 2022-02-02T18:32:38.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.751+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8100460 con 0x7fa7a80f6860 2022-02-02T18:32:38.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.752+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a8045ad0 con 0x7fa7a80f6860 2022-02-02T18:32:38.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.752+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa79401d960 con 0x7fa7a80f6860 2022-02-02T18:32:38.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.753+0000 7fa7a57fa700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 0x7fa798067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:32:38.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.753+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa794083830 con 0x7fa7a80f6860 2022-02-02T18:32:38.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.753+0000 7fa7acfd9700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 0x7fa798067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:32:38.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.753+0000 7fa7acfd9700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 0x7fa798067290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa7a80fe750 tx=0x7fa79c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:32:38.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.757+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa7940519a0 con 0x7fa7a80f6860 2022-02-02T18:32:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:38 smithi159 ceph-mon[69013]: pgmap v315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2022-02-02T18:32:38.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.965+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa7a8102190 con 0x7fa7a80f6860 2022-02-02T18:32:38.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.966+0000 7fa7a57fa700 1 -- 172.21.15.96:0/4021439597 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa794054fc0 con 0x7fa7a80f6860 2022-02-02T18:32:38.966 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:32:38.966 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:32:38.967 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:32:38.967 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:32:38.967 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:38.967 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:32:38.967 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:32:38.968 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:32:38.968 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:32:38.968 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:32:38.968 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:32:38.969 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:32:38.969 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:32:38.970 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:32:38.970 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:32:38.970 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:32:38.971 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:32:38.971 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:32:38.971 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:32:38.971 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:32:38.972 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:32:38.972 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:32:38.972 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:32:38.972 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:32:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:32:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:32:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:32:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:32:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:32:38.974 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:32:38.974 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:32:38.974 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:32:38.974 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:38.975 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:38.975 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:32:38.975 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:32:38.975 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:38.975 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:32:38.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 msgr2=0x7fa798067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 0x7fa798067290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa7a80fe750 tx=0x7fa79c009040).stop 2022-02-02T18:32:38.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 msgr2=0x7fa7a80feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:32:38.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa794009990 tx=0x7fa794009b30).stop 2022-02-02T18:32:38.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 shutdown_connections 2022-02-02T18:32:38.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa798064dd0 0x7fa798067290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a80f55c0 0x7fa7a80fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 --2- 172.21.15.96:0/4021439597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7a80f6860 0x7fa7a80feeb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:32:38.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 >> 172.21.15.96:0/4021439597 conn(0x7fa7a80f0d40 msgr2=0x7fa7a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:32:38.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 shutdown_connections 2022-02-02T18:32:38.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:32:38.968+0000 7fa7af23d700 1 -- 172.21.15.96:0/4021439597 wait complete. 2022-02-02T18:32:38.979 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:32:39.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:39 smithi159 ceph-mon[69013]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:39.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:39 smithi159 ceph-mon[69013]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:39.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4255078102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:39.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4021439597' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:32:39.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:39 smithi096 ceph-mon[101353]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:39.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:39 smithi096 ceph-mon[101353]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:32:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4255078102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4021439597' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:32:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:40 smithi159 ceph-mon[69013]: pgmap v316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2022-02-02T18:32:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:40 smithi096 ceph-mon[101353]: pgmap v316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2022-02-02T18:32:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:42 smithi159 ceph-mon[69013]: pgmap v317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2022-02-02T18:32:42.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:42 smithi096 ceph-mon[101353]: pgmap v317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2022-02-02T18:32:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:44 smithi159 ceph-mon[69013]: pgmap v318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:44 smithi096 ceph-mon[101353]: pgmap v318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: pgmap v319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: pgmap v319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:47.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:47 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:47 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:47 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:47 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:48 smithi159 ceph-mon[69013]: pgmap v320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:48.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:48 smithi096 ceph-mon[101353]: pgmap v320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:50 smithi159 ceph-mon[69013]: pgmap v321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:50 smithi096 ceph-mon[101353]: pgmap v321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:52 smithi159 ceph-mon[69013]: pgmap v322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:52 smithi096 ceph-mon[101353]: pgmap v322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:54 smithi159 ceph-mon[69013]: pgmap v323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:54 smithi096 ceph-mon[101353]: pgmap v323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: pgmap v324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: pgmap v324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:32:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:32:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:32:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:32:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:32:57.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:57 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:57 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:57.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:57 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:32:57.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:57 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:32:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:32:58 smithi159 ceph-mon[69013]: pgmap v325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:32:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:32:58 smithi096 ceph-mon[101353]: pgmap v325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:00 smithi159 ceph-mon[69013]: pgmap v326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:00 smithi096 ceph-mon[101353]: pgmap v326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:02 smithi159 ceph-mon[69013]: pgmap v327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:02 smithi096 ceph-mon[101353]: pgmap v327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:04 smithi159 ceph-mon[69013]: pgmap v328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:04 smithi096 ceph-mon[101353]: pgmap v328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: pgmap v329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: pgmap v329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:07.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:07 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:07 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:07 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:07 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:08.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:08 smithi159 ceph-mon[69013]: pgmap v330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:08.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:08 smithi096 ceph-mon[101353]: pgmap v330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1523669305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f55e0 msgr2=0x7fd3c80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1523669305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f55e0 0x7fd3c80f5a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd3b8004660 tx=0x7fd3b8009b30).stop 2022-02-02T18:33:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1523669305 shutdown_connections 2022-02-02T18:33:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1523669305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1523669305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f55e0 0x7fd3c80f5a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1523669305 >> 172.21.15.96:0/1523669305 conn(0x7fd3c80f0de0 msgr2=0x7fd3c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1523669305 shutdown_connections 2022-02-02T18:33:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.079+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1523669305 wait complete. 2022-02-02T18:33:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 Processor -- start 2022-02-02T18:33:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 -- start start 2022-02-02T18:33:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f55e0 0x7fd3c810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80603d0 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3d04b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8060510 con 0x7fd3c80f55e0 2022-02-02T18:33:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54600/0 (socket says 172.21.15.96:54600) 2022-02-02T18:33:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 -- 172.21.15.96:0/1217954228 learned_addr learned my addr 172.21.15.96:0/1217954228 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3ce254700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f55e0 0x7fd3c810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 -- 172.21.15.96:0/1217954228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f55e0 msgr2=0x7fd3c810c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f55e0 0x7fd3c810c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 -- 172.21.15.96:0/1217954228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8005040 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.080+0000 7fd3cda53700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd3c400c530 tx=0x7fd3c4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.081+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c400f650 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.081+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c810eaa0 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.081+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c810ef20 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.081+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3c400fc60 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.081+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c4012bd0 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.082+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b0004fa0 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.082+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3c4010070 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.082+0000 7fd3beffd700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 0x7fd3b4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.083+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3c4081680 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.083+0000 7fd3ce254700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 0x7fd3b4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.083+0000 7fd3ce254700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 0x7fd3b4067270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd3b8013690 tx=0x7fd3b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.087+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3c404f730 con 0x7fd3c80f5ef0 2022-02-02T18:33:09.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.268+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b0000bc0 con 0x7fd3b4064db0 2022-02-02T18:33:09.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.269+0000 7fd3beffd700 1 -- 172.21.15.96:0/1217954228 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd3b0000bc0 con 0x7fd3b4064db0 2022-02-02T18:33:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 msgr2=0x7fd3b4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 0x7fd3b4067270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd3b8013690 tx=0x7fd3b8009b30).stop 2022-02-02T18:33:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 msgr2=0x7fd3c810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd3c400c530 tx=0x7fd3c4007e20).stop 2022-02-02T18:33:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 shutdown_connections 2022-02-02T18:33:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b4064db0 0x7fd3b4067270 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c80f55e0 0x7fd3c810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 --2- 172.21.15.96:0/1217954228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3c80f5ef0 0x7fd3c810e5b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 >> 172.21.15.96:0/1217954228 conn(0x7fd3c80f0de0 msgr2=0x7fd3c80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 shutdown_connections 2022-02-02T18:33:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.271+0000 7fd3d04b8700 1 -- 172.21.15.96:0/1217954228 wait complete. 2022-02-02T18:33:09.280 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:33:09.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.369+0000 7f725359e700 1 -- 172.21.15.96:0/257663783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f6530 msgr2=0x7f72540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.369+0000 7f725359e700 1 --2- 172.21.15.96:0/257663783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f6530 0x7f72540f6950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7244004660 tx=0x7f7244009b30).stop 2022-02-02T18:33:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 -- 172.21.15.96:0/257663783 shutdown_connections 2022-02-02T18:33:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 --2- 172.21.15.96:0/257663783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f77d0 0x7f72540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:33:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 --2- 172.21.15.96:0/257663783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f6530 0x7f72540f6950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 -- 172.21.15.96:0/257663783 >> 172.21.15.96:0/257663783 conn(0x7f72540f1c90 msgr2=0x7f72540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 -- 172.21.15.96:0/257663783 shutdown_connections 2022-02-02T18:33:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 -- 172.21.15.96:0/257663783 wait complete. 2022-02-02T18:33:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 Processor -- start 2022-02-02T18:33:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.370+0000 7f725359e700 1 -- start start 2022-02-02T18:33:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f6530 0x7f7254106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72541079a0 con 0x7f72540f77d0 2022-02-02T18:33:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254108120 con 0x7f72540f6530 2022-02-02T18:33:09.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54610/0 (socket says 172.21.15.96:54610) 2022-02-02T18:33:09.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 -- 172.21.15.96:0/559409796 learned_addr learned my addr 172.21.15.96:0/559409796 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:09.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725259c700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f6530 0x7f7254106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 -- 172.21.15.96:0/559409796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f6530 msgr2=0x7f7254106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f6530 0x7f7254106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 -- 172.21.15.96:0/559409796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244005040 con 0x7f72540f77d0 2022-02-02T18:33:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7251d9b700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f724800b410 tx=0x7f7248006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72480125f0 con 0x7f72540f77d0 2022-02-02T18:33:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f724800be30 con 0x7f72540f77d0 2022-02-02T18:33:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.371+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72541083a0 con 0x7f72540f77d0 2022-02-02T18:33:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.372+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7254108960 con 0x7f72540f77d0 2022-02-02T18:33:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.372+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7248002a70 con 0x7f72540f77d0 2022-02-02T18:33:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.373+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238004fa0 con 0x7f72540f77d0 2022-02-02T18:33:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.373+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f724800f030 con 0x7f72540f77d0 2022-02-02T18:33:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.373+0000 7f7242ffd700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 0x7f723c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.373+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7248081e40 con 0x7f72540f77d0 2022-02-02T18:33:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.373+0000 7f725259c700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 0x7f723c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.374+0000 7f725259c700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 0x7f723c0672e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7244013690 tx=0x7f7244009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.378+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f724804fef0 con 0x7f72540f77d0 2022-02-02T18:33:09.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.548+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7238000bc0 con 0x7f723c064e20 2022-02-02T18:33:09.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.557+0000 7f7242ffd700 1 -- 172.21.15.96:0/559409796 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7238000bc0 con 0x7f723c064e20 2022-02-02T18:33:09.556 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:33:09.557 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (16m) 7m ago 17m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:33:09.557 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (8m) 7m ago 17m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:33:09.557 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (8m) 5m ago 17m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:33:09.557 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (16m) 7m ago 17m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:33:09.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (13m) 7m ago 13m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:33:09.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (9m) 7m ago 13m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:33:09.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (13m) 5m ago 13m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:33:09.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (9m) 5m ago 13m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:33:09.559 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (10m) 7m ago 18m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:33:09.559 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (10m) 5m ago 17m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:33:09.559 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (9m) 7m ago 18m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:33:09.559 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (9m) 5m ago 16m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:33:09.559 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (17m) 7m ago 17m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:33:09.560 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (16m) 5m ago 16m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:33:09.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (8m) 7m ago 16m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:33:09.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (8m) 7m ago 16m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:33:09.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (7m) 7m ago 15m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:33:09.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (6m) 5m ago 15m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:33:09.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (6m) 5m ago 15m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:33:09.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (5m) 5m ago 14m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:33:09.561 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (16m) 7m ago 17m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:33:09.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 msgr2=0x7f723c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 0x7f723c0672e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7244013690 tx=0x7f7244009b30).stop 2022-02-02T18:33:09.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 msgr2=0x7f7254107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f724800b410 tx=0x7f7248006ef0).stop 2022-02-02T18:33:09.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 shutdown_connections 2022-02-02T18:33:09.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f723c064e20 0x7f723c0672e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72540f6530 0x7f7254106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 --2- 172.21.15.96:0/559409796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72540f77d0 0x7f7254107310 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 >> 172.21.15.96:0/559409796 conn(0x7f72540f1c90 msgr2=0x7f72540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 shutdown_connections 2022-02-02T18:33:09.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.559+0000 7f725359e700 1 -- 172.21.15.96:0/559409796 wait complete. 2022-02-02T18:33:09.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1777111596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 msgr2=0x7ff3680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1777111596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff3680f6cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff350004660 tx=0x7ff350009b30).stop 2022-02-02T18:33:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1777111596 shutdown_connections 2022-02-02T18:33:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1777111596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff3680f6cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1777111596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 0x7ff3680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.656+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1777111596 >> 172.21.15.96:0/1777111596 conn(0x7ff3680f0d40 msgr2=0x7ff3680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.657+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1777111596 shutdown_connections 2022-02-02T18:33:09.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.657+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1777111596 wait complete. 2022-02-02T18:33:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.657+0000 7ff36e3e3700 1 Processor -- start 2022-02-02T18:33:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.657+0000 7ff36e3e3700 1 -- start start 2022-02-02T18:33:09.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff36e3e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 0x7ff368109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff36e3e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff36e3e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680603e0 con 0x7ff3680f6860 2022-02-02T18:33:09.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff36e3e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff368060520 con 0x7ff3680f55c0 2022-02-02T18:33:09.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54620/0 (socket says 172.21.15.96:54620) 2022-02-02T18:33:09.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 -- 172.21.15.96:0/1204521601 learned_addr learned my addr 172.21.15.96:0/1204521601 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:09.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff367fff700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 0x7ff368109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 -- 172.21.15.96:0/1204521601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 msgr2=0x7ff368109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 0x7ff368109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 -- 172.21.15.96:0/1204521601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350005040 con 0x7ff3680f6860 2022-02-02T18:33:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff3677fe700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff350009990 tx=0x7ff350009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff350018070 con 0x7ff3680f6860 2022-02-02T18:33:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff350007ca0 con 0x7ff3680f6860 2022-02-02T18:33:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36810c6a0 con 0x7ff3680f6860 2022-02-02T18:33:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.658+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff35001c620 con 0x7ff3680f6860 2022-02-02T18:33:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.659+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36810cc00 con 0x7ff3680f6860 2022-02-02T18:33:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.660+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff368045ad0 con 0x7ff3680f6860 2022-02-02T18:33:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.660+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff35001d960 con 0x7ff3680f6860 2022-02-02T18:33:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.660+0000 7ff364ff9700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 0x7ff354067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.660+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff350083820 con 0x7ff3680f6860 2022-02-02T18:33:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.660+0000 7ff367fff700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 0x7ff354067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.661+0000 7ff367fff700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 0x7ff354067290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff368060060 tx=0x7ff358009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.665+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff350051a40 con 0x7ff3680f6860 2022-02-02T18:33:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.893+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff3680fde20 con 0x7ff3680f6860 2022-02-02T18:33:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.893+0000 7ff364ff9700 1 -- 172.21.15.96:0/1204521601 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff350055060 con 0x7ff3680f6860 2022-02-02T18:33:09.892 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:33:09.893 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:33:09.893 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:33:09.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:09.893 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:33:09.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:33:09.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:09.894 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:33:09.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:33:09.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:09.895 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:33:09.895 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:33:09.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:09.896 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:33:09.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:33:09.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:33:09.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:33:09.896 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:33:09.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 msgr2=0x7ff354067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 0x7ff354067290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff368060060 tx=0x7ff358009040).stop 2022-02-02T18:33:09.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 msgr2=0x7ff36810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff350009990 tx=0x7ff350009b30).stop 2022-02-02T18:33:09.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 shutdown_connections 2022-02-02T18:33:09.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff354064dd0 0x7ff354067290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3680f55c0 0x7ff368109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 --2- 172.21.15.96:0/1204521601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3680f6860 0x7ff36810c150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 >> 172.21.15.96:0/1204521601 conn(0x7ff3680f0d40 msgr2=0x7ff3680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 shutdown_connections 2022-02-02T18:33:09.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.895+0000 7ff36e3e3700 1 -- 172.21.15.96:0/1204521601 wait complete. 2022-02-02T18:33:09.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 -- 172.21.15.96:0/2638141786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 msgr2=0x7fe2fc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 --2- 172.21.15.96:0/2638141786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc0f7de0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fe2ec004660 tx=0x7fe2ec009b30).stop 2022-02-02T18:33:09.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 -- 172.21.15.96:0/2638141786 shutdown_connections 2022-02-02T18:33:09.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 --2- 172.21.15.96:0/2638141786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc0f7de0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 --2- 172.21.15.96:0/2638141786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.992+0000 7fe30203d700 1 -- 172.21.15.96:0/2638141786 >> 172.21.15.96:0/2638141786 conn(0x7fe2fc0f1e40 msgr2=0x7fe2fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:09.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 -- 172.21.15.96:0/2638141786 shutdown_connections 2022-02-02T18:33:09.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 -- 172.21.15.96:0/2638141786 wait complete. 2022-02-02T18:33:09.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 Processor -- start 2022-02-02T18:33:09.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 -- start start 2022-02-02T18:33:09.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:09.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06a380 con 0x7fe2fc0f7980 2022-02-02T18:33:09.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.993+0000 7fe30203d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06a4c0 con 0x7fe2fc0f66e0 2022-02-02T18:33:09.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54630/0 (socket says 172.21.15.96:54630) 2022-02-02T18:33:09.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 -- 172.21.15.96:0/1935212951 learned_addr learned my addr 172.21.15.96:0/1935212951 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:09.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2fb7fe700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:09.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 -- 172.21.15.96:0/1935212951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 msgr2=0x7fe2fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:09.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:09.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 -- 172.21.15.96:0/1935212951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec005040 con 0x7fe2fc0f7980 2022-02-02T18:33:09.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2fb7fe700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:33:09.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2faffd700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe2ec009990 tx=0x7fe2ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:09.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec018070 con 0x7fe2fc0f7980 2022-02-02T18:33:09.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc06a740 con 0x7fe2fc0f7980 2022-02-02T18:33:10.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2ec007ca0 con 0x7fe2fc0f7980 2022-02-02T18:33:10.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec01c620 con 0x7fe2fc0f7980 2022-02-02T18:33:10.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.994+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc06aca0 con 0x7fe2fc0f7980 2022-02-02T18:33:10.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.996+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc045ad0 con 0x7fe2fc0f7980 2022-02-02T18:33:10.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.996+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2ec01d960 con 0x7fe2fc0f7980 2022-02-02T18:33:10.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.996+0000 7fe2e3fff700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 0x7fe2e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:10.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.996+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe2ec083820 con 0x7fe2fc0f7980 2022-02-02T18:33:10.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.996+0000 7fe2fb7fe700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 0x7fe2e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:10.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:09.997+0000 7fe2fb7fe700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 0x7fe2e4067290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe2f00041d0 tx=0x7fe2f0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:10.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.001+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2ec051a40 con 0x7fe2fc0f7980 2022-02-02T18:33:10.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.203+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2fc027a00 con 0x7fe2fc0f7980 2022-02-02T18:33:10.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.204+0000 7fe2e3fff700 1 -- 172.21.15.96:0/1935212951 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe2ec055060 con 0x7fe2fc0f7980 2022-02-02T18:33:10.203 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:33:10.203 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:33:10.204 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:33:10.204 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:33:10.204 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:10.204 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:33:10.205 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:33:10.205 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:33:10.205 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:33:10.205 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:33:10.205 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:33:10.206 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:33:10.206 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:33:10.206 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:33:10.206 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:33:10.207 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:33:10.207 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:33:10.207 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:33:10.207 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:33:10.208 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:33:10.208 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:33:10.208 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:33:10.208 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:33:10.208 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:33:10.209 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:33:10.209 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:33:10.209 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:33:10.209 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:33:10.210 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:33:10.210 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:33:10.210 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:33:10.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:33:10.210 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:10.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:10.211 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:33:10.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:10.211 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:10.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:10.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 msgr2=0x7fe2e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 0x7fe2e4067290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe2f00041d0 tx=0x7fe2f0009040).stop 2022-02-02T18:33:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 msgr2=0x7fe2fc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe2ec009990 tx=0x7fe2ec009b30).stop 2022-02-02T18:33:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 shutdown_connections 2022-02-02T18:33:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2e4064dd0 0x7fe2e4067290 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0f66e0 0x7fe2fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 --2- 172.21.15.96:0/1935212951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2fc0f7980 0x7fe2fc069e20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.205+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 >> 172.21.15.96:0/1935212951 conn(0x7fe2fc0f1e40 msgr2=0x7fe2fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.206+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 shutdown_connections 2022-02-02T18:33:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:10.206+0000 7fe30203d700 1 -- 172.21.15.96:0/1935212951 wait complete. 2022-02-02T18:33:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:33:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:10 smithi159 ceph-mon[69013]: pgmap v331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:10 smithi159 ceph-mon[69013]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1204521601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1935212951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:33:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:10 smithi096 ceph-mon[101353]: pgmap v331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:10 smithi096 ceph-mon[101353]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1204521601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1935212951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:33:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:11 smithi159 ceph-mon[69013]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:11 smithi096 ceph-mon[101353]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:12 smithi159 ceph-mon[69013]: pgmap v332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:12 smithi096 ceph-mon[101353]: pgmap v332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:14 smithi159 ceph-mon[69013]: pgmap v333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:14 smithi096 ceph-mon[101353]: pgmap v333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:16.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: pgmap v334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: pgmap v334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:16.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:17.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:17 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:17.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:17 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:17.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:17 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:17.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:17 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:18.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:18 smithi159 ceph-mon[69013]: pgmap v335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:18.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:18 smithi096 ceph-mon[101353]: pgmap v335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:20 smithi159 ceph-mon[69013]: pgmap v336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:20 smithi096 ceph-mon[101353]: pgmap v336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:22 smithi159 ceph-mon[69013]: pgmap v337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:22 smithi096 ceph-mon[101353]: pgmap v337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:24 smithi159 ceph-mon[69013]: pgmap v338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:24.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:24 smithi096 ceph-mon[101353]: pgmap v338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:26.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:26 smithi159 ceph-mon[69013]: pgmap v339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:26.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:26 smithi096 ceph-mon[101353]: pgmap v339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:26.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:33:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:33:27.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:27.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:27.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:27.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:33:27.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:33:28.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:28 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:28 smithi159 ceph-mon[69013]: pgmap v340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:28.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:28 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:28.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:28 smithi096 ceph-mon[101353]: pgmap v340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:30 smithi159 ceph-mon[69013]: pgmap v341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:30 smithi096 ceph-mon[101353]: pgmap v341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:32 smithi159 ceph-mon[69013]: pgmap v342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:32 smithi096 ceph-mon[101353]: pgmap v342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:34 smithi159 ceph-mon[69013]: pgmap v343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:34.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:34 smithi096 ceph-mon[101353]: pgmap v343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:36 smithi159 ceph-mon[69013]: pgmap v344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:36 smithi096 ceph-mon[101353]: pgmap v344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:37.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:33:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:37.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:37.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:33:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:33:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:38 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:38 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:38 smithi159 ceph-mon[69013]: pgmap v345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:38 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:38 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:38 smithi096 ceph-mon[101353]: pgmap v345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.312+0000 7f44dc991700 1 -- 172.21.15.96:0/3349105870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f77d0 msgr2=0x7f44d80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.312+0000 7f44dc991700 1 --2- 172.21.15.96:0/3349105870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f77d0 0x7f44d80f7c30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f44c0004660 tx=0x7f44c0009b30).stop 2022-02-02T18:33:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 -- 172.21.15.96:0/3349105870 shutdown_connections 2022-02-02T18:33:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 --2- 172.21.15.96:0/3349105870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f77d0 0x7f44d80f7c30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 --2- 172.21.15.96:0/3349105870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f6530 0x7f44d80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 -- 172.21.15.96:0/3349105870 >> 172.21.15.96:0/3349105870 conn(0x7f44d80f1c90 msgr2=0x7f44d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 -- 172.21.15.96:0/3349105870 shutdown_connections 2022-02-02T18:33:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.313+0000 7f44dc991700 1 -- 172.21.15.96:0/3349105870 wait complete. 2022-02-02T18:33:40.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 Processor -- start 2022-02-02T18:33:40.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 -- start start 2022-02-02T18:33:40.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f77d0 0x7f44d8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8107880 con 0x7f44d80f6530 2022-02-02T18:33:40.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44dc991700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8108090 con 0x7f44d80f77d0 2022-02-02T18:33:40.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54648/0 (socket says 172.21.15.96:54648) 2022-02-02T18:33:40.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d77fe700 1 -- 172.21.15.96:0/2618664924 learned_addr learned my addr 172.21.15.96:0/2618664924 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:40.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d6ffd700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f77d0 0x7f44d8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d77fe700 1 -- 172.21.15.96:0/2618664924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f77d0 msgr2=0x7f44d8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.314+0000 7f44d77fe700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f77d0 0x7f44d8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44d77fe700 1 -- 172.21.15.96:0/2618664924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0005040 con 0x7f44d80f6530 2022-02-02T18:33:40.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44d77fe700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f44c800c530 tx=0x7f44c8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c800f650 con 0x7f44d80f6530 2022-02-02T18:33:40.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d8108310 con 0x7f44d80f6530 2022-02-02T18:33:40.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f44c800fc60 con 0x7f44d80f6530 2022-02-02T18:33:40.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c8012d20 con 0x7f44d80f6530 2022-02-02T18:33:40.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.315+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d81088d0 con 0x7f44d80f6530 2022-02-02T18:33:40.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.316+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8059100 con 0x7f44d80f6530 2022-02-02T18:33:40.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.316+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f44c8019030 con 0x7f44d80f6530 2022-02-02T18:33:40.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.317+0000 7f44cffff700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 0x7f44c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.317+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f44c8081760 con 0x7f44d80f6530 2022-02-02T18:33:40.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.317+0000 7f44d6ffd700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 0x7f44c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.317+0000 7f44d6ffd700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 0x7f44c40672e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f44c0004e30 tx=0x7f44c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.321+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f44c804f860 con 0x7f44d80f6530 2022-02-02T18:33:40.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.500+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f44d80008d0 con 0x7f44c4064e20 2022-02-02T18:33:40.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.501+0000 7f44cffff700 1 -- 172.21.15.96:0/2618664924 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f44d80008d0 con 0x7f44c4064e20 2022-02-02T18:33:40.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 msgr2=0x7f44c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 0x7f44c40672e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f44c0004e30 tx=0x7f44c0009b30).stop 2022-02-02T18:33:40.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 msgr2=0x7f44d8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f44c800c530 tx=0x7f44c8007e10).stop 2022-02-02T18:33:40.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 shutdown_connections 2022-02-02T18:33:40.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44c4064e20 0x7f44c40672e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44d80f6530 0x7f44d8106d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 --2- 172.21.15.96:0/2618664924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44d80f77d0 0x7f44d8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 >> 172.21.15.96:0/2618664924 conn(0x7f44d80f1c90 msgr2=0x7f44d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:40.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 shutdown_connections 2022-02-02T18:33:40.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.503+0000 7f44dc991700 1 -- 172.21.15.96:0/2618664924 wait complete. 2022-02-02T18:33:40.512 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:33:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 -- 172.21.15.96:0/3580134361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 msgr2=0x7f96e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 --2- 172.21.15.96:0/3580134361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e40f7c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f96d8004660 tx=0x7f96d8009b30).stop 2022-02-02T18:33:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 -- 172.21.15.96:0/3580134361 shutdown_connections 2022-02-02T18:33:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 --2- 172.21.15.96:0/3580134361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e40f7c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 --2- 172.21.15.96:0/3580134361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:33:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 -- 172.21.15.96:0/3580134361 >> 172.21.15.96:0/3580134361 conn(0x7f96e40f1c90 msgr2=0x7f96e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:40.602 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:40 smithi096 ceph-mon[101353]: pgmap v346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.600+0000 7f96e8f30700 1 -- 172.21.15.96:0/3580134361 shutdown_connections 2022-02-02T18:33:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.601+0000 7f96e8f30700 1 -- 172.21.15.96:0/3580134361 wait complete. 2022-02-02T18:33:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.601+0000 7f96e8f30700 1 Processor -- start 2022-02-02T18:33:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.601+0000 7f96e8f30700 1 -- start start 2022-02-02T18:33:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e8f30700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e4106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e8f30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e8f30700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4107980 con 0x7f96e40f77d0 2022-02-02T18:33:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e8f30700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4108100 con 0x7f96e40f6530 2022-02-02T18:33:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54660/0 (socket says 172.21.15.96:54660) 2022-02-02T18:33:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 -- 172.21.15.96:0/2267049420 learned_addr learned my addr 172.21.15.96:0/2267049420 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e37fe700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e4106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 -- 172.21.15.96:0/2267049420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 msgr2=0x7f96e4106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e4106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 -- 172.21.15.96:0/2267049420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8005040 con 0x7f96e40f77d0 2022-02-02T18:33:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e37fe700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e4106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:33:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e2ffd700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f96d8009990 tx=0x7f96d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d8018070 con 0x7f96e40f77d0 2022-02-02T18:33:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f96d8007ca0 con 0x7f96e40f77d0 2022-02-02T18:33:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d801c620 con 0x7f96e40f77d0 2022-02-02T18:33:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.602+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e4108320 con 0x7f96e40f77d0 2022-02-02T18:33:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.603+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e4108880 con 0x7f96e40f77d0 2022-02-02T18:33:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.603+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e4045ad0 con 0x7f96e40f77d0 2022-02-02T18:33:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.604+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f96d801d960 con 0x7f96e40f77d0 2022-02-02T18:33:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.604+0000 7f96cbfff700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 0x7f96cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.604+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f96d8083760 con 0x7f96e40f77d0 2022-02-02T18:33:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.604+0000 7f96e37fe700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 0x7f96cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.605+0000 7f96e37fe700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 0x7f96cc0672e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f96e4106b70 tx=0x7f96d4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.609+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f96d80518d0 con 0x7f96e40f77d0 2022-02-02T18:33:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:40 smithi159 ceph-mon[69013]: pgmap v346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:40.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.780+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f96e40fef40 con 0x7f96cc064e20 2022-02-02T18:33:40.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.790+0000 7f96cbfff700 1 -- 172.21.15.96:0/2267049420 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f96d400b450 con 0x7f96cc064e20 2022-02-02T18:33:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:33:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (17m) 7m ago 18m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:33:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (9m) 7m ago 18m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:33:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (9m) 6m ago 17m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:33:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (16m) 7m ago 17m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:33:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (14m) 7m ago 14m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:33:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (9m) 7m ago 14m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:33:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (14m) 6m ago 14m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:33:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (10m) 6m ago 14m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:33:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (11m) 7m ago 19m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:33:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (10m) 6m ago 17m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:33:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (10m) 7m ago 19m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:33:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (10m) 6m ago 17m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:33:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (17m) 7m ago 17m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:33:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (17m) 6m ago 17m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:33:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (9m) 7m ago 16m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:33:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (8m) 7m ago 16m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:33:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (8m) 7m ago 16m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:33:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (7m) 6m ago 16m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:33:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (6m) 6m ago 15m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:33:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (6m) 6m ago 15m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:33:40.795 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (16m) 7m ago 17m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:33:40.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.791+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 msgr2=0x7f96cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.791+0000 7f96e8f30700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 0x7f96cc0672e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f96e4106b70 tx=0x7f96d4008040).stop 2022-02-02T18:33:40.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 msgr2=0x7f96e41072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f96d8009990 tx=0x7f96d8009b30).stop 2022-02-02T18:33:40.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 shutdown_connections 2022-02-02T18:33:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064e20 0x7f96cc0672e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f6530 0x7f96e4106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 --2- 172.21.15.96:0/2267049420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f77d0 0x7f96e41072f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 >> 172.21.15.96:0/2267049420 conn(0x7f96e40f1c90 msgr2=0x7f96e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 shutdown_connections 2022-02-02T18:33:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.792+0000 7f96e8f30700 1 -- 172.21.15.96:0/2267049420 wait complete. 2022-02-02T18:33:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 -- 172.21.15.96:0/1005338185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 msgr2=0x7f1be80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1005338185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be80f7c30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f1bd8004660 tx=0x7f1bd8009b30).stop 2022-02-02T18:33:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 -- 172.21.15.96:0/1005338185 shutdown_connections 2022-02-02T18:33:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1005338185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be80f7c30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1005338185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 0x7f1be80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 -- 172.21.15.96:0/1005338185 >> 172.21.15.96:0/1005338185 conn(0x7f1be80f1c90 msgr2=0x7f1be80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 -- 172.21.15.96:0/1005338185 shutdown_connections 2022-02-02T18:33:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.889+0000 7f1bee62a700 1 -- 172.21.15.96:0/1005338185 wait complete. 2022-02-02T18:33:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 Processor -- start 2022-02-02T18:33:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 -- start start 2022-02-02T18:33:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 0x7f1be8106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be81077f0 con 0x7f1be80f77d0 2022-02-02T18:33:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bee62a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8107ff0 con 0x7f1be80f6530 2022-02-02T18:33:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bece27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bece27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54670/0 (socket says 172.21.15.96:54670) 2022-02-02T18:33:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.890+0000 7f1bece27700 1 -- 172.21.15.96:0/1317310304 learned_addr learned my addr 172.21.15.96:0/1317310304 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bed628700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 0x7f1be8106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bece27700 1 -- 172.21.15.96:0/1317310304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 msgr2=0x7f1be8106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bece27700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 0x7f1be8106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bece27700 1 -- 172.21.15.96:0/1317310304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8005040 con 0x7f1be80f77d0 2022-02-02T18:33:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bece27700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1bd8009990 tx=0x7f1bd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd8018070 con 0x7f1be80f77d0 2022-02-02T18:33:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1bd8007ca0 con 0x7f1be80f77d0 2022-02-02T18:33:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd801c620 con 0x7f1be80f77d0 2022-02-02T18:33:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be8108270 con 0x7f1be80f77d0 2022-02-02T18:33:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.891+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be81087d0 con 0x7f1be80f77d0 2022-02-02T18:33:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.892+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be8059100 con 0x7f1be80f77d0 2022-02-02T18:33:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.893+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1bd801d960 con 0x7f1be80f77d0 2022-02-02T18:33:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.893+0000 7f1bddffb700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 0x7f1bd40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.893+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1bd8083840 con 0x7f1be80f77d0 2022-02-02T18:33:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.893+0000 7f1bed628700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 0x7f1bd40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.894+0000 7f1bed628700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 0x7f1bd40672e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1be80f7630 tx=0x7f1be4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:40.898+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1bd8055260 con 0x7f1be80f77d0 2022-02-02T18:33:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.126+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1be80fecf0 con 0x7f1be80f77d0 2022-02-02T18:33:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.127+0000 7f1bddffb700 1 -- 172.21.15.96:0/1317310304 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1bd8054e50 con 0x7f1be80f77d0 2022-02-02T18:33:41.128 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:33:41.128 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:33:41.129 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:33:41.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:41.130 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:33:41.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:33:41.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:41.131 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:33:41.132 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:33:41.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:41.132 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:33:41.133 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:33:41.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:33:41.134 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:33:41.134 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:33:41.135 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:33:41.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:33:41.135 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:33:41.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.129+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 msgr2=0x7f1bd40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.129+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 0x7f1bd40672e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1be80f7630 tx=0x7f1be4009040).stop 2022-02-02T18:33:41.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.129+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 msgr2=0x7f1be8107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.129+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1bd8009990 tx=0x7f1bd8009b30).stop 2022-02-02T18:33:41.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 shutdown_connections 2022-02-02T18:33:41.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bd4064e20 0x7f1bd40672e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80f6530 0x7f1be8106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 --2- 172.21.15.96:0/1317310304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1be80f77d0 0x7f1be8107240 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 >> 172.21.15.96:0/1317310304 conn(0x7f1be80f1c90 msgr2=0x7f1be80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 shutdown_connections 2022-02-02T18:33:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.130+0000 7f1bee62a700 1 -- 172.21.15.96:0/1317310304 wait complete. 2022-02-02T18:33:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 -- 172.21.15.96:0/1090499200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f66e0 msgr2=0x7f0aa80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/1090499200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f66e0 0x7f0aa80f6b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f0a98004660 tx=0x7f0a98009b30).stop 2022-02-02T18:33:41.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 -- 172.21.15.96:0/1090499200 shutdown_connections 2022-02-02T18:33:41.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/1090499200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f7980 0x7f0aa80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:33:41.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/1090499200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f66e0 0x7f0aa80f6b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 -- 172.21.15.96:0/1090499200 >> 172.21.15.96:0/1090499200 conn(0x7f0aa80f1e40 msgr2=0x7f0aa80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 -- 172.21.15.96:0/1090499200 shutdown_connections 2022-02-02T18:33:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.227+0000 7f0aaff7b700 1 -- 172.21.15.96:0/1090499200 wait complete. 2022-02-02T18:33:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 Processor -- start 2022-02-02T18:33:41.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 -- start start 2022-02-02T18:33:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f66e0 0x7f0aa806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa806a410 con 0x7f0aa80f7980 2022-02-02T18:33:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aaff7b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa806a550 con 0x7f0aa80f66e0 2022-02-02T18:33:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aad516700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aad516700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54680/0 (socket says 172.21.15.96:54680) 2022-02-02T18:33:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.228+0000 7f0aad516700 1 -- 172.21.15.96:0/3417504120 learned_addr learned my addr 172.21.15.96:0/3417504120 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:33:41.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aadd17700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f66e0 0x7f0aa806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aad516700 1 -- 172.21.15.96:0/3417504120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f66e0 msgr2=0x7f0aa806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aad516700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f66e0 0x7f0aa806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aad516700 1 -- 172.21.15.96:0/3417504120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98005040 con 0x7f0aa80f7980 2022-02-02T18:33:41.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aad516700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0aa400b410 tx=0x7f0aa4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:41.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa40125f0 con 0x7f0aa80f7980 2022-02-02T18:33:41.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0aa400be30 con 0x7f0aa80f7980 2022-02-02T18:33:41.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa806a830 con 0x7f0aa80f7980 2022-02-02T18:33:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa4002a70 con 0x7f0aa80f7980 2022-02-02T18:33:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.229+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa810efe0 con 0x7f0aa80f7980 2022-02-02T18:33:41.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.230+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8045ad0 con 0x7f0aa80f7980 2022-02-02T18:33:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.231+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0aa400f030 con 0x7f0aa80f7980 2022-02-02T18:33:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.231+0000 7f0a9e7fc700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 0x7f0a94067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:33:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.231+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0aa4081ec0 con 0x7f0aa80f7980 2022-02-02T18:33:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.231+0000 7f0aadd17700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 0x7f0a94067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:33:41.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.232+0000 7f0aadd17700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 0x7f0a94067270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0aa806b730 tx=0x7f0a98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:33:41.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.237+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0aa404ff70 con 0x7f0aa80f7980 2022-02-02T18:33:41.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.434+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0aa8027a00 con 0x7f0aa80f7980 2022-02-02T18:33:41.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.435+0000 7f0a9e7fc700 1 -- 172.21.15.96:0/3417504120 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0aa4053590 con 0x7f0aa80f7980 2022-02-02T18:33:41.435 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:33:41.435 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:33:41.435 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:33:41.436 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:33:41.436 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:41.436 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:33:41.437 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:33:41.437 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:33:41.437 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:33:41.437 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:33:41.437 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:33:41.438 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:33:41.438 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:33:41.438 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:33:41.438 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:33:41.439 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:33:41.439 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:33:41.439 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:33:41.439 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:33:41.439 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:33:41.440 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:33:41.440 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:33:41.440 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:33:41.440 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:33:41.441 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:33:41.441 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:33:41.441 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:33:41.441 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:33:41.441 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:33:41.442 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:33:41.442 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:33:41.442 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:33:41.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:41.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:41.443 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:33:41.444 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:33:41.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:41.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:41.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:33:41.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 msgr2=0x7f0a94067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 0x7f0a94067270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0aa806b730 tx=0x7f0a98009b30).stop 2022-02-02T18:33:41.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 msgr2=0x7f0aa8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:33:41.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0aa400b410 tx=0x7f0aa4006ef0).stop 2022-02-02T18:33:41.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 shutdown_connections 2022-02-02T18:33:41.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a94064db0 0x7f0a94067270 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0aa80f66e0 0x7f0aa806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 --2- 172.21.15.96:0/3417504120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80f7980 0x7f0aa8069e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:33:41.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 >> 172.21.15.96:0/3417504120 conn(0x7f0aa80f1e40 msgr2=0x7f0aa80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:33:41.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 shutdown_connections 2022-02-02T18:33:41.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:33:41.437+0000 7f0aaff7b700 1 -- 172.21.15.96:0/3417504120 wait complete. 2022-02-02T18:33:41.448 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:33:41.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1317310304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1317310304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:42 smithi159 ceph-mon[69013]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:42 smithi159 ceph-mon[69013]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:42 smithi159 ceph-mon[69013]: pgmap v347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3417504120' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:33:42.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:42 smithi096 ceph-mon[101353]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:42 smithi096 ceph-mon[101353]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:33:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:42 smithi096 ceph-mon[101353]: pgmap v347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:42.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3417504120' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:33:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:44 smithi159 ceph-mon[69013]: pgmap v348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:44 smithi096 ceph-mon[101353]: pgmap v348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:46 smithi159 ceph-mon[69013]: pgmap v349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:46 smithi096 ceph-mon[101353]: pgmap v349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:47.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:48 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:48 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:48 smithi159 ceph-mon[69013]: pgmap v350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:48.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:48 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:48.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:48 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:48 smithi096 ceph-mon[101353]: pgmap v350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:50 smithi159 ceph-mon[69013]: pgmap v351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:50 smithi096 ceph-mon[101353]: pgmap v351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:52 smithi159 ceph-mon[69013]: pgmap v352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:52 smithi096 ceph-mon[101353]: pgmap v352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:54 smithi159 ceph-mon[69013]: pgmap v353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:54 smithi096 ceph-mon[101353]: pgmap v353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:56 smithi159 ceph-mon[69013]: pgmap v354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:56 smithi096 ceph-mon[101353]: pgmap v354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:57.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:57.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:57.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:33:57.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:33:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:33:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:33:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:57.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:33:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:58 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:58 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:33:58 smithi159 ceph-mon[69013]: pgmap v355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:33:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:58 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:33:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:58 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:33:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:33:58 smithi096 ceph-mon[101353]: pgmap v355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:00 smithi159 ceph-mon[69013]: pgmap v356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:00 smithi096 ceph-mon[101353]: pgmap v356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:02 smithi159 ceph-mon[69013]: pgmap v357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:02 smithi096 ceph-mon[101353]: pgmap v357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:03 smithi159 ceph-mon[69013]: pgmap v358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:03.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:03 smithi096 ceph-mon[101353]: pgmap v358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:06.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:06 smithi159 ceph-mon[69013]: pgmap v359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:06.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:06 smithi096 ceph-mon[101353]: pgmap v359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:07.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:07.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:07.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:07.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:07.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:07.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:07.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:08.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:08 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:08.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:08 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:08 smithi159 ceph-mon[69013]: pgmap v360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:08.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:08 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:08.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:08 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:08 smithi096 ceph-mon[101353]: pgmap v360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:10.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:10 smithi159 ceph-mon[69013]: pgmap v361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:10.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:10 smithi096 ceph-mon[101353]: pgmap v361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 -- 172.21.15.96:0/3708782538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f55c0 msgr2=0x7f07200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 --2- 172.21.15.96:0/3708782538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f55c0 0x7f07200f59e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f0710004660 tx=0x7f0710009b30).stop 2022-02-02T18:34:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 -- 172.21.15.96:0/3708782538 shutdown_connections 2022-02-02T18:34:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 --2- 172.21.15.96:0/3708782538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f6860 0x7f07200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 --2- 172.21.15.96:0/3708782538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f55c0 0x7f07200f59e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 -- 172.21.15.96:0/3708782538 >> 172.21.15.96:0/3708782538 conn(0x7f07200f0d40 msgr2=0x7f07200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 -- 172.21.15.96:0/3708782538 shutdown_connections 2022-02-02T18:34:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.548+0000 7f07277b3700 1 -- 172.21.15.96:0/3708782538 wait complete. 2022-02-02T18:34:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 Processor -- start 2022-02-02T18:34:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 -- start start 2022-02-02T18:34:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 0x7f0720105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720106910 con 0x7f07200f6860 2022-02-02T18:34:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f07277b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720106a50 con 0x7f07200f55c0 2022-02-02T18:34:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54700/0 (socket says 172.21.15.96:54700) 2022-02-02T18:34:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 -- 172.21.15.96:0/3289860105 learned_addr learned my addr 172.21.15.96:0/3289860105 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f072554f700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 0x7f0720105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 -- 172.21.15.96:0/3289860105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 msgr2=0x7f0720105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 0x7f0720105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 -- 172.21.15.96:0/3289860105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0710005040 con 0x7f07200f6860 2022-02-02T18:34:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f072554f700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 0x7f0720105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:34:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.549+0000 7f0724d4e700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f071c00c530 tx=0x7f071c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.550+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c00f650 con 0x7f07200f6860 2022-02-02T18:34:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.550+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f071c00fc60 con 0x7f07200f6860 2022-02-02T18:34:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.550+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07201073f0 con 0x7f07200f6860 2022-02-02T18:34:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.550+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c012cd0 con 0x7f07200f6860 2022-02-02T18:34:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.550+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07201079b0 con 0x7f07200f6860 2022-02-02T18:34:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.551+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720045ad0 con 0x7f07200f6860 2022-02-02T18:34:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.552+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f071c010070 con 0x7f07200f6860 2022-02-02T18:34:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.552+0000 7f0715ffb700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.552+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f071c082030 con 0x7f07200f6860 2022-02-02T18:34:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.552+0000 7f072554f700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.553+0000 7f072554f700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0710004e30 tx=0x7f0710009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.556+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f071c053b10 con 0x7f07200f6860 2022-02-02T18:34:11.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.735+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0720107bd0 con 0x7f070c064dd0 2022-02-02T18:34:11.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.736+0000 7f0715ffb700 1 -- 172.21.15.96:0/3289860105 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0720107bd0 con 0x7f070c064dd0 2022-02-02T18:34:11.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 msgr2=0x7f070c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0710004e30 tx=0x7f0710009b30).stop 2022-02-02T18:34:11.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 msgr2=0x7f0720106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f071c00c530 tx=0x7f071c007e20).stop 2022-02-02T18:34:11.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 shutdown_connections 2022-02-02T18:34:11.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f070c064dd0 0x7f070c067290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07200f55c0 0x7f0720105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 --2- 172.21.15.96:0/3289860105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200f6860 0x7f0720106360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 >> 172.21.15.96:0/3289860105 conn(0x7f07200f0d40 msgr2=0x7f07200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:11.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 shutdown_connections 2022-02-02T18:34:11.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.738+0000 7f07277b3700 1 -- 172.21.15.96:0/3289860105 wait complete. 2022-02-02T18:34:11.747 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:34:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 -- 172.21.15.96:0/3406262412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 msgr2=0x7f4f8c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/3406262412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c0f6b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f4f80004660 tx=0x7f4f80009b30).stop 2022-02-02T18:34:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 -- 172.21.15.96:0/3406262412 shutdown_connections 2022-02-02T18:34:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/3406262412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c0f6b30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/3406262412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 0x7f4f8c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 -- 172.21.15.96:0/3406262412 >> 172.21.15.96:0/3406262412 conn(0x7f4f8c0f0b90 msgr2=0x7f4f8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:11.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 -- 172.21.15.96:0/3406262412 shutdown_connections 2022-02-02T18:34:11.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.836+0000 7f4f90bbc700 1 -- 172.21.15.96:0/3406262412 wait complete. 2022-02-02T18:34:11.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.837+0000 7f4f90bbc700 1 Processor -- start 2022-02-02T18:34:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.837+0000 7f4f90bbc700 1 -- start start 2022-02-02T18:34:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.837+0000 7f4f90bbc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 0x7f4f8c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.837+0000 7f4f90bbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.837+0000 7f4f90bbc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c106760 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f90bbc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c106f60 con 0x7f4f8c0f5430 2022-02-02T18:34:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54710/0 (socket says 172.21.15.96:54710) 2022-02-02T18:34:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 -- 172.21.15.96:0/2122642581 learned_addr learned my addr 172.21.15.96:0/2122642581 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8b7fe700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 0x7f4f8c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 -- 172.21.15.96:0/2122642581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 msgr2=0x7f4f8c105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 0x7f4f8c105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 -- 172.21.15.96:0/2122642581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80005040 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f8affd700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4f80009990 tx=0x7f4f80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f80018070 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f80007ba0 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c1071e0 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8001c3c0 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.838+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c107740 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.839+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c059100 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.840+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f8001d420 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.840+0000 7f4f73fff700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.840+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f80083790 con 0x7f4f8c0f66d0 2022-02-02T18:34:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.840+0000 7f4f8b7fe700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.840+0000 7f4f8b7fe700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4f8c0f6530 tx=0x7f4f7c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:11.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:11.844+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f800552d0 con 0x7f4f8c0f66d0 2022-02-02T18:34:12.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.014+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8c0fdc60 con 0x7f4f74064e20 2022-02-02T18:34:12.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.024+0000 7f4f73fff700 1 -- 172.21.15.96:0/2122642581 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4f8c0fdc60 con 0x7f4f74064e20 2022-02-02T18:34:12.024 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:34:12.025 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (17m) 8m ago 18m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:34:12.025 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (10m) 8m ago 18m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:34:12.025 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (9m) 6m ago 18m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:34:12.026 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (17m) 8m ago 18m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:34:12.026 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (14m) 8m ago 14m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:34:12.027 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (10m) 8m ago 14m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:34:12.027 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (14m) 6m ago 14m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:34:12.028 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (10m) 6m ago 14m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:34:12.028 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (11m) 8m ago 19m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:34:12.028 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (11m) 6m ago 18m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:34:12.029 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (10m) 8m ago 19m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:34:12.029 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (10m) 6m ago 18m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:34:12.030 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (18m) 8m ago 18m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:34:12.030 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (17m) 6m ago 17m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:34:12.031 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (9m) 8m ago 17m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:34:12.031 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (9m) 8m ago 17m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:34:12.032 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (8m) 8m ago 16m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:34:12.032 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (7m) 6m ago 16m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:34:12.032 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (7m) 6m ago 16m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:34:12.033 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (6m) 6m ago 15m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:34:12.033 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (17m) 8m ago 18m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:34:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 msgr2=0x7f4f740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4f8c0f6530 tx=0x7f4f7c00b040).stop 2022-02-02T18:34:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 msgr2=0x7f4f8c1061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4f80009990 tx=0x7f4f80009b30).stop 2022-02-02T18:34:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 shutdown_connections 2022-02-02T18:34:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f5430 0x7f4f8c105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 --2- 172.21.15.96:0/2122642581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f66d0 0x7f4f8c1061b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 >> 172.21.15.96:0/2122642581 conn(0x7f4f8c0f0b90 msgr2=0x7f4f8c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 shutdown_connections 2022-02-02T18:34:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.026+0000 7f4f90bbc700 1 -- 172.21.15.96:0/2122642581 wait complete. 2022-02-02T18:34:12.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 -- 172.21.15.96:0/2573056765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 msgr2=0x7f91100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 --2- 172.21.15.96:0/2573056765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f91100f59e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9100004660 tx=0x7f9100009b30).stop 2022-02-02T18:34:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 -- 172.21.15.96:0/2573056765 shutdown_connections 2022-02-02T18:34:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 --2- 172.21.15.96:0/2573056765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 0x7f91100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:34:12.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 --2- 172.21.15.96:0/2573056765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f91100f59e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 -- 172.21.15.96:0/2573056765 >> 172.21.15.96:0/2573056765 conn(0x7f91100f0d40 msgr2=0x7f91100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:12.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 -- 172.21.15.96:0/2573056765 shutdown_connections 2022-02-02T18:34:12.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 -- 172.21.15.96:0/2573056765 wait complete. 2022-02-02T18:34:12.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.124+0000 7f911814c700 1 Processor -- start 2022-02-02T18:34:12.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f911814c700 1 -- start start 2022-02-02T18:34:12.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f911814c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f911814c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 0x7f91101063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f911814c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101069f0 con 0x7f91100f55c0 2022-02-02T18:34:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f911814c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101072a0 con 0x7f91100f6860 2022-02-02T18:34:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54716/0 (socket says 172.21.15.96:54716) 2022-02-02T18:34:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 -- 172.21.15.96:0/3505286785 learned_addr learned my addr 172.21.15.96:0/3505286785 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f91156e7700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 0x7f91101063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 -- 172.21.15.96:0/3505286785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 msgr2=0x7f91101063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 0x7f91101063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 -- 172.21.15.96:0/3505286785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100005040 con 0x7f91100f55c0 2022-02-02T18:34:12.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.125+0000 7f9115ee8700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9100004f60 tx=0x7f9100009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:12.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.126+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9100018070 con 0x7f91100f55c0 2022-02-02T18:34:12.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.126+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9100007ba0 con 0x7f91100f55c0 2022-02-02T18:34:12.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.126+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9110107520 con 0x7f91100f55c0 2022-02-02T18:34:12.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.126+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910001c620 con 0x7f91100f55c0 2022-02-02T18:34:12.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.126+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9110107a80 con 0x7f91100f55c0 2022-02-02T18:34:12.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.127+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91100f49b0 con 0x7f91100f55c0 2022-02-02T18:34:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.127+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f910001d420 con 0x7f91100f55c0 2022-02-02T18:34:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.128+0000 7f91067fc700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.128+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f91000839c0 con 0x7f91100f55c0 2022-02-02T18:34:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.128+0000 7f91156e7700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.128+0000 7f91156e7700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f910c00b790 tx=0x7f910c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:12.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.132+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9100055560 con 0x7f91100f55c0 2022-02-02T18:34:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.367+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9110027a00 con 0x7f91100f55c0 2022-02-02T18:34:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.367+0000 7f91067fc700 1 -- 172.21.15.96:0/3505286785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9100055150 con 0x7f91100f55c0 2022-02-02T18:34:12.368 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:34:12.369 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:34:12.369 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:34:12.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:12.370 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:34:12.370 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:34:12.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:12.371 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:34:12.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:34:12.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:12.372 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:34:12.372 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:34:12.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:12.373 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:34:12.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:34:12.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:34:12.373 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:34:12.374 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:34:12.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 msgr2=0x7f90fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f910c00b790 tx=0x7f910c008040).stop 2022-02-02T18:34:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 msgr2=0x7f9110105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9100004f60 tx=0x7f9100009b30).stop 2022-02-02T18:34:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 shutdown_connections 2022-02-02T18:34:12.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91100f55c0 0x7f9110105ec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 --2- 172.21.15.96:0/3505286785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91100f6860 0x7f91101063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 >> 172.21.15.96:0/3505286785 conn(0x7f91100f0d40 msgr2=0x7f91100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:12.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 shutdown_connections 2022-02-02T18:34:12.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.369+0000 7f911814c700 1 -- 172.21.15.96:0/3505286785 wait complete. 2022-02-02T18:34:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 -- 172.21.15.96:0/120099619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f7980 msgr2=0x7fb3700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 --2- 172.21.15.96:0/120099619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f7980 0x7fb3700f7de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb35c004660 tx=0x7fb35c009b30).stop 2022-02-02T18:34:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 -- 172.21.15.96:0/120099619 shutdown_connections 2022-02-02T18:34:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 --2- 172.21.15.96:0/120099619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f7980 0x7fb3700f7de0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 --2- 172.21.15.96:0/120099619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f66e0 0x7fb3700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 -- 172.21.15.96:0/120099619 >> 172.21.15.96:0/120099619 conn(0x7fb3700f1e40 msgr2=0x7fb3700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 -- 172.21.15.96:0/120099619 shutdown_connections 2022-02-02T18:34:12.469 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:12 smithi096 ceph-mon[101353]: pgmap v362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:12.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.467+0000 7fb376c63700 1 -- 172.21.15.96:0/120099619 wait complete. 2022-02-02T18:34:12.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 Processor -- start 2022-02-02T18:34:12.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 -- start start 2022-02-02T18:34:12.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f7980 0x7fb370069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37006a380 con 0x7fb3700f66e0 2022-02-02T18:34:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.468+0000 7fb376c63700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37006a4c0 con 0x7fb3700f7980 2022-02-02T18:34:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54726/0 (socket says 172.21.15.96:54726) 2022-02-02T18:34:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 -- 172.21.15.96:0/1046096293 learned_addr learned my addr 172.21.15.96:0/1046096293 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb36ffff700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f7980 0x7fb370069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 -- 172.21.15.96:0/1046096293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f7980 msgr2=0x7fb370069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f7980 0x7fb370069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 -- 172.21.15.96:0/1046096293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c005040 con 0x7fb3700f66e0 2022-02-02T18:34:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb3749ff700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb36400c530 tx=0x7fb364007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb36400f650 con 0x7fb3700f66e0 2022-02-02T18:34:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb36400fc60 con 0x7fb3700f66e0 2022-02-02T18:34:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb364012d20 con 0x7fb3700f66e0 2022-02-02T18:34:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.469+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37006a7a0 con 0x7fb3700f66e0 2022-02-02T18:34:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.470+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37010ef90 con 0x7fb3700f66e0 2022-02-02T18:34:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.471+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370045ad0 con 0x7fb3700f66e0 2022-02-02T18:34:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.471+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb364019030 con 0x7fb3700f66e0 2022-02-02T18:34:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.472+0000 7fb36d7fa700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 0x7fb360067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.472+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb364081660 con 0x7fb3700f66e0 2022-02-02T18:34:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.472+0000 7fb36ffff700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 0x7fb360067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.472+0000 7fb36ffff700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 0x7fb360067290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb35c004e30 tx=0x7fb35c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:12.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.476+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb36404f760 con 0x7fb3700f66e0 2022-02-02T18:34:12.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:12 smithi159 ceph-mon[69013]: pgmap v362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.677+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3700fef70 con 0x7fb3700f66e0 2022-02-02T18:34:12.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.678+0000 7fb36d7fa700 1 -- 172.21.15.96:0/1046096293 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb364052d80 con 0x7fb3700f66e0 2022-02-02T18:34:12.678 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:34:12.678 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:34:12.678 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:34:12.678 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:34:12.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:12.679 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:34:12.679 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:34:12.679 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:34:12.679 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:34:12.680 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:34:12.680 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:34:12.680 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:34:12.680 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:34:12.680 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:34:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:34:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:34:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:34:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:34:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:34:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:34:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:34:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:34:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:34:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:34:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:34:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:34:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:34:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:34:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:34:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:34:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:34:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:34:12.685 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:12.685 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:12.685 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:34:12.685 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:12.686 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:12.686 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:12.686 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 msgr2=0x7fb360067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 0x7fb360067290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb35c004e30 tx=0x7fb35c009b30).stop 2022-02-02T18:34:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 msgr2=0x7fb37006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb36400c530 tx=0x7fb364007e10).stop 2022-02-02T18:34:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 shutdown_connections 2022-02-02T18:34:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb360064dd0 0x7fb360067290 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3700f66e0 0x7fb37006b9a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 --2- 172.21.15.96:0/1046096293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3700f7980 0x7fb370069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 >> 172.21.15.96:0/1046096293 conn(0x7fb3700f1e40 msgr2=0x7fb3700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.679+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 shutdown_connections 2022-02-02T18:34:12.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:12.680+0000 7fb376c63700 1 -- 172.21.15.96:0/1046096293 wait complete. 2022-02-02T18:34:12.690 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:34:13.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:13 smithi159 ceph-mon[69013]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:13.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:13 smithi159 ceph-mon[69013]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:13.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3505286785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1046096293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:34:13.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:13 smithi096 ceph-mon[101353]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:13.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:13 smithi096 ceph-mon[101353]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3505286785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1046096293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:34:14.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:14 smithi159 ceph-mon[69013]: pgmap v363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:14.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:14 smithi096 ceph-mon[101353]: pgmap v363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:16.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:16 smithi159 ceph-mon[69013]: pgmap v364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:16.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:16 smithi096 ceph-mon[101353]: pgmap v364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:17.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:17.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:18.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:18 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:18.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:18 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:18 smithi159 ceph-mon[69013]: pgmap v365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:18 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:18 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:18 smithi096 ceph-mon[101353]: pgmap v365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:20 smithi159 ceph-mon[69013]: pgmap v366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:20.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:20 smithi096 ceph-mon[101353]: pgmap v366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:22.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:22 smithi159 ceph-mon[69013]: pgmap v367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:22.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:22 smithi096 ceph-mon[101353]: pgmap v367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:24 smithi159 ceph-mon[69013]: pgmap v368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:24.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:24 smithi096 ceph-mon[101353]: pgmap v368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:26.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:26 smithi159 ceph-mon[69013]: pgmap v369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:26.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:26 smithi096 ceph-mon[101353]: pgmap v369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:27.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:27.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:27.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:27.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:34:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:34:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:27.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:27.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:27.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:34:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:34:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:28.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:28 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:28 smithi159 ceph-mon[69013]: pgmap v370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:28 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:28 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:28 smithi096 ceph-mon[101353]: pgmap v370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:28 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:30.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:30 smithi159 ceph-mon[69013]: pgmap v371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:30 smithi096 ceph-mon[101353]: pgmap v371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:32.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:32 smithi159 ceph-mon[69013]: pgmap v372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:32.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:32 smithi096 ceph-mon[101353]: pgmap v372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:34.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:34 smithi159 ceph-mon[69013]: pgmap v373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:34.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:34 smithi096 ceph-mon[101353]: pgmap v373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:36.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:36 smithi159 ceph-mon[69013]: pgmap v374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:36.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:36 smithi096 ceph-mon[101353]: pgmap v374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:37.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:37.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:37.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:37.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:38.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:38 smithi159 ceph-mon[69013]: pgmap v375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:38.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:38 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:38 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:38.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:38 smithi096 ceph-mon[101353]: pgmap v375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:38.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:38 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:38 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:40 smithi096 ceph-mon[101353]: pgmap v376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:40 smithi159 ceph-mon[69013]: pgmap v376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:42 smithi096 ceph-mon[101353]: pgmap v377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:42 smithi159 ceph-mon[69013]: pgmap v377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 -- 172.21.15.96:0/2858791176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f6860 msgr2=0x7f2e3c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 --2- 172.21.15.96:0/2858791176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c0f6cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2e38004660 tx=0x7f2e38009b30).stop 2022-02-02T18:34:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 -- 172.21.15.96:0/2858791176 shutdown_connections 2022-02-02T18:34:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 --2- 172.21.15.96:0/2858791176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c0f6cc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 --2- 172.21.15.96:0/2858791176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 -- 172.21.15.96:0/2858791176 >> 172.21.15.96:0/2858791176 conn(0x7f2e3c0f0d40 msgr2=0x7f2e3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:42.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 -- 172.21.15.96:0/2858791176 shutdown_connections 2022-02-02T18:34:42.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.792+0000 7f2e443a7700 1 -- 172.21.15.96:0/2858791176 wait complete. 2022-02-02T18:34:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 Processor -- start 2022-02-02T18:34:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 -- start start 2022-02-02T18:34:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0602b0 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e443a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0603f0 con 0x7f2e3c0f6860 2022-02-02T18:34:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54748/0 (socket says 172.21.15.96:54748) 2022-02-02T18:34:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 -- 172.21.15.96:0/3307367024 learned_addr learned my addr 172.21.15.96:0/3307367024 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:42.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e41942700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:42.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 -- 172.21.15.96:0/3307367024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f6860 msgr2=0x7f2e3c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:42.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.793+0000 7f2e42143700 1 -- 172.21.15.96:0/3307367024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38005040 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e42143700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2e2c002700 tx=0x7f2e2c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c0079c0 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e2c00f040 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c10ea60 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c014860 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.794+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c10eee0 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.795+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c045ad0 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.795+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e2c01b060 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.796+0000 7f2e32ffd700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 0x7f2e28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.796+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2e2c081880 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.796+0000 7f2e41942700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 0x7f2e28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:42.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.796+0000 7f2e41942700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 0x7f2e28067290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2e38004630 tx=0x7f2e38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:42.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.800+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e2c04f930 con 0x7f2e3c0f55c0 2022-02-02T18:34:42.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.980+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e3c0fdef0 con 0x7f2e28064dd0 2022-02-02T18:34:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.981+0000 7f2e32ffd700 1 -- 172.21.15.96:0/3307367024 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2e3c0fdef0 con 0x7f2e28064dd0 2022-02-02T18:34:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 msgr2=0x7f2e28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 0x7f2e28067290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2e38004630 tx=0x7f2e38009b30).stop 2022-02-02T18:34:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 msgr2=0x7f2e3c10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2e2c002700 tx=0x7f2e2c009d80).stop 2022-02-02T18:34:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 shutdown_connections 2022-02-02T18:34:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2e28064dd0 0x7f2e28067290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e3c0f55c0 0x7f2e3c10c070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 --2- 172.21.15.96:0/3307367024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c0f6860 0x7f2e3c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 >> 172.21.15.96:0/3307367024 conn(0x7f2e3c0f0d40 msgr2=0x7f2e3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 shutdown_connections 2022-02-02T18:34:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:42.983+0000 7f2e443a7700 1 -- 172.21.15.96:0/3307367024 wait complete. 2022-02-02T18:34:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:34:43.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 -- 172.21.15.96:0/641537914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84200f9690 msgr2=0x7f84200fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 --2- 172.21.15.96:0/641537914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84200f9690 0x7f84200fbae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f8410004660 tx=0x7f8410009b30).stop 2022-02-02T18:34:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 -- 172.21.15.96:0/641537914 shutdown_connections 2022-02-02T18:34:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 --2- 172.21.15.96:0/641537914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84200f9690 0x7f84200fbae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 --2- 172.21.15.96:0/641537914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8420060310 0x7f84200f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:34:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 -- 172.21.15.96:0/641537914 >> 172.21.15.96:0/641537914 conn(0x7f84200f0b90 msgr2=0x7f84200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 -- 172.21.15.96:0/641537914 shutdown_connections 2022-02-02T18:34:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.083+0000 7f84273f0700 1 -- 172.21.15.96:0/641537914 wait complete. 2022-02-02T18:34:43.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 Processor -- start 2022-02-02T18:34:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 -- start start 2022-02-02T18:34:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84200f9690 0x7f84200f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200f5600 con 0x7f8420060310 2022-02-02T18:34:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84273f0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200f5740 con 0x7f84200f9690 2022-02-02T18:34:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54756/0 (socket says 172.21.15.96:54756) 2022-02-02T18:34:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 -- 172.21.15.96:0/4169304184 learned_addr learned my addr 172.21.15.96:0/4169304184 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f8425bed700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84200f9690 0x7f84200f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 -- 172.21.15.96:0/4169304184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84200f9690 msgr2=0x7f84200f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84200f9690 0x7f84200f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.084+0000 7f84263ee700 1 -- 172.21.15.96:0/4169304184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410005040 con 0x7f8420060310 2022-02-02T18:34:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f84263ee700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f841c00b410 tx=0x7f841c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f841c0125f0 con 0x7f8420060310 2022-02-02T18:34:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f841c00be30 con 0x7f8420060310 2022-02-02T18:34:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84200f5a20 con 0x7f8420060310 2022-02-02T18:34:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f841c002a70 con 0x7f8420060310 2022-02-02T18:34:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.085+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842010edb0 con 0x7f8420060310 2022-02-02T18:34:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.086+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8420045ad0 con 0x7f8420060310 2022-02-02T18:34:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.086+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f841c00f030 con 0x7f8420060310 2022-02-02T18:34:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.086+0000 7f8416ffd700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 0x7f840c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.087+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f841c081ec0 con 0x7f8420060310 2022-02-02T18:34:43.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.087+0000 7f8425bed700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 0x7f840c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.087+0000 7f8425bed700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 0x7f840c0672e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8410004630 tx=0x7f8410009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.091+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f841c04ff70 con 0x7f8420060310 2022-02-02T18:34:43.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.264+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8420057f10 con 0x7f840c064e20 2022-02-02T18:34:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.273+0000 7f8416ffd700 1 -- 172.21.15.96:0/4169304184 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8420057f10 con 0x7f840c064e20 2022-02-02T18:34:43.271 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:34:43.272 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (18m) 8m ago 19m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:34:43.272 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (10m) 8m ago 19m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:34:43.272 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (10m) 7m ago 18m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:34:43.272 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (17m) 8m ago 18m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:34:43.273 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (15m) 8m ago 15m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:34:43.273 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (10m) 8m ago 15m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:34:43.273 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (15m) 7m ago 15m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:34:43.273 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (11m) 7m ago 15m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:34:43.274 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (12m) 8m ago 20m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:34:43.274 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (11m) 7m ago 18m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:34:43.274 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (11m) 8m ago 20m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:34:43.274 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (11m) 7m ago 18m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:34:43.275 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (18m) 8m ago 18m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:34:43.275 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (18m) 7m ago 18m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:34:43.275 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (10m) 8m ago 18m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:34:43.276 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (9m) 8m ago 17m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:34:43.276 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (9m) 8m ago 17m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:34:43.276 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (8m) 7m ago 17m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:34:43.276 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (7m) 7m ago 16m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:34:43.276 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (7m) 7m ago 16m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:34:43.277 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (17m) 8m ago 18m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:34:43.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 msgr2=0x7f840c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 0x7f840c0672e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8410004630 tx=0x7f8410009b30).stop 2022-02-02T18:34:43.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 msgr2=0x7f84200f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f841c00b410 tx=0x7f841c006ef0).stop 2022-02-02T18:34:43.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 shutdown_connections 2022-02-02T18:34:43.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f840c064e20 0x7f840c0672e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8420060310 0x7f84200f6b90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 --2- 172.21.15.96:0/4169304184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84200f9690 0x7f84200f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 >> 172.21.15.96:0/4169304184 conn(0x7f84200f0b90 msgr2=0x7f84200f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 shutdown_connections 2022-02-02T18:34:43.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.275+0000 7f84273f0700 1 -- 172.21.15.96:0/4169304184 wait complete. 2022-02-02T18:34:43.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 -- 172.21.15.96:0/446030570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f55c0 msgr2=0x7f9d2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 --2- 172.21.15.96:0/446030570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c0f59e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9d1c004660 tx=0x7f9d1c009b30).stop 2022-02-02T18:34:43.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 -- 172.21.15.96:0/446030570 shutdown_connections 2022-02-02T18:34:43.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 --2- 172.21.15.96:0/446030570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 --2- 172.21.15.96:0/446030570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c0f59e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 -- 172.21.15.96:0/446030570 >> 172.21.15.96:0/446030570 conn(0x7f9d2c0f0d40 msgr2=0x7f9d2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 -- 172.21.15.96:0/446030570 shutdown_connections 2022-02-02T18:34:43.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.372+0000 7f9d324d7700 1 -- 172.21.15.96:0/446030570 wait complete. 2022-02-02T18:34:43.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 Processor -- start 2022-02-02T18:34:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 -- start start 2022-02-02T18:34:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c107a40 con 0x7f9d2c0f6860 2022-02-02T18:34:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d324d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c107b80 con 0x7f9d2c0f55c0 2022-02-02T18:34:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54768/0 (socket says 172.21.15.96:54768) 2022-02-02T18:34:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d2b7fe700 1 -- 172.21.15.96:0/3813195906 learned_addr learned my addr 172.21.15.96:0/3813195906 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.373+0000 7f9d2bfff700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d2b7fe700 1 -- 172.21.15.96:0/3813195906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f55c0 msgr2=0x7f9d2c106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d2b7fe700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d2b7fe700 1 -- 172.21.15.96:0/3813195906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c005040 con 0x7f9d2c0f6860 2022-02-02T18:34:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d2b7fe700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9d2000c530 tx=0x7f9d20007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d2000f650 con 0x7f9d2c0f6860 2022-02-02T18:34:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d2000fc60 con 0x7f9d2c0f6860 2022-02-02T18:34:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d20012c20 con 0x7f9d2c0f6860 2022-02-02T18:34:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c108520 con 0x7f9d2c0f6860 2022-02-02T18:34:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.374+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c108a90 con 0x7f9d2c0f6860 2022-02-02T18:34:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9d20010070 con 0x7f9d2c0f6860 2022-02-02T18:34:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c045ad0 con 0x7f9d2c0f6860 2022-02-02T18:34:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d28ff9700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 0x7f9d14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9d20081700 con 0x7f9d2c0f6860 2022-02-02T18:34:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d2bfff700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 0x7f9d14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.376+0000 7f9d2bfff700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 0x7f9d14067290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9d1c004630 tx=0x7f9d1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.380+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9d200531e0 con 0x7f9d2c0f6860 2022-02-02T18:34:43.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.610+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d2c109120 con 0x7f9d2c0f6860 2022-02-02T18:34:43.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.610+0000 7f9d28ff9700 1 -- 172.21.15.96:0/3813195906 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9d20052dd0 con 0x7f9d2c0f6860 2022-02-02T18:34:43.609 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:34:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:34:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:34:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:34:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:34:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:34:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:34:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:34:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:34:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:34:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:34:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:34:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:34:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:34:43.613 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:34:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 msgr2=0x7f9d14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 0x7f9d14067290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9d1c004630 tx=0x7f9d1c009b30).stop 2022-02-02T18:34:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 msgr2=0x7f9d2c107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9d2000c530 tx=0x7f9d20007e20).stop 2022-02-02T18:34:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 shutdown_connections 2022-02-02T18:34:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d14064dd0 0x7f9d14067290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c0f55c0 0x7f9d2c106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 --2- 172.21.15.96:0/3813195906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0f6860 0x7f9d2c107490 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 >> 172.21.15.96:0/3813195906 conn(0x7f9d2c0f0d40 msgr2=0x7f9d2c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 shutdown_connections 2022-02-02T18:34:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.612+0000 7f9d324d7700 1 -- 172.21.15.96:0/3813195906 wait complete. 2022-02-02T18:34:43.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 -- 172.21.15.96:0/1556278086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f6860 msgr2=0x7f585c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 --2- 172.21.15.96:0/1556278086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f6860 0x7f585c0f6cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f5848004660 tx=0x7f5848009b30).stop 2022-02-02T18:34:43.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 -- 172.21.15.96:0/1556278086 shutdown_connections 2022-02-02T18:34:43.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 --2- 172.21.15.96:0/1556278086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f6860 0x7f585c0f6cc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 --2- 172.21.15.96:0/1556278086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f55c0 0x7f585c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:34:43.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 -- 172.21.15.96:0/1556278086 >> 172.21.15.96:0/1556278086 conn(0x7f585c0f0d40 msgr2=0x7f585c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 -- 172.21.15.96:0/1556278086 shutdown_connections 2022-02-02T18:34:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.710+0000 7f5862d07700 1 -- 172.21.15.96:0/1556278086 wait complete. 2022-02-02T18:34:43.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 Processor -- start 2022-02-02T18:34:43.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 -- start start 2022-02-02T18:34:43.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f6860 0x7f585c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c069830 con 0x7f585c0f55c0 2022-02-02T18:34:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5862d07700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c10faa0 con 0x7f585c0f6860 2022-02-02T18:34:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5860aa3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5860aa3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54776/0 (socket says 172.21.15.96:54776) 2022-02-02T18:34:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f5860aa3700 1 -- 172.21.15.96:0/564830718 learned_addr learned my addr 172.21.15.96:0/564830718 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:34:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.711+0000 7f585bfff700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f6860 0x7f585c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5860aa3700 1 -- 172.21.15.96:0/564830718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f6860 msgr2=0x7f585c0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5860aa3700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f6860 0x7f585c0691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5860aa3700 1 -- 172.21.15.96:0/564830718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848005040 con 0x7f585c0f55c0 2022-02-02T18:34:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5860aa3700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f58500093f0 tx=0x7f5850006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5850013640 con 0x7f585c0f55c0 2022-02-02T18:34:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c10fd80 con 0x7f585c0f55c0 2022-02-02T18:34:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5850013c50 con 0x7f585c0f55c0 2022-02-02T18:34:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5850012c70 con 0x7f585c0f55c0 2022-02-02T18:34:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.712+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c110340 con 0x7f585c0f55c0 2022-02-02T18:34:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.713+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c0f49b0 con 0x7f585c0f55c0 2022-02-02T18:34:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.714+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f585001a060 con 0x7f585c0f55c0 2022-02-02T18:34:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.714+0000 7f58597fa700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 0x7f584c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:34:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.714+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5850081aa0 con 0x7f585c0f55c0 2022-02-02T18:34:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.714+0000 7f585bfff700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 0x7f584c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:34:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.714+0000 7f585bfff700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 0x7f584c067290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5848004630 tx=0x7f5848009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:34:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.718+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f585004faf0 con 0x7f585c0f55c0 2022-02-02T18:34:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.918+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f585c045ad0 con 0x7f585c0f55c0 2022-02-02T18:34:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.918+0000 7f58597fa700 1 -- 172.21.15.96:0/564830718 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5850018720 con 0x7f585c0f55c0 2022-02-02T18:34:43.917 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:34:43.917 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:34:43.918 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:34:43.918 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:34:43.918 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:43.918 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:34:43.919 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:34:43.919 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:34:43.919 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:34:43.919 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:34:43.919 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:34:43.920 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:34:43.920 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:34:43.920 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:34:43.920 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:34:43.921 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:34:43.921 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:34:43.921 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:34:43.921 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:34:43.921 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:34:43.922 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:34:43.922 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:34:43.922 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:34:43.922 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:34:43.923 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:34:43.923 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:34:43.923 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:34:43.923 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:34:43.924 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:34:43.924 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:34:43.924 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:34:43.924 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:34:43.924 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:43.925 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:43.925 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:34:43.925 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:34:43.925 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:43.926 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:43.926 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:34:43.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 msgr2=0x7f584c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 0x7f584c067290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5848004630 tx=0x7f5848009b30).stop 2022-02-02T18:34:43.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 msgr2=0x7f585c068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:34:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f58500093f0 tx=0x7f5850006ec0).stop 2022-02-02T18:34:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 shutdown_connections 2022-02-02T18:34:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f584c064dd0 0x7f584c067290 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0f55c0 0x7f585c068c90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 --2- 172.21.15.96:0/564830718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c0f6860 0x7f585c0691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:34:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 >> 172.21.15.96:0/564830718 conn(0x7f585c0f0d40 msgr2=0x7f585c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:34:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 shutdown_connections 2022-02-02T18:34:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:34:43.921+0000 7f5862d07700 1 -- 172.21.15.96:0/564830718 wait complete. 2022-02-02T18:34:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:34:44.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:44 smithi096 ceph-mon[101353]: pgmap v378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:44.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:44 smithi096 ceph-mon[101353]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:44.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:44 smithi096 ceph-mon[101353]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:44.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3813195906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/564830718' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:34:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:44 smithi159 ceph-mon[69013]: pgmap v378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:44 smithi159 ceph-mon[69013]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:44 smithi159 ceph-mon[69013]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:34:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3813195906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/564830718' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:34:46.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:46 smithi096 ceph-mon[101353]: pgmap v379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:46 smithi159 ceph-mon[69013]: pgmap v379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:47.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:47.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:47.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:47.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:48.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:48 smithi096 ceph-mon[101353]: pgmap v380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:48 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:48 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:48 smithi159 ceph-mon[69013]: pgmap v380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:48 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:48 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:50.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:50 smithi096 ceph-mon[101353]: pgmap v381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:50 smithi159 ceph-mon[69013]: pgmap v381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:52.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:52 smithi096 ceph-mon[101353]: pgmap v382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:52 smithi159 ceph-mon[69013]: pgmap v382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:54.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:54 smithi096 ceph-mon[101353]: pgmap v383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:54 smithi159 ceph-mon[69013]: pgmap v383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:56.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:56 smithi096 ceph-mon[101353]: pgmap v384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:56 smithi159 ceph-mon[69013]: pgmap v384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:57.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:57.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:57.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:57.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:57.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:34:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:34:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:34:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:34:57.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:34:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:58 smithi159 ceph-mon[69013]: pgmap v385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:58 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:58.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:34:58 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:34:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:58 smithi096 ceph-mon[101353]: pgmap v385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:34:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:58 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:34:58.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:34:58 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:00 smithi159 ceph-mon[69013]: pgmap v386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:00 smithi096 ceph-mon[101353]: pgmap v386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:02 smithi159 ceph-mon[69013]: pgmap v387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:02 smithi096 ceph-mon[101353]: pgmap v387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:04 smithi159 ceph-mon[69013]: pgmap v388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:04 smithi096 ceph-mon[101353]: pgmap v388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:06 smithi159 ceph-mon[69013]: pgmap v389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:06 smithi096 ceph-mon[101353]: pgmap v389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:07.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:07.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:08.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:08 smithi159 ceph-mon[69013]: pgmap v390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:08.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:08 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:08 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:08.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:08 smithi096 ceph-mon[101353]: pgmap v390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:08.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:08 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:08 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:10 smithi159 ceph-mon[69013]: pgmap v391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:10 smithi096 ceph-mon[101353]: pgmap v391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:12 smithi159 ceph-mon[69013]: pgmap v392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:12 smithi096 ceph-mon[101353]: pgmap v392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:14.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 -- 172.21.15.96:0/3605034475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00f9860 msgr2=0x7f6da00fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 --2- 172.21.15.96:0/3605034475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00f9860 0x7f6da00fbc70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6d90004660 tx=0x7f6d90009b30).stop 2022-02-02T18:35:14.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 -- 172.21.15.96:0/3605034475 shutdown_connections 2022-02-02T18:35:14.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 --2- 172.21.15.96:0/3605034475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00f9860 0x7f6da00fbc70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 --2- 172.21.15.96:0/3605034475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00602d0 0x7f6da00f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:35:14.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 -- 172.21.15.96:0/3605034475 >> 172.21.15.96:0/3605034475 conn(0x7f6da00f0d40 msgr2=0x7f6da00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 -- 172.21.15.96:0/3605034475 shutdown_connections 2022-02-02T18:35:14.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.033+0000 7f6da513c700 1 -- 172.21.15.96:0/3605034475 wait complete. 2022-02-02T18:35:14.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 Processor -- start 2022-02-02T18:35:14.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 -- start start 2022-02-02T18:35:14.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00f9860 0x7f6da00f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00f57d0 con 0x7f6da00602d0 2022-02-02T18:35:14.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6da513c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00f5910 con 0x7f6da00f9860 2022-02-02T18:35:14.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6d9ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6d9ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54794/0 (socket says 172.21.15.96:54794) 2022-02-02T18:35:14.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.034+0000 7f6d9ed9d700 1 -- 172.21.15.96:0/3736109366 learned_addr learned my addr 172.21.15.96:0/3736109366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:14.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d9e59c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00f9860 0x7f6da00f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d9ed9d700 1 -- 172.21.15.96:0/3736109366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00f9860 msgr2=0x7f6da00f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d9ed9d700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00f9860 0x7f6da00f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d9ed9d700 1 -- 172.21.15.96:0/3736109366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90005040 con 0x7f6da00602d0 2022-02-02T18:35:14.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d9ed9d700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6d8800b410 tx=0x7f6d88006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d880125f0 con 0x7f6da00602d0 2022-02-02T18:35:14.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d8800be30 con 0x7f6da00602d0 2022-02-02T18:35:14.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d88002a70 con 0x7f6da00602d0 2022-02-02T18:35:14.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da00f5bf0 con 0x7f6da00602d0 2022-02-02T18:35:14.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.035+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da010ef60 con 0x7f6da00602d0 2022-02-02T18:35:14.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.036+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da0045ad0 con 0x7f6da00602d0 2022-02-02T18:35:14.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.037+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d8800f030 con 0x7f6da00602d0 2022-02-02T18:35:14.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.037+0000 7f6d977fe700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.037+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6d88081de0 con 0x7f6da00602d0 2022-02-02T18:35:14.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.037+0000 7f6d9e59c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.037+0000 7f6d9e59c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6d90004630 tx=0x7f6d90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.041+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d8804fe90 con 0x7f6da00602d0 2022-02-02T18:35:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.219+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6da00008d0 con 0x7f6d8c064dd0 2022-02-02T18:35:14.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.220+0000 7f6d977fe700 1 -- 172.21.15.96:0/3736109366 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6da00008d0 con 0x7f6d8c064dd0 2022-02-02T18:35:14.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 msgr2=0x7f6d8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6d90004630 tx=0x7f6d90009b30).stop 2022-02-02T18:35:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 msgr2=0x7f6da00f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6d8800b410 tx=0x7f6d88006ef0).stop 2022-02-02T18:35:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 shutdown_connections 2022-02-02T18:35:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da00602d0 0x7f6da00f6d60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 --2- 172.21.15.96:0/3736109366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da00f9860 0x7f6da00f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 >> 172.21.15.96:0/3736109366 conn(0x7f6da00f0d40 msgr2=0x7f6da00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 shutdown_connections 2022-02-02T18:35:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.222+0000 7f6da513c700 1 -- 172.21.15.96:0/3736109366 wait complete. 2022-02-02T18:35:14.230 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:35:14.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.320+0000 7f47ea9f1700 1 -- 172.21.15.96:0/2992876414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f7980 msgr2=0x7f47e40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.320+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/2992876414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f7980 0x7f47e40f7de0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f47cc004660 tx=0x7f47cc009b30).stop 2022-02-02T18:35:14.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 -- 172.21.15.96:0/2992876414 shutdown_connections 2022-02-02T18:35:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/2992876414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f7980 0x7f47e40f7de0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/2992876414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f66e0 0x7f47e40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 -- 172.21.15.96:0/2992876414 >> 172.21.15.96:0/2992876414 conn(0x7f47e40f1e40 msgr2=0x7f47e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 -- 172.21.15.96:0/2992876414 shutdown_connections 2022-02-02T18:35:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 -- 172.21.15.96:0/2992876414 wait complete. 2022-02-02T18:35:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 Processor -- start 2022-02-02T18:35:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 -- start start 2022-02-02T18:35:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.321+0000 7f47ea9f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47ea9f1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f7980 0x7f47e406a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47ea9f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e406bbe0 con 0x7f47e40f66e0 2022-02-02T18:35:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47ea9f1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e406bd20 con 0x7f47e40f7980 2022-02-02T18:35:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54804/0 (socket says 172.21.15.96:54804) 2022-02-02T18:35:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 -- 172.21.15.96:0/3016179325 learned_addr learned my addr 172.21.15.96:0/3016179325 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e37fe700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f7980 0x7f47e406a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 -- 172.21.15.96:0/3016179325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f7980 msgr2=0x7f47e406a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f7980 0x7f47e406a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 -- 172.21.15.96:0/3016179325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc005040 con 0x7f47e40f66e0 2022-02-02T18:35:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e3fff700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f47d400c790 tx=0x7f47d4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d400e680 con 0x7f47e40f66e0 2022-02-02T18:35:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47d400ec90 con 0x7f47e40f66e0 2022-02-02T18:35:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e406a6c0 con 0x7f47e40f66e0 2022-02-02T18:35:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d4012d00 con 0x7f47e40f66e0 2022-02-02T18:35:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.322+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e406ac80 con 0x7f47e40f66e0 2022-02-02T18:35:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.323+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e40f5ad0 con 0x7f47e40f66e0 2022-02-02T18:35:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.324+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47d4010070 con 0x7f47e40f66e0 2022-02-02T18:35:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.324+0000 7f47e0ff9700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.324+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f47d4081b60 con 0x7f47e40f66e0 2022-02-02T18:35:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.324+0000 7f47e37fe700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.325+0000 7f47e37fe700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f47cc004e30 tx=0x7f47cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.328+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47d404faf0 con 0x7f47e40f66e0 2022-02-02T18:35:14.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.504+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e4062a90 con 0x7f47d0064dd0 2022-02-02T18:35:14.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.513+0000 7f47e0ff9700 1 -- 172.21.15.96:0/3016179325 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f47e4062a90 con 0x7f47d0064dd0 2022-02-02T18:35:14.512 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:35:14.512 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (18m) 9m ago 19m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:35:14.512 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (11m) 9m ago 19m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:35:14.512 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (10m) 7m ago 19m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:35:14.513 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (18m) 9m ago 19m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:35:14.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (15m) 9m ago 15m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:35:14.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (11m) 9m ago 15m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:35:14.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (15m) 7m ago 15m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:35:14.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (11m) 7m ago 15m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:35:14.514 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (12m) 9m ago 20m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:35:14.514 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (12m) 7m ago 19m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:35:14.514 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (11m) 9m ago 20m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:35:14.514 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (11m) 7m ago 19m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:35:14.515 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (19m) 9m ago 19m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:35:14.515 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (18m) 7m ago 18m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:35:14.515 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (10m) 9m ago 18m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:35:14.515 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (10m) 9m ago 18m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:35:14.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (9m) 9m ago 17m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:35:14.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (9m) 7m ago 17m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:35:14.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (8m) 7m ago 17m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:35:14.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (8m) 7m ago 17m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:35:14.517 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (18m) 9m ago 19m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:35:14.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 msgr2=0x7f47d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f47cc004e30 tx=0x7f47cc009b30).stop 2022-02-02T18:35:14.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 msgr2=0x7f47e406b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f47d400c790 tx=0x7f47d4007d90).stop 2022-02-02T18:35:14.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 shutdown_connections 2022-02-02T18:35:14.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f66e0 0x7f47e406b5e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 --2- 172.21.15.96:0/3016179325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f7980 0x7f47e406a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.515+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 >> 172.21.15.96:0/3016179325 conn(0x7f47e40f1e40 msgr2=0x7f47e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.516+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 shutdown_connections 2022-02-02T18:35:14.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.516+0000 7f47ea9f1700 1 -- 172.21.15.96:0/3016179325 wait complete. 2022-02-02T18:35:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 -- 172.21.15.96:0/3801449102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f55d0 msgr2=0x7f25000f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 --2- 172.21.15.96:0/3801449102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f55d0 0x7f25000f59f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f24f0004660 tx=0x7f24f0009b30).stop 2022-02-02T18:35:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 -- 172.21.15.96:0/3801449102 shutdown_connections 2022-02-02T18:35:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 --2- 172.21.15.96:0/3801449102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f6870 0x7f25000f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 --2- 172.21.15.96:0/3801449102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f55d0 0x7f25000f59f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 -- 172.21.15.96:0/3801449102 >> 172.21.15.96:0/3801449102 conn(0x7f25000f0d70 msgr2=0x7f25000f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.617 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:14 smithi096 ceph-mon[101353]: pgmap v393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:14.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 -- 172.21.15.96:0/3801449102 shutdown_connections 2022-02-02T18:35:14.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.613+0000 7f2507267700 1 -- 172.21.15.96:0/3801449102 wait complete. 2022-02-02T18:35:14.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 Processor -- start 2022-02-02T18:35:14.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 -- start start 2022-02-02T18:35:14.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f55d0 0x7f2500106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25001079d0 con 0x7f25000f6870 2022-02-02T18:35:14.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2507267700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500107b10 con 0x7f25000f55d0 2022-02-02T18:35:14.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2504802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2504802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54814/0 (socket says 172.21.15.96:54814) 2022-02-02T18:35:14.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2504802700 1 -- 172.21.15.96:0/457566897 learned_addr learned my addr 172.21.15.96:0/457566897 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:14.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.614+0000 7f2505003700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f55d0 0x7f2500106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2504802700 1 -- 172.21.15.96:0/457566897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f55d0 msgr2=0x7f2500106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2504802700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f55d0 0x7f2500106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2504802700 1 -- 172.21.15.96:0/457566897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0005040 con 0x7f25000f6870 2022-02-02T18:35:14.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2504802700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f24fc00c790 tx=0x7f24fc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24fc002590 con 0x7f25000f6870 2022-02-02T18:35:14.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25001084b0 con 0x7f25000f6870 2022-02-02T18:35:14.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2500108a70 con 0x7f25000f6870 2022-02-02T18:35:14.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24fc002ba0 con 0x7f25000f6870 2022-02-02T18:35:14.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.615+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24fc01cd40 con 0x7f25000f6870 2022-02-02T18:35:14.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.616+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e0004fa0 con 0x7f25000f6870 2022-02-02T18:35:14.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.616+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24fc01a060 con 0x7f25000f6870 2022-02-02T18:35:14.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.617+0000 7f24f5ffb700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 0x7f24ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.617+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f24fc081860 con 0x7f25000f6870 2022-02-02T18:35:14.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.617+0000 7f2505003700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 0x7f24ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.617+0000 7f2505003700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 0x7f24ec067290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f24f0004630 tx=0x7f24f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.621+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24fc053340 con 0x7f25000f6870 2022-02-02T18:35:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:14 smithi159 ceph-mon[69013]: pgmap v393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:14.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.854+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24e0005e80 con 0x7f25000f6870 2022-02-02T18:35:14.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.855+0000 7f24f5ffb700 1 -- 172.21.15.96:0/457566897 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f24fc052f30 con 0x7f25000f6870 2022-02-02T18:35:14.856 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:35:14.856 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:35:14.856 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:35:14.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:14.857 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:35:14.857 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:35:14.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:14.857 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:35:14.858 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:35:14.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:14.858 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:35:14.858 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:35:14.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:14.859 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:35:14.859 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:35:14.859 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:35:14.860 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:35:14.860 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:35:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.856+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 msgr2=0x7f24ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.856+0000 7f2507267700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 0x7f24ec067290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f24f0004630 tx=0x7f24f0009b30).stop 2022-02-02T18:35:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.856+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 msgr2=0x7f2500107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.856+0000 7f2507267700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f24fc00c790 tx=0x7f24fc007d70).stop 2022-02-02T18:35:14.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 shutdown_connections 2022-02-02T18:35:14.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ec064dd0 0x7f24ec067290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25000f55d0 0x7f2500106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 --2- 172.21.15.96:0/457566897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25000f6870 0x7f2500107420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 >> 172.21.15.96:0/457566897 conn(0x7f25000f0d70 msgr2=0x7f250005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 shutdown_connections 2022-02-02T18:35:14.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.857+0000 7f2507267700 1 -- 172.21.15.96:0/457566897 wait complete. 2022-02-02T18:35:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1499948548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f5ef0 msgr2=0x7fd3f40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1499948548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f40f6920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd3f0004660 tx=0x7fd3f0009b30).stop 2022-02-02T18:35:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1499948548 shutdown_connections 2022-02-02T18:35:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1499948548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f40f6920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1499948548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f55e0 0x7fd3f40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.954+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1499948548 >> 172.21.15.96:0/1499948548 conn(0x7fd3f40f0de0 msgr2=0x7fd3f40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1499948548 shutdown_connections 2022-02-02T18:35:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1499948548 wait complete. 2022-02-02T18:35:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 Processor -- start 2022-02-02T18:35:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 -- start start 2022-02-02T18:35:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4060500 con 0x7fd3f40f55e0 2022-02-02T18:35:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.955+0000 7fd3fb6ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4060640 con 0x7fd3f40f5ef0 2022-02-02T18:35:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54822/0 (socket says 172.21.15.96:54822) 2022-02-02T18:35:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 -- 172.21.15.96:0/1332935158 learned_addr learned my addr 172.21.15.96:0/1332935158 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f8c88700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 -- 172.21.15.96:0/1332935158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f5ef0 msgr2=0x7fd3f410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 -- 172.21.15.96:0/1332935158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0005040 con 0x7fd3f40f55e0 2022-02-02T18:35:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3f9489700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd3e40026d0 tx=0x7fd3e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e4009320 con 0x7fd3f40f55e0 2022-02-02T18:35:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3e400f040 con 0x7fd3f40f55e0 2022-02-02T18:35:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f410c740 con 0x7fd3f40f55e0 2022-02-02T18:35:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e40147e0 con 0x7fd3f40f55e0 2022-02-02T18:35:14.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.956+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f410cd00 con 0x7fd3f40f55e0 2022-02-02T18:35:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.957+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f4045ad0 con 0x7fd3f40f55e0 2022-02-02T18:35:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.958+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3e4009480 con 0x7fd3f40f55e0 2022-02-02T18:35:14.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.959+0000 7fd3e9ffb700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 0x7fd3e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.959+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3e4082170 con 0x7fd3f40f55e0 2022-02-02T18:35:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.959+0000 7fd3f8c88700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 0x7fd3e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:14.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.959+0000 7fd3f8c88700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 0x7fd3e0067290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd3f0004630 tx=0x7fd3f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:14.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:14.963+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3e4050220 con 0x7fd3f40f55e0 2022-02-02T18:35:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.166+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3f40586e0 con 0x7fd3f40f55e0 2022-02-02T18:35:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.167+0000 7fd3e9ffb700 1 -- 172.21.15.96:0/1332935158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd3e4053840 con 0x7fd3f40f55e0 2022-02-02T18:35:15.165 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:35:15.165 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:35:15.166 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:35:15.166 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:35:15.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:15.166 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:35:15.167 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:35:15.167 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:35:15.167 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:35:15.168 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:35:15.168 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:35:15.168 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:35:15.168 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:35:15.169 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:35:15.169 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:35:15.169 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:35:15.169 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:35:15.170 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:35:15.170 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:35:15.170 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:35:15.170 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:35:15.170 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:35:15.171 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:35:15.171 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:35:15.171 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:35:15.171 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:35:15.172 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:35:15.172 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:35:15.172 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:35:15.172 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:35:15.173 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:35:15.173 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:35:15.173 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:15.173 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:15.173 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:35:15.174 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:15.174 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:15.174 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:15.174 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:15.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 msgr2=0x7fd3e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:15.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 0x7fd3e0067290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd3f0004630 tx=0x7fd3f0009b30).stop 2022-02-02T18:35:15.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 msgr2=0x7fd3f4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:15.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd3e40026d0 tx=0x7fd3e4009de0).stop 2022-02-02T18:35:15.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 shutdown_connections 2022-02-02T18:35:15.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3e0064dd0 0x7fd3e0067290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:15.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3f40f55e0 0x7fd3f4109c90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:15.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 --2- 172.21.15.96:0/1332935158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3f40f5ef0 0x7fd3f410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:15.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 >> 172.21.15.96:0/1332935158 conn(0x7fd3f40f0de0 msgr2=0x7fd3f40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:15.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 shutdown_connections 2022-02-02T18:35:15.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:15.169+0000 7fd3fb6ed700 1 -- 172.21.15.96:0/1332935158 wait complete. 2022-02-02T18:35:15.178 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:35:15.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:15 smithi159 ceph-mon[69013]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:15.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/457566897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:15.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1332935158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:35:15.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:15 smithi096 ceph-mon[101353]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:15.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/457566897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:15.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1332935158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:35:16.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:16 smithi159 ceph-mon[69013]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:16.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:16 smithi159 ceph-mon[69013]: pgmap v394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:16.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:16 smithi096 ceph-mon[101353]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:16.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:16 smithi096 ceph-mon[101353]: pgmap v394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:17.709 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:17.709 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:17.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:17.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:18.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: pgmap v395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:18.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:18.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: pgmap v395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:18.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:18.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:19.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:19 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:19.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:19 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:20 smithi159 ceph-mon[69013]: pgmap v396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:20 smithi096 ceph-mon[101353]: pgmap v396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:22 smithi159 ceph-mon[69013]: pgmap v397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:22 smithi096 ceph-mon[101353]: pgmap v397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:24 smithi159 ceph-mon[69013]: pgmap v398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:24.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:24 smithi096 ceph-mon[101353]: pgmap v398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:26.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:26 smithi159 ceph-mon[69013]: pgmap v399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:26.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:26 smithi096 ceph-mon[101353]: pgmap v399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:35:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:35:27.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:35:27.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:35:28.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: pgmap v400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:28.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:28.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: pgmap v400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:28.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:29.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:29 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:29.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:29 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:29.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:29 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:29.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:29 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:30 smithi159 ceph-mon[69013]: pgmap v401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:30 smithi096 ceph-mon[101353]: pgmap v401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:32 smithi159 ceph-mon[69013]: pgmap v402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:32 smithi096 ceph-mon[101353]: pgmap v402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:34 smithi159 ceph-mon[69013]: pgmap v403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:34 smithi096 ceph-mon[101353]: pgmap v403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:36 smithi159 ceph-mon[69013]: pgmap v404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:36 smithi096 ceph-mon[101353]: pgmap v404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:38.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: pgmap v405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:38.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:38.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: pgmap v405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:38.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:39.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:39.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:39 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:39.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:39.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:39 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:40 smithi159 ceph-mon[69013]: pgmap v406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:40 smithi096 ceph-mon[101353]: pgmap v406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:42 smithi159 ceph-mon[69013]: pgmap v407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:42 smithi096 ceph-mon[101353]: pgmap v407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:44 smithi159 ceph-mon[69013]: pgmap v408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:44 smithi096 ceph-mon[101353]: pgmap v408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 -- 172.21.15.96:0/557706182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f7960 msgr2=0x7f93ac0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 --2- 172.21.15.96:0/557706182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f7960 0x7f93ac0f7dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f939c004660 tx=0x7f939c009b30).stop 2022-02-02T18:35:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 -- 172.21.15.96:0/557706182 shutdown_connections 2022-02-02T18:35:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 --2- 172.21.15.96:0/557706182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f7960 0x7f93ac0f7dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 --2- 172.21.15.96:0/557706182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f66c0 0x7f93ac0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:35:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 -- 172.21.15.96:0/557706182 >> 172.21.15.96:0/557706182 conn(0x7f93ac0f1e20 msgr2=0x7f93ac0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 -- 172.21.15.96:0/557706182 shutdown_connections 2022-02-02T18:35:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.277+0000 7f93b165b700 1 -- 172.21.15.96:0/557706182 wait complete. 2022-02-02T18:35:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 Processor -- start 2022-02-02T18:35:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 -- start start 2022-02-02T18:35:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f7960 0x7f93ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac06a410 con 0x7f93ac0f66c0 2022-02-02T18:35:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93b165b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac06a550 con 0x7f93ac0f7960 2022-02-02T18:35:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.278+0000 7f93aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54842/0 (socket says 172.21.15.96:54842) 2022-02-02T18:35:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 -- 172.21.15.96:0/1207412438 learned_addr learned my addr 172.21.15.96:0/1207412438 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aa7fc700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f7960 0x7f93ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 -- 172.21.15.96:0/1207412438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f7960 msgr2=0x7f93ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f7960 0x7f93ac069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 -- 172.21.15.96:0/1207412438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c005040 con 0x7f93ac0f66c0 2022-02-02T18:35:45.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93aaffd700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f93a00093f0 tx=0x7f93a0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a0009ea0 con 0x7f93ac0f66c0 2022-02-02T18:35:45.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac06a830 con 0x7f93ac0f66c0 2022-02-02T18:35:45.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93a0013af0 con 0x7f93ac0f66c0 2022-02-02T18:35:45.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a000db10 con 0x7f93ac0f66c0 2022-02-02T18:35:45.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.279+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac10efc0 con 0x7f93ac0f66c0 2022-02-02T18:35:45.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.280+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac045ad0 con 0x7f93ac0f66c0 2022-02-02T18:35:45.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.281+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93a001a060 con 0x7f93ac0f66c0 2022-02-02T18:35:45.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.281+0000 7f93937fe700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 0x7f9394067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.281+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f93a0081ae0 con 0x7f93ac0f66c0 2022-02-02T18:35:45.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.281+0000 7f93aa7fc700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 0x7f9394067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.282+0000 7f93aa7fc700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 0x7f9394067290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f939c009da0 tx=0x7f939c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.286+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93a004fb90 con 0x7f93ac0f66c0 2022-02-02T18:35:45.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.464+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ac057f10 con 0x7f9394064dd0 2022-02-02T18:35:45.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.465+0000 7f93937fe700 1 -- 172.21.15.96:0/1207412438 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f93ac057f10 con 0x7f9394064dd0 2022-02-02T18:35:45.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 msgr2=0x7f9394067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 0x7f9394067290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f939c009da0 tx=0x7f939c009b30).stop 2022-02-02T18:35:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 msgr2=0x7f93ac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f93a00093f0 tx=0x7f93a0006ec0).stop 2022-02-02T18:35:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 shutdown_connections 2022-02-02T18:35:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9394064dd0 0x7f9394067290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac0f66c0 0x7f93ac06b9a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 --2- 172.21.15.96:0/1207412438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93ac0f7960 0x7f93ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 >> 172.21.15.96:0/1207412438 conn(0x7f93ac0f1e20 msgr2=0x7f93ac0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 shutdown_connections 2022-02-02T18:35:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.467+0000 7f93b165b700 1 -- 172.21.15.96:0/1207412438 wait complete. 2022-02-02T18:35:45.477 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:35:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 -- 172.21.15.96:0/2224165773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 msgr2=0x7ff98c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 --2- 172.21.15.96:0/2224165773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c0f6b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff980004660 tx=0x7ff980009b30).stop 2022-02-02T18:35:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 -- 172.21.15.96:0/2224165773 shutdown_connections 2022-02-02T18:35:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 --2- 172.21.15.96:0/2224165773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c0f6b30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 --2- 172.21.15.96:0/2224165773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 -- 172.21.15.96:0/2224165773 >> 172.21.15.96:0/2224165773 conn(0x7ff98c0f0b90 msgr2=0x7ff98c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 -- 172.21.15.96:0/2224165773 shutdown_connections 2022-02-02T18:35:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.566+0000 7ff99106e700 1 -- 172.21.15.96:0/2224165773 wait complete. 2022-02-02T18:35:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 Processor -- start 2022-02-02T18:35:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 -- start start 2022-02-02T18:35:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0603e0 con 0x7ff98c0f66d0 2022-02-02T18:35:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff99106e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c060520 con 0x7ff98c0f5430 2022-02-02T18:35:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff98b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff98b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54854/0 (socket says 172.21.15.96:54854) 2022-02-02T18:35:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.567+0000 7ff98b7fe700 1 -- 172.21.15.96:0/2552821848 learned_addr learned my addr 172.21.15.96:0/2552821848 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98bfff700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98b7fe700 1 -- 172.21.15.96:0/2552821848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 msgr2=0x7ff98c109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98b7fe700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98b7fe700 1 -- 172.21.15.96:0/2552821848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980005040 con 0x7ff98c0f66d0 2022-02-02T18:35:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98bfff700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:35:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff98b7fe700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff980009990 tx=0x7ff980009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff980018070 con 0x7ff98c0f66d0 2022-02-02T18:35:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff980007ca0 con 0x7ff98c0f66d0 2022-02-02T18:35:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c10c470 con 0x7ff98c0f66d0 2022-02-02T18:35:45.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98001c620 con 0x7ff98c0f66d0 2022-02-02T18:35:45.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.568+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c10c9d0 con 0x7ff98c0f66d0 2022-02-02T18:35:45.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.569+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c045ad0 con 0x7ff98c0f66d0 2022-02-02T18:35:45.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.569+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff98001d960 con 0x7ff98c0f66d0 2022-02-02T18:35:45.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.570+0000 7ff988ff9700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 0x7ff9740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.570+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff980083830 con 0x7ff98c0f66d0 2022-02-02T18:35:45.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.570+0000 7ff98bfff700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 0x7ff9740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.570+0000 7ff98bfff700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 0x7ff9740672e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff98c060060 tx=0x7ff97c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.574+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9800519a0 con 0x7ff98c0f66d0 2022-02-02T18:35:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.748+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff98c0008d0 con 0x7ff974064e20 2022-02-02T18:35:45.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.757+0000 7ff988ff9700 1 -- 172.21.15.96:0/2552821848 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff98c0008d0 con 0x7ff974064e20 2022-02-02T18:35:45.756 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:35:45.756 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (19m) 9m ago 20m 18.0M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:35:45.756 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (11m) 9m ago 20m 7218k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:35:45.757 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (11m) 8m ago 19m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:35:45.757 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (18m) 9m ago 19m 40.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:35:45.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (16m) 9m ago 16m 658M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:35:45.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (11m) 9m ago 16m 13.8M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:35:45.758 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (16m) 8m ago 16m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:35:45.758 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (12m) 8m ago 16m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:35:45.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (13m) 9m ago 21m 468M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:35:45.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (12m) 8m ago 19m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:35:45.758 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (12m) 9m ago 21m 83.4M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:35:45.759 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (12m) 8m ago 19m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:35:45.759 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (19m) 9m ago 19m 18.3M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:35:45.759 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (19m) 8m ago 19m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:35:45.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (11m) 9m ago 19m 249M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:35:45.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (10m) 9m ago 18m 245M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:35:45.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (10m) 9m ago 18m 12.3M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:35:45.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (9m) 8m ago 18m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:35:45.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (9m) 8m ago 17m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:35:45.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (8m) 8m ago 17m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:35:45.761 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (18m) 9m ago 19m 47.8M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:35:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 msgr2=0x7ff9740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 0x7ff9740672e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff98c060060 tx=0x7ff97c009040).stop 2022-02-02T18:35:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 msgr2=0x7ff98c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff980009990 tx=0x7ff980009b30).stop 2022-02-02T18:35:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 shutdown_connections 2022-02-02T18:35:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff974064e20 0x7ff9740672e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff98c0f5430 0x7ff98c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 --2- 172.21.15.96:0/2552821848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff98c0f66d0 0x7ff98c10bf20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 >> 172.21.15.96:0/2552821848 conn(0x7ff98c0f0b90 msgr2=0x7ff98c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:45.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 shutdown_connections 2022-02-02T18:35:45.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.759+0000 7ff99106e700 1 -- 172.21.15.96:0/2552821848 wait complete. 2022-02-02T18:35:45.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 -- 172.21.15.96:0/3223365434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f6530 msgr2=0x7f18c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 --2- 172.21.15.96:0/3223365434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f6530 0x7f18c80f6950 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f18c4004660 tx=0x7f18c4009b30).stop 2022-02-02T18:35:45.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 -- 172.21.15.96:0/3223365434 shutdown_connections 2022-02-02T18:35:45.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 --2- 172.21.15.96:0/3223365434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f77d0 0x7f18c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 --2- 172.21.15.96:0/3223365434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f6530 0x7f18c80f6950 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 -- 172.21.15.96:0/3223365434 >> 172.21.15.96:0/3223365434 conn(0x7f18c80f1c90 msgr2=0x7f18c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.856+0000 7f18ce191700 1 -- 172.21.15.96:0/3223365434 shutdown_connections 2022-02-02T18:35:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 -- 172.21.15.96:0/3223365434 wait complete. 2022-02-02T18:35:45.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 Processor -- start 2022-02-02T18:35:45.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 -- start start 2022-02-02T18:35:45.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f6530 0x7f18c8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c81078f0 con 0x7f18c80f77d0 2022-02-02T18:35:45.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18ce191700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8108100 con 0x7f18c80f6530 2022-02-02T18:35:45.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18cc98e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18cc98e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54868/0 (socket says 172.21.15.96:54868) 2022-02-02T18:35:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.857+0000 7f18cc98e700 1 -- 172.21.15.96:0/521063816 learned_addr learned my addr 172.21.15.96:0/521063816 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18cc98e700 1 -- 172.21.15.96:0/521063816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f6530 msgr2=0x7f18c8106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18cc98e700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f6530 0x7f18c8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:35:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18cc98e700 1 -- 172.21.15.96:0/521063816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4005040 con 0x7f18c80f77d0 2022-02-02T18:35:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18cc98e700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f18b800c790 tx=0x7f18b8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b800e680 con 0x7f18c80f77d0 2022-02-02T18:35:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18b800ec90 con 0x7f18c80f77d0 2022-02-02T18:35:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c8108380 con 0x7f18c80f77d0 2022-02-02T18:35:45.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b8013d60 con 0x7f18c80f77d0 2022-02-02T18:35:45.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.858+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c8108940 con 0x7f18c80f77d0 2022-02-02T18:35:45.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.859+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c8059100 con 0x7f18c80f77d0 2022-02-02T18:35:45.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.860+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18b801a060 con 0x7f18c80f77d0 2022-02-02T18:35:45.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.860+0000 7f18bdffb700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 0x7f18b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:45.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.860+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f18b8081d40 con 0x7f18c80f77d0 2022-02-02T18:35:45.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.860+0000 7f18cd18f700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 0x7f18b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:45.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.861+0000 7f18cd18f700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 0x7f18b40672e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f18c4004e30 tx=0x7f18c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:45.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:45.864+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18b804fdf0 con 0x7f18c80f77d0 2022-02-02T18:35:46.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.094+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f18c80008d0 con 0x7f18c80f77d0 2022-02-02T18:35:46.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.094+0000 7f18bdffb700 1 -- 172.21.15.96:0/521063816 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f18b8053410 con 0x7f18c80f77d0 2022-02-02T18:35:46.094 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:35:46.095 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:35:46.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:35:46.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:46.095 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:35:46.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:35:46.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:46.096 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:35:46.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:35:46.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:46.097 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:35:46.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:35:46.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:35:46.097 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:35:46.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:35:46.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:35:46.098 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:35:46.098 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:35:46.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 msgr2=0x7f18b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 0x7f18b40672e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f18c4004e30 tx=0x7f18c4009b30).stop 2022-02-02T18:35:46.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 msgr2=0x7f18c81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f18b800c790 tx=0x7f18b8007d70).stop 2022-02-02T18:35:46.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 shutdown_connections 2022-02-02T18:35:46.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b4064e20 0x7f18b40672e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f6530 0x7f18c8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:35:46.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 --2- 172.21.15.96:0/521063816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f77d0 0x7f18c81072f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 >> 172.21.15.96:0/521063816 conn(0x7f18c80f1c90 msgr2=0x7f18c80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 shutdown_connections 2022-02-02T18:35:46.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.097+0000 7f18ce191700 1 -- 172.21.15.96:0/521063816 wait complete. 2022-02-02T18:35:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- 172.21.15.96:0/308067941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 msgr2=0x7fee100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 --2- 172.21.15.96:0/308067941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee100f6950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fee04004660 tx=0x7fee04009b30).stop 2022-02-02T18:35:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- 172.21.15.96:0/308067941 shutdown_connections 2022-02-02T18:35:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 --2- 172.21.15.96:0/308067941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 --2- 172.21.15.96:0/308067941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee100f6950 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- 172.21.15.96:0/308067941 >> 172.21.15.96:0/308067941 conn(0x7fee100f1c90 msgr2=0x7fee100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- 172.21.15.96:0/308067941 shutdown_connections 2022-02-02T18:35:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- 172.21.15.96:0/308067941 wait complete. 2022-02-02T18:35:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 Processor -- start 2022-02-02T18:35:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.195+0000 7fee0f59e700 1 -- start start 2022-02-02T18:35:46.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:46.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:46.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a380 con 0x7fee100f6530 2022-02-02T18:35:46.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a4c0 con 0x7fee100f77d0 2022-02-02T18:35:46.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:46.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:58980/0 (socket says 172.21.15.96:58980) 2022-02-02T18:35:46.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 -- 172.21.15.96:0/2756582071 learned_addr learned my addr 172.21.15.96:0/2756582071 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:35:46.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0e59c700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:46.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 -- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 msgr2=0x7fee1006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.196+0000 7fee0dd9b700 1 -- 172.21.15.96:0/2756582071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04005040 con 0x7fee100f77d0 2022-02-02T18:35:46.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fee0dd9b700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fee0000c790 tx=0x7fee00007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:46.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee00002590 con 0x7fee100f77d0 2022-02-02T18:35:46.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee00002ba0 con 0x7fee100f77d0 2022-02-02T18:35:46.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1006a7a0 con 0x7fee100f77d0 2022-02-02T18:35:46.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1010edc0 con 0x7fee100f77d0 2022-02-02T18:35:46.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.197+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee00013d90 con 0x7fee100f77d0 2022-02-02T18:35:46.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.198+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10045ad0 con 0x7fee100f77d0 2022-02-02T18:35:46.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.198+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee0001a060 con 0x7fee100f77d0 2022-02-02T18:35:46.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.199+0000 7fedfeffd700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 0x7fedf80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:35:46.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.199+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee00081d10 con 0x7fee100f77d0 2022-02-02T18:35:46.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.199+0000 7fee0e59c700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 0x7fedf80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:35:46.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.199+0000 7fee0e59c700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 0x7fedf80672e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fee04013690 tx=0x7fee04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:35:46.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.203+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee0004fd60 con 0x7fee100f77d0 2022-02-02T18:35:46.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.404+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee100fecf0 con 0x7fee100f77d0 2022-02-02T18:35:46.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.405+0000 7fedfeffd700 1 -- 172.21.15.96:0/2756582071 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fee00053380 con 0x7fee100f77d0 2022-02-02T18:35:46.404 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:35:46.405 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:35:46.405 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:35:46.405 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:35:46.405 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:46.406 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:35:46.406 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:35:46.406 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:35:46.406 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:35:46.407 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:35:46.407 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:35:46.407 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:35:46.407 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:35:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:35:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:35:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:35:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:35:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:35:46.409 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:35:46.409 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:35:46.409 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:35:46.409 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:35:46.410 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:35:46.410 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:35:46.410 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:35:46.410 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:35:46.411 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:35:46.411 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:35:46.411 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:35:46.411 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:35:46.412 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:35:46.412 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:35:46.412 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:46.413 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:46.413 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:35:46.413 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:35:46.413 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:46.414 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:46.414 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:35:46.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 msgr2=0x7fedf80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 0x7fedf80672e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fee04013690 tx=0x7fee04009b30).stop 2022-02-02T18:35:46.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 msgr2=0x7fee10069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:35:46.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fee0000c790 tx=0x7fee00007d70).stop 2022-02-02T18:35:46.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 shutdown_connections 2022-02-02T18:35:46.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064e20 0x7fedf80672e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 --2- 172.21.15.96:0/2756582071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:35:46.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 >> 172.21.15.96:0/2756582071 conn(0x7fee100f1c90 msgr2=0x7fee100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:35:46.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 shutdown_connections 2022-02-02T18:35:46.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:35:46.408+0000 7fee0f59e700 1 -- 172.21.15.96:0/2756582071 wait complete. 2022-02-02T18:35:46.417 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:35:46.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:46 smithi096 ceph-mon[101353]: pgmap v409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:46.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:46 smithi096 ceph-mon[101353]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:46.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/521063816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:46 smithi159 ceph-mon[69013]: pgmap v409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:46 smithi159 ceph-mon[69013]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/521063816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:47.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:47 smithi159 ceph-mon[69013]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:47.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2756582071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:35:47.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:47 smithi096 ceph-mon[101353]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:35:47.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2756582071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:35:48.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:48 smithi096 ceph-mon[101353]: pgmap v410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:48.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:48.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:48.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:48 smithi159 ceph-mon[69013]: pgmap v410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:35:48.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:35:49.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:49 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:49.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:49 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:35:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:50 smithi159 ceph-mon[69013]: pgmap v411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:50 smithi096 ceph-mon[101353]: pgmap v411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:52 smithi159 ceph-mon[69013]: pgmap v412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:52 smithi096 ceph-mon[101353]: pgmap v412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:54 smithi159 ceph-mon[69013]: pgmap v413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:54 smithi096 ceph-mon[101353]: pgmap v413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:55.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:55.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:55.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:55 smithi159 ceph-mon[69013]: pgmap v414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:55.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:55.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:35:55.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:35:55.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:35:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:35:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:55 smithi096 ceph-mon[101353]: pgmap v414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:58.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:57 smithi159 ceph-mon[69013]: pgmap v415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:35:58.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:57 smithi096 ceph-mon[101353]: pgmap v415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:00.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:35:59 smithi159 ceph-mon[69013]: pgmap v416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:00.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:35:59 smithi096 ceph-mon[101353]: pgmap v416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:02.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:02 smithi159 ceph-mon[69013]: pgmap v417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:02.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:02 smithi096 ceph-mon[101353]: pgmap v417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:04.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:04 smithi159 ceph-mon[69013]: pgmap v418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:04.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:04 smithi096 ceph-mon[101353]: pgmap v418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:05.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:05.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:05.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:05.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:05.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:05.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:05 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:05.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:05.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:05.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:05.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:05 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:06.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:06 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:06.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:06 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:06.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:06 smithi159 ceph-mon[69013]: pgmap v419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:06.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:06 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:06.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:06 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:06.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:06 smithi096 ceph-mon[101353]: pgmap v419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:08.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:08 smithi159 ceph-mon[69013]: pgmap v420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:08.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:08 smithi096 ceph-mon[101353]: pgmap v420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:10.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:10 smithi159 ceph-mon[69013]: pgmap v421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:10.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:10 smithi096 ceph-mon[101353]: pgmap v421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:12.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:12 smithi159 ceph-mon[69013]: pgmap v422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:12.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:12 smithi096 ceph-mon[101353]: pgmap v422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:14.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:14 smithi159 ceph-mon[69013]: pgmap v423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:14.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:14 smithi096 ceph-mon[101353]: pgmap v423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:15.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:15.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:15.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:15.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:15 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:15.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:15.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:15.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:15.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:15.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:15 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:16.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:16 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:16.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:16 smithi096 ceph-mon[101353]: pgmap v424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:16.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:16 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:16.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1036141045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f55c0 msgr2=0x7ff9f80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1036141045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f55c0 0x7ff9f80f59e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff9e8004660 tx=0x7ff9e8009b30).stop 2022-02-02T18:36:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1036141045 shutdown_connections 2022-02-02T18:36:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1036141045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f6860 0x7ff9f80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1036141045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f55c0 0x7ff9f80f59e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1036141045 >> 172.21.15.96:0/1036141045 conn(0x7ff9f80f0d40 msgr2=0x7ff9f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1036141045 shutdown_connections 2022-02-02T18:36:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.520+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1036141045 wait complete. 2022-02-02T18:36:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 Processor -- start 2022-02-02T18:36:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 -- start start 2022-02-02T18:36:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f55c0 0x7ff9f8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81069f0 con 0x7ff9f80f6860 2022-02-02T18:36:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9ff53b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81072a0 con 0x7ff9f80f55c0 2022-02-02T18:36:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9fcad6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9fcad6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54896/0 (socket says 172.21.15.96:54896) 2022-02-02T18:36:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.521+0000 7ff9fcad6700 1 -- 172.21.15.96:0/1316603956 learned_addr learned my addr 172.21.15.96:0/1316603956 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9fd2d7700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f55c0 0x7ff9f8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9fcad6700 1 -- 172.21.15.96:0/1316603956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f55c0 msgr2=0x7ff9f8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9fcad6700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f55c0 0x7ff9f8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9fcad6700 1 -- 172.21.15.96:0/1316603956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8005040 con 0x7ff9f80f6860 2022-02-02T18:36:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9fcad6700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ff9f400b410 tx=0x7ff9f4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f40125f0 con 0x7ff9f80f6860 2022-02-02T18:36:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9f4012c00 con 0x7ff9f80f6860 2022-02-02T18:36:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8107580 con 0x7ff9f80f6860 2022-02-02T18:36:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f4002ae0 con 0x7ff9f80f6860 2022-02-02T18:36:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.522+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8107b40 con 0x7ff9f80f6860 2022-02-02T18:36:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.523+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80f49b0 con 0x7ff9f80f6860 2022-02-02T18:36:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:16 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:16 smithi159 ceph-mon[69013]: pgmap v424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:16.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:16 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:16.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.524+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9f400f030 con 0x7ff9f80f6860 2022-02-02T18:36:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.525+0000 7ff9edffb700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 0x7ff9e4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.525+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9f4082220 con 0x7ff9f80f6860 2022-02-02T18:36:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.525+0000 7ff9fd2d7700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 0x7ff9e4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.525+0000 7ff9fd2d7700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 0x7ff9e4067270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff9e8013690 tx=0x7ff9e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:16.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.528+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9f4053d80 con 0x7ff9f80f6860 2022-02-02T18:36:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.709+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9f80fdee0 con 0x7ff9e4064db0 2022-02-02T18:36:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.710+0000 7ff9edffb700 1 -- 172.21.15.96:0/1316603956 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff9f80fdee0 con 0x7ff9e4064db0 2022-02-02T18:36:16.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 msgr2=0x7ff9e4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 0x7ff9e4067270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff9e8013690 tx=0x7ff9e8009b30).stop 2022-02-02T18:36:16.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 msgr2=0x7ff9f81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ff9f400b410 tx=0x7ff9f4006ef0).stop 2022-02-02T18:36:16.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 shutdown_connections 2022-02-02T18:36:16.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9e4064db0 0x7ff9e4067270 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f80f55c0 0x7ff9f8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 --2- 172.21.15.96:0/1316603956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9f80f6860 0x7ff9f81063b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 >> 172.21.15.96:0/1316603956 conn(0x7ff9f80f0d40 msgr2=0x7ff9f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 shutdown_connections 2022-02-02T18:36:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.712+0000 7ff9ff53b700 1 -- 172.21.15.96:0/1316603956 wait complete. 2022-02-02T18:36:16.720 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:36:16.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.810+0000 7f3fb328d700 1 -- 172.21.15.96:0/2108080213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 msgr2=0x7f3fac0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.810+0000 7f3fb328d700 1 --2- 172.21.15.96:0/2108080213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac0f6b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3f9c004660 tx=0x7f3f9c009b30).stop 2022-02-02T18:36:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- 172.21.15.96:0/2108080213 shutdown_connections 2022-02-02T18:36:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 --2- 172.21.15.96:0/2108080213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac0f6b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 --2- 172.21.15.96:0/2108080213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- 172.21.15.96:0/2108080213 >> 172.21.15.96:0/2108080213 conn(0x7f3fac0f0b90 msgr2=0x7f3fac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- 172.21.15.96:0/2108080213 shutdown_connections 2022-02-02T18:36:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- 172.21.15.96:0/2108080213 wait complete. 2022-02-02T18:36:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 Processor -- start 2022-02-02T18:36:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- start start 2022-02-02T18:36:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac107980 con 0x7f3fac0f66d0 2022-02-02T18:36:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb328d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac108100 con 0x7f3fac0f5430 2022-02-02T18:36:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb1a8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb1a8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54904/0 (socket says 172.21.15.96:54904) 2022-02-02T18:36:16.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.811+0000 7f3fb1a8a700 1 -- 172.21.15.96:0/1688041 learned_addr learned my addr 172.21.15.96:0/1688041 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:16.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb1a8a700 1 -- 172.21.15.96:0/1688041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 msgr2=0x7f3fac106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:16.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb228b700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb1a8a700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:16.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb1a8a700 1 -- 172.21.15.96:0/1688041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c005040 con 0x7f3fac0f66d0 2022-02-02T18:36:16.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb228b700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:36:16.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb1a8a700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3f9c009990 tx=0x7f3f9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:16.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c018070 con 0x7f3fac0f66d0 2022-02-02T18:36:16.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac108320 con 0x7f3fac0f66d0 2022-02-02T18:36:16.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f9c007ca0 con 0x7f3fac0f66d0 2022-02-02T18:36:16.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c01c620 con 0x7f3fac0f66d0 2022-02-02T18:36:16.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.812+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac108880 con 0x7f3fac0f66d0 2022-02-02T18:36:16.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.813+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac045ad0 con 0x7f3fac0f66d0 2022-02-02T18:36:16.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.814+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f9c01d960 con 0x7f3fac0f66d0 2022-02-02T18:36:16.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.814+0000 7f3fa2ffd700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 0x7f3f980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:16.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.814+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f9c083950 con 0x7f3fac0f66d0 2022-02-02T18:36:16.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.814+0000 7f3fb228b700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 0x7f3f980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:16.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.815+0000 7f3fb228b700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 0x7f3f980672e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3fac106b70 tx=0x7f3fa8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:16.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.818+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f9c051a00 con 0x7f3fac0f66d0 2022-02-02T18:36:16.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:16.991+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fac0fab10 con 0x7f3f98064e20 2022-02-02T18:36:16.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.000+0000 7f3fa2ffd700 1 -- 172.21.15.96:0/1688041 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3fac0fab10 con 0x7f3f98064e20 2022-02-02T18:36:16.998 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:36:16.998 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (19m) 22s ago 20m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:36:16.998 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (12m) 22s ago 20m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:36:16.999 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (12m) 9m ago 20m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:36:16.999 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (19m) 22s ago 20m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:36:16.999 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (16m) 22s ago 16m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:36:16.999 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (12m) 22s ago 16m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:36:17.000 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (16m) 9m ago 16m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:36:17.000 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (12m) 9m ago 16m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:36:17.000 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (13m) 22s ago 21m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:36:17.000 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (13m) 9m ago 20m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:36:17.001 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (12m) 22s ago 21m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:36:17.001 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (12m) 9m ago 20m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:36:17.001 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (20m) 22s ago 20m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:36:17.001 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (19m) 9m ago 19m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:36:17.001 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (11m) 22s ago 19m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:36:17.002 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (11m) 22s ago 19m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:36:17.002 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (10m) 22s ago 18m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:36:17.002 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (10m) 9m ago 18m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:36:17.002 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (9m) 9m ago 18m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:36:17.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (9m) 9m ago 18m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:36:17.003 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (19m) 22s ago 20m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:36:17.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 msgr2=0x7f3f980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 0x7f3f980672e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3fac106b70 tx=0x7f3fa8008040).stop 2022-02-02T18:36:17.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 msgr2=0x7f3fac1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3f9c009990 tx=0x7f3f9c009b30).stop 2022-02-02T18:36:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 shutdown_connections 2022-02-02T18:36:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f98064e20 0x7f3f980672e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac0f5430 0x7f3fac106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 --2- 172.21.15.96:0/1688041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fac0f66d0 0x7f3fac1072f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 >> 172.21.15.96:0/1688041 conn(0x7f3fac0f0b90 msgr2=0x7f3fac05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 shutdown_connections 2022-02-02T18:36:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.002+0000 7f3fb328d700 1 -- 172.21.15.96:0/1688041 wait complete. 2022-02-02T18:36:17.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 -- 172.21.15.96:0/1170985756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 msgr2=0x7ff3980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 --2- 172.21.15.96:0/1170985756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff3980f7de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7ff388004660 tx=0x7ff388009b30).stop 2022-02-02T18:36:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 -- 172.21.15.96:0/1170985756 shutdown_connections 2022-02-02T18:36:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 --2- 172.21.15.96:0/1170985756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff3980f7de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 --2- 172.21.15.96:0/1170985756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 0x7ff3980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 -- 172.21.15.96:0/1170985756 >> 172.21.15.96:0/1170985756 conn(0x7ff3980f1e40 msgr2=0x7ff3980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 -- 172.21.15.96:0/1170985756 shutdown_connections 2022-02-02T18:36:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.099+0000 7ff39c838700 1 -- 172.21.15.96:0/1170985756 wait complete. 2022-02-02T18:36:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 Processor -- start 2022-02-02T18:36:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 -- start start 2022-02-02T18:36:17.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 0x7ff398106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398107a00 con 0x7ff3980f7980 2022-02-02T18:36:17.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff39c838700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398107b40 con 0x7ff3980f66e0 2022-02-02T18:36:17.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff395d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff395d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54914/0 (socket says 172.21.15.96:54914) 2022-02-02T18:36:17.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.100+0000 7ff395d9b700 1 -- 172.21.15.96:0/4063299641 learned_addr learned my addr 172.21.15.96:0/4063299641 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff39659c700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 0x7ff398106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff395d9b700 1 -- 172.21.15.96:0/4063299641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 msgr2=0x7ff398106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff395d9b700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 0x7ff398106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff395d9b700 1 -- 172.21.15.96:0/4063299641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388005040 con 0x7ff3980f7980 2022-02-02T18:36:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff395d9b700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff388009830 tx=0x7ff388009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff388018070 con 0x7ff3980f7980 2022-02-02T18:36:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff388007ba0 con 0x7ff3980f7980 2022-02-02T18:36:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398108480 con 0x7ff3980f7980 2022-02-02T18:36:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38801c620 con 0x7ff3980f7980 2022-02-02T18:36:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.101+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3981089e0 con 0x7ff3980f7980 2022-02-02T18:36:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.102+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff398045ad0 con 0x7ff3980f7980 2022-02-02T18:36:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.102+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff388007d10 con 0x7ff3980f7980 2022-02-02T18:36:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.103+0000 7ff386ffd700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 0x7ff380067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.103+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff3880837e0 con 0x7ff3980f7980 2022-02-02T18:36:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.103+0000 7ff39659c700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 0x7ff380067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.104+0000 7ff39659c700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 0x7ff380067270 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff3980f77e0 tx=0x7ff38c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.107+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff388055380 con 0x7ff3980f7980 2022-02-02T18:36:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.338+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff398027a00 con 0x7ff3980f7980 2022-02-02T18:36:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.339+0000 7ff386ffd700 1 -- 172.21.15.96:0/4063299641 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff388054f70 con 0x7ff3980f7980 2022-02-02T18:36:17.337 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:36:17.337 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:36:17.338 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:36:17.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:17.338 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:36:17.338 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:36:17.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:17.339 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:36:17.339 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:36:17.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:17.339 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:36:17.340 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:36:17.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:17.340 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:36:17.340 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:36:17.341 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:36:17.341 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:36:17.341 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:36:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 msgr2=0x7ff380067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 0x7ff380067270 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff3980f77e0 tx=0x7ff38c009c00).stop 2022-02-02T18:36:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 msgr2=0x7ff398107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff388009830 tx=0x7ff388009b30).stop 2022-02-02T18:36:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 shutdown_connections 2022-02-02T18:36:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff380064db0 0x7ff380067270 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3980f66e0 0x7ff398106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 --2- 172.21.15.96:0/4063299641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3980f7980 0x7ff398107450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 >> 172.21.15.96:0/4063299641 conn(0x7ff3980f1e40 msgr2=0x7ff3980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.340+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 shutdown_connections 2022-02-02T18:36:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.341+0000 7ff39c838700 1 -- 172.21.15.96:0/4063299641 wait complete. 2022-02-02T18:36:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1219759013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 msgr2=0x7fa0580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1219759013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa0580f59e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fa048004660 tx=0x7fa048009b30).stop 2022-02-02T18:36:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1219759013 shutdown_connections 2022-02-02T18:36:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1219759013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa0580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1219759013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa0580f59e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1219759013 >> 172.21.15.96:0/1219759013 conn(0x7fa0580f0d40 msgr2=0x7fa0580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1219759013 shutdown_connections 2022-02-02T18:36:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.439+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1219759013 wait complete. 2022-02-02T18:36:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 Processor -- start 2022-02-02T18:36:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 -- start start 2022-02-02T18:36:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa058106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058106910 con 0x7fa0580f55c0 2022-02-02T18:36:17.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05f9f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058106a50 con 0x7fa0580f6860 2022-02-02T18:36:17.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54922/0 (socket says 172.21.15.96:54922) 2022-02-02T18:36:17.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 -- 172.21.15.96:0/1613500592 learned_addr learned my addr 172.21.15.96:0/1613500592 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:17.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05cf8e700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa058106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 -- 172.21.15.96:0/1613500592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 msgr2=0x7fa058106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa058106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05d78f700 1 -- 172.21.15.96:0/1613500592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048005040 con 0x7fa0580f55c0 2022-02-02T18:36:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.440+0000 7fa05cf8e700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa058106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:36:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa05d78f700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fa048013a70 tx=0x7fa048009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa048018070 con 0x7fa0580f55c0 2022-02-02T18:36:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa058107390 con 0x7fa0580f55c0 2022-02-02T18:36:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0480097d0 con 0x7fa0580f55c0 2022-02-02T18:36:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa04801c3c0 con 0x7fa0580f55c0 2022-02-02T18:36:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.441+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0581078f0 con 0x7fa0580f55c0 2022-02-02T18:36:17.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.442+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058045ad0 con 0x7fa0580f55c0 2022-02-02T18:36:17.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.443+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa048007ba0 con 0x7fa0580f55c0 2022-02-02T18:36:17.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.443+0000 7fa04dffb700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 0x7fa0440694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:17.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.443+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa048083780 con 0x7fa0580f55c0 2022-02-02T18:36:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.443+0000 7fa05cf8e700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 0x7fa0440694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.444+0000 7fa05cf8e700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 0x7fa0440694a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa054009740 tx=0x7fa054009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.447+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa048055320 con 0x7fa0580f55c0 2022-02-02T18:36:17.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.649+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0581080b0 con 0x7fa0580f55c0 2022-02-02T18:36:17.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.650+0000 7fa04dffb700 1 -- 172.21.15.96:0/1613500592 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa048054f10 con 0x7fa0580f55c0 2022-02-02T18:36:17.648 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:36:17.649 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:36:17.649 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:36:17.649 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:36:17.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:17.650 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:36:17.650 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:36:17.650 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:36:17.650 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:36:17.651 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:36:17.651 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:36:17.651 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:36:17.652 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:36:17.652 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:36:17.652 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:36:17.652 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:36:17.652 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:36:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:36:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:36:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:36:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:36:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:36:17.654 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:36:17.654 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:36:17.654 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:36:17.654 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:36:17.655 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:36:17.655 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:36:17.655 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:36:17.655 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:36:17.656 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:36:17.656 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:36:17.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:17.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:17.657 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:36:17.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:17.657 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:17.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:17.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:17.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.651+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 msgr2=0x7fa0440694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.651+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 0x7fa0440694a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa054009740 tx=0x7fa054009be0).stop 2022-02-02T18:36:17.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.651+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 msgr2=0x7fa058105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:17.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.651+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fa048013a70 tx=0x7fa048009b30).stop 2022-02-02T18:36:17.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 shutdown_connections 2022-02-02T18:36:17.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa044066fe0 0x7fa0440694a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0580f55c0 0x7fa058105e70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 --2- 172.21.15.96:0/1613500592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580f6860 0x7fa058106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:17.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 >> 172.21.15.96:0/1613500592 conn(0x7fa0580f0d40 msgr2=0x7fa0580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:17.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 shutdown_connections 2022-02-02T18:36:17.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:17.652+0000 7fa05f9f3700 1 -- 172.21.15.96:0/1613500592 wait complete. 2022-02-02T18:36:17.662 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:36:18.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:18 smithi159 ceph-mon[69013]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:18.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:18 smithi159 ceph-mon[69013]: pgmap v425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:18 smithi159 ceph-mon[69013]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4063299641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1613500592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:36:18.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:18 smithi096 ceph-mon[101353]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:18 smithi096 ceph-mon[101353]: pgmap v425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:18 smithi096 ceph-mon[101353]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4063299641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:18.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1613500592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:36:20.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:20 smithi159 ceph-mon[69013]: pgmap v426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:20.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:20 smithi096 ceph-mon[101353]: pgmap v426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:22.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:22 smithi159 ceph-mon[69013]: pgmap v427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:22.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:22 smithi096 ceph-mon[101353]: pgmap v427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:24.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:24 smithi096 ceph-mon[101353]: pgmap v428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:24 smithi159 ceph-mon[69013]: pgmap v428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:25.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:25.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:25.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:25.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:26.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:26 smithi096 ceph-mon[101353]: pgmap v429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:26.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:26 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:26.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:26 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:26.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:26 smithi159 ceph-mon[69013]: pgmap v429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:26.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:26 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:26.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:26 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:27.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:36:27.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:36:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:36:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:36:28.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:28 smithi096 ceph-mon[101353]: pgmap v430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:28 smithi159 ceph-mon[69013]: pgmap v430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:30.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:30 smithi096 ceph-mon[101353]: pgmap v431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:30 smithi159 ceph-mon[69013]: pgmap v431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:32.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:32 smithi096 ceph-mon[101353]: pgmap v432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:32 smithi159 ceph-mon[69013]: pgmap v432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:34.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:34 smithi096 ceph-mon[101353]: pgmap v433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:34 smithi159 ceph-mon[69013]: pgmap v433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:35.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:35.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:35.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:35.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:35.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:35.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: pgmap v434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:36 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: pgmap v434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:36.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:36 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:38 smithi159 ceph-mon[69013]: pgmap v435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:38 smithi096 ceph-mon[101353]: pgmap v435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:40 smithi159 ceph-mon[69013]: pgmap v436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:40 smithi096 ceph-mon[101353]: pgmap v436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:42 smithi159 ceph-mon[69013]: pgmap v437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:42 smithi096 ceph-mon[101353]: pgmap v437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:44 smithi159 ceph-mon[69013]: pgmap v438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:44 smithi096 ceph-mon[101353]: pgmap v438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: pgmap v439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:46 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: pgmap v439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:46.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:46 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 -- 172.21.15.96:0/927006712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 msgr2=0x7f80b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 --2- 172.21.15.96:0/927006712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b80f59e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f80ac004660 tx=0x7f80ac009b30).stop 2022-02-02T18:36:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 -- 172.21.15.96:0/927006712 shutdown_connections 2022-02-02T18:36:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 --2- 172.21.15.96:0/927006712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 --2- 172.21.15.96:0/927006712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b80f59e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 -- 172.21.15.96:0/927006712 >> 172.21.15.96:0/927006712 conn(0x7f80b80f0d40 msgr2=0x7f80b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 -- 172.21.15.96:0/927006712 shutdown_connections 2022-02-02T18:36:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 -- 172.21.15.96:0/927006712 wait complete. 2022-02-02T18:36:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.764+0000 7f80bcd06700 1 Processor -- start 2022-02-02T18:36:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80bcd06700 1 -- start start 2022-02-02T18:36:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80bcd06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80bcd06700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b8109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80bcd06700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8109cb0 con 0x7f80b80f55c0 2022-02-02T18:36:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80bcd06700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b810a560 con 0x7f80b80f6860 2022-02-02T18:36:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54944/0 (socket says 172.21.15.96:54944) 2022-02-02T18:36:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 -- 172.21.15.96:0/3623032565 learned_addr learned my addr 172.21.15.96:0/3623032565 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b5d9b700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b8109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 -- 172.21.15.96:0/3623032565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 msgr2=0x7f80b8109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b8109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 -- 172.21.15.96:0/3623032565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac005040 con 0x7f80b80f55c0 2022-02-02T18:36:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b5d9b700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:36:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.765+0000 7f80b659c700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f80ac004f60 tx=0x7f80ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.766+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ac018070 con 0x7f80b80f55c0 2022-02-02T18:36:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.766+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80ac007ba0 con 0x7f80b80f55c0 2022-02-02T18:36:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.766+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b810a7e0 con 0x7f80b80f55c0 2022-02-02T18:36:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.766+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ac01c620 con 0x7f80b80f55c0 2022-02-02T18:36:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.766+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b810ad40 con 0x7f80b80f55c0 2022-02-02T18:36:47.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.767+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b80f49b0 con 0x7f80b80f55c0 2022-02-02T18:36:47.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.767+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80ac01c8e0 con 0x7f80b80f55c0 2022-02-02T18:36:47.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.767+0000 7f80a6ffd700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 0x7f80a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.768+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f80ac0839b0 con 0x7f80b80f55c0 2022-02-02T18:36:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.768+0000 7f80b5d9b700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 0x7f80a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.768+0000 7f80b5d9b700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 0x7f80a0067290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f80a800b830 tx=0x7f80a8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.772+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80ac055490 con 0x7f80b80f55c0 2022-02-02T18:36:47.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.950+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80b80faaa0 con 0x7f80a0064dd0 2022-02-02T18:36:47.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.951+0000 7f80a6ffd700 1 -- 172.21.15.96:0/3623032565 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f80b80faaa0 con 0x7f80a0064dd0 2022-02-02T18:36:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 msgr2=0x7f80a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 0x7f80a0067290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f80a800b830 tx=0x7f80a8008040).stop 2022-02-02T18:36:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 msgr2=0x7f80b8109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f80ac004f60 tx=0x7f80ac009b30).stop 2022-02-02T18:36:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 shutdown_connections 2022-02-02T18:36:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80a0064dd0 0x7f80a0067290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b80f55c0 0x7f80b8109180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 --2- 172.21.15.96:0/3623032565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b80f6860 0x7f80b8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 >> 172.21.15.96:0/3623032565 conn(0x7f80b80f0d40 msgr2=0x7f80b805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 shutdown_connections 2022-02-02T18:36:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:47.953+0000 7f80bcd06700 1 -- 172.21.15.96:0/3623032565 wait complete. 2022-02-02T18:36:47.961 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:36:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 -- 172.21.15.96:0/221775238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 msgr2=0x7fc2e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 --2- 172.21.15.96:0/221775238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e40f6b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fc2d4004660 tx=0x7fc2d4009b30).stop 2022-02-02T18:36:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 -- 172.21.15.96:0/221775238 shutdown_connections 2022-02-02T18:36:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 --2- 172.21.15.96:0/221775238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e40f7980 0x7fc2e40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 --2- 172.21.15.96:0/221775238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e40f6b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 -- 172.21.15.96:0/221775238 >> 172.21.15.96:0/221775238 conn(0x7fc2e40f1e40 msgr2=0x7fc2e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 -- 172.21.15.96:0/221775238 shutdown_connections 2022-02-02T18:36:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.051+0000 7fc2e9610700 1 -- 172.21.15.96:0/221775238 wait complete. 2022-02-02T18:36:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 Processor -- start 2022-02-02T18:36:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 -- start start 2022-02-02T18:36:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e40f7980 0x7fc2e41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4107ae0 con 0x7fc2e40f66e0 2022-02-02T18:36:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e9610700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4108390 con 0x7fc2e40f7980 2022-02-02T18:36:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54954/0 (socket says 172.21.15.96:54954) 2022-02-02T18:36:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.052+0000 7fc2e2ffd700 1 -- 172.21.15.96:0/2879777695 learned_addr learned my addr 172.21.15.96:0/2879777695 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e2ffd700 1 -- 172.21.15.96:0/2879777695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e40f7980 msgr2=0x7fc2e41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e2ffd700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e40f7980 0x7fc2e41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e2ffd700 1 -- 172.21.15.96:0/2879777695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4005040 con 0x7fc2e40f66e0 2022-02-02T18:36:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e2ffd700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc2d4004f60 tx=0x7fc2d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d4018070 con 0x7fc2e40f66e0 2022-02-02T18:36:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2d4007ba0 con 0x7fc2e40f66e0 2022-02-02T18:36:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e4108610 con 0x7fc2e40f66e0 2022-02-02T18:36:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d401c620 con 0x7fc2e40f66e0 2022-02-02T18:36:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.053+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e4108b70 con 0x7fc2e40f66e0 2022-02-02T18:36:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.054+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c4004fa0 con 0x7fc2e40f66e0 2022-02-02T18:36:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.055+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2d401c8e0 con 0x7fc2e40f66e0 2022-02-02T18:36:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.055+0000 7fc2cb7fe700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.055+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc2d4083970 con 0x7fc2e40f66e0 2022-02-02T18:36:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.055+0000 7fc2e27fc700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.056+0000 7fc2e27fc700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc2d8009610 tx=0x7fc2d8006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.059+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2d4055510 con 0x7fc2e40f66e0 2022-02-02T18:36:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.232+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2c4000bc0 con 0x7fc2cc064dd0 2022-02-02T18:36:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.241+0000 7fc2cb7fe700 1 -- 172.21.15.96:0/2879777695 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc2c4000bc0 con 0x7fc2cc064dd0 2022-02-02T18:36:48.240 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:36:48.240 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (20m) 53s ago 21m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:36:48.240 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (12m) 53s ago 21m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:36:48.240 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (12m) 9m ago 20m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:36:48.241 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (20m) 53s ago 21m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:36:48.241 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (17m) 53s ago 17m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:36:48.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (12m) 53s ago 17m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:36:48.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (17m) 9m ago 17m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:36:48.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (13m) 9m ago 17m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:36:48.242 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (14m) 53s ago 22m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:36:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (13m) 9m ago 20m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:36:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (13m) 53s ago 22m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:36:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (13m) 9m ago 20m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:36:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (20m) 53s ago 20m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:36:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (20m) 9m ago 20m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:36:48.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (12m) 53s ago 20m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:36:48.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (11m) 53s ago 19m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:36:48.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (11m) 53s ago 19m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:36:48.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (10m) 9m ago 19m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:36:48.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (10m) 9m ago 18m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:36:48.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (9m) 9m ago 18m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:36:48.245 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (19m) 53s ago 20m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:36:48.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 msgr2=0x7fc2cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc2d8009610 tx=0x7fc2d8006ab0).stop 2022-02-02T18:36:48.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 msgr2=0x7fc2e4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc2d4004f60 tx=0x7fc2d4009b30).stop 2022-02-02T18:36:48.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 shutdown_connections 2022-02-02T18:36:48.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e40f66e0 0x7fc2e4106fb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 --2- 172.21.15.96:0/2879777695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e40f7980 0x7fc2e41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:36:48.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 >> 172.21.15.96:0/2879777695 conn(0x7fc2e40f1e40 msgr2=0x7fc2e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 shutdown_connections 2022-02-02T18:36:48.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.243+0000 7fc2e9610700 1 -- 172.21.15.96:0/2879777695 wait complete. 2022-02-02T18:36:48.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 -- 172.21.15.96:0/1958901997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 msgr2=0x7fa9140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 --2- 172.21.15.96:0/1958901997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9140f6cc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa900004660 tx=0x7fa900009b30).stop 2022-02-02T18:36:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 -- 172.21.15.96:0/1958901997 shutdown_connections 2022-02-02T18:36:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 --2- 172.21.15.96:0/1958901997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9140f6cc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 --2- 172.21.15.96:0/1958901997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 0x7fa9140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 -- 172.21.15.96:0/1958901997 >> 172.21.15.96:0/1958901997 conn(0x7fa9140f0d40 msgr2=0x7fa9140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 -- 172.21.15.96:0/1958901997 shutdown_connections 2022-02-02T18:36:48.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.342+0000 7fa91b04e700 1 -- 172.21.15.96:0/1958901997 wait complete. 2022-02-02T18:36:48.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 Processor -- start 2022-02-02T18:36:48.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 -- start start 2022-02-02T18:36:48.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 0x7fa914105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141069b0 con 0x7fa9140f6860 2022-02-02T18:36:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa91b04e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141071c0 con 0x7fa9140f55c0 2022-02-02T18:36:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.343+0000 7fa913fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54966/0 (socket says 172.21.15.96:54966) 2022-02-02T18:36:48.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 -- 172.21.15.96:0/2796972381 learned_addr learned my addr 172.21.15.96:0/2796972381 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:48.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa918dea700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 0x7fa914105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 -- 172.21.15.96:0/2796972381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 msgr2=0x7fa914105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 0x7fa914105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 -- 172.21.15.96:0/2796972381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900005040 con 0x7fa9140f6860 2022-02-02T18:36:48.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa913fff700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa900009990 tx=0x7fa900009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa900018070 con 0x7fa9140f6860 2022-02-02T18:36:48.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa900007ca0 con 0x7fa9140f6860 2022-02-02T18:36:48.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9141073e0 con 0x7fa9140f6860 2022-02-02T18:36:48.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90001c620 con 0x7fa9140f6860 2022-02-02T18:36:48.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.344+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa914107860 con 0x7fa9140f6860 2022-02-02T18:36:48.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.345+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa914045ad0 con 0x7fa9140f6860 2022-02-02T18:36:48.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.346+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa90001d960 con 0x7fa9140f6860 2022-02-02T18:36:48.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.346+0000 7fa9117fa700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 0x7fa904067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.346+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa900083810 con 0x7fa9140f6860 2022-02-02T18:36:48.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.346+0000 7fa918dea700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 0x7fa904067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.346+0000 7fa918dea700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 0x7fa904067290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa914105c30 tx=0x7fa908009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.350+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa900051980 con 0x7fa9140f6860 2022-02-02T18:36:48.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.584+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa914108020 con 0x7fa9140f6860 2022-02-02T18:36:48.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.585+0000 7fa9117fa700 1 -- 172.21.15.96:0/2796972381 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa900054fa0 con 0x7fa9140f6860 2022-02-02T18:36:48.583 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:36:48.584 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:36:48.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:36:48.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:48.585 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:36:48.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:36:48.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:48.585 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:36:48.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:36:48.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:48.586 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:36:48.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:36:48.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:36:48.587 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:36:48.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:36:48.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:36:48.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:36:48.588 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:36:48.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 msgr2=0x7fa904067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 0x7fa904067290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa914105c30 tx=0x7fa908009040).stop 2022-02-02T18:36:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 msgr2=0x7fa9141063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa900009990 tx=0x7fa900009b30).stop 2022-02-02T18:36:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 shutdown_connections 2022-02-02T18:36:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa904064dd0 0x7fa904067290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9140f55c0 0x7fa914105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 --2- 172.21.15.96:0/2796972381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9140f6860 0x7fa9141063b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 >> 172.21.15.96:0/2796972381 conn(0x7fa9140f0d40 msgr2=0x7fa9140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 shutdown_connections 2022-02-02T18:36:48.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.587+0000 7fa91b04e700 1 -- 172.21.15.96:0/2796972381 wait complete. 2022-02-02T18:36:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 -- 172.21.15.96:0/2393024159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 msgr2=0x7fcd2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 --2- 172.21.15.96:0/2393024159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c0f59e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fcd1c004660 tx=0x7fcd1c009b30).stop 2022-02-02T18:36:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 -- 172.21.15.96:0/2393024159 shutdown_connections 2022-02-02T18:36:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 --2- 172.21.15.96:0/2393024159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 0x7fcd2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 --2- 172.21.15.96:0/2393024159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c0f59e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 -- 172.21.15.96:0/2393024159 >> 172.21.15.96:0/2393024159 conn(0x7fcd2c0f0d40 msgr2=0x7fcd2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:48 smithi096 ceph-mon[101353]: pgmap v440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 -- 172.21.15.96:0/2393024159 shutdown_connections 2022-02-02T18:36:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.685+0000 7fcd33453700 1 -- 172.21.15.96:0/2393024159 wait complete. 2022-02-02T18:36:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 Processor -- start 2022-02-02T18:36:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 -- start start 2022-02-02T18:36:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 0x7fcd2c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0602d0 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd33453700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c060410 con 0x7fcd2c0f6860 2022-02-02T18:36:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54974/0 (socket says 172.21.15.96:54974) 2022-02-02T18:36:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 -- 172.21.15.96:0/890942554 learned_addr learned my addr 172.21.15.96:0/890942554 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:36:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd309ee700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 0x7fcd2c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 -- 172.21.15.96:0/890942554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 msgr2=0x7fcd2c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 0x7fcd2c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.686+0000 7fcd311ef700 1 -- 172.21.15.96:0/890942554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c005040 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd311ef700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fcd1c004f60 tx=0x7fcd1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1c018070 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd1c009770 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1c01c3c0 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c10ea60 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.687+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c10ee30 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.688+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c045ad0 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.689+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd1c01d420 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.689+0000 7fcd21ffb700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 0x7fcd18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:36:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.689+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcd1c083890 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.689+0000 7fcd309ee700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 0x7fcd18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:36:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.690+0000 7fcd309ee700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 0x7fcd18067290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd280041d0 tx=0x7fcd28009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:36:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.693+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd1c051a00 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:48 smithi159 ceph-mon[69013]: pgmap v440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:48.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.895+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd2c0fde90 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.896+0000 7fcd21ffb700 1 -- 172.21.15.96:0/890942554 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcd1c055020 con 0x7fcd2c0f55c0 2022-02-02T18:36:48.894 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:36:48.894 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:36:48.895 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:36:48.895 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:36:48.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:48.895 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:36:48.896 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:36:48.896 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:36:48.896 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:36:48.896 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:36:48.896 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:36:48.897 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:36:48.897 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:36:48.897 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:36:48.898 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:36:48.898 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:36:48.898 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:36:48.898 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:36:48.899 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:36:48.899 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:36:48.899 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:36:48.900 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:36:48.900 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:36:48.900 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:36:48.900 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:36:48.900 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:36:48.901 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:36:48.901 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:36:48.901 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:36:48.901 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:36:48.902 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:36:48.902 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:36:48.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:48.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:48.903 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:36:48.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:36:48.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:48.904 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:48.904 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:36:48.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 msgr2=0x7fcd18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 0x7fcd18067290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd280041d0 tx=0x7fcd28009040).stop 2022-02-02T18:36:48.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 msgr2=0x7fcd2c10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:36:48.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fcd1c004f60 tx=0x7fcd1c009b30).stop 2022-02-02T18:36:48.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 shutdown_connections 2022-02-02T18:36:48.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd18064dd0 0x7fcd18067290 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd2c0f55c0 0x7fcd2c10c070 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 --2- 172.21.15.96:0/890942554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd2c0f6860 0x7fcd2c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:36:48.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 >> 172.21.15.96:0/890942554 conn(0x7fcd2c0f0d40 msgr2=0x7fcd2c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:36:48.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 shutdown_connections 2022-02-02T18:36:48.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:36:48.898+0000 7fcd33453700 1 -- 172.21.15.96:0/890942554 wait complete. 2022-02-02T18:36:48.908 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:36:49.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:49 smithi159 ceph-mon[69013]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:49.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:49 smithi159 ceph-mon[69013]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:49.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2796972381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:49.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/890942554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:36:49.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:49 smithi096 ceph-mon[101353]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:49.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:49 smithi096 ceph-mon[101353]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:36:49.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2796972381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:49.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/890942554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:36:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:50 smithi159 ceph-mon[69013]: pgmap v441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:50 smithi096 ceph-mon[101353]: pgmap v441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:52 smithi159 ceph-mon[69013]: pgmap v442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:52 smithi096 ceph-mon[101353]: pgmap v442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:54 smithi159 ceph-mon[69013]: pgmap v443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:54 smithi096 ceph-mon[101353]: pgmap v443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: pgmap v444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:56.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: pgmap v444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:36:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:36:56.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:36:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:36:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:36:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:36:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:57 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:57.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:57 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:36:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:36:58 smithi159 ceph-mon[69013]: pgmap v445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:36:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:36:58 smithi096 ceph-mon[101353]: pgmap v445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:00 smithi159 ceph-mon[69013]: pgmap v446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:00 smithi096 ceph-mon[101353]: pgmap v446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:02 smithi159 ceph-mon[69013]: pgmap v447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:02 smithi096 ceph-mon[101353]: pgmap v447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:04 smithi159 ceph-mon[69013]: pgmap v448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:04 smithi096 ceph-mon[101353]: pgmap v448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:06.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: pgmap v449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: pgmap v449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:06.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:07.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:07 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:07.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:07 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:07.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:07 smithi159 ceph-mon[69013]: pgmap v450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:07.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:07 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:07.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:07 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:07.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:07 smithi096 ceph-mon[101353]: pgmap v450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:10.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:09 smithi159 ceph-mon[69013]: pgmap v451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:10.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:09 smithi096 ceph-mon[101353]: pgmap v451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:12.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:12 smithi159 ceph-mon[69013]: pgmap v452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:12.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:12 smithi096 ceph-mon[101353]: pgmap v452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:14.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:14 smithi159 ceph-mon[69013]: pgmap v453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:14.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:14 smithi096 ceph-mon[101353]: pgmap v453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:16.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: pgmap v454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:16.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:16.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:16.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: pgmap v454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:17.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:17 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:17.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:17 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:17.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:17 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:17.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:17 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:18.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:18 smithi159 ceph-mon[69013]: pgmap v455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:18.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:18 smithi096 ceph-mon[101353]: pgmap v455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 -- 172.21.15.96:0/4183401799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 msgr2=0x7fa35c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 --2- 172.21.15.96:0/4183401799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c0f6b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa34c004660 tx=0x7fa34c009b30).stop 2022-02-02T18:37:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 -- 172.21.15.96:0/4183401799 shutdown_connections 2022-02-02T18:37:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 --2- 172.21.15.96:0/4183401799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c0f6b30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 --2- 172.21.15.96:0/4183401799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 0x7fa35c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 -- 172.21.15.96:0/4183401799 >> 172.21.15.96:0/4183401799 conn(0x7fa35c0f0b90 msgr2=0x7fa35c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 -- 172.21.15.96:0/4183401799 shutdown_connections 2022-02-02T18:37:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 -- 172.21.15.96:0/4183401799 wait complete. 2022-02-02T18:37:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.009+0000 7fa362ba9700 1 Processor -- start 2022-02-02T18:37:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa362ba9700 1 -- start start 2022-02-02T18:37:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa362ba9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 0x7fa35c10be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa362ba9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa362ba9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0602b0 con 0x7fa35c0f66d0 2022-02-02T18:37:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa362ba9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0603f0 con 0x7fa35c0f5430 2022-02-02T18:37:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54998/0 (socket says 172.21.15.96:54998) 2022-02-02T18:37:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 -- 172.21.15.96:0/1869592394 learned_addr learned my addr 172.21.15.96:0/1869592394 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa361ba7700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 0x7fa35c10be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 -- 172.21.15.96:0/1869592394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 msgr2=0x7fa35c10be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 0x7fa35c10be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 -- 172.21.15.96:0/1869592394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c005040 con 0x7fa35c0f66d0 2022-02-02T18:37:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.010+0000 7fa3613a6700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa34c009990 tx=0x7fa34c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.011+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c018070 con 0x7fa35c0f66d0 2022-02-02T18:37:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.011+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa34c007ba0 con 0x7fa35c0f66d0 2022-02-02T18:37:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.011+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c10e830 con 0x7fa35c0f66d0 2022-02-02T18:37:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.011+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c01c3c0 con 0x7fa35c0f66d0 2022-02-02T18:37:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.011+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c10ec00 con 0x7fa35c0f66d0 2022-02-02T18:37:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c059100 con 0x7fa35c0f66d0 2022-02-02T18:37:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa34c01d420 con 0x7fa35c0f66d0 2022-02-02T18:37:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa3527fc700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 0x7fa3480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa34c083710 con 0x7fa35c0f66d0 2022-02-02T18:37:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa361ba7700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 0x7fa3480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.013+0000 7fa361ba7700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 0x7fa3480672e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa35c060040 tx=0x7fa35800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.018+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa34c051820 con 0x7fa35c0f66d0 2022-02-02T18:37:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.195+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa35c0fdd10 con 0x7fa348064e20 2022-02-02T18:37:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.197+0000 7fa3527fc700 1 -- 172.21.15.96:0/1869592394 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa35c0fdd10 con 0x7fa348064e20 2022-02-02T18:37:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.198+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 msgr2=0x7fa3480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 0x7fa3480672e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa35c060040 tx=0x7fa35800b040).stop 2022-02-02T18:37:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 msgr2=0x7fa35c10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa34c009990 tx=0x7fa34c009b30).stop 2022-02-02T18:37:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 shutdown_connections 2022-02-02T18:37:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa348064e20 0x7fa3480672e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa35c0f5430 0x7fa35c10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 --2- 172.21.15.96:0/1869592394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa35c0f66d0 0x7fa35c10e340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 >> 172.21.15.96:0/1869592394 conn(0x7fa35c0f0b90 msgr2=0x7fa35c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 shutdown_connections 2022-02-02T18:37:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.200+0000 7fa362ba9700 1 -- 172.21.15.96:0/1869592394 wait complete. 2022-02-02T18:37:19.207 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:37:19.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- 172.21.15.96:0/3980294425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f7980 msgr2=0x7f25ac0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 --2- 172.21.15.96:0/3980294425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f7980 0x7f25ac0f7de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f25a8004660 tx=0x7f25a8009b30).stop 2022-02-02T18:37:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- 172.21.15.96:0/3980294425 shutdown_connections 2022-02-02T18:37:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 --2- 172.21.15.96:0/3980294425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f7980 0x7f25ac0f7de0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 --2- 172.21.15.96:0/3980294425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f66e0 0x7f25ac0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- 172.21.15.96:0/3980294425 >> 172.21.15.96:0/3980294425 conn(0x7f25ac0f1e40 msgr2=0x7f25ac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- 172.21.15.96:0/3980294425 shutdown_connections 2022-02-02T18:37:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- 172.21.15.96:0/3980294425 wait complete. 2022-02-02T18:37:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 Processor -- start 2022-02-02T18:37:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.298+0000 7f25b4469700 1 -- start start 2022-02-02T18:37:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b4469700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b4469700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f7980 0x7f25ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b4469700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac06a380 con 0x7f25ac0f66e0 2022-02-02T18:37:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b4469700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac06a4c0 con 0x7f25ac0f7980 2022-02-02T18:37:19.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55006/0 (socket says 172.21.15.96:55006) 2022-02-02T18:37:19.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 -- 172.21.15.96:0/2981516780 learned_addr learned my addr 172.21.15.96:0/2981516780 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:19.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b1a04700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f7980 0x7f25ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 -- 172.21.15.96:0/2981516780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f7980 msgr2=0x7f25ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f7980 0x7f25ac069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 -- 172.21.15.96:0/2981516780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8005040 con 0x7f25ac0f66e0 2022-02-02T18:37:19.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b2205700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f259c00e7c0 tx=0x7f259c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f259c0092e0 con 0x7f25ac0f66e0 2022-02-02T18:37:19.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f259c00f040 con 0x7f25ac0f66e0 2022-02-02T18:37:19.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.299+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac06a7a0 con 0x7f25ac0f66e0 2022-02-02T18:37:19.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.300+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f259c014750 con 0x7f25ac0f66e0 2022-02-02T18:37:19.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.300+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac10ef40 con 0x7f25ac0f66e0 2022-02-02T18:37:19.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.302+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac045ad0 con 0x7f25ac0f66e0 2022-02-02T18:37:19.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.302+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f259c01b030 con 0x7f25ac0f66e0 2022-02-02T18:37:19.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.303+0000 7f25a2ffd700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 0x7f2598067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.303+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f259c081b80 con 0x7f25ac0f66e0 2022-02-02T18:37:19.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.303+0000 7f25b1a04700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 0x7f2598067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.303+0000 7f25b1a04700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 0x7f2598067290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f25a8004d80 tx=0x7f25a800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.307+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f259c04fc30 con 0x7f25ac0f66e0 2022-02-02T18:37:19.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.483+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f25ac0ff050 con 0x7f2598064dd0 2022-02-02T18:37:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.492+0000 7f25a2ffd700 1 -- 172.21.15.96:0/2981516780 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f25a801a040 con 0x7f2598064dd0 2022-02-02T18:37:19.490 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:37:19.490 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (20m) 85s ago 21m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:37:19.491 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (13m) 85s ago 21m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:37:19.491 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (13m) 10m ago 21m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:37:19.491 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (20m) 85s ago 21m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:37:19.491 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (17m) 85s ago 17m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:37:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (13m) 85s ago 17m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:37:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (17m) 10m ago 17m 5338M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:37:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (13m) 10m ago 17m 14.7M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:37:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (14m) 85s ago 22m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:37:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (14m) 10m ago 21m 418M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:37:19.493 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (13m) 85s ago 22m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:37:19.493 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (13m) 10m ago 21m 71.9M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:37:19.493 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (21m) 85s ago 21m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:37:19.493 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (21m) 10m ago 21m 18.0M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:37:19.494 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (12m) 85s ago 20m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:37:19.494 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (12m) 85s ago 20m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:37:19.494 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (11m) 85s ago 19m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:37:19.494 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (11m) 10m ago 19m 291M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:37:19.494 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (10m) 10m ago 19m 255M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:37:19.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (10m) 10m ago 19m 451M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:37:19.495 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (20m) 85s ago 21m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:37:19.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 msgr2=0x7f2598067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 0x7f2598067290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f25a8004d80 tx=0x7f25a800b040).stop 2022-02-02T18:37:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 msgr2=0x7f25ac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f259c00e7c0 tx=0x7f259c00b040).stop 2022-02-02T18:37:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 shutdown_connections 2022-02-02T18:37:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2598064dd0 0x7f2598067290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25ac0f66e0 0x7f25ac06b9a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 --2- 172.21.15.96:0/2981516780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac0f7980 0x7f25ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 >> 172.21.15.96:0/2981516780 conn(0x7f25ac0f1e40 msgr2=0x7f25ac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 shutdown_connections 2022-02-02T18:37:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.494+0000 7f25b4469700 1 -- 172.21.15.96:0/2981516780 wait complete. 2022-02-02T18:37:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/2987705680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f66e0 msgr2=0x7fe7d40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/2987705680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f66e0 0x7fe7d40f6b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fe7bc004660 tx=0x7fe7bc009b30).stop 2022-02-02T18:37:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/2987705680 shutdown_connections 2022-02-02T18:37:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/2987705680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f7980 0x7fe7d40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/2987705680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f66e0 0x7fe7d40f6b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/2987705680 >> 172.21.15.96:0/2987705680 conn(0x7fe7d40f1e40 msgr2=0x7fe7d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/2987705680 shutdown_connections 2022-02-02T18:37:19.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.591+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/2987705680 wait complete. 2022-02-02T18:37:19.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 Processor -- start 2022-02-02T18:37:19.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 -- start start 2022-02-02T18:37:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 0x7fe7d4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4107a50 con 0x7fe7d40f7980 2022-02-02T18:37:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d8d3b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4107b90 con 0x7fe7d40f66e0 2022-02-02T18:37:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55018/0 (socket says 172.21.15.96:55018) 2022-02-02T18:37:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 -- 172.21.15.96:0/1393013151 learned_addr learned my addr 172.21.15.96:0/1393013151 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d259c700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 0x7fe7d4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 -- 172.21.15.96:0/1393013151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 msgr2=0x7fe7d4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 0x7fe7d4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.592+0000 7fe7d1d9b700 1 -- 172.21.15.96:0/1393013151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc005040 con 0x7fe7d40f7980 2022-02-02T18:37:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7d259c700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 0x7fe7d4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:37:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7d1d9b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe7c40026d0 tx=0x7fe7c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c4009320 con 0x7fe7d40f7980 2022-02-02T18:37:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7c400f040 con 0x7fe7d40f7980 2022-02-02T18:37:19.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c40147e0 con 0x7fe7d40f7980 2022-02-02T18:37:19.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d4108530 con 0x7fe7d40f7980 2022-02-02T18:37:19.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.593+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d4108af0 con 0x7fe7d40f7980 2022-02-02T18:37:19.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.594+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d4045ad0 con 0x7fe7d40f7980 2022-02-02T18:37:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.594+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7c4009480 con 0x7fe7d40f7980 2022-02-02T18:37:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.594+0000 7fe7caffd700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 0x7fe7c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.595+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe7c40820e0 con 0x7fe7d40f7980 2022-02-02T18:37:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.595+0000 7fe7d259c700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 0x7fe7c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.595+0000 7fe7d259c700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 0x7fe7c0067290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe7bc005010 tx=0x7fe7bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.599+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7c4053bc0 con 0x7fe7d40f7980 2022-02-02T18:37:19.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.827+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7d4027a00 con 0x7fe7d40f7980 2022-02-02T18:37:19.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.828+0000 7fe7caffd700 1 -- 172.21.15.96:0/1393013151 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe7c40537b0 con 0x7fe7d40f7980 2022-02-02T18:37:19.826 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:37:19.826 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:37:19.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:37:19.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:19.827 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:37:19.827 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:37:19.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:19.828 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:37:19.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:37:19.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:19.828 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:37:19.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:37:19.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:19.829 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:37:19.829 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:37:19.829 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:37:19.829 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:37:19.830 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:37:19.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 msgr2=0x7fe7c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 0x7fe7c0067290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe7bc005010 tx=0x7fe7bc009b30).stop 2022-02-02T18:37:19.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 msgr2=0x7fe7d41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe7c40026d0 tx=0x7fe7c4009de0).stop 2022-02-02T18:37:19.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 shutdown_connections 2022-02-02T18:37:19.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7c0064dd0 0x7fe7c0067290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d40f66e0 0x7fe7d4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 --2- 172.21.15.96:0/1393013151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7d40f7980 0x7fe7d41074a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 >> 172.21.15.96:0/1393013151 conn(0x7fe7d40f1e40 msgr2=0x7fe7d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 shutdown_connections 2022-02-02T18:37:19.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.830+0000 7fe7d8d3b700 1 -- 172.21.15.96:0/1393013151 wait complete. 2022-02-02T18:37:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- 172.21.15.96:0/3631816479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f66e0 msgr2=0x7f07880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 --2- 172.21.15.96:0/3631816479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f66e0 0x7f07880f6b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0778004660 tx=0x7f0778009b30).stop 2022-02-02T18:37:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- 172.21.15.96:0/3631816479 shutdown_connections 2022-02-02T18:37:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 --2- 172.21.15.96:0/3631816479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f7980 0x7f07880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 --2- 172.21.15.96:0/3631816479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f66e0 0x7f07880f6b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- 172.21.15.96:0/3631816479 >> 172.21.15.96:0/3631816479 conn(0x7f07880f1e40 msgr2=0x7f07880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- 172.21.15.96:0/3631816479 shutdown_connections 2022-02-02T18:37:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- 172.21.15.96:0/3631816479 wait complete. 2022-02-02T18:37:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 Processor -- start 2022-02-02T18:37:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.928+0000 7f078d372700 1 -- start start 2022-02-02T18:37:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f078d372700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f66e0 0x7f078806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f078d372700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f078d372700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078806a380 con 0x7f07880f7980 2022-02-02T18:37:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f078d372700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078806a4c0 con 0x7f07880f66e0 2022-02-02T18:37:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55028/0 (socket says 172.21.15.96:55028) 2022-02-02T18:37:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 -- 172.21.15.96:0/1601174203 learned_addr learned my addr 172.21.15.96:0/1601174203 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f0786ffd700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f66e0 0x7f078806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 -- 172.21.15.96:0/1601174203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f66e0 msgr2=0x7f078806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f66e0 0x7f078806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 -- 172.21.15.96:0/1601174203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778005040 con 0x7f07880f7980 2022-02-02T18:37:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.929+0000 7f07867fc700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f077c00c790 tx=0x7f077c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.930+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077c002590 con 0x7f07880f7980 2022-02-02T18:37:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.930+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f077c002ba0 con 0x7f07880f7980 2022-02-02T18:37:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.930+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077c013d90 con 0x7f07880f7980 2022-02-02T18:37:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.930+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078806a7a0 con 0x7f07880f7980 2022-02-02T18:37:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.930+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078810efe0 con 0x7f07880f7980 2022-02-02T18:37:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.931+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768004fa0 con 0x7f07880f7980 2022-02-02T18:37:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.931+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f077c01a060 con 0x7f07880f7980 2022-02-02T18:37:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.932+0000 7f076f7fe700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 0x7f0770067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.932+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f077c081b90 con 0x7f07880f7980 2022-02-02T18:37:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.932+0000 7f0786ffd700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 0x7f0770067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.932+0000 7f0786ffd700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 0x7f0770067290 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0778013690 tx=0x7f0778009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:19.936+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f077c04fbe0 con 0x7f07880f7980 2022-02-02T18:37:20.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.138+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0768005e80 con 0x7f07880f7980 2022-02-02T18:37:20.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.139+0000 7f076f7fe700 1 -- 172.21.15.96:0/1601174203 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f077c018720 con 0x7f07880f7980 2022-02-02T18:37:20.137 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:37:20.137 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:37:20.137 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:37:20.138 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:37:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:20.138 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:37:20.139 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:37:20.139 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:37:20.139 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:37:20.139 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:37:20.140 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:37:20.140 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:37:20.140 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:37:20.140 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:37:20.141 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:37:20.141 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:37:20.141 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:37:20.141 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:37:20.142 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:37:20.142 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:37:20.142 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:37:20.142 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:37:20.143 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:37:20.143 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:37:20.143 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:37:20.143 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:37:20.144 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:37:20.144 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:37:20.144 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:37:20.144 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:37:20.144 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:37:20.145 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:37:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:20.145 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:37:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:20.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:20.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:20.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:20.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 msgr2=0x7f0770067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 0x7f0770067290 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0778013690 tx=0x7f0778009b30).stop 2022-02-02T18:37:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 msgr2=0x7f0788069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f077c00c790 tx=0x7f077c007d70).stop 2022-02-02T18:37:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 shutdown_connections 2022-02-02T18:37:20.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0770064dd0 0x7f0770067290 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07880f66e0 0x7f078806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 --2- 172.21.15.96:0/1601174203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07880f7980 0x7f0788069e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 >> 172.21.15.96:0/1601174203 conn(0x7f07880f1e40 msgr2=0x7f07880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:20.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 shutdown_connections 2022-02-02T18:37:20.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:20.141+0000 7f078d372700 1 -- 172.21.15.96:0/1601174203 wait complete. 2022-02-02T18:37:20.150 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:37:20.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:20 smithi159 ceph-mon[69013]: pgmap v456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:20 smithi159 ceph-mon[69013]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:20 smithi159 ceph-mon[69013]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1393013151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:20.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1601174203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:37:20.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:20 smithi096 ceph-mon[101353]: pgmap v456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:20.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:20 smithi096 ceph-mon[101353]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:20.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:20 smithi096 ceph-mon[101353]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:20.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1393013151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:20.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1601174203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:37:22.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:22 smithi159 ceph-mon[69013]: pgmap v457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:22.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:22 smithi096 ceph-mon[101353]: pgmap v457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:24.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:24 smithi096 ceph-mon[101353]: pgmap v458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:24 smithi159 ceph-mon[69013]: pgmap v458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:26.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:26 smithi096 ceph-mon[101353]: pgmap v459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:26.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:26.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:26.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:26.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:26 smithi159 ceph-mon[69013]: pgmap v459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:26.816 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:26.816 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:26.817 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:27.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:27 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:27.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:37:27.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:37:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:27 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:37:27.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:37:28.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:28 smithi096 ceph-mon[101353]: pgmap v460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:28 smithi159 ceph-mon[69013]: pgmap v460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:30.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: pgmap v461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:30.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:30 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: pgmap v461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:30 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:32.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:32 smithi096 ceph-mon[101353]: pgmap v462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:32 smithi159 ceph-mon[69013]: pgmap v462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:34.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:34 smithi096 ceph-mon[101353]: pgmap v463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:34 smithi159 ceph-mon[69013]: pgmap v463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:36.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:36 smithi096 ceph-mon[101353]: pgmap v464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:36 smithi159 ceph-mon[69013]: pgmap v464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:38.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:38 smithi096 ceph-mon[101353]: pgmap v465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:38 smithi159 ceph-mon[69013]: pgmap v465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: pgmap v466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: pgmap v466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:41.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:41 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:41 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:42 smithi159 ceph-mon[69013]: pgmap v467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:42 smithi096 ceph-mon[101353]: pgmap v467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:44 smithi159 ceph-mon[69013]: pgmap v468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:44 smithi096 ceph-mon[101353]: pgmap v468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:46 smithi159 ceph-mon[69013]: pgmap v469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:46 smithi096 ceph-mon[101353]: pgmap v469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:48 smithi159 ceph-mon[69013]: pgmap v470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:48 smithi096 ceph-mon[101353]: pgmap v470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:50.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- 172.21.15.96:0/2671335734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 msgr2=0x7fe4340f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 --2- 172.21.15.96:0/2671335734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe4340f9340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe428004660 tx=0x7fe428009b30).stop 2022-02-02T18:37:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- 172.21.15.96:0/2671335734 shutdown_connections 2022-02-02T18:37:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 --2- 172.21.15.96:0/2671335734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 0x7fe4340fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 --2- 172.21.15.96:0/2671335734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe4340f9340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- 172.21.15.96:0/2671335734 >> 172.21.15.96:0/2671335734 conn(0x7fe4340f0d40 msgr2=0x7fe4340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- 172.21.15.96:0/2671335734 shutdown_connections 2022-02-02T18:37:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- 172.21.15.96:0/2671335734 wait complete. 2022-02-02T18:37:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 Processor -- start 2022-02-02T18:37:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.252+0000 7fe43afc6700 1 -- start start 2022-02-02T18:37:50.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe43afc6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe43afc6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 0x7fe434107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe43afc6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434107a30 con 0x7fe434060270 2022-02-02T18:37:50.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe43afc6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434107b70 con 0x7fe4340f9830 2022-02-02T18:37:50.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55044/0 (socket says 172.21.15.96:55044) 2022-02-02T18:37:50.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 -- 172.21.15.96:0/1531928113 learned_addr learned my addr 172.21.15.96:0/1531928113 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:50.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe433fff700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 0x7fe434107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 -- 172.21.15.96:0/1531928113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 msgr2=0x7fe434107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 0x7fe434107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 -- 172.21.15.96:0/1531928113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428005040 con 0x7fe434060270 2022-02-02T18:37:50.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.253+0000 7fe438d62700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe428009990 tx=0x7fe428009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.254+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe428018070 con 0x7fe434060270 2022-02-02T18:37:50.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.254+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe428007ba0 con 0x7fe434060270 2022-02-02T18:37:50.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.254+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42801c3c0 con 0x7fe434060270 2022-02-02T18:37:50.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.254+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4341084b0 con 0x7fe434060270 2022-02-02T18:37:50.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.254+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434108a10 con 0x7fe434060270 2022-02-02T18:37:50.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.255+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe434045ad0 con 0x7fe434060270 2022-02-02T18:37:50.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.255+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe42801d420 con 0x7fe434060270 2022-02-02T18:37:50.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.255+0000 7fe4317fa700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 0x7fe424067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.256+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe428083750 con 0x7fe434060270 2022-02-02T18:37:50.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.256+0000 7fe433fff700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 0x7fe424067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.256+0000 7fe433fff700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 0x7fe424067290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe434060040 tx=0x7fe42000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.260+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe4280551d0 con 0x7fe434060270 2022-02-02T18:37:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.442+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4340ff010 con 0x7fe424064dd0 2022-02-02T18:37:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.444+0000 7fe4317fa700 1 -- 172.21.15.96:0/1531928113 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe4340ff010 con 0x7fe424064dd0 2022-02-02T18:37:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 msgr2=0x7fe424067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 0x7fe424067290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe434060040 tx=0x7fe42000b040).stop 2022-02-02T18:37:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 msgr2=0x7fe434106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe428009990 tx=0x7fe428009b30).stop 2022-02-02T18:37:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 shutdown_connections 2022-02-02T18:37:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064dd0 0x7fe424067290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe434060270 0x7fe434106f90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 --2- 172.21.15.96:0/1531928113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4340f9830 0x7fe434107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.445+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 >> 172.21.15.96:0/1531928113 conn(0x7fe4340f0d40 msgr2=0x7fe4340f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.446+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 shutdown_connections 2022-02-02T18:37:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.446+0000 7fe43afc6700 1 -- 172.21.15.96:0/1531928113 wait complete. 2022-02-02T18:37:50.454 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:37:50.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 -- 172.21.15.96:0/2527033828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f6860 msgr2=0x7f4ca80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/2527033828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f6860 0x7f4ca80f6cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f4c94004660 tx=0x7f4c94009b30).stop 2022-02-02T18:37:50.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 -- 172.21.15.96:0/2527033828 shutdown_connections 2022-02-02T18:37:50.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/2527033828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f6860 0x7f4ca80f6cc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/2527033828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f55c0 0x7f4ca80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:37:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 -- 172.21.15.96:0/2527033828 >> 172.21.15.96:0/2527033828 conn(0x7f4ca80f0d40 msgr2=0x7f4ca80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 -- 172.21.15.96:0/2527033828 shutdown_connections 2022-02-02T18:37:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 -- 172.21.15.96:0/2527033828 wait complete. 2022-02-02T18:37:50.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: pgmap v471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:50.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:50.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:50.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:50.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:50.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:50.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.545+0000 7f4caf0c0700 1 Processor -- start 2022-02-02T18:37:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4caf0c0700 1 -- start start 2022-02-02T18:37:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4caf0c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4caf0c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 0x7f4ca810c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4caf0c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8060470 con 0x7f4ca80f55c0 2022-02-02T18:37:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4caf0c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80605b0 con 0x7f4ca80f6860 2022-02-02T18:37:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55054/0 (socket says 172.21.15.96:55054) 2022-02-02T18:37:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 -- 172.21.15.96:0/628090731 learned_addr learned my addr 172.21.15.96:0/628090731 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4ca7fff700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 0x7f4ca810c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 -- 172.21.15.96:0/628090731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 msgr2=0x7f4ca810c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 0x7f4ca810c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4cace5c700 1 -- 172.21.15.96:0/628090731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94005040 con 0x7f4ca80f55c0 2022-02-02T18:37:50.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.546+0000 7f4ca7fff700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 0x7f4ca810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:37:50.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4cace5c700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f4c9c009360 tx=0x7f4c9c006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c013460 con 0x7f4ca80f55c0 2022-02-02T18:37:50.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca810c850 con 0x7f4ca80f55c0 2022-02-02T18:37:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c9c013a70 con 0x7f4ca80f55c0 2022-02-02T18:37:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c00d9e0 con 0x7f4ca80f55c0 2022-02-02T18:37:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.547+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca810cde0 con 0x7f4ca80f55c0 2022-02-02T18:37:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.548+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80f49b0 con 0x7f4ca80f55c0 2022-02-02T18:37:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.548+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c9c01a060 con 0x7f4ca80f55c0 2022-02-02T18:37:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.549+0000 7f4ca57fa700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.549+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c9c081980 con 0x7f4ca80f55c0 2022-02-02T18:37:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.549+0000 7f4ca7fff700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.549+0000 7f4ca7fff700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 0x7f4c98067290 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4c94004e30 tx=0x7f4c94009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.553+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c9c04fa30 con 0x7f4ca80f55c0 2022-02-02T18:37:50.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.725+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ca80fdf60 con 0x7f4c98064dd0 2022-02-02T18:37:50.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.734+0000 7f4ca57fa700 1 -- 172.21.15.96:0/628090731 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4ca80fdf60 con 0x7f4c98064dd0 2022-02-02T18:37:50.733 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:37:50.733 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (21m) 116s ago 22m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:37:50.734 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (13m) 116s ago 22m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:37:50.734 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (13m) 21s ago 21m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:37:50.734 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (21m) 116s ago 22m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:37:50.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (18m) 116s ago 18m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:37:50.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (13m) 116s ago 18m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:37:50.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (18m) 21s ago 18m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:37:50.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (14m) 21s ago 18m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:37:50.736 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (15m) 116s ago 23m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:37:50.736 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (14m) 21s ago 21m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:37:50.736 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (14m) 116s ago 23m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:37:50.736 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (14m) 21s ago 21m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:37:50.736 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (22m) 116s ago 22m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:37:50.737 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (21m) 21s ago 21m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:37:50.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (13m) 116s ago 21m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:37:50.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (12m) 116s ago 20m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:37:50.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (12m) 116s ago 20m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:37:50.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (11m) 21s ago 20m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:37:50.738 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (11m) 21s ago 19m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:37:50.738 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (10m) 21s ago 19m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:37:50.738 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (20m) 116s ago 21m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:37:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 msgr2=0x7f4c98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 0x7f4c98067290 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4c94004e30 tx=0x7f4c94009b30).stop 2022-02-02T18:37:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 msgr2=0x7f4ca8109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f4c9c009360 tx=0x7f4c9c006e10).stop 2022-02-02T18:37:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 shutdown_connections 2022-02-02T18:37:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8109cf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 --2- 172.21.15.96:0/628090731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca80f6860 0x7f4ca810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.736+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 >> 172.21.15.96:0/628090731 conn(0x7f4ca80f0d40 msgr2=0x7f4ca80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.737+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 shutdown_connections 2022-02-02T18:37:50.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.737+0000 7f4caf0c0700 1 -- 172.21.15.96:0/628090731 wait complete. 2022-02-02T18:37:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: pgmap v471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:37:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:37:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:37:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:37:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.834+0000 7f2d42304700 1 -- 172.21.15.96:0/1005481898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 msgr2=0x7f2d3c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.834+0000 7f2d42304700 1 --2- 172.21.15.96:0/1005481898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c0f5850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2d38004660 tx=0x7f2d38009b30).stop 2022-02-02T18:37:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- 172.21.15.96:0/1005481898 shutdown_connections 2022-02-02T18:37:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 --2- 172.21.15.96:0/1005481898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 0x7f2d3c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 --2- 172.21.15.96:0/1005481898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c0f5850 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- 172.21.15.96:0/1005481898 >> 172.21.15.96:0/1005481898 conn(0x7f2d3c0f0b90 msgr2=0x7f2d3c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- 172.21.15.96:0/1005481898 shutdown_connections 2022-02-02T18:37:50.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- 172.21.15.96:0/1005481898 wait complete. 2022-02-02T18:37:50.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 Processor -- start 2022-02-02T18:37:50.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- start start 2022-02-02T18:37:50.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 0x7f2d3c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0603c0 con 0x7f2d3c0f5430 2022-02-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d42304700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c060500 con 0x7f2d3c0f66d0 2022-02-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.835+0000 7f2d41302700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55064/0 (socket says 172.21.15.96:55064) 2022-02-02T18:37:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 -- 172.21.15.96:0/4173656632 learned_addr learned my addr 172.21.15.96:0/4173656632 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d40b01700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 0x7f2d3c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 -- 172.21.15.96:0/4173656632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 msgr2=0x7f2d3c10bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 0x7f2d3c10bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 -- 172.21.15.96:0/4173656632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38005040 con 0x7f2d3c0f5430 2022-02-02T18:37:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d41302700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2d38000c00 tx=0x7f2d38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d38018070 con 0x7f2d3c0f5430 2022-02-02T18:37:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d38007cf0 con 0x7f2d3c0f5430 2022-02-02T18:37:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c10c500 con 0x7f2d3c0f5430 2022-02-02T18:37:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3801c3c0 con 0x7f2d3c0f5430 2022-02-02T18:37:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.836+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c10ca30 con 0x7f2d3c0f5430 2022-02-02T18:37:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.837+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c059100 con 0x7f2d3c0f5430 2022-02-02T18:37:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.838+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d3801d420 con 0x7f2d3c0f5430 2022-02-02T18:37:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.838+0000 7f2d31ffb700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 0x7f2d280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.838+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2d380838f0 con 0x7f2d3c0f5430 2022-02-02T18:37:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.838+0000 7f2d40b01700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 0x7f2d280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.839+0000 7f2d40b01700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 0x7f2d280672e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2d2c0041d0 tx=0x7f2d2c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:50.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:50.842+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d38051a60 con 0x7f2d3c0f5430 2022-02-02T18:37:51.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.074+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d3c0fdd00 con 0x7f2d3c0f5430 2022-02-02T18:37:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.074+0000 7f2d31ffb700 1 -- 172.21.15.96:0/4173656632 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2d38055080 con 0x7f2d3c0f5430 2022-02-02T18:37:51.073 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:37:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:37:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:37:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:37:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:37:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:37:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:37:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:37:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:37:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:37:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:37:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:37:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:37:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:37:51.078 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:37:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 msgr2=0x7f2d280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 0x7f2d280672e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2d2c0041d0 tx=0x7f2d2c009040).stop 2022-02-02T18:37:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 msgr2=0x7f2d3c109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2d38000c00 tx=0x7f2d38009b30).stop 2022-02-02T18:37:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 shutdown_connections 2022-02-02T18:37:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d28064e20 0x7f2d280672e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d3c0f5430 0x7f2d3c109ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 --2- 172.21.15.96:0/4173656632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3c0f66d0 0x7f2d3c10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.076+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 >> 172.21.15.96:0/4173656632 conn(0x7f2d3c0f0b90 msgr2=0x7f2d3c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:51.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.077+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 shutdown_connections 2022-02-02T18:37:51.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.077+0000 7f2d42304700 1 -- 172.21.15.96:0/4173656632 wait complete. 2022-02-02T18:37:51.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 -- 172.21.15.96:0/1213885375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f5970 msgr2=0x7fd4ac0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/1213885375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac0f5df0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd49c004660 tx=0x7fd49c009b30).stop 2022-02-02T18:37:51.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 -- 172.21.15.96:0/1213885375 shutdown_connections 2022-02-02T18:37:51.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/1213885375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac0f5df0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/1213885375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 -- 172.21.15.96:0/1213885375 >> 172.21.15.96:0/1213885375 conn(0x7fd4ac0f04c0 msgr2=0x7fd4ac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:51.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 -- 172.21.15.96:0/1213885375 shutdown_connections 2022-02-02T18:37:51.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.175+0000 7fd4b18c0700 1 -- 172.21.15.96:0/1213885375 wait complete. 2022-02-02T18:37:51.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 Processor -- start 2022-02-02T18:37:51.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 -- start start 2022-02-02T18:37:51.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:51.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0f5620 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4b18c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0f5760 con 0x7fd4ac0f5970 2022-02-02T18:37:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55076/0 (socket says 172.21.15.96:55076) 2022-02-02T18:37:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 -- 172.21.15.96:0/753942429 learned_addr learned my addr 172.21.15.96:0/753942429 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:37:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aaffd700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 -- 172.21.15.96:0/753942429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f5970 msgr2=0x7fd4ac109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 -- 172.21.15.96:0/753942429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c005040 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.176+0000 7fd4aa7fc700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fd49c009990 tx=0x7fd49c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.177+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c018070 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.177+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd49c007ba0 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.177+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac10c720 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.177+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c01c3c0 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.177+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac10cc80 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.178+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac045ad0 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.178+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd49c01d420 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.179+0000 7fd4937fe700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 0x7fd494067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:37:51.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.179+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd49c083730 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.179+0000 7fd4aaffd700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 0x7fd494067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:37:51.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.179+0000 7fd4aaffd700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 0x7fd494067290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd4a0007fd0 tx=0x7fd4a0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:37:51.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.183+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd49c051950 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.386+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4ac027a00 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.387+0000 7fd4937fe700 1 -- 172.21.15.96:0/753942429 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd49c054f70 con 0x7fd4ac0f6c60 2022-02-02T18:37:51.386 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:37:51.387 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:37:51.387 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:37:51.388 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:37:51.388 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:51.388 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:37:51.388 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:37:51.389 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:37:51.389 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:37:51.389 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:37:51.389 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:37:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:37:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:37:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:37:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:37:51.391 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:37:51.391 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:37:51.391 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:37:51.391 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:37:51.391 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:37:51.392 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:37:51.392 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:37:51.392 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:37:51.392 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:37:51.392 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:37:51.393 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:37:51.393 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:37:51.393 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:37:51.393 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:37:51.394 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:37:51.394 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:37:51.394 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:37:51.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:51.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:51.395 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:37:51.395 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:37:51.395 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:51.395 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:51.396 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:37:51.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 msgr2=0x7fd494067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 0x7fd494067290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd4a0007fd0 tx=0x7fd4a0009040).stop 2022-02-02T18:37:51.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 msgr2=0x7fd4ac10c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:37:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fd49c009990 tx=0x7fd49c009b30).stop 2022-02-02T18:37:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 shutdown_connections 2022-02-02T18:37:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd494064dd0 0x7fd494067290 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4ac0f5970 0x7fd4ac109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 --2- 172.21.15.96:0/753942429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4ac0f6c60 0x7fd4ac10c1d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:37:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 >> 172.21.15.96:0/753942429 conn(0x7fd4ac0f04c0 msgr2=0x7fd4ac0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:37:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.389+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 shutdown_connections 2022-02-02T18:37:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:37:51.390+0000 7fd4b18c0700 1 -- 172.21.15.96:0/753942429 wait complete. 2022-02-02T18:37:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:37:51.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:51 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:51.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:51 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:51.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:51 smithi096 ceph-mon[101353]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:51.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4173656632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:51 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:37:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:51 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:37:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:51 smithi159 ceph-mon[69013]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4173656632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:37:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:52 smithi159 ceph-mon[69013]: from='client.34608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:52 smithi159 ceph-mon[69013]: pgmap v472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/753942429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:37:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:52 smithi096 ceph-mon[101353]: from='client.34608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:37:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:52 smithi096 ceph-mon[101353]: pgmap v472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/753942429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:37:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:54 smithi159 ceph-mon[69013]: pgmap v473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:54 smithi096 ceph-mon[101353]: pgmap v473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:56 smithi159 ceph-mon[69013]: pgmap v474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:56 smithi096 ceph-mon[101353]: pgmap v474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:37:58 smithi159 ceph-mon[69013]: pgmap v475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:37:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:37:58 smithi096 ceph-mon[101353]: pgmap v475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: pgmap v476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: pgmap v476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:01 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:01 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:01.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:01 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:01 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:02 smithi159 ceph-mon[69013]: pgmap v477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:02 smithi096 ceph-mon[101353]: pgmap v477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:04 smithi159 ceph-mon[69013]: pgmap v478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:04 smithi096 ceph-mon[101353]: pgmap v478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:06.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:06 smithi159 ceph-mon[69013]: pgmap v479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:06.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:06 smithi096 ceph-mon[101353]: pgmap v479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:08 smithi159 ceph-mon[69013]: pgmap v480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:08 smithi096 ceph-mon[101353]: pgmap v480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: pgmap v481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: pgmap v481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:10.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:11 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:11 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:11 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:11 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:12 smithi159 ceph-mon[69013]: pgmap v482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:12 smithi096 ceph-mon[101353]: pgmap v482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:14 smithi159 ceph-mon[69013]: pgmap v483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:14 smithi096 ceph-mon[101353]: pgmap v483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:16.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:16 smithi159 ceph-mon[69013]: pgmap v484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:16.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:16 smithi096 ceph-mon[101353]: pgmap v484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:18.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:18 smithi159 ceph-mon[69013]: pgmap v485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:18 smithi096 ceph-mon[101353]: pgmap v485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: pgmap v486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: pgmap v486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:21.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- 172.21.15.96:0/3536508609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f55c0 msgr2=0x7fef4c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 --2- 172.21.15.96:0/3536508609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f55c0 0x7fef4c0f59e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fef40004660 tx=0x7fef40009b30).stop 2022-02-02T18:38:21.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- 172.21.15.96:0/3536508609 shutdown_connections 2022-02-02T18:38:21.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 --2- 172.21.15.96:0/3536508609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f6860 0x7fef4c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 --2- 172.21.15.96:0/3536508609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f55c0 0x7fef4c0f59e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- 172.21.15.96:0/3536508609 >> 172.21.15.96:0/3536508609 conn(0x7fef4c0f0d40 msgr2=0x7fef4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:21.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- 172.21.15.96:0/3536508609 shutdown_connections 2022-02-02T18:38:21.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- 172.21.15.96:0/3536508609 wait complete. 2022-02-02T18:38:21.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 Processor -- start 2022-02-02T18:38:21.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.502+0000 7fef5314a700 1 -- start start 2022-02-02T18:38:21.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef5314a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f55c0 0x7fef4c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef5314a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef5314a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c106910 con 0x7fef4c0f6860 2022-02-02T18:38:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef5314a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c106a50 con 0x7fef4c0f55c0 2022-02-02T18:38:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55096/0 (socket says 172.21.15.96:55096) 2022-02-02T18:38:21.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 -- 172.21.15.96:0/3087529890 learned_addr learned my addr 172.21.15.96:0/3087529890 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:21.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef50ee6700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f55c0 0x7fef4c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 -- 172.21.15.96:0/3087529890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f55c0 msgr2=0x7fef4c105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f55c0 0x7fef4c105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 -- 172.21.15.96:0/3087529890 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40005040 con 0x7fef4c0f6860 2022-02-02T18:38:21.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.503+0000 7fef4bfff700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fef3800f940 tx=0x7fef38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:21.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.504+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef38009500 con 0x7fef4c0f6860 2022-02-02T18:38:21.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.504+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c1073f0 con 0x7fef4c0f6860 2022-02-02T18:38:21.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.504+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef38009660 con 0x7fef4c0f6860 2022-02-02T18:38:21.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.504+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c1079b0 con 0x7fef4c0f6860 2022-02-02T18:38:21.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.504+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3800de30 con 0x7fef4c0f6860 2022-02-02T18:38:21.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.505+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c045ad0 con 0x7fef4c0f6860 2022-02-02T18:38:21.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.505+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fef3800e040 con 0x7fef4c0f6860 2022-02-02T18:38:21.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.506+0000 7fef497fa700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 0x7fef3c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.506+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fef38084470 con 0x7fef4c0f6860 2022-02-02T18:38:21.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.506+0000 7fef50ee6700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 0x7fef3c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.506+0000 7fef50ee6700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 0x7fef3c067270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fef40013690 tx=0x7fef40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:21.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.510+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fef38055f50 con 0x7fef4c0f6860 2022-02-02T18:38:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.689+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef4c05f620 con 0x7fef3c064db0 2022-02-02T18:38:21.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:21 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:21.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:21 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:21.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.690+0000 7fef497fa700 1 -- 172.21.15.96:0/3087529890 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fef4c05f620 con 0x7fef3c064db0 2022-02-02T18:38:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 msgr2=0x7fef3c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 0x7fef3c067270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fef40013690 tx=0x7fef40009b30).stop 2022-02-02T18:38:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 msgr2=0x7fef4c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fef3800f940 tx=0x7fef38009de0).stop 2022-02-02T18:38:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 shutdown_connections 2022-02-02T18:38:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef3c064db0 0x7fef3c067270 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef4c0f55c0 0x7fef4c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 --2- 172.21.15.96:0/3087529890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef4c0f6860 0x7fef4c106360 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 >> 172.21.15.96:0/3087529890 conn(0x7fef4c0f0d40 msgr2=0x7fef4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:21.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 shutdown_connections 2022-02-02T18:38:21.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.692+0000 7fef5314a700 1 -- 172.21.15.96:0/3087529890 wait complete. 2022-02-02T18:38:21.699 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:38:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:21 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:21 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 -- 172.21.15.96:0/2266853201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f6870 msgr2=0x7f120c0f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 --2- 172.21.15.96:0/2266853201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f6870 0x7f120c0f6cd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f11fc004660 tx=0x7f11fc009b30).stop 2022-02-02T18:38:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 -- 172.21.15.96:0/2266853201 shutdown_connections 2022-02-02T18:38:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 --2- 172.21.15.96:0/2266853201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f6870 0x7f120c0f6cd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 --2- 172.21.15.96:0/2266853201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f55d0 0x7f120c0f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 -- 172.21.15.96:0/2266853201 >> 172.21.15.96:0/2266853201 conn(0x7f120c0f0d70 msgr2=0x7f120c0f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 -- 172.21.15.96:0/2266853201 shutdown_connections 2022-02-02T18:38:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.790+0000 7f12125cc700 1 -- 172.21.15.96:0/2266853201 wait complete. 2022-02-02T18:38:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 Processor -- start 2022-02-02T18:38:21.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 -- start start 2022-02-02T18:38:21.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f6870 0x7f120c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0604a0 con 0x7f120c0f55d0 2022-02-02T18:38:21.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f12125cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0605e0 con 0x7f120c0f6870 2022-02-02T18:38:21.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f120bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f120bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55102/0 (socket says 172.21.15.96:55102) 2022-02-02T18:38:21.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f120bfff700 1 -- 172.21.15.96:0/2096733423 learned_addr learned my addr 172.21.15.96:0/2096733423 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:21.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.791+0000 7f120b7fe700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f6870 0x7f120c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f120bfff700 1 -- 172.21.15.96:0/2096733423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f6870 msgr2=0x7f120c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f120bfff700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f6870 0x7f120c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f120bfff700 1 -- 172.21.15.96:0/2096733423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc005040 con 0x7f120c0f55d0 2022-02-02T18:38:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f120bfff700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f11f400c790 tx=0x7f11f4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f400e680 con 0x7f120c0f55d0 2022-02-02T18:38:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11f400ec90 con 0x7f120c0f55d0 2022-02-02T18:38:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c10c720 con 0x7f120c0f55d0 2022-02-02T18:38:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c10ccb0 con 0x7f120c0f55d0 2022-02-02T18:38:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.792+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f4012d00 con 0x7f120c0f55d0 2022-02-02T18:38:21.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.793+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f0004fa0 con 0x7f120c0f55d0 2022-02-02T18:38:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.793+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11f4010070 con 0x7f120c0f55d0 2022-02-02T18:38:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.794+0000 7f1208ff9700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 0x7f11f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.794+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f11f4081b40 con 0x7f120c0f55d0 2022-02-02T18:38:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.794+0000 7f120b7fe700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 0x7f11f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.794+0000 7f120b7fe700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 0x7f11f8067290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f11fc004e30 tx=0x7f11fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.798+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11f404fbf0 con 0x7f120c0f55d0 2022-02-02T18:38:21.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.970+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11f00029f0 con 0x7f11f8064dd0 2022-02-02T18:38:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.979+0000 7f1208ff9700 1 -- 172.21.15.96:0/2096733423 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f11f00029f0 con 0x7f11f8064dd0 2022-02-02T18:38:21.977 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:38:21.977 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (21m) 2m ago 22m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:38:21.977 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (14m) 2m ago 22m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:38:21.978 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (14m) 52s ago 22m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:38:21.978 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (21m) 2m ago 22m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:38:21.978 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (18m) 2m ago 18m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:38:21.978 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (14m) 2m ago 18m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:38:21.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (18m) 52s ago 18m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:38:21.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (14m) 52s ago 18m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:38:21.979 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (15m) 2m ago 23m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:38:21.979 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (15m) 52s ago 22m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:38:21.980 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (15m) 2m ago 24m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:38:21.980 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (14m) 52s ago 22m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:38:21.980 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (22m) 2m ago 22m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:38:21.980 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (22m) 52s ago 22m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:38:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (13m) 2m ago 21m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:38:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (13m) 2m ago 21m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:38:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (12m) 2m ago 20m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:38:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (12m) 52s ago 20m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:38:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (11m) 52s ago 20m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:38:21.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (11m) 52s ago 20m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:38:21.982 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (21m) 2m ago 22m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:38:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 msgr2=0x7f11f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 0x7f11f8067290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f11fc004e30 tx=0x7f11fc009b30).stop 2022-02-02T18:38:21.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 msgr2=0x7f120c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f11f400c790 tx=0x7f11f4007d90).stop 2022-02-02T18:38:21.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 shutdown_connections 2022-02-02T18:38:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f8064dd0 0x7f11f8067290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f120c0f55d0 0x7f120c109c70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 --2- 172.21.15.96:0/2096733423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f120c0f6870 0x7f120c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:21.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 >> 172.21.15.96:0/2096733423 conn(0x7f120c0f0d70 msgr2=0x7f120c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:21.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 shutdown_connections 2022-02-02T18:38:21.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:21.981+0000 7f12125cc700 1 -- 172.21.15.96:0/2096733423 wait complete. 2022-02-02T18:38:22.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.078+0000 7f3e09a46700 1 -- 172.21.15.96:0/1405567177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 msgr2=0x7f3e040f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 --2- 172.21.15.96:0/1405567177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e040f5a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3df4004660 tx=0x7f3df4009b30).stop 2022-02-02T18:38:22.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 -- 172.21.15.96:0/1405567177 shutdown_connections 2022-02-02T18:38:22.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 --2- 172.21.15.96:0/1405567177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 0x7f3e040f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 --2- 172.21.15.96:0/1405567177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e040f5a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 -- 172.21.15.96:0/1405567177 >> 172.21.15.96:0/1405567177 conn(0x7f3e040f0de0 msgr2=0x7f3e040f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:22.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 -- 172.21.15.96:0/1405567177 shutdown_connections 2022-02-02T18:38:22.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 -- 172.21.15.96:0/1405567177 wait complete. 2022-02-02T18:38:22.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 Processor -- start 2022-02-02T18:38:22.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 -- start start 2022-02-02T18:38:22.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.079+0000 7f3e09a46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e09a46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 0x7f3e041073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e09a46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04107990 con 0x7f3e040f55e0 2022-02-02T18:38:22.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e09a46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04107ad0 con 0x7f3e040f5ef0 2022-02-02T18:38:22.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55110/0 (socket says 172.21.15.96:55110) 2022-02-02T18:38:22.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 -- 172.21.15.96:0/2336022137 learned_addr learned my addr 172.21.15.96:0/2336022137 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:22.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e027fc700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 0x7f3e041073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 -- 172.21.15.96:0/2336022137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 msgr2=0x7f3e041073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 0x7f3e041073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 -- 172.21.15.96:0/2336022137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4005040 con 0x7f3e040f55e0 2022-02-02T18:38:22.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e02ffd700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f3df4009990 tx=0x7f3df4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:22.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df4018070 con 0x7f3e040f55e0 2022-02-02T18:38:22.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e04108410 con 0x7f3e040f55e0 2022-02-02T18:38:22.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3df4007ba0 con 0x7f3e040f55e0 2022-02-02T18:38:22.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df401c3c0 con 0x7f3e040f55e0 2022-02-02T18:38:22.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.080+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04108970 con 0x7f3e040f55e0 2022-02-02T18:38:22.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.081+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04045ad0 con 0x7f3e040f55e0 2022-02-02T18:38:22.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.082+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3df401d420 con 0x7f3e040f55e0 2022-02-02T18:38:22.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.082+0000 7f3deb7fe700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 0x7f3dec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.082+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3df4083790 con 0x7f3e040f55e0 2022-02-02T18:38:22.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.082+0000 7f3e027fc700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 0x7f3dec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.083+0000 7f3e027fc700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 0x7f3dec067290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3df8009740 tx=0x7f3df8009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:22.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.086+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3df40552d0 con 0x7f3e040f55e0 2022-02-02T18:38:22.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.319+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e0410d510 con 0x7f3e040f55e0 2022-02-02T18:38:22.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.319+0000 7f3deb7fe700 1 -- 172.21.15.96:0/2336022137 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3df4054ec0 con 0x7f3e040f55e0 2022-02-02T18:38:22.317 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:38:22.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:38:22.317 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:38:22.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:22.318 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:38:22.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:38:22.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:22.319 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:38:22.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:38:22.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:22.319 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:38:22.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:38:22.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:22.320 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:38:22.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:38:22.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:38:22.321 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:38:22.321 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:38:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 msgr2=0x7f3dec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 0x7f3dec067290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3df8009740 tx=0x7f3df8009c60).stop 2022-02-02T18:38:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 msgr2=0x7f3e04106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f3df4009990 tx=0x7f3df4009b30).stop 2022-02-02T18:38:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 shutdown_connections 2022-02-02T18:38:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3dec064dd0 0x7f3dec067290 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e040f55e0 0x7f3e04106ef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 --2- 172.21.15.96:0/2336022137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040f5ef0 0x7f3e041073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 >> 172.21.15.96:0/2336022137 conn(0x7f3e040f0de0 msgr2=0x7f3e0405ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 shutdown_connections 2022-02-02T18:38:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.321+0000 7f3e09a46700 1 -- 172.21.15.96:0/2336022137 wait complete. 2022-02-02T18:38:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- 172.21.15.96:0/146834022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 msgr2=0x7fa9a40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/146834022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a40f7de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa990004660 tx=0x7fa990009b30).stop 2022-02-02T18:38:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- 172.21.15.96:0/146834022 shutdown_connections 2022-02-02T18:38:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/146834022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a40f7de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/146834022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 0x7fa9a40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- 172.21.15.96:0/146834022 >> 172.21.15.96:0/146834022 conn(0x7fa9a40f1e40 msgr2=0x7fa9a40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- 172.21.15.96:0/146834022 shutdown_connections 2022-02-02T18:38:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- 172.21.15.96:0/146834022 wait complete. 2022-02-02T18:38:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 Processor -- start 2022-02-02T18:38:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.420+0000 7fa9aac1c700 1 -- start start 2022-02-02T18:38:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9aac1c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 0x7fa9a4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9aac1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9aac1c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4107a00 con 0x7fa9a40f7980 2022-02-02T18:38:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9aac1c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4107b40 con 0x7fa9a40f66e0 2022-02-02T18:38:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55122/0 (socket says 172.21.15.96:55122) 2022-02-02T18:38:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 -- 172.21.15.96:0/1507650997 learned_addr learned my addr 172.21.15.96:0/1507650997 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a89b8700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 0x7fa9a4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 -- 172.21.15.96:0/1507650997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 msgr2=0x7fa9a4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 0x7fa9a4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 -- 172.21.15.96:0/1507650997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990005040 con 0x7fa9a40f7980 2022-02-02T18:38:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a3fff700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa990009990 tx=0x7fa990009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.421+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa990018070 con 0x7fa9a40f7980 2022-02-02T18:38:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.422+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa990007ba0 con 0x7fa9a40f7980 2022-02-02T18:38:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.422+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a4108480 con 0x7fa9a40f7980 2022-02-02T18:38:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.422+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99001c3c0 con 0x7fa9a40f7980 2022-02-02T18:38:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.422+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a41089e0 con 0x7fa9a40f7980 2022-02-02T18:38:22.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.422+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4045ad0 con 0x7fa9a40f7980 2022-02-02T18:38:22.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.423+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa99001d420 con 0x7fa9a40f7980 2022-02-02T18:38:22.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.424+0000 7fa9a17fa700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 0x7fa994067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:22.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.424+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa9900839b0 con 0x7fa9a40f7980 2022-02-02T18:38:22.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.424+0000 7fa9a89b8700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 0x7fa994067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:22.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.424+0000 7fa9a89b8700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 0x7fa994067290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa9a40f77e0 tx=0x7fa99800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:22.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.427+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa990055490 con 0x7fa9a40f7980 2022-02-02T18:38:22.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.630+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa9a4027a00 con 0x7fa9a40f7980 2022-02-02T18:38:22.628 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:22 smithi096 ceph-mon[101353]: pgmap v487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:22.629 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2336022137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:22.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.630+0000 7fa9a17fa700 1 -- 172.21.15.96:0/1507650997 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa990055080 con 0x7fa9a40f7980 2022-02-02T18:38:22.631 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:38:22.631 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:38:22.632 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:38:22.632 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:38:22.632 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:22.633 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:38:22.633 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:38:22.633 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:38:22.634 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:38:22.634 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:38:22.635 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:38:22.635 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:38:22.636 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:38:22.636 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:38:22.636 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:38:22.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:38:22.637 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:38:22.638 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:38:22.638 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:38:22.638 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:38:22.639 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:38:22.639 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:38:22.640 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:38:22.640 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:38:22.640 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:38:22.641 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:38:22.641 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:38:22.642 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:38:22.642 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:38:22.642 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:38:22.643 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:38:22.643 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:38:22.644 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:22.644 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:22.645 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:38:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:22.645 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:22.646 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:22.646 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 msgr2=0x7fa994067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 0x7fa994067290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa9a40f77e0 tx=0x7fa99800b040).stop 2022-02-02T18:38:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 msgr2=0x7fa9a4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa990009990 tx=0x7fa990009b30).stop 2022-02-02T18:38:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 shutdown_connections 2022-02-02T18:38:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa994064dd0 0x7fa994067290 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9a40f66e0 0x7fa9a4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 --2- 172.21.15.96:0/1507650997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a40f7980 0x7fa9a4107450 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 >> 172.21.15.96:0/1507650997 conn(0x7fa9a40f1e40 msgr2=0x7fa9a40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 shutdown_connections 2022-02-02T18:38:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:22.632+0000 7fa9aac1c700 1 -- 172.21.15.96:0/1507650997 wait complete. 2022-02-02T18:38:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:38:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:22 smithi159 ceph-mon[69013]: pgmap v487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2336022137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:23.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:23 smithi096 ceph-mon[101353]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:23.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:23 smithi096 ceph-mon[101353]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:23.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1507650997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:38:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:23 smithi159 ceph-mon[69013]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:23 smithi159 ceph-mon[69013]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1507650997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:38:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:24 smithi159 ceph-mon[69013]: pgmap v488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:24 smithi096 ceph-mon[101353]: pgmap v488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:26.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:26 smithi159 ceph-mon[69013]: pgmap v489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:26.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:26 smithi096 ceph-mon[101353]: pgmap v489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:38:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:38:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:38:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:38:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:28 smithi159 ceph-mon[69013]: pgmap v490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:28.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:28 smithi096 ceph-mon[101353]: pgmap v490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: pgmap v491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: pgmap v491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:31.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:31 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:31.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:31 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:31 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:31 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:32 smithi159 ceph-mon[69013]: pgmap v492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:32 smithi096 ceph-mon[101353]: pgmap v492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:34 smithi159 ceph-mon[69013]: pgmap v493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:34 smithi096 ceph-mon[101353]: pgmap v493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:36 smithi159 ceph-mon[69013]: pgmap v494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:36 smithi096 ceph-mon[101353]: pgmap v494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:38 smithi159 ceph-mon[69013]: pgmap v495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:38 smithi096 ceph-mon[101353]: pgmap v495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: pgmap v496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:40.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: pgmap v496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:41.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:41 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:41.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:41 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:41.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:41 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:41.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:41 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:42 smithi159 ceph-mon[69013]: pgmap v497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:42 smithi096 ceph-mon[101353]: pgmap v497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:44 smithi159 ceph-mon[69013]: pgmap v498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:44 smithi096 ceph-mon[101353]: pgmap v498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:46 smithi159 ceph-mon[69013]: pgmap v499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:46 smithi096 ceph-mon[101353]: pgmap v499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:48 smithi159 ceph-mon[69013]: pgmap v500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:48 smithi096 ceph-mon[101353]: pgmap v500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: pgmap v501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:50.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: pgmap v501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:38:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:38:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:38:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:38:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:51 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:51 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:51.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:51 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:38:51.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:51 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:38:52.741 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:52 smithi096 ceph-mon[101353]: pgmap v502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 -- 172.21.15.96:0/1441754821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 msgr2=0x7eff0c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 --2- 172.21.15.96:0/1441754821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c0f6cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7efefc004660 tx=0x7efefc009b30).stop 2022-02-02T18:38:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 -- 172.21.15.96:0/1441754821 shutdown_connections 2022-02-02T18:38:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 --2- 172.21.15.96:0/1441754821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c0f6cc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 --2- 172.21.15.96:0/1441754821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 0x7eff0c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 -- 172.21.15.96:0/1441754821 >> 172.21.15.96:0/1441754821 conn(0x7eff0c0f0d40 msgr2=0x7eff0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 -- 172.21.15.96:0/1441754821 shutdown_connections 2022-02-02T18:38:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.743+0000 7eff109bc700 1 -- 172.21.15.96:0/1441754821 wait complete. 2022-02-02T18:38:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 Processor -- start 2022-02-02T18:38:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 -- start start 2022-02-02T18:38:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 0x7eff0c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:52.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:52.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c109c20 con 0x7eff0c0f6860 2022-02-02T18:38:52.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff109bc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c109d60 con 0x7eff0c0f55c0 2022-02-02T18:38:52.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55152/0 (socket says 172.21.15.96:55152) 2022-02-02T18:38:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 -- 172.21.15.96:0/3300117183 learned_addr learned my addr 172.21.15.96:0/3300117183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff0a59c700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 0x7eff0c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 -- 172.21.15.96:0/3300117183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 msgr2=0x7eff0c109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 0x7eff0c109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.744+0000 7eff09d9b700 1 -- 172.21.15.96:0/3300117183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc005040 con 0x7eff0c0f6860 2022-02-02T18:38:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7eff09d9b700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7efefc009990 tx=0x7efefc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc018070 con 0x7eff0c0f6860 2022-02-02T18:38:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efefc007ca0 con 0x7eff0c0f6860 2022-02-02T18:38:52.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c10a6a0 con 0x7eff0c0f6860 2022-02-02T18:38:52.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc01c620 con 0x7eff0c0f6860 2022-02-02T18:38:52.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.745+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c10ac00 con 0x7eff0c0f6860 2022-02-02T18:38:52.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.746+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c045ad0 con 0x7eff0c0f6860 2022-02-02T18:38:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.746+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efefc01d960 con 0x7eff0c0f6860 2022-02-02T18:38:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.747+0000 7efefaffd700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 0x7efef4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.747+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efefc083830 con 0x7eff0c0f6860 2022-02-02T18:38:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.747+0000 7eff0a59c700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 0x7efef4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.747+0000 7eff0a59c700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 0x7efef4067290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7eff00007fd0 tx=0x7eff00009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.751+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efefc0553d0 con 0x7eff0c0f6860 2022-02-02T18:38:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:52 smithi159 ceph-mon[69013]: pgmap v502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:52.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.931+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff0c10b3d0 con 0x7efef4064dd0 2022-02-02T18:38:52.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.932+0000 7efefaffd700 1 -- 172.21.15.96:0/3300117183 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7eff0c10b3d0 con 0x7efef4064dd0 2022-02-02T18:38:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 msgr2=0x7efef4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 0x7efef4067290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7eff00007fd0 tx=0x7eff00009040).stop 2022-02-02T18:38:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 msgr2=0x7eff0c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7efefc009990 tx=0x7efefc009b30).stop 2022-02-02T18:38:52.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 shutdown_connections 2022-02-02T18:38:52.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efef4064dd0 0x7efef4067290 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff0c0f55c0 0x7eff0c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 --2- 172.21.15.96:0/3300117183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff0c0f6860 0x7eff0c109670 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 >> 172.21.15.96:0/3300117183 conn(0x7eff0c0f0d40 msgr2=0x7eff0c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 shutdown_connections 2022-02-02T18:38:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:52.934+0000 7eff109bc700 1 -- 172.21.15.96:0/3300117183 wait complete. 2022-02-02T18:38:52.941 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:38:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/1509046370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 msgr2=0x7fcb080f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/1509046370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb080f5850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fcaf8004660 tx=0x7fcaf8009b30).stop 2022-02-02T18:38:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/1509046370 shutdown_connections 2022-02-02T18:38:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/1509046370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb080f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/1509046370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb080f5850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/1509046370 >> 172.21.15.96:0/1509046370 conn(0x7fcb080f0b90 msgr2=0x7fcb080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/1509046370 shutdown_connections 2022-02-02T18:38:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/1509046370 wait complete. 2022-02-02T18:38:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 Processor -- start 2022-02-02T18:38:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.032+0000 7fcb0ecbe700 1 -- start start 2022-02-02T18:38:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0ecbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0ecbe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb0810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0ecbe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080603c0 con 0x7fcb080f5430 2022-02-02T18:38:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0ecbe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08060500 con 0x7fcb080f66d0 2022-02-02T18:38:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0d4bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb0810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0d4bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb0810bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:59268/0 (socket says 172.21.15.96:59268) 2022-02-02T18:38:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0d4bb700 1 -- 172.21.15.96:0/70052675 learned_addr learned my addr 172.21.15.96:0/70052675 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55162/0 (socket says 172.21.15.96:55162) 2022-02-02T18:38:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 -- 172.21.15.96:0/70052675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 msgr2=0x7fcb0810bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb0810bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 -- 172.21.15.96:0/70052675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8005040 con 0x7fcb080f5430 2022-02-02T18:38:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.033+0000 7fcb0dcbc700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcaf8000c00 tx=0x7fcaf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.034+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf8018070 con 0x7fcb080f5430 2022-02-02T18:38:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.034+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcaf8007ba0 con 0x7fcb080f5430 2022-02-02T18:38:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.034+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf80123c0 con 0x7fcb080f5430 2022-02-02T18:38:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.034+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0810c540 con 0x7fcb080f5430 2022-02-02T18:38:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.034+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0810ca70 con 0x7fcb080f5430 2022-02-02T18:38:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.035+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08059100 con 0x7fcb080f5430 2022-02-02T18:38:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.035+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcaf801d420 con 0x7fcb080f5430 2022-02-02T18:38:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.036+0000 7fcafe7fc700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 0x7fcaf40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.036+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcaf80836e0 con 0x7fcb080f5430 2022-02-02T18:38:53.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.036+0000 7fcb0d4bb700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 0x7fcaf40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.036+0000 7fcb0d4bb700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 0x7fcaf40672e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcb040041d0 tx=0x7fcb04009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.040+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcaf8051790 con 0x7fcb080f5430 2022-02-02T18:38:53.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.212+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb080fdd80 con 0x7fcaf4064e20 2022-02-02T18:38:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.221+0000 7fcafe7fc700 1 -- 172.21.15.96:0/70052675 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fcb080fdd80 con 0x7fcaf4064e20 2022-02-02T18:38:53.219 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:38:53.219 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (22m) 2m ago 23m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:38:53.220 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (14m) 2m ago 23m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:38:53.220 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (14m) 83s ago 22m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:38:53.220 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (22m) 2m ago 23m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:38:53.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (19m) 2m ago 19m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:38:53.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (14m) 2m ago 19m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:38:53.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (19m) 83s ago 19m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:38:53.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (15m) 83s ago 19m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:38:53.222 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (16m) 2m ago 24m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:38:53.222 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (16m) 83s ago 22m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:38:53.222 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (15m) 2m ago 24m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:38:53.222 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (15m) 83s ago 22m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:38:53.223 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (23m) 2m ago 23m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:38:53.223 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (22m) 83s ago 22m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:38:53.223 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (14m) 2m ago 22m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:38:53.223 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (13m) 2m ago 21m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:38:53.224 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (13m) 2m ago 21m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:38:53.224 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (12m) 83s ago 21m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:38:53.224 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (12m) 83s ago 20m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:38:53.224 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (11m) 83s ago 20m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:38:53.224 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (22m) 2m ago 22m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:38:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 msgr2=0x7fcaf40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 0x7fcaf40672e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcb040041d0 tx=0x7fcb04009040).stop 2022-02-02T18:38:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 msgr2=0x7fcb08109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcaf8000c00 tx=0x7fcaf8009b30).stop 2022-02-02T18:38:53.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 shutdown_connections 2022-02-02T18:38:53.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064e20 0x7fcaf40672e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f5430 0x7fcb08109af0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 --2- 172.21.15.96:0/70052675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66d0 0x7fcb0810bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 >> 172.21.15.96:0/70052675 conn(0x7fcb080f0b90 msgr2=0x7fcb080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 shutdown_connections 2022-02-02T18:38:53.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.223+0000 7fcb0ecbe700 1 -- 172.21.15.96:0/70052675 wait complete. 2022-02-02T18:38:53.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 -- 172.21.15.96:0/2545221941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 msgr2=0x7f85240f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 --2- 172.21.15.96:0/2545221941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f85240f5860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f8518004660 tx=0x7f8518009b30).stop 2022-02-02T18:38:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 -- 172.21.15.96:0/2545221941 shutdown_connections 2022-02-02T18:38:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 --2- 172.21.15.96:0/2545221941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 0x7f85240f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 --2- 172.21.15.96:0/2545221941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f85240f5860 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 -- 172.21.15.96:0/2545221941 >> 172.21.15.96:0/2545221941 conn(0x7f85240f0ba0 msgr2=0x7f85240f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.320+0000 7f8529959700 1 -- 172.21.15.96:0/2545221941 shutdown_connections 2022-02-02T18:38:53.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 -- 172.21.15.96:0/2545221941 wait complete. 2022-02-02T18:38:53.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 Processor -- start 2022-02-02T18:38:53.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 -- start start 2022-02-02T18:38:53.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 0x7f8524107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524107900 con 0x7f85240f5440 2022-02-02T18:38:53.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8529959700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524108110 con 0x7f85240f66e0 2022-02-02T18:38:53.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.321+0000 7f8528957700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55172/0 (socket says 172.21.15.96:55172) 2022-02-02T18:38:53.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 -- 172.21.15.96:0/1021159199 learned_addr learned my addr 172.21.15.96:0/1021159199 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:53.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8523fff700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 0x7f8524107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 -- 172.21.15.96:0/1021159199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 msgr2=0x7f8524107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 0x7f8524107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 -- 172.21.15.96:0/1021159199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518005040 con 0x7f85240f5440 2022-02-02T18:38:53.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8528957700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8518004f60 tx=0x7f8518009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8518018070 con 0x7f85240f5440 2022-02-02T18:38:53.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524108330 con 0x7f85240f5440 2022-02-02T18:38:53.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8518007ba0 con 0x7f85240f5440 2022-02-02T18:38:53.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851801c620 con 0x7f85240f5440 2022-02-02T18:38:53.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.322+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8524108890 con 0x7f85240f5440 2022-02-02T18:38:53.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.323+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524059100 con 0x7f85240f5440 2022-02-02T18:38:53.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.324+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f851801c8e0 con 0x7f85240f5440 2022-02-02T18:38:53.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.324+0000 7f85217fa700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 0x7f85140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.324+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f85180839b0 con 0x7f85240f5440 2022-02-02T18:38:53.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.324+0000 7f8523fff700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 0x7f85140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.324+0000 7f8523fff700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 0x7f85140672e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f85100041d0 tx=0x7f8510009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.328+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8518051a60 con 0x7f85240f5440 2022-02-02T18:38:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.561+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85240fdd90 con 0x7f85240f5440 2022-02-02T18:38:53.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.561+0000 7f85217fa700 1 -- 172.21.15.96:0/1021159199 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f85240fdd90 con 0x7f85240f5440 2022-02-02T18:38:53.559 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:38:53.559 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:38:53.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:38:53.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:53.560 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:38:53.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:38:53.561 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:53.561 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:38:53.561 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:38:53.561 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:53.562 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:38:53.562 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:38:53.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:38:53.562 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:38:53.562 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:38:53.563 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:38:53.563 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:38:53.563 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:38:53.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 msgr2=0x7f85140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 0x7f85140672e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f85100041d0 tx=0x7f8510009040).stop 2022-02-02T18:38:53.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 msgr2=0x7f8524106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8518004f60 tx=0x7f8518009b30).stop 2022-02-02T18:38:53.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 shutdown_connections 2022-02-02T18:38:53.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8514064e20 0x7f85140672e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85240f5440 0x7f8524106e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 --2- 172.21.15.96:0/1021159199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85240f66e0 0x7f8524107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 >> 172.21.15.96:0/1021159199 conn(0x7f85240f0ba0 msgr2=0x7f852405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 shutdown_connections 2022-02-02T18:38:53.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.563+0000 7f8529959700 1 -- 172.21.15.96:0/1021159199 wait complete. 2022-02-02T18:38:53.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 -- 172.21.15.96:0/2024344508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 msgr2=0x7f5d0c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 --2- 172.21.15.96:0/2024344508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c0f7de0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5cfc004660 tx=0x7f5cfc009b30).stop 2022-02-02T18:38:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 -- 172.21.15.96:0/2024344508 shutdown_connections 2022-02-02T18:38:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 --2- 172.21.15.96:0/2024344508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c0f7de0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 --2- 172.21.15.96:0/2024344508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:38:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 -- 172.21.15.96:0/2024344508 >> 172.21.15.96:0/2024344508 conn(0x7f5d0c0f1e40 msgr2=0x7f5d0c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 -- 172.21.15.96:0/2024344508 shutdown_connections 2022-02-02T18:38:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.661+0000 7f5d109f4700 1 -- 172.21.15.96:0/2024344508 wait complete. 2022-02-02T18:38:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 Processor -- start 2022-02-02T18:38:53.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 -- start start 2022-02-02T18:38:53.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c107ae0 con 0x7f5d0c0f7980 2022-02-02T18:38:53.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d109f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c108390 con 0x7f5d0c0f66e0 2022-02-02T18:38:53.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55184/0 (socket says 172.21.15.96:55184) 2022-02-02T18:38:53.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 -- 172.21.15.96:0/1861881611 learned_addr learned my addr 172.21.15.96:0/1861881611 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:38:53.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d0a59c700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 -- 172.21.15.96:0/1861881611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 msgr2=0x7f5d0c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 -- 172.21.15.96:0/1861881611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc005040 con 0x7f5d0c0f7980 2022-02-02T18:38:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d0a59c700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:38:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5d09d9b700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f5cfc009990 tx=0x7f5cfc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.662+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc018070 con 0x7f5d0c0f7980 2022-02-02T18:38:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.663+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cfc007ca0 con 0x7f5d0c0f7980 2022-02-02T18:38:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.663+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c108610 con 0x7f5d0c0f7980 2022-02-02T18:38:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.663+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc01c620 con 0x7f5d0c0f7980 2022-02-02T18:38:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.663+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c108b70 con 0x7f5d0c0f7980 2022-02-02T18:38:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.664+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c0f5ad0 con 0x7f5d0c0f7980 2022-02-02T18:38:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.664+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cfc01d960 con 0x7f5d0c0f7980 2022-02-02T18:38:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.664+0000 7f5cfaffd700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 0x7f5cf4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:38:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.665+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5cfc083820 con 0x7f5d0c0f7980 2022-02-02T18:38:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.665+0000 7f5d0a59c700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 0x7f5cf4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:38:53.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.665+0000 7f5d0a59c700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 0x7f5cf4067290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5d0c0f77e0 tx=0x7f5d00008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:38:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.669+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cfc055470 con 0x7f5d0c0f7980 2022-02-02T18:38:53.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.871+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d0c0fef40 con 0x7f5d0c0f7980 2022-02-02T18:38:53.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.871+0000 7f5cfaffd700 1 -- 172.21.15.96:0/1861881611 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5cfc055060 con 0x7f5d0c0f7980 2022-02-02T18:38:53.869 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:38:53.869 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:38:53.870 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:38:53.870 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:38:53.870 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:53.870 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:38:53.870 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:38:53.871 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:38:53.871 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:38:53.871 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:38:53.871 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:38:53.872 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:38:53.872 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:38:53.872 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:38:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:38:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:38:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:38:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:38:53.873 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:38:53.874 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:38:53.874 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:38:53.874 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:38:53.874 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:38:53.875 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:38:53.875 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:38:53.875 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:38:53.875 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:38:53.875 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:38:53.876 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:38:53.876 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:38:53.876 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:38:53.876 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:38:53.877 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:53.877 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:53.877 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:38:53.877 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:38:53.877 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:53.878 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:53.878 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:38:53.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 msgr2=0x7f5cf4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 0x7f5cf4067290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5d0c0f77e0 tx=0x7f5d00008040).stop 2022-02-02T18:38:53.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 msgr2=0x7f5d0c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:38:53.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f5cfc009990 tx=0x7f5cfc009b30).stop 2022-02-02T18:38:53.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 shutdown_connections 2022-02-02T18:38:53.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cf4064dd0 0x7f5cf4067290 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d0c0f66e0 0x7f5d0c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 --2- 172.21.15.96:0/1861881611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d0c0f7980 0x7f5d0c1074a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:38:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 >> 172.21.15.96:0/1861881611 conn(0x7f5d0c0f1e40 msgr2=0x7f5d0c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:38:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 shutdown_connections 2022-02-02T18:38:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:38:53.873+0000 7f5d109f4700 1 -- 172.21.15.96:0/1861881611 wait complete. 2022-02-02T18:38:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:38:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:54 smithi159 ceph-mon[69013]: from='client.34636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:54 smithi159 ceph-mon[69013]: pgmap v503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:54 smithi159 ceph-mon[69013]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1021159199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1861881611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:38:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:54 smithi096 ceph-mon[101353]: from='client.34636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:54 smithi096 ceph-mon[101353]: pgmap v503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:54 smithi096 ceph-mon[101353]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:38:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1021159199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:38:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1861881611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:38:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:56 smithi159 ceph-mon[69013]: pgmap v504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:56 smithi096 ceph-mon[101353]: pgmap v504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:38:58 smithi159 ceph-mon[69013]: pgmap v505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:38:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:38:58 smithi096 ceph-mon[101353]: pgmap v505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: pgmap v506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: pgmap v506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:00.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:01 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:01 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:01.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:01 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:01.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:01 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:02 smithi159 ceph-mon[69013]: pgmap v507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:02 smithi096 ceph-mon[101353]: pgmap v507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:04 smithi159 ceph-mon[69013]: pgmap v508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:04 smithi096 ceph-mon[101353]: pgmap v508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:06.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:06 smithi159 ceph-mon[69013]: pgmap v509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:06 smithi096 ceph-mon[101353]: pgmap v509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:08 smithi159 ceph-mon[69013]: pgmap v510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:08 smithi096 ceph-mon[101353]: pgmap v510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: pgmap v511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:10.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: pgmap v511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:10.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:10.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:10.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:11 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:11 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:11 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:11 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:12 smithi159 ceph-mon[69013]: pgmap v512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:12 smithi096 ceph-mon[101353]: pgmap v512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:14 smithi159 ceph-mon[69013]: pgmap v513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:14 smithi096 ceph-mon[101353]: pgmap v513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:16.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:16 smithi159 ceph-mon[69013]: pgmap v514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:16.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:16 smithi096 ceph-mon[101353]: pgmap v514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:18.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:18 smithi159 ceph-mon[69013]: pgmap v515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:18 smithi096 ceph-mon[101353]: pgmap v515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: pgmap v516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:20.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: pgmap v516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:20.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:21 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:21.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:21 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:22 smithi159 ceph-mon[69013]: pgmap v517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:22 smithi096 ceph-mon[101353]: pgmap v517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:23.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 -- 172.21.15.96:0/3040973152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f6860 msgr2=0x7fdcd00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:23.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/3040973152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f6860 0x7fdcd00f6cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fdcbc004660 tx=0x7fdcbc009b30).stop 2022-02-02T18:39:23.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 -- 172.21.15.96:0/3040973152 shutdown_connections 2022-02-02T18:39:23.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/3040973152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f6860 0x7fdcd00f6cc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:23.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/3040973152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f55c0 0x7fdcd00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:39:23.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 -- 172.21.15.96:0/3040973152 >> 172.21.15.96:0/3040973152 conn(0x7fdcd00f0d40 msgr2=0x7fdcd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:23.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 -- 172.21.15.96:0/3040973152 shutdown_connections 2022-02-02T18:39:23.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 -- 172.21.15.96:0/3040973152 wait complete. 2022-02-02T18:39:23.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.984+0000 7fdcd6f93700 1 Processor -- start 2022-02-02T18:39:23.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd6f93700 1 -- start start 2022-02-02T18:39:23.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd6f93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:23.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd6f93700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f6860 0x7fdcd010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:23.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd6f93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0060470 con 0x7fdcd00f55c0 2022-02-02T18:39:23.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd6f93700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00605b0 con 0x7fdcd00f6860 2022-02-02T18:39:23.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:23.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55206/0 (socket says 172.21.15.96:55206) 2022-02-02T18:39:23.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 -- 172.21.15.96:0/2654594488 learned_addr learned my addr 172.21.15.96:0/2654594488 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:23.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdccffff700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f6860 0x7fdcd010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:23.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 -- 172.21.15.96:0/2654594488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f6860 msgr2=0x7fdcd010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:23.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f6860 0x7fdcd010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:23.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.985+0000 7fdcd4d2f700 1 -- 172.21.15.96:0/2654594488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc005040 con 0x7fdcd00f55c0 2022-02-02T18:39:23.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdcd4d2f700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fdcc40093f0 tx=0x7fdcc4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:23.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc4009ea0 con 0x7fdcd00f55c0 2022-02-02T18:39:23.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdcc4013af0 con 0x7fdcd00f55c0 2022-02-02T18:39:23.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd010c810 con 0x7fdcd00f55c0 2022-02-02T18:39:23.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc400db10 con 0x7fdcd00f55c0 2022-02-02T18:39:23.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.986+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd010cda0 con 0x7fdcd00f55c0 2022-02-02T18:39:23.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.987+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0045ad0 con 0x7fdcd00f55c0 2022-02-02T18:39:23.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.988+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdcc401a060 con 0x7fdcd00f55c0 2022-02-02T18:39:23.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.988+0000 7fdccd7fa700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 0x7fdcc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:23.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.988+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdcc4081ed0 con 0x7fdcd00f55c0 2022-02-02T18:39:23.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.988+0000 7fdccffff700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 0x7fdcc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:23.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.989+0000 7fdccffff700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 0x7fdcc0067290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdcbc004e30 tx=0x7fdcbc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:23.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:23.992+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdcc404ff80 con 0x7fdcd00f55c0 2022-02-02T18:39:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.171+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd0057f10 con 0x7fdcc0064dd0 2022-02-02T18:39:24.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.172+0000 7fdccd7fa700 1 -- 172.21.15.96:0/2654594488 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdcd0057f10 con 0x7fdcc0064dd0 2022-02-02T18:39:24.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 msgr2=0x7fdcc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 0x7fdcc0067290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdcbc004e30 tx=0x7fdcbc009b30).stop 2022-02-02T18:39:24.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 msgr2=0x7fdcd0109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fdcc40093f0 tx=0x7fdcc4006ec0).stop 2022-02-02T18:39:24.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 shutdown_connections 2022-02-02T18:39:24.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc0064dd0 0x7fdcc0067290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcd00f55c0 0x7fdcd0109cb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 --2- 172.21.15.96:0/2654594488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcd00f6860 0x7fdcd010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 >> 172.21.15.96:0/2654594488 conn(0x7fdcd00f0d40 msgr2=0x7fdcd00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 shutdown_connections 2022-02-02T18:39:24.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.174+0000 7fdcd6f93700 1 -- 172.21.15.96:0/2654594488 wait complete. 2022-02-02T18:39:24.183 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:39:24.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 -- 172.21.15.96:0/2607528801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 msgr2=0x7f8c600f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/2607528801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c600f7010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f8c5c004660 tx=0x7f8c5c009b30).stop 2022-02-02T18:39:24.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 -- 172.21.15.96:0/2607528801 shutdown_connections 2022-02-02T18:39:24.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/2607528801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 0x7f8c600f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/2607528801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c600f7010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.272+0000 7f8c67a2f700 1 -- 172.21.15.96:0/2607528801 >> 172.21.15.96:0/2607528801 conn(0x7f8c600f04c0 msgr2=0x7f8c600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.273+0000 7f8c67a2f700 1 -- 172.21.15.96:0/2607528801 shutdown_connections 2022-02-02T18:39:24.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.273+0000 7f8c67a2f700 1 -- 172.21.15.96:0/2607528801 wait complete. 2022-02-02T18:39:24.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.273+0000 7f8c67a2f700 1 Processor -- start 2022-02-02T18:39:24.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.273+0000 7f8c67a2f700 1 -- start start 2022-02-02T18:39:24.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c67a2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c67a2f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 0x7f8c6010c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c67a2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600f5640 con 0x7f8c600f6bf0 2022-02-02T18:39:24.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c67a2f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600f5780 con 0x7f8c600f7590 2022-02-02T18:39:24.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55216/0 (socket says 172.21.15.96:55216) 2022-02-02T18:39:24.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 -- 172.21.15.96:0/646871547 learned_addr learned my addr 172.21.15.96:0/646871547 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:24.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c64fca700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 0x7f8c6010c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 -- 172.21.15.96:0/646871547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 msgr2=0x7f8c6010c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 0x7f8c6010c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 -- 172.21.15.96:0/646871547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c005040 con 0x7f8c600f6bf0 2022-02-02T18:39:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.274+0000 7f8c657cb700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f8c5c0043a0 tx=0x7f8c5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.275+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c018070 con 0x7f8c600f6bf0 2022-02-02T18:39:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.275+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c5c007ba0 con 0x7f8c600f6bf0 2022-02-02T18:39:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.275+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6010c780 con 0x7f8c600f6bf0 2022-02-02T18:39:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.275+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c01de30 con 0x7f8c600f6bf0 2022-02-02T18:39:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.275+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6010cce0 con 0x7f8c600f6bf0 2022-02-02T18:39:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.276+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60045ad0 con 0x7f8c600f6bf0 2022-02-02T18:39:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.276+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c5c01d420 con 0x7f8c600f6bf0 2022-02-02T18:39:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.277+0000 7f8c55ffb700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 0x7f8c4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.277+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8c5c083640 con 0x7f8c600f6bf0 2022-02-02T18:39:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.277+0000 7f8c64fca700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 0x7f8c4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.277+0000 7f8c64fca700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 0x7f8c4c067290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8c50004c40 tx=0x7f8c5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.281+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c5c0517b0 con 0x7f8c600f6bf0 2022-02-02T18:39:24.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.451+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c600fdef0 con 0x7f8c4c064dd0 2022-02-02T18:39:24.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.461+0000 7f8c55ffb700 1 -- 172.21.15.96:0/646871547 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8c600fdef0 con 0x7f8c4c064dd0 2022-02-02T18:39:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:39:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (22m) 3m ago 23m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:39:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (15m) 3m ago 23m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:39:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (15m) 115s ago 23m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:39:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (22m) 3m ago 23m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:39:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (19m) 3m ago 19m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:39:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (15m) 3m ago 19m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:39:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (19m) 115s ago 19m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:39:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (15m) 115s ago 20m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:39:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (17m) 3m ago 24m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:39:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (16m) 115s ago 23m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:39:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (16m) 3m ago 25m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:39:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (15m) 115s ago 23m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:39:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (23m) 3m ago 23m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:39:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (23m) 115s ago 23m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:39:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (14m) 3m ago 22m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:39:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (14m) 3m ago 22m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:39:24.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (13m) 3m ago 22m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:39:24.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (13m) 115s ago 21m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:39:24.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (12m) 115s ago 21m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:39:24.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (12m) 115s ago 21m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:39:24.508 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (22m) 3m ago 23m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:39:24.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 msgr2=0x7f8c4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 0x7f8c4c067290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8c50004c40 tx=0x7f8c5000b040).stop 2022-02-02T18:39:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 msgr2=0x7f8c60109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f8c5c0043a0 tx=0x7f8c5c009b30).stop 2022-02-02T18:39:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 shutdown_connections 2022-02-02T18:39:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c4c064dd0 0x7f8c4c067290 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c600f6bf0 0x7f8c60109d30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 --2- 172.21.15.96:0/646871547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c600f7590 0x7f8c6010c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 >> 172.21.15.96:0/646871547 conn(0x7f8c600f04c0 msgr2=0x7f8c600fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 shutdown_connections 2022-02-02T18:39:24.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.463+0000 7f8c67a2f700 1 -- 172.21.15.96:0/646871547 wait complete. 2022-02-02T18:39:24.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:24 smithi096 ceph-mon[101353]: pgmap v518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:24.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 -- 172.21.15.96:0/3645421335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 msgr2=0x7f64640f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 --2- 172.21.15.96:0/3645421335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f64640f6ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f6458004660 tx=0x7f6458009b30).stop 2022-02-02T18:39:24.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 -- 172.21.15.96:0/3645421335 shutdown_connections 2022-02-02T18:39:24.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 --2- 172.21.15.96:0/3645421335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f7960 0x7f64640f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:39:24.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 --2- 172.21.15.96:0/3645421335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f64640f6ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 -- 172.21.15.96:0/3645421335 >> 172.21.15.96:0/3645421335 conn(0x7f64640f1e20 msgr2=0x7f64640f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 -- 172.21.15.96:0/3645421335 shutdown_connections 2022-02-02T18:39:24.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.561+0000 7f6468a6e700 1 -- 172.21.15.96:0/3645421335 wait complete. 2022-02-02T18:39:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 Processor -- start 2022-02-02T18:39:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 -- start start 2022-02-02T18:39:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f7960 0x7f6464107500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464107b40 con 0x7f64640f66c0 2022-02-02T18:39:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f6468a6e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641083f0 con 0x7f64640f7960 2022-02-02T18:39:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f646259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f646259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55226/0 (socket says 172.21.15.96:55226) 2022-02-02T18:39:24.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.562+0000 7f646259c700 1 -- 172.21.15.96:0/1794633241 learned_addr learned my addr 172.21.15.96:0/1794633241 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:24.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f646259c700 1 -- 172.21.15.96:0/1794633241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f7960 msgr2=0x7f6464107500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:39:24.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f646259c700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f7960 0x7f6464107500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:39:24.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f646259c700 1 -- 172.21.15.96:0/1794633241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458005040 con 0x7f64640f66c0 2022-02-02T18:39:24.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f646259c700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6458013a70 tx=0x7f6458009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6458018070 con 0x7f64640f66c0 2022-02-02T18:39:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6458009760 con 0x7f64640f66c0 2022-02-02T18:39:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464108670 con 0x7f64640f66c0 2022-02-02T18:39:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645801c620 con 0x7f64640f66c0 2022-02-02T18:39:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.563+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6464108bd0 con 0x7f64640f66c0 2022-02-02T18:39:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.564+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f645801d420 con 0x7f64640f66c0 2022-02-02T18:39:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.564+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640f5ab0 con 0x7f64640f66c0 2022-02-02T18:39:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.565+0000 7f6452ffd700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 0x7f644c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.565+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6458083750 con 0x7f64640f66c0 2022-02-02T18:39:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.565+0000 7f6461d9b700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 0x7f644c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.565+0000 7f6461d9b700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 0x7f644c067290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f645400b460 tx=0x7f6454006960).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.569+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6458055230 con 0x7f64640f66c0 2022-02-02T18:39:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:24 smithi159 ceph-mon[69013]: pgmap v518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:24.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.797+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64640008d0 con 0x7f64640f66c0 2022-02-02T18:39:24.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.797+0000 7f6452ffd700 1 -- 172.21.15.96:0/1794633241 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6458054e20 con 0x7f64640f66c0 2022-02-02T18:39:24.796 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:39:24.796 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:39:24.797 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:39:24.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:24.797 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:39:24.797 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:39:24.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:24.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:39:24.798 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:39:24.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:24.799 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:39:24.799 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:39:24.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:24.799 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:39:24.800 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:39:24.800 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:39:24.800 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:39:24.800 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:39:24.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 msgr2=0x7f644c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 0x7f644c067290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f645400b460 tx=0x7f6454006960).stop 2022-02-02T18:39:24.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 msgr2=0x7f6464107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6458013a70 tx=0x7f6458009b30).stop 2022-02-02T18:39:24.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 shutdown_connections 2022-02-02T18:39:24.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f644c064dd0 0x7f644c067290 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f66c0 0x7f6464107010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 --2- 172.21.15.96:0/1794633241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f7960 0x7f6464107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:39:24.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 >> 172.21.15.96:0/1794633241 conn(0x7f64640f1e20 msgr2=0x7f64640fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 shutdown_connections 2022-02-02T18:39:24.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.799+0000 7f6468a6e700 1 -- 172.21.15.96:0/1794633241 wait complete. 2022-02-02T18:39:24.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 -- 172.21.15.96:0/2428979682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f7b80 msgr2=0x7f9d700f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2428979682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f7b80 0x7f9d700f7fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9d60004660 tx=0x7f9d60009b30).stop 2022-02-02T18:39:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 -- 172.21.15.96:0/2428979682 shutdown_connections 2022-02-02T18:39:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2428979682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f7b80 0x7f9d700f7fe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2428979682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f68e0 0x7f9d700f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:39:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 -- 172.21.15.96:0/2428979682 >> 172.21.15.96:0/2428979682 conn(0x7f9d700f2020 msgr2=0x7f9d700f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 -- 172.21.15.96:0/2428979682 shutdown_connections 2022-02-02T18:39:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.896+0000 7f9d7785c700 1 -- 172.21.15.96:0/2428979682 wait complete. 2022-02-02T18:39:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 Processor -- start 2022-02-02T18:39:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 -- start start 2022-02-02T18:39:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f7b80 0x7f9d70107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d70107cb0 con 0x7f9d700f68e0 2022-02-02T18:39:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d7785c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d70108560 con 0x7f9d700f7b80 2022-02-02T18:39:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55236/0 (socket says 172.21.15.96:55236) 2022-02-02T18:39:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 -- 172.21.15.96:0/2529642908 learned_addr learned my addr 172.21.15.96:0/2529642908 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d74df7700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f7b80 0x7f9d70107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 -- 172.21.15.96:0/2529642908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f7b80 msgr2=0x7f9d70107670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f7b80 0x7f9d70107670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 -- 172.21.15.96:0/2529642908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60005040 con 0x7f9d700f68e0 2022-02-02T18:39:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.897+0000 7f9d755f8700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d6c0093f0 tx=0x7f9d6c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.898+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6c009ea0 con 0x7f9d700f68e0 2022-02-02T18:39:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.898+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d70108840 con 0x7f9d700f68e0 2022-02-02T18:39:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.898+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d6c013af0 con 0x7f9d700f68e0 2022-02-02T18:39:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.898+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6c00db10 con 0x7f9d700f68e0 2022-02-02T18:39:24.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.898+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d70108e00 con 0x7f9d700f68e0 2022-02-02T18:39:24.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.899+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d700f5cd0 con 0x7f9d700f68e0 2022-02-02T18:39:24.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.899+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9d6c01a060 con 0x7f9d700f68e0 2022-02-02T18:39:24.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.900+0000 7f9d65ffb700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 0x7f9d5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:24.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.900+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9d6c081bb0 con 0x7f9d700f68e0 2022-02-02T18:39:24.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.900+0000 7f9d74df7700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 0x7f9d5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:24.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.900+0000 7f9d74df7700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 0x7f9d5c067290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9d60004e30 tx=0x7f9d60009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:24.904+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9d6c0535d0 con 0x7f9d700f68e0 2022-02-02T18:39:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.105+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d70027b30 con 0x7f9d700f68e0 2022-02-02T18:39:25.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.105+0000 7f9d65ffb700 1 -- 172.21.15.96:0/2529642908 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9d6c018070 con 0x7f9d700f68e0 2022-02-02T18:39:25.104 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:39:25.104 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:39:25.105 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:39:25.105 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:39:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:25.105 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:39:25.106 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:39:25.106 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:39:25.106 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:39:25.106 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:39:25.107 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:39:25.107 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:39:25.107 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:39:25.107 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:39:25.108 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:39:25.108 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:39:25.108 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:39:25.108 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:39:25.109 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:39:25.109 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:39:25.109 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:39:25.109 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:39:25.110 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:39:25.110 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:39:25.110 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:39:25.110 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:39:25.111 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:39:25.111 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:39:25.111 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:39:25.112 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:39:25.112 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:39:25.112 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:39:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:25.113 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:39:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:25.114 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:25.114 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:25.114 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 msgr2=0x7f9d5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 0x7f9d5c067290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9d60004e30 tx=0x7f9d60009b30).stop 2022-02-02T18:39:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 msgr2=0x7f9d70107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d6c0093f0 tx=0x7f9d6c006ec0).stop 2022-02-02T18:39:25.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 shutdown_connections 2022-02-02T18:39:25.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d5c064dd0 0x7f9d5c067290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:25.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d700f68e0 0x7f9d70107180 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:25.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 --2- 172.21.15.96:0/2529642908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d700f7b80 0x7f9d70107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 >> 172.21.15.96:0/2529642908 conn(0x7f9d700f2020 msgr2=0x7f9d700fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 shutdown_connections 2022-02-02T18:39:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:25.107+0000 7f9d7785c700 1 -- 172.21.15.96:0/2529642908 wait complete. 2022-02-02T18:39:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:39:25.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:25 smithi159 ceph-mon[69013]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:25.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:25 smithi159 ceph-mon[69013]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1794633241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:25.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2529642908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:39:25.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:25 smithi096 ceph-mon[101353]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:25.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:25 smithi096 ceph-mon[101353]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:25.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1794633241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:25.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2529642908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:39:26.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:26 smithi159 ceph-mon[69013]: pgmap v519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:26.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:26 smithi096 ceph-mon[101353]: pgmap v519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:39:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:39:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:39:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:39:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:28 smithi159 ceph-mon[69013]: pgmap v520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:28.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:28 smithi096 ceph-mon[101353]: pgmap v520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:30 smithi159 ceph-mon[69013]: pgmap v521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:30 smithi096 ceph-mon[101353]: pgmap v521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:30.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:31.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:31.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:32.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:32 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:32 smithi096 ceph-mon[101353]: pgmap v522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:32 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:32 smithi159 ceph-mon[69013]: pgmap v522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:33 smithi159 ceph-mon[69013]: pgmap v523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:33.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:33 smithi096 ceph-mon[101353]: pgmap v523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:36.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:36 smithi096 ceph-mon[101353]: pgmap v524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:36 smithi159 ceph-mon[69013]: pgmap v524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:38.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:38 smithi096 ceph-mon[101353]: pgmap v525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:38 smithi159 ceph-mon[69013]: pgmap v525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:40 smithi096 ceph-mon[101353]: pgmap v526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:40.567 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:40 smithi159 ceph-mon[69013]: pgmap v526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:41.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:41.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:41.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:41.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:41.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:41.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:42 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:42 smithi096 ceph-mon[101353]: pgmap v527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:42 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:42 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:42 smithi159 ceph-mon[69013]: pgmap v527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:42 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:44.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:44 smithi096 ceph-mon[101353]: pgmap v528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:44 smithi159 ceph-mon[69013]: pgmap v528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:46 smithi159 ceph-mon[69013]: pgmap v529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:46 smithi096 ceph-mon[101353]: pgmap v529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:48 smithi159 ceph-mon[69013]: pgmap v530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:48 smithi096 ceph-mon[101353]: pgmap v530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:50.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:50 smithi159 ceph-mon[69013]: pgmap v531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:50 smithi096 ceph-mon[101353]: pgmap v531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:51.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:51.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:39:51.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:39:51.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:39:51.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:39:51.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:51.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:52 smithi159 ceph-mon[69013]: pgmap v532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:52 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:52 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:52 smithi096 ceph-mon[101353]: pgmap v532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:52 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:39:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:52 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:39:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:54 smithi159 ceph-mon[69013]: pgmap v533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:54 smithi096 ceph-mon[101353]: pgmap v533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:55.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1298423773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f7980 msgr2=0x7f4c480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1298423773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f7980 0x7f4c480f7de0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4c30004660 tx=0x7f4c30009b30).stop 2022-02-02T18:39:55.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1298423773 shutdown_connections 2022-02-02T18:39:55.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1298423773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f7980 0x7f4c480f7de0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1298423773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f66e0 0x7f4c480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1298423773 >> 172.21.15.96:0/1298423773 conn(0x7f4c480f1e40 msgr2=0x7f4c480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:55.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1298423773 shutdown_connections 2022-02-02T18:39:55.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.220+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1298423773 wait complete. 2022-02-02T18:39:55.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 Processor -- start 2022-02-02T18:39:55.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 -- start start 2022-02-02T18:39:55.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f7980 0x7f4c48107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48107a00 con 0x7f4c480f66e0 2022-02-02T18:39:55.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.221+0000 7f4c4dac8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48107b40 con 0x7f4c480f7980 2022-02-02T18:39:55.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55256/0 (socket says 172.21.15.96:55256) 2022-02-02T18:39:55.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 -- 172.21.15.96:0/1690719165 learned_addr learned my addr 172.21.15.96:0/1690719165 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:55.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c46ffd700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f7980 0x7f4c48107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 -- 172.21.15.96:0/1690719165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f7980 msgr2=0x7f4c48107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f7980 0x7f4c48107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 -- 172.21.15.96:0/1690719165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30005040 con 0x7f4c480f66e0 2022-02-02T18:39:55.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c477fe700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4c38002700 tx=0x7f4c38009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c38009320 con 0x7f4c480f66e0 2022-02-02T18:39:55.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c481084e0 con 0x7f4c480f66e0 2022-02-02T18:39:55.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c3800f040 con 0x7f4c480f66e0 2022-02-02T18:39:55.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c48108aa0 con 0x7f4c480f66e0 2022-02-02T18:39:55.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.222+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c38014900 con 0x7f4c480f66e0 2022-02-02T18:39:55.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.223+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c004fa0 con 0x7f4c480f66e0 2022-02-02T18:39:55.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.224+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c38009480 con 0x7f4c480f66e0 2022-02-02T18:39:55.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.225+0000 7f4c3ffff700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 0x7f4c34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.225+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c38082000 con 0x7f4c480f66e0 2022-02-02T18:39:55.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.225+0000 7f4c46ffd700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 0x7f4c34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.225+0000 7f4c46ffd700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 0x7f4c34067290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f4c30004630 tx=0x7f4c30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.228+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c38053ae0 con 0x7f4c480f66e0 2022-02-02T18:39:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.409+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c2c000b90 con 0x7f4c34064dd0 2022-02-02T18:39:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.410+0000 7f4c3ffff700 1 -- 172.21.15.96:0/1690719165 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4c2c000b90 con 0x7f4c34064dd0 2022-02-02T18:39:55.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 msgr2=0x7f4c34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 0x7f4c34067290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f4c30004630 tx=0x7f4c30009b30).stop 2022-02-02T18:39:55.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 msgr2=0x7f4c48106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4c38002700 tx=0x7f4c38009d80).stop 2022-02-02T18:39:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 shutdown_connections 2022-02-02T18:39:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c34064dd0 0x7f4c34067290 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c480f66e0 0x7f4c48106f60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 --2- 172.21.15.96:0/1690719165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480f7980 0x7f4c48107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.412+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 >> 172.21.15.96:0/1690719165 conn(0x7f4c480f1e40 msgr2=0x7f4c480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:55.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.413+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 shutdown_connections 2022-02-02T18:39:55.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.413+0000 7f4c4dac8700 1 -- 172.21.15.96:0/1690719165 wait complete. 2022-02-02T18:39:55.419 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:39:55.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 -- 172.21.15.96:0/1813729615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 msgr2=0x7fec080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 --2- 172.21.15.96:0/1813729615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec080f6b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7febfc004660 tx=0x7febfc009b30).stop 2022-02-02T18:39:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 -- 172.21.15.96:0/1813729615 shutdown_connections 2022-02-02T18:39:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 --2- 172.21.15.96:0/1813729615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 0x7fec080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 --2- 172.21.15.96:0/1813729615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec080f6b00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 -- 172.21.15.96:0/1813729615 >> 172.21.15.96:0/1813729615 conn(0x7fec080f1e40 msgr2=0x7fec080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:55.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 -- 172.21.15.96:0/1813729615 shutdown_connections 2022-02-02T18:39:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.511+0000 7fec0c89a700 1 -- 172.21.15.96:0/1813729615 wait complete. 2022-02-02T18:39:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 Processor -- start 2022-02-02T18:39:55.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 -- start start 2022-02-02T18:39:55.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 0x7fec08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0806a380 con 0x7fec080f66e0 2022-02-02T18:39:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0c89a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0806a4c0 con 0x7fec080f7980 2022-02-02T18:39:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55266/0 (socket says 172.21.15.96:55266) 2022-02-02T18:39:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.512+0000 7fec0659c700 1 -- 172.21.15.96:0/775549232 learned_addr learned my addr 172.21.15.96:0/775549232 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.513+0000 7fec0659c700 1 -- 172.21.15.96:0/775549232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 msgr2=0x7fec08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.513+0000 7fec05d9b700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 0x7fec08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.513+0000 7fec0659c700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 0x7fec08069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.513+0000 7fec0659c700 1 -- 172.21.15.96:0/775549232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc005040 con 0x7fec080f66e0 2022-02-02T18:39:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7fec0659c700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7febfc004f60 tx=0x7febfc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febfc018070 con 0x7fec080f66e0 2022-02-02T18:39:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febfc007ba0 con 0x7fec080f66e0 2022-02-02T18:39:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0806a740 con 0x7fec080f66e0 2022-02-02T18:39:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febfc01c620 con 0x7fec080f66e0 2022-02-02T18:39:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.514+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0806aca0 con 0x7fec080f66e0 2022-02-02T18:39:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.515+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec08045ad0 con 0x7fec080f66e0 2022-02-02T18:39:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.516+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7febfc01c8e0 con 0x7fec080f66e0 2022-02-02T18:39:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.516+0000 7febf6ffd700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 0x7febf0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.516+0000 7fec05d9b700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 0x7febf0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.516+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7febfc083990 con 0x7fec080f66e0 2022-02-02T18:39:55.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.517+0000 7fec05d9b700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 0x7febf0067290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7febf80049e0 tx=0x7febf8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.520+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7febfc051a40 con 0x7fec080f66e0 2022-02-02T18:39:55.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.693+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec080ff050 con 0x7febf0064dd0 2022-02-02T18:39:55.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.702+0000 7febf6ffd700 1 -- 172.21.15.96:0/775549232 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7febf80045e0 con 0x7febf0064dd0 2022-02-02T18:39:55.700 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:39:55.700 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (23m) 4m ago 24m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:39:55.701 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (15m) 4m ago 24m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:39:55.701 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (15m) 2m ago 23m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:39:55.701 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (23m) 4m ago 24m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:39:55.701 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (20m) 4m ago 20m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:39:55.702 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (16m) 4m ago 20m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:39:55.702 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (20m) 2m ago 20m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:39:55.702 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (16m) 2m ago 20m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:39:55.702 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (17m) 4m ago 25m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:39:55.703 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (17m) 2m ago 23m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:39:55.703 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (16m) 4m ago 25m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:39:55.703 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (16m) 2m ago 23m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:39:55.703 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (24m) 4m ago 24m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:39:55.703 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (23m) 2m ago 23m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:39:55.704 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (15m) 4m ago 23m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:39:55.704 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (14m) 4m ago 22m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:39:55.704 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (14m) 4m ago 22m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:39:55.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (13m) 2m ago 22m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:39:55.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (13m) 2m ago 21m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:39:55.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (12m) 2m ago 21m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:39:55.705 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (23m) 4m ago 23m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:39:55.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 msgr2=0x7febf0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 0x7febf0067290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7febf80049e0 tx=0x7febf8009040).stop 2022-02-02T18:39:55.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 msgr2=0x7fec0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7febfc004f60 tx=0x7febfc009b30).stop 2022-02-02T18:39:55.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 shutdown_connections 2022-02-02T18:39:55.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febf0064dd0 0x7febf0067290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec080f66e0 0x7fec0806b9a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 --2- 172.21.15.96:0/775549232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec080f7980 0x7fec08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 >> 172.21.15.96:0/775549232 conn(0x7fec080f1e40 msgr2=0x7fec080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:55.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 shutdown_connections 2022-02-02T18:39:55.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.704+0000 7fec0c89a700 1 -- 172.21.15.96:0/775549232 wait complete. 2022-02-02T18:39:55.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.801+0000 7fb2bf59e700 1 -- 172.21.15.96:0/723227218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 msgr2=0x7fb2c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.801+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/723227218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c00f7c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fb2b4004660 tx=0x7fb2b4009b30).stop 2022-02-02T18:39:55.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 -- 172.21.15.96:0/723227218 shutdown_connections 2022-02-02T18:39:55.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/723227218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c00f7c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/723227218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 -- 172.21.15.96:0/723227218 >> 172.21.15.96:0/723227218 conn(0x7fb2c00f1c90 msgr2=0x7fb2c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 -- 172.21.15.96:0/723227218 shutdown_connections 2022-02-02T18:39:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 -- 172.21.15.96:0/723227218 wait complete. 2022-02-02T18:39:55.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 Processor -- start 2022-02-02T18:39:55.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.802+0000 7fb2bf59e700 1 -- start start 2022-02-02T18:39:55.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bf59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bf59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bf59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c006a380 con 0x7fb2c00f77d0 2022-02-02T18:39:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bf59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c006a4c0 con 0x7fb2c00f6530 2022-02-02T18:39:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55278/0 (socket says 172.21.15.96:55278) 2022-02-02T18:39:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 -- 172.21.15.96:0/594122056 learned_addr learned my addr 172.21.15.96:0/594122056 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2be59c700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 -- 172.21.15.96:0/594122056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 msgr2=0x7fb2c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 -- 172.21.15.96:0/594122056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4005040 con 0x7fb2c00f77d0 2022-02-02T18:39:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2be59c700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:39:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2bdd9b700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fb2b4009990 tx=0x7fb2b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.803+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b4018070 con 0x7fb2c00f77d0 2022-02-02T18:39:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.804+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2b4007ca0 con 0x7fb2c00f77d0 2022-02-02T18:39:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.804+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c006a740 con 0x7fb2c00f77d0 2022-02-02T18:39:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.804+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b401c620 con 0x7fb2c00f77d0 2022-02-02T18:39:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.804+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c006aca0 con 0x7fb2c00f77d0 2022-02-02T18:39:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.805+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c0045ad0 con 0x7fb2c00f77d0 2022-02-02T18:39:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.805+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2b401d960 con 0x7fb2c00f77d0 2022-02-02T18:39:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.805+0000 7fb2aeffd700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 0x7fb2a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.805+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2b4083760 con 0x7fb2c00f77d0 2022-02-02T18:39:55.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.806+0000 7fb2be59c700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 0x7fb2a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:55.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.806+0000 7fb2be59c700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 0x7fb2a80672e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb2c006b730 tx=0x7fb2b0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:55.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:55.810+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2b40518d0 con 0x7fb2c00f77d0 2022-02-02T18:39:56.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.041+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2c0027a00 con 0x7fb2c00f77d0 2022-02-02T18:39:56.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.042+0000 7fb2aeffd700 1 -- 172.21.15.96:0/594122056 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb2b4054ef0 con 0x7fb2c00f77d0 2022-02-02T18:39:56.040 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:39:56.040 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:39:56.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:39:56.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:56.041 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:39:56.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:39:56.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:56.042 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:39:56.042 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:39:56.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:56.042 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:39:56.043 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:39:56.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:39:56.043 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:39:56.043 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:39:56.043 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:39:56.044 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:39:56.044 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:39:56.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.043+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 msgr2=0x7fb2a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.043+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 0x7fb2a80672e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb2c006b730 tx=0x7fb2b0009040).stop 2022-02-02T18:39:56.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.043+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 msgr2=0x7fb2c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.043+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fb2b4009990 tx=0x7fb2b4009b30).stop 2022-02-02T18:39:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 shutdown_connections 2022-02-02T18:39:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2a8064e20 0x7fb2a80672e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c00f6530 0x7fb2c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 --2- 172.21.15.96:0/594122056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2c00f77d0 0x7fb2c0069e20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 >> 172.21.15.96:0/594122056 conn(0x7fb2c00f1c90 msgr2=0x7fb2c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 shutdown_connections 2022-02-02T18:39:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.044+0000 7fb2bf59e700 1 -- 172.21.15.96:0/594122056 wait complete. 2022-02-02T18:39:56.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/1829046865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f66e0 msgr2=0x7f1ad00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/1829046865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f66e0 0x7f1ad00f6b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1ac4004660 tx=0x7f1ac4009b30).stop 2022-02-02T18:39:56.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/1829046865 shutdown_connections 2022-02-02T18:39:56.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/1829046865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f7980 0x7f1ad00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/1829046865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f66e0 0x7f1ad00f6b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/1829046865 >> 172.21.15.96:0/1829046865 conn(0x7f1ad00f1e40 msgr2=0x7f1ad00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:56.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/1829046865 shutdown_connections 2022-02-02T18:39:56.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/1829046865 wait complete. 2022-02-02T18:39:56.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 Processor -- start 2022-02-02T18:39:56.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.142+0000 7f1ad6c6f700 1 -- start start 2022-02-02T18:39:56.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1ad6c6f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f66e0 0x7f1ad0106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:56.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1ad6c6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:56.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1ad6c6f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0107a40 con 0x7f1ad00f7980 2022-02-02T18:39:56.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1ad6c6f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0107b80 con 0x7f1ad00f66e0 2022-02-02T18:39:56.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:56.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55288/0 (socket says 172.21.15.96:55288) 2022-02-02T18:39:56.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 -- 172.21.15.96:0/3159645259 learned_addr learned my addr 172.21.15.96:0/3159645259 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:39:56.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1ad4a0b700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f66e0 0x7f1ad0106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:56.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 -- 172.21.15.96:0/3159645259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f66e0 msgr2=0x7f1ad0106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f66e0 0x7f1ad0106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 -- 172.21.15.96:0/3159645259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4005040 con 0x7f1ad00f7980 2022-02-02T18:39:56.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acffff700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1abc00c530 tx=0x7f1abc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:56.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.143+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1abc00f650 con 0x7f1ad00f7980 2022-02-02T18:39:56.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.144+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0108520 con 0x7f1ad00f7980 2022-02-02T18:39:56.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.144+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1abc00fc60 con 0x7f1ad00f7980 2022-02-02T18:39:56.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.144+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1abc012cd0 con 0x7f1ad00f7980 2022-02-02T18:39:56.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.144+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0108ae0 con 0x7f1ad00f7980 2022-02-02T18:39:56.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.145+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0045ad0 con 0x7f1ad00f7980 2022-02-02T18:39:56.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.145+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1abc010070 con 0x7f1ad00f7980 2022-02-02T18:39:56.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.145+0000 7f1acd7fa700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 0x7f1ac0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:39:56.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.145+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1abc081800 con 0x7f1ad00f7980 2022-02-02T18:39:56.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.146+0000 7f1ad4a0b700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 0x7f1ac0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:39:56.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.146+0000 7f1ad4a0b700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 0x7f1ac0067290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1ac4004e30 tx=0x7f1ac4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:39:56.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.149+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1abc0532e0 con 0x7f1ad00f7980 2022-02-02T18:39:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.350+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ad0027a00 con 0x7f1ad00f7980 2022-02-02T18:39:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.351+0000 7f1acd7fa700 1 -- 172.21.15.96:0/3159645259 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1abc052ed0 con 0x7f1ad00f7980 2022-02-02T18:39:56.349 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:39:56.349 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:39:56.350 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:39:56.350 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:39:56.350 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:56.350 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:39:56.351 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:39:56.351 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:39:56.351 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:39:56.351 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:39:56.352 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:39:56.352 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:39:56.352 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:39:56.352 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:39:56.353 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:39:56.353 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:39:56.353 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:39:56.353 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:39:56.353 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:39:56.354 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:39:56.354 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:39:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:39:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:39:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:39:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:39:56.356 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:39:56.356 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:39:56.356 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:39:56.356 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:39:56.357 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:39:56.357 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:39:56.357 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:39:56.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:56.358 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:56.358 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:39:56.358 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:39:56.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:56.359 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:56.359 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:39:56.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 msgr2=0x7f1ac0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 0x7f1ac0067290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1ac4004e30 tx=0x7f1ac4009b30).stop 2022-02-02T18:39:56.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 msgr2=0x7f1ad0107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:39:56.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1abc00c530 tx=0x7f1abc007e20).stop 2022-02-02T18:39:56.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 shutdown_connections 2022-02-02T18:39:56.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac0064dd0 0x7f1ac0067290 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ad00f66e0 0x7f1ad0106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 --2- 172.21.15.96:0/3159645259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ad00f7980 0x7f1ad0107490 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:39:56.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 >> 172.21.15.96:0/3159645259 conn(0x7f1ad00f1e40 msgr2=0x7f1ad00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:39:56.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 shutdown_connections 2022-02-02T18:39:56.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:39:56.354+0000 7f1ad6c6f700 1 -- 172.21.15.96:0/3159645259 wait complete. 2022-02-02T18:39:56.364 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:39:56.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:56 smithi096 ceph-mon[101353]: pgmap v534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:56.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:56 smithi096 ceph-mon[101353]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:56.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/594122056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:56 smithi159 ceph-mon[69013]: pgmap v534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:56 smithi159 ceph-mon[69013]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/594122056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:39:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:57 smithi159 ceph-mon[69013]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3159645259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:39:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:57 smithi096 ceph-mon[101353]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:39:57.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3159645259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:39:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:39:58 smithi159 ceph-mon[69013]: pgmap v535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:39:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:39:58 smithi096 ceph-mon[101353]: pgmap v535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:00 smithi159 ceph-mon[69013]: pgmap v536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:00.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:40:00.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:00 smithi096 ceph-mon[101353]: pgmap v536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:00.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:40:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:01.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:01.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:01.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:01.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:01.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:02 smithi159 ceph-mon[69013]: pgmap v537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:02 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:02 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:02 smithi096 ceph-mon[101353]: pgmap v537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:02 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:02 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:04 smithi159 ceph-mon[69013]: pgmap v538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:04 smithi096 ceph-mon[101353]: pgmap v538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:06.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:06 smithi159 ceph-mon[69013]: pgmap v539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:06 smithi096 ceph-mon[101353]: pgmap v539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:08 smithi159 ceph-mon[69013]: pgmap v540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:08 smithi096 ceph-mon[101353]: pgmap v540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:10 smithi159 ceph-mon[69013]: pgmap v541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:10.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:10 smithi096 ceph-mon[101353]: pgmap v541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:11.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:12 smithi159 ceph-mon[69013]: pgmap v542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:12 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:12 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:12 smithi096 ceph-mon[101353]: pgmap v542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:12 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:12 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:14 smithi159 ceph-mon[69013]: pgmap v543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:14 smithi096 ceph-mon[101353]: pgmap v543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:16.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:16 smithi159 ceph-mon[69013]: pgmap v544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:16.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:16 smithi096 ceph-mon[101353]: pgmap v544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:18.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:18 smithi159 ceph-mon[69013]: pgmap v545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:18 smithi096 ceph-mon[101353]: pgmap v545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:20.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:20 smithi159 ceph-mon[69013]: pgmap v546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:20.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:20 smithi096 ceph-mon[101353]: pgmap v546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:21.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:21.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:21.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:21.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:22 smithi159 ceph-mon[69013]: pgmap v547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:22 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:22 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:22 smithi096 ceph-mon[101353]: pgmap v547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:22 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:22 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:24.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:24 smithi159 ceph-mon[69013]: pgmap v548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:24 smithi096 ceph-mon[101353]: pgmap v548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:26.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 -- 172.21.15.96:0/415841149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 msgr2=0x7f49440f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 --2- 172.21.15.96:0/415841149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f49440f59f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4938004660 tx=0x7f4938009b30).stop 2022-02-02T18:40:26.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 -- 172.21.15.96:0/415841149 shutdown_connections 2022-02-02T18:40:26.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 --2- 172.21.15.96:0/415841149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 0x7f49440f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 --2- 172.21.15.96:0/415841149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f49440f59f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 -- 172.21.15.96:0/415841149 >> 172.21.15.96:0/415841149 conn(0x7f49440f0d70 msgr2=0x7f49440f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:26.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 -- 172.21.15.96:0/415841149 shutdown_connections 2022-02-02T18:40:26.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 -- 172.21.15.96:0/415841149 wait complete. 2022-02-02T18:40:26.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.464+0000 7f4948b57700 1 Processor -- start 2022-02-02T18:40:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 -- start start 2022-02-02T18:40:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 0x7f494410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4944060390 con 0x7f49440f55d0 2022-02-02T18:40:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440604d0 con 0x7f49440f6870 2022-02-02T18:40:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55304/0 (socket says 172.21.15.96:55304) 2022-02-02T18:40:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 -- 172.21.15.96:0/2202615705 learned_addr learned my addr 172.21.15.96:0/2202615705 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4941d9b700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 0x7f494410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 -- 172.21.15.96:0/2202615705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 msgr2=0x7f494410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 0x7f494410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 -- 172.21.15.96:0/2202615705 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938005040 con 0x7f49440f55d0 2022-02-02T18:40:26.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f494259c700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f4938004f60 tx=0x7f4938009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4938018070 con 0x7f49440f55d0 2022-02-02T18:40:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4938007ba0 con 0x7f49440f55d0 2022-02-02T18:40:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.465+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494410ea80 con 0x7f49440f55d0 2022-02-02T18:40:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.466+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494410ee50 con 0x7f49440f55d0 2022-02-02T18:40:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.466+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493801c620 con 0x7f49440f55d0 2022-02-02T18:40:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.467+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4928004fa0 con 0x7f49440f55d0 2022-02-02T18:40:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.467+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f493801d420 con 0x7f49440f55d0 2022-02-02T18:40:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.467+0000 7f4932ffd700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 0x7f492c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.467+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4938083890 con 0x7f49440f55d0 2022-02-02T18:40:26.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.467+0000 7f4941d9b700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 0x7f492c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.468+0000 7f4941d9b700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 0x7f492c067290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f49340041d0 tx=0x7f4934009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:26.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.472+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4938051940 con 0x7f49440f55d0 2022-02-02T18:40:26.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.650+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4928000bc0 con 0x7f492c064dd0 2022-02-02T18:40:26.647 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:26 smithi096 ceph-mon[101353]: pgmap v549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:26.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.651+0000 7f4932ffd700 1 -- 172.21.15.96:0/2202615705 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4928000bc0 con 0x7f492c064dd0 2022-02-02T18:40:26.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 msgr2=0x7f492c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 0x7f492c067290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f49340041d0 tx=0x7f4934009040).stop 2022-02-02T18:40:26.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 msgr2=0x7f494410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f4938004f60 tx=0x7f4938009b30).stop 2022-02-02T18:40:26.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 shutdown_connections 2022-02-02T18:40:26.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f492c064dd0 0x7f492c067290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49440f55d0 0x7f494410c090 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 --2- 172.21.15.96:0/2202615705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49440f6870 0x7f494410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.654+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 >> 172.21.15.96:0/2202615705 conn(0x7f49440f0d70 msgr2=0x7f49440fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:26.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.655+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 shutdown_connections 2022-02-02T18:40:26.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.655+0000 7f4948b57700 1 -- 172.21.15.96:0/2202615705 wait complete. 2022-02-02T18:40:26.663 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:40:26.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 -- 172.21.15.96:0/1614055044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 msgr2=0x7fa5ac0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 --2- 172.21.15.96:0/1614055044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac0f5a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa59c004660 tx=0x7fa59c009b30).stop 2022-02-02T18:40:26.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 -- 172.21.15.96:0/1614055044 shutdown_connections 2022-02-02T18:40:26.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 --2- 172.21.15.96:0/1614055044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 --2- 172.21.15.96:0/1614055044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac0f5a00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 -- 172.21.15.96:0/1614055044 >> 172.21.15.96:0/1614055044 conn(0x7fa5ac0f0de0 msgr2=0x7fa5ac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:26.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 -- 172.21.15.96:0/1614055044 shutdown_connections 2022-02-02T18:40:26.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.756+0000 7fa5b2808700 1 -- 172.21.15.96:0/1614055044 wait complete. 2022-02-02T18:40:26.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 Processor -- start 2022-02-02T18:40:26.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 -- start start 2022-02-02T18:40:26.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0603d0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5b2808700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac060510 con 0x7fa5ac0f5ef0 2022-02-02T18:40:26.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55314/0 (socket says 172.21.15.96:55314) 2022-02-02T18:40:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.757+0000 7fa5abfff700 1 -- 172.21.15.96:0/586051031 learned_addr learned my addr 172.21.15.96:0/586051031 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5abfff700 1 -- 172.21.15.96:0/586051031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 msgr2=0x7fa5ac10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5ab7fe700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5abfff700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac10e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5abfff700 1 -- 172.21.15.96:0/586051031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c005040 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5ab7fe700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:40:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5abfff700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa59c009990 tx=0x7fa59c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59c018070 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa59c007ba0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac10ea00 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59c01c3c0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.758+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac10edd0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.759+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac045ad0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.760+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa59c01d420 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.760+0000 7fa5a8ff9700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 0x7fa594067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.760+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa59c0838d0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.760+0000 7fa5ab7fe700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 0x7fa594067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.760+0000 7fa5ab7fe700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 0x7fa594067290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa5a0009880 tx=0x7fa5a000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.764+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa59c0519a0 con 0x7fa5ac0f55e0 2022-02-02T18:40:26.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:26 smithi159 ceph-mon[69013]: pgmap v549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:26.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.938+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5ac057f10 con 0x7fa594064dd0 2022-02-02T18:40:26.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.947+0000 7fa5a8ff9700 1 -- 172.21.15.96:0/586051031 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa5ac057f10 con 0x7fa594064dd0 2022-02-02T18:40:26.944 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:40:26.944 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (23m) 4m ago 24m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:40:26.945 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (16m) 4m ago 24m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:40:26.945 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (16m) 2m ago 24m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:40:26.945 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (23m) 4m ago 24m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:40:26.945 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (20m) 4m ago 20m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:40:26.946 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (16m) 4m ago 20m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:40:26.946 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (20m) 2m ago 20m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:40:26.946 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (16m) 2m ago 21m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:40:26.946 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (18m) 4m ago 26m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:40:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (17m) 2m ago 24m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:40:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (17m) 4m ago 26m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:40:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (16m) 2m ago 24m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:40:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (24m) 4m ago 24m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:40:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (24m) 2m ago 24m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:40:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (15m) 4m ago 23m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:40:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (15m) 4m ago 23m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:40:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (14m) 4m ago 23m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:40:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (14m) 2m ago 22m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:40:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (13m) 2m ago 22m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:40:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (13m) 2m ago 22m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:40:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (23m) 4m ago 24m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:40:26.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 msgr2=0x7fa594067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 0x7fa594067290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa5a0009880 tx=0x7fa5a000b040).stop 2022-02-02T18:40:26.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 msgr2=0x7fa5ac10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:26.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa59c009990 tx=0x7fa59c009b30).stop 2022-02-02T18:40:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 shutdown_connections 2022-02-02T18:40:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa594064dd0 0x7fa594067290 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5ac0f55e0 0x7fa5ac10c010 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 --2- 172.21.15.96:0/586051031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac0f5ef0 0x7fa5ac10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 >> 172.21.15.96:0/586051031 conn(0x7fa5ac0f0de0 msgr2=0x7fa5ac0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:26.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 shutdown_connections 2022-02-02T18:40:26.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:26.949+0000 7fa5b2808700 1 -- 172.21.15.96:0/586051031 wait complete. 2022-02-02T18:40:27.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/3671248493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 msgr2=0x7fa4a80f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/3671248493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a80f9120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fa498004660 tx=0x7fa498009b30).stop 2022-02-02T18:40:27.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/3671248493 shutdown_connections 2022-02-02T18:40:27.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/3671248493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 0x7fa4a80fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/3671248493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a80f9120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.046+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/3671248493 >> 172.21.15.96:0/3671248493 conn(0x7fa4a80f0ba0 msgr2=0x7fa4a80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:27.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.047+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/3671248493 shutdown_connections 2022-02-02T18:40:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.047+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/3671248493 wait complete. 2022-02-02T18:40:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.047+0000 7fa4ac9d7700 1 Processor -- start 2022-02-02T18:40:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.047+0000 7fa4ac9d7700 1 -- start start 2022-02-02T18:40:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4ac9d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4ac9d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 0x7fa4a8109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4ac9d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81099f0 con 0x7fa4a8060310 2022-02-02T18:40:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4ac9d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8109b30 con 0x7fa4a80f96a0 2022-02-02T18:40:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55324/0 (socket says 172.21.15.96:55324) 2022-02-02T18:40:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 -- 172.21.15.96:0/1932916847 learned_addr learned my addr 172.21.15.96:0/1932916847 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a6ffd700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 0x7fa4a8109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 -- 172.21.15.96:0/1932916847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 msgr2=0x7fa4a8109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 0x7fa4a8109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 -- 172.21.15.96:0/1932916847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498005040 con 0x7fa4a8060310 2022-02-02T18:40:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4a77fe700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fa498009990 tx=0x7fa498009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa498018070 con 0x7fa4a8060310 2022-02-02T18:40:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.048+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a810a470 con 0x7fa4a8060310 2022-02-02T18:40:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.049+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa498007ca0 con 0x7fa4a8060310 2022-02-02T18:40:27.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.049+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49801c620 con 0x7fa4a8060310 2022-02-02T18:40:27.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.049+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a810a9d0 con 0x7fa4a8060310 2022-02-02T18:40:27.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.050+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8045ad0 con 0x7fa4a8060310 2022-02-02T18:40:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.050+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa49801d960 con 0x7fa4a8060310 2022-02-02T18:40:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.050+0000 7fa48ffff700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 0x7fa4900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.051+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa498083820 con 0x7fa4a8060310 2022-02-02T18:40:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.051+0000 7fa4a6ffd700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 0x7fa4900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.051+0000 7fa4a6ffd700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 0x7fa4900672e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fa49c007fd0 tx=0x7fa49c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.055+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa498055470 con 0x7fa4a8060310 2022-02-02T18:40:27.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.287+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4a810f570 con 0x7fa4a8060310 2022-02-02T18:40:27.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.288+0000 7fa48ffff700 1 -- 172.21.15.96:0/1932916847 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa498055060 con 0x7fa4a8060310 2022-02-02T18:40:27.286 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:40:27.286 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:40:27.286 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:40:27.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:27.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:40:27.287 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:40:27.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:27.287 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:40:27.288 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:40:27.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:27.288 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:40:27.288 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:40:27.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:27.289 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:40:27.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:40:27.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:40:27.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:40:27.290 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:40:27.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 msgr2=0x7fa4900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 0x7fa4900672e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fa49c007fd0 tx=0x7fa49c009040).stop 2022-02-02T18:40:27.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 msgr2=0x7fa4a8108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fa498009990 tx=0x7fa498009b30).stop 2022-02-02T18:40:27.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 shutdown_connections 2022-02-02T18:40:27.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064e20 0x7fa4900672e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a8060310 0x7fa4a8108f50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 --2- 172.21.15.96:0/1932916847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f96a0 0x7fa4a8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 >> 172.21.15.96:0/1932916847 conn(0x7fa4a80f0ba0 msgr2=0x7fa4a80f9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:27.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 shutdown_connections 2022-02-02T18:40:27.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.290+0000 7fa4ac9d7700 1 -- 172.21.15.96:0/1932916847 wait complete. 2022-02-02T18:40:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 -- 172.21.15.96:0/3834514763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f5970 msgr2=0x7f65a40f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3834514763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f5970 0x7f65a40f5df0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f65a0004660 tx=0x7f65a0009b30).stop 2022-02-02T18:40:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 -- 172.21.15.96:0/3834514763 shutdown_connections 2022-02-02T18:40:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3834514763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f5970 0x7f65a40f5df0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3834514763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f6c60 0x7f65a40f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 -- 172.21.15.96:0/3834514763 >> 172.21.15.96:0/3834514763 conn(0x7f65a40f04c0 msgr2=0x7f65a40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 -- 172.21.15.96:0/3834514763 shutdown_connections 2022-02-02T18:40:27.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.388+0000 7f65ac42f700 1 -- 172.21.15.96:0/3834514763 wait complete. 2022-02-02T18:40:27.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 Processor -- start 2022-02-02T18:40:27.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 -- start start 2022-02-02T18:40:27.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 0x7f65a4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40f5660 con 0x7f65a40f6c60 2022-02-02T18:40:27.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65ac42f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40f57a0 con 0x7f65a40f5970 2022-02-02T18:40:27.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55334/0 (socket says 172.21.15.96:55334) 2022-02-02T18:40:27.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 -- 172.21.15.96:0/3224204216 learned_addr learned my addr 172.21.15.96:0/3224204216 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:27.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65aa1cb700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 0x7f65a4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 -- 172.21.15.96:0/3224204216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 msgr2=0x7f65a4109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 0x7f65a4109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65a99ca700 1 -- 172.21.15.96:0/3224204216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0005040 con 0x7f65a40f6c60 2022-02-02T18:40:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.389+0000 7f65aa1cb700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 0x7f65a4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:40:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f65a99ca700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f65a0009990 tx=0x7f65a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a0018070 con 0x7f65a40f6c60 2022-02-02T18:40:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65a0007ba0 con 0x7f65a40f6c60 2022-02-02T18:40:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a410c740 con 0x7f65a40f6c60 2022-02-02T18:40:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a001c3c0 con 0x7f65a40f6c60 2022-02-02T18:40:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.390+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a410cc70 con 0x7f65a40f6c60 2022-02-02T18:40:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.391+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a4045ad0 con 0x7f65a40f6c60 2022-02-02T18:40:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.391+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f65a001d420 con 0x7f65a40f6c60 2022-02-02T18:40:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.392+0000 7f659affd700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 0x7f6590067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.392+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f65a0083840 con 0x7f65a40f6c60 2022-02-02T18:40:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.392+0000 7f65aa1cb700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 0x7f6590067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.392+0000 7f65aa1cb700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 0x7f6590067290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f65a40f52e0 tx=0x7f659400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:27.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.396+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65a0051830 con 0x7f65a40f6c60 2022-02-02T18:40:27.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:40:27.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:40:27.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1932916847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:27.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.597+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f65a4027a00 con 0x7f65a40f6c60 2022-02-02T18:40:27.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.597+0000 7f659affd700 1 -- 172.21.15.96:0/3224204216 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f65a0054e50 con 0x7f65a40f6c60 2022-02-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:40:27.596 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:40:27.596 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:27.596 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:40:27.596 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:40:27.597 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:40:27.597 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:40:27.597 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:40:27.598 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:40:27.598 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:40:27.598 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:40:27.598 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:40:27.599 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:40:27.599 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:40:27.599 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:40:27.599 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:40:27.600 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:40:27.600 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:40:27.600 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:40:27.600 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:40:27.600 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:40:27.601 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:40:27.601 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:40:27.601 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:40:27.601 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:40:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:40:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:40:27.603 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:40:27.603 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:40:27.603 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:40:27.603 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:27.603 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:27.604 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:40:27.604 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:27.604 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:27.604 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:27.605 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 msgr2=0x7f6590067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 0x7f6590067290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f65a40f52e0 tx=0x7f659400b040).stop 2022-02-02T18:40:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 msgr2=0x7f65a410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f65a0009990 tx=0x7f65a0009b30).stop 2022-02-02T18:40:27.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 shutdown_connections 2022-02-02T18:40:27.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6590064dd0 0x7f6590067290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65a40f5970 0x7f65a4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 --2- 172.21.15.96:0/3224204216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65a40f6c60 0x7f65a410c190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:27.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.599+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 >> 172.21.15.96:0/3224204216 conn(0x7f65a40f04c0 msgr2=0x7f65a40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:27.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.600+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 shutdown_connections 2022-02-02T18:40:27.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:27.600+0000 7f65ac42f700 1 -- 172.21.15.96:0/3224204216 wait complete. 2022-02-02T18:40:27.610 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:40:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:40:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:40:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1932916847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:28 smithi159 ceph-mon[69013]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:28 smithi159 ceph-mon[69013]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:28 smithi159 ceph-mon[69013]: pgmap v550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:28.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3224204216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:40:28.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:28 smithi096 ceph-mon[101353]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:28.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:28 smithi096 ceph-mon[101353]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:28.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:28 smithi096 ceph-mon[101353]: pgmap v550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:28.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3224204216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:40:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:30 smithi159 ceph-mon[69013]: pgmap v551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:30 smithi096 ceph-mon[101353]: pgmap v551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:31.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:31.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:31.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:31.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:31.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:31.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:31.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:31.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:31.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:32.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:32 smithi159 ceph-mon[69013]: pgmap v552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:32 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:32 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:32 smithi096 ceph-mon[101353]: pgmap v552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:32 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:32 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:34.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:34 smithi159 ceph-mon[69013]: pgmap v553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:34 smithi096 ceph-mon[101353]: pgmap v553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:36.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:36 smithi159 ceph-mon[69013]: pgmap v554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:36 smithi096 ceph-mon[101353]: pgmap v554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:38 smithi159 ceph-mon[69013]: pgmap v555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:38 smithi096 ceph-mon[101353]: pgmap v555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:40 smithi159 ceph-mon[69013]: pgmap v556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:40 smithi096 ceph-mon[101353]: pgmap v556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:41.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:41.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:41.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:41.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:41.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:41.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: pgmap v557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: pgmap v557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:42.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:42.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:43.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:43 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:43 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:44 smithi159 ceph-mon[69013]: pgmap v558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:44 smithi096 ceph-mon[101353]: pgmap v558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:46 smithi159 ceph-mon[69013]: pgmap v559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:46 smithi096 ceph-mon[101353]: pgmap v559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:48 smithi159 ceph-mon[69013]: pgmap v560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:48 smithi096 ceph-mon[101353]: pgmap v560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:50.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:50 smithi159 ceph-mon[69013]: pgmap v561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:50.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:50 smithi096 ceph-mon[101353]: pgmap v561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: pgmap v562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: pgmap v562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:40:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:40:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:40:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:40:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:53.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:53 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:53.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:53 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:53.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:53 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:40:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:53 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:40:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:54 smithi159 ceph-mon[69013]: pgmap v563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:54 smithi096 ceph-mon[101353]: pgmap v563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:56.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:56 smithi159 ceph-mon[69013]: pgmap v564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:56 smithi096 ceph-mon[101353]: pgmap v564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:57.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 -- 172.21.15.96:0/3353696996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 msgr2=0x7f13f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:57.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 --2- 172.21.15.96:0/3353696996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f40f6cc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f13e8004660 tx=0x7f13e8009b30).stop 2022-02-02T18:40:57.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 -- 172.21.15.96:0/3353696996 shutdown_connections 2022-02-02T18:40:57.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 --2- 172.21.15.96:0/3353696996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f40f6cc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:57.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 --2- 172.21.15.96:0/3353696996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:40:57.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 -- 172.21.15.96:0/3353696996 >> 172.21.15.96:0/3353696996 conn(0x7f13f40f0d40 msgr2=0x7f13f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:57.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 -- 172.21.15.96:0/3353696996 shutdown_connections 2022-02-02T18:40:57.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.712+0000 7f13fa013700 1 -- 172.21.15.96:0/3353696996 wait complete. 2022-02-02T18:40:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 Processor -- start 2022-02-02T18:40:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 -- start start 2022-02-02T18:40:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4060450 con 0x7f13f40f6860 2022-02-02T18:40:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13fa013700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4060590 con 0x7f13f40f55c0 2022-02-02T18:40:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55356/0 (socket says 172.21.15.96:55356) 2022-02-02T18:40:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13f2ffd700 1 -- 172.21.15.96:0/3545585364 learned_addr learned my addr 172.21.15.96:0/3545585364 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.713+0000 7f13f37fe700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13f2ffd700 1 -- 172.21.15.96:0/3545585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 msgr2=0x7f13f4109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:57.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13f2ffd700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f4109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13f2ffd700 1 -- 172.21.15.96:0/3545585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8005040 con 0x7f13f40f6860 2022-02-02T18:40:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13f37fe700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f4109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:40:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13f2ffd700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f13e8009990 tx=0x7f13e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e8018070 con 0x7f13f40f6860 2022-02-02T18:40:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f410c730 con 0x7f13f40f6860 2022-02-02T18:40:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13e8007ca0 con 0x7f13f40f6860 2022-02-02T18:40:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e801c620 con 0x7f13f40f6860 2022-02-02T18:40:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.714+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f410cc90 con 0x7f13f40f6860 2022-02-02T18:40:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.715+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f4045ad0 con 0x7f13f40f6860 2022-02-02T18:40:57.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.716+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f13e801d960 con 0x7f13f40f6860 2022-02-02T18:40:57.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.716+0000 7f13dbfff700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 0x7f13dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:57.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.716+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f13e8083ba0 con 0x7f13f40f6860 2022-02-02T18:40:57.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.717+0000 7f13f37fe700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 0x7f13dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:57.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.717+0000 7f13f37fe700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 0x7f13dc067290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f13f4060040 tx=0x7f13e4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:57.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.720+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13e8051d10 con 0x7f13f40f6860 2022-02-02T18:40:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.898+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13f4057f10 con 0x7f13dc064dd0 2022-02-02T18:40:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.899+0000 7f13dbfff700 1 -- 172.21.15.96:0/3545585364 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f13f4057f10 con 0x7f13dc064dd0 2022-02-02T18:40:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 msgr2=0x7f13dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 0x7f13dc067290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f13f4060040 tx=0x7f13e4008040).stop 2022-02-02T18:40:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 msgr2=0x7f13f410c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:57.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f13e8009990 tx=0x7f13e8009b30).stop 2022-02-02T18:40:57.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 shutdown_connections 2022-02-02T18:40:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13dc064dd0 0x7f13dc067290 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40f55c0 0x7f13f4109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 --2- 172.21.15.96:0/3545585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13f40f6860 0x7f13f410c180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 >> 172.21.15.96:0/3545585364 conn(0x7f13f40f0d40 msgr2=0x7f13f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.901+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 shutdown_connections 2022-02-02T18:40:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.902+0000 7f13fa013700 1 -- 172.21.15.96:0/3545585364 wait complete. 2022-02-02T18:40:57.909 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:40:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 -- 172.21.15.96:0/2887163524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 msgr2=0x7efca40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 --2- 172.21.15.96:0/2887163524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca40f6cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7efca0004660 tx=0x7efca0009b30).stop 2022-02-02T18:40:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 -- 172.21.15.96:0/2887163524 shutdown_connections 2022-02-02T18:40:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 --2- 172.21.15.96:0/2887163524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca40f6cc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 --2- 172.21.15.96:0/2887163524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 -- 172.21.15.96:0/2887163524 >> 172.21.15.96:0/2887163524 conn(0x7efca40f0d40 msgr2=0x7efca40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 -- 172.21.15.96:0/2887163524 shutdown_connections 2022-02-02T18:40:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:57.999+0000 7efcac2e1700 1 -- 172.21.15.96:0/2887163524 wait complete. 2022-02-02T18:40:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 Processor -- start 2022-02-02T18:40:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 -- start start 2022-02-02T18:40:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca4105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca41069b0 con 0x7efca40f6860 2022-02-02T18:40:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcac2e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca41071c0 con 0x7efca40f55c0 2022-02-02T18:40:58.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55364/0 (socket says 172.21.15.96:55364) 2022-02-02T18:40:58.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 -- 172.21.15.96:0/1009551407 learned_addr learned my addr 172.21.15.96:0/1009551407 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:58.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcaa07d700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca4105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 -- 172.21.15.96:0/1009551407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 msgr2=0x7efca4105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca4105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 -- 172.21.15.96:0/1009551407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0005040 con 0x7efca40f6860 2022-02-02T18:40:58.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efcaa07d700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:40:58.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.000+0000 7efca987c700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7efca0009990 tx=0x7efca0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.001+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca0018070 con 0x7efca40f6860 2022-02-02T18:40:58.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.001+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efca0007ca0 con 0x7efca40f6860 2022-02-02T18:40:58.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.001+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca41073e0 con 0x7efca40f6860 2022-02-02T18:40:58.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.001+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca001c620 con 0x7efca40f6860 2022-02-02T18:40:58.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.001+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4107940 con 0x7efca40f6860 2022-02-02T18:40:58.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.002+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efca001d960 con 0x7efca40f6860 2022-02-02T18:40:58.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.002+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca40f49b0 con 0x7efca40f6860 2022-02-02T18:40:58.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.002+0000 7efc9affd700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.002+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efca0083810 con 0x7efca40f6860 2022-02-02T18:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.002+0000 7efcaa07d700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.003+0000 7efcaa07d700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7efc94007fd0 tx=0x7efc94009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.007+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efca0051980 con 0x7efca40f6860 2022-02-02T18:40:58.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.179+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efca40008d0 con 0x7efc90064dd0 2022-02-02T18:40:58.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.188+0000 7efc9affd700 1 -- 172.21.15.96:0/1009551407 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efca40008d0 con 0x7efc90064dd0 2022-02-02T18:40:58.185 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:40:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (24m) 5m ago 25m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:40:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (16m) 5m ago 25m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:40:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (16m) 3m ago 24m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:40:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (24m) 5m ago 25m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:40:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (21m) 5m ago 21m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:40:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (17m) 5m ago 21m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:40:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (21m) 3m ago 21m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:40:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (17m) 3m ago 21m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:40:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (18m) 5m ago 26m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:40:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (18m) 3m ago 24m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:40:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (17m) 5m ago 26m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:40:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (17m) 3m ago 24m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:40:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (25m) 5m ago 25m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:40:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (24m) 3m ago 24m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:40:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (16m) 5m ago 24m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:40:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (15m) 5m ago 23m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:40:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (15m) 5m ago 23m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:40:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (14m) 3m ago 23m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:40:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (14m) 3m ago 23m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:40:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (13m) 3m ago 22m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:40:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (24m) 5m ago 25m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:40:58.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 msgr2=0x7efc90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7efc94007fd0 tx=0x7efc94009040).stop 2022-02-02T18:40:58.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 msgr2=0x7efca41063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7efca0009990 tx=0x7efca0009b30).stop 2022-02-02T18:40:58.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 shutdown_connections 2022-02-02T18:40:58.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca40f55c0 0x7efca4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 --2- 172.21.15.96:0/1009551407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca40f6860 0x7efca41063b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 >> 172.21.15.96:0/1009551407 conn(0x7efca40f0d40 msgr2=0x7efca40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 shutdown_connections 2022-02-02T18:40:58.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.190+0000 7efcac2e1700 1 -- 172.21.15.96:0/1009551407 wait complete. 2022-02-02T18:40:58.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 -- 172.21.15.96:0/3831029450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 msgr2=0x7fda140f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 --2- 172.21.15.96:0/3831029450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f6b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fda00004660 tx=0x7fda00009b30).stop 2022-02-02T18:40:58.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 -- 172.21.15.96:0/3831029450 shutdown_connections 2022-02-02T18:40:58.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 --2- 172.21.15.96:0/3831029450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f6b30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 --2- 172.21.15.96:0/3831029450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 0x7fda140f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.287+0000 7fda19ade700 1 -- 172.21.15.96:0/3831029450 >> 172.21.15.96:0/3831029450 conn(0x7fda140f0b90 msgr2=0x7fda140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.288+0000 7fda19ade700 1 -- 172.21.15.96:0/3831029450 shutdown_connections 2022-02-02T18:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.288+0000 7fda19ade700 1 -- 172.21.15.96:0/3831029450 wait complete. 2022-02-02T18:40:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.288+0000 7fda19ade700 1 Processor -- start 2022-02-02T18:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda19ade700 1 -- start start 2022-02-02T18:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda19ade700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 0x7fda140f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda19ade700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda19ade700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140f7f70 con 0x7fda140f66d0 2022-02-02T18:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda19ade700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140f80b0 con 0x7fda140f5430 2022-02-02T18:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55372/0 (socket says 172.21.15.96:55372) 2022-02-02T18:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda18adc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 0x7fda140f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 -- 172.21.15.96:0/1227997952 learned_addr learned my addr 172.21.15.96:0/1227997952 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 -- 172.21.15.96:0/1227997952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 msgr2=0x7fda140f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 0x7fda140f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.289+0000 7fda13fff700 1 -- 172.21.15.96:0/1227997952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00005040 con 0x7fda140f66d0 2022-02-02T18:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda13fff700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fda00009da0 tx=0x7fda00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda00018070 con 0x7fda140f66d0 2022-02-02T18:40:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda140f8330 con 0x7fda140f66d0 2022-02-02T18:40:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda00007cf0 con 0x7fda140f66d0 2022-02-02T18:40:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0001c620 con 0x7fda140f66d0 2022-02-02T18:40:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.290+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda140f8890 con 0x7fda140f66d0 2022-02-02T18:40:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.291+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda14045ad0 con 0x7fda140f66d0 2022-02-02T18:40:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.291+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda0001d420 con 0x7fda140f66d0 2022-02-02T18:40:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.292+0000 7fda117fa700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 0x7fda040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.292+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fda00083a00 con 0x7fda140f66d0 2022-02-02T18:40:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.292+0000 7fda18adc700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 0x7fda040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.292+0000 7fda18adc700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 0x7fda040672e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fda140f9320 tx=0x7fda08009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.296+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda00051ab0 con 0x7fda140f66d0 2022-02-02T18:40:58.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.528+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda140fdbf0 con 0x7fda140f66d0 2022-02-02T18:40:58.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.529+0000 7fda117fa700 1 -- 172.21.15.96:0/1227997952 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fda000550d0 con 0x7fda140f66d0 2022-02-02T18:40:58.526 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:40:58.526 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:40:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:40:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:40:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:40:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:40:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:40:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:40:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:40:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:40:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:40:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:40:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:40:58.530 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:40:58.530 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:40:58.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 msgr2=0x7fda040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 0x7fda040672e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fda140f9320 tx=0x7fda08009040).stop 2022-02-02T18:40:58.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 msgr2=0x7fda140f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fda00009da0 tx=0x7fda00009b30).stop 2022-02-02T18:40:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 shutdown_connections 2022-02-02T18:40:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda04064e20 0x7fda040672e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda140f5430 0x7fda140f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 --2- 172.21.15.96:0/1227997952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda140f66d0 0x7fda140f7a10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 >> 172.21.15.96:0/1227997952 conn(0x7fda140f0b90 msgr2=0x7fda1405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 shutdown_connections 2022-02-02T18:40:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.531+0000 7fda19ade700 1 -- 172.21.15.96:0/1227997952 wait complete. 2022-02-02T18:40:58.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:58 smithi096 ceph-mon[101353]: pgmap v565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 -- 172.21.15.96:0/847587110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66e0 msgr2=0x7f6ee80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 --2- 172.21.15.96:0/847587110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66e0 0x7f6ee80f6b40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6ed4004660 tx=0x7f6ed4009b30).stop 2022-02-02T18:40:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 -- 172.21.15.96:0/847587110 shutdown_connections 2022-02-02T18:40:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 --2- 172.21.15.96:0/847587110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66e0 0x7f6ee80f6b40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 --2- 172.21.15.96:0/847587110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f5440 0x7f6ee80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.628+0000 7f6eedc74700 1 -- 172.21.15.96:0/847587110 >> 172.21.15.96:0/847587110 conn(0x7f6ee80f0ba0 msgr2=0x7f6ee80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.629+0000 7f6eedc74700 1 -- 172.21.15.96:0/847587110 shutdown_connections 2022-02-02T18:40:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.629+0000 7f6eedc74700 1 -- 172.21.15.96:0/847587110 wait complete. 2022-02-02T18:40:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.629+0000 7f6eedc74700 1 Processor -- start 2022-02-02T18:40:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.629+0000 7f6eedc74700 1 -- start start 2022-02-02T18:40:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66e0 0x7f6ee810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80603c0 con 0x7f6ee80f5440 2022-02-02T18:40:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8060500 con 0x7f6ee80f66e0 2022-02-02T18:40:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55380/0 (socket says 172.21.15.96:55380) 2022-02-02T18:40:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 -- 172.21.15.96:0/1110330405 learned_addr learned my addr 172.21.15.96:0/1110330405 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:40:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6ee7fff700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66e0 0x7f6ee810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 -- 172.21.15.96:0/1110330405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66e0 msgr2=0x7f6ee810bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66e0 0x7f6ee810bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 -- 172.21.15.96:0/1110330405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4005040 con 0x7f6ee80f5440 2022-02-02T18:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eecc72700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6edc002700 tx=0x7f6edc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc0079c0 con 0x7f6ee80f5440 2022-02-02T18:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee810c500 con 0x7f6ee80f5440 2022-02-02T18:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6edc00f040 con 0x7f6ee80f5440 2022-02-02T18:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc014860 con 0x7f6ee80f5440 2022-02-02T18:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.630+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee810ca90 con 0x7f6ee80f5440 2022-02-02T18:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.631+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8059100 con 0x7f6ee80f5440 2022-02-02T18:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.632+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6edc01b060 con 0x7f6ee80f5440 2022-02-02T18:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.632+0000 7f6ee57fa700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 0x7f6ed80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.632+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6edc081940 con 0x7f6ee80f5440 2022-02-02T18:40:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.632+0000 7f6ee7fff700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 0x7f6ed80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:40:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.633+0000 7f6ee7fff700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 0x7f6ed80672e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6ed4004630 tx=0x7f6ed4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:40:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.636+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6edc04f9f0 con 0x7f6ee80f5440 2022-02-02T18:40:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:58 smithi159 ceph-mon[69013]: pgmap v565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:40:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.843+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ee80586e0 con 0x7f6ee80f5440 2022-02-02T18:40:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.843+0000 7f6ee57fa700 1 -- 172.21.15.96:0/1110330405 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6edc019070 con 0x7f6ee80f5440 2022-02-02T18:40:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:40:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:40:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:40:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:40:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:40:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:40:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:40:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:40:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:40:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:40:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:40:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:40:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:40:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:40:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:40:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:40:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:40:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:40:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:40:58.846 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:40:58.846 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:40:58.846 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:40:58.846 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:40:58.847 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:40:58.847 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:40:58.847 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:40:58.847 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:40:58.847 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:40:58.848 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:40:58.848 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:40:58.848 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:40:58.848 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:58.849 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:58.849 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:40:58.849 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:40:58.849 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:58.850 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:58.850 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:40:58.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 msgr2=0x7f6ed80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 0x7f6ed80672e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6ed4004630 tx=0x7f6ed4009b30).stop 2022-02-02T18:40:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 msgr2=0x7f6ee8109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:40:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6edc002700 tx=0x7f6edc009d80).stop 2022-02-02T18:40:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 shutdown_connections 2022-02-02T18:40:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed8064e20 0x7f6ed80672e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5440 0x7f6ee8109a50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 --2- 172.21.15.96:0/1110330405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66e0 0x7f6ee810bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:40:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 >> 172.21.15.96:0/1110330405 conn(0x7f6ee80f0ba0 msgr2=0x7f6ee80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:40:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 shutdown_connections 2022-02-02T18:40:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:40:58.845+0000 7f6eedc74700 1 -- 172.21.15.96:0/1110330405 wait complete. 2022-02-02T18:40:58.854 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:40:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:59 smithi159 ceph-mon[69013]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:59.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:59 smithi159 ceph-mon[69013]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:59.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1227997952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:59.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:40:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1110330405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:40:59.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:59 smithi096 ceph-mon[101353]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:59.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:59 smithi096 ceph-mon[101353]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:40:59.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1227997952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:40:59.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:40:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1110330405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:41:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:00 smithi159 ceph-mon[69013]: pgmap v566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:00.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:00 smithi096 ceph-mon[101353]: pgmap v566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: pgmap v567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:02.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:02.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:02.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:02.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: pgmap v567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:03.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:03 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:03 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:03.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:03 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:03.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:03 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:04 smithi159 ceph-mon[69013]: pgmap v568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:04 smithi096 ceph-mon[101353]: pgmap v568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:06.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:06 smithi159 ceph-mon[69013]: pgmap v569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:06 smithi096 ceph-mon[101353]: pgmap v569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:08 smithi159 ceph-mon[69013]: pgmap v570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:08 smithi096 ceph-mon[101353]: pgmap v570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:10.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:10 smithi159 ceph-mon[69013]: pgmap v571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:10.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:10 smithi096 ceph-mon[101353]: pgmap v571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: pgmap v572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: pgmap v572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:13 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:13.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:13 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:13.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:13 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:13.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:13 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:14 smithi159 ceph-mon[69013]: pgmap v573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:14 smithi096 ceph-mon[101353]: pgmap v573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:16.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:16 smithi159 ceph-mon[69013]: pgmap v574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:16.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:16 smithi096 ceph-mon[101353]: pgmap v574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:18.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:18 smithi159 ceph-mon[69013]: pgmap v575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:18 smithi096 ceph-mon[101353]: pgmap v575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:20.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:20 smithi159 ceph-mon[69013]: pgmap v576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:20.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:20 smithi096 ceph-mon[101353]: pgmap v576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: pgmap v577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: pgmap v577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:23 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:23 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:23.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:23 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:23.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:23 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:24 smithi096 ceph-mon[101353]: pgmap v578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:24 smithi159 ceph-mon[69013]: pgmap v578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:26.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:26 smithi096 ceph-mon[101353]: pgmap v579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:26 smithi159 ceph-mon[69013]: pgmap v579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:41:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:41:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:41:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:41:28.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:28 smithi096 ceph-mon[101353]: pgmap v580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 -- 172.21.15.96:0/2006629756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 msgr2=0x7f928c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 --2- 172.21.15.96:0/2006629756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c0f6950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f9280004660 tx=0x7f9280009b30).stop 2022-02-02T18:41:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 -- 172.21.15.96:0/2006629756 shutdown_connections 2022-02-02T18:41:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 --2- 172.21.15.96:0/2006629756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 --2- 172.21.15.96:0/2006629756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c0f6950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 -- 172.21.15.96:0/2006629756 >> 172.21.15.96:0/2006629756 conn(0x7f928c0f1c90 msgr2=0x7f928c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 -- 172.21.15.96:0/2006629756 shutdown_connections 2022-02-02T18:41:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 -- 172.21.15.96:0/2006629756 wait complete. 2022-02-02T18:41:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.955+0000 7f9290d9b700 1 Processor -- start 2022-02-02T18:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f9290d9b700 1 -- start start 2022-02-02T18:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f9290d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 0x7f928c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f9290d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f9290d9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1078f0 con 0x7f928c0f77d0 2022-02-02T18:41:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f9290d9b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c108100 con 0x7f928c0f6530 2022-02-02T18:41:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 0x7f928c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55402/0 (socket says 172.21.15.96:55402) 2022-02-02T18:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 -- 172.21.15.96:0/3763395708 learned_addr learned my addr 172.21.15.96:0/3763395708 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 0x7f928c106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:59504/0 (socket says 172.21.15.96:59504) 2022-02-02T18:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 -- 172.21.15.96:0/3763395708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 msgr2=0x7f928c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 0x7f928c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.956+0000 7f928affd700 1 -- 172.21.15.96:0/3763395708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280005040 con 0x7f928c0f77d0 2022-02-02T18:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f928affd700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f927c00c530 tx=0x7f927c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c00f650 con 0x7f928c0f77d0 2022-02-02T18:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c108380 con 0x7f928c0f77d0 2022-02-02T18:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f927c00fc60 con 0x7f928c0f77d0 2022-02-02T18:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c012c20 con 0x7f928c0f77d0 2022-02-02T18:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.957+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c108940 con 0x7f928c0f77d0 2022-02-02T18:41:28.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.958+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c059100 con 0x7f928c0f77d0 2022-02-02T18:41:28.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.959+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f927c010070 con 0x7f928c0f77d0 2022-02-02T18:41:28.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.959+0000 7f9273fff700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.959+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f927c081730 con 0x7f928c0f77d0 2022-02-02T18:41:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.959+0000 7f928b7fe700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.960+0000 7f928b7fe700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f9280013690 tx=0x7f9280009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:28.964+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f927c04f7e0 con 0x7f928c0f77d0 2022-02-02T18:41:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:28 smithi159 ceph-mon[69013]: pgmap v580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:29.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.141+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f928c0fee00 con 0x7f9274064e20 2022-02-02T18:41:29.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.143+0000 7f9273fff700 1 -- 172.21.15.96:0/3763395708 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f928c0fee00 con 0x7f9274064e20 2022-02-02T18:41:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 msgr2=0x7f92740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f9280013690 tx=0x7f9280009b30).stop 2022-02-02T18:41:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 msgr2=0x7f928c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f927c00c530 tx=0x7f927c007e20).stop 2022-02-02T18:41:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 shutdown_connections 2022-02-02T18:41:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f6530 0x7f928c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 --2- 172.21.15.96:0/3763395708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f77d0 0x7f928c1072f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.144+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 >> 172.21.15.96:0/3763395708 conn(0x7f928c0f1c90 msgr2=0x7f928c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.145+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 shutdown_connections 2022-02-02T18:41:29.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.145+0000 7f9290d9b700 1 -- 172.21.15.96:0/3763395708 wait complete. 2022-02-02T18:41:29.152 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:41:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1150134104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 msgr2=0x7f4ce00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1150134104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce00f7c30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4cd0004660 tx=0x7f4cd0009b30).stop 2022-02-02T18:41:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1150134104 shutdown_connections 2022-02-02T18:41:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1150134104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce00f7c30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1150134104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 0x7f4ce00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:41:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1150134104 >> 172.21.15.96:0/1150134104 conn(0x7f4ce00f1c90 msgr2=0x7f4ce00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1150134104 shutdown_connections 2022-02-02T18:41:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.243+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1150134104 wait complete. 2022-02-02T18:41:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 Processor -- start 2022-02-02T18:41:29.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 -- start start 2022-02-02T18:41:29.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 0x7f4ce0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0107980 con 0x7f4ce00f77d0 2022-02-02T18:41:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4ce49a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0108100 con 0x7f4ce00f6530 2022-02-02T18:41:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4cdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4cdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55412/0 (socket says 172.21.15.96:55412) 2022-02-02T18:41:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4cdeffd700 1 -- 172.21.15.96:0/1903392118 learned_addr learned my addr 172.21.15.96:0/1903392118 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:41:29.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.244+0000 7f4cdf7fe700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 0x7f4ce0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cdeffd700 1 -- 172.21.15.96:0/1903392118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 msgr2=0x7f4ce0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cdeffd700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 0x7f4ce0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cdeffd700 1 -- 172.21.15.96:0/1903392118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0005040 con 0x7f4ce00f77d0 2022-02-02T18:41:29.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cdeffd700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f4cd0009990 tx=0x7f4cd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cd0018070 con 0x7f4ce00f77d0 2022-02-02T18:41:29.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cd0007ca0 con 0x7f4ce00f77d0 2022-02-02T18:41:29.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cd001c620 con 0x7f4ce00f77d0 2022-02-02T18:41:29.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce0108320 con 0x7f4ce00f77d0 2022-02-02T18:41:29.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.245+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce0108880 con 0x7f4ce00f77d0 2022-02-02T18:41:29.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.246+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce0045ad0 con 0x7f4ce00f77d0 2022-02-02T18:41:29.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.246+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cd001d960 con 0x7f4ce00f77d0 2022-02-02T18:41:29.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.247+0000 7f4cc7fff700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 0x7f4cc80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.247+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4cd0083750 con 0x7f4ce00f77d0 2022-02-02T18:41:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.247+0000 7f4cdf7fe700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 0x7f4cc80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.247+0000 7f4cdf7fe700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 0x7f4cc80672e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f4ce0106b70 tx=0x7f4cd4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.251+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cd0051800 con 0x7f4ce00f77d0 2022-02-02T18:41:29.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.423+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ce00fef40 con 0x7f4cc8064e20 2022-02-02T18:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.433+0000 7f4cc7fff700 1 -- 172.21.15.96:0/1903392118 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4cd400b3b0 con 0x7f4cc8064e20 2022-02-02T18:41:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:41:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (24m) 5m ago 25m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:41:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (17m) 5m ago 25m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:41:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (17m) 4m ago 25m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:41:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (24m) 5m ago 25m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:41:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (21m) 5m ago 21m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:41:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (17m) 5m ago 22m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:41:29.433 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (22m) 4m ago 22m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:41:29.433 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (17m) 4m ago 22m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:41:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (19m) 5m ago 27m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:41:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (18m) 4m ago 25m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:41:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (18m) 5m ago 27m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:41:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (17m) 4m ago 25m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:41:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (25m) 5m ago 25m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:41:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (25m) 4m ago 25m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:41:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (16m) 5m ago 24m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:41:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (16m) 5m ago 24m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:41:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (15m) 5m ago 24m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:41:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (15m) 4m ago 23m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:41:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (14m) 4m ago 23m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:41:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (14m) 4m ago 23m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:41:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (24m) 5m ago 25m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:41:29.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.435+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 msgr2=0x7f4cc80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.435+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 0x7f4cc80672e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f4ce0106b70 tx=0x7f4cd4008040).stop 2022-02-02T18:41:29.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.435+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 msgr2=0x7f4ce01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.435+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f4cd0009990 tx=0x7f4cd0009b30).stop 2022-02-02T18:41:29.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 shutdown_connections 2022-02-02T18:41:29.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064e20 0x7f4cc80672e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ce00f6530 0x7f4ce0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 --2- 172.21.15.96:0/1903392118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ce00f77d0 0x7f4ce01072f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 >> 172.21.15.96:0/1903392118 conn(0x7f4ce00f1c90 msgr2=0x7f4ce00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 shutdown_connections 2022-02-02T18:41:29.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.436+0000 7f4ce49a2700 1 -- 172.21.15.96:0/1903392118 wait complete. 2022-02-02T18:41:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 -- 172.21.15.96:0/1874999248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 msgr2=0x7fb26c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 --2- 172.21.15.96:0/1874999248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c0f5a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fb260004660 tx=0x7fb260009b30).stop 2022-02-02T18:41:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 -- 172.21.15.96:0/1874999248 shutdown_connections 2022-02-02T18:41:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 --2- 172.21.15.96:0/1874999248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 0x7fb26c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:41:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 --2- 172.21.15.96:0/1874999248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c0f5a00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 -- 172.21.15.96:0/1874999248 >> 172.21.15.96:0/1874999248 conn(0x7fb26c0f0de0 msgr2=0x7fb26c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 -- 172.21.15.96:0/1874999248 shutdown_connections 2022-02-02T18:41:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.533+0000 7fb2718e1700 1 -- 172.21.15.96:0/1874999248 wait complete. 2022-02-02T18:41:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 Processor -- start 2022-02-02T18:41:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 -- start start 2022-02-02T18:41:29.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 0x7fb26c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c107aa0 con 0x7fb26c0f55e0 2022-02-02T18:41:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb2718e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c108350 con 0x7fb26c0f5ef0 2022-02-02T18:41:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55420/0 (socket says 172.21.15.96:55420) 2022-02-02T18:41:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 -- 172.21.15.96:0/2838995941 learned_addr learned my addr 172.21.15.96:0/2838995941 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:41:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26a7fc700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 0x7fb26c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 -- 172.21.15.96:0/2838995941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 msgr2=0x7fb26c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 0x7fb26c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 -- 172.21.15.96:0/2838995941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260005040 con 0x7fb26c0f55e0 2022-02-02T18:41:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.534+0000 7fb26affd700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb260009990 tx=0x7fb260009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.535+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb260018070 con 0x7fb26c0f55e0 2022-02-02T18:41:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.535+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c1085d0 con 0x7fb26c0f55e0 2022-02-02T18:41:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.535+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb260007ca0 con 0x7fb26c0f55e0 2022-02-02T18:41:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.535+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26001c620 con 0x7fb26c0f55e0 2022-02-02T18:41:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.535+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c108b30 con 0x7fb26c0f55e0 2022-02-02T18:41:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.536+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c0f4a70 con 0x7fb26c0f55e0 2022-02-02T18:41:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.536+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb26001d960 con 0x7fb26c0f55e0 2022-02-02T18:41:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.537+0000 7fb2537fe700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 0x7fb254067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.537+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb260083820 con 0x7fb26c0f55e0 2022-02-02T18:41:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.537+0000 7fb26a7fc700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 0x7fb254067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.537+0000 7fb26a7fc700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 0x7fb254067290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb25c00b790 tx=0x7fb25c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.541+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb260055470 con 0x7fb26c0f55e0 2022-02-02T18:41:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.776+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb26c0fdfa0 con 0x7fb26c0f55e0 2022-02-02T18:41:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.777+0000 7fb2537fe700 1 -- 172.21.15.96:0/2838995941 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb260055060 con 0x7fb26c0f55e0 2022-02-02T18:41:29.775 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:41:29.775 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:41:29.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:41:29.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:41:29.776 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:41:29.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:41:29.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:41:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:41:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:41:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:41:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:41:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:41:29.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:41:29.778 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:41:29.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:41:29.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:41:29.779 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:41:29.779 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:41:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 msgr2=0x7fb254067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 0x7fb254067290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb25c00b790 tx=0x7fb25c008040).stop 2022-02-02T18:41:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 msgr2=0x7fb26c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb260009990 tx=0x7fb260009b30).stop 2022-02-02T18:41:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 shutdown_connections 2022-02-02T18:41:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.778+0000 7fb2718e1700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb254064dd0 0x7fb254067290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.779+0000 7fb2718e1700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb26c0f55e0 0x7fb26c106f70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.779+0000 7fb2718e1700 1 --2- 172.21.15.96:0/2838995941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26c0f5ef0 0x7fb26c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.779+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 >> 172.21.15.96:0/2838995941 conn(0x7fb26c0f0de0 msgr2=0x7fb26c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.779+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 shutdown_connections 2022-02-02T18:41:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.779+0000 7fb2718e1700 1 -- 172.21.15.96:0/2838995941 wait complete. 2022-02-02T18:41:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/1934447766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 msgr2=0x7fc4a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/1934447766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f59e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fc48c004660 tx=0x7fc48c009b30).stop 2022-02-02T18:41:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/1934447766 shutdown_connections 2022-02-02T18:41:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/1934447766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 0x7fc4a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/1934447766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f59e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/1934447766 >> 172.21.15.96:0/1934447766 conn(0x7fc4a40f0d20 msgr2=0x7fc4a40f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/1934447766 shutdown_connections 2022-02-02T18:41:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/1934447766 wait complete. 2022-02-02T18:41:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.876+0000 7fc4a8cb7700 1 Processor -- start 2022-02-02T18:41:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 -- start start 2022-02-02T18:41:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 0x7fc4a40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40f8100 con 0x7fc4a40f55c0 2022-02-02T18:41:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40f8240 con 0x7fc4a40f6860 2022-02-02T18:41:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55430/0 (socket says 172.21.15.96:55430) 2022-02-02T18:41:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 -- 172.21.15.96:0/2499268121 learned_addr learned my addr 172.21.15.96:0/2499268121 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:41:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a1d9b700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 0x7fc4a40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 -- 172.21.15.96:0/2499268121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 msgr2=0x7fc4a40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 0x7fc4a40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 -- 172.21.15.96:0/2499268121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c005040 con 0x7fc4a40f55c0 2022-02-02T18:41:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a259c700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc48c004f60 tx=0x7fc48c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c018070 con 0x7fc4a40f55c0 2022-02-02T18:41:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc48c007ba0 con 0x7fc4a40f55c0 2022-02-02T18:41:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a40f84c0 con 0x7fc4a40f55c0 2022-02-02T18:41:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c01c620 con 0x7fc4a40f55c0 2022-02-02T18:41:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.877+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a40f8a20 con 0x7fc4a40f55c0 2022-02-02T18:41:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.878+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a4045ad0 con 0x7fc4a40f55c0 2022-02-02T18:41:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.879+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc48c01c8e0 con 0x7fc4a40f55c0 2022-02-02T18:41:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.879+0000 7fc49affd700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 0x7fc490067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:41:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.879+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc48c083990 con 0x7fc4a40f55c0 2022-02-02T18:41:29.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.879+0000 7fc4a1d9b700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 0x7fc490067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:41:29.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.880+0000 7fc4a1d9b700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 0x7fc490067290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc4940041d0 tx=0x7fc494009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:41:29.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:29.883+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc48c051a40 con 0x7fc4a40f55c0 2022-02-02T18:41:30.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.082+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4a410f680 con 0x7fc4a40f55c0 2022-02-02T18:41:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.082+0000 7fc49affd700 1 -- 172.21.15.96:0/2499268121 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc48c055060 con 0x7fc4a40f55c0 2022-02-02T18:41:30.082 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:41:30.082 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:41:30.083 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:41:30.083 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:41:30.084 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:41:30.084 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:41:30.085 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:41:30.085 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:41:30.086 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:41:30.086 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:41:30.087 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:41:30.087 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:41:30.087 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:41:30.088 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:41:30.088 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:41:30.089 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:41:30.089 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:41:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:41:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:41:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:41:30.091 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:41:30.091 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:41:30.092 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:41:30.092 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:41:30.092 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:41:30.093 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:41:30.093 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:41:30.094 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:41:30.094 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:41:30.095 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:41:30.095 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:41:30.095 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:41:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:41:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:41:30.096 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:41:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:41:30.097 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:41:30.097 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:41:30.097 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:41:30.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 msgr2=0x7fc490067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:30.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 0x7fc490067290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc4940041d0 tx=0x7fc494009040).stop 2022-02-02T18:41:30.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 msgr2=0x7fc4a40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:41:30.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc48c004f60 tx=0x7fc48c009b30).stop 2022-02-02T18:41:30.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 shutdown_connections 2022-02-02T18:41:30.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc490064dd0 0x7fc490067290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4a40f55c0 0x7fc4a40f9720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 --2- 172.21.15.96:0/2499268121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4a40f6860 0x7fc4a40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 >> 172.21.15.96:0/2499268121 conn(0x7fc4a40f0d20 msgr2=0x7fc4a405ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 shutdown_connections 2022-02-02T18:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:41:30.084+0000 7fc4a8cb7700 1 -- 172.21.15.96:0/2499268121 wait complete. 2022-02-02T18:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:41:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:30 smithi096 ceph-mon[101353]: pgmap v581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:30 smithi096 ceph-mon[101353]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:41:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:30 smithi096 ceph-mon[101353]: from='client.34720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:41:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2838995941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:30.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2499268121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:41:31.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:30 smithi159 ceph-mon[69013]: pgmap v581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:31.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:30 smithi159 ceph-mon[69013]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:41:31.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:30 smithi159 ceph-mon[69013]: from='client.34720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:41:31.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2838995941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:31.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2499268121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:41:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: pgmap v582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: pgmap v582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:33 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:33 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:33.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:33 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:33.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:33 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:34 smithi096 ceph-mon[101353]: pgmap v583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:35.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:34 smithi159 ceph-mon[69013]: pgmap v583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:36 smithi159 ceph-mon[69013]: pgmap v584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:36 smithi096 ceph-mon[101353]: pgmap v584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:38 smithi159 ceph-mon[69013]: pgmap v585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:38 smithi096 ceph-mon[101353]: pgmap v585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:40 smithi159 ceph-mon[69013]: pgmap v586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:40 smithi096 ceph-mon[101353]: pgmap v586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:42.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: pgmap v587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:42.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:42.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:42.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:42.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:42.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:42.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: pgmap v587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:42.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:42.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:42.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:42.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:43.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:43 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:43.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:43 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:43 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:43.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:43 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:44 smithi159 ceph-mon[69013]: pgmap v588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:44 smithi096 ceph-mon[101353]: pgmap v588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:46 smithi159 ceph-mon[69013]: pgmap v589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:46 smithi096 ceph-mon[101353]: pgmap v589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:48 smithi159 ceph-mon[69013]: pgmap v590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:48 smithi096 ceph-mon[101353]: pgmap v590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:50.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:50 smithi159 ceph-mon[69013]: pgmap v591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:50 smithi096 ceph-mon[101353]: pgmap v591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: pgmap v592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: pgmap v592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:41:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:41:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:41:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:41:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:41:53.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:53 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:53.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:53 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:53.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:53 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:41:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:53 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:41:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:54 smithi159 ceph-mon[69013]: pgmap v593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:54 smithi096 ceph-mon[101353]: pgmap v593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:56 smithi159 ceph-mon[69013]: pgmap v594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:56 smithi096 ceph-mon[101353]: pgmap v594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:41:58 smithi159 ceph-mon[69013]: pgmap v595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:41:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:41:58 smithi096 ceph-mon[101353]: pgmap v595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:00.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2234141097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f86e0 msgr2=0x7fa4e80f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2234141097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f86e0 0x7fa4e80f4860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa4dc004660 tx=0x7fa4dc009b30).stop 2022-02-02T18:42:00.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2234141097 shutdown_connections 2022-02-02T18:42:00.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2234141097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f86e0 0x7fa4e80f4860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2234141097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f7d40 0x7fa4e80f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2234141097 >> 172.21.15.96:0/2234141097 conn(0x7fa4e80f04c0 msgr2=0x7fa4e80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:00.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2234141097 shutdown_connections 2022-02-02T18:42:00.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.197+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2234141097 wait complete. 2022-02-02T18:42:00.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 Processor -- start 2022-02-02T18:42:00.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 -- start start 2022-02-02T18:42:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f86e0 0x7fa4e8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8107a10 con 0x7fa4e80f7d40 2022-02-02T18:42:00.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4ed92c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8107b50 con 0x7fa4e80f86e0 2022-02-02T18:42:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.198+0000 7fa4e6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55452/0 (socket says 172.21.15.96:55452) 2022-02-02T18:42:00.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 -- 172.21.15.96:0/2397002867 learned_addr learned my addr 172.21.15.96:0/2397002867 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:00.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e67fc700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f86e0 0x7fa4e8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 -- 172.21.15.96:0/2397002867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f86e0 msgr2=0x7fa4e8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f86e0 0x7fa4e8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 -- 172.21.15.96:0/2397002867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc005040 con 0x7fa4e80f7d40 2022-02-02T18:42:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4e6ffd700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa4d800c790 tx=0x7fa4d8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d800e680 con 0x7fa4e80f7d40 2022-02-02T18:42:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa4d800ec90 con 0x7fa4e80f7d40 2022-02-02T18:42:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e81084f0 con 0x7fa4e80f7d40 2022-02-02T18:42:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d8012d00 con 0x7fa4e80f7d40 2022-02-02T18:42:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.199+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e8108ab0 con 0x7fa4e80f7d40 2022-02-02T18:42:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.200+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e8045ad0 con 0x7fa4e80f7d40 2022-02-02T18:42:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.201+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa4d8010070 con 0x7fa4e80f7d40 2022-02-02T18:42:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.201+0000 7fa4cf7fe700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 0x7fa4d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.201+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa4d8081ba0 con 0x7fa4e80f7d40 2022-02-02T18:42:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.201+0000 7fa4e67fc700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 0x7fa4d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.202+0000 7fa4e67fc700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 0x7fa4d0067290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa4dc004e30 tx=0x7fa4dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.205+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4d8053680 con 0x7fa4e80f7d40 2022-02-02T18:42:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.388+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4e80fef20 con 0x7fa4d0064dd0 2022-02-02T18:42:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.389+0000 7fa4cf7fe700 1 -- 172.21.15.96:0/2397002867 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa4e80fef20 con 0x7fa4d0064dd0 2022-02-02T18:42:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 msgr2=0x7fa4d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 0x7fa4d0067290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa4dc004e30 tx=0x7fa4dc009b30).stop 2022-02-02T18:42:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 msgr2=0x7fa4e8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa4d800c790 tx=0x7fa4d8007d90).stop 2022-02-02T18:42:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 shutdown_connections 2022-02-02T18:42:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4d0064dd0 0x7fa4d0067290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4e80f7d40 0x7fa4e8106f70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 --2- 172.21.15.96:0/2397002867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4e80f86e0 0x7fa4e8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 >> 172.21.15.96:0/2397002867 conn(0x7fa4e80f04c0 msgr2=0x7fa4e80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 shutdown_connections 2022-02-02T18:42:00.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.391+0000 7fa4ed92c700 1 -- 172.21.15.96:0/2397002867 wait complete. 2022-02-02T18:42:00.398 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:42:00.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 -- 172.21.15.96:0/901194361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 msgr2=0x7f26a40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 --2- 172.21.15.96:0/901194361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a40f6b40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2698004660 tx=0x7f2698009b30).stop 2022-02-02T18:42:00.486 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:00 smithi096 ceph-mon[101353]: pgmap v596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:00.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 -- 172.21.15.96:0/901194361 shutdown_connections 2022-02-02T18:42:00.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 --2- 172.21.15.96:0/901194361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a40f6b40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 --2- 172.21.15.96:0/901194361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 0x7f26a40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 -- 172.21.15.96:0/901194361 >> 172.21.15.96:0/901194361 conn(0x7f26a40f0ba0 msgr2=0x7f26a40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:00.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 -- 172.21.15.96:0/901194361 shutdown_connections 2022-02-02T18:42:00.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.488+0000 7f26a3fff700 1 -- 172.21.15.96:0/901194361 wait complete. 2022-02-02T18:42:00.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 Processor -- start 2022-02-02T18:42:00.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 -- start start 2022-02-02T18:42:00.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 0x7f26a410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40602b0 con 0x7f26a40f66e0 2022-02-02T18:42:00.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40603f0 con 0x7f26a40f5440 2022-02-02T18:42:00.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55464/0 (socket says 172.21.15.96:55464) 2022-02-02T18:42:00.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.489+0000 7f26a27fc700 1 -- 172.21.15.96:0/1462184899 learned_addr learned my addr 172.21.15.96:0/1462184899 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:00.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a2ffd700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 0x7f26a410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a27fc700 1 -- 172.21.15.96:0/1462184899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 msgr2=0x7f26a410beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a27fc700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 0x7f26a410beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a27fc700 1 -- 172.21.15.96:0/1462184899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698005040 con 0x7f26a40f66e0 2022-02-02T18:42:00.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a27fc700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2698009990 tx=0x7f2698009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2698018070 con 0x7f26a40f66e0 2022-02-02T18:42:00.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2698007ba0 con 0x7f26a40f66e0 2022-02-02T18:42:00.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269801c3c0 con 0x7f26a40f66e0 2022-02-02T18:42:00.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a410e8a0 con 0x7f26a40f66e0 2022-02-02T18:42:00.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.490+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a410ebf0 con 0x7f26a40f66e0 2022-02-02T18:42:00.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.492+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f269801d420 con 0x7f26a40f66e0 2022-02-02T18:42:00.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.492+0000 7f268b7fe700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 0x7f268c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.492+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f26980836f0 con 0x7f26a40f66e0 2022-02-02T18:42:00.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.492+0000 7f26a2ffd700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 0x7f268c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.492+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4045ad0 con 0x7f26a40f66e0 2022-02-02T18:42:00.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.493+0000 7f26a2ffd700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 0x7f268c0672e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f26a4060040 tx=0x7f269400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.497+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2698051860 con 0x7f26a40f66e0 2022-02-02T18:42:00.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.670+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a40fdd00 con 0x7f268c064e20 2022-02-02T18:42:00.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.679+0000 7f268b7fe700 1 -- 172.21.15.96:0/1462184899 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f26a40fdd00 con 0x7f268c064e20 2022-02-02T18:42:00.676 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:42:00.676 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (25m) 6m ago 26m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:42:00.676 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (17m) 6m ago 26m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:42:00.677 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (17m) 4m ago 25m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:42:00.677 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (25m) 6m ago 26m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:42:00.677 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (22m) 6m ago 22m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:42:00.677 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (18m) 6m ago 22m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:42:00.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (22m) 4m ago 22m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:42:00.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (18m) 4m ago 22m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:42:00.678 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (19m) 6m ago 27m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:42:00.678 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (19m) 4m ago 25m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:42:00.678 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (18m) 6m ago 27m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:42:00.679 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (18m) 4m ago 25m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:42:00.679 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (26m) 6m ago 26m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:42:00.679 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (25m) 4m ago 25m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:42:00.679 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (17m) 6m ago 25m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:42:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (16m) 6m ago 24m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:42:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (16m) 6m ago 24m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:42:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (15m) 4m ago 24m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:42:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (15m) 4m ago 24m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:42:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (14m) 4m ago 23m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:42:00.681 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (25m) 6m ago 26m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:42:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 msgr2=0x7f268c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 0x7f268c0672e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f26a4060040 tx=0x7f269400b040).stop 2022-02-02T18:42:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 msgr2=0x7f26a410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2698009990 tx=0x7f2698009b30).stop 2022-02-02T18:42:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 shutdown_connections 2022-02-02T18:42:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f268c064e20 0x7f268c0672e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40f5440 0x7f26a410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 --2- 172.21.15.96:0/1462184899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a40f66e0 0x7f26a410e3b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 >> 172.21.15.96:0/1462184899 conn(0x7f26a40f0ba0 msgr2=0x7f26a40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 shutdown_connections 2022-02-02T18:42:00.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.681+0000 7f26a3fff700 1 -- 172.21.15.96:0/1462184899 wait complete. 2022-02-02T18:42:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:00 smithi159 ceph-mon[69013]: pgmap v596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 -- 172.21.15.96:0/1524600034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 msgr2=0x7f6d580f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 --2- 172.21.15.96:0/1524600034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d580f6900 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6d54004660 tx=0x7f6d54009b30).stop 2022-02-02T18:42:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 -- 172.21.15.96:0/1524600034 shutdown_connections 2022-02-02T18:42:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 --2- 172.21.15.96:0/1524600034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d580f6900 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 --2- 172.21.15.96:0/1524600034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 0x7f6d580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 -- 172.21.15.96:0/1524600034 >> 172.21.15.96:0/1524600034 conn(0x7f6d580f0de0 msgr2=0x7f6d580f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 -- 172.21.15.96:0/1524600034 shutdown_connections 2022-02-02T18:42:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.777+0000 7f6d6001f700 1 -- 172.21.15.96:0/1524600034 wait complete. 2022-02-02T18:42:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 Processor -- start 2022-02-02T18:42:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 -- start start 2022-02-02T18:42:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 0x7f6d58109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580604a0 con 0x7f6d580f5ed0 2022-02-02T18:42:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d6001f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580605e0 con 0x7f6d580f55c0 2022-02-02T18:42:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d5d5ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d5d5ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55478/0 (socket says 172.21.15.96:55478) 2022-02-02T18:42:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d5d5ba700 1 -- 172.21.15.96:0/2953856642 learned_addr learned my addr 172.21.15.96:0/2953856642 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.778+0000 7f6d5ddbb700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 0x7f6d58109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d5d5ba700 1 -- 172.21.15.96:0/2953856642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 msgr2=0x7f6d58109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d5d5ba700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 0x7f6d58109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d5d5ba700 1 -- 172.21.15.96:0/2953856642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54005040 con 0x7f6d580f5ed0 2022-02-02T18:42:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d5d5ba700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f6d54009990 tx=0x7f6d54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d54018070 con 0x7f6d580f5ed0 2022-02-02T18:42:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5810c6e0 con 0x7f6d580f5ed0 2022-02-02T18:42:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d54007ba0 con 0x7f6d580f5ed0 2022-02-02T18:42:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5401c3c0 con 0x7f6d580f5ed0 2022-02-02T18:42:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.779+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5810cc10 con 0x7f6d580f5ed0 2022-02-02T18:42:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.780+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d580f4a50 con 0x7f6d580f5ed0 2022-02-02T18:42:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.781+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d5401d420 con 0x7f6d580f5ed0 2022-02-02T18:42:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.781+0000 7f6d4e7fc700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 0x7f6d44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.781+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6d540836f0 con 0x7f6d580f5ed0 2022-02-02T18:42:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.781+0000 7f6d5ddbb700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 0x7f6d44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.781+0000 7f6d5ddbb700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 0x7f6d44067290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6d58060120 tx=0x7f6d4800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:00.785+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d54051860 con 0x7f6d580f5ed0 2022-02-02T18:42:01.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.017+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d58045ad0 con 0x7f6d580f5ed0 2022-02-02T18:42:01.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.017+0000 7f6d4e7fc700 1 -- 172.21.15.96:0/2953856642 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6d54054e80 con 0x7f6d580f5ed0 2022-02-02T18:42:01.015 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:42:01.015 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:42:01.015 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:42:01.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:01.016 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:42:01.016 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:42:01.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:01.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:42:01.017 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:42:01.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:01.018 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:42:01.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:42:01.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:01.018 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:42:01.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:42:01.019 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:42:01.019 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:42:01.019 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:42:01.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 msgr2=0x7f6d44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 0x7f6d44067290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6d58060120 tx=0x7f6d4800b040).stop 2022-02-02T18:42:01.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 msgr2=0x7f6d5810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f6d54009990 tx=0x7f6d54009b30).stop 2022-02-02T18:42:01.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 shutdown_connections 2022-02-02T18:42:01.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d44064dd0 0x7f6d44067290 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d580f55c0 0x7f6d58109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 --2- 172.21.15.96:0/2953856642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d580f5ed0 0x7f6d5810c190 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 >> 172.21.15.96:0/2953856642 conn(0x7f6d580f0de0 msgr2=0x7f6d580fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 shutdown_connections 2022-02-02T18:42:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.020+0000 7f6d6001f700 1 -- 172.21.15.96:0/2953856642 wait complete. 2022-02-02T18:42:01.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- 172.21.15.96:0/3497283393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 msgr2=0x7f5f740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 --2- 172.21.15.96:0/3497283393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f740f7de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5f68004660 tx=0x7f5f68009b30).stop 2022-02-02T18:42:01.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- 172.21.15.96:0/3497283393 shutdown_connections 2022-02-02T18:42:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 --2- 172.21.15.96:0/3497283393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f740f7de0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 --2- 172.21.15.96:0/3497283393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 0x7f5f740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- 172.21.15.96:0/3497283393 >> 172.21.15.96:0/3497283393 conn(0x7f5f740f1e40 msgr2=0x7f5f740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:01.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- 172.21.15.96:0/3497283393 shutdown_connections 2022-02-02T18:42:01.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- 172.21.15.96:0/3497283393 wait complete. 2022-02-02T18:42:01.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 Processor -- start 2022-02-02T18:42:01.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.118+0000 7f5f79144700 1 -- start start 2022-02-02T18:42:01.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f79144700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 0x7f5f7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:01.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f79144700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f79144700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7406a380 con 0x7f5f740f7980 2022-02-02T18:42:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f79144700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7406a4c0 con 0x7f5f740f66e0 2022-02-02T18:42:01.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55488/0 (socket says 172.21.15.96:55488) 2022-02-02T18:42:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 -- 172.21.15.96:0/1880867129 learned_addr learned my addr 172.21.15.96:0/1880867129 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:01.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f72d9d700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 0x7f5f7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 -- 172.21.15.96:0/1880867129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 msgr2=0x7f5f7406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 0x7f5f7406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 -- 172.21.15.96:0/1880867129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68005040 con 0x7f5f740f7980 2022-02-02T18:42:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f7259c700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5f68009990 tx=0x7f5f68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:01.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f68018070 con 0x7f5f740f7980 2022-02-02T18:42:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f68007ca0 con 0x7f5f740f7980 2022-02-02T18:42:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7406a740 con 0x7f5f740f7980 2022-02-02T18:42:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.119+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6801c620 con 0x7f5f740f7980 2022-02-02T18:42:01.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.120+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7406aca0 con 0x7f5f740f7980 2022-02-02T18:42:01.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.120+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74045ad0 con 0x7f5f740f7980 2022-02-02T18:42:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.121+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f6801d960 con 0x7f5f740f7980 2022-02-02T18:42:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.121+0000 7f5f5b7fe700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 0x7f5f5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.121+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5f68083820 con 0x7f5f740f7980 2022-02-02T18:42:01.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.121+0000 7f5f72d9d700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 0x7f5f5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.122+0000 7f5f72d9d700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 0x7f5f5c067290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5f7406b730 tx=0x7f5f64009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:01.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.125+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f68051a40 con 0x7f5f740f7980 2022-02-02T18:42:01.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.326+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f74027a00 con 0x7f5f740f7980 2022-02-02T18:42:01.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.327+0000 7f5f5b7fe700 1 -- 172.21.15.96:0/1880867129 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5f68055060 con 0x7f5f740f7980 2022-02-02T18:42:01.324 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:42:01.324 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:42:01.324 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:42:01.325 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:42:01.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:01.325 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:42:01.325 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:42:01.325 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:42:01.326 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:42:01.326 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:42:01.326 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:42:01.326 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:42:01.327 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:42:01.327 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:42:01.327 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:42:01.327 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:42:01.327 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:42:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:42:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:42:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:42:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:42:01.329 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:42:01.329 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:42:01.329 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:42:01.329 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:42:01.329 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:42:01.330 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:42:01.330 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:42:01.330 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:42:01.330 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:42:01.330 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:42:01.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:42:01.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:01.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:01.331 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:42:01.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:01.332 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:01.332 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:01.332 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 msgr2=0x7f5f5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 0x7f5f5c067290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5f7406b730 tx=0x7f5f64009040).stop 2022-02-02T18:42:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 msgr2=0x7f5f74069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5f68009990 tx=0x7f5f68009b30).stop 2022-02-02T18:42:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 shutdown_connections 2022-02-02T18:42:01.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f5c064dd0 0x7f5f5c067290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f66e0 0x7f5f7406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 --2- 172.21.15.96:0/1880867129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f7980 0x7f5f74069e20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:01.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 >> 172.21.15.96:0/1880867129 conn(0x7f5f740f1e40 msgr2=0x7f5f740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:01.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 shutdown_connections 2022-02-02T18:42:01.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:01.328+0000 7f5f79144700 1 -- 172.21.15.96:0/1880867129 wait complete. 2022-02-02T18:42:01.336 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:42:01.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:01 smithi159 ceph-mon[69013]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2953856642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:01.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1880867129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:42:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:01 smithi096 ceph-mon[101353]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2953856642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1880867129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:42:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: pgmap v597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: pgmap v597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:02.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:03.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:03 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:03.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:03 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:03.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:03 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:03 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:04 smithi159 ceph-mon[69013]: pgmap v598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:04 smithi096 ceph-mon[101353]: pgmap v598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:06.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:06 smithi159 ceph-mon[69013]: pgmap v599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:06 smithi096 ceph-mon[101353]: pgmap v599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:08 smithi159 ceph-mon[69013]: pgmap v600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:08 smithi096 ceph-mon[101353]: pgmap v600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:10.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:10 smithi159 ceph-mon[69013]: pgmap v601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:10.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:10 smithi096 ceph-mon[101353]: pgmap v601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: pgmap v602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: pgmap v602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:12.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:12.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:13.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:13 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:13.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:13 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:13 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:13 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:14 smithi159 ceph-mon[69013]: pgmap v603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:14 smithi096 ceph-mon[101353]: pgmap v603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:16.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:16 smithi159 ceph-mon[69013]: pgmap v604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:16.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:16 smithi096 ceph-mon[101353]: pgmap v604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:18.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:18 smithi159 ceph-mon[69013]: pgmap v605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:18 smithi096 ceph-mon[101353]: pgmap v605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:20.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:20 smithi159 ceph-mon[69013]: pgmap v606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:20.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:20 smithi096 ceph-mon[101353]: pgmap v606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: pgmap v607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: pgmap v607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:23.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:23 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:23.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:23 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:23 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:23 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:24.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:24 smithi159 ceph-mon[69013]: pgmap v608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:24 smithi096 ceph-mon[101353]: pgmap v608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:26.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:26 smithi159 ceph-mon[69013]: pgmap v609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:26.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:26 smithi096 ceph-mon[101353]: pgmap v609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:42:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:42:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:42:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:42:28.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:28 smithi159 ceph-mon[69013]: pgmap v610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:28.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:28 smithi096 ceph-mon[101353]: pgmap v610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:30 smithi159 ceph-mon[69013]: pgmap v611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:30 smithi096 ceph-mon[101353]: pgmap v611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 -- 172.21.15.96:0/3835237530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 msgr2=0x7fd18c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 --2- 172.21.15.96:0/3835237530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c0fbae0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fd180004660 tx=0x7fd180009b30).stop 2022-02-02T18:42:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 -- 172.21.15.96:0/3835237530 shutdown_connections 2022-02-02T18:42:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 --2- 172.21.15.96:0/3835237530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c0fbae0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 --2- 172.21.15.96:0/3835237530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 -- 172.21.15.96:0/3835237530 >> 172.21.15.96:0/3835237530 conn(0x7fd18c0f0b90 msgr2=0x7fd18c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 -- 172.21.15.96:0/3835237530 shutdown_connections 2022-02-02T18:42:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 -- 172.21.15.96:0/3835237530 wait complete. 2022-02-02T18:42:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.440+0000 7fd1913da700 1 Processor -- start 2022-02-02T18:42:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd1913da700 1 -- start start 2022-02-02T18:42:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd1913da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd1913da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd1913da700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1099d0 con 0x7fd18c0f9690 2022-02-02T18:42:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd1913da700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c109b10 con 0x7fd18c060310 2022-02-02T18:42:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55512/0 (socket says 172.21.15.96:55512) 2022-02-02T18:42:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 -- 172.21.15.96:0/560270244 learned_addr learned my addr 172.21.15.96:0/560270244 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18bfff700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 -- 172.21.15.96:0/560270244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 msgr2=0x7fd18c108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 -- 172.21.15.96:0/560270244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180005040 con 0x7fd18c0f9690 2022-02-02T18:42:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18bfff700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:42:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.441+0000 7fd18b7fe700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fd180004f60 tx=0x7fd180009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.442+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd180018070 con 0x7fd18c0f9690 2022-02-02T18:42:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.442+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd180007ba0 con 0x7fd18c0f9690 2022-02-02T18:42:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.442+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c10a450 con 0x7fd18c0f9690 2022-02-02T18:42:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.442+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18001c620 con 0x7fd18c0f9690 2022-02-02T18:42:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.442+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c10a9b0 con 0x7fd18c0f9690 2022-02-02T18:42:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.443+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c045ad0 con 0x7fd18c0f9690 2022-02-02T18:42:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.443+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd18001c8e0 con 0x7fd18c0f9690 2022-02-02T18:42:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.444+0000 7fd188ff9700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 0x7fd1740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.444+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd180083a60 con 0x7fd18c0f9690 2022-02-02T18:42:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.444+0000 7fd18bfff700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 0x7fd1740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.444+0000 7fd18bfff700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 0x7fd1740672e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd17c004a70 tx=0x7fd17c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.448+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd180055600 con 0x7fd18c0f9690 2022-02-02T18:42:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.626+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd18c10b180 con 0x7fd174064e20 2022-02-02T18:42:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.627+0000 7fd188ff9700 1 -- 172.21.15.96:0/560270244 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd18c10b180 con 0x7fd174064e20 2022-02-02T18:42:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 msgr2=0x7fd1740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 0x7fd1740672e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd17c004a70 tx=0x7fd17c009040).stop 2022-02-02T18:42:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 msgr2=0x7fd18c109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fd180004f60 tx=0x7fd180009b30).stop 2022-02-02T18:42:31.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 shutdown_connections 2022-02-02T18:42:31.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd174064e20 0x7fd1740672e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd18c060310 0x7fd18c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 --2- 172.21.15.96:0/560270244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd18c0f9690 0x7fd18c109420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 >> 172.21.15.96:0/560270244 conn(0x7fd18c0f0b90 msgr2=0x7fd18c0f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:31.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 shutdown_connections 2022-02-02T18:42:31.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.629+0000 7fd1913da700 1 -- 172.21.15.96:0/560270244 wait complete. 2022-02-02T18:42:31.636 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:42:31.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 -- 172.21.15.96:0/3686305738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f7980 msgr2=0x7f277c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 --2- 172.21.15.96:0/3686305738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f7980 0x7f277c0f7de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f276c004660 tx=0x7f276c009b30).stop 2022-02-02T18:42:31.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 -- 172.21.15.96:0/3686305738 shutdown_connections 2022-02-02T18:42:31.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 --2- 172.21.15.96:0/3686305738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f7980 0x7f277c0f7de0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 --2- 172.21.15.96:0/3686305738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f66e0 0x7f277c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:42:31.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 -- 172.21.15.96:0/3686305738 >> 172.21.15.96:0/3686305738 conn(0x7f277c0f1e40 msgr2=0x7f277c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:31.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 -- 172.21.15.96:0/3686305738 shutdown_connections 2022-02-02T18:42:31.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 -- 172.21.15.96:0/3686305738 wait complete. 2022-02-02T18:42:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.728+0000 7f2780b69700 1 Processor -- start 2022-02-02T18:42:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 -- start start 2022-02-02T18:42:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f7980 0x7f277c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c107ae0 con 0x7f277c0f66e0 2022-02-02T18:42:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c108390 con 0x7f277c0f7980 2022-02-02T18:42:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55520/0 (socket says 172.21.15.96:55520) 2022-02-02T18:42:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 -- 172.21.15.96:0/1677624083 learned_addr learned my addr 172.21.15.96:0/1677624083 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:31.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2779d9b700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f7980 0x7f277c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 -- 172.21.15.96:0/1677624083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f7980 msgr2=0x7f277c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f7980 0x7f277c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 -- 172.21.15.96:0/1677624083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c005040 con 0x7f277c0f66e0 2022-02-02T18:42:31.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f277a59c700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f27700093f0 tx=0x7f2770006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:31.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2770009ea0 con 0x7f277c0f66e0 2022-02-02T18:42:31.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2770013af0 con 0x7f277c0f66e0 2022-02-02T18:42:31.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c108670 con 0x7f277c0f66e0 2022-02-02T18:42:31.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.729+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277000db10 con 0x7f277c0f66e0 2022-02-02T18:42:31.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.730+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c108c30 con 0x7f277c0f66e0 2022-02-02T18:42:31.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.731+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c0f5ad0 con 0x7f277c0f66e0 2022-02-02T18:42:31.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.731+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f277001a060 con 0x7f277c0f66e0 2022-02-02T18:42:31.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.731+0000 7f276affd700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 0x7f2764067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:31.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.731+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2770081b00 con 0x7f277c0f66e0 2022-02-02T18:42:31.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.731+0000 7f2779d9b700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 0x7f2764067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:31.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.732+0000 7f2779d9b700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 0x7f2764067290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f276c004e30 tx=0x7f276c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:31.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.736+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27700535e0 con 0x7f277c0f66e0 2022-02-02T18:42:31.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.909+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f277c0ff000 con 0x7f2764064dd0 2022-02-02T18:42:31.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.918+0000 7f276affd700 1 -- 172.21.15.96:0/1677624083 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f277c0ff000 con 0x7f2764064dd0 2022-02-02T18:42:31.915 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:42:31.915 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (25m) 6m ago 27m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:42:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (18m) 6m ago 26m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:42:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (18m) 5m ago 26m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:42:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (25m) 6m ago 26m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:42:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (23m) 6m ago 22m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:42:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (18m) 6m ago 23m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:42:31.917 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (23m) 5m ago 23m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:42:31.917 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (18m) 5m ago 23m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:42:31.917 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (20m) 6m ago 28m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:42:31.917 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (19m) 5m ago 26m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:42:31.918 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (19m) 6m ago 28m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:42:31.918 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (18m) 5m ago 26m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:42:31.918 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (26m) 6m ago 26m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:42:31.918 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (26m) 5m ago 26m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:42:31.918 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (17m) 6m ago 25m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:42:31.919 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (17m) 6m ago 25m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:42:31.919 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (16m) 6m ago 25m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:42:31.919 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (16m) 5m ago 24m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:42:31.919 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (15m) 5m ago 24m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:42:31.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (15m) 5m ago 24m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:42:31.920 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (25m) 6m ago 26m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:42:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 msgr2=0x7f2764067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 0x7f2764067290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f276c004e30 tx=0x7f276c009b30).stop 2022-02-02T18:42:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 msgr2=0x7f277c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f27700093f0 tx=0x7f2770006ec0).stop 2022-02-02T18:42:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 shutdown_connections 2022-02-02T18:42:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2764064dd0 0x7f2764067290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f277c0f66e0 0x7f277c106fb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 --2- 172.21.15.96:0/1677624083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f277c0f7980 0x7f277c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 >> 172.21.15.96:0/1677624083 conn(0x7f277c0f1e40 msgr2=0x7f277c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 shutdown_connections 2022-02-02T18:42:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:31.920+0000 7f2780b69700 1 -- 172.21.15.96:0/1677624083 wait complete. 2022-02-02T18:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 -- 172.21.15.96:0/1350342752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 msgr2=0x7f4f700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/1350342752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f700f7c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f4f64004660 tx=0x7f4f64009b30).stop 2022-02-02T18:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 -- 172.21.15.96:0/1350342752 shutdown_connections 2022-02-02T18:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/1350342752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f700f7c30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/1350342752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 0x7f4f700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.016+0000 7f4f6f59e700 1 -- 172.21.15.96:0/1350342752 >> 172.21.15.96:0/1350342752 conn(0x7f4f700f1c90 msgr2=0x7f4f700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 -- 172.21.15.96:0/1350342752 shutdown_connections 2022-02-02T18:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 -- 172.21.15.96:0/1350342752 wait complete. 2022-02-02T18:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 Processor -- start 2022-02-02T18:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 -- start start 2022-02-02T18:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 0x7f4f70106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f70107890 con 0x7f4f700f77d0 2022-02-02T18:42:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.017+0000 7f4f6f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701080d0 con 0x7f4f700f6530 2022-02-02T18:42:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55532/0 (socket says 172.21.15.96:55532) 2022-02-02T18:42:32.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 -- 172.21.15.96:0/3575680365 learned_addr learned my addr 172.21.15.96:0/3575680365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:32.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6e59c700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 0x7f4f70106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 -- 172.21.15.96:0/3575680365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 msgr2=0x7f4f70106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 0x7f4f70106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 -- 172.21.15.96:0/3575680365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64005040 con 0x7f4f700f77d0 2022-02-02T18:42:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6dd9b700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4f64009990 tx=0x7f4f64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f64018070 con 0x7f4f700f77d0 2022-02-02T18:42:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f70108350 con 0x7f4f700f77d0 2022-02-02T18:42:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f64007ba0 con 0x7f4f700f77d0 2022-02-02T18:42:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6401c3c0 con 0x7f4f700f77d0 2022-02-02T18:42:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.018+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f701087d0 con 0x7f4f700f77d0 2022-02-02T18:42:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.019+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f70059170 con 0x7f4f700f77d0 2022-02-02T18:42:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.020+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f6401d420 con 0x7f4f700f77d0 2022-02-02T18:42:32.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.020+0000 7f4f5effd700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 0x7f4f580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.021+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f640837b0 con 0x7f4f700f77d0 2022-02-02T18:42:32.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.021+0000 7f4f6e59c700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 0x7f4f580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.021+0000 7f4f6e59c700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 0x7f4f580672e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4f70107b60 tx=0x7f4f6000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:32.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.025+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f64051860 con 0x7f4f700f77d0 2022-02-02T18:42:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.257+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f70059170 con 0x7f4f700f77d0 2022-02-02T18:42:32.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.257+0000 7f4f5effd700 1 -- 172.21.15.96:0/3575680365 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4f70059170 con 0x7f4f700f77d0 2022-02-02T18:42:32.255 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:42:32.255 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:42:32.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:42:32.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:32.256 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:42:32.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:42:32.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:32.257 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:42:32.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:42:32.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:32.257 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:42:32.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:42:32.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:42:32.258 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:42:32.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:42:32.259 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:42:32.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:42:32.259 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:42:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 msgr2=0x7f4f580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 0x7f4f580672e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4f70107b60 tx=0x7f4f6000b040).stop 2022-02-02T18:42:32.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 msgr2=0x7f4f70107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4f64009990 tx=0x7f4f64009b30).stop 2022-02-02T18:42:32.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 shutdown_connections 2022-02-02T18:42:32.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f58064e20 0x7f4f580672e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f700f6530 0x7f4f70106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 --2- 172.21.15.96:0/3575680365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f700f77d0 0x7f4f70107290 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 >> 172.21.15.96:0/3575680365 conn(0x7f4f700f1c90 msgr2=0x7f4f700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 shutdown_connections 2022-02-02T18:42:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.259+0000 7f4f6f59e700 1 -- 172.21.15.96:0/3575680365 wait complete. 2022-02-02T18:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 -- 172.21.15.96:0/145720215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 msgr2=0x7ff58c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 --2- 172.21.15.96:0/145720215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c0f7c30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7ff57c004660 tx=0x7ff57c009b30).stop 2022-02-02T18:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 -- 172.21.15.96:0/145720215 shutdown_connections 2022-02-02T18:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 --2- 172.21.15.96:0/145720215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c0f7c30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 --2- 172.21.15.96:0/145720215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:42:32.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 -- 172.21.15.96:0/145720215 >> 172.21.15.96:0/145720215 conn(0x7ff58c0f1c90 msgr2=0x7ff58c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:32.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.359+0000 7ff59243c700 1 -- 172.21.15.96:0/145720215 shutdown_connections 2022-02-02T18:42:32.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 -- 172.21.15.96:0/145720215 wait complete. 2022-02-02T18:42:32.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 Processor -- start 2022-02-02T18:42:32.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 -- start start 2022-02-02T18:42:32.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c107980 con 0x7ff58c0f77d0 2022-02-02T18:42:32.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.360+0000 7ff59243c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c108100 con 0x7ff58c0f6530 2022-02-02T18:42:32.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55542/0 (socket says 172.21.15.96:55542) 2022-02-02T18:42:32.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 -- 172.21.15.96:0/3112458206 learned_addr learned my addr 172.21.15.96:0/3112458206 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:42:32.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff59143a700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 -- 172.21.15.96:0/3112458206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 msgr2=0x7ff58c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 -- 172.21.15.96:0/3112458206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c005040 con 0x7ff58c0f77d0 2022-02-02T18:42:32.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff59143a700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:42:32.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff590c39700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff57c009990 tx=0x7ff57c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:32.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57c018070 con 0x7ff58c0f77d0 2022-02-02T18:42:32.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff57c007ca0 con 0x7ff58c0f77d0 2022-02-02T18:42:32.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c108320 con 0x7ff58c0f77d0 2022-02-02T18:42:32.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57c01c620 con 0x7ff58c0f77d0 2022-02-02T18:42:32.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.361+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c108880 con 0x7ff58c0f77d0 2022-02-02T18:42:32.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.362+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c045ad0 con 0x7ff58c0f77d0 2022-02-02T18:42:32.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.363+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff57c01d960 con 0x7ff58c0f77d0 2022-02-02T18:42:32.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.363+0000 7ff581ffb700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 0x7ff5780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:42:32.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.363+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff57c083a10 con 0x7ff58c0f77d0 2022-02-02T18:42:32.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.364+0000 7ff59143a700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 0x7ff5780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:42:32.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.364+0000 7ff59143a700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 0x7ff5780672e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff58c106b70 tx=0x7ff588008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:42:32.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.367+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff57c051a00 con 0x7ff58c0f77d0 2022-02-02T18:42:32.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.570+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff58c027a00 con 0x7ff58c0f77d0 2022-02-02T18:42:32.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.571+0000 7ff581ffb700 1 -- 172.21.15.96:0/3112458206 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff57c055020 con 0x7ff58c0f77d0 2022-02-02T18:42:32.568 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:42:32.568 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:42:32.568 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:42:32.569 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:42:32.569 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:32.569 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:42:32.569 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:42:32.570 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:42:32.570 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:42:32.570 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:42:32.570 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:42:32.571 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:42:32.571 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:42:32.571 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:42:32.571 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:42:32.572 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:42:32.572 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:42:32.572 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:42:32.572 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:42:32.573 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:42:32.573 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:42:32.573 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:42:32.573 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:42:32.573 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:42:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:42:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:42:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:42:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:42:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:42:32.575 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:42:32.575 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:42:32.575 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:42:32.575 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:32.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:32.576 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:42:32.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:42:32.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:32.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:32.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:42:32.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 msgr2=0x7ff5780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 0x7ff5780672e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff58c106b70 tx=0x7ff588008040).stop 2022-02-02T18:42:32.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 msgr2=0x7ff58c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:42:32.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff57c009990 tx=0x7ff57c009b30).stop 2022-02-02T18:42:32.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 shutdown_connections 2022-02-02T18:42:32.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff578064e20 0x7ff5780672e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff58c0f6530 0x7ff58c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 --2- 172.21.15.96:0/3112458206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff58c0f77d0 0x7ff58c1072f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:42:32.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.572+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 >> 172.21.15.96:0/3112458206 conn(0x7ff58c0f1c90 msgr2=0x7ff58c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:42:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.573+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 shutdown_connections 2022-02-02T18:42:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:42:32.573+0000 7ff59243c700 1 -- 172.21.15.96:0/3112458206 wait complete. 2022-02-02T18:42:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:42:32.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: pgmap v612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3575680365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:32.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:32.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:32.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: pgmap v612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3575680365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:32.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:32.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:33.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:33 smithi096 ceph-mon[101353]: from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:33.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:33 smithi096 ceph-mon[101353]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:33.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:33 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:33.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:33 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:33.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3112458206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:42:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:33 smithi159 ceph-mon[69013]: from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:33 smithi159 ceph-mon[69013]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:42:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:33 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:33 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3112458206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:42:34.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:34 smithi159 ceph-mon[69013]: pgmap v613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:34 smithi096 ceph-mon[101353]: pgmap v613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:36 smithi159 ceph-mon[69013]: pgmap v614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:36 smithi096 ceph-mon[101353]: pgmap v614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:38 smithi159 ceph-mon[69013]: pgmap v615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:38 smithi096 ceph-mon[101353]: pgmap v615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:40 smithi159 ceph-mon[69013]: pgmap v616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:40 smithi096 ceph-mon[101353]: pgmap v616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:42.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:42 smithi159 ceph-mon[69013]: pgmap v617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:42.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:42.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:42 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:42 smithi096 ceph-mon[101353]: pgmap v617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:42 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:43.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:43.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:43.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:43.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:43.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:43.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:43.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:44 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:44 smithi159 ceph-mon[69013]: pgmap v618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:44 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:44 smithi096 ceph-mon[101353]: pgmap v618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:46 smithi159 ceph-mon[69013]: pgmap v619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:46 smithi096 ceph-mon[101353]: pgmap v619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:48 smithi159 ceph-mon[69013]: pgmap v620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:48 smithi096 ceph-mon[101353]: pgmap v620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:50.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:50 smithi159 ceph-mon[69013]: pgmap v621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:50 smithi096 ceph-mon[101353]: pgmap v621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:52 smithi159 ceph-mon[69013]: pgmap v622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:52 smithi096 ceph-mon[101353]: pgmap v622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:53.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:53.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:53.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:53 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:53.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:42:53.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:42:53.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:42:53.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:42:53.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:53.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:53 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:42:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:54 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:54 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:54 smithi159 ceph-mon[69013]: pgmap v623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:54 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:42:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:54 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:42:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:54 smithi096 ceph-mon[101353]: pgmap v623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:56 smithi159 ceph-mon[69013]: pgmap v624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:56 smithi096 ceph-mon[101353]: pgmap v624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:42:58 smithi159 ceph-mon[69013]: pgmap v625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:42:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:42:58 smithi096 ceph-mon[101353]: pgmap v625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:00 smithi159 ceph-mon[69013]: pgmap v626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:00.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:00 smithi096 ceph-mon[101353]: pgmap v626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:02.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- 172.21.15.96:0/717494945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 msgr2=0x7f4bfc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 --2- 172.21.15.96:0/717494945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f6b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f4be8004660 tx=0x7f4be8009b30).stop 2022-02-02T18:43:02.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- 172.21.15.96:0/717494945 shutdown_connections 2022-02-02T18:43:02.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 --2- 172.21.15.96:0/717494945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f6b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 --2- 172.21.15.96:0/717494945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 0x7f4bfc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- 172.21.15.96:0/717494945 >> 172.21.15.96:0/717494945 conn(0x7f4bfc0f0b90 msgr2=0x7f4bfc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:02.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- 172.21.15.96:0/717494945 shutdown_connections 2022-02-02T18:43:02.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- 172.21.15.96:0/717494945 wait complete. 2022-02-02T18:43:02.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 Processor -- start 2022-02-02T18:43:02.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.682+0000 7f4c0180e700 1 -- start start 2022-02-02T18:43:02.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4c0180e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 0x7f4bfc0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4c0180e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4c0180e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc0f7f70 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4c0180e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc0f80b0 con 0x7f4bfc0f5430 2022-02-02T18:43:02.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55562/0 (socket says 172.21.15.96:55562) 2022-02-02T18:43:02.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4c0080c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 0x7f4bfc0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 -- 172.21.15.96:0/1243010791 learned_addr learned my addr 172.21.15.96:0/1243010791 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 -- 172.21.15.96:0/1243010791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 msgr2=0x7f4bfc0f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 0x7f4bfc0f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.683+0000 7f4bfbfff700 1 -- 172.21.15.96:0/1243010791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8005040 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4bfbfff700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f4be8009990 tx=0x7f4be8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be8018070 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4be8007ba0 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be801c3c0 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc0f8330 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.684+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc0f8890 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.685+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc045ad0 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.685+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4be801d420 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.686+0000 7f4bf97fa700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 0x7f4bec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.686+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4be8083630 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.686+0000 7f4c0080c700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 0x7f4bec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.686+0000 7f4c0080c700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 0x7f4bec0672e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4bfc0f9320 tx=0x7f4bf000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:02.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.690+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4be8051680 con 0x7f4bfc0f66d0 2022-02-02T18:43:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:02 smithi159 ceph-mon[69013]: pgmap v627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:02 smithi096 ceph-mon[101353]: pgmap v627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:02.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.869+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bfc0fab10 con 0x7f4bec064e20 2022-02-02T18:43:02.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.871+0000 7f4bf97fa700 1 -- 172.21.15.96:0/1243010791 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4bfc0fab10 con 0x7f4bec064e20 2022-02-02T18:43:02.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 msgr2=0x7f4bec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 0x7f4bec0672e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4bfc0f9320 tx=0x7f4bf000b040).stop 2022-02-02T18:43:02.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 msgr2=0x7f4bfc0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f4be8009990 tx=0x7f4be8009b30).stop 2022-02-02T18:43:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 shutdown_connections 2022-02-02T18:43:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bec064e20 0x7f4bec0672e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.872+0000 7f4c0180e700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f5430 0x7f4bfc0f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.873+0000 7f4c0180e700 1 --2- 172.21.15.96:0/1243010791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f66d0 0x7f4bfc0f7a10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.873+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 >> 172.21.15.96:0/1243010791 conn(0x7f4bfc0f0b90 msgr2=0x7f4bfc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:02.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.873+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 shutdown_connections 2022-02-02T18:43:02.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.873+0000 7f4c0180e700 1 -- 172.21.15.96:0/1243010791 wait complete. 2022-02-02T18:43:02.880 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:43:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 -- 172.21.15.96:0/2585273420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 msgr2=0x7ffad80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/2585273420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad80f7de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7ffac8004660 tx=0x7ffac8009b30).stop 2022-02-02T18:43:02.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 -- 172.21.15.96:0/2585273420 shutdown_connections 2022-02-02T18:43:02.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/2585273420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad80f7de0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/2585273420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 -- 172.21.15.96:0/2585273420 >> 172.21.15.96:0/2585273420 conn(0x7ffad80f1e40 msgr2=0x7ffad80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 -- 172.21.15.96:0/2585273420 shutdown_connections 2022-02-02T18:43:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 -- 172.21.15.96:0/2585273420 wait complete. 2022-02-02T18:43:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.972+0000 7ffadcfc4700 1 Processor -- start 2022-02-02T18:43:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 -- start start 2022-02-02T18:43:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8107a00 con 0x7ffad80f7980 2022-02-02T18:43:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8107b40 con 0x7ffad80f66e0 2022-02-02T18:43:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55570/0 (socket says 172.21.15.96:55570) 2022-02-02T18:43:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 -- 172.21.15.96:0/4182704423 learned_addr learned my addr 172.21.15.96:0/4182704423 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad659c700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 -- 172.21.15.96:0/4182704423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 msgr2=0x7ffad8106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad8106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 -- 172.21.15.96:0/4182704423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8005040 con 0x7ffad80f7980 2022-02-02T18:43:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad659c700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:43:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffad5d9b700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ffac8009990 tx=0x7ffac8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac8018070 con 0x7ffad80f7980 2022-02-02T18:43:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffac8007ba0 con 0x7ffad80f7980 2022-02-02T18:43:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac801c3c0 con 0x7ffad80f7980 2022-02-02T18:43:02.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.973+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad8108480 con 0x7ffad80f7980 2022-02-02T18:43:02.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.974+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad81089e0 con 0x7ffad80f7980 2022-02-02T18:43:02.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.974+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad8045ad0 con 0x7ffad80f7980 2022-02-02T18:43:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.975+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffac801d420 con 0x7ffad80f7980 2022-02-02T18:43:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.975+0000 7ffac6ffd700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 0x7ffac0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.975+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffac80836d0 con 0x7ffad80f7980 2022-02-02T18:43:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.975+0000 7ffad659c700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 0x7ffac0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.976+0000 7ffad659c700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 0x7ffac0067290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ffad80f77e0 tx=0x7ffacc009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:02.979+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffac8055150 con 0x7ffad80f7980 2022-02-02T18:43:03.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.154+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffad8108c50 con 0x7ffac0064dd0 2022-02-02T18:43:03.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.164+0000 7ffac6ffd700 1 -- 172.21.15.96:0/4182704423 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ffad8108c50 con 0x7ffac0064dd0 2022-02-02T18:43:03.165 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:43:03.165 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (26m) 7m ago 27m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:43:03.165 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (18m) 7m ago 27m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:43:03.165 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (18m) 5m ago 26m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:43:03.166 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (26m) 7m ago 27m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:43:03.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (23m) 7m ago 23m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:43:03.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (19m) 7m ago 23m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:43:03.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (23m) 5m ago 23m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:43:03.167 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (19m) 5m ago 23m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:43:03.167 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (20m) 7m ago 28m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:43:03.167 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (20m) 5m ago 26m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:43:03.167 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (19m) 7m ago 28m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:43:03.168 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (19m) 5m ago 26m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:43:03.168 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (27m) 7m ago 27m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:43:03.168 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (26m) 5m ago 26m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:43:03.168 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (18m) 7m ago 26m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:43:03.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (17m) 7m ago 26m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:43:03.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (17m) 7m ago 25m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:43:03.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (16m) 5m ago 25m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:43:03.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (16m) 5m ago 25m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:43:03.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (15m) 5m ago 24m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:43:03.170 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (26m) 7m ago 27m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:43:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.165+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 msgr2=0x7ffac0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.165+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 0x7ffac0067290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ffad80f77e0 tx=0x7ffacc009c00).stop 2022-02-02T18:43:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.165+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 msgr2=0x7ffad8107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.165+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ffac8009990 tx=0x7ffac8009b30).stop 2022-02-02T18:43:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.165+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 shutdown_connections 2022-02-02T18:43:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffac0064dd0 0x7ffac0067290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad80f66e0 0x7ffad8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 --2- 172.21.15.96:0/4182704423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffad80f7980 0x7ffad8107450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 >> 172.21.15.96:0/4182704423 conn(0x7ffad80f1e40 msgr2=0x7ffad80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 shutdown_connections 2022-02-02T18:43:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.166+0000 7ffadcfc4700 1 -- 172.21.15.96:0/4182704423 wait complete. 2022-02-02T18:43:03.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 -- 172.21.15.96:0/3145760767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f7d00 msgr2=0x7f1fec0f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 --2- 172.21.15.96:0/3145760767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f7d00 0x7f1fec0f8120 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f1fe0004660 tx=0x7f1fe0009b30).stop 2022-02-02T18:43:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 -- 172.21.15.96:0/3145760767 shutdown_connections 2022-02-02T18:43:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 --2- 172.21.15.96:0/3145760767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f8610 0x7f1fec0f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 --2- 172.21.15.96:0/3145760767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f7d00 0x7f1fec0f8120 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 -- 172.21.15.96:0/3145760767 >> 172.21.15.96:0/3145760767 conn(0x7f1fec0f0540 msgr2=0x7f1fec0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:03.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 -- 172.21.15.96:0/3145760767 shutdown_connections 2022-02-02T18:43:03.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.265+0000 7f1ff1549700 1 -- 172.21.15.96:0/3145760767 wait complete. 2022-02-02T18:43:03.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 Processor -- start 2022-02-02T18:43:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 -- start start 2022-02-02T18:43:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f7d00 0x7f1fec106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec107970 con 0x7f1fec0f8610 2022-02-02T18:43:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1ff1549700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec107ab0 con 0x7f1fec0f7d00 2022-02-02T18:43:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1fea7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1fea7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55580/0 (socket says 172.21.15.96:55580) 2022-02-02T18:43:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1fea7fc700 1 -- 172.21.15.96:0/1354447761 learned_addr learned my addr 172.21.15.96:0/1354447761 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.266+0000 7f1feaffd700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f7d00 0x7f1fec106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fea7fc700 1 -- 172.21.15.96:0/1354447761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f7d00 msgr2=0x7f1fec106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fea7fc700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f7d00 0x7f1fec106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fea7fc700 1 -- 172.21.15.96:0/1354447761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0005040 con 0x7f1fec0f8610 2022-02-02T18:43:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fea7fc700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1fdc002700 tx=0x7f1fdc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:03.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fdc009320 con 0x7f1fec0f8610 2022-02-02T18:43:03.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec108450 con 0x7f1fec0f8610 2022-02-02T18:43:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec108a10 con 0x7f1fec0f8610 2022-02-02T18:43:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fdc00f040 con 0x7f1fec0f8610 2022-02-02T18:43:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.267+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fdc0146a0 con 0x7f1fec0f8610 2022-02-02T18:43:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.268+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc004fa0 con 0x7f1fec0f8610 2022-02-02T18:43:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.268+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1fdc014800 con 0x7f1fec0f8610 2022-02-02T18:43:03.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.268+0000 7f1fd37fe700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 0x7f1fd4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.269+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1fdc0819e0 con 0x7f1fec0f8610 2022-02-02T18:43:03.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.269+0000 7f1feaffd700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 0x7f1fd4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:03.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.269+0000 7f1feaffd700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 0x7f1fd4067290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1fe0004630 tx=0x7f1fe0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:03.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.273+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1fdc0534c0 con 0x7f1fec0f8610 2022-02-02T18:43:03.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.499+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1fcc005e80 con 0x7f1fec0f8610 2022-02-02T18:43:03.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.499+0000 7f1fd37fe700 1 -- 172.21.15.96:0/1354447761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1fdc0530b0 con 0x7f1fec0f8610 2022-02-02T18:43:03.498 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:43:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:43:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:43:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:43:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:43:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:43:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:43:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:43:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:43:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:43:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:43:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:43:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:43:03.502 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:43:03.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 msgr2=0x7f1fd4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 0x7f1fd4067290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1fe0004630 tx=0x7f1fe0009b30).stop 2022-02-02T18:43:03.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 msgr2=0x7f1fec1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1fdc002700 tx=0x7f1fdc009e00).stop 2022-02-02T18:43:03.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 shutdown_connections 2022-02-02T18:43:03.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fd4064dd0 0x7f1fd4067290 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fec0f7d00 0x7f1fec106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 --2- 172.21.15.96:0/1354447761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fec0f8610 0x7f1fec1073c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 >> 172.21.15.96:0/1354447761 conn(0x7f1fec0f0540 msgr2=0x7f1fec0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:03.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.501+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 shutdown_connections 2022-02-02T18:43:03.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.502+0000 7f1ff1549700 1 -- 172.21.15.96:0/1354447761 wait complete. 2022-02-02T18:43:03.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 -- 172.21.15.96:0/1298969976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 msgr2=0x7f14c00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 --2- 172.21.15.96:0/1298969976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c00f59e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f14b0004660 tx=0x7f14b0009b30).stop 2022-02-02T18:43:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 -- 172.21.15.96:0/1298969976 shutdown_connections 2022-02-02T18:43:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 --2- 172.21.15.96:0/1298969976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c00f6860 0x7f14c00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 --2- 172.21.15.96:0/1298969976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c00f59e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 -- 172.21.15.96:0/1298969976 >> 172.21.15.96:0/1298969976 conn(0x7f14c00f0d40 msgr2=0x7f14c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 -- 172.21.15.96:0/1298969976 shutdown_connections 2022-02-02T18:43:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.599+0000 7f14c7e36700 1 -- 172.21.15.96:0/1298969976 wait complete. 2022-02-02T18:43:03.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 Processor -- start 2022-02-02T18:43:03.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 -- start start 2022-02-02T18:43:03.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c00f6860 0x7f14c01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01069a0 con 0x7f14c00f55c0 2022-02-02T18:43:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c7e36700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01071b0 con 0x7f14c00f6860 2022-02-02T18:43:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55588/0 (socket says 172.21.15.96:55588) 2022-02-02T18:43:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 -- 172.21.15.96:0/3610137680 learned_addr learned my addr 172.21.15.96:0/3610137680 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 -- 172.21.15.96:0/3610137680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c00f6860 msgr2=0x7f14c01063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c00f6860 0x7f14c01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:43:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.600+0000 7f14c5bd2700 1 -- 172.21.15.96:0/3610137680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0005040 con 0x7f14c00f55c0 2022-02-02T18:43:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14c5bd2700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f14b0004570 tx=0x7f14b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b001a070 con 0x7f14c00f55c0 2022-02-02T18:43:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f14b0009630 con 0x7f14c00f55c0 2022-02-02T18:43:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b001f8d0 con 0x7f14c00f55c0 2022-02-02T18:43:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c01073d0 con 0x7f14c00f55c0 2022-02-02T18:43:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.601+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c0107930 con 0x7f14c00f55c0 2022-02-02T18:43:03.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.602+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c00f49b0 con 0x7f14c00f55c0 2022-02-02T18:43:03.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.602+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f14b00125d0 con 0x7f14c00f55c0 2022-02-02T18:43:03.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.603+0000 7f14b67fc700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 0x7f14ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:03.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.603+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f14b0085cf0 con 0x7f14c00f55c0 2022-02-02T18:43:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.603+0000 7f14c53d1700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 0x7f14ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.603+0000 7f14c53d1700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 0x7f14ac067290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f14bc004a10 tx=0x7f14bc0099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.607+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f14b0053da0 con 0x7f14c00f55c0 2022-02-02T18:43:03.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:03.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1354447761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:03.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:03.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:03.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:03.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:03.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1354447761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:03.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.806+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14c00ff790 con 0x7f14c00f55c0 2022-02-02T18:43:03.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.806+0000 7f14b67fc700 1 -- 172.21.15.96:0/3610137680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f14b00573c0 con 0x7f14c00f55c0 2022-02-02T18:43:03.805 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:43:03.806 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:43:03.806 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:43:03.806 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:43:03.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:03.807 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:43:03.807 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:43:03.807 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:43:03.807 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:43:03.807 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:43:03.808 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:43:03.808 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:43:03.808 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:43:03.808 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:43:03.809 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:43:03.809 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:43:03.809 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:43:03.809 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:43:03.809 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:43:03.810 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:43:03.810 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:43:03.810 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:43:03.810 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:43:03.811 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:43:03.811 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:43:03.811 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:43:03.811 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:43:03.811 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:43:03.812 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:43:03.812 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:43:03.812 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:43:03.812 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:43:03.812 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:03.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:03.813 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:43:03.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:03.813 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:03.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:03.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:03.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 msgr2=0x7f14ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 0x7f14ac067290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f14bc004a10 tx=0x7f14bc0099e0).stop 2022-02-02T18:43:03.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 msgr2=0x7f14c0105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:03.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f14b0004570 tx=0x7f14b0009b30).stop 2022-02-02T18:43:03.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 shutdown_connections 2022-02-02T18:43:03.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14ac064dd0 0x7f14ac067290 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14c00f55c0 0x7f14c0105eb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:03.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 --2- 172.21.15.96:0/3610137680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c00f6860 0x7f14c01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:43:03.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 >> 172.21.15.96:0/3610137680 conn(0x7f14c00f0d40 msgr2=0x7f14c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:03.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 shutdown_connections 2022-02-02T18:43:03.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:03.808+0000 7f14c7e36700 1 -- 172.21.15.96:0/3610137680 wait complete. 2022-02-02T18:43:03.817 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:43:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: pgmap v628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3610137680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:43:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: pgmap v628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3610137680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:43:06.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:06 smithi159 ceph-mon[69013]: pgmap v629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:06 smithi096 ceph-mon[101353]: pgmap v629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:08 smithi159 ceph-mon[69013]: pgmap v630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:08 smithi096 ceph-mon[101353]: pgmap v630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:10.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:10 smithi159 ceph-mon[69013]: pgmap v631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:10.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:10 smithi096 ceph-mon[101353]: pgmap v631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:12 smithi096 ceph-mon[101353]: pgmap v632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:13.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:12 smithi159 ceph-mon[69013]: pgmap v632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:13.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:13.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:13 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:13.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:13.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:13.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:13.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:13.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:13.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:13 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:14 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:14 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:14 smithi096 ceph-mon[101353]: pgmap v633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:14 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:14 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:14 smithi159 ceph-mon[69013]: pgmap v633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:16.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:16 smithi096 ceph-mon[101353]: pgmap v634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:16 smithi159 ceph-mon[69013]: pgmap v634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:18 smithi096 ceph-mon[101353]: pgmap v635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:18 smithi159 ceph-mon[69013]: pgmap v635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:20.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:20 smithi096 ceph-mon[101353]: pgmap v636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:20 smithi159 ceph-mon[69013]: pgmap v636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:22 smithi096 ceph-mon[101353]: pgmap v637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:23.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:22 smithi159 ceph-mon[69013]: pgmap v637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:23.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:23 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:23.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:23.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:23.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:23.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:23.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:23.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:23 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:24.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:24 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:24 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:24 smithi096 ceph-mon[101353]: pgmap v638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:24 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:24 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:25.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:24 smithi159 ceph-mon[69013]: pgmap v638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:26.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:26 smithi096 ceph-mon[101353]: pgmap v639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:26 smithi159 ceph-mon[69013]: pgmap v639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:43:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:43:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:43:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:43:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:28 smithi159 ceph-mon[69013]: pgmap v640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:28 smithi096 ceph-mon[101353]: pgmap v640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:31.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:30 smithi159 ceph-mon[69013]: pgmap v641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:31.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:30 smithi096 ceph-mon[101353]: pgmap v641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:32 smithi159 ceph-mon[69013]: pgmap v642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:32 smithi096 ceph-mon[101353]: pgmap v642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:33.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:33.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:33.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:33 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.917 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:33.917 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:33.918 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:33.918 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:33.918 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:33.919 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.919 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.919 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.920 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:33 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 -- 172.21.15.96:0/2310759901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 msgr2=0x7f60340f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 --2- 172.21.15.96:0/2310759901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60340f7de0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f6030004660 tx=0x7f6030009b30).stop 2022-02-02T18:43:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 -- 172.21.15.96:0/2310759901 shutdown_connections 2022-02-02T18:43:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 --2- 172.21.15.96:0/2310759901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60340f7de0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 --2- 172.21.15.96:0/2310759901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f60340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:43:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 -- 172.21.15.96:0/2310759901 >> 172.21.15.96:0/2310759901 conn(0x7f60340f1e40 msgr2=0x7f60340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:33.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 -- 172.21.15.96:0/2310759901 shutdown_connections 2022-02-02T18:43:33.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.919+0000 7f603c69a700 1 -- 172.21.15.96:0/2310759901 wait complete. 2022-02-02T18:43:33.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 Processor -- start 2022-02-02T18:43:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 -- start start 2022-02-02T18:43:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f603406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603406a410 con 0x7f60340f7980 2022-02-02T18:43:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f603c69a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603406a550 con 0x7f60340f66e0 2022-02-02T18:43:33.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.920+0000 7f6039c35700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:33.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55610/0 (socket says 172.21.15.96:55610) 2022-02-02T18:43:33.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 -- 172.21.15.96:0/2526274544 learned_addr learned my addr 172.21.15.96:0/2526274544 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:33.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f603a436700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f603406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:33.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 -- 172.21.15.96:0/2526274544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 msgr2=0x7f603406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:33.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f603406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:33.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 -- 172.21.15.96:0/2526274544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030005040 con 0x7f60340f7980 2022-02-02T18:43:33.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f6039c35700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f6030009990 tx=0x7f6030009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6030018070 con 0x7f60340f7980 2022-02-02T18:43:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603406a7d0 con 0x7f60340f7980 2022-02-02T18:43:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6030007ba0 con 0x7f60340f7980 2022-02-02T18:43:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f603001c620 con 0x7f60340f7980 2022-02-02T18:43:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.921+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603410efe0 con 0x7f60340f7980 2022-02-02T18:43:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.922+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034045ad0 con 0x7f60340f7980 2022-02-02T18:43:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.923+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f603001c8e0 con 0x7f60340f7980 2022-02-02T18:43:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.924+0000 7f602affd700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 0x7f6020067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.924+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6030083b40 con 0x7f60340f7980 2022-02-02T18:43:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.924+0000 7f603a436700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 0x7f6020067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.924+0000 7f603a436700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 0x7f6020067290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f603406b730 tx=0x7f6024008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:33.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:33.928+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6030051bf0 con 0x7f60340f7980 2022-02-02T18:43:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.107+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6034057f10 con 0x7f6020064dd0 2022-02-02T18:43:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.108+0000 7f602affd700 1 -- 172.21.15.96:0/2526274544 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6034057f10 con 0x7f6020064dd0 2022-02-02T18:43:34.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 msgr2=0x7f6020067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 0x7f6020067290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f603406b730 tx=0x7f6024008040).stop 2022-02-02T18:43:34.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 msgr2=0x7f6034069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f6030009990 tx=0x7f6030009b30).stop 2022-02-02T18:43:34.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 shutdown_connections 2022-02-02T18:43:34.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6020064dd0 0x7f6020067290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f603406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 --2- 172.21.15.96:0/2526274544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f6034069e20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 >> 172.21.15.96:0/2526274544 conn(0x7f60340f1e40 msgr2=0x7f60340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 shutdown_connections 2022-02-02T18:43:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.110+0000 7f603c69a700 1 -- 172.21.15.96:0/2526274544 wait complete. 2022-02-02T18:43:34.117 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:43:34.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 -- 172.21.15.96:0/1186941318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 msgr2=0x7face80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 --2- 172.21.15.96:0/1186941318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face80f7c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7facd8004660 tx=0x7facd8009b30).stop 2022-02-02T18:43:34.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 -- 172.21.15.96:0/1186941318 shutdown_connections 2022-02-02T18:43:34.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 --2- 172.21.15.96:0/1186941318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face80f7c30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 --2- 172.21.15.96:0/1186941318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 0x7face80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 -- 172.21.15.96:0/1186941318 >> 172.21.15.96:0/1186941318 conn(0x7face80f1c90 msgr2=0x7face80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 -- 172.21.15.96:0/1186941318 shutdown_connections 2022-02-02T18:43:34.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.207+0000 7face759e700 1 -- 172.21.15.96:0/1186941318 wait complete. 2022-02-02T18:43:34.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 Processor -- start 2022-02-02T18:43:34.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 -- start start 2022-02-02T18:43:34.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 0x7face8106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81077f0 con 0x7face80f77d0 2022-02-02T18:43:34.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.208+0000 7face759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8107ff0 con 0x7face80f6530 2022-02-02T18:43:34.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55618/0 (socket says 172.21.15.96:55618) 2022-02-02T18:43:34.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 -- 172.21.15.96:0/3130889799 learned_addr learned my addr 172.21.15.96:0/3130889799 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:34.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face659c700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 0x7face8106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 -- 172.21.15.96:0/3130889799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 msgr2=0x7face8106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 0x7face8106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 -- 172.21.15.96:0/3130889799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8005040 con 0x7face80f77d0 2022-02-02T18:43:34.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face5d9b700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7facd8009990 tx=0x7facd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd8018070 con 0x7face80f77d0 2022-02-02T18:43:34.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7facd8007ba0 con 0x7face80f77d0 2022-02-02T18:43:34.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face8108270 con 0x7face80f77d0 2022-02-02T18:43:34.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd801c620 con 0x7face80f77d0 2022-02-02T18:43:34.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.209+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face81087d0 con 0x7face80f77d0 2022-02-02T18:43:34.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.210+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8059100 con 0x7face80f77d0 2022-02-02T18:43:34.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.211+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7facd801c8e0 con 0x7face80f77d0 2022-02-02T18:43:34.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.211+0000 7facd6ffd700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 0x7facd00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.211+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7facd80838a0 con 0x7face80f77d0 2022-02-02T18:43:34.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.211+0000 7face659c700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 0x7facd00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.212+0000 7face659c700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 0x7facd00672e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7face80f7630 tx=0x7facdc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.216+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7facd8055380 con 0x7face80f77d0 2022-02-02T18:43:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.389+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7face80fecf0 con 0x7facd0064e20 2022-02-02T18:43:34.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.399+0000 7facd6ffd700 1 -- 172.21.15.96:0/3130889799 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7face80fecf0 con 0x7facd0064e20 2022-02-02T18:43:34.397 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:43:34.399 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (26m) 7m ago 28m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:43:34.399 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (19m) 7m ago 27m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:43:34.399 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (19m) 6m ago 27m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:43:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (26m) 7m ago 27m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:43:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (24m) 7m ago 24m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:43:34.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (19m) 7m ago 24m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:43:34.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (24m) 6m ago 24m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:43:34.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (19m) 6m ago 24m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:43:34.402 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (21m) 7m ago 29m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:43:34.402 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (20m) 6m ago 27m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:43:34.403 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (20m) 7m ago 29m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:43:34.403 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (19m) 6m ago 27m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:43:34.403 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (27m) 7m ago 27m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:43:34.404 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (27m) 6m ago 27m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:43:34.405 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (19m) 7m ago 26m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:43:34.405 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (18m) 7m ago 26m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:43:34.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (17m) 7m ago 26m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:43:34.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (17m) 6m ago 25m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:43:34.407 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (16m) 6m ago 25m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:43:34.407 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (16m) 6m ago 25m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:43:34.407 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (26m) 7m ago 27m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:43:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 msgr2=0x7facd00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 0x7facd00672e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7face80f7630 tx=0x7facdc009040).stop 2022-02-02T18:43:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 msgr2=0x7face8107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7facd8009990 tx=0x7facd8009b30).stop 2022-02-02T18:43:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 shutdown_connections 2022-02-02T18:43:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facd0064e20 0x7facd00672e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face80f6530 0x7face8106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 --2- 172.21.15.96:0/3130889799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7face80f77d0 0x7face8107240 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.400+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 >> 172.21.15.96:0/3130889799 conn(0x7face80f1c90 msgr2=0x7face80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.401+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 shutdown_connections 2022-02-02T18:43:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.401+0000 7face759e700 1 -- 172.21.15.96:0/3130889799 wait complete. 2022-02-02T18:43:34.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 -- 172.21.15.96:0/1469223436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f5430 msgr2=0x7fa85c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 --2- 172.21.15.96:0/1469223436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f5430 0x7fa85c0f5850 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fa84c004660 tx=0x7fa84c009b30).stop 2022-02-02T18:43:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 -- 172.21.15.96:0/1469223436 shutdown_connections 2022-02-02T18:43:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 --2- 172.21.15.96:0/1469223436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f66d0 0x7fa85c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:43:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 --2- 172.21.15.96:0/1469223436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f5430 0x7fa85c0f5850 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 -- 172.21.15.96:0/1469223436 >> 172.21.15.96:0/1469223436 conn(0x7fa85c0f0b90 msgr2=0x7fa85c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 -- 172.21.15.96:0/1469223436 shutdown_connections 2022-02-02T18:43:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.497+0000 7fa862bda700 1 -- 172.21.15.96:0/1469223436 wait complete. 2022-02-02T18:43:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 Processor -- start 2022-02-02T18:43:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 -- start start 2022-02-02T18:43:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f5430 0x7fa85c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c109af0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa862bda700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c10a3a0 con 0x7fa85c0f5430 2022-02-02T18:43:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa8613d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa8613d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55628/0 (socket says 172.21.15.96:55628) 2022-02-02T18:43:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa8613d7700 1 -- 172.21.15.96:0/2597386749 learned_addr learned my addr 172.21.15.96:0/2597386749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.498+0000 7fa861bd8700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f5430 0x7fa85c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8613d7700 1 -- 172.21.15.96:0/2597386749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f5430 msgr2=0x7fa85c108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8613d7700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f5430 0x7fa85c108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8613d7700 1 -- 172.21.15.96:0/2597386749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c005040 con 0x7fa85c0f66d0 2022-02-02T18:43:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8613d7700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa85800b410 tx=0x7fa858006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8580125f0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c10a680 con 0x7fa85c0f66d0 2022-02-02T18:43:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa85800be30 con 0x7fa85c0f66d0 2022-02-02T18:43:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa858002a70 con 0x7fa85c0f66d0 2022-02-02T18:43:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.499+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c10ac40 con 0x7fa85c0f66d0 2022-02-02T18:43:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.500+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c059100 con 0x7fa85c0f66d0 2022-02-02T18:43:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.501+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa85800f030 con 0x7fa85c0f66d0 2022-02-02T18:43:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.501+0000 7fa8527fc700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 0x7fa8480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.501+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa858081ed0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.501+0000 7fa861bd8700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 0x7fa8480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.501+0000 7fa861bd8700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 0x7fa8480672e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa84c004630 tx=0x7fa84c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.505+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8580539b0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.737+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa85c10f5e0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.738+0000 7fa8527fc700 1 -- 172.21.15.96:0/2597386749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa8580535a0 con 0x7fa85c0f66d0 2022-02-02T18:43:34.736 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:43:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:43:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:43:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:43:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:43:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:43:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:43:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:43:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:43:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:43:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:43:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:43:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:43:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:43:34.741 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:43:34.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.739+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 msgr2=0x7fa8480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.739+0000 7fa862bda700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 0x7fa8480672e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa84c004630 tx=0x7fa84c009b30).stop 2022-02-02T18:43:34.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.739+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 msgr2=0x7fa85c1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.739+0000 7fa862bda700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa85800b410 tx=0x7fa858006ef0).stop 2022-02-02T18:43:34.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 shutdown_connections 2022-02-02T18:43:34.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064e20 0x7fa8480672e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f5430 0x7fa85c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 --2- 172.21.15.96:0/2597386749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f66d0 0x7fa85c1094b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 >> 172.21.15.96:0/2597386749 conn(0x7fa85c0f0b90 msgr2=0x7fa85c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 shutdown_connections 2022-02-02T18:43:34.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.740+0000 7fa862bda700 1 -- 172.21.15.96:0/2597386749 wait complete. 2022-02-02T18:43:34.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:34 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:34 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:34 smithi096 ceph-mon[101353]: pgmap v643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:34.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 -- 172.21.15.96:0/3966163765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f77d0 msgr2=0x7fe80c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3966163765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f77d0 0x7fe80c0f7c30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fe7fc004660 tx=0x7fe7fc009b30).stop 2022-02-02T18:43:34.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 -- 172.21.15.96:0/3966163765 shutdown_connections 2022-02-02T18:43:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3966163765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f77d0 0x7fe80c0f7c30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3966163765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f6530 0x7fe80c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 -- 172.21.15.96:0/3966163765 >> 172.21.15.96:0/3966163765 conn(0x7fe80c0f1c90 msgr2=0x7fe80c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 -- 172.21.15.96:0/3966163765 shutdown_connections 2022-02-02T18:43:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.837+0000 7fe80b59e700 1 -- 172.21.15.96:0/3966163765 wait complete. 2022-02-02T18:43:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 Processor -- start 2022-02-02T18:43:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 -- start start 2022-02-02T18:43:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 0x7fe80c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c107880 con 0x7fe80c0f6530 2022-02-02T18:43:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c108090 con 0x7fe80c0f77d0 2022-02-02T18:43:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55636/0 (socket says 172.21.15.96:55636) 2022-02-02T18:43:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80a59c700 1 -- 172.21.15.96:0/3143544951 learned_addr learned my addr 172.21.15.96:0/3143544951 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:43:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe809d9b700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 0x7fe80c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.838+0000 7fe80a59c700 1 -- 172.21.15.96:0/3143544951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 msgr2=0x7fe80c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:34.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe80a59c700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 0x7fe80c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:34.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe80a59c700 1 -- 172.21.15.96:0/3143544951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc005040 con 0x7fe80c0f6530 2022-02-02T18:43:34.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe809d9b700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 0x7fe80c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:43:34.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe80a59c700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fe7f400c530 tx=0x7fe7f4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f400f650 con 0x7fe80c0f6530 2022-02-02T18:43:34.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7f400fc60 con 0x7fe80c0f6530 2022-02-02T18:43:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c108310 con 0x7fe80c0f6530 2022-02-02T18:43:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f4012d20 con 0x7fe80c0f6530 2022-02-02T18:43:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.839+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c1088d0 con 0x7fe80c0f6530 2022-02-02T18:43:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.840+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c059100 con 0x7fe80c0f6530 2022-02-02T18:43:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.840+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7f4019030 con 0x7fe80c0f6530 2022-02-02T18:43:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.841+0000 7fe802ffd700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 0x7fe7f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:43:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.841+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe7f4081700 con 0x7fe80c0f6530 2022-02-02T18:43:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.841+0000 7fe809d9b700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 0x7fe7f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:43:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.841+0000 7fe809d9b700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 0x7fe7f80672e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe7fc004e30 tx=0x7fe7fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:43:34.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:34.845+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7f40487d0 con 0x7fe80c0f6530 2022-02-02T18:43:35.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:34 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:35.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:34 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:35.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:34 smithi159 ceph-mon[69013]: pgmap v643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:35.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.044+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe80c045ad0 con 0x7fe80c0f6530 2022-02-02T18:43:35.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.044+0000 7fe802ffd700 1 -- 172.21.15.96:0/3143544951 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe7f404f8c0 con 0x7fe80c0f6530 2022-02-02T18:43:35.042 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:43:35.042 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:43:35.042 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:43:35.043 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:43:35.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:35.043 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:43:35.043 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:43:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:43:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:43:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:43:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:43:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:43:35.045 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:43:35.045 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:43:35.045 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:43:35.045 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:43:35.046 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:43:35.046 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:43:35.046 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:43:35.046 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:43:35.046 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:43:35.047 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:43:35.047 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:43:35.047 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:43:35.047 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:43:35.048 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:43:35.048 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:43:35.048 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:43:35.048 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:43:35.048 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:43:35.049 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:43:35.049 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:43:35.049 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:35.050 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:35.050 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:43:35.050 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:43:35.051 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:35.051 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:35.051 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:43:35.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 msgr2=0x7fe7f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:35.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 0x7fe7f80672e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe7fc004e30 tx=0x7fe7fc009b30).stop 2022-02-02T18:43:35.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 msgr2=0x7fe80c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:43:35.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fe7f400c530 tx=0x7fe7f4007e10).stop 2022-02-02T18:43:35.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 shutdown_connections 2022-02-02T18:43:35.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7f8064e20 0x7fe7f80672e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:35.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe80c0f6530 0x7fe80c106d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:35.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 --2- 172.21.15.96:0/3143544951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80c0f77d0 0x7fe80c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:43:35.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 >> 172.21.15.96:0/3143544951 conn(0x7fe80c0f1c90 msgr2=0x7fe80c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:43:35.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 shutdown_connections 2022-02-02T18:43:35.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:43:35.046+0000 7fe80b59e700 1 -- 172.21.15.96:0/3143544951 wait complete. 2022-02-02T18:43:35.055 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:43:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:35 smithi159 ceph-mon[69013]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:35 smithi159 ceph-mon[69013]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2597386749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3143544951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:43:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:35 smithi096 ceph-mon[101353]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:35 smithi096 ceph-mon[101353]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:43:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2597386749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:36.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3143544951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:43:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:36 smithi159 ceph-mon[69013]: pgmap v644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:36 smithi096 ceph-mon[101353]: pgmap v644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:38.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:37 smithi159 ceph-mon[69013]: pgmap v645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:38.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:37 smithi096 ceph-mon[101353]: pgmap v645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:40.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:40 smithi159 ceph-mon[69013]: pgmap v646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:40 smithi096 ceph-mon[101353]: pgmap v646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:42.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:42 smithi159 ceph-mon[69013]: pgmap v647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:42 smithi096 ceph-mon[101353]: pgmap v647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:43.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:43 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:43.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:43.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:43.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:43 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: pgmap v648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:43:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:43:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:44 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: pgmap v648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:43:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:43:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:44.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:44 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:46 smithi159 ceph-mon[69013]: pgmap v649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:46 smithi096 ceph-mon[101353]: pgmap v649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:48 smithi159 ceph-mon[69013]: pgmap v650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:48 smithi096 ceph-mon[101353]: pgmap v650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:50.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:50 smithi159 ceph-mon[69013]: pgmap v651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:50.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:50 smithi096 ceph-mon[101353]: pgmap v651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:52 smithi159 ceph-mon[69013]: pgmap v652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:52 smithi096 ceph-mon[101353]: pgmap v652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: pgmap v653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:54 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: pgmap v653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:43:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:43:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:43:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:43:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:43:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:43:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:54 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:43:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:56 smithi159 ceph-mon[69013]: pgmap v654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:56 smithi096 ceph-mon[101353]: pgmap v654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:43:58 smithi159 ceph-mon[69013]: pgmap v655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:43:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:43:58 smithi096 ceph-mon[101353]: pgmap v655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:00 smithi159 ceph-mon[69013]: pgmap v656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:00.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:00 smithi096 ceph-mon[101353]: pgmap v656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:02 smithi159 ceph-mon[69013]: pgmap v657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:02.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:02 smithi096 ceph-mon[101353]: pgmap v657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: pgmap v658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:04 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: pgmap v658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:04 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/498350918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 msgr2=0x7f3f480f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/498350918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f480f6920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3f38004660 tx=0x7f3f38009b30).stop 2022-02-02T18:44:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/498350918 shutdown_connections 2022-02-02T18:44:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/498350918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f480f6920 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/498350918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f480f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:44:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/498350918 >> 172.21.15.96:0/498350918 conn(0x7f3f480f0de0 msgr2=0x7f3f480f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/498350918 shutdown_connections 2022-02-02T18:44:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/498350918 wait complete. 2022-02-02T18:44:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 Processor -- start 2022-02-02T18:44:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.160+0000 7f3f4f7d8700 1 -- start start 2022-02-02T18:44:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4f7d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f48109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4f7d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4f7d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48060590 con 0x7f3f480f5ef0 2022-02-02T18:44:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4f7d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480606d0 con 0x7f3f480f55e0 2022-02-02T18:44:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55658/0 (socket says 172.21.15.96:55658) 2022-02-02T18:44:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 -- 172.21.15.96:0/967162087 learned_addr learned my addr 172.21.15.96:0/967162087 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4d574700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f48109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 -- 172.21.15.96:0/967162087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 msgr2=0x7f3f48109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f48109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 -- 172.21.15.96:0/967162087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38005040 con 0x7f3f480f5ef0 2022-02-02T18:44:05.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4d574700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f48109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:44:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4cd73700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f3f38009990 tx=0x7f3f38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f38018070 con 0x7f3f480f5ef0 2022-02-02T18:44:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f38007ca0 con 0x7f3f480f5ef0 2022-02-02T18:44:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.161+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4810c790 con 0x7f3f480f5ef0 2022-02-02T18:44:05.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.162+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3801c620 con 0x7f3f480f5ef0 2022-02-02T18:44:05.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.162+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4810ccc0 con 0x7f3f480f5ef0 2022-02-02T18:44:05.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.163+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480f4a70 con 0x7f3f480f5ef0 2022-02-02T18:44:05.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.163+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f3801d960 con 0x7f3f480f5ef0 2022-02-02T18:44:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.164+0000 7f3f3dffb700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.164+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f38083820 con 0x7f3f480f5ef0 2022-02-02T18:44:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.164+0000 7f3f4d574700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.164+0000 7f3f4d574700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 0x7f3f34067290 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f3f48060180 tx=0x7f3f44008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.168+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f38051a40 con 0x7f3f480f5ef0 2022-02-02T18:44:05.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.347+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f480008d0 con 0x7f3f34064dd0 2022-02-02T18:44:05.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.348+0000 7f3f3dffb700 1 -- 172.21.15.96:0/967162087 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3f480008d0 con 0x7f3f34064dd0 2022-02-02T18:44:05.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 msgr2=0x7f3f34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 0x7f3f34067290 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f3f48060180 tx=0x7f3f44008040).stop 2022-02-02T18:44:05.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 msgr2=0x7f3f4810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f3f38009990 tx=0x7f3f38009b30).stop 2022-02-02T18:44:05.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 shutdown_connections 2022-02-02T18:44:05.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f480f55e0 0x7f3f48109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 --2- 172.21.15.96:0/967162087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f480f5ef0 0x7f3f4810c190 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 >> 172.21.15.96:0/967162087 conn(0x7f3f480f0de0 msgr2=0x7f3f480fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 shutdown_connections 2022-02-02T18:44:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.350+0000 7f3f4f7d8700 1 -- 172.21.15.96:0/967162087 wait complete. 2022-02-02T18:44:05.356 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:44:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 -- 172.21.15.96:0/1543032140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f66e0 msgr2=0x7f81e00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 --2- 172.21.15.96:0/1543032140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f66e0 0x7f81e00f6b00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f81d4004660 tx=0x7f81d4009b30).stop 2022-02-02T18:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 -- 172.21.15.96:0/1543032140 shutdown_connections 2022-02-02T18:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 --2- 172.21.15.96:0/1543032140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f7980 0x7f81e00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 --2- 172.21.15.96:0/1543032140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f66e0 0x7f81e00f6b00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 -- 172.21.15.96:0/1543032140 >> 172.21.15.96:0/1543032140 conn(0x7f81e00f1e40 msgr2=0x7f81e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 -- 172.21.15.96:0/1543032140 shutdown_connections 2022-02-02T18:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.450+0000 7f81e59a2700 1 -- 172.21.15.96:0/1543032140 wait complete. 2022-02-02T18:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 Processor -- start 2022-02-02T18:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 -- start start 2022-02-02T18:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f66e0 0x7f81e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006a410 con 0x7f81e00f7980 2022-02-02T18:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81e59a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006a550 con 0x7f81e00f66e0 2022-02-02T18:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81de7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81de7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55668/0 (socket says 172.21.15.96:55668) 2022-02-02T18:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81de7fc700 1 -- 172.21.15.96:0/2223022790 learned_addr learned my addr 172.21.15.96:0/2223022790 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.451+0000 7f81deffd700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f66e0 0x7f81e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81de7fc700 1 -- 172.21.15.96:0/2223022790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f66e0 msgr2=0x7f81e006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81de7fc700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f66e0 0x7f81e006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81de7fc700 1 -- 172.21.15.96:0/2223022790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e00f7980 2022-02-02T18:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81de7fc700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f81d000b410 tx=0x7f81d0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d00125f0 con 0x7f81e00f7980 2022-02-02T18:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81d000be30 con 0x7f81e00f7980 2022-02-02T18:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e006a830 con 0x7f81e00f7980 2022-02-02T18:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d0002a70 con 0x7f81e00f7980 2022-02-02T18:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.452+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e010efe0 con 0x7f81e00f7980 2022-02-02T18:44:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.453+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0045ad0 con 0x7f81e00f7980 2022-02-02T18:44:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.454+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f81d000f030 con 0x7f81e00f7980 2022-02-02T18:44:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.454+0000 7f81c77fe700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.454+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f81d0081f00 con 0x7f81e00f7980 2022-02-02T18:44:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.454+0000 7f81deffd700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.455+0000 7f81deffd700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f81d4013690 tx=0x7f81d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.458+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81d0050090 con 0x7f81e00f7980 2022-02-02T18:44:05.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.631+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81e00ff090 con 0x7f81c8064dd0 2022-02-02T18:44:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.640+0000 7f81c77fe700 1 -- 172.21.15.96:0/2223022790 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f81e00ff090 con 0x7f81c8064dd0 2022-02-02T18:44:05.637 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:44:05.637 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (27m) 8m ago 28m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:44:05.637 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (19m) 8m ago 28m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:44:05.637 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (19m) 6m ago 28m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:44:05.638 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (27m) 8m ago 28m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:44:05.638 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (24m) 8m ago 24m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:44:05.638 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (20m) 8m ago 24m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:44:05.638 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (24m) 6m ago 24m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:44:05.639 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (20m) 6m ago 24m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:44:05.639 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (21m) 8m ago 29m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:44:05.639 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (21m) 6m ago 27m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:44:05.639 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (20m) 8m ago 29m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:44:05.639 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (20m) 6m ago 27m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:44:05.640 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (28m) 8m ago 28m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:44:05.640 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (27m) 6m ago 27m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:44:05.640 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (19m) 8m ago 27m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:44:05.640 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (18m) 8m ago 27m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:44:05.641 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (18m) 8m ago 26m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:44:05.641 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (17m) 6m ago 26m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:44:05.641 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (17m) 6m ago 26m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:44:05.641 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (16m) 6m ago 25m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:44:05.641 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (27m) 8m ago 28m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:44:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 msgr2=0x7f81c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f81d4013690 tx=0x7f81d4009b30).stop 2022-02-02T18:44:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 msgr2=0x7f81e0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f81d000b410 tx=0x7f81d0006ef0).stop 2022-02-02T18:44:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 shutdown_connections 2022-02-02T18:44:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f66e0 0x7f81e006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 --2- 172.21.15.96:0/2223022790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f7980 0x7f81e0069e20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 >> 172.21.15.96:0/2223022790 conn(0x7f81e00f1e40 msgr2=0x7f81e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 shutdown_connections 2022-02-02T18:44:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.643+0000 7f81e59a2700 1 -- 172.21.15.96:0/2223022790 wait complete. 2022-02-02T18:44:05.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 -- 172.21.15.96:0/1010627055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 msgr2=0x7f40e40f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 --2- 172.21.15.96:0/1010627055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7080 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f40d4004660 tx=0x7f40d4009b30).stop 2022-02-02T18:44:05.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 -- 172.21.15.96:0/1010627055 shutdown_connections 2022-02-02T18:44:05.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 --2- 172.21.15.96:0/1010627055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 0x7f40e40f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 --2- 172.21.15.96:0/1010627055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7080 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 -- 172.21.15.96:0/1010627055 >> 172.21.15.96:0/1010627055 conn(0x7f40e40f04c0 msgr2=0x7f40e40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 -- 172.21.15.96:0/1010627055 shutdown_connections 2022-02-02T18:44:05.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.740+0000 7f40ebe06700 1 -- 172.21.15.96:0/1010627055 wait complete. 2022-02-02T18:44:05.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 Processor -- start 2022-02-02T18:44:05.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 -- start start 2022-02-02T18:44:05.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 0x7f40e40f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40f8220 con 0x7f40e40f6c60 2022-02-02T18:44:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40ebe06700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40f8360 con 0x7f40e40f5970 2022-02-02T18:44:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55678/0 (socket says 172.21.15.96:55678) 2022-02-02T18:44:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 -- 172.21.15.96:0/2053508361 learned_addr learned my addr 172.21.15.96:0/2053508361 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e9ba2700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 0x7f40e40f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 -- 172.21.15.96:0/2053508361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 msgr2=0x7f40e40f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 0x7f40e40f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 -- 172.21.15.96:0/2053508361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4005040 con 0x7f40e40f6c60 2022-02-02T18:44:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.741+0000 7f40e93a1700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f40e00026d0 tx=0x7f40e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.742+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40e00079c0 con 0x7f40e40f6c60 2022-02-02T18:44:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.742+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40e000f040 con 0x7f40e40f6c60 2022-02-02T18:44:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.742+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40e00148b0 con 0x7f40e40f6c60 2022-02-02T18:44:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.742+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40f8640 con 0x7f40e40f6c60 2022-02-02T18:44:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.742+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e410efd0 con 0x7f40e40f6c60 2022-02-02T18:44:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.743+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4045ad0 con 0x7f40e40f6c60 2022-02-02T18:44:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.743+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40e0007b20 con 0x7f40e40f6c60 2022-02-02T18:44:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.743+0000 7f40da7fc700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 0x7f40d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.744+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f40e0081910 con 0x7f40e40f6c60 2022-02-02T18:44:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.744+0000 7f40e9ba2700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 0x7f40d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.744+0000 7f40e9ba2700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 0x7f40d0067290 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f40d4004630 tx=0x7f40d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.748+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40e004f9c0 con 0x7f40e40f6c60 2022-02-02T18:44:05.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.978+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40e40fde40 con 0x7f40e40f6c60 2022-02-02T18:44:05.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.978+0000 7f40da7fc700 1 -- 172.21.15.96:0/2053508361 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f40e0052fe0 con 0x7f40e40f6c60 2022-02-02T18:44:05.975 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:44:05.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:44:05.976 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:44:05.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:05.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:44:05.976 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:44:05.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:05.977 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:44:05.977 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:44:05.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:05.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:44:05.977 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:44:05.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:05.978 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:44:05.978 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:44:05.978 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:44:05.978 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:44:05.979 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:44:05.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 msgr2=0x7f40d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 0x7f40d0067290 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f40d4004630 tx=0x7f40d4009b30).stop 2022-02-02T18:44:05.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 msgr2=0x7f40e40f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:05.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f40e00026d0 tx=0x7f40e0009de0).stop 2022-02-02T18:44:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 shutdown_connections 2022-02-02T18:44:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40d0064dd0 0x7f40d0067290 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40f5970 0x7f40e40f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 --2- 172.21.15.96:0/2053508361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40e40f6c60 0x7f40e40f7cc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:05.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 >> 172.21.15.96:0/2053508361 conn(0x7f40e40f04c0 msgr2=0x7f40e40f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 shutdown_connections 2022-02-02T18:44:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:05.980+0000 7f40ebe06700 1 -- 172.21.15.96:0/2053508361 wait complete. 2022-02-02T18:44:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 -- 172.21.15.96:0/4255072687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f68e0 msgr2=0x7f5e8c0f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 --2- 172.21.15.96:0/4255072687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c0f6d00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f5e80004660 tx=0x7f5e80009b30).stop 2022-02-02T18:44:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 -- 172.21.15.96:0/4255072687 shutdown_connections 2022-02-02T18:44:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 --2- 172.21.15.96:0/4255072687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c0f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 --2- 172.21.15.96:0/4255072687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c0f6d00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 -- 172.21.15.96:0/4255072687 >> 172.21.15.96:0/4255072687 conn(0x7f5e8c0f2020 msgr2=0x7f5e8c0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 -- 172.21.15.96:0/4255072687 shutdown_connections 2022-02-02T18:44:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.079+0000 7f5e9285c700 1 -- 172.21.15.96:0/4255072687 wait complete. 2022-02-02T18:44:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 Processor -- start 2022-02-02T18:44:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 -- start start 2022-02-02T18:44:06.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:06.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:06.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c107c00 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e9285c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c107d40 con 0x7f5e8c0f68e0 2022-02-02T18:44:06.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:06.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55686/0 (socket says 172.21.15.96:55686) 2022-02-02T18:44:06.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.080+0000 7f5e8b7fe700 1 -- 172.21.15.96:0/1195411616 learned_addr learned my addr 172.21.15.96:0/1195411616 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:06.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e8bfff700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:06.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e8b7fe700 1 -- 172.21.15.96:0/1195411616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f68e0 msgr2=0x7f5e8c107160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:06.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e8b7fe700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e8b7fe700 1 -- 172.21.15.96:0/1195411616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80005040 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e8b7fe700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f5e7c002700 tx=0x7f5e7c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:06.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e7c009320 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e7c00f040 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c1086e0 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e7c014820 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.081+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c108ca0 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.082+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c045ad0 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.082+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e7c014a90 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.083+0000 7f5e88ff9700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 0x7f5e74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.083+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5e7c081e20 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.083+0000 7f5e8bfff700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 0x7f5e74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.083+0000 7f5e8bfff700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 0x7f5e74067290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5e80009da0 tx=0x7f5e80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:06.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.087+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e7c053980 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.287+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e8c0ff0a0 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.287+0000 7f5e88ff9700 1 -- 172.21.15.96:0/1195411616 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5e7c053570 con 0x7f5e8c0f7b80 2022-02-02T18:44:06.284 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:44:06.284 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:44:06.284 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:44:06.285 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:44:06.285 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:06.285 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:44:06.285 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:44:06.286 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:44:06.286 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:44:06.286 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:44:06.286 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:44:06.287 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:44:06.287 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:44:06.287 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:44:06.287 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:44:06.288 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:44:06.288 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:44:06.288 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:44:06.288 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:44:06.288 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:44:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:44:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:44:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:44:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:44:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:44:06.290 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:44:06.290 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:44:06.290 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:44:06.290 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:44:06.291 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:44:06.291 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:44:06.291 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:44:06.291 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:06.292 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:06.292 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:44:06.292 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:06.292 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:06.292 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:06.293 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:06.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 msgr2=0x7f5e74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:06.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 0x7f5e74067290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5e80009da0 tx=0x7f5e80009b30).stop 2022-02-02T18:44:06.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 msgr2=0x7f5e8c107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:06.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f5e7c002700 tx=0x7f5e7c009e00).stop 2022-02-02T18:44:06.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 shutdown_connections 2022-02-02T18:44:06.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e74064dd0 0x7f5e74067290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c0f68e0 0x7f5e8c107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 --2- 172.21.15.96:0/1195411616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e8c0f7b80 0x7f5e8c107650 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:06.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 >> 172.21.15.96:0/1195411616 conn(0x7f5e8c0f2020 msgr2=0x7f5e8c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:06.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 shutdown_connections 2022-02-02T18:44:06.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:06.289+0000 7f5e9285c700 1 -- 172.21.15.96:0/1195411616 wait complete. 2022-02-02T18:44:06.297 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:44:06.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:06 smithi159 ceph-mon[69013]: pgmap v659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:06.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:06 smithi159 ceph-mon[69013]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:06.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2053508361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:06.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1195411616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:44:06.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:06 smithi096 ceph-mon[101353]: pgmap v659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:06 smithi096 ceph-mon[101353]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2053508361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1195411616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:44:07.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:07 smithi159 ceph-mon[69013]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:07 smithi096 ceph-mon[101353]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:08 smithi159 ceph-mon[69013]: pgmap v660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:08 smithi096 ceph-mon[101353]: pgmap v660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:10.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:10 smithi159 ceph-mon[69013]: pgmap v661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:10.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:10 smithi096 ceph-mon[101353]: pgmap v661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:12 smithi159 ceph-mon[69013]: pgmap v662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:12 smithi096 ceph-mon[101353]: pgmap v662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: pgmap v663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:14.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: pgmap v663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:15.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:15 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:15.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:15 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:16.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:16 smithi159 ceph-mon[69013]: pgmap v664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:16.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:16 smithi096 ceph-mon[101353]: pgmap v664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:18.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:18 smithi159 ceph-mon[69013]: pgmap v665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:18 smithi096 ceph-mon[101353]: pgmap v665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:20.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:20 smithi159 ceph-mon[69013]: pgmap v666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:20 smithi096 ceph-mon[101353]: pgmap v666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:22 smithi159 ceph-mon[69013]: pgmap v667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:22 smithi096 ceph-mon[101353]: pgmap v667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:24.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: pgmap v668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:24.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:24.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: pgmap v668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:24.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:24.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:24.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:24.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:24.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:25.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:25 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:25.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:25 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:25.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:25 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:25.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:25 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:26.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:26 smithi159 ceph-mon[69013]: pgmap v669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:26 smithi096 ceph-mon[101353]: pgmap v669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:44:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:44:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:44:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:44:28.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:28 smithi159 ceph-mon[69013]: pgmap v670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:28 smithi096 ceph-mon[101353]: pgmap v670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:30 smithi159 ceph-mon[69013]: pgmap v671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:30.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:30 smithi096 ceph-mon[101353]: pgmap v671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:32.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:32 smithi159 ceph-mon[69013]: pgmap v672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:32 smithi096 ceph-mon[101353]: pgmap v672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:34.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: pgmap v673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:34.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:34.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:34.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:34 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: pgmap v673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:34.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:34.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:34.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:34 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:35.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:35 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:35.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:35 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:35.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:35 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:35.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:35 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 -- 172.21.15.96:0/2242614186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f5970 msgr2=0x7f70b40f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2242614186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f5970 0x7f70b40f5df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f709c004660 tx=0x7f709c009b30).stop 2022-02-02T18:44:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 -- 172.21.15.96:0/2242614186 shutdown_connections 2022-02-02T18:44:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2242614186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f5970 0x7f70b40f5df0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2242614186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f6c60 0x7f70b40f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:44:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 -- 172.21.15.96:0/2242614186 >> 172.21.15.96:0/2242614186 conn(0x7f70b40f04c0 msgr2=0x7f70b40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 -- 172.21.15.96:0/2242614186 shutdown_connections 2022-02-02T18:44:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.400+0000 7f70b9d91700 1 -- 172.21.15.96:0/2242614186 wait complete. 2022-02-02T18:44:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 Processor -- start 2022-02-02T18:44:36.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 -- start start 2022-02-02T18:44:36.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f5970 0x7f70b4109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40f5690 con 0x7f70b40f6c60 2022-02-02T18:44:36.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b9d91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40f57d0 con 0x7f70b40f5970 2022-02-02T18:44:36.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55704/0 (socket says 172.21.15.96:55704) 2022-02-02T18:44:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 -- 172.21.15.96:0/2229195928 learned_addr learned my addr 172.21.15.96:0/2229195928 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70b37fe700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f5970 0x7f70b4109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 -- 172.21.15.96:0/2229195928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f5970 msgr2=0x7f70b4109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f5970 0x7f70b4109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.401+0000 7f70aaffd700 1 -- 172.21.15.96:0/2229195928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c005040 con 0x7f70b40f6c60 2022-02-02T18:44:36.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70aaffd700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f709c009990 tx=0x7f709c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f709c018070 con 0x7f70b40f6c60 2022-02-02T18:44:36.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f709c007ba0 con 0x7f70b40f6c60 2022-02-02T18:44:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f709c01c3c0 con 0x7f70b40f6c60 2022-02-02T18:44:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b410c7b0 con 0x7f70b40f6c60 2022-02-02T18:44:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.402+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b410cd10 con 0x7f70b40f6c60 2022-02-02T18:44:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.403+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b4045ad0 con 0x7f70b40f6c60 2022-02-02T18:44:36.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.403+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f709c01d420 con 0x7f70b40f6c60 2022-02-02T18:44:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.404+0000 7f70b0ff9700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 0x7f70a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.404+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f709c0838d0 con 0x7f70b40f6c60 2022-02-02T18:44:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.404+0000 7f70b37fe700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 0x7f70a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.404+0000 7f70b37fe700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 0x7f70a0067290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f70b40f5280 tx=0x7f70a4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.408+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f709c051af0 con 0x7f70b40f6c60 2022-02-02T18:44:36.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.588+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b40fdfd0 con 0x7f70a0064dd0 2022-02-02T18:44:36.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.589+0000 7f70b0ff9700 1 -- 172.21.15.96:0/2229195928 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f70b40fdfd0 con 0x7f70a0064dd0 2022-02-02T18:44:36.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 msgr2=0x7f70a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 0x7f70a0067290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f70b40f5280 tx=0x7f70a4008040).stop 2022-02-02T18:44:36.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 msgr2=0x7f70b410c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f709c009990 tx=0x7f709c009b30).stop 2022-02-02T18:44:36.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 shutdown_connections 2022-02-02T18:44:36.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70a0064dd0 0x7f70a0067290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70b40f5970 0x7f70b4109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 --2- 172.21.15.96:0/2229195928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b40f6c60 0x7f70b410c200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.591+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 >> 172.21.15.96:0/2229195928 conn(0x7f70b40f04c0 msgr2=0x7f70b40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:36.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.592+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 shutdown_connections 2022-02-02T18:44:36.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.592+0000 7f70b9d91700 1 -- 172.21.15.96:0/2229195928 wait complete. 2022-02-02T18:44:36.598 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:44:36.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 -- 172.21.15.96:0/3694856621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f6c60 msgr2=0x7f10d80f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 --2- 172.21.15.96:0/3694856621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f6c60 0x7f10d80f7080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f10c8004660 tx=0x7f10c8009b30).stop 2022-02-02T18:44:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 -- 172.21.15.96:0/3694856621 shutdown_connections 2022-02-02T18:44:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 --2- 172.21.15.96:0/3694856621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f5970 0x7f10d80f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 --2- 172.21.15.96:0/3694856621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f6c60 0x7f10d80f7080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 -- 172.21.15.96:0/3694856621 >> 172.21.15.96:0/3694856621 conn(0x7f10d80f04c0 msgr2=0x7f10d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:36.689 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:36 smithi096 ceph-mon[101353]: pgmap v674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:36.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 -- 172.21.15.96:0/3694856621 shutdown_connections 2022-02-02T18:44:36.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.691+0000 7f10df6b9700 1 -- 172.21.15.96:0/3694856621 wait complete. 2022-02-02T18:44:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 Processor -- start 2022-02-02T18:44:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 -- start start 2022-02-02T18:44:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f6c60 0x7f10d810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80f5600 con 0x7f10d80f5970 2022-02-02T18:44:36.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10df6b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80f5740 con 0x7f10d80f6c60 2022-02-02T18:44:36.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10dd455700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10dd455700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55712/0 (socket says 172.21.15.96:55712) 2022-02-02T18:44:36.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10dd455700 1 -- 172.21.15.96:0/1186990419 learned_addr learned my addr 172.21.15.96:0/1186990419 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:36.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.692+0000 7f10dcc54700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f6c60 0x7f10d810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10dd455700 1 -- 172.21.15.96:0/1186990419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f6c60 msgr2=0x7f10d810c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10dd455700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f6c60 0x7f10d810c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10dd455700 1 -- 172.21.15.96:0/1186990419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8005040 con 0x7f10d80f5970 2022-02-02T18:44:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10dd455700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f10c8009990 tx=0x7f10c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c8018070 con 0x7f10d80f5970 2022-02-02T18:44:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f10c8007ba0 con 0x7f10d80f5970 2022-02-02T18:44:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c801c3c0 con 0x7f10d80f5970 2022-02-02T18:44:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d810c6b0 con 0x7f10d80f5970 2022-02-02T18:44:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.693+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d810cbe0 con 0x7f10d80f5970 2022-02-02T18:44:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.694+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80f4150 con 0x7f10d80f5970 2022-02-02T18:44:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.695+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f10c801d420 con 0x7f10d80f5970 2022-02-02T18:44:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.695+0000 7f10cdffb700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 0x7f10c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.695+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f10c8083750 con 0x7f10d80f5970 2022-02-02T18:44:36.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.695+0000 7f10dcc54700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 0x7f10c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.696+0000 7f10dcc54700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 0x7f10c4067290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f10d4007fd0 tx=0x7f10d4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.700+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10c8051800 con 0x7f10d80f5970 2022-02-02T18:44:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:36 smithi159 ceph-mon[69013]: pgmap v674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:36.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.870+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d80fdf80 con 0x7f10c4064dd0 2022-02-02T18:44:36.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.879+0000 7f10cdffb700 1 -- 172.21.15.96:0/1186990419 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f10d80fdf80 con 0x7f10c4064dd0 2022-02-02T18:44:36.875 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:44:36.876 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (27m) 8m ago 29m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:44:36.876 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (20m) 8m ago 29m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:44:36.876 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (20m) 7m ago 28m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:44:36.876 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (27m) 8m ago 28m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:44:36.877 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (25m) 8m ago 25m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:44:36.877 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (20m) 8m ago 25m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:44:36.877 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (25m) 7m ago 25m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:44:36.877 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (20m) 7m ago 25m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:44:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (22m) 8m ago 30m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:44:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (21m) 7m ago 28m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:44:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (21m) 8m ago 30m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:44:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (20m) 7m ago 28m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:44:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (28m) 8m ago 28m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:44:36.879 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (28m) 7m ago 28m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:44:36.879 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (20m) 8m ago 27m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:44:36.879 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (19m) 8m ago 27m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:44:36.879 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (18m) 8m ago 27m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:44:36.880 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (18m) 7m ago 26m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:44:36.880 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (17m) 7m ago 26m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:44:36.880 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (17m) 7m ago 26m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:44:36.880 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (27m) 8m ago 28m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:44:36.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 msgr2=0x7f10c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 0x7f10c4067290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f10d4007fd0 tx=0x7f10d4009040).stop 2022-02-02T18:44:36.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 msgr2=0x7f10d8109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f10c8009990 tx=0x7f10c8009b30).stop 2022-02-02T18:44:36.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 shutdown_connections 2022-02-02T18:44:36.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10c4064dd0 0x7f10c4067290 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80f5970 0x7f10d8109c60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 --2- 172.21.15.96:0/1186990419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d80f6c60 0x7f10d810c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 >> 172.21.15.96:0/1186990419 conn(0x7f10d80f04c0 msgr2=0x7f10d80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:36.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 shutdown_connections 2022-02-02T18:44:36.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.882+0000 7f10df6b9700 1 -- 172.21.15.96:0/1186990419 wait complete. 2022-02-02T18:44:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 -- 172.21.15.96:0/128011594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 msgr2=0x7fa3600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 --2- 172.21.15.96:0/128011594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa3600f5850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fa35c004660 tx=0x7fa35c009b30).stop 2022-02-02T18:44:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 -- 172.21.15.96:0/128011594 shutdown_connections 2022-02-02T18:44:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 --2- 172.21.15.96:0/128011594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 0x7fa3600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 --2- 172.21.15.96:0/128011594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa3600f5850 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.978+0000 7fa3666a0700 1 -- 172.21.15.96:0/128011594 >> 172.21.15.96:0/128011594 conn(0x7fa3600f0b90 msgr2=0x7fa3600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 -- 172.21.15.96:0/128011594 shutdown_connections 2022-02-02T18:44:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 -- 172.21.15.96:0/128011594 wait complete. 2022-02-02T18:44:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 Processor -- start 2022-02-02T18:44:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 -- start start 2022-02-02T18:44:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 0x7fa36010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600603e0 con 0x7fa3600f5430 2022-02-02T18:44:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa3666a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360060520 con 0x7fa3600f66d0 2022-02-02T18:44:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa36569e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa36569e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55722/0 (socket says 172.21.15.96:55722) 2022-02-02T18:44:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.979+0000 7fa36569e700 1 -- 172.21.15.96:0/2090499016 learned_addr learned my addr 172.21.15.96:0/2090499016 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa364e9d700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 0x7fa36010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa36569e700 1 -- 172.21.15.96:0/2090499016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 msgr2=0x7fa36010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa36569e700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 0x7fa36010bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa36569e700 1 -- 172.21.15.96:0/2090499016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c005040 con 0x7fa3600f5430 2022-02-02T18:44:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa36569e700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa35c013a70 tx=0x7fa35c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c018070 con 0x7fa3600f5430 2022-02-02T18:44:36.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa35c0097d0 con 0x7fa3600f5430 2022-02-02T18:44:36.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36010c4e0 con 0x7fa3600f5430 2022-02-02T18:44:36.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c01de80 con 0x7fa3600f5430 2022-02-02T18:44:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.980+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36010ca40 con 0x7fa3600f5430 2022-02-02T18:44:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.981+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa360045ad0 con 0x7fa3600f5430 2022-02-02T18:44:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.982+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa35c007ba0 con 0x7fa3600f5430 2022-02-02T18:44:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.982+0000 7fa355ffb700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.983+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa35c0835a0 con 0x7fa3600f5430 2022-02-02T18:44:36.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.983+0000 7fa364e9d700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:36.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.983+0000 7fa364e9d700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa350004c40 tx=0x7fa35000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:36.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:36.987+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa35c051650 con 0x7fa3600f5430 2022-02-02T18:44:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.219+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3600fdcc0 con 0x7fa3600f5430 2022-02-02T18:44:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.219+0000 7fa355ffb700 1 -- 172.21.15.96:0/2090499016 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa35c054c70 con 0x7fa3600f5430 2022-02-02T18:44:37.216 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:44:37.216 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:44:37.217 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:44:37.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:37.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:44:37.217 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:44:37.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:37.218 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:44:37.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:44:37.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:37.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:44:37.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:44:37.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:44:37.219 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:44:37.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:44:37.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:44:37.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:44:37.220 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:44:37.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 msgr2=0x7fa34c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa350004c40 tx=0x7fa35000b040).stop 2022-02-02T18:44:37.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 msgr2=0x7fa360109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa35c013a70 tx=0x7fa35c009b30).stop 2022-02-02T18:44:37.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 shutdown_connections 2022-02-02T18:44:37.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3600f5430 0x7fa360109a90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 --2- 172.21.15.96:0/2090499016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3600f66d0 0x7fa36010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 >> 172.21.15.96:0/2090499016 conn(0x7fa3600f0b90 msgr2=0x7fa3600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:37.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 shutdown_connections 2022-02-02T18:44:37.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.221+0000 7fa3666a0700 1 -- 172.21.15.96:0/2090499016 wait complete. 2022-02-02T18:44:37.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 -- 172.21.15.96:0/802255819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f6860 msgr2=0x7f34800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 --2- 172.21.15.96:0/802255819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f6860 0x7f34800f6cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f3470004660 tx=0x7f3470009b30).stop 2022-02-02T18:44:37.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 -- 172.21.15.96:0/802255819 shutdown_connections 2022-02-02T18:44:37.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 --2- 172.21.15.96:0/802255819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f6860 0x7f34800f6cc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 --2- 172.21.15.96:0/802255819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f55c0 0x7f34800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 -- 172.21.15.96:0/802255819 >> 172.21.15.96:0/802255819 conn(0x7f34800f0d40 msgr2=0x7f34800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:37.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 -- 172.21.15.96:0/802255819 shutdown_connections 2022-02-02T18:44:37.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 -- 172.21.15.96:0/802255819 wait complete. 2022-02-02T18:44:37.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.320+0000 7f3487bb9700 1 Processor -- start 2022-02-02T18:44:37.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3487bb9700 1 -- start start 2022-02-02T18:44:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3487bb9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3487bb9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 0x7f348010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3487bb9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480060420 con 0x7f34800f55c0 2022-02-02T18:44:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3487bb9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480060560 con 0x7f34800f6860 2022-02-02T18:44:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55732/0 (socket says 172.21.15.96:55732) 2022-02-02T18:44:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 -- 172.21.15.96:0/2714967856 learned_addr learned my addr 172.21.15.96:0/2714967856 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:44:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485154700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 0x7f348010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:37.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 -- 172.21.15.96:0/2714967856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 msgr2=0x7f348010c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 0x7f348010c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 -- 172.21.15.96:0/2714967856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470005040 con 0x7f34800f55c0 2022-02-02T18:44:37.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485154700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 0x7f348010c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:44:37.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f3485955700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f347c002700 tx=0x7f347c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:37.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.321+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c009320 con 0x7f34800f55c0 2022-02-02T18:44:37.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.322+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f347c00f040 con 0x7f34800f55c0 2022-02-02T18:44:37.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.322+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348010c720 con 0x7f34800f55c0 2022-02-02T18:44:37.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.322+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c014900 con 0x7f34800f55c0 2022-02-02T18:44:37.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.322+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348010ccb0 con 0x7f34800f55c0 2022-02-02T18:44:37.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.322+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480045ad0 con 0x7f34800f55c0 2022-02-02T18:44:37.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.323+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f347c009480 con 0x7f34800f55c0 2022-02-02T18:44:37.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.323+0000 7f34767fc700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 0x7f346c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:44:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.324+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f347c081d10 con 0x7f34800f55c0 2022-02-02T18:44:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.324+0000 7f3485154700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 0x7f346c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:44:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.324+0000 7f3485154700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 0x7f346c067290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3470004630 tx=0x7f3470009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:44:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.328+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f347c04fe80 con 0x7f34800f55c0 2022-02-02T18:44:37.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.530+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34800fde90 con 0x7f34800f55c0 2022-02-02T18:44:37.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.531+0000 7f34767fc700 1 -- 172.21.15.96:0/2714967856 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f347c0534a0 con 0x7f34800f55c0 2022-02-02T18:44:37.528 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:44:37.528 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:44:37.528 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:44:37.528 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:44:37.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:37.529 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:44:37.529 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:44:37.530 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:44:37.530 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:44:37.530 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:44:37.531 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:44:37.531 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:44:37.531 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:44:37.531 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:44:37.531 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:44:37.532 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:44:37.532 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:44:37.532 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:44:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:44:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:44:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:44:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:44:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:44:37.534 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:44:37.534 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:44:37.534 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:44:37.534 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:44:37.535 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:44:37.535 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:44:37.535 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:44:37.535 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:44:37.535 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:44:37.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:37.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:37.536 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:44:37.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:44:37.536 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:37.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:37.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:44:37.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 msgr2=0x7f346c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 0x7f346c067290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3470004630 tx=0x7f3470009b30).stop 2022-02-02T18:44:37.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 msgr2=0x7f3480109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:44:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f347c002700 tx=0x7f347c009d80).stop 2022-02-02T18:44:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 shutdown_connections 2022-02-02T18:44:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064dd0 0x7f346c067290 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f55c0 0x7f3480109c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 --2- 172.21.15.96:0/2714967856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f6860 0x7f348010c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:44:37.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 >> 172.21.15.96:0/2714967856 conn(0x7f34800f0d40 msgr2=0x7f34800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:44:37.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 shutdown_connections 2022-02-02T18:44:37.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:44:37.534+0000 7f3487bb9700 1 -- 172.21.15.96:0/2714967856 wait complete. 2022-02-02T18:44:37.541 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:44:37.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2090499016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2090499016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:38 smithi159 ceph-mon[69013]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:38 smithi159 ceph-mon[69013]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:38 smithi159 ceph-mon[69013]: pgmap v675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2714967856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:44:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:38 smithi096 ceph-mon[101353]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:38 smithi096 ceph-mon[101353]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:44:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:38 smithi096 ceph-mon[101353]: pgmap v675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2714967856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:44:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:40 smithi159 ceph-mon[69013]: pgmap v676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:40 smithi096 ceph-mon[101353]: pgmap v676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:42.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:42 smithi159 ceph-mon[69013]: pgmap v677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:42 smithi096 ceph-mon[101353]: pgmap v677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: pgmap v678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:44.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:44.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:44 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: pgmap v678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:44.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:44.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:44.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:44 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:45 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:45 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:45.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:45 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:45.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:45 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:46 smithi159 ceph-mon[69013]: pgmap v679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:46 smithi096 ceph-mon[101353]: pgmap v679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:48 smithi159 ceph-mon[69013]: pgmap v680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:48 smithi096 ceph-mon[101353]: pgmap v680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:50.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:50 smithi159 ceph-mon[69013]: pgmap v681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:50 smithi096 ceph-mon[101353]: pgmap v681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:52 smithi159 ceph-mon[69013]: pgmap v682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:52 smithi096 ceph-mon[101353]: pgmap v682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: pgmap v683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:54.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:54 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: pgmap v683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:54.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:44:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:44:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:44:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:44:54.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:54.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:54 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:44:55.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:55 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:55.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:55 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:55.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:55 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:44:55.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:55 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:44:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:56 smithi159 ceph-mon[69013]: pgmap v684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:56 smithi096 ceph-mon[101353]: pgmap v684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:44:58 smithi159 ceph-mon[69013]: pgmap v685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:44:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:44:58 smithi096 ceph-mon[101353]: pgmap v685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:00.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:00 smithi159 ceph-mon[69013]: pgmap v686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:00 smithi096 ceph-mon[101353]: pgmap v686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:02 smithi159 ceph-mon[69013]: pgmap v687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:02 smithi096 ceph-mon[101353]: pgmap v687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: pgmap v688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:04.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:04.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:04 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: pgmap v688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:04.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:04.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:04 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:05.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:05 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:05.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:05 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:06.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:05 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:06.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:05 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:06.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:06 smithi096 ceph-mon[101353]: pgmap v689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:06 smithi159 ceph-mon[69013]: pgmap v689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:07.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 -- 172.21.15.96:0/3862206174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f5430 msgr2=0x7f6d980f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 --2- 172.21.15.96:0/3862206174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f5430 0x7f6d980f5850 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f6d88004660 tx=0x7f6d88009b30).stop 2022-02-02T18:45:07.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 -- 172.21.15.96:0/3862206174 shutdown_connections 2022-02-02T18:45:07.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 --2- 172.21.15.96:0/3862206174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f66d0 0x7f6d980f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 --2- 172.21.15.96:0/3862206174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f5430 0x7f6d980f5850 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.643+0000 7f6d9759e700 1 -- 172.21.15.96:0/3862206174 >> 172.21.15.96:0/3862206174 conn(0x7f6d980f0b90 msgr2=0x7f6d980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:07.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 -- 172.21.15.96:0/3862206174 shutdown_connections 2022-02-02T18:45:07.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 -- 172.21.15.96:0/3862206174 wait complete. 2022-02-02T18:45:07.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 Processor -- start 2022-02-02T18:45:07.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 -- start start 2022-02-02T18:45:07.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 0x7f6d98106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98107900 con 0x7f6d980f66d0 2022-02-02T18:45:07.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d9759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98108110 con 0x7f6d980f5430 2022-02-02T18:45:07.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.644+0000 7f6d95d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55754/0 (socket says 172.21.15.96:55754) 2022-02-02T18:45:07.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 -- 172.21.15.96:0/332509349 learned_addr learned my addr 172.21.15.96:0/332509349 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:07.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d9659c700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 0x7f6d98106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 -- 172.21.15.96:0/332509349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 msgr2=0x7f6d98106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 0x7f6d98106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 -- 172.21.15.96:0/332509349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88005040 con 0x7f6d980f66d0 2022-02-02T18:45:07.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d9659c700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 0x7f6d98106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:45:07.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d95d9b700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f6d8c00c530 tx=0x7f6d8c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:07.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8c00f650 con 0x7f6d980f66d0 2022-02-02T18:45:07.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d8c00fc60 con 0x7f6d980f66d0 2022-02-02T18:45:07.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d98108390 con 0x7f6d980f66d0 2022-02-02T18:45:07.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8c012cd0 con 0x7f6d980f66d0 2022-02-02T18:45:07.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.645+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d98108950 con 0x7f6d980f66d0 2022-02-02T18:45:07.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.646+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d98059100 con 0x7f6d980f66d0 2022-02-02T18:45:07.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.647+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d8c010070 con 0x7f6d980f66d0 2022-02-02T18:45:07.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.647+0000 7f6d86ffd700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.647+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6d8c0818c0 con 0x7f6d980f66d0 2022-02-02T18:45:07.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.647+0000 7f6d9659c700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.648+0000 7f6d9659c700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f6d88004e30 tx=0x7f6d88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:07.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.652+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d8c04f8b0 con 0x7f6d980f66d0 2022-02-02T18:45:07.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.832+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d980fab10 con 0x7f6d80064e20 2022-02-02T18:45:07.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.833+0000 7f6d86ffd700 1 -- 172.21.15.96:0/332509349 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6d980fab10 con 0x7f6d80064e20 2022-02-02T18:45:07.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 msgr2=0x7f6d800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f6d88004e30 tx=0x7f6d88009b30).stop 2022-02-02T18:45:07.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 msgr2=0x7f6d98107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f6d8c00c530 tx=0x7f6d8c007e20).stop 2022-02-02T18:45:07.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 shutdown_connections 2022-02-02T18:45:07.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d980f5430 0x7f6d98106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 --2- 172.21.15.96:0/332509349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d980f66d0 0x7f6d98107300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 >> 172.21.15.96:0/332509349 conn(0x7f6d980f0b90 msgr2=0x7f6d9805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:07.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 shutdown_connections 2022-02-02T18:45:07.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.835+0000 7f6d9759e700 1 -- 172.21.15.96:0/332509349 wait complete. 2022-02-02T18:45:07.841 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:45:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 -- 172.21.15.96:0/1205790869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 msgr2=0x7f40a80fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 --2- 172.21.15.96:0/1205790869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a80fe000 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f4090004690 tx=0x7f4090009b30).stop 2022-02-02T18:45:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 -- 172.21.15.96:0/1205790869 shutdown_connections 2022-02-02T18:45:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 --2- 172.21.15.96:0/1205790869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a80fe000 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 --2- 172.21.15.96:0/1205790869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 0x7f40a80fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.932+0000 7f40add84700 1 -- 172.21.15.96:0/1205790869 >> 172.21.15.96:0/1205790869 conn(0x7f40a80f0d40 msgr2=0x7f40a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.933+0000 7f40add84700 1 -- 172.21.15.96:0/1205790869 shutdown_connections 2022-02-02T18:45:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.933+0000 7f40add84700 1 -- 172.21.15.96:0/1205790869 wait complete. 2022-02-02T18:45:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.933+0000 7f40add84700 1 Processor -- start 2022-02-02T18:45:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.933+0000 7f40add84700 1 -- start start 2022-02-02T18:45:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 0x7f40a81090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8109b80 con 0x7f40a80fbc10 2022-02-02T18:45:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8109cc0 con 0x7f40a8060290 2022-02-02T18:45:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55764/0 (socket says 172.21.15.96:55764) 2022-02-02T18:45:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 -- 172.21.15.96:0/1726057466 learned_addr learned my addr 172.21.15.96:0/1726057466 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a77fe700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 0x7f40a81090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 -- 172.21.15.96:0/1726057466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 msgr2=0x7f40a81090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 0x7f40a81090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 -- 172.21.15.96:0/1726057466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a80fbc10 2022-02-02T18:45:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40a6ffd700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4090000c00 tx=0x7f4090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4090018070 con 0x7f40a80fbc10 2022-02-02T18:45:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4090013e40 con 0x7f40a80fbc10 2022-02-02T18:45:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a810a600 con 0x7f40a80fbc10 2022-02-02T18:45:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.934+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a810ab60 con 0x7f40a80fbc10 2022-02-02T18:45:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.935+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409001c3c0 con 0x7f40a80fbc10 2022-02-02T18:45:07.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.935+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8045ad0 con 0x7f40a80fbc10 2022-02-02T18:45:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.936+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f409001d420 con 0x7f40a80fbc10 2022-02-02T18:45:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.936+0000 7f409ffff700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 0x7f4094067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.936+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f40900836c0 con 0x7f40a80fbc10 2022-02-02T18:45:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.936+0000 7f40a77fe700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 0x7f4094067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.937+0000 7f40a77fe700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 0x7f4094067270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4098004c40 tx=0x7f409800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:07.940+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40900551a0 con 0x7f40a80fbc10 2022-02-02T18:45:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.113+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a8101200 con 0x7f4094064db0 2022-02-02T18:45:08.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.122+0000 7f409ffff700 1 -- 172.21.15.96:0/1726057466 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f40a8101200 con 0x7f4094064db0 2022-02-02T18:45:08.119 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:45:08.120 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (28m) 9m ago 29m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:45:08.120 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (20m) 9m ago 29m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:45:08.120 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (20m) 7m ago 29m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:45:08.120 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (28m) 9m ago 29m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:45:08.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (25m) 9m ago 25m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:45:08.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (21m) 9m ago 25m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:45:08.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (25m) 7m ago 25m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:45:08.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (21m) 7m ago 25m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:45:08.121 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (22m) 9m ago 30m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:45:08.122 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (22m) 7m ago 29m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:45:08.122 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (21m) 9m ago 30m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:45:08.122 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (21m) 7m ago 28m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:45:08.122 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (29m) 9m ago 29m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:45:08.123 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (28m) 7m ago 28m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:45:08.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (20m) 9m ago 28m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:45:08.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (20m) 9m ago 28m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:45:08.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (19m) 9m ago 27m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:45:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (18m) 7m ago 27m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:45:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (18m) 7m ago 27m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:45:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (17m) 7m ago 26m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:45:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (28m) 9m ago 29m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:45:08.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 msgr2=0x7f4094067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 0x7f4094067270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4098004c40 tx=0x7f409800b040).stop 2022-02-02T18:45:08.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 msgr2=0x7f40a81095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4090000c00 tx=0x7f4090009b30).stop 2022-02-02T18:45:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 shutdown_connections 2022-02-02T18:45:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4094064db0 0x7f4094067270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a8060290 0x7f40a81090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 --2- 172.21.15.96:0/1726057466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80fbc10 0x7f40a81095d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 >> 172.21.15.96:0/1726057466 conn(0x7f40a80f0d40 msgr2=0x7f40a80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 shutdown_connections 2022-02-02T18:45:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.124+0000 7f40add84700 1 -- 172.21.15.96:0/1726057466 wait complete. 2022-02-02T18:45:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 -- 172.21.15.96:0/2345093729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 msgr2=0x7f9aac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 --2- 172.21.15.96:0/2345093729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac0f6cc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f9a98004660 tx=0x7f9a98009b30).stop 2022-02-02T18:45:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 -- 172.21.15.96:0/2345093729 shutdown_connections 2022-02-02T18:45:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 --2- 172.21.15.96:0/2345093729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac0f6cc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 --2- 172.21.15.96:0/2345093729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 -- 172.21.15.96:0/2345093729 >> 172.21.15.96:0/2345093729 conn(0x7f9aac0f0d40 msgr2=0x7f9aac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 -- 172.21.15.96:0/2345093729 shutdown_connections 2022-02-02T18:45:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.221+0000 7f9ab3072700 1 -- 172.21.15.96:0/2345093729 wait complete. 2022-02-02T18:45:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.222+0000 7f9ab3072700 1 Processor -- start 2022-02-02T18:45:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.222+0000 7f9ab3072700 1 -- start start 2022-02-02T18:45:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab3072700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab3072700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab3072700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1069b0 con 0x7f9aac0f6860 2022-02-02T18:45:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab3072700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1071c0 con 0x7f9aac0f55c0 2022-02-02T18:45:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55774/0 (socket says 172.21.15.96:55774) 2022-02-02T18:45:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 -- 172.21.15.96:0/787994201 learned_addr learned my addr 172.21.15.96:0/787994201 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab0e0e700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 -- 172.21.15.96:0/787994201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 msgr2=0x7f9aac105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 -- 172.21.15.96:0/787994201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98005040 con 0x7f9aac0f6860 2022-02-02T18:45:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9ab0e0e700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:45:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.223+0000 7f9aabfff700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f9a98009990 tx=0x7f9a98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.224+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9801c070 con 0x7f9aac0f6860 2022-02-02T18:45:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.224+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac107360 con 0x7f9aac0f6860 2022-02-02T18:45:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.224+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac1078c0 con 0x7f9aac0f6860 2022-02-02T18:45:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.224+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a98012a80 con 0x7f9aac0f6860 2022-02-02T18:45:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.224+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a98021890 con 0x7f9aac0f6860 2022-02-02T18:45:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.225+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c004fa0 con 0x7f9aac0f6860 2022-02-02T18:45:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.225+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a98012bf0 con 0x7f9aac0f6860 2022-02-02T18:45:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.226+0000 7f9aa97fa700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 0x7f9a9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.226+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9a98087b60 con 0x7f9aac0f6860 2022-02-02T18:45:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.226+0000 7f9ab0e0e700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 0x7f9a9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.226+0000 7f9ab0e0e700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 0x7f9a9c067290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9aac105c30 tx=0x7f9aa0009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.230+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a98055cd0 con 0x7f9aac0f6860 2022-02-02T18:45:08.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.461+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a8c005e80 con 0x7f9aac0f6860 2022-02-02T18:45:08.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.462+0000 7f9aa97fa700 1 -- 172.21.15.96:0/787994201 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9a98012e80 con 0x7f9aac0f6860 2022-02-02T18:45:08.460 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:45:08.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:45:08.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:45:08.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:08.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:45:08.461 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:45:08.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:08.461 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:45:08.461 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:45:08.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:08.462 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:45:08.462 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:45:08.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:08.462 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:45:08.463 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:45:08.463 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:45:08.463 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:45:08.463 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:45:08.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 msgr2=0x7f9a9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 0x7f9a9c067290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9aac105c30 tx=0x7f9aa0009c00).stop 2022-02-02T18:45:08.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 msgr2=0x7f9aac1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f9a98009990 tx=0x7f9a98009b30).stop 2022-02-02T18:45:08.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 shutdown_connections 2022-02-02T18:45:08.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a9c064dd0 0x7f9a9c067290 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f55c0 0x7f9aac105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 --2- 172.21.15.96:0/787994201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f6860 0x7f9aac1063b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 >> 172.21.15.96:0/787994201 conn(0x7f9aac0f0d40 msgr2=0x7f9aac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:08.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 shutdown_connections 2022-02-02T18:45:08.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.464+0000 7f9ab3072700 1 -- 172.21.15.96:0/787994201 wait complete. 2022-02-02T18:45:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 -- 172.21.15.96:0/1390902222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 msgr2=0x7f3e500f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 --2- 172.21.15.96:0/1390902222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e500f63e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f3e3c004660 tx=0x7f3e3c009b30).stop 2022-02-02T18:45:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 -- 172.21.15.96:0/1390902222 shutdown_connections 2022-02-02T18:45:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 --2- 172.21.15.96:0/1390902222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e500f63e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 --2- 172.21.15.96:0/1390902222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 0x7f3e500f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 -- 172.21.15.96:0/1390902222 >> 172.21.15.96:0/1390902222 conn(0x7f3e500f04c0 msgr2=0x7f3e500f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 -- 172.21.15.96:0/1390902222 shutdown_connections 2022-02-02T18:45:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.563+0000 7f3e57106700 1 -- 172.21.15.96:0/1390902222 wait complete. 2022-02-02T18:45:08.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 Processor -- start 2022-02-02T18:45:08.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 -- start start 2022-02-02T18:45:08.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 0x7f3e50105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50106960 con 0x7f3e500f5f60 2022-02-02T18:45:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e57106700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50106aa0 con 0x7f3e500f4d60 2022-02-02T18:45:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55784/0 (socket says 172.21.15.96:55784) 2022-02-02T18:45:08.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 -- 172.21.15.96:0/3807979097 learned_addr learned my addr 172.21.15.96:0/3807979097 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:08.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e54ea2700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 0x7f3e50105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 -- 172.21.15.96:0/3807979097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 msgr2=0x7f3e50105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 0x7f3e50105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 -- 172.21.15.96:0/3807979097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c005040 con 0x7f3e500f5f60 2022-02-02T18:45:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.564+0000 7f3e4ffff700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f3e3c009990 tx=0x7f3e3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.565+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c018070 con 0x7f3e500f5f60 2022-02-02T18:45:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.565+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e3c007ba0 con 0x7f3e500f5f60 2022-02-02T18:45:08.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.565+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c01c3c0 con 0x7f3e500f5f60 2022-02-02T18:45:08.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.565+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e501073e0 con 0x7f3e500f5f60 2022-02-02T18:45:08.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.565+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e501078f0 con 0x7f3e500f5f60 2022-02-02T18:45:08.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.566+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e50045ad0 con 0x7f3e500f5f60 2022-02-02T18:45:08.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.566+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e3c01d420 con 0x7f3e500f5f60 2022-02-02T18:45:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.566+0000 7f3e4d7fa700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 0x7f3e40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.567+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e3c0837f0 con 0x7f3e500f5f60 2022-02-02T18:45:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.567+0000 7f3e54ea2700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 0x7f3e40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.567+0000 7f3e54ea2700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 0x7f3e40067290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f3e440041d0 tx=0x7f3e44009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:08.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.571+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e3c0552d0 con 0x7f3e500f5f60 2022-02-02T18:45:08.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.773+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3e500fd540 con 0x7f3e500f5f60 2022-02-02T18:45:08.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.773+0000 7f3e4d7fa700 1 -- 172.21.15.96:0/3807979097 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3e3c054ec0 con 0x7f3e500f5f60 2022-02-02T18:45:08.771 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:45:08.771 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:45:08.771 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:45:08.772 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:45:08.772 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:08.772 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:45:08.772 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:45:08.773 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:45:08.773 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:45:08.773 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:45:08.773 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:45:08.773 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:45:08.774 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:45:08.774 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:45:08.774 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:45:08.774 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:45:08.775 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:45:08.775 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:45:08.775 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:45:08.775 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:45:08.775 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:45:08.776 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:45:08.776 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:45:08.776 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:45:08.776 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:45:08.776 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:45:08.777 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:45:08.777 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:45:08.777 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:45:08.777 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:45:08.778 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:45:08.778 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:45:08.778 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:08.778 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:08.778 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:45:08.779 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:08.779 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:08.779 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:08.779 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:08.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 msgr2=0x7f3e40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 0x7f3e40067290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f3e440041d0 tx=0x7f3e44009040).stop 2022-02-02T18:45:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 msgr2=0x7f3e501063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f3e3c009990 tx=0x7f3e3c009b30).stop 2022-02-02T18:45:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 shutdown_connections 2022-02-02T18:45:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e40064dd0 0x7f3e40067290 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e500f4d60 0x7f3e50105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 --2- 172.21.15.96:0/3807979097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e500f5f60 0x7f3e501063b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 >> 172.21.15.96:0/3807979097 conn(0x7f3e500f04c0 msgr2=0x7f3e500fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 shutdown_connections 2022-02-02T18:45:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:08.775+0000 7f3e57106700 1 -- 172.21.15.96:0/3807979097 wait complete. 2022-02-02T18:45:08.783 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:45:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:08 smithi096 ceph-mon[101353]: pgmap v690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/787994201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:09.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:08 smithi159 ceph-mon[69013]: pgmap v690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:09.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/787994201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:09.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:09 smithi096 ceph-mon[101353]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:09.822 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:09 smithi096 ceph-mon[101353]: from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:09.823 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3807979097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:45:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:09 smithi159 ceph-mon[69013]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:09 smithi159 ceph-mon[69013]: from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3807979097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:45:10.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:10 smithi096 ceph-mon[101353]: pgmap v691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:11.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:10 smithi159 ceph-mon[69013]: pgmap v691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:12 smithi096 ceph-mon[101353]: pgmap v692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:13.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:12 smithi159 ceph-mon[69013]: pgmap v692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: pgmap v693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:14.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:14.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:14 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: pgmap v693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:14 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:16.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:15 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:16.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:15 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:16.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:15 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:16.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:15 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:16 smithi159 ceph-mon[69013]: pgmap v694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:16 smithi096 ceph-mon[101353]: pgmap v694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:18 smithi159 ceph-mon[69013]: pgmap v695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:18 smithi096 ceph-mon[101353]: pgmap v695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:20 smithi159 ceph-mon[69013]: pgmap v696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:20 smithi096 ceph-mon[101353]: pgmap v696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:23.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:22 smithi159 ceph-mon[69013]: pgmap v697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:23.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:22 smithi096 ceph-mon[101353]: pgmap v697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:24 smithi159 ceph-mon[69013]: pgmap v698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:25.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:24 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:25.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:24 smithi096 ceph-mon[101353]: pgmap v698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:25.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:25.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:25.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:24 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:26.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:26.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:26.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:26.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:26.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:25 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:26.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:26.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:26.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:26.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:26.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:25 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:26 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:26 smithi159 ceph-mon[69013]: pgmap v699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:27.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:26 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:27.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:26 smithi096 ceph-mon[101353]: pgmap v699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:45:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:45:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:45:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:45:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:28 smithi159 ceph-mon[69013]: pgmap v700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:28 smithi096 ceph-mon[101353]: pgmap v700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:31.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:30 smithi159 ceph-mon[69013]: pgmap v701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:30 smithi096 ceph-mon[101353]: pgmap v701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:32 smithi159 ceph-mon[69013]: pgmap v702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:33.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:32 smithi096 ceph-mon[101353]: pgmap v702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:34 smithi159 ceph-mon[69013]: pgmap v703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:35.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:34 smithi096 ceph-mon[101353]: pgmap v703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:36.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:35 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:36.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:36.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:36.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:35 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:36 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:36 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:36 smithi159 ceph-mon[69013]: pgmap v704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:37.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:36 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:37.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:36 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:37.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:36 smithi096 ceph-mon[101353]: pgmap v704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:38.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:37 smithi159 ceph-mon[69013]: pgmap v705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:38.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:37 smithi096 ceph-mon[101353]: pgmap v705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:38.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 -- 172.21.15.96:0/1315186411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f55c0 msgr2=0x7f87e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:38.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 --2- 172.21.15.96:0/1315186411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f55c0 0x7f87e00f59e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f87d0004660 tx=0x7f87d0009b30).stop 2022-02-02T18:45:38.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 -- 172.21.15.96:0/1315186411 shutdown_connections 2022-02-02T18:45:38.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 --2- 172.21.15.96:0/1315186411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f6860 0x7f87e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:38.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 --2- 172.21.15.96:0/1315186411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f55c0 0x7f87e00f59e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 -- 172.21.15.96:0/1315186411 >> 172.21.15.96:0/1315186411 conn(0x7f87e00f0d40 msgr2=0x7f87e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 -- 172.21.15.96:0/1315186411 shutdown_connections 2022-02-02T18:45:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.884+0000 7f87e654c700 1 -- 172.21.15.96:0/1315186411 wait complete. 2022-02-02T18:45:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 Processor -- start 2022-02-02T18:45:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 -- start start 2022-02-02T18:45:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f55c0 0x7f87e0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0060420 con 0x7f87e00f6860 2022-02-02T18:45:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87e654c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0060560 con 0x7f87e00f55c0 2022-02-02T18:45:38.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:38.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55804/0 (socket says 172.21.15.96:55804) 2022-02-02T18:45:38.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87df7fe700 1 -- 172.21.15.96:0/15709286 learned_addr learned my addr 172.21.15.96:0/15709286 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:38.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.885+0000 7f87dffff700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f55c0 0x7f87e0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:38.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87df7fe700 1 -- 172.21.15.96:0/15709286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f55c0 msgr2=0x7f87e0109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:38.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87df7fe700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f55c0 0x7f87e0109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:38.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87df7fe700 1 -- 172.21.15.96:0/15709286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0005040 con 0x7f87e00f6860 2022-02-02T18:45:38.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87df7fe700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f87d40026d0 tx=0x7f87d4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:38.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d40079c0 con 0x7f87e00f6860 2022-02-02T18:45:38.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f87d400f040 con 0x7f87e00f6860 2022-02-02T18:45:38.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e010c740 con 0x7f87e00f6860 2022-02-02T18:45:38.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d40148b0 con 0x7f87e00f6860 2022-02-02T18:45:38.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.886+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e010ccd0 con 0x7f87e00f6860 2022-02-02T18:45:38.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.887+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0045ad0 con 0x7f87e00f6860 2022-02-02T18:45:38.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.888+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f87d4007b20 con 0x7f87e00f6860 2022-02-02T18:45:38.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.889+0000 7f87dcff9700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 0x7f87c8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:38.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.889+0000 7f87dffff700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 0x7f87c8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:38.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.889+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f87d4081dd0 con 0x7f87e00f6860 2022-02-02T18:45:38.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.889+0000 7f87dffff700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 0x7f87c8067270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f87e00600a0 tx=0x7f87d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:38.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:38.893+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f87d404fe80 con 0x7f87e00f6860 2022-02-02T18:45:39.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.070+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87e0057f10 con 0x7f87c8064db0 2022-02-02T18:45:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.072+0000 7f87dcff9700 1 -- 172.21.15.96:0/15709286 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f87e0057f10 con 0x7f87c8064db0 2022-02-02T18:45:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.073+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 msgr2=0x7f87c8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.073+0000 7f87e654c700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 0x7f87c8067270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f87e00600a0 tx=0x7f87d0009b30).stop 2022-02-02T18:45:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.073+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 msgr2=0x7f87e010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.073+0000 7f87e654c700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f87d40026d0 tx=0x7f87d4009de0).stop 2022-02-02T18:45:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 shutdown_connections 2022-02-02T18:45:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87c8064db0 0x7f87c8067270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87e00f55c0 0x7f87e0109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 --2- 172.21.15.96:0/15709286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e00f6860 0x7f87e010c130 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 >> 172.21.15.96:0/15709286 conn(0x7f87e00f0d40 msgr2=0x7f87e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 shutdown_connections 2022-02-02T18:45:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.074+0000 7f87e654c700 1 -- 172.21.15.96:0/15709286 wait complete. 2022-02-02T18:45:39.079 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:45:39.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 -- 172.21.15.96:0/2408996731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 msgr2=0x7f0cc80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 --2- 172.21.15.96:0/2408996731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc80f6b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f0cc4004660 tx=0x7f0cc4009b30).stop 2022-02-02T18:45:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 -- 172.21.15.96:0/2408996731 shutdown_connections 2022-02-02T18:45:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 --2- 172.21.15.96:0/2408996731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc80f6b30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 --2- 172.21.15.96:0/2408996731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.171+0000 7f0cce03e700 1 -- 172.21.15.96:0/2408996731 >> 172.21.15.96:0/2408996731 conn(0x7f0cc80f0b90 msgr2=0x7f0cc80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 -- 172.21.15.96:0/2408996731 shutdown_connections 2022-02-02T18:45:39.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 -- 172.21.15.96:0/2408996731 wait complete. 2022-02-02T18:45:39.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 Processor -- start 2022-02-02T18:45:39.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 -- start start 2022-02-02T18:45:39.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80603e0 con 0x7f0cc80f5430 2022-02-02T18:45:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0cce03e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8060520 con 0x7f0cc80f66d0 2022-02-02T18:45:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0ccd03c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0ccd03c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55812/0 (socket says 172.21.15.96:55812) 2022-02-02T18:45:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.172+0000 7f0ccd03c700 1 -- 172.21.15.96:0/1776443198 learned_addr learned my addr 172.21.15.96:0/1776443198 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0ccc83b700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0ccd03c700 1 -- 172.21.15.96:0/1776443198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f66d0 msgr2=0x7f0cc810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0ccd03c700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0ccd03c700 1 -- 172.21.15.96:0/1776443198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4005040 con 0x7f0cc80f5430 2022-02-02T18:45:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0ccd03c700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0cb8002700 tx=0x7f0cb8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb8009320 con 0x7f0cc80f5430 2022-02-02T18:45:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cb800f040 con 0x7f0cc80f5430 2022-02-02T18:45:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc810c4d0 con 0x7f0cc80f5430 2022-02-02T18:45:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb8014900 con 0x7f0cc80f5430 2022-02-02T18:45:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.173+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc810ca90 con 0x7f0cc80f5430 2022-02-02T18:45:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.174+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8045ad0 con 0x7f0cc80f5430 2022-02-02T18:45:39.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.175+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0cb8009480 con 0x7f0cc80f5430 2022-02-02T18:45:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.175+0000 7f0cbdffb700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 0x7f0cb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.175+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0cb8081d20 con 0x7f0cc80f5430 2022-02-02T18:45:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.175+0000 7f0ccc83b700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 0x7f0cb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.176+0000 7f0ccc83b700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 0x7f0cb40672e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0cc4004630 tx=0x7f0cc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.179+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0cb804fdd0 con 0x7f0cc80f5430 2022-02-02T18:45:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.351+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cc80fdda0 con 0x7f0cb4064e20 2022-02-02T18:45:39.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.360+0000 7f0cbdffb700 1 -- 172.21.15.96:0/1776443198 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0cc4019040 con 0x7f0cb4064e20 2022-02-02T18:45:39.356 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:45:39.356 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (29m) 9m ago 30m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:45:39.357 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (21m) 9m ago 30m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:45:39.357 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (21m) 8m ago 29m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:45:39.357 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (28m) 9m ago 29m 41.5M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:45:39.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (26m) 9m ago 26m 567M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:45:39.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (21m) 9m ago 26m 17.1M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:45:39.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (26m) 8m ago 26m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:45:39.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (22m) 8m ago 26m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:45:39.358 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (23m) 9m ago 31m 486M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:45:39.358 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (22m) 8m ago 29m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:45:39.359 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (22m) 9m ago 31m 118M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:45:39.359 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (22m) 8m ago 29m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:45:39.359 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (29m) 9m ago 29m 18.4M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:45:39.359 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (29m) 8m ago 29m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:45:39.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (21m) 9m ago 28m 299M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:45:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (20m) 9m ago 28m 296M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:45:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (19m) 9m ago 28m 241M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:45:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (19m) 8m ago 28m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:45:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (18m) 8m ago 27m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:45:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (18m) 8m ago 27m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:45:39.361 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (28m) 9m ago 29m 50.4M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:45:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 msgr2=0x7f0cb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 0x7f0cb40672e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0cc4004630 tx=0x7f0cc4009b30).stop 2022-02-02T18:45:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 msgr2=0x7f0cc8109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0cb8002700 tx=0x7f0cb8009d80).stop 2022-02-02T18:45:39.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 shutdown_connections 2022-02-02T18:45:39.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb4064e20 0x7f0cb40672e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 --2- 172.21.15.96:0/1776443198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 >> 172.21.15.96:0/1776443198 conn(0x7f0cc80f0b90 msgr2=0x7f0cc80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 shutdown_connections 2022-02-02T18:45:39.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.362+0000 7f0cce03e700 1 -- 172.21.15.96:0/1776443198 wait complete. 2022-02-02T18:45:39.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 -- 172.21.15.96:0/900255677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f55d0 msgr2=0x7f12e40f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 --2- 172.21.15.96:0/900255677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f55d0 0x7f12e40f59f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f12d8004660 tx=0x7f12d8009b30).stop 2022-02-02T18:45:39.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 -- 172.21.15.96:0/900255677 shutdown_connections 2022-02-02T18:45:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 --2- 172.21.15.96:0/900255677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f5ee0 0x7f12e40f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 --2- 172.21.15.96:0/900255677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f55d0 0x7f12e40f59f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 -- 172.21.15.96:0/900255677 >> 172.21.15.96:0/900255677 conn(0x7f12e40f0dd0 msgr2=0x7f12e40f31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 -- 172.21.15.96:0/900255677 shutdown_connections 2022-02-02T18:45:39.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.459+0000 7f12e9755700 1 -- 172.21.15.96:0/900255677 wait complete. 2022-02-02T18:45:39.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 Processor -- start 2022-02-02T18:45:39.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 -- start start 2022-02-02T18:45:39.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 0x7f12e4109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4109c10 con 0x7f12e40f5ee0 2022-02-02T18:45:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e9755700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4109d50 con 0x7f12e40f55d0 2022-02-02T18:45:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55824/0 (socket says 172.21.15.96:55824) 2022-02-02T18:45:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.460+0000 7f12e27fc700 1 -- 172.21.15.96:0/2789620462 learned_addr learned my addr 172.21.15.96:0/2789620462 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e2ffd700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 0x7f12e4109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e27fc700 1 -- 172.21.15.96:0/2789620462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 msgr2=0x7f12e4109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e27fc700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 0x7f12e4109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e27fc700 1 -- 172.21.15.96:0/2789620462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8005040 con 0x7f12e40f5ee0 2022-02-02T18:45:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e2ffd700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 0x7f12e4109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:45:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12e27fc700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f12d400c790 tx=0x7f12d4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d400e680 con 0x7f12e40f5ee0 2022-02-02T18:45:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12d400ec90 con 0x7f12e40f5ee0 2022-02-02T18:45:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.461+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d4013d60 con 0x7f12e40f5ee0 2022-02-02T18:45:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.462+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e410a6f0 con 0x7f12e40f5ee0 2022-02-02T18:45:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.462+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e410ac80 con 0x7f12e40f5ee0 2022-02-02T18:45:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.463+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e4045ad0 con 0x7f12e40f5ee0 2022-02-02T18:45:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.463+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f12d4010070 con 0x7f12e40f5ee0 2022-02-02T18:45:39.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.464+0000 7f12cb7fe700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 0x7f12cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.464+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f12d4081d10 con 0x7f12e40f5ee0 2022-02-02T18:45:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.464+0000 7f12e2ffd700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 0x7f12cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.464+0000 7f12e2ffd700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 0x7f12cc067290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f12d8009da0 tx=0x7f12d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.468+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f12d40538a0 con 0x7f12e40f5ee0 2022-02-02T18:45:39.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.696+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f12e410f790 con 0x7f12e40f5ee0 2022-02-02T18:45:39.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.696+0000 7f12cb7fe700 1 -- 172.21.15.96:0/2789620462 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f12d4053490 con 0x7f12e40f5ee0 2022-02-02T18:45:39.692 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:45:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:45:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:45:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:45:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:45:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:45:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:45:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:45:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:45:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:45:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:45:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:45:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:45:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:45:39.696 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:45:39.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 msgr2=0x7f12cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 0x7f12cc067290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f12d8009da0 tx=0x7f12d8009b30).stop 2022-02-02T18:45:39.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 msgr2=0x7f12e4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f12d400c790 tx=0x7f12d4007d70).stop 2022-02-02T18:45:39.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 shutdown_connections 2022-02-02T18:45:39.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12cc064dd0 0x7f12cc067290 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12e40f55d0 0x7f12e4109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 --2- 172.21.15.96:0/2789620462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e40f5ee0 0x7f12e4109660 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 >> 172.21.15.96:0/2789620462 conn(0x7f12e40f0dd0 msgr2=0x7f12e405fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 shutdown_connections 2022-02-02T18:45:39.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.698+0000 7f12e9755700 1 -- 172.21.15.96:0/2789620462 wait complete. 2022-02-02T18:45:39.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 -- 172.21.15.96:0/3840604784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 msgr2=0x7f53600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 --2- 172.21.15.96:0/3840604784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f53600f6950 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f5350004660 tx=0x7f5350009b30).stop 2022-02-02T18:45:39.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 -- 172.21.15.96:0/3840604784 shutdown_connections 2022-02-02T18:45:39.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 --2- 172.21.15.96:0/3840604784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53600f77d0 0x7f53600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 --2- 172.21.15.96:0/3840604784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f53600f6950 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:39.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 -- 172.21.15.96:0/3840604784 >> 172.21.15.96:0/3840604784 conn(0x7f53600f1c90 msgr2=0x7f53600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:39.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 -- 172.21.15.96:0/3840604784 shutdown_connections 2022-02-02T18:45:39.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.795+0000 7f535f59e700 1 -- 172.21.15.96:0/3840604784 wait complete. 2022-02-02T18:45:39.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 Processor -- start 2022-02-02T18:45:39.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 -- start start 2022-02-02T18:45:39.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53600f77d0 0x7f53601072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601078f0 con 0x7f53600f6530 2022-02-02T18:45:39.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360108100 con 0x7f53600f77d0 2022-02-02T18:45:39.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.796+0000 7f535e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55832/0 (socket says 172.21.15.96:55832) 2022-02-02T18:45:39.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 -- 172.21.15.96:0/366880685 learned_addr learned my addr 172.21.15.96:0/366880685 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:45:39.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 -- 172.21.15.96:0/366880685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53600f77d0 msgr2=0x7f53601072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:39.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53600f77d0 0x7f53601072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:45:39.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 -- 172.21.15.96:0/366880685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350005040 con 0x7f53600f6530 2022-02-02T18:45:39.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535e59c700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f5350013a70 tx=0x7f5350009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5350018070 con 0x7f53600f6530 2022-02-02T18:45:39.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5360108320 con 0x7f53600f6530 2022-02-02T18:45:39.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f53500097d0 con 0x7f53600f6530 2022-02-02T18:45:39.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535001c3c0 con 0x7f53600f6530 2022-02-02T18:45:39.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.797+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5360108880 con 0x7f53600f6530 2022-02-02T18:45:39.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.798+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360059100 con 0x7f53600f6530 2022-02-02T18:45:39.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.799+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5350007ba0 con 0x7f53600f6530 2022-02-02T18:45:39.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.799+0000 7f534effd700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 0x7f53480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:45:39.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.800+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5350083850 con 0x7f53600f6530 2022-02-02T18:45:39.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.800+0000 7f535dd9b700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 0x7f53480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:45:39.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.800+0000 7f535dd9b700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 0x7f53480672e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5354004a10 tx=0x7f53540099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:45:39.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:39.804+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5350051900 con 0x7f53600f6530 2022-02-02T18:45:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.003+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53600fecf0 con 0x7f53600f6530 2022-02-02T18:45:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.003+0000 7f534effd700 1 -- 172.21.15.96:0/366880685 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5350054f20 con 0x7f53600f6530 2022-02-02T18:45:40.000 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:45:40.000 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:45:40.000 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:45:40.001 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:45:40.001 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:40.001 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:45:40.001 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:45:40.001 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:45:40.002 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:45:40.002 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:45:40.002 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:45:40.002 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:45:40.003 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:45:40.003 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:45:40.003 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:45:40.003 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:45:40.004 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:45:40.004 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:45:40.004 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:45:40.004 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:45:40.005 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:45:40.005 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:45:40.005 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:45:40.005 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:45:40.005 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:45:40.006 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:45:40.006 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:45:40.006 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:45:40.006 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:45:40.007 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:45:40.007 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:45:40.007 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:45:40.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:40.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:40.008 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:45:40.008 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:45:40.008 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:40.008 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:40.009 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:45:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 msgr2=0x7f53480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 0x7f53480672e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5354004a10 tx=0x7f53540099e0).stop 2022-02-02T18:45:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 msgr2=0x7f5360106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:45:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f5350013a70 tx=0x7f5350009b30).stop 2022-02-02T18:45:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 shutdown_connections 2022-02-02T18:45:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5348064e20 0x7f53480672e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53600f6530 0x7f5360106e00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:45:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 --2- 172.21.15.96:0/366880685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53600f77d0 0x7f53601072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:45:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 >> 172.21.15.96:0/366880685 conn(0x7f53600f1c90 msgr2=0x7f53600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:45:40.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 shutdown_connections 2022-02-02T18:45:40.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:45:40.005+0000 7f535f59e700 1 -- 172.21.15.96:0/366880685 wait complete. 2022-02-02T18:45:40.012 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:45:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:40 smithi159 ceph-mon[69013]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:40 smithi159 ceph-mon[69013]: pgmap v706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:40 smithi159 ceph-mon[69013]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2789620462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/366880685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:45:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:40 smithi096 ceph-mon[101353]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:40 smithi096 ceph-mon[101353]: pgmap v706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:40 smithi096 ceph-mon[101353]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:45:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2789620462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/366880685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:45:42.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:42 smithi159 ceph-mon[69013]: pgmap v707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:42 smithi096 ceph-mon[101353]: pgmap v707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:44.672 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:44 smithi096 ceph-mon[101353]: pgmap v708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:44.673 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:44 smithi159 ceph-mon[69013]: pgmap v708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:45.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:45.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:45.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:45 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:45.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:45.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:45.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:45:45.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:45.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:45.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:45 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:45:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:46 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:46 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:46 smithi159 ceph-mon[69013]: pgmap v709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:46 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:46 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:45:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:46 smithi096 ceph-mon[101353]: pgmap v709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:48 smithi159 ceph-mon[69013]: pgmap v710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:48 smithi096 ceph-mon[101353]: pgmap v710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:50 smithi159 ceph-mon[69013]: pgmap v711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:50 smithi096 ceph-mon[101353]: pgmap v711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:52 smithi159 ceph-mon[69013]: pgmap v712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:52 smithi096 ceph-mon[101353]: pgmap v712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:54.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:54 smithi159 ceph-mon[69013]: pgmap v713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:54 smithi096 ceph-mon[101353]: pgmap v713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:55.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:55.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:55.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:55 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:55.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:45:55.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:45:55.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:55 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:45:56.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:56 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:56 smithi159 ceph-mon[69013]: pgmap v714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:56 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:45:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:56 smithi096 ceph-mon[101353]: pgmap v714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:45:58 smithi159 ceph-mon[69013]: pgmap v715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:45:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:45:58 smithi096 ceph-mon[101353]: pgmap v715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:00 smithi159 ceph-mon[69013]: pgmap v716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:00 smithi096 ceph-mon[101353]: pgmap v716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:02.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:02.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:02.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:02.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.521 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:02.522 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:02 smithi159 ceph-mon[69013]: pgmap v717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:02.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:02.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:02.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:02.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:02.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:02.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:02 smithi096 ceph-mon[101353]: pgmap v717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:04.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:04 smithi159 ceph-mon[69013]: pgmap v718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:04.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:04 smithi096 ceph-mon[101353]: pgmap v718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:06.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:06 smithi159 ceph-mon[69013]: pgmap v719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:06.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:06 smithi096 ceph-mon[101353]: pgmap v719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:08 smithi159 ceph-mon[69013]: pgmap v720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:08 smithi096 ceph-mon[101353]: pgmap v720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:10.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 -- 172.21.15.96:0/2668843578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f6860 msgr2=0x7f66300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 --2- 172.21.15.96:0/2668843578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f6860 0x7f66300f6cc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f662c004660 tx=0x7f662c009b30).stop 2022-02-02T18:46:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 -- 172.21.15.96:0/2668843578 shutdown_connections 2022-02-02T18:46:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 --2- 172.21.15.96:0/2668843578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f6860 0x7f66300f6cc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 --2- 172.21.15.96:0/2668843578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f55c0 0x7f66300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 -- 172.21.15.96:0/2668843578 >> 172.21.15.96:0/2668843578 conn(0x7f66300f0d40 msgr2=0x7f66300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 -- 172.21.15.96:0/2668843578 shutdown_connections 2022-02-02T18:46:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.116+0000 7f6638152700 1 -- 172.21.15.96:0/2668843578 wait complete. 2022-02-02T18:46:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 Processor -- start 2022-02-02T18:46:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 -- start start 2022-02-02T18:46:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f6860 0x7f663010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6630060420 con 0x7f66300f55c0 2022-02-02T18:46:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6638152700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6630060560 con 0x7f66300f6860 2022-02-02T18:46:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6635eee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6635eee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55854/0 (socket says 172.21.15.96:55854) 2022-02-02T18:46:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.117+0000 7f6635eee700 1 -- 172.21.15.96:0/2333846729 learned_addr learned my addr 172.21.15.96:0/2333846729 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f66356ed700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f6860 0x7f663010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6635eee700 1 -- 172.21.15.96:0/2333846729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f6860 msgr2=0x7f663010c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6635eee700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f6860 0x7f663010c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6635eee700 1 -- 172.21.15.96:0/2333846729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c005040 con 0x7f66300f55c0 2022-02-02T18:46:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6635eee700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f6620002700 tx=0x7f6620009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6620009320 con 0x7f66300f55c0 2022-02-02T18:46:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f662000f040 con 0x7f66300f55c0 2022-02-02T18:46:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663010c720 con 0x7f66300f55c0 2022-02-02T18:46:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6620014900 con 0x7f66300f55c0 2022-02-02T18:46:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.118+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663010ccb0 con 0x7f66300f55c0 2022-02-02T18:46:10.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.119+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66300f49b0 con 0x7f66300f55c0 2022-02-02T18:46:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.120+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6620009480 con 0x7f66300f55c0 2022-02-02T18:46:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.120+0000 7f66267fc700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 0x7f661c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.120+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6620081d10 con 0x7f66300f55c0 2022-02-02T18:46:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.120+0000 7f66356ed700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 0x7f661c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.120+0000 7f66356ed700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 0x7f661c067290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f662c004630 tx=0x7f662c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.124+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f662004fe80 con 0x7f66300f55c0 2022-02-02T18:46:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.302+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6630057f10 con 0x7f661c064dd0 2022-02-02T18:46:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.303+0000 7f66267fc700 1 -- 172.21.15.96:0/2333846729 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6630057f10 con 0x7f661c064dd0 2022-02-02T18:46:10.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 msgr2=0x7f661c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 0x7f661c067290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f662c004630 tx=0x7f662c009b30).stop 2022-02-02T18:46:10.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 msgr2=0x7f6630109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f6620002700 tx=0x7f6620009d80).stop 2022-02-02T18:46:10.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 shutdown_connections 2022-02-02T18:46:10.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f661c064dd0 0x7f661c067290 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66300f55c0 0x7f6630109c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 --2- 172.21.15.96:0/2333846729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66300f6860 0x7f663010c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 >> 172.21.15.96:0/2333846729 conn(0x7f66300f0d40 msgr2=0x7f66300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 shutdown_connections 2022-02-02T18:46:10.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.305+0000 7f6638152700 1 -- 172.21.15.96:0/2333846729 wait complete. 2022-02-02T18:46:10.311 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:46:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 -- 172.21.15.96:0/4165097308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 msgr2=0x7fe6100f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4165097308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f4c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe600004660 tx=0x7fe600009b30).stop 2022-02-02T18:46:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 -- 172.21.15.96:0/4165097308 shutdown_connections 2022-02-02T18:46:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4165097308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6100f51a0 0x7fe6100f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4165097308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f4c20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 -- 172.21.15.96:0/4165097308 >> 172.21.15.96:0/4165097308 conn(0x7fe6100f0320 msgr2=0x7fe6100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.404+0000 7fe60f59e700 1 -- 172.21.15.96:0/4165097308 shutdown_connections 2022-02-02T18:46:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 -- 172.21.15.96:0/4165097308 wait complete. 2022-02-02T18:46:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 Processor -- start 2022-02-02T18:46:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 -- start start 2022-02-02T18:46:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6100f51a0 0x7fe6100f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100f5e20 con 0x7fe6100f4800 2022-02-02T18:46:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100f5f60 con 0x7fe6100f51a0 2022-02-02T18:46:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55864/0 (socket says 172.21.15.96:55864) 2022-02-02T18:46:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.405+0000 7fe60e59c700 1 -- 172.21.15.96:0/4172165718 learned_addr learned my addr 172.21.15.96:0/4172165718 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60e59c700 1 -- 172.21.15.96:0/4172165718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6100f51a0 msgr2=0x7fe6100f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60e59c700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6100f51a0 0x7fe6100f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60e59c700 1 -- 172.21.15.96:0/4172165718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600005040 con 0x7fe6100f4800 2022-02-02T18:46:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60e59c700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe600000c00 tx=0x7fe600009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe600018070 con 0x7fe6100f4800 2022-02-02T18:46:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6100f61e0 con 0x7fe6100f4800 2022-02-02T18:46:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe600007d70 con 0x7fe6100f4800 2022-02-02T18:46:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60001c620 con 0x7fe6100f4800 2022-02-02T18:46:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.406+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61010ee20 con 0x7fe6100f4800 2022-02-02T18:46:10.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.407+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe610045ad0 con 0x7fe6100f4800 2022-02-02T18:46:10.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.407+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe60001c860 con 0x7fe6100f4800 2022-02-02T18:46:10.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.408+0000 7fe5feffd700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 0x7fe5f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.408+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe600083930 con 0x7fe6100f4800 2022-02-02T18:46:10.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.408+0000 7fe60dd9b700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 0x7fe5f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.408+0000 7fe60dd9b700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 0x7fe5f80672e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe6100f55e0 tx=0x7fe604006b50).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.412+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe6000519e0 con 0x7fe6100f4800 2022-02-02T18:46:10.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.586+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6100feed0 con 0x7fe5f8064e20 2022-02-02T18:46:10.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.595+0000 7fe5feffd700 1 -- 172.21.15.96:0/4172165718 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe6100feed0 con 0x7fe5f8064e20 2022-02-02T18:46:10.591 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:46:10.591 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (29m) 9s ago 30m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:46:10.591 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (21m) 9s ago 30m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:46:10.592 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (21m) 8m ago 30m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:46:10.592 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (29m) 9s ago 30m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:46:10.592 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (26m) 9s ago 26m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:46:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (22m) 9s ago 26m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:46:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (26m) 8m ago 26m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:46:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (22m) 8m ago 26m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:46:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (23m) 9s ago 31m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:46:10.594 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (23m) 8m ago 30m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:46:10.594 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (22m) 9s ago 31m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:46:10.594 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (22m) 8m ago 30m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:46:10.594 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (30m) 9s ago 30m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:46:10.594 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (29m) 8m ago 29m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:46:10.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (21m) 9s ago 29m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:46:10.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (21m) 9s ago 29m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:46:10.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (20m) 9s ago 28m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:46:10.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (19m) 8m ago 28m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:46:10.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (19m) 8m ago 28m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:46:10.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (18m) 8m ago 27m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:46:10.596 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (29m) 9s ago 30m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:46:10.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.596+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 msgr2=0x7fe5f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.596+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 0x7fe5f80672e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe6100f55e0 tx=0x7fe604006b50).stop 2022-02-02T18:46:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.596+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 msgr2=0x7fe6100f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.596+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe600000c00 tx=0x7fe600009b30).stop 2022-02-02T18:46:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 shutdown_connections 2022-02-02T18:46:10.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f8064e20 0x7fe5f80672e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6100f4800 0x7fe6100f73b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 --2- 172.21.15.96:0/4172165718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6100f51a0 0x7fe6100f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:10.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 >> 172.21.15.96:0/4172165718 conn(0x7fe6100f0320 msgr2=0x7fe6100fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 shutdown_connections 2022-02-02T18:46:10.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.597+0000 7fe60f59e700 1 -- 172.21.15.96:0/4172165718 wait complete. 2022-02-02T18:46:10.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 -- 172.21.15.96:0/4277719916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f66e0 msgr2=0x7f8d3c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/4277719916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c0f6b00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8d2c004660 tx=0x7f8d2c009b30).stop 2022-02-02T18:46:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 -- 172.21.15.96:0/4277719916 shutdown_connections 2022-02-02T18:46:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/4277719916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/4277719916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c0f6b00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 -- 172.21.15.96:0/4277719916 >> 172.21.15.96:0/4277719916 conn(0x7f8d3c0f1e40 msgr2=0x7f8d3c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:10 smithi096 ceph-mon[101353]: pgmap v721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:10.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 -- 172.21.15.96:0/4277719916 shutdown_connections 2022-02-02T18:46:10.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.693+0000 7f8d43e8a700 1 -- 172.21.15.96:0/4277719916 wait complete. 2022-02-02T18:46:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 Processor -- start 2022-02-02T18:46:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 -- start start 2022-02-02T18:46:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c06a380 con 0x7f8d3c0f7980 2022-02-02T18:46:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d43e8a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c06a4c0 con 0x7f8d3c0f66e0 2022-02-02T18:46:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d41425700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d41425700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55876/0 (socket says 172.21.15.96:55876) 2022-02-02T18:46:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d41425700 1 -- 172.21.15.96:0/643397528 learned_addr learned my addr 172.21.15.96:0/643397528 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.694+0000 7f8d41c26700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d41425700 1 -- 172.21.15.96:0/643397528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f66e0 msgr2=0x7f8d3c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d41425700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d41425700 1 -- 172.21.15.96:0/643397528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c005040 con 0x7f8d3c0f7980 2022-02-02T18:46:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d41425700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8d380026d0 tx=0x7f8d38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d380079c0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d3800f040 con 0x7f8d3c0f7980 2022-02-02T18:46:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c06a7a0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c10f020 con 0x7f8d3c0f7980 2022-02-02T18:46:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.695+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d380137c0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.696+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d24004fa0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.697+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d380090d0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.697+0000 7f8d327fc700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 0x7f8d28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.697+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8d380818f0 con 0x7f8d3c0f7980 2022-02-02T18:46:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.697+0000 7f8d41c26700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 0x7f8d28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.698+0000 7f8d41c26700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 0x7f8d28067290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f8d2c013690 tx=0x7f8d2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.701+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d3804fa50 con 0x7f8d3c0f7980 2022-02-02T18:46:10.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:10 smithi159 ceph-mon[69013]: pgmap v721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.932+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d24005e80 con 0x7f8d3c0f7980 2022-02-02T18:46:10.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.933+0000 7f8d327fc700 1 -- 172.21.15.96:0/643397528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8d38053070 con 0x7f8d3c0f7980 2022-02-02T18:46:10.929 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:46:10.929 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:46:10.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:46:10.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:10.930 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:46:10.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:46:10.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:10.931 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:46:10.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:46:10.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:10.932 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:46:10.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:46:10.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:10.932 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:46:10.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:46:10.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:46:10.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:46:10.933 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:46:10.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 msgr2=0x7f8d28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 0x7f8d28067290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f8d2c013690 tx=0x7f8d2c009b30).stop 2022-02-02T18:46:10.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 msgr2=0x7f8d3c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:10.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8d380026d0 tx=0x7f8d38009de0).stop 2022-02-02T18:46:10.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 shutdown_connections 2022-02-02T18:46:10.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064dd0 0x7f8d28067290 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d3c0f66e0 0x7f8d3c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 --2- 172.21.15.96:0/643397528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d3c0f7980 0x7f8d3c069e20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:10.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 >> 172.21.15.96:0/643397528 conn(0x7f8d3c0f1e40 msgr2=0x7f8d3c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:10.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 shutdown_connections 2022-02-02T18:46:10.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:10.934+0000 7f8d43e8a700 1 -- 172.21.15.96:0/643397528 wait complete. 2022-02-02T18:46:11.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 -- 172.21.15.96:0/3088816290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5430 msgr2=0x7f30f00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:11.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 --2- 172.21.15.96:0/3088816290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5430 0x7f30f00f5850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f30e0004660 tx=0x7f30e0009b30).stop 2022-02-02T18:46:11.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 -- 172.21.15.96:0/3088816290 shutdown_connections 2022-02-02T18:46:11.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 --2- 172.21.15.96:0/3088816290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f66d0 0x7f30f00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:11.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 --2- 172.21.15.96:0/3088816290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5430 0x7f30f00f5850 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:11.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 -- 172.21.15.96:0/3088816290 >> 172.21.15.96:0/3088816290 conn(0x7f30f00f0b90 msgr2=0x7f30f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:11.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 -- 172.21.15.96:0/3088816290 shutdown_connections 2022-02-02T18:46:11.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.031+0000 7f30f4949700 1 -- 172.21.15.96:0/3088816290 wait complete. 2022-02-02T18:46:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 Processor -- start 2022-02-02T18:46:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 -- start start 2022-02-02T18:46:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 0x7f30f00f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00f8000 con 0x7f30f00f66d0 2022-02-02T18:46:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30f4949700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00f8140 con 0x7f30f00f5430 2022-02-02T18:46:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.032+0000 7f30ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55886/0 (socket says 172.21.15.96:55886) 2022-02-02T18:46:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30ee59c700 1 -- 172.21.15.96:0/1796512068 learned_addr learned my addr 172.21.15.96:0/1796512068 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30eed9d700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 0x7f30f00f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30ee59c700 1 -- 172.21.15.96:0/1796512068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 msgr2=0x7f30f00f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30ee59c700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 0x7f30f00f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30ee59c700 1 -- 172.21.15.96:0/1796512068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0005040 con 0x7f30f00f66d0 2022-02-02T18:46:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30eed9d700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 0x7f30f00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:46:11.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30ee59c700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f30e400b410 tx=0x7f30e4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:11.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e40125f0 con 0x7f30f00f66d0 2022-02-02T18:46:11.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30e4012c00 con 0x7f30f00f66d0 2022-02-02T18:46:11.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00f8420 con 0x7f30f00f66d0 2022-02-02T18:46:11.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e4002ae0 con 0x7f30f00f66d0 2022-02-02T18:46:11.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.033+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f010edb0 con 0x7f30f00f66d0 2022-02-02T18:46:11.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.034+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0045ad0 con 0x7f30f00f66d0 2022-02-02T18:46:11.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.035+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f30e400f030 con 0x7f30f00f66d0 2022-02-02T18:46:11.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.035+0000 7f30d77fe700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 0x7f30d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:11.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.035+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f30e4081ef0 con 0x7f30f00f66d0 2022-02-02T18:46:11.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.035+0000 7f30eed9d700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 0x7f30d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:11.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.036+0000 7f30eed9d700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 0x7f30d80672e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f30f00f9320 tx=0x7f30e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:11.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.040+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f30e404ffa0 con 0x7f30f00f66d0 2022-02-02T18:46:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.240+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f30f00fdc70 con 0x7f30f00f66d0 2022-02-02T18:46:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.240+0000 7f30d77fe700 1 -- 172.21.15.96:0/1796512068 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f30e40535c0 con 0x7f30f00f66d0 2022-02-02T18:46:11.237 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:46:11.237 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:46:11.237 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:46:11.237 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:46:11.238 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:11.238 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:46:11.238 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:46:11.238 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:46:11.239 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:46:11.239 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:46:11.239 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:46:11.239 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:46:11.239 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:46:11.240 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:46:11.240 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:46:11.240 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:46:11.240 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:46:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:46:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:46:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:46:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:46:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:46:11.242 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:46:11.242 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:46:11.242 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:46:11.242 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:46:11.243 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:46:11.243 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:46:11.243 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:46:11.243 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:46:11.244 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:46:11.244 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:46:11.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:11.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:11.244 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:46:11.245 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:11.245 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:11.246 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:11.246 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:11.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.242+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 msgr2=0x7f30d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:11.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.242+0000 7f30f4949700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 0x7f30d80672e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f30f00f9320 tx=0x7f30e0009b30).stop 2022-02-02T18:46:11.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.242+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 msgr2=0x7f30f00f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:11.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.242+0000 7f30f4949700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f30e400b410 tx=0x7f30e4006ef0).stop 2022-02-02T18:46:11.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 shutdown_connections 2022-02-02T18:46:11.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30d8064e20 0x7f30d80672e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:11.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5430 0x7f30f00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:11.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 --2- 172.21.15.96:0/1796512068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f66d0 0x7f30f00f7a10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:11.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 >> 172.21.15.96:0/1796512068 conn(0x7f30f00f0b90 msgr2=0x7f30f005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:11.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 shutdown_connections 2022-02-02T18:46:11.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:11.243+0000 7f30f4949700 1 -- 172.21.15.96:0/1796512068 wait complete. 2022-02-02T18:46:11.250 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:46:11.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:11.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:11.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/643397528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:11.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1796512068' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:46:11.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:11.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:11.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/643397528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:11.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:11.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:11.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:11.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1796512068' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:46:12.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:12 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:12 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:12 smithi159 ceph-mon[69013]: pgmap v722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:12 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:12 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:12.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:12 smithi096 ceph-mon[101353]: pgmap v722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:14 smithi159 ceph-mon[69013]: pgmap v723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:14.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:14 smithi096 ceph-mon[101353]: pgmap v723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:16.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:16 smithi159 ceph-mon[69013]: pgmap v724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:16.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:16 smithi096 ceph-mon[101353]: pgmap v724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:18.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:18 smithi159 ceph-mon[69013]: pgmap v725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:18 smithi096 ceph-mon[101353]: pgmap v725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:20.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:20 smithi159 ceph-mon[69013]: pgmap v726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:20 smithi096 ceph-mon[101353]: pgmap v726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:21.519 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:21.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:21.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:21.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:21.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:21.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:23.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:23.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: pgmap v727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:23.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:23.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:23.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:23.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:22 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:23.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:23.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: pgmap v727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:23.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:23.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:23.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:23.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:23.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:22 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:24 smithi159 ceph-mon[69013]: pgmap v728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:25.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:24 smithi096 ceph-mon[101353]: pgmap v728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:26 smithi159 ceph-mon[69013]: pgmap v729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:27.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:26 smithi096 ceph-mon[101353]: pgmap v729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:46:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:46:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:46:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:46:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:28 smithi159 ceph-mon[69013]: pgmap v730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:28 smithi096 ceph-mon[101353]: pgmap v730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:30 smithi159 ceph-mon[69013]: pgmap v731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:30 smithi096 ceph-mon[101353]: pgmap v731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: pgmap v732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: pgmap v732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:33.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:33.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:33.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:33.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:33.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:33 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:34.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:33 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:34 smithi159 ceph-mon[69013]: pgmap v733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:35.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:34 smithi096 ceph-mon[101353]: pgmap v733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:37.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:36 smithi159 ceph-mon[69013]: pgmap v734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:36 smithi096 ceph-mon[101353]: pgmap v734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:38 smithi159 ceph-mon[69013]: pgmap v735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:38 smithi096 ceph-mon[101353]: pgmap v735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:40 smithi159 ceph-mon[69013]: pgmap v736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:41.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:40 smithi096 ceph-mon[101353]: pgmap v736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 -- 172.21.15.96:0/3240217051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 msgr2=0x7f3cfc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/3240217051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc0f59e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f3cf8004660 tx=0x7f3cf8009b30).stop 2022-02-02T18:46:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 -- 172.21.15.96:0/3240217051 shutdown_connections 2022-02-02T18:46:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/3240217051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 0x7f3cfc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/3240217051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc0f59e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 -- 172.21.15.96:0/3240217051 >> 172.21.15.96:0/3240217051 conn(0x7f3cfc0f0d40 msgr2=0x7f3cfc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:41.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 -- 172.21.15.96:0/3240217051 shutdown_connections 2022-02-02T18:46:41.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.354+0000 7f3d03e7d700 1 -- 172.21.15.96:0/3240217051 wait complete. 2022-02-02T18:46:41.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 Processor -- start 2022-02-02T18:46:41.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 -- start start 2022-02-02T18:46:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 0x7f3cfc10c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc060470 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d03e7d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0605b0 con 0x7f3cfc0f6860 2022-02-02T18:46:41.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d01c19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d01c19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55902/0 (socket says 172.21.15.96:55902) 2022-02-02T18:46:41.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d01c19700 1 -- 172.21.15.96:0/2628994372 learned_addr learned my addr 172.21.15.96:0/2628994372 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:41.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.355+0000 7f3d01418700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 0x7f3cfc10c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d01c19700 1 -- 172.21.15.96:0/2628994372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 msgr2=0x7f3cfc10c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d01c19700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 0x7f3cfc10c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d01c19700 1 -- 172.21.15.96:0/2628994372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8005040 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d01c19700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f3cf8004f60 tx=0x7f3cf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8018070 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3cf8007ba0 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc10c760 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf801c620 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.356+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc10cc90 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.357+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc0f49b0 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.358+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3cf801d420 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.358+0000 7f3cf27fc700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 0x7f3ce8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.358+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3cf80838f0 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.358+0000 7f3d01418700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 0x7f3ce8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.358+0000 7f3d01418700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 0x7f3ce8067290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3cec00b790 tx=0x7f3cec008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.363+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3cf80519a0 con 0x7f3cfc0f55c0 2022-02-02T18:46:41.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.539+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cfc0fdf40 con 0x7f3ce8064dd0 2022-02-02T18:46:41.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.540+0000 7f3cf27fc700 1 -- 172.21.15.96:0/2628994372 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3cfc0fdf40 con 0x7f3ce8064dd0 2022-02-02T18:46:41.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 msgr2=0x7f3ce8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 0x7f3ce8067290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3cec00b790 tx=0x7f3cec008040).stop 2022-02-02T18:46:41.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 msgr2=0x7f3cfc109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f3cf8004f60 tx=0x7f3cf8009b30).stop 2022-02-02T18:46:41.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 shutdown_connections 2022-02-02T18:46:41.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ce8064dd0 0x7f3ce8067290 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cfc0f55c0 0x7f3cfc109c60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 --2- 172.21.15.96:0/2628994372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cfc0f6860 0x7f3cfc10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 >> 172.21.15.96:0/2628994372 conn(0x7f3cfc0f0d40 msgr2=0x7f3cfc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:41.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 shutdown_connections 2022-02-02T18:46:41.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.542+0000 7f3d03e7d700 1 -- 172.21.15.96:0/2628994372 wait complete. 2022-02-02T18:46:41.548 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:46:41.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 -- 172.21.15.96:0/4235175267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 msgr2=0x7f40780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 --2- 172.21.15.96:0/4235175267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f40780f6cc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4068004660 tx=0x7f4068009b30).stop 2022-02-02T18:46:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 -- 172.21.15.96:0/4235175267 shutdown_connections 2022-02-02T18:46:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 --2- 172.21.15.96:0/4235175267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f40780f6cc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 --2- 172.21.15.96:0/4235175267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f40780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 -- 172.21.15.96:0/4235175267 >> 172.21.15.96:0/4235175267 conn(0x7f40780f0d40 msgr2=0x7f40780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 -- 172.21.15.96:0/4235175267 shutdown_connections 2022-02-02T18:46:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.649+0000 7f407dba0700 1 -- 172.21.15.96:0/4235175267 wait complete. 2022-02-02T18:46:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 Processor -- start 2022-02-02T18:46:41.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 -- start start 2022-02-02T18:46:41.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f4078109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40780603e0 con 0x7f40780f6860 2022-02-02T18:46:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f407dba0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078060520 con 0x7f40780f55c0 2022-02-02T18:46:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f4076ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f4076ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55914/0 (socket says 172.21.15.96:55914) 2022-02-02T18:46:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f4076ffd700 1 -- 172.21.15.96:0/1208452017 learned_addr learned my addr 172.21.15.96:0/1208452017 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.650+0000 7f40777fe700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f4078109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f4076ffd700 1 -- 172.21.15.96:0/1208452017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 msgr2=0x7f4078109c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f4076ffd700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f4078109c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f4076ffd700 1 -- 172.21.15.96:0/1208452017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068005040 con 0x7f40780f6860 2022-02-02T18:46:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f40777fe700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f4078109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:46:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f4076ffd700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4068018070 con 0x7f40780f6860 2022-02-02T18:46:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407810c6b0 con 0x7f40780f6860 2022-02-02T18:46:41.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407810cc10 con 0x7f40780f6860 2022-02-02T18:46:41.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4068007ca0 con 0x7f40780f6860 2022-02-02T18:46:41.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.651+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406801c620 con 0x7f40780f6860 2022-02-02T18:46:41.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.652+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c004fa0 con 0x7f40780f6860 2022-02-02T18:46:41.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.653+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f406801c890 con 0x7f40780f6860 2022-02-02T18:46:41.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.653+0000 7f406ffff700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 0x7f4064067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.653+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4068083690 con 0x7f40780f6860 2022-02-02T18:46:41.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.653+0000 7f40777fe700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 0x7f4064067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.653+0000 7f40777fe700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 0x7f4064067290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f4078060060 tx=0x7f4060009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.657+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4068051800 con 0x7f40780f6860 2022-02-02T18:46:41.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.830+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f405c000bc0 con 0x7f4064064dd0 2022-02-02T18:46:41.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.841+0000 7f406ffff700 1 -- 172.21.15.96:0/1208452017 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f405c000bc0 con 0x7f4064064dd0 2022-02-02T18:46:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:46:41.837 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (30m) 40s ago 31m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:46:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (22m) 40s ago 31m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:46:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (22m) 9m ago 30m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:46:41.838 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (29m) 40s ago 30m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:46:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (27m) 40s ago 27m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:46:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (22m) 40s ago 27m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:46:41.839 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (27m) 9m ago 27m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:46:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (23m) 9m ago 27m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:46:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (24m) 40s ago 32m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:46:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (23m) 9m ago 30m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:46:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (23m) 40s ago 32m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:46:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (23m) 9m ago 30m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:46:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (30m) 40s ago 30m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:46:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (30m) 9m ago 30m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:46:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (22m) 40s ago 29m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:46:41.841 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (21m) 40s ago 29m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:46:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (21m) 40s ago 29m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:46:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (20m) 9m ago 29m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:46:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (19m) 9m ago 28m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:46:41.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (19m) 9m ago 28m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:46:41.843 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (29m) 40s ago 30m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:46:41.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 msgr2=0x7f4064067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 0x7f4064067290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f4078060060 tx=0x7f4060009040).stop 2022-02-02T18:46:41.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 msgr2=0x7f407810c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009b30).stop 2022-02-02T18:46:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 shutdown_connections 2022-02-02T18:46:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064dd0 0x7f4064067290 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f55c0 0x7f4078109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 --2- 172.21.15.96:0/1208452017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6860 0x7f407810c160 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 >> 172.21.15.96:0/1208452017 conn(0x7f40780f0d40 msgr2=0x7f40780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 shutdown_connections 2022-02-02T18:46:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.843+0000 7f407dba0700 1 -- 172.21.15.96:0/1208452017 wait complete. 2022-02-02T18:46:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- 172.21.15.96:0/370463317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 msgr2=0x7f04ac0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 --2- 172.21.15.96:0/370463317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac0f7dd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f049c004660 tx=0x7f049c009b30).stop 2022-02-02T18:46:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- 172.21.15.96:0/370463317 shutdown_connections 2022-02-02T18:46:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 --2- 172.21.15.96:0/370463317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac0f7dd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 --2- 172.21.15.96:0/370463317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- 172.21.15.96:0/370463317 >> 172.21.15.96:0/370463317 conn(0x7f04ac0f1e10 msgr2=0x7f04ac0f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- 172.21.15.96:0/370463317 shutdown_connections 2022-02-02T18:46:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- 172.21.15.96:0/370463317 wait complete. 2022-02-02T18:46:41.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: pgmap v737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:41.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:41.938 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:41.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:41.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:41.939 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:41.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:41.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:41.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:41.940 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:41.941 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 Processor -- start 2022-02-02T18:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.939+0000 7f04b10e6700 1 -- start start 2022-02-02T18:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04b10e6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04b10e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04b10e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac107aa0 con 0x7f04ac0f7970 2022-02-02T18:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04b10e6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac108350 con 0x7f04ac0f66d0 2022-02-02T18:46:41.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55924/0 (socket says 172.21.15.96:55924) 2022-02-02T18:46:41.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 -- 172.21.15.96:0/2679244431 learned_addr learned my addr 172.21.15.96:0/2679244431 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:41.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aad9d700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 -- 172.21.15.96:0/2679244431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 msgr2=0x7f04ac106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:41.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:41.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 -- 172.21.15.96:0/2679244431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c005040 con 0x7f04ac0f7970 2022-02-02T18:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aad9d700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04aa59c700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f049c009990 tx=0x7f049c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.940+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f049c018070 con 0x7f04ac0f7970 2022-02-02T18:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.941+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac1085d0 con 0x7f04ac0f7970 2022-02-02T18:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.941+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac108b30 con 0x7f04ac0f7970 2022-02-02T18:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.941+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f049c007ca0 con 0x7f04ac0f7970 2022-02-02T18:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.941+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f049c01c3c0 con 0x7f04ac0f7970 2022-02-02T18:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.942+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c004fa0 con 0x7f04ac0f7970 2022-02-02T18:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.942+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f049c01d420 con 0x7f04ac0f7970 2022-02-02T18:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.942+0000 7f04937fe700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 0x7f0494067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.942+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f049c083450 con 0x7f04ac0f7970 2022-02-02T18:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.943+0000 7f04aad9d700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 0x7f0494067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.943+0000 7f04aad9d700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 0x7f0494067290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f04ac0f77d0 tx=0x7f04a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:41.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:41.947+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f049c054f30 con 0x7f04ac0f7970 2022-02-02T18:46:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: pgmap v737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:42.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:42.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:42.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:42.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:42.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:42.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:42.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:42.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.177+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f048c005e80 con 0x7f04ac0f7970 2022-02-02T18:46:42.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.177+0000 7f04937fe700 1 -- 172.21.15.96:0/2679244431 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f049c054b20 con 0x7f04ac0f7970 2022-02-02T18:46:42.174 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:46:42.175 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:46:42.175 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:46:42.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:42.175 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:46:42.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:46:42.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:42.176 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:46:42.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:46:42.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:42.177 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:46:42.177 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:46:42.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:46:42.177 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:46:42.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:46:42.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:46:42.178 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:46:42.178 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:46:42.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 msgr2=0x7f0494067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 0x7f0494067290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f04ac0f77d0 tx=0x7f04a0008040).stop 2022-02-02T18:46:42.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 msgr2=0x7f04ac107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f049c009990 tx=0x7f049c009b30).stop 2022-02-02T18:46:42.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 shutdown_connections 2022-02-02T18:46:42.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0494064dd0 0x7f0494067290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ac0f66d0 0x7f04ac106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 --2- 172.21.15.96:0/2679244431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ac0f7970 0x7f04ac107460 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 >> 172.21.15.96:0/2679244431 conn(0x7f04ac0f1e10 msgr2=0x7f04ac0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:42.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 shutdown_connections 2022-02-02T18:46:42.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.180+0000 7f04b10e6700 1 -- 172.21.15.96:0/2679244431 wait complete. 2022-02-02T18:46:42.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- 172.21.15.96:0/989689637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 msgr2=0x7efe000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 --2- 172.21.15.96:0/989689637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe000f59e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7efdf4004660 tx=0x7efdf4009b30).stop 2022-02-02T18:46:42.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- 172.21.15.96:0/989689637 shutdown_connections 2022-02-02T18:46:42.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 --2- 172.21.15.96:0/989689637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 0x7efe000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:46:42.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 --2- 172.21.15.96:0/989689637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe000f59e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- 172.21.15.96:0/989689637 >> 172.21.15.96:0/989689637 conn(0x7efe000f0d40 msgr2=0x7efe000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:42.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- 172.21.15.96:0/989689637 shutdown_connections 2022-02-02T18:46:42.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- 172.21.15.96:0/989689637 wait complete. 2022-02-02T18:46:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 Processor -- start 2022-02-02T18:46:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.277+0000 7efe04939700 1 -- start start 2022-02-02T18:46:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efe04939700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efe04939700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 0x7efe00109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efe04939700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00109cb0 con 0x7efe000f55c0 2022-02-02T18:46:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efe04939700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0010a560 con 0x7efe000f6860 2022-02-02T18:46:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55932/0 (socket says 172.21.15.96:55932) 2022-02-02T18:46:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 -- 172.21.15.96:0/1876833052 learned_addr learned my addr 172.21.15.96:0/1876833052 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:46:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfdd9b700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 0x7efe00109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:42.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 -- 172.21.15.96:0/1876833052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 msgr2=0x7efe00109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 0x7efe00109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 -- 172.21.15.96:0/1876833052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4005040 con 0x7efe000f55c0 2022-02-02T18:46:42.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdfe59c700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7efdf4004f60 tx=0x7efdf4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:42.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf4018070 con 0x7efe000f55c0 2022-02-02T18:46:42.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efdf4009770 con 0x7efe000f55c0 2022-02-02T18:46:42.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.278+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0010a7e0 con 0x7efe000f55c0 2022-02-02T18:46:42.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.279+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf401c3c0 con 0x7efe000f55c0 2022-02-02T18:46:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.279+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0010ad40 con 0x7efe000f55c0 2022-02-02T18:46:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.279+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe000f49b0 con 0x7efe000f55c0 2022-02-02T18:46:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.280+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efdf401d420 con 0x7efe000f55c0 2022-02-02T18:46:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.280+0000 7efdeeffd700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 0x7efde8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:46:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.280+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efdf4083890 con 0x7efe000f55c0 2022-02-02T18:46:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.280+0000 7efdfdd9b700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 0x7efde8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:46:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.281+0000 7efdfdd9b700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 0x7efde8067290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7efdf0006fd0 tx=0x7efdf0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:46:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.285+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efdf4055430 con 0x7efe000f55c0 2022-02-02T18:46:42.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.484+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe000fdf80 con 0x7efe000f55c0 2022-02-02T18:46:42.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.485+0000 7efdeeffd700 1 -- 172.21.15.96:0/1876833052 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efdf4055020 con 0x7efe000f55c0 2022-02-02T18:46:42.482 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:46:42.482 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:46:42.483 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:46:42.483 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:46:42.483 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:42.483 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:46:42.484 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:46:42.484 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:46:42.484 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:46:42.484 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:46:42.484 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:46:42.485 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:46:42.485 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:46:42.485 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:46:42.485 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:46:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:46:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:46:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:46:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:46:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:46:42.487 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:46:42.487 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:46:42.487 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:46:42.487 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:46:42.488 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:46:42.488 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:46:42.488 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:46:42.488 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:46:42.489 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:46:42.489 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:46:42.489 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:46:42.489 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:46:42.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:42.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:42.490 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:46:42.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:46:42.490 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:42.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:42.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 msgr2=0x7efde8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 0x7efde8067290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7efdf0006fd0 tx=0x7efdf0008040).stop 2022-02-02T18:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 msgr2=0x7efe00109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7efdf4004f60 tx=0x7efdf4009b30).stop 2022-02-02T18:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 shutdown_connections 2022-02-02T18:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efde8064dd0 0x7efde8067290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe000f55c0 0x7efe00109180 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 --2- 172.21.15.96:0/1876833052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe000f6860 0x7efe00109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 >> 172.21.15.96:0/1876833052 conn(0x7efe000f0d40 msgr2=0x7efe0005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 shutdown_connections 2022-02-02T18:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:46:42.487+0000 7efe04939700 1 -- 172.21.15.96:0/1876833052 wait complete. 2022-02-02T18:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:46:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:42 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:43.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:42 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:43.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:42 smithi159 ceph-mon[69013]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:43.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2679244431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:43.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1876833052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:46:43.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:42 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:43.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:42 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:43.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:42 smithi096 ceph-mon[101353]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:46:43.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2679244431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:43.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1876833052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:46:43.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:43 smithi159 ceph-mon[69013]: pgmap v738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:44.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:43 smithi096 ceph-mon[101353]: pgmap v738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:46.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:46 smithi159 ceph-mon[69013]: pgmap v739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:46 smithi096 ceph-mon[101353]: pgmap v739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:48.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:48 smithi159 ceph-mon[69013]: pgmap v740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:48 smithi096 ceph-mon[101353]: pgmap v740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:50 smithi159 ceph-mon[69013]: pgmap v741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:50 smithi096 ceph-mon[101353]: pgmap v741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: pgmap v742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:52 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: pgmap v742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:46:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:46:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:46:52.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:46:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:52.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:52 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:46:53.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:53 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:53.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:53 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:53.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:53 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:46:53.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:53 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:46:54.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:54 smithi159 ceph-mon[69013]: pgmap v743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:54 smithi096 ceph-mon[101353]: pgmap v743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:56.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:56 smithi159 ceph-mon[69013]: pgmap v744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:56 smithi096 ceph-mon[101353]: pgmap v744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:46:58 smithi159 ceph-mon[69013]: pgmap v745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:46:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:46:58 smithi096 ceph-mon[101353]: pgmap v745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:00 smithi159 ceph-mon[69013]: pgmap v746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:00 smithi096 ceph-mon[101353]: pgmap v746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:02.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: pgmap v747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:02.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:02 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: pgmap v747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:02.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:02.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:02 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:03.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:03 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:03.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:03 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:03.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:03 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:03.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:03 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:04.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:04 smithi159 ceph-mon[69013]: pgmap v748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:04.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:04 smithi096 ceph-mon[101353]: pgmap v748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:06.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:06 smithi159 ceph-mon[69013]: pgmap v749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:06.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:06 smithi096 ceph-mon[101353]: pgmap v749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:08 smithi159 ceph-mon[69013]: pgmap v750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:08 smithi096 ceph-mon[101353]: pgmap v750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:10.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:10 smithi159 ceph-mon[69013]: pgmap v751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:10.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:10 smithi096 ceph-mon[101353]: pgmap v751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:12.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- 172.21.15.96:0/3156170822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 msgr2=0x7f573c0fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 --2- 172.21.15.96:0/3156170822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0fbc40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f572c004660 tx=0x7f572c009b30).stop 2022-02-02T18:47:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- 172.21.15.96:0/3156170822 shutdown_connections 2022-02-02T18:47:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 --2- 172.21.15.96:0/3156170822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0fbc40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 --2- 172.21.15.96:0/3156170822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 0x7f573c0f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- 172.21.15.96:0/3156170822 >> 172.21.15.96:0/3156170822 conn(0x7f573c0f0de0 msgr2=0x7f573c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- 172.21.15.96:0/3156170822 shutdown_connections 2022-02-02T18:47:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- 172.21.15.96:0/3156170822 wait complete. 2022-02-02T18:47:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 Processor -- start 2022-02-02T18:47:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 -- start start 2022-02-02T18:47:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 0x7f573c0f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.597+0000 7f5744547700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5744547700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0f57c0 con 0x7f573c0f9850 2022-02-02T18:47:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5744547700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0f5900 con 0x7f573c060390 2022-02-02T18:47:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55960/0 (socket says 172.21.15.96:55960) 2022-02-02T18:47:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 -- 172.21.15.96:0/3945897220 learned_addr learned my addr 172.21.15.96:0/3945897220 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f57422e3700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 0x7f573c0f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 -- 172.21.15.96:0/3945897220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 msgr2=0x7f573c0f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 0x7f573c0f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 -- 172.21.15.96:0/3945897220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c005040 con 0x7f573c0f9850 2022-02-02T18:47:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5741ae2700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f572c009990 tx=0x7f572c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f572c018070 con 0x7f573c0f9850 2022-02-02T18:47:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f572c007ba0 con 0x7f573c0f9850 2022-02-02T18:47:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c0f5b80 con 0x7f573c0f9850 2022-02-02T18:47:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f572c01c3c0 con 0x7f573c0f9850 2022-02-02T18:47:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.598+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0f60e0 con 0x7f573c0f9850 2022-02-02T18:47:12.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.599+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c045ad0 con 0x7f573c0f9850 2022-02-02T18:47:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.600+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f572c01d420 con 0x7f573c0f9850 2022-02-02T18:47:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.600+0000 7f5732ffd700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 0x7f5728067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.600+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f572c083700 con 0x7f573c0f9850 2022-02-02T18:47:12.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.601+0000 7f57422e3700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 0x7f5728067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.601+0000 7f57422e3700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 0x7f5728067290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f573c0f6b70 tx=0x7f573800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:12.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.605+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f572c051810 con 0x7f573c0f9850 2022-02-02T18:47:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: pgmap v752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:12.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:12 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.783+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f573c0ff020 con 0x7f5728064dd0 2022-02-02T18:47:12.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: pgmap v752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:12.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:12.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:12.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:12.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:12.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:12.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:12 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:12.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.784+0000 7f5732ffd700 1 -- 172.21.15.96:0/3945897220 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f573c0ff020 con 0x7f5728064dd0 2022-02-02T18:47:12.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 msgr2=0x7f5728067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 0x7f5728067290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f573c0f6b70 tx=0x7f573800b040).stop 2022-02-02T18:47:12.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 msgr2=0x7f573c0f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f572c009990 tx=0x7f572c009b30).stop 2022-02-02T18:47:12.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 shutdown_connections 2022-02-02T18:47:12.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5728064dd0 0x7f5728067290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f573c060390 0x7f573c0f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 --2- 172.21.15.96:0/3945897220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f573c0f9850 0x7f573c0f5260 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 >> 172.21.15.96:0/3945897220 conn(0x7f573c0f0de0 msgr2=0x7f573c0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:12.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 shutdown_connections 2022-02-02T18:47:12.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.786+0000 7f5744547700 1 -- 172.21.15.96:0/3945897220 wait complete. 2022-02-02T18:47:12.793 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:47:12.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 -- 172.21.15.96:0/1083930658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 msgr2=0x7fd0100f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 --2- 172.21.15.96:0/1083930658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd0100f5850 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fd000004660 tx=0x7fd000009b30).stop 2022-02-02T18:47:12.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 -- 172.21.15.96:0/1083930658 shutdown_connections 2022-02-02T18:47:12.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 --2- 172.21.15.96:0/1083930658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 0x7fd0100f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 --2- 172.21.15.96:0/1083930658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd0100f5850 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 -- 172.21.15.96:0/1083930658 >> 172.21.15.96:0/1083930658 conn(0x7fd0100f0b90 msgr2=0x7fd0100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:12.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 -- 172.21.15.96:0/1083930658 shutdown_connections 2022-02-02T18:47:12.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.883+0000 7fd00ffff700 1 -- 172.21.15.96:0/1083930658 wait complete. 2022-02-02T18:47:12.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 Processor -- start 2022-02-02T18:47:12.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 -- start start 2022-02-02T18:47:12.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 0x7fd0101061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010106760 con 0x7fd0100f5430 2022-02-02T18:47:12.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.884+0000 7fd00ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd010106f60 con 0x7fd0100f66d0 2022-02-02T18:47:12.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55968/0 (socket says 172.21.15.96:55968) 2022-02-02T18:47:12.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 -- 172.21.15.96:0/2689283435 learned_addr learned my addr 172.21.15.96:0/2689283435 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:12.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00e7fc700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 0x7fd0101061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 -- 172.21.15.96:0/2689283435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 msgr2=0x7fd0101061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:12.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 0x7fd0101061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:12.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 -- 172.21.15.96:0/2689283435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000005040 con 0x7fd0100f5430 2022-02-02T18:47:12.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00effd700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fd000000c00 tx=0x7fd000009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:12.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd000018070 con 0x7fd0100f5430 2022-02-02T18:47:12.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0101071e0 con 0x7fd0100f5430 2022-02-02T18:47:12.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd000007d70 con 0x7fd0100f5430 2022-02-02T18:47:12.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00001c620 con 0x7fd0100f5430 2022-02-02T18:47:12.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.885+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd010107740 con 0x7fd0100f5430 2022-02-02T18:47:12.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.886+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd010059100 con 0x7fd0100f5430 2022-02-02T18:47:12.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.887+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd00001c860 con 0x7fd0100f5430 2022-02-02T18:47:12.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.887+0000 7fcff77fe700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 0x7fcff80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:12.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.887+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd000083950 con 0x7fd0100f5430 2022-02-02T18:47:12.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.887+0000 7fd00e7fc700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 0x7fcff80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:12.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.888+0000 7fd00e7fc700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 0x7fcff80672e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd004007fd0 tx=0x7fd004009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:12.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:12.891+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd000055430 con 0x7fd0100f5430 2022-02-02T18:47:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.062+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0100fdcb0 con 0x7fcff8064e20 2022-02-02T18:47:13.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.072+0000 7fcff77fe700 1 -- 172.21.15.96:0/2689283435 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd0100fdcb0 con 0x7fcff8064e20 2022-02-02T18:47:13.069 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:47:13.069 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (30m) 71s ago 31m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:47:13.069 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (23m) 71s ago 31m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:47:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (22m) 9m ago 31m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:47:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (30m) 71s ago 31m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:47:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (27m) 71s ago 27m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:47:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (23m) 71s ago 27m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:47:13.071 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (27m) 9m ago 27m 5341M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:47:13.071 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (23m) 9m ago 27m 17.9M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:47:13.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (24m) 71s ago 32m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:47:13.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (24m) 9m ago 31m 421M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:47:13.071 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (23m) 71s ago 32m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:47:13.072 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (23m) 9m ago 31m 72.3M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:47:13.072 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (31m) 71s ago 31m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:47:13.072 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (30m) 9m ago 30m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:47:13.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (22m) 71s ago 30m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:47:13.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (22m) 71s ago 30m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:47:13.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (21m) 71s ago 29m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:47:13.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (20m) 9m ago 29m 316M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:47:13.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (20m) 9m ago 29m 286M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:47:13.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (20m) 9m ago 28m 700M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:47:13.074 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (30m) 71s ago 31m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:47:13.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 msgr2=0x7fcff80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 0x7fcff80672e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd004007fd0 tx=0x7fd004009040).stop 2022-02-02T18:47:13.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 msgr2=0x7fd010105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fd000000c00 tx=0x7fd000009b30).stop 2022-02-02T18:47:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 shutdown_connections 2022-02-02T18:47:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064e20 0x7fcff80672e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0100f5430 0x7fd010105cc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 --2- 172.21.15.96:0/2689283435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0100f66d0 0x7fd0101061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 >> 172.21.15.96:0/2689283435 conn(0x7fd0100f0b90 msgr2=0x7fd0100fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:13.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 shutdown_connections 2022-02-02T18:47:13.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.074+0000 7fd00ffff700 1 -- 172.21.15.96:0/2689283435 wait complete. 2022-02-02T18:47:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 -- 172.21.15.96:0/1685464401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f66d0 msgr2=0x7f7d080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/1685464401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f66d0 0x7f7d080f6b30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f7cfc004660 tx=0x7f7cfc009b30).stop 2022-02-02T18:47:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 -- 172.21.15.96:0/1685464401 shutdown_connections 2022-02-02T18:47:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/1685464401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f66d0 0x7f7d080f6b30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/1685464401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f5430 0x7f7d080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 -- 172.21.15.96:0/1685464401 >> 172.21.15.96:0/1685464401 conn(0x7f7d080f0b90 msgr2=0x7f7d080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 -- 172.21.15.96:0/1685464401 shutdown_connections 2022-02-02T18:47:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.170+0000 7f7d0cadb700 1 -- 172.21.15.96:0/1685464401 wait complete. 2022-02-02T18:47:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 Processor -- start 2022-02-02T18:47:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 -- start start 2022-02-02T18:47:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f66d0 0x7f7d0810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080603c0 con 0x7f7d080f5430 2022-02-02T18:47:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d0cadb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08060500 con 0x7f7d080f66d0 2022-02-02T18:47:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55978/0 (socket says 172.21.15.96:55978) 2022-02-02T18:47:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.171+0000 7f7d077fe700 1 -- 172.21.15.96:0/402415186 learned_addr learned my addr 172.21.15.96:0/402415186 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d06ffd700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f66d0 0x7f7d0810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d077fe700 1 -- 172.21.15.96:0/402415186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f66d0 msgr2=0x7f7d0810bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d077fe700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f66d0 0x7f7d0810bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d077fe700 1 -- 172.21.15.96:0/402415186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc005040 con 0x7f7d080f5430 2022-02-02T18:47:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d077fe700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f7cf8002700 tx=0x7f7cf8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf80079c0 con 0x7f7d080f5430 2022-02-02T18:47:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cf800f040 con 0x7f7d080f5430 2022-02-02T18:47:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0810c4f0 con 0x7f7d080f5430 2022-02-02T18:47:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf8014860 con 0x7f7d080f5430 2022-02-02T18:47:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.172+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0810ca80 con 0x7f7d080f5430 2022-02-02T18:47:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.173+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08059100 con 0x7f7d080f5430 2022-02-02T18:47:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.174+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cf801b060 con 0x7f7d080f5430 2022-02-02T18:47:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.174+0000 7f7ceffff700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 0x7f7cf00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.174+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7cf8081860 con 0x7f7d080f5430 2022-02-02T18:47:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.174+0000 7f7d06ffd700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 0x7f7cf00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.174+0000 7f7d06ffd700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 0x7f7cf00672e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f7cfc004630 tx=0x7f7cfc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.178+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cf804f910 con 0x7f7d080f5430 2022-02-02T18:47:13.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.412+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d080586e0 con 0x7f7d080f5430 2022-02-02T18:47:13.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.413+0000 7f7ceffff700 1 -- 172.21.15.96:0/402415186 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7cf80192e0 con 0x7f7d080f5430 2022-02-02T18:47:13.410 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:47:13.410 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:47:13.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:47:13.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:13.411 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:47:13.411 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:47:13.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:13.412 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:47:13.412 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:47:13.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:13.412 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:47:13.413 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:47:13.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:13.413 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:47:13.413 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:47:13.413 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:47:13.414 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:47:13.414 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:47:13.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 msgr2=0x7f7cf00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 0x7f7cf00672e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f7cfc004630 tx=0x7f7cfc009b30).stop 2022-02-02T18:47:13.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 msgr2=0x7f7d08109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f7cf8002700 tx=0x7f7cf8009d80).stop 2022-02-02T18:47:13.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 shutdown_connections 2022-02-02T18:47:13.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cf0064e20 0x7f7cf00672e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d080f5430 0x7f7d08109a40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 --2- 172.21.15.96:0/402415186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d080f66d0 0x7f7d0810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 >> 172.21.15.96:0/402415186 conn(0x7f7d080f0b90 msgr2=0x7f7d080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:13.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 shutdown_connections 2022-02-02T18:47:13.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.415+0000 7f7d0cadb700 1 -- 172.21.15.96:0/402415186 wait complete. 2022-02-02T18:47:13.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 -- 172.21.15.96:0/1370084232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f5430 msgr2=0x7f89dc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 --2- 172.21.15.96:0/1370084232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f5430 0x7f89dc0f5850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f89d0004660 tx=0x7f89d0009b30).stop 2022-02-02T18:47:13.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 -- 172.21.15.96:0/1370084232 shutdown_connections 2022-02-02T18:47:13.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 --2- 172.21.15.96:0/1370084232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f66d0 0x7f89dc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:47:13.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 --2- 172.21.15.96:0/1370084232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f5430 0x7f89dc0f5850 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 -- 172.21.15.96:0/1370084232 >> 172.21.15.96:0/1370084232 conn(0x7f89dc0f0b90 msgr2=0x7f89dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:13.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.513+0000 7f89e1c24700 1 -- 172.21.15.96:0/1370084232 shutdown_connections 2022-02-02T18:47:13.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 -- 172.21.15.96:0/1370084232 wait complete. 2022-02-02T18:47:13.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 Processor -- start 2022-02-02T18:47:13.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 -- start start 2022-02-02T18:47:13.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f5430 0x7f89dc105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc106880 con 0x7f89dc0f66d0 2022-02-02T18:47:13.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89e1c24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc106ff0 con 0x7f89dc0f5430 2022-02-02T18:47:13.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55990/0 (socket says 172.21.15.96:55990) 2022-02-02T18:47:13.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.514+0000 7f89dbfff700 1 -- 172.21.15.96:0/618214778 learned_addr learned my addr 172.21.15.96:0/618214778 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:13.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89e0c22700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f5430 0x7f89dc105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89dbfff700 1 -- 172.21.15.96:0/618214778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f5430 msgr2=0x7f89dc105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89dbfff700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f5430 0x7f89dc105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89dbfff700 1 -- 172.21.15.96:0/618214778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0005040 con 0x7f89dc0f66d0 2022-02-02T18:47:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89dbfff700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f89c800b410 tx=0x7f89c8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c80125f0 con 0x7f89dc0f66d0 2022-02-02T18:47:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89c800be30 con 0x7f89dc0f66d0 2022-02-02T18:47:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc1072d0 con 0x7f89dc0f66d0 2022-02-02T18:47:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c8002a70 con 0x7f89dc0f66d0 2022-02-02T18:47:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.515+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc107890 con 0x7f89dc0f66d0 2022-02-02T18:47:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.516+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc045ad0 con 0x7f89dc0f66d0 2022-02-02T18:47:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.516+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f89c800f030 con 0x7f89dc0f66d0 2022-02-02T18:47:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.517+0000 7f89d97fa700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 0x7f89cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.517+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f89c8081eb0 con 0x7f89dc0f66d0 2022-02-02T18:47:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.517+0000 7f89e0c22700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 0x7f89cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.517+0000 7f89e0c22700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 0x7f89cc0672e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f89d0004630 tx=0x7f89d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.521+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f89c8053990 con 0x7f89dc0f66d0 2022-02-02T18:47:13.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.723+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89dc0ff680 con 0x7f89dc0f66d0 2022-02-02T18:47:13.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:13 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:13.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:13 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:13.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/402415186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:13.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.723+0000 7f89d97fa700 1 -- 172.21.15.96:0/618214778 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f89c8053580 con 0x7f89dc0f66d0 2022-02-02T18:47:13.721 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:47:13.722 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:47:13.722 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:47:13.722 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:47:13.722 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:13.723 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:47:13.723 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:47:13.723 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:47:13.723 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:47:13.724 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:47:13.724 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:47:13.724 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:47:13.724 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:47:13.724 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:47:13.725 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:47:13.725 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:47:13.725 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:47:13.725 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:47:13.726 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:47:13.726 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:47:13.726 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:47:13.726 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:47:13.727 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:47:13.727 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:47:13.727 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:47:13.727 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:47:13.727 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:47:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:47:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:47:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:47:13.728 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:47:13.729 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:47:13.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:13.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:13.729 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:47:13.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:13.730 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:13.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 msgr2=0x7f89cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 0x7f89cc0672e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f89d0004630 tx=0x7f89d0009b30).stop 2022-02-02T18:47:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 msgr2=0x7f89dc106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f89c800b410 tx=0x7f89c8006ef0).stop 2022-02-02T18:47:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 shutdown_connections 2022-02-02T18:47:13.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89cc064e20 0x7f89cc0672e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0f5430 0x7f89dc105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 --2- 172.21.15.96:0/618214778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89dc0f66d0 0x7f89dc106240 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:13.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 >> 172.21.15.96:0/618214778 conn(0x7f89dc0f0b90 msgr2=0x7f89dc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:13.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 shutdown_connections 2022-02-02T18:47:13.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:13.725+0000 7f89e1c24700 1 -- 172.21.15.96:0/618214778 wait complete. 2022-02-02T18:47:13.734 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:47:13.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:13 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:13 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:13.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/402415186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:14.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:14 smithi159 ceph-mon[69013]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:14 smithi159 ceph-mon[69013]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:14 smithi159 ceph-mon[69013]: pgmap v753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:14.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/618214778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:47:14.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:14 smithi096 ceph-mon[101353]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:14.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:14 smithi096 ceph-mon[101353]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:14 smithi096 ceph-mon[101353]: pgmap v753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:14.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/618214778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:47:16.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:16 smithi159 ceph-mon[69013]: pgmap v754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:16.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:16 smithi096 ceph-mon[101353]: pgmap v754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:18.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:18 smithi159 ceph-mon[69013]: pgmap v755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:18 smithi096 ceph-mon[101353]: pgmap v755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:20.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:20 smithi159 ceph-mon[69013]: pgmap v756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:20 smithi096 ceph-mon[101353]: pgmap v756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:22.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: pgmap v757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:22.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:22 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: pgmap v757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:22.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:22 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:23.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:23 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:23.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:23 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:23.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:23 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:23.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:23 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:24.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:24 smithi159 ceph-mon[69013]: pgmap v758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:24.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:24 smithi096 ceph-mon[101353]: pgmap v758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:26.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:26 smithi159 ceph-mon[69013]: pgmap v759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:26 smithi096 ceph-mon[101353]: pgmap v759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:27.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:47:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:47:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:47:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:47:28.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:28 smithi159 ceph-mon[69013]: pgmap v760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:28 smithi096 ceph-mon[101353]: pgmap v760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:30 smithi159 ceph-mon[69013]: pgmap v761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:30.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:30 smithi096 ceph-mon[101353]: pgmap v761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:32.519 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:32 smithi159 ceph-mon[69013]: pgmap v762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:32.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:32.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:32.520 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:32 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:32.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:32 smithi096 ceph-mon[101353]: pgmap v762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:32.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:32.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:32 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:33.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:33 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:33.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:33 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:34.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:34 smithi159 ceph-mon[69013]: pgmap v763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:34.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:34 smithi096 ceph-mon[101353]: pgmap v763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: pgmap v764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: pgmap v764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:37.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:37 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:37 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:38 smithi159 ceph-mon[69013]: pgmap v765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:38 smithi096 ceph-mon[101353]: pgmap v765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:40 smithi159 ceph-mon[69013]: pgmap v766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:40 smithi096 ceph-mon[101353]: pgmap v766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:42.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:42 smithi159 ceph-mon[69013]: pgmap v767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:42 smithi096 ceph-mon[101353]: pgmap v767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:43.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 -- 172.21.15.96:0/4120785644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f55c0 msgr2=0x7f97440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:43.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 --2- 172.21.15.96:0/4120785644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f55c0 0x7f97440f59e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f9734004660 tx=0x7f9734009b30).stop 2022-02-02T18:47:43.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 -- 172.21.15.96:0/4120785644 shutdown_connections 2022-02-02T18:47:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 --2- 172.21.15.96:0/4120785644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f6860 0x7f97440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:47:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 --2- 172.21.15.96:0/4120785644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f55c0 0x7f97440f59e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 -- 172.21.15.96:0/4120785644 >> 172.21.15.96:0/4120785644 conn(0x7f97440f0d40 msgr2=0x7f97440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 -- 172.21.15.96:0/4120785644 shutdown_connections 2022-02-02T18:47:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.836+0000 7f974a813700 1 -- 172.21.15.96:0/4120785644 wait complete. 2022-02-02T18:47:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 Processor -- start 2022-02-02T18:47:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 -- start start 2022-02-02T18:47:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 0x7f9744109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744060450 con 0x7f97440f6860 2022-02-02T18:47:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f974a813700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744060590 con 0x7f97440f55c0 2022-02-02T18:47:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f97437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f97437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56010/0 (socket says 172.21.15.96:56010) 2022-02-02T18:47:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f97437fe700 1 -- 172.21.15.96:0/2023037482 learned_addr learned my addr 172.21.15.96:0/2023037482 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.837+0000 7f9743fff700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 0x7f9744109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f97437fe700 1 -- 172.21.15.96:0/2023037482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 msgr2=0x7f9744109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f97437fe700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 0x7f9744109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:43.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f97437fe700 1 -- 172.21.15.96:0/2023037482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734005040 con 0x7f97440f6860 2022-02-02T18:47:43.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f9743fff700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 0x7f9744109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:47:43.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f97437fe700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f973800b410 tx=0x7f9738006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:43.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97380125f0 con 0x7f97440f6860 2022-02-02T18:47:43.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974410c7f0 con 0x7f97440f6860 2022-02-02T18:47:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f973800be80 con 0x7f97440f6860 2022-02-02T18:47:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9738002ac0 con 0x7f97440f6860 2022-02-02T18:47:43.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.838+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974410cdb0 con 0x7f97440f6860 2022-02-02T18:47:43.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.839+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9744045ad0 con 0x7f97440f6860 2022-02-02T18:47:43.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.839+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f973800f030 con 0x7f97440f6860 2022-02-02T18:47:43.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.840+0000 7f9740ff9700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 0x7f972c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:43.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.840+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9738081f90 con 0x7f97440f6860 2022-02-02T18:47:43.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.840+0000 7f9743fff700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 0x7f972c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:43.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.840+0000 7f9743fff700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 0x7f972c067290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9734004e30 tx=0x7f9734009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:43.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:43.844+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f973804ffe0 con 0x7f97440f6860 2022-02-02T18:47:44.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.021+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97440fdfb0 con 0x7f972c064dd0 2022-02-02T18:47:44.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.022+0000 7f9740ff9700 1 -- 172.21.15.96:0/2023037482 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9734019040 con 0x7f972c064dd0 2022-02-02T18:47:44.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 msgr2=0x7f972c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 0x7f972c067290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9734004e30 tx=0x7f9734009b30).stop 2022-02-02T18:47:44.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 msgr2=0x7f974410c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f973800b410 tx=0x7f9738006ef0).stop 2022-02-02T18:47:44.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 shutdown_connections 2022-02-02T18:47:44.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f972c064dd0 0x7f972c067290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97440f55c0 0x7f9744109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 --2- 172.21.15.96:0/2023037482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97440f6860 0x7f974410c1e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 >> 172.21.15.96:0/2023037482 conn(0x7f97440f0d40 msgr2=0x7f97440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 shutdown_connections 2022-02-02T18:47:44.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.024+0000 7f974a813700 1 -- 172.21.15.96:0/2023037482 wait complete. 2022-02-02T18:47:44.030 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:47:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.121+0000 7f7f4359e700 1 -- 172.21.15.96:0/435520919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f99e0 msgr2=0x7f7f440f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.121+0000 7f7f4359e700 1 --2- 172.21.15.96:0/435520919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f99e0 0x7f7f440f9e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f7f38004660 tx=0x7f7f38009b30).stop 2022-02-02T18:47:44.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- 172.21.15.96:0/435520919 shutdown_connections 2022-02-02T18:47:44.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 --2- 172.21.15.96:0/435520919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f99e0 0x7f7f440f9e40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 --2- 172.21.15.96:0/435520919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f8740 0x7f7f440f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- 172.21.15.96:0/435520919 >> 172.21.15.96:0/435520919 conn(0x7f7f440f40e0 msgr2=0x7f7f440f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- 172.21.15.96:0/435520919 shutdown_connections 2022-02-02T18:47:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- 172.21.15.96:0/435520919 wait complete. 2022-02-02T18:47:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 Processor -- start 2022-02-02T18:47:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- start start 2022-02-02T18:47:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f99e0 0x7f7f44109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441099c0 con 0x7f7f440f8740 2022-02-02T18:47:44.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.122+0000 7f7f4359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44109b00 con 0x7f7f440f99e0 2022-02-02T18:47:44.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56018/0 (socket says 172.21.15.96:56018) 2022-02-02T18:47:44.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 -- 172.21.15.96:0/3747783017 learned_addr learned my addr 172.21.15.96:0/3747783017 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:44.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f41d9b700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f99e0 0x7f7f44109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 -- 172.21.15.96:0/3747783017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f99e0 msgr2=0x7f7f44109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f99e0 0x7f7f44109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 -- 172.21.15.96:0/3747783017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38005040 con 0x7f7f440f8740 2022-02-02T18:47:44.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4259c700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f7f34002700 tx=0x7f7f34009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f340079c0 con 0x7f7f440f8740 2022-02-02T18:47:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4410a4a0 con 0x7f7f440f8740 2022-02-02T18:47:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f3400f040 con 0x7f7f440f8740 2022-02-02T18:47:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f34014860 con 0x7f7f440f8740 2022-02-02T18:47:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.123+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4410aa60 con 0x7f7f440f8740 2022-02-02T18:47:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.124+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f44045ad0 con 0x7f7f440f8740 2022-02-02T18:47:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.125+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7f3401b060 con 0x7f7f440f8740 2022-02-02T18:47:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.125+0000 7f7f32ffd700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 0x7f7f2c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.125+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7f34081930 con 0x7f7f440f8740 2022-02-02T18:47:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.125+0000 7f7f41d9b700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 0x7f7f2c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.127+0000 7f7f41d9b700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 0x7f7f2c0672e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f7f38004630 tx=0x7f7f38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.129+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7f34053410 con 0x7f7f440f8740 2022-02-02T18:47:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.303+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f4410ace0 con 0x7f7f2c064e20 2022-02-02T18:47:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.312+0000 7f7f32ffd700 1 -- 172.21.15.96:0/3747783017 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7f4410ace0 con 0x7f7f2c064e20 2022-02-02T18:47:44.308 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:47:44.308 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (31m) 103s ago 32m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:47:44.309 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (23m) 103s ago 32m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:47:44.309 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (23m) 8s ago 31m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:47:44.309 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (30m) 103s ago 31m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:47:44.309 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (28m) 103s ago 28m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:47:44.309 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (23m) 103s ago 28m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:47:44.310 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (28m) 8s ago 28m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:47:44.310 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (24m) 8s ago 28m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:47:44.310 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (25m) 103s ago 33m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:47:44.310 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (24m) 8s ago 31m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:47:44.311 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (24m) 103s ago 33m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:47:44.311 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (24m) 8s ago 31m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:47:44.311 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (31m) 103s ago 31m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:47:44.311 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (31m) 8s ago 31m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:47:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (23m) 103s ago 31m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:47:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (22m) 103s ago 30m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:47:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (22m) 103s ago 30m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:47:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (21m) 8s ago 30m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:47:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (21m) 8s ago 29m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:47:44.313 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (20m) 8s ago 29m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:47:44.313 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (30m) 103s ago 31m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:47:44.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 msgr2=0x7f7f2c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 0x7f7f2c0672e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f7f38004630 tx=0x7f7f38009b30).stop 2022-02-02T18:47:44.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 msgr2=0x7f7f44108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f7f34002700 tx=0x7f7f34009d80).stop 2022-02-02T18:47:44.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 shutdown_connections 2022-02-02T18:47:44.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f2c064e20 0x7f7f2c0672e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f440f8740 0x7f7f44108f20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 --2- 172.21.15.96:0/3747783017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f440f99e0 0x7f7f44109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 >> 172.21.15.96:0/3747783017 conn(0x7f7f440f40e0 msgr2=0x7f7f440fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 shutdown_connections 2022-02-02T18:47:44.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.315+0000 7f7f4359e700 1 -- 172.21.15.96:0/3747783017 wait complete. 2022-02-02T18:47:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 -- 172.21.15.96:0/198534334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 msgr2=0x7f555c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 --2- 172.21.15.96:0/198534334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c0f7de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f5558004660 tx=0x7f5558009b30).stop 2022-02-02T18:47:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 -- 172.21.15.96:0/198534334 shutdown_connections 2022-02-02T18:47:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 --2- 172.21.15.96:0/198534334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c0f7de0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 --2- 172.21.15.96:0/198534334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 0x7f555c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:47:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 -- 172.21.15.96:0/198534334 >> 172.21.15.96:0/198534334 conn(0x7f555c0f1e40 msgr2=0x7f555c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 -- 172.21.15.96:0/198534334 shutdown_connections 2022-02-02T18:47:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.416+0000 7f556394c700 1 -- 172.21.15.96:0/198534334 wait complete. 2022-02-02T18:47:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 Processor -- start 2022-02-02T18:47:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 -- start start 2022-02-02T18:47:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 0x7f555c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c107ab0 con 0x7f555c0f7980 2022-02-02T18:47:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f556394c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c108360 con 0x7f555c0f66e0 2022-02-02T18:47:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56030/0 (socket says 172.21.15.96:56030) 2022-02-02T18:47:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 -- 172.21.15.96:0/4075141627 learned_addr learned my addr 172.21.15.96:0/4075141627 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f55616e8700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 0x7f555c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 -- 172.21.15.96:0/4075141627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 msgr2=0x7f555c106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 0x7f555c106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 -- 172.21.15.96:0/4075141627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558005040 con 0x7f555c0f7980 2022-02-02T18:47:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.417+0000 7f5560ee7700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5558009990 tx=0x7f5558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.418+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5558018070 con 0x7f555c0f7980 2022-02-02T18:47:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.418+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c1085e0 con 0x7f555c0f7980 2022-02-02T18:47:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.418+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5558007ba0 con 0x7f555c0f7980 2022-02-02T18:47:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.418+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f555801c620 con 0x7f555c0f7980 2022-02-02T18:47:44.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.418+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c108b40 con 0x7f555c0f7980 2022-02-02T18:47:44.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.419+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f555801c8e0 con 0x7f555c0f7980 2022-02-02T18:47:44.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.419+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c0f5ad0 con 0x7f555c0f7980 2022-02-02T18:47:44.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.420+0000 7f5551ffb700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 0x7f5548067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.420+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f55580838a0 con 0x7f555c0f7980 2022-02-02T18:47:44.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.420+0000 7f55616e8700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 0x7f5548067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.420+0000 7f55616e8700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 0x7f5548067290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f554c006fd0 tx=0x7f554c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.424+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5558055380 con 0x7f555c0f7980 2022-02-02T18:47:44.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.656+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f555c0fef40 con 0x7f555c0f7980 2022-02-02T18:47:44.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.656+0000 7f5551ffb700 1 -- 172.21.15.96:0/4075141627 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5558054f70 con 0x7f555c0f7980 2022-02-02T18:47:44.652 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:47:44.652 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:47:44.653 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:47:44.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:44.653 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:47:44.653 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:47:44.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:44.654 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:47:44.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:47:44.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:44.655 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:47:44.655 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:47:44.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:47:44.655 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:47:44.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:47:44.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:47:44.656 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:47:44.656 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:47:44.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 msgr2=0x7f5548067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 0x7f5548067290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f554c006fd0 tx=0x7f554c008040).stop 2022-02-02T18:47:44.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 msgr2=0x7f555c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5558009990 tx=0x7f5558009b30).stop 2022-02-02T18:47:44.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 shutdown_connections 2022-02-02T18:47:44.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5548064dd0 0x7f5548067290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f555c0f66e0 0x7f555c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 --2- 172.21.15.96:0/4075141627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f555c0f7980 0x7f555c107470 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.658+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 >> 172.21.15.96:0/4075141627 conn(0x7f555c0f1e40 msgr2=0x7f555c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.659+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 shutdown_connections 2022-02-02T18:47:44.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.659+0000 7f556394c700 1 -- 172.21.15.96:0/4075141627 wait complete. 2022-02-02T18:47:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/2774289421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f6530 msgr2=0x7ff1f80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/2774289421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f6530 0x7ff1f80f6950 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff1f4004660 tx=0x7ff1f4009b30).stop 2022-02-02T18:47:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/2774289421 shutdown_connections 2022-02-02T18:47:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/2774289421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f77d0 0x7ff1f80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/2774289421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f6530 0x7ff1f80f6950 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/2774289421 >> 172.21.15.96:0/2774289421 conn(0x7ff1f80f1c90 msgr2=0x7ff1f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.754 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:44 smithi096 ceph-mon[101353]: pgmap v768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.756+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/2774289421 shutdown_connections 2022-02-02T18:47:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/2774289421 wait complete. 2022-02-02T18:47:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 Processor -- start 2022-02-02T18:47:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 -- start start 2022-02-02T18:47:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f6530 0x7ff1f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f806a380 con 0x7ff1f80f77d0 2022-02-02T18:47:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.757+0000 7ff1fe5f0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f806a4c0 con 0x7ff1f80f6530 2022-02-02T18:47:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56040/0 (socket says 172.21.15.96:56040) 2022-02-02T18:47:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 -- 172.21.15.96:0/1181462217 learned_addr learned my addr 172.21.15.96:0/1181462217 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:47:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fd5ee700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f6530 0x7ff1f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 -- 172.21.15.96:0/1181462217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f6530 msgr2=0x7ff1f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f6530 0x7ff1f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 -- 172.21.15.96:0/1181462217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4005040 con 0x7ff1f80f77d0 2022-02-02T18:47:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fcded700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff1e80026d0 tx=0x7ff1e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e80079c0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f806a7a0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff1e800f040 con 0x7ff1f80f77d0 2022-02-02T18:47:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.758+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e80137c0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.759+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f810ee00 con 0x7ff1f80f77d0 2022-02-02T18:47:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.760+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8045ad0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.760+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff1e80090d0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.760+0000 7ff1edffb700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 0x7ff1e40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:47:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.760+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff1e8081a90 con 0x7ff1f80f77d0 2022-02-02T18:47:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.760+0000 7ff1fd5ee700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 0x7ff1e40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:47:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.761+0000 7ff1fd5ee700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 0x7ff1e40672e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff1f4013690 tx=0x7ff1f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:47:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.765+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff1e804fae0 con 0x7ff1f80f77d0 2022-02-02T18:47:44.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:44 smithi159 ceph-mon[69013]: pgmap v768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:44.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.964+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff1f8027a00 con 0x7ff1f80f77d0 2022-02-02T18:47:44.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.965+0000 7ff1edffb700 1 -- 172.21.15.96:0/1181462217 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff1e8053100 con 0x7ff1f80f77d0 2022-02-02T18:47:44.962 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:47:44.963 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:47:44.963 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:47:44.963 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:47:44.963 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:44.964 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:47:44.964 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:47:44.964 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:47:44.964 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:47:44.965 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:47:44.965 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:47:44.965 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:47:44.965 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:47:44.965 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:47:44.966 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:47:44.966 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:47:44.966 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:47:44.967 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:47:44.967 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:47:44.967 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:47:44.967 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:47:44.968 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:47:44.968 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:47:44.968 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:47:44.968 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:47:44.969 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:47:44.969 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:47:44.969 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:47:44.969 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:47:44.970 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:47:44.970 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:47:44.970 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:47:44.970 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:44.970 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:44.971 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:47:44.971 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:47:44.971 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:44.971 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:44.972 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:47:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 msgr2=0x7ff1e40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 0x7ff1e40672e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff1f4013690 tx=0x7ff1f4009b30).stop 2022-02-02T18:47:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 msgr2=0x7ff1f8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:47:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff1e80026d0 tx=0x7ff1e8009de0).stop 2022-02-02T18:47:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 shutdown_connections 2022-02-02T18:47:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1e4064e20 0x7ff1e40672e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1f80f6530 0x7ff1f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 --2- 172.21.15.96:0/1181462217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1f80f77d0 0x7ff1f8069e20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:47:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 >> 172.21.15.96:0/1181462217 conn(0x7ff1f80f1c90 msgr2=0x7ff1f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:47:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 shutdown_connections 2022-02-02T18:47:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:47:44.967+0000 7ff1fe5f0700 1 -- 172.21.15.96:0/1181462217 wait complete. 2022-02-02T18:47:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:47:45.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:45 smithi159 ceph-mon[69013]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:45 smithi159 ceph-mon[69013]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4075141627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:45.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1181462217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:47:45.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:45 smithi096 ceph-mon[101353]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:45.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:45 smithi096 ceph-mon[101353]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:47:45.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4075141627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:45.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1181462217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:47:46.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: pgmap v769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: pgmap v769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:46.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:46.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:47.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:47 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:47.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:47 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:48.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:47 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:48.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:47 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:48 smithi096 ceph-mon[101353]: pgmap v770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:48 smithi159 ceph-mon[69013]: pgmap v770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:50 smithi096 ceph-mon[101353]: pgmap v771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:50 smithi159 ceph-mon[69013]: pgmap v771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:52 smithi096 ceph-mon[101353]: pgmap v772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:53.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:52 smithi159 ceph-mon[69013]: pgmap v772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:54 smithi096 ceph-mon[101353]: pgmap v773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:55.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:54 smithi159 ceph-mon[69013]: pgmap v773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: pgmap v774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:56.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:56.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:57.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: pgmap v774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:57.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:57.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:47:57.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:47:57.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:47:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:47:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:57.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:47:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:57 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:57 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:58.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:57 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:47:58.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:57 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:47:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:47:58 smithi096 ceph-mon[101353]: pgmap v775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:47:59.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:47:58 smithi159 ceph-mon[69013]: pgmap v775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:00 smithi096 ceph-mon[101353]: pgmap v776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:00 smithi159 ceph-mon[69013]: pgmap v776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:02 smithi159 ceph-mon[69013]: pgmap v777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:03.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:02 smithi096 ceph-mon[101353]: pgmap v777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:05.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:04 smithi159 ceph-mon[69013]: pgmap v778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:05.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:04 smithi096 ceph-mon[101353]: pgmap v778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: pgmap v779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:07.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:06 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: pgmap v779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:07.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:07.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:07.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:07.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:07.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:07.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:07.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:06 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:07 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:08.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:07 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:07 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:07 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:09.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:08 smithi159 ceph-mon[69013]: pgmap v780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:09.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:08 smithi096 ceph-mon[101353]: pgmap v780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:10 smithi159 ceph-mon[69013]: pgmap v781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:10 smithi096 ceph-mon[101353]: pgmap v781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:13.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:12 smithi159 ceph-mon[69013]: pgmap v782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:12 smithi096 ceph-mon[101353]: pgmap v782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:14 smithi159 ceph-mon[69013]: pgmap v783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:15.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:14 smithi096 ceph-mon[101353]: pgmap v783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:15.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 -- 172.21.15.96:0/3627595664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f55c0 msgr2=0x7f924c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 --2- 172.21.15.96:0/3627595664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f55c0 0x7f924c0f59e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f9248004660 tx=0x7f9248009b30).stop 2022-02-02T18:48:15.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 -- 172.21.15.96:0/3627595664 shutdown_connections 2022-02-02T18:48:15.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 --2- 172.21.15.96:0/3627595664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6860 0x7f924c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 --2- 172.21.15.96:0/3627595664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f55c0 0x7f924c0f59e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.077+0000 7f925431d700 1 -- 172.21.15.96:0/3627595664 >> 172.21.15.96:0/3627595664 conn(0x7f924c0f0d40 msgr2=0x7f924c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.078+0000 7f925431d700 1 -- 172.21.15.96:0/3627595664 shutdown_connections 2022-02-02T18:48:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.078+0000 7f925431d700 1 -- 172.21.15.96:0/3627595664 wait complete. 2022-02-02T18:48:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.078+0000 7f925431d700 1 Processor -- start 2022-02-02T18:48:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f925431d700 1 -- start start 2022-02-02T18:48:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f925431d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f55c0 0x7f924c109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f925431d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f925431d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c060420 con 0x7f924c0f6860 2022-02-02T18:48:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f925431d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c060560 con 0x7f924c0f55c0 2022-02-02T18:48:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56062/0 (socket says 172.21.15.96:56062) 2022-02-02T18:48:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 -- 172.21.15.96:0/2482374421 learned_addr learned my addr 172.21.15.96:0/2482374421 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:15.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92520b9700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f55c0 0x7f924c109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 -- 172.21.15.96:0/2482374421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f55c0 msgr2=0x7f924c109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f55c0 0x7f924c109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 -- 172.21.15.96:0/2482374421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248005040 con 0x7f924c0f6860 2022-02-02T18:48:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f92518b8700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f923c0026d0 tx=0x7f923c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.079+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c0079c0 con 0x7f924c0f6860 2022-02-02T18:48:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.080+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c10c740 con 0x7f924c0f6860 2022-02-02T18:48:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.080+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f923c00f040 con 0x7f924c0f6860 2022-02-02T18:48:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.080+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c0148b0 con 0x7f924c0f6860 2022-02-02T18:48:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.080+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c10ccd0 con 0x7f924c0f6860 2022-02-02T18:48:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.080+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c045ad0 con 0x7f924c0f6860 2022-02-02T18:48:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.081+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f923c007b20 con 0x7f924c0f6860 2022-02-02T18:48:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.081+0000 7f9242ffd700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 0x7f9238067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.082+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f923c0819e0 con 0x7f924c0f6860 2022-02-02T18:48:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.082+0000 7f92520b9700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 0x7f9238067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.082+0000 7f92520b9700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 0x7f9238067290 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9248013690 tx=0x7f9248009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.086+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f923c04fa90 con 0x7f924c0f6860 2022-02-02T18:48:15.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.264+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f924c057f10 con 0x7f9238064dd0 2022-02-02T18:48:15.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.265+0000 7f9242ffd700 1 -- 172.21.15.96:0/2482374421 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f924c057f10 con 0x7f9238064dd0 2022-02-02T18:48:15.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 msgr2=0x7f9238067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 0x7f9238067290 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9248013690 tx=0x7f9248009b30).stop 2022-02-02T18:48:15.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 msgr2=0x7f924c10c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f923c0026d0 tx=0x7f923c009de0).stop 2022-02-02T18:48:15.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 shutdown_connections 2022-02-02T18:48:15.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064dd0 0x7f9238067290 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f55c0 0x7f924c109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 --2- 172.21.15.96:0/2482374421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f6860 0x7f924c10c130 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 >> 172.21.15.96:0/2482374421 conn(0x7f924c0f0d40 msgr2=0x7f924c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 shutdown_connections 2022-02-02T18:48:15.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.267+0000 7f925431d700 1 -- 172.21.15.96:0/2482374421 wait complete. 2022-02-02T18:48:15.272 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:48:15.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 -- 172.21.15.96:0/1006378904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 msgr2=0x7f7cd00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 --2- 172.21.15.96:0/1006378904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd00f59e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f7cc4004660 tx=0x7f7cc4009b30).stop 2022-02-02T18:48:15.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 -- 172.21.15.96:0/1006378904 shutdown_connections 2022-02-02T18:48:15.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 --2- 172.21.15.96:0/1006378904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 --2- 172.21.15.96:0/1006378904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd00f59e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.364+0000 7f7cd7999700 1 -- 172.21.15.96:0/1006378904 >> 172.21.15.96:0/1006378904 conn(0x7f7cd00f0d40 msgr2=0x7f7cd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 -- 172.21.15.96:0/1006378904 shutdown_connections 2022-02-02T18:48:15.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 -- 172.21.15.96:0/1006378904 wait complete. 2022-02-02T18:48:15.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 Processor -- start 2022-02-02T18:48:15.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 -- start start 2022-02-02T18:48:15.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd0106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0106940 con 0x7f7cd00f55c0 2022-02-02T18:48:15.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd7999700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0107140 con 0x7f7cd00f6860 2022-02-02T18:48:15.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd5735700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd5735700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56070/0 (socket says 172.21.15.96:56070) 2022-02-02T18:48:15.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.365+0000 7f7cd5735700 1 -- 172.21.15.96:0/968839809 learned_addr learned my addr 172.21.15.96:0/968839809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:15.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd4f34700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd0106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd5735700 1 -- 172.21.15.96:0/968839809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 msgr2=0x7f7cd0106390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd5735700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd0106390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd5735700 1 -- 172.21.15.96:0/968839809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4005040 con 0x7f7cd00f55c0 2022-02-02T18:48:15.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd4f34700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd0106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:48:15.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd5735700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7cc4004570 tx=0x7f7cc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc401a070 con 0x7f7cd00f55c0 2022-02-02T18:48:15.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cc4009630 con 0x7f7cd00f55c0 2022-02-02T18:48:15.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd01073c0 con 0x7f7cd00f55c0 2022-02-02T18:48:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc401f8d0 con 0x7f7cd00f55c0 2022-02-02T18:48:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.366+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0107920 con 0x7f7cd00f55c0 2022-02-02T18:48:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.367+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd00f49b0 con 0x7f7cd00f55c0 2022-02-02T18:48:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.368+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cc40125d0 con 0x7f7cd00f55c0 2022-02-02T18:48:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.368+0000 7f7cc1ffb700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 0x7f7cbc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.368+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7cc4085d10 con 0x7f7cd00f55c0 2022-02-02T18:48:15.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.368+0000 7f7cd4f34700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 0x7f7cbc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.369+0000 7f7cd4f34700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 0x7f7cbc067290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f7ccc009740 tx=0x7f7ccc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.372+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cc40577f0 con 0x7f7cd00f55c0 2022-02-02T18:48:15.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.544+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cd005f620 con 0x7f7cbc064dd0 2022-02-02T18:48:15.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.553+0000 7f7cc1ffb700 1 -- 172.21.15.96:0/968839809 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7cd005f620 con 0x7f7cbc064dd0 2022-02-02T18:48:15.549 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:48:15.549 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (31m) 2m ago 32m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:48:15.549 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (24m) 2m ago 32m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:48:15.549 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (23m) 39s ago 32m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:48:15.550 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (31m) 2m ago 32m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:48:15.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (28m) 2m ago 28m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:48:15.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (24m) 2m ago 28m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:48:15.551 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (28m) 39s ago 28m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:48:15.551 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (24m) 39s ago 28m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:48:15.551 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (25m) 2m ago 33m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:48:15.551 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (25m) 39s ago 32m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:48:15.551 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (24m) 2m ago 33m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:48:15.552 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (24m) 39s ago 32m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:48:15.552 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (32m) 2m ago 32m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:48:15.552 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (31m) 39s ago 31m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:48:15.552 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (23m) 2m ago 31m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:48:15.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (23m) 2m ago 31m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:48:15.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (22m) 2m ago 30m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:48:15.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (22m) 39s ago 30m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:48:15.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (21m) 39s ago 30m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:48:15.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (21m) 39s ago 30m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:48:15.554 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (31m) 2m ago 32m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:48:15.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 msgr2=0x7f7cbc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 0x7f7cbc067290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f7ccc009740 tx=0x7f7ccc009be0).stop 2022-02-02T18:48:15.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 msgr2=0x7f7cd0105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7cc4004570 tx=0x7f7cc4009b30).stop 2022-02-02T18:48:15.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 shutdown_connections 2022-02-02T18:48:15.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cbc064dd0 0x7f7cbc067290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f55c0 0x7f7cd0105ea0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 --2- 172.21.15.96:0/968839809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6860 0x7f7cd0106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 >> 172.21.15.96:0/968839809 conn(0x7f7cd00f0d40 msgr2=0x7f7cd00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 shutdown_connections 2022-02-02T18:48:15.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.555+0000 7f7cd7999700 1 -- 172.21.15.96:0/968839809 wait complete. 2022-02-02T18:48:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 -- 172.21.15.96:0/4135936735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f7980 msgr2=0x7f40b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 --2- 172.21.15.96:0/4135936735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f7980 0x7f40b00f7de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f40a4004660 tx=0x7f40a4009b30).stop 2022-02-02T18:48:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 -- 172.21.15.96:0/4135936735 shutdown_connections 2022-02-02T18:48:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 --2- 172.21.15.96:0/4135936735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f7980 0x7f40b00f7de0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 --2- 172.21.15.96:0/4135936735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f66e0 0x7f40b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 -- 172.21.15.96:0/4135936735 >> 172.21.15.96:0/4135936735 conn(0x7f40b00f1e40 msgr2=0x7f40b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.652+0000 7f40b669a700 1 -- 172.21.15.96:0/4135936735 shutdown_connections 2022-02-02T18:48:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 -- 172.21.15.96:0/4135936735 wait complete. 2022-02-02T18:48:15.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 Processor -- start 2022-02-02T18:48:15.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 -- start start 2022-02-02T18:48:15.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 0x7f40b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b006a380 con 0x7f40b00f66e0 2022-02-02T18:48:15.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.653+0000 7f40b669a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b006a4c0 con 0x7f40b00f7980 2022-02-02T18:48:15.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56080/0 (socket says 172.21.15.96:56080) 2022-02-02T18:48:15.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 -- 172.21.15.96:0/296918829 learned_addr learned my addr 172.21.15.96:0/296918829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:15.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40af7fe700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 0x7f40b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 -- 172.21.15.96:0/296918829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 msgr2=0x7f40b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 0x7f40b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 -- 172.21.15.96:0/296918829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4005040 con 0x7f40b00f66e0 2022-02-02T18:48:15.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40af7fe700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 0x7f40b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:48:15.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40affff700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f40a000c530 tx=0x7f40a0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a000f650 con 0x7f40b00f66e0 2022-02-02T18:48:15.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40a000fc60 con 0x7f40b00f66e0 2022-02-02T18:48:15.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a0012d20 con 0x7f40b00f66e0 2022-02-02T18:48:15.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b006a7a0 con 0x7f40b00f66e0 2022-02-02T18:48:15.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.654+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b010ef90 con 0x7f40b00f66e0 2022-02-02T18:48:15.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.655+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0045ad0 con 0x7f40b00f66e0 2022-02-02T18:48:15.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.656+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40a0019030 con 0x7f40b00f66e0 2022-02-02T18:48:15.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.656+0000 7f40acff9700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.656+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f40a0081660 con 0x7f40b00f66e0 2022-02-02T18:48:15.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.656+0000 7f40af7fe700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.657+0000 7f40af7fe700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f40a4004e30 tx=0x7f40a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.661+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40a004f760 con 0x7f40b00f66e0 2022-02-02T18:48:15.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.894+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40b006a930 con 0x7f40b00f66e0 2022-02-02T18:48:15.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.894+0000 7f40acff9700 1 -- 172.21.15.96:0/296918829 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f40b006a930 con 0x7f40b00f66e0 2022-02-02T18:48:15.891 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:48:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:48:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:48:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:48:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:48:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:48:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:48:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:48:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:48:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:48:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:48:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:48:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:48:15.895 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:48:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 msgr2=0x7f4098067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f40a4004e30 tx=0x7f40a4009b30).stop 2022-02-02T18:48:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 msgr2=0x7f40b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f40a000c530 tx=0x7f40a0007e10).stop 2022-02-02T18:48:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 shutdown_connections 2022-02-02T18:48:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40b00f66e0 0x7f40b006b9a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 --2- 172.21.15.96:0/296918829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b00f7980 0x7f40b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 >> 172.21.15.96:0/296918829 conn(0x7f40b00f1e40 msgr2=0x7f40b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 shutdown_connections 2022-02-02T18:48:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.896+0000 7f40b669a700 1 -- 172.21.15.96:0/296918829 wait complete. 2022-02-02T18:48:15.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- 172.21.15.96:0/481287575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f6860 msgr2=0x7f109c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 --2- 172.21.15.96:0/481287575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f6860 0x7f109c0f6cc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f1098004660 tx=0x7f1098009b30).stop 2022-02-02T18:48:15.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- 172.21.15.96:0/481287575 shutdown_connections 2022-02-02T18:48:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 --2- 172.21.15.96:0/481287575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f6860 0x7f109c0f6cc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 --2- 172.21.15.96:0/481287575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f55c0 0x7f109c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- 172.21.15.96:0/481287575 >> 172.21.15.96:0/481287575 conn(0x7f109c0f0d40 msgr2=0x7f109c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- 172.21.15.96:0/481287575 shutdown_connections 2022-02-02T18:48:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- 172.21.15.96:0/481287575 wait complete. 2022-02-02T18:48:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 Processor -- start 2022-02-02T18:48:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.995+0000 7f10a3595700 1 -- start start 2022-02-02T18:48:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a3595700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a3595700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f6860 0x7f109c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a3595700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c1069b0 con 0x7f109c0f55c0 2022-02-02T18:48:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a3595700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c1071c0 con 0x7f109c0f6860 2022-02-02T18:48:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56096/0 (socket says 172.21.15.96:56096) 2022-02-02T18:48:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 -- 172.21.15.96:0/3431392634 learned_addr learned my addr 172.21.15.96:0/3431392634 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a0b30700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f6860 0x7f109c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 -- 172.21.15.96:0/3431392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f6860 msgr2=0x7f109c1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f6860 0x7f109c1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 -- 172.21.15.96:0/3431392634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098005040 con 0x7f109c0f55c0 2022-02-02T18:48:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f10a1331700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f109000f910 tx=0x7f1090009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1090009500 con 0x7f109c0f55c0 2022-02-02T18:48:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.996+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1090009660 con 0x7f109c0f55c0 2022-02-02T18:48:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.997+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109000dd30 con 0x7f109c0f55c0 2022-02-02T18:48:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.997+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c1073e0 con 0x7f109c0f55c0 2022-02-02T18:48:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.997+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c107970 con 0x7f109c0f55c0 2022-02-02T18:48:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.998+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c0f49b0 con 0x7f109c0f55c0 2022-02-02T18:48:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.998+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f109000e040 con 0x7f109c0f55c0 2022-02-02T18:48:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.998+0000 7f108dffb700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 0x7f1088067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.999+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1090084140 con 0x7f109c0f55c0 2022-02-02T18:48:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.999+0000 7f10a0b30700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 0x7f1088067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:15.999+0000 7f10a0b30700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 0x7f1088067290 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f1098004630 tx=0x7f1098009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.003+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10900521f0 con 0x7f109c0f55c0 2022-02-02T18:48:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.205+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f109c0ff850 con 0x7f109c0f55c0 2022-02-02T18:48:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.205+0000 7f108dffb700 1 -- 172.21.15.96:0/3431392634 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1090055810 con 0x7f109c0f55c0 2022-02-02T18:48:16.202 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:48:16.202 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:48:16.202 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:48:16.202 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:48:16.203 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:16.203 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:48:16.203 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:48:16.203 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:48:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:48:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:48:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:48:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:48:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:48:16.205 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:48:16.205 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:48:16.205 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:48:16.205 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:48:16.206 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:48:16.206 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:48:16.206 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:48:16.206 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:48:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:48:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:48:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:48:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:48:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:48:16.208 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:48:16.208 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:48:16.208 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:48:16.208 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:48:16.209 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:48:16.209 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:48:16.209 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:16.209 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:16.210 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:48:16.210 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:16.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:16.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:16.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:16.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 msgr2=0x7f1088067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 0x7f1088067290 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f1098004630 tx=0x7f1098009b30).stop 2022-02-02T18:48:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 msgr2=0x7f109c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f109000f910 tx=0x7f1090009d80).stop 2022-02-02T18:48:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 shutdown_connections 2022-02-02T18:48:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1088064dd0 0x7f1088067290 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f109c0f55c0 0x7f109c105ec0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 --2- 172.21.15.96:0/3431392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f109c0f6860 0x7f109c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 >> 172.21.15.96:0/3431392634 conn(0x7f109c0f0d40 msgr2=0x7f109c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 shutdown_connections 2022-02-02T18:48:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:16.207+0000 7f10a3595700 1 -- 172.21.15.96:0/3431392634 wait complete. 2022-02-02T18:48:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:48:17.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: pgmap v784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/296918829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3431392634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:48:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:16 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: pgmap v784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:17.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:17.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/296918829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3431392634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:48:17.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:17.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:17.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:17.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:16 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:18.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:17 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:18.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:17 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:18.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:17 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:18.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:17 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:18 smithi159 ceph-mon[69013]: pgmap v785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:18 smithi096 ceph-mon[101353]: pgmap v785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:20 smithi159 ceph-mon[69013]: pgmap v786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:20 smithi096 ceph-mon[101353]: pgmap v786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:23.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:22 smithi159 ceph-mon[69013]: pgmap v787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:22 smithi096 ceph-mon[101353]: pgmap v787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:24 smithi159 ceph-mon[69013]: pgmap v788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:25.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:24 smithi096 ceph-mon[101353]: pgmap v788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: pgmap v789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:27.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:26 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: pgmap v789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:27.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:27.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:27.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:27.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:27.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:27.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:27.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:26 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:27 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:27 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:48:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:48:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:27 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:27 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:48:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:48:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:28 smithi159 ceph-mon[69013]: pgmap v790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:28 smithi096 ceph-mon[101353]: pgmap v790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:30 smithi159 ceph-mon[69013]: pgmap v791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:30 smithi096 ceph-mon[101353]: pgmap v791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:32 smithi159 ceph-mon[69013]: pgmap v792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:33.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:32 smithi096 ceph-mon[101353]: pgmap v792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:34 smithi159 ceph-mon[69013]: pgmap v793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:35.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:34 smithi096 ceph-mon[101353]: pgmap v793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: pgmap v794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:36.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:36 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: pgmap v794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:36.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:36.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:36 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:37.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:37 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:37.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:37 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:37 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:37 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:38 smithi159 ceph-mon[69013]: pgmap v795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:38 smithi096 ceph-mon[101353]: pgmap v795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:40 smithi159 ceph-mon[69013]: pgmap v796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:40 smithi096 ceph-mon[101353]: pgmap v796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:42.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:42 smithi159 ceph-mon[69013]: pgmap v797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:42 smithi096 ceph-mon[101353]: pgmap v797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:44.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:44 smithi159 ceph-mon[69013]: pgmap v798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:44.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:44 smithi096 ceph-mon[101353]: pgmap v798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:46.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 -- 172.21.15.96:0/4250541069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 msgr2=0x7fe7f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 --2- 172.21.15.96:0/4250541069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f00f59e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fe7e0004660 tx=0x7fe7e0009b30).stop 2022-02-02T18:48:46.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 -- 172.21.15.96:0/4250541069 shutdown_connections 2022-02-02T18:48:46.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 --2- 172.21.15.96:0/4250541069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 0x7fe7f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 --2- 172.21.15.96:0/4250541069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f00f59e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 -- 172.21.15.96:0/4250541069 >> 172.21.15.96:0/4250541069 conn(0x7fe7f00f0d40 msgr2=0x7fe7f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:46.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 -- 172.21.15.96:0/4250541069 shutdown_connections 2022-02-02T18:48:46.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.317+0000 7fe7f514a700 1 -- 172.21.15.96:0/4250541069 wait complete. 2022-02-02T18:48:46.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.318+0000 7fe7f514a700 1 Processor -- start 2022-02-02T18:48:46.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.318+0000 7fe7f514a700 1 -- start start 2022-02-02T18:48:46.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7f514a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7f514a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 0x7fe7f0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7f514a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0106910 con 0x7fe7f00f55c0 2022-02-02T18:48:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7f514a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0106a50 con 0x7fe7f00f6860 2022-02-02T18:48:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56116/0 (socket says 172.21.15.96:56116) 2022-02-02T18:48:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 -- 172.21.15.96:0/3603799676 learned_addr learned my addr 172.21.15.96:0/3603799676 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7ee59c700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 0x7fe7f0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 -- 172.21.15.96:0/3603799676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 msgr2=0x7fe7f0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 0x7fe7f0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 -- 172.21.15.96:0/3603799676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0005040 con 0x7fe7f00f55c0 2022-02-02T18:48:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.319+0000 7fe7eed9d700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe7e0004f60 tx=0x7fe7e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.320+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0018070 con 0x7fe7f00f55c0 2022-02-02T18:48:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.320+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0107390 con 0x7fe7f00f55c0 2022-02-02T18:48:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.320+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7e0009770 con 0x7fe7f00f55c0 2022-02-02T18:48:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.320+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e001c3c0 con 0x7fe7f00f55c0 2022-02-02T18:48:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.320+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f01078f0 con 0x7fe7f00f55c0 2022-02-02T18:48:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.321+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f0045ad0 con 0x7fe7f00f55c0 2022-02-02T18:48:46.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.321+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7e001d420 con 0x7fe7f00f55c0 2022-02-02T18:48:46.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.321+0000 7fe7d77fe700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 0x7fe7d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.322+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe7e00838d0 con 0x7fe7f00f55c0 2022-02-02T18:48:46.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.322+0000 7fe7ee59c700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 0x7fe7d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.322+0000 7fe7ee59c700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 0x7fe7d8067290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe7e40041d0 tx=0x7fe7e4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.326+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7e0055470 con 0x7fe7f00f55c0 2022-02-02T18:48:46.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.510+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7f00008d0 con 0x7fe7d8064dd0 2022-02-02T18:48:46.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.511+0000 7fe7d77fe700 1 -- 172.21.15.96:0/3603799676 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe7f00008d0 con 0x7fe7d8064dd0 2022-02-02T18:48:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 msgr2=0x7fe7d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 0x7fe7d8067290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe7e40041d0 tx=0x7fe7e4009040).stop 2022-02-02T18:48:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 msgr2=0x7fe7f0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe7e0004f60 tx=0x7fe7e0009b30).stop 2022-02-02T18:48:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 shutdown_connections 2022-02-02T18:48:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064dd0 0x7fe7d8067290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f55c0 0x7fe7f0105e70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 --2- 172.21.15.96:0/3603799676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6860 0x7fe7f0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 >> 172.21.15.96:0/3603799676 conn(0x7fe7f00f0d40 msgr2=0x7fe7f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:46.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 shutdown_connections 2022-02-02T18:48:46.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.513+0000 7fe7f514a700 1 -- 172.21.15.96:0/3603799676 wait complete. 2022-02-02T18:48:46.519 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:48:46.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 -- 172.21.15.96:0/1970903667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 msgr2=0x7fa4540f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 --2- 172.21.15.96:0/1970903667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa4540f6920 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fa444004660 tx=0x7fa444009b30).stop 2022-02-02T18:48:46.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 -- 172.21.15.96:0/1970903667 shutdown_connections 2022-02-02T18:48:46.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 --2- 172.21.15.96:0/1970903667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa4540f6920 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 --2- 172.21.15.96:0/1970903667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 0x7fa4540f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 -- 172.21.15.96:0/1970903667 >> 172.21.15.96:0/1970903667 conn(0x7fa4540f0de0 msgr2=0x7fa4540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:46.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 -- 172.21.15.96:0/1970903667 shutdown_connections 2022-02-02T18:48:46.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.611+0000 7fa459c39700 1 -- 172.21.15.96:0/1970903667 wait complete. 2022-02-02T18:48:46.610 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: pgmap v799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:46.610 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:46.610 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:46.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:46.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:46.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:46.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.612 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.612 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.612 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:46 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 Processor -- start 2022-02-02T18:48:46.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 -- start start 2022-02-02T18:48:46.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 0x7fa454105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454106930 con 0x7fa4540f5ef0 2022-02-02T18:48:46.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa459c39700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454106a70 con 0x7fa4540f55e0 2022-02-02T18:48:46.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa452ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa452ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56128/0 (socket says 172.21.15.96:56128) 2022-02-02T18:48:46.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa452ffd700 1 -- 172.21.15.96:0/2114901271 learned_addr learned my addr 172.21.15.96:0/2114901271 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:46.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.612+0000 7fa4537fe700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 0x7fa454105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa452ffd700 1 -- 172.21.15.96:0/2114901271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 msgr2=0x7fa454105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa452ffd700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 0x7fa454105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa452ffd700 1 -- 172.21.15.96:0/2114901271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444005040 con 0x7fa4540f5ef0 2022-02-02T18:48:46.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa452ffd700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fa444009990 tx=0x7fa444009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa444018070 con 0x7fa4540f5ef0 2022-02-02T18:48:46.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa444007ba0 con 0x7fa4540f5ef0 2022-02-02T18:48:46.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa44401c620 con 0x7fa4540f5ef0 2022-02-02T18:48:46.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4541073b0 con 0x7fa4540f5ef0 2022-02-02T18:48:46.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.613+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa454107910 con 0x7fa4540f5ef0 2022-02-02T18:48:46.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.614+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa44401c890 con 0x7fa4540f5ef0 2022-02-02T18:48:46.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.614+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa454045ad0 con 0x7fa4540f5ef0 2022-02-02T18:48:46.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.615+0000 7fa44bfff700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 0x7fa440067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.615+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa444083810 con 0x7fa4540f5ef0 2022-02-02T18:48:46.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.615+0000 7fa4537fe700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 0x7fa440067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.615+0000 7fa4537fe700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 0x7fa440067290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa43c0041d0 tx=0x7fa43c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.619+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4440552f0 con 0x7fa4540f5ef0 2022-02-02T18:48:46.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: pgmap v799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:46.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:46.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:46 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:46.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.795+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4540fdf40 con 0x7fa440064dd0 2022-02-02T18:48:46.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.804+0000 7fa44bfff700 1 -- 172.21.15.96:0/2114901271 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa4540fdf40 con 0x7fa440064dd0 2022-02-02T18:48:46.801 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:48:46.801 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (32m) 2m ago 33m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:48:46.802 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (24m) 2m ago 33m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:48:46.802 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (24m) 71s ago 32m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:48:46.802 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (31m) 2m ago 33m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:48:46.802 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (29m) 2m ago 29m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:48:46.803 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (24m) 2m ago 29m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:48:46.803 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (29m) 71s ago 29m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:48:46.803 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (25m) 71s ago 29m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:48:46.803 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (26m) 2m ago 34m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:48:46.804 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (25m) 71s ago 32m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:48:46.804 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (25m) 2m ago 34m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:48:46.804 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (25m) 71s ago 32m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:48:46.804 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (32m) 2m ago 32m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:48:46.804 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (32m) 71s ago 32m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:48:46.805 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (24m) 2m ago 32m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:48:46.805 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (23m) 2m ago 31m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:48:46.805 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (23m) 2m ago 31m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:48:46.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (22m) 71s ago 31m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:48:46.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (22m) 71s ago 30m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:48:46.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (21m) 71s ago 30m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:48:46.806 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (31m) 2m ago 32m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:48:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 msgr2=0x7fa440067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 0x7fa440067290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa43c0041d0 tx=0x7fa43c009040).stop 2022-02-02T18:48:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 msgr2=0x7fa454106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fa444009990 tx=0x7fa444009b30).stop 2022-02-02T18:48:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 shutdown_connections 2022-02-02T18:48:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa440064dd0 0x7fa440067290 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4540f55e0 0x7fa454105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 --2- 172.21.15.96:0/2114901271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4540f5ef0 0x7fa454106380 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.806+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 >> 172.21.15.96:0/2114901271 conn(0x7fa4540f0de0 msgr2=0x7fa4540fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.807+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 shutdown_connections 2022-02-02T18:48:46.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.807+0000 7fa459c39700 1 -- 172.21.15.96:0/2114901271 wait complete. 2022-02-02T18:48:46.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 -- 172.21.15.96:0/3119280358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f66e0 msgr2=0x7f890c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 --2- 172.21.15.96:0/3119280358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f66e0 0x7f890c0f6b00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f8900004660 tx=0x7f8900009b30).stop 2022-02-02T18:48:46.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 -- 172.21.15.96:0/3119280358 shutdown_connections 2022-02-02T18:48:46.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 --2- 172.21.15.96:0/3119280358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f7980 0x7f890c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 --2- 172.21.15.96:0/3119280358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f66e0 0x7f890c0f6b00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 -- 172.21.15.96:0/3119280358 >> 172.21.15.96:0/3119280358 conn(0x7f890c0f1e40 msgr2=0x7f890c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:46.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 -- 172.21.15.96:0/3119280358 shutdown_connections 2022-02-02T18:48:46.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.903+0000 7f8910d99700 1 -- 172.21.15.96:0/3119280358 wait complete. 2022-02-02T18:48:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 Processor -- start 2022-02-02T18:48:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 -- start start 2022-02-02T18:48:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f66e0 0x7f890c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c107a50 con 0x7f890c0f7980 2022-02-02T18:48:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8910d99700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c107b90 con 0x7f890c0f66e0 2022-02-02T18:48:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8909d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8909d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56136/0 (socket says 172.21.15.96:56136) 2022-02-02T18:48:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f8909d9b700 1 -- 172.21.15.96:0/960785240 learned_addr learned my addr 172.21.15.96:0/960785240 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.904+0000 7f890a59c700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f66e0 0x7f890c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8909d9b700 1 -- 172.21.15.96:0/960785240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f66e0 msgr2=0x7f890c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8909d9b700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f66e0 0x7f890c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8909d9b700 1 -- 172.21.15.96:0/960785240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900005040 con 0x7f890c0f7980 2022-02-02T18:48:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8909d9b700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f88fc00c790 tx=0x7f88fc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88fc00e680 con 0x7f890c0f7980 2022-02-02T18:48:46.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88fc00ec90 con 0x7f890c0f7980 2022-02-02T18:48:46.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c108530 con 0x7f890c0f7980 2022-02-02T18:48:46.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88fc013d60 con 0x7f890c0f7980 2022-02-02T18:48:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.905+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c108af0 con 0x7f890c0f7980 2022-02-02T18:48:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.906+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c045ad0 con 0x7f890c0f7980 2022-02-02T18:48:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.907+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f88fc01a060 con 0x7f890c0f7980 2022-02-02T18:48:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.907+0000 7f88faffd700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 0x7f88f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.907+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f88fc081ce0 con 0x7f890c0f7980 2022-02-02T18:48:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.907+0000 7f890a59c700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 0x7f88f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.908+0000 7f890a59c700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 0x7f88f4067290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8900004e30 tx=0x7f8900009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:46.911+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f88fc0537c0 con 0x7f890c0f7980 2022-02-02T18:48:47.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.143+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f890c027a00 con 0x7f890c0f7980 2022-02-02T18:48:47.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.143+0000 7f88faffd700 1 -- 172.21.15.96:0/960785240 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f88fc018070 con 0x7f890c0f7980 2022-02-02T18:48:47.140 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:48:47.140 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:48:47.141 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:48:47.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:47.141 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:48:47.141 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:48:47.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:47.142 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:48:47.142 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:48:47.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:47.143 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:48:47.143 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:48:47.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:48:47.143 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:48:47.143 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:48:47.144 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:48:47.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:48:47.144 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:48:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 msgr2=0x7f88f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 0x7f88f4067290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8900004e30 tx=0x7f8900009b30).stop 2022-02-02T18:48:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 msgr2=0x7f890c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f88fc00c790 tx=0x7f88fc007d70).stop 2022-02-02T18:48:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 shutdown_connections 2022-02-02T18:48:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88f4064dd0 0x7f88f4067290 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f890c0f66e0 0x7f890c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 --2- 172.21.15.96:0/960785240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f890c0f7980 0x7f890c1074a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 >> 172.21.15.96:0/960785240 conn(0x7f890c0f1e40 msgr2=0x7f890c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 shutdown_connections 2022-02-02T18:48:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.145+0000 7f8910d99700 1 -- 172.21.15.96:0/960785240 wait complete. 2022-02-02T18:48:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 -- 172.21.15.96:0/69014857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f66e0 msgr2=0x7f81800f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 --2- 172.21.15.96:0/69014857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f66e0 0x7f81800f6b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f8170004660 tx=0x7f8170009b30).stop 2022-02-02T18:48:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 -- 172.21.15.96:0/69014857 shutdown_connections 2022-02-02T18:48:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 --2- 172.21.15.96:0/69014857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f7980 0x7f81800f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 --2- 172.21.15.96:0/69014857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f66e0 0x7f81800f6b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 -- 172.21.15.96:0/69014857 >> 172.21.15.96:0/69014857 conn(0x7f81800f1e40 msgr2=0x7f81800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 -- 172.21.15.96:0/69014857 shutdown_connections 2022-02-02T18:48:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.243+0000 7f818730c700 1 -- 172.21.15.96:0/69014857 wait complete. 2022-02-02T18:48:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 Processor -- start 2022-02-02T18:48:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 -- start start 2022-02-02T18:48:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f66e0 0x7f818006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818010ac80 con 0x7f81800f7980 2022-02-02T18:48:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f818730c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818010adc0 con 0x7f81800f66e0 2022-02-02T18:48:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56144/0 (socket says 172.21.15.96:56144) 2022-02-02T18:48:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 -- 172.21.15.96:0/3181931974 learned_addr learned my addr 172.21.15.96:0/3181931974 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:48:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81850a8700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f66e0 0x7f818006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 -- 172.21.15.96:0/3181931974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f66e0 msgr2=0x7f818006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f66e0 0x7f818006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 -- 172.21.15.96:0/3181931974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170005040 con 0x7f81800f7980 2022-02-02T18:48:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.244+0000 7f81848a7700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f817c0026d0 tx=0x7f817c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:47.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.245+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c0079c0 con 0x7f81800f7980 2022-02-02T18:48:47.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.245+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f817c00f040 con 0x7f81800f7980 2022-02-02T18:48:47.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.245+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818006a3d0 con 0x7f81800f7980 2022-02-02T18:48:47.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.245+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c0137c0 con 0x7f81800f7980 2022-02-02T18:48:47.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.245+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818006a990 con 0x7f81800f7980 2022-02-02T18:48:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.246+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180045ad0 con 0x7f81800f7980 2022-02-02T18:48:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.246+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f817c007b20 con 0x7f81800f7980 2022-02-02T18:48:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.247+0000 7f8175ffb700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 0x7f816c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:48:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.247+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f817c081aa0 con 0x7f81800f7980 2022-02-02T18:48:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.247+0000 7f81850a8700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 0x7f816c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:48:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.247+0000 7f81850a8700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 0x7f816c067290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8170013690 tx=0x7f8170009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:48:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.251+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f817c04fb50 con 0x7f81800f7980 2022-02-02T18:48:47.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.454+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f818006ac10 con 0x7f81800f7980 2022-02-02T18:48:47.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.454+0000 7f8175ffb700 1 -- 172.21.15.96:0/3181931974 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f817c053170 con 0x7f81800f7980 2022-02-02T18:48:47.451 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:48:47.452 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:48:47.452 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:48:47.453 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:48:47.453 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:47.453 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:48:47.454 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:48:47.454 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:48:47.454 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:48:47.454 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:48:47.455 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:48:47.455 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:48:47.455 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:48:47.455 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:48:47.456 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:48:47.456 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:48:47.456 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:48:47.456 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:48:47.456 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:48:47.457 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:48:47.457 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:48:47.457 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:48:47.457 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:48:47.458 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:48:47.458 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:48:47.458 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:48:47.458 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:48:47.458 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:48:47.459 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:48:47.459 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:48:47.459 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:48:47.459 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:48:47.460 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:47.460 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:47.460 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:48:47.460 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:48:47.460 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:47.461 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:47.461 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:48:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 msgr2=0x7f816c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 0x7f816c067290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8170013690 tx=0x7f8170009b30).stop 2022-02-02T18:48:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 msgr2=0x7f8180069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:48:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f817c0026d0 tx=0x7f817c009de0).stop 2022-02-02T18:48:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 shutdown_connections 2022-02-02T18:48:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f816c064dd0 0x7f816c067290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81800f66e0 0x7f818006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 --2- 172.21.15.96:0/3181931974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81800f7980 0x7f8180069e20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:48:47.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 >> 172.21.15.96:0/3181931974 conn(0x7f81800f1e40 msgr2=0x7f81800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:48:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 shutdown_connections 2022-02-02T18:48:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:48:47.457+0000 7f818730c700 1 -- 172.21.15.96:0/3181931974 wait complete. 2022-02-02T18:48:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:48:47.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:47 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:47.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:47 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:47.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:47 smithi096 ceph-mon[101353]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:47.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/960785240' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:47.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:47 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:47.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:47 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:47.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:47 smithi159 ceph-mon[69013]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:47.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/960785240' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:48.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:48 smithi159 ceph-mon[69013]: from='client.34944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:48.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:48 smithi159 ceph-mon[69013]: pgmap v800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3181931974' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:48:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:48 smithi096 ceph-mon[101353]: from='client.34944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:48:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:48 smithi096 ceph-mon[101353]: pgmap v800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3181931974' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:48:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:50 smithi159 ceph-mon[69013]: pgmap v801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:50 smithi096 ceph-mon[101353]: pgmap v801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:52 smithi159 ceph-mon[69013]: pgmap v802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:52 smithi096 ceph-mon[101353]: pgmap v802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:54.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:54 smithi159 ceph-mon[69013]: pgmap v803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:54 smithi096 ceph-mon[101353]: pgmap v803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:56.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:56 smithi159 ceph-mon[69013]: pgmap v804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:56.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:56 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:56 smithi096 ceph-mon[101353]: pgmap v804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:48:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:56 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:48:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:48:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:48:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:48:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:48:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:58 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:48:58 smithi159 ceph-mon[69013]: pgmap v805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:48:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:58 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:48:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:48:58 smithi096 ceph-mon[101353]: pgmap v805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:00 smithi159 ceph-mon[69013]: pgmap v806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:00 smithi096 ceph-mon[101353]: pgmap v806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:02.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:02 smithi159 ceph-mon[69013]: pgmap v807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:02.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:02 smithi096 ceph-mon[101353]: pgmap v807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:04.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:04 smithi159 ceph-mon[69013]: pgmap v808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:04.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:04 smithi096 ceph-mon[101353]: pgmap v808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:06.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:06 smithi159 ceph-mon[69013]: pgmap v809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:06.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:06 smithi096 ceph-mon[101353]: pgmap v809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:07.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:07.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:07.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:07.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:07.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:07.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:07.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:07.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:07.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:08 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:08 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:08 smithi159 ceph-mon[69013]: pgmap v810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:08 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:08 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:08 smithi096 ceph-mon[101353]: pgmap v810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:10.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:10 smithi159 ceph-mon[69013]: pgmap v811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:10.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:10 smithi096 ceph-mon[101353]: pgmap v811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:12.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:12 smithi159 ceph-mon[69013]: pgmap v812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:12.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:12 smithi096 ceph-mon[101353]: pgmap v812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:14.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:14 smithi159 ceph-mon[69013]: pgmap v813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:14.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:14 smithi096 ceph-mon[101353]: pgmap v813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:16.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:16 smithi159 ceph-mon[69013]: pgmap v814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:16.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:16 smithi096 ceph-mon[101353]: pgmap v814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 -- 172.21.15.96:0/2145122593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 msgr2=0x7fb9f00f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/2145122593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f00f8120 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fb9e4004660 tx=0x7fb9e4009b30).stop 2022-02-02T18:49:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 -- 172.21.15.96:0/2145122593 shutdown_connections 2022-02-02T18:49:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/2145122593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 0x7fb9f00f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/2145122593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f00f8120 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 -- 172.21.15.96:0/2145122593 >> 172.21.15.96:0/2145122593 conn(0x7fb9f00f0540 msgr2=0x7fb9f00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 -- 172.21.15.96:0/2145122593 shutdown_connections 2022-02-02T18:49:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.571+0000 7fb9f56a6700 1 -- 172.21.15.96:0/2145122593 wait complete. 2022-02-02T18:49:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 Processor -- start 2022-02-02T18:49:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 -- start start 2022-02-02T18:49:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 0x7fb9f0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0107a10 con 0x7fb9f00f7d00 2022-02-02T18:49:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9f56a6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0107b50 con 0x7fb9f00f8610 2022-02-02T18:49:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56164/0 (socket says 172.21.15.96:56164) 2022-02-02T18:49:17.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 -- 172.21.15.96:0/919199053 learned_addr learned my addr 172.21.15.96:0/919199053 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:17.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9ee7fc700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 0x7fb9f0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 -- 172.21.15.96:0/919199053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 msgr2=0x7fb9f0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 0x7fb9f0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 -- 172.21.15.96:0/919199053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4005040 con 0x7fb9f00f7d00 2022-02-02T18:49:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.572+0000 7fb9eeffd700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb9e4009990 tx=0x7fb9e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.573+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e4018070 con 0x7fb9f00f7d00 2022-02-02T18:49:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.573+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9e4007ba0 con 0x7fb9f00f7d00 2022-02-02T18:49:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.573+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0108490 con 0x7fb9f00f7d00 2022-02-02T18:49:17.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.573+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e401c3c0 con 0x7fb9f00f7d00 2022-02-02T18:49:17.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.573+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f01089f0 con 0x7fb9f00f7d00 2022-02-02T18:49:17.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.574+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9e401c680 con 0x7fb9f00f7d00 2022-02-02T18:49:17.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.574+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0045ad0 con 0x7fb9f00f7d00 2022-02-02T18:49:17.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.574+0000 7fb9d77fe700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 0x7fb9d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.574+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb9e4083740 con 0x7fb9f00f7d00 2022-02-02T18:49:17.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.575+0000 7fb9ee7fc700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 0x7fb9d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.575+0000 7fb9ee7fc700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 0x7fb9d8067290 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb9e0004c40 tx=0x7fb9e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.579+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9e4007d80 con 0x7fb9f00f7d00 2022-02-02T18:49:17.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.756+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9f00ff030 con 0x7fb9d8064dd0 2022-02-02T18:49:17.752 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:17.752 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:17.752 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:17.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:17.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:17.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.754 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.757+0000 7fb9d77fe700 1 -- 172.21.15.96:0/919199053 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb9f00ff030 con 0x7fb9d8064dd0 2022-02-02T18:49:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 msgr2=0x7fb9d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 0x7fb9d8067290 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb9e0004c40 tx=0x7fb9e000b040).stop 2022-02-02T18:49:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 msgr2=0x7fb9f0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb9e4009990 tx=0x7fb9e4009b30).stop 2022-02-02T18:49:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 shutdown_connections 2022-02-02T18:49:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9d8064dd0 0x7fb9d8067290 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9f00f7d00 0x7fb9f0106f70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 --2- 172.21.15.96:0/919199053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9f00f8610 0x7fb9f0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 >> 172.21.15.96:0/919199053 conn(0x7fb9f00f0540 msgr2=0x7fb9f00fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 shutdown_connections 2022-02-02T18:49:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.759+0000 7fb9f56a6700 1 -- 172.21.15.96:0/919199053 wait complete. 2022-02-02T18:49:17.764 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:49:17.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:17.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:17.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:17.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:17.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:17.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:17.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 -- 172.21.15.96:0/4206552222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 msgr2=0x7ff9c40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 --2- 172.21.15.96:0/4206552222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40f6920 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff9b4004660 tx=0x7ff9b4009b30).stop 2022-02-02T18:49:17.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 -- 172.21.15.96:0/4206552222 shutdown_connections 2022-02-02T18:49:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 --2- 172.21.15.96:0/4206552222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40f6920 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 --2- 172.21.15.96:0/4206552222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 0x7ff9c40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.857+0000 7ff9c9447700 1 -- 172.21.15.96:0/4206552222 >> 172.21.15.96:0/4206552222 conn(0x7ff9c40f0de0 msgr2=0x7ff9c40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:17.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.858+0000 7ff9c9447700 1 -- 172.21.15.96:0/4206552222 shutdown_connections 2022-02-02T18:49:17.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.858+0000 7ff9c9447700 1 -- 172.21.15.96:0/4206552222 wait complete. 2022-02-02T18:49:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.858+0000 7ff9c9447700 1 Processor -- start 2022-02-02T18:49:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.858+0000 7ff9c9447700 1 -- start start 2022-02-02T18:49:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c9447700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 0x7ff9c40fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c9447700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c9447700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40fc4f0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c9447700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40fc630 con 0x7ff9c40f55e0 2022-02-02T18:49:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56176/0 (socket says 172.21.15.96:56176) 2022-02-02T18:49:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 -- 172.21.15.96:0/1040503835 learned_addr learned my addr 172.21.15.96:0/1040503835 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c2ffd700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 0x7ff9c40fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 -- 172.21.15.96:0/1040503835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 msgr2=0x7ff9c40fdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 0x7ff9c40fdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 -- 172.21.15.96:0/1040503835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4005040 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c27fc700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7ff9b4009990 tx=0x7ff9b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:17.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b4018070 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.859+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40fc8b0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.860+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9b4007ba0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.860+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b401c3c0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.860+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40fce10 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.861+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c4045ad0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.861+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9b401d420 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.861+0000 7ff9ab7fe700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 0x7ff9ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.861+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9b40837b0 con 0x7ff9c40f5ef0 2022-02-02T18:49:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.861+0000 7ff9c2ffd700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 0x7ff9ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.862+0000 7ff9c2ffd700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 0x7ff9ac067290 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7ff9c40fd8a0 tx=0x7ff9b8009c20).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:17.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:17.866+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9b4051800 con 0x7ff9c40f5ef0 2022-02-02T18:49:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.038+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c40fef60 con 0x7ff9ac064dd0 2022-02-02T18:49:18.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.048+0000 7ff9ab7fe700 1 -- 172.21.15.96:0/1040503835 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff9c40fef60 con 0x7ff9ac064dd0 2022-02-02T18:49:18.044 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:49:18.045 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (32m) 3m ago 33m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:49:18.045 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (25m) 3m ago 33m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:49:18.045 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (25m) 102s ago 33m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:49:18.045 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (32m) 3m ago 33m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:49:18.046 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (29m) 3m ago 29m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:49:18.046 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (25m) 3m ago 29m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:49:18.046 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (29m) 102s ago 29m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:49:18.046 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (25m) 102s ago 29m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:49:18.046 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (26m) 3m ago 34m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:49:18.047 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (26m) 102s ago 33m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:49:18.047 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (25m) 3m ago 34m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:49:18.047 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (25m) 102s ago 33m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:49:18.047 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (33m) 3m ago 33m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:49:18.048 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (33m) 102s ago 32m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:49:18.048 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (24m) 3m ago 32m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:49:18.048 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (24m) 3m ago 32m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:49:18.048 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (23m) 3m ago 31m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:49:18.049 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (23m) 102s ago 31m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:49:18.049 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (22m) 102s ago 31m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:49:18.049 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (22m) 102s ago 31m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:49:18.049 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (32m) 3m ago 33m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:49:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.049+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 msgr2=0x7ff9ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.049+0000 7ff9c9447700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 0x7ff9ac067290 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7ff9c40fd8a0 tx=0x7ff9b8009c20).stop 2022-02-02T18:49:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.049+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 msgr2=0x7ff9c40fbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.049+0000 7ff9c9447700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7ff9b4009990 tx=0x7ff9b4009b30).stop 2022-02-02T18:49:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 shutdown_connections 2022-02-02T18:49:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9ac064dd0 0x7ff9ac067290 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c40f55e0 0x7ff9c40fdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 --2- 172.21.15.96:0/1040503835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9c40f5ef0 0x7ff9c40fbf90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 >> 172.21.15.96:0/1040503835 conn(0x7ff9c40f0de0 msgr2=0x7ff9c40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 shutdown_connections 2022-02-02T18:49:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.050+0000 7ff9c9447700 1 -- 172.21.15.96:0/1040503835 wait complete. 2022-02-02T18:49:18.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 -- 172.21.15.96:0/3720478230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f6880 msgr2=0x7f038c0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 --2- 172.21.15.96:0/3720478230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f6880 0x7f038c0f6ce0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f037c004660 tx=0x7f037c009b30).stop 2022-02-02T18:49:18.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 -- 172.21.15.96:0/3720478230 shutdown_connections 2022-02-02T18:49:18.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 --2- 172.21.15.96:0/3720478230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f6880 0x7f038c0f6ce0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 --2- 172.21.15.96:0/3720478230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f55e0 0x7f038c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 -- 172.21.15.96:0/3720478230 >> 172.21.15.96:0/3720478230 conn(0x7f038c0f0d40 msgr2=0x7f038c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 -- 172.21.15.96:0/3720478230 shutdown_connections 2022-02-02T18:49:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.147+0000 7f0391525700 1 -- 172.21.15.96:0/3720478230 wait complete. 2022-02-02T18:49:18.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 Processor -- start 2022-02-02T18:49:18.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 -- start start 2022-02-02T18:49:18.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 0x7f038c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c060500 con 0x7f038c0f55e0 2022-02-02T18:49:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f0391525700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c060640 con 0x7f038c0f6880 2022-02-02T18:49:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f038affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f038affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56184/0 (socket says 172.21.15.96:56184) 2022-02-02T18:49:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.148+0000 7f038affd700 1 -- 172.21.15.96:0/401749582 learned_addr learned my addr 172.21.15.96:0/401749582 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038a7fc700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 0x7f038c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038affd700 1 -- 172.21.15.96:0/401749582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 msgr2=0x7f038c10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038affd700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 0x7f038c10c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038affd700 1 -- 172.21.15.96:0/401749582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c005040 con 0x7f038c0f55e0 2022-02-02T18:49:18.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038a7fc700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 0x7f038c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:49:18.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f038affd700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f038000c790 tx=0x7f0380007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:18.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f038000e680 con 0x7f038c0f55e0 2022-02-02T18:49:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f038000ec90 con 0x7f038c0f55e0 2022-02-02T18:49:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c10c700 con 0x7f038c0f55e0 2022-02-02T18:49:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0380012d00 con 0x7f038c0f55e0 2022-02-02T18:49:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.149+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c10ccc0 con 0x7f038c0f55e0 2022-02-02T18:49:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.150+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c045ad0 con 0x7f038c0f55e0 2022-02-02T18:49:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.151+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0380010070 con 0x7f038c0f55e0 2022-02-02T18:49:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.151+0000 7f03737fe700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 0x7f0374067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.151+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0380081aa0 con 0x7f038c0f55e0 2022-02-02T18:49:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.151+0000 7f038a7fc700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 0x7f0374067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.151+0000 7f038a7fc700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 0x7f0374067290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f037c004e30 tx=0x7f037c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:18.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.155+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f038004faf0 con 0x7f038c0f55e0 2022-02-02T18:49:18.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.387+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f038c027a00 con 0x7f038c0f55e0 2022-02-02T18:49:18.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.387+0000 7f03737fe700 1 -- 172.21.15.96:0/401749582 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0380053110 con 0x7f038c0f55e0 2022-02-02T18:49:18.384 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:49:18.384 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:49:18.385 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:49:18.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:18.385 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:49:18.385 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:49:18.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:18.386 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:49:18.386 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:49:18.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:18.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:49:18.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:49:18.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:18.388 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:49:18.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:49:18.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:49:18.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:49:18.389 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:49:18.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 msgr2=0x7f0374067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 0x7f0374067290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f037c004e30 tx=0x7f037c009b30).stop 2022-02-02T18:49:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 msgr2=0x7f038c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f038000c790 tx=0x7f0380007d90).stop 2022-02-02T18:49:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 shutdown_connections 2022-02-02T18:49:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0374064dd0 0x7f0374067290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0f55e0 0x7f038c109c50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 --2- 172.21.15.96:0/401749582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f038c0f6880 0x7f038c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 >> 172.21.15.96:0/401749582 conn(0x7f038c0f0d40 msgr2=0x7f038c0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 shutdown_connections 2022-02-02T18:49:18.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.389+0000 7f0391525700 1 -- 172.21.15.96:0/401749582 wait complete. 2022-02-02T18:49:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.488+0000 7fd18df91700 1 -- 172.21.15.96:0/765476510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 msgr2=0x7fd1880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.488+0000 7fd18df91700 1 --2- 172.21.15.96:0/765476510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd1880f7de0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd17c004660 tx=0x7fd17c009b30).stop 2022-02-02T18:49:18.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 -- 172.21.15.96:0/765476510 shutdown_connections 2022-02-02T18:49:18.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 --2- 172.21.15.96:0/765476510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd1880f7de0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 --2- 172.21.15.96:0/765476510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 0x7fd1880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 -- 172.21.15.96:0/765476510 >> 172.21.15.96:0/765476510 conn(0x7fd1880f1e40 msgr2=0x7fd1880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 -- 172.21.15.96:0/765476510 shutdown_connections 2022-02-02T18:49:18.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 -- 172.21.15.96:0/765476510 wait complete. 2022-02-02T18:49:18.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 Processor -- start 2022-02-02T18:49:18.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.489+0000 7fd18df91700 1 -- start start 2022-02-02T18:49:18.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 0x7fd188106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188107a00 con 0x7fd1880f7980 2022-02-02T18:49:18.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188107b40 con 0x7fd1880f66e0 2022-02-02T18:49:18.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56196/0 (socket says 172.21.15.96:56196) 2022-02-02T18:49:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 -- 172.21.15.96:0/3087324807 learned_addr learned my addr 172.21.15.96:0/3087324807 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd1877fe700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 0x7fd188106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 -- 172.21.15.96:0/3087324807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 msgr2=0x7fd188106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 0x7fd188106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 -- 172.21.15.96:0/3087324807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c005040 con 0x7fd1880f7980 2022-02-02T18:49:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd186ffd700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fd17c009990 tx=0x7fd17c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c018070 con 0x7fd1880f7980 2022-02-02T18:49:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd17c007ba0 con 0x7fd1880f7980 2022-02-02T18:49:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd188108480 con 0x7fd1880f7980 2022-02-02T18:49:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c01c3c0 con 0x7fd1880f7980 2022-02-02T18:49:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.490+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1881089e0 con 0x7fd1880f7980 2022-02-02T18:49:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.491+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188045ad0 con 0x7fd1880f7980 2022-02-02T18:49:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.492+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd17c01d420 con 0x7fd1880f7980 2022-02-02T18:49:18.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.492+0000 7fd16ffff700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 0x7fd170067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:18.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.492+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd17c083700 con 0x7fd1880f7980 2022-02-02T18:49:18.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.492+0000 7fd1877fe700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 0x7fd170067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:18.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.493+0000 7fd1877fe700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 0x7fd170067290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd1880f77e0 tx=0x7fd17800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:18.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.496+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd17c055240 con 0x7fd1880f7980 2022-02-02T18:49:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.697+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd188027a00 con 0x7fd1880f7980 2022-02-02T18:49:18.694 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:18 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:18.694 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:18 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:18.695 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:18 smithi096 ceph-mon[101353]: pgmap v815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:18.695 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/401749582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.697+0000 7fd16ffff700 1 -- 172.21.15.96:0/3087324807 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd17c054e30 con 0x7fd1880f7980 2022-02-02T18:49:18.696 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:49:18.696 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:49:18.696 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:49:18.697 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:49:18.697 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:18.697 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:49:18.697 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:49:18.697 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:49:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:49:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:49:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:49:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:49:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:49:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:49:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:49:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:49:18.700 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:49:18.700 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:49:18.700 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:49:18.700 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:49:18.700 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:49:18.701 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:49:18.701 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:49:18.701 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:49:18.701 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:49:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:49:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:49:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:49:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:49:18.703 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:49:18.703 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:49:18.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:49:18.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:18.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:18.704 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:49:18.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:18.704 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:18.704 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:18.704 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 msgr2=0x7fd170067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 0x7fd170067290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd1880f77e0 tx=0x7fd17800b040).stop 2022-02-02T18:49:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 msgr2=0x7fd188107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fd17c009990 tx=0x7fd17c009b30).stop 2022-02-02T18:49:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 shutdown_connections 2022-02-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd170064dd0 0x7fd170067290 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1880f66e0 0x7fd188106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 --2- 172.21.15.96:0/3087324807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1880f7980 0x7fd188107450 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 >> 172.21.15.96:0/3087324807 conn(0x7fd1880f1e40 msgr2=0x7fd1880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.699+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 shutdown_connections 2022-02-02T18:49:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:18.700+0000 7fd18df91700 1 -- 172.21.15.96:0/3087324807 wait complete. 2022-02-02T18:49:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:49:18.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:18 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:18.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:18 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:18.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:18 smithi159 ceph-mon[69013]: pgmap v815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:18.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/401749582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:19.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:19 smithi159 ceph-mon[69013]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:19.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:19 smithi159 ceph-mon[69013]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:19.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3087324807' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:49:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:19 smithi096 ceph-mon[101353]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:19 smithi096 ceph-mon[101353]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3087324807' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:49:20.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:20 smithi159 ceph-mon[69013]: pgmap v816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:20 smithi096 ceph-mon[101353]: pgmap v816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:22.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:22 smithi159 ceph-mon[69013]: pgmap v817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:22.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:22 smithi096 ceph-mon[101353]: pgmap v817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:24.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:24 smithi159 ceph-mon[69013]: pgmap v818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:24.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:24 smithi096 ceph-mon[101353]: pgmap v818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:26.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:26 smithi159 ceph-mon[69013]: pgmap v819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:26 smithi096 ceph-mon[101353]: pgmap v819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:27.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:27.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:49:27.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:49:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:49:27.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:49:28.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:28 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:28.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:28 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:28.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:28 smithi159 ceph-mon[69013]: pgmap v820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:28 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:28 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:28 smithi096 ceph-mon[101353]: pgmap v820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:30.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:30 smithi159 ceph-mon[69013]: pgmap v821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:30.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:30 smithi096 ceph-mon[101353]: pgmap v821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:32.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:32 smithi159 ceph-mon[69013]: pgmap v822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:32.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:32 smithi096 ceph-mon[101353]: pgmap v822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:34.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:34 smithi159 ceph-mon[69013]: pgmap v823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:34.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:34 smithi096 ceph-mon[101353]: pgmap v823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:36 smithi159 ceph-mon[69013]: pgmap v824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:36 smithi096 ceph-mon[101353]: pgmap v824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:37.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:37.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:37.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:37.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:37.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:37.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:37 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:37.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:37.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:37.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:37.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:37.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:37 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:38 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:38 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:38 smithi159 ceph-mon[69013]: pgmap v825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:38 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:38 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:38 smithi096 ceph-mon[101353]: pgmap v825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:40 smithi096 ceph-mon[101353]: pgmap v826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:40 smithi159 ceph-mon[69013]: pgmap v826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:42.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:42 smithi096 ceph-mon[101353]: pgmap v827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:42 smithi159 ceph-mon[69013]: pgmap v827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:44.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:44 smithi096 ceph-mon[101353]: pgmap v828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:45.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:44 smithi159 ceph-mon[69013]: pgmap v828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:46 smithi096 ceph-mon[101353]: pgmap v829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:47.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:46 smithi159 ceph-mon[69013]: pgmap v829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:47.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:47.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:47.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:47.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:47.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:47.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:47.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:47.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:47.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:47 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:48.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:48.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:48.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:48.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:48.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:48.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:48.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:48.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:48.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:47 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:48 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:48 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:48 smithi096 ceph-mon[101353]: pgmap v830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:48.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/528510915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 msgr2=0x7fbf680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:48.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/528510915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf680f59e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fbf50004660 tx=0x7fbf50009b30).stop 2022-02-02T18:49:48.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/528510915 shutdown_connections 2022-02-02T18:49:48.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/528510915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 0x7fbf680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:49:48.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/528510915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf680f59e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:48.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.812+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/528510915 >> 172.21.15.96:0/528510915 conn(0x7fbf680f0d40 msgr2=0x7fbf680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:48.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/528510915 shutdown_connections 2022-02-02T18:49:48.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/528510915 wait complete. 2022-02-02T18:49:48.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 Processor -- start 2022-02-02T18:49:48.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 -- start start 2022-02-02T18:49:48.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:48.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 0x7fbf681063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:48.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681069f0 con 0x7fbf680f55c0 2022-02-02T18:49:48.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.813+0000 7fbf6cdbb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681072a0 con 0x7fbf680f6860 2022-02-02T18:49:48.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:48.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56212/0 (socket says 172.21.15.96:56212) 2022-02-02T18:49:48.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 -- 172.21.15.96:0/3556476879 learned_addr learned my addr 172.21.15.96:0/3556476879 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:48.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf65d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 0x7fbf681063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:48.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 -- 172.21.15.96:0/3556476879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 msgr2=0x7fbf681063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:48.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 0x7fbf681063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:48.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 -- 172.21.15.96:0/3556476879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50005040 con 0x7fbf680f55c0 2022-02-02T18:49:48.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6659c700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fbf50004f60 tx=0x7fbf50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:48.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf50018070 con 0x7fbf680f55c0 2022-02-02T18:49:48.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf68107520 con 0x7fbf680f55c0 2022-02-02T18:49:48.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf50009770 con 0x7fbf680f55c0 2022-02-02T18:49:48.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf5001c3c0 con 0x7fbf680f55c0 2022-02-02T18:49:48.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.814+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf68107a80 con 0x7fbf680f55c0 2022-02-02T18:49:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.815+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf680f49b0 con 0x7fbf680f55c0 2022-02-02T18:49:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.816+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbf5001d420 con 0x7fbf680f55c0 2022-02-02T18:49:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.816+0000 7fbf5effd700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 0x7fbf54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.816+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbf500838d0 con 0x7fbf680f55c0 2022-02-02T18:49:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.816+0000 7fbf65d9b700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 0x7fbf54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.816+0000 7fbf65d9b700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 0x7fbf54067290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fbf58006fd0 tx=0x7fbf58008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:48.820+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbf50055470 con 0x7fbf680f55c0 2022-02-02T18:49:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.000+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf680fde70 con 0x7fbf54064dd0 2022-02-02T18:49:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.001+0000 7fbf5effd700 1 -- 172.21.15.96:0/3556476879 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbf680fde70 con 0x7fbf54064dd0 2022-02-02T18:49:48.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 msgr2=0x7fbf54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 0x7fbf54067290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fbf58006fd0 tx=0x7fbf58008040).stop 2022-02-02T18:49:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 msgr2=0x7fbf68105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fbf50004f60 tx=0x7fbf50009b30).stop 2022-02-02T18:49:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 shutdown_connections 2022-02-02T18:49:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf54064dd0 0x7fbf54067290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf680f55c0 0x7fbf68105ec0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 --2- 172.21.15.96:0/3556476879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf680f6860 0x7fbf681063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 >> 172.21.15.96:0/3556476879 conn(0x7fbf680f0d40 msgr2=0x7fbf680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 shutdown_connections 2022-02-02T18:49:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.003+0000 7fbf6cdbb700 1 -- 172.21.15.96:0/3556476879 wait complete. 2022-02-02T18:49:49.008 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:49:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:48 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:48 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:48 smithi159 ceph-mon[69013]: pgmap v830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:49.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 -- 172.21.15.96:0/1416860589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f66e0 msgr2=0x7fce840f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 --2- 172.21.15.96:0/1416860589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f66e0 0x7fce840f6b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fce74004660 tx=0x7fce74009b30).stop 2022-02-02T18:49:49.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 -- 172.21.15.96:0/1416860589 shutdown_connections 2022-02-02T18:49:49.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 --2- 172.21.15.96:0/1416860589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f7980 0x7fce840f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 --2- 172.21.15.96:0/1416860589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f66e0 0x7fce840f6b00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 -- 172.21.15.96:0/1416860589 >> 172.21.15.96:0/1416860589 conn(0x7fce840f1e40 msgr2=0x7fce840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 -- 172.21.15.96:0/1416860589 shutdown_connections 2022-02-02T18:49:49.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.101+0000 7fce8a0db700 1 -- 172.21.15.96:0/1416860589 wait complete. 2022-02-02T18:49:49.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 Processor -- start 2022-02-02T18:49:49.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 -- start start 2022-02-02T18:49:49.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f66e0 0x7fce84106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84107a10 con 0x7fce840f7980 2022-02-02T18:49:49.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce8a0db700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84107b50 con 0x7fce840f66e0 2022-02-02T18:49:49.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56224/0 (socket says 172.21.15.96:56224) 2022-02-02T18:49:49.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 -- 172.21.15.96:0/2841459362 learned_addr learned my addr 172.21.15.96:0/2841459362 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:49.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce837fe700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f66e0 0x7fce84106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 -- 172.21.15.96:0/2841459362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f66e0 msgr2=0x7fce84106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f66e0 0x7fce84106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.102+0000 7fce82ffd700 1 -- 172.21.15.96:0/2841459362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74005040 con 0x7fce840f7980 2022-02-02T18:49:49.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce82ffd700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fce780026d0 tx=0x7fce78009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce780079c0 con 0x7fce840f7980 2022-02-02T18:49:49.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce841084f0 con 0x7fce840f7980 2022-02-02T18:49:49.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce84108ab0 con 0x7fce840f7980 2022-02-02T18:49:49.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce7800f040 con 0x7fce840f7980 2022-02-02T18:49:49.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.103+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce780148b0 con 0x7fce840f7980 2022-02-02T18:49:49.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.104+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce64004fa0 con 0x7fce840f7980 2022-02-02T18:49:49.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.104+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce780090d0 con 0x7fce840f7980 2022-02-02T18:49:49.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.105+0000 7fce6bfff700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 0x7fce6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.105+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fce78081900 con 0x7fce840f7980 2022-02-02T18:49:49.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.105+0000 7fce837fe700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 0x7fce6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.105+0000 7fce837fe700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 0x7fce6c067290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fce74004630 tx=0x7fce74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.109+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce780533e0 con 0x7fce840f7980 2022-02-02T18:49:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.282+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce64000bc0 con 0x7fce6c064dd0 2022-02-02T18:49:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.291+0000 7fce6bfff700 1 -- 172.21.15.96:0/2841459362 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fce64000bc0 con 0x7fce6c064dd0 2022-02-02T18:49:49.287 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:49:49.287 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (33m) 3m ago 34m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:49:49.287 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (25m) 3m ago 34m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:49:49.288 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (25m) 2m ago 33m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:49:49.288 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (33m) 3m ago 34m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:49:49.288 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (30m) 3m ago 30m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:49:49.288 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (25m) 3m ago 30m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:49:49.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (30m) 2m ago 30m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:49:49.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (26m) 2m ago 30m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:49:49.289 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (27m) 3m ago 35m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:49:49.289 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (26m) 2m ago 33m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:49:49.289 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (26m) 3m ago 35m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:49:49.290 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (26m) 2m ago 33m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:49:49.290 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (34m) 3m ago 33m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:49:49.290 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (33m) 2m ago 33m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:49:49.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (25m) 3m ago 33m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:49:49.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (24m) 3m ago 32m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:49:49.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (24m) 3m ago 32m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:49:49.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (23m) 2m ago 32m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:49:49.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (23m) 2m ago 31m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:49:49.292 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (22m) 2m ago 31m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:49:49.292 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (32m) 3m ago 33m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:49:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 msgr2=0x7fce6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 0x7fce6c067290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fce74004630 tx=0x7fce74009b30).stop 2022-02-02T18:49:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 msgr2=0x7fce84107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fce780026d0 tx=0x7fce78009de0).stop 2022-02-02T18:49:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 shutdown_connections 2022-02-02T18:49:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064dd0 0x7fce6c067290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f66e0 0x7fce84106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 --2- 172.21.15.96:0/2841459362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f7980 0x7fce84107460 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 >> 172.21.15.96:0/2841459362 conn(0x7fce840f1e40 msgr2=0x7fce840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 shutdown_connections 2022-02-02T18:49:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.293+0000 7fce8a0db700 1 -- 172.21.15.96:0/2841459362 wait complete. 2022-02-02T18:49:49.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 -- 172.21.15.96:0/4136945697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f5430 msgr2=0x7efdac0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 --2- 172.21.15.96:0/4136945697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f5430 0x7efdac0f5850 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7efd9c004660 tx=0x7efd9c009b30).stop 2022-02-02T18:49:49.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 -- 172.21.15.96:0/4136945697 shutdown_connections 2022-02-02T18:49:49.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 --2- 172.21.15.96:0/4136945697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f66d0 0x7efdac0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 --2- 172.21.15.96:0/4136945697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f5430 0x7efdac0f5850 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 -- 172.21.15.96:0/4136945697 >> 172.21.15.96:0/4136945697 conn(0x7efdac0f0b90 msgr2=0x7efdac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 -- 172.21.15.96:0/4136945697 shutdown_connections 2022-02-02T18:49:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.390+0000 7efdb084e700 1 -- 172.21.15.96:0/4136945697 wait complete. 2022-02-02T18:49:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 Processor -- start 2022-02-02T18:49:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 -- start start 2022-02-02T18:49:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f5430 0x7efdac05fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0603b0 con 0x7efdac0f66d0 2022-02-02T18:49:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.391+0000 7efdb084e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0604f0 con 0x7efdac0f5430 2022-02-02T18:49:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56234/0 (socket says 172.21.15.96:56234) 2022-02-02T18:49:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 -- 172.21.15.96:0/39138623 learned_addr learned my addr 172.21.15.96:0/39138623 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdab7fe700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f5430 0x7efdac05fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 -- 172.21.15.96:0/39138623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f5430 msgr2=0x7efdac05fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f5430 0x7efdac05fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 -- 172.21.15.96:0/39138623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c005040 con 0x7efdac0f66d0 2022-02-02T18:49:49.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdaaffd700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7efda000c790 tx=0x7efda0007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda000e680 con 0x7efdac0f66d0 2022-02-02T18:49:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efda000ec90 con 0x7efdac0f66d0 2022-02-02T18:49:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac068df0 con 0x7efdac0f66d0 2022-02-02T18:49:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda0013d60 con 0x7efdac0f66d0 2022-02-02T18:49:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.392+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac069330 con 0x7efdac0f66d0 2022-02-02T18:49:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.394+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac045ad0 con 0x7efdac0f66d0 2022-02-02T18:49:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.394+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efda001a060 con 0x7efdac0f66d0 2022-02-02T18:49:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.394+0000 7efd93fff700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 0x7efd940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.394+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efda0081ce0 con 0x7efdac0f66d0 2022-02-02T18:49:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.394+0000 7efdab7fe700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 0x7efd940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.395+0000 7efdab7fe700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 0x7efd940672e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7efd9c004e30 tx=0x7efd9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.399+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efda004fd90 con 0x7efdac0f66d0 2022-02-02T18:49:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.629+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efdac027a00 con 0x7efdac0f66d0 2022-02-02T18:49:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.629+0000 7efd93fff700 1 -- 172.21.15.96:0/39138623 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7efda0018070 con 0x7efdac0f66d0 2022-02-02T18:49:49.625 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:49:49.626 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:49:49.626 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:49:49.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:49.626 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:49:49.627 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:49:49.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:49.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:49:49.628 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:49:49.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:49.628 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:49:49.628 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:49:49.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:49:49.629 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:49:49.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:49:49.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:49:49.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:49:49.630 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:49:49.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 msgr2=0x7efd940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 0x7efd940672e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7efd9c004e30 tx=0x7efd9c009b30).stop 2022-02-02T18:49:49.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 msgr2=0x7efdac068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7efda000c790 tx=0x7efda0007d70).stop 2022-02-02T18:49:49.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 shutdown_connections 2022-02-02T18:49:49.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd94064e20 0x7efd940672e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdac0f5430 0x7efdac05fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 --2- 172.21.15.96:0/39138623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdac0f66d0 0x7efdac068900 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 >> 172.21.15.96:0/39138623 conn(0x7efdac0f0b90 msgr2=0x7efdac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 shutdown_connections 2022-02-02T18:49:49.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.631+0000 7efdb084e700 1 -- 172.21.15.96:0/39138623 wait complete. 2022-02-02T18:49:49.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 -- 172.21.15.96:0/1713229477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 msgr2=0x7f56140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 --2- 172.21.15.96:0/1713229477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f56140f59e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5608004660 tx=0x7f5608009b30).stop 2022-02-02T18:49:49.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 -- 172.21.15.96:0/1713229477 shutdown_connections 2022-02-02T18:49:49.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 --2- 172.21.15.96:0/1713229477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 0x7f56140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 --2- 172.21.15.96:0/1713229477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f56140f59e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 -- 172.21.15.96:0/1713229477 >> 172.21.15.96:0/1713229477 conn(0x7f56140f0d40 msgr2=0x7f56140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 -- 172.21.15.96:0/1713229477 shutdown_connections 2022-02-02T18:49:49.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.728+0000 7f561b0e2700 1 -- 172.21.15.96:0/1713229477 wait complete. 2022-02-02T18:49:49.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.729+0000 7f561b0e2700 1 Processor -- start 2022-02-02T18:49:49.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.729+0000 7f561b0e2700 1 -- start start 2022-02-02T18:49:49.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 0x7f561410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140603e0 con 0x7f56140f55c0 2022-02-02T18:49:49.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614060520 con 0x7f56140f6860 2022-02-02T18:49:49.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56242/0 (socket says 172.21.15.96:56242) 2022-02-02T18:49:49.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 -- 172.21.15.96:0/3497248932 learned_addr learned my addr 172.21.15.96:0/3497248932 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:49:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5613fff700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 0x7f561410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 -- 172.21.15.96:0/3497248932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 msgr2=0x7f561410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 0x7f561410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 -- 172.21.15.96:0/3497248932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608005040 con 0x7f56140f55c0 2022-02-02T18:49:49.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f5618e7e700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5608013a70 tx=0x7f5608009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5608018070 con 0x7f56140f55c0 2022-02-02T18:49:49.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56080097d0 con 0x7f56140f55c0 2022-02-02T18:49:49.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561410c700 con 0x7f56140f55c0 2022-02-02T18:49:49.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560801c3c0 con 0x7f56140f55c0 2022-02-02T18:49:49.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.730+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561410cc60 con 0x7f56140f55c0 2022-02-02T18:49:49.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.732+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614045ad0 con 0x7f56140f55c0 2022-02-02T18:49:49.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.732+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5608007ba0 con 0x7f56140f55c0 2022-02-02T18:49:49.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.732+0000 7f56117fa700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:49:49.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.732+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5608083690 con 0x7f56140f55c0 2022-02-02T18:49:49.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.732+0000 7f5613fff700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:49:49.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.733+0000 7f5613fff700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5600004a70 tx=0x7f560000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:49:49.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.737+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5608051800 con 0x7f56140f55c0 2022-02-02T18:49:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.936+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56140fdee0 con 0x7f56140f55c0 2022-02-02T18:49:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.936+0000 7f56117fa700 1 -- 172.21.15.96:0/3497248932 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5608054e20 con 0x7f56140f55c0 2022-02-02T18:49:49.932 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:49:49.932 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:49:49.933 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:49:49.933 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:49:49.933 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:49.933 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:49:49.934 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:49:49.934 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:49:49.934 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:49:49.934 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:49:49.935 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:49:49.935 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:49:49.935 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:49:49.935 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:49:49.936 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:49:49.936 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:49:49.936 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:49:49.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:49:49.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:49:49.937 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:49:49.937 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:49:49.937 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:49:49.937 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:49:49.938 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:49:49.938 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:49:49.938 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:49:49.938 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:49:49.939 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:49:49.939 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:49:49.939 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:49:49.939 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:49:49.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:49:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:49.940 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:49:49.940 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:49:49.941 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:49.941 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:49.941 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:49:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 msgr2=0x7f5604067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5600004a70 tx=0x7f560000b040).stop 2022-02-02T18:49:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 msgr2=0x7f5614109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:49:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5608013a70 tx=0x7f5608009b30).stop 2022-02-02T18:49:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 shutdown_connections 2022-02-02T18:49:49.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56140f55c0 0x7f5614109cb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 --2- 172.21.15.96:0/3497248932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56140f6860 0x7f561410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:49:49.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 >> 172.21.15.96:0/3497248932 conn(0x7f56140f0d40 msgr2=0x7f56140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:49:49.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 shutdown_connections 2022-02-02T18:49:49.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:49:49.938+0000 7f561b0e2700 1 -- 172.21.15.96:0/3497248932 wait complete. 2022-02-02T18:49:49.945 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:49:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:50 smithi096 ceph-mon[101353]: from='client.34972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:50 smithi096 ceph-mon[101353]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:50 smithi096 ceph-mon[101353]: pgmap v831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/39138623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3497248932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:49:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:50 smithi159 ceph-mon[69013]: from='client.34972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:50 smithi159 ceph-mon[69013]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:49:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:50 smithi159 ceph-mon[69013]: pgmap v831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/39138623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3497248932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:49:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:52 smithi096 ceph-mon[101353]: pgmap v832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:53.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:52 smithi159 ceph-mon[69013]: pgmap v832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:54 smithi096 ceph-mon[101353]: pgmap v833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:55.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:54 smithi159 ceph-mon[69013]: pgmap v833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:56 smithi096 ceph-mon[101353]: pgmap v834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:57.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:56 smithi159 ceph-mon[69013]: pgmap v834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:57.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:57 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:49:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:49:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:49:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:49:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:57.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:57 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:49:59.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:58 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:59.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:58 smithi159 ceph-mon[69013]: pgmap v835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:59.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:49:58 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:49:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:58 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:49:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:58 smithi096 ceph-mon[101353]: pgmap v835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:49:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:49:58 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:00 smithi159 ceph-mon[69013]: pgmap v836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:50:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:00 smithi096 ceph-mon[101353]: pgmap v836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T18:50:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:02 smithi159 ceph-mon[69013]: pgmap v837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:03.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:02 smithi096 ceph-mon[101353]: pgmap v837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:05.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:04 smithi159 ceph-mon[69013]: pgmap v838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:05.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:04 smithi096 ceph-mon[101353]: pgmap v838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:06 smithi159 ceph-mon[69013]: pgmap v839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:07.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:06 smithi096 ceph-mon[101353]: pgmap v839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:08.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:08.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:08.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:07 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:08.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:08.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:08.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:08.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:08.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:07 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:09.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:08 smithi159 ceph-mon[69013]: pgmap v840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:09.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:08 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:09.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:08 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:09.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:08 smithi096 ceph-mon[101353]: pgmap v840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:09.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:08 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:09.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:08 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:10 smithi159 ceph-mon[69013]: pgmap v841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:10 smithi096 ceph-mon[101353]: pgmap v841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:13.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:12 smithi159 ceph-mon[69013]: pgmap v842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:12 smithi096 ceph-mon[101353]: pgmap v842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:14 smithi159 ceph-mon[69013]: pgmap v843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:15.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:14 smithi096 ceph-mon[101353]: pgmap v843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:17.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:16 smithi159 ceph-mon[69013]: pgmap v844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:16 smithi096 ceph-mon[101353]: pgmap v844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:18.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:18.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:18.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:18.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:18.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:18.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.032 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.033 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.033 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:17 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:18.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:18.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:18.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:18.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:18.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:18.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:17 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:18 smithi159 ceph-mon[69013]: pgmap v845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:18 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:18 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:18 smithi096 ceph-mon[101353]: pgmap v845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:18 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:18 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 -- 172.21.15.96:0/302022859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 msgr2=0x7f09840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 --2- 172.21.15.96:0/302022859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f09840f59e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f0974004660 tx=0x7f0974009b30).stop 2022-02-02T18:50:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 -- 172.21.15.96:0/302022859 shutdown_connections 2022-02-02T18:50:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 --2- 172.21.15.96:0/302022859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f09840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:50:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 --2- 172.21.15.96:0/302022859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f09840f59e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 -- 172.21.15.96:0/302022859 >> 172.21.15.96:0/302022859 conn(0x7f09840f0d40 msgr2=0x7f09840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.048+0000 7f098a7c2700 1 -- 172.21.15.96:0/302022859 shutdown_connections 2022-02-02T18:50:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 -- 172.21.15.96:0/302022859 wait complete. 2022-02-02T18:50:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 Processor -- start 2022-02-02T18:50:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 -- start start 2022-02-02T18:50:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f098410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984060450 con 0x7f09840f55c0 2022-02-02T18:50:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.049+0000 7f098a7c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984060590 con 0x7f09840f6860 2022-02-02T18:50:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56264/0 (socket says 172.21.15.96:56264) 2022-02-02T18:50:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 -- 172.21.15.96:0/2376159701 learned_addr learned my addr 172.21.15.96:0/2376159701 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f09837fe700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f098410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 -- 172.21.15.96:0/2376159701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 msgr2=0x7f098410c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f098410c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 -- 172.21.15.96:0/2376159701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974005040 con 0x7f09840f55c0 2022-02-02T18:50:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f09837fe700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f098410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:50:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0983fff700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f0974004f60 tx=0x7f0974009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0974018070 con 0x7f09840f55c0 2022-02-02T18:50:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0974007ba0 con 0x7f09840f55c0 2022-02-02T18:50:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098410c790 con 0x7f09840f55c0 2022-02-02T18:50:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.050+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097401dea0 con 0x7f09840f55c0 2022-02-02T18:50:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.051+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098410ccf0 con 0x7f09840f55c0 2022-02-02T18:50:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.051+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0984045ad0 con 0x7f09840f55c0 2022-02-02T18:50:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.052+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f097401d420 con 0x7f09840f55c0 2022-02-02T18:50:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.052+0000 7f0980ff9700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 0x7f096c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.053+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09740839e0 con 0x7f09840f55c0 2022-02-02T18:50:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.053+0000 7f09837fe700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 0x7f096c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.053+0000 7f09837fe700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 0x7f096c067290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f097800b830 tx=0x7f0978008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.057+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0974051a90 con 0x7f09840f55c0 2022-02-02T18:50:20.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.234+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09840fde70 con 0x7f096c064dd0 2022-02-02T18:50:20.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.236+0000 7f0980ff9700 1 -- 172.21.15.96:0/2376159701 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f09840fde70 con 0x7f096c064dd0 2022-02-02T18:50:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 msgr2=0x7f096c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 0x7f096c067290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f097800b830 tx=0x7f0978008040).stop 2022-02-02T18:50:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 msgr2=0x7f0984109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f0974004f60 tx=0x7f0974009b30).stop 2022-02-02T18:50:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 shutdown_connections 2022-02-02T18:50:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f096c064dd0 0x7f096c067290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984109ce0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 --2- 172.21.15.96:0/2376159701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f098410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 >> 172.21.15.96:0/2376159701 conn(0x7f09840f0d40 msgr2=0x7f09840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 shutdown_connections 2022-02-02T18:50:20.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.238+0000 7f098a7c2700 1 -- 172.21.15.96:0/2376159701 wait complete. 2022-02-02T18:50:20.243 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:50:20.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 -- 172.21.15.96:0/3082554679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 msgr2=0x7f90880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 --2- 172.21.15.96:0/3082554679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f90880f7de0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f9078004660 tx=0x7f9078009b30).stop 2022-02-02T18:50:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 -- 172.21.15.96:0/3082554679 shutdown_connections 2022-02-02T18:50:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 --2- 172.21.15.96:0/3082554679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f90880f7de0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 --2- 172.21.15.96:0/3082554679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 0x7f90880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 -- 172.21.15.96:0/3082554679 >> 172.21.15.96:0/3082554679 conn(0x7f90880f1e40 msgr2=0x7f90880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 -- 172.21.15.96:0/3082554679 shutdown_connections 2022-02-02T18:50:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.337+0000 7f908fa69700 1 -- 172.21.15.96:0/3082554679 wait complete. 2022-02-02T18:50:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 Processor -- start 2022-02-02T18:50:20.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 -- start start 2022-02-02T18:50:20.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 0x7f9088106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881079e0 con 0x7f90880f7980 2022-02-02T18:50:20.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908fa69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088107b20 con 0x7f90880f66e0 2022-02-02T18:50:20.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908d004700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908d004700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56276/0 (socket says 172.21.15.96:56276) 2022-02-02T18:50:20.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908d004700 1 -- 172.21.15.96:0/1929281242 learned_addr learned my addr 172.21.15.96:0/1929281242 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:20.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908d805700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 0x7f9088106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.338+0000 7f908d004700 1 -- 172.21.15.96:0/1929281242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 msgr2=0x7f9088106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f908d004700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 0x7f9088106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f908d004700 1 -- 172.21.15.96:0/1929281242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078005040 con 0x7f90880f7980 2022-02-02T18:50:20.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f908d004700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f9078009990 tx=0x7f9078009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9078018070 con 0x7f90880f7980 2022-02-02T18:50:20.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088108460 con 0x7f90880f7980 2022-02-02T18:50:20.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90881089c0 con 0x7f90880f7980 2022-02-02T18:50:20.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9078007ba0 con 0x7f90880f7980 2022-02-02T18:50:20.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.339+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f907801c3c0 con 0x7f90880f7980 2022-02-02T18:50:20.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.340+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070004fa0 con 0x7f90880f7980 2022-02-02T18:50:20.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.340+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f907801d420 con 0x7f90880f7980 2022-02-02T18:50:20.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.341+0000 7f907e7fc700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 0x7f9074067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.341+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9078083570 con 0x7f90880f7980 2022-02-02T18:50:20.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.341+0000 7f908d805700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 0x7f9074067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.341+0000 7f908d805700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 0x7f9074067290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f90880f77e0 tx=0x7f908400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.345+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9078055110 con 0x7f90880f7980 2022-02-02T18:50:20.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.520+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9070000bc0 con 0x7f9074064dd0 2022-02-02T18:50:20.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.529+0000 7f907e7fc700 1 -- 172.21.15.96:0/1929281242 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9070000bc0 con 0x7f9074064dd0 2022-02-02T18:50:20.527 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:50:20.527 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (33m) 4m ago 34m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:50:20.528 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (26m) 4m ago 34m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:50:20.528 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (26m) 2m ago 34m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:50:20.528 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (33m) 4m ago 34m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:50:20.528 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (30m) 4m ago 30m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:50:20.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (26m) 4m ago 30m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:50:20.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (30m) 2m ago 30m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:50:20.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (26m) 2m ago 30m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:50:20.529 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (27m) 4m ago 35m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:50:20.529 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (27m) 2m ago 34m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:50:20.530 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (27m) 4m ago 36m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:50:20.530 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (26m) 2m ago 34m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:50:20.530 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (34m) 4m ago 34m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:50:20.530 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (34m) 2m ago 34m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:50:20.531 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (25m) 4m ago 33m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:50:20.531 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (25m) 4m ago 33m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:50:20.531 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (24m) 4m ago 32m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:50:20.531 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (24m) 2m ago 32m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:50:20.532 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (23m) 2m ago 32m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:50:20.532 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (23m) 2m ago 32m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:50:20.533 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (33m) 4m ago 34m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:50:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 msgr2=0x7f9074067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 0x7f9074067290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f90880f77e0 tx=0x7f908400b040).stop 2022-02-02T18:50:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 msgr2=0x7f9088107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f9078009990 tx=0x7f9078009b30).stop 2022-02-02T18:50:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 shutdown_connections 2022-02-02T18:50:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9074064dd0 0x7f9074067290 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880f66e0 0x7f9088106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 --2- 172.21.15.96:0/1929281242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90880f7980 0x7f9088107430 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 >> 172.21.15.96:0/1929281242 conn(0x7f90880f1e40 msgr2=0x7f90880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 shutdown_connections 2022-02-02T18:50:20.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.531+0000 7f908fa69700 1 -- 172.21.15.96:0/1929281242 wait complete. 2022-02-02T18:50:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 -- 172.21.15.96:0/83021189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 msgr2=0x7fbdc80f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/83021189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc80f9340 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fbdbc004660 tx=0x7fbdbc009b30).stop 2022-02-02T18:50:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 -- 172.21.15.96:0/83021189 shutdown_connections 2022-02-02T18:50:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/83021189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 0x7fbdc80fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/83021189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc80f9340 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 -- 172.21.15.96:0/83021189 >> 172.21.15.96:0/83021189 conn(0x7fbdc80f0d40 msgr2=0x7fbdc80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 -- 172.21.15.96:0/83021189 shutdown_connections 2022-02-02T18:50:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.629+0000 7fbdcf71a700 1 -- 172.21.15.96:0/83021189 wait complete. 2022-02-02T18:50:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 Processor -- start 2022-02-02T18:50:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 -- start start 2022-02-02T18:50:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 0x7fbdc8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8107a00 con 0x7fbdc8060270 2022-02-02T18:50:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcf71a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8107b40 con 0x7fbdc80f9830 2022-02-02T18:50:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56284/0 (socket says 172.21.15.96:56284) 2022-02-02T18:50:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 -- 172.21.15.96:0/1567078553 learned_addr learned my addr 172.21.15.96:0/1567078553 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:20.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcccb5700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 0x7fbdc8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 -- 172.21.15.96:0/1567078553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 msgr2=0x7fbdc8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 0x7fbdc8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.630+0000 7fbdcd4b6700 1 -- 172.21.15.96:0/1567078553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc005040 con 0x7fbdc8060270 2022-02-02T18:50:20.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdcd4b6700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbdbc009da0 tx=0x7fbdbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc018070 con 0x7fbdc8060270 2022-02-02T18:50:20.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc8108480 con 0x7fbdc8060270 2022-02-02T18:50:20.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbdbc007d70 con 0x7fbdc8060270 2022-02-02T18:50:20.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc01c620 con 0x7fbdc8060270 2022-02-02T18:50:20.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.631+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc81089e0 con 0x7fbdc8060270 2022-02-02T18:50:20.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.632+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc8045ad0 con 0x7fbdc8060270 2022-02-02T18:50:20.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.632+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbdbc01d960 con 0x7fbdc8060270 2022-02-02T18:50:20.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.632+0000 7fbdb9ffb700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 0x7fbdb4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.633+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbdbc083a90 con 0x7fbdc8060270 2022-02-02T18:50:20.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.633+0000 7fbdcccb5700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 0x7fbdb4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.633+0000 7fbdcccb5700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 0x7fbdb4067270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbdc40041d0 tx=0x7fbdc4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.637+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbdbc055570 con 0x7fbdc8060270 2022-02-02T18:50:20.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.868+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdc80fef50 con 0x7fbdc8060270 2022-02-02T18:50:20.864 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:20 smithi096 ceph-mon[101353]: pgmap v846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:20.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.869+0000 7fbdb9ffb700 1 -- 172.21.15.96:0/1567078553 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbdbc055160 con 0x7fbdc8060270 2022-02-02T18:50:20.865 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:50:20.865 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:50:20.865 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:50:20.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:20.866 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:50:20.866 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:50:20.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:20.867 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:50:20.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:50:20.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:20.867 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:50:20.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:50:20.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:20.868 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:50:20.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:50:20.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:50:20.869 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:50:20.869 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:50:20.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 msgr2=0x7fbdb4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 0x7fbdb4067270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbdc40041d0 tx=0x7fbdc4009040).stop 2022-02-02T18:50:20.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 msgr2=0x7fbdc8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbdbc009da0 tx=0x7fbdbc009b30).stop 2022-02-02T18:50:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 shutdown_connections 2022-02-02T18:50:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbdb4064db0 0x7fbdb4067270 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdc8060270 0x7fbdc8106f60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 --2- 172.21.15.96:0/1567078553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdc80f9830 0x7fbdc8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.871+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 >> 172.21.15.96:0/1567078553 conn(0x7fbdc80f0d40 msgr2=0x7fbdc80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.872+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 shutdown_connections 2022-02-02T18:50:20.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.872+0000 7fbdcf71a700 1 -- 172.21.15.96:0/1567078553 wait complete. 2022-02-02T18:50:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 -- 172.21.15.96:0/746107182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f55c0 msgr2=0x7f6cb40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 --2- 172.21.15.96:0/746107182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f55c0 0x7f6cb40f59e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6ca4004660 tx=0x7f6ca4009b30).stop 2022-02-02T18:50:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 -- 172.21.15.96:0/746107182 shutdown_connections 2022-02-02T18:50:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 --2- 172.21.15.96:0/746107182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f6860 0x7f6cb40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:50:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 --2- 172.21.15.96:0/746107182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f55c0 0x7f6cb40f59e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 -- 172.21.15.96:0/746107182 >> 172.21.15.96:0/746107182 conn(0x7f6cb40f0d40 msgr2=0x7f6cb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 -- 172.21.15.96:0/746107182 shutdown_connections 2022-02-02T18:50:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.969+0000 7f6cba924700 1 -- 172.21.15.96:0/746107182 wait complete. 2022-02-02T18:50:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 Processor -- start 2022-02-02T18:50:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 -- start start 2022-02-02T18:50:20.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f55c0 0x7f6cb4105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41069f0 con 0x7f6cb40f6860 2022-02-02T18:50:20.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cba924700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41072a0 con 0x7f6cb40f55c0 2022-02-02T18:50:20.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cb37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cb37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56294/0 (socket says 172.21.15.96:56294) 2022-02-02T18:50:20.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.970+0000 7f6cb37fe700 1 -- 172.21.15.96:0/3951039582 learned_addr learned my addr 172.21.15.96:0/3951039582 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:20.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb37fe700 1 -- 172.21.15.96:0/3951039582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f55c0 msgr2=0x7f6cb4105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:20.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb3fff700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f55c0 0x7f6cb4105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb37fe700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f55c0 0x7f6cb4105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:20.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb37fe700 1 -- 172.21.15.96:0/3951039582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4005040 con 0x7f6cb40f6860 2022-02-02T18:50:20.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb37fe700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6c9c00b410 tx=0x7f6c9c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9c0125f0 con 0x7f6cb40f6860 2022-02-02T18:50:20.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c9c012c00 con 0x7f6cb40f6860 2022-02-02T18:50:20.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb4107580 con 0x7f6cb40f6860 2022-02-02T18:50:20.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9c002ae0 con 0x7f6cb40f6860 2022-02-02T18:50:20.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.971+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4107b40 con 0x7f6cb40f6860 2022-02-02T18:50:20.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.972+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40f49b0 con 0x7f6cb40f6860 2022-02-02T18:50:20.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.972+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c9c00f030 con 0x7f6cb40f6860 2022-02-02T18:50:20.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.973+0000 7f6cb0ff9700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 0x7f6ca0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:20.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.973+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c9c081f60 con 0x7f6cb40f6860 2022-02-02T18:50:20.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.973+0000 7f6cb3fff700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 0x7f6ca0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:20.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.973+0000 7f6cb3fff700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 0x7f6ca0067290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f6ca4009da0 tx=0x7f6ca4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:20.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:20.977+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c9c0b07d0 con 0x7f6cb40f6860 2022-02-02T18:50:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:20 smithi159 ceph-mon[69013]: pgmap v846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:21.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.178+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6cb40fde00 con 0x7f6cb40f6860 2022-02-02T18:50:21.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.178+0000 7f6cb0ff9700 1 -- 172.21.15.96:0/3951039582 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6c9c053a40 con 0x7f6cb40f6860 2022-02-02T18:50:21.174 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:50:21.174 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:50:21.175 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:50:21.175 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:50:21.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:21.175 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:50:21.175 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:50:21.176 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:50:21.176 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:50:21.176 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:50:21.176 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:50:21.177 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:50:21.177 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:50:21.177 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:50:21.177 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:50:21.177 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:50:21.178 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:50:21.179 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:50:21.179 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:50:21.180 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:50:21.180 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:50:21.181 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:50:21.181 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:50:21.182 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:50:21.182 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:50:21.182 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:50:21.183 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:50:21.183 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:50:21.183 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:50:21.183 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:50:21.184 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:50:21.184 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:50:21.184 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:21.184 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:21.185 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:50:21.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:21.185 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:21.185 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:21.185 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:21.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 msgr2=0x7f6ca0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:21.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 0x7f6ca0067290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f6ca4009da0 tx=0x7f6ca4009b30).stop 2022-02-02T18:50:21.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 msgr2=0x7f6cb41063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:21.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6c9c00b410 tx=0x7f6c9c006ef0).stop 2022-02-02T18:50:21.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 shutdown_connections 2022-02-02T18:50:21.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ca0064dd0 0x7f6ca0067290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:21.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40f55c0 0x7f6cb4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:21.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 --2- 172.21.15.96:0/3951039582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cb40f6860 0x7f6cb41063b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:21.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 >> 172.21.15.96:0/3951039582 conn(0x7f6cb40f0d40 msgr2=0x7f6cb40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:21.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 shutdown_connections 2022-02-02T18:50:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:21.180+0000 7f6cba924700 1 -- 172.21.15.96:0/3951039582 wait complete. 2022-02-02T18:50:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:50:22.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:21 smithi159 ceph-mon[69013]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:21 smithi159 ceph-mon[69013]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1567078553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:22.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3951039582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:50:22.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:21 smithi096 ceph-mon[101353]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:21 smithi096 ceph-mon[101353]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1567078553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3951039582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:50:23.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:22 smithi159 ceph-mon[69013]: pgmap v847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:22 smithi096 ceph-mon[101353]: pgmap v847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:24 smithi159 ceph-mon[69013]: pgmap v848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:25.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:24 smithi096 ceph-mon[101353]: pgmap v848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:26 smithi159 ceph-mon[69013]: pgmap v849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:26 smithi096 ceph-mon[101353]: pgmap v849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:50:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:50:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:50:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:50:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:28 smithi159 ceph-mon[69013]: pgmap v850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:28 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:28 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:28 smithi096 ceph-mon[101353]: pgmap v850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:28 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:28 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:30 smithi159 ceph-mon[69013]: pgmap v851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:30 smithi096 ceph-mon[101353]: pgmap v851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:32 smithi159 ceph-mon[69013]: pgmap v852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:33.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:32 smithi096 ceph-mon[101353]: pgmap v852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:33.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:33 smithi159 ceph-mon[69013]: pgmap v853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:34.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:33 smithi096 ceph-mon[101353]: pgmap v853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:36.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:36 smithi159 ceph-mon[69013]: pgmap v854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:36.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:36 smithi096 ceph-mon[101353]: pgmap v854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: pgmap v855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:38.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:38.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:38 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:38.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: pgmap v855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:38.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:38.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:38.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:38 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:40 smithi159 ceph-mon[69013]: pgmap v856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:40.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:40 smithi096 ceph-mon[101353]: pgmap v856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:42.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:42 smithi159 ceph-mon[69013]: pgmap v857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:42.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:42 smithi096 ceph-mon[101353]: pgmap v857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:44.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:44 smithi159 ceph-mon[69013]: pgmap v858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:44.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:44 smithi096 ceph-mon[101353]: pgmap v858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:46.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:46 smithi159 ceph-mon[69013]: pgmap v859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:46.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:46 smithi096 ceph-mon[101353]: pgmap v859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:48.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: pgmap v860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:48.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:48.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: pgmap v860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:48.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:48.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:49.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:49 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:49.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:49 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:50 smithi159 ceph-mon[69013]: pgmap v861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:50 smithi096 ceph-mon[101353]: pgmap v861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- 172.21.15.96:0/3020293433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 msgr2=0x7fa79c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/3020293433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c0f6b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa790004660 tx=0x7fa790009b30).stop 2022-02-02T18:50:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- 172.21.15.96:0/3020293433 shutdown_connections 2022-02-02T18:50:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/3020293433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 0x7fa79c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:50:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/3020293433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c0f6b00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- 172.21.15.96:0/3020293433 >> 172.21.15.96:0/3020293433 conn(0x7fa79c0f1e40 msgr2=0x7fa79c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- 172.21.15.96:0/3020293433 shutdown_connections 2022-02-02T18:50:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- 172.21.15.96:0/3020293433 wait complete. 2022-02-02T18:50:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 Processor -- start 2022-02-02T18:50:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.290+0000 7fa7a2c24700 1 -- start start 2022-02-02T18:50:51.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a2c24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a2c24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 0x7fa79c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a2c24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c06a410 con 0x7fa79c0f66e0 2022-02-02T18:50:51.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a2c24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c06a550 con 0x7fa79c0f7980 2022-02-02T18:50:51.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56310/0 (socket says 172.21.15.96:56310) 2022-02-02T18:50:51.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 -- 172.21.15.96:0/496988210 learned_addr learned my addr 172.21.15.96:0/496988210 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:51.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa79bfff700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 0x7fa79c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 -- 172.21.15.96:0/496988210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 msgr2=0x7fa79c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 0x7fa79c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 -- 172.21.15.96:0/496988210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790005040 con 0x7fa79c0f66e0 2022-02-02T18:50:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7a09c0700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fa790004f60 tx=0x7fa790009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.291+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa790018070 con 0x7fa79c0f66e0 2022-02-02T18:50:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.292+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c06a7d0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.292+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa790007ba0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.292+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79001c620 con 0x7fa79c0f66e0 2022-02-02T18:50:51.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.292+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c10efe0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.293+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c045ad0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.293+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa79001c8e0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.294+0000 7fa7997fa700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 0x7fa78c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.294+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa7900839b0 con 0x7fa79c0f66e0 2022-02-02T18:50:51.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.294+0000 7fa79bfff700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 0x7fa78c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.294+0000 7fa79bfff700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 0x7fa78c067290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa78800b830 tx=0x7fa788008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.298+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa790051a60 con 0x7fa79c0f66e0 2022-02-02T18:50:51.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.477+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa79c0ff030 con 0x7fa78c064dd0 2022-02-02T18:50:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.478+0000 7fa7997fa700 1 -- 172.21.15.96:0/496988210 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa79c0ff030 con 0x7fa78c064dd0 2022-02-02T18:50:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 msgr2=0x7fa78c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 0x7fa78c067290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa78800b830 tx=0x7fa788008040).stop 2022-02-02T18:50:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 msgr2=0x7fa79c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fa790004f60 tx=0x7fa790009b30).stop 2022-02-02T18:50:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 shutdown_connections 2022-02-02T18:50:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa78c064dd0 0x7fa78c067290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa79c0f66e0 0x7fa79c06b9a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 --2- 172.21.15.96:0/496988210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa79c0f7980 0x7fa79c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 >> 172.21.15.96:0/496988210 conn(0x7fa79c0f1e40 msgr2=0x7fa79c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:51.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 shutdown_connections 2022-02-02T18:50:51.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.480+0000 7fa7a2c24700 1 -- 172.21.15.96:0/496988210 wait complete. 2022-02-02T18:50:51.486 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:50:51.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- 172.21.15.96:0/144921664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 msgr2=0x7f99b40fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 --2- 172.21.15.96:0/144921664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b40fbc80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f99a0004660 tx=0x7f99a0009b30).stop 2022-02-02T18:50:51.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- 172.21.15.96:0/144921664 shutdown_connections 2022-02-02T18:50:51.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 --2- 172.21.15.96:0/144921664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b40fbc80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 --2- 172.21.15.96:0/144921664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 0x7f99b40f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- 172.21.15.96:0/144921664 >> 172.21.15.96:0/144921664 conn(0x7f99b40f0d40 msgr2=0x7f99b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:51.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- 172.21.15.96:0/144921664 shutdown_connections 2022-02-02T18:50:51.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- 172.21.15.96:0/144921664 wait complete. 2022-02-02T18:50:51.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 Processor -- start 2022-02-02T18:50:51.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.580+0000 7f99baefa700 1 -- start start 2022-02-02T18:50:51.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99baefa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 0x7f99b4106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99baefa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99baefa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41079e0 con 0x7f99b40f9830 2022-02-02T18:50:51.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99baefa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4107b20 con 0x7f99b4060270 2022-02-02T18:50:51.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56322/0 (socket says 172.21.15.96:56322) 2022-02-02T18:50:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 -- 172.21.15.96:0/1759460098 learned_addr learned my addr 172.21.15.96:0/1759460098 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b8c96700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 0x7f99b4106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 -- 172.21.15.96:0/1759460098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 msgr2=0x7f99b4106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 0x7f99b4106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 -- 172.21.15.96:0/1759460098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0005040 con 0x7f99b40f9830 2022-02-02T18:50:51.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b3fff700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f99a0004f60 tx=0x7f99a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.581+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a0018070 con 0x7f99b40f9830 2022-02-02T18:50:51.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.582+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99a0007c70 con 0x7f99b40f9830 2022-02-02T18:50:51.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.582+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4108460 con 0x7f99b40f9830 2022-02-02T18:50:51.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.582+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a001c620 con 0x7f99b40f9830 2022-02-02T18:50:51.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.582+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b41089c0 con 0x7f99b40f9830 2022-02-02T18:50:51.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.583+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b4045ad0 con 0x7f99b40f9830 2022-02-02T18:50:51.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.583+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99a001d420 con 0x7f99b40f9830 2022-02-02T18:50:51.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.583+0000 7f99b17fa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 0x7f99a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.583+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f99a00839d0 con 0x7f99b40f9830 2022-02-02T18:50:51.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.583+0000 7f99b8c96700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 0x7f99a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.584+0000 7f99b8c96700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 0x7f99a4067290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f99a80041d0 tx=0x7f99a8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.588+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99a00554b0 con 0x7f99b40f9830 2022-02-02T18:50:51.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.759+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99b4108be0 con 0x7f99a4064dd0 2022-02-02T18:50:51.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.768+0000 7f99b17fa700 1 -- 172.21.15.96:0/1759460098 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f99b4108be0 con 0x7f99a4064dd0 2022-02-02T18:50:51.764 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:50:51.765 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (34m) 4m ago 35m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:50:51.765 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (26m) 4m ago 35m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:50:51.766 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (26m) 3m ago 34m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:50:51.766 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (34m) 4m ago 35m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:50:51.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (31m) 4m ago 31m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:50:51.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (26m) 4m ago 31m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:50:51.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (31m) 3m ago 31m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:50:51.768 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (27m) 3m ago 31m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:50:51.768 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (28m) 4m ago 36m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:50:51.769 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (28m) 3m ago 34m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:50:51.769 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (27m) 4m ago 36m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:50:51.769 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (27m) 3m ago 34m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:50:51.770 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (35m) 4m ago 35m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:50:51.771 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (34m) 3m ago 34m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:50:51.771 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (26m) 4m ago 34m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:50:51.771 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (25m) 4m ago 33m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:50:51.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (25m) 4m ago 33m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:50:51.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (24m) 3m ago 33m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:50:51.773 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (24m) 3m ago 32m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:50:51.773 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (23m) 3m ago 32m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:50:51.774 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (33m) 4m ago 34m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:50:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 msgr2=0x7f99a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 0x7f99a4067290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f99a80041d0 tx=0x7f99a8009040).stop 2022-02-02T18:50:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 msgr2=0x7f99b4107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f99a0004f60 tx=0x7f99a0009b30).stop 2022-02-02T18:50:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 shutdown_connections 2022-02-02T18:50:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99a4064dd0 0x7f99a4067290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b4060270 0x7f99b4106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 --2- 172.21.15.96:0/1759460098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99b40f9830 0x7f99b4107430 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 >> 172.21.15.96:0/1759460098 conn(0x7f99b40f0d40 msgr2=0x7f99b40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:51.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 shutdown_connections 2022-02-02T18:50:51.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.770+0000 7f99baefa700 1 -- 172.21.15.96:0/1759460098 wait complete. 2022-02-02T18:50:51.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- 172.21.15.96:0/2849724536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f66e0 msgr2=0x7ff0580f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2849724536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f66e0 0x7ff0580f6b00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7ff048004660 tx=0x7ff048009b30).stop 2022-02-02T18:50:51.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- 172.21.15.96:0/2849724536 shutdown_connections 2022-02-02T18:50:51.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2849724536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f7980 0x7ff0580f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2849724536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f66e0 0x7ff0580f6b00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- 172.21.15.96:0/2849724536 >> 172.21.15.96:0/2849724536 conn(0x7ff0580f1e40 msgr2=0x7ff0580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:51.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- 172.21.15.96:0/2849724536 shutdown_connections 2022-02-02T18:50:51.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- 172.21.15.96:0/2849724536 wait complete. 2022-02-02T18:50:51.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 Processor -- start 2022-02-02T18:50:51.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.867+0000 7ff05faa5700 1 -- start start 2022-02-02T18:50:51.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05faa5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f66e0 0x7ff058106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05faa5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05faa5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058107a90 con 0x7ff0580f7980 2022-02-02T18:50:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05faa5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058107bd0 con 0x7ff0580f66e0 2022-02-02T18:50:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56332/0 (socket says 172.21.15.96:56332) 2022-02-02T18:50:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 -- 172.21.15.96:0/2087334150 learned_addr learned my addr 172.21.15.96:0/2087334150 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d841700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f66e0 0x7ff058106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 -- 172.21.15.96:0/2087334150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f66e0 msgr2=0x7ff058106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f66e0 0x7ff058106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 -- 172.21.15.96:0/2087334150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048005040 con 0x7ff0580f7980 2022-02-02T18:50:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff05d040700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff05400c510 tx=0x7ff054007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.868+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05400f650 con 0x7ff0580f7980 2022-02-02T18:50:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.869+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff05400fc60 con 0x7ff0580f7980 2022-02-02T18:50:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.869+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058108570 con 0x7ff0580f7980 2022-02-02T18:50:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.869+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058108b30 con 0x7ff0580f7980 2022-02-02T18:50:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.869+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff054012c50 con 0x7ff0580f7980 2022-02-02T18:50:51.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.870+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff040004fa0 con 0x7ff0580f7980 2022-02-02T18:50:51.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.870+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff054010070 con 0x7ff0580f7980 2022-02-02T18:50:51.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.870+0000 7ff04e7fc700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 0x7ff044067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:51.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.871+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff054081650 con 0x7ff0580f7980 2022-02-02T18:50:51.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.871+0000 7ff05d841700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 0x7ff044067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:51.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.871+0000 7ff05d841700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 0x7ff044067290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff048004630 tx=0x7ff048009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:51.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:51.875+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff0540477d0 con 0x7ff0580f7980 2022-02-02T18:50:52.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.103+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff040005e80 con 0x7ff0580f7980 2022-02-02T18:50:52.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.103+0000 7ff04e7fc700 1 -- 172.21.15.96:0/2087334150 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff054053130 con 0x7ff0580f7980 2022-02-02T18:50:52.100 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:50:52.100 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:50:52.100 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:50:52.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:52.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:50:52.101 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:50:52.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:52.102 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:50:52.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:50:52.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:52.103 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:50:52.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:50:52.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:50:52.105 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:50:52.105 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:50:52.105 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:50:52.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:50:52.106 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:50:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 msgr2=0x7ff044067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 0x7ff044067290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff048004630 tx=0x7ff048009b30).stop 2022-02-02T18:50:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 msgr2=0x7ff0581074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff05400c510 tx=0x7ff054007e00).stop 2022-02-02T18:50:52.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 shutdown_connections 2022-02-02T18:50:52.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff044064dd0 0x7ff044067290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0580f66e0 0x7ff058106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 --2- 172.21.15.96:0/2087334150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0580f7980 0x7ff0581074e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 >> 172.21.15.96:0/2087334150 conn(0x7ff0580f1e40 msgr2=0x7ff0580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:52.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 shutdown_connections 2022-02-02T18:50:52.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.105+0000 7ff05faa5700 1 -- 172.21.15.96:0/2087334150 wait complete. 2022-02-02T18:50:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 -- 172.21.15.96:0/3316899472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f7980 msgr2=0x7f73cc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 --2- 172.21.15.96:0/3316899472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f7980 0x7f73cc0f7de0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f73bc004660 tx=0x7f73bc009b30).stop 2022-02-02T18:50:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 -- 172.21.15.96:0/3316899472 shutdown_connections 2022-02-02T18:50:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 --2- 172.21.15.96:0/3316899472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f7980 0x7f73cc0f7de0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 --2- 172.21.15.96:0/3316899472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f66e0 0x7f73cc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 -- 172.21.15.96:0/3316899472 >> 172.21.15.96:0/3316899472 conn(0x7f73cc0f1e40 msgr2=0x7f73cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 -- 172.21.15.96:0/3316899472 shutdown_connections 2022-02-02T18:50:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.203+0000 7f73d41e3700 1 -- 172.21.15.96:0/3316899472 wait complete. 2022-02-02T18:50:52.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 Processor -- start 2022-02-02T18:50:52.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 -- start start 2022-02-02T18:50:52.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:52.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f7980 0x7f73cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc06a380 con 0x7f73cc0f66e0 2022-02-02T18:50:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d41e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc06a4c0 con 0x7f73cc0f7980 2022-02-02T18:50:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56340/0 (socket says 172.21.15.96:56340) 2022-02-02T18:50:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 -- 172.21.15.96:0/347530990 learned_addr learned my addr 172.21.15.96:0/347530990 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:50:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d177e700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f7980 0x7f73cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 -- 172.21.15.96:0/347530990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f7980 msgr2=0x7f73cc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f7980 0x7f73cc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.204+0000 7f73d1f7f700 1 -- 172.21.15.96:0/347530990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc005040 con 0x7f73cc0f66e0 2022-02-02T18:50:52.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73d1f7f700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f73c8002700 tx=0x7f73c8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:52.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c80079c0 con 0x7f73cc0f66e0 2022-02-02T18:50:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f73c800f040 con 0x7f73cc0f66e0 2022-02-02T18:50:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc06a7a0 con 0x7f73cc0f66e0 2022-02-02T18:50:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c80147e0 con 0x7f73cc0f66e0 2022-02-02T18:50:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.205+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc10efb0 con 0x7f73cc0f66e0 2022-02-02T18:50:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.206+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc045ad0 con 0x7f73cc0f66e0 2022-02-02T18:50:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.206+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f73c801b060 con 0x7f73cc0f66e0 2022-02-02T18:50:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.207+0000 7f73c27fc700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 0x7f73b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:50:52.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.207+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f73c8081820 con 0x7f73cc0f66e0 2022-02-02T18:50:52.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.207+0000 7f73d177e700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 0x7f73b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:50:52.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.207+0000 7f73d177e700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 0x7f73b8067290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f73bc004630 tx=0x7f73bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:50:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.211+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f73c804f870 con 0x7f73cc0f66e0 2022-02-02T18:50:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.412+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f73cc027a00 con 0x7f73cc0f66e0 2022-02-02T18:50:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.413+0000 7f73c27fc700 1 -- 172.21.15.96:0/347530990 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f73c8019720 con 0x7f73cc0f66e0 2022-02-02T18:50:52.410 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:50:52.410 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:50:52.410 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:50:52.410 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:50:52.411 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:52.411 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:50:52.411 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:50:52.412 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:50:52.412 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:50:52.412 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:50:52.413 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:50:52.413 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:50:52.413 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:50:52.414 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:50:52.414 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:50:52.414 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:50:52.415 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:50:52.415 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:50:52.415 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:50:52.416 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:50:52.416 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:50:52.417 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:50:52.417 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:50:52.418 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:50:52.418 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:50:52.419 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:50:52.419 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:50:52.419 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:50:52.420 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:50:52.420 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:50:52.420 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:50:52.421 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:50:52.421 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:52.422 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:52.422 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:50:52.422 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:50:52.423 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:52.423 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:52.423 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:50:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 msgr2=0x7f73b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 0x7f73b8067290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f73bc004630 tx=0x7f73bc009b30).stop 2022-02-02T18:50:52.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 msgr2=0x7f73cc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:50:52.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f73c8002700 tx=0x7f73c8009d60).stop 2022-02-02T18:50:52.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 shutdown_connections 2022-02-02T18:50:52.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73b8064dd0 0x7f73b8067290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73cc0f66e0 0x7f73cc06b9a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 --2- 172.21.15.96:0/347530990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0f7980 0x7f73cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:50:52.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 >> 172.21.15.96:0/347530990 conn(0x7f73cc0f1e40 msgr2=0x7f73cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:50:52.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 shutdown_connections 2022-02-02T18:50:52.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:50:52.415+0000 7f73d41e3700 1 -- 172.21.15.96:0/347530990 wait complete. 2022-02-02T18:50:52.427 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:50:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:52 smithi159 ceph-mon[69013]: pgmap v862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:52 smithi159 ceph-mon[69013]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2087334150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:52.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/347530990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:50:52.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:52 smithi096 ceph-mon[101353]: pgmap v862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:52 smithi096 ceph-mon[101353]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2087334150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:52.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/347530990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:50:53.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:53 smithi096 ceph-mon[101353]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:53.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:53 smithi159 ceph-mon[69013]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:50:54.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:54 smithi159 ceph-mon[69013]: pgmap v863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:54.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:54 smithi096 ceph-mon[101353]: pgmap v863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:56.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:56 smithi159 ceph-mon[69013]: pgmap v864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:56.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:56 smithi096 ceph-mon[101353]: pgmap v864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: pgmap v865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:58.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: pgmap v865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:50:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:50:58.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:50:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:50:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:50:58.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:50:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:59 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:59.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:50:59 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:50:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:59 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:50:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:50:59 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:00 smithi159 ceph-mon[69013]: pgmap v866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:00.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:00 smithi096 ceph-mon[101353]: pgmap v866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:02.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:02 smithi159 ceph-mon[69013]: pgmap v867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:02.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:02 smithi096 ceph-mon[101353]: pgmap v867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:04.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:04 smithi159 ceph-mon[69013]: pgmap v868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:04.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:04 smithi096 ceph-mon[101353]: pgmap v868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:06.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:06 smithi159 ceph-mon[69013]: pgmap v869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:06.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:06 smithi096 ceph-mon[101353]: pgmap v869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: pgmap v870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:08.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:08.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.772 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:08 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: pgmap v870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:08.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:08.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:08.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:08 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:09.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:09 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:09.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:09 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:09 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:09.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:09 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:10.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:10 smithi159 ceph-mon[69013]: pgmap v871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:10.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:10 smithi096 ceph-mon[101353]: pgmap v871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:12.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:12 smithi159 ceph-mon[69013]: pgmap v872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:12.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:12 smithi096 ceph-mon[101353]: pgmap v872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:14.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:14 smithi159 ceph-mon[69013]: pgmap v873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:14.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:14 smithi096 ceph-mon[101353]: pgmap v873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:16.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:16 smithi159 ceph-mon[69013]: pgmap v874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:16.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:16 smithi096 ceph-mon[101353]: pgmap v874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: pgmap v875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:18.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:18.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:18 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: pgmap v875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:19.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:19.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:19.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:19.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:19.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:18 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:19.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:19 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:19 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:19 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:19 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:20.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:20 smithi096 ceph-mon[101353]: pgmap v876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:20 smithi159 ceph-mon[69013]: pgmap v876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:22.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 -- 172.21.15.96:0/2669618326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f6860 msgr2=0x7f46f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/2669618326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f6860 0x7f46f40f6cc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f46f0004660 tx=0x7f46f0009b30).stop 2022-02-02T18:51:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 -- 172.21.15.96:0/2669618326 shutdown_connections 2022-02-02T18:51:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/2669618326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f6860 0x7f46f40f6cc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/2669618326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f55c0 0x7f46f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:51:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 -- 172.21.15.96:0/2669618326 >> 172.21.15.96:0/2669618326 conn(0x7f46f40f0d40 msgr2=0x7f46f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:22.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 -- 172.21.15.96:0/2669618326 shutdown_connections 2022-02-02T18:51:22.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.527+0000 7f46fc2aa700 1 -- 172.21.15.96:0/2669618326 wait complete. 2022-02-02T18:51:22.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 Processor -- start 2022-02-02T18:51:22.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 -- start start 2022-02-02T18:51:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f6860 0x7f46f410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4060470 con 0x7f46f40f55c0 2022-02-02T18:51:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fc2aa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40605b0 con 0x7f46f40f6860 2022-02-02T18:51:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fa046700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fa046700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56362/0 (socket says 172.21.15.96:56362) 2022-02-02T18:51:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.528+0000 7f46fa046700 1 -- 172.21.15.96:0/3911347944 learned_addr learned my addr 172.21.15.96:0/3911347944 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46f9845700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f6860 0x7f46f410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fa046700 1 -- 172.21.15.96:0/3911347944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f6860 msgr2=0x7f46f410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fa046700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f6860 0x7f46f410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fa046700 1 -- 172.21.15.96:0/3911347944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0005040 con 0x7f46f40f55c0 2022-02-02T18:51:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fa046700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f46e80093f0 tx=0x7f46e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46e8009ea0 con 0x7f46f40f55c0 2022-02-02T18:51:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46e8013af0 con 0x7f46f40f55c0 2022-02-02T18:51:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f410c810 con 0x7f46f40f55c0 2022-02-02T18:51:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46e800db10 con 0x7f46f40f55c0 2022-02-02T18:51:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.529+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f410cda0 con 0x7f46f40f55c0 2022-02-02T18:51:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.530+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f4045ad0 con 0x7f46f40f55c0 2022-02-02T18:51:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.531+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f46e801a060 con 0x7f46f40f55c0 2022-02-02T18:51:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.531+0000 7f46e6ffd700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 0x7f46e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.531+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f46e80819e0 con 0x7f46f40f55c0 2022-02-02T18:51:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.531+0000 7f46f9845700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 0x7f46e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.532+0000 7f46f9845700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 0x7f46e0067290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f46f0004e30 tx=0x7f46f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.535+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46e804fa90 con 0x7f46f40f55c0 2022-02-02T18:51:22.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.716+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46f4057f10 con 0x7f46e0064dd0 2022-02-02T18:51:22.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.718+0000 7f46e6ffd700 1 -- 172.21.15.96:0/3911347944 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f46f4057f10 con 0x7f46e0064dd0 2022-02-02T18:51:22.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 msgr2=0x7f46e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 0x7f46e0067290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f46f0004e30 tx=0x7f46f0009b30).stop 2022-02-02T18:51:22.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 msgr2=0x7f46f4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f46e80093f0 tx=0x7f46e8006ec0).stop 2022-02-02T18:51:22.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 shutdown_connections 2022-02-02T18:51:22.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e0064dd0 0x7f46e0067290 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46f40f55c0 0x7f46f4109cb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 --2- 172.21.15.96:0/3911347944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f40f6860 0x7f46f410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.719+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 >> 172.21.15.96:0/3911347944 conn(0x7f46f40f0d40 msgr2=0x7f46f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:22.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.720+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 shutdown_connections 2022-02-02T18:51:22.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.720+0000 7f46fc2aa700 1 -- 172.21.15.96:0/3911347944 wait complete. 2022-02-02T18:51:22.724 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:51:22.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:22 smithi096 ceph-mon[101353]: pgmap v877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:22.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- 172.21.15.96:0/2533726594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 msgr2=0x7f10240f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 --2- 172.21.15.96:0/2533726594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10240f6cd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1020004660 tx=0x7f1020009b30).stop 2022-02-02T18:51:22.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- 172.21.15.96:0/2533726594 shutdown_connections 2022-02-02T18:51:22.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 --2- 172.21.15.96:0/2533726594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10240f6cd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 --2- 172.21.15.96:0/2533726594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 0x7f10240f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- 172.21.15.96:0/2533726594 >> 172.21.15.96:0/2533726594 conn(0x7f10240f0d70 msgr2=0x7f10240f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- 172.21.15.96:0/2533726594 shutdown_connections 2022-02-02T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- 172.21.15.96:0/2533726594 wait complete. 2022-02-02T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 Processor -- start 2022-02-02T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.817+0000 7f102c116700 1 -- start start 2022-02-02T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f102c116700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 0x7f1024105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f102c116700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f102c116700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241069b0 con 0x7f10240f6870 2022-02-02T18:51:22.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f102c116700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241071c0 con 0x7f10240f55d0 2022-02-02T18:51:22.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56374/0 (socket says 172.21.15.96:56374) 2022-02-02T18:51:22.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 -- 172.21.15.96:0/1793191006 learned_addr learned my addr 172.21.15.96:0/1793191006 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:22.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f1029eb2700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 0x7f1024105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 -- 172.21.15.96:0/1793191006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 msgr2=0x7f1024105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:22.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 0x7f1024105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:22.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 -- 172.21.15.96:0/1793191006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020005040 con 0x7f10240f6870 2022-02-02T18:51:22.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10296b1700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f1020009990 tx=0x7f1020009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:22.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102001a070 con 0x7f10240f6870 2022-02-02T18:51:22.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.818+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10241073e0 con 0x7f10240f6870 2022-02-02T18:51:22.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.819+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1020009630 con 0x7f10240f6870 2022-02-02T18:51:22.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.819+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102001f820 con 0x7f10240f6870 2022-02-02T18:51:22.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.819+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024107940 con 0x7f10240f6870 2022-02-02T18:51:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.819+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10240f49c0 con 0x7f10240f6870 2022-02-02T18:51:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.820+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1020012b80 con 0x7f10240f6870 2022-02-02T18:51:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.821+0000 7f10167fc700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 0x7f1010067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.821+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1020085d00 con 0x7f10240f6870 2022-02-02T18:51:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.821+0000 7f1029eb2700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 0x7f1010067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.821+0000 7f1029eb2700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 0x7f1010067290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f1024105c30 tx=0x7f101800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.824+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1020053db0 con 0x7f10240f6870 2022-02-02T18:51:22.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:22.999+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10240ff840 con 0x7f1010064dd0 2022-02-02T18:51:23.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.008+0000 7f10167fc700 1 -- 172.21.15.96:0/1793191006 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f10240ff840 con 0x7f1010064dd0 2022-02-02T18:51:23.003 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:51:23.003 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (34m) 5m ago 35m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:51:23.004 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (27m) 5m ago 35m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:51:23.004 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (27m) 3m ago 35m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:51:23.004 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (34m) 5m ago 35m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:51:23.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (31m) 5m ago 31m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:51:23.005 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (27m) 5m ago 31m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:51:23.005 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (31m) 3m ago 31m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:51:23.005 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (27m) 3m ago 31m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:51:23.005 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (29m) 5m ago 36m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:51:23.005 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (28m) 3m ago 35m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:51:23.006 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (28m) 5m ago 37m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:51:23.006 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (27m) 3m ago 35m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:51:23.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (35m) 5m ago 35m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:51:23.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (35m) 3m ago 35m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:51:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (26m) 5m ago 34m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:51:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (26m) 5m ago 34m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:51:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (25m) 5m ago 34m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:51:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (25m) 3m ago 33m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:51:23.008 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (24m) 3m ago 33m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:51:23.008 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (24m) 3m ago 33m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:51:23.008 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (34m) 5m ago 35m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:51:23.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 msgr2=0x7f1010067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 0x7f1010067290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f1024105c30 tx=0x7f101800b040).stop 2022-02-02T18:51:23.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 msgr2=0x7f10241063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f1020009990 tx=0x7f1020009b30).stop 2022-02-02T18:51:23.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 shutdown_connections 2022-02-02T18:51:23.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1010064dd0 0x7f1010067290 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10240f55d0 0x7f1024105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 --2- 172.21.15.96:0/1793191006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10240f6870 0x7f10241063b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 >> 172.21.15.96:0/1793191006 conn(0x7f10240f0d70 msgr2=0x7f10240fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 shutdown_connections 2022-02-02T18:51:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.010+0000 7f102c116700 1 -- 172.21.15.96:0/1793191006 wait complete. 2022-02-02T18:51:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:22 smithi159 ceph-mon[69013]: pgmap v877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 -- 172.21.15.96:0/410351471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f6bf0 msgr2=0x7ff7900f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 --2- 172.21.15.96:0/410351471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f6bf0 0x7ff7900f7010 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7ff78c004660 tx=0x7ff78c009b30).stop 2022-02-02T18:51:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 -- 172.21.15.96:0/410351471 shutdown_connections 2022-02-02T18:51:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 --2- 172.21.15.96:0/410351471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f7590 0x7ff7900f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:51:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 --2- 172.21.15.96:0/410351471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f6bf0 0x7ff7900f7010 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 -- 172.21.15.96:0/410351471 >> 172.21.15.96:0/410351471 conn(0x7ff7900f04c0 msgr2=0x7ff7900f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 -- 172.21.15.96:0/410351471 shutdown_connections 2022-02-02T18:51:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.107+0000 7ff797f8f700 1 -- 172.21.15.96:0/410351471 wait complete. 2022-02-02T18:51:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 Processor -- start 2022-02-02T18:51:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 -- start start 2022-02-02T18:51:23.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f6bf0 0x7ff790105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7901069d0 con 0x7ff7900f7590 2022-02-02T18:51:23.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff797f8f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff790107280 con 0x7ff7900f6bf0 2022-02-02T18:51:23.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff79552a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff79552a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56384/0 (socket says 172.21.15.96:56384) 2022-02-02T18:51:23.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff79552a700 1 -- 172.21.15.96:0/314611285 learned_addr learned my addr 172.21.15.96:0/314611285 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:23.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.108+0000 7ff795d2b700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f6bf0 0x7ff790105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff79552a700 1 -- 172.21.15.96:0/314611285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f6bf0 msgr2=0x7ff790105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff79552a700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f6bf0 0x7ff790105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff79552a700 1 -- 172.21.15.96:0/314611285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c005040 con 0x7ff7900f7590 2022-02-02T18:51:23.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff79552a700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff78000b410 tx=0x7ff780006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:23.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7800125f0 con 0x7ff7900f7590 2022-02-02T18:51:23.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff790107560 con 0x7ff7900f7590 2022-02-02T18:51:23.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff780012c00 con 0x7ff7900f7590 2022-02-02T18:51:23.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff780002ae0 con 0x7ff7900f7590 2022-02-02T18:51:23.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.109+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff790107b20 con 0x7ff7900f7590 2022-02-02T18:51:23.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.110+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff790045ad0 con 0x7ff7900f7590 2022-02-02T18:51:23.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.110+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff78000f030 con 0x7ff7900f7590 2022-02-02T18:51:23.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.111+0000 7ff7867fc700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 0x7ff77c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.111+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff780081f60 con 0x7ff7900f7590 2022-02-02T18:51:23.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.111+0000 7ff795d2b700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 0x7ff77c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.111+0000 7ff795d2b700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 0x7ff77c067290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff78c004e30 tx=0x7ff78c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:23.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.115+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff7800b07d0 con 0x7ff7900f7590 2022-02-02T18:51:23.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.348+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7901080d0 con 0x7ff7900f7590 2022-02-02T18:51:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.349+0000 7ff7867fc700 1 -- 172.21.15.96:0/314611285 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff780053a40 con 0x7ff7900f7590 2022-02-02T18:51:23.344 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:51:23.344 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:51:23.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:51:23.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:23.345 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:51:23.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:51:23.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:23.346 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:51:23.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:51:23.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:23.346 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:51:23.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:51:23.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:23.347 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:51:23.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:51:23.348 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:51:23.348 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:51:23.348 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:51:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.350+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 msgr2=0x7ff77c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 0x7ff77c067290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff78c004e30 tx=0x7ff78c009b30).stop 2022-02-02T18:51:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 msgr2=0x7ff790106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff78000b410 tx=0x7ff780006ef0).stop 2022-02-02T18:51:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 shutdown_connections 2022-02-02T18:51:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff77c064dd0 0x7ff77c067290 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7900f6bf0 0x7ff790105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 --2- 172.21.15.96:0/314611285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7900f7590 0x7ff790106390 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 >> 172.21.15.96:0/314611285 conn(0x7ff7900f04c0 msgr2=0x7ff7900fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 shutdown_connections 2022-02-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.351+0000 7ff797f8f700 1 -- 172.21.15.96:0/314611285 wait complete. 2022-02-02T18:51:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 -- 172.21.15.96:0/330523753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f5430 msgr2=0x7fb2600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 --2- 172.21.15.96:0/330523753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f5430 0x7fb2600f5850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fb250004660 tx=0x7fb250009b30).stop 2022-02-02T18:51:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 -- 172.21.15.96:0/330523753 shutdown_connections 2022-02-02T18:51:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 --2- 172.21.15.96:0/330523753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f66d0 0x7fb2600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 --2- 172.21.15.96:0/330523753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f5430 0x7fb2600f5850 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 -- 172.21.15.96:0/330523753 >> 172.21.15.96:0/330523753 conn(0x7fb2600f0b90 msgr2=0x7fb2600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 -- 172.21.15.96:0/330523753 shutdown_connections 2022-02-02T18:51:23.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.448+0000 7fb25f59e700 1 -- 172.21.15.96:0/330523753 wait complete. 2022-02-02T18:51:23.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 Processor -- start 2022-02-02T18:51:23.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 -- start start 2022-02-02T18:51:23.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 0x7fb260109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600603e0 con 0x7fb2600f66d0 2022-02-02T18:51:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260060520 con 0x7fb2600f5430 2022-02-02T18:51:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56394/0 (socket says 172.21.15.96:56394) 2022-02-02T18:51:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25dd9b700 1 -- 172.21.15.96:0/692828397 learned_addr learned my addr 172.21.15.96:0/692828397 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.449+0000 7fb25e59c700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 0x7fb260109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25dd9b700 1 -- 172.21.15.96:0/692828397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 msgr2=0x7fb260109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25dd9b700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 0x7fb260109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25dd9b700 1 -- 172.21.15.96:0/692828397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250005040 con 0x7fb2600f66d0 2022-02-02T18:51:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25e59c700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 0x7fb260109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:51:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25dd9b700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb24800c530 tx=0x7fb248007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb24800f650 con 0x7fb2600f66d0 2022-02-02T18:51:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb24800fc60 con 0x7fb2600f66d0 2022-02-02T18:51:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26010c540 con 0x7fb2600f66d0 2022-02-02T18:51:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb248012cd0 con 0x7fb2600f66d0 2022-02-02T18:51:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.450+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26010cb00 con 0x7fb2600f66d0 2022-02-02T18:51:23.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.452+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb248010070 con 0x7fb2600f66d0 2022-02-02T18:51:23.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.452+0000 7fb256ffd700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 0x7fb24c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:23.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.452+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb248081750 con 0x7fb2600f66d0 2022-02-02T18:51:23.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.452+0000 7fb25e59c700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 0x7fb24c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:23.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.452+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260045ad0 con 0x7fb2600f66d0 2022-02-02T18:51:23.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.453+0000 7fb25e59c700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 0x7fb24c0672e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb250004e30 tx=0x7fb250009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:23.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.457+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2480477d0 con 0x7fb2600f66d0 2022-02-02T18:51:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.659+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb2600fdbf0 con 0x7fb2600f66d0 2022-02-02T18:51:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.659+0000 7fb256ffd700 1 -- 172.21.15.96:0/692828397 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb24804f800 con 0x7fb2600f66d0 2022-02-02T18:51:23.655 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:51:23.655 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:51:23.655 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:51:23.656 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:51:23.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:23.656 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:51:23.656 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:51:23.656 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:51:23.657 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:51:23.657 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:51:23.657 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:51:23.657 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:51:23.658 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:51:23.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:51:23.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:51:23.658 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:51:23.659 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:51:23.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:51:23.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:51:23.659 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:51:23.659 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:51:23.660 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:51:23.660 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:51:23.660 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:51:23.660 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:51:23.661 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:51:23.661 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:51:23.661 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:51:23.661 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:51:23.661 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:51:23.662 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:51:23.662 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:51:23.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:23.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:23.663 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:51:23.663 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:23.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:23.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:23.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 msgr2=0x7fb24c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 0x7fb24c0672e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb250004e30 tx=0x7fb250009b30).stop 2022-02-02T18:51:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 msgr2=0x7fb26010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb24800c530 tx=0x7fb248007e20).stop 2022-02-02T18:51:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 shutdown_connections 2022-02-02T18:51:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb24c064e20 0x7fb24c0672e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2600f5430 0x7fb260109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 --2- 172.21.15.96:0/692828397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2600f66d0 0x7fb26010bf90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 >> 172.21.15.96:0/692828397 conn(0x7fb2600f0b90 msgr2=0x7fb2600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 shutdown_connections 2022-02-02T18:51:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:23.661+0000 7fb25f59e700 1 -- 172.21.15.96:0/692828397 wait complete. 2022-02-02T18:51:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:51:23.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/314611285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:23.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/314611285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:24.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:24 smithi096 ceph-mon[101353]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:24.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:24 smithi096 ceph-mon[101353]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:24.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:24 smithi096 ceph-mon[101353]: pgmap v878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:24.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/692828397' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:51:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:24 smithi159 ceph-mon[69013]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:24 smithi159 ceph-mon[69013]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:24 smithi159 ceph-mon[69013]: pgmap v878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:25.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/692828397' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:51:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:26 smithi096 ceph-mon[101353]: pgmap v879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:26 smithi159 ceph-mon[69013]: pgmap v879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:51:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:51:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:51:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:51:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: pgmap v880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: pgmap v880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:29.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:30.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:29 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:30.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:29 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:30.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:29 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:29 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:30 smithi159 ceph-mon[69013]: pgmap v881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:30 smithi096 ceph-mon[101353]: pgmap v881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:32 smithi159 ceph-mon[69013]: pgmap v882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:32 smithi096 ceph-mon[101353]: pgmap v882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:34 smithi159 ceph-mon[69013]: pgmap v883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:35.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:34 smithi096 ceph-mon[101353]: pgmap v883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:37.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:36 smithi159 ceph-mon[69013]: pgmap v884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:37.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:36 smithi096 ceph-mon[101353]: pgmap v884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: pgmap v885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:39.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:39.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:39.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:39.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:39.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:38 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: pgmap v885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:39.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:39.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:39.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:39.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:39.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:39.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:38 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:40.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:39 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:40.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:39 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:40.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:39 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:40.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:39 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:40 smithi159 ceph-mon[69013]: pgmap v886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:40 smithi096 ceph-mon[101353]: pgmap v886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:42 smithi159 ceph-mon[69013]: pgmap v887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:42 smithi096 ceph-mon[101353]: pgmap v887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:45.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:44 smithi159 ceph-mon[69013]: pgmap v888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:45.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:44 smithi096 ceph-mon[101353]: pgmap v888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:47.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:46 smithi159 ceph-mon[69013]: pgmap v889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:47.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:46 smithi096 ceph-mon[101353]: pgmap v889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: pgmap v890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:49.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:49.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:49.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:49.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:49.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:48 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: pgmap v890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:49.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:49.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:49.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:49.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:51:49.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:49.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:49.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:48 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:50.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:49 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:50.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:49 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:50.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:49 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:51:50.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:49 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:51:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:50 smithi159 ceph-mon[69013]: pgmap v891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:51.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:50 smithi096 ceph-mon[101353]: pgmap v891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:53.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:52 smithi159 ceph-mon[69013]: pgmap v892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:53.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:52 smithi096 ceph-mon[101353]: pgmap v892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 -- 172.21.15.96:0/998222686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 msgr2=0x7fb75c0f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 --2- 172.21.15.96:0/998222686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c0f8160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fb750004660 tx=0x7fb750009b30).stop 2022-02-02T18:51:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 -- 172.21.15.96:0/998222686 shutdown_connections 2022-02-02T18:51:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 --2- 172.21.15.96:0/998222686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c0f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 --2- 172.21.15.96:0/998222686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c0f8160 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 -- 172.21.15.96:0/998222686 >> 172.21.15.96:0/998222686 conn(0x7fb75c0f04c0 msgr2=0x7fb75c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:53.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 -- 172.21.15.96:0/998222686 shutdown_connections 2022-02-02T18:51:53.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.772+0000 7fb761973700 1 -- 172.21.15.96:0/998222686 wait complete. 2022-02-02T18:51:53.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 Processor -- start 2022-02-02T18:51:53.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 -- start start 2022-02-02T18:51:53.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:53.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c107a30 con 0x7fb75c0f7d40 2022-02-02T18:51:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb761973700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c107b70 con 0x7fb75c0f86e0 2022-02-02T18:51:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb75affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb75affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56412/0 (socket says 172.21.15.96:56412) 2022-02-02T18:51:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb75affd700 1 -- 172.21.15.96:0/1120591688 learned_addr learned my addr 172.21.15.96:0/1120591688 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:53.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb75a7fc700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:53.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.773+0000 7fb75affd700 1 -- 172.21.15.96:0/1120591688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 msgr2=0x7fb75c107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:53.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb75affd700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb75affd700 1 -- 172.21.15.96:0/1120591688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750005040 con 0x7fb75c0f7d40 2022-02-02T18:51:53.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb75a7fc700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:51:53.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb75affd700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb750004f60 tx=0x7fb750009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:53.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb750018070 con 0x7fb75c0f7d40 2022-02-02T18:51:53.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c1084b0 con 0x7fb75c0f7d40 2022-02-02T18:51:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb750007ba0 con 0x7fb75c0f7d40 2022-02-02T18:51:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb75001c620 con 0x7fb75c0f7d40 2022-02-02T18:51:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.774+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c108a10 con 0x7fb75c0f7d40 2022-02-02T18:51:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.775+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c045ad0 con 0x7fb75c0f7d40 2022-02-02T18:51:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.775+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb75001c8e0 con 0x7fb75c0f7d40 2022-02-02T18:51:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.776+0000 7fb7437fe700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 0x7fb744067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.776+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb750083990 con 0x7fb75c0f7d40 2022-02-02T18:51:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.776+0000 7fb75a7fc700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 0x7fb744067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.776+0000 7fb75a7fc700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 0x7fb744067290 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb74c004a70 tx=0x7fb74c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:53.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.780+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb750055470 con 0x7fb75c0f7d40 2022-02-02T18:51:53.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.960+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75c0fef20 con 0x7fb744064dd0 2022-02-02T18:51:53.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.961+0000 7fb7437fe700 1 -- 172.21.15.96:0/1120591688 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb75c0fef20 con 0x7fb744064dd0 2022-02-02T18:51:53.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 msgr2=0x7fb744067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:53.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 0x7fb744067290 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb74c004a70 tx=0x7fb74c009040).stop 2022-02-02T18:51:53.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 msgr2=0x7fb75c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:53.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb750004f60 tx=0x7fb750009b30).stop 2022-02-02T18:51:53.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 shutdown_connections 2022-02-02T18:51:53.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb744064dd0 0x7fb744067290 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb75c0f7d40 0x7fb75c106f90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 --2- 172.21.15.96:0/1120591688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb75c0f86e0 0x7fb75c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 >> 172.21.15.96:0/1120591688 conn(0x7fb75c0f04c0 msgr2=0x7fb75c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 shutdown_connections 2022-02-02T18:51:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:53.963+0000 7fb761973700 1 -- 172.21.15.96:0/1120591688 wait complete. 2022-02-02T18:51:53.968 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:51:54.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3234573294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f55c0 msgr2=0x7fc1b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3234573294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f55c0 0x7fc1b40f59e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fc1a4004660 tx=0x7fc1a4009b30).stop 2022-02-02T18:51:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3234573294 shutdown_connections 2022-02-02T18:51:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3234573294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f6860 0x7fc1b40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3234573294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f55c0 0x7fc1b40f59e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3234573294 >> 172.21.15.96:0/3234573294 conn(0x7fc1b40f0d40 msgr2=0x7fc1b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3234573294 shutdown_connections 2022-02-02T18:51:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.062+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3234573294 wait complete. 2022-02-02T18:51:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 Processor -- start 2022-02-02T18:51:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 -- start start 2022-02-02T18:51:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f55c0 0x7fc1b410c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40602b0 con 0x7fc1b40f6860 2022-02-02T18:51:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b8e3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40603f0 con 0x7fc1b40f55c0 2022-02-02T18:51:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56424/0 (socket says 172.21.15.96:56424) 2022-02-02T18:51:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 -- 172.21.15.96:0/3842755207 learned_addr learned my addr 172.21.15.96:0/3842755207 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b259c700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f55c0 0x7fc1b410c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 -- 172.21.15.96:0/3842755207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f55c0 msgr2=0x7fc1b410c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f55c0 0x7fc1b410c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.063+0000 7fc1b1d9b700 1 -- 172.21.15.96:0/3842755207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4005040 con 0x7fc1b40f6860 2022-02-02T18:51:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1b1d9b700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fc1a800c530 tx=0x7fc1a8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a800f650 con 0x7fc1b40f6860 2022-02-02T18:51:54.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b410ea10 con 0x7fc1b40f6860 2022-02-02T18:51:54.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1a800fc60 con 0x7fc1b40f6860 2022-02-02T18:51:54.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a8012cd0 con 0x7fc1b40f6860 2022-02-02T18:51:54.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.064+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b410ee90 con 0x7fc1b40f6860 2022-02-02T18:51:54.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.065+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b40f49b0 con 0x7fc1b40f6860 2022-02-02T18:51:54.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.065+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1a8010070 con 0x7fc1b40f6860 2022-02-02T18:51:54.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.065+0000 7fc1a2ffd700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 0x7fc19c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.066+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc1a80817d0 con 0x7fc1b40f6860 2022-02-02T18:51:54.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.066+0000 7fc1b259c700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 0x7fc19c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.066+0000 7fc1b259c700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 0x7fc19c067290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc1a4004e30 tx=0x7fc1a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.070+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1a804f880 con 0x7fc1b40f6860 2022-02-02T18:51:54.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.242+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1b40fde60 con 0x7fc19c064dd0 2022-02-02T18:51:54.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.251+0000 7fc1a2ffd700 1 -- 172.21.15.96:0/3842755207 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc1b40fde60 con 0x7fc19c064dd0 2022-02-02T18:51:54.248 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:51:54.248 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (35m) 5m ago 36m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:51:54.249 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (27m) 5m ago 36m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:51:54.249 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (27m) 4m ago 35m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:51:54.250 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (35m) 5m ago 36m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:51:54.250 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (32m) 5m ago 32m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:51:54.250 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (28m) 5m ago 32m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:51:54.251 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (32m) 4m ago 32m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:51:54.251 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (28m) 4m ago 32m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:51:54.251 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (29m) 5m ago 37m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:51:54.251 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (29m) 4m ago 35m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:51:54.251 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (28m) 5m ago 37m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:51:54.252 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (28m) 4m ago 35m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:51:54.252 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (36m) 5m ago 36m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:51:54.252 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (35m) 4m ago 35m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:51:54.252 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (27m) 5m ago 35m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:51:54.253 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (26m) 5m ago 34m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:51:54.253 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (26m) 5m ago 34m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:51:54.253 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (25m) 4m ago 34m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:51:54.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (25m) 4m ago 33m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:51:54.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (24m) 4m ago 33m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:51:54.254 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (35m) 5m ago 35m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:51:54.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 msgr2=0x7fc19c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 0x7fc19c067290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc1a4004e30 tx=0x7fc1a4009b30).stop 2022-02-02T18:51:54.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 msgr2=0x7fc1b410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fc1a800c530 tx=0x7fc1a8007e20).stop 2022-02-02T18:51:54.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 shutdown_connections 2022-02-02T18:51:54.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc19c064dd0 0x7fc19c067290 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b40f55c0 0x7fc1b410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 --2- 172.21.15.96:0/3842755207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1b40f6860 0x7fc1b410e520 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 >> 172.21.15.96:0/3842755207 conn(0x7fc1b40f0d40 msgr2=0x7fc1b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 shutdown_connections 2022-02-02T18:51:54.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.253+0000 7fc1b8e3e700 1 -- 172.21.15.96:0/3842755207 wait complete. 2022-02-02T18:51:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2362079514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f7980 msgr2=0x7fb8f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2362079514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f7980 0x7fb8f00f7de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fb8e0004660 tx=0x7fb8e0009b30).stop 2022-02-02T18:51:54.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2362079514 shutdown_connections 2022-02-02T18:51:54.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2362079514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f7980 0x7fb8f00f7de0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2362079514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f66e0 0x7fb8f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:51:54.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2362079514 >> 172.21.15.96:0/2362079514 conn(0x7fb8f00f1e40 msgr2=0x7fb8f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2362079514 shutdown_connections 2022-02-02T18:51:54.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.350+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2362079514 wait complete. 2022-02-02T18:51:54.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 Processor -- start 2022-02-02T18:51:54.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 -- start start 2022-02-02T18:51:54.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f7980 0x7fb8f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f006a410 con 0x7fb8f00f66e0 2022-02-02T18:51:54.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8f54bd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f006a550 con 0x7fb8f00f7980 2022-02-02T18:51:54.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56432/0 (socket says 172.21.15.96:56432) 2022-02-02T18:51:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 -- 172.21.15.96:0/2012235663 learned_addr learned my addr 172.21.15.96:0/2012235663 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8ee7fc700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f7980 0x7fb8f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 -- 172.21.15.96:0/2012235663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f7980 msgr2=0x7fb8f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f7980 0x7fb8f0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 -- 172.21.15.96:0/2012235663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0005040 con 0x7fb8f00f66e0 2022-02-02T18:51:54.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.351+0000 7fb8eeffd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb8e40093f0 tx=0x7fb8e4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.352+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4013640 con 0x7fb8f00f66e0 2022-02-02T18:51:54.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.352+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f006a830 con 0x7fb8f00f66e0 2022-02-02T18:51:54.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.352+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8e4013c50 con 0x7fb8f00f66e0 2022-02-02T18:51:54.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.352+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4012c70 con 0x7fb8f00f66e0 2022-02-02T18:51:54.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.352+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f010efe0 con 0x7fb8f00f66e0 2022-02-02T18:51:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.353+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0045ad0 con 0x7fb8f00f66e0 2022-02-02T18:51:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.353+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb8e401a060 con 0x7fb8f00f66e0 2022-02-02T18:51:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.354+0000 7fb8d77fe700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 0x7fb8d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.354+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb8e4081ac0 con 0x7fb8f00f66e0 2022-02-02T18:51:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.354+0000 7fb8ee7fc700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 0x7fb8d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.354+0000 7fb8ee7fc700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 0x7fb8d8067290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb8e0004630 tx=0x7fb8e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.358+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb8e404fb70 con 0x7fb8f00f66e0 2022-02-02T18:51:54.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.585+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8f0027a00 con 0x7fb8f00f66e0 2022-02-02T18:51:54.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.586+0000 7fb8d77fe700 1 -- 172.21.15.96:0/2012235663 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb8e40182e0 con 0x7fb8f00f66e0 2022-02-02T18:51:54.582 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:51:54.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:51:54.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:51:54.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:54.584 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:51:54.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:51:54.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:54.584 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:51:54.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:51:54.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:54.585 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:51:54.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:51:54.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:51:54.586 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:51:54.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:51:54.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:51:54.586 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:51:54.587 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:51:54.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 msgr2=0x7fb8d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 0x7fb8d8067290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb8e0004630 tx=0x7fb8e0009b30).stop 2022-02-02T18:51:54.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 msgr2=0x7fb8f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb8e40093f0 tx=0x7fb8e4006ec0).stop 2022-02-02T18:51:54.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 shutdown_connections 2022-02-02T18:51:54.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8d8064dd0 0x7fb8d8067290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8f00f66e0 0x7fb8f006b9a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 --2- 172.21.15.96:0/2012235663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f00f7980 0x7fb8f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 >> 172.21.15.96:0/2012235663 conn(0x7fb8f00f1e40 msgr2=0x7fb8f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 shutdown_connections 2022-02-02T18:51:54.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.588+0000 7fb8f54bd700 1 -- 172.21.15.96:0/2012235663 wait complete. 2022-02-02T18:51:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- 172.21.15.96:0/4139145226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 msgr2=0x7f56c80f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/4139145226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c80f4820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f56b4004660 tx=0x7f56b4009b30).stop 2022-02-02T18:51:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- 172.21.15.96:0/4139145226 shutdown_connections 2022-02-02T18:51:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/4139145226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c80f4820 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/4139145226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c80f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- 172.21.15.96:0/4139145226 >> 172.21.15.96:0/4139145226 conn(0x7f56c80f0540 msgr2=0x7f56c80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- 172.21.15.96:0/4139145226 shutdown_connections 2022-02-02T18:51:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- 172.21.15.96:0/4139145226 wait complete. 2022-02-02T18:51:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 Processor -- start 2022-02-02T18:51:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.687+0000 7f56ceaf7700 1 -- start start 2022-02-02T18:51:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c8106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c81079b0 con 0x7f56c80f8610 2022-02-02T18:51:54.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8107af0 con 0x7f56c80f7d00 2022-02-02T18:51:54.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56444/0 (socket says 172.21.15.96:56444) 2022-02-02T18:51:54.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 -- 172.21.15.96:0/3821475128 learned_addr learned my addr 172.21.15.96:0/3821475128 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:51:54.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56cc893700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c8106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 -- 172.21.15.96:0/3821475128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 msgr2=0x7f56c8106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c8106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 -- 172.21.15.96:0/3821475128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4005040 con 0x7f56c80f8610 2022-02-02T18:51:54.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56cc893700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c8106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:51:54.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c7fff700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f56b4009990 tx=0x7f56b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b4018070 con 0x7f56c80f8610 2022-02-02T18:51:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56b4007ca0 con 0x7f56c80f8610 2022-02-02T18:51:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c8108430 con 0x7f56c80f8610 2022-02-02T18:51:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b401c620 con 0x7f56c80f8610 2022-02-02T18:51:54.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.688+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8108990 con 0x7f56c80f8610 2022-02-02T18:51:54.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.689+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8045ad0 con 0x7f56c80f8610 2022-02-02T18:51:54.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.690+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56b401d960 con 0x7f56c80f8610 2022-02-02T18:51:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.690+0000 7f56c57fa700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 0x7f56b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:51:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.690+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f56b4083810 con 0x7f56c80f8610 2022-02-02T18:51:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.690+0000 7f56cc893700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 0x7f56b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:51:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.691+0000 7f56cc893700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 0x7f56b8067290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f56bc0041d0 tx=0x7f56bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:51:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.694+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56b40553b0 con 0x7f56c80f8610 2022-02-02T18:51:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.895+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56c8027a00 con 0x7f56c80f8610 2022-02-02T18:51:54.891 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:54 smithi096 ceph-mon[101353]: pgmap v893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:54.891 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2012235663' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.895+0000 7f56c57fa700 1 -- 172.21.15.96:0/3821475128 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f56b4054fa0 con 0x7f56c80f8610 2022-02-02T18:51:54.892 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:51:54.892 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:51:54.893 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:51:54.893 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:51:54.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:54.893 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:51:54.894 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:51:54.894 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:51:54.894 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:51:54.894 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:51:54.895 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:51:54.895 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:51:54.895 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:51:54.895 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:51:54.896 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:51:54.896 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:51:54.896 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:51:54.896 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:51:54.896 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:51:54.897 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:51:54.897 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:51:54.897 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:51:54.897 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:51:54.898 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:51:54.898 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:51:54.898 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:51:54.898 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:51:54.899 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:51:54.899 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:51:54.899 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:51:54.899 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:51:54.899 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:51:54.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:54.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:54.900 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:51:54.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:51:54.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:54.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:54.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:51:54.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 msgr2=0x7f56b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 0x7f56b8067290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f56bc0041d0 tx=0x7f56bc009040).stop 2022-02-02T18:51:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 msgr2=0x7f56c8107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:51:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f56b4009990 tx=0x7f56b4009b30).stop 2022-02-02T18:51:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 shutdown_connections 2022-02-02T18:51:54.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56b8064dd0 0x7f56b8067290 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c80f7d00 0x7f56c8106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 --2- 172.21.15.96:0/3821475128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56c80f8610 0x7f56c8107400 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:51:54.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 >> 172.21.15.96:0/3821475128 conn(0x7f56c80f0540 msgr2=0x7f56c80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:51:54.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 shutdown_connections 2022-02-02T18:51:54.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:51:54.897+0000 7f56ceaf7700 1 -- 172.21.15.96:0/3821475128 wait complete. 2022-02-02T18:51:54.905 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:51:55.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:54 smithi159 ceph-mon[69013]: pgmap v893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:55.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2012235663' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:51:56.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:55 smithi159 ceph-mon[69013]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:56.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:55 smithi159 ceph-mon[69013]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:56.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3821475128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:51:56.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:55 smithi096 ceph-mon[101353]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:56.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:55 smithi096 ceph-mon[101353]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:51:56.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3821475128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:51:57.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:56 smithi159 ceph-mon[69013]: pgmap v894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:57.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:56 smithi096 ceph-mon[101353]: pgmap v894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:59.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:58 smithi159 ceph-mon[69013]: pgmap v895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:59.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:59.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:59.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:58 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:51:59.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:58 smithi096 ceph-mon[101353]: pgmap v895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:51:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:51:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:51:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:58 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:00.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:00.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:00.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:00.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:51:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:00.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:00.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:00.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:00.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:51:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:00 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:00 smithi159 ceph-mon[69013]: pgmap v896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:00 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:00 smithi096 ceph-mon[101353]: pgmap v896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:02 smithi159 ceph-mon[69013]: pgmap v897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:02 smithi096 ceph-mon[101353]: pgmap v897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:05.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:04 smithi159 ceph-mon[69013]: pgmap v898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:05.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:04 smithi096 ceph-mon[101353]: pgmap v898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:06 smithi159 ceph-mon[69013]: pgmap v899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:07.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:06 smithi096 ceph-mon[101353]: pgmap v899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:09.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:08 smithi159 ceph-mon[69013]: pgmap v900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:09.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:08 smithi096 ceph-mon[101353]: pgmap v900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:10.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:10.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:10.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:10.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:10.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:10.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:10.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:10 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:10 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:10 smithi159 ceph-mon[69013]: pgmap v901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:10 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:10 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:10 smithi096 ceph-mon[101353]: pgmap v901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:13.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:12 smithi159 ceph-mon[69013]: pgmap v902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:12 smithi096 ceph-mon[101353]: pgmap v902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:14 smithi159 ceph-mon[69013]: pgmap v903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:15.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:14 smithi096 ceph-mon[101353]: pgmap v903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:17.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:16 smithi159 ceph-mon[69013]: pgmap v904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:16 smithi096 ceph-mon[101353]: pgmap v904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:18 smithi159 ceph-mon[69013]: pgmap v905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:18 smithi096 ceph-mon[101353]: pgmap v905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:20.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:20.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:20.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:20.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:20.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:20.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:20 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:20 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:20 smithi159 ceph-mon[69013]: pgmap v906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:20 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:20 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:20 smithi096 ceph-mon[101353]: pgmap v906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:22 smithi159 ceph-mon[69013]: pgmap v907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:22 smithi096 ceph-mon[101353]: pgmap v907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 -- 172.21.15.96:0/1689534062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 msgr2=0x7fde740fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/1689534062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740fbc70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fde64004660 tx=0x7fde64009b30).stop 2022-02-02T18:52:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 -- 172.21.15.96:0/1689534062 shutdown_connections 2022-02-02T18:52:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/1689534062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740fbc70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/1689534062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 0x7fde740f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:52:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 -- 172.21.15.96:0/1689534062 >> 172.21.15.96:0/1689534062 conn(0x7fde740f0d40 msgr2=0x7fde740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 -- 172.21.15.96:0/1689534062 shutdown_connections 2022-02-02T18:52:25.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.007+0000 7fde7a0cb700 1 -- 172.21.15.96:0/1689534062 wait complete. 2022-02-02T18:52:25.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:24 smithi096 ceph-mon[101353]: pgmap v908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:25.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 Processor -- start 2022-02-02T18:52:25.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 -- start start 2022-02-02T18:52:25.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 0x7fde740f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740f57f0 con 0x7fde740f9880 2022-02-02T18:52:25.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde7a0cb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740f5930 con 0x7fde740602b0 2022-02-02T18:52:25.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56464/0 (socket says 172.21.15.96:56464) 2022-02-02T18:52:25.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde72ffd700 1 -- 172.21.15.96:0/4286656470 learned_addr learned my addr 172.21.15.96:0/4286656470 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:25.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.008+0000 7fde737fe700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 0x7fde740f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde72ffd700 1 -- 172.21.15.96:0/4286656470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 msgr2=0x7fde740f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde72ffd700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 0x7fde740f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde72ffd700 1 -- 172.21.15.96:0/4286656470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64005040 con 0x7fde740f9880 2022-02-02T18:52:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde72ffd700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fde64004f60 tx=0x7fde64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde64018070 con 0x7fde740f9880 2022-02-02T18:52:25.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde740f5bb0 con 0x7fde740f9880 2022-02-02T18:52:25.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde64009770 con 0x7fde740f9880 2022-02-02T18:52:25.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7410ef90 con 0x7fde740f9880 2022-02-02T18:52:25.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.009+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6401c3c0 con 0x7fde740f9880 2022-02-02T18:52:25.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.010+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde74045ad0 con 0x7fde740f9880 2022-02-02T18:52:25.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.011+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde6401d420 con 0x7fde740f9880 2022-02-02T18:52:25.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.011+0000 7fde5bfff700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 0x7fde5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.011+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fde64083e60 con 0x7fde740f9880 2022-02-02T18:52:25.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.011+0000 7fde737fe700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 0x7fde5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.011+0000 7fde737fe700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 0x7fde5c067290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fde740f6b10 tx=0x7fde68008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.015+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde64051f10 con 0x7fde740f9880 2022-02-02T18:52:25.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:24 smithi159 ceph-mon[69013]: pgmap v908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:25.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.195+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde74057f10 con 0x7fde5c064dd0 2022-02-02T18:52:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.196+0000 7fde5bfff700 1 -- 172.21.15.96:0/4286656470 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fde74057f10 con 0x7fde5c064dd0 2022-02-02T18:52:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 msgr2=0x7fde5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 0x7fde5c067290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fde740f6b10 tx=0x7fde68008040).stop 2022-02-02T18:52:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 msgr2=0x7fde740f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fde64004f60 tx=0x7fde64009b30).stop 2022-02-02T18:52:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 shutdown_connections 2022-02-02T18:52:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde5c064dd0 0x7fde5c067290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde740602b0 0x7fde740f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 --2- 172.21.15.96:0/4286656470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde740f9880 0x7fde740f5200 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 >> 172.21.15.96:0/4286656470 conn(0x7fde740f0d40 msgr2=0x7fde740f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 shutdown_connections 2022-02-02T18:52:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.198+0000 7fde7a0cb700 1 -- 172.21.15.96:0/4286656470 wait complete. 2022-02-02T18:52:25.204 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:52:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- 172.21.15.96:0/3066658840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 msgr2=0x7fcfb80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/3066658840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb80f6b30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fcfb4004660 tx=0x7fcfb4009b30).stop 2022-02-02T18:52:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- 172.21.15.96:0/3066658840 shutdown_connections 2022-02-02T18:52:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/3066658840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb80f6b30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/3066658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 0x7fcfb80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- 172.21.15.96:0/3066658840 >> 172.21.15.96:0/3066658840 conn(0x7fcfb80f0b90 msgr2=0x7fcfb80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- 172.21.15.96:0/3066658840 shutdown_connections 2022-02-02T18:52:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- 172.21.15.96:0/3066658840 wait complete. 2022-02-02T18:52:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 Processor -- start 2022-02-02T18:52:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.296+0000 7fcfbf22e700 1 -- start start 2022-02-02T18:52:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 0x7fcfb8105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8106760 con 0x7fcfb80f66d0 2022-02-02T18:52:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8106f60 con 0x7fcfb80f5430 2022-02-02T18:52:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56474/0 (socket says 172.21.15.96:56474) 2022-02-02T18:52:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 -- 172.21.15.96:0/605531002 learned_addr learned my addr 172.21.15.96:0/605531002 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbe22c700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 0x7fcfb8105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 -- 172.21.15.96:0/605531002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 msgr2=0x7fcfb8105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 0x7fcfb8105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 -- 172.21.15.96:0/605531002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4005040 con 0x7fcfb80f66d0 2022-02-02T18:52:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbda2b700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fcfb4009990 tx=0x7fcfb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb4018070 con 0x7fcfb80f66d0 2022-02-02T18:52:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfb4007ba0 con 0x7fcfb80f66d0 2022-02-02T18:52:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb81071e0 con 0x7fcfb80f66d0 2022-02-02T18:52:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.297+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8107740 con 0x7fcfb80f66d0 2022-02-02T18:52:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.298+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb401c3c0 con 0x7fcfb80f66d0 2022-02-02T18:52:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.299+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8059100 con 0x7fcfb80f66d0 2022-02-02T18:52:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.299+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcfb401d420 con 0x7fcfb80f66d0 2022-02-02T18:52:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.299+0000 7fcfaeffd700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 0x7fcfa40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.299+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcfb4083630 con 0x7fcfb80f66d0 2022-02-02T18:52:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.299+0000 7fcfbe22c700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 0x7fcfa40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.300+0000 7fcfbe22c700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 0x7fcfa40672e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fcfb80f6530 tx=0x7fcfa800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.304+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcfb40550b0 con 0x7fcfb80f66d0 2022-02-02T18:52:25.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.479+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfb80fdbf0 con 0x7fcfa4064e20 2022-02-02T18:52:25.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.488+0000 7fcfaeffd700 1 -- 172.21.15.96:0/605531002 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fcfb80fdbf0 con 0x7fcfa4064e20 2022-02-02T18:52:25.484 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:52:25.484 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (35m) 6m ago 36m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:52:25.485 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (28m) 6m ago 36m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:52:25.485 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (28m) 4m ago 36m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:52:25.485 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (35m) 6m ago 36m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:52:25.485 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (32m) 6m ago 32m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:52:25.486 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (28m) 6m ago 32m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:52:25.486 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (32m) 4m ago 32m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:52:25.486 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (28m) 4m ago 33m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:52:25.486 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (30m) 6m ago 37m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:52:25.486 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (29m) 4m ago 36m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:52:25.487 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (29m) 6m ago 38m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:52:25.487 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (28m) 4m ago 36m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:52:25.487 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (36m) 6m ago 36m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:52:25.487 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (36m) 4m ago 36m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:52:25.488 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (27m) 6m ago 35m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:52:25.488 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (27m) 6m ago 35m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:52:25.488 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (26m) 6m ago 35m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:52:25.488 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (26m) 4m ago 34m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:52:25.488 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (25m) 4m ago 34m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:52:25.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (25m) 4m ago 34m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:52:25.489 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (35m) 6m ago 36m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:52:25.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 msgr2=0x7fcfa40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 0x7fcfa40672e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fcfb80f6530 tx=0x7fcfa800b040).stop 2022-02-02T18:52:25.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 msgr2=0x7fcfb81061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fcfb4009990 tx=0x7fcfb4009b30).stop 2022-02-02T18:52:25.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 shutdown_connections 2022-02-02T18:52:25.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfa4064e20 0x7fcfa40672e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfb80f5430 0x7fcfb8105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 --2- 172.21.15.96:0/605531002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfb80f66d0 0x7fcfb81061b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 >> 172.21.15.96:0/605531002 conn(0x7fcfb80f0b90 msgr2=0x7fcfb80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 shutdown_connections 2022-02-02T18:52:25.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.490+0000 7fcfbf22e700 1 -- 172.21.15.96:0/605531002 wait complete. 2022-02-02T18:52:25.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 -- 172.21.15.96:0/341841011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f7980 msgr2=0x7f03a00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 --2- 172.21.15.96:0/341841011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f7980 0x7f03a00f7de0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f038c004660 tx=0x7f038c009b30).stop 2022-02-02T18:52:25.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 -- 172.21.15.96:0/341841011 shutdown_connections 2022-02-02T18:52:25.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 --2- 172.21.15.96:0/341841011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f7980 0x7f03a00f7de0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 --2- 172.21.15.96:0/341841011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f66e0 0x7f03a00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 -- 172.21.15.96:0/341841011 >> 172.21.15.96:0/341841011 conn(0x7f03a00f1e40 msgr2=0x7f03a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 -- 172.21.15.96:0/341841011 shutdown_connections 2022-02-02T18:52:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 -- 172.21.15.96:0/341841011 wait complete. 2022-02-02T18:52:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.588+0000 7f03a6aca700 1 Processor -- start 2022-02-02T18:52:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a6aca700 1 -- start start 2022-02-02T18:52:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a6aca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a6aca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f7980 0x7f03a0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a6aca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0107a00 con 0x7f03a00f66e0 2022-02-02T18:52:25.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a6aca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0107b40 con 0x7f03a00f7980 2022-02-02T18:52:25.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56482/0 (socket says 172.21.15.96:56482) 2022-02-02T18:52:25.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 -- 172.21.15.96:0/1503405366 learned_addr learned my addr 172.21.15.96:0/1503405366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:25.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 -- 172.21.15.96:0/1503405366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f7980 msgr2=0x7f03a0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f7980 0x7f03a0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:52:25.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 -- 172.21.15.96:0/1503405366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c005040 con 0x7f03a00f66e0 2022-02-02T18:52:25.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.589+0000 7f03a4866700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0394002700 tx=0x7f0394009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.590+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0394009320 con 0x7f03a00f66e0 2022-02-02T18:52:25.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.590+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f039400f040 con 0x7f03a00f66e0 2022-02-02T18:52:25.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.590+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0394014900 con 0x7f03a00f66e0 2022-02-02T18:52:25.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.590+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a01084e0 con 0x7f03a00f66e0 2022-02-02T18:52:25.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.590+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a0108aa0 con 0x7f03a00f66e0 2022-02-02T18:52:25.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.591+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a0045ad0 con 0x7f03a00f66e0 2022-02-02T18:52:25.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.591+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0394009480 con 0x7f03a00f66e0 2022-02-02T18:52:25.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.591+0000 7f039d7fa700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 0x7f0390067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.591+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0394081c30 con 0x7f03a00f66e0 2022-02-02T18:52:25.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.591+0000 7f039ffff700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 0x7f0390067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.592+0000 7f039ffff700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 0x7f0390067290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f038c004e30 tx=0x7f038c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.596+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0394053710 con 0x7f03a00f66e0 2022-02-02T18:52:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.825+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03a0108d70 con 0x7f03a00f66e0 2022-02-02T18:52:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.825+0000 7f039d7fa700 1 -- 172.21.15.96:0/1503405366 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0394053300 con 0x7f03a00f66e0 2022-02-02T18:52:25.822 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:52:25.822 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:52:25.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:52:25.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:25.823 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:52:25.823 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:52:25.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:25.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:52:25.824 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:52:25.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:25.824 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:52:25.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:52:25.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:25.825 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:52:25.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:52:25.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:52:25.826 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:52:25.826 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:52:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 msgr2=0x7f0390067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 0x7f0390067290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f038c004e30 tx=0x7f038c009b30).stop 2022-02-02T18:52:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 msgr2=0x7f03a0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0394002700 tx=0x7f0394009d80).stop 2022-02-02T18:52:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 shutdown_connections 2022-02-02T18:52:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0390064dd0 0x7f0390067290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f66e0 0x7f03a0106f60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 --2- 172.21.15.96:0/1503405366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f7980 0x7f03a0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:52:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 >> 172.21.15.96:0/1503405366 conn(0x7f03a00f1e40 msgr2=0x7f03a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.827+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 shutdown_connections 2022-02-02T18:52:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.828+0000 7f03a6aca700 1 -- 172.21.15.96:0/1503405366 wait complete. 2022-02-02T18:52:25.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 -- 172.21.15.96:0/1533144508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 msgr2=0x7fd72c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 --2- 172.21.15.96:0/1533144508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c0f6b40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fd728004660 tx=0x7fd728009b30).stop 2022-02-02T18:52:25.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 -- 172.21.15.96:0/1533144508 shutdown_connections 2022-02-02T18:52:25.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 --2- 172.21.15.96:0/1533144508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c0f6b40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 --2- 172.21.15.96:0/1533144508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 0x7fd72c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 -- 172.21.15.96:0/1533144508 >> 172.21.15.96:0/1533144508 conn(0x7fd72c0f0ba0 msgr2=0x7fd72c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:25.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.925+0000 7fd7330e2700 1 -- 172.21.15.96:0/1533144508 shutdown_connections 2022-02-02T18:52:25.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 -- 172.21.15.96:0/1533144508 wait complete. 2022-02-02T18:52:25.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 Processor -- start 2022-02-02T18:52:25.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 -- start start 2022-02-02T18:52:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 0x7fd72c109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0603c0 con 0x7fd72c0f66e0 2022-02-02T18:52:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.926+0000 7fd7330e2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c060500 con 0x7fd72c0f5440 2022-02-02T18:52:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56494/0 (socket says 172.21.15.96:56494) 2022-02-02T18:52:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 -- 172.21.15.96:0/3017759492 learned_addr learned my addr 172.21.15.96:0/3017759492 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7320e0700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 0x7fd72c109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 -- 172.21.15.96:0/3017759492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 msgr2=0x7fd72c109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 0x7fd72c109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 -- 172.21.15.96:0/3017759492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728005040 con 0x7fd72c0f66e0 2022-02-02T18:52:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7318df700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fd728009990 tx=0x7fd728009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd728018070 con 0x7fd72c0f66e0 2022-02-02T18:52:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd728007ba0 con 0x7fd72c0f66e0 2022-02-02T18:52:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72801c3c0 con 0x7fd72c0f66e0 2022-02-02T18:52:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c10c4a0 con 0x7fd72c0f66e0 2022-02-02T18:52:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.927+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c10c980 con 0x7fd72c0f66e0 2022-02-02T18:52:25.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.928+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c045ad0 con 0x7fd72c0f66e0 2022-02-02T18:52:25.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.929+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd72801d420 con 0x7fd72c0f66e0 2022-02-02T18:52:25.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.929+0000 7fd722ffd700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 0x7fd7180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:25.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.929+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd728083710 con 0x7fd72c0f66e0 2022-02-02T18:52:25.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.929+0000 7fd7320e0700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 0x7fd7180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:25.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.930+0000 7fd7320e0700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 0x7fd7180672e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd72c060040 tx=0x7fd71c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:25.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:25.934+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd728051820 con 0x7fd72c0f66e0 2022-02-02T18:52:26.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.136+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd72c027a00 con 0x7fd72c0f66e0 2022-02-02T18:52:26.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.136+0000 7fd722ffd700 1 -- 172.21.15.96:0/3017759492 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd728051020 con 0x7fd72c0f66e0 2022-02-02T18:52:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:52:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:52:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:52:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:52:26.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:52:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:52:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:52:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:52:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:52:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:52:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:52:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:52:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:52:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:52:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:52:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:52:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:52:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:52:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:52:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:52:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:52:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:52:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:52:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:52:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:52:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:52:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:52:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:52:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:52:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:52:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:52:26.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:26.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:52:26.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:26.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 msgr2=0x7fd7180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:26.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 0x7fd7180672e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd72c060040 tx=0x7fd71c00b040).stop 2022-02-02T18:52:26.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 msgr2=0x7fd72c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fd728009990 tx=0x7fd728009b30).stop 2022-02-02T18:52:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 shutdown_connections 2022-02-02T18:52:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd718064e20 0x7fd7180672e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0f5440 0x7fd72c109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 --2- 172.21.15.96:0/3017759492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd72c0f66e0 0x7fd72c10bf50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 >> 172.21.15.96:0/3017759492 conn(0x7fd72c0f0ba0 msgr2=0x7fd72c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 shutdown_connections 2022-02-02T18:52:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:26.138+0000 7fd7330e2700 1 -- 172.21.15.96:0/3017759492 wait complete. 2022-02-02T18:52:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:52:26.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:26 smithi159 ceph-mon[69013]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:26.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:26 smithi159 ceph-mon[69013]: pgmap v909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:26.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:26 smithi159 ceph-mon[69013]: from='client.35056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:26.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1503405366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:26.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3017759492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:52:26.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:26 smithi096 ceph-mon[101353]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:26 smithi096 ceph-mon[101353]: pgmap v909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:26 smithi096 ceph-mon[101353]: from='client.35056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1503405366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:26.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3017759492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:52:27.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:52:27.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:52:27.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:52:27.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:52:28.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:28 smithi159 ceph-mon[69013]: pgmap v910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:28.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:28 smithi096 ceph-mon[101353]: pgmap v910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:29.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:29.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:29.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:29.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:29.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:29.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:29.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:29.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:29.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:29.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:29.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:29.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:30 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:30 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:30 smithi159 ceph-mon[69013]: pgmap v911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:30.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:30 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:30.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:30 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:30.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:30 smithi096 ceph-mon[101353]: pgmap v911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:32.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:32 smithi159 ceph-mon[69013]: pgmap v912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:32.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:32 smithi096 ceph-mon[101353]: pgmap v912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:34.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:34 smithi159 ceph-mon[69013]: pgmap v913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:34.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:34 smithi096 ceph-mon[101353]: pgmap v913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:36.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:36 smithi159 ceph-mon[69013]: pgmap v914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:36.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:36 smithi096 ceph-mon[101353]: pgmap v914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:38.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:38 smithi159 ceph-mon[69013]: pgmap v915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:38.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:38 smithi096 ceph-mon[101353]: pgmap v915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:39.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:39.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:39.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:39.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:39.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:39.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:39.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:39.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:39.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:39.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:39.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:39.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:40 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:40 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:40 smithi159 ceph-mon[69013]: pgmap v916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:40.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:40 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:40 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:40 smithi096 ceph-mon[101353]: pgmap v916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:42.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:42 smithi159 ceph-mon[69013]: pgmap v917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:42.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:42 smithi096 ceph-mon[101353]: pgmap v917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:44.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:44 smithi159 ceph-mon[69013]: pgmap v918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:44.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:44 smithi096 ceph-mon[101353]: pgmap v918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:46.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:46 smithi159 ceph-mon[69013]: pgmap v919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:46.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:46 smithi096 ceph-mon[101353]: pgmap v919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:48.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:48 smithi159 ceph-mon[69013]: pgmap v920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:48.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:48 smithi096 ceph-mon[101353]: pgmap v920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:49.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:49.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:49.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:49.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:49.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:49.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:49.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:49.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:49.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:49.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:49.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:49.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:50 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:50 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:50.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:50 smithi159 ceph-mon[69013]: pgmap v921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:50.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:50 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:52:50.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:50 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:52:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:50 smithi096 ceph-mon[101353]: pgmap v921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:52 smithi159 ceph-mon[69013]: pgmap v922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:52.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:52 smithi096 ceph-mon[101353]: pgmap v922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:54.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:54 smithi159 ceph-mon[69013]: pgmap v923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:54.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:54 smithi096 ceph-mon[101353]: pgmap v923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:56.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 -- 172.21.15.96:0/571062989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 msgr2=0x7f84e80f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/571062989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f6900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f84dc004660 tx=0x7f84dc009b30).stop 2022-02-02T18:52:56.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 -- 172.21.15.96:0/571062989 shutdown_connections 2022-02-02T18:52:56.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/571062989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f6900 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/571062989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 0x7f84e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 -- 172.21.15.96:0/571062989 >> 172.21.15.96:0/571062989 conn(0x7f84e80f0de0 msgr2=0x7f84e80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 -- 172.21.15.96:0/571062989 shutdown_connections 2022-02-02T18:52:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.248+0000 7f84ed7cf700 1 -- 172.21.15.96:0/571062989 wait complete. 2022-02-02T18:52:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 Processor -- start 2022-02-02T18:52:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 -- start start 2022-02-02T18:52:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 0x7f84e80f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80f81a0 con 0x7f84e80f5ed0 2022-02-02T18:52:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84ed7cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80f82e0 con 0x7f84e80f55c0 2022-02-02T18:52:56.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84e67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.249+0000 7f84e67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56510/0 (socket says 172.21.15.96:56510) 2022-02-02T18:52:56.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e67fc700 1 -- 172.21.15.96:0/3954081235 learned_addr learned my addr 172.21.15.96:0/3954081235 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:56.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e6ffd700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 0x7f84e80f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e67fc700 1 -- 172.21.15.96:0/3954081235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 msgr2=0x7f84e80f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e67fc700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 0x7f84e80f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e67fc700 1 -- 172.21.15.96:0/3954081235 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc005040 con 0x7f84e80f5ed0 2022-02-02T18:52:56.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84e67fc700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f84dc009990 tx=0x7f84dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84dc018070 con 0x7f84e80f5ed0 2022-02-02T18:52:56.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e80f8560 con 0x7f84e80f5ed0 2022-02-02T18:52:56.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84dc007ba0 con 0x7f84e80f5ed0 2022-02-02T18:52:56.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80f8ac0 con 0x7f84e80f5ed0 2022-02-02T18:52:56.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.250+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84dc01c620 con 0x7f84e80f5ed0 2022-02-02T18:52:56.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.251+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8045ad0 con 0x7f84e80f5ed0 2022-02-02T18:52:56.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.252+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84dc01c890 con 0x7f84e80f5ed0 2022-02-02T18:52:56.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.252+0000 7f84cf7fe700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 0x7f84d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.252+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f84dc083830 con 0x7f84e80f5ed0 2022-02-02T18:52:56.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.252+0000 7f84e6ffd700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 0x7f84d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.253+0000 7f84e6ffd700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 0x7f84d0067290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f84d80041d0 tx=0x7f84d8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.257+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84dc0519c0 con 0x7f84e80f5ed0 2022-02-02T18:52:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.437+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84e80fad40 con 0x7f84d0064dd0 2022-02-02T18:52:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.438+0000 7f84cf7fe700 1 -- 172.21.15.96:0/3954081235 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f84e80fad40 con 0x7f84d0064dd0 2022-02-02T18:52:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 msgr2=0x7f84d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 0x7f84d0067290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f84d80041d0 tx=0x7f84d8009040).stop 2022-02-02T18:52:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 msgr2=0x7f84e80f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f84dc009990 tx=0x7f84dc009b30).stop 2022-02-02T18:52:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 shutdown_connections 2022-02-02T18:52:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84d0064dd0 0x7f84d0067290 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e80f55c0 0x7f84e80f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 --2- 172.21.15.96:0/3954081235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84e80f5ed0 0x7f84e80f7c40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 >> 172.21.15.96:0/3954081235 conn(0x7f84e80f0de0 msgr2=0x7f84e805ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 shutdown_connections 2022-02-02T18:52:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.440+0000 7f84ed7cf700 1 -- 172.21.15.96:0/3954081235 wait complete. 2022-02-02T18:52:56.446 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:52:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/3546706851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f5f60 msgr2=0x7fd5b80f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/3546706851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f63e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fd5ac004660 tx=0x7fd5ac009b30).stop 2022-02-02T18:52:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/3546706851 shutdown_connections 2022-02-02T18:52:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/3546706851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f63e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/3546706851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/3546706851 >> 172.21.15.96:0/3546706851 conn(0x7fd5b80f04c0 msgr2=0x7fd5b80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/3546706851 shutdown_connections 2022-02-02T18:52:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.540+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/3546706851 wait complete. 2022-02-02T18:52:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 Processor -- start 2022-02-02T18:52:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 -- start start 2022-02-02T18:52:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80f7890 con 0x7fd5b80f4d60 2022-02-02T18:52:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bfdb3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80f79d0 con 0x7fd5b80f5f60 2022-02-02T18:52:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56518/0 (socket says 172.21.15.96:56518) 2022-02-02T18:52:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 -- 172.21.15.96:0/1223052423 learned_addr learned my addr 172.21.15.96:0/1223052423 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bd34e700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 -- 172.21.15.96:0/1223052423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f5f60 msgr2=0x7fd5b80f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 -- 172.21.15.96:0/1223052423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac005040 con 0x7fd5b80f4d60 2022-02-02T18:52:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.541+0000 7fd5bdb4f700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd5a8007fd0 tx=0x7fd5a8004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.542+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a800b4f0 con 0x7fd5b80f4d60 2022-02-02T18:52:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.542+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5a800f040 con 0x7fd5b80f4d60 2022-02-02T18:52:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.542+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b80f7cb0 con 0x7fd5b80f4d60 2022-02-02T18:52:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.542+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a8013a50 con 0x7fd5b80f4d60 2022-02-02T18:52:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.542+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b810eff0 con 0x7fd5b80f4d60 2022-02-02T18:52:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.543+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b8045ad0 con 0x7fd5b80f4d60 2022-02-02T18:52:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.543+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd5a801a030 con 0x7fd5b80f4d60 2022-02-02T18:52:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.543+0000 7fd5b67fc700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 0x7fd5a0067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.543+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd5a8081800 con 0x7fd5b80f4d60 2022-02-02T18:52:56.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.543+0000 7fd5bd34e700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 0x7fd5a0067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.544+0000 7fd5bd34e700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 0x7fd5a0067350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd5ac004630 tx=0x7fd5ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.547+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5a80497d0 con 0x7fd5b80f4d60 2022-02-02T18:52:56.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.725+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5b80fa430 con 0x7fd5a0064e90 2022-02-02T18:52:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.734+0000 7fd5b67fc700 1 -- 172.21.15.96:0/1223052423 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd5b80fa430 con 0x7fd5a0064e90 2022-02-02T18:52:56.730 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:52:56.730 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (36m) 6m ago 37m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:52:56.730 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (28m) 6m ago 37m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:52:56.731 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (28m) 5m ago 36m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:52:56.731 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (36m) 6m ago 37m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:52:56.731 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (33m) 6m ago 33m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:52:56.731 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (29m) 6m ago 33m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:52:56.732 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (33m) 5m ago 33m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:52:56.732 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (29m) 5m ago 33m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:52:56.732 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (30m) 6m ago 38m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:52:56.732 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (30m) 5m ago 36m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:52:56.733 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (29m) 6m ago 38m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:52:56.733 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (29m) 5m ago 36m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:52:56.733 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (37m) 6m ago 37m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:52:56.733 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (36m) 5m ago 36m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:52:56.733 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (28m) 6m ago 36m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:52:56.734 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (27m) 6m ago 35m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:52:56.734 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (27m) 6m ago 35m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:52:56.734 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (26m) 5m ago 35m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:52:56.734 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (26m) 5m ago 35m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:52:56.735 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (25m) 5m ago 34m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:52:56.735 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (36m) 6m ago 36m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:52:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.735+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 msgr2=0x7fd5a0067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.735+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 0x7fd5a0067350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd5ac004630 tx=0x7fd5ac009b30).stop 2022-02-02T18:52:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.735+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 msgr2=0x7fd5b80f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.735+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd5a8007fd0 tx=0x7fd5a8004ee0).stop 2022-02-02T18:52:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 shutdown_connections 2022-02-02T18:52:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5a0064e90 0x7fd5a0067350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5b80f4d60 0x7fd5b80f8eb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 --2- 172.21.15.96:0/1223052423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b80f5f60 0x7fd5b80f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 >> 172.21.15.96:0/1223052423 conn(0x7fd5b80f04c0 msgr2=0x7fd5b80fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:56.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 shutdown_connections 2022-02-02T18:52:56.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.736+0000 7fd5bfdb3700 1 -- 172.21.15.96:0/1223052423 wait complete. 2022-02-02T18:52:56.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:56 smithi159 ceph-mon[69013]: pgmap v924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:56.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:56 smithi096 ceph-mon[101353]: pgmap v924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 -- 172.21.15.96:0/3839732528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3738060310 msgr2=0x7f37380f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 --2- 172.21.15.96:0/3839732528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3738060310 0x7f37380f9110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f372c004660 tx=0x7f372c009b30).stop 2022-02-02T18:52:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 -- 172.21.15.96:0/3839732528 shutdown_connections 2022-02-02T18:52:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 --2- 172.21.15.96:0/3839732528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37380f9690 0x7f37380fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 --2- 172.21.15.96:0/3839732528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3738060310 0x7f37380f9110 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 -- 172.21.15.96:0/3839732528 >> 172.21.15.96:0/3839732528 conn(0x7f37380f0b90 msgr2=0x7f37380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.833+0000 7f373cdad700 1 -- 172.21.15.96:0/3839732528 shutdown_connections 2022-02-02T18:52:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 -- 172.21.15.96:0/3839732528 wait complete. 2022-02-02T18:52:56.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 Processor -- start 2022-02-02T18:52:56.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 -- start start 2022-02-02T18:52:56.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3738060310 0x7f3738106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738107880 con 0x7f37380f9690 2022-02-02T18:52:56.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f373cdad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37381080c0 con 0x7f3738060310 2022-02-02T18:52:56.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.834+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56530/0 (socket says 172.21.15.96:56530) 2022-02-02T18:52:56.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 -- 172.21.15.96:0/1652878808 learned_addr learned my addr 172.21.15.96:0/1652878808 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:56.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f37377fe700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3738060310 0x7f3738106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 -- 172.21.15.96:0/1652878808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3738060310 msgr2=0x7f3738106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:56.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3738060310 0x7f3738106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:56.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 -- 172.21.15.96:0/1652878808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c005040 con 0x7f37380f9690 2022-02-02T18:52:56.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f3736ffd700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f373000c790 tx=0x7f3730007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373000e680 con 0x7f37380f9690 2022-02-02T18:52:56.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f373000ec90 con 0x7f37380f9690 2022-02-02T18:52:56.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37381083a0 con 0x7f37380f9690 2022-02-02T18:52:56.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3730013cd0 con 0x7f37380f9690 2022-02-02T18:52:56.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.835+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37381088e0 con 0x7f37380f9690 2022-02-02T18:52:56.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.836+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3738059100 con 0x7f37380f9690 2022-02-02T18:52:56.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.837+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f373001a060 con 0x7f37380f9690 2022-02-02T18:52:56.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.837+0000 7f371ffff700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 0x7f37200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:56.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.837+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3730081db0 con 0x7f37380f9690 2022-02-02T18:52:56.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.837+0000 7f37377fe700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 0x7f37200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:56.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.838+0000 7f37377fe700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 0x7f37200672e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f372c004e30 tx=0x7f372c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:56.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:56.841+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f373004fe60 con 0x7f37380f9690 2022-02-02T18:52:57.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.075+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3738045ad0 con 0x7f37380f9690 2022-02-02T18:52:57.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.076+0000 7f371ffff700 1 -- 172.21.15.96:0/1652878808 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3730018070 con 0x7f37380f9690 2022-02-02T18:52:57.072 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:52:57.072 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:52:57.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:52:57.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:57.073 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:52:57.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:52:57.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:57.074 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:52:57.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:52:57.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:57.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:52:57.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:52:57.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:52:57.075 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:52:57.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:52:57.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:52:57.076 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:52:57.076 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:52:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 msgr2=0x7f37200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 0x7f37200672e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f372c004e30 tx=0x7f372c009b30).stop 2022-02-02T18:52:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 msgr2=0x7f3738107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f373000c790 tx=0x7f3730007d40).stop 2022-02-02T18:52:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 shutdown_connections 2022-02-02T18:52:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3720064e20 0x7f37200672e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3738060310 0x7f3738106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 --2- 172.21.15.96:0/1652878808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37380f9690 0x7f3738107280 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.077+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 >> 172.21.15.96:0/1652878808 conn(0x7f37380f0b90 msgr2=0x7f37380f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.078+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 shutdown_connections 2022-02-02T18:52:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.078+0000 7f373cdad700 1 -- 172.21.15.96:0/1652878808 wait complete. 2022-02-02T18:52:57.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.175+0000 7fef0d629700 1 -- 172.21.15.96:0/3031731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f66d0 msgr2=0x7fef080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.175+0000 7fef0d629700 1 --2- 172.21.15.96:0/3031731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f66d0 0x7fef080f6b30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7feef8004660 tx=0x7feef8009b30).stop 2022-02-02T18:52:57.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 -- 172.21.15.96:0/3031731 shutdown_connections 2022-02-02T18:52:57.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 --2- 172.21.15.96:0/3031731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f66d0 0x7fef080f6b30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 --2- 172.21.15.96:0/3031731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f5430 0x7fef080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 -- 172.21.15.96:0/3031731 >> 172.21.15.96:0/3031731 conn(0x7fef080f0b90 msgr2=0x7fef080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:57.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 -- 172.21.15.96:0/3031731 shutdown_connections 2022-02-02T18:52:57.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 -- 172.21.15.96:0/3031731 wait complete. 2022-02-02T18:52:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 Processor -- start 2022-02-02T18:52:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.176+0000 7fef0d629700 1 -- start start 2022-02-02T18:52:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f66d0 0x7fef0810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080603e0 con 0x7fef080f5430 2022-02-02T18:52:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef08060520 con 0x7fef080f66d0 2022-02-02T18:52:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56538/0 (socket says 172.21.15.96:56538) 2022-02-02T18:52:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 -- 172.21.15.96:0/646472167 learned_addr learned my addr 172.21.15.96:0/646472167 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:52:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef077fe700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f66d0 0x7fef0810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 -- 172.21.15.96:0/646472167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f66d0 msgr2=0x7fef0810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f66d0 0x7fef0810bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 -- 172.21.15.96:0/646472167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8005040 con 0x7fef080f5430 2022-02-02T18:52:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef07fff700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7feefc002700 tx=0x7feefc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc0079c0 con 0x7fef080f5430 2022-02-02T18:52:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0810c4d0 con 0x7fef080f5430 2022-02-02T18:52:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feefc00f040 con 0x7fef080f5430 2022-02-02T18:52:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc014860 con 0x7fef080f5430 2022-02-02T18:52:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.177+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0810ca90 con 0x7fef080f5430 2022-02-02T18:52:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.178+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef08045ad0 con 0x7fef080f5430 2022-02-02T18:52:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.179+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feefc01b060 con 0x7fef080f5430 2022-02-02T18:52:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.180+0000 7fef04ff9700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 0x7feef00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:52:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.180+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feefc081950 con 0x7fef080f5430 2022-02-02T18:52:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.180+0000 7fef077fe700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 0x7feef00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:52:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.180+0000 7fef077fe700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 0x7feef00672e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7feef8004630 tx=0x7feef8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:52:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.185+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feefc04fa00 con 0x7fef080f5430 2022-02-02T18:52:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.387+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fef080fdd70 con 0x7fef080f5430 2022-02-02T18:52:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.387+0000 7fef04ff9700 1 -- 172.21.15.96:0/646472167 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7feefc019070 con 0x7fef080f5430 2022-02-02T18:52:57.383 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:52:57.384 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:52:57.384 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:52:57.384 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:52:57.384 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:57.384 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:52:57.385 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:52:57.385 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:52:57.385 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:52:57.385 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:52:57.385 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:52:57.386 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:52:57.386 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:52:57.386 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:52:57.386 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:52:57.387 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:52:57.387 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:52:57.387 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:52:57.387 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:52:57.387 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:52:57.388 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:52:57.388 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:52:57.388 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:52:57.388 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:52:57.388 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:52:57.389 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:52:57.389 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:52:57.389 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:52:57.389 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:52:57.390 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:52:57.390 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:52:57.390 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:52:57.390 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:57.391 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:52:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:52:57.391 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:57.391 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:57.392 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:52:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 msgr2=0x7feef00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 0x7feef00672e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7feef8004630 tx=0x7feef8009b30).stop 2022-02-02T18:52:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 msgr2=0x7fef08109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:52:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7feefc002700 tx=0x7feefc009d80).stop 2022-02-02T18:52:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 shutdown_connections 2022-02-02T18:52:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feef0064e20 0x7feef00672e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef080f5430 0x7fef08109a20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 --2- 172.21.15.96:0/646472167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef080f66d0 0x7fef0810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:52:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 >> 172.21.15.96:0/646472167 conn(0x7fef080f0b90 msgr2=0x7fef080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:52:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 shutdown_connections 2022-02-02T18:52:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:52:57.390+0000 7fef0d629700 1 -- 172.21.15.96:0/646472167 wait complete. 2022-02-02T18:52:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:52:57.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:57 smithi159 ceph-mon[69013]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1652878808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:57.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/646472167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:52:57.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:57 smithi096 ceph-mon[101353]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:57.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1652878808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:57.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/646472167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:52:58.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:58 smithi159 ceph-mon[69013]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:58.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:58 smithi159 ceph-mon[69013]: pgmap v925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:58.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:58 smithi096 ceph-mon[101353]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:52:58.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:58 smithi096 ceph-mon[101353]: pgmap v925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:52:59.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:59.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:59.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:59.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:52:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:52:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:52:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:52:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:52:59.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:52:59.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:52:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:00.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:00 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:00 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:00.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:00 smithi159 ceph-mon[69013]: pgmap v926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:00.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:00 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:00 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:00.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:00 smithi096 ceph-mon[101353]: pgmap v926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:02.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:02 smithi159 ceph-mon[69013]: pgmap v927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:02.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:02 smithi096 ceph-mon[101353]: pgmap v927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:04.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:04 smithi096 ceph-mon[101353]: pgmap v928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:05.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:04 smithi159 ceph-mon[69013]: pgmap v928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:06.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:06 smithi096 ceph-mon[101353]: pgmap v929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:07.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:06 smithi159 ceph-mon[69013]: pgmap v929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:08.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:08 smithi096 ceph-mon[101353]: pgmap v930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:08 smithi159 ceph-mon[69013]: pgmap v930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:09.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:09.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:09.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:09.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:09.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:09 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:10.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:10.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:10.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:09 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:10.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:10 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:10.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:10 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:10.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:10 smithi096 ceph-mon[101353]: pgmap v931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:10 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:10 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:10 smithi159 ceph-mon[69013]: pgmap v931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:12.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:12 smithi096 ceph-mon[101353]: pgmap v932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:13.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:12 smithi159 ceph-mon[69013]: pgmap v932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:14.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:14 smithi096 ceph-mon[101353]: pgmap v933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:14 smithi159 ceph-mon[69013]: pgmap v933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:16.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:16 smithi096 ceph-mon[101353]: pgmap v934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:16 smithi159 ceph-mon[69013]: pgmap v934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:18.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:18 smithi096 ceph-mon[101353]: pgmap v935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:19.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:18 smithi159 ceph-mon[69013]: pgmap v935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:19.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:19.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:19.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:19 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:20.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:20.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:20.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:19 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:20.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:20 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:20 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:20.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:20 smithi096 ceph-mon[101353]: pgmap v936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:21.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:20 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:20 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:20 smithi159 ceph-mon[69013]: pgmap v936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:23.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:22 smithi159 ceph-mon[69013]: pgmap v937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:22 smithi096 ceph-mon[101353]: pgmap v937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:24 smithi159 ceph-mon[69013]: pgmap v938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:24 smithi096 ceph-mon[101353]: pgmap v938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:26 smithi159 ceph-mon[69013]: pgmap v939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:26 smithi096 ceph-mon[101353]: pgmap v939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:27.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 -- 172.21.15.96:0/3670965980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f5430 msgr2=0x7fb6dc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 --2- 172.21.15.96:0/3670965980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f5850 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fb6cc004660 tx=0x7fb6cc009b30).stop 2022-02-02T18:53:27.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 -- 172.21.15.96:0/3670965980 shutdown_connections 2022-02-02T18:53:27.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 --2- 172.21.15.96:0/3670965980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 --2- 172.21.15.96:0/3670965980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f5850 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 -- 172.21.15.96:0/3670965980 >> 172.21.15.96:0/3670965980 conn(0x7fb6dc0f0b90 msgr2=0x7fb6dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:27.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 -- 172.21.15.96:0/3670965980 shutdown_connections 2022-02-02T18:53:27.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.502+0000 7fb6e252d700 1 -- 172.21.15.96:0/3670965980 wait complete. 2022-02-02T18:53:27.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 Processor -- start 2022-02-02T18:53:27.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 -- start start 2022-02-02T18:53:27.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0f8790 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e252d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0f88d0 con 0x7fb6dc0f5430 2022-02-02T18:53:27.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e0d2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e0d2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56558/0 (socket says 172.21.15.96:56558) 2022-02-02T18:53:27.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e0d2a700 1 -- 172.21.15.96:0/1660536070 learned_addr learned my addr 172.21.15.96:0/1660536070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:27.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.503+0000 7fb6e152b700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e0d2a700 1 -- 172.21.15.96:0/1660536070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f5430 msgr2=0x7fb6dc0f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e0d2a700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e0d2a700 1 -- 172.21.15.96:0/1660536070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc005040 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e0d2a700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fb6d80026d0 tx=0x7fb6d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d80079c0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb6d800f040 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc0f8bb0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d80148b0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.504+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc10edf0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.505+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc045ad0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.506+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb6d8007b20 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.506+0000 7fb6d1ffb700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 0x7fb6c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.506+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb6d8081a30 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.506+0000 7fb6e152b700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 0x7fb6c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.507+0000 7fb6e152b700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 0x7fb6c80672e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fb6cc013690 tx=0x7fb6cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:27.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.510+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb6d804fae0 con 0x7fb6dc0f66d0 2022-02-02T18:53:27.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.689+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6dc05fd30 con 0x7fb6c8064e20 2022-02-02T18:53:27.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.691+0000 7fb6d1ffb700 1 -- 172.21.15.96:0/1660536070 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb6dc05fd30 con 0x7fb6c8064e20 2022-02-02T18:53:27.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.692+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 msgr2=0x7fb6c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.692+0000 7fb6e252d700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 0x7fb6c80672e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fb6cc013690 tx=0x7fb6cc009b30).stop 2022-02-02T18:53:27.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.692+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 msgr2=0x7fb6dc0f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.692+0000 7fb6e252d700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fb6d80026d0 tx=0x7fb6d8009de0).stop 2022-02-02T18:53:27.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 shutdown_connections 2022-02-02T18:53:27.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064e20 0x7fb6c80672e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6dc0f5430 0x7fb6dc0f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 --2- 172.21.15.96:0/1660536070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6dc0f66d0 0x7fb6dc0f8230 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 >> 172.21.15.96:0/1660536070 conn(0x7fb6dc0f0b90 msgr2=0x7fb6dc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:27.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 shutdown_connections 2022-02-02T18:53:27.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.693+0000 7fb6e252d700 1 -- 172.21.15.96:0/1660536070 wait complete. 2022-02-02T18:53:27.697 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:53:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 -- 172.21.15.96:0/3245433057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 msgr2=0x7fbf840f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3245433057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf840f6b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fbf80004660 tx=0x7fbf80009b30).stop 2022-02-02T18:53:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 -- 172.21.15.96:0/3245433057 shutdown_connections 2022-02-02T18:53:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3245433057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 0x7fbf840f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3245433057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf840f6b00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 -- 172.21.15.96:0/3245433057 >> 172.21.15.96:0/3245433057 conn(0x7fbf840f1e40 msgr2=0x7fbf840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:27.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:53:27.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:53:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 -- 172.21.15.96:0/3245433057 shutdown_connections 2022-02-02T18:53:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.791+0000 7fbf8c654700 1 -- 172.21.15.96:0/3245433057 wait complete. 2022-02-02T18:53:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 Processor -- start 2022-02-02T18:53:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 -- start start 2022-02-02T18:53:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 0x7fbf84069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8406a380 con 0x7fbf840f66e0 2022-02-02T18:53:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8c654700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8406a4c0 con 0x7fbf840f7980 2022-02-02T18:53:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56566/0 (socket says 172.21.15.96:56566) 2022-02-02T18:53:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 -- 172.21.15.96:0/3022925509 learned_addr learned my addr 172.21.15.96:0/3022925509 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf89bef700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 0x7fbf84069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 -- 172.21.15.96:0/3022925509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 msgr2=0x7fbf84069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 0x7fbf84069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 -- 172.21.15.96:0/3022925509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80005040 con 0x7fbf840f66e0 2022-02-02T18:53:27.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.792+0000 7fbf8a3f0700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fbf80013a70 tx=0x7fbf80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:27.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.793+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf80018070 con 0x7fbf840f66e0 2022-02-02T18:53:27.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.793+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8406a740 con 0x7fbf840f66e0 2022-02-02T18:53:27.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.793+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf800097d0 con 0x7fbf840f66e0 2022-02-02T18:53:27.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.793+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf8001de80 con 0x7fbf840f66e0 2022-02-02T18:53:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.793+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8406aca0 con 0x7fbf840f66e0 2022-02-02T18:53:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.794+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf84045ad0 con 0x7fbf840f66e0 2022-02-02T18:53:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.794+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbf80007ba0 con 0x7fbf840f66e0 2022-02-02T18:53:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.794+0000 7fbf7affd700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 0x7fbf70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.795+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbf800836a0 con 0x7fbf840f66e0 2022-02-02T18:53:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.795+0000 7fbf89bef700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 0x7fbf70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.795+0000 7fbf89bef700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 0x7fbf70067290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbf74004e20 tx=0x7fbf7400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.799+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbf80051750 con 0x7fbf840f66e0 2022-02-02T18:53:27.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.975+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf840ff020 con 0x7fbf70064dd0 2022-02-02T18:53:27.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.984+0000 7fbf7affd700 1 -- 172.21.15.96:0/3022925509 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbf840ff020 con 0x7fbf70064dd0 2022-02-02T18:53:27.979 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:53:27.979 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (36m) 7m ago 37m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:53:27.980 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (29m) 7m ago 37m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:53:27.980 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (29m) 5m ago 37m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:53:27.980 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (36m) 7m ago 37m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:53:27.980 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (33m) 7m ago 33m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:53:27.980 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (29m) 7m ago 34m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:53:27.981 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (33m) 5m ago 33m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:53:27.981 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (29m) 5m ago 34m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:53:27.981 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (31m) 7m ago 39m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:53:27.981 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (30m) 5m ago 37m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:53:27.982 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (30m) 7m ago 39m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:53:27.982 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (29m) 5m ago 37m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:53:27.982 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (37m) 7m ago 37m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:53:27.983 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (37m) 5m ago 37m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:53:27.983 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (28m) 7m ago 36m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:53:27.983 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (28m) 7m ago 36m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:53:27.984 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (27m) 7m ago 36m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:53:27.984 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (27m) 5m ago 35m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:53:27.984 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (26m) 5m ago 35m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:53:27.984 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (26m) 5m ago 35m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:53:27.984 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (36m) 7m ago 37m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:53:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 msgr2=0x7fbf70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 0x7fbf70067290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbf74004e20 tx=0x7fbf7400b040).stop 2022-02-02T18:53:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 msgr2=0x7fbf8406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fbf80013a70 tx=0x7fbf80009b30).stop 2022-02-02T18:53:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 shutdown_connections 2022-02-02T18:53:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbf70064dd0 0x7fbf70067290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf840f66e0 0x7fbf8406b9a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 --2- 172.21.15.96:0/3022925509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf840f7980 0x7fbf84069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 >> 172.21.15.96:0/3022925509 conn(0x7fbf840f1e40 msgr2=0x7fbf840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 shutdown_connections 2022-02-02T18:53:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:27.986+0000 7fbf8c654700 1 -- 172.21.15.96:0/3022925509 wait complete. 2022-02-02T18:53:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:53:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:53:28.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 -- 172.21.15.96:0/1641008559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 msgr2=0x7f3a6c0f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/1641008559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c0f6d00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f3a60004660 tx=0x7f3a60009b30).stop 2022-02-02T18:53:28.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 -- 172.21.15.96:0/1641008559 shutdown_connections 2022-02-02T18:53:28.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/1641008559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 0x7f3a6c0f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/1641008559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c0f6d00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 -- 172.21.15.96:0/1641008559 >> 172.21.15.96:0/1641008559 conn(0x7f3a6c0f2020 msgr2=0x7f3a6c0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:28.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 -- 172.21.15.96:0/1641008559 shutdown_connections 2022-02-02T18:53:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.083+0000 7f3a72c5b700 1 -- 172.21.15.96:0/1641008559 wait complete. 2022-02-02T18:53:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 Processor -- start 2022-02-02T18:53:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 -- start start 2022-02-02T18:53:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 0x7f3a6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c06a380 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a72c5b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c06a4c0 con 0x7f3a6c0f7b80 2022-02-02T18:53:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a709f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a709f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56590/0 (socket says 172.21.15.96:56590) 2022-02-02T18:53:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a709f7700 1 -- 172.21.15.96:0/938002719 learned_addr learned my addr 172.21.15.96:0/938002719 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.084+0000 7f3a6bfff700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 0x7f3a6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a709f7700 1 -- 172.21.15.96:0/938002719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 msgr2=0x7f3a6c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a709f7700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 0x7f3a6c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a709f7700 1 -- 172.21.15.96:0/938002719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60005040 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a709f7700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3a60013a70 tx=0x7f3a60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a60018070 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a600097d0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c06a740 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a6001de80 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.085+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c06aca0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.086+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c045ad0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.086+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a60007ba0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.087+0000 7f3a697fa700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 0x7f3a5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.087+0000 7f3a6bfff700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 0x7f3a5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.087+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3a600836b0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.087+0000 7f3a6bfff700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 0x7f3a5c067290 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f3a58004e20 tx=0x7f3a5800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:28.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.091+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a60051760 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.320+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a6c0ff0a0 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.321+0000 7f3a697fa700 1 -- 172.21.15.96:0/938002719 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3a60054d80 con 0x7f3a6c0f68e0 2022-02-02T18:53:28.316 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:53:28.316 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:53:28.317 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:53:28.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:28.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:53:28.317 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:53:28.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:28.318 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:53:28.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:53:28.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:28.319 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:53:28.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:53:28.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:28.319 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:53:28.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:53:28.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:53:28.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:53:28.320 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:53:28.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 msgr2=0x7f3a5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 0x7f3a5c067290 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f3a58004e20 tx=0x7f3a5800b040).stop 2022-02-02T18:53:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 msgr2=0x7f3a6c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3a60013a70 tx=0x7f3a60009b30).stop 2022-02-02T18:53:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 shutdown_connections 2022-02-02T18:53:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a5c064dd0 0x7f3a5c067290 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a6c0f68e0 0x7f3a6c06b9a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 --2- 172.21.15.96:0/938002719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a6c0f7b80 0x7f3a6c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 >> 172.21.15.96:0/938002719 conn(0x7f3a6c0f2020 msgr2=0x7f3a6c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:28.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 shutdown_connections 2022-02-02T18:53:28.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.323+0000 7f3a72c5b700 1 -- 172.21.15.96:0/938002719 wait complete. 2022-02-02T18:53:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.421+0000 7fbc544f2700 1 -- 172.21.15.96:0/732810396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 msgr2=0x7fbc4c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.421+0000 7fbc544f2700 1 --2- 172.21.15.96:0/732810396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c0f7de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fbc3c004660 tx=0x7fbc3c009b30).stop 2022-02-02T18:53:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- 172.21.15.96:0/732810396 shutdown_connections 2022-02-02T18:53:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 --2- 172.21.15.96:0/732810396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c0f7de0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 --2- 172.21.15.96:0/732810396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 0x7fbc4c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:53:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- 172.21.15.96:0/732810396 >> 172.21.15.96:0/732810396 conn(0x7fbc4c0f1e40 msgr2=0x7fbc4c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- 172.21.15.96:0/732810396 shutdown_connections 2022-02-02T18:53:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- 172.21.15.96:0/732810396 wait complete. 2022-02-02T18:53:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 Processor -- start 2022-02-02T18:53:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- start start 2022-02-02T18:53:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 0x7fbc4c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c107ae0 con 0x7fbc4c0f7980 2022-02-02T18:53:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.422+0000 7fbc544f2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c108390 con 0x7fbc4c0f66e0 2022-02-02T18:53:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56602/0 (socket says 172.21.15.96:56602) 2022-02-02T18:53:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 -- 172.21.15.96:0/2205968900 learned_addr learned my addr 172.21.15.96:0/2205968900 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc5228e700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 0x7fbc4c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 -- 172.21.15.96:0/2205968900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 msgr2=0x7fbc4c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 0x7fbc4c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 -- 172.21.15.96:0/2205968900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c005040 con 0x7fbc4c0f7980 2022-02-02T18:53:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc51a8d700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fbc3c009990 tx=0x7fbc3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c018070 con 0x7fbc4c0f7980 2022-02-02T18:53:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbc3c007ca0 con 0x7fbc4c0f7980 2022-02-02T18:53:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c108610 con 0x7fbc4c0f7980 2022-02-02T18:53:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c01c620 con 0x7fbc4c0f7980 2022-02-02T18:53:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.423+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c108b70 con 0x7fbc4c0f7980 2022-02-02T18:53:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.424+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c0f5ad0 con 0x7fbc4c0f7980 2022-02-02T18:53:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.425+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbc3c01d960 con 0x7fbc4c0f7980 2022-02-02T18:53:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.425+0000 7fbc42ffd700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 0x7fbc38067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.425+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbc3c083810 con 0x7fbc4c0f7980 2022-02-02T18:53:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.425+0000 7fbc5228e700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 0x7fbc38067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.426+0000 7fbc5228e700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 0x7fbc38067290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbc4c0f77e0 tx=0x7fbc48008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.430+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbc3c0553b0 con 0x7fbc4c0f7980 2022-02-02T18:53:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.634+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc4c0fef40 con 0x7fbc4c0f7980 2022-02-02T18:53:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.634+0000 7fbc42ffd700 1 -- 172.21.15.96:0/2205968900 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbc3c054fa0 con 0x7fbc4c0f7980 2022-02-02T18:53:28.630 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:53:28.631 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:53:28.631 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:53:28.631 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:53:28.631 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:28.632 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:53:28.632 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:53:28.632 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:53:28.632 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:53:28.633 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:53:28.633 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:53:28.633 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:53:28.633 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:53:28.633 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:53:28.634 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:53:28.634 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:53:28.634 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:53:28.634 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:53:28.635 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:53:28.635 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:53:28.635 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:53:28.635 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:53:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:53:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:53:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:53:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:53:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:53:28.637 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:53:28.637 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:53:28.637 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:53:28.637 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:53:28.637 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:53:28.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:28.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:28.638 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:53:28.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:28.638 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:28.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:28.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.636+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 msgr2=0x7fbc38067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.636+0000 7fbc544f2700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 0x7fbc38067290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbc4c0f77e0 tx=0x7fbc48008040).stop 2022-02-02T18:53:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.636+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 msgr2=0x7fbc4c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.636+0000 7fbc544f2700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fbc3c009990 tx=0x7fbc3c009b30).stop 2022-02-02T18:53:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.636+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 shutdown_connections 2022-02-02T18:53:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc38064dd0 0x7fbc38067290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc4c0f66e0 0x7fbc4c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 --2- 172.21.15.96:0/2205968900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc4c0f7980 0x7fbc4c1074a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 >> 172.21.15.96:0/2205968900 conn(0x7fbc4c0f1e40 msgr2=0x7fbc4c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 shutdown_connections 2022-02-02T18:53:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:28.637+0000 7fbc544f2700 1 -- 172.21.15.96:0/2205968900 wait complete. 2022-02-02T18:53:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:53:28.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:28 smithi096 ceph-mon[101353]: pgmap v940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:28.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/938002719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:29.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:28 smithi159 ceph-mon[69013]: pgmap v940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/938002719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:53:30.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:53:30.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2205968900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:53:30.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:30.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:30.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:30.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:30.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:30.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:29 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:53:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:53:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2205968900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:53:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:30.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:30.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:30.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:30.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:30.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:30.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:29 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:31.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:30 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:30 smithi159 ceph-mon[69013]: pgmap v941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:30 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:30 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:30 smithi096 ceph-mon[101353]: pgmap v941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:30 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:32 smithi159 ceph-mon[69013]: pgmap v942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:33.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:32 smithi096 ceph-mon[101353]: pgmap v942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:35.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:34 smithi159 ceph-mon[69013]: pgmap v943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:35.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:34 smithi096 ceph-mon[101353]: pgmap v943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:37.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:36 smithi159 ceph-mon[69013]: pgmap v944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:37.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:36 smithi096 ceph-mon[101353]: pgmap v944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:39.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:38 smithi159 ceph-mon[69013]: pgmap v945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:39.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:38 smithi096 ceph-mon[101353]: pgmap v945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:40.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:40.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:40.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:40.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:40.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:40.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:39 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:40.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:40.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:40.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:40.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:40.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:40.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:39 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:41.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:40 smithi159 ceph-mon[69013]: pgmap v946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:40 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:40 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:40 smithi096 ceph-mon[101353]: pgmap v946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:40 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:40 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:43.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:42 smithi159 ceph-mon[69013]: pgmap v947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:42 smithi096 ceph-mon[101353]: pgmap v947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:45.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:44 smithi159 ceph-mon[69013]: pgmap v948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:45.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:44 smithi096 ceph-mon[101353]: pgmap v948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:47.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:46 smithi159 ceph-mon[69013]: pgmap v949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:47.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:46 smithi096 ceph-mon[101353]: pgmap v949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:49.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:48 smithi159 ceph-mon[69013]: pgmap v950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:49.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:48 smithi096 ceph-mon[101353]: pgmap v950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:50.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:50.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:50.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:50.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:53:50.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:53:50.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:50.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:50.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:49 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:50.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:50.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:50.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:53:50.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2022-02-02T18:53:50.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:53:50.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:50.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:50.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:49 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:51.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:50 smithi159 ceph-mon[69013]: pgmap v951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:50 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:50 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:51.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:50 smithi096 ceph-mon[101353]: pgmap v951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:51.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:50 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:53:51.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:50 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:53:53.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:52 smithi159 ceph-mon[69013]: pgmap v952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:53.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:52 smithi096 ceph-mon[101353]: pgmap v952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:55.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:54 smithi159 ceph-mon[69013]: pgmap v953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:55.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:54 smithi096 ceph-mon[101353]: pgmap v953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:57.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:56 smithi159 ceph-mon[69013]: pgmap v954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:57.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:56 smithi096 ceph-mon[101353]: pgmap v954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 -- 172.21.15.96:0/3295235293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 msgr2=0x7ff2f40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/3295235293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f40f6b40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff2e4004660 tx=0x7ff2e4009b30).stop 2022-02-02T18:53:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 -- 172.21.15.96:0/3295235293 shutdown_connections 2022-02-02T18:53:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/3295235293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f40f6b40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/3295235293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 0x7ff2f40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 -- 172.21.15.96:0/3295235293 >> 172.21.15.96:0/3295235293 conn(0x7ff2f40f0ba0 msgr2=0x7ff2f40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.743+0000 7ff2f8d76700 1 -- 172.21.15.96:0/3295235293 shutdown_connections 2022-02-02T18:53:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 -- 172.21.15.96:0/3295235293 wait complete. 2022-02-02T18:53:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 Processor -- start 2022-02-02T18:53:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 -- start start 2022-02-02T18:53:58.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 0x7ff2f4109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:58.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:58.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40603e0 con 0x7ff2f40f66e0 2022-02-02T18:53:58.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.744+0000 7ff2f8d76700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4060520 con 0x7ff2f40f5440 2022-02-02T18:53:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56624/0 (socket says 172.21.15.96:56624) 2022-02-02T18:53:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/2691416425 learned_addr learned my addr 172.21.15.96:0/2691416425 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:58.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f37fe700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 0x7ff2f4109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/2691416425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 msgr2=0x7ff2f4109a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 0x7ff2f4109a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 -- 172.21.15.96:0/2691416425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4005040 con 0x7ff2f40f66e0 2022-02-02T18:53:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f2ffd700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff2e4009990 tx=0x7ff2e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:58.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4018070 con 0x7ff2f40f66e0 2022-02-02T18:53:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f410c480 con 0x7ff2f40f66e0 2022-02-02T18:53:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2e4007ba0 con 0x7ff2f40f66e0 2022-02-02T18:53:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e401c3c0 con 0x7ff2f40f66e0 2022-02-02T18:53:58.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.745+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f410c9e0 con 0x7ff2f40f66e0 2022-02-02T18:53:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.746+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4004fa0 con 0x7ff2f40f66e0 2022-02-02T18:53:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.747+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2e401d420 con 0x7ff2f40f66e0 2022-02-02T18:53:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.747+0000 7ff2dbfff700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 0x7ff2dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:58.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.747+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff2e4083660 con 0x7ff2f40f66e0 2022-02-02T18:53:58.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.747+0000 7ff2f37fe700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 0x7ff2dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:58.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.748+0000 7ff2f37fe700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 0x7ff2dc0672e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff2f4060060 tx=0x7ff2e800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:58.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.751+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2e4051770 con 0x7ff2f40f66e0 2022-02-02T18:53:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.930+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d4000bc0 con 0x7ff2dc064e20 2022-02-02T18:53:58.925 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:58 smithi096 ceph-mon[101353]: pgmap v955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.931+0000 7ff2dbfff700 1 -- 172.21.15.96:0/2691416425 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff2d4000bc0 con 0x7ff2dc064e20 2022-02-02T18:53:58.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 msgr2=0x7ff2dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 0x7ff2dc0672e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff2f4060060 tx=0x7ff2e800b040).stop 2022-02-02T18:53:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 msgr2=0x7ff2f410bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff2e4009990 tx=0x7ff2e4009b30).stop 2022-02-02T18:53:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 shutdown_connections 2022-02-02T18:53:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2dc064e20 0x7ff2dc0672e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2f40f5440 0x7ff2f4109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 --2- 172.21.15.96:0/2691416425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f40f66e0 0x7ff2f410bf30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 >> 172.21.15.96:0/2691416425 conn(0x7ff2f40f0ba0 msgr2=0x7ff2f40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 shutdown_connections 2022-02-02T18:53:58.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:58.933+0000 7ff2f8d76700 1 -- 172.21.15.96:0/2691416425 wait complete. 2022-02-02T18:53:58.938 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:53:59.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:58 smithi159 ceph-mon[69013]: pgmap v955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:53:59.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 -- 172.21.15.96:0/4020265810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f66e0 msgr2=0x7f68fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 --2- 172.21.15.96:0/4020265810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f66e0 0x7f68fc0f6b00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f68f0004660 tx=0x7f68f0009b30).stop 2022-02-02T18:53:59.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 -- 172.21.15.96:0/4020265810 shutdown_connections 2022-02-02T18:53:59.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 --2- 172.21.15.96:0/4020265810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f7980 0x7f68fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 --2- 172.21.15.96:0/4020265810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f66e0 0x7f68fc0f6b00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 -- 172.21.15.96:0/4020265810 >> 172.21.15.96:0/4020265810 conn(0x7f68fc0f1e40 msgr2=0x7f68fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 -- 172.21.15.96:0/4020265810 shutdown_connections 2022-02-02T18:53:59.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.030+0000 7f6902d4b700 1 -- 172.21.15.96:0/4020265810 wait complete. 2022-02-02T18:53:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 Processor -- start 2022-02-02T18:53:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 -- start start 2022-02-02T18:53:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f66e0 0x7f68fc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc107a50 con 0x7f68fc0f7980 2022-02-02T18:53:59.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6902d4b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc107b90 con 0x7f68fc0f66e0 2022-02-02T18:53:59.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56634/0 (socket says 172.21.15.96:56634) 2022-02-02T18:53:59.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 -- 172.21.15.96:0/3500148504 learned_addr learned my addr 172.21.15.96:0/3500148504 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:59.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f6900ae7700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f66e0 0x7f68fc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 -- 172.21.15.96:0/3500148504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f66e0 msgr2=0x7f68fc106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f66e0 0x7f68fc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.031+0000 7f68fbfff700 1 -- 172.21.15.96:0/3500148504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0005040 con 0x7f68fc0f7980 2022-02-02T18:53:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f68fbfff700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f68e80026d0 tx=0x7f68e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e8009320 con 0x7f68fc0f7980 2022-02-02T18:53:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc108530 con 0x7f68fc0f7980 2022-02-02T18:53:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68e800f040 con 0x7f68fc0f7980 2022-02-02T18:53:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e80147e0 con 0x7f68fc0f7980 2022-02-02T18:53:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.032+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc108af0 con 0x7f68fc0f7980 2022-02-02T18:53:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.033+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68e8009480 con 0x7f68fc0f7980 2022-02-02T18:53:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.033+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc045ad0 con 0x7f68fc0f7980 2022-02-02T18:53:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.033+0000 7f68f97fa700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 0x7f68ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.034+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f68e8082170 con 0x7f68fc0f7980 2022-02-02T18:53:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.034+0000 7f6900ae7700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 0x7f68ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.034+0000 7f6900ae7700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 0x7f68ec067290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f68f0009da0 tx=0x7f68f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.038+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68e8053c50 con 0x7f68fc0f7980 2022-02-02T18:53:59.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.211+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68fc108d70 con 0x7f68ec064dd0 2022-02-02T18:53:59.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.220+0000 7f68f97fa700 1 -- 172.21.15.96:0/3500148504 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f68fc108d70 con 0x7f68ec064dd0 2022-02-02T18:53:59.215 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:53:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (37m) 7m ago 38m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:53:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (29m) 7m ago 38m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:53:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (29m) 6m ago 37m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:53:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (37m) 7m ago 38m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:53:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (34m) 7m ago 34m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:53:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (30m) 7m ago 34m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:53:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (34m) 6m ago 34m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:53:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (30m) 6m ago 34m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:53:59.218 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (31m) 7m ago 39m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:53:59.218 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (31m) 6m ago 37m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:53:59.218 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (30m) 7m ago 39m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:53:59.218 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (30m) 6m ago 37m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:53:59.218 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (38m) 7m ago 38m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:53:59.219 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (37m) 6m ago 37m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:53:59.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (29m) 7m ago 37m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:53:59.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (28m) 7m ago 36m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:53:59.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (28m) 7m ago 36m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:53:59.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (27m) 6m ago 36m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:53:59.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (27m) 6m ago 36m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:53:59.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (26m) 6m ago 35m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:53:59.220 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (37m) 7m ago 38m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:53:59.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 msgr2=0x7f68ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 0x7f68ec067290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f68f0009da0 tx=0x7f68f0009b30).stop 2022-02-02T18:53:59.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 msgr2=0x7f68fc1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f68e80026d0 tx=0x7f68e8009de0).stop 2022-02-02T18:53:59.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 shutdown_connections 2022-02-02T18:53:59.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68ec064dd0 0x7f68ec067290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68fc0f66e0 0x7f68fc106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 --2- 172.21.15.96:0/3500148504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68fc0f7980 0x7f68fc1074a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 >> 172.21.15.96:0/3500148504 conn(0x7f68fc0f1e40 msgr2=0x7f68fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 shutdown_connections 2022-02-02T18:53:59.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.222+0000 7f6902d4b700 1 -- 172.21.15.96:0/3500148504 wait complete. 2022-02-02T18:53:59.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 -- 172.21.15.96:0/2427124252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f5710 msgr2=0x7f65300f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 --2- 172.21.15.96:0/2427124252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f5710 0x7f65300f5b90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6524004660 tx=0x7f6524009b30).stop 2022-02-02T18:53:59.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 -- 172.21.15.96:0/2427124252 shutdown_connections 2022-02-02T18:53:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 --2- 172.21.15.96:0/2427124252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f5710 0x7f65300f5b90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 --2- 172.21.15.96:0/2427124252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f6a10 0x7f65300f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 -- 172.21.15.96:0/2427124252 >> 172.21.15.96:0/2427124252 conn(0x7f65300f0320 msgr2=0x7f65300f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 -- 172.21.15.96:0/2427124252 shutdown_connections 2022-02-02T18:53:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.319+0000 7f6534989700 1 -- 172.21.15.96:0/2427124252 wait complete. 2022-02-02T18:53:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 Processor -- start 2022-02-02T18:53:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 -- start start 2022-02-02T18:53:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 0x7f6530106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530107900 con 0x7f65300f6a10 2022-02-02T18:53:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f6534989700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530108110 con 0x7f65300f5710 2022-02-02T18:53:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f652e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f652e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56644/0 (socket says 172.21.15.96:56644) 2022-02-02T18:53:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.320+0000 7f652e59c700 1 -- 172.21.15.96:0/4045399206 learned_addr learned my addr 172.21.15.96:0/4045399206 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652ed9d700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 0x7f6530106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652e59c700 1 -- 172.21.15.96:0/4045399206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 msgr2=0x7f6530106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652e59c700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 0x7f6530106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652e59c700 1 -- 172.21.15.96:0/4045399206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524005040 con 0x7f65300f6a10 2022-02-02T18:53:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652ed9d700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 0x7f6530106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:53:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f652e59c700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6524013a70 tx=0x7f6524009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6524018070 con 0x7f65300f6a10 2022-02-02T18:53:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65240097d0 con 0x7f65300f6a10 2022-02-02T18:53:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6530108330 con 0x7f65300f6a10 2022-02-02T18:53:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652401c3c0 con 0x7f65300f6a10 2022-02-02T18:53:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.321+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6530108890 con 0x7f65300f6a10 2022-02-02T18:53:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.322+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6530059100 con 0x7f65300f6a10 2022-02-02T18:53:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.322+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6524007ba0 con 0x7f65300f6a10 2022-02-02T18:53:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.323+0000 7f65177fe700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 0x7f65180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.323+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6524083760 con 0x7f65300f6a10 2022-02-02T18:53:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.323+0000 7f652ed9d700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 0x7f65180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.323+0000 7f652ed9d700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 0x7f65180672e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f6530106b80 tx=0x7f6520009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.327+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65240518d0 con 0x7f65300f6a10 2022-02-02T18:53:59.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.566+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f653010d350 con 0x7f65300f6a10 2022-02-02T18:53:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.567+0000 7f65177fe700 1 -- 172.21.15.96:0/4045399206 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6524054ef0 con 0x7f65300f6a10 2022-02-02T18:53:59.562 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:53:59.563 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:53:59.563 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:53:59.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:59.563 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:53:59.564 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:53:59.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:59.564 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:53:59.564 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:53:59.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:59.565 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:53:59.565 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:53:59.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:53:59.565 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:53:59.565 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:53:59.566 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:53:59.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:53:59.566 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:53:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 msgr2=0x7f65180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 0x7f65180672e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f6530106b80 tx=0x7f6520009c00).stop 2022-02-02T18:53:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 msgr2=0x7f6530107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6524013a70 tx=0x7f6524009b30).stop 2022-02-02T18:53:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 shutdown_connections 2022-02-02T18:53:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6518064e20 0x7f65180672e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65300f5710 0x7f6530106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 --2- 172.21.15.96:0/4045399206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65300f6a10 0x7f6530107300 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 >> 172.21.15.96:0/4045399206 conn(0x7f65300f0320 msgr2=0x7f65300f4600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 shutdown_connections 2022-02-02T18:53:59.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.569+0000 7f6534989700 1 -- 172.21.15.96:0/4045399206 wait complete. 2022-02-02T18:53:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/328716115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f77d0 msgr2=0x7f1cf40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/328716115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f77d0 0x7f1cf40f7c30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1ce4004660 tx=0x7f1ce4009b30).stop 2022-02-02T18:53:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/328716115 shutdown_connections 2022-02-02T18:53:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/328716115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f77d0 0x7f1cf40f7c30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/328716115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f6530 0x7f1cf40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/328716115 >> 172.21.15.96:0/328716115 conn(0x7f1cf40f1c90 msgr2=0x7f1cf40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/328716115 shutdown_connections 2022-02-02T18:53:59.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/328716115 wait complete. 2022-02-02T18:53:59.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.672+0000 7f1cf8d5c700 1 Processor -- start 2022-02-02T18:53:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf8d5c700 1 -- start start 2022-02-02T18:53:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf8d5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf8d5c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f77d0 0x7f1cf4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf8d5c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf406a380 con 0x7f1cf40f6530 2022-02-02T18:53:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf8d5c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf406a4c0 con 0x7f1cf40f77d0 2022-02-02T18:53:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56652/0 (socket says 172.21.15.96:56652) 2022-02-02T18:53:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 -- 172.21.15.96:0/3545913763 learned_addr learned my addr 172.21.15.96:0/3545913763 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:53:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf2ffd700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f77d0 0x7f1cf4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 -- 172.21.15.96:0/3545913763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f77d0 msgr2=0x7f1cf4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f77d0 0x7f1cf4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 -- 172.21.15.96:0/3545913763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4005040 con 0x7f1cf40f6530 2022-02-02T18:53:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.673+0000 7f1cf37fe700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f1cdc002700 tx=0x7f1cdc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.674+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc0079c0 con 0x7f1cf40f6530 2022-02-02T18:53:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.674+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf406a7a0 con 0x7f1cf40f6530 2022-02-02T18:53:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.674+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1cdc00f040 con 0x7f1cf40f6530 2022-02-02T18:53:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.674+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc014860 con 0x7f1cf40f6530 2022-02-02T18:53:59.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.674+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf410ed50 con 0x7f1cf40f6530 2022-02-02T18:53:59.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.675+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf4045ad0 con 0x7f1cf40f6530 2022-02-02T18:53:59.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.675+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1cdc01b060 con 0x7f1cf40f6530 2022-02-02T18:53:59.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.676+0000 7f1cebfff700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 0x7f1ce00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:53:59.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.676+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1cdc081970 con 0x7f1cf40f6530 2022-02-02T18:53:59.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.676+0000 7f1cf2ffd700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 0x7f1ce00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:53:59.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.676+0000 7f1cf2ffd700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 0x7f1ce00672e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1ce4004630 tx=0x7f1ce4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:53:59.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.680+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1cdc04fb00 con 0x7f1cf40f6530 2022-02-02T18:53:59.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:59.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:59.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:59 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:59.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:53:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4045399206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:53:59.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.896+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cf40fedf0 con 0x7f1cf40f6530 2022-02-02T18:53:59.892 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:53:59.892 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:53:59.892 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:53:59.893 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:53:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:59.893 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:53:59.894 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:53:59.894 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:53:59.894 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:53:59.894 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:53:59.895 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:53:59.895 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:53:59.895 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:53:59.895 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:53:59.896 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:53:59.896 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:53:59.896 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:53:59.896 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:53:59.897 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:53:59.897 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:53:59.897 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:53:59.897 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:53:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:53:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:53:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:53:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:53:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:53:59.899 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:53:59.899 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:53:59.899 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:53:59.899 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:53:59.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:53:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:59.900 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:53:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:53:59.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:59.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:59.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:53:59.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.897+0000 7f1cebfff700 1 -- 172.21.15.96:0/3545913763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1cdc019070 con 0x7f1cf40f6530 2022-02-02T18:53:59.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 msgr2=0x7f1ce00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 0x7f1ce00672e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1ce4004630 tx=0x7f1ce4009b30).stop 2022-02-02T18:53:59.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 msgr2=0x7f1cf406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:53:59.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f1cdc002700 tx=0x7f1cdc009d80).stop 2022-02-02T18:53:59.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 shutdown_connections 2022-02-02T18:53:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ce0064e20 0x7f1ce00672e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cf40f6530 0x7f1cf406b9a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 --2- 172.21.15.96:0/3545913763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cf40f77d0 0x7f1cf4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:53:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 >> 172.21.15.96:0/3545913763 conn(0x7f1cf40f1c90 msgr2=0x7f1cf40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:53:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 shutdown_connections 2022-02-02T18:53:59.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:53:59.899+0000 7f1cf8d5c700 1 -- 172.21.15.96:0/3545913763 wait complete. 2022-02-02T18:53:59.906 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:53:59.954 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:53:59.955 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:53:59.955 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:59 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:53:59.955 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:53:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4045399206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: pgmap v956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:01.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3545913763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:54:01.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:01.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:01.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: pgmap v956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3545913763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:54:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:01.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:01.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:02.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:01 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:02.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:01 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:03.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:02 smithi159 ceph-mon[69013]: pgmap v957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:02 smithi096 ceph-mon[101353]: pgmap v957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:05.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:04 smithi159 ceph-mon[69013]: pgmap v958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:05.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:04 smithi096 ceph-mon[101353]: pgmap v958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:06 smithi159 ceph-mon[69013]: pgmap v959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:07.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:06 smithi096 ceph-mon[101353]: pgmap v959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:08 smithi159 ceph-mon[69013]: pgmap v960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:09.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:08 smithi096 ceph-mon[101353]: pgmap v960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: pgmap v961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:11.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:11.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:11.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:11.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:11.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: pgmap v961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:11.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:11.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:11.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:11.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:12.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:11 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:12.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:11 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:12.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:11 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:12.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:11 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:13.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:12 smithi159 ceph-mon[69013]: pgmap v962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:13.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:12 smithi096 ceph-mon[101353]: pgmap v962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:15.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:14 smithi159 ceph-mon[69013]: pgmap v963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:15.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:14 smithi096 ceph-mon[101353]: pgmap v963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:16 smithi159 ceph-mon[69013]: pgmap v964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:17.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:16 smithi096 ceph-mon[101353]: pgmap v964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:18 smithi159 ceph-mon[69013]: pgmap v965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:18 smithi096 ceph-mon[101353]: pgmap v965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:21.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: pgmap v966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:20 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: pgmap v966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:21.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:21.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:20 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:22.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:21 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:22.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:21 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:22.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:21 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:22.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:21 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:22 smithi159 ceph-mon[69013]: pgmap v967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:22 smithi096 ceph-mon[101353]: pgmap v967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:25.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:24 smithi159 ceph-mon[69013]: pgmap v968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:24 smithi096 ceph-mon[101353]: pgmap v968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:26.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:26 smithi159 ceph-mon[69013]: pgmap v969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:26.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:26 smithi096 ceph-mon[101353]: pgmap v969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:27.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:54:27.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:54:27.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:54:27.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:54:28.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:28 smithi159 ceph-mon[69013]: pgmap v970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:28.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:28 smithi096 ceph-mon[101353]: pgmap v970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 -- 172.21.15.96:0/4074415008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f55c0 msgr2=0x7f726c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 --2- 172.21.15.96:0/4074415008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f55c0 0x7f726c0f59e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f725c004660 tx=0x7f725c009b30).stop 2022-02-02T18:54:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 -- 172.21.15.96:0/4074415008 shutdown_connections 2022-02-02T18:54:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 --2- 172.21.15.96:0/4074415008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f6860 0x7f726c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 --2- 172.21.15.96:0/4074415008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f55c0 0x7f726c0f59e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 -- 172.21.15.96:0/4074415008 >> 172.21.15.96:0/4074415008 conn(0x7f726c0f0d40 msgr2=0x7f726c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 -- 172.21.15.96:0/4074415008 shutdown_connections 2022-02-02T18:54:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.012+0000 7f727280c700 1 -- 172.21.15.96:0/4074415008 wait complete. 2022-02-02T18:54:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 Processor -- start 2022-02-02T18:54:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 -- start start 2022-02-02T18:54:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f55c0 0x7f726c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0603c0 con 0x7f726c0f6860 2022-02-02T18:54:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f727280c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c060500 con 0x7f726c0f55c0 2022-02-02T18:54:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f726b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f726b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56672/0 (socket says 172.21.15.96:56672) 2022-02-02T18:54:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.013+0000 7f726b7fe700 1 -- 172.21.15.96:0/3359653011 learned_addr learned my addr 172.21.15.96:0/3359653011 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:54:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f726bfff700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f55c0 0x7f726c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f726b7fe700 1 -- 172.21.15.96:0/3359653011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f55c0 msgr2=0x7f726c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f726b7fe700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f55c0 0x7f726c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f726b7fe700 1 -- 172.21.15.96:0/3359653011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c005040 con 0x7f726c0f6860 2022-02-02T18:54:30.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f726b7fe700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f726000c530 tx=0x7f7260007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f726000f650 con 0x7f726c0f6860 2022-02-02T18:54:30.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c10c740 con 0x7f726c0f6860 2022-02-02T18:54:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f726000fc60 con 0x7f726c0f6860 2022-02-02T18:54:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7260012cd0 con 0x7f726c0f6860 2022-02-02T18:54:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.014+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c10ccd0 con 0x7f726c0f6860 2022-02-02T18:54:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.016+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0f49b0 con 0x7f726c0f6860 2022-02-02T18:54:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.016+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7260010070 con 0x7f726c0f6860 2022-02-02T18:54:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.016+0000 7f7268ff9700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 0x7f7254067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.016+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7260081720 con 0x7f726c0f6860 2022-02-02T18:54:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.016+0000 7f726bfff700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 0x7f7254067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.017+0000 7f726bfff700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 0x7f7254067290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f725c004e30 tx=0x7f725c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.020+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72600477d0 con 0x7f726c0f6860 2022-02-02T18:54:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.201+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f726c0fdf00 con 0x7f7254064dd0 2022-02-02T18:54:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.202+0000 7f7268ff9700 1 -- 172.21.15.96:0/3359653011 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f726c0fdf00 con 0x7f7254064dd0 2022-02-02T18:54:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 msgr2=0x7f7254067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 0x7f7254067290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f725c004e30 tx=0x7f725c009b30).stop 2022-02-02T18:54:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 msgr2=0x7f726c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f726000c530 tx=0x7f7260007e20).stop 2022-02-02T18:54:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 shutdown_connections 2022-02-02T18:54:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7254064dd0 0x7f7254067290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f726c0f55c0 0x7f726c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 --2- 172.21.15.96:0/3359653011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f726c0f6860 0x7f726c10c190 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 >> 172.21.15.96:0/3359653011 conn(0x7f726c0f0d40 msgr2=0x7f726c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 shutdown_connections 2022-02-02T18:54:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.204+0000 7f727280c700 1 -- 172.21.15.96:0/3359653011 wait complete. 2022-02-02T18:54:30.210 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:54:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 -- 172.21.15.96:0/417466444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 msgr2=0x7f5cdc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/417466444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc0f7de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f5ccc004660 tx=0x7f5ccc009b30).stop 2022-02-02T18:54:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 -- 172.21.15.96:0/417466444 shutdown_connections 2022-02-02T18:54:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/417466444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc0f7de0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/417466444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:54:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 -- 172.21.15.96:0/417466444 >> 172.21.15.96:0/417466444 conn(0x7f5cdc0f1e40 msgr2=0x7f5cdc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 -- 172.21.15.96:0/417466444 shutdown_connections 2022-02-02T18:54:30.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.303+0000 7f5ce12c1700 1 -- 172.21.15.96:0/417466444 wait complete. 2022-02-02T18:54:30.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 Processor -- start 2022-02-02T18:54:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 -- start start 2022-02-02T18:54:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06a410 con 0x7f5cdc0f7980 2022-02-02T18:54:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5ce12c1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06a550 con 0x7f5cdc0f66e0 2022-02-02T18:54:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cda7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cda7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56682/0 (socket says 172.21.15.96:56682) 2022-02-02T18:54:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cda7fc700 1 -- 172.21.15.96:0/362129047 learned_addr learned my addr 172.21.15.96:0/362129047 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:54:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cdaffd700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cda7fc700 1 -- 172.21.15.96:0/362129047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 msgr2=0x7f5cdc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.304+0000 7f5cda7fc700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cda7fc700 1 -- 172.21.15.96:0/362129047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc005040 con 0x7f5cdc0f7980 2022-02-02T18:54:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cdaffd700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:54:30.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cda7fc700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5ccc009990 tx=0x7f5ccc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ccc018070 con 0x7f5cdc0f7980 2022-02-02T18:54:30.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc06a7d0 con 0x7f5cdc0f7980 2022-02-02T18:54:30.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc10efe0 con 0x7f5cdc0f7980 2022-02-02T18:54:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5ccc004490 con 0x7f5cdc0f7980 2022-02-02T18:54:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.305+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ccc01c620 con 0x7f5cdc0f7980 2022-02-02T18:54:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.306+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc0004fa0 con 0x7f5cdc0f7980 2022-02-02T18:54:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.306+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5ccc007ca0 con 0x7f5cdc0f7980 2022-02-02T18:54:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.307+0000 7f5cd37fe700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.307+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5ccc083740 con 0x7f5cdc0f7980 2022-02-02T18:54:30.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.307+0000 7f5cdaffd700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.307+0000 7f5cdaffd700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f5cdc06b730 tx=0x7f5cc4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.312+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5ccc0517f0 con 0x7f5cdc0f7980 2022-02-02T18:54:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.485+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc0000bc0 con 0x7f5cc8064dd0 2022-02-02T18:54:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.495+0000 7f5cd37fe700 1 -- 172.21.15.96:0/362129047 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5cc0000bc0 con 0x7f5cc8064dd0 2022-02-02T18:54:30.491 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:54:30.491 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (37m) 8m ago 38m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:54:30.492 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (30m) 8m ago 38m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:54:30.492 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (30m) 6m ago 38m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:54:30.492 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (37m) 8m ago 38m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:54:30.492 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (34m) 8m ago 34m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:54:30.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (30m) 8m ago 35m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:54:30.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (35m) 6m ago 35m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:54:30.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (30m) 6m ago 35m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:54:30.494 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (32m) 8m ago 40m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:54:30.494 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (31m) 6m ago 38m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:54:30.495 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (31m) 8m ago 40m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:54:30.495 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (30m) 6m ago 38m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:54:30.496 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (38m) 8m ago 38m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:54:30.496 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (38m) 6m ago 38m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:54:30.497 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (29m) 8m ago 37m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:54:30.497 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (29m) 8m ago 37m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:54:30.498 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (28m) 8m ago 37m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:54:30.498 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (28m) 6m ago 36m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:54:30.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (27m) 6m ago 36m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:54:30.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (27m) 6m ago 36m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:54:30.500 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (37m) 8m ago 38m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:54:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 msgr2=0x7f5cc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f5cdc06b730 tx=0x7f5cc4008040).stop 2022-02-02T18:54:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 msgr2=0x7f5cdc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5ccc009990 tx=0x7f5ccc009b30).stop 2022-02-02T18:54:30.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 shutdown_connections 2022-02-02T18:54:30.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 --2- 172.21.15.96:0/362129047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc069e20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 >> 172.21.15.96:0/362129047 conn(0x7f5cdc0f1e40 msgr2=0x7f5cdc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 shutdown_connections 2022-02-02T18:54:30.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.497+0000 7f5ce12c1700 1 -- 172.21.15.96:0/362129047 wait complete. 2022-02-02T18:54:30.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: pgmap v971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:30.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:30.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:30.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:30.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:30.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:30.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:30 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 -- 172.21.15.96:0/3876964255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 msgr2=0x7f68d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 --2- 172.21.15.96:0/3876964255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f59e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f68c8004660 tx=0x7f68c8009b30).stop 2022-02-02T18:54:30.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 -- 172.21.15.96:0/3876964255 shutdown_connections 2022-02-02T18:54:30.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 --2- 172.21.15.96:0/3876964255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:54:30.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 --2- 172.21.15.96:0/3876964255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f59e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 -- 172.21.15.96:0/3876964255 >> 172.21.15.96:0/3876964255 conn(0x7f68d80f0d40 msgr2=0x7f68d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 -- 172.21.15.96:0/3876964255 shutdown_connections 2022-02-02T18:54:30.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 -- 172.21.15.96:0/3876964255 wait complete. 2022-02-02T18:54:30.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.595+0000 7f68ddd23700 1 Processor -- start 2022-02-02T18:54:30.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68ddd23700 1 -- start start 2022-02-02T18:54:30.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68ddd23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68ddd23700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68ddd23700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80f8190 con 0x7f68d80f55c0 2022-02-02T18:54:30.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68ddd23700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80f82d0 con 0x7f68d80f6860 2022-02-02T18:54:30.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56690/0 (socket says 172.21.15.96:56690) 2022-02-02T18:54:30.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 -- 172.21.15.96:0/2036280085 learned_addr learned my addr 172.21.15.96:0/2036280085 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:54:30.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 -- 172.21.15.96:0/2036280085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 msgr2=0x7f68d80f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d6ffd700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 -- 172.21.15.96:0/2036280085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8005040 con 0x7f68d80f55c0 2022-02-02T18:54:30.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d6ffd700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:54:30.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.596+0000 7f68d77fe700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f68c8004f60 tx=0x7f68c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.597+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c8018070 con 0x7f68d80f55c0 2022-02-02T18:54:30.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.597+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68c8007ba0 con 0x7f68d80f55c0 2022-02-02T18:54:30.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.597+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d80f8550 con 0x7f68d80f55c0 2022-02-02T18:54:30.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.597+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d810efc0 con 0x7f68d80f55c0 2022-02-02T18:54:30.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.597+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c801c620 con 0x7f68d80f55c0 2022-02-02T18:54:30.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.598+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d8045ad0 con 0x7f68d80f55c0 2022-02-02T18:54:30.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.598+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68c801d420 con 0x7f68d80f55c0 2022-02-02T18:54:30.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.599+0000 7f68cffff700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 0x7f68c4067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.599+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f68c8083990 con 0x7f68d80f55c0 2022-02-02T18:54:30.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.599+0000 7f68d6ffd700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 0x7f68c4067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.599+0000 7f68d6ffd700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 0x7f68c4067230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f68c000a880 tx=0x7f68c0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.603+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68c8051a40 con 0x7f68d80f55c0 2022-02-02T18:54:30.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: pgmap v971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:30.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:30 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.834+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68d810f760 con 0x7f68d80f55c0 2022-02-02T18:54:30.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.834+0000 7f68cffff700 1 -- 172.21.15.96:0/2036280085 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f68c8055060 con 0x7f68d80f55c0 2022-02-02T18:54:30.830 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:54:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:54:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:54:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:54:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:54:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:54:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:54:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:54:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:54:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:54:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:54:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:54:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:54:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:54:30.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:54:30.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:54:30.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:54:30.834 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:54:30.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 msgr2=0x7f68c4067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 0x7f68c4067230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f68c000a880 tx=0x7f68c0008040).stop 2022-02-02T18:54:30.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 msgr2=0x7f68d80f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f68c8004f60 tx=0x7f68c8009b30).stop 2022-02-02T18:54:30.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 shutdown_connections 2022-02-02T18:54:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c4064d70 0x7f68c4067230 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d80f55c0 0x7f68d80f9720 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 --2- 172.21.15.96:0/2036280085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d80f6860 0x7f68d80f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 >> 172.21.15.96:0/2036280085 conn(0x7f68d80f0d40 msgr2=0x7f68d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 shutdown_connections 2022-02-02T18:54:30.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.836+0000 7f68ddd23700 1 -- 172.21.15.96:0/2036280085 wait complete. 2022-02-02T18:54:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 -- 172.21.15.96:0/1720821999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 msgr2=0x7fd1100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1720821999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd1100f59e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fd100004660 tx=0x7fd100009b30).stop 2022-02-02T18:54:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 -- 172.21.15.96:0/1720821999 shutdown_connections 2022-02-02T18:54:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1720821999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1100f6860 0x7fd1100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1720821999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd1100f59e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 -- 172.21.15.96:0/1720821999 >> 172.21.15.96:0/1720821999 conn(0x7fd1100f0d40 msgr2=0x7fd1100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 -- 172.21.15.96:0/1720821999 shutdown_connections 2022-02-02T18:54:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.934+0000 7fd1172f9700 1 -- 172.21.15.96:0/1720821999 wait complete. 2022-02-02T18:54:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 Processor -- start 2022-02-02T18:54:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 -- start start 2022-02-02T18:54:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1100f6860 0x7fd11010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100603e0 con 0x7fd1100f55c0 2022-02-02T18:54:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd1172f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110060520 con 0x7fd1100f6860 2022-02-02T18:54:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56704/0 (socket says 172.21.15.96:56704) 2022-02-02T18:54:30.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 -- 172.21.15.96:0/1623381604 learned_addr learned my addr 172.21.15.96:0/1623381604 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:54:30.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 -- 172.21.15.96:0/1623381604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1100f6860 msgr2=0x7fd11010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:30.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1100f6860 0x7fd11010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:54:30.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.935+0000 7fd115095700 1 -- 172.21.15.96:0/1623381604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100005040 con 0x7fd1100f55c0 2022-02-02T18:54:30.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd115095700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fd100013a70 tx=0x7fd100009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd100018070 con 0x7fd1100f55c0 2022-02-02T18:54:30.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1000097d0 con 0x7fd1100f55c0 2022-02-02T18:54:30.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11010c700 con 0x7fd1100f55c0 2022-02-02T18:54:30.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10001c3c0 con 0x7fd1100f55c0 2022-02-02T18:54:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.936+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11010cc60 con 0x7fd1100f55c0 2022-02-02T18:54:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.937+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110045ad0 con 0x7fd1100f55c0 2022-02-02T18:54:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.938+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd100007ba0 con 0x7fd1100f55c0 2022-02-02T18:54:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.938+0000 7fd105ffb700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:54:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.938+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd100083690 con 0x7fd1100f55c0 2022-02-02T18:54:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.938+0000 7fd114894700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:54:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.939+0000 7fd114894700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd10c004a10 tx=0x7fd10c0099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:54:30.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:30.942+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd100051800 con 0x7fd1100f55c0 2022-02-02T18:54:31.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.144+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd1100fdee0 con 0x7fd1100f55c0 2022-02-02T18:54:31.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.144+0000 7fd105ffb700 1 -- 172.21.15.96:0/1623381604 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd100054e20 con 0x7fd1100f55c0 2022-02-02T18:54:31.141 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:54:31.141 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:54:31.141 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:54:31.141 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:54:31.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:54:31.142 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:54:31.142 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:54:31.142 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:54:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:54:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:54:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:54:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:54:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:54:31.144 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:54:31.144 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:54:31.144 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:54:31.144 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:54:31.145 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:54:31.145 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:54:31.145 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:54:31.145 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:54:31.146 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:54:31.146 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:54:31.146 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:54:31.146 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:54:31.146 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:54:31.151 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:54:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:54:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:54:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:54:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:54:31.153 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:54:31.153 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:54:31.153 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:54:31.153 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:54:31.154 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:54:31.154 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:54:31.154 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:54:31.154 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:54:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 msgr2=0x7fd0fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd10c004a10 tx=0x7fd10c0099e0).stop 2022-02-02T18:54:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 msgr2=0x7fd110109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:54:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fd100013a70 tx=0x7fd100009b30).stop 2022-02-02T18:54:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 shutdown_connections 2022-02-02T18:54:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1100f55c0 0x7fd110109cb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:54:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 --2- 172.21.15.96:0/1623381604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1100f6860 0x7fd11010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:54:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 >> 172.21.15.96:0/1623381604 conn(0x7fd1100f0d40 msgr2=0x7fd1100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:54:31.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 shutdown_connections 2022-02-02T18:54:31.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:54:31.146+0000 7fd1172f9700 1 -- 172.21.15.96:0/1623381604 wait complete. 2022-02-02T18:54:31.158 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:54:31.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:31.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:31.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:31.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:31.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2036280085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:31.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1623381604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:54:31.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:31.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:31.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:31.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:54:31.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2036280085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:31.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1623381604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:54:32.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:32 smithi159 ceph-mon[69013]: pgmap v972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:32.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:32 smithi096 ceph-mon[101353]: pgmap v972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:34.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:34 smithi159 ceph-mon[69013]: pgmap v973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:34.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:34 smithi096 ceph-mon[101353]: pgmap v973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:36.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:36 smithi159 ceph-mon[69013]: pgmap v974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:36.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:36 smithi096 ceph-mon[101353]: pgmap v974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:38.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:38 smithi159 ceph-mon[69013]: pgmap v975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:38.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:38 smithi096 ceph-mon[101353]: pgmap v975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:40.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: pgmap v976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:40.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.771 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:40 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: pgmap v976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:40.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:40.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:40 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:41.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:41 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:41.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:41 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:42.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:41 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:41 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:42.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:42 smithi096 ceph-mon[101353]: pgmap v977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:43.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:42 smithi159 ceph-mon[69013]: pgmap v977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:44.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:44 smithi096 ceph-mon[101353]: pgmap v978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:45.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:44 smithi159 ceph-mon[69013]: pgmap v978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:46.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:46 smithi096 ceph-mon[101353]: pgmap v979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:47.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:46 smithi159 ceph-mon[69013]: pgmap v979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:48.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:48 smithi096 ceph-mon[101353]: pgmap v980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:49.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:48 smithi159 ceph-mon[69013]: pgmap v980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:50.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: pgmap v981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:50.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:50.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:50.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:50 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:51.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: pgmap v981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:54:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:54:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:54:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:54:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:51.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:50 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:54:51.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:51 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:51.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:51 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:52.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:51 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:54:52.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:51 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:54:52.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:52 smithi096 ceph-mon[101353]: pgmap v982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:53.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:52 smithi159 ceph-mon[69013]: pgmap v982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:54.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:54 smithi096 ceph-mon[101353]: pgmap v983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:55.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:54 smithi159 ceph-mon[69013]: pgmap v983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:56.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:56 smithi096 ceph-mon[101353]: pgmap v984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:57.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:56 smithi159 ceph-mon[69013]: pgmap v984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:59.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:54:58 smithi159 ceph-mon[69013]: pgmap v985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:54:59.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:54:58 smithi096 ceph-mon[101353]: pgmap v985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:01.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:00 smithi159 ceph-mon[69013]: pgmap v986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:00 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:00 smithi096 ceph-mon[101353]: pgmap v986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:00 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:01.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 -- 172.21.15.96:0/1293405491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 msgr2=0x7f48cc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 --2- 172.21.15.96:0/1293405491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc0f6b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f48c0004660 tx=0x7f48c0009b30).stop 2022-02-02T18:55:01.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 -- 172.21.15.96:0/1293405491 shutdown_connections 2022-02-02T18:55:01.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 --2- 172.21.15.96:0/1293405491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 0x7f48cc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 --2- 172.21.15.96:0/1293405491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc0f6b00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 -- 172.21.15.96:0/1293405491 >> 172.21.15.96:0/1293405491 conn(0x7f48cc0f1e40 msgr2=0x7f48cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:01.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 -- 172.21.15.96:0/1293405491 shutdown_connections 2022-02-02T18:55:01.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.251+0000 7f48d0c61700 1 -- 172.21.15.96:0/1293405491 wait complete. 2022-02-02T18:55:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 Processor -- start 2022-02-02T18:55:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 -- start start 2022-02-02T18:55:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 0x7f48cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06a380 con 0x7f48cc0f66e0 2022-02-02T18:55:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48d0c61700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06a4c0 con 0x7f48cc0f7980 2022-02-02T18:55:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56726/0 (socket says 172.21.15.96:56726) 2022-02-02T18:55:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 -- 172.21.15.96:0/905809291 learned_addr learned my addr 172.21.15.96:0/905809291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48c9d9b700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 0x7f48cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 -- 172.21.15.96:0/905809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 msgr2=0x7f48cc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 0x7f48cc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 -- 172.21.15.96:0/905809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0005040 con 0x7f48cc0f66e0 2022-02-02T18:55:01.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48ca59c700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f48c0004f60 tx=0x7f48c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c0018070 con 0x7f48cc0f66e0 2022-02-02T18:55:01.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.252+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f48c0007ba0 con 0x7f48cc0f66e0 2022-02-02T18:55:01.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.253+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc06a740 con 0x7f48cc0f66e0 2022-02-02T18:55:01.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.253+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c001c620 con 0x7f48cc0f66e0 2022-02-02T18:55:01.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.253+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc06aca0 con 0x7f48cc0f66e0 2022-02-02T18:55:01.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.253+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc045ad0 con 0x7f48cc0f66e0 2022-02-02T18:55:01.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.254+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f48c001c8e0 con 0x7f48cc0f66e0 2022-02-02T18:55:01.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.254+0000 7f48baffd700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 0x7f48b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.254+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f48c0083a30 con 0x7f48cc0f66e0 2022-02-02T18:55:01.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.254+0000 7f48c9d9b700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 0x7f48b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.255+0000 7f48c9d9b700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 0x7f48b4067290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f48bc0041d0 tx=0x7f48bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.259+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f48c0051a60 con 0x7f48cc0f66e0 2022-02-02T18:55:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.435+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48cc0ff010 con 0x7f48b4064dd0 2022-02-02T18:55:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.436+0000 7f48baffd700 1 -- 172.21.15.96:0/905809291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f48cc0ff010 con 0x7f48b4064dd0 2022-02-02T18:55:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 msgr2=0x7f48b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 0x7f48b4067290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f48bc0041d0 tx=0x7f48bc009040).stop 2022-02-02T18:55:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 msgr2=0x7f48cc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f48c0004f60 tx=0x7f48c0009b30).stop 2022-02-02T18:55:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 shutdown_connections 2022-02-02T18:55:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48b4064dd0 0x7f48b4067290 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48cc0f66e0 0x7f48cc06b9a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 --2- 172.21.15.96:0/905809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48cc0f7980 0x7f48cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 >> 172.21.15.96:0/905809291 conn(0x7f48cc0f1e40 msgr2=0x7f48cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 shutdown_connections 2022-02-02T18:55:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.438+0000 7f48d0c61700 1 -- 172.21.15.96:0/905809291 wait complete. 2022-02-02T18:55:01.443 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:55:01.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 -- 172.21.15.96:0/3012919552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 msgr2=0x7fee600f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 --2- 172.21.15.96:0/3012919552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600f6910 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fee50004660 tx=0x7fee50009b30).stop 2022-02-02T18:55:01.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 -- 172.21.15.96:0/3012919552 shutdown_connections 2022-02-02T18:55:01.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 --2- 172.21.15.96:0/3012919552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600f6910 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 --2- 172.21.15.96:0/3012919552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 0x7fee600f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:55:01.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 -- 172.21.15.96:0/3012919552 >> 172.21.15.96:0/3012919552 conn(0x7fee600f0dd0 msgr2=0x7fee600f31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:01.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 -- 172.21.15.96:0/3012919552 shutdown_connections 2022-02-02T18:55:01.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.536+0000 7fee654f4700 1 -- 172.21.15.96:0/3012919552 wait complete. 2022-02-02T18:55:01.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 Processor -- start 2022-02-02T18:55:01.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 -- start start 2022-02-02T18:55:01.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 0x7fee600fea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600ff600 con 0x7fee600f5ee0 2022-02-02T18:55:01.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee654f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600ffeb0 con 0x7fee600f55d0 2022-02-02T18:55:01.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56738/0 (socket says 172.21.15.96:56738) 2022-02-02T18:55:01.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 -- 172.21.15.96:0/2701965347 learned_addr learned my addr 172.21.15.96:0/2701965347 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:01.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5effd700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 0x7fee600fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 -- 172.21.15.96:0/2701965347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 msgr2=0x7fee600fea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 0x7fee600fea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.537+0000 7fee5e7fc700 1 -- 172.21.15.96:0/2701965347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50005040 con 0x7fee600f5ee0 2022-02-02T18:55:01.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee5e7fc700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fee50009990 tx=0x7fee50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee50018070 con 0x7fee600f5ee0 2022-02-02T18:55:01.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee60100100 con 0x7fee600f5ee0 2022-02-02T18:55:01.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee50007ca0 con 0x7fee600f5ee0 2022-02-02T18:55:01.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee5001c620 con 0x7fee600f5ee0 2022-02-02T18:55:01.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.538+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee60100660 con 0x7fee600f5ee0 2022-02-02T18:55:01.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.539+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee600f4a60 con 0x7fee600f5ee0 2022-02-02T18:55:01.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.539+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee5001d960 con 0x7fee600f5ee0 2022-02-02T18:55:01.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.540+0000 7fee477fe700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 0x7fee48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.540+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee50083820 con 0x7fee600f5ee0 2022-02-02T18:55:01.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.540+0000 7fee5effd700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 0x7fee48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.540+0000 7fee5effd700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 0x7fee48067290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fee600fe810 tx=0x7fee54008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.544+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee50051a40 con 0x7fee600f5ee0 2022-02-02T18:55:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.718+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee600fab50 con 0x7fee48064dd0 2022-02-02T18:55:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.727+0000 7fee477fe700 1 -- 172.21.15.96:0/2701965347 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fee600fab50 con 0x7fee48064dd0 2022-02-02T18:55:01.722 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:55:01.722 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (38m) 9m ago 39m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:55:01.722 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (30m) 9m ago 39m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:55:01.722 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (30m) 7m ago 38m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:55:01.723 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (38m) 9m ago 39m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:55:01.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (35m) 9m ago 35m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:55:01.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (31m) 9m ago 35m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:55:01.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (35m) 7m ago 35m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:55:01.724 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (31m) 7m ago 35m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:55:01.724 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (32m) 9m ago 40m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:55:01.724 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (32m) 7m ago 38m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:55:01.724 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (31m) 9m ago 40m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:55:01.725 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (31m) 7m ago 38m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:55:01.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (39m) 9m ago 39m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:55:01.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (38m) 7m ago 38m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:55:01.725 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (30m) 9m ago 38m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:55:01.725 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (29m) 9m ago 37m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:55:01.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (29m) 9m ago 37m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:55:01.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (28m) 7m ago 37m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:55:01.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (28m) 7m ago 37m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:55:01.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (27m) 7m ago 36m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:55:01.727 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (38m) 9m ago 39m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:55:01.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.728+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 msgr2=0x7fee48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.728+0000 7fee654f4700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 0x7fee48067290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fee600fe810 tx=0x7fee54008040).stop 2022-02-02T18:55:01.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.728+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 msgr2=0x7fee600fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.728+0000 7fee654f4700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fee50009990 tx=0x7fee50009b30).stop 2022-02-02T18:55:01.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 shutdown_connections 2022-02-02T18:55:01.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee48064dd0 0x7fee48067290 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee600f55d0 0x7fee600fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 --2- 172.21.15.96:0/2701965347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee600f5ee0 0x7fee600fef70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 >> 172.21.15.96:0/2701965347 conn(0x7fee600f0dd0 msgr2=0x7fee6005fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:01.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 shutdown_connections 2022-02-02T18:55:01.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.729+0000 7fee654f4700 1 -- 172.21.15.96:0/2701965347 wait complete. 2022-02-02T18:55:01.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:01.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:01.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:01.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:01.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:01.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:01.801 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:01 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:01.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 -- 172.21.15.96:0/2256115759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f66e0 msgr2=0x7f0ae00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/2256115759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f66e0 0x7f0ae00f6b00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f0ad4004660 tx=0x7f0ad4009b30).stop 2022-02-02T18:55:01.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 -- 172.21.15.96:0/2256115759 shutdown_connections 2022-02-02T18:55:01.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/2256115759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f7980 0x7f0ae00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:55:01.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/2256115759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f66e0 0x7f0ae00f6b00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 -- 172.21.15.96:0/2256115759 >> 172.21.15.96:0/2256115759 conn(0x7f0ae00f1e40 msgr2=0x7f0ae00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:01.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 -- 172.21.15.96:0/2256115759 shutdown_connections 2022-02-02T18:55:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.825+0000 7f0ae6f03700 1 -- 172.21.15.96:0/2256115759 wait complete. 2022-02-02T18:55:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 Processor -- start 2022-02-02T18:55:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 -- start start 2022-02-02T18:55:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f66e0 0x7f0ae006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae006a410 con 0x7f0ae00f7980 2022-02-02T18:55:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0ae6f03700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae006a550 con 0x7f0ae00f66e0 2022-02-02T18:55:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0adffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0adffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56748/0 (socket says 172.21.15.96:56748) 2022-02-02T18:55:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.826+0000 7f0adffff700 1 -- 172.21.15.96:0/880494990 learned_addr learned my addr 172.21.15.96:0/880494990 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0ae4c9f700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f66e0 0x7f0ae006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0adffff700 1 -- 172.21.15.96:0/880494990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f66e0 msgr2=0x7f0ae006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0adffff700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f66e0 0x7f0ae006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0adffff700 1 -- 172.21.15.96:0/880494990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4005040 con 0x7f0ae00f7980 2022-02-02T18:55:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0adffff700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f0acc00b410 tx=0x7f0acc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc0125f0 con 0x7f0ae00f7980 2022-02-02T18:55:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae006a830 con 0x7f0ae00f7980 2022-02-02T18:55:01.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0acc012c00 con 0x7f0ae00f7980 2022-02-02T18:55:01.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc002ae0 con 0x7f0ae00f7980 2022-02-02T18:55:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.827+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae010efe0 con 0x7f0ae00f7980 2022-02-02T18:55:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.828+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae0045ad0 con 0x7f0ae00f7980 2022-02-02T18:55:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.828+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0acc00f030 con 0x7f0ae00f7980 2022-02-02T18:55:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.829+0000 7f0add7fa700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 0x7f0ad0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.829+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0acc081f80 con 0x7f0ae00f7980 2022-02-02T18:55:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.829+0000 7f0ae4c9f700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 0x7f0ad0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.829+0000 7f0ae4c9f700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 0x7f0ad0067290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f0ad4004e30 tx=0x7f0ad4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:01.833+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0acc050110 con 0x7f0ae00f7980 2022-02-02T18:55:02.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:02.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:02.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:02.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:02.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:02.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:02.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:02.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:01 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.063+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ae0027a00 con 0x7f0ae00f7980 2022-02-02T18:55:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.063+0000 7f0add7fa700 1 -- 172.21.15.96:0/880494990 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0acc053730 con 0x7f0ae00f7980 2022-02-02T18:55:02.060 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:55:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:55:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:55:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:55:02.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:55:02.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:02.061 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:55:02.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:55:02.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:02.062 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:55:02.062 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:55:02.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:02.062 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:55:02.063 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:55:02.063 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:55:02.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:55:02.063 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:55:02.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 msgr2=0x7f0ad0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:02.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 0x7f0ad0067290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f0ad4004e30 tx=0x7f0ad4009b30).stop 2022-02-02T18:55:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 msgr2=0x7f0ae0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f0acc00b410 tx=0x7f0acc006ef0).stop 2022-02-02T18:55:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 shutdown_connections 2022-02-02T18:55:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ad0064dd0 0x7f0ad0067290 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f66e0 0x7f0ae006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 --2- 172.21.15.96:0/880494990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f7980 0x7f0ae0069e20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 >> 172.21.15.96:0/880494990 conn(0x7f0ae00f1e40 msgr2=0x7f0ae00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.065+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 shutdown_connections 2022-02-02T18:55:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.066+0000 7f0ae6f03700 1 -- 172.21.15.96:0/880494990 wait complete. 2022-02-02T18:55:02.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 -- 172.21.15.96:0/1048206519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f7980 msgr2=0x7f37bc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:02.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 --2- 172.21.15.96:0/1048206519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f7980 0x7f37bc0f7de0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f37b0004660 tx=0x7f37b0009b30).stop 2022-02-02T18:55:02.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 -- 172.21.15.96:0/1048206519 shutdown_connections 2022-02-02T18:55:02.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 --2- 172.21.15.96:0/1048206519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f7980 0x7f37bc0f7de0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 --2- 172.21.15.96:0/1048206519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37bc0f66e0 0x7f37bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:55:02.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 -- 172.21.15.96:0/1048206519 >> 172.21.15.96:0/1048206519 conn(0x7f37bc0f1e40 msgr2=0x7f37bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:02.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 -- 172.21.15.96:0/1048206519 shutdown_connections 2022-02-02T18:55:02.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.164+0000 7f37c08b2700 1 -- 172.21.15.96:0/1048206519 wait complete. 2022-02-02T18:55:02.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 Processor -- start 2022-02-02T18:55:02.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 -- start start 2022-02-02T18:55:02.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:02.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37bc0f7980 0x7f37bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:02.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc06a410 con 0x7f37bc0f66e0 2022-02-02T18:55:02.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37c08b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc06a550 con 0x7f37bc0f7980 2022-02-02T18:55:02.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:02.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56756/0 (socket says 172.21.15.96:56756) 2022-02-02T18:55:02.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.165+0000 7f37ba59c700 1 -- 172.21.15.96:0/2013168656 learned_addr learned my addr 172.21.15.96:0/2013168656 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:02.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37ba59c700 1 -- 172.21.15.96:0/2013168656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37bc0f7980 msgr2=0x7f37bc069e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T18:55:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37ba59c700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37bc0f7980 0x7f37bc069e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:55:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37ba59c700 1 -- 172.21.15.96:0/2013168656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0005040 con 0x7f37bc0f66e0 2022-02-02T18:55:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37ba59c700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f37ac0093f0 tx=0x7f37ac006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac009ea0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37ac013af0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc06a830 con 0x7f37bc0f66e0 2022-02-02T18:55:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac00db10 con 0x7f37bc0f66e0 2022-02-02T18:55:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.166+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc10efe0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.167+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc045ad0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.168+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f37ac01a060 con 0x7f37bc0f66e0 2022-02-02T18:55:02.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.168+0000 7f37aaffd700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 0x7f37a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:02.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.168+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f37ac082200 con 0x7f37bc0f66e0 2022-02-02T18:55:02.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.168+0000 7f37b9d9b700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 0x7f37a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:02.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.168+0000 7f37b9d9b700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 0x7f37a4067290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f37b0004e30 tx=0x7f37b0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.173+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37ac0502b0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.380+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f37bc06a9c0 con 0x7f37bc0f66e0 2022-02-02T18:55:02.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.381+0000 7f37aaffd700 1 -- 172.21.15.96:0/2013168656 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f37ac018720 con 0x7f37bc0f66e0 2022-02-02T18:55:02.377 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:55:02.378 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:55:02.378 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:55:02.378 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:55:02.378 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:02.379 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:55:02.379 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:55:02.379 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:55:02.379 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:55:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:55:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:55:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:55:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:55:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:55:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:55:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:55:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:55:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:55:02.382 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:55:02.382 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:55:02.382 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:55:02.382 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:55:02.383 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:55:02.383 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:55:02.383 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:55:02.384 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:55:02.384 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:55:02.384 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:55:02.384 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:55:02.385 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:55:02.385 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:55:02.385 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:55:02.385 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:02.385 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:02.386 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:55:02.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:02.386 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:02.386 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:02.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 msgr2=0x7f37a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 0x7f37a4067290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f37b0004e30 tx=0x7f37b0009b30).stop 2022-02-02T18:55:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 msgr2=0x7f37bc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f37ac0093f0 tx=0x7f37ac006ec0).stop 2022-02-02T18:55:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 shutdown_connections 2022-02-02T18:55:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37a4064dd0 0x7f37a4067290 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37bc0f66e0 0x7f37bc06b9a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 --2- 172.21.15.96:0/2013168656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37bc0f7980 0x7f37bc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:55:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 >> 172.21.15.96:0/2013168656 conn(0x7f37bc0f1e40 msgr2=0x7f37bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 shutdown_connections 2022-02-02T18:55:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:02.383+0000 7f37c08b2700 1 -- 172.21.15.96:0/2013168656 wait complete. 2022-02-02T18:55:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:55:03.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:02 smithi159 ceph-mon[69013]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:02 smithi159 ceph-mon[69013]: pgmap v987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/880494990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2013168656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:55:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:02 smithi096 ceph-mon[101353]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:02 smithi096 ceph-mon[101353]: pgmap v987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/880494990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:03.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2013168656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:55:03.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:03 smithi159 ceph-mon[69013]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:04.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:03 smithi096 ceph-mon[101353]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:05.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:04 smithi159 ceph-mon[69013]: pgmap v988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:05.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:04 smithi096 ceph-mon[101353]: pgmap v988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:07.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:06 smithi159 ceph-mon[69013]: pgmap v989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:07.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:06 smithi096 ceph-mon[101353]: pgmap v989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:08 smithi159 ceph-mon[69013]: pgmap v990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:09.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:08 smithi096 ceph-mon[101353]: pgmap v990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:11.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:10 smithi159 ceph-mon[69013]: pgmap v991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:10 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:10 smithi096 ceph-mon[101353]: pgmap v991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:10 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:12.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:12.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:12.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:12.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:11 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:12.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:12.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:12.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:12.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:12.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:11 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:13.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:12 smithi159 ceph-mon[69013]: pgmap v992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:13.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:12 smithi096 ceph-mon[101353]: pgmap v992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:15.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:14 smithi159 ceph-mon[69013]: pgmap v993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:15.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:14 smithi096 ceph-mon[101353]: pgmap v993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:16 smithi159 ceph-mon[69013]: pgmap v994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:17.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:16 smithi096 ceph-mon[101353]: pgmap v994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:19.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:18 smithi159 ceph-mon[69013]: pgmap v995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:18 smithi096 ceph-mon[101353]: pgmap v995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:20 smithi159 ceph-mon[69013]: pgmap v996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:20 smithi096 ceph-mon[101353]: pgmap v996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:22.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:22.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:22.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:22.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:21 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:22.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:22.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:22.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:22.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:22.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:22.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:21 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:22 smithi159 ceph-mon[69013]: pgmap v997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:22 smithi096 ceph-mon[101353]: pgmap v997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:25.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:24 smithi159 ceph-mon[69013]: pgmap v998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:24 smithi096 ceph-mon[101353]: pgmap v998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:27.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:26 smithi159 ceph-mon[69013]: pgmap v999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:26 smithi096 ceph-mon[101353]: pgmap v999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:28.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:55:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:55:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:55:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:55:29.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:28 smithi159 ceph-mon[69013]: pgmap v1000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:29.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:28 smithi096 ceph-mon[101353]: pgmap v1000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:31.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:30 smithi159 ceph-mon[69013]: pgmap v1001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:30 smithi096 ceph-mon[101353]: pgmap v1001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:32.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:32.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:32.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:32.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:32.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:32.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:32.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:31 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:32.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:32.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:32.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:32.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:32.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:32.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:32.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:31 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 -- 172.21.15.96:0/3347506830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 msgr2=0x7f05940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 --2- 172.21.15.96:0/3347506830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f05940f59e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f058c0099e0 tx=0x7f058c004d10).stop 2022-02-02T18:55:32.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 -- 172.21.15.96:0/3347506830 shutdown_connections 2022-02-02T18:55:32.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 --2- 172.21.15.96:0/3347506830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 0x7f05940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 --2- 172.21.15.96:0/3347506830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f05940f59e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 -- 172.21.15.96:0/3347506830 >> 172.21.15.96:0/3347506830 conn(0x7f05940f0d40 msgr2=0x7f05940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 -- 172.21.15.96:0/3347506830 shutdown_connections 2022-02-02T18:55:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.493+0000 7f059b02a700 1 -- 172.21.15.96:0/3347506830 wait complete. 2022-02-02T18:55:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 Processor -- start 2022-02-02T18:55:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 -- start start 2022-02-02T18:55:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 0x7f059410c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940603c0 con 0x7f05940f55c0 2022-02-02T18:55:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.494+0000 7f059b02a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0594060500 con 0x7f05940f6860 2022-02-02T18:55:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56774/0 (socket says 172.21.15.96:56774) 2022-02-02T18:55:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 -- 172.21.15.96:0/943102412 learned_addr learned my addr 172.21.15.96:0/943102412 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:32.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0593fff700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 0x7f059410c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 -- 172.21.15.96:0/943102412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 msgr2=0x7f059410c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 0x7f059410c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 -- 172.21.15.96:0/943102412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c009640 con 0x7f05940f55c0 2022-02-02T18:55:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f0598dc6700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f058c00c010 tx=0x7f058c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058c00e070 con 0x7f05940f55c0 2022-02-02T18:55:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f058c007d10 con 0x7f05940f55c0 2022-02-02T18:55:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059410c7d0 con 0x7f05940f55c0 2022-02-02T18:55:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058c018070 con 0x7f05940f55c0 2022-02-02T18:55:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.495+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059410cc80 con 0x7f05940f55c0 2022-02-02T18:55:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.496+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05940f49b0 con 0x7f05940f55c0 2022-02-02T18:55:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.497+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f058c024060 con 0x7f05940f55c0 2022-02-02T18:55:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.497+0000 7f05917fa700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 0x7f0580067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.497+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f058c083450 con 0x7f05940f55c0 2022-02-02T18:55:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.497+0000 7f0593fff700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 0x7f0580067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.498+0000 7f0593fff700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 0x7f0580067290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f057c007fd0 tx=0x7f057c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.501+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f058c0515c0 con 0x7f05940f55c0 2022-02-02T18:55:32.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.680+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05940fdec0 con 0x7f0580064dd0 2022-02-02T18:55:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.681+0000 7f05917fa700 1 -- 172.21.15.96:0/943102412 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f05940fdec0 con 0x7f0580064dd0 2022-02-02T18:55:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 msgr2=0x7f0580067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 0x7f0580067290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f057c007fd0 tx=0x7f057c009040).stop 2022-02-02T18:55:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 msgr2=0x7f0594109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f058c00c010 tx=0x7f058c004d10).stop 2022-02-02T18:55:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 shutdown_connections 2022-02-02T18:55:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0580064dd0 0x7f0580067290 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05940f55c0 0x7f0594109d80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 --2- 172.21.15.96:0/943102412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05940f6860 0x7f059410c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 >> 172.21.15.96:0/943102412 conn(0x7f05940f0d40 msgr2=0x7f05940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 shutdown_connections 2022-02-02T18:55:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.683+0000 7f059b02a700 1 -- 172.21.15.96:0/943102412 wait complete. 2022-02-02T18:55:32.688 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:55:32.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 -- 172.21.15.96:0/3770556695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f55e0 msgr2=0x7f41440f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 --2- 172.21.15.96:0/3770556695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f55e0 0x7f41440f5a00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f4138004660 tx=0x7f4138009b30).stop 2022-02-02T18:55:32.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:32 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:32.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:32 smithi096 ceph-mon[101353]: pgmap v1002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 -- 172.21.15.96:0/3770556695 shutdown_connections 2022-02-02T18:55:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 --2- 172.21.15.96:0/3770556695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f5ef0 0x7f41440f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 --2- 172.21.15.96:0/3770556695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f55e0 0x7f41440f5a00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 -- 172.21.15.96:0/3770556695 >> 172.21.15.96:0/3770556695 conn(0x7f41440f0de0 msgr2=0x7f41440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 -- 172.21.15.96:0/3770556695 shutdown_connections 2022-02-02T18:55:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.781+0000 7f4148977700 1 -- 172.21.15.96:0/3770556695 wait complete. 2022-02-02T18:55:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 Processor -- start 2022-02-02T18:55:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 -- start start 2022-02-02T18:55:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f55e0 0x7f4144109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440604c0 con 0x7f41440f5ef0 2022-02-02T18:55:32.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4148977700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144060600 con 0x7f41440f55e0 2022-02-02T18:55:32.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4141d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4141d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56784/0 (socket says 172.21.15.96:56784) 2022-02-02T18:55:32.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f4141d9b700 1 -- 172.21.15.96:0/2290722582 learned_addr learned my addr 172.21.15.96:0/2290722582 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:32.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.782+0000 7f414259c700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f55e0 0x7f4144109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4141d9b700 1 -- 172.21.15.96:0/2290722582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f55e0 msgr2=0x7f4144109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4141d9b700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f55e0 0x7f4144109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4141d9b700 1 -- 172.21.15.96:0/2290722582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138005040 con 0x7f41440f5ef0 2022-02-02T18:55:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4141d9b700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f413400c530 tx=0x7f4134007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413400f650 con 0x7f41440f5ef0 2022-02-02T18:55:32.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f413400fc60 con 0x7f41440f5ef0 2022-02-02T18:55:32.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414410c760 con 0x7f41440f5ef0 2022-02-02T18:55:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4134012c20 con 0x7f41440f5ef0 2022-02-02T18:55:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.783+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414410ccf0 con 0x7f41440f5ef0 2022-02-02T18:55:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.784+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440f4a70 con 0x7f41440f5ef0 2022-02-02T18:55:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.784+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4134010070 con 0x7f41440f5ef0 2022-02-02T18:55:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.785+0000 7f4132ffd700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:32.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.785+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4134081730 con 0x7f41440f5ef0 2022-02-02T18:55:32.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.785+0000 7f414259c700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:32.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.785+0000 7f414259c700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 0x7f412c067290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4138004630 tx=0x7f4138009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:32.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.789+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f413404f7e0 con 0x7f41440f5ef0 2022-02-02T18:55:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.960+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f41440008d0 con 0x7f412c064dd0 2022-02-02T18:55:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.969+0000 7f4132ffd700 1 -- 172.21.15.96:0/2290722582 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f41440008d0 con 0x7f412c064dd0 2022-02-02T18:55:32.964 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:55:32.965 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (38m) 9m ago 40m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:55:32.965 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (31m) 9m ago 39m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:55:32.965 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (31m) 7m ago 39m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:55:32.966 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (38m) 9m ago 39m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:55:32.966 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (36m) 9m ago 36m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:55:32.967 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (31m) 9m ago 36m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:55:32.967 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (36m) 7m ago 36m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:55:32.967 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (31m) 7m ago 36m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:55:32.968 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (33m) 9m ago 41m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:55:32.968 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (32m) 7m ago 39m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:55:32.969 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (32m) 9m ago 41m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:55:32.969 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (31m) 7m ago 39m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:55:32.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (39m) 9m ago 39m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:55:32.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (39m) 7m ago 39m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:55:32.970 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (30m) 9m ago 38m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:55:32.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (30m) 9m ago 38m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:55:32.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (29m) 9m ago 38m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:55:32.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (29m) 7m ago 37m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:55:32.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (28m) 7m ago 37m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:55:32.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (28m) 7m ago 37m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:55:32.973 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (38m) 9m ago 39m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:55:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 msgr2=0x7f412c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 0x7f412c067290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4138004630 tx=0x7f4138009b30).stop 2022-02-02T18:55:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 msgr2=0x7f414410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:32.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f413400c530 tx=0x7f4134007e20).stop 2022-02-02T18:55:32.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 shutdown_connections 2022-02-02T18:55:32.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41440f55e0 0x7f4144109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 --2- 172.21.15.96:0/2290722582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41440f5ef0 0x7f414410c1b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:32.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 >> 172.21.15.96:0/2290722582 conn(0x7f41440f0de0 msgr2=0x7f41440fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:32.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 shutdown_connections 2022-02-02T18:55:32.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:32.971+0000 7f4148977700 1 -- 172.21.15.96:0/2290722582 wait complete. 2022-02-02T18:55:33.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:32 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:32 smithi159 ceph-mon[69013]: pgmap v1002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- 172.21.15.96:0/587759618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 msgr2=0x7f7b6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 --2- 172.21.15.96:0/587759618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c0f6cc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f7b5c004660 tx=0x7f7b5c009b30).stop 2022-02-02T18:55:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- 172.21.15.96:0/587759618 shutdown_connections 2022-02-02T18:55:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 --2- 172.21.15.96:0/587759618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c0f6cc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 --2- 172.21.15.96:0/587759618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 0x7f7b6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- 172.21.15.96:0/587759618 >> 172.21.15.96:0/587759618 conn(0x7f7b6c0f0d40 msgr2=0x7f7b6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- 172.21.15.96:0/587759618 shutdown_connections 2022-02-02T18:55:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- 172.21.15.96:0/587759618 wait complete. 2022-02-02T18:55:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 Processor -- start 2022-02-02T18:55:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.069+0000 7f7b71197700 1 -- start start 2022-02-02T18:55:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b71197700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 0x7f7b6c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b71197700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b71197700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0603e0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b71197700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c060520 con 0x7f7b6c0f55c0 2022-02-02T18:55:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56792/0 (socket says 172.21.15.96:56792) 2022-02-02T18:55:33.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 -- 172.21.15.96:0/44901763 learned_addr learned my addr 172.21.15.96:0/44901763 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:33.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6ad9d700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 0x7f7b6c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 -- 172.21.15.96:0/44901763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 msgr2=0x7f7b6c109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 0x7f7b6c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 -- 172.21.15.96:0/44901763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c005040 con 0x7f7b6c0f6860 2022-02-02T18:55:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b6a59c700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f7b5c009990 tx=0x7f7b5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:33.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5c018070 con 0x7f7b6c0f6860 2022-02-02T18:55:33.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b5c007ca0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.070+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5c01c620 con 0x7f7b6c0f6860 2022-02-02T18:55:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.071+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c10c6a0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.071+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c10cbb0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.071+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c045ad0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.072+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b5c01d960 con 0x7f7b6c0f6860 2022-02-02T18:55:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.072+0000 7f7b537fe700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 0x7f7b54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.072+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7b5c083830 con 0x7f7b6c0f6860 2022-02-02T18:55:33.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.072+0000 7f7b6ad9d700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 0x7f7b54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.073+0000 7f7b6ad9d700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 0x7f7b54067290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f7b6c060060 tx=0x7f7b60009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:33.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.076+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b5c0519a0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.307+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b6c027a00 con 0x7f7b6c0f6860 2022-02-02T18:55:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.308+0000 7f7b537fe700 1 -- 172.21.15.96:0/44901763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7b5c054fc0 con 0x7f7b6c0f6860 2022-02-02T18:55:33.303 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:55:33.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:55:33.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:55:33.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:33.304 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:55:33.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:55:33.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:33.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:55:33.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:55:33.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:33.306 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:55:33.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:55:33.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:55:33.306 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:55:33.307 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:55:33.307 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:55:33.307 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:55:33.307 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:55:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 msgr2=0x7f7b54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 0x7f7b54067290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f7b6c060060 tx=0x7f7b60009040).stop 2022-02-02T18:55:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 msgr2=0x7f7b6c10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f7b5c009990 tx=0x7f7b5c009b30).stop 2022-02-02T18:55:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 shutdown_connections 2022-02-02T18:55:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b54064dd0 0x7f7b54067290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c0f55c0 0x7f7b6c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 --2- 172.21.15.96:0/44901763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b6c0f6860 0x7f7b6c10c150 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.310+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 >> 172.21.15.96:0/44901763 conn(0x7f7b6c0f0d40 msgr2=0x7f7b6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.311+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 shutdown_connections 2022-02-02T18:55:33.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.311+0000 7f7b71197700 1 -- 172.21.15.96:0/44901763 wait complete. 2022-02-02T18:55:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.408+0000 7f6830c9e700 1 -- 172.21.15.96:0/752538464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f6860 msgr2=0x7f682c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.408+0000 7f6830c9e700 1 --2- 172.21.15.96:0/752538464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f6860 0x7f682c0f6cc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f6820004660 tx=0x7f6820009b30).stop 2022-02-02T18:55:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 -- 172.21.15.96:0/752538464 shutdown_connections 2022-02-02T18:55:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 --2- 172.21.15.96:0/752538464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f6860 0x7f682c0f6cc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 --2- 172.21.15.96:0/752538464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f55c0 0x7f682c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 -- 172.21.15.96:0/752538464 >> 172.21.15.96:0/752538464 conn(0x7f682c0f0d40 msgr2=0x7f682c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 -- 172.21.15.96:0/752538464 shutdown_connections 2022-02-02T18:55:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.409+0000 7f6830c9e700 1 -- 172.21.15.96:0/752538464 wait complete. 2022-02-02T18:55:33.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 Processor -- start 2022-02-02T18:55:33.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 -- start start 2022-02-02T18:55:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 0x7f682c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0602b0 con 0x7f682c0f55c0 2022-02-02T18:55:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6830c9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0603f0 con 0x7f682c0f6860 2022-02-02T18:55:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f682a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f682a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56798/0 (socket says 172.21.15.96:56798) 2022-02-02T18:55:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f682a59c700 1 -- 172.21.15.96:0/2669787910 learned_addr learned my addr 172.21.15.96:0/2669787910 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:55:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.410+0000 7f6829d9b700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 0x7f682c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6829d9b700 1 -- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 msgr2=0x7f682c10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6829d9b700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6829d9b700 1 -- 172.21.15.96:0/2669787910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820005040 con 0x7f682c0f6860 2022-02-02T18:55:33.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f682a59c700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:55:33.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6829d9b700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 0x7f682c10e570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6820000c00 tx=0x7f6820009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:33.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6820018070 con 0x7f682c0f6860 2022-02-02T18:55:33.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c10ea60 con 0x7f682c0f6860 2022-02-02T18:55:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68200097d0 con 0x7f682c0f6860 2022-02-02T18:55:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f682001c3c0 con 0x7f682c0f6860 2022-02-02T18:55:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.411+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c10ee30 con 0x7f682c0f6860 2022-02-02T18:55:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.412+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c045ad0 con 0x7f682c0f6860 2022-02-02T18:55:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.413+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f682001d420 con 0x7f682c0f6860 2022-02-02T18:55:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.413+0000 7f681affd700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 0x7f6814067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:55:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.413+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6820083750 con 0x7f682c0f6860 2022-02-02T18:55:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.413+0000 7f682a59c700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 0x7f6814067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:55:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.413+0000 7f682a59c700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 0x7f6814067290 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f682c060040 tx=0x7f681c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:55:33.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.418+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6820051800 con 0x7f682c0f6860 2022-02-02T18:55:33.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.617+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f682c027a00 con 0x7f682c0f6860 2022-02-02T18:55:33.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.618+0000 7f681affd700 1 -- 172.21.15.96:0/2669787910 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6820054e20 con 0x7f682c0f6860 2022-02-02T18:55:33.613 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:55:33.613 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:55:33.613 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:55:33.614 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:55:33.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:33.614 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:55:33.614 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:55:33.615 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:55:33.615 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:55:33.615 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:55:33.615 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:55:33.615 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:55:33.616 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:55:33.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:55:33.617 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:55:33.617 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:55:33.617 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:55:33.618 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:55:33.618 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:55:33.618 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:55:33.618 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:55:33.619 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:55:33.619 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:55:33.619 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:55:33.619 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:55:33.619 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:55:33.620 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:55:33.620 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:55:33.620 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:55:33.620 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:55:33.621 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:55:33.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:55:33.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:33.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:33.622 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:55:33.623 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:55:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:55:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 msgr2=0x7f6814067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 0x7f6814067290 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f682c060040 tx=0x7f681c009040).stop 2022-02-02T18:55:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 msgr2=0x7f682c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:55:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 0x7f682c10e570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6820000c00 tx=0x7f6820009b30).stop 2022-02-02T18:55:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 shutdown_connections 2022-02-02T18:55:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6814064dd0 0x7f6814067290 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f682c0f55c0 0x7f682c10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 --2- 172.21.15.96:0/2669787910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f682c0f6860 0x7f682c10e570 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:55:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 >> 172.21.15.96:0/2669787910 conn(0x7f682c0f0d40 msgr2=0x7f682c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:55:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 shutdown_connections 2022-02-02T18:55:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:55:33.620+0000 7f6830c9e700 1 -- 172.21.15.96:0/2669787910 wait complete. 2022-02-02T18:55:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:55:33.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:33 smithi159 ceph-mon[69013]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:33.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/44901763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:33.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2669787910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:55:34.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:33 smithi096 ceph-mon[101353]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:34.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/44901763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:34.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2669787910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:55:35.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:34 smithi159 ceph-mon[69013]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:34 smithi159 ceph-mon[69013]: pgmap v1003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:35.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:34 smithi096 ceph-mon[101353]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:55:35.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:34 smithi096 ceph-mon[101353]: pgmap v1003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:37.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:36 smithi159 ceph-mon[69013]: pgmap v1004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:37.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:36 smithi096 ceph-mon[101353]: pgmap v1004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:39.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:38 smithi159 ceph-mon[69013]: pgmap v1005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:39.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:38 smithi096 ceph-mon[101353]: pgmap v1005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:41.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:40 smithi159 ceph-mon[69013]: pgmap v1006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:40 smithi096 ceph-mon[101353]: pgmap v1006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:42.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:41 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:42.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:42.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:42.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:42.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:42.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:41 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:55:43.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:42 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:42 smithi159 ceph-mon[69013]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:42 smithi159 ceph-mon[69013]: pgmap v1007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:42 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:42 smithi096 ceph-mon[101353]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2022-02-02T18:55:43.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:42 smithi096 ceph-mon[101353]: pgmap v1007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:45.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:44 smithi159 ceph-mon[69013]: pgmap v1008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:45.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:44 smithi096 ceph-mon[101353]: pgmap v1008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:47.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:46 smithi159 ceph-mon[69013]: pgmap v1009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:47.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:46 smithi096 ceph-mon[101353]: pgmap v1009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:49.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:48 smithi159 ceph-mon[69013]: pgmap v1010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:49.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:48 smithi096 ceph-mon[101353]: pgmap v1010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:50.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:49 smithi159 ceph-mon[69013]: pgmap v1011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:50.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:49 smithi096 ceph-mon[101353]: pgmap v1011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:51.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:51.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:51.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:51.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:51 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:51.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T18:55:51.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T18:55:51.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T18:55:51.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:51 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' 2022-02-02T18:55:52.689 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:52 smithi096 ceph-mon[101353]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:52.689 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:52 smithi096 ceph-mon[101353]: pgmap v1012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:52.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:52 smithi159 ceph-mon[69013]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T18:55:52.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:52 smithi159 ceph-mon[69013]: pgmap v1012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:54.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:54 smithi159 ceph-mon[69013]: pgmap v1013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:54.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:54 smithi096 ceph-mon[101353]: pgmap v1013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:56.769 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:56 smithi159 ceph-mon[69013]: pgmap v1014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:56.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:56 smithi096 ceph-mon[101353]: pgmap v1014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:58.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:55:58 smithi159 ceph-mon[69013]: pgmap v1015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:55:58.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:55:58 smithi096 ceph-mon[101353]: pgmap v1015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:00.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:00 smithi159 ceph-mon[69013]: pgmap v1016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:00.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:00 smithi096 ceph-mon[101353]: pgmap v1016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:02.768 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:02 smithi159 ceph-mon[69013]: pgmap v1017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:02.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:02 smithi096 ceph-mon[101353]: pgmap v1017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:03.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.730+0000 7f087c4d8700 1 -- 172.21.15.96:0/1247673151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66c0 msgr2=0x7f08740f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:03.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 --2- 172.21.15.96:0/1247673151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66c0 0x7f08740f6ae0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f0864004660 tx=0x7f0864009b30).stop 2022-02-02T18:56:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- 172.21.15.96:0/1247673151 shutdown_connections 2022-02-02T18:56:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 --2- 172.21.15.96:0/1247673151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f7960 0x7f08740f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 --2- 172.21.15.96:0/1247673151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66c0 0x7f08740f6ae0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- 172.21.15.96:0/1247673151 >> 172.21.15.96:0/1247673151 conn(0x7f08740f1e20 msgr2=0x7f08740f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- 172.21.15.96:0/1247673151 shutdown_connections 2022-02-02T18:56:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- 172.21.15.96:0/1247673151 wait complete. 2022-02-02T18:56:03.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 Processor -- start 2022-02-02T18:56:03.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- start start 2022-02-02T18:56:03.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 0x7f087406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:03.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:03.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087406a380 con 0x7f08740f7960 2022-02-02T18:56:03.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.731+0000 7f087c4d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087406a4c0 con 0x7f08740f66c0 2022-02-02T18:56:03.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:03.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56820/0 (socket says 172.21.15.96:56820) 2022-02-02T18:56:03.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 -- 172.21.15.96:0/2026771019 learned_addr learned my addr 172.21.15.96:0/2026771019 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:03.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f087a274700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 0x7f087406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:03.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 -- 172.21.15.96:0/2026771019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 msgr2=0x7f087406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:03.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 0x7f087406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 -- 172.21.15.96:0/2026771019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864005040 con 0x7f08740f7960 2022-02-02T18:56:03.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f087a274700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 0x7f087406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:56:03.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f0879a73700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f087000c530 tx=0x7f0870007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:03.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f087000f650 con 0x7f08740f7960 2022-02-02T18:56:03.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f087000fc60 con 0x7f08740f7960 2022-02-02T18:56:03.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0870012cd0 con 0x7f08740f7960 2022-02-02T18:56:03.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087406a7a0 con 0x7f08740f7960 2022-02-02T18:56:03.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.732+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087410efc0 con 0x7f08740f7960 2022-02-02T18:56:03.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.733+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0874045ad0 con 0x7f08740f7960 2022-02-02T18:56:03.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.734+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0870010070 con 0x7f08740f7960 2022-02-02T18:56:03.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.734+0000 7f086affd700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 0x7f0860067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:03.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.734+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0870081800 con 0x7f08740f7960 2022-02-02T18:56:03.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.734+0000 7f087a274700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 0x7f0860067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:03.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.735+0000 7f087a274700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 0x7f0860067290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0864004e30 tx=0x7f0864009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:03.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.739+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f087004f8b0 con 0x7f08740f7960 2022-02-02T18:56:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.917+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08740feff0 con 0x7f0860064dd0 2022-02-02T18:56:03.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.918+0000 7f086affd700 1 -- 172.21.15.96:0/2026771019 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f08740feff0 con 0x7f0860064dd0 2022-02-02T18:56:03.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 msgr2=0x7f0860067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:03.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 0x7f0860067290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0864004e30 tx=0x7f0864009b30).stop 2022-02-02T18:56:03.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 msgr2=0x7f0874069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:03.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f087000c530 tx=0x7f0870007e20).stop 2022-02-02T18:56:03.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 shutdown_connections 2022-02-02T18:56:03.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064dd0 0x7f0860067290 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f66c0 0x7f087406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 --2- 172.21.15.96:0/2026771019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f7960 0x7f0874069e20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 >> 172.21.15.96:0/2026771019 conn(0x7f08740f1e20 msgr2=0x7f08740fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 shutdown_connections 2022-02-02T18:56:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:03.920+0000 7f087c4d8700 1 -- 172.21.15.96:0/2026771019 wait complete. 2022-02-02T18:56:03.925 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:56:04.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 -- 172.21.15.96:0/2408216333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 msgr2=0x7ff8040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 --2- 172.21.15.96:0/2408216333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f6cc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7ff800004660 tx=0x7ff800009b30).stop 2022-02-02T18:56:04.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 -- 172.21.15.96:0/2408216333 shutdown_connections 2022-02-02T18:56:04.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 --2- 172.21.15.96:0/2408216333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f6cc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 --2- 172.21.15.96:0/2408216333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 0x7ff8040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:56:04.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 -- 172.21.15.96:0/2408216333 >> 172.21.15.96:0/2408216333 conn(0x7ff8040f0d40 msgr2=0x7ff8040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 -- 172.21.15.96:0/2408216333 shutdown_connections 2022-02-02T18:56:04.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.018+0000 7ff80bb97700 1 -- 172.21.15.96:0/2408216333 wait complete. 2022-02-02T18:56:04.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 Processor -- start 2022-02-02T18:56:04.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 -- start start 2022-02-02T18:56:04.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 0x7ff8040f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040f89b0 con 0x7ff8040f6860 2022-02-02T18:56:04.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff80bb97700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040f8af0 con 0x7ff8040f55c0 2022-02-02T18:56:04.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff809132700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff809132700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56830/0 (socket says 172.21.15.96:56830) 2022-02-02T18:56:04.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff809132700 1 -- 172.21.15.96:0/1360069939 learned_addr learned my addr 172.21.15.96:0/1360069939 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:04.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.019+0000 7ff809933700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 0x7ff8040f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff809132700 1 -- 172.21.15.96:0/1360069939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 msgr2=0x7ff8040f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff809132700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 0x7ff8040f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff809132700 1 -- 172.21.15.96:0/1360069939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800005040 con 0x7ff8040f6860 2022-02-02T18:56:04.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff809132700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ff800009990 tx=0x7ff800009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff800018070 con 0x7ff8040f6860 2022-02-02T18:56:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff800007ca0 con 0x7ff8040f6860 2022-02-02T18:56:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8040f8d70 con 0x7ff8040f6860 2022-02-02T18:56:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff80001c620 con 0x7ff8040f6860 2022-02-02T18:56:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.020+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80410efb0 con 0x7ff8040f6860 2022-02-02T18:56:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.021+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff804045ad0 con 0x7ff8040f6860 2022-02-02T18:56:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.022+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff80001d960 con 0x7ff8040f6860 2022-02-02T18:56:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.022+0000 7ff7fa7fc700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 0x7ff7f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.022+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff800083750 con 0x7ff8040f6860 2022-02-02T18:56:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.022+0000 7ff809933700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 0x7ff7f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.022+0000 7ff809933700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 0x7ff7f0067290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff8040f9cd0 tx=0x7ff7f4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.026+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff800051800 con 0x7ff8040f6860 2022-02-02T18:56:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.199+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff80405fd30 con 0x7ff7f0064dd0 2022-02-02T18:56:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.208+0000 7ff7fa7fc700 1 -- 172.21.15.96:0/1360069939 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff80405fd30 con 0x7ff7f0064dd0 2022-02-02T18:56:04.203 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:56:04.203 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (39m) 10m ago 40m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:56:04.204 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (31m) 10m ago 40m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:56:04.204 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (31m) 8m ago 40m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:56:04.204 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (39m) 10m ago 40m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:56:04.204 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (36m) 10m ago 36m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:56:04.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (32m) 10m ago 36m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:56:04.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (36m) 8m ago 36m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:56:04.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (32m) 8m ago 36m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:56:04.205 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (33m) 10m ago 41m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:56:04.206 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (33m) 8m ago 39m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:56:04.206 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (32m) 10m ago 41m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:56:04.206 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (32m) 8m ago 39m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:56:04.207 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (40m) 10m ago 40m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:56:04.207 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (39m) 8m ago 39m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:56:04.207 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (31m) 10m ago 39m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:56:04.207 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (30m) 10m ago 39m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:56:04.207 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (30m) 10m ago 38m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:56:04.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (29m) 8m ago 38m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:56:04.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (29m) 8m ago 38m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:56:04.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (28m) 8m ago 37m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:56:04.208 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (39m) 10m ago 40m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:56:04.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 msgr2=0x7ff7f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 0x7ff7f0067290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff8040f9cd0 tx=0x7ff7f4008040).stop 2022-02-02T18:56:04.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 msgr2=0x7ff8040f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ff800009990 tx=0x7ff800009b30).stop 2022-02-02T18:56:04.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 shutdown_connections 2022-02-02T18:56:04.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7f0064dd0 0x7ff7f0067290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8040f55c0 0x7ff8040f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 --2- 172.21.15.96:0/1360069939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8040f6860 0x7ff8040f83c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 >> 172.21.15.96:0/1360069939 conn(0x7ff8040f0d40 msgr2=0x7ff80405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 shutdown_connections 2022-02-02T18:56:04.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.211+0000 7ff80bb97700 1 -- 172.21.15.96:0/1360069939 wait complete. 2022-02-02T18:56:04.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 -- 172.21.15.96:0/2649180759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f49a0 msgr2=0x7f5c800f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 --2- 172.21.15.96:0/2649180759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f49a0 0x7f5c800f4dc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f5c7c004660 tx=0x7f5c7c009b30).stop 2022-02-02T18:56:04.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 -- 172.21.15.96:0/2649180759 shutdown_connections 2022-02-02T18:56:04.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 --2- 172.21.15.96:0/2649180759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f5340 0x7f5c800f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 --2- 172.21.15.96:0/2649180759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f49a0 0x7f5c800f4dc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 -- 172.21.15.96:0/2649180759 >> 172.21.15.96:0/2649180759 conn(0x7f5c800f04c0 msgr2=0x7f5c800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 -- 172.21.15.96:0/2649180759 shutdown_connections 2022-02-02T18:56:04.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.307+0000 7f5c88302700 1 -- 172.21.15.96:0/2649180759 wait complete. 2022-02-02T18:56:04.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 Processor -- start 2022-02-02T18:56:04.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 -- start start 2022-02-02T18:56:04.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f49a0 0x7f5c800f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800f5f30 con 0x7f5c800f5340 2022-02-02T18:56:04.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c88302700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800f6070 con 0x7f5c800f49a0 2022-02-02T18:56:04.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56838/0 (socket says 172.21.15.96:56838) 2022-02-02T18:56:04.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 -- 172.21.15.96:0/813044097 learned_addr learned my addr 172.21.15.96:0/813044097 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:04.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8609e700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f49a0 0x7f5c800f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 -- 172.21.15.96:0/813044097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f49a0 msgr2=0x7f5c800f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f49a0 0x7f5c800f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 -- 172.21.15.96:0/813044097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c005040 con 0x7f5c800f5340 2022-02-02T18:56:04.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.308+0000 7f5c8589d700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5c700026d0 tx=0x7f5c70009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.309+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c70009320 con 0x7f5c800f5340 2022-02-02T18:56:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.309+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c7000f040 con 0x7f5c800f5340 2022-02-02T18:56:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.309+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800f6350 con 0x7f5c800f5340 2022-02-02T18:56:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.309+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c70014870 con 0x7f5c800f5340 2022-02-02T18:56:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.309+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8010eff0 con 0x7f5c800f5340 2022-02-02T18:56:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.310+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80045ad0 con 0x7f5c800f5340 2022-02-02T18:56:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.310+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c70009480 con 0x7f5c800f5340 2022-02-02T18:56:04.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.310+0000 7f5c76ffd700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 0x7f5c6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.310+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5c70081de0 con 0x7f5c800f5340 2022-02-02T18:56:04.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.310+0000 7f5c8609e700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 0x7f5c6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.311+0000 7f5c8609e700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 0x7f5c6c067290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5c7c005010 tx=0x7f5c7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.315+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c7004fe90 con 0x7f5c800f5340 2022-02-02T18:56:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.546+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c80027a00 con 0x7f5c800f5340 2022-02-02T18:56:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.547+0000 7f5c76ffd700 1 -- 172.21.15.96:0/813044097 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5c700534b0 con 0x7f5c800f5340 2022-02-02T18:56:04.544 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:56:04.544 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:56:04.545 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:56:04.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:04.546 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:56:04.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:56:04.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:04.547 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:56:04.547 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:56:04.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:04.548 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:56:04.549 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:56:04.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:04.549 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:56:04.550 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:56:04.550 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:56:04.551 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:56:04.551 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:56:04.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 msgr2=0x7f5c6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 0x7f5c6c067290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5c7c005010 tx=0x7f5c7c009b30).stop 2022-02-02T18:56:04.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 msgr2=0x7f5c800f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5c700026d0 tx=0x7f5c70009e00).stop 2022-02-02T18:56:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 shutdown_connections 2022-02-02T18:56:04.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c6c064dd0 0x7f5c6c067290 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c800f49a0 0x7f5c800f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 --2- 172.21.15.96:0/813044097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c800f5340 0x7f5c800f59d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 >> 172.21.15.96:0/813044097 conn(0x7f5c800f04c0 msgr2=0x7f5c800fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 shutdown_connections 2022-02-02T18:56:04.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.549+0000 7f5c88302700 1 -- 172.21.15.96:0/813044097 wait complete. 2022-02-02T18:56:04.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 -- 172.21.15.96:0/3304191645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 msgr2=0x7ff0140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 --2- 172.21.15.96:0/3304191645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff0140f5850 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7ff004004660 tx=0x7ff004009b30).stop 2022-02-02T18:56:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 -- 172.21.15.96:0/3304191645 shutdown_connections 2022-02-02T18:56:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 --2- 172.21.15.96:0/3304191645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 0x7ff0140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 --2- 172.21.15.96:0/3304191645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff0140f5850 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 -- 172.21.15.96:0/3304191645 >> 172.21.15.96:0/3304191645 conn(0x7ff0140f0b90 msgr2=0x7ff0140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.643 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:04 smithi096 ceph-mon[101353]: pgmap v1018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:04.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 -- 172.21.15.96:0/3304191645 shutdown_connections 2022-02-02T18:56:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.646+0000 7ff0197cf700 1 -- 172.21.15.96:0/3304191645 wait complete. 2022-02-02T18:56:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.647+0000 7ff0197cf700 1 Processor -- start 2022-02-02T18:56:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.647+0000 7ff0197cf700 1 -- start start 2022-02-02T18:56:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.647+0000 7ff0197cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.647+0000 7ff0197cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 0x7ff014107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff0197cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014107900 con 0x7ff0140f5430 2022-02-02T18:56:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff0197cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014108110 con 0x7ff0140f66d0 2022-02-02T18:56:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56844/0 (socket says 172.21.15.96:56844) 2022-02-02T18:56:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 -- 172.21.15.96:0/387152688 learned_addr learned my addr 172.21.15.96:0/387152688 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff0137fe700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 0x7ff014107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 -- 172.21.15.96:0/387152688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 msgr2=0x7ff014107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 0x7ff014107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 -- 172.21.15.96:0/387152688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004005040 con 0x7ff0140f5430 2022-02-02T18:56:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff013fff700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff004004f60 tx=0x7ff004009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff004018070 con 0x7ff0140f5430 2022-02-02T18:56:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff014108330 con 0x7ff0140f5430 2022-02-02T18:56:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff004007ba0 con 0x7ff0140f5430 2022-02-02T18:56:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff00401c620 con 0x7ff0140f5430 2022-02-02T18:56:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.648+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff014108890 con 0x7ff0140f5430 2022-02-02T18:56:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.649+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff014059100 con 0x7ff0140f5430 2022-02-02T18:56:04.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.650+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff00401c8e0 con 0x7ff0140f5430 2022-02-02T18:56:04.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.650+0000 7ff010ff9700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 0x7feffc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:04.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.650+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff004083990 con 0x7ff0140f5430 2022-02-02T18:56:04.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.650+0000 7ff0137fe700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 0x7feffc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:04.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.651+0000 7ff0137fe700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 0x7feffc0672e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7ff008007fd0 tx=0x7ff008009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:04.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.654+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff004051a40 con 0x7ff0140f5430 2022-02-02T18:56:04.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.856+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff0140fdd30 con 0x7ff0140f5430 2022-02-02T18:56:04.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.857+0000 7ff010ff9700 1 -- 172.21.15.96:0/387152688 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff004055060 con 0x7ff0140f5430 2022-02-02T18:56:04.852 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:56:04.852 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:56:04.853 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:56:04.853 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:56:04.853 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:04.853 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:56:04.854 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:56:04.854 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:56:04.854 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:56:04.854 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:56:04.855 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:56:04.855 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:56:04.855 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:56:04.855 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:56:04.855 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:56:04.856 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:56:04.856 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:56:04.856 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:56:04.856 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:56:04.857 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:56:04.857 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:56:04.857 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:56:04.857 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:56:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:56:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:56:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:56:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:56:04.858 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:56:04.859 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:56:04.859 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:56:04.859 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:56:04.859 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:56:04.860 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:04.860 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:04.860 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:56:04.860 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:04.860 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:04.861 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:04.861 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:04.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 msgr2=0x7feffc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 0x7feffc0672e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7ff008007fd0 tx=0x7ff008009040).stop 2022-02-02T18:56:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 msgr2=0x7ff014106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff004004f60 tx=0x7ff004009b30).stop 2022-02-02T18:56:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 shutdown_connections 2022-02-02T18:56:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feffc064e20 0x7feffc0672e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0140f5430 0x7ff014106e10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 --2- 172.21.15.96:0/387152688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0140f66d0 0x7ff014107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:04.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 >> 172.21.15.96:0/387152688 conn(0x7ff0140f0b90 msgr2=0x7ff01405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:04.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 shutdown_connections 2022-02-02T18:56:04.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:04.859+0000 7ff0197cf700 1 -- 172.21.15.96:0/387152688 wait complete. 2022-02-02T18:56:04.865 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:56:05.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:04 smithi159 ceph-mon[69013]: pgmap v1018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:05.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:05 smithi096 ceph-mon[101353]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:05.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:05 smithi096 ceph-mon[101353]: from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:05.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/813044097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:56:05.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/387152688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:56:06.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:05 smithi159 ceph-mon[69013]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:06.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:05 smithi159 ceph-mon[69013]: from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:06.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/813044097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:56:06.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/387152688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:56:06.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:06 smithi096 ceph-mon[101353]: pgmap v1019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:07.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:06 smithi159 ceph-mon[69013]: pgmap v1019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:08.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:08 smithi096 ceph-mon[101353]: pgmap v1020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:08 smithi159 ceph-mon[69013]: pgmap v1020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:10.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:10 smithi096 ceph-mon[101353]: pgmap v1021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:10 smithi159 ceph-mon[69013]: pgmap v1021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:12.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:12 smithi096 ceph-mon[101353]: pgmap v1022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:13.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:12 smithi159 ceph-mon[69013]: pgmap v1022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:14.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:14 smithi096 ceph-mon[101353]: pgmap v1023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:15.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:14 smithi159 ceph-mon[69013]: pgmap v1023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:16 smithi159 ceph-mon[69013]: pgmap v1024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:17.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:16 smithi096 ceph-mon[101353]: pgmap v1024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:19.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:18 smithi159 ceph-mon[69013]: pgmap v1025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:18 smithi096 ceph-mon[101353]: pgmap v1025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:21.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:20 smithi159 ceph-mon[69013]: pgmap v1026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:20 smithi096 ceph-mon[101353]: pgmap v1026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:22 smithi159 ceph-mon[69013]: pgmap v1027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:22 smithi096 ceph-mon[101353]: pgmap v1027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:24 smithi159 ceph-mon[69013]: pgmap v1028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:24 smithi096 ceph-mon[101353]: pgmap v1028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:27.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:26 smithi159 ceph-mon[69013]: pgmap v1029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:26 smithi096 ceph-mon[101353]: pgmap v1029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:28.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:56:28.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:56:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:56:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:56:29.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:28 smithi159 ceph-mon[69013]: pgmap v1030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:29.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:28 smithi096 ceph-mon[101353]: pgmap v1030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:31.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:30 smithi159 ceph-mon[69013]: pgmap v1031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:30 smithi096 ceph-mon[101353]: pgmap v1031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:33.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:32 smithi159 ceph-mon[69013]: pgmap v1032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:33.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:32 smithi096 ceph-mon[101353]: pgmap v1032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:34.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- 172.21.15.96:0/2482900823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 msgr2=0x7f49140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:34.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 --2- 172.21.15.96:0/2482900823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f49140f7c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4904004660 tx=0x7f4904009b30).stop 2022-02-02T18:56:34.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- 172.21.15.96:0/2482900823 shutdown_connections 2022-02-02T18:56:34.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 --2- 172.21.15.96:0/2482900823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f49140f7c30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:34.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 --2- 172.21.15.96:0/2482900823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 0x7f49140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:34.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- 172.21.15.96:0/2482900823 >> 172.21.15.96:0/2482900823 conn(0x7f49140f1c90 msgr2=0x7f49140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:34.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- 172.21.15.96:0/2482900823 shutdown_connections 2022-02-02T18:56:34.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- 172.21.15.96:0/2482900823 wait complete. 2022-02-02T18:56:34.967 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:34 smithi096 ceph-mon[101353]: pgmap v1033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:34.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 Processor -- start 2022-02-02T18:56:34.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.969+0000 7f491aa3d700 1 -- start start 2022-02-02T18:56:34.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491aa3d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 0x7f491406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:34.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491aa3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:34.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491aa3d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491406a380 con 0x7f49140f77d0 2022-02-02T18:56:34.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491aa3d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491406a4c0 con 0x7f49140f6530 2022-02-02T18:56:34.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:34.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56866/0 (socket says 172.21.15.96:56866) 2022-02-02T18:56:34.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 -- 172.21.15.96:0/15350931 learned_addr learned my addr 172.21.15.96:0/15350931 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:34.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f4919a3b700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 0x7f491406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:34.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 -- 172.21.15.96:0/15350931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 msgr2=0x7f491406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:34.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 0x7f491406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:34.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 -- 172.21.15.96:0/15350931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904005040 con 0x7f49140f77d0 2022-02-02T18:56:34.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f491923a700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4904009990 tx=0x7f4904009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:34.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.970+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4904018070 con 0x7f49140f77d0 2022-02-02T18:56:34.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.971+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4904007ba0 con 0x7f49140f77d0 2022-02-02T18:56:34.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.971+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490401c620 con 0x7f49140f77d0 2022-02-02T18:56:34.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.971+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491406a740 con 0x7f49140f77d0 2022-02-02T18:56:34.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.971+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491406ac50 con 0x7f49140f77d0 2022-02-02T18:56:34.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.972+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914045ad0 con 0x7f49140f77d0 2022-02-02T18:56:34.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.973+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f490401c8e0 con 0x7f49140f77d0 2022-02-02T18:56:34.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.973+0000 7f490a7fc700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 0x7f49000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:34.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.973+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f49040838e0 con 0x7f49140f77d0 2022-02-02T18:56:34.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.973+0000 7f4919a3b700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 0x7f49000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:34.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.973+0000 7f4919a3b700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 0x7f49000672e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f491406b730 tx=0x7f4910009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:34.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:34.977+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4904051990 con 0x7f49140f77d0 2022-02-02T18:56:35.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:34 smithi159 ceph-mon[69013]: pgmap v1033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.157+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4914057f10 con 0x7f4900064e20 2022-02-02T18:56:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.158+0000 7f490a7fc700 1 -- 172.21.15.96:0/15350931 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4914057f10 con 0x7f4900064e20 2022-02-02T18:56:35.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 msgr2=0x7f49000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 0x7f49000672e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f491406b730 tx=0x7f4910009040).stop 2022-02-02T18:56:35.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 msgr2=0x7f4914069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4904009990 tx=0x7f4904009b30).stop 2022-02-02T18:56:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 shutdown_connections 2022-02-02T18:56:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4900064e20 0x7f49000672e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49140f6530 0x7f491406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 --2- 172.21.15.96:0/15350931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49140f77d0 0x7f4914069e20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 >> 172.21.15.96:0/15350931 conn(0x7f49140f1c90 msgr2=0x7f49140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 shutdown_connections 2022-02-02T18:56:35.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.160+0000 7f491aa3d700 1 -- 172.21.15.96:0/15350931 wait complete. 2022-02-02T18:56:35.165 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:56:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 -- 172.21.15.96:0/2039589090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f55c0 msgr2=0x7f0f740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2039589090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f55c0 0x7f0f740f59e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0f68004660 tx=0x7f0f68009b30).stop 2022-02-02T18:56:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 -- 172.21.15.96:0/2039589090 shutdown_connections 2022-02-02T18:56:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2039589090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f6860 0x7f0f740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2039589090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f55c0 0x7f0f740f59e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 -- 172.21.15.96:0/2039589090 >> 172.21.15.96:0/2039589090 conn(0x7f0f740f0d40 msgr2=0x7f0f740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 -- 172.21.15.96:0/2039589090 shutdown_connections 2022-02-02T18:56:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.258+0000 7f0f79b37700 1 -- 172.21.15.96:0/2039589090 wait complete. 2022-02-02T18:56:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 Processor -- start 2022-02-02T18:56:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 -- start start 2022-02-02T18:56:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f55c0 0x7f0f7410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740602b0 con 0x7f0f740f6860 2022-02-02T18:56:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f79b37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740603f0 con 0x7f0f740f55c0 2022-02-02T18:56:35.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56876/0 (socket says 172.21.15.96:56876) 2022-02-02T18:56:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.259+0000 7f0f72ffd700 1 -- 172.21.15.96:0/2541044560 learned_addr learned my addr 172.21.15.96:0/2541044560 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:35.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f72ffd700 1 -- 172.21.15.96:0/2541044560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f55c0 msgr2=0x7f0f7410c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f737fe700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f55c0 0x7f0f7410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f72ffd700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f55c0 0x7f0f7410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f72ffd700 1 -- 172.21.15.96:0/2541044560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68005040 con 0x7f0f740f6860 2022-02-02T18:56:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f72ffd700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0f6400c530 tx=0x7f0f64007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6400f650 con 0x7f0f740f6860 2022-02-02T18:56:35.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7410ea80 con 0x7f0f740f6860 2022-02-02T18:56:35.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f6400fc60 con 0x7f0f740f6860 2022-02-02T18:56:35.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f64012cd0 con 0x7f0f740f6860 2022-02-02T18:56:35.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.260+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7410ef00 con 0x7f0f740f6860 2022-02-02T18:56:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.261+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f74045ad0 con 0x7f0f740f6860 2022-02-02T18:56:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.261+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f64010070 con 0x7f0f740f6860 2022-02-02T18:56:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.262+0000 7f0f5bfff700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 0x7f0f5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.262+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0f640817d0 con 0x7f0f740f6860 2022-02-02T18:56:35.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.262+0000 7f0f737fe700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 0x7f0f5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.262+0000 7f0f737fe700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 0x7f0f5c067290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0f68009da0 tx=0x7f0f68009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.266+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f6404f880 con 0x7f0f740f6860 2022-02-02T18:56:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.440+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f74057f10 con 0x7f0f5c064dd0 2022-02-02T18:56:35.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.449+0000 7f0f5bfff700 1 -- 172.21.15.96:0/2541044560 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0f74057f10 con 0x7f0f5c064dd0 2022-02-02T18:56:35.445 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:56:35.445 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (39m) 10m ago 41m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:56:35.446 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (32m) 10m ago 40m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:56:35.446 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (32m) 8m ago 40m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:56:35.446 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (39m) 10m ago 40m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:56:35.446 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (37m) 10m ago 37m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:56:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (32m) 10m ago 37m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:56:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (37m) 8m ago 37m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:56:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (32m) 8m ago 37m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:56:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (34m) 10m ago 42m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:56:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (33m) 8m ago 40m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:56:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (33m) 10m ago 42m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:56:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (32m) 8m ago 40m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:56:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (40m) 10m ago 40m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:56:35.449 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (40m) 8m ago 40m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:56:35.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (32m) 10m ago 39m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:56:35.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (31m) 10m ago 39m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:56:35.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (30m) 10m ago 39m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:56:35.450 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (30m) 8m ago 38m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:56:35.450 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (29m) 8m ago 38m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:56:35.450 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (29m) 8m ago 38m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:56:35.450 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (39m) 10m ago 40m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:56:35.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 msgr2=0x7f0f5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 0x7f0f5c067290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0f68009da0 tx=0x7f0f68009b30).stop 2022-02-02T18:56:35.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 msgr2=0x7f0f7410e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0f6400c530 tx=0x7f0f64007e20).stop 2022-02-02T18:56:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 shutdown_connections 2022-02-02T18:56:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f5c064dd0 0x7f0f5c067290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f740f55c0 0x7f0f7410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 --2- 172.21.15.96:0/2541044560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f740f6860 0x7f0f7410e590 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 >> 172.21.15.96:0/2541044560 conn(0x7f0f740f0d40 msgr2=0x7f0f740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 shutdown_connections 2022-02-02T18:56:35.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.452+0000 7f0f79b37700 1 -- 172.21.15.96:0/2541044560 wait complete. 2022-02-02T18:56:35.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 -- 172.21.15.96:0/3461024600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 msgr2=0x7f9f740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/3461024600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f740f59e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9f5c004660 tx=0x7f9f5c009b30).stop 2022-02-02T18:56:35.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 -- 172.21.15.96:0/3461024600 shutdown_connections 2022-02-02T18:56:35.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/3461024600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f740f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/3461024600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f740f59e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 -- 172.21.15.96:0/3461024600 >> 172.21.15.96:0/3461024600 conn(0x7f9f740f0de0 msgr2=0x7f9f740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 -- 172.21.15.96:0/3461024600 shutdown_connections 2022-02-02T18:56:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.550+0000 7f9f78fb7700 1 -- 172.21.15.96:0/3461024600 wait complete. 2022-02-02T18:56:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 Processor -- start 2022-02-02T18:56:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 -- start start 2022-02-02T18:56:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f7410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74060410 con 0x7f9f740f55c0 2022-02-02T18:56:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f78fb7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74060550 con 0x7f9f740f5ed0 2022-02-02T18:56:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56884/0 (socket says 172.21.15.96:56884) 2022-02-02T18:56:35.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 -- 172.21.15.96:0/1495244446 learned_addr learned my addr 172.21.15.96:0/1495244446 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:35.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f71d9b700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f7410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 -- 172.21.15.96:0/1495244446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 msgr2=0x7f9f7410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f7410e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 -- 172.21.15.96:0/1495244446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c005040 con 0x7f9f740f55c0 2022-02-02T18:56:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f71d9b700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f7410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:56:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.551+0000 7f9f7259c700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9f5c009990 tx=0x7f9f5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.552+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c018070 con 0x7f9f740f55c0 2022-02-02T18:56:35.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.552+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f5c007ba0 con 0x7f9f740f55c0 2022-02-02T18:56:35.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.552+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7410ea80 con 0x7f9f740f55c0 2022-02-02T18:56:35.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.552+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c01c3c0 con 0x7f9f740f55c0 2022-02-02T18:56:35.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.552+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7410ee50 con 0x7f9f740f55c0 2022-02-02T18:56:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.553+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f74045ad0 con 0x7f9f740f55c0 2022-02-02T18:56:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.553+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f5c01d420 con 0x7f9f740f55c0 2022-02-02T18:56:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.554+0000 7f9f6affd700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 0x7f9f60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.554+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9f5c083150 con 0x7f9f740f55c0 2022-02-02T18:56:35.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.554+0000 7f9f71d9b700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 0x7f9f60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.554+0000 7f9f71d9b700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 0x7f9f60067290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f9f64009740 tx=0x7f9f64009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.558+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f5c051200 con 0x7f9f740f55c0 2022-02-02T18:56:35.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.787+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f740586e0 con 0x7f9f740f55c0 2022-02-02T18:56:35.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.788+0000 7f9f6affd700 1 -- 172.21.15.96:0/1495244446 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9f5c054820 con 0x7f9f740f55c0 2022-02-02T18:56:35.784 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:56:35.785 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:56:35.785 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:56:35.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:35.785 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:56:35.786 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:56:35.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:35.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:56:35.786 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:56:35.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:35.787 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:56:35.787 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:56:35.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:56:35.787 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:56:35.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:56:35.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:56:35.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:56:35.788 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:56:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 msgr2=0x7f9f60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 0x7f9f60067290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f9f64009740 tx=0x7f9f64009be0).stop 2022-02-02T18:56:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 msgr2=0x7f9f7410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9f5c009990 tx=0x7f9f5c009b30).stop 2022-02-02T18:56:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 shutdown_connections 2022-02-02T18:56:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f60064dd0 0x7f9f60067290 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f740f55c0 0x7f9f7410c090 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 --2- 172.21.15.96:0/1495244446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740f5ed0 0x7f9f7410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 >> 172.21.15.96:0/1495244446 conn(0x7f9f740f0de0 msgr2=0x7f9f740fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 shutdown_connections 2022-02-02T18:56:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.790+0000 7f9f78fb7700 1 -- 172.21.15.96:0/1495244446 wait complete. 2022-02-02T18:56:35.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 -- 172.21.15.96:0/1956554844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f55e0 msgr2=0x7fdc9c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 --2- 172.21.15.96:0/1956554844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0f5a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fdc8c004660 tx=0x7fdc8c009b30).stop 2022-02-02T18:56:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 -- 172.21.15.96:0/1956554844 shutdown_connections 2022-02-02T18:56:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 --2- 172.21.15.96:0/1956554844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 --2- 172.21.15.96:0/1956554844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0f5a00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 -- 172.21.15.96:0/1956554844 >> 172.21.15.96:0/1956554844 conn(0x7fdc9c0f0de0 msgr2=0x7fdc9c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 -- 172.21.15.96:0/1956554844 shutdown_connections 2022-02-02T18:56:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.887+0000 7fdca1365700 1 -- 172.21.15.96:0/1956554844 wait complete. 2022-02-02T18:56:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 Processor -- start 2022-02-02T18:56:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 -- start start 2022-02-02T18:56:35.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0fc1e0 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdca1365700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0fc320 con 0x7fdc9c0f55e0 2022-02-02T18:56:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdc9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdc9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56894/0 (socket says 172.21.15.96:56894) 2022-02-02T18:56:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.888+0000 7fdc9a7fc700 1 -- 172.21.15.96:0/1678607084 learned_addr learned my addr 172.21.15.96:0/1678607084 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:56:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc9affd700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc9a7fc700 1 -- 172.21.15.96:0/1678607084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f55e0 msgr2=0x7fdc9c0fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:35.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc9a7fc700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:35.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc9a7fc700 1 -- 172.21.15.96:0/1678607084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c005040 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc9a7fc700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fdc9000c510 tx=0x7fdc90007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9000f650 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc9000fc60 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c0fc600 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc90011c00 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.889+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c10efc0 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.890+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c045ad0 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.890+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc90010070 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.891+0000 7fdc837fe700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 0x7fdc84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:56:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.891+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdc900815e0 con 0x7fdc9c0f5ef0 2022-02-02T18:56:35.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.891+0000 7fdc9affd700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 0x7fdc84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:56:35.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.891+0000 7fdc9affd700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 0x7fdc84067290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fdc8c009da0 tx=0x7fdc8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:56:35.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:35.895+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc9004f690 con 0x7fdc9c0f5ef0 2022-02-02T18:56:36.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.098+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc9c027a00 con 0x7fdc9c0f5ef0 2022-02-02T18:56:36.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.099+0000 7fdc837fe700 1 -- 172.21.15.96:0/1678607084 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdc90017720 con 0x7fdc9c0f5ef0 2022-02-02T18:56:36.095 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:56:36.095 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:56:36.095 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:56:36.095 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:56:36.096 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:36.096 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:56:36.096 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:56:36.096 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:56:36.097 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:56:36.097 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:56:36.097 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:56:36.097 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:56:36.097 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:56:36.098 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:56:36.098 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:56:36.098 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:56:36.098 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:56:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:56:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:56:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:56:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:56:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:56:36.100 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:56:36.100 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:56:36.100 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:56:36.101 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:56:36.101 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:56:36.101 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:56:36.101 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:56:36.101 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:56:36.102 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:56:36.102 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:56:36.102 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:36.102 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:36.103 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:56:36.103 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:56:36.103 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:36.103 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:36.104 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:56:36.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 msgr2=0x7fdc84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 0x7fdc84067290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fdc8c009da0 tx=0x7fdc8c009b30).stop 2022-02-02T18:56:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 msgr2=0x7fdc9c0fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:56:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fdc9000c510 tx=0x7fdc90007e00).stop 2022-02-02T18:56:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 shutdown_connections 2022-02-02T18:56:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc84064dd0 0x7fdc84067290 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc9c0f55e0 0x7fdc9c0fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 --2- 172.21.15.96:0/1678607084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc9c0f5ef0 0x7fdc9c0fbc80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:56:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.100+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 >> 172.21.15.96:0/1678607084 conn(0x7fdc9c0f0de0 msgr2=0x7fdc9c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:56:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.101+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 shutdown_connections 2022-02-02T18:56:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:56:36.101+0000 7fdca1365700 1 -- 172.21.15.96:0/1678607084 wait complete. 2022-02-02T18:56:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:56:37.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:36 smithi159 ceph-mon[69013]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:36 smithi159 ceph-mon[69013]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:36 smithi159 ceph-mon[69013]: pgmap v1034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1495244446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:56:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1678607084' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:56:37.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:36 smithi096 ceph-mon[101353]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:36 smithi096 ceph-mon[101353]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:56:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:36 smithi096 ceph-mon[101353]: pgmap v1034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1495244446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:56:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1678607084' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:56:39.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:38 smithi159 ceph-mon[69013]: pgmap v1035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:39.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:38 smithi096 ceph-mon[101353]: pgmap v1035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:41.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:40 smithi159 ceph-mon[69013]: pgmap v1036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:41.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:40 smithi096 ceph-mon[101353]: pgmap v1036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:43.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:42 smithi159 ceph-mon[69013]: pgmap v1037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:42 smithi096 ceph-mon[101353]: pgmap v1037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:45.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:44 smithi159 ceph-mon[69013]: pgmap v1038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:45.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:44 smithi096 ceph-mon[101353]: pgmap v1038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:47.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:46 smithi159 ceph-mon[69013]: pgmap v1039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:47.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:46 smithi096 ceph-mon[101353]: pgmap v1039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:49.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:48 smithi159 ceph-mon[69013]: pgmap v1040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:49.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:48 smithi096 ceph-mon[101353]: pgmap v1040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:51.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:50 smithi159 ceph-mon[69013]: pgmap v1041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:51.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:50 smithi096 ceph-mon[101353]: pgmap v1041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:53.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:52 smithi159 ceph-mon[69013]: pgmap v1042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:53.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:52 smithi096 ceph-mon[101353]: pgmap v1042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:55.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:54 smithi159 ceph-mon[69013]: pgmap v1043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:55.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:54 smithi096 ceph-mon[101353]: pgmap v1043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:57.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:56 smithi159 ceph-mon[69013]: pgmap v1044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:57.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:56 smithi096 ceph-mon[101353]: pgmap v1044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:59.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:56:58 smithi159 ceph-mon[69013]: pgmap v1045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:56:59.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:56:58 smithi096 ceph-mon[101353]: pgmap v1045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:01.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:00 smithi159 ceph-mon[69013]: pgmap v1046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:01.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:00 smithi096 ceph-mon[101353]: pgmap v1046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:03.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:02 smithi159 ceph-mon[69013]: pgmap v1047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:03.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:02 smithi096 ceph-mon[101353]: pgmap v1047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:05.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:04 smithi159 ceph-mon[69013]: pgmap v1048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:05.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:04 smithi096 ceph-mon[101353]: pgmap v1048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 -- 172.21.15.96:0/1966453502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f66e0 msgr2=0x7f347c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 --2- 172.21.15.96:0/1966453502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f66e0 0x7f347c0f6b00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f346c004660 tx=0x7f346c009b30).stop 2022-02-02T18:57:06.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 -- 172.21.15.96:0/1966453502 shutdown_connections 2022-02-02T18:57:06.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 --2- 172.21.15.96:0/1966453502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f7980 0x7f347c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 --2- 172.21.15.96:0/1966453502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f66e0 0x7f347c0f6b00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 -- 172.21.15.96:0/1966453502 >> 172.21.15.96:0/1966453502 conn(0x7f347c0f1e40 msgr2=0x7f347c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 -- 172.21.15.96:0/1966453502 shutdown_connections 2022-02-02T18:57:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.212+0000 7f3484352700 1 -- 172.21.15.96:0/1966453502 wait complete. 2022-02-02T18:57:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 Processor -- start 2022-02-02T18:57:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 -- start start 2022-02-02T18:57:06.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 0x7f347c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c107a50 con 0x7f347c0f7980 2022-02-02T18:57:06.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f3484352700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c107b90 con 0x7f347c0f66e0 2022-02-02T18:57:06.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56916/0 (socket says 172.21.15.96:56916) 2022-02-02T18:57:06.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 -- 172.21.15.96:0/3015514146 learned_addr learned my addr 172.21.15.96:0/3015514146 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:06.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34820ee700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 0x7f347c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 -- 172.21.15.96:0/3015514146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 msgr2=0x7f347c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 0x7f347c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34818ed700 1 -- 172.21.15.96:0/3015514146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c005040 con 0x7f347c0f7980 2022-02-02T18:57:06.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.213+0000 7f34820ee700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 0x7f347c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:57:06.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f34818ed700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f347800c790 tx=0x7f3478007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347800e680 con 0x7f347c0f7980 2022-02-02T18:57:06.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f347800ec90 con 0x7f347c0f7980 2022-02-02T18:57:06.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c108530 con 0x7f347c0f7980 2022-02-02T18:57:06.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3478013d60 con 0x7f347c0f7980 2022-02-02T18:57:06.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.214+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c108af0 con 0x7f347c0f7980 2022-02-02T18:57:06.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.215+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c045ad0 con 0x7f347c0f7980 2022-02-02T18:57:06.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.216+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f347801a060 con 0x7f347c0f7980 2022-02-02T18:57:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.216+0000 7f3472ffd700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.216+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3478081e20 con 0x7f347c0f7980 2022-02-02T18:57:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.216+0000 7f34820ee700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.217+0000 7f34820ee700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f346c004e30 tx=0x7f346c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.220+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3478053980 con 0x7f347c0f7980 2022-02-02T18:57:06.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.399+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f347c0fef80 con 0x7f3468064dd0 2022-02-02T18:57:06.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.400+0000 7f3472ffd700 1 -- 172.21.15.96:0/3015514146 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f347c0fef80 con 0x7f3468064dd0 2022-02-02T18:57:06.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 msgr2=0x7f3468067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f346c004e30 tx=0x7f346c009b30).stop 2022-02-02T18:57:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 msgr2=0x7f347c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f347800c790 tx=0x7f3478007d70).stop 2022-02-02T18:57:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 shutdown_connections 2022-02-02T18:57:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f66e0 0x7f347c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 --2- 172.21.15.96:0/3015514146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f7980 0x7f347c1074a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 >> 172.21.15.96:0/3015514146 conn(0x7f347c0f1e40 msgr2=0x7f347c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 shutdown_connections 2022-02-02T18:57:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.402+0000 7f3484352700 1 -- 172.21.15.96:0/3015514146 wait complete. 2022-02-02T18:57:06.406 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:57:06.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.499+0000 7fd1e9098700 1 -- 172.21.15.96:0/1299501621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f6530 msgr2=0x7fd1e40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.499+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1299501621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f6530 0x7fd1e40f6950 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fd1d8004660 tx=0x7fd1d8009b30).stop 2022-02-02T18:57:06.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 -- 172.21.15.96:0/1299501621 shutdown_connections 2022-02-02T18:57:06.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1299501621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f77d0 0x7fd1e40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1299501621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f6530 0x7fd1e40f6950 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 -- 172.21.15.96:0/1299501621 >> 172.21.15.96:0/1299501621 conn(0x7fd1e40f1c90 msgr2=0x7fd1e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 -- 172.21.15.96:0/1299501621 shutdown_connections 2022-02-02T18:57:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 -- 172.21.15.96:0/1299501621 wait complete. 2022-02-02T18:57:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 Processor -- start 2022-02-02T18:57:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.500+0000 7fd1e9098700 1 -- start start 2022-02-02T18:57:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e9098700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f6530 0x7fd1e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e9098700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e9098700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e406a380 con 0x7fd1e40f77d0 2022-02-02T18:57:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e9098700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e406a4c0 con 0x7fd1e40f6530 2022-02-02T18:57:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56926/0 (socket says 172.21.15.96:56926) 2022-02-02T18:57:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 -- 172.21.15.96:0/1940112086 learned_addr learned my addr 172.21.15.96:0/1940112086 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e3fff700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f6530 0x7fd1e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 -- 172.21.15.96:0/1940112086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f6530 msgr2=0x7fd1e406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f6530 0x7fd1e406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 -- 172.21.15.96:0/1940112086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8005040 con 0x7fd1e40f77d0 2022-02-02T18:57:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e37fe700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fd1d40026d0 tx=0x7fd1d4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d40079c0 con 0x7fd1e40f77d0 2022-02-02T18:57:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e406a7a0 con 0x7fd1e40f77d0 2022-02-02T18:57:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1d400f040 con 0x7fd1e40f77d0 2022-02-02T18:57:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.501+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d40148b0 con 0x7fd1e40f77d0 2022-02-02T18:57:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.502+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e410edc0 con 0x7fd1e40f77d0 2022-02-02T18:57:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.502+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e4045ad0 con 0x7fd1e40f77d0 2022-02-02T18:57:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.503+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd1d4007b20 con 0x7fd1e40f77d0 2022-02-02T18:57:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.503+0000 7fd1e0ff9700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 0x7fd1cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.503+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd1d4081950 con 0x7fd1e40f77d0 2022-02-02T18:57:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.503+0000 7fd1e3fff700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 0x7fd1cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.504+0000 7fd1e3fff700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 0x7fd1cc0672e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd1d8013690 tx=0x7fd1d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.508+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1d404fa00 con 0x7fd1e40f77d0 2022-02-02T18:57:06.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.685+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1e4057f10 con 0x7fd1cc064e20 2022-02-02T18:57:06.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.694+0000 7fd1e0ff9700 1 -- 172.21.15.96:0/1940112086 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd1e4057f10 con 0x7fd1cc064e20 2022-02-02T18:57:06.689 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:57:06.689 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (40m) 11m ago 41m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:57:06.690 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (32m) 11m ago 41m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:57:06.690 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (32m) 9m ago 41m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:57:06.690 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (40m) 11m ago 41m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:57:06.690 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (37m) 11m ago 37m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:57:06.691 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (33m) 11m ago 37m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:57:06.691 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (37m) 9m ago 37m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:57:06.691 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (33m) 9m ago 37m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:57:06.691 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (34m) 11m ago 42m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:57:06.691 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (34m) 9m ago 41m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:57:06.692 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (33m) 11m ago 42m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:57:06.692 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (33m) 9m ago 40m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:57:06.692 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (41m) 11m ago 41m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:57:06.692 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (40m) 9m ago 40m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:57:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (32m) 11m ago 40m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:57:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (31m) 11m ago 40m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:57:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (31m) 11m ago 39m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:57:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (30m) 9m ago 39m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:57:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (30m) 9m ago 39m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:57:06.694 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (29m) 9m ago 38m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:57:06.694 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (40m) 11m ago 41m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:57:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 msgr2=0x7fd1cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 0x7fd1cc0672e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd1d8013690 tx=0x7fd1d8009b30).stop 2022-02-02T18:57:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 msgr2=0x7fd1e4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fd1d40026d0 tx=0x7fd1d4009de0).stop 2022-02-02T18:57:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 shutdown_connections 2022-02-02T18:57:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1cc064e20 0x7fd1cc0672e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1e40f6530 0x7fd1e406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 --2- 172.21.15.96:0/1940112086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1e40f77d0 0x7fd1e4069e20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 >> 172.21.15.96:0/1940112086 conn(0x7fd1e40f1c90 msgr2=0x7fd1e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:06.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 shutdown_connections 2022-02-02T18:57:06.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.697+0000 7fd1e9098700 1 -- 172.21.15.96:0/1940112086 wait complete. 2022-02-02T18:57:06.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.793+0000 7f26c9c3f700 1 -- 172.21.15.96:0/855830008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 msgr2=0x7f26c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.793+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/855830008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c40f59e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f26b8004660 tx=0x7f26b8009b30).stop 2022-02-02T18:57:06.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 -- 172.21.15.96:0/855830008 shutdown_connections 2022-02-02T18:57:06.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/855830008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 0x7f26c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:57:06.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/855830008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c40f59e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 -- 172.21.15.96:0/855830008 >> 172.21.15.96:0/855830008 conn(0x7f26c40f0d40 msgr2=0x7f26c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:06.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:06 smithi096 ceph-mon[101353]: pgmap v1049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:06.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 -- 172.21.15.96:0/855830008 shutdown_connections 2022-02-02T18:57:06.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 -- 172.21.15.96:0/855830008 wait complete. 2022-02-02T18:57:06.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.794+0000 7f26c9c3f700 1 Processor -- start 2022-02-02T18:57:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c9c3f700 1 -- start start 2022-02-02T18:57:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c9c3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c9c3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 0x7f26c4109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c9c3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4109cb0 con 0x7f26c40f55c0 2022-02-02T18:57:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c9c3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c410a560 con 0x7f26c40f6860 2022-02-02T18:57:06.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56934/0 (socket says 172.21.15.96:56934) 2022-02-02T18:57:06.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 -- 172.21.15.96:0/1443542594 learned_addr learned my addr 172.21.15.96:0/1443542594 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:06.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c2ffd700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 0x7f26c4109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 -- 172.21.15.96:0/1443542594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 msgr2=0x7f26c4109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:06.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 0x7f26c4109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:06.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.795+0000 7f26c37fe700 1 -- 172.21.15.96:0/1443542594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8005040 con 0x7f26c40f55c0 2022-02-02T18:57:06.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26c37fe700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f26b8004f60 tx=0x7f26b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b8018070 con 0x7f26c40f55c0 2022-02-02T18:57:06.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26b8007ba0 con 0x7f26c40f55c0 2022-02-02T18:57:06.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c410a7e0 con 0x7f26c40f55c0 2022-02-02T18:57:06.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c410ad40 con 0x7f26c40f55c0 2022-02-02T18:57:06.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.796+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b801c620 con 0x7f26c40f55c0 2022-02-02T18:57:06.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.797+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4004fa0 con 0x7f26c40f55c0 2022-02-02T18:57:06.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.797+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26b801c8e0 con 0x7f26c40f55c0 2022-02-02T18:57:06.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.798+0000 7f26abfff700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 0x7f26ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:06.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.798+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f26b8083900 con 0x7f26c40f55c0 2022-02-02T18:57:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.798+0000 7f26c2ffd700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 0x7f26ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.798+0000 7f26c2ffd700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 0x7f26ac067290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f26b400b790 tx=0x7f26b4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:06.802+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26b80553e0 con 0x7f26c40f55c0 2022-02-02T18:57:07.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:06 smithi159 ceph-mon[69013]: pgmap v1049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:07.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.033+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26a4005e80 con 0x7f26c40f55c0 2022-02-02T18:57:07.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.034+0000 7f26abfff700 1 -- 172.21.15.96:0/1443542594 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f26b8054fd0 con 0x7f26c40f55c0 2022-02-02T18:57:07.030 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:57:07.031 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:57:07.031 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:57:07.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:07.032 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:57:07.032 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:57:07.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:07.034 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:57:07.034 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:57:07.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:07.034 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:57:07.035 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:57:07.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:07.035 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:57:07.035 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:57:07.036 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:57:07.036 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:57:07.036 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:57:07.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 msgr2=0x7f26ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 0x7f26ac067290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f26b400b790 tx=0x7f26b4008040).stop 2022-02-02T18:57:07.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 msgr2=0x7f26c4109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f26b8004f60 tx=0x7f26b8009b30).stop 2022-02-02T18:57:07.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 shutdown_connections 2022-02-02T18:57:07.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26ac064dd0 0x7f26ac067290 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26c40f55c0 0x7f26c4109180 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 --2- 172.21.15.96:0/1443542594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c40f6860 0x7f26c4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.035+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 >> 172.21.15.96:0/1443542594 conn(0x7f26c40f0d40 msgr2=0x7f26c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:07.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.036+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 shutdown_connections 2022-02-02T18:57:07.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.036+0000 7f26c9c3f700 1 -- 172.21.15.96:0/1443542594 wait complete. 2022-02-02T18:57:07.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 -- 172.21.15.96:0/4025437686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f6530 msgr2=0x7eff6c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 --2- 172.21.15.96:0/4025437686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f6530 0x7eff6c0f6950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7eff5c004660 tx=0x7eff5c009b30).stop 2022-02-02T18:57:07.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 -- 172.21.15.96:0/4025437686 shutdown_connections 2022-02-02T18:57:07.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 --2- 172.21.15.96:0/4025437686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f77d0 0x7eff6c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 --2- 172.21.15.96:0/4025437686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f6530 0x7eff6c0f6950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 -- 172.21.15.96:0/4025437686 >> 172.21.15.96:0/4025437686 conn(0x7eff6c0f1c90 msgr2=0x7eff6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 -- 172.21.15.96:0/4025437686 shutdown_connections 2022-02-02T18:57:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.133+0000 7eff709ae700 1 -- 172.21.15.96:0/4025437686 wait complete. 2022-02-02T18:57:07.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 Processor -- start 2022-02-02T18:57:07.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 -- start start 2022-02-02T18:57:07.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:07.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:07.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06a380 con 0x7eff6c0f77d0 2022-02-02T18:57:07.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff709ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06a4c0 con 0x7eff6c0f6530 2022-02-02T18:57:07.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:07.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56946/0 (socket says 172.21.15.96:56946) 2022-02-02T18:57:07.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff6a59c700 1 -- 172.21.15.96:0/3567435101 learned_addr learned my addr 172.21.15.96:0/3567435101 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.134+0000 7eff6ad9d700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff6a59c700 1 -- 172.21.15.96:0/3567435101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f6530 msgr2=0x7eff6c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff6a59c700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff6a59c700 1 -- 172.21.15.96:0/3567435101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c005040 con 0x7eff6c0f77d0 2022-02-02T18:57:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff6a59c700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7eff600026d0 tx=0x7eff60009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:07.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff600079c0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff6000f040 con 0x7eff6c0f77d0 2022-02-02T18:57:07.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c06a7a0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff600148b0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.135+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c10edc0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.136+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c045ad0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.136+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff60007b20 con 0x7eff6c0f77d0 2022-02-02T18:57:07.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.137+0000 7eff537fe700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 0x7eff540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:07.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.137+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7eff60081a30 con 0x7eff6c0f77d0 2022-02-02T18:57:07.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.137+0000 7eff6ad9d700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 0x7eff540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:07.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.137+0000 7eff6ad9d700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 0x7eff540672e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7eff5c013690 tx=0x7eff5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:07.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.141+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff6004fae0 con 0x7eff6c0f77d0 2022-02-02T18:57:07.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.343+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff6c027a00 con 0x7eff6c0f77d0 2022-02-02T18:57:07.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.344+0000 7eff537fe700 1 -- 172.21.15.96:0/3567435101 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7eff60053100 con 0x7eff6c0f77d0 2022-02-02T18:57:07.379 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:57:07.380 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:57:07.380 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:57:07.380 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:57:07.380 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:57:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:57:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:57:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:57:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:57:07.382 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:57:07.382 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:57:07.382 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:57:07.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:57:07.383 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:57:07.383 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:57:07.383 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:57:07.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:57:07.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:57:07.384 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:57:07.384 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:57:07.384 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:57:07.384 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:57:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:57:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:57:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:57:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:57:07.385 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:57:07.386 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:57:07.386 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:57:07.386 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:57:07.386 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:57:07.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:07.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:07.387 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:57:07.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:07.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:07.388 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:07.388 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:07.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 msgr2=0x7eff540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 0x7eff540672e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7eff5c013690 tx=0x7eff5c009b30).stop 2022-02-02T18:57:07.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 msgr2=0x7eff6c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:07.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7eff600026d0 tx=0x7eff60009de0).stop 2022-02-02T18:57:07.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 shutdown_connections 2022-02-02T18:57:07.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff54064e20 0x7eff540672e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 --2- 172.21.15.96:0/3567435101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:07.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.345+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 >> 172.21.15.96:0/3567435101 conn(0x7eff6c0f1c90 msgr2=0x7eff6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:07.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.346+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 shutdown_connections 2022-02-02T18:57:07.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:07.346+0000 7eff709ae700 1 -- 172.21.15.96:0/3567435101 wait complete. 2022-02-02T18:57:07.392 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:57:08.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:07 smithi159 ceph-mon[69013]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:07 smithi159 ceph-mon[69013]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1443542594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:57:08.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3567435101' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:57:08.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:07 smithi096 ceph-mon[101353]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:07 smithi096 ceph-mon[101353]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1443542594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:57:08.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3567435101' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:57:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:08 smithi159 ceph-mon[69013]: pgmap v1050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:09.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:08 smithi096 ceph-mon[101353]: pgmap v1050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:11.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:10 smithi159 ceph-mon[69013]: pgmap v1051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:10 smithi096 ceph-mon[101353]: pgmap v1051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:13.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:12 smithi159 ceph-mon[69013]: pgmap v1052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:13.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:12 smithi096 ceph-mon[101353]: pgmap v1052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:15.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:14 smithi159 ceph-mon[69013]: pgmap v1053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:15.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:14 smithi096 ceph-mon[101353]: pgmap v1053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:16 smithi159 ceph-mon[69013]: pgmap v1054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:17.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:16 smithi096 ceph-mon[101353]: pgmap v1054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:19.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:18 smithi159 ceph-mon[69013]: pgmap v1055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:18 smithi096 ceph-mon[101353]: pgmap v1055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:21.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:20 smithi159 ceph-mon[69013]: pgmap v1056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:20 smithi096 ceph-mon[101353]: pgmap v1056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:22 smithi159 ceph-mon[69013]: pgmap v1057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:22 smithi096 ceph-mon[101353]: pgmap v1057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:25.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:24 smithi159 ceph-mon[69013]: pgmap v1058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:24 smithi096 ceph-mon[101353]: pgmap v1058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:27.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:26 smithi159 ceph-mon[69013]: pgmap v1059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:26 smithi096 ceph-mon[101353]: pgmap v1059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:28.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:57:28.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:57:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:57:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:57:29.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:28 smithi159 ceph-mon[69013]: pgmap v1060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:29.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:28 smithi096 ceph-mon[101353]: pgmap v1060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:31.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:30 smithi159 ceph-mon[69013]: pgmap v1061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:30 smithi096 ceph-mon[101353]: pgmap v1061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:33.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:32 smithi159 ceph-mon[69013]: pgmap v1062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:33.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:32 smithi096 ceph-mon[101353]: pgmap v1062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:35.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:34 smithi159 ceph-mon[69013]: pgmap v1063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:35.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:34 smithi096 ceph-mon[101353]: pgmap v1063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:37.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:36 smithi159 ceph-mon[69013]: pgmap v1064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:37.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:36 smithi096 ceph-mon[101353]: pgmap v1064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:37.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/2700859005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f66c0 msgr2=0x7f3ff80f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/2700859005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f66c0 0x7f3ff80f6ae0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f3fec004660 tx=0x7f3fec009b30).stop 2022-02-02T18:57:37.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/2700859005 shutdown_connections 2022-02-02T18:57:37.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/2700859005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f7960 0x7f3ff80f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/2700859005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f66c0 0x7f3ff80f6ae0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/2700859005 >> 172.21.15.96:0/2700859005 conn(0x7f3ff80f1e20 msgr2=0x7f3ff80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:37.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/2700859005 shutdown_connections 2022-02-02T18:57:37.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.456+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/2700859005 wait complete. 2022-02-02T18:57:37.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 Processor -- start 2022-02-02T18:57:37.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 -- start start 2022-02-02T18:57:37.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f66c0 0x7f3ff806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff806a380 con 0x7f3ff80f7960 2022-02-02T18:57:37.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ffd3b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff806a4c0 con 0x7f3ff80f66c0 2022-02-02T18:57:37.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ff67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ff67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56968/0 (socket says 172.21.15.96:56968) 2022-02-02T18:57:37.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.457+0000 7f3ff67fc700 1 -- 172.21.15.96:0/306553142 learned_addr learned my addr 172.21.15.96:0/306553142 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:37.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ff6ffd700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f66c0 0x7f3ff806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ff67fc700 1 -- 172.21.15.96:0/306553142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f66c0 msgr2=0x7f3ff806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ff67fc700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f66c0 0x7f3ff806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ff67fc700 1 -- 172.21.15.96:0/306553142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec005040 con 0x7f3ff80f7960 2022-02-02T18:57:37.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ff67fc700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3fe800e7f0 tx=0x7f3fe800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:37.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe80092e0 con 0x7f3ff80f7960 2022-02-02T18:57:37.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fe800f040 con 0x7f3ff80f7960 2022-02-02T18:57:37.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff806a7a0 con 0x7f3ff80f7960 2022-02-02T18:57:37.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe8014750 con 0x7f3ff80f7960 2022-02-02T18:57:37.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.458+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff810ef20 con 0x7f3ff80f7960 2022-02-02T18:57:37.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.459+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff8045ad0 con 0x7f3ff80f7960 2022-02-02T18:57:37.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.460+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fe801b030 con 0x7f3ff80f7960 2022-02-02T18:57:37.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.460+0000 7f3fdf7fe700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 0x7f3fe0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.460+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3fe8081770 con 0x7f3ff80f7960 2022-02-02T18:57:37.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.460+0000 7f3ff6ffd700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 0x7f3fe0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.461+0000 7f3ff6ffd700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 0x7f3fe0067290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3fec000c00 tx=0x7f3fec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:37.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.464+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fe804f8d0 con 0x7f3ff80f7960 2022-02-02T18:57:37.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.643+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ff8057f10 con 0x7f3fe0064dd0 2022-02-02T18:57:37.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.644+0000 7f3fdf7fe700 1 -- 172.21.15.96:0/306553142 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3ff8057f10 con 0x7f3fe0064dd0 2022-02-02T18:57:37.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 msgr2=0x7f3fe0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 0x7f3fe0067290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3fec000c00 tx=0x7f3fec00b040).stop 2022-02-02T18:57:37.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 msgr2=0x7f3ff8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3fe800e7f0 tx=0x7f3fe800b040).stop 2022-02-02T18:57:37.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 shutdown_connections 2022-02-02T18:57:37.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fe0064dd0 0x7f3fe0067290 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ff80f66c0 0x7f3ff806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 --2- 172.21.15.96:0/306553142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ff80f7960 0x7f3ff8069e20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 >> 172.21.15.96:0/306553142 conn(0x7f3ff80f1e20 msgr2=0x7f3ff80fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:37.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 shutdown_connections 2022-02-02T18:57:37.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.646+0000 7f3ffd3b2700 1 -- 172.21.15.96:0/306553142 wait complete. 2022-02-02T18:57:37.651 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:57:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 -- 172.21.15.96:0/2994538796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 msgr2=0x7f7d780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/2994538796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d780f6b00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f7d6c004660 tx=0x7f7d6c009b30).stop 2022-02-02T18:57:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 -- 172.21.15.96:0/2994538796 shutdown_connections 2022-02-02T18:57:37.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/2994538796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 0x7f7d780f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/2994538796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d780f6b00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 -- 172.21.15.96:0/2994538796 >> 172.21.15.96:0/2994538796 conn(0x7f7d780f1e40 msgr2=0x7f7d780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:37.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.745+0000 7f7d7eb23700 1 -- 172.21.15.96:0/2994538796 shutdown_connections 2022-02-02T18:57:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 -- 172.21.15.96:0/2994538796 wait complete. 2022-02-02T18:57:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 Processor -- start 2022-02-02T18:57:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 -- start start 2022-02-02T18:57:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 0x7f7d781074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78107a50 con 0x7f7d780f66e0 2022-02-02T18:57:37.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.746+0000 7f7d7eb23700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78107b90 con 0x7f7d780f7980 2022-02-02T18:57:37.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56976/0 (socket says 172.21.15.96:56976) 2022-02-02T18:57:37.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 -- 172.21.15.96:0/3671859920 learned_addr learned my addr 172.21.15.96:0/3671859920 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:37.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d77fff700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 0x7f7d781074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 -- 172.21.15.96:0/3671859920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 msgr2=0x7f7d781074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 0x7f7d781074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 -- 172.21.15.96:0/3671859920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c005040 con 0x7f7d780f66e0 2022-02-02T18:57:37.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7c8bf700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f7d6c013a70 tx=0x7f7d6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:37.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6c018070 con 0x7f7d780f66e0 2022-02-02T18:57:37.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d6c0097d0 con 0x7f7d780f66e0 2022-02-02T18:57:37.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d781084d0 con 0x7f7d780f66e0 2022-02-02T18:57:37.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6c01de80 con 0x7f7d780f66e0 2022-02-02T18:57:37.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.747+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d78108a30 con 0x7f7d780f66e0 2022-02-02T18:57:37.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.748+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78045ad0 con 0x7f7d780f66e0 2022-02-02T18:57:37.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.749+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d6c007ba0 con 0x7f7d780f66e0 2022-02-02T18:57:37.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.749+0000 7f7d757fa700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 0x7f7d68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:37.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.749+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7d6c0836a0 con 0x7f7d780f66e0 2022-02-02T18:57:37.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.749+0000 7f7d77fff700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 0x7f7d68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:37.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.750+0000 7f7d77fff700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 0x7f7d68067290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f7d64004c40 tx=0x7f7d6400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:37.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.754+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d6c055180 con 0x7f7d780f66e0 2022-02-02T18:57:37.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.926+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d780fef10 con 0x7f7d68064dd0 2022-02-02T18:57:37.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.935+0000 7f7d757fa700 1 -- 172.21.15.96:0/3671859920 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7d780fef10 con 0x7f7d68064dd0 2022-02-02T18:57:37.930 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:57:37.930 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (41m) 11m ago 42m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:57:37.930 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (33m) 11m ago 42m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:57:37.931 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (33m) 10m ago 41m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:57:37.931 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (40m) 11m ago 41m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:57:37.931 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (38m) 11m ago 38m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:57:37.931 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (33m) 11m ago 38m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:57:37.932 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (38m) 10m ago 38m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:57:37.932 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (33m) 10m ago 38m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:57:37.932 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (35m) 11m ago 43m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:57:37.932 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (34m) 10m ago 41m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:57:37.933 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (34m) 11m ago 43m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:57:37.933 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (33m) 10m ago 41m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:57:37.933 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (41m) 11m ago 41m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:57:37.933 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (41m) 10m ago 41m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:57:37.934 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (33m) 11m ago 40m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:57:37.934 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (32m) 11m ago 40m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:57:37.934 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (31m) 11m ago 40m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:57:37.934 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (31m) 10m ago 39m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:57:37.935 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (30m) 10m ago 39m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:57:37.935 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (30m) 10m ago 39m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:57:37.935 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (40m) 11m ago 41m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:57:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 msgr2=0x7f7d68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 0x7f7d68067290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f7d64004c40 tx=0x7f7d6400b040).stop 2022-02-02T18:57:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 msgr2=0x7f7d78106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f7d6c013a70 tx=0x7f7d6c009b30).stop 2022-02-02T18:57:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 shutdown_connections 2022-02-02T18:57:37.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d68064dd0 0x7f7d68067290 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d780f66e0 0x7f7d78106fb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 --2- 172.21.15.96:0/3671859920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d780f7980 0x7f7d781074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:37.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 >> 172.21.15.96:0/3671859920 conn(0x7f7d780f1e40 msgr2=0x7f7d780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:37.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 shutdown_connections 2022-02-02T18:57:37.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:37.937+0000 7f7d7eb23700 1 -- 172.21.15.96:0/3671859920 wait complete. 2022-02-02T18:57:38.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 -- 172.21.15.96:0/2532633029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 msgr2=0x7fe9c80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 --2- 172.21.15.96:0/2532633029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c80f6b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fe9b0004660 tx=0x7fe9b0009b30).stop 2022-02-02T18:57:38.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 -- 172.21.15.96:0/2532633029 shutdown_connections 2022-02-02T18:57:38.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 --2- 172.21.15.96:0/2532633029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 0x7fe9c80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 --2- 172.21.15.96:0/2532633029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c80f6b00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 -- 172.21.15.96:0/2532633029 >> 172.21.15.96:0/2532633029 conn(0x7fe9c80f1e40 msgr2=0x7fe9c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:38.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 -- 172.21.15.96:0/2532633029 shutdown_connections 2022-02-02T18:57:38.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.034+0000 7fe9cccff700 1 -- 172.21.15.96:0/2532633029 wait complete. 2022-02-02T18:57:38.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 Processor -- start 2022-02-02T18:57:38.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 -- start start 2022-02-02T18:57:38.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 0x7fe9c8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c806a380 con 0x7fe9c80f66e0 2022-02-02T18:57:38.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9cccff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c806a4c0 con 0x7fe9c80f7980 2022-02-02T18:57:38.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56986/0 (socket says 172.21.15.96:56986) 2022-02-02T18:57:38.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9c659c700 1 -- 172.21.15.96:0/1792043661 learned_addr learned my addr 172.21.15.96:0/1792043661 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:38.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9c659c700 1 -- 172.21.15.96:0/1792043661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 msgr2=0x7fe9c8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.035+0000 7fe9c5d9b700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 0x7fe9c8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9c659c700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 0x7fe9c8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9c659c700 1 -- 172.21.15.96:0/1792043661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0005040 con 0x7fe9c80f66e0 2022-02-02T18:57:38.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9c659c700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fe9b0004f60 tx=0x7fe9b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:38.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b0018070 con 0x7fe9c80f66e0 2022-02-02T18:57:38.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe9b0007ba0 con 0x7fe9c80f66e0 2022-02-02T18:57:38.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c806a740 con 0x7fe9c80f66e0 2022-02-02T18:57:38.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b001c620 con 0x7fe9c80f66e0 2022-02-02T18:57:38.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.036+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c806aca0 con 0x7fe9c80f66e0 2022-02-02T18:57:38.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.037+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c8045ad0 con 0x7fe9c80f66e0 2022-02-02T18:57:38.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.038+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe9b001d420 con 0x7fe9c80f66e0 2022-02-02T18:57:38.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.038+0000 7fe9beffd700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 0x7fe9b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.038+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe9b00838e0 con 0x7fe9c80f66e0 2022-02-02T18:57:38.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.038+0000 7fe9c5d9b700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 0x7fe9b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.038+0000 7fe9c5d9b700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 0x7fe9b4067290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe9b80041d0 tx=0x7fe9b8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:38.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.042+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe9b0051990 con 0x7fe9c80f66e0 2022-02-02T18:57:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.273+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9c8027a00 con 0x7fe9c80f66e0 2022-02-02T18:57:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.273+0000 7fe9beffd700 1 -- 172.21.15.96:0/1792043661 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe9b0054fb0 con 0x7fe9c80f66e0 2022-02-02T18:57:38.268 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:57:38.269 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:57:38.269 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:57:38.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:38.269 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:57:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:57:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:57:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:57:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:38.271 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:57:38.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:57:38.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:57:38.271 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:57:38.272 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:57:38.272 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:57:38.272 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:57:38.272 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:57:38.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 msgr2=0x7fe9b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 0x7fe9b4067290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe9b80041d0 tx=0x7fe9b8009040).stop 2022-02-02T18:57:38.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 msgr2=0x7fe9c806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fe9b0004f60 tx=0x7fe9b0009b30).stop 2022-02-02T18:57:38.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 shutdown_connections 2022-02-02T18:57:38.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9b4064dd0 0x7fe9b4067290 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9c80f66e0 0x7fe9c806b9a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 --2- 172.21.15.96:0/1792043661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80f7980 0x7fe9c8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 >> 172.21.15.96:0/1792043661 conn(0x7fe9c80f1e40 msgr2=0x7fe9c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:38.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 shutdown_connections 2022-02-02T18:57:38.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.275+0000 7fe9cccff700 1 -- 172.21.15.96:0/1792043661 wait complete. 2022-02-02T18:57:38.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 -- 172.21.15.96:0/4050348354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f6c60 msgr2=0x7fcce40f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4050348354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f6c60 0x7fcce40f7080 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fccd4004660 tx=0x7fccd4009b30).stop 2022-02-02T18:57:38.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 -- 172.21.15.96:0/4050348354 shutdown_connections 2022-02-02T18:57:38.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4050348354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f5970 0x7fcce40f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4050348354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f6c60 0x7fcce40f7080 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 -- 172.21.15.96:0/4050348354 >> 172.21.15.96:0/4050348354 conn(0x7fcce40f04c0 msgr2=0x7fcce40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:38.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 -- 172.21.15.96:0/4050348354 shutdown_connections 2022-02-02T18:57:38.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.374+0000 7fccebe7e700 1 -- 172.21.15.96:0/4050348354 wait complete. 2022-02-02T18:57:38.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 Processor -- start 2022-02-02T18:57:38.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 -- start start 2022-02-02T18:57:38.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f6c60 0x7fcce410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40f5660 con 0x7fcce40f5970 2022-02-02T18:57:38.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fccebe7e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40f57a0 con 0x7fcce40f6c60 2022-02-02T18:57:38.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56996/0 (socket says 172.21.15.96:56996) 2022-02-02T18:57:38.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 -- 172.21.15.96:0/4255131310 learned_addr learned my addr 172.21.15.96:0/4255131310 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:57:38.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9419700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f6c60 0x7fcce410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 -- 172.21.15.96:0/4255131310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f6c60 msgr2=0x7fcce410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f6c60 0x7fcce410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 -- 172.21.15.96:0/4255131310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4005040 con 0x7fcce40f5970 2022-02-02T18:57:38.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.375+0000 7fcce9c1a700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fccd4009990 tx=0x7fccd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:38.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd4018070 con 0x7fcce40f5970 2022-02-02T18:57:38.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce410c720 con 0x7fcce40f5970 2022-02-02T18:57:38.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fccd4007ba0 con 0x7fcce40f5970 2022-02-02T18:57:38.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd401de50 con 0x7fcce40f5970 2022-02-02T18:57:38.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce410cc50 con 0x7fcce40f5970 2022-02-02T18:57:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.376+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc004fa0 con 0x7fcce40f5970 2022-02-02T18:57:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.377+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fccd401d420 con 0x7fcce40f5970 2022-02-02T18:57:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.377+0000 7fccda7fc700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 0x7fccd0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:57:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.377+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fccd4083690 con 0x7fcce40f5970 2022-02-02T18:57:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.377+0000 7fcce9419700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 0x7fccd0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:57:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.378+0000 7fcce9419700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 0x7fccd0067290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fcce0004c40 tx=0x7fcce000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:57:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.381+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fccd4051740 con 0x7fcce40f5970 2022-02-02T18:57:38.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.582+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcccc005e80 con 0x7fcce40f5970 2022-02-02T18:57:38.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.582+0000 7fccda7fc700 1 -- 172.21.15.96:0/4255131310 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fccd4054d60 con 0x7fcce40f5970 2022-02-02T18:57:38.577 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:57:38.578 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:57:38.578 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:57:38.578 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:57:38.578 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:38.579 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:57:38.579 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:57:38.579 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:57:38.579 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:57:38.580 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:57:38.580 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:57:38.580 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:57:38.580 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:57:38.580 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:57:38.581 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:57:38.581 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:57:38.581 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:57:38.581 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:57:38.582 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:57:38.582 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:57:38.582 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:57:38.582 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:57:38.582 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:57:38.583 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:57:38.583 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:57:38.583 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:57:38.583 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:57:38.583 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:57:38.584 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:57:38.584 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:57:38.584 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:57:38.584 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:57:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:38.585 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:57:38.586 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:57:38.586 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:38.586 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:38.586 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:57:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 msgr2=0x7fccd0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 0x7fccd0067290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fcce0004c40 tx=0x7fcce000b040).stop 2022-02-02T18:57:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 msgr2=0x7fcce4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:57:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fccd4009990 tx=0x7fccd4009b30).stop 2022-02-02T18:57:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 shutdown_connections 2022-02-02T18:57:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fccd0064dd0 0x7fccd0067290 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce40f5970 0x7fcce4109c70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 --2- 172.21.15.96:0/4255131310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce40f6c60 0x7fcce410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:57:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 >> 172.21.15.96:0/4255131310 conn(0x7fcce40f04c0 msgr2=0x7fcce40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:57:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 shutdown_connections 2022-02-02T18:57:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:57:38.584+0000 7fccebe7e700 1 -- 172.21.15.96:0/4255131310 wait complete. 2022-02-02T18:57:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:57:39.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:38 smithi159 ceph-mon[69013]: pgmap v1065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:39.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:38 smithi159 ceph-mon[69013]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1792043661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:57:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4255131310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:57:39.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:38 smithi096 ceph-mon[101353]: pgmap v1065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:39.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:38 smithi096 ceph-mon[101353]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1792043661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:57:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4255131310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:57:40.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:39 smithi159 ceph-mon[69013]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:40.048 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:39 smithi096 ceph-mon[101353]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:57:41.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:40 smithi159 ceph-mon[69013]: pgmap v1066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:41.048 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:40 smithi096 ceph-mon[101353]: pgmap v1066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:43.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:42 smithi159 ceph-mon[69013]: pgmap v1067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:43.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:42 smithi096 ceph-mon[101353]: pgmap v1067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:45.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:44 smithi159 ceph-mon[69013]: pgmap v1068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:45.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:44 smithi096 ceph-mon[101353]: pgmap v1068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:47.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:46 smithi159 ceph-mon[69013]: pgmap v1069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:47.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:46 smithi096 ceph-mon[101353]: pgmap v1069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:49.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:48 smithi159 ceph-mon[69013]: pgmap v1070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:49.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:48 smithi096 ceph-mon[101353]: pgmap v1070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:51.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:50 smithi159 ceph-mon[69013]: pgmap v1071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:51.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:50 smithi096 ceph-mon[101353]: pgmap v1071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:53.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:52 smithi159 ceph-mon[69013]: pgmap v1072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:53.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:52 smithi096 ceph-mon[101353]: pgmap v1072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:55.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:54 smithi159 ceph-mon[69013]: pgmap v1073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:55.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:54 smithi096 ceph-mon[101353]: pgmap v1073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:56.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:56 smithi096 ceph-mon[101353]: pgmap v1074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:57.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:56 smithi159 ceph-mon[69013]: pgmap v1074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:58.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:57:58 smithi096 ceph-mon[101353]: pgmap v1075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:57:59.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:57:58 smithi159 ceph-mon[69013]: pgmap v1075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:00.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:00 smithi096 ceph-mon[101353]: pgmap v1076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:01.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:00 smithi159 ceph-mon[69013]: pgmap v1076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:02.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:02 smithi096 ceph-mon[101353]: pgmap v1077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:03.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:02 smithi159 ceph-mon[69013]: pgmap v1077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:04.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:04 smithi096 ceph-mon[101353]: pgmap v1078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:05.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:04 smithi159 ceph-mon[69013]: pgmap v1078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:06.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:06 smithi096 ceph-mon[101353]: pgmap v1079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:07.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:06 smithi159 ceph-mon[69013]: pgmap v1079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:08.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.693+0000 7ff6308e1700 1 -- 172.21.15.96:0/2987312183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 msgr2=0x7ff62c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.693+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2987312183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c0f59e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7ff61c004660 tx=0x7ff61c009b30).stop 2022-02-02T18:58:08.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.693+0000 7ff6308e1700 1 -- 172.21.15.96:0/2987312183 shutdown_connections 2022-02-02T18:58:08.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.693+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2987312183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.694+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2987312183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c0f59e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.694+0000 7ff6308e1700 1 -- 172.21.15.96:0/2987312183 >> 172.21.15.96:0/2987312183 conn(0x7ff62c0f0d40 msgr2=0x7ff62c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:08.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.694+0000 7ff6308e1700 1 -- 172.21.15.96:0/2987312183 shutdown_connections 2022-02-02T18:58:08.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.694+0000 7ff6308e1700 1 -- 172.21.15.96:0/2987312183 wait complete. 2022-02-02T18:58:08.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 Processor -- start 2022-02-02T18:58:08.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 -- start start 2022-02-02T18:58:08.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c107a10 con 0x7ff62c0f55c0 2022-02-02T18:58:08.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff6308e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c107b50 con 0x7ff62c0f6860 2022-02-02T18:58:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57014/0 (socket says 172.21.15.96:57014) 2022-02-02T18:58:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 -- 172.21.15.96:0/2097683172 learned_addr learned my addr 172.21.15.96:0/2097683172 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff629d9b700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 -- 172.21.15.96:0/2097683172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 msgr2=0x7ff62c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 -- 172.21.15.96:0/2097683172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c005040 con 0x7ff62c0f55c0 2022-02-02T18:58:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff629d9b700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:58:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.695+0000 7ff62a59c700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff61c013a70 tx=0x7ff61c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.696+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61c018070 con 0x7ff62c0f55c0 2022-02-02T18:58:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.696+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c108490 con 0x7ff62c0f55c0 2022-02-02T18:58:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.696+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff61c0097d0 con 0x7ff62c0f55c0 2022-02-02T18:58:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.696+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61c01c3c0 con 0x7ff62c0f55c0 2022-02-02T18:58:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.696+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c1089f0 con 0x7ff62c0f55c0 2022-02-02T18:58:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.697+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c045ad0 con 0x7ff62c0f55c0 2022-02-02T18:58:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.697+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff61c007ba0 con 0x7ff62c0f55c0 2022-02-02T18:58:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.697+0000 7ff61affd700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 0x7ff614067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.698+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff61c083790 con 0x7ff62c0f55c0 2022-02-02T18:58:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.698+0000 7ff629d9b700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 0x7ff614067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.698+0000 7ff629d9b700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 0x7ff614067290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7ff620009740 tx=0x7ff620009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.702+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff61c055330 con 0x7ff62c0f55c0 2022-02-02T18:58:08.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:08 smithi096 ceph-mon[101353]: pgmap v1080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:08.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.881+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff62c0faca0 con 0x7ff614064dd0 2022-02-02T18:58:08.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.883+0000 7ff61affd700 1 -- 172.21.15.96:0/2097683172 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff62c0faca0 con 0x7ff614064dd0 2022-02-02T18:58:08.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 msgr2=0x7ff614067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 0x7ff614067290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7ff620009740 tx=0x7ff620009be0).stop 2022-02-02T18:58:08.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 msgr2=0x7ff62c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff61c013a70 tx=0x7ff61c009b30).stop 2022-02-02T18:58:08.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 shutdown_connections 2022-02-02T18:58:08.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff614064dd0 0x7ff614067290 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff62c0f55c0 0x7ff62c106f70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 --2- 172.21.15.96:0/2097683172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff62c0f6860 0x7ff62c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.884+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 >> 172.21.15.96:0/2097683172 conn(0x7ff62c0f0d40 msgr2=0x7ff62c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:08.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.885+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 shutdown_connections 2022-02-02T18:58:08.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.885+0000 7ff6308e1700 1 -- 172.21.15.96:0/2097683172 wait complete. 2022-02-02T18:58:08.890 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:58:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- 172.21.15.96:0/2310347342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f8610 msgr2=0x7f09f80f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/2310347342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f8610 0x7f09f80f4820 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f09e8004660 tx=0x7f09e8009b30).stop 2022-02-02T18:58:08.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- 172.21.15.96:0/2310347342 shutdown_connections 2022-02-02T18:58:08.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/2310347342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f8610 0x7f09f80f4820 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/2310347342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f7d00 0x7f09f80f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- 172.21.15.96:0/2310347342 >> 172.21.15.96:0/2310347342 conn(0x7f09f80f0540 msgr2=0x7f09f80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:08.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- 172.21.15.96:0/2310347342 shutdown_connections 2022-02-02T18:58:08.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- 172.21.15.96:0/2310347342 wait complete. 2022-02-02T18:58:08.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 Processor -- start 2022-02-02T18:58:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 -- start start 2022-02-02T18:58:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.983+0000 7f09fe0e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09fe0e6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f8610 0x7f09f80f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09fe0e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80f5fb0 con 0x7f09f80f7d00 2022-02-02T18:58:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09fe0e6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80f60f0 con 0x7f09f80f8610 2022-02-02T18:58:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57024/0 (socket says 172.21.15.96:57024) 2022-02-02T18:58:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 -- 172.21.15.96:0/3151502391 learned_addr learned my addr 172.21.15.96:0/3151502391 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f6ffd700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f8610 0x7f09f80f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 -- 172.21.15.96:0/3151502391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f8610 msgr2=0x7f09f80f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:08.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f8610 0x7f09f80f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:08.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 -- 172.21.15.96:0/3151502391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8005040 con 0x7f09f80f7d00 2022-02-02T18:58:08.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09f77fe700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f09ec0026d0 tx=0x7f09ec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:08.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec0079c0 con 0x7f09f80f7d00 2022-02-02T18:58:08.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09ec00f040 con 0x7f09f80f7d00 2022-02-02T18:58:08.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f80f63d0 con 0x7f09f80f7d00 2022-02-02T18:58:08.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec0137c0 con 0x7f09f80f7d00 2022-02-02T18:58:08.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.984+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f810efc0 con 0x7f09f80f7d00 2022-02-02T18:58:08.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.985+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8045ad0 con 0x7f09f80f7d00 2022-02-02T18:58:08.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.986+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09ec007b20 con 0x7f09f80f7d00 2022-02-02T18:58:08.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.986+0000 7f09dffff700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:08.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.986+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09ec081aa0 con 0x7f09f80f7d00 2022-02-02T18:58:08.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.986+0000 7f09f6ffd700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:08.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.986+0000 7f09f6ffd700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 0x7f09e0067290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f09e8004630 tx=0x7f09e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:08.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:08.990+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09ec04fb50 con 0x7f09f80f7d00 2022-02-02T18:58:09.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:08 smithi159 ceph-mon[69013]: pgmap v1080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:09.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.163+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f80ff010 con 0x7f09e0064dd0 2022-02-02T18:58:09.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.173+0000 7f09dffff700 1 -- 172.21.15.96:0/3151502391 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f09f80ff010 con 0x7f09e0064dd0 2022-02-02T18:58:09.169 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:58:09.170 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (41m) 12m ago 42m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:58:09.170 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (33m) 12m ago 42m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:58:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (33m) 10m ago 42m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:58:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (41m) 12m ago 42m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:58:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (38m) 12m ago 38m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:58:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (34m) 12m ago 38m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:58:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (38m) 10m ago 38m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:58:09.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (34m) 10m ago 38m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:58:09.172 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (35m) 12m ago 43m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:58:09.172 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (35m) 10m ago 42m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:58:09.172 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (34m) 12m ago 43m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:58:09.173 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (34m) 10m ago 41m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:58:09.173 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (42m) 12m ago 42m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:58:09.173 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (41m) 10m ago 41m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:58:09.173 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (33m) 12m ago 41m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:58:09.173 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (33m) 12m ago 41m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:58:09.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (32m) 12m ago 40m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:58:09.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (31m) 10m ago 40m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:58:09.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (31m) 10m ago 40m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:58:09.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (30m) 10m ago 39m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:58:09.175 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (41m) 12m ago 42m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:58:09.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 msgr2=0x7f09e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 0x7f09e0067290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f09e8004630 tx=0x7f09e8009b30).stop 2022-02-02T18:58:09.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 msgr2=0x7f09f80f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f09ec0026d0 tx=0x7f09ec009de0).stop 2022-02-02T18:58:09.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 shutdown_connections 2022-02-02T18:58:09.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f80f7d00 0x7f09f80f75d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 --2- 172.21.15.96:0/3151502391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f80f8610 0x7f09f80f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 >> 172.21.15.96:0/3151502391 conn(0x7f09f80f0540 msgr2=0x7f09f80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:09.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 shutdown_connections 2022-02-02T18:58:09.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.175+0000 7f09fe0e6700 1 -- 172.21.15.96:0/3151502391 wait complete. 2022-02-02T18:58:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- 172.21.15.96:0/2985706118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 msgr2=0x7f01140f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 --2- 172.21.15.96:0/2985706118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f01140f7de0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f0110004660 tx=0x7f0110009b30).stop 2022-02-02T18:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- 172.21.15.96:0/2985706118 shutdown_connections 2022-02-02T18:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 --2- 172.21.15.96:0/2985706118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f01140f7de0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 --2- 172.21.15.96:0/2985706118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 0x7f01140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- 172.21.15.96:0/2985706118 >> 172.21.15.96:0/2985706118 conn(0x7f01140f1e40 msgr2=0x7f01140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- 172.21.15.96:0/2985706118 shutdown_connections 2022-02-02T18:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- 172.21.15.96:0/2985706118 wait complete. 2022-02-02T18:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 Processor -- start 2022-02-02T18:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.272+0000 7f011c17c700 1 -- start start 2022-02-02T18:58:09.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 0x7f011406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011406a380 con 0x7f01140f7980 2022-02-02T18:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011406a4c0 con 0x7f01140f66e0 2022-02-02T18:58:09.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57034/0 (socket says 172.21.15.96:57034) 2022-02-02T18:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 -- 172.21.15.96:0/2320148171 learned_addr learned my addr 172.21.15.96:0/2320148171 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119f18700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 0x7f011406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 -- 172.21.15.96:0/2320148171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 msgr2=0x7f011406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 0x7f011406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 -- 172.21.15.96:0/2320148171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110005040 con 0x7f01140f7980 2022-02-02T18:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f0119717700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f0110009990 tx=0x7f0110009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0110018070 con 0x7f01140f7980 2022-02-02T18:58:09.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0110007ba0 con 0x7f01140f7980 2022-02-02T18:58:09.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011406a740 con 0x7f01140f7980 2022-02-02T18:58:09.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f011001c3c0 con 0x7f01140f7980 2022-02-02T18:58:09.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.273+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011406aca0 con 0x7f01140f7980 2022-02-02T18:58:09.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.274+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0114045ad0 con 0x7f01140f7980 2022-02-02T18:58:09.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.275+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f011001d420 con 0x7f01140f7980 2022-02-02T18:58:09.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.276+0000 7f010a7fc700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 0x7f0100067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.276+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0110083980 con 0x7f01140f7980 2022-02-02T18:58:09.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.276+0000 7f0119f18700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 0x7f0100067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.276+0000 7f0119f18700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 0x7f0100067290 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f011406b730 tx=0x7f010400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:09.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.280+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0110051a30 con 0x7f01140f7980 2022-02-02T18:58:09.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.512+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0114027a00 con 0x7f01140f7980 2022-02-02T18:58:09.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.512+0000 7f010a7fc700 1 -- 172.21.15.96:0/2320148171 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0110055050 con 0x7f01140f7980 2022-02-02T18:58:09.508 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:58:09.509 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:58:09.509 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:58:09.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:09.509 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:58:09.510 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:58:09.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:09.510 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:58:09.510 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:58:09.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:09.511 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:58:09.511 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:58:09.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:09.511 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:58:09.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:58:09.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:58:09.512 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:58:09.512 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:58:09.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 msgr2=0x7f0100067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 0x7f0100067290 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f011406b730 tx=0x7f010400b040).stop 2022-02-02T18:58:09.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 msgr2=0x7f0114069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f0110009990 tx=0x7f0110009b30).stop 2022-02-02T18:58:09.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 shutdown_connections 2022-02-02T18:58:09.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0100064dd0 0x7f0100067290 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01140f66e0 0x7f011406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 --2- 172.21.15.96:0/2320148171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01140f7980 0x7f0114069e20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 >> 172.21.15.96:0/2320148171 conn(0x7f01140f1e40 msgr2=0x7f01140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:09.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 shutdown_connections 2022-02-02T18:58:09.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.515+0000 7f011c17c700 1 -- 172.21.15.96:0/2320148171 wait complete. 2022-02-02T18:58:09.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 -- 172.21.15.96:0/329299211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 msgr2=0x7f5b940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/329299211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b940f6cc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5b88004660 tx=0x7f5b88009b30).stop 2022-02-02T18:58:09.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 -- 172.21.15.96:0/329299211 shutdown_connections 2022-02-02T18:58:09.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/329299211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b940f6cc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/329299211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:58:09.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 -- 172.21.15.96:0/329299211 >> 172.21.15.96:0/329299211 conn(0x7f5b940f0d40 msgr2=0x7f5b940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:09.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 -- 172.21.15.96:0/329299211 shutdown_connections 2022-02-02T18:58:09.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 -- 172.21.15.96:0/329299211 wait complete. 2022-02-02T18:58:09.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.615+0000 7f5b99b2d700 1 Processor -- start 2022-02-02T18:58:09.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b99b2d700 1 -- start start 2022-02-02T18:58:09.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b99b2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b94109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b99b2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b99b2d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94060450 con 0x7f5b940f6860 2022-02-02T18:58:09.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b99b2d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94060590 con 0x7f5b940f55c0 2022-02-02T18:58:09.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57044/0 (socket says 172.21.15.96:57044) 2022-02-02T18:58:09.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 -- 172.21.15.96:0/1285923168 learned_addr learned my addr 172.21.15.96:0/1285923168 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:09.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b937fe700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b94109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 -- 172.21.15.96:0/1285923168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 msgr2=0x7f5b94109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b94109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 -- 172.21.15.96:0/1285923168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88005040 con 0x7f5b940f6860 2022-02-02T18:58:09.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b937fe700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b94109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:58:09.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.616+0000 7f5b92ffd700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f5b88009990 tx=0x7f5b88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:09.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b88018070 con 0x7f5b940f6860 2022-02-02T18:58:09.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9410c780 con 0x7f5b940f6860 2022-02-02T18:58:09.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b88007ca0 con 0x7f5b940f6860 2022-02-02T18:58:09.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8801c620 con 0x7f5b940f6860 2022-02-02T18:58:09.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9410cce0 con 0x7f5b940f6860 2022-02-02T18:58:09.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.617+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94045ad0 con 0x7f5b940f6860 2022-02-02T18:58:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.619+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b8801d960 con 0x7f5b940f6860 2022-02-02T18:58:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.619+0000 7f5b7bfff700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 0x7f5b7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.619+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5b88083ba0 con 0x7f5b940f6860 2022-02-02T18:58:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.619+0000 7f5b937fe700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 0x7f5b7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.620+0000 7f5b937fe700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 0x7f5b7c067290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5b94060040 tx=0x7f5b84008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.623+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b88051c10 con 0x7f5b940f6860 2022-02-02T18:58:09.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2320148171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:58:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.824+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b94027a00 con 0x7f5b940f6860 2022-02-02T18:58:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.824+0000 7f5b7bfff700 1 -- 172.21.15.96:0/1285923168 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5b88055230 con 0x7f5b940f6860 2022-02-02T18:58:09.821 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:58:09.821 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:58:09.821 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:58:09.822 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:58:09.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:58:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:58:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:58:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:58:09.824 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:58:09.824 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:58:09.825 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:58:09.825 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:58:09.825 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:58:09.825 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:58:09.826 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:58:09.826 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:58:09.827 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:58:09.827 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:58:09.827 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:58:09.827 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:58:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:58:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:58:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:58:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:58:09.829 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:58:09.829 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:58:09.829 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:58:09.829 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:58:09.830 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:58:09.830 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:58:09.830 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:58:09.830 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:09.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:09.831 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:58:09.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:09.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:09.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:09.834 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 msgr2=0x7f5b7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 0x7f5b7c067290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5b94060040 tx=0x7f5b84008040).stop 2022-02-02T18:58:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 msgr2=0x7f5b9410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f5b88009990 tx=0x7f5b88009b30).stop 2022-02-02T18:58:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 shutdown_connections 2022-02-02T18:58:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b7c064dd0 0x7f5b7c067290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b940f55c0 0x7f5b94109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 --2- 172.21.15.96:0/1285923168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b940f6860 0x7f5b9410c1d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 >> 172.21.15.96:0/1285923168 conn(0x7f5b940f0d40 msgr2=0x7f5b940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 shutdown_connections 2022-02-02T18:58:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:09.826+0000 7f5b99b2d700 1 -- 172.21.15.96:0/1285923168 wait complete. 2022-02-02T18:58:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:58:10.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2320148171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:58:11.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:10 smithi159 ceph-mon[69013]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:10 smithi159 ceph-mon[69013]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:10 smithi159 ceph-mon[69013]: pgmap v1081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1285923168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:58:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:10 smithi096 ceph-mon[101353]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:11.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:10 smithi096 ceph-mon[101353]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:10 smithi096 ceph-mon[101353]: pgmap v1081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1285923168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:58:13.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:12 smithi159 ceph-mon[69013]: pgmap v1082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:12 smithi096 ceph-mon[101353]: pgmap v1082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:15.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:14 smithi159 ceph-mon[69013]: pgmap v1083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:15.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:14 smithi096 ceph-mon[101353]: pgmap v1083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:17.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:16 smithi159 ceph-mon[69013]: pgmap v1084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:17.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:16 smithi096 ceph-mon[101353]: pgmap v1084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:19.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:18 smithi159 ceph-mon[69013]: pgmap v1085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:19.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:18 smithi096 ceph-mon[101353]: pgmap v1085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:20 smithi159 ceph-mon[69013]: pgmap v1086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:21.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:20 smithi096 ceph-mon[101353]: pgmap v1086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:23.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:22 smithi159 ceph-mon[69013]: pgmap v1087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:23.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:22 smithi096 ceph-mon[101353]: pgmap v1087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:25.018 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:24 smithi159 ceph-mon[69013]: pgmap v1088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:25.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:24 smithi096 ceph-mon[101353]: pgmap v1088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:26 smithi159 ceph-mon[69013]: pgmap v1089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:27.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:26 smithi096 ceph-mon[101353]: pgmap v1089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:58:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:58:28.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:58:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:58:29.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:28 smithi159 ceph-mon[69013]: pgmap v1090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:29.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:28 smithi096 ceph-mon[101353]: pgmap v1090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:30 smithi159 ceph-mon[69013]: pgmap v1091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:31.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:30 smithi096 ceph-mon[101353]: pgmap v1091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:33.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:32 smithi159 ceph-mon[69013]: pgmap v1092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:33.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:32 smithi096 ceph-mon[101353]: pgmap v1092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:35.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:34 smithi159 ceph-mon[69013]: pgmap v1093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:35.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:34 smithi096 ceph-mon[101353]: pgmap v1093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:37.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:36 smithi159 ceph-mon[69013]: pgmap v1094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:36 smithi096 ceph-mon[101353]: pgmap v1094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:39.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:38 smithi159 ceph-mon[69013]: pgmap v1095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:39.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:38 smithi096 ceph-mon[101353]: pgmap v1095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:39.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 -- 172.21.15.96:0/1302919259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 msgr2=0x7f03f80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:39.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 --2- 172.21.15.96:0/1302919259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f80f59e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f03ec004660 tx=0x7f03ec009b30).stop 2022-02-02T18:58:39.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 -- 172.21.15.96:0/1302919259 shutdown_connections 2022-02-02T18:58:39.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 --2- 172.21.15.96:0/1302919259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:58:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 --2- 172.21.15.96:0/1302919259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f80f59e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 -- 172.21.15.96:0/1302919259 >> 172.21.15.96:0/1302919259 conn(0x7f03f80f0d20 msgr2=0x7f03f80f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 -- 172.21.15.96:0/1302919259 shutdown_connections 2022-02-02T18:58:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.937+0000 7f03fd700700 1 -- 172.21.15.96:0/1302919259 wait complete. 2022-02-02T18:58:39.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 Processor -- start 2022-02-02T18:58:39.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 -- start start 2022-02-02T18:58:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8060610 con 0x7f03f80f55c0 2022-02-02T18:58:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03fd700700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8060750 con 0x7f03f80f6860 2022-02-02T18:58:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03f6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03f6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57062/0 (socket says 172.21.15.96:57062) 2022-02-02T18:58:39.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03f6ffd700 1 -- 172.21.15.96:0/2628504914 learned_addr learned my addr 172.21.15.96:0/2628504914 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:39.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.938+0000 7f03f67fc700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:39.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03f6ffd700 1 -- 172.21.15.96:0/2628504914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 msgr2=0x7f03f810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:39.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03f6ffd700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03f6ffd700 1 -- 172.21.15.96:0/2628504914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec005040 con 0x7f03f80f55c0 2022-02-02T18:58:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03f67fc700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:58:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03f6ffd700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f03ec004f60 tx=0x7f03ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ec018070 con 0x7f03f80f55c0 2022-02-02T18:58:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f810c790 con 0x7f03f80f55c0 2022-02-02T18:58:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03ec007ba0 con 0x7f03f80f55c0 2022-02-02T18:58:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f810ccc0 con 0x7f03f80f55c0 2022-02-02T18:58:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.939+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ec01c620 con 0x7f03f80f55c0 2022-02-02T18:58:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.940+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f8045ad0 con 0x7f03f80f55c0 2022-02-02T18:58:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.940+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03ec01c8e0 con 0x7f03f80f55c0 2022-02-02T18:58:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.941+0000 7f03df7fe700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 0x7f03e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.941+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f03ec0839b0 con 0x7f03f80f55c0 2022-02-02T18:58:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.941+0000 7f03f67fc700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 0x7f03e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.941+0000 7f03f67fc700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 0x7f03e0067290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f03e800b830 tx=0x7f03e8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:39.945+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03ec051b20 con 0x7f03f80f55c0 2022-02-02T18:58:40.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.124+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03f80fdf40 con 0x7f03e0064dd0 2022-02-02T18:58:40.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.126+0000 7f03df7fe700 1 -- 172.21.15.96:0/2628504914 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f03f80fdf40 con 0x7f03e0064dd0 2022-02-02T18:58:40.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 msgr2=0x7f03e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 0x7f03e0067290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f03e800b830 tx=0x7f03e8008040).stop 2022-02-02T18:58:40.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 msgr2=0x7f03f8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f03ec004f60 tx=0x7f03ec009b30).stop 2022-02-02T18:58:40.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 shutdown_connections 2022-02-02T18:58:40.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e0064dd0 0x7f03e0067290 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03f80f55c0 0x7f03f8109c90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 --2- 172.21.15.96:0/2628504914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03f80f6860 0x7f03f810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.127+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 >> 172.21.15.96:0/2628504914 conn(0x7f03f80f0d20 msgr2=0x7f03f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.128+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 shutdown_connections 2022-02-02T18:58:40.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.128+0000 7f03fd700700 1 -- 172.21.15.96:0/2628504914 wait complete. 2022-02-02T18:58:40.133 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:58:40.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 -- 172.21.15.96:0/2756402819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 msgr2=0x7f6e300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 --2- 172.21.15.96:0/2756402819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e300f59e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f6e20004660 tx=0x7f6e20009b30).stop 2022-02-02T18:58:40.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 -- 172.21.15.96:0/2756402819 shutdown_connections 2022-02-02T18:58:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 --2- 172.21.15.96:0/2756402819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e300f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 --2- 172.21.15.96:0/2756402819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e300f59e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.225+0000 7f6e3666f700 1 -- 172.21.15.96:0/2756402819 >> 172.21.15.96:0/2756402819 conn(0x7f6e300f0d40 msgr2=0x7f6e300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.226+0000 7f6e3666f700 1 -- 172.21.15.96:0/2756402819 shutdown_connections 2022-02-02T18:58:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.226+0000 7f6e3666f700 1 -- 172.21.15.96:0/2756402819 wait complete. 2022-02-02T18:58:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.226+0000 7f6e3666f700 1 Processor -- start 2022-02-02T18:58:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 -- start start 2022-02-02T18:58:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e3010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300603e0 con 0x7f6e300f55c0 2022-02-02T18:58:40.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e30060520 con 0x7f6e300f6860 2022-02-02T18:58:40.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57072/0 (socket says 172.21.15.96:57072) 2022-02-02T18:58:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 -- 172.21.15.96:0/403398954 learned_addr learned my addr 172.21.15.96:0/403398954 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2f7fe700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e3010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 -- 172.21.15.96:0/403398954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 msgr2=0x7f6e3010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e3010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 -- 172.21.15.96:0/403398954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20005040 con 0x7f6e300f55c0 2022-02-02T18:58:40.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2f7fe700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e3010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:58:40.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2ffff700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6e20013a70 tx=0x7f6e20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e20018070 con 0x7f6e300f55c0 2022-02-02T18:58:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.227+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3010c6c0 con 0x7f6e300f55c0 2022-02-02T18:58:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.228+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e200097d0 con 0x7f6e300f55c0 2022-02-02T18:58:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.228+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e2001c3c0 con 0x7f6e300f55c0 2022-02-02T18:58:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.228+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3010cc20 con 0x7f6e300f55c0 2022-02-02T18:58:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.228+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e30045ad0 con 0x7f6e300f55c0 2022-02-02T18:58:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.229+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e20007ba0 con 0x7f6e300f55c0 2022-02-02T18:58:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.229+0000 7f6e2cff9700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 0x7f6e18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.229+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e20083750 con 0x7f6e300f55c0 2022-02-02T18:58:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.230+0000 7f6e2f7fe700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 0x7f6e18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.230+0000 7f6e2f7fe700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 0x7f6e18067290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6e24009740 tx=0x7f6e24009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.234+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e20051800 con 0x7f6e300f55c0 2022-02-02T18:58:40.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.406+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e30057f10 con 0x7f6e18064dd0 2022-02-02T18:58:40.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.416+0000 7f6e2cff9700 1 -- 172.21.15.96:0/403398954 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6e30057f10 con 0x7f6e18064dd0 2022-02-02T18:58:40.412 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:58:40.412 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (42m) 12m ago 43m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:58:40.413 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (34m) 12m ago 43m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:58:40.413 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (34m) 11m ago 42m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:58:40.413 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (41m) 12m ago 42m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:58:40.413 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (39m) 12m ago 39m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:58:40.414 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (34m) 12m ago 39m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:58:40.414 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (39m) 11m ago 39m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:58:40.414 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (35m) 11m ago 39m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:58:40.414 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (36m) 12m ago 44m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:58:40.415 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (35m) 11m ago 42m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:58:40.415 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (35m) 12m ago 44m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:58:40.415 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (35m) 11m ago 42m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:58:40.415 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (42m) 12m ago 42m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:58:40.416 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (42m) 11m ago 42m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:58:40.416 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (34m) 12m ago 41m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:58:40.416 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (33m) 12m ago 41m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:58:40.416 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (32m) 12m ago 41m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:58:40.416 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (32m) 11m ago 41m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:58:40.417 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (31m) 11m ago 40m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:58:40.417 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (31m) 11m ago 40m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:58:40.417 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (41m) 12m ago 42m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:58:40.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 msgr2=0x7f6e18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 0x7f6e18067290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6e24009740 tx=0x7f6e24009be0).stop 2022-02-02T18:58:40.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 msgr2=0x7f6e30109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6e20013a70 tx=0x7f6e20009b30).stop 2022-02-02T18:58:40.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 shutdown_connections 2022-02-02T18:58:40.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e18064dd0 0x7f6e18067290 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e300f55c0 0x7f6e30109c70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 --2- 172.21.15.96:0/403398954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e300f6860 0x7f6e3010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.418+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 >> 172.21.15.96:0/403398954 conn(0x7f6e300f0d40 msgr2=0x7f6e300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.419+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 shutdown_connections 2022-02-02T18:58:40.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.419+0000 7f6e3666f700 1 -- 172.21.15.96:0/403398954 wait complete. 2022-02-02T18:58:40.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- 172.21.15.96:0/1054938151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 msgr2=0x7f2c440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 --2- 172.21.15.96:0/1054938151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c440f6cc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f2c40004660 tx=0x7f2c40009b30).stop 2022-02-02T18:58:40.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- 172.21.15.96:0/1054938151 shutdown_connections 2022-02-02T18:58:40.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 --2- 172.21.15.96:0/1054938151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f6860 0x7f2c440f6cc0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 --2- 172.21.15.96:0/1054938151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f55c0 0x7f2c440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- 172.21.15.96:0/1054938151 >> 172.21.15.96:0/1054938151 conn(0x7f2c440f0d40 msgr2=0x7f2c440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- 172.21.15.96:0/1054938151 shutdown_connections 2022-02-02T18:58:40.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- 172.21.15.96:0/1054938151 wait complete. 2022-02-02T18:58:40.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 Processor -- start 2022-02-02T18:58:40.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.515+0000 7f2c4b550700 1 -- start start 2022-02-02T18:58:40.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c4b550700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c4b550700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 0x7f2c4410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c4b550700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440603e0 con 0x7f2c440f55c0 2022-02-02T18:58:40.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c4b550700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44060520 con 0x7f2c440f6860 2022-02-02T18:58:40.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57082/0 (socket says 172.21.15.96:57082) 2022-02-02T18:58:40.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 -- 172.21.15.96:0/4232640823 learned_addr learned my addr 172.21.15.96:0/4232640823 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:40.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c48aeb700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 0x7f2c4410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 -- 172.21.15.96:0/4232640823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 msgr2=0x7f2c4410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 0x7f2c4410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 -- 172.21.15.96:0/4232640823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40005040 con 0x7f2c440f55c0 2022-02-02T18:58:40.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c492ec700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f2c3400c530 tx=0x7f2c34007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3400f650 con 0x7f2c440f55c0 2022-02-02T18:58:40.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c3400fc60 con 0x7f2c440f55c0 2022-02-02T18:58:40.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4410c700 con 0x7f2c440f55c0 2022-02-02T18:58:40.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.516+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c34012cb0 con 0x7f2c440f55c0 2022-02-02T18:58:40.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.517+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4410ccc0 con 0x7f2c440f55c0 2022-02-02T18:58:40.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.518+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44045ad0 con 0x7f2c440f55c0 2022-02-02T18:58:40.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.518+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c34019030 con 0x7f2c440f55c0 2022-02-02T18:58:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.519+0000 7f2c39ffb700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 0x7f2c30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.519+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2c34081670 con 0x7f2c440f55c0 2022-02-02T18:58:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.519+0000 7f2c48aeb700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 0x7f2c30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.519+0000 7f2c48aeb700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 0x7f2c30067290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2c40004630 tx=0x7f2c40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.523+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c3404f7d0 con 0x7f2c440f55c0 2022-02-02T18:58:40.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.753+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c44027a00 con 0x7f2c440f55c0 2022-02-02T18:58:40.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.754+0000 7f2c39ffb700 1 -- 172.21.15.96:0/4232640823 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2c340172e0 con 0x7f2c440f55c0 2022-02-02T18:58:40.751 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:58:40.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:58:40.751 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:58:40.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:40.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:58:40.752 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:58:40.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:40.752 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:58:40.752 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:58:40.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:40.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:58:40.753 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:58:40.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:58:40.754 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:58:40.754 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:58:40.754 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:58:40.755 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:58:40.755 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:58:40.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.755+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 msgr2=0x7f2c30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.755+0000 7f2c4b550700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 0x7f2c30067290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2c40004630 tx=0x7f2c40009b30).stop 2022-02-02T18:58:40.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.755+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 msgr2=0x7f2c44109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.755+0000 7f2c4b550700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f2c3400c530 tx=0x7f2c34007e10).stop 2022-02-02T18:58:40.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.755+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 shutdown_connections 2022-02-02T18:58:40.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c30064dd0 0x7f2c30067290 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c440f55c0 0x7f2c44109c50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 --2- 172.21.15.96:0/4232640823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c440f6860 0x7f2c4410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 >> 172.21.15.96:0/4232640823 conn(0x7f2c440f0d40 msgr2=0x7f2c440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 shutdown_connections 2022-02-02T18:58:40.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.756+0000 7f2c4b550700 1 -- 172.21.15.96:0/4232640823 wait complete. 2022-02-02T18:58:40.800 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:40 smithi096 ceph-mon[101353]: pgmap v1096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- 172.21.15.96:0/2378343485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f6860 msgr2=0x7fc8540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 --2- 172.21.15.96:0/2378343485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f6860 0x7fc8540f6cc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc840004660 tx=0x7fc840009b30).stop 2022-02-02T18:58:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- 172.21.15.96:0/2378343485 shutdown_connections 2022-02-02T18:58:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 --2- 172.21.15.96:0/2378343485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f6860 0x7fc8540f6cc0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 --2- 172.21.15.96:0/2378343485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f55c0 0x7fc8540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:58:40.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- 172.21.15.96:0/2378343485 >> 172.21.15.96:0/2378343485 conn(0x7fc8540f0d40 msgr2=0x7fc8540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:40.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- 172.21.15.96:0/2378343485 shutdown_connections 2022-02-02T18:58:40.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- 172.21.15.96:0/2378343485 wait complete. 2022-02-02T18:58:40.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 Processor -- start 2022-02-02T18:58:40.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.854+0000 7fc85aa92700 1 -- start start 2022-02-02T18:58:40.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85aa92700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85aa92700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 0x7fc854107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85aa92700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc854107ad0 con 0x7fc8540f55c0 2022-02-02T18:58:40.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85aa92700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc854108380 con 0x7fc8540f6860 2022-02-02T18:58:40.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57092/0 (socket says 172.21.15.96:57092) 2022-02-02T18:58:40.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 -- 172.21.15.96:0/558863975 learned_addr learned my addr 172.21.15.96:0/558863975 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:58:40.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc853fff700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 0x7fc854107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 -- 172.21.15.96:0/558863975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 msgr2=0x7fc854107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:40.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 0x7fc854107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:40.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 -- 172.21.15.96:0/558863975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840005040 con 0x7fc8540f55c0 2022-02-02T18:58:40.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc853fff700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 0x7fc854107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:58:40.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85882e700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc8480093f0 tx=0x7fc848006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc848009ea0 con 0x7fc8540f55c0 2022-02-02T18:58:40.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc854108660 con 0x7fc8540f55c0 2022-02-02T18:58:40.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc848013af0 con 0x7fc8540f55c0 2022-02-02T18:58:40.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.855+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc84800db10 con 0x7fc8540f55c0 2022-02-02T18:58:40.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.856+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc854108c20 con 0x7fc8540f55c0 2022-02-02T18:58:40.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.856+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8540f49b0 con 0x7fc8540f55c0 2022-02-02T18:58:40.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.857+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc84801a060 con 0x7fc8540f55c0 2022-02-02T18:58:40.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.857+0000 7fc8517fa700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 0x7fc844067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:58:40.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.857+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc848081af0 con 0x7fc8540f55c0 2022-02-02T18:58:40.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.857+0000 7fc853fff700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 0x7fc844067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:58:40.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.858+0000 7fc853fff700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 0x7fc844067290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fc840004e30 tx=0x7fc840009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:58:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:40.861+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8480535d0 con 0x7fc8540f55c0 2022-02-02T18:58:41.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:40 smithi159 ceph-mon[69013]: pgmap v1096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.061+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc854027a00 con 0x7fc8540f55c0 2022-02-02T18:58:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.062+0000 7fc8517fa700 1 -- 172.21.15.96:0/558863975 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc848018020 con 0x7fc8540f55c0 2022-02-02T18:58:41.059 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:58:41.059 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:58:41.060 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:58:41.060 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:58:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:41.061 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:58:41.061 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:58:41.062 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:58:41.062 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:58:41.062 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:58:41.063 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:58:41.064 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:58:41.064 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:58:41.065 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:58:41.065 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:58:41.065 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:58:41.065 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:58:41.066 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:58:41.066 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:58:41.066 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:58:41.066 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:58:41.067 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:58:41.067 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:58:41.067 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:58:41.067 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:58:41.068 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:58:41.068 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:58:41.068 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:58:41.068 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:58:41.068 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:58:41.069 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:58:41.069 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:58:41.069 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:41.069 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:41.069 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:58:41.070 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:58:41.070 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:41.070 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:41.071 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:58:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.063+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 msgr2=0x7fc844067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 0x7fc844067290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fc840004e30 tx=0x7fc840009b30).stop 2022-02-02T18:58:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 msgr2=0x7fc854106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:58:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fc8480093f0 tx=0x7fc848006ec0).stop 2022-02-02T18:58:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 shutdown_connections 2022-02-02T18:58:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc844064dd0 0x7fc844067290 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8540f55c0 0x7fc854106fa0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 --2- 172.21.15.96:0/558863975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8540f6860 0x7fc854107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:58:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 >> 172.21.15.96:0/558863975 conn(0x7fc8540f0d40 msgr2=0x7fc8540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:58:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 shutdown_connections 2022-02-02T18:58:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:58:41.064+0000 7fc85aa92700 1 -- 172.21.15.96:0/558863975 wait complete. 2022-02-02T18:58:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:58:42.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:41 smithi159 ceph-mon[69013]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:41 smithi159 ceph-mon[69013]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4232640823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:58:42.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/558863975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:58:42.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:41 smithi096 ceph-mon[101353]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:41 smithi096 ceph-mon[101353]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:58:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4232640823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:58:42.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/558863975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:58:43.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:42 smithi159 ceph-mon[69013]: pgmap v1097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:43.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:42 smithi096 ceph-mon[101353]: pgmap v1097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:45.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:44 smithi159 ceph-mon[69013]: pgmap v1098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:45.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:44 smithi096 ceph-mon[101353]: pgmap v1098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:47.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:46 smithi159 ceph-mon[69013]: pgmap v1099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:47.049 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:46 smithi096 ceph-mon[101353]: pgmap v1099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:49.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:48 smithi159 ceph-mon[69013]: pgmap v1100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:49.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:48 smithi096 ceph-mon[101353]: pgmap v1100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:51.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:50 smithi159 ceph-mon[69013]: pgmap v1101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:51.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:50 smithi096 ceph-mon[101353]: pgmap v1101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:53.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:52 smithi159 ceph-mon[69013]: pgmap v1102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:53.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:52 smithi096 ceph-mon[101353]: pgmap v1102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:55.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:54 smithi159 ceph-mon[69013]: pgmap v1103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:55.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:54 smithi096 ceph-mon[101353]: pgmap v1103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:57.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:56 smithi159 ceph-mon[69013]: pgmap v1104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:57.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:56 smithi096 ceph-mon[101353]: pgmap v1104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:59.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:58:58 smithi159 ceph-mon[69013]: pgmap v1105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:58:59.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:58:58 smithi096 ceph-mon[101353]: pgmap v1105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:01.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:00 smithi159 ceph-mon[69013]: pgmap v1106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:01.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:00 smithi096 ceph-mon[101353]: pgmap v1106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:03.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:02 smithi159 ceph-mon[69013]: pgmap v1107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:03.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:02 smithi096 ceph-mon[101353]: pgmap v1107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:05.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:04 smithi159 ceph-mon[69013]: pgmap v1108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:05.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:04 smithi096 ceph-mon[101353]: pgmap v1108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:07.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:06 smithi159 ceph-mon[69013]: pgmap v1109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:07.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:06 smithi096 ceph-mon[101353]: pgmap v1109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:09.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:08 smithi159 ceph-mon[69013]: pgmap v1110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:09.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:08 smithi096 ceph-mon[101353]: pgmap v1110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:11.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:10 smithi159 ceph-mon[69013]: pgmap v1111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:11.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:10 smithi096 ceph-mon[101353]: pgmap v1111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:11.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 -- 172.21.15.96:0/2261319266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f66e0 msgr2=0x7f34140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 --2- 172.21.15.96:0/2261319266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f66e0 0x7f34140f6b00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f33fc004660 tx=0x7f33fc009b30).stop 2022-02-02T18:59:11.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 -- 172.21.15.96:0/2261319266 shutdown_connections 2022-02-02T18:59:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 --2- 172.21.15.96:0/2261319266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f7980 0x7f34140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 --2- 172.21.15.96:0/2261319266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f66e0 0x7f34140f6b00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.175+0000 7f341883d700 1 -- 172.21.15.96:0/2261319266 >> 172.21.15.96:0/2261319266 conn(0x7f34140f1e40 msgr2=0x7f34140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 -- 172.21.15.96:0/2261319266 shutdown_connections 2022-02-02T18:59:11.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 -- 172.21.15.96:0/2261319266 wait complete. 2022-02-02T18:59:11.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 Processor -- start 2022-02-02T18:59:11.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 -- start start 2022-02-02T18:59:11.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f66e0 0x7f3414106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414107a50 con 0x7f34140f7980 2022-02-02T18:59:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f341883d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414107b90 con 0x7f34140f66e0 2022-02-02T18:59:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f3411d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f3411d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57116/0 (socket says 172.21.15.96:57116) 2022-02-02T18:59:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.176+0000 7f3411d9b700 1 -- 172.21.15.96:0/558576616 learned_addr learned my addr 172.21.15.96:0/558576616 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f341259c700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f66e0 0x7f3414106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f3411d9b700 1 -- 172.21.15.96:0/558576616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f66e0 msgr2=0x7f3414106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f3411d9b700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f66e0 0x7f3414106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f3411d9b700 1 -- 172.21.15.96:0/558576616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc005040 con 0x7f34140f7980 2022-02-02T18:59:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f3411d9b700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f34040026d0 tx=0x7f3404009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3404009320 con 0x7f34140f7980 2022-02-02T18:59:11.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f340400f040 con 0x7f34140f7980 2022-02-02T18:59:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3414108530 con 0x7f34140f7980 2022-02-02T18:59:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34040147e0 con 0x7f34140f7980 2022-02-02T18:59:11.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.177+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3414108af0 con 0x7f34140f7980 2022-02-02T18:59:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.178+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3414045ad0 con 0x7f34140f7980 2022-02-02T18:59:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.179+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3404009480 con 0x7f34140f7980 2022-02-02T18:59:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.179+0000 7f340affd700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 0x7f3400067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.179+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3404082170 con 0x7f34140f7980 2022-02-02T18:59:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.179+0000 7f341259c700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 0x7f3400067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.179+0000 7f341259c700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 0x7f3400067270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f33fc000c00 tx=0x7f33fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.183+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3404053c50 con 0x7f34140f7980 2022-02-02T18:59:11.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.361+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3414108d70 con 0x7f3400064db0 2022-02-02T18:59:11.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.363+0000 7f340affd700 1 -- 172.21.15.96:0/558576616 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3414108d70 con 0x7f3400064db0 2022-02-02T18:59:11.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.364+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 msgr2=0x7f3400067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.364+0000 7f341883d700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 0x7f3400067270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f33fc000c00 tx=0x7f33fc009b30).stop 2022-02-02T18:59:11.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.364+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 msgr2=0x7f34141074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.364+0000 7f341883d700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f34040026d0 tx=0x7f3404009de0).stop 2022-02-02T18:59:11.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 shutdown_connections 2022-02-02T18:59:11.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3400064db0 0x7f3400067270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34140f66e0 0x7f3414106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 --2- 172.21.15.96:0/558576616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34140f7980 0x7f34141074a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 >> 172.21.15.96:0/558576616 conn(0x7f34140f1e40 msgr2=0x7f34140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 shutdown_connections 2022-02-02T18:59:11.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.365+0000 7f341883d700 1 -- 172.21.15.96:0/558576616 wait complete. 2022-02-02T18:59:11.370 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:59:11.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 -- 172.21.15.96:0/2696562344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 msgr2=0x7efd540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 --2- 172.21.15.96:0/2696562344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd540f6950 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7efd48004660 tx=0x7efd48009b30).stop 2022-02-02T18:59:11.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 -- 172.21.15.96:0/2696562344 shutdown_connections 2022-02-02T18:59:11.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 --2- 172.21.15.96:0/2696562344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 --2- 172.21.15.96:0/2696562344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd540f6950 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 -- 172.21.15.96:0/2696562344 >> 172.21.15.96:0/2696562344 conn(0x7efd540f1c90 msgr2=0x7efd540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 -- 172.21.15.96:0/2696562344 shutdown_connections 2022-02-02T18:59:11.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.462+0000 7efd58a3e700 1 -- 172.21.15.96:0/2696562344 wait complete. 2022-02-02T18:59:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 Processor -- start 2022-02-02T18:59:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 -- start start 2022-02-02T18:59:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd541072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd541078f0 con 0x7efd540f6530 2022-02-02T18:59:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd58a3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54108100 con 0x7efd540f77d0 2022-02-02T18:59:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57124/0 (socket says 172.21.15.96:57124) 2022-02-02T18:59:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 -- 172.21.15.96:0/3152241365 learned_addr learned my addr 172.21.15.96:0/3152241365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd52ffd700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd541072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 -- 172.21.15.96:0/3152241365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 msgr2=0x7efd541072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd541072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd537fe700 1 -- 172.21.15.96:0/3152241365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48005040 con 0x7efd540f6530 2022-02-02T18:59:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.463+0000 7efd52ffd700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd541072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T18:59:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd537fe700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7efd48013a70 tx=0x7efd48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd48018070 con 0x7efd540f6530 2022-02-02T18:59:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd480097d0 con 0x7efd540f6530 2022-02-02T18:59:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd54108320 con 0x7efd540f6530 2022-02-02T18:59:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4801c3c0 con 0x7efd540f6530 2022-02-02T18:59:11.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.464+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd54108880 con 0x7efd540f6530 2022-02-02T18:59:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.465+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd54059100 con 0x7efd540f6530 2022-02-02T18:59:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.465+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd48007ba0 con 0x7efd540f6530 2022-02-02T18:59:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.466+0000 7efd3bfff700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 0x7efd3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.466+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efd48083800 con 0x7efd540f6530 2022-02-02T18:59:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.466+0000 7efd52ffd700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 0x7efd3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.466+0000 7efd52ffd700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 0x7efd3c0672e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7efd44009740 tx=0x7efd44009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.470+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd480518f0 con 0x7efd540f6530 2022-02-02T18:59:11.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.643+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd540008d0 con 0x7efd3c064e20 2022-02-02T18:59:11.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.652+0000 7efd3bfff700 1 -- 172.21.15.96:0/3152241365 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efd540008d0 con 0x7efd3c064e20 2022-02-02T18:59:11.648 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:59:11.648 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (42m) 13m ago 43m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:59:11.649 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (34m) 13m ago 43m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:59:11.649 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (34m) 11m ago 43m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:59:11.649 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (42m) 13m ago 43m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:59:11.649 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (39m) 13m ago 39m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:59:11.649 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (35m) 13m ago 39m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:59:11.650 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (39m) 11m ago 39m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:59:11.650 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (35m) 11m ago 39m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:59:11.650 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (36m) 13m ago 44m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:59:11.650 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (36m) 11m ago 43m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:59:11.651 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (35m) 13m ago 44m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:59:11.651 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (35m) 11m ago 43m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:59:11.651 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (43m) 13m ago 43m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:59:11.651 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (42m) 11m ago 42m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:59:11.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (34m) 13m ago 42m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:59:11.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (34m) 13m ago 42m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:59:11.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (33m) 13m ago 41m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:59:11.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (32m) 11m ago 41m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:59:11.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (32m) 11m ago 41m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:59:11.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (31m) 11m ago 40m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:59:11.653 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (42m) 13m ago 43m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:59:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 msgr2=0x7efd3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 0x7efd3c0672e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7efd44009740 tx=0x7efd44009be0).stop 2022-02-02T18:59:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 msgr2=0x7efd54106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7efd48013a70 tx=0x7efd48009b30).stop 2022-02-02T18:59:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 shutdown_connections 2022-02-02T18:59:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064e20 0x7efd3c0672e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540f6530 0x7efd54106e00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 --2- 172.21.15.96:0/3152241365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd540f77d0 0x7efd541072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 >> 172.21.15.96:0/3152241365 conn(0x7efd540f1c90 msgr2=0x7efd540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 shutdown_connections 2022-02-02T18:59:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.654+0000 7efd58a3e700 1 -- 172.21.15.96:0/3152241365 wait complete. 2022-02-02T18:59:11.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 -- 172.21.15.96:0/747762454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f6700 msgr2=0x7feb040f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 --2- 172.21.15.96:0/747762454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f6700 0x7feb040f6b60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7feaf8004660 tx=0x7feaf8009b30).stop 2022-02-02T18:59:11.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 -- 172.21.15.96:0/747762454 shutdown_connections 2022-02-02T18:59:11.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 --2- 172.21.15.96:0/747762454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f6700 0x7feb040f6b60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 --2- 172.21.15.96:0/747762454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb040f5460 0x7feb040f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 -- 172.21.15.96:0/747762454 >> 172.21.15.96:0/747762454 conn(0x7feb040f0bc0 msgr2=0x7feb040f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.751+0000 7feb096b6700 1 -- 172.21.15.96:0/747762454 shutdown_connections 2022-02-02T18:59:11.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.752+0000 7feb096b6700 1 -- 172.21.15.96:0/747762454 wait complete. 2022-02-02T18:59:11.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 Processor -- start 2022-02-02T18:59:11.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 -- start start 2022-02-02T18:59:11.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb040f6700 0x7feb04106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb041067d0 con 0x7feb040f5460 2022-02-02T18:59:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb096b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04106fd0 con 0x7feb040f6700 2022-02-02T18:59:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57134/0 (socket says 172.21.15.96:57134) 2022-02-02T18:59:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 -- 172.21.15.96:0/1139136766 learned_addr learned my addr 172.21.15.96:0/1139136766 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 -- 172.21.15.96:0/1139136766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb040f6700 msgr2=0x7feb04106220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T18:59:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb040f6700 0x7feb04106220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:59:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.753+0000 7feb02ffd700 1 -- 172.21.15.96:0/1139136766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8005040 con 0x7feb040f5460 2022-02-02T18:59:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feb02ffd700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7feaf4002700 tx=0x7feaf4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf4009320 con 0x7feb040f5460 2022-02-02T18:59:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feaf400f040 con 0x7feb040f5460 2022-02-02T18:59:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb041072b0 con 0x7feb040f5460 2022-02-02T18:59:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf4014900 con 0x7feb040f5460 2022-02-02T18:59:11.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.754+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04107870 con 0x7feb040f5460 2022-02-02T18:59:11.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.755+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb04045ad0 con 0x7feb040f5460 2022-02-02T18:59:11.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.755+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feaf4009480 con 0x7feb040f5460 2022-02-02T18:59:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.756+0000 7feaeb7fe700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 0x7feaec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.756+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feaf40816b0 con 0x7feb040f5460 2022-02-02T18:59:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.756+0000 7feb027fc700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 0x7feaec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.756+0000 7feb027fc700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 0x7feaec0672e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7feaf8004e30 tx=0x7feaf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:11.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.760+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feaf4053100 con 0x7feb040f5460 2022-02-02T18:59:11.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.989+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb040fdc20 con 0x7feb040f5460 2022-02-02T18:59:11.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.990+0000 7feaeb7fe700 1 -- 172.21.15.96:0/1139136766 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7feaf4052cf0 con 0x7feb040f5460 2022-02-02T18:59:11.986 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:59:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:59:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:59:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:11.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:59:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:59:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:11.988 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:59:11.989 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:59:11.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:11.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:59:11.990 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:59:11.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:11.990 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:59:11.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:59:11.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:59:11.991 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:59:11.991 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:59:11.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 msgr2=0x7feaec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 0x7feaec0672e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7feaf8004e30 tx=0x7feaf8009b30).stop 2022-02-02T18:59:11.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 msgr2=0x7feb04105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:11.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7feaf4002700 tx=0x7feaf4009d80).stop 2022-02-02T18:59:11.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 shutdown_connections 2022-02-02T18:59:11.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feaec064e20 0x7feaec0672e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb040f5460 0x7feb04105d30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:11.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 --2- 172.21.15.96:0/1139136766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb040f6700 0x7feb04106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T18:59:11.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 >> 172.21.15.96:0/1139136766 conn(0x7feb040f0bc0 msgr2=0x7feb040fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:11.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 shutdown_connections 2022-02-02T18:59:11.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:11.992+0000 7feb096b6700 1 -- 172.21.15.96:0/1139136766 wait complete. 2022-02-02T18:59:12.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 -- 172.21.15.96:0/2104789003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 msgr2=0x7f3dd00f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:12.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 --2- 172.21.15.96:0/2104789003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd00f5d30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f3dc4004660 tx=0x7f3dc4009b30).stop 2022-02-02T18:59:12.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 -- 172.21.15.96:0/2104789003 shutdown_connections 2022-02-02T18:59:12.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 --2- 172.21.15.96:0/2104789003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd00f5d30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 --2- 172.21.15.96:0/2104789003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd00f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 -- 172.21.15.96:0/2104789003 >> 172.21.15.96:0/2104789003 conn(0x7f3dd00f04c0 msgr2=0x7f3dd00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:12.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 -- 172.21.15.96:0/2104789003 shutdown_connections 2022-02-02T18:59:12.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.092+0000 7f3dd6473700 1 -- 172.21.15.96:0/2104789003 wait complete. 2022-02-02T18:59:12.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 Processor -- start 2022-02-02T18:59:12.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 -- start start 2022-02-02T18:59:12.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:12.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:12.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00f55a0 con 0x7f3dd00f58b0 2022-02-02T18:59:12.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dd6473700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00f56e0 con 0x7f3dd00f6bb0 2022-02-02T18:59:12.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:12.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57142/0 (socket says 172.21.15.96:57142) 2022-02-02T18:59:12.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 -- 172.21.15.96:0/3119690763 learned_addr learned my addr 172.21.15.96:0/3119690763 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:12.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcf7fe700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:12.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 -- 172.21.15.96:0/3119690763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 msgr2=0x7f3dd010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:12.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 -- 172.21.15.96:0/3119690763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4005040 con 0x7f3dd00f58b0 2022-02-02T18:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcf7fe700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.093+0000 7f3dcffff700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f3dc0002700 tx=0x7f3dc0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.094+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc0009320 con 0x7f3dd00f58b0 2022-02-02T18:59:12.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.094+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3dc000f040 con 0x7f3dd00f58b0 2022-02-02T18:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.094+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd010c7e0 con 0x7f3dd00f58b0 2022-02-02T18:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.094+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc0014900 con 0x7f3dd00f58b0 2022-02-02T18:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.094+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd010cd70 con 0x7f3dd00f58b0 2022-02-02T18:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.095+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00f4150 con 0x7f3dd00f58b0 2022-02-02T18:59:12.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.095+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3dc0009480 con 0x7f3dd00f58b0 2022-02-02T18:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.096+0000 7f3dccff9700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 0x7f3db8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.096+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3dc0081d00 con 0x7f3dd00f58b0 2022-02-02T18:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.096+0000 7f3dcf7fe700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 0x7f3db8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.096+0000 7f3dcf7fe700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 0x7f3db8067290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f3dc4009da0 tx=0x7f3dc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.100+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3dc004fdb0 con 0x7f3dd00f58b0 2022-02-02T18:59:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.303+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3dd00586e0 con 0x7f3dd00f58b0 2022-02-02T18:59:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.304+0000 7f3dccff9700 1 -- 172.21.15.96:0/3119690763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3dc00533d0 con 0x7f3dd00f58b0 2022-02-02T18:59:12.300 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:59:12.300 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:59:12.300 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:59:12.301 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:59:12.301 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:12.301 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:59:12.301 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:59:12.302 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:59:12.302 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:59:12.303 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:59:12.303 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:59:12.303 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:59:12.303 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:59:12.303 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:59:12.304 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:59:12.304 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:59:12.304 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:59:12.304 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:59:12.305 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:59:12.305 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:59:12.306 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:59:12.306 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:59:12.307 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:59:12.307 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:59:12.307 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:59:12.308 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:59:12.308 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:59:12.309 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:59:12.309 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:59:12.309 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:59:12.310 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:59:12.310 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:59:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:12.311 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:59:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:12.311 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:12.312 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:12.312 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:12.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.305+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 msgr2=0x7f3db8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:12.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.305+0000 7f3dd6473700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 0x7f3db8067290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f3dc4009da0 tx=0x7f3dc4009b30).stop 2022-02-02T18:59:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.305+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 msgr2=0x7f3dd0109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.305+0000 7f3dd6473700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f3dc0002700 tx=0x7f3dc0009d80).stop 2022-02-02T18:59:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 shutdown_connections 2022-02-02T18:59:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3db8064dd0 0x7f3db8067290 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd00f58b0 0x7f3dd0109cd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 --2- 172.21.15.96:0/3119690763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3dd00f6bb0 0x7f3dd010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 >> 172.21.15.96:0/3119690763 conn(0x7f3dd00f04c0 msgr2=0x7f3dd00fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:12.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 shutdown_connections 2022-02-02T18:59:12.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:12.306+0000 7f3dd6473700 1 -- 172.21.15.96:0/3119690763 wait complete. 2022-02-02T18:59:12.316 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:59:13.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:12 smithi159 ceph-mon[69013]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:13.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:12 smithi159 ceph-mon[69013]: pgmap v1112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:13.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:12 smithi159 ceph-mon[69013]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:13.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1139136766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:59:13.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3119690763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:59:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:12 smithi096 ceph-mon[101353]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:13.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:12 smithi096 ceph-mon[101353]: pgmap v1112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:13.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:12 smithi096 ceph-mon[101353]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:13.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1139136766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:59:13.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3119690763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:59:15.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:14 smithi159 ceph-mon[69013]: pgmap v1113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:15.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:14 smithi096 ceph-mon[101353]: pgmap v1113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:16 smithi159 ceph-mon[69013]: pgmap v1114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:17.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:16 smithi096 ceph-mon[101353]: pgmap v1114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:19.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:18 smithi159 ceph-mon[69013]: pgmap v1115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:19.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:18 smithi096 ceph-mon[101353]: pgmap v1115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:21.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:20 smithi159 ceph-mon[69013]: pgmap v1116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:21.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:20 smithi096 ceph-mon[101353]: pgmap v1116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:23.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:22 smithi159 ceph-mon[69013]: pgmap v1117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:23.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:22 smithi096 ceph-mon[101353]: pgmap v1117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:25.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:24 smithi159 ceph-mon[69013]: pgmap v1118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:25.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:24 smithi096 ceph-mon[101353]: pgmap v1118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:27.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:26 smithi159 ceph-mon[69013]: pgmap v1119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:27.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:26 smithi096 ceph-mon[101353]: pgmap v1119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:28.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:59:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:59:28.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T18:59:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T18:59:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:28 smithi159 ceph-mon[69013]: pgmap v1120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:29.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:28 smithi096 ceph-mon[101353]: pgmap v1120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:31.019 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:30 smithi159 ceph-mon[69013]: pgmap v1121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:31.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:30 smithi096 ceph-mon[101353]: pgmap v1121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:32 smithi159 ceph-mon[69013]: pgmap v1122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:33.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:32 smithi096 ceph-mon[101353]: pgmap v1122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:35.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:34 smithi159 ceph-mon[69013]: pgmap v1123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:35.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:34 smithi096 ceph-mon[101353]: pgmap v1123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:37.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:36 smithi159 ceph-mon[69013]: pgmap v1124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:37.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:36 smithi096 ceph-mon[101353]: pgmap v1124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:39.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:38 smithi159 ceph-mon[69013]: pgmap v1125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:39.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:38 smithi096 ceph-mon[101353]: pgmap v1125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:41.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:40 smithi159 ceph-mon[69013]: pgmap v1126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:41.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:40 smithi096 ceph-mon[101353]: pgmap v1126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- 172.21.15.96:0/1978055241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 msgr2=0x7f32d00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 --2- 172.21.15.96:0/1978055241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d00f5850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f32cc004660 tx=0x7f32cc009b30).stop 2022-02-02T18:59:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- 172.21.15.96:0/1978055241 shutdown_connections 2022-02-02T18:59:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 --2- 172.21.15.96:0/1978055241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 --2- 172.21.15.96:0/1978055241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d00f5850 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- 172.21.15.96:0/1978055241 >> 172.21.15.96:0/1978055241 conn(0x7f32d00f0b90 msgr2=0x7f32d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- 172.21.15.96:0/1978055241 shutdown_connections 2022-02-02T18:59:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- 172.21.15.96:0/1978055241 wait complete. 2022-02-02T18:59:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 Processor -- start 2022-02-02T18:59:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.418+0000 7f32d710c700 1 -- start start 2022-02-02T18:59:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d710c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d710c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d710c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00603e0 con 0x7f32d00f5430 2022-02-02T18:59:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d710c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0060520 con 0x7f32d00f66d0 2022-02-02T18:59:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57160/0 (socket says 172.21.15.96:57160) 2022-02-02T18:59:42.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 -- 172.21.15.96:0/4012702544 learned_addr learned my addr 172.21.15.96:0/4012702544 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:42.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d5909700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 -- 172.21.15.96:0/4012702544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 msgr2=0x7f32d010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d010bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 -- 172.21.15.96:0/4012702544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc005040 con 0x7f32d00f5430 2022-02-02T18:59:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d5909700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:59:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.419+0000 7f32d610a700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f32cc013a70 tx=0x7f32cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.420+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc018070 con 0x7f32d00f5430 2022-02-02T18:59:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.420+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32cc0097d0 con 0x7f32d00f5430 2022-02-02T18:59:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.420+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d010c4e0 con 0x7f32d00f5430 2022-02-02T18:59:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.420+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc01c3c0 con 0x7f32d00f5430 2022-02-02T18:59:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.420+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d010ca40 con 0x7f32d00f5430 2022-02-02T18:59:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.421+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d0045ad0 con 0x7f32d00f5430 2022-02-02T18:59:42.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.421+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f32cc007ba0 con 0x7f32d00f5430 2022-02-02T18:59:42.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.421+0000 7f32c6ffd700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 0x7f32bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.422+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f32cc083690 con 0x7f32d00f5430 2022-02-02T18:59:42.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.422+0000 7f32d5909700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 0x7f32bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.422+0000 7f32d5909700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 0x7f32bc0672e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f32c0009fd0 tx=0x7f32c000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:42.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.426+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32cc051800 con 0x7f32d00f5430 2022-02-02T18:59:42.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.605+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32d0057f10 con 0x7f32bc064e20 2022-02-02T18:59:42.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.606+0000 7f32c6ffd700 1 -- 172.21.15.96:0/4012702544 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f32d0057f10 con 0x7f32bc064e20 2022-02-02T18:59:42.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 msgr2=0x7f32bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 0x7f32bc0672e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f32c0009fd0 tx=0x7f32c000b040).stop 2022-02-02T18:59:42.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 msgr2=0x7f32d0109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f32cc013a70 tx=0x7f32cc009b30).stop 2022-02-02T18:59:42.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 shutdown_connections 2022-02-02T18:59:42.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32bc064e20 0x7f32bc0672e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32d00f5430 0x7f32d0109a90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 --2- 172.21.15.96:0/4012702544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d00f66d0 0x7f32d010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 >> 172.21.15.96:0/4012702544 conn(0x7f32d00f0b90 msgr2=0x7f32d00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:42.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 shutdown_connections 2022-02-02T18:59:42.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.608+0000 7f32d710c700 1 -- 172.21.15.96:0/4012702544 wait complete. 2022-02-02T18:59:42.614 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T18:59:42.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 -- 172.21.15.96:0/1470346707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f7980 msgr2=0x7f47f40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 --2- 172.21.15.96:0/1470346707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f7980 0x7f47f40f7de0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f47dc004660 tx=0x7f47dc009b30).stop 2022-02-02T18:59:42.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 -- 172.21.15.96:0/1470346707 shutdown_connections 2022-02-02T18:59:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 --2- 172.21.15.96:0/1470346707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f7980 0x7f47f40f7de0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 --2- 172.21.15.96:0/1470346707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f66e0 0x7f47f40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:59:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 -- 172.21.15.96:0/1470346707 >> 172.21.15.96:0/1470346707 conn(0x7f47f40f1e40 msgr2=0x7f47f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 -- 172.21.15.96:0/1470346707 shutdown_connections 2022-02-02T18:59:42.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.706+0000 7f47f8f05700 1 -- 172.21.15.96:0/1470346707 wait complete. 2022-02-02T18:59:42.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 Processor -- start 2022-02-02T18:59:42.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 -- start start 2022-02-02T18:59:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 0x7f47f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406a410 con 0x7f47f40f66e0 2022-02-02T18:59:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f8f05700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406a550 con 0x7f47f40f7980 2022-02-02T18:59:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57170/0 (socket says 172.21.15.96:57170) 2022-02-02T18:59:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 -- 172.21.15.96:0/3656448698 learned_addr learned my addr 172.21.15.96:0/3656448698 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f1d9b700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 0x7f47f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 -- 172.21.15.96:0/3656448698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 msgr2=0x7f47f4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 0x7f47f4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.707+0000 7f47f259c700 1 -- 172.21.15.96:0/3656448698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc005040 con 0x7f47f40f66e0 2022-02-02T18:59:42.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47f1d9b700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 0x7f47f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T18:59:42.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47f259c700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f47e40093f0 tx=0x7f47e4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:42.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e4009ea0 con 0x7f47f40f66e0 2022-02-02T18:59:42.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47e4013af0 con 0x7f47f40f66e0 2022-02-02T18:59:42.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f406a830 con 0x7f47f40f66e0 2022-02-02T18:59:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e400db10 con 0x7f47f40f66e0 2022-02-02T18:59:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.708+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f410efe0 con 0x7f47f40f66e0 2022-02-02T18:59:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.709+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f4045ad0 con 0x7f47f40f66e0 2022-02-02T18:59:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.710+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47e401a060 con 0x7f47f40f66e0 2022-02-02T18:59:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.710+0000 7f47eaffd700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 0x7f47e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.710+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f47e4081ed0 con 0x7f47f40f66e0 2022-02-02T18:59:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.710+0000 7f47f1d9b700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 0x7f47e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.711+0000 7f47f1d9b700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 0x7f47e0067290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f47dc009da0 tx=0x7f47dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.714+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47e404ff80 con 0x7f47f40f66e0 2022-02-02T18:59:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.887+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47f4057f10 con 0x7f47e0064dd0 2022-02-02T18:59:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.897+0000 7f47eaffd700 1 -- 172.21.15.96:0/3656448698 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f47f4057f10 con 0x7f47e0064dd0 2022-02-02T18:59:42.894 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T18:59:42.894 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (43m) 13m ago 44m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T18:59:42.894 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (35m) 13m ago 44m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T18:59:42.894 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (35m) 12m ago 43m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T18:59:42.895 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (42m) 13m ago 43m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T18:59:42.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (40m) 13m ago 40m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T18:59:42.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (35m) 13m ago 40m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T18:59:42.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (40m) 12m ago 40m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T18:59:42.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (36m) 12m ago 40m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T18:59:42.896 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (37m) 13m ago 45m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T18:59:42.896 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (36m) 12m ago 43m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T18:59:42.896 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (36m) 13m ago 45m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T18:59:42.896 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (36m) 12m ago 43m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T18:59:42.897 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (43m) 13m ago 43m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T18:59:42.897 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (43m) 12m ago 43m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T18:59:42.897 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (35m) 13m ago 42m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T18:59:42.897 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (34m) 13m ago 42m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T18:59:42.897 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (34m) 13m ago 42m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T18:59:42.898 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (33m) 12m ago 42m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T18:59:42.898 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (32m) 12m ago 41m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T18:59:42.898 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (32m) 12m ago 41m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T18:59:42.898 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (42m) 13m ago 43m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T18:59:42.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 msgr2=0x7f47e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 0x7f47e0067290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f47dc009da0 tx=0x7f47dc009b30).stop 2022-02-02T18:59:42.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 msgr2=0x7f47f406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f47e40093f0 tx=0x7f47e4006ec0).stop 2022-02-02T18:59:42.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 shutdown_connections 2022-02-02T18:59:42.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47e0064dd0 0x7f47e0067290 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f40f66e0 0x7f47f406b9a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 --2- 172.21.15.96:0/3656448698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f40f7980 0x7f47f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 >> 172.21.15.96:0/3656448698 conn(0x7f47f40f1e40 msgr2=0x7f47f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:42.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 shutdown_connections 2022-02-02T18:59:42.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.899+0000 7f47f8f05700 1 -- 172.21.15.96:0/3656448698 wait complete. 2022-02-02T18:59:42.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 -- 172.21.15.96:0/2813081726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f6860 msgr2=0x7f6ba00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:42.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/2813081726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f6860 0x7f6ba00f6cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6b8c004660 tx=0x7f6b8c009b30).stop 2022-02-02T18:59:42.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 -- 172.21.15.96:0/2813081726 shutdown_connections 2022-02-02T18:59:42.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/2813081726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f6860 0x7f6ba00f6cc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/2813081726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f55c0 0x7f6ba00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:42.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.996+0000 7f6ba6adf700 1 -- 172.21.15.96:0/2813081726 >> 172.21.15.96:0/2813081726 conn(0x7f6ba00f0d40 msgr2=0x7f6ba00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:42.994 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:42 smithi096 ceph-mon[101353]: pgmap v1127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:42.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 -- 172.21.15.96:0/2813081726 shutdown_connections 2022-02-02T18:59:42.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 -- 172.21.15.96:0/2813081726 wait complete. 2022-02-02T18:59:42.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 Processor -- start 2022-02-02T18:59:42.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 -- start start 2022-02-02T18:59:42.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.997+0000 7f6ba6adf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f6860 0x7f6ba0109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:42.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba6adf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0109c20 con 0x7f6ba00f55c0 2022-02-02T18:59:42.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba6adf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0109d60 con 0x7f6ba00f6860 2022-02-02T18:59:42.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57180/0 (socket says 172.21.15.96:57180) 2022-02-02T18:59:42.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 -- 172.21.15.96:0/3438358289 learned_addr learned my addr 172.21.15.96:0/3438358289 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:42.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6b9ffff700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f6860 0x7f6ba0109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:42.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 -- 172.21.15.96:0/3438358289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f6860 msgr2=0x7f6ba0109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f6860 0x7f6ba0109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 -- 172.21.15.96:0/3438358289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c005040 con 0x7f6ba00f55c0 2022-02-02T18:59:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba487b700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6b9400c530 tx=0x7f6b94007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9400f650 con 0x7f6ba00f55c0 2022-02-02T18:59:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba010a700 con 0x7f6ba00f55c0 2022-02-02T18:59:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b9400fc60 con 0x7f6ba00f55c0 2022-02-02T18:59:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b94012d20 con 0x7f6ba00f55c0 2022-02-02T18:59:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.998+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba010acc0 con 0x7f6ba00f55c0 2022-02-02T18:59:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:42.999+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba0045ad0 con 0x7f6ba00f55c0 2022-02-02T18:59:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.000+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b94019030 con 0x7f6ba00f55c0 2022-02-02T18:59:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.000+0000 7f6b9d7fa700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 0x7f6b90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.000+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6b94081700 con 0x7f6ba00f55c0 2022-02-02T18:59:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.000+0000 7f6b9ffff700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 0x7f6b90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.001+0000 7f6b9ffff700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 0x7f6b90067290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6b8c004e30 tx=0x7f6b8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.005+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b94053230 con 0x7f6ba00f55c0 2022-02-02T18:59:43.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:42 smithi159 ceph-mon[69013]: pgmap v1127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.232+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ba010f7d0 con 0x7f6ba00f55c0 2022-02-02T18:59:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.232+0000 7f6b9d7fa700 1 -- 172.21.15.96:0/3438358289 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6b94052e20 con 0x7f6ba00f55c0 2022-02-02T18:59:43.229 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T18:59:43.229 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T18:59:43.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:59:43.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:43.230 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T18:59:43.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T18:59:43.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:43.231 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T18:59:43.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T18:59:43.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:43.231 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T18:59:43.232 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T18:59:43.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T18:59:43.232 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T18:59:43.232 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T18:59:43.233 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T18:59:43.233 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T18:59:43.233 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T18:59:43.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 msgr2=0x7f6b90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 0x7f6b90067290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6b8c004e30 tx=0x7f6b8c009b30).stop 2022-02-02T18:59:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 msgr2=0x7f6ba0109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6b9400c530 tx=0x7f6b94007e10).stop 2022-02-02T18:59:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 shutdown_connections 2022-02-02T18:59:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b90064dd0 0x7f6b90067290 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ba00f55c0 0x7f6ba0109180 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 --2- 172.21.15.96:0/3438358289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba00f6860 0x7f6ba0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 >> 172.21.15.96:0/3438358289 conn(0x7f6ba00f0d40 msgr2=0x7f6ba005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 shutdown_connections 2022-02-02T18:59:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.235+0000 7f6ba6adf700 1 -- 172.21.15.96:0/3438358289 wait complete. 2022-02-02T18:59:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 -- 172.21.15.96:0/2573665417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 msgr2=0x7f28ac0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 --2- 172.21.15.96:0/2573665417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac0f6b30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f289c004660 tx=0x7f289c009b30).stop 2022-02-02T18:59:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 -- 172.21.15.96:0/2573665417 shutdown_connections 2022-02-02T18:59:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 --2- 172.21.15.96:0/2573665417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac0f6b30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 --2- 172.21.15.96:0/2573665417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 0x7f28ac0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T18:59:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 -- 172.21.15.96:0/2573665417 >> 172.21.15.96:0/2573665417 conn(0x7f28ac0f0b90 msgr2=0x7f28ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.333+0000 7f28b21ab700 1 -- 172.21.15.96:0/2573665417 shutdown_connections 2022-02-02T18:59:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 -- 172.21.15.96:0/2573665417 wait complete. 2022-02-02T18:59:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 Processor -- start 2022-02-02T18:59:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 -- start start 2022-02-02T18:59:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 0x7f28ac106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac107980 con 0x7f28ac0f66d0 2022-02-02T18:59:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b21ab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac108100 con 0x7f28ac0f5430 2022-02-02T18:59:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b09a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b09a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57192/0 (socket says 172.21.15.96:57192) 2022-02-02T18:59:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b09a8700 1 -- 172.21.15.96:0/1169980009 learned_addr learned my addr 172.21.15.96:0/1169980009 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T18:59:43.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.334+0000 7f28b11a9700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 0x7f28ac106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:43.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b09a8700 1 -- 172.21.15.96:0/1169980009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 msgr2=0x7f28ac106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b09a8700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 0x7f28ac106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b09a8700 1 -- 172.21.15.96:0/1169980009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c005040 con 0x7f28ac0f66d0 2022-02-02T18:59:43.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b09a8700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f289c009990 tx=0x7f289c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:43.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f289c018070 con 0x7f28ac0f66d0 2022-02-02T18:59:43.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f289c007ca0 con 0x7f28ac0f66d0 2022-02-02T18:59:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac108320 con 0x7f28ac0f66d0 2022-02-02T18:59:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f289c01c620 con 0x7f28ac0f66d0 2022-02-02T18:59:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.335+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac108880 con 0x7f28ac0f66d0 2022-02-02T18:59:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.336+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac045ad0 con 0x7f28ac0f66d0 2022-02-02T18:59:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.336+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f289c01d420 con 0x7f28ac0f66d0 2022-02-02T18:59:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.337+0000 7f28a1ffb700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 0x7f28980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T18:59:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.337+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f289c083780 con 0x7f28ac0f66d0 2022-02-02T18:59:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.337+0000 7f28b11a9700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 0x7f28980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T18:59:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.337+0000 7f28b11a9700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 0x7f28980672e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f28ac106b70 tx=0x7f28a8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T18:59:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.341+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f289c0518f0 con 0x7f28ac0f66d0 2022-02-02T18:59:43.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.541+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28ac10d340 con 0x7f28ac0f66d0 2022-02-02T18:59:43.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.542+0000 7f28a1ffb700 1 -- 172.21.15.96:0/1169980009 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f289c054f10 con 0x7f28ac0f66d0 2022-02-02T18:59:43.539 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T18:59:43.539 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T18:59:43.539 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:59:43.540 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T18:59:43.540 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:43.540 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T18:59:43.540 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T18:59:43.541 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T18:59:43.541 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T18:59:43.541 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T18:59:43.541 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T18:59:43.541 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T18:59:43.542 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T18:59:43.542 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T18:59:43.542 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T18:59:43.542 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T18:59:43.543 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T18:59:43.543 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T18:59:43.543 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T18:59:43.543 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T18:59:43.544 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T18:59:43.544 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T18:59:43.544 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T18:59:43.544 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T18:59:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T18:59:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T18:59:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T18:59:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T18:59:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T18:59:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T18:59:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T18:59:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T18:59:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T18:59:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T18:59:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T18:59:43.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.543+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 msgr2=0x7f28980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.543+0000 7f28b21ab700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 0x7f28980672e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f28ac106b70 tx=0x7f28a8008040).stop 2022-02-02T18:59:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.543+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 msgr2=0x7f28ac1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T18:59:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.543+0000 7f28b21ab700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f289c009990 tx=0x7f289c009b30).stop 2022-02-02T18:59:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 shutdown_connections 2022-02-02T18:59:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2898064e20 0x7f28980672e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28ac0f5430 0x7f28ac106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 --2- 172.21.15.96:0/1169980009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28ac0f66d0 0x7f28ac1072f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T18:59:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 >> 172.21.15.96:0/1169980009 conn(0x7f28ac0f0b90 msgr2=0x7f28ac05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T18:59:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 shutdown_connections 2022-02-02T18:59:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T18:59:43.544+0000 7f28b21ab700 1 -- 172.21.15.96:0/1169980009 wait complete. 2022-02-02T18:59:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T18:59:44.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:43 smithi159 ceph-mon[69013]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:44.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3438358289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:59:44.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1169980009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:59:44.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:43 smithi096 ceph-mon[101353]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:44.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3438358289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T18:59:44.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1169980009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T18:59:45.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:44 smithi159 ceph-mon[69013]: from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:45.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:44 smithi159 ceph-mon[69013]: pgmap v1128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:45.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:44 smithi096 ceph-mon[101353]: from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T18:59:45.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:44 smithi096 ceph-mon[101353]: pgmap v1128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:47.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:46 smithi159 ceph-mon[69013]: pgmap v1129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:47.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:46 smithi096 ceph-mon[101353]: pgmap v1129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:49.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:48 smithi159 ceph-mon[69013]: pgmap v1130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:49.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:48 smithi096 ceph-mon[101353]: pgmap v1130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:51.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:50 smithi159 ceph-mon[69013]: pgmap v1131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:51.050 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:50 smithi096 ceph-mon[101353]: pgmap v1131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:53.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:52 smithi159 ceph-mon[69013]: pgmap v1132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:53.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:52 smithi096 ceph-mon[101353]: pgmap v1132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:55.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:54 smithi159 ceph-mon[69013]: pgmap v1133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:55.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:54 smithi096 ceph-mon[101353]: pgmap v1133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:57.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:56 smithi159 ceph-mon[69013]: pgmap v1134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:57.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:56 smithi096 ceph-mon[101353]: pgmap v1134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:59.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:58 smithi159 ceph-mon[69013]: pgmap v1135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T18:59:59.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:58 smithi096 ceph-mon[101353]: pgmap v1135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:00.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 18:59:59 smithi096 ceph-mon[101353]: pgmap v1136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:00.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 18:59:59 smithi159 ceph-mon[69013]: pgmap v1136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:01.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:00:01.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:00:02.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:01 smithi096 ceph-mon[101353]: pgmap v1137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:02.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:01 smithi159 ceph-mon[69013]: pgmap v1137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:05.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:04 smithi159 ceph-mon[69013]: pgmap v1138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:05.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:04 smithi096 ceph-mon[101353]: pgmap v1138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:07.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:06 smithi159 ceph-mon[69013]: pgmap v1139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:07.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:06 smithi096 ceph-mon[101353]: pgmap v1139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:09.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:08 smithi159 ceph-mon[69013]: pgmap v1140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:09.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:08 smithi096 ceph-mon[101353]: pgmap v1140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:11.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:10 smithi159 ceph-mon[69013]: pgmap v1141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:11.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:10 smithi096 ceph-mon[101353]: pgmap v1141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:13.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:12 smithi159 ceph-mon[69013]: pgmap v1142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:13.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:12 smithi096 ceph-mon[101353]: pgmap v1142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:13.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 -- 172.21.15.96:0/3699852775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 msgr2=0x7f01580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 --2- 172.21.15.96:0/3699852775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f59e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f01500099e0 tx=0x7f0150004d10).stop 2022-02-02T19:00:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 -- 172.21.15.96:0/3699852775 shutdown_connections 2022-02-02T19:00:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 --2- 172.21.15.96:0/3699852775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 0x7f01580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 --2- 172.21.15.96:0/3699852775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f59e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 -- 172.21.15.96:0/3699852775 >> 172.21.15.96:0/3699852775 conn(0x7f01580f0d40 msgr2=0x7f01580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 -- 172.21.15.96:0/3699852775 shutdown_connections 2022-02-02T19:00:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.654+0000 7f015dacb700 1 -- 172.21.15.96:0/3699852775 wait complete. 2022-02-02T19:00:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 Processor -- start 2022-02-02T19:00:13.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 -- start start 2022-02-02T19:00:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 0x7f01580f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580f8920 con 0x7f01580f55c0 2022-02-02T19:00:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f015dacb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580f8a60 con 0x7f01580f6860 2022-02-02T19:00:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f01577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f01577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57212/0 (socket says 172.21.15.96:57212) 2022-02-02T19:00:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.655+0000 7f01577fe700 1 -- 172.21.15.96:0/3816056003 learned_addr learned my addr 172.21.15.96:0/3816056003 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f0156ffd700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 0x7f01580f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f01577fe700 1 -- 172.21.15.96:0/3816056003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 msgr2=0x7f01580f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f01577fe700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 0x7f01580f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f01577fe700 1 -- 172.21.15.96:0/3816056003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150009640 con 0x7f01580f55c0 2022-02-02T19:00:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f01577fe700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f015000c010 tx=0x7f0150004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f015000e070 con 0x7f01580f55c0 2022-02-02T19:00:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01580f8ce0 con 0x7f01580f55c0 2022-02-02T19:00:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0150007dc0 con 0x7f01580f55c0 2022-02-02T19:00:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0150018070 con 0x7f01580f55c0 2022-02-02T19:00:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.656+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01580f91c0 con 0x7f01580f55c0 2022-02-02T19:00:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.657+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158045ad0 con 0x7f01580f55c0 2022-02-02T19:00:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.657+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0150024060 con 0x7f01580f55c0 2022-02-02T19:00:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.658+0000 7f014ffff700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 0x7f0144067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.658+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0150083360 con 0x7f01580f55c0 2022-02-02T19:00:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.658+0000 7f0156ffd700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 0x7f0144067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.658+0000 7f0156ffd700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 0x7f0144067290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0140009760 tx=0x7f0140009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.662+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0150051410 con 0x7f01580f55c0 2022-02-02T19:00:13.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.842+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f015805fd30 con 0x7f0144064dd0 2022-02-02T19:00:13.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.843+0000 7f014ffff700 1 -- 172.21.15.96:0/3816056003 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f015805fd30 con 0x7f0144064dd0 2022-02-02T19:00:13.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 msgr2=0x7f0144067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 0x7f0144067290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0140009760 tx=0x7f0140009c60).stop 2022-02-02T19:00:13.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 msgr2=0x7f01580f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f015000c010 tx=0x7f0150004d10).stop 2022-02-02T19:00:13.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 shutdown_connections 2022-02-02T19:00:13.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0144064dd0 0x7f0144067290 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01580f55c0 0x7f01580f9f40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 --2- 172.21.15.96:0/3816056003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01580f6860 0x7f01580f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 >> 172.21.15.96:0/3816056003 conn(0x7f01580f0d40 msgr2=0x7f015805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:13.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 shutdown_connections 2022-02-02T19:00:13.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.845+0000 7f015dacb700 1 -- 172.21.15.96:0/3816056003 wait complete. 2022-02-02T19:00:13.852 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:00:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 -- 172.21.15.96:0/238996574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f5430 msgr2=0x7f3e280f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 --2- 172.21.15.96:0/238996574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f5430 0x7f3e280f5850 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f3e18004660 tx=0x7f3e18009b30).stop 2022-02-02T19:00:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 -- 172.21.15.96:0/238996574 shutdown_connections 2022-02-02T19:00:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 --2- 172.21.15.96:0/238996574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f66d0 0x7f3e280f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 --2- 172.21.15.96:0/238996574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f5430 0x7f3e280f5850 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 -- 172.21.15.96:0/238996574 >> 172.21.15.96:0/238996574 conn(0x7f3e280f0b90 msgr2=0x7f3e280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.942+0000 7f3e27fff700 1 -- 172.21.15.96:0/238996574 shutdown_connections 2022-02-02T19:00:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 -- 172.21.15.96:0/238996574 wait complete. 2022-02-02T19:00:13.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 Processor -- start 2022-02-02T19:00:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 -- start start 2022-02-02T19:00:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f5430 0x7f3e28106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e281078f0 con 0x7f3e280f66d0 2022-02-02T19:00:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.943+0000 7f3e27fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28108100 con 0x7f3e280f5430 2022-02-02T19:00:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57224/0 (socket says 172.21.15.96:57224) 2022-02-02T19:00:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 -- 172.21.15.96:0/1695585364 learned_addr learned my addr 172.21.15.96:0/1695585364 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f5430 0x7f3e28106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 -- 172.21.15.96:0/1695585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f5430 msgr2=0x7f3e28106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f5430 0x7f3e28106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 -- 172.21.15.96:0/1695585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18005040 con 0x7f3e280f66d0 2022-02-02T19:00:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e267fc700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f3e1c0026d0 tx=0x7f3e1c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1c009320 con 0x7f3e280f66d0 2022-02-02T19:00:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e28108380 con 0x7f3e280f66d0 2022-02-02T19:00:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e1c00f040 con 0x7f3e280f66d0 2022-02-02T19:00:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.944+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1c0147e0 con 0x7f3e280f66d0 2022-02-02T19:00:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.945+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e28108940 con 0x7f3e280f66d0 2022-02-02T19:00:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.946+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28059100 con 0x7f3e280f66d0 2022-02-02T19:00:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.946+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e1c009480 con 0x7f3e280f66d0 2022-02-02T19:00:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.946+0000 7f3e0f7fe700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 0x7f3e100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.946+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e1c082170 con 0x7f3e280f66d0 2022-02-02T19:00:13.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.946+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 0x7f3e100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:13.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.947+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 0x7f3e100672e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f3e18009da0 tx=0x7f3e18009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:13.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:13.950+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e1c050220 con 0x7f3e280f66d0 2022-02-02T19:00:14.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.121+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e280fee60 con 0x7f3e10064e20 2022-02-02T19:00:14.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.131+0000 7f3e0f7fe700 1 -- 172.21.15.96:0/1695585364 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3e280fee60 con 0x7f3e10064e20 2022-02-02T19:00:14.129 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:00:14.130 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (43m) 14m ago 44m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:00:14.130 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (36m) 14m ago 44m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:00:14.131 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (35m) 12m ago 44m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:00:14.131 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (43m) 14m ago 44m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:00:14.132 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (40m) 14m ago 40m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:00:14.132 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (36m) 14m ago 40m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:00:14.132 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (40m) 12m ago 40m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:00:14.133 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (36m) 12m ago 40m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:00:14.133 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (37m) 14m ago 45m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:00:14.134 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (37m) 12m ago 44m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:00:14.134 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (36m) 14m ago 45m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:00:14.135 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (36m) 12m ago 44m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:00:14.135 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (44m) 14m ago 44m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:00:14.136 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (43m) 12m ago 43m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:00:14.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (35m) 14m ago 43m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:00:14.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (35m) 14m ago 43m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:00:14.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (34m) 14m ago 42m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:00:14.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (34m) 12m ago 42m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:00:14.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (33m) 12m ago 42m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:00:14.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (33m) 12m ago 42m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:00:14.138 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (43m) 14m ago 44m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:00:14.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 msgr2=0x7f3e100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 0x7f3e100672e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f3e18009da0 tx=0x7f3e18009b30).stop 2022-02-02T19:00:14.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 msgr2=0x7f3e281072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f3e1c0026d0 tx=0x7f3e1c009de0).stop 2022-02-02T19:00:14.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 shutdown_connections 2022-02-02T19:00:14.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064e20 0x7f3e100672e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f5430 0x7f3e28106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 --2- 172.21.15.96:0/1695585364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66d0 0x7f3e281072f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 >> 172.21.15.96:0/1695585364 conn(0x7f3e280f0b90 msgr2=0x7f3e280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:14.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 shutdown_connections 2022-02-02T19:00:14.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.133+0000 7f3e27fff700 1 -- 172.21.15.96:0/1695585364 wait complete. 2022-02-02T19:00:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 -- 172.21.15.96:0/2650904089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f55c0 msgr2=0x7fc5600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 --2- 172.21.15.96:0/2650904089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f55c0 0x7fc5600f59e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fc55c004660 tx=0x7fc55c009b30).stop 2022-02-02T19:00:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 -- 172.21.15.96:0/2650904089 shutdown_connections 2022-02-02T19:00:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 --2- 172.21.15.96:0/2650904089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f6860 0x7fc5600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:00:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 --2- 172.21.15.96:0/2650904089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f55c0 0x7fc5600f59e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 -- 172.21.15.96:0/2650904089 >> 172.21.15.96:0/2650904089 conn(0x7fc5600f0d40 msgr2=0x7fc5600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 -- 172.21.15.96:0/2650904089 shutdown_connections 2022-02-02T19:00:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.229+0000 7fc5681af700 1 -- 172.21.15.96:0/2650904089 wait complete. 2022-02-02T19:00:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 Processor -- start 2022-02-02T19:00:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 -- start start 2022-02-02T19:00:14.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f55c0 0x7fc560105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5601069f0 con 0x7fc5600f6860 2022-02-02T19:00:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc5681af700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5601072a0 con 0x7fc5600f55c0 2022-02-02T19:00:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57234/0 (socket says 172.21.15.96:57234) 2022-02-02T19:00:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 -- 172.21.15.96:0/3612951929 learned_addr learned my addr 172.21.15.96:0/3612951929 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc565f4b700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f55c0 0x7fc560105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 -- 172.21.15.96:0/3612951929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f55c0 msgr2=0x7fc560105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f55c0 0x7fc560105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.230+0000 7fc56574a700 1 -- 172.21.15.96:0/3612951929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c005040 con 0x7fc5600f6860 2022-02-02T19:00:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc56574a700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fc55000b410 tx=0x7fc550006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5500125f0 con 0x7fc5600f6860 2022-02-02T19:00:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc560107580 con 0x7fc5600f6860 2022-02-02T19:00:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc550012c00 con 0x7fc5600f6860 2022-02-02T19:00:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc550002ae0 con 0x7fc5600f6860 2022-02-02T19:00:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.231+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc560107b40 con 0x7fc5600f6860 2022-02-02T19:00:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.232+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5600f49b0 con 0x7fc5600f6860 2022-02-02T19:00:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.233+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc550012d70 con 0x7fc5600f6860 2022-02-02T19:00:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.233+0000 7fc5567fc700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 0x7fc54c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.233+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc550082370 con 0x7fc5600f6860 2022-02-02T19:00:14.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.233+0000 7fc565f4b700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 0x7fc54c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:14.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.233+0000 7fc565f4b700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 0x7fc54c067290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc55c004e30 tx=0x7fc55c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:14.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.237+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc550053e50 con 0x7fc5600f6860 2022-02-02T19:00:14.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.468+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc560045ad0 con 0x7fc5600f6860 2022-02-02T19:00:14.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.469+0000 7fc5567fc700 1 -- 172.21.15.96:0/3612951929 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc550053a40 con 0x7fc5600f6860 2022-02-02T19:00:14.467 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:00:14.468 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:00:14.468 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:00:14.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:14.468 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:00:14.469 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:00:14.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:14.470 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:00:14.470 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:00:14.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:14.470 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:00:14.471 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:00:14.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:14.471 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:00:14.471 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:00:14.472 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:00:14.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:00:14.472 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:00:14.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.470+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 msgr2=0x7fc54c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.470+0000 7fc5681af700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 0x7fc54c067290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc55c004e30 tx=0x7fc55c009b30).stop 2022-02-02T19:00:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.470+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 msgr2=0x7fc5601063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.470+0000 7fc5681af700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fc55000b410 tx=0x7fc550006ef0).stop 2022-02-02T19:00:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 shutdown_connections 2022-02-02T19:00:14.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc54c064dd0 0x7fc54c067290 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5600f55c0 0x7fc560105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 --2- 172.21.15.96:0/3612951929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5600f6860 0x7fc5601063b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 >> 172.21.15.96:0/3612951929 conn(0x7fc5600f0d40 msgr2=0x7fc5600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:14.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 shutdown_connections 2022-02-02T19:00:14.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.471+0000 7fc5681af700 1 -- 172.21.15.96:0/3612951929 wait complete. 2022-02-02T19:00:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 -- 172.21.15.96:0/3778633070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 msgr2=0x7fb7d80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 --2- 172.21.15.96:0/3778633070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d80f7c30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fb7cc004660 tx=0x7fb7cc009b30).stop 2022-02-02T19:00:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 -- 172.21.15.96:0/3778633070 shutdown_connections 2022-02-02T19:00:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 --2- 172.21.15.96:0/3778633070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d80f7c30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 --2- 172.21.15.96:0/3778633070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7d80f6530 0x7fb7d80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:00:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 -- 172.21.15.96:0/3778633070 >> 172.21.15.96:0/3778633070 conn(0x7fb7d80f1cd0 msgr2=0x7fb7d80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:14.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 -- 172.21.15.96:0/3778633070 shutdown_connections 2022-02-02T19:00:14.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.568+0000 7fb7de114700 1 -- 172.21.15.96:0/3778633070 wait complete. 2022-02-02T19:00:14.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 Processor -- start 2022-02-02T19:00:14.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 -- start start 2022-02-02T19:00:14.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7d80f6530 0x7fb7d8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8107900 con 0x7fb7d80f77d0 2022-02-02T19:00:14.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7de114700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81080b0 con 0x7fb7d80f6530 2022-02-02T19:00:14.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7dc911700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:14.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7dc911700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57244/0 (socket says 172.21.15.96:57244) 2022-02-02T19:00:14.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.569+0000 7fb7dc911700 1 -- 172.21.15.96:0/2249148920 learned_addr learned my addr 172.21.15.96:0/2249148920 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:14.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7dc911700 1 -- 172.21.15.96:0/2249148920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7d80f6530 msgr2=0x7fb7d8106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7dc911700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7d80f6530 0x7fb7d8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:00:14.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7dc911700 1 -- 172.21.15.96:0/2249148920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc005040 con 0x7fb7d80f77d0 2022-02-02T19:00:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7dc911700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fb7cc009990 tx=0x7fb7cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7cc018070 con 0x7fb7d80f77d0 2022-02-02T19:00:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8108330 con 0x7fb7d80f77d0 2022-02-02T19:00:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb7cc007ca0 con 0x7fb7d80f77d0 2022-02-02T19:00:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7cc01c620 con 0x7fb7d80f77d0 2022-02-02T19:00:14.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.570+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8108890 con 0x7fb7d80f77d0 2022-02-02T19:00:14.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.571+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d8059100 con 0x7fb7d80f77d0 2022-02-02T19:00:14.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.572+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb7cc01d960 con 0x7fb7d80f77d0 2022-02-02T19:00:14.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.572+0000 7fb7c9ffb700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 0x7fb7c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:14.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.572+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb7cc083820 con 0x7fb7d80f77d0 2022-02-02T19:00:14.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.572+0000 7fb7dd112700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 0x7fb7c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:14.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.572+0000 7fb7dd112700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 0x7fb7c40672e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb7d8107b40 tx=0x7fb7d4006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:14.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.576+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb7cc051a40 con 0x7fb7d80f77d0 2022-02-02T19:00:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.780+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb7d80fee80 con 0x7fb7d80f77d0 2022-02-02T19:00:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.780+0000 7fb7c9ffb700 1 -- 172.21.15.96:0/2249148920 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb7cc055060 con 0x7fb7d80f77d0 2022-02-02T19:00:14.779 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:00:14.779 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:00:14.779 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:00:14.780 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:00:14.780 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:14.780 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:00:14.780 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:00:14.780 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:00:14.781 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:00:14.781 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:00:14.781 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:00:14.781 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:00:14.782 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:00:14.782 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:00:14.782 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:00:14.782 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:00:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:00:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:00:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:00:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:00:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:00:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:00:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:00:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:00:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:00:14.785 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:00:14.785 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:00:14.785 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:00:14.785 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:00:14.785 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:00:14.786 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:00:14.786 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:00:14.786 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:14.786 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:14.787 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:00:14.787 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:14.787 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:14.787 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:14.787 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:14.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 msgr2=0x7fb7c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 0x7fb7c40672e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb7d8107b40 tx=0x7fb7d4006ab0).stop 2022-02-02T19:00:14.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 msgr2=0x7fb7d8107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:14.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fb7cc009990 tx=0x7fb7cc009b30).stop 2022-02-02T19:00:14.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 shutdown_connections 2022-02-02T19:00:14.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb7c4064e20 0x7fb7c40672e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7d80f6530 0x7fb7d8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:00:14.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 --2- 172.21.15.96:0/2249148920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7d80f77d0 0x7fb7d8107270 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:14.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 >> 172.21.15.96:0/2249148920 conn(0x7fb7d80f1cd0 msgr2=0x7fb7d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 shutdown_connections 2022-02-02T19:00:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:14.782+0000 7fb7de114700 1 -- 172.21.15.96:0/2249148920 wait complete. 2022-02-02T19:00:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:00:15.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:14 smithi159 ceph-mon[69013]: pgmap v1143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3612951929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:00:15.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:14 smithi096 ceph-mon[101353]: pgmap v1143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:15.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3612951929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:00:16.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:15 smithi159 ceph-mon[69013]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:16.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:15 smithi159 ceph-mon[69013]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:16.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2249148920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:00:16.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:15 smithi096 ceph-mon[101353]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:16.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:15 smithi096 ceph-mon[101353]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:16.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2249148920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:00:17.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:16 smithi159 ceph-mon[69013]: pgmap v1144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:17.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:16 smithi096 ceph-mon[101353]: pgmap v1144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:19.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:18 smithi159 ceph-mon[69013]: pgmap v1145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:19.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:18 smithi096 ceph-mon[101353]: pgmap v1145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:21.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:20 smithi159 ceph-mon[69013]: pgmap v1146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:21.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:20 smithi096 ceph-mon[101353]: pgmap v1146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:23.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:22 smithi159 ceph-mon[69013]: pgmap v1147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:23.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:22 smithi096 ceph-mon[101353]: pgmap v1147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:25.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:24 smithi159 ceph-mon[69013]: pgmap v1148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:25.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:24 smithi096 ceph-mon[101353]: pgmap v1148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:26 smithi159 ceph-mon[69013]: pgmap v1149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:27.080 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:26 smithi096 ceph-mon[101353]: pgmap v1149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:28.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:00:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:00:28.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:00:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:00:29.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:28 smithi159 ceph-mon[69013]: pgmap v1150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:29.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:28 smithi096 ceph-mon[101353]: pgmap v1150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:30.770 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:30 smithi159 ceph-mon[69013]: pgmap v1151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:31.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:30 smithi096 ceph-mon[101353]: pgmap v1151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:33.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:32 smithi159 ceph-mon[69013]: pgmap v1152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:33.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:32 smithi096 ceph-mon[101353]: pgmap v1152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:35.020 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:34 smithi159 ceph-mon[69013]: pgmap v1153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:35.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:34 smithi096 ceph-mon[101353]: pgmap v1153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:37.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:36 smithi159 ceph-mon[69013]: pgmap v1154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:37.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:36 smithi096 ceph-mon[101353]: pgmap v1154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:39.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:38 smithi159 ceph-mon[69013]: pgmap v1155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:39.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:38 smithi096 ceph-mon[101353]: pgmap v1155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:41.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:40 smithi159 ceph-mon[69013]: pgmap v1156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:41.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:40 smithi096 ceph-mon[101353]: pgmap v1156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:43.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:42 smithi159 ceph-mon[69013]: pgmap v1157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:43.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:42 smithi096 ceph-mon[101353]: pgmap v1157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:44.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.892+0000 7fe164a1e700 1 -- 172.21.15.96:0/2375647261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f5430 msgr2=0x7fe1600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:44.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.892+0000 7fe164a1e700 1 --2- 172.21.15.96:0/2375647261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f5430 0x7fe1600f5850 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fe150004660 tx=0x7fe150009b30).stop 2022-02-02T19:00:44.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 -- 172.21.15.96:0/2375647261 shutdown_connections 2022-02-02T19:00:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 --2- 172.21.15.96:0/2375647261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f66d0 0x7fe1600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 --2- 172.21.15.96:0/2375647261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f5430 0x7fe1600f5850 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 -- 172.21.15.96:0/2375647261 >> 172.21.15.96:0/2375647261 conn(0x7fe1600f0b90 msgr2=0x7fe1600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 -- 172.21.15.96:0/2375647261 shutdown_connections 2022-02-02T19:00:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 -- 172.21.15.96:0/2375647261 wait complete. 2022-02-02T19:00:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 Processor -- start 2022-02-02T19:00:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.893+0000 7fe164a1e700 1 -- start start 2022-02-02T19:00:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe164a1e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f5430 0x7fe1600f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe164a1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe164a1e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600f7f70 con 0x7fe1600f66d0 2022-02-02T19:00:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe164a1e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600f80b0 con 0x7fe1600f5430 2022-02-02T19:00:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57264/0 (socket says 172.21.15.96:57264) 2022-02-02T19:00:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 -- 172.21.15.96:0/3346729900 learned_addr learned my addr 172.21.15.96:0/3346729900 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15f7fe700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f5430 0x7fe1600f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 -- 172.21.15.96:0/3346729900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f5430 msgr2=0x7fe1600f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f5430 0x7fe1600f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 -- 172.21.15.96:0/3346729900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150005040 con 0x7fe1600f66d0 2022-02-02T19:00:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe15effd700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fe15400c530 tx=0x7fe154007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe15400f650 con 0x7fe1600f66d0 2022-02-02T19:00:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1600f8390 con 0x7fe1600f66d0 2022-02-02T19:00:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.894+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe15400fc60 con 0x7fe1600f66d0 2022-02-02T19:00:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.895+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe154012c20 con 0x7fe1600f66d0 2022-02-02T19:00:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.895+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16010edd0 con 0x7fe1600f66d0 2022-02-02T19:00:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.896+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe160045ad0 con 0x7fe1600f66d0 2022-02-02T19:00:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.896+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe154010070 con 0x7fe1600f66d0 2022-02-02T19:00:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.896+0000 7fe147fff700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 0x7fe1480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.896+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe154081700 con 0x7fe1600f66d0 2022-02-02T19:00:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.896+0000 7fe15f7fe700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 0x7fe1480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.897+0000 7fe15f7fe700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 0x7fe1480672e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fe150013690 tx=0x7fe150009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:44.901+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe15404f7b0 con 0x7fe1600f66d0 2022-02-02T19:00:45.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:44 smithi159 ceph-mon[69013]: pgmap v1158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:45.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:44 smithi096 ceph-mon[101353]: pgmap v1158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:45.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.079+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1600fab10 con 0x7fe148064e20 2022-02-02T19:00:45.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.081+0000 7fe147fff700 1 -- 172.21.15.96:0/3346729900 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe1600fab10 con 0x7fe148064e20 2022-02-02T19:00:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 msgr2=0x7fe1480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 0x7fe1480672e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fe150013690 tx=0x7fe150009b30).stop 2022-02-02T19:00:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 msgr2=0x7fe1600f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fe15400c530 tx=0x7fe154007e20).stop 2022-02-02T19:00:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 shutdown_connections 2022-02-02T19:00:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe148064e20 0x7fe1480672e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1600f5430 0x7fe1600f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 --2- 172.21.15.96:0/3346729900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1600f66d0 0x7fe1600f7a10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.082+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 >> 172.21.15.96:0/3346729900 conn(0x7fe1600f0b90 msgr2=0x7fe16005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.083+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 shutdown_connections 2022-02-02T19:00:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.083+0000 7fe164a1e700 1 -- 172.21.15.96:0/3346729900 wait complete. 2022-02-02T19:00:45.090 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:00:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- 172.21.15.96:0/3110133265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 msgr2=0x7f387c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 --2- 172.21.15.96:0/3110133265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c0f7de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f386c004660 tx=0x7f386c009b30).stop 2022-02-02T19:00:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- 172.21.15.96:0/3110133265 shutdown_connections 2022-02-02T19:00:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 --2- 172.21.15.96:0/3110133265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c0f7de0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 --2- 172.21.15.96:0/3110133265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 0x7f387c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- 172.21.15.96:0/3110133265 >> 172.21.15.96:0/3110133265 conn(0x7f387c0f1e40 msgr2=0x7f387c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- 172.21.15.96:0/3110133265 shutdown_connections 2022-02-02T19:00:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- 172.21.15.96:0/3110133265 wait complete. 2022-02-02T19:00:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 Processor -- start 2022-02-02T19:00:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.180+0000 7f3880862700 1 -- start start 2022-02-02T19:00:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3880862700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 0x7f387c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3880862700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3880862700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c107a00 con 0x7f387c0f7980 2022-02-02T19:00:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3880862700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c107b40 con 0x7f387c0f66e0 2022-02-02T19:00:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57274/0 (socket says 172.21.15.96:57274) 2022-02-02T19:00:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 -- 172.21.15.96:0/1605017199 learned_addr learned my addr 172.21.15.96:0/1605017199 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f387a59c700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 0x7f387c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 -- 172.21.15.96:0/1605017199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 msgr2=0x7f387c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 0x7f387c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 -- 172.21.15.96:0/1605017199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c005040 con 0x7f387c0f7980 2022-02-02T19:00:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3879d9b700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f386c009990 tx=0x7f386c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386c018070 con 0x7f387c0f7980 2022-02-02T19:00:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f386c007ba0 con 0x7f387c0f7980 2022-02-02T19:00:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c108480 con 0x7f387c0f7980 2022-02-02T19:00:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.181+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386c01c3c0 con 0x7f387c0f7980 2022-02-02T19:00:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.182+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1089e0 con 0x7f387c0f7980 2022-02-02T19:00:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.182+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c045ad0 con 0x7f387c0f7980 2022-02-02T19:00:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.183+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f386c01d420 con 0x7f387c0f7980 2022-02-02T19:00:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.183+0000 7f386affd700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 0x7f38640672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.183+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f386c083870 con 0x7f387c0f7980 2022-02-02T19:00:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.183+0000 7f387a59c700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 0x7f38640672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.184+0000 7f387a59c700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 0x7f38640672d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f387c0f77e0 tx=0x7f387000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.187+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f386c055230 con 0x7f387c0f7980 2022-02-02T19:00:45.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.359+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f387c0fefb0 con 0x7f3864064e10 2022-02-02T19:00:45.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.368+0000 7f386affd700 1 -- 172.21.15.96:0/1605017199 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f387c0fefb0 con 0x7f3864064e10 2022-02-02T19:00:45.367 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:00:45.367 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (44m) 14m ago 45m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:00:45.368 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (36m) 14m ago 45m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:00:45.368 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (36m) 13m ago 44m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:00:45.368 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (43m) 14m ago 44m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:00:45.368 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (41m) 14m ago 41m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:00:45.369 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (36m) 14m ago 41m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:00:45.369 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (41m) 13m ago 41m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:00:45.369 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (37m) 13m ago 41m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:00:45.369 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (38m) 14m ago 46m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:00:45.370 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (37m) 13m ago 44m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:00:45.370 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (37m) 14m ago 46m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:00:45.370 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (37m) 13m ago 44m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:00:45.370 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (44m) 14m ago 44m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:00:45.371 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (44m) 13m ago 44m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:00:45.371 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (36m) 14m ago 44m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:00:45.371 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (35m) 14m ago 43m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:00:45.371 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (35m) 14m ago 43m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:00:45.371 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (34m) 13m ago 43m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:00:45.372 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (34m) 13m ago 42m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:00:45.372 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (33m) 13m ago 42m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:00:45.372 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (43m) 14m ago 44m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:00:45.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 msgr2=0x7f38640672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 0x7f38640672d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f387c0f77e0 tx=0x7f387000b040).stop 2022-02-02T19:00:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 msgr2=0x7f387c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f386c009990 tx=0x7f386c009b30).stop 2022-02-02T19:00:45.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 shutdown_connections 2022-02-02T19:00:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3864064e10 0x7f38640672d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f387c0f66e0 0x7f387c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 --2- 172.21.15.96:0/1605017199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f387c0f7980 0x7f387c107450 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 >> 172.21.15.96:0/1605017199 conn(0x7f387c0f1e40 msgr2=0x7f387c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 shutdown_connections 2022-02-02T19:00:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.370+0000 7f3880862700 1 -- 172.21.15.96:0/1605017199 wait complete. 2022-02-02T19:00:45.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 -- 172.21.15.96:0/3785762537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f6860 msgr2=0x7fee140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 --2- 172.21.15.96:0/3785762537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f6860 0x7fee140f6cc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fee04004660 tx=0x7fee04009b30).stop 2022-02-02T19:00:45.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 -- 172.21.15.96:0/3785762537 shutdown_connections 2022-02-02T19:00:45.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 --2- 172.21.15.96:0/3785762537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f6860 0x7fee140f6cc0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 --2- 172.21.15.96:0/3785762537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f55c0 0x7fee140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 -- 172.21.15.96:0/3785762537 >> 172.21.15.96:0/3785762537 conn(0x7fee140f0d20 msgr2=0x7fee140f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 -- 172.21.15.96:0/3785762537 shutdown_connections 2022-02-02T19:00:45.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.467+0000 7fee19056700 1 -- 172.21.15.96:0/3785762537 wait complete. 2022-02-02T19:00:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 Processor -- start 2022-02-02T19:00:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 -- start start 2022-02-02T19:00:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f6860 0x7fee1410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee14060540 con 0x7fee140f55c0 2022-02-02T19:00:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee19056700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee14060680 con 0x7fee140f6860 2022-02-02T19:00:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee12d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee12d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57282/0 (socket says 172.21.15.96:57282) 2022-02-02T19:00:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee12d9d700 1 -- 172.21.15.96:0/503658251 learned_addr learned my addr 172.21.15.96:0/503658251 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.468+0000 7fee1259c700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f6860 0x7fee1410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee12d9d700 1 -- 172.21.15.96:0/503658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f6860 msgr2=0x7fee1410c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee12d9d700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f6860 0x7fee1410c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee12d9d700 1 -- 172.21.15.96:0/503658251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04005040 con 0x7fee140f55c0 2022-02-02T19:00:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee12d9d700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fee0800e7c0 tx=0x7fee0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee080092e0 con 0x7fee140f55c0 2022-02-02T19:00:45.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1410c670 con 0x7fee140f55c0 2022-02-02T19:00:45.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1410cc30 con 0x7fee140f55c0 2022-02-02T19:00:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee0800f040 con 0x7fee140f55c0 2022-02-02T19:00:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.469+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee080147e0 con 0x7fee140f55c0 2022-02-02T19:00:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.470+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf4004fa0 con 0x7fee140f55c0 2022-02-02T19:00:45.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.470+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee0801b030 con 0x7fee140f55c0 2022-02-02T19:00:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.471+0000 7fedfb7fe700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 0x7fedfc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.471+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee08081950 con 0x7fee140f55c0 2022-02-02T19:00:45.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.471+0000 7fee1259c700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 0x7fedfc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.471+0000 7fee1259c700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 0x7fedfc067290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fee04005010 tx=0x7fee04016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.475+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee0804fa00 con 0x7fee140f55c0 2022-02-02T19:00:45.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.706+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedf4005e80 con 0x7fee140f55c0 2022-02-02T19:00:45.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.706+0000 7fedfb7fe700 1 -- 172.21.15.96:0/503658251 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fee08019070 con 0x7fee140f55c0 2022-02-02T19:00:45.705 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:00:45.705 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:00:45.705 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:00:45.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:45.706 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:00:45.706 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:00:45.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:45.707 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:00:45.707 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:00:45.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:45.707 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:00:45.707 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:00:45.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:00:45.708 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:00:45.708 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:00:45.708 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:00:45.709 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:00:45.709 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:00:45.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.708+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 msgr2=0x7fedfc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.708+0000 7fee19056700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 0x7fedfc067290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fee04005010 tx=0x7fee04016040).stop 2022-02-02T19:00:45.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.708+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 msgr2=0x7fee14109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.708+0000 7fee19056700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fee0800e7c0 tx=0x7fee0800b040).stop 2022-02-02T19:00:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 shutdown_connections 2022-02-02T19:00:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedfc064dd0 0x7fedfc067290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee140f55c0 0x7fee14109bc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 --2- 172.21.15.96:0/503658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee140f6860 0x7fee1410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 >> 172.21.15.96:0/503658251 conn(0x7fee140f0d20 msgr2=0x7fee140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 shutdown_connections 2022-02-02T19:00:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.709+0000 7fee19056700 1 -- 172.21.15.96:0/503658251 wait complete. 2022-02-02T19:00:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/583690445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f66e0 msgr2=0x7f9c440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/583690445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f66e0 0x7f9c440f6b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f9c34004660 tx=0x7f9c34009b30).stop 2022-02-02T19:00:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/583690445 shutdown_connections 2022-02-02T19:00:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/583690445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f7980 0x7f9c440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/583690445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f66e0 0x7f9c440f6b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/583690445 >> 172.21.15.96:0/583690445 conn(0x7f9c440f1e40 msgr2=0x7f9c440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/583690445 shutdown_connections 2022-02-02T19:00:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.807+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/583690445 wait complete. 2022-02-02T19:00:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 Processor -- start 2022-02-02T19:00:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 -- start start 2022-02-02T19:00:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 0x7f9c44106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44107a50 con 0x7f9c440f7980 2022-02-02T19:00:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c4a2c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44107b90 con 0x7f9c440f66e0 2022-02-02T19:00:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57300/0 (socket says 172.21.15.96:57300) 2022-02-02T19:00:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c437fe700 1 -- 172.21.15.96:0/2625847215 learned_addr learned my addr 172.21.15.96:0/2625847215 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:00:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c43fff700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 0x7f9c44106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c437fe700 1 -- 172.21.15.96:0/2625847215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 msgr2=0x7f9c44106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.808+0000 7f9c437fe700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 0x7f9c44106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c437fe700 1 -- 172.21.15.96:0/2625847215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c34005040 con 0x7f9c440f7980 2022-02-02T19:00:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c43fff700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 0x7f9c44106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:00:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c437fe700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f9c3800c530 tx=0x7f9c38007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3800f650 con 0x7f9c440f7980 2022-02-02T19:00:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44108530 con 0x7f9c440f7980 2022-02-02T19:00:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c3800fc60 con 0x7f9c440f7980 2022-02-02T19:00:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c38012cd0 con 0x7f9c440f7980 2022-02-02T19:00:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.809+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c44108af0 con 0x7f9c440f7980 2022-02-02T19:00:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.810+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c44045ad0 con 0x7f9c440f7980 2022-02-02T19:00:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.810+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c38010070 con 0x7f9c440f7980 2022-02-02T19:00:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.811+0000 7f9c40ff9700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 0x7f9c2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:00:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.811+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c38081800 con 0x7f9c440f7980 2022-02-02T19:00:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.811+0000 7f9c43fff700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 0x7f9c2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:00:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.811+0000 7f9c43fff700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 0x7f9c2c067290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f9c34009da0 tx=0x7f9c34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:00:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:45.815+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c380532e0 con 0x7f9c440f7980 2022-02-02T19:00:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.016+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c44108d10 con 0x7f9c440f7980 2022-02-02T19:00:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.017+0000 7f9c40ff9700 1 -- 172.21.15.96:0/2625847215 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9c38052ed0 con 0x7f9c440f7980 2022-02-02T19:00:46.016 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:00:46.016 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:00:46.016 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:00:46.016 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:00:46.017 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:46.017 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:00:46.017 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:00:46.017 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:00:46.017 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:00:46.018 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:00:46.018 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:00:46.018 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:00:46.018 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:00:46.019 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:00:46.019 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:00:46.019 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:00:46.019 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:00:46.019 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:00:46.020 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:00:46.020 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:00:46.020 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:00:46.020 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:00:46.020 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:00:46.021 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:00:46.021 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:00:46.021 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:00:46.021 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:00:46.022 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:00:46.022 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:00:46.022 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:00:46.022 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:00:46.022 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:00:46.023 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:46.023 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:46.023 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:00:46.023 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:00:46.024 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:46.024 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:46.024 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:00:46.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 msgr2=0x7f9c2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:46.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 0x7f9c2c067290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f9c34009da0 tx=0x7f9c34009b30).stop 2022-02-02T19:00:46.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 msgr2=0x7f9c441074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:00:46.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f9c3800c530 tx=0x7f9c38007e20).stop 2022-02-02T19:00:46.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 shutdown_connections 2022-02-02T19:00:46.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c2c064dd0 0x7f9c2c067290 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:46.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c440f66e0 0x7f9c44106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:46.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 --2- 172.21.15.96:0/2625847215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c440f7980 0x7f9c441074a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:00:46.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 >> 172.21.15.96:0/2625847215 conn(0x7f9c440f1e40 msgr2=0x7f9c440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:00:46.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 shutdown_connections 2022-02-02T19:00:46.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:00:46.019+0000 7f9c4a2c3700 1 -- 172.21.15.96:0/2625847215 wait complete. 2022-02-02T19:00:46.027 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:00:47.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:46 smithi159 ceph-mon[69013]: from='client.35308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:47.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:46 smithi159 ceph-mon[69013]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:47.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:46 smithi159 ceph-mon[69013]: pgmap v1159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:47.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/503658251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:00:47.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2625847215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:00:47.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:46 smithi096 ceph-mon[101353]: from='client.35308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:47.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:46 smithi096 ceph-mon[101353]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:00:47.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:46 smithi096 ceph-mon[101353]: pgmap v1159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:47.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/503658251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:00:47.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2625847215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:00:49.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:48 smithi159 ceph-mon[69013]: pgmap v1160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:49.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:48 smithi096 ceph-mon[101353]: pgmap v1160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:51.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:50 smithi159 ceph-mon[69013]: pgmap v1161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:51.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:50 smithi096 ceph-mon[101353]: pgmap v1161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:53.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:52 smithi159 ceph-mon[69013]: pgmap v1162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:53.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:52 smithi096 ceph-mon[101353]: pgmap v1162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:55.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:54 smithi159 ceph-mon[69013]: pgmap v1163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:55.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:54 smithi096 ceph-mon[101353]: pgmap v1163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:56 smithi159 ceph-mon[69013]: pgmap v1164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:57.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:56 smithi096 ceph-mon[101353]: pgmap v1164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:58.930 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:00:58 smithi096 ceph-mon[101353]: pgmap v1165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:00:59.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:00:58 smithi159 ceph-mon[69013]: pgmap v1165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:01.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:00 smithi159 ceph-mon[69013]: pgmap v1166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:00 smithi096 ceph-mon[101353]: pgmap v1166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:03.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:02 smithi159 ceph-mon[69013]: pgmap v1167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:03.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:02 smithi096 ceph-mon[101353]: pgmap v1167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:05.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:04 smithi159 ceph-mon[69013]: pgmap v1168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:05.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:04 smithi096 ceph-mon[101353]: pgmap v1168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:07.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:06 smithi159 ceph-mon[69013]: pgmap v1169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:07.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:06 smithi096 ceph-mon[101353]: pgmap v1169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:09.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:08 smithi159 ceph-mon[69013]: pgmap v1170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:09.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:08 smithi096 ceph-mon[101353]: pgmap v1170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:11.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:10 smithi159 ceph-mon[69013]: pgmap v1171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:11.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:10 smithi096 ceph-mon[101353]: pgmap v1171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:13.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:12 smithi159 ceph-mon[69013]: pgmap v1172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:13.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:12 smithi096 ceph-mon[101353]: pgmap v1172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:15.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:14 smithi159 ceph-mon[69013]: pgmap v1173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:15.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:14 smithi096 ceph-mon[101353]: pgmap v1173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3144788042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 msgr2=0x7fd2b40f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3144788042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f4860 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd29c004660 tx=0x7fd29c009b30).stop 2022-02-02T19:01:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3144788042 shutdown_connections 2022-02-02T19:01:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3144788042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f4860 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3144788042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 0x7fd2b40f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3144788042 >> 172.21.15.96:0/3144788042 conn(0x7fd2b40f04c0 msgr2=0x7fd2b40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3144788042 shutdown_connections 2022-02-02T19:01:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.131+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3144788042 wait complete. 2022-02-02T19:01:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 Processor -- start 2022-02-02T19:01:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 -- start start 2022-02-02T19:01:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 0x7fd2b40f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40f5ff0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2ba2b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40f6130 con 0x7fd2b40f7d40 2022-02-02T19:01:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57320/0 (socket says 172.21.15.96:57320) 2022-02-02T19:01:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 -- 172.21.15.96:0/3003984186 learned_addr learned my addr 172.21.15.96:0/3003984186 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 0x7fd2b40f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 -- 172.21.15.96:0/3003984186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 msgr2=0x7fd2b40f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 0x7fd2b40f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.132+0000 7fd2abfff700 1 -- 172.21.15.96:0/3003984186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c005040 con 0x7fd2b40f86e0 2022-02-02T19:01:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2abfff700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd29c000c00 tx=0x7fd29c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29c019070 con 0x7fd2b40f86e0 2022-02-02T19:01:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd29c007e70 con 0x7fd2b40f86e0 2022-02-02T19:01:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29c014ce0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b40f63b0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.133+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b40f68c0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.134+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4045ad0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.135+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd29c025070 con 0x7fd2b40f86e0 2022-02-02T19:01:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.135+0000 7fd2b17fa700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 0x7fd2a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.135+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd29c082a30 con 0x7fd2b40f86e0 2022-02-02T19:01:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.135+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 0x7fd2a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.135+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 0x7fd2a0067290 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fd2b40f73a0 tx=0x7fd2a400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.139+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd29c050ae0 con 0x7fd2b40f86e0 2022-02-02T19:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.317+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b40fefc0 con 0x7fd2a0064dd0 2022-02-02T19:01:16.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.318+0000 7fd2b17fa700 1 -- 172.21.15.96:0/3003984186 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd2b40fefc0 con 0x7fd2a0064dd0 2022-02-02T19:01:16.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 msgr2=0x7fd2a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 0x7fd2a0067290 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fd2b40f73a0 tx=0x7fd2a400b040).stop 2022-02-02T19:01:16.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 msgr2=0x7fd2b40f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd29c000c00 tx=0x7fd29c00b040).stop 2022-02-02T19:01:16.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 shutdown_connections 2022-02-02T19:01:16.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a0064dd0 0x7fd2a0067290 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f7d40 0x7fd2b40f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 --2- 172.21.15.96:0/3003984186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f86e0 0x7fd2b40f5a90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 >> 172.21.15.96:0/3003984186 conn(0x7fd2b40f04c0 msgr2=0x7fd2b40fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 shutdown_connections 2022-02-02T19:01:16.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.320+0000 7fd2ba2b8700 1 -- 172.21.15.96:0/3003984186 wait complete. 2022-02-02T19:01:16.327 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:01:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2568435765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0f9860 msgr2=0x7f8acc0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2568435765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0f9860 0x7f8acc0fbc70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8ab8004660 tx=0x7f8ab8009b30).stop 2022-02-02T19:01:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2568435765 shutdown_connections 2022-02-02T19:01:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2568435765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0f9860 0x7f8acc0fbc70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2568435765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0602d0 0x7f8acc0f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2568435765 >> 172.21.15.96:0/2568435765 conn(0x7f8acc0f0d40 msgr2=0x7f8acc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2568435765 shutdown_connections 2022-02-02T19:01:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2568435765 wait complete. 2022-02-02T19:01:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.418+0000 7f8ad2ff7700 1 Processor -- start 2022-02-02T19:01:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad2ff7700 1 -- start start 2022-02-02T19:01:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad2ff7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad2ff7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 0x7f8acc107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad2ff7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1079e0 con 0x7f8acc0602d0 2022-02-02T19:01:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad2ff7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc107b20 con 0x7f8acc0f9860 2022-02-02T19:01:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57328/0 (socket says 172.21.15.96:57328) 2022-02-02T19:01:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 -- 172.21.15.96:0/2612284393 learned_addr learned my addr 172.21.15.96:0/2612284393 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8acbfff700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 0x7f8acc107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 -- 172.21.15.96:0/2612284393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 msgr2=0x7f8acc107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 0x7f8acc107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8ad0d93700 1 -- 172.21.15.96:0/2612284393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8005040 con 0x7f8acc0602d0 2022-02-02T19:01:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.419+0000 7f8acbfff700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 0x7f8acc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:01:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ad0d93700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f8ac00026d0 tx=0x7f8ac0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac0009320 con 0x7f8acc0602d0 2022-02-02T19:01:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ac000f040 con 0x7f8acc0602d0 2022-02-02T19:01:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc1084c0 con 0x7f8acc0602d0 2022-02-02T19:01:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac00147e0 con 0x7f8acc0602d0 2022-02-02T19:01:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.420+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc108a80 con 0x7f8acc0602d0 2022-02-02T19:01:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.421+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc045ad0 con 0x7f8acc0602d0 2022-02-02T19:01:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.421+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ac0009480 con 0x7f8acc0602d0 2022-02-02T19:01:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.422+0000 7f8ac97fa700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 0x7f8abc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.422+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ac0082170 con 0x7f8acc0602d0 2022-02-02T19:01:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.422+0000 7f8acbfff700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 0x7f8abc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.422+0000 7f8acbfff700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 0x7f8abc067290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8ab8009da0 tx=0x7f8ab8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.426+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ac0053c50 con 0x7f8acc0602d0 2022-02-02T19:01:16.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.599+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8acc108d00 con 0x7f8abc064dd0 2022-02-02T19:01:16.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.608+0000 7f8ac97fa700 1 -- 172.21.15.96:0/2612284393 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8acc108d00 con 0x7f8abc064dd0 2022-02-02T19:01:16.606 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:01:16.606 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (44m) 15m ago 45m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:01:16.606 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (37m) 15m ago 45m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:01:16.607 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (37m) 13m ago 45m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:01:16.607 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (44m) 15m ago 45m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:01:16.607 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (41m) 15m ago 41m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:01:16.607 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (37m) 15m ago 41m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:01:16.608 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (41m) 13m ago 41m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:01:16.608 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (37m) 13m ago 41m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:01:16.608 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (38m) 15m ago 46m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:01:16.608 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (38m) 13m ago 45m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:01:16.608 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (37m) 15m ago 46m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:01:16.609 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (37m) 13m ago 45m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:01:16.609 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (45m) 15m ago 45m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:01:16.609 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (44m) 13m ago 44m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:01:16.609 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (36m) 15m ago 44m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:01:16.611 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (36m) 15m ago 44m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:01:16.611 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (35m) 15m ago 43m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:01:16.611 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (35m) 13m ago 43m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:01:16.612 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (34m) 13m ago 43m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:01:16.612 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (34m) 13m ago 43m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:01:16.612 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (44m) 15m ago 45m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:01:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 msgr2=0x7f8abc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 0x7f8abc067290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8ab8009da0 tx=0x7f8ab8009b30).stop 2022-02-02T19:01:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 msgr2=0x7f8acc106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f8ac00026d0 tx=0x7f8ac0009de0).stop 2022-02-02T19:01:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 shutdown_connections 2022-02-02T19:01:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8abc064dd0 0x7f8abc067290 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8acc0602d0 0x7f8acc106f40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 --2- 172.21.15.96:0/2612284393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8acc0f9860 0x7f8acc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 >> 172.21.15.96:0/2612284393 conn(0x7f8acc0f0d40 msgr2=0x7f8acc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 shutdown_connections 2022-02-02T19:01:16.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.610+0000 7f8ad2ff7700 1 -- 172.21.15.96:0/2612284393 wait complete. 2022-02-02T19:01:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 -- 172.21.15.96:0/373939067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 msgr2=0x7fd7100f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 --2- 172.21.15.96:0/373939067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd7100f7890 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd704004660 tx=0x7fd704009b30).stop 2022-02-02T19:01:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 -- 172.21.15.96:0/373939067 shutdown_connections 2022-02-02T19:01:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 --2- 172.21.15.96:0/373939067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd7100f7890 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 --2- 172.21.15.96:0/373939067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 0x7fd7100f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:01:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 -- 172.21.15.96:0/373939067 >> 172.21.15.96:0/373939067 conn(0x7fd7100f0290 msgr2=0x7fd7100f26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 -- 172.21.15.96:0/373939067 shutdown_connections 2022-02-02T19:01:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.712+0000 7fd70f59e700 1 -- 172.21.15.96:0/373939067 wait complete. 2022-02-02T19:01:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 Processor -- start 2022-02-02T19:01:16.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 -- start start 2022-02-02T19:01:16.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 0x7fd710106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710107900 con 0x7fd7100f5110 2022-02-02T19:01:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101080b0 con 0x7fd7100f4770 2022-02-02T19:01:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57338/0 (socket says 172.21.15.96:57338) 2022-02-02T19:01:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 -- 172.21.15.96:0/1863511770 learned_addr learned my addr 172.21.15.96:0/1863511770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70e59c700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 0x7fd710106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 -- 172.21.15.96:0/1863511770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 msgr2=0x7fd710106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 0x7fd710106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 -- 172.21.15.96:0/1863511770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd7100f5110 2022-02-02T19:01:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd70dd9b700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd704000c00 tx=0x7fd704009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.713+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd704018070 con 0x7fd7100f5110 2022-02-02T19:01:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.714+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd704007cf0 con 0x7fd7100f5110 2022-02-02T19:01:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.714+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710108330 con 0x7fd7100f5110 2022-02-02T19:01:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.714+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70401c3c0 con 0x7fd7100f5110 2022-02-02T19:01:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.714+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710108890 con 0x7fd7100f5110 2022-02-02T19:01:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.715+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710059100 con 0x7fd7100f5110 2022-02-02T19:01:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.715+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd70401c670 con 0x7fd7100f5110 2022-02-02T19:01:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.715+0000 7fd6feffd700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 0x7fd6f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.715+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd7040838f0 con 0x7fd7100f5110 2022-02-02T19:01:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.715+0000 7fd70e59c700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 0x7fd6f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.716+0000 7fd70e59c700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 0x7fd6f80672e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd710107b40 tx=0x7fd700008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.719+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd704051a60 con 0x7fd7100f5110 2022-02-02T19:01:16.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.949+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7100fedd0 con 0x7fd7100f5110 2022-02-02T19:01:16.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.949+0000 7fd6feffd700 1 -- 172.21.15.96:0/1863511770 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd704055080 con 0x7fd7100f5110 2022-02-02T19:01:16.948 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:01:16.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:01:16.949 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:01:16.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:16.950 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:01:16.950 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:01:16.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:16.951 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:01:16.951 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:01:16.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:16.952 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:01:16.952 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:01:16.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:16.952 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:01:16.952 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:01:16.953 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:01:16.953 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:01:16.953 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:01:16.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 msgr2=0x7fd6f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 0x7fd6f80672e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd710107b40 tx=0x7fd700008040).stop 2022-02-02T19:01:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 msgr2=0x7fd710107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd704000c00 tx=0x7fd704009b30).stop 2022-02-02T19:01:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 shutdown_connections 2022-02-02T19:01:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6f8064e20 0x7fd6f80672e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7100f4770 0x7fd710106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 --2- 172.21.15.96:0/1863511770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7100f5110 0x7fd710107270 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 >> 172.21.15.96:0/1863511770 conn(0x7fd7100f0290 msgr2=0x7fd7100fb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 shutdown_connections 2022-02-02T19:01:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:16.952+0000 7fd70f59e700 1 -- 172.21.15.96:0/1863511770 wait complete. 2022-02-02T19:01:17.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:16 smithi159 ceph-mon[69013]: pgmap v1174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 -- 172.21.15.96:0/596015076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f6530 msgr2=0x7f74980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 --2- 172.21.15.96:0/596015076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f6530 0x7f74980f6950 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f7488004660 tx=0x7f7488009b30).stop 2022-02-02T19:01:17.048 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:16 smithi096 ceph-mon[101353]: pgmap v1174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 -- 172.21.15.96:0/596015076 shutdown_connections 2022-02-02T19:01:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 --2- 172.21.15.96:0/596015076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f77d0 0x7f74980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 --2- 172.21.15.96:0/596015076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f6530 0x7f74980f6950 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 -- 172.21.15.96:0/596015076 >> 172.21.15.96:0/596015076 conn(0x7f74980f1c90 msgr2=0x7f74980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 -- 172.21.15.96:0/596015076 shutdown_connections 2022-02-02T19:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.049+0000 7f749e14f700 1 -- 172.21.15.96:0/596015076 wait complete. 2022-02-02T19:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 Processor -- start 2022-02-02T19:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 -- start start 2022-02-02T19:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f6530 0x7f749806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749806a380 con 0x7f74980f77d0 2022-02-02T19:01:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749e14f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749806a4c0 con 0x7f74980f6530 2022-02-02T19:01:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749c94c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749c94c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57350/0 (socket says 172.21.15.96:57350) 2022-02-02T19:01:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.050+0000 7f749c94c700 1 -- 172.21.15.96:0/2100290539 learned_addr learned my addr 172.21.15.96:0/2100290539 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749d14d700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f6530 0x7f749806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749c94c700 1 -- 172.21.15.96:0/2100290539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f6530 msgr2=0x7f749806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749c94c700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f6530 0x7f749806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749c94c700 1 -- 172.21.15.96:0/2100290539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488005040 con 0x7f74980f77d0 2022-02-02T19:01:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749c94c700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f74940026d0 tx=0x7f7494009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74940079c0 con 0x7f74980f77d0 2022-02-02T19:01:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749806a7a0 con 0x7f74980f77d0 2022-02-02T19:01:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f749400f040 con 0x7f74980f77d0 2022-02-02T19:01:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74940137c0 con 0x7f74980f77d0 2022-02-02T19:01:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.051+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749810ee00 con 0x7f74980f77d0 2022-02-02T19:01:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.052+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498045ad0 con 0x7f74980f77d0 2022-02-02T19:01:17.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.053+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f74940090d0 con 0x7f74980f77d0 2022-02-02T19:01:17.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.053+0000 7f748dffb700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 0x7f74840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:17.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.053+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7494081a90 con 0x7f74980f77d0 2022-02-02T19:01:17.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.053+0000 7f749d14d700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 0x7f74840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.054+0000 7f749d14d700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 0x7f74840672e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7488013690 tx=0x7f7488009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.058+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f749404fae0 con 0x7f74980f77d0 2022-02-02T19:01:17.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.260+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7498027a00 con 0x7f74980f77d0 2022-02-02T19:01:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.261+0000 7f748dffb700 1 -- 172.21.15.96:0/2100290539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7494053100 con 0x7f74980f77d0 2022-02-02T19:01:17.259 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:01:17.259 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:01:17.260 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:01:17.260 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:01:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:17.260 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:01:17.260 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:01:17.261 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:01:17.261 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:01:17.261 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:01:17.261 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:01:17.262 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:01:17.262 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:01:17.262 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:01:17.262 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:01:17.263 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:01:17.263 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:01:17.263 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:01:17.263 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:01:17.263 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:01:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:01:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:01:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:01:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:01:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:01:17.265 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:01:17.265 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:01:17.265 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:01:17.265 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:01:17.266 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:01:17.266 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:01:17.266 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:01:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:17.267 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:01:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:17.267 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:17.267 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:17.268 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:17.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.262+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 msgr2=0x7f74840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.262+0000 7f749e14f700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 0x7f74840672e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7488013690 tx=0x7f7488009b30).stop 2022-02-02T19:01:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.262+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 msgr2=0x7f7498069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.262+0000 7f749e14f700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f74940026d0 tx=0x7f7494009de0).stop 2022-02-02T19:01:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 shutdown_connections 2022-02-02T19:01:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7484064e20 0x7f74840672e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f6530 0x7f749806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 --2- 172.21.15.96:0/2100290539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f77d0 0x7f7498069e20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 >> 172.21.15.96:0/2100290539 conn(0x7f74980f1c90 msgr2=0x7f74980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 shutdown_connections 2022-02-02T19:01:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:17.263+0000 7f749e14f700 1 -- 172.21.15.96:0/2100290539 wait complete. 2022-02-02T19:01:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:01:18.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:17 smithi159 ceph-mon[69013]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:18.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:17 smithi159 ceph-mon[69013]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:18.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1863511770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:01:18.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2100290539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:01:18.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:17 smithi096 ceph-mon[101353]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:18.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:17 smithi096 ceph-mon[101353]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:18.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1863511770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:01:18.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2100290539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:01:19.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:18 smithi159 ceph-mon[69013]: pgmap v1175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:19.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:18 smithi096 ceph-mon[101353]: pgmap v1175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:21.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:20 smithi159 ceph-mon[69013]: pgmap v1176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:21.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:20 smithi096 ceph-mon[101353]: pgmap v1176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:23.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:22 smithi159 ceph-mon[69013]: pgmap v1177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:23.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:22 smithi096 ceph-mon[101353]: pgmap v1177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:25.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:24 smithi159 ceph-mon[69013]: pgmap v1178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:25.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:24 smithi096 ceph-mon[101353]: pgmap v1178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:27.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:26 smithi159 ceph-mon[69013]: pgmap v1179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:27.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:26 smithi096 ceph-mon[101353]: pgmap v1179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:01:28.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:01:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:01:28.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:01:29.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:28 smithi159 ceph-mon[69013]: pgmap v1180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:29.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:28 smithi096 ceph-mon[101353]: pgmap v1180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:31.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:30 smithi159 ceph-mon[69013]: pgmap v1181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:31.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:30 smithi096 ceph-mon[101353]: pgmap v1181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:33.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:32 smithi159 ceph-mon[69013]: pgmap v1182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:33.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:32 smithi096 ceph-mon[101353]: pgmap v1182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:35.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:34 smithi159 ceph-mon[69013]: pgmap v1183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:35.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:34 smithi096 ceph-mon[101353]: pgmap v1183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:37.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:36 smithi159 ceph-mon[69013]: pgmap v1184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:37.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:36 smithi096 ceph-mon[101353]: pgmap v1184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:39.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:38 smithi159 ceph-mon[69013]: pgmap v1185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:39.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:38 smithi096 ceph-mon[101353]: pgmap v1185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:41.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:40 smithi159 ceph-mon[69013]: pgmap v1186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:41.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:40 smithi096 ceph-mon[101353]: pgmap v1186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:43.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:42 smithi159 ceph-mon[69013]: pgmap v1187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:43.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:42 smithi096 ceph-mon[101353]: pgmap v1187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:45.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:44 smithi159 ceph-mon[69013]: pgmap v1188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:45.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:44 smithi096 ceph-mon[101353]: pgmap v1188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:47.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:46 smithi159 ceph-mon[69013]: pgmap v1189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:47.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:46 smithi096 ceph-mon[101353]: pgmap v1189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 -- 172.21.15.96:0/411305914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 msgr2=0x7f4ac40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/411305914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac40f59e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f4ab8004660 tx=0x7f4ab8009b30).stop 2022-02-02T19:01:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 -- 172.21.15.96:0/411305914 shutdown_connections 2022-02-02T19:01:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/411305914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/411305914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac40f59e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 -- 172.21.15.96:0/411305914 >> 172.21.15.96:0/411305914 conn(0x7f4ac40f0d40 msgr2=0x7f4ac40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 -- 172.21.15.96:0/411305914 shutdown_connections 2022-02-02T19:01:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.375+0000 7f4acc1b7700 1 -- 172.21.15.96:0/411305914 wait complete. 2022-02-02T19:01:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 Processor -- start 2022-02-02T19:01:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 -- start start 2022-02-02T19:01:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac4106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4106910 con 0x7f4ac40f55c0 2022-02-02T19:01:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.376+0000 7f4acc1b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4106a50 con 0x7f4ac40f6860 2022-02-02T19:01:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9752700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac4106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9752700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac4106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:33242/0 (socket says 172.21.15.96:33242) 2022-02-02T19:01:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9752700 1 -- 172.21.15.96:0/722550590 learned_addr learned my addr 172.21.15.96:0/722550590 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57368/0 (socket says 172.21.15.96:57368) 2022-02-02T19:01:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 -- 172.21.15.96:0/722550590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 msgr2=0x7f4ac4106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac4106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 -- 172.21.15.96:0/722550590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8005040 con 0x7f4ac40f55c0 2022-02-02T19:01:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ac9f53700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f4ab8000c00 tx=0x7f4ab8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab8018070 con 0x7f4ac40f55c0 2022-02-02T19:01:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ab8007ba0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4107390 con 0x7f4ac40f55c0 2022-02-02T19:01:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab80123c0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.377+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41078f0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.378+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4045ad0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.379+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ab801d420 con 0x7f4ac40f55c0 2022-02-02T19:01:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.379+0000 7f4ab67fc700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 0x7f4ab0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.379+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ab80837d0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.379+0000 7f4ac9752700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 0x7f4ab0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.380+0000 7f4ac9752700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 0x7f4ab0067290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f4ac00041d0 tx=0x7f4ac0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.384+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ab80552b0 con 0x7f4ac40f55c0 2022-02-02T19:01:47.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.562+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ac40fdec0 con 0x7f4ab0064dd0 2022-02-02T19:01:47.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.563+0000 7f4ab67fc700 1 -- 172.21.15.96:0/722550590 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4ac40fdec0 con 0x7f4ab0064dd0 2022-02-02T19:01:47.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 msgr2=0x7f4ab0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 0x7f4ab0067290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f4ac00041d0 tx=0x7f4ac0009040).stop 2022-02-02T19:01:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 msgr2=0x7f4ac4105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f4ab8000c00 tx=0x7f4ab8009b30).stop 2022-02-02T19:01:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 shutdown_connections 2022-02-02T19:01:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ab0064dd0 0x7f4ab0067290 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ac40f55c0 0x7f4ac4105e70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 --2- 172.21.15.96:0/722550590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ac40f6860 0x7f4ac4106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 >> 172.21.15.96:0/722550590 conn(0x7f4ac40f0d40 msgr2=0x7f4ac40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:47.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 shutdown_connections 2022-02-02T19:01:47.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.565+0000 7f4acc1b7700 1 -- 172.21.15.96:0/722550590 wait complete. 2022-02-02T19:01:47.573 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:01:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 -- 172.21.15.96:0/3352720976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f66e0 msgr2=0x7f720c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 --2- 172.21.15.96:0/3352720976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f66e0 0x7f720c0f6b00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f7208004660 tx=0x7f7208009b30).stop 2022-02-02T19:01:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 -- 172.21.15.96:0/3352720976 shutdown_connections 2022-02-02T19:01:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 --2- 172.21.15.96:0/3352720976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f7980 0x7f720c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 --2- 172.21.15.96:0/3352720976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f66e0 0x7f720c0f6b00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 -- 172.21.15.96:0/3352720976 >> 172.21.15.96:0/3352720976 conn(0x7f720c0f1e40 msgr2=0x7f720c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.663+0000 7f7213b8a700 1 -- 172.21.15.96:0/3352720976 shutdown_connections 2022-02-02T19:01:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.664+0000 7f7213b8a700 1 -- 172.21.15.96:0/3352720976 wait complete. 2022-02-02T19:01:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 Processor -- start 2022-02-02T19:01:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 -- start start 2022-02-02T19:01:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f66e0 0x7f720c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c107a00 con 0x7f720c0f7980 2022-02-02T19:01:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7213b8a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c107b40 con 0x7f720c0f66e0 2022-02-02T19:01:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57380/0 (socket says 172.21.15.96:57380) 2022-02-02T19:01:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 -- 172.21.15.96:0/2123577268 learned_addr learned my addr 172.21.15.96:0/2123577268 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211926700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f66e0 0x7f720c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 -- 172.21.15.96:0/2123577268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f66e0 msgr2=0x7f720c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f66e0 0x7f720c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 -- 172.21.15.96:0/2123577268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208005040 con 0x7f720c0f7980 2022-02-02T19:01:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.665+0000 7f7211125700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f71fc002700 tx=0x7f71fc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.666+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71fc009320 con 0x7f720c0f7980 2022-02-02T19:01:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.666+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c1084e0 con 0x7f720c0f7980 2022-02-02T19:01:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.666+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f720c0f7980 2022-02-02T19:01:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.666+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71fc014870 con 0x7f720c0f7980 2022-02-02T19:01:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.666+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c108aa0 con 0x7f720c0f7980 2022-02-02T19:01:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.667+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c045ad0 con 0x7f720c0f7980 2022-02-02T19:01:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.667+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71fc009480 con 0x7f720c0f7980 2022-02-02T19:01:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.667+0000 7f72027fc700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 0x7f71f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.667+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f71fc081d50 con 0x7f720c0f7980 2022-02-02T19:01:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.667+0000 7f7211926700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 0x7f71f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.668+0000 7f7211926700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 0x7f71f8067290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7208004630 tx=0x7f7208009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.671+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71fc053830 con 0x7f720c0f7980 2022-02-02T19:01:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.845+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f720c108d20 con 0x7f71f8064dd0 2022-02-02T19:01:47.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.854+0000 7f72027fc700 1 -- 172.21.15.96:0/2123577268 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f720c108d20 con 0x7f71f8064dd0 2022-02-02T19:01:47.852 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:01:47.852 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (45m) 15m ago 46m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:01:47.853 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (37m) 15m ago 46m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:01:47.853 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (37m) 14m ago 45m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:01:47.853 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (45m) 15m ago 46m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:01:47.853 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (42m) 15m ago 42m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:01:47.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (37m) 15m ago 42m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:01:47.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (42m) 14m ago 42m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:01:47.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (38m) 14m ago 42m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:01:47.854 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (39m) 15m ago 47m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (38m) 14m ago 45m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (38m) 15m ago 47m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (38m) 14m ago 45m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (45m) 15m ago 45m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (45m) 14m ago 45m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:01:47.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (37m) 15m ago 45m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:01:47.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (36m) 15m ago 44m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:01:47.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (36m) 15m ago 44m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:01:47.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (35m) 14m ago 44m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:01:47.857 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (35m) 14m ago 43m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:01:47.857 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (34m) 14m ago 43m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:01:47.857 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (44m) 15m ago 45m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:01:47.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 msgr2=0x7f71f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 0x7f71f8067290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7208004630 tx=0x7f7208009b30).stop 2022-02-02T19:01:47.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 msgr2=0x7f720c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f71fc002700 tx=0x7f71fc009e00).stop 2022-02-02T19:01:47.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 shutdown_connections 2022-02-02T19:01:47.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71f8064dd0 0x7f71f8067290 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f720c0f66e0 0x7f720c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 --2- 172.21.15.96:0/2123577268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f720c0f7980 0x7f720c107450 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 >> 172.21.15.96:0/2123577268 conn(0x7f720c0f1e40 msgr2=0x7f720c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:47.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 shutdown_connections 2022-02-02T19:01:47.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.856+0000 7f7213b8a700 1 -- 172.21.15.96:0/2123577268 wait complete. 2022-02-02T19:01:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 -- 172.21.15.96:0/1472866216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f55c0 msgr2=0x7f8ce80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 --2- 172.21.15.96:0/1472866216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f55c0 0x7f8ce80f59e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8cd8004660 tx=0x7f8cd8009b30).stop 2022-02-02T19:01:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 -- 172.21.15.96:0/1472866216 shutdown_connections 2022-02-02T19:01:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 --2- 172.21.15.96:0/1472866216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f6860 0x7f8ce80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:01:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 --2- 172.21.15.96:0/1472866216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f55c0 0x7f8ce80f59e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 -- 172.21.15.96:0/1472866216 >> 172.21.15.96:0/1472866216 conn(0x7f8ce80f0d40 msgr2=0x7f8ce80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 -- 172.21.15.96:0/1472866216 shutdown_connections 2022-02-02T19:01:47.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.953+0000 7f8cec935700 1 -- 172.21.15.96:0/1472866216 wait complete. 2022-02-02T19:01:47.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 Processor -- start 2022-02-02T19:01:47.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 -- start start 2022-02-02T19:01:47.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f55c0 0x7f8ce8106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8107ac0 con 0x7f8ce80f6860 2022-02-02T19:01:47.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8cec935700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8108370 con 0x7f8ce80f55c0 2022-02-02T19:01:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8ce5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8ce5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57390/0 (socket says 172.21.15.96:57390) 2022-02-02T19:01:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.954+0000 7f8ce5d9b700 1 -- 172.21.15.96:0/289494071 learned_addr learned my addr 172.21.15.96:0/289494071 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8ce659c700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f55c0 0x7f8ce8106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8ce5d9b700 1 -- 172.21.15.96:0/289494071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f55c0 msgr2=0x7f8ce8106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8ce5d9b700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f55c0 0x7f8ce8106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8ce5d9b700 1 -- 172.21.15.96:0/289494071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8005040 con 0x7f8ce80f6860 2022-02-02T19:01:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8ce5d9b700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f8cd000b410 tx=0x7f8cd0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cd00125f0 con 0x7f8ce80f6860 2022-02-02T19:01:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8cd0012c00 con 0x7f8ce80f6860 2022-02-02T19:01:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce8108650 con 0x7f8ce80f6860 2022-02-02T19:01:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cd0002ae0 con 0x7f8ce80f6860 2022-02-02T19:01:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.955+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce8108c10 con 0x7f8ce80f6860 2022-02-02T19:01:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.956+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80f49b0 con 0x7f8ce80f6860 2022-02-02T19:01:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.956+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8cd000f030 con 0x7f8ce80f6860 2022-02-02T19:01:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.957+0000 7f8cdeffd700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 0x7f8cd4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.957+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8cd0081f60 con 0x7f8ce80f6860 2022-02-02T19:01:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.957+0000 7f8ce659c700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 0x7f8cd4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:47.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.957+0000 7f8ce659c700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 0x7f8cd4067290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f8cd8004e30 tx=0x7f8cd8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:47.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:47.962+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8cd00b07d0 con 0x7f8ce80f6860 2022-02-02T19:01:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.193+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ce810d5b0 con 0x7f8ce80f6860 2022-02-02T19:01:48.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.194+0000 7f8cdeffd700 1 -- 172.21.15.96:0/289494071 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8cd0053a40 con 0x7f8ce80f6860 2022-02-02T19:01:48.192 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:01:48.192 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:01:48.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:01:48.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:48.193 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:01:48.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:01:48.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:48.194 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:01:48.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:01:48.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:48.194 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:01:48.195 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:01:48.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:01:48.195 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:01:48.195 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:01:48.195 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:01:48.196 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:01:48.196 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:01:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 msgr2=0x7f8cd4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 0x7f8cd4067290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f8cd8004e30 tx=0x7f8cd8009b30).stop 2022-02-02T19:01:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 msgr2=0x7f8ce8107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f8cd000b410 tx=0x7f8cd0006ef0).stop 2022-02-02T19:01:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 shutdown_connections 2022-02-02T19:01:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cd4064dd0 0x7f8cd4067290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce80f55c0 0x7f8ce8106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 --2- 172.21.15.96:0/289494071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ce80f6860 0x7f8ce8107480 secure :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0x7f8cd000b410 tx=0x7f8cd0006ef0).stop 2022-02-02T19:01:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 >> 172.21.15.96:0/289494071 conn(0x7f8ce80f0d40 msgr2=0x7f8ce805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 shutdown_connections 2022-02-02T19:01:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.195+0000 7f8cec935700 1 -- 172.21.15.96:0/289494071 wait complete. 2022-02-02T19:01:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 -- 172.21.15.96:0/1835196836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f6860 msgr2=0x7f25300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1835196836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f6860 0x7f25300f6cc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f2518004660 tx=0x7f2518009b30).stop 2022-02-02T19:01:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 -- 172.21.15.96:0/1835196836 shutdown_connections 2022-02-02T19:01:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1835196836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f6860 0x7f25300f6cc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:48.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1835196836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f55c0 0x7f25300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:01:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 -- 172.21.15.96:0/1835196836 >> 172.21.15.96:0/1835196836 conn(0x7f25300f0d40 msgr2=0x7f25300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.293+0000 7f2535ab9700 1 -- 172.21.15.96:0/1835196836 shutdown_connections 2022-02-02T19:01:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.294+0000 7f2535ab9700 1 -- 172.21.15.96:0/1835196836 wait complete. 2022-02-02T19:01:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.294+0000 7f2535ab9700 1 Processor -- start 2022-02-02T19:01:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.294+0000 7f2535ab9700 1 -- start start 2022-02-02T19:01:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2535ab9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:48.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2535ab9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6860 0x7f253010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2535ab9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300604b0 con 0x7f25300f55c0 2022-02-02T19:01:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2535ab9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300605f0 con 0x7f25300f6860 2022-02-02T19:01:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57398/0 (socket says 172.21.15.96:57398) 2022-02-02T19:01:48.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 -- 172.21.15.96:0/1070191868 learned_addr learned my addr 172.21.15.96:0/1070191868 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:01:48.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 -- 172.21.15.96:0/1070191868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6860 msgr2=0x7f253010c170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T19:01:48.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6860 0x7f253010c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:01:48.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 -- 172.21.15.96:0/1070191868 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518005040 con 0x7f25300f55c0 2022-02-02T19:01:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f252f7fe700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f25200093f0 tx=0x7f2520006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2520009ea0 con 0x7f25300f55c0 2022-02-02T19:01:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253010c7d0 con 0x7f25300f55c0 2022-02-02T19:01:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.295+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2520013af0 con 0x7f25300f55c0 2022-02-02T19:01:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.296+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252000db10 con 0x7f25300f55c0 2022-02-02T19:01:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.296+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253010cd90 con 0x7f25300f55c0 2022-02-02T19:01:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.297+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530045ad0 con 0x7f25300f55c0 2022-02-02T19:01:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.297+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f252001a060 con 0x7f25300f55c0 2022-02-02T19:01:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.297+0000 7f2527fff700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 0x7f251c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:01:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.297+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2520081af0 con 0x7f25300f55c0 2022-02-02T19:01:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.297+0000 7f252effd700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 0x7f251c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:01:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.298+0000 7f252effd700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 0x7f251c067290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2518004e30 tx=0x7f2518009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:01:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.302+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f252004fba0 con 0x7f25300f55c0 2022-02-02T19:01:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.501+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f25300fdf30 con 0x7f25300f55c0 2022-02-02T19:01:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.501+0000 7f2527fff700 1 -- 172.21.15.96:0/1070191868 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2520018020 con 0x7f25300f55c0 2022-02-02T19:01:48.500 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:01:48.500 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:01:48.500 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:01:48.500 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:01:48.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:48.501 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:01:48.501 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:01:48.501 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:01:48.501 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:01:48.502 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:01:48.502 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:01:48.502 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:01:48.502 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:01:48.502 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:01:48.503 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:01:48.503 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:01:48.503 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:01:48.503 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:01:48.503 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:01:48.504 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:01:48.504 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:01:48.504 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:01:48.504 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:01:48.505 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:01:48.505 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:01:48.505 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:01:48.505 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:01:48.505 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:01:48.506 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:01:48.506 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:01:48.506 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:01:48.506 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:01:48.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:48.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:48.507 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:01:48.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:01:48.507 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:48.508 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:48.508 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:01:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 msgr2=0x7f251c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 0x7f251c067290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2518004e30 tx=0x7f2518009b30).stop 2022-02-02T19:01:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 msgr2=0x7f2530109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:01:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f25200093f0 tx=0x7f2520006ec0).stop 2022-02-02T19:01:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 shutdown_connections 2022-02-02T19:01:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f251c064dd0 0x7f251c067290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f55c0 0x7f2530109c70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:01:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 --2- 172.21.15.96:0/1070191868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6860 0x7f253010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:01:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 >> 172.21.15.96:0/1070191868 conn(0x7f25300f0d40 msgr2=0x7f25300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:01:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 shutdown_connections 2022-02-02T19:01:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:01:48.503+0000 7f2535ab9700 1 -- 172.21.15.96:0/1070191868 wait complete. 2022-02-02T19:01:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:01:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:48 smithi159 ceph-mon[69013]: pgmap v1190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:48 smithi159 ceph-mon[69013]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:49.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/289494071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:01:49.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1070191868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:01:49.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:48 smithi096 ceph-mon[101353]: pgmap v1190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:49.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:48 smithi096 ceph-mon[101353]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:49.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/289494071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:01:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1070191868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:01:50.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:49 smithi159 ceph-mon[69013]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:50.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:49 smithi096 ceph-mon[101353]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:01:51.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:50 smithi159 ceph-mon[69013]: pgmap v1191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:51.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:50 smithi096 ceph-mon[101353]: pgmap v1191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:52.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:51 smithi159 ceph-mon[69013]: pgmap v1192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:52.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:51 smithi096 ceph-mon[101353]: pgmap v1192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:55.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:54 smithi159 ceph-mon[69013]: pgmap v1193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:55.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:54 smithi096 ceph-mon[101353]: pgmap v1193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:57.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:56 smithi159 ceph-mon[69013]: pgmap v1194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:57.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:56 smithi096 ceph-mon[101353]: pgmap v1194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:59.021 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:01:58 smithi159 ceph-mon[69013]: pgmap v1195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:01:59.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:01:58 smithi096 ceph-mon[101353]: pgmap v1195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:01.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:00 smithi159 ceph-mon[69013]: pgmap v1196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:00 smithi096 ceph-mon[101353]: pgmap v1196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:03.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:02 smithi159 ceph-mon[69013]: pgmap v1197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:03.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:02 smithi096 ceph-mon[101353]: pgmap v1197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:05.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:04 smithi159 ceph-mon[69013]: pgmap v1198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:05.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:04 smithi096 ceph-mon[101353]: pgmap v1198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:07.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:06 smithi159 ceph-mon[69013]: pgmap v1199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:07.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:06 smithi096 ceph-mon[101353]: pgmap v1199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:09.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:08 smithi159 ceph-mon[69013]: pgmap v1200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:09.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:08 smithi096 ceph-mon[101353]: pgmap v1200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:11.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:10 smithi159 ceph-mon[69013]: pgmap v1201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:11.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:10 smithi096 ceph-mon[101353]: pgmap v1201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:13.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:12 smithi159 ceph-mon[69013]: pgmap v1202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:13.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:12 smithi096 ceph-mon[101353]: pgmap v1202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:15.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:14 smithi159 ceph-mon[69013]: pgmap v1203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:15.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:14 smithi096 ceph-mon[101353]: pgmap v1203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:16 smithi159 ceph-mon[69013]: pgmap v1204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:16 smithi096 ceph-mon[101353]: pgmap v1204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 -- 172.21.15.96:0/3073886722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 msgr2=0x7f04d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 --2- 172.21.15.96:0/3073886722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d80f59e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f04c0004660 tx=0x7f04c0009b30).stop 2022-02-02T19:02:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 -- 172.21.15.96:0/3073886722 shutdown_connections 2022-02-02T19:02:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 --2- 172.21.15.96:0/3073886722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 0x7f04d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 --2- 172.21.15.96:0/3073886722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d80f59e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 -- 172.21.15.96:0/3073886722 >> 172.21.15.96:0/3073886722 conn(0x7f04d80f0d40 msgr2=0x7f04d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 -- 172.21.15.96:0/3073886722 shutdown_connections 2022-02-02T19:02:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.613+0000 7f04de353700 1 -- 172.21.15.96:0/3073886722 wait complete. 2022-02-02T19:02:18.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 Processor -- start 2022-02-02T19:02:18.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 -- start start 2022-02-02T19:02:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 0x7f04d810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d80603e0 con 0x7f04d80f55c0 2022-02-02T19:02:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04de353700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d8060520 con 0x7f04d80f6860 2022-02-02T19:02:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57418/0 (socket says 172.21.15.96:57418) 2022-02-02T19:02:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04d7fff700 1 -- 172.21.15.96:0/3079948117 learned_addr learned my addr 172.21.15.96:0/3079948117 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.614+0000 7f04d77fe700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 0x7f04d810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d7fff700 1 -- 172.21.15.96:0/3079948117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 msgr2=0x7f04d810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d7fff700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 0x7f04d810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d7fff700 1 -- 172.21.15.96:0/3079948117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0005040 con 0x7f04d80f55c0 2022-02-02T19:02:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d7fff700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f04c0004f60 tx=0x7f04c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c0018070 con 0x7f04d80f55c0 2022-02-02T19:02:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f04c0009770 con 0x7f04d80f55c0 2022-02-02T19:02:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d810c6c0 con 0x7f04d80f55c0 2022-02-02T19:02:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c001c3c0 con 0x7f04d80f55c0 2022-02-02T19:02:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.615+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d810cc20 con 0x7f04d80f55c0 2022-02-02T19:02:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.617+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d8045ad0 con 0x7f04d80f55c0 2022-02-02T19:02:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.617+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f04c001d420 con 0x7f04d80f55c0 2022-02-02T19:02:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.617+0000 7f04d4ff9700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 0x7f04c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.617+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f04c0083890 con 0x7f04d80f55c0 2022-02-02T19:02:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.617+0000 7f04d77fe700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 0x7f04c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.618+0000 7f04d77fe700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 0x7f04c4067290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f04c8007fd0 tx=0x7f04c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.622+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f04c0051a00 con 0x7f04d80f55c0 2022-02-02T19:02:18.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.803+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d80fde90 con 0x7f04c4064dd0 2022-02-02T19:02:18.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.804+0000 7f04d4ff9700 1 -- 172.21.15.96:0/3079948117 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f04d80fde90 con 0x7f04c4064dd0 2022-02-02T19:02:18.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 msgr2=0x7f04c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 0x7f04c4067290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f04c8007fd0 tx=0x7f04c8009040).stop 2022-02-02T19:02:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 msgr2=0x7f04d8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f04c0004f60 tx=0x7f04c0009b30).stop 2022-02-02T19:02:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 shutdown_connections 2022-02-02T19:02:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04c4064dd0 0x7f04c4067290 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04d80f55c0 0x7f04d8109c70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 --2- 172.21.15.96:0/3079948117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80f6860 0x7f04d810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 >> 172.21.15.96:0/3079948117 conn(0x7f04d80f0d40 msgr2=0x7f04d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 shutdown_connections 2022-02-02T19:02:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.806+0000 7f04de353700 1 -- 172.21.15.96:0/3079948117 wait complete. 2022-02-02T19:02:18.815 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:02:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 -- 172.21.15.96:0/959980536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f5ed0 msgr2=0x7ff3480f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/959980536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f6900 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7ff338004660 tx=0x7ff338009b30).stop 2022-02-02T19:02:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 -- 172.21.15.96:0/959980536 shutdown_connections 2022-02-02T19:02:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/959980536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f6900 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/959980536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f55c0 0x7ff3480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 -- 172.21.15.96:0/959980536 >> 172.21.15.96:0/959980536 conn(0x7ff3480f0dc0 msgr2=0x7ff3480f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:18.907 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:18 smithi096 ceph-mon[101353]: pgmap v1205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 -- 172.21.15.96:0/959980536 shutdown_connections 2022-02-02T19:02:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.906+0000 7ff34d4e2700 1 -- 172.21.15.96:0/959980536 wait complete. 2022-02-02T19:02:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 Processor -- start 2022-02-02T19:02:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 -- start start 2022-02-02T19:02:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480f81a0 con 0x7ff3480f55c0 2022-02-02T19:02:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff34d4e2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480f82e0 con 0x7ff3480f5ed0 2022-02-02T19:02:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57428/0 (socket says 172.21.15.96:57428) 2022-02-02T19:02:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 -- 172.21.15.96:0/1345970144 learned_addr learned my addr 172.21.15.96:0/1345970144 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff3467fc700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 -- 172.21.15.96:0/1345970144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f5ed0 msgr2=0x7ff3480f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 -- 172.21.15.96:0/1345970144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338005040 con 0x7ff3480f55c0 2022-02-02T19:02:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.907+0000 7ff346ffd700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff33c00c530 tx=0x7ff33c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.908+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c00f650 con 0x7ff3480f55c0 2022-02-02T19:02:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.908+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3480f85c0 con 0x7ff3480f55c0 2022-02-02T19:02:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.908+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff33c00fc60 con 0x7ff3480f55c0 2022-02-02T19:02:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.908+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c012cd0 con 0x7ff3480f55c0 2022-02-02T19:02:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.908+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34810ef70 con 0x7ff3480f55c0 2022-02-02T19:02:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.909+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff348045ad0 con 0x7ff3480f55c0 2022-02-02T19:02:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.909+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff33c010070 con 0x7ff3480f55c0 2022-02-02T19:02:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.909+0000 7ff32f7fe700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 0x7ff330067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:18.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.909+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff33c081800 con 0x7ff3480f55c0 2022-02-02T19:02:18.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.910+0000 7ff3467fc700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 0x7ff330067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:18.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.910+0000 7ff3467fc700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 0x7ff330067290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff338004e30 tx=0x7ff338009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:18.914+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff33c04f8b0 con 0x7ff3480f55c0 2022-02-02T19:02:19.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:18 smithi159 ceph-mon[69013]: pgmap v1205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:19.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.083+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3480fad40 con 0x7ff330064dd0 2022-02-02T19:02:19.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.093+0000 7ff32f7fe700 1 -- 172.21.15.96:0/1345970144 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff3480fad40 con 0x7ff330064dd0 2022-02-02T19:02:19.093 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:02:19.093 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (45m) 16m ago 46m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:02:19.093 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (38m) 16m ago 46m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:02:19.093 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (38m) 14m ago 46m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:02:19.094 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (45m) 16m ago 46m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:02:19.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (42m) 16m ago 42m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:02:19.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (38m) 16m ago 42m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:02:19.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (42m) 14m ago 42m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:02:19.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (38m) 14m ago 42m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:02:19.095 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (39m) 16m ago 47m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:02:19.095 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (39m) 14m ago 46m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:02:19.095 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (38m) 16m ago 47m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:02:19.096 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (38m) 14m ago 46m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:02:19.096 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (46m) 16m ago 46m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:02:19.096 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (46m) 14m ago 46m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:02:19.096 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (37m) 16m ago 45m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:02:19.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (37m) 16m ago 45m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:02:19.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (36m) 16m ago 44m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:02:19.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (36m) 14m ago 44m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:02:19.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (35m) 14m ago 44m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:02:19.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (35m) 14m ago 44m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:02:19.099 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (45m) 16m ago 46m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:02:19.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.094+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 msgr2=0x7ff330067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.094+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 0x7ff330067290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff338004e30 tx=0x7ff338009b30).stop 2022-02-02T19:02:19.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 msgr2=0x7ff3480f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff33c00c530 tx=0x7ff33c007e20).stop 2022-02-02T19:02:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 shutdown_connections 2022-02-02T19:02:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff330064dd0 0x7ff330067290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3480f55c0 0x7ff3480f97c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 --2- 172.21.15.96:0/1345970144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3480f5ed0 0x7ff3480f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 >> 172.21.15.96:0/1345970144 conn(0x7ff3480f0dc0 msgr2=0x7ff34805ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:19.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 shutdown_connections 2022-02-02T19:02:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.095+0000 7ff34d4e2700 1 -- 172.21.15.96:0/1345970144 wait complete. 2022-02-02T19:02:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 -- 172.21.15.96:0/3108984565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f5460 msgr2=0x7f13180f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 --2- 172.21.15.96:0/3108984565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f5460 0x7f13180f5880 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f1308004660 tx=0x7f1308009b30).stop 2022-02-02T19:02:19.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 -- 172.21.15.96:0/3108984565 shutdown_connections 2022-02-02T19:02:19.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 --2- 172.21.15.96:0/3108984565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f6700 0x7f13180f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 --2- 172.21.15.96:0/3108984565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f5460 0x7f13180f5880 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 -- 172.21.15.96:0/3108984565 >> 172.21.15.96:0/3108984565 conn(0x7f13180f0bc0 msgr2=0x7f13180f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 -- 172.21.15.96:0/3108984565 shutdown_connections 2022-02-02T19:02:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 -- 172.21.15.96:0/3108984565 wait complete. 2022-02-02T19:02:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.191+0000 7f131d7c3700 1 Processor -- start 2022-02-02T19:02:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f131d7c3700 1 -- start start 2022-02-02T19:02:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f131d7c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 0x7f1318109b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f131d7c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f131d7c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180603c0 con 0x7f13180f6700 2022-02-02T19:02:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f131d7c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318060500 con 0x7f13180f5460 2022-02-02T19:02:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57440/0 (socket says 172.21.15.96:57440) 2022-02-02T19:02:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 -- 172.21.15.96:0/1126252688 learned_addr learned my addr 172.21.15.96:0/1126252688 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f1316ffd700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 0x7f1318109b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 -- 172.21.15.96:0/1126252688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 msgr2=0x7f1318109b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 0x7f1318109b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f130e7fc700 1 -- 172.21.15.96:0/1126252688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308005040 con 0x7f13180f6700 2022-02-02T19:02:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.192+0000 7f1316ffd700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 0x7f1318109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:02:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f130e7fc700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f130000c510 tx=0x7f1300007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130000f650 con 0x7f13180f6700 2022-02-02T19:02:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131810c5f0 con 0x7f13180f6700 2022-02-02T19:02:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f130000fc60 con 0x7f13180f6700 2022-02-02T19:02:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1300012d00 con 0x7f13180f6700 2022-02-02T19:02:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.193+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131810cb80 con 0x7f13180f6700 2022-02-02T19:02:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.194+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0004fa0 con 0x7f13180f6700 2022-02-02T19:02:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.194+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1300010070 con 0x7f13180f6700 2022-02-02T19:02:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.195+0000 7f130ffff700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 0x7f12f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.195+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1300081750 con 0x7f13180f6700 2022-02-02T19:02:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.195+0000 7f1316ffd700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 0x7f12f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.195+0000 7f1316ffd700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 0x7f12f80672e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1308004e30 tx=0x7f1308009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.199+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f130004f7a0 con 0x7f13180f6700 2022-02-02T19:02:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.430+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f12f0005e80 con 0x7f13180f6700 2022-02-02T19:02:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.430+0000 7f130ffff700 1 -- 172.21.15.96:0/1126252688 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1300052dc0 con 0x7f13180f6700 2022-02-02T19:02:19.431 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:02:19.432 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:02:19.432 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:02:19.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:19.433 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:02:19.433 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:02:19.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:19.434 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:02:19.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:02:19.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:19.435 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:02:19.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:02:19.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:19.436 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:02:19.436 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:02:19.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:02:19.437 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:02:19.437 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:02:19.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 msgr2=0x7f12f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 0x7f12f80672e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1308004e30 tx=0x7f1308009b30).stop 2022-02-02T19:02:19.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 msgr2=0x7f131810c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f130000c510 tx=0x7f1300007e00).stop 2022-02-02T19:02:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 shutdown_connections 2022-02-02T19:02:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064e20 0x7f12f80672e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13180f5460 0x7f1318109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 --2- 172.21.15.96:0/1126252688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13180f6700 0x7f131810c040 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 >> 172.21.15.96:0/1126252688 conn(0x7f13180f0bc0 msgr2=0x7f13180fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 shutdown_connections 2022-02-02T19:02:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.432+0000 7f131d7c3700 1 -- 172.21.15.96:0/1126252688 wait complete. 2022-02-02T19:02:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 -- 172.21.15.96:0/3915911567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 msgr2=0x7f74980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 --2- 172.21.15.96:0/3915911567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f74980f7de0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f7488004660 tx=0x7f7488009b30).stop 2022-02-02T19:02:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 -- 172.21.15.96:0/3915911567 shutdown_connections 2022-02-02T19:02:19.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 --2- 172.21.15.96:0/3915911567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f74980f7de0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 --2- 172.21.15.96:0/3915911567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 0x7f74980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 -- 172.21.15.96:0/3915911567 >> 172.21.15.96:0/3915911567 conn(0x7f74980f1e40 msgr2=0x7f74980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:19.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 -- 172.21.15.96:0/3915911567 shutdown_connections 2022-02-02T19:02:19.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.530+0000 7f749cebf700 1 -- 172.21.15.96:0/3915911567 wait complete. 2022-02-02T19:02:19.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 Processor -- start 2022-02-02T19:02:19.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 -- start start 2022-02-02T19:02:19.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 0x7f7498106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498107a00 con 0x7f74980f7980 2022-02-02T19:02:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749cebf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498107b40 con 0x7f74980f66e0 2022-02-02T19:02:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57450/0 (socket says 172.21.15.96:57450) 2022-02-02T19:02:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 -- 172.21.15.96:0/436000561 learned_addr learned my addr 172.21.15.96:0/436000561 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f749659c700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 0x7f7498106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 -- 172.21.15.96:0/436000561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 msgr2=0x7f7498106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 0x7f7498106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 -- 172.21.15.96:0/436000561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488005040 con 0x7f74980f7980 2022-02-02T19:02:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.531+0000 7f7495d9b700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7488009990 tx=0x7f7488009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.532+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7488018070 con 0x7f74980f7980 2022-02-02T19:02:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.532+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7488007ba0 con 0x7f74980f7980 2022-02-02T19:02:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.532+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7498108480 con 0x7f74980f7980 2022-02-02T19:02:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.532+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748801c3c0 con 0x7f74980f7980 2022-02-02T19:02:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.532+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74981089e0 con 0x7f74980f7980 2022-02-02T19:02:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.533+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498045ad0 con 0x7f74980f7980 2022-02-02T19:02:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.533+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f748801d420 con 0x7f74980f7980 2022-02-02T19:02:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.533+0000 7f7486ffd700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 0x7f7480067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.534+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f74880836f0 con 0x7f74980f7980 2022-02-02T19:02:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.534+0000 7f749659c700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 0x7f7480067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.534+0000 7f749659c700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 0x7f7480067290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f74980f77e0 tx=0x7f748c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.538+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7488055290 con 0x7f74980f7980 2022-02-02T19:02:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.739+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74980fefa0 con 0x7f74980f7980 2022-02-02T19:02:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.739+0000 7f7486ffd700 1 -- 172.21.15.96:0/436000561 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7488054e80 con 0x7f74980f7980 2022-02-02T19:02:19.739 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:02:19.740 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:02:19.740 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:02:19.740 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:02:19.741 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:19.741 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:02:19.741 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:02:19.741 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:02:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:02:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:02:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:02:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:02:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:02:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:02:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:02:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:02:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:02:19.744 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:02:19.744 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:02:19.744 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:02:19.744 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:02:19.744 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:02:19.745 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:02:19.745 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:02:19.746 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:02:19.747 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:02:19.747 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:02:19.748 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:02:19.748 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:02:19.748 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:02:19.749 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:02:19.749 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:02:19.749 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:19.750 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:19.750 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:02:19.751 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:19.751 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:19.751 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:19.752 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 msgr2=0x7f7480067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 0x7f7480067290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f74980f77e0 tx=0x7f748c00b040).stop 2022-02-02T19:02:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 msgr2=0x7f7498107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7488009990 tx=0x7f7488009b30).stop 2022-02-02T19:02:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 shutdown_connections 2022-02-02T19:02:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7480064dd0 0x7f7480067290 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74980f66e0 0x7f7498106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 --2- 172.21.15.96:0/436000561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74980f7980 0x7f7498107450 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 >> 172.21.15.96:0/436000561 conn(0x7f74980f1e40 msgr2=0x7f74980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 shutdown_connections 2022-02-02T19:02:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:19.741+0000 7f749cebf700 1 -- 172.21.15.96:0/436000561 wait complete. 2022-02-02T19:02:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:02:19.803 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1126252688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:02:20.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1126252688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:02:21.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:20 smithi159 ceph-mon[69013]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:21.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:20 smithi159 ceph-mon[69013]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:21.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:20 smithi159 ceph-mon[69013]: pgmap v1206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/436000561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:02:21.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:20 smithi096 ceph-mon[101353]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:21.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:20 smithi096 ceph-mon[101353]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:21.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:20 smithi096 ceph-mon[101353]: pgmap v1206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/436000561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:02:23.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:22 smithi159 ceph-mon[69013]: pgmap v1207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:23.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:22 smithi096 ceph-mon[101353]: pgmap v1207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:25.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:24 smithi159 ceph-mon[69013]: pgmap v1208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:25.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:24 smithi096 ceph-mon[101353]: pgmap v1208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:27.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:26 smithi159 ceph-mon[69013]: pgmap v1209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:27.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:26 smithi096 ceph-mon[101353]: pgmap v1209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:28.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:02:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:02:28.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:02:28.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:02:29.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:28 smithi159 ceph-mon[69013]: pgmap v1210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:29.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:28 smithi096 ceph-mon[101353]: pgmap v1210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:31.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:30 smithi159 ceph-mon[69013]: pgmap v1211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:31.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:30 smithi096 ceph-mon[101353]: pgmap v1211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:33.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:32 smithi159 ceph-mon[69013]: pgmap v1212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:33.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:32 smithi096 ceph-mon[101353]: pgmap v1212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:35.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:34 smithi159 ceph-mon[69013]: pgmap v1213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:35.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:34 smithi096 ceph-mon[101353]: pgmap v1213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:37.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:36 smithi159 ceph-mon[69013]: pgmap v1214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:37.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:36 smithi096 ceph-mon[101353]: pgmap v1214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:38 smithi159 ceph-mon[69013]: pgmap v1215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:39.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:38 smithi096 ceph-mon[101353]: pgmap v1215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:41.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:40 smithi159 ceph-mon[69013]: pgmap v1216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:41.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:40 smithi096 ceph-mon[101353]: pgmap v1216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:42 smithi159 ceph-mon[69013]: pgmap v1217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:43.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:42 smithi096 ceph-mon[101353]: pgmap v1217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:45.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:44 smithi159 ceph-mon[69013]: pgmap v1218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:45.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:44 smithi096 ceph-mon[101353]: pgmap v1218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:47.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:46 smithi159 ceph-mon[69013]: pgmap v1219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:47.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:46 smithi096 ceph-mon[101353]: pgmap v1219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:49.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:48 smithi159 ceph-mon[69013]: pgmap v1220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:49.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:48 smithi096 ceph-mon[101353]: pgmap v1220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:49.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 -- 172.21.15.96:0/49771512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 msgr2=0x7fa7f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/49771512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f59e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa7e4004660 tx=0x7fa7e4009b30).stop 2022-02-02T19:02:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 -- 172.21.15.96:0/49771512 shutdown_connections 2022-02-02T19:02:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/49771512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:02:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/49771512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f59e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 -- 172.21.15.96:0/49771512 >> 172.21.15.96:0/49771512 conn(0x7fa7f00f0d40 msgr2=0x7fa7f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 -- 172.21.15.96:0/49771512 shutdown_connections 2022-02-02T19:02:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.853+0000 7fa7f6af8700 1 -- 172.21.15.96:0/49771512 wait complete. 2022-02-02T19:02:49.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 Processor -- start 2022-02-02T19:02:49.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 -- start start 2022-02-02T19:02:49.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00f8190 con 0x7fa7f00f55c0 2022-02-02T19:02:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f6af8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00f82d0 con 0x7fa7f00f6860 2022-02-02T19:02:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f4894700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:49.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f4894700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57466/0 (socket says 172.21.15.96:57466) 2022-02-02T19:02:49.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.854+0000 7fa7f4894700 1 -- 172.21.15.96:0/333206773 learned_addr learned my addr 172.21.15.96:0/333206773 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:49.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7effff700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:49.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f4894700 1 -- 172.21.15.96:0/333206773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 msgr2=0x7fa7f00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f4894700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f4894700 1 -- 172.21.15.96:0/333206773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4005040 con 0x7fa7f00f55c0 2022-02-02T19:02:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7effff700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:02:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f4894700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fa7e4004f60 tx=0x7fa7e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e4018070 con 0x7fa7f00f55c0 2022-02-02T19:02:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00f8550 con 0x7fa7f00f55c0 2022-02-02T19:02:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7e4007ba0 con 0x7fa7f00f55c0 2022-02-02T19:02:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e401c620 con 0x7fa7f00f55c0 2022-02-02T19:02:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.855+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f010efc0 con 0x7fa7f00f55c0 2022-02-02T19:02:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.856+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0045ad0 con 0x7fa7f00f55c0 2022-02-02T19:02:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.857+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa7e401c8e0 con 0x7fa7f00f55c0 2022-02-02T19:02:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.857+0000 7fa7ed7fa700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 0x7fa7e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.857+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa7e4083e60 con 0x7fa7f00f55c0 2022-02-02T19:02:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.858+0000 7fa7effff700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 0x7fa7e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:49.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.858+0000 7fa7effff700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 0x7fa7e0067290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fa7dc00a880 tx=0x7fa7dc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:49.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:49.861+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa7e40ac7d0 con 0x7fa7f00f55c0 2022-02-02T19:02:50.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.040+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f00faca0 con 0x7fa7e0064dd0 2022-02-02T19:02:50.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.041+0000 7fa7ed7fa700 1 -- 172.21.15.96:0/333206773 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa7f00faca0 con 0x7fa7e0064dd0 2022-02-02T19:02:50.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 msgr2=0x7fa7e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 0x7fa7e0067290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fa7dc00a880 tx=0x7fa7dc008040).stop 2022-02-02T19:02:50.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 msgr2=0x7fa7f00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fa7e4004f60 tx=0x7fa7e4009b30).stop 2022-02-02T19:02:50.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 shutdown_connections 2022-02-02T19:02:50.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7e0064dd0 0x7fa7e0067290 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f55c0 0x7fa7f00f9720 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 --2- 172.21.15.96:0/333206773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f6860 0x7fa7f00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 >> 172.21.15.96:0/333206773 conn(0x7fa7f00f0d40 msgr2=0x7fa7f005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 shutdown_connections 2022-02-02T19:02:50.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.043+0000 7fa7f6af8700 1 -- 172.21.15.96:0/333206773 wait complete. 2022-02-02T19:02:50.052 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:02:50.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 -- 172.21.15.96:0/3733158641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f49a0 msgr2=0x7fe9a80f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3733158641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f49a0 0x7fe9a80f4dc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe998004660 tx=0x7fe998009b30).stop 2022-02-02T19:02:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 -- 172.21.15.96:0/3733158641 shutdown_connections 2022-02-02T19:02:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3733158641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f5340 0x7fe9a80f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3733158641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f49a0 0x7fe9a80f4dc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 -- 172.21.15.96:0/3733158641 >> 172.21.15.96:0/3733158641 conn(0x7fe9a80f04c0 msgr2=0x7fe9a80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 -- 172.21.15.96:0/3733158641 shutdown_connections 2022-02-02T19:02:50.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.141+0000 7fe9ad941700 1 -- 172.21.15.96:0/3733158641 wait complete. 2022-02-02T19:02:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 Processor -- start 2022-02-02T19:02:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 -- start start 2022-02-02T19:02:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f49a0 0x7fe9a8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8107a50 con 0x7fe9a80f5340 2022-02-02T19:02:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9ad941700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8107b90 con 0x7fe9a80f49a0 2022-02-02T19:02:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9a67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9a67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57478/0 (socket says 172.21.15.96:57478) 2022-02-02T19:02:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9a67fc700 1 -- 172.21.15.96:0/3635979306 learned_addr learned my addr 172.21.15.96:0/3635979306 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.142+0000 7fe9a6ffd700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f49a0 0x7fe9a8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9a67fc700 1 -- 172.21.15.96:0/3635979306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f49a0 msgr2=0x7fe9a8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9a67fc700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f49a0 0x7fe9a8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9a67fc700 1 -- 172.21.15.96:0/3635979306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998005040 con 0x7fe9a80f5340 2022-02-02T19:02:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9a67fc700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe990002700 tx=0x7fe990009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9900079c0 con 0x7fe9a80f5340 2022-02-02T19:02:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe99000f040 con 0x7fe9a80f5340 2022-02-02T19:02:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8108530 con 0x7fe9a80f5340 2022-02-02T19:02:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe990014740 con 0x7fe9a80f5340 2022-02-02T19:02:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.143+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8108af0 con 0x7fe9a80f5340 2022-02-02T19:02:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.144+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a8045ad0 con 0x7fe9a80f5340 2022-02-02T19:02:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.144+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe99001b060 con 0x7fe9a80f5340 2022-02-02T19:02:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.145+0000 7fe99f7fe700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 0x7fe994067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.145+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe9900819b0 con 0x7fe9a80f5340 2022-02-02T19:02:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.145+0000 7fe9a6ffd700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 0x7fe994067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.145+0000 7fe9a6ffd700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 0x7fe994067290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fe998004630 tx=0x7fe998009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.149+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe990053570 con 0x7fe9a80f5340 2022-02-02T19:02:50.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.320+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a8108d70 con 0x7fe994064dd0 2022-02-02T19:02:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.330+0000 7fe99f7fe700 1 -- 172.21.15.96:0/3635979306 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe9a8108d70 con 0x7fe994064dd0 2022-02-02T19:02:50.329 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:02:50.330 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (46m) 16m ago 47m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:02:50.330 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (38m) 16m ago 47m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:02:50.330 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (38m) 15m ago 46m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:02:50.331 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (46m) 16m ago 47m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:02:50.331 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (43m) 16m ago 43m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:02:50.331 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (38m) 16m ago 43m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:02:50.332 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (43m) 15m ago 43m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:02:50.332 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (39m) 15m ago 43m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:02:50.333 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (40m) 16m ago 48m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:02:50.333 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (39m) 15m ago 46m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:02:50.333 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (39m) 16m ago 48m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:02:50.334 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (39m) 15m ago 46m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:02:50.334 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (47m) 16m ago 47m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:02:50.335 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (46m) 15m ago 46m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:02:50.335 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (38m) 16m ago 46m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:02:50.335 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (37m) 16m ago 45m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:02:50.336 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (37m) 16m ago 45m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:02:50.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (36m) 15m ago 45m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:02:50.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (36m) 15m ago 44m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:02:50.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (35m) 15m ago 44m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:02:50.338 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (45m) 16m ago 46m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:02:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 msgr2=0x7fe994067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 0x7fe994067290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fe998004630 tx=0x7fe998009b30).stop 2022-02-02T19:02:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 msgr2=0x7fe9a81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe990002700 tx=0x7fe990009d60).stop 2022-02-02T19:02:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 shutdown_connections 2022-02-02T19:02:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe994064dd0 0x7fe994067290 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a80f49a0 0x7fe9a8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 --2- 172.21.15.96:0/3635979306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a80f5340 0x7fe9a81074a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.331+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 >> 172.21.15.96:0/3635979306 conn(0x7fe9a80f04c0 msgr2=0x7fe9a80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.332+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 shutdown_connections 2022-02-02T19:02:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.332+0000 7fe9ad941700 1 -- 172.21.15.96:0/3635979306 wait complete. 2022-02-02T19:02:50.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 -- 172.21.15.96:0/2346116993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 msgr2=0x7f3eb80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 --2- 172.21.15.96:0/2346116993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb80f59e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f3ea8004660 tx=0x7f3ea8009b30).stop 2022-02-02T19:02:50.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 -- 172.21.15.96:0/2346116993 shutdown_connections 2022-02-02T19:02:50.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 --2- 172.21.15.96:0/2346116993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 0x7f3eb80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 --2- 172.21.15.96:0/2346116993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb80f59e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 -- 172.21.15.96:0/2346116993 >> 172.21.15.96:0/2346116993 conn(0x7f3eb80f0d40 msgr2=0x7f3eb80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 -- 172.21.15.96:0/2346116993 shutdown_connections 2022-02-02T19:02:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.429+0000 7f3ebc940700 1 -- 172.21.15.96:0/2346116993 wait complete. 2022-02-02T19:02:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 Processor -- start 2022-02-02T19:02:50.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 -- start start 2022-02-02T19:02:50.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 0x7f3eb810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80603e0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3ebc940700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8060520 con 0x7f3eb80f6860 2022-02-02T19:02:50.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57486/0 (socket says 172.21.15.96:57486) 2022-02-02T19:02:50.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb659c700 1 -- 172.21.15.96:0/196170425 learned_addr learned my addr 172.21.15.96:0/196170425 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:50.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb5d9b700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 0x7f3eb810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb659c700 1 -- 172.21.15.96:0/196170425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 msgr2=0x7f3eb810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.430+0000 7f3eb659c700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 0x7f3eb810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3eb659c700 1 -- 172.21.15.96:0/196170425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8005040 con 0x7f3eb80f55c0 2022-02-02T19:02:50.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3eb659c700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f3ea8013a70 tx=0x7f3ea8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea8018070 con 0x7f3eb80f55c0 2022-02-02T19:02:50.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ea80097d0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb810c6c0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea801de80 con 0x7f3eb80f55c0 2022-02-02T19:02:50.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.431+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb810cc20 con 0x7f3eb80f55c0 2022-02-02T19:02:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.432+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb8045ad0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.432+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ea8007ba0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.433+0000 7f3eaeffd700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 0x7f3ea4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.433+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3ea80836a0 con 0x7f3eb80f55c0 2022-02-02T19:02:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.433+0000 7f3eb5d9b700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 0x7f3ea4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.433+0000 7f3eb5d9b700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 0x7f3ea4067290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3ea0004c40 tx=0x7f3ea000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.437+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ea8051750 con 0x7f3eb80f55c0 2022-02-02T19:02:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.668+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3eb80fdd80 con 0x7f3eb80f55c0 2022-02-02T19:02:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.668+0000 7f3eaeffd700 1 -- 172.21.15.96:0/196170425 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3ea8054d70 con 0x7f3eb80f55c0 2022-02-02T19:02:50.668 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:02:50.668 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:02:50.668 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:02:50.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:50.669 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:02:50.669 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:02:50.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:50.670 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:02:50.670 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:02:50.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:50.670 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:02:50.671 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:02:50.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:02:50.671 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:02:50.671 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:02:50.672 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:02:50.672 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:02:50.672 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:02:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 msgr2=0x7f3ea4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 0x7f3ea4067290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3ea0004c40 tx=0x7f3ea000b040).stop 2022-02-02T19:02:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 msgr2=0x7f3eb8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f3ea8013a70 tx=0x7f3ea8009b30).stop 2022-02-02T19:02:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 shutdown_connections 2022-02-02T19:02:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ea4064dd0 0x7f3ea4067290 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb80f55c0 0x7f3eb8109c70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 --2- 172.21.15.96:0/196170425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb80f6860 0x7f3eb810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 >> 172.21.15.96:0/196170425 conn(0x7f3eb80f0d40 msgr2=0x7f3eb80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 shutdown_connections 2022-02-02T19:02:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.670+0000 7f3ebc940700 1 -- 172.21.15.96:0/196170425 wait complete. 2022-02-02T19:02:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 -- 172.21.15.96:0/3300376109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f55c0 msgr2=0x7feef80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 --2- 172.21.15.96:0/3300376109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f55c0 0x7feef80f59e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7feee8004660 tx=0x7feee8009b30).stop 2022-02-02T19:02:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 -- 172.21.15.96:0/3300376109 shutdown_connections 2022-02-02T19:02:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 --2- 172.21.15.96:0/3300376109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f6860 0x7feef80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 --2- 172.21.15.96:0/3300376109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f55c0 0x7feef80f59e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 -- 172.21.15.96:0/3300376109 >> 172.21.15.96:0/3300376109 conn(0x7feef80f0d40 msgr2=0x7feef80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 -- 172.21.15.96:0/3300376109 shutdown_connections 2022-02-02T19:02:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.769+0000 7feeff35e700 1 -- 172.21.15.96:0/3300376109 wait complete. 2022-02-02T19:02:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 Processor -- start 2022-02-02T19:02:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 -- start start 2022-02-02T19:02:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f55c0 0x7feef8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8107a10 con 0x7feef80f6860 2022-02-02T19:02:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feeff35e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8107b50 con 0x7feef80f55c0 2022-02-02T19:02:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57498/0 (socket says 172.21.15.96:57498) 2022-02-02T19:02:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 -- 172.21.15.96:0/1871865438 learned_addr learned my addr 172.21.15.96:0/1871865438 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:02:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefd0fa700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f55c0 0x7feef8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 -- 172.21.15.96:0/1871865438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f55c0 msgr2=0x7feef8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f55c0 0x7feef8106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.770+0000 7feefc8f9700 1 -- 172.21.15.96:0/1871865438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8005040 con 0x7feef80f6860 2022-02-02T19:02:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feefc8f9700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7feef400c530 tx=0x7feef4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef400f650 con 0x7feef80f6860 2022-02-02T19:02:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feef400fc60 con 0x7feef80f6860 2022-02-02T19:02:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef81084f0 con 0x7feef80f6860 2022-02-02T19:02:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef4012cd0 con 0x7feef80f6860 2022-02-02T19:02:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.771+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8108ab0 con 0x7feef80f6860 2022-02-02T19:02:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.772+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feef4010070 con 0x7feef80f6860 2022-02-02T19:02:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.772+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8045ad0 con 0x7feef80f6860 2022-02-02T19:02:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.773+0000 7feeedffb700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 0x7feee4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:02:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.773+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feef4081720 con 0x7feef80f6860 2022-02-02T19:02:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.773+0000 7feefd0fa700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 0x7feee4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:02:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.773+0000 7feefd0fa700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 0x7feee4067270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7feee8013690 tx=0x7feee8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:02:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.777+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feef40477d0 con 0x7feef80f6860 2022-02-02T19:02:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.979+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feef8109140 con 0x7feef80f6860 2022-02-02T19:02:50.978 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:50 smithi096 ceph-mon[101353]: pgmap v1221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:50.978 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/196170425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:02:50.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.979+0000 7feeedffb700 1 -- 172.21.15.96:0/1871865438 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7feef4053200 con 0x7feef80f6860 2022-02-02T19:02:50.979 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:02:50.980 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:02:50.980 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:02:50.980 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:02:50.980 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:50.981 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:02:50.981 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:02:50.981 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:02:50.982 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:02:50.982 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:02:50.982 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:02:50.982 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:02:50.982 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:02:50.983 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:02:50.983 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:02:50.983 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:02:50.983 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:02:50.983 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:02:50.984 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:02:50.984 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:02:50.984 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:02:50.984 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:02:50.985 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:02:50.985 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:02:50.985 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:02:50.985 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:02:50.985 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:02:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:02:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:02:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:02:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:02:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:02:50.987 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:50.987 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:50.987 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:02:50.987 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:02:50.988 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:50.988 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:50.988 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:02:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 msgr2=0x7feee4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 0x7feee4067270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7feee8013690 tx=0x7feee8009b30).stop 2022-02-02T19:02:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 msgr2=0x7feef8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:02:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7feef400c530 tx=0x7feef4007e20).stop 2022-02-02T19:02:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 shutdown_connections 2022-02-02T19:02:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee4064db0 0x7feee4067270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f55c0 0x7feef8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 --2- 172.21.15.96:0/1871865438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f6860 0x7feef8107460 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:02:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 >> 172.21.15.96:0/1871865438 conn(0x7feef80f0d40 msgr2=0x7feef805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:02:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 shutdown_connections 2022-02-02T19:02:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:02:50.981+0000 7feeff35e700 1 -- 172.21.15.96:0/1871865438 wait complete. 2022-02-02T19:02:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:02:51.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:50 smithi159 ceph-mon[69013]: pgmap v1221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:51.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/196170425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:02:52.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:51 smithi159 ceph-mon[69013]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:52.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:51 smithi159 ceph-mon[69013]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:52.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1871865438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:02:52.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:51 smithi096 ceph-mon[101353]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:52.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:51 smithi096 ceph-mon[101353]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:02:52.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1871865438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:02:53.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:52 smithi159 ceph-mon[69013]: pgmap v1222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:53.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:52 smithi096 ceph-mon[101353]: pgmap v1222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:55.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:54 smithi159 ceph-mon[69013]: pgmap v1223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:55.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:54 smithi096 ceph-mon[101353]: pgmap v1223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:57.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:56 smithi159 ceph-mon[69013]: pgmap v1224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:57.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:56 smithi096 ceph-mon[101353]: pgmap v1224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:59.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:02:58 smithi159 ceph-mon[69013]: pgmap v1225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:02:59.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:02:58 smithi096 ceph-mon[101353]: pgmap v1225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:01.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:00 smithi159 ceph-mon[69013]: pgmap v1226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:01.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:00 smithi096 ceph-mon[101353]: pgmap v1226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:03.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:02 smithi159 ceph-mon[69013]: pgmap v1227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:03.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:02 smithi096 ceph-mon[101353]: pgmap v1227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:05.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:04 smithi159 ceph-mon[69013]: pgmap v1228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:05.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:04 smithi096 ceph-mon[101353]: pgmap v1228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:07.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:06 smithi159 ceph-mon[69013]: pgmap v1229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:07.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:06 smithi096 ceph-mon[101353]: pgmap v1229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:08 smithi159 ceph-mon[69013]: pgmap v1230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:09.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:08 smithi096 ceph-mon[101353]: pgmap v1230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:11.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:10 smithi159 ceph-mon[69013]: pgmap v1231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:11.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:10 smithi096 ceph-mon[101353]: pgmap v1231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:13.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:12 smithi159 ceph-mon[69013]: pgmap v1232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:13.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:12 smithi096 ceph-mon[101353]: pgmap v1232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:15.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:14 smithi159 ceph-mon[69013]: pgmap v1233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:15.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:14 smithi096 ceph-mon[101353]: pgmap v1233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:17.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:16 smithi159 ceph-mon[69013]: pgmap v1234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:17.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:16 smithi096 ceph-mon[101353]: pgmap v1234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:19.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:18 smithi159 ceph-mon[69013]: pgmap v1235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:19.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:18 smithi096 ceph-mon[101353]: pgmap v1235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:20 smithi159 ceph-mon[69013]: pgmap v1236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:21.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:20 smithi096 ceph-mon[101353]: pgmap v1236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:21.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- 172.21.15.96:0/1268201812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 msgr2=0x7ff5140f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 --2- 172.21.15.96:0/1268201812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff5140f4fe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7ff510004660 tx=0x7ff510009b30).stop 2022-02-02T19:03:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- 172.21.15.96:0/1268201812 shutdown_connections 2022-02-02T19:03:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 --2- 172.21.15.96:0/1268201812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 0x7ff5140f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:03:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 --2- 172.21.15.96:0/1268201812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff5140f4fe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- 172.21.15.96:0/1268201812 >> 172.21.15.96:0/1268201812 conn(0x7ff5140f0320 msgr2=0x7ff5140f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- 172.21.15.96:0/1268201812 shutdown_connections 2022-02-02T19:03:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- 172.21.15.96:0/1268201812 wait complete. 2022-02-02T19:03:21.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 Processor -- start 2022-02-02T19:03:21.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.092+0000 7ff51ae26700 1 -- start start 2022-02-02T19:03:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 0x7ff51410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140fbef0 con 0x7ff5140f4bc0 2022-02-02T19:03:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140fc030 con 0x7ff5140f5e60 2022-02-02T19:03:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57516/0 (socket says 172.21.15.96:57516) 2022-02-02T19:03:21.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 -- 172.21.15.96:0/19283623 learned_addr learned my addr 172.21.15.96:0/19283623 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:21.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519623700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 0x7ff51410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 -- 172.21.15.96:0/19283623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 msgr2=0x7ff51410bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 0x7ff51410bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 -- 172.21.15.96:0/19283623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510005040 con 0x7ff5140f4bc0 2022-02-02T19:03:21.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff519e24700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7ff510004f60 tx=0x7ff510009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff510018070 con 0x7ff5140f4bc0 2022-02-02T19:03:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51410c580 con 0x7ff5140f4bc0 2022-02-02T19:03:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff510007ba0 con 0x7ff5140f4bc0 2022-02-02T19:03:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51001c620 con 0x7ff5140f4bc0 2022-02-02T19:03:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.093+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51410cab0 con 0x7ff5140f4bc0 2022-02-02T19:03:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.095+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514059100 con 0x7ff5140f4bc0 2022-02-02T19:03:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.095+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff51001c8e0 con 0x7ff5140f4bc0 2022-02-02T19:03:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.095+0000 7ff50a7fc700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 0x7ff5000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.095+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff5100839b0 con 0x7ff5140f4bc0 2022-02-02T19:03:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.095+0000 7ff519623700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 0x7ff5000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.096+0000 7ff519623700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 0x7ff5000672e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7ff50400b790 tx=0x7ff504008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.099+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff510051b20 con 0x7ff5140f4bc0 2022-02-02T19:03:21.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.279+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5140fddc0 con 0x7ff500064e20 2022-02-02T19:03:21.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.280+0000 7ff50a7fc700 1 -- 172.21.15.96:0/19283623 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff5140fddc0 con 0x7ff500064e20 2022-02-02T19:03:21.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.281+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 msgr2=0x7ff5000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.281+0000 7ff51ae26700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 0x7ff5000672e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7ff50400b790 tx=0x7ff504008040).stop 2022-02-02T19:03:21.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.281+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 msgr2=0x7ff514109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7ff510004f60 tx=0x7ff510009b30).stop 2022-02-02T19:03:21.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 shutdown_connections 2022-02-02T19:03:21.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff500064e20 0x7ff5000672e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5140f4bc0 0x7ff514109a80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 --2- 172.21.15.96:0/19283623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5140f5e60 0x7ff51410bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 >> 172.21.15.96:0/19283623 conn(0x7ff5140f0320 msgr2=0x7ff5140f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 shutdown_connections 2022-02-02T19:03:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.282+0000 7ff51ae26700 1 -- 172.21.15.96:0/19283623 wait complete. 2022-02-02T19:03:21.290 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:03:21.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- 172.21.15.96:0/2182757571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 msgr2=0x7f03340f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2182757571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f03340f7de0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f0330004660 tx=0x7f0330009b30).stop 2022-02-02T19:03:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- 172.21.15.96:0/2182757571 shutdown_connections 2022-02-02T19:03:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2182757571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f03340f7de0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2182757571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f03340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- 172.21.15.96:0/2182757571 >> 172.21.15.96:0/2182757571 conn(0x7f03340f1e40 msgr2=0x7f03340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- 172.21.15.96:0/2182757571 shutdown_connections 2022-02-02T19:03:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- 172.21.15.96:0/2182757571 wait complete. 2022-02-02T19:03:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 Processor -- start 2022-02-02T19:03:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 -- start start 2022-02-02T19:03:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.379+0000 7f033c6f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f0334106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033c6f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033c6f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334107a00 con 0x7f03340f7980 2022-02-02T19:03:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033c6f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334107b40 con 0x7f03340f66e0 2022-02-02T19:03:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57526/0 (socket says 172.21.15.96:57526) 2022-02-02T19:03:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 -- 172.21.15.96:0/2524305151 learned_addr learned my addr 172.21.15.96:0/2524305151 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033a495700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f0334106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 -- 172.21.15.96:0/2524305151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 msgr2=0x7f0334106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f0334106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 -- 172.21.15.96:0/2524305151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330005040 con 0x7f03340f7980 2022-02-02T19:03:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033a495700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f0334106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:03:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f0339c94700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0330009990 tx=0x7f0330009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0330018070 con 0x7f03340f7980 2022-02-02T19:03:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0334108480 con 0x7f03340f7980 2022-02-02T19:03:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0330007ca0 con 0x7f03340f7980 2022-02-02T19:03:21.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033001c620 con 0x7f03340f7980 2022-02-02T19:03:21.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.380+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03341089e0 con 0x7f03340f7980 2022-02-02T19:03:21.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.381+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0334045ad0 con 0x7f03340f7980 2022-02-02T19:03:21.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.382+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f033001d960 con 0x7f03340f7980 2022-02-02T19:03:21.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.382+0000 7f032affd700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 0x7f0320067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.382+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0330083830 con 0x7f03340f7980 2022-02-02T19:03:21.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.382+0000 7f033a495700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 0x7f0320067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.383+0000 7f033a495700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 0x7f0320067290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f03340f77e0 tx=0x7f0324009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.387+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03300553d0 con 0x7f03340f7980 2022-02-02T19:03:21.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.558+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0334108c00 con 0x7f0320064dd0 2022-02-02T19:03:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.567+0000 7f032affd700 1 -- 172.21.15.96:0/2524305151 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0334108c00 con 0x7f0320064dd0 2022-02-02T19:03:21.566 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:03:21.566 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (46m) 17m ago 47m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:03:21.567 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (39m) 17m ago 47m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:03:21.567 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (39m) 15m ago 47m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:03:21.567 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (46m) 17m ago 47m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:03:21.567 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (43m) 17m ago 43m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:03:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (39m) 17m ago 43m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:03:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (43m) 15m ago 43m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:03:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (39m) 15m ago 43m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:03:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (40m) 17m ago 48m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:03:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (40m) 15m ago 47m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:03:21.569 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (40m) 17m ago 49m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:03:21.569 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (39m) 15m ago 47m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:03:21.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (47m) 17m ago 47m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:03:21.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (47m) 15m ago 47m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:03:21.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (38m) 17m ago 46m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:03:21.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (38m) 17m ago 46m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:03:21.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (37m) 17m ago 45m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:03:21.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (37m) 15m ago 45m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:03:21.571 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (36m) 15m ago 45m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:03:21.571 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (36m) 15m ago 45m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:03:21.571 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (46m) 17m ago 47m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:03:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 msgr2=0x7f0320067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 0x7f0320067290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f03340f77e0 tx=0x7f0324009040).stop 2022-02-02T19:03:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 msgr2=0x7f0334107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0330009990 tx=0x7f0330009b30).stop 2022-02-02T19:03:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 shutdown_connections 2022-02-02T19:03:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0320064dd0 0x7f0320067290 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340f66e0 0x7f0334106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 --2- 172.21.15.96:0/2524305151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03340f7980 0x7f0334107450 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 >> 172.21.15.96:0/2524305151 conn(0x7f03340f1e40 msgr2=0x7f03340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 shutdown_connections 2022-02-02T19:03:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.569+0000 7f033c6f9700 1 -- 172.21.15.96:0/2524305151 wait complete. 2022-02-02T19:03:21.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 -- 172.21.15.96:0/1007012901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 msgr2=0x7fadb00f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1007012901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb00f5fd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fada4004660 tx=0x7fada4009b30).stop 2022-02-02T19:03:21.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 -- 172.21.15.96:0/1007012901 shutdown_connections 2022-02-02T19:03:21.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1007012901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb00f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:03:21.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1007012901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb00f5fd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 -- 172.21.15.96:0/1007012901 >> 172.21.15.96:0/1007012901 conn(0x7fadb00f04c0 msgr2=0x7fadb00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 -- 172.21.15.96:0/1007012901 shutdown_connections 2022-02-02T19:03:21.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.666+0000 7fadb6e89700 1 -- 172.21.15.96:0/1007012901 wait complete. 2022-02-02T19:03:21.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 Processor -- start 2022-02-02T19:03:21.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 -- start start 2022-02-02T19:03:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00f5710 con 0x7fadb00f5bb0 2022-02-02T19:03:21.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb6e89700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00f5850 con 0x7fadb00f6550 2022-02-02T19:03:21.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.667+0000 7fadb4c25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57534/0 (socket says 172.21.15.96:57534) 2022-02-02T19:03:21.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 -- 172.21.15.96:0/1630057721 learned_addr learned my addr 172.21.15.96:0/1630057721 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:21.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadaffff700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 -- 172.21.15.96:0/1630057721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 msgr2=0x7fadb010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 -- 172.21.15.96:0/1630057721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4005040 con 0x7fadb00f5bb0 2022-02-02T19:03:21.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadaffff700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:03:21.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb4c25700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fada4004f60 tx=0x7fada4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada4018070 con 0x7fadb00f5bb0 2022-02-02T19:03:21.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fada4007ba0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb010c780 con 0x7fadb00f5bb0 2022-02-02T19:03:21.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada401dea0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.668+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb010cce0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.670+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb0045ad0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.670+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fada401d420 con 0x7fadb00f5bb0 2022-02-02T19:03:21.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.670+0000 7fadad7fa700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 0x7fada0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:21.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.670+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fada4083aa0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.670+0000 7fadaffff700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 0x7fada0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:21.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.671+0000 7fadaffff700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 0x7fada0067290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fad9c00a7e0 tx=0x7fad9c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:21.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.674+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fada4051a90 con 0x7fadb00f5bb0 2022-02-02T19:03:21.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.905+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fadb00fdec0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.905+0000 7fadad7fa700 1 -- 172.21.15.96:0/1630057721 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fada40550b0 con 0x7fadb00f5bb0 2022-02-02T19:03:21.905 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:03:21.905 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:03:21.906 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:03:21.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:21.906 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:03:21.906 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:03:21.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:21.907 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:03:21.907 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:03:21.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:03:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:03:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:03:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:03:21.909 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:03:21.909 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:03:21.909 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:03:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 msgr2=0x7fada0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 0x7fada0067290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fad9c00a7e0 tx=0x7fad9c008040).stop 2022-02-02T19:03:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 msgr2=0x7fadb0109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fada4004f60 tx=0x7fada4009b30).stop 2022-02-02T19:03:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 shutdown_connections 2022-02-02T19:03:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fada0064dd0 0x7fada0067290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadb00f5bb0 0x7fadb0109cd0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 --2- 172.21.15.96:0/1630057721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadb00f6550 0x7fadb010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 >> 172.21.15.96:0/1630057721 conn(0x7fadb00f04c0 msgr2=0x7fadb00fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 shutdown_connections 2022-02-02T19:03:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:21.907+0000 7fadb6e89700 1 -- 172.21.15.96:0/1630057721 wait complete. 2022-02-02T19:03:22.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 -- 172.21.15.96:0/3250549949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f77d0 msgr2=0x7f156c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 --2- 172.21.15.96:0/3250549949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f77d0 0x7f156c0f7c30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f155c004660 tx=0x7f155c009b30).stop 2022-02-02T19:03:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 -- 172.21.15.96:0/3250549949 shutdown_connections 2022-02-02T19:03:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 --2- 172.21.15.96:0/3250549949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f77d0 0x7f156c0f7c30 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 --2- 172.21.15.96:0/3250549949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f6530 0x7f156c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 -- 172.21.15.96:0/3250549949 >> 172.21.15.96:0/3250549949 conn(0x7f156c0f1c90 msgr2=0x7f156c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 -- 172.21.15.96:0/3250549949 shutdown_connections 2022-02-02T19:03:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.004+0000 7f156b59e700 1 -- 172.21.15.96:0/3250549949 wait complete. 2022-02-02T19:03:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 Processor -- start 2022-02-02T19:03:22.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 -- start start 2022-02-02T19:03:22.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:22.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f77d0 0x7f156c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:22.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c06a380 con 0x7f156c0f6530 2022-02-02T19:03:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c06a4c0 con 0x7f156c0f77d0 2022-02-02T19:03:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57544/0 (socket says 172.21.15.96:57544) 2022-02-02T19:03:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 -- 172.21.15.96:0/3082731396 learned_addr learned my addr 172.21.15.96:0/3082731396 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f1569d9b700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f77d0 0x7f156c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 -- 172.21.15.96:0/3082731396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f77d0 msgr2=0x7f156c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f77d0 0x7f156c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.005+0000 7f156a59c700 1 -- 172.21.15.96:0/3082731396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c005040 con 0x7f156c0f6530 2022-02-02T19:03:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f156a59c700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f155400c530 tx=0x7f1554007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155400f650 con 0x7f156c0f6530 2022-02-02T19:03:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c06a7a0 con 0x7f156c0f6530 2022-02-02T19:03:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f155400fc60 con 0x7f156c0f6530 2022-02-02T19:03:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1554012cb0 con 0x7f156c0f6530 2022-02-02T19:03:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.006+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c10ed50 con 0x7f156c0f6530 2022-02-02T19:03:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.007+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c045ad0 con 0x7f156c0f6530 2022-02-02T19:03:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.008+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1554019030 con 0x7f156c0f6530 2022-02-02T19:03:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.008+0000 7f1562ffd700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.008+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1554081c70 con 0x7f156c0f6530 2022-02-02T19:03:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.008+0000 7f1569d9b700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.009+0000 7f1569d9b700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 0x7f15580672e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f155c004630 tx=0x7f155c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.012+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f155404fe90 con 0x7f156c0f6530 2022-02-02T19:03:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.213+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f156c0fee70 con 0x7f156c0f6530 2022-02-02T19:03:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.213+0000 7f1562ffd700 1 -- 172.21.15.96:0/3082731396 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1554017070 con 0x7f156c0f6530 2022-02-02T19:03:22.213 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:03:22.213 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:03:22.213 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:03:22.213 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:03:22.214 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:22.214 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:03:22.214 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:03:22.214 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:03:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:03:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:03:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:03:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:03:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:03:22.216 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:03:22.216 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:03:22.216 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:03:22.216 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:03:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:03:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:03:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:03:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:03:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:03:22.218 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:03:22.218 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:03:22.218 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:03:22.218 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:03:22.219 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:03:22.219 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:03:22.219 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:03:22.219 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:03:22.219 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:03:22.220 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:03:22.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:22.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:22.220 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:03:22.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:22.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:22.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:22.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 msgr2=0x7f15580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 0x7f15580672e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f155c004630 tx=0x7f155c009b30).stop 2022-02-02T19:03:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 msgr2=0x7f156c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f155400c530 tx=0x7f1554007e10).stop 2022-02-02T19:03:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 shutdown_connections 2022-02-02T19:03:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f156c0f6530 0x7f156c06b9a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 --2- 172.21.15.96:0/3082731396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156c0f77d0 0x7f156c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 >> 172.21.15.96:0/3082731396 conn(0x7f156c0f1c90 msgr2=0x7f156c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 shutdown_connections 2022-02-02T19:03:22.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:22.215+0000 7f156b59e700 1 -- 172.21.15.96:0/3082731396 wait complete. 2022-02-02T19:03:22.225 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:03:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:22 smithi159 ceph-mon[69013]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:22 smithi159 ceph-mon[69013]: from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:22 smithi159 ceph-mon[69013]: pgmap v1237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1630057721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:03:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3082731396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:03:23.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:22 smithi096 ceph-mon[101353]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:22 smithi096 ceph-mon[101353]: from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:22 smithi096 ceph-mon[101353]: pgmap v1237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1630057721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:03:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3082731396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:03:25.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:24 smithi159 ceph-mon[69013]: pgmap v1238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:25.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:24 smithi096 ceph-mon[101353]: pgmap v1238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:26 smithi159 ceph-mon[69013]: pgmap v1239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:27.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:26 smithi096 ceph-mon[101353]: pgmap v1239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:28.022 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:03:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:03:28.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:03:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:03:29.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:28 smithi096 ceph-mon[101353]: pgmap v1240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:29.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:28 smithi159 ceph-mon[69013]: pgmap v1240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:31.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:30 smithi096 ceph-mon[101353]: pgmap v1241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:31.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:30 smithi159 ceph-mon[69013]: pgmap v1241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:33.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:32 smithi096 ceph-mon[101353]: pgmap v1242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:33.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:32 smithi159 ceph-mon[69013]: pgmap v1242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:35.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:34 smithi096 ceph-mon[101353]: pgmap v1243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:35.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:34 smithi159 ceph-mon[69013]: pgmap v1243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:36 smithi159 ceph-mon[69013]: pgmap v1244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:37.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:36 smithi096 ceph-mon[101353]: pgmap v1244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:38 smithi159 ceph-mon[69013]: pgmap v1245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:39.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:38 smithi096 ceph-mon[101353]: pgmap v1245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:40 smithi159 ceph-mon[69013]: pgmap v1246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:41.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:40 smithi096 ceph-mon[101353]: pgmap v1246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:42 smithi159 ceph-mon[69013]: pgmap v1247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:43.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:42 smithi096 ceph-mon[101353]: pgmap v1247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:44 smithi159 ceph-mon[69013]: pgmap v1248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:44 smithi096 ceph-mon[101353]: pgmap v1248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:46 smithi159 ceph-mon[69013]: pgmap v1249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:47.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:46 smithi096 ceph-mon[101353]: pgmap v1249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:48 smithi159 ceph-mon[69013]: pgmap v1250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:49.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:48 smithi096 ceph-mon[101353]: pgmap v1250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:50 smithi159 ceph-mon[69013]: pgmap v1251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:50 smithi096 ceph-mon[101353]: pgmap v1251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:52.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 -- 172.21.15.96:0/2293841477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f55c0 msgr2=0x7f64640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 --2- 172.21.15.96:0/2293841477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f55c0 0x7f64640f59e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f6458004660 tx=0x7f6458009b30).stop 2022-02-02T19:03:52.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 -- 172.21.15.96:0/2293841477 shutdown_connections 2022-02-02T19:03:52.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 --2- 172.21.15.96:0/2293841477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f6860 0x7f64640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 --2- 172.21.15.96:0/2293841477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f55c0 0x7f64640f59e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 -- 172.21.15.96:0/2293841477 >> 172.21.15.96:0/2293841477 conn(0x7f64640f0d40 msgr2=0x7f64640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 -- 172.21.15.96:0/2293841477 shutdown_connections 2022-02-02T19:03:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.326+0000 7f646b669700 1 -- 172.21.15.96:0/2293841477 wait complete. 2022-02-02T19:03:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 Processor -- start 2022-02-02T19:03:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 -- start start 2022-02-02T19:03:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f55c0 0x7f6464109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640603c0 con 0x7f64640f6860 2022-02-02T19:03:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f646b669700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464060500 con 0x7f64640f55c0 2022-02-02T19:03:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f6468c04700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f6468c04700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57566/0 (socket says 172.21.15.96:57566) 2022-02-02T19:03:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.327+0000 7f6468c04700 1 -- 172.21.15.96:0/3778033560 learned_addr learned my addr 172.21.15.96:0/3778033560 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6469405700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f55c0 0x7f6464109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6468c04700 1 -- 172.21.15.96:0/3778033560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f55c0 msgr2=0x7f6464109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6468c04700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f55c0 0x7f6464109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6468c04700 1 -- 172.21.15.96:0/3778033560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458005040 con 0x7f64640f6860 2022-02-02T19:03:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6468c04700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f646000e7f0 tx=0x7f646000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64600092e0 con 0x7f64640f6860 2022-02-02T19:03:52.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f646000f040 con 0x7f64640f6860 2022-02-02T19:03:52.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646410c6c0 con 0x7f64640f6860 2022-02-02T19:03:52.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6460014750 con 0x7f64640f6860 2022-02-02T19:03:52.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.328+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646410cc50 con 0x7f64640f6860 2022-02-02T19:03:52.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.329+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640f49b0 con 0x7f64640f6860 2022-02-02T19:03:52.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.330+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f646001b030 con 0x7f64640f6860 2022-02-02T19:03:52.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.330+0000 7f6455ffb700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 0x7f6450067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.330+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6460081870 con 0x7f64640f6860 2022-02-02T19:03:52.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.330+0000 7f6469405700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 0x7f6450067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.331+0000 7f6469405700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 0x7f6450067290 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6458000c00 tx=0x7f6458016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.335+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f646004f9d0 con 0x7f64640f6860 2022-02-02T19:03:52.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.517+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64640fdf00 con 0x7f6450064dd0 2022-02-02T19:03:52.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.518+0000 7f6455ffb700 1 -- 172.21.15.96:0/3778033560 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f64640fdf00 con 0x7f6450064dd0 2022-02-02T19:03:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 msgr2=0x7f6450067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 0x7f6450067290 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6458000c00 tx=0x7f6458016040).stop 2022-02-02T19:03:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 msgr2=0x7f646410c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f646000e7f0 tx=0x7f646000b040).stop 2022-02-02T19:03:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 shutdown_connections 2022-02-02T19:03:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6450064dd0 0x7f6450067290 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64640f55c0 0x7f6464109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 --2- 172.21.15.96:0/3778033560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64640f6860 0x7f646410c110 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 >> 172.21.15.96:0/3778033560 conn(0x7f64640f0d40 msgr2=0x7f64640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 shutdown_connections 2022-02-02T19:03:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.520+0000 7f646b669700 1 -- 172.21.15.96:0/3778033560 wait complete. 2022-02-02T19:03:52.529 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:03:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 -- 172.21.15.96:0/3817927361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 msgr2=0x7f87300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 --2- 172.21.15.96:0/3817927361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f87300f6b00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f8720004660 tx=0x7f8720009b30).stop 2022-02-02T19:03:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 -- 172.21.15.96:0/3817927361 shutdown_connections 2022-02-02T19:03:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 --2- 172.21.15.96:0/3817927361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 0x7f87300f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:03:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 --2- 172.21.15.96:0/3817927361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f87300f6b00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 -- 172.21.15.96:0/3817927361 >> 172.21.15.96:0/3817927361 conn(0x7f87300f1e40 msgr2=0x7f87300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 -- 172.21.15.96:0/3817927361 shutdown_connections 2022-02-02T19:03:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.617+0000 7f8735b83700 1 -- 172.21.15.96:0/3817927361 wait complete. 2022-02-02T19:03:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 Processor -- start 2022-02-02T19:03:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 -- start start 2022-02-02T19:03:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 0x7f87301074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730107ae0 con 0x7f87300f66e0 2022-02-02T19:03:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f8735b83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730108390 con 0x7f87300f7980 2022-02-02T19:03:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f872f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f872f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57574/0 (socket says 172.21.15.96:57574) 2022-02-02T19:03:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.618+0000 7f872f7fe700 1 -- 172.21.15.96:0/1365698208 learned_addr learned my addr 172.21.15.96:0/1365698208 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f872effd700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 0x7f87301074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f872f7fe700 1 -- 172.21.15.96:0/1365698208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 msgr2=0x7f87301074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f872f7fe700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 0x7f87301074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f872f7fe700 1 -- 172.21.15.96:0/1365698208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720005040 con 0x7f87300f66e0 2022-02-02T19:03:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f872f7fe700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f8720004f60 tx=0x7f8720009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8720018070 con 0x7f87300f66e0 2022-02-02T19:03:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8720007ba0 con 0x7f87300f66e0 2022-02-02T19:03:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8730108610 con 0x7f87300f66e0 2022-02-02T19:03:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872001c620 con 0x7f87300f66e0 2022-02-02T19:03:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.619+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8730108b70 con 0x7f87300f66e0 2022-02-02T19:03:52.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.620+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87300f5ad0 con 0x7f87300f66e0 2022-02-02T19:03:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.621+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f872001c8e0 con 0x7f87300f66e0 2022-02-02T19:03:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.621+0000 7f8717fff700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.621+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f87200839b0 con 0x7f87300f66e0 2022-02-02T19:03:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.621+0000 7f872effd700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.621+0000 7f872effd700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f872400b790 tx=0x7f8724008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.625+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8720055490 con 0x7f87300f66e0 2022-02-02T19:03:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.801+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87300fef20 con 0x7f8718064dd0 2022-02-02T19:03:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.810+0000 7f8717fff700 1 -- 172.21.15.96:0/1365698208 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f87300fef20 con 0x7f8718064dd0 2022-02-02T19:03:52.810 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:03:52.810 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (47m) 17m ago 48m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:03:52.810 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (39m) 17m ago 48m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:03:52.811 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (39m) 16m ago 47m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:03:52.811 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (47m) 17m ago 48m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:03:52.811 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (44m) 17m ago 44m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:03:52.811 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (39m) 17m ago 44m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:03:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (44m) 16m ago 44m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:03:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (40m) 16m ago 44m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:03:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (41m) 17m ago 49m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:03:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (41m) 16m ago 47m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:03:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (40m) 17m ago 49m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:03:52.813 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (40m) 16m ago 47m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:03:52.813 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (48m) 17m ago 48m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:03:52.813 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (47m) 16m ago 47m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:03:52.813 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (39m) 17m ago 47m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:03:52.814 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (38m) 17m ago 46m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:03:52.814 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (38m) 17m ago 46m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:03:52.814 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (37m) 16m ago 46m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:03:52.814 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (37m) 16m ago 45m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:03:52.815 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (36m) 16m ago 45m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:03:52.815 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (47m) 17m ago 47m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:03:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 msgr2=0x7f8718067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f872400b790 tx=0x7f8724008040).stop 2022-02-02T19:03:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 msgr2=0x7f8730106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f8720004f60 tx=0x7f8720009b30).stop 2022-02-02T19:03:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 shutdown_connections 2022-02-02T19:03:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87300f66e0 0x7f8730106fb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 --2- 172.21.15.96:0/1365698208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87300f7980 0x7f87301074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 >> 172.21.15.96:0/1365698208 conn(0x7f87300f1e40 msgr2=0x7f87300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 shutdown_connections 2022-02-02T19:03:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.812+0000 7f8735b83700 1 -- 172.21.15.96:0/1365698208 wait complete. 2022-02-02T19:03:52.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 -- 172.21.15.96:0/1034398929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f55c0 msgr2=0x7f09d40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 --2- 172.21.15.96:0/1034398929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f55c0 0x7f09d40f59e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f09c4004660 tx=0x7f09c4009b30).stop 2022-02-02T19:03:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 -- 172.21.15.96:0/1034398929 shutdown_connections 2022-02-02T19:03:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 --2- 172.21.15.96:0/1034398929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f6860 0x7f09d40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:03:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 --2- 172.21.15.96:0/1034398929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f55c0 0x7f09d40f59e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 -- 172.21.15.96:0/1034398929 >> 172.21.15.96:0/1034398929 conn(0x7f09d40f0d40 msgr2=0x7f09d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:52.911 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:52 smithi096 ceph-mon[101353]: pgmap v1252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:52.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 -- 172.21.15.96:0/1034398929 shutdown_connections 2022-02-02T19:03:52.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.909+0000 7f09da148700 1 -- 172.21.15.96:0/1034398929 wait complete. 2022-02-02T19:03:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 Processor -- start 2022-02-02T19:03:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 -- start start 2022-02-02T19:03:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f55c0 0x7f09d4109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d4060450 con 0x7f09d40f6860 2022-02-02T19:03:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09da148700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d4060590 con 0x7f09d40f55c0 2022-02-02T19:03:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57586/0 (socket says 172.21.15.96:57586) 2022-02-02T19:03:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09d2ffd700 1 -- 172.21.15.96:0/1628708148 learned_addr learned my addr 172.21.15.96:0/1628708148 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.910+0000 7f09d37fe700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f55c0 0x7f09d4109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09d2ffd700 1 -- 172.21.15.96:0/1628708148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f55c0 msgr2=0x7f09d4109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09d2ffd700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f55c0 0x7f09d4109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09d2ffd700 1 -- 172.21.15.96:0/1628708148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4005040 con 0x7f09d40f6860 2022-02-02T19:03:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09d2ffd700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f09bc00b410 tx=0x7f09bc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09bc0125f0 con 0x7f09d40f6860 2022-02-02T19:03:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d410c7f0 con 0x7f09d40f6860 2022-02-02T19:03:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09bc012c00 con 0x7f09d40f6860 2022-02-02T19:03:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d410cdb0 con 0x7f09d40f6860 2022-02-02T19:03:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.911+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09bc011d20 con 0x7f09d40f6860 2022-02-02T19:03:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.913+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d4045ad0 con 0x7f09d40f6860 2022-02-02T19:03:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.913+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09bc00f030 con 0x7f09d40f6860 2022-02-02T19:03:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.913+0000 7f09cbfff700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 0x7f09c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.913+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09bc081e00 con 0x7f09d40f6860 2022-02-02T19:03:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.913+0000 7f09d37fe700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 0x7f09c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.914+0000 7f09d37fe700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 0x7f09c0067290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f09c4013690 tx=0x7f09c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:52.917+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09bc050e20 con 0x7f09d40f6860 2022-02-02T19:03:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:52 smithi159 ceph-mon[69013]: pgmap v1252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.147+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09d40fdea0 con 0x7f09d40f6860 2022-02-02T19:03:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.147+0000 7f09cbfff700 1 -- 172.21.15.96:0/1628708148 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f09bc012d70 con 0x7f09d40f6860 2022-02-02T19:03:53.147 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:03:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:03:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:03:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:03:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:03:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:03:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:03:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:03:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:03:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:03:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:03:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:03:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:03:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:03:53.151 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:03:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 msgr2=0x7f09c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 0x7f09c0067290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f09c4013690 tx=0x7f09c4009b30).stop 2022-02-02T19:03:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 msgr2=0x7f09d410c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f09bc00b410 tx=0x7f09bc006ef0).stop 2022-02-02T19:03:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 shutdown_connections 2022-02-02T19:03:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09c0064dd0 0x7f09c0067290 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09d40f55c0 0x7f09d4109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 --2- 172.21.15.96:0/1628708148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09d40f6860 0x7f09d410c1e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 >> 172.21.15.96:0/1628708148 conn(0x7f09d40f0d40 msgr2=0x7f09d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:53.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 shutdown_connections 2022-02-02T19:03:53.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.149+0000 7f09da148700 1 -- 172.21.15.96:0/1628708148 wait complete. 2022-02-02T19:03:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 -- 172.21.15.96:0/3755903950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f55c0 msgr2=0x7f70f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 --2- 172.21.15.96:0/3755903950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f55c0 0x7f70f00f59e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f70e0004660 tx=0x7f70e0009b30).stop 2022-02-02T19:03:53.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 -- 172.21.15.96:0/3755903950 shutdown_connections 2022-02-02T19:03:53.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 --2- 172.21.15.96:0/3755903950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f6860 0x7f70f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 --2- 172.21.15.96:0/3755903950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f55c0 0x7f70f00f59e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 -- 172.21.15.96:0/3755903950 >> 172.21.15.96:0/3755903950 conn(0x7f70f00f0d40 msgr2=0x7f70f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 -- 172.21.15.96:0/3755903950 shutdown_connections 2022-02-02T19:03:53.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.248+0000 7f70f610d700 1 -- 172.21.15.96:0/3755903950 wait complete. 2022-02-02T19:03:53.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 Processor -- start 2022-02-02T19:03:53.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 -- start start 2022-02-02T19:03:53.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f55c0 0x7f70f0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0060420 con 0x7f70f00f6860 2022-02-02T19:03:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70f610d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0060560 con 0x7f70f00f55c0 2022-02-02T19:03:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57596/0 (socket says 172.21.15.96:57596) 2022-02-02T19:03:53.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70eeffd700 1 -- 172.21.15.96:0/2161511029 learned_addr learned my addr 172.21.15.96:0/2161511029 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:03:53.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.249+0000 7f70ef7fe700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f55c0 0x7f70f0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:53.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70eeffd700 1 -- 172.21.15.96:0/2161511029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f55c0 msgr2=0x7f70f0109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70eeffd700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f55c0 0x7f70f0109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70eeffd700 1 -- 172.21.15.96:0/2161511029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0005040 con 0x7f70f00f6860 2022-02-02T19:03:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70eeffd700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f70d80026d0 tx=0x7f70d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d80079c0 con 0x7f70f00f6860 2022-02-02T19:03:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f010c740 con 0x7f70f00f6860 2022-02-02T19:03:53.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f010ccd0 con 0x7f70f00f6860 2022-02-02T19:03:53.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70d800f040 con 0x7f70f00f6860 2022-02-02T19:03:53.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.250+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d80148b0 con 0x7f70f00f6860 2022-02-02T19:03:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.251+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d4004fa0 con 0x7f70f00f6860 2022-02-02T19:03:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.251+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f70d8014a10 con 0x7f70f00f6860 2022-02-02T19:03:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.252+0000 7f70e7fff700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 0x7f70dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:03:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.252+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f70d8081910 con 0x7f70f00f6860 2022-02-02T19:03:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.252+0000 7f70ef7fe700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 0x7f70dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:03:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.252+0000 7f70ef7fe700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 0x7f70dc067290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f70e0013690 tx=0x7f70e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:03:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.256+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f70d804f9c0 con 0x7f70f00f6860 2022-02-02T19:03:53.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.460+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70d4005e80 con 0x7f70f00f6860 2022-02-02T19:03:53.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.460+0000 7f70e7fff700 1 -- 172.21.15.96:0/2161511029 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f70d8052fe0 con 0x7f70f00f6860 2022-02-02T19:03:53.461 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:03:53.462 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:03:53.462 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:03:53.462 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:03:53.463 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:53.463 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:03:53.464 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:03:53.464 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:03:53.465 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:03:53.465 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:03:53.466 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:03:53.466 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:03:53.467 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:03:53.467 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:03:53.468 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:03:53.468 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:03:53.468 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:03:53.469 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:03:53.469 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:03:53.470 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:03:53.470 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:03:53.471 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:03:53.471 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:03:53.472 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:03:53.472 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:03:53.473 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:03:53.473 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:03:53.474 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:03:53.474 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:03:53.474 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:03:53.475 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:03:53.475 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:03:53.475 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:53.476 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:53.476 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:03:53.477 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:03:53.477 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:53.478 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:53.478 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:03:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 msgr2=0x7f70dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 0x7f70dc067290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f70e0013690 tx=0x7f70e0009b30).stop 2022-02-02T19:03:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 msgr2=0x7f70f010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:03:53.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f70d80026d0 tx=0x7f70d8009de0).stop 2022-02-02T19:03:53.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 shutdown_connections 2022-02-02T19:03:53.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70dc064dd0 0x7f70dc067290 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f00f55c0 0x7f70f0109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 --2- 172.21.15.96:0/2161511029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f00f6860 0x7f70f010c130 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:03:53.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 >> 172.21.15.96:0/2161511029 conn(0x7f70f00f0d40 msgr2=0x7f70f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:03:53.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 shutdown_connections 2022-02-02T19:03:53.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:03:53.463+0000 7f70f610d700 1 -- 172.21.15.96:0/2161511029 wait complete. 2022-02-02T19:03:53.486 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:03:53.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:53 smithi159 ceph-mon[69013]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:53.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1628708148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:03:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2161511029' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:03:54.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:53 smithi096 ceph-mon[101353]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:54.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1628708148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:03:54.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2161511029' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:03:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:54 smithi159 ceph-mon[69013]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:54 smithi159 ceph-mon[69013]: pgmap v1253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:54 smithi096 ceph-mon[101353]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:03:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:54 smithi096 ceph-mon[101353]: pgmap v1253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:56 smithi159 ceph-mon[69013]: pgmap v1254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:56 smithi096 ceph-mon[101353]: pgmap v1254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:03:58 smithi159 ceph-mon[69013]: pgmap v1255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:03:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:03:58 smithi096 ceph-mon[101353]: pgmap v1255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:00 smithi159 ceph-mon[69013]: pgmap v1256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:00 smithi096 ceph-mon[101353]: pgmap v1256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:02 smithi159 ceph-mon[69013]: pgmap v1257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:02 smithi096 ceph-mon[101353]: pgmap v1257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:04 smithi159 ceph-mon[69013]: pgmap v1258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:04 smithi096 ceph-mon[101353]: pgmap v1258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:06 smithi159 ceph-mon[69013]: pgmap v1259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:06 smithi096 ceph-mon[101353]: pgmap v1259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:08 smithi159 ceph-mon[69013]: pgmap v1260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:08 smithi096 ceph-mon[101353]: pgmap v1260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:10 smithi159 ceph-mon[69013]: pgmap v1261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:10 smithi096 ceph-mon[101353]: pgmap v1261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:12 smithi159 ceph-mon[69013]: pgmap v1262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:12 smithi096 ceph-mon[101353]: pgmap v1262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:14 smithi159 ceph-mon[69013]: pgmap v1263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:14 smithi096 ceph-mon[101353]: pgmap v1263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:16 smithi159 ceph-mon[69013]: pgmap v1264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:16 smithi096 ceph-mon[101353]: pgmap v1264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:18 smithi159 ceph-mon[69013]: pgmap v1265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:18 smithi096 ceph-mon[101353]: pgmap v1265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:20 smithi159 ceph-mon[69013]: pgmap v1266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:20 smithi096 ceph-mon[101353]: pgmap v1266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:22 smithi159 ceph-mon[69013]: pgmap v1267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:22 smithi096 ceph-mon[101353]: pgmap v1267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:23.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 -- 172.21.15.96:0/3278918617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f5ef0 msgr2=0x7f07740f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 --2- 172.21.15.96:0/3278918617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f5ef0 0x7f07740f6920 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f0768004660 tx=0x7f0768009b30).stop 2022-02-02T19:04:23.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 -- 172.21.15.96:0/3278918617 shutdown_connections 2022-02-02T19:04:23.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 --2- 172.21.15.96:0/3278918617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f5ef0 0x7f07740f6920 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 --2- 172.21.15.96:0/3278918617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f55e0 0x7f07740f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 -- 172.21.15.96:0/3278918617 >> 172.21.15.96:0/3278918617 conn(0x7f07740f0de0 msgr2=0x7f07740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:23.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 -- 172.21.15.96:0/3278918617 shutdown_connections 2022-02-02T19:04:23.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.572+0000 7f0779365700 1 -- 172.21.15.96:0/3278918617 wait complete. 2022-02-02T19:04:23.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 Processor -- start 2022-02-02T19:04:23.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 -- start start 2022-02-02T19:04:23.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f5ef0 0x7f077410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740604e0 con 0x7f07740f55e0 2022-02-02T19:04:23.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0779365700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774060620 con 0x7f07740f5ef0 2022-02-02T19:04:23.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57614/0 (socket says 172.21.15.96:57614) 2022-02-02T19:04:23.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.573+0000 7f0772ffd700 1 -- 172.21.15.96:0/3303618217 learned_addr learned my addr 172.21.15.96:0/3303618217 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f07727fc700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f5ef0 0x7f077410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0772ffd700 1 -- 172.21.15.96:0/3303618217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f5ef0 msgr2=0x7f077410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0772ffd700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f5ef0 0x7f077410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0772ffd700 1 -- 172.21.15.96:0/3303618217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768005040 con 0x7f07740f55e0 2022-02-02T19:04:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0772ffd700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f076400c790 tx=0x7f0764007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0764002590 con 0x7f07740f55e0 2022-02-02T19:04:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077410c740 con 0x7f07740f55e0 2022-02-02T19:04:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0764002ba0 con 0x7f07740f55e0 2022-02-02T19:04:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0764013d90 con 0x7f07740f55e0 2022-02-02T19:04:23.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.574+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077410cd00 con 0x7f07740f55e0 2022-02-02T19:04:23.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.575+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0774045ad0 con 0x7f07740f55e0 2022-02-02T19:04:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.576+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f076401a060 con 0x7f07740f55e0 2022-02-02T19:04:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.576+0000 7f075b7fe700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 0x7f075c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.576+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0764081d40 con 0x7f07740f55e0 2022-02-02T19:04:23.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.576+0000 7f07727fc700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 0x7f075c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.576+0000 7f07727fc700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 0x7f075c067290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f0768004630 tx=0x7f0768009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:23.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.580+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f076404fd90 con 0x7f07740f55e0 2022-02-02T19:04:23.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.759+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07740fdee0 con 0x7f075c064dd0 2022-02-02T19:04:23.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.760+0000 7f075b7fe700 1 -- 172.21.15.96:0/3303618217 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f07740fdee0 con 0x7f075c064dd0 2022-02-02T19:04:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 msgr2=0x7f075c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 0x7f075c067290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f0768004630 tx=0x7f0768009b30).stop 2022-02-02T19:04:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 msgr2=0x7f0774109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f076400c790 tx=0x7f0764007d70).stop 2022-02-02T19:04:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 shutdown_connections 2022-02-02T19:04:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f075c064dd0 0x7f075c067290 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07740f55e0 0x7f0774109c90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 --2- 172.21.15.96:0/3303618217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07740f5ef0 0x7f077410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 >> 172.21.15.96:0/3303618217 conn(0x7f07740f0de0 msgr2=0x7f07740fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 shutdown_connections 2022-02-02T19:04:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.762+0000 7f0779365700 1 -- 172.21.15.96:0/3303618217 wait complete. 2022-02-02T19:04:23.772 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:04:23.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 -- 172.21.15.96:0/2877365719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f5430 msgr2=0x7f494c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 --2- 172.21.15.96:0/2877365719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f5430 0x7f494c0f5850 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f493c004660 tx=0x7f493c009b30).stop 2022-02-02T19:04:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 -- 172.21.15.96:0/2877365719 shutdown_connections 2022-02-02T19:04:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 --2- 172.21.15.96:0/2877365719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f66d0 0x7f494c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 --2- 172.21.15.96:0/2877365719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f5430 0x7f494c0f5850 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 -- 172.21.15.96:0/2877365719 >> 172.21.15.96:0/2877365719 conn(0x7f494c0f0b90 msgr2=0x7f494c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 -- 172.21.15.96:0/2877365719 shutdown_connections 2022-02-02T19:04:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.859+0000 7f494bfff700 1 -- 172.21.15.96:0/2877365719 wait complete. 2022-02-02T19:04:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 Processor -- start 2022-02-02T19:04:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 -- start start 2022-02-02T19:04:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f5430 0x7f494c105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1067d0 con 0x7f494c0f66d0 2022-02-02T19:04:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c106fd0 con 0x7f494c0f5430 2022-02-02T19:04:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.860+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57626/0 (socket says 172.21.15.96:57626) 2022-02-02T19:04:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494affd700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f5430 0x7f494c105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 -- 172.21.15.96:0/3482971998 learned_addr learned my addr 172.21.15.96:0/3482971998 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 -- 172.21.15.96:0/3482971998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f5430 msgr2=0x7f494c105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f5430 0x7f494c105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 -- 172.21.15.96:0/3482971998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c005040 con 0x7f494c0f66d0 2022-02-02T19:04:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494a7fc700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f494000c530 tx=0x7f4940007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494000f650 con 0x7f494c0f66d0 2022-02-02T19:04:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f494000fc60 con 0x7f494c0f66d0 2022-02-02T19:04:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1072b0 con 0x7f494c0f66d0 2022-02-02T19:04:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c107870 con 0x7f494c0f66d0 2022-02-02T19:04:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.861+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4940012c20 con 0x7f494c0f66d0 2022-02-02T19:04:23.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.862+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c004fa0 con 0x7f494c0f66d0 2022-02-02T19:04:23.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.863+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4940010070 con 0x7f494c0f66d0 2022-02-02T19:04:23.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.863+0000 7f49337fe700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 0x7f49340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.863+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f49400816e0 con 0x7f494c0f66d0 2022-02-02T19:04:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.863+0000 7f494affd700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 0x7f49340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.864+0000 7f494affd700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 0x7f49340672e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f493c004630 tx=0x7f493c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:23.868+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49400531c0 con 0x7f494c0f66d0 2022-02-02T19:04:24.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.041+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f492c000bc0 con 0x7f4934064e20 2022-02-02T19:04:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.050+0000 7f49337fe700 1 -- 172.21.15.96:0/3482971998 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f492c000bc0 con 0x7f4934064e20 2022-02-02T19:04:24.051 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:04:24.051 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (47m) 18m ago 48m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:04:24.051 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (40m) 18m ago 48m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:04:24.052 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (40m) 16m ago 48m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:04:24.052 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (47m) 18m ago 48m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:04:24.052 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (44m) 18m ago 44m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:04:24.052 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (40m) 18m ago 44m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:04:24.053 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (44m) 16m ago 44m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:04:24.053 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (40m) 16m ago 44m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:04:24.053 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (42m) 18m ago 49m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:04:24.053 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (41m) 16m ago 48m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:04:24.054 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (41m) 18m ago 50m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:04:24.054 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (40m) 16m ago 48m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:04:24.054 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (48m) 18m ago 48m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:04:24.054 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (48m) 16m ago 48m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:04:24.055 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (39m) 18m ago 47m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:04:24.055 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (39m) 18m ago 47m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:04:24.055 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (38m) 18m ago 47m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:04:24.055 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (38m) 16m ago 46m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:04:24.055 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (37m) 16m ago 46m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:04:24.056 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (37m) 16m ago 46m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:04:24.056 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (47m) 18m ago 48m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:04:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 msgr2=0x7f49340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 0x7f49340672e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f493c004630 tx=0x7f493c009b30).stop 2022-02-02T19:04:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 msgr2=0x7f494c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f494000c530 tx=0x7f4940007e20).stop 2022-02-02T19:04:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 shutdown_connections 2022-02-02T19:04:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4934064e20 0x7f49340672e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f494c0f5430 0x7f494c105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 --2- 172.21.15.96:0/3482971998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f494c0f66d0 0x7f494c106220 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 >> 172.21.15.96:0/3482971998 conn(0x7f494c0f0b90 msgr2=0x7f494c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 shutdown_connections 2022-02-02T19:04:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.052+0000 7f494bfff700 1 -- 172.21.15.96:0/3482971998 wait complete. 2022-02-02T19:04:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 -- 172.21.15.96:0/1941623605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 msgr2=0x7f15700f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 --2- 172.21.15.96:0/1941623605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f8160 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f1564004660 tx=0x7f1564009b30).stop 2022-02-02T19:04:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 -- 172.21.15.96:0/1941623605 shutdown_connections 2022-02-02T19:04:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 --2- 172.21.15.96:0/1941623605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 0x7f15700f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 --2- 172.21.15.96:0/1941623605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f8160 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.148+0000 7f1575207700 1 -- 172.21.15.96:0/1941623605 >> 172.21.15.96:0/1941623605 conn(0x7f15700f04c0 msgr2=0x7f15700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 -- 172.21.15.96:0/1941623605 shutdown_connections 2022-02-02T19:04:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 -- 172.21.15.96:0/1941623605 wait complete. 2022-02-02T19:04:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 Processor -- start 2022-02-02T19:04:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 -- start start 2022-02-02T19:04:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 0x7f15700f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700f5ff0 con 0x7f15700f7d40 2022-02-02T19:04:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.149+0000 7f1575207700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700f6130 con 0x7f15700f86e0 2022-02-02T19:04:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57632/0 (socket says 172.21.15.96:57632) 2022-02-02T19:04:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 -- 172.21.15.96:0/271219217 learned_addr learned my addr 172.21.15.96:0/271219217 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156e59c700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 0x7f15700f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 -- 172.21.15.96:0/271219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 msgr2=0x7f15700f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 0x7f15700f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 -- 172.21.15.96:0/271219217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564005040 con 0x7f15700f7d40 2022-02-02T19:04:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f156ed9d700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f1564014040 tx=0x7f156400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564019070 con 0x7f15700f7d40 2022-02-02T19:04:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15700f63b0 con 0x7f15700f7d40 2022-02-02T19:04:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1564007e70 con 0x7f15700f7d40 2022-02-02T19:04:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564014d10 con 0x7f15700f7d40 2022-02-02T19:04:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.150+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15700f6910 con 0x7f15700f7d40 2022-02-02T19:04:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.151+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1570045ad0 con 0x7f15700f7d40 2022-02-02T19:04:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.152+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1564025070 con 0x7f15700f7d40 2022-02-02T19:04:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.153+0000 7f15577fe700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 0x7f1558067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.153+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1564082a90 con 0x7f15700f7d40 2022-02-02T19:04:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.153+0000 7f156e59c700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 0x7f1558067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.153+0000 7f156e59c700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 0x7f1558067290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f1560009fd0 tx=0x7f156000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.157+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1564050b40 con 0x7f15700f7d40 2022-02-02T19:04:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.384+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15700586e0 con 0x7f15700f7d40 2022-02-02T19:04:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.384+0000 7f15577fe700 1 -- 172.21.15.96:0/271219217 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1564023020 con 0x7f15700f7d40 2022-02-02T19:04:24.386 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:04:24.386 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:04:24.386 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:04:24.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:04:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:04:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:04:24.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:04:24.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:24.388 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:04:24.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:04:24.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:24.389 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:04:24.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:04:24.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:04:24.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:04:24.390 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:04:24.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 msgr2=0x7f1558067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 0x7f1558067290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f1560009fd0 tx=0x7f156000b040).stop 2022-02-02T19:04:24.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 msgr2=0x7f15700f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f1564014040 tx=0x7f156400b040).stop 2022-02-02T19:04:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 shutdown_connections 2022-02-02T19:04:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1558064dd0 0x7f1558067290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15700f7d40 0x7f15700f7610 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 --2- 172.21.15.96:0/271219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15700f86e0 0x7f15700f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 >> 172.21.15.96:0/271219217 conn(0x7f15700f04c0 msgr2=0x7f15700fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:24.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 shutdown_connections 2022-02-02T19:04:24.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.386+0000 7f1575207700 1 -- 172.21.15.96:0/271219217 wait complete. 2022-02-02T19:04:24.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 -- 172.21.15.96:0/561651444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 msgr2=0x7f61a00f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 --2- 172.21.15.96:0/561651444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a00f5df0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f619c004660 tx=0x7f619c009b30).stop 2022-02-02T19:04:24.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 -- 172.21.15.96:0/561651444 shutdown_connections 2022-02-02T19:04:24.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 --2- 172.21.15.96:0/561651444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a00f5df0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 --2- 172.21.15.96:0/561651444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 0x7f61a00f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:04:24.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 -- 172.21.15.96:0/561651444 >> 172.21.15.96:0/561651444 conn(0x7f61a00f04c0 msgr2=0x7f61a00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:24.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.484+0000 7f61a8622700 1 -- 172.21.15.96:0/561651444 shutdown_connections 2022-02-02T19:04:24.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.485+0000 7f61a8622700 1 -- 172.21.15.96:0/561651444 wait complete. 2022-02-02T19:04:24.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.485+0000 7f61a8622700 1 Processor -- start 2022-02-02T19:04:24.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.485+0000 7f61a8622700 1 -- start start 2022-02-02T19:04:24.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 0x7f61a010c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00f56b0 con 0x7f61a00f5970 2022-02-02T19:04:24.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00f57f0 con 0x7f61a00f6c60 2022-02-02T19:04:24.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57640/0 (socket says 172.21.15.96:57640) 2022-02-02T19:04:24.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 -- 172.21.15.96:0/3851973678 learned_addr learned my addr 172.21.15.96:0/3851973678 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:24.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a5bbd700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 0x7f61a010c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 -- 172.21.15.96:0/3851973678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 msgr2=0x7f61a010c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 0x7f61a010c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 -- 172.21.15.96:0/3851973678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c005040 con 0x7f61a00f5970 2022-02-02T19:04:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a63be700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f619000b410 tx=0x7f6190006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61900125f0 con 0x7f61a00f5970 2022-02-02T19:04:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a010c860 con 0x7f61a00f5970 2022-02-02T19:04:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f619000be30 con 0x7f61a00f5970 2022-02-02T19:04:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6190002a70 con 0x7f61a00f5970 2022-02-02T19:04:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.486+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a010cdf0 con 0x7f61a00f5970 2022-02-02T19:04:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.488+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a00f4150 con 0x7f61a00f5970 2022-02-02T19:04:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.488+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f619000f030 con 0x7f61a00f5970 2022-02-02T19:04:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.488+0000 7f6196ffd700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 0x7f618c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.488+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6190081ed0 con 0x7f61a00f5970 2022-02-02T19:04:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.488+0000 7f61a5bbd700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 0x7f618c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.489+0000 7f61a5bbd700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 0x7f618c067290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f619c004580 tx=0x7f619c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:24.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.492+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f619004ff80 con 0x7f61a00f5970 2022-02-02T19:04:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.692+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f61a00fdf90 con 0x7f61a00f5970 2022-02-02T19:04:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.693+0000 7f6196ffd700 1 -- 172.21.15.96:0/3851973678 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f61900535a0 con 0x7f61a00f5970 2022-02-02T19:04:24.694 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:04:24.695 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:04:24.695 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:04:24.695 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:04:24.695 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:24.696 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:04:24.696 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:04:24.696 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:04:24.696 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:04:24.697 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:04:24.697 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:04:24.697 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:04:24.697 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:04:24.698 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:04:24.698 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:04:24.698 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:04:24.698 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:04:24.698 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:04:24.699 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:04:24.699 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:04:24.699 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:04:24.699 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:04:24.700 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:04:24.700 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:04:24.700 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:04:24.700 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:04:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:04:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:04:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:04:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:04:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:04:24.702 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:04:24.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:24.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:24.702 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:04:24.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:24.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:24.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:24.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 msgr2=0x7f618c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 0x7f618c067290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f619c004580 tx=0x7f619c009b30).stop 2022-02-02T19:04:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 msgr2=0x7f61a0109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f619000b410 tx=0x7f6190006ef0).stop 2022-02-02T19:04:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 shutdown_connections 2022-02-02T19:04:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f618c064dd0 0x7f618c067290 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61a00f5970 0x7f61a0109d00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 --2- 172.21.15.96:0/3851973678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61a00f6c60 0x7f61a010c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 >> 172.21.15.96:0/3851973678 conn(0x7f61a00f04c0 msgr2=0x7f61a00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 shutdown_connections 2022-02-02T19:04:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:24.696+0000 7f61a8622700 1 -- 172.21.15.96:0/3851973678 wait complete. 2022-02-02T19:04:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:04:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:24 smithi096 ceph-mon[101353]: pgmap v1268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:24 smithi096 ceph-mon[101353]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/271219217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:04:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:24 smithi159 ceph-mon[69013]: pgmap v1268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:24 smithi159 ceph-mon[69013]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/271219217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:04:26.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:25 smithi159 ceph-mon[69013]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:26.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3851973678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:04:26.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:25 smithi096 ceph-mon[101353]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:26.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3851973678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:04:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:26 smithi159 ceph-mon[69013]: pgmap v1269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:26 smithi096 ceph-mon[101353]: pgmap v1269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:04:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:04:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:04:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:04:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:28 smithi159 ceph-mon[69013]: pgmap v1270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:28 smithi096 ceph-mon[101353]: pgmap v1270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:30 smithi159 ceph-mon[69013]: pgmap v1271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:30 smithi096 ceph-mon[101353]: pgmap v1271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:32 smithi159 ceph-mon[69013]: pgmap v1272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:32 smithi096 ceph-mon[101353]: pgmap v1272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:34 smithi159 ceph-mon[69013]: pgmap v1273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:34 smithi096 ceph-mon[101353]: pgmap v1273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:36 smithi159 ceph-mon[69013]: pgmap v1274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:36 smithi096 ceph-mon[101353]: pgmap v1274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:38 smithi159 ceph-mon[69013]: pgmap v1275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:38 smithi096 ceph-mon[101353]: pgmap v1275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:40 smithi159 ceph-mon[69013]: pgmap v1276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:40 smithi096 ceph-mon[101353]: pgmap v1276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:42 smithi159 ceph-mon[69013]: pgmap v1277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:42 smithi096 ceph-mon[101353]: pgmap v1277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:44 smithi159 ceph-mon[69013]: pgmap v1278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:44 smithi096 ceph-mon[101353]: pgmap v1278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:46 smithi159 ceph-mon[69013]: pgmap v1279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:46 smithi096 ceph-mon[101353]: pgmap v1279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:48 smithi159 ceph-mon[69013]: pgmap v1280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:48 smithi096 ceph-mon[101353]: pgmap v1280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:50 smithi159 ceph-mon[69013]: pgmap v1281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:50 smithi096 ceph-mon[101353]: pgmap v1281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:52 smithi159 ceph-mon[69013]: pgmap v1282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:52 smithi096 ceph-mon[101353]: pgmap v1282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:54.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 -- 172.21.15.96:0/363504704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 msgr2=0x7f7acc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:54.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/363504704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc0f6b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f7ac0004660 tx=0x7f7ac0009b30).stop 2022-02-02T19:04:54.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 -- 172.21.15.96:0/363504704 shutdown_connections 2022-02-02T19:04:54.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/363504704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 0x7f7acc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:54.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/363504704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc0f6b00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:54.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 -- 172.21.15.96:0/363504704 >> 172.21.15.96:0/363504704 conn(0x7f7acc0f1e40 msgr2=0x7f7acc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:54.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 -- 172.21.15.96:0/363504704 shutdown_connections 2022-02-02T19:04:54.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.810+0000 7f7ad45a5700 1 -- 172.21.15.96:0/363504704 wait complete. 2022-02-02T19:04:54.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 Processor -- start 2022-02-02T19:04:54.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 -- start start 2022-02-02T19:04:54.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:54.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 0x7f7acc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:54.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc107a50 con 0x7f7acc0f66e0 2022-02-02T19:04:54.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad45a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc107b90 con 0x7f7acc0f7980 2022-02-02T19:04:54.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad2341700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:54.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad2341700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57660/0 (socket says 172.21.15.96:57660) 2022-02-02T19:04:54.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad2341700 1 -- 172.21.15.96:0/2544515339 learned_addr learned my addr 172.21.15.96:0/2544515339 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:54.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.811+0000 7f7ad1b40700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 0x7f7acc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:54.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad2341700 1 -- 172.21.15.96:0/2544515339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 msgr2=0x7f7acc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:54.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad2341700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 0x7f7acc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:54.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad2341700 1 -- 172.21.15.96:0/2544515339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0005040 con 0x7f7acc0f66e0 2022-02-02T19:04:54.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad2341700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f7ac0004f60 tx=0x7f7ac0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:54.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac0018070 con 0x7f7acc0f66e0 2022-02-02T19:04:54.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ac0009770 con 0x7f7acc0f66e0 2022-02-02T19:04:54.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc1084d0 con 0x7f7acc0f66e0 2022-02-02T19:04:54.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc108a30 con 0x7f7acc0f66e0 2022-02-02T19:04:54.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.812+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac001c3c0 con 0x7f7acc0f66e0 2022-02-02T19:04:54.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.813+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc045ad0 con 0x7f7acc0f66e0 2022-02-02T19:04:54.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.813+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ac001d420 con 0x7f7acc0f66e0 2022-02-02T19:04:54.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.814+0000 7f7abeffd700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 0x7f7ab8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:54.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.814+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7ac0083890 con 0x7f7acc0f66e0 2022-02-02T19:04:54.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.814+0000 7f7ad1b40700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 0x7f7ab8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:54.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.814+0000 7f7ad1b40700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 0x7f7ab8067290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f7ac80041d0 tx=0x7f7ac8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:54.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.818+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ac0055430 con 0x7f7acc0f66e0 2022-02-02T19:04:54.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.996+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7acc0fefe0 con 0x7f7ab8064dd0 2022-02-02T19:04:54.996 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:54 smithi096 ceph-mon[101353]: pgmap v1283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:54.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.997+0000 7f7abeffd700 1 -- 172.21.15.96:0/2544515339 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7acc0fefe0 con 0x7f7ab8064dd0 2022-02-02T19:04:54.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 msgr2=0x7f7ab8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:54.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 0x7f7ab8067290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f7ac80041d0 tx=0x7f7ac8009040).stop 2022-02-02T19:04:55.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 msgr2=0x7f7acc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f7ac0004f60 tx=0x7f7ac0009b30).stop 2022-02-02T19:04:55.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 shutdown_connections 2022-02-02T19:04:55.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab8064dd0 0x7f7ab8067290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7acc0f66e0 0x7f7acc106fb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 --2- 172.21.15.96:0/2544515339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7acc0f7980 0x7f7acc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 >> 172.21.15.96:0/2544515339 conn(0x7f7acc0f1e40 msgr2=0x7f7acc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:54.999+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 shutdown_connections 2022-02-02T19:04:55.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.000+0000 7f7ad45a5700 1 -- 172.21.15.96:0/2544515339 wait complete. 2022-02-02T19:04:55.009 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:04:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:54 smithi159 ceph-mon[69013]: pgmap v1283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:55.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 -- 172.21.15.96:0/3153681947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f7980 msgr2=0x7f5ec00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/3153681947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f7980 0x7f5ec00f7de0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5ebc004660 tx=0x7f5ebc009b30).stop 2022-02-02T19:04:55.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 -- 172.21.15.96:0/3153681947 shutdown_connections 2022-02-02T19:04:55.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/3153681947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f7980 0x7f5ec00f7de0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/3153681947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f66e0 0x7f5ec00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 -- 172.21.15.96:0/3153681947 >> 172.21.15.96:0/3153681947 conn(0x7f5ec00f1e40 msgr2=0x7f5ec00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 -- 172.21.15.96:0/3153681947 shutdown_connections 2022-02-02T19:04:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 -- 172.21.15.96:0/3153681947 wait complete. 2022-02-02T19:04:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.097+0000 7f5ec7b01700 1 Processor -- start 2022-02-02T19:04:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 -- start start 2022-02-02T19:04:55.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f7980 0x7f5ec0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec0107a00 con 0x7f5ec00f66e0 2022-02-02T19:04:55.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec0107b40 con 0x7f5ec00f7980 2022-02-02T19:04:55.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57670/0 (socket says 172.21.15.96:57670) 2022-02-02T19:04:55.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 -- 172.21.15.96:0/1232461380 learned_addr learned my addr 172.21.15.96:0/1232461380 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:55.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec509c700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f7980 0x7f5ec0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 -- 172.21.15.96:0/1232461380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f7980 msgr2=0x7f5ec0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f7980 0x7f5ec0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 -- 172.21.15.96:0/1232461380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc005040 con 0x7f5ec00f66e0 2022-02-02T19:04:55.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec589d700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5eb0002700 tx=0x7f5eb0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb00079c0 con 0x7f5ec00f66e0 2022-02-02T19:04:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec01084e0 con 0x7f5ec00f66e0 2022-02-02T19:04:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5eb000f040 con 0x7f5ec00f66e0 2022-02-02T19:04:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.098+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb0014860 con 0x7f5ec00f66e0 2022-02-02T19:04:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.099+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec0108aa0 con 0x7f5ec00f66e0 2022-02-02T19:04:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.099+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec0045ad0 con 0x7f5ec00f66e0 2022-02-02T19:04:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.100+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5eb001b060 con 0x7f5ec00f66e0 2022-02-02T19:04:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.100+0000 7f5eb67fc700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 0x7f5eac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.100+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5eb00819f0 con 0x7f5ec00f66e0 2022-02-02T19:04:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.100+0000 7f5ec509c700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 0x7f5eac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.101+0000 7f5ec509c700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 0x7f5eac067290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f5ebc004630 tx=0x7f5ebc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.104+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5eb0053410 con 0x7f5ec00f66e0 2022-02-02T19:04:55.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.276+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ec0108d20 con 0x7f5eac064dd0 2022-02-02T19:04:55.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.285+0000 7f5eb67fc700 1 -- 172.21.15.96:0/1232461380 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5ec0108d20 con 0x7f5eac064dd0 2022-02-02T19:04:55.285 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:04:55.286 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (48m) 18m ago 49m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:04:55.286 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (40m) 18m ago 49m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:04:55.286 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (40m) 17m ago 48m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:04:55.286 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (48m) 18m ago 49m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:04:55.287 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (45m) 18m ago 45m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:04:55.287 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (41m) 18m ago 45m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:04:55.287 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (45m) 17m ago 45m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:04:55.287 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (41m) 17m ago 45m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:04:55.288 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (42m) 18m ago 50m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:04:55.288 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (42m) 17m ago 48m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:04:55.288 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (41m) 18m ago 50m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:04:55.288 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (41m) 17m ago 48m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:04:55.288 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (49m) 18m ago 49m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:04:55.289 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (48m) 17m ago 48m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:04:55.289 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (40m) 18m ago 48m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:04:55.289 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (39m) 18m ago 47m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:04:55.289 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (39m) 18m ago 47m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:04:55.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (38m) 17m ago 47m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:04:55.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (38m) 17m ago 46m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:04:55.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (37m) 17m ago 46m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:04:55.290 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (48m) 18m ago 48m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:04:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 msgr2=0x7f5eac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 0x7f5eac067290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f5ebc004630 tx=0x7f5ebc009b30).stop 2022-02-02T19:04:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 msgr2=0x7f5ec0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5eb0002700 tx=0x7f5eb0009d80).stop 2022-02-02T19:04:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 shutdown_connections 2022-02-02T19:04:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5eac064dd0 0x7f5eac067290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec00f66e0 0x7f5ec0106f60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 --2- 172.21.15.96:0/1232461380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec00f7980 0x7f5ec0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 >> 172.21.15.96:0/1232461380 conn(0x7f5ec00f1e40 msgr2=0x7f5ec00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 shutdown_connections 2022-02-02T19:04:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.287+0000 7f5ec7b01700 1 -- 172.21.15.96:0/1232461380 wait complete. 2022-02-02T19:04:55.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 -- 172.21.15.96:0/1648168638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 msgr2=0x7f4cd40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 --2- 172.21.15.96:0/1648168638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd40f59e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4cc8004660 tx=0x7f4cc8009b30).stop 2022-02-02T19:04:55.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 -- 172.21.15.96:0/1648168638 shutdown_connections 2022-02-02T19:04:55.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 --2- 172.21.15.96:0/1648168638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 --2- 172.21.15.96:0/1648168638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd40f59e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 -- 172.21.15.96:0/1648168638 >> 172.21.15.96:0/1648168638 conn(0x7f4cd40f0d40 msgr2=0x7f4cd40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 -- 172.21.15.96:0/1648168638 shutdown_connections 2022-02-02T19:04:55.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.384+0000 7f4cdb212700 1 -- 172.21.15.96:0/1648168638 wait complete. 2022-02-02T19:04:55.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 Processor -- start 2022-02-02T19:04:55.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 -- start start 2022-02-02T19:04:55.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4060420 con 0x7f4cd40f55c0 2022-02-02T19:04:55.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cdb212700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4060560 con 0x7f4cd40f6860 2022-02-02T19:04:55.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cd8fae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cd8fae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57680/0 (socket says 172.21.15.96:57680) 2022-02-02T19:04:55.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.385+0000 7f4cd8fae700 1 -- 172.21.15.96:0/3712924529 learned_addr learned my addr 172.21.15.96:0/3712924529 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:55.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd3fff700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd8fae700 1 -- 172.21.15.96:0/3712924529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 msgr2=0x7f4cd410c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd8fae700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd410c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd8fae700 1 -- 172.21.15.96:0/3712924529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc8005040 con 0x7f4cd40f55c0 2022-02-02T19:04:55.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd3fff700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd410c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:04:55.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd8fae700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4cc8004f60 tx=0x7f4cc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc8018070 con 0x7f4cd40f55c0 2022-02-02T19:04:55.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd410c6e0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cc8007ba0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc801c620 con 0x7f4cd40f55c0 2022-02-02T19:04:55.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.386+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd410cc10 con 0x7f4cd40f55c0 2022-02-02T19:04:55.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.387+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd40f49b0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.387+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cc801c8e0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.388+0000 7f4cd17fa700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 0x7f4cc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.388+0000 7f4cd3fff700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 0x7f4cc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.388+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4cc80839e0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.388+0000 7f4cd3fff700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 0x7f4cc4067290 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f4cc0004a70 tx=0x7f4cc0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.392+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cc8051a90 con 0x7f4cd40f55c0 2022-02-02T19:04:55.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.623+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4cd40fde50 con 0x7f4cd40f55c0 2022-02-02T19:04:55.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.623+0000 7f4cd17fa700 1 -- 172.21.15.96:0/3712924529 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4cc80550b0 con 0x7f4cd40f55c0 2022-02-02T19:04:55.623 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:04:55.624 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:04:55.624 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:04:55.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:55.624 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:04:55.625 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:04:55.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:55.625 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:04:55.625 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:04:55.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:55.626 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:04:55.626 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:04:55.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:04:55.626 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:04:55.627 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:04:55.627 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:04:55.627 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:04:55.627 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:04:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 msgr2=0x7f4cc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 0x7f4cc4067290 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f4cc0004a70 tx=0x7f4cc0009040).stop 2022-02-02T19:04:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 msgr2=0x7f4cd4109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4cc8004f60 tx=0x7f4cc8009b30).stop 2022-02-02T19:04:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 shutdown_connections 2022-02-02T19:04:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc4064dd0 0x7f4cc4067290 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f55c0 0x7f4cd4109c30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 --2- 172.21.15.96:0/3712924529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f6860 0x7f4cd410c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 >> 172.21.15.96:0/3712924529 conn(0x7f4cd40f0d40 msgr2=0x7f4cd40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 shutdown_connections 2022-02-02T19:04:55.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.625+0000 7f4cdb212700 1 -- 172.21.15.96:0/3712924529 wait complete. 2022-02-02T19:04:55.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 -- 172.21.15.96:0/59393788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f6530 msgr2=0x7f4f880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 --2- 172.21.15.96:0/59393788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f6530 0x7f4f880f6950 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f4f78004660 tx=0x7f4f78009b30).stop 2022-02-02T19:04:55.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 -- 172.21.15.96:0/59393788 shutdown_connections 2022-02-02T19:04:55.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 --2- 172.21.15.96:0/59393788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f77d0 0x7f4f880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 --2- 172.21.15.96:0/59393788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f6530 0x7f4f880f6950 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.722+0000 7f4f8e244700 1 -- 172.21.15.96:0/59393788 >> 172.21.15.96:0/59393788 conn(0x7f4f880f1c90 msgr2=0x7f4f880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 -- 172.21.15.96:0/59393788 shutdown_connections 2022-02-02T19:04:55.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 -- 172.21.15.96:0/59393788 wait complete. 2022-02-02T19:04:55.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 Processor -- start 2022-02-02T19:04:55.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 -- start start 2022-02-02T19:04:55.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f6530 0x7f4f8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8806a380 con 0x7f4f880f77d0 2022-02-02T19:04:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8e244700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8806a4c0 con 0x7f4f880f6530 2022-02-02T19:04:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8ca41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8ca41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57692/0 (socket says 172.21.15.96:57692) 2022-02-02T19:04:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.723+0000 7f4f8ca41700 1 -- 172.21.15.96:0/3735867767 learned_addr learned my addr 172.21.15.96:0/3735867767 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:04:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8d242700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f6530 0x7f4f8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8ca41700 1 -- 172.21.15.96:0/3735867767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f6530 msgr2=0x7f4f8806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8ca41700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f6530 0x7f4f8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8ca41700 1 -- 172.21.15.96:0/3735867767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78005040 con 0x7f4f880f77d0 2022-02-02T19:04:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8ca41700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f4f840026d0 tx=0x7f4f84009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f84009320 con 0x7f4f880f77d0 2022-02-02T19:04:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f8400f040 con 0x7f4f880f77d0 2022-02-02T19:04:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8806a7a0 con 0x7f4f880f77d0 2022-02-02T19:04:55.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f840148f0 con 0x7f4f880f77d0 2022-02-02T19:04:55.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.724+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8810ee00 con 0x7f4f880f77d0 2022-02-02T19:04:55.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.725+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f88045ad0 con 0x7f4f880f77d0 2022-02-02T19:04:55.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.726+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f8401b060 con 0x7f4f880f77d0 2022-02-02T19:04:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.726+0000 7f4f7dffb700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:04:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.726+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f84081050 con 0x7f4f880f77d0 2022-02-02T19:04:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.726+0000 7f4f8d242700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:04:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.727+0000 7f4f8d242700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f4f78009da0 tx=0x7f4f78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:04:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.731+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f84086060 con 0x7f4f880f77d0 2022-02-02T19:04:55.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.930+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f88027a00 con 0x7f4f880f77d0 2022-02-02T19:04:55.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.930+0000 7f4f7dffb700 1 -- 172.21.15.96:0/3735867767 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4f84019070 con 0x7f4f880f77d0 2022-02-02T19:04:55.931 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:04:55.931 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:04:55.931 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:04:55.931 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:04:55.932 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:55.932 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:04:55.932 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:04:55.932 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:04:55.933 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:04:55.933 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:04:55.933 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:04:55.933 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:04:55.933 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:04:55.934 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:04:55.934 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:04:55.934 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:04:55.934 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:04:55.935 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:04:55.935 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:04:55.935 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:04:55.935 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:04:55.935 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:04:55.936 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:04:55.936 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:04:55.936 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:04:55.936 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:04:55.937 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:04:55.937 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:04:55.937 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:04:55.937 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:04:55.938 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:04:55.938 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:04:55.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:55.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:55.938 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:04:55.939 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:04:55.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:55.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:55.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:04:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 msgr2=0x7f4f740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f4f78009da0 tx=0x7f4f78009b30).stop 2022-02-02T19:04:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 msgr2=0x7f4f88069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:04:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f4f840026d0 tx=0x7f4f84009de0).stop 2022-02-02T19:04:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 shutdown_connections 2022-02-02T19:04:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f74064e20 0x7f4f740672e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f880f6530 0x7f4f8806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 --2- 172.21.15.96:0/3735867767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f880f77d0 0x7f4f88069e20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:04:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 >> 172.21.15.96:0/3735867767 conn(0x7f4f880f1c90 msgr2=0x7f4f880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:04:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 shutdown_connections 2022-02-02T19:04:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:04:55.932+0000 7f4f8e244700 1 -- 172.21.15.96:0/3735867767 wait complete. 2022-02-02T19:04:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:04:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:56 smithi159 ceph-mon[69013]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:56 smithi159 ceph-mon[69013]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:56 smithi159 ceph-mon[69013]: pgmap v1284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3712924529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:04:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3735867767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:04:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:56 smithi096 ceph-mon[101353]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:56 smithi096 ceph-mon[101353]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:04:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:56 smithi096 ceph-mon[101353]: pgmap v1284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3712924529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:04:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3735867767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:04:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:04:58 smithi159 ceph-mon[69013]: pgmap v1285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:04:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:04:58 smithi096 ceph-mon[101353]: pgmap v1285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:00 smithi159 ceph-mon[69013]: pgmap v1286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:00 smithi096 ceph-mon[101353]: pgmap v1286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:02 smithi159 ceph-mon[69013]: pgmap v1287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:02 smithi096 ceph-mon[101353]: pgmap v1287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:04 smithi159 ceph-mon[69013]: pgmap v1288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:04 smithi096 ceph-mon[101353]: pgmap v1288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:06 smithi159 ceph-mon[69013]: pgmap v1289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:06 smithi096 ceph-mon[101353]: pgmap v1289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:08 smithi159 ceph-mon[69013]: pgmap v1290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:08 smithi096 ceph-mon[101353]: pgmap v1290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:10 smithi159 ceph-mon[69013]: pgmap v1291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:10 smithi096 ceph-mon[101353]: pgmap v1291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:12 smithi159 ceph-mon[69013]: pgmap v1292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:12 smithi096 ceph-mon[101353]: pgmap v1292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:14 smithi159 ceph-mon[69013]: pgmap v1293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:14 smithi096 ceph-mon[101353]: pgmap v1293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:16 smithi159 ceph-mon[69013]: pgmap v1294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:16 smithi096 ceph-mon[101353]: pgmap v1294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:18 smithi159 ceph-mon[69013]: pgmap v1295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:19.230 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:18 smithi096 ceph-mon[101353]: pgmap v1295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:20 smithi159 ceph-mon[69013]: pgmap v1296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:20 smithi096 ceph-mon[101353]: pgmap v1296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:22 smithi159 ceph-mon[69013]: pgmap v1297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:22 smithi096 ceph-mon[101353]: pgmap v1297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:24 smithi159 ceph-mon[69013]: pgmap v1298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:24 smithi096 ceph-mon[101353]: pgmap v1298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:26.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 -- 172.21.15.96:0/1504114719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f7980 msgr2=0x7fec9c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 --2- 172.21.15.96:0/1504114719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f7980 0x7fec9c0f7de0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fec84004660 tx=0x7fec84009b30).stop 2022-02-02T19:05:26.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 -- 172.21.15.96:0/1504114719 shutdown_connections 2022-02-02T19:05:26.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 --2- 172.21.15.96:0/1504114719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f7980 0x7fec9c0f7de0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 --2- 172.21.15.96:0/1504114719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f66e0 0x7fec9c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.043+0000 7feca0d29700 1 -- 172.21.15.96:0/1504114719 >> 172.21.15.96:0/1504114719 conn(0x7fec9c0f1e40 msgr2=0x7fec9c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 -- 172.21.15.96:0/1504114719 shutdown_connections 2022-02-02T19:05:26.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 -- 172.21.15.96:0/1504114719 wait complete. 2022-02-02T19:05:26.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 Processor -- start 2022-02-02T19:05:26.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 -- start start 2022-02-02T19:05:26.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f7980 0x7fec9c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c06a380 con 0x7fec9c0f66e0 2022-02-02T19:05:26.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7feca0d29700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c06a4c0 con 0x7fec9c0f7980 2022-02-02T19:05:26.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.044+0000 7fec9a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57708/0 (socket says 172.21.15.96:57708) 2022-02-02T19:05:26.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 -- 172.21.15.96:0/3439132570 learned_addr learned my addr 172.21.15.96:0/3439132570 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:26.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec99d9b700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f7980 0x7fec9c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 -- 172.21.15.96:0/3439132570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f7980 msgr2=0x7fec9c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f7980 0x7fec9c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 -- 172.21.15.96:0/3439132570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84005040 con 0x7fec9c0f66e0 2022-02-02T19:05:26.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec9a59c700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fec8c002700 tx=0x7fec8c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8c0079c0 con 0x7fec9c0f66e0 2022-02-02T19:05:26.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c06a7a0 con 0x7fec9c0f66e0 2022-02-02T19:05:26.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec8c00f040 con 0x7fec9c0f66e0 2022-02-02T19:05:26.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8c014860 con 0x7fec9c0f66e0 2022-02-02T19:05:26.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.045+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c10ef90 con 0x7fec9c0f66e0 2022-02-02T19:05:26.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.046+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c045ad0 con 0x7fec9c0f66e0 2022-02-02T19:05:26.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.047+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec8c01b060 con 0x7fec9c0f66e0 2022-02-02T19:05:26.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.047+0000 7fec92ffd700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 0x7fec88067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.047+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fec8c0819f0 con 0x7fec9c0f66e0 2022-02-02T19:05:26.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.047+0000 7fec99d9b700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 0x7fec88067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.048+0000 7fec99d9b700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 0x7fec88067270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fec84004e30 tx=0x7fec84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.051+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec8c04f9e0 con 0x7fec9c0f66e0 2022-02-02T19:05:26.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.229+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec9c057f10 con 0x7fec88064db0 2022-02-02T19:05:26.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.230+0000 7fec92ffd700 1 -- 172.21.15.96:0/3439132570 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fec9c057f10 con 0x7fec88064db0 2022-02-02T19:05:26.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 msgr2=0x7fec88067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 0x7fec88067270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fec84004e30 tx=0x7fec84009b30).stop 2022-02-02T19:05:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 msgr2=0x7fec9c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fec8c002700 tx=0x7fec8c009d80).stop 2022-02-02T19:05:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 shutdown_connections 2022-02-02T19:05:26.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec88064db0 0x7fec88067270 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec9c0f66e0 0x7fec9c06b9a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 --2- 172.21.15.96:0/3439132570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec9c0f7980 0x7fec9c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 >> 172.21.15.96:0/3439132570 conn(0x7fec9c0f1e40 msgr2=0x7fec9c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 shutdown_connections 2022-02-02T19:05:26.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.232+0000 7feca0d29700 1 -- 172.21.15.96:0/3439132570 wait complete. 2022-02-02T19:05:26.242 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:05:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- 172.21.15.96:0/2645770653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f55d0 msgr2=0x7f3f400f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 --2- 172.21.15.96:0/2645770653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f55d0 0x7f3f400f59f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f3f30004660 tx=0x7f3f30009b30).stop 2022-02-02T19:05:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- 172.21.15.96:0/2645770653 shutdown_connections 2022-02-02T19:05:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 --2- 172.21.15.96:0/2645770653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f6870 0x7f3f400f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 --2- 172.21.15.96:0/2645770653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f55d0 0x7f3f400f59f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- 172.21.15.96:0/2645770653 >> 172.21.15.96:0/2645770653 conn(0x7f3f400f0d70 msgr2=0x7f3f400f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- 172.21.15.96:0/2645770653 shutdown_connections 2022-02-02T19:05:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- 172.21.15.96:0/2645770653 wait complete. 2022-02-02T19:05:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 Processor -- start 2022-02-02T19:05:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- start start 2022-02-02T19:05:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 0x7f3f40109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400604a0 con 0x7f3f400f6870 2022-02-02T19:05:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.330+0000 7f3f47907700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400605e0 con 0x7f3f400f55d0 2022-02-02T19:05:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57720/0 (socket says 172.21.15.96:57720) 2022-02-02T19:05:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 -- 172.21.15.96:0/2535311736 learned_addr learned my addr 172.21.15.96:0/2535311736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:26.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f456a3700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 0x7f3f40109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 -- 172.21.15.96:0/2535311736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 msgr2=0x7f3f40109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 0x7f3f40109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 -- 172.21.15.96:0/2535311736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30005040 con 0x7f3f400f6870 2022-02-02T19:05:26.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f456a3700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 0x7f3f40109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:05:26.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f44ea2700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f3f3c00c530 tx=0x7f3f3c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c00f650 con 0x7f3f400f6870 2022-02-02T19:05:26.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f3c00fc60 con 0x7f3f400f6870 2022-02-02T19:05:26.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4010c740 con 0x7f3f400f6870 2022-02-02T19:05:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c012cd0 con 0x7f3f400f6870 2022-02-02T19:05:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.331+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4010ccd0 con 0x7f3f400f6870 2022-02-02T19:05:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.332+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f400f49c0 con 0x7f3f400f6870 2022-02-02T19:05:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.333+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f3c010070 con 0x7f3f400f6870 2022-02-02T19:05:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.333+0000 7f3f35ffb700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 0x7f3f2c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.333+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f3c0817c0 con 0x7f3f400f6870 2022-02-02T19:05:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.333+0000 7f3f456a3700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 0x7f3f2c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.333+0000 7f3f456a3700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 0x7f3f2c067270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f3f40060120 tx=0x7f3f30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.337+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f3c04f870 con 0x7f3f400f6870 2022-02-02T19:05:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.515+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f400fdf10 con 0x7f3f2c064db0 2022-02-02T19:05:26.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.524+0000 7f3f35ffb700 1 -- 172.21.15.96:0/2535311736 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3f400fdf10 con 0x7f3f2c064db0 2022-02-02T19:05:26.525 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:05:26.525 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (48m) 19m ago 49m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:05:26.525 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (41m) 19m ago 49m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:05:26.526 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (41m) 17m ago 49m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:05:26.526 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (48m) 19m ago 49m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:05:26.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (45m) 19m ago 45m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:05:26.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (41m) 19m ago 45m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:05:26.527 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (45m) 17m ago 45m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:05:26.527 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (41m) 17m ago 46m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:05:26.527 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (43m) 19m ago 51m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:05:26.527 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (42m) 17m ago 49m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:05:26.527 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (42m) 19m ago 51m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:05:26.528 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (41m) 17m ago 49m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:05:26.528 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (49m) 19m ago 49m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:05:26.528 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (49m) 17m ago 49m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:05:26.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (40m) 19m ago 48m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:05:26.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (40m) 19m ago 48m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:05:26.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (39m) 19m ago 48m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:05:26.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (39m) 17m ago 47m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:05:26.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (38m) 17m ago 47m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:05:26.530 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (38m) 17m ago 47m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:05:26.530 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (48m) 19m ago 49m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:05:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 msgr2=0x7f3f2c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 0x7f3f2c067270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f3f40060120 tx=0x7f3f30009b30).stop 2022-02-02T19:05:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 msgr2=0x7f3f4010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f3f3c00c530 tx=0x7f3f3c007e20).stop 2022-02-02T19:05:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 shutdown_connections 2022-02-02T19:05:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f2c064db0 0x7f3f2c067270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f400f55d0 0x7f3f40109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 --2- 172.21.15.96:0/2535311736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f400f6870 0x7f3f4010c190 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.526+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 >> 172.21.15.96:0/2535311736 conn(0x7f3f400f0d70 msgr2=0x7f3f400fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.527+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 shutdown_connections 2022-02-02T19:05:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.527+0000 7f3f47907700 1 -- 172.21.15.96:0/2535311736 wait complete. 2022-02-02T19:05:26.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 -- 172.21.15.96:0/1764979735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f6c60 msgr2=0x7fe98c0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 --2- 172.21.15.96:0/1764979735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f6c60 0x7fe98c0f7080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe97c004660 tx=0x7fe97c009b30).stop 2022-02-02T19:05:26.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 -- 172.21.15.96:0/1764979735 shutdown_connections 2022-02-02T19:05:26.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 --2- 172.21.15.96:0/1764979735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f5970 0x7fe98c0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 --2- 172.21.15.96:0/1764979735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f6c60 0x7fe98c0f7080 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 -- 172.21.15.96:0/1764979735 >> 172.21.15.96:0/1764979735 conn(0x7fe98c0f04c0 msgr2=0x7fe98c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 -- 172.21.15.96:0/1764979735 shutdown_connections 2022-02-02T19:05:26.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.623+0000 7fe994420700 1 -- 172.21.15.96:0/1764979735 wait complete. 2022-02-02T19:05:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 Processor -- start 2022-02-02T19:05:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 -- start start 2022-02-02T19:05:26.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f6c60 0x7fe98c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c106950 con 0x7fe98c0f5970 2022-02-02T19:05:26.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe994420700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c106a90 con 0x7fe98c0f6c60 2022-02-02T19:05:26.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9921bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9921bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57728/0 (socket says 172.21.15.96:57728) 2022-02-02T19:05:26.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9921bc700 1 -- 172.21.15.96:0/1667147703 learned_addr learned my addr 172.21.15.96:0/1667147703 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:26.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9919bb700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f6c60 0x7fe98c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9921bc700 1 -- 172.21.15.96:0/1667147703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f6c60 msgr2=0x7fe98c1063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.624+0000 7fe9921bc700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f6c60 0x7fe98c1063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe9921bc700 1 -- 172.21.15.96:0/1667147703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c005040 con 0x7fe98c0f5970 2022-02-02T19:05:26.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe9921bc700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe97c009990 tx=0x7fe97c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c01a070 con 0x7fe98c0f5970 2022-02-02T19:05:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe97c01fab0 con 0x7fe98c0f5970 2022-02-02T19:05:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c1073d0 con 0x7fe98c0f5970 2022-02-02T19:05:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c01e750 con 0x7fe98c0f5970 2022-02-02T19:05:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.625+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c107930 con 0x7fe98c0f5970 2022-02-02T19:05:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.626+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c045ad0 con 0x7fe98c0f5970 2022-02-02T19:05:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.626+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe97c01ea10 con 0x7fe98c0f5970 2022-02-02T19:05:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.627+0000 7fe982ffd700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 0x7fe978067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.627+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe97c085bf0 con 0x7fe98c0f5970 2022-02-02T19:05:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.627+0000 7fe9919bb700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 0x7fe978067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.627+0000 7fe9919bb700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 0x7fe978067290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fe988004c40 tx=0x7fe98800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.631+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe97c057790 con 0x7fe98c0f5970 2022-02-02T19:05:26.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.866+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe98c1080f0 con 0x7fe98c0f5970 2022-02-02T19:05:26.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.867+0000 7fe982ffd700 1 -- 172.21.15.96:0/1667147703 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe97c057380 con 0x7fe98c0f5970 2022-02-02T19:05:26.867 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:05:26.868 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:05:26.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:05:26.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:26.868 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:05:26.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:05:26.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:26.869 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:05:26.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:05:26.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:26.870 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:05:26.870 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:05:26.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:26.870 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:05:26.871 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:05:26.871 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:05:26.871 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:05:26.871 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:05:26.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.868+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 msgr2=0x7fe978067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.868+0000 7fe994420700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 0x7fe978067290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fe988004c40 tx=0x7fe98800b040).stop 2022-02-02T19:05:26.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.868+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 msgr2=0x7fe98c105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.868+0000 7fe994420700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe97c009990 tx=0x7fe97c009b30).stop 2022-02-02T19:05:26.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 shutdown_connections 2022-02-02T19:05:26.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe978064dd0 0x7fe978067290 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0f5970 0x7fe98c105eb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 --2- 172.21.15.96:0/1667147703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe98c0f6c60 0x7fe98c1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 >> 172.21.15.96:0/1667147703 conn(0x7fe98c0f04c0 msgr2=0x7fe98c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 shutdown_connections 2022-02-02T19:05:26.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.869+0000 7fe994420700 1 -- 172.21.15.96:0/1667147703 wait complete. 2022-02-02T19:05:26.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 -- 172.21.15.96:0/980336591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f5430 msgr2=0x7f303c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 --2- 172.21.15.96:0/980336591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f5430 0x7f303c0f5850 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f302c004660 tx=0x7f302c009b30).stop 2022-02-02T19:05:26.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 -- 172.21.15.96:0/980336591 shutdown_connections 2022-02-02T19:05:26.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 --2- 172.21.15.96:0/980336591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f66d0 0x7f303c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 --2- 172.21.15.96:0/980336591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f5430 0x7f303c0f5850 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 -- 172.21.15.96:0/980336591 >> 172.21.15.96:0/980336591 conn(0x7f303c0f0b90 msgr2=0x7f303c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:26.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:26 smithi096 ceph-mon[101353]: pgmap v1299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:26.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 -- 172.21.15.96:0/980336591 shutdown_connections 2022-02-02T19:05:26.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.966+0000 7f30429ac700 1 -- 172.21.15.96:0/980336591 wait complete. 2022-02-02T19:05:26.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 Processor -- start 2022-02-02T19:05:26.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 -- start start 2022-02-02T19:05:26.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f5430 0x7f303c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0f7f70 con 0x7f303c0f66d0 2022-02-02T19:05:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30429ac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0f80b0 con 0x7f303c0f5430 2022-02-02T19:05:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57740/0 (socket says 172.21.15.96:57740) 2022-02-02T19:05:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 -- 172.21.15.96:0/790393564 learned_addr learned my addr 172.21.15.96:0/790393564 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30419aa700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f5430 0x7f303c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 -- 172.21.15.96:0/790393564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f5430 msgr2=0x7f303c0f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f5430 0x7f303c0f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.967+0000 7f30411a9700 1 -- 172.21.15.96:0/790393564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c005040 con 0x7f303c0f66d0 2022-02-02T19:05:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30411a9700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f30380026d0 tx=0x7f3038009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30380079c0 con 0x7f303c0f66d0 2022-02-02T19:05:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0f8390 con 0x7f303c0f66d0 2022-02-02T19:05:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c10edd0 con 0x7f303c0f66d0 2022-02-02T19:05:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f303800f040 con 0x7f303c0f66d0 2022-02-02T19:05:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.968+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30380148b0 con 0x7f303c0f66d0 2022-02-02T19:05:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.969+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c045ad0 con 0x7f303c0f66d0 2022-02-02T19:05:26.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.970+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3038007b20 con 0x7f303c0f66d0 2022-02-02T19:05:26.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.970+0000 7f30327fc700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 0x7f30280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:26.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.970+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3038081910 con 0x7f303c0f66d0 2022-02-02T19:05:26.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.970+0000 7f30419aa700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 0x7f30280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.971+0000 7f30419aa700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 0x7f30280672e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f302c013690 tx=0x7f302c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:26.974+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f303804f9c0 con 0x7f303c0f66d0 2022-02-02T19:05:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:26 smithi159 ceph-mon[69013]: pgmap v1299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:27.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.175+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f303c0fdbf0 con 0x7f303c0f66d0 2022-02-02T19:05:27.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.176+0000 7f30327fc700 1 -- 172.21.15.96:0/790393564 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3038052fe0 con 0x7f303c0f66d0 2022-02-02T19:05:27.177 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:05:27.177 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:05:27.178 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:05:27.178 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:05:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:27.178 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:05:27.179 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:05:27.179 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:05:27.179 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:05:27.179 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:05:27.179 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:05:27.180 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:05:27.180 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:05:27.180 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:05:27.180 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:05:27.181 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:05:27.181 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:05:27.181 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:05:27.181 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:05:27.182 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:05:27.182 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:05:27.182 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:05:27.182 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:05:27.183 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:05:27.183 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:05:27.183 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:05:27.183 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:05:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:05:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:05:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:05:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:05:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:05:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:27.185 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:05:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:27.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:27.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:27.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:27.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 msgr2=0x7f30280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:27.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 0x7f30280672e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f302c013690 tx=0x7f302c009b30).stop 2022-02-02T19:05:27.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 msgr2=0x7f303c0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f30380026d0 tx=0x7f3038009de0).stop 2022-02-02T19:05:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 shutdown_connections 2022-02-02T19:05:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064e20 0x7f30280672e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f303c0f5430 0x7f303c0f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 --2- 172.21.15.96:0/790393564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f303c0f66d0 0x7f303c0f7a10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 >> 172.21.15.96:0/790393564 conn(0x7f303c0f0b90 msgr2=0x7f303c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 shutdown_connections 2022-02-02T19:05:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:27.178+0000 7f30429ac700 1 -- 172.21.15.96:0/790393564 wait complete. 2022-02-02T19:05:27.190 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:05:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1667147703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:05:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:05:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:05:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/790393564' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:05:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1667147703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:05:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:05:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:05:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/790393564' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:05:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:28 smithi159 ceph-mon[69013]: pgmap v1300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:28 smithi096 ceph-mon[101353]: pgmap v1300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:30 smithi159 ceph-mon[69013]: pgmap v1301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:30 smithi096 ceph-mon[101353]: pgmap v1301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:32 smithi159 ceph-mon[69013]: pgmap v1302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:32 smithi096 ceph-mon[101353]: pgmap v1302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:34 smithi159 ceph-mon[69013]: pgmap v1303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:34 smithi096 ceph-mon[101353]: pgmap v1303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:36 smithi159 ceph-mon[69013]: pgmap v1304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:36 smithi096 ceph-mon[101353]: pgmap v1304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:38 smithi159 ceph-mon[69013]: pgmap v1305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:38 smithi096 ceph-mon[101353]: pgmap v1305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:40 smithi159 ceph-mon[69013]: pgmap v1306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:40 smithi096 ceph-mon[101353]: pgmap v1306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:42 smithi159 ceph-mon[69013]: pgmap v1307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:42 smithi096 ceph-mon[101353]: pgmap v1307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:44 smithi159 ceph-mon[69013]: pgmap v1308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:44 smithi096 ceph-mon[101353]: pgmap v1308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:46 smithi159 ceph-mon[69013]: pgmap v1309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:46 smithi096 ceph-mon[101353]: pgmap v1309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:48 smithi159 ceph-mon[69013]: pgmap v1310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:48 smithi096 ceph-mon[101353]: pgmap v1310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:50 smithi159 ceph-mon[69013]: pgmap v1311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:50 smithi096 ceph-mon[101353]: pgmap v1311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:52 smithi159 ceph-mon[69013]: pgmap v1312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:52 smithi096 ceph-mon[101353]: pgmap v1312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:54 smithi159 ceph-mon[69013]: pgmap v1313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:54 smithi096 ceph-mon[101353]: pgmap v1313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:56 smithi159 ceph-mon[69013]: pgmap v1314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:56 smithi096 ceph-mon[101353]: pgmap v1314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:57.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- 172.21.15.96:0/2199895979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 msgr2=0x7fd2b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 --2- 172.21.15.96:0/2199895979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b40f6cc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fd2a4004660 tx=0x7fd2a4009b30).stop 2022-02-02T19:05:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- 172.21.15.96:0/2199895979 shutdown_connections 2022-02-02T19:05:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 --2- 172.21.15.96:0/2199895979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b40f6cc0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 --2- 172.21.15.96:0/2199895979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- 172.21.15.96:0/2199895979 >> 172.21.15.96:0/2199895979 conn(0x7fd2b40f0d40 msgr2=0x7fd2b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- 172.21.15.96:0/2199895979 shutdown_connections 2022-02-02T19:05:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- 172.21.15.96:0/2199895979 wait complete. 2022-02-02T19:05:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 Processor -- start 2022-02-02T19:05:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.285+0000 7fd2b8891700 1 -- start start 2022-02-02T19:05:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40602b0 con 0x7fd2b40f6860 2022-02-02T19:05:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40603f0 con 0x7fd2b40f55c0 2022-02-02T19:05:57.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57762/0 (socket says 172.21.15.96:57762) 2022-02-02T19:05:57.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 -- 172.21.15.96:0/3214015094 learned_addr learned my addr 172.21.15.96:0/3214015094 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:57.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b259c700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 -- 172.21.15.96:0/3214015094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 msgr2=0x7fd2b410c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b410c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 -- 172.21.15.96:0/3214015094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4005040 con 0x7fd2b40f6860 2022-02-02T19:05:57.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b259c700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:05:57.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b1d9b700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd2a4009990 tx=0x7fd2a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a4018070 con 0x7fd2b40f6860 2022-02-02T19:05:57.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b410ea60 con 0x7fd2b40f6860 2022-02-02T19:05:57.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd2a4007ba0 con 0x7fd2b40f6860 2022-02-02T19:05:57.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a401c3c0 con 0x7fd2b40f6860 2022-02-02T19:05:57.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.286+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b410ee30 con 0x7fd2b40f6860 2022-02-02T19:05:57.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.287+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4045ad0 con 0x7fd2b40f6860 2022-02-02T19:05:57.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.288+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd2a401d420 con 0x7fd2b40f6860 2022-02-02T19:05:57.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.288+0000 7fd2a2ffd700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 0x7fd29c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.288+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd2a4083770 con 0x7fd2b40f6860 2022-02-02T19:05:57.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.288+0000 7fd2b259c700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 0x7fd29c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.289+0000 7fd2b259c700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 0x7fd29c067290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fd2b4060040 tx=0x7fd2a8009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.292+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd2a4051880 con 0x7fd2b40f6860 2022-02-02T19:05:57.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.470+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b4057f10 con 0x7fd29c064dd0 2022-02-02T19:05:57.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.471+0000 7fd2a2ffd700 1 -- 172.21.15.96:0/3214015094 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd2b4057f10 con 0x7fd29c064dd0 2022-02-02T19:05:57.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 msgr2=0x7fd29c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 0x7fd29c067290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fd2b4060040 tx=0x7fd2a8009c00).stop 2022-02-02T19:05:57.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 msgr2=0x7fd2b410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd2a4009990 tx=0x7fd2a4009b30).stop 2022-02-02T19:05:57.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 shutdown_connections 2022-02-02T19:05:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd29c064dd0 0x7fd29c067290 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f55c0 0x7fd2b410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 --2- 172.21.15.96:0/3214015094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6860 0x7fd2b410e570 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 >> 172.21.15.96:0/3214015094 conn(0x7fd2b40f0d40 msgr2=0x7fd2b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:57.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 shutdown_connections 2022-02-02T19:05:57.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.474+0000 7fd2b8891700 1 -- 172.21.15.96:0/3214015094 wait complete. 2022-02-02T19:05:57.484 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:05:57.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 -- 172.21.15.96:0/2685197019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 msgr2=0x7faadc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 --2- 172.21.15.96:0/2685197019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc0f6b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7faacc004660 tx=0x7faacc009b30).stop 2022-02-02T19:05:57.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 -- 172.21.15.96:0/2685197019 shutdown_connections 2022-02-02T19:05:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 --2- 172.21.15.96:0/2685197019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 --2- 172.21.15.96:0/2685197019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc0f6b00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 -- 172.21.15.96:0/2685197019 >> 172.21.15.96:0/2685197019 conn(0x7faadc0f1e40 msgr2=0x7faadc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 -- 172.21.15.96:0/2685197019 shutdown_connections 2022-02-02T19:05:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.570+0000 7faae363a700 1 -- 172.21.15.96:0/2685197019 wait complete. 2022-02-02T19:05:57.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 Processor -- start 2022-02-02T19:05:57.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 -- start start 2022-02-02T19:05:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc109c40 con 0x7faadc0f66e0 2022-02-02T19:05:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae363a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc109d80 con 0x7faadc0f7980 2022-02-02T19:05:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57770/0 (socket says 172.21.15.96:57770) 2022-02-02T19:05:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 -- 172.21.15.96:0/1405501404 learned_addr learned my addr 172.21.15.96:0/1405501404 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae0bd5700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 -- 172.21.15.96:0/1405501404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 msgr2=0x7faadc109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae13d6700 1 -- 172.21.15.96:0/1405501404 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc005040 con 0x7faadc0f66e0 2022-02-02T19:05:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.571+0000 7faae0bd5700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:05:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faae13d6700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7faacc004f60 tx=0x7faacc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faacc018070 con 0x7faadc0f66e0 2022-02-02T19:05:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faacc007ba0 con 0x7faadc0f66e0 2022-02-02T19:05:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc10a6c0 con 0x7faadc0f66e0 2022-02-02T19:05:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faacc01c620 con 0x7faadc0f66e0 2022-02-02T19:05:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.572+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc10ac20 con 0x7faadc0f66e0 2022-02-02T19:05:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.573+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc045ad0 con 0x7faadc0f66e0 2022-02-02T19:05:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.573+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faacc01d420 con 0x7faadc0f66e0 2022-02-02T19:05:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.574+0000 7faad1ffb700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 0x7faac8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.574+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faacc0838e0 con 0x7faadc0f66e0 2022-02-02T19:05:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.574+0000 7faae0bd5700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 0x7faac8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.574+0000 7faae0bd5700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 0x7faac8067290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7faad80041d0 tx=0x7faad8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.578+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faacc055480 con 0x7faadc0f66e0 2022-02-02T19:05:57.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.752+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faadc0fefe0 con 0x7faac8064dd0 2022-02-02T19:05:57.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.761+0000 7faad1ffb700 1 -- 172.21.15.96:0/1405501404 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faadc0fefe0 con 0x7faac8064dd0 2022-02-02T19:05:57.763 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:05:57.763 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (49m) 19m ago 50m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:05:57.763 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (41m) 19m ago 50m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:05:57.763 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (41m) 18m ago 49m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:05:57.764 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (49m) 19m ago 50m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:05:57.764 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (46m) 19m ago 46m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:05:57.764 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (42m) 19m ago 46m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:05:57.764 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (46m) 18m ago 46m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:05:57.765 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (42m) 18m ago 46m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:05:57.765 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (43m) 19m ago 51m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:05:57.765 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (43m) 18m ago 49m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:05:57.765 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (42m) 19m ago 51m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:05:57.766 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (42m) 18m ago 49m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:05:57.766 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (50m) 19m ago 50m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:05:57.766 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (49m) 18m ago 49m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:05:57.766 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (41m) 19m ago 49m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:05:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (40m) 19m ago 48m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:05:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (40m) 19m ago 48m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:05:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (39m) 18m ago 48m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:05:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (39m) 18m ago 48m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:05:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (38m) 18m ago 47m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:05:57.768 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (49m) 19m ago 50m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:05:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 msgr2=0x7faac8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 0x7faac8067290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7faad80041d0 tx=0x7faad8009040).stop 2022-02-02T19:05:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 msgr2=0x7faadc1091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7faacc004f60 tx=0x7faacc009b30).stop 2022-02-02T19:05:57.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 shutdown_connections 2022-02-02T19:05:57.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac8064dd0 0x7faac8067290 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f66e0 0x7faadc1091a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 --2- 172.21.15.96:0/1405501404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f7980 0x7faadc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 >> 172.21.15.96:0/1405501404 conn(0x7faadc0f1e40 msgr2=0x7faadc0f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 shutdown_connections 2022-02-02T19:05:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.764+0000 7faae363a700 1 -- 172.21.15.96:0/1405501404 wait complete. 2022-02-02T19:05:57.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/1046096968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 msgr2=0x7fbdac0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/1046096968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac0f9340 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fbda0004660 tx=0x7fbda0009b30).stop 2022-02-02T19:05:57.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/1046096968 shutdown_connections 2022-02-02T19:05:57.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/1046096968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 0x7fbdac0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/1046096968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac0f9340 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/1046096968 >> 172.21.15.96:0/1046096968 conn(0x7fbdac0f0d40 msgr2=0x7fbdac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/1046096968 shutdown_connections 2022-02-02T19:05:57.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.861+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/1046096968 wait complete. 2022-02-02T19:05:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.862+0000 7fbdb2cfd700 1 Processor -- start 2022-02-02T19:05:57.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.862+0000 7fbdb2cfd700 1 -- start start 2022-02-02T19:05:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.862+0000 7fbdb2cfd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb2cfd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 0x7fbdac107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb2cfd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac107a00 con 0x7fbdac060270 2022-02-02T19:05:57.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb2cfd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac107b40 con 0x7fbdac0f9830 2022-02-02T19:05:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57782/0 (socket says 172.21.15.96:57782) 2022-02-02T19:05:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 -- 172.21.15.96:0/2679769834 learned_addr learned my addr 172.21.15.96:0/2679769834 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdabfff700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 0x7fbdac107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 -- 172.21.15.96:0/2679769834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 msgr2=0x7fbdac107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 0x7fbdac107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 -- 172.21.15.96:0/2679769834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0005040 con 0x7fbdac060270 2022-02-02T19:05:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb0a99700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fbda0009990 tx=0x7fbda0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda0018070 con 0x7fbdac060270 2022-02-02T19:05:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbda0007ba0 con 0x7fbdac060270 2022-02-02T19:05:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac108480 con 0x7fbdac060270 2022-02-02T19:05:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.863+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda001c3c0 con 0x7fbdac060270 2022-02-02T19:05:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.864+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac1089e0 con 0x7fbdac060270 2022-02-02T19:05:57.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.865+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac045ad0 con 0x7fbdac060270 2022-02-02T19:05:57.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.865+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbda001d420 con 0x7fbdac060270 2022-02-02T19:05:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.865+0000 7fbda97fa700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 0x7fbd9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.865+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbda0083730 con 0x7fbdac060270 2022-02-02T19:05:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.866+0000 7fbdabfff700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 0x7fbd9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:57.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.866+0000 7fbdabfff700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 0x7fbd9c067290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fbdac060040 tx=0x7fbd9800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:57.871+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbda00552d0 con 0x7fbdac060270 2022-02-02T19:05:58.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.098+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdac0fefc0 con 0x7fbdac060270 2022-02-02T19:05:58.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.099+0000 7fbda97fa700 1 -- 172.21.15.96:0/2679769834 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbda0054ec0 con 0x7fbdac060270 2022-02-02T19:05:58.100 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:05:58.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:05:58.101 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:05:58.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:58.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:05:58.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:05:58.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:58.102 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:05:58.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:05:58.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:58.103 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:05:58.103 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:05:58.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:05:58.103 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:05:58.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:05:58.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:05:58.104 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:05:58.104 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:05:58.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 msgr2=0x7fbd9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 0x7fbd9c067290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fbdac060040 tx=0x7fbd9800b040).stop 2022-02-02T19:05:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 msgr2=0x7fbdac106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fbda0009990 tx=0x7fbda0009b30).stop 2022-02-02T19:05:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 shutdown_connections 2022-02-02T19:05:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd9c064dd0 0x7fbd9c067290 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdac060270 0x7fbdac106f60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 --2- 172.21.15.96:0/2679769834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdac0f9830 0x7fbdac107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 >> 172.21.15.96:0/2679769834 conn(0x7fbdac0f0d40 msgr2=0x7fbdac0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 shutdown_connections 2022-02-02T19:05:58.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.100+0000 7fbdb2cfd700 1 -- 172.21.15.96:0/2679769834 wait complete. 2022-02-02T19:05:58.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 -- 172.21.15.96:0/4001391124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 msgr2=0x7f97e40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 --2- 172.21.15.96:0/4001391124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e40f6b40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f97d0004660 tx=0x7f97d0009b30).stop 2022-02-02T19:05:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 -- 172.21.15.96:0/4001391124 shutdown_connections 2022-02-02T19:05:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 --2- 172.21.15.96:0/4001391124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e40f6b40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 --2- 172.21.15.96:0/4001391124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:05:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 -- 172.21.15.96:0/4001391124 >> 172.21.15.96:0/4001391124 conn(0x7f97e40f0ba0 msgr2=0x7f97e40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 -- 172.21.15.96:0/4001391124 shutdown_connections 2022-02-02T19:05:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.197+0000 7f97e9bac700 1 -- 172.21.15.96:0/4001391124 wait complete. 2022-02-02T19:05:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.198+0000 7f97e9bac700 1 Processor -- start 2022-02-02T19:05:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.198+0000 7f97e9bac700 1 -- start start 2022-02-02T19:05:58.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e9bac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e4104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:58.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e9bac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:58.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e9bac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41056a0 con 0x7f97e40f66e0 2022-02-02T19:05:58.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e9bac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4105f50 con 0x7f97e40f5440 2022-02-02T19:05:58.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:58.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57792/0 (socket says 172.21.15.96:57792) 2022-02-02T19:05:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e3fff700 1 -- 172.21.15.96:0/2505485515 learned_addr learned my addr 172.21.15.96:0/2505485515 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:05:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.200+0000 7f97e8baa700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e4104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e8baa700 1 -- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 msgr2=0x7f97e4105010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e8baa700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e8baa700 1 -- 172.21.15.96:0/2505485515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0005040 con 0x7f97e40f5440 2022-02-02T19:05:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e3fff700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:05:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e8baa700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e4104b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f97e40f6540 tx=0x7f97d8006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d8013640 con 0x7f97e40f5440 2022-02-02T19:05:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4106200 con 0x7f97e40f5440 2022-02-02T19:05:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97d8013c50 con 0x7f97e40f5440 2022-02-02T19:05:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d8012be0 con 0x7f97e40f5440 2022-02-02T19:05:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.201+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e41067c0 con 0x7f97e40f5440 2022-02-02T19:05:58.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.202+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4059100 con 0x7f97e40f5440 2022-02-02T19:05:58.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.203+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f97d801a060 con 0x7f97e40f5440 2022-02-02T19:05:58.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.203+0000 7f97e17fa700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 0x7f97d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:05:58.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.203+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f97d8081a20 con 0x7f97e40f5440 2022-02-02T19:05:58.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.203+0000 7f97e3fff700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 0x7f97d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:05:58.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.203+0000 7f97e3fff700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 0x7f97d40672e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f97d0005010 tx=0x7f97d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:05:58.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.209+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f97d804fad0 con 0x7f97e40f5440 2022-02-02T19:05:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.409+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f97e41091a0 con 0x7f97e40f5440 2022-02-02T19:05:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.411+0000 7f97e17fa700 1 -- 172.21.15.96:0/2505485515 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f97d8018070 con 0x7f97e40f5440 2022-02-02T19:05:58.412 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:05:58.412 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:05:58.412 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:05:58.413 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:05:58.413 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:58.413 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:05:58.413 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:05:58.414 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:05:58.414 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:05:58.414 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:05:58.414 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:05:58.415 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:05:58.415 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:05:58.415 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:05:58.415 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:05:58.416 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:05:58.416 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:05:58.416 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:05:58.416 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:05:58.416 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:05:58.417 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:05:58.417 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:05:58.417 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:05:58.417 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:05:58.418 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:05:58.418 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:05:58.418 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:05:58.419 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:05:58.419 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:05:58.419 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:05:58.419 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:05:58.419 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:05:58.420 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:58.420 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:58.420 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:05:58.420 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:05:58.421 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:58.421 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:58.421 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:05:58.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 msgr2=0x7f97d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 0x7f97d40672e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f97d0005010 tx=0x7f97d0009b30).stop 2022-02-02T19:05:58.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 msgr2=0x7f97e4104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:05:58.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e4104b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f97e40f6540 tx=0x7f97d8006e30).stop 2022-02-02T19:05:58.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 shutdown_connections 2022-02-02T19:05:58.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97d4064e20 0x7f97d40672e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97e40f5440 0x7f97e4104b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 --2- 172.21.15.96:0/2505485515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97e40f66e0 0x7f97e4105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:05:58.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.414+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 >> 172.21.15.96:0/2505485515 conn(0x7f97e40f0ba0 msgr2=0x7f97e405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:05:58.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.415+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 shutdown_connections 2022-02-02T19:05:58.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:05:58.415+0000 7f97e9bac700 1 -- 172.21.15.96:0/2505485515 wait complete. 2022-02-02T19:05:58.425 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:05:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:58 smithi159 ceph-mon[69013]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:58 smithi159 ceph-mon[69013]: pgmap v1315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:58 smithi159 ceph-mon[69013]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2679769834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:05:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:05:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2505485515' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:05:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:58 smithi096 ceph-mon[101353]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:58 smithi096 ceph-mon[101353]: pgmap v1315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:05:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:58 smithi096 ceph-mon[101353]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:05:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2679769834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:05:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:05:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2505485515' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:06:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:00 smithi159 ceph-mon[69013]: pgmap v1316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:00 smithi096 ceph-mon[101353]: pgmap v1316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:02 smithi159 ceph-mon[69013]: pgmap v1317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:02 smithi096 ceph-mon[101353]: pgmap v1317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:04 smithi159 ceph-mon[69013]: pgmap v1318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:04 smithi096 ceph-mon[101353]: pgmap v1318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:06 smithi159 ceph-mon[69013]: pgmap v1319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:06 smithi096 ceph-mon[101353]: pgmap v1319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:08 smithi159 ceph-mon[69013]: pgmap v1320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:08 smithi096 ceph-mon[101353]: pgmap v1320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:10 smithi159 ceph-mon[69013]: pgmap v1321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:10 smithi096 ceph-mon[101353]: pgmap v1321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:12 smithi159 ceph-mon[69013]: pgmap v1322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:12 smithi096 ceph-mon[101353]: pgmap v1322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:14 smithi159 ceph-mon[69013]: pgmap v1323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:14 smithi096 ceph-mon[101353]: pgmap v1323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:16 smithi159 ceph-mon[69013]: pgmap v1324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:16 smithi096 ceph-mon[101353]: pgmap v1324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:18 smithi159 ceph-mon[69013]: pgmap v1325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:18 smithi096 ceph-mon[101353]: pgmap v1325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:20 smithi159 ceph-mon[69013]: pgmap v1326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:20 smithi096 ceph-mon[101353]: pgmap v1326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:22 smithi159 ceph-mon[69013]: pgmap v1327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:22 smithi096 ceph-mon[101353]: pgmap v1327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:24 smithi096 ceph-mon[101353]: pgmap v1328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:24 smithi159 ceph-mon[69013]: pgmap v1328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:26 smithi096 ceph-mon[101353]: pgmap v1329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:26 smithi159 ceph-mon[69013]: pgmap v1329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:06:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:06:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:06:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:06:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/2686647672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f5430 msgr2=0x7f7c140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/2686647672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f5430 0x7f7c140f5850 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f7c10004660 tx=0x7f7c10009b30).stop 2022-02-02T19:06:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/2686647672 shutdown_connections 2022-02-02T19:06:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/2686647672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f66d0 0x7f7c140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:06:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/2686647672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f5430 0x7f7c140f5850 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.524+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/2686647672 >> 172.21.15.96:0/2686647672 conn(0x7f7c140f0b90 msgr2=0x7f7c140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:28.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.525+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/2686647672 shutdown_connections 2022-02-02T19:06:28.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.525+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/2686647672 wait complete. 2022-02-02T19:06:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.525+0000 7f7c1a1cd700 1 Processor -- start 2022-02-02T19:06:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.525+0000 7f7c1a1cd700 1 -- start start 2022-02-02T19:06:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c1a1cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f5430 0x7f7c14109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c1a1cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c1a1cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140604b0 con 0x7f7c140f66d0 2022-02-02T19:06:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c1a1cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140605f0 con 0x7f7c140f5430 2022-02-02T19:06:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c191cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f5430 0x7f7c14109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57810/0 (socket says 172.21.15.96:57810) 2022-02-02T19:06:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 -- 172.21.15.96:0/628061707 learned_addr learned my addr 172.21.15.96:0/628061707 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:06:28.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 -- 172.21.15.96:0/628061707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f5430 msgr2=0x7f7c14109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f5430 0x7f7c14109a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 -- 172.21.15.96:0/628061707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10005040 con 0x7f7c140f66d0 2022-02-02T19:06:28.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.526+0000 7f7c189ca700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7c0400b410 tx=0x7f7c04006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:28.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.527+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c040125f0 con 0x7f7c140f66d0 2022-02-02T19:06:28.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.527+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1410c5d0 con 0x7f7c140f66d0 2022-02-02T19:06:28.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.527+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c0400be30 con 0x7f7c140f66d0 2022-02-02T19:06:28.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.527+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c04002a70 con 0x7f7c140f66d0 2022-02-02T19:06:28.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.527+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1410cb90 con 0x7f7c140f66d0 2022-02-02T19:06:28.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.528+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14045ad0 con 0x7f7c140f66d0 2022-02-02T19:06:28.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.529+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c0400f030 con 0x7f7c140f66d0 2022-02-02T19:06:28.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.529+0000 7f7c09ffb700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 0x7f7c000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.529+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7c04081ed0 con 0x7f7c140f66d0 2022-02-02T19:06:28.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.529+0000 7f7c191cb700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 0x7f7c000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.530+0000 7f7c191cb700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 0x7f7c000672e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7c10013690 tx=0x7f7c10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:28.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.534+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c0404ff80 con 0x7f7c140f66d0 2022-02-02T19:06:28.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.710+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c140fde20 con 0x7f7c00064e20 2022-02-02T19:06:28.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.712+0000 7f7c09ffb700 1 -- 172.21.15.96:0/628061707 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7c10019040 con 0x7f7c00064e20 2022-02-02T19:06:28.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 msgr2=0x7f7c000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 0x7f7c000672e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7c10013690 tx=0x7f7c10009b30).stop 2022-02-02T19:06:28.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 msgr2=0x7f7c1410bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7c0400b410 tx=0x7f7c04006ef0).stop 2022-02-02T19:06:28.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 shutdown_connections 2022-02-02T19:06:28.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c00064e20 0x7f7c000672e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c140f5430 0x7f7c14109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 --2- 172.21.15.96:0/628061707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c140f66d0 0x7f7c1410bf70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.713+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 >> 172.21.15.96:0/628061707 conn(0x7f7c140f0b90 msgr2=0x7f7c140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:28.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.714+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 shutdown_connections 2022-02-02T19:06:28.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.714+0000 7f7c1a1cd700 1 -- 172.21.15.96:0/628061707 wait complete. 2022-02-02T19:06:28.725 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:06:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/1006451005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 msgr2=0x7fd1a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/1006451005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a00f6cc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fd190004660 tx=0x7fd190009b30).stop 2022-02-02T19:06:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/1006451005 shutdown_connections 2022-02-02T19:06:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/1006451005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a00f6cc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/1006451005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 0x7fd1a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/1006451005 >> 172.21.15.96:0/1006451005 conn(0x7fd1a00f0d40 msgr2=0x7fd1a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/1006451005 shutdown_connections 2022-02-02T19:06:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/1006451005 wait complete. 2022-02-02T19:06:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 Processor -- start 2022-02-02T19:06:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.813+0000 7fd1a4c0c700 1 -- start start 2022-02-02T19:06:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 0x7fd1a0109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0109c20 con 0x7fd1a00f6860 2022-02-02T19:06:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0109d60 con 0x7fd1a00f55c0 2022-02-02T19:06:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57820/0 (socket says 172.21.15.96:57820) 2022-02-02T19:06:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 -- 172.21.15.96:0/2288809525 learned_addr learned my addr 172.21.15.96:0/2288809525 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:06:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19e59c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 0x7fd1a0109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 -- 172.21.15.96:0/2288809525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 msgr2=0x7fd1a0109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 0x7fd1a0109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 -- 172.21.15.96:0/2288809525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190005040 con 0x7fd1a00f6860 2022-02-02T19:06:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd19dd9b700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd190009990 tx=0x7fd190009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd190018070 con 0x7fd1a00f6860 2022-02-02T19:06:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd190007ca0 con 0x7fd1a00f6860 2022-02-02T19:06:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd19001c620 con 0x7fd1a00f6860 2022-02-02T19:06:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a010a6a0 con 0x7fd1a00f6860 2022-02-02T19:06:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.814+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a010ac00 con 0x7fd1a00f6860 2022-02-02T19:06:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.815+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0045ad0 con 0x7fd1a00f6860 2022-02-02T19:06:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.816+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd19001d960 con 0x7fd1a00f6860 2022-02-02T19:06:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.816+0000 7fd18effd700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 0x7fd188067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.816+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd190083750 con 0x7fd1a00f6860 2022-02-02T19:06:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.816+0000 7fd19e59c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 0x7fd188067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.817+0000 7fd19e59c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 0x7fd188067290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd1a00f66c0 tx=0x7fd194009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.820+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd190055230 con 0x7fd1a00f6860 2022-02-02T19:06:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:28.991+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a00faaa0 con 0x7fd188064dd0 2022-02-02T19:06:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.000+0000 7fd18effd700 1 -- 172.21.15.96:0/2288809525 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd1a00faaa0 con 0x7fd188064dd0 2022-02-02T19:06:29.002 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:06:29.003 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (49m) 20m ago 50m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:06:29.003 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (42m) 20m ago 50m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:06:29.003 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (42m) 18m ago 50m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:06:29.003 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (49m) 20m ago 50m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:06:29.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (46m) 20m ago 46m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:06:29.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (42m) 20m ago 47m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:06:29.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (47m) 18m ago 46m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:06:29.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (42m) 18m ago 47m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:06:29.004 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (44m) 20m ago 52m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:06:29.005 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (43m) 18m ago 50m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:06:29.005 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (43m) 20m ago 52m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:06:29.005 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (42m) 18m ago 50m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:06:29.005 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (50m) 20m ago 50m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:06:29.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (50m) 18m ago 50m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:06:29.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (41m) 20m ago 49m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:06:29.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (41m) 20m ago 49m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:06:29.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (40m) 20m ago 49m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:06:29.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (40m) 18m ago 48m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:06:29.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (39m) 18m ago 48m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:06:29.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (39m) 18m ago 48m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:06:29.007 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (49m) 20m ago 50m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:06:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 msgr2=0x7fd188067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 0x7fd188067290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd1a00f66c0 tx=0x7fd194009040).stop 2022-02-02T19:06:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 msgr2=0x7fd1a0109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd190009990 tx=0x7fd190009b30).stop 2022-02-02T19:06:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 shutdown_connections 2022-02-02T19:06:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd188064dd0 0x7fd188067290 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a00f55c0 0x7fd1a0109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 --2- 172.21.15.96:0/2288809525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1a00f6860 0x7fd1a0109670 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.002+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 >> 172.21.15.96:0/2288809525 conn(0x7fd1a00f0d40 msgr2=0x7fd1a005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.003+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 shutdown_connections 2022-02-02T19:06:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.003+0000 7fd1a4c0c700 1 -- 172.21.15.96:0/2288809525 wait complete. 2022-02-02T19:06:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:28 smithi096 ceph-mon[101353]: pgmap v1330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:29.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 -- 172.21.15.96:0/1129736880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 msgr2=0x7f744c0f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 --2- 172.21.15.96:0/1129736880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c0f5180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f7440004660 tx=0x7f7440009b30).stop 2022-02-02T19:06:29.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 -- 172.21.15.96:0/1129736880 shutdown_connections 2022-02-02T19:06:29.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 --2- 172.21.15.96:0/1129736880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 0x7f744c0f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 --2- 172.21.15.96:0/1129736880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c0f5180 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 -- 172.21.15.96:0/1129736880 >> 172.21.15.96:0/1129736880 conn(0x7f744c0f04c0 msgr2=0x7f744c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:29.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 -- 172.21.15.96:0/1129736880 shutdown_connections 2022-02-02T19:06:29.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.100+0000 7f7451588700 1 -- 172.21.15.96:0/1129736880 wait complete. 2022-02-02T19:06:29.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 Processor -- start 2022-02-02T19:06:29.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 -- start start 2022-02-02T19:06:29.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 0x7f744c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1079b0 con 0x7f744c0f4d60 2022-02-02T19:06:29.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c107af0 con 0x7f744c0f5f60 2022-02-02T19:06:29.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57828/0 (socket says 172.21.15.96:57828) 2022-02-02T19:06:29.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 -- 172.21.15.96:0/4072503330 learned_addr learned my addr 172.21.15.96:0/4072503330 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:06:29.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744a7fc700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 0x7f744c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 -- 172.21.15.96:0/4072503330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 msgr2=0x7f744c107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 0x7f744c107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 -- 172.21.15.96:0/4072503330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440005040 con 0x7f744c0f4d60 2022-02-02T19:06:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f744affd700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7440009990 tx=0x7f7440009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7440018070 con 0x7f744c0f4d60 2022-02-02T19:06:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c108430 con 0x7f744c0f4d60 2022-02-02T19:06:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.101+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7440007ba0 con 0x7f744c0f4d60 2022-02-02T19:06:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.102+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f744001c3c0 con 0x7f744c0f4d60 2022-02-02T19:06:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.102+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c108990 con 0x7f744c0f4d60 2022-02-02T19:06:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.102+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c045ad0 con 0x7f744c0f4d60 2022-02-02T19:06:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.103+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f744001d420 con 0x7f744c0f4d60 2022-02-02T19:06:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.103+0000 7f74337fe700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 0x7f7434067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.103+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f74400837b0 con 0x7f744c0f4d60 2022-02-02T19:06:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.103+0000 7f744a7fc700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 0x7f7434067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.104+0000 7f744a7fc700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 0x7f7434067290 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f743c004a70 tx=0x7f743c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.108+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7440055230 con 0x7f744c0f4d60 2022-02-02T19:06:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:28 smithi159 ceph-mon[69013]: pgmap v1330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.340+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f744c027a00 con 0x7f744c0f4d60 2022-02-02T19:06:29.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.341+0000 7f74337fe700 1 -- 172.21.15.96:0/4072503330 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7440054e20 con 0x7f744c0f4d60 2022-02-02T19:06:29.343 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:06:29.344 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:06:29.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:06:29.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:06:29.344 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:06:29.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:06:29.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:06:29.345 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:06:29.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:06:29.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:06:29.346 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:06:29.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:06:29.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:06:29.346 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:06:29.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:06:29.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:06:29.347 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:06:29.347 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:06:29.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 msgr2=0x7f7434067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 0x7f7434067290 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f743c004a70 tx=0x7f743c00b040).stop 2022-02-02T19:06:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 msgr2=0x7f744c106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7440009990 tx=0x7f7440009b30).stop 2022-02-02T19:06:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 shutdown_connections 2022-02-02T19:06:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7434064dd0 0x7f7434067290 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f744c0f4d60 0x7f744c106f10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 --2- 172.21.15.96:0/4072503330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f744c0f5f60 0x7f744c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 >> 172.21.15.96:0/4072503330 conn(0x7f744c0f04c0 msgr2=0x7f744c0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 shutdown_connections 2022-02-02T19:06:29.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.343+0000 7f7451588700 1 -- 172.21.15.96:0/4072503330 wait complete. 2022-02-02T19:06:29.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 -- 172.21.15.96:0/3287157603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f55c0 msgr2=0x7fc4380f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 --2- 172.21.15.96:0/3287157603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f55c0 0x7fc4380f59e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fc428004660 tx=0x7fc428009b30).stop 2022-02-02T19:06:29.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 -- 172.21.15.96:0/3287157603 shutdown_connections 2022-02-02T19:06:29.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 --2- 172.21.15.96:0/3287157603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f6860 0x7fc4380f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 --2- 172.21.15.96:0/3287157603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f55c0 0x7fc4380f59e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 -- 172.21.15.96:0/3287157603 >> 172.21.15.96:0/3287157603 conn(0x7fc4380f0d40 msgr2=0x7fc4380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:29.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.440+0000 7fc43cf49700 1 -- 172.21.15.96:0/3287157603 shutdown_connections 2022-02-02T19:06:29.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 -- 172.21.15.96:0/3287157603 wait complete. 2022-02-02T19:06:29.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 Processor -- start 2022-02-02T19:06:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 -- start start 2022-02-02T19:06:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f55c0 0x7fc438109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.441+0000 7fc43cf49700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380603c0 con 0x7fc4380f6860 2022-02-02T19:06:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc43cf49700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438060500 con 0x7fc4380f55c0 2022-02-02T19:06:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57840/0 (socket says 172.21.15.96:57840) 2022-02-02T19:06:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 -- 172.21.15.96:0/1403174963 learned_addr learned my addr 172.21.15.96:0/1403174963 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:06:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc43659c700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f55c0 0x7fc438109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 -- 172.21.15.96:0/1403174963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f55c0 msgr2=0x7fc438109c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f55c0 0x7fc438109c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 -- 172.21.15.96:0/1403174963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428005040 con 0x7fc4380f6860 2022-02-02T19:06:29.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42ffff700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc420002700 tx=0x7fc420009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:29.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420009320 con 0x7fc4380f6860 2022-02-02T19:06:29.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc42000f040 con 0x7fc4380f6860 2022-02-02T19:06:29.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43810c710 con 0x7fc4380f6860 2022-02-02T19:06:29.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420014870 con 0x7fc4380f6860 2022-02-02T19:06:29.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.442+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43810cca0 con 0x7fc4380f6860 2022-02-02T19:06:29.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.443+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4380f49b0 con 0x7fc4380f6860 2022-02-02T19:06:29.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.444+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc420009480 con 0x7fc4380f6860 2022-02-02T19:06:29.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.444+0000 7fc42effd700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 0x7fc424067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:29.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.444+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc420081d40 con 0x7fc4380f6860 2022-02-02T19:06:29.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.444+0000 7fc43659c700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 0x7fc424067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:29.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.445+0000 7fc43659c700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 0x7fc424067270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fc438060040 tx=0x7fc428009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:29.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.449+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc42004fdf0 con 0x7fc4380f6860 2022-02-02T19:06:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.652+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc438045ad0 con 0x7fc4380f6860 2022-02-02T19:06:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.653+0000 7fc42effd700 1 -- 172.21.15.96:0/1403174963 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc420053410 con 0x7fc4380f6860 2022-02-02T19:06:29.655 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:06:29.655 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:06:29.656 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:06:29.656 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:06:29.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:06:29.656 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:06:29.656 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:06:29.657 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:06:29.657 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:06:29.657 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:06:29.657 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:06:29.658 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:06:29.658 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:06:29.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:06:29.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:06:29.658 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:06:29.659 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:06:29.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:06:29.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:06:29.659 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:06:29.660 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:06:29.660 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:06:29.660 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:06:29.660 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:06:29.660 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:06:29.661 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:06:29.661 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:06:29.661 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:06:29.661 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:06:29.662 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:06:29.662 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:06:29.662 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:06:29.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:06:29.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:06:29.663 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:06:29.663 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:06:29.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:06:29.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:06:29.664 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:06:29.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.654+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 msgr2=0x7fc424067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.654+0000 7fc43cf49700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 0x7fc424067270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fc438060040 tx=0x7fc428009b30).stop 2022-02-02T19:06:29.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.654+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 msgr2=0x7fc43810c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:29.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.654+0000 7fc43cf49700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc420002700 tx=0x7fc420009e00).stop 2022-02-02T19:06:29.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 shutdown_connections 2022-02-02T19:06:29.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc424064db0 0x7fc424067270 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4380f55c0 0x7fc438109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 --2- 172.21.15.96:0/1403174963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4380f6860 0x7fc43810c160 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:29.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 >> 172.21.15.96:0/1403174963 conn(0x7fc4380f0d40 msgr2=0x7fc4380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:29.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 shutdown_connections 2022-02-02T19:06:29.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:29.655+0000 7fc43cf49700 1 -- 172.21.15.96:0/1403174963 wait complete. 2022-02-02T19:06:29.667 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:06:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:29 smithi096 ceph-mon[101353]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:06:30.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4072503330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:06:30.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1403174963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:06:30.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:29 smithi159 ceph-mon[69013]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:06:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4072503330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:06:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1403174963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:06:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:30 smithi096 ceph-mon[101353]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:06:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:30 smithi096 ceph-mon[101353]: pgmap v1331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:30 smithi159 ceph-mon[69013]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:06:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:30 smithi159 ceph-mon[69013]: pgmap v1331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:32 smithi096 ceph-mon[101353]: pgmap v1332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:32 smithi159 ceph-mon[69013]: pgmap v1332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:34 smithi096 ceph-mon[101353]: pgmap v1333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:34 smithi159 ceph-mon[69013]: pgmap v1333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:36 smithi096 ceph-mon[101353]: pgmap v1334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:36 smithi159 ceph-mon[69013]: pgmap v1334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:38 smithi096 ceph-mon[101353]: pgmap v1335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:38 smithi159 ceph-mon[69013]: pgmap v1335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:40 smithi159 ceph-mon[69013]: pgmap v1336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:40 smithi096 ceph-mon[101353]: pgmap v1336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:42 smithi096 ceph-mon[101353]: pgmap v1337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:42 smithi159 ceph-mon[69013]: pgmap v1337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:44 smithi159 ceph-mon[69013]: pgmap v1338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:44 smithi096 ceph-mon[101353]: pgmap v1338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:46 smithi159 ceph-mon[69013]: pgmap v1339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:46 smithi096 ceph-mon[101353]: pgmap v1339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:48 smithi159 ceph-mon[69013]: pgmap v1340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:49.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:48 smithi096 ceph-mon[101353]: pgmap v1340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:50.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:49 smithi159 ceph-mon[69013]: pgmap v1341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:50.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:49 smithi096 ceph-mon[101353]: pgmap v1341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:52 smithi159 ceph-mon[69013]: pgmap v1342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:52 smithi096 ceph-mon[101353]: pgmap v1342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:54 smithi159 ceph-mon[69013]: pgmap v1343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:55.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:54 smithi096 ceph-mon[101353]: pgmap v1343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:56 smithi159 ceph-mon[69013]: pgmap v1344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:56 smithi096 ceph-mon[101353]: pgmap v1344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:06:58 smithi159 ceph-mon[69013]: pgmap v1345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:06:58 smithi096 ceph-mon[101353]: pgmap v1345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:06:59.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 -- 172.21.15.96:0/4176100021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 msgr2=0x7f94340f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:59.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 --2- 172.21.15.96:0/4176100021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f94340f6ac0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f9424004660 tx=0x7f9424009b30).stop 2022-02-02T19:06:59.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 -- 172.21.15.96:0/4176100021 shutdown_connections 2022-02-02T19:06:59.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 --2- 172.21.15.96:0/4176100021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 0x7f94340f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 --2- 172.21.15.96:0/4176100021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f94340f6ac0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 -- 172.21.15.96:0/4176100021 >> 172.21.15.96:0/4176100021 conn(0x7f94340f1e00 msgr2=0x7f94340f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:59.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.764+0000 7f943bd13700 1 -- 172.21.15.96:0/4176100021 shutdown_connections 2022-02-02T19:06:59.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 -- 172.21.15.96:0/4176100021 wait complete. 2022-02-02T19:06:59.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 Processor -- start 2022-02-02T19:06:59.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 -- start start 2022-02-02T19:06:59.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:59.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 0x7f9434069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:59.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943406a380 con 0x7f94340f66a0 2022-02-02T19:06:59.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f943bd13700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943406a4c0 con 0x7f94340f7940 2022-02-02T19:06:59.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f9439aaf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:59.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f9439aaf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57862/0 (socket says 172.21.15.96:57862) 2022-02-02T19:06:59.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.765+0000 7f9439aaf700 1 -- 172.21.15.96:0/3478008824 learned_addr learned my addr 172.21.15.96:0/3478008824 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:06:59.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f94392ae700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 0x7f9434069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:59.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f9439aaf700 1 -- 172.21.15.96:0/3478008824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 msgr2=0x7f9434069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:59.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f9439aaf700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 0x7f9434069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f9439aaf700 1 -- 172.21.15.96:0/3478008824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424005040 con 0x7f94340f66a0 2022-02-02T19:06:59.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f9439aaf700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f9424013a70 tx=0x7f9424009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:59.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9424018070 con 0x7f94340f66a0 2022-02-02T19:06:59.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94240097d0 con 0x7f94340f66a0 2022-02-02T19:06:59.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943406a740 con 0x7f94340f66a0 2022-02-02T19:06:59.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f942401c3c0 con 0x7f94340f66a0 2022-02-02T19:06:59.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.766+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943406aca0 con 0x7f94340f66a0 2022-02-02T19:06:59.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.767+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434045ad0 con 0x7f94340f66a0 2022-02-02T19:06:59.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.767+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9424007ba0 con 0x7f94340f66a0 2022-02-02T19:06:59.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.768+0000 7f942a7fc700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 0x7f94200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:06:59.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.768+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9424083690 con 0x7f94340f66a0 2022-02-02T19:06:59.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.768+0000 7f94392ae700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 0x7f94200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:06:59.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.768+0000 7f94392ae700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 0x7f94200672e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9430004b00 tx=0x7f943000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:06:59.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.772+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9424051800 con 0x7f94340f66a0 2022-02-02T19:06:59.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.949+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9434057f10 con 0x7f9420064e20 2022-02-02T19:06:59.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.950+0000 7f942a7fc700 1 -- 172.21.15.96:0/3478008824 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9434057f10 con 0x7f9420064e20 2022-02-02T19:06:59.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 msgr2=0x7f94200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:59.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 0x7f94200672e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9430004b00 tx=0x7f943000b040).stop 2022-02-02T19:06:59.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 msgr2=0x7f943406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:06:59.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f9424013a70 tx=0x7f9424009b30).stop 2022-02-02T19:06:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 shutdown_connections 2022-02-02T19:06:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9420064e20 0x7f94200672e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94340f66a0 0x7f943406b9a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 --2- 172.21.15.96:0/3478008824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340f7940 0x7f9434069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:06:59.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 >> 172.21.15.96:0/3478008824 conn(0x7f94340f1e00 msgr2=0x7f94340fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:06:59.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 shutdown_connections 2022-02-02T19:06:59.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:06:59.952+0000 7f943bd13700 1 -- 172.21.15.96:0/3478008824 wait complete. 2022-02-02T19:06:59.963 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:07:00.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- 172.21.15.96:0/2776119500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 msgr2=0x7f9ca40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 --2- 172.21.15.96:0/2776119500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca40f59e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f9c98004660 tx=0x7f9c98009b30).stop 2022-02-02T19:07:00.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- 172.21.15.96:0/2776119500 shutdown_connections 2022-02-02T19:07:00.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 --2- 172.21.15.96:0/2776119500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 --2- 172.21.15.96:0/2776119500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca40f59e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- 172.21.15.96:0/2776119500 >> 172.21.15.96:0/2776119500 conn(0x7f9ca40f0d40 msgr2=0x7f9ca40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- 172.21.15.96:0/2776119500 shutdown_connections 2022-02-02T19:07:00.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- 172.21.15.96:0/2776119500 wait complete. 2022-02-02T19:07:00.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 Processor -- start 2022-02-02T19:07:00.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.050+0000 7f9cac124700 1 -- start start 2022-02-02T19:07:00.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9cac124700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9cac124700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9cac124700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40603c0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9cac124700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4060500 con 0x7f9ca40f6860 2022-02-02T19:07:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57872/0 (socket says 172.21.15.96:57872) 2022-02-02T19:07:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 -- 172.21.15.96:0/1440832766 learned_addr learned my addr 172.21.15.96:0/1440832766 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca96bf700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 -- 172.21.15.96:0/1440832766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 msgr2=0x7f9ca410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 -- 172.21.15.96:0/1440832766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98005040 con 0x7f9ca40f55c0 2022-02-02T19:07:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9ca9ec0700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f9c98013a70 tx=0x7f9c98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c98018070 con 0x7f9ca40f55c0 2022-02-02T19:07:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca410c720 con 0x7f9ca40f55c0 2022-02-02T19:07:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c980097d0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.051+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9801c3c0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.052+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca410cc50 con 0x7f9ca40f55c0 2022-02-02T19:07:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.053+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca40f49b0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.053+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c98007ba0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.053+0000 7f9c967fc700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.053+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c98083760 con 0x7f9ca40f55c0 2022-02-02T19:07:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.053+0000 7f9ca96bf700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.054+0000 7f9ca96bf700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9ca00096c0 tx=0x7f9ca0009c20).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.057+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c980518d0 con 0x7f9ca40f55c0 2022-02-02T19:07:00.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.233+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca40fdf10 con 0x7f9c90064dd0 2022-02-02T19:07:00.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.242+0000 7f9c967fc700 1 -- 172.21.15.96:0/1440832766 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9ca40fdf10 con 0x7f9c90064dd0 2022-02-02T19:07:00.243 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:07:00.243 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (50m) 20m ago 51m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:07:00.243 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (42m) 20m ago 51m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:07:00.243 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (42m) 19m ago 50m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:07:00.244 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (50m) 20m ago 51m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:07:00.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (47m) 20m ago 47m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:07:00.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (43m) 20m ago 47m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:07:00.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (47m) 19m ago 47m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:07:00.245 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (43m) 19m ago 47m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:07:00.245 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (44m) 20m ago 52m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:07:00.245 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (44m) 19m ago 50m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:07:00.245 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (43m) 20m ago 52m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:07:00.245 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (43m) 19m ago 50m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:07:00.246 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (51m) 20m ago 51m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:07:00.246 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (50m) 19m ago 50m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:07:00.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (42m) 20m ago 50m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:07:00.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (41m) 20m ago 49m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:07:00.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (41m) 20m ago 49m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:07:00.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (40m) 19m ago 49m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:07:00.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (40m) 19m ago 49m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:07:00.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (39m) 19m ago 48m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:07:00.247 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (50m) 20m ago 51m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:07:00.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 msgr2=0x7f9c90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9ca00096c0 tx=0x7f9ca0009c20).stop 2022-02-02T19:07:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 msgr2=0x7f9ca4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f9c98013a70 tx=0x7f9c98009b30).stop 2022-02-02T19:07:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 shutdown_connections 2022-02-02T19:07:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca4109cd0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 --2- 172.21.15.96:0/1440832766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 >> 172.21.15.96:0/1440832766 conn(0x7f9ca40f0d40 msgr2=0x7f9ca40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.243+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 shutdown_connections 2022-02-02T19:07:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.244+0000 7f9cac124700 1 -- 172.21.15.96:0/1440832766 wait complete. 2022-02-02T19:07:00.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 -- 172.21.15.96:0/2631268286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 msgr2=0x7f63700f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 --2- 172.21.15.96:0/2631268286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f63700f59e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f6360004660 tx=0x7f6360009b30).stop 2022-02-02T19:07:00.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 -- 172.21.15.96:0/2631268286 shutdown_connections 2022-02-02T19:07:00.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 --2- 172.21.15.96:0/2631268286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63700f6860 0x7f63700f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:07:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 --2- 172.21.15.96:0/2631268286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f63700f59e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 -- 172.21.15.96:0/2631268286 >> 172.21.15.96:0/2631268286 conn(0x7f63700f0d40 msgr2=0x7f63700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 -- 172.21.15.96:0/2631268286 shutdown_connections 2022-02-02T19:07:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.341+0000 7f6377b80700 1 -- 172.21.15.96:0/2631268286 wait complete. 2022-02-02T19:07:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 Processor -- start 2022-02-02T19:07:00.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 -- start start 2022-02-02T19:07:00.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63700f6860 0x7f637010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370060450 con 0x7f63700f55c0 2022-02-02T19:07:00.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f6377b80700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370060590 con 0x7f63700f6860 2022-02-02T19:07:00.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57882/0 (socket says 172.21.15.96:57882) 2022-02-02T19:07:00.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 -- 172.21.15.96:0/3678519873 learned_addr learned my addr 172.21.15.96:0/3678519873 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:00.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 -- 172.21.15.96:0/3678519873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63700f6860 msgr2=0x7f637010c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63700f6860 0x7f637010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:07:00.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 -- 172.21.15.96:0/3678519873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360005040 con 0x7f63700f55c0 2022-02-02T19:07:00.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f637591c700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f6360004f60 tx=0x7f6360009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.342+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6360018070 con 0x7f63700f55c0 2022-02-02T19:07:00.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.343+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6360007ba0 con 0x7f63700f55c0 2022-02-02T19:07:00.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.343+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636001dea0 con 0x7f63700f55c0 2022-02-02T19:07:00.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.343+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637010c790 con 0x7f63700f55c0 2022-02-02T19:07:00.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.343+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637010ccf0 con 0x7f63700f55c0 2022-02-02T19:07:00.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.344+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6370045ad0 con 0x7f63700f55c0 2022-02-02T19:07:00.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.344+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f636001d420 con 0x7f63700f55c0 2022-02-02T19:07:00.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.344+0000 7f63667fc700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 0x7f635c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.344+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6360083a00 con 0x7f63700f55c0 2022-02-02T19:07:00.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.345+0000 7f637511b700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 0x7f635c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.345+0000 7f637511b700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 0x7f635c067290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f636c009610 tx=0x7f636c006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.349+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6360051ab0 con 0x7f63700f55c0 2022-02-02T19:07:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.580+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63700586e0 con 0x7f63700f55c0 2022-02-02T19:07:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.580+0000 7f63667fc700 1 -- 172.21.15.96:0/3678519873 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f63600550d0 con 0x7f63700f55c0 2022-02-02T19:07:00.582 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:07:00.582 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:07:00.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:07:00.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:00.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:07:00.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:07:00.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:00.584 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:07:00.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:07:00.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:00.584 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:07:00.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:07:00.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:00.585 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:07:00.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:07:00.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:07:00.586 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:07:00.586 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:07:00.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 msgr2=0x7f635c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 0x7f635c067290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f636c009610 tx=0x7f636c006ab0).stop 2022-02-02T19:07:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 msgr2=0x7f6370109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f6360004f60 tx=0x7f6360009b30).stop 2022-02-02T19:07:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 shutdown_connections 2022-02-02T19:07:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f635c064dd0 0x7f635c067290 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63700f55c0 0x7f6370109ce0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 --2- 172.21.15.96:0/3678519873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63700f6860 0x7f637010c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:07:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 >> 172.21.15.96:0/3678519873 conn(0x7f63700f0d40 msgr2=0x7f63700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 shutdown_connections 2022-02-02T19:07:00.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.582+0000 7f6377b80700 1 -- 172.21.15.96:0/3678519873 wait complete. 2022-02-02T19:07:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/557566807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f66e0 msgr2=0x7f3a080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/557566807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f66e0 0x7f3a080f6b00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f39f0004660 tx=0x7f39f0009b30).stop 2022-02-02T19:07:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/557566807 shutdown_connections 2022-02-02T19:07:00.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/557566807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f6ff0 0x7f3a080f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:07:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/557566807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f66e0 0x7f3a080f6b00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/557566807 >> 172.21.15.96:0/557566807 conn(0x7f3a080f1f00 msgr2=0x7f3a080f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/557566807 shutdown_connections 2022-02-02T19:07:00.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/557566807 wait complete. 2022-02-02T19:07:00.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.681+0000 7f3a0e2e8700 1 Processor -- start 2022-02-02T19:07:00.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a0e2e8700 1 -- start start 2022-02-02T19:07:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a0e2e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f66e0 0x7f3a08106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a0e2e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a0e2e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08107ab0 con 0x7f3a080f6ff0 2022-02-02T19:07:00.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a0e2e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08108360 con 0x7f3a080f66e0 2022-02-02T19:07:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f66e0 0x7f3a08106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57894/0 (socket says 172.21.15.96:57894) 2022-02-02T19:07:00.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 -- 172.21.15.96:0/2346953938 learned_addr learned my addr 172.21.15.96:0/2346953938 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 -- 172.21.15.96:0/2346953938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f66e0 msgr2=0x7f3a08106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f66e0 0x7f3a08106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.682+0000 7f3a077fe700 1 -- 172.21.15.96:0/2346953938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0005040 con 0x7f3a080f6ff0 2022-02-02T19:07:00.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a077fe700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f39f800b410 tx=0x7f39f8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f80125f0 con 0x7f3a080f6ff0 2022-02-02T19:07:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a08108640 con 0x7f3a080f6ff0 2022-02-02T19:07:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39f800be30 con 0x7f3a080f6ff0 2022-02-02T19:07:00.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f8002a70 con 0x7f3a080f6ff0 2022-02-02T19:07:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.683+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a08108c00 con 0x7f3a080f6ff0 2022-02-02T19:07:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.684+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f39f800f030 con 0x7f3a080f6ff0 2022-02-02T19:07:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.684+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a080f5b70 con 0x7f3a080f6ff0 2022-02-02T19:07:00.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.685+0000 7f3a04ff9700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 0x7f39f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.685+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f39f8081b00 con 0x7f3a080f6ff0 2022-02-02T19:07:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.685+0000 7f3a07fff700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 0x7f39f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:00.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.685+0000 7f3a07fff700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 0x7f39f4067290 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f39f0004630 tx=0x7f39f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:00.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.689+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39f80535c0 con 0x7f3a080f6ff0 2022-02-02T19:07:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.891+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a08045ad0 con 0x7f3a080f6ff0 2022-02-02T19:07:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.892+0000 7f3a04ff9700 1 -- 172.21.15.96:0/2346953938 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f39f80531b0 con 0x7f3a080f6ff0 2022-02-02T19:07:00.893 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:07:00.893 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:07:00.893 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:07:00.894 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:07:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:00.894 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:07:00.894 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:07:00.895 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:07:00.895 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:07:00.895 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:07:00.895 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:07:00.896 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:07:00.896 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:07:00.896 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:07:00.896 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:07:00.896 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:07:00.897 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:07:00.897 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:07:00.897 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:07:00.897 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:07:00.897 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:07:00.898 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:07:00.898 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:07:00.898 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:07:00.898 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:07:00.898 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:07:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:07:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:07:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:07:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:07:00.900 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:07:00.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:07:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:00.900 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:07:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:00.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:00.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:00.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:00.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 msgr2=0x7f39f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 0x7f39f4067290 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f39f0004630 tx=0x7f39f0009b30).stop 2022-02-02T19:07:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 msgr2=0x7f3a08107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f39f800b410 tx=0x7f39f8006ef0).stop 2022-02-02T19:07:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 shutdown_connections 2022-02-02T19:07:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39f4064dd0 0x7f39f4067290 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a080f66e0 0x7f3a08106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 --2- 172.21.15.96:0/2346953938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a080f6ff0 0x7f3a08107470 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.893+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 >> 172.21.15.96:0/2346953938 conn(0x7f3a080f1f00 msgr2=0x7f3a080fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:00.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.894+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 shutdown_connections 2022-02-02T19:07:00.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:00.894+0000 7f3a0e2e8700 1 -- 172.21.15.96:0/2346953938 wait complete. 2022-02-02T19:07:00.905 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:07:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:00 smithi159 ceph-mon[69013]: pgmap v1346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3678519873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:07:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:00 smithi096 ceph-mon[101353]: pgmap v1346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3678519873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:07:02.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:01 smithi159 ceph-mon[69013]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:01 smithi159 ceph-mon[69013]: from='client.35504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2346953938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:07:02.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:01 smithi096 ceph-mon[101353]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:02.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:01 smithi096 ceph-mon[101353]: from='client.35504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:02.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2346953938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:07:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:02 smithi159 ceph-mon[69013]: pgmap v1347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:02 smithi096 ceph-mon[101353]: pgmap v1347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:04 smithi159 ceph-mon[69013]: pgmap v1348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:04 smithi096 ceph-mon[101353]: pgmap v1348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:06 smithi159 ceph-mon[69013]: pgmap v1349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:06 smithi096 ceph-mon[101353]: pgmap v1349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:08 smithi159 ceph-mon[69013]: pgmap v1350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:08 smithi096 ceph-mon[101353]: pgmap v1350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:10 smithi159 ceph-mon[69013]: pgmap v1351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:10 smithi096 ceph-mon[101353]: pgmap v1351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:12 smithi159 ceph-mon[69013]: pgmap v1352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:12 smithi096 ceph-mon[101353]: pgmap v1352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:14 smithi159 ceph-mon[69013]: pgmap v1353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:14 smithi096 ceph-mon[101353]: pgmap v1353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:16 smithi159 ceph-mon[69013]: pgmap v1354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:16 smithi096 ceph-mon[101353]: pgmap v1354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:18 smithi159 ceph-mon[69013]: pgmap v1355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:18 smithi096 ceph-mon[101353]: pgmap v1355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:20 smithi159 ceph-mon[69013]: pgmap v1356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:20 smithi096 ceph-mon[101353]: pgmap v1356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:22 smithi159 ceph-mon[69013]: pgmap v1357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:22 smithi096 ceph-mon[101353]: pgmap v1357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:24 smithi159 ceph-mon[69013]: pgmap v1358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:24 smithi096 ceph-mon[101353]: pgmap v1358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:26 smithi159 ceph-mon[69013]: pgmap v1359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:26 smithi096 ceph-mon[101353]: pgmap v1359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:07:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:07:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:07:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:07:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:28 smithi159 ceph-mon[69013]: pgmap v1360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:28 smithi096 ceph-mon[101353]: pgmap v1360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:31.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:30 smithi096 ceph-mon[101353]: pgmap v1361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 -- 172.21.15.96:0/1444127552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f6860 msgr2=0x7f946c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 --2- 172.21.15.96:0/1444127552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f6860 0x7f946c0f6cc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f9458004660 tx=0x7f9458009b30).stop 2022-02-02T19:07:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 -- 172.21.15.96:0/1444127552 shutdown_connections 2022-02-02T19:07:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 --2- 172.21.15.96:0/1444127552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f6860 0x7f946c0f6cc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 --2- 172.21.15.96:0/1444127552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f55c0 0x7f946c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 -- 172.21.15.96:0/1444127552 >> 172.21.15.96:0/1444127552 conn(0x7f946c0f0d40 msgr2=0x7f946c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 -- 172.21.15.96:0/1444127552 shutdown_connections 2022-02-02T19:07:31.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.005+0000 7f9472c73700 1 -- 172.21.15.96:0/1444127552 wait complete. 2022-02-02T19:07:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 Processor -- start 2022-02-02T19:07:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 -- start start 2022-02-02T19:07:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f6860 0x7f946c107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c1079f0 con 0x7f946c0f55c0 2022-02-02T19:07:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9472c73700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c107b30 con 0x7f946c0f6860 2022-02-02T19:07:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.006+0000 7f9470a0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57920/0 (socket says 172.21.15.96:57920) 2022-02-02T19:07:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 -- 172.21.15.96:0/1901821768 learned_addr learned my addr 172.21.15.96:0/1901821768 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:31.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f946bfff700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f6860 0x7f946c107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 -- 172.21.15.96:0/1901821768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f6860 msgr2=0x7f946c107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f6860 0x7f946c107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 -- 172.21.15.96:0/1901821768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458005040 con 0x7f946c0f55c0 2022-02-02T19:07:31.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9470a0f700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9460002700 tx=0x7f9460009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9460009320 con 0x7f946c0f55c0 2022-02-02T19:07:31.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f946000f040 con 0x7f946c0f55c0 2022-02-02T19:07:31.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c1084d0 con 0x7f946c0f55c0 2022-02-02T19:07:31.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9460014780 con 0x7f946c0f55c0 2022-02-02T19:07:31.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.007+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c108a90 con 0x7f946c0f55c0 2022-02-02T19:07:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.008+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c045ad0 con 0x7f946c0f55c0 2022-02-02T19:07:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.009+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9460009480 con 0x7f946c0f55c0 2022-02-02T19:07:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.009+0000 7f94697fa700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 0x7f945c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.009+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f94600820e0 con 0x7f946c0f55c0 2022-02-02T19:07:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.009+0000 7f946bfff700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 0x7f945c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.009+0000 7f946bfff700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 0x7f945c067290 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f9458009da0 tx=0x7f9458009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.013+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9460053b60 con 0x7f946c0f55c0 2022-02-02T19:07:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:30 smithi159 ceph-mon[69013]: pgmap v1361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:31.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.191+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f946c0faca0 con 0x7f945c064dd0 2022-02-02T19:07:31.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.193+0000 7f94697fa700 1 -- 172.21.15.96:0/1901821768 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f946c0faca0 con 0x7f945c064dd0 2022-02-02T19:07:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.194+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 msgr2=0x7f945c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.194+0000 7f9472c73700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 0x7f945c067290 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f9458009da0 tx=0x7f9458009b30).stop 2022-02-02T19:07:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.194+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 msgr2=0x7f946c106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.194+0000 7f9472c73700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9460002700 tx=0x7f9460009d60).stop 2022-02-02T19:07:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 shutdown_connections 2022-02-02T19:07:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064dd0 0x7f945c067290 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f946c0f55c0 0x7f946c106f50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 --2- 172.21.15.96:0/1901821768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0f6860 0x7f946c107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 >> 172.21.15.96:0/1901821768 conn(0x7f946c0f0d40 msgr2=0x7f946c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 shutdown_connections 2022-02-02T19:07:31.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.195+0000 7f9472c73700 1 -- 172.21.15.96:0/1901821768 wait complete. 2022-02-02T19:07:31.205 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:07:31.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/2023187032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 msgr2=0x7fd2b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/2023187032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b40f6950 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fd2a8004660 tx=0x7fd2a8009b30).stop 2022-02-02T19:07:31.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/2023187032 shutdown_connections 2022-02-02T19:07:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/2023187032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/2023187032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b40f6950 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/2023187032 >> 172.21.15.96:0/2023187032 conn(0x7fd2b40f1c90 msgr2=0x7fd2b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/2023187032 shutdown_connections 2022-02-02T19:07:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.292+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/2023187032 wait complete. 2022-02-02T19:07:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 Processor -- start 2022-02-02T19:07:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 -- start start 2022-02-02T19:07:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b410aa20 con 0x7fd2b40f6530 2022-02-02T19:07:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b9f3c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b410ab60 con 0x7fd2b40f77d0 2022-02-02T19:07:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b8f3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b8f3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57930/0 (socket says 172.21.15.96:57930) 2022-02-02T19:07:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.293+0000 7fd2b8f3a700 1 -- 172.21.15.96:0/4252273395 learned_addr learned my addr 172.21.15.96:0/4252273395 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b8f3a700 1 -- 172.21.15.96:0/4252273395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 msgr2=0x7fd2b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b8f3a700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b8f3a700 1 -- 172.21.15.96:0/4252273395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8005040 con 0x7fd2b40f6530 2022-02-02T19:07:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:07:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b8f3a700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fd2a8004f60 tx=0x7fd2a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a8018070 con 0x7fd2b40f6530 2022-02-02T19:07:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd2a8007ba0 con 0x7fd2b40f6530 2022-02-02T19:07:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b406a370 con 0x7fd2b40f6530 2022-02-02T19:07:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a801c620 con 0x7fd2b40f6530 2022-02-02T19:07:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.294+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b406a8d0 con 0x7fd2b40f6530 2022-02-02T19:07:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.295+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4045ad0 con 0x7fd2b40f6530 2022-02-02T19:07:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.295+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd2a801c8e0 con 0x7fd2b40f6530 2022-02-02T19:07:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.296+0000 7fd2b17fa700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 0x7fd2a40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.296+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd2a8083990 con 0x7fd2b40f6530 2022-02-02T19:07:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.296+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 0x7fd2a40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.296+0000 7fd2b3fff700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 0x7fd2a40672e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fd2a0004ac0 tx=0x7fd2a0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.300+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd2a8051a40 con 0x7fd2b40f6530 2022-02-02T19:07:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.471+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b4027b40 con 0x7fd2a4064e20 2022-02-02T19:07:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.481+0000 7fd2b17fa700 1 -- 172.21.15.96:0/4252273395 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd2b4027b40 con 0x7fd2a4064e20 2022-02-02T19:07:31.482 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:07:31.482 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (50m) 21m ago 52m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:07:31.483 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (43m) 21m ago 51m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:07:31.483 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (43m) 19m ago 51m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:07:31.483 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (50m) 21m ago 51m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:07:31.483 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (47m) 21m ago 47m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:07:31.484 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (43m) 21m ago 48m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:07:31.484 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (48m) 19m ago 48m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:07:31.484 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (43m) 19m ago 48m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:07:31.484 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (45m) 21m ago 53m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:07:31.485 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (44m) 19m ago 51m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:07:31.485 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (44m) 21m ago 53m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:07:31.485 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (43m) 19m ago 51m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:07:31.485 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (51m) 21m ago 51m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:07:31.485 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (51m) 19m ago 51m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:07:31.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (42m) 21m ago 50m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:07:31.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (42m) 21m ago 50m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:07:31.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (41m) 21m ago 50m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:07:31.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (41m) 19m ago 49m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:07:31.487 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (40m) 19m ago 49m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:07:31.487 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (40m) 19m ago 49m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:07:31.487 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (50m) 21m ago 51m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:07:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.482+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 msgr2=0x7fd2a40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.482+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 0x7fd2a40672e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fd2a0004ac0 tx=0x7fd2a0009040).stop 2022-02-02T19:07:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.482+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 msgr2=0x7fd2b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.482+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fd2a8004f60 tx=0x7fd2a8009b30).stop 2022-02-02T19:07:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 shutdown_connections 2022-02-02T19:07:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2a4064e20 0x7fd2a40672e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2b40f6530 0x7fd2b406b9a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 --2- 172.21.15.96:0/4252273395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2b40f77d0 0x7fd2b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 >> 172.21.15.96:0/4252273395 conn(0x7fd2b40f1c90 msgr2=0x7fd2b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 shutdown_connections 2022-02-02T19:07:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.483+0000 7fd2b9f3c700 1 -- 172.21.15.96:0/4252273395 wait complete. 2022-02-02T19:07:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 -- 172.21.15.96:0/3530923963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 msgr2=0x7fe9180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 --2- 172.21.15.96:0/3530923963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe9180f6950 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fe908004660 tx=0x7fe908009b30).stop 2022-02-02T19:07:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 -- 172.21.15.96:0/3530923963 shutdown_connections 2022-02-02T19:07:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 --2- 172.21.15.96:0/3530923963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 --2- 172.21.15.96:0/3530923963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe9180f6950 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.580+0000 7fe91759e700 1 -- 172.21.15.96:0/3530923963 >> 172.21.15.96:0/3530923963 conn(0x7fe9180f1c90 msgr2=0x7fe9180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 -- 172.21.15.96:0/3530923963 shutdown_connections 2022-02-02T19:07:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 -- 172.21.15.96:0/3530923963 wait complete. 2022-02-02T19:07:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 Processor -- start 2022-02-02T19:07:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 -- start start 2022-02-02T19:07:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9181072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181078f0 con 0x7fe9180f6530 2022-02-02T19:07:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe918108100 con 0x7fe9180f77d0 2022-02-02T19:07:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57940/0 (socket says 172.21.15.96:57940) 2022-02-02T19:07:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.581+0000 7fe91659c700 1 -- 172.21.15.96:0/3000292437 learned_addr learned my addr 172.21.15.96:0/3000292437 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe915d9b700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9181072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91659c700 1 -- 172.21.15.96:0/3000292437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 msgr2=0x7fe9181072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91659c700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9181072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91659c700 1 -- 172.21.15.96:0/3000292437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908005040 con 0x7fe9180f6530 2022-02-02T19:07:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe915d9b700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9181072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:07:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91659c700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe908009830 tx=0x7fe908009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe908018070 con 0x7fe9180f6530 2022-02-02T19:07:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe908007ba0 con 0x7fe9180f6530 2022-02-02T19:07:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe918108320 con 0x7fe9180f6530 2022-02-02T19:07:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90801c620 con 0x7fe9180f6530 2022-02-02T19:07:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.582+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe918108880 con 0x7fe9180f6530 2022-02-02T19:07:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.583+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe918059100 con 0x7fe9180f6530 2022-02-02T19:07:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.583+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe908007d10 con 0x7fe9180f6530 2022-02-02T19:07:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.584+0000 7fe906ffd700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 0x7fe9000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.584+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe908083780 con 0x7fe9180f6530 2022-02-02T19:07:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.584+0000 7fe915d9b700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 0x7fe9000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.584+0000 7fe915d9b700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 0x7fe9000672e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe90c009740 tx=0x7fe90c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.588+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe908051890 con 0x7fe9180f6530 2022-02-02T19:07:31.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.820+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9180008d0 con 0x7fe9180f6530 2022-02-02T19:07:31.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.821+0000 7fe906ffd700 1 -- 172.21.15.96:0/3000292437 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe908054eb0 con 0x7fe9180f6530 2022-02-02T19:07:31.823 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:07:31.823 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:07:31.823 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:07:31.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:31.824 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:07:31.824 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:07:31.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:31.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:07:31.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:07:31.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:31.825 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:07:31.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:07:31.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:07:31.826 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:07:31.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:07:31.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:07:31.826 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:07:31.827 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:07:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 msgr2=0x7fe9000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 0x7fe9000672e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe90c009740 tx=0x7fe90c009be0).stop 2022-02-02T19:07:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 msgr2=0x7fe918106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe908009830 tx=0x7fe908009b30).stop 2022-02-02T19:07:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 shutdown_connections 2022-02-02T19:07:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe900064e20 0x7fe9000672e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9180f6530 0x7fe918106e00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 --2- 172.21.15.96:0/3000292437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9180f77d0 0x7fe9181072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 >> 172.21.15.96:0/3000292437 conn(0x7fe9180f1c90 msgr2=0x7fe9180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 shutdown_connections 2022-02-02T19:07:31.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.823+0000 7fe91759e700 1 -- 172.21.15.96:0/3000292437 wait complete. 2022-02-02T19:07:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.920+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/2433595858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 msgr2=0x7f1bcc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.920+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/2433595858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc0f6cc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f1bbc004660 tx=0x7f1bbc009b30).stop 2022-02-02T19:07:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/2433595858 shutdown_connections 2022-02-02T19:07:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/2433595858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc0f6cc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/2433595858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/2433595858 >> 172.21.15.96:0/2433595858 conn(0x7f1bcc0f0d40 msgr2=0x7f1bcc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/2433595858 shutdown_connections 2022-02-02T19:07:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/2433595858 wait complete. 2022-02-02T19:07:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 Processor -- start 2022-02-02T19:07:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.921+0000 7f1bd1a0b700 1 -- start start 2022-02-02T19:07:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bd1a0b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bd1a0b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bd1a0b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0603e0 con 0x7f1bcc0f6860 2022-02-02T19:07:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bd1a0b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc060520 con 0x7f1bcc0f55c0 2022-02-02T19:07:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57952/0 (socket says 172.21.15.96:57952) 2022-02-02T19:07:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 -- 172.21.15.96:0/3861420026 learned_addr learned my addr 172.21.15.96:0/3861420026 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:07:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bcaffd700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 -- 172.21.15.96:0/3861420026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 msgr2=0x7f1bcc109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 -- 172.21.15.96:0/3861420026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc005040 con 0x7f1bcc0f6860 2022-02-02T19:07:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bcaffd700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:07:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bca7fc700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1bbc009990 tx=0x7f1bbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bbc018070 con 0x7f1bcc0f6860 2022-02-02T19:07:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1bbc007ca0 con 0x7f1bcc0f6860 2022-02-02T19:07:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc10c6a0 con 0x7f1bcc0f6860 2022-02-02T19:07:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.922+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bbc01c620 con 0x7f1bcc0f6860 2022-02-02T19:07:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.923+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc10cc00 con 0x7f1bcc0f6860 2022-02-02T19:07:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.923+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc045ad0 con 0x7f1bcc0f6860 2022-02-02T19:07:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.924+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1bbc01d960 con 0x7f1bcc0f6860 2022-02-02T19:07:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.924+0000 7f1bb37fe700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 0x7f1bb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:07:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.924+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1bbc083760 con 0x7f1bcc0f6860 2022-02-02T19:07:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.925+0000 7f1bcaffd700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 0x7f1bb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:07:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.925+0000 7f1bcaffd700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 0x7f1bb4067290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1bcc060060 tx=0x7f1bc0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:07:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:31.929+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1bbc0518d0 con 0x7f1bcc0f6860 2022-02-02T19:07:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.129+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1bcc027a00 con 0x7f1bcc0f6860 2022-02-02T19:07:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.129+0000 7f1bb37fe700 1 -- 172.21.15.96:0/3861420026 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1bbc054ef0 con 0x7f1bcc0f6860 2022-02-02T19:07:32.131 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:07:32.132 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:07:32.132 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:07:32.132 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:07:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:32.133 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:07:32.133 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:07:32.133 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:07:32.133 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:07:32.133 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:07:32.134 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:07:32.134 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:07:32.134 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:07:32.134 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:07:32.135 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:07:32.135 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:07:32.135 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:07:32.135 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:07:32.135 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:07:32.136 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:07:32.136 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:07:32.136 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:07:32.136 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:07:32.137 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:07:32.137 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:07:32.137 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:07:32.137 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:07:32.137 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:07:32.138 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:07:32.138 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:07:32.138 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:07:32.138 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:07:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:32.139 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:07:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:07:32.139 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:32.140 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:32.140 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:07:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 msgr2=0x7f1bb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 0x7f1bb4067290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1bcc060060 tx=0x7f1bc0009040).stop 2022-02-02T19:07:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 msgr2=0x7f1bcc10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:07:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1bbc009990 tx=0x7f1bbc009b30).stop 2022-02-02T19:07:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 shutdown_connections 2022-02-02T19:07:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bb4064dd0 0x7f1bb4067290 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bcc0f55c0 0x7f1bcc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 --2- 172.21.15.96:0/3861420026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bcc0f6860 0x7f1bcc10c150 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:07:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 >> 172.21.15.96:0/3861420026 conn(0x7f1bcc0f0d40 msgr2=0x7f1bcc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:07:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.132+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 shutdown_connections 2022-02-02T19:07:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:07:32.133+0000 7f1bd1a0b700 1 -- 172.21.15.96:0/3861420026 wait complete. 2022-02-02T19:07:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:07:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:32 smithi159 ceph-mon[69013]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:32 smithi159 ceph-mon[69013]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:32 smithi159 ceph-mon[69013]: pgmap v1362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3000292437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:07:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3861420026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:07:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:32 smithi096 ceph-mon[101353]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:32 smithi096 ceph-mon[101353]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:07:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:32 smithi096 ceph-mon[101353]: pgmap v1362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:33.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3000292437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:07:33.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3861420026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:07:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:34 smithi159 ceph-mon[69013]: pgmap v1363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:34 smithi096 ceph-mon[101353]: pgmap v1363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:36 smithi159 ceph-mon[69013]: pgmap v1364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:36 smithi096 ceph-mon[101353]: pgmap v1364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:38 smithi159 ceph-mon[69013]: pgmap v1365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:38 smithi096 ceph-mon[101353]: pgmap v1365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:40 smithi159 ceph-mon[69013]: pgmap v1366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:40 smithi096 ceph-mon[101353]: pgmap v1366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:42 smithi159 ceph-mon[69013]: pgmap v1367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:42 smithi096 ceph-mon[101353]: pgmap v1367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:44 smithi159 ceph-mon[69013]: pgmap v1368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:44 smithi096 ceph-mon[101353]: pgmap v1368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:46 smithi159 ceph-mon[69013]: pgmap v1369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:46 smithi096 ceph-mon[101353]: pgmap v1369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:48 smithi159 ceph-mon[69013]: pgmap v1370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:48 smithi096 ceph-mon[101353]: pgmap v1370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:50 smithi159 ceph-mon[69013]: pgmap v1371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:50 smithi096 ceph-mon[101353]: pgmap v1371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:52 smithi159 ceph-mon[69013]: pgmap v1372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:52 smithi096 ceph-mon[101353]: pgmap v1372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:54 smithi159 ceph-mon[69013]: pgmap v1373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:54 smithi096 ceph-mon[101353]: pgmap v1373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:56 smithi159 ceph-mon[69013]: pgmap v1374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:56 smithi096 ceph-mon[101353]: pgmap v1374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:07:58 smithi159 ceph-mon[69013]: pgmap v1375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:07:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:07:58 smithi096 ceph-mon[101353]: pgmap v1375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:00 smithi159 ceph-mon[69013]: pgmap v1376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:00 smithi096 ceph-mon[101353]: pgmap v1376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:02.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 -- 172.21.15.96:0/3714155396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f55c0 msgr2=0x7f18100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 --2- 172.21.15.96:0/3714155396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f55c0 0x7f18100f59e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f1804004660 tx=0x7f1804009b30).stop 2022-02-02T19:08:02.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 -- 172.21.15.96:0/3714155396 shutdown_connections 2022-02-02T19:08:02.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 --2- 172.21.15.96:0/3714155396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f6860 0x7f18100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 --2- 172.21.15.96:0/3714155396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f55c0 0x7f18100f59e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 -- 172.21.15.96:0/3714155396 >> 172.21.15.96:0/3714155396 conn(0x7f18100f0d40 msgr2=0x7f18100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:02.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 -- 172.21.15.96:0/3714155396 shutdown_connections 2022-02-02T19:08:02.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.243+0000 7f18187a7700 1 -- 172.21.15.96:0/3714155396 wait complete. 2022-02-02T19:08:02.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 Processor -- start 2022-02-02T19:08:02.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 -- start start 2022-02-02T19:08:02.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f55c0 0x7f181010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100602b0 con 0x7f18100f6860 2022-02-02T19:08:02.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f18187a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100603f0 con 0x7f18100f55c0 2022-02-02T19:08:02.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57972/0 (socket says 172.21.15.96:57972) 2022-02-02T19:08:02.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 -- 172.21.15.96:0/1405699720 learned_addr learned my addr 172.21.15.96:0/1405699720 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:02.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1816543700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f55c0 0x7f181010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 -- 172.21.15.96:0/1405699720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f55c0 msgr2=0x7f181010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f55c0 0x7f181010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 -- 172.21.15.96:0/1405699720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804005040 con 0x7f18100f6860 2022-02-02T19:08:02.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.244+0000 7f1815d42700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f180c00c790 tx=0x7f180c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.245+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180c00e680 con 0x7f18100f6860 2022-02-02T19:08:02.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.245+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f180c00ec90 con 0x7f18100f6860 2022-02-02T19:08:02.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.245+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181010ea80 con 0x7f18100f6860 2022-02-02T19:08:02.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.245+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180c013d60 con 0x7f18100f6860 2022-02-02T19:08:02.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.245+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181010ef00 con 0x7f18100f6860 2022-02-02T19:08:02.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.246+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810045ad0 con 0x7f18100f6860 2022-02-02T19:08:02.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.246+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f180c01a060 con 0x7f18100f6860 2022-02-02T19:08:02.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.247+0000 7f1802ffd700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 0x7f17fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.247+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f180c081d70 con 0x7f18100f6860 2022-02-02T19:08:02.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.247+0000 7f1816543700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 0x7f17fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.247+0000 7f1816543700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 0x7f17fc067290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f1804009da0 tx=0x7f1804009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.251+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f180c04fd60 con 0x7f18100f6860 2022-02-02T19:08:02.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.430+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1810057f10 con 0x7f17fc064dd0 2022-02-02T19:08:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.431+0000 7f1802ffd700 1 -- 172.21.15.96:0/1405699720 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1810057f10 con 0x7f17fc064dd0 2022-02-02T19:08:02.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 msgr2=0x7f17fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 0x7f17fc067290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f1804009da0 tx=0x7f1804009b30).stop 2022-02-02T19:08:02.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 msgr2=0x7f181010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f180c00c790 tx=0x7f180c007d70).stop 2022-02-02T19:08:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 shutdown_connections 2022-02-02T19:08:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17fc064dd0 0x7f17fc067290 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18100f55c0 0x7f181010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 --2- 172.21.15.96:0/1405699720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18100f6860 0x7f181010e590 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 >> 172.21.15.96:0/1405699720 conn(0x7f18100f0d40 msgr2=0x7f18100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 shutdown_connections 2022-02-02T19:08:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.433+0000 7f18187a7700 1 -- 172.21.15.96:0/1405699720 wait complete. 2022-02-02T19:08:02.445 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:08:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 -- 172.21.15.96:0/819303507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 msgr2=0x7fea5c0f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 --2- 172.21.15.96:0/819303507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c0f7fe0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fea48004660 tx=0x7fea48009b30).stop 2022-02-02T19:08:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 -- 172.21.15.96:0/819303507 shutdown_connections 2022-02-02T19:08:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 --2- 172.21.15.96:0/819303507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c0f7fe0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 --2- 172.21.15.96:0/819303507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c0f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 -- 172.21.15.96:0/819303507 >> 172.21.15.96:0/819303507 conn(0x7fea5c0f2020 msgr2=0x7fea5c0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 -- 172.21.15.96:0/819303507 shutdown_connections 2022-02-02T19:08:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.531+0000 7fea62c5e700 1 -- 172.21.15.96:0/819303507 wait complete. 2022-02-02T19:08:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 Processor -- start 2022-02-02T19:08:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 -- start start 2022-02-02T19:08:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c107cb0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea62c5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c108560 con 0x7fea5c0f68e0 2022-02-02T19:08:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.532+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57982/0 (socket says 172.21.15.96:57982) 2022-02-02T19:08:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 -- 172.21.15.96:0/4018038588 learned_addr learned my addr 172.21.15.96:0/4018038588 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea609fa700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 -- 172.21.15.96:0/4018038588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 msgr2=0x7fea5c107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c107180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 -- 172.21.15.96:0/4018038588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48005040 con 0x7fea5c0f7b80 2022-02-02T19:08:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea609fa700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:08:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea5bfff700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fea48009990 tx=0x7fea48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea48018070 con 0x7fea5c0f7b80 2022-02-02T19:08:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c1087e0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.533+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c108d40 con 0x7fea5c0f7b80 2022-02-02T19:08:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.534+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea48007ca0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.534+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4801c3c0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.535+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fea4801c5e0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.535+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c004fa0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.535+0000 7fea597fa700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 0x7fea4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.535+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fea480845b0 con 0x7fea5c0f7b80 2022-02-02T19:08:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.535+0000 7fea609fa700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 0x7fea4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.536+0000 7fea609fa700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 0x7fea4c067290 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fea5c0f79e0 tx=0x7fea50008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.540+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fea48056150 con 0x7fea5c0f7b80 2022-02-02T19:08:02.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.716+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea3c0029f0 con 0x7fea4c064dd0 2022-02-02T19:08:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.725+0000 7fea597fa700 1 -- 172.21.15.96:0/4018038588 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fea3c0029f0 con 0x7fea4c064dd0 2022-02-02T19:08:02.727 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:08:02.727 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (51m) 22m ago 52m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:08:02.728 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (43m) 22m ago 52m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:08:02.728 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (43m) 20m ago 51m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:08:02.728 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (51m) 22m ago 52m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:08:02.728 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (48m) 22m ago 48m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:08:02.728 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (44m) 22m ago 48m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:08:02.729 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (48m) 20m ago 48m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:08:02.729 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (44m) 20m ago 48m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:08:02.729 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (45m) 22m ago 53m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:08:02.729 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (45m) 20m ago 51m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:08:02.730 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (44m) 22m ago 53m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:08:02.730 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (44m) 20m ago 51m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:08:02.730 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (52m) 22m ago 52m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:08:02.730 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (51m) 20m ago 51m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:08:02.730 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (43m) 22m ago 51m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:08:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (42m) 22m ago 50m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:08:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (42m) 22m ago 50m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:08:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (41m) 20m ago 50m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:08:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (41m) 20m ago 50m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:08:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (40m) 20m ago 49m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:08:02.732 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (51m) 22m ago 52m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:08:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.726+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 msgr2=0x7fea4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.726+0000 7fea62c5e700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 0x7fea4c067290 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fea5c0f79e0 tx=0x7fea50008040).stop 2022-02-02T19:08:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.726+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 msgr2=0x7fea5c107670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.726+0000 7fea62c5e700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fea48009990 tx=0x7fea48009b30).stop 2022-02-02T19:08:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 shutdown_connections 2022-02-02T19:08:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea4c064dd0 0x7fea4c067290 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5c0f68e0 0x7fea5c107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 --2- 172.21.15.96:0/4018038588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c0f7b80 0x7fea5c107670 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 >> 172.21.15.96:0/4018038588 conn(0x7fea5c0f2020 msgr2=0x7fea5c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 shutdown_connections 2022-02-02T19:08:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.727+0000 7fea62c5e700 1 -- 172.21.15.96:0/4018038588 wait complete. 2022-02-02T19:08:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:02 smithi096 ceph-mon[101353]: pgmap v1377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:02.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 -- 172.21.15.96:0/2801573960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f55e0 msgr2=0x7f8b5c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/2801573960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c0f5a00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f8b4c004660 tx=0x7f8b4c009b30).stop 2022-02-02T19:08:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 -- 172.21.15.96:0/2801573960 shutdown_connections 2022-02-02T19:08:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/2801573960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/2801573960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c0f5a00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 -- 172.21.15.96:0/2801573960 >> 172.21.15.96:0/2801573960 conn(0x7f8b5c0f0de0 msgr2=0x7f8b5c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 -- 172.21.15.96:0/2801573960 shutdown_connections 2022-02-02T19:08:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.824+0000 7f8b63ff8700 1 -- 172.21.15.96:0/2801573960 wait complete. 2022-02-02T19:08:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 Processor -- start 2022-02-02T19:08:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 -- start start 2022-02-02T19:08:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c109bf0 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b63ff8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c109d30 con 0x7f8b5c0f55e0 2022-02-02T19:08:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b61593700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b61593700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57990/0 (socket says 172.21.15.96:57990) 2022-02-02T19:08:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b61593700 1 -- 172.21.15.96:0/879991292 learned_addr learned my addr 172.21.15.96:0/879991292 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.825+0000 7f8b61d94700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b61593700 1 -- 172.21.15.96:0/879991292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f55e0 msgr2=0x7f8b5c109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b61593700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b61593700 1 -- 172.21.15.96:0/879991292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c005040 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b61593700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8b5800c530 tx=0x7f8b58007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5800f650 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b5800fc60 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c10a6d0 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b58012c20 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.826+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c10ac90 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.827+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c045ad0 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.827+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8b58010070 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.828+0000 7f8b527fc700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 0x7f8b48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:02.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.828+0000 7f8b61d94700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 0x7f8b48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:02.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.828+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8b58081660 con 0x7f8b5c0f5ef0 2022-02-02T19:08:02.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.828+0000 7f8b61d94700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 0x7f8b48067290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8b4c004630 tx=0x7f8b4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:02.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:02.832+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8b580477d0 con 0x7f8b5c0f5ef0 2022-02-02T19:08:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:02 smithi159 ceph-mon[69013]: pgmap v1377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.068+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b5c10b320 con 0x7f8b5c0f5ef0 2022-02-02T19:08:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.068+0000 7f8b527fc700 1 -- 172.21.15.96:0/879991292 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8b58053140 con 0x7f8b5c0f5ef0 2022-02-02T19:08:03.071 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:08:03.071 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:08:03.071 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:08:03.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:03.072 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:08:03.072 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:08:03.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:03.072 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:08:03.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:08:03.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:03.073 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:08:03.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:08:03.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:03.074 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:08:03.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:08:03.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:08:03.074 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:08:03.075 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:08:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 msgr2=0x7f8b48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 0x7f8b48067290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8b4c004630 tx=0x7f8b4c009b30).stop 2022-02-02T19:08:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 msgr2=0x7f8b5c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8b5800c530 tx=0x7f8b58007e20).stop 2022-02-02T19:08:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 shutdown_connections 2022-02-02T19:08:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b48064dd0 0x7f8b48067290 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5c0f55e0 0x7f8b5c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 --2- 172.21.15.96:0/879991292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b5c0f5ef0 0x7f8b5c109640 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 >> 172.21.15.96:0/879991292 conn(0x7f8b5c0f0de0 msgr2=0x7f8b5c05ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 shutdown_connections 2022-02-02T19:08:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.070+0000 7f8b63ff8700 1 -- 172.21.15.96:0/879991292 wait complete. 2022-02-02T19:08:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 -- 172.21.15.96:0/2608538863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f6860 msgr2=0x7fcb3c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 --2- 172.21.15.96:0/2608538863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f6860 0x7fcb3c0f6cc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fcb30004660 tx=0x7fcb30009b30).stop 2022-02-02T19:08:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 -- 172.21.15.96:0/2608538863 shutdown_connections 2022-02-02T19:08:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 --2- 172.21.15.96:0/2608538863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f6860 0x7fcb3c0f6cc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 --2- 172.21.15.96:0/2608538863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 -- 172.21.15.96:0/2608538863 >> 172.21.15.96:0/2608538863 conn(0x7fcb3c0f0d40 msgr2=0x7fcb3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.168+0000 7fcb43a77700 1 -- 172.21.15.96:0/2608538863 shutdown_connections 2022-02-02T19:08:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 -- 172.21.15.96:0/2608538863 wait complete. 2022-02-02T19:08:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 Processor -- start 2022-02-02T19:08:03.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 -- start start 2022-02-02T19:08:03.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:03.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3c0f6860 0x7fcb3c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:03.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0603c0 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.169+0000 7fcb43a77700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c060500 con 0x7fcb3c0f6860 2022-02-02T19:08:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57998/0 (socket says 172.21.15.96:57998) 2022-02-02T19:08:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 -- 172.21.15.96:0/1554181377 learned_addr learned my addr 172.21.15.96:0/1554181377 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 -- 172.21.15.96:0/1554181377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3c0f6860 msgr2=0x7fcb3c10c170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T19:08:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3c0f6860 0x7fcb3c10c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 -- 172.21.15.96:0/1554181377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30005040 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb41813700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fcb38002700 tx=0x7fcb38009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:03.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38009320 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c10c720 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb3800f040 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38014900 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.170+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c10ccb0 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.171+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c045ad0 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.172+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb38009480 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.172+0000 7fcb2e7fc700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 0x7fcb28067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.172+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb38081d10 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.173+0000 7fcb41012700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 0x7fcb28067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.173+0000 7fcb41012700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 0x7fcb28067270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fcb30009f50 tx=0x7fcb30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.177+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb3804fe80 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.377+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb3c0586e0 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.378+0000 7fcb2e7fc700 1 -- 172.21.15.96:0/1554181377 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcb380534a0 con 0x7fcb3c0f55c0 2022-02-02T19:08:03.381 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:08:03.381 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:08:03.382 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:08:03.382 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:08:03.382 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:03.383 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:08:03.383 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:08:03.383 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:08:03.384 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:08:03.384 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:08:03.384 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:08:03.384 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:08:03.385 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:08:03.385 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:08:03.385 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:08:03.385 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:08:03.385 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:08:03.386 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:08:03.386 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:08:03.386 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:08:03.386 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:08:03.387 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:08:03.387 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:08:03.387 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:08:03.387 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:08:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:08:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:08:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:08:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:08:03.388 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:08:03.389 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:08:03.389 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:08:03.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:03.390 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:03.390 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:08:03.390 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:03.390 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:03.391 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:03.391 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 msgr2=0x7fcb28067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 0x7fcb28067270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fcb30009f50 tx=0x7fcb30009b30).stop 2022-02-02T19:08:03.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 msgr2=0x7fcb3c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:03.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fcb38002700 tx=0x7fcb38009d80).stop 2022-02-02T19:08:03.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 shutdown_connections 2022-02-02T19:08:03.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb28064db0 0x7fcb28067270 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb3c0f55c0 0x7fcb3c109c70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:03.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 --2- 172.21.15.96:0/1554181377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3c0f6860 0x7fcb3c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:03.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 >> 172.21.15.96:0/1554181377 conn(0x7fcb3c0f0d40 msgr2=0x7fcb3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 shutdown_connections 2022-02-02T19:08:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:03.380+0000 7fcb43a77700 1 -- 172.21.15.96:0/1554181377 wait complete. 2022-02-02T19:08:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:08:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:03 smithi159 ceph-mon[69013]: from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:03 smithi159 ceph-mon[69013]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:03.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/879991292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:08:03.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1554181377' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:08:04.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:03 smithi096 ceph-mon[101353]: from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:04.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:03 smithi096 ceph-mon[101353]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:04.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/879991292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:08:04.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1554181377' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:08:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:04 smithi159 ceph-mon[69013]: pgmap v1378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:04 smithi096 ceph-mon[101353]: pgmap v1378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:06 smithi159 ceph-mon[69013]: pgmap v1379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:06 smithi096 ceph-mon[101353]: pgmap v1379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:08 smithi159 ceph-mon[69013]: pgmap v1380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:08 smithi096 ceph-mon[101353]: pgmap v1380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:10 smithi159 ceph-mon[69013]: pgmap v1381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:10 smithi096 ceph-mon[101353]: pgmap v1381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:12 smithi159 ceph-mon[69013]: pgmap v1382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:12 smithi096 ceph-mon[101353]: pgmap v1382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:14 smithi159 ceph-mon[69013]: pgmap v1383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:14 smithi096 ceph-mon[101353]: pgmap v1383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:16 smithi159 ceph-mon[69013]: pgmap v1384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:16 smithi096 ceph-mon[101353]: pgmap v1384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:18 smithi159 ceph-mon[69013]: pgmap v1385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:18 smithi096 ceph-mon[101353]: pgmap v1385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:20 smithi159 ceph-mon[69013]: pgmap v1386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:20 smithi096 ceph-mon[101353]: pgmap v1386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:22 smithi159 ceph-mon[69013]: pgmap v1387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:22 smithi096 ceph-mon[101353]: pgmap v1387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:24 smithi159 ceph-mon[69013]: pgmap v1388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:24 smithi096 ceph-mon[101353]: pgmap v1388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:26 smithi159 ceph-mon[69013]: pgmap v1389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:26 smithi096 ceph-mon[101353]: pgmap v1389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:08:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:08:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:08:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:08:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:28 smithi159 ceph-mon[69013]: pgmap v1390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:28 smithi096 ceph-mon[101353]: pgmap v1390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:30 smithi159 ceph-mon[69013]: pgmap v1391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:30 smithi096 ceph-mon[101353]: pgmap v1391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:32 smithi159 ceph-mon[69013]: pgmap v1392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:32 smithi096 ceph-mon[101353]: pgmap v1392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:33.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 -- 172.21.15.96:0/2011386980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 msgr2=0x7f0c6406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 --2- 172.21.15.96:0/2011386980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c6406a7d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f0c4c004660 tx=0x7f0c4c009b30).stop 2022-02-02T19:08:33.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 -- 172.21.15.96:0/2011386980 shutdown_connections 2022-02-02T19:08:33.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 --2- 172.21.15.96:0/2011386980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c6406a7d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 --2- 172.21.15.96:0/2011386980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 0x7f0c64069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.488+0000 7f0c688fc700 1 -- 172.21.15.96:0/2011386980 >> 172.21.15.96:0/2011386980 conn(0x7f0c640f1e40 msgr2=0x7f0c640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:33.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.489+0000 7f0c688fc700 1 -- 172.21.15.96:0/2011386980 shutdown_connections 2022-02-02T19:08:33.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.489+0000 7f0c688fc700 1 -- 172.21.15.96:0/2011386980 wait complete. 2022-02-02T19:08:33.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.489+0000 7f0c688fc700 1 Processor -- start 2022-02-02T19:08:33.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c688fc700 1 -- start start 2022-02-02T19:08:33.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c688fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c688fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 0x7f0c64109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c688fc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64109be0 con 0x7f0c6406a350 2022-02-02T19:08:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c688fc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64109d20 con 0x7f0c6406b960 2022-02-02T19:08:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58030/0 (socket says 172.21.15.96:58030) 2022-02-02T19:08:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 -- 172.21.15.96:0/221414911 learned_addr learned my addr 172.21.15.96:0/221414911 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c61d9b700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 0x7f0c64109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 -- 172.21.15.96:0/221414911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 msgr2=0x7f0c64109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 0x7f0c64109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 -- 172.21.15.96:0/221414911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c005040 con 0x7f0c6406a350 2022-02-02T19:08:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.490+0000 7f0c6259c700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0c5400c790 tx=0x7f0c54007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:33.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.491+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c54002590 con 0x7f0c6406a350 2022-02-02T19:08:33.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.491+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0c54002ba0 con 0x7f0c6406a350 2022-02-02T19:08:33.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.491+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6410a6c0 con 0x7f0c6406a350 2022-02-02T19:08:33.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.491+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c54013d90 con 0x7f0c6406a350 2022-02-02T19:08:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.491+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6410ac80 con 0x7f0c6406a350 2022-02-02T19:08:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.492+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c64045ad0 con 0x7f0c6406a350 2022-02-02T19:08:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.492+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0c5401a060 con 0x7f0c6406a350 2022-02-02T19:08:33.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.492+0000 7f0c5affd700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 0x7f0c50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.492+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0c54081d10 con 0x7f0c6406a350 2022-02-02T19:08:33.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.492+0000 7f0c61d9b700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 0x7f0c50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:33.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.493+0000 7f0c61d9b700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 0x7f0c50067290 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f0c4c004630 tx=0x7f0c4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:33.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.497+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0c54053790 con 0x7f0c6406a350 2022-02-02T19:08:33.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.675+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c641011a0 con 0x7f0c50064dd0 2022-02-02T19:08:33.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.676+0000 7f0c5affd700 1 -- 172.21.15.96:0/221414911 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0c641011a0 con 0x7f0c50064dd0 2022-02-02T19:08:33.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 msgr2=0x7f0c50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 0x7f0c50067290 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f0c4c004630 tx=0x7f0c4c009b30).stop 2022-02-02T19:08:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 msgr2=0x7f0c64109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0c5400c790 tx=0x7f0c54007d70).stop 2022-02-02T19:08:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 shutdown_connections 2022-02-02T19:08:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c50064dd0 0x7f0c50067290 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c6406a350 0x7f0c64109140 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 --2- 172.21.15.96:0/221414911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c6406b960 0x7f0c64109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 >> 172.21.15.96:0/221414911 conn(0x7f0c640f1e40 msgr2=0x7f0c640fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 shutdown_connections 2022-02-02T19:08:33.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.678+0000 7f0c688fc700 1 -- 172.21.15.96:0/221414911 wait complete. 2022-02-02T19:08:33.689 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:08:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 -- 172.21.15.96:0/1040302771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f55c0 msgr2=0x7fd0980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/1040302771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f55c0 0x7fd0980f59e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fd088004660 tx=0x7fd088009b30).stop 2022-02-02T19:08:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 -- 172.21.15.96:0/1040302771 shutdown_connections 2022-02-02T19:08:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/1040302771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f6860 0x7fd0980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/1040302771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f55c0 0x7fd0980f59e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 -- 172.21.15.96:0/1040302771 >> 172.21.15.96:0/1040302771 conn(0x7fd0980f0d40 msgr2=0x7fd0980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 -- 172.21.15.96:0/1040302771 shutdown_connections 2022-02-02T19:08:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.776+0000 7fd09f3c9700 1 -- 172.21.15.96:0/1040302771 wait complete. 2022-02-02T19:08:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 Processor -- start 2022-02-02T19:08:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 -- start start 2022-02-02T19:08:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f6860 0x7fd09810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980603e0 con 0x7fd0980f6860 2022-02-02T19:08:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09f3c9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098060520 con 0x7fd0980f55c0 2022-02-02T19:08:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09d165700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09d165700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:33912/0 (socket says 172.21.15.96:33912) 2022-02-02T19:08:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.777+0000 7fd09d165700 1 -- 172.21.15.96:0/3290273725 learned_addr learned my addr 172.21.15.96:0/3290273725 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09d165700 1 -- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f6860 msgr2=0x7fd09810c170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T19:08:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09d165700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f6860 0x7fd09810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09d165700 1 -- 172.21.15.96:0/3290273725 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088005040 con 0x7fd0980f55c0 2022-02-02T19:08:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09d165700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd088013a70 tx=0x7fd088009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd088018070 con 0x7fd0980f55c0 2022-02-02T19:08:33.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09810c6c0 con 0x7fd0980f55c0 2022-02-02T19:08:33.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd0880097d0 con 0x7fd0980f55c0 2022-02-02T19:08:33.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08801c3c0 con 0x7fd0980f55c0 2022-02-02T19:08:33.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.778+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09810cc20 con 0x7fd0980f55c0 2022-02-02T19:08:33.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.779+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd098045ad0 con 0x7fd0980f55c0 2022-02-02T19:08:33.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.780+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd088007ba0 con 0x7fd0980f55c0 2022-02-02T19:08:33.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.780+0000 7fd08dffb700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 0x7fd084067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:33.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.780+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd088083780 con 0x7fd0980f55c0 2022-02-02T19:08:33.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.780+0000 7fd09c964700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 0x7fd084067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:33.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.781+0000 7fd09c964700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 0x7fd084067290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd094004a10 tx=0x7fd0940099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:33.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.785+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd0880518f0 con 0x7fd0980f55c0 2022-02-02T19:08:33.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.956+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd098057f10 con 0x7fd084064dd0 2022-02-02T19:08:33.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.965+0000 7fd08dffb700 1 -- 172.21.15.96:0/3290273725 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd098057f10 con 0x7fd084064dd0 2022-02-02T19:08:33.967 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:08:33.967 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (51m) 22m ago 53m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:08:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (44m) 22m ago 52m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:08:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (44m) 20m ago 52m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:08:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (51m) 22m ago 52m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:08:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (49m) 22m ago 49m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:08:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (44m) 22m ago 49m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:08:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (49m) 20m ago 49m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:08:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (44m) 20m ago 49m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:08:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (46m) 22m ago 54m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:08:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (45m) 20m ago 52m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:08:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (45m) 22m ago 54m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:08:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (44m) 20m ago 52m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:08:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (52m) 22m ago 52m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:08:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (52m) 20m ago 52m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:08:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (43m) 22m ago 51m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:08:33.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (43m) 22m ago 51m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:08:33.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (42m) 22m ago 51m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:08:33.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (42m) 20m ago 50m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:08:33.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (41m) 20m ago 50m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:08:33.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (41m) 20m ago 50m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:08:33.972 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (51m) 22m ago 52m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:08:33.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 msgr2=0x7fd084067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 0x7fd084067290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd094004a10 tx=0x7fd0940099e0).stop 2022-02-02T19:08:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 msgr2=0x7fd098109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd088013a70 tx=0x7fd088009b30).stop 2022-02-02T19:08:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 shutdown_connections 2022-02-02T19:08:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd084064dd0 0x7fd084067290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0980f55c0 0x7fd098109c70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 --2- 172.21.15.96:0/3290273725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0980f6860 0x7fd09810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 >> 172.21.15.96:0/3290273725 conn(0x7fd0980f0d40 msgr2=0x7fd0980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 shutdown_connections 2022-02-02T19:08:33.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:33.967+0000 7fd09f3c9700 1 -- 172.21.15.96:0/3290273725 wait complete. 2022-02-02T19:08:34.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 -- 172.21.15.96:0/327786104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f55c0 msgr2=0x7ff0ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 --2- 172.21.15.96:0/327786104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac0f59e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7ff09c004660 tx=0x7ff09c009b30).stop 2022-02-02T19:08:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 -- 172.21.15.96:0/327786104 shutdown_connections 2022-02-02T19:08:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 --2- 172.21.15.96:0/327786104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 --2- 172.21.15.96:0/327786104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac0f59e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 -- 172.21.15.96:0/327786104 >> 172.21.15.96:0/327786104 conn(0x7ff0ac0f0d40 msgr2=0x7ff0ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 -- 172.21.15.96:0/327786104 shutdown_connections 2022-02-02T19:08:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 -- 172.21.15.96:0/327786104 wait complete. 2022-02-02T19:08:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.064+0000 7ff0b415e700 1 Processor -- start 2022-02-02T19:08:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 -- start start 2022-02-02T19:08:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0603e0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac060520 con 0x7ff0ac0f55c0 2022-02-02T19:08:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58052/0 (socket says 172.21.15.96:58052) 2022-02-02T19:08:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 -- 172.21.15.96:0/2079557340 learned_addr learned my addr 172.21.15.96:0/2079557340 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b1efa700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 -- 172.21.15.96:0/2079557340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f55c0 msgr2=0x7ff0ac109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 -- 172.21.15.96:0/2079557340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c005040 con 0x7ff0ac0f6860 2022-02-02T19:08:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b16f9700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7ff0a80026d0 tx=0x7ff0a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a80079c0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac10c720 con 0x7ff0ac0f6860 2022-02-02T19:08:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff0a800f040 con 0x7ff0ac0f6860 2022-02-02T19:08:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.065+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a80148b0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.066+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac10cce0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.066+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac045ad0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.067+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff0a8007b20 con 0x7ff0ac0f6860 2022-02-02T19:08:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.067+0000 7ff0a27fc700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 0x7ff098067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.068+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff0a8081e40 con 0x7ff0ac0f6860 2022-02-02T19:08:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.068+0000 7ff0b1efa700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 0x7ff098067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.068+0000 7ff0b1efa700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 0x7ff098067290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7ff09c013690 tx=0x7ff09c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.071+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff0a804fef0 con 0x7ff0ac0f6860 2022-02-02T19:08:34.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.300+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0ac027a00 con 0x7ff0ac0f6860 2022-02-02T19:08:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.300+0000 7ff0a27fc700 1 -- 172.21.15.96:0/2079557340 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff0a8053510 con 0x7ff0ac0f6860 2022-02-02T19:08:34.302 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:08:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:08:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:08:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:08:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:08:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:08:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:08:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:08:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:08:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:08:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:08:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:08:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:08:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:08:34.307 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:08:34.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 msgr2=0x7ff098067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 0x7ff098067290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7ff09c013690 tx=0x7ff09c009b30).stop 2022-02-02T19:08:34.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 msgr2=0x7ff0ac10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7ff0a80026d0 tx=0x7ff0a8009de0).stop 2022-02-02T19:08:34.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 shutdown_connections 2022-02-02T19:08:34.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff098064dd0 0x7ff098067290 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ac0f55c0 0x7ff0ac109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 --2- 172.21.15.96:0/2079557340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ac0f6860 0x7ff0ac10c170 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 >> 172.21.15.96:0/2079557340 conn(0x7ff0ac0f0d40 msgr2=0x7ff0ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 shutdown_connections 2022-02-02T19:08:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.302+0000 7ff0b415e700 1 -- 172.21.15.96:0/2079557340 wait complete. 2022-02-02T19:08:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 -- 172.21.15.96:0/1619155707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 msgr2=0x7f3c180f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 --2- 172.21.15.96:0/1619155707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c180f6d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f3c08004660 tx=0x7f3c08009b30).stop 2022-02-02T19:08:34.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 -- 172.21.15.96:0/1619155707 shutdown_connections 2022-02-02T19:08:34.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 --2- 172.21.15.96:0/1619155707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 0x7f3c180f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:08:34.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 --2- 172.21.15.96:0/1619155707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c180f6d00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.400+0000 7f3c1e260700 1 -- 172.21.15.96:0/1619155707 >> 172.21.15.96:0/1619155707 conn(0x7f3c180f2020 msgr2=0x7f3c180f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:34.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.401+0000 7f3c1e260700 1 -- 172.21.15.96:0/1619155707 shutdown_connections 2022-02-02T19:08:34.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.401+0000 7f3c1e260700 1 -- 172.21.15.96:0/1619155707 wait complete. 2022-02-02T19:08:34.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.401+0000 7f3c1e260700 1 Processor -- start 2022-02-02T19:08:34.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.401+0000 7f3c1e260700 1 -- start start 2022-02-02T19:08:34.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 0x7f3c18107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18107cb0 con 0x7f3c180f68e0 2022-02-02T19:08:34.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18108560 con 0x7f3c180f7b80 2022-02-02T19:08:34.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58060/0 (socket says 172.21.15.96:58060) 2022-02-02T19:08:34.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 -- 172.21.15.96:0/351398273 learned_addr learned my addr 172.21.15.96:0/351398273 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:08:34.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c16ffd700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 0x7f3c18107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 -- 172.21.15.96:0/351398273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 msgr2=0x7f3c18107670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 0x7f3c18107670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 -- 172.21.15.96:0/351398273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08005040 con 0x7f3c180f68e0 2022-02-02T19:08:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c177fe700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3c08004f60 tx=0x7f3c08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c08018070 con 0x7f3c180f68e0 2022-02-02T19:08:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c08007ba0 con 0x7f3c180f68e0 2022-02-02T19:08:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c181087e0 con 0x7f3c180f68e0 2022-02-02T19:08:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0801c620 con 0x7f3c180f68e0 2022-02-02T19:08:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.402+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18108d40 con 0x7f3c180f68e0 2022-02-02T19:08:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.404+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c180f5cd0 con 0x7f3c180f68e0 2022-02-02T19:08:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.404+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c0801c8e0 con 0x7f3c180f68e0 2022-02-02T19:08:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.405+0000 7f3bfffff700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 0x7f3c00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:08:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.405+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3c08083990 con 0x7f3c180f68e0 2022-02-02T19:08:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.405+0000 7f3c16ffd700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 0x7f3c00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:08:34.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.405+0000 7f3c16ffd700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 0x7f3c00067290 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f3c0c00b790 tx=0x7f3c0c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:08:34.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.409+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c08055470 con 0x7f3c180f68e0 2022-02-02T19:08:34.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.610+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c18045ad0 con 0x7f3c180f68e0 2022-02-02T19:08:34.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.610+0000 7f3bfffff700 1 -- 172.21.15.96:0/351398273 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3c08055060 con 0x7f3c180f68e0 2022-02-02T19:08:34.613 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:08:34.613 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:08:34.613 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:08:34.613 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:08:34.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:34.614 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:08:34.614 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:08:34.614 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:08:34.615 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:08:34.615 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:08:34.615 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:08:34.615 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:08:34.616 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:08:34.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:08:34.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:08:34.616 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:08:34.617 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:08:34.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:08:34.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:08:34.617 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:08:34.617 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:08:34.618 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:08:34.618 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:08:34.618 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:08:34.618 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:08:34.619 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:08:34.619 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:08:34.619 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:08:34.619 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:08:34.620 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:08:34.620 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:08:34.620 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:08:34.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:34.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:34.621 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:08:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:08:34.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:34.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:34.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:08:34.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 msgr2=0x7f3c00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 0x7f3c00067290 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f3c0c00b790 tx=0x7f3c0c008040).stop 2022-02-02T19:08:34.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 msgr2=0x7f3c18107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:08:34.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3c08004f60 tx=0x7f3c08009b30).stop 2022-02-02T19:08:34.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 shutdown_connections 2022-02-02T19:08:34.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c00064dd0 0x7f3c00067290 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c180f68e0 0x7f3c18107180 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 --2- 172.21.15.96:0/351398273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c180f7b80 0x7f3c18107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:08:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 >> 172.21.15.96:0/351398273 conn(0x7f3c180f2020 msgr2=0x7f3c180fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:08:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 shutdown_connections 2022-02-02T19:08:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:08:34.612+0000 7f3c1e260700 1 -- 172.21.15.96:0/351398273 wait complete. 2022-02-02T19:08:34.626 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:08:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:34 smithi159 ceph-mon[69013]: pgmap v1393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:35.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:34 smithi159 ceph-mon[69013]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:35.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2079557340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:08:35.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/351398273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:08:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:34 smithi096 ceph-mon[101353]: pgmap v1393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:34 smithi096 ceph-mon[101353]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:35.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2079557340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:08:35.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/351398273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:08:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:35 smithi159 ceph-mon[69013]: from='client.44979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:35 smithi096 ceph-mon[101353]: from='client.44979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:08:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:36 smithi159 ceph-mon[69013]: pgmap v1394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:36 smithi096 ceph-mon[101353]: pgmap v1394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:38 smithi159 ceph-mon[69013]: pgmap v1395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:39.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:38 smithi096 ceph-mon[101353]: pgmap v1395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:40 smithi159 ceph-mon[69013]: pgmap v1396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:40 smithi096 ceph-mon[101353]: pgmap v1396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:42 smithi159 ceph-mon[69013]: pgmap v1397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:42 smithi096 ceph-mon[101353]: pgmap v1397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:45.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:44 smithi159 ceph-mon[69013]: pgmap v1398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:44 smithi096 ceph-mon[101353]: pgmap v1398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:46 smithi159 ceph-mon[69013]: pgmap v1399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:46 smithi096 ceph-mon[101353]: pgmap v1399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:48 smithi159 ceph-mon[69013]: pgmap v1400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:48 smithi096 ceph-mon[101353]: pgmap v1400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:50 smithi159 ceph-mon[69013]: pgmap v1401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:50 smithi096 ceph-mon[101353]: pgmap v1401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:52 smithi159 ceph-mon[69013]: pgmap v1402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:52 smithi096 ceph-mon[101353]: pgmap v1402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:54 smithi159 ceph-mon[69013]: pgmap v1403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:54 smithi096 ceph-mon[101353]: pgmap v1403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:56 smithi159 ceph-mon[69013]: pgmap v1404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:56 smithi096 ceph-mon[101353]: pgmap v1404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:08:58 smithi159 ceph-mon[69013]: pgmap v1405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:08:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:08:58 smithi096 ceph-mon[101353]: pgmap v1405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:00 smithi159 ceph-mon[69013]: pgmap v1406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:00 smithi096 ceph-mon[101353]: pgmap v1406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:02 smithi159 ceph-mon[69013]: pgmap v1407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:02 smithi096 ceph-mon[101353]: pgmap v1407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 -- 172.21.15.96:0/624079126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 msgr2=0x7f44000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 --2- 172.21.15.96:0/624079126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f44000f6cc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f43ec004660 tx=0x7f43ec009b30).stop 2022-02-02T19:09:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 -- 172.21.15.96:0/624079126 shutdown_connections 2022-02-02T19:09:04.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 --2- 172.21.15.96:0/624079126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f44000f6cc0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:04.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 --2- 172.21.15.96:0/624079126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f44000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:09:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 -- 172.21.15.96:0/624079126 >> 172.21.15.96:0/624079126 conn(0x7f44000f0d40 msgr2=0x7f44000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 -- 172.21.15.96:0/624079126 shutdown_connections 2022-02-02T19:09:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 -- 172.21.15.96:0/624079126 wait complete. 2022-02-02T19:09:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.724+0000 7f4406afa700 1 Processor -- start 2022-02-02T19:09:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4406afa700 1 -- start start 2022-02-02T19:09:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4406afa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f4400104d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:04.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4406afa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4406afa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400105890 con 0x7f44000f6860 2022-02-02T19:09:04.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4406afa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400106140 con 0x7f44000f55c0 2022-02-02T19:09:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f43fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f43fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58084/0 (socket says 172.21.15.96:58084) 2022-02-02T19:09:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f43fffff700 1 -- 172.21.15.96:0/3264972982 learned_addr learned my addr 172.21.15.96:0/3264972982 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f4404896700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f4400104d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.725+0000 7f43fffff700 1 -- 172.21.15.96:0/3264972982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 msgr2=0x7f4400104d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fffff700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f4400104d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fffff700 1 -- 172.21.15.96:0/3264972982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec005040 con 0x7f44000f6860 2022-02-02T19:09:04.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f4404896700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f4400104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:09:04.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fffff700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f43ec009990 tx=0x7f43ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:04.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43ec018070 con 0x7f44000f6860 2022-02-02T19:09:04.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4400106390 con 0x7f44000f6860 2022-02-02T19:09:04.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44001068f0 con 0x7f44000f6860 2022-02-02T19:09:04.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f43ec007ca0 con 0x7f44000f6860 2022-02-02T19:09:04.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.726+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43ec01c3c0 con 0x7f44000f6860 2022-02-02T19:09:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.727+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e0004fa0 con 0x7f44000f6860 2022-02-02T19:09:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.728+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f43ec01d420 con 0x7f44000f6860 2022-02-02T19:09:04.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.728+0000 7f43fd7fa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 0x7f43f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:04.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.728+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f43ec083670 con 0x7f44000f6860 2022-02-02T19:09:04.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.728+0000 7f4404896700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 0x7f43f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:04.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.729+0000 7f4404896700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 0x7f43f0067290 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f4400104aa0 tx=0x7f43f4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:04.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.732+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f43ec0517e0 con 0x7f44000f6860 2022-02-02T19:09:04.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.910+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e0000bc0 con 0x7f43f0064dd0 2022-02-02T19:09:04.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.911+0000 7f43fd7fa700 1 -- 172.21.15.96:0/3264972982 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f43e0000bc0 con 0x7f43f0064dd0 2022-02-02T19:09:04.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 msgr2=0x7f43f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:04.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 0x7f43f0067290 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f4400104aa0 tx=0x7f43f4008040).stop 2022-02-02T19:09:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 msgr2=0x7f4400105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f43ec009990 tx=0x7f43ec009b30).stop 2022-02-02T19:09:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 shutdown_connections 2022-02-02T19:09:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43f0064dd0 0x7f43f0067290 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44000f55c0 0x7f4400104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 --2- 172.21.15.96:0/3264972982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44000f6860 0x7f4400105200 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 >> 172.21.15.96:0/3264972982 conn(0x7f44000f0d40 msgr2=0x7f440005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 shutdown_connections 2022-02-02T19:09:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:04.913+0000 7f4406afa700 1 -- 172.21.15.96:0/3264972982 wait complete. 2022-02-02T19:09:04.925 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:09:05.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 -- 172.21.15.96:0/4117100851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f66e0 msgr2=0x7f11440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 --2- 172.21.15.96:0/4117100851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f66e0 0x7f11440f6b00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f1138004660 tx=0x7f1138009b30).stop 2022-02-02T19:09:05.013 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:04 smithi096 ceph-mon[101353]: pgmap v1408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:05.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 -- 172.21.15.96:0/4117100851 shutdown_connections 2022-02-02T19:09:05.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 --2- 172.21.15.96:0/4117100851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f7980 0x7f11440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 --2- 172.21.15.96:0/4117100851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f66e0 0x7f11440f6b00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 -- 172.21.15.96:0/4117100851 >> 172.21.15.96:0/4117100851 conn(0x7f11440f1e40 msgr2=0x7f11440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 -- 172.21.15.96:0/4117100851 shutdown_connections 2022-02-02T19:09:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.011+0000 7f114b0b0700 1 -- 172.21.15.96:0/4117100851 wait complete. 2022-02-02T19:09:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 Processor -- start 2022-02-02T19:09:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 -- start start 2022-02-02T19:09:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f66e0 0x7f1144106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144107a50 con 0x7f11440f7980 2022-02-02T19:09:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f114b0b0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144107b90 con 0x7f11440f66e0 2022-02-02T19:09:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f1143fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f1143fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58092/0 (socket says 172.21.15.96:58092) 2022-02-02T19:09:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.012+0000 7f1143fff700 1 -- 172.21.15.96:0/1637423050 learned_addr learned my addr 172.21.15.96:0/1637423050 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f1148e4c700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f66e0 0x7f1144106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f1143fff700 1 -- 172.21.15.96:0/1637423050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f66e0 msgr2=0x7f1144106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f1143fff700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f66e0 0x7f1144106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f1143fff700 1 -- 172.21.15.96:0/1637423050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138005040 con 0x7f11440f7980 2022-02-02T19:09:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f1143fff700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f113000c530 tx=0x7f1130007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113000f650 con 0x7f11440f7980 2022-02-02T19:09:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f113000fc60 con 0x7f11440f7980 2022-02-02T19:09:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1144108530 con 0x7f11440f7980 2022-02-02T19:09:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1130012cd0 con 0x7f11440f7980 2022-02-02T19:09:05.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.013+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1144108af0 con 0x7f11440f7980 2022-02-02T19:09:05.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.014+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144045ad0 con 0x7f11440f7980 2022-02-02T19:09:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.015+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1130010070 con 0x7f11440f7980 2022-02-02T19:09:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.015+0000 7f11417fa700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 0x7f1134067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.015+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1130081740 con 0x7f11440f7980 2022-02-02T19:09:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.015+0000 7f1148e4c700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 0x7f1134067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.015+0000 7f1148e4c700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 0x7f1134067290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f1138004e30 tx=0x7f1138009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.019+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11300477d0 con 0x7f11440f7980 2022-02-02T19:09:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:04 smithi159 ceph-mon[69013]: pgmap v1408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:05.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.190+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11440fefb0 con 0x7f1134064dd0 2022-02-02T19:09:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.200+0000 7f11417fa700 1 -- 172.21.15.96:0/1637423050 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f11440fefb0 con 0x7f1134064dd0 2022-02-02T19:09:05.202 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:09:05.202 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (52m) 23m ago 53m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:09:05.203 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (44m) 23m ago 53m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:09:05.203 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (44m) 21m ago 53m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:09:05.204 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (52m) 23m ago 53m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:09:05.204 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (49m) 23m ago 49m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:09:05.204 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (45m) 23m ago 49m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:09:05.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (49m) 21m ago 49m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:09:05.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (45m) 21m ago 49m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:09:05.206 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (46m) 23m ago 54m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:09:05.206 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (46m) 21m ago 52m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:09:05.207 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (45m) 23m ago 54m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:09:05.207 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (45m) 21m ago 52m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:09:05.207 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (53m) 23m ago 53m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:09:05.208 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (52m) 21m ago 52m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:09:05.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (44m) 23m ago 52m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:09:05.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (43m) 23m ago 52m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:09:05.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (43m) 23m ago 51m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:09:05.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (42m) 21m ago 51m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:09:05.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (42m) 21m ago 51m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:09:05.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (41m) 21m ago 50m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:09:05.210 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (52m) 23m ago 53m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:09:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.201+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 msgr2=0x7f1134067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.201+0000 7f114b0b0700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 0x7f1134067290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f1138004e30 tx=0x7f1138009b30).stop 2022-02-02T19:09:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.201+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 msgr2=0x7f11441074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.201+0000 7f114b0b0700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f113000c530 tx=0x7f1130007e20).stop 2022-02-02T19:09:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 shutdown_connections 2022-02-02T19:09:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1134064dd0 0x7f1134067290 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11440f66e0 0x7f1144106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 --2- 172.21.15.96:0/1637423050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11440f7980 0x7f11441074a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 >> 172.21.15.96:0/1637423050 conn(0x7f11440f1e40 msgr2=0x7f11440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 shutdown_connections 2022-02-02T19:09:05.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.202+0000 7f114b0b0700 1 -- 172.21.15.96:0/1637423050 wait complete. 2022-02-02T19:09:05.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- 172.21.15.96:0/3578996645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f55c0 msgr2=0x7fba480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 --2- 172.21.15.96:0/3578996645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f55c0 0x7fba480f59e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fba3c004660 tx=0x7fba3c009b30).stop 2022-02-02T19:09:05.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- 172.21.15.96:0/3578996645 shutdown_connections 2022-02-02T19:09:05.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 --2- 172.21.15.96:0/3578996645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f6860 0x7fba480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 --2- 172.21.15.96:0/3578996645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f55c0 0x7fba480f59e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- 172.21.15.96:0/3578996645 >> 172.21.15.96:0/3578996645 conn(0x7fba480f0d40 msgr2=0x7fba480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- 172.21.15.96:0/3578996645 shutdown_connections 2022-02-02T19:09:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- 172.21.15.96:0/3578996645 wait complete. 2022-02-02T19:09:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 Processor -- start 2022-02-02T19:09:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.298+0000 7fba4cf63700 1 -- start start 2022-02-02T19:09:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba4cf63700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f55c0 0x7fba48109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba4cf63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba4cf63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480603e0 con 0x7fba480f6860 2022-02-02T19:09:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba4cf63700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba48060520 con 0x7fba480f55c0 2022-02-02T19:09:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58102/0 (socket says 172.21.15.96:58102) 2022-02-02T19:09:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 -- 172.21.15.96:0/1650361395 learned_addr learned my addr 172.21.15.96:0/1650361395 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba4659c700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f55c0 0x7fba48109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 -- 172.21.15.96:0/1650361395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f55c0 msgr2=0x7fba48109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f55c0 0x7fba48109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 -- 172.21.15.96:0/1650361395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c005040 con 0x7fba480f6860 2022-02-02T19:09:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.299+0000 7fba45d9b700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fba380026d0 tx=0x7fba38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.300+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba38009320 con 0x7fba480f6860 2022-02-02T19:09:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.300+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4810c720 con 0x7fba480f6860 2022-02-02T19:09:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.300+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba3800f040 con 0x7fba480f6860 2022-02-02T19:09:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.300+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba380147e0 con 0x7fba480f6860 2022-02-02T19:09:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.300+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4810cce0 con 0x7fba480f6860 2022-02-02T19:09:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.301+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba48045ad0 con 0x7fba480f6860 2022-02-02T19:09:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.301+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba38009480 con 0x7fba480f6860 2022-02-02T19:09:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.301+0000 7fba36ffd700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 0x7fba30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.301+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fba380820e0 con 0x7fba480f6860 2022-02-02T19:09:05.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.301+0000 7fba4659c700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 0x7fba30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.302+0000 7fba4659c700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 0x7fba30067290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fba3c004e30 tx=0x7fba3c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.306+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba38050190 con 0x7fba480f6860 2022-02-02T19:09:05.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.540+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba48027a00 con 0x7fba480f6860 2022-02-02T19:09:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.540+0000 7fba36ffd700 1 -- 172.21.15.96:0/1650361395 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fba380537b0 con 0x7fba480f6860 2022-02-02T19:09:05.542 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:09:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:09:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:09:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:09:05.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:09:05.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:05.544 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:09:05.545 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:09:05.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:05.545 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:09:05.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:09:05.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:05.546 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:09:05.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:09:05.547 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:09:05.547 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:09:05.547 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:09:05.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 msgr2=0x7fba30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 0x7fba30067290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fba3c004e30 tx=0x7fba3c009b30).stop 2022-02-02T19:09:05.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 msgr2=0x7fba4810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fba380026d0 tx=0x7fba38009de0).stop 2022-02-02T19:09:05.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 shutdown_connections 2022-02-02T19:09:05.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba30064dd0 0x7fba30067290 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba480f55c0 0x7fba48109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 --2- 172.21.15.96:0/1650361395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba480f6860 0x7fba4810c170 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 >> 172.21.15.96:0/1650361395 conn(0x7fba480f0d40 msgr2=0x7fba480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 shutdown_connections 2022-02-02T19:09:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.542+0000 7fba4cf63700 1 -- 172.21.15.96:0/1650361395 wait complete. 2022-02-02T19:09:05.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 -- 172.21.15.96:0/2927474820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f6880 msgr2=0x7efd500f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 --2- 172.21.15.96:0/2927474820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f6880 0x7efd500f6ce0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7efd4c004660 tx=0x7efd4c009b30).stop 2022-02-02T19:09:05.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 -- 172.21.15.96:0/2927474820 shutdown_connections 2022-02-02T19:09:05.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 --2- 172.21.15.96:0/2927474820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f6880 0x7efd500f6ce0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 --2- 172.21.15.96:0/2927474820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f55e0 0x7efd500f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 -- 172.21.15.96:0/2927474820 >> 172.21.15.96:0/2927474820 conn(0x7efd500f0d40 msgr2=0x7efd500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 -- 172.21.15.96:0/2927474820 shutdown_connections 2022-02-02T19:09:05.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.640+0000 7efd577c7700 1 -- 172.21.15.96:0/2927474820 wait complete. 2022-02-02T19:09:05.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 Processor -- start 2022-02-02T19:09:05.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 -- start start 2022-02-02T19:09:05.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f6880 0x7efd50109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50109be0 con 0x7efd500f55e0 2022-02-02T19:09:05.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd577c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50109d20 con 0x7efd500f6880 2022-02-02T19:09:05.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58110/0 (socket says 172.21.15.96:58110) 2022-02-02T19:09:05.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 -- 172.21.15.96:0/632884151 learned_addr learned my addr 172.21.15.96:0/632884151 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:05.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd54d62700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f6880 0x7efd50109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 -- 172.21.15.96:0/632884151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f6880 msgr2=0x7efd50109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f6880 0x7efd50109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.641+0000 7efd55563700 1 -- 172.21.15.96:0/632884151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c005040 con 0x7efd500f55e0 2022-02-02T19:09:05.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd55563700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd4000c530 tx=0x7efd40007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4000f650 con 0x7efd500f55e0 2022-02-02T19:09:05.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd4000fc60 con 0x7efd500f55e0 2022-02-02T19:09:05.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd40012d20 con 0x7efd500f55e0 2022-02-02T19:09:05.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5010a6c0 con 0x7efd500f55e0 2022-02-02T19:09:05.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.642+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5010ac80 con 0x7efd500f55e0 2022-02-02T19:09:05.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.643+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50045ad0 con 0x7efd500f55e0 2022-02-02T19:09:05.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.643+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd40019030 con 0x7efd500f55e0 2022-02-02T19:09:05.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.644+0000 7efd45ffb700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 0x7efd3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:05.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.644+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efd40081700 con 0x7efd500f55e0 2022-02-02T19:09:05.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.644+0000 7efd54d62700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 0x7efd3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:05.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.644+0000 7efd54d62700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 0x7efd3c067290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7efd4c004e30 tx=0x7efd4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:05.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.648+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd40053230 con 0x7efd500f55e0 2022-02-02T19:09:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.851+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd5010f760 con 0x7efd500f55e0 2022-02-02T19:09:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.851+0000 7efd45ffb700 1 -- 172.21.15.96:0/632884151 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efd40052e20 con 0x7efd500f55e0 2022-02-02T19:09:05.854 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:09:05.854 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:09:05.854 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:09:05.855 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:09:05.855 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:05.855 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:09:05.855 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:09:05.856 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:09:05.856 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:09:05.856 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:09:05.857 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:09:05.857 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:09:05.857 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:09:05.857 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:09:05.857 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:09:05.858 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:09:05.858 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:09:05.858 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:09:05.858 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:09:05.859 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:09:05.859 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:09:05.859 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:09:05.859 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:09:05.860 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:09:05.860 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:09:05.860 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:09:05.860 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:09:05.861 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:09:05.861 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:09:05.861 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:09:05.861 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:09:05.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:09:05.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:05.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:05.862 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:09:05.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:05.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:05.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:05.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.854+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 msgr2=0x7efd3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.854+0000 7efd577c7700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 0x7efd3c067290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7efd4c004e30 tx=0x7efd4c009b30).stop 2022-02-02T19:09:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.854+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 msgr2=0x7efd50109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd4000c530 tx=0x7efd40007e10).stop 2022-02-02T19:09:05.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 shutdown_connections 2022-02-02T19:09:05.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd3c064dd0 0x7efd3c067290 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd500f55e0 0x7efd50109140 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 --2- 172.21.15.96:0/632884151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd500f6880 0x7efd50109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:05.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 >> 172.21.15.96:0/632884151 conn(0x7efd500f0d40 msgr2=0x7efd5005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:05.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 shutdown_connections 2022-02-02T19:09:05.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:05.855+0000 7efd577c7700 1 -- 172.21.15.96:0/632884151 wait complete. 2022-02-02T19:09:05.867 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:09:06.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1650361395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:09:06.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1650361395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:09:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:06 smithi159 ceph-mon[69013]: from='client.35562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:06 smithi159 ceph-mon[69013]: from='client.35566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:06 smithi159 ceph-mon[69013]: pgmap v1409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/632884151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:09:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:06 smithi096 ceph-mon[101353]: from='client.35562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:06 smithi096 ceph-mon[101353]: from='client.35566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:06 smithi096 ceph-mon[101353]: pgmap v1409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/632884151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:09:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:08 smithi159 ceph-mon[69013]: pgmap v1410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:08 smithi096 ceph-mon[101353]: pgmap v1410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:10 smithi159 ceph-mon[69013]: pgmap v1411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:10 smithi096 ceph-mon[101353]: pgmap v1411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:12 smithi159 ceph-mon[69013]: pgmap v1412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:12 smithi096 ceph-mon[101353]: pgmap v1412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:14 smithi159 ceph-mon[69013]: pgmap v1413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:14 smithi096 ceph-mon[101353]: pgmap v1413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:16 smithi159 ceph-mon[69013]: pgmap v1414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:16 smithi096 ceph-mon[101353]: pgmap v1414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:18 smithi159 ceph-mon[69013]: pgmap v1415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:18 smithi096 ceph-mon[101353]: pgmap v1415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:20 smithi159 ceph-mon[69013]: pgmap v1416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:20 smithi096 ceph-mon[101353]: pgmap v1416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:22 smithi159 ceph-mon[69013]: pgmap v1417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:22 smithi096 ceph-mon[101353]: pgmap v1417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:25.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:24 smithi159 ceph-mon[69013]: pgmap v1418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:24 smithi096 ceph-mon[101353]: pgmap v1418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:26 smithi159 ceph-mon[69013]: pgmap v1419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:26 smithi096 ceph-mon[101353]: pgmap v1419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:09:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:09:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:09:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:09:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:28 smithi159 ceph-mon[69013]: pgmap v1420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:28 smithi096 ceph-mon[101353]: pgmap v1420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:30 smithi159 ceph-mon[69013]: pgmap v1421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:30 smithi096 ceph-mon[101353]: pgmap v1421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:32 smithi159 ceph-mon[69013]: pgmap v1422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:32 smithi096 ceph-mon[101353]: pgmap v1422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:34 smithi159 ceph-mon[69013]: pgmap v1423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:34 smithi096 ceph-mon[101353]: pgmap v1423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:35.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 -- 172.21.15.96:0/1013413001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 msgr2=0x7f101c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:35.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 --2- 172.21.15.96:0/1013413001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c0f6cc0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f1004004660 tx=0x7f1004009b30).stop 2022-02-02T19:09:35.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 -- 172.21.15.96:0/1013413001 shutdown_connections 2022-02-02T19:09:35.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 --2- 172.21.15.96:0/1013413001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c0f6cc0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:35.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 --2- 172.21.15.96:0/1013413001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 0x7f101c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:35.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 -- 172.21.15.96:0/1013413001 >> 172.21.15.96:0/1013413001 conn(0x7f101c0f0d40 msgr2=0x7f101c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:35.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 -- 172.21.15.96:0/1013413001 shutdown_connections 2022-02-02T19:09:35.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.961+0000 7f10211e9700 1 -- 172.21.15.96:0/1013413001 wait complete. 2022-02-02T19:09:35.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 Processor -- start 2022-02-02T19:09:35.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 -- start start 2022-02-02T19:09:35.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 0x7f101c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:35.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:35.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0603e0 con 0x7f101c0f6860 2022-02-02T19:09:35.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f10211e9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c060520 con 0x7f101c0f55c0 2022-02-02T19:09:35.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f101a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:35.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f101a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58132/0 (socket says 172.21.15.96:58132) 2022-02-02T19:09:35.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f101a59c700 1 -- 172.21.15.96:0/3491872605 learned_addr learned my addr 172.21.15.96:0/3491872605 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:35.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f101ad9d700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 0x7f101c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:35.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.962+0000 7f101a59c700 1 -- 172.21.15.96:0/3491872605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 msgr2=0x7f101c109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f101a59c700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 0x7f101c109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f101a59c700 1 -- 172.21.15.96:0/3491872605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004005040 con 0x7f101c0f6860 2022-02-02T19:09:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f101a59c700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f1004009990 tx=0x7f1004009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1004018070 con 0x7f101c0f6860 2022-02-02T19:09:35.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c10c6a0 con 0x7f101c0f6860 2022-02-02T19:09:35.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c10cc00 con 0x7f101c0f6860 2022-02-02T19:09:35.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1004007ba0 con 0x7f101c0f6860 2022-02-02T19:09:35.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.963+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100401dea0 con 0x7f101c0f6860 2022-02-02T19:09:35.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.964+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1000004fa0 con 0x7f101c0f6860 2022-02-02T19:09:35.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.964+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f100401d420 con 0x7f101c0f6860 2022-02-02T19:09:35.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.965+0000 7f10137fe700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 0x7f1008067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:35.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.965+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1004083710 con 0x7f101c0f6860 2022-02-02T19:09:35.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.965+0000 7f101ad9d700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 0x7f1008067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.965+0000 7f101ad9d700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 0x7f1008067290 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f101c060060 tx=0x7f1014009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:35.969+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10040517c0 con 0x7f101c0f6860 2022-02-02T19:09:36.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.145+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1000000bc0 con 0x7f1008064dd0 2022-02-02T19:09:36.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.147+0000 7f10137fe700 1 -- 172.21.15.96:0/3491872605 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1000000bc0 con 0x7f1008064dd0 2022-02-02T19:09:36.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 msgr2=0x7f1008067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 0x7f1008067290 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f101c060060 tx=0x7f1014009c00).stop 2022-02-02T19:09:36.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 msgr2=0x7f101c10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f1004009990 tx=0x7f1004009b30).stop 2022-02-02T19:09:36.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 shutdown_connections 2022-02-02T19:09:36.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1008064dd0 0x7f1008067290 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f101c0f55c0 0x7f101c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 --2- 172.21.15.96:0/3491872605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f101c0f6860 0x7f101c10c150 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.148+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 >> 172.21.15.96:0/3491872605 conn(0x7f101c0f0d40 msgr2=0x7f101c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.149+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 shutdown_connections 2022-02-02T19:09:36.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.149+0000 7f10211e9700 1 -- 172.21.15.96:0/3491872605 wait complete. 2022-02-02T19:09:36.160 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:09:36.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 -- 172.21.15.96:0/1675925650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 msgr2=0x7f6e940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/1675925650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e940f7de0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f6e80004660 tx=0x7f6e80009b30).stop 2022-02-02T19:09:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 -- 172.21.15.96:0/1675925650 shutdown_connections 2022-02-02T19:09:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/1675925650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e940f7de0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/1675925650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:09:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 -- 172.21.15.96:0/1675925650 >> 172.21.15.96:0/1675925650 conn(0x7f6e940f1e40 msgr2=0x7f6e940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 -- 172.21.15.96:0/1675925650 shutdown_connections 2022-02-02T19:09:36.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 -- 172.21.15.96:0/1675925650 wait complete. 2022-02-02T19:09:36.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.246+0000 7f6e9ac91700 1 Processor -- start 2022-02-02T19:09:36.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e9ac91700 1 -- start start 2022-02-02T19:09:36.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e9ac91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e9ac91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e941074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e9ac91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94107ae0 con 0x7f6e940f7980 2022-02-02T19:09:36.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e9ac91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94108390 con 0x7f6e940f66e0 2022-02-02T19:09:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e98a2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e98a2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:34012/0 (socket says 172.21.15.96:34012) 2022-02-02T19:09:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.247+0000 7f6e98a2d700 1 -- 172.21.15.96:0/429395149 learned_addr learned my addr 172.21.15.96:0/429395149 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e93fff700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e941074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e98a2d700 1 -- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 msgr2=0x7f6e941074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e98a2d700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e941074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e98a2d700 1 -- 172.21.15.96:0/429395149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80005040 con 0x7f6e940f66e0 2022-02-02T19:09:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e98a2d700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6e880093f0 tx=0x7f6e88006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e88009ea0 con 0x7f6e940f66e0 2022-02-02T19:09:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94108670 con 0x7f6e940f66e0 2022-02-02T19:09:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e88013af0 con 0x7f6e940f66e0 2022-02-02T19:09:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e8800db10 con 0x7f6e940f66e0 2022-02-02T19:09:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.248+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e94108c30 con 0x7f6e940f66e0 2022-02-02T19:09:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.249+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e940f5ad0 con 0x7f6e940f66e0 2022-02-02T19:09:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.250+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e8801a060 con 0x7f6e940f66e0 2022-02-02T19:09:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.250+0000 7f6e917fa700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 0x7f6e84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.250+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e88081af0 con 0x7f6e940f66e0 2022-02-02T19:09:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.250+0000 7f6e93fff700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 0x7f6e84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.250+0000 7f6e93fff700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 0x7f6e84067290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f6e80004e30 tx=0x7f6e80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.254+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e880535d0 con 0x7f6e940f66e0 2022-02-02T19:09:36.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.429+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e940fefb0 con 0x7f6e84064dd0 2022-02-02T19:09:36.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.438+0000 7f6e917fa700 1 -- 172.21.15.96:0/429395149 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6e940fefb0 con 0x7f6e84064dd0 2022-02-02T19:09:36.441 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:09:36.441 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (52m) 23m ago 54m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:09:36.441 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (45m) 23m ago 54m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:09:36.442 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (45m) 22m ago 53m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:09:36.442 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (52m) 23m ago 53m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:09:36.442 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (50m) 23m ago 50m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:09:36.442 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (45m) 23m ago 50m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:09:36.442 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (50m) 22m ago 50m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:09:36.443 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (45m) 22m ago 50m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:09:36.443 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (47m) 23m ago 55m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:09:36.443 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (46m) 22m ago 53m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:09:36.443 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (46m) 23m ago 55m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:09:36.443 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (45m) 22m ago 53m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:09:36.444 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (53m) 23m ago 53m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:09:36.444 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (53m) 22m ago 53m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:09:36.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (45m) 23m ago 52m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:09:36.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (44m) 23m ago 52m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:09:36.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (43m) 23m ago 52m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:09:36.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (43m) 22m ago 51m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:09:36.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (42m) 22m ago 51m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:09:36.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (42m) 22m ago 51m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:09:36.445 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (52m) 23m ago 53m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:09:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.440+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 msgr2=0x7f6e84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.440+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 0x7f6e84067290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f6e80004e30 tx=0x7f6e80009b30).stop 2022-02-02T19:09:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.440+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 msgr2=0x7f6e94106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.440+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6e880093f0 tx=0x7f6e88006ec0).stop 2022-02-02T19:09:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 shutdown_connections 2022-02-02T19:09:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e84064dd0 0x7f6e84067290 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e940f66e0 0x7f6e94106fb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 --2- 172.21.15.96:0/429395149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e940f7980 0x7f6e941074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 >> 172.21.15.96:0/429395149 conn(0x7f6e940f1e40 msgr2=0x7f6e940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 shutdown_connections 2022-02-02T19:09:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.441+0000 7f6e9ac91700 1 -- 172.21.15.96:0/429395149 wait complete. 2022-02-02T19:09:36.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 -- 172.21.15.96:0/1127087663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 msgr2=0x7f160c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 --2- 172.21.15.96:0/1127087663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c0f6b00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f1600004660 tx=0x7f1600009b30).stop 2022-02-02T19:09:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 -- 172.21.15.96:0/1127087663 shutdown_connections 2022-02-02T19:09:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 --2- 172.21.15.96:0/1127087663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 0x7f160c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 --2- 172.21.15.96:0/1127087663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c0f6b00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 -- 172.21.15.96:0/1127087663 >> 172.21.15.96:0/1127087663 conn(0x7f160c0f1e40 msgr2=0x7f160c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 -- 172.21.15.96:0/1127087663 shutdown_connections 2022-02-02T19:09:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.537+0000 7f1614653700 1 -- 172.21.15.96:0/1127087663 wait complete. 2022-02-02T19:09:36.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 Processor -- start 2022-02-02T19:09:36.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 -- start start 2022-02-02T19:09:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 0x7f160c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c107a00 con 0x7f160c0f66e0 2022-02-02T19:09:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1614653700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c107b40 con 0x7f160c0f7980 2022-02-02T19:09:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f16123ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f16123ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58148/0 (socket says 172.21.15.96:58148) 2022-02-02T19:09:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f16123ef700 1 -- 172.21.15.96:0/1976313843 learned_addr learned my addr 172.21.15.96:0/1976313843 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.538+0000 7f1611bee700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 0x7f160c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f16123ef700 1 -- 172.21.15.96:0/1976313843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 msgr2=0x7f160c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f16123ef700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 0x7f160c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f16123ef700 1 -- 172.21.15.96:0/1976313843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600005040 con 0x7f160c0f66e0 2022-02-02T19:09:36.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f16123ef700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1600013a70 tx=0x7f1600009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1600018070 con 0x7f160c0f66e0 2022-02-02T19:09:36.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c108480 con 0x7f160c0f66e0 2022-02-02T19:09:36.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16000097d0 con 0x7f160c0f66e0 2022-02-02T19:09:36.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160001de80 con 0x7f160c0f66e0 2022-02-02T19:09:36.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.539+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c1089e0 con 0x7f160c0f66e0 2022-02-02T19:09:36.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.540+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c045ad0 con 0x7f160c0f66e0 2022-02-02T19:09:36.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.540+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1600007ba0 con 0x7f160c0f66e0 2022-02-02T19:09:36.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.541+0000 7f15feffd700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 0x7f15f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.541+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f16000836a0 con 0x7f160c0f66e0 2022-02-02T19:09:36.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.541+0000 7f1611bee700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 0x7f15f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.541+0000 7f1611bee700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 0x7f15f8067290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1608004ce0 tx=0x7f160800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.545+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1600055180 con 0x7f160c0f66e0 2022-02-02T19:09:36.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.782+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f160c0fef40 con 0x7f160c0f66e0 2022-02-02T19:09:36.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.783+0000 7f15feffd700 1 -- 172.21.15.96:0/1976313843 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1600054d70 con 0x7f160c0f66e0 2022-02-02T19:09:36.785 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:09:36.785 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:09:36.786 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:09:36.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:36.786 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:09:36.786 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:09:36.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:36.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:09:36.787 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:09:36.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:36.787 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:09:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:09:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:09:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:09:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:09:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:09:36.789 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:09:36.789 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:09:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 msgr2=0x7f15f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 0x7f15f8067290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1608004ce0 tx=0x7f160800b040).stop 2022-02-02T19:09:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 msgr2=0x7f160c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1600013a70 tx=0x7f1600009b30).stop 2022-02-02T19:09:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 shutdown_connections 2022-02-02T19:09:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15f8064dd0 0x7f15f8067290 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f160c0f66e0 0x7f160c106f60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 --2- 172.21.15.96:0/1976313843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c0f7980 0x7f160c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 >> 172.21.15.96:0/1976313843 conn(0x7f160c0f1e40 msgr2=0x7f160c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 shutdown_connections 2022-02-02T19:09:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.785+0000 7f1614653700 1 -- 172.21.15.96:0/1976313843 wait complete. 2022-02-02T19:09:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:36 smithi096 ceph-mon[101353]: pgmap v1424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:36.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 -- 172.21.15.96:0/279090342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f77d0 msgr2=0x7fdb400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/279090342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f77d0 0x7fdb400f7c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fdb34004660 tx=0x7fdb34009b30).stop 2022-02-02T19:09:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 -- 172.21.15.96:0/279090342 shutdown_connections 2022-02-02T19:09:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/279090342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f77d0 0x7fdb400f7c30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/279090342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f6530 0x7fdb400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.882+0000 7fdb3f59e700 1 -- 172.21.15.96:0/279090342 >> 172.21.15.96:0/279090342 conn(0x7fdb400f1c90 msgr2=0x7fdb400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:36.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 -- 172.21.15.96:0/279090342 shutdown_connections 2022-02-02T19:09:36.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 -- 172.21.15.96:0/279090342 wait complete. 2022-02-02T19:09:36.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 Processor -- start 2022-02-02T19:09:36.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 -- start start 2022-02-02T19:09:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f77d0 0x7fdb40107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb401077f0 con 0x7fdb400f6530 2022-02-02T19:09:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40107ff0 con 0x7fdb400f77d0 2022-02-02T19:09:36.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58158/0 (socket says 172.21.15.96:58158) 2022-02-02T19:09:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.883+0000 7fdb3e59c700 1 -- 172.21.15.96:0/2694662657 learned_addr learned my addr 172.21.15.96:0/2694662657 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:09:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3dd9b700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f77d0 0x7fdb40107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3e59c700 1 -- 172.21.15.96:0/2694662657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f77d0 msgr2=0x7fdb40107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3e59c700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f77d0 0x7fdb40107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3e59c700 1 -- 172.21.15.96:0/2694662657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34005040 con 0x7fdb400f6530 2022-02-02T19:09:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3e59c700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fdb3000c790 tx=0x7fdb30007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb3000e680 con 0x7fdb400f6530 2022-02-02T19:09:36.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb3000ec90 con 0x7fdb400f6530 2022-02-02T19:09:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb401082d0 con 0x7fdb400f6530 2022-02-02T19:09:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb30012d00 con 0x7fdb400f6530 2022-02-02T19:09:36.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.884+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb40108890 con 0x7fdb400f6530 2022-02-02T19:09:36.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.885+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb40059100 con 0x7fdb400f6530 2022-02-02T19:09:36.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.885+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdb30010070 con 0x7fdb400f6530 2022-02-02T19:09:36.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.886+0000 7fdb2effd700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 0x7fdb280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:09:36.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.886+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdb30081aa0 con 0x7fdb400f6530 2022-02-02T19:09:36.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.886+0000 7fdb3dd9b700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 0x7fdb280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:09:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.886+0000 7fdb3dd9b700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 0x7fdb280672e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdb34009da0 tx=0x7fdb34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:09:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:36.890+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb30053520 con 0x7fdb400f6530 2022-02-02T19:09:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:36 smithi159 ceph-mon[69013]: pgmap v1424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:37.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.090+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb40045ad0 con 0x7fdb400f6530 2022-02-02T19:09:37.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.090+0000 7fdb2effd700 1 -- 172.21.15.96:0/2694662657 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdb30053110 con 0x7fdb400f6530 2022-02-02T19:09:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:09:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:09:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:09:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:09:37.094 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:37.094 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:09:37.094 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:09:37.094 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:09:37.095 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:09:37.095 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:09:37.095 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:09:37.095 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:09:37.095 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:09:37.096 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:09:37.096 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:09:37.096 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:09:37.096 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:09:37.096 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:09:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:09:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:09:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:09:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:09:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:09:37.098 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:09:37.098 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:09:37.098 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:09:37.098 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:09:37.099 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:37.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:37.100 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:09:37.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:09:37.100 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:37.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:37.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:09:37.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 msgr2=0x7fdb280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:37.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 0x7fdb280672e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdb34009da0 tx=0x7fdb34009b30).stop 2022-02-02T19:09:37.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 msgr2=0x7fdb40106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:09:37.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fdb3000c790 tx=0x7fdb30007d90).stop 2022-02-02T19:09:37.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 shutdown_connections 2022-02-02T19:09:37.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb28064e20 0x7fdb280672e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:37.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb400f6530 0x7fdb40106d50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:37.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 --2- 172.21.15.96:0/2694662657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb400f77d0 0x7fdb40107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:09:37.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 >> 172.21.15.96:0/2694662657 conn(0x7fdb400f1c90 msgr2=0x7fdb400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:09:37.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 shutdown_connections 2022-02-02T19:09:37.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:09:37.092+0000 7fdb3f59e700 1 -- 172.21.15.96:0/2694662657 wait complete. 2022-02-02T19:09:37.104 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:09:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:37 smithi159 ceph-mon[69013]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:37 smithi159 ceph-mon[69013]: from='client.45001 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1976313843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:09:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2694662657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:09:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:37 smithi096 ceph-mon[101353]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:37 smithi096 ceph-mon[101353]: from='client.45001 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:09:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1976313843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:09:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2694662657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:09:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:38 smithi159 ceph-mon[69013]: pgmap v1425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:39.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:38 smithi096 ceph-mon[101353]: pgmap v1425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:40 smithi159 ceph-mon[69013]: pgmap v1426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:40 smithi096 ceph-mon[101353]: pgmap v1426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:42 smithi159 ceph-mon[69013]: pgmap v1427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:42 smithi096 ceph-mon[101353]: pgmap v1427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:44 smithi159 ceph-mon[69013]: pgmap v1428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:44 smithi096 ceph-mon[101353]: pgmap v1428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:46 smithi159 ceph-mon[69013]: pgmap v1429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:46 smithi096 ceph-mon[101353]: pgmap v1429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:48 smithi159 ceph-mon[69013]: pgmap v1430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:48 smithi096 ceph-mon[101353]: pgmap v1430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:50 smithi159 ceph-mon[69013]: pgmap v1431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:50 smithi096 ceph-mon[101353]: pgmap v1431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:52 smithi159 ceph-mon[69013]: pgmap v1432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:52 smithi096 ceph-mon[101353]: pgmap v1432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:55.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:54 smithi159 ceph-mon[69013]: pgmap v1433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:54 smithi096 ceph-mon[101353]: pgmap v1433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:56 smithi159 ceph-mon[69013]: pgmap v1434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:56 smithi096 ceph-mon[101353]: pgmap v1434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:09:58 smithi159 ceph-mon[69013]: pgmap v1435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:09:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:09:58 smithi096 ceph-mon[101353]: pgmap v1435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:01.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:00 smithi159 ceph-mon[69013]: pgmap v1436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:01.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:10:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:00 smithi096 ceph-mon[101353]: pgmap v1436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:01.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:10:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:02 smithi159 ceph-mon[69013]: pgmap v1437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:02 smithi096 ceph-mon[101353]: pgmap v1437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:05.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:04 smithi159 ceph-mon[69013]: pgmap v1438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:04 smithi096 ceph-mon[101353]: pgmap v1438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:06 smithi159 ceph-mon[69013]: pgmap v1439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:06 smithi096 ceph-mon[101353]: pgmap v1439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 -- 172.21.15.96:0/4189548474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f49a0 msgr2=0x7f97540f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 --2- 172.21.15.96:0/4189548474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f49a0 0x7f97540f4dc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f9744004660 tx=0x7f9744009b30).stop 2022-02-02T19:10:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 -- 172.21.15.96:0/4189548474 shutdown_connections 2022-02-02T19:10:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 --2- 172.21.15.96:0/4189548474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f5340 0x7f97540f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 --2- 172.21.15.96:0/4189548474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f49a0 0x7f97540f4dc0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 -- 172.21.15.96:0/4189548474 >> 172.21.15.96:0/4189548474 conn(0x7f97540f04c0 msgr2=0x7f97540f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:07.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 -- 172.21.15.96:0/4189548474 shutdown_connections 2022-02-02T19:10:07.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.201+0000 7f975a2f1700 1 -- 172.21.15.96:0/4189548474 wait complete. 2022-02-02T19:10:07.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 Processor -- start 2022-02-02T19:10:07.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 -- start start 2022-02-02T19:10:07.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f49a0 0x7f97540f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540f5f30 con 0x7f97540f5340 2022-02-02T19:10:07.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f975a2f1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540f6070 con 0x7f97540f49a0 2022-02-02T19:10:07.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f97537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f97537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58180/0 (socket says 172.21.15.96:58180) 2022-02-02T19:10:07.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f97537fe700 1 -- 172.21.15.96:0/1129702037 learned_addr learned my addr 172.21.15.96:0/1129702037 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:07.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.202+0000 7f9753fff700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f49a0 0x7f97540f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f97537fe700 1 -- 172.21.15.96:0/1129702037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f49a0 msgr2=0x7f97540f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f97537fe700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f49a0 0x7f97540f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f97537fe700 1 -- 172.21.15.96:0/1129702037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744005040 con 0x7f97540f5340 2022-02-02T19:10:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f97537fe700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f9748002700 tx=0x7f9748009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9748009320 con 0x7f97540f5340 2022-02-02T19:10:07.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f974800f040 con 0x7f97540f5340 2022-02-02T19:10:07.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97540f6350 con 0x7f97540f5340 2022-02-02T19:10:07.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9748014810 con 0x7f97540f5340 2022-02-02T19:10:07.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.203+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975410f080 con 0x7f97540f5340 2022-02-02T19:10:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.204+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754045ad0 con 0x7f97540f5340 2022-02-02T19:10:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.205+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f97480077b0 con 0x7f97540f5340 2022-02-02T19:10:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.205+0000 7f9750ff9700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 0x7f973c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.205+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f97480820e0 con 0x7f97540f5340 2022-02-02T19:10:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.205+0000 7f9753fff700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 0x7f973c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.206+0000 7f9753fff700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 0x7f973c067290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f9744005010 tx=0x7f9744009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.210+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9748050190 con 0x7f97540f5340 2022-02-02T19:10:07.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.388+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9754057f10 con 0x7f973c064dd0 2022-02-02T19:10:07.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.389+0000 7f9750ff9700 1 -- 172.21.15.96:0/1129702037 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9754057f10 con 0x7f973c064dd0 2022-02-02T19:10:07.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 msgr2=0x7f973c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 0x7f973c067290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f9744005010 tx=0x7f9744009b30).stop 2022-02-02T19:10:07.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 msgr2=0x7f97540f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f9748002700 tx=0x7f9748009d60).stop 2022-02-02T19:10:07.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 shutdown_connections 2022-02-02T19:10:07.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f973c064dd0 0x7f973c067290 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97540f49a0 0x7f97540f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 --2- 172.21.15.96:0/1129702037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97540f5340 0x7f97540f59d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 >> 172.21.15.96:0/1129702037 conn(0x7f97540f04c0 msgr2=0x7f97540fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:07.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 shutdown_connections 2022-02-02T19:10:07.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.391+0000 7f975a2f1700 1 -- 172.21.15.96:0/1129702037 wait complete. 2022-02-02T19:10:07.404 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:10:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 -- 172.21.15.96:0/4038161358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 msgr2=0x7fdfa00f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 --2- 172.21.15.96:0/4038161358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa00f6900 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fdf94004660 tx=0x7fdf94009b30).stop 2022-02-02T19:10:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 -- 172.21.15.96:0/4038161358 shutdown_connections 2022-02-02T19:10:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 --2- 172.21.15.96:0/4038161358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa00f6900 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 --2- 172.21.15.96:0/4038161358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 -- 172.21.15.96:0/4038161358 >> 172.21.15.96:0/4038161358 conn(0x7fdfa00f0de0 msgr2=0x7fdfa00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.489+0000 7fdfa582c700 1 -- 172.21.15.96:0/4038161358 shutdown_connections 2022-02-02T19:10:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 -- 172.21.15.96:0/4038161358 wait complete. 2022-02-02T19:10:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 Processor -- start 2022-02-02T19:10:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 -- start start 2022-02-02T19:10:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa0060390 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.490+0000 7fdfa582c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa00604d0 con 0x7fdfa00f55c0 2022-02-02T19:10:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58190/0 (socket says 172.21.15.96:58190) 2022-02-02T19:10:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 -- 172.21.15.96:0/1426134811 learned_addr learned my addr 172.21.15.96:0/1426134811 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9effd700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 -- 172.21.15.96:0/1426134811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 msgr2=0x7fdfa010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa010c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 -- 172.21.15.96:0/1426134811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94005040 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9effd700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:10:07.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf9e7fc700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fdf94009990 tx=0x7fdf94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf94018070 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf94007ba0 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9401c3c0 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.491+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa010ea80 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.492+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa010ee50 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.492+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa0045ad0 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.493+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf9401d420 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.493+0000 7fdf877fe700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 0x7fdf88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.493+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdf940836d0 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.493+0000 7fdf9effd700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 0x7fdf88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.494+0000 7fdf9effd700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 0x7fdf88067290 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdfa0060120 tx=0x7fdf9000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.497+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf94051720 con 0x7fdfa00f5ed0 2022-02-02T19:10:07.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.670+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfa00fdeb0 con 0x7fdf88064dd0 2022-02-02T19:10:07.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.680+0000 7fdf877fe700 1 -- 172.21.15.96:0/1426134811 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fdfa00fdeb0 con 0x7fdf88064dd0 2022-02-02T19:10:07.683 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:10:07.683 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (53m) 24m ago 54m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:10:07.684 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (45m) 24m ago 54m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:10:07.684 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (45m) 22m ago 54m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:10:07.684 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (53m) 24m ago 54m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:10:07.684 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (50m) 24m ago 50m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:10:07.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (46m) 24m ago 50m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:10:07.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (50m) 22m ago 50m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:10:07.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (46m) 22m ago 50m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:10:07.685 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (47m) 24m ago 55m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:10:07.686 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (47m) 22m ago 54m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:10:07.686 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (46m) 24m ago 55m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:10:07.686 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (46m) 22m ago 53m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:10:07.686 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (54m) 24m ago 54m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:10:07.687 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (53m) 22m ago 53m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:10:07.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (45m) 24m ago 53m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:10:07.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (45m) 24m ago 53m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:10:07.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (44m) 24m ago 52m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:10:07.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (43m) 22m ago 52m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:10:07.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (43m) 22m ago 52m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:10:07.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (42m) 22m ago 51m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:10:07.688 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (53m) 24m ago 54m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:10:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.681+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 msgr2=0x7fdf88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.681+0000 7fdfa582c700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 0x7fdf88067290 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdfa0060120 tx=0x7fdf9000b040).stop 2022-02-02T19:10:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.681+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 msgr2=0x7fdfa010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.681+0000 7fdfa582c700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fdf94009990 tx=0x7fdf94009b30).stop 2022-02-02T19:10:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.681+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 shutdown_connections 2022-02-02T19:10:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf88064dd0 0x7fdf88067290 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfa00f55c0 0x7fdfa010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 --2- 172.21.15.96:0/1426134811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa00f5ed0 0x7fdfa010e590 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 >> 172.21.15.96:0/1426134811 conn(0x7fdfa00f0de0 msgr2=0x7fdfa00fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 shutdown_connections 2022-02-02T19:10:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.682+0000 7fdfa582c700 1 -- 172.21.15.96:0/1426134811 wait complete. 2022-02-02T19:10:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 -- 172.21.15.96:0/1073227682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f7980 msgr2=0x7fa1900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 --2- 172.21.15.96:0/1073227682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f7980 0x7fa1900f7de0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fa18c004660 tx=0x7fa18c009b30).stop 2022-02-02T19:10:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 -- 172.21.15.96:0/1073227682 shutdown_connections 2022-02-02T19:10:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 --2- 172.21.15.96:0/1073227682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f7980 0x7fa1900f7de0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 --2- 172.21.15.96:0/1073227682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f66e0 0x7fa1900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 -- 172.21.15.96:0/1073227682 >> 172.21.15.96:0/1073227682 conn(0x7fa1900f1e40 msgr2=0x7fa1900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 -- 172.21.15.96:0/1073227682 shutdown_connections 2022-02-02T19:10:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 -- 172.21.15.96:0/1073227682 wait complete. 2022-02-02T19:10:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.780+0000 7fa1983de700 1 Processor -- start 2022-02-02T19:10:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa1983de700 1 -- start start 2022-02-02T19:10:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa1983de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa1983de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f7980 0x7fa19010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa1983de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19010e050 con 0x7fa1900f66e0 2022-02-02T19:10:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa1983de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19010e190 con 0x7fa1900f7980 2022-02-02T19:10:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58198/0 (socket says 172.21.15.96:58198) 2022-02-02T19:10:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 -- 172.21.15.96:0/3534308765 learned_addr learned my addr 172.21.15.96:0/3534308765 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa195979700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f7980 0x7fa19010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 -- 172.21.15.96:0/3534308765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f7980 msgr2=0x7fa19010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f7980 0x7fa19010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 -- 172.21.15.96:0/3534308765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c005040 con 0x7fa1900f66e0 2022-02-02T19:10:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.781+0000 7fa19617a700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fa180002700 tx=0x7fa180009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.782+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1800079c0 con 0x7fa1900f66e0 2022-02-02T19:10:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.782+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa18000f040 con 0x7fa1900f66e0 2022-02-02T19:10:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.782+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19010eb30 con 0x7fa1900f66e0 2022-02-02T19:10:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.782+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1800147e0 con 0x7fa1900f66e0 2022-02-02T19:10:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.782+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19010f0f0 con 0x7fa1900f66e0 2022-02-02T19:10:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.783+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190045ad0 con 0x7fa1900f66e0 2022-02-02T19:10:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.785+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa18001b060 con 0x7fa1900f66e0 2022-02-02T19:10:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.785+0000 7fa186ffd700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 0x7fa17c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.785+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa180081b00 con 0x7fa1900f66e0 2022-02-02T19:10:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.785+0000 7fa195979700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 0x7fa17c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.786+0000 7fa195979700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 0x7fa17c067270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa18c004e30 tx=0x7fa18c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:07.788+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa180053640 con 0x7fa1900f66e0 2022-02-02T19:10:08.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.023+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa1900ff040 con 0x7fa1900f66e0 2022-02-02T19:10:08.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.023+0000 7fa186ffd700 1 -- 172.21.15.96:0/3534308765 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa1800192e0 con 0x7fa1900f66e0 2022-02-02T19:10:08.027 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:10:08.027 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:10:08.027 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:10:08.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:08.028 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:10:08.028 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:10:08.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:08.029 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:10:08.029 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:10:08.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:08.029 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:10:08.030 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:10:08.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:08.030 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:10:08.030 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:10:08.030 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:10:08.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:10:08.031 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:10:08.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 msgr2=0x7fa17c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 0x7fa17c067270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa18c004e30 tx=0x7fa18c009b30).stop 2022-02-02T19:10:08.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 msgr2=0x7fa19010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fa180002700 tx=0x7fa180009d60).stop 2022-02-02T19:10:08.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 shutdown_connections 2022-02-02T19:10:08.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa17c064db0 0x7fa17c067270 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1900f66e0 0x7fa19010d5b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 --2- 172.21.15.96:0/3534308765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1900f7980 0x7fa19010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 >> 172.21.15.96:0/3534308765 conn(0x7fa1900f1e40 msgr2=0x7fa19006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:08.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.025+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 shutdown_connections 2022-02-02T19:10:08.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.026+0000 7fa1983de700 1 -- 172.21.15.96:0/3534308765 wait complete. 2022-02-02T19:10:08.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 -- 172.21.15.96:0/265040135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f7980 msgr2=0x7f1fb80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 --2- 172.21.15.96:0/265040135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f7980 0x7f1fb80f7de0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f1fb4004660 tx=0x7f1fb4009b30).stop 2022-02-02T19:10:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 -- 172.21.15.96:0/265040135 shutdown_connections 2022-02-02T19:10:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 --2- 172.21.15.96:0/265040135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f7980 0x7f1fb80f7de0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 --2- 172.21.15.96:0/265040135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f66e0 0x7f1fb80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 -- 172.21.15.96:0/265040135 >> 172.21.15.96:0/265040135 conn(0x7f1fb80f1e40 msgr2=0x7f1fb80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 -- 172.21.15.96:0/265040135 shutdown_connections 2022-02-02T19:10:08.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.123+0000 7f1fc064c700 1 -- 172.21.15.96:0/265040135 wait complete. 2022-02-02T19:10:08.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 Processor -- start 2022-02-02T19:10:08.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 -- start start 2022-02-02T19:10:08.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:08.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 0x7f1fb8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:08.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8107a00 con 0x7f1fb80f66e0 2022-02-02T19:10:08.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fc064c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8107b40 con 0x7f1fb80f7980 2022-02-02T19:10:08.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:08.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58208/0 (socket says 172.21.15.96:58208) 2022-02-02T19:10:08.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 -- 172.21.15.96:0/3139114099 learned_addr learned my addr 172.21.15.96:0/3139114099 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:08.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbdbe7700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 0x7f1fb8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 -- 172.21.15.96:0/3139114099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 msgr2=0x7f1fb8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 0x7f1fb8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbe3e8700 1 -- 172.21.15.96:0/3139114099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb4005040 con 0x7f1fb80f66e0 2022-02-02T19:10:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.124+0000 7f1fbdbe7700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 0x7f1fb8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:10:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1fbe3e8700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f1fa8002700 tx=0x7f1fa8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa8009320 con 0x7f1fb80f66e0 2022-02-02T19:10:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fa800f040 con 0x7f1fb80f66e0 2022-02-02T19:10:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb81084e0 con 0x7f1fb80f66e0 2022-02-02T19:10:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa8014900 con 0x7f1fb80f66e0 2022-02-02T19:10:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.125+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb8108aa0 con 0x7f1fb80f66e0 2022-02-02T19:10:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.126+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8045ad0 con 0x7f1fb80f66e0 2022-02-02T19:10:08.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.126+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1fa8009480 con 0x7f1fb80f66e0 2022-02-02T19:10:08.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.126+0000 7f1faeffd700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 0x7f1fa4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:08.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.127+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1fa8081d10 con 0x7f1fb80f66e0 2022-02-02T19:10:08.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.127+0000 7f1fbdbe7700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 0x7f1fa4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:08.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.127+0000 7f1fbdbe7700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 0x7f1fa4067270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f1fb4004630 tx=0x7f1fb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:08.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.131+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1fa80538b0 con 0x7f1fb80f66e0 2022-02-02T19:10:08.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.330+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fb80ff020 con 0x7f1fb80f66e0 2022-02-02T19:10:08.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.331+0000 7f1faeffd700 1 -- 172.21.15.96:0/3139114099 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1fa80534a0 con 0x7f1fb80f66e0 2022-02-02T19:10:08.334 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:10:08.334 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:10:08.335 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:10:08.335 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:10:08.335 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:08.335 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:10:08.336 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:10:08.336 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:10:08.336 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:10:08.336 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:10:08.337 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:10:08.337 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:10:08.337 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:10:08.337 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:10:08.337 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:10:08.338 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:10:08.338 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:10:08.338 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:10:08.338 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:10:08.339 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:10:08.339 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:10:08.339 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:10:08.339 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:10:08.339 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:10:08.340 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:10:08.340 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:10:08.340 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:10:08.340 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:10:08.340 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:10:08.341 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:10:08.341 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:10:08.341 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:10:08.341 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:08.342 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:08.342 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:10:08.342 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:08.342 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:08.342 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:08.343 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 msgr2=0x7f1fa4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 0x7f1fa4067270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f1fb4004630 tx=0x7f1fb4009b30).stop 2022-02-02T19:10:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 msgr2=0x7f1fb8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f1fa8002700 tx=0x7f1fa8009d80).stop 2022-02-02T19:10:08.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 shutdown_connections 2022-02-02T19:10:08.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064db0 0x7f1fa4067270 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f66e0 0x7f1fb8106f60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 --2- 172.21.15.96:0/3139114099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f7980 0x7f1fb8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:08.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.332+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 >> 172.21.15.96:0/3139114099 conn(0x7f1fb80f1e40 msgr2=0x7f1fb80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:08.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.333+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 shutdown_connections 2022-02-02T19:10:08.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:08.333+0000 7f1fc064c700 1 -- 172.21.15.96:0/3139114099 wait complete. 2022-02-02T19:10:08.346 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:10:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:08 smithi159 ceph-mon[69013]: from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:08 smithi159 ceph-mon[69013]: from='client.35598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:08 smithi159 ceph-mon[69013]: pgmap v1440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:09.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3534308765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:10:09.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3139114099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:10:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:08 smithi096 ceph-mon[101353]: from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:08 smithi096 ceph-mon[101353]: from='client.35598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:08 smithi096 ceph-mon[101353]: pgmap v1440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3534308765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:10:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3139114099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:10:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:10 smithi159 ceph-mon[69013]: pgmap v1441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:10 smithi096 ceph-mon[101353]: pgmap v1441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:13.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:12 smithi159 ceph-mon[69013]: pgmap v1442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:12 smithi096 ceph-mon[101353]: pgmap v1442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:15.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:14 smithi159 ceph-mon[69013]: pgmap v1443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:14 smithi096 ceph-mon[101353]: pgmap v1443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:16 smithi159 ceph-mon[69013]: pgmap v1444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:16 smithi096 ceph-mon[101353]: pgmap v1444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:18 smithi159 ceph-mon[69013]: pgmap v1445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:18 smithi096 ceph-mon[101353]: pgmap v1445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:21.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:20 smithi159 ceph-mon[69013]: pgmap v1446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:20 smithi096 ceph-mon[101353]: pgmap v1446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:23.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:22 smithi159 ceph-mon[69013]: pgmap v1447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:22 smithi096 ceph-mon[101353]: pgmap v1447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:25.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:24 smithi159 ceph-mon[69013]: pgmap v1448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:24 smithi096 ceph-mon[101353]: pgmap v1448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:27.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:26 smithi159 ceph-mon[69013]: pgmap v1449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:26 smithi096 ceph-mon[101353]: pgmap v1449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:10:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:10:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:10:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:10:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:28 smithi159 ceph-mon[69013]: pgmap v1450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:28 smithi096 ceph-mon[101353]: pgmap v1450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:31.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:30 smithi159 ceph-mon[69013]: pgmap v1451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:30 smithi096 ceph-mon[101353]: pgmap v1451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:32 smithi159 ceph-mon[69013]: pgmap v1452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:32 smithi096 ceph-mon[101353]: pgmap v1452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:35.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:34 smithi159 ceph-mon[69013]: pgmap v1453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:34 smithi096 ceph-mon[101353]: pgmap v1453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:37.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:36 smithi159 ceph-mon[69013]: pgmap v1454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:37.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:36 smithi096 ceph-mon[101353]: pgmap v1454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 -- 172.21.15.96:0/104401691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 msgr2=0x7f50380f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 --2- 172.21.15.96:0/104401691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f50380f59e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f5028004660 tx=0x7f5028009b30).stop 2022-02-02T19:10:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 -- 172.21.15.96:0/104401691 shutdown_connections 2022-02-02T19:10:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 --2- 172.21.15.96:0/104401691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 0x7f50380f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 --2- 172.21.15.96:0/104401691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f50380f59e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.445+0000 7f503fcfe700 1 -- 172.21.15.96:0/104401691 >> 172.21.15.96:0/104401691 conn(0x7f50380f0d40 msgr2=0x7f50380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.446+0000 7f503fcfe700 1 -- 172.21.15.96:0/104401691 shutdown_connections 2022-02-02T19:10:38.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.446+0000 7f503fcfe700 1 -- 172.21.15.96:0/104401691 wait complete. 2022-02-02T19:10:38.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.446+0000 7f503fcfe700 1 Processor -- start 2022-02-02T19:10:38.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503fcfe700 1 -- start start 2022-02-02T19:10:38.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503fcfe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503fcfe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 0x7f503810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503fcfe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380603e0 con 0x7f50380f55c0 2022-02-02T19:10:38.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503fcfe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038060520 con 0x7f50380f6860 2022-02-02T19:10:38.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58230/0 (socket says 172.21.15.96:58230) 2022-02-02T19:10:38.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 -- 172.21.15.96:0/3361484939 learned_addr learned my addr 172.21.15.96:0/3361484939 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:38.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503d299700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 0x7f503810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 -- 172.21.15.96:0/3361484939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 msgr2=0x7f503810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 0x7f503810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.447+0000 7f503da9a700 1 -- 172.21.15.96:0/3361484939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028005040 con 0x7f50380f55c0 2022-02-02T19:10:38.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f503da9a700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f5028004f60 tx=0x7f5028009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:38.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5028018070 con 0x7f50380f55c0 2022-02-02T19:10:38.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5028009770 con 0x7f50380f55c0 2022-02-02T19:10:38.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503810c700 con 0x7f50380f55c0 2022-02-02T19:10:38.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502801c3c0 con 0x7f50380f55c0 2022-02-02T19:10:38.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.448+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503810cc60 con 0x7f50380f55c0 2022-02-02T19:10:38.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.449+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5038045ad0 con 0x7f50380f55c0 2022-02-02T19:10:38.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.450+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f502801d420 con 0x7f50380f55c0 2022-02-02T19:10:38.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.450+0000 7f502e7fc700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 0x7f5024067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.450+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5028083e80 con 0x7f50380f55c0 2022-02-02T19:10:38.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.450+0000 7f503d299700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 0x7f5024067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.451+0000 7f503d299700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 0x7f5024067290 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f50340041d0 tx=0x7f5034009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:38.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.454+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5028052070 con 0x7f50380f55c0 2022-02-02T19:10:38.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.634+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50380fdee0 con 0x7f5024064dd0 2022-02-02T19:10:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.635+0000 7f502e7fc700 1 -- 172.21.15.96:0/3361484939 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f50380fdee0 con 0x7f5024064dd0 2022-02-02T19:10:38.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 msgr2=0x7f5024067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 0x7f5024067290 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f50340041d0 tx=0x7f5034009040).stop 2022-02-02T19:10:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 msgr2=0x7f5038109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f5028004f60 tx=0x7f5028009b30).stop 2022-02-02T19:10:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 shutdown_connections 2022-02-02T19:10:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5024064dd0 0x7f5024067290 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50380f55c0 0x7f5038109cb0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 --2- 172.21.15.96:0/3361484939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50380f6860 0x7f503810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 >> 172.21.15.96:0/3361484939 conn(0x7f50380f0d40 msgr2=0x7f50380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 shutdown_connections 2022-02-02T19:10:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.637+0000 7f503fcfe700 1 -- 172.21.15.96:0/3361484939 wait complete. 2022-02-02T19:10:38.649 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:10:38.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 -- 172.21.15.96:0/2829223670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f66e0 msgr2=0x7f60340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 --2- 172.21.15.96:0/2829223670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f66e0 0x7f60340f6b00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f6028004660 tx=0x7f6028009b30).stop 2022-02-02T19:10:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 -- 172.21.15.96:0/2829223670 shutdown_connections 2022-02-02T19:10:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 --2- 172.21.15.96:0/2829223670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f7980 0x7f60340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 --2- 172.21.15.96:0/2829223670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f66e0 0x7f60340f6b00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 -- 172.21.15.96:0/2829223670 >> 172.21.15.96:0/2829223670 conn(0x7f60340f1e40 msgr2=0x7f60340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 -- 172.21.15.96:0/2829223670 shutdown_connections 2022-02-02T19:10:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 -- 172.21.15.96:0/2829223670 wait complete. 2022-02-02T19:10:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.734+0000 7f603ab07700 1 Processor -- start 2022-02-02T19:10:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f603ab07700 1 -- start start 2022-02-02T19:10:38.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f603ab07700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f6034106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f603ab07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f603ab07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6034107a50 con 0x7f60340f7980 2022-02-02T19:10:38.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f603ab07700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6034107b90 con 0x7f60340f66e0 2022-02-02T19:10:38.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58242/0 (socket says 172.21.15.96:58242) 2022-02-02T19:10:38.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 -- 172.21.15.96:0/474494507 learned_addr learned my addr 172.21.15.96:0/474494507 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:38.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f60388a3700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f6034106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 -- 172.21.15.96:0/474494507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 msgr2=0x7f6034106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f6034106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.735+0000 7f6033fff700 1 -- 172.21.15.96:0/474494507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028005040 con 0x7f60340f7980 2022-02-02T19:10:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f6033fff700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f602000c530 tx=0x7f6020007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602000f650 con 0x7f60340f7980 2022-02-02T19:10:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6034108530 con 0x7f60340f7980 2022-02-02T19:10:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f602000fc60 con 0x7f60340f7980 2022-02-02T19:10:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6020012cd0 con 0x7f60340f7980 2022-02-02T19:10:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.736+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6034108af0 con 0x7f60340f7980 2022-02-02T19:10:38.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.737+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034045ad0 con 0x7f60340f7980 2022-02-02T19:10:38.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.737+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6020010070 con 0x7f60340f7980 2022-02-02T19:10:38.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.738+0000 7f60317fa700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 0x7f6024067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:38.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.738+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6020081800 con 0x7f60340f7980 2022-02-02T19:10:38.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.738+0000 7f60388a3700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 0x7f6024067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:38.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.738+0000 7f60388a3700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 0x7f6024067290 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6028004e30 tx=0x7f6028009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:38.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.742+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60200532e0 con 0x7f60340f7980 2022-02-02T19:10:38.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.915+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6034108d10 con 0x7f6024064dd0 2022-02-02T19:10:38.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.924+0000 7f60317fa700 1 -- 172.21.15.96:0/474494507 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6034108d10 con 0x7f6024064dd0 2022-02-02T19:10:38.927 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:10:38.927 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (54m) 24m ago 55m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:10:38.927 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (46m) 24m ago 55m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:10:38.927 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (46m) 23m ago 54m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:10:38.928 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (53m) 24m ago 54m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:10:38.928 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (51m) 24m ago 51m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:10:38.928 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (46m) 24m ago 51m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:10:38.928 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (51m) 23m ago 51m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:10:38.928 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (47m) 23m ago 51m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:10:38.929 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (48m) 24m ago 56m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:10:38.929 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (47m) 23m ago 54m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:10:38.929 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (47m) 24m ago 56m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:10:38.929 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (47m) 23m ago 54m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:10:38.929 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (54m) 24m ago 54m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:10:38.930 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (54m) 23m ago 54m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:10:38.930 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (46m) 24m ago 53m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:10:38.930 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (45m) 24m ago 53m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:10:38.930 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (44m) 24m ago 53m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:10:38.931 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (44m) 23m ago 53m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:10:38.931 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (43m) 23m ago 52m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:10:38.931 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (43m) 23m ago 52m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:10:38.931 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (53m) 24m ago 54m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:10:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 msgr2=0x7f6024067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 0x7f6024067290 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6028004e30 tx=0x7f6028009b30).stop 2022-02-02T19:10:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 msgr2=0x7f60341074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f602000c530 tx=0x7f6020007e20).stop 2022-02-02T19:10:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 shutdown_connections 2022-02-02T19:10:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6024064dd0 0x7f6024067290 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60340f66e0 0x7f6034106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 --2- 172.21.15.96:0/474494507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60340f7980 0x7f60341074a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 >> 172.21.15.96:0/474494507 conn(0x7f60340f1e40 msgr2=0x7f60340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 shutdown_connections 2022-02-02T19:10:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:38.926+0000 7f603ab07700 1 -- 172.21.15.96:0/474494507 wait complete. 2022-02-02T19:10:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 -- 172.21.15.96:0/2220872131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 msgr2=0x7f73840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 --2- 172.21.15.96:0/2220872131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73840f7c30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f7374004660 tx=0x7f7374009b30).stop 2022-02-02T19:10:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 -- 172.21.15.96:0/2220872131 shutdown_connections 2022-02-02T19:10:39.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 --2- 172.21.15.96:0/2220872131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73840f7c30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 --2- 172.21.15.96:0/2220872131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 0x7f73840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:10:39.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.022+0000 7f738b48d700 1 -- 172.21.15.96:0/2220872131 >> 172.21.15.96:0/2220872131 conn(0x7f73840f1c90 msgr2=0x7f73840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:39.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:38 smithi096 ceph-mon[101353]: pgmap v1455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:39.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.023+0000 7f738b48d700 1 -- 172.21.15.96:0/2220872131 shutdown_connections 2022-02-02T19:10:39.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.023+0000 7f738b48d700 1 -- 172.21.15.96:0/2220872131 wait complete. 2022-02-02T19:10:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.023+0000 7f738b48d700 1 Processor -- start 2022-02-02T19:10:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.023+0000 7f738b48d700 1 -- start start 2022-02-02T19:10:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.023+0000 7f738b48d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 0x7f7384106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738b48d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738b48d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384107980 con 0x7f73840f77d0 2022-02-02T19:10:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738b48d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384108100 con 0x7f73840f6530 2022-02-02T19:10:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58252/0 (socket says 172.21.15.96:58252) 2022-02-02T19:10:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 -- 172.21.15.96:0/3359938128 learned_addr learned my addr 172.21.15.96:0/3359938128 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738a48b700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 0x7f7384106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 -- 172.21.15.96:0/3359938128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 msgr2=0x7f7384106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 0x7f7384106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 -- 172.21.15.96:0/3359938128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374005040 con 0x7f73840f77d0 2022-02-02T19:10:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f7389c8a700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f7374009990 tx=0x7f7374009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7374018070 con 0x7f73840f77d0 2022-02-02T19:10:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7374007ca0 con 0x7f73840f77d0 2022-02-02T19:10:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384108320 con 0x7f73840f77d0 2022-02-02T19:10:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737401c620 con 0x7f73840f77d0 2022-02-02T19:10:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.024+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7384108880 con 0x7f73840f77d0 2022-02-02T19:10:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.026+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384045ad0 con 0x7f73840f77d0 2022-02-02T19:10:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.026+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f737401d960 con 0x7f73840f77d0 2022-02-02T19:10:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.026+0000 7f737affd700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 0x7f73700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.026+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7374083750 con 0x7f73840f77d0 2022-02-02T19:10:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.026+0000 7f738a48b700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 0x7f73700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.027+0000 7f738a48b700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 0x7f73700672e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f7384106b70 tx=0x7f7380008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:39.036 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:38 smithi159 ceph-mon[69013]: pgmap v1455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.030+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7374051800 con 0x7f73840f77d0 2022-02-02T19:10:39.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.259+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7384027a00 con 0x7f73840f77d0 2022-02-02T19:10:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.260+0000 7f737affd700 1 -- 172.21.15.96:0/3359938128 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7374054e20 con 0x7f73840f77d0 2022-02-02T19:10:39.264 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:10:39.264 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:10:39.264 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:10:39.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:39.265 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:10:39.265 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:10:39.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:39.266 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:10:39.266 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:10:39.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:39.266 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:10:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:10:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:10:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:10:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:10:39.268 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:10:39.268 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:10:39.268 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:10:39.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 msgr2=0x7f73700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 0x7f73700672e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f7384106b70 tx=0x7f7380008040).stop 2022-02-02T19:10:39.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 msgr2=0x7f73841072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f7374009990 tx=0x7f7374009b30).stop 2022-02-02T19:10:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 shutdown_connections 2022-02-02T19:10:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7370064e20 0x7f73700672e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73840f6530 0x7f7384106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 --2- 172.21.15.96:0/3359938128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73840f77d0 0x7f73841072f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 >> 172.21.15.96:0/3359938128 conn(0x7f73840f1c90 msgr2=0x7f73840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 shutdown_connections 2022-02-02T19:10:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.262+0000 7f738b48d700 1 -- 172.21.15.96:0/3359938128 wait complete. 2022-02-02T19:10:39.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 -- 172.21.15.96:0/1154832131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 msgr2=0x7fc5640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 --2- 172.21.15.96:0/1154832131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5640f7c30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fc54c004660 tx=0x7fc54c009b30).stop 2022-02-02T19:10:39.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 -- 172.21.15.96:0/1154832131 shutdown_connections 2022-02-02T19:10:39.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 --2- 172.21.15.96:0/1154832131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5640f7c30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 --2- 172.21.15.96:0/1154832131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc5640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:10:39.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 -- 172.21.15.96:0/1154832131 >> 172.21.15.96:0/1154832131 conn(0x7fc5640f1c90 msgr2=0x7fc5640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:39.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 -- 172.21.15.96:0/1154832131 shutdown_connections 2022-02-02T19:10:39.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.360+0000 7fc56359e700 1 -- 172.21.15.96:0/1154832131 wait complete. 2022-02-02T19:10:39.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 Processor -- start 2022-02-02T19:10:39.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 -- start start 2022-02-02T19:10:39.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc564106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564107980 con 0x7fc5640f77d0 2022-02-02T19:10:39.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564108100 con 0x7fc5640f6530 2022-02-02T19:10:39.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc561d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc561d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58262/0 (socket says 172.21.15.96:58262) 2022-02-02T19:10:39.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc561d9b700 1 -- 172.21.15.96:0/1342142761 learned_addr learned my addr 172.21.15.96:0/1342142761 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:10:39.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.361+0000 7fc56259c700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc564106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc561d9b700 1 -- 172.21.15.96:0/1342142761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 msgr2=0x7fc564106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc561d9b700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc564106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc561d9b700 1 -- 172.21.15.96:0/1342142761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c005040 con 0x7fc5640f77d0 2022-02-02T19:10:39.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc56259c700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc564106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:10:39.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc561d9b700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fc54c009990 tx=0x7fc54c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:39.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54c018070 con 0x7fc5640f77d0 2022-02-02T19:10:39.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc54c007ca0 con 0x7fc5640f77d0 2022-02-02T19:10:39.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc564108320 con 0x7fc5640f77d0 2022-02-02T19:10:39.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54c01c620 con 0x7fc5640f77d0 2022-02-02T19:10:39.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.362+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc564108880 con 0x7fc5640f77d0 2022-02-02T19:10:39.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.363+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc564045ad0 con 0x7fc5640f77d0 2022-02-02T19:10:39.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.363+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc54c01d960 con 0x7fc5640f77d0 2022-02-02T19:10:39.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.364+0000 7fc55affd700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 0x7fc5500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:10:39.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.364+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc54c083830 con 0x7fc5640f77d0 2022-02-02T19:10:39.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.364+0000 7fc56259c700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 0x7fc5500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:10:39.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.364+0000 7fc56259c700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 0x7fc5500672e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fc564106b70 tx=0x7fc554008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:10:39.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.368+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc54c0519a0 con 0x7fc5640f77d0 2022-02-02T19:10:39.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.567+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc564027a00 con 0x7fc5640f77d0 2022-02-02T19:10:39.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.568+0000 7fc55affd700 1 -- 172.21.15.96:0/1342142761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc54c054fc0 con 0x7fc5640f77d0 2022-02-02T19:10:39.571 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:10:39.571 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:10:39.571 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:10:39.571 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:10:39.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:39.572 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:10:39.572 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:10:39.572 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:10:39.572 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:10:39.573 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:10:39.573 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:10:39.573 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:10:39.573 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:10:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:10:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:10:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:10:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:10:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:10:39.575 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:10:39.575 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:10:39.575 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:10:39.575 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:10:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:10:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:10:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:10:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:10:39.577 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:10:39.577 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:10:39.577 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:10:39.577 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:10:39.577 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:10:39.578 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:10:39.578 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:39.578 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:39.578 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:10:39.579 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:10:39.579 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:39.579 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:39.579 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:10:39.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 msgr2=0x7fc5500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 0x7fc5500672e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fc564106b70 tx=0x7fc554008040).stop 2022-02-02T19:10:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 msgr2=0x7fc5641072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:10:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fc54c009990 tx=0x7fc54c009b30).stop 2022-02-02T19:10:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 shutdown_connections 2022-02-02T19:10:39.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc550064e20 0x7fc5500672e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5640f6530 0x7fc564106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 --2- 172.21.15.96:0/1342142761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5640f77d0 0x7fc5641072f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:10:39.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 >> 172.21.15.96:0/1342142761 conn(0x7fc5640f1c90 msgr2=0x7fc5640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:10:39.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 shutdown_connections 2022-02-02T19:10:39.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:10:39.569+0000 7fc56359e700 1 -- 172.21.15.96:0/1342142761 wait complete. 2022-02-02T19:10:39.583 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:10:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:39 smithi159 ceph-mon[69013]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3359938128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:10:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1342142761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:10:40.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:39 smithi096 ceph-mon[101353]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3359938128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:10:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1342142761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:10:41.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:40 smithi159 ceph-mon[69013]: from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:41.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:40 smithi159 ceph-mon[69013]: pgmap v1456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:40 smithi096 ceph-mon[101353]: from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:10:41.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:40 smithi096 ceph-mon[101353]: pgmap v1456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:42 smithi159 ceph-mon[69013]: pgmap v1457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:42 smithi096 ceph-mon[101353]: pgmap v1457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:45.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:44 smithi159 ceph-mon[69013]: pgmap v1458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:45.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:44 smithi096 ceph-mon[101353]: pgmap v1458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:47.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:46 smithi159 ceph-mon[69013]: pgmap v1459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:46 smithi096 ceph-mon[101353]: pgmap v1459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:49.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:48 smithi159 ceph-mon[69013]: pgmap v1460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:48 smithi096 ceph-mon[101353]: pgmap v1460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:51.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:50 smithi159 ceph-mon[69013]: pgmap v1461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:50 smithi096 ceph-mon[101353]: pgmap v1461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:53.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:52 smithi159 ceph-mon[69013]: pgmap v1462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:52 smithi096 ceph-mon[101353]: pgmap v1462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:55.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:54 smithi159 ceph-mon[69013]: pgmap v1463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:55.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:54 smithi096 ceph-mon[101353]: pgmap v1463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:57.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:56 smithi159 ceph-mon[69013]: pgmap v1464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:57.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:56 smithi096 ceph-mon[101353]: pgmap v1464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:59.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:10:58 smithi159 ceph-mon[69013]: pgmap v1465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:10:59.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:10:58 smithi096 ceph-mon[101353]: pgmap v1465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:01.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:00 smithi159 ceph-mon[69013]: pgmap v1466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:00 smithi096 ceph-mon[101353]: pgmap v1466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:02 smithi159 ceph-mon[69013]: pgmap v1467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:03.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:02 smithi096 ceph-mon[101353]: pgmap v1467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:05.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:04 smithi096 ceph-mon[101353]: pgmap v1468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:04 smithi159 ceph-mon[69013]: pgmap v1468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:06 smithi159 ceph-mon[69013]: pgmap v1469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:07.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:06 smithi096 ceph-mon[101353]: pgmap v1469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:08 smithi159 ceph-mon[69013]: pgmap v1470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:08 smithi096 ceph-mon[101353]: pgmap v1470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:09.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- 172.21.15.96:0/658460363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f66d0 msgr2=0x7f83440f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 --2- 172.21.15.96:0/658460363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f66d0 0x7f83440f6b30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f8334004660 tx=0x7f8334009b30).stop 2022-02-02T19:11:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- 172.21.15.96:0/658460363 shutdown_connections 2022-02-02T19:11:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 --2- 172.21.15.96:0/658460363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f66d0 0x7f83440f6b30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 --2- 172.21.15.96:0/658460363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f5430 0x7f83440f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- 172.21.15.96:0/658460363 >> 172.21.15.96:0/658460363 conn(0x7f83440f0b90 msgr2=0x7f83440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- 172.21.15.96:0/658460363 shutdown_connections 2022-02-02T19:11:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- 172.21.15.96:0/658460363 wait complete. 2022-02-02T19:11:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 Processor -- start 2022-02-02T19:11:09.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.680+0000 7f834aeec700 1 -- start start 2022-02-02T19:11:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f834aeec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f834aeec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 0x7f834410bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f834aeec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440603e0 con 0x7f83440f5430 2022-02-02T19:11:09.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f834aeec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344060520 con 0x7f83440f66d0 2022-02-02T19:11:09.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58282/0 (socket says 172.21.15.96:58282) 2022-02-02T19:11:09.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 -- 172.21.15.96:0/865851893 learned_addr learned my addr 172.21.15.96:0/865851893 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:09.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f83496e9700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 0x7f834410bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 -- 172.21.15.96:0/865851893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 msgr2=0x7f834410bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 0x7f834410bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 -- 172.21.15.96:0/865851893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334005040 con 0x7f83440f5430 2022-02-02T19:11:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f83496e9700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 0x7f834410bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:11:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f8349eea700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f834000e7c0 tx=0x7f834000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83400092e0 con 0x7f83440f5430 2022-02-02T19:11:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f834000f040 con 0x7f83440f5430 2022-02-02T19:11:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.681+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834410c430 con 0x7f83440f5430 2022-02-02T19:11:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.682+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8340014830 con 0x7f83440f5430 2022-02-02T19:11:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.682+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834410c9f0 con 0x7f83440f5430 2022-02-02T19:11:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.683+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8344045ad0 con 0x7f83440f5430 2022-02-02T19:11:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.683+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8340014ab0 con 0x7f83440f5430 2022-02-02T19:11:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.684+0000 7f833a7fc700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 0x7f83300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.684+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8340082160 con 0x7f83440f5430 2022-02-02T19:11:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.684+0000 7f83496e9700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 0x7f83300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.684+0000 7f83496e9700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 0x7f83300672e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f8334004d80 tx=0x7f833400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.688+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8340050210 con 0x7f83440f5430 2022-02-02T19:11:09.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.865+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8344057f10 con 0x7f8330064e20 2022-02-02T19:11:09.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.866+0000 7f833a7fc700 1 -- 172.21.15.96:0/865851893 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8344057f10 con 0x7f8330064e20 2022-02-02T19:11:09.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 msgr2=0x7f83300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 0x7f83300672e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f8334004d80 tx=0x7f833400b040).stop 2022-02-02T19:11:09.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 msgr2=0x7f83441099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f834000e7c0 tx=0x7f834000b040).stop 2022-02-02T19:11:09.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 shutdown_connections 2022-02-02T19:11:09.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8330064e20 0x7f83300672e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83440f5430 0x7f83441099e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 --2- 172.21.15.96:0/865851893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83440f66d0 0x7f834410bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 >> 172.21.15.96:0/865851893 conn(0x7f83440f0b90 msgr2=0x7f83440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:09.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 shutdown_connections 2022-02-02T19:11:09.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.868+0000 7f834aeec700 1 -- 172.21.15.96:0/865851893 wait complete. 2022-02-02T19:11:09.880 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:11:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 -- 172.21.15.96:0/176835751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f55c0 msgr2=0x7fbb540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/176835751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f55c0 0x7fbb540f59e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fbb48004660 tx=0x7fbb48009b30).stop 2022-02-02T19:11:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 -- 172.21.15.96:0/176835751 shutdown_connections 2022-02-02T19:11:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/176835751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f6860 0x7fbb540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/176835751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f55c0 0x7fbb540f59e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 -- 172.21.15.96:0/176835751 >> 172.21.15.96:0/176835751 conn(0x7fbb540f0d40 msgr2=0x7fbb540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 -- 172.21.15.96:0/176835751 shutdown_connections 2022-02-02T19:11:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.965+0000 7fbb5af1c700 1 -- 172.21.15.96:0/176835751 wait complete. 2022-02-02T19:11:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 Processor -- start 2022-02-02T19:11:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 -- start start 2022-02-02T19:11:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f55c0 0x7fbb54105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54106910 con 0x7fbb540f6860 2022-02-02T19:11:09.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb5af1c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54106a50 con 0x7fbb540f55c0 2022-02-02T19:11:09.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58294/0 (socket says 172.21.15.96:58294) 2022-02-02T19:11:09.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 -- 172.21.15.96:0/6891291 learned_addr learned my addr 172.21.15.96:0/6891291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb58cb8700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f55c0 0x7fbb54105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 -- 172.21.15.96:0/6891291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f55c0 msgr2=0x7fbb54105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f55c0 0x7fbb54105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.966+0000 7fbb53fff700 1 -- 172.21.15.96:0/6891291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48005040 con 0x7fbb540f6860 2022-02-02T19:11:09.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb53fff700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fbb4000c530 tx=0x7fbb40007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:09.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb4000f650 con 0x7fbb540f6860 2022-02-02T19:11:09.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb4000fc60 con 0x7fbb540f6860 2022-02-02T19:11:09.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb40012cd0 con 0x7fbb540f6860 2022-02-02T19:11:09.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb541073f0 con 0x7fbb540f6860 2022-02-02T19:11:09.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.967+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb541079b0 con 0x7fbb540f6860 2022-02-02T19:11:09.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.968+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54045ad0 con 0x7fbb540f6860 2022-02-02T19:11:09.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.968+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb40010070 con 0x7fbb540f6860 2022-02-02T19:11:09.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.968+0000 7fbb517fa700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 0x7fbb44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:09.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.969+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbb40081710 con 0x7fbb540f6860 2022-02-02T19:11:09.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.969+0000 7fbb58cb8700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 0x7fbb44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:09.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.969+0000 7fbb58cb8700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 0x7fbb44067290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbb48004e30 tx=0x7fbb48009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:09.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:09.973+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb400477d0 con 0x7fbb540f6860 2022-02-02T19:11:10.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.145+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb54107c20 con 0x7fbb44064dd0 2022-02-02T19:11:10.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.154+0000 7fbb517fa700 1 -- 172.21.15.96:0/6891291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbb54107c20 con 0x7fbb44064dd0 2022-02-02T19:11:10.158 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:11:10.158 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (54m) 25m ago 55m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:11:10.158 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (46m) 25m ago 55m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:11:10.159 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (46m) 23m ago 55m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:11:10.160 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (54m) 25m ago 55m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:11:10.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (51m) 25m ago 51m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:11:10.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (47m) 25m ago 51m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:11:10.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (51m) 23m ago 51m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:11:10.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (47m) 23m ago 51m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:11:10.161 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (48m) 25m ago 56m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:11:10.162 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (48m) 23m ago 55m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:11:10.162 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (47m) 25m ago 56m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:11:10.162 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (47m) 23m ago 55m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:11:10.162 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (55m) 25m ago 55m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:11:10.163 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (54m) 23m ago 54m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:11:10.163 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (46m) 25m ago 54m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:11:10.163 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (46m) 25m ago 54m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:11:10.163 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (45m) 25m ago 53m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:11:10.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (44m) 23m ago 53m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:11:10.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (44m) 23m ago 53m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:11:10.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (43m) 23m ago 52m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:11:10.164 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (54m) 25m ago 55m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:11:10.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 msgr2=0x7fbb44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 0x7fbb44067290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbb48004e30 tx=0x7fbb48009b30).stop 2022-02-02T19:11:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 msgr2=0x7fbb54106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fbb4000c530 tx=0x7fbb40007e20).stop 2022-02-02T19:11:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 shutdown_connections 2022-02-02T19:11:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb44064dd0 0x7fbb44067290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb540f55c0 0x7fbb54105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 --2- 172.21.15.96:0/6891291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb540f6860 0x7fbb54106360 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 >> 172.21.15.96:0/6891291 conn(0x7fbb540f0d40 msgr2=0x7fbb540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 shutdown_connections 2022-02-02T19:11:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.156+0000 7fbb5af1c700 1 -- 172.21.15.96:0/6891291 wait complete. 2022-02-02T19:11:10.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- 172.21.15.96:0/3530732418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f66d0 msgr2=0x7f08980f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 --2- 172.21.15.96:0/3530732418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f66d0 0x7f08980f6b30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f088c004660 tx=0x7f088c009b30).stop 2022-02-02T19:11:10.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- 172.21.15.96:0/3530732418 shutdown_connections 2022-02-02T19:11:10.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 --2- 172.21.15.96:0/3530732418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f66d0 0x7f08980f6b30 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 --2- 172.21.15.96:0/3530732418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f5430 0x7f08980f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- 172.21.15.96:0/3530732418 >> 172.21.15.96:0/3530732418 conn(0x7f08980f0b90 msgr2=0x7f08980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:10.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- 172.21.15.96:0/3530732418 shutdown_connections 2022-02-02T19:11:10.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- 172.21.15.96:0/3530732418 wait complete. 2022-02-02T19:11:10.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 Processor -- start 2022-02-02T19:11:10.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 -- start start 2022-02-02T19:11:10.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.253+0000 7f089759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 0x7f08980f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980f7f70 con 0x7f08980f5430 2022-02-02T19:11:10.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980f80b0 con 0x7f08980f66d0 2022-02-02T19:11:10.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58300/0 (socket says 172.21.15.96:58300) 2022-02-02T19:11:10.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 -- 172.21.15.96:0/1522274338 learned_addr learned my addr 172.21.15.96:0/1522274338 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:10.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f0895d9b700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 0x7f08980f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 -- 172.21.15.96:0/1522274338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 msgr2=0x7f08980f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 0x7f08980f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 -- 172.21.15.96:0/1522274338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c005040 con 0x7f08980f5430 2022-02-02T19:11:10.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f0895d9b700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 0x7f08980f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:11:10.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089659c700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f088800c530 tx=0x7f0888007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:10.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f088800f650 con 0x7f08980f5430 2022-02-02T19:11:10.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08980f8390 con 0x7f08980f5430 2022-02-02T19:11:10.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f088800fc60 con 0x7f08980f5430 2022-02-02T19:11:10.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0888012d20 con 0x7f08980f5430 2022-02-02T19:11:10.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.254+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089810ed60 con 0x7f08980f5430 2022-02-02T19:11:10.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.255+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0898045ad0 con 0x7f08980f5430 2022-02-02T19:11:10.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.256+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0888019030 con 0x7f08980f5430 2022-02-02T19:11:10.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.256+0000 7f0886ffd700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 0x7f08800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.256+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0888081700 con 0x7f08980f5430 2022-02-02T19:11:10.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.256+0000 7f0895d9b700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 0x7f08800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.257+0000 7f0895d9b700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 0x7f08800672e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f088c004e30 tx=0x7f088c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:10.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.261+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f088804f800 con 0x7f08980f5430 2022-02-02T19:11:10.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.493+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f089810f4d0 con 0x7f08980f5430 2022-02-02T19:11:10.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.493+0000 7f0886ffd700 1 -- 172.21.15.96:0/1522274338 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0888052e20 con 0x7f08980f5430 2022-02-02T19:11:10.496 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:11:10.496 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:11:10.497 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:11:10.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:10.497 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:11:10.497 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:11:10.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:10.498 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:11:10.498 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:11:10.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:10.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:11:10.499 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:11:10.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:10.500 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:11:10.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:11:10.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:11:10.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:11:10.500 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:11:10.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 msgr2=0x7f08800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 0x7f08800672e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f088c004e30 tx=0x7f088c009b30).stop 2022-02-02T19:11:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 msgr2=0x7f08980f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f088800c530 tx=0x7f0888007e10).stop 2022-02-02T19:11:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 shutdown_connections 2022-02-02T19:11:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0880064e20 0x7f08800672e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08980f5430 0x7f08980f9590 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 --2- 172.21.15.96:0/1522274338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08980f66d0 0x7f08980f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 >> 172.21.15.96:0/1522274338 conn(0x7f08980f0b90 msgr2=0x7f089805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 shutdown_connections 2022-02-02T19:11:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.495+0000 7f089759e700 1 -- 172.21.15.96:0/1522274338 wait complete. 2022-02-02T19:11:10.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 -- 172.21.15.96:0/424779815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f55c0 msgr2=0x7f42d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 --2- 172.21.15.96:0/424779815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f55c0 0x7f42d00f59e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f42c0004660 tx=0x7f42c0009b30).stop 2022-02-02T19:11:10.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 -- 172.21.15.96:0/424779815 shutdown_connections 2022-02-02T19:11:10.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 --2- 172.21.15.96:0/424779815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f6860 0x7f42d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:11:10.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 --2- 172.21.15.96:0/424779815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f55c0 0x7f42d00f59e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.593+0000 7f42d5be5700 1 -- 172.21.15.96:0/424779815 >> 172.21.15.96:0/424779815 conn(0x7f42d00f0d40 msgr2=0x7f42d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:10.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.594+0000 7f42d5be5700 1 -- 172.21.15.96:0/424779815 shutdown_connections 2022-02-02T19:11:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.594+0000 7f42d5be5700 1 -- 172.21.15.96:0/424779815 wait complete. 2022-02-02T19:11:10.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.594+0000 7f42d5be5700 1 Processor -- start 2022-02-02T19:11:10.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42d5be5700 1 -- start start 2022-02-02T19:11:10.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42d5be5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f55c0 0x7f42d0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42d5be5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42d5be5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d01069f0 con 0x7f42d00f6860 2022-02-02T19:11:10.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42d5be5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d01072a0 con 0x7f42d00f55c0 2022-02-02T19:11:10.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58310/0 (socket says 172.21.15.96:58310) 2022-02-02T19:11:10.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 -- 172.21.15.96:0/2618676536 learned_addr learned my addr 172.21.15.96:0/2618676536 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:10.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42cf7fe700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f55c0 0x7f42d0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 -- 172.21.15.96:0/2618676536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f55c0 msgr2=0x7f42d0105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f55c0 0x7f42d0105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 -- 172.21.15.96:0/2618676536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0005040 con 0x7f42d00f6860 2022-02-02T19:11:10.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.595+0000 7f42ceffd700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f42c400b410 tx=0x7f42c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:10.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c40125f0 con 0x7f42d00f6860 2022-02-02T19:11:10.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d0107580 con 0x7f42d00f6860 2022-02-02T19:11:10.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42c4012c00 con 0x7f42d00f6860 2022-02-02T19:11:10.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c4002ae0 con 0x7f42d00f6860 2022-02-02T19:11:10.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d0107b40 con 0x7f42d00f6860 2022-02-02T19:11:10.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.596+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d00f49b0 con 0x7f42d00f6860 2022-02-02T19:11:10.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.597+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42c400f030 con 0x7f42d00f6860 2022-02-02T19:11:10.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.598+0000 7f42b7fff700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 0x7f42b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:10.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.598+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f42c4082220 con 0x7f42d00f6860 2022-02-02T19:11:10.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.598+0000 7f42cf7fe700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 0x7f42b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:10.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.598+0000 7f42cf7fe700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 0x7f42b8067290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f42c0004e30 tx=0x7f42c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:10.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.601+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42c4053d80 con 0x7f42d00f6860 2022-02-02T19:11:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.806+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42d0045ad0 con 0x7f42d00f6860 2022-02-02T19:11:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.806+0000 7f42b7fff700 1 -- 172.21.15.96:0/2618676536 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f42c4002d50 con 0x7f42d00f6860 2022-02-02T19:11:10.810 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:11:10.810 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:11:10.810 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:11:10.810 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:11:10.811 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:11:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:11:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:11:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:11:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:11:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:11:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:11:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:11:10.813 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:11:10.813 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:11:10.813 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:11:10.813 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:11:10.813 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:11:10.814 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:11:10.814 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:11:10.814 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:11:10.814 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:11:10.814 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:11:10.815 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:11:10.815 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:11:10.815 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:11:10.815 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:11:10.816 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:11:10.816 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:11:10.816 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:11:10.816 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:11:10.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:11:10.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:10.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:10.817 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:11:10.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:10.818 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:10.818 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:10.818 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:10.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 msgr2=0x7f42b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 0x7f42b8067290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f42c0004e30 tx=0x7f42c0009b30).stop 2022-02-02T19:11:10.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 msgr2=0x7f42d01063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:10.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f42c400b410 tx=0x7f42c4006ef0).stop 2022-02-02T19:11:10.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 shutdown_connections 2022-02-02T19:11:10.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42b8064dd0 0x7f42b8067290 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00f55c0 0x7f42d0105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 --2- 172.21.15.96:0/2618676536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d00f6860 0x7f42d01063b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:10.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.809+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 >> 172.21.15.96:0/2618676536 conn(0x7f42d00f0d40 msgr2=0x7f42d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:10.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.810+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 shutdown_connections 2022-02-02T19:11:10.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:10.810+0000 7f42d5be5700 1 -- 172.21.15.96:0/2618676536 wait complete. 2022-02-02T19:11:10.822 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:11:11.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:10 smithi159 ceph-mon[69013]: pgmap v1471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:11.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1522274338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:11:11.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:10 smithi096 ceph-mon[101353]: pgmap v1471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:11.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1522274338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:11:12.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:11 smithi096 ceph-mon[101353]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:12.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:11 smithi096 ceph-mon[101353]: from='client.35630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:12.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2618676536' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:11:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:11 smithi159 ceph-mon[69013]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:11 smithi159 ceph-mon[69013]: from='client.35630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2618676536' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:11:13.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:12 smithi096 ceph-mon[101353]: pgmap v1472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:12 smithi159 ceph-mon[69013]: pgmap v1472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:15.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:14 smithi096 ceph-mon[101353]: pgmap v1473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:14 smithi159 ceph-mon[69013]: pgmap v1473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:16 smithi159 ceph-mon[69013]: pgmap v1474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:17.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:16 smithi096 ceph-mon[101353]: pgmap v1474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:18 smithi159 ceph-mon[69013]: pgmap v1475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:19.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:18 smithi096 ceph-mon[101353]: pgmap v1475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:20 smithi096 ceph-mon[101353]: pgmap v1476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:20 smithi159 ceph-mon[69013]: pgmap v1476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:22 smithi096 ceph-mon[101353]: pgmap v1477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:22 smithi159 ceph-mon[69013]: pgmap v1477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:25.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:24 smithi096 ceph-mon[101353]: pgmap v1478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:24 smithi159 ceph-mon[69013]: pgmap v1478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:27.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:26 smithi159 ceph-mon[69013]: pgmap v1479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:27.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:26 smithi096 ceph-mon[101353]: pgmap v1479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:11:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:11:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:11:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:11:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:28 smithi159 ceph-mon[69013]: pgmap v1480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:29.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:28 smithi096 ceph-mon[101353]: pgmap v1480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:31.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:30 smithi096 ceph-mon[101353]: pgmap v1481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:30 smithi159 ceph-mon[69013]: pgmap v1481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:33.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:32 smithi096 ceph-mon[101353]: pgmap v1482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:32 smithi159 ceph-mon[69013]: pgmap v1482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:35.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:34 smithi096 ceph-mon[101353]: pgmap v1483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:34 smithi159 ceph-mon[69013]: pgmap v1483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:37.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:36 smithi159 ceph-mon[69013]: pgmap v1484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:36 smithi096 ceph-mon[101353]: pgmap v1484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:39.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:38 smithi096 ceph-mon[101353]: pgmap v1485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:38 smithi159 ceph-mon[69013]: pgmap v1485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:40.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 -- 172.21.15.96:0/1447089239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 msgr2=0x7fd2080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:40.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 --2- 172.21.15.96:0/1447089239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd2080f6cc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fd204004660 tx=0x7fd204009b30).stop 2022-02-02T19:11:40.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 -- 172.21.15.96:0/1447089239 shutdown_connections 2022-02-02T19:11:40.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 --2- 172.21.15.96:0/1447089239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd2080f6cc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:40.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 --2- 172.21.15.96:0/1447089239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 0x7fd2080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:40.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 -- 172.21.15.96:0/1447089239 >> 172.21.15.96:0/1447089239 conn(0x7fd2080f0d40 msgr2=0x7fd2080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:40.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 -- 172.21.15.96:0/1447089239 shutdown_connections 2022-02-02T19:11:40.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.921+0000 7fd210382700 1 -- 172.21.15.96:0/1447089239 wait complete. 2022-02-02T19:11:40.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 Processor -- start 2022-02-02T19:11:40.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 -- start start 2022-02-02T19:11:40.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 0x7fd208109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:40.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:40.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208060420 con 0x7fd2080f6860 2022-02-02T19:11:40.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd210382700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208060560 con 0x7fd2080f55c0 2022-02-02T19:11:40.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd20d91d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:40.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd20d91d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58330/0 (socket says 172.21.15.96:58330) 2022-02-02T19:11:40.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd20d91d700 1 -- 172.21.15.96:0/2937546972 learned_addr learned my addr 172.21.15.96:0/2937546972 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:40.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.922+0000 7fd20e11e700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 0x7fd208109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:40.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd20d91d700 1 -- 172.21.15.96:0/2937546972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 msgr2=0x7fd208109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:40.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd20d91d700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 0x7fd208109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:40.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd20d91d700 1 -- 172.21.15.96:0/2937546972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204005040 con 0x7fd2080f6860 2022-02-02T19:11:40.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd20d91d700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fd204009990 tx=0x7fd204009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:40.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd204018070 con 0x7fd2080f6860 2022-02-02T19:11:40.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20810c6c0 con 0x7fd2080f6860 2022-02-02T19:11:40.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd204007ba0 con 0x7fd2080f6860 2022-02-02T19:11:40.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd20401c3c0 con 0x7fd2080f6860 2022-02-02T19:11:40.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.923+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20810cbf0 con 0x7fd2080f6860 2022-02-02T19:11:40.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.924+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2080f49b0 con 0x7fd2080f6860 2022-02-02T19:11:40.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.924+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd20401d420 con 0x7fd2080f6860 2022-02-02T19:11:40.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.925+0000 7fd1faffd700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 0x7fd1f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:40.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.925+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd204083770 con 0x7fd2080f6860 2022-02-02T19:11:40.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.925+0000 7fd20e11e700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 0x7fd1f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:40.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.925+0000 7fd20e11e700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 0x7fd1f4067290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd2080600a0 tx=0x7fd1fc009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:40.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:40.929+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd204051880 con 0x7fd2080f6860 2022-02-02T19:11:41.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:40 smithi096 ceph-mon[101353]: pgmap v1486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:41.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.110+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2080fdf00 con 0x7fd1f4064dd0 2022-02-02T19:11:41.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.111+0000 7fd1faffd700 1 -- 172.21.15.96:0/2937546972 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd2080fdf00 con 0x7fd1f4064dd0 2022-02-02T19:11:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 msgr2=0x7fd1f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 0x7fd1f4067290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd2080600a0 tx=0x7fd1fc009c00).stop 2022-02-02T19:11:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 msgr2=0x7fd20810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fd204009990 tx=0x7fd204009b30).stop 2022-02-02T19:11:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 shutdown_connections 2022-02-02T19:11:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1f4064dd0 0x7fd1f4067290 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2080f55c0 0x7fd208109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 --2- 172.21.15.96:0/2937546972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2080f6860 0x7fd20810c110 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 >> 172.21.15.96:0/2937546972 conn(0x7fd2080f0d40 msgr2=0x7fd2080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 shutdown_connections 2022-02-02T19:11:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.113+0000 7fd210382700 1 -- 172.21.15.96:0/2937546972 wait complete. 2022-02-02T19:11:41.126 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:11:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 -- 172.21.15.96:0/2154913268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 msgr2=0x7f7a600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 --2- 172.21.15.96:0/2154913268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a600f6950 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f7a54004660 tx=0x7f7a54009b30).stop 2022-02-02T19:11:41.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 -- 172.21.15.96:0/2154913268 shutdown_connections 2022-02-02T19:11:41.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 --2- 172.21.15.96:0/2154913268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 0x7f7a600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 --2- 172.21.15.96:0/2154913268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a600f6950 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 -- 172.21.15.96:0/2154913268 >> 172.21.15.96:0/2154913268 conn(0x7f7a600f1c90 msgr2=0x7f7a600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 -- 172.21.15.96:0/2154913268 shutdown_connections 2022-02-02T19:11:41.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.211+0000 7f7a6640a700 1 -- 172.21.15.96:0/2154913268 wait complete. 2022-02-02T19:11:41.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 Processor -- start 2022-02-02T19:11:41.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 -- start start 2022-02-02T19:11:41.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 0x7f7a601072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a601078f0 con 0x7f7a600f6530 2022-02-02T19:11:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a6640a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a60108100 con 0x7f7a600f77d0 2022-02-02T19:11:41.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a65408700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a65408700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58338/0 (socket says 172.21.15.96:58338) 2022-02-02T19:11:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a65408700 1 -- 172.21.15.96:0/1269200368 learned_addr learned my addr 172.21.15.96:0/1269200368 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a64c07700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 0x7f7a601072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a65408700 1 -- 172.21.15.96:0/1269200368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 msgr2=0x7f7a601072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.212+0000 7f7a65408700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 0x7f7a601072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a65408700 1 -- 172.21.15.96:0/1269200368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54005040 con 0x7f7a600f6530 2022-02-02T19:11:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a65408700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f7a54004f60 tx=0x7f7a54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a54018070 con 0x7f7a600f6530 2022-02-02T19:11:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a60108320 con 0x7f7a600f6530 2022-02-02T19:11:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a54007ba0 con 0x7f7a600f6530 2022-02-02T19:11:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a5401c620 con 0x7f7a600f6530 2022-02-02T19:11:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.213+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a60108880 con 0x7f7a600f6530 2022-02-02T19:11:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.214+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a60059100 con 0x7f7a600f6530 2022-02-02T19:11:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.214+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a5401c8e0 con 0x7f7a600f6530 2022-02-02T19:11:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.215+0000 7f7a51ffb700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 0x7f7a4c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.215+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7a54083990 con 0x7f7a600f6530 2022-02-02T19:11:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.215+0000 7f7a64c07700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 0x7f7a4c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.215+0000 7f7a64c07700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 0x7f7a4c0672e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f7a5c0041d0 tx=0x7f7a5c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.219+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a54051a40 con 0x7f7a600f6530 2022-02-02T19:11:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:40 smithi159 ceph-mon[69013]: pgmap v1486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:41.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.394+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a600fed60 con 0x7f7a4c064e20 2022-02-02T19:11:41.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.404+0000 7f7a51ffb700 1 -- 172.21.15.96:0/1269200368 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7a600fed60 con 0x7f7a4c064e20 2022-02-02T19:11:41.409 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:11:41.409 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (55m) 25m ago 56m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:11:41.410 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (47m) 25m ago 56m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:11:41.410 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (47m) 24m ago 55m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:11:41.410 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (54m) 25m ago 55m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:11:41.410 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (52m) 25m ago 52m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:11:41.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (47m) 25m ago 52m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:11:41.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (52m) 24m ago 52m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:11:41.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (48m) 24m ago 52m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:11:41.411 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (49m) 25m ago 57m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:11:41.412 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (48m) 24m ago 55m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:11:41.412 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (48m) 25m ago 57m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:11:41.412 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (48m) 24m ago 55m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:11:41.412 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (55m) 25m ago 55m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:11:41.413 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (55m) 24m ago 55m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:11:41.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (47m) 25m ago 54m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:11:41.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (46m) 25m ago 54m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:11:41.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (46m) 25m ago 54m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:11:41.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (45m) 24m ago 54m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:11:41.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (44m) 24m ago 53m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:11:41.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (44m) 24m ago 53m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:11:41.414 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (54m) 25m ago 55m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:11:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 msgr2=0x7f7a4c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 0x7f7a4c0672e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f7a5c0041d0 tx=0x7f7a5c009040).stop 2022-02-02T19:11:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 msgr2=0x7f7a60106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f7a54004f60 tx=0x7f7a54009b30).stop 2022-02-02T19:11:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 shutdown_connections 2022-02-02T19:11:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a4c064e20 0x7f7a4c0672e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a600f6530 0x7f7a60106e00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 --2- 172.21.15.96:0/1269200368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a600f77d0 0x7f7a601072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 >> 172.21.15.96:0/1269200368 conn(0x7f7a600f1c90 msgr2=0x7f7a600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 shutdown_connections 2022-02-02T19:11:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.406+0000 7f7a6640a700 1 -- 172.21.15.96:0/1269200368 wait complete. 2022-02-02T19:11:41.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 -- 172.21.15.96:0/1916143721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 msgr2=0x7f21ac0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 --2- 172.21.15.96:0/1916143721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac0f5850 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f219c004660 tx=0x7f219c009b30).stop 2022-02-02T19:11:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 -- 172.21.15.96:0/1916143721 shutdown_connections 2022-02-02T19:11:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 --2- 172.21.15.96:0/1916143721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 --2- 172.21.15.96:0/1916143721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac0f5850 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 -- 172.21.15.96:0/1916143721 >> 172.21.15.96:0/1916143721 conn(0x7f21ac0f0b90 msgr2=0x7f21ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 -- 172.21.15.96:0/1916143721 shutdown_connections 2022-02-02T19:11:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.501+0000 7f21b2d80700 1 -- 172.21.15.96:0/1916143721 wait complete. 2022-02-02T19:11:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 Processor -- start 2022-02-02T19:11:41.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 -- start start 2022-02-02T19:11:41.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0603e0 con 0x7f21ac0f5430 2022-02-02T19:11:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b2d80700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac060520 con 0x7f21ac0f66d0 2022-02-02T19:11:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b1d7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b1d7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58348/0 (socket says 172.21.15.96:58348) 2022-02-02T19:11:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b1d7e700 1 -- 172.21.15.96:0/2886465045 learned_addr learned my addr 172.21.15.96:0/2886465045 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.502+0000 7f21b157d700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b1d7e700 1 -- 172.21.15.96:0/2886465045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 msgr2=0x7f21ac10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b1d7e700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b1d7e700 1 -- 172.21.15.96:0/2886465045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c005040 con 0x7f21ac0f5430 2022-02-02T19:11:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b157d700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:11:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b1d7e700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f219c013a70 tx=0x7f219c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219c018070 con 0x7f21ac0f5430 2022-02-02T19:11:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f219c0097d0 con 0x7f21ac0f5430 2022-02-02T19:11:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac10c4e0 con 0x7f21ac0f5430 2022-02-02T19:11:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219c01c3c0 con 0x7f21ac0f5430 2022-02-02T19:11:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.503+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac10ca40 con 0x7f21ac0f5430 2022-02-02T19:11:41.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.504+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac045ad0 con 0x7f21ac0f5430 2022-02-02T19:11:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.504+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f219c007ba0 con 0x7f21ac0f5430 2022-02-02T19:11:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.505+0000 7f21a27fc700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.505+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f219c083790 con 0x7f21ac0f5430 2022-02-02T19:11:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.505+0000 7f21b157d700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.505+0000 7f21b157d700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f21a8009740 tx=0x7f21a8009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.509+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f219c051900 con 0x7f21ac0f5430 2022-02-02T19:11:41.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.740+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21ac0fdcc0 con 0x7f21ac0f5430 2022-02-02T19:11:41.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.740+0000 7f21a27fc700 1 -- 172.21.15.96:0/2886465045 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f219c054f20 con 0x7f21ac0f5430 2022-02-02T19:11:41.748 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:11:41.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:11:41.748 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:11:41.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:41.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:11:41.749 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:11:41.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:41.749 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:11:41.750 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:11:41.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:41.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:11:41.750 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:11:41.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:11:41.751 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:11:41.751 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:11:41.751 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:11:41.751 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:11:41.752 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:11:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 msgr2=0x7f21980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f21a8009740 tx=0x7f21a8009be0).stop 2022-02-02T19:11:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 msgr2=0x7f21ac109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f219c013a70 tx=0x7f219c009b30).stop 2022-02-02T19:11:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 shutdown_connections 2022-02-02T19:11:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f5430 0x7f21ac109a90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 --2- 172.21.15.96:0/2886465045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f66d0 0x7f21ac10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 >> 172.21.15.96:0/2886465045 conn(0x7f21ac0f0b90 msgr2=0x7f21ac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 shutdown_connections 2022-02-02T19:11:41.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.742+0000 7f21b2d80700 1 -- 172.21.15.96:0/2886465045 wait complete. 2022-02-02T19:11:41.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 -- 172.21.15.96:0/1882369125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc060270 msgr2=0x7f29bc0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 --2- 172.21.15.96:0/1882369125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc060270 0x7f29bc0f9340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f29b0004660 tx=0x7f29b0009b30).stop 2022-02-02T19:11:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 -- 172.21.15.96:0/1882369125 shutdown_connections 2022-02-02T19:11:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 --2- 172.21.15.96:0/1882369125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc0f9830 0x7f29bc0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:11:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 --2- 172.21.15.96:0/1882369125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc060270 0x7f29bc0f9340 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 -- 172.21.15.96:0/1882369125 >> 172.21.15.96:0/1882369125 conn(0x7f29bc0f0d40 msgr2=0x7f29bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 -- 172.21.15.96:0/1882369125 shutdown_connections 2022-02-02T19:11:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.841+0000 7f29c39bb700 1 -- 172.21.15.96:0/1882369125 wait complete. 2022-02-02T19:11:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 Processor -- start 2022-02-02T19:11:41.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 -- start start 2022-02-02T19:11:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc060270 0x7f29bc0f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0f5830 con 0x7f29bc0f9830 2022-02-02T19:11:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c39bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0f5970 con 0x7f29bc060270 2022-02-02T19:11:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58360/0 (socket says 172.21.15.96:58360) 2022-02-02T19:11:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 -- 172.21.15.96:0/3595740472 learned_addr learned my addr 172.21.15.96:0/3595740472 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:11:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c1757700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc060270 0x7f29bc0f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 -- 172.21.15.96:0/3595740472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc060270 msgr2=0x7f29bc0f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc060270 0x7f29bc0f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 -- 172.21.15.96:0/3595740472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0005040 con 0x7f29bc0f9830 2022-02-02T19:11:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29c0f56700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f29b80093f0 tx=0x7f29b8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.842+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8013640 con 0x7f29bc0f9830 2022-02-02T19:11:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.843+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f29b8013c50 con 0x7f29bc0f9830 2022-02-02T19:11:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.843+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0f5c50 con 0x7f29bc0f9830 2022-02-02T19:11:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.843+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8012c70 con 0x7f29bc0f9830 2022-02-02T19:11:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.843+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc10ef90 con 0x7f29bc0f9830 2022-02-02T19:11:41.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.844+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc045ad0 con 0x7f29bc0f9830 2022-02-02T19:11:41.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.844+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f29b801a060 con 0x7f29bc0f9830 2022-02-02T19:11:41.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.845+0000 7f29adffb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 0x7f29a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:11:41.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.845+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f29b8081e00 con 0x7f29bc0f9830 2022-02-02T19:11:41.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.845+0000 7f29c1757700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 0x7f29a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:11:41.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.845+0000 7f29c1757700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 0x7f29a8067290 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f29b0004630 tx=0x7f29b0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:11:41.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:41.849+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f29b804fe50 con 0x7f29bc0f9830 2022-02-02T19:11:42.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.049+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f29bc0f5de0 con 0x7f29bc0f9830 2022-02-02T19:11:42.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2886465045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:11:42.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.049+0000 7f29adffb700 1 -- 172.21.15.96:0/3595740472 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f29b8018720 con 0x7f29bc0f9830 2022-02-02T19:11:42.055 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:11:42.055 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:11:42.056 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:11:42.056 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:11:42.057 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:42.057 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:11:42.057 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:11:42.058 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:11:42.058 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:11:42.059 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:11:42.059 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:11:42.060 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:11:42.060 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:11:42.061 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:11:42.062 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:11:42.062 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:11:42.062 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:11:42.062 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:11:42.063 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:11:42.063 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:11:42.063 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:11:42.063 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:11:42.064 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:11:42.064 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:11:42.064 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:11:42.064 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:11:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:11:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:11:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:11:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:11:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:11:42.066 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:11:42.066 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:42.066 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:42.066 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:11:42.067 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:11:42.067 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:42.067 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:42.067 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:11:42.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 msgr2=0x7f29a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:42.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 0x7f29a8067290 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f29b0004630 tx=0x7f29b0009b30).stop 2022-02-02T19:11:42.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 msgr2=0x7f29bc0f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:11:42.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f29b80093f0 tx=0x7f29b8006ec0).stop 2022-02-02T19:11:42.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 shutdown_connections 2022-02-02T19:11:42.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29a8064dd0 0x7f29a8067290 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:42.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29bc060270 0x7f29bc0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:42.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 --2- 172.21.15.96:0/3595740472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29bc0f9830 0x7f29bc0f5240 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:11:42.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 >> 172.21.15.96:0/3595740472 conn(0x7f29bc0f0d40 msgr2=0x7f29bc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:11:42.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 shutdown_connections 2022-02-02T19:11:42.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:11:42.051+0000 7f29c39bb700 1 -- 172.21.15.96:0/3595740472 wait complete. 2022-02-02T19:11:42.071 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:11:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2886465045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:11:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:42 smithi096 ceph-mon[101353]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:42 smithi096 ceph-mon[101353]: from='client.35646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:42 smithi096 ceph-mon[101353]: pgmap v1487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:43.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3595740472' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:11:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:42 smithi159 ceph-mon[69013]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:42 smithi159 ceph-mon[69013]: from='client.35646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:11:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:42 smithi159 ceph-mon[69013]: pgmap v1487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3595740472' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:11:45.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:44 smithi096 ceph-mon[101353]: pgmap v1488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:44 smithi159 ceph-mon[69013]: pgmap v1488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:47.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:46 smithi159 ceph-mon[69013]: pgmap v1489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:47.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:46 smithi096 ceph-mon[101353]: pgmap v1489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:49.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:48 smithi096 ceph-mon[101353]: pgmap v1490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:49.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:48 smithi159 ceph-mon[69013]: pgmap v1490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:50 smithi096 ceph-mon[101353]: pgmap v1491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:51.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:50 smithi159 ceph-mon[69013]: pgmap v1491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:52 smithi096 ceph-mon[101353]: pgmap v1492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:53.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:52 smithi159 ceph-mon[69013]: pgmap v1492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:55.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:54 smithi096 ceph-mon[101353]: pgmap v1493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:55.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:54 smithi159 ceph-mon[69013]: pgmap v1493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:57.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:56 smithi159 ceph-mon[69013]: pgmap v1494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:57.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:56 smithi096 ceph-mon[101353]: pgmap v1494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:59.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:11:58 smithi096 ceph-mon[101353]: pgmap v1495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:11:59.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:11:58 smithi159 ceph-mon[69013]: pgmap v1495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:01.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:00 smithi096 ceph-mon[101353]: pgmap v1496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:00 smithi159 ceph-mon[69013]: pgmap v1496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:03.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:02 smithi096 ceph-mon[101353]: pgmap v1497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:03.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:02 smithi159 ceph-mon[69013]: pgmap v1497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:05.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:04 smithi096 ceph-mon[101353]: pgmap v1498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:04 smithi159 ceph-mon[69013]: pgmap v1498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:06 smithi159 ceph-mon[69013]: pgmap v1499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:06 smithi096 ceph-mon[101353]: pgmap v1499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:09.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:08 smithi096 ceph-mon[101353]: pgmap v1500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:09.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:08 smithi159 ceph-mon[69013]: pgmap v1500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:11.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:10 smithi096 ceph-mon[101353]: pgmap v1501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:10 smithi159 ceph-mon[69013]: pgmap v1501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 -- 172.21.15.96:0/57087151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f6860 msgr2=0x7fc04c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 --2- 172.21.15.96:0/57087151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f6860 0x7fc04c0f6cc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fc034004660 tx=0x7fc034009b30).stop 2022-02-02T19:12:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 -- 172.21.15.96:0/57087151 shutdown_connections 2022-02-02T19:12:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 --2- 172.21.15.96:0/57087151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f6860 0x7fc04c0f6cc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 --2- 172.21.15.96:0/57087151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f55c0 0x7fc04c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 -- 172.21.15.96:0/57087151 >> 172.21.15.96:0/57087151 conn(0x7fc04c0f0d40 msgr2=0x7fc04c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 -- 172.21.15.96:0/57087151 shutdown_connections 2022-02-02T19:12:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.164+0000 7fc051c84700 1 -- 172.21.15.96:0/57087151 wait complete. 2022-02-02T19:12:12.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 Processor -- start 2022-02-02T19:12:12.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 -- start start 2022-02-02T19:12:12.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f6860 0x7fc04c1051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c1057e0 con 0x7fc04c0f55c0 2022-02-02T19:12:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc051c84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c105920 con 0x7fc04c0f6860 2022-02-02T19:12:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58378/0 (socket says 172.21.15.96:58378) 2022-02-02T19:12:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 -- 172.21.15.96:0/3368324441 learned_addr learned my addr 172.21.15.96:0/3368324441 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc043fff700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f6860 0x7fc04c1051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 -- 172.21.15.96:0/3368324441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f6860 msgr2=0x7fc04c1051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f6860 0x7fc04c1051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.165+0000 7fc04b7fe700 1 -- 172.21.15.96:0/3368324441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034005040 con 0x7fc04c0f55c0 2022-02-02T19:12:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc04b7fe700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fc03c00c790 tx=0x7fc03c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc03c013630 con 0x7fc04c0f55c0 2022-02-02T19:12:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c106290 con 0x7fc04c0f55c0 2022-02-02T19:12:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc03c012860 con 0x7fc04c0f55c0 2022-02-02T19:12:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc03c002780 con 0x7fc04c0f55c0 2022-02-02T19:12:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.166+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c106850 con 0x7fc04c0f55c0 2022-02-02T19:12:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.167+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c045ad0 con 0x7fc04c0f55c0 2022-02-02T19:12:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.167+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc03c010070 con 0x7fc04c0f55c0 2022-02-02T19:12:12.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.168+0000 7fc048ff9700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 0x7fc038067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.168+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc03c081b80 con 0x7fc04c0f55c0 2022-02-02T19:12:12.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.168+0000 7fc043fff700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 0x7fc038067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.168+0000 7fc043fff700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 0x7fc038067290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc034004630 tx=0x7fc034009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.172+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc03c04fbd0 con 0x7fc04c0f55c0 2022-02-02T19:12:12.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.351+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc04c0faaa0 con 0x7fc038064dd0 2022-02-02T19:12:12.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.352+0000 7fc048ff9700 1 -- 172.21.15.96:0/3368324441 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc04c0faaa0 con 0x7fc038064dd0 2022-02-02T19:12:12.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 msgr2=0x7fc038067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 0x7fc038067290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc034004630 tx=0x7fc034009b30).stop 2022-02-02T19:12:12.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 msgr2=0x7fc04c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fc03c00c790 tx=0x7fc03c007d90).stop 2022-02-02T19:12:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 shutdown_connections 2022-02-02T19:12:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc038064dd0 0x7fc038067290 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc04c0f55c0 0x7fc04c104cf0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 --2- 172.21.15.96:0/3368324441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc04c0f6860 0x7fc04c1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 >> 172.21.15.96:0/3368324441 conn(0x7fc04c0f0d40 msgr2=0x7fc04c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 shutdown_connections 2022-02-02T19:12:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.354+0000 7fc051c84700 1 -- 172.21.15.96:0/3368324441 wait complete. 2022-02-02T19:12:12.367 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:12:12.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 -- 172.21.15.96:0/3773875258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f7590 msgr2=0x7fa2a40f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 --2- 172.21.15.96:0/3773875258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f7590 0x7fa2a40f59b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fa294004660 tx=0x7fa294009b30).stop 2022-02-02T19:12:12.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 -- 172.21.15.96:0/3773875258 shutdown_connections 2022-02-02T19:12:12.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 --2- 172.21.15.96:0/3773875258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f7590 0x7fa2a40f59b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 --2- 172.21.15.96:0/3773875258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a40f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 -- 172.21.15.96:0/3773875258 >> 172.21.15.96:0/3773875258 conn(0x7fa2a40f04c0 msgr2=0x7fa2a40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 -- 172.21.15.96:0/3773875258 shutdown_connections 2022-02-02T19:12:12.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.452+0000 7fa2a994a700 1 -- 172.21.15.96:0/3773875258 wait complete. 2022-02-02T19:12:12.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 Processor -- start 2022-02-02T19:12:12.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 -- start start 2022-02-02T19:12:12.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f7590 0x7fa2a410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40f5620 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a994a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40f5760 con 0x7fa2a40f7590 2022-02-02T19:12:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58388/0 (socket says 172.21.15.96:58388) 2022-02-02T19:12:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.453+0000 7fa2a2ffd700 1 -- 172.21.15.96:0/1956087703 learned_addr learned my addr 172.21.15.96:0/1956087703 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a27fc700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f7590 0x7fa2a410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a2ffd700 1 -- 172.21.15.96:0/1956087703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f7590 msgr2=0x7fa2a410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a2ffd700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f7590 0x7fa2a410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a2ffd700 1 -- 172.21.15.96:0/1956087703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294005040 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a2ffd700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa29800c510 tx=0x7fa298007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29800f650 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a410c760 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a410ccf0 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa29800fc60 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.454+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa298012d00 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.455+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa284004fa0 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.455+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa298010070 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.456+0000 7fa28b7fe700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 0x7fa28c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.456+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa298081570 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.456+0000 7fa2a27fc700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 0x7fa28c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.456+0000 7fa2a27fc700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 0x7fa28c067290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa294009da0 tx=0x7fa294009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.460+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa29804f620 con 0x7fa2a40f6bf0 2022-02-02T19:12:12.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.633+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa284000bc0 con 0x7fa28c064dd0 2022-02-02T19:12:12.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.643+0000 7fa28b7fe700 1 -- 172.21.15.96:0/1956087703 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa284000bc0 con 0x7fa28c064dd0 2022-02-02T19:12:12.647 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:12:12.649 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (55m) 26m ago 56m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:12:12.649 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (48m) 26m ago 56m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:12:12.650 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (47m) 24m ago 56m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:12:12.650 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (55m) 26m ago 56m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:12:12.650 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (52m) 26m ago 52m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:12:12.651 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (48m) 26m ago 52m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:12:12.651 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (52m) 24m ago 52m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:12:12.651 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (48m) 24m ago 52m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:12:12.651 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (49m) 26m ago 57m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:12:12.652 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (49m) 24m ago 56m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:12:12.652 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (48m) 26m ago 57m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:12:12.652 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (48m) 24m ago 56m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:12:12.652 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (56m) 26m ago 56m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:12:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (55m) 24m ago 55m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:12:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (47m) 26m ago 55m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:12:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (47m) 26m ago 55m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:12:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (46m) 26m ago 54m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:12:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (45m) 24m ago 54m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:12:12.654 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (45m) 24m ago 54m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:12:12.654 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (45m) 24m ago 53m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:12:12.654 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (55m) 26m ago 56m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:12:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 msgr2=0x7fa28c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 0x7fa28c067290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa294009da0 tx=0x7fa294009b30).stop 2022-02-02T19:12:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 msgr2=0x7fa2a4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa29800c510 tx=0x7fa298007df0).stop 2022-02-02T19:12:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 shutdown_connections 2022-02-02T19:12:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa28c064dd0 0x7fa28c067290 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a40f6bf0 0x7fa2a4109cb0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 --2- 172.21.15.96:0/1956087703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2a40f7590 0x7fa2a410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.644+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 >> 172.21.15.96:0/1956087703 conn(0x7fa2a40f04c0 msgr2=0x7fa2a40fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.645+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 shutdown_connections 2022-02-02T19:12:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.645+0000 7fa2a994a700 1 -- 172.21.15.96:0/1956087703 wait complete. 2022-02-02T19:12:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 -- 172.21.15.96:0/3439908860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 msgr2=0x7fef580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 --2- 172.21.15.96:0/3439908860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef580f59e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fef4c004660 tx=0x7fef4c009b30).stop 2022-02-02T19:12:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 -- 172.21.15.96:0/3439908860 shutdown_connections 2022-02-02T19:12:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 --2- 172.21.15.96:0/3439908860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 0x7fef580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:12:12.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 --2- 172.21.15.96:0/3439908860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef580f59e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 -- 172.21.15.96:0/3439908860 >> 172.21.15.96:0/3439908860 conn(0x7fef580f0d40 msgr2=0x7fef580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 -- 172.21.15.96:0/3439908860 shutdown_connections 2022-02-02T19:12:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.740+0000 7fef5fc19700 1 -- 172.21.15.96:0/3439908860 wait complete. 2022-02-02T19:12:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 Processor -- start 2022-02-02T19:12:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 -- start start 2022-02-02T19:12:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 0x7fef58107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58107ac0 con 0x7fef580f55c0 2022-02-02T19:12:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5fc19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58108370 con 0x7fef580f6860 2022-02-02T19:12:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d9b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d9b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58398/0 (socket says 172.21.15.96:58398) 2022-02-02T19:12:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d9b5700 1 -- 172.21.15.96:0/1988132258 learned_addr learned my addr 172.21.15.96:0/1988132258 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d1b4700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 0x7fef58107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d9b5700 1 -- 172.21.15.96:0/1988132258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 msgr2=0x7fef58107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.741+0000 7fef5d9b5700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 0x7fef58107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef5d9b5700 1 -- 172.21.15.96:0/1988132258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c005040 con 0x7fef580f55c0 2022-02-02T19:12:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef5d9b5700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fef4c004f60 tx=0x7fef4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c018070 con 0x7fef580f55c0 2022-02-02T19:12:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef4c009770 con 0x7fef580f55c0 2022-02-02T19:12:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef581085f0 con 0x7fef580f55c0 2022-02-02T19:12:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c01c3c0 con 0x7fef580f55c0 2022-02-02T19:12:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.742+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58108b50 con 0x7fef580f55c0 2022-02-02T19:12:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.743+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef40004fa0 con 0x7fef580f55c0 2022-02-02T19:12:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.743+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fef4c01d420 con 0x7fef580f55c0 2022-02-02T19:12:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.744+0000 7fef4a7fc700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 0x7fef44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.744+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fef4c0837b0 con 0x7fef580f55c0 2022-02-02T19:12:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.744+0000 7fef5d1b4700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 0x7fef44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.744+0000 7fef5d1b4700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 0x7fef44067290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fef54006fd0 tx=0x7fef54008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.748+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fef4c055350 con 0x7fef580f55c0 2022-02-02T19:12:12.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.978+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef40005e80 con 0x7fef580f55c0 2022-02-02T19:12:12.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.979+0000 7fef4a7fc700 1 -- 172.21.15.96:0/1988132258 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fef4c054f40 con 0x7fef580f55c0 2022-02-02T19:12:12.983 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:12:12.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:12:12.983 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:12:12.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:12.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:12:12.984 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:12:12.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:12.984 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:12:12.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:12:12.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:12.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:12:12.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:12:12.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:12.986 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:12:12.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:12:12.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:12:12.986 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:12:12.986 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:12:12.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 msgr2=0x7fef44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 0x7fef44067290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fef54006fd0 tx=0x7fef54008040).stop 2022-02-02T19:12:12.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 msgr2=0x7fef58106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:12.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fef4c004f60 tx=0x7fef4c009b30).stop 2022-02-02T19:12:12.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 shutdown_connections 2022-02-02T19:12:12.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef44064dd0 0x7fef44067290 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef580f55c0 0x7fef58106f90 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 --2- 172.21.15.96:0/1988132258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef580f6860 0x7fef58107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:12.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.980+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 >> 172.21.15.96:0/1988132258 conn(0x7fef580f0d40 msgr2=0x7fef5805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:12.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.981+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 shutdown_connections 2022-02-02T19:12:12.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:12.981+0000 7fef5fc19700 1 -- 172.21.15.96:0/1988132258 wait complete. 2022-02-02T19:12:13.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:12 smithi096 ceph-mon[101353]: pgmap v1502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:13.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 -- 172.21.15.96:0/2615011549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 msgr2=0x7fad740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:13.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/2615011549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad740f6cc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fad70004660 tx=0x7fad70009b30).stop 2022-02-02T19:12:13.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 -- 172.21.15.96:0/2615011549 shutdown_connections 2022-02-02T19:12:13.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/2615011549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad740f6cc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:13.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/2615011549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 0x7fad740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:12:13.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 -- 172.21.15.96:0/2615011549 >> 172.21.15.96:0/2615011549 conn(0x7fad740f0d40 msgr2=0x7fad740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:13.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 -- 172.21.15.96:0/2615011549 shutdown_connections 2022-02-02T19:12:13.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.078+0000 7fad7bdaa700 1 -- 172.21.15.96:0/2615011549 wait complete. 2022-02-02T19:12:13.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 Processor -- start 2022-02-02T19:12:13.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 -- start start 2022-02-02T19:12:13.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 0x7fad74109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:13.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:13.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74060470 con 0x7fad740f6860 2022-02-02T19:12:13.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad7bdaa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad740605b0 con 0x7fad740f55c0 2022-02-02T19:12:13.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:13.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58410/0 (socket says 172.21.15.96:58410) 2022-02-02T19:12:13.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 -- 172.21.15.96:0/3729407442 learned_addr learned my addr 172.21.15.96:0/3729407442 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:13.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79b46700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 0x7fad74109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:13.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 -- 172.21.15.96:0/3729407442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 msgr2=0x7fad74109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:13.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 0x7fad74109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:13.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.079+0000 7fad79345700 1 -- 172.21.15.96:0/3729407442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70005040 con 0x7fad740f6860 2022-02-02T19:12:13.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad79345700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fad70009990 tx=0x7fad70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:13.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad70018070 con 0x7fad740f6860 2022-02-02T19:12:13.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad70007ca0 con 0x7fad740f6860 2022-02-02T19:12:13.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7410c7b0 con 0x7fad740f6860 2022-02-02T19:12:13.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7001c620 con 0x7fad740f6860 2022-02-02T19:12:13.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.080+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7410cce0 con 0x7fad740f6860 2022-02-02T19:12:13.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.081+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad74045ad0 con 0x7fad740f6860 2022-02-02T19:12:13.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.081+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad7001d960 con 0x7fad740f6860 2022-02-02T19:12:13.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.082+0000 7fad6a7fc700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 0x7fad60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:13.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.082+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fad70083830 con 0x7fad740f6860 2022-02-02T19:12:13.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.082+0000 7fad79b46700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 0x7fad60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:13.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.082+0000 7fad79b46700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 0x7fad60067290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fad74060060 tx=0x7fad64008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:13.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.086+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad700519a0 con 0x7fad740f6860 2022-02-02T19:12:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:12 smithi159 ceph-mon[69013]: pgmap v1502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.286+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad740fdec0 con 0x7fad740f6860 2022-02-02T19:12:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.287+0000 7fad6a7fc700 1 -- 172.21.15.96:0/3729407442 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fad70054fc0 con 0x7fad740f6860 2022-02-02T19:12:13.291 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:12:13.291 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:12:13.292 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:12:13.292 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:12:13.292 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:13.293 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:12:13.293 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:12:13.293 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:12:13.293 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:12:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:12:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:12:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:12:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:12:13.295 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:12:13.295 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:12:13.295 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:12:13.296 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:12:13.296 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:12:13.296 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:12:13.297 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:12:13.297 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:12:13.297 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:12:13.297 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:12:13.297 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:12:13.298 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:12:13.298 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:12:13.298 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:12:13.298 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:12:13.298 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:12:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:12:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:12:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:12:13.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:13.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:13.300 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:12:13.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:13.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:13.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:13.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 msgr2=0x7fad60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 0x7fad60067290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fad74060060 tx=0x7fad64008040).stop 2022-02-02T19:12:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 msgr2=0x7fad7410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fad70009990 tx=0x7fad70009b30).stop 2022-02-02T19:12:13.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 shutdown_connections 2022-02-02T19:12:13.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad60064dd0 0x7fad60067290 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:13.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad740f55c0 0x7fad74109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:13.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 --2- 172.21.15.96:0/3729407442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad740f6860 0x7fad7410c1b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:13.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 >> 172.21.15.96:0/3729407442 conn(0x7fad740f0d40 msgr2=0x7fad740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:13.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 shutdown_connections 2022-02-02T19:12:13.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:13.289+0000 7fad7bdaa700 1 -- 172.21.15.96:0/3729407442 wait complete. 2022-02-02T19:12:13.304 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:12:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:13 smithi096 ceph-mon[101353]: from='client.35658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:13 smithi096 ceph-mon[101353]: from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1988132258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:12:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3729407442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:12:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:13 smithi159 ceph-mon[69013]: from='client.35658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:13 smithi159 ceph-mon[69013]: from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1988132258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:12:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3729407442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:12:15.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:14 smithi096 ceph-mon[101353]: pgmap v1503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:14 smithi159 ceph-mon[69013]: pgmap v1503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:16 smithi159 ceph-mon[69013]: pgmap v1504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:17.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:16 smithi096 ceph-mon[101353]: pgmap v1504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:19.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:18 smithi096 ceph-mon[101353]: pgmap v1505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:19.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:18 smithi159 ceph-mon[69013]: pgmap v1505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:21.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:20 smithi096 ceph-mon[101353]: pgmap v1506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:20 smithi159 ceph-mon[69013]: pgmap v1506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:22 smithi096 ceph-mon[101353]: pgmap v1507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:22 smithi159 ceph-mon[69013]: pgmap v1507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:25.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:24 smithi096 ceph-mon[101353]: pgmap v1508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:24 smithi159 ceph-mon[69013]: pgmap v1508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:27.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:26 smithi159 ceph-mon[69013]: pgmap v1509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:27.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:26 smithi096 ceph-mon[101353]: pgmap v1509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:12:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:12:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:12:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:12:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:28 smithi159 ceph-mon[69013]: pgmap v1510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:28 smithi096 ceph-mon[101353]: pgmap v1510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:31.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:30 smithi096 ceph-mon[101353]: pgmap v1511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:30 smithi159 ceph-mon[69013]: pgmap v1511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:33.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:32 smithi096 ceph-mon[101353]: pgmap v1512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:33.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:32 smithi159 ceph-mon[69013]: pgmap v1512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:35.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:34 smithi096 ceph-mon[101353]: pgmap v1513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:34 smithi159 ceph-mon[69013]: pgmap v1513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:37.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:36 smithi159 ceph-mon[69013]: pgmap v1514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:36 smithi096 ceph-mon[101353]: pgmap v1514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:39.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:38 smithi096 ceph-mon[101353]: pgmap v1515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:39.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:38 smithi159 ceph-mon[69013]: pgmap v1515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:41.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:40 smithi096 ceph-mon[101353]: pgmap v1516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:41.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:40 smithi159 ceph-mon[69013]: pgmap v1516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:42 smithi096 ceph-mon[101353]: pgmap v1517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:43.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:42 smithi159 ceph-mon[69013]: pgmap v1517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.400+0000 7f676da1e700 1 -- 172.21.15.96:0/1512018382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f5460 msgr2=0x7f67680f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.400+0000 7f676da1e700 1 --2- 172.21.15.96:0/1512018382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f5460 0x7f67680f5880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f675c004660 tx=0x7f675c009b30).stop 2022-02-02T19:12:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 -- 172.21.15.96:0/1512018382 shutdown_connections 2022-02-02T19:12:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 --2- 172.21.15.96:0/1512018382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f6700 0x7f67680f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 --2- 172.21.15.96:0/1512018382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f5460 0x7f67680f5880 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 -- 172.21.15.96:0/1512018382 >> 172.21.15.96:0/1512018382 conn(0x7f67680f0bc0 msgr2=0x7f67680f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 -- 172.21.15.96:0/1512018382 shutdown_connections 2022-02-02T19:12:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 -- 172.21.15.96:0/1512018382 wait complete. 2022-02-02T19:12:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 Processor -- start 2022-02-02T19:12:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.401+0000 7f676da1e700 1 -- start start 2022-02-02T19:12:43.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f676da1e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f5460 0x7f6768105d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f676da1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f676da1e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768106860 con 0x7f67680f6700 2022-02-02T19:12:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f676da1e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768107070 con 0x7f67680f5460 2022-02-02T19:12:43.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58434/0 (socket says 172.21.15.96:58434) 2022-02-02T19:12:43.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 -- 172.21.15.96:0/4223854669 learned_addr learned my addr 172.21.15.96:0/4223854669 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:43.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f6766ffd700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f5460 0x7f6768105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 -- 172.21.15.96:0/4223854669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f5460 msgr2=0x7f6768105d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f5460 0x7f6768105d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 -- 172.21.15.96:0/4223854669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c005040 con 0x7f67680f6700 2022-02-02T19:12:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f67667fc700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f675800c790 tx=0x7f6758007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6758002590 con 0x7f67680f6700 2022-02-02T19:12:43.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6758002ba0 con 0x7f67680f6700 2022-02-02T19:12:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67681072f0 con 0x7f67680f6700 2022-02-02T19:12:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.402+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6758013d90 con 0x7f67680f6700 2022-02-02T19:12:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.403+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681078b0 con 0x7f67680f6700 2022-02-02T19:12:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.404+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f675801a060 con 0x7f67680f6700 2022-02-02T19:12:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.404+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6768059100 con 0x7f67680f6700 2022-02-02T19:12:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.405+0000 7f674f7fe700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 0x7f67500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.405+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6758081d10 con 0x7f67680f6700 2022-02-02T19:12:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.405+0000 7f6766ffd700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 0x7f67500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.405+0000 7f6766ffd700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 0x7f67500672e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f675c013690 tx=0x7f675c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.409+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f675804fd60 con 0x7f67680f6700 2022-02-02T19:12:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.588+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67680fdd10 con 0x7f6750064e20 2022-02-02T19:12:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.590+0000 7f674f7fe700 1 -- 172.21.15.96:0/4223854669 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f67680fdd10 con 0x7f6750064e20 2022-02-02T19:12:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 msgr2=0x7f67500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 0x7f67500672e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f675c013690 tx=0x7f675c009b30).stop 2022-02-02T19:12:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 msgr2=0x7f6768106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f675800c790 tx=0x7f6758007d70).stop 2022-02-02T19:12:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 shutdown_connections 2022-02-02T19:12:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6750064e20 0x7f67500672e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67680f5460 0x7f6768105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 --2- 172.21.15.96:0/4223854669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67680f6700 0x7f6768106260 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 >> 172.21.15.96:0/4223854669 conn(0x7f67680f0bc0 msgr2=0x7f67680fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.591+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 shutdown_connections 2022-02-02T19:12:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.592+0000 7f676da1e700 1 -- 172.21.15.96:0/4223854669 wait complete. 2022-02-02T19:12:43.604 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:12:43.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 -- 172.21.15.96:0/4191095005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f7980 msgr2=0x7f84600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 --2- 172.21.15.96:0/4191095005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f7980 0x7f84600f7de0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f8450004660 tx=0x7f8450009b30).stop 2022-02-02T19:12:43.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 -- 172.21.15.96:0/4191095005 shutdown_connections 2022-02-02T19:12:43.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 --2- 172.21.15.96:0/4191095005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f7980 0x7f84600f7de0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 --2- 172.21.15.96:0/4191095005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f66e0 0x7f84600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 -- 172.21.15.96:0/4191095005 >> 172.21.15.96:0/4191095005 conn(0x7f84600f1e40 msgr2=0x7f84600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:43.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 -- 172.21.15.96:0/4191095005 shutdown_connections 2022-02-02T19:12:43.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.690+0000 7f846554c700 1 -- 172.21.15.96:0/4191095005 wait complete. 2022-02-02T19:12:43.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 Processor -- start 2022-02-02T19:12:43.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 -- start start 2022-02-02T19:12:43.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f7980 0x7f8460107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460107a00 con 0x7f84600f66e0 2022-02-02T19:12:43.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f846554c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460107b40 con 0x7f84600f7980 2022-02-02T19:12:43.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58442/0 (socket says 172.21.15.96:58442) 2022-02-02T19:12:43.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 -- 172.21.15.96:0/3298009897 learned_addr learned my addr 172.21.15.96:0/3298009897 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:43.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845e7fc700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f7980 0x7f8460107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 -- 172.21.15.96:0/3298009897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f7980 msgr2=0x7f8460107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f7980 0x7f8460107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 -- 172.21.15.96:0/3298009897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450005040 con 0x7f84600f66e0 2022-02-02T19:12:43.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.691+0000 7f845effd700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f8454002700 tx=0x7f8454009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.692+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8454009320 con 0x7f84600f66e0 2022-02-02T19:12:43.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.692+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84601084e0 con 0x7f84600f66e0 2022-02-02T19:12:43.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.692+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f845400f040 con 0x7f84600f66e0 2022-02-02T19:12:43.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.692+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8460108aa0 con 0x7f84600f66e0 2022-02-02T19:12:43.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.692+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8454014900 con 0x7f84600f66e0 2022-02-02T19:12:43.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.693+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440004fa0 con 0x7f84600f66e0 2022-02-02T19:12:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.693+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8454009480 con 0x7f84600f66e0 2022-02-02T19:12:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.693+0000 7f84477fe700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 0x7f8448067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.694+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8454081c80 con 0x7f84600f66e0 2022-02-02T19:12:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.694+0000 7f845e7fc700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 0x7f8448067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.694+0000 7f845e7fc700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 0x7f8448067290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f8450009da0 tx=0x7f8450009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.698+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8454053760 con 0x7f84600f66e0 2022-02-02T19:12:43.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.871+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84400029f0 con 0x7f8448064dd0 2022-02-02T19:12:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.882+0000 7f84477fe700 1 -- 172.21.15.96:0/3298009897 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f84400029f0 con 0x7f8448064dd0 2022-02-02T19:12:43.885 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:12:43.885 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (56m) 26m ago 57m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:12:43.885 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (48m) 26m ago 57m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:12:43.886 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (48m) 25m ago 56m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:12:43.886 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (55m) 26m ago 56m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:12:43.886 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (53m) 26m ago 53m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:12:43.886 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (48m) 26m ago 53m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:12:43.887 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (53m) 25m ago 53m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:12:43.887 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (49m) 25m ago 53m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:12:43.887 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (50m) 26m ago 58m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:12:43.887 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (49m) 25m ago 56m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:12:43.888 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (49m) 26m ago 58m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:12:43.888 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (49m) 25m ago 56m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:12:43.888 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (56m) 26m ago 56m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:12:43.888 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (56m) 25m ago 56m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:12:43.888 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (48m) 26m ago 56m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:12:43.889 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (47m) 26m ago 55m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:12:43.889 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (47m) 26m ago 55m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:12:43.889 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (46m) 25m ago 55m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:12:43.889 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (46m) 25m ago 54m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:12:43.890 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (45m) 25m ago 54m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:12:43.890 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (55m) 26m ago 56m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:12:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 msgr2=0x7f8448067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 0x7f8448067290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f8450009da0 tx=0x7f8450009b30).stop 2022-02-02T19:12:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 msgr2=0x7f8460106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f8454002700 tx=0x7f8454009d80).stop 2022-02-02T19:12:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 shutdown_connections 2022-02-02T19:12:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8448064dd0 0x7f8448067290 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84600f66e0 0x7f8460106f60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 --2- 172.21.15.96:0/3298009897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84600f7980 0x7f8460107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 >> 172.21.15.96:0/3298009897 conn(0x7f84600f1e40 msgr2=0x7f84600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 shutdown_connections 2022-02-02T19:12:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.884+0000 7f846554c700 1 -- 172.21.15.96:0/3298009897 wait complete. 2022-02-02T19:12:43.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 -- 172.21.15.96:0/2435051841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 msgr2=0x7f05600f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 --2- 172.21.15.96:0/2435051841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f7ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f055c004660 tx=0x7f055c009b30).stop 2022-02-02T19:12:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 -- 172.21.15.96:0/2435051841 shutdown_connections 2022-02-02T19:12:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 --2- 172.21.15.96:0/2435051841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f7ac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 --2- 172.21.15.96:0/2435051841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 0x7f05600f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 -- 172.21.15.96:0/2435051841 >> 172.21.15.96:0/2435051841 conn(0x7f05600f04c0 msgr2=0x7f05600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 -- 172.21.15.96:0/2435051841 shutdown_connections 2022-02-02T19:12:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.980+0000 7f0567969700 1 -- 172.21.15.96:0/2435051841 wait complete. 2022-02-02T19:12:43.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 Processor -- start 2022-02-02T19:12:43.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 -- start start 2022-02-02T19:12:43.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 0x7f05600f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600f5f30 con 0x7f05600f5340 2022-02-02T19:12:43.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0567969700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600f6070 con 0x7f05600f49a0 2022-02-02T19:12:43.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58452/0 (socket says 172.21.15.96:58452) 2022-02-02T19:12:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 -- 172.21.15.96:0/2795893393 learned_addr learned my addr 172.21.15.96:0/2795893393 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0565705700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 0x7f05600f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 -- 172.21.15.96:0/2795893393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 msgr2=0x7f05600f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 0x7f05600f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.981+0000 7f0564f04700 1 -- 172.21.15.96:0/2795893393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c005040 con 0x7f05600f5340 2022-02-02T19:12:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0564f04700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f055c0043a0 tx=0x7f055c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c018070 con 0x7f05600f5340 2022-02-02T19:12:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05600f62f0 con 0x7f05600f5340 2022-02-02T19:12:43.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f055c007ba0 con 0x7f05600f5340 2022-02-02T19:12:43.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c01de30 con 0x7f05600f5340 2022-02-02T19:12:43.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.982+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05600f6850 con 0x7f05600f5340 2022-02-02T19:12:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.983+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0560045ad0 con 0x7f05600f5340 2022-02-02T19:12:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.984+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f055c01d420 con 0x7f05600f5340 2022-02-02T19:12:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.985+0000 7f0555ffb700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 0x7f054c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.985+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f055c0838a0 con 0x7f05600f5340 2022-02-02T19:12:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.985+0000 7f0565705700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 0x7f054c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.985+0000 7f0565705700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 0x7f054c067290 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f05600f72e0 tx=0x7f055000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:43.988+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f055c051890 con 0x7f05600f5340 2022-02-02T19:12:44.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.217+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0560027a00 con 0x7f05600f5340 2022-02-02T19:12:44.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.218+0000 7f0555ffb700 1 -- 172.21.15.96:0/2795893393 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f055c054eb0 con 0x7f05600f5340 2022-02-02T19:12:44.221 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:12:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:12:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:12:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:12:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:12:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:12:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:12:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:12:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:12:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:12:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:12:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:12:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:12:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:12:44.225 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:12:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.219+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 msgr2=0x7f054c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.219+0000 7f0567969700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 0x7f054c067290 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f05600f72e0 tx=0x7f055000b040).stop 2022-02-02T19:12:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.219+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 msgr2=0x7f05600f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.219+0000 7f0567969700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f055c0043a0 tx=0x7f055c009b30).stop 2022-02-02T19:12:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 shutdown_connections 2022-02-02T19:12:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f054c064dd0 0x7f054c067290 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05600f49a0 0x7f05600f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 --2- 172.21.15.96:0/2795893393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05600f5340 0x7f05600f59d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 >> 172.21.15.96:0/2795893393 conn(0x7f05600f04c0 msgr2=0x7f05600fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 shutdown_connections 2022-02-02T19:12:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.220+0000 7f0567969700 1 -- 172.21.15.96:0/2795893393 wait complete. 2022-02-02T19:12:44.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 -- 172.21.15.96:0/445617652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f66d0 msgr2=0x7fe1ac0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 --2- 172.21.15.96:0/445617652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac0f6b30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fe19c004660 tx=0x7fe19c009b30).stop 2022-02-02T19:12:44.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 -- 172.21.15.96:0/445617652 shutdown_connections 2022-02-02T19:12:44.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 --2- 172.21.15.96:0/445617652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac0f6b30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 --2- 172.21.15.96:0/445617652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 -- 172.21.15.96:0/445617652 >> 172.21.15.96:0/445617652 conn(0x7fe1ac0f0b90 msgr2=0x7fe1ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 -- 172.21.15.96:0/445617652 shutdown_connections 2022-02-02T19:12:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.317+0000 7fe1b167f700 1 -- 172.21.15.96:0/445617652 wait complete. 2022-02-02T19:12:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 Processor -- start 2022-02-02T19:12:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 -- start start 2022-02-02T19:12:44.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:44.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:44.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac106760 con 0x7fe1ac0f5430 2022-02-02T19:12:44.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1b167f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac106f60 con 0x7fe1ac0f66d0 2022-02-02T19:12:44.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:44.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.318+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58460/0 (socket says 172.21.15.96:58460) 2022-02-02T19:12:44.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1abfff700 1 -- 172.21.15.96:0/2059868409 learned_addr learned my addr 172.21.15.96:0/2059868409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:12:44.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1ab7fe700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1abfff700 1 -- 172.21.15.96:0/2059868409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f66d0 msgr2=0x7fe1ac1061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1abfff700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac1061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1abfff700 1 -- 172.21.15.96:0/2059868409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c005040 con 0x7fe1ac0f5430 2022-02-02T19:12:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1abfff700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fe19400c790 tx=0x7fe194007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194013630 con 0x7fe1ac0f5430 2022-02-02T19:12:44.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe194012860 con 0x7fe1ac0f5430 2022-02-02T19:12:44.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac107240 con 0x7fe1ac0f5430 2022-02-02T19:12:44.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac107800 con 0x7fe1ac0f5430 2022-02-02T19:12:44.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.319+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194002780 con 0x7fe1ac0f5430 2022-02-02T19:12:44.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.320+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe190004fa0 con 0x7fe1ac0f5430 2022-02-02T19:12:44.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.321+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe194010070 con 0x7fe1ac0f5430 2022-02-02T19:12:44.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.321+0000 7fe1a8ff9700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 0x7fe1980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:12:44.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.321+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe194081ad0 con 0x7fe1ac0f5430 2022-02-02T19:12:44.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.321+0000 7fe1ab7fe700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 0x7fe1980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:12:44.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.321+0000 7fe1ab7fe700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 0x7fe1980672e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe19c004630 tx=0x7fe19c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:12:44.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.325+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe194053550 con 0x7fe1ac0f5430 2022-02-02T19:12:44.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.527+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe190005e80 con 0x7fe1ac0f5430 2022-02-02T19:12:44.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.528+0000 7fe1a8ff9700 1 -- 172.21.15.96:0/2059868409 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe194053140 con 0x7fe1ac0f5430 2022-02-02T19:12:44.531 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:12:44.531 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:12:44.532 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:12:44.532 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:12:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:44.532 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:12:44.533 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:12:44.533 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:12:44.533 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:12:44.533 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:12:44.533 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:12:44.534 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:12:44.534 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:12:44.534 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:12:44.534 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:12:44.535 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:12:44.535 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:12:44.535 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:12:44.535 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:12:44.536 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:12:44.536 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:12:44.536 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:12:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:12:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:12:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:12:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:12:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:12:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:12:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:12:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:12:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:12:44.539 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:12:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:44.539 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:12:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:12:44.540 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:44.540 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:44.540 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:12:44.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 msgr2=0x7fe1980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 0x7fe1980672e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe19c004630 tx=0x7fe19c009b30).stop 2022-02-02T19:12:44.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 msgr2=0x7fe1ac105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:12:44.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fe19400c790 tx=0x7fe194007d90).stop 2022-02-02T19:12:44.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 shutdown_connections 2022-02-02T19:12:44.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe198064e20 0x7fe1980672e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1ac0f5430 0x7fe1ac105cc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 --2- 172.21.15.96:0/2059868409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1ac0f66d0 0x7fe1ac1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:12:44.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 >> 172.21.15.96:0/2059868409 conn(0x7fe1ac0f0b90 msgr2=0x7fe1ac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:12:44.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 shutdown_connections 2022-02-02T19:12:44.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:12:44.530+0000 7fe1b167f700 1 -- 172.21.15.96:0/2059868409 wait complete. 2022-02-02T19:12:44.549 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:12:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:44 smithi159 ceph-mon[69013]: from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:44 smithi159 ceph-mon[69013]: pgmap v1518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:44 smithi159 ceph-mon[69013]: from='client.35678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2795893393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:12:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2059868409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:12:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:44 smithi096 ceph-mon[101353]: from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:44 smithi096 ceph-mon[101353]: pgmap v1518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:44 smithi096 ceph-mon[101353]: from='client.35678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:12:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2795893393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:12:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2059868409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:12:47.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:46 smithi159 ceph-mon[69013]: pgmap v1519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:47.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:46 smithi096 ceph-mon[101353]: pgmap v1519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:49.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:48 smithi096 ceph-mon[101353]: pgmap v1520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:49.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:48 smithi159 ceph-mon[69013]: pgmap v1520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:51.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:50 smithi096 ceph-mon[101353]: pgmap v1521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:51.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:50 smithi159 ceph-mon[69013]: pgmap v1521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:52 smithi096 ceph-mon[101353]: pgmap v1522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:53.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:52 smithi159 ceph-mon[69013]: pgmap v1522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:54 smithi159 ceph-mon[69013]: pgmap v1523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:55.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:54 smithi096 ceph-mon[101353]: pgmap v1523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:57.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:56 smithi159 ceph-mon[69013]: pgmap v1524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:57.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:56 smithi096 ceph-mon[101353]: pgmap v1524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:59.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:12:58 smithi096 ceph-mon[101353]: pgmap v1525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:12:59.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:12:58 smithi159 ceph-mon[69013]: pgmap v1525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:01.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:00 smithi096 ceph-mon[101353]: pgmap v1526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:00 smithi159 ceph-mon[69013]: pgmap v1526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:03.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:02 smithi096 ceph-mon[101353]: pgmap v1527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:03.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:02 smithi159 ceph-mon[69013]: pgmap v1527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:05.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:04 smithi159 ceph-mon[69013]: pgmap v1528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:05.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:04 smithi096 ceph-mon[101353]: pgmap v1528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:07.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:06 smithi159 ceph-mon[69013]: pgmap v1529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:06 smithi096 ceph-mon[101353]: pgmap v1529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:09.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:08 smithi096 ceph-mon[101353]: pgmap v1530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:09.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:08 smithi159 ceph-mon[69013]: pgmap v1530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:10 smithi159 ceph-mon[69013]: pgmap v1531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:10 smithi096 ceph-mon[101353]: pgmap v1531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:12 smithi096 ceph-mon[101353]: pgmap v1532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:12 smithi159 ceph-mon[69013]: pgmap v1532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:14.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 -- 172.21.15.96:0/3679972051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f6860 msgr2=0x7ff9300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 --2- 172.21.15.96:0/3679972051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f6860 0x7ff9300f6cc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff924004660 tx=0x7ff924009b30).stop 2022-02-02T19:13:14.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 -- 172.21.15.96:0/3679972051 shutdown_connections 2022-02-02T19:13:14.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 --2- 172.21.15.96:0/3679972051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f6860 0x7ff9300f6cc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 --2- 172.21.15.96:0/3679972051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f55c0 0x7ff9300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:13:14.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 -- 172.21.15.96:0/3679972051 >> 172.21.15.96:0/3679972051 conn(0x7ff9300f0d40 msgr2=0x7ff9300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:14.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 -- 172.21.15.96:0/3679972051 shutdown_connections 2022-02-02T19:13:14.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.637+0000 7ff93792c700 1 -- 172.21.15.96:0/3679972051 wait complete. 2022-02-02T19:13:14.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 Processor -- start 2022-02-02T19:13:14.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 -- start start 2022-02-02T19:13:14.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f6860 0x7ff9301063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301069e0 con 0x7ff9300f55c0 2022-02-02T19:13:14.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.638+0000 7ff93792c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930107290 con 0x7ff9300f6860 2022-02-02T19:13:14.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58482/0 (socket says 172.21.15.96:58482) 2022-02-02T19:13:14.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 -- 172.21.15.96:0/2094515955 learned_addr learned my addr 172.21.15.96:0/2094515955 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:14.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff934ec7700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f6860 0x7ff9301063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 -- 172.21.15.96:0/2094515955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f6860 msgr2=0x7ff9301063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f6860 0x7ff9301063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 -- 172.21.15.96:0/2094515955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924005040 con 0x7ff9300f55c0 2022-02-02T19:13:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff9356c8700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff92c0093f0 tx=0x7ff92c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff92c009ea0 con 0x7ff9300f55c0 2022-02-02T19:13:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff92c013af0 con 0x7ff9300f55c0 2022-02-02T19:13:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930107570 con 0x7ff9300f55c0 2022-02-02T19:13:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.639+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff92c00db10 con 0x7ff9300f55c0 2022-02-02T19:13:14.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.640+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930107b30 con 0x7ff9300f55c0 2022-02-02T19:13:14.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.640+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300f49b0 con 0x7ff9300f55c0 2022-02-02T19:13:14.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.641+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff92c01a060 con 0x7ff9300f55c0 2022-02-02T19:13:14.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.641+0000 7ff921ffb700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 0x7ff91c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.641+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff92c081a30 con 0x7ff9300f55c0 2022-02-02T19:13:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.641+0000 7ff934ec7700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 0x7ff91c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.642+0000 7ff934ec7700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 0x7ff91c067290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff924004e30 tx=0x7ff924009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:14.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.645+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff92c053510 con 0x7ff9300f55c0 2022-02-02T19:13:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.822+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9300fdee0 con 0x7ff91c064dd0 2022-02-02T19:13:14.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.823+0000 7ff921ffb700 1 -- 172.21.15.96:0/2094515955 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff9300fdee0 con 0x7ff91c064dd0 2022-02-02T19:13:14.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 msgr2=0x7ff91c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 0x7ff91c067290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff924004e30 tx=0x7ff924009b30).stop 2022-02-02T19:13:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 msgr2=0x7ff930105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff92c0093f0 tx=0x7ff92c006ec0).stop 2022-02-02T19:13:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 shutdown_connections 2022-02-02T19:13:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff91c064dd0 0x7ff91c067290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9300f55c0 0x7ff930105eb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 --2- 172.21.15.96:0/2094515955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9300f6860 0x7ff9301063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.825+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 >> 172.21.15.96:0/2094515955 conn(0x7ff9300f0d40 msgr2=0x7ff9300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.826+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 shutdown_connections 2022-02-02T19:13:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.826+0000 7ff93792c700 1 -- 172.21.15.96:0/2094515955 wait complete. 2022-02-02T19:13:14.839 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:13:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/2006824453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f55c0 msgr2=0x7fe0e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/2006824453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f55c0 0x7fe0e40f59e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fe0d4004660 tx=0x7fe0d4009b30).stop 2022-02-02T19:13:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/2006824453 shutdown_connections 2022-02-02T19:13:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/2006824453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f6860 0x7fe0e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:13:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/2006824453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f55c0 0x7fe0e40f59e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/2006824453 >> 172.21.15.96:0/2006824453 conn(0x7fe0e40f0d40 msgr2=0x7fe0e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:14.928 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:14 smithi096 ceph-mon[101353]: pgmap v1533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:14.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/2006824453 shutdown_connections 2022-02-02T19:13:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.923+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/2006824453 wait complete. 2022-02-02T19:13:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 Processor -- start 2022-02-02T19:13:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 -- start start 2022-02-02T19:13:14.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f55c0 0x7fe0e4106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4107ac0 con 0x7fe0e40f6860 2022-02-02T19:13:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0eb2ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4108370 con 0x7fe0e40f55c0 2022-02-02T19:13:14.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58494/0 (socket says 172.21.15.96:58494) 2022-02-02T19:13:14.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 -- 172.21.15.96:0/137130765 learned_addr learned my addr 172.21.15.96:0/137130765 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e904a700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f55c0 0x7fe0e4106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 -- 172.21.15.96:0/137130765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f55c0 msgr2=0x7fe0e4106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f55c0 0x7fe0e4106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:14.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 -- 172.21.15.96:0/137130765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4005040 con 0x7fe0e40f6860 2022-02-02T19:13:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0e8849700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fe0e000b410 tx=0x7fe0e0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.924+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e00125f0 con 0x7fe0e40f6860 2022-02-02T19:13:14.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.925+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0e000be30 con 0x7fe0e40f6860 2022-02-02T19:13:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.925+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0002a70 con 0x7fe0e40f6860 2022-02-02T19:13:14.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.925+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4108650 con 0x7fe0e40f6860 2022-02-02T19:13:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.925+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4108bc0 con 0x7fe0e40f6860 2022-02-02T19:13:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.926+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e40f49b0 con 0x7fe0e40f6860 2022-02-02T19:13:14.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.926+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0e000f030 con 0x7fe0e40f6860 2022-02-02T19:13:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.927+0000 7fe0d9ffb700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 0x7fe0d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.927+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe0e0081ed0 con 0x7fe0e40f6860 2022-02-02T19:13:14.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.927+0000 7fe0e904a700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 0x7fe0d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:14.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.927+0000 7fe0e904a700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 0x7fe0d0067290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe0d4004630 tx=0x7fe0d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:14.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:14.931+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0e00539b0 con 0x7fe0e40f6860 2022-02-02T19:13:15.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.102+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e40faca0 con 0x7fe0d0064dd0 2022-02-02T19:13:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.111+0000 7fe0d9ffb700 1 -- 172.21.15.96:0/137130765 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe0e40faca0 con 0x7fe0d0064dd0 2022-02-02T19:13:15.115 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:13:15.116 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (56m) 27m ago 57m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:13:15.116 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (49m) 27m ago 57m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:13:15.117 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (48m) 25m ago 57m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:13:15.117 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (56m) 27m ago 57m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:13:15.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (53m) 27m ago 53m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:13:15.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (49m) 27m ago 53m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:13:15.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (53m) 25m ago 53m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:13:15.122 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (49m) 25m ago 53m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:13:15.122 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (50m) 27m ago 58m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:13:15.122 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (50m) 25m ago 57m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:13:15.123 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (49m) 27m ago 58m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:13:15.126 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (49m) 25m ago 57m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:13:15.127 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (57m) 27m ago 57m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:13:15.127 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (56m) 25m ago 56m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:13:15.127 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (48m) 27m ago 56m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:13:15.128 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (48m) 27m ago 56m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:13:15.128 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (47m) 27m ago 55m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:13:15.129 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (47m) 25m ago 55m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:13:15.129 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (46m) 25m ago 55m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:13:15.130 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (46m) 25m ago 55m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:13:15.130 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (56m) 27m ago 57m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:13:15.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 msgr2=0x7fe0d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 0x7fe0d0067290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe0d4004630 tx=0x7fe0d4009b30).stop 2022-02-02T19:13:15.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 msgr2=0x7fe0e4107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fe0e000b410 tx=0x7fe0e0006ef0).stop 2022-02-02T19:13:15.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 shutdown_connections 2022-02-02T19:13:15.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0d0064dd0 0x7fe0d0067290 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0e40f55c0 0x7fe0e4106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 --2- 172.21.15.96:0/137130765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0e40f6860 0x7fe0e4107480 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 >> 172.21.15.96:0/137130765 conn(0x7fe0e40f0d40 msgr2=0x7fe0e405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 shutdown_connections 2022-02-02T19:13:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.113+0000 7fe0eb2ae700 1 -- 172.21.15.96:0/137130765 wait complete. 2022-02-02T19:13:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 -- 172.21.15.96:0/3297824063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 msgr2=0x7f81080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 --2- 172.21.15.96:0/3297824063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f81080f6b30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f8104004660 tx=0x7f8104009b30).stop 2022-02-02T19:13:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 -- 172.21.15.96:0/3297824063 shutdown_connections 2022-02-02T19:13:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 --2- 172.21.15.96:0/3297824063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f81080f6b30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 --2- 172.21.15.96:0/3297824063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 0x7f81080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:13:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 -- 172.21.15.96:0/3297824063 >> 172.21.15.96:0/3297824063 conn(0x7f81080f0b90 msgr2=0x7f81080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.209+0000 7f810f3d1700 1 -- 172.21.15.96:0/3297824063 shutdown_connections 2022-02-02T19:13:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.210+0000 7f810f3d1700 1 -- 172.21.15.96:0/3297824063 wait complete. 2022-02-02T19:13:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.210+0000 7f810f3d1700 1 Processor -- start 2022-02-02T19:13:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.210+0000 7f810f3d1700 1 -- start start 2022-02-02T19:13:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 0x7f8108109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080604b0 con 0x7f81080f66d0 2022-02-02T19:13:15.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080605f0 con 0x7f81080f5430 2022-02-02T19:13:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58502/0 (socket says 172.21.15.96:58502) 2022-02-02T19:13:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 -- 172.21.15.96:0/2907671414 learned_addr learned my addr 172.21.15.96:0/2907671414 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810e3cf700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 0x7f8108109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 -- 172.21.15.96:0/2907671414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 msgr2=0x7f8108109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 0x7f8108109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 -- 172.21.15.96:0/2907671414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104005040 con 0x7f81080f66d0 2022-02-02T19:13:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810dbce700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f8104009990 tx=0x7f8104009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8104018070 con 0x7f81080f66d0 2022-02-02T19:13:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810810c550 con 0x7f81080f66d0 2022-02-02T19:13:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8104007ca0 con 0x7f81080f66d0 2022-02-02T19:13:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810401c620 con 0x7f81080f66d0 2022-02-02T19:13:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.211+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810810cab0 con 0x7f81080f66d0 2022-02-02T19:13:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.213+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8108045ad0 con 0x7f81080f66d0 2022-02-02T19:13:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.213+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f810401d960 con 0x7f81080f66d0 2022-02-02T19:13:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.214+0000 7f80feffd700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.214+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8104083830 con 0x7f81080f66d0 2022-02-02T19:13:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.214+0000 7f810e3cf700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.214+0000 7f810e3cf700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f81080600a0 tx=0x7f80f8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.218+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81040519a0 con 0x7f81080f66d0 2022-02-02T19:13:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:14 smithi159 ceph-mon[69013]: pgmap v1533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:15.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.450+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8108027a00 con 0x7f81080f66d0 2022-02-02T19:13:15.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.450+0000 7f80feffd700 1 -- 172.21.15.96:0/2907671414 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8104054fc0 con 0x7f81080f66d0 2022-02-02T19:13:15.455 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:13:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:13:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:13:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:13:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:13:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:13:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:13:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:13:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:13:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:13:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:13:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:13:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:13:15.462 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:13:15.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 msgr2=0x7f80f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f81080600a0 tx=0x7f80f8008040).stop 2022-02-02T19:13:15.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 msgr2=0x7f810810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f8104009990 tx=0x7f8104009b30).stop 2022-02-02T19:13:15.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 shutdown_connections 2022-02-02T19:13:15.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81080f5430 0x7f8108109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 --2- 172.21.15.96:0/2907671414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81080f66d0 0x7f810810bf50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.452+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 >> 172.21.15.96:0/2907671414 conn(0x7f81080f0b90 msgr2=0x7f81080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:15.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.453+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 shutdown_connections 2022-02-02T19:13:15.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.453+0000 7f810f3d1700 1 -- 172.21.15.96:0/2907671414 wait complete. 2022-02-02T19:13:15.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 -- 172.21.15.96:0/575905126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 msgr2=0x7f402c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 --2- 172.21.15.96:0/575905126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c0f6cc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f401c004660 tx=0x7f401c009b30).stop 2022-02-02T19:13:15.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 -- 172.21.15.96:0/575905126 shutdown_connections 2022-02-02T19:13:15.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 --2- 172.21.15.96:0/575905126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c0f6cc0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 --2- 172.21.15.96:0/575905126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 0x7f402c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:13:15.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 -- 172.21.15.96:0/575905126 >> 172.21.15.96:0/575905126 conn(0x7f402c0f0d40 msgr2=0x7f402c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:15.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 -- 172.21.15.96:0/575905126 shutdown_connections 2022-02-02T19:13:15.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.550+0000 7f4030963700 1 -- 172.21.15.96:0/575905126 wait complete. 2022-02-02T19:13:15.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 Processor -- start 2022-02-02T19:13:15.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 -- start start 2022-02-02T19:13:15.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 0x7f402c105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1069e0 con 0x7f402c0f6860 2022-02-02T19:13:15.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4030963700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c107290 con 0x7f402c0f55c0 2022-02-02T19:13:15.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4029d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4029d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58512/0 (socket says 172.21.15.96:58512) 2022-02-02T19:13:15.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f4029d9b700 1 -- 172.21.15.96:0/3664738178 learned_addr learned my addr 172.21.15.96:0/3664738178 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:15.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.551+0000 7f402a59c700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 0x7f402c105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4029d9b700 1 -- 172.21.15.96:0/3664738178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 msgr2=0x7f402c105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4029d9b700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 0x7f402c105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4029d9b700 1 -- 172.21.15.96:0/3664738178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c005040 con 0x7f402c0f6860 2022-02-02T19:13:15.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4029d9b700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f401c009990 tx=0x7f401c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:15.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c018070 con 0x7f402c0f6860 2022-02-02T19:13:15.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f401c007ba0 con 0x7f402c0f6860 2022-02-02T19:13:15.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c107510 con 0x7f402c0f6860 2022-02-02T19:13:15.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c01c620 con 0x7f402c0f6860 2022-02-02T19:13:15.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.552+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c107a70 con 0x7f402c0f6860 2022-02-02T19:13:15.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.553+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0f49b0 con 0x7f402c0f6860 2022-02-02T19:13:15.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.553+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f401c01c890 con 0x7f402c0f6860 2022-02-02T19:13:15.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.554+0000 7f4022ffd700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 0x7f4018067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:15.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.554+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f401c0837e0 con 0x7f402c0f6860 2022-02-02T19:13:15.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.554+0000 7f402a59c700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 0x7f4018067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:15.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.554+0000 7f402a59c700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 0x7f4018067290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4014006fd0 tx=0x7f4014008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:15.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.558+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f401c055380 con 0x7f402c0f6860 2022-02-02T19:13:15.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.760+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f402c045ad0 con 0x7f402c0f6860 2022-02-02T19:13:15.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.760+0000 7f4022ffd700 1 -- 172.21.15.96:0/3664738178 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f401c054f70 con 0x7f402c0f6860 2022-02-02T19:13:15.765 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:13:15.765 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:13:15.766 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:13:15.766 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:13:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:15.767 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:13:15.767 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:13:15.767 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:13:15.768 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:13:15.768 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:13:15.768 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:13:15.769 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:13:15.769 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:13:15.769 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:13:15.771 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:13:15.771 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:13:15.771 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:13:15.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:13:15.772 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:13:15.772 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:13:15.772 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:13:15.772 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:13:15.773 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:13:15.773 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:13:15.773 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:13:15.773 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:13:15.773 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:13:15.774 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:13:15.774 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:13:15.774 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:13:15.774 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:13:15.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:13:15.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:15.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:15.775 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:13:15.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:15.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:15.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:15.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 msgr2=0x7f4018067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 0x7f4018067290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f4014006fd0 tx=0x7f4014008040).stop 2022-02-02T19:13:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 msgr2=0x7f402c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f401c009990 tx=0x7f401c009b30).stop 2022-02-02T19:13:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 shutdown_connections 2022-02-02T19:13:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4018064dd0 0x7f4018067290 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c0f55c0 0x7f402c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 --2- 172.21.15.96:0/3664738178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f402c0f6860 0x7f402c1063a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 >> 172.21.15.96:0/3664738178 conn(0x7f402c0f0d40 msgr2=0x7f402c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 shutdown_connections 2022-02-02T19:13:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:15.762+0000 7f4030963700 1 -- 172.21.15.96:0/3664738178 wait complete. 2022-02-02T19:13:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:13:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:15 smithi159 ceph-mon[69013]: from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:16.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2907671414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:13:16.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3664738178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:13:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:15 smithi096 ceph-mon[101353]: from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2907671414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:13:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3664738178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:13:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:16 smithi159 ceph-mon[69013]: from='client.35694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:16 smithi159 ceph-mon[69013]: pgmap v1534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:17.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:16 smithi096 ceph-mon[101353]: from='client.35694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:16 smithi096 ceph-mon[101353]: pgmap v1534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:18 smithi159 ceph-mon[69013]: pgmap v1535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:19.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:18 smithi096 ceph-mon[101353]: pgmap v1535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:20 smithi159 ceph-mon[69013]: pgmap v1536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:20 smithi096 ceph-mon[101353]: pgmap v1536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:23.246 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:22 smithi096 ceph-mon[101353]: pgmap v1537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:22 smithi159 ceph-mon[69013]: pgmap v1537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:24 smithi159 ceph-mon[69013]: pgmap v1538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:24 smithi096 ceph-mon[101353]: pgmap v1538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:27.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:26 smithi159 ceph-mon[69013]: pgmap v1539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:27.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:26 smithi096 ceph-mon[101353]: pgmap v1539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:13:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:13:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:13:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:13:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:28 smithi159 ceph-mon[69013]: pgmap v1540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:29.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:28 smithi096 ceph-mon[101353]: pgmap v1540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:31.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:30 smithi159 ceph-mon[69013]: pgmap v1541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:30 smithi096 ceph-mon[101353]: pgmap v1541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:33.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:32 smithi096 ceph-mon[101353]: pgmap v1542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:33.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:32 smithi159 ceph-mon[69013]: pgmap v1542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:34 smithi159 ceph-mon[69013]: pgmap v1543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:34 smithi096 ceph-mon[101353]: pgmap v1543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:37.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:36 smithi159 ceph-mon[69013]: pgmap v1544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:36 smithi096 ceph-mon[101353]: pgmap v1544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:38 smithi159 ceph-mon[69013]: pgmap v1545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:39.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:38 smithi096 ceph-mon[101353]: pgmap v1545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:40 smithi159 ceph-mon[69013]: pgmap v1546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:40 smithi096 ceph-mon[101353]: pgmap v1546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:43.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:42 smithi096 ceph-mon[101353]: pgmap v1547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:42 smithi159 ceph-mon[69013]: pgmap v1547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:44 smithi159 ceph-mon[69013]: pgmap v1548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:44 smithi096 ceph-mon[101353]: pgmap v1548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:45.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 -- 172.21.15.96:0/3732362779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f7980 msgr2=0x7f4ed80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:45.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 --2- 172.21.15.96:0/3732362779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f7980 0x7f4ed80f7de0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f4ed4004660 tx=0x7f4ed4009b30).stop 2022-02-02T19:13:45.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 -- 172.21.15.96:0/3732362779 shutdown_connections 2022-02-02T19:13:45.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 --2- 172.21.15.96:0/3732362779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f7980 0x7f4ed80f7de0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:45.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 --2- 172.21.15.96:0/3732362779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f66e0 0x7f4ed80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:45.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 -- 172.21.15.96:0/3732362779 >> 172.21.15.96:0/3732362779 conn(0x7f4ed80f1e40 msgr2=0x7f4ed80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:45.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 -- 172.21.15.96:0/3732362779 shutdown_connections 2022-02-02T19:13:45.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.872+0000 7f4edf699700 1 -- 172.21.15.96:0/3732362779 wait complete. 2022-02-02T19:13:45.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 Processor -- start 2022-02-02T19:13:45.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 -- start start 2022-02-02T19:13:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f7980 0x7f4ed8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8107a00 con 0x7f4ed80f66e0 2022-02-02T19:13:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edf699700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8107b40 con 0x7f4ed80f7980 2022-02-02T19:13:45.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edd435700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:45.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edd435700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58534/0 (socket says 172.21.15.96:58534) 2022-02-02T19:13:45.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edd435700 1 -- 172.21.15.96:0/4049740441 learned_addr learned my addr 172.21.15.96:0/4049740441 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:45.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.873+0000 7f4edcc34700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f7980 0x7f4ed8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edd435700 1 -- 172.21.15.96:0/4049740441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f7980 msgr2=0x7f4ed8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edd435700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f7980 0x7f4ed8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edd435700 1 -- 172.21.15.96:0/4049740441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4005040 con 0x7f4ed80f66e0 2022-02-02T19:13:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edd435700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f4ecc002700 tx=0x7f4ecc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ecc0079c0 con 0x7f4ed80f66e0 2022-02-02T19:13:45.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ecc00f040 con 0x7f4ed80f66e0 2022-02-02T19:13:45.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed81084e0 con 0x7f4ed80f66e0 2022-02-02T19:13:45.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ecc014860 con 0x7f4ed80f66e0 2022-02-02T19:13:45.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.874+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8108aa0 con 0x7f4ed80f66e0 2022-02-02T19:13:45.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.875+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed8045ad0 con 0x7f4ed80f66e0 2022-02-02T19:13:45.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.876+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ecc01b060 con 0x7f4ed80f66e0 2022-02-02T19:13:45.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.876+0000 7f4ec9ffb700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 0x7f4ec4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:45.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.876+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ecc081930 con 0x7f4ed80f66e0 2022-02-02T19:13:45.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.876+0000 7f4edcc34700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 0x7f4ec4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:45.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.877+0000 7f4edcc34700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 0x7f4ec4067290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f4ed4004630 tx=0x7f4ed4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:45.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:45.880+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ecc053410 con 0x7f4ed80f66e0 2022-02-02T19:13:46.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.060+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ed8108d20 con 0x7f4ec4064dd0 2022-02-02T19:13:46.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.061+0000 7f4ec9ffb700 1 -- 172.21.15.96:0/4049740441 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4ed8108d20 con 0x7f4ec4064dd0 2022-02-02T19:13:46.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 msgr2=0x7f4ec4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 0x7f4ec4067290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f4ed4004630 tx=0x7f4ed4009b30).stop 2022-02-02T19:13:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 msgr2=0x7f4ed8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f4ecc002700 tx=0x7f4ecc009d80).stop 2022-02-02T19:13:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 shutdown_connections 2022-02-02T19:13:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ec4064dd0 0x7f4ec4067290 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed80f66e0 0x7f4ed8106f60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 --2- 172.21.15.96:0/4049740441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ed80f7980 0x7f4ed8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 >> 172.21.15.96:0/4049740441 conn(0x7f4ed80f1e40 msgr2=0x7f4ed80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.063+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 shutdown_connections 2022-02-02T19:13:46.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.064+0000 7f4edf699700 1 -- 172.21.15.96:0/4049740441 wait complete. 2022-02-02T19:13:46.077 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:13:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 -- 172.21.15.96:0/1704625662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 msgr2=0x7fa4780f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 --2- 172.21.15.96:0/1704625662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa4780f5850 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa46c004660 tx=0x7fa46c009b30).stop 2022-02-02T19:13:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 -- 172.21.15.96:0/1704625662 shutdown_connections 2022-02-02T19:13:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 --2- 172.21.15.96:0/1704625662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 0x7fa4780f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 --2- 172.21.15.96:0/1704625662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa4780f5850 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 -- 172.21.15.96:0/1704625662 >> 172.21.15.96:0/1704625662 conn(0x7fa4780f0b90 msgr2=0x7fa4780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 -- 172.21.15.96:0/1704625662 shutdown_connections 2022-02-02T19:13:46.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.160+0000 7fa47de52700 1 -- 172.21.15.96:0/1704625662 wait complete. 2022-02-02T19:13:46.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 Processor -- start 2022-02-02T19:13:46.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 -- start start 2022-02-02T19:13:46.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 0x7fa478108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478109a40 con 0x7fa4780f66d0 2022-02-02T19:13:46.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa47de52700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478109b80 con 0x7fa4780f5430 2022-02-02T19:13:46.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa477fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.161+0000 7fa477fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58546/0 (socket says 172.21.15.96:58546) 2022-02-02T19:13:46.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa477fff700 1 -- 172.21.15.96:0/2723427070 learned_addr learned my addr 172.21.15.96:0/2723427070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:46.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa47ce50700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 0x7fa478108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa477fff700 1 -- 172.21.15.96:0/2723427070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 msgr2=0x7fa478108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa477fff700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 0x7fa478108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa477fff700 1 -- 172.21.15.96:0/2723427070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c005040 con 0x7fa4780f66d0 2022-02-02T19:13:46.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa477fff700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fa4640026d0 tx=0x7fa464009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa464009320 con 0x7fa4780f66d0 2022-02-02T19:13:46.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47810a520 con 0x7fa4780f66d0 2022-02-02T19:13:46.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47810aae0 con 0x7fa4780f66d0 2022-02-02T19:13:46.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa46400f040 con 0x7fa4780f66d0 2022-02-02T19:13:46.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.162+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4640145e0 con 0x7fa4780f66d0 2022-02-02T19:13:46.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.163+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa458004fa0 con 0x7fa4780f66d0 2022-02-02T19:13:46.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.164+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa464009480 con 0x7fa4780f66d0 2022-02-02T19:13:46.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.165+0000 7fa4757fa700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 0x7fa4680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.165+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa464082140 con 0x7fa4780f66d0 2022-02-02T19:13:46.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.165+0000 7fa47ce50700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 0x7fa4680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.165+0000 7fa47ce50700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 0x7fa4680672e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa46c009da0 tx=0x7fa46c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.169+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa464053be0 con 0x7fa4780f66d0 2022-02-02T19:13:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.341+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa458000bc0 con 0x7fa468064e20 2022-02-02T19:13:46.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.350+0000 7fa4757fa700 1 -- 172.21.15.96:0/2723427070 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa458000bc0 con 0x7fa468064e20 2022-02-02T19:13:46.355 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:13:46.355 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (57m) 27m ago 58m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:13:46.355 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (49m) 27m ago 58m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:13:46.355 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (49m) 26m ago 57m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:13:46.356 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (56m) 27m ago 58m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:13:46.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (54m) 27m ago 54m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:13:46.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (49m) 27m ago 54m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:13:46.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (54m) 26m ago 54m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:13:46.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (50m) 26m ago 54m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:13:46.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (51m) 27m ago 59m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:13:46.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (50m) 26m ago 57m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:13:46.357 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (50m) 27m ago 59m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:13:46.359 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (50m) 26m ago 57m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:13:46.360 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (57m) 27m ago 57m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:13:46.360 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (57m) 26m ago 57m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:13:46.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (49m) 27m ago 57m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:13:46.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (48m) 27m ago 56m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:13:46.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (48m) 27m ago 56m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:13:46.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (47m) 26m ago 56m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:13:46.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (47m) 26m ago 55m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:13:46.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (46m) 26m ago 55m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:13:46.362 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (56m) 27m ago 57m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:13:46.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 msgr2=0x7fa4680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 0x7fa4680672e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa46c009da0 tx=0x7fa46c009b30).stop 2022-02-02T19:13:46.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 msgr2=0x7fa478109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fa4640026d0 tx=0x7fa464009de0).stop 2022-02-02T19:13:46.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 shutdown_connections 2022-02-02T19:13:46.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa468064e20 0x7fa4680672e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 0x7fa478108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 --2- 172.21.15.96:0/2723427070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa478109490 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 >> 172.21.15.96:0/2723427070 conn(0x7fa4780f0b90 msgr2=0x7fa47805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 shutdown_connections 2022-02-02T19:13:46.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.352+0000 7fa47de52700 1 -- 172.21.15.96:0/2723427070 wait complete. 2022-02-02T19:13:46.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 -- 172.21.15.96:0/198718941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f66e0 msgr2=0x7f40d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/198718941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f66e0 0x7f40d00f6b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f40c0004660 tx=0x7f40c0009b30).stop 2022-02-02T19:13:46.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 -- 172.21.15.96:0/198718941 shutdown_connections 2022-02-02T19:13:46.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/198718941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f7980 0x7f40d00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/198718941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f66e0 0x7f40d00f6b00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 -- 172.21.15.96:0/198718941 >> 172.21.15.96:0/198718941 conn(0x7f40d00f1e40 msgr2=0x7f40d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 -- 172.21.15.96:0/198718941 shutdown_connections 2022-02-02T19:13:46.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.449+0000 7f40d4e2c700 1 -- 172.21.15.96:0/198718941 wait complete. 2022-02-02T19:13:46.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 Processor -- start 2022-02-02T19:13:46.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 -- start start 2022-02-02T19:13:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f66e0 0x7f40d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006a380 con 0x7f40d00f7980 2022-02-02T19:13:46.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40d4e2c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006a4c0 con 0x7f40d00f66e0 2022-02-02T19:13:46.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58556/0 (socket says 172.21.15.96:58556) 2022-02-02T19:13:46.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.450+0000 7f40cdd9b700 1 -- 172.21.15.96:0/4143247909 learned_addr learned my addr 172.21.15.96:0/4143247909 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:46.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40ce59c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f66e0 0x7f40d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40cdd9b700 1 -- 172.21.15.96:0/4143247909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f66e0 msgr2=0x7f40d006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40cdd9b700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f66e0 0x7f40d006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40cdd9b700 1 -- 172.21.15.96:0/4143247909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0005040 con 0x7f40d00f7980 2022-02-02T19:13:46.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40cdd9b700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f40c400c530 tx=0x7f40c4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c400f650 con 0x7f40d00f7980 2022-02-02T19:13:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d006a7a0 con 0x7f40d00f7980 2022-02-02T19:13:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40c400fc60 con 0x7f40d00f7980 2022-02-02T19:13:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c4012cd0 con 0x7f40d00f7980 2022-02-02T19:13:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.451+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d010efe0 con 0x7f40d00f7980 2022-02-02T19:13:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.452+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d0045ad0 con 0x7f40d00f7980 2022-02-02T19:13:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.453+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40c4010070 con 0x7f40d00f7980 2022-02-02T19:13:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.453+0000 7f40beffd700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.453+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f40c4081800 con 0x7f40d00f7980 2022-02-02T19:13:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.453+0000 7f40ce59c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.454+0000 7f40ce59c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f40c0004e30 tx=0x7f40c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.457+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40c404f8b0 con 0x7f40d00f7980 2022-02-02T19:13:46.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.691+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40d0027a00 con 0x7f40d00f7980 2022-02-02T19:13:46.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.691+0000 7f40beffd700 1 -- 172.21.15.96:0/4143247909 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f40c4052ed0 con 0x7f40d00f7980 2022-02-02T19:13:46.696 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:13:46.696 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:13:46.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:13:46.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:13:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:13:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:13:46.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:13:46.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:46.698 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:13:46.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:13:46.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:13:46.699 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:13:46.699 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:13:46.699 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:13:46.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:13:46.700 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:13:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.693+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 msgr2=0x7f40b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.693+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f40c0004e30 tx=0x7f40c0009b30).stop 2022-02-02T19:13:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.693+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 msgr2=0x7f40d0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.693+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f40c400c530 tx=0x7f40c4007e20).stop 2022-02-02T19:13:46.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 shutdown_connections 2022-02-02T19:13:46.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d00f66e0 0x7f40d006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 --2- 172.21.15.96:0/4143247909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d00f7980 0x7f40d0069e20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 >> 172.21.15.96:0/4143247909 conn(0x7f40d00f1e40 msgr2=0x7f40d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 shutdown_connections 2022-02-02T19:13:46.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.694+0000 7f40d4e2c700 1 -- 172.21.15.96:0/4143247909 wait complete. 2022-02-02T19:13:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 -- 172.21.15.96:0/1841978352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 msgr2=0x7f21b40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 --2- 172.21.15.96:0/1841978352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b40f6b00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f21a4004660 tx=0x7f21a4009b30).stop 2022-02-02T19:13:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 -- 172.21.15.96:0/1841978352 shutdown_connections 2022-02-02T19:13:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 --2- 172.21.15.96:0/1841978352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 --2- 172.21.15.96:0/1841978352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b40f6b00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 -- 172.21.15.96:0/1841978352 >> 172.21.15.96:0/1841978352 conn(0x7f21b40f1e40 msgr2=0x7f21b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:46.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 -- 172.21.15.96:0/1841978352 shutdown_connections 2022-02-02T19:13:46.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.792+0000 7f21b883a700 1 -- 172.21.15.96:0/1841978352 wait complete. 2022-02-02T19:13:46.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 Processor -- start 2022-02-02T19:13:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 -- start start 2022-02-02T19:13:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b406a380 con 0x7f21b40f66e0 2022-02-02T19:13:46.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b883a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b406a4c0 con 0x7f21b40f7980 2022-02-02T19:13:46.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58564/0 (socket says 172.21.15.96:58564) 2022-02-02T19:13:46.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 -- 172.21.15.96:0/1777209760 learned_addr learned my addr 172.21.15.96:0/1777209760 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:13:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b1d9b700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 -- 172.21.15.96:0/1777209760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 msgr2=0x7f21b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 -- 172.21.15.96:0/1777209760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4005040 con 0x7f21b40f66e0 2022-02-02T19:13:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b1d9b700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:13:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.793+0000 7f21b259c700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f21a4004f60 tx=0x7f21a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.794+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a4018070 con 0x7f21b40f66e0 2022-02-02T19:13:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.794+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21a4007ba0 con 0x7f21b40f66e0 2022-02-02T19:13:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.794+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b406a740 con 0x7f21b40f66e0 2022-02-02T19:13:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.794+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a401c620 con 0x7f21b40f66e0 2022-02-02T19:13:46.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.794+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b406aca0 con 0x7f21b40f66e0 2022-02-02T19:13:46.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.795+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21a401c8e0 con 0x7f21b40f66e0 2022-02-02T19:13:46.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.795+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b4045ad0 con 0x7f21b40f66e0 2022-02-02T19:13:46.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.796+0000 7f21aaffd700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 0x7f21a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:13:46.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.796+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f21a40839b0 con 0x7f21b40f66e0 2022-02-02T19:13:46.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.796+0000 7f21b1d9b700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 0x7f21a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:13:46.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.796+0000 7f21b1d9b700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 0x7f21a0067290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f219c0041d0 tx=0x7f219c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:13:46.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:46.800+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21a4051a60 con 0x7f21b40f66e0 2022-02-02T19:13:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.004+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21b40586e0 con 0x7f21b40f66e0 2022-02-02T19:13:47.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:46 smithi096 ceph-mon[101353]: pgmap v1549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:47.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4143247909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:13:47.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.004+0000 7f21aaffd700 1 -- 172.21.15.96:0/1777209760 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f21a4055080 con 0x7f21b40f66e0 2022-02-02T19:13:47.011 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:13:47.012 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:13:47.012 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:13:47.012 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:13:47.012 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:47.013 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:13:47.013 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:13:47.013 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:13:47.013 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:13:47.014 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:13:47.014 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:13:47.014 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:13:47.014 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:13:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:13:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:13:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:13:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:13:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:13:47.016 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:13:47.016 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:13:47.016 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:13:47.016 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:13:47.017 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:13:47.017 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:13:47.017 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:13:47.017 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:13:47.017 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:13:47.018 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:13:47.018 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:13:47.018 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:13:47.018 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:13:47.019 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:13:47.019 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:47.019 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:47.019 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:13:47.019 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:13:47.020 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:47.020 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:47.020 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:13:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 msgr2=0x7f21a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:47.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 0x7f21a0067290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f219c0041d0 tx=0x7f219c009040).stop 2022-02-02T19:13:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 msgr2=0x7f21b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:13:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f21a4004f60 tx=0x7f21a4009b30).stop 2022-02-02T19:13:47.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 shutdown_connections 2022-02-02T19:13:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21a0064dd0 0x7f21a0067290 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21b40f66e0 0x7f21b406b9a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 --2- 172.21.15.96:0/1777209760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21b40f7980 0x7f21b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:13:47.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 >> 172.21.15.96:0/1777209760 conn(0x7f21b40f1e40 msgr2=0x7f21b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:13:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 shutdown_connections 2022-02-02T19:13:47.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:13:47.006+0000 7f21b883a700 1 -- 172.21.15.96:0/1777209760 wait complete. 2022-02-02T19:13:47.025 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:13:47.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:46 smithi159 ceph-mon[69013]: pgmap v1549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:47.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4143247909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:13:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:47 smithi159 ceph-mon[69013]: from='client.35706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:48.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:47 smithi159 ceph-mon[69013]: from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:48.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1777209760' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:13:48.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:47 smithi096 ceph-mon[101353]: from='client.35706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:47 smithi096 ceph-mon[101353]: from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:13:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1777209760' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:13:49.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:48 smithi159 ceph-mon[69013]: pgmap v1550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:49.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:48 smithi096 ceph-mon[101353]: pgmap v1550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:50 smithi159 ceph-mon[69013]: pgmap v1551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:51.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:50 smithi096 ceph-mon[101353]: pgmap v1551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:53.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:52 smithi096 ceph-mon[101353]: pgmap v1552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:53.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:52 smithi159 ceph-mon[69013]: pgmap v1552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:55.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:54 smithi159 ceph-mon[69013]: pgmap v1553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:54 smithi096 ceph-mon[101353]: pgmap v1553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:57.034 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:56 smithi159 ceph-mon[69013]: pgmap v1554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:57.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:56 smithi096 ceph-mon[101353]: pgmap v1554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:59.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:13:58 smithi159 ceph-mon[69013]: pgmap v1555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:13:59.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:13:58 smithi096 ceph-mon[101353]: pgmap v1555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:00 smithi159 ceph-mon[69013]: pgmap v1556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:01.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:00 smithi096 ceph-mon[101353]: pgmap v1556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:03.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:02 smithi096 ceph-mon[101353]: pgmap v1557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:03.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:02 smithi159 ceph-mon[69013]: pgmap v1557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:04 smithi159 ceph-mon[69013]: pgmap v1558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:04 smithi096 ceph-mon[101353]: pgmap v1558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:07.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:06 smithi159 ceph-mon[69013]: pgmap v1559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:07.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:06 smithi096 ceph-mon[101353]: pgmap v1559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:08 smithi159 ceph-mon[69013]: pgmap v1560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:09.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:08 smithi096 ceph-mon[101353]: pgmap v1560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:10 smithi159 ceph-mon[69013]: pgmap v1561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:10 smithi096 ceph-mon[101353]: pgmap v1561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:12 smithi096 ceph-mon[101353]: pgmap v1562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:13.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:12 smithi159 ceph-mon[69013]: pgmap v1562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:14 smithi159 ceph-mon[69013]: pgmap v1563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:14 smithi096 ceph-mon[101353]: pgmap v1563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:16 smithi159 ceph-mon[69013]: pgmap v1564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:17.121 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:16 smithi096 ceph-mon[101353]: pgmap v1564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 -- 172.21.15.96:0/3054236870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 msgr2=0x7f69600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 --2- 172.21.15.96:0/3054236870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f69600f6b00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f6950004660 tx=0x7f6950009b30).stop 2022-02-02T19:14:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 -- 172.21.15.96:0/3054236870 shutdown_connections 2022-02-02T19:14:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 --2- 172.21.15.96:0/3054236870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 0x7f69600f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:14:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 --2- 172.21.15.96:0/3054236870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f69600f6b00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 -- 172.21.15.96:0/3054236870 >> 172.21.15.96:0/3054236870 conn(0x7f69600f1e40 msgr2=0x7f69600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 -- 172.21.15.96:0/3054236870 shutdown_connections 2022-02-02T19:14:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.117+0000 7f696782b700 1 -- 172.21.15.96:0/3054236870 wait complete. 2022-02-02T19:14:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 Processor -- start 2022-02-02T19:14:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 -- start start 2022-02-02T19:14:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 0x7f69601074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960107b00 con 0x7f69600f66e0 2022-02-02T19:14:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f696782b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69601083b0 con 0x7f69600f7980 2022-02-02T19:14:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f69655c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f69655c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58584/0 (socket says 172.21.15.96:58584) 2022-02-02T19:14:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f69655c7700 1 -- 172.21.15.96:0/1894552991 learned_addr learned my addr 172.21.15.96:0/1894552991 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.118+0000 7f6964dc6700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 0x7f69601074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f69655c7700 1 -- 172.21.15.96:0/1894552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 msgr2=0x7f69601074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f69655c7700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 0x7f69601074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f69655c7700 1 -- 172.21.15.96:0/1894552991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950005040 con 0x7f69600f66e0 2022-02-02T19:14:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f69655c7700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f6950004f60 tx=0x7f6950009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6950018070 con 0x7f69600f66e0 2022-02-02T19:14:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6950009770 con 0x7f69600f66e0 2022-02-02T19:14:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6960108630 con 0x7f69600f66e0 2022-02-02T19:14:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695001c3c0 con 0x7f69600f66e0 2022-02-02T19:14:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.119+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6960108b90 con 0x7f69600f66e0 2022-02-02T19:14:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.120+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69600f5ad0 con 0x7f69600f66e0 2022-02-02T19:14:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.121+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f695001d420 con 0x7f69600f66e0 2022-02-02T19:14:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.121+0000 7f6955ffb700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 0x7f694c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.121+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6950083950 con 0x7f69600f66e0 2022-02-02T19:14:17.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.121+0000 7f6964dc6700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 0x7f694c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.122+0000 7f6964dc6700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 0x7f694c067290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f695c006fd0 tx=0x7f695c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.126+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6950055470 con 0x7f69600f66e0 2022-02-02T19:14:17.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.306+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69600fef20 con 0x7f694c064dd0 2022-02-02T19:14:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.308+0000 7f6955ffb700 1 -- 172.21.15.96:0/1894552991 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f69600fef20 con 0x7f694c064dd0 2022-02-02T19:14:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 msgr2=0x7f694c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 0x7f694c067290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f695c006fd0 tx=0x7f695c008040).stop 2022-02-02T19:14:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 msgr2=0x7f6960106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f6950004f60 tx=0x7f6950009b30).stop 2022-02-02T19:14:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 shutdown_connections 2022-02-02T19:14:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f694c064dd0 0x7f694c067290 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69600f66e0 0x7f6960106fd0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 --2- 172.21.15.96:0/1894552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69600f7980 0x7f69601074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 >> 172.21.15.96:0/1894552991 conn(0x7f69600f1e40 msgr2=0x7f69600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 shutdown_connections 2022-02-02T19:14:17.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.310+0000 7f696782b700 1 -- 172.21.15.96:0/1894552991 wait complete. 2022-02-02T19:14:17.323 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:14:17.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.407+0000 7f6b31229700 1 -- 172.21.15.96:0/3998319134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f6530 msgr2=0x7f6b2c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.407+0000 7f6b31229700 1 --2- 172.21.15.96:0/3998319134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c0f6950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f6b1c004660 tx=0x7f6b1c009b30).stop 2022-02-02T19:14:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 -- 172.21.15.96:0/3998319134 shutdown_connections 2022-02-02T19:14:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 --2- 172.21.15.96:0/3998319134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 --2- 172.21.15.96:0/3998319134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c0f6950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 -- 172.21.15.96:0/3998319134 >> 172.21.15.96:0/3998319134 conn(0x7f6b2c0f1c90 msgr2=0x7f6b2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 -- 172.21.15.96:0/3998319134 shutdown_connections 2022-02-02T19:14:17.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 -- 172.21.15.96:0/3998319134 wait complete. 2022-02-02T19:14:17.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.408+0000 7f6b31229700 1 Processor -- start 2022-02-02T19:14:17.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b31229700 1 -- start start 2022-02-02T19:14:17.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b31229700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b31229700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b31229700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c06a380 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b31229700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c06a4c0 con 0x7f6b2c0f6530 2022-02-02T19:14:17.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58596/0 (socket says 172.21.15.96:58596) 2022-02-02T19:14:17.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 -- 172.21.15.96:0/2470801054 learned_addr learned my addr 172.21.15.96:0/2470801054 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:17.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2bfff700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 -- 172.21.15.96:0/2470801054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f6530 msgr2=0x7f6b2c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.409+0000 7f6b2b7fe700 1 -- 172.21.15.96:0/2470801054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c005040 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b2b7fe700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f6b200026d0 tx=0x7f6b20009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b200079c0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c06a7a0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b2000f040 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b200148b0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.410+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c10edc0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.411+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c045ad0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.411+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b20014a10 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.411+0000 7f6b28ff9700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 0x7f6b140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.412+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6b20081a10 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.412+0000 7f6b2bfff700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 0x7f6b140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.412+0000 7f6b2bfff700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 0x7f6b140672e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6b2c06b730 tx=0x7f6b1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.416+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b2004fba0 con 0x7f6b2c0f77d0 2022-02-02T19:14:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.590+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b2c0fee00 con 0x7f6b14064e20 2022-02-02T19:14:17.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.599+0000 7f6b28ff9700 1 -- 172.21.15.96:0/2470801054 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6b2c0fee00 con 0x7f6b14064e20 2022-02-02T19:14:17.603 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:14:17.603 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (57m) 28m ago 58m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:14:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (50m) 28m ago 58m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:14:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (50m) 26m ago 58m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:14:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (57m) 28m ago 58m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:14:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (54m) 28m ago 54m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:14:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (50m) 28m ago 54m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:14:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (54m) 26m ago 54m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:14:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (50m) 26m ago 54m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:14:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (51m) 28m ago 59m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:14:17.605 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (51m) 26m ago 58m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:14:17.606 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (50m) 28m ago 59m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:14:17.606 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (50m) 26m ago 58m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:14:17.606 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (58m) 28m ago 58m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:14:17.606 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (57m) 26m ago 57m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:14:17.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (49m) 28m ago 57m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:14:17.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (49m) 28m ago 57m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:14:17.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (48m) 28m ago 56m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:14:17.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (48m) 26m ago 56m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:14:17.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (47m) 26m ago 56m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:14:17.608 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (47m) 26m ago 56m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:14:17.608 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (57m) 28m ago 58m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:14:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 msgr2=0x7f6b140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 0x7f6b140672e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6b2c06b730 tx=0x7f6b1c009b30).stop 2022-02-02T19:14:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 msgr2=0x7f6b2c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f6b200026d0 tx=0x7f6b20009de0).stop 2022-02-02T19:14:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 shutdown_connections 2022-02-02T19:14:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b14064e20 0x7f6b140672e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b2c0f6530 0x7f6b2c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 --2- 172.21.15.96:0/2470801054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b2c0f77d0 0x7f6b2c069e20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 >> 172.21.15.96:0/2470801054 conn(0x7f6b2c0f1c90 msgr2=0x7f6b2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 shutdown_connections 2022-02-02T19:14:17.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.601+0000 7f6b31229700 1 -- 172.21.15.96:0/2470801054 wait complete. 2022-02-02T19:14:17.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 -- 172.21.15.96:0/3234022268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 msgr2=0x7f2aa40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 --2- 172.21.15.96:0/3234022268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa40f6cc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f2a94004660 tx=0x7f2a94009b30).stop 2022-02-02T19:14:17.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 -- 172.21.15.96:0/3234022268 shutdown_connections 2022-02-02T19:14:17.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 --2- 172.21.15.96:0/3234022268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa40f6cc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 --2- 172.21.15.96:0/3234022268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 0x7f2aa40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 -- 172.21.15.96:0/3234022268 >> 172.21.15.96:0/3234022268 conn(0x7f2aa40f0d40 msgr2=0x7f2aa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 -- 172.21.15.96:0/3234022268 shutdown_connections 2022-02-02T19:14:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.698+0000 7f2aa9206700 1 -- 172.21.15.96:0/3234022268 wait complete. 2022-02-02T19:14:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 Processor -- start 2022-02-02T19:14:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 -- start start 2022-02-02T19:14:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 0x7f2aa4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4060420 con 0x7f2aa40f6860 2022-02-02T19:14:17.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa9206700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4060560 con 0x7f2aa40f55c0 2022-02-02T19:14:17.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58606/0 (socket says 172.21.15.96:58606) 2022-02-02T19:14:17.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa259c700 1 -- 172.21.15.96:0/519688626 learned_addr learned my addr 172.21.15.96:0/519688626 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:17.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.699+0000 7f2aa2d9d700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 0x7f2aa4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2aa259c700 1 -- 172.21.15.96:0/519688626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 msgr2=0x7f2aa4109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2aa259c700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 0x7f2aa4109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2aa259c700 1 -- 172.21.15.96:0/519688626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94005040 con 0x7f2aa40f6860 2022-02-02T19:14:17.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2aa259c700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2a94009990 tx=0x7f2a94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a94018070 con 0x7f2aa40f6860 2022-02-02T19:14:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a94007ba0 con 0x7f2aa40f6860 2022-02-02T19:14:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa410c6c0 con 0x7f2aa40f6860 2022-02-02T19:14:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.700+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a9401c3c0 con 0x7f2aa40f6860 2022-02-02T19:14:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.701+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa410cbf0 con 0x7f2aa40f6860 2022-02-02T19:14:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.701+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40f49b0 con 0x7f2aa40f6860 2022-02-02T19:14:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.702+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a9401d420 con 0x7f2aa40f6860 2022-02-02T19:14:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.702+0000 7f2a8b7fe700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 0x7f2a8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.702+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2a94082d80 con 0x7f2aa40f6860 2022-02-02T19:14:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.702+0000 7f2aa2d9d700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 0x7f2a8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.702+0000 7f2aa2d9d700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 0x7f2a8c067290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f2aa40600a0 tx=0x7f2a9800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.706+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a94050d40 con 0x7f2aa40f6860 2022-02-02T19:14:17.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.939+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2aa4045ad0 con 0x7f2aa40f6860 2022-02-02T19:14:17.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.940+0000 7f2a8b7fe700 1 -- 172.21.15.96:0/519688626 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2a94054360 con 0x7f2aa40f6860 2022-02-02T19:14:17.944 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:14:17.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:14:17.945 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:14:17.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:17.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:14:17.946 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:14:17.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:17.946 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:14:17.946 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:14:17.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:17.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:14:17.947 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:14:17.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:17.947 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:14:17.948 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:14:17.948 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:14:17.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:14:17.948 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:14:17.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 msgr2=0x7f2a8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 0x7f2a8c067290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f2aa40600a0 tx=0x7f2a9800b040).stop 2022-02-02T19:14:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 msgr2=0x7f2aa410c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2a94009990 tx=0x7f2a94009b30).stop 2022-02-02T19:14:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 shutdown_connections 2022-02-02T19:14:17.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a8c064dd0 0x7f2a8c067290 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa40f55c0 0x7f2aa4109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 --2- 172.21.15.96:0/519688626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aa40f6860 0x7f2aa410c110 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:17.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.941+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 >> 172.21.15.96:0/519688626 conn(0x7f2aa40f0d40 msgr2=0x7f2aa40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.942+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 shutdown_connections 2022-02-02T19:14:17.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:17.942+0000 7f2aa9206700 1 -- 172.21.15.96:0/519688626 wait complete. 2022-02-02T19:14:18.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 -- 172.21.15.96:0/1198127518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 msgr2=0x7fb4a00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/1198127518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a00f6b30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fb490004660 tx=0x7fb490009b30).stop 2022-02-02T19:14:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 -- 172.21.15.96:0/1198127518 shutdown_connections 2022-02-02T19:14:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/1198127518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a00f6b30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/1198127518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 -- 172.21.15.96:0/1198127518 >> 172.21.15.96:0/1198127518 conn(0x7fb4a00f0b90 msgr2=0x7fb4a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:18.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.039+0000 7fb4a4f30700 1 -- 172.21.15.96:0/1198127518 shutdown_connections 2022-02-02T19:14:18.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 -- 172.21.15.96:0/1198127518 wait complete. 2022-02-02T19:14:18.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 Processor -- start 2022-02-02T19:14:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 -- start start 2022-02-02T19:14:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a005fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0060450 con 0x7fb4a00f66d0 2022-02-02T19:14:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.040+0000 7fb4a4f30700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0060590 con 0x7fb4a00f5430 2022-02-02T19:14:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58616/0 (socket says 172.21.15.96:58616) 2022-02-02T19:14:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 -- 172.21.15.96:0/2152443288 learned_addr learned my addr 172.21.15.96:0/2152443288 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49f7fe700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a005fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 -- 172.21.15.96:0/2152443288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 msgr2=0x7fb4a005fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a005fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 -- 172.21.15.96:0/2152443288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490005040 con 0x7fb4a00f66d0 2022-02-02T19:14:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49f7fe700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a005fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:14:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb49effd700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fb490009990 tx=0x7fb490009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb490018070 con 0x7fb4a00f66d0 2022-02-02T19:14:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a0068e40 con 0x7fb4a00f66d0 2022-02-02T19:14:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a00693a0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb490007ca0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.041+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb49001c3c0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.043+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a0045ad0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.044+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb49001d960 con 0x7fb4a00f66d0 2022-02-02T19:14:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.044+0000 7fb487fff700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 0x7fb4880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.044+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb4900838f0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.044+0000 7fb49f7fe700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 0x7fb4880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.044+0000 7fb49f7fe700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 0x7fb4880672e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fb4a005fbe0 tx=0x7fb494009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.048+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb490051a60 con 0x7fb4a00f66d0 2022-02-02T19:14:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.245+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4a00008d0 con 0x7fb4a00f66d0 2022-02-02T19:14:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.245+0000 7fb487fff700 1 -- 172.21.15.96:0/2152443288 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb490055080 con 0x7fb4a00f66d0 2022-02-02T19:14:18.249 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:14:18.249 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:14:18.250 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:14:18.250 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:14:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:18.250 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:14:18.251 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:14:18.251 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:14:18.251 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:14:18.251 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:14:18.252 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:14:18.252 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:14:18.252 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:14:18.252 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:14:18.252 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:14:18.253 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:14:18.253 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:14:18.253 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:14:18.253 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:14:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:14:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:14:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:14:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:14:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:14:18.255 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:14:18.255 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:14:18.255 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:14:18.255 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:14:18.256 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:14:18.256 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:14:18.256 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:14:18.256 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:14:18.256 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:18.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:18.257 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:14:18.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:18.257 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:18.257 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:18.258 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 msgr2=0x7fb4880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 0x7fb4880672e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fb4a005fbe0 tx=0x7fb494009040).stop 2022-02-02T19:14:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 msgr2=0x7fb4a0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fb490009990 tx=0x7fb490009b30).stop 2022-02-02T19:14:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 shutdown_connections 2022-02-02T19:14:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb488064e20 0x7fb4880672e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4a00f5430 0x7fb4a005fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 --2- 172.21.15.96:0/2152443288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a00f66d0 0x7fb4a0068890 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.247+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 >> 172.21.15.96:0/2152443288 conn(0x7fb4a00f0b90 msgr2=0x7fb4a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.248+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 shutdown_connections 2022-02-02T19:14:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:18.248+0000 7fb4a4f30700 1 -- 172.21.15.96:0/2152443288 wait complete. 2022-02-02T19:14:18.262 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:14:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:18 smithi159 ceph-mon[69013]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:18 smithi159 ceph-mon[69013]: from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:18 smithi159 ceph-mon[69013]: pgmap v1565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/519688626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:14:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2152443288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:14:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:18 smithi096 ceph-mon[101353]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:18 smithi096 ceph-mon[101353]: from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:18 smithi096 ceph-mon[101353]: pgmap v1565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/519688626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:14:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2152443288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:14:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:20 smithi159 ceph-mon[69013]: pgmap v1566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:20 smithi096 ceph-mon[101353]: pgmap v1566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:23.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:22 smithi096 ceph-mon[101353]: pgmap v1567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:22 smithi159 ceph-mon[69013]: pgmap v1567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:24 smithi159 ceph-mon[69013]: pgmap v1568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:25.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:24 smithi096 ceph-mon[101353]: pgmap v1568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:27.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:26 smithi159 ceph-mon[69013]: pgmap v1569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:27.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:26 smithi096 ceph-mon[101353]: pgmap v1569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:14:28.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:14:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:14:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:14:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:28 smithi159 ceph-mon[69013]: pgmap v1570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:28 smithi096 ceph-mon[101353]: pgmap v1570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:30 smithi159 ceph-mon[69013]: pgmap v1571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:31.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:30 smithi096 ceph-mon[101353]: pgmap v1571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:33.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:32 smithi096 ceph-mon[101353]: pgmap v1572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:32 smithi159 ceph-mon[69013]: pgmap v1572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:34 smithi159 ceph-mon[69013]: pgmap v1573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:34 smithi096 ceph-mon[101353]: pgmap v1573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:37.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:36 smithi159 ceph-mon[69013]: pgmap v1574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:36 smithi096 ceph-mon[101353]: pgmap v1574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:38 smithi159 ceph-mon[69013]: pgmap v1575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:39.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:38 smithi096 ceph-mon[101353]: pgmap v1575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:40 smithi159 ceph-mon[69013]: pgmap v1576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:41.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:40 smithi096 ceph-mon[101353]: pgmap v1576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:42 smithi096 ceph-mon[101353]: pgmap v1577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:42 smithi159 ceph-mon[69013]: pgmap v1577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:44 smithi159 ceph-mon[69013]: pgmap v1578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:44 smithi096 ceph-mon[101353]: pgmap v1578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:47.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:46 smithi159 ceph-mon[69013]: pgmap v1579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:47.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:46 smithi096 ceph-mon[101353]: pgmap v1579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.357+0000 7fd76b1ad700 1 -- 172.21.15.96:0/4168144699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 msgr2=0x7fd7640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.357+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/4168144699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd7640f6b00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd758004660 tx=0x7fd758009b30).stop 2022-02-02T19:14:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 -- 172.21.15.96:0/4168144699 shutdown_connections 2022-02-02T19:14:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/4168144699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd7640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/4168144699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd7640f6b00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 -- 172.21.15.96:0/4168144699 >> 172.21.15.96:0/4168144699 conn(0x7fd7640f1e40 msgr2=0x7fd7640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 -- 172.21.15.96:0/4168144699 shutdown_connections 2022-02-02T19:14:48.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 -- 172.21.15.96:0/4168144699 wait complete. 2022-02-02T19:14:48.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 Processor -- start 2022-02-02T19:14:48.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.358+0000 7fd76b1ad700 1 -- start start 2022-02-02T19:14:48.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd76b1ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd76b1ad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd764069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd76b1ad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406a380 con 0x7fd7640f66e0 2022-02-02T19:14:48.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd76b1ad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406a4c0 con 0x7fd7640f7980 2022-02-02T19:14:48.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58634/0 (socket says 172.21.15.96:58634) 2022-02-02T19:14:48.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 -- 172.21.15.96:0/2477615531 learned_addr learned my addr 172.21.15.96:0/2477615531 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:48.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd763fff700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd764069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 -- 172.21.15.96:0/2477615531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 msgr2=0x7fd764069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd764069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 -- 172.21.15.96:0/2477615531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758005040 con 0x7fd7640f66e0 2022-02-02T19:14:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd763fff700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd764069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:14:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd768f49700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd758004f60 tx=0x7fd758009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.359+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd758018070 con 0x7fd7640f66e0 2022-02-02T19:14:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.360+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd758007ba0 con 0x7fd7640f66e0 2022-02-02T19:14:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.360+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76406a740 con 0x7fd7640f66e0 2022-02-02T19:14:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.360+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd75801c620 con 0x7fd7640f66e0 2022-02-02T19:14:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.360+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76406aca0 con 0x7fd7640f66e0 2022-02-02T19:14:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.361+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764045ad0 con 0x7fd7640f66e0 2022-02-02T19:14:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.361+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd75801c8e0 con 0x7fd7640f66e0 2022-02-02T19:14:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.361+0000 7fd7617fa700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 0x7fd754067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.361+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd7580839b0 con 0x7fd7640f66e0 2022-02-02T19:14:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.361+0000 7fd763fff700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 0x7fd754067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.362+0000 7fd763fff700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 0x7fd754067290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd7500041d0 tx=0x7fd750009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.366+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd758051a60 con 0x7fd7640f66e0 2022-02-02T19:14:48.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.545+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd764057f10 con 0x7fd754064dd0 2022-02-02T19:14:48.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.547+0000 7fd7617fa700 1 -- 172.21.15.96:0/2477615531 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd764057f10 con 0x7fd754064dd0 2022-02-02T19:14:48.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 msgr2=0x7fd754067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 0x7fd754067290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd7500041d0 tx=0x7fd750009040).stop 2022-02-02T19:14:48.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 msgr2=0x7fd76406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd758004f60 tx=0x7fd758009b30).stop 2022-02-02T19:14:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 shutdown_connections 2022-02-02T19:14:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd754064dd0 0x7fd754067290 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7640f66e0 0x7fd76406b9a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 --2- 172.21.15.96:0/2477615531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7640f7980 0x7fd764069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 >> 172.21.15.96:0/2477615531 conn(0x7fd7640f1e40 msgr2=0x7fd7640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 shutdown_connections 2022-02-02T19:14:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.548+0000 7fd76b1ad700 1 -- 172.21.15.96:0/2477615531 wait complete. 2022-02-02T19:14:48.561 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:14:48.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 -- 172.21.15.96:0/2590244125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f66d0 msgr2=0x7f50040f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 --2- 172.21.15.96:0/2590244125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f66d0 0x7f50040f6b30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f4fec004660 tx=0x7f4fec009b30).stop 2022-02-02T19:14:48.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 -- 172.21.15.96:0/2590244125 shutdown_connections 2022-02-02T19:14:48.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 --2- 172.21.15.96:0/2590244125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f66d0 0x7f50040f6b30 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 --2- 172.21.15.96:0/2590244125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f5430 0x7f50040f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.645+0000 7f500359e700 1 -- 172.21.15.96:0/2590244125 >> 172.21.15.96:0/2590244125 conn(0x7f50040f0b90 msgr2=0x7f50040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:48.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 -- 172.21.15.96:0/2590244125 shutdown_connections 2022-02-02T19:14:48.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 -- 172.21.15.96:0/2590244125 wait complete. 2022-02-02T19:14:48.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 Processor -- start 2022-02-02T19:14:48.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 -- start start 2022-02-02T19:14:48.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f66d0 0x7f50041061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004106760 con 0x7f50040f5430 2022-02-02T19:14:48.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.646+0000 7f500359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004106f60 con 0x7f50040f66d0 2022-02-02T19:14:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58644/0 (socket says 172.21.15.96:58644) 2022-02-02T19:14:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 -- 172.21.15.96:0/1520081195 learned_addr learned my addr 172.21.15.96:0/1520081195 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f5001d9b700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f66d0 0x7f50041061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 -- 172.21.15.96:0/1520081195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f66d0 msgr2=0x7f50041061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f66d0 0x7f50041061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 -- 172.21.15.96:0/1520081195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec005040 con 0x7f50040f5430 2022-02-02T19:14:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500259c700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f4ff4002700 tx=0x7f4ff4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff40079c0 con 0x7f50040f5430 2022-02-02T19:14:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5004107240 con 0x7f50040f5430 2022-02-02T19:14:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ff400f040 con 0x7f50040f5430 2022-02-02T19:14:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff4014860 con 0x7f50040f5430 2022-02-02T19:14:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.647+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004107800 con 0x7f50040f5430 2022-02-02T19:14:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.648+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5004059100 con 0x7f50040f5430 2022-02-02T19:14:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.649+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ff401b060 con 0x7f50040f5430 2022-02-02T19:14:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.649+0000 7f4ffaffd700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 0x7f4ff00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.649+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ff4081950 con 0x7f50040f5430 2022-02-02T19:14:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.649+0000 7f5001d9b700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 0x7f4ff00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.650+0000 7f5001d9b700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 0x7f4ff00672e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4fec004630 tx=0x7f4fec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.654+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ff4053430 con 0x7f50040f5430 2022-02-02T19:14:48.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.826+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50040fdd00 con 0x7f4ff0064e20 2022-02-02T19:14:48.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.835+0000 7f4ffaffd700 1 -- 172.21.15.96:0/1520081195 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f50040fdd00 con 0x7f4ff0064e20 2022-02-02T19:14:48.839 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:14:48.839 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (58m) 28m ago 59m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:14:48.839 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (50m) 28m ago 59m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:14:48.839 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (50m) 27m ago 58m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:14:48.840 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (58m) 28m ago 59m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:14:48.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (55m) 28m ago 55m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:14:48.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (50m) 28m ago 55m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:14:48.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (55m) 27m ago 55m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:14:48.841 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (51m) 27m ago 55m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:14:48.841 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (52m) 28m ago 60m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:14:48.841 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (51m) 27m ago 58m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:14:48.841 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (51m) 28m ago 60m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:14:48.842 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (51m) 27m ago 58m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:14:48.842 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (58m) 28m ago 58m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:14:48.842 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (58m) 27m ago 58m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:14:48.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (50m) 28m ago 58m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:14:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (49m) 28m ago 57m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:14:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (49m) 28m ago 57m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:14:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (48m) 27m ago 57m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:14:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (48m) 27m ago 56m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:14:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (47m) 27m ago 56m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:14:48.844 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (57m) 28m ago 58m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:14:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 msgr2=0x7f4ff00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 0x7f4ff00672e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4fec004630 tx=0x7f4fec009b30).stop 2022-02-02T19:14:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 msgr2=0x7f5004105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f4ff4002700 tx=0x7f4ff4009d80).stop 2022-02-02T19:14:48.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 shutdown_connections 2022-02-02T19:14:48.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ff0064e20 0x7f4ff00672e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040f5430 0x7f5004105cc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 --2- 172.21.15.96:0/1520081195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50040f66d0 0x7f50041061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.837+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 >> 172.21.15.96:0/1520081195 conn(0x7f50040f0b90 msgr2=0x7f50040fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.838+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 shutdown_connections 2022-02-02T19:14:48.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.838+0000 7f500359e700 1 -- 172.21.15.96:0/1520081195 wait complete. 2022-02-02T19:14:48.937 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:48 smithi096 ceph-mon[101353]: pgmap v1580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:48.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 -- 172.21.15.96:0/2106774075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 msgr2=0x7f81500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 --2- 172.21.15.96:0/2106774075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f81500f59e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f814c004660 tx=0x7f814c009b30).stop 2022-02-02T19:14:48.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 -- 172.21.15.96:0/2106774075 shutdown_connections 2022-02-02T19:14:48.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 --2- 172.21.15.96:0/2106774075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f81500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:14:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 --2- 172.21.15.96:0/2106774075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f81500f59e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 -- 172.21.15.96:0/2106774075 >> 172.21.15.96:0/2106774075 conn(0x7f81500f0d40 msgr2=0x7f81500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 -- 172.21.15.96:0/2106774075 shutdown_connections 2022-02-02T19:14:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 -- 172.21.15.96:0/2106774075 wait complete. 2022-02-02T19:14:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.934+0000 7f8157514700 1 Processor -- start 2022-02-02T19:14:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8157514700 1 -- start start 2022-02-02T19:14:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8157514700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8157514700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f815010e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8157514700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500602d0 con 0x7f81500f55c0 2022-02-02T19:14:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8157514700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8150060410 con 0x7f81500f6860 2022-02-02T19:14:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58654/0 (socket says 172.21.15.96:58654) 2022-02-02T19:14:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 -- 172.21.15.96:0/378955446 learned_addr learned my addr 172.21.15.96:0/378955446 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8154aaf700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f815010e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 -- 172.21.15.96:0/378955446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 msgr2=0x7f815010e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f815010e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 -- 172.21.15.96:0/378955446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c005040 con 0x7f81500f55c0 2022-02-02T19:14:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f8154aaf700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f815010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:14:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.935+0000 7f81552b0700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f814c004f60 tx=0x7f814c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.936+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c018070 con 0x7f81500f55c0 2022-02-02T19:14:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.936+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815010eab0 con 0x7f81500f55c0 2022-02-02T19:14:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.936+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f814c007ba0 con 0x7f81500f55c0 2022-02-02T19:14:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.936+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c01c620 con 0x7f81500f55c0 2022-02-02T19:14:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.936+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815010eee0 con 0x7f81500f55c0 2022-02-02T19:14:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.937+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8150045ad0 con 0x7f81500f55c0 2022-02-02T19:14:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.938+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f814c01c8e0 con 0x7f81500f55c0 2022-02-02T19:14:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.938+0000 7f8145ffb700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 0x7f813c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.938+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f814c083ec0 con 0x7f81500f55c0 2022-02-02T19:14:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.938+0000 7f8154aaf700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 0x7f813c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.939+0000 7f8154aaf700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 0x7f813c067290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f814000a7e0 tx=0x7f8140008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:48.941+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f814c051f70 con 0x7f81500f55c0 2022-02-02T19:14:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.171+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81500586e0 con 0x7f81500f55c0 2022-02-02T19:14:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.172+0000 7f8145ffb700 1 -- 172.21.15.96:0/378955446 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f814c055590 con 0x7f81500f55c0 2022-02-02T19:14:49.176 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:14:49.176 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:14:49.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:14:49.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:49.177 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:14:49.177 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:14:49.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:49.177 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:14:49.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:14:49.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:49.178 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:14:49.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:14:49.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:14:49.179 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:14:49.179 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:14:49.179 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:14:49.180 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:14:49.180 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:14:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 msgr2=0x7f813c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 0x7f813c067290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f814000a7e0 tx=0x7f8140008040).stop 2022-02-02T19:14:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 msgr2=0x7f815010c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f814c004f60 tx=0x7f814c009b30).stop 2022-02-02T19:14:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 shutdown_connections 2022-02-02T19:14:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f813c064dd0 0x7f813c067290 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81500f55c0 0x7f815010c0c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 --2- 172.21.15.96:0/378955446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81500f6860 0x7f815010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 >> 172.21.15.96:0/378955446 conn(0x7f81500f0d40 msgr2=0x7f81500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:49.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 shutdown_connections 2022-02-02T19:14:49.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.174+0000 7f8157514700 1 -- 172.21.15.96:0/378955446 wait complete. 2022-02-02T19:14:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 -- 172.21.15.96:0/2190434275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f6860 msgr2=0x7f16a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2190434275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f6860 0x7f16a40f6cc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1694004660 tx=0x7f1694009b30).stop 2022-02-02T19:14:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 -- 172.21.15.96:0/2190434275 shutdown_connections 2022-02-02T19:14:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2190434275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f6860 0x7f16a40f6cc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2190434275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f55c0 0x7f16a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:14:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 -- 172.21.15.96:0/2190434275 >> 172.21.15.96:0/2190434275 conn(0x7f16a40f0d40 msgr2=0x7f16a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 -- 172.21.15.96:0/2190434275 shutdown_connections 2022-02-02T19:14:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.271+0000 7f16a9a36700 1 -- 172.21.15.96:0/2190434275 wait complete. 2022-02-02T19:14:49.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:48 smithi159 ceph-mon[69013]: pgmap v1580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 Processor -- start 2022-02-02T19:14:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 -- start start 2022-02-02T19:14:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 0x7f16a4109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40604b0 con 0x7f16a40f55c0 2022-02-02T19:14:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a9a36700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40605f0 con 0x7f16a40f6860 2022-02-02T19:14:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a27fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 0x7f16a4109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58664/0 (socket says 172.21.15.96:58664) 2022-02-02T19:14:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.272+0000 7f16a2ffd700 1 -- 172.21.15.96:0/2074332721 learned_addr learned my addr 172.21.15.96:0/2074332721 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:14:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a2ffd700 1 -- 172.21.15.96:0/2074332721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 msgr2=0x7f16a4109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a2ffd700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 0x7f16a4109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a2ffd700 1 -- 172.21.15.96:0/2074332721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694005040 con 0x7f16a40f55c0 2022-02-02T19:14:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a27fc700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 0x7f16a4109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:14:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a2ffd700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f16980093f0 tx=0x7f1698006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1698013640 con 0x7f16a40f55c0 2022-02-02T19:14:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a410a5c0 con 0x7f16a40f55c0 2022-02-02T19:14:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1698013c50 con 0x7f16a40f55c0 2022-02-02T19:14:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1698012c70 con 0x7f16a40f55c0 2022-02-02T19:14:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.273+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a410ab80 con 0x7f16a40f55c0 2022-02-02T19:14:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.274+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4045ad0 con 0x7f16a40f55c0 2022-02-02T19:14:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.275+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f169801a060 con 0x7f16a40f55c0 2022-02-02T19:14:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.275+0000 7f168b7fe700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 0x7f168c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:14:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.275+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1698081aa0 con 0x7f16a40f55c0 2022-02-02T19:14:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.275+0000 7f16a27fc700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 0x7f168c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:14:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.275+0000 7f16a27fc700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 0x7f168c067290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1694004630 tx=0x7f1694009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:14:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.279+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f169804faf0 con 0x7f16a40f55c0 2022-02-02T19:14:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.481+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16a40fde20 con 0x7f16a40f55c0 2022-02-02T19:14:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.482+0000 7f168b7fe700 1 -- 172.21.15.96:0/2074332721 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1698018720 con 0x7f16a40f55c0 2022-02-02T19:14:49.486 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:14:49.486 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:14:49.486 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:14:49.486 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:14:49.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:49.487 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:14:49.487 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:14:49.487 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:14:49.487 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:14:49.488 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:14:49.488 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:14:49.488 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:14:49.488 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:14:49.489 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:14:49.489 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:14:49.489 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:14:49.489 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:14:49.489 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:14:49.490 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:14:49.490 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:14:49.490 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:14:49.490 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:14:49.491 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:14:49.491 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:14:49.492 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:14:49.493 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:14:49.493 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:14:49.493 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:14:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:14:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:14:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:14:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:14:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:49.495 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:14:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:14:49.496 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:49.496 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:49.496 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:14:49.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 msgr2=0x7f168c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 0x7f168c067290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1694004630 tx=0x7f1694009b30).stop 2022-02-02T19:14:49.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 msgr2=0x7f16a4107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:14:49.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f16980093f0 tx=0x7f1698006ec0).stop 2022-02-02T19:14:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 shutdown_connections 2022-02-02T19:14:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f168c064dd0 0x7f168c067290 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16a40f55c0 0x7f16a4107a60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 --2- 172.21.15.96:0/2074332721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a40f6860 0x7f16a4109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:14:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.483+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 >> 172.21.15.96:0/2074332721 conn(0x7f16a40f0d40 msgr2=0x7f16a40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:14:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.484+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 shutdown_connections 2022-02-02T19:14:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:14:49.484+0000 7f16a9a36700 1 -- 172.21.15.96:0/2074332721 wait complete. 2022-02-02T19:14:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:14:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:49 smithi159 ceph-mon[69013]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:49 smithi159 ceph-mon[69013]: from='client.35742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/378955446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:14:50.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2074332721' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:14:50.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:49 smithi096 ceph-mon[101353]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:50.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:49 smithi096 ceph-mon[101353]: from='client.35742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:14:50.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/378955446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:14:50.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2074332721' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:14:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:50 smithi159 ceph-mon[69013]: pgmap v1581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:51.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:50 smithi096 ceph-mon[101353]: pgmap v1581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:52 smithi096 ceph-mon[101353]: pgmap v1582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:52 smithi159 ceph-mon[69013]: pgmap v1582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:54 smithi159 ceph-mon[69013]: pgmap v1583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:54 smithi096 ceph-mon[101353]: pgmap v1583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:57.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:56 smithi159 ceph-mon[69013]: pgmap v1584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:57.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:56 smithi096 ceph-mon[101353]: pgmap v1584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:59.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:14:58 smithi159 ceph-mon[69013]: pgmap v1585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:14:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:14:58 smithi096 ceph-mon[101353]: pgmap v1585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:00 smithi159 ceph-mon[69013]: pgmap v1586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:00 smithi096 ceph-mon[101353]: pgmap v1586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:02 smithi096 ceph-mon[101353]: pgmap v1587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:03.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:02 smithi159 ceph-mon[69013]: pgmap v1587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:04 smithi159 ceph-mon[69013]: pgmap v1588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:04 smithi096 ceph-mon[101353]: pgmap v1588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:07.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:06 smithi159 ceph-mon[69013]: pgmap v1589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:06 smithi096 ceph-mon[101353]: pgmap v1589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:08 smithi159 ceph-mon[69013]: pgmap v1590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:09.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:08 smithi096 ceph-mon[101353]: pgmap v1590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:10 smithi159 ceph-mon[69013]: pgmap v1591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:10 smithi096 ceph-mon[101353]: pgmap v1591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:12 smithi096 ceph-mon[101353]: pgmap v1592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:13.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:12 smithi159 ceph-mon[69013]: pgmap v1592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:14 smithi159 ceph-mon[69013]: pgmap v1593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:14 smithi096 ceph-mon[101353]: pgmap v1593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:16 smithi159 ceph-mon[69013]: pgmap v1594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:16 smithi096 ceph-mon[101353]: pgmap v1594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:18 smithi159 ceph-mon[69013]: pgmap v1595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:18 smithi096 ceph-mon[101353]: pgmap v1595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:19.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 -- 172.21.15.96:0/3464714344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f6860 msgr2=0x7f41100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 --2- 172.21.15.96:0/3464714344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f6860 0x7f41100f6cc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f410c004660 tx=0x7f410c009b30).stop 2022-02-02T19:15:19.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 -- 172.21.15.96:0/3464714344 shutdown_connections 2022-02-02T19:15:19.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 --2- 172.21.15.96:0/3464714344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f6860 0x7f41100f6cc0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 --2- 172.21.15.96:0/3464714344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f55c0 0x7f41100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 -- 172.21.15.96:0/3464714344 >> 172.21.15.96:0/3464714344 conn(0x7f41100f0d40 msgr2=0x7f41100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:19.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 -- 172.21.15.96:0/3464714344 shutdown_connections 2022-02-02T19:15:19.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.593+0000 7f41177d7700 1 -- 172.21.15.96:0/3464714344 wait complete. 2022-02-02T19:15:19.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 Processor -- start 2022-02-02T19:15:19.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 -- start start 2022-02-02T19:15:19.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f6860 0x7f411010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100602b0 con 0x7f41100f55c0 2022-02-02T19:15:19.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f41177d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100603f0 con 0x7f41100f6860 2022-02-02T19:15:19.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58682/0 (socket says 172.21.15.96:58682) 2022-02-02T19:15:19.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 -- 172.21.15.96:0/1504661365 learned_addr learned my addr 172.21.15.96:0/1504661365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:19.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4114d72700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f6860 0x7f411010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 -- 172.21.15.96:0/1504661365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f6860 msgr2=0x7f411010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f6860 0x7f411010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.594+0000 7f4115573700 1 -- 172.21.15.96:0/1504661365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c005040 con 0x7f41100f55c0 2022-02-02T19:15:19.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f4115573700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f4100002700 tx=0x7f4100009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:19.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41000079c0 con 0x7f41100f55c0 2022-02-02T19:15:19.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f410000f040 con 0x7f41100f55c0 2022-02-02T19:15:19.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4100014860 con 0x7f41100f55c0 2022-02-02T19:15:19.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411010ea60 con 0x7f41100f55c0 2022-02-02T19:15:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.595+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411010eee0 con 0x7f41100f55c0 2022-02-02T19:15:19.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.596+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4110045ad0 con 0x7f41100f55c0 2022-02-02T19:15:19.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.596+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f410001b060 con 0x7f41100f55c0 2022-02-02T19:15:19.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.597+0000 7f4105ffb700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 0x7f40fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.597+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4100081880 con 0x7f41100f55c0 2022-02-02T19:15:19.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.597+0000 7f4114d72700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 0x7f40fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.597+0000 7f4114d72700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 0x7f40fc067290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f410c004630 tx=0x7f410c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:19.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.601+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f410004f930 con 0x7f41100f55c0 2022-02-02T19:15:19.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.776+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41100fdef0 con 0x7f40fc064dd0 2022-02-02T19:15:19.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.778+0000 7f4105ffb700 1 -- 172.21.15.96:0/1504661365 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f41100fdef0 con 0x7f40fc064dd0 2022-02-02T19:15:19.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.779+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 msgr2=0x7f40fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.779+0000 7f41177d7700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 0x7f40fc067290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f410c004630 tx=0x7f410c009b30).stop 2022-02-02T19:15:19.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.779+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 msgr2=0x7f411010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.779+0000 7f41177d7700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f4100002700 tx=0x7f4100009d80).stop 2022-02-02T19:15:19.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 shutdown_connections 2022-02-02T19:15:19.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40fc064dd0 0x7f40fc067290 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41100f55c0 0x7f411010c070 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 --2- 172.21.15.96:0/1504661365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41100f6860 0x7f411010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 >> 172.21.15.96:0/1504661365 conn(0x7f41100f0d40 msgr2=0x7f41100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 shutdown_connections 2022-02-02T19:15:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.780+0000 7f41177d7700 1 -- 172.21.15.96:0/1504661365 wait complete. 2022-02-02T19:15:19.794 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:15:19.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3796358676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f6860 msgr2=0x7f6bf00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3796358676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f6860 0x7f6bf00f6cc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f6bdc004660 tx=0x7f6bdc009b30).stop 2022-02-02T19:15:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3796358676 shutdown_connections 2022-02-02T19:15:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3796358676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f6860 0x7f6bf00f6cc0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3796358676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00f55c0 0x7f6bf00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3796358676 >> 172.21.15.96:0/3796358676 conn(0x7f6bf00f0d40 msgr2=0x7f6bf00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3796358676 shutdown_connections 2022-02-02T19:15:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.877+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3796358676 wait complete. 2022-02-02T19:15:19.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 Processor -- start 2022-02-02T19:15:19.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 -- start start 2022-02-02T19:15:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 0x7f6bf010c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf010c840 con 0x7f6bf00f55c0 2022-02-02T19:15:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf6c9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf010c980 con 0x7f6bf00602d0 2022-02-02T19:15:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf4a39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf4a39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58692/0 (socket says 172.21.15.96:58692) 2022-02-02T19:15:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.878+0000 7f6bf4a39700 1 -- 172.21.15.96:0/3129323061 learned_addr learned my addr 172.21.15.96:0/3129323061 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6beffff700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 0x7f6bf010c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf4a39700 1 -- 172.21.15.96:0/3129323061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 msgr2=0x7f6bf010c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf4a39700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 0x7f6bf010c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf4a39700 1 -- 172.21.15.96:0/3129323061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc005040 con 0x7f6bf00f55c0 2022-02-02T19:15:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6beffff700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 0x7f6bf010c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:15:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf4a39700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f6be400c530 tx=0x7f6be4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be400f650 con 0x7f6bf00f55c0 2022-02-02T19:15:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6be400fc60 con 0x7f6bf00f55c0 2022-02-02T19:15:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf010cc60 con 0x7f6bf00f55c0 2022-02-02T19:15:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be4012d20 con 0x7f6bf00f55c0 2022-02-02T19:15:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.879+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf010d1a0 con 0x7f6bf00f55c0 2022-02-02T19:15:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.880+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0045ad0 con 0x7f6bf00f55c0 2022-02-02T19:15:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.881+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6be4019030 con 0x7f6bf00f55c0 2022-02-02T19:15:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.881+0000 7f6bed7fa700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 0x7f6be0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:19.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.881+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6be4081700 con 0x7f6bf00f55c0 2022-02-02T19:15:19.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.881+0000 7f6beffff700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 0x7f6be0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:19.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.881+0000 7f6beffff700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 0x7f6be0067290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6bdc004e30 tx=0x7f6bdc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:19.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:19.885+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6be404f800 con 0x7f6bf00f55c0 2022-02-02T19:15:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.058+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bf0057f10 con 0x7f6be0064dd0 2022-02-02T19:15:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.067+0000 7f6bed7fa700 1 -- 172.21.15.96:0/3129323061 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6bf0057f10 con 0x7f6be0064dd0 2022-02-02T19:15:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:15:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (58m) 29m ago 59m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:15:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (51m) 29m ago 59m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:15:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (51m) 27m ago 59m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:15:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (58m) 29m ago 59m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:15:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (55m) 29m ago 55m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:15:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (51m) 29m ago 55m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:15:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (55m) 27m ago 55m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:15:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (51m) 27m ago 55m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:15:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (52m) 29m ago 60m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:15:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (52m) 27m ago 59m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:15:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (52m) 29m ago 61m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:15:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (51m) 27m ago 59m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:15:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (59m) 29m ago 59m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:15:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (59m) 27m ago 59m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:15:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (50m) 29m ago 58m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:15:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (50m) 29m ago 58m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:15:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (49m) 29m ago 57m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:15:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (49m) 27m ago 57m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:15:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (48m) 27m ago 57m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:15:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (48m) 27m ago 57m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:15:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (58m) 29m ago 59m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:15:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 msgr2=0x7f6be0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 0x7f6be0067290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6bdc004e30 tx=0x7f6bdc009b30).stop 2022-02-02T19:15:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 msgr2=0x7f6bf0109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f6be400c530 tx=0x7f6be4007e10).stop 2022-02-02T19:15:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 shutdown_connections 2022-02-02T19:15:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6be0064dd0 0x7f6be0067290 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bf00f55c0 0x7f6bf0109de0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 --2- 172.21.15.96:0/3129323061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bf00602d0 0x7f6bf010c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 >> 172.21.15.96:0/3129323061 conn(0x7f6bf00f0d40 msgr2=0x7f6bf00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 shutdown_connections 2022-02-02T19:15:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.069+0000 7f6bf6c9d700 1 -- 172.21.15.96:0/3129323061 wait complete. 2022-02-02T19:15:20.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 -- 172.21.15.96:0/4226969460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f6860 msgr2=0x7fdf640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/4226969460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f6860 0x7fdf640f6cc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fdf58004660 tx=0x7fdf58009b30).stop 2022-02-02T19:15:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 -- 172.21.15.96:0/4226969460 shutdown_connections 2022-02-02T19:15:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/4226969460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f6860 0x7fdf640f6cc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/4226969460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f55c0 0x7fdf640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 -- 172.21.15.96:0/4226969460 >> 172.21.15.96:0/4226969460 conn(0x7fdf640f0d40 msgr2=0x7fdf640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 -- 172.21.15.96:0/4226969460 shutdown_connections 2022-02-02T19:15:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.166+0000 7fdf6aa24700 1 -- 172.21.15.96:0/4226969460 wait complete. 2022-02-02T19:15:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 Processor -- start 2022-02-02T19:15:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 -- start start 2022-02-02T19:15:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f6860 0x7fdf6410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640602d0 con 0x7fdf640f55c0 2022-02-02T19:15:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf6aa24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64060410 con 0x7fdf640f6860 2022-02-02T19:15:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.167+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58702/0 (socket says 172.21.15.96:58702) 2022-02-02T19:15:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 -- 172.21.15.96:0/473852955 learned_addr learned my addr 172.21.15.96:0/473852955 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf637fe700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f6860 0x7fdf6410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 -- 172.21.15.96:0/473852955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f6860 msgr2=0x7fdf6410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f6860 0x7fdf6410e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 -- 172.21.15.96:0/473852955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58005040 con 0x7fdf640f55c0 2022-02-02T19:15:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf63fff700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fdf5400c790 tx=0x7fdf54007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf54013630 con 0x7fdf640f55c0 2022-02-02T19:15:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf54012860 con 0x7fdf640f55c0 2022-02-02T19:15:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf54002780 con 0x7fdf640f55c0 2022-02-02T19:15:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6410ea40 con 0x7fdf640f55c0 2022-02-02T19:15:20.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.168+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6410ee60 con 0x7fdf640f55c0 2022-02-02T19:15:20.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.170+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf64045ad0 con 0x7fdf640f55c0 2022-02-02T19:15:20.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.170+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf54010070 con 0x7fdf640f55c0 2022-02-02T19:15:20.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.171+0000 7fdf60ff9700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.171+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdf54081ae0 con 0x7fdf640f55c0 2022-02-02T19:15:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.171+0000 7fdf637fe700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.171+0000 7fdf637fe700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fdf58004630 tx=0x7fdf58009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:20.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.175+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf5404fb30 con 0x7fdf640f55c0 2022-02-02T19:15:20.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.406+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf640605a0 con 0x7fdf640f55c0 2022-02-02T19:15:20.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.407+0000 7fdf60ff9700 1 -- 172.21.15.96:0/473852955 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdf54053150 con 0x7fdf640f55c0 2022-02-02T19:15:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:15:20.413 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:15:20.414 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:15:20.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:20.415 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:15:20.415 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:15:20.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:20.416 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:15:20.417 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:15:20.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:20.418 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:15:20.418 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:15:20.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:20.418 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:15:20.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:15:20.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:15:20.419 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:15:20.419 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:15:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 msgr2=0x7fdf4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fdf58004630 tx=0x7fdf58009b30).stop 2022-02-02T19:15:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 msgr2=0x7fdf6410c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fdf5400c790 tx=0x7fdf54007d90).stop 2022-02-02T19:15:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 shutdown_connections 2022-02-02T19:15:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf640f55c0 0x7fdf6410c050 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 --2- 172.21.15.96:0/473852955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf640f6860 0x7fdf6410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 >> 172.21.15.96:0/473852955 conn(0x7fdf640f0d40 msgr2=0x7fdf640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:20.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 shutdown_connections 2022-02-02T19:15:20.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.409+0000 7fdf6aa24700 1 -- 172.21.15.96:0/473852955 wait complete. 2022-02-02T19:15:20.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- 172.21.15.96:0/1121953639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f7980 msgr2=0x7f556c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 --2- 172.21.15.96:0/1121953639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f7980 0x7f556c0f7de0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f5568004660 tx=0x7f5568009b30).stop 2022-02-02T19:15:20.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- 172.21.15.96:0/1121953639 shutdown_connections 2022-02-02T19:15:20.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 --2- 172.21.15.96:0/1121953639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f7980 0x7f556c0f7de0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 --2- 172.21.15.96:0/1121953639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f66e0 0x7f556c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- 172.21.15.96:0/1121953639 >> 172.21.15.96:0/1121953639 conn(0x7f556c0f1e40 msgr2=0x7f556c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:20.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- 172.21.15.96:0/1121953639 shutdown_connections 2022-02-02T19:15:20.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- 172.21.15.96:0/1121953639 wait complete. 2022-02-02T19:15:20.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 Processor -- start 2022-02-02T19:15:20.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.508+0000 7f5574142700 1 -- start start 2022-02-02T19:15:20.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5574142700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5574142700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 0x7f556c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5574142700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c107a00 con 0x7f556c0f66e0 2022-02-02T19:15:20.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5574142700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c107b40 con 0x7f556c0f7980 2022-02-02T19:15:20.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58712/0 (socket says 172.21.15.96:58712) 2022-02-02T19:15:20.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 -- 172.21.15.96:0/1278284802 learned_addr learned my addr 172.21.15.96:0/1278284802 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:20.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f55716dd700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 0x7f556c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 -- 172.21.15.96:0/1278284802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 msgr2=0x7f556c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 0x7f556c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 -- 172.21.15.96:0/1278284802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568005040 con 0x7f556c0f66e0 2022-02-02T19:15:20.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f55716dd700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 0x7f556c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:15:20.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.509+0000 7f5571ede700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f555c00c530 tx=0x7f555c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:20.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.510+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f555c00f650 con 0x7f556c0f66e0 2022-02-02T19:15:20.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.510+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556c1084e0 con 0x7f556c0f66e0 2022-02-02T19:15:20.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.510+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f555c00fc60 con 0x7f556c0f66e0 2022-02-02T19:15:20.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.510+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f555c012d20 con 0x7f556c0f66e0 2022-02-02T19:15:20.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.510+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c108aa0 con 0x7f556c0f66e0 2022-02-02T19:15:20.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.511+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c045ad0 con 0x7f556c0f66e0 2022-02-02T19:15:20.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.511+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f555c019030 con 0x7f556c0f66e0 2022-02-02T19:15:20.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.511+0000 7f55627fc700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 0x7f5558067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:20.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.512+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f555c081760 con 0x7f556c0f66e0 2022-02-02T19:15:20.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.512+0000 7f55716dd700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 0x7f5558067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:20.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.512+0000 7f55716dd700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 0x7f5558067290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f5568009da0 tx=0x7f5568009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:20.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.516+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f555c053290 con 0x7f556c0f66e0 2022-02-02T19:15:20.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.717+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f556c0fefb0 con 0x7f556c0f66e0 2022-02-02T19:15:20.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.717+0000 7f55627fc700 1 -- 172.21.15.96:0/1278284802 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f555c052e80 con 0x7f556c0f66e0 2022-02-02T19:15:20.724 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:15:20.724 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:15:20.724 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:15:20.725 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:15:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:20.725 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:15:20.725 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:15:20.726 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:15:20.726 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:15:20.726 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:15:20.726 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:15:20.726 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:15:20.727 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:15:20.727 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:15:20.727 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:15:20.727 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:15:20.728 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:15:20.728 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:15:20.728 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:15:20.728 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:15:20.728 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:15:20.729 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:15:20.729 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:15:20.729 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:15:20.729 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:15:20.730 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:15:20.730 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:15:20.730 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:15:20.730 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:15:20.730 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:15:20.731 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:15:20.731 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:15:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:20.732 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:15:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:20.732 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:20.732 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:20.732 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:20.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 msgr2=0x7f5558067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 0x7f5558067290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f5568009da0 tx=0x7f5568009b30).stop 2022-02-02T19:15:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 msgr2=0x7f556c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f555c00c530 tx=0x7f555c007e10).stop 2022-02-02T19:15:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 shutdown_connections 2022-02-02T19:15:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5558064dd0 0x7f5558067290 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556c0f66e0 0x7f556c106f60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 --2- 172.21.15.96:0/1278284802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f556c0f7980 0x7f556c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 >> 172.21.15.96:0/1278284802 conn(0x7f556c0f1e40 msgr2=0x7f556c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 shutdown_connections 2022-02-02T19:15:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:20.719+0000 7f5574142700 1 -- 172.21.15.96:0/1278284802 wait complete. 2022-02-02T19:15:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:15:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:20 smithi159 ceph-mon[69013]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:20 smithi159 ceph-mon[69013]: pgmap v1596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/473852955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:15:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1278284802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:15:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:20 smithi096 ceph-mon[101353]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:20 smithi096 ceph-mon[101353]: pgmap v1596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/473852955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:15:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1278284802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:15:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:21 smithi159 ceph-mon[69013]: from='client.35758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:22.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:21 smithi096 ceph-mon[101353]: from='client.35758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:22 smithi096 ceph-mon[101353]: pgmap v1597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:22 smithi159 ceph-mon[69013]: pgmap v1597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:24 smithi159 ceph-mon[69013]: pgmap v1598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:24 smithi096 ceph-mon[101353]: pgmap v1598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:27.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:26 smithi159 ceph-mon[69013]: pgmap v1599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:27.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:26 smithi096 ceph-mon[101353]: pgmap v1599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:15:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:15:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:15:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:15:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:28 smithi096 ceph-mon[101353]: pgmap v1600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:28 smithi159 ceph-mon[69013]: pgmap v1600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:30 smithi159 ceph-mon[69013]: pgmap v1601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:30 smithi096 ceph-mon[101353]: pgmap v1601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:32 smithi096 ceph-mon[101353]: pgmap v1602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:32 smithi159 ceph-mon[69013]: pgmap v1602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:34 smithi159 ceph-mon[69013]: pgmap v1603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:34 smithi096 ceph-mon[101353]: pgmap v1603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:37.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:36 smithi159 ceph-mon[69013]: pgmap v1604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:36 smithi096 ceph-mon[101353]: pgmap v1604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:38 smithi159 ceph-mon[69013]: pgmap v1605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:38 smithi096 ceph-mon[101353]: pgmap v1605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:40 smithi159 ceph-mon[69013]: pgmap v1606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:40 smithi096 ceph-mon[101353]: pgmap v1606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:42 smithi096 ceph-mon[101353]: pgmap v1607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:42 smithi159 ceph-mon[69013]: pgmap v1607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:44 smithi159 ceph-mon[69013]: pgmap v1608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:44 smithi096 ceph-mon[101353]: pgmap v1608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:47.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:46 smithi096 ceph-mon[101353]: pgmap v1609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:47.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:46 smithi159 ceph-mon[69013]: pgmap v1609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:49.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:48 smithi159 ceph-mon[69013]: pgmap v1610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:48 smithi096 ceph-mon[101353]: pgmap v1610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 -- 172.21.15.96:0/367898725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 msgr2=0x7fc1080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 --2- 172.21.15.96:0/367898725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc1080f6cc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fc0f4004660 tx=0x7fc0f4009b30).stop 2022-02-02T19:15:50.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 -- 172.21.15.96:0/367898725 shutdown_connections 2022-02-02T19:15:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 --2- 172.21.15.96:0/367898725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc1080f6cc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 --2- 172.21.15.96:0/367898725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 0x7fc1080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 -- 172.21.15.96:0/367898725 >> 172.21.15.96:0/367898725 conn(0x7fc1080f0d40 msgr2=0x7fc1080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 -- 172.21.15.96:0/367898725 shutdown_connections 2022-02-02T19:15:50.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.830+0000 7fc10ed45700 1 -- 172.21.15.96:0/367898725 wait complete. 2022-02-02T19:15:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.831+0000 7fc10ed45700 1 Processor -- start 2022-02-02T19:15:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.831+0000 7fc10ed45700 1 -- start start 2022-02-02T19:15:50.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.831+0000 7fc10ed45700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 0x7fc108109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc10ed45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc10ed45700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080603c0 con 0x7fc1080f6860 2022-02-02T19:15:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc10ed45700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108060500 con 0x7fc1080f55c0 2022-02-02T19:15:50.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58734/0 (socket says 172.21.15.96:58734) 2022-02-02T19:15:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 -- 172.21.15.96:0/1848425752 learned_addr learned my addr 172.21.15.96:0/1848425752 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc10cae1700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 0x7fc108109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:50.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 -- 172.21.15.96:0/1848425752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 msgr2=0x7fc108109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 0x7fc108109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 -- 172.21.15.96:0/1848425752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4005040 con 0x7fc1080f6860 2022-02-02T19:15:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc107fff700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fc0f4009990 tx=0x7fc0f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f4018070 con 0x7fc1080f6860 2022-02-02T19:15:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0f4007ba0 con 0x7fc1080f6860 2022-02-02T19:15:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.832+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10810c6c0 con 0x7fc1080f6860 2022-02-02T19:15:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.833+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f401c3c0 con 0x7fc1080f6860 2022-02-02T19:15:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.833+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10810cbf0 con 0x7fc1080f6860 2022-02-02T19:15:50.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.833+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1080f49b0 con 0x7fc1080f6860 2022-02-02T19:15:50.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.834+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc0f401d420 con 0x7fc1080f6860 2022-02-02T19:15:50.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.834+0000 7fc1057fa700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 0x7fc0f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:50.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.835+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc0f4083650 con 0x7fc1080f6860 2022-02-02T19:15:50.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.835+0000 7fc10cae1700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 0x7fc0f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:50.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.835+0000 7fc10cae1700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 0x7fc0f8067290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc108060040 tx=0x7fc0fc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:50.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:50.839+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc0f40517c0 con 0x7fc1080f6860 2022-02-02T19:15:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.016+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1080fdf00 con 0x7fc0f8064dd0 2022-02-02T19:15:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.017+0000 7fc1057fa700 1 -- 172.21.15.96:0/1848425752 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc1080fdf00 con 0x7fc0f8064dd0 2022-02-02T19:15:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 msgr2=0x7fc0f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 0x7fc0f8067290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc108060040 tx=0x7fc0fc00b040).stop 2022-02-02T19:15:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 msgr2=0x7fc10810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fc0f4009990 tx=0x7fc0f4009b30).stop 2022-02-02T19:15:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 shutdown_connections 2022-02-02T19:15:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0f8064dd0 0x7fc0f8067290 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1080f55c0 0x7fc108109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 --2- 172.21.15.96:0/1848425752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1080f6860 0x7fc10810c170 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 >> 172.21.15.96:0/1848425752 conn(0x7fc1080f0d40 msgr2=0x7fc1080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 shutdown_connections 2022-02-02T19:15:51.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.019+0000 7fc10ed45700 1 -- 172.21.15.96:0/1848425752 wait complete. 2022-02-02T19:15:51.033 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:15:51.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.116+0000 7fdd7df9e700 1 -- 172.21.15.96:0/2919653221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f5430 msgr2=0x7fdd780f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.116+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/2919653221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f5430 0x7fdd780f5850 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fdd6c004660 tx=0x7fdd6c009b30).stop 2022-02-02T19:15:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 -- 172.21.15.96:0/2919653221 shutdown_connections 2022-02-02T19:15:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/2919653221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f66d0 0x7fdd780f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/2919653221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f5430 0x7fdd780f5850 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 -- 172.21.15.96:0/2919653221 >> 172.21.15.96:0/2919653221 conn(0x7fdd780f0b90 msgr2=0x7fdd780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.123 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:50 smithi096 ceph-mon[101353]: pgmap v1611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:51.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 -- 172.21.15.96:0/2919653221 shutdown_connections 2022-02-02T19:15:51.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 -- 172.21.15.96:0/2919653221 wait complete. 2022-02-02T19:15:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 Processor -- start 2022-02-02T19:15:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.117+0000 7fdd7df9e700 1 -- start start 2022-02-02T19:15:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd7df9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f5430 0x7fdd78109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd7df9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd7df9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780603e0 con 0x7fdd780f66d0 2022-02-02T19:15:51.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd7df9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78060520 con 0x7fdd780f5430 2022-02-02T19:15:51.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58742/0 (socket says 172.21.15.96:58742) 2022-02-02T19:15:51.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 -- 172.21.15.96:0/944491249 learned_addr learned my addr 172.21.15.96:0/944491249 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:51.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd7cf9c700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f5430 0x7fdd78109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 -- 172.21.15.96:0/944491249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f5430 msgr2=0x7fdd78109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f5430 0x7fdd78109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 -- 172.21.15.96:0/944491249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c005040 con 0x7fdd780f66d0 2022-02-02T19:15:51.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.118+0000 7fdd77fff700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdd6400e7f0 tx=0x7fdd6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.119+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd640092e0 con 0x7fdd780f66d0 2022-02-02T19:15:51.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.119+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7810c4d0 con 0x7fdd780f66d0 2022-02-02T19:15:51.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.119+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd6400f040 con 0x7fdd780f66d0 2022-02-02T19:15:51.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.119+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd64014750 con 0x7fdd780f66d0 2022-02-02T19:15:51.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.119+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7810ca90 con 0x7fdd780f66d0 2022-02-02T19:15:51.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.120+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd78045ad0 con 0x7fdd780f66d0 2022-02-02T19:15:51.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.120+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdd6401b030 con 0x7fdd780f66d0 2022-02-02T19:15:51.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.120+0000 7fdd757fa700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 0x7fdd680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.120+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdd64081880 con 0x7fdd780f66d0 2022-02-02T19:15:51.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.120+0000 7fdd7cf9c700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 0x7fdd680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.121+0000 7fdd7cf9c700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 0x7fdd680672e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fdd6c000c00 tx=0x7fdd6c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.125+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdd6404f9e0 con 0x7fdd780f66d0 2022-02-02T19:15:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:50 smithi159 ceph-mon[69013]: pgmap v1611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:51.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.296+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd78057f10 con 0x7fdd68064e20 2022-02-02T19:15:51.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.306+0000 7fdd757fa700 1 -- 172.21.15.96:0/944491249 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fdd78057f10 con 0x7fdd68064e20 2022-02-02T19:15:51.313 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:15:51.313 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (59m) 29m ago 60m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:15:51.313 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (51m) 29m ago 60m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:15:51.313 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (51m) 28m ago 59m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:15:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (59m) 29m ago 60m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:15:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (56m) 29m ago 56m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:15:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (51m) 29m ago 56m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:15:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (56m) 28m ago 56m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:15:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (52m) 28m ago 56m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:15:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (53m) 29m ago 61m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:15:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (53m) 28m ago 59m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:15:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (52m) 29m ago 61m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:15:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (52m) 28m ago 59m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:15:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (60m) 29m ago 60m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:15:51.316 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (59m) 28m ago 59m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:15:51.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (51m) 29m ago 59m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:15:51.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (50m) 29m ago 58m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:15:51.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (50m) 29m ago 58m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:15:51.317 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (49m) 28m ago 58m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:15:51.317 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (49m) 28m ago 57m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:15:51.317 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (48m) 28m ago 57m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:15:51.317 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (58m) 29m ago 59m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:15:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 msgr2=0x7fdd680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 0x7fdd680672e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fdd6c000c00 tx=0x7fdd6c016040).stop 2022-02-02T19:15:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 msgr2=0x7fdd7810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdd6400e7f0 tx=0x7fdd6400b040).stop 2022-02-02T19:15:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 shutdown_connections 2022-02-02T19:15:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd68064e20 0x7fdd680672e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.307+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd780f5430 0x7fdd78109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.308+0000 7fdd7df9e700 1 --2- 172.21.15.96:0/944491249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd780f66d0 0x7fdd7810bf20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.308+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 >> 172.21.15.96:0/944491249 conn(0x7fdd780f0b90 msgr2=0x7fdd780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.308+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 shutdown_connections 2022-02-02T19:15:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.308+0000 7fdd7df9e700 1 -- 172.21.15.96:0/944491249 wait complete. 2022-02-02T19:15:51.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 -- 172.21.15.96:0/3239389985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f55c0 msgr2=0x7fb58c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 --2- 172.21.15.96:0/3239389985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f55c0 0x7fb58c0f59e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb574004660 tx=0x7fb574009b30).stop 2022-02-02T19:15:51.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 -- 172.21.15.96:0/3239389985 shutdown_connections 2022-02-02T19:15:51.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 --2- 172.21.15.96:0/3239389985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f6860 0x7fb58c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 --2- 172.21.15.96:0/3239389985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f55c0 0x7fb58c0f59e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 -- 172.21.15.96:0/3239389985 >> 172.21.15.96:0/3239389985 conn(0x7fb58c0f0d40 msgr2=0x7fb58c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 -- 172.21.15.96:0/3239389985 shutdown_connections 2022-02-02T19:15:51.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.403+0000 7fb590db2700 1 -- 172.21.15.96:0/3239389985 wait complete. 2022-02-02T19:15:51.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 Processor -- start 2022-02-02T19:15:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 -- start start 2022-02-02T19:15:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f55c0 0x7fb58c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c106910 con 0x7fb58c0f6860 2022-02-02T19:15:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb590db2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c106a50 con 0x7fb58c0f55c0 2022-02-02T19:15:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb589d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb589d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58752/0 (socket says 172.21.15.96:58752) 2022-02-02T19:15:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb589d9b700 1 -- 172.21.15.96:0/3812289490 learned_addr learned my addr 172.21.15.96:0/3812289490 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.404+0000 7fb58a59c700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f55c0 0x7fb58c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb589d9b700 1 -- 172.21.15.96:0/3812289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f55c0 msgr2=0x7fb58c105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb589d9b700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f55c0 0x7fb58c105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb589d9b700 1 -- 172.21.15.96:0/3812289490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574005040 con 0x7fb58c0f6860 2022-02-02T19:15:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb589d9b700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fb57c00e9a0 tx=0x7fb57c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57c00cb90 con 0x7fb58c0f6860 2022-02-02T19:15:51.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c1073f0 con 0x7fb58c0f6860 2022-02-02T19:15:51.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb57c00ee30 con 0x7fb58c0f6860 2022-02-02T19:15:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57c010630 con 0x7fb58c0f6860 2022-02-02T19:15:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.405+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c1079b0 con 0x7fb58c0f6860 2022-02-02T19:15:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.406+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c045ad0 con 0x7fb58c0f6860 2022-02-02T19:15:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.407+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb57c00ccf0 con 0x7fb58c0f6860 2022-02-02T19:15:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.407+0000 7fb582ffd700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 0x7fb578067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.407+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb57c084b70 con 0x7fb58c0f6860 2022-02-02T19:15:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.407+0000 7fb58a59c700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 0x7fb578067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.407+0000 7fb58a59c700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 0x7fb578067290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb574004630 tx=0x7fb574009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.411+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb57c0565f0 con 0x7fb58c0f6860 2022-02-02T19:15:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.637+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb58c107ff0 con 0x7fb58c0f6860 2022-02-02T19:15:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.638+0000 7fb582ffd700 1 -- 172.21.15.96:0/3812289490 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb57c0561e0 con 0x7fb58c0f6860 2022-02-02T19:15:51.643 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:15:51.643 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:15:51.643 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:15:51.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:51.644 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:15:51.644 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:15:51.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:51.644 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:15:51.644 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:15:51.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:51.645 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:15:51.645 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:15:51.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:15:51.646 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:15:51.646 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:15:51.646 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:15:51.646 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:15:51.646 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:15:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.639+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 msgr2=0x7fb578067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.639+0000 7fb590db2700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 0x7fb578067290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb574004630 tx=0x7fb574009b30).stop 2022-02-02T19:15:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.639+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 msgr2=0x7fb58c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.639+0000 7fb590db2700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fb57c00e9a0 tx=0x7fb57c007e00).stop 2022-02-02T19:15:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 shutdown_connections 2022-02-02T19:15:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb578064dd0 0x7fb578067290 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f55c0 0x7fb58c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 --2- 172.21.15.96:0/3812289490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0f6860 0x7fb58c106360 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 >> 172.21.15.96:0/3812289490 conn(0x7fb58c0f0d40 msgr2=0x7fb58c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 shutdown_connections 2022-02-02T19:15:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.640+0000 7fb590db2700 1 -- 172.21.15.96:0/3812289490 wait complete. 2022-02-02T19:15:51.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 -- 172.21.15.96:0/1668816180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f5f60 msgr2=0x7f971c0f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 --2- 172.21.15.96:0/1668816180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f5f60 0x7f971c0f63e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f970c004660 tx=0x7f970c009b30).stop 2022-02-02T19:15:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 -- 172.21.15.96:0/1668816180 shutdown_connections 2022-02-02T19:15:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 --2- 172.21.15.96:0/1668816180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f5f60 0x7f971c0f63e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 --2- 172.21.15.96:0/1668816180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f971c0f4d60 0x7f971c0f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 -- 172.21.15.96:0/1668816180 >> 172.21.15.96:0/1668816180 conn(0x7f971c0f04c0 msgr2=0x7f971c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 -- 172.21.15.96:0/1668816180 shutdown_connections 2022-02-02T19:15:51.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.737+0000 7f972131a700 1 -- 172.21.15.96:0/1668816180 wait complete. 2022-02-02T19:15:51.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 Processor -- start 2022-02-02T19:15:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 -- start start 2022-02-02T19:15:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f971c0f5f60 0x7f971c0f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0f7890 con 0x7f971c0f4d60 2022-02-02T19:15:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f972131a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0f79d0 con 0x7f971c0f5f60 2022-02-02T19:15:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f971affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f971affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58758/0 (socket says 172.21.15.96:58758) 2022-02-02T19:15:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.738+0000 7f971affd700 1 -- 172.21.15.96:0/2375908476 learned_addr learned my addr 172.21.15.96:0/2375908476 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:15:51.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f971affd700 1 -- 172.21.15.96:0/2375908476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f971c0f5f60 msgr2=0x7f971c0f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f971affd700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f971c0f5f60 0x7f971c0f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:15:51.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f971affd700 1 -- 172.21.15.96:0/2375908476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c005040 con 0x7f971c0f4d60 2022-02-02T19:15:51.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f971affd700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f97100026d0 tx=0x7f9710009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9710009320 con 0x7f971c0f4d60 2022-02-02T19:15:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c0f7cb0 con 0x7f971c0f4d60 2022-02-02T19:15:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f971000f040 con 0x7f971c0f4d60 2022-02-02T19:15:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97100147e0 con 0x7f971c0f4d60 2022-02-02T19:15:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.739+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c10ef90 con 0x7f971c0f4d60 2022-02-02T19:15:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.740+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c045ad0 con 0x7f971c0f4d60 2022-02-02T19:15:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.741+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9710009480 con 0x7f971c0f4d60 2022-02-02T19:15:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.741+0000 7f97037fe700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 0x7f9704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:15:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.741+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9710082190 con 0x7f971c0f4d60 2022-02-02T19:15:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.741+0000 7f971a7fc700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 0x7f9704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:15:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.741+0000 7f971a7fc700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 0x7f9704067290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f970c004e30 tx=0x7f970c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:15:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.745+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9710050240 con 0x7f971c0f4d60 2022-02-02T19:15:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.947+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f971c0fdf50 con 0x7f971c0f4d60 2022-02-02T19:15:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.947+0000 7f97037fe700 1 -- 172.21.15.96:0/2375908476 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9710053860 con 0x7f971c0f4d60 2022-02-02T19:15:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:15:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:15:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:15:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:15:51.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:51.954 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:15:51.954 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:15:51.954 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:15:51.955 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:15:51.955 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:15:51.955 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:15:51.955 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:15:51.956 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:15:51.956 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:15:51.956 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:15:51.956 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:15:51.956 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:15:51.957 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:15:51.957 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:15:51.957 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:15:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:15:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:15:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:15:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:15:51.959 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:15:51.959 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:15:51.959 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:15:51.959 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:15:51.960 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:15:51.960 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:15:51.960 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:15:51.960 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:15:51.960 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:51.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:51.961 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:15:51.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:15:51.961 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:51.961 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:51.962 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:15:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 msgr2=0x7f9704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 0x7f9704067290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f970c004e30 tx=0x7f970c009b30).stop 2022-02-02T19:15:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 msgr2=0x7f971c0f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:15:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f97100026d0 tx=0x7f9710009de0).stop 2022-02-02T19:15:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 shutdown_connections 2022-02-02T19:15:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9704064dd0 0x7f9704067290 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f971c0f4d60 0x7f971c0f8eb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:15:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 --2- 172.21.15.96:0/2375908476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f971c0f5f60 0x7f971c0f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:15:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 >> 172.21.15.96:0/2375908476 conn(0x7f971c0f04c0 msgr2=0x7f971c0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:15:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 shutdown_connections 2022-02-02T19:15:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:15:51.949+0000 7f972131a700 1 -- 172.21.15.96:0/2375908476 wait complete. 2022-02-02T19:15:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:15:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3812289490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:15:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3812289490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:15:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:52 smithi096 ceph-mon[101353]: from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:52 smithi096 ceph-mon[101353]: from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:52 smithi096 ceph-mon[101353]: pgmap v1612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:53.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2375908476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:15:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:52 smithi159 ceph-mon[69013]: from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:52 smithi159 ceph-mon[69013]: from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:15:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:52 smithi159 ceph-mon[69013]: pgmap v1612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2375908476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:15:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:54 smithi159 ceph-mon[69013]: pgmap v1613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:54 smithi096 ceph-mon[101353]: pgmap v1613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:57.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:56 smithi096 ceph-mon[101353]: pgmap v1614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:56 smithi159 ceph-mon[69013]: pgmap v1614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:59.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:15:58 smithi159 ceph-mon[69013]: pgmap v1615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:15:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:15:58 smithi096 ceph-mon[101353]: pgmap v1615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:00 smithi159 ceph-mon[69013]: pgmap v1616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:00 smithi096 ceph-mon[101353]: pgmap v1616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:02 smithi096 ceph-mon[101353]: pgmap v1617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:03.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:02 smithi159 ceph-mon[69013]: pgmap v1617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:04 smithi159 ceph-mon[69013]: pgmap v1618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:04 smithi096 ceph-mon[101353]: pgmap v1618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:06 smithi096 ceph-mon[101353]: pgmap v1619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:07.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:06 smithi159 ceph-mon[69013]: pgmap v1619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:08 smithi159 ceph-mon[69013]: pgmap v1620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:09.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:08 smithi096 ceph-mon[101353]: pgmap v1620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:10 smithi159 ceph-mon[69013]: pgmap v1621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:10 smithi096 ceph-mon[101353]: pgmap v1621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:12 smithi096 ceph-mon[101353]: pgmap v1622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:13.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:12 smithi159 ceph-mon[69013]: pgmap v1622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:14 smithi159 ceph-mon[69013]: pgmap v1623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:14 smithi096 ceph-mon[101353]: pgmap v1623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:16 smithi096 ceph-mon[101353]: pgmap v1624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:16 smithi159 ceph-mon[69013]: pgmap v1624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:18 smithi159 ceph-mon[69013]: pgmap v1625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:18 smithi096 ceph-mon[101353]: pgmap v1625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:20 smithi159 ceph-mon[69013]: pgmap v1626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:20 smithi096 ceph-mon[101353]: pgmap v1626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:22.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3347977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f5440 msgr2=0x7f9e4c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3347977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c0f5860 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f9e3c004660 tx=0x7f9e3c009b30).stop 2022-02-02T19:16:22.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3347977374 shutdown_connections 2022-02-02T19:16:22.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3347977374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3347977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c0f5860 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3347977374 >> 172.21.15.96:0/3347977374 conn(0x7f9e4c0f0ba0 msgr2=0x7f9e4c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3347977374 shutdown_connections 2022-02-02T19:16:22.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.061+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3347977374 wait complete. 2022-02-02T19:16:22.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 Processor -- start 2022-02-02T19:16:22.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 -- start start 2022-02-02T19:16:22.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0603e0 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e52ba1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c060520 con 0x7f9e4c0f5440 2022-02-02T19:16:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e5139e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e5139e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58780/0 (socket says 172.21.15.96:58780) 2022-02-02T19:16:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e5139e700 1 -- 172.21.15.96:0/3923233677 learned_addr learned my addr 172.21.15.96:0/3923233677 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.062+0000 7f9e51b9f700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e5139e700 1 -- 172.21.15.96:0/3923233677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f5440 msgr2=0x7f9e4c109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e5139e700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e5139e700 1 -- 172.21.15.96:0/3923233677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c005040 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e5139e700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9e480026d0 tx=0x7f9e48009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e480079c0 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e4800f040 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c10c540 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e480148b0 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.063+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c10cb00 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.064+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c045ad0 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.065+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e48007b20 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.065+0000 7f9e427fc700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 0x7f9e380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.065+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9e48081a30 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.065+0000 7f9e51b9f700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 0x7f9e380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.065+0000 7f9e51b9f700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 0x7f9e380672e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9e3c013690 tx=0x7f9e3c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.069+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e4804fae0 con 0x7f9e4c0f66e0 2022-02-02T19:16:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.248+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e4c057f10 con 0x7f9e38064e20 2022-02-02T19:16:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.250+0000 7f9e427fc700 1 -- 172.21.15.96:0/3923233677 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9e4c057f10 con 0x7f9e38064e20 2022-02-02T19:16:22.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.251+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 msgr2=0x7f9e380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.251+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 0x7f9e380672e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9e3c013690 tx=0x7f9e3c009b30).stop 2022-02-02T19:16:22.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.251+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 msgr2=0x7f9e4c10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.251+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9e480026d0 tx=0x7f9e48009de0).stop 2022-02-02T19:16:22.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.251+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 shutdown_connections 2022-02-02T19:16:22.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e38064e20 0x7f9e380672e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e4c0f5440 0x7f9e4c109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 --2- 172.21.15.96:0/3923233677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e4c0f66e0 0x7f9e4c10bf90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 >> 172.21.15.96:0/3923233677 conn(0x7f9e4c0f0ba0 msgr2=0x7f9e4c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 shutdown_connections 2022-02-02T19:16:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.252+0000 7f9e52ba1700 1 -- 172.21.15.96:0/3923233677 wait complete. 2022-02-02T19:16:22.265 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:16:22.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.349+0000 7fe6aa361700 1 -- 172.21.15.96:0/3796705485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 msgr2=0x7fe6a40f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.349+0000 7fe6aa361700 1 --2- 172.21.15.96:0/3796705485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f92e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fe694004660 tx=0x7fe694009b30).stop 2022-02-02T19:16:22.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.349+0000 7fe6aa361700 1 -- 172.21.15.96:0/3796705485 shutdown_connections 2022-02-02T19:16:22.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 --2- 172.21.15.96:0/3796705485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 0x7fe6a40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 --2- 172.21.15.96:0/3796705485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f92e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 -- 172.21.15.96:0/3796705485 >> 172.21.15.96:0/3796705485 conn(0x7fe6a40f0d40 msgr2=0x7fe6a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 -- 172.21.15.96:0/3796705485 shutdown_connections 2022-02-02T19:16:22.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 -- 172.21.15.96:0/3796705485 wait complete. 2022-02-02T19:16:22.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.350+0000 7fe6aa361700 1 Processor -- start 2022-02-02T19:16:22.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6aa361700 1 -- start start 2022-02-02T19:16:22.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6aa361700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6aa361700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 0x7fe6a40f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6aa361700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40f5740 con 0x7fe6a40602d0 2022-02-02T19:16:22.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6aa361700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40f5880 con 0x7fe6a40f9860 2022-02-02T19:16:22.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58788/0 (socket says 172.21.15.96:58788) 2022-02-02T19:16:22.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 -- 172.21.15.96:0/2685758179 learned_addr learned my addr 172.21.15.96:0/2685758179 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:22.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a37fe700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 0x7fe6a40f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 -- 172.21.15.96:0/2685758179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 msgr2=0x7fe6a40f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 0x7fe6a40f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 -- 172.21.15.96:0/2685758179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694005040 con 0x7fe6a40602d0 2022-02-02T19:16:22.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a3fff700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fe694009990 tx=0x7fe694009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.351+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe694018070 con 0x7fe6a40602d0 2022-02-02T19:16:22.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.352+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe694007ba0 con 0x7fe6a40602d0 2022-02-02T19:16:22.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.352+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40f5b00 con 0x7fe6a40602d0 2022-02-02T19:16:22.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.352+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69401c3c0 con 0x7fe6a40602d0 2022-02-02T19:16:22.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.352+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a40f6060 con 0x7fe6a40602d0 2022-02-02T19:16:22.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.352+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4045ad0 con 0x7fe6a40602d0 2022-02-02T19:16:22.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.353+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe69401d420 con 0x7fe6a40602d0 2022-02-02T19:16:22.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.353+0000 7fe6a0ff9700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 0x7fe690067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.353+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe6940836f0 con 0x7fe6a40602d0 2022-02-02T19:16:22.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.353+0000 7fe6a37fe700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 0x7fe690067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.354+0000 7fe6a37fe700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 0x7fe690067290 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fe6a40600a0 tx=0x7fe68c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.358+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe694051860 con 0x7fe6a40602d0 2022-02-02T19:16:22.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.532+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6a40ff050 con 0x7fe690064dd0 2022-02-02T19:16:22.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.542+0000 7fe6a0ff9700 1 -- 172.21.15.96:0/2685758179 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe68c00f040 con 0x7fe690064dd0 2022-02-02T19:16:22.546 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:16:22.547 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (59m) 30m ago 60m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:16:22.547 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (52m) 30m ago 60m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:16:22.548 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (52m) 28m ago 60m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:16:22.548 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (59m) 30m ago 60m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:16:22.549 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (56m) 30m ago 56m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:16:22.549 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (52m) 30m ago 56m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:16:22.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (56m) 28m ago 56m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:16:22.550 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (52m) 28m ago 56m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:16:22.550 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (54m) 30m ago 61m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:16:22.551 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (53m) 28m ago 60m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:16:22.551 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (53m) 30m ago 62m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:16:22.552 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (52m) 28m ago 60m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:16:22.552 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (60m) 30m ago 60m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:16:22.553 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (60m) 28m ago 60m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:16:22.553 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (51m) 30m ago 59m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:16:22.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (51m) 30m ago 59m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:16:22.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (50m) 30m ago 59m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:16:22.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (50m) 28m ago 58m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:16:22.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (49m) 28m ago 58m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:16:22.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (49m) 28m ago 58m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:16:22.556 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (59m) 30m ago 60m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:16:22.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.543+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 msgr2=0x7fe690067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.543+0000 7fe6aa361700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 0x7fe690067290 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fe6a40600a0 tx=0x7fe68c00b040).stop 2022-02-02T19:16:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 msgr2=0x7fe6a40f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fe694009990 tx=0x7fe694009b30).stop 2022-02-02T19:16:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 shutdown_connections 2022-02-02T19:16:22.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe690064dd0 0x7fe690067290 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6a40602d0 0x7fe6a40f6d60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 --2- 172.21.15.96:0/2685758179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6a40f9860 0x7fe6a40f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 >> 172.21.15.96:0/2685758179 conn(0x7fe6a40f0d40 msgr2=0x7fe6a40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 shutdown_connections 2022-02-02T19:16:22.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.544+0000 7fe6aa361700 1 -- 172.21.15.96:0/2685758179 wait complete. 2022-02-02T19:16:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- 172.21.15.96:0/1882687777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f4ac0 msgr2=0x7fdf680f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 --2- 172.21.15.96:0/1882687777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f4ac0 0x7fdf680f4ee0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fdf64004660 tx=0x7fdf64009b30).stop 2022-02-02T19:16:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- 172.21.15.96:0/1882687777 shutdown_connections 2022-02-02T19:16:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 --2- 172.21.15.96:0/1882687777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f53d0 0x7fdf680f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 --2- 172.21.15.96:0/1882687777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f4ac0 0x7fdf680f4ee0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- 172.21.15.96:0/1882687777 >> 172.21.15.96:0/1882687777 conn(0x7fdf680f0540 msgr2=0x7fdf680f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- 172.21.15.96:0/1882687777 shutdown_connections 2022-02-02T19:16:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- 172.21.15.96:0/1882687777 wait complete. 2022-02-02T19:16:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 Processor -- start 2022-02-02T19:16:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.641+0000 7fdf6f591700 1 -- start start 2022-02-02T19:16:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6f591700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 0x7fdf681071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6f591700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6f591700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68107c60 con 0x7fdf680f53d0 2022-02-02T19:16:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6f591700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68107da0 con 0x7fdf680f4ac0 2022-02-02T19:16:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58800/0 (socket says 172.21.15.96:58800) 2022-02-02T19:16:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 -- 172.21.15.96:0/3863546288 learned_addr learned my addr 172.21.15.96:0/3863546288 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6d32d700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 0x7fdf681071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 -- 172.21.15.96:0/3863546288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 msgr2=0x7fdf681071c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 0x7fdf681071c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 -- 172.21.15.96:0/3863546288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64005040 con 0x7fdf680f53d0 2022-02-02T19:16:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6d32d700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 0x7fdf681071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:16:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6cb2c700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fdf58004ae0 tx=0x7fdf58007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf58013070 con 0x7fdf680f53d0 2022-02-02T19:16:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf5800e2b0 con 0x7fdf680f53d0 2022-02-02T19:16:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.642+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf68108740 con 0x7fdf680f53d0 2022-02-02T19:16:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.643+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf68108d00 con 0x7fdf680f53d0 2022-02-02T19:16:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.643+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf5800cb80 con 0x7fdf680f53d0 2022-02-02T19:16:22.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.644+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48004fa0 con 0x7fdf680f53d0 2022-02-02T19:16:22.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.644+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf5800cce0 con 0x7fdf680f53d0 2022-02-02T19:16:22.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.644+0000 7fdf5dffb700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 0x7fdf54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.644+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdf58085fd0 con 0x7fdf680f53d0 2022-02-02T19:16:22.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.645+0000 7fdf6d32d700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 0x7fdf54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.645+0000 7fdf6d32d700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 0x7fdf54067290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fdf64004e30 tx=0x7fdf64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.649+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf58058b00 con 0x7fdf680f53d0 2022-02-02T19:16:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.883+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf48005e80 con 0x7fdf680f53d0 2022-02-02T19:16:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.884+0000 7fdf5dffb700 1 -- 172.21.15.96:0/3863546288 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdf580586f0 con 0x7fdf680f53d0 2022-02-02T19:16:22.889 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:16:22.889 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:16:22.890 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:16:22.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:22.890 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:16:22.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:16:22.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:22.892 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:16:22.892 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:16:22.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:22.894 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:16:22.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:16:22.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:22.895 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:16:22.895 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:16:22.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:16:22.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:16:22.897 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:16:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 msgr2=0x7fdf54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 0x7fdf54067290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fdf64004e30 tx=0x7fdf64009b30).stop 2022-02-02T19:16:22.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 msgr2=0x7fdf681076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fdf58004ae0 tx=0x7fdf58007e00).stop 2022-02-02T19:16:22.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 shutdown_connections 2022-02-02T19:16:22.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf54064dd0 0x7fdf54067290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf680f4ac0 0x7fdf681071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 --2- 172.21.15.96:0/3863546288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf680f53d0 0x7fdf681076b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 >> 172.21.15.96:0/3863546288 conn(0x7fdf680f0540 msgr2=0x7fdf680fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 shutdown_connections 2022-02-02T19:16:22.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.886+0000 7fdf6f591700 1 -- 172.21.15.96:0/3863546288 wait complete. 2022-02-02T19:16:22.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 -- 172.21.15.96:0/274916216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 msgr2=0x7fd3d00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 --2- 172.21.15.96:0/274916216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d00f6b30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fd3c4004660 tx=0x7fd3c4009b30).stop 2022-02-02T19:16:22.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 -- 172.21.15.96:0/274916216 shutdown_connections 2022-02-02T19:16:22.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 --2- 172.21.15.96:0/274916216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d00f6b30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 --2- 172.21.15.96:0/274916216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.983+0000 7fd3d515d700 1 -- 172.21.15.96:0/274916216 >> 172.21.15.96:0/274916216 conn(0x7fd3d00f0b90 msgr2=0x7fd3d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:22.989 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:22 smithi096 ceph-mon[101353]: pgmap v1627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:22.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.984+0000 7fd3d515d700 1 -- 172.21.15.96:0/274916216 shutdown_connections 2022-02-02T19:16:22.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.984+0000 7fd3d515d700 1 -- 172.21.15.96:0/274916216 wait complete. 2022-02-02T19:16:22.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.984+0000 7fd3d515d700 1 Processor -- start 2022-02-02T19:16:22.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.984+0000 7fd3d515d700 1 -- start start 2022-02-02T19:16:22.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.984+0000 7fd3d515d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d0104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3d515d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:22.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3d515d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01055e0 con 0x7fd3d00f66d0 2022-02-02T19:16:22.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3d515d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d0105720 con 0x7fd3d00f5430 2022-02-02T19:16:22.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58810/0 (socket says 172.21.15.96:58810) 2022-02-02T19:16:22.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 -- 172.21.15.96:0/2553986709 learned_addr learned my addr 172.21.15.96:0/2553986709 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:22.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cffff700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d0104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:22.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 -- 172.21.15.96:0/2553986709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 msgr2=0x7fd3d0104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:22.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d0104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:22.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 -- 172.21.15.96:0/2553986709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4005040 con 0x7fd3d00f66d0 2022-02-02T19:16:22.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cffff700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:16:22.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3cf7fe700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fd3c4009990 tx=0x7fd3c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:22.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c4018070 con 0x7fd3d00f66d0 2022-02-02T19:16:22.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d0106030 con 0x7fd3d00f66d0 2022-02-02T19:16:22.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3c4007ca0 con 0x7fd3d00f66d0 2022-02-02T19:16:22.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c401c620 con 0x7fd3d00f66d0 2022-02-02T19:16:22.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.985+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d0106590 con 0x7fd3d00f66d0 2022-02-02T19:16:22.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.986+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d0045ad0 con 0x7fd3d00f66d0 2022-02-02T19:16:22.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.987+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3c401c8e0 con 0x7fd3d00f66d0 2022-02-02T19:16:23.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.987+0000 7fd3ccff9700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 0x7fd3b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:23.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.987+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3c4083a00 con 0x7fd3d00f66d0 2022-02-02T19:16:23.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.987+0000 7fd3cffff700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 0x7fd3b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:23.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.988+0000 7fd3cffff700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 0x7fd3b80672e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fd3c0007fd0 tx=0x7fd3c0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:23.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:22.991+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3c4051c50 con 0x7fd3d00f66d0 2022-02-02T19:16:23.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.192+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3d00fdd30 con 0x7fd3d00f66d0 2022-02-02T19:16:23.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.192+0000 7fd3ccff9700 1 -- 172.21.15.96:0/2553986709 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd3c4055270 con 0x7fd3d00f66d0 2022-02-02T19:16:23.198 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:16:23.198 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:16:23.199 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:16:23.199 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:16:23.200 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:23.200 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:16:23.200 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:16:23.201 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:16:23.201 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:16:23.202 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:16:23.202 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:16:23.203 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:16:23.203 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:16:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:16:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:16:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:16:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:16:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:16:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:16:23.206 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:16:23.206 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:16:23.207 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:16:23.207 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:16:23.207 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:16:23.208 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:16:23.208 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:16:23.208 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:16:23.209 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:16:23.209 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:16:23.209 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:16:23.210 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:16:23.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:16:23.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:23.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:23.211 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:16:23.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:23.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:23.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:23.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:23.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 msgr2=0x7fd3b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:23.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 0x7fd3b80672e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fd3c0007fd0 tx=0x7fd3c0009040).stop 2022-02-02T19:16:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 msgr2=0x7fd3d0104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fd3c4009990 tx=0x7fd3c4009b30).stop 2022-02-02T19:16:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 shutdown_connections 2022-02-02T19:16:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3b8064e20 0x7fd3b80672e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d00f5430 0x7fd3d0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 --2- 172.21.15.96:0/2553986709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3d00f66d0 0x7fd3d0104fe0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 >> 172.21.15.96:0/2553986709 conn(0x7fd3d00f0b90 msgr2=0x7fd3d005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 shutdown_connections 2022-02-02T19:16:23.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:23.194+0000 7fd3d515d700 1 -- 172.21.15.96:0/2553986709 wait complete. 2022-02-02T19:16:23.216 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:16:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:22 smithi159 ceph-mon[69013]: pgmap v1627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:23 smithi159 ceph-mon[69013]: from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:23 smithi159 ceph-mon[69013]: from='client.35790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3863546288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:16:24.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2553986709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:16:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:23 smithi096 ceph-mon[101353]: from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:23 smithi096 ceph-mon[101353]: from='client.35790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3863546288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:16:24.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2553986709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:16:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:24 smithi159 ceph-mon[69013]: pgmap v1628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:24 smithi096 ceph-mon[101353]: pgmap v1628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:27.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:26 smithi096 ceph-mon[101353]: pgmap v1629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:26 smithi159 ceph-mon[69013]: pgmap v1629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:16:28.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:16:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:16:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:16:29.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:28 smithi096 ceph-mon[101353]: pgmap v1630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:28 smithi159 ceph-mon[69013]: pgmap v1630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:30 smithi159 ceph-mon[69013]: pgmap v1631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:30 smithi096 ceph-mon[101353]: pgmap v1631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:32 smithi096 ceph-mon[101353]: pgmap v1632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:32 smithi159 ceph-mon[69013]: pgmap v1632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:34 smithi159 ceph-mon[69013]: pgmap v1633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:34 smithi096 ceph-mon[101353]: pgmap v1633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:36 smithi096 ceph-mon[101353]: pgmap v1634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:36 smithi159 ceph-mon[69013]: pgmap v1634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:38 smithi159 ceph-mon[69013]: pgmap v1635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:38 smithi096 ceph-mon[101353]: pgmap v1635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:40 smithi159 ceph-mon[69013]: pgmap v1636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:40 smithi096 ceph-mon[101353]: pgmap v1636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:42 smithi096 ceph-mon[101353]: pgmap v1637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:42 smithi159 ceph-mon[69013]: pgmap v1637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:44 smithi159 ceph-mon[69013]: pgmap v1638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:44 smithi096 ceph-mon[101353]: pgmap v1638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:47.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:46 smithi096 ceph-mon[101353]: pgmap v1639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:46 smithi159 ceph-mon[69013]: pgmap v1639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:49.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:48 smithi159 ceph-mon[69013]: pgmap v1640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:48 smithi096 ceph-mon[101353]: pgmap v1640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:50 smithi159 ceph-mon[69013]: pgmap v1641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:51.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:50 smithi096 ceph-mon[101353]: pgmap v1641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:52 smithi096 ceph-mon[101353]: pgmap v1642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:52 smithi159 ceph-mon[69013]: pgmap v1642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:53.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 -- 172.21.15.96:0/3056153965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f7970 msgr2=0x7f00780f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 --2- 172.21.15.96:0/3056153965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f7970 0x7f00780f7dd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f0074004660 tx=0x7f0074009b30).stop 2022-02-02T19:16:53.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 -- 172.21.15.96:0/3056153965 shutdown_connections 2022-02-02T19:16:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 --2- 172.21.15.96:0/3056153965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f7970 0x7f00780f7dd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 --2- 172.21.15.96:0/3056153965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f66d0 0x7f00780f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.302+0000 7f007fcd7700 1 -- 172.21.15.96:0/3056153965 >> 172.21.15.96:0/3056153965 conn(0x7f00780f1e50 msgr2=0x7f00780f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 -- 172.21.15.96:0/3056153965 shutdown_connections 2022-02-02T19:16:53.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 -- 172.21.15.96:0/3056153965 wait complete. 2022-02-02T19:16:53.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 Processor -- start 2022-02-02T19:16:53.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 -- start start 2022-02-02T19:16:53.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f7970 0x7f0078069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007806a380 con 0x7f00780f66d0 2022-02-02T19:16:53.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007fcd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007806a4c0 con 0x7f00780f7970 2022-02-02T19:16:53.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007da73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007da73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58832/0 (socket says 172.21.15.96:58832) 2022-02-02T19:16:53.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.303+0000 7f007da73700 1 -- 172.21.15.96:0/289131482 learned_addr learned my addr 172.21.15.96:0/289131482 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:53.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007d272700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f7970 0x7f0078069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007da73700 1 -- 172.21.15.96:0/289131482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f7970 msgr2=0x7f0078069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007da73700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f7970 0x7f0078069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007da73700 1 -- 172.21.15.96:0/289131482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074005040 con 0x7f00780f66d0 2022-02-02T19:16:53.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007da73700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f0068002700 tx=0x7f0068009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00680079c0 con 0x7f00780f66d0 2022-02-02T19:16:53.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f006800f040 con 0x7f00780f66d0 2022-02-02T19:16:53.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007806a7a0 con 0x7f00780f66d0 2022-02-02T19:16:53.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0068014860 con 0x7f00780f66d0 2022-02-02T19:16:53.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.304+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007810ef80 con 0x7f00780f66d0 2022-02-02T19:16:53.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.305+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078045ad0 con 0x7f00780f66d0 2022-02-02T19:16:53.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.306+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f006801b060 con 0x7f00780f66d0 2022-02-02T19:16:53.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.306+0000 7f006e7fc700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.306+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0068081930 con 0x7f00780f66d0 2022-02-02T19:16:53.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.306+0000 7f007d272700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.306+0000 7f007d272700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f0074004630 tx=0x7f0074009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.310+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f006804f9e0 con 0x7f00780f66d0 2022-02-02T19:16:53.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.489+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00780ff040 con 0x7f0064064dd0 2022-02-02T19:16:53.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.490+0000 7f006e7fc700 1 -- 172.21.15.96:0/289131482 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0074019040 con 0x7f0064064dd0 2022-02-02T19:16:53.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 msgr2=0x7f0064067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f0074004630 tx=0x7f0074009b30).stop 2022-02-02T19:16:53.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 msgr2=0x7f007806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f0068002700 tx=0x7f0068009d80).stop 2022-02-02T19:16:53.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 shutdown_connections 2022-02-02T19:16:53.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00780f66d0 0x7f007806b9a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 --2- 172.21.15.96:0/289131482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00780f7970 0x7f0078069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 >> 172.21.15.96:0/289131482 conn(0x7f00780f1e50 msgr2=0x7f00780fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 shutdown_connections 2022-02-02T19:16:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.492+0000 7f007fcd7700 1 -- 172.21.15.96:0/289131482 wait complete. 2022-02-02T19:16:53.506 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:16:53.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 -- 172.21.15.96:0/119902448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f7980 msgr2=0x7fe8b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 --2- 172.21.15.96:0/119902448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f7980 0x7fe8b40f7de0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fe8a0004660 tx=0x7fe8a0009b30).stop 2022-02-02T19:16:53.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 -- 172.21.15.96:0/119902448 shutdown_connections 2022-02-02T19:16:53.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 --2- 172.21.15.96:0/119902448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f7980 0x7fe8b40f7de0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 --2- 172.21.15.96:0/119902448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f66e0 0x7fe8b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 -- 172.21.15.96:0/119902448 >> 172.21.15.96:0/119902448 conn(0x7fe8b40f1e40 msgr2=0x7fe8b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:53.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 -- 172.21.15.96:0/119902448 shutdown_connections 2022-02-02T19:16:53.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.590+0000 7fe8bae11700 1 -- 172.21.15.96:0/119902448 wait complete. 2022-02-02T19:16:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 Processor -- start 2022-02-02T19:16:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 -- start start 2022-02-02T19:16:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f7980 0x7fe8b4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4107a00 con 0x7fe8b40f66e0 2022-02-02T19:16:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8bae11700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4107b40 con 0x7fe8b40f7980 2022-02-02T19:16:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58842/0 (socket says 172.21.15.96:58842) 2022-02-02T19:16:53.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 -- 172.21.15.96:0/1119214698 learned_addr learned my addr 172.21.15.96:0/1119214698 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:53.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b3fff700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f7980 0x7fe8b4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 -- 172.21.15.96:0/1119214698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f7980 msgr2=0x7fe8b4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f7980 0x7fe8b4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.591+0000 7fe8b8bad700 1 -- 172.21.15.96:0/1119214698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0005040 con 0x7fe8b40f66e0 2022-02-02T19:16:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8b8bad700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fe8a800c530 tx=0x7fe8a8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a800f650 con 0x7fe8b40f66e0 2022-02-02T19:16:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41084e0 con 0x7fe8b40f66e0 2022-02-02T19:16:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe8a800fc60 con 0x7fe8b40f66e0 2022-02-02T19:16:53.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a8012d20 con 0x7fe8b40f66e0 2022-02-02T19:16:53.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.592+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b4108aa0 con 0x7fe8b40f66e0 2022-02-02T19:16:53.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.593+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b4045ad0 con 0x7fe8b40f66e0 2022-02-02T19:16:53.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.593+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe8a8019030 con 0x7fe8b40f66e0 2022-02-02T19:16:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.594+0000 7fe8b17fa700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 0x7fe8a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.594+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe8a8081700 con 0x7fe8b40f66e0 2022-02-02T19:16:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.594+0000 7fe8b3fff700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 0x7fe8a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.594+0000 7fe8b3fff700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 0x7fe8a4067290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe8a0004e30 tx=0x7fe8a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.598+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe8a8053230 con 0x7fe8b40f66e0 2022-02-02T19:16:53.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.769+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8b40ff020 con 0x7fe8a4064dd0 2022-02-02T19:16:53.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.780+0000 7fe8b17fa700 1 -- 172.21.15.96:0/1119214698 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe8b40ff020 con 0x7fe8a4064dd0 2022-02-02T19:16:53.784 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:16:53.784 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (60m) 30m ago 61m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:16:53.784 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (52m) 30m ago 61m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:16:53.785 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (52m) 29m ago 60m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:16:53.785 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (60m) 30m ago 61m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:16:53.785 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (57m) 30m ago 57m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:16:53.785 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (52m) 30m ago 57m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:16:53.786 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (57m) 29m ago 57m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:16:53.786 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (53m) 29m ago 57m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:16:53.786 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (54m) 30m ago 62m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:16:53.786 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (54m) 29m ago 60m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:16:53.787 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (53m) 30m ago 62m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:16:53.787 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (53m) 29m ago 60m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:16:53.787 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (61m) 30m ago 61m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:16:53.787 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (60m) 29m ago 60m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:16:53.788 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (52m) 30m ago 60m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:16:53.788 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (51m) 30m ago 59m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:16:53.788 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (51m) 30m ago 59m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:16:53.788 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (50m) 29m ago 59m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:16:53.789 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (50m) 29m ago 58m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:16:53.789 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (49m) 29m ago 58m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:16:53.789 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (60m) 30m ago 60m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:16:53.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 msgr2=0x7fe8a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 0x7fe8a4067290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe8a0004e30 tx=0x7fe8a0009b30).stop 2022-02-02T19:16:53.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 msgr2=0x7fe8b4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fe8a800c530 tx=0x7fe8a8007e10).stop 2022-02-02T19:16:53.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 shutdown_connections 2022-02-02T19:16:53.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a4064dd0 0x7fe8a4067290 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b40f66e0 0x7fe8b4106f60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 --2- 172.21.15.96:0/1119214698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b40f7980 0x7fe8b4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 >> 172.21.15.96:0/1119214698 conn(0x7fe8b40f1e40 msgr2=0x7fe8b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:53.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 shutdown_connections 2022-02-02T19:16:53.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.782+0000 7fe8bae11700 1 -- 172.21.15.96:0/1119214698 wait complete. 2022-02-02T19:16:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- 172.21.15.96:0/1167824908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f7980 msgr2=0x7f7e880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 --2- 172.21.15.96:0/1167824908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f7980 0x7f7e880f7de0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f7e84004660 tx=0x7f7e84009b30).stop 2022-02-02T19:16:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- 172.21.15.96:0/1167824908 shutdown_connections 2022-02-02T19:16:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 --2- 172.21.15.96:0/1167824908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f7980 0x7f7e880f7de0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 --2- 172.21.15.96:0/1167824908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f66e0 0x7f7e880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:16:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- 172.21.15.96:0/1167824908 >> 172.21.15.96:0/1167824908 conn(0x7f7e880f1e40 msgr2=0x7f7e880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- 172.21.15.96:0/1167824908 shutdown_connections 2022-02-02T19:16:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- 172.21.15.96:0/1167824908 wait complete. 2022-02-02T19:16:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 Processor -- start 2022-02-02T19:16:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.879+0000 7f7e90428700 1 -- start start 2022-02-02T19:16:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e90428700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e90428700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f7980 0x7f7e881074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e90428700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88107ae0 con 0x7f7e880f66e0 2022-02-02T19:16:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e90428700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88108390 con 0x7f7e880f7980 2022-02-02T19:16:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58852/0 (socket says 172.21.15.96:58852) 2022-02-02T19:16:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 -- 172.21.15.96:0/2836121140 learned_addr learned my addr 172.21.15.96:0/2836121140 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8d9c3700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f7980 0x7f7e881074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 -- 172.21.15.96:0/2836121140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f7980 msgr2=0x7f7e881074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f7980 0x7f7e881074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 -- 172.21.15.96:0/2836121140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84005040 con 0x7f7e880f66e0 2022-02-02T19:16:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e8e1c4700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f7e7c0093f0 tx=0x7f7e7c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c013640 con 0x7f7e880f66e0 2022-02-02T19:16:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88108670 con 0x7f7e880f66e0 2022-02-02T19:16:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.880+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e7c013c50 con 0x7f7e880f66e0 2022-02-02T19:16:53.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.881+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c012c70 con 0x7f7e880f66e0 2022-02-02T19:16:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.881+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e88108c30 con 0x7f7e880f66e0 2022-02-02T19:16:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.882+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880f5ad0 con 0x7f7e880f66e0 2022-02-02T19:16:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.882+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e7c01a060 con 0x7f7e880f66e0 2022-02-02T19:16:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.882+0000 7f7e7affd700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 0x7f7e740672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.882+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7e7c081b60 con 0x7f7e880f66e0 2022-02-02T19:16:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.882+0000 7f7e8d9c3700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 0x7f7e740672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.883+0000 7f7e8d9c3700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 0x7f7e740672d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7e84004630 tx=0x7f7e84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:53.887+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e7c053520 con 0x7f7e880f66e0 2022-02-02T19:16:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.119+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e88027a00 con 0x7f7e880f66e0 2022-02-02T19:16:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.119+0000 7f7e7affd700 1 -- 172.21.15.96:0/2836121140 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7e7c053110 con 0x7f7e880f66e0 2022-02-02T19:16:54.124 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:16:54.124 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:16:54.124 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:16:54.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:54.125 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:16:54.125 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:16:54.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:54.126 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:16:54.126 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:16:54.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:54.126 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:16:54.127 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:16:54.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:16:54.127 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:16:54.127 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:16:54.128 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:16:54.128 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:16:54.128 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:16:54.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 msgr2=0x7f7e740672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 0x7f7e740672d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7e84004630 tx=0x7f7e84009b30).stop 2022-02-02T19:16:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 msgr2=0x7f7e88106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f7e7c0093f0 tx=0x7f7e7c006ec0).stop 2022-02-02T19:16:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 shutdown_connections 2022-02-02T19:16:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e74064e10 0x7f7e740672d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e880f66e0 0x7f7e88106fb0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 --2- 172.21.15.96:0/2836121140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880f7980 0x7f7e881074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.121+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 >> 172.21.15.96:0/2836121140 conn(0x7f7e880f1e40 msgr2=0x7f7e880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.122+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 shutdown_connections 2022-02-02T19:16:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.122+0000 7f7e90428700 1 -- 172.21.15.96:0/2836121140 wait complete. 2022-02-02T19:16:54.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 -- 172.21.15.96:0/3546479004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f77d0 msgr2=0x7f731c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 --2- 172.21.15.96:0/3546479004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f77d0 0x7f731c0f7c30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f7310004660 tx=0x7f7310009b30).stop 2022-02-02T19:16:54.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 -- 172.21.15.96:0/3546479004 shutdown_connections 2022-02-02T19:16:54.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 --2- 172.21.15.96:0/3546479004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f77d0 0x7f731c0f7c30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 --2- 172.21.15.96:0/3546479004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f6530 0x7f731c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:16:54.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 -- 172.21.15.96:0/3546479004 >> 172.21.15.96:0/3546479004 conn(0x7f731c0f1c90 msgr2=0x7f731c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:54.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 -- 172.21.15.96:0/3546479004 shutdown_connections 2022-02-02T19:16:54.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.219+0000 7f731bfff700 1 -- 172.21.15.96:0/3546479004 wait complete. 2022-02-02T19:16:54.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.220+0000 7f731bfff700 1 Processor -- start 2022-02-02T19:16:54.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.220+0000 7f731bfff700 1 -- start start 2022-02-02T19:16:54.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.220+0000 7f731bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:54.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.220+0000 7f731bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f77d0 0x7f731c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:54.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c107980 con 0x7f731c0f6530 2022-02-02T19:16:54.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c108100 con 0x7f731c0f77d0 2022-02-02T19:16:54.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:54.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58862/0 (socket says 172.21.15.96:58862) 2022-02-02T19:16:54.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 -- 172.21.15.96:0/2975672277 learned_addr learned my addr 172.21.15.96:0/2975672277 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:16:54.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731a7fc700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f77d0 0x7f731c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 -- 172.21.15.96:0/2975672277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f77d0 msgr2=0x7f731c1072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f77d0 0x7f731c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 -- 172.21.15.96:0/2975672277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310005040 con 0x7f731c0f6530 2022-02-02T19:16:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731affd700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f730c0093f0 tx=0x7f730c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c009ea0 con 0x7f731c0f6530 2022-02-02T19:16:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f730c013af0 con 0x7f731c0f6530 2022-02-02T19:16:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c108380 con 0x7f731c0f6530 2022-02-02T19:16:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c00db10 con 0x7f731c0f6530 2022-02-02T19:16:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.221+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c108940 con 0x7f731c0f6530 2022-02-02T19:16:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.222+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c045ad0 con 0x7f731c0f6530 2022-02-02T19:16:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.223+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f730c01a060 con 0x7f731c0f6530 2022-02-02T19:16:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.223+0000 7f73037fe700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 0x7f73040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:16:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.223+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f730c081a10 con 0x7f731c0f6530 2022-02-02T19:16:54.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.223+0000 7f731a7fc700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 0x7f73040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:16:54.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.224+0000 7f731a7fc700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 0x7f73040672e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f7310009da0 tx=0x7f7310009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:16:54.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.227+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f730c04fac0 con 0x7f731c0f6530 2022-02-02T19:16:54.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.429+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f731c0fef10 con 0x7f731c0f6530 2022-02-02T19:16:54.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.429+0000 7f73037fe700 1 -- 172.21.15.96:0/2975672277 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f730c018720 con 0x7f731c0f6530 2022-02-02T19:16:54.434 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:16:54.435 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:16:54.435 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:16:54.435 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:16:54.435 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:54.436 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:16:54.436 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:16:54.436 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:16:54.436 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:16:54.436 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:16:54.437 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:16:54.437 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:16:54.437 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:16:54.437 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:16:54.438 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:16:54.438 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:16:54.438 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:16:54.438 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:16:54.438 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:16:54.439 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:16:54.439 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:16:54.439 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:16:54.439 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:16:54.440 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:16:54.440 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:16:54.440 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:16:54.440 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:16:54.440 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:16:54.441 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:16:54.441 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:16:54.441 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:16:54.441 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:16:54.442 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:54.442 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:54.442 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:16:54.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:16:54.443 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:54.443 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:54.443 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:16:54.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 msgr2=0x7f73040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 0x7f73040672e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f7310009da0 tx=0x7f7310009b30).stop 2022-02-02T19:16:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 msgr2=0x7f731c106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:16:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f730c0093f0 tx=0x7f730c006ec0).stop 2022-02-02T19:16:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 shutdown_connections 2022-02-02T19:16:54.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7304064e20 0x7f73040672e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f731c0f6530 0x7f731c106e00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 --2- 172.21.15.96:0/2975672277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c0f77d0 0x7f731c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:16:54.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 >> 172.21.15.96:0/2975672277 conn(0x7f731c0f1c90 msgr2=0x7f731c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:16:54.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 shutdown_connections 2022-02-02T19:16:54.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:16:54.431+0000 7f731bfff700 1 -- 172.21.15.96:0/2975672277 wait complete. 2022-02-02T19:16:54.447 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:16:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:54 smithi159 ceph-mon[69013]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:54 smithi159 ceph-mon[69013]: from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:54 smithi159 ceph-mon[69013]: pgmap v1643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2836121140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:16:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2975672277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:16:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:54 smithi096 ceph-mon[101353]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:54 smithi096 ceph-mon[101353]: from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:16:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:54 smithi096 ceph-mon[101353]: pgmap v1643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2836121140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:16:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2975672277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:16:57.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:56 smithi096 ceph-mon[101353]: pgmap v1644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:56 smithi159 ceph-mon[69013]: pgmap v1644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:59.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:16:58 smithi159 ceph-mon[69013]: pgmap v1645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:16:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:16:58 smithi096 ceph-mon[101353]: pgmap v1645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:00 smithi159 ceph-mon[69013]: pgmap v1646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:00 smithi096 ceph-mon[101353]: pgmap v1646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:02 smithi096 ceph-mon[101353]: pgmap v1647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:03.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:02 smithi159 ceph-mon[69013]: pgmap v1647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:05.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:04 smithi159 ceph-mon[69013]: pgmap v1648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:04 smithi096 ceph-mon[101353]: pgmap v1648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:06 smithi096 ceph-mon[101353]: pgmap v1649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:07.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:06 smithi159 ceph-mon[69013]: pgmap v1649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:08 smithi159 ceph-mon[69013]: pgmap v1650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:09.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:08 smithi096 ceph-mon[101353]: pgmap v1650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:10 smithi159 ceph-mon[69013]: pgmap v1651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:10 smithi096 ceph-mon[101353]: pgmap v1651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:12 smithi096 ceph-mon[101353]: pgmap v1652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:13.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:12 smithi159 ceph-mon[69013]: pgmap v1652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:14 smithi159 ceph-mon[69013]: pgmap v1653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:14 smithi096 ceph-mon[101353]: pgmap v1653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:16 smithi096 ceph-mon[101353]: pgmap v1654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:16 smithi159 ceph-mon[69013]: pgmap v1654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:18 smithi159 ceph-mon[69013]: pgmap v1655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:18 smithi096 ceph-mon[101353]: pgmap v1655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:20 smithi159 ceph-mon[69013]: pgmap v1656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:20 smithi096 ceph-mon[101353]: pgmap v1656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:22 smithi096 ceph-mon[101353]: pgmap v1657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:22 smithi159 ceph-mon[69013]: pgmap v1657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 -- 172.21.15.96:0/4205461977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 msgr2=0x7fb3c00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/4205461977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c00f59e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb3a8004660 tx=0x7fb3a8009b30).stop 2022-02-02T19:17:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 -- 172.21.15.96:0/4205461977 shutdown_connections 2022-02-02T19:17:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/4205461977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 0x7fb3c00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/4205461977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c00f59e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 -- 172.21.15.96:0/4205461977 >> 172.21.15.96:0/4205461977 conn(0x7fb3c00f0d40 msgr2=0x7fb3c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 -- 172.21.15.96:0/4205461977 shutdown_connections 2022-02-02T19:17:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.540+0000 7fb3c60f5700 1 -- 172.21.15.96:0/4205461977 wait complete. 2022-02-02T19:17:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 Processor -- start 2022-02-02T19:17:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 -- start start 2022-02-02T19:17:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 0x7fb3c010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00603e0 con 0x7fb3c00f55c0 2022-02-02T19:17:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3c60f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0060520 con 0x7fb3c00f6860 2022-02-02T19:17:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58880/0 (socket says 172.21.15.96:58880) 2022-02-02T19:17:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.541+0000 7fb3bf7fe700 1 -- 172.21.15.96:0/1666375561 learned_addr learned my addr 172.21.15.96:0/1666375561 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3beffd700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 0x7fb3c010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3bf7fe700 1 -- 172.21.15.96:0/1666375561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 msgr2=0x7fb3c010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3bf7fe700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 0x7fb3c010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3bf7fe700 1 -- 172.21.15.96:0/1666375561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8005040 con 0x7fb3c00f55c0 2022-02-02T19:17:24.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3bf7fe700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fb3a8013a70 tx=0x7fb3a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:24.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a8018070 con 0x7fb3c00f55c0 2022-02-02T19:17:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c010c6c0 con 0x7fb3c00f55c0 2022-02-02T19:17:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3a80097d0 con 0x7fb3c00f55c0 2022-02-02T19:17:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c010cc20 con 0x7fb3c00f55c0 2022-02-02T19:17:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.542+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a801de80 con 0x7fb3c00f55c0 2022-02-02T19:17:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.543+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a4004fa0 con 0x7fb3c00f55c0 2022-02-02T19:17:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.544+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb3a8007ba0 con 0x7fb3c00f55c0 2022-02-02T19:17:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.544+0000 7fb3b7fff700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.544+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb3a8083510 con 0x7fb3c00f55c0 2022-02-02T19:17:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.544+0000 7fb3beffd700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.544+0000 7fb3beffd700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb3b0004c40 tx=0x7fb3b000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.548+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb3a8051680 con 0x7fb3c00f55c0 2022-02-02T19:17:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.726+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3a4000bc0 con 0x7fb3ac064dd0 2022-02-02T19:17:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.727+0000 7fb3b7fff700 1 -- 172.21.15.96:0/1666375561 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb3a4000bc0 con 0x7fb3ac064dd0 2022-02-02T19:17:24.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 msgr2=0x7fb3ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb3b0004c40 tx=0x7fb3b000b040).stop 2022-02-02T19:17:24.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 msgr2=0x7fb3c0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fb3a8013a70 tx=0x7fb3a8009b30).stop 2022-02-02T19:17:24.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 shutdown_connections 2022-02-02T19:17:24.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c00f55c0 0x7fb3c0109c70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 --2- 172.21.15.96:0/1666375561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c00f6860 0x7fb3c010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 >> 172.21.15.96:0/1666375561 conn(0x7fb3c00f0d40 msgr2=0x7fb3c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 shutdown_connections 2022-02-02T19:17:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.729+0000 7fb3c60f5700 1 -- 172.21.15.96:0/1666375561 wait complete. 2022-02-02T19:17:24.744 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:17:24.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- 172.21.15.96:0/1427778977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f66e0 msgr2=0x7f18040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 --2- 172.21.15.96:0/1427778977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f66e0 0x7f18040f6b00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f17f8004660 tx=0x7f17f8009b30).stop 2022-02-02T19:17:24.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- 172.21.15.96:0/1427778977 shutdown_connections 2022-02-02T19:17:24.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 --2- 172.21.15.96:0/1427778977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f7980 0x7f18040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 --2- 172.21.15.96:0/1427778977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f66e0 0x7f18040f6b00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- 172.21.15.96:0/1427778977 >> 172.21.15.96:0/1427778977 conn(0x7f18040f1e40 msgr2=0x7f18040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:24.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- 172.21.15.96:0/1427778977 shutdown_connections 2022-02-02T19:17:24.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- 172.21.15.96:0/1427778977 wait complete. 2022-02-02T19:17:24.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 Processor -- start 2022-02-02T19:17:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- start start 2022-02-02T19:17:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f66e0 0x7f1804104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804105830 con 0x7f18040f7980 2022-02-02T19:17:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.828+0000 7f1808ae3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804105970 con 0x7f18040f66e0 2022-02-02T19:17:24.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58892/0 (socket says 172.21.15.96:58892) 2022-02-02T19:17:24.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 -- 172.21.15.96:0/775038511 learned_addr learned my addr 172.21.15.96:0/775038511 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:24.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 -- 172.21.15.96:0/775038511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f66e0 msgr2=0x7f1804104d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f180259c700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f66e0 0x7f1804104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f66e0 0x7f1804104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 -- 172.21.15.96:0/775038511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8005040 con 0x7f18040f7980 2022-02-02T19:17:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1801d9b700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f17f400c530 tx=0x7f17f4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f400f650 con 0x7f18040f7980 2022-02-02T19:17:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f17f400fc60 con 0x7f18040f7980 2022-02-02T19:17:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180410b540 con 0x7f18040f7980 2022-02-02T19:17:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f4012cd0 con 0x7f18040f7980 2022-02-02T19:17:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.829+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180410bb00 con 0x7f18040f7980 2022-02-02T19:17:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.830+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1804045ad0 con 0x7f18040f7980 2022-02-02T19:17:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.831+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f17f4010070 con 0x7f18040f7980 2022-02-02T19:17:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.831+0000 7f17f2ffd700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 0x7f17ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:24.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.831+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f17f4081800 con 0x7f18040f7980 2022-02-02T19:17:24.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.831+0000 7f180259c700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 0x7f17ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:24.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.831+0000 7f180259c700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 0x7f17ec067290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f17f8009da0 tx=0x7f17f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:24.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:24.835+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f17f404f8b0 con 0x7f18040f7980 2022-02-02T19:17:25.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.007+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18040fbe40 con 0x7f17ec064dd0 2022-02-02T19:17:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.017+0000 7f17f2ffd700 1 -- 172.21.15.96:0/775038511 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f18040fbe40 con 0x7f17ec064dd0 2022-02-02T19:17:25.022 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:17:25.022 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (60m) 31m ago 61m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:17:25.022 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (53m) 31m ago 61m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:17:25.023 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (53m) 29m ago 61m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:17:25.023 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (60m) 31m ago 61m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:17:25.023 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (57m) 31m ago 57m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:17:25.023 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (53m) 31m ago 57m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:17:25.023 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (57m) 29m ago 57m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:17:25.024 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (53m) 29m ago 58m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:17:25.024 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (55m) 31m ago 62m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:17:25.024 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (54m) 29m ago 61m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:17:25.024 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (54m) 31m ago 63m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:17:25.024 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (53m) 29m ago 61m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:17:25.025 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (61m) 31m ago 61m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:17:25.025 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (61m) 29m ago 61m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:17:25.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (52m) 31m ago 60m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:17:25.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (52m) 31m ago 60m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:17:25.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (51m) 31m ago 60m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:17:25.026 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (51m) 29m ago 59m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:17:25.026 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (50m) 29m ago 59m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:17:25.026 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (50m) 29m ago 59m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:17:25.026 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (60m) 31m ago 61m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:17:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 msgr2=0x7f17ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 0x7f17ec067290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f17f8009da0 tx=0x7f17f8009b30).stop 2022-02-02T19:17:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 msgr2=0x7f1804105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f17f400c530 tx=0x7f17f4007e20).stop 2022-02-02T19:17:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 shutdown_connections 2022-02-02T19:17:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17ec064dd0 0x7f17ec067290 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18040f66e0 0x7f1804104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 --2- 172.21.15.96:0/775038511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18040f7980 0x7f1804105230 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.018+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 >> 172.21.15.96:0/775038511 conn(0x7f18040f1e40 msgr2=0x7f180406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.019+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 shutdown_connections 2022-02-02T19:17:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.019+0000 7f1808ae3700 1 -- 172.21.15.96:0/775038511 wait complete. 2022-02-02T19:17:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 -- 172.21.15.96:0/272254583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 msgr2=0x7fb58c0f90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 --2- 172.21.15.96:0/272254583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c0f90d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fb580004660 tx=0x7fb580009b30).stop 2022-02-02T19:17:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 -- 172.21.15.96:0/272254583 shutdown_connections 2022-02-02T19:17:25.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 --2- 172.21.15.96:0/272254583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 0x7fb58c0fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 --2- 172.21.15.96:0/272254583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c0f90d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 -- 172.21.15.96:0/272254583 >> 172.21.15.96:0/272254583 conn(0x7fb58c0f0ad0 msgr2=0x7fb58c0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:25.122 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:24 smithi096 ceph-mon[101353]: pgmap v1658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:25.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 -- 172.21.15.96:0/272254583 shutdown_connections 2022-02-02T19:17:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.115+0000 7fb590df2700 1 -- 172.21.15.96:0/272254583 wait complete. 2022-02-02T19:17:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 Processor -- start 2022-02-02T19:17:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 -- start start 2022-02-02T19:17:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 0x7fb58c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c107830 con 0x7fb58c0602b0 2022-02-02T19:17:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb590df2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c108040 con 0x7fb58c0f9650 2022-02-02T19:17:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58900/0 (socket says 172.21.15.96:58900) 2022-02-02T19:17:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 -- 172.21.15.96:0/2130685300 learned_addr learned my addr 172.21.15.96:0/2130685300 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58affd700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 0x7fb58c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 -- 172.21.15.96:0/2130685300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 msgr2=0x7fb58c107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 0x7fb58c107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.116+0000 7fb58b7fe700 1 -- 172.21.15.96:0/2130685300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580005040 con 0x7fb58c0602b0 2022-02-02T19:17:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb58b7fe700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fb580009990 tx=0x7fb580009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb580018070 con 0x7fb58c0602b0 2022-02-02T19:17:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c108260 con 0x7fb58c0602b0 2022-02-02T19:17:25.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c1087c0 con 0x7fb58c0602b0 2022-02-02T19:17:25.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb580007ca0 con 0x7fb58c0602b0 2022-02-02T19:17:25.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.117+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb58001c620 con 0x7fb58c0602b0 2022-02-02T19:17:25.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.118+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c004fa0 con 0x7fb58c0602b0 2022-02-02T19:17:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.118+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb58001c890 con 0x7fb58c0602b0 2022-02-02T19:17:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.119+0000 7fb573fff700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 0x7fb5740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.119+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb5800836c0 con 0x7fb58c0602b0 2022-02-02T19:17:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.119+0000 7fb58affd700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 0x7fb5740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.119+0000 7fb58affd700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 0x7fb5740672e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb57c0041d0 tx=0x7fb57c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.123+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb580051770 con 0x7fb58c0602b0 2022-02-02T19:17:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:24 smithi159 ceph-mon[69013]: pgmap v1658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:25.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.354+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb56c005e80 con 0x7fb58c0602b0 2022-02-02T19:17:25.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.355+0000 7fb573fff700 1 -- 172.21.15.96:0/2130685300 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb580054d90 con 0x7fb58c0602b0 2022-02-02T19:17:25.360 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:17:25.361 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:17:25.361 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:17:25.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:25.361 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:17:25.362 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:17:25.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:25.362 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:17:25.362 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:17:25.363 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:25.363 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:17:25.363 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:17:25.363 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:25.363 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:17:25.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:17:25.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:17:25.364 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:17:25.364 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:17:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 msgr2=0x7fb5740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 0x7fb5740672e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb57c0041d0 tx=0x7fb57c009040).stop 2022-02-02T19:17:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 msgr2=0x7fb58c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fb580009990 tx=0x7fb580009b30).stop 2022-02-02T19:17:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 shutdown_connections 2022-02-02T19:17:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb574064e20 0x7fb5740672e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb58c0602b0 0x7fb58c106d40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 --2- 172.21.15.96:0/2130685300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58c0f9650 0x7fb58c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 >> 172.21.15.96:0/2130685300 conn(0x7fb58c0f0ad0 msgr2=0x7fb58c0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 shutdown_connections 2022-02-02T19:17:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.357+0000 7fb590df2700 1 -- 172.21.15.96:0/2130685300 wait complete. 2022-02-02T19:17:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 -- 172.21.15.96:0/945510809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 msgr2=0x7f3e940f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 --2- 172.21.15.96:0/945510809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e940f7a20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f3e84004660 tx=0x7f3e84009b30).stop 2022-02-02T19:17:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 -- 172.21.15.96:0/945510809 shutdown_connections 2022-02-02T19:17:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 --2- 172.21.15.96:0/945510809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e940f7a20 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 --2- 172.21.15.96:0/945510809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 0x7f3e940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 -- 172.21.15.96:0/945510809 >> 172.21.15.96:0/945510809 conn(0x7f3e940f1f00 msgr2=0x7f3e940f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:25.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.455+0000 7f3e98816700 1 -- 172.21.15.96:0/945510809 shutdown_connections 2022-02-02T19:17:25.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 -- 172.21.15.96:0/945510809 wait complete. 2022-02-02T19:17:25.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 Processor -- start 2022-02-02T19:17:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 -- start start 2022-02-02T19:17:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 0x7f3e94106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94107a10 con 0x7f3e940f6ff0 2022-02-02T19:17:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e98816700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94107b50 con 0x7f3e940f66e0 2022-02-02T19:17:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e91d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e91d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58910/0 (socket says 172.21.15.96:58910) 2022-02-02T19:17:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.456+0000 7f3e91d9b700 1 -- 172.21.15.96:0/4069174461 learned_addr learned my addr 172.21.15.96:0/4069174461 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e9259c700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 0x7f3e94106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e91d9b700 1 -- 172.21.15.96:0/4069174461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 msgr2=0x7f3e94106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e91d9b700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 0x7f3e94106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e91d9b700 1 -- 172.21.15.96:0/4069174461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84005040 con 0x7f3e940f6ff0 2022-02-02T19:17:25.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e91d9b700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f3e84009990 tx=0x7f3e84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e84018070 con 0x7f3e940f6ff0 2022-02-02T19:17:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e94108490 con 0x7f3e940f6ff0 2022-02-02T19:17:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e84007ba0 con 0x7f3e940f6ff0 2022-02-02T19:17:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8401c3c0 con 0x7f3e940f6ff0 2022-02-02T19:17:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.457+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e941089f0 con 0x7f3e940f6ff0 2022-02-02T19:17:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.458+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94045ad0 con 0x7f3e940f6ff0 2022-02-02T19:17:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.459+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e8401d420 con 0x7f3e940f6ff0 2022-02-02T19:17:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.460+0000 7f3e82ffd700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 0x7f3e7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.460+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e84083980 con 0x7f3e940f6ff0 2022-02-02T19:17:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.460+0000 7f3e9259c700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 0x7f3e7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.460+0000 7f3e9259c700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 0x7f3e7c067290 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f3e88004c40 tx=0x7f3e8800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.463+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e84055460 con 0x7f3e940f6ff0 2022-02-02T19:17:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.662+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3e94027a00 con 0x7f3e940f6ff0 2022-02-02T19:17:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.662+0000 7f3e82ffd700 1 -- 172.21.15.96:0/4069174461 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3e84055050 con 0x7f3e940f6ff0 2022-02-02T19:17:25.668 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:17:25.668 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:17:25.668 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:17:25.669 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:17:25.669 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:25.669 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:17:25.669 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:17:25.670 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:17:25.670 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:17:25.670 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:17:25.670 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:17:25.670 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:17:25.671 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:17:25.671 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:17:25.671 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:17:25.671 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:17:25.672 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:17:25.672 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:17:25.672 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:17:25.672 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:17:25.672 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:17:25.673 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:17:25.673 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:17:25.673 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:17:25.673 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:17:25.674 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:17:25.674 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:17:25.674 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:17:25.674 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:17:25.675 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:17:25.675 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:17:25.675 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:17:25.675 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:25.675 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:25.676 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:17:25.676 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:25.676 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:25.676 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:25.676 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 msgr2=0x7f3e7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 0x7f3e7c067290 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f3e88004c40 tx=0x7f3e8800b040).stop 2022-02-02T19:17:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 msgr2=0x7f3e94107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f3e84009990 tx=0x7f3e84009b30).stop 2022-02-02T19:17:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 shutdown_connections 2022-02-02T19:17:25.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e7c064dd0 0x7f3e7c067290 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e940f66e0 0x7f3e94106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 --2- 172.21.15.96:0/4069174461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e940f6ff0 0x7f3e94107460 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:25.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 >> 172.21.15.96:0/4069174461 conn(0x7f3e940f1f00 msgr2=0x7f3e940fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 shutdown_connections 2022-02-02T19:17:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:25.664+0000 7f3e98816700 1 -- 172.21.15.96:0/4069174461 wait complete. 2022-02-02T19:17:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:17:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:25 smithi159 ceph-mon[69013]: from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2130685300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:17:26.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4069174461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:17:26.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:25 smithi096 ceph-mon[101353]: from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:26.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2130685300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:17:26.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4069174461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:17:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:26 smithi159 ceph-mon[69013]: from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:26 smithi159 ceph-mon[69013]: pgmap v1659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:27.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:26 smithi096 ceph-mon[101353]: from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:27.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:26 smithi096 ceph-mon[101353]: pgmap v1659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:17:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:17:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:17:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:17:29.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:28 smithi159 ceph-mon[69013]: pgmap v1660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:28 smithi096 ceph-mon[101353]: pgmap v1660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:31.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:30 smithi159 ceph-mon[69013]: pgmap v1661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:30 smithi096 ceph-mon[101353]: pgmap v1661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:32 smithi096 ceph-mon[101353]: pgmap v1662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:32 smithi159 ceph-mon[69013]: pgmap v1662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:34 smithi159 ceph-mon[69013]: pgmap v1663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:34 smithi096 ceph-mon[101353]: pgmap v1663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:36 smithi096 ceph-mon[101353]: pgmap v1664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:36 smithi159 ceph-mon[69013]: pgmap v1664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:38 smithi159 ceph-mon[69013]: pgmap v1665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:38 smithi096 ceph-mon[101353]: pgmap v1665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:41.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:40 smithi159 ceph-mon[69013]: pgmap v1666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:40 smithi096 ceph-mon[101353]: pgmap v1666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:42 smithi096 ceph-mon[101353]: pgmap v1667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:43.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:42 smithi159 ceph-mon[69013]: pgmap v1667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:45.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:44 smithi159 ceph-mon[69013]: pgmap v1668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:44 smithi096 ceph-mon[101353]: pgmap v1668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:47.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:46 smithi096 ceph-mon[101353]: pgmap v1669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:46 smithi159 ceph-mon[69013]: pgmap v1669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:49.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:48 smithi159 ceph-mon[69013]: pgmap v1670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:48 smithi096 ceph-mon[101353]: pgmap v1670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:50 smithi159 ceph-mon[69013]: pgmap v1671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:51.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:50 smithi096 ceph-mon[101353]: pgmap v1671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:52 smithi096 ceph-mon[101353]: pgmap v1672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:52 smithi159 ceph-mon[69013]: pgmap v1672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:55.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:54 smithi159 ceph-mon[69013]: pgmap v1673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:54 smithi096 ceph-mon[101353]: pgmap v1673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:55.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.775+0000 7eff2f4ea700 1 -- 172.21.15.96:0/4190231848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 msgr2=0x7eff280f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:55.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.775+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/4190231848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff280f6b30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7eff18004660 tx=0x7eff18009b30).stop 2022-02-02T19:17:55.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 -- 172.21.15.96:0/4190231848 shutdown_connections 2022-02-02T19:17:55.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/4190231848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff280f6b30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/4190231848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 0x7eff280f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 -- 172.21.15.96:0/4190231848 >> 172.21.15.96:0/4190231848 conn(0x7eff280f0b90 msgr2=0x7eff280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:55.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 -- 172.21.15.96:0/4190231848 shutdown_connections 2022-02-02T19:17:55.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 -- 172.21.15.96:0/4190231848 wait complete. 2022-02-02T19:17:55.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.776+0000 7eff2f4ea700 1 Processor -- start 2022-02-02T19:17:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2f4ea700 1 -- start start 2022-02-02T19:17:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2f4ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 0x7eff28104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2f4ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2f4ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281055e0 con 0x7eff280f66d0 2022-02-02T19:17:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2f4ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28105720 con 0x7eff280f5430 2022-02-02T19:17:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58926/0 (socket says 172.21.15.96:58926) 2022-02-02T19:17:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 -- 172.21.15.96:0/624256834 learned_addr learned my addr 172.21.15.96:0/624256834 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2e4e8700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 0x7eff28104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 -- 172.21.15.96:0/624256834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 msgr2=0x7eff28104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 0x7eff28104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 -- 172.21.15.96:0/624256834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18005040 con 0x7eff280f66d0 2022-02-02T19:17:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.777+0000 7eff2dce7700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7eff18009990 tx=0x7eff18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.778+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff18018070 con 0x7eff280f66d0 2022-02-02T19:17:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.778+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff18007ba0 con 0x7eff280f66d0 2022-02-02T19:17:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.778+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff28106030 con 0x7eff280f66d0 2022-02-02T19:17:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.778+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1801c620 con 0x7eff280f66d0 2022-02-02T19:17:55.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.778+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28106590 con 0x7eff280f66d0 2022-02-02T19:17:55.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.779+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28045ad0 con 0x7eff280f66d0 2022-02-02T19:17:55.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.779+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff1801c8e0 con 0x7eff280f66d0 2022-02-02T19:17:55.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.779+0000 7eff1effd700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 0x7eff140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.779+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7eff180838e0 con 0x7eff280f66d0 2022-02-02T19:17:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.780+0000 7eff2e4e8700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 0x7eff140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.780+0000 7eff2e4e8700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 0x7eff140672e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7eff28104880 tx=0x7eff24009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:55.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.784+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff18051990 con 0x7eff280f66d0 2022-02-02T19:17:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.963+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff280fa910 con 0x7eff14064e20 2022-02-02T19:17:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.964+0000 7eff1effd700 1 -- 172.21.15.96:0/624256834 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7eff280fa910 con 0x7eff14064e20 2022-02-02T19:17:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 msgr2=0x7eff140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 0x7eff140672e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7eff28104880 tx=0x7eff24009040).stop 2022-02-02T19:17:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 msgr2=0x7eff28104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:55.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7eff18009990 tx=0x7eff18009b30).stop 2022-02-02T19:17:55.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 shutdown_connections 2022-02-02T19:17:55.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff14064e20 0x7eff140672e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280f5430 0x7eff28104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 --2- 172.21.15.96:0/624256834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff280f66d0 0x7eff28104fe0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 >> 172.21.15.96:0/624256834 conn(0x7eff280f0b90 msgr2=0x7eff2805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 shutdown_connections 2022-02-02T19:17:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:55.966+0000 7eff2f4ea700 1 -- 172.21.15.96:0/624256834 wait complete. 2022-02-02T19:17:55.980 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:17:56.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 -- 172.21.15.96:0/1095902035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f77d0 msgr2=0x7f28240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 --2- 172.21.15.96:0/1095902035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f77d0 0x7f28240f7c30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f2814004660 tx=0x7f2814009b30).stop 2022-02-02T19:17:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 -- 172.21.15.96:0/1095902035 shutdown_connections 2022-02-02T19:17:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 --2- 172.21.15.96:0/1095902035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f77d0 0x7f28240f7c30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 --2- 172.21.15.96:0/1095902035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f6530 0x7f28240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.063+0000 7f28295b9700 1 -- 172.21.15.96:0/1095902035 >> 172.21.15.96:0/1095902035 conn(0x7f28240f1c90 msgr2=0x7f28240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 -- 172.21.15.96:0/1095902035 shutdown_connections 2022-02-02T19:17:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 -- 172.21.15.96:0/1095902035 wait complete. 2022-02-02T19:17:56.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 Processor -- start 2022-02-02T19:17:56.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 -- start start 2022-02-02T19:17:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 0x7f2824069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282406a380 con 0x7f28240f6530 2022-02-02T19:17:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.064+0000 7f28295b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282406a4c0 con 0x7f28240f77d0 2022-02-02T19:17:56.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58934/0 (socket says 172.21.15.96:58934) 2022-02-02T19:17:56.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 -- 172.21.15.96:0/1279449090 learned_addr learned my addr 172.21.15.96:0/1279449090 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:56.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f28237fe700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 0x7f2824069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 -- 172.21.15.96:0/1279449090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 msgr2=0x7f2824069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 0x7f2824069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 -- 172.21.15.96:0/1279449090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814005040 con 0x7f28240f6530 2022-02-02T19:17:56.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f28237fe700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 0x7f2824069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:17:56.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2823fff700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f280c002700 tx=0x7f280c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c009320 con 0x7f28240f6530 2022-02-02T19:17:56.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f280c00f040 con 0x7f28240f6530 2022-02-02T19:17:56.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c0148e0 con 0x7f28240f6530 2022-02-02T19:17:56.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282406a7a0 con 0x7f28240f6530 2022-02-02T19:17:56.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.065+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282410ed00 con 0x7f28240f6530 2022-02-02T19:17:56.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.066+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824045ad0 con 0x7f28240f6530 2022-02-02T19:17:56.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.067+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f280c009480 con 0x7f28240f6530 2022-02-02T19:17:56.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.067+0000 7f2820ff9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 0x7f28100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.067+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f280c081de0 con 0x7f28240f6530 2022-02-02T19:17:56.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.067+0000 7f28237fe700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 0x7f28100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.068+0000 7f28237fe700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 0x7f28100672e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f2814009da0 tx=0x7f2814009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.072+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f280c04fe90 con 0x7f28240f6530 2022-02-02T19:17:56.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.244+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28240fee30 con 0x7f2810064e20 2022-02-02T19:17:56.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.254+0000 7f2820ff9700 1 -- 172.21.15.96:0/1279449090 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f28240fee30 con 0x7f2810064e20 2022-02-02T19:17:56.258 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:17:56.258 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (61m) 31m ago 62m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:17:56.258 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (53m) 31m ago 62m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:17:56.259 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (53m) 30m ago 61m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:17:56.259 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (61m) 31m ago 62m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:17:56.259 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (58m) 31m ago 58m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:17:56.259 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (54m) 31m ago 58m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:17:56.259 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (58m) 30m ago 58m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:17:56.260 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (54m) 30m ago 58m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:17:56.260 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (55m) 31m ago 63m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:17:56.260 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (55m) 30m ago 61m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:17:56.260 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (54m) 31m ago 63m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:17:56.261 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (54m) 30m ago 61m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:17:56.261 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (62m) 31m ago 62m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:17:56.261 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (61m) 30m ago 61m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:17:56.261 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (53m) 31m ago 61m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:17:56.261 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (52m) 31m ago 60m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:17:56.262 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (52m) 31m ago 60m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:17:56.262 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (51m) 30m ago 60m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:17:56.262 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (51m) 30m ago 60m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:17:56.262 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (50m) 30m ago 59m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:17:56.263 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (61m) 31m ago 61m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:17:56.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 msgr2=0x7f28100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 0x7f28100672e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f2814009da0 tx=0x7f2814009b30).stop 2022-02-02T19:17:56.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 msgr2=0x7f282406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f280c002700 tx=0x7f280c009e00).stop 2022-02-02T19:17:56.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 shutdown_connections 2022-02-02T19:17:56.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2810064e20 0x7f28100672e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28240f6530 0x7f282406b9a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 --2- 172.21.15.96:0/1279449090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28240f77d0 0x7f2824069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 >> 172.21.15.96:0/1279449090 conn(0x7f28240f1c90 msgr2=0x7f28240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 shutdown_connections 2022-02-02T19:17:56.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.256+0000 7f28295b9700 1 -- 172.21.15.96:0/1279449090 wait complete. 2022-02-02T19:17:56.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 -- 172.21.15.96:0/1680971224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 msgr2=0x7ffaec0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 --2- 172.21.15.96:0/1680971224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec0f6b40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7ffae0004660 tx=0x7ffae0009b30).stop 2022-02-02T19:17:56.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 -- 172.21.15.96:0/1680971224 shutdown_connections 2022-02-02T19:17:56.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 --2- 172.21.15.96:0/1680971224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec0f6b40 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 --2- 172.21.15.96:0/1680971224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 0x7ffaec0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 -- 172.21.15.96:0/1680971224 >> 172.21.15.96:0/1680971224 conn(0x7ffaec0f0ba0 msgr2=0x7ffaec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 -- 172.21.15.96:0/1680971224 shutdown_connections 2022-02-02T19:17:56.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 -- 172.21.15.96:0/1680971224 wait complete. 2022-02-02T19:17:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.353+0000 7ffaf1350700 1 Processor -- start 2022-02-02T19:17:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaf1350700 1 -- start start 2022-02-02T19:17:56.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaf1350700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 0x7ffaec106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaf1350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaf1350700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec107880 con 0x7ffaec0f66e0 2022-02-02T19:17:56.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaf1350700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec108090 con 0x7ffaec0f5440 2022-02-02T19:17:56.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58946/0 (socket says 172.21.15.96:58946) 2022-02-02T19:17:56.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 -- 172.21.15.96:0/3904999932 learned_addr learned my addr 172.21.15.96:0/3904999932 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:56.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaebfff700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 0x7ffaec106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 -- 172.21.15.96:0/3904999932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 msgr2=0x7ffaec106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 0x7ffaec106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 -- 172.21.15.96:0/3904999932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0005040 con 0x7ffaec0f66e0 2022-02-02T19:17:56.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.354+0000 7ffaeb7fe700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ffae0009990 tx=0x7ffae0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.355+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae0018070 con 0x7ffaec0f66e0 2022-02-02T19:17:56.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.355+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec1082b0 con 0x7ffaec0f66e0 2022-02-02T19:17:56.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.355+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffae0007ba0 con 0x7ffaec0f66e0 2022-02-02T19:17:56.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.355+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae001c3c0 con 0x7ffaec0f66e0 2022-02-02T19:17:56.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.355+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec108810 con 0x7ffaec0f66e0 2022-02-02T19:17:56.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.356+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec059100 con 0x7ffaec0f66e0 2022-02-02T19:17:56.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.356+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffae001d420 con 0x7ffaec0f66e0 2022-02-02T19:17:56.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.356+0000 7ffae8ff9700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 0x7ffad40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.357+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffae00836f0 con 0x7ffaec0f66e0 2022-02-02T19:17:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.357+0000 7ffaebfff700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 0x7ffad40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.357+0000 7ffaebfff700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 0x7ffad40672e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ffaec106b00 tx=0x7ffadc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.361+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffae0051860 con 0x7ffaec0f66e0 2022-02-02T19:17:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.591+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffaec10d2d0 con 0x7ffaec0f66e0 2022-02-02T19:17:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.592+0000 7ffae8ff9700 1 -- 172.21.15.96:0/3904999932 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ffae0054e80 con 0x7ffaec0f66e0 2022-02-02T19:17:56.597 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:17:56.597 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:17:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:17:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:17:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:17:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:17:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:17:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:17:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:17:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:17:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:17:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:17:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:17:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:17:56.604 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:17:56.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 msgr2=0x7ffad40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 0x7ffad40672e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ffaec106b00 tx=0x7ffadc00b040).stop 2022-02-02T19:17:56.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 msgr2=0x7ffaec107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ffae0009990 tx=0x7ffae0009b30).stop 2022-02-02T19:17:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 shutdown_connections 2022-02-02T19:17:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffad4064e20 0x7ffad40672e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaec0f5440 0x7ffaec106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 --2- 172.21.15.96:0/3904999932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaec0f66e0 0x7ffaec107280 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 >> 172.21.15.96:0/3904999932 conn(0x7ffaec0f0ba0 msgr2=0x7ffaec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 shutdown_connections 2022-02-02T19:17:56.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.594+0000 7ffaf1350700 1 -- 172.21.15.96:0/3904999932 wait complete. 2022-02-02T19:17:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 -- 172.21.15.96:0/301318877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f6c60 msgr2=0x7f73340f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 --2- 172.21.15.96:0/301318877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f6c60 0x7f73340f7080 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f731c004660 tx=0x7f731c009b30).stop 2022-02-02T19:17:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 -- 172.21.15.96:0/301318877 shutdown_connections 2022-02-02T19:17:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 --2- 172.21.15.96:0/301318877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f5970 0x7f73340f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 --2- 172.21.15.96:0/301318877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f6c60 0x7f73340f7080 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 -- 172.21.15.96:0/301318877 >> 172.21.15.96:0/301318877 conn(0x7f73340f04c0 msgr2=0x7f73340f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 -- 172.21.15.96:0/301318877 shutdown_connections 2022-02-02T19:17:56.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 -- 172.21.15.96:0/301318877 wait complete. 2022-02-02T19:17:56.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.694+0000 7f733a259700 1 Processor -- start 2022-02-02T19:17:56.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f733a259700 1 -- start start 2022-02-02T19:17:56.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f733a259700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f733a259700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f6c60 0x7f733410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f733a259700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340f5660 con 0x7f73340f5970 2022-02-02T19:17:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f733a259700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340f57a0 con 0x7f73340f6c60 2022-02-02T19:17:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58954/0 (socket says 172.21.15.96:58954) 2022-02-02T19:17:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 -- 172.21.15.96:0/3447567370 learned_addr learned my addr 172.21.15.96:0/3447567370 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:17:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f7332ffd700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f6c60 0x7f733410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 -- 172.21.15.96:0/3447567370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f6c60 msgr2=0x7f733410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f6c60 0x7f733410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.695+0000 7f73337fe700 1 -- 172.21.15.96:0/3447567370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c005040 con 0x7f73340f5970 2022-02-02T19:17:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f73337fe700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f731c009990 tx=0x7f731c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f731c018070 con 0x7f73340f5970 2022-02-02T19:17:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733410c720 con 0x7f73340f5970 2022-02-02T19:17:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f731c007ba0 con 0x7f73340f5970 2022-02-02T19:17:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733410cc50 con 0x7f73340f5970 2022-02-02T19:17:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.696+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f731c01de50 con 0x7f73340f5970 2022-02-02T19:17:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.697+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318004fa0 con 0x7f73340f5970 2022-02-02T19:17:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.697+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f731c01d420 con 0x7f73340f5970 2022-02-02T19:17:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.698+0000 7f732bfff700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 0x7f7320067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:17:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.698+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f731c083640 con 0x7f73340f5970 2022-02-02T19:17:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.698+0000 7f7332ffd700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 0x7f7320067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:17:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.698+0000 7f7332ffd700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 0x7f7320067290 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f7324004c40 tx=0x7f732400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:17:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.703+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f731c0517b0 con 0x7f73340f5970 2022-02-02T19:17:56.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.903+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7318005e80 con 0x7f73340f5970 2022-02-02T19:17:56.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.903+0000 7f732bfff700 1 -- 172.21.15.96:0/3447567370 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f731c054dd0 con 0x7f73340f5970 2022-02-02T19:17:56.908 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:17:56.908 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:17:56.909 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:17:56.909 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:17:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:56.909 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:17:56.910 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:17:56.910 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:17:56.910 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:17:56.910 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:17:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:17:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:17:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:17:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:17:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:17:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:17:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:17:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:17:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:17:56.913 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:17:56.913 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:17:56.913 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:17:56.913 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:17:56.914 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:17:56.914 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:17:56.914 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:17:56.914 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:17:56.914 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:17:56.915 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:17:56.915 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:17:56.915 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:17:56.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:17:56.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:56.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:56.916 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:17:56.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:17:56.917 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:56.917 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:56.917 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:17:56.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 msgr2=0x7f7320067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 0x7f7320067290 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f7324004c40 tx=0x7f732400b040).stop 2022-02-02T19:17:56.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 msgr2=0x7f7334109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:17:56.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f731c009990 tx=0x7f731c009b30).stop 2022-02-02T19:17:56.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 shutdown_connections 2022-02-02T19:17:56.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7320064dd0 0x7f7320067290 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73340f5970 0x7f7334109c70 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 --2- 172.21.15.96:0/3447567370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73340f6c60 0x7f733410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:17:56.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 >> 172.21.15.96:0/3447567370 conn(0x7f73340f04c0 msgr2=0x7f73340fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:17:56.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 shutdown_connections 2022-02-02T19:17:56.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:17:56.905+0000 7f733a259700 1 -- 172.21.15.96:0/3447567370 wait complete. 2022-02-02T19:17:56.921 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:17:57.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:56 smithi096 ceph-mon[101353]: pgmap v1674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:57.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3904999932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:17:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:56 smithi159 ceph-mon[69013]: pgmap v1674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3904999932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:17:58.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:57 smithi096 ceph-mon[101353]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:58.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:57 smithi096 ceph-mon[101353]: from='client.35838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:58.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3447567370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:17:58.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:57 smithi159 ceph-mon[69013]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:58.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:57 smithi159 ceph-mon[69013]: from='client.35838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:17:58.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3447567370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:17:59.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:17:58 smithi159 ceph-mon[69013]: pgmap v1675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:17:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:17:58 smithi096 ceph-mon[101353]: pgmap v1675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:00 smithi159 ceph-mon[69013]: pgmap v1676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:00 smithi096 ceph-mon[101353]: pgmap v1676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:02 smithi096 ceph-mon[101353]: pgmap v1677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:03.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:02 smithi159 ceph-mon[69013]: pgmap v1677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:04 smithi159 ceph-mon[69013]: pgmap v1678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:04 smithi096 ceph-mon[101353]: pgmap v1678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:07.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:06 smithi096 ceph-mon[101353]: pgmap v1679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:06 smithi159 ceph-mon[69013]: pgmap v1679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:09.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:08 smithi159 ceph-mon[69013]: pgmap v1680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:09.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:08 smithi096 ceph-mon[101353]: pgmap v1680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:10 smithi159 ceph-mon[69013]: pgmap v1681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:10 smithi096 ceph-mon[101353]: pgmap v1681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:12 smithi096 ceph-mon[101353]: pgmap v1682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:13.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:12 smithi159 ceph-mon[69013]: pgmap v1682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:14 smithi159 ceph-mon[69013]: pgmap v1683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:14 smithi096 ceph-mon[101353]: pgmap v1683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:17.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:16 smithi096 ceph-mon[101353]: pgmap v1684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:16 smithi159 ceph-mon[69013]: pgmap v1684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:19.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:18 smithi159 ceph-mon[69013]: pgmap v1685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:18 smithi096 ceph-mon[101353]: pgmap v1685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:21.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:20 smithi159 ceph-mon[69013]: pgmap v1686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:20 smithi096 ceph-mon[101353]: pgmap v1686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:22 smithi096 ceph-mon[101353]: pgmap v1687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:22 smithi159 ceph-mon[69013]: pgmap v1687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:24 smithi159 ceph-mon[69013]: pgmap v1688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:24 smithi096 ceph-mon[101353]: pgmap v1688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 -- 172.21.15.96:0/3588181419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f55c0 msgr2=0x7ffa3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3588181419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c0f59e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7ffa2c004660 tx=0x7ffa2c009b30).stop 2022-02-02T19:18:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 -- 172.21.15.96:0/3588181419 shutdown_connections 2022-02-02T19:18:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3588181419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:18:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3588181419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c0f59e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 -- 172.21.15.96:0/3588181419 >> 172.21.15.96:0/3588181419 conn(0x7ffa3c0f0d40 msgr2=0x7ffa3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 -- 172.21.15.96:0/3588181419 shutdown_connections 2022-02-02T19:18:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.012+0000 7ffa428e3700 1 -- 172.21.15.96:0/3588181419 wait complete. 2022-02-02T19:18:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.013+0000 7ffa428e3700 1 Processor -- start 2022-02-02T19:18:27.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.013+0000 7ffa428e3700 1 -- start start 2022-02-02T19:18:27.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c1069f0 con 0x7ffa3c0f6860 2022-02-02T19:18:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c1072a0 con 0x7ffa3c0f55c0 2022-02-02T19:18:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58976/0 (socket says 172.21.15.96:58976) 2022-02-02T19:18:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 -- 172.21.15.96:0/3621765271 learned_addr learned my addr 172.21.15.96:0/3621765271 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3bfff700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 -- 172.21.15.96:0/3621765271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f55c0 msgr2=0x7ffa3c105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 -- 172.21.15.96:0/3621765271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c005040 con 0x7ffa3c0f6860 2022-02-02T19:18:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa3b7fe700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7ffa3000b410 tx=0x7ffa30006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa300125f0 con 0x7ffa3c0f6860 2022-02-02T19:18:27.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c107580 con 0x7ffa3c0f6860 2022-02-02T19:18:27.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa30012c00 con 0x7ffa3c0f6860 2022-02-02T19:18:27.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa30002ae0 con 0x7ffa3c0f6860 2022-02-02T19:18:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.014+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c107b40 con 0x7ffa3c0f6860 2022-02-02T19:18:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.015+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c0f49b0 con 0x7ffa3c0f6860 2022-02-02T19:18:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.016+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa3000f030 con 0x7ffa3c0f6860 2022-02-02T19:18:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.016+0000 7ffa38ff9700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 0x7ffa24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.016+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffa30081f60 con 0x7ffa3c0f6860 2022-02-02T19:18:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.016+0000 7ffa3bfff700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 0x7ffa24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.017+0000 7ffa3bfff700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 0x7ffa24067290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7ffa2c004e30 tx=0x7ffa2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.021+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa300b07d0 con 0x7ffa3c0f6860 2022-02-02T19:18:27.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.203+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa3c0fdee0 con 0x7ffa24064dd0 2022-02-02T19:18:27.208 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:26 smithi096 ceph-mon[101353]: pgmap v1689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:27.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.204+0000 7ffa38ff9700 1 -- 172.21.15.96:0/3621765271 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffa3c0fdee0 con 0x7ffa24064dd0 2022-02-02T19:18:27.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 msgr2=0x7ffa24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 0x7ffa24067290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7ffa2c004e30 tx=0x7ffa2c009b30).stop 2022-02-02T19:18:27.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 msgr2=0x7ffa3c1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7ffa3000b410 tx=0x7ffa30006ef0).stop 2022-02-02T19:18:27.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 shutdown_connections 2022-02-02T19:18:27.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa24064dd0 0x7ffa24067290 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c0f55c0 0x7ffa3c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 --2- 172.21.15.96:0/3621765271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa3c0f6860 0x7ffa3c1063b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 >> 172.21.15.96:0/3621765271 conn(0x7ffa3c0f0d40 msgr2=0x7ffa3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:27.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 shutdown_connections 2022-02-02T19:18:27.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.206+0000 7ffa428e3700 1 -- 172.21.15.96:0/3621765271 wait complete. 2022-02-02T19:18:27.220 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:18:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:26 smithi159 ceph-mon[69013]: pgmap v1689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 -- 172.21.15.96:0/2144621096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 msgr2=0x7f07f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 --2- 172.21.15.96:0/2144621096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f40f7c30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f07e8004660 tx=0x7f07e8009b30).stop 2022-02-02T19:18:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 -- 172.21.15.96:0/2144621096 shutdown_connections 2022-02-02T19:18:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 --2- 172.21.15.96:0/2144621096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f40f7c30 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 --2- 172.21.15.96:0/2144621096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 0x7f07f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 -- 172.21.15.96:0/2144621096 >> 172.21.15.96:0/2144621096 conn(0x7f07f40f1c90 msgr2=0x7f07f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 -- 172.21.15.96:0/2144621096 shutdown_connections 2022-02-02T19:18:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.303+0000 7f07f9718700 1 -- 172.21.15.96:0/2144621096 wait complete. 2022-02-02T19:18:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 Processor -- start 2022-02-02T19:18:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 -- start start 2022-02-02T19:18:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 0x7f07f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f406a380 con 0x7f07f40f77d0 2022-02-02T19:18:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f9718700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f406a4c0 con 0x7f07f40f6530 2022-02-02T19:18:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58986/0 (socket says 172.21.15.96:58986) 2022-02-02T19:18:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.304+0000 7f07f37fe700 1 -- 172.21.15.96:0/1922567934 learned_addr learned my addr 172.21.15.96:0/1922567934 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f3fff700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 0x7f07f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f37fe700 1 -- 172.21.15.96:0/1922567934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 msgr2=0x7f07f406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f37fe700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 0x7f07f406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f37fe700 1 -- 172.21.15.96:0/1922567934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8005040 con 0x7f07f40f77d0 2022-02-02T19:18:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f37fe700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f07e8009990 tx=0x7f07e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e8018070 con 0x7f07f40f77d0 2022-02-02T19:18:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f07e8007ca0 con 0x7f07f40f77d0 2022-02-02T19:18:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e801c620 con 0x7f07f40f77d0 2022-02-02T19:18:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f406a740 con 0x7f07f40f77d0 2022-02-02T19:18:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.305+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f406ac50 con 0x7f07f40f77d0 2022-02-02T19:18:27.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.306+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f4045ad0 con 0x7f07f40f77d0 2022-02-02T19:18:27.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.307+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f07e801d960 con 0x7f07f40f77d0 2022-02-02T19:18:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.307+0000 7f07f0ff9700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 0x7f07dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.307+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f07e8083830 con 0x7f07f40f77d0 2022-02-02T19:18:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.307+0000 7f07f3fff700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 0x7f07dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.307+0000 7f07f3fff700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 0x7f07dc0672e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f07f406b730 tx=0x7f07e4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.311+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f07e80519a0 con 0x7f07f40f77d0 2022-02-02T19:18:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.483+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f40fee60 con 0x7f07dc064e20 2022-02-02T19:18:27.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.492+0000 7f07f0ff9700 1 -- 172.21.15.96:0/1922567934 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f07f40fee60 con 0x7f07dc064e20 2022-02-02T19:18:27.497 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:18:27.497 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (61m) 32m ago 62m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:18:27.498 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (54m) 32m ago 62m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:18:27.498 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (54m) 30m ago 62m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:18:27.499 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (61m) 32m ago 62m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:18:27.499 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (58m) 32m ago 58m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:18:27.499 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (54m) 32m ago 59m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:18:27.500 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (58m) 30m ago 58m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:18:27.500 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (54m) 30m ago 59m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:18:27.500 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (56m) 32m ago 64m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:18:27.501 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (55m) 30m ago 62m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:18:27.501 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (55m) 32m ago 64m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:18:27.501 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (54m) 30m ago 62m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:18:27.501 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (62m) 32m ago 62m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:18:27.502 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (62m) 30m ago 62m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:18:27.502 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (53m) 32m ago 61m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:18:27.502 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (53m) 32m ago 61m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:18:27.502 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (52m) 32m ago 61m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:18:27.503 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (52m) 30m ago 60m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:18:27.503 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (51m) 30m ago 60m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:18:27.503 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (51m) 30m ago 60m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:18:27.503 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (61m) 32m ago 62m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:18:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.494+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 msgr2=0x7f07dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.494+0000 7f07f9718700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 0x7f07dc0672e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f07f406b730 tx=0x7f07e4009040).stop 2022-02-02T19:18:27.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.494+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 msgr2=0x7f07f4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.494+0000 7f07f9718700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f07e8009990 tx=0x7f07e8009b30).stop 2022-02-02T19:18:27.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 shutdown_connections 2022-02-02T19:18:27.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07dc064e20 0x7f07dc0672e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07f40f6530 0x7f07f406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 --2- 172.21.15.96:0/1922567934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07f40f77d0 0x7f07f4069e20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 >> 172.21.15.96:0/1922567934 conn(0x7f07f40f1c90 msgr2=0x7f07f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:27.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 shutdown_connections 2022-02-02T19:18:27.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.495+0000 7f07f9718700 1 -- 172.21.15.96:0/1922567934 wait complete. 2022-02-02T19:18:27.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 -- 172.21.15.96:0/3552890188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 msgr2=0x7f0d600f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 --2- 172.21.15.96:0/3552890188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d600f5200 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f0d54004660 tx=0x7f0d54009b30).stop 2022-02-02T19:18:27.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 -- 172.21.15.96:0/3552890188 shutdown_connections 2022-02-02T19:18:27.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 --2- 172.21.15.96:0/3552890188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 0x7f0d600f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 --2- 172.21.15.96:0/3552890188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d600f5200 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 -- 172.21.15.96:0/3552890188 >> 172.21.15.96:0/3552890188 conn(0x7f0d600f0540 msgr2=0x7f0d600f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:27.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 -- 172.21.15.96:0/3552890188 shutdown_connections 2022-02-02T19:18:27.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.591+0000 7f0d6838c700 1 -- 172.21.15.96:0/3552890188 wait complete. 2022-02-02T19:18:27.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 Processor -- start 2022-02-02T19:18:27.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 -- start start 2022-02-02T19:18:27.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 0x7f0d6010c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600f7fc0 con 0x7f0d600f4de0 2022-02-02T19:18:27.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d6838c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600f8100 con 0x7f0d600f5fe0 2022-02-02T19:18:27.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58994/0 (socket says 172.21.15.96:58994) 2022-02-02T19:18:27.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 -- 172.21.15.96:0/2587483483 learned_addr learned my addr 172.21.15.96:0/2587483483 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:27.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d65927700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 0x7f0d6010c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 -- 172.21.15.96:0/2587483483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 msgr2=0x7f0d6010c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:27.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 0x7f0d6010c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:27.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 -- 172.21.15.96:0/2587483483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54005040 con 0x7f0d600f4de0 2022-02-02T19:18:27.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d66128700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f0d54009990 tx=0x7f0d54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.592+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d54018070 con 0x7f0d600f4de0 2022-02-02T19:18:27.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.593+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d54007ca0 con 0x7f0d600f4de0 2022-02-02T19:18:27.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.593+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6010c6b0 con 0x7f0d600f4de0 2022-02-02T19:18:27.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.593+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d5401c620 con 0x7f0d600f4de0 2022-02-02T19:18:27.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.593+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6010cc10 con 0x7f0d600f4de0 2022-02-02T19:18:27.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.594+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60045ad0 con 0x7f0d600f4de0 2022-02-02T19:18:27.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.594+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d5401d960 con 0x7f0d600f4de0 2022-02-02T19:18:27.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.594+0000 7f0d52ffd700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 0x7f0d4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.594+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0d54083830 con 0x7f0d600f4de0 2022-02-02T19:18:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.594+0000 7f0d65927700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 0x7f0d4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.595+0000 7f0d65927700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 0x7f0d4c067290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0d5c0041d0 tx=0x7f0d5c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.599+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d540519a0 con 0x7f0d600f4de0 2022-02-02T19:18:27.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.829+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d600fd530 con 0x7f0d600f4de0 2022-02-02T19:18:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.829+0000 7f0d52ffd700 1 -- 172.21.15.96:0/2587483483 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0d54054fc0 con 0x7f0d600f4de0 2022-02-02T19:18:27.995 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:18:27.995 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:18:27.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:18:27.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:27.996 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:18:27.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:18:27.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:27.996 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:18:27.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:18:27.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:27.997 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:18:27.997 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:18:27.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:27.998 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:18:27.998 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:18:27.998 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:18:27.998 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:18:27.999 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:18:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 msgr2=0x7f0d4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 0x7f0d4c067290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0d5c0041d0 tx=0x7f0d5c009040).stop 2022-02-02T19:18:28.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 msgr2=0x7f0d60109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f0d54009990 tx=0x7f0d54009b30).stop 2022-02-02T19:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 shutdown_connections 2022-02-02T19:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d4c064dd0 0x7f0d4c067290 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d600f4de0 0x7f0d60109c60 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 --2- 172.21.15.96:0/2587483483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d600f5fe0 0x7f0d6010c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 >> 172.21.15.96:0/2587483483 conn(0x7f0d600f0540 msgr2=0x7f0d600fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 shutdown_connections 2022-02-02T19:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.831+0000 7f0d6838c700 1 -- 172.21.15.96:0/2587483483 wait complete. 2022-02-02T19:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 -- 172.21.15.96:0/182122696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f66d0 msgr2=0x7ffaf80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 --2- 172.21.15.96:0/182122696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f66d0 0x7ffaf80f6b30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ffae8004660 tx=0x7ffae8009b30).stop 2022-02-02T19:18:28.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 -- 172.21.15.96:0/182122696 shutdown_connections 2022-02-02T19:18:28.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 --2- 172.21.15.96:0/182122696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f66d0 0x7ffaf80f6b30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 --2- 172.21.15.96:0/182122696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f5430 0x7ffaf80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 -- 172.21.15.96:0/182122696 >> 172.21.15.96:0/182122696 conn(0x7ffaf80f0b90 msgr2=0x7ffaf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:28.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 -- 172.21.15.96:0/182122696 shutdown_connections 2022-02-02T19:18:28.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.928+0000 7ffafeacc700 1 -- 172.21.15.96:0/182122696 wait complete. 2022-02-02T19:18:28.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 Processor -- start 2022-02-02T19:18:28.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 -- start start 2022-02-02T19:18:28.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:28.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f66d0 0x7ffaf810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:28.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80603c0 con 0x7ffaf80f5430 2022-02-02T19:18:28.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafeacc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf8060500 con 0x7ffaf80f66d0 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59004/0 (socket says 172.21.15.96:59004) 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 -- 172.21.15.96:0/1362584326 learned_addr learned my addr 172.21.15.96:0/1362584326 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafd2c9700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f66d0 0x7ffaf810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 -- 172.21.15.96:0/1362584326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f66d0 msgr2=0x7ffaf810bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f66d0 0x7ffaf810bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.929+0000 7ffafdaca700 1 -- 172.21.15.96:0/1362584326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8005040 con 0x7ffaf80f5430 2022-02-02T19:18:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffafdaca700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ffaf400c530 tx=0x7ffaf4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf400f650 con 0x7ffaf80f5430 2022-02-02T19:18:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffaf400fc60 con 0x7ffaf80f5430 2022-02-02T19:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf810c4f0 con 0x7ffaf80f5430 2022-02-02T19:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4012cb0 con 0x7ffaf80f5430 2022-02-02T19:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.930+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf810ca80 con 0x7ffaf80f5430 2022-02-02T19:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.931+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf8059100 con 0x7ffaf80f5430 2022-02-02T19:18:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.931+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffaf4019030 con 0x7ffaf80f5430 2022-02-02T19:18:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.932+0000 7ffaee7fc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 0x7ffae40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.932+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffaf40816e0 con 0x7ffaf80f5430 2022-02-02T19:18:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.932+0000 7ffafd2c9700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 0x7ffae40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.932+0000 7ffafd2c9700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 0x7ffae40672e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7ffae8004630 tx=0x7ffae8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:27.936+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffaf404f7c0 con 0x7ffaf80f5430 2022-02-02T19:18:28.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.136+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffaf80fdcf0 con 0x7ffaf80f5430 2022-02-02T19:18:28.141 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:18:28.141 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:18:28.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.137+0000 7ffaee7fc700 1 -- 172.21.15.96:0/1362584326 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ffaf4052de0 con 0x7ffaf80f5430 2022-02-02T19:18:28.142 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:18:28.143 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:18:28.143 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:18:28.144 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:18:28.144 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:28.144 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:18:28.144 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:18:28.144 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:18:28.145 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:18:28.145 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:18:28.145 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:18:28.145 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:18:28.146 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:18:28.146 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:18:28.146 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:18:28.146 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:18:28.146 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:18:28.147 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:18:28.147 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:18:28.147 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:18:28.147 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:18:28.147 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:18:28.148 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:18:28.148 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:18:28.148 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:18:28.148 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:18:28.149 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:18:28.149 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:18:28.149 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:18:28.149 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:18:28.149 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:18:28.150 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:18:28.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:28.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:28.150 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:18:28.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:28.151 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:28.151 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:28.151 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:28.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.138+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 msgr2=0x7ffae40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.138+0000 7ffafeacc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 0x7ffae40672e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7ffae8004630 tx=0x7ffae8009b30).stop 2022-02-02T19:18:28.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 msgr2=0x7ffaf8109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:28.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ffaf400c530 tx=0x7ffaf4007e10).stop 2022-02-02T19:18:28.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 shutdown_connections 2022-02-02T19:18:28.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffae4064e20 0x7ffae40672e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffaf80f5430 0x7ffaf8109a40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 --2- 172.21.15.96:0/1362584326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaf80f66d0 0x7ffaf810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:28.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 >> 172.21.15.96:0/1362584326 conn(0x7ffaf80f0b90 msgr2=0x7ffaf80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:28.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 shutdown_connections 2022-02-02T19:18:28.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:28.139+0000 7ffafeacc700 1 -- 172.21.15.96:0/1362584326 wait complete. 2022-02-02T19:18:28.155 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:18:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:18:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:18:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:28 smithi159 ceph-mon[69013]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:18:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:28 smithi159 ceph-mon[69013]: from='client.35854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:18:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2587483483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:18:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:28 smithi159 ceph-mon[69013]: pgmap v1690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1362584326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:18:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:28 smithi096 ceph-mon[101353]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:18:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:28 smithi096 ceph-mon[101353]: from='client.35854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:18:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2587483483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:18:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:28 smithi096 ceph-mon[101353]: pgmap v1690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1362584326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:18:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:30 smithi159 ceph-mon[69013]: pgmap v1691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:30 smithi096 ceph-mon[101353]: pgmap v1691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:32 smithi096 ceph-mon[101353]: pgmap v1692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:33.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:32 smithi159 ceph-mon[69013]: pgmap v1692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:34 smithi159 ceph-mon[69013]: pgmap v1693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:34 smithi096 ceph-mon[101353]: pgmap v1693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:36 smithi159 ceph-mon[69013]: pgmap v1694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:36 smithi096 ceph-mon[101353]: pgmap v1694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:39.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:38 smithi159 ceph-mon[69013]: pgmap v1695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:39.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:38 smithi096 ceph-mon[101353]: pgmap v1695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:40 smithi159 ceph-mon[69013]: pgmap v1696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:40 smithi096 ceph-mon[101353]: pgmap v1696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:42 smithi096 ceph-mon[101353]: pgmap v1697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:43.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:42 smithi159 ceph-mon[69013]: pgmap v1697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:44 smithi159 ceph-mon[69013]: pgmap v1698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:44 smithi096 ceph-mon[101353]: pgmap v1698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:46 smithi159 ceph-mon[69013]: pgmap v1699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:46 smithi096 ceph-mon[101353]: pgmap v1699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:49.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:48 smithi159 ceph-mon[69013]: pgmap v1700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:48 smithi096 ceph-mon[101353]: pgmap v1700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:50 smithi159 ceph-mon[69013]: pgmap v1701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:51.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:50 smithi096 ceph-mon[101353]: pgmap v1701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:53.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:52 smithi096 ceph-mon[101353]: pgmap v1702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:52 smithi159 ceph-mon[69013]: pgmap v1702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:54 smithi159 ceph-mon[69013]: pgmap v1703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:54 smithi096 ceph-mon[101353]: pgmap v1703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:57.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:56 smithi159 ceph-mon[69013]: pgmap v1704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:56 smithi096 ceph-mon[101353]: pgmap v1704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 -- 172.21.15.96:0/2175990253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 msgr2=0x7f0a880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/2175990253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a880f7de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f0a78004660 tx=0x7f0a78009b30).stop 2022-02-02T19:18:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 -- 172.21.15.96:0/2175990253 shutdown_connections 2022-02-02T19:18:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/2175990253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a880f7de0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/2175990253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 0x7f0a880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:18:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 -- 172.21.15.96:0/2175990253 >> 172.21.15.96:0/2175990253 conn(0x7f0a880f1e40 msgr2=0x7f0a880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 -- 172.21.15.96:0/2175990253 shutdown_connections 2022-02-02T19:18:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.249+0000 7f0a8caf0700 1 -- 172.21.15.96:0/2175990253 wait complete. 2022-02-02T19:18:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 Processor -- start 2022-02-02T19:18:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 -- start start 2022-02-02T19:18:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 0x7f0a88106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88107ae0 con 0x7f0a880f7980 2022-02-02T19:18:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8caf0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88108390 con 0x7f0a880f66e0 2022-02-02T19:18:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a85d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a85d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59024/0 (socket says 172.21.15.96:59024) 2022-02-02T19:18:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a85d9b700 1 -- 172.21.15.96:0/1455317325 learned_addr learned my addr 172.21.15.96:0/1455317325 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.250+0000 7f0a8659c700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 0x7f0a88106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a85d9b700 1 -- 172.21.15.96:0/1455317325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 msgr2=0x7f0a88106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a85d9b700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 0x7f0a88106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a85d9b700 1 -- 172.21.15.96:0/1455317325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78005040 con 0x7f0a880f7980 2022-02-02T19:18:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a85d9b700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f0a78009990 tx=0x7f0a78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a78018070 con 0x7f0a880f7980 2022-02-02T19:18:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a88108610 con 0x7f0a880f7980 2022-02-02T19:18:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a78007ba0 con 0x7f0a880f7980 2022-02-02T19:18:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7801c620 con 0x7f0a880f7980 2022-02-02T19:18:58.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.251+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a88108b70 con 0x7f0a880f7980 2022-02-02T19:18:58.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.252+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a880f5ad0 con 0x7f0a880f7980 2022-02-02T19:18:58.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.253+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a7801c8e0 con 0x7f0a880f7980 2022-02-02T19:18:58.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.253+0000 7f0a7effd700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.253+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0a780838e0 con 0x7f0a880f7980 2022-02-02T19:18:58.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.253+0000 7f0a8659c700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.254+0000 7f0a8659c700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f0a70006fd0 tx=0x7f0a70008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.258+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a780553c0 con 0x7f0a880f7980 2022-02-02T19:18:58.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.439+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a880fefb0 con 0x7f0a74064dd0 2022-02-02T19:18:58.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.440+0000 7f0a7effd700 1 -- 172.21.15.96:0/1455317325 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a880fefb0 con 0x7f0a74064dd0 2022-02-02T19:18:58.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 msgr2=0x7f0a74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f0a70006fd0 tx=0x7f0a70008040).stop 2022-02-02T19:18:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 msgr2=0x7f0a881074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f0a78009990 tx=0x7f0a78009b30).stop 2022-02-02T19:18:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 shutdown_connections 2022-02-02T19:18:58.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f66e0 0x7f0a88106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 --2- 172.21.15.96:0/1455317325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f7980 0x7f0a881074a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 >> 172.21.15.96:0/1455317325 conn(0x7f0a880f1e40 msgr2=0x7f0a880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:58.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 shutdown_connections 2022-02-02T19:18:58.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.442+0000 7f0a8caf0700 1 -- 172.21.15.96:0/1455317325 wait complete. 2022-02-02T19:18:58.457 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:18:58.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 -- 172.21.15.96:0/2787009689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 msgr2=0x7f6c900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 --2- 172.21.15.96:0/2787009689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c900f7de0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6c8c004660 tx=0x7f6c8c009b30).stop 2022-02-02T19:18:58.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 -- 172.21.15.96:0/2787009689 shutdown_connections 2022-02-02T19:18:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 --2- 172.21.15.96:0/2787009689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c900f7de0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 --2- 172.21.15.96:0/2787009689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:18:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 -- 172.21.15.96:0/2787009689 >> 172.21.15.96:0/2787009689 conn(0x7f6c900f1e40 msgr2=0x7f6c900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 -- 172.21.15.96:0/2787009689 shutdown_connections 2022-02-02T19:18:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.540+0000 7f6c980e3700 1 -- 172.21.15.96:0/2787009689 wait complete. 2022-02-02T19:18:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 Processor -- start 2022-02-02T19:18:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 -- start start 2022-02-02T19:18:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c90106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90107ae0 con 0x7f6c900f7980 2022-02-02T19:18:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c980e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90108390 con 0x7f6c900f66e0 2022-02-02T19:18:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59034/0 (socket says 172.21.15.96:59034) 2022-02-02T19:18:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 -- 172.21.15.96:0/1992519509 learned_addr learned my addr 172.21.15.96:0/1992519509 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c95e7f700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c90106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 -- 172.21.15.96:0/1992519509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 msgr2=0x7f6c90106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c90106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c9567e700 1 -- 172.21.15.96:0/1992519509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c005040 con 0x7f6c900f7980 2022-02-02T19:18:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.541+0000 7f6c95e7f700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c90106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:18:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c9567e700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f6c8c009990 tx=0x7f6c8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8c018070 con 0x7f6c900f7980 2022-02-02T19:18:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c8c007ca0 con 0x7f6c900f7980 2022-02-02T19:18:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8c01c620 con 0x7f6c900f7980 2022-02-02T19:18:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c90108610 con 0x7f6c900f7980 2022-02-02T19:18:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.542+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c90108b20 con 0x7f6c900f7980 2022-02-02T19:18:58.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.543+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c900f5ad0 con 0x7f6c900f7980 2022-02-02T19:18:58.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.543+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c8c01d960 con 0x7f6c900f7980 2022-02-02T19:18:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.544+0000 7f6c867fc700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 0x7f6c7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.544+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c8c083830 con 0x7f6c900f7980 2022-02-02T19:18:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.544+0000 7f6c95e7f700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 0x7f6c7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.544+0000 7f6c95e7f700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 0x7f6c7c067290 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f6c900f77e0 tx=0x7f6c80008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.548+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c8c0553d0 con 0x7f6c900f7980 2022-02-02T19:18:58.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.719+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c900fefb0 con 0x7f6c7c064dd0 2022-02-02T19:18:58.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.729+0000 7f6c867fc700 1 -- 172.21.15.96:0/1992519509 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6c900fefb0 con 0x7f6c7c064dd0 2022-02-02T19:18:58.734 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:18:58.734 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (62m) 32m ago 63m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:18:58.734 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (54m) 32m ago 63m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:18:58.735 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (54m) 31m ago 62m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:18:58.735 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (62m) 32m ago 63m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:18:58.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (59m) 32m ago 59m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:18:58.735 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (55m) 32m ago 59m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:18:58.736 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (59m) 31m ago 59m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:18:58.736 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (55m) 31m ago 59m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:18:58.736 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (56m) 32m ago 64m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:18:58.736 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (56m) 31m ago 62m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:18:58.737 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (55m) 32m ago 64m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:18:58.737 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (55m) 31m ago 62m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:18:58.737 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (63m) 32m ago 63m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:18:58.737 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (62m) 31m ago 62m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:18:58.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (54m) 32m ago 62m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:18:58.738 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (53m) 32m ago 61m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:18:58.738 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (53m) 32m ago 61m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:18:58.738 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (52m) 31m ago 61m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:18:58.739 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (52m) 31m ago 61m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:18:58.739 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (51m) 31m ago 60m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:18:58.739 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (62m) 32m ago 63m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:18:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 msgr2=0x7f6c7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 0x7f6c7c067290 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f6c900f77e0 tx=0x7f6c80008040).stop 2022-02-02T19:18:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 msgr2=0x7f6c901074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f6c8c009990 tx=0x7f6c8c009b30).stop 2022-02-02T19:18:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 shutdown_connections 2022-02-02T19:18:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c7c064dd0 0x7f6c7c067290 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c900f66e0 0x7f6c90106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 --2- 172.21.15.96:0/1992519509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c900f7980 0x7f6c901074a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 >> 172.21.15.96:0/1992519509 conn(0x7f6c900f1e40 msgr2=0x7f6c900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.730+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 shutdown_connections 2022-02-02T19:18:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.731+0000 7f6c980e3700 1 -- 172.21.15.96:0/1992519509 wait complete. 2022-02-02T19:18:58.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 -- 172.21.15.96:0/2727546949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 msgr2=0x7fe7680fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 --2- 172.21.15.96:0/2727546949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe7680fbaf0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fe750004660 tx=0x7fe750009b30).stop 2022-02-02T19:18:58.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 -- 172.21.15.96:0/2727546949 shutdown_connections 2022-02-02T19:18:58.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 --2- 172.21.15.96:0/2727546949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe7680fbaf0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 --2- 172.21.15.96:0/2727546949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 0x7fe7680f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:18:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.827+0000 7fe76cee9700 1 -- 172.21.15.96:0/2727546949 >> 172.21.15.96:0/2727546949 conn(0x7fe7680f0ba0 msgr2=0x7fe7680f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 -- 172.21.15.96:0/2727546949 shutdown_connections 2022-02-02T19:18:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 -- 172.21.15.96:0/2727546949 wait complete. 2022-02-02T19:18:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 Processor -- start 2022-02-02T19:18:58.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 -- start start 2022-02-02T19:18:58.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 0x7fe768106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768107920 con 0x7fe7680f96a0 2022-02-02T19:18:58.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.828+0000 7fe76cee9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681080d0 con 0x7fe768060310 2022-02-02T19:18:58.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59044/0 (socket says 172.21.15.96:59044) 2022-02-02T19:18:58.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 -- 172.21.15.96:0/4154111480 learned_addr learned my addr 172.21.15.96:0/4154111480 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe7677fe700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 0x7fe768106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 -- 172.21.15.96:0/4154111480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 msgr2=0x7fe768106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 0x7fe768106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 -- 172.21.15.96:0/4154111480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750005040 con 0x7fe7680f96a0 2022-02-02T19:18:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe766ffd700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fe750004f60 tx=0x7fe750009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe750018070 con 0x7fe7680f96a0 2022-02-02T19:18:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe750007ba0 con 0x7fe7680f96a0 2022-02-02T19:18:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768108350 con 0x7fe7680f96a0 2022-02-02T19:18:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe75001c620 con 0x7fe7680f96a0 2022-02-02T19:18:58.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.829+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7681088b0 con 0x7fe7680f96a0 2022-02-02T19:18:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.830+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768059100 con 0x7fe7680f96a0 2022-02-02T19:18:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.831+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe75001d420 con 0x7fe7680f96a0 2022-02-02T19:18:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.831+0000 7fe75ffff700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 0x7fe7540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.831+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe7500838e0 con 0x7fe7680f96a0 2022-02-02T19:18:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.831+0000 7fe7677fe700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 0x7fe7540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.832+0000 7fe7677fe700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 0x7fe7540672e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fe768107b60 tx=0x7fe758008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:58.835+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe750051a50 con 0x7fe7680f96a0 2022-02-02T19:18:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.066+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7680fed80 con 0x7fe7680f96a0 2022-02-02T19:18:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.066+0000 7fe75ffff700 1 -- 172.21.15.96:0/4154111480 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe750055070 con 0x7fe7680f96a0 2022-02-02T19:18:59.072 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:18:59.072 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:18:59.072 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:18:59.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:59.073 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:18:59.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:18:59.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:59.073 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:18:59.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:18:59.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:59.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:18:59.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:18:59.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:18:59.075 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:18:59.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:18:59.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:18:59.075 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:18:59.075 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:18:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 msgr2=0x7fe7540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 0x7fe7540672e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fe768107b60 tx=0x7fe758008040).stop 2022-02-02T19:18:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 msgr2=0x7fe768107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fe750004f60 tx=0x7fe750009b30).stop 2022-02-02T19:18:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 shutdown_connections 2022-02-02T19:18:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe754064e20 0x7fe7540672e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe768060310 0x7fe768106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 --2- 172.21.15.96:0/4154111480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7680f96a0 0x7fe768107290 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 >> 172.21.15.96:0/4154111480 conn(0x7fe7680f0ba0 msgr2=0x7fe7680f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 shutdown_connections 2022-02-02T19:18:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.068+0000 7fe76cee9700 1 -- 172.21.15.96:0/4154111480 wait complete. 2022-02-02T19:18:59.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 -- 172.21.15.96:0/3158476465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 msgr2=0x7f03100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 --2- 172.21.15.96:0/3158476465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f03100f6950 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f0304004660 tx=0x7f0304009b30).stop 2022-02-02T19:18:59.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 -- 172.21.15.96:0/3158476465 shutdown_connections 2022-02-02T19:18:59.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 --2- 172.21.15.96:0/3158476465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 --2- 172.21.15.96:0/3158476465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f03100f6950 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.165+0000 7f03148cd700 1 -- 172.21.15.96:0/3158476465 >> 172.21.15.96:0/3158476465 conn(0x7f03100f1c90 msgr2=0x7f03100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.166+0000 7f03148cd700 1 -- 172.21.15.96:0/3158476465 shutdown_connections 2022-02-02T19:18:59.173 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:58 smithi096 ceph-mon[101353]: pgmap v1705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.166+0000 7f03148cd700 1 -- 172.21.15.96:0/3158476465 wait complete. 2022-02-02T19:18:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.166+0000 7f03148cd700 1 Processor -- start 2022-02-02T19:18:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.166+0000 7f03148cd700 1 -- start start 2022-02-02T19:18:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f03148cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f03148cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03101072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f03148cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101078f0 con 0x7f03100f6530 2022-02-02T19:18:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f03148cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310108100 con 0x7f03100f77d0 2022-02-02T19:18:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59052/0 (socket says 172.21.15.96:59052) 2022-02-02T19:18:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 -- 172.21.15.96:0/1390870954 learned_addr learned my addr 172.21.15.96:0/1390870954 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:18:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030effd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03101072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 -- 172.21.15.96:0/1390870954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 msgr2=0x7f03101072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03101072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 -- 172.21.15.96:0/1390870954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304005040 con 0x7f03100f6530 2022-02-02T19:18:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030effd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03101072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:18:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f030f7fe700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f0304004f60 tx=0x7f0304009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0304018070 con 0x7f03100f6530 2022-02-02T19:18:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310108320 con 0x7f03100f6530 2022-02-02T19:18:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0304007ba0 con 0x7f03100f6530 2022-02-02T19:18:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.167+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030401c620 con 0x7f03100f6530 2022-02-02T19:18:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.168+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0310108880 con 0x7f03100f6530 2022-02-02T19:18:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.169+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f030401c8e0 con 0x7f03100f6530 2022-02-02T19:18:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.169+0000 7f02f7fff700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 0x7f02f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:18:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.169+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f03040835c0 con 0x7f03100f6530 2022-02-02T19:18:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.169+0000 7f030effd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 0x7f02f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:18:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.169+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310059100 con 0x7f03100f6530 2022-02-02T19:18:59.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.170+0000 7f030effd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 0x7f02f80672e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f03000041d0 tx=0x7f0300009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:18:59.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.174+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0304051670 con 0x7f03100f6530 2022-02-02T19:18:59.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:58 smithi159 ceph-mon[69013]: pgmap v1705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:18:59.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.373+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03100fecf0 con 0x7f03100f6530 2022-02-02T19:18:59.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.373+0000 7f02f7fff700 1 -- 172.21.15.96:0/1390870954 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0304054c90 con 0x7f03100f6530 2022-02-02T19:18:59.379 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:18:59.379 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:18:59.379 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:18:59.380 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:18:59.380 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:59.380 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:18:59.380 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:18:59.380 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:18:59.381 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:18:59.381 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:18:59.381 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:18:59.381 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:18:59.382 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:18:59.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:18:59.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:18:59.382 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:18:59.382 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:18:59.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:18:59.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:18:59.383 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:18:59.383 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:18:59.384 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:18:59.384 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:18:59.384 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:18:59.384 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:18:59.385 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:18:59.385 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:18:59.385 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:18:59.385 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:18:59.385 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:18:59.386 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:18:59.386 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:18:59.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:59.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:59.386 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:18:59.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:18:59.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:59.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:59.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:18:59.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 msgr2=0x7f02f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 0x7f02f80672e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f03000041d0 tx=0x7f0300009040).stop 2022-02-02T19:18:59.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 msgr2=0x7f0310106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:18:59.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f0304004f60 tx=0x7f0304009b30).stop 2022-02-02T19:18:59.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 shutdown_connections 2022-02-02T19:18:59.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02f8064e20 0x7f02f80672e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03100f6530 0x7f0310106e00 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 --2- 172.21.15.96:0/1390870954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03100f77d0 0x7f03101072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:18:59.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 >> 172.21.15.96:0/1390870954 conn(0x7f03100f1c90 msgr2=0x7f03100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:18:59.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 shutdown_connections 2022-02-02T19:18:59.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:18:59.375+0000 7f03148cd700 1 -- 172.21.15.96:0/1390870954 wait complete. 2022-02-02T19:18:59.391 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:19:00.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:59 smithi159 ceph-mon[69013]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:00.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:59 smithi159 ceph-mon[69013]: from='client.35870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:00.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4154111480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:19:00.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:18:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1390870954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:19:00.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:59 smithi096 ceph-mon[101353]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:00.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:59 smithi096 ceph-mon[101353]: from='client.35870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:00.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4154111480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:19:00.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:18:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1390870954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:19:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:00 smithi159 ceph-mon[69013]: pgmap v1706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:00 smithi096 ceph-mon[101353]: pgmap v1706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:03.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:02 smithi096 ceph-mon[101353]: pgmap v1707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:02 smithi159 ceph-mon[69013]: pgmap v1707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:04 smithi159 ceph-mon[69013]: pgmap v1708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:04 smithi096 ceph-mon[101353]: pgmap v1708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:06 smithi159 ceph-mon[69013]: pgmap v1709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:07.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:06 smithi096 ceph-mon[101353]: pgmap v1709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:09.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:08 smithi159 ceph-mon[69013]: pgmap v1710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:08 smithi096 ceph-mon[101353]: pgmap v1710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:10 smithi159 ceph-mon[69013]: pgmap v1711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:10 smithi096 ceph-mon[101353]: pgmap v1711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:12 smithi096 ceph-mon[101353]: pgmap v1712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:12 smithi159 ceph-mon[69013]: pgmap v1712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:14 smithi159 ceph-mon[69013]: pgmap v1713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:15.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:14 smithi096 ceph-mon[101353]: pgmap v1713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:16 smithi159 ceph-mon[69013]: pgmap v1714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:17.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:16 smithi096 ceph-mon[101353]: pgmap v1714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:18 smithi159 ceph-mon[69013]: pgmap v1715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:18 smithi096 ceph-mon[101353]: pgmap v1715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:20 smithi159 ceph-mon[69013]: pgmap v1716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:20 smithi096 ceph-mon[101353]: pgmap v1716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:22 smithi096 ceph-mon[101353]: pgmap v1717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:22 smithi159 ceph-mon[69013]: pgmap v1717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:24 smithi159 ceph-mon[69013]: pgmap v1718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:24 smithi096 ceph-mon[101353]: pgmap v1718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:26 smithi159 ceph-mon[69013]: pgmap v1719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:27.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:26 smithi096 ceph-mon[101353]: pgmap v1719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:19:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:19:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:19:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:19:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:28 smithi159 ceph-mon[69013]: pgmap v1720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:28 smithi096 ceph-mon[101353]: pgmap v1720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:29.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 -- 172.21.15.96:0/2163455752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 msgr2=0x7fa6c40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 --2- 172.21.15.96:0/2163455752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c40f7de0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fa6b8004660 tx=0x7fa6b8009b30).stop 2022-02-02T19:19:29.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 -- 172.21.15.96:0/2163455752 shutdown_connections 2022-02-02T19:19:29.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 --2- 172.21.15.96:0/2163455752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c40f7de0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 --2- 172.21.15.96:0/2163455752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 0x7fa6c40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:19:29.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 -- 172.21.15.96:0/2163455752 >> 172.21.15.96:0/2163455752 conn(0x7fa6c40f1e40 msgr2=0x7fa6c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:29.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 -- 172.21.15.96:0/2163455752 shutdown_connections 2022-02-02T19:19:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.486+0000 7fa6cb944700 1 -- 172.21.15.96:0/2163455752 wait complete. 2022-02-02T19:19:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 Processor -- start 2022-02-02T19:19:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 -- start start 2022-02-02T19:19:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 0x7fa6c4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4107ae0 con 0x7fa6c40f7980 2022-02-02T19:19:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6cb944700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4108390 con 0x7fa6c40f66e0 2022-02-02T19:19:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:29.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59072/0 (socket says 172.21.15.96:59072) 2022-02-02T19:19:29.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 -- 172.21.15.96:0/4270496032 learned_addr learned my addr 172.21.15.96:0/4270496032 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:19:29.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c96e0700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 0x7fa6c4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:29.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 -- 172.21.15.96:0/4270496032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 msgr2=0x7fa6c4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 0x7fa6c4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.487+0000 7fa6c8edf700 1 -- 172.21.15.96:0/4270496032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8005040 con 0x7fa6c40f7980 2022-02-02T19:19:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6c8edf700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fa6b8009990 tx=0x7fa6b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b8018070 con 0x7fa6c40f7980 2022-02-02T19:19:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa6b8007ba0 con 0x7fa6c40f7980 2022-02-02T19:19:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c4108610 con 0x7fa6c40f7980 2022-02-02T19:19:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b801c620 con 0x7fa6c40f7980 2022-02-02T19:19:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.488+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c4108b70 con 0x7fa6c40f7980 2022-02-02T19:19:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.489+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c40f5ad0 con 0x7fa6c40f7980 2022-02-02T19:19:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.489+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa6b801d420 con 0x7fa6c40f7980 2022-02-02T19:19:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.490+0000 7fa6c1ffb700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 0x7fa6ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.490+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa6b80838d0 con 0x7fa6c40f7980 2022-02-02T19:19:29.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.490+0000 7fa6c96e0700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 0x7fa6ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:29.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.490+0000 7fa6c96e0700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 0x7fa6ac067290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa6bc006fd0 tx=0x7fa6bc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:29.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.494+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa6b8055470 con 0x7fa6c40f7980 2022-02-02T19:19:29.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.674+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6c40fef40 con 0x7fa6ac064dd0 2022-02-02T19:19:29.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.675+0000 7fa6c1ffb700 1 -- 172.21.15.96:0/4270496032 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa6c40fef40 con 0x7fa6ac064dd0 2022-02-02T19:19:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 msgr2=0x7fa6ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 0x7fa6ac067290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa6bc006fd0 tx=0x7fa6bc008040).stop 2022-02-02T19:19:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 msgr2=0x7fa6c41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fa6b8009990 tx=0x7fa6b8009b30).stop 2022-02-02T19:19:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 shutdown_connections 2022-02-02T19:19:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6ac064dd0 0x7fa6ac067290 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c40f66e0 0x7fa6c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 --2- 172.21.15.96:0/4270496032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6c40f7980 0x7fa6c41074a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 >> 172.21.15.96:0/4270496032 conn(0x7fa6c40f1e40 msgr2=0x7fa6c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 shutdown_connections 2022-02-02T19:19:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.677+0000 7fa6cb944700 1 -- 172.21.15.96:0/4270496032 wait complete. 2022-02-02T19:19:29.692 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:19:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 -- 172.21.15.96:0/2916438127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 msgr2=0x7faa8c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 --2- 172.21.15.96:0/2916438127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c0f59e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7faa80004660 tx=0x7faa80009b30).stop 2022-02-02T19:19:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 -- 172.21.15.96:0/2916438127 shutdown_connections 2022-02-02T19:19:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 --2- 172.21.15.96:0/2916438127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa8c0f6860 0x7faa8c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:19:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 --2- 172.21.15.96:0/2916438127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c0f59e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 -- 172.21.15.96:0/2916438127 >> 172.21.15.96:0/2916438127 conn(0x7faa8c0f0d40 msgr2=0x7faa8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 -- 172.21.15.96:0/2916438127 shutdown_connections 2022-02-02T19:19:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.774+0000 7faa92f94700 1 -- 172.21.15.96:0/2916438127 wait complete. 2022-02-02T19:19:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 Processor -- start 2022-02-02T19:19:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 -- start start 2022-02-02T19:19:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa8c0f6860 0x7faa8c10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c060470 con 0x7faa8c0f55c0 2022-02-02T19:19:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa92f94700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0605b0 con 0x7faa8c0f6860 2022-02-02T19:19:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.775+0000 7faa90d30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59080/0 (socket says 172.21.15.96:59080) 2022-02-02T19:19:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 -- 172.21.15.96:0/75676739 learned_addr learned my addr 172.21.15.96:0/75676739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:19:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 -- 172.21.15.96:0/75676739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa8c0f6860 msgr2=0x7faa8c10c1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T19:19:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa8c0f6860 0x7faa8c10c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:19:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 -- 172.21.15.96:0/75676739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80005040 con 0x7faa8c0f55c0 2022-02-02T19:19:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa90d30700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7faa80004f60 tx=0x7faa80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa80018070 con 0x7faa8c0f55c0 2022-02-02T19:19:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa80007ba0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c10c7c0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8001c620 con 0x7faa8c0f55c0 2022-02-02T19:19:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.776+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c10ccf0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.777+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c0f49b0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.778+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa8001c8e0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.778+0000 7faa897fa700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 0x7faa7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.778+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faa800839c0 con 0x7faa8c0f55c0 2022-02-02T19:19:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.778+0000 7faa8bfff700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 0x7faa7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.778+0000 7faa8bfff700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 0x7faa7c067290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7faa78009500 tx=0x7faa78006a30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:29.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.782+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa80051b30 con 0x7faa8c0f55c0 2022-02-02T19:19:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.956+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa8c0fdfb0 con 0x7faa7c064dd0 2022-02-02T19:19:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.966+0000 7faa897fa700 1 -- 172.21.15.96:0/75676739 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faa78009180 con 0x7faa7c064dd0 2022-02-02T19:19:29.971 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:19:29.971 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (62m) 33m ago 63m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:19:29.972 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (55m) 33m ago 63m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:19:29.972 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (55m) 31m ago 63m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:19:29.972 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (62m) 33m ago 63m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:19:29.972 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (59m) 33m ago 59m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:19:29.973 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (55m) 33m ago 60m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:19:29.973 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (60m) 31m ago 60m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:19:29.973 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (55m) 31m ago 60m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:19:29.973 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (57m) 33m ago 65m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:19:29.974 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (56m) 31m ago 63m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:19:29.974 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (56m) 33m ago 65m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:19:29.975 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (55m) 31m ago 63m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:19:29.975 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (63m) 33m ago 63m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:19:29.975 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (63m) 31m ago 63m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:19:29.975 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (54m) 33m ago 62m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:19:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (54m) 33m ago 62m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:19:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (53m) 33m ago 62m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:19:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (53m) 31m ago 61m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:19:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (52m) 31m ago 61m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:19:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (52m) 31m ago 61m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:19:29.977 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (62m) 33m ago 63m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:19:29.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 msgr2=0x7faa7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 0x7faa7c067290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7faa78009500 tx=0x7faa78006a30).stop 2022-02-02T19:19:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 msgr2=0x7faa8c109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7faa80004f60 tx=0x7faa80009b30).stop 2022-02-02T19:19:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 shutdown_connections 2022-02-02T19:19:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa7c064dd0 0x7faa7c067290 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa8c0f55c0 0x7faa8c109cc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 --2- 172.21.15.96:0/75676739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa8c0f6860 0x7faa8c10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:19:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 >> 172.21.15.96:0/75676739 conn(0x7faa8c0f0d40 msgr2=0x7faa8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 shutdown_connections 2022-02-02T19:19:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:29.968+0000 7faa92f94700 1 -- 172.21.15.96:0/75676739 wait complete. 2022-02-02T19:19:30.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 -- 172.21.15.96:0/2782205602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 msgr2=0x7f95f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 --2- 172.21.15.96:0/2782205602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f00f59e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f95e4004660 tx=0x7f95e4009b30).stop 2022-02-02T19:19:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 -- 172.21.15.96:0/2782205602 shutdown_connections 2022-02-02T19:19:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 --2- 172.21.15.96:0/2782205602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 0x7f95f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 --2- 172.21.15.96:0/2782205602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f00f59e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 -- 172.21.15.96:0/2782205602 >> 172.21.15.96:0/2782205602 conn(0x7f95f00f0d40 msgr2=0x7f95f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 -- 172.21.15.96:0/2782205602 shutdown_connections 2022-02-02T19:19:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.064+0000 7f95f50ea700 1 -- 172.21.15.96:0/2782205602 wait complete. 2022-02-02T19:19:30.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 Processor -- start 2022-02-02T19:19:30.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 -- start start 2022-02-02T19:19:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 0x7f95f0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0106910 con 0x7f95f00f55c0 2022-02-02T19:19:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95f50ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0106a50 con 0x7f95f00f6860 2022-02-02T19:19:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59090/0 (socket says 172.21.15.96:59090) 2022-02-02T19:19:30.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95eed9d700 1 -- 172.21.15.96:0/3722795784 learned_addr learned my addr 172.21.15.96:0/3722795784 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:19:30.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.065+0000 7f95ee59c700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 0x7f95f0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95eed9d700 1 -- 172.21.15.96:0/3722795784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 msgr2=0x7f95f0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95eed9d700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 0x7f95f0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95eed9d700 1 -- 172.21.15.96:0/3722795784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4005040 con 0x7f95f00f55c0 2022-02-02T19:19:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95eed9d700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f95e4004f60 tx=0x7f95e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e4018070 con 0x7f95f00f55c0 2022-02-02T19:19:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95e4009770 con 0x7f95f00f55c0 2022-02-02T19:19:30.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e401c3c0 con 0x7f95f00f55c0 2022-02-02T19:19:30.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f0107390 con 0x7f95f00f55c0 2022-02-02T19:19:30.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.066+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f01078a0 con 0x7f95f00f55c0 2022-02-02T19:19:30.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.067+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f0045ad0 con 0x7f95f00f55c0 2022-02-02T19:19:30.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.068+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f95e401d420 con 0x7f95f00f55c0 2022-02-02T19:19:30.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.068+0000 7f95d77fe700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 0x7f95d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.068+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f95e4083890 con 0x7f95f00f55c0 2022-02-02T19:19:30.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.068+0000 7f95ee59c700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 0x7f95d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.068+0000 7f95ee59c700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 0x7f95d8067290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f95e0007fd0 tx=0x7f95e0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:30.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.072+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95e4055430 con 0x7f95f00f55c0 2022-02-02T19:19:30.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.303+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95f00008d0 con 0x7f95f00f55c0 2022-02-02T19:19:30.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.304+0000 7f95d77fe700 1 -- 172.21.15.96:0/3722795784 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f95e4055020 con 0x7f95f00f55c0 2022-02-02T19:19:30.309 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:19:30.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:19:30.310 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:19:30.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:19:30.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:19:30.311 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:19:30.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:19:30.311 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:19:30.312 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:19:30.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:19:30.312 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:19:30.312 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:19:30.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:19:30.313 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:19:30.313 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:19:30.313 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:19:30.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:19:30.314 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:19:30.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.305+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 msgr2=0x7f95d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.305+0000 7f95f50ea700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 0x7f95d8067290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f95e0007fd0 tx=0x7f95e0009040).stop 2022-02-02T19:19:30.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.305+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 msgr2=0x7f95f0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.305+0000 7f95f50ea700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f95e4004f60 tx=0x7f95e4009b30).stop 2022-02-02T19:19:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 shutdown_connections 2022-02-02T19:19:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95d8064dd0 0x7f95d8067290 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95f00f55c0 0x7f95f0105e70 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 --2- 172.21.15.96:0/3722795784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95f00f6860 0x7f95f0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 >> 172.21.15.96:0/3722795784 conn(0x7f95f00f0d40 msgr2=0x7f95f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 shutdown_connections 2022-02-02T19:19:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.306+0000 7f95f50ea700 1 -- 172.21.15.96:0/3722795784 wait complete. 2022-02-02T19:19:30.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/91739392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f7960 msgr2=0x7f1ff80f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/91739392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f7960 0x7f1ff80f7dc0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f1fec004660 tx=0x7f1fec009b30).stop 2022-02-02T19:19:30.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/91739392 shutdown_connections 2022-02-02T19:19:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/91739392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f7960 0x7f1ff80f7dc0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/91739392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f66c0 0x7f1ff80f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/91739392 >> 172.21.15.96:0/91739392 conn(0x7f1ff80f1e20 msgr2=0x7f1ff80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/91739392 shutdown_connections 2022-02-02T19:19:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.403+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/91739392 wait complete. 2022-02-02T19:19:30.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 Processor -- start 2022-02-02T19:19:30.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 -- start start 2022-02-02T19:19:30.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f7960 0x7f1ff8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff81079f0 con 0x7f1ff80f66c0 2022-02-02T19:19:30.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ffd8fe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8107b30 con 0x7f1ff80f7960 2022-02-02T19:19:30.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ff6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ff6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59100/0 (socket says 172.21.15.96:59100) 2022-02-02T19:19:30.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.404+0000 7f1ff6ffd700 1 -- 172.21.15.96:0/2254189019 learned_addr learned my addr 172.21.15.96:0/2254189019 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:19:30.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ff67fc700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f7960 0x7f1ff8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ff6ffd700 1 -- 172.21.15.96:0/2254189019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f7960 msgr2=0x7f1ff8107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ff6ffd700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f7960 0x7f1ff8107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ff6ffd700 1 -- 172.21.15.96:0/2254189019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec005040 con 0x7f1ff80f66c0 2022-02-02T19:19:30.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ff6ffd700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1fe800c530 tx=0x7f1fe8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:30.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fe800f650 con 0x7f1ff80f66c0 2022-02-02T19:19:30.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fe800fc60 con 0x7f1ff80f66c0 2022-02-02T19:19:30.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff81084d0 con 0x7f1ff80f66c0 2022-02-02T19:19:30.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fe8012cb0 con 0x7f1ff80f66c0 2022-02-02T19:19:30.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.405+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff8108a90 con 0x7f1ff80f66c0 2022-02-02T19:19:30.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.406+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff8045ad0 con 0x7f1ff80f66c0 2022-02-02T19:19:30.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.407+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1fe8019030 con 0x7f1ff80f66c0 2022-02-02T19:19:30.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.407+0000 7f1fdf7fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 0x7f1fe0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:19:30.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.407+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1fe8081580 con 0x7f1ff80f66c0 2022-02-02T19:19:30.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.407+0000 7f1ff67fc700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 0x7f1fe0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:19:30.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.408+0000 7f1ff67fc700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 0x7f1fe0067290 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f1fec004630 tx=0x7f1fec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:19:30.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.412+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1fe80487d0 con 0x7f1ff80f66c0 2022-02-02T19:19:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.611+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ff80ff000 con 0x7f1ff80f66c0 2022-02-02T19:19:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.612+0000 7f1fdf7fe700 1 -- 172.21.15.96:0/2254189019 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1fe8017070 con 0x7f1ff80f66c0 2022-02-02T19:19:30.619 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:19:30.619 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:19:30.619 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:19:30.620 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:19:30.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:19:30.620 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:19:30.620 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:19:30.621 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:19:30.621 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:19:30.621 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:19:30.621 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:19:30.622 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:19:30.622 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:19:30.622 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:19:30.622 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:19:30.623 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:19:30.623 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:19:30.623 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:19:30.623 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:19:30.624 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:19:30.624 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:19:30.624 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:19:30.624 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:19:30.625 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:19:30.625 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:19:30.625 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:19:30.625 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:19:30.626 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:19:30.626 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:19:30.626 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:19:30.627 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:19:30.627 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:19:30.627 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:19:30.627 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:19:30.627 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:19:30.628 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:19:30.628 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:19:30.628 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:19:30.628 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:19:30.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.613+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 msgr2=0x7f1fe0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.613+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 0x7f1fe0067290 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f1fec004630 tx=0x7f1fec009b30).stop 2022-02-02T19:19:30.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.613+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 msgr2=0x7f1ff8106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:19:30.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.613+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1fe800c530 tx=0x7f1fe8007e10).stop 2022-02-02T19:19:30.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 shutdown_connections 2022-02-02T19:19:30.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fe0064dd0 0x7f1fe0067290 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff80f66c0 0x7f1ff8106f50 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 --2- 172.21.15.96:0/2254189019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff80f7960 0x7f1ff8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:19:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 >> 172.21.15.96:0/2254189019 conn(0x7f1ff80f1e20 msgr2=0x7f1ff80fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:19:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 shutdown_connections 2022-02-02T19:19:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:19:30.614+0000 7f1ffd8fe700 1 -- 172.21.15.96:0/2254189019 wait complete. 2022-02-02T19:19:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:19:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:30 smithi159 ceph-mon[69013]: from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:30 smithi159 ceph-mon[69013]: pgmap v1721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3722795784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:19:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2254189019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:19:31.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:30 smithi096 ceph-mon[101353]: from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:30 smithi096 ceph-mon[101353]: pgmap v1721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3722795784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:19:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2254189019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:19:32.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:31 smithi159 ceph-mon[69013]: from='client.35886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:32.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:31 smithi096 ceph-mon[101353]: from='client.35886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:19:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:32 smithi096 ceph-mon[101353]: pgmap v1722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:32 smithi159 ceph-mon[69013]: pgmap v1722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:34 smithi159 ceph-mon[69013]: pgmap v1723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:35.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:34 smithi096 ceph-mon[101353]: pgmap v1723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:36 smithi159 ceph-mon[69013]: pgmap v1724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:37.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:36 smithi096 ceph-mon[101353]: pgmap v1724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:39.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:38 smithi159 ceph-mon[69013]: pgmap v1725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:38 smithi096 ceph-mon[101353]: pgmap v1725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:40 smithi159 ceph-mon[69013]: pgmap v1726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:41.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:40 smithi096 ceph-mon[101353]: pgmap v1726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:43.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:42 smithi096 ceph-mon[101353]: pgmap v1727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:42 smithi159 ceph-mon[69013]: pgmap v1727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:44 smithi159 ceph-mon[69013]: pgmap v1728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:45.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:44 smithi096 ceph-mon[101353]: pgmap v1728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:46 smithi159 ceph-mon[69013]: pgmap v1729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:46 smithi096 ceph-mon[101353]: pgmap v1729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:48 smithi159 ceph-mon[69013]: pgmap v1730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:48 smithi096 ceph-mon[101353]: pgmap v1730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:50 smithi159 ceph-mon[69013]: pgmap v1731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:50 smithi096 ceph-mon[101353]: pgmap v1731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:53.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:52 smithi096 ceph-mon[101353]: pgmap v1732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:52 smithi159 ceph-mon[69013]: pgmap v1732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:54 smithi159 ceph-mon[69013]: pgmap v1733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:55.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:54 smithi096 ceph-mon[101353]: pgmap v1733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:56 smithi159 ceph-mon[69013]: pgmap v1734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:56 smithi096 ceph-mon[101353]: pgmap v1734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:59.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:19:58 smithi159 ceph-mon[69013]: pgmap v1735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:19:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:19:58 smithi096 ceph-mon[101353]: pgmap v1735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:00.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 -- 172.21.15.96:0/1588784959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f4de0 msgr2=0x7f0ba80f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:00.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 --2- 172.21.15.96:0/1588784959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f4de0 0x7f0ba80f5200 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f0b9c004660 tx=0x7f0b9c009b30).stop 2022-02-02T19:20:00.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 -- 172.21.15.96:0/1588784959 shutdown_connections 2022-02-02T19:20:00.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 --2- 172.21.15.96:0/1588784959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba80f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 --2- 172.21.15.96:0/1588784959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f4de0 0x7f0ba80f5200 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 -- 172.21.15.96:0/1588784959 >> 172.21.15.96:0/1588784959 conn(0x7f0ba80f0540 msgr2=0x7f0ba80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:00.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 -- 172.21.15.96:0/1588784959 shutdown_connections 2022-02-02T19:20:00.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.725+0000 7f0bada53700 1 -- 172.21.15.96:0/1588784959 wait complete. 2022-02-02T19:20:00.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.726+0000 7f0bada53700 1 Processor -- start 2022-02-02T19:20:00.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.726+0000 7f0bada53700 1 -- start start 2022-02-02T19:20:00.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.726+0000 7f0bada53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f4de0 0x7f0ba8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:00.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0bada53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:00.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0bada53700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80f7fc0 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0bada53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80f8100 con 0x7f0ba80f4de0 2022-02-02T19:20:00.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:00.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59120/0 (socket says 172.21.15.96:59120) 2022-02-02T19:20:00.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 -- 172.21.15.96:0/141285195 learned_addr learned my addr 172.21.15.96:0/141285195 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba6ffd700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f4de0 0x7f0ba8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 -- 172.21.15.96:0/141285195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f4de0 msgr2=0x7f0ba8109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f4de0 0x7f0ba8109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 -- 172.21.15.96:0/141285195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c005040 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0ba67fc700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f0b9800c530 tx=0x7f0b98007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:00.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9800f650 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0b9800fc60 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba810c700 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b98012cd0 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.727+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba810ccc0 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.729+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8045ad0 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.729+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0b98010070 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.729+0000 7f0b8f7fe700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 0x7f0b90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.729+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0b98081800 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.729+0000 7f0ba6ffd700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 0x7f0b90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.730+0000 7f0ba6ffd700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 0x7f0b90067290 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0b9c004e30 tx=0x7f0b9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.734+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0b9804f8b0 con 0x7f0ba80f5fe0 2022-02-02T19:20:00.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.911+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ba80fa320 con 0x7f0b90064dd0 2022-02-02T19:20:00.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.913+0000 7f0b8f7fe700 1 -- 172.21.15.96:0/141285195 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0ba80fa320 con 0x7f0b90064dd0 2022-02-02T19:20:00.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 msgr2=0x7f0b90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:00.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 0x7f0b90067290 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0b9c004e30 tx=0x7f0b9c009b30).stop 2022-02-02T19:20:00.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 msgr2=0x7f0ba810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:00.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f0b9800c530 tx=0x7f0b98007e20).stop 2022-02-02T19:20:00.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 shutdown_connections 2022-02-02T19:20:00.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b90064dd0 0x7f0b90067290 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba80f4de0 0x7f0ba8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 --2- 172.21.15.96:0/141285195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ba80f5fe0 0x7f0ba810c150 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:00.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.914+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 >> 172.21.15.96:0/141285195 conn(0x7f0ba80f0540 msgr2=0x7f0ba80f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:00.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.915+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 shutdown_connections 2022-02-02T19:20:00.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:00.915+0000 7f0bada53700 1 -- 172.21.15.96:0/141285195 wait complete. 2022-02-02T19:20:00.929 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:20:01.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 -- 172.21.15.96:0/2414245000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f66d0 msgr2=0x7f9ab80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 --2- 172.21.15.96:0/2414245000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f66d0 0x7f9ab80f6b30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f9aa8004660 tx=0x7f9aa8009b30).stop 2022-02-02T19:20:01.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 -- 172.21.15.96:0/2414245000 shutdown_connections 2022-02-02T19:20:01.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 --2- 172.21.15.96:0/2414245000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f66d0 0x7f9ab80f6b30 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 --2- 172.21.15.96:0/2414245000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f5430 0x7f9ab80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.012+0000 7f9abeff5700 1 -- 172.21.15.96:0/2414245000 >> 172.21.15.96:0/2414245000 conn(0x7f9ab80f0b90 msgr2=0x7f9ab80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:00 smithi096 ceph-mon[101353]: pgmap v1736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:01.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:20:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 -- 172.21.15.96:0/2414245000 shutdown_connections 2022-02-02T19:20:01.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 -- 172.21.15.96:0/2414245000 wait complete. 2022-02-02T19:20:01.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 Processor -- start 2022-02-02T19:20:01.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 -- start start 2022-02-02T19:20:01.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 0x7f9ab8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8107870 con 0x7f9ab80f5430 2022-02-02T19:20:01.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.013+0000 7f9abeff5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81080b0 con 0x7f9ab80f66d0 2022-02-02T19:20:01.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59134/0 (socket says 172.21.15.96:59134) 2022-02-02T19:20:01.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 -- 172.21.15.96:0/1227367125 learned_addr learned my addr 172.21.15.96:0/1227367125 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:01.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abd7f2700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 0x7f9ab8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 -- 172.21.15.96:0/1227367125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 msgr2=0x7f9ab8107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 0x7f9ab8107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 -- 172.21.15.96:0/1227367125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8005040 con 0x7f9ab80f5430 2022-02-02T19:20:01.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abd7f2700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 0x7f9ab8107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:20:01.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abdff3700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f9ab4011b90 tx=0x7f9ab4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ab4009320 con 0x7f9ab80f5430 2022-02-02T19:20:01.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ab4009480 con 0x7f9ab80f5430 2022-02-02T19:20:01.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ab4002bd0 con 0x7f9ab80f5430 2022-02-02T19:20:01.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8108330 con 0x7f9ab80f5430 2022-02-02T19:20:01.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.014+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab8108870 con 0x7f9ab80f5430 2022-02-02T19:20:01.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.015+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8059100 con 0x7f9ab80f5430 2022-02-02T19:20:01.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.016+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ab40077b0 con 0x7f9ab80f5430 2022-02-02T19:20:01.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.016+0000 7f9aae7fc700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 0x7f9aa40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.016+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9ab4085810 con 0x7f9ab80f5430 2022-02-02T19:20:01.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.016+0000 7f9abd7f2700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 0x7f9aa40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.017+0000 7f9abd7f2700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 0x7f9aa40672e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9aa8009da0 tx=0x7f9aa8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.020+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ab40538c0 con 0x7f9ab80f5430 2022-02-02T19:20:01.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.193+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab80fab10 con 0x7f9aa4064e20 2022-02-02T19:20:01.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.202+0000 7f9aae7fc700 1 -- 172.21.15.96:0/1227367125 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9ab80fab10 con 0x7f9aa4064e20 2022-02-02T19:20:01.206 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:20:01.207 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (63m) 34m ago 64m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:20:01.207 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (55m) 34m ago 64m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:20:01.207 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (55m) 32m ago 63m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:20:01.208 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (63m) 34m ago 64m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:20:01.208 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (60m) 34m ago 60m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:20:01.208 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (56m) 34m ago 60m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:20:01.208 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (60m) 32m ago 60m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:20:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (56m) 32m ago 60m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:20:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (57m) 34m ago 65m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:20:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (57m) 32m ago 63m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:20:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (56m) 34m ago 65m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:20:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (56m) 32m ago 63m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:20:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (64m) 34m ago 64m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:20:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (63m) 32m ago 63m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:20:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (55m) 34m ago 63m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:20:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (54m) 34m ago 62m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:20:01.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (54m) 34m ago 62m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:20:01.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (53m) 32m ago 62m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:20:01.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (53m) 32m ago 62m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:20:01.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (52m) 32m ago 61m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:20:01.211 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (63m) 34m ago 64m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:20:01.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 msgr2=0x7f9aa40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 0x7f9aa40672e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9aa8009da0 tx=0x7f9aa8009b30).stop 2022-02-02T19:20:01.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 msgr2=0x7f9ab8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f9ab4011b90 tx=0x7f9ab4009d80).stop 2022-02-02T19:20:01.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 shutdown_connections 2022-02-02T19:20:01.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9aa4064e20 0x7f9aa40672e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80f5430 0x7f9ab8106d80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 --2- 172.21.15.96:0/1227367125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80f66d0 0x7f9ab8107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 >> 172.21.15.96:0/1227367125 conn(0x7f9ab80f0b90 msgr2=0x7f9ab805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 shutdown_connections 2022-02-02T19:20:01.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.204+0000 7f9abeff5700 1 -- 172.21.15.96:0/1227367125 wait complete. 2022-02-02T19:20:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:00 smithi159 ceph-mon[69013]: pgmap v1736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:20:01.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 -- 172.21.15.96:0/2974526478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f66e0 msgr2=0x7f51fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 --2- 172.21.15.96:0/2974526478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f66e0 0x7f51fc0f6b00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f51f0004660 tx=0x7f51f0009b30).stop 2022-02-02T19:20:01.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 -- 172.21.15.96:0/2974526478 shutdown_connections 2022-02-02T19:20:01.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 --2- 172.21.15.96:0/2974526478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f7980 0x7f51fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 --2- 172.21.15.96:0/2974526478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f66e0 0x7f51fc0f6b00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 -- 172.21.15.96:0/2974526478 >> 172.21.15.96:0/2974526478 conn(0x7f51fc0f1e40 msgr2=0x7f51fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 -- 172.21.15.96:0/2974526478 shutdown_connections 2022-02-02T19:20:01.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.300+0000 7f52013ce700 1 -- 172.21.15.96:0/2974526478 wait complete. 2022-02-02T19:20:01.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 Processor -- start 2022-02-02T19:20:01.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 -- start start 2022-02-02T19:20:01.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f66e0 0x7f51fc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc107a50 con 0x7f51fc0f7980 2022-02-02T19:20:01.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.301+0000 7f52013ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc107b90 con 0x7f51fc0f66e0 2022-02-02T19:20:01.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59146/0 (socket says 172.21.15.96:59146) 2022-02-02T19:20:01.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 -- 172.21.15.96:0/2691259766 learned_addr learned my addr 172.21.15.96:0/2691259766 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:01.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51faffd700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f66e0 0x7f51fc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 -- 172.21.15.96:0/2691259766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f66e0 msgr2=0x7f51fc106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f66e0 0x7f51fc106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 -- 172.21.15.96:0/2691259766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0005040 con 0x7f51fc0f7980 2022-02-02T19:20:01.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51fa7fc700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f51ec0026d0 tx=0x7f51ec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec0079c0 con 0x7f51fc0f7980 2022-02-02T19:20:01.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc108530 con 0x7f51fc0f7980 2022-02-02T19:20:01.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc108af0 con 0x7f51fc0f7980 2022-02-02T19:20:01.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51ec00f040 con 0x7f51fc0f7980 2022-02-02T19:20:01.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.302+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec0148b0 con 0x7f51fc0f7980 2022-02-02T19:20:01.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.303+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc004fa0 con 0x7f51fc0f7980 2022-02-02T19:20:01.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.304+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f51ec014a10 con 0x7f51fc0f7980 2022-02-02T19:20:01.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.304+0000 7f51e37fe700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.304+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f51ec0818b0 con 0x7f51fc0f7980 2022-02-02T19:20:01.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.304+0000 7f51faffd700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.305+0000 7f51faffd700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f51f0004630 tx=0x7f51f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.308+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f51ec053390 con 0x7f51fc0f7980 2022-02-02T19:20:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.537+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51dc005e80 con 0x7f51fc0f7980 2022-02-02T19:20:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.537+0000 7f51e37fe700 1 -- 172.21.15.96:0/2691259766 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f51ec052f80 con 0x7f51fc0f7980 2022-02-02T19:20:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:20:01.542 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:20:01.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:20:01.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:01.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:20:01.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:20:01.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:01.544 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:20:01.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:20:01.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:01.544 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:20:01.545 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:20:01.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:01.545 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:20:01.545 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:20:01.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:20:01.546 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:20:01.546 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:20:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.539+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 msgr2=0x7f51e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.539+0000 7f52013ce700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f51f0004630 tx=0x7f51f0009b30).stop 2022-02-02T19:20:01.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 msgr2=0x7f51fc1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f51ec0026d0 tx=0x7f51ec009de0).stop 2022-02-02T19:20:01.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 shutdown_connections 2022-02-02T19:20:01.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51fc0f66e0 0x7f51fc106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 --2- 172.21.15.96:0/2691259766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51fc0f7980 0x7f51fc1074a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 >> 172.21.15.96:0/2691259766 conn(0x7f51fc0f1e40 msgr2=0x7f51fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 shutdown_connections 2022-02-02T19:20:01.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.540+0000 7f52013ce700 1 -- 172.21.15.96:0/2691259766 wait complete. 2022-02-02T19:20:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 -- 172.21.15.96:0/1030357429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f6530 msgr2=0x7f6d940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1030357429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f6530 0x7f6d940f6950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f6d84004660 tx=0x7f6d84009b30).stop 2022-02-02T19:20:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 -- 172.21.15.96:0/1030357429 shutdown_connections 2022-02-02T19:20:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1030357429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f77d0 0x7f6d940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1030357429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f6530 0x7f6d940f6950 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 -- 172.21.15.96:0/1030357429 >> 172.21.15.96:0/1030357429 conn(0x7f6d940f1c90 msgr2=0x7f6d940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 -- 172.21.15.96:0/1030357429 shutdown_connections 2022-02-02T19:20:01.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.637+0000 7f6d9af87700 1 -- 172.21.15.96:0/1030357429 wait complete. 2022-02-02T19:20:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 Processor -- start 2022-02-02T19:20:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 -- start start 2022-02-02T19:20:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 0x7f6d94106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941078f0 con 0x7f6d940f77d0 2022-02-02T19:20:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d9af87700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94108100 con 0x7f6d940f6530 2022-02-02T19:20:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.638+0000 7f6d99784700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59156/0 (socket says 172.21.15.96:59156) 2022-02-02T19:20:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 -- 172.21.15.96:0/1822730671 learned_addr learned my addr 172.21.15.96:0/1822730671 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:01.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99f85700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 0x7f6d94106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 -- 172.21.15.96:0/1822730671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 msgr2=0x7f6d94106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 0x7f6d94106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 -- 172.21.15.96:0/1822730671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84005040 con 0x7f6d940f77d0 2022-02-02T19:20:01.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99f85700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 0x7f6d94106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:20:01.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d99784700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f6d900026d0 tx=0x7f6d90009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d90009320 con 0x7f6d940f77d0 2022-02-02T19:20:01.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d9000f040 con 0x7f6d940f77d0 2022-02-02T19:20:01.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d900147e0 con 0x7f6d940f77d0 2022-02-02T19:20:01.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d94108380 con 0x7f6d940f77d0 2022-02-02T19:20:01.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.639+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d941088f0 con 0x7f6d940f77d0 2022-02-02T19:20:01.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.640+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d94059100 con 0x7f6d940f77d0 2022-02-02T19:20:01.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.641+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d90009480 con 0x7f6d940f77d0 2022-02-02T19:20:01.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.641+0000 7f6d8a7fc700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:01.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.641+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6d90082170 con 0x7f6d940f77d0 2022-02-02T19:20:01.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.641+0000 7f6d99f85700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:01.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.642+0000 7f6d99f85700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f6d84004e30 tx=0x7f6d84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:01.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.645+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d90050220 con 0x7f6d940f77d0 2022-02-02T19:20:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.846+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6d940fedf0 con 0x7f6d940f77d0 2022-02-02T19:20:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.846+0000 7f6d8a7fc700 1 -- 172.21.15.96:0/1822730671 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6d90053840 con 0x7f6d940f77d0 2022-02-02T19:20:01.851 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:20:01.851 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:20:01.851 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:20:01.852 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:20:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:01.852 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:20:01.852 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:20:01.852 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:20:01.853 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:20:01.853 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:20:01.853 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:20:01.853 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:20:01.854 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:20:01.854 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:20:01.854 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:20:01.854 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:20:01.855 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:20:01.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:20:01.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:20:01.855 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:20:01.855 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:20:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:20:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:20:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:20:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:20:01.857 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:20:01.857 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:20:01.857 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:20:01.857 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:20:01.857 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:20:01.858 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:20:01.858 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:20:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:01.859 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:20:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:01.859 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:01.859 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:01.859 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 msgr2=0x7f6d800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f6d84004e30 tx=0x7f6d84009b30).stop 2022-02-02T19:20:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 msgr2=0x7f6d941072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f6d900026d0 tx=0x7f6d90009de0).stop 2022-02-02T19:20:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 shutdown_connections 2022-02-02T19:20:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d80064e20 0x7f6d800672e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d940f6530 0x7f6d94106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 --2- 172.21.15.96:0/1822730671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d940f77d0 0x7f6d941072f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 >> 172.21.15.96:0/1822730671 conn(0x7f6d940f1c90 msgr2=0x7f6d940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 shutdown_connections 2022-02-02T19:20:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:01.848+0000 7f6d9af87700 1 -- 172.21.15.96:0/1822730671 wait complete. 2022-02-02T19:20:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:20:02.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:01 smithi159 ceph-mon[69013]: from='client.35898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:02.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2691259766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:20:02.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1822730671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:20:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:01 smithi096 ceph-mon[101353]: from='client.35898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2691259766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:20:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1822730671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:20:03.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:02 smithi096 ceph-mon[101353]: from='client.35902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:03.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:02 smithi096 ceph-mon[101353]: pgmap v1737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:02 smithi159 ceph-mon[69013]: from='client.35902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:02 smithi159 ceph-mon[69013]: pgmap v1737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:04 smithi159 ceph-mon[69013]: pgmap v1738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:05.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:04 smithi096 ceph-mon[101353]: pgmap v1738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:06 smithi159 ceph-mon[69013]: pgmap v1739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:06 smithi096 ceph-mon[101353]: pgmap v1739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:09.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:08 smithi159 ceph-mon[69013]: pgmap v1740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:08 smithi096 ceph-mon[101353]: pgmap v1740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:10 smithi159 ceph-mon[69013]: pgmap v1741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:10 smithi096 ceph-mon[101353]: pgmap v1741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:13.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:12 smithi096 ceph-mon[101353]: pgmap v1742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:12 smithi159 ceph-mon[69013]: pgmap v1742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:14 smithi159 ceph-mon[69013]: pgmap v1743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:14 smithi096 ceph-mon[101353]: pgmap v1743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:16 smithi159 ceph-mon[69013]: pgmap v1744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:16 smithi096 ceph-mon[101353]: pgmap v1744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:18 smithi159 ceph-mon[69013]: pgmap v1745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:18 smithi096 ceph-mon[101353]: pgmap v1745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:20 smithi159 ceph-mon[69013]: pgmap v1746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:20 smithi096 ceph-mon[101353]: pgmap v1746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:22 smithi096 ceph-mon[101353]: pgmap v1747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:22 smithi159 ceph-mon[69013]: pgmap v1747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:24 smithi159 ceph-mon[69013]: pgmap v1748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:25.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:24 smithi096 ceph-mon[101353]: pgmap v1748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:26 smithi159 ceph-mon[69013]: pgmap v1749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:27.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:26 smithi096 ceph-mon[101353]: pgmap v1749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:20:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:20:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:20:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:20:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:28 smithi159 ceph-mon[69013]: pgmap v1750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:29.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:28 smithi096 ceph-mon[101353]: pgmap v1750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:30 smithi159 ceph-mon[69013]: pgmap v1751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:30 smithi096 ceph-mon[101353]: pgmap v1751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:31.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- 172.21.15.96:0/1350280027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 msgr2=0x7ff0e00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:31.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 --2- 172.21.15.96:0/1350280027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e00f6b00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7ff0dc004660 tx=0x7ff0dc009b30).stop 2022-02-02T19:20:31.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- 172.21.15.96:0/1350280027 shutdown_connections 2022-02-02T19:20:31.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 --2- 172.21.15.96:0/1350280027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:31.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 --2- 172.21.15.96:0/1350280027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e00f6b00 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:31.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- 172.21.15.96:0/1350280027 >> 172.21.15.96:0/1350280027 conn(0x7ff0e00f1e40 msgr2=0x7ff0e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:31.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- 172.21.15.96:0/1350280027 shutdown_connections 2022-02-02T19:20:31.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- 172.21.15.96:0/1350280027 wait complete. 2022-02-02T19:20:31.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 Processor -- start 2022-02-02T19:20:31.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.959+0000 7ff0e7612700 1 -- start start 2022-02-02T19:20:31.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e7612700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:31.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e7612700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:31.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e7612700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0107a50 con 0x7ff0e00f66e0 2022-02-02T19:20:31.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e7612700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0107b90 con 0x7ff0e00f7980 2022-02-02T19:20:31.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:31.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59174/0 (socket says 172.21.15.96:59174) 2022-02-02T19:20:31.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 -- 172.21.15.96:0/3410283917 learned_addr learned my addr 172.21.15.96:0/3410283917 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:31.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e4bad700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:31.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 -- 172.21.15.96:0/3410283917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 msgr2=0x7ff0e01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:31.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:31.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 -- 172.21.15.96:0/3410283917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc005040 con 0x7ff0e00f66e0 2022-02-02T19:20:31.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e4bad700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:20:31.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e53ae700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7ff0dc004f60 tx=0x7ff0dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:31.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc018070 con 0x7ff0e00f66e0 2022-02-02T19:20:31.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e01084d0 con 0x7ff0e00f66e0 2022-02-02T19:20:31.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff0dc007ba0 con 0x7ff0e00f66e0 2022-02-02T19:20:31.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.960+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc01c620 con 0x7ff0e00f66e0 2022-02-02T19:20:31.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.961+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0108a30 con 0x7ff0e00f66e0 2022-02-02T19:20:31.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.962+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0045ad0 con 0x7ff0e00f66e0 2022-02-02T19:20:31.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.962+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff0dc01c8e0 con 0x7ff0e00f66e0 2022-02-02T19:20:31.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.962+0000 7ff0d5ffb700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 0x7ff0cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:31.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.963+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff0dc0839b0 con 0x7ff0e00f66e0 2022-02-02T19:20:31.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.963+0000 7ff0e4bad700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 0x7ff0cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:31.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.963+0000 7ff0e4bad700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 0x7ff0cc067290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff0d0004a90 tx=0x7ff0d0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:31.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:31.967+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff0dc055490 con 0x7ff0e00f66e0 2022-02-02T19:20:32.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.142+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0e00ff010 con 0x7ff0cc064dd0 2022-02-02T19:20:32.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.143+0000 7ff0d5ffb700 1 -- 172.21.15.96:0/3410283917 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff0e00ff010 con 0x7ff0cc064dd0 2022-02-02T19:20:32.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 msgr2=0x7ff0cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 0x7ff0cc067290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff0d0004a90 tx=0x7ff0d0009040).stop 2022-02-02T19:20:32.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 msgr2=0x7ff0e0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7ff0dc004f60 tx=0x7ff0dc009b30).stop 2022-02-02T19:20:32.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 shutdown_connections 2022-02-02T19:20:32.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff0cc064dd0 0x7ff0cc067290 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0e00f66e0 0x7ff0e0106fb0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 --2- 172.21.15.96:0/3410283917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e00f7980 0x7ff0e01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 >> 172.21.15.96:0/3410283917 conn(0x7ff0e00f1e40 msgr2=0x7ff0e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 shutdown_connections 2022-02-02T19:20:32.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.145+0000 7ff0e7612700 1 -- 172.21.15.96:0/3410283917 wait complete. 2022-02-02T19:20:32.159 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:20:32.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 -- 172.21.15.96:0/3625083495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f55c0 msgr2=0x7f60c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 --2- 172.21.15.96:0/3625083495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f55c0 0x7f60c40f59e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f60b8004660 tx=0x7f60b8009b30).stop 2022-02-02T19:20:32.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 -- 172.21.15.96:0/3625083495 shutdown_connections 2022-02-02T19:20:32.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 --2- 172.21.15.96:0/3625083495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f6860 0x7f60c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 --2- 172.21.15.96:0/3625083495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f55c0 0x7f60c40f59e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 -- 172.21.15.96:0/3625083495 >> 172.21.15.96:0/3625083495 conn(0x7f60c40f0d40 msgr2=0x7f60c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 -- 172.21.15.96:0/3625083495 shutdown_connections 2022-02-02T19:20:32.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.243+0000 7f60caf79700 1 -- 172.21.15.96:0/3625083495 wait complete. 2022-02-02T19:20:32.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 Processor -- start 2022-02-02T19:20:32.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 -- start start 2022-02-02T19:20:32.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f55c0 0x7f60c4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4107a10 con 0x7f60c40f6860 2022-02-02T19:20:32.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60caf79700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4107b50 con 0x7f60c40f55c0 2022-02-02T19:20:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59186/0 (socket says 172.21.15.96:59186) 2022-02-02T19:20:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 -- 172.21.15.96:0/383389280 learned_addr learned my addr 172.21.15.96:0/383389280 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c8d15700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f55c0 0x7f60c4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 -- 172.21.15.96:0/383389280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f55c0 msgr2=0x7f60c4106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f55c0 0x7f60c4106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.244+0000 7f60c3fff700 1 -- 172.21.15.96:0/383389280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8005040 con 0x7f60c40f6860 2022-02-02T19:20:32.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60c3fff700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f60b00026d0 tx=0x7f60b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60b00079c0 con 0x7f60c40f6860 2022-02-02T19:20:32.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60b000f040 con 0x7f60c40f6860 2022-02-02T19:20:32.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c41084f0 con 0x7f60c40f6860 2022-02-02T19:20:32.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60b00148b0 con 0x7f60c40f6860 2022-02-02T19:20:32.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.245+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c4108ab0 con 0x7f60c40f6860 2022-02-02T19:20:32.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.246+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c4045ad0 con 0x7f60c40f6860 2022-02-02T19:20:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.246+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f60b0007b20 con 0x7f60c40f6860 2022-02-02T19:20:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.247+0000 7f60c17fa700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 0x7f60b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.247+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f60b0081a30 con 0x7f60c40f6860 2022-02-02T19:20:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.247+0000 7f60c8d15700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 0x7f60b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.247+0000 7f60c8d15700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 0x7f60b4067290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f60b8004630 tx=0x7f60b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.251+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60b0053510 con 0x7f60c40f6860 2022-02-02T19:20:32.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.425+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c40faca0 con 0x7f60b4064dd0 2022-02-02T19:20:32.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.435+0000 7f60c17fa700 1 -- 172.21.15.96:0/383389280 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f60c40faca0 con 0x7f60b4064dd0 2022-02-02T19:20:32.439 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:20:32.440 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (63m) 34m ago 65m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:20:32.440 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (56m) 34m ago 64m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:20:32.440 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (56m) 32m ago 64m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:20:32.440 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (63m) 34m ago 64m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:20:32.441 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (61m) 34m ago 61m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:20:32.441 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (56m) 34m ago 61m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:20:32.441 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (61m) 32m ago 61m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:20:32.441 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (56m) 32m ago 61m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:20:32.442 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (58m) 34m ago 66m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:20:32.442 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (57m) 32m ago 64m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:20:32.442 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (57m) 34m ago 66m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:20:32.442 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (56m) 32m ago 64m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:20:32.442 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (64m) 34m ago 64m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:20:32.443 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (64m) 32m ago 64m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:20:32.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (55m) 34m ago 63m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:20:32.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (55m) 34m ago 63m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:20:32.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (54m) 34m ago 63m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:20:32.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (54m) 32m ago 62m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:20:32.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (53m) 32m ago 62m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:20:32.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (53m) 32m ago 62m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:20:32.444 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (63m) 34m ago 64m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:20:32.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 msgr2=0x7f60b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 0x7f60b4067290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f60b8004630 tx=0x7f60b8009b30).stop 2022-02-02T19:20:32.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 msgr2=0x7f60c4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f60b00026d0 tx=0x7f60b0009de0).stop 2022-02-02T19:20:32.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 shutdown_connections 2022-02-02T19:20:32.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60b4064dd0 0x7f60b4067290 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c40f55c0 0x7f60c4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 --2- 172.21.15.96:0/383389280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60c40f6860 0x7f60c4107460 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 >> 172.21.15.96:0/383389280 conn(0x7f60c40f0d40 msgr2=0x7f60c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 shutdown_connections 2022-02-02T19:20:32.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.437+0000 7f60caf79700 1 -- 172.21.15.96:0/383389280 wait complete. 2022-02-02T19:20:32.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 -- 172.21.15.96:0/3556548131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f6860 msgr2=0x7f71440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 --2- 172.21.15.96:0/3556548131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f6860 0x7f71440f6cc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f7138004660 tx=0x7f7138009b30).stop 2022-02-02T19:20:32.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 -- 172.21.15.96:0/3556548131 shutdown_connections 2022-02-02T19:20:32.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 --2- 172.21.15.96:0/3556548131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f6860 0x7f71440f6cc0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 --2- 172.21.15.96:0/3556548131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f55c0 0x7f71440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 -- 172.21.15.96:0/3556548131 >> 172.21.15.96:0/3556548131 conn(0x7f71440f0d40 msgr2=0x7f71440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 -- 172.21.15.96:0/3556548131 shutdown_connections 2022-02-02T19:20:32.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.534+0000 7f714a1ce700 1 -- 172.21.15.96:0/3556548131 wait complete. 2022-02-02T19:20:32.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 Processor -- start 2022-02-02T19:20:32.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 -- start start 2022-02-02T19:20:32.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f6860 0x7f714410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144060420 con 0x7f71440f55c0 2022-02-02T19:20:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f714a1ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144060560 con 0x7f71440f6860 2022-02-02T19:20:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f71437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f71437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59194/0 (socket says 172.21.15.96:59194) 2022-02-02T19:20:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.535+0000 7f71437fe700 1 -- 172.21.15.96:0/2393885281 learned_addr learned my addr 172.21.15.96:0/2393885281 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f7142ffd700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f6860 0x7f714410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f71437fe700 1 -- 172.21.15.96:0/2393885281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f6860 msgr2=0x7f714410c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f71437fe700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f6860 0x7f714410c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f71437fe700 1 -- 172.21.15.96:0/2393885281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138005040 con 0x7f71440f55c0 2022-02-02T19:20:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f71437fe700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f7134002700 tx=0x7f7134009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7134009320 con 0x7f71440f55c0 2022-02-02T19:20:32.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f713400f040 con 0x7f71440f55c0 2022-02-02T19:20:32.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714410c720 con 0x7f71440f55c0 2022-02-02T19:20:32.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7134014900 con 0x7f71440f55c0 2022-02-02T19:20:32.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.536+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714410ccb0 con 0x7f71440f55c0 2022-02-02T19:20:32.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.537+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144045ad0 con 0x7f71440f55c0 2022-02-02T19:20:32.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.538+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7134009480 con 0x7f71440f55c0 2022-02-02T19:20:32.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.538+0000 7f712bfff700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 0x7f712c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.538+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7134081d60 con 0x7f71440f55c0 2022-02-02T19:20:32.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.538+0000 7f7142ffd700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 0x7f712c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.539+0000 7f7142ffd700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 0x7f712c067290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7138004630 tx=0x7f7138009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.542+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f713404fe10 con 0x7f71440f55c0 2022-02-02T19:20:32.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.771+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71440586e0 con 0x7f71440f55c0 2022-02-02T19:20:32.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.772+0000 7f712bfff700 1 -- 172.21.15.96:0/2393885281 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7134053430 con 0x7f71440f55c0 2022-02-02T19:20:32.777 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:20:32.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:20:32.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:20:32.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:32.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:20:32.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:20:32.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:32.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:20:32.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:20:32.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:32.779 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:20:32.779 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:20:32.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:20:32.779 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:20:32.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:20:32.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:20:32.780 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:20:32.780 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:20:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.773+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 msgr2=0x7f712c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.773+0000 7f714a1ce700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 0x7f712c067290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7138004630 tx=0x7f7138009b30).stop 2022-02-02T19:20:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.773+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 msgr2=0x7f7144109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.773+0000 7f714a1ce700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f7134002700 tx=0x7f7134009d80).stop 2022-02-02T19:20:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 shutdown_connections 2022-02-02T19:20:32.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f712c064dd0 0x7f712c067290 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71440f55c0 0x7f7144109c10 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 --2- 172.21.15.96:0/2393885281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71440f6860 0x7f714410c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 >> 172.21.15.96:0/2393885281 conn(0x7f71440f0d40 msgr2=0x7f71440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 shutdown_connections 2022-02-02T19:20:32.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.774+0000 7f714a1ce700 1 -- 172.21.15.96:0/2393885281 wait complete. 2022-02-02T19:20:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 -- 172.21.15.96:0/3422564231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 msgr2=0x7f54fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 --2- 172.21.15.96:0/3422564231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f6cc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f54e4004660 tx=0x7f54e4009b30).stop 2022-02-02T19:20:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 -- 172.21.15.96:0/3422564231 shutdown_connections 2022-02-02T19:20:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 --2- 172.21.15.96:0/3422564231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f6cc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 --2- 172.21.15.96:0/3422564231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 -- 172.21.15.96:0/3422564231 >> 172.21.15.96:0/3422564231 conn(0x7f54fc0f0d40 msgr2=0x7f54fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 -- 172.21.15.96:0/3422564231 shutdown_connections 2022-02-02T19:20:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 -- 172.21.15.96:0/3422564231 wait complete. 2022-02-02T19:20:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.872+0000 7f55022d4700 1 Processor -- start 2022-02-02T19:20:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f55022d4700 1 -- start start 2022-02-02T19:20:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f55022d4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f55022d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f55022d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0f8100 con 0x7f54fc0f6860 2022-02-02T19:20:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f55022d4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0f8240 con 0x7f54fc0f55c0 2022-02-02T19:20:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59206/0 (socket says 172.21.15.96:59206) 2022-02-02T19:20:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 -- 172.21.15.96:0/3120526859 learned_addr learned my addr 172.21.15.96:0/3120526859 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:20:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fbfff700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 -- 172.21.15.96:0/3120526859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 msgr2=0x7f54fc0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fb7fe700 1 -- 172.21.15.96:0/3120526859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4005040 con 0x7f54fc0f6860 2022-02-02T19:20:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.873+0000 7f54fbfff700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:20:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f54fb7fe700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f54e4009990 tx=0x7f54e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e4018070 con 0x7f54fc0f6860 2022-02-02T19:20:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54e4007ba0 con 0x7f54fc0f6860 2022-02-02T19:20:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc0f84c0 con 0x7f54fc0f6860 2022-02-02T19:20:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e401c3c0 con 0x7f54fc0f6860 2022-02-02T19:20:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.874+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0f8a20 con 0x7f54fc0f6860 2022-02-02T19:20:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.875+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f54e401d420 con 0x7f54fc0f6860 2022-02-02T19:20:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.875+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc045ad0 con 0x7f54fc0f6860 2022-02-02T19:20:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.875+0000 7f54f8ff9700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 0x7f54e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:20:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.875+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f54e40837b0 con 0x7f54fc0f6860 2022-02-02T19:20:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.876+0000 7f54fbfff700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 0x7f54e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:20:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.876+0000 7f54fbfff700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 0x7f54e8067290 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f54fc0f94b0 tx=0x7f54ec009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:20:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:32.880+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f54e4051800 con 0x7f54fc0f6860 2022-02-02T19:20:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.082+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54fc0fdd80 con 0x7f54fc0f6860 2022-02-02T19:20:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.083+0000 7f54f8ff9700 1 -- 172.21.15.96:0/3120526859 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f54e4054e20 con 0x7f54fc0f6860 2022-02-02T19:20:33.088 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:20:33.088 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:20:33.088 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:20:33.088 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:20:33.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:33.089 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:20:33.089 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:20:33.089 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:20:33.090 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:20:33.090 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:20:33.090 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:20:33.090 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:20:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:20:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:20:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:20:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:20:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:20:33.092 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:20:33.092 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:20:33.092 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:20:33.092 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:20:33.093 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:20:33.093 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:20:33.093 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:20:33.093 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:20:33.093 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:20:33.094 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:20:33.094 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:20:33.094 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:20:33.094 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:20:33.095 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:20:33.095 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:20:33.095 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:33.095 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:33.095 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:20:33.096 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:20:33.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:33.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:33.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:20:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 msgr2=0x7f54e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 0x7f54e8067290 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f54fc0f94b0 tx=0x7f54ec009c00).stop 2022-02-02T19:20:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 msgr2=0x7f54fc0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:20:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f54e4009990 tx=0x7f54e4009b30).stop 2022-02-02T19:20:33.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 shutdown_connections 2022-02-02T19:20:33.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54e8064dd0 0x7f54e8067290 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:33.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54fc0f55c0 0x7f54fc0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:33.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 --2- 172.21.15.96:0/3120526859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54fc0f6860 0x7f54fc0f7ba0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:20:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.084+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 >> 172.21.15.96:0/3120526859 conn(0x7f54fc0f0d40 msgr2=0x7f54fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:20:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.085+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 shutdown_connections 2022-02-02T19:20:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:20:33.085+0000 7f55022d4700 1 -- 172.21.15.96:0/3120526859 wait complete. 2022-02-02T19:20:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:20:33.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:32 smithi096 ceph-mon[101353]: pgmap v1752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:33.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2393885281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:20:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:32 smithi159 ceph-mon[69013]: pgmap v1752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2393885281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:20:34.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:33 smithi159 ceph-mon[69013]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:34.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:33 smithi159 ceph-mon[69013]: from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:34.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3120526859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:20:34.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:33 smithi096 ceph-mon[101353]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:34.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:33 smithi096 ceph-mon[101353]: from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:20:34.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3120526859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:20:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:34 smithi159 ceph-mon[69013]: pgmap v1753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:35.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:34 smithi096 ceph-mon[101353]: pgmap v1753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:36 smithi159 ceph-mon[69013]: pgmap v1754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:36 smithi096 ceph-mon[101353]: pgmap v1754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:39.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:38 smithi159 ceph-mon[69013]: pgmap v1755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:38 smithi096 ceph-mon[101353]: pgmap v1755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:40 smithi159 ceph-mon[69013]: pgmap v1756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:40 smithi096 ceph-mon[101353]: pgmap v1756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:43.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:42 smithi096 ceph-mon[101353]: pgmap v1757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:42 smithi159 ceph-mon[69013]: pgmap v1757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:44 smithi159 ceph-mon[69013]: pgmap v1758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:44 smithi096 ceph-mon[101353]: pgmap v1758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:46 smithi159 ceph-mon[69013]: pgmap v1759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:46 smithi096 ceph-mon[101353]: pgmap v1759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:48 smithi159 ceph-mon[69013]: pgmap v1760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:49.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:48 smithi096 ceph-mon[101353]: pgmap v1760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:50 smithi159 ceph-mon[69013]: pgmap v1761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:50 smithi096 ceph-mon[101353]: pgmap v1761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:53.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:52 smithi096 ceph-mon[101353]: pgmap v1762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:52 smithi159 ceph-mon[69013]: pgmap v1762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:54 smithi159 ceph-mon[69013]: pgmap v1763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:54 smithi096 ceph-mon[101353]: pgmap v1763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:56 smithi159 ceph-mon[69013]: pgmap v1764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:56 smithi096 ceph-mon[101353]: pgmap v1764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:59.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:20:58 smithi159 ceph-mon[69013]: pgmap v1765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:20:59.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:20:58 smithi096 ceph-mon[101353]: pgmap v1765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:00 smithi159 ceph-mon[69013]: pgmap v1766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:00 smithi096 ceph-mon[101353]: pgmap v1766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:03.200 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:02 smithi096 ceph-mon[101353]: pgmap v1767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:03.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3529051589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 msgr2=0x7fd3a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3529051589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f59e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fd398004660 tx=0x7fd398009b30).stop 2022-02-02T19:21:03.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3529051589 shutdown_connections 2022-02-02T19:21:03.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3529051589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:21:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3529051589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f59e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3529051589 >> 172.21.15.96:0/3529051589 conn(0x7fd3a40f0d40 msgr2=0x7fd3a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3529051589 shutdown_connections 2022-02-02T19:21:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3529051589 wait complete. 2022-02-02T19:21:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.194+0000 7fd3a9aa4700 1 Processor -- start 2022-02-02T19:21:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a9aa4700 1 -- start start 2022-02-02T19:21:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a9aa4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a9aa4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a9aa4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40f8190 con 0x7fd3a40f6860 2022-02-02T19:21:03.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a9aa4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40f82d0 con 0x7fd3a40f55c0 2022-02-02T19:21:03.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59226/0 (socket says 172.21.15.96:59226) 2022-02-02T19:21:03.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 -- 172.21.15.96:0/3564826570 learned_addr learned my addr 172.21.15.96:0/3564826570 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:03.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a37fe700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 -- 172.21.15.96:0/3564826570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 msgr2=0x7fd3a40f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.195+0000 7fd3a2ffd700 1 -- 172.21.15.96:0/3564826570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398005040 con 0x7fd3a40f6860 2022-02-02T19:21:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd3a2ffd700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fd39400b410 tx=0x7fd394006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3940125f0 con 0x7fd3a40f6860 2022-02-02T19:21:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd39400be30 con 0x7fd3a40f6860 2022-02-02T19:21:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a40f85b0 con 0x7fd3a40f6860 2022-02-02T19:21:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd394002a70 con 0x7fd3a40f6860 2022-02-02T19:21:03.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.196+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a410efc0 con 0x7fd3a40f6860 2022-02-02T19:21:03.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.197+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a4045ad0 con 0x7fd3a40f6860 2022-02-02T19:21:03.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.197+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd39400f030 con 0x7fd3a40f6860 2022-02-02T19:21:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.198+0000 7fd38bfff700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 0x7fd38c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.198+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd394081ed0 con 0x7fd3a40f6860 2022-02-02T19:21:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.198+0000 7fd3a37fe700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 0x7fd38c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.198+0000 7fd3a37fe700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 0x7fd38c067290 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fd398013690 tx=0x7fd398009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.202+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd39404ff80 con 0x7fd3a40f6860 2022-02-02T19:21:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:02 smithi159 ceph-mon[69013]: pgmap v1767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.381+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a40faca0 con 0x7fd38c064dd0 2022-02-02T19:21:03.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.383+0000 7fd38bfff700 1 -- 172.21.15.96:0/3564826570 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd3a40faca0 con 0x7fd38c064dd0 2022-02-02T19:21:03.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 msgr2=0x7fd38c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 0x7fd38c067290 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fd398013690 tx=0x7fd398009b30).stop 2022-02-02T19:21:03.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 msgr2=0x7fd3a40f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fd39400b410 tx=0x7fd394006ef0).stop 2022-02-02T19:21:03.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 shutdown_connections 2022-02-02T19:21:03.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd38c064dd0 0x7fd38c067290 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 --2- 172.21.15.96:0/3564826570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f7ba0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.384+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 >> 172.21.15.96:0/3564826570 conn(0x7fd3a40f0d40 msgr2=0x7fd3a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.385+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 shutdown_connections 2022-02-02T19:21:03.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.385+0000 7fd3a9aa4700 1 -- 172.21.15.96:0/3564826570 wait complete. 2022-02-02T19:21:03.399 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:21:03.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 -- 172.21.15.96:0/2510222764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 msgr2=0x7f094c0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 --2- 172.21.15.96:0/2510222764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f9340 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f093c004660 tx=0x7f093c009b30).stop 2022-02-02T19:21:03.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 -- 172.21.15.96:0/2510222764 shutdown_connections 2022-02-02T19:21:03.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 --2- 172.21.15.96:0/2510222764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 --2- 172.21.15.96:0/2510222764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f9340 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 -- 172.21.15.96:0/2510222764 >> 172.21.15.96:0/2510222764 conn(0x7f094c0f0d40 msgr2=0x7f094c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:03.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 -- 172.21.15.96:0/2510222764 shutdown_connections 2022-02-02T19:21:03.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 -- 172.21.15.96:0/2510222764 wait complete. 2022-02-02T19:21:03.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.482+0000 7f095367c700 1 Processor -- start 2022-02-02T19:21:03.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f095367c700 1 -- start start 2022-02-02T19:21:03.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f095367c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f095367c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f095367c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0f57a0 con 0x7f094c060270 2022-02-02T19:21:03.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f095367c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0f58e0 con 0x7f094c0f9830 2022-02-02T19:21:03.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59234/0 (socket says 172.21.15.96:59234) 2022-02-02T19:21:03.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 -- 172.21.15.96:0/1803660612 learned_addr learned my addr 172.21.15.96:0/1803660612 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:03.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0950c17700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 -- 172.21.15.96:0/1803660612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 msgr2=0x7f094c0f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 -- 172.21.15.96:0/1803660612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c005040 con 0x7f094c060270 2022-02-02T19:21:03.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0950c17700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:21:03.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0951418700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f093c009990 tx=0x7f093c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.483+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c018070 con 0x7f094c060270 2022-02-02T19:21:03.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.484+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f093c007ca0 con 0x7f094c060270 2022-02-02T19:21:03.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.484+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c0f5b60 con 0x7f094c060270 2022-02-02T19:21:03.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.484+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c01c600 con 0x7f094c060270 2022-02-02T19:21:03.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.484+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0f60c0 con 0x7f094c060270 2022-02-02T19:21:03.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.485+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c045ad0 con 0x7f094c060270 2022-02-02T19:21:03.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.485+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f093c01d9d0 con 0x7f094c060270 2022-02-02T19:21:03.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.485+0000 7f0941ffb700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 0x7f0938067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.485+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f093c083910 con 0x7f094c060270 2022-02-02T19:21:03.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.486+0000 7f0950c17700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 0x7f0938067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.486+0000 7f0950c17700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 0x7f0938067290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f09480041d0 tx=0x7f0948009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.490+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f093c0519c0 con 0x7f094c060270 2022-02-02T19:21:03.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.662+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f094c0ff020 con 0x7f0938064dd0 2022-02-02T19:21:03.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.672+0000 7f0941ffb700 1 -- 172.21.15.96:0/1803660612 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f094c0ff020 con 0x7f0938064dd0 2022-02-02T19:21:03.677 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:21:03.677 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (64m) 35m ago 65m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:21:03.678 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (56m) 35m ago 65m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:21:03.678 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (56m) 33m ago 64m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:21:03.678 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (64m) 35m ago 65m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:21:03.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (61m) 35m ago 61m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:21:03.679 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (57m) 35m ago 61m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:21:03.679 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (61m) 33m ago 61m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:21:03.679 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (57m) 33m ago 61m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:21:03.679 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (58m) 35m ago 66m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:21:03.680 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (58m) 33m ago 64m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:21:03.680 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (57m) 35m ago 66m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:21:03.680 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (57m) 33m ago 64m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:21:03.680 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (65m) 35m ago 65m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:21:03.680 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (64m) 33m ago 64m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:21:03.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (56m) 35m ago 64m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:21:03.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (55m) 35m ago 64m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:21:03.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (55m) 35m ago 63m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:21:03.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (54m) 33m ago 63m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:21:03.682 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (54m) 33m ago 63m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:21:03.682 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (53m) 33m ago 62m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:21:03.682 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (64m) 35m ago 65m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:21:03.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 msgr2=0x7f0938067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 0x7f0938067290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f09480041d0 tx=0x7f0948009040).stop 2022-02-02T19:21:03.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 msgr2=0x7f094c0f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f093c009990 tx=0x7f093c009b30).stop 2022-02-02T19:21:03.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 shutdown_connections 2022-02-02T19:21:03.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0938064dd0 0x7f0938067290 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094c060270 0x7f094c0f6dc0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 --2- 172.21.15.96:0/1803660612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f094c0f9830 0x7f094c0f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.673+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 >> 172.21.15.96:0/1803660612 conn(0x7f094c0f0d40 msgr2=0x7f094c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:03.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.674+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 shutdown_connections 2022-02-02T19:21:03.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.674+0000 7f095367c700 1 -- 172.21.15.96:0/1803660612 wait complete. 2022-02-02T19:21:03.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2135603537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 msgr2=0x7f4dbc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2135603537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc0f6b00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f4db0004660 tx=0x7f4db0009b30).stop 2022-02-02T19:21:03.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2135603537 shutdown_connections 2022-02-02T19:21:03.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2135603537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 0x7f4dbc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2135603537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc0f6b00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2135603537 >> 172.21.15.96:0/2135603537 conn(0x7f4dbc0f1e40 msgr2=0x7f4dbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:03.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2135603537 shutdown_connections 2022-02-02T19:21:03.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.770+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2135603537 wait complete. 2022-02-02T19:21:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 Processor -- start 2022-02-02T19:21:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 -- start start 2022-02-02T19:21:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 0x7f4dbc069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc069840 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dc1e85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc110b70 con 0x7f4dbc0f7980 2022-02-02T19:21:03.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dbb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dbb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59244/0 (socket says 172.21.15.96:59244) 2022-02-02T19:21:03.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dbb7fe700 1 -- 172.21.15.96:0/2313404801 learned_addr learned my addr 172.21.15.96:0/2313404801 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:03.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.771+0000 7f4dbaffd700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 0x7f4dbc069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dbb7fe700 1 -- 172.21.15.96:0/2313404801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 msgr2=0x7f4dbc069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:03.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dbb7fe700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 0x7f4dbc069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:03.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dbb7fe700 1 -- 172.21.15.96:0/2313404801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0005040 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dbb7fe700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f4db0013a70 tx=0x7f4db0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db0018070 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc110df0 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4db00097d0 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db001de80 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.772+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc111350 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.773+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc0f5ad0 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.774+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4db0007ba0 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.774+0000 7f4da3fff700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 0x7f4da4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:03.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.774+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4db00836a0 con 0x7f4dbc0f66e0 2022-02-02T19:21:03.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.774+0000 7f4dbaffd700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 0x7f4da4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:03.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.774+0000 7f4dbaffd700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 0x7f4da4067290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f4dbc068ae0 tx=0x7f4dac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:03.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:03.778+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4db0055240 con 0x7f4dbc0f66e0 2022-02-02T19:21:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.010+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4dbc027a00 con 0x7f4dbc0f66e0 2022-02-02T19:21:04.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.011+0000 7f4da3fff700 1 -- 172.21.15.96:0/2313404801 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4db0054e30 con 0x7f4dbc0f66e0 2022-02-02T19:21:04.017 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:21:04.017 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:21:04.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:21:04.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:04.018 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:21:04.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:21:04.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:04.019 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:21:04.019 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:21:04.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:04.020 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:21:04.020 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:21:04.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:04.020 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:21:04.020 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:21:04.021 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:21:04.021 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:21:04.021 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:21:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 msgr2=0x7f4da4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 0x7f4da4067290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f4dbc068ae0 tx=0x7f4dac00b040).stop 2022-02-02T19:21:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 msgr2=0x7f4dbc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f4db0013a70 tx=0x7f4db0009b30).stop 2022-02-02T19:21:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 shutdown_connections 2022-02-02T19:21:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4da4064dd0 0x7f4da4067290 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dbc0f66e0 0x7f4dbc068d50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 --2- 172.21.15.96:0/2313404801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dbc0f7980 0x7f4dbc069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 >> 172.21.15.96:0/2313404801 conn(0x7f4dbc0f1e40 msgr2=0x7f4dbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 shutdown_connections 2022-02-02T19:21:04.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.013+0000 7f4dc1e85700 1 -- 172.21.15.96:0/2313404801 wait complete. 2022-02-02T19:21:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.110+0000 7f777ede4700 1 -- 172.21.15.96:0/690680317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77780f7480 msgr2=0x7f77780f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.110+0000 7f777ede4700 1 --2- 172.21.15.96:0/690680317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77780f7480 0x7f77780f9910 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f7768004660 tx=0x7f7768009b30).stop 2022-02-02T19:21:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- 172.21.15.96:0/690680317 shutdown_connections 2022-02-02T19:21:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 --2- 172.21.15.96:0/690680317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77780f7480 0x7f77780f9910 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 --2- 172.21.15.96:0/690680317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7778060310 0x7f77780f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- 172.21.15.96:0/690680317 >> 172.21.15.96:0/690680317 conn(0x7f77780f0b90 msgr2=0x7f77780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- 172.21.15.96:0/690680317 shutdown_connections 2022-02-02T19:21:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- 172.21.15.96:0/690680317 wait complete. 2022-02-02T19:21:04.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 Processor -- start 2022-02-02T19:21:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- start start 2022-02-02T19:21:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77780f7480 0x7f777810d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:04.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777810ddd0 con 0x7f7778060310 2022-02-02T19:21:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777ede4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777810df10 con 0x7f77780f7480 2022-02-02T19:21:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777dde2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777dde2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59254/0 (socket says 172.21.15.96:59254) 2022-02-02T19:21:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.111+0000 7f777dde2700 1 -- 172.21.15.96:0/3825827999 learned_addr learned my addr 172.21.15.96:0/3825827999 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777dde2700 1 -- 172.21.15.96:0/3825827999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77780f7480 msgr2=0x7f777810d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777dde2700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77780f7480 0x7f777810d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:21:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777dde2700 1 -- 172.21.15.96:0/3825827999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768005040 con 0x7f7778060310 2022-02-02T19:21:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777dde2700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f77740026d0 tx=0x7f7774009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7774009320 con 0x7f7778060310 2022-02-02T19:21:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f777400f040 con 0x7f7778060310 2022-02-02T19:21:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77740147e0 con 0x7f7778060310 2022-02-02T19:21:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777810e8b0 con 0x7f7778060310 2022-02-02T19:21:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.112+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777810ee70 con 0x7f7778060310 2022-02-02T19:21:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.113+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778045ad0 con 0x7f7778060310 2022-02-02T19:21:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.113+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7774009480 con 0x7f7778060310 2022-02-02T19:21:04.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.114+0000 7f776e7fc700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 0x7f77640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:04.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.114+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7774082170 con 0x7f7778060310 2022-02-02T19:21:04.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.114+0000 7f777d5e1700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 0x7f77640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:04.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.114+0000 7f777d5e1700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 0x7f77640672e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f7768004e30 tx=0x7f7768009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:04.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.118+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7774053c50 con 0x7f7778060310 2022-02-02T19:21:04.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.315+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f777810f0f0 con 0x7f7778060310 2022-02-02T19:21:04.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.316+0000 7f776e7fc700 1 -- 172.21.15.96:0/3825827999 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7774053840 con 0x7f7778060310 2022-02-02T19:21:04.322 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:21:04.322 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:21:04.322 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:21:04.322 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:21:04.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:04.323 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:21:04.324 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:21:04.324 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:21:04.324 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:21:04.324 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:21:04.324 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:21:04.325 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:21:04.325 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:21:04.325 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:21:04.325 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:21:04.326 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:21:04.326 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:21:04.326 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:21:04.326 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:21:04.326 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:21:04.327 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:21:04.327 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:21:04.327 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:21:04.327 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:21:04.328 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:21:04.328 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:21:04.328 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:21:04.328 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:21:04.328 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:21:04.329 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:21:04.329 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:21:04.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:21:04.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:04.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:04.330 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:21:04.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:04.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:04.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:04.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 msgr2=0x7f77640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 0x7f77640672e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f7768004e30 tx=0x7f7768009b30).stop 2022-02-02T19:21:04.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 msgr2=0x7f777810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:04.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f77740026d0 tx=0x7f7774009de0).stop 2022-02-02T19:21:04.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 shutdown_connections 2022-02-02T19:21:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7764064e20 0x7f77640672e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7778060310 0x7f777810d330 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 --2- 172.21.15.96:0/3825827999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77780f7480 0x7f777810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:21:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 >> 172.21.15.96:0/3825827999 conn(0x7f77780f0b90 msgr2=0x7f77780f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 shutdown_connections 2022-02-02T19:21:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:04.319+0000 7f777ede4700 1 -- 172.21.15.96:0/3825827999 wait complete. 2022-02-02T19:21:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:21:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:04 smithi159 ceph-mon[69013]: from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:04 smithi159 ceph-mon[69013]: from='client.35934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:05.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:04 smithi159 ceph-mon[69013]: pgmap v1768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:05.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2313404801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:21:05.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3825827999' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:21:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:04 smithi096 ceph-mon[101353]: from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:04 smithi096 ceph-mon[101353]: from='client.35934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:04 smithi096 ceph-mon[101353]: pgmap v1768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2313404801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:21:05.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3825827999' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:21:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:06 smithi159 ceph-mon[69013]: pgmap v1769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:06 smithi096 ceph-mon[101353]: pgmap v1769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:09.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:08 smithi159 ceph-mon[69013]: pgmap v1770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:08 smithi096 ceph-mon[101353]: pgmap v1770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:10 smithi159 ceph-mon[69013]: pgmap v1771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:11.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:10 smithi096 ceph-mon[101353]: pgmap v1771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:13.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:12 smithi096 ceph-mon[101353]: pgmap v1772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:12 smithi159 ceph-mon[69013]: pgmap v1772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:14 smithi159 ceph-mon[69013]: pgmap v1773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:14 smithi096 ceph-mon[101353]: pgmap v1773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:16 smithi159 ceph-mon[69013]: pgmap v1774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:16 smithi096 ceph-mon[101353]: pgmap v1774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:18 smithi159 ceph-mon[69013]: pgmap v1775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:18 smithi096 ceph-mon[101353]: pgmap v1775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:20 smithi159 ceph-mon[69013]: pgmap v1776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:20 smithi096 ceph-mon[101353]: pgmap v1776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:23.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:22 smithi096 ceph-mon[101353]: pgmap v1777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:22 smithi159 ceph-mon[69013]: pgmap v1777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:24 smithi159 ceph-mon[69013]: pgmap v1778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:25.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:24 smithi096 ceph-mon[101353]: pgmap v1778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:26 smithi159 ceph-mon[69013]: pgmap v1779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:27.461 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:26 smithi096 ceph-mon[101353]: pgmap v1779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:21:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:21:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:21:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:21:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:28 smithi159 ceph-mon[69013]: pgmap v1780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:28 smithi096 ceph-mon[101353]: pgmap v1780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:30 smithi159 ceph-mon[69013]: pgmap v1781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:30 smithi096 ceph-mon[101353]: pgmap v1781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:33.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:32 smithi096 ceph-mon[101353]: pgmap v1782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:32 smithi159 ceph-mon[69013]: pgmap v1782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:34.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/1723117194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f66e0 msgr2=0x7f5cc40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/1723117194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f66e0 0x7f5cc40f6b00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f5cb4004660 tx=0x7f5cb4009b30).stop 2022-02-02T19:21:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/1723117194 shutdown_connections 2022-02-02T19:21:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/1723117194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/1723117194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f66e0 0x7f5cc40f6b00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/1723117194 >> 172.21.15.96:0/1723117194 conn(0x7f5cc40f1f00 msgr2=0x7f5cc40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:34.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/1723117194 shutdown_connections 2022-02-02T19:21:34.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.431+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/1723117194 wait complete. 2022-02-02T19:21:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.432+0000 7f5cc9ad8700 1 Processor -- start 2022-02-02T19:21:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.432+0000 7f5cc9ad8700 1 -- start start 2022-02-02T19:21:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc9ad8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f66e0 0x7f5cc4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc9ad8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc9ad8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4107a00 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc9ad8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4107b40 con 0x7f5cc40f66e0 2022-02-02T19:21:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59276/0 (socket says 172.21.15.96:59276) 2022-02-02T19:21:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 -- 172.21.15.96:0/3768833640 learned_addr learned my addr 172.21.15.96:0/3768833640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc37fe700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f66e0 0x7f5cc4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 -- 172.21.15.96:0/3768833640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f66e0 msgr2=0x7f5cc4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f66e0 0x7f5cc4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 -- 172.21.15.96:0/3768833640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4005040 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cc2ffd700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f5cac0026d0 tx=0x7f5cac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.433+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cac0079c0 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.434+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc41084e0 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.434+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cac00f040 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.434+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cac0148b0 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.434+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4108aa0 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.435+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4045ad0 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.435+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cac007b20 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.435+0000 7f5cbbfff700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 0x7f5cb0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.435+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5cac081950 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.436+0000 7f5cc37fe700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 0x7f5cb0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.436+0000 7f5cc37fe700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 0x7f5cb0067290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5cb4004630 tx=0x7f5cb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:34.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.440+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cac053430 con 0x7f5cc40f6ff0 2022-02-02T19:21:34.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.620+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc40ff080 con 0x7f5cb0064dd0 2022-02-02T19:21:34.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.621+0000 7f5cbbfff700 1 -- 172.21.15.96:0/3768833640 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5cb4019040 con 0x7f5cb0064dd0 2022-02-02T19:21:34.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 msgr2=0x7f5cb0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 0x7f5cb0067290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5cb4004630 tx=0x7f5cb4009b30).stop 2022-02-02T19:21:34.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 msgr2=0x7f5cc4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f5cac0026d0 tx=0x7f5cac009de0).stop 2022-02-02T19:21:34.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 shutdown_connections 2022-02-02T19:21:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cb0064dd0 0x7f5cb0067290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cc40f66e0 0x7f5cc4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 --2- 172.21.15.96:0/3768833640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc40f6ff0 0x7f5cc4107450 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 >> 172.21.15.96:0/3768833640 conn(0x7f5cc40f1f00 msgr2=0x7f5cc40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:34.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 shutdown_connections 2022-02-02T19:21:34.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.623+0000 7f5cc9ad8700 1 -- 172.21.15.96:0/3768833640 wait complete. 2022-02-02T19:21:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:21:34.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 -- 172.21.15.96:0/3723836506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f66d0 msgr2=0x7f99e80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 --2- 172.21.15.96:0/3723836506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f66d0 0x7f99e80f6b30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f99dc004660 tx=0x7f99dc009b30).stop 2022-02-02T19:21:34.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 -- 172.21.15.96:0/3723836506 shutdown_connections 2022-02-02T19:21:34.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 --2- 172.21.15.96:0/3723836506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f66d0 0x7f99e80f6b30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 --2- 172.21.15.96:0/3723836506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f5430 0x7f99e80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 -- 172.21.15.96:0/3723836506 >> 172.21.15.96:0/3723836506 conn(0x7f99e80f0b90 msgr2=0x7f99e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:34.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 -- 172.21.15.96:0/3723836506 shutdown_connections 2022-02-02T19:21:34.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.720+0000 7f99ec956700 1 -- 172.21.15.96:0/3723836506 wait complete. 2022-02-02T19:21:34.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 Processor -- start 2022-02-02T19:21:34.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 -- start start 2022-02-02T19:21:34.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f66d0 0x7f99e81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8106760 con 0x7f99e80f5430 2022-02-02T19:21:34.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.721+0000 7f99ec956700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8106f60 con 0x7f99e80f66d0 2022-02-02T19:21:34.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59284/0 (socket says 172.21.15.96:59284) 2022-02-02T19:21:34.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 -- 172.21.15.96:0/3466182093 learned_addr learned my addr 172.21.15.96:0/3466182093 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:34.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e659c700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f66d0 0x7f99e81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 -- 172.21.15.96:0/3466182093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f66d0 msgr2=0x7f99e81061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f66d0 0x7f99e81061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 -- 172.21.15.96:0/3466182093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc005040 con 0x7f99e80f5430 2022-02-02T19:21:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99e6d9d700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f99d8002700 tx=0x7f99d8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:34.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d80079c0 con 0x7f99e80f5430 2022-02-02T19:21:34.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99d800f040 con 0x7f99e80f5430 2022-02-02T19:21:34.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d8014860 con 0x7f99e80f5430 2022-02-02T19:21:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e8107240 con 0x7f99e80f5430 2022-02-02T19:21:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.722+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8107780 con 0x7f99e80f5430 2022-02-02T19:21:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.723+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8045ad0 con 0x7f99e80f5430 2022-02-02T19:21:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.724+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99d801b060 con 0x7f99e80f5430 2022-02-02T19:21:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.724+0000 7f99cf7fe700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 0x7f99d00694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.724+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f99d8081910 con 0x7f99e80f5430 2022-02-02T19:21:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.724+0000 7f99e659c700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 0x7f99d00694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.725+0000 7f99e659c700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 0x7f99d00694f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f99dc004630 tx=0x7f99dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.728+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99d80533f0 con 0x7f99e80f5430 2022-02-02T19:21:34.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.899+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e80ff710 con 0x7f99d0067030 2022-02-02T19:21:34.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.908+0000 7f99cf7fe700 1 -- 172.21.15.96:0/3466182093 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f99e80ff710 con 0x7f99d0067030 2022-02-02T19:21:34.913 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:21:34.913 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (64m) 35m ago 66m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:21:34.914 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (57m) 35m ago 65m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:21:34.914 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (57m) 33m ago 65m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:21:34.914 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (64m) 35m ago 65m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:21:34.914 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (62m) 35m ago 62m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:21:34.915 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (57m) 35m ago 62m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:21:34.915 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (62m) 33m ago 62m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:21:34.915 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (57m) 33m ago 62m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:21:34.915 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (59m) 35m ago 67m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:21:34.916 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (58m) 33m ago 65m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:21:34.916 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (58m) 35m ago 67m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:21:34.916 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (57m) 33m ago 65m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:21:34.916 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (65m) 35m ago 65m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:21:34.916 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (65m) 33m ago 65m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:21:34.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (57m) 35m ago 64m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:21:34.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (56m) 35m ago 64m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:21:34.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (55m) 35m ago 64m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:21:34.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (55m) 33m ago 63m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:21:34.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (54m) 33m ago 63m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:21:34.918 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (54m) 33m ago 63m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:21:34.918 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (64m) 35m ago 65m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:21:34.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 msgr2=0x7f99d00694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 0x7f99d00694f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f99dc004630 tx=0x7f99dc009b30).stop 2022-02-02T19:21:34.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 msgr2=0x7f99e8105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:34.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f99d8002700 tx=0x7f99d8009d80).stop 2022-02-02T19:21:34.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 shutdown_connections 2022-02-02T19:21:34.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99d0067030 0x7f99d00694f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99e80f5430 0x7f99e8105cc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 --2- 172.21.15.96:0/3466182093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99e80f66d0 0x7f99e81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:34.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.910+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 >> 172.21.15.96:0/3466182093 conn(0x7f99e80f0b90 msgr2=0x7f99e80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:34.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.911+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 shutdown_connections 2022-02-02T19:21:34.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:34.911+0000 7f99ec956700 1 -- 172.21.15.96:0/3466182093 wait complete. 2022-02-02T19:21:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 -- 172.21.15.96:0/4234675359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 msgr2=0x7f0dc40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/4234675359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc40f7c30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f0dc0004660 tx=0x7f0dc0009b30).stop 2022-02-02T19:21:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 -- 172.21.15.96:0/4234675359 shutdown_connections 2022-02-02T19:21:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/4234675359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc40f7c30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/4234675359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 0x7f0dc40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 -- 172.21.15.96:0/4234675359 >> 172.21.15.96:0/4234675359 conn(0x7f0dc40f1c90 msgr2=0x7f0dc40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:35.014 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:34 smithi096 ceph-mon[101353]: pgmap v1783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 -- 172.21.15.96:0/4234675359 shutdown_connections 2022-02-02T19:21:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.008+0000 7f0dcaec4700 1 -- 172.21.15.96:0/4234675359 wait complete. 2022-02-02T19:21:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 Processor -- start 2022-02-02T19:21:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 -- start start 2022-02-02T19:21:35.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 0x7f0dc4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4107880 con 0x7f0dc40f77d0 2022-02-02T19:21:35.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dcaec4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4108090 con 0x7f0dc40f6530 2022-02-02T19:21:35.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59296/0 (socket says 172.21.15.96:59296) 2022-02-02T19:21:35.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 -- 172.21.15.96:0/13189228 learned_addr learned my addr 172.21.15.96:0/13189228 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:35.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc9ec2700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 0x7f0dc4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 -- 172.21.15.96:0/13189228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 msgr2=0x7f0dc4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 0x7f0dc4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 -- 172.21.15.96:0/13189228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0005040 con 0x7f0dc40f77d0 2022-02-02T19:21:35.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.009+0000 7f0dc96c1700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f0dc0009990 tx=0x7f0dc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:35.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.010+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc0018070 con 0x7f0dc40f77d0 2022-02-02T19:21:35.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.010+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc41082b0 con 0x7f0dc40f77d0 2022-02-02T19:21:35.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.010+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0dc0007ba0 con 0x7f0dc40f77d0 2022-02-02T19:21:35.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.010+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc001c3c0 con 0x7f0dc40f77d0 2022-02-02T19:21:35.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.010+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4108810 con 0x7f0dc40f77d0 2022-02-02T19:21:35.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.011+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc4059100 con 0x7f0dc40f77d0 2022-02-02T19:21:35.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.011+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0dc001d420 con 0x7f0dc40f77d0 2022-02-02T19:21:35.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.012+0000 7f0dba7fc700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 0x7f0db00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.012+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0dc0083700 con 0x7f0dc40f77d0 2022-02-02T19:21:35.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.012+0000 7f0dc9ec2700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 0x7f0db00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.012+0000 7f0dc9ec2700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 0x7f0db00672e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f0dc4106b00 tx=0x7f0db400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:35.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.016+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0dc0051810 con 0x7f0dc40f77d0 2022-02-02T19:21:35.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.245+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0dc40fee80 con 0x7f0dc40f77d0 2022-02-02T19:21:35.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.245+0000 7f0dba7fc700 1 -- 172.21.15.96:0/13189228 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0dc40fee80 con 0x7f0dc40f77d0 2022-02-02T19:21:35.250 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:21:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:21:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:21:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:21:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:21:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:21:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:21:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:21:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:21:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:21:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:21:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:21:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:21:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:21:35.254 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:21:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 msgr2=0x7f0db00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 0x7f0db00672e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f0dc4106b00 tx=0x7f0db400b040).stop 2022-02-02T19:21:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 msgr2=0x7f0dc4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f0dc0009990 tx=0x7f0dc0009b30).stop 2022-02-02T19:21:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 shutdown_connections 2022-02-02T19:21:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db0064e20 0x7f0db00672e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc40f6530 0x7f0dc4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 --2- 172.21.15.96:0/13189228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dc40f77d0 0x7f0dc4107280 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 >> 172.21.15.96:0/13189228 conn(0x7f0dc40f1c90 msgr2=0x7f0dc40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 shutdown_connections 2022-02-02T19:21:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.247+0000 7f0dcaec4700 1 -- 172.21.15.96:0/13189228 wait complete. 2022-02-02T19:21:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:34 smithi159 ceph-mon[69013]: pgmap v1783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:35.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- 172.21.15.96:0/2697334298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 msgr2=0x7f45740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 --2- 172.21.15.96:0/2697334298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f45740f6b00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4564004660 tx=0x7f4564009b30).stop 2022-02-02T19:21:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- 172.21.15.96:0/2697334298 shutdown_connections 2022-02-02T19:21:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 --2- 172.21.15.96:0/2697334298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 0x7f45740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 --2- 172.21.15.96:0/2697334298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f45740f6b00 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- 172.21.15.96:0/2697334298 >> 172.21.15.96:0/2697334298 conn(0x7f45740f1e40 msgr2=0x7f45740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:35.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- 172.21.15.96:0/2697334298 shutdown_connections 2022-02-02T19:21:35.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- 172.21.15.96:0/2697334298 wait complete. 2022-02-02T19:21:35.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 Processor -- start 2022-02-02T19:21:35.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.345+0000 7f457a6ed700 1 -- start start 2022-02-02T19:21:35.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f457a6ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f457a6ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 0x7f45741074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f457a6ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574107a90 con 0x7f45740f66e0 2022-02-02T19:21:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f457a6ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574107bd0 con 0x7f45740f7980 2022-02-02T19:21:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59304/0 (socket says 172.21.15.96:59304) 2022-02-02T19:21:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 -- 172.21.15.96:0/710912103 learned_addr learned my addr 172.21.15.96:0/710912103 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:21:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f45737fe700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 0x7f45741074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 -- 172.21.15.96:0/710912103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 msgr2=0x7f45741074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 0x7f45741074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 -- 172.21.15.96:0/710912103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564005040 con 0x7f45740f66e0 2022-02-02T19:21:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4573fff700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4564013a70 tx=0x7f4564009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4564018070 con 0x7f45740f66e0 2022-02-02T19:21:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4574108510 con 0x7f45740f66e0 2022-02-02T19:21:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.346+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f45640097d0 con 0x7f45740f66e0 2022-02-02T19:21:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.347+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456401de80 con 0x7f45740f66e0 2022-02-02T19:21:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.347+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4574108a70 con 0x7f45740f66e0 2022-02-02T19:21:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.348+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574045ad0 con 0x7f45740f66e0 2022-02-02T19:21:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.349+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4564007ba0 con 0x7f45740f66e0 2022-02-02T19:21:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.349+0000 7f4570ff9700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 0x7f455c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:21:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.349+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f45640835f0 con 0x7f45740f66e0 2022-02-02T19:21:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.350+0000 7f45737fe700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 0x7f455c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:21:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.350+0000 7f45737fe700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 0x7f455c067290 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f4568004c60 tx=0x7f456800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:21:35.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.354+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4564055190 con 0x7f45740f66e0 2022-02-02T19:21:35.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.555+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45740ff040 con 0x7f45740f66e0 2022-02-02T19:21:35.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.555+0000 7f4570ff9700 1 -- 172.21.15.96:0/710912103 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4564054d80 con 0x7f45740f66e0 2022-02-02T19:21:35.560 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:21:35.560 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:21:35.561 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:21:35.561 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:21:35.561 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:35.561 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:21:35.562 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:21:35.562 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:21:35.562 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:21:35.562 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:21:35.563 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:21:35.563 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:21:35.563 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:21:35.564 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:21:35.564 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:21:35.564 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:21:35.565 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:21:35.565 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:21:35.565 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:21:35.565 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:21:35.565 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:21:35.566 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:21:35.566 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:21:35.566 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:21:35.566 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:21:35.567 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:21:35.567 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:21:35.567 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:21:35.567 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:21:35.568 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:21:35.568 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:21:35.568 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:21:35.569 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:35.569 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:35.569 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:21:35.569 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:21:35.569 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:35.570 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:35.570 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:21:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 msgr2=0x7f455c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 0x7f455c067290 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f4568004c60 tx=0x7f456800b040).stop 2022-02-02T19:21:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 msgr2=0x7f4574106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:21:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4564013a70 tx=0x7f4564009b30).stop 2022-02-02T19:21:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 shutdown_connections 2022-02-02T19:21:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f455c064dd0 0x7f455c067290 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45740f66e0 0x7f4574106ff0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 --2- 172.21.15.96:0/710912103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45740f7980 0x7f45741074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:21:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 >> 172.21.15.96:0/710912103 conn(0x7f45740f1e40 msgr2=0x7f45740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:21:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 shutdown_connections 2022-02-02T19:21:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:21:35.557+0000 7f457a6ed700 1 -- 172.21.15.96:0/710912103 wait complete. 2022-02-02T19:21:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:21:36.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:35 smithi159 ceph-mon[69013]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:36.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:35 smithi159 ceph-mon[69013]: from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:36.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/13189228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:21:36.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/710912103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:21:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:35 smithi096 ceph-mon[101353]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:35 smithi096 ceph-mon[101353]: from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:21:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/13189228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:21:36.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/710912103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:21:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:36 smithi159 ceph-mon[69013]: pgmap v1784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:36 smithi096 ceph-mon[101353]: pgmap v1784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:39.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:38 smithi159 ceph-mon[69013]: pgmap v1785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:38 smithi096 ceph-mon[101353]: pgmap v1785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:40 smithi159 ceph-mon[69013]: pgmap v1786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:40 smithi096 ceph-mon[101353]: pgmap v1786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:43.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:42 smithi096 ceph-mon[101353]: pgmap v1787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:42 smithi159 ceph-mon[69013]: pgmap v1787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:44 smithi159 ceph-mon[69013]: pgmap v1788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:44 smithi096 ceph-mon[101353]: pgmap v1788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:46 smithi159 ceph-mon[69013]: pgmap v1789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:46 smithi096 ceph-mon[101353]: pgmap v1789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:48 smithi159 ceph-mon[69013]: pgmap v1790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:48 smithi096 ceph-mon[101353]: pgmap v1790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:50 smithi159 ceph-mon[69013]: pgmap v1791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:50 smithi096 ceph-mon[101353]: pgmap v1791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:53.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:52 smithi096 ceph-mon[101353]: pgmap v1792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:52 smithi159 ceph-mon[69013]: pgmap v1792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:54 smithi159 ceph-mon[69013]: pgmap v1793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:54 smithi096 ceph-mon[101353]: pgmap v1793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:56 smithi159 ceph-mon[69013]: pgmap v1794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:56 smithi096 ceph-mon[101353]: pgmap v1794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:59.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:21:58 smithi159 ceph-mon[69013]: pgmap v1795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:21:59.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:21:58 smithi096 ceph-mon[101353]: pgmap v1795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:00 smithi159 ceph-mon[69013]: pgmap v1796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:00 smithi096 ceph-mon[101353]: pgmap v1796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:03.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:02 smithi096 ceph-mon[101353]: pgmap v1797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:02 smithi159 ceph-mon[69013]: pgmap v1797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:04 smithi159 ceph-mon[69013]: pgmap v1798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:04 smithi096 ceph-mon[101353]: pgmap v1798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- 172.21.15.96:0/3463326459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 msgr2=0x7f0e280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 --2- 172.21.15.96:0/3463326459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e280f6950 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f0e24004660 tx=0x7f0e24009b30).stop 2022-02-02T19:22:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- 172.21.15.96:0/3463326459 shutdown_connections 2022-02-02T19:22:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 --2- 172.21.15.96:0/3463326459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 0x7f0e280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 --2- 172.21.15.96:0/3463326459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e280f6950 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- 172.21.15.96:0/3463326459 >> 172.21.15.96:0/3463326459 conn(0x7f0e280f1c90 msgr2=0x7f0e280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- 172.21.15.96:0/3463326459 shutdown_connections 2022-02-02T19:22:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- 172.21.15.96:0/3463326459 wait complete. 2022-02-02T19:22:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 Processor -- start 2022-02-02T19:22:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 -- start start 2022-02-02T19:22:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.668+0000 7f0e2e257700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2e257700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 0x7f0e28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2e257700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2810aa20 con 0x7f0e280f6530 2022-02-02T19:22:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2e257700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2810ab60 con 0x7f0e280f77d0 2022-02-02T19:22:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59322/0 (socket says 172.21.15.96:59322) 2022-02-02T19:22:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 -- 172.21.15.96:0/2927504077 learned_addr learned my addr 172.21.15.96:0/2927504077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2ca54700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 0x7f0e28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 -- 172.21.15.96:0/2927504077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 msgr2=0x7f0e28069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 0x7f0e28069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 -- 172.21.15.96:0/2927504077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24005040 con 0x7f0e280f6530 2022-02-02T19:22:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2d255700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f0e24013a70 tx=0x7f0e24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e24018070 con 0x7f0e280f6530 2022-02-02T19:22:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2806a370 con 0x7f0e280f6530 2022-02-02T19:22:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e240097d0 con 0x7f0e280f6530 2022-02-02T19:22:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.669+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2401c3c0 con 0x7f0e280f6530 2022-02-02T19:22:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.670+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2806a8d0 con 0x7f0e280f6530 2022-02-02T19:22:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.671+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28045ad0 con 0x7f0e280f6530 2022-02-02T19:22:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.671+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e24007ba0 con 0x7f0e280f6530 2022-02-02T19:22:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.672+0000 7f0e1dffb700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 0x7f0e140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.672+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e24083780 con 0x7f0e280f6530 2022-02-02T19:22:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.672+0000 7f0e2ca54700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 0x7f0e140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.672+0000 7f0e2ca54700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 0x7f0e140672e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f0e18009760 tx=0x7f0e18009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.676+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e240518f0 con 0x7f0e280f6530 2022-02-02T19:22:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.855+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e280feea0 con 0x7f0e14064e20 2022-02-02T19:22:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.856+0000 7f0e1dffb700 1 -- 172.21.15.96:0/2927504077 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0e180093f0 con 0x7f0e14064e20 2022-02-02T19:22:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 msgr2=0x7f0e140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 0x7f0e140672e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f0e18009760 tx=0x7f0e18009c60).stop 2022-02-02T19:22:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 msgr2=0x7f0e2806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f0e24013a70 tx=0x7f0e24009b30).stop 2022-02-02T19:22:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 shutdown_connections 2022-02-02T19:22:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064e20 0x7f0e140672e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6530 0x7f0e2806b9a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 --2- 172.21.15.96:0/2927504077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f77d0 0x7f0e28069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 >> 172.21.15.96:0/2927504077 conn(0x7f0e280f1c90 msgr2=0x7f0e280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 shutdown_connections 2022-02-02T19:22:05.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.858+0000 7f0e2e257700 1 -- 172.21.15.96:0/2927504077 wait complete. 2022-02-02T19:22:05.872 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:22:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 -- 172.21.15.96:0/193718871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f7980 msgr2=0x7fce7c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 --2- 172.21.15.96:0/193718871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f7980 0x7fce7c0f7de0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fce6c004660 tx=0x7fce6c009b30).stop 2022-02-02T19:22:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 -- 172.21.15.96:0/193718871 shutdown_connections 2022-02-02T19:22:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 --2- 172.21.15.96:0/193718871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f7980 0x7fce7c0f7de0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 --2- 172.21.15.96:0/193718871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.955+0000 7fce81c7a700 1 -- 172.21.15.96:0/193718871 >> 172.21.15.96:0/193718871 conn(0x7fce7c0f1e40 msgr2=0x7fce7c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.956+0000 7fce81c7a700 1 -- 172.21.15.96:0/193718871 shutdown_connections 2022-02-02T19:22:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.956+0000 7fce81c7a700 1 -- 172.21.15.96:0/193718871 wait complete. 2022-02-02T19:22:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.956+0000 7fce81c7a700 1 Processor -- start 2022-02-02T19:22:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.956+0000 7fce81c7a700 1 -- start start 2022-02-02T19:22:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce81c7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce81c7a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f7980 0x7fce7c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce81c7a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c107a00 con 0x7fce7c0f66e0 2022-02-02T19:22:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce81c7a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c107b40 con 0x7fce7c0f7980 2022-02-02T19:22:05.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7affd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f7980 0x7fce7c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59332/0 (socket says 172.21.15.96:59332) 2022-02-02T19:22:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 -- 172.21.15.96:0/245551640 learned_addr learned my addr 172.21.15.96:0/245551640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:05.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 -- 172.21.15.96:0/245551640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f7980 msgr2=0x7fce7c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:05.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f7980 0x7fce7c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:05.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 -- 172.21.15.96:0/245551640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c005040 con 0x7fce7c0f66e0 2022-02-02T19:22:05.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.957+0000 7fce7b7fe700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fce7000c790 tx=0x7fce70007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.958+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce70013630 con 0x7fce7c0f66e0 2022-02-02T19:22:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.958+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1084e0 con 0x7fce7c0f66e0 2022-02-02T19:22:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.958+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce70012860 con 0x7fce7c0f66e0 2022-02-02T19:22:05.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.958+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce70002780 con 0x7fce7c0f66e0 2022-02-02T19:22:05.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.958+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c108aa0 con 0x7fce7c0f66e0 2022-02-02T19:22:05.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.959+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c045ad0 con 0x7fce7c0f66e0 2022-02-02T19:22:05.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.959+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce70010070 con 0x7fce7c0f66e0 2022-02-02T19:22:05.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.960+0000 7fce63fff700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 0x7fce64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:05.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.960+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fce70081b80 con 0x7fce7c0f66e0 2022-02-02T19:22:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.960+0000 7fce7affd700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 0x7fce64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.960+0000 7fce7affd700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 0x7fce64067290 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fce6c004630 tx=0x7fce6c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:05.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:05.964+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce70053600 con 0x7fce7c0f66e0 2022-02-02T19:22:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.139+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce7c0fefe0 con 0x7fce64064dd0 2022-02-02T19:22:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.148+0000 7fce63fff700 1 -- 172.21.15.96:0/245551640 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fce7c0fefe0 con 0x7fce64064dd0 2022-02-02T19:22:06.153 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:22:06.153 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (65m) 36m ago 66m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:22:06.153 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (57m) 36m ago 66m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:22:06.154 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (57m) 34m ago 66m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:22:06.154 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (65m) 36m ago 66m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:22:06.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (62m) 36m ago 62m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:22:06.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (58m) 36m ago 62m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:22:06.155 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (62m) 34m ago 62m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:22:06.155 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (58m) 34m ago 62m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:22:06.155 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (59m) 36m ago 67m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:22:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (59m) 34m ago 65m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:22:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (58m) 36m ago 67m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:22:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (58m) 34m ago 65m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:22:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (66m) 36m ago 66m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:22:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (65m) 34m ago 65m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:22:06.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (57m) 36m ago 65m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:22:06.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (56m) 36m ago 65m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:22:06.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (56m) 36m ago 64m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:22:06.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (55m) 34m ago 64m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:22:06.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (55m) 34m ago 64m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:22:06.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (54m) 34m ago 63m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:22:06.158 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (65m) 36m ago 66m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:22:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 msgr2=0x7fce64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 0x7fce64067290 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fce6c004630 tx=0x7fce6c009b30).stop 2022-02-02T19:22:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 msgr2=0x7fce7c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fce7000c790 tx=0x7fce70007d90).stop 2022-02-02T19:22:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 shutdown_connections 2022-02-02T19:22:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064dd0 0x7fce64067290 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f66e0 0x7fce7c106f60 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 --2- 172.21.15.96:0/245551640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f7980 0x7fce7c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.150+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 >> 172.21.15.96:0/245551640 conn(0x7fce7c0f1e40 msgr2=0x7fce7c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.151+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 shutdown_connections 2022-02-02T19:22:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.151+0000 7fce81c7a700 1 -- 172.21.15.96:0/245551640 wait complete. 2022-02-02T19:22:06.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 -- 172.21.15.96:0/6759300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f5970 msgr2=0x7f97cc0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 --2- 172.21.15.96:0/6759300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f5970 0x7f97cc0f5df0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f97bc004660 tx=0x7f97bc009b30).stop 2022-02-02T19:22:06.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 -- 172.21.15.96:0/6759300 shutdown_connections 2022-02-02T19:22:06.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 --2- 172.21.15.96:0/6759300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f5970 0x7f97cc0f5df0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 --2- 172.21.15.96:0/6759300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f6c60 0x7f97cc0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 -- 172.21.15.96:0/6759300 >> 172.21.15.96:0/6759300 conn(0x7f97cc0f04c0 msgr2=0x7f97cc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:06.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 -- 172.21.15.96:0/6759300 shutdown_connections 2022-02-02T19:22:06.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.247+0000 7f97d137b700 1 -- 172.21.15.96:0/6759300 wait complete. 2022-02-02T19:22:06.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 Processor -- start 2022-02-02T19:22:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 -- start start 2022-02-02T19:22:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f5970 0x7f97cc105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc106970 con 0x7f97cc0f6c60 2022-02-02T19:22:06.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97d137b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc106ab0 con 0x7f97cc0f5970 2022-02-02T19:22:06.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59344/0 (socket says 172.21.15.96:59344) 2022-02-02T19:22:06.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 -- 172.21.15.96:0/593320272 learned_addr learned my addr 172.21.15.96:0/593320272 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:06.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97caffd700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f5970 0x7f97cc105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 -- 172.21.15.96:0/593320272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f5970 msgr2=0x7f97cc105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f5970 0x7f97cc105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 -- 172.21.15.96:0/593320272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97cc0f6c60 2022-02-02T19:22:06.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.248+0000 7f97ca7fc700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f97bc009990 tx=0x7f97bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:06.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.249+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97bc018070 con 0x7f97cc0f6c60 2022-02-02T19:22:06.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.249+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc1073f0 con 0x7f97cc0f6c60 2022-02-02T19:22:06.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.249+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97bc007ba0 con 0x7f97cc0f6c60 2022-02-02T19:22:06.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.249+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97bc01c3c0 con 0x7f97cc0f6c60 2022-02-02T19:22:06.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.249+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc107950 con 0x7f97cc0f6c60 2022-02-02T19:22:06.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.250+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc045ad0 con 0x7f97cc0f6c60 2022-02-02T19:22:06.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.250+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f97bc01d420 con 0x7f97cc0f6c60 2022-02-02T19:22:06.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.251+0000 7f97b37fe700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 0x7f97b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.251+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f97bc0837c0 con 0x7f97cc0f6c60 2022-02-02T19:22:06.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.251+0000 7f97caffd700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 0x7f97b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.251+0000 7f97caffd700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 0x7f97b4067290 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f97c00096c0 tx=0x7f97c0009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:06.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.255+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f97bc055360 con 0x7f97cc0f6c60 2022-02-02T19:22:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.488+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97cc108050 con 0x7f97cc0f6c60 2022-02-02T19:22:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.488+0000 7f97b37fe700 1 -- 172.21.15.96:0/593320272 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f97bc054f50 con 0x7f97cc0f6c60 2022-02-02T19:22:06.493 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:22:06.493 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:22:06.494 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:22:06.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:06.494 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:22:06.494 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:22:06.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:06.495 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:22:06.495 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:22:06.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:06.496 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:22:06.496 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:22:06.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:06.496 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:22:06.496 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:22:06.497 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:22:06.497 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:22:06.497 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:22:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.490+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 msgr2=0x7f97b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.490+0000 7f97d137b700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 0x7f97b4067290 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f97c00096c0 tx=0x7f97c0009be0).stop 2022-02-02T19:22:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.490+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 msgr2=0x7f97cc1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.490+0000 7f97d137b700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f97bc009990 tx=0x7f97bc009b30).stop 2022-02-02T19:22:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 shutdown_connections 2022-02-02T19:22:06.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97b4064dd0 0x7f97b4067290 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc0f5970 0x7f97cc105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 --2- 172.21.15.96:0/593320272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97cc0f6c60 0x7f97cc1063c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 >> 172.21.15.96:0/593320272 conn(0x7f97cc0f04c0 msgr2=0x7f97cc0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 shutdown_connections 2022-02-02T19:22:06.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.491+0000 7f97d137b700 1 -- 172.21.15.96:0/593320272 wait complete. 2022-02-02T19:22:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 -- 172.21.15.96:0/871074965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f55c0 msgr2=0x7fc6640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 --2- 172.21.15.96:0/871074965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f55c0 0x7fc6640f59e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc654004660 tx=0x7fc654009b30).stop 2022-02-02T19:22:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 -- 172.21.15.96:0/871074965 shutdown_connections 2022-02-02T19:22:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 --2- 172.21.15.96:0/871074965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f6860 0x7fc6640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 --2- 172.21.15.96:0/871074965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f55c0 0x7fc6640f59e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 -- 172.21.15.96:0/871074965 >> 172.21.15.96:0/871074965 conn(0x7fc6640f0d40 msgr2=0x7fc6640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 -- 172.21.15.96:0/871074965 shutdown_connections 2022-02-02T19:22:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.588+0000 7fc66bb24700 1 -- 172.21.15.96:0/871074965 wait complete. 2022-02-02T19:22:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 Processor -- start 2022-02-02T19:22:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 -- start start 2022-02-02T19:22:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f55c0 0x7fc664109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664060420 con 0x7fc6640f6860 2022-02-02T19:22:06.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc66bb24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664060560 con 0x7fc6640f55c0 2022-02-02T19:22:06.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59352/0 (socket says 172.21.15.96:59352) 2022-02-02T19:22:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 -- 172.21.15.96:0/3928277965 learned_addr learned my addr 172.21.15.96:0/3928277965 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6698c0700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f55c0 0x7fc664109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 -- 172.21.15.96:0/3928277965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f55c0 msgr2=0x7fc664109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f55c0 0x7fc664109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 -- 172.21.15.96:0/3928277965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654005040 con 0x7fc6640f6860 2022-02-02T19:22:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.589+0000 7fc6690bf700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fc6600026d0 tx=0x7fc660009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.590+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6600079c0 con 0x7fc6640f6860 2022-02-02T19:22:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.590+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc66000f040 con 0x7fc6640f6860 2022-02-02T19:22:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.590+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66410c780 con 0x7fc6640f6860 2022-02-02T19:22:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.590+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6600137c0 con 0x7fc6640f6860 2022-02-02T19:22:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.590+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66410cd10 con 0x7fc6640f6860 2022-02-02T19:22:06.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.591+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640f49b0 con 0x7fc6640f6860 2022-02-02T19:22:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.591+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc6600090d0 con 0x7fc6640f6860 2022-02-02T19:22:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.592+0000 7fc65a7fc700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 0x7fc650067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.592+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc660081a90 con 0x7fc6640f6860 2022-02-02T19:22:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.592+0000 7fc6698c0700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 0x7fc650067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.592+0000 7fc6698c0700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 0x7fc650067290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc654013690 tx=0x7fc654009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.596+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc66004fae0 con 0x7fc6640f6860 2022-02-02T19:22:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.800+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc664045ad0 con 0x7fc6640f6860 2022-02-02T19:22:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.800+0000 7fc65a7fc700 1 -- 172.21.15.96:0/3928277965 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc660053100 con 0x7fc6640f6860 2022-02-02T19:22:06.805 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:22:06.806 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:22:06.806 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:22:06.806 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:22:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:06.807 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:22:06.807 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:22:06.807 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:22:06.807 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:22:06.808 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:22:06.808 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:22:06.808 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:22:06.808 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:22:06.809 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:22:06.809 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:22:06.809 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:22:06.809 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:22:06.809 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:22:06.810 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:22:06.810 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:22:06.810 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:22:06.810 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:22:06.811 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:22:06.811 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:22:06.811 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:22:06.811 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:22:06.812 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:22:06.812 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:22:06.812 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:22:06.812 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:22:06.812 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:22:06.813 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:22:06.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:06.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:06.813 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:22:06.814 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:06.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:06.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:06.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:06.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 msgr2=0x7fc650067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 0x7fc650067290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc654013690 tx=0x7fc654009b30).stop 2022-02-02T19:22:06.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 msgr2=0x7fc66410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:06.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fc6600026d0 tx=0x7fc660009de0).stop 2022-02-02T19:22:06.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 shutdown_connections 2022-02-02T19:22:06.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc650064dd0 0x7fc650067290 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6640f55c0 0x7fc664109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 --2- 172.21.15.96:0/3928277965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6640f6860 0x7fc66410c170 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:06.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.802+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 >> 172.21.15.96:0/3928277965 conn(0x7fc6640f0d40 msgr2=0x7fc6640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:06.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.803+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 shutdown_connections 2022-02-02T19:22:06.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:06.803+0000 7fc66bb24700 1 -- 172.21.15.96:0/3928277965 wait complete. 2022-02-02T19:22:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:22:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:06 smithi159 ceph-mon[69013]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:06 smithi159 ceph-mon[69013]: pgmap v1799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/593320272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:22:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3928277965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:22:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:06 smithi096 ceph-mon[101353]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:06 smithi096 ceph-mon[101353]: pgmap v1799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/593320272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:22:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3928277965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:22:08.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:07 smithi159 ceph-mon[69013]: from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:08.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:07 smithi096 ceph-mon[101353]: from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:09.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:08 smithi159 ceph-mon[69013]: pgmap v1800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:08 smithi096 ceph-mon[101353]: pgmap v1800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:10 smithi159 ceph-mon[69013]: pgmap v1801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:11.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:10 smithi096 ceph-mon[101353]: pgmap v1801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:13.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:12 smithi096 ceph-mon[101353]: pgmap v1802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:12 smithi159 ceph-mon[69013]: pgmap v1802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:14 smithi159 ceph-mon[69013]: pgmap v1803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:14 smithi096 ceph-mon[101353]: pgmap v1803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:16 smithi159 ceph-mon[69013]: pgmap v1804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:16 smithi096 ceph-mon[101353]: pgmap v1804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:18 smithi159 ceph-mon[69013]: pgmap v1805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:18 smithi096 ceph-mon[101353]: pgmap v1805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:20 smithi159 ceph-mon[69013]: pgmap v1806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:20 smithi096 ceph-mon[101353]: pgmap v1806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:23.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:22 smithi096 ceph-mon[101353]: pgmap v1807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:22 smithi159 ceph-mon[69013]: pgmap v1807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:24 smithi159 ceph-mon[69013]: pgmap v1808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:25.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:24 smithi096 ceph-mon[101353]: pgmap v1808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:26 smithi159 ceph-mon[69013]: pgmap v1809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:27.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:26 smithi096 ceph-mon[101353]: pgmap v1809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:22:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:22:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:22:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:22:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:28 smithi159 ceph-mon[69013]: pgmap v1810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:28 smithi096 ceph-mon[101353]: pgmap v1810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:30 smithi159 ceph-mon[69013]: pgmap v1811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:30 smithi096 ceph-mon[101353]: pgmap v1811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:33.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:32 smithi096 ceph-mon[101353]: pgmap v1812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:32 smithi159 ceph-mon[69013]: pgmap v1812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:34 smithi159 ceph-mon[69013]: pgmap v1813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:35.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:34 smithi096 ceph-mon[101353]: pgmap v1813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:36.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 -- 172.21.15.96:0/1634570996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 msgr2=0x7f91300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:36.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 --2- 172.21.15.96:0/1634570996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f6cc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f911c004660 tx=0x7f911c009b30).stop 2022-02-02T19:22:36.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 -- 172.21.15.96:0/1634570996 shutdown_connections 2022-02-02T19:22:36.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 --2- 172.21.15.96:0/1634570996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f6cc0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:36.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 --2- 172.21.15.96:0/1634570996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:36.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 -- 172.21.15.96:0/1634570996 >> 172.21.15.96:0/1634570996 conn(0x7f91300f0d40 msgr2=0x7f91300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:36.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 -- 172.21.15.96:0/1634570996 shutdown_connections 2022-02-02T19:22:36.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.914+0000 7f913709e700 1 -- 172.21.15.96:0/1634570996 wait complete. 2022-02-02T19:22:36.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 Processor -- start 2022-02-02T19:22:36.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 -- start start 2022-02-02T19:22:36.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:36.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:36.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300f8100 con 0x7f91300f6860 2022-02-02T19:22:36.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f913709e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300f8240 con 0x7f91300f55c0 2022-02-02T19:22:36.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f912ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:36.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f912ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59374/0 (socket says 172.21.15.96:59374) 2022-02-02T19:22:36.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.915+0000 7f912ffff700 1 -- 172.21.15.96:0/932515960 learned_addr learned my addr 172.21.15.96:0/932515960 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:36.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f9134e3a700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:36.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912ffff700 1 -- 172.21.15.96:0/932515960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 msgr2=0x7f91300f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:36.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912ffff700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:36.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912ffff700 1 -- 172.21.15.96:0/932515960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c005040 con 0x7f91300f6860 2022-02-02T19:22:36.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f9134e3a700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:22:36.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912ffff700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f911c009da0 tx=0x7f911c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:36.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911c018070 con 0x7f91300f6860 2022-02-02T19:22:36.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91300f84c0 con 0x7f91300f6860 2022-02-02T19:22:36.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f911c007d70 con 0x7f91300f6860 2022-02-02T19:22:36.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911c01dea0 con 0x7f91300f6860 2022-02-02T19:22:36.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.916+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91300f8a20 con 0x7f91300f6860 2022-02-02T19:22:36.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.917+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9130045ad0 con 0x7f91300f6860 2022-02-02T19:22:36.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.918+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f911c01d420 con 0x7f91300f6860 2022-02-02T19:22:36.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.918+0000 7f912d7fa700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 0x7f9120067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:36.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.918+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f911c083950 con 0x7f91300f6860 2022-02-02T19:22:36.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.918+0000 7f9134e3a700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 0x7f9120067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:36.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.919+0000 7f9134e3a700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 0x7f9120067270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f91300f94b0 tx=0x7f9124009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:36.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:36.922+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f911c051a00 con 0x7f91300f6860 2022-02-02T19:22:37.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.100+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91300faca0 con 0x7f9120064db0 2022-02-02T19:22:37.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.101+0000 7f912d7fa700 1 -- 172.21.15.96:0/932515960 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f91300faca0 con 0x7f9120064db0 2022-02-02T19:22:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.102+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 msgr2=0x7f9120067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 0x7f9120067270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f91300f94b0 tx=0x7f9124009040).stop 2022-02-02T19:22:37.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 msgr2=0x7f91300f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f911c009da0 tx=0x7f911c009b30).stop 2022-02-02T19:22:37.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 shutdown_connections 2022-02-02T19:22:37.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9120064db0 0x7f9120067270 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300f55c0 0x7f91300f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 --2- 172.21.15.96:0/932515960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91300f6860 0x7f91300f7ba0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 >> 172.21.15.96:0/932515960 conn(0x7f91300f0d40 msgr2=0x7f913005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 shutdown_connections 2022-02-02T19:22:37.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.103+0000 7f913709e700 1 -- 172.21.15.96:0/932515960 wait complete. 2022-02-02T19:22:37.117 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:22:37.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:36 smithi096 ceph-mon[101353]: pgmap v1814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:37.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 -- 172.21.15.96:0/1049357013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 msgr2=0x7f37180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1049357013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f37180f59e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f3708004660 tx=0x7f3708009b30).stop 2022-02-02T19:22:37.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 -- 172.21.15.96:0/1049357013 shutdown_connections 2022-02-02T19:22:37.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1049357013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f37180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1049357013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f37180f59e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 -- 172.21.15.96:0/1049357013 >> 172.21.15.96:0/1049357013 conn(0x7f37180f0d40 msgr2=0x7f37180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 -- 172.21.15.96:0/1049357013 shutdown_connections 2022-02-02T19:22:37.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.200+0000 7f371ce3f700 1 -- 172.21.15.96:0/1049357013 wait complete. 2022-02-02T19:22:37.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 Processor -- start 2022-02-02T19:22:37.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 -- start start 2022-02-02T19:22:37.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f3718106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3718106910 con 0x7f37180f55c0 2022-02-02T19:22:37.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371ce3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3718106a50 con 0x7f37180f6860 2022-02-02T19:22:37.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59382/0 (socket says 172.21.15.96:59382) 2022-02-02T19:22:37.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 -- 172.21.15.96:0/1227078265 learned_addr learned my addr 172.21.15.96:0/1227078265 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:37.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 -- 172.21.15.96:0/1227078265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 msgr2=0x7f3718106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f3715d9b700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f3718106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f3718106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 -- 172.21.15.96:0/1227078265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708005040 con 0x7f37180f55c0 2022-02-02T19:22:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f3715d9b700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f3718106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:22:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.201+0000 7f371659c700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3708004f60 tx=0x7f3708009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.202+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3708018070 con 0x7f37180f55c0 2022-02-02T19:22:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.202+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3718107390 con 0x7f37180f55c0 2022-02-02T19:22:37.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.202+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3708007ba0 con 0x7f37180f55c0 2022-02-02T19:22:37.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.202+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37181078f0 con 0x7f37180f55c0 2022-02-02T19:22:37.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.202+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370801c620 con 0x7f37180f55c0 2022-02-02T19:22:37.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.203+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3718045ad0 con 0x7f37180f55c0 2022-02-02T19:22:37.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.203+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f370801c8e0 con 0x7f37180f55c0 2022-02-02T19:22:37.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.203+0000 7f3706ffd700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 0x7f3700067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.204+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f37080839e0 con 0x7f37180f55c0 2022-02-02T19:22:37.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.204+0000 7f3715d9b700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 0x7f3700067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.204+0000 7f3715d9b700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 0x7f3700067290 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f370c0041d0 tx=0x7f370c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.208+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37080554c0 con 0x7f37180f55c0 2022-02-02T19:22:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:36 smithi159 ceph-mon[69013]: pgmap v1814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:37.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.380+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37180fddf0 con 0x7f3700064dd0 2022-02-02T19:22:37.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.389+0000 7f3706ffd700 1 -- 172.21.15.96:0/1227078265 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f37180fddf0 con 0x7f3700064dd0 2022-02-02T19:22:37.394 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:22:37.394 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (66m) 36m ago 67m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:22:37.395 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (58m) 36m ago 67m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:22:37.395 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (58m) 35m ago 66m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:22:37.395 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (65m) 36m ago 66m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:22:37.395 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (63m) 36m ago 63m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:22:37.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (58m) 36m ago 63m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:22:37.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (63m) 35m ago 63m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:22:37.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (58m) 35m ago 63m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:22:37.396 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (60m) 36m ago 68m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:22:37.396 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (59m) 35m ago 66m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:22:37.397 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (59m) 36m ago 68m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:22:37.397 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (58m) 35m ago 66m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:22:37.397 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (66m) 36m ago 66m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:22:37.397 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (66m) 35m ago 66m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:22:37.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (58m) 36m ago 65m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:22:37.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (57m) 36m ago 65m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:22:37.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (56m) 36m ago 65m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:22:37.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (56m) 35m ago 64m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:22:37.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (55m) 35m ago 64m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:22:37.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (55m) 35m ago 64m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:22:37.399 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (65m) 36m ago 66m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:22:37.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 msgr2=0x7f3700067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 0x7f3700067290 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f370c0041d0 tx=0x7f370c009040).stop 2022-02-02T19:22:37.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 msgr2=0x7f3718105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3708004f60 tx=0x7f3708009b30).stop 2022-02-02T19:22:37.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 shutdown_connections 2022-02-02T19:22:37.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3700064dd0 0x7f3700067290 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37180f55c0 0x7f3718105e70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 --2- 172.21.15.96:0/1227078265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37180f6860 0x7f3718106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 >> 172.21.15.96:0/1227078265 conn(0x7f37180f0d40 msgr2=0x7f37180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 shutdown_connections 2022-02-02T19:22:37.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.391+0000 7f371ce3f700 1 -- 172.21.15.96:0/1227078265 wait complete. 2022-02-02T19:22:37.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- 172.21.15.96:0/3677659911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 msgr2=0x7f517c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 --2- 172.21.15.96:0/3677659911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c0f6920 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f516c004660 tx=0x7f516c009b30).stop 2022-02-02T19:22:37.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- 172.21.15.96:0/3677659911 shutdown_connections 2022-02-02T19:22:37.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 --2- 172.21.15.96:0/3677659911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c0f6920 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 --2- 172.21.15.96:0/3677659911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- 172.21.15.96:0/3677659911 >> 172.21.15.96:0/3677659911 conn(0x7f517c0f0de0 msgr2=0x7f517c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- 172.21.15.96:0/3677659911 shutdown_connections 2022-02-02T19:22:37.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- 172.21.15.96:0/3677659911 wait complete. 2022-02-02T19:22:37.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 Processor -- start 2022-02-02T19:22:37.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.488+0000 7f518108b700 1 -- start start 2022-02-02T19:22:37.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c106950 con 0x7f517c0f5ef0 2022-02-02T19:22:37.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c107160 con 0x7f517c0f55e0 2022-02-02T19:22:37.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59394/0 (socket says 172.21.15.96:59394) 2022-02-02T19:22:37.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 -- 172.21.15.96:0/851343514 learned_addr learned my addr 172.21.15.96:0/851343514 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:37.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517ad9d700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 -- 172.21.15.96:0/851343514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 msgr2=0x7f517c105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 -- 172.21.15.96:0/851343514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c005040 con 0x7f517c0f5ef0 2022-02-02T19:22:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517ad9d700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:22:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f517a59c700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f516c009990 tx=0x7f516c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f516c018070 con 0x7f517c0f5ef0 2022-02-02T19:22:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c107380 con 0x7f517c0f5ef0 2022-02-02T19:22:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f516c007ba0 con 0x7f517c0f5ef0 2022-02-02T19:22:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f516c01c3c0 con 0x7f517c0f5ef0 2022-02-02T19:22:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.489+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c1078e0 con 0x7f517c0f5ef0 2022-02-02T19:22:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.490+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c0f4a70 con 0x7f517c0f5ef0 2022-02-02T19:22:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.491+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f516c01d420 con 0x7f517c0f5ef0 2022-02-02T19:22:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.491+0000 7f51737fe700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 0x7f5168067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.491+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f516c0837b0 con 0x7f517c0f5ef0 2022-02-02T19:22:37.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.491+0000 7f517ad9d700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 0x7f5168067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.492+0000 7f517ad9d700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 0x7f5168067290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f517c105bd0 tx=0x7f5164009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.496+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f516c051800 con 0x7f517c0f5ef0 2022-02-02T19:22:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.727+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f517c0fddd0 con 0x7f517c0f5ef0 2022-02-02T19:22:37.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.728+0000 7f51737fe700 1 -- 172.21.15.96:0/851343514 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f516c054e20 con 0x7f517c0f5ef0 2022-02-02T19:22:37.733 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:22:37.733 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:22:37.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:22:37.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:37.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:22:37.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:22:37.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:37.735 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:22:37.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:22:37.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:37.735 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:22:37.736 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:22:37.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:22:37.736 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:22:37.736 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:22:37.737 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:22:37.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:22:37.737 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:22:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 msgr2=0x7f5168067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 0x7f5168067290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f517c105bd0 tx=0x7f5164009c80).stop 2022-02-02T19:22:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 msgr2=0x7f517c106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f516c009990 tx=0x7f516c009b30).stop 2022-02-02T19:22:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 shutdown_connections 2022-02-02T19:22:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5168064dd0 0x7f5168067290 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f517c0f55e0 0x7f517c105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 --2- 172.21.15.96:0/851343514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f517c0f5ef0 0x7f517c106350 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 >> 172.21.15.96:0/851343514 conn(0x7f517c0f0de0 msgr2=0x7f517c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 shutdown_connections 2022-02-02T19:22:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.730+0000 7f518108b700 1 -- 172.21.15.96:0/851343514 wait complete. 2022-02-02T19:22:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 -- 172.21.15.96:0/657029383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 msgr2=0x7f439c0f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 --2- 172.21.15.96:0/657029383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c0f7fe0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f4388004660 tx=0x7f4388009b30).stop 2022-02-02T19:22:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 -- 172.21.15.96:0/657029383 shutdown_connections 2022-02-02T19:22:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 --2- 172.21.15.96:0/657029383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c0f7fe0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 --2- 172.21.15.96:0/657029383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 0x7f439c0f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 -- 172.21.15.96:0/657029383 >> 172.21.15.96:0/657029383 conn(0x7f439c0f2020 msgr2=0x7f439c0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 -- 172.21.15.96:0/657029383 shutdown_connections 2022-02-02T19:22:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.828+0000 7f43a325e700 1 -- 172.21.15.96:0/657029383 wait complete. 2022-02-02T19:22:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 Processor -- start 2022-02-02T19:22:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 -- start start 2022-02-02T19:22:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 0x7f439c107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c107c10 con 0x7f439c0f7b80 2022-02-02T19:22:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a325e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c107d50 con 0x7f439c0f68e0 2022-02-02T19:22:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f439bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f439bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59404/0 (socket says 172.21.15.96:59404) 2022-02-02T19:22:37.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f439bfff700 1 -- 172.21.15.96:0/2313410409 learned_addr learned my addr 172.21.15.96:0/2313410409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:22:37.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.829+0000 7f43a0ffa700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 0x7f439c107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f439bfff700 1 -- 172.21.15.96:0/2313410409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 msgr2=0x7f439c107170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:37.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f439bfff700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 0x7f439c107170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:37.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f439bfff700 1 -- 172.21.15.96:0/2313410409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388005040 con 0x7f439c0f7b80 2022-02-02T19:22:37.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f439bfff700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f4388009990 tx=0x7f4388009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4388018070 con 0x7f439c0f7b80 2022-02-02T19:22:37.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4388007ba0 con 0x7f439c0f7b80 2022-02-02T19:22:37.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c108690 con 0x7f439c0f7b80 2022-02-02T19:22:37.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438801c620 con 0x7f439c0f7b80 2022-02-02T19:22:37.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.830+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c108bf0 con 0x7f439c0f7b80 2022-02-02T19:22:37.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.831+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c045ad0 con 0x7f439c0f7b80 2022-02-02T19:22:37.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.831+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f438801c8e0 con 0x7f439c0f7b80 2022-02-02T19:22:37.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.832+0000 7f43997fa700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 0x7f438c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:22:37.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.832+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f43880838e0 con 0x7f439c0f7b80 2022-02-02T19:22:37.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.832+0000 7f43a0ffa700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 0x7f438c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:22:37.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.832+0000 7f43a0ffa700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 0x7f438c067290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f439c0f79e0 tx=0x7f4390009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:22:37.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:37.836+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f43880553c0 con 0x7f439c0f7b80 2022-02-02T19:22:38.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.038+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f439c0612d0 con 0x7f439c0f7b80 2022-02-02T19:22:38.044 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/851343514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:22:38.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.039+0000 7f43997fa700 1 -- 172.21.15.96:0/2313410409 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4388054fb0 con 0x7f439c0f7b80 2022-02-02T19:22:38.045 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:22:38.045 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:22:38.045 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:22:38.045 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:22:38.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:38.046 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:22:38.046 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:22:38.046 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:22:38.047 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:22:38.047 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:22:38.047 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:22:38.047 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:22:38.047 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:22:38.048 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:22:38.048 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:22:38.048 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:22:38.048 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:22:38.049 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:22:38.049 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:22:38.049 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:22:38.050 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:22:38.050 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:22:38.050 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:22:38.050 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:22:38.051 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:22:38.051 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:22:38.051 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:22:38.051 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:22:38.051 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:22:38.052 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:22:38.052 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:22:38.052 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:22:38.052 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:38.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:38.053 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:22:38.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:22:38.053 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:38.053 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:38.054 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:22:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 msgr2=0x7f438c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 0x7f438c067290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f439c0f79e0 tx=0x7f4390009040).stop 2022-02-02T19:22:38.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 msgr2=0x7f439c107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:22:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f4388009990 tx=0x7f4388009b30).stop 2022-02-02T19:22:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 shutdown_connections 2022-02-02T19:22:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f438c064dd0 0x7f438c067290 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:38.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f439c0f68e0 0x7f439c107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 --2- 172.21.15.96:0/2313410409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f439c0f7b80 0x7f439c107660 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:22:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 >> 172.21.15.96:0/2313410409 conn(0x7f439c0f2020 msgr2=0x7f439c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:22:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 shutdown_connections 2022-02-02T19:22:38.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:22:38.041+0000 7f43a325e700 1 -- 172.21.15.96:0/2313410409 wait complete. 2022-02-02T19:22:38.058 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:22:38.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/851343514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:22:39.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:38 smithi159 ceph-mon[69013]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:39.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:38 smithi159 ceph-mon[69013]: from='client.35982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:39.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:38 smithi159 ceph-mon[69013]: pgmap v1815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:39.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2313410409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:22:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:38 smithi096 ceph-mon[101353]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:39.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:38 smithi096 ceph-mon[101353]: from='client.35982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:22:39.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:38 smithi096 ceph-mon[101353]: pgmap v1815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:39.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2313410409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:22:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:40 smithi159 ceph-mon[69013]: pgmap v1816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:40 smithi096 ceph-mon[101353]: pgmap v1816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:43.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:42 smithi096 ceph-mon[101353]: pgmap v1817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:42 smithi159 ceph-mon[69013]: pgmap v1817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:44 smithi159 ceph-mon[69013]: pgmap v1818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:44 smithi096 ceph-mon[101353]: pgmap v1818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:46 smithi159 ceph-mon[69013]: pgmap v1819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:46 smithi096 ceph-mon[101353]: pgmap v1819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:48 smithi159 ceph-mon[69013]: pgmap v1820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:49.373 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:48 smithi096 ceph-mon[101353]: pgmap v1820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:50 smithi159 ceph-mon[69013]: pgmap v1821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:50 smithi096 ceph-mon[101353]: pgmap v1821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:53.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:52 smithi096 ceph-mon[101353]: pgmap v1822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:52 smithi159 ceph-mon[69013]: pgmap v1822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:55.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:54 smithi159 ceph-mon[69013]: pgmap v1823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:54 smithi096 ceph-mon[101353]: pgmap v1823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:56 smithi159 ceph-mon[69013]: pgmap v1824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:56 smithi096 ceph-mon[101353]: pgmap v1824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:59.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:22:58 smithi159 ceph-mon[69013]: pgmap v1825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:22:59.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:22:58 smithi096 ceph-mon[101353]: pgmap v1825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:00 smithi159 ceph-mon[69013]: pgmap v1826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:00 smithi096 ceph-mon[101353]: pgmap v1826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:03.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:02 smithi096 ceph-mon[101353]: pgmap v1827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:03.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:02 smithi159 ceph-mon[69013]: pgmap v1827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:04 smithi159 ceph-mon[69013]: pgmap v1828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:04 smithi096 ceph-mon[101353]: pgmap v1828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:06 smithi159 ceph-mon[69013]: pgmap v1829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:06 smithi096 ceph-mon[101353]: pgmap v1829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:08.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 -- 172.21.15.96:0/930806823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 msgr2=0x7f0ad00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/930806823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad00f59e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f0ac0004660 tx=0x7f0ac0009b30).stop 2022-02-02T19:23:08.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 -- 172.21.15.96:0/930806823 shutdown_connections 2022-02-02T19:23:08.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/930806823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 0x7f0ad00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/930806823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad00f59e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 -- 172.21.15.96:0/930806823 >> 172.21.15.96:0/930806823 conn(0x7f0ad00f0d40 msgr2=0x7f0ad00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 -- 172.21.15.96:0/930806823 shutdown_connections 2022-02-02T19:23:08.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.151+0000 7f0ad73d6700 1 -- 172.21.15.96:0/930806823 wait complete. 2022-02-02T19:23:08.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 Processor -- start 2022-02-02T19:23:08.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 -- start start 2022-02-02T19:23:08.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 0x7f0ad010c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00603e0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad73d6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0060520 con 0x7f0ad00f6860 2022-02-02T19:23:08.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad5172700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad5172700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59418/0 (socket says 172.21.15.96:59418) 2022-02-02T19:23:08.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.152+0000 7f0ad5172700 1 -- 172.21.15.96:0/1896313154 learned_addr learned my addr 172.21.15.96:0/1896313154 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:08.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad4971700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 0x7f0ad010c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad5172700 1 -- 172.21.15.96:0/1896313154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 msgr2=0x7f0ad010c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad5172700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 0x7f0ad010c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad5172700 1 -- 172.21.15.96:0/1896313154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0005040 con 0x7f0ad00f55c0 2022-02-02T19:23:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad5172700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f0ac0013a70 tx=0x7f0ac0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac0018070 con 0x7f0ad00f55c0 2022-02-02T19:23:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ac00097d0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad010c650 con 0x7f0ad00f55c0 2022-02-02T19:23:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac001c3c0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.153+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad010cbb0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.154+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0045ad0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.155+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ac0007ba0 con 0x7f0ad00f55c0 2022-02-02T19:23:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.155+0000 7f0ac5ffb700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.155+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0ac0083850 con 0x7f0ad00f55c0 2022-02-02T19:23:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.155+0000 7f0ad4971700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.156+0000 7f0ad4971700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 0x7f0abc067290 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0acc0096c0 tx=0x7f0acc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.160+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ac0051900 con 0x7f0ad00f55c0 2022-02-02T19:23:08.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.338+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad00fdec0 con 0x7f0abc064dd0 2022-02-02T19:23:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.339+0000 7f0ac5ffb700 1 -- 172.21.15.96:0/1896313154 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0ad00fdec0 con 0x7f0abc064dd0 2022-02-02T19:23:08.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.340+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 msgr2=0x7f0abc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.340+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 0x7f0abc067290 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0acc0096c0 tx=0x7f0acc009be0).stop 2022-02-02T19:23:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.340+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 msgr2=0x7f0ad0109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.340+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f0ac0013a70 tx=0x7f0ac0009b30).stop 2022-02-02T19:23:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 shutdown_connections 2022-02-02T19:23:08.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ad00f55c0 0x7f0ad0109c00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 --2- 172.21.15.96:0/1896313154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ad00f6860 0x7f0ad010c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 >> 172.21.15.96:0/1896313154 conn(0x7f0ad00f0d40 msgr2=0x7f0ad00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 shutdown_connections 2022-02-02T19:23:08.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.341+0000 7f0ad73d6700 1 -- 172.21.15.96:0/1896313154 wait complete. 2022-02-02T19:23:08.356 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:23:08.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- 172.21.15.96:0/205841253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f55c0 msgr2=0x7f31040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 --2- 172.21.15.96:0/205841253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f55c0 0x7f31040f59e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f30f4004660 tx=0x7f30f4009b30).stop 2022-02-02T19:23:08.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- 172.21.15.96:0/205841253 shutdown_connections 2022-02-02T19:23:08.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 --2- 172.21.15.96:0/205841253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f6860 0x7f31040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:23:08.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 --2- 172.21.15.96:0/205841253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f55c0 0x7f31040f59e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- 172.21.15.96:0/205841253 >> 172.21.15.96:0/205841253 conn(0x7f31040f0d40 msgr2=0x7f31040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- 172.21.15.96:0/205841253 shutdown_connections 2022-02-02T19:23:08.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- 172.21.15.96:0/205841253 wait complete. 2022-02-02T19:23:08.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 Processor -- start 2022-02-02T19:23:08.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- start start 2022-02-02T19:23:08.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 0x7f3104107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040604b0 con 0x7f31040f6860 2022-02-02T19:23:08.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.438+0000 7f310b38a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040605f0 con 0x7f31040f55c0 2022-02-02T19:23:08.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59430/0 (socket says 172.21.15.96:59430) 2022-02-02T19:23:08.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 -- 172.21.15.96:0/1060097688 learned_addr learned my addr 172.21.15.96:0/1060097688 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:08.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3109126700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 0x7f3104107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 -- 172.21.15.96:0/1060097688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 msgr2=0x7f3104107a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 0x7f3104107a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 -- 172.21.15.96:0/1060097688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4005040 con 0x7f31040f6860 2022-02-02T19:23:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3109126700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 0x7f3104107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:23:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f3108925700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f310000b410 tx=0x7f3100006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31000125f0 con 0x7f31040f6860 2022-02-02T19:23:08.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3100012c00 con 0x7f31040f6860 2022-02-02T19:23:08.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310410a5d0 con 0x7f31040f6860 2022-02-02T19:23:08.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.439+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3100002ae0 con 0x7f31040f6860 2022-02-02T19:23:08.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.440+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310410ab90 con 0x7f31040f6860 2022-02-02T19:23:08.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.441+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3104045ad0 con 0x7f31040f6860 2022-02-02T19:23:08.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.441+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f310000f030 con 0x7f31040f6860 2022-02-02T19:23:08.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.442+0000 7f30f9ffb700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 0x7f30f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.442+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3100081f00 con 0x7f31040f6860 2022-02-02T19:23:08.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.442+0000 7f3109126700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 0x7f30f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.442+0000 7f3109126700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 0x7f30f0067290 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f30f4004e30 tx=0x7f30f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.446+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f310004ffb0 con 0x7f31040f6860 2022-02-02T19:23:08.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.619+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3104057f10 con 0x7f30f0064dd0 2022-02-02T19:23:08.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.628+0000 7f30f9ffb700 1 -- 172.21.15.96:0/1060097688 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3104057f10 con 0x7f30f0064dd0 2022-02-02T19:23:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:23:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (66m) 37m ago 67m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:23:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (58m) 37m ago 67m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:23:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (58m) 35m ago 67m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:23:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (66m) 37m ago 67m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:23:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (63m) 37m ago 63m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:23:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (59m) 37m ago 63m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:23:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (63m) 35m ago 63m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:23:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (59m) 35m ago 63m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:23:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (60m) 37m ago 68m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:23:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (60m) 35m ago 67m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:23:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (59m) 37m ago 68m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:23:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (59m) 35m ago 66m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:23:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (67m) 37m ago 67m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:23:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (66m) 35m ago 66m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:23:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (58m) 37m ago 66m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:23:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (58m) 37m ago 66m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:23:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (57m) 37m ago 65m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:23:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (56m) 35m ago 65m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:23:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (56m) 35m ago 65m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:23:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (55m) 35m ago 64m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:23:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (66m) 37m ago 67m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:23:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 msgr2=0x7f30f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 0x7f30f0067290 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f30f4004e30 tx=0x7f30f4009b30).stop 2022-02-02T19:23:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 msgr2=0x7f3104109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f310000b410 tx=0x7f3100006ef0).stop 2022-02-02T19:23:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 shutdown_connections 2022-02-02T19:23:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30f0064dd0 0x7f30f0067290 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31040f55c0 0x7f3104107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 --2- 172.21.15.96:0/1060097688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31040f6860 0x7f3104109f70 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 >> 172.21.15.96:0/1060097688 conn(0x7f31040f0d40 msgr2=0x7f31040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 shutdown_connections 2022-02-02T19:23:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.630+0000 7f310b38a700 1 -- 172.21.15.96:0/1060097688 wait complete. 2022-02-02T19:23:08.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 -- 172.21.15.96:0/3885739808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 msgr2=0x7fccbc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 --2- 172.21.15.96:0/3885739808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc0f59e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fcca4004660 tx=0x7fcca4009b30).stop 2022-02-02T19:23:08.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 -- 172.21.15.96:0/3885739808 shutdown_connections 2022-02-02T19:23:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 --2- 172.21.15.96:0/3885739808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 --2- 172.21.15.96:0/3885739808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc0f59e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 -- 172.21.15.96:0/3885739808 >> 172.21.15.96:0/3885739808 conn(0x7fccbc0f0de0 msgr2=0x7fccbc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 -- 172.21.15.96:0/3885739808 shutdown_connections 2022-02-02T19:23:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 -- 172.21.15.96:0/3885739808 wait complete. 2022-02-02T19:23:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.726+0000 7fccc0b38700 1 Processor -- start 2022-02-02T19:23:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccc0b38700 1 -- start start 2022-02-02T19:23:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccc0b38700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccc0b38700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccc0b38700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc060410 con 0x7fccbc0f55c0 2022-02-02T19:23:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccc0b38700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc060550 con 0x7fccbc0f5ed0 2022-02-02T19:23:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59438/0 (socket says 172.21.15.96:59438) 2022-02-02T19:23:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 -- 172.21.15.96:0/693831752 learned_addr learned my addr 172.21.15.96:0/693831752 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccb9d9b700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 -- 172.21.15.96:0/693831752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 msgr2=0x7fccbc10e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc10e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 -- 172.21.15.96:0/693831752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4005040 con 0x7fccbc0f55c0 2022-02-02T19:23:08.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccb9d9b700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:23:08.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.727+0000 7fccba59c700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fcca4009990 tx=0x7fcca4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.728+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca4018070 con 0x7fccbc0f55c0 2022-02-02T19:23:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.728+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc10ea80 con 0x7fccbc0f55c0 2022-02-02T19:23:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.728+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcca4007ca0 con 0x7fccbc0f55c0 2022-02-02T19:23:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.728+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca401c620 con 0x7fccbc0f55c0 2022-02-02T19:23:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.728+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc10ee50 con 0x7fccbc0f55c0 2022-02-02T19:23:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.729+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc045ad0 con 0x7fccbc0f55c0 2022-02-02T19:23:08.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.729+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcca401d960 con 0x7fccbc0f55c0 2022-02-02T19:23:08.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.730+0000 7fccb2ffd700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 0x7fcca8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:08.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.730+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcca4083830 con 0x7fccbc0f55c0 2022-02-02T19:23:08.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.730+0000 7fccb9d9b700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 0x7fcca8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:08.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.730+0000 7fccb9d9b700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 0x7fcca8067290 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fccac0041d0 tx=0x7fccac009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:08.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.734+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcca40519a0 con 0x7fccbc0f55c0 2022-02-02T19:23:08.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.964+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccbc0586e0 con 0x7fccbc0f55c0 2022-02-02T19:23:08.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.965+0000 7fccb2ffd700 1 -- 172.21.15.96:0/693831752 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcca4054fc0 con 0x7fccbc0f55c0 2022-02-02T19:23:08.971 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:23:08.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:23:08.972 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:23:08.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:08.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:23:08.973 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:23:08.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:08.973 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:23:08.973 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:23:08.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:08.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:23:08.974 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:23:08.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:08.975 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:23:08.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:23:08.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:23:08.975 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:23:08.975 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:23:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 msgr2=0x7fcca8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 0x7fcca8067290 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fccac0041d0 tx=0x7fccac009040).stop 2022-02-02T19:23:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 msgr2=0x7fccbc10c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fcca4009990 tx=0x7fcca4009b30).stop 2022-02-02T19:23:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 shutdown_connections 2022-02-02T19:23:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcca8064dd0 0x7fcca8067290 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccbc0f55c0 0x7fccbc10c090 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 --2- 172.21.15.96:0/693831752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccbc0f5ed0 0x7fccbc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:08.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 >> 172.21.15.96:0/693831752 conn(0x7fccbc0f0de0 msgr2=0x7fccbc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:08.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 shutdown_connections 2022-02-02T19:23:08.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:08.967+0000 7fccc0b38700 1 -- 172.21.15.96:0/693831752 wait complete. 2022-02-02T19:23:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:08 smithi096 ceph-mon[101353]: pgmap v1830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:09.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/693831752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:23:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/1154281446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f6860 msgr2=0x7fc7f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/1154281446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f6860 0x7fc7f80f6cc0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fc7e8004660 tx=0x7fc7e8009b30).stop 2022-02-02T19:23:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/1154281446 shutdown_connections 2022-02-02T19:23:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/1154281446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f6860 0x7fc7f80f6cc0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/1154281446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f55c0 0x7fc7f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:23:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.064+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/1154281446 >> 172.21.15.96:0/1154281446 conn(0x7fc7f80f0d40 msgr2=0x7fc7f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/1154281446 shutdown_connections 2022-02-02T19:23:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/1154281446 wait complete. 2022-02-02T19:23:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 Processor -- start 2022-02-02T19:23:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 -- start start 2022-02-02T19:23:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f6860 0x7fc7f810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80602b0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7ffb7a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80603f0 con 0x7fc7f80f6860 2022-02-02T19:23:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7fd916700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7fd916700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59448/0 (socket says 172.21.15.96:59448) 2022-02-02T19:23:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.065+0000 7fc7fd916700 1 -- 172.21.15.96:0/853341724 learned_addr learned my addr 172.21.15.96:0/853341724 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7fd115700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f6860 0x7fc7f810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7fd916700 1 -- 172.21.15.96:0/853341724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f6860 msgr2=0x7fc7f810e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7fd916700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f6860 0x7fc7f810e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7fd916700 1 -- 172.21.15.96:0/853341724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8005040 con 0x7fc7f80f55c0 2022-02-02T19:23:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7fd916700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fc7f40093f0 tx=0x7fc7f4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f4009ea0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7f4013af0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f810eac0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f400db10 con 0x7fc7f80f55c0 2022-02-02T19:23:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.066+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f810efa0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.067+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8045ad0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.068+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc7f401a060 con 0x7fc7f80f55c0 2022-02-02T19:23:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.068+0000 7fc7ee7fc700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 0x7fc7e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.068+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc7f4081ae0 con 0x7fc7f80f55c0 2022-02-02T19:23:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.068+0000 7fc7fd115700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 0x7fc7e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.068+0000 7fc7fd115700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 0x7fc7e4067290 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc7e8004e30 tx=0x7fc7e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.072+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7f404fb90 con 0x7fc7f80f55c0 2022-02-02T19:23:09.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.271+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7f8027a00 con 0x7fc7f80f55c0 2022-02-02T19:23:09.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.272+0000 7fc7ee7fc700 1 -- 172.21.15.96:0/853341724 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc7f4018020 con 0x7fc7f80f55c0 2022-02-02T19:23:09.278 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:23:09.279 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:23:09.279 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:23:09.279 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:23:09.279 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:09.280 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:23:09.280 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:23:09.280 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:23:09.280 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:23:09.281 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:23:09.281 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:23:09.281 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:23:09.281 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:23:09.282 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:23:09.282 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:23:09.282 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:23:09.282 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:23:09.283 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:23:09.283 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:23:09.283 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:23:09.283 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:23:09.284 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:23:09.284 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:23:09.284 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:23:09.284 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:23:09.284 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:23:09.285 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:23:09.285 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:23:09.285 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:23:09.285 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:23:09.286 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:23:09.286 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:23:09.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:09.287 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:09.287 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:23:09.287 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:09.288 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:09.288 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:09.288 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:09.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:08 smithi159 ceph-mon[69013]: pgmap v1830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:09.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/693831752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:23:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 msgr2=0x7fc7e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:09.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 0x7fc7e4067290 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc7e8004e30 tx=0x7fc7e8009b30).stop 2022-02-02T19:23:09.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 msgr2=0x7fc7f810c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:09.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fc7f40093f0 tx=0x7fc7f4006ec0).stop 2022-02-02T19:23:09.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 shutdown_connections 2022-02-02T19:23:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7e4064dd0 0x7fc7e4067290 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f80f55c0 0x7fc7f810c0d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 --2- 172.21.15.96:0/853341724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7f80f6860 0x7fc7f810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 >> 172.21.15.96:0/853341724 conn(0x7fc7f80f0d40 msgr2=0x7fc7f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 shutdown_connections 2022-02-02T19:23:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:09.274+0000 7fc7ffb7a700 1 -- 172.21.15.96:0/853341724 wait complete. 2022-02-02T19:23:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:23:10.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:09 smithi159 ceph-mon[69013]: from='client.35994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:09 smithi159 ceph-mon[69013]: from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/853341724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:23:10.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:09 smithi096 ceph-mon[101353]: from='client.35994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:10.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:09 smithi096 ceph-mon[101353]: from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:10.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/853341724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:23:11.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:10 smithi159 ceph-mon[69013]: pgmap v1831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:11.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:10 smithi096 ceph-mon[101353]: pgmap v1831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:13.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:12 smithi096 ceph-mon[101353]: pgmap v1832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:12 smithi159 ceph-mon[69013]: pgmap v1832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:14 smithi159 ceph-mon[69013]: pgmap v1833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:14 smithi096 ceph-mon[101353]: pgmap v1833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:16 smithi159 ceph-mon[69013]: pgmap v1834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:16 smithi096 ceph-mon[101353]: pgmap v1834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:19.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:18 smithi159 ceph-mon[69013]: pgmap v1835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:18 smithi096 ceph-mon[101353]: pgmap v1835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:20 smithi159 ceph-mon[69013]: pgmap v1836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:20 smithi096 ceph-mon[101353]: pgmap v1836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:23.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:22 smithi096 ceph-mon[101353]: pgmap v1837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:22 smithi159 ceph-mon[69013]: pgmap v1837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:24 smithi159 ceph-mon[69013]: pgmap v1838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:25.364 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:24 smithi096 ceph-mon[101353]: pgmap v1838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:27.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:26 smithi159 ceph-mon[69013]: pgmap v1839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:27.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:26 smithi096 ceph-mon[101353]: pgmap v1839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:23:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:23:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:23:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:23:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:28 smithi159 ceph-mon[69013]: pgmap v1840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:28 smithi096 ceph-mon[101353]: pgmap v1840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:31.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:30 smithi159 ceph-mon[69013]: pgmap v1841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:30 smithi096 ceph-mon[101353]: pgmap v1841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:33.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:32 smithi096 ceph-mon[101353]: pgmap v1842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:32 smithi159 ceph-mon[69013]: pgmap v1842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:34 smithi159 ceph-mon[69013]: pgmap v1843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:35.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:34 smithi096 ceph-mon[101353]: pgmap v1843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:36 smithi159 ceph-mon[69013]: pgmap v1844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:36 smithi096 ceph-mon[101353]: pgmap v1844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:39.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:38 smithi159 ceph-mon[69013]: pgmap v1845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:38 smithi096 ceph-mon[101353]: pgmap v1845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:39.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/2303037397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f6c60 msgr2=0x7f5e640f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/2303037397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f6c60 0x7f5e640f7080 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f5e54004660 tx=0x7f5e54009b30).stop 2022-02-02T19:23:39.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/2303037397 shutdown_connections 2022-02-02T19:23:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/2303037397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f5970 0x7f5e640f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:23:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/2303037397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f6c60 0x7f5e640f7080 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/2303037397 >> 172.21.15.96:0/2303037397 conn(0x7f5e640f04c0 msgr2=0x7f5e640f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/2303037397 shutdown_connections 2022-02-02T19:23:39.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.385+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/2303037397 wait complete. 2022-02-02T19:23:39.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 Processor -- start 2022-02-02T19:23:39.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 -- start start 2022-02-02T19:23:39.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f6c60 0x7f5e6410c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640f5690 con 0x7f5e640f5970 2022-02-02T19:23:39.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.386+0000 7f5e6a5b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640f57d0 con 0x7f5e640f6c60 2022-02-02T19:23:39.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59476/0 (socket says 172.21.15.96:59476) 2022-02-02T19:23:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 -- 172.21.15.96:0/3980927283 learned_addr learned my addr 172.21.15.96:0/3980927283 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e637fe700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f6c60 0x7f5e6410c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 -- 172.21.15.96:0/3980927283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f6c60 msgr2=0x7f5e6410c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f6c60 0x7f5e6410c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 -- 172.21.15.96:0/3980927283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54005040 con 0x7f5e640f5970 2022-02-02T19:23:39.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e63fff700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f5e54009990 tx=0x7f5e54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e54018070 con 0x7f5e640f5970 2022-02-02T19:23:39.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6410c7b0 con 0x7f5e640f5970 2022-02-02T19:23:39.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e54007ba0 con 0x7f5e640f5970 2022-02-02T19:23:39.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5401c3c0 con 0x7f5e640f5970 2022-02-02T19:23:39.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.387+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6410cd10 con 0x7f5e640f5970 2022-02-02T19:23:39.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.388+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e64045ad0 con 0x7f5e640f5970 2022-02-02T19:23:39.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.389+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e5401d420 con 0x7f5e640f5970 2022-02-02T19:23:39.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.389+0000 7f5e60ff9700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 0x7f5e4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.389+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5e54083910 con 0x7f5e640f5970 2022-02-02T19:23:39.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.389+0000 7f5e637fe700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 0x7f5e4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.390+0000 7f5e637fe700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 0x7f5e4c067290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f5e58006fd0 tx=0x7f5e58008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.394+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e54051b30 con 0x7f5e640f5970 2022-02-02T19:23:39.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.571+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e640fdf30 con 0x7f5e4c064dd0 2022-02-02T19:23:39.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.572+0000 7f5e60ff9700 1 -- 172.21.15.96:0/3980927283 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5e640fdf30 con 0x7f5e4c064dd0 2022-02-02T19:23:39.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 msgr2=0x7f5e4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 0x7f5e4c067290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f5e58006fd0 tx=0x7f5e58008040).stop 2022-02-02T19:23:39.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 msgr2=0x7f5e64109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f5e54009990 tx=0x7f5e54009b30).stop 2022-02-02T19:23:39.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 shutdown_connections 2022-02-02T19:23:39.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e4c064dd0 0x7f5e4c067290 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e640f5970 0x7f5e64109d00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 --2- 172.21.15.96:0/3980927283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e640f6c60 0x7f5e6410c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 >> 172.21.15.96:0/3980927283 conn(0x7f5e640f04c0 msgr2=0x7f5e640fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 shutdown_connections 2022-02-02T19:23:39.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.574+0000 7f5e6a5b2700 1 -- 172.21.15.96:0/3980927283 wait complete. 2022-02-02T19:23:39.588 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:23:39.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 -- 172.21.15.96:0/2572614144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0f9860 msgr2=0x7f71bc0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/2572614144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0f9860 0x7f71bc0fbc70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f71ac004660 tx=0x7f71ac009b30).stop 2022-02-02T19:23:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 -- 172.21.15.96:0/2572614144 shutdown_connections 2022-02-02T19:23:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/2572614144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0f9860 0x7f71bc0fbc70 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/2572614144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0602d0 0x7f71bc0f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 -- 172.21.15.96:0/2572614144 >> 172.21.15.96:0/2572614144 conn(0x7f71bc0f0d40 msgr2=0x7f71bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 -- 172.21.15.96:0/2572614144 shutdown_connections 2022-02-02T19:23:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 -- 172.21.15.96:0/2572614144 wait complete. 2022-02-02T19:23:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.671+0000 7f71c1b8e700 1 Processor -- start 2022-02-02T19:23:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71c1b8e700 1 -- start start 2022-02-02T19:23:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71c1b8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71c1b8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0f9860 0x7f71bc107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71c1b8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1079e0 con 0x7f71bc0602d0 2022-02-02T19:23:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71c1b8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc107b20 con 0x7f71bc0f9860 2022-02-02T19:23:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59486/0 (socket says 172.21.15.96:59486) 2022-02-02T19:23:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71bb7fe700 1 -- 172.21.15.96:0/4018763004 learned_addr learned my addr 172.21.15.96:0/4018763004 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.672+0000 7f71baffd700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0f9860 0x7f71bc107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71bb7fe700 1 -- 172.21.15.96:0/4018763004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0f9860 msgr2=0x7f71bc107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71bb7fe700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0f9860 0x7f71bc107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71bb7fe700 1 -- 172.21.15.96:0/4018763004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac005040 con 0x7f71bc0602d0 2022-02-02T19:23:39.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71bb7fe700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f71b00026d0 tx=0x7f71b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b00079c0 con 0x7f71bc0602d0 2022-02-02T19:23:39.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc1084c0 con 0x7f71bc0602d0 2022-02-02T19:23:39.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71b000f040 con 0x7f71bc0602d0 2022-02-02T19:23:39.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b00148b0 con 0x7f71bc0602d0 2022-02-02T19:23:39.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.673+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc108a80 con 0x7f71bc0602d0 2022-02-02T19:23:39.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.674+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc045ad0 con 0x7f71bc0602d0 2022-02-02T19:23:39.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.674+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71b0007b20 con 0x7f71bc0602d0 2022-02-02T19:23:39.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.675+0000 7f71a3fff700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 0x7f71a4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.675+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f71b0081a30 con 0x7f71bc0602d0 2022-02-02T19:23:39.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.675+0000 7f71baffd700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 0x7f71a4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.675+0000 7f71baffd700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 0x7f71a4067270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f71ac013690 tx=0x7f71ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.679+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71b0053510 con 0x7f71bc0602d0 2022-02-02T19:23:39.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.851+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71bc0fefc0 con 0x7f71a4064db0 2022-02-02T19:23:39.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.861+0000 7f71a3fff700 1 -- 172.21.15.96:0/4018763004 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f71bc0fefc0 con 0x7f71a4064db0 2022-02-02T19:23:39.866 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:23:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (67m) 37m ago 68m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:23:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (59m) 37m ago 68m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:23:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (59m) 36m ago 67m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:23:39.868 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (66m) 37m ago 67m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:23:39.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (64m) 37m ago 64m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:23:39.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (59m) 37m ago 64m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:23:39.869 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (64m) 36m ago 64m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:23:39.869 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (60m) 36m ago 64m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:23:39.869 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (61m) 37m ago 69m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:23:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (60m) 36m ago 67m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:23:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (60m) 37m ago 69m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:23:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (60m) 36m ago 67m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:23:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (67m) 37m ago 67m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:23:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (67m) 36m ago 67m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:23:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (59m) 37m ago 66m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:23:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (58m) 37m ago 66m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:23:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (57m) 37m ago 66m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:23:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (57m) 36m ago 66m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:23:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (56m) 36m ago 65m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:23:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (56m) 36m ago 65m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:23:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (66m) 37m ago 67m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:23:39.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 msgr2=0x7f71a4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 0x7f71a4067270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f71ac013690 tx=0x7f71ac009b30).stop 2022-02-02T19:23:39.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 msgr2=0x7f71bc106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f71b00026d0 tx=0x7f71b0009de0).stop 2022-02-02T19:23:39.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 shutdown_connections 2022-02-02T19:23:39.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71a4064db0 0x7f71a4067270 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71bc0602d0 0x7f71bc106f40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 --2- 172.21.15.96:0/4018763004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71bc0f9860 0x7f71bc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 >> 172.21.15.96:0/4018763004 conn(0x7f71bc0f0d40 msgr2=0x7f71bc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:39.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 shutdown_connections 2022-02-02T19:23:39.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.863+0000 7f71c1b8e700 1 -- 172.21.15.96:0/4018763004 wait complete. 2022-02-02T19:23:39.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 -- 172.21.15.96:0/943019501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 msgr2=0x7fad640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 --2- 172.21.15.96:0/943019501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad640f6950 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fad60004660 tx=0x7fad60009b30).stop 2022-02-02T19:23:39.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 -- 172.21.15.96:0/943019501 shutdown_connections 2022-02-02T19:23:39.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 --2- 172.21.15.96:0/943019501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 0x7fad640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 --2- 172.21.15.96:0/943019501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad640f6950 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.959+0000 7fad6aa79700 1 -- 172.21.15.96:0/943019501 >> 172.21.15.96:0/943019501 conn(0x7fad640f1c90 msgr2=0x7fad640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:39.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 -- 172.21.15.96:0/943019501 shutdown_connections 2022-02-02T19:23:39.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 -- 172.21.15.96:0/943019501 wait complete. 2022-02-02T19:23:39.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 Processor -- start 2022-02-02T19:23:39.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 -- start start 2022-02-02T19:23:39.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 0x7fad641072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad641078f0 con 0x7fad640f6530 2022-02-02T19:23:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad6aa79700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64108100 con 0x7fad640f77d0 2022-02-02T19:23:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad69a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad69a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59496/0 (socket says 172.21.15.96:59496) 2022-02-02T19:23:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.960+0000 7fad69a77700 1 -- 172.21.15.96:0/2338301656 learned_addr learned my addr 172.21.15.96:0/2338301656 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad69276700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 0x7fad641072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad69a77700 1 -- 172.21.15.96:0/2338301656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 msgr2=0x7fad641072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad69a77700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 0x7fad641072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad69a77700 1 -- 172.21.15.96:0/2338301656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60005040 con 0x7fad640f6530 2022-02-02T19:23:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad69a77700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fad60004f60 tx=0x7fad60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad60018070 con 0x7fad640f6530 2022-02-02T19:23:39.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad60007ba0 con 0x7fad640f6530 2022-02-02T19:23:39.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64108320 con 0x7fad640f6530 2022-02-02T19:23:39.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6001c620 con 0x7fad640f6530 2022-02-02T19:23:39.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.961+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64108880 con 0x7fad640f6530 2022-02-02T19:23:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.963+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64059100 con 0x7fad640f6530 2022-02-02T19:23:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.963+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad6001c8e0 con 0x7fad640f6530 2022-02-02T19:23:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.963+0000 7fad5a7fc700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 0x7fad500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.963+0000 7fad69276700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 0x7fad500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.963+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fad60083990 con 0x7fad640f6530 2022-02-02T19:23:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.964+0000 7fad69276700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 0x7fad500672e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fad540041d0 tx=0x7fad54009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:39.967+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad60051a40 con 0x7fad640f6530 2022-02-02T19:23:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.197+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad640008d0 con 0x7fad640f6530 2022-02-02T19:23:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.197+0000 7fad5a7fc700 1 -- 172.21.15.96:0/2338301656 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fad60055060 con 0x7fad640f6530 2022-02-02T19:23:40.203 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:23:40.203 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:23:40.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:23:40.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:40.204 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:23:40.204 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:23:40.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:40.205 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:23:40.205 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:23:40.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:40.205 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:23:40.205 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:23:40.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:23:40.206 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:23:40.206 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:23:40.206 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:23:40.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:23:40.207 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:23:40.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 msgr2=0x7fad500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 0x7fad500672e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fad540041d0 tx=0x7fad54009040).stop 2022-02-02T19:23:40.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 msgr2=0x7fad64106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fad60004f60 tx=0x7fad60009b30).stop 2022-02-02T19:23:40.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 shutdown_connections 2022-02-02T19:23:40.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad50064e20 0x7fad500672e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad640f6530 0x7fad64106e00 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 --2- 172.21.15.96:0/2338301656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad640f77d0 0x7fad641072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 >> 172.21.15.96:0/2338301656 conn(0x7fad640f1c90 msgr2=0x7fad640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:40.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 shutdown_connections 2022-02-02T19:23:40.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.199+0000 7fad6aa79700 1 -- 172.21.15.96:0/2338301656 wait complete. 2022-02-02T19:23:40.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- 172.21.15.96:0/3810979963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f86e0 msgr2=0x7f6f1c0f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3810979963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c0f4860 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f6f08004660 tx=0x7f6f08009b30).stop 2022-02-02T19:23:40.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- 172.21.15.96:0/3810979963 shutdown_connections 2022-02-02T19:23:40.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3810979963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c0f4860 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3810979963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c0f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- 172.21.15.96:0/3810979963 >> 172.21.15.96:0/3810979963 conn(0x7f6f1c0f04c0 msgr2=0x7f6f1c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:40.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- 172.21.15.96:0/3810979963 shutdown_connections 2022-02-02T19:23:40.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- 172.21.15.96:0/3810979963 wait complete. 2022-02-02T19:23:40.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 Processor -- start 2022-02-02T19:23:40.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.296+0000 7f6f22b38700 1 -- start start 2022-02-02T19:23:40.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f22b38700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f22b38700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f22b38700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c107a00 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f22b38700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c107b40 con 0x7f6f1c0f86e0 2022-02-02T19:23:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59506/0 (socket says 172.21.15.96:59506) 2022-02-02T19:23:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 -- 172.21.15.96:0/3290360611 learned_addr learned my addr 172.21.15.96:0/3290360611 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:23:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f1bfff700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 -- 172.21.15.96:0/3290360611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f86e0 msgr2=0x7f6f1c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.297+0000 7f6f208d4700 1 -- 172.21.15.96:0/3290360611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08005040 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f208d4700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6f10002700 tx=0x7f6f10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f100079c0 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c1084e0 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f1000f040 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f10014860 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.298+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c108aa0 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.299+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c045ad0 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.300+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f1001b060 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.300+0000 7f6f197fa700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 0x7f6f0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:23:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.300+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6f10081b80 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.300+0000 7f6f1bfff700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 0x7f6f0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:23:40.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.301+0000 7f6f1bfff700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 0x7f6f0c067290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f6f08004630 tx=0x7f6f08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:23:40.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.304+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f10053720 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.507+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f1c108d20 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.507+0000 7f6f197fa700 1 -- 172.21.15.96:0/3290360611 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6f10019070 con 0x7f6f1c0f7d40 2022-02-02T19:23:40.512 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:23:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:23:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:23:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:23:40.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:23:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:23:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:23:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:23:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:23:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:23:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:23:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:23:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:23:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:23:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:23:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:23:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:23:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:23:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:23:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:23:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:23:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:23:40.518 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:23:40.518 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:23:40.518 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:23:40.518 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:23:40.519 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:23:40.519 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:23:40.519 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:23:40.519 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:23:40.519 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:23:40.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:40.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:40.520 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:23:40.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:23:40.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:40.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:40.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:23:40.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 msgr2=0x7f6f0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 0x7f6f0c067290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f6f08004630 tx=0x7f6f08009b30).stop 2022-02-02T19:23:40.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 msgr2=0x7f6f1c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:23:40.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6f10002700 tx=0x7f6f10009d80).stop 2022-02-02T19:23:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 shutdown_connections 2022-02-02T19:23:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f0c064dd0 0x7f6f0c067290 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f1c0f7d40 0x7f6f1c106f60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 --2- 172.21.15.96:0/3290360611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f1c0f86e0 0x7f6f1c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:23:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 >> 172.21.15.96:0/3290360611 conn(0x7f6f1c0f04c0 msgr2=0x7f6f1c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:23:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 shutdown_connections 2022-02-02T19:23:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:23:40.509+0000 7f6f22b38700 1 -- 172.21.15.96:0/3290360611 wait complete. 2022-02-02T19:23:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:23:41.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:40 smithi159 ceph-mon[69013]: from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:40 smithi159 ceph-mon[69013]: from='client.36014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:40 smithi159 ceph-mon[69013]: pgmap v1846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2338301656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:23:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3290360611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:23:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:40 smithi096 ceph-mon[101353]: from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:40 smithi096 ceph-mon[101353]: from='client.36014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:23:41.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:40 smithi096 ceph-mon[101353]: pgmap v1846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:41.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2338301656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:23:41.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3290360611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:23:43.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:42 smithi096 ceph-mon[101353]: pgmap v1847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:42 smithi159 ceph-mon[69013]: pgmap v1847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:45.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:44 smithi159 ceph-mon[69013]: pgmap v1848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:44 smithi096 ceph-mon[101353]: pgmap v1848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:46 smithi159 ceph-mon[69013]: pgmap v1849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:46 smithi096 ceph-mon[101353]: pgmap v1849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:48 smithi159 ceph-mon[69013]: pgmap v1850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:48 smithi096 ceph-mon[101353]: pgmap v1850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:50 smithi159 ceph-mon[69013]: pgmap v1851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:50 smithi096 ceph-mon[101353]: pgmap v1851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:52 smithi159 ceph-mon[69013]: pgmap v1852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:53.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:52 smithi096 ceph-mon[101353]: pgmap v1852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:55.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:54 smithi159 ceph-mon[69013]: pgmap v1853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:54 smithi096 ceph-mon[101353]: pgmap v1853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:56 smithi159 ceph-mon[69013]: pgmap v1854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:56 smithi096 ceph-mon[101353]: pgmap v1854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:59.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:23:58 smithi159 ceph-mon[69013]: pgmap v1855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:23:59.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:23:58 smithi096 ceph-mon[101353]: pgmap v1855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:01.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:00 smithi159 ceph-mon[69013]: pgmap v1856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:00 smithi096 ceph-mon[101353]: pgmap v1856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:03.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:02 smithi159 ceph-mon[69013]: pgmap v1857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:03.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:02 smithi096 ceph-mon[101353]: pgmap v1857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:05.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:04 smithi159 ceph-mon[69013]: pgmap v1858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:05.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:04 smithi096 ceph-mon[101353]: pgmap v1858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:07.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:06 smithi159 ceph-mon[69013]: pgmap v1859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:06 smithi096 ceph-mon[101353]: pgmap v1859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:09.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:08 smithi159 ceph-mon[69013]: pgmap v1860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:08 smithi096 ceph-mon[101353]: pgmap v1860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:10.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 -- 172.21.15.96:0/2161239934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b8060310 msgr2=0x7ff8b80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2161239934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b8060310 0x7ff8b80f9110 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7ff8ac004660 tx=0x7ff8ac009b30).stop 2022-02-02T19:24:10.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 -- 172.21.15.96:0/2161239934 shutdown_connections 2022-02-02T19:24:10.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2161239934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b80f9690 0x7ff8b80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2161239934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b8060310 0x7ff8b80f9110 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 -- 172.21.15.96:0/2161239934 >> 172.21.15.96:0/2161239934 conn(0x7ff8b80f0b90 msgr2=0x7ff8b80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:10.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 -- 172.21.15.96:0/2161239934 shutdown_connections 2022-02-02T19:24:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.619+0000 7ff8b759e700 1 -- 172.21.15.96:0/2161239934 wait complete. 2022-02-02T19:24:10.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 Processor -- start 2022-02-02T19:24:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 -- start start 2022-02-02T19:24:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b8060310 0x7ff8b8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8107880 con 0x7ff8b80f9690 2022-02-02T19:24:10.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b81080c0 con 0x7ff8b8060310 2022-02-02T19:24:10.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59528/0 (socket says 172.21.15.96:59528) 2022-02-02T19:24:10.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 -- 172.21.15.96:0/2442140773 learned_addr learned my addr 172.21.15.96:0/2442140773 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:10.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b659c700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b8060310 0x7ff8b8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 -- 172.21.15.96:0/2442140773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b8060310 msgr2=0x7ff8b8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b8060310 0x7ff8b8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 -- 172.21.15.96:0/2442140773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac005040 con 0x7ff8b80f9690 2022-02-02T19:24:10.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.620+0000 7ff8b5d9b700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7ff8a8002700 tx=0x7ff8a8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:10.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.621+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a80079c0 con 0x7ff8b80f9690 2022-02-02T19:24:10.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.621+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8a800f040 con 0x7ff8b80f9690 2022-02-02T19:24:10.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.621+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b81083a0 con 0x7ff8b80f9690 2022-02-02T19:24:10.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.621+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a8014740 con 0x7ff8b80f9690 2022-02-02T19:24:10.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.621+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b81088e0 con 0x7ff8b80f9690 2022-02-02T19:24:10.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.622+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b8059100 con 0x7ff8b80f9690 2022-02-02T19:24:10.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.622+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff8a801b060 con 0x7ff8b80f9690 2022-02-02T19:24:10.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.622+0000 7ff8a6ffd700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 0x7ff8a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.623+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff8a8081890 con 0x7ff8b80f9690 2022-02-02T19:24:10.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.623+0000 7ff8b659c700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 0x7ff8a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.623+0000 7ff8b659c700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 0x7ff8a00672e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff8ac004630 tx=0x7ff8ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:10.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.627+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff8a804f9f0 con 0x7ff8b80f9690 2022-02-02T19:24:10.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.806+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8b80feea0 con 0x7ff8a0064e20 2022-02-02T19:24:10.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.807+0000 7ff8a6ffd700 1 -- 172.21.15.96:0/2442140773 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff8b80feea0 con 0x7ff8a0064e20 2022-02-02T19:24:10.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 msgr2=0x7ff8a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 0x7ff8a00672e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff8ac004630 tx=0x7ff8ac009b30).stop 2022-02-02T19:24:10.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 msgr2=0x7ff8b8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7ff8a8002700 tx=0x7ff8a8009d60).stop 2022-02-02T19:24:10.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 shutdown_connections 2022-02-02T19:24:10.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.809+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8a0064e20 0x7ff8a00672e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.810+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b8060310 0x7ff8b8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.810+0000 7ff8b759e700 1 --2- 172.21.15.96:0/2442140773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8b80f9690 0x7ff8b8107280 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.810+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 >> 172.21.15.96:0/2442140773 conn(0x7ff8b80f0b90 msgr2=0x7ff8b80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:10.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.810+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 shutdown_connections 2022-02-02T19:24:10.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.810+0000 7ff8b759e700 1 -- 172.21.15.96:0/2442140773 wait complete. 2022-02-02T19:24:10.824 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:24:10.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 -- 172.21.15.96:0/1219031103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f55c0 msgr2=0x7fbe540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 --2- 172.21.15.96:0/1219031103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f55c0 0x7fbe540f59e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fbe50004660 tx=0x7fbe50009b30).stop 2022-02-02T19:24:10.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 -- 172.21.15.96:0/1219031103 shutdown_connections 2022-02-02T19:24:10.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 --2- 172.21.15.96:0/1219031103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f6860 0x7fbe540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 --2- 172.21.15.96:0/1219031103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f55c0 0x7fbe540f59e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 -- 172.21.15.96:0/1219031103 >> 172.21.15.96:0/1219031103 conn(0x7fbe540f0d40 msgr2=0x7fbe540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:10.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 -- 172.21.15.96:0/1219031103 shutdown_connections 2022-02-02T19:24:10.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.907+0000 7fbe5c164700 1 -- 172.21.15.96:0/1219031103 wait complete. 2022-02-02T19:24:10.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 Processor -- start 2022-02-02T19:24:10.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 -- start start 2022-02-02T19:24:10.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f55c0 0x7fbe54109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54109c20 con 0x7fbe540f6860 2022-02-02T19:24:10.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe5c164700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54109d60 con 0x7fbe540f55c0 2022-02-02T19:24:10.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe596ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe596ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59538/0 (socket says 172.21.15.96:59538) 2022-02-02T19:24:10.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.908+0000 7fbe596ff700 1 -- 172.21.15.96:0/157434079 learned_addr learned my addr 172.21.15.96:0/157434079 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:10.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe59f00700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f55c0 0x7fbe54109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe596ff700 1 -- 172.21.15.96:0/157434079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f55c0 msgr2=0x7fbe54109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:10.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe596ff700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f55c0 0x7fbe54109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:10.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe596ff700 1 -- 172.21.15.96:0/157434079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50005040 con 0x7fbe540f6860 2022-02-02T19:24:10.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe596ff700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fbe440026d0 tx=0x7fbe44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:10.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe440079c0 con 0x7fbe540f6860 2022-02-02T19:24:10.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe4400f040 con 0x7fbe540f6860 2022-02-02T19:24:10.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5410a700 con 0x7fbe540f6860 2022-02-02T19:24:10.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe440148b0 con 0x7fbe540f6860 2022-02-02T19:24:10.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.909+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5410acc0 con 0x7fbe540f6860 2022-02-02T19:24:10.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.910+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe54045ad0 con 0x7fbe540f6860 2022-02-02T19:24:10.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.911+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe44007b20 con 0x7fbe540f6860 2022-02-02T19:24:10.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.911+0000 7fbe4a7fc700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 0x7fbe40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:10.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.911+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbe440819e0 con 0x7fbe540f6860 2022-02-02T19:24:10.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.911+0000 7fbe59f00700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 0x7fbe40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:10.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.911+0000 7fbe59f00700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 0x7fbe40067290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fbe50004630 tx=0x7fbe50009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:10.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:10.915+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe440534c0 con 0x7fbe540f6860 2022-02-02T19:24:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.091+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe540faaa0 con 0x7fbe40064dd0 2022-02-02T19:24:11.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.101+0000 7fbe4a7fc700 1 -- 172.21.15.96:0/157434079 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbe540faaa0 con 0x7fbe40064dd0 2022-02-02T19:24:11.106 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:24:11.106 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (67m) 38m ago 68m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:24:11.106 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (59m) 38m ago 68m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:24:11.107 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (59m) 36m ago 68m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:24:11.107 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (67m) 38m ago 68m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:24:11.107 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (64m) 38m ago 64m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:24:11.107 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (60m) 38m ago 64m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:24:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (64m) 36m ago 64m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:24:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (60m) 36m ago 64m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:24:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (61m) 38m ago 69m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:24:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (61m) 36m ago 68m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:24:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (60m) 38m ago 69m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:24:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (60m) 36m ago 68m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:24:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (68m) 38m ago 68m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:24:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (67m) 36m ago 67m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:24:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (59m) 38m ago 67m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:24:11.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (59m) 38m ago 67m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:24:11.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (58m) 38m ago 66m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:24:11.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (57m) 36m ago 66m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:24:11.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (57m) 36m ago 66m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:24:11.111 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (56m) 36m ago 65m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:24:11.111 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (67m) 38m ago 68m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:24:11.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 msgr2=0x7fbe40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 0x7fbe40067290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fbe50004630 tx=0x7fbe50009b30).stop 2022-02-02T19:24:11.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 msgr2=0x7fbe54109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fbe440026d0 tx=0x7fbe44009de0).stop 2022-02-02T19:24:11.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 shutdown_connections 2022-02-02T19:24:11.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe40064dd0 0x7fbe40067290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe540f55c0 0x7fbe54109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 --2- 172.21.15.96:0/157434079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe540f6860 0x7fbe54109670 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 >> 172.21.15.96:0/157434079 conn(0x7fbe540f0d40 msgr2=0x7fbe5405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:11.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 shutdown_connections 2022-02-02T19:24:11.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.103+0000 7fbe5c164700 1 -- 172.21.15.96:0/157434079 wait complete. 2022-02-02T19:24:11.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.198+0000 7fb53b59e700 1 -- 172.21.15.96:0/1460323082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f5440 msgr2=0x7fb53c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.198+0000 7fb53b59e700 1 --2- 172.21.15.96:0/1460323082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f5440 0x7fb53c0f5860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fb52c004660 tx=0x7fb52c009b30).stop 2022-02-02T19:24:11.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 -- 172.21.15.96:0/1460323082 shutdown_connections 2022-02-02T19:24:11.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 --2- 172.21.15.96:0/1460323082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f66e0 0x7fb53c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 --2- 172.21.15.96:0/1460323082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f5440 0x7fb53c0f5860 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 -- 172.21.15.96:0/1460323082 >> 172.21.15.96:0/1460323082 conn(0x7fb53c0f0ba0 msgr2=0x7fb53c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:11.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 -- 172.21.15.96:0/1460323082 shutdown_connections 2022-02-02T19:24:11.205 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:10 smithi096 ceph-mon[101353]: pgmap v1861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:11.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 -- 172.21.15.96:0/1460323082 wait complete. 2022-02-02T19:24:11.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 Processor -- start 2022-02-02T19:24:11.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.199+0000 7fb53b59e700 1 -- start start 2022-02-02T19:24:11.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb53b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f5440 0x7fb53c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb53b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb53b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0603e0 con 0x7fb53c0f66e0 2022-02-02T19:24:11.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb53b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c060520 con 0x7fb53c0f5440 2022-02-02T19:24:11.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59546/0 (socket says 172.21.15.96:59546) 2022-02-02T19:24:11.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 -- 172.21.15.96:0/2898720669 learned_addr learned my addr 172.21.15.96:0/2898720669 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:11.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb53a59c700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f5440 0x7fb53c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 -- 172.21.15.96:0/2898720669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f5440 msgr2=0x7fb53c109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f5440 0x7fb53c109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 -- 172.21.15.96:0/2898720669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c005040 con 0x7fb53c0f66e0 2022-02-02T19:24:11.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.200+0000 7fb539d9b700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fb53000c790 tx=0x7fb530007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:11.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.201+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53000e680 con 0x7fb53c0f66e0 2022-02-02T19:24:11.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.202+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb53000ec90 con 0x7fb53c0f66e0 2022-02-02T19:24:11.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.202+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb530013d60 con 0x7fb53c0f66e0 2022-02-02T19:24:11.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.202+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c10c4d0 con 0x7fb53c0f66e0 2022-02-02T19:24:11.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.202+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c10ca90 con 0x7fb53c0f66e0 2022-02-02T19:24:11.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.202+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c045ad0 con 0x7fb53c0f66e0 2022-02-02T19:24:11.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.203+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb53001a060 con 0x7fb53c0f66e0 2022-02-02T19:24:11.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.203+0000 7fb52affd700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 0x7fb5240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.203+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb530081da0 con 0x7fb53c0f66e0 2022-02-02T19:24:11.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.203+0000 7fb53a59c700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 0x7fb5240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.204+0000 7fb53a59c700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 0x7fb5240672e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fb52c004e30 tx=0x7fb52c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:11.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.208+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb53004fd90 con 0x7fb53c0f66e0 2022-02-02T19:24:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:10 smithi159 ceph-mon[69013]: pgmap v1861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.442+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb53c027a00 con 0x7fb53c0f66e0 2022-02-02T19:24:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.442+0000 7fb52affd700 1 -- 172.21.15.96:0/2898720669 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb530018070 con 0x7fb53c0f66e0 2022-02-02T19:24:11.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:24:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:24:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:24:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:24:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:24:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:24:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:24:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:24:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:24:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:24:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:24:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:24:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:24:11.452 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:24:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 msgr2=0x7fb5240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 0x7fb5240672e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fb52c004e30 tx=0x7fb52c009b30).stop 2022-02-02T19:24:11.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 msgr2=0x7fb53c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fb53000c790 tx=0x7fb530007d70).stop 2022-02-02T19:24:11.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 shutdown_connections 2022-02-02T19:24:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb524064e20 0x7fb5240672e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb53c0f5440 0x7fb53c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 --2- 172.21.15.96:0/2898720669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb53c0f66e0 0x7fb53c10bf20 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 >> 172.21.15.96:0/2898720669 conn(0x7fb53c0f0ba0 msgr2=0x7fb53c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 shutdown_connections 2022-02-02T19:24:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.444+0000 7fb53b59e700 1 -- 172.21.15.96:0/2898720669 wait complete. 2022-02-02T19:24:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 -- 172.21.15.96:0/1720081482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 msgr2=0x7f44380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1720081482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f44380f6cc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f442c004660 tx=0x7f442c009b30).stop 2022-02-02T19:24:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 -- 172.21.15.96:0/1720081482 shutdown_connections 2022-02-02T19:24:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1720081482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f44380f6cc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1720081482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 0x7f44380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:24:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 -- 172.21.15.96:0/1720081482 >> 172.21.15.96:0/1720081482 conn(0x7f44380f0d40 msgr2=0x7f44380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 -- 172.21.15.96:0/1720081482 shutdown_connections 2022-02-02T19:24:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 -- 172.21.15.96:0/1720081482 wait complete. 2022-02-02T19:24:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.541+0000 7f443e9e1700 1 Processor -- start 2022-02-02T19:24:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f443e9e1700 1 -- start start 2022-02-02T19:24:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f443e9e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 0x7f4438109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f443e9e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f443e9e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380604b0 con 0x7f44380f6860 2022-02-02T19:24:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f443e9e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380605f0 con 0x7f44380f55c0 2022-02-02T19:24:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59556/0 (socket says 172.21.15.96:59556) 2022-02-02T19:24:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 -- 172.21.15.96:0/1782902258 learned_addr learned my addr 172.21.15.96:0/1782902258 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f4437fff700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 0x7f4438109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 -- 172.21.15.96:0/1782902258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 msgr2=0x7f4438109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 0x7f4438109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 -- 172.21.15.96:0/1782902258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c005040 con 0x7f44380f6860 2022-02-02T19:24:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.542+0000 7f44377fe700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f442c009990 tx=0x7f442c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.543+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f442c018070 con 0x7f44380f6860 2022-02-02T19:24:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.543+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f442c007ca0 con 0x7f44380f6860 2022-02-02T19:24:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.543+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443810c770 con 0x7f44380f6860 2022-02-02T19:24:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.543+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f442c01c620 con 0x7f44380f6860 2022-02-02T19:24:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.543+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443810ccd0 con 0x7f44380f6860 2022-02-02T19:24:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.544+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f442c01d960 con 0x7f44380f6860 2022-02-02T19:24:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.544+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4438045ad0 con 0x7f44380f6860 2022-02-02T19:24:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.545+0000 7f4434ff9700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 0x7f4420067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.545+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f442c083830 con 0x7f44380f6860 2022-02-02T19:24:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.545+0000 7f4437fff700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 0x7f4420067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.545+0000 7f4437fff700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 0x7f4420067290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f44380600a0 tx=0x7f4428008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.549+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f442c0519a0 con 0x7f44380f6860 2022-02-02T19:24:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.748+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4438027a00 con 0x7f44380f6860 2022-02-02T19:24:11.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.749+0000 7f4434ff9700 1 -- 172.21.15.96:0/1782902258 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f442c054fc0 con 0x7f44380f6860 2022-02-02T19:24:11.755 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:24:11.755 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:24:11.756 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:24:11.756 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:24:11.757 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:11.757 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:24:11.757 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:24:11.758 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:24:11.758 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:24:11.759 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:24:11.759 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:24:11.760 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:24:11.760 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:24:11.761 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:24:11.761 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:24:11.761 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:24:11.762 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:24:11.762 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:24:11.763 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:24:11.763 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:24:11.764 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:24:11.764 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:24:11.765 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:24:11.765 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:24:11.765 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:24:11.766 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:24:11.766 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:24:11.767 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:24:11.767 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:24:11.768 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:24:11.768 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:24:11.768 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:24:11.769 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:11.769 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:11.770 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:24:11.770 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:11.770 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:11.771 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:11.771 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 msgr2=0x7f4420067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 0x7f4420067290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f44380600a0 tx=0x7f4428008040).stop 2022-02-02T19:24:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 msgr2=0x7f443810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f442c009990 tx=0x7f442c009b30).stop 2022-02-02T19:24:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 shutdown_connections 2022-02-02T19:24:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4420064dd0 0x7f4420067290 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44380f55c0 0x7f4438109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 --2- 172.21.15.96:0/1782902258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44380f6860 0x7f443810c170 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 >> 172.21.15.96:0/1782902258 conn(0x7f44380f0d40 msgr2=0x7f44380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 shutdown_connections 2022-02-02T19:24:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:11.752+0000 7f443e9e1700 1 -- 172.21.15.96:0/1782902258 wait complete. 2022-02-02T19:24:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:24:12.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:11 smithi159 ceph-mon[69013]: from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2898720669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:24:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1782902258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:24:12.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:11 smithi096 ceph-mon[101353]: from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:12.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2898720669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:24:12.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1782902258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:24:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:12 smithi159 ceph-mon[69013]: from='client.36030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:13.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:12 smithi159 ceph-mon[69013]: pgmap v1862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:13.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:12 smithi096 ceph-mon[101353]: from='client.36030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:13.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:12 smithi096 ceph-mon[101353]: pgmap v1862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:15.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:14 smithi159 ceph-mon[69013]: pgmap v1863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:15.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:14 smithi096 ceph-mon[101353]: pgmap v1863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:17.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:16 smithi159 ceph-mon[69013]: pgmap v1864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:16 smithi096 ceph-mon[101353]: pgmap v1864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:19.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:18 smithi159 ceph-mon[69013]: pgmap v1865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:18 smithi096 ceph-mon[101353]: pgmap v1865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:21.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:20 smithi159 ceph-mon[69013]: pgmap v1866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:20 smithi096 ceph-mon[101353]: pgmap v1866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:22 smithi159 ceph-mon[69013]: pgmap v1867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:23.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:22 smithi096 ceph-mon[101353]: pgmap v1867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:25 smithi159 ceph-mon[69013]: pgmap v1868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:25.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:24 smithi096 ceph-mon[101353]: pgmap v1868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:26 smithi159 ceph-mon[69013]: pgmap v1869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:27.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:26 smithi096 ceph-mon[101353]: pgmap v1869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:24:28.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:24:28.469 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:24:28.469 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:24:29.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:28 smithi159 ceph-mon[69013]: pgmap v1870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:28 smithi096 ceph-mon[101353]: pgmap v1870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:31.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:30 smithi159 ceph-mon[69013]: pgmap v1871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:31.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:30 smithi096 ceph-mon[101353]: pgmap v1871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:32 smithi159 ceph-mon[69013]: pgmap v1872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:33.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:32 smithi096 ceph-mon[101353]: pgmap v1872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:35.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:35 smithi159 ceph-mon[69013]: pgmap v1873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:35.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:34 smithi096 ceph-mon[101353]: pgmap v1873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:36 smithi159 ceph-mon[69013]: pgmap v1874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:36 smithi096 ceph-mon[101353]: pgmap v1874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:39.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:38 smithi159 ceph-mon[69013]: pgmap v1875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:38 smithi096 ceph-mon[101353]: pgmap v1875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:41.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:41 smithi159 ceph-mon[69013]: pgmap v1876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:41.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:41 smithi096 ceph-mon[101353]: pgmap v1876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:41.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 -- 172.21.15.96:0/4152619424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f7980 msgr2=0x7f4f500f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:41.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 --2- 172.21.15.96:0/4152619424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f7980 0x7f4f500f7de0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f4f3c004660 tx=0x7f4f3c009b30).stop 2022-02-02T19:24:41.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 -- 172.21.15.96:0/4152619424 shutdown_connections 2022-02-02T19:24:41.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 --2- 172.21.15.96:0/4152619424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f7980 0x7f4f500f7de0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:41.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 --2- 172.21.15.96:0/4152619424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f66e0 0x7f4f500f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:41.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 -- 172.21.15.96:0/4152619424 >> 172.21.15.96:0/4152619424 conn(0x7f4f500f1e40 msgr2=0x7f4f500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:41.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 -- 172.21.15.96:0/4152619424 shutdown_connections 2022-02-02T19:24:41.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.860+0000 7f4f571eb700 1 -- 172.21.15.96:0/4152619424 wait complete. 2022-02-02T19:24:41.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 Processor -- start 2022-02-02T19:24:41.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 -- start start 2022-02-02T19:24:41.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:41.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f7980 0x7f4f50069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:41.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5006a380 con 0x7f4f500f66e0 2022-02-02T19:24:41.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.861+0000 7f4f571eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5006a4c0 con 0x7f4f500f7980 2022-02-02T19:24:41.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:41.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59572/0 (socket says 172.21.15.96:59572) 2022-02-02T19:24:41.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 -- 172.21.15.96:0/3249603949 learned_addr learned my addr 172.21.15.96:0/3249603949 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:41.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f4ffff700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f7980 0x7f4f50069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:41.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 -- 172.21.15.96:0/3249603949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f7980 msgr2=0x7f4f50069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:41.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f7980 0x7f4f50069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:41.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 -- 172.21.15.96:0/3249603949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c005040 con 0x7f4f500f66e0 2022-02-02T19:24:41.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f54f87700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f4f44002700 tx=0x7f4f44009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:41.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f440079c0 con 0x7f4f500f66e0 2022-02-02T19:24:41.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f4400f040 con 0x7f4f500f66e0 2022-02-02T19:24:41.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5006a7a0 con 0x7f4f500f66e0 2022-02-02T19:24:41.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f44014860 con 0x7f4f500f66e0 2022-02-02T19:24:41.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.862+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5010ef90 con 0x7f4f500f66e0 2022-02-02T19:24:41.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.863+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f50045ad0 con 0x7f4f500f66e0 2022-02-02T19:24:41.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.864+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f4401b060 con 0x7f4f500f66e0 2022-02-02T19:24:41.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.864+0000 7f4f4d7fa700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 0x7f4f40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:41.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.864+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f44081840 con 0x7f4f500f66e0 2022-02-02T19:24:41.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.864+0000 7f4f4ffff700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 0x7f4f40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:41.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.865+0000 7f4f4ffff700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 0x7f4f40067290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4f3c004630 tx=0x7f4f3c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:41.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:41.869+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f4404f8f0 con 0x7f4f500f66e0 2022-02-02T19:24:42.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.046+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f500fefe0 con 0x7f4f40064dd0 2022-02-02T19:24:42.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.047+0000 7f4f4d7fa700 1 -- 172.21.15.96:0/3249603949 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4f500fefe0 con 0x7f4f40064dd0 2022-02-02T19:24:42.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 msgr2=0x7f4f40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 0x7f4f40067290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4f3c004630 tx=0x7f4f3c009b30).stop 2022-02-02T19:24:42.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 msgr2=0x7f4f5006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f4f44002700 tx=0x7f4f44009d80).stop 2022-02-02T19:24:42.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 shutdown_connections 2022-02-02T19:24:42.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f40064dd0 0x7f4f40067290 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f500f66e0 0x7f4f5006b9a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 --2- 172.21.15.96:0/3249603949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f500f7980 0x7f4f50069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 >> 172.21.15.96:0/3249603949 conn(0x7f4f500f1e40 msgr2=0x7f4f500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 shutdown_connections 2022-02-02T19:24:42.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.049+0000 7f4f571eb700 1 -- 172.21.15.96:0/3249603949 wait complete. 2022-02-02T19:24:42.065 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:24:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 -- 172.21.15.96:0/4261521928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f5430 msgr2=0x7f76480f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 --2- 172.21.15.96:0/4261521928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f5430 0x7f76480f5850 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f7638004660 tx=0x7f7638009b30).stop 2022-02-02T19:24:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 -- 172.21.15.96:0/4261521928 shutdown_connections 2022-02-02T19:24:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 --2- 172.21.15.96:0/4261521928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f66d0 0x7f76480f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 --2- 172.21.15.96:0/4261521928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f5430 0x7f76480f5850 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.147+0000 7f764759e700 1 -- 172.21.15.96:0/4261521928 >> 172.21.15.96:0/4261521928 conn(0x7f76480f0b90 msgr2=0x7f76480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 -- 172.21.15.96:0/4261521928 shutdown_connections 2022-02-02T19:24:42.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 -- 172.21.15.96:0/4261521928 wait complete. 2022-02-02T19:24:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 Processor -- start 2022-02-02T19:24:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 -- start start 2022-02-02T19:24:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 0x7f7648109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480603c0 con 0x7f76480f66d0 2022-02-02T19:24:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.148+0000 7f764759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648060500 con 0x7f76480f5430 2022-02-02T19:24:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59584/0 (socket says 172.21.15.96:59584) 2022-02-02T19:24:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 -- 172.21.15.96:0/243866873 learned_addr learned my addr 172.21.15.96:0/243866873 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f764659c700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 0x7f7648109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 -- 172.21.15.96:0/243866873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 msgr2=0x7f7648109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 0x7f7648109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 -- 172.21.15.96:0/243866873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638005040 con 0x7f76480f66d0 2022-02-02T19:24:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f764659c700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 0x7f7648109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:24:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7645d9b700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f763c00c530 tx=0x7f763c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c00f650 con 0x7f76480f66d0 2022-02-02T19:24:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764810c560 con 0x7f76480f66d0 2022-02-02T19:24:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f763c00fc60 con 0x7f76480f66d0 2022-02-02T19:24:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c012cd0 con 0x7f76480f66d0 2022-02-02T19:24:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.149+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764810caf0 con 0x7f76480f66d0 2022-02-02T19:24:42.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.150+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648059100 con 0x7f76480f66d0 2022-02-02T19:24:42.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.151+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f763c010070 con 0x7f76480f66d0 2022-02-02T19:24:42.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.151+0000 7f7636ffd700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 0x7f76300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.151+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f763c0817d0 con 0x7f76480f66d0 2022-02-02T19:24:42.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.151+0000 7f764659c700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 0x7f76300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.151+0000 7f764659c700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 0x7f76300672e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f7638004e30 tx=0x7f7638009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.155+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f763c04f880 con 0x7f76480f66d0 2022-02-02T19:24:42.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.328+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f76480fdda0 con 0x7f7630064e20 2022-02-02T19:24:42.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.337+0000 7f7636ffd700 1 -- 172.21.15.96:0/243866873 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7638013410 con 0x7f7630064e20 2022-02-02T19:24:42.344 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:24:42.344 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (68m) 38m ago 69m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:24:42.344 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (60m) 38m ago 69m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:24:42.345 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (60m) 37m ago 68m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:24:42.345 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (67m) 38m ago 68m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:24:42.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (65m) 38m ago 65m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:24:42.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (60m) 38m ago 65m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:24:42.346 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (65m) 37m ago 65m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:24:42.346 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (61m) 37m ago 65m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:24:42.346 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (62m) 38m ago 70m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:24:42.346 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (61m) 37m ago 68m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:24:42.347 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (61m) 38m ago 70m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:24:42.347 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (61m) 37m ago 68m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:24:42.347 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (68m) 38m ago 68m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:24:42.348 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (68m) 37m ago 68m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:24:42.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (60m) 38m ago 67m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:24:42.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (59m) 38m ago 67m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:24:42.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (59m) 38m ago 67m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:24:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (58m) 37m ago 67m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:24:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (57m) 37m ago 66m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:24:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (57m) 37m ago 66m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:24:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (67m) 38m ago 68m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:24:42.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 msgr2=0x7f76300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 0x7f76300672e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f7638004e30 tx=0x7f7638009b30).stop 2022-02-02T19:24:42.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 msgr2=0x7f764810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f763c00c530 tx=0x7f763c007e20).stop 2022-02-02T19:24:42.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 shutdown_connections 2022-02-02T19:24:42.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7630064e20 0x7f76300672e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76480f5430 0x7f7648109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 --2- 172.21.15.96:0/243866873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76480f66d0 0x7f764810bfb0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 >> 172.21.15.96:0/243866873 conn(0x7f76480f0b90 msgr2=0x7f76480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 shutdown_connections 2022-02-02T19:24:42.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.340+0000 7f764759e700 1 -- 172.21.15.96:0/243866873 wait complete. 2022-02-02T19:24:42.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 -- 172.21.15.96:0/651969779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 msgr2=0x7fd5780f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 --2- 172.21.15.96:0/651969779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd5780f9170 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fd56c004660 tx=0x7fd56c009b30).stop 2022-02-02T19:24:42.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 -- 172.21.15.96:0/651969779 shutdown_connections 2022-02-02T19:24:42.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 --2- 172.21.15.96:0/651969779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 0x7fd5780fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 --2- 172.21.15.96:0/651969779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd5780f9170 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 -- 172.21.15.96:0/651969779 >> 172.21.15.96:0/651969779 conn(0x7fd5780f0b90 msgr2=0x7fd5780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 -- 172.21.15.96:0/651969779 shutdown_connections 2022-02-02T19:24:42.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.436+0000 7fd57de7d700 1 -- 172.21.15.96:0/651969779 wait complete. 2022-02-02T19:24:42.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.437+0000 7fd57de7d700 1 Processor -- start 2022-02-02T19:24:42.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.437+0000 7fd57de7d700 1 -- start start 2022-02-02T19:24:42.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57de7d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57de7d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 0x7fd5781072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57de7d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781078a0 con 0x7fd5780602b0 2022-02-02T19:24:42.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57de7d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781080e0 con 0x7fd5780f96f0 2022-02-02T19:24:42.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59592/0 (socket says 172.21.15.96:59592) 2022-02-02T19:24:42.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 -- 172.21.15.96:0/787410070 learned_addr learned my addr 172.21.15.96:0/787410070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:42.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd577fff700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 0x7fd5781072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 -- 172.21.15.96:0/787410070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 msgr2=0x7fd5781072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 0x7fd5781072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 -- 172.21.15.96:0/787410070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c005040 con 0x7fd5780602b0 2022-02-02T19:24:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57ce7b700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fd56c009990 tx=0x7fd56c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c018070 con 0x7fd5780602b0 2022-02-02T19:24:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd578108360 con 0x7fd5780602b0 2022-02-02T19:24:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd56c007ba0 con 0x7fd5780602b0 2022-02-02T19:24:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.438+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c01c3c0 con 0x7fd5780602b0 2022-02-02T19:24:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.439+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd578108840 con 0x7fd5780602b0 2022-02-02T19:24:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.440+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd578059100 con 0x7fd5780602b0 2022-02-02T19:24:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.440+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd56c01d420 con 0x7fd5780602b0 2022-02-02T19:24:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.440+0000 7fd5757fa700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 0x7fd5680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.441+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd56c083700 con 0x7fd5780602b0 2022-02-02T19:24:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.441+0000 7fd577fff700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 0x7fd5680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.441+0000 7fd577fff700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 0x7fd5680672e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fd578106b40 tx=0x7fd56400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.445+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd56c051810 con 0x7fd5780602b0 2022-02-02T19:24:42.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.674+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd578045b50 con 0x7fd5780602b0 2022-02-02T19:24:42.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.675+0000 7fd5757fa700 1 -- 172.21.15.96:0/787410070 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd578045b50 con 0x7fd5780602b0 2022-02-02T19:24:42.681 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:24:42.682 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:24:42.682 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:24:42.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:42.683 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:24:42.683 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:24:42.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:42.684 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:24:42.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:24:42.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:42.684 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:24:42.685 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:24:42.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:24:42.685 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:24:42.685 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:24:42.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:24:42.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:24:42.686 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:24:42.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 msgr2=0x7fd5680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 0x7fd5680672e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fd578106b40 tx=0x7fd56400b040).stop 2022-02-02T19:24:42.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 msgr2=0x7fd578106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fd56c009990 tx=0x7fd56c009b30).stop 2022-02-02T19:24:42.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 shutdown_connections 2022-02-02T19:24:42.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd568064e20 0x7fd5680672e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5780602b0 0x7fd578106db0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 --2- 172.21.15.96:0/787410070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5780f96f0 0x7fd5781072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 >> 172.21.15.96:0/787410070 conn(0x7fd5780f0b90 msgr2=0x7fd5780f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 shutdown_connections 2022-02-02T19:24:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.677+0000 7fd57de7d700 1 -- 172.21.15.96:0/787410070 wait complete. 2022-02-02T19:24:42.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 -- 172.21.15.96:0/3627255374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0f66e0 msgr2=0x7f8edc0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 --2- 172.21.15.96:0/3627255374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0f66e0 0x7f8edc0f6b40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f8ec8004660 tx=0x7f8ec8009b30).stop 2022-02-02T19:24:42.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 -- 172.21.15.96:0/3627255374 shutdown_connections 2022-02-02T19:24:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 --2- 172.21.15.96:0/3627255374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0f66e0 0x7f8edc0f6b40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 --2- 172.21.15.96:0/3627255374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc0f5440 0x7f8edc0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 -- 172.21.15.96:0/3627255374 >> 172.21.15.96:0/3627255374 conn(0x7f8edc0f0ba0 msgr2=0x7f8edc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 -- 172.21.15.96:0/3627255374 shutdown_connections 2022-02-02T19:24:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.773+0000 7f8ee1824700 1 -- 172.21.15.96:0/3627255374 wait complete. 2022-02-02T19:24:42.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 Processor -- start 2022-02-02T19:24:42.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 -- start start 2022-02-02T19:24:42.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc0f5440 0x7f8edc109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc10c650 con 0x7f8edc0602b0 2022-02-02T19:24:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.774+0000 7f8ee1824700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc10c790 con 0x7f8edc0f5440 2022-02-02T19:24:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59604/0 (socket says 172.21.15.96:59604) 2022-02-02T19:24:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 -- 172.21.15.96:0/1572573855 learned_addr learned my addr 172.21.15.96:0/1572573855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:24:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 -- 172.21.15.96:0/1572573855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc0f5440 msgr2=0x7f8edc109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc0f5440 0x7f8edc109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:24:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 -- 172.21.15.96:0/1572573855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8005040 con 0x7f8edc0602b0 2022-02-02T19:24:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8edbfff700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f8ec8000c00 tx=0x7f8ec8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec8019070 con 0x7f8edc0602b0 2022-02-02T19:24:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc10ca10 con 0x7f8edc0602b0 2022-02-02T19:24:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ec80097d0 con 0x7f8edc0602b0 2022-02-02T19:24:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec80145f0 con 0x7f8edc0602b0 2022-02-02T19:24:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.775+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc10cf10 con 0x7f8edc0602b0 2022-02-02T19:24:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.776+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc045ad0 con 0x7f8edc0602b0 2022-02-02T19:24:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.777+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ec8014750 con 0x7f8edc0602b0 2022-02-02T19:24:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.777+0000 7f8ed97fa700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 0x7f8ecc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:24:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.777+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ec8082d50 con 0x7f8edc0602b0 2022-02-02T19:24:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.778+0000 7f8ee0822700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 0x7f8ecc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:24:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.778+0000 7f8ee0822700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 0x7f8ecc0672e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8edc060040 tx=0x7f8ed0007a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:24:42.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.782+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ec8050e00 con 0x7f8edc0602b0 2022-02-02T19:24:42.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.982+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8edc027a00 con 0x7f8edc0602b0 2022-02-02T19:24:42.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.982+0000 7f8ed97fa700 1 -- 172.21.15.96:0/1572573855 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8ec8054420 con 0x7f8edc0602b0 2022-02-02T19:24:42.989 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:24:42.989 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:24:42.989 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:24:42.990 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:24:42.990 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:42.990 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:24:42.990 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:24:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:24:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:24:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:24:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:24:42.991 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:24:42.992 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:24:42.992 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:24:42.992 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:24:42.992 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:24:42.993 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:24:42.993 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:24:42.993 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:24:42.993 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:24:42.994 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:24:42.994 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:24:42.994 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:24:42.994 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:24:42.995 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:24:42.995 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:24:42.995 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:24:42.995 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:24:42.996 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:24:42.996 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:24:42.996 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:24:42.996 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:24:42.996 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:42.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:42.997 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:24:42.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:24:42.998 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:42.998 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:42.998 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:24:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 msgr2=0x7f8ecc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 0x7f8ecc0672e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8edc060040 tx=0x7f8ed0007a60).stop 2022-02-02T19:24:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 msgr2=0x7f8edc10c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:24:43.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f8ec8000c00 tx=0x7f8ec8009b30).stop 2022-02-02T19:24:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 shutdown_connections 2022-02-02T19:24:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ecc064e20 0x7f8ecc0672e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc0f5440 0x7f8edc109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:24:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 --2- 172.21.15.96:0/1572573855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8edc0602b0 0x7f8edc10c110 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:24:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 >> 172.21.15.96:0/1572573855 conn(0x7f8edc0f0ba0 msgr2=0x7f8edc0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:24:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 shutdown_connections 2022-02-02T19:24:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:24:42.984+0000 7f8ee1824700 1 -- 172.21.15.96:0/1572573855 wait complete. 2022-02-02T19:24:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:24:43.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:43 smithi096 ceph-mon[101353]: pgmap v1877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:43.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/787410070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:24:43.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1572573855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:24:43.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:43 smithi159 ceph-mon[69013]: pgmap v1877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:43.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/787410070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:24:43.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1572573855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:24:44.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:44 smithi159 ceph-mon[69013]: from='client.36042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:44.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:44 smithi159 ceph-mon[69013]: from='client.36046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:44.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:44 smithi096 ceph-mon[101353]: from='client.36042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:44.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:44 smithi096 ceph-mon[101353]: from='client.36046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:24:45.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:45 smithi159 ceph-mon[69013]: pgmap v1878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:45.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:45 smithi096 ceph-mon[101353]: pgmap v1878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:47.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:46 smithi159 ceph-mon[69013]: pgmap v1879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:46 smithi096 ceph-mon[101353]: pgmap v1879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:49.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:48 smithi159 ceph-mon[69013]: pgmap v1880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:48 smithi096 ceph-mon[101353]: pgmap v1880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:51 smithi159 ceph-mon[69013]: pgmap v1881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:51.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:51 smithi096 ceph-mon[101353]: pgmap v1881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:53 smithi159 ceph-mon[69013]: pgmap v1882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:53.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:53 smithi096 ceph-mon[101353]: pgmap v1882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:55.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:55 smithi159 ceph-mon[69013]: pgmap v1883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:55.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:55 smithi096 ceph-mon[101353]: pgmap v1883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:56 smithi159 ceph-mon[69013]: pgmap v1884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:56 smithi096 ceph-mon[101353]: pgmap v1884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:59.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:24:59 smithi159 ceph-mon[69013]: pgmap v1885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:24:59.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:24:59 smithi096 ceph-mon[101353]: pgmap v1885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:01.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:01 smithi159 ceph-mon[69013]: pgmap v1886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:01.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:01 smithi096 ceph-mon[101353]: pgmap v1886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:03.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:03 smithi159 ceph-mon[69013]: pgmap v1887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:03.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:03 smithi096 ceph-mon[101353]: pgmap v1887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:04 smithi159 ceph-mon[69013]: pgmap v1888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:04 smithi096 ceph-mon[101353]: pgmap v1888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:06 smithi159 ceph-mon[69013]: pgmap v1889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:06 smithi096 ceph-mon[101353]: pgmap v1889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:09.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:09 smithi159 ceph-mon[69013]: pgmap v1890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:09.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:09 smithi096 ceph-mon[101353]: pgmap v1890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:11.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:11 smithi159 ceph-mon[69013]: pgmap v1891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:11.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:11 smithi096 ceph-mon[101353]: pgmap v1891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:13.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 -- 172.21.15.96:0/4119611412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f55c0 msgr2=0x7f568c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 --2- 172.21.15.96:0/4119611412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f55c0 0x7f568c0f59e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f5680004660 tx=0x7f5680009b30).stop 2022-02-02T19:25:13.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 -- 172.21.15.96:0/4119611412 shutdown_connections 2022-02-02T19:25:13.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 --2- 172.21.15.96:0/4119611412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f6860 0x7f568c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 --2- 172.21.15.96:0/4119611412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f55c0 0x7f568c0f59e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 -- 172.21.15.96:0/4119611412 >> 172.21.15.96:0/4119611412 conn(0x7f568c0f0d40 msgr2=0x7f568c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 -- 172.21.15.96:0/4119611412 shutdown_connections 2022-02-02T19:25:13.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 -- 172.21.15.96:0/4119611412 wait complete. 2022-02-02T19:25:13.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.093+0000 7f569321c700 1 Processor -- start 2022-02-02T19:25:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f569321c700 1 -- start start 2022-02-02T19:25:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f569321c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f55c0 0x7f568c109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f569321c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f569321c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0603c0 con 0x7f568c0f6860 2022-02-02T19:25:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f569321c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c060500 con 0x7f568c0f55c0 2022-02-02T19:25:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f568bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f568bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59626/0 (socket says 172.21.15.96:59626) 2022-02-02T19:25:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f568bfff700 1 -- 172.21.15.96:0/558720454 learned_addr learned my addr 172.21.15.96:0/558720454 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:13.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f5690fb8700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f55c0 0x7f568c109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f568bfff700 1 -- 172.21.15.96:0/558720454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f55c0 msgr2=0x7f568c109c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.094+0000 7f568bfff700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f55c0 0x7f568c109c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f568bfff700 1 -- 172.21.15.96:0/558720454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680005040 con 0x7f568c0f6860 2022-02-02T19:25:13.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f568bfff700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f567800c530 tx=0x7f5678007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f567800f650 con 0x7f568c0f6860 2022-02-02T19:25:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f567800fc60 con 0x7f568c0f6860 2022-02-02T19:25:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c10c6d0 con 0x7f568c0f6860 2022-02-02T19:25:13.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5678012c20 con 0x7f568c0f6860 2022-02-02T19:25:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.095+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c10cc60 con 0x7f568c0f6860 2022-02-02T19:25:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.096+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c0f49b0 con 0x7f568c0f6860 2022-02-02T19:25:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.096+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5678010070 con 0x7f568c0f6860 2022-02-02T19:25:13.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.097+0000 7f56897fa700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 0x7f567c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.097+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5678081760 con 0x7f568c0f6860 2022-02-02T19:25:13.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.097+0000 7f5690fb8700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 0x7f567c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.097+0000 7f5690fb8700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 0x7f567c067290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5680013690 tx=0x7f5680009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.101+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f567804f810 con 0x7f568c0f6860 2022-02-02T19:25:13.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:13 smithi159 ceph-mon[69013]: pgmap v1892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:13.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.281+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f568c0fdf30 con 0x7f567c064dd0 2022-02-02T19:25:13.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:13 smithi096 ceph-mon[101353]: pgmap v1892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:13.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.282+0000 7f56897fa700 1 -- 172.21.15.96:0/558720454 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5680019040 con 0x7f567c064dd0 2022-02-02T19:25:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 msgr2=0x7f567c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 0x7f567c067290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5680013690 tx=0x7f5680009b30).stop 2022-02-02T19:25:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 msgr2=0x7f568c10c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f567800c530 tx=0x7f5678007e20).stop 2022-02-02T19:25:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 shutdown_connections 2022-02-02T19:25:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f567c064dd0 0x7f567c067290 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f568c0f55c0 0x7f568c109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 --2- 172.21.15.96:0/558720454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f568c0f6860 0x7f568c10c120 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 >> 172.21.15.96:0/558720454 conn(0x7f568c0f0d40 msgr2=0x7f568c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 shutdown_connections 2022-02-02T19:25:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.284+0000 7f569321c700 1 -- 172.21.15.96:0/558720454 wait complete. 2022-02-02T19:25:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:25:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 -- 172.21.15.96:0/4224678393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f7980 msgr2=0x7f7ce00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 --2- 172.21.15.96:0/4224678393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f7980 0x7f7ce00f7de0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f7cdc004660 tx=0x7f7cdc009b30).stop 2022-02-02T19:25:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 -- 172.21.15.96:0/4224678393 shutdown_connections 2022-02-02T19:25:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 --2- 172.21.15.96:0/4224678393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f7980 0x7f7ce00f7de0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 --2- 172.21.15.96:0/4224678393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f66e0 0x7f7ce00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 -- 172.21.15.96:0/4224678393 >> 172.21.15.96:0/4224678393 conn(0x7f7ce00f1e40 msgr2=0x7f7ce00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 -- 172.21.15.96:0/4224678393 shutdown_connections 2022-02-02T19:25:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.381+0000 7f7ce7423700 1 -- 172.21.15.96:0/4224678393 wait complete. 2022-02-02T19:25:13.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 Processor -- start 2022-02-02T19:25:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 -- start start 2022-02-02T19:25:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f7980 0x7f7ce01073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0107990 con 0x7f7ce00f66e0 2022-02-02T19:25:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce7423700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0107ad0 con 0x7f7ce00f7980 2022-02-02T19:25:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59634/0 (socket says 172.21.15.96:59634) 2022-02-02T19:25:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 -- 172.21.15.96:0/945190300 learned_addr learned my addr 172.21.15.96:0/945190300 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce49be700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f7980 0x7f7ce01073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 -- 172.21.15.96:0/945190300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f7980 msgr2=0x7f7ce01073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f7980 0x7f7ce01073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.382+0000 7f7ce51bf700 1 -- 172.21.15.96:0/945190300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc005040 con 0x7f7ce00f66e0 2022-02-02T19:25:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7ce51bf700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f7cd000c530 tx=0x7f7cd0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd000f650 con 0x7f7ce00f66e0 2022-02-02T19:25:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0108470 con 0x7f7ce00f66e0 2022-02-02T19:25:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cd000fc60 con 0x7f7ce00f66e0 2022-02-02T19:25:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd0012d20 con 0x7f7ce00f66e0 2022-02-02T19:25:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.383+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce01089b0 con 0x7f7ce00f66e0 2022-02-02T19:25:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.384+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce0045ad0 con 0x7f7ce00f66e0 2022-02-02T19:25:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.384+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cd0019030 con 0x7f7ce00f66e0 2022-02-02T19:25:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.385+0000 7f7cd5ffb700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 0x7f7ccc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.385+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7cd0081700 con 0x7f7ce00f66e0 2022-02-02T19:25:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.385+0000 7f7ce49be700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 0x7f7ccc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.385+0000 7f7ce49be700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 0x7f7ccc067290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f7cdc009da0 tx=0x7f7cdc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.389+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cd0053230 con 0x7f7ce00f66e0 2022-02-02T19:25:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.563+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ce0108c30 con 0x7f7ccc064dd0 2022-02-02T19:25:13.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.572+0000 7f7cd5ffb700 1 -- 172.21.15.96:0/945190300 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7ce0108c30 con 0x7f7ccc064dd0 2022-02-02T19:25:13.579 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:25:13.580 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (68m) 39m ago 69m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:25:13.580 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (61m) 39m ago 69m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:25:13.581 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (60m) 37m ago 69m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:25:13.581 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (68m) 39m ago 69m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:25:13.582 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (65m) 39m ago 65m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:25:13.582 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (61m) 39m ago 65m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:25:13.582 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (65m) 37m ago 65m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:25:13.583 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (61m) 37m ago 65m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:25:13.583 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (62m) 39m ago 70m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:25:13.584 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (62m) 37m ago 69m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:25:13.584 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (61m) 39m ago 70m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:25:13.585 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (61m) 37m ago 69m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:25:13.585 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (69m) 39m ago 69m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:25:13.586 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (68m) 37m ago 68m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:25:13.586 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (60m) 39m ago 68m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:25:13.586 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (60m) 39m ago 68m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:25:13.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (59m) 39m ago 67m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:25:13.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (59m) 37m ago 67m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:25:13.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (58m) 37m ago 67m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:25:13.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (58m) 37m ago 67m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:25:13.589 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (68m) 39m ago 69m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:25:13.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 msgr2=0x7f7ccc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 0x7f7ccc067290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f7cdc009da0 tx=0x7f7cdc009b30).stop 2022-02-02T19:25:13.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 msgr2=0x7f7ce0106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f7cd000c530 tx=0x7f7cd0007e10).stop 2022-02-02T19:25:13.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 shutdown_connections 2022-02-02T19:25:13.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064dd0 0x7f7ccc067290 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f66e0 0x7f7ce0106ef0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 --2- 172.21.15.96:0/945190300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f7980 0x7f7ce01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 >> 172.21.15.96:0/945190300 conn(0x7f7ce00f1e40 msgr2=0x7f7ce00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 shutdown_connections 2022-02-02T19:25:13.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.574+0000 7f7ce7423700 1 -- 172.21.15.96:0/945190300 wait complete. 2022-02-02T19:25:13.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- 172.21.15.96:0/3157141558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 msgr2=0x7f2ca00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 --2- 172.21.15.96:0/3157141558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca00f59e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f2c94004660 tx=0x7f2c94009b30).stop 2022-02-02T19:25:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- 172.21.15.96:0/3157141558 shutdown_connections 2022-02-02T19:25:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 --2- 172.21.15.96:0/3157141558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 --2- 172.21.15.96:0/3157141558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca00f59e0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- 172.21.15.96:0/3157141558 >> 172.21.15.96:0/3157141558 conn(0x7f2ca00f0d40 msgr2=0x7f2ca00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- 172.21.15.96:0/3157141558 shutdown_connections 2022-02-02T19:25:13.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- 172.21.15.96:0/3157141558 wait complete. 2022-02-02T19:25:13.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 Processor -- start 2022-02-02T19:25:13.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.671+0000 7f2ca687b700 1 -- start start 2022-02-02T19:25:13.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0106950 con 0x7f2ca00f55c0 2022-02-02T19:25:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0106a90 con 0x7f2ca00f6860 2022-02-02T19:25:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59644/0 (socket says 172.21.15.96:59644) 2022-02-02T19:25:13.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 -- 172.21.15.96:0/2416988336 learned_addr learned my addr 172.21.15.96:0/2416988336 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:13.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9f7fe700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 -- 172.21.15.96:0/2416988336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 msgr2=0x7f2ca01063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca01063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 -- 172.21.15.96:0/2416988336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94005040 con 0x7f2ca00f55c0 2022-02-02T19:25:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9f7fe700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:25:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9ffff700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f2c94009d30 tx=0x7f2c94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9401a070 con 0x7f2ca00f55c0 2022-02-02T19:25:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca01073d0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c940097d0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca0107930 con 0x7f2ca00f55c0 2022-02-02T19:25:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.672+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9401f8d0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.673+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0045ad0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.674+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c940125d0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.674+0000 7f2c9cff9700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 0x7f2c88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:13.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.674+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2c94085e10 con 0x7f2ca00f55c0 2022-02-02T19:25:13.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.674+0000 7f2c9f7fe700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 0x7f2c88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:13.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.675+0000 7f2c9f7fe700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 0x7f2c88067290 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f2c900041d0 tx=0x7f2c90009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:13.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.678+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c940578f0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.908+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ca00ff7b0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.909+0000 7f2c9cff9700 1 -- 172.21.15.96:0/2416988336 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2c940574e0 con 0x7f2ca00f55c0 2022-02-02T19:25:13.915 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:25:13.916 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:25:13.916 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:25:13.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:13.916 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:25:13.917 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:25:13.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:13.917 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:25:13.917 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:25:13.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:13.918 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:25:13.918 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:25:13.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:13.918 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:25:13.919 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:25:13.919 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:25:13.919 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:25:13.919 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:25:13.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 msgr2=0x7f2c88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 0x7f2c88067290 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f2c900041d0 tx=0x7f2c90009040).stop 2022-02-02T19:25:13.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 msgr2=0x7f2ca0105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:13.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f2c94009d30 tx=0x7f2c94009b30).stop 2022-02-02T19:25:13.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 shutdown_connections 2022-02-02T19:25:13.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c88064dd0 0x7f2c88067290 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca00f55c0 0x7f2ca0105eb0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 --2- 172.21.15.96:0/2416988336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca00f6860 0x7f2ca01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:13.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 >> 172.21.15.96:0/2416988336 conn(0x7f2ca00f0d40 msgr2=0x7f2ca00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:13.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 shutdown_connections 2022-02-02T19:25:13.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:13.911+0000 7f2ca687b700 1 -- 172.21.15.96:0/2416988336 wait complete. 2022-02-02T19:25:14.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 -- 172.21.15.96:0/40002482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 msgr2=0x7fb1880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:14.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/40002482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb1880f7de0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fb17c004660 tx=0x7fb17c009b30).stop 2022-02-02T19:25:14.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 -- 172.21.15.96:0/40002482 shutdown_connections 2022-02-02T19:25:14.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/40002482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb1880f7de0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/40002482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 0x7fb1880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 -- 172.21.15.96:0/40002482 >> 172.21.15.96:0/40002482 conn(0x7fb1880f1e40 msgr2=0x7fb1880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:14.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.008+0000 7fb18e8f7700 1 -- 172.21.15.96:0/40002482 shutdown_connections 2022-02-02T19:25:14.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 -- 172.21.15.96:0/40002482 wait complete. 2022-02-02T19:25:14.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 Processor -- start 2022-02-02T19:25:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 -- start start 2022-02-02T19:25:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 0x7fb18806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18806a380 con 0x7fb1880f7980 2022-02-02T19:25:14.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb18e8f7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18806a4c0 con 0x7fb1880f66e0 2022-02-02T19:25:14.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.009+0000 7fb1877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:14.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59656/0 (socket says 172.21.15.96:59656) 2022-02-02T19:25:14.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 -- 172.21.15.96:0/345602788 learned_addr learned my addr 172.21.15.96:0/345602788 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:14.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb187fff700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 0x7fb18806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:14.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 -- 172.21.15.96:0/345602788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 msgr2=0x7fb18806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:14.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 0x7fb18806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 -- 172.21.15.96:0/345602788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c005040 con 0x7fb1880f7980 2022-02-02T19:25:14.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb1877fe700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fb17c009990 tx=0x7fb17c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17c018070 con 0x7fb1880f7980 2022-02-02T19:25:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18806a740 con 0x7fb1880f7980 2022-02-02T19:25:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb17c007ba0 con 0x7fb1880f7980 2022-02-02T19:25:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17c01c3c0 con 0x7fb1880f7980 2022-02-02T19:25:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.010+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18806aca0 con 0x7fb1880f7980 2022-02-02T19:25:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.011+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb188045ad0 con 0x7fb1880f7980 2022-02-02T19:25:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.012+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb17c01d420 con 0x7fb1880f7980 2022-02-02T19:25:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.012+0000 7fb184ff9700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 0x7fb170067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.012+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb17c0836e0 con 0x7fb1880f7980 2022-02-02T19:25:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.012+0000 7fb187fff700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 0x7fb170067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.012+0000 7fb187fff700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 0x7fb170067290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fb18806b730 tx=0x7fb17800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:14.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.018+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb17c051850 con 0x7fb1880f7980 2022-02-02T19:25:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.216+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb188027a00 con 0x7fb1880f7980 2022-02-02T19:25:14.223 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2416988336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:25:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.217+0000 7fb184ff9700 1 -- 172.21.15.96:0/345602788 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb17c054e70 con 0x7fb1880f7980 2022-02-02T19:25:14.224 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:25:14.224 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:25:14.224 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:25:14.224 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:25:14.225 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:14.225 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:25:14.225 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:25:14.225 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:25:14.226 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:25:14.226 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:25:14.226 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:25:14.226 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:25:14.227 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:25:14.227 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:25:14.227 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:25:14.227 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:25:14.227 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:25:14.228 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:25:14.228 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:25:14.228 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:25:14.228 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:25:14.228 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:25:14.229 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:25:14.229 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:25:14.229 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:25:14.229 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:25:14.229 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:25:14.230 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:25:14.230 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:25:14.230 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:25:14.230 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:25:14.231 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:25:14.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:14.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:14.231 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:25:14.232 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:14.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:14.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:14.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 msgr2=0x7fb170067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 0x7fb170067290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fb18806b730 tx=0x7fb17800b040).stop 2022-02-02T19:25:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 msgr2=0x7fb188069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fb17c009990 tx=0x7fb17c009b30).stop 2022-02-02T19:25:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 shutdown_connections 2022-02-02T19:25:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb170064dd0 0x7fb170067290 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1880f66e0 0x7fb18806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 --2- 172.21.15.96:0/345602788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1880f7980 0x7fb188069e20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.218+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 >> 172.21.15.96:0/345602788 conn(0x7fb1880f1e40 msgr2=0x7fb1880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.219+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 shutdown_connections 2022-02-02T19:25:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:14.219+0000 7fb18e8f7700 1 -- 172.21.15.96:0/345602788 wait complete. 2022-02-02T19:25:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:25:14.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2416988336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:25:15.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:15 smithi159 ceph-mon[69013]: from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:15.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:15 smithi159 ceph-mon[69013]: from='client.36062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:15.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:15 smithi159 ceph-mon[69013]: pgmap v1893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:15.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/345602788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:25:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:15 smithi096 ceph-mon[101353]: from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:15.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:15 smithi096 ceph-mon[101353]: from='client.36062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:15.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:15 smithi096 ceph-mon[101353]: pgmap v1893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:15.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/345602788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:25:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:16 smithi159 ceph-mon[69013]: pgmap v1894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:16 smithi096 ceph-mon[101353]: pgmap v1894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:19.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:19 smithi159 ceph-mon[69013]: pgmap v1895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:19 smithi096 ceph-mon[101353]: pgmap v1895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:21.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:21 smithi159 ceph-mon[69013]: pgmap v1896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:21.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:21 smithi096 ceph-mon[101353]: pgmap v1896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:22.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:22 smithi159 ceph-mon[69013]: pgmap v1897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:22.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:22 smithi096 ceph-mon[101353]: pgmap v1897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:25.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:25 smithi159 ceph-mon[69013]: pgmap v1898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:25.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:25 smithi096 ceph-mon[101353]: pgmap v1898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:26 smithi159 ceph-mon[69013]: pgmap v1899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:27.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:26 smithi096 ceph-mon[101353]: pgmap v1899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:25:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:25:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:25:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:25:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:28 smithi159 ceph-mon[69013]: pgmap v1900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:28 smithi096 ceph-mon[101353]: pgmap v1900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:31 smithi159 ceph-mon[69013]: pgmap v1901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:31.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:31 smithi096 ceph-mon[101353]: pgmap v1901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:33.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:33 smithi159 ceph-mon[69013]: pgmap v1902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:33.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:33 smithi096 ceph-mon[101353]: pgmap v1902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:34 smithi159 ceph-mon[69013]: pgmap v1903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:34 smithi096 ceph-mon[101353]: pgmap v1903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:37.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:36 smithi159 ceph-mon[69013]: pgmap v1904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:36 smithi096 ceph-mon[101353]: pgmap v1904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:39.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:39 smithi159 ceph-mon[69013]: pgmap v1905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:39 smithi096 ceph-mon[101353]: pgmap v1905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:40 smithi159 ceph-mon[69013]: pgmap v1906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:40 smithi096 ceph-mon[101353]: pgmap v1906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:43.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:43 smithi159 ceph-mon[69013]: pgmap v1907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:43.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:43 smithi096 ceph-mon[101353]: pgmap v1907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:44.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 -- 172.21.15.96:0/670191657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 msgr2=0x7f4eec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 --2- 172.21.15.96:0/670191657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec0f59e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f4ee0004660 tx=0x7f4ee0009b30).stop 2022-02-02T19:25:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 -- 172.21.15.96:0/670191657 shutdown_connections 2022-02-02T19:25:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 --2- 172.21.15.96:0/670191657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 0x7f4eec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 --2- 172.21.15.96:0/670191657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec0f59e0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 -- 172.21.15.96:0/670191657 >> 172.21.15.96:0/670191657 conn(0x7f4eec0f0d40 msgr2=0x7f4eec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 -- 172.21.15.96:0/670191657 shutdown_connections 2022-02-02T19:25:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.330+0000 7f4ef315e700 1 -- 172.21.15.96:0/670191657 wait complete. 2022-02-02T19:25:44.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:44 smithi096 ceph-mon[101353]: pgmap v1908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 Processor -- start 2022-02-02T19:25:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 -- start start 2022-02-02T19:25:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 0x7f4eec10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0603c0 con 0x7f4eec0f55c0 2022-02-02T19:25:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef315e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec060500 con 0x7f4eec0f6860 2022-02-02T19:25:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef0efa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef0efa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59678/0 (socket says 172.21.15.96:59678) 2022-02-02T19:25:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4ef0efa700 1 -- 172.21.15.96:0/944829802 learned_addr learned my addr 172.21.15.96:0/944829802 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.331+0000 7f4eebfff700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 0x7f4eec10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef0efa700 1 -- 172.21.15.96:0/944829802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 msgr2=0x7f4eec10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef0efa700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 0x7f4eec10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef0efa700 1 -- 172.21.15.96:0/944829802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0005040 con 0x7f4eec0f55c0 2022-02-02T19:25:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef0efa700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f4ee0004f60 tx=0x7f4ee0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee0018070 con 0x7f4eec0f55c0 2022-02-02T19:25:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec10c6e0 con 0x7f4eec0f55c0 2022-02-02T19:25:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ee0009770 con 0x7f4eec0f55c0 2022-02-02T19:25:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee001c3c0 con 0x7f4eec0f55c0 2022-02-02T19:25:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.332+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec10cc10 con 0x7f4eec0f55c0 2022-02-02T19:25:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.333+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec045ad0 con 0x7f4eec0f55c0 2022-02-02T19:25:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.334+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ee001d420 con 0x7f4eec0f55c0 2022-02-02T19:25:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.334+0000 7f4ee97fa700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 0x7f4edc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.334+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ee00838a0 con 0x7f4eec0f55c0 2022-02-02T19:25:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.334+0000 7f4eebfff700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 0x7f4edc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.334+0000 7f4eebfff700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 0x7f4edc067290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4ed80041d0 tx=0x7f4ed8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.338+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ee0051950 con 0x7f4eec0f55c0 2022-02-02T19:25:44.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.519+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eec057f10 con 0x7f4edc064dd0 2022-02-02T19:25:44.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.520+0000 7f4ee97fa700 1 -- 172.21.15.96:0/944829802 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4eec057f10 con 0x7f4edc064dd0 2022-02-02T19:25:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 msgr2=0x7f4edc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 0x7f4edc067290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4ed80041d0 tx=0x7f4ed8009040).stop 2022-02-02T19:25:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 msgr2=0x7f4eec109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f4ee0004f60 tx=0x7f4ee0009b30).stop 2022-02-02T19:25:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 shutdown_connections 2022-02-02T19:25:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4edc064dd0 0x7f4edc067290 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eec0f55c0 0x7f4eec109c90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 --2- 172.21.15.96:0/944829802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec0f6860 0x7f4eec10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 >> 172.21.15.96:0/944829802 conn(0x7f4eec0f0d40 msgr2=0x7f4eec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 shutdown_connections 2022-02-02T19:25:44.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.522+0000 7f4ef315e700 1 -- 172.21.15.96:0/944829802 wait complete. 2022-02-02T19:25:44.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:44 smithi159 ceph-mon[69013]: pgmap v1908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:25:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 -- 172.21.15.96:0/4273752167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 msgr2=0x7f3a240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/4273752167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a240f6cc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f3a10004660 tx=0x7f3a10009b30).stop 2022-02-02T19:25:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 -- 172.21.15.96:0/4273752167 shutdown_connections 2022-02-02T19:25:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/4273752167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a240f6cc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/4273752167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 0x7f3a240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:25:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 -- 172.21.15.96:0/4273752167 >> 172.21.15.96:0/4273752167 conn(0x7f3a240f0d40 msgr2=0x7f3a240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 -- 172.21.15.96:0/4273752167 shutdown_connections 2022-02-02T19:25:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.619+0000 7f3a2ab93700 1 -- 172.21.15.96:0/4273752167 wait complete. 2022-02-02T19:25:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 Processor -- start 2022-02-02T19:25:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 -- start start 2022-02-02T19:25:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 0x7f3a24109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24060450 con 0x7f3a240f6860 2022-02-02T19:25:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.620+0000 7f3a2ab93700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24060590 con 0x7f3a240f55c0 2022-02-02T19:25:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59690/0 (socket says 172.21.15.96:59690) 2022-02-02T19:25:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 -- 172.21.15.96:0/2229241135 learned_addr learned my addr 172.21.15.96:0/2229241135 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a2892f700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 0x7f3a24109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 -- 172.21.15.96:0/2229241135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 msgr2=0x7f3a24109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 0x7f3a24109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 -- 172.21.15.96:0/2229241135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10005040 con 0x7f3a240f6860 2022-02-02T19:25:44.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a23fff700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f3a10009990 tx=0x7f3a10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a10018070 con 0x7f3a240f6860 2022-02-02T19:25:44.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2410c780 con 0x7f3a240f6860 2022-02-02T19:25:44.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a10007ba0 con 0x7f3a240f6860 2022-02-02T19:25:44.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1001c620 con 0x7f3a240f6860 2022-02-02T19:25:44.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.621+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2410cce0 con 0x7f3a240f6860 2022-02-02T19:25:44.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.622+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a24045ad0 con 0x7f3a240f6860 2022-02-02T19:25:44.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.623+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a1001c8e0 con 0x7f3a240f6860 2022-02-02T19:25:44.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.623+0000 7f3a217fa700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 0x7f3a14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.623+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3a10083900 con 0x7f3a240f6860 2022-02-02T19:25:44.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.623+0000 7f3a2892f700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 0x7f3a14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.624+0000 7f3a2892f700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 0x7f3a14067290 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3a24060040 tx=0x7f3a18008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.628+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a100519b0 con 0x7f3a240f6860 2022-02-02T19:25:44.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.799+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a240008d0 con 0x7f3a14064dd0 2022-02-02T19:25:44.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.808+0000 7f3a217fa700 1 -- 172.21.15.96:0/2229241135 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3a240008d0 con 0x7f3a14064dd0 2022-02-02T19:25:44.814 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:25:44.814 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (69m) 39m ago 70m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:25:44.814 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (61m) 39m ago 70m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:25:44.815 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (61m) 38m ago 69m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:25:44.815 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (68m) 39m ago 69m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:25:44.815 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (66m) 39m ago 66m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:25:44.815 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (61m) 39m ago 66m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:25:44.816 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (66m) 38m ago 66m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:25:44.816 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (62m) 38m ago 66m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:25:44.816 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (63m) 39m ago 71m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:25:44.816 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (62m) 38m ago 69m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:25:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (62m) 39m ago 71m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:25:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (62m) 38m ago 69m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:25:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (69m) 39m ago 69m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:25:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (69m) 38m ago 69m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:25:44.817 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (61m) 39m ago 69m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:25:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (60m) 39m ago 68m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:25:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (60m) 39m ago 68m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:25:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (59m) 38m ago 68m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:25:44.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (59m) 38m ago 67m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:25:44.819 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (58m) 38m ago 67m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:25:44.819 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (68m) 39m ago 69m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:25:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 msgr2=0x7f3a14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 0x7f3a14067290 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f3a24060040 tx=0x7f3a18008040).stop 2022-02-02T19:25:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 msgr2=0x7f3a2410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f3a10009990 tx=0x7f3a10009b30).stop 2022-02-02T19:25:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 shutdown_connections 2022-02-02T19:25:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064dd0 0x7f3a14067290 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a240f55c0 0x7f3a24109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 --2- 172.21.15.96:0/2229241135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a240f6860 0x7f3a2410c1d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 >> 172.21.15.96:0/2229241135 conn(0x7f3a240f0d40 msgr2=0x7f3a240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 shutdown_connections 2022-02-02T19:25:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.810+0000 7f3a2ab93700 1 -- 172.21.15.96:0/2229241135 wait complete. 2022-02-02T19:25:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.906+0000 7fdf405b0700 1 -- 172.21.15.96:0/1146488112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f5970 msgr2=0x7fdf380f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1146488112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f5970 0x7fdf380f5df0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fdf28004660 tx=0x7fdf28009b30).stop 2022-02-02T19:25:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 -- 172.21.15.96:0/1146488112 shutdown_connections 2022-02-02T19:25:44.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1146488112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f5970 0x7fdf380f5df0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1146488112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f6c60 0x7fdf380f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:25:44.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 -- 172.21.15.96:0/1146488112 >> 172.21.15.96:0/1146488112 conn(0x7fdf380f04c0 msgr2=0x7fdf380f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 -- 172.21.15.96:0/1146488112 shutdown_connections 2022-02-02T19:25:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 -- 172.21.15.96:0/1146488112 wait complete. 2022-02-02T19:25:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 Processor -- start 2022-02-02T19:25:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.907+0000 7fdf405b0700 1 -- start start 2022-02-02T19:25:44.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf405b0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 0x7fdf3810c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf405b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf405b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380f54f0 con 0x7fdf380f6c60 2022-02-02T19:25:44.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf405b0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380f5630 con 0x7fdf380f5970 2022-02-02T19:25:44.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59698/0 (socket says 172.21.15.96:59698) 2022-02-02T19:25:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 -- 172.21.15.96:0/1561013183 learned_addr learned my addr 172.21.15.96:0/1561013183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3e34c700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 0x7fdf3810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 -- 172.21.15.96:0/1561013183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 msgr2=0x7fdf3810c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 0x7fdf3810c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 -- 172.21.15.96:0/1561013183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28005040 con 0x7fdf380f6c60 2022-02-02T19:25:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3e34c700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 0x7fdf3810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:25:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf3db4b700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fdf28009990 tx=0x7fdf28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.908+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf28018070 con 0x7fdf380f6c60 2022-02-02T19:25:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.909+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf28007ba0 con 0x7fdf380f6c60 2022-02-02T19:25:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.909+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3810eaf0 con 0x7fdf380f6c60 2022-02-02T19:25:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.909+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf2801c620 con 0x7fdf380f6c60 2022-02-02T19:25:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.909+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3810ef10 con 0x7fdf380f6c60 2022-02-02T19:25:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.910+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf38045ad0 con 0x7fdf380f6c60 2022-02-02T19:25:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.910+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf2801d420 con 0x7fdf380f6c60 2022-02-02T19:25:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.911+0000 7fdf2effd700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 0x7fdf24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.911+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdf28083a90 con 0x7fdf380f6c60 2022-02-02T19:25:44.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.911+0000 7fdf3e34c700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 0x7fdf24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:44.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.911+0000 7fdf3e34c700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 0x7fdf24067290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fdf380f5280 tx=0x7fdf34008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:44.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:44.915+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf28051bc0 con 0x7fdf380f6c60 2022-02-02T19:25:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.144+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf380f57c0 con 0x7fdf380f6c60 2022-02-02T19:25:45.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.144+0000 7fdf2effd700 1 -- 172.21.15.96:0/1561013183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdf280551e0 con 0x7fdf380f6c60 2022-02-02T19:25:45.207 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:25:45.207 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:25:45.208 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:25:45.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:45.208 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:25:45.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:25:45.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:45.209 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:25:45.210 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:25:45.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:45.211 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:25:45.211 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:25:45.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:25:45.212 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:25:45.212 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:25:45.213 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:25:45.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:25:45.213 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:25:45.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 msgr2=0x7fdf24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 0x7fdf24067290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fdf380f5280 tx=0x7fdf34008040).stop 2022-02-02T19:25:45.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 msgr2=0x7fdf3810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fdf28009990 tx=0x7fdf28009b30).stop 2022-02-02T19:25:45.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 shutdown_connections 2022-02-02T19:25:45.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf24064dd0 0x7fdf24067290 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf380f5970 0x7fdf3810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 --2- 172.21.15.96:0/1561013183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf380f6c60 0x7fdf3810e600 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 >> 172.21.15.96:0/1561013183 conn(0x7fdf380f04c0 msgr2=0x7fdf380fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:45.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 shutdown_connections 2022-02-02T19:25:45.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.146+0000 7fdf405b0700 1 -- 172.21.15.96:0/1561013183 wait complete. 2022-02-02T19:25:45.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 -- 172.21.15.96:0/2563580972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f4d60 msgr2=0x7f70e40f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 --2- 172.21.15.96:0/2563580972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f4d60 0x7f70e40f5180 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f70d8004660 tx=0x7f70d8009b30).stop 2022-02-02T19:25:45.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 -- 172.21.15.96:0/2563580972 shutdown_connections 2022-02-02T19:25:45.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 --2- 172.21.15.96:0/2563580972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f5f60 0x7f70e40f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 --2- 172.21.15.96:0/2563580972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f4d60 0x7f70e40f5180 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 -- 172.21.15.96:0/2563580972 >> 172.21.15.96:0/2563580972 conn(0x7f70e40f04c0 msgr2=0x7f70e40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:45.251 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:45 smithi096 ceph-mon[101353]: from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:45.252 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:45 smithi096 ceph-mon[101353]: from='client.36078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:45.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 -- 172.21.15.96:0/2563580972 shutdown_connections 2022-02-02T19:25:45.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.243+0000 7f70eae06700 1 -- 172.21.15.96:0/2563580972 wait complete. 2022-02-02T19:25:45.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 Processor -- start 2022-02-02T19:25:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 -- start start 2022-02-02T19:25:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f4d60 0x7f70e4109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40fc360 con 0x7f70e40f5f60 2022-02-02T19:25:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.244+0000 7f70eae06700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40fc4a0 con 0x7f70e40f4d60 2022-02-02T19:25:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59706/0 (socket says 172.21.15.96:59706) 2022-02-02T19:25:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 -- 172.21.15.96:0/2264093066 learned_addr learned my addr 172.21.15.96:0/2264093066 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:25:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e8ba2700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f4d60 0x7f70e4109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 -- 172.21.15.96:0/2264093066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f4d60 msgr2=0x7f70e4109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f4d60 0x7f70e4109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 -- 172.21.15.96:0/2264093066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8005040 con 0x7f70e40f5f60 2022-02-02T19:25:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e3fff700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f70d000c510 tx=0x7f70d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d000f650 con 0x7f70e40f5f60 2022-02-02T19:25:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70d000fc60 con 0x7f70e40f5f60 2022-02-02T19:25:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e410c750 con 0x7f70e40f5f60 2022-02-02T19:25:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d0012c50 con 0x7f70e40f5f60 2022-02-02T19:25:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.245+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e410cd10 con 0x7f70e40f5f60 2022-02-02T19:25:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.247+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e4045ad0 con 0x7f70e40f5f60 2022-02-02T19:25:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.247+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f70d0010070 con 0x7f70e40f5f60 2022-02-02T19:25:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.248+0000 7f70e17fa700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 0x7f70d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:25:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.248+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f70d00816d0 con 0x7f70e40f5f60 2022-02-02T19:25:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.248+0000 7f70e8ba2700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 0x7f70d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:25:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.248+0000 7f70e8ba2700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 0x7f70d4067290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f70d8004630 tx=0x7f70d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:25:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.252+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f70d00477d0 con 0x7f70e40f5f60 2022-02-02T19:25:45.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.454+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70e4027a00 con 0x7f70e40f5f60 2022-02-02T19:25:45.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.454+0000 7f70e17fa700 1 -- 172.21.15.96:0/2264093066 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f70d004f780 con 0x7f70e40f5f60 2022-02-02T19:25:45.460 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:25:45.460 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:25:45.461 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:25:45.461 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:25:45.461 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:45.461 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:25:45.462 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:25:45.462 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:25:45.462 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:25:45.462 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:25:45.463 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:25:45.463 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:25:45.463 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:25:45.464 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:25:45.464 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:25:45.464 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:25:45.464 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:25:45.464 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:25:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:25:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:25:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:25:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:25:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:25:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:25:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:25:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:25:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:25:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:25:45.467 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:25:45.467 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:25:45.467 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:25:45.467 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:25:45.468 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:45.468 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:45.468 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:25:45.468 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:25:45.469 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:45.469 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:45.469 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:25:45.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 msgr2=0x7f70d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 0x7f70d4067290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f70d8004630 tx=0x7f70d8009b30).stop 2022-02-02T19:25:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 msgr2=0x7f70e410c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:25:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f70d000c510 tx=0x7f70d0007e00).stop 2022-02-02T19:25:45.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 shutdown_connections 2022-02-02T19:25:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70d4064dd0 0x7f70d4067290 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e40f4d60 0x7f70e4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 --2- 172.21.15.96:0/2264093066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e40f5f60 0x7f70e410c1a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:25:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.456+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 >> 172.21.15.96:0/2264093066 conn(0x7f70e40f04c0 msgr2=0x7f70e40f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:25:45.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.457+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 shutdown_connections 2022-02-02T19:25:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:25:45.457+0000 7f70eae06700 1 -- 172.21.15.96:0/2264093066 wait complete. 2022-02-02T19:25:45.473 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:25:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:45 smithi159 ceph-mon[69013]: from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:45.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:45 smithi159 ceph-mon[69013]: from='client.36078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:25:46.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1561013183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:25:46.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2264093066' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:25:46.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:46 smithi159 ceph-mon[69013]: pgmap v1909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:46.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1561013183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:25:46.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2264093066' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:25:46.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:46 smithi096 ceph-mon[101353]: pgmap v1909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:49.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:49 smithi159 ceph-mon[69013]: pgmap v1910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:49.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:49 smithi096 ceph-mon[101353]: pgmap v1910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:50 smithi159 ceph-mon[69013]: pgmap v1911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:50 smithi096 ceph-mon[101353]: pgmap v1911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:53.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:53 smithi159 ceph-mon[69013]: pgmap v1912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:53.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:53 smithi096 ceph-mon[101353]: pgmap v1912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:54 smithi159 ceph-mon[69013]: pgmap v1913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:54 smithi096 ceph-mon[101353]: pgmap v1913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:57.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:56 smithi159 ceph-mon[69013]: pgmap v1914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:56 smithi096 ceph-mon[101353]: pgmap v1914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:59.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:25:59 smithi159 ceph-mon[69013]: pgmap v1915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:25:59.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:25:59 smithi096 ceph-mon[101353]: pgmap v1915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:00.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:00 smithi096 ceph-mon[101353]: pgmap v1916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:00 smithi159 ceph-mon[69013]: pgmap v1916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:02 smithi159 ceph-mon[69013]: pgmap v1917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:02 smithi096 ceph-mon[101353]: pgmap v1917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:04 smithi159 ceph-mon[69013]: pgmap v1918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:04 smithi096 ceph-mon[101353]: pgmap v1918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:06 smithi159 ceph-mon[69013]: pgmap v1919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:06 smithi096 ceph-mon[101353]: pgmap v1919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:08 smithi159 ceph-mon[69013]: pgmap v1920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:08.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:08 smithi096 ceph-mon[101353]: pgmap v1920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:10 smithi159 ceph-mon[69013]: pgmap v1921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:10 smithi096 ceph-mon[101353]: pgmap v1921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:12 smithi159 ceph-mon[69013]: pgmap v1922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:12 smithi096 ceph-mon[101353]: pgmap v1922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:14 smithi159 ceph-mon[69013]: pgmap v1923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:14.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:14 smithi096 ceph-mon[101353]: pgmap v1923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:15.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/2576812178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f66e0 msgr2=0x7f5c080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/2576812178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f66e0 0x7f5c080f6b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f5bf8004660 tx=0x7f5bf8009b30).stop 2022-02-02T19:26:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/2576812178 shutdown_connections 2022-02-02T19:26:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/2576812178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f7980 0x7f5c080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/2576812178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f66e0 0x7f5c080f6b00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/2576812178 >> 172.21.15.96:0/2576812178 conn(0x7f5c080f1e40 msgr2=0x7f5c080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/2576812178 shutdown_connections 2022-02-02T19:26:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.567+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/2576812178 wait complete. 2022-02-02T19:26:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 Processor -- start 2022-02-02T19:26:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 -- start start 2022-02-02T19:26:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f66e0 0x7f5c08106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081079e0 con 0x7f5c080f7980 2022-02-02T19:26:15.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0f6cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08107b20 con 0x7f5c080f66e0 2022-02-02T19:26:15.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59726/0 (socket says 172.21.15.96:59726) 2022-02-02T19:26:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 -- 172.21.15.96:0/1728280118 learned_addr learned my addr 172.21.15.96:0/1728280118 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0d469700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f66e0 0x7f5c08106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 -- 172.21.15.96:0/1728280118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f66e0 msgr2=0x7f5c08106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f66e0 0x7f5c08106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.568+0000 7f5c0cc68700 1 -- 172.21.15.96:0/1728280118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8005040 con 0x7f5c080f7980 2022-02-02T19:26:15.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5c0cc68700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f5c0400c530 tx=0x7f5c04007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:15.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0400f650 con 0x7f5c080f7980 2022-02-02T19:26:15.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c081084c0 con 0x7f5c080f7980 2022-02-02T19:26:15.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c0400fc60 con 0x7f5c080f7980 2022-02-02T19:26:15.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c04012c20 con 0x7f5c080f7980 2022-02-02T19:26:15.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.569+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c08108a80 con 0x7f5c080f7980 2022-02-02T19:26:15.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.570+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c08045ad0 con 0x7f5c080f7980 2022-02-02T19:26:15.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.571+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c04010070 con 0x7f5c080f7980 2022-02-02T19:26:15.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.571+0000 7f5bfdffb700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 0x7f5bf4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.571+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5c04081700 con 0x7f5c080f7980 2022-02-02T19:26:15.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.571+0000 7f5c0d469700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 0x7f5bf4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.571+0000 7f5c0d469700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 0x7f5bf4067290 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5bf8004630 tx=0x7f5bf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:15.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.575+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c040531e0 con 0x7f5c080f7980 2022-02-02T19:26:15.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.753+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c08108ca0 con 0x7f5bf4064dd0 2022-02-02T19:26:15.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.754+0000 7f5bfdffb700 1 -- 172.21.15.96:0/1728280118 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5c08108ca0 con 0x7f5bf4064dd0 2022-02-02T19:26:15.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 msgr2=0x7f5bf4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 0x7f5bf4067290 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f5bf8004630 tx=0x7f5bf8009b30).stop 2022-02-02T19:26:15.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 msgr2=0x7f5c08107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f5c0400c530 tx=0x7f5c04007e20).stop 2022-02-02T19:26:15.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 shutdown_connections 2022-02-02T19:26:15.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf4064dd0 0x7f5bf4067290 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c080f66e0 0x7f5c08106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 --2- 172.21.15.96:0/1728280118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c080f7980 0x7f5c08107430 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.756+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 >> 172.21.15.96:0/1728280118 conn(0x7f5c080f1e40 msgr2=0x7f5c080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:15.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.757+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 shutdown_connections 2022-02-02T19:26:15.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.757+0000 7f5c0f6cd700 1 -- 172.21.15.96:0/1728280118 wait complete. 2022-02-02T19:26:15.835 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:26:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 -- 172.21.15.96:0/1044313830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 msgr2=0x7f4a0c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 --2- 172.21.15.96:0/1044313830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c0f6b00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f4a00004660 tx=0x7f4a00009b30).stop 2022-02-02T19:26:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 -- 172.21.15.96:0/1044313830 shutdown_connections 2022-02-02T19:26:15.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 --2- 172.21.15.96:0/1044313830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 0x7f4a0c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 --2- 172.21.15.96:0/1044313830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c0f6b00 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 -- 172.21.15.96:0/1044313830 >> 172.21.15.96:0/1044313830 conn(0x7f4a0c0f1f00 msgr2=0x7f4a0c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:15.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 -- 172.21.15.96:0/1044313830 shutdown_connections 2022-02-02T19:26:15.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.854+0000 7f4a13a66700 1 -- 172.21.15.96:0/1044313830 wait complete. 2022-02-02T19:26:15.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 Processor -- start 2022-02-02T19:26:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 -- start start 2022-02-02T19:26:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 0x7f4a0c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c06a380 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a13a66700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c06a4c0 con 0x7f4a0c0f6ff0 2022-02-02T19:26:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59732/0 (socket says 172.21.15.96:59732) 2022-02-02T19:26:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 -- 172.21.15.96:0/3079117749 learned_addr learned my addr 172.21.15.96:0/3079117749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11001700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 0x7f4a0c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 -- 172.21.15.96:0/3079117749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 msgr2=0x7f4a0c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:15.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 0x7f4a0c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:15.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.855+0000 7f4a11802700 1 -- 172.21.15.96:0/3079117749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00005040 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f4a11802700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f4a00009990 tx=0x7f4a00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:15.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a00018070 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a00007ba0 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0001c3c0 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c06a740 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.856+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c06aca0 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.857+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c045ad0 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.857+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a0001d420 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.857+0000 7f49fe7fc700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 0x7f49f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.858+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4a00083710 con 0x7f4a0c0f66e0 2022-02-02T19:26:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.858+0000 7f4a11001700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 0x7f49f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.858+0000 7f4a11001700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 0x7f49f8067290 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f4a080077b0 tx=0x7f4a08009ce0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:15.862+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a000517c0 con 0x7f4a0c0f66e0 2022-02-02T19:26:16.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.035+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0c057f10 con 0x7f49f8064dd0 2022-02-02T19:26:16.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.044+0000 7f49fe7fc700 1 -- 172.21.15.96:0/3079117749 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4a0c057f10 con 0x7f49f8064dd0 2022-02-02T19:26:16.049 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:26:16.049 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (69m) 40m ago 70m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:26:16.049 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (62m) 40m ago 70m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:26:16.050 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (61m) 38m ago 70m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:26:16.050 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (69m) 40m ago 70m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:26:16.050 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (66m) 40m ago 66m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:26:16.050 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (62m) 40m ago 66m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:26:16.051 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (66m) 38m ago 66m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:26:16.051 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (62m) 38m ago 66m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:26:16.051 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (63m) 40m ago 71m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:26:16.051 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (63m) 38m ago 70m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:26:16.051 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (62m) 40m ago 71m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:26:16.052 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (62m) 38m ago 70m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:26:16.052 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (70m) 40m ago 70m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:26:16.052 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (69m) 38m ago 69m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:26:16.052 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (61m) 40m ago 69m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:26:16.052 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (61m) 40m ago 69m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:26:16.053 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (60m) 40m ago 68m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:26:16.053 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (60m) 38m ago 68m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:26:16.053 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (59m) 38m ago 68m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:26:16.053 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (59m) 38m ago 68m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:26:16.054 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (69m) 40m ago 70m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:26:16.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 msgr2=0x7f49f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 0x7f49f8067290 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f4a080077b0 tx=0x7f4a08009ce0).stop 2022-02-02T19:26:16.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 msgr2=0x7f4a0c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f4a00009990 tx=0x7f4a00009b30).stop 2022-02-02T19:26:16.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 shutdown_connections 2022-02-02T19:26:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f8064dd0 0x7f49f8067290 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f66e0 0x7f4a0c06b9a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 --2- 172.21.15.96:0/3079117749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6ff0 0x7f4a0c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 >> 172.21.15.96:0/3079117749 conn(0x7f4a0c0f1f00 msgr2=0x7f4a0c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:16.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 shutdown_connections 2022-02-02T19:26:16.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.046+0000 7f4a13a66700 1 -- 172.21.15.96:0/3079117749 wait complete. 2022-02-02T19:26:16.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 -- 172.21.15.96:0/2881682417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f55c0 msgr2=0x7fc2600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2881682417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f55c0 0x7fc2600f59e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fc248004660 tx=0x7fc248009b30).stop 2022-02-02T19:26:16.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 -- 172.21.15.96:0/2881682417 shutdown_connections 2022-02-02T19:26:16.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2881682417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f6860 0x7fc2600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2881682417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f55c0 0x7fc2600f59e0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 -- 172.21.15.96:0/2881682417 >> 172.21.15.96:0/2881682417 conn(0x7fc2600f0d40 msgr2=0x7fc2600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:16.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 -- 172.21.15.96:0/2881682417 shutdown_connections 2022-02-02T19:26:16.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.143+0000 7fc264c0d700 1 -- 172.21.15.96:0/2881682417 wait complete. 2022-02-02T19:26:16.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 Processor -- start 2022-02-02T19:26:16.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 -- start start 2022-02-02T19:26:16.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 0x7fc260105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc260106910 con 0x7fc2600f6860 2022-02-02T19:26:16.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc264c0d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc260106a50 con 0x7fc2600f55c0 2022-02-02T19:26:16.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59750/0 (socket says 172.21.15.96:59750) 2022-02-02T19:26:16.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 -- 172.21.15.96:0/2300732262 learned_addr learned my addr 172.21.15.96:0/2300732262 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25e59c700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 0x7fc260105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 -- 172.21.15.96:0/2300732262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 msgr2=0x7fc260105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 0x7fc260105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25dd9b700 1 -- 172.21.15.96:0/2300732262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248005040 con 0x7fc2600f6860 2022-02-02T19:26:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.144+0000 7fc25e59c700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 0x7fc260105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:26:16.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc25dd9b700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fc25000c530 tx=0x7fc250007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:16.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25000f650 con 0x7fc2600f6860 2022-02-02T19:26:16.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc25000fc60 con 0x7fc2600f6860 2022-02-02T19:26:16.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2601073f0 con 0x7fc2600f6860 2022-02-02T19:26:16.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc250012cd0 con 0x7fc2600f6860 2022-02-02T19:26:16.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.145+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2601079b0 con 0x7fc2600f6860 2022-02-02T19:26:16.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.146+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc260045ad0 con 0x7fc2600f6860 2022-02-02T19:26:16.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.146+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc250010070 con 0x7fc2600f6860 2022-02-02T19:26:16.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.146+0000 7fc256ffd700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 0x7fc24c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.147+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc250081800 con 0x7fc2600f6860 2022-02-02T19:26:16.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.147+0000 7fc25e59c700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 0x7fc24c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.147+0000 7fc25e59c700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 0x7fc24c067290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fc248004e30 tx=0x7fc248009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:16.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.151+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2500532e0 con 0x7fc2600f6860 2022-02-02T19:26:16.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.380+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc260027a00 con 0x7fc2600f6860 2022-02-02T19:26:16.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.380+0000 7fc256ffd700 1 -- 172.21.15.96:0/2300732262 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc250052ed0 con 0x7fc2600f6860 2022-02-02T19:26:16.386 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:26:16.386 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:26:16.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:26:16.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:16.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:26:16.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:26:16.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:16.388 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:26:16.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:26:16.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:16.388 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:26:16.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:26:16.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:16.389 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:26:16.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:26:16.390 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:26:16.390 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:26:16.390 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:26:16.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.382+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 msgr2=0x7fc24c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.382+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 0x7fc24c067290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fc248004e30 tx=0x7fc248009b30).stop 2022-02-02T19:26:16.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.382+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 msgr2=0x7fc260106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.382+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fc25000c530 tx=0x7fc250007e20).stop 2022-02-02T19:26:16.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 shutdown_connections 2022-02-02T19:26:16.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc24c064dd0 0x7fc24c067290 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600f55c0 0x7fc260105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 --2- 172.21.15.96:0/2300732262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2600f6860 0x7fc260106360 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 >> 172.21.15.96:0/2300732262 conn(0x7fc2600f0d40 msgr2=0x7fc2600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 shutdown_connections 2022-02-02T19:26:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.383+0000 7fc264c0d700 1 -- 172.21.15.96:0/2300732262 wait complete. 2022-02-02T19:26:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 -- 172.21.15.96:0/2196063160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f7980 msgr2=0x7f130c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 --2- 172.21.15.96:0/2196063160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f7980 0x7f130c0f7de0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f12f4004660 tx=0x7f12f4009b30).stop 2022-02-02T19:26:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 -- 172.21.15.96:0/2196063160 shutdown_connections 2022-02-02T19:26:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 --2- 172.21.15.96:0/2196063160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f7980 0x7f130c0f7de0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 --2- 172.21.15.96:0/2196063160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f66e0 0x7f130c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 -- 172.21.15.96:0/2196063160 >> 172.21.15.96:0/2196063160 conn(0x7f130c0f1e40 msgr2=0x7f130c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.481+0000 7f13127cb700 1 -- 172.21.15.96:0/2196063160 shutdown_connections 2022-02-02T19:26:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.482+0000 7f13127cb700 1 -- 172.21.15.96:0/2196063160 wait complete. 2022-02-02T19:26:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.482+0000 7f13127cb700 1 Processor -- start 2022-02-02T19:26:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.482+0000 7f13127cb700 1 -- start start 2022-02-02T19:26:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f7980 0x7f130c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c107a00 con 0x7f130c0f66e0 2022-02-02T19:26:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c107b40 con 0x7f130c0f7980 2022-02-02T19:26:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59758/0 (socket says 172.21.15.96:59758) 2022-02-02T19:26:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 -- 172.21.15.96:0/2707513585 learned_addr learned my addr 172.21.15.96:0/2707513585 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f1303fff700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f7980 0x7f130c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 -- 172.21.15.96:0/2707513585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f7980 msgr2=0x7f130c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f7980 0x7f130c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 -- 172.21.15.96:0/2707513585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4005040 con 0x7f130c0f66e0 2022-02-02T19:26:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f130bfff700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f12fc00c530 tx=0x7f12fc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12fc00f650 con 0x7f130c0f66e0 2022-02-02T19:26:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12fc00fc60 con 0x7f130c0f66e0 2022-02-02T19:26:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c1084e0 con 0x7f130c0f66e0 2022-02-02T19:26:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12fc012cb0 con 0x7f130c0f66e0 2022-02-02T19:26:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.483+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c108aa0 con 0x7f130c0f66e0 2022-02-02T19:26:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.485+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c045ad0 con 0x7f130c0f66e0 2022-02-02T19:26:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.485+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f12fc019030 con 0x7f130c0f66e0 2022-02-02T19:26:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.485+0000 7f13097fa700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 0x7f12f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.485+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f12fc0816b0 con 0x7f130c0f66e0 2022-02-02T19:26:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.485+0000 7f1303fff700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 0x7f12f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.486+0000 7f1303fff700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 0x7f12f8067290 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f12f4004630 tx=0x7f12f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:16.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.490+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f12fc0531c0 con 0x7f130c0f66e0 2022-02-02T19:26:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.695+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f130c0fefa0 con 0x7f130c0f66e0 2022-02-02T19:26:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.696+0000 7f13097fa700 1 -- 172.21.15.96:0/2707513585 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f12fc052db0 con 0x7f130c0f66e0 2022-02-02T19:26:16.702 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:26:16.702 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:26:16.702 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:26:16.703 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:26:16.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:16.703 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:26:16.703 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:26:16.704 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:26:16.704 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:26:16.704 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:26:16.704 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:26:16.705 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:26:16.705 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:26:16.705 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:26:16.705 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:26:16.706 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:26:16.706 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:26:16.706 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:26:16.706 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:26:16.706 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:26:16.707 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:26:16.707 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:26:16.707 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:26:16.707 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:26:16.708 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:26:16.708 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:26:16.708 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:26:16.708 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:26:16.709 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:26:16.709 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:26:16.709 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:26:16.709 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:26:16.709 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:16.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:16.710 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:26:16.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:16.710 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:16.711 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:16.711 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 msgr2=0x7f12f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 0x7f12f8067290 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f12f4004630 tx=0x7f12f4009b30).stop 2022-02-02T19:26:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 msgr2=0x7f130c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f12fc00c530 tx=0x7f12fc007e10).stop 2022-02-02T19:26:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 shutdown_connections 2022-02-02T19:26:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12f8064dd0 0x7f12f8067290 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f130c0f66e0 0x7f130c106f60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 --2- 172.21.15.96:0/2707513585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f130c0f7980 0x7f130c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 >> 172.21.15.96:0/2707513585 conn(0x7f130c0f1e40 msgr2=0x7f130c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 shutdown_connections 2022-02-02T19:26:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:16.698+0000 7f13127cb700 1 -- 172.21.15.96:0/2707513585 wait complete. 2022-02-02T19:26:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:26:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:16 smithi159 ceph-mon[69013]: from='client.36090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:16 smithi159 ceph-mon[69013]: pgmap v1924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2300732262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:26:17.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2707513585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:26:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:16 smithi096 ceph-mon[101353]: from='client.36090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:16 smithi096 ceph-mon[101353]: pgmap v1924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2300732262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:26:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2707513585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:26:18.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:17 smithi159 ceph-mon[69013]: from='client.36094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:18.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:17 smithi096 ceph-mon[101353]: from='client.36094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:19.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:18 smithi159 ceph-mon[69013]: pgmap v1925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:19.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:18 smithi096 ceph-mon[101353]: pgmap v1925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:20 smithi159 ceph-mon[69013]: pgmap v1926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:20.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:20 smithi096 ceph-mon[101353]: pgmap v1926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:22 smithi159 ceph-mon[69013]: pgmap v1927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:22 smithi096 ceph-mon[101353]: pgmap v1927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:24 smithi159 ceph-mon[69013]: pgmap v1928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:24 smithi096 ceph-mon[101353]: pgmap v1928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:26 smithi159 ceph-mon[69013]: pgmap v1929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:26 smithi096 ceph-mon[101353]: pgmap v1929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:26:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:26:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:26:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:26:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:28 smithi159 ceph-mon[69013]: pgmap v1930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:28 smithi096 ceph-mon[101353]: pgmap v1930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:30 smithi159 ceph-mon[69013]: pgmap v1931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:30 smithi096 ceph-mon[101353]: pgmap v1931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:32 smithi159 ceph-mon[69013]: pgmap v1932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:32 smithi096 ceph-mon[101353]: pgmap v1932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:34 smithi159 ceph-mon[69013]: pgmap v1933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:34.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:34 smithi096 ceph-mon[101353]: pgmap v1933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:36 smithi159 ceph-mon[69013]: pgmap v1934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:37.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:36 smithi096 ceph-mon[101353]: pgmap v1934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:38 smithi159 ceph-mon[69013]: pgmap v1935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:38 smithi096 ceph-mon[101353]: pgmap v1935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:40 smithi159 ceph-mon[69013]: pgmap v1936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:40 smithi096 ceph-mon[101353]: pgmap v1936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:42 smithi159 ceph-mon[69013]: pgmap v1937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:42 smithi096 ceph-mon[101353]: pgmap v1937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:44 smithi159 ceph-mon[69013]: pgmap v1938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:44 smithi096 ceph-mon[101353]: pgmap v1938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:46.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 -- 172.21.15.96:0/3518971716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f7980 msgr2=0x7f5ea80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:46.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/3518971716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f7980 0x7f5ea80f7de0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f5e98004660 tx=0x7f5e98009b30).stop 2022-02-02T19:26:46.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 -- 172.21.15.96:0/3518971716 shutdown_connections 2022-02-02T19:26:46.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/3518971716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f7980 0x7f5ea80f7de0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:46.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/3518971716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f66e0 0x7f5ea80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:46.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 -- 172.21.15.96:0/3518971716 >> 172.21.15.96:0/3518971716 conn(0x7f5ea80f1e40 msgr2=0x7f5ea80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:46.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 -- 172.21.15.96:0/3518971716 shutdown_connections 2022-02-02T19:26:46.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.808+0000 7f5eadaf3700 1 -- 172.21.15.96:0/3518971716 wait complete. 2022-02-02T19:26:46.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.809+0000 7f5eadaf3700 1 Processor -- start 2022-02-02T19:26:46.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.809+0000 7f5eadaf3700 1 -- start start 2022-02-02T19:26:46.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.809+0000 7f5eadaf3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:46.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.809+0000 7f5eadaf3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f7980 0x7f5ea8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:46.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5eadaf3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8107a00 con 0x7f5ea80f66e0 2022-02-02T19:26:46.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5eadaf3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8107b40 con 0x7f5ea80f7980 2022-02-02T19:26:46.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:46.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59776/0 (socket says 172.21.15.96:59776) 2022-02-02T19:26:46.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 -- 172.21.15.96:0/1567141300 learned_addr learned my addr 172.21.15.96:0/1567141300 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:46.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea6ffd700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f7980 0x7f5ea8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:46.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 -- 172.21.15.96:0/1567141300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f7980 msgr2=0x7f5ea8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:46.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f7980 0x7f5ea8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:46.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 -- 172.21.15.96:0/1567141300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98005040 con 0x7f5ea80f66e0 2022-02-02T19:26:46.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5ea77fe700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f5e9c00c530 tx=0x7f5e9c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:46.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9c00f650 con 0x7f5ea80f66e0 2022-02-02T19:26:46.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea81084e0 con 0x7f5ea80f66e0 2022-02-02T19:26:46.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e9c00fc60 con 0x7f5ea80f66e0 2022-02-02T19:26:46.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9c012d20 con 0x7f5ea80f66e0 2022-02-02T19:26:46.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.810+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea8108aa0 con 0x7f5ea80f66e0 2022-02-02T19:26:46.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.811+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8045ad0 con 0x7f5ea80f66e0 2022-02-02T19:26:46.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.812+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e9c019030 con 0x7f5ea80f66e0 2022-02-02T19:26:46.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.813+0000 7f5e8ffff700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:46.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.813+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5e9c081cd0 con 0x7f5ea80f66e0 2022-02-02T19:26:46.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.813+0000 7f5ea6ffd700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:46.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.813+0000 7f5ea6ffd700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f5e98004e30 tx=0x7f5e98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:46.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.816+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e9c053800 con 0x7f5ea80f66e0 2022-02-02T19:26:47.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.998+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea8108d20 con 0x7f5e90064dd0 2022-02-02T19:26:47.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:46.999+0000 7f5e8ffff700 1 -- 172.21.15.96:0/1567141300 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5ea8108d20 con 0x7f5e90064dd0 2022-02-02T19:26:47.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 msgr2=0x7f5e90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f5e98004e30 tx=0x7f5e98009b30).stop 2022-02-02T19:26:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 msgr2=0x7f5ea8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f5e9c00c530 tx=0x7f5e9c007e10).stop 2022-02-02T19:26:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 shutdown_connections 2022-02-02T19:26:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea80f66e0 0x7f5ea8106f60 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 --2- 172.21.15.96:0/1567141300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea80f7980 0x7f5ea8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.001+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 >> 172.21.15.96:0/1567141300 conn(0x7f5ea80f1e40 msgr2=0x7f5ea80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.002+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 shutdown_connections 2022-02-02T19:26:47.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.002+0000 7f5eadaf3700 1 -- 172.21.15.96:0/1567141300 wait complete. 2022-02-02T19:26:47.018 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:26:47.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.098+0000 7efe4390d700 1 -- 172.21.15.96:0/1986560867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f55c0 msgr2=0x7efe3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.098+0000 7efe4390d700 1 --2- 172.21.15.96:0/1986560867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f55c0 0x7efe3c0f59e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7efe38004660 tx=0x7efe38009b30).stop 2022-02-02T19:26:47.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 -- 172.21.15.96:0/1986560867 shutdown_connections 2022-02-02T19:26:47.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 --2- 172.21.15.96:0/1986560867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f6860 0x7efe3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 --2- 172.21.15.96:0/1986560867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f55c0 0x7efe3c0f59e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 -- 172.21.15.96:0/1986560867 >> 172.21.15.96:0/1986560867 conn(0x7efe3c0f0d40 msgr2=0x7efe3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:46 smithi096 ceph-mon[101353]: pgmap v1939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:47.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 -- 172.21.15.96:0/1986560867 shutdown_connections 2022-02-02T19:26:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 -- 172.21.15.96:0/1986560867 wait complete. 2022-02-02T19:26:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 Processor -- start 2022-02-02T19:26:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.099+0000 7efe4390d700 1 -- start start 2022-02-02T19:26:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe4390d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f55c0 0x7efe3c10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe4390d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe4390d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0602b0 con 0x7efe3c0f6860 2022-02-02T19:26:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe4390d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0603f0 con 0x7efe3c0f55c0 2022-02-02T19:26:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59788/0 (socket says 172.21.15.96:59788) 2022-02-02T19:26:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 -- 172.21.15.96:0/936190385 learned_addr learned my addr 172.21.15.96:0/936190385 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe416a9700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f55c0 0x7efe3c10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 -- 172.21.15.96:0/936190385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f55c0 msgr2=0x7efe3c10c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f55c0 0x7efe3c10c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 -- 172.21.15.96:0/936190385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38005040 con 0x7efe3c0f6860 2022-02-02T19:26:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe40ea8700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7efe2c0026d0 tx=0x7efe2c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.100+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c0079c0 con 0x7efe3c0f6860 2022-02-02T19:26:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.101+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c10ea80 con 0x7efe3c0f6860 2022-02-02T19:26:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.101+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe2c00f040 con 0x7efe3c0f6860 2022-02-02T19:26:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.101+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c0148b0 con 0x7efe3c0f6860 2022-02-02T19:26:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.101+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c10ef00 con 0x7efe3c0f6860 2022-02-02T19:26:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.102+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c045ad0 con 0x7efe3c0f6860 2022-02-02T19:26:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.102+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe2c007b20 con 0x7efe3c0f6860 2022-02-02T19:26:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.102+0000 7efe31ffb700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 0x7efe28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.102+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efe2c0819e0 con 0x7efe3c0f6860 2022-02-02T19:26:47.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.103+0000 7efe416a9700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 0x7efe28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.103+0000 7efe416a9700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 0x7efe28067290 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7efe38013690 tx=0x7efe38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.107+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe2c04fa90 con 0x7efe3c0f6860 2022-02-02T19:26:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:46 smithi159 ceph-mon[69013]: pgmap v1939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:47.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.279+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3c057f10 con 0x7efe28064dd0 2022-02-02T19:26:47.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.288+0000 7efe31ffb700 1 -- 172.21.15.96:0/936190385 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efe3c057f10 con 0x7efe28064dd0 2022-02-02T19:26:47.295 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:26:47.295 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (70m) 40m ago 71m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:26:47.295 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (62m) 40m ago 71m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:26:47.296 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (62m) 39m ago 70m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:26:47.296 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (70m) 40m ago 71m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:26:47.296 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (67m) 40m ago 67m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:26:47.296 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (62m) 40m ago 67m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:26:47.297 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (67m) 39m ago 67m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:26:47.297 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (63m) 39m ago 67m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:26:47.297 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (64m) 40m ago 72m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:26:47.298 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (63m) 39m ago 70m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:26:47.298 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (63m) 40m ago 72m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:26:47.298 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (63m) 39m ago 70m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:26:47.299 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (70m) 40m ago 70m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:26:47.299 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (70m) 39m ago 70m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:26:47.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (62m) 40m ago 70m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:26:47.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (61m) 40m ago 69m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:26:47.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (61m) 40m ago 69m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:26:47.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (60m) 39m ago 69m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:26:47.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (60m) 39m ago 68m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:26:47.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (59m) 39m ago 68m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:26:47.301 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (69m) 40m ago 70m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:26:47.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 msgr2=0x7efe28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 0x7efe28067290 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7efe38013690 tx=0x7efe38009b30).stop 2022-02-02T19:26:47.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 msgr2=0x7efe3c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7efe2c0026d0 tx=0x7efe2c009de0).stop 2022-02-02T19:26:47.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 shutdown_connections 2022-02-02T19:26:47.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe28064dd0 0x7efe28067290 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c0f55c0 0x7efe3c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 --2- 172.21.15.96:0/936190385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe3c0f6860 0x7efe3c10e590 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.290+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 >> 172.21.15.96:0/936190385 conn(0x7efe3c0f0d40 msgr2=0x7efe3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.291+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 shutdown_connections 2022-02-02T19:26:47.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.291+0000 7efe4390d700 1 -- 172.21.15.96:0/936190385 wait complete. 2022-02-02T19:26:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 -- 172.21.15.96:0/1226507080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 msgr2=0x7f3fd40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 --2- 172.21.15.96:0/1226507080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd40f6b00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f3fc8004660 tx=0x7f3fc8009b30).stop 2022-02-02T19:26:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 -- 172.21.15.96:0/1226507080 shutdown_connections 2022-02-02T19:26:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 --2- 172.21.15.96:0/1226507080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd40f7980 0x7f3fd40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:26:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 --2- 172.21.15.96:0/1226507080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd40f6b00 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 -- 172.21.15.96:0/1226507080 >> 172.21.15.96:0/1226507080 conn(0x7f3fd40f1e40 msgr2=0x7f3fd40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 -- 172.21.15.96:0/1226507080 shutdown_connections 2022-02-02T19:26:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.388+0000 7f3fdb184700 1 -- 172.21.15.96:0/1226507080 wait complete. 2022-02-02T19:26:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 Processor -- start 2022-02-02T19:26:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 -- start start 2022-02-02T19:26:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd40f7980 0x7f3fd41074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4107b00 con 0x7f3fd40f66e0 2022-02-02T19:26:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.389+0000 7f3fdb184700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41083b0 con 0x7f3fd40f7980 2022-02-02T19:26:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59796/0 (socket says 172.21.15.96:59796) 2022-02-02T19:26:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 -- 172.21.15.96:0/2198614297 learned_addr learned my addr 172.21.15.96:0/2198614297 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 -- 172.21.15.96:0/2198614297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd40f7980 msgr2=0x7f3fd41074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd40f7980 0x7f3fd41074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:26:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 -- 172.21.15.96:0/2198614297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8005040 con 0x7f3fd40f66e0 2022-02-02T19:26:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd8f20700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3fc8004f60 tx=0x7f3fc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc8018070 con 0x7f3fd40f66e0 2022-02-02T19:26:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd4108630 con 0x7f3fd40f66e0 2022-02-02T19:26:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fc8007ba0 con 0x7f3fd40f66e0 2022-02-02T19:26:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc801c620 con 0x7f3fd40f66e0 2022-02-02T19:26:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.390+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4108b90 con 0x7f3fd40f66e0 2022-02-02T19:26:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.391+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd40f5ad0 con 0x7f3fd40f66e0 2022-02-02T19:26:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.392+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fc801c8e0 con 0x7f3fd40f66e0 2022-02-02T19:26:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.392+0000 7f3fd17fa700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 0x7f3fc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.392+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3fc8083990 con 0x7f3fd40f66e0 2022-02-02T19:26:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.392+0000 7f3fd3fff700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 0x7f3fc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.393+0000 7f3fd3fff700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 0x7f3fc4067290 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3fc0009610 tx=0x7f3fc0006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.396+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fc8055470 con 0x7f3fd40f66e0 2022-02-02T19:26:47.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.628+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3fd40ff010 con 0x7f3fd40f66e0 2022-02-02T19:26:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.628+0000 7f3fd17fa700 1 -- 172.21.15.96:0/2198614297 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3fc8055060 con 0x7f3fd40f66e0 2022-02-02T19:26:47.635 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:26:47.636 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:26:47.636 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:26:47.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:47.637 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:26:47.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:26:47.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:47.638 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:26:47.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:26:47.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:47.639 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:26:47.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:26:47.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:26:47.639 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:26:47.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:26:47.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:26:47.640 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:26:47.640 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:26:47.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 msgr2=0x7f3fc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 0x7f3fc4067290 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3fc0009610 tx=0x7f3fc0006ab0).stop 2022-02-02T19:26:47.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 msgr2=0x7f3fd4106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3fc8004f60 tx=0x7f3fc8009b30).stop 2022-02-02T19:26:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 shutdown_connections 2022-02-02T19:26:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fc4064dd0 0x7f3fc4067290 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fd40f66e0 0x7f3fd4106fd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 --2- 172.21.15.96:0/2198614297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd40f7980 0x7f3fd41074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:26:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 >> 172.21.15.96:0/2198614297 conn(0x7f3fd40f1e40 msgr2=0x7f3fd40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 shutdown_connections 2022-02-02T19:26:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.630+0000 7f3fdb184700 1 -- 172.21.15.96:0/2198614297 wait complete. 2022-02-02T19:26:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 -- 172.21.15.96:0/3932353948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f5430 msgr2=0x7f73640f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 --2- 172.21.15.96:0/3932353948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f5430 0x7f73640f5850 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f7360004660 tx=0x7f7360009b30).stop 2022-02-02T19:26:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 -- 172.21.15.96:0/3932353948 shutdown_connections 2022-02-02T19:26:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 --2- 172.21.15.96:0/3932353948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f66d0 0x7f73640f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:26:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 --2- 172.21.15.96:0/3932353948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f5430 0x7f73640f5850 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.728+0000 7f736a650700 1 -- 172.21.15.96:0/3932353948 >> 172.21.15.96:0/3932353948 conn(0x7f73640f0b90 msgr2=0x7f73640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 -- 172.21.15.96:0/3932353948 shutdown_connections 2022-02-02T19:26:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 -- 172.21.15.96:0/3932353948 wait complete. 2022-02-02T19:26:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 Processor -- start 2022-02-02T19:26:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 -- start start 2022-02-02T19:26:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f5430 0x7f7364105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364106880 con 0x7f73640f66d0 2022-02-02T19:26:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.729+0000 7f736a650700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364106ff0 con 0x7f73640f5430 2022-02-02T19:26:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59810/0 (socket says 172.21.15.96:59810) 2022-02-02T19:26:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 -- 172.21.15.96:0/1709798725 learned_addr learned my addr 172.21.15.96:0/1709798725 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:26:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f736964e700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f5430 0x7f7364105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 -- 172.21.15.96:0/1709798725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f5430 msgr2=0x7f7364105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f5430 0x7f7364105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 -- 172.21.15.96:0/1709798725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360005040 con 0x7f73640f66d0 2022-02-02T19:26:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7368e4d700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f735400b410 tx=0x7f7354006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73540125f0 con 0x7f73640f66d0 2022-02-02T19:26:47.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f735400be30 con 0x7f73640f66d0 2022-02-02T19:26:47.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73641072d0 con 0x7f73640f66d0 2022-02-02T19:26:47.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.730+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7354002a70 con 0x7f73640f66d0 2022-02-02T19:26:47.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.731+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364107890 con 0x7f73640f66d0 2022-02-02T19:26:47.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.732+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f735400f030 con 0x7f73640f66d0 2022-02-02T19:26:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.732+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7364045ad0 con 0x7f73640f66d0 2022-02-02T19:26:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.732+0000 7f7359ffb700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 0x7f73500694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:26:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.733+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7354081df0 con 0x7f73640f66d0 2022-02-02T19:26:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.733+0000 7f736964e700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 0x7f73500694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:26:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.733+0000 7f736964e700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 0x7f73500694f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7360004630 tx=0x7f7360009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:26:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.737+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f73540538d0 con 0x7f73640f66d0 2022-02-02T19:26:47.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.939+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f73640ff680 con 0x7f73640f66d0 2022-02-02T19:26:47.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.940+0000 7f7359ffb700 1 -- 172.21.15.96:0/1709798725 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f73540534c0 con 0x7f73640f66d0 2022-02-02T19:26:47.946 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:26:47.947 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:26:47.947 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:26:47.947 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:26:47.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:47.948 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:26:47.948 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:26:47.948 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:26:47.948 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:26:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:26:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:26:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:26:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:26:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:26:47.950 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:26:47.950 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:26:47.950 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:26:47.950 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:26:47.951 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:26:47.951 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:26:47.951 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:26:47.951 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:26:47.952 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:26:47.952 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:26:47.952 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:26:47.952 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:26:47.952 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:26:47.953 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:26:47.953 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:26:47.953 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:26:47.953 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:26:47.954 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:26:47.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:47.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:47.955 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:26:47.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:26:47.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:47.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:47.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:26:47.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 msgr2=0x7f73500694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 0x7f73500694f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7360004630 tx=0x7f7360009b30).stop 2022-02-02T19:26:47.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 msgr2=0x7f7364106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:26:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f735400b410 tx=0x7f7354006ef0).stop 2022-02-02T19:26:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 shutdown_connections 2022-02-02T19:26:47.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7350067030 0x7f73500694f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73640f5430 0x7f7364105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 --2- 172.21.15.96:0/1709798725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73640f66d0 0x7f7364106240 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:26:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 >> 172.21.15.96:0/1709798725 conn(0x7f73640f0b90 msgr2=0x7f73640fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:26:47.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 shutdown_connections 2022-02-02T19:26:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:26:47.942+0000 7f736a650700 1 -- 172.21.15.96:0/1709798725 wait complete. 2022-02-02T19:26:47.960 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:26:48.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:47 smithi096 ceph-mon[101353]: from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:48.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2198614297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:26:48.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:47 smithi159 ceph-mon[69013]: from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:48.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2198614297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:26:49.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:48 smithi159 ceph-mon[69013]: from='client.36110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:49.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1709798725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:26:49.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:48 smithi159 ceph-mon[69013]: pgmap v1940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:49.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:48 smithi096 ceph-mon[101353]: from='client.36110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:26:49.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1709798725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:26:49.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:48 smithi096 ceph-mon[101353]: pgmap v1940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:50 smithi159 ceph-mon[69013]: pgmap v1941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:50 smithi096 ceph-mon[101353]: pgmap v1941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:52 smithi159 ceph-mon[69013]: pgmap v1942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:52.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:52 smithi096 ceph-mon[101353]: pgmap v1942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:54 smithi159 ceph-mon[69013]: pgmap v1943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:54 smithi096 ceph-mon[101353]: pgmap v1943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:56 smithi159 ceph-mon[69013]: pgmap v1944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:56 smithi096 ceph-mon[101353]: pgmap v1944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:26:58 smithi159 ceph-mon[69013]: pgmap v1945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:26:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:26:58 smithi096 ceph-mon[101353]: pgmap v1945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:00 smithi159 ceph-mon[69013]: pgmap v1946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:00 smithi096 ceph-mon[101353]: pgmap v1946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:02 smithi159 ceph-mon[69013]: pgmap v1947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:02 smithi096 ceph-mon[101353]: pgmap v1947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:04 smithi159 ceph-mon[69013]: pgmap v1948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:04 smithi096 ceph-mon[101353]: pgmap v1948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:06 smithi159 ceph-mon[69013]: pgmap v1949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:07.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:06 smithi096 ceph-mon[101353]: pgmap v1949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:08 smithi159 ceph-mon[69013]: pgmap v1950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:08 smithi096 ceph-mon[101353]: pgmap v1950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:10 smithi159 ceph-mon[69013]: pgmap v1951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:10 smithi096 ceph-mon[101353]: pgmap v1951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:12 smithi159 ceph-mon[69013]: pgmap v1952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:12 smithi096 ceph-mon[101353]: pgmap v1952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:14 smithi159 ceph-mon[69013]: pgmap v1953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:14 smithi096 ceph-mon[101353]: pgmap v1953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:16 smithi159 ceph-mon[69013]: pgmap v1954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:16 smithi096 ceph-mon[101353]: pgmap v1954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 -- 172.21.15.96:0/3106181593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f7980 msgr2=0x7f3da80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3106181593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f7980 0x7f3da80f7de0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f3da4004660 tx=0x7f3da4009b30).stop 2022-02-02T19:27:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 -- 172.21.15.96:0/3106181593 shutdown_connections 2022-02-02T19:27:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3106181593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f7980 0x7f3da80f7de0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3106181593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f66e0 0x7f3da80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.053+0000 7f3db04bf700 1 -- 172.21.15.96:0/3106181593 >> 172.21.15.96:0/3106181593 conn(0x7f3da80f1e40 msgr2=0x7f3da80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 -- 172.21.15.96:0/3106181593 shutdown_connections 2022-02-02T19:27:18.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 -- 172.21.15.96:0/3106181593 wait complete. 2022-02-02T19:27:18.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 Processor -- start 2022-02-02T19:27:18.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 -- start start 2022-02-02T19:27:18.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f7980 0x7f3da8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da806a380 con 0x7f3da80f66e0 2022-02-02T19:27:18.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3db04bf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da806a4c0 con 0x7f3da80f7980 2022-02-02T19:27:18.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3dae25b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3dae25b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59826/0 (socket says 172.21.15.96:59826) 2022-02-02T19:27:18.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.054+0000 7f3dae25b700 1 -- 172.21.15.96:0/3954407819 learned_addr learned my addr 172.21.15.96:0/3954407819 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:18.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3dada5a700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f7980 0x7f3da8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3dae25b700 1 -- 172.21.15.96:0/3954407819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f7980 msgr2=0x7f3da8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3dae25b700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f7980 0x7f3da8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3dae25b700 1 -- 172.21.15.96:0/3954407819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4005040 con 0x7f3da80f66e0 2022-02-02T19:27:18.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3dae25b700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f3d9c002700 tx=0x7f3d9c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9c0079c0 con 0x7f3da80f66e0 2022-02-02T19:27:18.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da806a7a0 con 0x7f3da80f66e0 2022-02-02T19:27:18.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d9c00f040 con 0x7f3da80f66e0 2022-02-02T19:27:18.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9c014860 con 0x7f3da80f66e0 2022-02-02T19:27:18.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.055+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da810ef90 con 0x7f3da80f66e0 2022-02-02T19:27:18.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d9c01b060 con 0x7f3da80f66e0 2022-02-02T19:27:18.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da8045ad0 con 0x7f3da80f66e0 2022-02-02T19:27:18.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3d9affd700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 0x7f3d94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3d9c081930 con 0x7f3da80f66e0 2022-02-02T19:27:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3dada5a700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 0x7f3d94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.057+0000 7f3dada5a700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 0x7f3d94067290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f3da4004630 tx=0x7f3da4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.061+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d9c04f9e0 con 0x7f3da80f66e0 2022-02-02T19:27:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.239+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3da80ff050 con 0x7f3d94064dd0 2022-02-02T19:27:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.240+0000 7f3d9affd700 1 -- 172.21.15.96:0/3954407819 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3da4019040 con 0x7f3d94064dd0 2022-02-02T19:27:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 msgr2=0x7f3d94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 0x7f3d94067290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f3da4004630 tx=0x7f3da4009b30).stop 2022-02-02T19:27:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 msgr2=0x7f3da806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f3d9c002700 tx=0x7f3d9c009d80).stop 2022-02-02T19:27:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 shutdown_connections 2022-02-02T19:27:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d94064dd0 0x7f3d94067290 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3da80f66e0 0x7f3da806b9a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 --2- 172.21.15.96:0/3954407819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da80f7980 0x7f3da8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 >> 172.21.15.96:0/3954407819 conn(0x7f3da80f1e40 msgr2=0x7f3da80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 shutdown_connections 2022-02-02T19:27:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.242+0000 7f3db04bf700 1 -- 172.21.15.96:0/3954407819 wait complete. 2022-02-02T19:27:18.258 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:27:18.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- 172.21.15.96:0/189383494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f55c0 msgr2=0x7f41780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 --2- 172.21.15.96:0/189383494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f55c0 0x7f41780f59e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f4168004660 tx=0x7f4168009b30).stop 2022-02-02T19:27:18.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- 172.21.15.96:0/189383494 shutdown_connections 2022-02-02T19:27:18.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 --2- 172.21.15.96:0/189383494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f6860 0x7f41780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 --2- 172.21.15.96:0/189383494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f55c0 0x7f41780f59e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- 172.21.15.96:0/189383494 >> 172.21.15.96:0/189383494 conn(0x7f41780f0d40 msgr2=0x7f41780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:18 smithi096 ceph-mon[101353]: pgmap v1955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:18.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- 172.21.15.96:0/189383494 shutdown_connections 2022-02-02T19:27:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- 172.21.15.96:0/189383494 wait complete. 2022-02-02T19:27:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 Processor -- start 2022-02-02T19:27:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.339+0000 7f417f9ec700 1 -- start start 2022-02-02T19:27:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417f9ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 0x7f4178109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417f9ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417f9ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780603e0 con 0x7f41780f6860 2022-02-02T19:27:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417f9ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178060520 con 0x7f41780f55c0 2022-02-02T19:27:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59838/0 (socket says 172.21.15.96:59838) 2022-02-02T19:27:18.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 -- 172.21.15.96:0/433455072 learned_addr learned my addr 172.21.15.96:0/433455072 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:18.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417d788700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 0x7f4178109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 -- 172.21.15.96:0/433455072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 msgr2=0x7f4178109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 0x7f4178109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 -- 172.21.15.96:0/433455072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168005040 con 0x7f41780f6860 2022-02-02T19:27:18.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417d788700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 0x7f4178109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:27:18.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417cf87700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f41740026d0 tx=0x7f4174009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4174009320 con 0x7f41780f6860 2022-02-02T19:27:18.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f417400f040 con 0x7f41780f6860 2022-02-02T19:27:18.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417810c720 con 0x7f41780f6860 2022-02-02T19:27:18.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.340+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41740147e0 con 0x7f41780f6860 2022-02-02T19:27:18.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.341+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417810cce0 con 0x7f41780f6860 2022-02-02T19:27:18.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.342+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178045ad0 con 0x7f41780f6860 2022-02-02T19:27:18.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.342+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4174009480 con 0x7f41780f6860 2022-02-02T19:27:18.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.342+0000 7f416dffb700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 0x7f4164067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.343+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4174082170 con 0x7f41780f6860 2022-02-02T19:27:18.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.343+0000 7f417d788700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 0x7f4164067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.343+0000 7f417d788700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 0x7f4164067290 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4168004e30 tx=0x7f4168009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.347+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4174050220 con 0x7f41780f6860 2022-02-02T19:27:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.520+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4178057f10 con 0x7f4164064dd0 2022-02-02T19:27:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:18 smithi159 ceph-mon[69013]: pgmap v1955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:18.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.529+0000 7f416dffb700 1 -- 172.21.15.96:0/433455072 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4178057f10 con 0x7f4164064dd0 2022-02-02T19:27:18.536 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:27:18.537 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (70m) 41m ago 71m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:27:18.537 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (63m) 41m ago 71m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:27:18.537 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (63m) 39m ago 71m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:27:18.537 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (70m) 41m ago 71m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:27:18.538 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (67m) 41m ago 67m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:27:18.538 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (63m) 41m ago 67m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:27:18.538 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (67m) 39m ago 67m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:27:18.538 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (63m) 39m ago 67m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:27:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (64m) 41m ago 72m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:27:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (64m) 39m ago 71m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:27:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (63m) 41m ago 72m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:27:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (63m) 39m ago 71m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:27:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (71m) 41m ago 71m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:27:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (71m) 39m ago 71m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:27:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (62m) 41m ago 70m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:27:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (62m) 41m ago 70m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:27:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (61m) 41m ago 69m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:27:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (61m) 39m ago 69m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:27:18.541 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (60m) 39m ago 69m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:27:18.541 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (60m) 39m ago 69m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:27:18.541 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (70m) 41m ago 71m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:27:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 msgr2=0x7f4164067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 0x7f4164067290 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4168004e30 tx=0x7f4168009b30).stop 2022-02-02T19:27:18.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 msgr2=0x7f417810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f41740026d0 tx=0x7f4174009de0).stop 2022-02-02T19:27:18.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 shutdown_connections 2022-02-02T19:27:18.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4164064dd0 0x7f4164067290 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41780f55c0 0x7f4178109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 --2- 172.21.15.96:0/433455072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41780f6860 0x7f417810c170 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.531+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 >> 172.21.15.96:0/433455072 conn(0x7f41780f0d40 msgr2=0x7f41780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.532+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 shutdown_connections 2022-02-02T19:27:18.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.532+0000 7f417f9ec700 1 -- 172.21.15.96:0/433455072 wait complete. 2022-02-02T19:27:18.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 -- 172.21.15.96:0/2490709897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 msgr2=0x7f57c00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 --2- 172.21.15.96:0/2490709897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c00f6920 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f57ac004660 tx=0x7f57ac009b30).stop 2022-02-02T19:27:18.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 -- 172.21.15.96:0/2490709897 shutdown_connections 2022-02-02T19:27:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 --2- 172.21.15.96:0/2490709897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c00f6920 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 --2- 172.21.15.96:0/2490709897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 0x7f57c00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 -- 172.21.15.96:0/2490709897 >> 172.21.15.96:0/2490709897 conn(0x7f57c00f0de0 msgr2=0x7f57c00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 -- 172.21.15.96:0/2490709897 shutdown_connections 2022-02-02T19:27:18.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.628+0000 7f57c6be6700 1 -- 172.21.15.96:0/2490709897 wait complete. 2022-02-02T19:27:18.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 Processor -- start 2022-02-02T19:27:18.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 -- start start 2022-02-02T19:27:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 0x7f57c0109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00604e0 con 0x7f57c00f5ef0 2022-02-02T19:27:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57c6be6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0060620 con 0x7f57c00f55e0 2022-02-02T19:27:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57bffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57bffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59848/0 (socket says 172.21.15.96:59848) 2022-02-02T19:27:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.629+0000 7f57bffff700 1 -- 172.21.15.96:0/1767883963 learned_addr learned my addr 172.21.15.96:0/1767883963 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57c4982700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 0x7f57c0109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bffff700 1 -- 172.21.15.96:0/1767883963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 msgr2=0x7f57c0109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bffff700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 0x7f57c0109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bffff700 1 -- 172.21.15.96:0/1767883963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac005040 con 0x7f57c00f5ef0 2022-02-02T19:27:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bffff700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f57ac009990 tx=0x7f57ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac018070 con 0x7f57c00f5ef0 2022-02-02T19:27:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c010c700 con 0x7f57c00f5ef0 2022-02-02T19:27:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f57ac007ba0 con 0x7f57c00f5ef0 2022-02-02T19:27:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac01c620 con 0x7f57c00f5ef0 2022-02-02T19:27:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.630+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c010cc30 con 0x7f57c00f5ef0 2022-02-02T19:27:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.631+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c00f4a70 con 0x7f57c00f5ef0 2022-02-02T19:27:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.632+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f57ac01c8e0 con 0x7f57c00f5ef0 2022-02-02T19:27:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.632+0000 7f57bd7fa700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 0x7f57b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.632+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f57ac0838a0 con 0x7f57c00f5ef0 2022-02-02T19:27:18.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.632+0000 7f57c4982700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 0x7f57b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.633+0000 7f57c4982700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 0x7f57b0067290 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f57b4007fd0 tx=0x7f57b4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.636+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f57ac051950 con 0x7f57c00f5ef0 2022-02-02T19:27:18.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.867+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57c0045ad0 con 0x7f57c00f5ef0 2022-02-02T19:27:18.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.868+0000 7f57bd7fa700 1 -- 172.21.15.96:0/1767883963 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f57ac054f70 con 0x7f57c00f5ef0 2022-02-02T19:27:18.875 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:27:18.875 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:27:18.875 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:27:18.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:18.876 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:27:18.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:27:18.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:18.876 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:27:18.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:27:18.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:18.877 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:27:18.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:27:18.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:18.878 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:27:18.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:27:18.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:27:18.878 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:27:18.879 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:27:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 msgr2=0x7f57b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 0x7f57b0067290 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f57b4007fd0 tx=0x7f57b4009040).stop 2022-02-02T19:27:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 msgr2=0x7f57c010c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f57ac009990 tx=0x7f57ac009b30).stop 2022-02-02T19:27:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 shutdown_connections 2022-02-02T19:27:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f57b0064dd0 0x7f57b0067290 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c00f55e0 0x7f57c0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 --2- 172.21.15.96:0/1767883963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c00f5ef0 0x7f57c010c1b0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 >> 172.21.15.96:0/1767883963 conn(0x7f57c00f0de0 msgr2=0x7f57c00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 shutdown_connections 2022-02-02T19:27:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.870+0000 7f57c6be6700 1 -- 172.21.15.96:0/1767883963 wait complete. 2022-02-02T19:27:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- 172.21.15.96:0/2512475140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 msgr2=0x7fc9500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 --2- 172.21.15.96:0/2512475140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc9500f6cc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fc940004660 tx=0x7fc940009b30).stop 2022-02-02T19:27:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- 172.21.15.96:0/2512475140 shutdown_connections 2022-02-02T19:27:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 --2- 172.21.15.96:0/2512475140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc9500f6cc0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 --2- 172.21.15.96:0/2512475140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 0x7fc9500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- 172.21.15.96:0/2512475140 >> 172.21.15.96:0/2512475140 conn(0x7fc9500f0d40 msgr2=0x7fc9500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- 172.21.15.96:0/2512475140 shutdown_connections 2022-02-02T19:27:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- 172.21.15.96:0/2512475140 wait complete. 2022-02-02T19:27:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 Processor -- start 2022-02-02T19:27:18.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.968+0000 7fc9561f1700 1 -- start start 2022-02-02T19:27:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc9561f1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 0x7fc950106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc9561f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc9561f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950107a10 con 0x7fc9500f6860 2022-02-02T19:27:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc9561f1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950107b50 con 0x7fc9500f55c0 2022-02-02T19:27:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59856/0 (socket says 172.21.15.96:59856) 2022-02-02T19:27:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 -- 172.21.15.96:0/3597426908 learned_addr learned my addr 172.21.15.96:0/3597426908 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94f7fe700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 0x7fc950106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 -- 172.21.15.96:0/3597426908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 msgr2=0x7fc950106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 0x7fc950106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 -- 172.21.15.96:0/3597426908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940005040 con 0x7fc9500f6860 2022-02-02T19:27:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.969+0000 7fc94effd700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fc940009990 tx=0x7fc940009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.970+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc940018070 con 0x7fc9500f6860 2022-02-02T19:27:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.970+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc940007ba0 con 0x7fc9500f6860 2022-02-02T19:27:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.970+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc950108490 con 0x7fc9500f6860 2022-02-02T19:27:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.970+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc94001c620 con 0x7fc9500f6860 2022-02-02T19:27:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.970+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9501089f0 con 0x7fc9500f6860 2022-02-02T19:27:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.971+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc950045ad0 con 0x7fc9500f6860 2022-02-02T19:27:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.971+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc94001c8e0 con 0x7fc9500f6860 2022-02-02T19:27:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.972+0000 7fc937fff700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 0x7fc938067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.972+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc9400838e0 con 0x7fc9500f6860 2022-02-02T19:27:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.972+0000 7fc94f7fe700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 0x7fc938067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.972+0000 7fc94f7fe700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 0x7fc938067290 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fc9500f66c0 tx=0x7fc944009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:18.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:18.976+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc9400553c0 con 0x7fc9500f6860 2022-02-02T19:27:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.178+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9500fdd80 con 0x7fc9500f6860 2022-02-02T19:27:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.179+0000 7fc937fff700 1 -- 172.21.15.96:0/3597426908 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc940054fb0 con 0x7fc9500f6860 2022-02-02T19:27:19.186 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:27:19.186 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:27:19.186 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:27:19.187 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:27:19.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:19.187 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:27:19.187 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:27:19.187 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:27:19.188 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:27:19.188 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:27:19.188 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:27:19.189 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:27:19.190 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:27:19.190 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:27:19.190 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:27:19.191 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:27:19.191 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:27:19.191 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:27:19.192 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:27:19.192 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:27:19.192 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:27:19.192 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:27:19.192 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:27:19.193 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:27:19.193 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:27:19.193 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:27:19.193 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:27:19.194 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:27:19.194 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:27:19.194 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:27:19.194 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:27:19.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:27:19.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:19.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:19.195 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:27:19.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:19.196 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:19.196 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:19.196 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 msgr2=0x7fc938067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 0x7fc938067290 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fc9500f66c0 tx=0x7fc944009040).stop 2022-02-02T19:27:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 msgr2=0x7fc950107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fc940009990 tx=0x7fc940009b30).stop 2022-02-02T19:27:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 shutdown_connections 2022-02-02T19:27:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc938064dd0 0x7fc938067290 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500f55c0 0x7fc950106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 --2- 172.21.15.96:0/3597426908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500f6860 0x7fc950107460 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 >> 172.21.15.96:0/3597426908 conn(0x7fc9500f0d40 msgr2=0x7fc95005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 shutdown_connections 2022-02-02T19:27:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:19.181+0000 7fc9561f1700 1 -- 172.21.15.96:0/3597426908 wait complete. 2022-02-02T19:27:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:27:19.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:19 smithi096 ceph-mon[101353]: from='client.36122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:19.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:19 smithi096 ceph-mon[101353]: from='client.36126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:19.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1767883963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:27:19.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:19 smithi159 ceph-mon[69013]: from='client.36122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:19.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:19 smithi159 ceph-mon[69013]: from='client.36126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:19.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1767883963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:27:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3597426908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:27:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:20 smithi159 ceph-mon[69013]: pgmap v1956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:20.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3597426908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:27:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:20 smithi096 ceph-mon[101353]: pgmap v1956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:22 smithi159 ceph-mon[69013]: pgmap v1957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:22.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:22 smithi096 ceph-mon[101353]: pgmap v1957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:24 smithi159 ceph-mon[69013]: pgmap v1958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:24 smithi096 ceph-mon[101353]: pgmap v1958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:26 smithi159 ceph-mon[69013]: pgmap v1959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:26 smithi096 ceph-mon[101353]: pgmap v1959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:27:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:27:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:27:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:27:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:28 smithi159 ceph-mon[69013]: pgmap v1960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:28 smithi096 ceph-mon[101353]: pgmap v1960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:30 smithi159 ceph-mon[69013]: pgmap v1961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:30 smithi096 ceph-mon[101353]: pgmap v1961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:32 smithi159 ceph-mon[69013]: pgmap v1962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:32.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:32 smithi096 ceph-mon[101353]: pgmap v1962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:34 smithi159 ceph-mon[69013]: pgmap v1963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:34 smithi096 ceph-mon[101353]: pgmap v1963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:36 smithi159 ceph-mon[69013]: pgmap v1964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:36 smithi096 ceph-mon[101353]: pgmap v1964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:38 smithi159 ceph-mon[69013]: pgmap v1965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:38 smithi096 ceph-mon[101353]: pgmap v1965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:40 smithi159 ceph-mon[69013]: pgmap v1966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:40 smithi096 ceph-mon[101353]: pgmap v1966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:42 smithi159 ceph-mon[69013]: pgmap v1967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:42 smithi096 ceph-mon[101353]: pgmap v1967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:44 smithi159 ceph-mon[69013]: pgmap v1968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:44 smithi096 ceph-mon[101353]: pgmap v1968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:46 smithi159 ceph-mon[69013]: pgmap v1969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:46 smithi096 ceph-mon[101353]: pgmap v1969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:48 smithi159 ceph-mon[69013]: pgmap v1970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:48 smithi096 ceph-mon[101353]: pgmap v1970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 -- 172.21.15.96:0/645003192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 msgr2=0x7f6ca00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/645003192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca00f59e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f6c90004660 tx=0x7f6c90009b30).stop 2022-02-02T19:27:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 -- 172.21.15.96:0/645003192 shutdown_connections 2022-02-02T19:27:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/645003192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 0x7f6ca00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/645003192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca00f59e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 -- 172.21.15.96:0/645003192 >> 172.21.15.96:0/645003192 conn(0x7f6ca00f0d40 msgr2=0x7f6ca00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 -- 172.21.15.96:0/645003192 shutdown_connections 2022-02-02T19:27:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.293+0000 7f6ca82b0700 1 -- 172.21.15.96:0/645003192 wait complete. 2022-02-02T19:27:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 Processor -- start 2022-02-02T19:27:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 -- start start 2022-02-02T19:27:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 0x7f6ca010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0060420 con 0x7f6ca00f55c0 2022-02-02T19:27:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca82b0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0060560 con 0x7f6ca00f6860 2022-02-02T19:27:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59874/0 (socket says 172.21.15.96:59874) 2022-02-02T19:27:49.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 -- 172.21.15.96:0/1997070184 learned_addr learned my addr 172.21.15.96:0/1997070184 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:49.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca584b700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 0x7f6ca010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 -- 172.21.15.96:0/1997070184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 msgr2=0x7f6ca010c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 0x7f6ca010c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 -- 172.21.15.96:0/1997070184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90005040 con 0x7f6ca00f55c0 2022-02-02T19:27:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.294+0000 7f6ca604c700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f6c90004f60 tx=0x7f6c90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.295+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c90018070 con 0x7f6ca00f55c0 2022-02-02T19:27:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.295+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c90007ba0 con 0x7f6ca00f55c0 2022-02-02T19:27:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.295+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca010c6e0 con 0x7f6ca00f55c0 2022-02-02T19:27:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.295+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9001c620 con 0x7f6ca00f55c0 2022-02-02T19:27:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.295+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca010cc10 con 0x7f6ca00f55c0 2022-02-02T19:27:49.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.296+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0045ad0 con 0x7f6ca00f55c0 2022-02-02T19:27:49.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.296+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c9001c8e0 con 0x7f6ca00f55c0 2022-02-02T19:27:49.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.297+0000 7f6c96ffd700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 0x7f6c8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.297+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c90083e20 con 0x7f6ca00f55c0 2022-02-02T19:27:49.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.297+0000 7f6ca584b700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 0x7f6c8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.297+0000 7f6ca584b700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 0x7f6c8c067290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6c9c0041d0 tx=0x7f6c9c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.300+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c90051ed0 con 0x7f6ca00f55c0 2022-02-02T19:27:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.479+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ca00fdec0 con 0x7f6c8c064dd0 2022-02-02T19:27:49.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.481+0000 7f6c96ffd700 1 -- 172.21.15.96:0/1997070184 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6ca00fdec0 con 0x7f6c8c064dd0 2022-02-02T19:27:49.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 msgr2=0x7f6c8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 0x7f6c8c067290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6c9c0041d0 tx=0x7f6c9c009040).stop 2022-02-02T19:27:49.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 msgr2=0x7f6ca0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f6c90004f60 tx=0x7f6c90009b30).stop 2022-02-02T19:27:49.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 shutdown_connections 2022-02-02T19:27:49.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c8c064dd0 0x7f6c8c067290 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ca00f55c0 0x7f6ca0109c30 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 --2- 172.21.15.96:0/1997070184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca00f6860 0x7f6ca010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 >> 172.21.15.96:0/1997070184 conn(0x7f6ca00f0d40 msgr2=0x7f6ca00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:49.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.482+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 shutdown_connections 2022-02-02T19:27:49.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.483+0000 7f6ca82b0700 1 -- 172.21.15.96:0/1997070184 wait complete. 2022-02-02T19:27:49.497 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:27:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 -- 172.21.15.96:0/3429381161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 msgr2=0x7f64480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3429381161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f64480f59e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f643c004660 tx=0x7f643c009b30).stop 2022-02-02T19:27:49.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 -- 172.21.15.96:0/3429381161 shutdown_connections 2022-02-02T19:27:49.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3429381161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 0x7f64480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3429381161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f64480f59e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 -- 172.21.15.96:0/3429381161 >> 172.21.15.96:0/3429381161 conn(0x7f64480f0d40 msgr2=0x7f64480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 -- 172.21.15.96:0/3429381161 shutdown_connections 2022-02-02T19:27:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.580+0000 7f644d4ae700 1 -- 172.21.15.96:0/3429381161 wait complete. 2022-02-02T19:27:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 Processor -- start 2022-02-02T19:27:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 -- start start 2022-02-02T19:27:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 0x7f6448106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448106910 con 0x7f64480f55c0 2022-02-02T19:27:49.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f644d4ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448106a50 con 0x7f64480f6860 2022-02-02T19:27:49.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59884/0 (socket says 172.21.15.96:59884) 2022-02-02T19:27:49.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 -- 172.21.15.96:0/3812478344 learned_addr learned my addr 172.21.15.96:0/3812478344 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:49.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f64467fc700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 0x7f6448106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 -- 172.21.15.96:0/3812478344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 msgr2=0x7f6448106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 0x7f6448106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 -- 172.21.15.96:0/3812478344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c005040 con 0x7f64480f55c0 2022-02-02T19:27:49.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.581+0000 7f6446ffd700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f643c009d30 tx=0x7f643c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.582+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643c01a070 con 0x7f64480f55c0 2022-02-02T19:27:49.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.582+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6448107390 con 0x7f64480f55c0 2022-02-02T19:27:49.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.582+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64481078f0 con 0x7f64480f55c0 2022-02-02T19:27:49.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.582+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f643c0097d0 con 0x7f64480f55c0 2022-02-02T19:27:49.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.582+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643c01f820 con 0x7f64480f55c0 2022-02-02T19:27:49.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.583+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6448045ad0 con 0x7f64480f55c0 2022-02-02T19:27:49.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.583+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f643c0125d0 con 0x7f64480f55c0 2022-02-02T19:27:49.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.584+0000 7f642f7fe700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 0x7f6430067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.584+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f643c085ca0 con 0x7f64480f55c0 2022-02-02T19:27:49.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.584+0000 7f64467fc700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 0x7f6430067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.584+0000 7f64467fc700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 0x7f6430067290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f64380041d0 tx=0x7f6438009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.588+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f643c08a070 con 0x7f64480f55c0 2022-02-02T19:27:49.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.760+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f644805f620 con 0x7f6430064dd0 2022-02-02T19:27:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.769+0000 7f642f7fe700 1 -- 172.21.15.96:0/3812478344 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f644805f620 con 0x7f6430064dd0 2022-02-02T19:27:49.775 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:27:49.775 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (71m) 41m ago 72m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:27:49.775 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (63m) 41m ago 72m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:27:49.775 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (63m) 40m ago 71m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:27:49.776 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (71m) 41m ago 72m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:27:49.776 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (68m) 41m ago 68m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:27:49.776 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (63m) 41m ago 68m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:27:49.776 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (68m) 40m ago 68m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:27:49.777 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (64m) 40m ago 68m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:27:49.777 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (65m) 41m ago 73m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:27:49.777 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (64m) 40m ago 71m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:27:49.777 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (64m) 41m ago 73m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:27:49.777 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (64m) 40m ago 71m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:27:49.778 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (72m) 41m ago 72m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:27:49.778 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (71m) 40m ago 71m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:27:49.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (63m) 41m ago 71m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:27:49.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (62m) 41m ago 70m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:27:49.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (62m) 41m ago 70m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:27:49.779 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (61m) 40m ago 70m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:27:49.779 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (61m) 40m ago 69m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:27:49.779 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (60m) 40m ago 69m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:27:49.779 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (70m) 41m ago 71m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:27:49.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 msgr2=0x7f6430067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 0x7f6430067290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f64380041d0 tx=0x7f6438009040).stop 2022-02-02T19:27:49.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 msgr2=0x7f6448105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f643c009d30 tx=0x7f643c009b30).stop 2022-02-02T19:27:49.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 shutdown_connections 2022-02-02T19:27:49.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6430064dd0 0x7f6430067290 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64480f55c0 0x7f6448105e70 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 --2- 172.21.15.96:0/3812478344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64480f6860 0x7f6448106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 >> 172.21.15.96:0/3812478344 conn(0x7f64480f0d40 msgr2=0x7f64480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:49.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 shutdown_connections 2022-02-02T19:27:49.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.772+0000 7f644d4ae700 1 -- 172.21.15.96:0/3812478344 wait complete. 2022-02-02T19:27:49.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 -- 172.21.15.96:0/945476728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f5430 msgr2=0x7f02a40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 --2- 172.21.15.96:0/945476728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f5430 0x7f02a40f5850 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f02a0004660 tx=0x7f02a0009b30).stop 2022-02-02T19:27:49.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 -- 172.21.15.96:0/945476728 shutdown_connections 2022-02-02T19:27:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 --2- 172.21.15.96:0/945476728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f66d0 0x7f02a40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 --2- 172.21.15.96:0/945476728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f5430 0x7f02a40f5850 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.868+0000 7f02aa121700 1 -- 172.21.15.96:0/945476728 >> 172.21.15.96:0/945476728 conn(0x7f02a40f0b90 msgr2=0x7f02a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 -- 172.21.15.96:0/945476728 shutdown_connections 2022-02-02T19:27:49.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 -- 172.21.15.96:0/945476728 wait complete. 2022-02-02T19:27:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 Processor -- start 2022-02-02T19:27:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 -- start start 2022-02-02T19:27:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f5430 0x7f02a4105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.869+0000 7f02aa121700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02aa121700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41067d0 con 0x7f02a40f66d0 2022-02-02T19:27:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02aa121700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4106fd0 con 0x7f02a40f5430 2022-02-02T19:27:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59896/0 (socket says 172.21.15.96:59896) 2022-02-02T19:27:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 -- 172.21.15.96:0/2479729143 learned_addr learned my addr 172.21.15.96:0/2479729143 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a911f700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f5430 0x7f02a4105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 -- 172.21.15.96:0/2479729143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f5430 msgr2=0x7f02a4105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f5430 0x7f02a4105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 -- 172.21.15.96:0/2479729143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0005040 con 0x7f02a40f66d0 2022-02-02T19:27:49.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02a891e700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f029400f940 tx=0x7f0294009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0294009500 con 0x7f02a40f66d0 2022-02-02T19:27:49.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.870+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a4107250 con 0x7f02a40f66d0 2022-02-02T19:27:49.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.871+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0294009660 con 0x7f02a40f66d0 2022-02-02T19:27:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.871+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029400dd60 con 0x7f02a40f66d0 2022-02-02T19:27:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.871+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a41077c0 con 0x7f02a40f66d0 2022-02-02T19:27:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.872+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4045ad0 con 0x7f02a40f66d0 2022-02-02T19:27:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.872+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f029400e040 con 0x7f02a40f66d0 2022-02-02T19:27:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.872+0000 7f0299ffb700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 0x7f02900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.873+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0294084360 con 0x7f02a40f66d0 2022-02-02T19:27:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.873+0000 7f02a911f700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 0x7f02900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.873+0000 7f02a911f700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 0x7f02900672e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f02a0004630 tx=0x7f02a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:49.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:49.877+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0294055e40 con 0x7f02a40f66d0 2022-02-02T19:27:50.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.114+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f02a4107e50 con 0x7f02a40f66d0 2022-02-02T19:27:50.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.114+0000 7f0299ffb700 1 -- 172.21.15.96:0/2479729143 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0294055a30 con 0x7f02a40f66d0 2022-02-02T19:27:50.120 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:27:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:27:50.120 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:27:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:27:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:27:50.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:27:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:27:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:27:50.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:27:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:27:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:27:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:27:50.123 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:27:50.124 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:27:50.124 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:27:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.116+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 msgr2=0x7f02900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.116+0000 7f02aa121700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 0x7f02900672e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f02a0004630 tx=0x7f02a0009b30).stop 2022-02-02T19:27:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.116+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 msgr2=0x7f02a4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.116+0000 7f02aa121700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f029400f940 tx=0x7f0294009de0).stop 2022-02-02T19:27:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 shutdown_connections 2022-02-02T19:27:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0290064e20 0x7f02900672e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a40f5430 0x7f02a4105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 --2- 172.21.15.96:0/2479729143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a40f66d0 0x7f02a4106220 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 >> 172.21.15.96:0/2479729143 conn(0x7f02a40f0b90 msgr2=0x7f02a40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 shutdown_connections 2022-02-02T19:27:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.117+0000 7f02aa121700 1 -- 172.21.15.96:0/2479729143 wait complete. 2022-02-02T19:27:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 -- 172.21.15.96:0/3006643005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f74a0 msgr2=0x7f0d240f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 --2- 172.21.15.96:0/3006643005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f74a0 0x7f0d240f5930 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f0d18004660 tx=0x7f0d18009b30).stop 2022-02-02T19:27:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 -- 172.21.15.96:0/3006643005 shutdown_connections 2022-02-02T19:27:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 --2- 172.21.15.96:0/3006643005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f74a0 0x7f0d240f5930 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 --2- 172.21.15.96:0/3006643005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f6b90 0x7f0d240f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 -- 172.21.15.96:0/3006643005 >> 172.21.15.96:0/3006643005 conn(0x7f0d240f0540 msgr2=0x7f0d240f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 -- 172.21.15.96:0/3006643005 shutdown_connections 2022-02-02T19:27:50.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.214+0000 7f0d297b6700 1 -- 172.21.15.96:0/3006643005 wait complete. 2022-02-02T19:27:50.222 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:50 smithi096 ceph-mon[101353]: from='client.36138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:50.222 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:50 smithi096 ceph-mon[101353]: from='client.36142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:50.223 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:50 smithi096 ceph-mon[101353]: pgmap v1971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:50.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.215+0000 7f0d297b6700 1 Processor -- start 2022-02-02T19:27:50.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.215+0000 7f0d297b6700 1 -- start start 2022-02-02T19:27:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.215+0000 7f0d297b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.215+0000 7f0d297b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f74a0 0x7f0d24106370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.215+0000 7f0d297b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24106920 con 0x7f0d240f6b90 2022-02-02T19:27:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d297b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24106a60 con 0x7f0d240f74a0 2022-02-02T19:27:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59904/0 (socket says 172.21.15.96:59904) 2022-02-02T19:27:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 -- 172.21.15.96:0/540418417 learned_addr learned my addr 172.21.15.96:0/540418417 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:27:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d227fc700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f74a0 0x7f0d24106370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 -- 172.21.15.96:0/540418417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f74a0 msgr2=0x7f0d24106370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f74a0 0x7f0d24106370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 -- 172.21.15.96:0/540418417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18005040 con 0x7f0d240f6b90 2022-02-02T19:27:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d22ffd700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f0d14002700 tx=0x7f0d14009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d14009320 con 0x7f0d240f6b90 2022-02-02T19:27:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d24107400 con 0x7f0d240f6b90 2022-02-02T19:27:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d1400f040 con 0x7f0d240f6b90 2022-02-02T19:27:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d14014900 con 0x7f0d240f6b90 2022-02-02T19:27:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.216+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d241079c0 con 0x7f0d240f6b90 2022-02-02T19:27:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.218+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d24045ad0 con 0x7f0d240f6b90 2022-02-02T19:27:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.218+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d14009480 con 0x7f0d240f6b90 2022-02-02T19:27:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.218+0000 7f0d0b7fe700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 0x7f0d0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:27:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.218+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0d14081d80 con 0x7f0d240f6b90 2022-02-02T19:27:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.218+0000 7f0d227fc700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 0x7f0d0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:27:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.219+0000 7f0d227fc700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 0x7f0d0c067290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f0d18004630 tx=0x7f0d18009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:27:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.222+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d14053860 con 0x7f0d240f6b90 2022-02-02T19:27:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.424+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d240ff7b0 con 0x7f0d240f6b90 2022-02-02T19:27:50.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.424+0000 7f0d0b7fe700 1 -- 172.21.15.96:0/540418417 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0d14083720 con 0x7f0d240f6b90 2022-02-02T19:27:50.431 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:27:50.431 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:27:50.431 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:27:50.431 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:27:50.432 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:50.432 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:27:50.432 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:27:50.432 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:27:50.432 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:27:50.433 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:27:50.433 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:27:50.433 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:27:50.433 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:27:50.434 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:27:50.434 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:27:50.434 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:27:50.434 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:27:50.434 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:27:50.435 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:27:50.435 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:27:50.435 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:27:50.435 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:27:50.436 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:27:50.436 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:27:50.436 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:27:50.436 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:27:50.437 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:27:50.437 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:27:50.437 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:27:50.437 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:27:50.437 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:27:50.438 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:27:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:50.438 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:50.438 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:27:50.439 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:27:50.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:50.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:50.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:27:50.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 msgr2=0x7f0d0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 0x7f0d0c067290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f0d18004630 tx=0x7f0d18009b30).stop 2022-02-02T19:27:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 msgr2=0x7f0d24105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:27:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f0d14002700 tx=0x7f0d14009d80).stop 2022-02-02T19:27:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 shutdown_connections 2022-02-02T19:27:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d0c064dd0 0x7f0d0c067290 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d240f6b90 0x7f0d24105e80 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 --2- 172.21.15.96:0/540418417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d240f74a0 0x7f0d24106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:27:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 >> 172.21.15.96:0/540418417 conn(0x7f0d240f0540 msgr2=0x7f0d240fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:27:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 shutdown_connections 2022-02-02T19:27:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:27:50.426+0000 7f0d297b6700 1 -- 172.21.15.96:0/540418417 wait complete. 2022-02-02T19:27:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:27:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:50 smithi159 ceph-mon[69013]: from='client.36138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:50 smithi159 ceph-mon[69013]: from='client.36142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:27:50.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:50 smithi159 ceph-mon[69013]: pgmap v1971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:51.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2479729143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:27:51.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/540418417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:27:51.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2479729143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:27:51.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/540418417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:27:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:52 smithi159 ceph-mon[69013]: pgmap v1972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:52 smithi096 ceph-mon[101353]: pgmap v1972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:54 smithi159 ceph-mon[69013]: pgmap v1973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:54 smithi096 ceph-mon[101353]: pgmap v1973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:56 smithi159 ceph-mon[69013]: pgmap v1974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:56 smithi096 ceph-mon[101353]: pgmap v1974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:27:58 smithi159 ceph-mon[69013]: pgmap v1975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:27:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:27:58 smithi096 ceph-mon[101353]: pgmap v1975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:00 smithi159 ceph-mon[69013]: pgmap v1976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:00.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:00 smithi096 ceph-mon[101353]: pgmap v1976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:02 smithi159 ceph-mon[69013]: pgmap v1977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:02 smithi096 ceph-mon[101353]: pgmap v1977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:04 smithi159 ceph-mon[69013]: pgmap v1978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:04 smithi096 ceph-mon[101353]: pgmap v1978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:06 smithi159 ceph-mon[69013]: pgmap v1979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:06 smithi096 ceph-mon[101353]: pgmap v1979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:08 smithi159 ceph-mon[69013]: pgmap v1980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:08 smithi096 ceph-mon[101353]: pgmap v1980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:10 smithi159 ceph-mon[69013]: pgmap v1981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:10 smithi096 ceph-mon[101353]: pgmap v1981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:12 smithi159 ceph-mon[69013]: pgmap v1982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:12 smithi096 ceph-mon[101353]: pgmap v1982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:14 smithi159 ceph-mon[69013]: pgmap v1983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:14 smithi096 ceph-mon[101353]: pgmap v1983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:16 smithi159 ceph-mon[69013]: pgmap v1984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:16 smithi096 ceph-mon[101353]: pgmap v1984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:18 smithi159 ceph-mon[69013]: pgmap v1985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:18 smithi096 ceph-mon[101353]: pgmap v1985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:20 smithi159 ceph-mon[69013]: pgmap v1986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:20.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.536+0000 7fdce5298700 1 -- 172.21.15.96:0/2205883242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 msgr2=0x7fdce00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.536+0000 7fdce5298700 1 --2- 172.21.15.96:0/2205883242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce00f7c30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fdcd4004660 tx=0x7fdcd4009b30).stop 2022-02-02T19:28:20.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 -- 172.21.15.96:0/2205883242 shutdown_connections 2022-02-02T19:28:20.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 --2- 172.21.15.96:0/2205883242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce00f7c30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 --2- 172.21.15.96:0/2205883242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 -- 172.21.15.96:0/2205883242 >> 172.21.15.96:0/2205883242 conn(0x7fdce00f1c90 msgr2=0x7fdce00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:20.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:20 smithi096 ceph-mon[101353]: pgmap v1986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:20.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 -- 172.21.15.96:0/2205883242 shutdown_connections 2022-02-02T19:28:20.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 -- 172.21.15.96:0/2205883242 wait complete. 2022-02-02T19:28:20.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 Processor -- start 2022-02-02T19:28:20.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.537+0000 7fdce5298700 1 -- start start 2022-02-02T19:28:20.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdce5298700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdce5298700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdce5298700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce006a410 con 0x7fdce00f77d0 2022-02-02T19:28:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdce5298700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce006a550 con 0x7fdce00f6530 2022-02-02T19:28:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59924/0 (socket says 172.21.15.96:59924) 2022-02-02T19:28:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 -- 172.21.15.96:0/1778518436 learned_addr learned my addr 172.21.15.96:0/1778518436 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 -- 172.21.15.96:0/1778518436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 msgr2=0x7fdce006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 -- 172.21.15.96:0/1778518436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4005040 con 0x7fdce00f77d0 2022-02-02T19:28:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:28:20.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdf7fe700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fdcd4009990 tx=0x7fdcd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:20.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd4018070 con 0x7fdce00f77d0 2022-02-02T19:28:20.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce006a7d0 con 0x7fdce00f77d0 2022-02-02T19:28:20.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdcd4007ca0 con 0x7fdce00f77d0 2022-02-02T19:28:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.538+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd401c620 con 0x7fdce00f77d0 2022-02-02T19:28:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.539+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce010edc0 con 0x7fdce00f77d0 2022-02-02T19:28:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.540+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce0045ad0 con 0x7fdce00f77d0 2022-02-02T19:28:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.540+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdcd401d960 con 0x7fdce00f77d0 2022-02-02T19:28:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.540+0000 7fdcdcff9700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 0x7fdcc80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.541+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdcd4083830 con 0x7fdce00f77d0 2022-02-02T19:28:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.541+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 0x7fdcc80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.541+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 0x7fdcc80672e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fdce006b730 tx=0x7fdcd0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.545+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdcd40519a0 con 0x7fdce00f77d0 2022-02-02T19:28:20.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.726+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdce0057f10 con 0x7fdcc8064e20 2022-02-02T19:28:20.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.727+0000 7fdcdcff9700 1 -- 172.21.15.96:0/1778518436 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdce0057f10 con 0x7fdcc8064e20 2022-02-02T19:28:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 msgr2=0x7fdcc80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 0x7fdcc80672e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fdce006b730 tx=0x7fdcd0008040).stop 2022-02-02T19:28:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 msgr2=0x7fdce0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fdcd4009990 tx=0x7fdcd4009b30).stop 2022-02-02T19:28:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 shutdown_connections 2022-02-02T19:28:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcc8064e20 0x7fdcc80672e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f6530 0x7fdce006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 --2- 172.21.15.96:0/1778518436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f77d0 0x7fdce0069e20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.729+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 >> 172.21.15.96:0/1778518436 conn(0x7fdce00f1c90 msgr2=0x7fdce00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.730+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 shutdown_connections 2022-02-02T19:28:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.730+0000 7fdce5298700 1 -- 172.21.15.96:0/1778518436 wait complete. 2022-02-02T19:28:20.745 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:28:20.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 -- 172.21.15.96:0/1615177044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 msgr2=0x7fbbd40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1615177044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd40f6b40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fbbc4004660 tx=0x7fbbc4009b30).stop 2022-02-02T19:28:20.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 -- 172.21.15.96:0/1615177044 shutdown_connections 2022-02-02T19:28:20.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1615177044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd40f6b40 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1615177044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 0x7fbbd40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:20.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 -- 172.21.15.96:0/1615177044 >> 172.21.15.96:0/1615177044 conn(0x7fbbd40f0ba0 msgr2=0x7fbbd40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:20.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 -- 172.21.15.96:0/1615177044 shutdown_connections 2022-02-02T19:28:20.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.828+0000 7fbbd359e700 1 -- 172.21.15.96:0/1615177044 wait complete. 2022-02-02T19:28:20.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 Processor -- start 2022-02-02T19:28:20.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 -- start start 2022-02-02T19:28:20.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 0x7fbbd4105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4106850 con 0x7fbbd40f66e0 2022-02-02T19:28:20.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4106fc0 con 0x7fbbd40f5440 2022-02-02T19:28:20.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59934/0 (socket says 172.21.15.96:59934) 2022-02-02T19:28:20.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.829+0000 7fbbd1d9b700 1 -- 172.21.15.96:0/1002499902 learned_addr learned my addr 172.21.15.96:0/1002499902 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:20.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd1d9b700 1 -- 172.21.15.96:0/1002499902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 msgr2=0x7fbbd4105d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:20.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd259c700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 0x7fbbd4105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd1d9b700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 0x7fbbd4105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:20.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd1d9b700 1 -- 172.21.15.96:0/1002499902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4005040 con 0x7fbbd40f66e0 2022-02-02T19:28:20.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd1d9b700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fbbc4009990 tx=0x7fbbc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:20.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc4018070 con 0x7fbbd40f66e0 2022-02-02T19:28:20.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd4107240 con 0x7fbbd40f66e0 2022-02-02T19:28:20.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd41077a0 con 0x7fbbd40f66e0 2022-02-02T19:28:20.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbc4007ca0 con 0x7fbbd40f66e0 2022-02-02T19:28:20.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.830+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc401c620 con 0x7fbbd40f66e0 2022-02-02T19:28:20.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.831+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb8004fa0 con 0x7fbbd40f66e0 2022-02-02T19:28:20.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.831+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbbc401c890 con 0x7fbbd40f66e0 2022-02-02T19:28:20.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.832+0000 7fbbc2ffd700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 0x7fbbbc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:20.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.832+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbbc40836d0 con 0x7fbbd40f66e0 2022-02-02T19:28:20.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.832+0000 7fbbd259c700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 0x7fbbbc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:20.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.832+0000 7fbbd259c700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 0x7fbbbc0672e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fbbd40f6540 tx=0x7fbbc8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:20.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:20.836+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbbc4055270 con 0x7fbbd40f66e0 2022-02-02T19:28:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.008+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbb8000bc0 con 0x7fbbbc064e20 2022-02-02T19:28:21.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.017+0000 7fbbc2ffd700 1 -- 172.21.15.96:0/1002499902 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbbb8000bc0 con 0x7fbbbc064e20 2022-02-02T19:28:21.023 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:28:21.023 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (71m) 42m ago 72m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:28:21.024 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (64m) 42m ago 72m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:28:21.024 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (64m) 40m ago 72m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:28:21.024 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (71m) 42m ago 72m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:28:21.024 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (68m) 42m ago 68m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:28:21.025 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (64m) 42m ago 68m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:28:21.025 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (68m) 40m ago 68m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:28:21.025 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (64m) 40m ago 68m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:28:21.025 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (65m) 42m ago 73m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:28:21.026 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (65m) 40m ago 72m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:28:21.026 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (65m) 42m ago 74m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:28:21.026 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (64m) 40m ago 72m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:28:21.026 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (72m) 42m ago 72m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:28:21.027 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (72m) 40m ago 72m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:28:21.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (63m) 42m ago 71m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:28:21.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (63m) 42m ago 71m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:28:21.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (62m) 42m ago 70m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:28:21.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (62m) 40m ago 70m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:28:21.028 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (61m) 40m ago 70m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:28:21.028 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (61m) 40m ago 70m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:28:21.028 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (71m) 42m ago 72m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:28:21.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 msgr2=0x7fbbbc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 0x7fbbbc0672e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fbbd40f6540 tx=0x7fbbc8008040).stop 2022-02-02T19:28:21.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 msgr2=0x7fbbd4106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fbbc4009990 tx=0x7fbbc4009b30).stop 2022-02-02T19:28:21.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 shutdown_connections 2022-02-02T19:28:21.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbbc064e20 0x7fbbbc0672e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbd40f5440 0x7fbbd4105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 --2- 172.21.15.96:0/1002499902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbd40f66e0 0x7fbbd4106210 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 >> 172.21.15.96:0/1002499902 conn(0x7fbbd40f0ba0 msgr2=0x7fbbd40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:21.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 shutdown_connections 2022-02-02T19:28:21.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.019+0000 7fbbd359e700 1 -- 172.21.15.96:0/1002499902 wait complete. 2022-02-02T19:28:21.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 -- 172.21.15.96:0/2847182709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 msgr2=0x7fa0b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 --2- 172.21.15.96:0/2847182709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b00f7de0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fa0a4004660 tx=0x7fa0a4009b30).stop 2022-02-02T19:28:21.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 -- 172.21.15.96:0/2847182709 shutdown_connections 2022-02-02T19:28:21.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 --2- 172.21.15.96:0/2847182709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b00f7de0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 --2- 172.21.15.96:0/2847182709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 0x7fa0b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:21.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.115+0000 7fa0b6844700 1 -- 172.21.15.96:0/2847182709 >> 172.21.15.96:0/2847182709 conn(0x7fa0b00f1e40 msgr2=0x7fa0b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:21.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.116+0000 7fa0b6844700 1 -- 172.21.15.96:0/2847182709 shutdown_connections 2022-02-02T19:28:21.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.116+0000 7fa0b6844700 1 -- 172.21.15.96:0/2847182709 wait complete. 2022-02-02T19:28:21.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.116+0000 7fa0b6844700 1 Processor -- start 2022-02-02T19:28:21.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0b6844700 1 -- start start 2022-02-02T19:28:21.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0b6844700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 0x7fa0b0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0b6844700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0b6844700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0107ae0 con 0x7fa0b00f7980 2022-02-02T19:28:21.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0b6844700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0108390 con 0x7fa0b00f66e0 2022-02-02T19:28:21.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59944/0 (socket says 172.21.15.96:59944) 2022-02-02T19:28:21.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 -- 172.21.15.96:0/1821050456 learned_addr learned my addr 172.21.15.96:0/1821050456 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:21.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0affff700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 0x7fa0b0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 -- 172.21.15.96:0/1821050456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 msgr2=0x7fa0b0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 0x7fa0b0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 -- 172.21.15.96:0/1821050456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4005040 con 0x7fa0b00f7980 2022-02-02T19:28:21.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.117+0000 7fa0af7fe700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fa0a4009990 tx=0x7fa0a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.118+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a4018070 con 0x7fa0b00f7980 2022-02-02T19:28:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.118+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0a4007ca0 con 0x7fa0b00f7980 2022-02-02T19:28:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.118+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b0108610 con 0x7fa0b00f7980 2022-02-02T19:28:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.118+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a401c620 con 0x7fa0b00f7980 2022-02-02T19:28:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.118+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b0108b70 con 0x7fa0b00f7980 2022-02-02T19:28:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.119+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b00f5ad0 con 0x7fa0b00f7980 2022-02-02T19:28:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.119+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa0a401d960 con 0x7fa0b00f7980 2022-02-02T19:28:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.120+0000 7fa0acff9700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 0x7fa098067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.120+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa0a4083830 con 0x7fa0b00f7980 2022-02-02T19:28:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.120+0000 7fa0affff700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 0x7fa098067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.120+0000 7fa0affff700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 0x7fa098067290 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fa0b00f77e0 tx=0x7fa0a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.124+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa0a40553d0 con 0x7fa0b00f7980 2022-02-02T19:28:21.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.354+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0b00fef40 con 0x7fa0b00f7980 2022-02-02T19:28:21.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.355+0000 7fa0acff9700 1 -- 172.21.15.96:0/1821050456 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa0a4054fc0 con 0x7fa0b00f7980 2022-02-02T19:28:21.361 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:28:21.361 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:28:21.361 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:28:21.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:21.362 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:28:21.362 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:28:21.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:21.363 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:28:21.363 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:28:21.363 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:21.363 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:28:21.363 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:28:21.364 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:21.364 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:28:21.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:28:21.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:28:21.364 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:28:21.365 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:28:21.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 msgr2=0x7fa098067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 0x7fa098067290 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fa0b00f77e0 tx=0x7fa0a0008040).stop 2022-02-02T19:28:21.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 msgr2=0x7fa0b01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fa0a4009990 tx=0x7fa0a4009b30).stop 2022-02-02T19:28:21.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 shutdown_connections 2022-02-02T19:28:21.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa098064dd0 0x7fa098067290 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b00f66e0 0x7fa0b0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 --2- 172.21.15.96:0/1821050456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0b00f7980 0x7fa0b01074a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 >> 172.21.15.96:0/1821050456 conn(0x7fa0b00f1e40 msgr2=0x7fa0b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:21.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 shutdown_connections 2022-02-02T19:28:21.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.357+0000 7fa0b6844700 1 -- 172.21.15.96:0/1821050456 wait complete. 2022-02-02T19:28:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- 172.21.15.96:0/4115927193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 msgr2=0x7f57340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 --2- 172.21.15.96:0/4115927193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f57340f6cc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f5730004660 tx=0x7f5730009b30).stop 2022-02-02T19:28:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- 172.21.15.96:0/4115927193 shutdown_connections 2022-02-02T19:28:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 --2- 172.21.15.96:0/4115927193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f57340f6cc0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 --2- 172.21.15.96:0/4115927193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 0x7f57340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- 172.21.15.96:0/4115927193 >> 172.21.15.96:0/4115927193 conn(0x7f57340f0d40 msgr2=0x7f57340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- 172.21.15.96:0/4115927193 shutdown_connections 2022-02-02T19:28:21.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- 172.21.15.96:0/4115927193 wait complete. 2022-02-02T19:28:21.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 Processor -- start 2022-02-02T19:28:21.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.454+0000 7f573b31d700 1 -- start start 2022-02-02T19:28:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f573b31d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 0x7f5734109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f573b31d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f573b31d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340603e0 con 0x7f57340f6860 2022-02-02T19:28:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f573b31d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5734060520 con 0x7f57340f55c0 2022-02-02T19:28:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59954/0 (socket says 172.21.15.96:59954) 2022-02-02T19:28:21.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 -- 172.21.15.96:0/3813163077 learned_addr learned my addr 172.21.15.96:0/3813163077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:21.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57390b9700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 0x7f5734109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 -- 172.21.15.96:0/3813163077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 msgr2=0x7f5734109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 0x7f5734109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 -- 172.21.15.96:0/3813163077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730005040 con 0x7f57340f6860 2022-02-02T19:28:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f57388b8700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f5730009990 tx=0x7f5730009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.455+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5730018070 con 0x7f57340f6860 2022-02-02T19:28:21.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.456+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573410c6a0 con 0x7f57340f6860 2022-02-02T19:28:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.456+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5730007ba0 con 0x7f57340f6860 2022-02-02T19:28:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.456+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f573001c620 con 0x7f57340f6860 2022-02-02T19:28:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.456+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573410cc00 con 0x7f57340f6860 2022-02-02T19:28:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.457+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5734045ad0 con 0x7f57340f6860 2022-02-02T19:28:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.457+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f573001d420 con 0x7f57340f6860 2022-02-02T19:28:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.457+0000 7f5729ffb700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 0x7f5720067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.458+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f57300838d0 con 0x7f57340f6860 2022-02-02T19:28:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.458+0000 7f57390b9700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 0x7f5720067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:21.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.458+0000 7f57390b9700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 0x7f5720067290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f5734060060 tx=0x7f5724009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:21.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.462+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5730051a40 con 0x7f57340f6860 2022-02-02T19:28:21.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.664+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57340008d0 con 0x7f57340f6860 2022-02-02T19:28:21.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.665+0000 7f5729ffb700 1 -- 172.21.15.96:0/3813163077 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5730055060 con 0x7f57340f6860 2022-02-02T19:28:21.671 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:28:21.671 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:28:21.671 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:28:21.672 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:28:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:21.672 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:28:21.672 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:28:21.673 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:28:21.673 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:28:21.673 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:28:21.673 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:28:21.673 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:28:21.674 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:28:21.674 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:28:21.674 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:28:21.674 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:28:21.675 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:28:21.675 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:28:21.675 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:28:21.675 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:28:21.676 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:28:21.676 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:28:21.676 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:28:21.676 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:28:21.676 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:28:21.677 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:28:21.677 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:28:21.677 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:28:21.677 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:28:21.678 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:28:21.678 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:28:21.678 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:28:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:21.679 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:28:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:21.679 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:21.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:21.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 msgr2=0x7f5720067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 0x7f5720067290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f5734060060 tx=0x7f5724009040).stop 2022-02-02T19:28:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 msgr2=0x7f573410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f5730009990 tx=0x7f5730009b30).stop 2022-02-02T19:28:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 shutdown_connections 2022-02-02T19:28:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5720064dd0 0x7f5720067290 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57340f55c0 0x7f5734109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 --2- 172.21.15.96:0/3813163077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57340f6860 0x7f573410c150 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 >> 172.21.15.96:0/3813163077 conn(0x7f57340f0d40 msgr2=0x7f57340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 shutdown_connections 2022-02-02T19:28:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:21.667+0000 7f573b31d700 1 -- 172.21.15.96:0/3813163077 wait complete. 2022-02-02T19:28:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:28:22.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:21 smithi159 ceph-mon[69013]: from='client.36154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:22.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:21 smithi159 ceph-mon[69013]: from='client.36158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:22.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1821050456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:28:22.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3813163077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:28:22.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:21 smithi096 ceph-mon[101353]: from='client.36154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:22.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:21 smithi096 ceph-mon[101353]: from='client.36158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:22.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1821050456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:28:22.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3813163077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:28:23.242 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:22 smithi096 ceph-mon[101353]: pgmap v1987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:23.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:22 smithi159 ceph-mon[69013]: pgmap v1987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:24 smithi159 ceph-mon[69013]: pgmap v1988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:24 smithi096 ceph-mon[101353]: pgmap v1988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:26 smithi159 ceph-mon[69013]: pgmap v1989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:27.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:26 smithi096 ceph-mon[101353]: pgmap v1989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:28:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:28:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:28:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:28:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:28 smithi159 ceph-mon[69013]: pgmap v1990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:28 smithi096 ceph-mon[101353]: pgmap v1990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:30 smithi159 ceph-mon[69013]: pgmap v1991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:30 smithi096 ceph-mon[101353]: pgmap v1991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:32 smithi159 ceph-mon[69013]: pgmap v1992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:32.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:32 smithi096 ceph-mon[101353]: pgmap v1992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:34 smithi159 ceph-mon[69013]: pgmap v1993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:34 smithi096 ceph-mon[101353]: pgmap v1993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:36 smithi159 ceph-mon[69013]: pgmap v1994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:36 smithi096 ceph-mon[101353]: pgmap v1994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:38 smithi159 ceph-mon[69013]: pgmap v1995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:38 smithi096 ceph-mon[101353]: pgmap v1995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:40 smithi159 ceph-mon[69013]: pgmap v1996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:40 smithi096 ceph-mon[101353]: pgmap v1996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:42 smithi159 ceph-mon[69013]: pgmap v1997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:42 smithi096 ceph-mon[101353]: pgmap v1997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:44 smithi159 ceph-mon[69013]: pgmap v1998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:44 smithi096 ceph-mon[101353]: pgmap v1998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:46 smithi159 ceph-mon[69013]: pgmap v1999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:46 smithi096 ceph-mon[101353]: pgmap v1999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:48 smithi159 ceph-mon[69013]: pgmap v2000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:48 smithi096 ceph-mon[101353]: pgmap v2000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:50 smithi159 ceph-mon[69013]: pgmap v2001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:50 smithi096 ceph-mon[101353]: pgmap v2001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 -- 172.21.15.96:0/1491728734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f7980 msgr2=0x7f9c3c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 --2- 172.21.15.96:0/1491728734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c0f7de0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f9c2c004660 tx=0x7f9c2c009b30).stop 2022-02-02T19:28:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 -- 172.21.15.96:0/1491728734 shutdown_connections 2022-02-02T19:28:51.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 --2- 172.21.15.96:0/1491728734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c0f7de0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 --2- 172.21.15.96:0/1491728734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 -- 172.21.15.96:0/1491728734 >> 172.21.15.96:0/1491728734 conn(0x7f9c3c0f1e40 msgr2=0x7f9c3c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:51.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 -- 172.21.15.96:0/1491728734 shutdown_connections 2022-02-02T19:28:51.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 -- 172.21.15.96:0/1491728734 wait complete. 2022-02-02T19:28:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.776+0000 7f9c424f7700 1 Processor -- start 2022-02-02T19:28:51.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c424f7700 1 -- start start 2022-02-02T19:28:51.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c424f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c424f7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c424f7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c06a380 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c424f7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c06a4c0 con 0x7f9c3c0f7980 2022-02-02T19:28:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59972/0 (socket says 172.21.15.96:59972) 2022-02-02T19:28:51.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 -- 172.21.15.96:0/2990202974 learned_addr learned my addr 172.21.15.96:0/2990202974 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:51.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3b7fe700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:51.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 -- 172.21.15.96:0/2990202974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f7980 msgr2=0x7f9c3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:51.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.777+0000 7f9c3bfff700 1 -- 172.21.15.96:0/2990202974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c005040 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c3bfff700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f9c30002700 tx=0x7f9c30009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:51.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c300079c0 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c3000f040 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c06a7a0 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c10ef90 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.778+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c30014860 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.779+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c045ad0 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.779+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c3001b060 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.780+0000 7f9c38ff9700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 0x7f9c24067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:51.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.780+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c30081970 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.780+0000 7f9c3b7fe700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 0x7f9c24067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:51.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.780+0000 7f9c3b7fe700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 0x7f9c24067270 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f9c2c004e30 tx=0x7f9c2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:51.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.784+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c3004fa20 con 0x7f9c3c0f66e0 2022-02-02T19:28:51.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.964+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3c0fefe0 con 0x7f9c24064db0 2022-02-02T19:28:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.965+0000 7f9c38ff9700 1 -- 172.21.15.96:0/2990202974 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9c3c0fefe0 con 0x7f9c24064db0 2022-02-02T19:28:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 msgr2=0x7f9c24067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 0x7f9c24067270 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f9c2c004e30 tx=0x7f9c2c009b30).stop 2022-02-02T19:28:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 msgr2=0x7f9c3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f9c30002700 tx=0x7f9c30009d80).stop 2022-02-02T19:28:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 shutdown_connections 2022-02-02T19:28:51.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c24064db0 0x7f9c24067270 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c3c0f66e0 0x7f9c3c06b9a0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 --2- 172.21.15.96:0/2990202974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c3c0f7980 0x7f9c3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:51.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 >> 172.21.15.96:0/2990202974 conn(0x7f9c3c0f1e40 msgr2=0x7f9c3c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:51.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 shutdown_connections 2022-02-02T19:28:51.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:51.967+0000 7f9c424f7700 1 -- 172.21.15.96:0/2990202974 wait complete. 2022-02-02T19:28:51.983 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:28:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 -- 172.21.15.96:0/1829191316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f6860 msgr2=0x7f05f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 --2- 172.21.15.96:0/1829191316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f6860 0x7f05f40f6cc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f05e0004660 tx=0x7f05e0009b30).stop 2022-02-02T19:28:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 -- 172.21.15.96:0/1829191316 shutdown_connections 2022-02-02T19:28:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 --2- 172.21.15.96:0/1829191316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f6860 0x7f05f40f6cc0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 --2- 172.21.15.96:0/1829191316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f55c0 0x7f05f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 -- 172.21.15.96:0/1829191316 >> 172.21.15.96:0/1829191316 conn(0x7f05f40f0d40 msgr2=0x7f05f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.066+0000 7f05faf9c700 1 -- 172.21.15.96:0/1829191316 shutdown_connections 2022-02-02T19:28:52.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.067+0000 7f05faf9c700 1 -- 172.21.15.96:0/1829191316 wait complete. 2022-02-02T19:28:52.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.067+0000 7f05faf9c700 1 Processor -- start 2022-02-02T19:28:52.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.067+0000 7f05faf9c700 1 -- start start 2022-02-02T19:28:52.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 0x7f05f4107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41079f0 con 0x7f05f40f55c0 2022-02-02T19:28:52.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f4107b30 con 0x7f05f40f6860 2022-02-02T19:28:52.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59982/0 (socket says 172.21.15.96:59982) 2022-02-02T19:28:52.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 -- 172.21.15.96:0/2272286329 learned_addr learned my addr 172.21.15.96:0/2272286329 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:52.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f3fff700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 0x7f05f4107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 -- 172.21.15.96:0/2272286329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 msgr2=0x7f05f4107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 0x7f05f4107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 -- 172.21.15.96:0/2272286329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0005040 con 0x7f05f40f55c0 2022-02-02T19:28:52.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f3fff700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 0x7f05f4107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:28:52.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f8d38700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f05e8002700 tx=0x7f05e8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e8009320 con 0x7f05f40f55c0 2022-02-02T19:28:52.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f41084d0 con 0x7f05f40f55c0 2022-02-02T19:28:52.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f05e800f040 con 0x7f05f40f55c0 2022-02-02T19:28:52.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e8014780 con 0x7f05f40f55c0 2022-02-02T19:28:52.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.068+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f4108a90 con 0x7f05f40f55c0 2022-02-02T19:28:52.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.069+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d4004fa0 con 0x7f05f40f55c0 2022-02-02T19:28:52.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.070+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f05e8009480 con 0x7f05f40f55c0 2022-02-02T19:28:52.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.070+0000 7f05f17fa700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 0x7f05e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.070+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f05e8082090 con 0x7f05f40f55c0 2022-02-02T19:28:52.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.070+0000 7f05f3fff700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 0x7f05e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.071+0000 7f05f3fff700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 0x7f05e4067290 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f05e0004630 tx=0x7f05e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.075+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f05e8053b10 con 0x7f05f40f55c0 2022-02-02T19:28:52.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.249+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05d4000bc0 con 0x7f05e4064dd0 2022-02-02T19:28:52.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.258+0000 7f05f17fa700 1 -- 172.21.15.96:0/2272286329 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f05d4000bc0 con 0x7f05e4064dd0 2022-02-02T19:28:52.265 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:28:52.266 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (72m) 42m ago 73m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:28:52.266 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (64m) 42m ago 73m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:28:52.266 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (64m) 41m ago 72m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:28:52.266 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (72m) 42m ago 73m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:28:52.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (69m) 42m ago 69m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:28:52.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (64m) 42m ago 69m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:28:52.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (69m) 41m ago 69m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:28:52.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (65m) 41m ago 69m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:28:52.267 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (66m) 42m ago 74m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:28:52.268 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (66m) 41m ago 72m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:28:52.268 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (65m) 42m ago 74m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:28:52.268 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (65m) 41m ago 72m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:28:52.268 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (73m) 42m ago 73m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:28:52.269 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (72m) 41m ago 72m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:28:52.269 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (64m) 42m ago 72m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:28:52.269 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (63m) 42m ago 71m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:28:52.269 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (63m) 42m ago 71m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:28:52.269 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (62m) 41m ago 71m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:28:52.270 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (62m) 41m ago 70m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:28:52.270 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (61m) 41m ago 70m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:28:52.270 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (72m) 42m ago 72m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:28:52.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 msgr2=0x7f05e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 0x7f05e4067290 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f05e0004630 tx=0x7f05e0009b30).stop 2022-02-02T19:28:52.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 msgr2=0x7f05f4106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f05e8002700 tx=0x7f05e8009d60).stop 2022-02-02T19:28:52.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 shutdown_connections 2022-02-02T19:28:52.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05e4064dd0 0x7f05e4067290 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40f55c0 0x7f05f4106f50 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 --2- 172.21.15.96:0/2272286329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f40f6860 0x7f05f4107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 >> 172.21.15.96:0/2272286329 conn(0x7f05f40f0d40 msgr2=0x7f05f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 shutdown_connections 2022-02-02T19:28:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.260+0000 7f05faf9c700 1 -- 172.21.15.96:0/2272286329 wait complete. 2022-02-02T19:28:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4259685311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f77d0 msgr2=0x7fbb880f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4259685311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f77d0 0x7fbb880f7c30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fbb78004660 tx=0x7fbb78009b30).stop 2022-02-02T19:28:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4259685311 shutdown_connections 2022-02-02T19:28:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4259685311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f77d0 0x7fbb880f7c30 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4259685311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f6530 0x7fbb880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4259685311 >> 172.21.15.96:0/4259685311 conn(0x7fbb880f1c90 msgr2=0x7fbb880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:52 smithi096 ceph-mon[101353]: from='client.36170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:52.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:52 smithi096 ceph-mon[101353]: pgmap v2002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:52.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.356+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4259685311 shutdown_connections 2022-02-02T19:28:52.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.357+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4259685311 wait complete. 2022-02-02T19:28:52.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 Processor -- start 2022-02-02T19:28:52.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 -- start start 2022-02-02T19:28:52.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f77d0 0x7fbb881072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88107980 con 0x7fbb880f6530 2022-02-02T19:28:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8e6c5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88108100 con 0x7fbb880f77d0 2022-02-02T19:28:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59992/0 (socket says 172.21.15.96:59992) 2022-02-02T19:28:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 -- 172.21.15.96:0/4055671174 learned_addr learned my addr 172.21.15.96:0/4055671174 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8cec2700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f77d0 0x7fbb881072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 -- 172.21.15.96:0/4055671174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f77d0 msgr2=0x7fbb881072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f77d0 0x7fbb881072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.358+0000 7fbb8d6c3700 1 -- 172.21.15.96:0/4055671174 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78005040 con 0x7fbb880f6530 2022-02-02T19:28:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb8d6c3700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbb840093f0 tx=0x7fbb84006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb84009ea0 con 0x7fbb880f6530 2022-02-02T19:28:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb84013af0 con 0x7fbb880f6530 2022-02-02T19:28:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb88108380 con 0x7fbb880f6530 2022-02-02T19:28:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8400db10 con 0x7fbb880f6530 2022-02-02T19:28:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.359+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88108940 con 0x7fbb880f6530 2022-02-02T19:28:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.360+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb88045ad0 con 0x7fbb880f6530 2022-02-02T19:28:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.360+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb8401a060 con 0x7fbb880f6530 2022-02-02T19:28:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.361+0000 7fbb7dffb700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 0x7fbb740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.361+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbb84081ad0 con 0x7fbb880f6530 2022-02-02T19:28:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.361+0000 7fbb8cec2700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 0x7fbb740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.361+0000 7fbb8cec2700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 0x7fbb740672e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fbb78009da0 tx=0x7fbb78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.365+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb8404fb80 con 0x7fbb880f6530 2022-02-02T19:28:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:52 smithi159 ceph-mon[69013]: from='client.36170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:52.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:52 smithi159 ceph-mon[69013]: pgmap v2002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.593+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb880feed0 con 0x7fbb880f6530 2022-02-02T19:28:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.594+0000 7fbb7dffb700 1 -- 172.21.15.96:0/4055671174 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbb840531a0 con 0x7fbb880f6530 2022-02-02T19:28:52.601 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:28:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:28:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:28:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:28:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:28:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:28:52.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:28:52.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:52.603 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:28:52.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:28:52.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:28:52.604 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:28:52.604 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:28:52.604 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:28:52.604 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:28:52.605 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:28:52.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 msgr2=0x7fbb740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 0x7fbb740672e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fbb78009da0 tx=0x7fbb78009b30).stop 2022-02-02T19:28:52.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 msgr2=0x7fbb88106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbb840093f0 tx=0x7fbb84006ec0).stop 2022-02-02T19:28:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 shutdown_connections 2022-02-02T19:28:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb74064e20 0x7fbb740672e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb880f6530 0x7fbb88106e00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 --2- 172.21.15.96:0/4055671174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb880f77d0 0x7fbb881072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.595+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 >> 172.21.15.96:0/4055671174 conn(0x7fbb880f1c90 msgr2=0x7fbb880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.596+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 shutdown_connections 2022-02-02T19:28:52.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.596+0000 7fbb8e6c5700 1 -- 172.21.15.96:0/4055671174 wait complete. 2022-02-02T19:28:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 -- 172.21.15.96:0/179742772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 msgr2=0x7f977c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 --2- 172.21.15.96:0/179742772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f59e0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f9770004660 tx=0x7f9770009b30).stop 2022-02-02T19:28:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 -- 172.21.15.96:0/179742772 shutdown_connections 2022-02-02T19:28:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 --2- 172.21.15.96:0/179742772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f977c0f6860 0x7f977c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 --2- 172.21.15.96:0/179742772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f59e0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 -- 172.21.15.96:0/179742772 >> 172.21.15.96:0/179742772 conn(0x7f977c0f0d40 msgr2=0x7f977c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 -- 172.21.15.96:0/179742772 shutdown_connections 2022-02-02T19:28:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.693+0000 7f978314c700 1 -- 172.21.15.96:0/179742772 wait complete. 2022-02-02T19:28:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 Processor -- start 2022-02-02T19:28:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 -- start start 2022-02-02T19:28:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f977c0f6860 0x7f977c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0f8190 con 0x7f977c0f55c0 2022-02-02T19:28:52.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f978314c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0f82d0 con 0x7f977c0f6860 2022-02-02T19:28:52.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60002/0 (socket says 172.21.15.96:60002) 2022-02-02T19:28:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 -- 172.21.15.96:0/1904049155 learned_addr learned my addr 172.21.15.96:0/1904049155 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:28:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 -- 172.21.15.96:0/1904049155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f977c0f6860 msgr2=0x7f977c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f977c0f6860 0x7f977c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.694+0000 7f9780ee8700 1 -- 172.21.15.96:0/1904049155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770005040 con 0x7f977c0f55c0 2022-02-02T19:28:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f9780ee8700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f9770004f60 tx=0x7f9770009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9770018070 con 0x7f977c0f55c0 2022-02-02T19:28:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9770007ba0 con 0x7f977c0f55c0 2022-02-02T19:28:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0f8550 con 0x7f977c0f55c0 2022-02-02T19:28:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977001c620 con 0x7f977c0f55c0 2022-02-02T19:28:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.695+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c10efc0 con 0x7f977c0f55c0 2022-02-02T19:28:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.696+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c045ad0 con 0x7f977c0f55c0 2022-02-02T19:28:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.697+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f977001d420 con 0x7f977c0f55c0 2022-02-02T19:28:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.697+0000 7f97797fa700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 0x7f976c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:28:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.697+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f97700838e0 con 0x7f977c0f55c0 2022-02-02T19:28:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.697+0000 7f977bfff700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 0x7f976c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:28:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.697+0000 7f977bfff700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 0x7f976c067290 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f9768009610 tx=0x7f9768006b50).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:28:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.701+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9770051a50 con 0x7f977c0f55c0 2022-02-02T19:28:52.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.900+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f977c10f630 con 0x7f977c0f55c0 2022-02-02T19:28:52.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.901+0000 7f97797fa700 1 -- 172.21.15.96:0/1904049155 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9770055070 con 0x7f977c0f55c0 2022-02-02T19:28:52.908 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:28:52.908 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:28:52.908 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:28:52.909 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:28:52.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:52.909 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:28:52.909 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:28:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:28:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:28:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:28:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:28:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:28:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:28:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:28:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:28:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:28:52.912 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:28:52.912 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:28:52.912 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:28:52.912 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:28:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:28:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:28:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:28:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:28:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:28:52.914 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:28:52.914 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:28:52.914 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:28:52.914 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:28:52.915 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:28:52.915 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:28:52.915 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:28:52.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:52.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:52.916 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:28:52.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:28:52.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:52.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:52.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:28:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 msgr2=0x7f976c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 0x7f976c067290 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f9768009610 tx=0x7f9768006b50).stop 2022-02-02T19:28:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 msgr2=0x7f977c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:28:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f9770004f60 tx=0x7f9770009b30).stop 2022-02-02T19:28:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 shutdown_connections 2022-02-02T19:28:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f976c064dd0 0x7f976c067290 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f977c0f55c0 0x7f977c0f9720 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:28:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 --2- 172.21.15.96:0/1904049155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f977c0f6860 0x7f977c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:28:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 >> 172.21.15.96:0/1904049155 conn(0x7f977c0f0d40 msgr2=0x7f977c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:28:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 shutdown_connections 2022-02-02T19:28:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:28:52.904+0000 7f978314c700 1 -- 172.21.15.96:0/1904049155 wait complete. 2022-02-02T19:28:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:28:53.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:53 smithi159 ceph-mon[69013]: from='client.36174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:53.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4055671174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:28:53.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1904049155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:28:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:53 smithi096 ceph-mon[101353]: from='client.36174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:28:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4055671174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:28:53.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1904049155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:28:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:54 smithi159 ceph-mon[69013]: pgmap v2003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:54 smithi096 ceph-mon[101353]: pgmap v2003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:56 smithi159 ceph-mon[69013]: pgmap v2004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:56 smithi096 ceph-mon[101353]: pgmap v2004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:28:58 smithi159 ceph-mon[69013]: pgmap v2005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:28:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:28:58 smithi096 ceph-mon[101353]: pgmap v2005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:00 smithi159 ceph-mon[69013]: pgmap v2006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:00.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:00 smithi096 ceph-mon[101353]: pgmap v2006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:02 smithi159 ceph-mon[69013]: pgmap v2007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:02 smithi096 ceph-mon[101353]: pgmap v2007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:04 smithi159 ceph-mon[69013]: pgmap v2008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:04 smithi096 ceph-mon[101353]: pgmap v2008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:06 smithi159 ceph-mon[69013]: pgmap v2009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:06 smithi096 ceph-mon[101353]: pgmap v2009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:08 smithi159 ceph-mon[69013]: pgmap v2010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:08 smithi096 ceph-mon[101353]: pgmap v2010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:10 smithi159 ceph-mon[69013]: pgmap v2011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:10 smithi096 ceph-mon[101353]: pgmap v2011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:12 smithi159 ceph-mon[69013]: pgmap v2012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:12 smithi096 ceph-mon[101353]: pgmap v2012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:14 smithi159 ceph-mon[69013]: pgmap v2013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:14.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:14 smithi096 ceph-mon[101353]: pgmap v2013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:16 smithi159 ceph-mon[69013]: pgmap v2014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:16 smithi096 ceph-mon[101353]: pgmap v2014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:18 smithi159 ceph-mon[69013]: pgmap v2015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:18 smithi096 ceph-mon[101353]: pgmap v2015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:20 smithi159 ceph-mon[69013]: pgmap v2016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:20 smithi096 ceph-mon[101353]: pgmap v2016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:22 smithi159 ceph-mon[69013]: pgmap v2017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:22.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:22 smithi096 ceph-mon[101353]: pgmap v2017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.016+0000 7fbe6cc58700 1 -- 172.21.15.96:0/1239109850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f7960 msgr2=0x7fbe680f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.016+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/1239109850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f7960 0x7fbe680f7dc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fbe50004660 tx=0x7fbe50009b30).stop 2022-02-02T19:29:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.016+0000 7fbe6cc58700 1 -- 172.21.15.96:0/1239109850 shutdown_connections 2022-02-02T19:29:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/1239109850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f7960 0x7fbe680f7dc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/1239109850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f66c0 0x7fbe680f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- 172.21.15.96:0/1239109850 >> 172.21.15.96:0/1239109850 conn(0x7fbe680f1e20 msgr2=0x7fbe680f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- 172.21.15.96:0/1239109850 shutdown_connections 2022-02-02T19:29:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- 172.21.15.96:0/1239109850 wait complete. 2022-02-02T19:29:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 Processor -- start 2022-02-02T19:29:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- start start 2022-02-02T19:29:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f7960 0x7fbe68107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe681079f0 con 0x7fbe680f66c0 2022-02-02T19:29:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6cc58700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe68107b30 con 0x7fbe680f7960 2022-02-02T19:29:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.017+0000 7fbe6659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60020/0 (socket says 172.21.15.96:60020) 2022-02-02T19:29:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 -- 172.21.15.96:0/4006806736 learned_addr learned my addr 172.21.15.96:0/4006806736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe65d9b700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f7960 0x7fbe68107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 -- 172.21.15.96:0/4006806736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f7960 msgr2=0x7fbe68107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f7960 0x7fbe68107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 -- 172.21.15.96:0/4006806736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50005040 con 0x7fbe680f66c0 2022-02-02T19:29:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6659c700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fbe60002700 tx=0x7fbe60009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe600079c0 con 0x7fbe680f66c0 2022-02-02T19:29:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe6000f040 con 0x7fbe680f66c0 2022-02-02T19:29:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe60014860 con 0x7fbe680f66c0 2022-02-02T19:29:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe681084d0 con 0x7fbe680f66c0 2022-02-02T19:29:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.018+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe68108a90 con 0x7fbe680f66c0 2022-02-02T19:29:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.019+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe68045ad0 con 0x7fbe680f66c0 2022-02-02T19:29:23.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.020+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe6001b060 con 0x7fbe680f66c0 2022-02-02T19:29:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.020+0000 7fbe5effd700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 0x7fbe54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.020+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbe60081860 con 0x7fbe680f66c0 2022-02-02T19:29:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.020+0000 7fbe65d9b700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 0x7fbe54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.021+0000 7fbe65d9b700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 0x7fbe54067290 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fbe50004630 tx=0x7fbe50009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.024+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe60053340 con 0x7fbe680f66c0 2022-02-02T19:29:23.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.205+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe68108d60 con 0x7fbe54064dd0 2022-02-02T19:29:23.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.206+0000 7fbe5effd700 1 -- 172.21.15.96:0/4006806736 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbe68108d60 con 0x7fbe54064dd0 2022-02-02T19:29:23.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 msgr2=0x7fbe54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 0x7fbe54067290 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fbe50004630 tx=0x7fbe50009b30).stop 2022-02-02T19:29:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 msgr2=0x7fbe68106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fbe60002700 tx=0x7fbe60009d80).stop 2022-02-02T19:29:23.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 shutdown_connections 2022-02-02T19:29:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe54064dd0 0x7fbe54067290 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe680f66c0 0x7fbe68106f50 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 --2- 172.21.15.96:0/4006806736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe680f7960 0x7fbe68107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 >> 172.21.15.96:0/4006806736 conn(0x7fbe680f1e20 msgr2=0x7fbe680fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 shutdown_connections 2022-02-02T19:29:23.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.208+0000 7fbe6cc58700 1 -- 172.21.15.96:0/4006806736 wait complete. 2022-02-02T19:29:23.223 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:29:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- 172.21.15.96:0/1219051435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f6860 msgr2=0x7fc3840f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 --2- 172.21.15.96:0/1219051435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f6860 0x7fc3840f6cc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fc374004660 tx=0x7fc374009b30).stop 2022-02-02T19:29:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- 172.21.15.96:0/1219051435 shutdown_connections 2022-02-02T19:29:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 --2- 172.21.15.96:0/1219051435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f6860 0x7fc3840f6cc0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 --2- 172.21.15.96:0/1219051435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f55c0 0x7fc3840f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- 172.21.15.96:0/1219051435 >> 172.21.15.96:0/1219051435 conn(0x7fc3840f0d40 msgr2=0x7fc3840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- 172.21.15.96:0/1219051435 shutdown_connections 2022-02-02T19:29:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- 172.21.15.96:0/1219051435 wait complete. 2022-02-02T19:29:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 Processor -- start 2022-02-02T19:29:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.307+0000 7fc38c491700 1 -- start start 2022-02-02T19:29:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38c491700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38c491700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 0x7fc384107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38c491700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc384107a10 con 0x7fc3840f55c0 2022-02-02T19:29:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38c491700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc384107b50 con 0x7fc3840f6860 2022-02-02T19:29:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60030/0 (socket says 172.21.15.96:60030) 2022-02-02T19:29:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 -- 172.21.15.96:0/1202348795 learned_addr learned my addr 172.21.15.96:0/1202348795 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc389a2c700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 0x7fc384107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 -- 172.21.15.96:0/1202348795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 msgr2=0x7fc384107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 0x7fc384107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 -- 172.21.15.96:0/1202348795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374005040 con 0x7fc3840f55c0 2022-02-02T19:29:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc389a2c700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 0x7fc384107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:29:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38a22d700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fc380002700 tx=0x7fc380009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc380009320 con 0x7fc3840f55c0 2022-02-02T19:29:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc38000f040 con 0x7fc3840f55c0 2022-02-02T19:29:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3841084f0 con 0x7fc3840f55c0 2022-02-02T19:29:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.308+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc380014900 con 0x7fc3840f55c0 2022-02-02T19:29:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.309+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc384108ab0 con 0x7fc3840f55c0 2022-02-02T19:29:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.309+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc384045ad0 con 0x7fc3840f55c0 2022-02-02T19:29:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.310+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc380009480 con 0x7fc3840f55c0 2022-02-02T19:29:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.310+0000 7fc37affd700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 0x7fc370067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.310+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc380081c40 con 0x7fc3840f55c0 2022-02-02T19:29:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.310+0000 7fc389a2c700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 0x7fc370067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.311+0000 7fc389a2c700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 0x7fc370067360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fc374004630 tx=0x7fc374009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.314+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc380053860 con 0x7fc3840f55c0 2022-02-02T19:29:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.489+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3840faca0 con 0x7fc370064ea0 2022-02-02T19:29:23.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.499+0000 7fc37affd700 1 -- 172.21.15.96:0/1202348795 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc3840faca0 con 0x7fc370064ea0 2022-02-02T19:29:23.505 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:29:23.505 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (72m) 43m ago 73m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:29:23.505 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (65m) 43m ago 73m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:29:23.505 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (65m) 41m ago 73m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:29:23.506 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (72m) 43m ago 73m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:29:23.506 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (69m) 43m ago 69m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:29:23.506 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (65m) 43m ago 69m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:29:23.506 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (69m) 41m ago 69m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:29:23.507 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (65m) 41m ago 69m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:29:23.507 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (67m) 43m ago 74m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:29:23.507 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (66m) 41m ago 73m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:29:23.507 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (66m) 43m ago 75m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:29:23.508 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (65m) 41m ago 73m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:29:23.508 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (73m) 43m ago 73m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:29:23.508 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (73m) 41m ago 73m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:29:23.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (64m) 43m ago 72m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:29:23.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (64m) 43m ago 72m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:29:23.509 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (63m) 43m ago 72m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:29:23.509 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (63m) 41m ago 71m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:29:23.509 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (62m) 41m ago 71m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:29:23.509 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (62m) 41m ago 71m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:29:23.510 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (72m) 43m ago 73m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:29:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 msgr2=0x7fc370067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 0x7fc370067360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fc374004630 tx=0x7fc374009b30).stop 2022-02-02T19:29:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 msgr2=0x7fc384106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fc380002700 tx=0x7fc380009d80).stop 2022-02-02T19:29:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 shutdown_connections 2022-02-02T19:29:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc370064ea0 0x7fc370067360 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3840f55c0 0x7fc384106f70 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 --2- 172.21.15.96:0/1202348795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3840f6860 0x7fc384107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 >> 172.21.15.96:0/1202348795 conn(0x7fc3840f0d40 msgr2=0x7fc38405fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 shutdown_connections 2022-02-02T19:29:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.501+0000 7fc38c491700 1 -- 172.21.15.96:0/1202348795 wait complete. 2022-02-02T19:29:23.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 -- 172.21.15.96:0/3202850099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 msgr2=0x7fee940f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 --2- 172.21.15.96:0/3202850099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee940f6b00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fee84004660 tx=0x7fee84009b30).stop 2022-02-02T19:29:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 -- 172.21.15.96:0/3202850099 shutdown_connections 2022-02-02T19:29:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 --2- 172.21.15.96:0/3202850099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 0x7fee940f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 --2- 172.21.15.96:0/3202850099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee940f6b00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 -- 172.21.15.96:0/3202850099 >> 172.21.15.96:0/3202850099 conn(0x7fee940f1e40 msgr2=0x7fee940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 -- 172.21.15.96:0/3202850099 shutdown_connections 2022-02-02T19:29:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 -- 172.21.15.96:0/3202850099 wait complete. 2022-02-02T19:29:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.598+0000 7fee9ba73700 1 Processor -- start 2022-02-02T19:29:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9ba73700 1 -- start start 2022-02-02T19:29:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9ba73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9ba73700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 0x7fee94107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9ba73700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94107a10 con 0x7fee940f66e0 2022-02-02T19:29:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9ba73700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94107b50 con 0x7fee940f7980 2022-02-02T19:29:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60040/0 (socket says 172.21.15.96:60040) 2022-02-02T19:29:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 -- 172.21.15.96:0/4240996267 learned_addr learned my addr 172.21.15.96:0/4240996267 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9900e700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 0x7fee94107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 -- 172.21.15.96:0/4240996267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 msgr2=0x7fee94107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 0x7fee94107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 -- 172.21.15.96:0/4240996267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84005040 con 0x7fee940f66e0 2022-02-02T19:29:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.599+0000 7fee9980f700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fee84004f60 tx=0x7fee84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.600+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee84018070 con 0x7fee940f66e0 2022-02-02T19:29:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.600+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee84009770 con 0x7fee940f66e0 2022-02-02T19:29:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.600+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94108490 con 0x7fee940f66e0 2022-02-02T19:29:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.600+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee941089f0 con 0x7fee940f66e0 2022-02-02T19:29:23.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.600+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8401c3c0 con 0x7fee940f66e0 2022-02-02T19:29:23.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.601+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c004fa0 con 0x7fee940f66e0 2022-02-02T19:29:23.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.601+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee8401c630 con 0x7fee940f66e0 2022-02-02T19:29:23.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.601+0000 7fee8a7fc700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 0x7fee80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.601+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee840837d0 con 0x7fee940f66e0 2022-02-02T19:29:23.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.601+0000 7fee9900e700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 0x7fee80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.602+0000 7fee9900e700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 0x7fee80067290 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fee90007fd0 tx=0x7fee90009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.606+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee840552b0 con 0x7fee940f66e0 2022-02-02T19:29:23.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.838+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee7c005e80 con 0x7fee940f66e0 2022-02-02T19:29:23.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.838+0000 7fee8a7fc700 1 -- 172.21.15.96:0/4240996267 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fee84054ea0 con 0x7fee940f66e0 2022-02-02T19:29:23.845 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:29:23.845 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:29:23.845 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:29:23.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:23.846 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:29:23.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:29:23.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:23.846 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:29:23.847 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:29:23.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:23.847 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:29:23.847 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:29:23.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:23.848 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:29:23.848 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:29:23.848 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:29:23.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:29:23.849 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:29:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 msgr2=0x7fee80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 0x7fee80067290 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fee90007fd0 tx=0x7fee90009040).stop 2022-02-02T19:29:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 msgr2=0x7fee94106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fee84004f60 tx=0x7fee84009b30).stop 2022-02-02T19:29:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 shutdown_connections 2022-02-02T19:29:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee80064dd0 0x7fee80067290 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee940f66e0 0x7fee94106f70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 --2- 172.21.15.96:0/4240996267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee940f7980 0x7fee94107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 >> 172.21.15.96:0/4240996267 conn(0x7fee940f1e40 msgr2=0x7fee940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 shutdown_connections 2022-02-02T19:29:23.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.841+0000 7fee9ba73700 1 -- 172.21.15.96:0/4240996267 wait complete. 2022-02-02T19:29:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 -- 172.21.15.96:0/3112028864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f66e0 msgr2=0x7f72d80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 --2- 172.21.15.96:0/3112028864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f66e0 0x7f72d80f6b00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f72cc004660 tx=0x7f72cc009b30).stop 2022-02-02T19:29:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 -- 172.21.15.96:0/3112028864 shutdown_connections 2022-02-02T19:29:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 --2- 172.21.15.96:0/3112028864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f7980 0x7f72d80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 --2- 172.21.15.96:0/3112028864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f66e0 0x7f72d80f6b00 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 -- 172.21.15.96:0/3112028864 >> 172.21.15.96:0/3112028864 conn(0x7f72d80f1e40 msgr2=0x7f72d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 -- 172.21.15.96:0/3112028864 shutdown_connections 2022-02-02T19:29:23.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.939+0000 7f72dd79c700 1 -- 172.21.15.96:0/3112028864 wait complete. 2022-02-02T19:29:23.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 Processor -- start 2022-02-02T19:29:23.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 -- start start 2022-02-02T19:29:23.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f66e0 0x7f72d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d806a380 con 0x7f72d80f7980 2022-02-02T19:29:23.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72dd79c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d806a4c0 con 0x7f72d80f66e0 2022-02-02T19:29:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60050/0 (socket says 172.21.15.96:60050) 2022-02-02T19:29:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 -- 172.21.15.96:0/1899425090 learned_addr learned my addr 172.21.15.96:0/1899425090 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d6ffd700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f66e0 0x7f72d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 -- 172.21.15.96:0/1899425090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f66e0 msgr2=0x7f72d806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f66e0 0x7f72d806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 -- 172.21.15.96:0/1899425090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc005040 con 0x7f72d80f7980 2022-02-02T19:29:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.940+0000 7f72d67fc700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f72c80026d0 tx=0x7f72c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.941+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c80079c0 con 0x7f72d80f7980 2022-02-02T19:29:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.941+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72c800f040 con 0x7f72d80f7980 2022-02-02T19:29:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.941+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d806a7a0 con 0x7f72d80f7980 2022-02-02T19:29:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.941+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c80148b0 con 0x7f72d80f7980 2022-02-02T19:29:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.941+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d810efe0 con 0x7f72d80f7980 2022-02-02T19:29:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.942+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d8045ad0 con 0x7f72d80f7980 2022-02-02T19:29:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.942+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72c8007b20 con 0x7f72d80f7980 2022-02-02T19:29:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.942+0000 7f72bf7fe700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 0x7f72c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.943+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f72c8081950 con 0x7f72d80f7980 2022-02-02T19:29:23.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.943+0000 7f72d6ffd700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 0x7f72c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:23.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.943+0000 7f72d6ffd700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 0x7f72c0067290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f72cc013690 tx=0x7f72cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:23.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:23.947+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72c804fa00 con 0x7f72d80f7980 2022-02-02T19:29:24.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.147+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72d80586e0 con 0x7f72d80f7980 2022-02-02T19:29:24.154 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4240996267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:29:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.148+0000 7f72bf7fe700 1 -- 172.21.15.96:0/1899425090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f72c8053020 con 0x7f72d80f7980 2022-02-02T19:29:24.155 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:29:24.155 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:29:24.156 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:29:24.156 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:29:24.157 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:24.157 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:29:24.158 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:29:24.158 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:29:24.159 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:29:24.159 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:29:24.160 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:29:24.160 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:29:24.161 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:29:24.161 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:29:24.162 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:29:24.162 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:29:24.163 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:29:24.163 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:29:24.163 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:29:24.164 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:29:24.164 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:29:24.165 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:29:24.165 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:29:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:29:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:29:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:29:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:29:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:29:24.168 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:29:24.168 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:29:24.169 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:29:24.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:29:24.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:24.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:24.171 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:29:24.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:24.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:24.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:24.173 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:24.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 msgr2=0x7f72c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:24.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 0x7f72c0067290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f72cc013690 tx=0x7f72cc009b30).stop 2022-02-02T19:29:24.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 msgr2=0x7f72d8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:24.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f72c80026d0 tx=0x7f72c8009de0).stop 2022-02-02T19:29:24.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 shutdown_connections 2022-02-02T19:29:24.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72c0064dd0 0x7f72c0067290 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:24.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72d80f66e0 0x7f72d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:24.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 --2- 172.21.15.96:0/1899425090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72d80f7980 0x7f72d8069e20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:24.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 >> 172.21.15.96:0/1899425090 conn(0x7f72d80f1e40 msgr2=0x7f72d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:24.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 shutdown_connections 2022-02-02T19:29:24.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:24.150+0000 7f72dd79c700 1 -- 172.21.15.96:0/1899425090 wait complete. 2022-02-02T19:29:24.180 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:29:24.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4240996267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:29:25.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:24 smithi159 ceph-mon[69013]: from='client.36186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:25.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:24 smithi159 ceph-mon[69013]: from='client.36190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:25.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:24 smithi159 ceph-mon[69013]: pgmap v2018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:25.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1899425090' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:29:25.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:24 smithi096 ceph-mon[101353]: from='client.36186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:25.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:24 smithi096 ceph-mon[101353]: from='client.36190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:25.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:24 smithi096 ceph-mon[101353]: pgmap v2018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:25.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1899425090' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:29:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:26 smithi159 ceph-mon[69013]: pgmap v2019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:26 smithi096 ceph-mon[101353]: pgmap v2019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:29:28.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:29:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:29:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:29:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:28 smithi159 ceph-mon[69013]: pgmap v2020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:28 smithi096 ceph-mon[101353]: pgmap v2020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:30 smithi159 ceph-mon[69013]: pgmap v2021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:30 smithi096 ceph-mon[101353]: pgmap v2021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:32 smithi159 ceph-mon[69013]: pgmap v2022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:32.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:32 smithi096 ceph-mon[101353]: pgmap v2022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:34 smithi159 ceph-mon[69013]: pgmap v2023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:34 smithi096 ceph-mon[101353]: pgmap v2023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:36 smithi159 ceph-mon[69013]: pgmap v2024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:36 smithi096 ceph-mon[101353]: pgmap v2024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:38 smithi159 ceph-mon[69013]: pgmap v2025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:38 smithi096 ceph-mon[101353]: pgmap v2025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:40 smithi159 ceph-mon[69013]: pgmap v2026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:40 smithi096 ceph-mon[101353]: pgmap v2026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:42 smithi159 ceph-mon[69013]: pgmap v2027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:42 smithi096 ceph-mon[101353]: pgmap v2027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:44 smithi159 ceph-mon[69013]: pgmap v2028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:44 smithi096 ceph-mon[101353]: pgmap v2028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:46 smithi159 ceph-mon[69013]: pgmap v2029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:46 smithi096 ceph-mon[101353]: pgmap v2029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:48 smithi159 ceph-mon[69013]: pgmap v2030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:48 smithi096 ceph-mon[101353]: pgmap v2030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:50 smithi159 ceph-mon[69013]: pgmap v2031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:50 smithi096 ceph-mon[101353]: pgmap v2031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:52 smithi159 ceph-mon[69013]: pgmap v2032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:52 smithi096 ceph-mon[101353]: pgmap v2032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:54.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.261+0000 7f9544c11700 1 -- 172.21.15.96:0/1019518695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 msgr2=0x7f95400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.261+0000 7f9544c11700 1 --2- 172.21.15.96:0/1019518695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f95400f6b00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f9530004660 tx=0x7f9530009b30).stop 2022-02-02T19:29:54.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.261+0000 7f9544c11700 1 -- 172.21.15.96:0/1019518695 shutdown_connections 2022-02-02T19:29:54.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 --2- 172.21.15.96:0/1019518695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 0x7f95400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 --2- 172.21.15.96:0/1019518695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f95400f6b00 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 -- 172.21.15.96:0/1019518695 >> 172.21.15.96:0/1019518695 conn(0x7f95400f1e40 msgr2=0x7f95400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:54.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 -- 172.21.15.96:0/1019518695 shutdown_connections 2022-02-02T19:29:54.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 -- 172.21.15.96:0/1019518695 wait complete. 2022-02-02T19:29:54.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 Processor -- start 2022-02-02T19:29:54.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.262+0000 7f9544c11700 1 -- start start 2022-02-02T19:29:54.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f9544c11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f9544c11700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 0x7f95401074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f9544c11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540107a50 con 0x7f95400f66e0 2022-02-02T19:29:54.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f9544c11700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540107b90 con 0x7f95400f7980 2022-02-02T19:29:54.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60066/0 (socket says 172.21.15.96:60066) 2022-02-02T19:29:54.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 -- 172.21.15.96:0/3667206869 learned_addr learned my addr 172.21.15.96:0/3667206869 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 0x7f95401074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 -- 172.21.15.96:0/3667206869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 msgr2=0x7f95401074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 0x7f95401074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 -- 172.21.15.96:0/3667206869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530005040 con 0x7f95400f66e0 2022-02-02T19:29:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f953e59c700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f9530004f60 tx=0x7f9530009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9530018070 con 0x7f95400f66e0 2022-02-02T19:29:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9530007ba0 con 0x7f95400f66e0 2022-02-02T19:29:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95401084d0 con 0x7f95400f66e0 2022-02-02T19:29:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.263+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953001c620 con 0x7f95400f66e0 2022-02-02T19:29:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.264+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9540108a30 con 0x7f95400f66e0 2022-02-02T19:29:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.264+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540045ad0 con 0x7f95400f66e0 2022-02-02T19:29:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.265+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f953001c8e0 con 0x7f95400f66e0 2022-02-02T19:29:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.265+0000 7f952effd700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 0x7f9528067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.266+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9530083990 con 0x7f95400f66e0 2022-02-02T19:29:54.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.266+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 0x7f9528067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.266+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 0x7f9528067290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f95340041d0 tx=0x7f9534009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.270+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9530055470 con 0x7f95400f66e0 2022-02-02T19:29:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.448+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95400fefe0 con 0x7f9528064dd0 2022-02-02T19:29:54.455 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:54 smithi096 ceph-mon[101353]: pgmap v2033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.449+0000 7f952effd700 1 -- 172.21.15.96:0/3667206869 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f95400fefe0 con 0x7f9528064dd0 2022-02-02T19:29:54.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 msgr2=0x7f9528067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 0x7f9528067290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f95340041d0 tx=0x7f9534009040).stop 2022-02-02T19:29:54.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 msgr2=0x7f9540106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f9530004f60 tx=0x7f9530009b30).stop 2022-02-02T19:29:54.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 shutdown_connections 2022-02-02T19:29:54.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9528064dd0 0x7f9528067290 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f66e0 0x7f9540106fb0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 --2- 172.21.15.96:0/3667206869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f7980 0x7f95401074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.451+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 >> 172.21.15.96:0/3667206869 conn(0x7f95400f1e40 msgr2=0x7f95400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:54.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.452+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 shutdown_connections 2022-02-02T19:29:54.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.452+0000 7f9544c11700 1 -- 172.21.15.96:0/3667206869 wait complete. 2022-02-02T19:29:54.467 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:29:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:54 smithi159 ceph-mon[69013]: pgmap v2033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 -- 172.21.15.96:0/3468173996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 msgr2=0x7f1e080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/3468173996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e080f59e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f1df8004660 tx=0x7f1df8009b30).stop 2022-02-02T19:29:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 -- 172.21.15.96:0/3468173996 shutdown_connections 2022-02-02T19:29:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/3468173996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/3468173996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e080f59e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 -- 172.21.15.96:0/3468173996 >> 172.21.15.96:0/3468173996 conn(0x7f1e080f0d40 msgr2=0x7f1e080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 -- 172.21.15.96:0/3468173996 shutdown_connections 2022-02-02T19:29:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.549+0000 7f1e0e72d700 1 -- 172.21.15.96:0/3468173996 wait complete. 2022-02-02T19:29:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 Processor -- start 2022-02-02T19:29:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 -- start start 2022-02-02T19:29:54.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e08106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08106910 con 0x7f1e080f55c0 2022-02-02T19:29:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e0e72d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08106a50 con 0x7f1e080f6860 2022-02-02T19:29:54.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60076/0 (socket says 172.21.15.96:60076) 2022-02-02T19:29:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e07fff700 1 -- 172.21.15.96:0/830600771 learned_addr learned my addr 172.21.15.96:0/830600771 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:54.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e077fe700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e08106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e07fff700 1 -- 172.21.15.96:0/830600771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 msgr2=0x7f1e08106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.550+0000 7f1e07fff700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e08106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e07fff700 1 -- 172.21.15.96:0/830600771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8005040 con 0x7f1e080f55c0 2022-02-02T19:29:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e077fe700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e08106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:29:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e07fff700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f1df8013a70 tx=0x7f1df8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df8018070 con 0x7f1e080f55c0 2022-02-02T19:29:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e08107390 con 0x7f1e080f55c0 2022-02-02T19:29:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1df80097d0 con 0x7f1e080f55c0 2022-02-02T19:29:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e081078f0 con 0x7f1e080f55c0 2022-02-02T19:29:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.551+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df801c3c0 con 0x7f1e080f55c0 2022-02-02T19:29:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.552+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8004fa0 con 0x7f1e080f55c0 2022-02-02T19:29:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.552+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1df8007ba0 con 0x7f1e080f55c0 2022-02-02T19:29:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.553+0000 7f1e04ff9700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 0x7f1df00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.553+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1df80836f0 con 0x7f1e080f55c0 2022-02-02T19:29:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.553+0000 7f1e077fe700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 0x7f1df00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.553+0000 7f1e077fe700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 0x7f1df00694a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1dfc009fd0 tx=0x7f1dfc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.557+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1df8055290 con 0x7f1e080f55c0 2022-02-02T19:29:54.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.727+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1de8000bc0 con 0x7f1df0066fe0 2022-02-02T19:29:54.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.737+0000 7f1e04ff9700 1 -- 172.21.15.96:0/830600771 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1de8000bc0 con 0x7f1df0066fe0 2022-02-02T19:29:54.743 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:29:54.743 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (73m) 43m ago 74m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:29:54.743 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (65m) 43m ago 74m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:29:54.744 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (65m) 42m ago 73m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:29:54.744 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (73m) 43m ago 74m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:29:54.744 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (70m) 43m ago 70m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:29:54.744 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (66m) 43m ago 70m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:29:54.745 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (70m) 42m ago 70m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:29:54.745 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (66m) 42m ago 70m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:29:54.745 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (67m) 43m ago 75m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:29:54.745 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (67m) 42m ago 73m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:29:54.745 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (66m) 43m ago 75m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:29:54.746 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (66m) 42m ago 73m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:29:54.746 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (74m) 43m ago 74m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:29:54.746 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (73m) 42m ago 73m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:29:54.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (65m) 43m ago 73m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:29:54.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (64m) 43m ago 72m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:29:54.747 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (64m) 43m ago 72m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:29:54.747 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (63m) 42m ago 72m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:29:54.747 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (63m) 42m ago 71m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:29:54.747 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (62m) 42m ago 71m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:29:54.747 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (73m) 43m ago 73m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:29:54.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 msgr2=0x7f1df00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 0x7f1df00694a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1dfc009fd0 tx=0x7f1dfc00b040).stop 2022-02-02T19:29:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 msgr2=0x7f1e08105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f1df8013a70 tx=0x7f1df8009b30).stop 2022-02-02T19:29:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 shutdown_connections 2022-02-02T19:29:54.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1df0066fe0 0x7f1df00694a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e080f55c0 0x7f1e08105e70 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 --2- 172.21.15.96:0/830600771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e080f6860 0x7f1e08106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 >> 172.21.15.96:0/830600771 conn(0x7f1e080f0d40 msgr2=0x7f1e080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:54.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 shutdown_connections 2022-02-02T19:29:54.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.739+0000 7f1e0e72d700 1 -- 172.21.15.96:0/830600771 wait complete. 2022-02-02T19:29:54.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2022462276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 msgr2=0x7f2b9c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2022462276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c0f5850 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f2b8c004660 tx=0x7f2b8c009b30).stop 2022-02-02T19:29:54.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2022462276 shutdown_connections 2022-02-02T19:29:54.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2022462276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b9c0f66d0 0x7f2b9c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2022462276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c0f5850 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:54.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.835+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2022462276 >> 172.21.15.96:0/2022462276 conn(0x7f2b9c0f0b90 msgr2=0x7f2b9c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:54.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2022462276 shutdown_connections 2022-02-02T19:29:54.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2022462276 wait complete. 2022-02-02T19:29:54.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 Processor -- start 2022-02-02T19:29:54.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 -- start start 2022-02-02T19:29:54.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b9c0f66d0 0x7f2b9c10e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0602b0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0603f0 con 0x7f2b9c0f66d0 2022-02-02T19:29:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60084/0 (socket says 172.21.15.96:60084) 2022-02-02T19:29:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.836+0000 7f2b9a59c700 1 -- 172.21.15.96:0/2470998375 learned_addr learned my addr 172.21.15.96:0/2470998375 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9a59c700 1 -- 172.21.15.96:0/2470998375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b9c0f66d0 msgr2=0x7f2b9c10e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9a59c700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b9c0f66d0 0x7f2b9c10e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:29:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9a59c700 1 -- 172.21.15.96:0/2470998375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c005040 con 0x7f2b9c0f5430 2022-02-02T19:29:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9a59c700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f2b8c013a70 tx=0x7f2b8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8c018070 con 0x7f2b9c0f5430 2022-02-02T19:29:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b8c0097d0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8c01c3c0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c10e8a0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.837+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c10ec70 con 0x7f2b9c0f5430 2022-02-02T19:29:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.838+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c045ad0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.838+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b8c007ba0 con 0x7f2b9c0f5430 2022-02-02T19:29:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.839+0000 7f2b8affd700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 0x7f2b840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:54.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.839+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2b8c083770 con 0x7f2b9c0f5430 2022-02-02T19:29:54.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.839+0000 7f2b99d9b700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 0x7f2b840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:54.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.839+0000 7f2b99d9b700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 0x7f2b840672e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2b90004a10 tx=0x7f2b900099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:54.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:54.843+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b8c051820 con 0x7f2b9c0f5430 2022-02-02T19:29:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.078+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b9c027a00 con 0x7f2b9c0f5430 2022-02-02T19:29:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.078+0000 7f2b8affd700 1 -- 172.21.15.96:0/2470998375 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2b8c051030 con 0x7f2b9c0f5430 2022-02-02T19:29:55.085 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:29:55.085 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:29:55.085 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:29:55.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:55.086 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:29:55.086 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:29:55.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:55.087 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:29:55.087 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:29:55.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:55.087 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:29:55.088 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:29:55.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:29:55.088 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:29:55.088 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:29:55.088 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:29:55.089 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:29:55.089 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:29:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 msgr2=0x7f2b840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 0x7f2b840672e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2b90004a10 tx=0x7f2b900099e0).stop 2022-02-02T19:29:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 msgr2=0x7f2b9c10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f2b8c013a70 tx=0x7f2b8c009b30).stop 2022-02-02T19:29:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 shutdown_connections 2022-02-02T19:29:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b84064e20 0x7f2b840672e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b9c0f5430 0x7f2b9c10beb0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 --2- 172.21.15.96:0/2470998375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b9c0f66d0 0x7f2b9c10e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:29:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 >> 172.21.15.96:0/2470998375 conn(0x7f2b9c0f0b90 msgr2=0x7f2b9c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 shutdown_connections 2022-02-02T19:29:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.080+0000 7f2b9b59e700 1 -- 172.21.15.96:0/2470998375 wait complete. 2022-02-02T19:29:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 -- 172.21.15.96:0/2863818514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 msgr2=0x7f4bf00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 --2- 172.21.15.96:0/2863818514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf00f7de0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f4be0004660 tx=0x7f4be0009b30).stop 2022-02-02T19:29:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 -- 172.21.15.96:0/2863818514 shutdown_connections 2022-02-02T19:29:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 --2- 172.21.15.96:0/2863818514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf00f7de0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 --2- 172.21.15.96:0/2863818514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 0x7f4bf00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 -- 172.21.15.96:0/2863818514 >> 172.21.15.96:0/2863818514 conn(0x7f4bf00f1e40 msgr2=0x7f4bf00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 -- 172.21.15.96:0/2863818514 shutdown_connections 2022-02-02T19:29:55.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.179+0000 7f4bf5773700 1 -- 172.21.15.96:0/2863818514 wait complete. 2022-02-02T19:29:55.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 Processor -- start 2022-02-02T19:29:55.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 -- start start 2022-02-02T19:29:55.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 0x7f4bf0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:55.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:55.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0107a00 con 0x7f4bf00f7980 2022-02-02T19:29:55.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bf5773700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0107b40 con 0x7f4bf00f66e0 2022-02-02T19:29:55.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:55.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60096/0 (socket says 172.21.15.96:60096) 2022-02-02T19:29:55.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 -- 172.21.15.96:0/956573711 learned_addr learned my addr 172.21.15.96:0/956573711 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:29:55.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4beeffd700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 0x7f4bf0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:55.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 -- 172.21.15.96:0/956573711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 msgr2=0x7f4bf0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 0x7f4bf0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.180+0000 7f4bee7fc700 1 -- 172.21.15.96:0/956573711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0005040 con 0x7f4bf00f7980 2022-02-02T19:29:55.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bee7fc700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f4be0009990 tx=0x7f4be0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:55.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be0018070 con 0x7f4bf00f7980 2022-02-02T19:29:55.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4be0007ba0 con 0x7f4bf00f7980 2022-02-02T19:29:55.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf0108480 con 0x7f4bf00f7980 2022-02-02T19:29:55.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be001c3c0 con 0x7f4bf00f7980 2022-02-02T19:29:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.181+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf01089e0 con 0x7f4bf00f7980 2022-02-02T19:29:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.182+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf0045ad0 con 0x7f4bf00f7980 2022-02-02T19:29:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.182+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4be001d420 con 0x7f4bf00f7980 2022-02-02T19:29:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.183+0000 7f4bd77fe700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 0x7f4bd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:29:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.183+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4be00836d0 con 0x7f4bf00f7980 2022-02-02T19:29:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.183+0000 7f4beeffd700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 0x7f4bd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:29:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.183+0000 7f4beeffd700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 0x7f4bd8067290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f4bf00f77e0 tx=0x7f4be4009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:29:55.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.187+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4be0055150 con 0x7f4bf00f7980 2022-02-02T19:29:55.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.388+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4bf0027a00 con 0x7f4bf00f7980 2022-02-02T19:29:55.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:55 smithi096 ceph-mon[101353]: from='client.36202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:55.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:55 smithi096 ceph-mon[101353]: from='client.36206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:55.395 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2470998375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:29:55.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.389+0000 7f4bd77fe700 1 -- 172.21.15.96:0/956573711 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4be0054d40 con 0x7f4bf00f7980 2022-02-02T19:29:55.396 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:29:55.397 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:29:55.397 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:29:55.397 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:29:55.397 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:55.398 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:29:55.398 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:29:55.398 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:29:55.398 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:29:55.399 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:29:55.399 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:29:55.399 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:29:55.399 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:29:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:29:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:29:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:29:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:29:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:29:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:29:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:29:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:29:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:29:55.402 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:29:55.402 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:29:55.402 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:29:55.402 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:29:55.402 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:29:55.403 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:29:55.403 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:29:55.403 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:29:55.403 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:29:55.404 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:29:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:55.404 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:29:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:29:55.405 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:55.405 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:55.405 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:29:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 msgr2=0x7f4bd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 0x7f4bd8067290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f4bf00f77e0 tx=0x7f4be4009c00).stop 2022-02-02T19:29:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 msgr2=0x7f4bf0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:29:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f4be0009990 tx=0x7f4be0009b30).stop 2022-02-02T19:29:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 shutdown_connections 2022-02-02T19:29:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bd8064dd0 0x7f4bd8067290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bf00f66e0 0x7f4bf0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 --2- 172.21.15.96:0/956573711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bf00f7980 0x7f4bf0107450 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:29:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 >> 172.21.15.96:0/956573711 conn(0x7f4bf00f1e40 msgr2=0x7f4bf00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:29:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 shutdown_connections 2022-02-02T19:29:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:29:55.391+0000 7f4bf5773700 1 -- 172.21.15.96:0/956573711 wait complete. 2022-02-02T19:29:55.409 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:29:55.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:55 smithi159 ceph-mon[69013]: from='client.36202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:55.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:55 smithi159 ceph-mon[69013]: from='client.36206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:29:55.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2470998375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:29:56.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/956573711' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:29:56.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:56 smithi159 ceph-mon[69013]: pgmap v2034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:56.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/956573711' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:29:56.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:56 smithi096 ceph-mon[101353]: pgmap v2034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:29:58 smithi159 ceph-mon[69013]: pgmap v2035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:29:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:29:58 smithi096 ceph-mon[101353]: pgmap v2035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:00.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:30:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:30:01.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:01 smithi096 ceph-mon[101353]: pgmap v2036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:01.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:01 smithi159 ceph-mon[69013]: pgmap v2036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:03.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:03 smithi159 ceph-mon[69013]: pgmap v2037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:03 smithi096 ceph-mon[101353]: pgmap v2037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:04 smithi159 ceph-mon[69013]: pgmap v2038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:04 smithi096 ceph-mon[101353]: pgmap v2038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:06 smithi159 ceph-mon[69013]: pgmap v2039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:06 smithi096 ceph-mon[101353]: pgmap v2039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:08 smithi159 ceph-mon[69013]: pgmap v2040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:08 smithi096 ceph-mon[101353]: pgmap v2040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:10 smithi159 ceph-mon[69013]: pgmap v2041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:10 smithi096 ceph-mon[101353]: pgmap v2041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:12 smithi159 ceph-mon[69013]: pgmap v2042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:12 smithi096 ceph-mon[101353]: pgmap v2042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:14 smithi159 ceph-mon[69013]: pgmap v2043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:14 smithi096 ceph-mon[101353]: pgmap v2043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:17.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:16 smithi159 ceph-mon[69013]: pgmap v2044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:16 smithi096 ceph-mon[101353]: pgmap v2044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:18 smithi159 ceph-mon[69013]: pgmap v2045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:18 smithi096 ceph-mon[101353]: pgmap v2045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:20 smithi159 ceph-mon[69013]: pgmap v2046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:20 smithi096 ceph-mon[101353]: pgmap v2046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:22 smithi159 ceph-mon[69013]: pgmap v2047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:22.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:22 smithi096 ceph-mon[101353]: pgmap v2047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:24.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:24 smithi096 ceph-mon[101353]: pgmap v2048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:24 smithi159 ceph-mon[69013]: pgmap v2048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:25.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2326923154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f55c0 msgr2=0x7f8a9c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2326923154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c0f59e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f8a90004660 tx=0x7f8a90009b30).stop 2022-02-02T19:30:25.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2326923154 shutdown_connections 2022-02-02T19:30:25.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2326923154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2326923154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c0f59e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2326923154 >> 172.21.15.96:0/2326923154 conn(0x7f8a9c0f0d20 msgr2=0x7f8a9c0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:25.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2326923154 shutdown_connections 2022-02-02T19:30:25.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2326923154 wait complete. 2022-02-02T19:30:25.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.502+0000 7f8aa1a23700 1 Processor -- start 2022-02-02T19:30:25.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8aa1a23700 1 -- start start 2022-02-02T19:30:25.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8aa1a23700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8aa1a23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8aa1a23700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c060540 con 0x7f8a9c0f6860 2022-02-02T19:30:25.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8aa1a23700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c060680 con 0x7f8a9c0f55c0 2022-02-02T19:30:25.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60114/0 (socket says 172.21.15.96:60114) 2022-02-02T19:30:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9affd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 -- 172.21.15.96:0/2650933177 learned_addr learned my addr 172.21.15.96:0/2650933177 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 -- 172.21.15.96:0/2650933177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 msgr2=0x7f8a9c109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c109cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9a7fc700 1 -- 172.21.15.96:0/2650933177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90005040 con 0x7f8a9c0f6860 2022-02-02T19:30:25.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.503+0000 7f8a9affd700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:30:25.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8a9a7fc700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f8a8c0026d0 tx=0x7f8a8c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:25.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c0079c0 con 0x7f8a9c0f6860 2022-02-02T19:30:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c10c770 con 0x7f8a9c0f6860 2022-02-02T19:30:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a8c00f040 con 0x7f8a9c0f6860 2022-02-02T19:30:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c0148b0 con 0x7f8a9c0f6860 2022-02-02T19:30:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.504+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c105b20 con 0x7f8a9c0f6860 2022-02-02T19:30:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.505+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c045ad0 con 0x7f8a9c0f6860 2022-02-02T19:30:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.505+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a8c007b20 con 0x7f8a9c0f6860 2022-02-02T19:30:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.506+0000 7f8a837fe700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 0x7f8a8406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.506+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8a8c081a30 con 0x7f8a9c0f6860 2022-02-02T19:30:25.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.506+0000 7f8a9affd700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 0x7f8a8406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.506+0000 7f8a9affd700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 0x7f8a8406b6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f8a90013690 tx=0x7f8a90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:25.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.510+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a8c04fae0 con 0x7f8a9c0f6860 2022-02-02T19:30:25.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.687+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a9c057f10 con 0x7f8a840691e0 2022-02-02T19:30:25.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.688+0000 7f8a837fe700 1 -- 172.21.15.96:0/2650933177 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8a9c057f10 con 0x7f8a840691e0 2022-02-02T19:30:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 msgr2=0x7f8a8406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 0x7f8a8406b6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f8a90013690 tx=0x7f8a90009b30).stop 2022-02-02T19:30:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 msgr2=0x7f8a9c10c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f8a8c0026d0 tx=0x7f8a8c009de0).stop 2022-02-02T19:30:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 shutdown_connections 2022-02-02T19:30:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a840691e0 0x7f8a8406b6a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a9c0f55c0 0x7f8a9c109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 --2- 172.21.15.96:0/2650933177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a9c0f6860 0x7f8a9c10c1c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 >> 172.21.15.96:0/2650933177 conn(0x7f8a9c0f0d20 msgr2=0x7f8a9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 shutdown_connections 2022-02-02T19:30:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.690+0000 7f8aa1a23700 1 -- 172.21.15.96:0/2650933177 wait complete. 2022-02-02T19:30:25.706 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:30:25.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.787+0000 7f273936f700 1 -- 172.21.15.96:0/410681100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 msgr2=0x7f27340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.787+0000 7f273936f700 1 --2- 172.21.15.96:0/410681100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f27340f6cc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f2724004660 tx=0x7f2724009b30).stop 2022-02-02T19:30:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 -- 172.21.15.96:0/410681100 shutdown_connections 2022-02-02T19:30:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 --2- 172.21.15.96:0/410681100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f27340f6cc0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 --2- 172.21.15.96:0/410681100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 0x7f27340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 -- 172.21.15.96:0/410681100 >> 172.21.15.96:0/410681100 conn(0x7f27340f0d40 msgr2=0x7f27340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 -- 172.21.15.96:0/410681100 shutdown_connections 2022-02-02T19:30:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 -- 172.21.15.96:0/410681100 wait complete. 2022-02-02T19:30:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.788+0000 7f273936f700 1 Processor -- start 2022-02-02T19:30:25.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f273936f700 1 -- start start 2022-02-02T19:30:25.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f273936f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 0x7f2734109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f273936f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f273936f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340603e0 con 0x7f27340f6860 2022-02-02T19:30:25.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f273936f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734060520 con 0x7f27340f55c0 2022-02-02T19:30:25.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60124/0 (socket says 172.21.15.96:60124) 2022-02-02T19:30:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f2732ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 0x7f2734109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 -- 172.21.15.96:0/706215980 learned_addr learned my addr 172.21.15.96:0/706215980 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 -- 172.21.15.96:0/706215980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 msgr2=0x7f2734109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 0x7f2734109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 -- 172.21.15.96:0/706215980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724005040 con 0x7f27340f6860 2022-02-02T19:30:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.789+0000 7f27327fc700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f2724009990 tx=0x7f2724009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.790+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2724018070 con 0x7f27340f6860 2022-02-02T19:30:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.790+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2724007ba0 con 0x7f27340f6860 2022-02-02T19:30:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.790+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272401c3c0 con 0x7f27340f6860 2022-02-02T19:30:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.790+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273410c6a0 con 0x7f27340f6860 2022-02-02T19:30:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.790+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273410cc00 con 0x7f27340f6860 2022-02-02T19:30:25.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.791+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734045ad0 con 0x7f27340f6860 2022-02-02T19:30:25.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.791+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f272401d420 con 0x7f27340f6860 2022-02-02T19:30:25.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.792+0000 7f271b7fe700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 0x7f271c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:25.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.792+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2724083680 con 0x7f27340f6860 2022-02-02T19:30:25.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.792+0000 7f2732ffd700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 0x7f271c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:25.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.792+0000 7f2732ffd700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 0x7f271c067290 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2734060060 tx=0x7f272800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:25.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.796+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2724051730 con 0x7f27340f6860 2022-02-02T19:30:25.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.967+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2734057f10 con 0x7f271c064dd0 2022-02-02T19:30:25.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.977+0000 7f271b7fe700 1 -- 172.21.15.96:0/706215980 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2734057f10 con 0x7f271c064dd0 2022-02-02T19:30:25.983 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:30:25.983 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (73m) 44m ago 74m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:30:25.984 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (66m) 44m ago 74m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:30:25.984 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (66m) 42m ago 74m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:30:25.984 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (73m) 44m ago 74m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:30:25.984 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (70m) 44m ago 70m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:30:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (66m) 44m ago 70m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:30:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (70m) 42m ago 70m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:30:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (66m) 42m ago 71m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:30:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (68m) 44m ago 76m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:30:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (67m) 42m ago 74m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:30:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (67m) 44m ago 76m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:30:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (66m) 42m ago 74m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:30:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (74m) 44m ago 74m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:30:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (74m) 42m ago 74m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:30:25.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (65m) 44m ago 73m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:30:25.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (65m) 44m ago 73m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:30:25.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (64m) 44m ago 73m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:30:25.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (64m) 42m ago 72m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:30:25.988 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (63m) 42m ago 72m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:30:25.988 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (63m) 42m ago 72m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:30:25.988 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (73m) 44m ago 74m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:30:25.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.978+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 msgr2=0x7f271c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.978+0000 7f273936f700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 0x7f271c067290 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2734060060 tx=0x7f272800b040).stop 2022-02-02T19:30:25.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.978+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 msgr2=0x7f273410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:25.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.978+0000 7f273936f700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f2724009990 tx=0x7f2724009b30).stop 2022-02-02T19:30:25.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 shutdown_connections 2022-02-02T19:30:25.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f271c064dd0 0x7f271c067290 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27340f55c0 0x7f2734109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 --2- 172.21.15.96:0/706215980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27340f6860 0x7f273410c150 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:25.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 >> 172.21.15.96:0/706215980 conn(0x7f27340f0d40 msgr2=0x7f27340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:25.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 shutdown_connections 2022-02-02T19:30:25.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:25.979+0000 7f273936f700 1 -- 172.21.15.96:0/706215980 wait complete. 2022-02-02T19:30:26.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 -- 172.21.15.96:0/1292824616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 msgr2=0x7fbe380f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 --2- 172.21.15.96:0/1292824616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe380f5a00 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fbe28004660 tx=0x7fbe28009b30).stop 2022-02-02T19:30:26.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 -- 172.21.15.96:0/1292824616 shutdown_connections 2022-02-02T19:30:26.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 --2- 172.21.15.96:0/1292824616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 0x7fbe380f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 --2- 172.21.15.96:0/1292824616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe380f5a00 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 -- 172.21.15.96:0/1292824616 >> 172.21.15.96:0/1292824616 conn(0x7fbe380f0de0 msgr2=0x7fbe380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:26.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 -- 172.21.15.96:0/1292824616 shutdown_connections 2022-02-02T19:30:26.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.075+0000 7fbe3f378700 1 -- 172.21.15.96:0/1292824616 wait complete. 2022-02-02T19:30:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 Processor -- start 2022-02-02T19:30:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 -- start start 2022-02-02T19:30:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 0x7fbe3810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380604e0 con 0x7fbe380f55e0 2022-02-02T19:30:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3f378700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38060620 con 0x7fbe380f5ef0 2022-02-02T19:30:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60132/0 (socket says 172.21.15.96:60132) 2022-02-02T19:30:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 -- 172.21.15.96:0/2534611120 learned_addr learned my addr 172.21.15.96:0/2534611120 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3c913700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 0x7fbe3810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 -- 172.21.15.96:0/2534611120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 msgr2=0x7fbe3810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 0x7fbe3810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 -- 172.21.15.96:0/2534611120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28005040 con 0x7fbe380f55e0 2022-02-02T19:30:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe3d114700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fbe28009990 tx=0x7fbe28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.076+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe28018070 con 0x7fbe380f55e0 2022-02-02T19:30:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.077+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe28007ba0 con 0x7fbe380f55e0 2022-02-02T19:30:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.077+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3810c6e0 con 0x7fbe380f55e0 2022-02-02T19:30:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.077+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe2801c3c0 con 0x7fbe380f55e0 2022-02-02T19:30:26.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.077+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3810cc40 con 0x7fbe380f55e0 2022-02-02T19:30:26.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.078+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38045ad0 con 0x7fbe380f55e0 2022-02-02T19:30:26.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.079+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe2801d420 con 0x7fbe380f55e0 2022-02-02T19:30:26.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.079+0000 7fbe2dffb700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 0x7fbe24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.079+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbe280839a0 con 0x7fbe380f55e0 2022-02-02T19:30:26.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.079+0000 7fbe3c913700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 0x7fbe24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.079+0000 7fbe3c913700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 0x7fbe24067290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbe34004c40 tx=0x7fbe3400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:26.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.083+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe28051a50 con 0x7fbe380f55e0 2022-02-02T19:30:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.313+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe380fdea0 con 0x7fbe380f55e0 2022-02-02T19:30:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.313+0000 7fbe2dffb700 1 -- 172.21.15.96:0/2534611120 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbe28055070 con 0x7fbe380f55e0 2022-02-02T19:30:26.325 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:30:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:30:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:30:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:30:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:30:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:30:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:30:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:30:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:30:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:30:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:30:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:30:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:30:26.329 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:30:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 msgr2=0x7fbe24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 0x7fbe24067290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbe34004c40 tx=0x7fbe3400b040).stop 2022-02-02T19:30:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 msgr2=0x7fbe38109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fbe28009990 tx=0x7fbe28009b30).stop 2022-02-02T19:30:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 shutdown_connections 2022-02-02T19:30:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe24064dd0 0x7fbe24067290 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe380f55e0 0x7fbe38109c90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 --2- 172.21.15.96:0/2534611120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe380f5ef0 0x7fbe3810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 >> 172.21.15.96:0/2534611120 conn(0x7fbe380f0de0 msgr2=0x7fbe380fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 shutdown_connections 2022-02-02T19:30:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.316+0000 7fbe3f378700 1 -- 172.21.15.96:0/2534611120 wait complete. 2022-02-02T19:30:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 -- 172.21.15.96:0/2187714613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f7590 msgr2=0x7f374c0f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 --2- 172.21.15.96:0/2187714613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f7590 0x7f374c0f59b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f3734004660 tx=0x7f3734009b30).stop 2022-02-02T19:30:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 -- 172.21.15.96:0/2187714613 shutdown_connections 2022-02-02T19:30:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 --2- 172.21.15.96:0/2187714613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f7590 0x7f374c0f59b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 --2- 172.21.15.96:0/2187714613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 -- 172.21.15.96:0/2187714613 >> 172.21.15.96:0/2187714613 conn(0x7f374c0f04c0 msgr2=0x7f374c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 -- 172.21.15.96:0/2187714613 shutdown_connections 2022-02-02T19:30:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.414+0000 7f375233c700 1 -- 172.21.15.96:0/2187714613 wait complete. 2022-02-02T19:30:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 Processor -- start 2022-02-02T19:30:26.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 -- start start 2022-02-02T19:30:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 0x7f374c0f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0f8240 con 0x7f374c0f6bf0 2022-02-02T19:30:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f375233c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0f8380 con 0x7f374c0f7590 2022-02-02T19:30:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60142/0 (socket says 172.21.15.96:60142) 2022-02-02T19:30:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 -- 172.21.15.96:0/3731059943 learned_addr learned my addr 172.21.15.96:0/3731059943 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374b7fe700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 0x7f374c0f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 -- 172.21.15.96:0/3731059943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 msgr2=0x7f374c0f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 0x7f374c0f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374bfff700 1 -- 172.21.15.96:0/3731059943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734005040 con 0x7f374c0f6bf0 2022-02-02T19:30:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.415+0000 7f374b7fe700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 0x7f374c0f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:30:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f374bfff700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f373c002700 tx=0x7f373c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373c009320 con 0x7f374c0f6bf0 2022-02-02T19:30:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f373c00f040 con 0x7f374c0f6bf0 2022-02-02T19:30:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c0f8660 con 0x7f374c0f6bf0 2022-02-02T19:30:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373c014900 con 0x7f374c0f6bf0 2022-02-02T19:30:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.416+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c10f010 con 0x7f374c0f6bf0 2022-02-02T19:30:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.417+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c045ad0 con 0x7f374c0f6bf0 2022-02-02T19:30:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.417+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f373c009480 con 0x7f374c0f6bf0 2022-02-02T19:30:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.418+0000 7f3748ff9700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 0x7f3738067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.418+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f373c081d10 con 0x7f374c0f6bf0 2022-02-02T19:30:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.418+0000 7f374b7fe700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 0x7f3738067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.418+0000 7f374b7fe700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 0x7f3738067290 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f3734004630 tx=0x7f3734009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.422+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f373c04fe80 con 0x7f374c0f6bf0 2022-02-02T19:30:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.626+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f374c0fddb0 con 0x7f374c0f6bf0 2022-02-02T19:30:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.627+0000 7f3748ff9700 1 -- 172.21.15.96:0/3731059943 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f373c0534a0 con 0x7f374c0f6bf0 2022-02-02T19:30:26.634 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:30:26.634 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:30:26.634 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:30:26.634 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:30:26.635 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:26.635 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:30:26.635 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:30:26.635 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:30:26.636 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:30:26.636 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:30:26.636 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:30:26.636 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:30:26.636 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:30:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:30:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:30:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:30:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:30:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:30:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:30:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:30:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:30:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:30:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:30:26.639 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:30:26.640 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:30:26.640 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:30:26.640 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:30:26.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:26.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:30:26.641 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:26.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.628+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 msgr2=0x7f3738067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.628+0000 7f375233c700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 0x7f3738067290 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f3734004630 tx=0x7f3734009b30).stop 2022-02-02T19:30:26.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.628+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 msgr2=0x7f374c0f9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:26.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.628+0000 7f375233c700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f373c002700 tx=0x7f373c009d80).stop 2022-02-02T19:30:26.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.628+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 shutdown_connections 2022-02-02T19:30:26.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3738064dd0 0x7f3738067290 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f374c0f6bf0 0x7f374c0f9860 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 --2- 172.21.15.96:0/3731059943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f374c0f7590 0x7f374c0f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:26.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 >> 172.21.15.96:0/3731059943 conn(0x7f374c0f04c0 msgr2=0x7f374c0f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:26.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 shutdown_connections 2022-02-02T19:30:26.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:26.629+0000 7f375233c700 1 -- 172.21.15.96:0/3731059943 wait complete. 2022-02-02T19:30:26.645 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:30:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:26 smithi159 ceph-mon[69013]: from='client.36218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:26 smithi159 ceph-mon[69013]: from='client.36222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:27.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:26 smithi159 ceph-mon[69013]: pgmap v2049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:27.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2534611120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:30:27.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3731059943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:30:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:26 smithi096 ceph-mon[101353]: from='client.36218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:26 smithi096 ceph-mon[101353]: from='client.36222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:27.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:26 smithi096 ceph-mon[101353]: pgmap v2049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:27.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2534611120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:30:27.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3731059943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:30:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:30:28.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:30:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:30:28.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:30:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:28 smithi159 ceph-mon[69013]: pgmap v2050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:28 smithi096 ceph-mon[101353]: pgmap v2050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:30 smithi159 ceph-mon[69013]: pgmap v2051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:30 smithi096 ceph-mon[101353]: pgmap v2051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:32 smithi159 ceph-mon[69013]: pgmap v2052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:32.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:32 smithi096 ceph-mon[101353]: pgmap v2052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:34 smithi159 ceph-mon[69013]: pgmap v2053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:34 smithi096 ceph-mon[101353]: pgmap v2053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:36 smithi159 ceph-mon[69013]: pgmap v2054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:36 smithi096 ceph-mon[101353]: pgmap v2054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:38 smithi159 ceph-mon[69013]: pgmap v2055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:38 smithi096 ceph-mon[101353]: pgmap v2055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:40 smithi159 ceph-mon[69013]: pgmap v2056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:40 smithi096 ceph-mon[101353]: pgmap v2056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:42 smithi159 ceph-mon[69013]: pgmap v2057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:42 smithi096 ceph-mon[101353]: pgmap v2057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:44 smithi159 ceph-mon[69013]: pgmap v2058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:44 smithi096 ceph-mon[101353]: pgmap v2058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:46 smithi159 ceph-mon[69013]: pgmap v2059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:47.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:46 smithi096 ceph-mon[101353]: pgmap v2059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:48 smithi159 ceph-mon[69013]: pgmap v2060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:48 smithi096 ceph-mon[101353]: pgmap v2060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:50 smithi159 ceph-mon[69013]: pgmap v2061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:50 smithi096 ceph-mon[101353]: pgmap v2061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:52 smithi159 ceph-mon[69013]: pgmap v2062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:52.645 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:52 smithi096 ceph-mon[101353]: pgmap v2062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:54 smithi159 ceph-mon[69013]: pgmap v2063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:54 smithi096 ceph-mon[101353]: pgmap v2063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:56.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.741+0000 7f598d133700 1 -- 172.21.15.96:0/2517166654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f5430 msgr2=0x7f59880f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:56.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.741+0000 7f598d133700 1 --2- 172.21.15.96:0/2517166654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f5430 0x7f59880f5850 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f5978004660 tx=0x7f5978009b30).stop 2022-02-02T19:30:56.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 -- 172.21.15.96:0/2517166654 shutdown_connections 2022-02-02T19:30:56.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 --2- 172.21.15.96:0/2517166654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f66d0 0x7f59880f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 --2- 172.21.15.96:0/2517166654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f5430 0x7f59880f5850 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 -- 172.21.15.96:0/2517166654 >> 172.21.15.96:0/2517166654 conn(0x7f59880f0b90 msgr2=0x7f59880f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:56.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 -- 172.21.15.96:0/2517166654 shutdown_connections 2022-02-02T19:30:56.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 -- 172.21.15.96:0/2517166654 wait complete. 2022-02-02T19:30:56.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.742+0000 7f598d133700 1 Processor -- start 2022-02-02T19:30:56.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f598d133700 1 -- start start 2022-02-02T19:30:56.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f598d133700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f5430 0x7f5988109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:56.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f598d133700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:56.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f598d133700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988060420 con 0x7f59880f66d0 2022-02-02T19:30:56.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f598d133700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988060560 con 0x7f59880f5430 2022-02-02T19:30:56.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:56.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60162/0 (socket says 172.21.15.96:60162) 2022-02-02T19:30:56.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 -- 172.21.15.96:0/2272489762 learned_addr learned my addr 172.21.15.96:0/2272489762 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:56.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f5987fff700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f5430 0x7f5988109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:56.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 -- 172.21.15.96:0/2272489762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f5430 msgr2=0x7f5988109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:56.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f5430 0x7f5988109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.743+0000 7f59877fe700 1 -- 172.21.15.96:0/2272489762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978005040 con 0x7f59880f66d0 2022-02-02T19:30:56.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f59877fe700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f597c00c790 tx=0x7f597c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:56.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597c002590 con 0x7f59880f66d0 2022-02-02T19:30:56.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f597c002ba0 con 0x7f59880f66d0 2022-02-02T19:30:56.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598810c560 con 0x7f59880f66d0 2022-02-02T19:30:56.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597c013d90 con 0x7f59880f66d0 2022-02-02T19:30:56.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.744+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598810caf0 con 0x7f59880f66d0 2022-02-02T19:30:56.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.745+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5988059100 con 0x7f59880f66d0 2022-02-02T19:30:56.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.745+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f597c01a060 con 0x7f59880f66d0 2022-02-02T19:30:56.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.746+0000 7f5984ff9700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 0x7f59700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.746+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f597c081d10 con 0x7f59880f66d0 2022-02-02T19:30:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.746+0000 7f5987fff700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 0x7f59700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.746+0000 7f5987fff700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 0x7f59700672e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f5978013690 tx=0x7f5978009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.750+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f597c04fd60 con 0x7f59880f66d0 2022-02-02T19:30:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.929+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59880fdd80 con 0x7f5970064e20 2022-02-02T19:30:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.930+0000 7f5984ff9700 1 -- 172.21.15.96:0/2272489762 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f59880fdd80 con 0x7f5970064e20 2022-02-02T19:30:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 msgr2=0x7f59700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 0x7f59700672e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f5978013690 tx=0x7f5978009b30).stop 2022-02-02T19:30:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 msgr2=0x7f598810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f597c00c790 tx=0x7f597c007d70).stop 2022-02-02T19:30:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 shutdown_connections 2022-02-02T19:30:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5970064e20 0x7f59700672e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59880f5430 0x7f5988109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 --2- 172.21.15.96:0/2272489762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880f66d0 0x7f598810bf50 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 >> 172.21.15.96:0/2272489762 conn(0x7f59880f0b90 msgr2=0x7f59880fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 shutdown_connections 2022-02-02T19:30:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:56.932+0000 7f598d133700 1 -- 172.21.15.96:0/2272489762 wait complete. 2022-02-02T19:30:56.948 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:30:57.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 -- 172.21.15.96:0/4030754691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 msgr2=0x7f40600f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 --2- 172.21.15.96:0/4030754691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40600f6b30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f4050004660 tx=0x7f4050009b30).stop 2022-02-02T19:30:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 -- 172.21.15.96:0/4030754691 shutdown_connections 2022-02-02T19:30:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 --2- 172.21.15.96:0/4030754691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40600f6b30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 --2- 172.21.15.96:0/4030754691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 0x7f40600f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.030+0000 7f4067457700 1 -- 172.21.15.96:0/4030754691 >> 172.21.15.96:0/4030754691 conn(0x7f40600f0b90 msgr2=0x7f40600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:56 smithi096 ceph-mon[101353]: pgmap v2064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 -- 172.21.15.96:0/4030754691 shutdown_connections 2022-02-02T19:30:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 -- 172.21.15.96:0/4030754691 wait complete. 2022-02-02T19:30:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 Processor -- start 2022-02-02T19:30:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 -- start start 2022-02-02T19:30:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 0x7f4060105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060106760 con 0x7f40600f66d0 2022-02-02T19:30:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.031+0000 7f4067457700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060106f60 con 0x7f40600f5430 2022-02-02T19:30:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60172/0 (socket says 172.21.15.96:60172) 2022-02-02T19:30:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 -- 172.21.15.96:0/1916653740 learned_addr learned my addr 172.21.15.96:0/1916653740 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4066455700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 0x7f4060105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 -- 172.21.15.96:0/1916653740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 msgr2=0x7f4060105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 0x7f4060105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 -- 172.21.15.96:0/1916653740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050005040 con 0x7f40600f66d0 2022-02-02T19:30:57.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4065c54700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f4050009990 tx=0x7f4050009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050018070 con 0x7f40600f66d0 2022-02-02T19:30:57.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4050007ba0 con 0x7f40600f66d0 2022-02-02T19:30:57.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601071e0 con 0x7f40600f66d0 2022-02-02T19:30:57.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405001c3c0 con 0x7f40600f66d0 2022-02-02T19:30:57.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.032+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060107740 con 0x7f40600f66d0 2022-02-02T19:30:57.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.033+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060059100 con 0x7f40600f66d0 2022-02-02T19:30:57.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.034+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f405001d420 con 0x7f40600f66d0 2022-02-02T19:30:57.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.034+0000 7f4056ffd700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 0x7f404c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.034+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4050083700 con 0x7f40600f66d0 2022-02-02T19:30:57.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.034+0000 7f4066455700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 0x7f404c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.034+0000 7f4066455700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 0x7f404c0672e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f40600f6530 tx=0x7f405c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.038+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4050055240 con 0x7f40600f66d0 2022-02-02T19:30:57.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.216+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40600fdbf0 con 0x7f404c064e20 2022-02-02T19:30:57.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.225+0000 7f4056ffd700 1 -- 172.21.15.96:0/1916653740 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f40600fdbf0 con 0x7f404c064e20 2022-02-02T19:30:57.232 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:30:57.232 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (74m) 44m ago 75m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:30:57.233 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (66m) 44m ago 75m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:30:57.233 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (66m) 43m ago 74m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:30:57.233 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (74m) 44m ago 75m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:30:57.233 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (71m) 44m ago 71m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:30:57.234 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (67m) 44m ago 71m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:30:57.234 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (71m) 43m ago 71m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:30:57.234 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (67m) 43m ago 71m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:30:57.234 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (68m) 44m ago 76m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:30:57.234 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (68m) 43m ago 74m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:30:57.235 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (67m) 44m ago 76m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:30:57.235 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (67m) 43m ago 74m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:30:57.235 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (75m) 44m ago 75m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:30:57.235 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (74m) 43m ago 74m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:30:57.235 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (66m) 44m ago 74m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:30:57.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (65m) 44m ago 73m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:30:57.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (65m) 44m ago 73m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:30:57.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (64m) 43m ago 73m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:30:57.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (64m) 43m ago 73m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:30:57.237 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (63m) 43m ago 72m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:30:57.237 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (74m) 44m ago 75m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:30:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 msgr2=0x7f404c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 0x7f404c0672e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f40600f6530 tx=0x7f405c00b040).stop 2022-02-02T19:30:57.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 msgr2=0x7f40601061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f4050009990 tx=0x7f4050009b30).stop 2022-02-02T19:30:57.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 shutdown_connections 2022-02-02T19:30:57.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f404c064e20 0x7f404c0672e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40600f5430 0x7f4060105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 --2- 172.21.15.96:0/1916653740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40600f66d0 0x7f40601061b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 >> 172.21.15.96:0/1916653740 conn(0x7f40600f0b90 msgr2=0x7f40600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 shutdown_connections 2022-02-02T19:30:57.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.227+0000 7f4067457700 1 -- 172.21.15.96:0/1916653740 wait complete. 2022-02-02T19:30:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:56 smithi159 ceph-mon[69013]: pgmap v2064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 -- 172.21.15.96:0/1187393988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 msgr2=0x7f08740f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 --2- 172.21.15.96:0/1187393988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08740f6b30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f0864004660 tx=0x7f0864009b30).stop 2022-02-02T19:30:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 -- 172.21.15.96:0/1187393988 shutdown_connections 2022-02-02T19:30:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 --2- 172.21.15.96:0/1187393988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08740f6b30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 --2- 172.21.15.96:0/1187393988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 0x7f08740f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.323+0000 7f087a76a700 1 -- 172.21.15.96:0/1187393988 >> 172.21.15.96:0/1187393988 conn(0x7f08740f0b90 msgr2=0x7f08740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.324+0000 7f087a76a700 1 -- 172.21.15.96:0/1187393988 shutdown_connections 2022-02-02T19:30:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.324+0000 7f087a76a700 1 -- 172.21.15.96:0/1187393988 wait complete. 2022-02-02T19:30:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.324+0000 7f087a76a700 1 Processor -- start 2022-02-02T19:30:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.324+0000 7f087a76a700 1 -- start start 2022-02-02T19:30:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.324+0000 7f087a76a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 0x7f0874105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f087a76a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f087a76a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874106760 con 0x7f08740f66d0 2022-02-02T19:30:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f087a76a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874106f60 con 0x7f08740f5430 2022-02-02T19:30:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60182/0 (socket says 172.21.15.96:60182) 2022-02-02T19:30:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 -- 172.21.15.96:0/3453947097 learned_addr learned my addr 172.21.15.96:0/3453947097 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0879768700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 0x7f0874105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 -- 172.21.15.96:0/3453947097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 msgr2=0x7f0874105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 0x7f0874105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 -- 172.21.15.96:0/3453947097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864005040 con 0x7f08740f66d0 2022-02-02T19:30:57.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0878f67700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f0864009990 tx=0x7f0864009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0864018070 con 0x7f08740f66d0 2022-02-02T19:30:57.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0864007ba0 con 0x7f08740f66d0 2022-02-02T19:30:57.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086401c3c0 con 0x7f08740f66d0 2022-02-02T19:30:57.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.325+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741071e0 con 0x7f08740f66d0 2022-02-02T19:30:57.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.326+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0874107740 con 0x7f08740f66d0 2022-02-02T19:30:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.326+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0874059100 con 0x7f08740f66d0 2022-02-02T19:30:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.327+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f086401d420 con 0x7f08740f66d0 2022-02-02T19:30:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.327+0000 7f0869ffb700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 0x7f08600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.327+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0864083700 con 0x7f08740f66d0 2022-02-02T19:30:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.327+0000 7f0879768700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 0x7f08600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.328+0000 7f0879768700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 0x7f08600672e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f08740f6530 tx=0x7f087000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.332+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0864055240 con 0x7f08740f66d0 2022-02-02T19:30:57.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.560+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f08740fdbf0 con 0x7f08740f66d0 2022-02-02T19:30:57.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.561+0000 7f0869ffb700 1 -- 172.21.15.96:0/3453947097 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0864054e30 con 0x7f08740f66d0 2022-02-02T19:30:57.568 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:30:57.568 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:30:57.569 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:30:57.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:57.569 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:30:57.569 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:30:57.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:57.570 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:30:57.570 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:30:57.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:57.570 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:30:57.571 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:30:57.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:30:57.571 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:30:57.571 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:30:57.572 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:30:57.572 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:30:57.572 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:30:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 msgr2=0x7f08600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 0x7f08600672e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f08740f6530 tx=0x7f087000b040).stop 2022-02-02T19:30:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 msgr2=0x7f08741061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f0864009990 tx=0x7f0864009b30).stop 2022-02-02T19:30:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 shutdown_connections 2022-02-02T19:30:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0860064e20 0x7f08600672e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08740f5430 0x7f0874105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 --2- 172.21.15.96:0/3453947097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08740f66d0 0x7f08741061b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 >> 172.21.15.96:0/3453947097 conn(0x7f08740f0b90 msgr2=0x7f08740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 shutdown_connections 2022-02-02T19:30:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.563+0000 7f087a76a700 1 -- 172.21.15.96:0/3453947097 wait complete. 2022-02-02T19:30:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 -- 172.21.15.96:0/3246444476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 msgr2=0x7f69780f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 --2- 172.21.15.96:0/3246444476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f69780f6fe0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f696c004660 tx=0x7f696c009b30).stop 2022-02-02T19:30:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 -- 172.21.15.96:0/3246444476 shutdown_connections 2022-02-02T19:30:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 --2- 172.21.15.96:0/3246444476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 0x7f69780f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:30:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 --2- 172.21.15.96:0/3246444476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f69780f6fe0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.659+0000 7f697f0e4700 1 -- 172.21.15.96:0/3246444476 >> 172.21.15.96:0/3246444476 conn(0x7f69780f04c0 msgr2=0x7f69780f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.662+0000 7f697f0e4700 1 -- 172.21.15.96:0/3246444476 shutdown_connections 2022-02-02T19:30:57.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.662+0000 7f697f0e4700 1 -- 172.21.15.96:0/3246444476 wait complete. 2022-02-02T19:30:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.662+0000 7f697f0e4700 1 Processor -- start 2022-02-02T19:30:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.662+0000 7f697f0e4700 1 -- start start 2022-02-02T19:30:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697f0e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697f0e4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 0x7f697810c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697f0e4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780f56f0 con 0x7f69780f6bc0 2022-02-02T19:30:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697f0e4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780f5830 con 0x7f69780f7560 2022-02-02T19:30:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60190/0 (socket says 172.21.15.96:60190) 2022-02-02T19:30:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 -- 172.21.15.96:0/545126983 learned_addr learned my addr 172.21.15.96:0/545126983 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:30:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f6977fff700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 0x7f697810c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 -- 172.21.15.96:0/545126983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 msgr2=0x7f697810c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 0x7f697810c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 -- 172.21.15.96:0/545126983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c005040 con 0x7f69780f6bc0 2022-02-02T19:30:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f697ce80700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f696c009d80 tx=0x7f696c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.663+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c018070 con 0x7f69780f6bc0 2022-02-02T19:30:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.664+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f696c007ba0 con 0x7f69780f6bc0 2022-02-02T19:30:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.664+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697810c890 con 0x7f69780f6bc0 2022-02-02T19:30:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.664+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c01c620 con 0x7f69780f6bc0 2022-02-02T19:30:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.664+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697810cdc0 con 0x7f69780f6bc0 2022-02-02T19:30:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.664+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6978045ad0 con 0x7f69780f6bc0 2022-02-02T19:30:57.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.665+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f696c01d420 con 0x7f69780f6bc0 2022-02-02T19:30:57.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.665+0000 7f69757fa700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 0x7f6968067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:30:57.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.666+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f696c083900 con 0x7f69780f6bc0 2022-02-02T19:30:57.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.666+0000 7f6977fff700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 0x7f6968067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:30:57.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.666+0000 7f6977fff700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 0x7f6968067290 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f69780f79a0 tx=0x7f6964008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:30:57.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.670+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f696c051950 con 0x7f69780f6bc0 2022-02-02T19:30:57.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.869+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f69780fdf60 con 0x7f69780f6bc0 2022-02-02T19:30:57.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.870+0000 7f69757fa700 1 -- 172.21.15.96:0/545126983 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f696c054f70 con 0x7f69780f6bc0 2022-02-02T19:30:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:30:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:30:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:30:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:30:57.878 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:30:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:30:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:30:57.879 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:30:57.879 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:30:57.879 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:30:57.879 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:30:57.880 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:30:57.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:30:57.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:30:57.880 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:30:57.880 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:30:57.881 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:30:57.881 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:30:57.881 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:30:57.882 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:30:57.882 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:30:57.882 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:30:57.882 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:30:57.882 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:30:57.883 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:30:57.883 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:30:57.883 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:30:57.883 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:30:57.884 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:30:57.884 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:30:57.884 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:30:57.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:57.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:57.885 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:30:57.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:30:57.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:57.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:57.886 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:30:57.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.871+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 msgr2=0x7f6968067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.871+0000 7f697f0e4700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 0x7f6968067290 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f69780f79a0 tx=0x7f6964008040).stop 2022-02-02T19:30:57.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.871+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 msgr2=0x7f6978109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:30:57.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.871+0000 7f697f0e4700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f696c009d80 tx=0x7f696c009b30).stop 2022-02-02T19:30:57.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.871+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 shutdown_connections 2022-02-02T19:30:57.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6968064dd0 0x7f6968067290 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69780f6bc0 0x7f6978109d90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 --2- 172.21.15.96:0/545126983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69780f7560 0x7f697810c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:30:57.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 >> 172.21.15.96:0/545126983 conn(0x7f69780f04c0 msgr2=0x7f69780fa410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:30:57.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 shutdown_connections 2022-02-02T19:30:57.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:30:57.872+0000 7f697f0e4700 1 -- 172.21.15.96:0/545126983 wait complete. 2022-02-02T19:30:57.889 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:30:58.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:57 smithi159 ceph-mon[69013]: from='client.36234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:58.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3453947097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:30:58.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/545126983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:30:58.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:57 smithi096 ceph-mon[101353]: from='client.36234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:58.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3453947097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:30:58.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/545126983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:30:59.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:58 smithi096 ceph-mon[101353]: from='client.36238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:59.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:30:58 smithi096 ceph-mon[101353]: pgmap v2065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:30:59.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:58 smithi159 ceph-mon[69013]: from='client.36238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:30:59.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:30:58 smithi159 ceph-mon[69013]: pgmap v2065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:00 smithi159 ceph-mon[69013]: pgmap v2066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:00.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:00 smithi096 ceph-mon[101353]: pgmap v2066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:02 smithi159 ceph-mon[69013]: pgmap v2067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:02 smithi096 ceph-mon[101353]: pgmap v2067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:04 smithi159 ceph-mon[69013]: pgmap v2068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:04 smithi096 ceph-mon[101353]: pgmap v2068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:06 smithi159 ceph-mon[69013]: pgmap v2069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:06 smithi096 ceph-mon[101353]: pgmap v2069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:08 smithi159 ceph-mon[69013]: pgmap v2070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:08 smithi096 ceph-mon[101353]: pgmap v2070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:10 smithi159 ceph-mon[69013]: pgmap v2071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:10 smithi096 ceph-mon[101353]: pgmap v2071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:12 smithi159 ceph-mon[69013]: pgmap v2072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:12 smithi096 ceph-mon[101353]: pgmap v2072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:14 smithi159 ceph-mon[69013]: pgmap v2073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:14 smithi096 ceph-mon[101353]: pgmap v2073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:16 smithi159 ceph-mon[69013]: pgmap v2074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:16 smithi096 ceph-mon[101353]: pgmap v2074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:18 smithi159 ceph-mon[69013]: pgmap v2075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:18 smithi096 ceph-mon[101353]: pgmap v2075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:20 smithi159 ceph-mon[69013]: pgmap v2076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:20 smithi096 ceph-mon[101353]: pgmap v2076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:22 smithi159 ceph-mon[69013]: pgmap v2077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:22.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:22 smithi096 ceph-mon[101353]: pgmap v2077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:24 smithi159 ceph-mon[69013]: pgmap v2078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:24 smithi096 ceph-mon[101353]: pgmap v2078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:26 smithi159 ceph-mon[69013]: pgmap v2079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:26 smithi096 ceph-mon[101353]: pgmap v2079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.983+0000 7efdc1876700 1 -- 172.21.15.96:0/702730580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f6be0 msgr2=0x7efdbc0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.983+0000 7efdc1876700 1 --2- 172.21.15.96:0/702730580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f6be0 0x7efdbc0f7000 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7efdac004660 tx=0x7efdac009b30).stop 2022-02-02T19:31:27.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 -- 172.21.15.96:0/702730580 shutdown_connections 2022-02-02T19:31:27.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 --2- 172.21.15.96:0/702730580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f7580 0x7efdbc0f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:27.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 --2- 172.21.15.96:0/702730580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f6be0 0x7efdbc0f7000 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:27.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 -- 172.21.15.96:0/702730580 >> 172.21.15.96:0/702730580 conn(0x7efdbc0f04c0 msgr2=0x7efdbc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:27.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 -- 172.21.15.96:0/702730580 shutdown_connections 2022-02-02T19:31:27.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 -- 172.21.15.96:0/702730580 wait complete. 2022-02-02T19:31:27.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.984+0000 7efdc1876700 1 Processor -- start 2022-02-02T19:31:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdc1876700 1 -- start start 2022-02-02T19:31:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdc1876700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f6be0 0x7efdbc109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdc1876700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:27.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdc1876700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0f56c0 con 0x7efdbc0f7580 2022-02-02T19:31:27.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdc1876700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0f5800 con 0x7efdbc0f6be0 2022-02-02T19:31:27.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdb27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:27.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdbaffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f6be0 0x7efdbc109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:27.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdb27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60210/0 (socket says 172.21.15.96:60210) 2022-02-02T19:31:27.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.985+0000 7efdb27fc700 1 -- 172.21.15.96:0/1586406435 learned_addr learned my addr 172.21.15.96:0/1586406435 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:27.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb27fc700 1 -- 172.21.15.96:0/1586406435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f6be0 msgr2=0x7efdbc109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:27.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb27fc700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f6be0 0x7efdbc109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:27.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb27fc700 1 -- 172.21.15.96:0/1586406435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac005040 con 0x7efdbc0f7580 2022-02-02T19:31:27.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb27fc700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7efda4002700 tx=0x7efda4009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:27.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda40079c0 con 0x7efdbc0f7580 2022-02-02T19:31:27.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc10c7e0 con 0x7efdbc0f7580 2022-02-02T19:31:27.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efda400f040 con 0x7efdbc0f7580 2022-02-02T19:31:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda4014740 con 0x7efdbc0f7580 2022-02-02T19:31:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.986+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc10cd70 con 0x7efdbc0f7580 2022-02-02T19:31:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.987+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0f4150 con 0x7efdbc0f7580 2022-02-02T19:31:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.987+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efda401b060 con 0x7efdbc0f7580 2022-02-02T19:31:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.988+0000 7efdb3fff700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.988+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efda4081960 con 0x7efdbc0f7580 2022-02-02T19:31:28.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.988+0000 7efdbaffd700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.988+0000 7efdbaffd700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 0x7efda8067290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7efdac004630 tx=0x7efdac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:27.992+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efda404f9b0 con 0x7efdbc0f7580 2022-02-02T19:31:28.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.172+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdbc0fdf50 con 0x7efda8064dd0 2022-02-02T19:31:28.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.173+0000 7efdb3fff700 1 -- 172.21.15.96:0/1586406435 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7efdbc0fdf50 con 0x7efda8064dd0 2022-02-02T19:31:28.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 msgr2=0x7efda8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 0x7efda8067290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7efdac004630 tx=0x7efdac009b30).stop 2022-02-02T19:31:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 msgr2=0x7efdbc10c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7efda4002700 tx=0x7efda4009d60).stop 2022-02-02T19:31:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 shutdown_connections 2022-02-02T19:31:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdbc0f6be0 0x7efdbc109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 --2- 172.21.15.96:0/1586406435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdbc0f7580 0x7efdbc10c1d0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.174+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 >> 172.21.15.96:0/1586406435 conn(0x7efdbc0f04c0 msgr2=0x7efdbc0fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.175+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 shutdown_connections 2022-02-02T19:31:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.175+0000 7efdc1876700 1 -- 172.21.15.96:0/1586406435 wait complete. 2022-02-02T19:31:28.190 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:31:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 -- 172.21.15.96:0/337762995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f6530 msgr2=0x7fed380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/337762995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f6530 0x7fed380f6950 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7fed28004660 tx=0x7fed28009b30).stop 2022-02-02T19:31:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 -- 172.21.15.96:0/337762995 shutdown_connections 2022-02-02T19:31:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/337762995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f77d0 0x7fed380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:31:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/337762995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f6530 0x7fed380f6950 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 -- 172.21.15.96:0/337762995 >> 172.21.15.96:0/337762995 conn(0x7fed380f1c90 msgr2=0x7fed380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 -- 172.21.15.96:0/337762995 shutdown_connections 2022-02-02T19:31:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.272+0000 7fed3d6ce700 1 -- 172.21.15.96:0/337762995 wait complete. 2022-02-02T19:31:28.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:31:28.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:31:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 Processor -- start 2022-02-02T19:31:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 -- start start 2022-02-02T19:31:28.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 0x7fed3806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3806a410 con 0x7fed380f77d0 2022-02-02T19:31:28.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed3d6ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3806a550 con 0x7fed380f6530 2022-02-02T19:31:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60220/0 (socket says 172.21.15.96:60220) 2022-02-02T19:31:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.273+0000 7fed377fe700 1 -- 172.21.15.96:0/2376150243 learned_addr learned my addr 172.21.15.96:0/2376150243 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:28.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed37fff700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 0x7fed3806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed377fe700 1 -- 172.21.15.96:0/2376150243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 msgr2=0x7fed3806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed377fe700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 0x7fed3806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed377fe700 1 -- 172.21.15.96:0/2376150243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28005040 con 0x7fed380f77d0 2022-02-02T19:31:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed37fff700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 0x7fed3806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:31:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed377fe700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fed2c00b410 tx=0x7fed2c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c0125f0 con 0x7fed380f77d0 2022-02-02T19:31:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed2c012c00 con 0x7fed380f77d0 2022-02-02T19:31:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3806a830 con 0x7fed380f77d0 2022-02-02T19:31:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c002ae0 con 0x7fed380f77d0 2022-02-02T19:31:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.274+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3810ede0 con 0x7fed380f77d0 2022-02-02T19:31:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.275+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed38045ad0 con 0x7fed380f77d0 2022-02-02T19:31:28.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.276+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed2c00f030 con 0x7fed380f77d0 2022-02-02T19:31:28.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.276+0000 7fed34ff9700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 0x7fed200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.276+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fed2c081f60 con 0x7fed380f77d0 2022-02-02T19:31:28.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.276+0000 7fed37fff700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 0x7fed200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.276+0000 7fed37fff700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 0x7fed200672e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fed28004e30 tx=0x7fed28009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:31:28.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:31:28.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.280+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed2c0b07d0 con 0x7fed380f77d0 2022-02-02T19:31:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.453+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed380feee0 con 0x7fed20064e20 2022-02-02T19:31:28.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.464+0000 7fed34ff9700 1 -- 172.21.15.96:0/2376150243 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fed380feee0 con 0x7fed20064e20 2022-02-02T19:31:28.491 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:31:28.491 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (74m) 45m ago 75m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:31:28.492 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (67m) 45m ago 75m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:31:28.492 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (67m) 43m ago 75m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:31:28.492 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (74m) 45m ago 75m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:31:28.492 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (71m) 45m ago 71m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:31:28.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (67m) 45m ago 72m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:31:28.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (71m) 43m ago 71m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:31:28.493 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (67m) 43m ago 72m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:31:28.493 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (69m) 45m ago 77m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:31:28.494 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (68m) 43m ago 75m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:31:28.494 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (68m) 45m ago 77m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:31:28.494 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (67m) 43m ago 75m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:31:28.494 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (75m) 45m ago 75m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:31:28.494 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (75m) 43m ago 75m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:31:28.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (66m) 45m ago 74m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:31:28.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (66m) 45m ago 74m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:31:28.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (65m) 45m ago 74m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:31:28.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (65m) 43m ago 73m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:31:28.496 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (64m) 43m ago 73m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:31:28.496 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (64m) 43m ago 73m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:31:28.496 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (74m) 45m ago 75m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:31:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 msgr2=0x7fed200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 0x7fed200672e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fed28004e30 tx=0x7fed28009b30).stop 2022-02-02T19:31:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 msgr2=0x7fed38069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fed2c00b410 tx=0x7fed2c006ef0).stop 2022-02-02T19:31:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 shutdown_connections 2022-02-02T19:31:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed20064e20 0x7fed200672e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed380f6530 0x7fed3806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 --2- 172.21.15.96:0/2376150243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed380f77d0 0x7fed38069e20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 >> 172.21.15.96:0/2376150243 conn(0x7fed380f1c90 msgr2=0x7fed380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 shutdown_connections 2022-02-02T19:31:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.466+0000 7fed3d6ce700 1 -- 172.21.15.96:0/2376150243 wait complete. 2022-02-02T19:31:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 -- 172.21.15.96:0/557662729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 msgr2=0x7f0e840f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/557662729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e840f6b00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f0e74004660 tx=0x7f0e74009b30).stop 2022-02-02T19:31:28.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 -- 172.21.15.96:0/557662729 shutdown_connections 2022-02-02T19:31:28.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/557662729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 0x7f0e840f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/557662729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e840f6b00 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 -- 172.21.15.96:0/557662729 >> 172.21.15.96:0/557662729 conn(0x7f0e840f1e40 msgr2=0x7f0e840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 -- 172.21.15.96:0/557662729 shutdown_connections 2022-02-02T19:31:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.563+0000 7f0e8a23d700 1 -- 172.21.15.96:0/557662729 wait complete. 2022-02-02T19:31:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 Processor -- start 2022-02-02T19:31:28.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 -- start start 2022-02-02T19:31:28.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 0x7f0e84109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84109c40 con 0x7f0e840f66e0 2022-02-02T19:31:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e8a23d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84109d80 con 0x7f0e840f7980 2022-02-02T19:31:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60228/0 (socket says 172.21.15.96:60228) 2022-02-02T19:31:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e837fe700 1 -- 172.21.15.96:0/952907197 learned_addr learned my addr 172.21.15.96:0/952907197 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:28.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.564+0000 7f0e82ffd700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 0x7f0e84109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e837fe700 1 -- 172.21.15.96:0/952907197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 msgr2=0x7f0e84109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e837fe700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 0x7f0e84109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e837fe700 1 -- 172.21.15.96:0/952907197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74005040 con 0x7f0e840f66e0 2022-02-02T19:31:28.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e837fe700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f0e74013a70 tx=0x7f0e74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e74018070 con 0x7f0e840f66e0 2022-02-02T19:31:28.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e740097d0 con 0x7f0e840f66e0 2022-02-02T19:31:28.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e7401de80 con 0x7f0e840f66e0 2022-02-02T19:31:28.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8410a6c0 con 0x7f0e840f66e0 2022-02-02T19:31:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.565+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8410ac20 con 0x7f0e840f66e0 2022-02-02T19:31:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.566+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84045ad0 con 0x7f0e840f66e0 2022-02-02T19:31:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.567+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e74007ba0 con 0x7f0e840f66e0 2022-02-02T19:31:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.567+0000 7f0e7bfff700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 0x7f0e70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.567+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e740836b0 con 0x7f0e840f66e0 2022-02-02T19:31:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.567+0000 7f0e82ffd700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 0x7f0e70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.567+0000 7f0e82ffd700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 0x7f0e70067290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f0e6c004c40 tx=0x7f0e6c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.571+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e74055190 con 0x7f0e840f66e0 2022-02-02T19:31:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.802+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e840fefb0 con 0x7f0e840f66e0 2022-02-02T19:31:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.802+0000 7f0e7bfff700 1 -- 172.21.15.96:0/952907197 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0e74054d80 con 0x7f0e840f66e0 2022-02-02T19:31:28.809 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:31:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:31:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:31:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:31:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:31:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:31:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:31:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:31:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:31:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:31:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:31:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:31:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:31:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:31:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:31:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:31:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:31:28.817 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:31:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 msgr2=0x7f0e70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 0x7f0e70067290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f0e6c004c40 tx=0x7f0e6c00b040).stop 2022-02-02T19:31:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 msgr2=0x7f0e841091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f0e74013a70 tx=0x7f0e74009b30).stop 2022-02-02T19:31:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 shutdown_connections 2022-02-02T19:31:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e70064dd0 0x7f0e70067290 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e840f66e0 0x7f0e841091a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 --2- 172.21.15.96:0/952907197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e840f7980 0x7f0e84109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 >> 172.21.15.96:0/952907197 conn(0x7f0e840f1e40 msgr2=0x7f0e840f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.804+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 shutdown_connections 2022-02-02T19:31:28.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.805+0000 7f0e8a23d700 1 -- 172.21.15.96:0/952907197 wait complete. 2022-02-02T19:31:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 -- 172.21.15.96:0/2303395121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 msgr2=0x7f9e280f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/2303395121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e280f5df0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f9e18004660 tx=0x7f9e18009b30).stop 2022-02-02T19:31:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 -- 172.21.15.96:0/2303395121 shutdown_connections 2022-02-02T19:31:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/2303395121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e280f5df0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/2303395121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e280f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 -- 172.21.15.96:0/2303395121 >> 172.21.15.96:0/2303395121 conn(0x7f9e280f04c0 msgr2=0x7f9e280f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 -- 172.21.15.96:0/2303395121 shutdown_connections 2022-02-02T19:31:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.902+0000 7f9e2cc68700 1 -- 172.21.15.96:0/2303395121 wait complete. 2022-02-02T19:31:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 Processor -- start 2022-02-02T19:31:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 -- start start 2022-02-02T19:31:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e28107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e281079f0 con 0x7f9e280f5970 2022-02-02T19:31:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2cc68700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28107b30 con 0x7f9e280f6c60 2022-02-02T19:31:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60238/0 (socket says 172.21.15.96:60238) 2022-02-02T19:31:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e2659c700 1 -- 172.21.15.96:0/502541248 learned_addr learned my addr 172.21.15.96:0/502541248 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.903+0000 7f9e25d9b700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e28107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2659c700 1 -- 172.21.15.96:0/502541248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 msgr2=0x7f9e28107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:28.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2659c700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e28107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:28.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2659c700 1 -- 172.21.15.96:0/502541248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18005040 con 0x7f9e280f5970 2022-02-02T19:31:28.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e25d9b700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e28107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:31:28.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2659c700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f9e1000c790 tx=0x7f9e10007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1000e680 con 0x7f9e280f5970 2022-02-02T19:31:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e1000ec90 con 0x7f9e280f5970 2022-02-02T19:31:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e10013d60 con 0x7f9e280f5970 2022-02-02T19:31:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e281084d0 con 0x7f9e280f5970 2022-02-02T19:31:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.904+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e28108a40 con 0x7f9e280f5970 2022-02-02T19:31:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.905+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e28045ad0 con 0x7f9e280f5970 2022-02-02T19:31:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.906+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e1001a060 con 0x7f9e280f5970 2022-02-02T19:31:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.906+0000 7f9e1effd700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 0x7f9e14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.906+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9e10081ce0 con 0x7f9e280f5970 2022-02-02T19:31:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.906+0000 7f9e25d9b700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 0x7f9e14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:28.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.907+0000 7f9e25d9b700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 0x7f9e14067290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f9e18004e30 tx=0x7f9e18009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:28.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:28.911+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e100537c0 con 0x7f9e280f5970 2022-02-02T19:31:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.113+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e2810d570 con 0x7f9e280f5970 2022-02-02T19:31:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.114+0000 7f9e1effd700 1 -- 172.21.15.96:0/502541248 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9e10018070 con 0x7f9e280f5970 2022-02-02T19:31:29.120 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:31:29.120 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:31:29.121 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:31:29.121 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:31:29.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:31:29.121 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:31:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:31:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:31:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:31:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:31:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:31:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:31:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:31:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:31:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:31:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:31:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:31:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:31:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:31:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:31:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:31:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:31:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:31:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:31:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:31:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:31:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:31:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:31:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:31:29.127 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:31:29.127 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:31:29.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:31:29.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:31:29.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:31:29.128 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:31:29.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:31:29.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:31:29.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:31:29.129 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:31:29.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 msgr2=0x7f9e14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:29.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 0x7f9e14067290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f9e18004e30 tx=0x7f9e18009b30).stop 2022-02-02T19:31:29.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 msgr2=0x7f9e28106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f9e1000c790 tx=0x7f9e10007d70).stop 2022-02-02T19:31:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 shutdown_connections 2022-02-02T19:31:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064dd0 0x7f9e14067290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e280f5970 0x7f9e28106f50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 --2- 172.21.15.96:0/502541248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e280f6c60 0x7f9e28107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 >> 172.21.15.96:0/502541248 conn(0x7f9e280f04c0 msgr2=0x7f9e280f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 shutdown_connections 2022-02-02T19:31:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:29.116+0000 7f9e2cc68700 1 -- 172.21.15.96:0/502541248 wait complete. 2022-02-02T19:31:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:31:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:28 smithi159 ceph-mon[69013]: pgmap v2080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:29.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/952907197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:31:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:28 smithi096 ceph-mon[101353]: pgmap v2080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/952907197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:31:30.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:29 smithi159 ceph-mon[69013]: from='client.36250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:31:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:29 smithi159 ceph-mon[69013]: from='client.36254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:31:30.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/502541248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:31:30.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:29 smithi096 ceph-mon[101353]: from='client.36250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:31:30.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:29 smithi096 ceph-mon[101353]: from='client.36254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:31:30.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/502541248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:31:31.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:30 smithi159 ceph-mon[69013]: pgmap v2081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:31.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:30 smithi096 ceph-mon[101353]: pgmap v2081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:32 smithi159 ceph-mon[69013]: pgmap v2082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:32.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:32 smithi096 ceph-mon[101353]: pgmap v2082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:34 smithi159 ceph-mon[69013]: pgmap v2083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:34 smithi096 ceph-mon[101353]: pgmap v2083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:36 smithi159 ceph-mon[69013]: pgmap v2084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:36 smithi096 ceph-mon[101353]: pgmap v2084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:38 smithi159 ceph-mon[69013]: pgmap v2085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:38 smithi096 ceph-mon[101353]: pgmap v2085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:40 smithi159 ceph-mon[69013]: pgmap v2086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:40 smithi096 ceph-mon[101353]: pgmap v2086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:42.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:42 smithi159 ceph-mon[69013]: pgmap v2087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:42 smithi096 ceph-mon[101353]: pgmap v2087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:44.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:44 smithi159 ceph-mon[69013]: pgmap v2088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:44 smithi096 ceph-mon[101353]: pgmap v2088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:46 smithi159 ceph-mon[69013]: pgmap v2089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:46 smithi096 ceph-mon[101353]: pgmap v2089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:48 smithi159 ceph-mon[69013]: pgmap v2090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:48 smithi096 ceph-mon[101353]: pgmap v2090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:50 smithi159 ceph-mon[69013]: pgmap v2091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:50 smithi096 ceph-mon[101353]: pgmap v2091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:52 smithi159 ceph-mon[69013]: pgmap v2092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:52 smithi096 ceph-mon[101353]: pgmap v2092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:54 smithi159 ceph-mon[69013]: pgmap v2093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:54 smithi096 ceph-mon[101353]: pgmap v2093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:56 smithi159 ceph-mon[69013]: pgmap v2094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:56 smithi096 ceph-mon[101353]: pgmap v2094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:31:58 smithi159 ceph-mon[69013]: pgmap v2095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:31:58 smithi096 ceph-mon[101353]: pgmap v2095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:31:59.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 -- 172.21.15.96:0/3193536169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f6880 msgr2=0x7f245c0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 --2- 172.21.15.96:0/3193536169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f6880 0x7f245c0f6ce0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f2444004660 tx=0x7f2444009b30).stop 2022-02-02T19:31:59.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 -- 172.21.15.96:0/3193536169 shutdown_connections 2022-02-02T19:31:59.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 --2- 172.21.15.96:0/3193536169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f6880 0x7f245c0f6ce0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 --2- 172.21.15.96:0/3193536169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f55e0 0x7f245c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.225+0000 7f2460e96700 1 -- 172.21.15.96:0/3193536169 >> 172.21.15.96:0/3193536169 conn(0x7f245c0f0d40 msgr2=0x7f245c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:59.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 -- 172.21.15.96:0/3193536169 shutdown_connections 2022-02-02T19:31:59.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 -- 172.21.15.96:0/3193536169 wait complete. 2022-02-02T19:31:59.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 Processor -- start 2022-02-02T19:31:59.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 -- start start 2022-02-02T19:31:59.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 0x7f245c0f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0f8940 con 0x7f245c0f55e0 2022-02-02T19:31:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f2460e96700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0f8a80 con 0x7f245c0f6880 2022-02-02T19:31:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f245a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f245a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60254/0 (socket says 172.21.15.96:60254) 2022-02-02T19:31:59.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.226+0000 7f245a59c700 1 -- 172.21.15.96:0/735435431 learned_addr learned my addr 172.21.15.96:0/735435431 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:59.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2459d9b700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 0x7f245c0f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f245a59c700 1 -- 172.21.15.96:0/735435431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 msgr2=0x7f245c0f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f245a59c700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 0x7f245c0f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f245a59c700 1 -- 172.21.15.96:0/735435431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444005040 con 0x7f245c0f55e0 2022-02-02T19:31:59.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2459d9b700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 0x7f245c0f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:31:59.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f245a59c700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f244c00c530 tx=0x7f244c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c00f650 con 0x7f245c0f55e0 2022-02-02T19:31:59.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f244c00fc60 con 0x7f245c0f55e0 2022-02-02T19:31:59.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0f8d60 con 0x7f245c0f55e0 2022-02-02T19:31:59.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c10ef20 con 0x7f245c0f55e0 2022-02-02T19:31:59.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.227+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c012d20 con 0x7f245c0f55e0 2022-02-02T19:31:59.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.228+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440004fa0 con 0x7f245c0f55e0 2022-02-02T19:31:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.229+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f244c019030 con 0x7f245c0f55e0 2022-02-02T19:31:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.229+0000 7f2452ffd700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 0x7f2448067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.229+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f244c0816e0 con 0x7f245c0f55e0 2022-02-02T19:31:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.229+0000 7f2459d9b700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 0x7f2448067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.230+0000 7f2459d9b700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 0x7f2448067290 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2444009da0 tx=0x7f2444009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.233+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f244c04f7e0 con 0x7f245c0f55e0 2022-02-02T19:31:59.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.414+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2440002a40 con 0x7f2448064dd0 2022-02-02T19:31:59.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.416+0000 7f2452ffd700 1 -- 172.21.15.96:0/735435431 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2440002a40 con 0x7f2448064dd0 2022-02-02T19:31:59.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 msgr2=0x7f2448067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 0x7f2448067290 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2444009da0 tx=0x7f2444009b30).stop 2022-02-02T19:31:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 msgr2=0x7f245c0f9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f244c00c530 tx=0x7f244c007e10).stop 2022-02-02T19:31:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 shutdown_connections 2022-02-02T19:31:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2448064dd0 0x7f2448067290 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f245c0f55e0 0x7f245c0f9f60 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 --2- 172.21.15.96:0/735435431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245c0f6880 0x7f245c0f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.417+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 >> 172.21.15.96:0/735435431 conn(0x7f245c0f0d40 msgr2=0x7f245c05f740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.418+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 shutdown_connections 2022-02-02T19:31:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.418+0000 7f2460e96700 1 -- 172.21.15.96:0/735435431 wait complete. 2022-02-02T19:31:59.433 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:31:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 -- 172.21.15.96:0/1708549283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f66d0 msgr2=0x7f5d000f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 --2- 172.21.15.96:0/1708549283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f66d0 0x7f5d000f6b30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f5cf0004660 tx=0x7f5cf0009b30).stop 2022-02-02T19:31:59.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 -- 172.21.15.96:0/1708549283 shutdown_connections 2022-02-02T19:31:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 --2- 172.21.15.96:0/1708549283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f66d0 0x7f5d000f6b30 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 --2- 172.21.15.96:0/1708549283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f5430 0x7f5d000f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 -- 172.21.15.96:0/1708549283 >> 172.21.15.96:0/1708549283 conn(0x7f5d000f0b90 msgr2=0x7f5d000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 -- 172.21.15.96:0/1708549283 shutdown_connections 2022-02-02T19:31:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.516+0000 7f5cff59e700 1 -- 172.21.15.96:0/1708549283 wait complete. 2022-02-02T19:31:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 Processor -- start 2022-02-02T19:31:59.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 -- start start 2022-02-02T19:31:59.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f66d0 0x7f5d0010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000603c0 con 0x7f5d000f5430 2022-02-02T19:31:59.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cff59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00060500 con 0x7f5d000f66d0 2022-02-02T19:31:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60264/0 (socket says 172.21.15.96:60264) 2022-02-02T19:31:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 -- 172.21.15.96:0/4104388411 learned_addr learned my addr 172.21.15.96:0/4104388411 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfdd9b700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f66d0 0x7f5d0010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 -- 172.21.15.96:0/4104388411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f66d0 msgr2=0x7f5d0010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f66d0 0x7f5d0010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 -- 172.21.15.96:0/4104388411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0005040 con 0x7f5d000f5430 2022-02-02T19:31:59.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.517+0000 7f5cfe59c700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f5cf4002700 tx=0x7f5cf4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.518+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf40079c0 con 0x7f5d000f5430 2022-02-02T19:31:59.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.518+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cf400f040 con 0x7f5d000f5430 2022-02-02T19:31:59.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.518+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0010c4f0 con 0x7f5d000f5430 2022-02-02T19:31:59.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.518+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf4014860 con 0x7f5d000f5430 2022-02-02T19:31:59.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.518+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0010ca80 con 0x7f5d000f5430 2022-02-02T19:31:59.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.519+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00045ad0 con 0x7f5d000f5430 2022-02-02T19:31:59.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.519+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cf401b060 con 0x7f5d000f5430 2022-02-02T19:31:59.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.520+0000 7f5ceeffd700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 0x7f5ce80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.520+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5cf4081940 con 0x7f5d000f5430 2022-02-02T19:31:59.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.520+0000 7f5cfdd9b700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 0x7f5ce80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.520+0000 7f5cfdd9b700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 0x7f5ce80672e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5cf0004630 tx=0x7f5cf0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.524+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cf404f9f0 con 0x7f5d000f5430 2022-02-02T19:31:59.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.695+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d00057f10 con 0x7f5ce8064e20 2022-02-02T19:31:59.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.705+0000 7f5ceeffd700 1 -- 172.21.15.96:0/4104388411 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5d00057f10 con 0x7f5ce8064e20 2022-02-02T19:31:59.713 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:31:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (75m) 45m ago 76m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:31:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (67m) 45m ago 76m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:31:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (67m) 44m ago 75m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:31:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (75m) 45m ago 76m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:31:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (72m) 45m ago 72m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:31:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (68m) 45m ago 72m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:31:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (72m) 44m ago 72m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:31:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (68m) 44m ago 72m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:31:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (69m) 45m ago 77m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:31:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (69m) 44m ago 75m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:31:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (68m) 45m ago 77m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:31:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (68m) 44m ago 75m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (76m) 45m ago 76m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (75m) 44m ago 75m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (67m) 45m ago 75m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (66m) 45m ago 74m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:31:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (66m) 45m ago 74m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:31:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (65m) 44m ago 74m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:31:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (65m) 44m ago 74m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:31:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (64m) 44m ago 73m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:31:59.719 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (75m) 45m ago 76m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:31:59.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.706+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 msgr2=0x7f5ce80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.706+0000 7f5cff59e700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 0x7f5ce80672e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5cf0004630 tx=0x7f5cf0009b30).stop 2022-02-02T19:31:59.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.706+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 msgr2=0x7f5d00109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.706+0000 7f5cff59e700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f5cf4002700 tx=0x7f5cf4009d80).stop 2022-02-02T19:31:59.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 shutdown_connections 2022-02-02T19:31:59.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ce8064e20 0x7f5ce80672e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d000f5430 0x7f5d00109a40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 --2- 172.21.15.96:0/4104388411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d000f66d0 0x7f5d0010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 >> 172.21.15.96:0/4104388411 conn(0x7f5d000f0b90 msgr2=0x7f5d000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:59.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 shutdown_connections 2022-02-02T19:31:59.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.707+0000 7f5cff59e700 1 -- 172.21.15.96:0/4104388411 wait complete. 2022-02-02T19:31:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- 172.21.15.96:0/2247561071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f5970 msgr2=0x7f2fac0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 --2- 172.21.15.96:0/2247561071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f5970 0x7f2fac0f5df0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f2f9c004660 tx=0x7f2f9c009b30).stop 2022-02-02T19:31:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- 172.21.15.96:0/2247561071 shutdown_connections 2022-02-02T19:31:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 --2- 172.21.15.96:0/2247561071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f5970 0x7f2fac0f5df0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 --2- 172.21.15.96:0/2247561071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f6c60 0x7f2fac0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:31:59.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- 172.21.15.96:0/2247561071 >> 172.21.15.96:0/2247561071 conn(0x7f2fac0f04c0 msgr2=0x7f2fac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:31:59.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- 172.21.15.96:0/2247561071 shutdown_connections 2022-02-02T19:31:59.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- 172.21.15.96:0/2247561071 wait complete. 2022-02-02T19:31:59.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 Processor -- start 2022-02-02T19:31:59.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.803+0000 7f2fb298f700 1 -- start start 2022-02-02T19:31:59.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fb298f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fb298f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f6c60 0x7f2fac10c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fb298f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0f5660 con 0x7f2fac0f6c60 2022-02-02T19:31:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fb298f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0f57a0 con 0x7f2fac0f5970 2022-02-02T19:31:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:36146/0 (socket says 172.21.15.96:36146) 2022-02-02T19:31:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 -- 172.21.15.96:0/1347534063 learned_addr learned my addr 172.21.15.96:0/1347534063 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:31:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 -- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f6c60 msgr2=0x7f2fac10c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:31:59.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f6c60 0x7f2fac10c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:31:59.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 -- 172.21.15.96:0/1347534063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c005040 con 0x7f2fac0f5970 2022-02-02T19:31:59.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.804+0000 7f2fabfff700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2f9400e7f0 tx=0x7f2f9400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f940092e0 con 0x7f2fac0f5970 2022-02-02T19:31:59.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac10c750 con 0x7f2fac0f5970 2022-02-02T19:31:59.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f9400f040 con 0x7f2fac0f5970 2022-02-02T19:31:59.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f94014750 con 0x7f2fac0f5970 2022-02-02T19:31:59.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac10cce0 con 0x7f2fac0f5970 2022-02-02T19:31:59.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.805+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac045ad0 con 0x7f2fac0f5970 2022-02-02T19:31:59.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.807+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f9401b030 con 0x7f2fac0f5970 2022-02-02T19:31:59.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.807+0000 7f2fa8ff9700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 0x7f2f98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:31:59.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.807+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2f94081a80 con 0x7f2fac0f5970 2022-02-02T19:31:59.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.807+0000 7f2fab7fe700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 0x7f2f98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:31:59.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.807+0000 7f2fab7fe700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 0x7f2f98067290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f2f9c004d80 tx=0x7f2f9c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:31:59.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:31:59.811+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f9404fb30 con 0x7f2fac0f5970 2022-02-02T19:32:00.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.044+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2fac0586e0 con 0x7f2fac0f5970 2022-02-02T19:32:00.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.045+0000 7f2fa8ff9700 1 -- 172.21.15.96:0/1347534063 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2f940192e0 con 0x7f2fac0f5970 2022-02-02T19:32:00.051 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:32:00.051 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:32:00.051 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:32:00.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:00.052 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:32:00.052 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:32:00.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:00.053 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:32:00.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:32:00.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:00.053 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:32:00.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:32:00.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:00.054 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:32:00.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:32:00.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:32:00.055 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:32:00.055 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:32:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 msgr2=0x7f2f98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 0x7f2f98067290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f2f9c004d80 tx=0x7f2f9c00b040).stop 2022-02-02T19:32:00.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 msgr2=0x7f2fac109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2f9400e7f0 tx=0x7f2f9400b040).stop 2022-02-02T19:32:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 shutdown_connections 2022-02-02T19:32:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f98064dd0 0x7f2f98067290 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac0f5970 0x7f2fac109c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 --2- 172.21.15.96:0/1347534063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fac0f6c60 0x7f2fac10c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:32:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 >> 172.21.15.96:0/1347534063 conn(0x7f2fac0f04c0 msgr2=0x7f2fac0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 shutdown_connections 2022-02-02T19:32:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.047+0000 7f2fb298f700 1 -- 172.21.15.96:0/1347534063 wait complete. 2022-02-02T19:32:00.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 -- 172.21.15.96:0/1675536933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f55c0 msgr2=0x7f94e80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1675536933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f55c0 0x7f94e80f59e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f94e00099e0 tx=0x7f94e0004d10).stop 2022-02-02T19:32:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 -- 172.21.15.96:0/1675536933 shutdown_connections 2022-02-02T19:32:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1675536933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f6860 0x7f94e80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:32:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1675536933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f55c0 0x7f94e80f59e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 -- 172.21.15.96:0/1675536933 >> 172.21.15.96:0/1675536933 conn(0x7f94e80f0d40 msgr2=0x7f94e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 -- 172.21.15.96:0/1675536933 shutdown_connections 2022-02-02T19:32:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 -- 172.21.15.96:0/1675536933 wait complete. 2022-02-02T19:32:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.146+0000 7f94ed31e700 1 Processor -- start 2022-02-02T19:32:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94ed31e700 1 -- start start 2022-02-02T19:32:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94ed31e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f55c0 0x7f94e81092f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94ed31e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94ed31e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8109e20 con 0x7f94e80f6860 2022-02-02T19:32:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94ed31e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e810a6d0 con 0x7f94e80f55c0 2022-02-02T19:32:00.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:00.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60286/0 (socket says 172.21.15.96:60286) 2022-02-02T19:32:00.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 -- 172.21.15.96:0/1393279882 learned_addr learned my addr 172.21.15.96:0/1393279882 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:32:00.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e6ffd700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f55c0 0x7f94e81092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 -- 172.21.15.96:0/1393279882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f55c0 msgr2=0x7f94e81092f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f55c0 0x7f94e81092f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 -- 172.21.15.96:0/1393279882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009640 con 0x7f94e80f6860 2022-02-02T19:32:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94e67fc700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f94dc00b410 tx=0x7f94dc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.147+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc0125f0 con 0x7f94e80f6860 2022-02-02T19:32:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.148+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94dc012c00 con 0x7f94e80f6860 2022-02-02T19:32:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.148+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e810a9b0 con 0x7f94e80f6860 2022-02-02T19:32:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.148+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc002ae0 con 0x7f94e80f6860 2022-02-02T19:32:00.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.148+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e810aef0 con 0x7f94e80f6860 2022-02-02T19:32:00.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.149+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e80f49b0 con 0x7f94e80f6860 2022-02-02T19:32:00.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.149+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f94dc00f030 con 0x7f94e80f6860 2022-02-02T19:32:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.149+0000 7f94cf7fe700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 0x7f94d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.149+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f94dc081ec0 con 0x7f94e80f6860 2022-02-02T19:32:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.149+0000 7f94e6ffd700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 0x7f94d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.150+0000 7f94e6ffd700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 0x7f94d0067290 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f94e0009f50 tx=0x7f94e0004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.153+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f94dc0539a0 con 0x7f94e80f6860 2022-02-02T19:32:00.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.351+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94e8045ad0 con 0x7f94e80f6860 2022-02-02T19:32:00.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:00 smithi096 ceph-mon[101353]: from='client.36266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:00.358 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:00 smithi096 ceph-mon[101353]: from='client.36270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:00.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1347534063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:32:00.359 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:00 smithi096 ceph-mon[101353]: pgmap v2096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:00.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.352+0000 7f94cf7fe700 1 -- 172.21.15.96:0/1393279882 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f94dc002d50 con 0x7f94e80f6860 2022-02-02T19:32:00.360 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:32:00.360 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:32:00.360 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:32:00.360 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:32:00.361 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:00.362 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:32:00.362 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:32:00.362 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:32:00.362 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:32:00.363 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:32:00.363 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:32:00.363 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:32:00.363 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:32:00.364 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:32:00.364 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:32:00.364 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:32:00.364 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:32:00.365 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:32:00.365 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:32:00.365 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:32:00.365 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:32:00.366 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:32:00.366 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:32:00.366 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:32:00.366 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:32:00.367 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:32:00.367 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:32:00.367 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:32:00.368 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:32:00.368 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:32:00.368 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:32:00.368 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:32:00.369 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:00.369 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:00.369 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:32:00.370 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:00.370 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:00.370 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:00.370 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:00.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 msgr2=0x7f94d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 0x7f94d0067290 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f94e0009f50 tx=0x7f94e0004d10).stop 2022-02-02T19:32:00.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 msgr2=0x7f94e81097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:00.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f94dc00b410 tx=0x7f94dc006ef0).stop 2022-02-02T19:32:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 shutdown_connections 2022-02-02T19:32:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94d0064dd0 0x7f94d0067290 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e80f55c0 0x7f94e81092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 --2- 172.21.15.96:0/1393279882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94e80f6860 0x7f94e81097e0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 >> 172.21.15.96:0/1393279882 conn(0x7f94e80f0d40 msgr2=0x7f94e805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.355+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 shutdown_connections 2022-02-02T19:32:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:00.356+0000 7f94ed31e700 1 -- 172.21.15.96:0/1393279882 wait complete. 2022-02-02T19:32:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:32:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:00 smithi159 ceph-mon[69013]: from='client.36266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:00.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:00 smithi159 ceph-mon[69013]: from='client.36270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:00.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1347534063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:32:00.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:00 smithi159 ceph-mon[69013]: pgmap v2096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:01.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1393279882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:32:01.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1393279882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:32:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:02 smithi159 ceph-mon[69013]: pgmap v2097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:02.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:02 smithi096 ceph-mon[101353]: pgmap v2097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:04 smithi159 ceph-mon[69013]: pgmap v2098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:04.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:04 smithi096 ceph-mon[101353]: pgmap v2098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:06 smithi159 ceph-mon[69013]: pgmap v2099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:06 smithi096 ceph-mon[101353]: pgmap v2099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:08 smithi159 ceph-mon[69013]: pgmap v2100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:08 smithi096 ceph-mon[101353]: pgmap v2100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:10 smithi159 ceph-mon[69013]: pgmap v2101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:10 smithi096 ceph-mon[101353]: pgmap v2101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:12 smithi159 ceph-mon[69013]: pgmap v2102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:12 smithi096 ceph-mon[101353]: pgmap v2102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:14 smithi159 ceph-mon[69013]: pgmap v2103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:14 smithi096 ceph-mon[101353]: pgmap v2103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:16 smithi159 ceph-mon[69013]: pgmap v2104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:16 smithi096 ceph-mon[101353]: pgmap v2104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:18 smithi159 ceph-mon[69013]: pgmap v2105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:18 smithi096 ceph-mon[101353]: pgmap v2105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:20 smithi159 ceph-mon[69013]: pgmap v2106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:20 smithi096 ceph-mon[101353]: pgmap v2106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:22.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:21 smithi159 ceph-mon[69013]: osdmap e86: 6 total, 6 up, 6 in 2022-02-02T19:32:22.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:21 smithi096 ceph-mon[101353]: osdmap e86: 6 total, 6 up, 6 in 2022-02-02T19:32:23.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:22 smithi159 ceph-mon[69013]: pgmap v2108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:23.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:22 smithi096 ceph-mon[101353]: pgmap v2108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:24 smithi159 ceph-mon[69013]: pgmap v2109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:24 smithi096 ceph-mon[101353]: pgmap v2109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:27.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:26 smithi159 ceph-mon[69013]: osdmap e87: 6 total, 6 up, 6 in 2022-02-02T19:32:27.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:26 smithi159 ceph-mon[69013]: pgmap v2111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:26 smithi096 ceph-mon[101353]: osdmap e87: 6 total, 6 up, 6 in 2022-02-02T19:32:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:26 smithi096 ceph-mon[101353]: pgmap v2111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:32:28.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:32:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:32:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:32:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:29 smithi159 ceph-mon[69013]: pgmap v2112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:29.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:29 smithi096 ceph-mon[101353]: pgmap v2112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:30.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 -- 172.21.15.96:0/1356971649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f66e0 msgr2=0x7ff4300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 --2- 172.21.15.96:0/1356971649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f66e0 0x7ff4300f6b00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7ff418004660 tx=0x7ff418009b30).stop 2022-02-02T19:32:30.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 -- 172.21.15.96:0/1356971649 shutdown_connections 2022-02-02T19:32:30.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 --2- 172.21.15.96:0/1356971649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f7980 0x7ff4300f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 --2- 172.21.15.96:0/1356971649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f66e0 0x7ff4300f6b00 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 -- 172.21.15.96:0/1356971649 >> 172.21.15.96:0/1356971649 conn(0x7ff4300f1e40 msgr2=0x7ff4300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 -- 172.21.15.96:0/1356971649 shutdown_connections 2022-02-02T19:32:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.467+0000 7ff434d91700 1 -- 172.21.15.96:0/1356971649 wait complete. 2022-02-02T19:32:30.477 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:30 smithi096 ceph-mon[101353]: pgmap v2113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:30.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 Processor -- start 2022-02-02T19:32:30.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 -- start start 2022-02-02T19:32:30.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f66e0 0x7ff43006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43006a380 con 0x7ff4300f7980 2022-02-02T19:32:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff434d91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43006a4c0 con 0x7ff4300f66e0 2022-02-02T19:32:30.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff42dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff42dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60304/0 (socket says 172.21.15.96:60304) 2022-02-02T19:32:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.468+0000 7ff42dd9b700 1 -- 172.21.15.96:0/2632008440 learned_addr learned my addr 172.21.15.96:0/2632008440 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:32:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff42e59c700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f66e0 0x7ff43006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff42dd9b700 1 -- 172.21.15.96:0/2632008440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f66e0 msgr2=0x7ff43006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff42dd9b700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f66e0 0x7ff43006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff42dd9b700 1 -- 172.21.15.96:0/2632008440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418005040 con 0x7ff4300f7980 2022-02-02T19:32:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff42dd9b700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7ff4200026d0 tx=0x7ff420009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4200079c0 con 0x7ff4300f7980 2022-02-02T19:32:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff42000f040 con 0x7ff4300f7980 2022-02-02T19:32:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4200148b0 con 0x7ff4300f7980 2022-02-02T19:32:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43006a7a0 con 0x7ff4300f7980 2022-02-02T19:32:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.469+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43010efe0 con 0x7ff4300f7980 2022-02-02T19:32:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.470+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430045ad0 con 0x7ff4300f7980 2022-02-02T19:32:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.471+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff420007b20 con 0x7ff4300f7980 2022-02-02T19:32:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.471+0000 7ff426ffd700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 0x7ff41c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.471+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4200818c0 con 0x7ff4300f7980 2022-02-02T19:32:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.471+0000 7ff42e59c700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 0x7ff41c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.472+0000 7ff42e59c700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 0x7ff41c067290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff418013690 tx=0x7ff418009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.475+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff42004f9c0 con 0x7ff4300f7980 2022-02-02T19:32:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:30 smithi159 ceph-mon[69013]: pgmap v2113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.656+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4300fefb0 con 0x7ff41c064dd0 2022-02-02T19:32:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.658+0000 7ff426ffd700 1 -- 172.21.15.96:0/2632008440 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff4300fefb0 con 0x7ff41c064dd0 2022-02-02T19:32:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 msgr2=0x7ff41c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 0x7ff41c067290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff418013690 tx=0x7ff418009b30).stop 2022-02-02T19:32:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 msgr2=0x7ff430069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7ff4200026d0 tx=0x7ff420009de0).stop 2022-02-02T19:32:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 shutdown_connections 2022-02-02T19:32:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff41c064dd0 0x7ff41c067290 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4300f66e0 0x7ff43006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 --2- 172.21.15.96:0/2632008440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4300f7980 0x7ff430069e20 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.659+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 >> 172.21.15.96:0/2632008440 conn(0x7ff4300f1e40 msgr2=0x7ff4300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.660+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 shutdown_connections 2022-02-02T19:32:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.660+0000 7ff434d91700 1 -- 172.21.15.96:0/2632008440 wait complete. 2022-02-02T19:32:30.676 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:32:30.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 -- 172.21.15.96:0/1988167465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 msgr2=0x7fecbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 --2- 172.21.15.96:0/1988167465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc0f7c30 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fecac004660 tx=0x7fecac009b30).stop 2022-02-02T19:32:30.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 -- 172.21.15.96:0/1988167465 shutdown_connections 2022-02-02T19:32:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 --2- 172.21.15.96:0/1988167465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc0f7c30 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 --2- 172.21.15.96:0/1988167465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 0x7fecbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 -- 172.21.15.96:0/1988167465 >> 172.21.15.96:0/1988167465 conn(0x7fecbc0f1c90 msgr2=0x7fecbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 -- 172.21.15.96:0/1988167465 shutdown_connections 2022-02-02T19:32:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 -- 172.21.15.96:0/1988167465 wait complete. 2022-02-02T19:32:30.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.758+0000 7fecc0aee700 1 Processor -- start 2022-02-02T19:32:30.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecc0aee700 1 -- start start 2022-02-02T19:32:30.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecc0aee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 0x7fecbc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecc0aee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecc0aee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc107880 con 0x7fecbc0f77d0 2022-02-02T19:32:30.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecc0aee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc108090 con 0x7fecbc0f6530 2022-02-02T19:32:30.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60314/0 (socket says 172.21.15.96:60314) 2022-02-02T19:32:30.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 -- 172.21.15.96:0/3655428372 learned_addr learned my addr 172.21.15.96:0/3655428372 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:32:30.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbb7fe700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 0x7fecbc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 -- 172.21.15.96:0/3655428372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 msgr2=0x7fecbc106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 0x7fecbc106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 -- 172.21.15.96:0/3655428372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac005040 con 0x7fecbc0f77d0 2022-02-02T19:32:30.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.759+0000 7fecbaffd700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fecac009990 tx=0x7fecac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:30.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.760+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecac018070 con 0x7fecbc0f77d0 2022-02-02T19:32:30.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.760+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc1082b0 con 0x7fecbc0f77d0 2022-02-02T19:32:30.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.760+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecac007ba0 con 0x7fecbc0f77d0 2022-02-02T19:32:30.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.760+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecac01c3c0 con 0x7fecbc0f77d0 2022-02-02T19:32:30.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.760+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc108810 con 0x7fecbc0f77d0 2022-02-02T19:32:30.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.761+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc059100 con 0x7fecbc0f77d0 2022-02-02T19:32:30.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.761+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fecac01d420 con 0x7fecbc0f77d0 2022-02-02T19:32:30.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.761+0000 7feca3fff700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:30.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.762+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fecac0836b0 con 0x7fecbc0f77d0 2022-02-02T19:32:30.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.762+0000 7fecbb7fe700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:30.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.762+0000 7fecbb7fe700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 0x7feca40672e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fecbc106b00 tx=0x7fecb000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:30.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.766+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fecac051810 con 0x7fecbc0f77d0 2022-02-02T19:32:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.939+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fecbc0fee80 con 0x7feca4064e20 2022-02-02T19:32:30.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.949+0000 7feca3fff700 1 -- 172.21.15.96:0/3655428372 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fecbc0fee80 con 0x7feca4064e20 2022-02-02T19:32:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:32:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (75m) 46m ago 77m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:32:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (68m) 46m ago 76m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:32:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (68m) 44m ago 76m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:32:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (75m) 46m ago 76m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:32:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (72m) 46m ago 72m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:32:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (68m) 46m ago 73m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:32:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (73m) 44m ago 73m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:32:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (68m) 44m ago 73m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:32:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (70m) 46m ago 78m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:32:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (69m) 44m ago 76m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:32:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (69m) 46m ago 78m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:32:30.959 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (68m) 44m ago 76m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:32:30.959 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (76m) 46m ago 76m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:32:30.959 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (76m) 44m ago 76m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:32:30.959 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (67m) 46m ago 75m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:32:30.960 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (67m) 46m ago 75m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:32:30.960 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (66m) 46m ago 75m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:32:30.960 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (66m) 44m ago 74m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:32:30.960 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (65m) 44m ago 74m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:32:30.961 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (65m) 44m ago 74m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:32:30.961 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (75m) 46m ago 76m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:32:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 msgr2=0x7feca40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 0x7feca40672e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fecbc106b00 tx=0x7fecb000b040).stop 2022-02-02T19:32:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 msgr2=0x7fecbc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fecac009990 tx=0x7fecac009b30).stop 2022-02-02T19:32:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 shutdown_connections 2022-02-02T19:32:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecbc0f6530 0x7fecbc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 --2- 172.21.15.96:0/3655428372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecbc0f77d0 0x7fecbc107280 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:30.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 >> 172.21.15.96:0/3655428372 conn(0x7fecbc0f1c90 msgr2=0x7fecbc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:30.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 shutdown_connections 2022-02-02T19:32:30.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:30.951+0000 7fecc0aee700 1 -- 172.21.15.96:0/3655428372 wait complete. 2022-02-02T19:32:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 -- 172.21.15.96:0/1575712342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 msgr2=0x7fbff00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 --2- 172.21.15.96:0/1575712342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff00f7de0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fbfe4004660 tx=0x7fbfe4009b30).stop 2022-02-02T19:32:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 -- 172.21.15.96:0/1575712342 shutdown_connections 2022-02-02T19:32:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 --2- 172.21.15.96:0/1575712342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff00f7de0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 --2- 172.21.15.96:0/1575712342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 -- 172.21.15.96:0/1575712342 >> 172.21.15.96:0/1575712342 conn(0x7fbff00f1e40 msgr2=0x7fbff00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 -- 172.21.15.96:0/1575712342 shutdown_connections 2022-02-02T19:32:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.048+0000 7fbff6902700 1 -- 172.21.15.96:0/1575712342 wait complete. 2022-02-02T19:32:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 Processor -- start 2022-02-02T19:32:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 -- start start 2022-02-02T19:32:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0107a00 con 0x7fbff00f66e0 2022-02-02T19:32:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbff6902700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0107b40 con 0x7fbff00f7980 2022-02-02T19:32:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60326/0 (socket says 172.21.15.96:60326) 2022-02-02T19:32:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.049+0000 7fbfeffff700 1 -- 172.21.15.96:0/87469596 learned_addr learned my addr 172.21.15.96:0/87469596 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:32:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfeffff700 1 -- 172.21.15.96:0/87469596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 msgr2=0x7fbff0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfeffff700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfeffff700 1 -- 172.21.15.96:0/87469596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4005040 con 0x7fbff00f66e0 2022-02-02T19:32:31.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:32:31.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfeffff700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fbfe000c530 tx=0x7fbfe0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe000f650 con 0x7fbff00f66e0 2022-02-02T19:32:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff01084e0 con 0x7fbff00f66e0 2022-02-02T19:32:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfe000fc60 con 0x7fbff00f66e0 2022-02-02T19:32:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe0012d20 con 0x7fbff00f66e0 2022-02-02T19:32:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.050+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0108aa0 con 0x7fbff00f66e0 2022-02-02T19:32:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.051+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff0045ad0 con 0x7fbff00f66e0 2022-02-02T19:32:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.052+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbfe0019030 con 0x7fbff00f66e0 2022-02-02T19:32:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.052+0000 7fbfecff9700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 0x7fbfd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.052+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbfe0081710 con 0x7fbff00f66e0 2022-02-02T19:32:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.052+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 0x7fbfd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.052+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 0x7fbfd8067290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fbfe4004e30 tx=0x7fbfe4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.056+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbfe0053290 con 0x7fbff00f66e0 2022-02-02T19:32:31.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.284+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbff00fefa0 con 0x7fbff00f66e0 2022-02-02T19:32:31.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.285+0000 7fbfecff9700 1 -- 172.21.15.96:0/87469596 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbfe0052e80 con 0x7fbff00f66e0 2022-02-02T19:32:31.292 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:32:31.292 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:32:31.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:32:31.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:31.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:32:31.293 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:32:31.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:31.293 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:32:31.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:32:31.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:31.294 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:32:31.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:32:31.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:32:31.295 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:32:31.295 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:32:31.295 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:32:31.296 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:32:31.296 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:32:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 msgr2=0x7fbfd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 0x7fbfd8067290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fbfe4004e30 tx=0x7fbfe4009b30).stop 2022-02-02T19:32:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 msgr2=0x7fbff0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fbfe000c530 tx=0x7fbfe0007e10).stop 2022-02-02T19:32:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 shutdown_connections 2022-02-02T19:32:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfd8064dd0 0x7fbfd8067290 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff0106f60 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 --2- 172.21.15.96:0/87469596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.286+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 >> 172.21.15.96:0/87469596 conn(0x7fbff00f1e40 msgr2=0x7fbff00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.287+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 shutdown_connections 2022-02-02T19:32:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.287+0000 7fbff6902700 1 -- 172.21.15.96:0/87469596 wait complete. 2022-02-02T19:32:31.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 -- 172.21.15.96:0/1791405517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f55c0 msgr2=0x7f55fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 --2- 172.21.15.96:0/1791405517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f55c0 0x7f55fc0f59e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f55f0004660 tx=0x7f55f0009b30).stop 2022-02-02T19:32:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 -- 172.21.15.96:0/1791405517 shutdown_connections 2022-02-02T19:32:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 --2- 172.21.15.96:0/1791405517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f6860 0x7f55fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 --2- 172.21.15.96:0/1791405517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f55c0 0x7f55fc0f59e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 -- 172.21.15.96:0/1791405517 >> 172.21.15.96:0/1791405517 conn(0x7f55fc0f0d40 msgr2=0x7f55fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 -- 172.21.15.96:0/1791405517 shutdown_connections 2022-02-02T19:32:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 -- 172.21.15.96:0/1791405517 wait complete. 2022-02-02T19:32:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.385+0000 7f56020b7700 1 Processor -- start 2022-02-02T19:32:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f56020b7700 1 -- start start 2022-02-02T19:32:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f56020b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 0x7f55fc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f56020b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f56020b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc107a10 con 0x7f55fc0f6860 2022-02-02T19:32:31.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f56020b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc107b50 con 0x7f55fc0f55c0 2022-02-02T19:32:31.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60338/0 (socket says 172.21.15.96:60338) 2022-02-02T19:32:31.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 -- 172.21.15.96:0/1118120099 learned_addr learned my addr 172.21.15.96:0/1118120099 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:32:31.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55fb7fe700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 0x7f55fc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 -- 172.21.15.96:0/1118120099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 msgr2=0x7f55fc106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 0x7f55fc106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 -- 172.21.15.96:0/1118120099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0005040 con 0x7f55fc0f6860 2022-02-02T19:32:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55fb7fe700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 0x7f55fc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:32:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.386+0000 7f55faffd700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f55ec0026d0 tx=0x7f55ec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:31.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.387+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec009320 con 0x7f55fc0f6860 2022-02-02T19:32:31.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.387+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55ec00f040 con 0x7f55fc0f6860 2022-02-02T19:32:31.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.387+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc1084f0 con 0x7f55fc0f6860 2022-02-02T19:32:31.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.387+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec0147e0 con 0x7f55fc0f6860 2022-02-02T19:32:31.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.387+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc108ab0 con 0x7f55fc0f6860 2022-02-02T19:32:31.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.388+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc045ad0 con 0x7f55fc0f6860 2022-02-02T19:32:31.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.388+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55ec009480 con 0x7f55fc0f6860 2022-02-02T19:32:31.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.388+0000 7f55e3fff700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 0x7f55e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:32:31.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.389+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55ec082120 con 0x7f55fc0f6860 2022-02-02T19:32:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.389+0000 7f55fb7fe700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 0x7f55e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:32:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.389+0000 7f55fb7fe700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 0x7f55e4067290 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f55f0005010 tx=0x7f55f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:32:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.393+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55ec053c50 con 0x7f55fc0f6860 2022-02-02T19:32:31.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.592+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f55fc10d650 con 0x7f55fc0f6860 2022-02-02T19:32:31.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.592+0000 7f55e3fff700 1 -- 172.21.15.96:0/1118120099 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f55ec053840 con 0x7f55fc0f6860 2022-02-02T19:32:31.600 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:32:31.600 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:32:31.600 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:32:31.600 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:32:31.601 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:31.601 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:32:31.601 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:32:31.601 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:32:31.601 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:32:31.602 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:32:31.602 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:32:31.602 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:32:31.603 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:32:31.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:32:31.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:32:31.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:32:31.603 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:32:31.604 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:32:31.604 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:32:31.604 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:32:31.604 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:32:31.605 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:32:31.605 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:32:31.605 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:32:31.605 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:32:31.605 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:32:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:32:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:32:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:32:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:32:31.607 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:32:31.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:32:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:31.607 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:32:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:32:31.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:31.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:31.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:32:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 msgr2=0x7f55e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 0x7f55e4067290 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f55f0005010 tx=0x7f55f0009b30).stop 2022-02-02T19:32:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 msgr2=0x7f55fc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:32:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f55ec0026d0 tx=0x7f55ec009de0).stop 2022-02-02T19:32:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 shutdown_connections 2022-02-02T19:32:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55e4064dd0 0x7f55e4067290 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55fc0f55c0 0x7f55fc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 --2- 172.21.15.96:0/1118120099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55fc0f6860 0x7f55fc107460 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:32:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 >> 172.21.15.96:0/1118120099 conn(0x7f55fc0f0d40 msgr2=0x7f55fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:32:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 shutdown_connections 2022-02-02T19:32:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:32:31.594+0000 7f56020b7700 1 -- 172.21.15.96:0/1118120099 wait complete. 2022-02-02T19:32:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:32:32.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:31 smithi159 ceph-mon[69013]: from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:32.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:31 smithi159 ceph-mon[69013]: from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:32.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/87469596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:32:32.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1118120099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:32:32.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:31 smithi096 ceph-mon[101353]: from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:32.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:31 smithi096 ceph-mon[101353]: from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:32:32.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/87469596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:32:32.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1118120099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:32:33.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:32 smithi159 ceph-mon[69013]: pgmap v2114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:33.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:32 smithi096 ceph-mon[101353]: pgmap v2114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:34.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:34 smithi159 ceph-mon[69013]: pgmap v2115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:34.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:34 smithi096 ceph-mon[101353]: pgmap v2115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:36 smithi159 ceph-mon[69013]: pgmap v2116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:36 smithi096 ceph-mon[101353]: pgmap v2116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:38 smithi159 ceph-mon[69013]: pgmap v2117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:38.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:38 smithi096 ceph-mon[101353]: pgmap v2117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:40 smithi159 ceph-mon[69013]: pgmap v2118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:40 smithi096 ceph-mon[101353]: pgmap v2118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:42 smithi159 ceph-mon[69013]: pgmap v2119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:42 smithi096 ceph-mon[101353]: pgmap v2119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:44 smithi159 ceph-mon[69013]: pgmap v2120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:44 smithi096 ceph-mon[101353]: pgmap v2120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:46 smithi159 ceph-mon[69013]: pgmap v2121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:47.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:46 smithi096 ceph-mon[101353]: pgmap v2121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:48 smithi159 ceph-mon[69013]: pgmap v2122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:48 smithi096 ceph-mon[101353]: pgmap v2122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:50 smithi159 ceph-mon[69013]: pgmap v2123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:50.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:50 smithi096 ceph-mon[101353]: pgmap v2123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:52 smithi159 ceph-mon[69013]: pgmap v2124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:52 smithi096 ceph-mon[101353]: pgmap v2124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:54 smithi159 ceph-mon[69013]: pgmap v2125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:54.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:54 smithi096 ceph-mon[101353]: pgmap v2125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:57 smithi159 ceph-mon[69013]: pgmap v2126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:56 smithi096 ceph-mon[101353]: pgmap v2126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:32:58 smithi159 ceph-mon[69013]: pgmap v2127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:32:58.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:32:58 smithi096 ceph-mon[101353]: pgmap v2127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:00 smithi159 ceph-mon[69013]: pgmap v2128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:00.718 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:00 smithi096 ceph-mon[101353]: pgmap v2128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 -- 172.21.15.96:0/4276883691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 msgr2=0x7fbbbc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 --2- 172.21.15.96:0/4276883691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc0f6b00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fbbb0004660 tx=0x7fbbb0009b30).stop 2022-02-02T19:33:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 -- 172.21.15.96:0/4276883691 shutdown_connections 2022-02-02T19:33:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 --2- 172.21.15.96:0/4276883691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 0x7fbbbc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 --2- 172.21.15.96:0/4276883691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc0f6b00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 -- 172.21.15.96:0/4276883691 >> 172.21.15.96:0/4276883691 conn(0x7fbbbc0f1e40 msgr2=0x7fbbbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:01.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 -- 172.21.15.96:0/4276883691 shutdown_connections 2022-02-02T19:33:01.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.705+0000 7fbbc3424700 1 -- 172.21.15.96:0/4276883691 wait complete. 2022-02-02T19:33:01.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 Processor -- start 2022-02-02T19:33:01.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 -- start start 2022-02-02T19:33:01.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:01.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 0x7fbbbc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:01.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc107a50 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.706+0000 7fbbc3424700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc107b90 con 0x7fbbbc0f7980 2022-02-02T19:33:01.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:01.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60352/0 (socket says 172.21.15.96:60352) 2022-02-02T19:33:01.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 -- 172.21.15.96:0/513361936 learned_addr learned my addr 172.21.15.96:0/513361936 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:01.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc09bf700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 0x7fbbbc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:01.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 -- 172.21.15.96:0/513361936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 msgr2=0x7fbbbc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:01.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 0x7fbbbc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 -- 172.21.15.96:0/513361936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0005040 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc11c0700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fbbb0013a70 tx=0x7fbbb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:01.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb0018070 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbb00097d0 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc1084d0 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.707+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb001de80 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.708+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc108a30 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.708+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbbc045ad0 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.709+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbbb0007ba0 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.709+0000 7fbbadffb700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 0x7fbba8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:01.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.710+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbbb0083620 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.710+0000 7fbbc09bf700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 0x7fbba8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.710+0000 7fbbc09bf700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 0x7fbba8067290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fbbb8004c40 tx=0x7fbbb800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.714+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbbb0055090 con 0x7fbbbc0f66e0 2022-02-02T19:33:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.893+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbbc0fefb0 con 0x7fbba8064dd0 2022-02-02T19:33:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.895+0000 7fbbadffb700 1 -- 172.21.15.96:0/513361936 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbbbc0fefb0 con 0x7fbba8064dd0 2022-02-02T19:33:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 msgr2=0x7fbba8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 0x7fbba8067290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fbbb8004c40 tx=0x7fbbb800b040).stop 2022-02-02T19:33:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 msgr2=0x7fbbbc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fbbb0013a70 tx=0x7fbbb0009b30).stop 2022-02-02T19:33:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 shutdown_connections 2022-02-02T19:33:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbba8064dd0 0x7fbba8067290 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbbc0f66e0 0x7fbbbc106fb0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 --2- 172.21.15.96:0/513361936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbbc0f7980 0x7fbbbc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.896+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 >> 172.21.15.96:0/513361936 conn(0x7fbbbc0f1e40 msgr2=0x7fbbbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.897+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 shutdown_connections 2022-02-02T19:33:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.897+0000 7fbbc3424700 1 -- 172.21.15.96:0/513361936 wait complete. 2022-02-02T19:33:01.912 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:33:02.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 -- 172.21.15.96:0/1824181958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f55c0 msgr2=0x7f72b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 --2- 172.21.15.96:0/1824181958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f55c0 0x7f72b00f59e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f72a4004660 tx=0x7f72a4009b30).stop 2022-02-02T19:33:02.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 -- 172.21.15.96:0/1824181958 shutdown_connections 2022-02-02T19:33:02.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 --2- 172.21.15.96:0/1824181958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f6860 0x7f72b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 --2- 172.21.15.96:0/1824181958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f55c0 0x7f72b00f59e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 -- 172.21.15.96:0/1824181958 >> 172.21.15.96:0/1824181958 conn(0x7f72b00f0d40 msgr2=0x7f72b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 -- 172.21.15.96:0/1824181958 shutdown_connections 2022-02-02T19:33:02.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.995+0000 7f72b5924700 1 -- 172.21.15.96:0/1824181958 wait complete. 2022-02-02T19:33:02.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 Processor -- start 2022-02-02T19:33:02.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 -- start start 2022-02-02T19:33:02.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 0x7f72b00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00f8100 con 0x7f72b00f6860 2022-02-02T19:33:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72b5924700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00f8240 con 0x7f72b00f55c0 2022-02-02T19:33:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60364/0 (socket says 172.21.15.96:60364) 2022-02-02T19:33:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 -- 172.21.15.96:0/4237220018 learned_addr learned my addr 172.21.15.96:0/4237220018 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72aeffd700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 0x7f72b00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 -- 172.21.15.96:0/4237220018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 msgr2=0x7f72b00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 0x7f72b00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72ae7fc700 1 -- 172.21.15.96:0/4237220018 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4005040 con 0x7f72b00f6860 2022-02-02T19:33:02.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.996+0000 7f72aeffd700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 0x7f72b00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:33:02.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72ae7fc700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f72a000e7f0 tx=0x7f72a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a00092e0 con 0x7f72b00f6860 2022-02-02T19:33:02.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00f8520 con 0x7f72b00f6860 2022-02-02T19:33:02.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72a000f040 con 0x7f72b00f6860 2022-02-02T19:33:02.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a0014750 con 0x7f72b00f6860 2022-02-02T19:33:02.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.997+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b010ef20 con 0x7f72b00f6860 2022-02-02T19:33:02.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.998+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b0045ad0 con 0x7f72b00f6860 2022-02-02T19:33:02.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.998+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72a001b030 con 0x7f72b00f6860 2022-02-02T19:33:02.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.999+0000 7f72977fe700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 0x7f7298067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.999+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f72a0081830 con 0x7f72b00f6860 2022-02-02T19:33:02.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.999+0000 7f72aeffd700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 0x7f7298067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:01.999+0000 7f72aeffd700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 0x7f7298067290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f72a4000c00 tx=0x7f72a4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.003+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72a004f9e0 con 0x7f72b00f6860 2022-02-02T19:33:02.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.179+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72b00faca0 con 0x7f7298064dd0 2022-02-02T19:33:02.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.188+0000 7f72977fe700 1 -- 172.21.15.96:0/4237220018 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f72b00faca0 con 0x7f7298064dd0 2022-02-02T19:33:02.194 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:33:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (76m) 47m ago 77m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:33:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (68m) 47m ago 77m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:33:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (68m) 45m ago 76m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:33:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (76m) 47m ago 77m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:33:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (73m) 47m ago 73m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:33:02.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (69m) 47m ago 73m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:33:02.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (73m) 45m ago 73m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:33:02.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (69m) 45m ago 73m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:33:02.196 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (70m) 47m ago 78m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:33:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (70m) 45m ago 76m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:33:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (69m) 47m ago 78m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:33:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (69m) 45m ago 76m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:33:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (77m) 47m ago 77m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:33:02.198 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (76m) 45m ago 76m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:33:02.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (68m) 47m ago 76m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:33:02.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (67m) 47m ago 75m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:33:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (67m) 47m ago 75m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:33:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (66m) 45m ago 75m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:33:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (66m) 45m ago 75m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:33:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (65m) 45m ago 74m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:33:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (76m) 47m ago 77m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:33:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 msgr2=0x7f7298067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 0x7f7298067290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f72a4000c00 tx=0x7f72a4016040).stop 2022-02-02T19:33:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 msgr2=0x7f72b00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f72a000e7f0 tx=0x7f72a000b040).stop 2022-02-02T19:33:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 shutdown_connections 2022-02-02T19:33:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7298064dd0 0x7f7298067290 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b00f55c0 0x7f72b00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 --2- 172.21.15.96:0/4237220018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b00f6860 0x7f72b00f7ba0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 >> 172.21.15.96:0/4237220018 conn(0x7f72b00f0d40 msgr2=0x7f72b005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 shutdown_connections 2022-02-02T19:33:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.191+0000 7f72b5924700 1 -- 172.21.15.96:0/4237220018 wait complete. 2022-02-02T19:33:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.287+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1286362996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f7980 msgr2=0x7f1fbc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.287+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1286362996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc0f7de0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f1fac004660 tx=0x7f1fac009b30).stop 2022-02-02T19:33:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1286362996 shutdown_connections 2022-02-02T19:33:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1286362996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc0f7de0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1286362996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1286362996 >> 172.21.15.96:0/1286362996 conn(0x7f1fbc0f1e40 msgr2=0x7f1fbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:02 smithi096 ceph-mon[101353]: from='client.36296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:02.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:02 smithi096 ceph-mon[101353]: pgmap v2129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1286362996 shutdown_connections 2022-02-02T19:33:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1286362996 wait complete. 2022-02-02T19:33:02.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 Processor -- start 2022-02-02T19:33:02.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.288+0000 7f1fc11d9700 1 -- start start 2022-02-02T19:33:02.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc107a00 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc107b40 con 0x7f1fbc0f7980 2022-02-02T19:33:02.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60372/0 (socket says 172.21.15.96:60372) 2022-02-02T19:33:02.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 -- 172.21.15.96:0/1542469670 learned_addr learned my addr 172.21.15.96:0/1542469670 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fba59c700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 -- 172.21.15.96:0/1542469670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f7980 msgr2=0x7f1fbc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 -- 172.21.15.96:0/1542469670 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac005040 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fbad9d700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f1fb000c530 tx=0x7f1fb0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb000f650 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fb000fc60 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc1084e0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb0012cb0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.289+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc108aa0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.290+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c004fa0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.291+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1fb0019030 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.291+0000 7f1fa37fe700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 0x7f1fa4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.291+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1fb00815c0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.291+0000 7f1fba59c700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 0x7f1fa4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.292+0000 7f1fba59c700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 0x7f1fa4067290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f1fac004630 tx=0x7f1fac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.295+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1fb00531a0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:02 smithi159 ceph-mon[69013]: from='client.36296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:02 smithi159 ceph-mon[69013]: pgmap v2129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.530+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1f9c005e80 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.530+0000 7f1fa37fe700 1 -- 172.21.15.96:0/1542469670 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1fb00172e0 con 0x7f1fbc0f66e0 2022-02-02T19:33:02.536 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:33:02.536 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:33:02.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:33:02.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:02.537 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:33:02.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:33:02.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:02.538 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:33:02.538 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:33:02.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:02.538 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:33:02.539 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:33:02.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:02.539 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:33:02.539 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:33:02.539 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:33:02.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:33:02.540 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:33:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 msgr2=0x7f1fa4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 0x7f1fa4067290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f1fac004630 tx=0x7f1fac009b30).stop 2022-02-02T19:33:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 msgr2=0x7f1fbc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f1fb000c530 tx=0x7f1fb0007e10).stop 2022-02-02T19:33:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 shutdown_connections 2022-02-02T19:33:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa4064dd0 0x7f1fa4067290 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fbc0f66e0 0x7f1fbc106f60 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 --2- 172.21.15.96:0/1542469670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fbc0f7980 0x7f1fbc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.532+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 >> 172.21.15.96:0/1542469670 conn(0x7f1fbc0f1e40 msgr2=0x7f1fbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.533+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 shutdown_connections 2022-02-02T19:33:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.533+0000 7f1fc11d9700 1 -- 172.21.15.96:0/1542469670 wait complete. 2022-02-02T19:33:02.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 -- 172.21.15.96:0/3457450880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 msgr2=0x7f6c080f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/3457450880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c080f7dd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6bf8004660 tx=0x7f6bf8009b30).stop 2022-02-02T19:33:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 -- 172.21.15.96:0/3457450880 shutdown_connections 2022-02-02T19:33:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/3457450880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c080f7dd0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/3457450880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 0x7f6c080f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 -- 172.21.15.96:0/3457450880 >> 172.21.15.96:0/3457450880 conn(0x7f6c080f1e10 msgr2=0x7f6c080f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 -- 172.21.15.96:0/3457450880 shutdown_connections 2022-02-02T19:33:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.630+0000 7f6c0d86a700 1 -- 172.21.15.96:0/3457450880 wait complete. 2022-02-02T19:33:02.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 Processor -- start 2022-02-02T19:33:02.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 -- start start 2022-02-02T19:33:02.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 0x7f6c08106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c081079f0 con 0x7f6c080f7970 2022-02-02T19:33:02.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c0d86a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08107b30 con 0x7f6c080f66d0 2022-02-02T19:33:02.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60384/0 (socket says 172.21.15.96:60384) 2022-02-02T19:33:02.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 -- 172.21.15.96:0/1861146572 learned_addr learned my addr 172.21.15.96:0/1861146572 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:02.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c06ffd700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 0x7f6c08106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 -- 172.21.15.96:0/1861146572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 msgr2=0x7f6c08106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 0x7f6c08106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.631+0000 7f6c067fc700 1 -- 172.21.15.96:0/1861146572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8005040 con 0x7f6c080f7970 2022-02-02T19:33:02.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6c067fc700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f6bf8009990 tx=0x7f6bf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf8018070 con 0x7f6c080f7970 2022-02-02T19:33:02.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6bf8007ca0 con 0x7f6c080f7970 2022-02-02T19:33:02.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c08108470 con 0x7f6c080f7970 2022-02-02T19:33:02.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf801c620 con 0x7f6c080f7970 2022-02-02T19:33:02.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.632+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c081089d0 con 0x7f6c080f7970 2022-02-02T19:33:02.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.633+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08045ad0 con 0x7f6c080f7970 2022-02-02T19:33:02.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.633+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6bf801d960 con 0x7f6c080f7970 2022-02-02T19:33:02.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.634+0000 7f6bef7fe700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 0x7f6bf0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:02.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.634+0000 7f6c06ffd700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 0x7f6bf0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:02.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.634+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6bf8083710 con 0x7f6c080f7970 2022-02-02T19:33:02.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.634+0000 7f6c06ffd700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 0x7f6bf0067290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6c080f77d0 tx=0x7f6bfc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:02.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.638+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6bf8055300 con 0x7f6c080f7970 2022-02-02T19:33:02.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.840+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c08027a00 con 0x7f6c080f7970 2022-02-02T19:33:02.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.840+0000 7f6bef7fe700 1 -- 172.21.15.96:0/1861146572 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6bf8054ef0 con 0x7f6c080f7970 2022-02-02T19:33:02.847 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:33:02.847 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:33:02.847 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:33:02.847 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:33:02.848 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:02.848 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:33:02.848 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:33:02.848 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:33:02.849 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:33:02.849 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:33:02.849 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:33:02.849 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:33:02.850 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:33:02.850 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:33:02.850 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:33:02.850 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:33:02.850 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:33:02.851 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:33:02.851 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:33:02.851 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:33:02.851 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:33:02.852 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:33:02.852 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:33:02.852 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:33:02.852 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:33:02.853 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:33:02.853 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:33:02.853 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:33:02.853 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:33:02.853 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:33:02.854 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:33:02.854 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:33:02.854 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:02.854 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:02.855 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:33:02.855 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:02.855 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:02.855 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:02.856 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 msgr2=0x7f6bf0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 0x7f6bf0067290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6c080f77d0 tx=0x7f6bfc009040).stop 2022-02-02T19:33:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 msgr2=0x7f6c08107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f6bf8009990 tx=0x7f6bf8009b30).stop 2022-02-02T19:33:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 shutdown_connections 2022-02-02T19:33:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6bf0064dd0 0x7f6bf0067290 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080f66d0 0x7f6c08106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 --2- 172.21.15.96:0/1861146572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c080f7970 0x7f6c08107440 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 >> 172.21.15.96:0/1861146572 conn(0x7f6c080f1e10 msgr2=0x7f6c080fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 shutdown_connections 2022-02-02T19:33:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:02.842+0000 7f6c0d86a700 1 -- 172.21.15.96:0/1861146572 wait complete. 2022-02-02T19:33:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:33:03.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:03 smithi159 ceph-mon[69013]: from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:03.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1542469670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:33:03.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1861146572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:33:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:03 smithi096 ceph-mon[101353]: from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:03.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1542469670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:33:03.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1861146572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:33:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:04 smithi159 ceph-mon[69013]: pgmap v2130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:04.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:04 smithi096 ceph-mon[101353]: pgmap v2130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:07.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:07 smithi159 ceph-mon[69013]: pgmap v2131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:07.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:07 smithi096 ceph-mon[101353]: pgmap v2131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:08 smithi159 ceph-mon[69013]: pgmap v2132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:08 smithi096 ceph-mon[101353]: pgmap v2132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:10 smithi159 ceph-mon[69013]: pgmap v2133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:10.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:10 smithi096 ceph-mon[101353]: pgmap v2133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:12.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:12 smithi159 ceph-mon[69013]: pgmap v2134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:12.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:12 smithi096 ceph-mon[101353]: pgmap v2134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:14.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:14 smithi159 ceph-mon[69013]: pgmap v2135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:14 smithi096 ceph-mon[101353]: pgmap v2135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:17.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:17 smithi159 ceph-mon[69013]: pgmap v2136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:17.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:17 smithi096 ceph-mon[101353]: pgmap v2136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:18 smithi159 ceph-mon[69013]: pgmap v2137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:18 smithi096 ceph-mon[101353]: pgmap v2137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:20.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:20 smithi159 ceph-mon[69013]: pgmap v2138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:20.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:20 smithi096 ceph-mon[101353]: pgmap v2138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:22 smithi159 ceph-mon[69013]: pgmap v2139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:22 smithi096 ceph-mon[101353]: pgmap v2139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:24 smithi159 ceph-mon[69013]: pgmap v2140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:24.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:24 smithi096 ceph-mon[101353]: pgmap v2140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:27.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:27 smithi159 ceph-mon[69013]: pgmap v2141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:27.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:27 smithi096 ceph-mon[101353]: pgmap v2141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:33:28.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:33:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:33:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:33:29.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:29 smithi159 ceph-mon[69013]: pgmap v2142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:29.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:29 smithi096 ceph-mon[101353]: pgmap v2142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:30 smithi159 ceph-mon[69013]: pgmap v2143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:30.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:30 smithi096 ceph-mon[101353]: pgmap v2143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:32.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:32 smithi159 ceph-mon[69013]: pgmap v2144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:32 smithi096 ceph-mon[101353]: pgmap v2144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 -- 172.21.15.96:0/3675112096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 msgr2=0x7f8eb40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 --2- 172.21.15.96:0/3675112096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb40f6b00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f8ea8004660 tx=0x7f8ea8009b30).stop 2022-02-02T19:33:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 -- 172.21.15.96:0/3675112096 shutdown_connections 2022-02-02T19:33:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 --2- 172.21.15.96:0/3675112096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 0x7f8eb40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 --2- 172.21.15.96:0/3675112096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb40f6b00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 -- 172.21.15.96:0/3675112096 >> 172.21.15.96:0/3675112096 conn(0x7f8eb40f1e40 msgr2=0x7f8eb40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 -- 172.21.15.96:0/3675112096 shutdown_connections 2022-02-02T19:33:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.950+0000 7f8eb9582700 1 -- 172.21.15.96:0/3675112096 wait complete. 2022-02-02T19:33:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 Processor -- start 2022-02-02T19:33:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 -- start start 2022-02-02T19:33:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 0x7f8eb4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406a380 con 0x7f8eb40f66e0 2022-02-02T19:33:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb9582700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406a4c0 con 0x7f8eb40f7980 2022-02-02T19:33:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60400/0 (socket says 172.21.15.96:60400) 2022-02-02T19:33:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 -- 172.21.15.96:0/191738814 learned_addr learned my addr 172.21.15.96:0/191738814 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb27fc700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 0x7f8eb4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 -- 172.21.15.96:0/191738814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 msgr2=0x7f8eb4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 0x7f8eb4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 -- 172.21.15.96:0/191738814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8005040 con 0x7f8eb40f66e0 2022-02-02T19:33:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.951+0000 7f8eb2ffd700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f8ea8004f60 tx=0x7f8ea8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.952+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea8018070 con 0x7f8eb40f66e0 2022-02-02T19:33:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.952+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb406a740 con 0x7f8eb40f66e0 2022-02-02T19:33:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.952+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ea8007ba0 con 0x7f8eb40f66e0 2022-02-02T19:33:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.952+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea801c620 con 0x7f8eb40f66e0 2022-02-02T19:33:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.952+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb406aca0 con 0x7f8eb40f66e0 2022-02-02T19:33:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.953+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4045ad0 con 0x7f8eb40f66e0 2022-02-02T19:33:32.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.953+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ea801c8e0 con 0x7f8eb40f66e0 2022-02-02T19:33:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.953+0000 7f8e9b7fe700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 0x7f8e9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.954+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8ea8083940 con 0x7f8eb40f66e0 2022-02-02T19:33:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.954+0000 7f8eb27fc700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 0x7f8e9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.954+0000 7f8eb27fc700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 0x7f8e9c067290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f8ea4004a70 tx=0x7f8ea4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:32.958+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ea8051a40 con 0x7f8eb40f66e0 2022-02-02T19:33:33.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.134+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb40fefb0 con 0x7f8e9c064dd0 2022-02-02T19:33:33.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.135+0000 7f8e9b7fe700 1 -- 172.21.15.96:0/191738814 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8eb40fefb0 con 0x7f8e9c064dd0 2022-02-02T19:33:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 msgr2=0x7f8e9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 0x7f8e9c067290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f8ea4004a70 tx=0x7f8ea4009040).stop 2022-02-02T19:33:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 msgr2=0x7f8eb406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f8ea8004f60 tx=0x7f8ea8009b30).stop 2022-02-02T19:33:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 shutdown_connections 2022-02-02T19:33:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e9c064dd0 0x7f8e9c067290 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb40f66e0 0x7f8eb406b9a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 --2- 172.21.15.96:0/191738814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb40f7980 0x7f8eb4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.137+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 >> 172.21.15.96:0/191738814 conn(0x7f8eb40f1e40 msgr2=0x7f8eb40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.138+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 shutdown_connections 2022-02-02T19:33:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.138+0000 7f8eb9582700 1 -- 172.21.15.96:0/191738814 wait complete. 2022-02-02T19:33:33.152 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:33:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 -- 172.21.15.96:0/2600576262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 msgr2=0x7fb0100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 --2- 172.21.15.96:0/2600576262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb0100f6b00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fb000004660 tx=0x7fb000009b30).stop 2022-02-02T19:33:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 -- 172.21.15.96:0/2600576262 shutdown_connections 2022-02-02T19:33:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 --2- 172.21.15.96:0/2600576262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0100f7980 0x7fb0100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 --2- 172.21.15.96:0/2600576262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb0100f6b00 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 -- 172.21.15.96:0/2600576262 >> 172.21.15.96:0/2600576262 conn(0x7fb0100f1e40 msgr2=0x7fb0100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 -- 172.21.15.96:0/2600576262 shutdown_connections 2022-02-02T19:33:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 -- 172.21.15.96:0/2600576262 wait complete. 2022-02-02T19:33:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.235+0000 7fb017ab9700 1 Processor -- start 2022-02-02T19:33:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb017ab9700 1 -- start start 2022-02-02T19:33:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb017ab9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb017ab9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0100f7980 0x7fb010107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb017ab9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010107a00 con 0x7fb0100f66e0 2022-02-02T19:33:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb017ab9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010107b40 con 0x7fb0100f7980 2022-02-02T19:33:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60410/0 (socket says 172.21.15.96:60410) 2022-02-02T19:33:33.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 -- 172.21.15.96:0/1782528476 learned_addr learned my addr 172.21.15.96:0/1782528476 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 -- 172.21.15.96:0/1782528476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0100f7980 msgr2=0x7fb010107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0100f7980 0x7fb010107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:33:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.236+0000 7fb015855700 1 -- 172.21.15.96:0/1782528476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000005040 con 0x7fb0100f66e0 2022-02-02T19:33:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb015855700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fb000013a70 tx=0x7fb000009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb000018070 con 0x7fb0100f66e0 2022-02-02T19:33:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0000097d0 con 0x7fb0100f66e0 2022-02-02T19:33:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00001c3c0 con 0x7fb0100f66e0 2022-02-02T19:33:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb010108480 con 0x7fb0100f66e0 2022-02-02T19:33:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.237+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb010108990 con 0x7fb0100f66e0 2022-02-02T19:33:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.238+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010045ad0 con 0x7fb0100f66e0 2022-02-02T19:33:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.239+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb000007ba0 con 0x7fb0100f66e0 2022-02-02T19:33:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.239+0000 7fb0067fc700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 0x7faffc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.239+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb000083280 con 0x7fb0100f66e0 2022-02-02T19:33:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.239+0000 7fb015054700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 0x7faffc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.240+0000 7fb015054700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 0x7faffc067290 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb00c009880 tx=0x7fb00c009a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.243+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb000054d90 con 0x7fb0100f66e0 2022-02-02T19:33:33.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.419+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb010108c00 con 0x7faffc064dd0 2022-02-02T19:33:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.428+0000 7fb0067fc700 1 -- 172.21.15.96:0/1782528476 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb010108c00 con 0x7faffc064dd0 2022-02-02T19:33:33.433 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:33:33.434 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (76m) 47m ago 78m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:33:33.434 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (69m) 47m ago 77m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:33:33.434 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (69m) 45m ago 77m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:33:33.434 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (76m) 47m ago 77m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:33:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (74m) 47m ago 74m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:33:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (69m) 47m ago 74m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:33:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (74m) 45m ago 74m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:33:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (69m) 45m ago 74m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:33:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (71m) 47m ago 79m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:33:33.436 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (70m) 45m ago 77m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:33:33.436 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (70m) 47m ago 79m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:33:33.436 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (69m) 45m ago 77m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:33:33.436 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (77m) 47m ago 77m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:33:33.437 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (77m) 45m ago 77m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:33:33.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (68m) 47m ago 76m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:33:33.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (68m) 47m ago 76m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:33:33.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (67m) 47m ago 76m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:33:33.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (67m) 45m ago 75m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:33:33.438 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (66m) 45m ago 75m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:33:33.438 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (66m) 45m ago 75m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:33:33.438 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (76m) 47m ago 77m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:33:33.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 msgr2=0x7faffc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 0x7faffc067290 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb00c009880 tx=0x7fb00c009a60).stop 2022-02-02T19:33:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 msgr2=0x7fb010106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fb000013a70 tx=0x7fb000009b30).stop 2022-02-02T19:33:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 shutdown_connections 2022-02-02T19:33:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faffc064dd0 0x7faffc067290 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0100f66e0 0x7fb010106f60 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 --2- 172.21.15.96:0/1782528476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0100f7980 0x7fb010107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:33:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 >> 172.21.15.96:0/1782528476 conn(0x7fb0100f1e40 msgr2=0x7fb0100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 shutdown_connections 2022-02-02T19:33:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.430+0000 7fb017ab9700 1 -- 172.21.15.96:0/1782528476 wait complete. 2022-02-02T19:33:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 -- 172.21.15.96:0/2459702866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f66e0 msgr2=0x7f46540f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2459702866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f66e0 0x7f46540f6b40 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f4648004660 tx=0x7f4648009b30).stop 2022-02-02T19:33:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 -- 172.21.15.96:0/2459702866 shutdown_connections 2022-02-02T19:33:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2459702866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f66e0 0x7f46540f6b40 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2459702866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f5440 0x7f46540f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:33:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 -- 172.21.15.96:0/2459702866 >> 172.21.15.96:0/2459702866 conn(0x7f46540f0ba0 msgr2=0x7f46540f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 -- 172.21.15.96:0/2459702866 shutdown_connections 2022-02-02T19:33:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.526+0000 7f4658b5f700 1 -- 172.21.15.96:0/2459702866 wait complete. 2022-02-02T19:33:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 Processor -- start 2022-02-02T19:33:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 -- start start 2022-02-02T19:33:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 0x7f46540f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540f8010 con 0x7f46540f5440 2022-02-02T19:33:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f4658b5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540f8150 con 0x7f46540f66e0 2022-02-02T19:33:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f46537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f46537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60420/0 (socket says 172.21.15.96:60420) 2022-02-02T19:33:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.527+0000 7f46537fe700 1 -- 172.21.15.96:0/2794221278 learned_addr learned my addr 172.21.15.96:0/2794221278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f4652ffd700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 0x7f46540f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f46537fe700 1 -- 172.21.15.96:0/2794221278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 msgr2=0x7f46540f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f46537fe700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 0x7f46540f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f46537fe700 1 -- 172.21.15.96:0/2794221278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648005040 con 0x7f46540f5440 2022-02-02T19:33:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f4652ffd700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 0x7f46540f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:33:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f46537fe700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f46440093f0 tx=0x7f4644006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4644009ea0 con 0x7f46540f5440 2022-02-02T19:33:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46540f8430 con 0x7f46540f5440 2022-02-02T19:33:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465410edb0 con 0x7f46540f5440 2022-02-02T19:33:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4644013af0 con 0x7f46540f5440 2022-02-02T19:33:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.528+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f464400db10 con 0x7f46540f5440 2022-02-02T19:33:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.529+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f464401a060 con 0x7f46540f5440 2022-02-02T19:33:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.530+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634004fa0 con 0x7f46540f5440 2022-02-02T19:33:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.530+0000 7f463bfff700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 0x7f463c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.530+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4644081970 con 0x7f46540f5440 2022-02-02T19:33:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.530+0000 7f4652ffd700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 0x7f463c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.530+0000 7f4652ffd700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 0x7f463c0672e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f4648009da0 tx=0x7f4648009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.534+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f464404fa70 con 0x7f46540f5440 2022-02-02T19:33:33.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.764+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4634005e80 con 0x7f46540f5440 2022-02-02T19:33:33.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.765+0000 7f463bfff700 1 -- 172.21.15.96:0/2794221278 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4644053090 con 0x7f46540f5440 2022-02-02T19:33:33.770 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:33:33.771 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:33:33.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:33:33.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:33.771 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:33:33.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:33:33.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:33.772 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:33:33.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:33:33.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:33.773 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:33:33.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:33:33.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:33:33.773 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:33:33.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:33:33.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:33:33.774 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:33:33.774 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:33:33.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 msgr2=0x7f463c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 0x7f463c0672e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f4648009da0 tx=0x7f4648009b30).stop 2022-02-02T19:33:33.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 msgr2=0x7f46540f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f46440093f0 tx=0x7f4644006ec0).stop 2022-02-02T19:33:33.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 shutdown_connections 2022-02-02T19:33:33.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f463c064e20 0x7f463c0672e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540f5440 0x7f46540f95a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 --2- 172.21.15.96:0/2794221278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46540f66e0 0x7f46540f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.766+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 >> 172.21.15.96:0/2794221278 conn(0x7f46540f0ba0 msgr2=0x7f465405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.767+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 shutdown_connections 2022-02-02T19:33:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.767+0000 7f4658b5f700 1 -- 172.21.15.96:0/2794221278 wait complete. 2022-02-02T19:33:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- 172.21.15.96:0/3028052664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 msgr2=0x7fd6b00fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/3028052664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b00fbc70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fd6ac004660 tx=0x7fd6ac009b30).stop 2022-02-02T19:33:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- 172.21.15.96:0/3028052664 shutdown_connections 2022-02-02T19:33:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/3028052664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b00fbc70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/3028052664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b00f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- 172.21.15.96:0/3028052664 >> 172.21.15.96:0/3028052664 conn(0x7fd6b00f0d40 msgr2=0x7fd6b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- 172.21.15.96:0/3028052664 shutdown_connections 2022-02-02T19:33:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- 172.21.15.96:0/3028052664 wait complete. 2022-02-02T19:33:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 Processor -- start 2022-02-02T19:33:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.866+0000 7fd6b7db5700 1 -- start start 2022-02-02T19:33:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b0106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b01079e0 con 0x7fd6b00f9860 2022-02-02T19:33:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0107b20 con 0x7fd6b00602d0 2022-02-02T19:33:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60430/0 (socket says 172.21.15.96:60430) 2022-02-02T19:33:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 -- 172.21.15.96:0/1156275486 learned_addr learned my addr 172.21.15.96:0/1156275486 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:33:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5b51700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b0106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 -- 172.21.15.96:0/1156275486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 msgr2=0x7fd6b0106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b0106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 -- 172.21.15.96:0/1156275486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac005040 con 0x7fd6b00f9860 2022-02-02T19:33:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5b51700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b0106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:33:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b5350700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fd6ac013a70 tx=0x7fd6ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac018070 con 0x7fd6b00f9860 2022-02-02T19:33:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6ac0097d0 con 0x7fd6b00f9860 2022-02-02T19:33:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac01c3c0 con 0x7fd6b00f9860 2022-02-02T19:33:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b0108460 con 0x7fd6b00f9860 2022-02-02T19:33:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.867+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b01089c0 con 0x7fd6b00f9860 2022-02-02T19:33:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.868+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b0045ad0 con 0x7fd6b00f9860 2022-02-02T19:33:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.870+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6ac007ba0 con 0x7fd6b00f9860 2022-02-02T19:33:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.870+0000 7fd6a67fc700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 0x7fd69c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:33:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.870+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd6ac083ad0 con 0x7fd6b00f9860 2022-02-02T19:33:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.870+0000 7fd6b5b51700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 0x7fd69c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:33:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.870+0000 7fd6b5b51700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 0x7fd69c067290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fd6a0009fd0 tx=0x7fd6a000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:33:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:33.874+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6ac055600 con 0x7fd6b00f9860 2022-02-02T19:33:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.074+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6b0027a00 con 0x7fd6b00f9860 2022-02-02T19:33:34.080 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2794221278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:33:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.074+0000 7fd6a67fc700 1 -- 172.21.15.96:0/1156275486 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd6ac0551f0 con 0x7fd6b00f9860 2022-02-02T19:33:34.081 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:33:34.081 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:33:34.081 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:33:34.081 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:33:34.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:34.082 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:33:34.082 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:33:34.082 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:33:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:33:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:33:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:33:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:33:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:33:34.084 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:33:34.084 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:33:34.084 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:33:34.084 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:33:34.084 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:33:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:33:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:33:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:33:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:33:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:33:34.086 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:33:34.086 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:33:34.086 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:33:34.086 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:33:34.086 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:33:34.087 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:33:34.087 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:33:34.087 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:33:34.087 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:33:34.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:34.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:34.088 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:33:34.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:33:34.088 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:34.088 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:34.089 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:33:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 msgr2=0x7fd69c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 0x7fd69c067290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fd6a0009fd0 tx=0x7fd6a000b040).stop 2022-02-02T19:33:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 msgr2=0x7fd6b0107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:33:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fd6ac013a70 tx=0x7fd6ac009b30).stop 2022-02-02T19:33:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 shutdown_connections 2022-02-02T19:33:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd69c064dd0 0x7fd69c067290 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b00602d0 0x7fd6b0106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 --2- 172.21.15.96:0/1156275486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6b00f9860 0x7fd6b0107430 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:33:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 >> 172.21.15.96:0/1156275486 conn(0x7fd6b00f0d40 msgr2=0x7fd6b00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:33:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 shutdown_connections 2022-02-02T19:33:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:33:34.076+0000 7fd6b7db5700 1 -- 172.21.15.96:0/1156275486 wait complete. 2022-02-02T19:33:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:33:34.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2794221278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:33:35.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:34 smithi159 ceph-mon[69013]: from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:35.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:34 smithi159 ceph-mon[69013]: from='client.36316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:35.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1156275486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:33:35.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:34 smithi159 ceph-mon[69013]: pgmap v2145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:35.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:34 smithi096 ceph-mon[101353]: from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:35.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:34 smithi096 ceph-mon[101353]: from='client.36316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:33:35.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1156275486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:33:35.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:34 smithi096 ceph-mon[101353]: pgmap v2145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:37.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:37 smithi159 ceph-mon[69013]: pgmap v2146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:37.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:37 smithi096 ceph-mon[101353]: pgmap v2146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:38 smithi159 ceph-mon[69013]: pgmap v2147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:38 smithi096 ceph-mon[101353]: pgmap v2147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:40 smithi159 ceph-mon[69013]: pgmap v2148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:40 smithi096 ceph-mon[101353]: pgmap v2148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:42 smithi159 ceph-mon[69013]: pgmap v2149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:42 smithi096 ceph-mon[101353]: pgmap v2149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:44 smithi159 ceph-mon[69013]: pgmap v2150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:44 smithi096 ceph-mon[101353]: pgmap v2150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:47 smithi159 ceph-mon[69013]: pgmap v2151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:47.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:47 smithi096 ceph-mon[101353]: pgmap v2151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:48.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:48 smithi159 ceph-mon[69013]: pgmap v2152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:48 smithi096 ceph-mon[101353]: pgmap v2152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:50.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:50 smithi159 ceph-mon[69013]: pgmap v2153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:50 smithi096 ceph-mon[101353]: pgmap v2153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:52 smithi159 ceph-mon[69013]: pgmap v2154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:52 smithi096 ceph-mon[101353]: pgmap v2154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:54 smithi159 ceph-mon[69013]: pgmap v2155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:54 smithi096 ceph-mon[101353]: pgmap v2155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:57.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:57 smithi159 ceph-mon[69013]: pgmap v2156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:57 smithi096 ceph-mon[101353]: pgmap v2156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:33:58 smithi159 ceph-mon[69013]: pgmap v2157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:33:58.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:33:58 smithi096 ceph-mon[101353]: pgmap v2157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:00 smithi159 ceph-mon[69013]: pgmap v2158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:00 smithi096 ceph-mon[101353]: pgmap v2158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:02.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:02 smithi159 ceph-mon[69013]: pgmap v2159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:02 smithi096 ceph-mon[101353]: pgmap v2159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- 172.21.15.96:0/2867071304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f55c0 msgr2=0x7fd9640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 --2- 172.21.15.96:0/2867071304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f55c0 0x7fd9640f59e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fd960004660 tx=0x7fd960009b30).stop 2022-02-02T19:34:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- 172.21.15.96:0/2867071304 shutdown_connections 2022-02-02T19:34:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 --2- 172.21.15.96:0/2867071304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f6860 0x7fd9640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 --2- 172.21.15.96:0/2867071304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f55c0 0x7fd9640f59e0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- 172.21.15.96:0/2867071304 >> 172.21.15.96:0/2867071304 conn(0x7fd9640f0d40 msgr2=0x7fd9640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- 172.21.15.96:0/2867071304 shutdown_connections 2022-02-02T19:34:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- 172.21.15.96:0/2867071304 wait complete. 2022-02-02T19:34:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 Processor -- start 2022-02-02T19:34:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.188+0000 7fd96b833700 1 -- start start 2022-02-02T19:34:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd96b833700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f55c0 0x7fd964109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd96b833700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd96b833700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640603e0 con 0x7fd9640f6860 2022-02-02T19:34:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd96b833700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964060520 con 0x7fd9640f55c0 2022-02-02T19:34:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60448/0 (socket says 172.21.15.96:60448) 2022-02-02T19:34:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 -- 172.21.15.96:0/2894357409 learned_addr learned my addr 172.21.15.96:0/2894357409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd9695cf700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f55c0 0x7fd964109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 -- 172.21.15.96:0/2894357409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f55c0 msgr2=0x7fd964109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f55c0 0x7fd964109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 -- 172.21.15.96:0/2894357409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960005040 con 0x7fd9640f6860 2022-02-02T19:34:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.189+0000 7fd968dce700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fd9540026d0 tx=0x7fd954009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.190+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9540079c0 con 0x7fd9640f6860 2022-02-02T19:34:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.190+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96410c720 con 0x7fd9640f6860 2022-02-02T19:34:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.190+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd95400f040 con 0x7fd9640f6860 2022-02-02T19:34:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.190+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9540148b0 con 0x7fd9640f6860 2022-02-02T19:34:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.190+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96410cce0 con 0x7fd9640f6860 2022-02-02T19:34:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.191+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964045ad0 con 0x7fd9640f6860 2022-02-02T19:34:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.191+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd954007b20 con 0x7fd9640f6860 2022-02-02T19:34:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.192+0000 7fd959ffb700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 0x7fd950067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.192+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9540819a0 con 0x7fd9640f6860 2022-02-02T19:34:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.192+0000 7fd9695cf700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 0x7fd950067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.192+0000 7fd9695cf700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 0x7fd950067290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd960013690 tx=0x7fd960009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.196+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd95404faa0 con 0x7fd9640f6860 2022-02-02T19:34:04.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.373+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd964057f10 con 0x7fd950064dd0 2022-02-02T19:34:04.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.374+0000 7fd959ffb700 1 -- 172.21.15.96:0/2894357409 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd964057f10 con 0x7fd950064dd0 2022-02-02T19:34:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 msgr2=0x7fd950067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 0x7fd950067290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd960013690 tx=0x7fd960009b30).stop 2022-02-02T19:34:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 msgr2=0x7fd96410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fd9540026d0 tx=0x7fd954009de0).stop 2022-02-02T19:34:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 shutdown_connections 2022-02-02T19:34:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd950064dd0 0x7fd950067290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9640f55c0 0x7fd964109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 --2- 172.21.15.96:0/2894357409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9640f6860 0x7fd96410c170 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.376+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 >> 172.21.15.96:0/2894357409 conn(0x7fd9640f0d40 msgr2=0x7fd9640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.377+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 shutdown_connections 2022-02-02T19:34:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.377+0000 7fd96b833700 1 -- 172.21.15.96:0/2894357409 wait complete. 2022-02-02T19:34:04.391 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:34:04.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 -- 172.21.15.96:0/2977666023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 msgr2=0x7fa2cc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/2977666023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc0f6b00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fa2bc004660 tx=0x7fa2bc009b30).stop 2022-02-02T19:34:04.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 -- 172.21.15.96:0/2977666023 shutdown_connections 2022-02-02T19:34:04.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/2977666023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 0x7fa2cc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/2977666023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc0f6b00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 -- 172.21.15.96:0/2977666023 >> 172.21.15.96:0/2977666023 conn(0x7fa2cc0f1e40 msgr2=0x7fa2cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:04.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 -- 172.21.15.96:0/2977666023 shutdown_connections 2022-02-02T19:34:04.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.474+0000 7fa2d3f46700 1 -- 172.21.15.96:0/2977666023 wait complete. 2022-02-02T19:34:04.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 Processor -- start 2022-02-02T19:34:04.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 -- start start 2022-02-02T19:34:04.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 0x7fa2cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc06a380 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc06a4c0 con 0x7fa2cc0f7980 2022-02-02T19:34:04.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60456/0 (socket says 172.21.15.96:60456) 2022-02-02T19:34:04.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 -- 172.21.15.96:0/353231612 learned_addr learned my addr 172.21.15.96:0/353231612 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:04.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d14e1700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 0x7fa2cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 -- 172.21.15.96:0/353231612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 msgr2=0x7fa2cc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 0x7fa2cc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 -- 172.21.15.96:0/353231612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc005040 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d1ce2700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa2bc013a70 tx=0x7fa2bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc018070 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc06a740 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2bc0097d0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.475+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc01c3c0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.476+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc06aca0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.476+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc045ad0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.477+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2bc007ba0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.477+0000 7fa2c27fc700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 0x7fa2b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.477+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa2bc083730 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.477+0000 7fa2d14e1700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 0x7fa2b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.478+0000 7fa2d14e1700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 0x7fa2b8067290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa2c8009760 tx=0x7fa2c8009cc0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.481+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2bc0518f0 con 0x7fa2cc0f66e0 2022-02-02T19:34:04.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.654+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2cc057f10 con 0x7fa2b8064dd0 2022-02-02T19:34:04.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.663+0000 7fa2c27fc700 1 -- 172.21.15.96:0/353231612 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa2cc057f10 con 0x7fa2b8064dd0 2022-02-02T19:34:04.669 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:34:04.669 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (77m) 48m ago 78m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:34:04.670 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (69m) 48m ago 78m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:34:04.670 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (69m) 46m ago 78m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:34:04.670 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (77m) 48m ago 78m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:34:04.670 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (74m) 48m ago 74m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:34:04.671 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (70m) 48m ago 74m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:34:04.671 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (74m) 46m ago 74m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:34:04.671 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (70m) 46m ago 74m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:34:04.671 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (71m) 48m ago 79m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:34:04.672 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (71m) 46m ago 77m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:34:04.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (70m) 48m ago 79m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:34:04.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (70m) 46m ago 77m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:34:04.672 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (78m) 48m ago 78m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:34:04.672 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (77m) 46m ago 77m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:34:04.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (69m) 48m ago 77m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:34:04.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (68m) 48m ago 77m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:34:04.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (68m) 48m ago 76m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:34:04.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (67m) 46m ago 76m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:34:04.674 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (67m) 46m ago 76m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:34:04.674 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (66m) 46m ago 75m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:34:04.674 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (77m) 48m ago 78m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:34:04.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 msgr2=0x7fa2b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 0x7fa2b8067290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa2c8009760 tx=0x7fa2c8009cc0).stop 2022-02-02T19:34:04.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 msgr2=0x7fa2cc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa2bc013a70 tx=0x7fa2bc009b30).stop 2022-02-02T19:34:04.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 shutdown_connections 2022-02-02T19:34:04.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b8064dd0 0x7fa2b8067290 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f66e0 0x7fa2cc06b9a0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 --2- 172.21.15.96:0/353231612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f7980 0x7fa2cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 >> 172.21.15.96:0/353231612 conn(0x7fa2cc0f1e40 msgr2=0x7fa2cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:04.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 shutdown_connections 2022-02-02T19:34:04.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.665+0000 7fa2d3f46700 1 -- 172.21.15.96:0/353231612 wait complete. 2022-02-02T19:34:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 -- 172.21.15.96:0/914996134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f7980 msgr2=0x7f62300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 --2- 172.21.15.96:0/914996134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f7980 0x7f62300f7de0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f622c004660 tx=0x7f622c009b30).stop 2022-02-02T19:34:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 -- 172.21.15.96:0/914996134 shutdown_connections 2022-02-02T19:34:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 --2- 172.21.15.96:0/914996134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f7980 0x7f62300f7de0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 --2- 172.21.15.96:0/914996134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f66e0 0x7f62300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 -- 172.21.15.96:0/914996134 >> 172.21.15.96:0/914996134 conn(0x7f62300f1e40 msgr2=0x7f62300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 -- 172.21.15.96:0/914996134 shutdown_connections 2022-02-02T19:34:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.762+0000 7f6237410700 1 -- 172.21.15.96:0/914996134 wait complete. 2022-02-02T19:34:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 Processor -- start 2022-02-02T19:34:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 -- start start 2022-02-02T19:34:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f7980 0x7f6230107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6230107a00 con 0x7f62300f66e0 2022-02-02T19:34:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f6237410700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6230107b40 con 0x7f62300f7980 2022-02-02T19:34:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60466/0 (socket says 172.21.15.96:60466) 2022-02-02T19:34:04.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 -- 172.21.15.96:0/3946713961 learned_addr learned my addr 172.21.15.96:0/3946713961 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:04.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62349ab700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f7980 0x7f6230107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 -- 172.21.15.96:0/3946713961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f7980 msgr2=0x7f6230107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:04.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f7980 0x7f6230107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:04.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.763+0000 7f62351ac700 1 -- 172.21.15.96:0/3946713961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c005040 con 0x7f62300f66e0 2022-02-02T19:34:04.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f62351ac700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f6220002700 tx=0x7f6220009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62200079c0 con 0x7f62300f66e0 2022-02-02T19:34:04.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f622000f040 con 0x7f62300f66e0 2022-02-02T19:34:04.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62301084e0 con 0x7f62300f66e0 2022-02-02T19:34:04.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6220014860 con 0x7f62300f66e0 2022-02-02T19:34:04.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.764+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6230108aa0 con 0x7f62300f66e0 2022-02-02T19:34:04.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.765+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6230045ad0 con 0x7f62300f66e0 2022-02-02T19:34:04.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.765+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f622001b060 con 0x7f62300f66e0 2022-02-02T19:34:04.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.766+0000 7f6225ffb700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 0x7f621c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:04.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.766+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6220081840 con 0x7f62300f66e0 2022-02-02T19:34:04.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.766+0000 7f62349ab700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 0x7f621c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:04.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.766+0000 7f62349ab700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 0x7f621c067290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f622c004630 tx=0x7f622c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:04.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:04.770+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6220053370 con 0x7f62300f66e0 2022-02-02T19:34:05.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.001+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62300ff020 con 0x7f62300f66e0 2022-02-02T19:34:05.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.001+0000 7f6225ffb700 1 -- 172.21.15.96:0/3946713961 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f62200192e0 con 0x7f62300f66e0 2022-02-02T19:34:05.007 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:34:05.007 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:34:05.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:34:05.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:05.008 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:34:05.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:34:05.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:05.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:34:05.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:34:05.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:05.009 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:34:05.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:34:05.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:05.010 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:34:05.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:34:05.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:34:05.011 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:34:05.011 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:34:05.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 msgr2=0x7f621c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 0x7f621c067290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f622c004630 tx=0x7f622c009b30).stop 2022-02-02T19:34:05.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 msgr2=0x7f6230106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f6220002700 tx=0x7f6220009d80).stop 2022-02-02T19:34:05.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 shutdown_connections 2022-02-02T19:34:05.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f621c064dd0 0x7f621c067290 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62300f66e0 0x7f6230106f60 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 --2- 172.21.15.96:0/3946713961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62300f7980 0x7f6230107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 >> 172.21.15.96:0/3946713961 conn(0x7f62300f1e40 msgr2=0x7f62300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:05.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 shutdown_connections 2022-02-02T19:34:05.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.003+0000 7f6237410700 1 -- 172.21.15.96:0/3946713961 wait complete. 2022-02-02T19:34:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 -- 172.21.15.96:0/2107202038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 msgr2=0x7fdb280f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 --2- 172.21.15.96:0/2107202038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb280f5c50 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fdb18004660 tx=0x7fdb18009b30).stop 2022-02-02T19:34:05.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 -- 172.21.15.96:0/2107202038 shutdown_connections 2022-02-02T19:34:05.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 --2- 172.21.15.96:0/2107202038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb280f5c50 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 --2- 172.21.15.96:0/2107202038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb280f6ac0 0x7fdb280f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:34:05.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 -- 172.21.15.96:0/2107202038 >> 172.21.15.96:0/2107202038 conn(0x7fdb280f0320 msgr2=0x7fdb280f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:05.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 -- 172.21.15.96:0/2107202038 shutdown_connections 2022-02-02T19:34:05.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.101+0000 7fdb2759e700 1 -- 172.21.15.96:0/2107202038 wait complete. 2022-02-02T19:34:05.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 Processor -- start 2022-02-02T19:34:05.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 -- start start 2022-02-02T19:34:05.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:05.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb280f6ac0 0x7fdb281061e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28106820 con 0x7fdb280f57d0 2022-02-02T19:34:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28106f90 con 0x7fdb280f6ac0 2022-02-02T19:34:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60476/0 (socket says 172.21.15.96:60476) 2022-02-02T19:34:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.102+0000 7fdb2659c700 1 -- 172.21.15.96:0/3406348620 learned_addr learned my addr 172.21.15.96:0/3406348620 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2659c700 1 -- 172.21.15.96:0/3406348620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb280f6ac0 msgr2=0x7fdb281061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2659c700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb280f6ac0 0x7fdb281061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:34:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2659c700 1 -- 172.21.15.96:0/3406348620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18005040 con 0x7fdb280f57d0 2022-02-02T19:34:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2659c700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fdb1000b410 tx=0x7fdb10006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb100125f0 con 0x7fdb280f57d0 2022-02-02T19:34:05.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28107270 con 0x7fdb280f57d0 2022-02-02T19:34:05.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb10012c00 con 0x7fdb280f57d0 2022-02-02T19:34:05.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb10002ae0 con 0x7fdb280f57d0 2022-02-02T19:34:05.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.103+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb28107830 con 0x7fdb280f57d0 2022-02-02T19:34:05.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.104+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb28045ad0 con 0x7fdb280f57d0 2022-02-02T19:34:05.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.104+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdb1000f030 con 0x7fdb280f57d0 2022-02-02T19:34:05.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.105+0000 7fdb1effd700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 0x7fdb140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:05.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.105+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdb10081f10 con 0x7fdb280f57d0 2022-02-02T19:34:05.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.105+0000 7fdb25d9b700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 0x7fdb140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:05.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.105+0000 7fdb25d9b700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 0x7fdb140672e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fdb18004e30 tx=0x7fdb18009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:05.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.109+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb10053a40 con 0x7fdb280f57d0 2022-02-02T19:34:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.312+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb280ff7d0 con 0x7fdb280f57d0 2022-02-02T19:34:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.312+0000 7fdb1effd700 1 -- 172.21.15.96:0/3406348620 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdb10002d50 con 0x7fdb280f57d0 2022-02-02T19:34:05.318 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:34:05.318 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:34:05.319 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:34:05.319 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:34:05.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:05.319 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:34:05.320 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:34:05.320 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:34:05.320 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:34:05.320 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:34:05.321 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:34:05.321 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:34:05.321 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:34:05.321 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:34:05.322 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:34:05.322 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:34:05.322 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:34:05.322 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:34:05.322 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:34:05.323 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:34:05.323 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:34:05.323 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:34:05.323 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:34:05.324 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:34:05.324 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:34:05.324 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:34:05.324 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:34:05.324 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:34:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:34:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:34:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:34:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:34:05.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:05.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:05.326 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:34:05.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:05.326 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:05.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:05.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:05.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 msgr2=0x7fdb140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 0x7fdb140672e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fdb18004e30 tx=0x7fdb18009b30).stop 2022-02-02T19:34:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 msgr2=0x7fdb28105cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fdb1000b410 tx=0x7fdb10006ef0).stop 2022-02-02T19:34:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 shutdown_connections 2022-02-02T19:34:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb14064e20 0x7fdb140672e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280f57d0 0x7fdb28105cf0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 --2- 172.21.15.96:0/3406348620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb280f6ac0 0x7fdb281061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:34:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.314+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 >> 172.21.15.96:0/3406348620 conn(0x7fdb280f0320 msgr2=0x7fdb280fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.315+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 shutdown_connections 2022-02-02T19:34:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:05.315+0000 7fdb2759e700 1 -- 172.21.15.96:0/3406348620 wait complete. 2022-02-02T19:34:05.331 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:34:05.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:05 smithi159 ceph-mon[69013]: pgmap v2160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:05.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:05 smithi159 ceph-mon[69013]: from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:05.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:05 smithi159 ceph-mon[69013]: from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:05.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3946713961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:34:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:05 smithi096 ceph-mon[101353]: pgmap v2160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:05 smithi096 ceph-mon[101353]: from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:05.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:05 smithi096 ceph-mon[101353]: from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:05.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3946713961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:34:06.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3406348620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:34:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3406348620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:34:08.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:08 smithi159 ceph-mon[69013]: pgmap v2161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:08.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:08 smithi096 ceph-mon[101353]: pgmap v2161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:10.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:10 smithi159 ceph-mon[69013]: pgmap v2162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:10.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:10 smithi096 ceph-mon[101353]: pgmap v2162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:12.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:12 smithi159 ceph-mon[69013]: pgmap v2163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:12.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:12 smithi096 ceph-mon[101353]: pgmap v2163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:14.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:14 smithi159 ceph-mon[69013]: pgmap v2164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:14.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:14 smithi096 ceph-mon[101353]: pgmap v2164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:16.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:16 smithi096 ceph-mon[101353]: pgmap v2165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:16.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:16 smithi159 ceph-mon[69013]: pgmap v2165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:18.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:18 smithi096 ceph-mon[101353]: pgmap v2166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:18 smithi159 ceph-mon[69013]: pgmap v2166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:20 smithi096 ceph-mon[101353]: pgmap v2167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:20 smithi159 ceph-mon[69013]: pgmap v2167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:22.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:22 smithi096 ceph-mon[101353]: pgmap v2168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:22.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:22 smithi159 ceph-mon[69013]: pgmap v2168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:24.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:24 smithi096 ceph-mon[101353]: pgmap v2169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:24.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:24 smithi159 ceph-mon[69013]: pgmap v2169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:26.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:26 smithi096 ceph-mon[101353]: pgmap v2170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:26.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:26 smithi159 ceph-mon[69013]: pgmap v2170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:28 smithi096 ceph-mon[101353]: pgmap v2171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:34:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:34:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:28 smithi159 ceph-mon[69013]: pgmap v2171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:34:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:34:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:30 smithi096 ceph-mon[101353]: pgmap v2172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:30 smithi159 ceph-mon[69013]: pgmap v2172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:32.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:32 smithi096 ceph-mon[101353]: pgmap v2173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:32 smithi159 ceph-mon[69013]: pgmap v2173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:34.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:34 smithi096 ceph-mon[101353]: pgmap v2174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:34 smithi159 ceph-mon[69013]: pgmap v2174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:35.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 -- 172.21.15.96:0/3476829343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f6530 msgr2=0x7fd6ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/3476829343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec0f6950 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fd6e0004660 tx=0x7fd6e0009b30).stop 2022-02-02T19:34:35.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 -- 172.21.15.96:0/3476829343 shutdown_connections 2022-02-02T19:34:35.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/3476829343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/3476829343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec0f6950 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 -- 172.21.15.96:0/3476829343 >> 172.21.15.96:0/3476829343 conn(0x7fd6ec0f1c90 msgr2=0x7fd6ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:35.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 -- 172.21.15.96:0/3476829343 shutdown_connections 2022-02-02T19:34:35.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 -- 172.21.15.96:0/3476829343 wait complete. 2022-02-02T19:34:35.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.424+0000 7fd6f0e93700 1 Processor -- start 2022-02-02T19:34:35.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6f0e93700 1 -- start start 2022-02-02T19:34:35.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6f0e93700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6f0e93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6f0e93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1078f0 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6f0e93700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec108100 con 0x7fd6ec0f6530 2022-02-02T19:34:35.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60496/0 (socket says 172.21.15.96:60496) 2022-02-02T19:34:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 -- 172.21.15.96:0/1386036279 learned_addr learned my addr 172.21.15.96:0/1386036279 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eb7fe700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 -- 172.21.15.96:0/1386036279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 msgr2=0x7fd6ec106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 -- 172.21.15.96:0/1386036279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0005040 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eb7fe700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:34:35.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.425+0000 7fd6eaffd700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fd6dc00c790 tx=0x7fd6dc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:35.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.426+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc00e680 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.426+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec108380 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.426+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6dc00ec90 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.426+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc013d60 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.426+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec108940 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.427+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec059100 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.427+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6dc01a060 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.427+0000 7fd6d3fff700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 0x7fd6d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.428+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd6dc081c90 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.428+0000 7fd6eb7fe700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 0x7fd6d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.428+0000 7fd6eb7fe700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 0x7fd6d40672e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fd6e0004e30 tx=0x7fd6e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.432+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6dc04fd90 con 0x7fd6ec0f77d0 2022-02-02T19:34:35.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.609+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6ec0fede0 con 0x7fd6d4064e20 2022-02-02T19:34:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.610+0000 7fd6d3fff700 1 -- 172.21.15.96:0/1386036279 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd6ec0fede0 con 0x7fd6d4064e20 2022-02-02T19:34:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 msgr2=0x7fd6d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 0x7fd6d40672e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fd6e0004e30 tx=0x7fd6e0009b30).stop 2022-02-02T19:34:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 msgr2=0x7fd6ec1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fd6dc00c790 tx=0x7fd6dc007d70).stop 2022-02-02T19:34:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 shutdown_connections 2022-02-02T19:34:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6d4064e20 0x7fd6d40672e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ec0f6530 0x7fd6ec106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 --2- 172.21.15.96:0/1386036279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6ec0f77d0 0x7fd6ec1072f0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 >> 172.21.15.96:0/1386036279 conn(0x7fd6ec0f1c90 msgr2=0x7fd6ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 shutdown_connections 2022-02-02T19:34:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.612+0000 7fd6f0e93700 1 -- 172.21.15.96:0/1386036279 wait complete. 2022-02-02T19:34:35.628 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:34:35.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 -- 172.21.15.96:0/400309932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 msgr2=0x7f40780f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 --2- 172.21.15.96:0/400309932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f40780f5850 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f4068004660 tx=0x7f4068009b30).stop 2022-02-02T19:34:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 -- 172.21.15.96:0/400309932 shutdown_connections 2022-02-02T19:34:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 --2- 172.21.15.96:0/400309932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 0x7f40780f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 --2- 172.21.15.96:0/400309932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f40780f5850 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.710+0000 7f407c8fa700 1 -- 172.21.15.96:0/400309932 >> 172.21.15.96:0/400309932 conn(0x7f40780f0b90 msgr2=0x7f40780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.711+0000 7f407c8fa700 1 -- 172.21.15.96:0/400309932 shutdown_connections 2022-02-02T19:34:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.711+0000 7f407c8fa700 1 -- 172.21.15.96:0/400309932 wait complete. 2022-02-02T19:34:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.711+0000 7f407c8fa700 1 Processor -- start 2022-02-02T19:34:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.711+0000 7f407c8fa700 1 -- start start 2022-02-02T19:34:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f407c8fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f407c8fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 0x7f4078106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f407c8fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40781067d0 con 0x7f40780f5430 2022-02-02T19:34:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f407c8fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078106fd0 con 0x7f40780f66d0 2022-02-02T19:34:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60504/0 (socket says 172.21.15.96:60504) 2022-02-02T19:34:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 -- 172.21.15.96:0/1316622043 learned_addr learned my addr 172.21.15.96:0/1316622043 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f4076ffd700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 0x7f4078106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 -- 172.21.15.96:0/1316622043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 msgr2=0x7f4078106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 0x7f4078106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 -- 172.21.15.96:0/1316622043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068005040 con 0x7f40780f5430 2022-02-02T19:34:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f40777fe700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f4068004f60 tx=0x7f4068009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:35.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.712+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4068018070 con 0x7f40780f5430 2022-02-02T19:34:35.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.713+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078107250 con 0x7f40780f5430 2022-02-02T19:34:35.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.713+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4068009770 con 0x7f40780f5430 2022-02-02T19:34:35.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.713+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406801c3c0 con 0x7f40780f5430 2022-02-02T19:34:35.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.713+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40781077b0 con 0x7f40780f5430 2022-02-02T19:34:35.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.714+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078059100 con 0x7f40780f5430 2022-02-02T19:34:35.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.714+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f406801c630 con 0x7f40780f5430 2022-02-02T19:34:35.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.714+0000 7f405ffff700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.714+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4068083790 con 0x7f40780f5430 2022-02-02T19:34:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.715+0000 7f4076ffd700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.715+0000 7f4076ffd700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f406c007fd0 tx=0x7f406c007df0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.719+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4068055380 con 0x7f40780f5430 2022-02-02T19:34:35.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.893+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f407805f620 con 0x7f4060064e20 2022-02-02T19:34:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.903+0000 7f405ffff700 1 -- 172.21.15.96:0/1316622043 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f407805f620 con 0x7f4060064e20 2022-02-02T19:34:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:34:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (77m) 48m ago 79m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:34:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (70m) 48m ago 79m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:34:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (70m) 47m ago 78m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:34:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (77m) 48m ago 78m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:34:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (75m) 48m ago 75m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:34:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (70m) 48m ago 75m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:34:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (75m) 47m ago 75m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:34:35.911 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (70m) 47m ago 75m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:34:35.911 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (72m) 48m ago 80m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:34:35.911 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (71m) 47m ago 78m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:34:35.911 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (71m) 48m ago 80m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:34:35.911 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (70m) 47m ago 78m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:34:35.912 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (78m) 48m ago 78m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:34:35.912 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (78m) 47m ago 78m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:34:35.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (70m) 48m ago 77m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:34:35.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (69m) 48m ago 77m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:34:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (68m) 48m ago 77m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:34:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (68m) 47m ago 76m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:34:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (67m) 47m ago 76m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:34:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (67m) 47m ago 76m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:34:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (77m) 48m ago 78m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:34:35.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 msgr2=0x7f40600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f406c007fd0 tx=0x7f406c007df0).stop 2022-02-02T19:34:35.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 msgr2=0x7f4078105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:35.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f4068004f60 tx=0x7f4068009b30).stop 2022-02-02T19:34:35.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 shutdown_connections 2022-02-02T19:34:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f5430 0x7f4078105d30 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 --2- 172.21.15.96:0/1316622043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f66d0 0x7f4078106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 >> 172.21.15.96:0/1316622043 conn(0x7f40780f0b90 msgr2=0x7f40780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 shutdown_connections 2022-02-02T19:34:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:35.905+0000 7f407c8fa700 1 -- 172.21.15.96:0/1316622043 wait complete. 2022-02-02T19:34:36.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/266846800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f6530 msgr2=0x7f4fb00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/266846800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f6530 0x7f4fb00f6950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f4fa0004660 tx=0x7f4fa0009b30).stop 2022-02-02T19:34:36.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/266846800 shutdown_connections 2022-02-02T19:34:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/266846800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f77d0 0x7f4fb00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:34:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/266846800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f6530 0x7f4fb00f6950 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/266846800 >> 172.21.15.96:0/266846800 conn(0x7f4fb00f1c90 msgr2=0x7f4fb00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/266846800 shutdown_connections 2022-02-02T19:34:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.001+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/266846800 wait complete. 2022-02-02T19:34:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.002+0000 7f4fb4f2f700 1 Processor -- start 2022-02-02T19:34:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.002+0000 7f4fb4f2f700 1 -- start start 2022-02-02T19:34:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4fb4f2f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f6530 0x7f4fb0106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4fb4f2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4fb4f2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0107990 con 0x7f4fb00f77d0 2022-02-02T19:34:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4fb4f2f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0108110 con 0x7f4fb00f6530 2022-02-02T19:34:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60516/0 (socket says 172.21.15.96:60516) 2022-02-02T19:34:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 -- 172.21.15.96:0/1100986918 learned_addr learned my addr 172.21.15.96:0/1100986918 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faf7fe700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f6530 0x7f4fb0106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 -- 172.21.15.96:0/1100986918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f6530 msgr2=0x7f4fb0106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f6530 0x7f4fb0106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 -- 172.21.15.96:0/1100986918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0005040 con 0x7f4fb00f77d0 2022-02-02T19:34:36.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.003+0000 7f4faeffd700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f4fa400b410 tx=0x7f4fa4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:36.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.004+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa40125f0 con 0x7f4fb00f77d0 2022-02-02T19:34:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.004+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fa400be30 con 0x7f4fb00f77d0 2022-02-02T19:34:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.004+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0108390 con 0x7f4fb00f77d0 2022-02-02T19:34:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.004+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa4002a70 con 0x7f4fb00f77d0 2022-02-02T19:34:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.004+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb0108950 con 0x7f4fb00f77d0 2022-02-02T19:34:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.005+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4fa400f030 con 0x7f4fb00f77d0 2022-02-02T19:34:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.005+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb0045ad0 con 0x7f4fb00f77d0 2022-02-02T19:34:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.006+0000 7f4f97fff700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 0x7f4f980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.006+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4fa4081de0 con 0x7f4fb00f77d0 2022-02-02T19:34:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.006+0000 7f4faf7fe700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 0x7f4f980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.006+0000 7f4faf7fe700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 0x7f4f980672e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f4fa0013690 tx=0x7f4fa0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:36.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.010+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4fa404fee0 con 0x7f4fb00f77d0 2022-02-02T19:34:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.242+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4fb0027a00 con 0x7f4fb00f77d0 2022-02-02T19:34:36.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.243+0000 7f4f97fff700 1 -- 172.21.15.96:0/1100986918 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4fa4053500 con 0x7f4fb00f77d0 2022-02-02T19:34:36.250 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:34:36.250 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:34:36.250 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:34:36.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:36.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:34:36.251 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:34:36.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:36.251 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:34:36.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:34:36.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:36.252 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:34:36.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:34:36.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:34:36.253 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:34:36.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:34:36.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:34:36.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:34:36.253 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:34:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.244+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 msgr2=0x7f4f980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.244+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 0x7f4f980672e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f4fa0013690 tx=0x7f4fa0009b30).stop 2022-02-02T19:34:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.244+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 msgr2=0x7f4fb0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.244+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f4fa400b410 tx=0x7f4fa4006ef0).stop 2022-02-02T19:34:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 shutdown_connections 2022-02-02T19:34:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f98064e20 0x7f4f980672e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fb00f6530 0x7f4fb0106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 --2- 172.21.15.96:0/1100986918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fb00f77d0 0x7f4fb0107300 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 >> 172.21.15.96:0/1100986918 conn(0x7f4fb00f1c90 msgr2=0x7f4fb00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 shutdown_connections 2022-02-02T19:34:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.245+0000 7f4fb4f2f700 1 -- 172.21.15.96:0/1100986918 wait complete. 2022-02-02T19:34:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:36 smithi096 ceph-mon[101353]: pgmap v2175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 -- 172.21.15.96:0/4014888806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f7980 msgr2=0x7fbd880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 --2- 172.21.15.96:0/4014888806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f7980 0x7fbd880f7de0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fbd84004660 tx=0x7fbd84009b30).stop 2022-02-02T19:34:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 -- 172.21.15.96:0/4014888806 shutdown_connections 2022-02-02T19:34:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 --2- 172.21.15.96:0/4014888806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f7980 0x7fbd880f7de0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 --2- 172.21.15.96:0/4014888806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f66e0 0x7fbd880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 -- 172.21.15.96:0/4014888806 >> 172.21.15.96:0/4014888806 conn(0x7fbd880f1e40 msgr2=0x7fbd880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 -- 172.21.15.96:0/4014888806 shutdown_connections 2022-02-02T19:34:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.342+0000 7fbd904bd700 1 -- 172.21.15.96:0/4014888806 wait complete. 2022-02-02T19:34:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 Processor -- start 2022-02-02T19:34:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 -- start start 2022-02-02T19:34:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 0x7fbd88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8806a380 con 0x7fbd880f66e0 2022-02-02T19:34:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd904bd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8806a4c0 con 0x7fbd880f7980 2022-02-02T19:34:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60522/0 (socket says 172.21.15.96:60522) 2022-02-02T19:34:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 -- 172.21.15.96:0/1171720769 learned_addr learned my addr 172.21.15.96:0/1171720769 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:34:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8da58700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 0x7fbd88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 -- 172.21.15.96:0/1171720769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 msgr2=0x7fbd88069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 0x7fbd88069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8e259700 1 -- 172.21.15.96:0/1171720769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84005040 con 0x7fbd880f66e0 2022-02-02T19:34:36.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.343+0000 7fbd8da58700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 0x7fbd88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:34:36.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd8e259700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fbd78002700 tx=0x7fbd78009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:36.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd78009320 con 0x7fbd880f66e0 2022-02-02T19:34:36.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd7800f040 con 0x7fbd880f66e0 2022-02-02T19:34:36.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8806a7a0 con 0x7fbd880f66e0 2022-02-02T19:34:36.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd78014900 con 0x7fbd880f66e0 2022-02-02T19:34:36.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.344+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8810ef90 con 0x7fbd880f66e0 2022-02-02T19:34:36.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.345+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd88045ad0 con 0x7fbd880f66e0 2022-02-02T19:34:36.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.345+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbd78009480 con 0x7fbd880f66e0 2022-02-02T19:34:36.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.346+0000 7fbd7effd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 0x7fbd74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:34:36.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.346+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbd780820d0 con 0x7fbd880f66e0 2022-02-02T19:34:36.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.346+0000 7fbd8da58700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 0x7fbd74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:34:36.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.346+0000 7fbd8da58700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 0x7fbd74067290 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbd84009da0 tx=0x7fbd84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:34:36.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.350+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbd780503c0 con 0x7fbd880f66e0 2022-02-02T19:34:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:36 smithi159 ceph-mon[69013]: pgmap v2175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:36.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.551+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd8806a930 con 0x7fbd880f66e0 2022-02-02T19:34:36.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.551+0000 7fbd7effd700 1 -- 172.21.15.96:0/1171720769 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbd8806a930 con 0x7fbd880f66e0 2022-02-02T19:34:36.558 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:34:36.559 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:34:36.559 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:34:36.559 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:34:36.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:36.560 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:34:36.561 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:34:36.561 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:34:36.562 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:34:36.562 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:34:36.562 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:34:36.563 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:34:36.563 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:34:36.564 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:34:36.564 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:34:36.565 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:34:36.565 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:34:36.565 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:34:36.566 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:34:36.566 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:34:36.567 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:34:36.567 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:34:36.568 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:34:36.568 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:34:36.568 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:34:36.569 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:34:36.569 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:34:36.570 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:34:36.570 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:34:36.571 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:34:36.571 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:34:36.571 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:34:36.571 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:36.571 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:36.572 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:34:36.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:34:36.572 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:36.572 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:36.573 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:34:36.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 msgr2=0x7fbd74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 0x7fbd74067290 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbd84009da0 tx=0x7fbd84009b30).stop 2022-02-02T19:34:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 msgr2=0x7fbd8806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:34:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fbd78002700 tx=0x7fbd78009d80).stop 2022-02-02T19:34:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 shutdown_connections 2022-02-02T19:34:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064dd0 0x7fbd74067290 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd880f66e0 0x7fbd8806b9a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 --2- 172.21.15.96:0/1171720769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd880f7980 0x7fbd88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:34:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 >> 172.21.15.96:0/1171720769 conn(0x7fbd880f1e40 msgr2=0x7fbd880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:34:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 shutdown_connections 2022-02-02T19:34:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:34:36.553+0000 7fbd904bd700 1 -- 172.21.15.96:0/1171720769 wait complete. 2022-02-02T19:34:36.577 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:34:37.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:37 smithi159 ceph-mon[69013]: from='client.36344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:37.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:37 smithi159 ceph-mon[69013]: from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:37.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1100986918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:34:37.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1171720769' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:34:37.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:37 smithi096 ceph-mon[101353]: from='client.36344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:37.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:37 smithi096 ceph-mon[101353]: from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:34:37.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1100986918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:34:37.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1171720769' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:34:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:38 smithi159 ceph-mon[69013]: pgmap v2176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:38 smithi096 ceph-mon[101353]: pgmap v2176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:40 smithi159 ceph-mon[69013]: pgmap v2177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:40 smithi096 ceph-mon[101353]: pgmap v2177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:42 smithi159 ceph-mon[69013]: pgmap v2178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:42 smithi096 ceph-mon[101353]: pgmap v2178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:44 smithi159 ceph-mon[69013]: pgmap v2179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:44 smithi096 ceph-mon[101353]: pgmap v2179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:46.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:46 smithi159 ceph-mon[69013]: pgmap v2180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:46.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:46 smithi096 ceph-mon[101353]: pgmap v2180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:48 smithi159 ceph-mon[69013]: pgmap v2181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:48 smithi096 ceph-mon[101353]: pgmap v2181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:50 smithi159 ceph-mon[69013]: pgmap v2182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:50 smithi096 ceph-mon[101353]: pgmap v2182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:52 smithi159 ceph-mon[69013]: pgmap v2183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:52 smithi096 ceph-mon[101353]: pgmap v2183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:54 smithi159 ceph-mon[69013]: pgmap v2184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:54 smithi096 ceph-mon[101353]: pgmap v2184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:56 smithi159 ceph-mon[69013]: pgmap v2185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:56 smithi096 ceph-mon[101353]: pgmap v2185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:34:58 smithi159 ceph-mon[69013]: pgmap v2186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:34:58.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:34:58 smithi096 ceph-mon[101353]: pgmap v2186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:00.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:00 smithi159 ceph-mon[69013]: pgmap v2187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:00 smithi096 ceph-mon[101353]: pgmap v2187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:02 smithi159 ceph-mon[69013]: pgmap v2188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:02 smithi096 ceph-mon[101353]: pgmap v2188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:04.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:04 smithi159 ceph-mon[69013]: pgmap v2189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:04 smithi096 ceph-mon[101353]: pgmap v2189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:06 smithi159 ceph-mon[69013]: pgmap v2190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:06 smithi096 ceph-mon[101353]: pgmap v2190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 -- 172.21.15.96:0/3912426527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f55c0 msgr2=0x7f81e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 --2- 172.21.15.96:0/3912426527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f55c0 0x7f81e00f59e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f81d4004660 tx=0x7f81d4009b30).stop 2022-02-02T19:35:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 -- 172.21.15.96:0/3912426527 shutdown_connections 2022-02-02T19:35:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 --2- 172.21.15.96:0/3912426527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f6860 0x7f81e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 --2- 172.21.15.96:0/3912426527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f55c0 0x7f81e00f59e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 -- 172.21.15.96:0/3912426527 >> 172.21.15.96:0/3912426527 conn(0x7f81e00f0d40 msgr2=0x7f81e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 -- 172.21.15.96:0/3912426527 shutdown_connections 2022-02-02T19:35:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.665+0000 7f81e83e8700 1 -- 172.21.15.96:0/3912426527 wait complete. 2022-02-02T19:35:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 Processor -- start 2022-02-02T19:35:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 -- start start 2022-02-02T19:35:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e0109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0109c00 con 0x7f81e00f6860 2022-02-02T19:35:06.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e83e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0109d40 con 0x7f81e00f55c0 2022-02-02T19:35:06.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e5983700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e5983700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60542/0 (socket says 172.21.15.96:60542) 2022-02-02T19:35:06.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e5983700 1 -- 172.21.15.96:0/352509525 learned_addr learned my addr 172.21.15.96:0/352509525 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.666+0000 7f81e6184700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e0109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e5983700 1 -- 172.21.15.96:0/352509525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 msgr2=0x7f81e0109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e5983700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e0109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e5983700 1 -- 172.21.15.96:0/352509525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e00f6860 2022-02-02T19:35:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e5983700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f81dc0026d0 tx=0x7f81dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81dc0079c0 con 0x7f81e00f6860 2022-02-02T19:35:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81dc00f040 con 0x7f81e00f6860 2022-02-02T19:35:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81dc0148b0 con 0x7f81e00f6860 2022-02-02T19:35:06.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e010a6e0 con 0x7f81e00f6860 2022-02-02T19:35:06.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.667+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e010aca0 con 0x7f81e00f6860 2022-02-02T19:35:06.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.668+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0045ad0 con 0x7f81e00f6860 2022-02-02T19:35:06.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.669+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f81dc007b20 con 0x7f81e00f6860 2022-02-02T19:35:06.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.670+0000 7f81d2ffd700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 0x7f81cc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.670+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f81dc081900 con 0x7f81e00f6860 2022-02-02T19:35:06.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.670+0000 7f81e6184700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 0x7f81cc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.670+0000 7f81e6184700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 0x7f81cc067270 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f81d4013690 tx=0x7f81d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:06.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.675+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81dc053430 con 0x7f81e00f6860 2022-02-02T19:35:06.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.853+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81e00faaa0 con 0x7f81cc064db0 2022-02-02T19:35:06.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.854+0000 7f81d2ffd700 1 -- 172.21.15.96:0/352509525 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f81e00faaa0 con 0x7f81cc064db0 2022-02-02T19:35:06.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 msgr2=0x7f81cc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 0x7f81cc067270 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f81d4013690 tx=0x7f81d4009b30).stop 2022-02-02T19:35:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 msgr2=0x7f81e0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f81dc0026d0 tx=0x7f81dc009de0).stop 2022-02-02T19:35:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 shutdown_connections 2022-02-02T19:35:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81cc064db0 0x7f81cc067270 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 --2- 172.21.15.96:0/352509525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e0109650 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 >> 172.21.15.96:0/352509525 conn(0x7f81e00f0d40 msgr2=0x7f81e005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 shutdown_connections 2022-02-02T19:35:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.856+0000 7f81e83e8700 1 -- 172.21.15.96:0/352509525 wait complete. 2022-02-02T19:35:06.870 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:35:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 -- 172.21.15.96:0/3351638282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f55c0 msgr2=0x7f6a2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 --2- 172.21.15.96:0/3351638282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c0f59e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f6a28004660 tx=0x7f6a28009b30).stop 2022-02-02T19:35:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 -- 172.21.15.96:0/3351638282 shutdown_connections 2022-02-02T19:35:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 --2- 172.21.15.96:0/3351638282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 --2- 172.21.15.96:0/3351638282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c0f59e0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 -- 172.21.15.96:0/3351638282 >> 172.21.15.96:0/3351638282 conn(0x7f6a2c0f0d40 msgr2=0x7f6a2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 -- 172.21.15.96:0/3351638282 shutdown_connections 2022-02-02T19:35:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.953+0000 7f6a347d1700 1 -- 172.21.15.96:0/3351638282 wait complete. 2022-02-02T19:35:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 Processor -- start 2022-02-02T19:35:06.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 -- start start 2022-02-02T19:35:06.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0603e0 con 0x7f6a2c0f6860 2022-02-02T19:35:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a347d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c060520 con 0x7f6a2c0f55c0 2022-02-02T19:35:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a31d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.954+0000 7f6a31d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60552/0 (socket says 172.21.15.96:60552) 2022-02-02T19:35:06.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a31d6c700 1 -- 172.21.15.96:0/1471029891 learned_addr learned my addr 172.21.15.96:0/1471029891 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:06.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a3256d700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a31d6c700 1 -- 172.21.15.96:0/1471029891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f55c0 msgr2=0x7f6a2c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a31d6c700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a31d6c700 1 -- 172.21.15.96:0/1471029891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28005040 con 0x7f6a2c0f6860 2022-02-02T19:35:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a31d6c700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f6a2000c790 tx=0x7f6a20007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a20002590 con 0x7f6a2c0f6860 2022-02-02T19:35:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a20002ba0 con 0x7f6a2c0f6860 2022-02-02T19:35:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c10c720 con 0x7f6a2c0f6860 2022-02-02T19:35:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a20013d90 con 0x7f6a2c0f6860 2022-02-02T19:35:06.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.955+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c10cce0 con 0x7f6a2c0f6860 2022-02-02T19:35:06.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.956+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c045ad0 con 0x7f6a2c0f6860 2022-02-02T19:35:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.957+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a2001a060 con 0x7f6a2c0f6860 2022-02-02T19:35:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.957+0000 7f6a1effd700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 0x7f6a18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.957+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6a20081c20 con 0x7f6a2c0f6860 2022-02-02T19:35:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.957+0000 7f6a3256d700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 0x7f6a18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.957+0000 7f6a3256d700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 0x7f6a18067290 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f6a28013690 tx=0x7f6a28009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:06.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:06.961+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a2004fcc0 con 0x7f6a2c0f6860 2022-02-02T19:35:07.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.135+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2c057f10 con 0x7f6a18064dd0 2022-02-02T19:35:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.144+0000 7f6a1effd700 1 -- 172.21.15.96:0/1471029891 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6a2c057f10 con 0x7f6a18064dd0 2022-02-02T19:35:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:35:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (78m) 49m ago 79m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:35:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (70m) 49m ago 79m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:35:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (70m) 47m ago 79m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:35:07.151 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (78m) 49m ago 79m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:35:07.151 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (75m) 49m ago 75m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:35:07.151 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (71m) 49m ago 75m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:35:07.151 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (75m) 47m ago 75m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:35:07.152 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (71m) 47m ago 75m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:35:07.152 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (72m) 49m ago 80m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:35:07.152 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (72m) 47m ago 79m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:35:07.152 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (71m) 49m ago 80m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:35:07.153 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (71m) 47m ago 78m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:35:07.153 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (79m) 49m ago 79m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:35:07.153 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (78m) 47m ago 78m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:35:07.154 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (70m) 49m ago 78m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:35:07.154 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (69m) 49m ago 78m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:35:07.154 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (69m) 49m ago 77m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:35:07.154 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (68m) 47m ago 77m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:35:07.155 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (68m) 47m ago 77m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:35:07.155 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (67m) 47m ago 76m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:35:07.155 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (78m) 49m ago 79m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:35:07.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 msgr2=0x7f6a18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 0x7f6a18067290 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f6a28013690 tx=0x7f6a28009b30).stop 2022-02-02T19:35:07.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 msgr2=0x7f6a2c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f6a2000c790 tx=0x7f6a20007d70).stop 2022-02-02T19:35:07.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 shutdown_connections 2022-02-02T19:35:07.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a18064dd0 0x7f6a18067290 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2c0f55c0 0x7f6a2c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 --2- 172.21.15.96:0/1471029891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a2c0f6860 0x7f6a2c10c170 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 >> 172.21.15.96:0/1471029891 conn(0x7f6a2c0f0d40 msgr2=0x7f6a2c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:07.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 shutdown_connections 2022-02-02T19:35:07.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.146+0000 7f6a347d1700 1 -- 172.21.15.96:0/1471029891 wait complete. 2022-02-02T19:35:07.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- 172.21.15.96:0/2616033415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f6530 msgr2=0x7ff38c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2616033415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f6530 0x7ff38c0f6950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7ff37c004660 tx=0x7ff37c009b30).stop 2022-02-02T19:35:07.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- 172.21.15.96:0/2616033415 shutdown_connections 2022-02-02T19:35:07.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2616033415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f77d0 0x7ff38c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:35:07.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2616033415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f6530 0x7ff38c0f6950 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- 172.21.15.96:0/2616033415 >> 172.21.15.96:0/2616033415 conn(0x7ff38c0f1c90 msgr2=0x7ff38c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:07.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- 172.21.15.96:0/2616033415 shutdown_connections 2022-02-02T19:35:07.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- 172.21.15.96:0/2616033415 wait complete. 2022-02-02T19:35:07.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 Processor -- start 2022-02-02T19:35:07.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.243+0000 7ff3929a0700 1 -- start start 2022-02-02T19:35:07.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3929a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f6530 0x7ff38c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3929a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3929a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c1079a0 con 0x7ff38c0f77d0 2022-02-02T19:35:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3929a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c108120 con 0x7ff38c0f6530 2022-02-02T19:35:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60562/0 (socket says 172.21.15.96:60562) 2022-02-02T19:35:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 -- 172.21.15.96:0/2463662194 learned_addr learned my addr 172.21.15.96:0/2463662194 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39199e700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f6530 0x7ff38c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 -- 172.21.15.96:0/2463662194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f6530 msgr2=0x7ff38c106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f6530 0x7ff38c106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 -- 172.21.15.96:0/2463662194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c005040 con 0x7ff38c0f77d0 2022-02-02T19:35:07.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff39119d700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7ff38800b410 tx=0x7ff388006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:07.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3880125f0 con 0x7ff38c0f77d0 2022-02-02T19:35:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff38800be30 con 0x7ff38c0f77d0 2022-02-02T19:35:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.244+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c1083a0 con 0x7ff38c0f77d0 2022-02-02T19:35:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.245+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c108960 con 0x7ff38c0f77d0 2022-02-02T19:35:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.245+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff388002a70 con 0x7ff38c0f77d0 2022-02-02T19:35:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.245+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff374004fa0 con 0x7ff38c0f77d0 2022-02-02T19:35:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.246+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff38800f030 con 0x7ff38c0f77d0 2022-02-02T19:35:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.246+0000 7ff3827fc700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 0x7ff3780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.246+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff388081d70 con 0x7ff38c0f77d0 2022-02-02T19:35:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.246+0000 7ff39199e700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 0x7ff3780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.247+0000 7ff39199e700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 0x7ff3780672e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7ff37c013690 tx=0x7ff37c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.250+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff38804fe10 con 0x7ff38c0f77d0 2022-02-02T19:35:07.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.481+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff374005e80 con 0x7ff38c0f77d0 2022-02-02T19:35:07.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.481+0000 7ff3827fc700 1 -- 172.21.15.96:0/2463662194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff388053430 con 0x7ff38c0f77d0 2022-02-02T19:35:07.486 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:35:07.487 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:35:07.487 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:35:07.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:07.487 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:35:07.488 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:35:07.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:07.488 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:35:07.488 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:35:07.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:07.489 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:35:07.489 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:35:07.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:07.490 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:35:07.490 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:35:07.490 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:35:07.491 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:35:07.491 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:35:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 msgr2=0x7ff3780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 0x7ff3780672e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7ff37c013690 tx=0x7ff37c009b30).stop 2022-02-02T19:35:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 msgr2=0x7ff38c107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7ff38800b410 tx=0x7ff388006ef0).stop 2022-02-02T19:35:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 shutdown_connections 2022-02-02T19:35:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff378064e20 0x7ff3780672e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff38c0f6530 0x7ff38c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 --2- 172.21.15.96:0/2463662194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107310 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 >> 172.21.15.96:0/2463662194 conn(0x7ff38c0f1c90 msgr2=0x7ff38c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 shutdown_connections 2022-02-02T19:35:07.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.483+0000 7ff3929a0700 1 -- 172.21.15.96:0/2463662194 wait complete. 2022-02-02T19:35:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 -- 172.21.15.96:0/2999334120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f77d0 msgr2=0x7fa36c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 --2- 172.21.15.96:0/2999334120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f77d0 0x7fa36c0f7c30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fa368004660 tx=0x7fa368009b30).stop 2022-02-02T19:35:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 -- 172.21.15.96:0/2999334120 shutdown_connections 2022-02-02T19:35:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 --2- 172.21.15.96:0/2999334120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f77d0 0x7fa36c0f7c30 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 --2- 172.21.15.96:0/2999334120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f6530 0x7fa36c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 -- 172.21.15.96:0/2999334120 >> 172.21.15.96:0/2999334120 conn(0x7fa36c0f1c90 msgr2=0x7fa36c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 -- 172.21.15.96:0/2999334120 shutdown_connections 2022-02-02T19:35:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.580+0000 7fa372446700 1 -- 172.21.15.96:0/2999334120 wait complete. 2022-02-02T19:35:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 Processor -- start 2022-02-02T19:35:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 -- start start 2022-02-02T19:35:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f77d0 0x7fa36c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c107880 con 0x7fa36c0f6530 2022-02-02T19:35:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa372446700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c108090 con 0x7fa36c0f77d0 2022-02-02T19:35:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa371444700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa371444700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60570/0 (socket says 172.21.15.96:60570) 2022-02-02T19:35:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa371444700 1 -- 172.21.15.96:0/3133369745 learned_addr learned my addr 172.21.15.96:0/3133369745 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.581+0000 7fa370c43700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f77d0 0x7fa36c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa371444700 1 -- 172.21.15.96:0/3133369745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f77d0 msgr2=0x7fa36c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa371444700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f77d0 0x7fa36c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa371444700 1 -- 172.21.15.96:0/3133369745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368005040 con 0x7fa36c0f6530 2022-02-02T19:35:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa371444700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fa35c002700 tx=0x7fa35c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c0079c0 con 0x7fa36c0f6530 2022-02-02T19:35:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa35c00f040 con 0x7fa36c0f6530 2022-02-02T19:35:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c108310 con 0x7fa36c0f6530 2022-02-02T19:35:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c014860 con 0x7fa36c0f6530 2022-02-02T19:35:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.582+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c1088d0 con 0x7fa36c0f6530 2022-02-02T19:35:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.583+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c059100 con 0x7fa36c0f6530 2022-02-02T19:35:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.583+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa35c01b060 con 0x7fa36c0f6530 2022-02-02T19:35:07.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.584+0000 7fa361ffb700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 0x7fa3580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:07.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.584+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa35c0818e0 con 0x7fa36c0f6530 2022-02-02T19:35:07.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.584+0000 7fa370c43700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 0x7fa3580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:07.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.584+0000 7fa370c43700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 0x7fa3580672e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa368004630 tx=0x7fa368009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:07.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.588+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa35c04f9e0 con 0x7fa36c0f6530 2022-02-02T19:35:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.790+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa36c045ad0 con 0x7fa36c0f6530 2022-02-02T19:35:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.790+0000 7fa361ffb700 1 -- 172.21.15.96:0/3133369745 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa35c019070 con 0x7fa36c0f6530 2022-02-02T19:35:07.796 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:35:07.796 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:35:07.796 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:35:07.796 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:35:07.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:07.797 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:35:07.797 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:35:07.797 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:35:07.798 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:35:07.798 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:35:07.798 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:35:07.798 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:35:07.799 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:35:07.799 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:35:07.799 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:35:07.799 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:35:07.800 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:35:07.800 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:35:07.800 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:35:07.801 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:35:07.801 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:35:07.801 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:35:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:35:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:35:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:35:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:35:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:35:07.803 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:35:07.803 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:35:07.803 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:35:07.803 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:35:07.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:35:07.804 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:07.804 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:07.804 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:35:07.804 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:07.805 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:07.805 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:07.805 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 msgr2=0x7fa3580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 0x7fa3580672e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa368004630 tx=0x7fa368009b30).stop 2022-02-02T19:35:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 msgr2=0x7fa36c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fa35c002700 tx=0x7fa35c009d80).stop 2022-02-02T19:35:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 shutdown_connections 2022-02-02T19:35:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa358064e20 0x7fa3580672e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa36c0f6530 0x7fa36c106d90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 --2- 172.21.15.96:0/3133369745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa36c0f77d0 0x7fa36c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 >> 172.21.15.96:0/3133369745 conn(0x7fa36c0f1c90 msgr2=0x7fa36c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 shutdown_connections 2022-02-02T19:35:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:07.792+0000 7fa372446700 1 -- 172.21.15.96:0/3133369745 wait complete. 2022-02-02T19:35:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:35:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:08 smithi159 ceph-mon[69013]: pgmap v2191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:08 smithi159 ceph-mon[69013]: from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2463662194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:35:08.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3133369745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:35:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:08 smithi096 ceph-mon[101353]: pgmap v2191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:08.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:08 smithi096 ceph-mon[101353]: from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:08.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2463662194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:35:08.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3133369745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:35:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:09 smithi159 ceph-mon[69013]: from='client.36364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:09 smithi096 ceph-mon[101353]: from='client.36364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:10 smithi159 ceph-mon[69013]: pgmap v2192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:10 smithi096 ceph-mon[101353]: pgmap v2192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:12.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:12 smithi096 ceph-mon[101353]: pgmap v2193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:12 smithi159 ceph-mon[69013]: pgmap v2193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:14.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:14 smithi096 ceph-mon[101353]: pgmap v2194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:14.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:14 smithi159 ceph-mon[69013]: pgmap v2194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:16.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:16 smithi096 ceph-mon[101353]: pgmap v2195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:16 smithi159 ceph-mon[69013]: pgmap v2195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:18.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:18 smithi096 ceph-mon[101353]: pgmap v2196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:18 smithi159 ceph-mon[69013]: pgmap v2196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:20 smithi096 ceph-mon[101353]: pgmap v2197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:20 smithi159 ceph-mon[69013]: pgmap v2197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:22.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:22 smithi096 ceph-mon[101353]: pgmap v2198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:22 smithi159 ceph-mon[69013]: pgmap v2198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:24.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:24 smithi096 ceph-mon[101353]: pgmap v2199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:24 smithi159 ceph-mon[69013]: pgmap v2199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:26.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:26 smithi096 ceph-mon[101353]: pgmap v2200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:26 smithi159 ceph-mon[69013]: pgmap v2200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:28.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:28 smithi096 ceph-mon[101353]: pgmap v2201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:35:28.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:35:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:28 smithi159 ceph-mon[69013]: pgmap v2201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:35:28.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:35:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:30 smithi096 ceph-mon[101353]: pgmap v2202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:30 smithi159 ceph-mon[69013]: pgmap v2202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:32 smithi159 ceph-mon[69013]: pgmap v2203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:32 smithi096 ceph-mon[101353]: pgmap v2203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:34 smithi159 ceph-mon[69013]: pgmap v2204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:34.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:34 smithi096 ceph-mon[101353]: pgmap v2204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:36 smithi159 ceph-mon[69013]: pgmap v2205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:36.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:36 smithi096 ceph-mon[101353]: pgmap v2205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:37.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 -- 172.21.15.96:0/2132384578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f66d0 msgr2=0x7f37c40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 --2- 172.21.15.96:0/2132384578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f66d0 0x7f37c40f6b30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f37b8004660 tx=0x7f37b8009b30).stop 2022-02-02T19:35:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 -- 172.21.15.96:0/2132384578 shutdown_connections 2022-02-02T19:35:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 --2- 172.21.15.96:0/2132384578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f66d0 0x7f37c40f6b30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 --2- 172.21.15.96:0/2132384578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f5430 0x7f37c40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:35:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 -- 172.21.15.96:0/2132384578 >> 172.21.15.96:0/2132384578 conn(0x7f37c40f0b90 msgr2=0x7f37c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 -- 172.21.15.96:0/2132384578 shutdown_connections 2022-02-02T19:35:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.902+0000 7f37c359e700 1 -- 172.21.15.96:0/2132384578 wait complete. 2022-02-02T19:35:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 Processor -- start 2022-02-02T19:35:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 -- start start 2022-02-02T19:35:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f66d0 0x7f37c40f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40f8000 con 0x7f37c40f5430 2022-02-02T19:35:37.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40f8140 con 0x7f37c40f66d0 2022-02-02T19:35:37.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:37.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60588/0 (socket says 172.21.15.96:60588) 2022-02-02T19:35:37.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 -- 172.21.15.96:0/563999972 learned_addr learned my addr 172.21.15.96:0/563999972 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c1d9b700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f66d0 0x7f37c40f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 -- 172.21.15.96:0/563999972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f66d0 msgr2=0x7f37c40f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f66d0 0x7f37c40f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 -- 172.21.15.96:0/563999972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8005040 con 0x7f37c40f5430 2022-02-02T19:35:37.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.903+0000 7f37c259c700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f37b40093f0 tx=0x7f37b4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.904+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b4013640 con 0x7f37c40f5430 2022-02-02T19:35:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.904+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37b4013c50 con 0x7f37c40f5430 2022-02-02T19:35:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.904+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c40f8420 con 0x7f37c40f5430 2022-02-02T19:35:37.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.904+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b4012c70 con 0x7f37c40f5430 2022-02-02T19:35:37.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.904+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c410edc0 con 0x7f37c40f5430 2022-02-02T19:35:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.905+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4045ad0 con 0x7f37c40f5430 2022-02-02T19:35:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.905+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f37b401a060 con 0x7f37c40f5430 2022-02-02T19:35:37.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.906+0000 7f37b2ffd700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 0x7f37ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.906+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f37b4081a50 con 0x7f37c40f5430 2022-02-02T19:35:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.906+0000 7f37c1d9b700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 0x7f37ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.906+0000 7f37c1d9b700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 0x7f37ac0672e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f37b8004630 tx=0x7f37b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:37.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:37.910+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37b404faf0 con 0x7f37c40f5430 2022-02-02T19:35:38.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.089+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37c40fab10 con 0x7f37ac064e20 2022-02-02T19:35:38.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.090+0000 7f37b2ffd700 1 -- 172.21.15.96:0/563999972 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f37c40fab10 con 0x7f37ac064e20 2022-02-02T19:35:38.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 msgr2=0x7f37ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 0x7f37ac0672e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f37b8004630 tx=0x7f37b8009b30).stop 2022-02-02T19:35:38.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 msgr2=0x7f37c40f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f37b40093f0 tx=0x7f37b4006ec0).stop 2022-02-02T19:35:38.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 shutdown_connections 2022-02-02T19:35:38.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f37ac064e20 0x7f37ac0672e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37c40f5430 0x7f37c40f9590 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 --2- 172.21.15.96:0/563999972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37c40f66d0 0x7f37c40f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 >> 172.21.15.96:0/563999972 conn(0x7f37c40f0b90 msgr2=0x7f37c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 shutdown_connections 2022-02-02T19:35:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.092+0000 7f37c359e700 1 -- 172.21.15.96:0/563999972 wait complete. 2022-02-02T19:35:38.106 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:35:38.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/2779092336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f6530 msgr2=0x7f8d380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/2779092336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f6530 0x7f8d380f6950 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f8d2c004660 tx=0x7f8d2c009b30).stop 2022-02-02T19:35:38.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/2779092336 shutdown_connections 2022-02-02T19:35:38.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/2779092336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f77d0 0x7f8d380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/2779092336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f6530 0x7f8d380f6950 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/2779092336 >> 172.21.15.96:0/2779092336 conn(0x7f8d380f1c90 msgr2=0x7f8d380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/2779092336 shutdown_connections 2022-02-02T19:35:38.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.189+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/2779092336 wait complete. 2022-02-02T19:35:38.197 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:38 smithi096 ceph-mon[101353]: pgmap v2206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:38.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.190+0000 7f8d3dbdb700 1 Processor -- start 2022-02-02T19:35:38.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.190+0000 7f8d3dbdb700 1 -- start start 2022-02-02T19:35:38.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3dbdb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 0x7f8d38108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3dbdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3dbdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38109a50 con 0x7f8d380f77d0 2022-02-02T19:35:38.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3dbdb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38109b90 con 0x7f8d380f6530 2022-02-02T19:35:38.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60600/0 (socket says 172.21.15.96:60600) 2022-02-02T19:35:38.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 -- 172.21.15.96:0/1329180086 learned_addr learned my addr 172.21.15.96:0/1329180086 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:38.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3cbd9700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 0x7f8d38108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 -- 172.21.15.96:0/1329180086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 msgr2=0x7f8d38108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 0x7f8d38108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 -- 172.21.15.96:0/1329180086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c005040 con 0x7f8d380f77d0 2022-02-02T19:35:38.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d3cbd9700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 0x7f8d38108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:35:38.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d37fff700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f8d240026d0 tx=0x7f8d24009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.191+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d24009320 con 0x7f8d380f77d0 2022-02-02T19:35:38.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.192+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3810a530 con 0x7f8d380f77d0 2022-02-02T19:35:38.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.192+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3810aaf0 con 0x7f8d380f77d0 2022-02-02T19:35:38.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.192+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d2400f040 con 0x7f8d380f77d0 2022-02-02T19:35:38.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.192+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d240147e0 con 0x7f8d380f77d0 2022-02-02T19:35:38.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.193+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d18004fa0 con 0x7f8d380f77d0 2022-02-02T19:35:38.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.193+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d24009480 con 0x7f8d380f77d0 2022-02-02T19:35:38.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.193+0000 7f8d357fa700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 0x7f8d280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.194+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d24082050 con 0x7f8d380f77d0 2022-02-02T19:35:38.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.194+0000 7f8d3cbd9700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 0x7f8d280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.194+0000 7f8d3cbd9700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 0x7f8d280672e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f8d2c005010 tx=0x7f8d2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.198+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d24053b80 con 0x7f8d380f77d0 2022-02-02T19:35:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.374+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d18000bc0 con 0x7f8d28064e20 2022-02-02T19:35:38.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.383+0000 7f8d357fa700 1 -- 172.21.15.96:0/1329180086 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8d18000bc0 con 0x7f8d28064e20 2022-02-02T19:35:38.388 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:35:38.388 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (79m) 49m ago 80m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:35:38.389 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (71m) 49m ago 80m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:35:38.389 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (71m) 48m ago 79m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:35:38.389 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (78m) 49m ago 79m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:35:38.389 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (76m) 49m ago 76m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:35:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (71m) 49m ago 76m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:35:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (76m) 48m ago 76m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:35:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (71m) 48m ago 76m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:35:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (73m) 49m ago 81m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:35:38.390 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (72m) 48m ago 79m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:35:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (72m) 49m ago 81m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:35:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (71m) 48m ago 79m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:35:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (79m) 49m ago 79m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:35:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (79m) 48m ago 79m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:35:38.392 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (71m) 49m ago 78m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:35:38.392 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (70m) 49m ago 78m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:35:38.392 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (69m) 49m ago 78m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:35:38.392 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (69m) 48m ago 77m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:35:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (68m) 48m ago 77m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:35:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (68m) 48m ago 77m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:35:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (78m) 49m ago 79m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:35:38.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 msgr2=0x7f8d280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 0x7f8d280672e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f8d2c005010 tx=0x7f8d2c009b30).stop 2022-02-02T19:35:38.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 msgr2=0x7f8d381094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f8d240026d0 tx=0x7f8d24009de0).stop 2022-02-02T19:35:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 shutdown_connections 2022-02-02T19:35:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d28064e20 0x7f8d280672e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d380f6530 0x7f8d38108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 --2- 172.21.15.96:0/1329180086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d380f77d0 0x7f8d381094a0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 >> 172.21.15.96:0/1329180086 conn(0x7f8d380f1c90 msgr2=0x7f8d3806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 shutdown_connections 2022-02-02T19:35:38.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.385+0000 7f8d3dbdb700 1 -- 172.21.15.96:0/1329180086 wait complete. 2022-02-02T19:35:38.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 -- 172.21.15.96:0/3475623969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 msgr2=0x7fe9bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3475623969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc0f6cc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fe9ac004660 tx=0x7fe9ac009b30).stop 2022-02-02T19:35:38.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 -- 172.21.15.96:0/3475623969 shutdown_connections 2022-02-02T19:35:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3475623969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc0f6cc0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3475623969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 0x7fe9bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:35:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 -- 172.21.15.96:0/3475623969 >> 172.21.15.96:0/3475623969 conn(0x7fe9bc0f0d40 msgr2=0x7fe9bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 -- 172.21.15.96:0/3475623969 shutdown_connections 2022-02-02T19:35:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.482+0000 7fe9c1226700 1 -- 172.21.15.96:0/3475623969 wait complete. 2022-02-02T19:35:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 Processor -- start 2022-02-02T19:35:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 -- start start 2022-02-02T19:35:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 0x7fe9bc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc107ae0 con 0x7fe9bc0f6860 2022-02-02T19:35:38.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9c1226700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc108390 con 0x7fe9bc0f55c0 2022-02-02T19:35:38.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60610/0 (socket says 172.21.15.96:60610) 2022-02-02T19:35:38.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 -- 172.21.15.96:0/3416529113 learned_addr learned my addr 172.21.15.96:0/3416529113 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9bad9d700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 0x7fe9bc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 -- 172.21.15.96:0/3416529113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 msgr2=0x7fe9bc106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 0x7fe9bc106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.483+0000 7fe9ba59c700 1 -- 172.21.15.96:0/3416529113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac005040 con 0x7fe9bc0f6860 2022-02-02T19:35:38.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9ba59c700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe9ac009990 tx=0x7fe9ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9ac018070 con 0x7fe9bc0f6860 2022-02-02T19:35:38.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc108610 con 0x7fe9bc0f6860 2022-02-02T19:35:38.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe9ac007ba0 con 0x7fe9bc0f6860 2022-02-02T19:35:38.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9ac01c620 con 0x7fe9bc0f6860 2022-02-02T19:35:38.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.484+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc108b70 con 0x7fe9bc0f6860 2022-02-02T19:35:38.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.485+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc0f49b0 con 0x7fe9bc0f6860 2022-02-02T19:35:38.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.485+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe9ac01d420 con 0x7fe9bc0f6860 2022-02-02T19:35:38.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.486+0000 7fe9a37fe700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 0x7fe9a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.486+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe9ac0837d0 con 0x7fe9bc0f6860 2022-02-02T19:35:38.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.486+0000 7fe9bad9d700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 0x7fe9a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.486+0000 7fe9bad9d700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 0x7fe9a4067290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe9b0006fd0 tx=0x7fe9b0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.490+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe9ac055300 con 0x7fe9bc0f6860 2022-02-02T19:35:38.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:38 smithi159 ceph-mon[69013]: pgmap v2206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:38.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.717+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9bc0fef60 con 0x7fe9bc0f6860 2022-02-02T19:35:38.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.717+0000 7fe9a37fe700 1 -- 172.21.15.96:0/3416529113 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe9ac054ef0 con 0x7fe9bc0f6860 2022-02-02T19:35:38.723 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:35:38.723 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:35:38.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:35:38.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:38.724 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:35:38.724 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:35:38.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:38.725 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:35:38.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:35:38.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:38.726 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:35:38.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:35:38.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:35:38.727 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:35:38.727 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:35:38.727 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:35:38.727 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:35:38.727 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:35:38.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.719+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 msgr2=0x7fe9a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 0x7fe9a4067290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe9b0006fd0 tx=0x7fe9b0008040).stop 2022-02-02T19:35:38.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 msgr2=0x7fe9bc1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe9ac009990 tx=0x7fe9ac009b30).stop 2022-02-02T19:35:38.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 shutdown_connections 2022-02-02T19:35:38.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe9a4064dd0 0x7fe9a4067290 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9bc0f55c0 0x7fe9bc106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 --2- 172.21.15.96:0/3416529113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9bc0f6860 0x7fe9bc1074a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 >> 172.21.15.96:0/3416529113 conn(0x7fe9bc0f0d40 msgr2=0x7fe9bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 shutdown_connections 2022-02-02T19:35:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.720+0000 7fe9c1226700 1 -- 172.21.15.96:0/3416529113 wait complete. 2022-02-02T19:35:38.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 -- 172.21.15.96:0/2070489134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f6630 msgr2=0x7f57080f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 --2- 172.21.15.96:0/2070489134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f6630 0x7f57080f6a90 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f56fc004660 tx=0x7f56fc009b30).stop 2022-02-02T19:35:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 -- 172.21.15.96:0/2070489134 shutdown_connections 2022-02-02T19:35:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 --2- 172.21.15.96:0/2070489134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f6630 0x7f57080f6a90 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 --2- 172.21.15.96:0/2070489134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f5390 0x7f57080f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 -- 172.21.15.96:0/2070489134 >> 172.21.15.96:0/2070489134 conn(0x7f57080f0ad0 msgr2=0x7f57080f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 -- 172.21.15.96:0/2070489134 shutdown_connections 2022-02-02T19:35:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.818+0000 7f570caf5700 1 -- 172.21.15.96:0/2070489134 wait complete. 2022-02-02T19:35:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 Processor -- start 2022-02-02T19:35:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 -- start start 2022-02-02T19:35:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f6630 0x7f5708107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5708107850 con 0x7f57080f5390 2022-02-02T19:35:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f570caf5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5708108060 con 0x7f57080f6630 2022-02-02T19:35:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f57077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f57077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60616/0 (socket says 172.21.15.96:60616) 2022-02-02T19:35:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.819+0000 7f57077fe700 1 -- 172.21.15.96:0/4049567430 learned_addr learned my addr 172.21.15.96:0/4049567430 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:35:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f5706ffd700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f6630 0x7f5708107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f57077fe700 1 -- 172.21.15.96:0/4049567430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f6630 msgr2=0x7f5708107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f57077fe700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f6630 0x7f5708107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f57077fe700 1 -- 172.21.15.96:0/4049567430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc005040 con 0x7f57080f5390 2022-02-02T19:35:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f57077fe700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f56f8002700 tx=0x7f56f8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f8009320 con 0x7f57080f5390 2022-02-02T19:35:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56f800f040 con 0x7f57080f5390 2022-02-02T19:35:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57081082e0 con 0x7f57080f5390 2022-02-02T19:35:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f8014900 con 0x7f57080f5390 2022-02-02T19:35:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.820+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57081088a0 con 0x7f57080f5390 2022-02-02T19:35:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.821+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5708059100 con 0x7f57080f5390 2022-02-02T19:35:38.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.821+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56f8009480 con 0x7f57080f5390 2022-02-02T19:35:38.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.822+0000 7f56effff700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 0x7f56f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:35:38.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.822+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56f8081d30 con 0x7f57080f5390 2022-02-02T19:35:38.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.822+0000 7f5706ffd700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 0x7f56f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:35:38.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.822+0000 7f5706ffd700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 0x7f56f00672e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f56fc009da0 tx=0x7f56fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:35:38.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:38.826+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56f804fe30 con 0x7f57080f5390 2022-02-02T19:35:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.026+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f570810d2d0 con 0x7f57080f5390 2022-02-02T19:35:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.027+0000 7f56effff700 1 -- 172.21.15.96:0/4049567430 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f56f8053450 con 0x7f57080f5390 2022-02-02T19:35:39.032 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:35:39.032 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:35:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:35:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:35:39.033 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:35:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:35:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:35:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:35:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:35:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:35:39.035 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:35:39.035 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:35:39.035 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:35:39.036 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:35:39.036 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:35:39.036 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:35:39.036 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:35:39.037 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:35:39.037 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:35:39.037 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:35:39.037 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:35:39.037 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:35:39.038 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:35:39.038 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:35:39.038 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:35:39.038 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:35:39.039 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:35:39.039 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:35:39.039 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:35:39.039 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:35:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:35:39.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:39.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:35:39.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:35:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:35:39.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 msgr2=0x7f56f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:39.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 0x7f56f00672e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f56fc009da0 tx=0x7f56fc009b30).stop 2022-02-02T19:35:39.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 msgr2=0x7f5708106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:35:39.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f56f8002700 tx=0x7f56f8009d80).stop 2022-02-02T19:35:39.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 shutdown_connections 2022-02-02T19:35:39.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f0064e20 0x7f56f00672e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:39.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5390 0x7f5708106d60 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:39.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.028+0000 7f570caf5700 1 --2- 172.21.15.96:0/4049567430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f6630 0x7f5708107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:35:39.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.029+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 >> 172.21.15.96:0/4049567430 conn(0x7f57080f0ad0 msgr2=0x7f570805fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:35:39.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.029+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 shutdown_connections 2022-02-02T19:35:39.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:35:39.029+0000 7f570caf5700 1 -- 172.21.15.96:0/4049567430 wait complete. 2022-02-02T19:35:39.045 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:35:39.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:39 smithi096 ceph-mon[101353]: from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:39.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3416529113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:35:39.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4049567430' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:35:39.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:39 smithi159 ceph-mon[69013]: from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:39.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3416529113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:35:39.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4049567430' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:35:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:40 smithi159 ceph-mon[69013]: pgmap v2207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:40.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:40 smithi159 ceph-mon[69013]: from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:40 smithi096 ceph-mon[101353]: pgmap v2207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:40.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:40 smithi096 ceph-mon[101353]: from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:35:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:42 smithi159 ceph-mon[69013]: pgmap v2208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:42 smithi096 ceph-mon[101353]: pgmap v2208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:44 smithi159 ceph-mon[69013]: pgmap v2209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:44 smithi096 ceph-mon[101353]: pgmap v2209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:46 smithi159 ceph-mon[69013]: pgmap v2210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:46.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:46 smithi096 ceph-mon[101353]: pgmap v2210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:48 smithi159 ceph-mon[69013]: pgmap v2211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:48 smithi096 ceph-mon[101353]: pgmap v2211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:50 smithi159 ceph-mon[69013]: pgmap v2212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:50 smithi096 ceph-mon[101353]: pgmap v2212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:52 smithi159 ceph-mon[69013]: pgmap v2213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:52 smithi096 ceph-mon[101353]: pgmap v2213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:54 smithi159 ceph-mon[69013]: pgmap v2214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:54 smithi096 ceph-mon[101353]: pgmap v2214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:56.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:56 smithi159 ceph-mon[69013]: pgmap v2215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:56 smithi096 ceph-mon[101353]: pgmap v2215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:35:58 smithi159 ceph-mon[69013]: pgmap v2216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:35:58.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:35:58 smithi096 ceph-mon[101353]: pgmap v2216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:00 smithi159 ceph-mon[69013]: pgmap v2217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:00 smithi096 ceph-mon[101353]: pgmap v2217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:02 smithi159 ceph-mon[69013]: pgmap v2218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:02 smithi096 ceph-mon[101353]: pgmap v2218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:04 smithi159 ceph-mon[69013]: pgmap v2219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:04 smithi096 ceph-mon[101353]: pgmap v2219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:06 smithi159 ceph-mon[69013]: pgmap v2220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:06 smithi096 ceph-mon[101353]: pgmap v2220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:08 smithi159 ceph-mon[69013]: pgmap v2221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:08.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:08 smithi096 ceph-mon[101353]: pgmap v2221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 -- 172.21.15.96:0/1943480495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f6860 msgr2=0x7f06b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 --2- 172.21.15.96:0/1943480495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f6860 0x7f06b80f6cc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f06ac004660 tx=0x7f06ac009b30).stop 2022-02-02T19:36:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 -- 172.21.15.96:0/1943480495 shutdown_connections 2022-02-02T19:36:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 --2- 172.21.15.96:0/1943480495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f6860 0x7f06b80f6cc0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 --2- 172.21.15.96:0/1943480495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f55c0 0x7f06b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 -- 172.21.15.96:0/1943480495 >> 172.21.15.96:0/1943480495 conn(0x7f06b80f0d40 msgr2=0x7f06b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 -- 172.21.15.96:0/1943480495 shutdown_connections 2022-02-02T19:36:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.139+0000 7f06c072a700 1 -- 172.21.15.96:0/1943480495 wait complete. 2022-02-02T19:36:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 Processor -- start 2022-02-02T19:36:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 -- start start 2022-02-02T19:36:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f6860 0x7f06b810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80603c0 con 0x7f06b80f55c0 2022-02-02T19:36:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06c072a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8060500 con 0x7f06b80f6860 2022-02-02T19:36:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06be4c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06be4c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60634/0 (socket says 172.21.15.96:60634) 2022-02-02T19:36:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06be4c6700 1 -- 172.21.15.96:0/912993106 learned_addr learned my addr 172.21.15.96:0/912993106 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.140+0000 7f06bdcc5700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f6860 0x7f06b810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06be4c6700 1 -- 172.21.15.96:0/912993106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f6860 msgr2=0x7f06b810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06be4c6700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f6860 0x7f06b810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06be4c6700 1 -- 172.21.15.96:0/912993106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac005040 con 0x7f06b80f55c0 2022-02-02T19:36:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06be4c6700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f06b4002700 tx=0x7f06b4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06b40079c0 con 0x7f06b80f55c0 2022-02-02T19:36:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b810c720 con 0x7f06b80f55c0 2022-02-02T19:36:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06b400f040 con 0x7f06b80f55c0 2022-02-02T19:36:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06b4014860 con 0x7f06b80f55c0 2022-02-02T19:36:09.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.141+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b810ccb0 con 0x7f06b80f55c0 2022-02-02T19:36:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.142+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b8045ad0 con 0x7f06b80f55c0 2022-02-02T19:36:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.143+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06b401b060 con 0x7f06b80f55c0 2022-02-02T19:36:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.143+0000 7f06aaffd700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 0x7f06a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.143+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f06b40819d0 con 0x7f06b80f55c0 2022-02-02T19:36:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.143+0000 7f06bdcc5700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 0x7f06a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.144+0000 7f06bdcc5700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 0x7f06a4067290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f06ac004630 tx=0x7f06ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.147+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06b404fb50 con 0x7f06b80f55c0 2022-02-02T19:36:09.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.324+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06b8057f10 con 0x7f06a4064dd0 2022-02-02T19:36:09.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.325+0000 7f06aaffd700 1 -- 172.21.15.96:0/912993106 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f06b8057f10 con 0x7f06a4064dd0 2022-02-02T19:36:09.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 msgr2=0x7f06a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 0x7f06a4067290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f06ac004630 tx=0x7f06ac009b30).stop 2022-02-02T19:36:09.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 msgr2=0x7f06b8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f06b4002700 tx=0x7f06b4009d80).stop 2022-02-02T19:36:09.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 shutdown_connections 2022-02-02T19:36:09.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06a4064dd0 0x7f06a4067290 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06b80f55c0 0x7f06b8109c70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 --2- 172.21.15.96:0/912993106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06b80f6860 0x7f06b810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 >> 172.21.15.96:0/912993106 conn(0x7f06b80f0d40 msgr2=0x7f06b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 shutdown_connections 2022-02-02T19:36:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.327+0000 7f06c072a700 1 -- 172.21.15.96:0/912993106 wait complete. 2022-02-02T19:36:09.343 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:36:09.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 -- 172.21.15.96:0/3911741972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f6860 msgr2=0x7f9fc40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 --2- 172.21.15.96:0/3911741972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f6860 0x7f9fc40f6cc0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f9fc0004660 tx=0x7f9fc0009b30).stop 2022-02-02T19:36:09.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 -- 172.21.15.96:0/3911741972 shutdown_connections 2022-02-02T19:36:09.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 --2- 172.21.15.96:0/3911741972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f6860 0x7f9fc40f6cc0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 --2- 172.21.15.96:0/3911741972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f55c0 0x7f9fc40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 -- 172.21.15.96:0/3911741972 >> 172.21.15.96:0/3911741972 conn(0x7f9fc40f0d40 msgr2=0x7f9fc40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:09.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 -- 172.21.15.96:0/3911741972 shutdown_connections 2022-02-02T19:36:09.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.425+0000 7f9fcc072700 1 -- 172.21.15.96:0/3911741972 wait complete. 2022-02-02T19:36:09.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 Processor -- start 2022-02-02T19:36:09.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 -- start start 2022-02-02T19:36:09.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f6860 0x7f9fc410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40603c0 con 0x7f9fc40f55c0 2022-02-02T19:36:09.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fcc072700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4060500 con 0x7f9fc40f6860 2022-02-02T19:36:09.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fc9e0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fc9e0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60644/0 (socket says 172.21.15.96:60644) 2022-02-02T19:36:09.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fc9e0e700 1 -- 172.21.15.96:0/159930316 learned_addr learned my addr 172.21.15.96:0/159930316 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:09.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.426+0000 7f9fc960d700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f6860 0x7f9fc410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fc9e0e700 1 -- 172.21.15.96:0/159930316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f6860 msgr2=0x7f9fc410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fc9e0e700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f6860 0x7f9fc410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fc9e0e700 1 -- 172.21.15.96:0/159930316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0005040 con 0x7f9fc40f55c0 2022-02-02T19:36:09.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fc9e0e700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9fb400c530 tx=0x7f9fb4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb400f650 con 0x7f9fc40f55c0 2022-02-02T19:36:09.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc410c720 con 0x7f9fc40f55c0 2022-02-02T19:36:09.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc410ccb0 con 0x7f9fc40f55c0 2022-02-02T19:36:09.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9fb400fc60 con 0x7f9fc40f55c0 2022-02-02T19:36:09.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.427+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4012cb0 con 0x7f9fc40f55c0 2022-02-02T19:36:09.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.428+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac004fa0 con 0x7f9fc40f55c0 2022-02-02T19:36:09.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.429+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9fb4019030 con 0x7f9fc40f55c0 2022-02-02T19:36:09.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.429+0000 7f9fba7fc700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 0x7f9fb006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.429+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9fb4081500 con 0x7f9fc40f55c0 2022-02-02T19:36:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.429+0000 7f9fc960d700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 0x7f9fb006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.429+0000 7f9fc960d700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 0x7f9fb006b6a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9fc0004630 tx=0x7f9fc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.433+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9fb40487d0 con 0x7f9fc40f55c0 2022-02-02T19:36:09.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.605+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fac0029f0 con 0x7f9fb00691e0 2022-02-02T19:36:09.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.615+0000 7f9fba7fc700 1 -- 172.21.15.96:0/159930316 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9fac0029f0 con 0x7f9fb00691e0 2022-02-02T19:36:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:36:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (79m) 50m ago 80m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:36:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (71m) 50m ago 80m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:36:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (71m) 48m ago 80m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:36:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (79m) 50m ago 80m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:36:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (76m) 50m ago 76m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:36:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (72m) 50m ago 76m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:36:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (76m) 48m ago 76m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:36:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (72m) 48m ago 76m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:36:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (73m) 50m ago 81m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:36:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (73m) 48m ago 80m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:36:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (72m) 50m ago 81m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:36:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (72m) 48m ago 79m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:36:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (80m) 50m ago 80m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:36:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (79m) 48m ago 79m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:36:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (71m) 50m ago 79m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:36:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (71m) 50m ago 79m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:36:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (70m) 50m ago 78m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:36:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (69m) 48m ago 78m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:36:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (69m) 48m ago 78m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:36:09.626 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (68m) 48m ago 77m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:36:09.626 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (79m) 50m ago 80m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:36:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 msgr2=0x7f9fb006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 0x7f9fb006b6a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9fc0004630 tx=0x7f9fc0009b30).stop 2022-02-02T19:36:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 msgr2=0x7f9fc4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9fb400c530 tx=0x7f9fb4007e10).stop 2022-02-02T19:36:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 shutdown_connections 2022-02-02T19:36:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fb00691e0 0x7f9fb006b6a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc40f55c0 0x7f9fc4109c70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 --2- 172.21.15.96:0/159930316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fc40f6860 0x7f9fc410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 >> 172.21.15.96:0/159930316 conn(0x7f9fc40f0d40 msgr2=0x7f9fc40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 shutdown_connections 2022-02-02T19:36:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.617+0000 7f9fcc072700 1 -- 172.21.15.96:0/159930316 wait complete. 2022-02-02T19:36:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 -- 172.21.15.96:0/3460229165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f77d0 msgr2=0x7fccfc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/3460229165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f77d0 0x7fccfc0f7c30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fccf8004660 tx=0x7fccf8009b30).stop 2022-02-02T19:36:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 -- 172.21.15.96:0/3460229165 shutdown_connections 2022-02-02T19:36:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/3460229165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f77d0 0x7fccfc0f7c30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/3460229165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc0f6530 0x7fccfc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 -- 172.21.15.96:0/3460229165 >> 172.21.15.96:0/3460229165 conn(0x7fccfc0f1c90 msgr2=0x7fccfc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 -- 172.21.15.96:0/3460229165 shutdown_connections 2022-02-02T19:36:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.713+0000 7fcd02c1f700 1 -- 172.21.15.96:0/3460229165 wait complete. 2022-02-02T19:36:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 Processor -- start 2022-02-02T19:36:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 -- start start 2022-02-02T19:36:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 0x7fccfc1082c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc1078a0 con 0x7fccfc0f6530 2022-02-02T19:36:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd02c1f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc1079e0 con 0x7fccfc1073d0 2022-02-02T19:36:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.714+0000 7fcd01c1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60654/0 (socket says 172.21.15.96:60654) 2022-02-02T19:36:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 -- 172.21.15.96:0/1716351691 learned_addr learned my addr 172.21.15.96:0/1716351691 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd0141c700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 0x7fccfc1082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 -- 172.21.15.96:0/1716351691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 msgr2=0x7fccfc1082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 0x7fccfc1082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 -- 172.21.15.96:0/1716351691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8005040 con 0x7fccfc0f6530 2022-02-02T19:36:09.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd0141c700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 0x7fccfc1082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:36:09.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd01c1d700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fccec00c530 tx=0x7fccec007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccec00f650 con 0x7fccfc0f6530 2022-02-02T19:36:09.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc108870 con 0x7fccfc0f6530 2022-02-02T19:36:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fccec00fc60 con 0x7fccfc0f6530 2022-02-02T19:36:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccec012d20 con 0x7fccfc0f6530 2022-02-02T19:36:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.715+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc108e30 con 0x7fccfc0f6530 2022-02-02T19:36:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.717+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc1090b0 con 0x7fccfc0f6530 2022-02-02T19:36:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.717+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fccec019030 con 0x7fccfc0f6530 2022-02-02T19:36:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.717+0000 7fccf27fc700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 0x7fcce80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.717+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fccec081770 con 0x7fccfc0f6530 2022-02-02T19:36:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.717+0000 7fcd0141c700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 0x7fcce80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.718+0000 7fcd0141c700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 0x7fcce80672e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fccf8000c00 tx=0x7fccf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:09.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.721+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fccec053230 con 0x7fccfc0f6530 2022-02-02T19:36:09.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.951+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccfc0fecf0 con 0x7fccfc0f6530 2022-02-02T19:36:10.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.951+0000 7fccf27fc700 1 -- 172.21.15.96:0/1716351691 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fccec052e20 con 0x7fccfc0f6530 2022-02-02T19:36:10.299 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:36:10.300 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:36:10.300 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:36:10.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:10.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:36:10.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:36:10.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:10.302 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:36:10.302 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:36:10.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:10.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:36:10.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:36:10.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:10.304 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:36:10.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:36:10.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:36:10.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:36:10.306 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:36:10.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 msgr2=0x7fcce80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:10.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 0x7fcce80672e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fccf8000c00 tx=0x7fccf8009b30).stop 2022-02-02T19:36:10.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 msgr2=0x7fccfc106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:10.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fccec00c530 tx=0x7fccec007e10).stop 2022-02-02T19:36:10.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 shutdown_connections 2022-02-02T19:36:10.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcce8064e20 0x7fcce80672e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fccfc0f6530 0x7fccfc106ee0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 --2- 172.21.15.96:0/1716351691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccfc1073d0 0x7fccfc1082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 >> 172.21.15.96:0/1716351691 conn(0x7fccfc0f1c90 msgr2=0x7fccfc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:10.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 shutdown_connections 2022-02-02T19:36:10.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:09.953+0000 7fcd02c1f700 1 -- 172.21.15.96:0/1716351691 wait complete. 2022-02-02T19:36:10.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 -- 172.21.15.96:0/2696725795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 msgr2=0x7fa4a80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:10.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 --2- 172.21.15.96:0/2696725795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f6cc0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fa494004660 tx=0x7fa494009b30).stop 2022-02-02T19:36:10.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 -- 172.21.15.96:0/2696725795 shutdown_connections 2022-02-02T19:36:10.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 --2- 172.21.15.96:0/2696725795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f6cc0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 --2- 172.21.15.96:0/2696725795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f55c0 0x7fa4a80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 -- 172.21.15.96:0/2696725795 >> 172.21.15.96:0/2696725795 conn(0x7fa4a80f0d40 msgr2=0x7fa4a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:10.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 -- 172.21.15.96:0/2696725795 shutdown_connections 2022-02-02T19:36:10.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.050+0000 7fa4aebed700 1 -- 172.21.15.96:0/2696725795 wait complete. 2022-02-02T19:36:10.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 Processor -- start 2022-02-02T19:36:10.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 -- start start 2022-02-02T19:36:10.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f55c0 0x7fa4a80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:10.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:10.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80f8100 con 0x7fa4a80f6860 2022-02-02T19:36:10.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4aebed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80f8240 con 0x7fa4a80f55c0 2022-02-02T19:36:10.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:10.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60666/0 (socket says 172.21.15.96:60666) 2022-02-02T19:36:10.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.051+0000 7fa4a7fff700 1 -- 172.21.15.96:0/4108984195 learned_addr learned my addr 172.21.15.96:0/4108984195 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:10.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a7fff700 1 -- 172.21.15.96:0/4108984195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f55c0 msgr2=0x7fa4a80f9720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T19:36:10.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a7fff700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f55c0 0x7fa4a80f9720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:36:10.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a7fff700 1 -- 172.21.15.96:0/4108984195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494005040 con 0x7fa4a80f6860 2022-02-02T19:36:10.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a7fff700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fa494009990 tx=0x7fa494009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:10.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa494018070 con 0x7fa4a80f6860 2022-02-02T19:36:10.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa494007ca0 con 0x7fa4a80f6860 2022-02-02T19:36:10.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a80f84c0 con 0x7fa4a80f6860 2022-02-02T19:36:10.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49401c620 con 0x7fa4a80f6860 2022-02-02T19:36:10.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.052+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a80f8a20 con 0x7fa4a80f6860 2022-02-02T19:36:10.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.053+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8045ad0 con 0x7fa4a80f6860 2022-02-02T19:36:10.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.054+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa49401d960 con 0x7fa4a80f6860 2022-02-02T19:36:10.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.054+0000 7fa4a57fa700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 0x7fa498067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:10.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.054+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa494083710 con 0x7fa4a80f6860 2022-02-02T19:36:10.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.054+0000 7fa4ac989700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 0x7fa498067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:10.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.055+0000 7fa4ac989700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 0x7fa498067290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fa4a80f94b0 tx=0x7fa49c007a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:10.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.058+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4940518d0 con 0x7fa4a80f6860 2022-02-02T19:36:10.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.261+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4a810f660 con 0x7fa4a80f6860 2022-02-02T19:36:10.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.262+0000 7fa4a57fa700 1 -- 172.21.15.96:0/4108984195 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa494054ef0 con 0x7fa4a80f6860 2022-02-02T19:36:10.323 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:36:10.323 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:36:10.323 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:36:10.324 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:36:10.324 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:10.324 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:36:10.324 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:36:10.324 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:36:10.325 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:36:10.325 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:36:10.325 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:36:10.325 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:36:10.326 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:36:10.326 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:36:10.326 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:36:10.327 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:36:10.327 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:36:10.327 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:36:10.327 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:36:10.328 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:36:10.328 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:36:10.329 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:36:10.329 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:36:10.329 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:36:10.329 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:36:10.330 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:36:10.330 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:36:10.330 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:36:10.330 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:36:10.331 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:36:10.331 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:36:10.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:36:10.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:10.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:10.332 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:36:10.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:10.333 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:10.333 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:10.333 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:10.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 msgr2=0x7fa498067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:10.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 0x7fa498067290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fa4a80f94b0 tx=0x7fa49c007a60).stop 2022-02-02T19:36:10.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 msgr2=0x7fa4a80f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:10.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fa494009990 tx=0x7fa494009b30).stop 2022-02-02T19:36:10.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 shutdown_connections 2022-02-02T19:36:10.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa498064dd0 0x7fa498067290 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f55c0 0x7fa4a80f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:36:10.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 --2- 172.21.15.96:0/4108984195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f6860 0x7fa4a80f7ba0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:10.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 >> 172.21.15.96:0/4108984195 conn(0x7fa4a80f0d40 msgr2=0x7fa4a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:10.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 shutdown_connections 2022-02-02T19:36:10.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:10.265+0000 7fa4aebed700 1 -- 172.21.15.96:0/4108984195 wait complete. 2022-02-02T19:36:10.337 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:36:10.337 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:10 smithi096 ceph-mon[101353]: pgmap v2222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:10.338 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1716351691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:36:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:10 smithi159 ceph-mon[69013]: pgmap v2222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:10.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1716351691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:36:11.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:11 smithi159 ceph-mon[69013]: from='client.36392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:11.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:11 smithi159 ceph-mon[69013]: from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:11.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4108984195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:36:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:11 smithi096 ceph-mon[101353]: from='client.36392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:11.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:11 smithi096 ceph-mon[101353]: from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:11.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4108984195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:36:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:12 smithi159 ceph-mon[69013]: pgmap v2223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:12.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:12 smithi096 ceph-mon[101353]: pgmap v2223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:13.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:13 smithi159 ceph-mon[69013]: pgmap v2224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:13 smithi096 ceph-mon[101353]: pgmap v2224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:15.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:15 smithi159 ceph-mon[69013]: pgmap v2225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:15.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:15 smithi096 ceph-mon[101353]: pgmap v2225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:18.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:18 smithi096 ceph-mon[101353]: pgmap v2226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:18 smithi159 ceph-mon[69013]: pgmap v2226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:20 smithi096 ceph-mon[101353]: pgmap v2227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:20 smithi159 ceph-mon[69013]: pgmap v2227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:22.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:22 smithi096 ceph-mon[101353]: pgmap v2228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:22 smithi159 ceph-mon[69013]: pgmap v2228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:24.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:24 smithi096 ceph-mon[101353]: pgmap v2229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:24 smithi159 ceph-mon[69013]: pgmap v2229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:26.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:26 smithi096 ceph-mon[101353]: pgmap v2230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:26 smithi159 ceph-mon[69013]: pgmap v2230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:28 smithi159 ceph-mon[69013]: pgmap v2231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:36:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:36:28.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:28 smithi096 ceph-mon[101353]: pgmap v2231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:28.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:36:28.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:36:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:30 smithi159 ceph-mon[69013]: pgmap v2232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:30 smithi096 ceph-mon[101353]: pgmap v2232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:32 smithi159 ceph-mon[69013]: pgmap v2233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:32 smithi096 ceph-mon[101353]: pgmap v2233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:34 smithi159 ceph-mon[69013]: pgmap v2234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:34.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:34 smithi096 ceph-mon[101353]: pgmap v2234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:36 smithi159 ceph-mon[69013]: pgmap v2235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:36.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:36 smithi096 ceph-mon[101353]: pgmap v2235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:38.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:38 smithi159 ceph-mon[69013]: pgmap v2236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:38 smithi096 ceph-mon[101353]: pgmap v2236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:40.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 -- 172.21.15.96:0/1927722671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f6860 msgr2=0x7feb900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 --2- 172.21.15.96:0/1927722671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f6860 0x7feb900f6cc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7feb80004660 tx=0x7feb80009b30).stop 2022-02-02T19:36:40.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 -- 172.21.15.96:0/1927722671 shutdown_connections 2022-02-02T19:36:40.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 --2- 172.21.15.96:0/1927722671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f6860 0x7feb900f6cc0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 --2- 172.21.15.96:0/1927722671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f55c0 0x7feb900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 -- 172.21.15.96:0/1927722671 >> 172.21.15.96:0/1927722671 conn(0x7feb900f0d40 msgr2=0x7feb900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:40.384 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:40 smithi096 ceph-mon[101353]: pgmap v2237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 -- 172.21.15.96:0/1927722671 shutdown_connections 2022-02-02T19:36:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.376+0000 7feb97843700 1 -- 172.21.15.96:0/1927722671 wait complete. 2022-02-02T19:36:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 Processor -- start 2022-02-02T19:36:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 -- start start 2022-02-02T19:36:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f6860 0x7feb900f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900f8100 con 0x7feb900f55c0 2022-02-02T19:36:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb97843700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900f8240 con 0x7feb900f6860 2022-02-02T19:36:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb955df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb955df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60682/0 (socket says 172.21.15.96:60682) 2022-02-02T19:36:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb955df700 1 -- 172.21.15.96:0/1216623529 learned_addr learned my addr 172.21.15.96:0/1216623529 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.377+0000 7feb94dde700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f6860 0x7feb900f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb955df700 1 -- 172.21.15.96:0/1216623529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f6860 msgr2=0x7feb900f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb955df700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f6860 0x7feb900f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb955df700 1 -- 172.21.15.96:0/1216623529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80005040 con 0x7feb900f55c0 2022-02-02T19:36:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb955df700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7feb8c00c790 tx=0x7feb8c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8c013630 con 0x7feb900f55c0 2022-02-02T19:36:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb8c012860 con 0x7feb900f55c0 2022-02-02T19:36:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb900f8520 con 0x7feb900f55c0 2022-02-02T19:36:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8c002780 con 0x7feb900f55c0 2022-02-02T19:36:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.378+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9010efa0 con 0x7feb900f55c0 2022-02-02T19:36:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.379+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90045ad0 con 0x7feb900f55c0 2022-02-02T19:36:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.380+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb8c010070 con 0x7feb900f55c0 2022-02-02T19:36:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.380+0000 7feb85ffb700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 0x7feb7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.380+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feb8c081b10 con 0x7feb900f55c0 2022-02-02T19:36:40.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.380+0000 7feb94dde700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 0x7feb7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.380+0000 7feb94dde700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 0x7feb7c067290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7feb80004630 tx=0x7feb80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.384+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb8c04fc10 con 0x7feb900f55c0 2022-02-02T19:36:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:40 smithi159 ceph-mon[69013]: pgmap v2237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:40.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.564+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb900faca0 con 0x7feb7c064dd0 2022-02-02T19:36:40.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.566+0000 7feb85ffb700 1 -- 172.21.15.96:0/1216623529 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7feb900faca0 con 0x7feb7c064dd0 2022-02-02T19:36:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.567+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 msgr2=0x7feb7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.567+0000 7feb97843700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 0x7feb7c067290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7feb80004630 tx=0x7feb80009b30).stop 2022-02-02T19:36:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.567+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 msgr2=0x7feb900f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.567+0000 7feb97843700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7feb8c00c790 tx=0x7feb8c007d90).stop 2022-02-02T19:36:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 shutdown_connections 2022-02-02T19:36:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb7c064dd0 0x7feb7c067290 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb900f55c0 0x7feb900f9720 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 --2- 172.21.15.96:0/1216623529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb900f6860 0x7feb900f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 >> 172.21.15.96:0/1216623529 conn(0x7feb900f0d40 msgr2=0x7feb9005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 shutdown_connections 2022-02-02T19:36:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.568+0000 7feb97843700 1 -- 172.21.15.96:0/1216623529 wait complete. 2022-02-02T19:36:40.583 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:36:40.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 -- 172.21.15.96:0/1746696251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7980 msgr2=0x7f0a4c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 --2- 172.21.15.96:0/1746696251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c0f7de0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f0a3c004660 tx=0x7f0a3c009b30).stop 2022-02-02T19:36:40.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 -- 172.21.15.96:0/1746696251 shutdown_connections 2022-02-02T19:36:40.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 --2- 172.21.15.96:0/1746696251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c0f7de0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 --2- 172.21.15.96:0/1746696251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f66e0 0x7f0a4c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 -- 172.21.15.96:0/1746696251 >> 172.21.15.96:0/1746696251 conn(0x7f0a4c0f1e40 msgr2=0x7f0a4c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:40.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 -- 172.21.15.96:0/1746696251 shutdown_connections 2022-02-02T19:36:40.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 -- 172.21.15.96:0/1746696251 wait complete. 2022-02-02T19:36:40.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.665+0000 7f0a50db0700 1 Processor -- start 2022-02-02T19:36:40.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a50db0700 1 -- start start 2022-02-02T19:36:40.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a50db0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66e0 0x7f0a4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a50db0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a50db0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c06a380 con 0x7f0a4c0f66e0 2022-02-02T19:36:40.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a50db0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c06a4c0 con 0x7f0a4c0f7980 2022-02-02T19:36:40.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a49d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a49d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:36566/0 (socket says 172.21.15.96:36566) 2022-02-02T19:36:40.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a49d9b700 1 -- 172.21.15.96:0/2104705122 learned_addr learned my addr 172.21.15.96:0/2104705122 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:40.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.666+0000 7f0a4a59c700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66e0 0x7f0a4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a49d9b700 1 -- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66e0 msgr2=0x7f0a4c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a49d9b700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66e0 0x7f0a4c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a49d9b700 1 -- 172.21.15.96:0/2104705122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c005040 con 0x7f0a4c0f7980 2022-02-02T19:36:40.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a49d9b700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0a3c009990 tx=0x7f0a3c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3c018070 con 0x7f0a4c0f7980 2022-02-02T19:36:40.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c06a740 con 0x7f0a4c0f7980 2022-02-02T19:36:40.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a3c007ba0 con 0x7f0a4c0f7980 2022-02-02T19:36:40.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3c01c620 con 0x7f0a4c0f7980 2022-02-02T19:36:40.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.667+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c06aca0 con 0x7f0a4c0f7980 2022-02-02T19:36:40.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.668+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c045ad0 con 0x7f0a4c0f7980 2022-02-02T19:36:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.668+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a3c01c8e0 con 0x7f0a4c0f7980 2022-02-02T19:36:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.669+0000 7f0a3affd700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 0x7f0a34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.669+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a3c083890 con 0x7f0a4c0f7980 2022-02-02T19:36:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.669+0000 7f0a4a59c700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 0x7f0a34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.669+0000 7f0a4a59c700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 0x7f0a34067290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f0a4c06b730 tx=0x7f0a40009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.673+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a3c051990 con 0x7f0a4c0f7980 2022-02-02T19:36:40.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.845+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a4c0ff020 con 0x7f0a34064dd0 2022-02-02T19:36:40.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.854+0000 7f0a3affd700 1 -- 172.21.15.96:0/2104705122 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0a4c0ff020 con 0x7f0a34064dd0 2022-02-02T19:36:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:36:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (80m) 50m ago 81m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:36:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (72m) 50m ago 81m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:36:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (72m) 49m ago 80m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:36:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (79m) 50m ago 80m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:36:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (77m) 50m ago 77m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:36:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (72m) 50m ago 77m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:36:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (77m) 49m ago 77m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:36:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (73m) 49m ago 77m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:36:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (74m) 50m ago 82m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:36:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (73m) 49m ago 80m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:36:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (73m) 50m ago 82m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:36:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (73m) 49m ago 80m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:36:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (80m) 50m ago 80m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:36:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (80m) 49m ago 80m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:36:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (72m) 50m ago 79m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:36:40.864 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (71m) 50m ago 79m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:36:40.864 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (71m) 50m ago 79m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:36:40.864 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (70m) 49m ago 79m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:36:40.864 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (69m) 49m ago 78m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:36:40.865 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (69m) 49m ago 78m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:36:40.865 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (79m) 50m ago 80m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:36:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 msgr2=0x7f0a34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 0x7f0a34067290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f0a4c06b730 tx=0x7f0a40009040).stop 2022-02-02T19:36:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 msgr2=0x7f0a4c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0a3c009990 tx=0x7f0a3c009b30).stop 2022-02-02T19:36:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 shutdown_connections 2022-02-02T19:36:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a34064dd0 0x7f0a34067290 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66e0 0x7f0a4c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 --2- 172.21.15.96:0/2104705122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7980 0x7f0a4c069e20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 >> 172.21.15.96:0/2104705122 conn(0x7f0a4c0f1e40 msgr2=0x7f0a4c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 shutdown_connections 2022-02-02T19:36:40.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.856+0000 7f0a50db0700 1 -- 172.21.15.96:0/2104705122 wait complete. 2022-02-02T19:36:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 -- 172.21.15.96:0/3558935778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 msgr2=0x7f9e080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 --2- 172.21.15.96:0/3558935778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e080f6b30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f9dfc004660 tx=0x7f9dfc009b30).stop 2022-02-02T19:36:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 -- 172.21.15.96:0/3558935778 shutdown_connections 2022-02-02T19:36:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 --2- 172.21.15.96:0/3558935778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e080f6b30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 --2- 172.21.15.96:0/3558935778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 0x7f9e080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 -- 172.21.15.96:0/3558935778 >> 172.21.15.96:0/3558935778 conn(0x7f9e080f0b90 msgr2=0x7f9e080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 -- 172.21.15.96:0/3558935778 shutdown_connections 2022-02-02T19:36:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.952+0000 7f9e0d096700 1 -- 172.21.15.96:0/3558935778 wait complete. 2022-02-02T19:36:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 Processor -- start 2022-02-02T19:36:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 -- start start 2022-02-02T19:36:40.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 0x7f9e08109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080603c0 con 0x7f9e080f66d0 2022-02-02T19:36:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e0d096700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08060500 con 0x7f9e080f5430 2022-02-02T19:36:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60704/0 (socket says 172.21.15.96:60704) 2022-02-02T19:36:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.953+0000 7f9e077fe700 1 -- 172.21.15.96:0/4118624514 learned_addr learned my addr 172.21.15.96:0/4118624514 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e07fff700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 0x7f9e08109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e077fe700 1 -- 172.21.15.96:0/4118624514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 msgr2=0x7f9e08109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e077fe700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 0x7f9e08109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e077fe700 1 -- 172.21.15.96:0/4118624514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc005040 con 0x7f9e080f66d0 2022-02-02T19:36:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e077fe700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f9dfc009990 tx=0x7f9dfc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dfc018070 con 0x7f9e080f66d0 2022-02-02T19:36:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0810c490 con 0x7f9e080f66d0 2022-02-02T19:36:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0810c9c0 con 0x7f9e080f66d0 2022-02-02T19:36:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9dfc007ba0 con 0x7f9e080f66d0 2022-02-02T19:36:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.954+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dfc01dcc0 con 0x7f9e080f66d0 2022-02-02T19:36:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9dfc027440 con 0x7f9e080f66d0 2022-02-02T19:36:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08045ad0 con 0x7f9e080f66d0 2022-02-02T19:36:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e04ff9700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 0x7f9df00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9dfc0843c0 con 0x7f9e080f66d0 2022-02-02T19:36:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e07fff700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 0x7f9df00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.956+0000 7f9e07fff700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 0x7f9df00672e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f9e08060040 tx=0x7f9df800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:40.960+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9dfc052460 con 0x7f9e080f66d0 2022-02-02T19:36:41.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.192+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e080fdd00 con 0x7f9e080f66d0 2022-02-02T19:36:41.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.192+0000 7f9e04ff9700 1 -- 172.21.15.96:0/4118624514 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9dfc055a80 con 0x7f9e080f66d0 2022-02-02T19:36:41.198 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:36:41.199 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:36:41.199 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:36:41.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:41.199 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:36:41.200 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:36:41.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:41.200 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:36:41.200 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:36:41.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:41.201 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:36:41.201 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:36:41.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:36:41.201 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:36:41.202 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:36:41.202 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:36:41.202 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:36:41.202 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:36:41.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 msgr2=0x7f9df00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 0x7f9df00672e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f9e08060040 tx=0x7f9df800b040).stop 2022-02-02T19:36:41.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 msgr2=0x7f9e0810bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f9dfc009990 tx=0x7f9dfc009b30).stop 2022-02-02T19:36:41.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 shutdown_connections 2022-02-02T19:36:41.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9df0064e20 0x7f9df00672e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e080f5430 0x7f9e08109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 --2- 172.21.15.96:0/4118624514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e080f66d0 0x7f9e0810bf40 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 >> 172.21.15.96:0/4118624514 conn(0x7f9e080f0b90 msgr2=0x7f9e080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:41.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 shutdown_connections 2022-02-02T19:36:41.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.194+0000 7f9e0d096700 1 -- 172.21.15.96:0/4118624514 wait complete. 2022-02-02T19:36:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.291+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1800692494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 msgr2=0x7f9b640f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.291+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1800692494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b640f59b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f9b50004660 tx=0x7f9b50009b30).stop 2022-02-02T19:36:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.291+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1800692494 shutdown_connections 2022-02-02T19:36:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1800692494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b640f59b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1800692494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b640f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1800692494 >> 172.21.15.96:0/1800692494 conn(0x7f9b640f04c0 msgr2=0x7f9b640f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1800692494 shutdown_connections 2022-02-02T19:36:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1800692494 wait complete. 2022-02-02T19:36:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 Processor -- start 2022-02-02T19:36:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- start start 2022-02-02T19:36:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b64105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64106910 con 0x7f9b640f7590 2022-02-02T19:36:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.292+0000 7f9b6ae06700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64106a50 con 0x7f9b640f6bf0 2022-02-02T19:36:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60714/0 (socket says 172.21.15.96:60714) 2022-02-02T19:36:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 -- 172.21.15.96:0/1126512859 learned_addr learned my addr 172.21.15.96:0/1126512859 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:36:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b68ba2700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b64105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 -- 172.21.15.96:0/1126512859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 msgr2=0x7f9b64105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b64105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 -- 172.21.15.96:0/1126512859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50005040 con 0x7f9b640f7590 2022-02-02T19:36:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b68ba2700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b64105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:36:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b63fff700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f9b50009990 tx=0x7f9b50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b50018070 con 0x7f9b640f7590 2022-02-02T19:36:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b50007ca0 con 0x7f9b640f7590 2022-02-02T19:36:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5001c620 con 0x7f9b640f7590 2022-02-02T19:36:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64107390 con 0x7f9b640f7590 2022-02-02T19:36:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.293+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b641078a0 con 0x7f9b640f7590 2022-02-02T19:36:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.295+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64045ad0 con 0x7f9b640f7590 2022-02-02T19:36:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.295+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b5001d960 con 0x7f9b640f7590 2022-02-02T19:36:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.295+0000 7f9b617fa700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 0x7f9b54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:36:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.295+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b500837d0 con 0x7f9b640f7590 2022-02-02T19:36:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.295+0000 7f9b68ba2700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 0x7f9b54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:36:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.296+0000 7f9b68ba2700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 0x7f9b54067290 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f9b6405f440 tx=0x7f9b58009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:36:41.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.299+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b50055470 con 0x7f9b640f7590 2022-02-02T19:36:41.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.499+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b64107ff0 con 0x7f9b640f7590 2022-02-02T19:36:41.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.500+0000 7f9b617fa700 1 -- 172.21.15.96:0/1126512859 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9b50055060 con 0x7f9b640f7590 2022-02-02T19:36:41.506 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:36:41.507 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:36:41.507 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:36:41.507 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:36:41.507 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:41.508 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:36:41.508 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:36:41.508 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:36:41.508 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:36:41.508 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:36:41.509 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:36:41.509 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:36:41.509 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:36:41.509 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:36:41.510 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:36:41.510 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:36:41.510 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:36:41.510 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:36:41.511 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:36:41.511 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:36:41.511 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:36:41.511 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:36:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:36:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:36:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:36:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:36:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:36:41.513 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:36:41.513 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:36:41.513 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:36:41.513 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:36:41.513 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:36:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:41.514 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:36:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:36:41.515 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:41.515 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:41.515 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:36:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 msgr2=0x7f9b54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 0x7f9b54067290 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f9b6405f440 tx=0x7f9b58009040).stop 2022-02-02T19:36:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 msgr2=0x7f9b64106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:36:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f9b50009990 tx=0x7f9b50009b30).stop 2022-02-02T19:36:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 shutdown_connections 2022-02-02T19:36:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b54064dd0 0x7f9b54067290 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640f6bf0 0x7f9b64105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 --2- 172.21.15.96:0/1126512859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b640f7590 0x7f9b64106360 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:36:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 >> 172.21.15.96:0/1126512859 conn(0x7f9b640f04c0 msgr2=0x7f9b640fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:36:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 shutdown_connections 2022-02-02T19:36:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:36:41.502+0000 7f9b6ae06700 1 -- 172.21.15.96:0/1126512859 wait complete. 2022-02-02T19:36:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:36:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:42 smithi159 ceph-mon[69013]: pgmap v2238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:42 smithi159 ceph-mon[69013]: from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:42 smithi159 ceph-mon[69013]: from='client.45517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4118624514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:36:42.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1126512859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:36:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:42 smithi096 ceph-mon[101353]: pgmap v2238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:42 smithi096 ceph-mon[101353]: from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:42 smithi096 ceph-mon[101353]: from='client.45517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:36:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4118624514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:36:42.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1126512859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:36:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:44 smithi159 ceph-mon[69013]: pgmap v2239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:44 smithi096 ceph-mon[101353]: pgmap v2239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:46 smithi159 ceph-mon[69013]: pgmap v2240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:46.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:46 smithi096 ceph-mon[101353]: pgmap v2240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:48 smithi159 ceph-mon[69013]: pgmap v2241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:48 smithi096 ceph-mon[101353]: pgmap v2241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:50 smithi159 ceph-mon[69013]: pgmap v2242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:50 smithi096 ceph-mon[101353]: pgmap v2242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:52 smithi159 ceph-mon[69013]: pgmap v2243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:52 smithi096 ceph-mon[101353]: pgmap v2243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:54 smithi159 ceph-mon[69013]: pgmap v2244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:54 smithi096 ceph-mon[101353]: pgmap v2244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:56 smithi159 ceph-mon[69013]: pgmap v2245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:56 smithi096 ceph-mon[101353]: pgmap v2245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:36:58 smithi159 ceph-mon[69013]: pgmap v2246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:36:58.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:36:58 smithi096 ceph-mon[101353]: pgmap v2246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:00 smithi159 ceph-mon[69013]: pgmap v2247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:00 smithi096 ceph-mon[101353]: pgmap v2247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:02 smithi159 ceph-mon[69013]: pgmap v2248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:02 smithi096 ceph-mon[101353]: pgmap v2248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:04 smithi159 ceph-mon[69013]: pgmap v2249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:04 smithi096 ceph-mon[101353]: pgmap v2249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:06 smithi159 ceph-mon[69013]: pgmap v2250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:06 smithi096 ceph-mon[101353]: pgmap v2250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:08 smithi159 ceph-mon[69013]: pgmap v2251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:08.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:08 smithi096 ceph-mon[101353]: pgmap v2251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:10 smithi159 ceph-mon[69013]: pgmap v2252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:10 smithi096 ceph-mon[101353]: pgmap v2252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:11.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.613+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/924774921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 msgr2=0x7fcb480f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.613+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/924774921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb480f6b30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fcb38004660 tx=0x7fcb38009b30).stop 2022-02-02T19:37:11.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/924774921 shutdown_connections 2022-02-02T19:37:11.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/924774921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb480f6b30 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/924774921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 0x7fcb480f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:37:11.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/924774921 >> 172.21.15.96:0/924774921 conn(0x7fcb480f0b90 msgr2=0x7fcb480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:11.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/924774921 shutdown_connections 2022-02-02T19:37:11.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/924774921 wait complete. 2022-02-02T19:37:11.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.614+0000 7fcb4d5cd700 1 Processor -- start 2022-02-02T19:37:11.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb4d5cd700 1 -- start start 2022-02-02T19:37:11.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb4d5cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 0x7fcb48109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb4d5cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb4d5cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48060470 con 0x7fcb480f66d0 2022-02-02T19:37:11.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb4d5cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480605b0 con 0x7fcb480f5430 2022-02-02T19:37:11.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60734/0 (socket says 172.21.15.96:60734) 2022-02-02T19:37:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 -- 172.21.15.96:0/3449845448 learned_addr learned my addr 172.21.15.96:0/3449845448 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb47fff700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 0x7fcb48109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 -- 172.21.15.96:0/3449845448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 msgr2=0x7fcb48109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 0x7fcb48109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.615+0000 7fcb477fe700 1 -- 172.21.15.96:0/3449845448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38005040 con 0x7fcb480f66d0 2022-02-02T19:37:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb477fe700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fcb38009990 tx=0x7fcb38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38018070 con 0x7fcb480f66d0 2022-02-02T19:37:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb38007ba0 con 0x7fcb480f66d0 2022-02-02T19:37:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3801c620 con 0x7fcb480f66d0 2022-02-02T19:37:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4810c590 con 0x7fcb480f66d0 2022-02-02T19:37:11.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.616+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4810ca70 con 0x7fcb480f66d0 2022-02-02T19:37:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.617+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb48045ad0 con 0x7fcb480f66d0 2022-02-02T19:37:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.617+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb3801d420 con 0x7fcb480f66d0 2022-02-02T19:37:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.618+0000 7fcb44ff9700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 0x7fcb300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.618+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb38083880 con 0x7fcb480f66d0 2022-02-02T19:37:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.618+0000 7fcb47fff700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 0x7fcb300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.618+0000 7fcb47fff700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 0x7fcb300672e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fcb48060060 tx=0x7fcb3c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.622+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb38051a40 con 0x7fcb480f66d0 2022-02-02T19:37:11.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.800+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb480fde00 con 0x7fcb30064e20 2022-02-02T19:37:11.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.801+0000 7fcb44ff9700 1 -- 172.21.15.96:0/3449845448 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcb480fde00 con 0x7fcb30064e20 2022-02-02T19:37:11.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 msgr2=0x7fcb300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 0x7fcb300672e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fcb48060060 tx=0x7fcb3c008040).stop 2022-02-02T19:37:11.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 msgr2=0x7fcb4810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fcb38009990 tx=0x7fcb38009b30).stop 2022-02-02T19:37:11.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 shutdown_connections 2022-02-02T19:37:11.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb30064e20 0x7fcb300672e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f5430 0x7fcb48109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 --2- 172.21.15.96:0/3449845448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f66d0 0x7fcb4810bf90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.803+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 >> 172.21.15.96:0/3449845448 conn(0x7fcb480f0b90 msgr2=0x7fcb480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:11.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.804+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 shutdown_connections 2022-02-02T19:37:11.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.804+0000 7fcb4d5cd700 1 -- 172.21.15.96:0/3449845448 wait complete. 2022-02-02T19:37:11.818 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:37:11.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 -- 172.21.15.96:0/524647290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 msgr2=0x7ff57c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 --2- 172.21.15.96:0/524647290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c0f6cc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7ff56c004660 tx=0x7ff56c009b30).stop 2022-02-02T19:37:11.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 -- 172.21.15.96:0/524647290 shutdown_connections 2022-02-02T19:37:11.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 --2- 172.21.15.96:0/524647290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c0f6cc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 --2- 172.21.15.96:0/524647290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 0x7ff57c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 -- 172.21.15.96:0/524647290 >> 172.21.15.96:0/524647290 conn(0x7ff57c0f0d40 msgr2=0x7ff57c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:11.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 -- 172.21.15.96:0/524647290 shutdown_connections 2022-02-02T19:37:11.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.900+0000 7ff581cce700 1 -- 172.21.15.96:0/524647290 wait complete. 2022-02-02T19:37:11.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 Processor -- start 2022-02-02T19:37:11.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 -- start start 2022-02-02T19:37:11.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 0x7ff57c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0603c0 con 0x7ff57c0f6860 2022-02-02T19:37:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.901+0000 7ff581cce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c060500 con 0x7ff57c0f55c0 2022-02-02T19:37:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60744/0 (socket says 172.21.15.96:60744) 2022-02-02T19:37:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 -- 172.21.15.96:0/2288292222 learned_addr learned my addr 172.21.15.96:0/2288292222 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57b7fe700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 0x7ff57c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 -- 172.21.15.96:0/2288292222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 msgr2=0x7ff57c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 0x7ff57c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 -- 172.21.15.96:0/2288292222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c005040 con 0x7ff57c0f6860 2022-02-02T19:37:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff57affd700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7ff56c009990 tx=0x7ff56c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56c018070 con 0x7ff57c0f6860 2022-02-02T19:37:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff56c007ba0 con 0x7ff57c0f6860 2022-02-02T19:37:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c10c6c0 con 0x7ff57c0f6860 2022-02-02T19:37:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56c01c3c0 con 0x7ff57c0f6860 2022-02-02T19:37:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.902+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c10cbf0 con 0x7ff57c0f6860 2022-02-02T19:37:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.903+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c0f49b0 con 0x7ff57c0f6860 2022-02-02T19:37:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.904+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff56c01d420 con 0x7ff57c0f6860 2022-02-02T19:37:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.904+0000 7ff563fff700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 0x7ff564067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.904+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff56c083720 con 0x7ff57c0f6860 2022-02-02T19:37:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.904+0000 7ff57b7fe700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 0x7ff564067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.904+0000 7ff57b7fe700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 0x7ff564067290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff57c060040 tx=0x7ff570009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:11.908+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff56c051880 con 0x7ff57c0f6860 2022-02-02T19:37:12.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.080+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff57c0fdf00 con 0x7ff564064dd0 2022-02-02T19:37:12.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.090+0000 7ff563fff700 1 -- 172.21.15.96:0/2288292222 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff57c0fdf00 con 0x7ff564064dd0 2022-02-02T19:37:12.094 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:37:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (80m) 51m ago 81m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:37:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (73m) 51m ago 81m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:37:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (72m) 49m ago 81m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:37:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (80m) 51m ago 81m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:37:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (77m) 51m ago 77m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:37:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (73m) 51m ago 77m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:37:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (77m) 49m ago 77m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:37:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (73m) 49m ago 77m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:37:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (74m) 51m ago 82m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:37:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (74m) 49m ago 81m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:37:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (73m) 51m ago 82m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:37:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (73m) 49m ago 81m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:37:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (81m) 51m ago 81m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:37:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (80m) 49m ago 80m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:37:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (72m) 51m ago 80m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:37:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (72m) 51m ago 80m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:37:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (71m) 51m ago 79m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:37:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (70m) 49m ago 79m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:37:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (70m) 49m ago 79m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:37:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (69m) 49m ago 78m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:37:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (80m) 51m ago 81m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:37:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 msgr2=0x7ff564067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 0x7ff564067290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff57c060040 tx=0x7ff570009c00).stop 2022-02-02T19:37:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 msgr2=0x7ff57c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7ff56c009990 tx=0x7ff56c009b30).stop 2022-02-02T19:37:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 shutdown_connections 2022-02-02T19:37:12.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff564064dd0 0x7ff564067290 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff57c0f55c0 0x7ff57c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 --2- 172.21.15.96:0/2288292222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff57c0f6860 0x7ff57c10c170 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 >> 172.21.15.96:0/2288292222 conn(0x7ff57c0f0d40 msgr2=0x7ff57c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 shutdown_connections 2022-02-02T19:37:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.092+0000 7ff581cce700 1 -- 172.21.15.96:0/2288292222 wait complete. 2022-02-02T19:37:12.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 -- 172.21.15.96:0/3885542152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 msgr2=0x7fada00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 --2- 172.21.15.96:0/3885542152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada00f7de0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fad90004660 tx=0x7fad90009b30).stop 2022-02-02T19:37:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 -- 172.21.15.96:0/3885542152 shutdown_connections 2022-02-02T19:37:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 --2- 172.21.15.96:0/3885542152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada00f7de0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 --2- 172.21.15.96:0/3885542152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.189+0000 7fada79b5700 1 -- 172.21.15.96:0/3885542152 >> 172.21.15.96:0/3885542152 conn(0x7fada00f1e40 msgr2=0x7fada00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:12.196 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:12 smithi096 ceph-mon[101353]: pgmap v2253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:12.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.190+0000 7fada79b5700 1 -- 172.21.15.96:0/3885542152 shutdown_connections 2022-02-02T19:37:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.190+0000 7fada79b5700 1 -- 172.21.15.96:0/3885542152 wait complete. 2022-02-02T19:37:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.190+0000 7fada79b5700 1 Processor -- start 2022-02-02T19:37:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.190+0000 7fada79b5700 1 -- start start 2022-02-02T19:37:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.190+0000 7fada79b5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada79b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada79b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0107a00 con 0x7fada00f7980 2022-02-02T19:37:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada79b5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0107b40 con 0x7fada00f66e0 2022-02-02T19:37:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60754/0 (socket says 172.21.15.96:60754) 2022-02-02T19:37:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 -- 172.21.15.96:0/853682309 learned_addr learned my addr 172.21.15.96:0/853682309 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada5751700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 -- 172.21.15.96:0/853682309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 msgr2=0x7fada0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 -- 172.21.15.96:0/853682309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90005040 con 0x7fada00f7980 2022-02-02T19:37:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada5751700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:37:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada4f50700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fad90009990 tx=0x7fad90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90018070 con 0x7fada00f7980 2022-02-02T19:37:12.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada0108480 con 0x7fada00f7980 2022-02-02T19:37:12.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad90007ba0 con 0x7fada00f7980 2022-02-02T19:37:12.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.191+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad9001c3c0 con 0x7fada00f7980 2022-02-02T19:37:12.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.192+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada01089e0 con 0x7fada00f7980 2022-02-02T19:37:12.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.193+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0045ad0 con 0x7fada00f7980 2022-02-02T19:37:12.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.193+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad9001d420 con 0x7fada00f7980 2022-02-02T19:37:12.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.193+0000 7fad95ffb700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.193+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fad90083760 con 0x7fada00f7980 2022-02-02T19:37:12.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.193+0000 7fada5751700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.194+0000 7fada5751700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fada00f77e0 tx=0x7fad9c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:12.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.198+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad90055230 con 0x7fada00f7980 2022-02-02T19:37:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.428+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fada0027a00 con 0x7fada00f7980 2022-02-02T19:37:12.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.429+0000 7fad95ffb700 1 -- 172.21.15.96:0/853682309 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fad90054e20 con 0x7fada00f7980 2022-02-02T19:37:12.434 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:37:12.434 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:37:12.434 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:37:12.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:12.435 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:37:12.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:37:12.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:12.435 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:37:12.436 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:37:12.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:12.436 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:37:12.436 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:37:12.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:12.437 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:37:12.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:37:12.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:37:12.437 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:37:12.438 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:37:12.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 msgr2=0x7fad8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fada00f77e0 tx=0x7fad9c009c00).stop 2022-02-02T19:37:12.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 msgr2=0x7fada0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fad90009990 tx=0x7fad90009b30).stop 2022-02-02T19:37:12.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 shutdown_connections 2022-02-02T19:37:12.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 --2- 172.21.15.96:0/853682309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.430+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 >> 172.21.15.96:0/853682309 conn(0x7fada00f1e40 msgr2=0x7fada00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:12.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.431+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 shutdown_connections 2022-02-02T19:37:12.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.431+0000 7fada79b5700 1 -- 172.21.15.96:0/853682309 wait complete. 2022-02-02T19:37:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:12 smithi159 ceph-mon[69013]: pgmap v2253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:12.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 -- 172.21.15.96:0/4292865254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 msgr2=0x7ff7180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 --2- 172.21.15.96:0/4292865254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff7180f6cc0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7ff714004660 tx=0x7ff714009b30).stop 2022-02-02T19:37:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 -- 172.21.15.96:0/4292865254 shutdown_connections 2022-02-02T19:37:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 --2- 172.21.15.96:0/4292865254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff7180f6cc0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 --2- 172.21.15.96:0/4292865254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 0x7ff7180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 -- 172.21.15.96:0/4292865254 >> 172.21.15.96:0/4292865254 conn(0x7ff7180f0d40 msgr2=0x7ff7180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:12.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 -- 172.21.15.96:0/4292865254 shutdown_connections 2022-02-02T19:37:12.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.530+0000 7ff720742700 1 -- 172.21.15.96:0/4292865254 wait complete. 2022-02-02T19:37:12.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 Processor -- start 2022-02-02T19:37:12.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 -- start start 2022-02-02T19:37:12.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 0x7ff718109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180603c0 con 0x7ff7180f6860 2022-02-02T19:37:12.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff720742700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff718060500 con 0x7ff7180f55c0 2022-02-02T19:37:12.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff71dcdd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff71dcdd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60764/0 (socket says 172.21.15.96:60764) 2022-02-02T19:37:12.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff71dcdd700 1 -- 172.21.15.96:0/2353278107 learned_addr learned my addr 172.21.15.96:0/2353278107 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:12.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff71e4de700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 0x7ff718109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.531+0000 7ff71dcdd700 1 -- 172.21.15.96:0/2353278107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 msgr2=0x7ff718109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff71dcdd700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 0x7ff718109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff71dcdd700 1 -- 172.21.15.96:0/2353278107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714005040 con 0x7ff7180f6860 2022-02-02T19:37:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff71dcdd700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7ff714009990 tx=0x7ff714009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff714018070 con 0x7ff7180f6860 2022-02-02T19:37:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71810c6c0 con 0x7ff7180f6860 2022-02-02T19:37:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff714007ba0 con 0x7ff7180f6860 2022-02-02T19:37:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff71401c3c0 con 0x7ff7180f6860 2022-02-02T19:37:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.532+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71810cbf0 con 0x7ff7180f6860 2022-02-02T19:37:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.533+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7180f49b0 con 0x7ff7180f6860 2022-02-02T19:37:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.533+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff71401d420 con 0x7ff7180f6860 2022-02-02T19:37:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.534+0000 7ff70effd700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 0x7ff704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.534+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff7140836a0 con 0x7ff7180f6860 2022-02-02T19:37:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.534+0000 7ff71e4de700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 0x7ff704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.534+0000 7ff71e4de700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 0x7ff704067290 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff718060040 tx=0x7ff70800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:12.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.538+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff714051860 con 0x7ff7180f6860 2022-02-02T19:37:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.739+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff718045ad0 con 0x7ff7180f6860 2022-02-02T19:37:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.740+0000 7ff70effd700 1 -- 172.21.15.96:0/2353278107 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff714054e80 con 0x7ff7180f6860 2022-02-02T19:37:12.745 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:37:12.745 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:37:12.745 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:37:12.746 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:37:12.746 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:12.746 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:37:12.746 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:37:12.746 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:37:12.747 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:37:12.747 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:37:12.747 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:37:12.747 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:37:12.748 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:37:12.748 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:37:12.748 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:37:12.748 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:37:12.748 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:37:12.749 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:37:12.749 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:37:12.749 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:37:12.749 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:37:12.750 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:37:12.750 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:37:12.750 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:37:12.750 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:37:12.750 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:37:12.751 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:37:12.751 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:37:12.751 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:37:12.751 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:37:12.752 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:37:12.752 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:37:12.752 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:12.752 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:12.753 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:37:12.753 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:12.753 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:12.753 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:12.753 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 msgr2=0x7ff704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 0x7ff704067290 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff718060040 tx=0x7ff70800b040).stop 2022-02-02T19:37:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 msgr2=0x7ff71810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7ff714009990 tx=0x7ff714009b30).stop 2022-02-02T19:37:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 shutdown_connections 2022-02-02T19:37:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff704064dd0 0x7ff704067290 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7180f55c0 0x7ff718109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 --2- 172.21.15.96:0/2353278107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180f6860 0x7ff71810c170 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 >> 172.21.15.96:0/2353278107 conn(0x7ff7180f0d40 msgr2=0x7ff7180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 shutdown_connections 2022-02-02T19:37:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:12.742+0000 7ff720742700 1 -- 172.21.15.96:0/2353278107 wait complete. 2022-02-02T19:37:12.757 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:37:13.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:13 smithi159 ceph-mon[69013]: from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:13.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:13 smithi159 ceph-mon[69013]: from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:13.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/853682309' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:37:13.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2353278107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:37:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:13 smithi096 ceph-mon[101353]: from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:13.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:13 smithi096 ceph-mon[101353]: from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:13.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/853682309' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:37:13.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2353278107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:37:14.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:14 smithi159 ceph-mon[69013]: pgmap v2254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:14.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:14 smithi096 ceph-mon[101353]: pgmap v2254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:16 smithi159 ceph-mon[69013]: pgmap v2255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:16 smithi096 ceph-mon[101353]: pgmap v2255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:17.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:17 smithi159 ceph-mon[69013]: pgmap v2256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:17.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:17 smithi096 ceph-mon[101353]: pgmap v2256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:19.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:19 smithi159 ceph-mon[69013]: pgmap v2257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:19.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:19 smithi096 ceph-mon[101353]: pgmap v2257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:22.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:22 smithi096 ceph-mon[101353]: pgmap v2258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:22 smithi159 ceph-mon[69013]: pgmap v2258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:24 smithi159 ceph-mon[69013]: pgmap v2259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:24 smithi096 ceph-mon[101353]: pgmap v2259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:26 smithi159 ceph-mon[69013]: pgmap v2260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:26.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:26 smithi096 ceph-mon[101353]: pgmap v2260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:28 smithi159 ceph-mon[69013]: pgmap v2261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:37:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:37:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:28 smithi096 ceph-mon[101353]: pgmap v2261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:37:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:37:30.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:30 smithi159 ceph-mon[69013]: pgmap v2262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:30 smithi096 ceph-mon[101353]: pgmap v2262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:32 smithi159 ceph-mon[69013]: pgmap v2263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:32 smithi096 ceph-mon[101353]: pgmap v2263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:34 smithi159 ceph-mon[69013]: pgmap v2264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:34.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:34 smithi096 ceph-mon[101353]: pgmap v2264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:36 smithi159 ceph-mon[69013]: pgmap v2265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:36 smithi096 ceph-mon[101353]: pgmap v2265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:38.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:38 smithi159 ceph-mon[69013]: pgmap v2266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:38 smithi096 ceph-mon[101353]: pgmap v2266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:40 smithi159 ceph-mon[69013]: pgmap v2267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:40 smithi096 ceph-mon[101353]: pgmap v2267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:42 smithi159 ceph-mon[69013]: pgmap v2268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:42 smithi096 ceph-mon[101353]: pgmap v2268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 -- 172.21.15.96:0/867419137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 msgr2=0x7f15240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 --2- 172.21.15.96:0/867419137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f15240f6cc0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f1514004660 tx=0x7f1514009b30).stop 2022-02-02T19:37:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 -- 172.21.15.96:0/867419137 shutdown_connections 2022-02-02T19:37:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 --2- 172.21.15.96:0/867419137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f15240f6cc0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 --2- 172.21.15.96:0/867419137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 0x7f15240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 -- 172.21.15.96:0/867419137 >> 172.21.15.96:0/867419137 conn(0x7f15240f0d40 msgr2=0x7f15240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 -- 172.21.15.96:0/867419137 shutdown_connections 2022-02-02T19:37:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.853+0000 7f1529a2f700 1 -- 172.21.15.96:0/867419137 wait complete. 2022-02-02T19:37:42.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.854+0000 7f1529a2f700 1 Processor -- start 2022-02-02T19:37:42.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.854+0000 7f1529a2f700 1 -- start start 2022-02-02T19:37:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f1529a2f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 0x7f1524109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f1529a2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f1529a2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240603e0 con 0x7f15240f6860 2022-02-02T19:37:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f1529a2f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524060520 con 0x7f15240f55c0 2022-02-02T19:37:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60782/0 (socket says 172.21.15.96:60782) 2022-02-02T19:37:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 -- 172.21.15.96:0/4203464597 learned_addr learned my addr 172.21.15.96:0/4203464597 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f1522ffd700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 0x7f1524109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 -- 172.21.15.96:0/4203464597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 msgr2=0x7f1524109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 0x7f1524109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 -- 172.21.15.96:0/4203464597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514005040 con 0x7f15240f6860 2022-02-02T19:37:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f15227fc700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f1514009830 tx=0x7f1514009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.855+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1514018070 con 0x7f15240f6860 2022-02-02T19:37:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.856+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1514007ba0 con 0x7f15240f6860 2022-02-02T19:37:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.856+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f151401c3c0 con 0x7f15240f6860 2022-02-02T19:37:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.856+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152410c6a0 con 0x7f15240f6860 2022-02-02T19:37:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.856+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152410cc00 con 0x7f15240f6860 2022-02-02T19:37:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.857+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1524045ad0 con 0x7f15240f6860 2022-02-02T19:37:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.857+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1514007d10 con 0x7f15240f6860 2022-02-02T19:37:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.857+0000 7f150b7fe700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 0x7f150c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.857+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1514083620 con 0x7f15240f6860 2022-02-02T19:37:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.857+0000 7f1522ffd700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 0x7f150c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.858+0000 7f1522ffd700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 0x7f150c067270 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f1524060060 tx=0x7f151800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:42.862+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f15140517e0 con 0x7f15240f6860 2022-02-02T19:37:43.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.039+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1524057f10 con 0x7f150c064db0 2022-02-02T19:37:43.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.040+0000 7f150b7fe700 1 -- 172.21.15.96:0/4203464597 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1524057f10 con 0x7f150c064db0 2022-02-02T19:37:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 msgr2=0x7f150c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 0x7f150c067270 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f1524060060 tx=0x7f151800b040).stop 2022-02-02T19:37:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 msgr2=0x7f152410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f1514009830 tx=0x7f1514009b30).stop 2022-02-02T19:37:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 shutdown_connections 2022-02-02T19:37:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f150c064db0 0x7f150c067270 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15240f55c0 0x7f1524109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 --2- 172.21.15.96:0/4203464597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15240f6860 0x7f152410c150 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 >> 172.21.15.96:0/4203464597 conn(0x7f15240f0d40 msgr2=0x7f15240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 shutdown_connections 2022-02-02T19:37:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.042+0000 7f1529a2f700 1 -- 172.21.15.96:0/4203464597 wait complete. 2022-02-02T19:37:43.056 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:37:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3819286960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 msgr2=0x7fc6780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3819286960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc6780f6cc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fc674004660 tx=0x7fc674009b30).stop 2022-02-02T19:37:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3819286960 shutdown_connections 2022-02-02T19:37:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3819286960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc6780f6cc0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3819286960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 0x7fc6780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:37:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3819286960 >> 172.21.15.96:0/3819286960 conn(0x7fc6780f0d40 msgr2=0x7fc6780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3819286960 shutdown_connections 2022-02-02T19:37:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3819286960 wait complete. 2022-02-02T19:37:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 Processor -- start 2022-02-02T19:37:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.141+0000 7fc67f8a7700 1 -- start start 2022-02-02T19:37:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67f8a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 0x7fc67810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67f8a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67f8a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780602b0 con 0x7fc6780f6860 2022-02-02T19:37:43.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67f8a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780603f0 con 0x7fc6780f55c0 2022-02-02T19:37:43.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60792/0 (socket says 172.21.15.96:60792) 2022-02-02T19:37:43.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 -- 172.21.15.96:0/3504712973 learned_addr learned my addr 172.21.15.96:0/3504712973 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:43.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67d643700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 0x7fc67810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 -- 172.21.15.96:0/3504712973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 msgr2=0x7fc67810c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 0x7fc67810c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 -- 172.21.15.96:0/3504712973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674005040 con 0x7fc6780f6860 2022-02-02T19:37:43.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc67ce42700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fc674009990 tx=0x7fc674009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.142+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc674018070 con 0x7fc6780f6860 2022-02-02T19:37:43.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.143+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc674007ca0 con 0x7fc6780f6860 2022-02-02T19:37:43.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.143+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67810eac0 con 0x7fc6780f6860 2022-02-02T19:37:43.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.143+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67401c620 con 0x7fc6780f6860 2022-02-02T19:37:43.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.143+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67810eee0 con 0x7fc6780f6860 2022-02-02T19:37:43.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.144+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc678045ad0 con 0x7fc6780f6860 2022-02-02T19:37:43.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.144+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc67401d960 con 0x7fc6780f6860 2022-02-02T19:37:43.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.144+0000 7fc66dffb700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 0x7fc664067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.145+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc6740837d0 con 0x7fc6780f6860 2022-02-02T19:37:43.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.145+0000 7fc67d643700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 0x7fc664067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.145+0000 7fc67d643700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 0x7fc664067290 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fc678060040 tx=0x7fc668008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.149+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc674051a40 con 0x7fc6780f6860 2022-02-02T19:37:43.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.325+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6780fdf00 con 0x7fc664064dd0 2022-02-02T19:37:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.335+0000 7fc66dffb700 1 -- 172.21.15.96:0/3504712973 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc6780fdf00 con 0x7fc664064dd0 2022-02-02T19:37:43.339 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:37:43.339 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (81m) 51m ago 82m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:37:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (73m) 51m ago 82m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:37:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (73m) 50m ago 81m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:37:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (80m) 51m ago 81m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:37:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (78m) 51m ago 78m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:37:43.341 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (73m) 51m ago 78m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:37:43.341 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (78m) 50m ago 78m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:37:43.341 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (74m) 50m ago 78m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:37:43.341 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (75m) 51m ago 83m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:37:43.342 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (74m) 50m ago 81m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:37:43.342 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (74m) 51m ago 83m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:37:43.342 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (74m) 50m ago 81m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:37:43.342 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (81m) 51m ago 81m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:37:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (81m) 50m ago 81m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:37:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (73m) 51m ago 81m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:37:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (72m) 51m ago 80m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:37:43.343 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (72m) 51m ago 80m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:37:43.344 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (71m) 50m ago 80m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:37:43.344 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (71m) 50m ago 79m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:37:43.344 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (70m) 50m ago 79m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:37:43.344 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (80m) 51m ago 81m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:37:43.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.336+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 msgr2=0x7fc664067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 0x7fc664067290 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fc678060040 tx=0x7fc668008040).stop 2022-02-02T19:37:43.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 msgr2=0x7fc67810e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fc674009990 tx=0x7fc674009b30).stop 2022-02-02T19:37:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 shutdown_connections 2022-02-02T19:37:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc664064dd0 0x7fc664067290 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6780f55c0 0x7fc67810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 --2- 172.21.15.96:0/3504712973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6780f6860 0x7fc67810e5d0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 >> 172.21.15.96:0/3504712973 conn(0x7fc6780f0d40 msgr2=0x7fc6780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 shutdown_connections 2022-02-02T19:37:43.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.337+0000 7fc67f8a7700 1 -- 172.21.15.96:0/3504712973 wait complete. 2022-02-02T19:37:43.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 -- 172.21.15.96:0/4253451264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 msgr2=0x7f58280f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 --2- 172.21.15.96:0/4253451264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f58280f59e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f5818004660 tx=0x7f5818009b30).stop 2022-02-02T19:37:43.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 -- 172.21.15.96:0/4253451264 shutdown_connections 2022-02-02T19:37:43.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 --2- 172.21.15.96:0/4253451264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 0x7f58280f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 --2- 172.21.15.96:0/4253451264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f58280f59e0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.433+0000 7f582e158700 1 -- 172.21.15.96:0/4253451264 >> 172.21.15.96:0/4253451264 conn(0x7f58280f0d40 msgr2=0x7f58280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.434+0000 7f582e158700 1 -- 172.21.15.96:0/4253451264 shutdown_connections 2022-02-02T19:37:43.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.434+0000 7f582e158700 1 -- 172.21.15.96:0/4253451264 wait complete. 2022-02-02T19:37:43.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.434+0000 7f582e158700 1 Processor -- start 2022-02-02T19:37:43.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f582e158700 1 -- start start 2022-02-02T19:37:43.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f582e158700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f582e158700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 0x7f5828107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f582e158700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828107a10 con 0x7f58280f55c0 2022-02-02T19:37:43.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f582e158700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828107b50 con 0x7f58280f6860 2022-02-02T19:37:43.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60800/0 (socket says 172.21.15.96:60800) 2022-02-02T19:37:43.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 -- 172.21.15.96:0/1472972311 learned_addr learned my addr 172.21.15.96:0/1472972311 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:43.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f5826ffd700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 0x7f5828107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 -- 172.21.15.96:0/1472972311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 msgr2=0x7f5828107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 0x7f5828107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 -- 172.21.15.96:0/1472972311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818005040 con 0x7f58280f55c0 2022-02-02T19:37:43.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.435+0000 7f58277fe700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f5818013a70 tx=0x7f5818009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.436+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5818018070 con 0x7f58280f55c0 2022-02-02T19:37:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.436+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5828108490 con 0x7f58280f55c0 2022-02-02T19:37:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.436+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f58180097d0 con 0x7f58280f55c0 2022-02-02T19:37:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.436+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581801de80 con 0x7f58280f55c0 2022-02-02T19:37:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.436+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58281089f0 con 0x7f58280f55c0 2022-02-02T19:37:43.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.437+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5808004fa0 con 0x7f58280f55c0 2022-02-02T19:37:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.437+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5818007ba0 con 0x7f58280f55c0 2022-02-02T19:37:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.438+0000 7f580ffff700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 0x7f5810067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.438+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5818083620 con 0x7f58280f55c0 2022-02-02T19:37:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.438+0000 7f5826ffd700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 0x7f5810067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.438+0000 7f5826ffd700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 0x7f5810067290 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f581c004c40 tx=0x7f581c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.442+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5818055210 con 0x7f58280f55c0 2022-02-02T19:37:43.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.672+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5808005e80 con 0x7f58280f55c0 2022-02-02T19:37:43.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.673+0000 7f580ffff700 1 -- 172.21.15.96:0/1472972311 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5818054e00 con 0x7f58280f55c0 2022-02-02T19:37:43.678 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:37:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:37:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:37:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:37:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:37:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:37:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:37:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:37:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:37:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:37:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:37:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:37:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:37:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:37:43.681 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:37:43.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 msgr2=0x7f5810067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 0x7f5810067290 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f581c004c40 tx=0x7f581c00b040).stop 2022-02-02T19:37:43.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 msgr2=0x7f5828106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f5818013a70 tx=0x7f5818009b30).stop 2022-02-02T19:37:43.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 shutdown_connections 2022-02-02T19:37:43.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5810064dd0 0x7f5810067290 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58280f55c0 0x7f5828106f70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 --2- 172.21.15.96:0/1472972311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58280f6860 0x7f5828107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.674+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 >> 172.21.15.96:0/1472972311 conn(0x7f58280f0d40 msgr2=0x7f582805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.675+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 shutdown_connections 2022-02-02T19:37:43.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.675+0000 7f582e158700 1 -- 172.21.15.96:0/1472972311 wait complete. 2022-02-02T19:37:43.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 -- 172.21.15.96:0/159023935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f5430 msgr2=0x7f05e80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 --2- 172.21.15.96:0/159023935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f5430 0x7f05e80f5850 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f05e4004660 tx=0x7f05e4009b30).stop 2022-02-02T19:37:43.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 -- 172.21.15.96:0/159023935 shutdown_connections 2022-02-02T19:37:43.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 --2- 172.21.15.96:0/159023935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f66d0 0x7f05e80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 --2- 172.21.15.96:0/159023935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f5430 0x7f05e80f5850 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.771+0000 7f05ee63c700 1 -- 172.21.15.96:0/159023935 >> 172.21.15.96:0/159023935 conn(0x7f05e80f0b90 msgr2=0x7f05e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 -- 172.21.15.96:0/159023935 shutdown_connections 2022-02-02T19:37:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 -- 172.21.15.96:0/159023935 wait complete. 2022-02-02T19:37:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 Processor -- start 2022-02-02T19:37:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 -- start start 2022-02-02T19:37:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f5430 0x7f05e8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8107900 con 0x7f05e80f66d0 2022-02-02T19:37:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.772+0000 7f05ee63c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8108110 con 0x7f05e80f5430 2022-02-02T19:37:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60812/0 (socket says 172.21.15.96:60812) 2022-02-02T19:37:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 -- 172.21.15.96:0/1808071980 learned_addr learned my addr 172.21.15.96:0/1808071980 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:37:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ed63a700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f5430 0x7f05e8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 -- 172.21.15.96:0/1808071980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f5430 msgr2=0x7f05e8106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f5430 0x7f05e8106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 -- 172.21.15.96:0/1808071980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4005040 con 0x7f05e80f66d0 2022-02-02T19:37:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ece39700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f05d80026d0 tx=0x7f05d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d80079c0 con 0x7f05e80f66d0 2022-02-02T19:37:43.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8108390 con 0x7f05e80f66d0 2022-02-02T19:37:43.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f05d800f040 con 0x7f05e80f66d0 2022-02-02T19:37:43.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d80148b0 con 0x7f05e80f66d0 2022-02-02T19:37:43.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.773+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e8108950 con 0x7f05e80f66d0 2022-02-02T19:37:43.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.774+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e8059100 con 0x7f05e80f66d0 2022-02-02T19:37:43.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.775+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f05d8007b20 con 0x7f05e80f66d0 2022-02-02T19:37:43.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.776+0000 7f05ddffb700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 0x7f05d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:37:43.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.776+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f05d8081df0 con 0x7f05e80f66d0 2022-02-02T19:37:43.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.776+0000 7f05ed63a700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 0x7f05d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:37:43.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.776+0000 7f05ed63a700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 0x7f05d40672e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f05e4013690 tx=0x7f05e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:37:43.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.780+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f05d804fef0 con 0x7f05e80f66d0 2022-02-02T19:37:43.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.982+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f05e810d350 con 0x7f05e80f66d0 2022-02-02T19:37:43.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.982+0000 7f05ddffb700 1 -- 172.21.15.96:0/1808071980 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f05d8053510 con 0x7f05e80f66d0 2022-02-02T19:37:43.989 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:37:43.989 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:37:43.990 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:37:43.990 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:37:43.990 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:43.990 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:37:43.991 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:37:43.991 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:37:43.991 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:37:43.991 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:37:43.992 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:37:43.992 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:37:43.992 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:37:43.993 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:37:43.993 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:37:43.993 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:37:43.994 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:37:43.994 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:37:43.994 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:37:43.994 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:37:43.995 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:37:43.995 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:37:43.995 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:37:43.995 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:37:43.995 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:37:43.996 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:37:43.996 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:37:43.996 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:37:43.996 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:37:43.997 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:37:43.997 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:37:43.997 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:37:43.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:43.998 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:43.998 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:37:43.998 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:37:43.998 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:43.999 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:43.999 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:37:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 msgr2=0x7f05d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 0x7f05d40672e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f05e4013690 tx=0x7f05e4009b30).stop 2022-02-02T19:37:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 msgr2=0x7f05e8107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:37:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f05d80026d0 tx=0x7f05d8009de0).stop 2022-02-02T19:37:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 shutdown_connections 2022-02-02T19:37:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05d4064e20 0x7f05d40672e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e80f5430 0x7f05e8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 --2- 172.21.15.96:0/1808071980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e80f66d0 0x7f05e8107300 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:37:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 >> 172.21.15.96:0/1808071980 conn(0x7f05e80f0b90 msgr2=0x7f05e805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:37:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 shutdown_connections 2022-02-02T19:37:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:37:43.984+0000 7f05ee63c700 1 -- 172.21.15.96:0/1808071980 wait complete. 2022-02-02T19:37:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:37:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:44 smithi159 ceph-mon[69013]: pgmap v2269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:44 smithi159 ceph-mon[69013]: from='client.36440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1472972311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:37:44.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1808071980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:37:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:44 smithi096 ceph-mon[101353]: pgmap v2269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:44 smithi096 ceph-mon[101353]: from='client.36440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:44.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1472972311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:37:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1808071980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:37:45.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:45 smithi159 ceph-mon[69013]: from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:45.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:45 smithi096 ceph-mon[101353]: from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:37:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:46 smithi159 ceph-mon[69013]: pgmap v2270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:46.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:46 smithi096 ceph-mon[101353]: pgmap v2270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:48 smithi159 ceph-mon[69013]: pgmap v2271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:48 smithi096 ceph-mon[101353]: pgmap v2271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:50 smithi159 ceph-mon[69013]: pgmap v2272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:50 smithi096 ceph-mon[101353]: pgmap v2272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:52 smithi159 ceph-mon[69013]: pgmap v2273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:52 smithi096 ceph-mon[101353]: pgmap v2273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:54 smithi159 ceph-mon[69013]: pgmap v2274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:54 smithi096 ceph-mon[101353]: pgmap v2274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:56 smithi159 ceph-mon[69013]: pgmap v2275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:56 smithi096 ceph-mon[101353]: pgmap v2275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:37:58 smithi159 ceph-mon[69013]: pgmap v2276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:37:58.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:37:58 smithi096 ceph-mon[101353]: pgmap v2276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:00 smithi159 ceph-mon[69013]: pgmap v2277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:00 smithi096 ceph-mon[101353]: pgmap v2277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:02 smithi159 ceph-mon[69013]: pgmap v2278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:02 smithi096 ceph-mon[101353]: pgmap v2278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:04 smithi159 ceph-mon[69013]: pgmap v2279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:04 smithi096 ceph-mon[101353]: pgmap v2279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:06 smithi159 ceph-mon[69013]: pgmap v2280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:06 smithi096 ceph-mon[101353]: pgmap v2280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:08 smithi159 ceph-mon[69013]: pgmap v2281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:08.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:08 smithi096 ceph-mon[101353]: pgmap v2281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:10 smithi159 ceph-mon[69013]: pgmap v2282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:10.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:10 smithi096 ceph-mon[101353]: pgmap v2282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:12 smithi159 ceph-mon[69013]: pgmap v2283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:12.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:12 smithi096 ceph-mon[101353]: pgmap v2283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 -- 172.21.15.96:0/1806232039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f55c0 msgr2=0x7fa2080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1806232039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f55c0 0x7fa2080f59e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fa1fc004660 tx=0x7fa1fc009b30).stop 2022-02-02T19:38:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 -- 172.21.15.96:0/1806232039 shutdown_connections 2022-02-02T19:38:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1806232039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f6860 0x7fa2080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1806232039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f55c0 0x7fa2080f59e0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 -- 172.21.15.96:0/1806232039 >> 172.21.15.96:0/1806232039 conn(0x7fa2080f0d40 msgr2=0x7fa2080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 -- 172.21.15.96:0/1806232039 shutdown_connections 2022-02-02T19:38:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.094+0000 7fa20cb32700 1 -- 172.21.15.96:0/1806232039 wait complete. 2022-02-02T19:38:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 Processor -- start 2022-02-02T19:38:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 -- start start 2022-02-02T19:38:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f55c0 0x7fa20810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080602b0 con 0x7fa2080f6860 2022-02-02T19:38:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20cb32700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080603f0 con 0x7fa2080f55c0 2022-02-02T19:38:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60830/0 (socket says 172.21.15.96:60830) 2022-02-02T19:38:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 -- 172.21.15.96:0/1118346909 learned_addr learned my addr 172.21.15.96:0/1118346909 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa20659c700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f55c0 0x7fa20810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 -- 172.21.15.96:0/1118346909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f55c0 msgr2=0x7fa20810c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f55c0 0x7fa20810c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.095+0000 7fa205d9b700 1 -- 172.21.15.96:0/1118346909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc005040 con 0x7fa2080f6860 2022-02-02T19:38:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa205d9b700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fa1f80026d0 tx=0x7fa1f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f80079c0 con 0x7fa2080f6860 2022-02-02T19:38:14.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa1f800f040 con 0x7fa2080f6860 2022-02-02T19:38:14.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20810ea80 con 0x7fa2080f6860 2022-02-02T19:38:14.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f80148b0 con 0x7fa2080f6860 2022-02-02T19:38:14.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.096+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20810ef00 con 0x7fa2080f6860 2022-02-02T19:38:14.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.097+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208045ad0 con 0x7fa2080f6860 2022-02-02T19:38:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.097+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa1f8007b20 con 0x7fa2080f6860 2022-02-02T19:38:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.098+0000 7fa1f6ffd700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 0x7fa1f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.098+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa1f8081990 con 0x7fa2080f6860 2022-02-02T19:38:14.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.098+0000 7fa20659c700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 0x7fa1f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.098+0000 7fa20659c700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 0x7fa1f0067290 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa1fc013690 tx=0x7fa1fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.102+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa1f804fa90 con 0x7fa2080f6860 2022-02-02T19:38:14.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.280+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa208057f10 con 0x7fa1f0064dd0 2022-02-02T19:38:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.281+0000 7fa1f6ffd700 1 -- 172.21.15.96:0/1118346909 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa208057f10 con 0x7fa1f0064dd0 2022-02-02T19:38:14.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 msgr2=0x7fa1f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 0x7fa1f0067290 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa1fc013690 tx=0x7fa1fc009b30).stop 2022-02-02T19:38:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 msgr2=0x7fa20810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fa1f80026d0 tx=0x7fa1f8009de0).stop 2022-02-02T19:38:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 shutdown_connections 2022-02-02T19:38:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa1f0064dd0 0x7fa1f0067290 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2080f55c0 0x7fa20810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 --2- 172.21.15.96:0/1118346909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2080f6860 0x7fa20810e590 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 >> 172.21.15.96:0/1118346909 conn(0x7fa2080f0d40 msgr2=0x7fa2080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 shutdown_connections 2022-02-02T19:38:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.283+0000 7fa20cb32700 1 -- 172.21.15.96:0/1118346909 wait complete. 2022-02-02T19:38:14.298 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:38:14.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- 172.21.15.96:0/2839583794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 msgr2=0x7fd1940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 --2- 172.21.15.96:0/2839583794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd1940f59e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd184004660 tx=0x7fd184009b30).stop 2022-02-02T19:38:14.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- 172.21.15.96:0/2839583794 shutdown_connections 2022-02-02T19:38:14.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 --2- 172.21.15.96:0/2839583794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1940f6860 0x7fd1940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:38:14.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 --2- 172.21.15.96:0/2839583794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd1940f59e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- 172.21.15.96:0/2839583794 >> 172.21.15.96:0/2839583794 conn(0x7fd1940f0d40 msgr2=0x7fd1940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- 172.21.15.96:0/2839583794 shutdown_connections 2022-02-02T19:38:14.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- 172.21.15.96:0/2839583794 wait complete. 2022-02-02T19:38:14.388 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:14 smithi096 ceph-mon[101353]: pgmap v2284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:14.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 Processor -- start 2022-02-02T19:38:14.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.381+0000 7fd19c612700 1 -- start start 2022-02-02T19:38:14.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1940f6860 0x7fd1941063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941069f0 con 0x7fd1940f55c0 2022-02-02T19:38:14.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941072a0 con 0x7fd1940f6860 2022-02-02T19:38:14.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60836/0 (socket says 172.21.15.96:60836) 2022-02-02T19:38:14.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 -- 172.21.15.96:0/2643734976 learned_addr learned my addr 172.21.15.96:0/2643734976 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:14.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 -- 172.21.15.96:0/2643734976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1940f6860 msgr2=0x7fd1941063b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T19:38:14.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1940f6860 0x7fd1941063b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:38:14.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 -- 172.21.15.96:0/2643734976 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd184005040 con 0x7fd1940f55c0 2022-02-02T19:38:14.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19a3ae700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd184004f60 tx=0x7fd184009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd184018070 con 0x7fd1940f55c0 2022-02-02T19:38:14.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd184007ba0 con 0x7fd1940f55c0 2022-02-02T19:38:14.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18401c620 con 0x7fd1940f55c0 2022-02-02T19:38:14.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194107520 con 0x7fd1940f55c0 2022-02-02T19:38:14.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.382+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd194107a80 con 0x7fd1940f55c0 2022-02-02T19:38:14.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.383+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1940f49b0 con 0x7fd1940f55c0 2022-02-02T19:38:14.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.384+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd18401c8e0 con 0x7fd1940f55c0 2022-02-02T19:38:14.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.384+0000 7fd18affd700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 0x7fd180067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.384+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd184083910 con 0x7fd1940f55c0 2022-02-02T19:38:14.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.384+0000 7fd199bad700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 0x7fd180067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.385+0000 7fd199bad700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 0x7fd180067290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd190009500 tx=0x7fd190006a30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.388+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd184055440 con 0x7fd1940f55c0 2022-02-02T19:38:14.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:14 smithi159 ceph-mon[69013]: pgmap v2284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.561+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1940fde70 con 0x7fd180064dd0 2022-02-02T19:38:14.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.570+0000 7fd18affd700 1 -- 172.21.15.96:0/2643734976 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd1940fde70 con 0x7fd180064dd0 2022-02-02T19:38:14.576 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:38:14.576 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (81m) 52m ago 82m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:38:14.576 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (74m) 52m ago 82m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:38:14.576 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (73m) 50m ago 82m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:38:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (81m) 52m ago 82m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:38:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (78m) 52m ago 78m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:38:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (74m) 52m ago 78m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:38:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (78m) 50m ago 78m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:38:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (74m) 50m ago 78m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:38:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (75m) 52m ago 83m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:38:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (75m) 50m ago 82m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:38:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (74m) 52m ago 83m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:38:14.579 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (74m) 50m ago 82m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:38:14.579 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (82m) 52m ago 82m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:38:14.579 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (81m) 50m ago 81m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:38:14.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (73m) 52m ago 81m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:38:14.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (73m) 52m ago 81m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:38:14.580 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (72m) 52m ago 80m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:38:14.580 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (72m) 50m ago 80m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:38:14.580 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (71m) 50m ago 80m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:38:14.580 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (71m) 50m ago 80m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:38:14.580 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (81m) 52m ago 82m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:38:14.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 msgr2=0x7fd180067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 0x7fd180067290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd190009500 tx=0x7fd190006a30).stop 2022-02-02T19:38:14.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 msgr2=0x7fd194105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd184004f60 tx=0x7fd184009b30).stop 2022-02-02T19:38:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 shutdown_connections 2022-02-02T19:38:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd180064dd0 0x7fd180067290 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1940f55c0 0x7fd194105ec0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 --2- 172.21.15.96:0/2643734976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1940f6860 0x7fd1941063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:38:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 >> 172.21.15.96:0/2643734976 conn(0x7fd1940f0d40 msgr2=0x7fd1940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 shutdown_connections 2022-02-02T19:38:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.572+0000 7fd19c612700 1 -- 172.21.15.96:0/2643734976 wait complete. 2022-02-02T19:38:14.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 -- 172.21.15.96:0/134457517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 msgr2=0x7f96e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 --2- 172.21.15.96:0/134457517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e40f6cc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f96d4004660 tx=0x7f96d4009b30).stop 2022-02-02T19:38:14.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 -- 172.21.15.96:0/134457517 shutdown_connections 2022-02-02T19:38:14.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 --2- 172.21.15.96:0/134457517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e40f6cc0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 --2- 172.21.15.96:0/134457517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 -- 172.21.15.96:0/134457517 >> 172.21.15.96:0/134457517 conn(0x7f96e40f0d40 msgr2=0x7f96e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 -- 172.21.15.96:0/134457517 shutdown_connections 2022-02-02T19:38:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.669+0000 7f96e917d700 1 -- 172.21.15.96:0/134457517 wait complete. 2022-02-02T19:38:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 Processor -- start 2022-02-02T19:38:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 -- start start 2022-02-02T19:38:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40603e0 con 0x7f96e40f6860 2022-02-02T19:38:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e917d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4060520 con 0x7f96e40f55c0 2022-02-02T19:38:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60848/0 (socket says 172.21.15.96:60848) 2022-02-02T19:38:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 -- 172.21.15.96:0/4028367194 learned_addr learned my addr 172.21.15.96:0/4028367194 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e2d9d700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 -- 172.21.15.96:0/4028367194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 msgr2=0x7f96e4109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 -- 172.21.15.96:0/4028367194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4005040 con 0x7f96e40f6860 2022-02-02T19:38:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e2d9d700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:38:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.670+0000 7f96e259c700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f96d4009990 tx=0x7f96d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.671+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d4018070 con 0x7f96e40f6860 2022-02-02T19:38:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.671+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f96d4007ca0 con 0x7f96e40f6860 2022-02-02T19:38:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.671+0000 7f96e917d700 1 -- 172.21.15.96:0/4028367194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e410c6a0 con 0x7f96e40f6860 2022-02-02T19:38:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.671+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d401c620 con 0x7f96e40f6860 2022-02-02T19:38:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.671+0000 7f96e917d700 1 -- 172.21.15.96:0/4028367194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e410cc00 con 0x7f96e40f6860 2022-02-02T19:38:14.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.672+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f96d401c8e0 con 0x7f96e40f6860 2022-02-02T19:38:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.672+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc004fa0 con 0x7f96e40f6860 2022-02-02T19:38:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.673+0000 7f96cb7fe700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.673+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f96d4084760 con 0x7f96e40f6860 2022-02-02T19:38:14.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.673+0000 7f96e2d9d700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:14.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.673+0000 7f96e2d9d700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f96e4060060 tx=0x7f96d8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:14.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.677+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f96d4052860 con 0x7f96e40f6860 2022-02-02T19:38:14.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.905+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96bc005e80 con 0x7f96e40f6860 2022-02-02T19:38:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.905+0000 7f96cb7fe700 1 -- 172.21.15.96:0/4028367194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f96d4055e80 con 0x7f96e40f6860 2022-02-02T19:38:14.911 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:38:14.911 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:38:14.911 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:38:14.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:14.912 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:38:14.912 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:38:14.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:14.913 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:38:14.913 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:38:14.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:14.913 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:38:14.914 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:38:14.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:14.914 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:38:14.914 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:38:14.914 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:38:14.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:38:14.915 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:38:14.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 msgr2=0x7f96cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f96e4060060 tx=0x7f96d8009040).stop 2022-02-02T19:38:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 msgr2=0x7f96e410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f96d4009990 tx=0x7f96d4009b30).stop 2022-02-02T19:38:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 shutdown_connections 2022-02-02T19:38:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 --2- 172.21.15.96:0/4028367194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c150 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 >> 172.21.15.96:0/4028367194 conn(0x7f96e40f0d40 msgr2=0x7f96e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 shutdown_connections 2022-02-02T19:38:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:14.907+0000 7f96c97fa700 1 -- 172.21.15.96:0/4028367194 wait complete. 2022-02-02T19:38:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- 172.21.15.96:0/4027100470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f5430 msgr2=0x7f84cc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 --2- 172.21.15.96:0/4027100470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f5430 0x7f84cc0f5850 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f84bc004660 tx=0x7f84bc009b30).stop 2022-02-02T19:38:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- 172.21.15.96:0/4027100470 shutdown_connections 2022-02-02T19:38:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 --2- 172.21.15.96:0/4027100470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f66d0 0x7f84cc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 --2- 172.21.15.96:0/4027100470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f5430 0x7f84cc0f5850 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- 172.21.15.96:0/4027100470 >> 172.21.15.96:0/4027100470 conn(0x7f84cc0f0b90 msgr2=0x7f84cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- 172.21.15.96:0/4027100470 shutdown_connections 2022-02-02T19:38:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- 172.21.15.96:0/4027100470 wait complete. 2022-02-02T19:38:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 Processor -- start 2022-02-02T19:38:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.005+0000 7f84d202e700 1 -- start start 2022-02-02T19:38:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d202e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f5430 0x7f84cc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d202e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d202e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1067d0 con 0x7f84cc0f66d0 2022-02-02T19:38:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d202e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc106fd0 con 0x7f84cc0f5430 2022-02-02T19:38:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60858/0 (socket says 172.21.15.96:60858) 2022-02-02T19:38:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 -- 172.21.15.96:0/2364974709 learned_addr learned my addr 172.21.15.96:0/2364974709 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d102c700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f5430 0x7f84cc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 -- 172.21.15.96:0/2364974709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f5430 msgr2=0x7f84cc105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f5430 0x7f84cc105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 -- 172.21.15.96:0/2364974709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc005040 con 0x7f84cc0f66d0 2022-02-02T19:38:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.006+0000 7f84d082b700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f84c80026d0 tx=0x7f84c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.007+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c8009320 con 0x7f84cc0f66d0 2022-02-02T19:38:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.007+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84c800f040 con 0x7f84cc0f66d0 2022-02-02T19:38:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.007+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc1072b0 con 0x7f84cc0f66d0 2022-02-02T19:38:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.007+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c80147e0 con 0x7f84cc0f66d0 2022-02-02T19:38:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.007+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc107870 con 0x7f84cc0f66d0 2022-02-02T19:38:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.008+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc059100 con 0x7f84cc0f66d0 2022-02-02T19:38:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.008+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84c8014a50 con 0x7f84cc0f66d0 2022-02-02T19:38:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.009+0000 7f84c1ffb700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 0x7f84b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.009+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84c8082110 con 0x7f84cc0f66d0 2022-02-02T19:38:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.009+0000 7f84d102c700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 0x7f84b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.009+0000 7f84d102c700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 0x7f84b80672e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f84bc004630 tx=0x7f84bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.013+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84c8053bc0 con 0x7f84cc0f66d0 2022-02-02T19:38:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.217+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f84cc0fdc90 con 0x7f84cc0f66d0 2022-02-02T19:38:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.218+0000 7f84c1ffb700 1 -- 172.21.15.96:0/2364974709 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f84c80537b0 con 0x7f84cc0f66d0 2022-02-02T19:38:15.223 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:38:15.224 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:38:15.224 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:38:15.224 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:38:15.224 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:15.225 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:38:15.225 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:38:15.225 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:38:15.225 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:38:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:38:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:38:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:38:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:38:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:38:15.227 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:38:15.227 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:38:15.227 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:38:15.227 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:38:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:38:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:38:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:38:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:38:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:38:15.229 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:38:15.229 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:38:15.229 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:38:15.229 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:38:15.230 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:38:15.230 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:38:15.230 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:38:15.230 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:38:15.230 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:38:15.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:15.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:15.231 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:38:15.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:15.231 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:15.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:15.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 msgr2=0x7f84b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 0x7f84b80672e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f84bc004630 tx=0x7f84bc009b30).stop 2022-02-02T19:38:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 msgr2=0x7f84cc106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f84c80026d0 tx=0x7f84c8009de0).stop 2022-02-02T19:38:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 shutdown_connections 2022-02-02T19:38:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84b8064e20 0x7f84b80672e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84cc0f5430 0x7f84cc105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 --2- 172.21.15.96:0/2364974709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84cc0f66d0 0x7f84cc106220 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 >> 172.21.15.96:0/2364974709 conn(0x7f84cc0f0b90 msgr2=0x7f84cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 shutdown_connections 2022-02-02T19:38:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:15.221+0000 7f84d202e700 1 -- 172.21.15.96:0/2364974709 wait complete. 2022-02-02T19:38:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:38:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4028367194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:38:15.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4028367194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:38:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:16 smithi159 ceph-mon[69013]: pgmap v2285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:16 smithi159 ceph-mon[69013]: from='client.36456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:16 smithi159 ceph-mon[69013]: from='client.36460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:16.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2364974709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:38:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:16 smithi096 ceph-mon[101353]: pgmap v2285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:16 smithi096 ceph-mon[101353]: from='client.36456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:16 smithi096 ceph-mon[101353]: from='client.36460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:16.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2364974709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:38:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:18 smithi159 ceph-mon[69013]: pgmap v2286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:18.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:18 smithi096 ceph-mon[101353]: pgmap v2286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:19.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:19 smithi159 ceph-mon[69013]: pgmap v2287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:19.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:19 smithi096 ceph-mon[101353]: pgmap v2287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:22 smithi159 ceph-mon[69013]: pgmap v2288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:22.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:22 smithi096 ceph-mon[101353]: pgmap v2288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:24 smithi159 ceph-mon[69013]: pgmap v2289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:24 smithi096 ceph-mon[101353]: pgmap v2289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:26 smithi159 ceph-mon[69013]: pgmap v2290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:26.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:26 smithi096 ceph-mon[101353]: pgmap v2290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:28 smithi159 ceph-mon[69013]: pgmap v2291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:38:28.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:38:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:28 smithi096 ceph-mon[101353]: pgmap v2291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:38:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:38:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:30 smithi159 ceph-mon[69013]: pgmap v2292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:30 smithi096 ceph-mon[101353]: pgmap v2292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:32 smithi159 ceph-mon[69013]: pgmap v2293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:32 smithi096 ceph-mon[101353]: pgmap v2293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:34 smithi159 ceph-mon[69013]: pgmap v2294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:34 smithi096 ceph-mon[101353]: pgmap v2294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:36 smithi159 ceph-mon[69013]: pgmap v2295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:36.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:36 smithi096 ceph-mon[101353]: pgmap v2295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:38 smithi159 ceph-mon[69013]: pgmap v2296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:38 smithi096 ceph-mon[101353]: pgmap v2296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:40 smithi159 ceph-mon[69013]: pgmap v2297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:40 smithi096 ceph-mon[101353]: pgmap v2297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:42 smithi159 ceph-mon[69013]: pgmap v2298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:42 smithi096 ceph-mon[101353]: pgmap v2298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:44 smithi159 ceph-mon[69013]: pgmap v2299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:44 smithi096 ceph-mon[101353]: pgmap v2299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:45.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 -- 172.21.15.96:0/1948572233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f55c0 msgr2=0x7f2be00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 --2- 172.21.15.96:0/1948572233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f55c0 0x7f2be00f59e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f2bd0004660 tx=0x7f2bd0009b30).stop 2022-02-02T19:38:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 -- 172.21.15.96:0/1948572233 shutdown_connections 2022-02-02T19:38:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 --2- 172.21.15.96:0/1948572233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f6860 0x7f2be00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 --2- 172.21.15.96:0/1948572233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f55c0 0x7f2be00f59e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 -- 172.21.15.96:0/1948572233 >> 172.21.15.96:0/1948572233 conn(0x7f2be00f0d40 msgr2=0x7f2be00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.332+0000 7f2be6712700 1 -- 172.21.15.96:0/1948572233 shutdown_connections 2022-02-02T19:38:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.333+0000 7f2be6712700 1 -- 172.21.15.96:0/1948572233 wait complete. 2022-02-02T19:38:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.333+0000 7f2be6712700 1 Processor -- start 2022-02-02T19:38:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.333+0000 7f2be6712700 1 -- start start 2022-02-02T19:38:45.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2be6712700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 0x7f2be0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2be6712700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2be6712700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0106910 con 0x7f2be00f6860 2022-02-02T19:38:45.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2be6712700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0106a50 con 0x7f2be00f55c0 2022-02-02T19:38:45.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60892/0 (socket says 172.21.15.96:60892) 2022-02-02T19:38:45.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 -- 172.21.15.96:0/3488805837 learned_addr learned my addr 172.21.15.96:0/3488805837 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:45.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdffff700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 0x7f2be0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 -- 172.21.15.96:0/3488805837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 msgr2=0x7f2be0105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 0x7f2be0105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 -- 172.21.15.96:0/3488805837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0005040 con 0x7f2be00f6860 2022-02-02T19:38:45.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdffff700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 0x7f2be0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:38:45.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdf7fe700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f2bd400c530 tx=0x7f2bd4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd400f650 con 0x7f2be00f6860 2022-02-02T19:38:45.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be01073f0 con 0x7f2be00f6860 2022-02-02T19:38:45.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2bd400fc60 con 0x7f2be00f6860 2022-02-02T19:38:45.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.334+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd4012cd0 con 0x7f2be00f6860 2022-02-02T19:38:45.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.335+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be01079b0 con 0x7f2be00f6860 2022-02-02T19:38:45.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.335+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be0045ad0 con 0x7f2be00f6860 2022-02-02T19:38:45.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.336+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2bd4010070 con 0x7f2be00f6860 2022-02-02T19:38:45.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.336+0000 7f2bdcff9700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 0x7f2bc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.336+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2bd40817b0 con 0x7f2be00f6860 2022-02-02T19:38:45.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.336+0000 7f2bdffff700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 0x7f2bc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.337+0000 7f2bdffff700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 0x7f2bc8067290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f2bd0009da0 tx=0x7f2bd0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.341+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2bd40532e0 con 0x7f2be00f6860 2022-02-02T19:38:45.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.518+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2be00ff850 con 0x7f2bc8064dd0 2022-02-02T19:38:45.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.520+0000 7f2bdcff9700 1 -- 172.21.15.96:0/3488805837 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2be00ff850 con 0x7f2bc8064dd0 2022-02-02T19:38:45.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 msgr2=0x7f2bc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 0x7f2bc8067290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f2bd0009da0 tx=0x7f2bd0009b30).stop 2022-02-02T19:38:45.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 msgr2=0x7f2be0106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f2bd400c530 tx=0x7f2bd4007e20).stop 2022-02-02T19:38:45.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 shutdown_connections 2022-02-02T19:38:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bc8064dd0 0x7f2bc8067290 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2be00f55c0 0x7f2be0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 --2- 172.21.15.96:0/3488805837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2be00f6860 0x7f2be0106360 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.521+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 >> 172.21.15.96:0/3488805837 conn(0x7f2be00f0d40 msgr2=0x7f2be00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.522+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 shutdown_connections 2022-02-02T19:38:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.522+0000 7f2be6712700 1 -- 172.21.15.96:0/3488805837 wait complete. 2022-02-02T19:38:45.535 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:38:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.618+0000 7fa0ccb94700 1 -- 172.21.15.96:0/233981440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f6870 msgr2=0x7fa0c80f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.618+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/233981440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f6870 0x7fa0c80f6cd0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fa0bc004660 tx=0x7fa0bc009b30).stop 2022-02-02T19:38:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- 172.21.15.96:0/233981440 shutdown_connections 2022-02-02T19:38:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/233981440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f6870 0x7fa0c80f6cd0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/233981440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f55d0 0x7fa0c80f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- 172.21.15.96:0/233981440 >> 172.21.15.96:0/233981440 conn(0x7fa0c80f0d70 msgr2=0x7fa0c80f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- 172.21.15.96:0/233981440 shutdown_connections 2022-02-02T19:38:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- 172.21.15.96:0/233981440 wait complete. 2022-02-02T19:38:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 Processor -- start 2022-02-02T19:38:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- start start 2022-02-02T19:38:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f6870 0x7fa0c810c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80604a0 con 0x7fa0c80f55d0 2022-02-02T19:38:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.619+0000 7fa0ccb94700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80605e0 con 0x7fa0c80f6870 2022-02-02T19:38:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60900/0 (socket says 172.21.15.96:60900) 2022-02-02T19:38:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 -- 172.21.15.96:0/3346659855 learned_addr learned my addr 172.21.15.96:0/3346659855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c5d9b700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f6870 0x7fa0c810c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 -- 172.21.15.96:0/3346659855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f6870 msgr2=0x7fa0c810c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f6870 0x7fa0c810c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 -- 172.21.15.96:0/3346659855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc005040 con 0x7fa0c80f55d0 2022-02-02T19:38:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0c659c700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa0b800c530 tx=0x7fa0b8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b800f650 con 0x7fa0c80f55d0 2022-02-02T19:38:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0b800fc60 con 0x7fa0c80f55d0 2022-02-02T19:38:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c810c6f0 con 0x7fa0c80f55d0 2022-02-02T19:38:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b8012cb0 con 0x7fa0c80f55d0 2022-02-02T19:38:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.620+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c810cc80 con 0x7fa0c80f55d0 2022-02-02T19:38:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.621+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c8045ad0 con 0x7fa0c80f55d0 2022-02-02T19:38:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.622+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa0b8019030 con 0x7fa0c80f55d0 2022-02-02T19:38:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.622+0000 7fa0b6ffd700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 0x7fa0b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.622+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa0b8081610 con 0x7fa0c80f55d0 2022-02-02T19:38:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.622+0000 7fa0c5d9b700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 0x7fa0b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.623+0000 7fa0c5d9b700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 0x7fa0b0067290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa0bc004630 tx=0x7fa0bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.627+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa0b804f7c0 con 0x7fa0c80f55d0 2022-02-02T19:38:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.801+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0c80fdf00 con 0x7fa0b0064dd0 2022-02-02T19:38:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.810+0000 7fa0b6ffd700 1 -- 172.21.15.96:0/3346659855 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa0c80fdf00 con 0x7fa0b0064dd0 2022-02-02T19:38:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:38:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (82m) 52m ago 83m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:38:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (74m) 52m ago 83m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:38:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (74m) 51m ago 82m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:38:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (81m) 52m ago 82m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:38:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (79m) 52m ago 79m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:38:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (74m) 52m ago 79m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:38:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (79m) 51m ago 79m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:38:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (75m) 51m ago 79m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:38:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (76m) 52m ago 84m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:38:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (75m) 51m ago 82m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:38:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (75m) 52m ago 84m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:38:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (75m) 51m ago 82m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:38:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (82m) 52m ago 82m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:38:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (82m) 51m ago 82m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:38:45.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (74m) 52m ago 82m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:38:45.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (73m) 52m ago 81m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:38:45.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (73m) 52m ago 81m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:38:45.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (72m) 51m ago 81m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:38:45.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (72m) 51m ago 80m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:38:45.819 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (71m) 51m ago 80m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:38:45.822 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (81m) 52m ago 82m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:38:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 msgr2=0x7fa0b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 0x7fa0b0067290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa0bc004630 tx=0x7fa0bc009b30).stop 2022-02-02T19:38:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 msgr2=0x7fa0c8109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa0b800c530 tx=0x7fa0b8007e10).stop 2022-02-02T19:38:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 shutdown_connections 2022-02-02T19:38:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0b0064dd0 0x7fa0b0067290 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0c80f55d0 0x7fa0c8109c40 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 --2- 172.21.15.96:0/3346659855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c80f6870 0x7fa0c810c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 >> 172.21.15.96:0/3346659855 conn(0x7fa0c80f0d70 msgr2=0x7fa0c80fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 shutdown_connections 2022-02-02T19:38:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.812+0000 7fa0ccb94700 1 -- 172.21.15.96:0/3346659855 wait complete. 2022-02-02T19:38:45.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 -- 172.21.15.96:0/564632148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f5570 msgr2=0x7fc1ac0f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/564632148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac0f5990 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fc19c004660 tx=0x7fc19c009b30).stop 2022-02-02T19:38:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 -- 172.21.15.96:0/564632148 shutdown_connections 2022-02-02T19:38:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/564632148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac0f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/564632148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac0f5990 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.908+0000 7fc1b20b6700 1 -- 172.21.15.96:0/564632148 >> 172.21.15.96:0/564632148 conn(0x7fc1ac0f0cd0 msgr2=0x7fc1ac0f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.909+0000 7fc1b20b6700 1 -- 172.21.15.96:0/564632148 shutdown_connections 2022-02-02T19:38:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.909+0000 7fc1b20b6700 1 -- 172.21.15.96:0/564632148 wait complete. 2022-02-02T19:38:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.909+0000 7fc1b20b6700 1 Processor -- start 2022-02-02T19:38:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1b20b6700 1 -- start start 2022-02-02T19:38:45.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1b20b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1b20b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1b20b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0603e0 con 0x7fc1ac0f6810 2022-02-02T19:38:45.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1b20b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac060520 con 0x7fc1ac0f5570 2022-02-02T19:38:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60912/0 (socket says 172.21.15.96:60912) 2022-02-02T19:38:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 -- 172.21.15.96:0/2911146807 learned_addr learned my addr 172.21.15.96:0/2911146807 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1ab7fe700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 -- 172.21.15.96:0/2911146807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f5570 msgr2=0x7fc1ac109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 -- 172.21.15.96:0/2911146807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c005040 con 0x7fc1ac0f6810 2022-02-02T19:38:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.910+0000 7fc1a3fff700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fc1940026d0 tx=0x7fc194009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.911+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1940079c0 con 0x7fc1ac0f6810 2022-02-02T19:38:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.911+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc19400f040 con 0x7fc1ac0f6810 2022-02-02T19:38:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.911+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac10c670 con 0x7fc1ac0f6810 2022-02-02T19:38:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.911+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1940148b0 con 0x7fc1ac0f6810 2022-02-02T19:38:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.911+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac10cc30 con 0x7fc1ac0f6810 2022-02-02T19:38:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.912+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac045ad0 con 0x7fc1ac0f6810 2022-02-02T19:38:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.912+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc194007b20 con 0x7fc1ac0f6810 2022-02-02T19:38:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.913+0000 7fc1a8ff9700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 0x7fc1980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.913+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1940819e0 con 0x7fc1ac0f6810 2022-02-02T19:38:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.913+0000 7fc1ab7fe700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 0x7fc1980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.913+0000 7fc1ab7fe700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 0x7fc1980672e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fc19c013690 tx=0x7fc19c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:45.917+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc19404fae0 con 0x7fc1ac0f6810 2022-02-02T19:38:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.150+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1ac0fde30 con 0x7fc1ac0f6810 2022-02-02T19:38:46.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.151+0000 7fc1a8ff9700 1 -- 172.21.15.96:0/2911146807 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc194053100 con 0x7fc1ac0f6810 2022-02-02T19:38:46.155 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:38:46.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:38:46.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:38:46.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:46.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:38:46.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:38:46.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:46.157 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:38:46.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:38:46.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:46.158 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:38:46.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:38:46.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:38:46.158 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:38:46.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:38:46.159 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:38:46.159 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:38:46.159 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:38:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.152+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 msgr2=0x7fc1980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.152+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 0x7fc1980672e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fc19c013690 tx=0x7fc19c009b30).stop 2022-02-02T19:38:46.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.152+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 msgr2=0x7fc1ac10c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.152+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fc1940026d0 tx=0x7fc194009de0).stop 2022-02-02T19:38:46.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 shutdown_connections 2022-02-02T19:38:46.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc198064e20 0x7fc1980672e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1ac0f5570 0x7fc1ac109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 --2- 172.21.15.96:0/2911146807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1ac0f6810 0x7fc1ac10c0c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 >> 172.21.15.96:0/2911146807 conn(0x7fc1ac0f0cd0 msgr2=0x7fc1ac0fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 shutdown_connections 2022-02-02T19:38:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.153+0000 7fc1b20b6700 1 -- 172.21.15.96:0/2911146807 wait complete. 2022-02-02T19:38:46.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 -- 172.21.15.96:0/2962969040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 msgr2=0x7fb4880f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/2962969040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb4880f5df0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fb478004660 tx=0x7fb478009b30).stop 2022-02-02T19:38:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 -- 172.21.15.96:0/2962969040 shutdown_connections 2022-02-02T19:38:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/2962969040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb4880f5df0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/2962969040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 0x7fb4880f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 -- 172.21.15.96:0/2962969040 >> 172.21.15.96:0/2962969040 conn(0x7fb4880f04c0 msgr2=0x7fb4880f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:46.256 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:46 smithi096 ceph-mon[101353]: pgmap v2300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:46.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 -- 172.21.15.96:0/2962969040 shutdown_connections 2022-02-02T19:38:46.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 -- 172.21.15.96:0/2962969040 wait complete. 2022-02-02T19:38:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.250+0000 7fb48cbf7700 1 Processor -- start 2022-02-02T19:38:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48cbf7700 1 -- start start 2022-02-02T19:38:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48cbf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:46.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48cbf7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 0x7fb48810c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48cbf7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880f5600 con 0x7fb4880f5970 2022-02-02T19:38:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48cbf7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880f5740 con 0x7fb4880f6c60 2022-02-02T19:38:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60922/0 (socket says 172.21.15.96:60922) 2022-02-02T19:38:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 -- 172.21.15.96:0/3986357428 learned_addr learned my addr 172.21.15.96:0/3986357428 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:38:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb485d9b700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 0x7fb48810c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 -- 172.21.15.96:0/3986357428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 msgr2=0x7fb48810c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 0x7fb48810c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 -- 172.21.15.96:0/3986357428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478005040 con 0x7fb4880f5970 2022-02-02T19:38:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb48659c700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fb47c0049b0 tx=0x7fb47c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.251+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47c013070 con 0x7fb4880f5970 2022-02-02T19:38:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.252+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb488105ae0 con 0x7fb4880f5970 2022-02-02T19:38:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.252+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb47c00e2e0 con 0x7fb4880f5970 2022-02-02T19:38:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.252+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47c00ca60 con 0x7fb4880f5970 2022-02-02T19:38:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.252+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4881060a0 con 0x7fb4880f5970 2022-02-02T19:38:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.253+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb488045ad0 con 0x7fb4880f5970 2022-02-02T19:38:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.253+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb47c00cd20 con 0x7fb4880f5970 2022-02-02T19:38:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.253+0000 7fb476ffd700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 0x7fb470067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:38:46.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.253+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb47c085f80 con 0x7fb4880f5970 2022-02-02T19:38:46.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.253+0000 7fb485d9b700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 0x7fb470067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:38:46.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.254+0000 7fb485d9b700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 0x7fb470067290 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb478004e30 tx=0x7fb478009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:38:46.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.258+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb47c054080 con 0x7fb4880f5970 2022-02-02T19:38:46.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.460+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4880fdf30 con 0x7fb4880f5970 2022-02-02T19:38:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.460+0000 7fb476ffd700 1 -- 172.21.15.96:0/3986357428 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb47c0576a0 con 0x7fb4880f5970 2022-02-02T19:38:46.465 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:38:46.465 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:38:46.465 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:38:46.466 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:38:46.466 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:46.466 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:38:46.466 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:38:46.467 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:38:46.467 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:38:46.467 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:38:46.467 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:38:46.468 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:38:46.468 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:38:46.468 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:38:46.468 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:38:46.469 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:38:46.469 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:38:46.469 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:38:46.469 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:38:46.469 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:38:46.470 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:38:46.470 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:38:46.470 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:38:46.470 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:38:46.471 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:38:46.471 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:38:46.471 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:38:46.471 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:38:46.471 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:38:46.472 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:38:46.472 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:38:46.472 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:38:46.472 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:46.472 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:46.473 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:38:46.473 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:38:46.473 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:46.473 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:46.474 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:38:46.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 msgr2=0x7fb470067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 0x7fb470067290 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb478004e30 tx=0x7fb478009b30).stop 2022-02-02T19:38:46.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 msgr2=0x7fb488109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:38:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fb47c0049b0 tx=0x7fb47c007e90).stop 2022-02-02T19:38:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 shutdown_connections 2022-02-02T19:38:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb470064dd0 0x7fb470067290 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f5970 0x7fb488109ca0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 --2- 172.21.15.96:0/3986357428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6c60 0x7fb48810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:38:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 >> 172.21.15.96:0/3986357428 conn(0x7fb4880f04c0 msgr2=0x7fb4880fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:38:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 shutdown_connections 2022-02-02T19:38:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:38:46.462+0000 7fb48cbf7700 1 -- 172.21.15.96:0/3986357428 wait complete. 2022-02-02T19:38:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:38:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:46 smithi159 ceph-mon[69013]: pgmap v2300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:47.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:47 smithi159 ceph-mon[69013]: from='client.36472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:47.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:47 smithi159 ceph-mon[69013]: from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:47.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2911146807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:38:47.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3986357428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:38:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:47 smithi096 ceph-mon[101353]: from='client.36472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:47 smithi096 ceph-mon[101353]: from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:38:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2911146807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:38:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3986357428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:38:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:48 smithi159 ceph-mon[69013]: pgmap v2301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:48 smithi096 ceph-mon[101353]: pgmap v2301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:50 smithi159 ceph-mon[69013]: pgmap v2302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:50 smithi096 ceph-mon[101353]: pgmap v2302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:52 smithi159 ceph-mon[69013]: pgmap v2303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:52 smithi096 ceph-mon[101353]: pgmap v2303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:54 smithi159 ceph-mon[69013]: pgmap v2304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:54 smithi096 ceph-mon[101353]: pgmap v2304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:56 smithi159 ceph-mon[69013]: pgmap v2305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:56 smithi096 ceph-mon[101353]: pgmap v2305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:38:58 smithi159 ceph-mon[69013]: pgmap v2306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:38:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:38:58 smithi096 ceph-mon[101353]: pgmap v2306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:00 smithi159 ceph-mon[69013]: pgmap v2307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:00 smithi096 ceph-mon[101353]: pgmap v2307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:02.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:02 smithi096 ceph-mon[101353]: pgmap v2308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:02 smithi159 ceph-mon[69013]: pgmap v2308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:04 smithi159 ceph-mon[69013]: pgmap v2309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:04 smithi096 ceph-mon[101353]: pgmap v2309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:06 smithi159 ceph-mon[69013]: pgmap v2310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:06 smithi096 ceph-mon[101353]: pgmap v2310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:08 smithi159 ceph-mon[69013]: pgmap v2311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:08 smithi096 ceph-mon[101353]: pgmap v2311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:10 smithi159 ceph-mon[69013]: pgmap v2312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:10 smithi096 ceph-mon[101353]: pgmap v2312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:12 smithi159 ceph-mon[69013]: pgmap v2313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:12 smithi096 ceph-mon[101353]: pgmap v2313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:14.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:14 smithi159 ceph-mon[69013]: pgmap v2314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:14 smithi096 ceph-mon[101353]: pgmap v2314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:15.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:15 smithi159 ceph-mon[69013]: pgmap v2315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:15.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:15 smithi096 ceph-mon[101353]: pgmap v2315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/2346402869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f77d0 msgr2=0x7fdcf40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/2346402869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f77d0 0x7fdcf40f7c30 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fdce4004660 tx=0x7fdce4009b30).stop 2022-02-02T19:39:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/2346402869 shutdown_connections 2022-02-02T19:39:16.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/2346402869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f77d0 0x7fdcf40f7c30 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/2346402869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf40f6530 0x7fdcf40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/2346402869 >> 172.21.15.96:0/2346402869 conn(0x7fdcf40f1c90 msgr2=0x7fdcf40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:16.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/2346402869 shutdown_connections 2022-02-02T19:39:16.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/2346402869 wait complete. 2022-02-02T19:39:16.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 Processor -- start 2022-02-02T19:39:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 -- start start 2022-02-02T19:39:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.574+0000 7fdcfb3cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfb3cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfb3cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4107880 con 0x7fdcf40f6530 2022-02-02T19:39:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfb3cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4108090 con 0x7fdcf40f77d0 2022-02-02T19:39:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60942/0 (socket says 172.21.15.96:60942) 2022-02-02T19:39:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 -- 172.21.15.96:0/1065185197 learned_addr learned my addr 172.21.15.96:0/1065185197 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 -- 172.21.15.96:0/1065185197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf40f77d0 msgr2=0x7fdcf4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 -- 172.21.15.96:0/1065185197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4005040 con 0x7fdcf40f6530 2022-02-02T19:39:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdcfa3ca700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fdcf000c530 tx=0x7fdcf0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcf000f650 con 0x7fdcf40f6530 2022-02-02T19:39:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.575+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdcf000fc60 con 0x7fdcf40f6530 2022-02-02T19:39:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.576+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4108310 con 0x7fdcf40f6530 2022-02-02T19:39:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.576+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcf0012d20 con 0x7fdcf40f6530 2022-02-02T19:39:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.576+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf41088d0 con 0x7fdcf40f6530 2022-02-02T19:39:16.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.577+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdcf0019030 con 0x7fdcf40f6530 2022-02-02T19:39:16.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.577+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4059100 con 0x7fdcf40f6530 2022-02-02T19:39:16.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.577+0000 7fdceaffd700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 0x7fdce00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.577+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdcf00816b0 con 0x7fdcf40f6530 2022-02-02T19:39:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.578+0000 7fdcf9bc9700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 0x7fdce00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.578+0000 7fdcf9bc9700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 0x7fdce00672e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fdce4004e30 tx=0x7fdce4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.582+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdcf004f800 con 0x7fdcf40f6530 2022-02-02T19:39:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.764+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcf40feea0 con 0x7fdce0064e20 2022-02-02T19:39:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.766+0000 7fdceaffd700 1 -- 172.21.15.96:0/1065185197 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdce40092e0 con 0x7fdce0064e20 2022-02-02T19:39:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 msgr2=0x7fdce00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 0x7fdce00672e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fdce4004e30 tx=0x7fdce4009b30).stop 2022-02-02T19:39:16.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 msgr2=0x7fdcf4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fdcf000c530 tx=0x7fdcf0007e10).stop 2022-02-02T19:39:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 shutdown_connections 2022-02-02T19:39:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdce0064e20 0x7fdce00672e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 --2- 172.21.15.96:0/1065185197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 >> 172.21.15.96:0/1065185197 conn(0x7fdcf40f1c90 msgr2=0x7fdcf40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 shutdown_connections 2022-02-02T19:39:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.767+0000 7fdcfb3cc700 1 -- 172.21.15.96:0/1065185197 wait complete. 2022-02-02T19:39:16.781 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:39:16.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 -- 172.21.15.96:0/439026077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f5430 msgr2=0x7f6ab00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 --2- 172.21.15.96:0/439026077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f5430 0x7f6ab00f5850 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f6aa0004660 tx=0x7f6aa0009b30).stop 2022-02-02T19:39:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 -- 172.21.15.96:0/439026077 shutdown_connections 2022-02-02T19:39:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 --2- 172.21.15.96:0/439026077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f66d0 0x7f6ab00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 --2- 172.21.15.96:0/439026077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f5430 0x7f6ab00f5850 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 -- 172.21.15.96:0/439026077 >> 172.21.15.96:0/439026077 conn(0x7f6ab00f0b90 msgr2=0x7f6ab00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 -- 172.21.15.96:0/439026077 shutdown_connections 2022-02-02T19:39:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.864+0000 7f6ab6936700 1 -- 172.21.15.96:0/439026077 wait complete. 2022-02-02T19:39:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 Processor -- start 2022-02-02T19:39:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 -- start start 2022-02-02T19:39:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f5430 0x7f6ab0105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0106760 con 0x7f6ab00f66d0 2022-02-02T19:39:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab6936700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0106f60 con 0x7f6ab00f5430 2022-02-02T19:39:16.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab5133700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:16.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab5133700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60952/0 (socket says 172.21.15.96:60952) 2022-02-02T19:39:16.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab5133700 1 -- 172.21.15.96:0/443513795 learned_addr learned my addr 172.21.15.96:0/443513795 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:16.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.865+0000 7f6ab5934700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f5430 0x7f6ab0105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:16.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab5133700 1 -- 172.21.15.96:0/443513795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f5430 msgr2=0x7f6ab0105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:16.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab5133700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f5430 0x7f6ab0105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:16.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab5133700 1 -- 172.21.15.96:0/443513795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0005040 con 0x7f6ab00f66d0 2022-02-02T19:39:16.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab5133700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f6aac00f940 tx=0x7f6aac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:16.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac009500 con 0x7f6ab00f66d0 2022-02-02T19:39:16.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab01071e0 con 0x7f6ab00f66d0 2022-02-02T19:39:16.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6aac009660 con 0x7f6ab00f66d0 2022-02-02T19:39:16.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac00de30 con 0x7f6ab00f66d0 2022-02-02T19:39:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.866+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab0107750 con 0x7f6ab00f66d0 2022-02-02T19:39:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.867+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0045ad0 con 0x7f6ab00f66d0 2022-02-02T19:39:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.867+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6aac00e040 con 0x7f6ab00f66d0 2022-02-02T19:39:16.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.868+0000 7f6aa67fc700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 0x7f6a9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.868+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6aac084400 con 0x7f6ab00f66d0 2022-02-02T19:39:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.868+0000 7f6ab5934700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 0x7f6a9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.868+0000 7f6ab5934700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 0x7f6a9c0672e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6aa0004630 tx=0x7f6aa0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:16.872+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6aac055f30 con 0x7f6ab00f66d0 2022-02-02T19:39:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.042+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ab00ff670 con 0x7f6a9c064e20 2022-02-02T19:39:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.051+0000 7f6aa67fc700 1 -- 172.21.15.96:0/443513795 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6ab00ff670 con 0x7f6a9c064e20 2022-02-02T19:39:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:39:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (82m) 53m ago 83m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:39:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (75m) 53m ago 83m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:39:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (75m) 51m ago 83m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:39:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (82m) 53m ago 83m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:39:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (79m) 53m ago 79m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:39:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (75m) 53m ago 79m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:39:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (79m) 51m ago 79m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:39:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (75m) 51m ago 79m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:39:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (76m) 53m ago 84m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:39:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (76m) 51m ago 83m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:39:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (75m) 53m ago 84m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:39:17.059 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (75m) 51m ago 83m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:39:17.059 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (83m) 53m ago 83m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:39:17.059 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (82m) 51m ago 82m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:39:17.059 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (74m) 53m ago 82m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:39:17.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (74m) 53m ago 82m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:39:17.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (73m) 53m ago 81m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:39:17.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (73m) 51m ago 81m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:39:17.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (72m) 51m ago 81m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:39:17.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (72m) 51m ago 81m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:39:17.061 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (82m) 53m ago 83m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:39:17.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 msgr2=0x7f6a9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 0x7f6a9c0672e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6aa0004630 tx=0x7f6aa0009b30).stop 2022-02-02T19:39:17.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 msgr2=0x7f6ab01061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f6aac00f940 tx=0x7f6aac009de0).stop 2022-02-02T19:39:17.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 shutdown_connections 2022-02-02T19:39:17.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a9c064e20 0x7f6a9c0672e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ab00f5430 0x7f6ab0105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 --2- 172.21.15.96:0/443513795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ab00f66d0 0x7f6ab01061b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 >> 172.21.15.96:0/443513795 conn(0x7f6ab00f0b90 msgr2=0x7f6ab00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:17.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 shutdown_connections 2022-02-02T19:39:17.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.053+0000 7f6ab6936700 1 -- 172.21.15.96:0/443513795 wait complete. 2022-02-02T19:39:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 -- 172.21.15.96:0/592775003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f7970 msgr2=0x7faa7c0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 --2- 172.21.15.96:0/592775003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f7970 0x7faa7c0f7dd0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7faa78004660 tx=0x7faa78009b30).stop 2022-02-02T19:39:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 -- 172.21.15.96:0/592775003 shutdown_connections 2022-02-02T19:39:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 --2- 172.21.15.96:0/592775003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f7970 0x7faa7c0f7dd0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 --2- 172.21.15.96:0/592775003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f66d0 0x7faa7c0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 -- 172.21.15.96:0/592775003 >> 172.21.15.96:0/592775003 conn(0x7faa7c0f1e50 msgr2=0x7faa7c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 -- 172.21.15.96:0/592775003 shutdown_connections 2022-02-02T19:39:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.150+0000 7faa83727700 1 -- 172.21.15.96:0/592775003 wait complete. 2022-02-02T19:39:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 Processor -- start 2022-02-02T19:39:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 -- start start 2022-02-02T19:39:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f7970 0x7faa7c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c107aa0 con 0x7faa7c0f66d0 2022-02-02T19:39:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa83727700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c108350 con 0x7faa7c0f7970 2022-02-02T19:39:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60962/0 (socket says 172.21.15.96:60962) 2022-02-02T19:39:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 -- 172.21.15.96:0/1759472540 learned_addr learned my addr 172.21.15.96:0/1759472540 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa80cc2700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f7970 0x7faa7c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 -- 172.21.15.96:0/1759472540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f7970 msgr2=0x7faa7c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f7970 0x7faa7c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 -- 172.21.15.96:0/1759472540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78005040 con 0x7faa7c0f66d0 2022-02-02T19:39:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.151+0000 7faa814c3700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7faa6c0093f0 tx=0x7faa6c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.152+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6c013640 con 0x7faa7c0f66d0 2022-02-02T19:39:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.152+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa6c013c50 con 0x7faa7c0f66d0 2022-02-02T19:39:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.152+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c108630 con 0x7faa7c0f66d0 2022-02-02T19:39:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.152+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6c012c70 con 0x7faa7c0f66d0 2022-02-02T19:39:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.152+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c108bf0 con 0x7faa7c0f66d0 2022-02-02T19:39:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.153+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c0f5ac0 con 0x7faa7c0f66d0 2022-02-02T19:39:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.153+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa6c01a060 con 0x7faa7c0f66d0 2022-02-02T19:39:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.154+0000 7faa71ffb700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.154+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa6c081a50 con 0x7faa7c0f66d0 2022-02-02T19:39:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.154+0000 7faa80cc2700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.154+0000 7faa80cc2700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7faa78004630 tx=0x7faa78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.158+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa6c053520 con 0x7faa7c0f66d0 2022-02-02T19:39:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.388+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa7c027a00 con 0x7faa7c0f66d0 2022-02-02T19:39:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.388+0000 7faa71ffb700 1 -- 172.21.15.96:0/1759472540 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faa6c053110 con 0x7faa7c0f66d0 2022-02-02T19:39:17.394 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:39:17.394 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:39:17.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:39:17.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:17.395 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:39:17.395 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:39:17.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:17.396 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:39:17.396 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:39:17.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:17.396 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:39:17.396 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:39:17.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:17.397 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:39:17.397 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:39:17.397 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:39:17.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:39:17.398 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:39:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 msgr2=0x7faa68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7faa78004630 tx=0x7faa78009b30).stop 2022-02-02T19:39:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 msgr2=0x7faa7c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7faa6c0093f0 tx=0x7faa6c006ec0).stop 2022-02-02T19:39:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 shutdown_connections 2022-02-02T19:39:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa7c0f66d0 0x7faa7c106f70 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 --2- 172.21.15.96:0/1759472540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c0f7970 0x7faa7c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 >> 172.21.15.96:0/1759472540 conn(0x7faa7c0f1e50 msgr2=0x7faa7c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 shutdown_connections 2022-02-02T19:39:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.391+0000 7faa83727700 1 -- 172.21.15.96:0/1759472540 wait complete. 2022-02-02T19:39:17.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3030754596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 msgr2=0x7fb8cc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3030754596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc0f5850 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fb8c0004660 tx=0x7fb8c0009b30).stop 2022-02-02T19:39:17.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3030754596 shutdown_connections 2022-02-02T19:39:17.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3030754596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 0x7fb8cc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3030754596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc0f5850 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3030754596 >> 172.21.15.96:0/3030754596 conn(0x7fb8cc0f0b90 msgr2=0x7fb8cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:17.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.488+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3030754596 shutdown_connections 2022-02-02T19:39:17.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.489+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3030754596 wait complete. 2022-02-02T19:39:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.489+0000 7fb8d2f22700 1 Processor -- start 2022-02-02T19:39:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d2f22700 1 -- start start 2022-02-02T19:39:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d2f22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d2f22700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 0x7fb8cc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d2f22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1067d0 con 0x7fb8cc0f5430 2022-02-02T19:39:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d2f22700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc106fd0 con 0x7fb8cc0f66d0 2022-02-02T19:39:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60972/0 (socket says 172.21.15.96:60972) 2022-02-02T19:39:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 -- 172.21.15.96:0/3635688140 learned_addr learned my addr 172.21.15.96:0/3635688140 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d171f700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 0x7fb8cc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 -- 172.21.15.96:0/3635688140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 msgr2=0x7fb8cc106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 0x7fb8cc106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 -- 172.21.15.96:0/3635688140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0005040 con 0x7fb8cc0f5430 2022-02-02T19:39:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.490+0000 7fb8d1f20700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fb8c0013a70 tx=0x7fb8c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.491+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c0018070 con 0x7fb8cc0f5430 2022-02-02T19:39:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.491+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc107250 con 0x7fb8cc0f5430 2022-02-02T19:39:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.491+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8c00097d0 con 0x7fb8cc0f5430 2022-02-02T19:39:17.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.491+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c001de80 con 0x7fb8cc0f5430 2022-02-02T19:39:17.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.491+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc1077b0 con 0x7fb8cc0f5430 2022-02-02T19:39:17.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.492+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc059100 con 0x7fb8cc0f5430 2022-02-02T19:39:17.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.492+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb8c0007ba0 con 0x7fb8cc0f5430 2022-02-02T19:39:17.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.493+0000 7fb8be7fc700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 0x7fb8b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:17.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.493+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb8c0083650 con 0x7fb8cc0f5430 2022-02-02T19:39:17.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.493+0000 7fb8d171f700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 0x7fb8b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:17.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.493+0000 7fb8d171f700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 0x7fb8b80672e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fb8c8004c40 tx=0x7fb8c800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:17.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.497+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb8c0055180 con 0x7fb8cc0f5430 2022-02-02T19:39:17.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.698+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb8cc0fdbf0 con 0x7fb8cc0f5430 2022-02-02T19:39:17.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.698+0000 7fb8be7fc700 1 -- 172.21.15.96:0/3635688140 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb8c0054d70 con 0x7fb8cc0f5430 2022-02-02T19:39:17.703 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:39:17.703 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:39:17.703 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:39:17.704 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:39:17.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:17.706 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:39:17.706 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:39:17.707 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:39:17.707 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:39:17.707 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:39:17.707 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:39:17.708 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:39:17.708 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:39:17.708 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:39:17.708 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:39:17.709 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:39:17.709 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:39:17.709 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:39:17.709 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:39:17.709 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:39:17.710 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:39:17.710 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:39:17.710 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:39:17.710 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:39:17.711 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:39:17.711 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:39:17.711 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:39:17.711 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:39:17.711 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:39:17.712 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:39:17.712 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:39:17.712 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:39:17.712 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:17.712 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:17.713 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:39:17.713 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:17.714 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:17.714 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:17.714 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 msgr2=0x7fb8b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 0x7fb8b80672e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fb8c8004c40 tx=0x7fb8c800b040).stop 2022-02-02T19:39:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 msgr2=0x7fb8cc105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fb8c0013a70 tx=0x7fb8c0009b30).stop 2022-02-02T19:39:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 shutdown_connections 2022-02-02T19:39:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8b8064e20 0x7fb8b80672e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8cc0f5430 0x7fb8cc105d30 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 --2- 172.21.15.96:0/3635688140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8cc0f66d0 0x7fb8cc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 >> 172.21.15.96:0/3635688140 conn(0x7fb8cc0f0b90 msgr2=0x7fb8cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 shutdown_connections 2022-02-02T19:39:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:17.700+0000 7fb8d2f22700 1 -- 172.21.15.96:0/3635688140 wait complete. 2022-02-02T19:39:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:39:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:18 smithi159 ceph-mon[69013]: pgmap v2316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:18 smithi159 ceph-mon[69013]: from='client.36488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:18 smithi159 ceph-mon[69013]: from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:18.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1759472540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:39:18.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3635688140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:39:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:18 smithi096 ceph-mon[101353]: pgmap v2316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:18.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:18 smithi096 ceph-mon[101353]: from='client.36488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:18.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:18 smithi096 ceph-mon[101353]: from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:18.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1759472540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:39:18.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3635688140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:39:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:20 smithi159 ceph-mon[69013]: pgmap v2317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:20.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:20 smithi096 ceph-mon[101353]: pgmap v2317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:22 smithi159 ceph-mon[69013]: pgmap v2318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:22 smithi096 ceph-mon[101353]: pgmap v2318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:24 smithi159 ceph-mon[69013]: pgmap v2319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:24 smithi096 ceph-mon[101353]: pgmap v2319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:26 smithi159 ceph-mon[69013]: pgmap v2320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:26 smithi096 ceph-mon[101353]: pgmap v2320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:28 smithi159 ceph-mon[69013]: pgmap v2321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:39:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:39:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:28 smithi096 ceph-mon[101353]: pgmap v2321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:39:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:39:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:30 smithi159 ceph-mon[69013]: pgmap v2322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:30 smithi096 ceph-mon[101353]: pgmap v2322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:32.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:32 smithi159 ceph-mon[69013]: pgmap v2323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:32.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:32 smithi096 ceph-mon[101353]: pgmap v2323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:34 smithi159 ceph-mon[69013]: pgmap v2324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:34 smithi096 ceph-mon[101353]: pgmap v2324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:36 smithi159 ceph-mon[69013]: pgmap v2325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:36 smithi096 ceph-mon[101353]: pgmap v2325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:38.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:38 smithi159 ceph-mon[69013]: pgmap v2326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:38 smithi096 ceph-mon[101353]: pgmap v2326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:40 smithi159 ceph-mon[69013]: pgmap v2327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:40.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:40 smithi096 ceph-mon[101353]: pgmap v2327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:42 smithi159 ceph-mon[69013]: pgmap v2328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:42 smithi096 ceph-mon[101353]: pgmap v2328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:44.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:44 smithi159 ceph-mon[69013]: pgmap v2329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:44 smithi096 ceph-mon[101353]: pgmap v2329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:46 smithi159 ceph-mon[69013]: pgmap v2330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:46 smithi096 ceph-mon[101353]: pgmap v2330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- 172.21.15.96:0/2990812920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 msgr2=0x7f22a80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2990812920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a80f5850 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f22a4004660 tx=0x7f22a4009b30).stop 2022-02-02T19:39:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- 172.21.15.96:0/2990812920 shutdown_connections 2022-02-02T19:39:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2990812920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 0x7f22a80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2990812920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a80f5850 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- 172.21.15.96:0/2990812920 >> 172.21.15.96:0/2990812920 conn(0x7f22a80f0b90 msgr2=0x7f22a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- 172.21.15.96:0/2990812920 shutdown_connections 2022-02-02T19:39:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- 172.21.15.96:0/2990812920 wait complete. 2022-02-02T19:39:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 Processor -- start 2022-02-02T19:39:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- start start 2022-02-02T19:39:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:47.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 0x7f22a8109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:47.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81099f0 con 0x7f22a80f5430 2022-02-02T19:39:47.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.810+0000 7f22aed7a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8109b30 con 0x7f22a80f66d0 2022-02-02T19:39:47.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:47.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60992/0 (socket says 172.21.15.96:60992) 2022-02-02T19:39:47.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 -- 172.21.15.96:0/2140666592 learned_addr learned my addr 172.21.15.96:0/2140666592 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:47.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22ad577700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 0x7f22a8109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:47.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 -- 172.21.15.96:0/2140666592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 msgr2=0x7f22a8109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:47.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 0x7f22a8109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:47.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 -- 172.21.15.96:0/2140666592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4005040 con 0x7f22a80f5430 2022-02-02T19:39:47.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22add78700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f22a4013a70 tx=0x7f22a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a4018070 con 0x7f22a80f5430 2022-02-02T19:39:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22a40097d0 con 0x7f22a80f5430 2022-02-02T19:39:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a401c3c0 con 0x7f22a80f5430 2022-02-02T19:39:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a810a470 con 0x7f22a80f5430 2022-02-02T19:39:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.811+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a810a9d0 con 0x7f22a80f5430 2022-02-02T19:39:47.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.813+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a8045ad0 con 0x7f22a80f5430 2022-02-02T19:39:47.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.813+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22a4007ba0 con 0x7f22a80f5430 2022-02-02T19:39:47.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.813+0000 7f229e7fc700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 0x7f22940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:47.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.813+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22a4083640 con 0x7f22a80f5430 2022-02-02T19:39:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.813+0000 7f22ad577700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 0x7f22940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.814+0000 7f22ad577700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 0x7f22940672e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f2298009740 tx=0x7f2298009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:47.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.818+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22a4055230 con 0x7f22a80f5430 2022-02-02T19:39:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.996+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22a80fa910 con 0x7f2294064e20 2022-02-02T19:39:48.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.998+0000 7f229e7fc700 1 -- 172.21.15.96:0/2140666592 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f22a80fa910 con 0x7f2294064e20 2022-02-02T19:39:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 msgr2=0x7f22940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 0x7f22940672e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f2298009740 tx=0x7f2298009c60).stop 2022-02-02T19:39:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 msgr2=0x7f22a8108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f22a4013a70 tx=0x7f22a4009b30).stop 2022-02-02T19:39:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 shutdown_connections 2022-02-02T19:39:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2294064e20 0x7f22940672e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a80f5430 0x7f22a8108f50 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 --2- 172.21.15.96:0/2140666592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22a80f66d0 0x7f22a8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:47.999+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 >> 172.21.15.96:0/2140666592 conn(0x7f22a80f0b90 msgr2=0x7f22a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.000+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 shutdown_connections 2022-02-02T19:39:48.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.000+0000 7f22aed7a700 1 -- 172.21.15.96:0/2140666592 wait complete. 2022-02-02T19:39:48.014 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:39:48.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 -- 172.21.15.96:0/769520865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f6860 msgr2=0x7f59480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 --2- 172.21.15.96:0/769520865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f6860 0x7f59480f6cc0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f5944004660 tx=0x7f5944009b30).stop 2022-02-02T19:39:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 -- 172.21.15.96:0/769520865 shutdown_connections 2022-02-02T19:39:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 --2- 172.21.15.96:0/769520865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f6860 0x7f59480f6cc0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 --2- 172.21.15.96:0/769520865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59480f55c0 0x7f59480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 -- 172.21.15.96:0/769520865 >> 172.21.15.96:0/769520865 conn(0x7f59480f0d40 msgr2=0x7f59480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 -- 172.21.15.96:0/769520865 shutdown_connections 2022-02-02T19:39:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.096+0000 7f594f48f700 1 -- 172.21.15.96:0/769520865 wait complete. 2022-02-02T19:39:48.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 Processor -- start 2022-02-02T19:39:48.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 -- start start 2022-02-02T19:39:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59480602d0 0x7f594810c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594810c8e0 con 0x7f59480f55c0 2022-02-02T19:39:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.097+0000 7f594f48f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594810ca20 con 0x7f59480602d0 2022-02-02T19:39:48.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32768/0 (socket says 172.21.15.96:32768) 2022-02-02T19:39:48.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 -- 172.21.15.96:0/3807255803 learned_addr learned my addr 172.21.15.96:0/3807255803 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:48.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 -- 172.21.15.96:0/3807255803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59480602d0 msgr2=0x7f594810c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59480602d0 0x7f594810c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 -- 172.21.15.96:0/3807255803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944005040 con 0x7f59480f55c0 2022-02-02T19:39:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594d22b700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f59380093f0 tx=0x7f5938006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5938009ea0 con 0x7f59480f55c0 2022-02-02T19:39:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594810cd00 con 0x7f59480f55c0 2022-02-02T19:39:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5938013af0 con 0x7f59480f55c0 2022-02-02T19:39:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.098+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593800db10 con 0x7f59480f55c0 2022-02-02T19:39:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.099+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594810d2c0 con 0x7f59480f55c0 2022-02-02T19:39:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.100+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5948045ad0 con 0x7f59480f55c0 2022-02-02T19:39:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.101+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f593801a060 con 0x7f59480f55c0 2022-02-02T19:39:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.101+0000 7f593dffb700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 0x7f5934067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.101+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5938081a80 con 0x7f59480f55c0 2022-02-02T19:39:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.101+0000 7f594ca2a700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 0x7f5934067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.101+0000 7f594ca2a700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 0x7f5934067290 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f5944009040 tx=0x7f5944009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.106+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f593804fc30 con 0x7f59480f55c0 2022-02-02T19:39:48.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.279+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5948057f10 con 0x7f5934064dd0 2022-02-02T19:39:48.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.288+0000 7f593dffb700 1 -- 172.21.15.96:0/3807255803 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5948057f10 con 0x7f5934064dd0 2022-02-02T19:39:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:39:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (83m) 53m ago 84m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:39:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (75m) 53m ago 84m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:39:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (75m) 52m ago 83m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:39:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (83m) 53m ago 84m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:39:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (80m) 53m ago 80m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:39:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (75m) 53m ago 80m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:39:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (80m) 52m ago 80m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:39:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (76m) 52m ago 80m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:39:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (77m) 53m ago 85m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:39:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (76m) 52m ago 83m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:39:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (76m) 53m ago 85m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:39:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (76m) 52m ago 83m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:39:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (83m) 53m ago 83m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:39:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (83m) 52m ago 83m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:39:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (75m) 53m ago 83m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:39:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (74m) 53m ago 82m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:39:48.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (74m) 53m ago 82m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:39:48.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (73m) 52m ago 82m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:39:48.300 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (73m) 52m ago 81m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:39:48.301 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (72m) 52m ago 81m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:39:48.301 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (82m) 53m ago 83m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:39:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 msgr2=0x7f5934067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 0x7f5934067290 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f5944009040 tx=0x7f5944009b30).stop 2022-02-02T19:39:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 msgr2=0x7f5948109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f59380093f0 tx=0x7f5938006ec0).stop 2022-02-02T19:39:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 shutdown_connections 2022-02-02T19:39:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064dd0 0x7f5934067290 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59480f55c0 0x7f5948109df0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 --2- 172.21.15.96:0/3807255803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59480602d0 0x7f594810c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 >> 172.21.15.96:0/3807255803 conn(0x7f59480f0d40 msgr2=0x7f59480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 shutdown_connections 2022-02-02T19:39:48.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.291+0000 7f594f48f700 1 -- 172.21.15.96:0/3807255803 wait complete. 2022-02-02T19:39:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 -- 172.21.15.96:0/1965372102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f7980 msgr2=0x7f66d00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 --2- 172.21.15.96:0/1965372102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f7980 0x7f66d00f7de0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f66c0004660 tx=0x7f66c0009b30).stop 2022-02-02T19:39:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 -- 172.21.15.96:0/1965372102 shutdown_connections 2022-02-02T19:39:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 --2- 172.21.15.96:0/1965372102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f7980 0x7f66d00f7de0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 --2- 172.21.15.96:0/1965372102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f66e0 0x7f66d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 -- 172.21.15.96:0/1965372102 >> 172.21.15.96:0/1965372102 conn(0x7f66d00f1e40 msgr2=0x7f66d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.393 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:48 smithi096 ceph-mon[101353]: pgmap v2331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 -- 172.21.15.96:0/1965372102 shutdown_connections 2022-02-02T19:39:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.386+0000 7f66d4935700 1 -- 172.21.15.96:0/1965372102 wait complete. 2022-02-02T19:39:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 Processor -- start 2022-02-02T19:39:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 -- start start 2022-02-02T19:39:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f7980 0x7f66d0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d0107a00 con 0x7f66d00f66e0 2022-02-02T19:39:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66d4935700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d0107b40 con 0x7f66d00f7980 2022-02-02T19:39:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66ce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66ce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32778/0 (socket says 172.21.15.96:32778) 2022-02-02T19:39:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66ce59c700 1 -- 172.21.15.96:0/3307376944 learned_addr learned my addr 172.21.15.96:0/3307376944 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.387+0000 7f66cdd9b700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f7980 0x7f66d0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66ce59c700 1 -- 172.21.15.96:0/3307376944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f7980 msgr2=0x7f66d0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66ce59c700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f7980 0x7f66d0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66ce59c700 1 -- 172.21.15.96:0/3307376944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0005040 con 0x7f66d00f66e0 2022-02-02T19:39:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66ce59c700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f66c400c530 tx=0x7f66c4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c400f650 con 0x7f66d00f66e0 2022-02-02T19:39:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d01084e0 con 0x7f66d00f66e0 2022-02-02T19:39:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f66c400fc60 con 0x7f66d00f66e0 2022-02-02T19:39:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c4012d20 con 0x7f66d00f66e0 2022-02-02T19:39:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.388+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d0108aa0 con 0x7f66d00f66e0 2022-02-02T19:39:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.389+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0045ad0 con 0x7f66d00f66e0 2022-02-02T19:39:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.389+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f66c4019030 con 0x7f66d00f66e0 2022-02-02T19:39:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.390+0000 7f66beffd700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 0x7f66b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.390+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f66c4081710 con 0x7f66d00f66e0 2022-02-02T19:39:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.390+0000 7f66cdd9b700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 0x7f66b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.390+0000 7f66cdd9b700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 0x7f66b8067290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f66c0004e30 tx=0x7f66c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.395+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f66c4053290 con 0x7f66d00f66e0 2022-02-02T19:39:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:48 smithi159 ceph-mon[69013]: pgmap v2331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:48.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.631+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f66d00fefa0 con 0x7f66d00f66e0 2022-02-02T19:39:48.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.632+0000 7f66beffd700 1 -- 172.21.15.96:0/3307376944 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f66c4052e80 con 0x7f66d00f66e0 2022-02-02T19:39:48.636 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:39:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:39:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:39:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:39:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:39:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:39:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:39:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:39:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:39:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:39:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:39:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:39:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:39:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:39:48.641 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:39:48.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 msgr2=0x7f66b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 0x7f66b8067290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f66c0004e30 tx=0x7f66c0009b30).stop 2022-02-02T19:39:48.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 msgr2=0x7f66d0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f66c400c530 tx=0x7f66c4007e10).stop 2022-02-02T19:39:48.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 shutdown_connections 2022-02-02T19:39:48.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66b8064dd0 0x7f66b8067290 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66d00f66e0 0x7f66d0106f60 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 --2- 172.21.15.96:0/3307376944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66d00f7980 0x7f66d0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 >> 172.21.15.96:0/3307376944 conn(0x7f66d00f1e40 msgr2=0x7f66d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 shutdown_connections 2022-02-02T19:39:48.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.634+0000 7f66d4935700 1 -- 172.21.15.96:0/3307376944 wait complete. 2022-02-02T19:39:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.730+0000 7f6581df0700 1 -- 172.21.15.96:0/2406044139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 msgr2=0x7f657c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.730+0000 7f6581df0700 1 --2- 172.21.15.96:0/2406044139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c0f7de0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f656c004660 tx=0x7f656c009b30).stop 2022-02-02T19:39:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 -- 172.21.15.96:0/2406044139 shutdown_connections 2022-02-02T19:39:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 --2- 172.21.15.96:0/2406044139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c0f7de0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 --2- 172.21.15.96:0/2406044139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 0x7f657c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:39:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 -- 172.21.15.96:0/2406044139 >> 172.21.15.96:0/2406044139 conn(0x7f657c0f1e40 msgr2=0x7f657c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 -- 172.21.15.96:0/2406044139 shutdown_connections 2022-02-02T19:39:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 -- 172.21.15.96:0/2406044139 wait complete. 2022-02-02T19:39:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.731+0000 7f6581df0700 1 Processor -- start 2022-02-02T19:39:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f6581df0700 1 -- start start 2022-02-02T19:39:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f6581df0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 0x7f657c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f6581df0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f6581df0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c06a410 con 0x7f657c0f7980 2022-02-02T19:39:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f6581df0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c06a550 con 0x7f657c0f66e0 2022-02-02T19:39:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32790/0 (socket says 172.21.15.96:32790) 2022-02-02T19:39:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 -- 172.21.15.96:0/1235509746 learned_addr learned my addr 172.21.15.96:0/1235509746 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:39:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657b7fe700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 0x7f657c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 -- 172.21.15.96:0/1235509746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 msgr2=0x7f657c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 0x7f657c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.732+0000 7f657affd700 1 -- 172.21.15.96:0/1235509746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c005040 con 0x7f657c0f7980 2022-02-02T19:39:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f657affd700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f656c009990 tx=0x7f656c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656c018070 con 0x7f657c0f7980 2022-02-02T19:39:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c06a7d0 con 0x7f657c0f7980 2022-02-02T19:39:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f656c007ba0 con 0x7f657c0f7980 2022-02-02T19:39:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656c01c620 con 0x7f657c0f7980 2022-02-02T19:39:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.733+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c10efe0 con 0x7f657c0f7980 2022-02-02T19:39:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.734+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c045ad0 con 0x7f657c0f7980 2022-02-02T19:39:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.734+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f656c01c8e0 con 0x7f657c0f7980 2022-02-02T19:39:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.735+0000 7f6563fff700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 0x7f6564067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:39:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.735+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f656c083850 con 0x7f657c0f7980 2022-02-02T19:39:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.735+0000 7f657b7fe700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 0x7f6564067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:39:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.735+0000 7f657b7fe700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 0x7f6564067290 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f657c06b730 tx=0x7f6570008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:39:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.739+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f656c051950 con 0x7f657c0f7980 2022-02-02T19:39:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.940+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f657c0008d0 con 0x7f657c0f7980 2022-02-02T19:39:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.941+0000 7f6563fff700 1 -- 172.21.15.96:0/1235509746 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f656c054f70 con 0x7f657c0f7980 2022-02-02T19:39:48.945 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:39:48.946 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:39:48.946 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:39:48.946 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:39:48.946 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:48.947 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:39:48.947 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:39:48.947 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:39:48.947 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:39:48.948 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:39:48.948 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:39:48.949 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:39:48.949 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:39:48.950 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:39:48.950 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:39:48.950 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:39:48.951 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:39:48.951 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:39:48.951 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:39:48.951 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:39:48.952 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:39:48.952 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:39:48.952 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:39:48.952 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:39:48.952 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:39:48.953 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:39:48.953 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:39:48.953 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:39:48.953 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:39:48.954 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:39:48.954 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:39:48.954 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:39:48.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:48.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:48.955 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:39:48.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:39:48.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:48.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:48.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:39:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 msgr2=0x7f6564067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 0x7f6564067290 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f657c06b730 tx=0x7f6570008040).stop 2022-02-02T19:39:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 msgr2=0x7f657c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:39:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f656c009990 tx=0x7f656c009b30).stop 2022-02-02T19:39:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 shutdown_connections 2022-02-02T19:39:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6564064dd0 0x7f6564067290 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c0f66e0 0x7f657c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.942+0000 7f6581df0700 1 --2- 172.21.15.96:0/1235509746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f657c0f7980 0x7f657c069e20 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:39:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.943+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 >> 172.21.15.96:0/1235509746 conn(0x7f657c0f1e40 msgr2=0x7f657c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:39:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.943+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 shutdown_connections 2022-02-02T19:39:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:39:48.943+0000 7f6581df0700 1 -- 172.21.15.96:0/1235509746 wait complete. 2022-02-02T19:39:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:39:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:49 smithi159 ceph-mon[69013]: from='client.36504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3307376944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:39:49.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1235509746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:39:49.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:49 smithi096 ceph-mon[101353]: from='client.36504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3307376944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:39:49.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1235509746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:39:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:50 smithi159 ceph-mon[69013]: pgmap v2332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:50 smithi159 ceph-mon[69013]: from='client.36508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:50 smithi096 ceph-mon[101353]: pgmap v2332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:50 smithi096 ceph-mon[101353]: from='client.36508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:39:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:52 smithi159 ceph-mon[69013]: pgmap v2333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:52 smithi096 ceph-mon[101353]: pgmap v2333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:54 smithi159 ceph-mon[69013]: pgmap v2334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:54 smithi096 ceph-mon[101353]: pgmap v2334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:56 smithi159 ceph-mon[69013]: pgmap v2335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:56 smithi096 ceph-mon[101353]: pgmap v2335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:58 smithi159 ceph-mon[69013]: pgmap v2336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:58 smithi096 ceph-mon[101353]: pgmap v2336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:59.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:39:59 smithi159 ceph-mon[69013]: pgmap v2337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:39:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:39:59 smithi096 ceph-mon[101353]: pgmap v2337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:40:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:40:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:02 smithi159 ceph-mon[69013]: pgmap v2338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:02 smithi096 ceph-mon[101353]: pgmap v2338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:04 smithi159 ceph-mon[69013]: pgmap v2339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:04 smithi096 ceph-mon[101353]: pgmap v2339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:06 smithi159 ceph-mon[69013]: pgmap v2340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:06 smithi096 ceph-mon[101353]: pgmap v2340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:08 smithi159 ceph-mon[69013]: pgmap v2341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:08 smithi096 ceph-mon[101353]: pgmap v2341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:10.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:10 smithi159 ceph-mon[69013]: pgmap v2342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:10 smithi096 ceph-mon[101353]: pgmap v2342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:12.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:12 smithi159 ceph-mon[69013]: pgmap v2343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:12 smithi096 ceph-mon[101353]: pgmap v2343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:14.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:14 smithi159 ceph-mon[69013]: pgmap v2344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:14 smithi096 ceph-mon[101353]: pgmap v2344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:16 smithi159 ceph-mon[69013]: pgmap v2345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:16 smithi096 ceph-mon[101353]: pgmap v2345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:18 smithi159 ceph-mon[69013]: pgmap v2346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:18.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:18 smithi096 ceph-mon[101353]: pgmap v2346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- 172.21.15.96:0/3362535278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 msgr2=0x7fe5040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3362535278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe5040f6cc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fe4f4004660 tx=0x7fe4f4009b30).stop 2022-02-02T19:40:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- 172.21.15.96:0/3362535278 shutdown_connections 2022-02-02T19:40:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3362535278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe5040f6cc0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3362535278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 0x7fe5040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- 172.21.15.96:0/3362535278 >> 172.21.15.96:0/3362535278 conn(0x7fe5040f0d40 msgr2=0x7fe5040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- 172.21.15.96:0/3362535278 shutdown_connections 2022-02-02T19:40:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- 172.21.15.96:0/3362535278 wait complete. 2022-02-02T19:40:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 Processor -- start 2022-02-02T19:40:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.054+0000 7fe508c3f700 1 -- start start 2022-02-02T19:40:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 0x7fe504106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504107a10 con 0x7fe5040f6860 2022-02-02T19:40:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504107b50 con 0x7fe5040f55c0 2022-02-02T19:40:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32810/0 (socket says 172.21.15.96:32810) 2022-02-02T19:40:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 -- 172.21.15.96:0/3846735481 learned_addr learned my addr 172.21.15.96:0/3846735481 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe50259c700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 0x7fe504106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 -- 172.21.15.96:0/3846735481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 msgr2=0x7fe504106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 0x7fe504106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 -- 172.21.15.96:0/3846735481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4005040 con 0x7fe5040f6860 2022-02-02T19:40:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe501d9b700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fe4f4009990 tx=0x7fe4f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f4018070 con 0x7fe5040f6860 2022-02-02T19:40:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe504108490 con 0x7fe5040f6860 2022-02-02T19:40:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5041089f0 con 0x7fe5040f6860 2022-02-02T19:40:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4f4007ba0 con 0x7fe5040f6860 2022-02-02T19:40:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.055+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f401c620 con 0x7fe5040f6860 2022-02-02T19:40:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.056+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504045ad0 con 0x7fe5040f6860 2022-02-02T19:40:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.057+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe4f401c8e0 con 0x7fe5040f6860 2022-02-02T19:40:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.057+0000 7fe4f2ffd700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 0x7fe4ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.057+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe4f40838a0 con 0x7fe5040f6860 2022-02-02T19:40:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.057+0000 7fe50259c700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 0x7fe4ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.058+0000 7fe50259c700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 0x7fe4ec067290 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe5040f66c0 tx=0x7fe4f8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.062+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe4f4055490 con 0x7fe5040f6860 2022-02-02T19:40:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.242+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe50405fd30 con 0x7fe4ec064dd0 2022-02-02T19:40:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.243+0000 7fe4f2ffd700 1 -- 172.21.15.96:0/3846735481 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe50405fd30 con 0x7fe4ec064dd0 2022-02-02T19:40:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 msgr2=0x7fe4ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 0x7fe4ec067290 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe5040f66c0 tx=0x7fe4f8009040).stop 2022-02-02T19:40:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 msgr2=0x7fe504107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fe4f4009990 tx=0x7fe4f4009b30).stop 2022-02-02T19:40:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 shutdown_connections 2022-02-02T19:40:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4ec064dd0 0x7fe4ec067290 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5040f55c0 0x7fe504106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 --2- 172.21.15.96:0/3846735481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5040f6860 0x7fe504107460 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 >> 172.21.15.96:0/3846735481 conn(0x7fe5040f0d40 msgr2=0x7fe50405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 shutdown_connections 2022-02-02T19:40:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.245+0000 7fe508c3f700 1 -- 172.21.15.96:0/3846735481 wait complete. 2022-02-02T19:40:19.260 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:40:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- 172.21.15.96:0/1435857809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f6860 msgr2=0x7f7b8c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1435857809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f6860 0x7f7b8c0f6cc0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f7b7c004660 tx=0x7f7b7c009b30).stop 2022-02-02T19:40:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- 172.21.15.96:0/1435857809 shutdown_connections 2022-02-02T19:40:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1435857809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f6860 0x7f7b8c0f6cc0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1435857809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- 172.21.15.96:0/1435857809 >> 172.21.15.96:0/1435857809 conn(0x7f7b8c0f0d40 msgr2=0x7f7b8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- 172.21.15.96:0/1435857809 shutdown_connections 2022-02-02T19:40:19.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- 172.21.15.96:0/1435857809 wait complete. 2022-02-02T19:40:19.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 Processor -- start 2022-02-02T19:40:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.343+0000 7f7b90dad700 1 -- start start 2022-02-02T19:40:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b90dad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b90dad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b8c0f6860 0x7f7b8c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b90dad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0602b0 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b90dad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0603f0 con 0x7f7b8c0f6860 2022-02-02T19:40:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32818/0 (socket says 172.21.15.96:32818) 2022-02-02T19:40:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 -- 172.21.15.96:0/1754977268 learned_addr learned my addr 172.21.15.96:0/1754977268 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:19.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 -- 172.21.15.96:0/1754977268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b8c0f6860 msgr2=0x7f7b8c10e570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T19:40:19.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b8c0f6860 0x7f7b8c10e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:40:19.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 -- 172.21.15.96:0/1754977268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c005040 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b8a59c700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f7b74002700 tx=0x7f7b74009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.344+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b74009320 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.345+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c10ea60 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.345+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b7400f040 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.345+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b74014900 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.345+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c10eee0 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.346+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c045ad0 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.348+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b74009480 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.349+0000 7f7b82ffd700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 0x7f7b78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.349+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b74081e60 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.349+0000 7f7b89d9b700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 0x7f7b78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.349+0000 7f7b89d9b700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 0x7f7b78067290 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7b7c004e30 tx=0x7f7b7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.352+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b7404fea0 con 0x7f7b8c0f55c0 2022-02-02T19:40:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.524+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b8c057f10 con 0x7f7b78064dd0 2022-02-02T19:40:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.533+0000 7f7b82ffd700 1 -- 172.21.15.96:0/1754977268 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7b8c057f10 con 0x7f7b78064dd0 2022-02-02T19:40:19.539 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:40:19.539 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (83m) 54m ago 84m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:40:19.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (76m) 54m ago 84m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:40:19.540 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (76m) 52m ago 84m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:40:19.540 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (83m) 54m ago 84m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:40:19.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (80m) 54m ago 80m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:40:19.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (76m) 54m ago 80m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:40:19.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (80m) 52m ago 80m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:40:19.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (76m) 52m ago 80m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:40:19.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (77m) 54m ago 85m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:40:19.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (77m) 52m ago 84m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:40:19.542 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (76m) 54m ago 85m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:40:19.542 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (76m) 52m ago 84m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:40:19.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (84m) 54m ago 84m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:40:19.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (84m) 52m ago 84m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:40:19.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (75m) 54m ago 83m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:40:19.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (75m) 54m ago 83m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:40:19.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (74m) 54m ago 82m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:40:19.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (74m) 52m ago 82m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:40:19.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (73m) 52m ago 82m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:40:19.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (73m) 52m ago 82m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:40:19.544 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (83m) 54m ago 84m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:40:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 msgr2=0x7f7b78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 0x7f7b78067290 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7b7c004e30 tx=0x7f7b7c009b30).stop 2022-02-02T19:40:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 msgr2=0x7f7b8c10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f7b74002700 tx=0x7f7b74009d80).stop 2022-02-02T19:40:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 shutdown_connections 2022-02-02T19:40:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b78064dd0 0x7f7b78067290 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b8c0f55c0 0x7f7b8c10c070 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 --2- 172.21.15.96:0/1754977268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b8c0f6860 0x7f7b8c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:40:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 >> 172.21.15.96:0/1754977268 conn(0x7f7b8c0f0d40 msgr2=0x7f7b8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 shutdown_connections 2022-02-02T19:40:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.535+0000 7f7b90dad700 1 -- 172.21.15.96:0/1754977268 wait complete. 2022-02-02T19:40:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 -- 172.21.15.96:0/4132239799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f77d0 msgr2=0x7fe6040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 --2- 172.21.15.96:0/4132239799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f77d0 0x7fe6040f7c30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fe5f4004660 tx=0x7fe5f4009b30).stop 2022-02-02T19:40:19.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 -- 172.21.15.96:0/4132239799 shutdown_connections 2022-02-02T19:40:19.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 --2- 172.21.15.96:0/4132239799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f77d0 0x7fe6040f7c30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 --2- 172.21.15.96:0/4132239799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f6530 0x7fe6040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 -- 172.21.15.96:0/4132239799 >> 172.21.15.96:0/4132239799 conn(0x7fe6040f1c90 msgr2=0x7fe6040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 -- 172.21.15.96:0/4132239799 shutdown_connections 2022-02-02T19:40:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.631+0000 7fe608f3a700 1 -- 172.21.15.96:0/4132239799 wait complete. 2022-02-02T19:40:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 Processor -- start 2022-02-02T19:40:19.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 -- start start 2022-02-02T19:40:19.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f77d0 0x7fe604069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60406a380 con 0x7fe6040f6530 2022-02-02T19:40:19.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe608f3a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60406a4c0 con 0x7fe6040f77d0 2022-02-02T19:40:19.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.632+0000 7fe6037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32828/0 (socket says 172.21.15.96:32828) 2022-02-02T19:40:19.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 -- 172.21.15.96:0/2955913554 learned_addr learned my addr 172.21.15.96:0/2955913554 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:19.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe602ffd700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f77d0 0x7fe604069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 -- 172.21.15.96:0/2955913554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f77d0 msgr2=0x7fe604069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f77d0 0x7fe604069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 -- 172.21.15.96:0/2955913554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4005040 con 0x7fe6040f6530 2022-02-02T19:40:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe6037fe700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe5ec002700 tx=0x7fe5ec009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec0079c0 con 0x7fe6040f6530 2022-02-02T19:40:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60406a7a0 con 0x7fe6040f6530 2022-02-02T19:40:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe5ec00f040 con 0x7fe6040f6530 2022-02-02T19:40:19.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60410ed80 con 0x7fe6040f6530 2022-02-02T19:40:19.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.633+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec0147e0 con 0x7fe6040f6530 2022-02-02T19:40:19.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.634+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe604045ad0 con 0x7fe6040f6530 2022-02-02T19:40:19.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.635+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe5ec01b060 con 0x7fe6040f6530 2022-02-02T19:40:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.635+0000 7fe5fbfff700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 0x7fe5f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.635+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5ec081830 con 0x7fe6040f6530 2022-02-02T19:40:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.635+0000 7fe602ffd700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 0x7fe5f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.635+0000 7fe602ffd700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 0x7fe5f00672e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fe5f4004630 tx=0x7fe5f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.639+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe5ec04fa10 con 0x7fe6040f6530 2022-02-02T19:40:19.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.867+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe604027a00 con 0x7fe6040f6530 2022-02-02T19:40:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.867+0000 7fe5fbfff700 1 -- 172.21.15.96:0/2955913554 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe5ec0192e0 con 0x7fe6040f6530 2022-02-02T19:40:19.873 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:40:19.874 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:40:19.874 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:40:19.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:19.875 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:40:19.875 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:40:19.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:19.875 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:40:19.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:40:19.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:19.876 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:40:19.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:40:19.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:19.877 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:40:19.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:40:19.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:40:19.877 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:40:19.878 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:40:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 msgr2=0x7fe5f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 0x7fe5f00672e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fe5f4004630 tx=0x7fe5f4009b30).stop 2022-02-02T19:40:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 msgr2=0x7fe60406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe5ec002700 tx=0x7fe5ec009d60).stop 2022-02-02T19:40:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 shutdown_connections 2022-02-02T19:40:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5f0064e20 0x7fe5f00672e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6040f6530 0x7fe60406b9a0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 --2- 172.21.15.96:0/2955913554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6040f77d0 0x7fe604069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 >> 172.21.15.96:0/2955913554 conn(0x7fe6040f1c90 msgr2=0x7fe6040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.869+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 shutdown_connections 2022-02-02T19:40:19.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.870+0000 7fe608f3a700 1 -- 172.21.15.96:0/2955913554 wait complete. 2022-02-02T19:40:19.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 -- 172.21.15.96:0/3369084272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5ef0 msgr2=0x7fcd8c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/3369084272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c0f6920 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fcd7c004660 tx=0x7fcd7c009b30).stop 2022-02-02T19:40:19.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 -- 172.21.15.96:0/3369084272 shutdown_connections 2022-02-02T19:40:19.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/3369084272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c0f6920 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/3369084272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 -- 172.21.15.96:0/3369084272 >> 172.21.15.96:0/3369084272 conn(0x7fcd8c0f0de0 msgr2=0x7fcd8c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:19.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 -- 172.21.15.96:0/3369084272 shutdown_connections 2022-02-02T19:40:19.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.967+0000 7fcd91cd7700 1 -- 172.21.15.96:0/3369084272 wait complete. 2022-02-02T19:40:19.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 Processor -- start 2022-02-02T19:40:19.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 -- start start 2022-02-02T19:40:19.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c106950 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd91cd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c107160 con 0x7fcd8c0f5ef0 2022-02-02T19:40:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.968+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32838/0 (socket says 172.21.15.96:32838) 2022-02-02T19:40:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 -- 172.21.15.96:0/2819961782 learned_addr learned my addr 172.21.15.96:0/2819961782 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8affd700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 -- 172.21.15.96:0/2819961782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5ef0 msgr2=0x7fcd8c106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:19.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:19.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 -- 172.21.15.96:0/2819961782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c005040 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd8b7fe700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fcd74002700 tx=0x7fcd74009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd74009320 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd7400f040 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c1073e0 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c1079a0 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.969+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd74014870 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.970+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70004fa0 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.971+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd74009480 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.971+0000 7fcd83fff700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 0x7fcd78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:19.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.971+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd74081c80 con 0x7fcd8c0f55e0 2022-02-02T19:40:19.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.971+0000 7fcd8affd700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 0x7fcd78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:19.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.972+0000 7fcd8affd700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 0x7fcd78067290 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fcd7c004630 tx=0x7fcd7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:19.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:19.975+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd7404fd80 con 0x7fcd8c0f55e0 2022-02-02T19:40:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.176+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd70005e80 con 0x7fcd8c0f55e0 2022-02-02T19:40:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.176+0000 7fcd83fff700 1 -- 172.21.15.96:0/2819961782 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcd740533a0 con 0x7fcd8c0f55e0 2022-02-02T19:40:20.182 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:40:20.182 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:40:20.182 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:40:20.183 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:40:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:20.183 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:40:20.183 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:40:20.184 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:40:20.184 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:40:20.184 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:40:20.185 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:40:20.185 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:40:20.185 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:40:20.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:40:20.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:40:20.186 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:40:20.186 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:40:20.186 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:40:20.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:40:20.187 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:40:20.187 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:40:20.188 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:40:20.188 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:40:20.188 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:40:20.188 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:40:20.188 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:40:20.189 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:40:20.189 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:40:20.189 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:40:20.189 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:40:20.190 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:40:20.190 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:40:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:20.190 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:40:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:20.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:20.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:20.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 msgr2=0x7fcd78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 0x7fcd78067290 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fcd7c004630 tx=0x7fcd7c009b30).stop 2022-02-02T19:40:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 msgr2=0x7fcd8c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fcd74002700 tx=0x7fcd74009e00).stop 2022-02-02T19:40:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 shutdown_connections 2022-02-02T19:40:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd78064dd0 0x7fcd78067290 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd8c0f55e0 0x7fcd8c105e60 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 --2- 172.21.15.96:0/2819961782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd8c0f5ef0 0x7fcd8c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 >> 172.21.15.96:0/2819961782 conn(0x7fcd8c0f0de0 msgr2=0x7fcd8c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.178+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 shutdown_connections 2022-02-02T19:40:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:20.179+0000 7fcd91cd7700 1 -- 172.21.15.96:0/2819961782 wait complete. 2022-02-02T19:40:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:40:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:20 smithi096 ceph-mon[101353]: pgmap v2347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2955913554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:40:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:20 smithi159 ceph-mon[69013]: pgmap v2347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:20.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2955913554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:40:21.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:21 smithi159 ceph-mon[69013]: from='client.36520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:21.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:21 smithi159 ceph-mon[69013]: from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:21.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2819961782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:40:21.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:21 smithi096 ceph-mon[101353]: from='client.36520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:21.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:21 smithi096 ceph-mon[101353]: from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:21.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2819961782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:40:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:22 smithi159 ceph-mon[69013]: pgmap v2348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:22 smithi096 ceph-mon[101353]: pgmap v2348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:24 smithi159 ceph-mon[69013]: pgmap v2349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:24 smithi096 ceph-mon[101353]: pgmap v2349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:26 smithi159 ceph-mon[69013]: pgmap v2350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:26 smithi096 ceph-mon[101353]: pgmap v2350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:28 smithi159 ceph-mon[69013]: pgmap v2351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:40:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:40:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:28 smithi096 ceph-mon[101353]: pgmap v2351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:40:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:40:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:30 smithi159 ceph-mon[69013]: pgmap v2352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:30 smithi096 ceph-mon[101353]: pgmap v2352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:32 smithi159 ceph-mon[69013]: pgmap v2353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:32 smithi096 ceph-mon[101353]: pgmap v2353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:34 smithi159 ceph-mon[69013]: pgmap v2354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:34 smithi096 ceph-mon[101353]: pgmap v2354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:36.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:36 smithi159 ceph-mon[69013]: pgmap v2355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:36 smithi096 ceph-mon[101353]: pgmap v2355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:38 smithi159 ceph-mon[69013]: pgmap v2356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:38 smithi096 ceph-mon[101353]: pgmap v2356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:40 smithi159 ceph-mon[69013]: pgmap v2357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:40 smithi096 ceph-mon[101353]: pgmap v2357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:42 smithi159 ceph-mon[69013]: pgmap v2358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:42.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:42 smithi096 ceph-mon[101353]: pgmap v2358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:44 smithi159 ceph-mon[69013]: pgmap v2359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:44 smithi096 ceph-mon[101353]: pgmap v2359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:46.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:46 smithi159 ceph-mon[69013]: pgmap v2360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:46 smithi096 ceph-mon[101353]: pgmap v2360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:47.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:47 smithi159 ceph-mon[69013]: pgmap v2361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:47.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:47 smithi096 ceph-mon[101353]: pgmap v2361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:49.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:49 smithi159 ceph-mon[69013]: pgmap v2362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:49.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:49 smithi096 ceph-mon[101353]: pgmap v2362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 -- 172.21.15.96:0/2661673051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f55c0 msgr2=0x7f6a780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/2661673051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f55c0 0x7f6a780f59e0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f6a6c004660 tx=0x7f6a6c009b30).stop 2022-02-02T19:40:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 -- 172.21.15.96:0/2661673051 shutdown_connections 2022-02-02T19:40:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/2661673051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f6860 0x7f6a780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/2661673051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f55c0 0x7f6a780f59e0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 -- 172.21.15.96:0/2661673051 >> 172.21.15.96:0/2661673051 conn(0x7f6a780f0d40 msgr2=0x7f6a780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 -- 172.21.15.96:0/2661673051 shutdown_connections 2022-02-02T19:40:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.290+0000 7f6a7fd44700 1 -- 172.21.15.96:0/2661673051 wait complete. 2022-02-02T19:40:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 Processor -- start 2022-02-02T19:40:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 -- start start 2022-02-02T19:40:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f55c0 0x7f6a78109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780603e0 con 0x7f6a780f6860 2022-02-02T19:40:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.291+0000 7f6a7fd44700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78060520 con 0x7f6a780f55c0 2022-02-02T19:40:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32858/0 (socket says 172.21.15.96:32858) 2022-02-02T19:40:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 -- 172.21.15.96:0/3651189487 learned_addr learned my addr 172.21.15.96:0/3651189487 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7dae0700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f55c0 0x7f6a78109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 -- 172.21.15.96:0/3651189487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f55c0 msgr2=0x7f6a78109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f55c0 0x7f6a78109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 -- 172.21.15.96:0/3651189487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c005040 con 0x7f6a780f6860 2022-02-02T19:40:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7d2df700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f6a7400e7f0 tx=0x7f6a7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a740092e0 con 0x7f6a780f6860 2022-02-02T19:40:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7810c6a0 con 0x7f6a780f6860 2022-02-02T19:40:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a7400f040 con 0x7f6a780f6860 2022-02-02T19:40:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.292+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a74014750 con 0x7f6a780f6860 2022-02-02T19:40:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.293+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7810cc60 con 0x7f6a780f6860 2022-02-02T19:40:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.294+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a7401b030 con 0x7f6a780f6860 2022-02-02T19:40:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.294+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a78045ad0 con 0x7f6a780f6860 2022-02-02T19:40:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.294+0000 7f6a6a7fc700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 0x7f6a64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.294+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6a740819d0 con 0x7f6a780f6860 2022-02-02T19:40:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.294+0000 7f6a7dae0700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 0x7f6a64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.295+0000 7f6a7dae0700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 0x7f6a64067290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f6a6c000c00 tx=0x7f6a6c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.298+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a7404fab0 con 0x7f6a780f6860 2022-02-02T19:40:50.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.479+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a780fdf30 con 0x7f6a64064dd0 2022-02-02T19:40:50.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.480+0000 7f6a6a7fc700 1 -- 172.21.15.96:0/3651189487 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6a6c01a040 con 0x7f6a64064dd0 2022-02-02T19:40:50.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 msgr2=0x7f6a64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 0x7f6a64067290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f6a6c000c00 tx=0x7f6a6c00b040).stop 2022-02-02T19:40:50.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 msgr2=0x7f6a7810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f6a7400e7f0 tx=0x7f6a7400b040).stop 2022-02-02T19:40:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 shutdown_connections 2022-02-02T19:40:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a64064dd0 0x7f6a64067290 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a780f55c0 0x7f6a78109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 --2- 172.21.15.96:0/3651189487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a780f6860 0x7f6a7810c0f0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 >> 172.21.15.96:0/3651189487 conn(0x7f6a780f0d40 msgr2=0x7f6a780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 shutdown_connections 2022-02-02T19:40:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.482+0000 7f6a7fd44700 1 -- 172.21.15.96:0/3651189487 wait complete. 2022-02-02T19:40:50.496 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:40:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 -- 172.21.15.96:0/3950981317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 msgr2=0x7ff6480fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 --2- 172.21.15.96:0/3950981317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff6480fbb00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7ff638004660 tx=0x7ff638009b30).stop 2022-02-02T19:40:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 -- 172.21.15.96:0/3950981317 shutdown_connections 2022-02-02T19:40:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 --2- 172.21.15.96:0/3950981317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff6480fbb00 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 --2- 172.21.15.96:0/3950981317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 0x7ff6480f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.579+0000 7ff64e361700 1 -- 172.21.15.96:0/3950981317 >> 172.21.15.96:0/3950981317 conn(0x7ff6480f0b90 msgr2=0x7ff6480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.580+0000 7ff64e361700 1 -- 172.21.15.96:0/3950981317 shutdown_connections 2022-02-02T19:40:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.580+0000 7ff64e361700 1 -- 172.21.15.96:0/3950981317 wait complete. 2022-02-02T19:40:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.580+0000 7ff64e361700 1 Processor -- start 2022-02-02T19:40:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.580+0000 7ff64e361700 1 -- start start 2022-02-02T19:40:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64e361700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 0x7ff648106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64e361700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64e361700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648107890 con 0x7ff6480f9710 2022-02-02T19:40:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64e361700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481080d0 con 0x7ff648060290 2022-02-02T19:40:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32866/0 (socket says 172.21.15.96:32866) 2022-02-02T19:40:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 -- 172.21.15.96:0/1613889247 learned_addr learned my addr 172.21.15.96:0/1613889247 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64d35f700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 0x7ff648106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 -- 172.21.15.96:0/1613889247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 msgr2=0x7ff648106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 0x7ff648106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 -- 172.21.15.96:0/1613889247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638005040 con 0x7ff6480f9710 2022-02-02T19:40:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64cb5e700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7ff638004f60 tx=0x7ff638009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff638018070 con 0x7ff6480f9710 2022-02-02T19:40:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff638007ba0 con 0x7ff6480f9710 2022-02-02T19:40:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff648108350 con 0x7ff6480f9710 2022-02-02T19:40:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.581+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63801c620 con 0x7ff6480f9710 2022-02-02T19:40:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.582+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff648108830 con 0x7ff6480f9710 2022-02-02T19:40:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.582+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff648059100 con 0x7ff6480f9710 2022-02-02T19:40:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.583+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff63801c8e0 con 0x7ff6480f9710 2022-02-02T19:40:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.583+0000 7ff63dffb700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 0x7ff6340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.583+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff638083940 con 0x7ff6480f9710 2022-02-02T19:40:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.583+0000 7ff64d35f700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 0x7ff6340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.584+0000 7ff64d35f700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 0x7ff6340672e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7ff644007fd0 tx=0x7ff644009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.588+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff638051a40 con 0x7ff6480f9710 2022-02-02T19:40:50.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.759+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6480fede0 con 0x7ff634064e20 2022-02-02T19:40:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.768+0000 7ff63dffb700 1 -- 172.21.15.96:0/1613889247 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff6480fede0 con 0x7ff634064e20 2022-02-02T19:40:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:40:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (84m) 54m ago 85m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:40:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (76m) 54m ago 85m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:40:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (76m) 53m ago 84m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:40:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (84m) 54m ago 85m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:40:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (81m) 54m ago 81m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:40:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (76m) 54m ago 81m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:40:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (81m) 53m ago 81m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:40:50.775 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (77m) 53m ago 81m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:40:50.775 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (78m) 54m ago 86m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:40:50.775 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (77m) 53m ago 84m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:40:50.775 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (77m) 54m ago 86m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:40:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (77m) 53m ago 84m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:40:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (85m) 54m ago 85m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:40:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (84m) 53m ago 84m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:40:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (76m) 54m ago 84m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:40:50.777 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (75m) 54m ago 83m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:40:50.777 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (75m) 54m ago 83m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:40:50.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (74m) 53m ago 83m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:40:50.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (74m) 53m ago 82m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:40:50.778 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (73m) 53m ago 82m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:40:50.778 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (83m) 54m ago 84m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:40:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 msgr2=0x7ff6340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 0x7ff6340672e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7ff644007fd0 tx=0x7ff644009040).stop 2022-02-02T19:40:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 msgr2=0x7ff648107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7ff638004f60 tx=0x7ff638009b30).stop 2022-02-02T19:40:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 shutdown_connections 2022-02-02T19:40:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff634064e20 0x7ff6340672e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff648060290 0x7ff648106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 --2- 172.21.15.96:0/1613889247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6480f9710 0x7ff648107290 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 >> 172.21.15.96:0/1613889247 conn(0x7ff6480f0b90 msgr2=0x7ff6480f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 shutdown_connections 2022-02-02T19:40:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.770+0000 7ff64e361700 1 -- 172.21.15.96:0/1613889247 wait complete. 2022-02-02T19:40:50.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 -- 172.21.15.96:0/3179318978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66e0 msgr2=0x7fd7140f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 --2- 172.21.15.96:0/3179318978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66e0 0x7fd7140f6b40 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd704004660 tx=0x7fd704009b30).stop 2022-02-02T19:40:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 -- 172.21.15.96:0/3179318978 shutdown_connections 2022-02-02T19:40:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 --2- 172.21.15.96:0/3179318978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66e0 0x7fd7140f6b40 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 --2- 172.21.15.96:0/3179318978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5440 0x7fd7140f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 -- 172.21.15.96:0/3179318978 >> 172.21.15.96:0/3179318978 conn(0x7fd7140f0ba0 msgr2=0x7fd7140f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.866+0000 7fd713fff700 1 -- 172.21.15.96:0/3179318978 shutdown_connections 2022-02-02T19:40:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.867+0000 7fd713fff700 1 -- 172.21.15.96:0/3179318978 wait complete. 2022-02-02T19:40:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.867+0000 7fd713fff700 1 Processor -- start 2022-02-02T19:40:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.867+0000 7fd713fff700 1 -- start start 2022-02-02T19:40:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd713fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd713fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f66e0 0x7fd714107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd713fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714107880 con 0x7fd7140f5440 2022-02-02T19:40:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd713fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714108090 con 0x7fd7140f66e0 2022-02-02T19:40:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32874/0 (socket says 172.21.15.96:32874) 2022-02-02T19:40:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 -- 172.21.15.96:0/427009574 learned_addr learned my addr 172.21.15.96:0/427009574 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd7127fc700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f66e0 0x7fd714107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 -- 172.21.15.96:0/427009574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f66e0 msgr2=0x7fd714107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f66e0 0x7fd714107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.868+0000 7fd712ffd700 1 -- 172.21.15.96:0/427009574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd7140f5440 2022-02-02T19:40:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd712ffd700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd70800c790 tx=0x7fd708007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd708013630 con 0x7fd7140f5440 2022-02-02T19:40:50.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd714108310 con 0x7fd7140f5440 2022-02-02T19:40:50.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd708012860 con 0x7fd7140f5440 2022-02-02T19:40:50.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd708002780 con 0x7fd7140f5440 2022-02-02T19:40:50.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.869+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7141088d0 con 0x7fd7140f5440 2022-02-02T19:40:50.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.870+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd714059100 con 0x7fd7140f5440 2022-02-02T19:40:50.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.870+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd708010070 con 0x7fd7140f5440 2022-02-02T19:40:50.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.871+0000 7fd6fb7fe700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 0x7fd6fc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:50.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.871+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd708081b30 con 0x7fd7140f5440 2022-02-02T19:40:50.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.873+0000 7fd7127fc700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 0x7fd6fc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:50.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.873+0000 7fd7127fc700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 0x7fd6fc0672e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fd704004630 tx=0x7fd704009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:50.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:50.875+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd70804fc30 con 0x7fd7140f5440 2022-02-02T19:40:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.108+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd714108f10 con 0x7fd7140f5440 2022-02-02T19:40:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.108+0000 7fd6fb7fe700 1 -- 172.21.15.96:0/427009574 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd708053250 con 0x7fd7140f5440 2022-02-02T19:40:51.113 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:40:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:40:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:40:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:40:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:40:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:40:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:40:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:40:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:40:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:40:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:40:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:40:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:40:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:40:51.119 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:40:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 msgr2=0x7fd6fc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 0x7fd6fc0672e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fd704004630 tx=0x7fd704009b30).stop 2022-02-02T19:40:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 msgr2=0x7fd714106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd70800c790 tx=0x7fd708007d90).stop 2022-02-02T19:40:51.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 shutdown_connections 2022-02-02T19:40:51.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6fc064e20 0x7fd6fc0672e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f5440 0x7fd714106d90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 --2- 172.21.15.96:0/427009574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f66e0 0x7fd714107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 >> 172.21.15.96:0/427009574 conn(0x7fd7140f0ba0 msgr2=0x7fd71405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:51.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 shutdown_connections 2022-02-02T19:40:51.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.110+0000 7fd713fff700 1 -- 172.21.15.96:0/427009574 wait complete. 2022-02-02T19:40:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- 172.21.15.96:0/467694164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 msgr2=0x7fa7180f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 --2- 172.21.15.96:0/467694164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180f5db0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fa708004660 tx=0x7fa708009b30).stop 2022-02-02T19:40:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- 172.21.15.96:0/467694164 shutdown_connections 2022-02-02T19:40:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 --2- 172.21.15.96:0/467694164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180f5db0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 --2- 172.21.15.96:0/467694164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 0x7fa7180f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- 172.21.15.96:0/467694164 >> 172.21.15.96:0/467694164 conn(0x7fa7180f04c0 msgr2=0x7fa7180f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- 172.21.15.96:0/467694164 shutdown_connections 2022-02-02T19:40:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- 172.21.15.96:0/467694164 wait complete. 2022-02-02T19:40:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 Processor -- start 2022-02-02T19:40:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- start start 2022-02-02T19:40:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 0x7fa7180fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180ff510 con 0x7fa7180f5930 2022-02-02T19:40:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.208+0000 7fa720577700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180ff650 con 0x7fa7180f6be0 2022-02-02T19:40:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32884/0 (socket says 172.21.15.96:32884) 2022-02-02T19:40:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 -- 172.21.15.96:0/1931623316 learned_addr learned my addr 172.21.15.96:0/1931623316 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:40:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71db12700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 0x7fa7180fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 -- 172.21.15.96:0/1931623316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 msgr2=0x7fa7180fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 0x7fa7180fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 -- 172.21.15.96:0/1931623316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708005040 con 0x7fa7180f5930 2022-02-02T19:40:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa71e313700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fa714002700 tx=0x7fa714009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140079c0 con 0x7fa7180f5930 2022-02-02T19:40:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa71400f040 con 0x7fa7180f5930 2022-02-02T19:40:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7180fffc0 con 0x7fa7180f5930 2022-02-02T19:40:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.209+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa714014850 con 0x7fa7180f5930 2022-02-02T19:40:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.210+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa718100580 con 0x7fa7180f5930 2022-02-02T19:40:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.210+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa718045ad0 con 0x7fa7180f5930 2022-02-02T19:40:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.211+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa71401b060 con 0x7fa7180f5930 2022-02-02T19:40:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.211+0000 7fa70effd700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:40:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.212+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa7140817e0 con 0x7fa7180f5930 2022-02-02T19:40:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.212+0000 7fa71db12700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:40:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.212+0000 7fa71db12700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 0x7fa704067290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fa708004630 tx=0x7fa708009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:40:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.216+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa71404f8e0 con 0x7fa7180f5930 2022-02-02T19:40:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.412+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa718102210 con 0x7fa7180f5930 2022-02-02T19:40:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.413+0000 7fa70effd700 1 -- 172.21.15.96:0/1931623316 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa714052f00 con 0x7fa7180f5930 2022-02-02T19:40:51.418 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:40:51.418 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:40:51.418 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:40:51.419 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:40:51.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:51.419 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:40:51.420 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:40:51.420 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:40:51.420 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:40:51.421 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:40:51.421 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:40:51.421 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:40:51.421 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:40:51.422 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:40:51.422 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:40:51.422 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:40:51.422 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:40:51.422 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:40:51.423 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:40:51.423 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:40:51.423 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:40:51.423 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:40:51.424 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:40:51.424 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:40:51.424 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:40:51.424 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:40:51.424 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:40:51.425 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:40:51.425 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:40:51.425 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:40:51.425 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:40:51.426 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:40:51.426 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:51.426 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:51.426 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:40:51.426 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:40:51.427 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:51.427 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:51.427 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:40:51.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 msgr2=0x7fa704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 0x7fa704067290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fa708004630 tx=0x7fa708009b30).stop 2022-02-02T19:40:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 msgr2=0x7fa7180fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:40:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fa714002700 tx=0x7fa714009e00).stop 2022-02-02T19:40:51.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 shutdown_connections 2022-02-02T19:40:51.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7180f5930 0x7fa7180fea20 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 --2- 172.21.15.96:0/1931623316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7180f6be0 0x7fa7180fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:40:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 >> 172.21.15.96:0/1931623316 conn(0x7fa7180f04c0 msgr2=0x7fa7180f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:40:51.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 shutdown_connections 2022-02-02T19:40:51.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:40:51.414+0000 7fa720577700 1 -- 172.21.15.96:0/1931623316 wait complete. 2022-02-02T19:40:51.432 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:40:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:52 smithi159 ceph-mon[69013]: pgmap v2363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:52 smithi159 ceph-mon[69013]: from='client.36536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:52 smithi159 ceph-mon[69013]: from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/427009574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:40:52.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1931623316' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:40:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:52 smithi096 ceph-mon[101353]: pgmap v2363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:52 smithi096 ceph-mon[101353]: from='client.36536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:52 smithi096 ceph-mon[101353]: from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:40:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/427009574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:40:52.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1931623316' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:40:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:54 smithi159 ceph-mon[69013]: pgmap v2364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:54 smithi096 ceph-mon[101353]: pgmap v2364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:56 smithi159 ceph-mon[69013]: pgmap v2365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:56 smithi096 ceph-mon[101353]: pgmap v2365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:40:58 smithi159 ceph-mon[69013]: pgmap v2366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:40:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:40:58 smithi096 ceph-mon[101353]: pgmap v2366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:00 smithi159 ceph-mon[69013]: pgmap v2367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:00 smithi096 ceph-mon[101353]: pgmap v2367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:02 smithi159 ceph-mon[69013]: pgmap v2368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:02 smithi096 ceph-mon[101353]: pgmap v2368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:04 smithi159 ceph-mon[69013]: pgmap v2369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:04 smithi096 ceph-mon[101353]: pgmap v2369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:06 smithi159 ceph-mon[69013]: pgmap v2370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:06 smithi096 ceph-mon[101353]: pgmap v2370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:08 smithi159 ceph-mon[69013]: pgmap v2371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:08 smithi096 ceph-mon[101353]: pgmap v2371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:10 smithi159 ceph-mon[69013]: pgmap v2372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:10 smithi096 ceph-mon[101353]: pgmap v2372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:12 smithi159 ceph-mon[69013]: pgmap v2373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:12 smithi096 ceph-mon[101353]: pgmap v2373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:14 smithi159 ceph-mon[69013]: pgmap v2374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:14 smithi096 ceph-mon[101353]: pgmap v2374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:16 smithi159 ceph-mon[69013]: pgmap v2375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:16 smithi096 ceph-mon[101353]: pgmap v2375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:18 smithi159 ceph-mon[69013]: pgmap v2376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:18 smithi096 ceph-mon[101353]: pgmap v2376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:20 smithi159 ceph-mon[69013]: pgmap v2377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:20 smithi096 ceph-mon[101353]: pgmap v2377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:21.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 -- 172.21.15.96:0/3298051424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f66d0 msgr2=0x7f738c0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 --2- 172.21.15.96:0/3298051424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f66d0 0x7f738c0f6af0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f737c004660 tx=0x7f737c009b30).stop 2022-02-02T19:41:21.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 -- 172.21.15.96:0/3298051424 shutdown_connections 2022-02-02T19:41:21.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 --2- 172.21.15.96:0/3298051424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f7970 0x7f738c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:41:21.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 --2- 172.21.15.96:0/3298051424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f66d0 0x7f738c0f6af0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 -- 172.21.15.96:0/3298051424 >> 172.21.15.96:0/3298051424 conn(0x7f738c0f1e50 msgr2=0x7f738c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:21.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.524+0000 7f7391479700 1 -- 172.21.15.96:0/3298051424 shutdown_connections 2022-02-02T19:41:21.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.525+0000 7f7391479700 1 -- 172.21.15.96:0/3298051424 wait complete. 2022-02-02T19:41:21.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 Processor -- start 2022-02-02T19:41:21.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 -- start start 2022-02-02T19:41:21.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f66d0 0x7f738c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c107ac0 con 0x7f738c0f7970 2022-02-02T19:41:21.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f7391479700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c108370 con 0x7f738c0f66d0 2022-02-02T19:41:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f738a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f738a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32904/0 (socket says 172.21.15.96:32904) 2022-02-02T19:41:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f738a7fc700 1 -- 172.21.15.96:0/3918914679 learned_addr learned my addr 172.21.15.96:0/3918914679 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.526+0000 7f738affd700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f66d0 0x7f738c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f738a7fc700 1 -- 172.21.15.96:0/3918914679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f66d0 msgr2=0x7f738c106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f738a7fc700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f66d0 0x7f738c106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f738a7fc700 1 -- 172.21.15.96:0/3918914679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c005040 con 0x7f738c0f7970 2022-02-02T19:41:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f738a7fc700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f737400b410 tx=0x7f7374006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73740125f0 con 0x7f738c0f7970 2022-02-02T19:41:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f737400be30 con 0x7f738c0f7970 2022-02-02T19:41:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c108650 con 0x7f738c0f7970 2022-02-02T19:41:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7374002a70 con 0x7f738c0f7970 2022-02-02T19:41:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.527+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c108c10 con 0x7f738c0f7970 2022-02-02T19:41:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.528+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0f5ac0 con 0x7f738c0f7970 2022-02-02T19:41:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.528+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f737400f030 con 0x7f738c0f7970 2022-02-02T19:41:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.529+0000 7f73837fe700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.529+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7374081e60 con 0x7f738c0f7970 2022-02-02T19:41:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.529+0000 7f738affd700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.529+0000 7f738affd700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f737c004630 tx=0x7f737c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.533+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7374053990 con 0x7f738c0f7970 2022-02-02T19:41:21.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.709+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f738c0fef80 con 0x7f7378064dd0 2022-02-02T19:41:21.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.710+0000 7f73837fe700 1 -- 172.21.15.96:0/3918914679 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f738c0fef80 con 0x7f7378064dd0 2022-02-02T19:41:21.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 msgr2=0x7f7378067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f737c004630 tx=0x7f737c009b30).stop 2022-02-02T19:41:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 msgr2=0x7f738c107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f737400b410 tx=0x7f7374006ef0).stop 2022-02-02T19:41:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 shutdown_connections 2022-02-02T19:41:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f738c0f66d0 0x7f738c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 --2- 172.21.15.96:0/3918914679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f738c0f7970 0x7f738c107480 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 >> 172.21.15.96:0/3918914679 conn(0x7f738c0f1e50 msgr2=0x7f738c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 shutdown_connections 2022-02-02T19:41:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.712+0000 7f7391479700 1 -- 172.21.15.96:0/3918914679 wait complete. 2022-02-02T19:41:21.726 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:41:21.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/168037939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 msgr2=0x7f4fd80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/168037939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd80f7a20 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f4fc8004660 tx=0x7f4fc8009b30).stop 2022-02-02T19:41:21.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/168037939 shutdown_connections 2022-02-02T19:41:21.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/168037939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd80f7a20 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/168037939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 0x7f4fd80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/168037939 >> 172.21.15.96:0/168037939 conn(0x7f4fd80f1f00 msgr2=0x7f4fd80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:21.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/168037939 shutdown_connections 2022-02-02T19:41:21.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/168037939 wait complete. 2022-02-02T19:41:21.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 Processor -- start 2022-02-02T19:41:21.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- start start 2022-02-02T19:41:21.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 0x7f4fd8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8107a20 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.810+0000 7f4fdf6b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8107b60 con 0x7f4fd80f66e0 2022-02-02T19:41:21.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32914/0 (socket says 172.21.15.96:32914) 2022-02-02T19:41:21.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 -- 172.21.15.96:0/1085450791 learned_addr learned my addr 172.21.15.96:0/1085450791 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:21.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdd44f700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 0x7f4fd8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 -- 172.21.15.96:0/1085450791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 msgr2=0x7f4fd8106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:21.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 0x7f4fd8106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:21.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 -- 172.21.15.96:0/1085450791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8005040 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdcc4e700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f4fc8009990 tx=0x7f4fc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:21.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc8018070 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fc8007ba0 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd81084a0 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc801c3c0 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.811+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd8108a00 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.813+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8045ad0 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.813+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4fc801d420 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.813+0000 7f4fcdffb700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 0x7f4fc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:21.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.813+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4fc80836b0 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.813+0000 7f4fdd44f700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 0x7f4fc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:21.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.814+0000 7f4fdd44f700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 0x7f4fc4067290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4fd4004c40 tx=0x7f4fd400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:21.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.817+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4fc8055240 con 0x7f4fd80f6ff0 2022-02-02T19:41:21.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.989+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fd80fefe0 con 0x7f4fc4064dd0 2022-02-02T19:41:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:21.998+0000 7f4fcdffb700 1 -- 172.21.15.96:0/1085450791 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4fd80fefe0 con 0x7f4fc4064dd0 2022-02-02T19:41:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:41:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (84m) 55m ago 85m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:41:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (77m) 55m ago 85m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:41:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (77m) 53m ago 85m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:41:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (84m) 55m ago 85m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:41:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (81m) 55m ago 81m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:41:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (77m) 55m ago 81m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:41:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (81m) 53m ago 81m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:41:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (77m) 53m ago 81m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:41:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (78m) 55m ago 86m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:41:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (78m) 53m ago 85m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:41:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (78m) 55m ago 87m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:41:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (77m) 53m ago 85m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:41:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (85m) 55m ago 85m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:41:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (85m) 53m ago 85m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:41:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (76m) 55m ago 84m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:41:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (76m) 55m ago 84m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:41:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (75m) 55m ago 83m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:41:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (75m) 53m ago 83m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:41:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (74m) 53m ago 83m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:41:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (74m) 53m ago 83m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:41:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (84m) 55m ago 85m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:41:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 msgr2=0x7f4fc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 0x7f4fc4067290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4fd4004c40 tx=0x7f4fd400b040).stop 2022-02-02T19:41:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 msgr2=0x7f4fd8107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f4fc8009990 tx=0x7f4fc8009b30).stop 2022-02-02T19:41:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 shutdown_connections 2022-02-02T19:41:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4fc4064dd0 0x7f4fc4067290 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd80f66e0 0x7f4fd8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 --2- 172.21.15.96:0/1085450791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fd80f6ff0 0x7f4fd8107470 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.000+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 >> 172.21.15.96:0/1085450791 conn(0x7f4fd80f1f00 msgr2=0x7f4fd80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.001+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 shutdown_connections 2022-02-02T19:41:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.001+0000 7f4fdf6b3700 1 -- 172.21.15.96:0/1085450791 wait complete. 2022-02-02T19:41:22.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 -- 172.21.15.96:0/1276981452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0602b0 msgr2=0x7f363c0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 --2- 172.21.15.96:0/1276981452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0602b0 0x7f363c0f9170 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f3638004660 tx=0x7f3638009b30).stop 2022-02-02T19:41:22.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 -- 172.21.15.96:0/1276981452 shutdown_connections 2022-02-02T19:41:22.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 --2- 172.21.15.96:0/1276981452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0f96f0 0x7f363c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:41:22.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 --2- 172.21.15.96:0/1276981452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0602b0 0x7f363c0f9170 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.096+0000 7f36426c7700 1 -- 172.21.15.96:0/1276981452 >> 172.21.15.96:0/1276981452 conn(0x7f363c0f0b90 msgr2=0x7f363c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:22.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.097+0000 7f36426c7700 1 -- 172.21.15.96:0/1276981452 shutdown_connections 2022-02-02T19:41:22.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.097+0000 7f36426c7700 1 -- 172.21.15.96:0/1276981452 wait complete. 2022-02-02T19:41:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.097+0000 7f36426c7700 1 Processor -- start 2022-02-02T19:41:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.097+0000 7f36426c7700 1 -- start start 2022-02-02T19:41:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.097+0000 7f36426c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 0x7f363c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36426c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36426c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c107930 con 0x7f363c0f96f0 2022-02-02T19:41:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36426c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1080e0 con 0x7f363c0602b0 2022-02-02T19:41:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32924/0 (socket says 172.21.15.96:32924) 2022-02-02T19:41:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 -- 172.21.15.96:0/1880880731 learned_addr learned my addr 172.21.15.96:0/1880880731 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36416c5700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 0x7f363c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 -- 172.21.15.96:0/1880880731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 msgr2=0x7f363c106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 0x7f363c106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 -- 172.21.15.96:0/1880880731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638005040 con 0x7f363c0f96f0 2022-02-02T19:41:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36416c5700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 0x7f363c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:41:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3640ec4700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f362c0093f0 tx=0x7f362c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c009ea0 con 0x7f363c0f96f0 2022-02-02T19:41:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f362c013af0 con 0x7f363c0f96f0 2022-02-02T19:41:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c1083c0 con 0x7f363c0f96f0 2022-02-02T19:41:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.098+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c00db10 con 0x7f363c0f96f0 2022-02-02T19:41:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.099+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c108980 con 0x7f363c0f96f0 2022-02-02T19:41:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.099+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c059100 con 0x7f363c0f96f0 2022-02-02T19:41:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.100+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f362c01a060 con 0x7f363c0f96f0 2022-02-02T19:41:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.100+0000 7f3631ffb700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 0x7f36280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.100+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f362c081a10 con 0x7f363c0f96f0 2022-02-02T19:41:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.100+0000 7f36416c5700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 0x7f36280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.101+0000 7f36416c5700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 0x7f36280672e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f3638004e30 tx=0x7f3638009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.104+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f362c04fab0 con 0x7f363c0f96f0 2022-02-02T19:41:22.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.336+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f363c0fee30 con 0x7f363c0f96f0 2022-02-02T19:41:22.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.337+0000 7f3631ffb700 1 -- 172.21.15.96:0/1880880731 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f362c0530d0 con 0x7f363c0f96f0 2022-02-02T19:41:22.341 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:41:22.342 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:41:22.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:41:22.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:22.343 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:41:22.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:41:22.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:22.344 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:41:22.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:41:22.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:22.344 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:41:22.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:41:22.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:22.345 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:41:22.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:41:22.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:41:22.346 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:41:22.346 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:41:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 msgr2=0x7f36280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 0x7f36280672e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f3638004e30 tx=0x7f3638009b30).stop 2022-02-02T19:41:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 msgr2=0x7f363c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f362c0093f0 tx=0x7f362c006ec0).stop 2022-02-02T19:41:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 shutdown_connections 2022-02-02T19:41:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3628064e20 0x7f36280672e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f363c0602b0 0x7f363c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 --2- 172.21.15.96:0/1880880731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f363c0f96f0 0x7f363c1072a0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.339+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 >> 172.21.15.96:0/1880880731 conn(0x7f363c0f0b90 msgr2=0x7f363c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.340+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 shutdown_connections 2022-02-02T19:41:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.340+0000 7f36426c7700 1 -- 172.21.15.96:0/1880880731 wait complete. 2022-02-02T19:41:22.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 -- 172.21.15.96:0/4125474427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f77d0 msgr2=0x7f10d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 --2- 172.21.15.96:0/4125474427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f77d0 0x7f10d00f7c30 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f10c4004660 tx=0x7f10c4009b30).stop 2022-02-02T19:41:22.442 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:22 smithi096 ceph-mon[101353]: pgmap v2378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 -- 172.21.15.96:0/4125474427 shutdown_connections 2022-02-02T19:41:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 --2- 172.21.15.96:0/4125474427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f77d0 0x7f10d00f7c30 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 --2- 172.21.15.96:0/4125474427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f6530 0x7f10d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 -- 172.21.15.96:0/4125474427 >> 172.21.15.96:0/4125474427 conn(0x7f10d00f1c90 msgr2=0x7f10d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.437+0000 7f10cffff700 1 -- 172.21.15.96:0/4125474427 shutdown_connections 2022-02-02T19:41:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.438+0000 7f10cffff700 1 -- 172.21.15.96:0/4125474427 wait complete. 2022-02-02T19:41:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.438+0000 7f10cffff700 1 Processor -- start 2022-02-02T19:41:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.438+0000 7f10cffff700 1 -- start start 2022-02-02T19:41:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10cffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f77d0 0x7f10d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10cffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d006a380 con 0x7f10d00f6530 2022-02-02T19:41:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10cffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d006a4c0 con 0x7f10d00f77d0 2022-02-02T19:41:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32932/0 (socket says 172.21.15.96:32932) 2022-02-02T19:41:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 -- 172.21.15.96:0/3287840278 learned_addr learned my addr 172.21.15.96:0/3287840278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ce7fc700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f77d0 0x7f10d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 -- 172.21.15.96:0/3287840278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f77d0 msgr2=0x7f10d0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f77d0 0x7f10d0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 -- 172.21.15.96:0/3287840278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4005040 con 0x7f10d00f6530 2022-02-02T19:41:22.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10ceffd700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f10c0002700 tx=0x7f10c0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:22.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.439+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c00079c0 con 0x7f10d00f6530 2022-02-02T19:41:22.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.440+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f10c000f040 con 0x7f10d00f6530 2022-02-02T19:41:22.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.440+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d006a7a0 con 0x7f10d00f6530 2022-02-02T19:41:22.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.440+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c0014860 con 0x7f10d00f6530 2022-02-02T19:41:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.440+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d010ed50 con 0x7f10d00f6530 2022-02-02T19:41:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.441+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0045ad0 con 0x7f10d00f6530 2022-02-02T19:41:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.441+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f10c001b060 con 0x7f10d00f6530 2022-02-02T19:41:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.442+0000 7f10b77fe700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 0x7f10b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.442+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10c0081900 con 0x7f10d00f6530 2022-02-02T19:41:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.442+0000 7f10ce7fc700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 0x7f10b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.442+0000 7f10ce7fc700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 0x7f10b80672e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f10c4004630 tx=0x7f10c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.446+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10c004fa00 con 0x7f10d00f6530 2022-02-02T19:41:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:22 smithi159 ceph-mon[69013]: pgmap v2378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.648+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f10d00fedc0 con 0x7f10d00f6530 2022-02-02T19:41:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.648+0000 7f10b77fe700 1 -- 172.21.15.96:0/3287840278 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f10c0019070 con 0x7f10d00f6530 2022-02-02T19:41:22.652 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:41:22.653 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:41:22.653 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:41:22.654 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:41:22.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:22.654 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:41:22.654 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:41:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:41:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:41:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:41:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:41:22.656 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:41:22.656 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:41:22.656 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:41:22.656 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:41:22.656 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:41:22.657 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:41:22.657 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:41:22.657 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:41:22.657 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:41:22.660 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:41:22.660 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:41:22.660 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:22.660 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:22.661 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:41:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:22.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:22.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:22.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 msgr2=0x7f10b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 0x7f10b80672e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f10c4004630 tx=0x7f10c4009b30).stop 2022-02-02T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 msgr2=0x7f10d006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f10c0002700 tx=0x7f10c0009d80).stop 2022-02-02T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 shutdown_connections 2022-02-02T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b8064e20 0x7f10b80672e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d00f6530 0x7f10d006b9a0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 --2- 172.21.15.96:0/3287840278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10d00f77d0 0x7f10d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 >> 172.21.15.96:0/3287840278 conn(0x7f10d00f1c90 msgr2=0x7f10d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 shutdown_connections 2022-02-02T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:22.650+0000 7f10cffff700 1 -- 172.21.15.96:0/3287840278 wait complete. 2022-02-02T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:41:23.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:23 smithi159 ceph-mon[69013]: from='client.36552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:23 smithi159 ceph-mon[69013]: from='client.36556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1880880731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:41:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3287840278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:41:23.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:23 smithi096 ceph-mon[101353]: from='client.36552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:23.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:23 smithi096 ceph-mon[101353]: from='client.36556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:23.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1880880731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:41:23.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3287840278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:41:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:24 smithi159 ceph-mon[69013]: pgmap v2379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:24 smithi096 ceph-mon[101353]: pgmap v2379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:26 smithi159 ceph-mon[69013]: pgmap v2380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:26 smithi096 ceph-mon[101353]: pgmap v2380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:28 smithi159 ceph-mon[69013]: pgmap v2381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:41:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:41:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:28 smithi096 ceph-mon[101353]: pgmap v2381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:41:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:41:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:30 smithi159 ceph-mon[69013]: pgmap v2382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:30 smithi096 ceph-mon[101353]: pgmap v2382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:32 smithi159 ceph-mon[69013]: pgmap v2383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:32 smithi096 ceph-mon[101353]: pgmap v2383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:34 smithi159 ceph-mon[69013]: pgmap v2384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:34 smithi096 ceph-mon[101353]: pgmap v2384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:36 smithi159 ceph-mon[69013]: pgmap v2385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:36 smithi096 ceph-mon[101353]: pgmap v2385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:38 smithi159 ceph-mon[69013]: pgmap v2386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:38 smithi096 ceph-mon[101353]: pgmap v2386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:40 smithi159 ceph-mon[69013]: pgmap v2387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:40 smithi096 ceph-mon[101353]: pgmap v2387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:42 smithi159 ceph-mon[69013]: pgmap v2388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:42 smithi096 ceph-mon[101353]: pgmap v2388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:44 smithi159 ceph-mon[69013]: pgmap v2389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:44 smithi096 ceph-mon[101353]: pgmap v2389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:46 smithi159 ceph-mon[69013]: pgmap v2390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:46 smithi096 ceph-mon[101353]: pgmap v2390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:48 smithi159 ceph-mon[69013]: pgmap v2391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:48 smithi096 ceph-mon[101353]: pgmap v2391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:50 smithi159 ceph-mon[69013]: pgmap v2392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:50 smithi096 ceph-mon[101353]: pgmap v2392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:52 smithi159 ceph-mon[69013]: pgmap v2393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:52 smithi096 ceph-mon[101353]: pgmap v2393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 -- 172.21.15.96:0/55844649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 msgr2=0x7f10900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 --2- 172.21.15.96:0/55844649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f10900f6cc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f108c004660 tx=0x7f108c009b30).stop 2022-02-02T19:41:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 -- 172.21.15.96:0/55844649 shutdown_connections 2022-02-02T19:41:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 --2- 172.21.15.96:0/55844649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f10900f6cc0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 --2- 172.21.15.96:0/55844649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 0x7f10900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 -- 172.21.15.96:0/55844649 >> 172.21.15.96:0/55844649 conn(0x7f10900f0d40 msgr2=0x7f10900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 -- 172.21.15.96:0/55844649 shutdown_connections 2022-02-02T19:41:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.758+0000 7f1097dd1700 1 -- 172.21.15.96:0/55844649 wait complete. 2022-02-02T19:41:52.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 Processor -- start 2022-02-02T19:41:52.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 -- start start 2022-02-02T19:41:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 0x7f1090109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900603e0 con 0x7f10900f6860 2022-02-02T19:41:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.759+0000 7f1097dd1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090060520 con 0x7f10900f55c0 2022-02-02T19:41:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32952/0 (socket says 172.21.15.96:32952) 2022-02-02T19:41:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 -- 172.21.15.96:0/1050769969 learned_addr learned my addr 172.21.15.96:0/1050769969 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f1095b6d700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 0x7f1090109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 -- 172.21.15.96:0/1050769969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 msgr2=0x7f1090109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 0x7f1090109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 -- 172.21.15.96:0/1050769969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c005040 con 0x7f10900f6860 2022-02-02T19:41:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f109536c700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f108c009990 tx=0x7f108c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f108c018070 con 0x7f10900f6860 2022-02-02T19:41:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f108c007ba0 con 0x7f10900f6860 2022-02-02T19:41:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109010c6a0 con 0x7f10900f6860 2022-02-02T19:41:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f108c01c620 con 0x7f10900f6860 2022-02-02T19:41:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.760+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109010cc00 con 0x7f10900f6860 2022-02-02T19:41:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.761+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090045ad0 con 0x7f10900f6860 2022-02-02T19:41:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.762+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f108c01c8e0 con 0x7f10900f6860 2022-02-02T19:41:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.762+0000 7f10867fc700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 0x7f107c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.762+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f108c083890 con 0x7f10900f6860 2022-02-02T19:41:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.762+0000 7f1095b6d700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 0x7f107c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.763+0000 7f1095b6d700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 0x7f107c067290 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f1090060060 tx=0x7f1080009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.767+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f108c051990 con 0x7f10900f6860 2022-02-02T19:41:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.944+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1090057f10 con 0x7f107c064dd0 2022-02-02T19:41:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.946+0000 7f10867fc700 1 -- 172.21.15.96:0/1050769969 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1090057f10 con 0x7f107c064dd0 2022-02-02T19:41:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 msgr2=0x7f107c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 0x7f107c067290 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f1090060060 tx=0x7f1080009040).stop 2022-02-02T19:41:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 msgr2=0x7f109010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f108c009990 tx=0x7f108c009b30).stop 2022-02-02T19:41:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 shutdown_connections 2022-02-02T19:41:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f107c064dd0 0x7f107c067290 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10900f55c0 0x7f1090109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 --2- 172.21.15.96:0/1050769969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10900f6860 0x7f109010c150 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.947+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 >> 172.21.15.96:0/1050769969 conn(0x7f10900f0d40 msgr2=0x7f10900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.948+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 shutdown_connections 2022-02-02T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:52.948+0000 7f1097dd1700 1 -- 172.21.15.96:0/1050769969 wait complete. 2022-02-02T19:41:52.962 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:41:53.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.044+0000 7f77e6afd700 1 -- 172.21.15.96:0/1181253538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 msgr2=0x7f77e00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.044+0000 7f77e6afd700 1 --2- 172.21.15.96:0/1181253538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e00f7de0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f77cc004660 tx=0x7f77cc009b30).stop 2022-02-02T19:41:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 -- 172.21.15.96:0/1181253538 shutdown_connections 2022-02-02T19:41:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 --2- 172.21.15.96:0/1181253538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e00f7de0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 --2- 172.21.15.96:0/1181253538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 0x7f77e00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 -- 172.21.15.96:0/1181253538 >> 172.21.15.96:0/1181253538 conn(0x7f77e00f1e40 msgr2=0x7f77e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 -- 172.21.15.96:0/1181253538 shutdown_connections 2022-02-02T19:41:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 -- 172.21.15.96:0/1181253538 wait complete. 2022-02-02T19:41:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 Processor -- start 2022-02-02T19:41:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.045+0000 7f77e6afd700 1 -- start start 2022-02-02T19:41:53.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77e6afd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 0x7f77e0106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77e6afd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77e6afd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0107a20 con 0x7f77e00f7980 2022-02-02T19:41:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77e6afd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0107b60 con 0x7f77e00f66e0 2022-02-02T19:41:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32962/0 (socket says 172.21.15.96:32962) 2022-02-02T19:41:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 -- 172.21.15.96:0/1804816334 learned_addr learned my addr 172.21.15.96:0/1804816334 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77e4899700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 0x7f77e0106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 -- 172.21.15.96:0/1804816334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 msgr2=0x7f77e0106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 0x7f77e0106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 -- 172.21.15.96:0/1804816334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc005040 con 0x7f77e00f7980 2022-02-02T19:41:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.046+0000 7f77dffff700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f77cc009990 tx=0x7f77cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.047+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77cc018070 con 0x7f77e00f7980 2022-02-02T19:41:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.047+0000 7f77e6afd700 1 -- 172.21.15.96:0/1804816334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e01084a0 con 0x7f77e00f7980 2022-02-02T19:41:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.047+0000 7f77e6afd700 1 -- 172.21.15.96:0/1804816334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e0108a00 con 0x7f77e00f7980 2022-02-02T19:41:53.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.047+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77cc007ca0 con 0x7f77e00f7980 2022-02-02T19:41:53.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.047+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77cc01c620 con 0x7f77e00f7980 2022-02-02T19:41:53.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.048+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b8004fa0 con 0x7f77e00f7980 2022-02-02T19:41:53.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.048+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77cc01d960 con 0x7f77e00f7980 2022-02-02T19:41:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.049+0000 7f77dd7fa700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 0x7f77d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.049+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77cc0837c0 con 0x7f77e00f7980 2022-02-02T19:41:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.049+0000 7f77e4899700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 0x7f77d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.049+0000 7f77e4899700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 0x7f77d0067290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f77d40041d0 tx=0x7f77d4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.053+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77cc0553b0 con 0x7f77e00f7980 2022-02-02T19:41:53.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.226+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f77b8000bc0 con 0x7f77d0064dd0 2022-02-02T19:41:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.235+0000 7f77dd7fa700 1 -- 172.21.15.96:0/1804816334 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f77b8000bc0 con 0x7f77d0064dd0 2022-02-02T19:41:53.240 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:41:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (85m) 55m ago 86m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:41:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (77m) 55m ago 86m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:41:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (77m) 54m ago 85m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:41:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (85m) 55m ago 86m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:41:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (82m) 55m ago 82m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:41:53.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (77m) 55m ago 82m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:41:53.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (82m) 54m ago 82m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:41:53.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (78m) 54m ago 82m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:41:53.243 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (79m) 55m ago 87m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:41:53.243 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (79m) 54m ago 85m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:41:53.243 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (78m) 55m ago 87m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:41:53.243 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (78m) 54m ago 85m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:41:53.244 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (86m) 55m ago 86m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:41:53.244 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (85m) 54m ago 85m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:41:53.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (77m) 55m ago 85m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:41:53.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (76m) 55m ago 84m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:41:53.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (76m) 55m ago 84m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:41:53.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (75m) 54m ago 84m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:41:53.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (75m) 54m ago 83m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:41:53.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (74m) 54m ago 83m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:41:53.246 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (85m) 55m ago 85m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:41:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 msgr2=0x7f77d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 0x7f77d0067290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f77d40041d0 tx=0x7f77d4009040).stop 2022-02-02T19:41:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 msgr2=0x7f77e0107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f77cc009990 tx=0x7f77cc009b30).stop 2022-02-02T19:41:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 shutdown_connections 2022-02-02T19:41:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77d0064dd0 0x7f77d0067290 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66e0 0x7f77e0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 --2- 172.21.15.96:0/1804816334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f7980 0x7f77e0107470 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 >> 172.21.15.96:0/1804816334 conn(0x7f77e00f1e40 msgr2=0x7f77e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 shutdown_connections 2022-02-02T19:41:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.237+0000 7f77caffd700 1 -- 172.21.15.96:0/1804816334 wait complete. 2022-02-02T19:41:53.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 -- 172.21.15.96:0/2194474738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f55c0 msgr2=0x7fed9c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 --2- 172.21.15.96:0/2194474738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f55c0 0x7fed9c0f59e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fed84004660 tx=0x7fed84009b30).stop 2022-02-02T19:41:53.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 -- 172.21.15.96:0/2194474738 shutdown_connections 2022-02-02T19:41:53.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 --2- 172.21.15.96:0/2194474738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f6860 0x7fed9c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 --2- 172.21.15.96:0/2194474738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f55c0 0x7fed9c0f59e0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 -- 172.21.15.96:0/2194474738 >> 172.21.15.96:0/2194474738 conn(0x7fed9c0f0d40 msgr2=0x7fed9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 -- 172.21.15.96:0/2194474738 shutdown_connections 2022-02-02T19:41:53.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 -- 172.21.15.96:0/2194474738 wait complete. 2022-02-02T19:41:53.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.334+0000 7feda1d01700 1 Processor -- start 2022-02-02T19:41:53.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7feda1d01700 1 -- start start 2022-02-02T19:41:53.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7feda1d01700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f55c0 0x7fed9c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7feda1d01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7feda1d01700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c106910 con 0x7fed9c0f6860 2022-02-02T19:41:53.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7feda1d01700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c106a50 con 0x7fed9c0f55c0 2022-02-02T19:41:53.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32972/0 (socket says 172.21.15.96:32972) 2022-02-02T19:41:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 -- 172.21.15.96:0/4030561855 learned_addr learned my addr 172.21.15.96:0/4030561855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9b7fe700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f55c0 0x7fed9c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 -- 172.21.15.96:0/4030561855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f55c0 msgr2=0x7fed9c105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f55c0 0x7fed9c105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.335+0000 7fed9affd700 1 -- 172.21.15.96:0/4030561855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84005040 con 0x7fed9c0f6860 2022-02-02T19:41:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7fed9affd700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fed8c00c530 tx=0x7fed8c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8c00f650 con 0x7fed9c0f6860 2022-02-02T19:41:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c1073f0 con 0x7fed9c0f6860 2022-02-02T19:41:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed8c00fc60 con 0x7fed9c0f6860 2022-02-02T19:41:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8c012c20 con 0x7fed9c0f6860 2022-02-02T19:41:53.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.336+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c1079b0 con 0x7fed9c0f6860 2022-02-02T19:41:53.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.337+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c045ad0 con 0x7fed9c0f6860 2022-02-02T19:41:53.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.337+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed8c010070 con 0x7fed9c0f6860 2022-02-02T19:41:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.337+0000 7fed93fff700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 0x7fed88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.338+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed8c081710 con 0x7fed9c0f6860 2022-02-02T19:41:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.338+0000 7fed9b7fe700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 0x7fed88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.338+0000 7fed9b7fe700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 0x7fed88067290 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fed84004630 tx=0x7fed84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.342+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed8c053240 con 0x7fed9c0f6860 2022-02-02T19:41:53.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.573+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed9c027a00 con 0x7fed9c0f6860 2022-02-02T19:41:53.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.573+0000 7fed93fff700 1 -- 172.21.15.96:0/4030561855 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fed8c052e30 con 0x7fed9c0f6860 2022-02-02T19:41:53.579 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:41:53.579 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:41:53.580 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:41:53.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:53.580 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:41:53.580 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:41:53.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:53.581 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:41:53.581 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:41:53.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:53.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:41:53.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:41:53.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:41:53.584 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:41:53.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:41:53.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:41:53.585 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:41:53.586 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:41:53.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 msgr2=0x7fed88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 0x7fed88067290 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fed84004630 tx=0x7fed84009b30).stop 2022-02-02T19:41:53.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 msgr2=0x7fed9c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fed8c00c530 tx=0x7fed8c007e20).stop 2022-02-02T19:41:53.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 shutdown_connections 2022-02-02T19:41:53.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed88064dd0 0x7fed88067290 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed9c0f55c0 0x7fed9c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 --2- 172.21.15.96:0/4030561855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed9c0f6860 0x7fed9c106360 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 >> 172.21.15.96:0/4030561855 conn(0x7fed9c0f0d40 msgr2=0x7fed9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 shutdown_connections 2022-02-02T19:41:53.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.575+0000 7feda1d01700 1 -- 172.21.15.96:0/4030561855 wait complete. 2022-02-02T19:41:53.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 -- 172.21.15.96:0/243089717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f5430 msgr2=0x7f3ca00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 --2- 172.21.15.96:0/243089717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f5430 0x7f3ca00f5850 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f3c90004660 tx=0x7f3c90009b30).stop 2022-02-02T19:41:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 -- 172.21.15.96:0/243089717 shutdown_connections 2022-02-02T19:41:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 --2- 172.21.15.96:0/243089717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f66d0 0x7f3ca00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:41:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 --2- 172.21.15.96:0/243089717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f5430 0x7f3ca00f5850 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 -- 172.21.15.96:0/243089717 >> 172.21.15.96:0/243089717 conn(0x7f3ca00f0b90 msgr2=0x7f3ca00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 -- 172.21.15.96:0/243089717 shutdown_connections 2022-02-02T19:41:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 -- 172.21.15.96:0/243089717 wait complete. 2022-02-02T19:41:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.673+0000 7f3ca699b700 1 Processor -- start 2022-02-02T19:41:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca699b700 1 -- start start 2022-02-02T19:41:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca699b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f5430 0x7f3ca0105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca699b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca699b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0106880 con 0x7f3ca00f66d0 2022-02-02T19:41:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca699b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0106ff0 con 0x7f3ca00f5430 2022-02-02T19:41:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32982/0 (socket says 172.21.15.96:32982) 2022-02-02T19:41:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 -- 172.21.15.96:0/912409543 learned_addr learned my addr 172.21.15.96:0/912409543 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:41:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5999700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f5430 0x7f3ca0105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 -- 172.21.15.96:0/912409543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f5430 msgr2=0x7f3ca0105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f5430 0x7f3ca0105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 -- 172.21.15.96:0/912409543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90005040 con 0x7f3ca00f66d0 2022-02-02T19:41:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.674+0000 7f3ca5198700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f3c9c00d770 tx=0x7f3c9c00da80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.675+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c9c00e9e0 con 0x7f3ca00f66d0 2022-02-02T19:41:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.675+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c9c012070 con 0x7f3ca00f66d0 2022-02-02T19:41:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.675+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca01072d0 con 0x7f3ca00f66d0 2022-02-02T19:41:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.675+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c9c016e80 con 0x7f3ca00f66d0 2022-02-02T19:41:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.675+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca0107890 con 0x7f3ca00f66d0 2022-02-02T19:41:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.676+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca0045ad0 con 0x7f3ca00f66d0 2022-02-02T19:41:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.676+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c9c016380 con 0x7f3ca00f66d0 2022-02-02T19:41:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.677+0000 7f3c967fc700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 0x7f3c8c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:41:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.677+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3c9c081620 con 0x7f3ca00f66d0 2022-02-02T19:41:53.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.677+0000 7f3ca5999700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 0x7f3c8c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:41:53.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.677+0000 7f3ca5999700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 0x7f3c8c0672e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f3c90004630 tx=0x7f3c90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:41:53.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.681+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c9c0530f0 con 0x7f3ca00f66d0 2022-02-02T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.881+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ca00fdc70 con 0x7f3ca00f66d0 2022-02-02T19:41:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.881+0000 7f3c967fc700 1 -- 172.21.15.96:0/912409543 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3c9c052ce0 con 0x7f3ca00f66d0 2022-02-02T19:41:53.887 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:41:53.888 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:41:53.888 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:41:53.889 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:41:53.889 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:53.889 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:41:53.890 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:41:53.890 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:41:53.891 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:41:53.891 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:41:53.892 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:41:53.893 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:41:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 msgr2=0x7f3c8c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 0x7f3c8c0672e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f3c90004630 tx=0x7f3c90009b30).stop 2022-02-02T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 msgr2=0x7f3ca0106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f3c9c00d770 tx=0x7f3c9c00da80).stop 2022-02-02T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 shutdown_connections 2022-02-02T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c8c064e20 0x7f3c8c0672e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca00f5430 0x7f3ca0105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 --2- 172.21.15.96:0/912409543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca00f66d0 0x7f3ca0106240 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 >> 172.21.15.96:0/912409543 conn(0x7f3ca00f0b90 msgr2=0x7f3ca00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 shutdown_connections 2022-02-02T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:41:53.884+0000 7f3ca699b700 1 -- 172.21.15.96:0/912409543 wait complete. 2022-02-02T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:41:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:54 smithi159 ceph-mon[69013]: pgmap v2394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:54 smithi159 ceph-mon[69013]: from='client.36568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:54.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4030561855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:41:54.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/912409543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:41:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:54 smithi096 ceph-mon[101353]: pgmap v2394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:54 smithi096 ceph-mon[101353]: from='client.36568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4030561855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:41:54.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/912409543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:41:55.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:55 smithi159 ceph-mon[69013]: from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:55.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:55 smithi096 ceph-mon[101353]: from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:41:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:56 smithi159 ceph-mon[69013]: pgmap v2395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:56 smithi096 ceph-mon[101353]: pgmap v2395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:41:58 smithi159 ceph-mon[69013]: pgmap v2396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:41:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:41:58 smithi096 ceph-mon[101353]: pgmap v2396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:00.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:00 smithi159 ceph-mon[69013]: pgmap v2397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:00 smithi096 ceph-mon[101353]: pgmap v2397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:02 smithi159 ceph-mon[69013]: pgmap v2398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:02 smithi096 ceph-mon[101353]: pgmap v2398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:04 smithi159 ceph-mon[69013]: pgmap v2399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:04 smithi096 ceph-mon[101353]: pgmap v2399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:06 smithi159 ceph-mon[69013]: pgmap v2400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:06 smithi096 ceph-mon[101353]: pgmap v2400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:08 smithi159 ceph-mon[69013]: pgmap v2401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:08 smithi096 ceph-mon[101353]: pgmap v2401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:10 smithi159 ceph-mon[69013]: pgmap v2402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:10 smithi096 ceph-mon[101353]: pgmap v2402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:12 smithi159 ceph-mon[69013]: pgmap v2403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:12 smithi096 ceph-mon[101353]: pgmap v2403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:14 smithi159 ceph-mon[69013]: pgmap v2404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:14 smithi096 ceph-mon[101353]: pgmap v2404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:16.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:16 smithi159 ceph-mon[69013]: pgmap v2405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:16 smithi096 ceph-mon[101353]: pgmap v2405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:18 smithi159 ceph-mon[69013]: pgmap v2406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:18 smithi096 ceph-mon[101353]: pgmap v2406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:20 smithi159 ceph-mon[69013]: pgmap v2407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:20 smithi096 ceph-mon[101353]: pgmap v2407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:22 smithi159 ceph-mon[69013]: pgmap v2408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:22 smithi096 ceph-mon[101353]: pgmap v2408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:24.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.994+0000 7f0d7871a700 1 -- 172.21.15.96:0/3740206740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f7980 msgr2=0x7f0d700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.994+0000 7f0d7871a700 1 --2- 172.21.15.96:0/3740206740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f7980 0x7f0d700f7de0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f0d6c004660 tx=0x7f0d6c009b30).stop 2022-02-02T19:42:24.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- 172.21.15.96:0/3740206740 shutdown_connections 2022-02-02T19:42:24.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 --2- 172.21.15.96:0/3740206740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f7980 0x7f0d700f7de0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 --2- 172.21.15.96:0/3740206740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f66e0 0x7f0d700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- 172.21.15.96:0/3740206740 >> 172.21.15.96:0/3740206740 conn(0x7f0d700f1e40 msgr2=0x7f0d700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- 172.21.15.96:0/3740206740 shutdown_connections 2022-02-02T19:42:24.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- 172.21.15.96:0/3740206740 wait complete. 2022-02-02T19:42:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 Processor -- start 2022-02-02T19:42:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- start start 2022-02-02T19:42:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f7980 0x7f0d70069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7006a380 con 0x7f0d700f66e0 2022-02-02T19:42:24.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.995+0000 7f0d7871a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7006a4c0 con 0x7f0d700f7980 2022-02-02T19:42:24.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33000/0 (socket says 172.21.15.96:33000) 2022-02-02T19:42:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 -- 172.21.15.96:0/1737082986 learned_addr learned my addr 172.21.15.96:0/1737082986 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d75cb5700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f7980 0x7f0d70069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 -- 172.21.15.96:0/1737082986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f7980 msgr2=0x7f0d70069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f7980 0x7f0d70069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 -- 172.21.15.96:0/1737082986 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c005040 con 0x7f0d700f66e0 2022-02-02T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d764b6700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0d64002700 tx=0x7f0d64009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d640079c0 con 0x7f0d700f66e0 2022-02-02T19:42:24.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7006a7a0 con 0x7f0d700f66e0 2022-02-02T19:42:24.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d6400f040 con 0x7f0d700f66e0 2022-02-02T19:42:24.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.996+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d64014860 con 0x7f0d700f66e0 2022-02-02T19:42:24.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.997+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7010ef90 con 0x7f0d700f66e0 2022-02-02T19:42:24.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.997+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d70045ad0 con 0x7f0d700f66e0 2022-02-02T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.998+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d6401b060 con 0x7f0d700f66e0 2022-02-02T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.998+0000 7f0d62ffd700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 0x7f0d5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.998+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0d640819a0 con 0x7f0d700f66e0 2022-02-02T19:42:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.998+0000 7f0d75cb5700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 0x7f0d5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:23.999+0000 7f0d75cb5700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 0x7f0d5c067290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f0d6c004630 tx=0x7f0d6c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.003+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d6404f9e0 con 0x7f0d700f66e0 2022-02-02T19:42:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.179+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d70057f10 con 0x7f0d5c064dd0 2022-02-02T19:42:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.180+0000 7f0d62ffd700 1 -- 172.21.15.96:0/1737082986 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0d70057f10 con 0x7f0d5c064dd0 2022-02-02T19:42:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 msgr2=0x7f0d5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 0x7f0d5c067290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f0d6c004630 tx=0x7f0d6c009b30).stop 2022-02-02T19:42:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 msgr2=0x7f0d7006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0d64002700 tx=0x7f0d64009d80).stop 2022-02-02T19:42:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 shutdown_connections 2022-02-02T19:42:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d5c064dd0 0x7f0d5c067290 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d700f66e0 0x7f0d7006b9a0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 --2- 172.21.15.96:0/1737082986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d700f7980 0x7f0d70069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 >> 172.21.15.96:0/1737082986 conn(0x7f0d700f1e40 msgr2=0x7f0d700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 shutdown_connections 2022-02-02T19:42:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.182+0000 7f0d7871a700 1 -- 172.21.15.96:0/1737082986 wait complete. 2022-02-02T19:42:24.196 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:42:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 -- 172.21.15.96:0/1331599784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f6860 msgr2=0x7effe00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 --2- 172.21.15.96:0/1331599784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f6860 0x7effe00f6cc0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7effc8004660 tx=0x7effc8009b30).stop 2022-02-02T19:42:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 -- 172.21.15.96:0/1331599784 shutdown_connections 2022-02-02T19:42:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 --2- 172.21.15.96:0/1331599784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f6860 0x7effe00f6cc0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 --2- 172.21.15.96:0/1331599784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f55c0 0x7effe00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 -- 172.21.15.96:0/1331599784 >> 172.21.15.96:0/1331599784 conn(0x7effe00f0d40 msgr2=0x7effe00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.279+0000 7effe61ee700 1 -- 172.21.15.96:0/1331599784 shutdown_connections 2022-02-02T19:42:24.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:24 smithi096 ceph-mon[101353]: pgmap v2409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.280+0000 7effe61ee700 1 -- 172.21.15.96:0/1331599784 wait complete. 2022-02-02T19:42:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.280+0000 7effe61ee700 1 Processor -- start 2022-02-02T19:42:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.280+0000 7effe61ee700 1 -- start start 2022-02-02T19:42:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effe61ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effe61ee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f6860 0x7effe0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effe61ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0107a10 con 0x7effe00f55c0 2022-02-02T19:42:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effe61ee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0107b50 con 0x7effe00f6860 2022-02-02T19:42:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33010/0 (socket says 172.21.15.96:33010) 2022-02-02T19:42:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 -- 172.21.15.96:0/2294696508 learned_addr learned my addr 172.21.15.96:0/2294696508 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdeffd700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f6860 0x7effe0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 -- 172.21.15.96:0/2294696508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f6860 msgr2=0x7effe0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f6860 0x7effe0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 -- 172.21.15.96:0/2294696508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8005040 con 0x7effe00f55c0 2022-02-02T19:42:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effdf7fe700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7effd000c530 tx=0x7effd0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.281+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd000f650 con 0x7effe00f55c0 2022-02-02T19:42:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.282+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe01084f0 con 0x7effe00f55c0 2022-02-02T19:42:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.282+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effd000fc60 con 0x7effe00f55c0 2022-02-02T19:42:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.282+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd0012cb0 con 0x7effe00f55c0 2022-02-02T19:42:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.282+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe0108ab0 con 0x7effe00f55c0 2022-02-02T19:42:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.282+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0045ad0 con 0x7effe00f55c0 2022-02-02T19:42:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.283+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7effd0019030 con 0x7effe00f55c0 2022-02-02T19:42:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.283+0000 7effd7fff700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 0x7effcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.283+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7effd0081600 con 0x7effe00f55c0 2022-02-02T19:42:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.283+0000 7effdeffd700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 0x7effcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.284+0000 7effdeffd700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 0x7effcc067290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7effc8004630 tx=0x7effc8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.287+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7effd00531e0 con 0x7effe00f55c0 2022-02-02T19:42:24.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.460+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effe00faca0 con 0x7effcc064dd0 2022-02-02T19:42:24.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.470+0000 7effd7fff700 1 -- 172.21.15.96:0/2294696508 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7effe00faca0 con 0x7effcc064dd0 2022-02-02T19:42:24.474 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:42:24.475 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (85m) 56m ago 86m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:42:24.475 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (78m) 56m ago 86m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:42:24.475 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (78m) 54m ago 86m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:42:24.475 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (85m) 56m ago 86m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:42:24.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (82m) 56m ago 82m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:42:24.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (78m) 56m ago 82m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:42:24.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (82m) 54m ago 82m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:42:24.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (78m) 54m ago 83m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:42:24.477 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (80m) 56m ago 87m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:42:24.477 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (79m) 54m ago 86m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:42:24.477 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (79m) 56m ago 88m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:42:24.477 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (78m) 54m ago 86m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:42:24.477 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (86m) 56m ago 86m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:42:24.478 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (86m) 54m ago 86m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:42:24.478 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (77m) 56m ago 85m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:42:24.478 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (77m) 56m ago 85m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:42:24.478 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (76m) 56m ago 85m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:42:24.479 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (76m) 54m ago 84m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:42:24.479 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (75m) 54m ago 84m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:42:24.479 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (75m) 54m ago 84m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:42:24.479 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (85m) 56m ago 86m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:42:24.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 msgr2=0x7effcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 0x7effcc067290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7effc8004630 tx=0x7effc8009b30).stop 2022-02-02T19:42:24.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 msgr2=0x7effe0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7effd000c530 tx=0x7effd0007e10).stop 2022-02-02T19:42:24.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 shutdown_connections 2022-02-02T19:42:24.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effcc064dd0 0x7effcc067290 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe00f55c0 0x7effe0106f70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 --2- 172.21.15.96:0/2294696508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe00f6860 0x7effe0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.471+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 >> 172.21.15.96:0/2294696508 conn(0x7effe00f0d40 msgr2=0x7effe005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.472+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 shutdown_connections 2022-02-02T19:42:24.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.472+0000 7effe61ee700 1 -- 172.21.15.96:0/2294696508 wait complete. 2022-02-02T19:42:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:24 smithi159 ceph-mon[69013]: pgmap v2409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:24.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 -- 172.21.15.96:0/4243056208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f6860 msgr2=0x7ff5280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/4243056208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f6860 0x7ff5280f6cc0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7ff514004660 tx=0x7ff514009b30).stop 2022-02-02T19:42:24.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 -- 172.21.15.96:0/4243056208 shutdown_connections 2022-02-02T19:42:24.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/4243056208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f6860 0x7ff5280f6cc0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/4243056208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f55c0 0x7ff5280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 -- 172.21.15.96:0/4243056208 >> 172.21.15.96:0/4243056208 conn(0x7ff5280f0d40 msgr2=0x7ff5280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 -- 172.21.15.96:0/4243056208 shutdown_connections 2022-02-02T19:42:24.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.569+0000 7ff52ed8c700 1 -- 172.21.15.96:0/4243056208 wait complete. 2022-02-02T19:42:24.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 Processor -- start 2022-02-02T19:42:24.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 -- start start 2022-02-02T19:42:24.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 0x7ff52810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280603c0 con 0x7ff5280f55c0 2022-02-02T19:42:24.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52ed8c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528060500 con 0x7ff5280f6860 2022-02-02T19:42:24.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52cb28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52cb28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33020/0 (socket says 172.21.15.96:33020) 2022-02-02T19:42:24.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff52cb28700 1 -- 172.21.15.96:0/1725279972 learned_addr learned my addr 172.21.15.96:0/1725279972 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:24.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.570+0000 7ff527fff700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 0x7ff52810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52cb28700 1 -- 172.21.15.96:0/1725279972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 msgr2=0x7ff52810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52cb28700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 0x7ff52810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52cb28700 1 -- 172.21.15.96:0/1725279972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514005040 con 0x7ff5280f55c0 2022-02-02T19:42:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff527fff700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 0x7ff52810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:42:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52cb28700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7ff51c002700 tx=0x7ff51c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c009320 con 0x7ff5280f55c0 2022-02-02T19:42:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff51c00f040 con 0x7ff5280f55c0 2022-02-02T19:42:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52810c720 con 0x7ff5280f55c0 2022-02-02T19:42:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c014900 con 0x7ff5280f55c0 2022-02-02T19:42:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.571+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52810ccb0 con 0x7ff5280f55c0 2022-02-02T19:42:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.572+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5280f49b0 con 0x7ff5280f55c0 2022-02-02T19:42:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.572+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff51c009480 con 0x7ff5280f55c0 2022-02-02T19:42:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.573+0000 7ff5257fa700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 0x7ff518067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.573+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff51c081cc0 con 0x7ff5280f55c0 2022-02-02T19:42:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.573+0000 7ff527fff700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 0x7ff518067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.573+0000 7ff527fff700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 0x7ff518067290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7ff514004630 tx=0x7ff514009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.577+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff51c04fe80 con 0x7ff5280f55c0 2022-02-02T19:42:24.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.805+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5280586e0 con 0x7ff5280f55c0 2022-02-02T19:42:24.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.806+0000 7ff5257fa700 1 -- 172.21.15.96:0/1725279972 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff51c0534a0 con 0x7ff5280f55c0 2022-02-02T19:42:24.812 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:42:24.812 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:42:24.812 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:42:24.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:24.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:42:24.813 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:42:24.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:24.814 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:42:24.814 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:42:24.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:24.815 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:42:24.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:42:24.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:24.816 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:42:24.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:42:24.817 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:42:24.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:42:24.817 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:42:24.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.807+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 msgr2=0x7ff518067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.807+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 0x7ff518067290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7ff514004630 tx=0x7ff514009b30).stop 2022-02-02T19:42:24.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.807+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 msgr2=0x7ff528109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.807+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7ff51c002700 tx=0x7ff51c009d80).stop 2022-02-02T19:42:24.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.807+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 shutdown_connections 2022-02-02T19:42:24.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff518064dd0 0x7ff518067290 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5280f55c0 0x7ff528109c70 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 --2- 172.21.15.96:0/1725279972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5280f6860 0x7ff52810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 >> 172.21.15.96:0/1725279972 conn(0x7ff5280f0d40 msgr2=0x7ff5280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 shutdown_connections 2022-02-02T19:42:24.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.808+0000 7ff52ed8c700 1 -- 172.21.15.96:0/1725279972 wait complete. 2022-02-02T19:42:24.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- 172.21.15.96:0/931115592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f7980 msgr2=0x7f5e180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 --2- 172.21.15.96:0/931115592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f7980 0x7f5e180f7de0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f5e04004660 tx=0x7f5e04009b30).stop 2022-02-02T19:42:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- 172.21.15.96:0/931115592 shutdown_connections 2022-02-02T19:42:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 --2- 172.21.15.96:0/931115592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f7980 0x7f5e180f7de0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 --2- 172.21.15.96:0/931115592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f66e0 0x7f5e180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- 172.21.15.96:0/931115592 >> 172.21.15.96:0/931115592 conn(0x7f5e180f1e40 msgr2=0x7f5e180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:24.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- 172.21.15.96:0/931115592 shutdown_connections 2022-02-02T19:42:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- 172.21.15.96:0/931115592 wait complete. 2022-02-02T19:42:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 Processor -- start 2022-02-02T19:42:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.905+0000 7f5e1f046700 1 -- start start 2022-02-02T19:42:24.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1f046700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1f046700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f7980 0x7f5e18109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1f046700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18109c30 con 0x7f5e180f66e0 2022-02-02T19:42:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1f046700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18109d70 con 0x7f5e180f7980 2022-02-02T19:42:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33026/0 (socket says 172.21.15.96:33026) 2022-02-02T19:42:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 -- 172.21.15.96:0/2396489733 learned_addr learned my addr 172.21.15.96:0/2396489733 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e17fff700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f7980 0x7f5e18109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 -- 172.21.15.96:0/2396489733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f7980 msgr2=0x7f5e18109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f7980 0x7f5e18109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 -- 172.21.15.96:0/2396489733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04005040 con 0x7f5e180f66e0 2022-02-02T19:42:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.906+0000 7f5e1cde2700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f5e0c00c790 tx=0x7f5e0c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.907+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c00e680 con 0x7f5e180f66e0 2022-02-02T19:42:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.907+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1810a710 con 0x7f5e180f66e0 2022-02-02T19:42:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.907+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e0c00ec90 con 0x7f5e180f66e0 2022-02-02T19:42:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.907+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c012d00 con 0x7f5e180f66e0 2022-02-02T19:42:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.907+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1810acd0 con 0x7f5e180f66e0 2022-02-02T19:42:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.908+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e18045ad0 con 0x7f5e180f66e0 2022-02-02T19:42:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.909+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e0c010070 con 0x7f5e180f66e0 2022-02-02T19:42:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.909+0000 7f5e157fa700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 0x7f5e08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.909+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5e0c081b30 con 0x7f5e180f66e0 2022-02-02T19:42:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.909+0000 7f5e17fff700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 0x7f5e08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:24.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.910+0000 7f5e17fff700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 0x7f5e08067290 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f5e04009da0 tx=0x7f5e04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:24.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:24.913+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e0c053660 con 0x7f5e180f66e0 2022-02-02T19:42:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.113+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e1810f7b0 con 0x7f5e180f66e0 2022-02-02T19:42:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.113+0000 7f5e157fa700 1 -- 172.21.15.96:0/2396489733 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5e0c053250 con 0x7f5e180f66e0 2022-02-02T19:42:25.119 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:42:25.119 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:42:25.119 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:42:25.119 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:42:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:25.120 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:42:25.120 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:42:25.121 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:42:25.121 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:42:25.121 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:42:25.122 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:42:25.122 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:42:25.122 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:42:25.122 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:42:25.123 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:42:25.123 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:42:25.124 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:42:25.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:42:25.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:42:25.124 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:42:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:42:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:42:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:42:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:42:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:42:25.126 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:42:25.126 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:42:25.126 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:42:25.126 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:42:25.127 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:42:25.127 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:42:25.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:42:25.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:25.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:25.128 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:42:25.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:25.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:25.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:25.129 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 msgr2=0x7f5e08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 0x7f5e08067290 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f5e04009da0 tx=0x7f5e04009b30).stop 2022-02-02T19:42:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 msgr2=0x7f5e18109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f5e0c00c790 tx=0x7f5e0c007d90).stop 2022-02-02T19:42:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 shutdown_connections 2022-02-02T19:42:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e08064dd0 0x7f5e08067290 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e180f66e0 0x7f5e18109190 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 --2- 172.21.15.96:0/2396489733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e180f7980 0x7f5e18109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 >> 172.21.15.96:0/2396489733 conn(0x7f5e180f1e40 msgr2=0x7f5e180fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 shutdown_connections 2022-02-02T19:42:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:25.115+0000 7f5e1f046700 1 -- 172.21.15.96:0/2396489733 wait complete. 2022-02-02T19:42:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:42:25.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:25 smithi159 ceph-mon[69013]: from='client.36584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:25.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1725279972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:42:25.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2396489733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:42:25.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:25 smithi096 ceph-mon[101353]: from='client.36584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:25.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1725279972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:42:25.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2396489733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:42:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:26 smithi159 ceph-mon[69013]: pgmap v2410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:26.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:26 smithi159 ceph-mon[69013]: from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:26 smithi096 ceph-mon[101353]: pgmap v2410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:26.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:26 smithi096 ceph-mon[101353]: from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:27.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:27 smithi159 ceph-mon[69013]: pgmap v2411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:27.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:27 smithi096 ceph-mon[101353]: pgmap v2411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:42:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:42:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:42:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:42:29.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:29 smithi159 ceph-mon[69013]: pgmap v2412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:29.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:29 smithi096 ceph-mon[101353]: pgmap v2412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:32 smithi159 ceph-mon[69013]: pgmap v2413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:32 smithi096 ceph-mon[101353]: pgmap v2413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:34.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:34 smithi159 ceph-mon[69013]: pgmap v2414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:34 smithi096 ceph-mon[101353]: pgmap v2414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:36 smithi159 ceph-mon[69013]: pgmap v2415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:36 smithi096 ceph-mon[101353]: pgmap v2415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:38.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:38 smithi159 ceph-mon[69013]: pgmap v2416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:38 smithi096 ceph-mon[101353]: pgmap v2416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:40.451 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:40 smithi159 ceph-mon[69013]: pgmap v2417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:40 smithi096 ceph-mon[101353]: pgmap v2417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:42 smithi159 ceph-mon[69013]: pgmap v2418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:42 smithi096 ceph-mon[101353]: pgmap v2418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:44 smithi159 ceph-mon[69013]: pgmap v2419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:44 smithi096 ceph-mon[101353]: pgmap v2419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:46.530 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:46 smithi159 ceph-mon[69013]: pgmap v2420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:46 smithi096 ceph-mon[101353]: pgmap v2420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:48 smithi159 ceph-mon[69013]: pgmap v2421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:48 smithi096 ceph-mon[101353]: pgmap v2421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:50 smithi159 ceph-mon[69013]: pgmap v2422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:50 smithi096 ceph-mon[101353]: pgmap v2422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:52.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:52 smithi159 ceph-mon[69013]: pgmap v2423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:52 smithi096 ceph-mon[101353]: pgmap v2423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:54 smithi159 ceph-mon[69013]: pgmap v2424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:54 smithi096 ceph-mon[101353]: pgmap v2424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:55.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 -- 172.21.15.96:0/1463548794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 msgr2=0x7f09200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 --2- 172.21.15.96:0/1463548794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f09200f59e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f0910004660 tx=0x7f0910009b30).stop 2022-02-02T19:42:55.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 -- 172.21.15.96:0/1463548794 shutdown_connections 2022-02-02T19:42:55.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 --2- 172.21.15.96:0/1463548794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f09200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 --2- 172.21.15.96:0/1463548794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f09200f59e0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 -- 172.21.15.96:0/1463548794 >> 172.21.15.96:0/1463548794 conn(0x7f09200f0d40 msgr2=0x7f09200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:55.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 -- 172.21.15.96:0/1463548794 shutdown_connections 2022-02-02T19:42:55.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.228+0000 7f092820e700 1 -- 172.21.15.96:0/1463548794 wait complete. 2022-02-02T19:42:55.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 Processor -- start 2022-02-02T19:42:55.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 -- start start 2022-02-02T19:42:55.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f0920106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920106910 con 0x7f09200f55c0 2022-02-02T19:42:55.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.229+0000 7f092820e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920106a50 con 0x7f09200f6860 2022-02-02T19:42:55.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33044/0 (socket says 172.21.15.96:33044) 2022-02-02T19:42:55.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 -- 172.21.15.96:0/1560928070 learned_addr learned my addr 172.21.15.96:0/1560928070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:55.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f09257a9700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f0920106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 -- 172.21.15.96:0/1560928070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 msgr2=0x7f0920106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f0920106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 -- 172.21.15.96:0/1560928070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910005040 con 0x7f09200f55c0 2022-02-02T19:42:55.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f09257a9700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f0920106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:42:55.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f0925faa700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f0910013a70 tx=0x7f0910009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0910018070 con 0x7f09200f55c0 2022-02-02T19:42:55.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0920107390 con 0x7f09200f55c0 2022-02-02T19:42:55.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09100097d0 con 0x7f09200f55c0 2022-02-02T19:42:55.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.230+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09201078f0 con 0x7f09200f55c0 2022-02-02T19:42:55.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.231+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091001dd60 con 0x7f09200f55c0 2022-02-02T19:42:55.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.231+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0920045ad0 con 0x7f09200f55c0 2022-02-02T19:42:55.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.232+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0910007ba0 con 0x7f09200f55c0 2022-02-02T19:42:55.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.232+0000 7f09167fc700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 0x7f090c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.232+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f09100835c0 con 0x7f09200f55c0 2022-02-02T19:42:55.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.232+0000 7f09257a9700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 0x7f090c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.233+0000 7f09257a9700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 0x7f090c067290 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f091c009fd0 tx=0x7f091c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.237+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09100550f0 con 0x7f09200f55c0 2022-02-02T19:42:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.415+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09200fde90 con 0x7f090c064dd0 2022-02-02T19:42:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.417+0000 7f09167fc700 1 -- 172.21.15.96:0/1560928070 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f09200fde90 con 0x7f090c064dd0 2022-02-02T19:42:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 msgr2=0x7f090c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 0x7f090c067290 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f091c009fd0 tx=0x7f091c00b040).stop 2022-02-02T19:42:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 msgr2=0x7f0920105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f0910013a70 tx=0x7f0910009b30).stop 2022-02-02T19:42:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 shutdown_connections 2022-02-02T19:42:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f090c064dd0 0x7f090c067290 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09200f55c0 0x7f0920105e70 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 --2- 172.21.15.96:0/1560928070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09200f6860 0x7f0920106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 >> 172.21.15.96:0/1560928070 conn(0x7f09200f0d40 msgr2=0x7f09200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 shutdown_connections 2022-02-02T19:42:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.418+0000 7f092820e700 1 -- 172.21.15.96:0/1560928070 wait complete. 2022-02-02T19:42:55.432 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:42:55.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.516+0000 7f03a67cb700 1 -- 172.21.15.96:0/4040655394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 msgr2=0x7f03a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.516+0000 7f03a67cb700 1 --2- 172.21.15.96:0/4040655394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f6cc0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f0388004660 tx=0x7f0388009b30).stop 2022-02-02T19:42:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 -- 172.21.15.96:0/4040655394 shutdown_connections 2022-02-02T19:42:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 --2- 172.21.15.96:0/4040655394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f6cc0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 --2- 172.21.15.96:0/4040655394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:42:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 -- 172.21.15.96:0/4040655394 >> 172.21.15.96:0/4040655394 conn(0x7f03a00f0d40 msgr2=0x7f03a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 -- 172.21.15.96:0/4040655394 shutdown_connections 2022-02-02T19:42:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 -- 172.21.15.96:0/4040655394 wait complete. 2022-02-02T19:42:55.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 Processor -- start 2022-02-02T19:42:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.517+0000 7f03a67cb700 1 -- start start 2022-02-02T19:42:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f03a67cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f03a67cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f03a67cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00f8190 con 0x7f03a00f6860 2022-02-02T19:42:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f03a67cb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00f82d0 con 0x7f03a00f55c0 2022-02-02T19:42:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33054/0 (socket says 172.21.15.96:33054) 2022-02-02T19:42:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 -- 172.21.15.96:0/2805506380 learned_addr learned my addr 172.21.15.96:0/2805506380 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:55.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 -- 172.21.15.96:0/2805506380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 msgr2=0x7f03a00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039ffff700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 -- 172.21.15.96:0/2805506380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388005040 con 0x7f03a00f6860 2022-02-02T19:42:55.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039ffff700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:42:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039f7fe700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f0388009990 tx=0x7f0388009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0388018070 con 0x7f03a00f6860 2022-02-02T19:42:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0388007ca0 con 0x7f03a00f6860 2022-02-02T19:42:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00f8550 con 0x7f03a00f6860 2022-02-02T19:42:55.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.518+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f038801c620 con 0x7f03a00f6860 2022-02-02T19:42:55.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.519+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a010efb0 con 0x7f03a00f6860 2022-02-02T19:42:55.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.519+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a0045ad0 con 0x7f03a00f6860 2022-02-02T19:42:55.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.520+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f038801d960 con 0x7f03a00f6860 2022-02-02T19:42:55.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.520+0000 7f039cff9700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 0x7f038c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.520+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f03880837e0 con 0x7f03a00f6860 2022-02-02T19:42:55.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.520+0000 7f039ffff700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 0x7f038c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.521+0000 7f039ffff700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 0x7f038c067290 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f03a00f94b0 tx=0x7f0390008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.524+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03880519a0 con 0x7f03a00f6860 2022-02-02T19:42:55.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.698+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a00faca0 con 0x7f038c064dd0 2022-02-02T19:42:55.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.707+0000 7f039cff9700 1 -- 172.21.15.96:0/2805506380 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f03a00faca0 con 0x7f038c064dd0 2022-02-02T19:42:55.712 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:42:55.712 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (86m) 56m ago 87m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:42:55.712 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (78m) 56m ago 87m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:42:55.712 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (78m) 55m ago 86m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:42:55.713 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (86m) 56m ago 87m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:42:55.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (83m) 56m ago 83m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:42:55.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (79m) 56m ago 83m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:42:55.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (83m) 55m ago 83m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:42:55.714 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (79m) 55m ago 83m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:42:55.714 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (80m) 56m ago 88m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:42:55.714 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (80m) 55m ago 86m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:42:55.714 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (79m) 56m ago 88m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:42:55.715 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (79m) 55m ago 86m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:42:55.715 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (87m) 56m ago 87m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:42:55.715 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (86m) 55m ago 86m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:42:55.715 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (78m) 56m ago 86m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:42:55.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (77m) 56m ago 85m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:42:55.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (77m) 56m ago 85m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:42:55.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (76m) 55m ago 85m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:42:55.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (76m) 55m ago 84m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:42:55.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (75m) 55m ago 84m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:42:55.717 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (86m) 56m ago 86m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:42:55.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 msgr2=0x7f038c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 0x7f038c067290 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f03a00f94b0 tx=0x7f0390008040).stop 2022-02-02T19:42:55.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 msgr2=0x7f03a00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f0388009990 tx=0x7f0388009b30).stop 2022-02-02T19:42:55.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 shutdown_connections 2022-02-02T19:42:55.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f038c064dd0 0x7f038c067290 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a00f55c0 0x7f03a00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 --2- 172.21.15.96:0/2805506380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03a00f6860 0x7f03a00f7ba0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.709+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 >> 172.21.15.96:0/2805506380 conn(0x7f03a00f0d40 msgr2=0x7f03a005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:55.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.710+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 shutdown_connections 2022-02-02T19:42:55.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.710+0000 7f03a67cb700 1 -- 172.21.15.96:0/2805506380 wait complete. 2022-02-02T19:42:55.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 -- 172.21.15.96:0/115497258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 msgr2=0x7f52100f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 --2- 172.21.15.96:0/115497258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f52100f5850 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f5200004660 tx=0x7f5200009b30).stop 2022-02-02T19:42:55.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 -- 172.21.15.96:0/115497258 shutdown_connections 2022-02-02T19:42:55.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 --2- 172.21.15.96:0/115497258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 0x7f52100f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 --2- 172.21.15.96:0/115497258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f52100f5850 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 -- 172.21.15.96:0/115497258 >> 172.21.15.96:0/115497258 conn(0x7f52100f0b90 msgr2=0x7f52100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:55.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 -- 172.21.15.96:0/115497258 shutdown_connections 2022-02-02T19:42:55.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.807+0000 7f521492f700 1 -- 172.21.15.96:0/115497258 wait complete. 2022-02-02T19:42:55.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 Processor -- start 2022-02-02T19:42:55.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 -- start start 2022-02-02T19:42:55.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 0x7f5210107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210107870 con 0x7f52100f5430 2022-02-02T19:42:55.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f521492f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210108080 con 0x7f52100f66d0 2022-02-02T19:42:55.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f520f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f520f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33060/0 (socket says 172.21.15.96:33060) 2022-02-02T19:42:55.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.808+0000 7f520f7fe700 1 -- 172.21.15.96:0/2861569714 learned_addr learned my addr 172.21.15.96:0/2861569714 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:55.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f520effd700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 0x7f5210107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f520f7fe700 1 -- 172.21.15.96:0/2861569714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 msgr2=0x7f5210107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:55.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f520f7fe700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 0x7f5210107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:55.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f520f7fe700 1 -- 172.21.15.96:0/2861569714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200005040 con 0x7f52100f5430 2022-02-02T19:42:55.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f520f7fe700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f5200013a70 tx=0x7f5200009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5200018070 con 0x7f52100f5430 2022-02-02T19:42:55.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52101082a0 con 0x7f52100f5430 2022-02-02T19:42:55.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52000097d0 con 0x7f52100f5430 2022-02-02T19:42:55.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520001c3c0 con 0x7f52100f5430 2022-02-02T19:42:55.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.809+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210108800 con 0x7f52100f5430 2022-02-02T19:42:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.810+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5200007ba0 con 0x7f52100f5430 2022-02-02T19:42:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.810+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210059100 con 0x7f52100f5430 2022-02-02T19:42:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.811+0000 7f51f7fff700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 0x7f51f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.811+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5200083740 con 0x7f52100f5430 2022-02-02T19:42:55.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.811+0000 7f520effd700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 0x7f51f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:55.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.811+0000 7f520effd700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 0x7f51f80672e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5204009fd0 tx=0x7f520400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:55.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:55.815+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5200051900 con 0x7f52100f5430 2022-02-02T19:42:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.048+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f52100fdbf0 con 0x7f52100f5430 2022-02-02T19:42:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.049+0000 7f51f7fff700 1 -- 172.21.15.96:0/2861569714 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5200054f20 con 0x7f52100f5430 2022-02-02T19:42:56.053 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:42:56.053 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:42:56.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:42:56.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:56.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:42:56.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:42:56.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:56.055 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:42:56.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:42:56.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:56.055 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:42:56.056 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:42:56.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:42:56.056 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:42:56.056 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:42:56.057 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:42:56.057 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:42:56.057 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:42:56.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 msgr2=0x7f51f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 0x7f51f80672e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5204009fd0 tx=0x7f520400b040).stop 2022-02-02T19:42:56.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 msgr2=0x7f5210106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f5200013a70 tx=0x7f5200009b30).stop 2022-02-02T19:42:56.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 shutdown_connections 2022-02-02T19:42:56.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51f8064e20 0x7f51f80672e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52100f5430 0x7f5210106d80 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 --2- 172.21.15.96:0/2861569714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52100f66d0 0x7f5210107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.050+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 >> 172.21.15.96:0/2861569714 conn(0x7f52100f0b90 msgr2=0x7f52100fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:56.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.051+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 shutdown_connections 2022-02-02T19:42:56.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.051+0000 7f521492f700 1 -- 172.21.15.96:0/2861569714 wait complete. 2022-02-02T19:42:56.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 -- 172.21.15.96:0/3105627732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f55c0 msgr2=0x7f86680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 --2- 172.21.15.96:0/3105627732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f55c0 0x7f86680f59e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f865c004660 tx=0x7f865c009b30).stop 2022-02-02T19:42:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 -- 172.21.15.96:0/3105627732 shutdown_connections 2022-02-02T19:42:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 --2- 172.21.15.96:0/3105627732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f6860 0x7f86680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 --2- 172.21.15.96:0/3105627732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f55c0 0x7f86680f59e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.149+0000 7f866d14e700 1 -- 172.21.15.96:0/3105627732 >> 172.21.15.96:0/3105627732 conn(0x7f86680f0d40 msgr2=0x7f86680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.150+0000 7f866d14e700 1 -- 172.21.15.96:0/3105627732 shutdown_connections 2022-02-02T19:42:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.150+0000 7f866d14e700 1 -- 172.21.15.96:0/3105627732 wait complete. 2022-02-02T19:42:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.150+0000 7f866d14e700 1 Processor -- start 2022-02-02T19:42:56.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.150+0000 7f866d14e700 1 -- start start 2022-02-02T19:42:56.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866d14e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f55c0 0x7f8668109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:56.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866d14e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:56.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866d14e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680603c0 con 0x7f86680f6860 2022-02-02T19:42:56.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866d14e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668060500 con 0x7f86680f55c0 2022-02-02T19:42:56.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:56.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33072/0 (socket says 172.21.15.96:33072) 2022-02-02T19:42:56.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 -- 172.21.15.96:0/3793429044 learned_addr learned my addr 172.21.15.96:0/3793429044 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:42:56.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f8666d9d700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f55c0 0x7f8668109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:56.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 -- 172.21.15.96:0/3793429044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f55c0 msgr2=0x7f8668109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f55c0 0x7f8668109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 -- 172.21.15.96:0/3793429044 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c005040 con 0x7f86680f6860 2022-02-02T19:42:56.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866659c700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f8658002700 tx=0x7f8658009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:56.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8658009320 con 0x7f86680f6860 2022-02-02T19:42:56.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f865800f040 con 0x7f86680f6860 2022-02-02T19:42:56.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866810c6c0 con 0x7f86680f6860 2022-02-02T19:42:56.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.151+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8658014820 con 0x7f86680f6860 2022-02-02T19:42:56.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.152+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8668105a70 con 0x7f86680f6860 2022-02-02T19:42:56.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.153+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680f49b0 con 0x7f86680f6860 2022-02-02T19:42:56.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.153+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8658009480 con 0x7f86680f6860 2022-02-02T19:42:56.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.154+0000 7f864f7fe700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 0x7f865006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:42:56.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.154+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8658081cc0 con 0x7f86680f6860 2022-02-02T19:42:56.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.154+0000 7f8666d9d700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 0x7f865006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:42:56.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.154+0000 7f8666d9d700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 0x7f865006b6a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f865c004e30 tx=0x7f865c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:42:56.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.158+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f865804fdc0 con 0x7f86680f6860 2022-02-02T19:42:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.361+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8668045ad0 con 0x7f86680f6860 2022-02-02T19:42:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.362+0000 7f864f7fe700 1 -- 172.21.15.96:0/3793429044 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f86580533e0 con 0x7f86680f6860 2022-02-02T19:42:56.366 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:42:56.366 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:42:56.366 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:42:56.367 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:42:56.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:56.367 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:42:56.367 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:42:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:42:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:42:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:42:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:42:56.369 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:42:56.369 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:42:56.369 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:42:56.369 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:42:56.369 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:42:56.370 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:42:56.370 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:42:56.370 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:42:56.370 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:42:56.371 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:42:56.371 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:42:56.371 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:42:56.371 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:42:56.371 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:42:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:42:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:42:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:42:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:42:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:42:56.373 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:42:56.373 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:42:56.373 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:56.373 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:56.374 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:42:56.374 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:42:56.374 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:56.374 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:56.375 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:42:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 msgr2=0x7f865006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 0x7f865006b6a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f865c004e30 tx=0x7f865c009b30).stop 2022-02-02T19:42:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 msgr2=0x7f866810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:42:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f8658002700 tx=0x7f8658009e00).stop 2022-02-02T19:42:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 shutdown_connections 2022-02-02T19:42:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f86500691e0 0x7f865006b6a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f55c0 0x7f8668109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 --2- 172.21.15.96:0/3793429044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6860 0x7f866810c110 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:42:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 >> 172.21.15.96:0/3793429044 conn(0x7f86680f0d40 msgr2=0x7f86680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:42:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 shutdown_connections 2022-02-02T19:42:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:42:56.364+0000 7f866d14e700 1 -- 172.21.15.96:0/3793429044 wait complete. 2022-02-02T19:42:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:42:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:56 smithi159 ceph-mon[69013]: pgmap v2425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2861569714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:42:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:56 smithi096 ceph-mon[101353]: pgmap v2425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:56.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2861569714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:42:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:57 smithi159 ceph-mon[69013]: from='client.36600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:57.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:57 smithi159 ceph-mon[69013]: from='client.36604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:57.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3793429044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:42:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:57 smithi096 ceph-mon[101353]: from='client.36600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:57 smithi096 ceph-mon[101353]: from='client.36604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:42:57.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3793429044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:42:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:42:58 smithi159 ceph-mon[69013]: pgmap v2426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:42:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:42:58 smithi096 ceph-mon[101353]: pgmap v2426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:00 smithi159 ceph-mon[69013]: pgmap v2427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:00 smithi096 ceph-mon[101353]: pgmap v2427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:02 smithi159 ceph-mon[69013]: pgmap v2428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:02 smithi096 ceph-mon[101353]: pgmap v2428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:04 smithi159 ceph-mon[69013]: pgmap v2429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:04 smithi096 ceph-mon[101353]: pgmap v2429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:06 smithi159 ceph-mon[69013]: pgmap v2430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:06 smithi096 ceph-mon[101353]: pgmap v2430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:08.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:08 smithi159 ceph-mon[69013]: pgmap v2431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:08 smithi096 ceph-mon[101353]: pgmap v2431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:10 smithi159 ceph-mon[69013]: pgmap v2432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:10 smithi096 ceph-mon[101353]: pgmap v2432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:12 smithi159 ceph-mon[69013]: pgmap v2433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:12 smithi096 ceph-mon[101353]: pgmap v2433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:14 smithi159 ceph-mon[69013]: pgmap v2434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:14 smithi096 ceph-mon[101353]: pgmap v2434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:15.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:15 smithi159 ceph-mon[69013]: pgmap v2435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:15.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:15 smithi096 ceph-mon[101353]: pgmap v2435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:18 smithi159 ceph-mon[69013]: pgmap v2436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:18 smithi096 ceph-mon[101353]: pgmap v2436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:20 smithi159 ceph-mon[69013]: pgmap v2437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:20 smithi096 ceph-mon[101353]: pgmap v2437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:22 smithi159 ceph-mon[69013]: pgmap v2438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:22 smithi096 ceph-mon[101353]: pgmap v2438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:24 smithi159 ceph-mon[69013]: pgmap v2439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:24 smithi096 ceph-mon[101353]: pgmap v2439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:26.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- 172.21.15.96:0/4090434778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 msgr2=0x7fbca40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 --2- 172.21.15.96:0/4090434778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca40f6cc0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fbc94004660 tx=0x7fbc94009b30).stop 2022-02-02T19:43:26.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- 172.21.15.96:0/4090434778 shutdown_connections 2022-02-02T19:43:26.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 --2- 172.21.15.96:0/4090434778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca40f6cc0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 --2- 172.21.15.96:0/4090434778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:43:26.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- 172.21.15.96:0/4090434778 >> 172.21.15.96:0/4090434778 conn(0x7fbca40f0d40 msgr2=0x7fbca40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:26.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- 172.21.15.96:0/4090434778 shutdown_connections 2022-02-02T19:43:26.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- 172.21.15.96:0/4090434778 wait complete. 2022-02-02T19:43:26.477 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:26 smithi096 ceph-mon[101353]: pgmap v2440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:26.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 Processor -- start 2022-02-02T19:43:26.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.471+0000 7fbca8950700 1 -- start start 2022-02-02T19:43:26.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4060470 con 0x7fbca40f6860 2022-02-02T19:43:26.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40605b0 con 0x7fbca40f55c0 2022-02-02T19:43:26.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33090/0 (socket says 172.21.15.96:33090) 2022-02-02T19:43:26.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 -- 172.21.15.96:0/30879482 learned_addr learned my addr 172.21.15.96:0/30879482 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:26.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca259c700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 -- 172.21.15.96:0/30879482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 msgr2=0x7fbca4109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca4109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 -- 172.21.15.96:0/30879482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94005040 con 0x7fbca40f6860 2022-02-02T19:43:26.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca259c700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:43:26.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca1d9b700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fbc94009990 tx=0x7fbc94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc94018070 con 0x7fbca40f6860 2022-02-02T19:43:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca410c7b0 con 0x7fbca40f6860 2022-02-02T19:43:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbc94007ca0 con 0x7fbca40f6860 2022-02-02T19:43:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9401c620 con 0x7fbca40f6860 2022-02-02T19:43:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.472+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca410cce0 con 0x7fbca40f6860 2022-02-02T19:43:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.473+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40f49b0 con 0x7fbca40f6860 2022-02-02T19:43:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.474+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbc9401d960 con 0x7fbca40f6860 2022-02-02T19:43:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.474+0000 7fbc92ffd700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 0x7fbc8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.474+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbc94083660 con 0x7fbca40f6860 2022-02-02T19:43:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.474+0000 7fbca259c700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 0x7fbc8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.475+0000 7fbca259c700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 0x7fbc8c067290 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fbca4060060 tx=0x7fbc98008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.479+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbc94051760 con 0x7fbca40f6860 2022-02-02T19:43:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:26 smithi159 ceph-mon[69013]: pgmap v2440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:26.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.657+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbca40fdf90 con 0x7fbc8c064dd0 2022-02-02T19:43:26.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.659+0000 7fbc92ffd700 1 -- 172.21.15.96:0/30879482 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbca40fdf90 con 0x7fbc8c064dd0 2022-02-02T19:43:26.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.660+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 msgr2=0x7fbc8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.660+0000 7fbca8950700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 0x7fbc8c067290 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fbca4060060 tx=0x7fbc98008040).stop 2022-02-02T19:43:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.660+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 msgr2=0x7fbca410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.660+0000 7fbca8950700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fbc94009990 tx=0x7fbc94009b30).stop 2022-02-02T19:43:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 shutdown_connections 2022-02-02T19:43:26.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbc8c064dd0 0x7fbc8c067290 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca40f55c0 0x7fbca4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 --2- 172.21.15.96:0/30879482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca40f6860 0x7fbca410c1b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 >> 172.21.15.96:0/30879482 conn(0x7fbca40f0d40 msgr2=0x7fbca40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 shutdown_connections 2022-02-02T19:43:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.661+0000 7fbca8950700 1 -- 172.21.15.96:0/30879482 wait complete. 2022-02-02T19:43:26.674 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:43:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 -- 172.21.15.96:0/994129693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 msgr2=0x7fd3bc0f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/994129693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc0f5fd0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fd3ac004660 tx=0x7fd3ac009b30).stop 2022-02-02T19:43:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 -- 172.21.15.96:0/994129693 shutdown_connections 2022-02-02T19:43:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/994129693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 0x7fd3bc0f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:43:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/994129693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc0f5fd0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 -- 172.21.15.96:0/994129693 >> 172.21.15.96:0/994129693 conn(0x7fd3bc0f04c0 msgr2=0x7fd3bc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 -- 172.21.15.96:0/994129693 shutdown_connections 2022-02-02T19:43:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.758+0000 7fd3c3de9700 1 -- 172.21.15.96:0/994129693 wait complete. 2022-02-02T19:43:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 Processor -- start 2022-02-02T19:43:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 -- start start 2022-02-02T19:43:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 0x7fd3bc10c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0f5710 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c3de9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0f5850 con 0x7fd3bc0f6550 2022-02-02T19:43:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c1b85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c1b85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33098/0 (socket says 172.21.15.96:33098) 2022-02-02T19:43:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c1b85700 1 -- 172.21.15.96:0/1084869473 learned_addr learned my addr 172.21.15.96:0/1084869473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.759+0000 7fd3c1384700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 0x7fd3bc10c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c1b85700 1 -- 172.21.15.96:0/1084869473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 msgr2=0x7fd3bc10c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c1b85700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 0x7fd3bc10c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c1b85700 1 -- 172.21.15.96:0/1084869473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac005040 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c1b85700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fd3ac009d80 tx=0x7fd3ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ac018070 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3ac007ba0 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc10c820 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ac01c620 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.760+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc10cd80 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.761+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc045ad0 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.761+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3ac01d420 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.762+0000 7fd3b27fc700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 0x7fd3a8067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.762+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd3ac083320 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.762+0000 7fd3c1384700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 0x7fd3a8067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.762+0000 7fd3c1384700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 0x7fd3a8067280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fd3b800b790 tx=0x7fd3b8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:26.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.766+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3ac0513c0 con 0x7fd3bc0f5bb0 2022-02-02T19:43:26.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.939+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3bc0fdf90 con 0x7fd3a8064dc0 2022-02-02T19:43:26.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.948+0000 7fd3b27fc700 1 -- 172.21.15.96:0/1084869473 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd3bc0fdf90 con 0x7fd3a8064dc0 2022-02-02T19:43:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:43:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (86m) 57m ago 87m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:43:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (79m) 57m ago 87m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:43:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (79m) 55m ago 87m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:43:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (86m) 57m ago 87m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:43:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (83m) 57m ago 83m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:43:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (79m) 57m ago 83m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:43:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (83m) 55m ago 83m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:43:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (79m) 55m ago 84m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:43:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (81m) 57m ago 89m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:43:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (80m) 55m ago 87m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:43:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (80m) 57m ago 89m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:43:26.956 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (79m) 55m ago 87m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:43:26.956 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (87m) 57m ago 87m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:43:26.956 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (87m) 55m ago 87m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:43:26.956 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (78m) 57m ago 86m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:43:26.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (78m) 57m ago 86m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:43:26.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (77m) 57m ago 86m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:43:26.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (77m) 55m ago 85m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:43:26.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (76m) 55m ago 85m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:43:26.958 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (76m) 55m ago 85m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:43:26.958 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (86m) 57m ago 87m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:43:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 msgr2=0x7fd3a8067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 0x7fd3a8067280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fd3b800b790 tx=0x7fd3b8008040).stop 2022-02-02T19:43:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 msgr2=0x7fd3bc109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fd3ac009d80 tx=0x7fd3ac009b30).stop 2022-02-02T19:43:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 shutdown_connections 2022-02-02T19:43:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd3a8064dc0 0x7fd3a8067280 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3bc0f5bb0 0x7fd3bc109d70 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 --2- 172.21.15.96:0/1084869473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3bc0f6550 0x7fd3bc10c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:26.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 >> 172.21.15.96:0/1084869473 conn(0x7fd3bc0f04c0 msgr2=0x7fd3bc0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:26.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 shutdown_connections 2022-02-02T19:43:26.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:26.950+0000 7fd3c3de9700 1 -- 172.21.15.96:0/1084869473 wait complete. 2022-02-02T19:43:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3068130820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f4a40 msgr2=0x7fd1d40f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3068130820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f4e60 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fd1c8004660 tx=0x7fd1c8009b30).stop 2022-02-02T19:43:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3068130820 shutdown_connections 2022-02-02T19:43:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3068130820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3068130820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f4e60 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.046+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3068130820 >> 172.21.15.96:0/3068130820 conn(0x7fd1d40f04c0 msgr2=0x7fd1d40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.047+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3068130820 shutdown_connections 2022-02-02T19:43:27.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.047+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3068130820 wait complete. 2022-02-02T19:43:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 Processor -- start 2022-02-02T19:43:27.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 -- start start 2022-02-02T19:43:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40f6010 con 0x7fd1d40f53e0 2022-02-02T19:43:27.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d90e4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40f6150 con 0x7fd1d40f4a40 2022-02-02T19:43:27.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33108/0 (socket says 172.21.15.96:33108) 2022-02-02T19:43:27.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 -- 172.21.15.96:0/3430232724 learned_addr learned my addr 172.21.15.96:0/3430232724 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:27.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d2d9d700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 -- 172.21.15.96:0/3430232724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f4a40 msgr2=0x7fd1d40f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.048+0000 7fd1d259c700 1 -- 172.21.15.96:0/3430232724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8005040 con 0x7fd1d40f53e0 2022-02-02T19:43:27.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1d259c700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fd1c4002700 tx=0x7fd1c4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:27.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c40079c0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d40f6430 con 0x7fd1d40f53e0 2022-02-02T19:43:27.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1c400f040 con 0x7fd1d40f53e0 2022-02-02T19:43:27.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c4014860 con 0x7fd1d40f53e0 2022-02-02T19:43:27.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.049+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d410f270 con 0x7fd1d40f53e0 2022-02-02T19:43:27.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.050+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d4045ad0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.051+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd1c401b060 con 0x7fd1d40f53e0 2022-02-02T19:43:27.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.051+0000 7fd1bb7fe700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 0x7fd1bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.051+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1c40818e0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.051+0000 7fd1d2d9d700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 0x7fd1bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.052+0000 7fd1d2d9d700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 0x7fd1bc067290 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fd1c8004630 tx=0x7fd1c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:27.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.055+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1c404f9e0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.292+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd1d40ff0f0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.292+0000 7fd1bb7fe700 1 -- 172.21.15.96:0/3430232724 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd1c40192e0 con 0x7fd1d40f53e0 2022-02-02T19:43:27.297 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:43:27.297 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:43:27.297 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:43:27.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:27.298 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:43:27.298 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:43:27.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:27.298 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:43:27.299 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:43:27.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:27.300 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:43:27.300 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:43:27.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:27.300 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:43:27.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:43:27.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:43:27.301 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:43:27.301 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:43:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 msgr2=0x7fd1bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 0x7fd1bc067290 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fd1c8004630 tx=0x7fd1c8009b30).stop 2022-02-02T19:43:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 msgr2=0x7fd1d40f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fd1c4002700 tx=0x7fd1c4009d80).stop 2022-02-02T19:43:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 shutdown_connections 2022-02-02T19:43:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1bc064dd0 0x7fd1bc067290 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f4a40 0x7fd1d40f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 --2- 172.21.15.96:0/3430232724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f53e0 0x7fd1d40f5ab0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 >> 172.21.15.96:0/3430232724 conn(0x7fd1d40f04c0 msgr2=0x7fd1d40fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 shutdown_connections 2022-02-02T19:43:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.295+0000 7fd1d90e4700 1 -- 172.21.15.96:0/3430232724 wait complete. 2022-02-02T19:43:27.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/2629206271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f55d0 msgr2=0x7fd49c0f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/2629206271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f55d0 0x7fd49c0f59f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fd490004660 tx=0x7fd490009b30).stop 2022-02-02T19:43:27.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/2629206271 shutdown_connections 2022-02-02T19:43:27.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/2629206271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f6870 0x7fd49c0f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/2629206271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f55d0 0x7fd49c0f59f0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/2629206271 >> 172.21.15.96:0/2629206271 conn(0x7fd49c0f0d30 msgr2=0x7fd49c0f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:27.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/2629206271 shutdown_connections 2022-02-02T19:43:27.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.392+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/2629206271 wait complete. 2022-02-02T19:43:27.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 Processor -- start 2022-02-02T19:43:27.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 -- start start 2022-02-02T19:43:27.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f55d0 0x7fd49c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c106910 con 0x7fd49c0f6870 2022-02-02T19:43:27.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.393+0000 7fd4a2cb8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c106a50 con 0x7fd49c0f55d0 2022-02-02T19:43:27.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33118/0 (socket says 172.21.15.96:33118) 2022-02-02T19:43:27.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 -- 172.21.15.96:0/1012139694 learned_addr learned my addr 172.21.15.96:0/1012139694 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:27.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4a0a54700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f55d0 0x7fd49c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 -- 172.21.15.96:0/1012139694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f55d0 msgr2=0x7fd49c105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f55d0 0x7fd49c105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 -- 172.21.15.96:0/1012139694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490005040 con 0x7fd49c0f6870 2022-02-02T19:43:27.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd49bfff700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fd4880026d0 tx=0x7fd488009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:27.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4880079c0 con 0x7fd49c0f6870 2022-02-02T19:43:27.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c1073f0 con 0x7fd49c0f6870 2022-02-02T19:43:27.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd48800f040 con 0x7fd49c0f6870 2022-02-02T19:43:27.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4880148b0 con 0x7fd49c0f6870 2022-02-02T19:43:27.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.394+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c1079b0 con 0x7fd49c0f6870 2022-02-02T19:43:27.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.395+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c045ad0 con 0x7fd49c0f6870 2022-02-02T19:43:27.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.396+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd488007b20 con 0x7fd49c0f6870 2022-02-02T19:43:27.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.396+0000 7fd4997fa700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 0x7fd48c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:27.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.396+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd4880819e0 con 0x7fd49c0f6870 2022-02-02T19:43:27.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.396+0000 7fd4a0a54700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 0x7fd48c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:27.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.397+0000 7fd4a0a54700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 0x7fd48c067290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fd490004630 tx=0x7fd490009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:27.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.400+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd488053510 con 0x7fd49c0f6870 2022-02-02T19:43:27.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.601+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd49c108050 con 0x7fd49c0f6870 2022-02-02T19:43:27.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.602+0000 7fd4997fa700 1 -- 172.21.15.96:0/1012139694 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd488053100 con 0x7fd49c0f6870 2022-02-02T19:43:27.606 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:43:27.606 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:43:27.606 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:43:27.607 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:43:27.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:27.607 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:43:27.607 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:43:27.608 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:43:27.608 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:43:27.608 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:43:27.608 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:43:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:43:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:43:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:43:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:43:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:43:27.610 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:43:27.610 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:43:27.610 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:43:27.610 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:43:27.610 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:43:27.611 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:43:27.611 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:43:27.611 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:43:27.611 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:43:27.612 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:43:27.612 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:43:27.612 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:43:27.612 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:43:27.613 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:43:27.613 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:43:27.613 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:43:27.613 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:27.613 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:27.614 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:43:27.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:27.614 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:27.614 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:27.615 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:27.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.603+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 msgr2=0x7fd48c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.603+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 0x7fd48c067290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fd490004630 tx=0x7fd490009b30).stop 2022-02-02T19:43:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.603+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 msgr2=0x7fd49c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.603+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fd4880026d0 tx=0x7fd488009de0).stop 2022-02-02T19:43:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.603+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 shutdown_connections 2022-02-02T19:43:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd48c064dd0 0x7fd48c067290 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c0f55d0 0x7fd49c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 --2- 172.21.15.96:0/1012139694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c0f6870 0x7fd49c106360 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 >> 172.21.15.96:0/1012139694 conn(0x7fd49c0f0d30 msgr2=0x7fd49c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 shutdown_connections 2022-02-02T19:43:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:27.604+0000 7fd4a2cb8700 1 -- 172.21.15.96:0/1012139694 wait complete. 2022-02-02T19:43:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:43:28.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: pgmap v2441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:28.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='client.36616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:28.532 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:28.533 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:43:28.533 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:43:28.533 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3430232724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:43:28.533 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1012139694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:43:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: pgmap v2441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='client.36616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:28.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:43:28.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:43:28.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3430232724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:43:28.561 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1012139694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:43:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:30 smithi159 ceph-mon[69013]: pgmap v2442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:30 smithi096 ceph-mon[101353]: pgmap v2442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:32 smithi159 ceph-mon[69013]: pgmap v2443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:32 smithi096 ceph-mon[101353]: pgmap v2443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:34 smithi159 ceph-mon[69013]: pgmap v2444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:34 smithi096 ceph-mon[101353]: pgmap v2444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:36 smithi159 ceph-mon[69013]: pgmap v2445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:36 smithi096 ceph-mon[101353]: pgmap v2445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:38 smithi159 ceph-mon[69013]: pgmap v2446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:38 smithi096 ceph-mon[101353]: pgmap v2446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:40 smithi159 ceph-mon[69013]: pgmap v2447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:40 smithi096 ceph-mon[101353]: pgmap v2447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:42 smithi159 ceph-mon[69013]: pgmap v2448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:42 smithi096 ceph-mon[101353]: pgmap v2448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:44 smithi159 ceph-mon[69013]: pgmap v2449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:44 smithi096 ceph-mon[101353]: pgmap v2449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:46 smithi159 ceph-mon[69013]: pgmap v2450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:46 smithi096 ceph-mon[101353]: pgmap v2450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:48 smithi159 ceph-mon[69013]: pgmap v2451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:48 smithi096 ceph-mon[101353]: pgmap v2451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:50 smithi159 ceph-mon[69013]: pgmap v2452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:50 smithi096 ceph-mon[101353]: pgmap v2452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:52 smithi159 ceph-mon[69013]: pgmap v2453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:52 smithi096 ceph-mon[101353]: pgmap v2453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:54 smithi159 ceph-mon[69013]: pgmap v2454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:54 smithi096 ceph-mon[101353]: pgmap v2454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:56 smithi159 ceph-mon[69013]: pgmap v2455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:56 smithi096 ceph-mon[101353]: pgmap v2455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:57.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- 172.21.15.96:0/1014371441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 msgr2=0x7f23680f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:57.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 --2- 172.21.15.96:0/1014371441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f9340 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f235c004660 tx=0x7f235c009b30).stop 2022-02-02T19:43:57.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- 172.21.15.96:0/1014371441 shutdown_connections 2022-02-02T19:43:57.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 --2- 172.21.15.96:0/1014371441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 0x7f23680fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:43:57.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 --2- 172.21.15.96:0/1014371441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f9340 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- 172.21.15.96:0/1014371441 >> 172.21.15.96:0/1014371441 conn(0x7f23680f0d40 msgr2=0x7f23680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- 172.21.15.96:0/1014371441 shutdown_connections 2022-02-02T19:43:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- 172.21.15.96:0/1014371441 wait complete. 2022-02-02T19:43:57.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 Processor -- start 2022-02-02T19:43:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.709+0000 7f236f095700 1 -- start start 2022-02-02T19:43:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236f095700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236f095700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 0x7f23680f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236f095700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680f5830 con 0x7f2368060270 2022-02-02T19:43:57.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236f095700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680f5970 con 0x7f23680f9830 2022-02-02T19:43:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33134/0 (socket says 172.21.15.96:33134) 2022-02-02T19:43:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 -- 172.21.15.96:0/2128230379 learned_addr learned my addr 172.21.15.96:0/2128230379 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:57.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 -- 172.21.15.96:0/2128230379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 msgr2=0x7f23680f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f2367fff700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 0x7f23680f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 0x7f23680f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 -- 172.21.15.96:0/2128230379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c005040 con 0x7f2368060270 2022-02-02T19:43:57.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f236ce31700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f235c009990 tx=0x7f235c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.710+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235c018070 con 0x7f2368060270 2022-02-02T19:43:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.711+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23680f5bf0 con 0x7f2368060270 2022-02-02T19:43:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.711+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f235c007ca0 con 0x7f2368060270 2022-02-02T19:43:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.711+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235c01c600 con 0x7f2368060270 2022-02-02T19:43:57.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.711+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236810ef90 con 0x7f2368060270 2022-02-02T19:43:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.711+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2368045ad0 con 0x7f2368060270 2022-02-02T19:43:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.712+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f235c01d9d0 con 0x7f2368060270 2022-02-02T19:43:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.712+0000 7f23657fa700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 0x7f2358067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:57.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.712+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f235c0838f0 con 0x7f2368060270 2022-02-02T19:43:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.713+0000 7f2367fff700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 0x7f2358067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.713+0000 7f2367fff700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 0x7f2358067290 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f2354006fd0 tx=0x7f2354008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:57.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.717+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f235c0519f0 con 0x7f2368060270 2022-02-02T19:43:57.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.894+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23680ff010 con 0x7f2358064dd0 2022-02-02T19:43:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.895+0000 7f23657fa700 1 -- 172.21.15.96:0/2128230379 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f23680ff010 con 0x7f2358064dd0 2022-02-02T19:43:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 msgr2=0x7f2358067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 0x7f2358067290 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f2354006fd0 tx=0x7f2354008040).stop 2022-02-02T19:43:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 msgr2=0x7f23680f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f235c009990 tx=0x7f235c009b30).stop 2022-02-02T19:43:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 shutdown_connections 2022-02-02T19:43:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2358064dd0 0x7f2358067290 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2368060270 0x7f23680f6dc0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:57.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 --2- 172.21.15.96:0/2128230379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f9830 0x7f23680f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:57.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 >> 172.21.15.96:0/2128230379 conn(0x7f23680f0d40 msgr2=0x7f23680f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:57.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 shutdown_connections 2022-02-02T19:43:57.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.897+0000 7f236f095700 1 -- 172.21.15.96:0/2128230379 wait complete. 2022-02-02T19:43:57.911 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:43:57.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 -- 172.21.15.96:0/676794280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f55c0 msgr2=0x7f8a540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/676794280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f55c0 0x7f8a540f59e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f8a4c0099e0 tx=0x7f8a4c004d10).stop 2022-02-02T19:43:58.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 -- 172.21.15.96:0/676794280 shutdown_connections 2022-02-02T19:43:58.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/676794280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f6860 0x7f8a540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/676794280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f55c0 0x7f8a540f59e0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 -- 172.21.15.96:0/676794280 >> 172.21.15.96:0/676794280 conn(0x7f8a540f0d40 msgr2=0x7f8a540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 -- 172.21.15.96:0/676794280 shutdown_connections 2022-02-02T19:43:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.994+0000 7f8a5aef1700 1 -- 172.21.15.96:0/676794280 wait complete. 2022-02-02T19:43:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 Processor -- start 2022-02-02T19:43:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 -- start start 2022-02-02T19:43:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f55c0 0x7f8a5410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540602b0 con 0x7f8a540f6860 2022-02-02T19:43:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a5aef1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540603f0 con 0x7f8a540f55c0 2022-02-02T19:43:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33146/0 (socket says 172.21.15.96:33146) 2022-02-02T19:43:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.995+0000 7f8a53fff700 1 -- 172.21.15.96:0/1572687252 learned_addr learned my addr 172.21.15.96:0/1572687252 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:58.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a58c8d700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f55c0 0x7f8a5410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a53fff700 1 -- 172.21.15.96:0/1572687252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f55c0 msgr2=0x7f8a5410c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a53fff700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f55c0 0x7f8a5410c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a53fff700 1 -- 172.21.15.96:0/1572687252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c009640 con 0x7f8a540f6860 2022-02-02T19:43:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a53fff700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f8a3c00e7f0 tx=0x7f8a3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c0092e0 con 0x7f8a540f6860 2022-02-02T19:43:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a3c00f040 con 0x7f8a540f6860 2022-02-02T19:43:58.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5410eb70 con 0x7f8a540f6860 2022-02-02T19:43:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c014750 con 0x7f8a540f6860 2022-02-02T19:43:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.996+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5410eff0 con 0x7f8a540f6860 2022-02-02T19:43:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.997+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a54045ad0 con 0x7f8a540f6860 2022-02-02T19:43:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.998+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a3c01b030 con 0x7f8a540f6860 2022-02-02T19:43:58.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.998+0000 7f8a517fa700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 0x7f8a40067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.998+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a3c081730 con 0x7f8a540f6860 2022-02-02T19:43:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.998+0000 7f8a58c8d700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 0x7f8a40067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:57.998+0000 7f8a58c8d700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 0x7f8a40067270 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f8a54060040 tx=0x7f8a4c015040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.002+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a3c04f8e0 con 0x7f8a540f6860 2022-02-02T19:43:58.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.175+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a54057f10 con 0x7f8a40064db0 2022-02-02T19:43:58.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.185+0000 7f8a517fa700 1 -- 172.21.15.96:0/1572687252 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8a54057f10 con 0x7f8a40064db0 2022-02-02T19:43:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:43:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (87m) 57m ago 88m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:43:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (79m) 57m ago 88m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:43:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (79m) 56m ago 87m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:43:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (87m) 57m ago 88m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:43:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (84m) 57m ago 84m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:43:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (80m) 57m ago 84m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:43:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (84m) 56m ago 84m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:43:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (80m) 56m ago 84m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:43:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (81m) 57m ago 89m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:43:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (81m) 56m ago 87m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:43:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (80m) 57m ago 89m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:43:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (80m) 56m ago 87m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:43:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (88m) 57m ago 88m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:43:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (87m) 56m ago 87m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:43:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (79m) 57m ago 87m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:43:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (78m) 57m ago 86m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:43:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (78m) 57m ago 86m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:43:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (77m) 56m ago 86m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:43:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (77m) 56m ago 86m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:43:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (76m) 56m ago 85m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:43:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (87m) 57m ago 88m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:43:58.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 msgr2=0x7f8a40067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 0x7f8a40067270 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f8a54060040 tx=0x7f8a4c015040).stop 2022-02-02T19:43:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 msgr2=0x7f8a5410e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f8a3c00e7f0 tx=0x7f8a3c00b040).stop 2022-02-02T19:43:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 shutdown_connections 2022-02-02T19:43:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a40064db0 0x7f8a40067270 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a540f55c0 0x7f8a5410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 --2- 172.21.15.96:0/1572687252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a540f6860 0x7f8a5410e680 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.187+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 >> 172.21.15.96:0/1572687252 conn(0x7f8a540f0d40 msgr2=0x7f8a540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.188+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 shutdown_connections 2022-02-02T19:43:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.188+0000 7f8a5aef1700 1 -- 172.21.15.96:0/1572687252 wait complete. 2022-02-02T19:43:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.283+0000 7fabfd5a5700 1 -- 172.21.15.96:0/1619443979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 msgr2=0x7fabf80f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.283+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/1619443979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f9170 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fabe8004660 tx=0x7fabe8009b30).stop 2022-02-02T19:43:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 -- 172.21.15.96:0/1619443979 shutdown_connections 2022-02-02T19:43:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/1619443979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/1619443979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f9170 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 -- 172.21.15.96:0/1619443979 >> 172.21.15.96:0/1619443979 conn(0x7fabf80f0b90 msgr2=0x7fabf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:58 smithi096 ceph-mon[101353]: pgmap v2456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 -- 172.21.15.96:0/1619443979 shutdown_connections 2022-02-02T19:43:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 -- 172.21.15.96:0/1619443979 wait complete. 2022-02-02T19:43:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 Processor -- start 2022-02-02T19:43:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.284+0000 7fabfd5a5700 1 -- start start 2022-02-02T19:43:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabfd5a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabfd5a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabfd5a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80f55d0 con 0x7fabf80602b0 2022-02-02T19:43:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabfd5a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80f5710 con 0x7fabf80f96f0 2022-02-02T19:43:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33152/0 (socket says 172.21.15.96:33152) 2022-02-02T19:43:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 -- 172.21.15.96:0/2041456194 learned_addr learned my addr 172.21.15.96:0/2041456194 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf77fe700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 -- 172.21.15.96:0/2041456194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 msgr2=0x7fabf80f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 -- 172.21.15.96:0/2041456194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8005040 con 0x7fabf80602b0 2022-02-02T19:43:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf77fe700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:43:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf7fff700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fabe8009990 tx=0x7fabe8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe8018070 con 0x7fabf80602b0 2022-02-02T19:43:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf80f5990 con 0x7fabf80602b0 2022-02-02T19:43:58.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fabe8007ca0 con 0x7fabf80602b0 2022-02-02T19:43:58.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.285+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe801c620 con 0x7fabf80602b0 2022-02-02T19:43:58.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.286+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf80f5ef0 con 0x7fabf80602b0 2022-02-02T19:43:58.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.287+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf8045ad0 con 0x7fabf80602b0 2022-02-02T19:43:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.287+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fabe801d420 con 0x7fabf80602b0 2022-02-02T19:43:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.287+0000 7fabf4ff9700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 0x7fabe00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.288+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fabe8083810 con 0x7fabf80602b0 2022-02-02T19:43:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.288+0000 7fabf77fe700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 0x7fabe00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.288+0000 7fabf77fe700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 0x7fabe00672e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fabf8060080 tx=0x7fabec009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.291+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fabe8051910 con 0x7fabf80602b0 2022-02-02T19:43:58.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.520+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabf8027a00 con 0x7fabf80602b0 2022-02-02T19:43:58.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.521+0000 7fabf4ff9700 1 -- 172.21.15.96:0/2041456194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fabe8054f30 con 0x7fabf80602b0 2022-02-02T19:43:58.526 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:43:58.526 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:43:58.526 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:43:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:43:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:43:58.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:43:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:43:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:43:58.528 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:43:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:43:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:43:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:43:58.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:43:58.530 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:43:58.530 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:43:58.531 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:58 smithi159 ceph-mon[69013]: pgmap v2456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:43:58.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 msgr2=0x7fabe00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 0x7fabe00672e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fabf8060080 tx=0x7fabec009040).stop 2022-02-02T19:43:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 msgr2=0x7fabf80f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fabe8009990 tx=0x7fabe8009b30).stop 2022-02-02T19:43:58.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 shutdown_connections 2022-02-02T19:43:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabe0064e20 0x7fabe00672e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabf80602b0 0x7fabf80f6bf0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 --2- 172.21.15.96:0/2041456194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf80f96f0 0x7fabf80f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 >> 172.21.15.96:0/2041456194 conn(0x7fabf80f0b90 msgr2=0x7fabf80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 shutdown_connections 2022-02-02T19:43:58.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.523+0000 7fabfd5a5700 1 -- 172.21.15.96:0/2041456194 wait complete. 2022-02-02T19:43:58.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 -- 172.21.15.96:0/3907825458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f6c60 msgr2=0x7ff7b00f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/3907825458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f6c60 0x7ff7b00f7080 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7ff7a0004660 tx=0x7ff7a0009b30).stop 2022-02-02T19:43:58.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 -- 172.21.15.96:0/3907825458 shutdown_connections 2022-02-02T19:43:58.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/3907825458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f5970 0x7ff7b00f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/3907825458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f6c60 0x7ff7b00f7080 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 -- 172.21.15.96:0/3907825458 >> 172.21.15.96:0/3907825458 conn(0x7ff7b00f04c0 msgr2=0x7ff7b00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 -- 172.21.15.96:0/3907825458 shutdown_connections 2022-02-02T19:43:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.621+0000 7ff7b65a7700 1 -- 172.21.15.96:0/3907825458 wait complete. 2022-02-02T19:43:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 Processor -- start 2022-02-02T19:43:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 -- start start 2022-02-02T19:43:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f6c60 0x7ff7b010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00f5600 con 0x7ff7b00f5970 2022-02-02T19:43:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.622+0000 7ff7b65a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00f5740 con 0x7ff7b00f6c60 2022-02-02T19:43:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33162/0 (socket says 172.21.15.96:33162) 2022-02-02T19:43:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 -- 172.21.15.96:0/2591539073 learned_addr learned my addr 172.21.15.96:0/2591539073 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:43:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7af7fe700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f6c60 0x7ff7b010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 -- 172.21.15.96:0/2591539073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f6c60 msgr2=0x7ff7b010c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f6c60 0x7ff7b010c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 -- 172.21.15.96:0/2591539073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0005040 con 0x7ff7b00f5970 2022-02-02T19:43:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7affff700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7ff7a0009990 tx=0x7ff7a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0018070 con 0x7ff7b00f5970 2022-02-02T19:43:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b010c680 con 0x7ff7b00f5970 2022-02-02T19:43:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7a0007ba0 con 0x7ff7b00f5970 2022-02-02T19:43:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a001c3c0 con 0x7ff7b00f5970 2022-02-02T19:43:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.623+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b010cbb0 con 0x7ff7b00f5970 2022-02-02T19:43:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.624+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b0045ad0 con 0x7ff7b00f5970 2022-02-02T19:43:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.625+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff7a001d420 con 0x7ff7b00f5970 2022-02-02T19:43:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.625+0000 7ff7acff9700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 0x7ff79c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:43:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.625+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff7a00836c0 con 0x7ff7b00f5970 2022-02-02T19:43:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.625+0000 7ff7af7fe700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 0x7ff79c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:43:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.626+0000 7ff7af7fe700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 0x7ff79c067290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7ff798004c40 tx=0x7ff79800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:43:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.629+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff7a0051820 con 0x7ff7b00f5970 2022-02-02T19:43:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.831+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7b00fdfc0 con 0x7ff7b00f5970 2022-02-02T19:43:58.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.831+0000 7ff7acff9700 1 -- 172.21.15.96:0/2591539073 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff7a0051070 con 0x7ff7b00f5970 2022-02-02T19:43:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:43:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:43:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:43:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:43:58.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:58.838 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:43:58.838 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:43:58.838 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:43:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:43:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:43:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:43:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:43:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:43:58.840 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:43:58.840 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:43:58.840 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:43:58.840 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:43:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:43:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:43:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:43:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:43:58.841 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:43:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:43:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:43:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:43:58.842 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:43:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:43:58.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:58.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:43:58.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:43:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:43:58.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 msgr2=0x7ff79c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 0x7ff79c067290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7ff798004c40 tx=0x7ff79800b040).stop 2022-02-02T19:43:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 msgr2=0x7ff7b0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:43:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7ff7a0009990 tx=0x7ff7a0009b30).stop 2022-02-02T19:43:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 shutdown_connections 2022-02-02T19:43:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff79c064dd0 0x7ff79c067290 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00f5970 0x7ff7b0109c30 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 --2- 172.21.15.96:0/2591539073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7b00f6c60 0x7ff7b010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:43:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 >> 172.21.15.96:0/2591539073 conn(0x7ff7b00f04c0 msgr2=0x7ff7b00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:43:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 shutdown_connections 2022-02-02T19:43:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:43:58.833+0000 7ff7b65a7700 1 -- 172.21.15.96:0/2591539073 wait complete. 2022-02-02T19:43:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:43:59.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:59 smithi159 ceph-mon[69013]: from='client.36632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:59.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:59 smithi159 ceph-mon[69013]: from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:59.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2041456194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:43:59.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:43:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2591539073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:43:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:59 smithi096 ceph-mon[101353]: from='client.36632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:59 smithi096 ceph-mon[101353]: from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:43:59.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2041456194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:43:59.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:43:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2591539073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:44:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:00 smithi159 ceph-mon[69013]: pgmap v2457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:00 smithi096 ceph-mon[101353]: pgmap v2457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:02 smithi159 ceph-mon[69013]: pgmap v2458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:02 smithi096 ceph-mon[101353]: pgmap v2458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:04 smithi159 ceph-mon[69013]: pgmap v2459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:04 smithi096 ceph-mon[101353]: pgmap v2459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:06 smithi159 ceph-mon[69013]: pgmap v2460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:06 smithi096 ceph-mon[101353]: pgmap v2460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:08 smithi159 ceph-mon[69013]: pgmap v2461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:08 smithi096 ceph-mon[101353]: pgmap v2461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:10 smithi159 ceph-mon[69013]: pgmap v2462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:10 smithi096 ceph-mon[101353]: pgmap v2462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:12 smithi159 ceph-mon[69013]: pgmap v2463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:12 smithi096 ceph-mon[101353]: pgmap v2463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:14 smithi159 ceph-mon[69013]: pgmap v2464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:14 smithi096 ceph-mon[101353]: pgmap v2464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:16 smithi159 ceph-mon[69013]: pgmap v2465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:16 smithi096 ceph-mon[101353]: pgmap v2465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:18 smithi159 ceph-mon[69013]: pgmap v2466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:18 smithi096 ceph-mon[101353]: pgmap v2466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:20 smithi159 ceph-mon[69013]: pgmap v2467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:20 smithi096 ceph-mon[101353]: pgmap v2467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:22 smithi159 ceph-mon[69013]: pgmap v2468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:22 smithi096 ceph-mon[101353]: pgmap v2468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:24.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:24 smithi159 ceph-mon[69013]: pgmap v2469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:24 smithi096 ceph-mon[101353]: pgmap v2469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:26 smithi159 ceph-mon[69013]: pgmap v2470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:26 smithi096 ceph-mon[101353]: pgmap v2470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:28 smithi159 ceph-mon[69013]: pgmap v2471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:44:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:44:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:28 smithi096 ceph-mon[101353]: pgmap v2471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:44:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:44:28.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.943+0000 7f21b335c700 1 -- 172.21.15.96:0/1091461177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f77d0 msgr2=0x7f21ac0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.943+0000 7f21b335c700 1 --2- 172.21.15.96:0/1091461177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f77d0 0x7f21ac0f7c30 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f219c004660 tx=0x7f219c009b30).stop 2022-02-02T19:44:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 -- 172.21.15.96:0/1091461177 shutdown_connections 2022-02-02T19:44:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 --2- 172.21.15.96:0/1091461177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f77d0 0x7f21ac0f7c30 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:28.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 --2- 172.21.15.96:0/1091461177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f6530 0x7f21ac0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:28.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 -- 172.21.15.96:0/1091461177 >> 172.21.15.96:0/1091461177 conn(0x7f21ac0f1c90 msgr2=0x7f21ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:28.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 -- 172.21.15.96:0/1091461177 shutdown_connections 2022-02-02T19:44:28.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 -- 172.21.15.96:0/1091461177 wait complete. 2022-02-02T19:44:28.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.944+0000 7f21b335c700 1 Processor -- start 2022-02-02T19:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b335c700 1 -- start start 2022-02-02T19:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b335c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b335c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 0x7f21ac107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b335c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac107880 con 0x7f21ac0f6530 2022-02-02T19:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b335c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac108090 con 0x7f21ac0f77d0 2022-02-02T19:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33180/0 (socket says 172.21.15.96:33180) 2022-02-02T19:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 -- 172.21.15.96:0/4244233762 learned_addr learned my addr 172.21.15.96:0/4244233762 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b1b59700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 0x7f21ac107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 -- 172.21.15.96:0/4244233762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 msgr2=0x7f21ac107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 0x7f21ac107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 -- 172.21.15.96:0/4244233762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c005040 con 0x7f21ac0f6530 2022-02-02T19:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b1b59700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 0x7f21ac107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.945+0000 7f21b235a700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f21a800c790 tx=0x7f21a8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.946+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a800e680 con 0x7f21ac0f6530 2022-02-02T19:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.946+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21a800ec90 con 0x7f21ac0f6530 2022-02-02T19:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.946+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac108310 con 0x7f21ac0f6530 2022-02-02T19:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.946+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a8012d00 con 0x7f21ac0f6530 2022-02-02T19:44:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.946+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac1088d0 con 0x7f21ac0f6530 2022-02-02T19:44:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.947+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac059100 con 0x7f21ac0f6530 2022-02-02T19:44:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.947+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21a8010070 con 0x7f21ac0f6530 2022-02-02T19:44:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.947+0000 7f21a2ffd700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.948+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f21a8081b30 con 0x7f21ac0f6530 2022-02-02T19:44:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.948+0000 7f21b1b59700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.948+0000 7f21b1b59700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f219c004e30 tx=0x7f219c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:28.952+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21a804fc30 con 0x7f21ac0f6530 2022-02-02T19:44:29.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.129+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ac0008d0 con 0x7f2198064e20 2022-02-02T19:44:29.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.130+0000 7f21a2ffd700 1 -- 172.21.15.96:0/4244233762 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f21ac0008d0 con 0x7f2198064e20 2022-02-02T19:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 msgr2=0x7f21980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f219c004e30 tx=0x7f219c009b30).stop 2022-02-02T19:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 msgr2=0x7f21ac106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f21a800c790 tx=0x7f21a8007d90).stop 2022-02-02T19:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 shutdown_connections 2022-02-02T19:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064e20 0x7f21980672e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac0f6530 0x7f21ac106d90 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 --2- 172.21.15.96:0/4244233762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f77d0 0x7f21ac107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 >> 172.21.15.96:0/4244233762 conn(0x7f21ac0f1c90 msgr2=0x7f21ac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 shutdown_connections 2022-02-02T19:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.132+0000 7f21b335c700 1 -- 172.21.15.96:0/4244233762 wait complete. 2022-02-02T19:44:29.145 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:44:29.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 -- 172.21.15.96:0/1967018065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 msgr2=0x7f60e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 --2- 172.21.15.96:0/1967018065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 0x7f60e40f7c30 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f60e0004660 tx=0x7f60e0009b30).stop 2022-02-02T19:44:29.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 -- 172.21.15.96:0/1967018065 shutdown_connections 2022-02-02T19:44:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 --2- 172.21.15.96:0/1967018065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 0x7f60e40f7c30 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 --2- 172.21.15.96:0/1967018065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 -- 172.21.15.96:0/1967018065 >> 172.21.15.96:0/1967018065 conn(0x7f60e40f1c90 msgr2=0x7f60e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 -- 172.21.15.96:0/1967018065 shutdown_connections 2022-02-02T19:44:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.230+0000 7f60eae21700 1 -- 172.21.15.96:0/1967018065 wait complete. 2022-02-02T19:44:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 Processor -- start 2022-02-02T19:44:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 -- start start 2022-02-02T19:44:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 0x7f60e41072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4107980 con 0x7f60e40f77d0 2022-02-02T19:44:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60eae21700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4108100 con 0x7f60e40f6530 2022-02-02T19:44:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:37292/0 (socket says 172.21.15.96:37292) 2022-02-02T19:44:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 -- 172.21.15.96:0/782427579 learned_addr learned my addr 172.21.15.96:0/782427579 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:44:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 -- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 msgr2=0x7f60e41072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 0x7f60e41072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.231+0000 7f60e9e1f700 1 -- 172.21.15.96:0/782427579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0005040 con 0x7f60e40f6530 2022-02-02T19:44:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60e9e1f700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f60d40093f0 tx=0x7f60d4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d4009ea0 con 0x7f60e40f6530 2022-02-02T19:44:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e4108380 con 0x7f60e40f6530 2022-02-02T19:44:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e4108940 con 0x7f60e40f6530 2022-02-02T19:44:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60d4013af0 con 0x7f60e40f6530 2022-02-02T19:44:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.232+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d401da90 con 0x7f60e40f6530 2022-02-02T19:44:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.233+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc004fa0 con 0x7f60e40f6530 2022-02-02T19:44:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.234+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f60d401a060 con 0x7f60e40f6530 2022-02-02T19:44:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.234+0000 7f60da7fc700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 0x7f60d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.234+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f60d4081a60 con 0x7f60e40f6530 2022-02-02T19:44:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.234+0000 7f60e961e700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 0x7f60d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.234+0000 7f60e961e700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 0x7f60d00672e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f60e0004e30 tx=0x7f60e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.239+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60d404fb00 con 0x7f60e40f6530 2022-02-02T19:44:29.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.413+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60cc0029f0 con 0x7f60d0064e20 2022-02-02T19:44:29.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.422+0000 7f60da7fc700 1 -- 172.21.15.96:0/782427579 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f60cc0029f0 con 0x7f60d0064e20 2022-02-02T19:44:29.427 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:44:29.428 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (87m) 58m ago 88m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:44:29.428 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (80m) 58m ago 88m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:44:29.428 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (80m) 56m ago 88m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:44:29.429 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (87m) 58m ago 88m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:44:29.429 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (84m) 58m ago 84m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:44:29.429 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (80m) 58m ago 85m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:44:29.430 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (85m) 56m ago 85m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:44:29.430 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (80m) 56m ago 85m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:44:29.430 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (82m) 58m ago 90m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:44:29.430 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (81m) 56m ago 88m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:44:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (81m) 58m ago 90m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:44:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (80m) 56m ago 88m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:44:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (88m) 58m ago 88m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:44:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (88m) 56m ago 88m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:44:29.431 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (79m) 58m ago 87m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:44:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (79m) 58m ago 87m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:44:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (78m) 58m ago 87m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:44:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (78m) 56m ago 86m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:44:29.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (77m) 56m ago 86m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:44:29.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (77m) 56m ago 86m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:44:29.433 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (87m) 58m ago 88m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:44:29.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 msgr2=0x7f60d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 0x7f60d00672e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f60e0004e30 tx=0x7f60e0009b30).stop 2022-02-02T19:44:29.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 msgr2=0x7f60e4106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f60d40093f0 tx=0x7f60d4006ec0).stop 2022-02-02T19:44:29.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 shutdown_connections 2022-02-02T19:44:29.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d0064e20 0x7f60d00672e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e40f6530 0x7f60e4106e00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 --2- 172.21.15.96:0/782427579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e40f77d0 0x7f60e41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.424+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 >> 172.21.15.96:0/782427579 conn(0x7f60e40f1c90 msgr2=0x7f60e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.425+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 shutdown_connections 2022-02-02T19:44:29.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.425+0000 7f60eae21700 1 -- 172.21.15.96:0/782427579 wait complete. 2022-02-02T19:44:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.520+0000 7fcfe4873700 1 -- 172.21.15.96:0/287307764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f6530 msgr2=0x7fcfe00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.520+0000 7fcfe4873700 1 --2- 172.21.15.96:0/287307764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f6530 0x7fcfe00f6950 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fcfd4004660 tx=0x7fcfd4009b30).stop 2022-02-02T19:44:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.520+0000 7fcfe4873700 1 -- 172.21.15.96:0/287307764 shutdown_connections 2022-02-02T19:44:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.520+0000 7fcfe4873700 1 --2- 172.21.15.96:0/287307764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe00f77d0 0x7fcfe00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.520+0000 7fcfe4873700 1 --2- 172.21.15.96:0/287307764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f6530 0x7fcfe00f6950 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.521+0000 7fcfe4873700 1 -- 172.21.15.96:0/287307764 >> 172.21.15.96:0/287307764 conn(0x7fcfe00f1c90 msgr2=0x7fcfe00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.521+0000 7fcfe4873700 1 -- 172.21.15.96:0/287307764 shutdown_connections 2022-02-02T19:44:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.521+0000 7fcfe4873700 1 -- 172.21.15.96:0/287307764 wait complete. 2022-02-02T19:44:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.521+0000 7fcfe4873700 1 Processor -- start 2022-02-02T19:44:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.521+0000 7fcfe4873700 1 -- start start 2022-02-02T19:44:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe00f6530 0x7fcfe0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01079a0 con 0x7fcfe00f77d0 2022-02-02T19:44:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0108120 con 0x7fcfe00f6530 2022-02-02T19:44:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33200/0 (socket says 172.21.15.96:33200) 2022-02-02T19:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 -- 172.21.15.96:0/1687721725 learned_addr learned my addr 172.21.15.96:0/1687721725 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 -- 172.21.15.96:0/1687721725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe00f6530 msgr2=0x7fcfe0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe00f6530 0x7fcfe0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 -- 172.21.15.96:0/1687721725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4005040 con 0x7fcfe00f77d0 2022-02-02T19:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfdeffd700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fcfd000b410 tx=0x7fcfd0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd00125f0 con 0x7fcfe00f77d0 2022-02-02T19:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe01083a0 con 0x7fcfe00f77d0 2022-02-02T19:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfd0012c00 con 0x7fcfe00f77d0 2022-02-02T19:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd0002ae0 con 0x7fcfe00f77d0 2022-02-02T19:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.522+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe0108960 con 0x7fcfe00f77d0 2022-02-02T19:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.523+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe0045ad0 con 0x7fcfe00f77d0 2022-02-02T19:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.524+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcfd000f030 con 0x7fcfe00f77d0 2022-02-02T19:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.524+0000 7fcfc7fff700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 0x7fcfc80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.524+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcfd0081f10 con 0x7fcfe00f77d0 2022-02-02T19:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.524+0000 7fcfdf7fe700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 0x7fcfc80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.525+0000 7fcfdf7fe700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 0x7fcfc80672e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fcfd4004e30 tx=0x7fcfd4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.528+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcfd0050010 con 0x7fcfe00f77d0 2022-02-02T19:44:29.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.756+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfe0108b80 con 0x7fcfe00f77d0 2022-02-02T19:44:29.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.757+0000 7fcfc7fff700 1 -- 172.21.15.96:0/1687721725 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcfd0053630 con 0x7fcfe00f77d0 2022-02-02T19:44:29.761 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:44:29.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:44:29.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:44:29.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:44:29.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:44:29.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:44:29.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:44:29.763 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:44:29.763 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:44:29.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:44:29.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:44:29.764 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:44:29.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:44:29.764 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:44:29.765 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:44:29.765 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:44:29.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:44:29.765 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:44:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 msgr2=0x7fcfc80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 0x7fcfc80672e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fcfd4004e30 tx=0x7fcfd4009b30).stop 2022-02-02T19:44:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 msgr2=0x7fcfe0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fcfd000b410 tx=0x7fcfd0006ef0).stop 2022-02-02T19:44:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 shutdown_connections 2022-02-02T19:44:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfc8064e20 0x7fcfc80672e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe00f6530 0x7fcfe0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:44:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 --2- 172.21.15.96:0/1687721725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe00f77d0 0x7fcfe0107310 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 >> 172.21.15.96:0/1687721725 conn(0x7fcfe00f1c90 msgr2=0x7fcfe00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 shutdown_connections 2022-02-02T19:44:29.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.759+0000 7fcfe4873700 1 -- 172.21.15.96:0/1687721725 wait complete. 2022-02-02T19:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 -- 172.21.15.96:0/3168568970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f7980 msgr2=0x7f16e80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/3168568970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f7980 0x7f16e80f7de0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f16dc004660 tx=0x7f16dc009b30).stop 2022-02-02T19:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 -- 172.21.15.96:0/3168568970 shutdown_connections 2022-02-02T19:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/3168568970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f7980 0x7f16e80f7de0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/3168568970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f66e0 0x7f16e80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 -- 172.21.15.96:0/3168568970 >> 172.21.15.96:0/3168568970 conn(0x7f16e80f1e40 msgr2=0x7f16e80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 -- 172.21.15.96:0/3168568970 shutdown_connections 2022-02-02T19:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.858+0000 7f16ee7cb700 1 -- 172.21.15.96:0/3168568970 wait complete. 2022-02-02T19:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 Processor -- start 2022-02-02T19:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 -- start start 2022-02-02T19:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f7980 0x7f16e8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8107a00 con 0x7f16e80f66e0 2022-02-02T19:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16ee7cb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8107b40 con 0x7f16e80f7980 2022-02-02T19:44:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33208/0 (socket says 172.21.15.96:33208) 2022-02-02T19:44:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 -- 172.21.15.96:0/2496183517 learned_addr learned my addr 172.21.15.96:0/2496183517 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:44:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e77fe700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f7980 0x7f16e8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 -- 172.21.15.96:0/2496183517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f7980 msgr2=0x7f16e8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f7980 0x7f16e8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.859+0000 7f16e7fff700 1 -- 172.21.15.96:0/2496183517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc005040 con 0x7f16e80f66e0 2022-02-02T19:44:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16e7fff700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f16d8002700 tx=0x7f16d8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d8009320 con 0x7f16e80f66e0 2022-02-02T19:44:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e81084e0 con 0x7f16e80f66e0 2022-02-02T19:44:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16d800f040 con 0x7f16e80f66e0 2022-02-02T19:44:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d8014900 con 0x7f16e80f66e0 2022-02-02T19:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.860+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8108aa0 con 0x7f16e80f66e0 2022-02-02T19:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.861+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e8045ad0 con 0x7f16e80f66e0 2022-02-02T19:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.861+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f16d8009480 con 0x7f16e80f66e0 2022-02-02T19:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.861+0000 7f16e4ff9700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 0x7f16d0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.862+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f16d8081be0 con 0x7f16e80f66e0 2022-02-02T19:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.862+0000 7f16e77fe700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 0x7f16d0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.862+0000 7f16e77fe700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 0x7f16d0067270 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f16dc004e30 tx=0x7f16dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:29.866+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f16d8053710 con 0x7f16e80f66e0 2022-02-02T19:44:30.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.068+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16e80ff020 con 0x7f16e80f66e0 2022-02-02T19:44:30.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.068+0000 7f16e4ff9700 1 -- 172.21.15.96:0/2496183517 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f16d8053300 con 0x7f16e80f66e0 2022-02-02T19:44:30.073 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:44:30.073 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:44:30.073 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:44:30.073 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:44:30.074 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:44:30.074 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:44:30.075 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:44:30.075 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:44:30.075 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:44:30.076 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:44:30.076 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:44:30.076 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:44:30.077 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:44:30.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:44:30.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:44:30.077 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:44:30.077 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:44:30.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:44:30.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:44:30.078 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:44:30.078 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:44:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:44:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:44:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:44:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:44:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:44:30.080 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:44:30.080 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:44:30.080 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:44:30.080 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:44:30.081 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:44:30.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:44:30.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:44:30.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:44:30.081 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:44:30.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:44:30.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:44:30.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:44:30.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 msgr2=0x7f16d0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 0x7f16d0067270 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f16dc004e30 tx=0x7f16dc009b30).stop 2022-02-02T19:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 msgr2=0x7f16e8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f16d8002700 tx=0x7f16d8009d80).stop 2022-02-02T19:44:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 shutdown_connections 2022-02-02T19:44:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d0064db0 0x7f16d0067270 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16e80f66e0 0x7f16e8106f60 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 --2- 172.21.15.96:0/2496183517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80f7980 0x7f16e8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:44:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 >> 172.21.15.96:0/2496183517 conn(0x7f16e80f1e40 msgr2=0x7f16e80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:44:30.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 shutdown_connections 2022-02-02T19:44:30.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:44:30.070+0000 7f16ee7cb700 1 -- 172.21.15.96:0/2496183517 wait complete. 2022-02-02T19:44:30.086 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:44:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:30 smithi159 ceph-mon[69013]: pgmap v2472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:30 smithi159 ceph-mon[69013]: from='client.36648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:44:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1687721725' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:44:30.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2496183517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:44:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:30 smithi096 ceph-mon[101353]: pgmap v2472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:30 smithi096 ceph-mon[101353]: from='client.36648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:44:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1687721725' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:44:30.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2496183517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:44:31.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:31 smithi159 ceph-mon[69013]: from='client.45669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:44:31.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:31 smithi096 ceph-mon[101353]: from='client.45669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:44:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:32 smithi159 ceph-mon[69013]: pgmap v2473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:32 smithi096 ceph-mon[101353]: pgmap v2473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:34 smithi159 ceph-mon[69013]: pgmap v2474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:34 smithi096 ceph-mon[101353]: pgmap v2474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:36 smithi159 ceph-mon[69013]: pgmap v2475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:36 smithi096 ceph-mon[101353]: pgmap v2475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:38 smithi159 ceph-mon[69013]: pgmap v2476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:38 smithi096 ceph-mon[101353]: pgmap v2476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:40 smithi159 ceph-mon[69013]: pgmap v2477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:40 smithi096 ceph-mon[101353]: pgmap v2477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:42 smithi159 ceph-mon[69013]: pgmap v2478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:42 smithi096 ceph-mon[101353]: pgmap v2478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:44 smithi159 ceph-mon[69013]: pgmap v2479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:44 smithi096 ceph-mon[101353]: pgmap v2479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:45.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:45 smithi159 ceph-mon[69013]: pgmap v2480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:45.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:45 smithi096 ceph-mon[101353]: pgmap v2480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:48 smithi159 ceph-mon[69013]: pgmap v2481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:48 smithi096 ceph-mon[101353]: pgmap v2481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:50 smithi159 ceph-mon[69013]: pgmap v2482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:50 smithi096 ceph-mon[101353]: pgmap v2482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:52 smithi159 ceph-mon[69013]: pgmap v2483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:52 smithi096 ceph-mon[101353]: pgmap v2483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:54 smithi159 ceph-mon[69013]: pgmap v2484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:54 smithi096 ceph-mon[101353]: pgmap v2484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:56 smithi159 ceph-mon[69013]: pgmap v2485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:56 smithi096 ceph-mon[101353]: pgmap v2485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:44:58 smithi159 ceph-mon[69013]: pgmap v2486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:44:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:44:58 smithi096 ceph-mon[101353]: pgmap v2486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:00.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 -- 172.21.15.96:0/953225930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f66d0 msgr2=0x7f8bd00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/953225930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f66d0 0x7f8bd00f6b30 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f8bc0004660 tx=0x7f8bc0009b30).stop 2022-02-02T19:45:00.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 -- 172.21.15.96:0/953225930 shutdown_connections 2022-02-02T19:45:00.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/953225930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f66d0 0x7f8bd00f6b30 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/953225930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f5430 0x7f8bd00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 -- 172.21.15.96:0/953225930 >> 172.21.15.96:0/953225930 conn(0x7f8bd00f0b90 msgr2=0x7f8bd00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:00.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 -- 172.21.15.96:0/953225930 shutdown_connections 2022-02-02T19:45:00.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.181+0000 7f8bcf59e700 1 -- 172.21.15.96:0/953225930 wait complete. 2022-02-02T19:45:00.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 Processor -- start 2022-02-02T19:45:00.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 -- start start 2022-02-02T19:45:00.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f66d0 0x7f8bd010bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0060420 con 0x7f8bd00f5430 2022-02-02T19:45:00.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcf59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0060560 con 0x7f8bd00f66d0 2022-02-02T19:45:00.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33226/0 (socket says 172.21.15.96:33226) 2022-02-02T19:45:00.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 -- 172.21.15.96:0/968728905 learned_addr learned my addr 172.21.15.96:0/968728905 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:00.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bcdd9b700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f66d0 0x7f8bd010bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 -- 172.21.15.96:0/968728905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f66d0 msgr2=0x7f8bd010bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f66d0 0x7f8bd010bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.182+0000 7f8bce59c700 1 -- 172.21.15.96:0/968728905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0005040 con 0x7f8bd00f5430 2022-02-02T19:45:00.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bce59c700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f8bc400c530 tx=0x7f8bc4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc400f650 con 0x7f8bd00f5430 2022-02-02T19:45:00.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd010c4f0 con 0x7f8bd00f5430 2022-02-02T19:45:00.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8bc400fc60 con 0x7f8bd00f5430 2022-02-02T19:45:00.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc4012cb0 con 0x7f8bd00f5430 2022-02-02T19:45:00.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.183+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd010ca80 con 0x7f8bd00f5430 2022-02-02T19:45:00.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.184+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0059100 con 0x7f8bd00f5430 2022-02-02T19:45:00.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.184+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8bc4019030 con 0x7f8bd00f5430 2022-02-02T19:45:00.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.185+0000 7f8bbeffd700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 0x7f8bb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.185+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8bc40816d0 con 0x7f8bd00f5430 2022-02-02T19:45:00.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.185+0000 7f8bcdd9b700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 0x7f8bb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.185+0000 7f8bcdd9b700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 0x7f8bb80672e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f8bc0004630 tx=0x7f8bc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.189+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8bc404f7c0 con 0x7f8bd00f5430 2022-02-02T19:45:00.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.366+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bd0057f10 con 0x7f8bb8064e20 2022-02-02T19:45:00.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.367+0000 7f8bbeffd700 1 -- 172.21.15.96:0/968728905 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8bd0057f10 con 0x7f8bb8064e20 2022-02-02T19:45:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 msgr2=0x7f8bb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 0x7f8bb80672e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f8bc0004630 tx=0x7f8bc0009b30).stop 2022-02-02T19:45:00.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 msgr2=0x7f8bd01099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f8bc400c530 tx=0x7f8bc4007e10).stop 2022-02-02T19:45:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 shutdown_connections 2022-02-02T19:45:00.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bb8064e20 0x7f8bb80672e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bd00f5430 0x7f8bd01099e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 --2- 172.21.15.96:0/968728905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd00f66d0 0x7f8bd010bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 >> 172.21.15.96:0/968728905 conn(0x7f8bd00f0b90 msgr2=0x7f8bd00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 shutdown_connections 2022-02-02T19:45:00.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.369+0000 7f8bcf59e700 1 -- 172.21.15.96:0/968728905 wait complete. 2022-02-02T19:45:00.382 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:45:00.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 -- 172.21.15.96:0/1645841201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 msgr2=0x7f8dac0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 --2- 172.21.15.96:0/1645841201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0fbd10 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f8da8004660 tx=0x7f8da8009b30).stop 2022-02-02T19:45:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 -- 172.21.15.96:0/1645841201 shutdown_connections 2022-02-02T19:45:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 --2- 172.21.15.96:0/1645841201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0fbd10 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 --2- 172.21.15.96:0/1645841201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 0x7f8dac0f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 -- 172.21.15.96:0/1645841201 >> 172.21.15.96:0/1645841201 conn(0x7f8dac0f04c0 msgr2=0x7f8dac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:00.473 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:00 smithi096 ceph-mon[101353]: pgmap v2487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:00.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 -- 172.21.15.96:0/1645841201 shutdown_connections 2022-02-02T19:45:00.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.467+0000 7f8db4197700 1 -- 172.21.15.96:0/1645841201 wait complete. 2022-02-02T19:45:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 Processor -- start 2022-02-02T19:45:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 -- start start 2022-02-02T19:45:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 0x7f8dac0f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0f6030 con 0x7f8dac0f5400 2022-02-02T19:45:00.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db4197700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0f6170 con 0x7f8dac0f4a60 2022-02-02T19:45:00.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db1732700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db1732700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33238/0 (socket says 172.21.15.96:33238) 2022-02-02T19:45:00.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.468+0000 7f8db1732700 1 -- 172.21.15.96:0/3070544083 learned_addr learned my addr 172.21.15.96:0/3070544083 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:00.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db1f33700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 0x7f8dac0f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db1732700 1 -- 172.21.15.96:0/3070544083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 msgr2=0x7f8dac0f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db1732700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 0x7f8dac0f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db1732700 1 -- 172.21.15.96:0/3070544083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8005040 con 0x7f8dac0f5400 2022-02-02T19:45:00.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db1732700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f8da8013a70 tx=0x7f8da8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da8018070 con 0x7f8dac0f5400 2022-02-02T19:45:00.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac0f63f0 con 0x7f8dac0f5400 2022-02-02T19:45:00.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8da80097d0 con 0x7f8dac0f5400 2022-02-02T19:45:00.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da801de80 con 0x7f8dac0f5400 2022-02-02T19:45:00.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.469+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac0f6950 con 0x7f8dac0f5400 2022-02-02T19:45:00.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.470+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac045ad0 con 0x7f8dac0f5400 2022-02-02T19:45:00.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.470+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8da8007ba0 con 0x7f8dac0f5400 2022-02-02T19:45:00.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.471+0000 7f8da27fc700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 0x7f8d98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.471+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8da8083660 con 0x7f8dac0f5400 2022-02-02T19:45:00.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.471+0000 7f8db1f33700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 0x7f8d98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.471+0000 7f8db1f33700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 0x7f8d98067290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f8dac0f73e0 tx=0x7f8d9c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.475+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8da8051760 con 0x7f8dac0f5400 2022-02-02T19:45:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:00 smithi159 ceph-mon[69013]: pgmap v2487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.646+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dac057f10 con 0x7f8d98064dd0 2022-02-02T19:45:00.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.655+0000 7f8da27fc700 1 -- 172.21.15.96:0/3070544083 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8dac057f10 con 0x7f8d98064dd0 2022-02-02T19:45:00.659 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:45:00.659 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (88m) 58m ago 89m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:45:00.660 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (80m) 58m ago 89m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:45:00.660 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (80m) 57m ago 88m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:45:00.660 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (88m) 58m ago 89m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:45:00.661 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (85m) 58m ago 85m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:45:00.661 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (81m) 58m ago 85m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:45:00.661 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (85m) 57m ago 85m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:45:00.661 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (81m) 57m ago 85m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:45:00.661 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (82m) 58m ago 90m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:45:00.662 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (82m) 57m ago 88m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:45:00.662 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (81m) 58m ago 90m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:45:00.662 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (81m) 57m ago 88m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:45:00.663 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (89m) 58m ago 89m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:45:00.663 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (88m) 57m ago 88m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:45:00.663 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (80m) 58m ago 88m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:45:00.663 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (79m) 58m ago 87m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:45:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (79m) 58m ago 87m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:45:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (78m) 57m ago 87m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:45:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (78m) 57m ago 87m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:45:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (77m) 57m ago 86m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:45:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (88m) 58m ago 89m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:45:00.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 msgr2=0x7f8d98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 0x7f8d98067290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f8dac0f73e0 tx=0x7f8d9c00b040).stop 2022-02-02T19:45:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 msgr2=0x7f8dac0f5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f8da8013a70 tx=0x7f8da8009b30).stop 2022-02-02T19:45:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 shutdown_connections 2022-02-02T19:45:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d98064dd0 0x7f8d98067290 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dac0f4a60 0x7f8dac0f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 --2- 172.21.15.96:0/3070544083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dac0f5400 0x7f8dac0f5ad0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 >> 172.21.15.96:0/3070544083 conn(0x7f8dac0f04c0 msgr2=0x7f8dac0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 shutdown_connections 2022-02-02T19:45:00.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.657+0000 7f8db4197700 1 -- 172.21.15.96:0/3070544083 wait complete. 2022-02-02T19:45:00.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 -- 172.21.15.96:0/2116389306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f66e0 msgr2=0x7fead40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 --2- 172.21.15.96:0/2116389306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f66e0 0x7fead40f6b00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7feac4004660 tx=0x7feac4009b30).stop 2022-02-02T19:45:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 -- 172.21.15.96:0/2116389306 shutdown_connections 2022-02-02T19:45:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 --2- 172.21.15.96:0/2116389306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f7980 0x7fead40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 --2- 172.21.15.96:0/2116389306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f66e0 0x7fead40f6b00 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 -- 172.21.15.96:0/2116389306 >> 172.21.15.96:0/2116389306 conn(0x7fead40f1e40 msgr2=0x7fead40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:00.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 -- 172.21.15.96:0/2116389306 shutdown_connections 2022-02-02T19:45:00.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.754+0000 7feadb42c700 1 -- 172.21.15.96:0/2116389306 wait complete. 2022-02-02T19:45:00.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 Processor -- start 2022-02-02T19:45:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 -- start start 2022-02-02T19:45:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f66e0 0x7fead4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4107a50 con 0x7fead40f7980 2022-02-02T19:45:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7feadb42c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4107b90 con 0x7fead40f66e0 2022-02-02T19:45:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7fead89c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7fead89c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33248/0 (socket says 172.21.15.96:33248) 2022-02-02T19:45:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.755+0000 7fead89c7700 1 -- 172.21.15.96:0/297628840 learned_addr learned my addr 172.21.15.96:0/297628840 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7fead89c7700 1 -- 172.21.15.96:0/297628840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f66e0 msgr2=0x7fead4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7fead91c8700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f66e0 0x7fead4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7fead89c7700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f66e0 0x7fead4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7fead89c7700 1 -- 172.21.15.96:0/297628840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005040 con 0x7fead40f7980 2022-02-02T19:45:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7fead89c7700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fead000c530 tx=0x7fead0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead000f650 con 0x7fead40f7980 2022-02-02T19:45:00.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead4108530 con 0x7fead40f7980 2022-02-02T19:45:00.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fead000fc60 con 0x7fead40f7980 2022-02-02T19:45:00.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead0012cd0 con 0x7fead40f7980 2022-02-02T19:45:00.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.756+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4108af0 con 0x7fead40f7980 2022-02-02T19:45:00.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.757+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4045ad0 con 0x7fead40f7980 2022-02-02T19:45:00.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.758+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fead0010070 con 0x7fead40f7980 2022-02-02T19:45:00.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.758+0000 7feac9ffb700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 0x7feac0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:00.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.759+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fead0081fe0 con 0x7fead40f7980 2022-02-02T19:45:00.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.759+0000 7fead91c8700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 0x7feac0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:00.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.759+0000 7fead91c8700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 0x7feac0067290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7feac4009da0 tx=0x7feac4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:00.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.762+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fead0053b10 con 0x7fead40f7980 2022-02-02T19:45:00.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.994+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fead4108d10 con 0x7fead40f7980 2022-02-02T19:45:00.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.994+0000 7feac9ffb700 1 -- 172.21.15.96:0/297628840 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fead0020070 con 0x7fead40f7980 2022-02-02T19:45:00.998 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:45:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:45:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:45:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:45:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:45:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:45:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:45:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:45:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:45:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:45:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:45:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:45:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:45:01.003 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:45:01.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 msgr2=0x7feac0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 0x7feac0067290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7feac4009da0 tx=0x7feac4009b30).stop 2022-02-02T19:45:01.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 msgr2=0x7fead41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fead000c530 tx=0x7fead0007e20).stop 2022-02-02T19:45:01.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 shutdown_connections 2022-02-02T19:45:01.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feac0064dd0 0x7feac0067290 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead40f66e0 0x7fead4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 --2- 172.21.15.96:0/297628840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fead40f7980 0x7fead41074a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 >> 172.21.15.96:0/297628840 conn(0x7fead40f1e40 msgr2=0x7fead40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:01.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 shutdown_connections 2022-02-02T19:45:01.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:00.996+0000 7feadb42c700 1 -- 172.21.15.96:0/297628840 wait complete. 2022-02-02T19:45:01.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 -- 172.21.15.96:0/941326108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f6860 msgr2=0x7f9fa80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 --2- 172.21.15.96:0/941326108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f6860 0x7f9fa80f6cc0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f9f90004660 tx=0x7f9f90009b30).stop 2022-02-02T19:45:01.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 -- 172.21.15.96:0/941326108 shutdown_connections 2022-02-02T19:45:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 --2- 172.21.15.96:0/941326108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f6860 0x7f9fa80f6cc0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 --2- 172.21.15.96:0/941326108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f55c0 0x7f9fa80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:45:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 -- 172.21.15.96:0/941326108 >> 172.21.15.96:0/941326108 conn(0x7f9fa80f0d40 msgr2=0x7f9fa80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 -- 172.21.15.96:0/941326108 shutdown_connections 2022-02-02T19:45:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.094+0000 7f9fae91f700 1 -- 172.21.15.96:0/941326108 wait complete. 2022-02-02T19:45:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 Processor -- start 2022-02-02T19:45:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 -- start start 2022-02-02T19:45:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 0x7f9fa810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8060470 con 0x7f9fa80f55c0 2022-02-02T19:45:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fae91f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80605b0 con 0x7f9fa80f6860 2022-02-02T19:45:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33260/0 (socket says 172.21.15.96:33260) 2022-02-02T19:45:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 -- 172.21.15.96:0/3467597692 learned_addr learned my addr 172.21.15.96:0/3467597692 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa77fe700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 0x7f9fa810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 -- 172.21.15.96:0/3467597692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 msgr2=0x7f9fa810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 0x7f9fa810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa7fff700 1 -- 172.21.15.96:0/3467597692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90005040 con 0x7f9fa80f55c0 2022-02-02T19:45:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.095+0000 7f9fa77fe700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 0x7f9fa810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:45:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fa7fff700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f9f980093f0 tx=0x7f9f98006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f98009ea0 con 0x7f9fa80f55c0 2022-02-02T19:45:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa810c810 con 0x7f9fa80f55c0 2022-02-02T19:45:01.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f98013af0 con 0x7f9fa80f55c0 2022-02-02T19:45:01.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9800db10 con 0x7f9fa80f55c0 2022-02-02T19:45:01.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.096+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa810cda0 con 0x7f9fa80f55c0 2022-02-02T19:45:01.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.097+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa80f49b0 con 0x7f9fa80f55c0 2022-02-02T19:45:01.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.097+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f9801a060 con 0x7f9fa80f55c0 2022-02-02T19:45:01.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.098+0000 7f9fa4ff9700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 0x7f9f94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:01.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.098+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f98081a90 con 0x7f9fa80f55c0 2022-02-02T19:45:01.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.098+0000 7f9fa77fe700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 0x7f9f94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:01.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.098+0000 7f9fa77fe700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 0x7f9f94067290 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f9f90009da0 tx=0x7f9f90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:01.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.102+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f9804fb90 con 0x7f9fa80f55c0 2022-02-02T19:45:01.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.307+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9fa80fdf20 con 0x7f9fa80f55c0 2022-02-02T19:45:01.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.307+0000 7f9fa4ff9700 1 -- 172.21.15.96:0/3467597692 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9f98018070 con 0x7f9fa80f55c0 2022-02-02T19:45:01.311 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:45:01.312 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:45:01.312 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:45:01.312 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:45:01.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:01.312 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:45:01.313 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:45:01.313 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:45:01.313 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:45:01.313 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:45:01.314 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:45:01.314 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:45:01.314 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:45:01.314 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:45:01.315 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:45:01.315 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:45:01.315 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:45:01.315 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:45:01.315 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:45:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:45:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:45:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:45:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:45:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:45:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:45:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:45:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:45:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:45:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:45:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:45:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:45:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:45:01.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:01.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:01.320 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:45:01.320 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:01.320 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:01.321 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:01.321 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:01.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 msgr2=0x7f9f94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 0x7f9f94067290 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f9f90009da0 tx=0x7f9f90009b30).stop 2022-02-02T19:45:01.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 msgr2=0x7f9fa8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:01.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f9f980093f0 tx=0x7f9f98006ec0).stop 2022-02-02T19:45:01.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 shutdown_connections 2022-02-02T19:45:01.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f94064dd0 0x7f9f94067290 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa80f55c0 0x7f9fa8109cb0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 --2- 172.21.15.96:0/3467597692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa80f6860 0x7f9fa810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:01.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 >> 172.21.15.96:0/3467597692 conn(0x7f9fa80f0d40 msgr2=0x7f9fa80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:01.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 shutdown_connections 2022-02-02T19:45:01.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:01.309+0000 7f9fae91f700 1 -- 172.21.15.96:0/3467597692 wait complete. 2022-02-02T19:45:01.328 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:45:01.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/297628840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:45:01.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/297628840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:45:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:02 smithi159 ceph-mon[69013]: from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:02 smithi159 ceph-mon[69013]: pgmap v2488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:02 smithi159 ceph-mon[69013]: from='client.36666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:02.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3467597692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:45:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:02 smithi096 ceph-mon[101353]: from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:02 smithi096 ceph-mon[101353]: pgmap v2488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:02 smithi096 ceph-mon[101353]: from='client.36666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3467597692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:45:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:04 smithi159 ceph-mon[69013]: pgmap v2489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:04 smithi096 ceph-mon[101353]: pgmap v2489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:06 smithi159 ceph-mon[69013]: pgmap v2490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:06 smithi096 ceph-mon[101353]: pgmap v2490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:08 smithi159 ceph-mon[69013]: pgmap v2491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:08 smithi096 ceph-mon[101353]: pgmap v2491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:10 smithi159 ceph-mon[69013]: pgmap v2492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:10 smithi096 ceph-mon[101353]: pgmap v2492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:12 smithi159 ceph-mon[69013]: pgmap v2493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:12 smithi096 ceph-mon[101353]: pgmap v2493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:14 smithi159 ceph-mon[69013]: pgmap v2494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:14 smithi096 ceph-mon[101353]: pgmap v2494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:16 smithi159 ceph-mon[69013]: pgmap v2495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:16 smithi096 ceph-mon[101353]: pgmap v2495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:18 smithi159 ceph-mon[69013]: pgmap v2496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:18 smithi096 ceph-mon[101353]: pgmap v2496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:20 smithi159 ceph-mon[69013]: pgmap v2497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:20 smithi096 ceph-mon[101353]: pgmap v2497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:22.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:22 smithi159 ceph-mon[69013]: pgmap v2498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:22 smithi096 ceph-mon[101353]: pgmap v2498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:24 smithi159 ceph-mon[69013]: pgmap v2499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:24 smithi096 ceph-mon[101353]: pgmap v2499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:26 smithi159 ceph-mon[69013]: pgmap v2500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:26 smithi096 ceph-mon[101353]: pgmap v2500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:27.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:27 smithi159 ceph-mon[69013]: pgmap v2501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:27.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:27 smithi096 ceph-mon[101353]: pgmap v2501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:45:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:45:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:45:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:45:29.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:29 smithi159 ceph-mon[69013]: pgmap v2502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:29.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:29 smithi096 ceph-mon[101353]: pgmap v2502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:31.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 -- 172.21.15.96:0/1584415737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0f9860 msgr2=0x7f213c0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 --2- 172.21.15.96:0/1584415737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0f9860 0x7f213c0fbc70 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f2138004660 tx=0x7f2138009b30).stop 2022-02-02T19:45:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 -- 172.21.15.96:0/1584415737 shutdown_connections 2022-02-02T19:45:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 --2- 172.21.15.96:0/1584415737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0f9860 0x7f213c0fbc70 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 --2- 172.21.15.96:0/1584415737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0602d0 0x7f213c0f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 -- 172.21.15.96:0/1584415737 >> 172.21.15.96:0/1584415737 conn(0x7f213c0f0d40 msgr2=0x7f213c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 -- 172.21.15.96:0/1584415737 shutdown_connections 2022-02-02T19:45:31.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.414+0000 7f2143fe2700 1 -- 172.21.15.96:0/1584415737 wait complete. 2022-02-02T19:45:31.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 Processor -- start 2022-02-02T19:45:31.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 -- start start 2022-02-02T19:45:31.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0f9860 0x7f213c0f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0f5740 con 0x7f213c0602d0 2022-02-02T19:45:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2143fe2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0f5880 con 0x7f213c0f9860 2022-02-02T19:45:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2141d7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2141d7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33278/0 (socket says 172.21.15.96:33278) 2022-02-02T19:45:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f2141d7e700 1 -- 172.21.15.96:0/386439822 learned_addr learned my addr 172.21.15.96:0/386439822 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.415+0000 7f214157d700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0f9860 0x7f213c0f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2141d7e700 1 -- 172.21.15.96:0/386439822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0f9860 msgr2=0x7f213c0f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2141d7e700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0f9860 0x7f213c0f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2141d7e700 1 -- 172.21.15.96:0/386439822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138005040 con 0x7f213c0602d0 2022-02-02T19:45:31.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2141d7e700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f212c0026d0 tx=0x7f212c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:31.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c0079c0 con 0x7f213c0602d0 2022-02-02T19:45:31.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f212c00f040 con 0x7f213c0602d0 2022-02-02T19:45:31.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c0f5b60 con 0x7f213c0602d0 2022-02-02T19:45:31.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c0148b0 con 0x7f213c0602d0 2022-02-02T19:45:31.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.416+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c10ef70 con 0x7f213c0602d0 2022-02-02T19:45:31.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.417+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c045ad0 con 0x7f213c0602d0 2022-02-02T19:45:31.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.417+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f212c007b20 con 0x7f213c0602d0 2022-02-02T19:45:31.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.418+0000 7f21327fc700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 0x7f2128067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.418+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f212c081990 con 0x7f213c0602d0 2022-02-02T19:45:31.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.418+0000 7f214157d700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 0x7f2128067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.418+0000 7f214157d700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 0x7f2128067290 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f2138004630 tx=0x7f2138009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:31.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.422+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f212c04fa90 con 0x7f213c0602d0 2022-02-02T19:45:31.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.600+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f213c0fef90 con 0x7f2128064dd0 2022-02-02T19:45:31.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.601+0000 7f21327fc700 1 -- 172.21.15.96:0/386439822 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f213c0fef90 con 0x7f2128064dd0 2022-02-02T19:45:31.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 msgr2=0x7f2128067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 0x7f2128067290 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f2138004630 tx=0x7f2138009b30).stop 2022-02-02T19:45:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 msgr2=0x7f213c0f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f212c0026d0 tx=0x7f212c009de0).stop 2022-02-02T19:45:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 shutdown_connections 2022-02-02T19:45:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2128064dd0 0x7f2128067290 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f213c0602d0 0x7f213c0f6d60 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 --2- 172.21.15.96:0/386439822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f213c0f9860 0x7f213c0f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 >> 172.21.15.96:0/386439822 conn(0x7f213c0f0d40 msgr2=0x7f213c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 shutdown_connections 2022-02-02T19:45:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.603+0000 7f2143fe2700 1 -- 172.21.15.96:0/386439822 wait complete. 2022-02-02T19:45:31.619 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:45:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 -- 172.21.15.96:0/3878559994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 msgr2=0x7fe5d80f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 --2- 172.21.15.96:0/3878559994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d80f5860 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fe5c0004660 tx=0x7fe5c0009b30).stop 2022-02-02T19:45:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 -- 172.21.15.96:0/3878559994 shutdown_connections 2022-02-02T19:45:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 --2- 172.21.15.96:0/3878559994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 0x7fe5d80f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 --2- 172.21.15.96:0/3878559994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d80f5860 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 -- 172.21.15.96:0/3878559994 >> 172.21.15.96:0/3878559994 conn(0x7fe5d80f0ba0 msgr2=0x7fe5d80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.700+0000 7fe5d759e700 1 -- 172.21.15.96:0/3878559994 shutdown_connections 2022-02-02T19:45:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.701+0000 7fe5d759e700 1 -- 172.21.15.96:0/3878559994 wait complete. 2022-02-02T19:45:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.701+0000 7fe5d759e700 1 Processor -- start 2022-02-02T19:45:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d759e700 1 -- start start 2022-02-02T19:45:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 0x7fe5d8106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81067e0 con 0x7fe5d80f5440 2022-02-02T19:45:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8106fe0 con 0x7fe5d80f66e0 2022-02-02T19:45:31.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33288/0 (socket says 172.21.15.96:33288) 2022-02-02T19:45:31.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 -- 172.21.15.96:0/2879048940 learned_addr learned my addr 172.21.15.96:0/2879048940 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:31.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d5d9b700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 0x7fe5d8106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 -- 172.21.15.96:0/2879048940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 msgr2=0x7fe5d8106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 0x7fe5d8106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 -- 172.21.15.96:0/2879048940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0005040 con 0x7fe5d80f5440 2022-02-02T19:45:31.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5d659c700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fe5c0004f60 tx=0x7fe5c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:31.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.702+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c0018070 con 0x7fe5d80f5440 2022-02-02T19:45:31.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.703+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe5c0007ba0 con 0x7fe5d80f5440 2022-02-02T19:45:31.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.703+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d8107260 con 0x7fe5d80f5440 2022-02-02T19:45:31.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.703+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c001c620 con 0x7fe5d80f5440 2022-02-02T19:45:31.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.703+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d81077c0 con 0x7fe5d80f5440 2022-02-02T19:45:31.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.703+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d8059100 con 0x7fe5d80f5440 2022-02-02T19:45:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.704+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe5c001d420 con 0x7fe5d80f5440 2022-02-02T19:45:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.704+0000 7fe5ceffd700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 0x7fe5c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.704+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5c0083890 con 0x7fe5d80f5440 2022-02-02T19:45:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.704+0000 7fe5d5d9b700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 0x7fe5c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.705+0000 7fe5d5d9b700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 0x7fe5c40672e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fe5c8007fd0 tx=0x7fe5c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.709+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe5c0055480 con 0x7fe5d80f5440 2022-02-02T19:45:31.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.882+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5d80fdcc0 con 0x7fe5c4064e20 2022-02-02T19:45:31.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.891+0000 7fe5ceffd700 1 -- 172.21.15.96:0/2879048940 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe5d80fdcc0 con 0x7fe5c4064e20 2022-02-02T19:45:31.896 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:45:31.897 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (88m) 59m ago 90m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:45:31.897 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (81m) 59m ago 89m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:45:31.897 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (81m) 57m ago 89m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:45:31.897 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (88m) 59m ago 89m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:45:31.897 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (86m) 59m ago 85m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:45:31.898 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (81m) 59m ago 86m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:45:31.898 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (86m) 57m ago 86m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:45:31.898 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (81m) 57m ago 86m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:45:31.899 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (83m) 59m ago 91m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:45:31.899 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (82m) 57m ago 89m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:45:31.899 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (82m) 59m ago 91m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:45:31.899 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (81m) 57m ago 89m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:45:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (89m) 59m ago 89m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:45:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (89m) 57m ago 89m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:45:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (80m) 59m ago 88m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:45:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (80m) 59m ago 88m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:45:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (79m) 59m ago 88m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:45:31.901 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (79m) 57m ago 87m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:45:31.901 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (78m) 57m ago 87m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:45:31.901 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (78m) 57m ago 87m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:45:31.901 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (88m) 59m ago 89m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:45:31.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 msgr2=0x7fe5c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 0x7fe5c40672e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fe5c8007fd0 tx=0x7fe5c8009040).stop 2022-02-02T19:45:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 msgr2=0x7fe5d8105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fe5c0004f60 tx=0x7fe5c0009b30).stop 2022-02-02T19:45:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 shutdown_connections 2022-02-02T19:45:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5c4064e20 0x7fe5c40672e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80f5440 0x7fe5d8105d40 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 --2- 172.21.15.96:0/2879048940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5d80f66e0 0x7fe5d8106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:31.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 >> 172.21.15.96:0/2879048940 conn(0x7fe5d80f0ba0 msgr2=0x7fe5d80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:31.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 shutdown_connections 2022-02-02T19:45:31.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.893+0000 7fe5d759e700 1 -- 172.21.15.96:0/2879048940 wait complete. 2022-02-02T19:45:31.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 -- 172.21.15.96:0/1504180447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 msgr2=0x7f25840fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 --2- 172.21.15.96:0/1504180447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840fbc80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f2574004660 tx=0x7f2574009b30).stop 2022-02-02T19:45:32.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 -- 172.21.15.96:0/1504180447 shutdown_connections 2022-02-02T19:45:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 --2- 172.21.15.96:0/1504180447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840fbc80 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 --2- 172.21.15.96:0/1504180447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 0x7f25840f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 -- 172.21.15.96:0/1504180447 >> 172.21.15.96:0/1504180447 conn(0x7f25840f0d40 msgr2=0x7f25840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 -- 172.21.15.96:0/1504180447 shutdown_connections 2022-02-02T19:45:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.989+0000 7f2589c53700 1 -- 172.21.15.96:0/1504180447 wait complete. 2022-02-02T19:45:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 Processor -- start 2022-02-02T19:45:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 -- start start 2022-02-02T19:45:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 0x7f25840f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840f57a0 con 0x7f25840f9830 2022-02-02T19:45:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2589c53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840f58e0 con 0x7f2584060270 2022-02-02T19:45:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2582ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2582ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33300/0 (socket says 172.21.15.96:33300) 2022-02-02T19:45:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.990+0000 7f2582ffd700 1 -- 172.21.15.96:0/1538520831 learned_addr learned my addr 172.21.15.96:0/1538520831 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f25837fe700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 0x7f25840f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2582ffd700 1 -- 172.21.15.96:0/1538520831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 msgr2=0x7f25840f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2582ffd700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 0x7f25840f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2582ffd700 1 -- 172.21.15.96:0/1538520831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574005040 con 0x7f25840f9830 2022-02-02T19:45:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2582ffd700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f2574004f60 tx=0x7f2574009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2574018070 con 0x7f25840f9830 2022-02-02T19:45:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2574007c70 con 0x7f25840f9830 2022-02-02T19:45:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25840f5b60 con 0x7f25840f9830 2022-02-02T19:45:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257401c620 con 0x7f25840f9830 2022-02-02T19:45:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.991+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25840f60c0 con 0x7f25840f9830 2022-02-02T19:45:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.992+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584045ad0 con 0x7f25840f9830 2022-02-02T19:45:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.993+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f257401d420 con 0x7f25840f9830 2022-02-02T19:45:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.993+0000 7f256bfff700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 0x7f256c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.993+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2574083960 con 0x7f25840f9830 2022-02-02T19:45:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.993+0000 7f25837fe700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 0x7f256c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.994+0000 7f25837fe700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 0x7f256c067290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2578007fd0 tx=0x7f2578009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:31.997+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2574051a60 con 0x7f25840f9830 2022-02-02T19:45:32.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.228+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2584027a00 con 0x7f25840f9830 2022-02-02T19:45:32.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.228+0000 7f256bfff700 1 -- 172.21.15.96:0/1538520831 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2574055080 con 0x7f25840f9830 2022-02-02T19:45:32.233 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:45:32.234 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:45:32.234 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:45:32.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:32.234 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:45:32.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:45:32.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:32.235 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:45:32.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:45:32.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:32.236 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:45:32.236 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:45:32.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:45:32.236 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:45:32.237 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:45:32.237 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:45:32.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:45:32.237 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:45:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 msgr2=0x7f256c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 0x7f256c067290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2578007fd0 tx=0x7f2578009040).stop 2022-02-02T19:45:32.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 msgr2=0x7f25840f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f2574004f60 tx=0x7f2574009b30).stop 2022-02-02T19:45:32.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 shutdown_connections 2022-02-02T19:45:32.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f256c064dd0 0x7f256c067290 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2584060270 0x7f25840f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 --2- 172.21.15.96:0/1538520831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25840f9830 0x7f25840f5240 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 >> 172.21.15.96:0/1538520831 conn(0x7f25840f0d40 msgr2=0x7f25840f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 shutdown_connections 2022-02-02T19:45:32.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.230+0000 7f2589c53700 1 -- 172.21.15.96:0/1538520831 wait complete. 2022-02-02T19:45:32.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:32 smithi096 ceph-mon[101353]: pgmap v2503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 -- 172.21.15.96:0/4287607105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f66e0 msgr2=0x7f1ed80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 --2- 172.21.15.96:0/4287607105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f66e0 0x7f1ed80f6b40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f1ec0004660 tx=0x7f1ec0009b30).stop 2022-02-02T19:45:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 -- 172.21.15.96:0/4287607105 shutdown_connections 2022-02-02T19:45:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 --2- 172.21.15.96:0/4287607105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f66e0 0x7f1ed80f6b40 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 --2- 172.21.15.96:0/4287607105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80f5440 0x7f1ed80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 -- 172.21.15.96:0/4287607105 >> 172.21.15.96:0/4287607105 conn(0x7f1ed80f0ba0 msgr2=0x7f1ed80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 -- 172.21.15.96:0/4287607105 shutdown_connections 2022-02-02T19:45:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.328+0000 7f1edc802700 1 -- 172.21.15.96:0/4287607105 wait complete. 2022-02-02T19:45:32.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.329+0000 7f1edc802700 1 Processor -- start 2022-02-02T19:45:32.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.329+0000 7f1edc802700 1 -- start start 2022-02-02T19:45:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.329+0000 7f1edc802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.329+0000 7f1edc802700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80f66e0 0x7f1ed810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1edc802700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80603c0 con 0x7f1ed80f5440 2022-02-02T19:45:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1edc802700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8060500 con 0x7f1ed80f66e0 2022-02-02T19:45:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33308/0 (socket says 172.21.15.96:33308) 2022-02-02T19:45:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 -- 172.21.15.96:0/2140649012 learned_addr learned my addr 172.21.15.96:0/2140649012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:45:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 -- 172.21.15.96:0/2140649012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80f66e0 msgr2=0x7f1ed810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80f66e0 0x7f1ed810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:45:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 -- 172.21.15.96:0/2140649012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec0005040 con 0x7f1ed80f5440 2022-02-02T19:45:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ed6d9d700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f1ec800d7f0 tx=0x7f1ec8004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec800b4f0 con 0x7f1ed80f5440 2022-02-02T19:45:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed810c560 con 0x7f1ed80f5440 2022-02-02T19:45:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ec800f040 con 0x7f1ed80f5440 2022-02-02T19:45:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed810caf0 con 0x7f1ed80f5440 2022-02-02T19:45:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.330+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec8013980 con 0x7f1ed80f5440 2022-02-02T19:45:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.331+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8059100 con 0x7f1ed80f5440 2022-02-02T19:45:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.332+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ec801a030 con 0x7f1ed80f5440 2022-02-02T19:45:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.332+0000 7f1ecf7fe700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 0x7f1ec40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:45:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.332+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ec8081840 con 0x7f1ed80f5440 2022-02-02T19:45:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.332+0000 7f1ed659c700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 0x7f1ec40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:45:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.332+0000 7f1ed659c700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 0x7f1ec40672e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f1ec0004e30 tx=0x7f1ec0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:45:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.336+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ec804f940 con 0x7f1ed80f5440 2022-02-02T19:45:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:32 smithi159 ceph-mon[69013]: pgmap v2503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:32.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.537+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ed80586e0 con 0x7f1ed80f5440 2022-02-02T19:45:32.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.537+0000 7f1ecf7fe700 1 -- 172.21.15.96:0/2140649012 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1ec8052f60 con 0x7f1ed80f5440 2022-02-02T19:45:32.544 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:45:32.544 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:45:32.544 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:45:32.545 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:45:32.545 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:32.546 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:45:32.546 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:45:32.546 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:45:32.546 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:45:32.547 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:45:32.547 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:45:32.547 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:45:32.547 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:45:32.548 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:45:32.548 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:45:32.548 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:45:32.549 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:45:32.549 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:45:32.549 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:45:32.549 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:45:32.550 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:45:32.550 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:45:32.550 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:45:32.550 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:45:32.551 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:45:32.551 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:45:32.551 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:45:32.551 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:45:32.551 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:45:32.552 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:45:32.552 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:45:32.552 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:45:32.552 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:32.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:32.553 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:45:32.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:45:32.553 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:32.553 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:32.554 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:45:32.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 msgr2=0x7f1ec40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 0x7f1ec40672e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f1ec0004e30 tx=0x7f1ec0009b30).stop 2022-02-02T19:45:32.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 msgr2=0x7f1ed8109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:45:32.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f1ec800d7f0 tx=0x7f1ec8004e80).stop 2022-02-02T19:45:32.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 shutdown_connections 2022-02-02T19:45:32.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ec4064e20 0x7f1ec40672e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed80f5440 0x7f1ed8109ab0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:45:32.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 --2- 172.21.15.96:0/2140649012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80f66e0 0x7f1ed810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:45:32.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 >> 172.21.15.96:0/2140649012 conn(0x7f1ed80f0ba0 msgr2=0x7f1ed80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:45:32.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 shutdown_connections 2022-02-02T19:45:32.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:45:32.539+0000 7f1edc802700 1 -- 172.21.15.96:0/2140649012 wait complete. 2022-02-02T19:45:32.557 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:45:33.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:33 smithi159 ceph-mon[69013]: from='client.36678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:33.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:33 smithi159 ceph-mon[69013]: from='client.36682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:33.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1538520831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:45:33.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2140649012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:45:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:33 smithi096 ceph-mon[101353]: from='client.36678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:33 smithi096 ceph-mon[101353]: from='client.36682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:45:33.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1538520831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:45:33.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2140649012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:45:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:34 smithi159 ceph-mon[69013]: pgmap v2504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:34 smithi096 ceph-mon[101353]: pgmap v2504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:36 smithi159 ceph-mon[69013]: pgmap v2505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:36 smithi096 ceph-mon[101353]: pgmap v2505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:38 smithi159 ceph-mon[69013]: pgmap v2506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:38 smithi096 ceph-mon[101353]: pgmap v2506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:40 smithi159 ceph-mon[69013]: pgmap v2507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:40 smithi096 ceph-mon[101353]: pgmap v2507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:42 smithi159 ceph-mon[69013]: pgmap v2508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:42 smithi096 ceph-mon[101353]: pgmap v2508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:44 smithi159 ceph-mon[69013]: pgmap v2509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:44 smithi096 ceph-mon[101353]: pgmap v2509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:46 smithi159 ceph-mon[69013]: pgmap v2510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:46 smithi096 ceph-mon[101353]: pgmap v2510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:48 smithi159 ceph-mon[69013]: pgmap v2511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:48 smithi096 ceph-mon[101353]: pgmap v2511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:50 smithi159 ceph-mon[69013]: pgmap v2512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:50 smithi096 ceph-mon[101353]: pgmap v2512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:52 smithi159 ceph-mon[69013]: pgmap v2513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:52 smithi096 ceph-mon[101353]: pgmap v2513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:54 smithi159 ceph-mon[69013]: pgmap v2514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:54 smithi096 ceph-mon[101353]: pgmap v2514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:56 smithi159 ceph-mon[69013]: pgmap v2515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:56 smithi096 ceph-mon[101353]: pgmap v2515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:45:58 smithi159 ceph-mon[69013]: pgmap v2516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:45:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:45:58 smithi096 ceph-mon[101353]: pgmap v2516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:00 smithi159 ceph-mon[69013]: pgmap v2517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:00 smithi096 ceph-mon[101353]: pgmap v2517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:02 smithi159 ceph-mon[69013]: pgmap v2518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:02 smithi096 ceph-mon[101353]: pgmap v2518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:02.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.649+0000 7f7cce536700 1 -- 172.21.15.96:0/3937907516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f66d0 msgr2=0x7f7cc80f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.649+0000 7f7cce536700 1 --2- 172.21.15.96:0/3937907516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f66d0 0x7f7cc80f6af0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f7cb8004660 tx=0x7f7cb8009b30).stop 2022-02-02T19:46:02.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 -- 172.21.15.96:0/3937907516 shutdown_connections 2022-02-02T19:46:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 --2- 172.21.15.96:0/3937907516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f7970 0x7f7cc80f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 --2- 172.21.15.96:0/3937907516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f66d0 0x7f7cc80f6af0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 -- 172.21.15.96:0/3937907516 >> 172.21.15.96:0/3937907516 conn(0x7f7cc80f1e50 msgr2=0x7f7cc80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:02.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 -- 172.21.15.96:0/3937907516 shutdown_connections 2022-02-02T19:46:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 -- 172.21.15.96:0/3937907516 wait complete. 2022-02-02T19:46:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.650+0000 7f7cce536700 1 Processor -- start 2022-02-02T19:46:02.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cce536700 1 -- start start 2022-02-02T19:46:02.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cce536700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f66d0 0x7f7cc8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cce536700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cce536700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8107a20 con 0x7f7cc80f7970 2022-02-02T19:46:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cce536700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8107b60 con 0x7f7cc80f66d0 2022-02-02T19:46:02.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33328/0 (socket says 172.21.15.96:33328) 2022-02-02T19:46:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 -- 172.21.15.96:0/3767903737 learned_addr learned my addr 172.21.15.96:0/3767903737 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc7fff700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f66d0 0x7f7cc8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 -- 172.21.15.96:0/3767903737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f66d0 msgr2=0x7f7cc8106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f66d0 0x7f7cc8106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.651+0000 7f7cc77fe700 1 -- 172.21.15.96:0/3767903737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8005040 con 0x7f7cc80f7970 2022-02-02T19:46:02.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cc77fe700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f7cbc00c530 tx=0x7f7cbc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cbc00f650 con 0x7f7cc80f7970 2022-02-02T19:46:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cbc00fc60 con 0x7f7cc80f7970 2022-02-02T19:46:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8108500 con 0x7f7cc80f7970 2022-02-02T19:46:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cbc012cd0 con 0x7f7cc80f7970 2022-02-02T19:46:02.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.652+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc8108ac0 con 0x7f7cc80f7970 2022-02-02T19:46:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.653+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc8045ad0 con 0x7f7cc80f7970 2022-02-02T19:46:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.654+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cbc010070 con 0x7f7cc80f7970 2022-02-02T19:46:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.654+0000 7f7cc4ff9700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.654+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7cbc081fe0 con 0x7f7cc80f7970 2022-02-02T19:46:02.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.654+0000 7f7cc7fff700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.655+0000 7f7cc7fff700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 0x7f7cb0067290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f7cb8004e30 tx=0x7f7cb8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:02.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.658+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cbc053b10 con 0x7f7cc80f7970 2022-02-02T19:46:02.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.835+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc8108ce0 con 0x7f7cb0064dd0 2022-02-02T19:46:02.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.836+0000 7f7cc4ff9700 1 -- 172.21.15.96:0/3767903737 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7cc8108ce0 con 0x7f7cb0064dd0 2022-02-02T19:46:02.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 msgr2=0x7f7cb0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 0x7f7cb0067290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f7cb8004e30 tx=0x7f7cb8009b30).stop 2022-02-02T19:46:02.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 msgr2=0x7f7cc8107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f7cbc00c530 tx=0x7f7cbc007e20).stop 2022-02-02T19:46:02.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 shutdown_connections 2022-02-02T19:46:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80f66d0 0x7f7cc8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 --2- 172.21.15.96:0/3767903737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc80f7970 0x7f7cc8107470 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 >> 172.21.15.96:0/3767903737 conn(0x7f7cc80f1e50 msgr2=0x7f7cc80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 shutdown_connections 2022-02-02T19:46:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.838+0000 7f7cce536700 1 -- 172.21.15.96:0/3767903737 wait complete. 2022-02-02T19:46:02.852 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:46:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/1679663269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f66d0 msgr2=0x7f7bd80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/1679663269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f66d0 0x7f7bd80f6b30 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f7bcc004660 tx=0x7f7bcc009b30).stop 2022-02-02T19:46:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/1679663269 shutdown_connections 2022-02-02T19:46:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/1679663269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f66d0 0x7f7bd80f6b30 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/1679663269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f5430 0x7f7bd80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/1679663269 >> 172.21.15.96:0/1679663269 conn(0x7f7bd80f0b90 msgr2=0x7f7bd80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/1679663269 shutdown_connections 2022-02-02T19:46:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.936+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/1679663269 wait complete. 2022-02-02T19:46:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 Processor -- start 2022-02-02T19:46:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 -- start start 2022-02-02T19:46:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80603e0 con 0x7f7bd80f5430 2022-02-02T19:46:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.937+0000 7f7bdc9c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8060520 con 0x7f7bd80f66d0 2022-02-02T19:46:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:37442/0 (socket says 172.21.15.96:37442) 2022-02-02T19:46:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd659c700 1 -- 172.21.15.96:0/320151016 learned_addr learned my addr 172.21.15.96:0/320151016 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33336/0 (socket says 172.21.15.96:33336) 2022-02-02T19:46:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 -- 172.21.15.96:0/320151016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 msgr2=0x7f7bd810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 -- 172.21.15.96:0/320151016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc005040 con 0x7f7bd80f5430 2022-02-02T19:46:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd659c700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:46:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.938+0000 7f7bd6d9d700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f7bc800c460 tx=0x7f7bc8007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.939+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800f650 con 0x7f7bd80f5430 2022-02-02T19:46:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.939+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bc800ce80 con 0x7f7bd80f5430 2022-02-02T19:46:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.939+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc8012b70 con 0x7f7bd80f5430 2022-02-02T19:46:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.939+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd810c4d0 con 0x7f7bd80f5430 2022-02-02T19:46:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.939+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd810ca90 con 0x7f7bd80f5430 2022-02-02T19:46:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.940+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd8045ad0 con 0x7f7bd80f5430 2022-02-02T19:46:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.941+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7bc8019030 con 0x7f7bd80f5430 2022-02-02T19:46:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.941+0000 7f7bbf7fe700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 0x7f7bc00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.942+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7bc8081ff0 con 0x7f7bd80f5430 2022-02-02T19:46:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.942+0000 7f7bd659c700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 0x7f7bc00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.942+0000 7f7bd659c700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 0x7f7bc00672e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f7bcc005010 tx=0x7f7bcc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:02.945+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7bc80501a0 con 0x7f7bd80f5430 2022-02-02T19:46:03.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.120+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd80fdda0 con 0x7f7bc0064e20 2022-02-02T19:46:03.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.129+0000 7f7bbf7fe700 1 -- 172.21.15.96:0/320151016 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7bcc019040 con 0x7f7bc0064e20 2022-02-02T19:46:03.134 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:46:03.135 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (89m) 60m ago 90m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:46:03.135 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (81m) 60m ago 90m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:46:03.136 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (81m) 58m ago 89m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:46:03.136 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (89m) 60m ago 90m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:46:03.137 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (86m) 60m ago 86m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:46:03.137 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (82m) 60m ago 86m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:46:03.138 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (86m) 58m ago 86m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:46:03.138 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (82m) 58m ago 86m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:46:03.139 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (83m) 60m ago 91m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:46:03.139 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (83m) 58m ago 89m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:46:03.140 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (82m) 60m ago 91m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:46:03.140 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (82m) 58m ago 89m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:46:03.140 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (90m) 60m ago 90m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:46:03.140 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (89m) 58m ago 89m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:46:03.140 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (81m) 60m ago 89m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:46:03.141 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (80m) 60m ago 89m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:46:03.141 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (80m) 60m ago 88m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:46:03.141 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (79m) 58m ago 88m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:46:03.141 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (79m) 58m ago 88m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:46:03.142 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (78m) 58m ago 87m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:46:03.142 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (89m) 60m ago 90m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:46:03.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 msgr2=0x7f7bc00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 0x7f7bc00672e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f7bcc005010 tx=0x7f7bcc009b30).stop 2022-02-02T19:46:03.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 msgr2=0x7f7bd8109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f7bc800c460 tx=0x7f7bc8007d80).stop 2022-02-02T19:46:03.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 shutdown_connections 2022-02-02T19:46:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064e20 0x7f7bc00672e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5430 0x7f7bd8109a20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 --2- 172.21.15.96:0/320151016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f66d0 0x7f7bd810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 >> 172.21.15.96:0/320151016 conn(0x7f7bd80f0b90 msgr2=0x7f7bd80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:03.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 shutdown_connections 2022-02-02T19:46:03.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.131+0000 7f7bdc9c0700 1 -- 172.21.15.96:0/320151016 wait complete. 2022-02-02T19:46:03.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 -- 172.21.15.96:0/4243933073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f77d0 msgr2=0x7f276c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 --2- 172.21.15.96:0/4243933073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f77d0 0x7f276c0f7c30 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f275c004660 tx=0x7f275c009b30).stop 2022-02-02T19:46:03.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 -- 172.21.15.96:0/4243933073 shutdown_connections 2022-02-02T19:46:03.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 --2- 172.21.15.96:0/4243933073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f77d0 0x7f276c0f7c30 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 --2- 172.21.15.96:0/4243933073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f6530 0x7f276c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:46:03.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 -- 172.21.15.96:0/4243933073 >> 172.21.15.96:0/4243933073 conn(0x7f276c0f1cd0 msgr2=0x7f276c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:03.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 -- 172.21.15.96:0/4243933073 shutdown_connections 2022-02-02T19:46:03.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.227+0000 7f2772616700 1 -- 172.21.15.96:0/4243933073 wait complete. 2022-02-02T19:46:03.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 Processor -- start 2022-02-02T19:46:03.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 -- start start 2022-02-02T19:46:03.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 0x7f276c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c109a80 con 0x7f276c0f6530 2022-02-02T19:46:03.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.228+0000 7f2772616700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c10a330 con 0x7f276c0f77d0 2022-02-02T19:46:03.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:37448/0 (socket says 172.21.15.96:37448) 2022-02-02T19:46:03.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 -- 172.21.15.96:0/3670232552 learned_addr learned my addr 172.21.15.96:0/3670232552 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:03.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2771614700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 0x7f276c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 -- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 msgr2=0x7f276c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 0x7f276c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 -- 172.21.15.96:0/3670232552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c005040 con 0x7f276c0f77d0 2022-02-02T19:46:03.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2771614700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 0x7f276c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:46:03.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2770e13700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f275c009990 tx=0x7f275c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:03.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c018070 con 0x7f276c0f77d0 2022-02-02T19:46:03.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f275c007ca0 con 0x7f276c0f77d0 2022-02-02T19:46:03.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.229+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c10a5b0 con 0x7f276c0f77d0 2022-02-02T19:46:03.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.230+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c01c620 con 0x7f276c0f77d0 2022-02-02T19:46:03.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.230+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c10ab10 con 0x7f276c0f77d0 2022-02-02T19:46:03.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.231+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c059100 con 0x7f276c0f77d0 2022-02-02T19:46:03.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.231+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f275c01d960 con 0x7f276c0f77d0 2022-02-02T19:46:03.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.231+0000 7f2761ffb700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 0x7f27580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.232+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f275c0837d0 con 0x7f276c0f77d0 2022-02-02T19:46:03.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.232+0000 7f2771614700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 0x7f27580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.232+0000 7f2771614700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 0x7f27580672e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f276c0f7630 tx=0x7f2768008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:03.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.236+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f275c055470 con 0x7f276c0f77d0 2022-02-02T19:46:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.466+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f276c0fed90 con 0x7f276c0f77d0 2022-02-02T19:46:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.467+0000 7f2761ffb700 1 -- 172.21.15.96:0/3670232552 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f275c055060 con 0x7f276c0f77d0 2022-02-02T19:46:03.473 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:46:03.474 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:46:03.474 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:46:03.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:03.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:46:03.475 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:46:03.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:03.476 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:46:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:46:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:46:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:46:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:46:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:46:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:46:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:46:03.480 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:46:03.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 msgr2=0x7f27580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 0x7f27580672e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f276c0f7630 tx=0x7f2768008040).stop 2022-02-02T19:46:03.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 msgr2=0x7f276c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f275c009990 tx=0x7f275c009b30).stop 2022-02-02T19:46:03.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 shutdown_connections 2022-02-02T19:46:03.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2758064e20 0x7f27580672e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f276c0f6530 0x7f276c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 --2- 172.21.15.96:0/3670232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f276c0f77d0 0x7f276c109440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 >> 172.21.15.96:0/3670232552 conn(0x7f276c0f1cd0 msgr2=0x7f276c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:03.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 shutdown_connections 2022-02-02T19:46:03.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.469+0000 7f2772616700 1 -- 172.21.15.96:0/3670232552 wait complete. 2022-02-02T19:46:03.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 -- 172.21.15.96:0/1741164598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 msgr2=0x7f026c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 --2- 172.21.15.96:0/1741164598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c0f7c30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f0258004660 tx=0x7f0258009b30).stop 2022-02-02T19:46:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 -- 172.21.15.96:0/1741164598 shutdown_connections 2022-02-02T19:46:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 --2- 172.21.15.96:0/1741164598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c0f7c30 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 --2- 172.21.15.96:0/1741164598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 0x7f026c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:46:03.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 -- 172.21.15.96:0/1741164598 >> 172.21.15.96:0/1741164598 conn(0x7f026c0f1c90 msgr2=0x7f026c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:03.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.566+0000 7f0271900700 1 -- 172.21.15.96:0/1741164598 shutdown_connections 2022-02-02T19:46:03.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 -- 172.21.15.96:0/1741164598 wait complete. 2022-02-02T19:46:03.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 Processor -- start 2022-02-02T19:46:03.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 -- start start 2022-02-02T19:46:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 0x7f026c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c107980 con 0x7f026c0f77d0 2022-02-02T19:46:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f0271900700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c108100 con 0x7f026c0f6530 2022-02-02T19:46:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.567+0000 7f026bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33356/0 (socket says 172.21.15.96:33356) 2022-02-02T19:46:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 -- 172.21.15.96:0/1192207466 learned_addr learned my addr 172.21.15.96:0/1192207466 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f02708fe700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 0x7f026c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 -- 172.21.15.96:0/1192207466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 msgr2=0x7f026c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 0x7f026c106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 -- 172.21.15.96:0/1192207466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258005040 con 0x7f026c0f77d0 2022-02-02T19:46:03.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f026bfff700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f0258009990 tx=0x7f0258009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0258018070 con 0x7f026c0f77d0 2022-02-02T19:46:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0258007ca0 con 0x7f026c0f77d0 2022-02-02T19:46:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c108320 con 0x7f026c0f77d0 2022-02-02T19:46:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025801c620 con 0x7f026c0f77d0 2022-02-02T19:46:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.568+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c108880 con 0x7f026c0f77d0 2022-02-02T19:46:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.569+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c045ad0 con 0x7f026c0f77d0 2022-02-02T19:46:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.570+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f025801d960 con 0x7f026c0f77d0 2022-02-02T19:46:03.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.570+0000 7f02697fa700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 0x7f025c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:03.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.570+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02580837e0 con 0x7f026c0f77d0 2022-02-02T19:46:03.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.570+0000 7f02708fe700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 0x7f025c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:03.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.570+0000 7f02708fe700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 0x7f025c0672e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f026c106b70 tx=0x7f0260008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:03.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.574+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02580519a0 con 0x7f026c0f77d0 2022-02-02T19:46:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.774+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f026c027a00 con 0x7f026c0f77d0 2022-02-02T19:46:03.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.775+0000 7f02697fa700 1 -- 172.21.15.96:0/1192207466 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0258054fc0 con 0x7f026c0f77d0 2022-02-02T19:46:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:46:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:46:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:46:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:46:03.782 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:03.782 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:46:03.782 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:46:03.782 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:46:03.782 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:46:03.783 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:46:03.783 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:46:03.783 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:46:03.783 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:46:03.784 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:46:03.784 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:46:03.784 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:46:03.784 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:46:03.784 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:46:03.785 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:46:03.785 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:46:03.789 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:46:03.789 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:46:03.789 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:46:03.790 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:46:03.790 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:46:03.790 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:46:03.790 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:46:03.791 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:46:03.791 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:46:03.792 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:46:03.792 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:46:03.792 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:46:03.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:03.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:03.793 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:46:03.794 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:03.794 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:03.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:03.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:03.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 msgr2=0x7f025c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 0x7f025c0672e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f026c106b70 tx=0x7f0260008040).stop 2022-02-02T19:46:03.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 msgr2=0x7f026c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:03.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f0258009990 tx=0x7f0258009b30).stop 2022-02-02T19:46:03.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 shutdown_connections 2022-02-02T19:46:03.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f025c064e20 0x7f025c0672e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f026c0f6530 0x7f026c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 --2- 172.21.15.96:0/1192207466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f026c0f77d0 0x7f026c1072f0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:03.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 >> 172.21.15.96:0/1192207466 conn(0x7f026c0f1c90 msgr2=0x7f026c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:03.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 shutdown_connections 2022-02-02T19:46:03.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:03.777+0000 7f0271900700 1 -- 172.21.15.96:0/1192207466 wait complete. 2022-02-02T19:46:03.802 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:46:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:04 smithi159 ceph-mon[69013]: pgmap v2519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:04 smithi159 ceph-mon[69013]: from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:04 smithi159 ceph-mon[69013]: from='client.36698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3670232552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:46:04.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1192207466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:46:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:04 smithi096 ceph-mon[101353]: pgmap v2519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:04 smithi096 ceph-mon[101353]: from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:04 smithi096 ceph-mon[101353]: from='client.36698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3670232552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:46:04.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1192207466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:46:06.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:06 smithi159 ceph-mon[69013]: pgmap v2520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:06 smithi096 ceph-mon[101353]: pgmap v2520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:07.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:07 smithi159 ceph-mon[69013]: pgmap v2521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:07.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:07 smithi096 ceph-mon[101353]: pgmap v2521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:09.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:09 smithi159 ceph-mon[69013]: pgmap v2522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:09.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:09 smithi096 ceph-mon[101353]: pgmap v2522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:12 smithi159 ceph-mon[69013]: pgmap v2523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:12 smithi096 ceph-mon[101353]: pgmap v2523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:14 smithi159 ceph-mon[69013]: pgmap v2524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:14 smithi096 ceph-mon[101353]: pgmap v2524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:16 smithi159 ceph-mon[69013]: pgmap v2525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:16 smithi096 ceph-mon[101353]: pgmap v2525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:18 smithi159 ceph-mon[69013]: pgmap v2526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:18 smithi096 ceph-mon[101353]: pgmap v2526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:20 smithi159 ceph-mon[69013]: pgmap v2527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:20 smithi096 ceph-mon[101353]: pgmap v2527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:22 smithi159 ceph-mon[69013]: pgmap v2528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:22 smithi096 ceph-mon[101353]: pgmap v2528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:24 smithi159 ceph-mon[69013]: pgmap v2529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:24 smithi096 ceph-mon[101353]: pgmap v2529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:26 smithi159 ceph-mon[69013]: pgmap v2530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:26 smithi096 ceph-mon[101353]: pgmap v2530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:28 smithi159 ceph-mon[69013]: pgmap v2531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:46:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:46:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:28 smithi096 ceph-mon[101353]: pgmap v2531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:46:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:46:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:30 smithi159 ceph-mon[69013]: pgmap v2532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:30 smithi096 ceph-mon[101353]: pgmap v2532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:32 smithi159 ceph-mon[69013]: pgmap v2533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:32 smithi096 ceph-mon[101353]: pgmap v2533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:33.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 -- 172.21.15.96:0/2918638841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 msgr2=0x7fb5ac0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:33.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 --2- 172.21.15.96:0/2918638841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac0f7de0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fb59c004660 tx=0x7fb59c009b30).stop 2022-02-02T19:46:33.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 -- 172.21.15.96:0/2918638841 shutdown_connections 2022-02-02T19:46:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 --2- 172.21.15.96:0/2918638841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac0f7de0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 --2- 172.21.15.96:0/2918638841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 0x7fb5ac0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 -- 172.21.15.96:0/2918638841 >> 172.21.15.96:0/2918638841 conn(0x7fb5ac0f1e40 msgr2=0x7fb5ac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 -- 172.21.15.96:0/2918638841 shutdown_connections 2022-02-02T19:46:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 -- 172.21.15.96:0/2918638841 wait complete. 2022-02-02T19:46:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.885+0000 7fb5b4568700 1 Processor -- start 2022-02-02T19:46:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b4568700 1 -- start start 2022-02-02T19:46:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b4568700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 0x7fb5ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b4568700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b4568700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac06a380 con 0x7fb5ac0f7980 2022-02-02T19:46:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b4568700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac06a4c0 con 0x7fb5ac0f66e0 2022-02-02T19:46:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:33.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33372/0 (socket says 172.21.15.96:33372) 2022-02-02T19:46:33.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 -- 172.21.15.96:0/1149990605 learned_addr learned my addr 172.21.15.96:0/1149990605 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:33.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b2304700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 0x7fb5ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:33.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 -- 172.21.15.96:0/1149990605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 msgr2=0x7fb5ac06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:33.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 0x7fb5ac06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:33.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 -- 172.21.15.96:0/1149990605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c005040 con 0x7fb5ac0f7980 2022-02-02T19:46:33.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5b1b03700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fb59c009da0 tx=0x7fb59c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:33.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.886+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59c018070 con 0x7fb5ac0f7980 2022-02-02T19:46:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.887+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac06a740 con 0x7fb5ac0f7980 2022-02-02T19:46:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.887+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb59c007cf0 con 0x7fb5ac0f7980 2022-02-02T19:46:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.887+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59c01c620 con 0x7fb5ac0f7980 2022-02-02T19:46:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.887+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac06aca0 con 0x7fb5ac0f7980 2022-02-02T19:46:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.888+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac045ad0 con 0x7fb5ac0f7980 2022-02-02T19:46:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.888+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb59c01d420 con 0x7fb5ac0f7980 2022-02-02T19:46:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.888+0000 7fb5a2ffd700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 0x7fb598067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.888+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb59c0839b0 con 0x7fb5ac0f7980 2022-02-02T19:46:33.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.888+0000 7fb5b2304700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 0x7fb598067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:33.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.889+0000 7fb5b2304700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 0x7fb598067270 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fb5ac06b730 tx=0x7fb5a8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:33.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:33.893+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb59c051ab0 con 0x7fb5ac0f7980 2022-02-02T19:46:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.070+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5ac0ff010 con 0x7fb598064db0 2022-02-02T19:46:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.071+0000 7fb5a2ffd700 1 -- 172.21.15.96:0/1149990605 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb5ac0ff010 con 0x7fb598064db0 2022-02-02T19:46:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 msgr2=0x7fb598067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 0x7fb598067270 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fb5ac06b730 tx=0x7fb5a8009040).stop 2022-02-02T19:46:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 msgr2=0x7fb5ac069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fb59c009da0 tx=0x7fb59c009b30).stop 2022-02-02T19:46:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 shutdown_connections 2022-02-02T19:46:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb598064db0 0x7fb598067270 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5ac0f66e0 0x7fb5ac06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 --2- 172.21.15.96:0/1149990605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ac0f7980 0x7fb5ac069e20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 >> 172.21.15.96:0/1149990605 conn(0x7fb5ac0f1e40 msgr2=0x7fb5ac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 shutdown_connections 2022-02-02T19:46:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.073+0000 7fb5b4568700 1 -- 172.21.15.96:0/1149990605 wait complete. 2022-02-02T19:46:34.087 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:46:34.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.170+0000 7f68d6796700 1 -- 172.21.15.96:0/1353277888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f5f60 msgr2=0x7f68d00f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.170+0000 7f68d6796700 1 --2- 172.21.15.96:0/1353277888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f5f60 0x7f68d00f63e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f68c0004770 tx=0x7f68c000ac40).stop 2022-02-02T19:46:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 -- 172.21.15.96:0/1353277888 shutdown_connections 2022-02-02T19:46:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 --2- 172.21.15.96:0/1353277888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f5f60 0x7f68d00f63e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 --2- 172.21.15.96:0/1353277888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f4d60 0x7f68d00f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 -- 172.21.15.96:0/1353277888 >> 172.21.15.96:0/1353277888 conn(0x7f68d00f04c0 msgr2=0x7f68d00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 -- 172.21.15.96:0/1353277888 shutdown_connections 2022-02-02T19:46:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 -- 172.21.15.96:0/1353277888 wait complete. 2022-02-02T19:46:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 Processor -- start 2022-02-02T19:46:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.171+0000 7f68d6796700 1 -- start start 2022-02-02T19:46:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68d6796700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68d6796700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f5f60 0x7f68d0104ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68d6796700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0105020 con 0x7f68d00f4d60 2022-02-02T19:46:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68d6796700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0105160 con 0x7f68d00f5f60 2022-02-02T19:46:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33380/0 (socket says 172.21.15.96:33380) 2022-02-02T19:46:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 -- 172.21.15.96:0/2298759800 learned_addr learned my addr 172.21.15.96:0/2298759800 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cf7fe700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f5f60 0x7f68d0104ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 -- 172.21.15.96:0/2298759800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f5f60 msgr2=0x7f68d0104ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f5f60 0x7f68d0104ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 -- 172.21.15.96:0/2298759800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0005040 con 0x7f68d00f4d60 2022-02-02T19:46:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68cffff700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f68c40026d0 tx=0x7f68c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c40079c0 con 0x7f68d00f4d60 2022-02-02T19:46:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68c400f040 con 0x7f68d00f4d60 2022-02-02T19:46:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.172+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d0105440 con 0x7f68d00f4d60 2022-02-02T19:46:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.173+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c40148b0 con 0x7f68d00f4d60 2022-02-02T19:46:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.173+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d010efe0 con 0x7f68d00f4d60 2022-02-02T19:46:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.173+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d0045ad0 con 0x7f68d00f4d60 2022-02-02T19:46:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.174+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68c4007b20 con 0x7f68d00f4d60 2022-02-02T19:46:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.174+0000 7f68ccff9700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 0x7f68b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.175+0000 7f68cf7fe700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 0x7f68b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.175+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68c40819e0 con 0x7f68d00f4d60 2022-02-02T19:46:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.175+0000 7f68cf7fe700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 0x7f68b8067290 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f68c0004740 tx=0x7f68c0016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.179+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68c404fae0 con 0x7f68d00f4d60 2022-02-02T19:46:34.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.356+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d0057f10 con 0x7f68b8064dd0 2022-02-02T19:46:34.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.365+0000 7f68ccff9700 1 -- 172.21.15.96:0/2298759800 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f68d0057f10 con 0x7f68b8064dd0 2022-02-02T19:46:34.369 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:46:34.369 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (89m) 60m ago 91m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:46:34.369 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (82m) 60m ago 90m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:46:34.370 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (82m) 58m ago 90m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:46:34.370 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (89m) 60m ago 90m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:46:34.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (87m) 60m ago 87m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:46:34.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (82m) 60m ago 87m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:46:34.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (87m) 58m ago 87m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:46:34.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (82m) 58m ago 87m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:46:34.371 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (84m) 60m ago 92m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:46:34.371 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (83m) 58m ago 90m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:46:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (83m) 60m ago 92m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:46:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (82m) 58m ago 90m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:46:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (90m) 60m ago 90m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:46:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (90m) 58m ago 90m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:46:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (82m) 60m ago 89m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:46:34.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (81m) 60m ago 89m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:46:34.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (80m) 60m ago 89m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:46:34.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (80m) 58m ago 88m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:46:34.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (79m) 58m ago 88m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:46:34.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (79m) 58m ago 88m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:46:34.374 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (89m) 60m ago 90m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:46:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 msgr2=0x7f68b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 0x7f68b8067290 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f68c0004740 tx=0x7f68c0016040).stop 2022-02-02T19:46:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 msgr2=0x7f68d0106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f68c40026d0 tx=0x7f68c4009de0).stop 2022-02-02T19:46:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 shutdown_connections 2022-02-02T19:46:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68b8064dd0 0x7f68b8067290 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d00f4d60 0x7f68d0106640 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 --2- 172.21.15.96:0/2298759800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d00f5f60 0x7f68d0104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 >> 172.21.15.96:0/2298759800 conn(0x7f68d00f04c0 msgr2=0x7f68d00f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 shutdown_connections 2022-02-02T19:46:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.367+0000 7f68d6796700 1 -- 172.21.15.96:0/2298759800 wait complete. 2022-02-02T19:46:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 -- 172.21.15.96:0/558540503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f7980 msgr2=0x7f70f40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/558540503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f7980 0x7f70f40f7de0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f70f0004660 tx=0x7f70f0009b30).stop 2022-02-02T19:46:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 -- 172.21.15.96:0/558540503 shutdown_connections 2022-02-02T19:46:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/558540503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f7980 0x7f70f40f7de0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/558540503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f66e0 0x7f70f40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:46:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 -- 172.21.15.96:0/558540503 >> 172.21.15.96:0/558540503 conn(0x7f70f40f1e40 msgr2=0x7f70f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 -- 172.21.15.96:0/558540503 shutdown_connections 2022-02-02T19:46:34.469 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:34 smithi096 ceph-mon[101353]: pgmap v2534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.463+0000 7f70fbcb0700 1 -- 172.21.15.96:0/558540503 wait complete. 2022-02-02T19:46:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 Processor -- start 2022-02-02T19:46:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 -- start start 2022-02-02T19:46:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 0x7f70f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f406a410 con 0x7f70f40f66e0 2022-02-02T19:46:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70fbcb0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f406a550 con 0x7f70f40f7980 2022-02-02T19:46:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70f9a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70f9a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33390/0 (socket says 172.21.15.96:33390) 2022-02-02T19:46:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.464+0000 7f70f9a4c700 1 -- 172.21.15.96:0/369877659 learned_addr learned my addr 172.21.15.96:0/369877659 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:34.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f924b700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 0x7f70f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f9a4c700 1 -- 172.21.15.96:0/369877659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 msgr2=0x7f70f4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f9a4c700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 0x7f70f4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f9a4c700 1 -- 172.21.15.96:0/369877659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0005040 con 0x7f70f40f66e0 2022-02-02T19:46:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f924b700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 0x7f70f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:46:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70f9a4c700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f70e40093f0 tx=0x7f70e4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e4009ea0 con 0x7f70f40f66e0 2022-02-02T19:46:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f406a830 con 0x7f70f40f66e0 2022-02-02T19:46:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70e4013af0 con 0x7f70f40f66e0 2022-02-02T19:46:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e400db10 con 0x7f70f40f66e0 2022-02-02T19:46:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.465+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f410efe0 con 0x7f70f40f66e0 2022-02-02T19:46:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.466+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc004fa0 con 0x7f70f40f66e0 2022-02-02T19:46:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.466+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f70e401a060 con 0x7f70f40f66e0 2022-02-02T19:46:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.467+0000 7f70ea7fc700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 0x7f70e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.467+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f70e4081a60 con 0x7f70f40f66e0 2022-02-02T19:46:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.467+0000 7f70f924b700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 0x7f70e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.467+0000 7f70f924b700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 0x7f70e0067290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f70f0009da0 tx=0x7f70f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.471+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f70e404fb60 con 0x7f70f40f66e0 2022-02-02T19:46:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:34 smithi159 ceph-mon[69013]: pgmap v2534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.702+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70dc005e80 con 0x7f70f40f66e0 2022-02-02T19:46:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.703+0000 7f70ea7fc700 1 -- 172.21.15.96:0/369877659 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f70e4053180 con 0x7f70f40f66e0 2022-02-02T19:46:34.707 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:46:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:46:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:46:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:46:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:46:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:46:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:46:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:46:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:46:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:46:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:46:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:46:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:46:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:46:34.713 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:46:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 msgr2=0x7f70e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 0x7f70e0067290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f70f0009da0 tx=0x7f70f0009b30).stop 2022-02-02T19:46:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 msgr2=0x7f70f406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f70e40093f0 tx=0x7f70e4006ec0).stop 2022-02-02T19:46:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 shutdown_connections 2022-02-02T19:46:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70e0064dd0 0x7f70e0067290 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70f40f66e0 0x7f70f406b9a0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 --2- 172.21.15.96:0/369877659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f40f7980 0x7f70f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 >> 172.21.15.96:0/369877659 conn(0x7f70f40f1e40 msgr2=0x7f70f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 shutdown_connections 2022-02-02T19:46:34.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.705+0000 7f70fbcb0700 1 -- 172.21.15.96:0/369877659 wait complete. 2022-02-02T19:46:34.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 -- 172.21.15.96:0/3567818447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 msgr2=0x7f67600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 --2- 172.21.15.96:0/3567818447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f67600f7de0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f6750004660 tx=0x7f6750009b30).stop 2022-02-02T19:46:34.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 -- 172.21.15.96:0/3567818447 shutdown_connections 2022-02-02T19:46:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 --2- 172.21.15.96:0/3567818447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f67600f7de0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 --2- 172.21.15.96:0/3567818447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f67600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 -- 172.21.15.96:0/3567818447 >> 172.21.15.96:0/3567818447 conn(0x7f67600f1e40 msgr2=0x7f67600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 -- 172.21.15.96:0/3567818447 shutdown_connections 2022-02-02T19:46:34.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.802+0000 7f6765f82700 1 -- 172.21.15.96:0/3567818447 wait complete. 2022-02-02T19:46:34.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.803+0000 7f6765f82700 1 Processor -- start 2022-02-02T19:46:34.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f6765f82700 1 -- start start 2022-02-02T19:46:34.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f6765f82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f6760106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f6765f82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f6765f82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760107a20 con 0x7f67600f7980 2022-02-02T19:46:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f6765f82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760107b60 con 0x7f67600f66e0 2022-02-02T19:46:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33402/0 (socket says 172.21.15.96:33402) 2022-02-02T19:46:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 -- 172.21.15.96:0/335859565 learned_addr learned my addr 172.21.15.96:0/335859565 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:46:34.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675f7fe700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f6760106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 -- 172.21.15.96:0/335859565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 msgr2=0x7f6760106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:34.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f6760106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:34.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 -- 172.21.15.96:0/335859565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750005040 con 0x7f67600f7980 2022-02-02T19:46:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675f7fe700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f6760106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:46:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.804+0000 7f675effd700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f6750009990 tx=0x7f6750009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.805+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6750018070 con 0x7f67600f7980 2022-02-02T19:46:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.805+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6750007ca0 con 0x7f67600f7980 2022-02-02T19:46:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.805+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675001c620 con 0x7f67600f7980 2022-02-02T19:46:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.805+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67601084a0 con 0x7f67600f7980 2022-02-02T19:46:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.805+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6760108a00 con 0x7f67600f7980 2022-02-02T19:46:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.806+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6760045ad0 con 0x7f67600f7980 2022-02-02T19:46:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.806+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f675001d960 con 0x7f67600f7980 2022-02-02T19:46:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.807+0000 7f6747fff700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 0x7f6748067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:46:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.807+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6750083710 con 0x7f67600f7980 2022-02-02T19:46:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.807+0000 7f675f7fe700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 0x7f6748067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:46:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.807+0000 7f675f7fe700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 0x7f6748067290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f67540041d0 tx=0x7f6754009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:46:34.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:34.811+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6750055300 con 0x7f67600f7980 2022-02-02T19:46:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.013+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6760027a00 con 0x7f67600f7980 2022-02-02T19:46:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.013+0000 7f6747fff700 1 -- 172.21.15.96:0/335859565 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6750054ef0 con 0x7f67600f7980 2022-02-02T19:46:35.017 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:46:35.017 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:46:35.018 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:46:35.018 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:46:35.018 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:35.018 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:46:35.019 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:46:35.019 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:46:35.019 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:46:35.019 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:46:35.019 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:46:35.020 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:46:35.020 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:46:35.020 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:46:35.020 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:46:35.021 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:46:35.021 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:46:35.023 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:46:35.023 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:46:35.023 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:46:35.023 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:46:35.024 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:46:35.024 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:46:35.024 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:46:35.024 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:46:35.027 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:46:35.027 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:46:35.027 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:46:35.027 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:46:35.028 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:46:35.028 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:46:35.028 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:46:35.028 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:35.029 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:35.029 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:46:35.029 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:46:35.029 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:35.030 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:35.030 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:46:35.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 msgr2=0x7f6748067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:35.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 0x7f6748067290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f67540041d0 tx=0x7f6754009040).stop 2022-02-02T19:46:35.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 msgr2=0x7f6760107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:46:35.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f6750009990 tx=0x7f6750009b30).stop 2022-02-02T19:46:35.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 shutdown_connections 2022-02-02T19:46:35.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6748064dd0 0x7f6748067290 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:35.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67600f66e0 0x7f6760106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:35.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 --2- 172.21.15.96:0/335859565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67600f7980 0x7f6760107470 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:46:35.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 >> 172.21.15.96:0/335859565 conn(0x7f67600f1e40 msgr2=0x7f67600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:46:35.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.015+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 shutdown_connections 2022-02-02T19:46:35.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:46:35.016+0000 7f6765f82700 1 -- 172.21.15.96:0/335859565 wait complete. 2022-02-02T19:46:35.034 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:46:35.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:35 smithi159 ceph-mon[69013]: from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:35.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/369877659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:46:35.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/335859565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:46:35.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:35 smithi096 ceph-mon[101353]: from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:35.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/369877659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:46:35.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/335859565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:46:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:36 smithi159 ceph-mon[69013]: from='client.36714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:36 smithi159 ceph-mon[69013]: pgmap v2535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:36 smithi096 ceph-mon[101353]: from='client.36714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:46:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:36 smithi096 ceph-mon[101353]: pgmap v2535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:38 smithi159 ceph-mon[69013]: pgmap v2536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:38 smithi096 ceph-mon[101353]: pgmap v2536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:40 smithi159 ceph-mon[69013]: pgmap v2537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:40 smithi096 ceph-mon[101353]: pgmap v2537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:42 smithi159 ceph-mon[69013]: pgmap v2538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:42 smithi096 ceph-mon[101353]: pgmap v2538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:43 smithi096 ceph-mon[101353]: pgmap v2539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:43 smithi159 ceph-mon[69013]: pgmap v2539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:45.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:45 smithi159 ceph-mon[69013]: pgmap v2540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:45.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:45 smithi096 ceph-mon[101353]: pgmap v2540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:48 smithi159 ceph-mon[69013]: pgmap v2541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:48 smithi096 ceph-mon[101353]: pgmap v2541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:50 smithi159 ceph-mon[69013]: pgmap v2542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:50 smithi096 ceph-mon[101353]: pgmap v2542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:52 smithi159 ceph-mon[69013]: pgmap v2543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:52 smithi096 ceph-mon[101353]: pgmap v2543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:54 smithi159 ceph-mon[69013]: pgmap v2544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:54 smithi096 ceph-mon[101353]: pgmap v2544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:56 smithi159 ceph-mon[69013]: pgmap v2545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:56 smithi096 ceph-mon[101353]: pgmap v2545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:58.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:46:58 smithi159 ceph-mon[69013]: pgmap v2546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:46:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:46:58 smithi096 ceph-mon[101353]: pgmap v2546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:00 smithi159 ceph-mon[69013]: pgmap v2547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:00 smithi096 ceph-mon[101353]: pgmap v2547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:02 smithi159 ceph-mon[69013]: pgmap v2548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:02.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:02 smithi096 ceph-mon[101353]: pgmap v2548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:04 smithi159 ceph-mon[69013]: pgmap v2549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:04 smithi096 ceph-mon[101353]: pgmap v2549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 -- 172.21.15.96:0/588875566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f6860 msgr2=0x7f99540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 --2- 172.21.15.96:0/588875566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f6860 0x7f99540f6cc0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f9944004660 tx=0x7f9944009b30).stop 2022-02-02T19:47:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 -- 172.21.15.96:0/588875566 shutdown_connections 2022-02-02T19:47:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 --2- 172.21.15.96:0/588875566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f6860 0x7f99540f6cc0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 --2- 172.21.15.96:0/588875566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f55c0 0x7f99540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 -- 172.21.15.96:0/588875566 >> 172.21.15.96:0/588875566 conn(0x7f99540f0d40 msgr2=0x7f99540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 -- 172.21.15.96:0/588875566 shutdown_connections 2022-02-02T19:47:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.125+0000 7f995bef8700 1 -- 172.21.15.96:0/588875566 wait complete. 2022-02-02T19:47:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 Processor -- start 2022-02-02T19:47:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 -- start start 2022-02-02T19:47:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f6860 0x7f995410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540603e0 con 0x7f99540f55c0 2022-02-02T19:47:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.126+0000 7f995bef8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954060520 con 0x7f99540f6860 2022-02-02T19:47:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33422/0 (socket says 172.21.15.96:33422) 2022-02-02T19:47:05.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 -- 172.21.15.96:0/633269423 learned_addr learned my addr 172.21.15.96:0/633269423 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:05.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959493700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f6860 0x7f995410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 -- 172.21.15.96:0/633269423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f6860 msgr2=0x7f995410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f6860 0x7f995410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 -- 172.21.15.96:0/633269423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944005040 con 0x7f99540f55c0 2022-02-02T19:47:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f9959c94700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f995000c530 tx=0x7f9950007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995000f650 con 0x7f99540f55c0 2022-02-02T19:47:05.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f995000fc60 con 0x7f99540f55c0 2022-02-02T19:47:05.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9950012d20 con 0x7f99540f55c0 2022-02-02T19:47:05.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995410c700 con 0x7f99540f55c0 2022-02-02T19:47:05.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.127+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995410ccc0 con 0x7f99540f55c0 2022-02-02T19:47:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.128+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954045ad0 con 0x7f99540f55c0 2022-02-02T19:47:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.129+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9950019030 con 0x7f99540f55c0 2022-02-02T19:47:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.129+0000 7f994a7fc700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 0x7f9940067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.129+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9950081710 con 0x7f99540f55c0 2022-02-02T19:47:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.129+0000 7f9959493700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 0x7f9940067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.130+0000 7f9959493700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 0x7f9940067290 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9944004e30 tx=0x7f9944009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.134+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f995004f860 con 0x7f99540f55c0 2022-02-02T19:47:05.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.312+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99540fdec0 con 0x7f9940064dd0 2022-02-02T19:47:05.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.313+0000 7f994a7fc700 1 -- 172.21.15.96:0/633269423 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f99540fdec0 con 0x7f9940064dd0 2022-02-02T19:47:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 msgr2=0x7f9940067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 0x7f9940067290 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9944004e30 tx=0x7f9944009b30).stop 2022-02-02T19:47:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 msgr2=0x7f9954109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f995000c530 tx=0x7f9950007e10).stop 2022-02-02T19:47:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 shutdown_connections 2022-02-02T19:47:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9940064dd0 0x7f9940067290 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99540f55c0 0x7f9954109c50 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 --2- 172.21.15.96:0/633269423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99540f6860 0x7f995410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 >> 172.21.15.96:0/633269423 conn(0x7f99540f0d40 msgr2=0x7f99540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 shutdown_connections 2022-02-02T19:47:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.315+0000 7f995bef8700 1 -- 172.21.15.96:0/633269423 wait complete. 2022-02-02T19:47:05.329 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:47:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 -- 172.21.15.96:0/3933288104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f6860 msgr2=0x7f1b700f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 --2- 172.21.15.96:0/3933288104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f6860 0x7f1b700f6cc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f1b5c004660 tx=0x7f1b5c009b30).stop 2022-02-02T19:47:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 -- 172.21.15.96:0/3933288104 shutdown_connections 2022-02-02T19:47:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 --2- 172.21.15.96:0/3933288104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f6860 0x7f1b700f6cc0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 --2- 172.21.15.96:0/3933288104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f55c0 0x7f1b700f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 -- 172.21.15.96:0/3933288104 >> 172.21.15.96:0/3933288104 conn(0x7f1b700f0d40 msgr2=0x7f1b700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 -- 172.21.15.96:0/3933288104 shutdown_connections 2022-02-02T19:47:05.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 -- 172.21.15.96:0/3933288104 wait complete. 2022-02-02T19:47:05.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.414+0000 7f1b76b99700 1 Processor -- start 2022-02-02T19:47:05.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b76b99700 1 -- start start 2022-02-02T19:47:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b76b99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b76b99700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f6860 0x7f1b70105280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b76b99700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b70105880 con 0x7f1b700f55c0 2022-02-02T19:47:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b76b99700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b701060c0 con 0x7f1b700f6860 2022-02-02T19:47:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33432/0 (socket says 172.21.15.96:33432) 2022-02-02T19:47:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 -- 172.21.15.96:0/1760021998 learned_addr learned my addr 172.21.15.96:0/1760021998 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b6ffff700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f6860 0x7f1b70105280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 -- 172.21.15.96:0/1760021998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f6860 msgr2=0x7f1b70105280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f6860 0x7f1b70105280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.415+0000 7f1b74935700 1 -- 172.21.15.96:0/1760021998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c005040 con 0x7f1b700f55c0 2022-02-02T19:47:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b74935700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f1b64002700 tx=0x7f1b64009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b640079c0 con 0x7f1b700f55c0 2022-02-02T19:47:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b701063a0 con 0x7f1b700f55c0 2022-02-02T19:47:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b6400f040 con 0x7f1b700f55c0 2022-02-02T19:47:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b64014860 con 0x7f1b700f55c0 2022-02-02T19:47:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.416+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b701068e0 con 0x7f1b700f55c0 2022-02-02T19:47:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.417+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b700f49b0 con 0x7f1b700f55c0 2022-02-02T19:47:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.417+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b6401b060 con 0x7f1b700f55c0 2022-02-02T19:47:05.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.418+0000 7f1b6d7fa700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 0x7f1b6006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.418+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b640818e0 con 0x7f1b700f55c0 2022-02-02T19:47:05.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.418+0000 7f1b6ffff700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 0x7f1b6006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.418+0000 7f1b6ffff700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 0x7f1b6006b6a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1b5c004630 tx=0x7f1b5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.422+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b6404f9e0 con 0x7f1b700f55c0 2022-02-02T19:47:05.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.593+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b700fcde0 con 0x7f1b600691e0 2022-02-02T19:47:05.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.602+0000 7f1b6d7fa700 1 -- 172.21.15.96:0/1760021998 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1b700fcde0 con 0x7f1b600691e0 2022-02-02T19:47:05.611 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:47:05.611 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (90m) 61m ago 91m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:47:05.612 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (82m) 61m ago 91m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:47:05.612 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (82m) 59m ago 91m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:47:05.612 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (90m) 61m ago 91m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:47:05.612 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (87m) 61m ago 87m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:47:05.613 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (83m) 61m ago 87m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:47:05.613 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (87m) 59m ago 87m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:47:05.613 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (83m) 59m ago 87m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:47:05.613 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (84m) 61m ago 92m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:47:05.614 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (84m) 59m ago 90m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:47:05.614 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (83m) 61m ago 92m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:47:05.614 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (83m) 59m ago 90m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:47:05.614 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (91m) 61m ago 91m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:47:05.615 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (90m) 59m ago 90m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:47:05.615 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (82m) 61m ago 90m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:47:05.615 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (81m) 61m ago 90m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:47:05.615 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (81m) 61m ago 89m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:47:05.616 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (80m) 59m ago 89m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:47:05.616 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (80m) 59m ago 89m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:47:05.616 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (79m) 59m ago 88m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:47:05.617 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (90m) 61m ago 91m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:47:05.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 msgr2=0x7f1b6006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 0x7f1b6006b6a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1b5c004630 tx=0x7f1b5c009b30).stop 2022-02-02T19:47:05.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 msgr2=0x7f1b70104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f1b64002700 tx=0x7f1b64009d80).stop 2022-02-02T19:47:05.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 shutdown_connections 2022-02-02T19:47:05.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b600691e0 0x7f1b6006b6a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b700f55c0 0x7f1b70104d90 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 --2- 172.21.15.96:0/1760021998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b700f6860 0x7f1b70105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 >> 172.21.15.96:0/1760021998 conn(0x7f1b700f0d40 msgr2=0x7f1b700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 shutdown_connections 2022-02-02T19:47:05.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.604+0000 7f1b76b99700 1 -- 172.21.15.96:0/1760021998 wait complete. 2022-02-02T19:47:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 -- 172.21.15.96:0/2405614761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 msgr2=0x7f5d440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2405614761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d440f59e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f5d38004660 tx=0x7f5d38009b30).stop 2022-02-02T19:47:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 -- 172.21.15.96:0/2405614761 shutdown_connections 2022-02-02T19:47:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2405614761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 0x7f5d440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2405614761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d440f59e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 -- 172.21.15.96:0/2405614761 >> 172.21.15.96:0/2405614761 conn(0x7f5d440f0d40 msgr2=0x7f5d440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 -- 172.21.15.96:0/2405614761 shutdown_connections 2022-02-02T19:47:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.700+0000 7f5d49b54700 1 -- 172.21.15.96:0/2405614761 wait complete. 2022-02-02T19:47:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 Processor -- start 2022-02-02T19:47:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 -- start start 2022-02-02T19:47:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 0x7f5d441063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44106950 con 0x7f5d440f55c0 2022-02-02T19:47:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d49b54700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44106a90 con 0x7f5d440f6860 2022-02-02T19:47:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33442/0 (socket says 172.21.15.96:33442) 2022-02-02T19:47:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.701+0000 7f5d437fe700 1 -- 172.21.15.96:0/2686232131 learned_addr learned my addr 172.21.15.96:0/2686232131 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d42ffd700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 0x7f5d441063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d437fe700 1 -- 172.21.15.96:0/2686232131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 msgr2=0x7f5d441063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d437fe700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 0x7f5d441063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d437fe700 1 -- 172.21.15.96:0/2686232131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38005040 con 0x7f5d440f55c0 2022-02-02T19:47:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d437fe700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f5d38013a70 tx=0x7f5d38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d38018070 con 0x7f5d440f55c0 2022-02-02T19:47:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d441073d0 con 0x7f5d440f55c0 2022-02-02T19:47:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d380097d0 con 0x7f5d440f55c0 2022-02-02T19:47:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d3801c3c0 con 0x7f5d440f55c0 2022-02-02T19:47:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.702+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d44107930 con 0x7f5d440f55c0 2022-02-02T19:47:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.703+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d44045ad0 con 0x7f5d440f55c0 2022-02-02T19:47:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.703+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5d3801d420 con 0x7f5d440f55c0 2022-02-02T19:47:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.704+0000 7f5d2bfff700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 0x7f5d2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.704+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5d38083710 con 0x7f5d440f55c0 2022-02-02T19:47:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.704+0000 7f5d42ffd700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 0x7f5d2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.704+0000 7f5d42ffd700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 0x7f5d2c067290 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f5d340096c0 tx=0x7f5d34009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.708+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5d380553b0 con 0x7f5d440f55c0 2022-02-02T19:47:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.939+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d440fdf00 con 0x7f5d440f55c0 2022-02-02T19:47:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.939+0000 7f5d2bfff700 1 -- 172.21.15.96:0/2686232131 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5d38054fa0 con 0x7f5d440f55c0 2022-02-02T19:47:05.944 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:47:05.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:47:05.945 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:47:05.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:05.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:47:05.946 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:47:05.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:05.947 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:47:05.947 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:47:05.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:05.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:47:05.948 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:47:05.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:05.949 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:47:05.949 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:47:05.950 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:47:05.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:47:05.951 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:47:05.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 msgr2=0x7f5d2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 0x7f5d2c067290 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f5d340096c0 tx=0x7f5d34009be0).stop 2022-02-02T19:47:05.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 msgr2=0x7f5d44105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:05.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f5d38013a70 tx=0x7f5d38009b30).stop 2022-02-02T19:47:05.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 shutdown_connections 2022-02-02T19:47:05.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d2c064dd0 0x7f5d2c067290 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d440f55c0 0x7f5d44105eb0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.941+0000 7f5d49b54700 1 --2- 172.21.15.96:0/2686232131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d440f6860 0x7f5d441063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:05.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.942+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 >> 172.21.15.96:0/2686232131 conn(0x7f5d440f0d40 msgr2=0x7f5d440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:05.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.942+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 shutdown_connections 2022-02-02T19:47:05.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:05.942+0000 7f5d49b54700 1 -- 172.21.15.96:0/2686232131 wait complete. 2022-02-02T19:47:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 -- 172.21.15.96:0/3134779253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 msgr2=0x7f61d00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 --2- 172.21.15.96:0/3134779253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d00f6b30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f61cc004660 tx=0x7f61cc009b30).stop 2022-02-02T19:47:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 -- 172.21.15.96:0/3134779253 shutdown_connections 2022-02-02T19:47:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 --2- 172.21.15.96:0/3134779253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d00f6b30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 --2- 172.21.15.96:0/3134779253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 0x7f61d00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 -- 172.21.15.96:0/3134779253 >> 172.21.15.96:0/3134779253 conn(0x7f61d00f0b90 msgr2=0x7f61d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 -- 172.21.15.96:0/3134779253 shutdown_connections 2022-02-02T19:47:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.038+0000 7f61d6073700 1 -- 172.21.15.96:0/3134779253 wait complete. 2022-02-02T19:47:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 Processor -- start 2022-02-02T19:47:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 -- start start 2022-02-02T19:47:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 0x7f61d0108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01099e0 con 0x7f61d00f66d0 2022-02-02T19:47:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d6073700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0109b20 con 0x7f61d00f5430 2022-02-02T19:47:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d4870700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d4870700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33454/0 (socket says 172.21.15.96:33454) 2022-02-02T19:47:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d4870700 1 -- 172.21.15.96:0/968406239 learned_addr learned my addr 172.21.15.96:0/968406239 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.039+0000 7f61d5071700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 0x7f61d0108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d4870700 1 -- 172.21.15.96:0/968406239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 msgr2=0x7f61d0108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d4870700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 0x7f61d0108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d4870700 1 -- 172.21.15.96:0/968406239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc005040 con 0x7f61d00f66d0 2022-02-02T19:47:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d4870700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f61cc009990 tx=0x7f61cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61cc018070 con 0x7f61d00f66d0 2022-02-02T19:47:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61cc007ba0 con 0x7f61d00f66d0 2022-02-02T19:47:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d010a460 con 0x7f61d00f66d0 2022-02-02T19:47:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61cc01c3c0 con 0x7f61d00f66d0 2022-02-02T19:47:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.040+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d010a9c0 con 0x7f61d00f66d0 2022-02-02T19:47:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.041+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d0045ad0 con 0x7f61d00f66d0 2022-02-02T19:47:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.042+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f61cc01d420 con 0x7f61d00f66d0 2022-02-02T19:47:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.042+0000 7f61c1ffb700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 0x7f61bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.043+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f61cc0835e0 con 0x7f61d00f66d0 2022-02-02T19:47:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.043+0000 7f61d5071700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 0x7f61bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.043+0000 7f61d5071700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 0x7f61bc0672e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f61d00f6530 tx=0x7f61c400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.047+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f61cc0550b0 con 0x7f61d00f66d0 2022-02-02T19:47:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.249+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f61d010b110 con 0x7f61d00f66d0 2022-02-02T19:47:06.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.250+0000 7f61c1ffb700 1 -- 172.21.15.96:0/968406239 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f61cc054ca0 con 0x7f61d00f66d0 2022-02-02T19:47:06.257 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:47:06.257 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:47:06.257 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:47:06.257 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:47:06.258 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:06.259 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:47:06.259 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:47:06.259 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:47:06.259 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:47:06.260 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:47:06.260 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:47:06.261 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:47:06.261 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:47:06.261 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:47:06.261 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:47:06.262 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:47:06.262 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:47:06.262 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:47:06.262 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:47:06.263 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:47:06.263 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:47:06.263 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:47:06.263 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:47:06.264 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:47:06.264 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:47:06.264 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:47:06.264 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:47:06.264 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:47:06.265 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:47:06.265 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:47:06.265 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:47:06.266 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:47:06.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:06.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:06.267 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:47:06.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:06.268 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:06.268 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:06.268 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 msgr2=0x7f61bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 0x7f61bc0672e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f61d00f6530 tx=0x7f61c400b040).stop 2022-02-02T19:47:06.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 msgr2=0x7f61d0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:06.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f61cc009990 tx=0x7f61cc009b30).stop 2022-02-02T19:47:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 shutdown_connections 2022-02-02T19:47:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61bc064e20 0x7f61bc0672e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d00f5430 0x7f61d0108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 --2- 172.21.15.96:0/968406239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61d00f66d0 0x7f61d0109430 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:06.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.251+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 >> 172.21.15.96:0/968406239 conn(0x7f61d00f0b90 msgr2=0x7f61d005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:06.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.252+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 shutdown_connections 2022-02-02T19:47:06.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:06.252+0000 7f61d6073700 1 -- 172.21.15.96:0/968406239 wait complete. 2022-02-02T19:47:06.274 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:47:06.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:06 smithi096 ceph-mon[101353]: pgmap v2550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:06.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2686232131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:47:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:06 smithi159 ceph-mon[69013]: pgmap v2550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2686232131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:47:07.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:07 smithi159 ceph-mon[69013]: from='client.36726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:07.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:07 smithi159 ceph-mon[69013]: from='client.36730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:07.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/968406239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:47:07.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:07 smithi096 ceph-mon[101353]: from='client.36726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:07.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:07 smithi096 ceph-mon[101353]: from='client.36730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:07.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/968406239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:47:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:08 smithi159 ceph-mon[69013]: pgmap v2551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:08 smithi096 ceph-mon[101353]: pgmap v2551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:10 smithi159 ceph-mon[69013]: pgmap v2552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:10 smithi096 ceph-mon[101353]: pgmap v2552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:12 smithi159 ceph-mon[69013]: pgmap v2553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:12 smithi096 ceph-mon[101353]: pgmap v2553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:14 smithi159 ceph-mon[69013]: pgmap v2554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:14 smithi096 ceph-mon[101353]: pgmap v2554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:15.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:15 smithi096 ceph-mon[101353]: pgmap v2555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:15 smithi159 ceph-mon[69013]: pgmap v2555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:18 smithi159 ceph-mon[69013]: pgmap v2556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:18 smithi096 ceph-mon[101353]: pgmap v2556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:20 smithi159 ceph-mon[69013]: pgmap v2557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:20 smithi096 ceph-mon[101353]: pgmap v2557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:22 smithi159 ceph-mon[69013]: pgmap v2558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:22 smithi096 ceph-mon[101353]: pgmap v2558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:24 smithi159 ceph-mon[69013]: pgmap v2559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:24 smithi096 ceph-mon[101353]: pgmap v2559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:26 smithi159 ceph-mon[69013]: pgmap v2560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:26 smithi096 ceph-mon[101353]: pgmap v2560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:28 smithi159 ceph-mon[69013]: pgmap v2561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:47:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:47:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:28 smithi096 ceph-mon[101353]: pgmap v2561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:47:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:47:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:30 smithi159 ceph-mon[69013]: pgmap v2562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:30 smithi096 ceph-mon[101353]: pgmap v2562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:32 smithi159 ceph-mon[69013]: pgmap v2563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:32 smithi096 ceph-mon[101353]: pgmap v2563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:34 smithi159 ceph-mon[69013]: pgmap v2564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:34 smithi096 ceph-mon[101353]: pgmap v2564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- 172.21.15.96:0/2044611498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f6860 msgr2=0x7f65e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/2044611498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f6860 0x7f65e40f6cc0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f65e0004660 tx=0x7f65e0009b30).stop 2022-02-02T19:47:36.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- 172.21.15.96:0/2044611498 shutdown_connections 2022-02-02T19:47:36.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/2044611498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f6860 0x7f65e40f6cc0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/2044611498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65e40f55c0 0x7f65e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:47:36.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- 172.21.15.96:0/2044611498 >> 172.21.15.96:0/2044611498 conn(0x7f65e40f0d40 msgr2=0x7f65e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:36.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- 172.21.15.96:0/2044611498 shutdown_connections 2022-02-02T19:47:36.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- 172.21.15.96:0/2044611498 wait complete. 2022-02-02T19:47:36.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 Processor -- start 2022-02-02T19:47:36.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.358+0000 7f65ec1a8700 1 -- start start 2022-02-02T19:47:36.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65e40f6860 0x7f65e410e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40602b0 con 0x7f65e40f55c0 2022-02-02T19:47:36.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40603f0 con 0x7f65e40f6860 2022-02-02T19:47:36.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33470/0 (socket says 172.21.15.96:33470) 2022-02-02T19:47:36.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 -- 172.21.15.96:0/330511292 learned_addr learned my addr 172.21.15.96:0/330511292 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:36.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 -- 172.21.15.96:0/330511292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65e40f6860 msgr2=0x7f65e410e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65e40f6860 0x7f65e410e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:47:36.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 -- 172.21.15.96:0/330511292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0005040 con 0x7f65e40f55c0 2022-02-02T19:47:36.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65e9f44700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f65d40093f0 tx=0x7f65d4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d4009ea0 con 0x7f65e40f55c0 2022-02-02T19:47:36.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e410eac0 con 0x7f65e40f55c0 2022-02-02T19:47:36.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65d4013af0 con 0x7f65e40f55c0 2022-02-02T19:47:36.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d400db10 con 0x7f65e40f55c0 2022-02-02T19:47:36.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.359+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e410efa0 con 0x7f65e40f55c0 2022-02-02T19:47:36.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.361+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4045ad0 con 0x7f65e40f55c0 2022-02-02T19:47:36.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.361+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f65d401a060 con 0x7f65e40f55c0 2022-02-02T19:47:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.361+0000 7f65da7fc700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 0x7f65d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.361+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f65d4081a80 con 0x7f65e40f55c0 2022-02-02T19:47:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.361+0000 7f65e9743700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 0x7f65d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.362+0000 7f65e9743700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 0x7f65d0067290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f65e0004e30 tx=0x7f65e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.366+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65d404fc30 con 0x7f65e40f55c0 2022-02-02T19:47:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:36 smithi159 ceph-mon[69013]: pgmap v2565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:36.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.545+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65e4057f10 con 0x7f65d0064dd0 2022-02-02T19:47:36.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:36 smithi096 ceph-mon[101353]: pgmap v2565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:36.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.547+0000 7f65da7fc700 1 -- 172.21.15.96:0/330511292 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f65e4057f10 con 0x7f65d0064dd0 2022-02-02T19:47:36.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.548+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 msgr2=0x7f65d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.548+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 0x7f65d0067290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f65e0004e30 tx=0x7f65e0009b30).stop 2022-02-02T19:47:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.548+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 msgr2=0x7f65e410c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.548+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f65d40093f0 tx=0x7f65d4006ec0).stop 2022-02-02T19:47:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 shutdown_connections 2022-02-02T19:47:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65d0064dd0 0x7f65d0067290 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65e40f55c0 0x7f65e410c0d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 --2- 172.21.15.96:0/330511292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65e40f6860 0x7f65e410e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:47:36.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 >> 172.21.15.96:0/330511292 conn(0x7f65e40f0d40 msgr2=0x7f65e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:36.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 shutdown_connections 2022-02-02T19:47:36.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.549+0000 7f65ec1a8700 1 -- 172.21.15.96:0/330511292 wait complete. 2022-02-02T19:47:36.563 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:47:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 -- 172.21.15.96:0/3929055737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 msgr2=0x7f81e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 --2- 172.21.15.96:0/3929055737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e00f6cc0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f81d4004660 tx=0x7f81d4009b30).stop 2022-02-02T19:47:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 -- 172.21.15.96:0/3929055737 shutdown_connections 2022-02-02T19:47:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 --2- 172.21.15.96:0/3929055737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e00f6cc0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 --2- 172.21.15.96:0/3929055737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 -- 172.21.15.96:0/3929055737 >> 172.21.15.96:0/3929055737 conn(0x7f81e00f0d40 msgr2=0x7f81e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 -- 172.21.15.96:0/3929055737 shutdown_connections 2022-02-02T19:47:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.646+0000 7f81e6221700 1 -- 172.21.15.96:0/3929055737 wait complete. 2022-02-02T19:47:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 Processor -- start 2022-02-02T19:47:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 -- start start 2022-02-02T19:47:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00602b0 con 0x7f81e00f6860 2022-02-02T19:47:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81e6221700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00603f0 con 0x7f81e00f55c0 2022-02-02T19:47:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33482/0 (socket says 172.21.15.96:33482) 2022-02-02T19:47:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81deffd700 1 -- 172.21.15.96:0/2122666424 learned_addr learned my addr 172.21.15.96:0/2122666424 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.647+0000 7f81df7fe700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81deffd700 1 -- 172.21.15.96:0/2122666424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 msgr2=0x7f81e010c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81deffd700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e010c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81deffd700 1 -- 172.21.15.96:0/2122666424 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e00f6860 2022-02-02T19:47:36.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81deffd700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f81d4009990 tx=0x7f81d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d4018070 con 0x7f81e00f6860 2022-02-02T19:47:36.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e010ea70 con 0x7f81e00f6860 2022-02-02T19:47:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81d4007ba0 con 0x7f81e00f6860 2022-02-02T19:47:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d401c3c0 con 0x7f81e00f6860 2022-02-02T19:47:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.648+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e010ee40 con 0x7f81e00f6860 2022-02-02T19:47:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.649+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e00f49b0 con 0x7f81e00f6860 2022-02-02T19:47:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.649+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f81d401d420 con 0x7f81e00f6860 2022-02-02T19:47:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.650+0000 7f81c7fff700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.650+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f81d40836c0 con 0x7f81e00f6860 2022-02-02T19:47:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.650+0000 7f81df7fe700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.650+0000 7f81df7fe700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f81e0060040 tx=0x7f81d000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.656+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81d4051820 con 0x7f81e00f6860 2022-02-02T19:47:36.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.828+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81e00fde70 con 0x7f81c8064dd0 2022-02-02T19:47:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.838+0000 7f81c7fff700 1 -- 172.21.15.96:0/2122666424 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f81e00fde70 con 0x7f81c8064dd0 2022-02-02T19:47:36.843 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:47:36.843 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (90m) 61m ago 92m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:47:36.843 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (83m) 61m ago 92m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:47:36.844 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (83m) 60m ago 91m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:47:36.844 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (90m) 61m ago 91m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:47:36.844 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (88m) 61m ago 88m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:47:36.844 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (83m) 61m ago 88m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:47:36.844 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (88m) 60m ago 88m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:47:36.845 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (83m) 60m ago 88m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:47:36.845 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (85m) 61m ago 93m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:47:36.845 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (84m) 60m ago 91m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:47:36.845 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (84m) 61m ago 93m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:47:36.846 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (83m) 60m ago 91m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:47:36.846 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (91m) 61m ago 91m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:47:36.846 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (91m) 60m ago 91m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:47:36.846 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (83m) 61m ago 90m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:47:36.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (82m) 61m ago 90m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:47:36.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (81m) 61m ago 90m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:47:36.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (81m) 60m ago 89m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:47:36.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (80m) 60m ago 89m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:47:36.848 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (80m) 60m ago 89m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:47:36.848 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (90m) 61m ago 91m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:47:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 msgr2=0x7f81c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f81e0060040 tx=0x7f81d000b040).stop 2022-02-02T19:47:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 msgr2=0x7f81e010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f81d4009990 tx=0x7f81d4009b30).stop 2022-02-02T19:47:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 shutdown_connections 2022-02-02T19:47:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81c8064dd0 0x7f81c8067290 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81e00f55c0 0x7f81e010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 --2- 172.21.15.96:0/2122666424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81e00f6860 0x7f81e010e580 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 >> 172.21.15.96:0/2122666424 conn(0x7f81e00f0d40 msgr2=0x7f81e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:36.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 shutdown_connections 2022-02-02T19:47:36.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.840+0000 7f81e6221700 1 -- 172.21.15.96:0/2122666424 wait complete. 2022-02-02T19:47:36.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 -- 172.21.15.96:0/3020978497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 msgr2=0x7fb9080f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 --2- 172.21.15.96:0/3020978497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f5810 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fb8f0004660 tx=0x7fb8f0009b30).stop 2022-02-02T19:47:36.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 -- 172.21.15.96:0/3020978497 shutdown_connections 2022-02-02T19:47:36.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 --2- 172.21.15.96:0/3020978497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f5810 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 --2- 172.21.15.96:0/3020978497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 0x7fb9080f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 -- 172.21.15.96:0/3020978497 >> 172.21.15.96:0/3020978497 conn(0x7fb9080f0320 msgr2=0x7fb9080f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:36.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 -- 172.21.15.96:0/3020978497 shutdown_connections 2022-02-02T19:47:36.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.937+0000 7fb90cba2700 1 -- 172.21.15.96:0/3020978497 wait complete. 2022-02-02T19:47:36.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 Processor -- start 2022-02-02T19:47:36.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 -- start start 2022-02-02T19:47:36.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 0x7fb9080f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080f80a0 con 0x7fb9080f73f0 2022-02-02T19:47:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb90cba2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080f81e0 con 0x7fb9080f6a50 2022-02-02T19:47:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb906ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb906ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33492/0 (socket says 172.21.15.96:33492) 2022-02-02T19:47:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb906ffd700 1 -- 172.21.15.96:0/2129182180 learned_addr learned my addr 172.21.15.96:0/2129182180 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.938+0000 7fb9077fe700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 0x7fb9080f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb906ffd700 1 -- 172.21.15.96:0/2129182180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 msgr2=0x7fb9080f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb906ffd700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 0x7fb9080f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb906ffd700 1 -- 172.21.15.96:0/2129182180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0005040 con 0x7fb9080f73f0 2022-02-02T19:47:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb906ffd700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fb8f0009990 tx=0x7fb8f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f0018070 con 0x7fb9080f73f0 2022-02-02T19:47:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9080f8460 con 0x7fb9080f73f0 2022-02-02T19:47:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8f0007ba0 con 0x7fb9080f73f0 2022-02-02T19:47:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f001c3c0 con 0x7fb9080f73f0 2022-02-02T19:47:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.939+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9080f89c0 con 0x7fb9080f73f0 2022-02-02T19:47:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.940+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb908045ad0 con 0x7fb9080f73f0 2022-02-02T19:47:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.940+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb8f001d420 con 0x7fb9080f73f0 2022-02-02T19:47:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.941+0000 7fb8fffff700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 0x7fb8f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.941+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb8f00836b0 con 0x7fb9080f73f0 2022-02-02T19:47:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.941+0000 7fb9077fe700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 0x7fb8f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.941+0000 7fb9077fe700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 0x7fb8f40672e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fb9080f9450 tx=0x7fb8f800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:36.945+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb8f0051810 con 0x7fb9080f73f0 2022-02-02T19:47:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.175+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9080fdc10 con 0x7fb9080f73f0 2022-02-02T19:47:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.175+0000 7fb8fffff700 1 -- 172.21.15.96:0/2129182180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb8f0054e30 con 0x7fb9080f73f0 2022-02-02T19:47:37.181 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:47:37.181 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:47:37.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:47:37.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:37.182 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:47:37.182 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:47:37.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:37.183 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:47:37.183 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:47:37.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:37.183 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:47:37.184 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:47:37.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:47:37.184 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:47:37.184 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:47:37.184 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:47:37.185 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:47:37.185 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:47:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.177+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 msgr2=0x7fb8f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.177+0000 7fb90cba2700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 0x7fb8f40672e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fb9080f9450 tx=0x7fb8f800b040).stop 2022-02-02T19:47:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.177+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 msgr2=0x7fb9080f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.177+0000 7fb90cba2700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fb8f0009990 tx=0x7fb8f0009b30).stop 2022-02-02T19:47:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.177+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 shutdown_connections 2022-02-02T19:47:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8f4064e20 0x7fb8f40672e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9080f6a50 0x7fb9080f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 --2- 172.21.15.96:0/2129182180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9080f73f0 0x7fb9080f7b40 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 >> 172.21.15.96:0/2129182180 conn(0x7fb9080f0320 msgr2=0x7fb9080f4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:37.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 shutdown_connections 2022-02-02T19:47:37.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.178+0000 7fb90cba2700 1 -- 172.21.15.96:0/2129182180 wait complete. 2022-02-02T19:47:37.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 -- 172.21.15.96:0/833106572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 msgr2=0x7f4a600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 --2- 172.21.15.96:0/833106572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a600f59e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f4a54004660 tx=0x7f4a54009b30).stop 2022-02-02T19:47:37.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 -- 172.21.15.96:0/833106572 shutdown_connections 2022-02-02T19:47:37.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 --2- 172.21.15.96:0/833106572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 0x7f4a600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:47:37.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 --2- 172.21.15.96:0/833106572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a600f59e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 -- 172.21.15.96:0/833106572 >> 172.21.15.96:0/833106572 conn(0x7f4a600f0d40 msgr2=0x7f4a600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:37.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 -- 172.21.15.96:0/833106572 shutdown_connections 2022-02-02T19:47:37.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.276+0000 7f4a671ab700 1 -- 172.21.15.96:0/833106572 wait complete. 2022-02-02T19:47:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 Processor -- start 2022-02-02T19:47:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 -- start start 2022-02-02T19:47:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 0x7f4a601063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:37.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601069f0 con 0x7f4a600f55c0 2022-02-02T19:47:37.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a671ab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601072a0 con 0x7f4a600f6860 2022-02-02T19:47:37.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a64f47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:37.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a64f47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33500/0 (socket says 172.21.15.96:33500) 2022-02-02T19:47:37.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a64f47700 1 -- 172.21.15.96:0/2583007143 learned_addr learned my addr 172.21.15.96:0/2583007143 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:47:37.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.277+0000 7f4a5ffff700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 0x7f4a601063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:37.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a64f47700 1 -- 172.21.15.96:0/2583007143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 msgr2=0x7f4a601063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a64f47700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 0x7f4a601063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a64f47700 1 -- 172.21.15.96:0/2583007143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54005040 con 0x7f4a600f55c0 2022-02-02T19:47:37.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a64f47700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f4a54004f60 tx=0x7f4a54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a54018070 con 0x7f4a600f55c0 2022-02-02T19:47:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a54009770 con 0x7f4a600f55c0 2022-02-02T19:47:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a60107520 con 0x7f4a600f55c0 2022-02-02T19:47:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60107a80 con 0x7f4a600f55c0 2022-02-02T19:47:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.278+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5401c3c0 con 0x7f4a600f55c0 2022-02-02T19:47:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.279+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a600f49b0 con 0x7f4a600f55c0 2022-02-02T19:47:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.279+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a5401d420 con 0x7f4a600f55c0 2022-02-02T19:47:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.280+0000 7f4a5d7fa700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 0x7f4a500694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:47:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.280+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4a54083840 con 0x7f4a600f55c0 2022-02-02T19:47:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.280+0000 7f4a5ffff700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 0x7f4a500694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:47:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.280+0000 7f4a5ffff700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 0x7f4a500694a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f4a4c006fd0 tx=0x7f4a4c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:47:37.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.284+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a54055430 con 0x7f4a600f55c0 2022-02-02T19:47:37.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.484+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a60108110 con 0x7f4a600f55c0 2022-02-02T19:47:37.490 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2129182180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:47:37.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.485+0000 7f4a5d7fa700 1 -- 172.21.15.96:0/2583007143 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4a60108110 con 0x7f4a600f55c0 2022-02-02T19:47:37.490 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:47:37.491 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:47:37.491 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:47:37.491 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:47:37.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:37.492 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:47:37.492 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:47:37.492 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:47:37.492 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:47:37.493 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:47:37.493 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:47:37.493 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:47:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:47:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:47:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:47:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:47:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:47:37.495 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:47:37.495 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:47:37.495 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:47:37.495 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:47:37.496 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:47:37.496 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:47:37.496 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:47:37.496 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:47:37.496 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:47:37.497 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:47:37.497 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:47:37.497 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:47:37.497 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:47:37.498 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:47:37.498 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:47:37.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:37.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:37.499 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:47:37.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:47:37.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:37.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:37.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:47:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 msgr2=0x7f4a500694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 0x7f4a500694a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f4a4c006fd0 tx=0x7f4a4c008040).stop 2022-02-02T19:47:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 msgr2=0x7f4a60105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:47:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f4a54004f60 tx=0x7f4a54009b30).stop 2022-02-02T19:47:37.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 shutdown_connections 2022-02-02T19:47:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a50066fe0 0x7f4a500694a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a600f55c0 0x7f4a60105ec0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 --2- 172.21.15.96:0/2583007143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a600f6860 0x7f4a601063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:47:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 >> 172.21.15.96:0/2583007143 conn(0x7f4a600f0d40 msgr2=0x7f4a600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:47:37.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 shutdown_connections 2022-02-02T19:47:37.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:47:37.487+0000 7f4a671ab700 1 -- 172.21.15.96:0/2583007143 wait complete. 2022-02-02T19:47:37.503 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:47:37.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2129182180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:47:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:38 smithi159 ceph-mon[69013]: pgmap v2566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:38 smithi159 ceph-mon[69013]: from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:38.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:38 smithi159 ceph-mon[69013]: from='client.36746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:38.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2583007143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:47:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:38 smithi096 ceph-mon[101353]: pgmap v2566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:38 smithi096 ceph-mon[101353]: from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:38 smithi096 ceph-mon[101353]: from='client.36746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:47:38.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2583007143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:47:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:40 smithi159 ceph-mon[69013]: pgmap v2567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:40 smithi096 ceph-mon[101353]: pgmap v2567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:42 smithi159 ceph-mon[69013]: pgmap v2568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:42 smithi096 ceph-mon[101353]: pgmap v2568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:44 smithi159 ceph-mon[69013]: pgmap v2569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:44.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:44 smithi096 ceph-mon[101353]: pgmap v2569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:46 smithi159 ceph-mon[69013]: pgmap v2570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:46 smithi096 ceph-mon[101353]: pgmap v2570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:48 smithi159 ceph-mon[69013]: pgmap v2571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:48 smithi096 ceph-mon[101353]: pgmap v2571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:50 smithi159 ceph-mon[69013]: pgmap v2572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:50 smithi096 ceph-mon[101353]: pgmap v2572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:52 smithi159 ceph-mon[69013]: pgmap v2573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:52.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:52 smithi096 ceph-mon[101353]: pgmap v2573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:54 smithi159 ceph-mon[69013]: pgmap v2574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:54 smithi096 ceph-mon[101353]: pgmap v2574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:56.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:56 smithi159 ceph-mon[69013]: pgmap v2575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:56 smithi096 ceph-mon[101353]: pgmap v2575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:47:58 smithi159 ceph-mon[69013]: pgmap v2576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:47:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:47:58 smithi096 ceph-mon[101353]: pgmap v2576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:00 smithi159 ceph-mon[69013]: pgmap v2577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:00 smithi096 ceph-mon[101353]: pgmap v2577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:02 smithi159 ceph-mon[69013]: pgmap v2578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:02 smithi096 ceph-mon[101353]: pgmap v2578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:04 smithi159 ceph-mon[69013]: pgmap v2579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:04 smithi096 ceph-mon[101353]: pgmap v2579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:06 smithi159 ceph-mon[69013]: pgmap v2580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:06 smithi096 ceph-mon[101353]: pgmap v2580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:07.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 -- 172.21.15.96:0/4222210035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 msgr2=0x7fbf000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/4222210035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf000f6cc0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fbee8004660 tx=0x7fbee8009b30).stop 2022-02-02T19:48:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 -- 172.21.15.96:0/4222210035 shutdown_connections 2022-02-02T19:48:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/4222210035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf000f6cc0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/4222210035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 0x7fbf000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 -- 172.21.15.96:0/4222210035 >> 172.21.15.96:0/4222210035 conn(0x7fbf000f0d20 msgr2=0x7fbf000f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 -- 172.21.15.96:0/4222210035 shutdown_connections 2022-02-02T19:48:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.598+0000 7fbf05ed8700 1 -- 172.21.15.96:0/4222210035 wait complete. 2022-02-02T19:48:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 Processor -- start 2022-02-02T19:48:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 -- start start 2022-02-02T19:48:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 0x7fbf00106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf001079d0 con 0x7fbf000f6860 2022-02-02T19:48:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbf05ed8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00107b10 con 0x7fbf000f55c0 2022-02-02T19:48:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbefeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbefeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33520/0 (socket says 172.21.15.96:33520) 2022-02-02T19:48:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbefeffd700 1 -- 172.21.15.96:0/1143305665 learned_addr learned my addr 172.21.15.96:0/1143305665 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:07.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.599+0000 7fbeff7fe700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 0x7fbf00106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbefeffd700 1 -- 172.21.15.96:0/1143305665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 msgr2=0x7fbf00106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbefeffd700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 0x7fbf00106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbefeffd700 1 -- 172.21.15.96:0/1143305665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8005040 con 0x7fbf000f6860 2022-02-02T19:48:07.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbefeffd700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fbee8009990 tx=0x7fbee8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:07.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee8018070 con 0x7fbf000f6860 2022-02-02T19:48:07.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbee8007ba0 con 0x7fbf000f6860 2022-02-02T19:48:07.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee801c3c0 con 0x7fbf000f6860 2022-02-02T19:48:07.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf00108450 con 0x7fbf000f6860 2022-02-02T19:48:07.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.600+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf00108960 con 0x7fbf000f6860 2022-02-02T19:48:07.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.601+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00045ad0 con 0x7fbf000f6860 2022-02-02T19:48:07.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.602+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbee801d420 con 0x7fbf000f6860 2022-02-02T19:48:07.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.602+0000 7fbef7fff700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 0x7fbeec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.602+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbee80836b0 con 0x7fbf000f6860 2022-02-02T19:48:07.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.602+0000 7fbeff7fe700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 0x7fbeec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.602+0000 7fbeff7fe700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 0x7fbeec067290 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fbf000f66c0 tx=0x7fbef000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:07.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.606+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbee8055240 con 0x7fbf000f6860 2022-02-02T19:48:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.784+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf000faca0 con 0x7fbeec064dd0 2022-02-02T19:48:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.785+0000 7fbef7fff700 1 -- 172.21.15.96:0/1143305665 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbf000faca0 con 0x7fbeec064dd0 2022-02-02T19:48:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 msgr2=0x7fbeec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 0x7fbeec067290 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fbf000f66c0 tx=0x7fbef000b040).stop 2022-02-02T19:48:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 msgr2=0x7fbf00107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fbee8009990 tx=0x7fbee8009b30).stop 2022-02-02T19:48:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 shutdown_connections 2022-02-02T19:48:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbeec064dd0 0x7fbeec067290 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf000f55c0 0x7fbf00106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 --2- 172.21.15.96:0/1143305665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf000f6860 0x7fbf00107420 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 >> 172.21.15.96:0/1143305665 conn(0x7fbf000f0d20 msgr2=0x7fbf0005ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 shutdown_connections 2022-02-02T19:48:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.787+0000 7fbf05ed8700 1 -- 172.21.15.96:0/1143305665 wait complete. 2022-02-02T19:48:07.800 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:48:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 -- 172.21.15.96:0/2893325684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406b960 msgr2=0x7febe4069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 --2- 172.21.15.96:0/2893325684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406b960 0x7febe4069e60 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7febd4004660 tx=0x7febd4009b30).stop 2022-02-02T19:48:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 -- 172.21.15.96:0/2893325684 shutdown_connections 2022-02-02T19:48:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 --2- 172.21.15.96:0/2893325684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406a350 0x7febe406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 --2- 172.21.15.96:0/2893325684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406b960 0x7febe4069e60 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 -- 172.21.15.96:0/2893325684 >> 172.21.15.96:0/2893325684 conn(0x7febe40f1e40 msgr2=0x7febe40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 -- 172.21.15.96:0/2893325684 shutdown_connections 2022-02-02T19:48:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.884+0000 7febeb873700 1 -- 172.21.15.96:0/2893325684 wait complete. 2022-02-02T19:48:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 Processor -- start 2022-02-02T19:48:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 -- start start 2022-02-02T19:48:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406b960 0x7febe4109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4109c10 con 0x7febe406a350 2022-02-02T19:48:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febeb873700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4109d50 con 0x7febe406b960 2022-02-02T19:48:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33526/0 (socket says 172.21.15.96:33526) 2022-02-02T19:48:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 -- 172.21.15.96:0/826239272 learned_addr learned my addr 172.21.15.96:0/826239272 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:07.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe8e0e700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406b960 0x7febe4109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 -- 172.21.15.96:0/826239272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406b960 msgr2=0x7febe4109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:07.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406b960 0x7febe4109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 -- 172.21.15.96:0/826239272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4005040 con 0x7febe406a350 2022-02-02T19:48:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.885+0000 7febe960f700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7febd4009990 tx=0x7febd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.886+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd4018070 con 0x7febe406a350 2022-02-02T19:48:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.886+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe410a690 con 0x7febe406a350 2022-02-02T19:48:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.886+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febd4007ba0 con 0x7febe406a350 2022-02-02T19:48:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.886+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd401c3c0 con 0x7febe406a350 2022-02-02T19:48:07.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.886+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe410abf0 con 0x7febe406a350 2022-02-02T19:48:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.887+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe4045ad0 con 0x7febe406a350 2022-02-02T19:48:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.887+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7febd401d420 con 0x7febe406a350 2022-02-02T19:48:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.888+0000 7febd9ffb700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 0x7febd0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.888+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7febd4083760 con 0x7febe406a350 2022-02-02T19:48:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.888+0000 7febe8e0e700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 0x7febd0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.888+0000 7febe8e0e700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 0x7febd0067290 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7febe0004a70 tx=0x7febe000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:07.892+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7febd4055230 con 0x7febe406a350 2022-02-02T19:48:08.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.067+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febe41011a0 con 0x7febd0064dd0 2022-02-02T19:48:08.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.076+0000 7febd9ffb700 1 -- 172.21.15.96:0/826239272 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7febe41011a0 con 0x7febd0064dd0 2022-02-02T19:48:08.080 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:48:08.080 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (91m) 62m ago 92m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:48:08.080 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (83m) 62m ago 92m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:48:08.081 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (83m) 60m ago 92m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:48:08.081 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (91m) 62m ago 92m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:48:08.081 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (88m) 62m ago 88m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:48:08.082 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (84m) 62m ago 88m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:48:08.083 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (88m) 60m ago 88m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:48:08.083 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (84m) 60m ago 88m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:48:08.083 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (85m) 62m ago 93m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:48:08.084 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (85m) 60m ago 92m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:48:08.084 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (84m) 62m ago 93m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:48:08.084 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (84m) 60m ago 91m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:48:08.084 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (92m) 62m ago 92m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:48:08.084 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (91m) 60m ago 91m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:48:08.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (83m) 62m ago 91m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:48:08.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (83m) 62m ago 91m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:48:08.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (82m) 62m ago 90m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:48:08.086 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (81m) 60m ago 90m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:48:08.086 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (81m) 60m ago 90m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:48:08.086 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (80m) 60m ago 89m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:48:08.087 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (91m) 62m ago 92m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:48:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 msgr2=0x7febd0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 0x7febd0067290 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7febe0004a70 tx=0x7febe000b040).stop 2022-02-02T19:48:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 msgr2=0x7febe4109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7febd4009990 tx=0x7febd4009b30).stop 2022-02-02T19:48:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 shutdown_connections 2022-02-02T19:48:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7febd0064dd0 0x7febd0067290 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febe406a350 0x7febe4109170 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 --2- 172.21.15.96:0/826239272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febe406b960 0x7febe4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 >> 172.21.15.96:0/826239272 conn(0x7febe40f1e40 msgr2=0x7febe40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 shutdown_connections 2022-02-02T19:48:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.078+0000 7febeb873700 1 -- 172.21.15.96:0/826239272 wait complete. 2022-02-02T19:48:08.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 -- 172.21.15.96:0/3043611892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f49a0 msgr2=0x7f1ec80f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/3043611892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f49a0 0x7f1ec80f4dc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f1eb8004660 tx=0x7f1eb8009b30).stop 2022-02-02T19:48:08.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 -- 172.21.15.96:0/3043611892 shutdown_connections 2022-02-02T19:48:08.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/3043611892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f5340 0x7f1ec80f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/3043611892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f49a0 0x7f1ec80f4dc0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 -- 172.21.15.96:0/3043611892 >> 172.21.15.96:0/3043611892 conn(0x7f1ec80f04c0 msgr2=0x7f1ec80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:08.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 -- 172.21.15.96:0/3043611892 shutdown_connections 2022-02-02T19:48:08.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.175+0000 7f1ecfd50700 1 -- 172.21.15.96:0/3043611892 wait complete. 2022-02-02T19:48:08.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 Processor -- start 2022-02-02T19:48:08.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 -- start start 2022-02-02T19:48:08.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f49a0 0x7f1ec8106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec8107a90 con 0x7f1ec80f5340 2022-02-02T19:48:08.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecfd50700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec8107bd0 con 0x7f1ec80f49a0 2022-02-02T19:48:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecdaec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f49a0 0x7f1ec8106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33538/0 (socket says 172.21.15.96:33538) 2022-02-02T19:48:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 -- 172.21.15.96:0/274863243 learned_addr learned my addr 172.21.15.96:0/274863243 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 -- 172.21.15.96:0/274863243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f49a0 msgr2=0x7f1ec8106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f49a0 0x7f1ec8106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.176+0000 7f1ecd2eb700 1 -- 172.21.15.96:0/274863243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8005040 con 0x7f1ec80f5340 2022-02-02T19:48:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ecd2eb700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f1ec400c510 tx=0x7f1ec4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec400f650 con 0x7f1ec80f5340 2022-02-02T19:48:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec8108570 con 0x7f1ec80f5340 2022-02-02T19:48:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ec400fc60 con 0x7f1ec80f5340 2022-02-02T19:48:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec4012c20 con 0x7f1ec80f5340 2022-02-02T19:48:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.177+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec8108b30 con 0x7f1ec80f5340 2022-02-02T19:48:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.178+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0004fa0 con 0x7f1ec80f5340 2022-02-02T19:48:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.178+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ec4010070 con 0x7f1ec80f5340 2022-02-02T19:48:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.179+0000 7f1ebe7fc700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 0x7f1eb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.179+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ec4081660 con 0x7f1ec80f5340 2022-02-02T19:48:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.179+0000 7f1ecdaec700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 0x7f1eb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.179+0000 7f1ecdaec700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 0x7f1eb4067290 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f1eb8004630 tx=0x7f1eb8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.183+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ec4053190 con 0x7f1ec80f5340 2022-02-02T19:48:08.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.417+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1eb0005e80 con 0x7f1ec80f5340 2022-02-02T19:48:08.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.417+0000 7f1ebe7fc700 1 -- 172.21.15.96:0/274863243 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1ec4052d80 con 0x7f1ec80f5340 2022-02-02T19:48:08.421 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:48:08.421 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:48:08.422 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:48:08.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:08.422 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:48:08.422 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:48:08.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:08.423 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:48:08.423 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:48:08.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:08.423 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:48:08.424 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:48:08.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:08.425 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:48:08.425 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:48:08.425 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:48:08.426 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:48:08.426 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:48:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 msgr2=0x7f1eb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 0x7f1eb4067290 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f1eb8004630 tx=0x7f1eb8009b30).stop 2022-02-02T19:48:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 msgr2=0x7f1ec81074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f1ec400c510 tx=0x7f1ec4007df0).stop 2022-02-02T19:48:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 shutdown_connections 2022-02-02T19:48:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1eb4064dd0 0x7f1eb4067290 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec80f49a0 0x7f1ec8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 --2- 172.21.15.96:0/274863243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec80f5340 0x7f1ec81074e0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 >> 172.21.15.96:0/274863243 conn(0x7f1ec80f04c0 msgr2=0x7f1ec80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 shutdown_connections 2022-02-02T19:48:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.419+0000 7f1ecfd50700 1 -- 172.21.15.96:0/274863243 wait complete. 2022-02-02T19:48:08.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 -- 172.21.15.96:0/2288308152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f5f60 msgr2=0x7f6af80f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 --2- 172.21.15.96:0/2288308152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f5f60 0x7f6af80f63e0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f6af4004770 tx=0x7f6af400ac40).stop 2022-02-02T19:48:08.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 -- 172.21.15.96:0/2288308152 shutdown_connections 2022-02-02T19:48:08.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 --2- 172.21.15.96:0/2288308152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f5f60 0x7f6af80f63e0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 --2- 172.21.15.96:0/2288308152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6af80f4d60 0x7f6af80f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:48:08.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 -- 172.21.15.96:0/2288308152 >> 172.21.15.96:0/2288308152 conn(0x7f6af80f04c0 msgr2=0x7f6af80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:08.523 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:08 smithi096 ceph-mon[101353]: pgmap v2581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:08.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 -- 172.21.15.96:0/2288308152 shutdown_connections 2022-02-02T19:48:08.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.517+0000 7f6aff495700 1 -- 172.21.15.96:0/2288308152 wait complete. 2022-02-02T19:48:08.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 Processor -- start 2022-02-02T19:48:08.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 -- start start 2022-02-02T19:48:08.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6af80f5f60 0x7f6af8109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8109c80 con 0x7f6af80f4d60 2022-02-02T19:48:08.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6aff495700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af810a530 con 0x7f6af80f5f60 2022-02-02T19:48:08.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:08.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33546/0 (socket says 172.21.15.96:33546) 2022-02-02T19:48:08.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 -- 172.21.15.96:0/2591293578 learned_addr learned my addr 172.21.15.96:0/2591293578 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:08.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 -- 172.21.15.96:0/2591293578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6af80f5f60 msgr2=0x7f6af8109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6af80f5f60 0x7f6af8109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:48:08.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 -- 172.21.15.96:0/2591293578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4005040 con 0x7f6af80f4d60 2022-02-02T19:48:08.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.518+0000 7f6afd231700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f6aec00b410 tx=0x7f6aec006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:08.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.519+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec0125f0 con 0x7f6af80f4d60 2022-02-02T19:48:08.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.519+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6aec012c00 con 0x7f6af80f4d60 2022-02-02T19:48:08.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.519+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af810a810 con 0x7f6af80f4d60 2022-02-02T19:48:08.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.519+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec002ae0 con 0x7f6af80f4d60 2022-02-02T19:48:08.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.519+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af810add0 con 0x7f6af80f4d60 2022-02-02T19:48:08.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.520+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af80f4150 con 0x7f6af80f4d60 2022-02-02T19:48:08.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.521+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6aec00f030 con 0x7f6af80f4d60 2022-02-02T19:48:08.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.521+0000 7f6ae9ffb700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 0x7f6ae4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:08.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.521+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6aec081e40 con 0x7f6af80f4d60 2022-02-02T19:48:08.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.521+0000 7f6afca30700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 0x7f6ae4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:08.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.521+0000 7f6afca30700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 0x7f6ae4067290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6af4000c00 tx=0x7f6af400ac40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:08.534 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:08 smithi159 ceph-mon[69013]: pgmap v2581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:08.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.525+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6aec053970 con 0x7f6af80f4d60 2022-02-02T19:48:08.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.726+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6af80fcde0 con 0x7f6af80f4d60 2022-02-02T19:48:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.726+0000 7f6ae9ffb700 1 -- 172.21.15.96:0/2591293578 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6aec053560 con 0x7f6af80f4d60 2022-02-02T19:48:08.730 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:48:08.730 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:48:08.731 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:48:08.731 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:48:08.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:08.731 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:48:08.731 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:48:08.732 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:48:08.732 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:48:08.732 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:48:08.732 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:48:08.733 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:48:08.733 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:48:08.733 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:48:08.733 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:48:08.733 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:48:08.734 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:48:08.734 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:48:08.734 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:48:08.734 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:48:08.735 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:48:08.735 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:48:08.735 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:48:08.735 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:48:08.735 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:48:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:48:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:48:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:48:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:48:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:48:08.737 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:48:08.737 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:48:08.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:08.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:08.738 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:48:08.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:08.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:08.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:08.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 msgr2=0x7f6ae4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 0x7f6ae4067290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6af4000c00 tx=0x7f6af400ac40).stop 2022-02-02T19:48:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 msgr2=0x7f6af8109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:08.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f6aec00b410 tx=0x7f6aec006ef0).stop 2022-02-02T19:48:08.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 shutdown_connections 2022-02-02T19:48:08.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ae4064dd0 0x7f6ae4067290 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af80f4d60 0x7f6af8109150 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:08.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 --2- 172.21.15.96:0/2591293578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6af80f5f60 0x7f6af8109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:48:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 >> 172.21.15.96:0/2591293578 conn(0x7f6af80f04c0 msgr2=0x7f6af80f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 shutdown_connections 2022-02-02T19:48:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:08.728+0000 7f6aff495700 1 -- 172.21.15.96:0/2591293578 wait complete. 2022-02-02T19:48:08.742 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:48:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:09 smithi159 ceph-mon[69013]: from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:09.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:09 smithi159 ceph-mon[69013]: from='client.36762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/274863243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:48:09.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2591293578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:48:09.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:09 smithi096 ceph-mon[101353]: from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:09.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:09 smithi096 ceph-mon[101353]: from='client.36762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/274863243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:48:09.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2591293578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:48:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:10 smithi159 ceph-mon[69013]: pgmap v2582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:10 smithi096 ceph-mon[101353]: pgmap v2582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:12 smithi159 ceph-mon[69013]: pgmap v2583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:12 smithi096 ceph-mon[101353]: pgmap v2583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:14 smithi159 ceph-mon[69013]: pgmap v2584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:14 smithi096 ceph-mon[101353]: pgmap v2584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:16 smithi159 ceph-mon[69013]: pgmap v2585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:16 smithi096 ceph-mon[101353]: pgmap v2585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:18 smithi159 ceph-mon[69013]: pgmap v2586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:18 smithi096 ceph-mon[101353]: pgmap v2586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:20 smithi159 ceph-mon[69013]: pgmap v2587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:20 smithi096 ceph-mon[101353]: pgmap v2587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:22 smithi159 ceph-mon[69013]: pgmap v2588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:22 smithi096 ceph-mon[101353]: pgmap v2588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:24 smithi159 ceph-mon[69013]: pgmap v2589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:24 smithi096 ceph-mon[101353]: pgmap v2589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:25.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:25 smithi096 ceph-mon[101353]: pgmap v2590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:25.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:25 smithi159 ceph-mon[69013]: pgmap v2590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:28 smithi159 ceph-mon[69013]: pgmap v2591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:48:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:48:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:28 smithi096 ceph-mon[101353]: pgmap v2591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:48:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:48:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:30 smithi159 ceph-mon[69013]: pgmap v2592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:30 smithi096 ceph-mon[101353]: pgmap v2592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:32 smithi159 ceph-mon[69013]: pgmap v2593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:32 smithi096 ceph-mon[101353]: pgmap v2593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:34 smithi159 ceph-mon[69013]: pgmap v2594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:34 smithi096 ceph-mon[101353]: pgmap v2594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:36 smithi159 ceph-mon[69013]: pgmap v2595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:36 smithi096 ceph-mon[101353]: pgmap v2595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:38 smithi159 ceph-mon[69013]: pgmap v2596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:38 smithi096 ceph-mon[101353]: pgmap v2596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:38.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.838+0000 7fd11d753700 1 -- 172.21.15.96:0/1144905871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 msgr2=0x7fd1180f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:38.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.838+0000 7fd11d753700 1 --2- 172.21.15.96:0/1144905871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd1180f6920 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fd10c004660 tx=0x7fd10c009b30).stop 2022-02-02T19:48:38.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 -- 172.21.15.96:0/1144905871 shutdown_connections 2022-02-02T19:48:38.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 --2- 172.21.15.96:0/1144905871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd1180f6920 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:38.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 --2- 172.21.15.96:0/1144905871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd1180f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:38.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 -- 172.21.15.96:0/1144905871 >> 172.21.15.96:0/1144905871 conn(0x7fd1180f0de0 msgr2=0x7fd1180f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:38.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 -- 172.21.15.96:0/1144905871 shutdown_connections 2022-02-02T19:48:38.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 -- 172.21.15.96:0/1144905871 wait complete. 2022-02-02T19:48:38.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 Processor -- start 2022-02-02T19:48:38.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.839+0000 7fd11d753700 1 -- start start 2022-02-02T19:48:38.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd11d753700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd118106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:38.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd11d753700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:38.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd11d753700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118107a10 con 0x7fd1180f5ef0 2022-02-02T19:48:38.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd11d753700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118107b50 con 0x7fd1180f55e0 2022-02-02T19:48:38.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:38.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33566/0 (socket says 172.21.15.96:33566) 2022-02-02T19:48:38.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 -- 172.21.15.96:0/2209179803 learned_addr learned my addr 172.21.15.96:0/2209179803 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:38.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd116ffd700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd118106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:38.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 -- 172.21.15.96:0/2209179803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 msgr2=0x7fd118106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:38.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd118106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:38.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 -- 172.21.15.96:0/2209179803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c005040 con 0x7fd1180f5ef0 2022-02-02T19:48:38.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd116ffd700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd118106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:48:38.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd1167fc700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fd10c009990 tx=0x7fd10c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:38.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.840+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c018070 con 0x7fd1180f5ef0 2022-02-02T19:48:38.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.841+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd10c007ba0 con 0x7fd1180f5ef0 2022-02-02T19:48:38.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.841+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118108490 con 0x7fd1180f5ef0 2022-02-02T19:48:38.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.841+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c01c3c0 con 0x7fd1180f5ef0 2022-02-02T19:48:38.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.841+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1181089f0 con 0x7fd1180f5ef0 2022-02-02T19:48:38.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.842+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd118045ad0 con 0x7fd1180f5ef0 2022-02-02T19:48:38.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.842+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd10c01d420 con 0x7fd1180f5ef0 2022-02-02T19:48:38.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.842+0000 7fd0ff7fe700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 0x7fd100067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:38.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.843+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd10c083820 con 0x7fd1180f5ef0 2022-02-02T19:48:38.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.843+0000 7fd116ffd700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 0x7fd100067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.843+0000 7fd116ffd700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 0x7fd100067290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fd108009740 tx=0x7fd108009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:38.847+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd10c055230 con 0x7fd1180f5ef0 2022-02-02T19:48:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.030+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd11805fe50 con 0x7fd100064dd0 2022-02-02T19:48:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.031+0000 7fd0ff7fe700 1 -- 172.21.15.96:0/2209179803 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd11805fe50 con 0x7fd100064dd0 2022-02-02T19:48:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 msgr2=0x7fd100067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 0x7fd100067290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fd108009740 tx=0x7fd108009be0).stop 2022-02-02T19:48:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 msgr2=0x7fd118107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fd10c009990 tx=0x7fd10c009b30).stop 2022-02-02T19:48:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 shutdown_connections 2022-02-02T19:48:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd100064dd0 0x7fd100067290 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1180f55e0 0x7fd118106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 --2- 172.21.15.96:0/2209179803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1180f5ef0 0x7fd118107460 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 >> 172.21.15.96:0/2209179803 conn(0x7fd1180f0de0 msgr2=0x7fd11805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 shutdown_connections 2022-02-02T19:48:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.033+0000 7fd11d753700 1 -- 172.21.15.96:0/2209179803 wait complete. 2022-02-02T19:48:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:48:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 -- 172.21.15.96:0/3415921327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 msgr2=0x7f7b540f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3415921327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b540f92a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f7b44004660 tx=0x7f7b44009b30).stop 2022-02-02T19:48:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 -- 172.21.15.96:0/3415921327 shutdown_connections 2022-02-02T19:48:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3415921327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 0x7f7b540fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3415921327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b540f92a0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 -- 172.21.15.96:0/3415921327 >> 172.21.15.96:0/3415921327 conn(0x7f7b540f0d40 msgr2=0x7f7b540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 -- 172.21.15.96:0/3415921327 shutdown_connections 2022-02-02T19:48:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.130+0000 7f7b5c196700 1 -- 172.21.15.96:0/3415921327 wait complete. 2022-02-02T19:48:39.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 Processor -- start 2022-02-02T19:48:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 -- start start 2022-02-02T19:48:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 0x7f7b54107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541079f0 con 0x7f7b54060310 2022-02-02T19:48:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b5c196700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54107b30 con 0x7f7b540f9820 2022-02-02T19:48:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b59f32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b59f32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33572/0 (socket says 172.21.15.96:33572) 2022-02-02T19:48:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b59f32700 1 -- 172.21.15.96:0/3417684154 learned_addr learned my addr 172.21.15.96:0/3417684154 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.131+0000 7f7b59731700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 0x7f7b54107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b59f32700 1 -- 172.21.15.96:0/3417684154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 msgr2=0x7f7b54107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b59f32700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 0x7f7b54107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b59f32700 1 -- 172.21.15.96:0/3417684154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44005040 con 0x7f7b54060310 2022-02-02T19:48:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b59f32700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f7b44009990 tx=0x7f7b44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b44018070 con 0x7f7b54060310 2022-02-02T19:48:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b54108470 con 0x7f7b54060310 2022-02-02T19:48:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b541089d0 con 0x7f7b54060310 2022-02-02T19:48:39.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b44007ba0 con 0x7f7b54060310 2022-02-02T19:48:39.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.132+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4401c3c0 con 0x7f7b54060310 2022-02-02T19:48:39.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.133+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c004fa0 con 0x7f7b54060310 2022-02-02T19:48:39.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.133+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b4401c630 con 0x7f7b54060310 2022-02-02T19:48:39.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.134+0000 7f7b4a7fc700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 0x7f7b40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.134+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b44083620 con 0x7f7b54060310 2022-02-02T19:48:39.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.134+0000 7f7b59731700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 0x7f7b40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.134+0000 7f7b59731700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 0x7f7b40067290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f7b500041d0 tx=0x7f7b50009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.138+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b440560d0 con 0x7f7b54060310 2022-02-02T19:48:39.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.311+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b3c000bc0 con 0x7f7b40064dd0 2022-02-02T19:48:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.320+0000 7f7b4a7fc700 1 -- 172.21.15.96:0/3417684154 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7b3c000bc0 con 0x7f7b40064dd0 2022-02-02T19:48:39.324 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:48:39.324 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (92m) 62m ago 93m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:48:39.325 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (84m) 62m ago 93m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:48:39.325 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (84m) 61m ago 92m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:48:39.325 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (91m) 62m ago 92m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:48:39.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (89m) 62m ago 89m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:48:39.326 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (84m) 62m ago 89m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:48:39.326 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (89m) 61m ago 89m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:48:39.326 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (85m) 61m ago 89m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:48:39.326 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (86m) 62m ago 94m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:48:39.327 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (85m) 61m ago 92m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:48:39.327 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (85m) 62m ago 94m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:48:39.327 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (85m) 61m ago 92m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:48:39.327 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (92m) 62m ago 92m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:48:39.328 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (92m) 61m ago 92m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:48:39.328 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (84m) 62m ago 91m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:48:39.328 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (83m) 62m ago 91m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:48:39.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (82m) 62m ago 91m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:48:39.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (82m) 61m ago 91m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:48:39.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (81m) 61m ago 90m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:48:39.330 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (81m) 61m ago 90m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:48:39.330 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (91m) 62m ago 92m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:48:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 msgr2=0x7f7b40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 0x7f7b40067290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f7b500041d0 tx=0x7f7b50009040).stop 2022-02-02T19:48:39.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 msgr2=0x7f7b54106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f7b44009990 tx=0x7f7b44009b30).stop 2022-02-02T19:48:39.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 shutdown_connections 2022-02-02T19:48:39.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b40064dd0 0x7f7b40067290 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54060310 0x7f7b54106f50 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 --2- 172.21.15.96:0/3417684154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b540f9820 0x7f7b54107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 >> 172.21.15.96:0/3417684154 conn(0x7f7b540f0d40 msgr2=0x7f7b540f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 shutdown_connections 2022-02-02T19:48:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.322+0000 7f7b5c196700 1 -- 172.21.15.96:0/3417684154 wait complete. 2022-02-02T19:48:39.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- 172.21.15.96:0/4058672105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 msgr2=0x7f21f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/4058672105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f40f6b00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f21ec004660 tx=0x7f21ec009b30).stop 2022-02-02T19:48:39.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- 172.21.15.96:0/4058672105 shutdown_connections 2022-02-02T19:48:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/4058672105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 0x7f21f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:48:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/4058672105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f40f6b00 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- 172.21.15.96:0/4058672105 >> 172.21.15.96:0/4058672105 conn(0x7f21f40f1e40 msgr2=0x7f21f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- 172.21.15.96:0/4058672105 shutdown_connections 2022-02-02T19:48:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- 172.21.15.96:0/4058672105 wait complete. 2022-02-02T19:48:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 Processor -- start 2022-02-02T19:48:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.418+0000 7f21fc1ea700 1 -- start start 2022-02-02T19:48:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21fc1ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21fc1ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 0x7f21f41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21fc1ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4107ae0 con 0x7f21f40f66e0 2022-02-02T19:48:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21fc1ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4108390 con 0x7f21f40f7980 2022-02-02T19:48:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33582/0 (socket says 172.21.15.96:33582) 2022-02-02T19:48:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 -- 172.21.15.96:0/1058352042 learned_addr learned my addr 172.21.15.96:0/1058352042 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9785700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 0x7f21f41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 -- 172.21.15.96:0/1058352042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 msgr2=0x7f21f41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 0x7f21f41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 -- 172.21.15.96:0/1058352042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec005040 con 0x7f21f40f66e0 2022-02-02T19:48:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.419+0000 7f21f9f86700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f21ec004f60 tx=0x7f21ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.420+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21ec018070 con 0x7f21f40f66e0 2022-02-02T19:48:39.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.420+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21ec007ba0 con 0x7f21f40f66e0 2022-02-02T19:48:39.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.420+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f4108610 con 0x7f21f40f66e0 2022-02-02T19:48:39.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.420+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21ec01c620 con 0x7f21f40f66e0 2022-02-02T19:48:39.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.420+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f4108b70 con 0x7f21f40f66e0 2022-02-02T19:48:39.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.421+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc004fa0 con 0x7f21f40f66e0 2022-02-02T19:48:39.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.422+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21ec01d420 con 0x7f21f40f66e0 2022-02-02T19:48:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.422+0000 7f21ea7fc700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 0x7f21e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.422+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f21ec083ca0 con 0x7f21f40f66e0 2022-02-02T19:48:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.422+0000 7f21f9785700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 0x7f21e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.423+0000 7f21f9785700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 0x7f21e0067290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f21e400b790 tx=0x7f21e4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.426+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21ec055850 con 0x7f21f40f66e0 2022-02-02T19:48:39.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.654+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21dc005940 con 0x7f21f40f66e0 2022-02-02T19:48:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.655+0000 7f21ea7fc700 1 -- 172.21.15.96:0/1058352042 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f21ec055440 con 0x7f21f40f66e0 2022-02-02T19:48:39.659 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:48:39.659 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:48:39.659 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:48:39.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:39.660 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:48:39.660 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:48:39.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:48:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:48:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:48:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:48:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:48:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:48:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:48:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:48:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:48:39.663 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:48:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 msgr2=0x7f21e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 0x7f21e0067290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f21e400b790 tx=0x7f21e4008040).stop 2022-02-02T19:48:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 msgr2=0x7f21f4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f21ec004f60 tx=0x7f21ec009b30).stop 2022-02-02T19:48:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 shutdown_connections 2022-02-02T19:48:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21e0064dd0 0x7f21e0067290 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21f40f66e0 0x7f21f4106fb0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 --2- 172.21.15.96:0/1058352042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f40f7980 0x7f21f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 >> 172.21.15.96:0/1058352042 conn(0x7f21f40f1e40 msgr2=0x7f21f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 shutdown_connections 2022-02-02T19:48:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.657+0000 7f21fc1ea700 1 -- 172.21.15.96:0/1058352042 wait complete. 2022-02-02T19:48:39.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 -- 172.21.15.96:0/1695438477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f6860 msgr2=0x7fa4c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/1695438477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f6860 0x7fa4c80f6cc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fa4c4004660 tx=0x7fa4c4009b30).stop 2022-02-02T19:48:39.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 -- 172.21.15.96:0/1695438477 shutdown_connections 2022-02-02T19:48:39.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/1695438477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f6860 0x7fa4c80f6cc0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/1695438477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f55c0 0x7fa4c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 -- 172.21.15.96:0/1695438477 >> 172.21.15.96:0/1695438477 conn(0x7fa4c80f0d40 msgr2=0x7fa4c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 -- 172.21.15.96:0/1695438477 shutdown_connections 2022-02-02T19:48:39.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.754+0000 7fa4cfcda700 1 -- 172.21.15.96:0/1695438477 wait complete. 2022-02-02T19:48:39.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 Processor -- start 2022-02-02T19:48:39.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 -- start start 2022-02-02T19:48:39.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 0x7fa4c81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81069b0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cfcda700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81071c0 con 0x7fa4c80f6860 2022-02-02T19:48:39.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cda76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cda76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33592/0 (socket says 172.21.15.96:33592) 2022-02-02T19:48:39.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cda76700 1 -- 172.21.15.96:0/829367155 learned_addr learned my addr 172.21.15.96:0/829367155 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:48:39.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cd275700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 0x7fa4c81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cda76700 1 -- 172.21.15.96:0/829367155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 msgr2=0x7fa4c81063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.755+0000 7fa4cda76700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 0x7fa4c81063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4cda76700 1 -- 172.21.15.96:0/829367155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4005040 con 0x7fa4c80f55c0 2022-02-02T19:48:39.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4cd275700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 0x7fa4c81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:48:39.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4cda76700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa4b800c530 tx=0x7fa4b8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b800f650 con 0x7fa4c80f55c0 2022-02-02T19:48:39.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c81073e0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c8107970 con 0x7fa4c80f55c0 2022-02-02T19:48:39.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa4b800fc60 con 0x7fa4c80f55c0 2022-02-02T19:48:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.756+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b8012d20 con 0x7fa4c80f55c0 2022-02-02T19:48:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.757+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b0004fa0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.757+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa4b8019030 con 0x7fa4c80f55c0 2022-02-02T19:48:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.758+0000 7fa4be7fc700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 0x7fa4b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:48:39.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.758+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa4b80815a0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.758+0000 7fa4cd275700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 0x7fa4b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:48:39.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.758+0000 7fa4cd275700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 0x7fa4b4067290 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fa4c4009da0 tx=0x7fa4c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:48:39.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.762+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4b80487d0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.963+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4b0005e80 con 0x7fa4c80f55c0 2022-02-02T19:48:39.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.963+0000 7fa4be7fc700 1 -- 172.21.15.96:0/829367155 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa4b804f6f0 con 0x7fa4c80f55c0 2022-02-02T19:48:39.967 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:48:39.968 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:48:39.968 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:48:39.968 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:48:39.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:39.969 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:48:39.969 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:48:39.969 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:48:39.969 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:48:39.970 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:48:39.970 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:48:39.970 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:48:39.971 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:48:39.971 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:48:39.971 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:48:39.971 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:48:39.972 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:48:39.972 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:48:39.972 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:48:39.972 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:48:39.972 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:48:39.973 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:48:39.973 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:48:39.973 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:48:39.973 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:48:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:48:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:48:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:48:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:48:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:48:39.975 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:48:39.975 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:48:39.975 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:39.975 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:39.976 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:48:39.976 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:48:39.976 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:39.976 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:39.977 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:48:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 msgr2=0x7fa4b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 0x7fa4b4067290 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fa4c4009da0 tx=0x7fa4c4009b30).stop 2022-02-02T19:48:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 msgr2=0x7fa4c8105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:48:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa4b800c530 tx=0x7fa4b8007e10).stop 2022-02-02T19:48:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 shutdown_connections 2022-02-02T19:48:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4b4064dd0 0x7fa4b4067290 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c80f55c0 0x7fa4c8105ec0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 --2- 172.21.15.96:0/829367155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4c80f6860 0x7fa4c81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:48:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 >> 172.21.15.96:0/829367155 conn(0x7fa4c80f0d40 msgr2=0x7fa4c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:48:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 shutdown_connections 2022-02-02T19:48:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:48:39.965+0000 7fa4cfcda700 1 -- 172.21.15.96:0/829367155 wait complete. 2022-02-02T19:48:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:48:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:40 smithi159 ceph-mon[69013]: pgmap v2597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:40 smithi159 ceph-mon[69013]: from='client.36774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1058352042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:48:40.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/829367155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:48:40.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:40 smithi096 ceph-mon[101353]: pgmap v2597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:40 smithi096 ceph-mon[101353]: from='client.36774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1058352042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:48:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/829367155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:48:41.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:41 smithi159 ceph-mon[69013]: from='client.36778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:41.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:41 smithi096 ceph-mon[101353]: from='client.36778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:48:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:42 smithi159 ceph-mon[69013]: pgmap v2598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:42 smithi096 ceph-mon[101353]: pgmap v2598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:44 smithi159 ceph-mon[69013]: pgmap v2599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:44 smithi096 ceph-mon[101353]: pgmap v2599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:46 smithi159 ceph-mon[69013]: pgmap v2600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:46 smithi096 ceph-mon[101353]: pgmap v2600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:48 smithi159 ceph-mon[69013]: pgmap v2601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:48 smithi096 ceph-mon[101353]: pgmap v2601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:50 smithi159 ceph-mon[69013]: pgmap v2602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:50 smithi096 ceph-mon[101353]: pgmap v2602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:52 smithi159 ceph-mon[69013]: pgmap v2603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:52 smithi096 ceph-mon[101353]: pgmap v2603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:54 smithi159 ceph-mon[69013]: pgmap v2604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:54 smithi096 ceph-mon[101353]: pgmap v2604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:55.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:55 smithi096 ceph-mon[101353]: pgmap v2605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:55 smithi159 ceph-mon[69013]: pgmap v2605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:48:58 smithi159 ceph-mon[69013]: pgmap v2606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:48:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:48:58 smithi096 ceph-mon[101353]: pgmap v2606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:00 smithi159 ceph-mon[69013]: pgmap v2607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:00 smithi096 ceph-mon[101353]: pgmap v2607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:02 smithi159 ceph-mon[69013]: pgmap v2608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:02 smithi096 ceph-mon[101353]: pgmap v2608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:04 smithi159 ceph-mon[69013]: pgmap v2609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:04 smithi096 ceph-mon[101353]: pgmap v2609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:06 smithi159 ceph-mon[69013]: pgmap v2610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:06 smithi096 ceph-mon[101353]: pgmap v2610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:08 smithi159 ceph-mon[69013]: pgmap v2611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:08 smithi096 ceph-mon[101353]: pgmap v2611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 -- 172.21.15.96:0/191273765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f6520 msgr2=0x7f1a000f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 --2- 172.21.15.96:0/191273765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f6520 0x7f1a000f6940 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f19f0004660 tx=0x7f19f0009b30).stop 2022-02-02T19:49:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 -- 172.21.15.96:0/191273765 shutdown_connections 2022-02-02T19:49:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 --2- 172.21.15.96:0/191273765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f77c0 0x7f1a000f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 --2- 172.21.15.96:0/191273765 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f6520 0x7f1a000f6940 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 -- 172.21.15.96:0/191273765 >> 172.21.15.96:0/191273765 conn(0x7f1a000f1ca0 msgr2=0x7f1a000f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 -- 172.21.15.96:0/191273765 shutdown_connections 2022-02-02T19:49:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 -- 172.21.15.96:0/191273765 wait complete. 2022-02-02T19:49:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.074+0000 7f1a051fe700 1 Processor -- start 2022-02-02T19:49:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f1a051fe700 1 -- start start 2022-02-02T19:49:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f1a051fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 0x7f1a00106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f1a051fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f1a051fe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00107930 con 0x7f1a000f77c0 2022-02-02T19:49:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f1a051fe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001080e0 con 0x7f1a000f6520 2022-02-02T19:49:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33612/0 (socket says 172.21.15.96:33612) 2022-02-02T19:49:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 -- 172.21.15.96:0/2259701397 learned_addr learned my addr 172.21.15.96:0/2259701397 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19fffff700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 0x7f1a00106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 -- 172.21.15.96:0/2259701397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 msgr2=0x7f1a00106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 0x7f1a00106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19ff7fe700 1 -- 172.21.15.96:0/2259701397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0005040 con 0x7f1a000f77c0 2022-02-02T19:49:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.075+0000 7f19fffff700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 0x7f1a00106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:49:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f19ff7fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f19e800b410 tx=0x7f19e8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e80125f0 con 0x7f1a000f77c0 2022-02-02T19:49:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a001083c0 con 0x7f1a000f77c0 2022-02-02T19:49:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19e8012c00 con 0x7f1a000f77c0 2022-02-02T19:49:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a00108980 con 0x7f1a000f77c0 2022-02-02T19:49:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.076+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e8002ae0 con 0x7f1a000f77c0 2022-02-02T19:49:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.077+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e4004fa0 con 0x7f1a000f77c0 2022-02-02T19:49:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.077+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19e800f030 con 0x7f1a000f77c0 2022-02-02T19:49:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.078+0000 7f19fcff9700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 0x7f19ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.078+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19e8081e80 con 0x7f1a000f77c0 2022-02-02T19:49:10.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.078+0000 7f19fffff700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 0x7f19ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.078+0000 7f19fffff700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 0x7f19ec0672e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f19f0004e30 tx=0x7f19f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.082+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19e804ff80 con 0x7f1a000f77c0 2022-02-02T19:49:10.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.261+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e4000bc0 con 0x7f19ec064e20 2022-02-02T19:49:10.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.262+0000 7f19fcff9700 1 -- 172.21.15.96:0/2259701397 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f19e4000bc0 con 0x7f19ec064e20 2022-02-02T19:49:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 msgr2=0x7f19ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 0x7f19ec0672e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f19f0004e30 tx=0x7f19f0009b30).stop 2022-02-02T19:49:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 msgr2=0x7f1a001072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f19e800b410 tx=0x7f19e8006ef0).stop 2022-02-02T19:49:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 shutdown_connections 2022-02-02T19:49:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19ec064e20 0x7f19ec0672e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a000f6520 0x7f1a00106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 --2- 172.21.15.96:0/2259701397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a000f77c0 0x7f1a001072a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 >> 172.21.15.96:0/2259701397 conn(0x7f1a000f1ca0 msgr2=0x7f1a000fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 shutdown_connections 2022-02-02T19:49:10.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.264+0000 7f1a051fe700 1 -- 172.21.15.96:0/2259701397 wait complete. 2022-02-02T19:49:10.278 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:49:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 -- 172.21.15.96:0/564608497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66d0 msgr2=0x7f165c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 --2- 172.21.15.96:0/564608497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66d0 0x7f165c0f6b30 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f164c004660 tx=0x7f164c009b30).stop 2022-02-02T19:49:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 -- 172.21.15.96:0/564608497 shutdown_connections 2022-02-02T19:49:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 --2- 172.21.15.96:0/564608497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66d0 0x7f165c0f6b30 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 --2- 172.21.15.96:0/564608497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f5430 0x7f165c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 -- 172.21.15.96:0/564608497 >> 172.21.15.96:0/564608497 conn(0x7f165c0f0b90 msgr2=0x7f165c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:10 smithi096 ceph-mon[101353]: pgmap v2612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:10.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 -- 172.21.15.96:0/564608497 shutdown_connections 2022-02-02T19:49:10.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.361+0000 7f1662512700 1 -- 172.21.15.96:0/564608497 wait complete. 2022-02-02T19:49:10.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 Processor -- start 2022-02-02T19:49:10.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 -- start start 2022-02-02T19:49:10.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0602d0 0x7f165c10c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c10c660 con 0x7f165c0f5430 2022-02-02T19:49:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1662512700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c10c7a0 con 0x7f165c0602d0 2022-02-02T19:49:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33620/0 (socket says 172.21.15.96:33620) 2022-02-02T19:49:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 -- 172.21.15.96:0/1519099250 learned_addr learned my addr 172.21.15.96:0/1519099250 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:10.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1660d0f700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0602d0 0x7f165c10c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 -- 172.21.15.96:0/1519099250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0602d0 msgr2=0x7f165c10c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0602d0 0x7f165c10c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.362+0000 7f1661510700 1 -- 172.21.15.96:0/1519099250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c005040 con 0x7f165c0f5430 2022-02-02T19:49:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1661510700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f1658002700 tx=0x7f1658009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1658009320 con 0x7f165c0f5430 2022-02-02T19:49:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c10ca80 con 0x7f165c0f5430 2022-02-02T19:49:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f165800f040 con 0x7f165c0f5430 2022-02-02T19:49:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1658014900 con 0x7f165c0f5430 2022-02-02T19:49:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.363+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c10d040 con 0x7f165c0f5430 2022-02-02T19:49:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.364+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c045ad0 con 0x7f165c0f5430 2022-02-02T19:49:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.364+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1658009480 con 0x7f165c0f5430 2022-02-02T19:49:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.365+0000 7f1651ffb700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 0x7f16480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.365+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1658081cc0 con 0x7f165c0f5430 2022-02-02T19:49:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.365+0000 7f1660d0f700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 0x7f16480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.365+0000 7f1660d0f700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 0x7f16480672e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f164c000c00 tx=0x7f164c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.369+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f165804fe80 con 0x7f165c0f5430 2022-02-02T19:49:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:10 smithi159 ceph-mon[69013]: pgmap v2612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:10.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.544+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f165c0fdd30 con 0x7f1648064e20 2022-02-02T19:49:10.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.553+0000 7f1651ffb700 1 -- 172.21.15.96:0/1519099250 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f165c0fdd30 con 0x7f1648064e20 2022-02-02T19:49:10.557 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:49:10.558 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (92m) 63m ago 93m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:49:10.558 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (84m) 63m ago 93m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:49:10.558 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (84m) 61m ago 93m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:49:10.558 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (92m) 63m ago 93m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:49:10.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (89m) 63m ago 89m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:49:10.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (85m) 63m ago 89m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:49:10.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (89m) 61m ago 89m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:49:10.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (85m) 61m ago 89m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:49:10.560 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (86m) 63m ago 94m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:49:10.560 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (86m) 61m ago 93m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:49:10.560 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (85m) 63m ago 94m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:49:10.560 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (85m) 61m ago 93m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:49:10.560 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (93m) 63m ago 93m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:49:10.561 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (92m) 61m ago 92m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:49:10.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (84m) 63m ago 92m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:49:10.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (84m) 63m ago 92m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:49:10.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (83m) 63m ago 91m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:49:10.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (82m) 61m ago 91m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:49:10.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (82m) 61m ago 91m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:49:10.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (81m) 61m ago 90m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:49:10.562 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (92m) 63m ago 93m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:49:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 msgr2=0x7f16480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 0x7f16480672e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f164c000c00 tx=0x7f164c009b30).stop 2022-02-02T19:49:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 msgr2=0x7f165c109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f1658002700 tx=0x7f1658009d80).stop 2022-02-02T19:49:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 shutdown_connections 2022-02-02T19:49:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064e20 0x7f16480672e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f5430 0x7f165c109c00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 --2- 172.21.15.96:0/1519099250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0602d0 0x7f165c10c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 >> 172.21.15.96:0/1519099250 conn(0x7f165c0f0b90 msgr2=0x7f165c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 shutdown_connections 2022-02-02T19:49:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.555+0000 7f1662512700 1 -- 172.21.15.96:0/1519099250 wait complete. 2022-02-02T19:49:10.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2077657294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 msgr2=0x7fa8b80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2077657294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b80f7de0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fa8a8004660 tx=0x7fa8a8009b30).stop 2022-02-02T19:49:10.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2077657294 shutdown_connections 2022-02-02T19:49:10.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2077657294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b80f7de0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2077657294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 0x7fa8b80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:10.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2077657294 >> 172.21.15.96:0/2077657294 conn(0x7fa8b80f1e40 msgr2=0x7fa8b80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2077657294 shutdown_connections 2022-02-02T19:49:10.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.652+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2077657294 wait complete. 2022-02-02T19:49:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 Processor -- start 2022-02-02T19:49:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 -- start start 2022-02-02T19:49:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 0x7fa8b8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8107ae0 con 0x7fa8b80f7980 2022-02-02T19:49:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8bd9cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8108390 con 0x7fa8b80f66e0 2022-02-02T19:49:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8b67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8b67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33632/0 (socket says 172.21.15.96:33632) 2022-02-02T19:49:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8b67fc700 1 -- 172.21.15.96:0/2046945894 learned_addr learned my addr 172.21.15.96:0/2046945894 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.653+0000 7fa8b6ffd700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 0x7fa8b8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8b67fc700 1 -- 172.21.15.96:0/2046945894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 msgr2=0x7fa8b8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8b67fc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 0x7fa8b8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8b67fc700 1 -- 172.21.15.96:0/2046945894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a8005040 con 0x7fa8b80f7980 2022-02-02T19:49:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8b67fc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7fa8a8009990 tx=0x7fa8a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a8018070 con 0x7fa8b80f7980 2022-02-02T19:49:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b8108610 con 0x7fa8b80f7980 2022-02-02T19:49:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b8108b70 con 0x7fa8b80f7980 2022-02-02T19:49:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa8a8007ba0 con 0x7fa8b80f7980 2022-02-02T19:49:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.654+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a801c620 con 0x7fa8b80f7980 2022-02-02T19:49:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.655+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa898004fa0 con 0x7fa8b80f7980 2022-02-02T19:49:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.655+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa8a801c890 con 0x7fa8b80f7980 2022-02-02T19:49:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.656+0000 7fa89f7fe700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.656+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8a80836c0 con 0x7fa8b80f7980 2022-02-02T19:49:10.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.656+0000 7fa8b6ffd700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.656+0000 7fa8b6ffd700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fa8ac006fd0 tx=0x7fa8ac008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:10.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.660+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8a80552b0 con 0x7fa8b80f7980 2022-02-02T19:49:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.889+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa898005e80 con 0x7fa8b80f7980 2022-02-02T19:49:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.889+0000 7fa89f7fe700 1 -- 172.21.15.96:0/2046945894 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa8a8054ea0 con 0x7fa8b80f7980 2022-02-02T19:49:10.894 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:49:10.895 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:49:10.895 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:49:10.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:10.896 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:49:10.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:49:10.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:10.897 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:49:10.899 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:49:10.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:10.901 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:49:10.901 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:49:10.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:10.902 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:49:10.902 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:49:10.903 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:49:10.903 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:49:10.903 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:49:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 msgr2=0x7fa8a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fa8ac006fd0 tx=0x7fa8ac008040).stop 2022-02-02T19:49:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 msgr2=0x7fa8b81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7fa8a8009990 tx=0x7fa8a8009b30).stop 2022-02-02T19:49:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 shutdown_connections 2022-02-02T19:49:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f66e0 0x7fa8b8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 --2- 172.21.15.96:0/2046945894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f7980 0x7fa8b81074a0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 >> 172.21.15.96:0/2046945894 conn(0x7fa8b80f1e40 msgr2=0x7fa8b80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 shutdown_connections 2022-02-02T19:49:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.892+0000 7fa8bd9cc700 1 -- 172.21.15.96:0/2046945894 wait complete. 2022-02-02T19:49:10.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 -- 172.21.15.96:0/3177124738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 msgr2=0x7f50500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:10.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 --2- 172.21.15.96:0/3177124738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f50500f59e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f5040004660 tx=0x7f5040009b30).stop 2022-02-02T19:49:10.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 -- 172.21.15.96:0/3177124738 shutdown_connections 2022-02-02T19:49:10.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 --2- 172.21.15.96:0/3177124738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 0x7f50500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 --2- 172.21.15.96:0/3177124738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f50500f59e0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:10.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 -- 172.21.15.96:0/3177124738 >> 172.21.15.96:0/3177124738 conn(0x7f50500f0d40 msgr2=0x7f50500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:10.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 -- 172.21.15.96:0/3177124738 shutdown_connections 2022-02-02T19:49:10.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 -- 172.21.15.96:0/3177124738 wait complete. 2022-02-02T19:49:10.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.990+0000 7f5057b8e700 1 Processor -- start 2022-02-02T19:49:10.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5057b8e700 1 -- start start 2022-02-02T19:49:10.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5057b8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5057b8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 0x7f505010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:10.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5057b8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500603e0 con 0x7f50500f55c0 2022-02-02T19:49:10.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5057b8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050060520 con 0x7f50500f6860 2022-02-02T19:49:10.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:10.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33640/0 (socket says 172.21.15.96:33640) 2022-02-02T19:49:11.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 -- 172.21.15.96:0/4243901639 learned_addr learned my addr 172.21.15.96:0/4243901639 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:11.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f5055129700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 0x7f505010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:11.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 -- 172.21.15.96:0/4243901639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 msgr2=0x7f505010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:11.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 0x7f505010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:11.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 -- 172.21.15.96:0/4243901639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040005040 con 0x7f50500f55c0 2022-02-02T19:49:11.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.991+0000 7f505592a700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f5040004f60 tx=0x7f5040009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:11.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.992+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5040018070 con 0x7f50500f55c0 2022-02-02T19:49:11.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.992+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505010c6c0 con 0x7f50500f55c0 2022-02-02T19:49:11.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.992+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5040007ba0 con 0x7f50500f55c0 2022-02-02T19:49:11.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.992+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504001c620 con 0x7f50500f55c0 2022-02-02T19:49:11.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.992+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505010cc20 con 0x7f50500f55c0 2022-02-02T19:49:11.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.993+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5050045ad0 con 0x7f50500f55c0 2022-02-02T19:49:11.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.993+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f504001c8e0 con 0x7f50500f55c0 2022-02-02T19:49:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.994+0000 7f50467fc700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 0x7f503c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.994+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5040083960 con 0x7f50500f55c0 2022-02-02T19:49:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.994+0000 7f5055129700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 0x7f503c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.994+0000 7f5055129700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 0x7f503c067290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f504c007fd0 tx=0x7f504c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:11.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:10.998+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5040051a60 con 0x7f50500f55c0 2022-02-02T19:49:11.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.197+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50500fde20 con 0x7f50500f55c0 2022-02-02T19:49:11.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.198+0000 7f50467fc700 1 -- 172.21.15.96:0/4243901639 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5040055080 con 0x7f50500f55c0 2022-02-02T19:49:11.202 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:49:11.202 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:49:11.203 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:49:11.203 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:49:11.203 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:11.203 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:49:11.204 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:49:11.204 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:49:11.204 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:49:11.204 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:49:11.205 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:49:11.205 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:49:11.206 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:49:11.206 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:49:11.206 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:49:11.206 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:49:11.207 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:49:11.207 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:49:11.207 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:49:11.207 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:49:11.208 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:49:11.208 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:49:11.208 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:49:11.208 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:49:11.209 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:49:11.209 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:49:11.209 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:49:11.209 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:49:11.209 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:49:11.210 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:49:11.210 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:49:11.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:49:11.210 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:11.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:11.211 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:49:11.211 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:11.211 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:11.211 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:11.212 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:11.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.199+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 msgr2=0x7f503c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:11.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.199+0000 7f5057b8e700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 0x7f503c067290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f504c007fd0 tx=0x7f504c009040).stop 2022-02-02T19:49:11.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.199+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 msgr2=0x7f5050109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:11.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.199+0000 7f5057b8e700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f5040004f60 tx=0x7f5040009b30).stop 2022-02-02T19:49:11.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 shutdown_connections 2022-02-02T19:49:11.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f503c064dd0 0x7f503c067290 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:11.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50500f55c0 0x7f5050109c70 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:11.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 --2- 172.21.15.96:0/4243901639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50500f6860 0x7f505010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:11.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 >> 172.21.15.96:0/4243901639 conn(0x7f50500f0d40 msgr2=0x7f50500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:11.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 shutdown_connections 2022-02-02T19:49:11.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:11.200+0000 7f5057b8e700 1 -- 172.21.15.96:0/4243901639 wait complete. 2022-02-02T19:49:11.216 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:49:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2046945894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:49:11.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4243901639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:49:11.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2046945894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:49:11.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4243901639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:49:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:12 smithi159 ceph-mon[69013]: from='client.36790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:12 smithi159 ceph-mon[69013]: pgmap v2613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:12 smithi159 ceph-mon[69013]: from='client.36794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:12 smithi096 ceph-mon[101353]: from='client.36790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:12 smithi096 ceph-mon[101353]: pgmap v2613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:12 smithi096 ceph-mon[101353]: from='client.36794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:14 smithi159 ceph-mon[69013]: pgmap v2614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:14 smithi096 ceph-mon[101353]: pgmap v2614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:16 smithi159 ceph-mon[69013]: pgmap v2615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:16 smithi096 ceph-mon[101353]: pgmap v2615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:18 smithi159 ceph-mon[69013]: pgmap v2616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:18 smithi096 ceph-mon[101353]: pgmap v2616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:20 smithi159 ceph-mon[69013]: pgmap v2617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:20 smithi096 ceph-mon[101353]: pgmap v2617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:22 smithi159 ceph-mon[69013]: pgmap v2618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:22 smithi096 ceph-mon[101353]: pgmap v2618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:23.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:23 smithi159 ceph-mon[69013]: pgmap v2619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:23.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:23 smithi096 ceph-mon[101353]: pgmap v2619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:25.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:25 smithi096 ceph-mon[101353]: pgmap v2620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:26.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:25 smithi159 ceph-mon[69013]: pgmap v2620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:28 smithi159 ceph-mon[69013]: pgmap v2621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:49:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:49:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:28 smithi096 ceph-mon[101353]: pgmap v2621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:49:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:49:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:30 smithi159 ceph-mon[69013]: pgmap v2622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:30 smithi096 ceph-mon[101353]: pgmap v2622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:32 smithi159 ceph-mon[69013]: pgmap v2623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:32 smithi096 ceph-mon[101353]: pgmap v2623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:34 smithi159 ceph-mon[69013]: pgmap v2624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:34 smithi096 ceph-mon[101353]: pgmap v2624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:36 smithi159 ceph-mon[69013]: pgmap v2625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:36 smithi096 ceph-mon[101353]: pgmap v2625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:38 smithi159 ceph-mon[69013]: pgmap v2626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:38 smithi096 ceph-mon[101353]: pgmap v2626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:40 smithi159 ceph-mon[69013]: pgmap v2627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:40 smithi096 ceph-mon[101353]: pgmap v2627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:41.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 -- 172.21.15.96:0/2893701983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 msgr2=0x7f94900f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 --2- 172.21.15.96:0/2893701983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f94900f6050 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f948c004660 tx=0x7f948c009b30).stop 2022-02-02T19:49:41.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 -- 172.21.15.96:0/2893701983 shutdown_connections 2022-02-02T19:49:41.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 --2- 172.21.15.96:0/2893701983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94900f6540 0x7f94900f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 --2- 172.21.15.96:0/2893701983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f94900f6050 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.310+0000 7f94982dc700 1 -- 172.21.15.96:0/2893701983 >> 172.21.15.96:0/2893701983 conn(0x7f94900f0540 msgr2=0x7f94900f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:41.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.311+0000 7f94982dc700 1 -- 172.21.15.96:0/2893701983 shutdown_connections 2022-02-02T19:49:41.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.311+0000 7f94982dc700 1 -- 172.21.15.96:0/2893701983 wait complete. 2022-02-02T19:49:41.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.311+0000 7f94982dc700 1 Processor -- start 2022-02-02T19:49:41.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.311+0000 7f94982dc700 1 -- start start 2022-02-02T19:49:41.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94900f6540 0x7f94901063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490106960 con 0x7f94900f5c30 2022-02-02T19:49:41.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490107160 con 0x7f94900f6540 2022-02-02T19:49:41.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33658/0 (socket says 172.21.15.96:33658) 2022-02-02T19:49:41.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 -- 172.21.15.96:0/4057590936 learned_addr learned my addr 172.21.15.96:0/4057590936 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:41.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 -- 172.21.15.96:0/4057590936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94900f6540 msgr2=0x7f94901063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94900f6540 0x7f94901063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:41.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 -- 172.21.15.96:0/4057590936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c005040 con 0x7f94900f5c30 2022-02-02T19:49:41.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9496078700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f948c000c00 tx=0x7f948c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c019070 con 0x7f94900f5c30 2022-02-02T19:49:41.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f948c007e70 con 0x7f94900f5c30 2022-02-02T19:49:41.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94901073e0 con 0x7f94900f5c30 2022-02-02T19:49:41.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c014e20 con 0x7f94900f5c30 2022-02-02T19:49:41.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.312+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490107940 con 0x7f94900f5c30 2022-02-02T19:49:41.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.313+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900f41d0 con 0x7f94900f5c30 2022-02-02T19:49:41.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.314+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f948c025070 con 0x7f94900f5c30 2022-02-02T19:49:41.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.314+0000 7f9486ffd700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 0x7f947c067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.314+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f948c082b90 con 0x7f94900f5c30 2022-02-02T19:49:41.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.315+0000 7f9495877700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 0x7f947c067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.315+0000 7f9495877700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 0x7f947c067230 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f9480004b70 tx=0x7f948000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.319+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f948c0545a0 con 0x7f94900f5c30 2022-02-02T19:49:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.502+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94900fdef0 con 0x7f947c064d70 2022-02-02T19:49:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.503+0000 7f9486ffd700 1 -- 172.21.15.96:0/4057590936 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f94900fdef0 con 0x7f947c064d70 2022-02-02T19:49:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 msgr2=0x7f947c067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 0x7f947c067230 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f9480004b70 tx=0x7f948000b040).stop 2022-02-02T19:49:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 msgr2=0x7f9490105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f948c000c00 tx=0x7f948c00b040).stop 2022-02-02T19:49:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 shutdown_connections 2022-02-02T19:49:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f947c064d70 0x7f947c067230 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94900f5c30 0x7f9490105ec0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 --2- 172.21.15.96:0/4057590936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94900f6540 0x7f94901063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 >> 172.21.15.96:0/4057590936 conn(0x7f94900f0540 msgr2=0x7f94900fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 shutdown_connections 2022-02-02T19:49:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.505+0000 7f94982dc700 1 -- 172.21.15.96:0/4057590936 wait complete. 2022-02-02T19:49:41.519 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:49:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 -- 172.21.15.96:0/1421646964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 msgr2=0x7f9ea80f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/1421646964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea80f7da0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f9e98004660 tx=0x7f9e98009b30).stop 2022-02-02T19:49:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 -- 172.21.15.96:0/1421646964 shutdown_connections 2022-02-02T19:49:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/1421646964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea80f7da0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/1421646964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 0x7f9ea80f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 -- 172.21.15.96:0/1421646964 >> 172.21.15.96:0/1421646964 conn(0x7f9ea80f1e00 msgr2=0x7f9ea80f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 -- 172.21.15.96:0/1421646964 shutdown_connections 2022-02-02T19:49:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 -- 172.21.15.96:0/1421646964 wait complete. 2022-02-02T19:49:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.603+0000 7f9eadf3f700 1 Processor -- start 2022-02-02T19:49:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9eadf3f700 1 -- start start 2022-02-02T19:49:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9eadf3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 0x7f9ea806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9eadf3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9eadf3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea806a410 con 0x7f9ea80f7940 2022-02-02T19:49:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9eadf3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea806a550 con 0x7f9ea80f66a0 2022-02-02T19:49:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33670/0 (socket says 172.21.15.96:33670) 2022-02-02T19:49:41.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/3227204494 learned_addr learned my addr 172.21.15.96:0/3227204494 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:41.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea77fe700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 0x7f9ea806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/3227204494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 msgr2=0x7f9ea806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 0x7f9ea806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.604+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/3227204494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98005040 con 0x7f9ea80f7940 2022-02-02T19:49:41.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9ea6ffd700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f9e98009990 tx=0x7f9e98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e98018070 con 0x7f9ea80f7940 2022-02-02T19:49:41.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea806a7d0 con 0x7f9ea80f7940 2022-02-02T19:49:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e98007ca0 con 0x7f9ea80f7940 2022-02-02T19:49:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9801c620 con 0x7f9ea80f7940 2022-02-02T19:49:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.605+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea810eee0 con 0x7f9ea80f7940 2022-02-02T19:49:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.606+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea8045ad0 con 0x7f9ea80f7940 2022-02-02T19:49:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.606+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e9801d960 con 0x7f9ea80f7940 2022-02-02T19:49:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.607+0000 7f9e8ffff700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 0x7f9e900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.607+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e980837e0 con 0x7f9ea80f7940 2022-02-02T19:49:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.607+0000 7f9ea77fe700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 0x7f9e900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.607+0000 7f9ea77fe700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 0x7f9e900672e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f9ea806b730 tx=0x7f9e9c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.611+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e980519a0 con 0x7f9ea80f7940 2022-02-02T19:49:41.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.782+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ea80008d0 con 0x7f9e90064e20 2022-02-02T19:49:41.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.791+0000 7f9e8ffff700 1 -- 172.21.15.96:0/3227204494 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9ea80008d0 con 0x7f9e90064e20 2022-02-02T19:49:41.796 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:49:41.796 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (93m) 63m ago 94m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:49:41.796 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (85m) 63m ago 94m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:49:41.797 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (85m) 62m ago 93m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:49:41.797 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (92m) 63m ago 93m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:49:41.797 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (90m) 63m ago 90m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:49:41.797 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (85m) 63m ago 90m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:49:41.798 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (90m) 62m ago 90m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:49:41.798 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (86m) 62m ago 90m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:49:41.798 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (87m) 63m ago 95m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:49:41.798 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (86m) 62m ago 93m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:49:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (86m) 63m ago 95m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:49:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (86m) 62m ago 93m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:49:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (93m) 63m ago 93m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:49:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (93m) 62m ago 93m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:49:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (85m) 63m ago 92m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:49:41.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (84m) 63m ago 92m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:49:41.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (84m) 63m ago 92m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:49:41.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (83m) 62m ago 92m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:49:41.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (82m) 62m ago 91m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:49:41.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (82m) 62m ago 91m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:49:41.801 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (92m) 63m ago 93m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:49:41.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 msgr2=0x7f9e900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 0x7f9e900672e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f9ea806b730 tx=0x7f9e9c008040).stop 2022-02-02T19:49:41.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 msgr2=0x7f9ea8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f9e98009990 tx=0x7f9e98009b30).stop 2022-02-02T19:49:41.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 shutdown_connections 2022-02-02T19:49:41.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e90064e20 0x7f9e900672e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80f66a0 0x7f9ea806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 --2- 172.21.15.96:0/3227204494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea80f7940 0x7f9ea8069e20 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 >> 172.21.15.96:0/3227204494 conn(0x7f9ea80f1e00 msgr2=0x7f9ea80fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 shutdown_connections 2022-02-02T19:49:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.793+0000 7f9eadf3f700 1 -- 172.21.15.96:0/3227204494 wait complete. 2022-02-02T19:49:41.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 -- 172.21.15.96:0/623826650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 msgr2=0x7fd8080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 --2- 172.21.15.96:0/623826650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd8080f6cc0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fd804004660 tx=0x7fd804009b30).stop 2022-02-02T19:49:41.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 -- 172.21.15.96:0/623826650 shutdown_connections 2022-02-02T19:49:41.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 --2- 172.21.15.96:0/623826650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd8080f6cc0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 --2- 172.21.15.96:0/623826650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 0x7fd8080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 -- 172.21.15.96:0/623826650 >> 172.21.15.96:0/623826650 conn(0x7fd8080f0d40 msgr2=0x7fd8080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 -- 172.21.15.96:0/623826650 shutdown_connections 2022-02-02T19:49:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.889+0000 7fd81026d700 1 -- 172.21.15.96:0/623826650 wait complete. 2022-02-02T19:49:41.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 Processor -- start 2022-02-02T19:49:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 -- start start 2022-02-02T19:49:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 0x7fd808109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080603c0 con 0x7fd8080f6860 2022-02-02T19:49:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd81026d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808060500 con 0x7fd8080f55c0 2022-02-02T19:49:41.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd80d808700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd80d808700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33680/0 (socket says 172.21.15.96:33680) 2022-02-02T19:49:41.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd80d808700 1 -- 172.21.15.96:0/2863597059 learned_addr learned my addr 172.21.15.96:0/2863597059 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:41.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.890+0000 7fd80e009700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 0x7fd808109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd80d808700 1 -- 172.21.15.96:0/2863597059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 msgr2=0x7fd808109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:41.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd80d808700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 0x7fd808109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd80d808700 1 -- 172.21.15.96:0/2863597059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804005040 con 0x7fd8080f6860 2022-02-02T19:49:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd80d808700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd804009990 tx=0x7fd804009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd804018070 con 0x7fd8080f6860 2022-02-02T19:49:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80810c6c0 con 0x7fd8080f6860 2022-02-02T19:49:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd804007ba0 con 0x7fd8080f6860 2022-02-02T19:49:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd80401c3c0 con 0x7fd8080f6860 2022-02-02T19:49:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.891+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80810cbf0 con 0x7fd8080f6860 2022-02-02T19:49:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.892+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd808045ad0 con 0x7fd8080f6860 2022-02-02T19:49:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.893+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd80401d420 con 0x7fd8080f6860 2022-02-02T19:49:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.894+0000 7fd7feffd700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 0x7fd7f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.894+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd804083950 con 0x7fd8080f6860 2022-02-02T19:49:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.894+0000 7fd80e009700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 0x7fd7f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.894+0000 7fd80e009700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 0x7fd7f4067290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd808060040 tx=0x7fd7f800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:41.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:41.897+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd804051a50 con 0x7fd8080f6860 2022-02-02T19:49:42.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.128+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd808027a00 con 0x7fd8080f6860 2022-02-02T19:49:42.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.129+0000 7fd7feffd700 1 -- 172.21.15.96:0/2863597059 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd804055070 con 0x7fd8080f6860 2022-02-02T19:49:42.134 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:49:42.135 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:49:42.135 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:49:42.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:42.135 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:49:42.137 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:49:42.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:42.137 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:49:42.137 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:49:42.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:42.138 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:49:42.138 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:49:42.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:49:42.139 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:49:42.139 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:49:42.139 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:49:42.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:49:42.140 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:49:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 msgr2=0x7fd7f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 0x7fd7f4067290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd808060040 tx=0x7fd7f800b040).stop 2022-02-02T19:49:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 msgr2=0x7fd80810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd804009990 tx=0x7fd804009b30).stop 2022-02-02T19:49:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 shutdown_connections 2022-02-02T19:49:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7f4064dd0 0x7fd7f4067290 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080f55c0 0x7fd808109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 --2- 172.21.15.96:0/2863597059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8080f6860 0x7fd80810c170 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 >> 172.21.15.96:0/2863597059 conn(0x7fd8080f0d40 msgr2=0x7fd8080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 shutdown_connections 2022-02-02T19:49:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.132+0000 7fd81026d700 1 -- 172.21.15.96:0/2863597059 wait complete. 2022-02-02T19:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 -- 172.21.15.96:0/2005756658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f55e0 msgr2=0x7f25800f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 --2- 172.21.15.96:0/2005756658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f55e0 0x7f25800f5a00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f2574004660 tx=0x7f2574009b30).stop 2022-02-02T19:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 -- 172.21.15.96:0/2005756658 shutdown_connections 2022-02-02T19:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 --2- 172.21.15.96:0/2005756658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f5ef0 0x7f25800f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 --2- 172.21.15.96:0/2005756658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f55e0 0x7f25800f5a00 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 -- 172.21.15.96:0/2005756658 >> 172.21.15.96:0/2005756658 conn(0x7f25800f0de0 msgr2=0x7f25800f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 -- 172.21.15.96:0/2005756658 shutdown_connections 2022-02-02T19:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.232+0000 7f2585a18700 1 -- 172.21.15.96:0/2005756658 wait complete. 2022-02-02T19:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 Processor -- start 2022-02-02T19:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 -- start start 2022-02-02T19:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f55e0 0x7f2580109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580060570 con 0x7f25800f5ef0 2022-02-02T19:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f2585a18700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800606b0 con 0x7f25800f55e0 2022-02-02T19:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33690/0 (socket says 172.21.15.96:33690) 2022-02-02T19:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 -- 172.21.15.96:0/11646651 learned_addr learned my addr 172.21.15.96:0/11646651 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257effd700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f55e0 0x7f2580109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 -- 172.21.15.96:0/11646651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f55e0 msgr2=0x7f2580109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f55e0 0x7f2580109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.233+0000 7f257e7fc700 1 -- 172.21.15.96:0/11646651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574005040 con 0x7f25800f5ef0 2022-02-02T19:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f257e7fc700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f257000b410 tx=0x7f2570006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25700125f0 con 0x7f25800f5ef0 2022-02-02T19:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2570012c00 con 0x7f25800f5ef0 2022-02-02T19:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258010c7a0 con 0x7f25800f5ef0 2022-02-02T19:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2570011d20 con 0x7f25800f5ef0 2022-02-02T19:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.234+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580105e20 con 0x7f25800f5ef0 2022-02-02T19:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.235+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580045ad0 con 0x7f25800f5ef0 2022-02-02T19:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.235+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f257000f030 con 0x7f25800f5ef0 2022-02-02T19:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.236+0000 7f25677fe700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 0x7f2568067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.236+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2570081e90 con 0x7f25800f5ef0 2022-02-02T19:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.236+0000 7f257effd700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 0x7f2568067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.236+0000 7f257effd700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 0x7f2568067290 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f2574004630 tx=0x7f2574009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.240+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f257004ff90 con 0x7f25800f5ef0 2022-02-02T19:49:42.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.441+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2580027a00 con 0x7f25800f5ef0 2022-02-02T19:49:42.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.441+0000 7f25677fe700 1 -- 172.21.15.96:0/11646651 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f25700535b0 con 0x7f25800f5ef0 2022-02-02T19:49:42.446 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:49:42.446 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:49:42.447 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:49:42.447 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:49:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:42.447 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:49:42.448 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:49:42.448 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:49:42.448 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:49:42.448 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:49:42.449 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:49:42.449 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:49:42.449 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:49:42.449 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:49:42.450 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:49:42.450 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:49:42.450 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:49:42.450 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:49:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:49:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:49:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:49:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:49:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:49:42.452 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:49:42.452 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:49:42.452 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:49:42.452 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:49:42.453 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:49:42.453 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:49:42.453 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:49:42.453 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:49:42.453 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:49:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:42.454 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:49:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:49:42.455 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:42.455 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:42.455 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:49:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 msgr2=0x7f2568067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 0x7f2568067290 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f2574004630 tx=0x7f2574009b30).stop 2022-02-02T19:49:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 msgr2=0x7f258010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:49:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f257000b410 tx=0x7f2570006ef0).stop 2022-02-02T19:49:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 shutdown_connections 2022-02-02T19:49:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2568064dd0 0x7f2568067290 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25800f55e0 0x7f2580109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 --2- 172.21.15.96:0/11646651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25800f5ef0 0x7f258010c190 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:49:42.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 >> 172.21.15.96:0/11646651 conn(0x7f25800f0de0 msgr2=0x7f25800fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:49:42.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 shutdown_connections 2022-02-02T19:49:42.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:49:42.443+0000 7f2585a18700 1 -- 172.21.15.96:0/11646651 wait complete. 2022-02-02T19:49:42.459 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:49:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:42 smithi159 ceph-mon[69013]: pgmap v2628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:42.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2863597059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:49:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:42 smithi096 ceph-mon[101353]: pgmap v2628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2863597059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:49:43.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:43 smithi159 ceph-mon[69013]: from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:43.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:43 smithi159 ceph-mon[69013]: from='client.36810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:43.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/11646651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:49:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:43 smithi096 ceph-mon[101353]: from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:43 smithi096 ceph-mon[101353]: from='client.36810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:49:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/11646651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:49:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:44 smithi159 ceph-mon[69013]: pgmap v2629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:44.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:44 smithi096 ceph-mon[101353]: pgmap v2629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:45.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:45 smithi159 ceph-mon[69013]: pgmap v2630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:45.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:45 smithi096 ceph-mon[101353]: pgmap v2630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:48 smithi159 ceph-mon[69013]: pgmap v2631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:48 smithi096 ceph-mon[101353]: pgmap v2631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:50 smithi159 ceph-mon[69013]: pgmap v2632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:50 smithi096 ceph-mon[101353]: pgmap v2632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:52 smithi159 ceph-mon[69013]: pgmap v2633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:52 smithi096 ceph-mon[101353]: pgmap v2633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:54 smithi159 ceph-mon[69013]: pgmap v2634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:54 smithi096 ceph-mon[101353]: pgmap v2634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:56 smithi159 ceph-mon[69013]: pgmap v2635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:56 smithi096 ceph-mon[101353]: pgmap v2635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:49:58 smithi159 ceph-mon[69013]: pgmap v2636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:49:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:49:58 smithi096 ceph-mon[101353]: pgmap v2636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:00 smithi159 ceph-mon[69013]: pgmap v2637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:50:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:00 smithi096 ceph-mon[101353]: pgmap v2637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:00.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T19:50:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:02 smithi159 ceph-mon[69013]: pgmap v2638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:02 smithi096 ceph-mon[101353]: pgmap v2638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:04 smithi159 ceph-mon[69013]: pgmap v2639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:04.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:04 smithi096 ceph-mon[101353]: pgmap v2639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:06 smithi159 ceph-mon[69013]: pgmap v2640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:06 smithi096 ceph-mon[101353]: pgmap v2640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:08 smithi159 ceph-mon[69013]: pgmap v2641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:08.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:08 smithi096 ceph-mon[101353]: pgmap v2641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:10 smithi159 ceph-mon[69013]: pgmap v2642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:10 smithi096 ceph-mon[101353]: pgmap v2642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:12 smithi159 ceph-mon[69013]: pgmap v2643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:12 smithi096 ceph-mon[101353]: pgmap v2643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:12.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 -- 172.21.15.96:0/1970957723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 msgr2=0x7fb9280f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 --2- 172.21.15.96:0/1970957723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9280f63e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fb91c004660 tx=0x7fb91c009b30).stop 2022-02-02T19:50:12.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 -- 172.21.15.96:0/1970957723 shutdown_connections 2022-02-02T19:50:12.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 --2- 172.21.15.96:0/1970957723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9280f63e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 --2- 172.21.15.96:0/1970957723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 0x7fb9280f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 -- 172.21.15.96:0/1970957723 >> 172.21.15.96:0/1970957723 conn(0x7fb9280f04c0 msgr2=0x7fb9280f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:12.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.555+0000 7fb92e650700 1 -- 172.21.15.96:0/1970957723 shutdown_connections 2022-02-02T19:50:12.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 -- 172.21.15.96:0/1970957723 wait complete. 2022-02-02T19:50:12.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 Processor -- start 2022-02-02T19:50:12.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 -- start start 2022-02-02T19:50:12.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 0x7fb928105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928106970 con 0x7fb9280f5f60 2022-02-02T19:50:12.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.556+0000 7fb92e650700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928106ab0 con 0x7fb9280f4d60 2022-02-02T19:50:12.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33708/0 (socket says 172.21.15.96:33708) 2022-02-02T19:50:12.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 -- 172.21.15.96:0/2213984350 learned_addr learned my addr 172.21.15.96:0/2213984350 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:12.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb927fff700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 0x7fb928105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 -- 172.21.15.96:0/2213984350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 msgr2=0x7fb928105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 0x7fb928105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 -- 172.21.15.96:0/2213984350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c005040 con 0x7fb9280f5f60 2022-02-02T19:50:12.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb9277fe700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb91c004e30 tx=0x7fb91c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:12.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c018070 con 0x7fb9280f5f60 2022-02-02T19:50:12.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9281073f0 con 0x7fb9280f5f60 2022-02-02T19:50:12.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb91c004290 con 0x7fb9280f5f60 2022-02-02T19:50:12.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c01de70 con 0x7fb9280f5f60 2022-02-02T19:50:12.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.557+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb928107950 con 0x7fb9280f5f60 2022-02-02T19:50:12.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.558+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb928045ad0 con 0x7fb9280f5f60 2022-02-02T19:50:12.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.559+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb91c007d30 con 0x7fb9280f5f60 2022-02-02T19:50:12.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.559+0000 7fb924ff9700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 0x7fb910067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.559+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb91c0835d0 con 0x7fb9280f5f60 2022-02-02T19:50:12.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.559+0000 7fb927fff700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 0x7fb910067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.560+0000 7fb927fff700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 0x7fb910067270 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fb918004c40 tx=0x7fb91800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:12.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.564+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb91c0551c0 con 0x7fb9280f5f60 2022-02-02T19:50:12.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.741+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9280faa40 con 0x7fb910064db0 2022-02-02T19:50:12.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.742+0000 7fb924ff9700 1 -- 172.21.15.96:0/2213984350 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb9280faa40 con 0x7fb910064db0 2022-02-02T19:50:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 msgr2=0x7fb910067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 0x7fb910067270 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fb918004c40 tx=0x7fb91800b040).stop 2022-02-02T19:50:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 msgr2=0x7fb9281063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb91c004e30 tx=0x7fb91c009b30).stop 2022-02-02T19:50:12.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 shutdown_connections 2022-02-02T19:50:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb910064db0 0x7fb910067270 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9280f4d60 0x7fb928105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 --2- 172.21.15.96:0/2213984350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9280f5f60 0x7fb9281063c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 >> 172.21.15.96:0/2213984350 conn(0x7fb9280f04c0 msgr2=0x7fb9280fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 shutdown_connections 2022-02-02T19:50:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.744+0000 7fb92e650700 1 -- 172.21.15.96:0/2213984350 wait complete. 2022-02-02T19:50:12.757 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:50:12.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 -- 172.21.15.96:0/3758902614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 msgr2=0x7f45d40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 --2- 172.21.15.96:0/3758902614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d40f5850 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f45c4004660 tx=0x7f45c4009b30).stop 2022-02-02T19:50:12.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 -- 172.21.15.96:0/3758902614 shutdown_connections 2022-02-02T19:50:12.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 --2- 172.21.15.96:0/3758902614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 0x7f45d40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 --2- 172.21.15.96:0/3758902614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d40f5850 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 -- 172.21.15.96:0/3758902614 >> 172.21.15.96:0/3758902614 conn(0x7f45d40f0b90 msgr2=0x7f45d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:12.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 -- 172.21.15.96:0/3758902614 shutdown_connections 2022-02-02T19:50:12.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.842+0000 7f45d937c700 1 -- 172.21.15.96:0/3758902614 wait complete. 2022-02-02T19:50:12.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 Processor -- start 2022-02-02T19:50:12.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 -- start start 2022-02-02T19:50:12.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 0x7f45d410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40603c0 con 0x7f45d40f5430 2022-02-02T19:50:12.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d937c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4060500 con 0x7f45d40f66d0 2022-02-02T19:50:12.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33716/0 (socket says 172.21.15.96:33716) 2022-02-02T19:50:12.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.843+0000 7f45d3fff700 1 -- 172.21.15.96:0/992106012 learned_addr learned my addr 172.21.15.96:0/992106012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:12.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d37fe700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 0x7f45d410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d3fff700 1 -- 172.21.15.96:0/992106012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 msgr2=0x7f45d410bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:12.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d3fff700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 0x7f45d410bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:12.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d3fff700 1 -- 172.21.15.96:0/992106012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4005040 con 0x7f45d40f5430 2022-02-02T19:50:12.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d3fff700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f45c4004f60 tx=0x7f45c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:12.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c4018070 con 0x7f45d40f5430 2022-02-02T19:50:12.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d410c500 con 0x7f45d40f5430 2022-02-02T19:50:12.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f45c4009770 con 0x7f45d40f5430 2022-02-02T19:50:12.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c401c3c0 con 0x7f45d40f5430 2022-02-02T19:50:12.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.844+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d410ca30 con 0x7f45d40f5430 2022-02-02T19:50:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.845+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4004fa0 con 0x7f45d40f5430 2022-02-02T19:50:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.846+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f45c401d420 con 0x7f45d40f5430 2022-02-02T19:50:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.846+0000 7f45d0ff9700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 0x7f45bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:12.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.846+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f45c4083840 con 0x7f45d40f5430 2022-02-02T19:50:12.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.846+0000 7f45d37fe700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 0x7f45bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:12.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.846+0000 7f45d37fe700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 0x7f45bc0672e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f45c8007fd0 tx=0x7f45c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:12.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:12.850+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f45c4051a00 con 0x7f45d40f5430 2022-02-02T19:50:13.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.025+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f45b4000bc0 con 0x7f45bc064e20 2022-02-02T19:50:13.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.034+0000 7f45d0ff9700 1 -- 172.21.15.96:0/992106012 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f45b4000bc0 con 0x7f45bc064e20 2022-02-02T19:50:13.037 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:50:13.038 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (93m) 64m ago 94m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:50:13.038 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (86m) 64m ago 94m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:50:13.038 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (85m) 62m ago 94m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:50:13.038 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (93m) 64m ago 94m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:50:13.039 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (90m) 64m ago 90m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:50:13.039 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (86m) 64m ago 90m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:50:13.039 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (90m) 62m ago 90m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:50:13.039 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (86m) 62m ago 90m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:50:13.039 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (87m) 64m ago 95m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:50:13.040 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (87m) 62m ago 94m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:50:13.040 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (86m) 64m ago 95m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:50:13.040 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (86m) 62m ago 94m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:50:13.040 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (94m) 64m ago 94m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:50:13.041 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (93m) 62m ago 93m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:50:13.041 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (85m) 64m ago 93m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:50:13.041 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (85m) 64m ago 93m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:50:13.041 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (84m) 64m ago 92m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:50:13.041 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (83m) 62m ago 92m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:50:13.042 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (83m) 62m ago 92m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:50:13.042 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (83m) 62m ago 91m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:50:13.042 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (93m) 64m ago 94m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:50:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 msgr2=0x7f45bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 0x7f45bc0672e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f45c8007fd0 tx=0x7f45c8009040).stop 2022-02-02T19:50:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 msgr2=0x7f45d4109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f45c4004f60 tx=0x7f45c4009b30).stop 2022-02-02T19:50:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 shutdown_connections 2022-02-02T19:50:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45bc064e20 0x7f45bc0672e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d40f5430 0x7f45d4109ab0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 --2- 172.21.15.96:0/992106012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45d40f66d0 0x7f45d410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 >> 172.21.15.96:0/992106012 conn(0x7f45d40f0b90 msgr2=0x7f45d40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 shutdown_connections 2022-02-02T19:50:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.036+0000 7f45d937c700 1 -- 172.21.15.96:0/992106012 wait complete. 2022-02-02T19:50:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 -- 172.21.15.96:0/308098910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 msgr2=0x7f81000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 --2- 172.21.15.96:0/308098910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f81000f6b00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f80f0004660 tx=0x7f80f0009b30).stop 2022-02-02T19:50:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 -- 172.21.15.96:0/308098910 shutdown_connections 2022-02-02T19:50:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 --2- 172.21.15.96:0/308098910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f81000f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 --2- 172.21.15.96:0/308098910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f81000f6b00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 -- 172.21.15.96:0/308098910 >> 172.21.15.96:0/308098910 conn(0x7f81000f1f00 msgr2=0x7f81000f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:13.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 -- 172.21.15.96:0/308098910 shutdown_connections 2022-02-02T19:50:13.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.131+0000 7f81075c6700 1 -- 172.21.15.96:0/308098910 wait complete. 2022-02-02T19:50:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 Processor -- start 2022-02-02T19:50:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 -- start start 2022-02-02T19:50:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f8100105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100105810 con 0x7f81000f66e0 2022-02-02T19:50:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f81075c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100105950 con 0x7f81000f6ff0 2022-02-02T19:50:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33726/0 (socket says 172.21.15.96:33726) 2022-02-02T19:50:13.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 -- 172.21.15.96:0/720737094 learned_addr learned my addr 172.21.15.96:0/720737094 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8104b61700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f8100105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 -- 172.21.15.96:0/720737094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 msgr2=0x7f8100105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f8100105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.132+0000 7f8105362700 1 -- 172.21.15.96:0/720737094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0005040 con 0x7f81000f66e0 2022-02-02T19:50:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f8104b61700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f8100105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:50:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f8105362700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f80f0009990 tx=0x7f80f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80f0018070 con 0x7f81000f66e0 2022-02-02T19:50:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80f0007ba0 con 0x7f81000f66e0 2022-02-02T19:50:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80f001c3c0 con 0x7f81000f66e0 2022-02-02T19:50:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810010b4c0 con 0x7f81000f66e0 2022-02-02T19:50:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.133+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810010ba20 con 0x7f81000f66e0 2022-02-02T19:50:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.134+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8100045ad0 con 0x7f81000f66e0 2022-02-02T19:50:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.135+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80f001d420 con 0x7f81000f66e0 2022-02-02T19:50:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.135+0000 7f80f5ffb700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 0x7f80ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.135+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80f0083740 con 0x7f81000f66e0 2022-02-02T19:50:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.139+0000 7f8104b61700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 0x7f80ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.139+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80f00518a0 con 0x7f81000f66e0 2022-02-02T19:50:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.140+0000 7f8104b61700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 0x7f80ec067290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f80fc009740 tx=0x7f80fc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:13.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.375+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81000fbdd0 con 0x7f81000f66e0 2022-02-02T19:50:13.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.376+0000 7f80f5ffb700 1 -- 172.21.15.96:0/720737094 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f80f0054ec0 con 0x7f81000f66e0 2022-02-02T19:50:13.380 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:50:13.380 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:50:13.380 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:50:13.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:13.381 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:50:13.381 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:50:13.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:13.382 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:50:13.382 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:50:13.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:13.382 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:50:13.383 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:50:13.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:13.383 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:50:13.383 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:50:13.384 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:50:13.384 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:50:13.384 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:50:13.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 msgr2=0x7f80ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 0x7f80ec067290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f80fc009740 tx=0x7f80fc009be0).stop 2022-02-02T19:50:13.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 msgr2=0x7f8100104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f80f0009990 tx=0x7f80f0009b30).stop 2022-02-02T19:50:13.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 shutdown_connections 2022-02-02T19:50:13.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80ec064dd0 0x7f80ec067290 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81000f66e0 0x7f8100104d20 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.377+0000 7f81075c6700 1 --2- 172.21.15.96:0/720737094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81000f6ff0 0x7f8100105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.378+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 >> 172.21.15.96:0/720737094 conn(0x7f81000f1f00 msgr2=0x7f810006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.378+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 shutdown_connections 2022-02-02T19:50:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.378+0000 7f81075c6700 1 -- 172.21.15.96:0/720737094 wait complete. 2022-02-02T19:50:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 -- 172.21.15.96:0/1609900892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f6860 msgr2=0x7f76500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 --2- 172.21.15.96:0/1609900892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f6860 0x7f76500f6cc0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f7640004660 tx=0x7f7640009b30).stop 2022-02-02T19:50:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 -- 172.21.15.96:0/1609900892 shutdown_connections 2022-02-02T19:50:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 --2- 172.21.15.96:0/1609900892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f6860 0x7f76500f6cc0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 --2- 172.21.15.96:0/1609900892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f55c0 0x7f76500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:50:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 -- 172.21.15.96:0/1609900892 >> 172.21.15.96:0/1609900892 conn(0x7f76500f0d40 msgr2=0x7f76500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:13.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 -- 172.21.15.96:0/1609900892 shutdown_connections 2022-02-02T19:50:13.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.475+0000 7f7654e0f700 1 -- 172.21.15.96:0/1609900892 wait complete. 2022-02-02T19:50:13.481 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:13 smithi096 ceph-mon[101353]: pgmap v2644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:13.482 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:13 smithi096 ceph-mon[101353]: from='client.36822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:13.482 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:13 smithi096 ceph-mon[101353]: from='client.36826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:13.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 Processor -- start 2022-02-02T19:50:13.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 -- start start 2022-02-02T19:50:13.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f6860 0x7f765010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7650060470 con 0x7f76500f55c0 2022-02-02T19:50:13.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f7654e0f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500605b0 con 0x7f76500f6860 2022-02-02T19:50:13.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33734/0 (socket says 172.21.15.96:33734) 2022-02-02T19:50:13.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 -- 172.21.15.96:0/4058900544 learned_addr learned my addr 172.21.15.96:0/4058900544 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:13.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764dd9b700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f6860 0x7f765010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 -- 172.21.15.96:0/4058900544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f6860 msgr2=0x7f765010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f6860 0x7f765010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.476+0000 7f764e59c700 1 -- 172.21.15.96:0/4058900544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640005040 con 0x7f76500f55c0 2022-02-02T19:50:13.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f764e59c700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f76440093f0 tx=0x7f7644006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:13.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7644013640 con 0x7f76500f55c0 2022-02-02T19:50:13.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765010c810 con 0x7f76500f55c0 2022-02-02T19:50:13.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765010cda0 con 0x7f76500f55c0 2022-02-02T19:50:13.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7644013c50 con 0x7f76500f55c0 2022-02-02T19:50:13.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.477+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7644012c70 con 0x7f76500f55c0 2022-02-02T19:50:13.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.478+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500f49b0 con 0x7f76500f55c0 2022-02-02T19:50:13.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.479+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f764401a060 con 0x7f76500f55c0 2022-02-02T19:50:13.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.479+0000 7f763effd700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 0x7f7638067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:13.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.479+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7644081a40 con 0x7f76500f55c0 2022-02-02T19:50:13.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.479+0000 7f764dd9b700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 0x7f7638067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:13.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.479+0000 7f764dd9b700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 0x7f7638067290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f7640004630 tx=0x7f7640009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:13.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.483+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f764404fae0 con 0x7f76500f55c0 2022-02-02T19:50:13.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:13 smithi159 ceph-mon[69013]: pgmap v2644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:13.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:13 smithi159 ceph-mon[69013]: from='client.36822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:13.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:13 smithi159 ceph-mon[69013]: from='client.36826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:13.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.685+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76500fdfb0 con 0x7f76500f55c0 2022-02-02T19:50:13.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.686+0000 7f763effd700 1 -- 172.21.15.96:0/4058900544 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7644018720 con 0x7f76500f55c0 2022-02-02T19:50:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:50:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:50:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:50:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:50:13.691 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:50:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:50:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:50:13.692 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:50:13.692 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:50:13.692 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:50:13.692 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:50:13.692 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:50:13.693 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:50:13.693 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:50:13.693 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:50:13.693 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:50:13.693 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:50:13.694 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:50:13.694 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:50:13.694 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:50:13.695 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:50:13.695 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:50:13.696 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:50:13.696 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:50:13.696 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:50:13.696 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:50:13.697 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:50:13.697 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:50:13.697 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:50:13.697 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:50:13.698 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:50:13.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:13.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:13.698 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:50:13.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:13.699 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:13.699 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:13.699 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:13.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.687+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 msgr2=0x7f7638067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 0x7f7638067290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f7640004630 tx=0x7f7640009b30).stop 2022-02-02T19:50:13.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 msgr2=0x7f7650109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:13.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f76440093f0 tx=0x7f7644006ec0).stop 2022-02-02T19:50:13.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 shutdown_connections 2022-02-02T19:50:13.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7638064dd0 0x7f7638067290 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76500f55c0 0x7f7650109cb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 --2- 172.21.15.96:0/4058900544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76500f6860 0x7f765010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 >> 172.21.15.96:0/4058900544 conn(0x7f76500f0d40 msgr2=0x7f76500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 shutdown_connections 2022-02-02T19:50:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:13.688+0000 7f7654e0f700 1 -- 172.21.15.96:0/4058900544 wait complete. 2022-02-02T19:50:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:50:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/720737094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:50:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4058900544' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:50:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/720737094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:50:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4058900544' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:50:15.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:15 smithi096 ceph-mon[101353]: pgmap v2645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:15 smithi159 ceph-mon[69013]: pgmap v2645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:18 smithi159 ceph-mon[69013]: pgmap v2646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:18 smithi096 ceph-mon[101353]: pgmap v2646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:20 smithi159 ceph-mon[69013]: pgmap v2647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:20 smithi096 ceph-mon[101353]: pgmap v2647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:22 smithi159 ceph-mon[69013]: pgmap v2648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:22 smithi096 ceph-mon[101353]: pgmap v2648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:24 smithi159 ceph-mon[69013]: pgmap v2649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:24 smithi096 ceph-mon[101353]: pgmap v2649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:26 smithi159 ceph-mon[69013]: pgmap v2650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:26 smithi096 ceph-mon[101353]: pgmap v2650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:28 smithi159 ceph-mon[69013]: pgmap v2651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:50:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:50:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:28 smithi096 ceph-mon[101353]: pgmap v2651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:50:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:50:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:30 smithi159 ceph-mon[69013]: pgmap v2652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:30 smithi096 ceph-mon[101353]: pgmap v2652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:32 smithi159 ceph-mon[69013]: pgmap v2653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:32 smithi096 ceph-mon[101353]: pgmap v2653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:34 smithi159 ceph-mon[69013]: pgmap v2654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:34 smithi096 ceph-mon[101353]: pgmap v2654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:36 smithi159 ceph-mon[69013]: pgmap v2655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:36 smithi096 ceph-mon[101353]: pgmap v2655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:38 smithi159 ceph-mon[69013]: pgmap v2656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:38 smithi096 ceph-mon[101353]: pgmap v2656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:40 smithi159 ceph-mon[69013]: pgmap v2657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:40 smithi096 ceph-mon[101353]: pgmap v2657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:42 smithi159 ceph-mon[69013]: pgmap v2658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:42 smithi096 ceph-mon[101353]: pgmap v2658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:43 smithi096 ceph-mon[101353]: pgmap v2659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:43 smithi159 ceph-mon[69013]: pgmap v2659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:43.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 -- 172.21.15.96:0/138737696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f6860 msgr2=0x7f92300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:43.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 --2- 172.21.15.96:0/138737696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f6860 0x7f92300f6cc0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f922c004660 tx=0x7f922c009b30).stop 2022-02-02T19:50:43.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 -- 172.21.15.96:0/138737696 shutdown_connections 2022-02-02T19:50:43.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 --2- 172.21.15.96:0/138737696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f6860 0x7f92300f6cc0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 --2- 172.21.15.96:0/138737696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f55c0 0x7f92300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 -- 172.21.15.96:0/138737696 >> 172.21.15.96:0/138737696 conn(0x7f92300f0d40 msgr2=0x7f92300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:43.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 -- 172.21.15.96:0/138737696 shutdown_connections 2022-02-02T19:50:43.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.797+0000 7f923809b700 1 -- 172.21.15.96:0/138737696 wait complete. 2022-02-02T19:50:43.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 Processor -- start 2022-02-02T19:50:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 -- start start 2022-02-02T19:50:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f6860 0x7f923010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:43.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300603c0 con 0x7f92300f55c0 2022-02-02T19:50:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f923809b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9230060500 con 0x7f92300f6860 2022-02-02T19:50:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33752/0 (socket says 172.21.15.96:33752) 2022-02-02T19:50:43.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 -- 172.21.15.96:0/4097832735 learned_addr learned my addr 172.21.15.96:0/4097832735 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235636700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f6860 0x7f923010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 -- 172.21.15.96:0/4097832735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f6860 msgr2=0x7f923010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f6860 0x7f923010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.798+0000 7f9235e37700 1 -- 172.21.15.96:0/4097832735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c005040 con 0x7f92300f55c0 2022-02-02T19:50:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f9235e37700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f922000c530 tx=0x7f9220007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922000f650 con 0x7f92300f55c0 2022-02-02T19:50:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f922000fc60 con 0x7f92300f55c0 2022-02-02T19:50:43.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923010c720 con 0x7f92300f55c0 2022-02-02T19:50:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9220012cb0 con 0x7f92300f55c0 2022-02-02T19:50:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.799+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923010ccb0 con 0x7f92300f55c0 2022-02-02T19:50:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.800+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92300f49b0 con 0x7f92300f55c0 2022-02-02T19:50:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.800+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9220019030 con 0x7f92300f55c0 2022-02-02T19:50:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.800+0000 7f92267fc700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.801+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9220081610 con 0x7f92300f55c0 2022-02-02T19:50:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.801+0000 7f9235636700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.801+0000 7f9235636700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f922c004630 tx=0x7f922c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.805+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f922004f7c0 con 0x7f92300f55c0 2022-02-02T19:50:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.983+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9230057f10 con 0x7f921c064dd0 2022-02-02T19:50:43.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.984+0000 7f92267fc700 1 -- 172.21.15.96:0/4097832735 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9230057f10 con 0x7f921c064dd0 2022-02-02T19:50:43.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 msgr2=0x7f921c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f922c004630 tx=0x7f922c009b30).stop 2022-02-02T19:50:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 msgr2=0x7f9230109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f922000c530 tx=0x7f9220007e10).stop 2022-02-02T19:50:43.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 shutdown_connections 2022-02-02T19:50:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230109c70 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 --2- 172.21.15.96:0/4097832735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f6860 0x7f923010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:43.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 >> 172.21.15.96:0/4097832735 conn(0x7f92300f0d40 msgr2=0x7f92300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:43.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 shutdown_connections 2022-02-02T19:50:43.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:43.986+0000 7f923809b700 1 -- 172.21.15.96:0/4097832735 wait complete. 2022-02-02T19:50:43.999 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:50:44.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 -- 172.21.15.96:0/1993199838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b20060310 msgr2=0x7f8b200f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 --2- 172.21.15.96:0/1993199838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b20060310 0x7f8b200f9110 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f8b10004660 tx=0x7f8b10009b30).stop 2022-02-02T19:50:44.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 -- 172.21.15.96:0/1993199838 shutdown_connections 2022-02-02T19:50:44.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 --2- 172.21.15.96:0/1993199838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b200f9690 0x7f8b200fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 --2- 172.21.15.96:0/1993199838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b20060310 0x7f8b200f9110 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 -- 172.21.15.96:0/1993199838 >> 172.21.15.96:0/1993199838 conn(0x7f8b200f0b90 msgr2=0x7f8b200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 -- 172.21.15.96:0/1993199838 shutdown_connections 2022-02-02T19:50:44.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.084+0000 7f8b25237700 1 -- 172.21.15.96:0/1993199838 wait complete. 2022-02-02T19:50:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 Processor -- start 2022-02-02T19:50:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 -- start start 2022-02-02T19:50:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b20060310 0x7f8b20106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20107880 con 0x7f8b200f9690 2022-02-02T19:50:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b25237700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201080c0 con 0x7f8b20060310 2022-02-02T19:50:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33764/0 (socket says 172.21.15.96:33764) 2022-02-02T19:50:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.085+0000 7f8b1f7fe700 1 -- 172.21.15.96:0/3657898057 learned_addr learned my addr 172.21.15.96:0/3657898057 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1ffff700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b20060310 0x7f8b20106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1f7fe700 1 -- 172.21.15.96:0/3657898057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b20060310 msgr2=0x7f8b20106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1f7fe700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b20060310 0x7f8b20106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1f7fe700 1 -- 172.21.15.96:0/3657898057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10005040 con 0x7f8b200f9690 2022-02-02T19:50:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1f7fe700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f8b1400c510 tx=0x7f8b14007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1400f650 con 0x7f8b200f9690 2022-02-02T19:50:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b1400fc60 con 0x7f8b200f9690 2022-02-02T19:50:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b201083a0 con 0x7f8b200f9690 2022-02-02T19:50:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b14012cd0 con 0x7f8b200f9690 2022-02-02T19:50:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.086+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b201088e0 con 0x7f8b200f9690 2022-02-02T19:50:44.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.087+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b20059100 con 0x7f8b200f9690 2022-02-02T19:50:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.087+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8b14010070 con 0x7f8b200f9690 2022-02-02T19:50:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.088+0000 7f8b1cff9700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 0x7f8b080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.088+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8b14081760 con 0x7f8b200f9690 2022-02-02T19:50:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.088+0000 7f8b1ffff700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 0x7f8b080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.088+0000 7f8b1ffff700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 0x7f8b080672e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f8b10004e30 tx=0x7f8b10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.092+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8b1404f860 con 0x7f8b200f9690 2022-02-02T19:50:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.264+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b200fee90 con 0x7f8b08064e20 2022-02-02T19:50:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.274+0000 7f8b1cff9700 1 -- 172.21.15.96:0/3657898057 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8b200fee90 con 0x7f8b08064e20 2022-02-02T19:50:44.278 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:50:44.278 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (94m) 64m ago 95m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:50:44.278 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (86m) 64m ago 95m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:50:44.278 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (86m) 63m ago 94m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:50:44.279 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (93m) 64m ago 94m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:50:44.279 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (91m) 64m ago 91m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:50:44.279 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (86m) 64m ago 91m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:50:44.279 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (91m) 63m ago 91m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:50:44.280 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (87m) 63m ago 91m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:50:44.280 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (88m) 64m ago 96m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:50:44.280 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (87m) 63m ago 94m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:50:44.280 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (87m) 64m ago 96m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:50:44.281 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (87m) 63m ago 94m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:50:44.281 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (94m) 64m ago 94m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:50:44.281 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (94m) 63m ago 94m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:50:44.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (86m) 64m ago 94m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:50:44.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (85m) 64m ago 93m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:50:44.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (85m) 64m ago 93m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:50:44.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (84m) 63m ago 93m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:50:44.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (84m) 63m ago 92m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:50:44.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (83m) 63m ago 92m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:50:44.283 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (93m) 64m ago 94m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:50:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 msgr2=0x7f8b080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 0x7f8b080672e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f8b10004e30 tx=0x7f8b10009b30).stop 2022-02-02T19:50:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 msgr2=0x7f8b20107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f8b1400c510 tx=0x7f8b14007df0).stop 2022-02-02T19:50:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 shutdown_connections 2022-02-02T19:50:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8b08064e20 0x7f8b080672e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b20060310 0x7f8b20106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 --2- 172.21.15.96:0/3657898057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b200f9690 0x7f8b20107280 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.276+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 >> 172.21.15.96:0/3657898057 conn(0x7f8b200f0b90 msgr2=0x7f8b200f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.277+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 shutdown_connections 2022-02-02T19:50:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.277+0000 7f8b25237700 1 -- 172.21.15.96:0/3657898057 wait complete. 2022-02-02T19:50:44.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.374+0000 7f24c359e700 1 -- 172.21.15.96:0/3756051090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f66d0 msgr2=0x7f24c40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.374+0000 7f24c359e700 1 --2- 172.21.15.96:0/3756051090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f66d0 0x7f24c40f6b30 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f24b8004660 tx=0x7f24b8009b30).stop 2022-02-02T19:50:44.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 -- 172.21.15.96:0/3756051090 shutdown_connections 2022-02-02T19:50:44.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 --2- 172.21.15.96:0/3756051090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f66d0 0x7f24c40f6b30 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 --2- 172.21.15.96:0/3756051090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f5430 0x7f24c40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 -- 172.21.15.96:0/3756051090 >> 172.21.15.96:0/3756051090 conn(0x7f24c40f0b90 msgr2=0x7f24c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 -- 172.21.15.96:0/3756051090 shutdown_connections 2022-02-02T19:50:44.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 -- 172.21.15.96:0/3756051090 wait complete. 2022-02-02T19:50:44.380 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:44 smithi096 ceph-mon[101353]: from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:44.381 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:44 smithi096 ceph-mon[101353]: from='client.36842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:44.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 Processor -- start 2022-02-02T19:50:44.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.375+0000 7f24c359e700 1 -- start start 2022-02-02T19:50:44.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f66d0 0x7f24c410bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40603e0 con 0x7f24c40f5430 2022-02-02T19:50:44.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4060520 con 0x7f24c40f66d0 2022-02-02T19:50:44.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33772/0 (socket says 172.21.15.96:33772) 2022-02-02T19:50:44.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 -- 172.21.15.96:0/38728711 learned_addr learned my addr 172.21.15.96:0/38728711 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:44.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c1d9b700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f66d0 0x7f24c410bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 -- 172.21.15.96:0/38728711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f66d0 msgr2=0x7f24c410bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f66d0 0x7f24c410bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 -- 172.21.15.96:0/38728711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8005040 con 0x7f24c40f5430 2022-02-02T19:50:44.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c259c700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f24b4002700 tx=0x7f24b4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b40079c0 con 0x7f24c40f5430 2022-02-02T19:50:44.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c410c4d0 con 0x7f24c40f5430 2022-02-02T19:50:44.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24b400f040 con 0x7f24c40f5430 2022-02-02T19:50:44.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b4014860 con 0x7f24c40f5430 2022-02-02T19:50:44.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.376+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c410ca90 con 0x7f24c40f5430 2022-02-02T19:50:44.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.377+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c4045ad0 con 0x7f24c40f5430 2022-02-02T19:50:44.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.378+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24b401b060 con 0x7f24c40f5430 2022-02-02T19:50:44.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.378+0000 7f24b2ffd700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 0x7f24ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.378+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f24b4081900 con 0x7f24c40f5430 2022-02-02T19:50:44.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.379+0000 7f24c1d9b700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 0x7f24ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.379+0000 7f24c1d9b700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 0x7f24ac0672e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f24b8004630 tx=0x7f24b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.383+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24b404fa00 con 0x7f24c40f5430 2022-02-02T19:50:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.611+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24c4027a00 con 0x7f24c40f5430 2022-02-02T19:50:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.612+0000 7f24b2ffd700 1 -- 172.21.15.96:0/38728711 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f24b40192e0 con 0x7f24c40f5430 2022-02-02T19:50:44.616 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:50:44.617 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:50:44.617 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:50:44.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:44.618 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:50:44.619 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:50:44.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:44.620 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:50:44.620 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:50:44.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:44.621 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:50:44.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:50:44.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:50:44.622 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:50:44.623 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:50:44.624 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:50:44.624 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:50:44.624 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:50:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 msgr2=0x7f24ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 0x7f24ac0672e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f24b8004630 tx=0x7f24b8009b30).stop 2022-02-02T19:50:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 msgr2=0x7f24c4109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f24b4002700 tx=0x7f24b4009d80).stop 2022-02-02T19:50:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 shutdown_connections 2022-02-02T19:50:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24ac064e20 0x7f24ac0672e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24c40f5430 0x7f24c4109a20 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 --2- 172.21.15.96:0/38728711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24c40f66d0 0x7f24c410bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 >> 172.21.15.96:0/38728711 conn(0x7f24c40f0b90 msgr2=0x7f24c40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 shutdown_connections 2022-02-02T19:50:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.614+0000 7f24c359e700 1 -- 172.21.15.96:0/38728711 wait complete. 2022-02-02T19:50:44.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 -- 172.21.15.96:0/907880127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f6860 msgr2=0x7fcbec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/907880127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f6860 0x7fcbec0f6cc0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fcbd8004660 tx=0x7fcbd8009b30).stop 2022-02-02T19:50:44.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 -- 172.21.15.96:0/907880127 shutdown_connections 2022-02-02T19:50:44.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/907880127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f6860 0x7fcbec0f6cc0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/907880127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f55c0 0x7fcbec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 -- 172.21.15.96:0/907880127 >> 172.21.15.96:0/907880127 conn(0x7fcbec0f0d40 msgr2=0x7fcbec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 -- 172.21.15.96:0/907880127 shutdown_connections 2022-02-02T19:50:44.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.711+0000 7fcbf2c85700 1 -- 172.21.15.96:0/907880127 wait complete. 2022-02-02T19:50:44.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 Processor -- start 2022-02-02T19:50:44.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 -- start start 2022-02-02T19:50:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f6860 0x7fcbec10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0602b0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf2c85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0603f0 con 0x7fcbec0f6860 2022-02-02T19:50:44.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf0a21700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf0a21700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33782/0 (socket says 172.21.15.96:33782) 2022-02-02T19:50:44.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbf0a21700 1 -- 172.21.15.96:0/2262231209 learned_addr learned my addr 172.21.15.96:0/2262231209 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:50:44.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.712+0000 7fcbebfff700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f6860 0x7fcbec10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf0a21700 1 -- 172.21.15.96:0/2262231209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f6860 msgr2=0x7fcbec10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf0a21700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f6860 0x7fcbec10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf0a21700 1 -- 172.21.15.96:0/2262231209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8005040 con 0x7fcbec0f55c0 2022-02-02T19:50:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf0a21700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fcbe000c530 tx=0x7fcbe0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe000f650 con 0x7fcbec0f55c0 2022-02-02T19:50:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec10ea60 con 0x7fcbec0f55c0 2022-02-02T19:50:44.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcbe000fc60 con 0x7fcbec0f55c0 2022-02-02T19:50:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe0012cb0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.713+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec10eee0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.714+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec045ad0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.715+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcbe0019030 con 0x7fcbec0f55c0 2022-02-02T19:50:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.715+0000 7fcbe97fa700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:50:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.715+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcbe00816d0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.715+0000 7fcbebfff700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:50:44.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.715+0000 7fcbebfff700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fcbd8004630 tx=0x7fcbd8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:50:44.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.719+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcbe004f7c0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:44 smithi159 ceph-mon[69013]: from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:44 smithi159 ceph-mon[69013]: from='client.36842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:50:44.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.921+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcbec0586e0 con 0x7fcbec0f55c0 2022-02-02T19:50:44.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.921+0000 7fcbe97fa700 1 -- 172.21.15.96:0/2262231209 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcbe0017070 con 0x7fcbec0f55c0 2022-02-02T19:50:44.925 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:50:44.925 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:50:44.926 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:50:44.926 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:50:44.926 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:44.926 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:50:44.927 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:50:44.927 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:50:44.927 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:50:44.927 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:50:44.927 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:50:44.928 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:50:44.928 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:50:44.928 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:50:44.928 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:50:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:50:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:50:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:50:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:50:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:50:44.930 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:50:44.930 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:50:44.930 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:50:44.930 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:50:44.931 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:50:44.931 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:50:44.931 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:50:44.931 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:50:44.931 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:50:44.932 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:50:44.932 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:50:44.932 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:50:44.932 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:44.933 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:44.933 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:50:44.933 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:50:44.933 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:44.933 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:44.934 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:50:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 msgr2=0x7fcbdc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fcbd8004630 tx=0x7fcbd8009b30).stop 2022-02-02T19:50:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 msgr2=0x7fcbec10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:50:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fcbe000c530 tx=0x7fcbe0007e10).stop 2022-02-02T19:50:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 shutdown_connections 2022-02-02T19:50:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbec0f55c0 0x7fcbec10c070 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 --2- 172.21.15.96:0/2262231209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbec0f6860 0x7fcbec10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:50:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 >> 172.21.15.96:0/2262231209 conn(0x7fcbec0f0d40 msgr2=0x7fcbec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:50:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 shutdown_connections 2022-02-02T19:50:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:50:44.923+0000 7fcbf2c85700 1 -- 172.21.15.96:0/2262231209 wait complete. 2022-02-02T19:50:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:50:45.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:45 smithi159 ceph-mon[69013]: pgmap v2660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:45.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/38728711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:50:45.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2262231209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:50:45.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:45 smithi096 ceph-mon[101353]: pgmap v2660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:45.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/38728711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:50:45.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2262231209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:50:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:48 smithi159 ceph-mon[69013]: pgmap v2661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:48 smithi096 ceph-mon[101353]: pgmap v2661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:50 smithi159 ceph-mon[69013]: pgmap v2662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:50 smithi096 ceph-mon[101353]: pgmap v2662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:52 smithi159 ceph-mon[69013]: pgmap v2663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:52 smithi096 ceph-mon[101353]: pgmap v2663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:54 smithi159 ceph-mon[69013]: pgmap v2664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:54 smithi096 ceph-mon[101353]: pgmap v2664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:56 smithi159 ceph-mon[69013]: pgmap v2665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:56 smithi096 ceph-mon[101353]: pgmap v2665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:50:58 smithi159 ceph-mon[69013]: pgmap v2666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:50:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:50:58 smithi096 ceph-mon[101353]: pgmap v2666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:00 smithi159 ceph-mon[69013]: pgmap v2667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:00 smithi096 ceph-mon[101353]: pgmap v2667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:02 smithi159 ceph-mon[69013]: pgmap v2668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:02 smithi096 ceph-mon[101353]: pgmap v2668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:04 smithi159 ceph-mon[69013]: pgmap v2669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:04 smithi096 ceph-mon[101353]: pgmap v2669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:06 smithi159 ceph-mon[69013]: pgmap v2670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:06 smithi096 ceph-mon[101353]: pgmap v2670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:08 smithi159 ceph-mon[69013]: pgmap v2671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:08 smithi096 ceph-mon[101353]: pgmap v2671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:09.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:09 smithi159 ceph-mon[69013]: pgmap v2672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:09.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:09 smithi096 ceph-mon[101353]: pgmap v2672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:12 smithi159 ceph-mon[69013]: pgmap v2673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:12.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:12 smithi096 ceph-mon[101353]: pgmap v2673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:14 smithi159 ceph-mon[69013]: pgmap v2674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:14 smithi096 ceph-mon[101353]: pgmap v2674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:15.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- 172.21.15.96:0/3444077954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f55c0 msgr2=0x7f49f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 --2- 172.21.15.96:0/3444077954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f55c0 0x7f49f00f59e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f49ec004660 tx=0x7f49ec009b30).stop 2022-02-02T19:51:15.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- 172.21.15.96:0/3444077954 shutdown_connections 2022-02-02T19:51:15.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 --2- 172.21.15.96:0/3444077954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f6860 0x7f49f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 --2- 172.21.15.96:0/3444077954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f55c0 0x7f49f00f59e0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- 172.21.15.96:0/3444077954 >> 172.21.15.96:0/3444077954 conn(0x7f49f00f0d40 msgr2=0x7f49f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- 172.21.15.96:0/3444077954 shutdown_connections 2022-02-02T19:51:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- 172.21.15.96:0/3444077954 wait complete. 2022-02-02T19:51:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 Processor -- start 2022-02-02T19:51:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.034+0000 7f49f7782700 1 -- start start 2022-02-02T19:51:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f7782700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f55c0 0x7f49f0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f7782700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f7782700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00603e0 con 0x7f49f00f6860 2022-02-02T19:51:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f7782700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0060520 con 0x7f49f00f55c0 2022-02-02T19:51:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33802/0 (socket says 172.21.15.96:33802) 2022-02-02T19:51:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 -- 172.21.15.96:0/3930249114 learned_addr learned my addr 172.21.15.96:0/3930249114 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f551e700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f55c0 0x7f49f0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 -- 172.21.15.96:0/3930249114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f55c0 msgr2=0x7f49f0109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f55c0 0x7f49f0109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 -- 172.21.15.96:0/3930249114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec005040 con 0x7f49f00f6860 2022-02-02T19:51:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f4d1d700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f49e00026d0 tx=0x7f49e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e00079c0 con 0x7f49f00f6860 2022-02-02T19:51:15.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49e000f040 con 0x7f49f00f6860 2022-02-02T19:51:15.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e00148b0 con 0x7f49f00f6860 2022-02-02T19:51:15.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.035+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f010c720 con 0x7f49f00f6860 2022-02-02T19:51:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.036+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f010cce0 con 0x7f49f00f6860 2022-02-02T19:51:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.037+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0045ad0 con 0x7f49f00f6860 2022-02-02T19:51:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.037+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f49e0007b20 con 0x7f49f00f6860 2022-02-02T19:51:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.037+0000 7f49e5ffb700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.038+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49e00819e0 con 0x7f49f00f6860 2022-02-02T19:51:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.038+0000 7f49f551e700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.038+0000 7f49f551e700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f49ec013690 tx=0x7f49ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.042+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49e004fae0 con 0x7f49f00f6860 2022-02-02T19:51:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.218+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f0057f10 con 0x7f49dc064dd0 2022-02-02T19:51:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.219+0000 7f49e5ffb700 1 -- 172.21.15.96:0/3930249114 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f49f0057f10 con 0x7f49dc064dd0 2022-02-02T19:51:15.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 msgr2=0x7f49dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f49ec013690 tx=0x7f49ec009b30).stop 2022-02-02T19:51:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 msgr2=0x7f49f010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f49e00026d0 tx=0x7f49e0009de0).stop 2022-02-02T19:51:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 shutdown_connections 2022-02-02T19:51:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f00f55c0 0x7f49f0109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 --2- 172.21.15.96:0/3930249114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f00f6860 0x7f49f010c170 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 >> 172.21.15.96:0/3930249114 conn(0x7f49f00f0d40 msgr2=0x7f49f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 shutdown_connections 2022-02-02T19:51:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.221+0000 7f49f7782700 1 -- 172.21.15.96:0/3930249114 wait complete. 2022-02-02T19:51:15.235 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:51:15.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 -- 172.21.15.96:0/1963731362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 msgr2=0x7f9db80f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 --2- 172.21.15.96:0/1963731362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f4860 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f9da0004660 tx=0x7f9da0009b30).stop 2022-02-02T19:51:15.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 -- 172.21.15.96:0/1963731362 shutdown_connections 2022-02-02T19:51:15.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 --2- 172.21.15.96:0/1963731362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f4860 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 --2- 172.21.15.96:0/1963731362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 0x7f9db80f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 -- 172.21.15.96:0/1963731362 >> 172.21.15.96:0/1963731362 conn(0x7f9db80f04c0 msgr2=0x7f9db80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 -- 172.21.15.96:0/1963731362 shutdown_connections 2022-02-02T19:51:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.319+0000 7f9dbde81700 1 -- 172.21.15.96:0/1963731362 wait complete. 2022-02-02T19:51:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 Processor -- start 2022-02-02T19:51:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 -- start start 2022-02-02T19:51:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 0x7f9db80f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80f5ff0 con 0x7f9db80f86e0 2022-02-02T19:51:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9dbde81700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80f6130 con 0x7f9db80f7d40 2022-02-02T19:51:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33812/0 (socket says 172.21.15.96:33812) 2022-02-02T19:51:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 -- 172.21.15.96:0/3622465506 learned_addr learned my addr 172.21.15.96:0/3622465506 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db77fe700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 0x7f9db80f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 -- 172.21.15.96:0/3622465506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 msgr2=0x7f9db80f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 0x7f9db80f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.320+0000 7f9db6ffd700 1 -- 172.21.15.96:0/3622465506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0005040 con 0x7f9db80f86e0 2022-02-02T19:51:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9db6ffd700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f9da0009990 tx=0x7f9da0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da0018070 con 0x7f9db80f86e0 2022-02-02T19:51:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80f63b0 con 0x7f9db80f86e0 2022-02-02T19:51:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9da0007ba0 con 0x7f9db80f86e0 2022-02-02T19:51:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da001c3c0 con 0x7f9db80f86e0 2022-02-02T19:51:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.321+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db80f6910 con 0x7f9db80f86e0 2022-02-02T19:51:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.322+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8045ad0 con 0x7f9db80f86e0 2022-02-02T19:51:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.322+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9da001d420 con 0x7f9db80f86e0 2022-02-02T19:51:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.323+0000 7f9daffff700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 0x7f9da4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.323+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9da0083810 con 0x7f9db80f86e0 2022-02-02T19:51:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.323+0000 7f9db77fe700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 0x7f9da4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.323+0000 7f9db77fe700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 0x7f9da4067290 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9da8009880 tx=0x7f9da800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.327+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9da0051850 con 0x7f9db80f86e0 2022-02-02T19:51:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.500+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9db8057f10 con 0x7f9da4064dd0 2022-02-02T19:51:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.509+0000 7f9daffff700 1 -- 172.21.15.96:0/3622465506 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9db8057f10 con 0x7f9da4064dd0 2022-02-02T19:51:15.514 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:51:15.514 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (94m) 65m ago 95m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:51:15.514 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (87m) 65m ago 95m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:51:15.514 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (86m) 63m ago 95m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:51:15.515 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (94m) 65m ago 95m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:51:15.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (91m) 65m ago 91m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:51:15.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (87m) 65m ago 91m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:51:15.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (91m) 63m ago 91m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:51:15.516 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (87m) 63m ago 91m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:51:15.516 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (88m) 65m ago 96m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:51:15.516 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (88m) 63m ago 95m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:51:15.516 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (87m) 65m ago 96m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:51:15.516 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (87m) 63m ago 95m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:51:15.517 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (95m) 65m ago 95m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:51:15.517 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (94m) 63m ago 94m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:51:15.517 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (86m) 65m ago 94m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:51:15.517 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (86m) 65m ago 94m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:51:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (85m) 65m ago 93m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:51:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (85m) 63m ago 93m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:51:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (84m) 63m ago 93m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:51:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (84m) 63m ago 93m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:51:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (94m) 65m ago 95m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:51:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 msgr2=0x7f9da4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 0x7f9da4067290 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9da8009880 tx=0x7f9da800b040).stop 2022-02-02T19:51:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 msgr2=0x7f9db80f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f9da0009990 tx=0x7f9da0009b30).stop 2022-02-02T19:51:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 shutdown_connections 2022-02-02T19:51:15.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9da4064dd0 0x7f9da4067290 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db80f7d40 0x7f9db80f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 --2- 172.21.15.96:0/3622465506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9db80f86e0 0x7f9db80f5a90 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.511+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 >> 172.21.15.96:0/3622465506 conn(0x7f9db80f04c0 msgr2=0x7f9db80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.512+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 shutdown_connections 2022-02-02T19:51:15.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.512+0000 7f9dbde81700 1 -- 172.21.15.96:0/3622465506 wait complete. 2022-02-02T19:51:15.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 -- 172.21.15.96:0/3573482744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 msgr2=0x7fa5780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 --2- 172.21.15.96:0/3573482744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f59e0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fa56c004660 tx=0x7fa56c009b30).stop 2022-02-02T19:51:15.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 -- 172.21.15.96:0/3573482744 shutdown_connections 2022-02-02T19:51:15.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 --2- 172.21.15.96:0/3573482744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 0x7fa5780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 --2- 172.21.15.96:0/3573482744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f59e0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.608+0000 7fa57cb95700 1 -- 172.21.15.96:0/3573482744 >> 172.21.15.96:0/3573482744 conn(0x7fa5780f0d40 msgr2=0x7fa5780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 -- 172.21.15.96:0/3573482744 shutdown_connections 2022-02-02T19:51:15.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 -- 172.21.15.96:0/3573482744 wait complete. 2022-02-02T19:51:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 Processor -- start 2022-02-02T19:51:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 -- start start 2022-02-02T19:51:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 0x7fa5780f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780f8100 con 0x7fa5780f55c0 2022-02-02T19:51:15.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.609+0000 7fa57cb95700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780f8240 con 0x7fa5780f6860 2022-02-02T19:51:15.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33820/0 (socket says 172.21.15.96:33820) 2022-02-02T19:51:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 -- 172.21.15.96:0/4158950254 learned_addr learned my addr 172.21.15.96:0/4158950254 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa575d9b700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 0x7fa5780f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 -- 172.21.15.96:0/4158950254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 msgr2=0x7fa5780f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 0x7fa5780f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 -- 172.21.15.96:0/4158950254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c005040 con 0x7fa5780f55c0 2022-02-02T19:51:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57659c700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fa56c013a70 tx=0x7fa56c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa56c018070 con 0x7fa5780f55c0 2022-02-02T19:51:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa56c0097d0 con 0x7fa5780f55c0 2022-02-02T19:51:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa56c01de80 con 0x7fa5780f55c0 2022-02-02T19:51:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5780f84c0 con 0x7fa5780f55c0 2022-02-02T19:51:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.610+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5780f8a20 con 0x7fa5780f55c0 2022-02-02T19:51:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.611+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa578045ad0 con 0x7fa5780f55c0 2022-02-02T19:51:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.612+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa56c007ba0 con 0x7fa5780f55c0 2022-02-02T19:51:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.612+0000 7fa566ffd700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 0x7fa560067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.613+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa56c0835a0 con 0x7fa5780f55c0 2022-02-02T19:51:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.613+0000 7fa575d9b700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 0x7fa560067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.613+0000 7fa575d9b700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 0x7fa560067290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fa568004e20 tx=0x7fa56800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.617+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa56c051810 con 0x7fa5780f55c0 2022-02-02T19:51:15.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.847+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa57810f6a0 con 0x7fa5780f55c0 2022-02-02T19:51:15.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.847+0000 7fa566ffd700 1 -- 172.21.15.96:0/4158950254 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa56c054e30 con 0x7fa5780f55c0 2022-02-02T19:51:15.852 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:51:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:51:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:51:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:51:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:51:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:51:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:51:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:51:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:51:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:51:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:51:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:51:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:51:15.856 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:51:15.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 msgr2=0x7fa560067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 0x7fa560067290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fa568004e20 tx=0x7fa56800b040).stop 2022-02-02T19:51:15.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 msgr2=0x7fa5780f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fa56c013a70 tx=0x7fa56c009b30).stop 2022-02-02T19:51:15.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 shutdown_connections 2022-02-02T19:51:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa560064dd0 0x7fa560067290 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5780f55c0 0x7fa5780f9720 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 --2- 172.21.15.96:0/4158950254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5780f6860 0x7fa5780f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.849+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 >> 172.21.15.96:0/4158950254 conn(0x7fa5780f0d40 msgr2=0x7fa57805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.850+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 shutdown_connections 2022-02-02T19:51:15.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.850+0000 7fa57cb95700 1 -- 172.21.15.96:0/4158950254 wait complete. 2022-02-02T19:51:15.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2804904941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66e0 msgr2=0x7fa4a80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2804904941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66e0 0x7fa4a80f6b40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fa49c004660 tx=0x7fa49c009b30).stop 2022-02-02T19:51:15.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2804904941 shutdown_connections 2022-02-02T19:51:15.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2804904941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66e0 0x7fa4a80f6b40 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2804904941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5440 0x7fa4a80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2804904941 >> 172.21.15.96:0/2804904941 conn(0x7fa4a80f0ba0 msgr2=0x7fa4a80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:15.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2804904941 shutdown_connections 2022-02-02T19:51:15.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.946+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2804904941 wait complete. 2022-02-02T19:51:15.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 Processor -- start 2022-02-02T19:51:15.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 -- start start 2022-02-02T19:51:15.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f66e0 0x7fa4a81061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8106770 con 0x7fa4a80f5440 2022-02-02T19:51:15.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4ad3b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8106f70 con 0x7fa4a80f66e0 2022-02-02T19:51:15.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33830/0 (socket says 172.21.15.96:33830) 2022-02-02T19:51:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.947+0000 7fa4a7fff700 1 -- 172.21.15.96:0/2870468017 learned_addr learned my addr 172.21.15.96:0/2870468017 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a77fe700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f66e0 0x7fa4a81061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a7fff700 1 -- 172.21.15.96:0/2870468017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f66e0 msgr2=0x7fa4a81061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a7fff700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f66e0 0x7fa4a81061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a7fff700 1 -- 172.21.15.96:0/2870468017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c005040 con 0x7fa4a80f5440 2022-02-02T19:51:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a7fff700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fa49800e9a0 tx=0x7fa498007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49800c9b0 con 0x7fa4a80f5440 2022-02-02T19:51:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa498011470 con 0x7fa4a80f5440 2022-02-02T19:51:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a81071f0 con 0x7fa4a80f5440 2022-02-02T19:51:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4980105f0 con 0x7fa4a80f5440 2022-02-02T19:51:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.948+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8107760 con 0x7fa4a80f5440 2022-02-02T19:51:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.949+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8045ad0 con 0x7fa4a80f5440 2022-02-02T19:51:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.950+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa4980115e0 con 0x7fa4a80f5440 2022-02-02T19:51:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.950+0000 7fa4a4ff9700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 0x7fa4900673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.950+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa498084850 con 0x7fa4a80f5440 2022-02-02T19:51:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.950+0000 7fa4a77fe700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 0x7fa4900673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.951+0000 7fa4a77fe700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 0x7fa4900673b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fa49c004e30 tx=0x7fa49c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:15.954+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa498056400 con 0x7fa4a80f5440 2022-02-02T19:51:16.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.156+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4a80ff640 con 0x7fa4a80f5440 2022-02-02T19:51:16.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.156+0000 7fa4a4ff9700 1 -- 172.21.15.96:0/2870468017 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa498055ff0 con 0x7fa4a80f5440 2022-02-02T19:51:16.161 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:51:16.161 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:51:16.161 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:51:16.162 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:51:16.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:16.162 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:51:16.162 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:51:16.163 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:51:16.163 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:51:16.163 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:51:16.163 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:51:16.163 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:51:16.164 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:51:16.164 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:51:16.164 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:51:16.164 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:51:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:51:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:51:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:51:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:51:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:51:16.166 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:51:16.166 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:51:16.166 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:51:16.166 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:51:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:51:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:51:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:51:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:51:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:51:16.168 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:51:16.168 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:51:16.168 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:16.168 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:16.169 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:51:16.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:16.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:16.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:16.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 msgr2=0x7fa4900673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 0x7fa4900673b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fa49c004e30 tx=0x7fa49c009b30).stop 2022-02-02T19:51:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 msgr2=0x7fa4a8105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fa49800e9a0 tx=0x7fa498007e20).stop 2022-02-02T19:51:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 shutdown_connections 2022-02-02T19:51:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa490064ef0 0x7fa4900673b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f5440 0x7fa4a8105cd0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 --2- 172.21.15.96:0/2870468017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f66e0 0x7fa4a81061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 >> 172.21.15.96:0/2870468017 conn(0x7fa4a80f0ba0 msgr2=0x7fa4a80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 shutdown_connections 2022-02-02T19:51:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:16.158+0000 7fa4ad3b2700 1 -- 172.21.15.96:0/2870468017 wait complete. 2022-02-02T19:51:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:51:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:16 smithi159 ceph-mon[69013]: pgmap v2675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:16 smithi159 ceph-mon[69013]: from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4158950254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:51:16.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2870468017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:51:16.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:16 smithi096 ceph-mon[101353]: pgmap v2675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:16 smithi096 ceph-mon[101353]: from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4158950254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:51:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2870468017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:51:17.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:17 smithi159 ceph-mon[69013]: from='client.36858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:17.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:17 smithi096 ceph-mon[101353]: from='client.36858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:18 smithi159 ceph-mon[69013]: pgmap v2676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:18 smithi096 ceph-mon[101353]: pgmap v2676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:20.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:20 smithi159 ceph-mon[69013]: pgmap v2677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:20.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:20 smithi096 ceph-mon[101353]: pgmap v2677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:22 smithi159 ceph-mon[69013]: pgmap v2678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:22 smithi096 ceph-mon[101353]: pgmap v2678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:24 smithi159 ceph-mon[69013]: pgmap v2679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:24 smithi096 ceph-mon[101353]: pgmap v2679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:26 smithi159 ceph-mon[69013]: pgmap v2680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:26 smithi096 ceph-mon[101353]: pgmap v2680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:28 smithi159 ceph-mon[69013]: pgmap v2681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:51:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:51:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:28 smithi096 ceph-mon[101353]: pgmap v2681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:51:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:51:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:30 smithi159 ceph-mon[69013]: pgmap v2682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:30 smithi096 ceph-mon[101353]: pgmap v2682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:32 smithi159 ceph-mon[69013]: pgmap v2683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:32 smithi096 ceph-mon[101353]: pgmap v2683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:34 smithi159 ceph-mon[69013]: pgmap v2684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:34 smithi096 ceph-mon[101353]: pgmap v2684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:36 smithi159 ceph-mon[69013]: pgmap v2685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:36 smithi096 ceph-mon[101353]: pgmap v2685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:38 smithi159 ceph-mon[69013]: pgmap v2686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:38 smithi096 ceph-mon[101353]: pgmap v2686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:40 smithi159 ceph-mon[69013]: pgmap v2687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:40 smithi096 ceph-mon[101353]: pgmap v2687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:42.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:42 smithi159 ceph-mon[69013]: pgmap v2688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:42 smithi096 ceph-mon[101353]: pgmap v2688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:44.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:44 smithi159 ceph-mon[69013]: pgmap v2689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:44 smithi096 ceph-mon[101353]: pgmap v2689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:46.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 -- 172.21.15.96:0/3861772819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 msgr2=0x7f29c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/3861772819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f59e0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f29b8004660 tx=0x7f29b8009b30).stop 2022-02-02T19:51:46.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 -- 172.21.15.96:0/3861772819 shutdown_connections 2022-02-02T19:51:46.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/3861772819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 0x7f29c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/3861772819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f59e0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 -- 172.21.15.96:0/3861772819 >> 172.21.15.96:0/3861772819 conn(0x7f29c40f0d40 msgr2=0x7f29c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 -- 172.21.15.96:0/3861772819 shutdown_connections 2022-02-02T19:51:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.271+0000 7f29cbb8a700 1 -- 172.21.15.96:0/3861772819 wait complete. 2022-02-02T19:51:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 Processor -- start 2022-02-02T19:51:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 -- start start 2022-02-02T19:51:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 0x7f29c40f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40f8920 con 0x7f29c40f55c0 2022-02-02T19:51:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29cbb8a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40f8a60 con 0x7f29c40f6860 2022-02-02T19:51:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33850/0 (socket says 172.21.15.96:33850) 2022-02-02T19:51:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 -- 172.21.15.96:0/2409681628 learned_addr learned my addr 172.21.15.96:0/2409681628 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9125700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 0x7f29c40f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 -- 172.21.15.96:0/2409681628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 msgr2=0x7f29c40f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 0x7f29c40f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.272+0000 7f29c9926700 1 -- 172.21.15.96:0/2409681628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8005040 con 0x7f29c40f55c0 2022-02-02T19:51:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29c9926700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f29b8013a70 tx=0x7f29b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8018070 con 0x7f29c40f55c0 2022-02-02T19:51:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f29b80097d0 con 0x7f29c40f55c0 2022-02-02T19:51:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40f8ce0 con 0x7f29c40f55c0 2022-02-02T19:51:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b801de80 con 0x7f29c40f55c0 2022-02-02T19:51:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.273+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40f9240 con 0x7f29c40f55c0 2022-02-02T19:51:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.274+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c4045ad0 con 0x7f29c40f55c0 2022-02-02T19:51:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.274+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f29b8007ba0 con 0x7f29c40f55c0 2022-02-02T19:51:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.275+0000 7f29b67fc700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 0x7f29b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.275+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f29b8083660 con 0x7f29c40f55c0 2022-02-02T19:51:46.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.275+0000 7f29c9125700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 0x7f29b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.275+0000 7f29c9125700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 0x7f29b0067290 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f29c0004e20 tx=0x7f29c000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.279+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f29b8051760 con 0x7f29c40f55c0 2022-02-02T19:51:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.460+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29c405fd30 con 0x7f29b0064dd0 2022-02-02T19:51:46.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.461+0000 7f29b67fc700 1 -- 172.21.15.96:0/2409681628 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f29c405fd30 con 0x7f29b0064dd0 2022-02-02T19:51:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 msgr2=0x7f29b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 0x7f29b0067290 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f29c0004e20 tx=0x7f29c000b040).stop 2022-02-02T19:51:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 msgr2=0x7f29c40f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f29b8013a70 tx=0x7f29b8009b30).stop 2022-02-02T19:51:46.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 shutdown_connections 2022-02-02T19:51:46.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f29b0064dd0 0x7f29b0067290 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c40f55c0 0x7f29c40f9f40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 --2- 172.21.15.96:0/2409681628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29c40f6860 0x7f29c40f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 >> 172.21.15.96:0/2409681628 conn(0x7f29c40f0d40 msgr2=0x7f29c405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:46.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 shutdown_connections 2022-02-02T19:51:46.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.463+0000 7f29cbb8a700 1 -- 172.21.15.96:0/2409681628 wait complete. 2022-02-02T19:51:46.479 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:51:46.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:46 smithi159 ceph-mon[69013]: pgmap v2690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:46 smithi096 ceph-mon[101353]: pgmap v2690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 -- 172.21.15.96:0/2117574857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f66e0 msgr2=0x7ff7dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/2117574857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc0f6b00 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7ff7cc004660 tx=0x7ff7cc009b30).stop 2022-02-02T19:51:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 -- 172.21.15.96:0/2117574857 shutdown_connections 2022-02-02T19:51:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/2117574857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/2117574857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc0f6b00 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 -- 172.21.15.96:0/2117574857 >> 172.21.15.96:0/2117574857 conn(0x7ff7dc0f1e40 msgr2=0x7ff7dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 -- 172.21.15.96:0/2117574857 shutdown_connections 2022-02-02T19:51:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.560+0000 7ff7e33d3700 1 -- 172.21.15.96:0/2117574857 wait complete. 2022-02-02T19:51:46.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 Processor -- start 2022-02-02T19:51:46.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 -- start start 2022-02-02T19:51:46.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc06a380 con 0x7ff7dc0f7980 2022-02-02T19:51:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e33d3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc06a4c0 con 0x7ff7dc0f66e0 2022-02-02T19:51:46.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e096e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e096e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33862/0 (socket says 172.21.15.96:33862) 2022-02-02T19:51:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e096e700 1 -- 172.21.15.96:0/3927254637 learned_addr learned my addr 172.21.15.96:0/3927254637 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.561+0000 7ff7e116f700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e096e700 1 -- 172.21.15.96:0/3927254637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f66e0 msgr2=0x7ff7dc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e096e700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e096e700 1 -- 172.21.15.96:0/3927254637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc005040 con 0x7ff7dc0f7980 2022-02-02T19:51:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e096e700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7ff7d800c530 tx=0x7ff7d8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d800f650 con 0x7ff7dc0f7980 2022-02-02T19:51:46.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7d800fc60 con 0x7ff7dc0f7980 2022-02-02T19:51:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc06a7a0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d8012cd0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.562+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc10efe0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.563+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc045ad0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.563+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff7d8010070 con 0x7ff7dc0f7980 2022-02-02T19:51:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.564+0000 7ff7d1ffb700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 0x7ff7c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.564+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff7d80817b0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.564+0000 7ff7e116f700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 0x7ff7c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.564+0000 7ff7e116f700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 0x7ff7c8067290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff7cc004e30 tx=0x7ff7cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.568+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff7d804f8b0 con 0x7ff7dc0f7980 2022-02-02T19:51:46.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.741+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7dc0ff010 con 0x7ff7c8064dd0 2022-02-02T19:51:46.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.751+0000 7ff7d1ffb700 1 -- 172.21.15.96:0/3927254637 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff7dc0ff010 con 0x7ff7c8064dd0 2022-02-02T19:51:46.754 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:51:46.755 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (95m) 65m ago 96m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:51:46.755 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (87m) 65m ago 96m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:51:46.755 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (87m) 64m ago 95m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:51:46.755 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (94m) 65m ago 96m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:51:46.755 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (92m) 65m ago 92m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:51:46.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (87m) 65m ago 92m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:51:46.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (92m) 64m ago 92m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:51:46.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (88m) 64m ago 92m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:51:46.756 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (89m) 65m ago 97m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:51:46.757 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (88m) 64m ago 95m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:51:46.757 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (88m) 65m ago 97m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:51:46.757 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (88m) 64m ago 95m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:51:46.757 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (95m) 65m ago 95m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:51:46.758 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (95m) 64m ago 95m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:51:46.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (87m) 65m ago 95m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:51:46.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (86m) 65m ago 94m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:51:46.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (86m) 65m ago 94m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:51:46.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (85m) 64m ago 94m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:51:46.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (85m) 64m ago 93m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:51:46.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (84m) 64m ago 93m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:51:46.759 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (94m) 65m ago 95m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:51:46.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 msgr2=0x7ff7c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 0x7ff7c8067290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff7cc004e30 tx=0x7ff7cc009b30).stop 2022-02-02T19:51:46.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 msgr2=0x7ff7dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7ff7d800c530 tx=0x7ff7d8007e20).stop 2022-02-02T19:51:46.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 shutdown_connections 2022-02-02T19:51:46.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff7c8064dd0 0x7ff7c8067290 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7dc0f66e0 0x7ff7dc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 --2- 172.21.15.96:0/3927254637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7dc0f7980 0x7ff7dc069e20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.753+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 >> 172.21.15.96:0/3927254637 conn(0x7ff7dc0f1e40 msgr2=0x7ff7dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:46.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.754+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 shutdown_connections 2022-02-02T19:51:46.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.754+0000 7ff7e33d3700 1 -- 172.21.15.96:0/3927254637 wait complete. 2022-02-02T19:51:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 -- 172.21.15.96:0/3184726189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f55e0 msgr2=0x7fed800f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 --2- 172.21.15.96:0/3184726189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f55e0 0x7fed800f5a00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fed74004660 tx=0x7fed74009b30).stop 2022-02-02T19:51:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 -- 172.21.15.96:0/3184726189 shutdown_connections 2022-02-02T19:51:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 --2- 172.21.15.96:0/3184726189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f6880 0x7fed800f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 --2- 172.21.15.96:0/3184726189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f55e0 0x7fed800f5a00 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 -- 172.21.15.96:0/3184726189 >> 172.21.15.96:0/3184726189 conn(0x7fed800f0d40 msgr2=0x7fed800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 -- 172.21.15.96:0/3184726189 shutdown_connections 2022-02-02T19:51:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.850+0000 7fed84cb8700 1 -- 172.21.15.96:0/3184726189 wait complete. 2022-02-02T19:51:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 Processor -- start 2022-02-02T19:51:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 -- start start 2022-02-02T19:51:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f55e0 0x7fed8010c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800603f0 con 0x7fed800f6880 2022-02-02T19:51:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed84cb8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed80060530 con 0x7fed800f55e0 2022-02-02T19:51:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33872/0 (socket says 172.21.15.96:33872) 2022-02-02T19:51:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 -- 172.21.15.96:0/1735650951 learned_addr learned my addr 172.21.15.96:0/1735650951 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7e59c700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f55e0 0x7fed8010c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 -- 172.21.15.96:0/1735650951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f55e0 msgr2=0x7fed8010c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f55e0 0x7fed8010c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.851+0000 7fed7dd9b700 1 -- 172.21.15.96:0/1735650951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74005040 con 0x7fed800f6880 2022-02-02T19:51:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed7dd9b700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fed700026d0 tx=0x7fed70009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed700079c0 con 0x7fed800f6880 2022-02-02T19:51:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed7000f040 con 0x7fed800f6880 2022-02-02T19:51:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8010eaa0 con 0x7fed800f6880 2022-02-02T19:51:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed700148b0 con 0x7fed800f6880 2022-02-02T19:51:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.852+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8010ef20 con 0x7fed800f6880 2022-02-02T19:51:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.853+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80045ad0 con 0x7fed800f6880 2022-02-02T19:51:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.853+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed70007b20 con 0x7fed800f6880 2022-02-02T19:51:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.854+0000 7fed6effd700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.854+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed70081930 con 0x7fed800f6880 2022-02-02T19:51:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.854+0000 7fed7e59c700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.854+0000 7fed7e59c700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 0x7fed68067290 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fed74013690 tx=0x7fed74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:46.858+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed7004fa30 con 0x7fed800f6880 2022-02-02T19:51:47.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.091+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed800606c0 con 0x7fed800f6880 2022-02-02T19:51:47.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.091+0000 7fed6effd700 1 -- 172.21.15.96:0/1735650951 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fed70053050 con 0x7fed800f6880 2022-02-02T19:51:47.095 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:51:47.096 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:51:47.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:51:47.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:47.096 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:51:47.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:51:47.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:47.097 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:51:47.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:51:47.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:47.098 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:51:47.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:51:47.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:51:47.098 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:51:47.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:51:47.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:51:47.099 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:51:47.099 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:51:47.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 msgr2=0x7fed68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 0x7fed68067290 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fed74013690 tx=0x7fed74009b30).stop 2022-02-02T19:51:47.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 msgr2=0x7fed8010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fed700026d0 tx=0x7fed70009de0).stop 2022-02-02T19:51:47.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 shutdown_connections 2022-02-02T19:51:47.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed800f55e0 0x7fed8010c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 --2- 172.21.15.96:0/1735650951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed800f6880 0x7fed8010e5b0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 >> 172.21.15.96:0/1735650951 conn(0x7fed800f0d40 msgr2=0x7fed800fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:47.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 shutdown_connections 2022-02-02T19:51:47.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.093+0000 7fed84cb8700 1 -- 172.21.15.96:0/1735650951 wait complete. 2022-02-02T19:51:47.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 -- 172.21.15.96:0/3389401297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 msgr2=0x7f5d240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 --2- 172.21.15.96:0/3389401297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d240f6b00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f5d14004660 tx=0x7f5d14009b30).stop 2022-02-02T19:51:47.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 -- 172.21.15.96:0/3389401297 shutdown_connections 2022-02-02T19:51:47.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 --2- 172.21.15.96:0/3389401297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 0x7f5d240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 --2- 172.21.15.96:0/3389401297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d240f6b00 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 -- 172.21.15.96:0/3389401297 >> 172.21.15.96:0/3389401297 conn(0x7f5d240f1e40 msgr2=0x7f5d240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:47.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 -- 172.21.15.96:0/3389401297 shutdown_connections 2022-02-02T19:51:47.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.190+0000 7f5d28815700 1 -- 172.21.15.96:0/3389401297 wait complete. 2022-02-02T19:51:47.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 Processor -- start 2022-02-02T19:51:47.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 -- start start 2022-02-02T19:51:47.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:47.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 0x7f5d241074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:47.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24107a50 con 0x7f5d240f66e0 2022-02-02T19:51:47.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d28815700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24107b90 con 0x7f5d240f7980 2022-02-02T19:51:47.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:47.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33880/0 (socket says 172.21.15.96:33880) 2022-02-02T19:51:47.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d2259c700 1 -- 172.21.15.96:0/3867902693 learned_addr learned my addr 172.21.15.96:0/3867902693 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:51:47.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.191+0000 7f5d1bfff700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 0x7f5d241074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:47.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d2259c700 1 -- 172.21.15.96:0/3867902693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 msgr2=0x7f5d241074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d2259c700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 0x7f5d241074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d2259c700 1 -- 172.21.15.96:0/3867902693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14005040 con 0x7f5d240f66e0 2022-02-02T19:51:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d2259c700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f5d14013a70 tx=0x7f5d14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d14018070 con 0x7f5d240f66e0 2022-02-02T19:51:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d241084d0 con 0x7f5d240f66e0 2022-02-02T19:51:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d140097d0 con 0x7f5d240f66e0 2022-02-02T19:51:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1401de80 con 0x7f5d240f66e0 2022-02-02T19:51:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.192+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d24108a30 con 0x7f5d240f66e0 2022-02-02T19:51:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.193+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5d14007ba0 con 0x7f5d240f66e0 2022-02-02T19:51:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.194+0000 7f5d1affd700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 0x7f5d10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:51:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.194+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24045ad0 con 0x7f5d240f66e0 2022-02-02T19:51:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.194+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5d14083590 con 0x7f5d240f66e0 2022-02-02T19:51:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.194+0000 7f5d1bfff700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 0x7f5d10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:51:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.194+0000 7f5d1bfff700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 0x7f5d10067290 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5d0c004c40 tx=0x7f5d0c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:51:47.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.198+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5d14055180 con 0x7f5d240f66e0 2022-02-02T19:51:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.403+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d240fefb0 con 0x7f5d240f66e0 2022-02-02T19:51:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.404+0000 7f5d1affd700 1 -- 172.21.15.96:0/3867902693 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5d14054d70 con 0x7f5d240f66e0 2022-02-02T19:51:47.410 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:51:47.411 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:51:47.411 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:51:47.411 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:51:47.411 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:47.412 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:51:47.412 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:51:47.412 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:51:47.412 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:51:47.412 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:51:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:51:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:51:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:51:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:51:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:51:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:51:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:51:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:51:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:51:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:51:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:51:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:51:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:51:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:51:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:51:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:51:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:51:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:51:47.417 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:51:47.417 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:51:47.417 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:51:47.417 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:51:47.417 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:47.418 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:47.418 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:51:47.418 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:51:47.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:47.419 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:47.419 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:51:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 msgr2=0x7f5d10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 0x7f5d10067290 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5d0c004c40 tx=0x7f5d0c00b040).stop 2022-02-02T19:51:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 msgr2=0x7f5d24106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:51:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f5d14013a70 tx=0x7f5d14009b30).stop 2022-02-02T19:51:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 shutdown_connections 2022-02-02T19:51:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d10064dd0 0x7f5d10067290 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.405+0000 7f5d28815700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f66e0 0x7f5d24106fb0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.406+0000 7f5d28815700 1 --2- 172.21.15.96:0/3867902693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f7980 0x7f5d241074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:51:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.406+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 >> 172.21.15.96:0/3867902693 conn(0x7f5d240f1e40 msgr2=0x7f5d240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:51:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.406+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 shutdown_connections 2022-02-02T19:51:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:51:47.406+0000 7f5d28815700 1 -- 172.21.15.96:0/3867902693 wait complete. 2022-02-02T19:51:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:51:47.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1735650951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:51:47.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1735650951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:51:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:48 smithi159 ceph-mon[69013]: from='client.36870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:48 smithi159 ceph-mon[69013]: pgmap v2691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:48 smithi159 ceph-mon[69013]: from='client.36874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:48.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3867902693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:51:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:48 smithi096 ceph-mon[101353]: from='client.36870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:48 smithi096 ceph-mon[101353]: pgmap v2691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:48.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:48 smithi096 ceph-mon[101353]: from='client.36874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:51:48.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3867902693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:51:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:50 smithi096 ceph-mon[101353]: pgmap v2692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:50.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:50 smithi159 ceph-mon[69013]: pgmap v2692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:52 smithi096 ceph-mon[101353]: pgmap v2693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:52 smithi159 ceph-mon[69013]: pgmap v2693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:53 smithi096 ceph-mon[101353]: pgmap v2694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:53.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:53 smithi159 ceph-mon[69013]: pgmap v2694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:55 smithi159 ceph-mon[69013]: pgmap v2695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:56.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:55 smithi096 ceph-mon[101353]: pgmap v2695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:58.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:51:58 smithi159 ceph-mon[69013]: pgmap v2696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:51:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:51:58 smithi096 ceph-mon[101353]: pgmap v2696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:00.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:00 smithi159 ceph-mon[69013]: pgmap v2697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:00 smithi096 ceph-mon[101353]: pgmap v2697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:02 smithi159 ceph-mon[69013]: pgmap v2698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:02 smithi096 ceph-mon[101353]: pgmap v2698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:04.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:04 smithi159 ceph-mon[69013]: pgmap v2699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:04 smithi096 ceph-mon[101353]: pgmap v2699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:06.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:06 smithi159 ceph-mon[69013]: pgmap v2700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:06 smithi096 ceph-mon[101353]: pgmap v2700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:08.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:08 smithi159 ceph-mon[69013]: pgmap v2701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:08 smithi096 ceph-mon[101353]: pgmap v2701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:10.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:10 smithi159 ceph-mon[69013]: pgmap v2702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:10 smithi096 ceph-mon[101353]: pgmap v2702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:12 smithi159 ceph-mon[69013]: pgmap v2703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:12 smithi096 ceph-mon[101353]: pgmap v2703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:14 smithi096 ceph-mon[101353]: pgmap v2704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:14 smithi159 ceph-mon[69013]: pgmap v2704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:16 smithi096 ceph-mon[101353]: pgmap v2705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:16 smithi159 ceph-mon[69013]: pgmap v2705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:17.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 -- 172.21.15.96:0/2756730858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 msgr2=0x7f96880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 --2- 172.21.15.96:0/2756730858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f96880f59e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f9678004660 tx=0x7f9678009b30).stop 2022-02-02T19:52:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 -- 172.21.15.96:0/2756730858 shutdown_connections 2022-02-02T19:52:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 --2- 172.21.15.96:0/2756730858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 0x7f96880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 --2- 172.21.15.96:0/2756730858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f96880f59e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 -- 172.21.15.96:0/2756730858 >> 172.21.15.96:0/2756730858 conn(0x7f96880f0d40 msgr2=0x7f96880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 -- 172.21.15.96:0/2756730858 shutdown_connections 2022-02-02T19:52:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.515+0000 7f96904cf700 1 -- 172.21.15.96:0/2756730858 wait complete. 2022-02-02T19:52:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 Processor -- start 2022-02-02T19:52:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 -- start start 2022-02-02T19:52:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 0x7f9688107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688107a10 con 0x7f96880f55c0 2022-02-02T19:52:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f96904cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688107b50 con 0x7f96880f6860 2022-02-02T19:52:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f968e26b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f968e26b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33898/0 (socket says 172.21.15.96:33898) 2022-02-02T19:52:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f968e26b700 1 -- 172.21.15.96:0/1878711332 learned_addr learned my addr 172.21.15.96:0/1878711332 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:17.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.516+0000 7f968da6a700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 0x7f9688107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f968e26b700 1 -- 172.21.15.96:0/1878711332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 msgr2=0x7f9688107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f968e26b700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 0x7f9688107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f968e26b700 1 -- 172.21.15.96:0/1878711332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678005040 con 0x7f96880f55c0 2022-02-02T19:52:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f968e26b700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f9678013a70 tx=0x7f9678009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9678018070 con 0x7f96880f55c0 2022-02-02T19:52:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f96780097d0 con 0x7f96880f55c0 2022-02-02T19:52:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9688108490 con 0x7f96880f55c0 2022-02-02T19:52:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967801c3c0 con 0x7f96880f55c0 2022-02-02T19:52:17.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.517+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96881089f0 con 0x7f96880f55c0 2022-02-02T19:52:17.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.518+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9688045ad0 con 0x7f96880f55c0 2022-02-02T19:52:17.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.518+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9678007ba0 con 0x7f96880f55c0 2022-02-02T19:52:17.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.519+0000 7f967effd700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 0x7f96740672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.519+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9678083800 con 0x7f96880f55c0 2022-02-02T19:52:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.519+0000 7f968da6a700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 0x7f96740672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.519+0000 7f968da6a700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 0x7f96740672d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f96840096c0 tx=0x7f9684009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.523+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9678055330 con 0x7f96880f55c0 2022-02-02T19:52:17.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.701+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96881091e0 con 0x7f9674064e10 2022-02-02T19:52:17.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:17 smithi096 ceph-mon[101353]: pgmap v2706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:17.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.703+0000 7f967effd700 1 -- 172.21.15.96:0/1878711332 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9684009e20 con 0x7f9674064e10 2022-02-02T19:52:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 msgr2=0x7f96740672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 0x7f96740672d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f96840096c0 tx=0x7f9684009be0).stop 2022-02-02T19:52:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 msgr2=0x7f9688106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f9678013a70 tx=0x7f9678009b30).stop 2022-02-02T19:52:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 shutdown_connections 2022-02-02T19:52:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9674064e10 0x7f96740672d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96880f55c0 0x7f9688106f70 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 --2- 172.21.15.96:0/1878711332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96880f6860 0x7f9688107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 >> 172.21.15.96:0/1878711332 conn(0x7f96880f0d40 msgr2=0x7f968805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:17.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 shutdown_connections 2022-02-02T19:52:17.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.705+0000 7f96904cf700 1 -- 172.21.15.96:0/1878711332 wait complete. 2022-02-02T19:52:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:52:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:17 smithi159 ceph-mon[69013]: pgmap v2706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.802+0000 7f0980f02700 1 -- 172.21.15.96:0/937385962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 msgr2=0x7f097c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.802+0000 7f0980f02700 1 --2- 172.21.15.96:0/937385962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c0f6b00 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f096c004660 tx=0x7f096c009b30).stop 2022-02-02T19:52:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.802+0000 7f0980f02700 1 -- 172.21.15.96:0/937385962 shutdown_connections 2022-02-02T19:52:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.802+0000 7f0980f02700 1 --2- 172.21.15.96:0/937385962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 0x7f097c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 --2- 172.21.15.96:0/937385962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c0f6b00 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- 172.21.15.96:0/937385962 >> 172.21.15.96:0/937385962 conn(0x7f097c0f1e40 msgr2=0x7f097c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- 172.21.15.96:0/937385962 shutdown_connections 2022-02-02T19:52:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- 172.21.15.96:0/937385962 wait complete. 2022-02-02T19:52:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 Processor -- start 2022-02-02T19:52:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- start start 2022-02-02T19:52:17.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 0x7f097c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c06a380 con 0x7f097c0f66e0 2022-02-02T19:52:17.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f0980f02700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c06a4c0 con 0x7f097c0f7980 2022-02-02T19:52:17.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f097a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f097a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33908/0 (socket says 172.21.15.96:33908) 2022-02-02T19:52:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.803+0000 7f097a59c700 1 -- 172.21.15.96:0/2801347846 learned_addr learned my addr 172.21.15.96:0/2801347846 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f0979d9b700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 0x7f097c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f097a59c700 1 -- 172.21.15.96:0/2801347846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 msgr2=0x7f097c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f097a59c700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 0x7f097c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f097a59c700 1 -- 172.21.15.96:0/2801347846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c005040 con 0x7f097c0f66e0 2022-02-02T19:52:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f097a59c700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f096c013a70 tx=0x7f096c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096c018070 con 0x7f097c0f66e0 2022-02-02T19:52:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f096c0097d0 con 0x7f097c0f66e0 2022-02-02T19:52:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c06a740 con 0x7f097c0f66e0 2022-02-02T19:52:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096c01c3c0 con 0x7f097c0f66e0 2022-02-02T19:52:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.804+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c06aca0 con 0x7f097c0f66e0 2022-02-02T19:52:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.805+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c045ad0 con 0x7f097c0f66e0 2022-02-02T19:52:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.805+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f096c007ba0 con 0x7f097c0f66e0 2022-02-02T19:52:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.806+0000 7f096affd700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 0x7f0964067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.806+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f096c083640 con 0x7f097c0f66e0 2022-02-02T19:52:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.806+0000 7f0979d9b700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 0x7f0964067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.806+0000 7f0979d9b700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 0x7f0964067290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f0970009880 tx=0x7f097000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.810+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f096c051800 con 0x7f097c0f66e0 2022-02-02T19:52:17.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.983+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f097c0ff010 con 0x7f0964064dd0 2022-02-02T19:52:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.992+0000 7f096affd700 1 -- 172.21.15.96:0/2801347846 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f097c0ff010 con 0x7f0964064dd0 2022-02-02T19:52:17.996 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:52:17.996 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (95m) 66m ago 96m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:52:17.996 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (88m) 66m ago 96m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:52:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (88m) 64m ago 96m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:52:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (95m) 66m ago 96m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:52:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (92m) 66m ago 92m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:52:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (88m) 66m ago 92m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:52:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (92m) 64m ago 92m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:52:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (88m) 64m ago 92m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:52:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (89m) 66m ago 97m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:52:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (89m) 64m ago 96m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:52:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (88m) 66m ago 97m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:52:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (88m) 64m ago 96m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:52:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (96m) 66m ago 96m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:52:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (96m) 64m ago 95m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:52:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (87m) 66m ago 95m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:52:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (87m) 66m ago 95m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:52:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (86m) 66m ago 94m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:52:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (86m) 64m ago 94m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:52:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (85m) 64m ago 94m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:52:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (85m) 64m ago 94m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:52:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (95m) 66m ago 96m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:52:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 msgr2=0x7f0964067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 0x7f0964067290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f0970009880 tx=0x7f097000b040).stop 2022-02-02T19:52:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 msgr2=0x7f097c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f096c013a70 tx=0x7f096c009b30).stop 2022-02-02T19:52:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 shutdown_connections 2022-02-02T19:52:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0964064dd0 0x7f0964067290 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f097c0f66e0 0x7f097c06b9a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 --2- 172.21.15.96:0/2801347846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f097c0f7980 0x7f097c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 >> 172.21.15.96:0/2801347846 conn(0x7f097c0f1e40 msgr2=0x7f097c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 shutdown_connections 2022-02-02T19:52:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:17.994+0000 7f0980f02700 1 -- 172.21.15.96:0/2801347846 wait complete. 2022-02-02T19:52:18.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 -- 172.21.15.96:0/3551846511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 msgr2=0x7f1ca00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 --2- 172.21.15.96:0/3551846511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca00f6b30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f1c94004660 tx=0x7f1c94009b30).stop 2022-02-02T19:52:18.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 -- 172.21.15.96:0/3551846511 shutdown_connections 2022-02-02T19:52:18.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 --2- 172.21.15.96:0/3551846511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca00f6b30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 --2- 172.21.15.96:0/3551846511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ca00f5430 0x7f1ca00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 -- 172.21.15.96:0/3551846511 >> 172.21.15.96:0/3551846511 conn(0x7f1ca00f0b90 msgr2=0x7f1ca00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 -- 172.21.15.96:0/3551846511 shutdown_connections 2022-02-02T19:52:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.090+0000 7f1ca4992700 1 -- 172.21.15.96:0/3551846511 wait complete. 2022-02-02T19:52:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 Processor -- start 2022-02-02T19:52:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 -- start start 2022-02-02T19:52:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ca00f5430 0x7f1ca0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0107870 con 0x7f1ca00f66d0 2022-02-02T19:52:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1ca4992700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01080b0 con 0x7f1ca00f5430 2022-02-02T19:52:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1c9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1c9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33920/0 (socket says 172.21.15.96:33920) 2022-02-02T19:52:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.091+0000 7f1c9e59c700 1 -- 172.21.15.96:0/2666690384 learned_addr learned my addr 172.21.15.96:0/2666690384 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c9e59c700 1 -- 172.21.15.96:0/2666690384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ca00f5430 msgr2=0x7f1ca0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c9e59c700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ca00f5430 0x7f1ca0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:52:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c9e59c700 1 -- 172.21.15.96:0/2666690384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94005040 con 0x7f1ca00f66d0 2022-02-02T19:52:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c9e59c700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f1c94009990 tx=0x7f1c94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c94018070 con 0x7f1ca00f66d0 2022-02-02T19:52:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c94007ca0 con 0x7f1ca00f66d0 2022-02-02T19:52:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca0108330 con 0x7f1ca00f66d0 2022-02-02T19:52:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9401c620 con 0x7f1ca00f66d0 2022-02-02T19:52:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.092+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca0108810 con 0x7f1ca00f66d0 2022-02-02T19:52:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.093+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca0059100 con 0x7f1ca00f66d0 2022-02-02T19:52:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.094+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c9401d960 con 0x7f1ca00f66d0 2022-02-02T19:52:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.094+0000 7f1c877fe700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 0x7f1c880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.094+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c940837d0 con 0x7f1ca00f66d0 2022-02-02T19:52:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.094+0000 7f1c9ed9d700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 0x7f1c880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.094+0000 7f1c9ed9d700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 0x7f1c880672e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f1ca0107b40 tx=0x7f1c90007a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.098+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c94051a40 con 0x7f1ca00f66d0 2022-02-02T19:52:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.328+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ca010d2f0 con 0x7f1ca00f66d0 2022-02-02T19:52:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.328+0000 7f1c877fe700 1 -- 172.21.15.96:0/2666690384 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1c94055060 con 0x7f1ca00f66d0 2022-02-02T19:52:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:52:18.332 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:52:18.332 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:52:18.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:18.333 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:52:18.333 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:52:18.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:18.333 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:52:18.334 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:52:18.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:18.334 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:52:18.334 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:52:18.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:18.335 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:52:18.335 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:52:18.335 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:52:18.335 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:52:18.336 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:52:18.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 msgr2=0x7f1c880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 0x7f1c880672e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f1ca0107b40 tx=0x7f1c90007a60).stop 2022-02-02T19:52:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 msgr2=0x7f1ca0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f1c94009990 tx=0x7f1c94009b30).stop 2022-02-02T19:52:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 shutdown_connections 2022-02-02T19:52:18.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c88064e20 0x7f1c880672e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ca00f5430 0x7f1ca0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:52:18.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 --2- 172.21.15.96:0/2666690384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca00f66d0 0x7f1ca0107270 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 >> 172.21.15.96:0/2666690384 conn(0x7f1ca00f0b90 msgr2=0x7f1ca005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:18.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 shutdown_connections 2022-02-02T19:52:18.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.330+0000 7f1ca4992700 1 -- 172.21.15.96:0/2666690384 wait complete. 2022-02-02T19:52:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2687401774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 msgr2=0x7fa0880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2687401774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa0880f6b00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7fa078004660 tx=0x7fa078009b30).stop 2022-02-02T19:52:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2687401774 shutdown_connections 2022-02-02T19:52:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2687401774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 0x7fa0880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2687401774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa0880f6b00 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2687401774 >> 172.21.15.96:0/2687401774 conn(0x7fa0880f1e40 msgr2=0x7fa0880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:18.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2687401774 shutdown_connections 2022-02-02T19:52:18.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2687401774 wait complete. 2022-02-02T19:52:18.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.427+0000 7fa08e5c0700 1 Processor -- start 2022-02-02T19:52:18.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa08e5c0700 1 -- start start 2022-02-02T19:52:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa08e5c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa08e5c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 0x7fa088107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa08e5c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088107a00 con 0x7fa0880f66e0 2022-02-02T19:52:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa08e5c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088107b40 con 0x7fa0880f7980 2022-02-02T19:52:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33928/0 (socket says 172.21.15.96:33928) 2022-02-02T19:52:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 -- 172.21.15.96:0/2193733186 learned_addr learned my addr 172.21.15.96:0/2193733186 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa0877fe700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 0x7fa088107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 -- 172.21.15.96:0/2193733186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 msgr2=0x7fa088107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 0x7fa088107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 -- 172.21.15.96:0/2193733186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078005040 con 0x7fa0880f66e0 2022-02-02T19:52:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.428+0000 7fa087fff700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fa078013a70 tx=0x7fa078009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.429+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa078018070 con 0x7fa0880f66e0 2022-02-02T19:52:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.429+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088108480 con 0x7fa0880f66e0 2022-02-02T19:52:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.429+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0881089e0 con 0x7fa0880f66e0 2022-02-02T19:52:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.429+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0780097d0 con 0x7fa0880f66e0 2022-02-02T19:52:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.429+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07801de80 con 0x7fa0880f66e0 2022-02-02T19:52:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.430+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c004fa0 con 0x7fa0880f66e0 2022-02-02T19:52:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.430+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa078007ba0 con 0x7fa0880f66e0 2022-02-02T19:52:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.430+0000 7fa084ff9700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 0x7fa074067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.430+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa078083550 con 0x7fa0880f66e0 2022-02-02T19:52:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.430+0000 7fa0877fe700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 0x7fa074067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.431+0000 7fa0877fe700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 0x7fa074067290 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fa070004ce0 tx=0x7fa07000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.434+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa078055080 con 0x7fa0880f66e0 2022-02-02T19:52:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.638+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa06c005e80 con 0x7fa0880f66e0 2022-02-02T19:52:18.642 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:18 smithi096 ceph-mon[101353]: from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:18.642 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:18 smithi096 ceph-mon[101353]: from='client.36890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:18.642 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2666690384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:52:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.638+0000 7fa084ff9700 1 -- 172.21.15.96:0/2193733186 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa078054c70 con 0x7fa0880f66e0 2022-02-02T19:52:18.643 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:52:18.644 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:52:18.644 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:52:18.644 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:52:18.644 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:18.645 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:52:18.645 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:52:18.645 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:52:18.646 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:52:18.646 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:52:18.646 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:52:18.646 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:52:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:52:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:52:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:52:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:52:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:52:18.648 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:52:18.648 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:52:18.648 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:52:18.648 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:52:18.649 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:52:18.649 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:52:18.649 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:52:18.649 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:52:18.649 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:52:18.650 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:52:18.650 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:52:18.650 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:52:18.650 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:52:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:52:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:52:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:52:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:18.652 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:18.652 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:18.652 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 msgr2=0x7fa074067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 0x7fa074067290 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fa070004ce0 tx=0x7fa07000b040).stop 2022-02-02T19:52:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 msgr2=0x7fa088106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fa078013a70 tx=0x7fa078009b30).stop 2022-02-02T19:52:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 shutdown_connections 2022-02-02T19:52:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa074064dd0 0x7fa074067290 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0880f66e0 0x7fa088106f60 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 --2- 172.21.15.96:0/2193733186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0880f7980 0x7fa088107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 >> 172.21.15.96:0/2193733186 conn(0x7fa0880f1e40 msgr2=0x7fa0880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 shutdown_connections 2022-02-02T19:52:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:18.641+0000 7fa08e5c0700 1 -- 172.21.15.96:0/2193733186 wait complete. 2022-02-02T19:52:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:52:18.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:18 smithi159 ceph-mon[69013]: from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:18.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:18 smithi159 ceph-mon[69013]: from='client.36890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:18.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2666690384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:52:19.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:19 smithi159 ceph-mon[69013]: pgmap v2707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:19.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2193733186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:52:19.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:19 smithi096 ceph-mon[101353]: pgmap v2707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:19.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2193733186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:52:22.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:22 smithi159 ceph-mon[69013]: pgmap v2708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:22 smithi096 ceph-mon[101353]: pgmap v2708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:24 smithi159 ceph-mon[69013]: pgmap v2709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:24 smithi096 ceph-mon[101353]: pgmap v2709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:26 smithi159 ceph-mon[69013]: pgmap v2710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:26 smithi096 ceph-mon[101353]: pgmap v2710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:28 smithi159 ceph-mon[69013]: pgmap v2711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:52:28.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:52:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:28 smithi096 ceph-mon[101353]: pgmap v2711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:52:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:52:30.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:30 smithi159 ceph-mon[69013]: pgmap v2712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:30 smithi096 ceph-mon[101353]: pgmap v2712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:32.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:32 smithi159 ceph-mon[69013]: pgmap v2713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:32 smithi096 ceph-mon[101353]: pgmap v2713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:34 smithi159 ceph-mon[69013]: pgmap v2714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:34.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:34 smithi096 ceph-mon[101353]: pgmap v2714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:36.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:36 smithi096 ceph-mon[101353]: pgmap v2715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:36 smithi159 ceph-mon[69013]: pgmap v2715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:38 smithi096 ceph-mon[101353]: pgmap v2716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:38 smithi159 ceph-mon[69013]: pgmap v2716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:40 smithi096 ceph-mon[101353]: pgmap v2717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:40.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:40 smithi159 ceph-mon[69013]: pgmap v2717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:42 smithi096 ceph-mon[101353]: pgmap v2718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:42 smithi159 ceph-mon[69013]: pgmap v2718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:43 smithi096 ceph-mon[101353]: pgmap v2719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:43 smithi159 ceph-mon[69013]: pgmap v2719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:46.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:45 smithi159 ceph-mon[69013]: pgmap v2720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:45 smithi096 ceph-mon[101353]: pgmap v2720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:48.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:48 smithi159 ceph-mon[69013]: pgmap v2721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:48 smithi096 ceph-mon[101353]: pgmap v2721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:48.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.751+0000 7ff6d9bec700 1 -- 172.21.15.96:0/1461800860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 msgr2=0x7ff6d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:48.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.751+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/1461800860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d40f7de0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7ff6c8004660 tx=0x7ff6c8009b30).stop 2022-02-02T19:52:48.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 -- 172.21.15.96:0/1461800860 shutdown_connections 2022-02-02T19:52:48.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/1461800860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d40f7de0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/1461800860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 0x7ff6d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 -- 172.21.15.96:0/1461800860 >> 172.21.15.96:0/1461800860 conn(0x7ff6d40f1e40 msgr2=0x7ff6d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:48.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 -- 172.21.15.96:0/1461800860 shutdown_connections 2022-02-02T19:52:48.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 -- 172.21.15.96:0/1461800860 wait complete. 2022-02-02T19:52:48.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.752+0000 7ff6d9bec700 1 Processor -- start 2022-02-02T19:52:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d9bec700 1 -- start start 2022-02-02T19:52:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d9bec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 0x7ff6d4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d9bec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d9bec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d41079b0 con 0x7ff6d40f7980 2022-02-02T19:52:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d9bec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4107af0 con 0x7ff6d40f66e0 2022-02-02T19:52:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33946/0 (socket says 172.21.15.96:33946) 2022-02-02T19:52:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 -- 172.21.15.96:0/535203258 learned_addr learned my addr 172.21.15.96:0/535203258 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d37fe700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 0x7ff6d4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:48.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 -- 172.21.15.96:0/535203258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 msgr2=0x7ff6d4106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:48.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 0x7ff6d4106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.753+0000 7ff6d2ffd700 1 -- 172.21.15.96:0/535203258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8005040 con 0x7ff6d40f7980 2022-02-02T19:52:48.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6d2ffd700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ff6c8009990 tx=0x7ff6c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:48.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c8018070 con 0x7ff6d40f7980 2022-02-02T19:52:48.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4108430 con 0x7ff6d40f7980 2022-02-02T19:52:48.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6c8007ba0 con 0x7ff6d40f7980 2022-02-02T19:52:48.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c801c3c0 con 0x7ff6d40f7980 2022-02-02T19:52:48.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.754+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4108990 con 0x7ff6d40f7980 2022-02-02T19:52:48.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.755+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4045ad0 con 0x7ff6d40f7980 2022-02-02T19:52:48.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.755+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff6c801d420 con 0x7ff6d40f7980 2022-02-02T19:52:48.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.755+0000 7ff6bbfff700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 0x7ff6bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:48.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.756+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff6c80836a0 con 0x7ff6d40f7980 2022-02-02T19:52:48.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.756+0000 7ff6d37fe700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 0x7ff6bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:48.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.756+0000 7ff6d37fe700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 0x7ff6bc067290 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ff6d40f77e0 tx=0x7ff6c400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:48.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.760+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff6c8055290 con 0x7ff6d40f7980 2022-02-02T19:52:48.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.938+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d4108bb0 con 0x7ff6bc064dd0 2022-02-02T19:52:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.939+0000 7ff6bbfff700 1 -- 172.21.15.96:0/535203258 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff6d4108bb0 con 0x7ff6bc064dd0 2022-02-02T19:52:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 msgr2=0x7ff6bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 0x7ff6bc067290 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ff6d40f77e0 tx=0x7ff6c400b040).stop 2022-02-02T19:52:48.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 msgr2=0x7ff6d4107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:48.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ff6c8009990 tx=0x7ff6c8009b30).stop 2022-02-02T19:52:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 shutdown_connections 2022-02-02T19:52:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6bc064dd0 0x7ff6bc067290 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d40f66e0 0x7ff6d4106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 --2- 172.21.15.96:0/535203258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6d40f7980 0x7ff6d4107400 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.941+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 >> 172.21.15.96:0/535203258 conn(0x7ff6d40f1e40 msgr2=0x7ff6d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.942+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 shutdown_connections 2022-02-02T19:52:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:48.942+0000 7ff6d9bec700 1 -- 172.21.15.96:0/535203258 wait complete. 2022-02-02T19:52:48.955 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:52:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 -- 172.21.15.96:0/816708407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 msgr2=0x7f84d40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 --2- 172.21.15.96:0/816708407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d40f5850 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f84c4004660 tx=0x7f84c4009b30).stop 2022-02-02T19:52:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 -- 172.21.15.96:0/816708407 shutdown_connections 2022-02-02T19:52:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 --2- 172.21.15.96:0/816708407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f66d0 0x7f84d40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 --2- 172.21.15.96:0/816708407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d40f5850 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 -- 172.21.15.96:0/816708407 >> 172.21.15.96:0/816708407 conn(0x7f84d40f0b90 msgr2=0x7f84d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 -- 172.21.15.96:0/816708407 shutdown_connections 2022-02-02T19:52:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.039+0000 7f84d359e700 1 -- 172.21.15.96:0/816708407 wait complete. 2022-02-02T19:52:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 Processor -- start 2022-02-02T19:52:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 -- start start 2022-02-02T19:52:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f66d0 0x7f84d410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40603c0 con 0x7f84d40f5430 2022-02-02T19:52:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4060500 con 0x7f84d40f66d0 2022-02-02T19:52:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.040+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33954/0 (socket says 172.21.15.96:33954) 2022-02-02T19:52:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 -- 172.21.15.96:0/547655606 learned_addr learned my addr 172.21.15.96:0/547655606 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 -- 172.21.15.96:0/547655606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f66d0 msgr2=0x7f84d410bfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T19:52:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f66d0 0x7f84d410bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:52:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 -- 172.21.15.96:0/547655606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4005040 con 0x7f84d40f5430 2022-02-02T19:52:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d259c700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f84c4013a70 tx=0x7f84c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c4018070 con 0x7f84d40f5430 2022-02-02T19:52:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d410c500 con 0x7f84d40f5430 2022-02-02T19:52:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84c40097d0 con 0x7f84d40f5430 2022-02-02T19:52:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c401c3c0 con 0x7f84d40f5430 2022-02-02T19:52:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.041+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d410ca30 con 0x7f84d40f5430 2022-02-02T19:52:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.042+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8004fa0 con 0x7f84d40f5430 2022-02-02T19:52:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.042+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84c4007ba0 con 0x7f84d40f5430 2022-02-02T19:52:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.043+0000 7f84c2ffd700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 0x7f84bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.043+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84c40836b0 con 0x7f84d40f5430 2022-02-02T19:52:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.043+0000 7f84d1d9b700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 0x7f84bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.043+0000 7f84d1d9b700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 0x7f84bc0672e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f84c8004a10 tx=0x7f84c80099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.047+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84c4051870 con 0x7f84d40f5430 2022-02-02T19:52:49.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.220+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b8000bc0 con 0x7f84bc064e20 2022-02-02T19:52:49.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.230+0000 7f84c2ffd700 1 -- 172.21.15.96:0/547655606 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f84b8000bc0 con 0x7f84bc064e20 2022-02-02T19:52:49.233 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:52:49.234 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (96m) 66m ago 97m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:52:49.234 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (88m) 66m ago 97m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:52:49.234 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (88m) 65m ago 96m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:52:49.234 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (96m) 66m ago 97m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:52:49.235 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (93m) 66m ago 93m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:52:49.235 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (88m) 66m ago 93m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:52:49.235 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (93m) 65m ago 93m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:52:49.236 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (89m) 65m ago 93m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:52:49.236 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (90m) 66m ago 98m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:52:49.236 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (89m) 65m ago 96m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:52:49.236 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (89m) 66m ago 98m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:52:49.237 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (89m) 65m ago 96m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:52:49.237 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (97m) 66m ago 96m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:52:49.237 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (96m) 65m ago 96m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:52:49.237 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (88m) 66m ago 96m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:52:49.238 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (87m) 66m ago 95m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:52:49.238 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (87m) 66m ago 95m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:52:49.238 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (86m) 65m ago 95m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:52:49.238 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (86m) 65m ago 94m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:52:49.239 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (85m) 65m ago 94m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:52:49.239 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (95m) 66m ago 96m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:52:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 msgr2=0x7f84bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 0x7f84bc0672e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f84c8004a10 tx=0x7f84c80099e0).stop 2022-02-02T19:52:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 msgr2=0x7f84d4109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f84c4013a70 tx=0x7f84c4009b30).stop 2022-02-02T19:52:49.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 shutdown_connections 2022-02-02T19:52:49.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064e20 0x7f84bc0672e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f5430 0x7f84d4109ab0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 --2- 172.21.15.96:0/547655606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f66d0 0x7f84d410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:52:49.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 >> 172.21.15.96:0/547655606 conn(0x7f84d40f0b90 msgr2=0x7f84d40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 shutdown_connections 2022-02-02T19:52:49.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.232+0000 7f84d359e700 1 -- 172.21.15.96:0/547655606 wait complete. 2022-02-02T19:52:49.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 -- 172.21.15.96:0/2096367408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f55c0 msgr2=0x7f64d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 --2- 172.21.15.96:0/2096367408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f55c0 0x7f64d00f59e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f64c4004660 tx=0x7f64c4009b30).stop 2022-02-02T19:52:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 -- 172.21.15.96:0/2096367408 shutdown_connections 2022-02-02T19:52:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 --2- 172.21.15.96:0/2096367408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f6860 0x7f64d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 --2- 172.21.15.96:0/2096367408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f55c0 0x7f64d00f59e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 -- 172.21.15.96:0/2096367408 >> 172.21.15.96:0/2096367408 conn(0x7f64d00f0d40 msgr2=0x7f64d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 -- 172.21.15.96:0/2096367408 shutdown_connections 2022-02-02T19:52:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.328+0000 7f64d48a4700 1 -- 172.21.15.96:0/2096367408 wait complete. 2022-02-02T19:52:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 Processor -- start 2022-02-02T19:52:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 -- start start 2022-02-02T19:52:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 0x7f64d010c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00602b0 con 0x7f64d00f6860 2022-02-02T19:52:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64d48a4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00603f0 con 0x7f64d00f55c0 2022-02-02T19:52:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33964/0 (socket says 172.21.15.96:33964) 2022-02-02T19:52:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 -- 172.21.15.96:0/3652075558 learned_addr learned my addr 172.21.15.96:0/3652075558 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64ce59c700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 0x7f64d010c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 -- 172.21.15.96:0/3652075558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 msgr2=0x7f64d010c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 0x7f64d010c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 -- 172.21.15.96:0/3652075558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4005040 con 0x7f64d00f6860 2022-02-02T19:52:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64ce59c700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 0x7f64d010c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:52:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.329+0000 7f64cdd9b700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f64c000c530 tx=0x7f64c0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.330+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c000f650 con 0x7f64d00f6860 2022-02-02T19:52:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.330+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64c000fc60 con 0x7f64d00f6860 2022-02-02T19:52:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.330+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d010ea10 con 0x7f64d00f6860 2022-02-02T19:52:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.330+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c0012cd0 con 0x7f64d00f6860 2022-02-02T19:52:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.330+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d010ee90 con 0x7f64d00f6860 2022-02-02T19:52:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.331+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d0045ad0 con 0x7f64d00f6860 2022-02-02T19:52:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.331+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f64c0010070 con 0x7f64d00f6860 2022-02-02T19:52:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.331+0000 7f64beffd700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 0x7f64b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.332+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64c0081780 con 0x7f64d00f6860 2022-02-02T19:52:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.332+0000 7f64ce59c700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 0x7f64b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.332+0000 7f64ce59c700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 0x7f64b8067290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f64c4004e30 tx=0x7f64c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.336+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f64c004f880 con 0x7f64d00f6860 2022-02-02T19:52:49.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.566+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64d00586e0 con 0x7f64d00f6860 2022-02-02T19:52:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.567+0000 7f64beffd700 1 -- 172.21.15.96:0/3652075558 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f64c0052ea0 con 0x7f64d00f6860 2022-02-02T19:52:49.571 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:52:49.571 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:52:49.571 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:52:49.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:49.572 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:52:49.572 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:52:49.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:49.572 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:52:49.573 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:52:49.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:49.573 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:52:49.573 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:52:49.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:52:49.574 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:52:49.574 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:52:49.574 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:52:49.574 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:52:49.575 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:52:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 msgr2=0x7f64b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 0x7f64b8067290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f64c4004e30 tx=0x7f64c4009b30).stop 2022-02-02T19:52:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 msgr2=0x7f64d010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f64c000c530 tx=0x7f64c0007e20).stop 2022-02-02T19:52:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 shutdown_connections 2022-02-02T19:52:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64b8064dd0 0x7f64b8067290 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64d00f55c0 0x7f64d010c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 --2- 172.21.15.96:0/3652075558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64d00f6860 0x7f64d010e520 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 >> 172.21.15.96:0/3652075558 conn(0x7f64d00f0d40 msgr2=0x7f64d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 shutdown_connections 2022-02-02T19:52:49.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.569+0000 7f64d48a4700 1 -- 172.21.15.96:0/3652075558 wait complete. 2022-02-02T19:52:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 -- 172.21.15.96:0/1493401605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 msgr2=0x7fb7800f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 --2- 172.21.15.96:0/1493401605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb7800f6b00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fb77c004660 tx=0x7fb77c009b30).stop 2022-02-02T19:52:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 -- 172.21.15.96:0/1493401605 shutdown_connections 2022-02-02T19:52:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 --2- 172.21.15.96:0/1493401605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb7800f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:52:49.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 --2- 172.21.15.96:0/1493401605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb7800f6b00 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 -- 172.21.15.96:0/1493401605 >> 172.21.15.96:0/1493401605 conn(0x7fb7800f1e40 msgr2=0x7fb7800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 -- 172.21.15.96:0/1493401605 shutdown_connections 2022-02-02T19:52:49.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.666+0000 7fb787510700 1 -- 172.21.15.96:0/1493401605 wait complete. 2022-02-02T19:52:49.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 Processor -- start 2022-02-02T19:52:49.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 -- start start 2022-02-02T19:52:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb780069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78006a410 con 0x7fb7800f66e0 2022-02-02T19:52:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb787510700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78006a550 con 0x7fb7800f7980 2022-02-02T19:52:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33970/0 (socket says 172.21.15.96:33970) 2022-02-02T19:52:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 -- 172.21.15.96:0/2865022870 learned_addr learned my addr 172.21.15.96:0/2865022870 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:52:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb784aab700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb780069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 -- 172.21.15.96:0/2865022870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 msgr2=0x7fb780069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb780069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 -- 172.21.15.96:0/2865022870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c005040 con 0x7fb7800f66e0 2022-02-02T19:52:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb784aab700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb780069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:52:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb7852ac700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fb77c000c00 tx=0x7fb77c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.667+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c018070 con 0x7fb7800f66e0 2022-02-02T19:52:49.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.668+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb77c007d70 con 0x7fb7800f66e0 2022-02-02T19:52:49.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.668+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78006a7d0 con 0x7fb7800f66e0 2022-02-02T19:52:49.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.668+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c01c620 con 0x7fb7800f66e0 2022-02-02T19:52:49.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.668+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78010efe0 con 0x7fb7800f66e0 2022-02-02T19:52:49.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.669+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb760004fa0 con 0x7fb7800f66e0 2022-02-02T19:52:49.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.669+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb77c01c860 con 0x7fb7800f66e0 2022-02-02T19:52:49.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.670+0000 7fb775ffb700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 0x7fb76c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:52:49.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.670+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb77c083840 con 0x7fb7800f66e0 2022-02-02T19:52:49.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.670+0000 7fb784aab700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 0x7fb76c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:52:49.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.670+0000 7fb784aab700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 0x7fb76c067270 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb77000a880 tx=0x7fb770008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:52:49.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.674+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb77c051940 con 0x7fb7800f66e0 2022-02-02T19:52:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.877+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb760005e80 con 0x7fb7800f66e0 2022-02-02T19:52:49.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.878+0000 7fb775ffb700 1 -- 172.21.15.96:0/2865022870 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb77c054f60 con 0x7fb7800f66e0 2022-02-02T19:52:49.882 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:52:49.882 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:52:49.883 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:52:49.883 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:52:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:49.883 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:52:49.884 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:52:49.884 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:52:49.884 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:52:49.885 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:52:49.885 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:52:49.885 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:52:49.885 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:52:49.886 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:52:49.886 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:52:49.886 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:52:49.887 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:52:49.887 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:52:49.887 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:52:49.888 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:52:49.888 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:52:49.888 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:52:49.889 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:52:49.889 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:52:49.889 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:52:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:52:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:52:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:52:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:52:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:52:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:52:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:52:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:49.893 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:52:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:52:49.894 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:49.894 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:49.894 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:52:49.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 msgr2=0x7fb76c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 0x7fb76c067270 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb77000a880 tx=0x7fb770008040).stop 2022-02-02T19:52:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 msgr2=0x7fb78006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:52:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fb77c000c00 tx=0x7fb77c009b30).stop 2022-02-02T19:52:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 shutdown_connections 2022-02-02T19:52:49.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb76c064db0 0x7fb76c067270 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7800f66e0 0x7fb78006b9a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 --2- 172.21.15.96:0/2865022870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7800f7980 0x7fb780069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:52:49.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 >> 172.21.15.96:0/2865022870 conn(0x7fb7800f1e40 msgr2=0x7fb7800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:52:49.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 shutdown_connections 2022-02-02T19:52:49.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:52:49.880+0000 7fb787510700 1 -- 172.21.15.96:0/2865022870 wait complete. 2022-02-02T19:52:49.900 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:52:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:50 smithi159 ceph-mon[69013]: pgmap v2722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:50 smithi159 ceph-mon[69013]: from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:50.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:50 smithi159 ceph-mon[69013]: from='client.36906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3652075558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:52:50.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2865022870' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:52:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:50 smithi096 ceph-mon[101353]: pgmap v2722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:50 smithi096 ceph-mon[101353]: from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:50 smithi096 ceph-mon[101353]: from='client.36906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:52:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3652075558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:52:50.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2865022870' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:52:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:52 smithi159 ceph-mon[69013]: pgmap v2723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:52 smithi096 ceph-mon[101353]: pgmap v2723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:54.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:54 smithi159 ceph-mon[69013]: pgmap v2724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:54 smithi096 ceph-mon[101353]: pgmap v2724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:56.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:56 smithi159 ceph-mon[69013]: pgmap v2725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:56.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:56 smithi096 ceph-mon[101353]: pgmap v2725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:52:58 smithi096 ceph-mon[101353]: pgmap v2726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:52:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:52:58 smithi159 ceph-mon[69013]: pgmap v2726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:00 smithi096 ceph-mon[101353]: pgmap v2727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:00.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:00 smithi159 ceph-mon[69013]: pgmap v2727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:02 smithi096 ceph-mon[101353]: pgmap v2728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:02 smithi159 ceph-mon[69013]: pgmap v2728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:04 smithi096 ceph-mon[101353]: pgmap v2729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:04 smithi159 ceph-mon[69013]: pgmap v2729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:06 smithi096 ceph-mon[101353]: pgmap v2730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:06 smithi159 ceph-mon[69013]: pgmap v2730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:07 smithi159 ceph-mon[69013]: pgmap v2731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:07 smithi096 ceph-mon[101353]: pgmap v2731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:10.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:09 smithi159 ceph-mon[69013]: pgmap v2732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:10.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:09 smithi096 ceph-mon[101353]: pgmap v2732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:12 smithi159 ceph-mon[69013]: pgmap v2733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:12.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:12 smithi096 ceph-mon[101353]: pgmap v2733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:14.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:14 smithi159 ceph-mon[69013]: pgmap v2734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:14 smithi096 ceph-mon[101353]: pgmap v2734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:16.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:16 smithi159 ceph-mon[69013]: pgmap v2735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:16.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:16 smithi096 ceph-mon[101353]: pgmap v2735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:18 smithi159 ceph-mon[69013]: pgmap v2736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:18.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:18 smithi096 ceph-mon[101353]: pgmap v2736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:19.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.988+0000 7f43c515a700 1 -- 172.21.15.96:0/1871700634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f5430 msgr2=0x7f43c00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:19.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.988+0000 7f43c515a700 1 --2- 172.21.15.96:0/1871700634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f5430 0x7f43c00f5850 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f43b4004660 tx=0x7f43b4009b30).stop 2022-02-02T19:53:19.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 -- 172.21.15.96:0/1871700634 shutdown_connections 2022-02-02T19:53:19.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 --2- 172.21.15.96:0/1871700634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f66d0 0x7f43c00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:19.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 --2- 172.21.15.96:0/1871700634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f5430 0x7f43c00f5850 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:19.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 -- 172.21.15.96:0/1871700634 >> 172.21.15.96:0/1871700634 conn(0x7f43c00f0b90 msgr2=0x7f43c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:19.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 -- 172.21.15.96:0/1871700634 shutdown_connections 2022-02-02T19:53:19.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 -- 172.21.15.96:0/1871700634 wait complete. 2022-02-02T19:53:19.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.989+0000 7f43c515a700 1 Processor -- start 2022-02-02T19:53:19.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43c515a700 1 -- start start 2022-02-02T19:53:19.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43c515a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f5430 0x7f43c0109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:19.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43c515a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:19.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43c515a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00603c0 con 0x7f43c00f66d0 2022-02-02T19:53:19.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43c515a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0060500 con 0x7f43c00f5430 2022-02-02T19:53:19.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:19.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33990/0 (socket says 172.21.15.96:33990) 2022-02-02T19:53:20.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 -- 172.21.15.96:0/3393119366 learned_addr learned my addr 172.21.15.96:0/3393119366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:20.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bffff700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f5430 0x7f43c0109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 -- 172.21.15.96:0/3393119366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f5430 msgr2=0x7f43c0109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f5430 0x7f43c0109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.990+0000 7f43bf7fe700 1 -- 172.21.15.96:0/3393119366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4005040 con 0x7f43c00f66d0 2022-02-02T19:53:20.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43bf7fe700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f43b00026d0 tx=0x7f43b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b0009320 con 0x7f43c00f66d0 2022-02-02T19:53:20.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f43b000f040 con 0x7f43c00f66d0 2022-02-02T19:53:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c010c560 con 0x7f43c00f66d0 2022-02-02T19:53:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b00147e0 con 0x7f43c00f66d0 2022-02-02T19:53:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.991+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c010caf0 con 0x7f43c00f66d0 2022-02-02T19:53:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.992+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c0059100 con 0x7f43c00f66d0 2022-02-02T19:53:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.992+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f43b0009480 con 0x7f43c00f66d0 2022-02-02T19:53:20.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.993+0000 7f43bcff9700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 0x7f43a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.993+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f43b0082120 con 0x7f43c00f66d0 2022-02-02T19:53:20.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.993+0000 7f43bffff700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 0x7f43a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.993+0000 7f43bffff700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 0x7f43a80672e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f43b4004e30 tx=0x7f43b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:19.997+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f43b0050220 con 0x7f43c00f66d0 2022-02-02T19:53:20.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.176+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c00fdd70 con 0x7f43a8064e20 2022-02-02T19:53:20.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.177+0000 7f43bcff9700 1 -- 172.21.15.96:0/3393119366 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f43c00fdd70 con 0x7f43a8064e20 2022-02-02T19:53:20.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 msgr2=0x7f43a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 0x7f43a80672e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f43b4004e30 tx=0x7f43b4009b30).stop 2022-02-02T19:53:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 msgr2=0x7f43c010bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f43b00026d0 tx=0x7f43b0009de0).stop 2022-02-02T19:53:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 shutdown_connections 2022-02-02T19:53:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43a8064e20 0x7f43a80672e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43c00f5430 0x7f43c0109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 --2- 172.21.15.96:0/3393119366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43c00f66d0 0x7f43c010bfb0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 >> 172.21.15.96:0/3393119366 conn(0x7f43c00f0b90 msgr2=0x7f43c00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 shutdown_connections 2022-02-02T19:53:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.179+0000 7f43c515a700 1 -- 172.21.15.96:0/3393119366 wait complete. 2022-02-02T19:53:20.193 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:53:20.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 -- 172.21.15.96:0/757442886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f66d0 msgr2=0x7f7cc00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 --2- 172.21.15.96:0/757442886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f66d0 0x7f7cc00f6b30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f7cb4004660 tx=0x7f7cb4009b30).stop 2022-02-02T19:53:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 -- 172.21.15.96:0/757442886 shutdown_connections 2022-02-02T19:53:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 --2- 172.21.15.96:0/757442886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f66d0 0x7f7cc00f6b30 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 --2- 172.21.15.96:0/757442886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f5430 0x7f7cc00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 -- 172.21.15.96:0/757442886 >> 172.21.15.96:0/757442886 conn(0x7f7cc00f0b90 msgr2=0x7f7cc00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.276+0000 7f7cc545c700 1 -- 172.21.15.96:0/757442886 shutdown_connections 2022-02-02T19:53:20.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.277+0000 7f7cc545c700 1 -- 172.21.15.96:0/757442886 wait complete. 2022-02-02T19:53:20.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.277+0000 7f7cc545c700 1 Processor -- start 2022-02-02T19:53:20.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.277+0000 7f7cc545c700 1 -- start start 2022-02-02T19:53:20.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.277+0000 7f7cc545c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.277+0000 7f7cc545c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f66d0 0x7f7cc010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cc545c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00603e0 con 0x7f7cc00f5430 2022-02-02T19:53:20.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cc545c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0060520 con 0x7f7cc00f66d0 2022-02-02T19:53:20.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33998/0 (socket says 172.21.15.96:33998) 2022-02-02T19:53:20.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 -- 172.21.15.96:0/782355354 learned_addr learned my addr 172.21.15.96:0/782355354 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:20.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbf7fe700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f66d0 0x7f7cc010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 -- 172.21.15.96:0/782355354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f66d0 msgr2=0x7f7cc010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f66d0 0x7f7cc010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 -- 172.21.15.96:0/782355354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4005040 con 0x7f7cc00f5430 2022-02-02T19:53:20.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbffff700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f7cb0002700 tx=0x7f7cb0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb00079c0 con 0x7f7cc00f5430 2022-02-02T19:53:20.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cb000f040 con 0x7f7cc00f5430 2022-02-02T19:53:20.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc010c4d0 con 0x7f7cc00f5430 2022-02-02T19:53:20.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb0014860 con 0x7f7cc00f5430 2022-02-02T19:53:20.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.278+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc010ca90 con 0x7f7cc00f5430 2022-02-02T19:53:20.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.279+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0045ad0 con 0x7f7cc00f5430 2022-02-02T19:53:20.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.280+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cb001b060 con 0x7f7cc00f5430 2022-02-02T19:53:20.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.280+0000 7f7cbcff9700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.280+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7cb0081900 con 0x7f7cc00f5430 2022-02-02T19:53:20.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.280+0000 7f7cbf7fe700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.281+0000 7f7cbf7fe700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7cb4004e30 tx=0x7f7cb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.284+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cb004fa00 con 0x7f7cc00f5430 2022-02-02T19:53:20.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.457+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc00fdd60 con 0x7f7ca8064e20 2022-02-02T19:53:20.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.467+0000 7f7cbcff9700 1 -- 172.21.15.96:0/782355354 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7cc00fdd60 con 0x7f7ca8064e20 2022-02-02T19:53:20.471 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:53:20.471 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (96m) 67m ago 97m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:53:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (89m) 67m ago 97m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:53:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (89m) 65m ago 97m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:53:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (96m) 67m ago 97m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:53:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (93m) 67m ago 93m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:53:20.473 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (89m) 67m ago 93m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:53:20.473 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (93m) 65m ago 93m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:53:20.473 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (89m) 65m ago 93m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:53:20.473 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (90m) 67m ago 98m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:53:20.473 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (90m) 65m ago 97m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:53:20.474 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (90m) 67m ago 99m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:53:20.474 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (89m) 65m ago 97m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:53:20.474 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (97m) 67m ago 97m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:53:20.474 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (97m) 65m ago 97m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:53:20.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (88m) 67m ago 96m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:53:20.475 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (88m) 67m ago 96m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:53:20.475 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (87m) 67m ago 95m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:53:20.475 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (87m) 65m ago 95m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:53:20.475 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (86m) 65m ago 95m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:53:20.476 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (86m) 65m ago 95m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:53:20.476 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (96m) 67m ago 97m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:53:20.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 msgr2=0x7f7ca80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7cb4004e30 tx=0x7f7cb4009b30).stop 2022-02-02T19:53:20.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 msgr2=0x7f7cc0109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f7cb0002700 tx=0x7f7cb0009d80).stop 2022-02-02T19:53:20.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 shutdown_connections 2022-02-02T19:53:20.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cc00f5430 0x7f7cc0109a20 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 --2- 172.21.15.96:0/782355354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc00f66d0 0x7f7cc010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 >> 172.21.15.96:0/782355354 conn(0x7f7cc00f0b90 msgr2=0x7f7cc00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.469+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 shutdown_connections 2022-02-02T19:53:20.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.470+0000 7f7cc545c700 1 -- 172.21.15.96:0/782355354 wait complete. 2022-02-02T19:53:20.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:20 smithi096 ceph-mon[101353]: pgmap v2737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:20.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 -- 172.21.15.96:0/3110786006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f66d0 msgr2=0x7f61740f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 --2- 172.21.15.96:0/3110786006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f66d0 0x7f61740f6b30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f6164004660 tx=0x7f6164009b30).stop 2022-02-02T19:53:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 -- 172.21.15.96:0/3110786006 shutdown_connections 2022-02-02T19:53:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 --2- 172.21.15.96:0/3110786006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f66d0 0x7f61740f6b30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 --2- 172.21.15.96:0/3110786006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f5430 0x7f61740f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 -- 172.21.15.96:0/3110786006 >> 172.21.15.96:0/3110786006 conn(0x7f61740f0b90 msgr2=0x7f61740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 -- 172.21.15.96:0/3110786006 shutdown_connections 2022-02-02T19:53:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.568+0000 7f617a940700 1 -- 172.21.15.96:0/3110786006 wait complete. 2022-02-02T19:53:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 Processor -- start 2022-02-02T19:53:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 -- start start 2022-02-02T19:53:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f66d0 0x7f6174109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61741099e0 con 0x7f61740f5430 2022-02-02T19:53:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617a940700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6174109b20 con 0x7f61740f66d0 2022-02-02T19:53:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617993e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617993e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34008/0 (socket says 172.21.15.96:34008) 2022-02-02T19:53:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.569+0000 7f617993e700 1 -- 172.21.15.96:0/1787178674 learned_addr learned my addr 172.21.15.96:0/1787178674 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617913d700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f66d0 0x7f6174109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617993e700 1 -- 172.21.15.96:0/1787178674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f66d0 msgr2=0x7f6174109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617993e700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f66d0 0x7f6174109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617993e700 1 -- 172.21.15.96:0/1787178674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164005040 con 0x7f61740f5430 2022-02-02T19:53:20.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617993e700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f6170002700 tx=0x7f6170009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6170009320 con 0x7f61740f5430 2022-02-02T19:53:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617410a4c0 con 0x7f61740f5430 2022-02-02T19:53:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f617000f040 con 0x7f61740f5430 2022-02-02T19:53:20.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617410aa80 con 0x7f61740f5430 2022-02-02T19:53:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.570+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6170014900 con 0x7f61740f5430 2022-02-02T19:53:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.571+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c004fa0 con 0x7f61740f5430 2022-02-02T19:53:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.571+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6170009480 con 0x7f61740f5430 2022-02-02T19:53:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.572+0000 7f616a7fc700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 0x7f61600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.572+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6170081ba0 con 0x7f61740f5430 2022-02-02T19:53:20.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.572+0000 7f617913d700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 0x7f61600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.572+0000 7f617913d700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 0x7f61600672e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f6164004630 tx=0x7f6164009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.576+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6170053790 con 0x7f61740f5430 2022-02-02T19:53:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:20 smithi159 ceph-mon[69013]: pgmap v2737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:20.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.807+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f615c005e80 con 0x7f61740f5430 2022-02-02T19:53:20.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.808+0000 7f616a7fc700 1 -- 172.21.15.96:0/1787178674 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6170053380 con 0x7f61740f5430 2022-02-02T19:53:20.813 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:53:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:53:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:53:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:53:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:53:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:53:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:53:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:53:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:53:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:53:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:53:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:53:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:53:20.817 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:53:20.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 msgr2=0x7f61600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 0x7f61600672e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f6164004630 tx=0x7f6164009b30).stop 2022-02-02T19:53:20.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 msgr2=0x7f6174108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f6170002700 tx=0x7f6170009d80).stop 2022-02-02T19:53:20.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 shutdown_connections 2022-02-02T19:53:20.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6160064e20 0x7f61600672e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61740f5430 0x7f6174108f40 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 --2- 172.21.15.96:0/1787178674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61740f66d0 0x7f6174109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 >> 172.21.15.96:0/1787178674 conn(0x7f61740f0b90 msgr2=0x7f617405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 shutdown_connections 2022-02-02T19:53:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.810+0000 7f617a940700 1 -- 172.21.15.96:0/1787178674 wait complete. 2022-02-02T19:53:20.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 -- 172.21.15.96:0/124415044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f6540 msgr2=0x7fc3000f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 --2- 172.21.15.96:0/124415044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f6540 0x7fc3000f69c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fc2fc004660 tx=0x7fc2fc009b30).stop 2022-02-02T19:53:20.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 -- 172.21.15.96:0/124415044 shutdown_connections 2022-02-02T19:53:20.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 --2- 172.21.15.96:0/124415044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f6540 0x7fc3000f69c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 --2- 172.21.15.96:0/124415044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f5c30 0x7fc3000f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 -- 172.21.15.96:0/124415044 >> 172.21.15.96:0/124415044 conn(0x7fc3000f0540 msgr2=0x7fc3000f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:20.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 -- 172.21.15.96:0/124415044 shutdown_connections 2022-02-02T19:53:20.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.907+0000 7fc308077700 1 -- 172.21.15.96:0/124415044 wait complete. 2022-02-02T19:53:20.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 Processor -- start 2022-02-02T19:53:20.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 -- start start 2022-02-02T19:53:20.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f6540 0x7fc3000f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3000f8320 con 0x7fc3000f5c30 2022-02-02T19:53:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc308077700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3000f8460 con 0x7fc3000f6540 2022-02-02T19:53:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34018/0 (socket says 172.21.15.96:34018) 2022-02-02T19:53:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 -- 172.21.15.96:0/3927865126 learned_addr learned my addr 172.21.15.96:0/3927865126 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305612700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f6540 0x7fc3000f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 -- 172.21.15.96:0/3927865126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f6540 msgr2=0x7fc3000f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f6540 0x7fc3000f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.908+0000 7fc305e13700 1 -- 172.21.15.96:0/3927865126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc005040 con 0x7fc3000f5c30 2022-02-02T19:53:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc305e13700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fc2f00026d0 tx=0x7fc2f0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f00079c0 con 0x7fc3000f5c30 2022-02-02T19:53:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3000f8740 con 0x7fc3000f5c30 2022-02-02T19:53:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2f000f040 con 0x7fc3000f5c30 2022-02-02T19:53:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f00148b0 con 0x7fc3000f5c30 2022-02-02T19:53:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.909+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30010ef80 con 0x7fc3000f5c30 2022-02-02T19:53:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.910+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc300045ad0 con 0x7fc3000f5c30 2022-02-02T19:53:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.910+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2f0007b20 con 0x7fc3000f5c30 2022-02-02T19:53:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.911+0000 7fc2f67fc700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 0x7fc2ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.911+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2f0081990 con 0x7fc3000f5c30 2022-02-02T19:53:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.911+0000 7fc305612700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 0x7fc2ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.911+0000 7fc305612700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 0x7fc2ec067290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc2fc005010 tx=0x7fc2fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:20.915+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2f004fa90 con 0x7fc3000f5c30 2022-02-02T19:53:21.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.114+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc30010f6f0 con 0x7fc3000f5c30 2022-02-02T19:53:21.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.114+0000 7fc2f67fc700 1 -- 172.21.15.96:0/3927865126 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc2f00530b0 con 0x7fc3000f5c30 2022-02-02T19:53:21.120 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:53:21.120 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:53:21.120 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:53:21.121 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:53:21.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:21.121 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:53:21.121 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:53:21.121 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:53:21.122 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:53:21.122 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:53:21.122 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:53:21.122 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:53:21.123 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:53:21.123 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:53:21.123 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:53:21.123 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:53:21.123 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:53:21.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:53:21.124 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:53:21.124 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:53:21.124 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:53:21.125 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:53:21.125 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:53:21.125 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:53:21.125 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:53:21.126 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:53:21.126 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:53:21.126 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:53:21.126 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:53:21.126 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:53:21.127 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:53:21.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:53:21.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:21.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:21.127 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:53:21.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:21.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:21.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:21.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 msgr2=0x7fc2ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 0x7fc2ec067290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc2fc005010 tx=0x7fc2fc009b30).stop 2022-02-02T19:53:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 msgr2=0x7fc3000f9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fc2f00026d0 tx=0x7fc2f0009de0).stop 2022-02-02T19:53:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 shutdown_connections 2022-02-02T19:53:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064dd0 0x7fc2ec067290 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f5c30 0x7fc3000f9940 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 --2- 172.21.15.96:0/3927865126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f6540 0x7fc3000f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 >> 172.21.15.96:0/3927865126 conn(0x7fc3000f0540 msgr2=0x7fc3000f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.116+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 shutdown_connections 2022-02-02T19:53:21.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:21.117+0000 7fc308077700 1 -- 172.21.15.96:0/3927865126 wait complete. 2022-02-02T19:53:21.134 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:53:21.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:21 smithi096 ceph-mon[101353]: from='client.36918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:21.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1787178674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:53:21.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3927865126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:53:21.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:21 smithi159 ceph-mon[69013]: from='client.36918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:21.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1787178674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:53:21.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3927865126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:53:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:22 smithi096 ceph-mon[101353]: from='client.36922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:22 smithi096 ceph-mon[101353]: pgmap v2738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:22 smithi159 ceph-mon[69013]: from='client.36922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:22 smithi159 ceph-mon[69013]: pgmap v2738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:24 smithi096 ceph-mon[101353]: pgmap v2739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:24 smithi159 ceph-mon[69013]: pgmap v2739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:26 smithi096 ceph-mon[101353]: pgmap v2740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:26 smithi159 ceph-mon[69013]: pgmap v2740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:28 smithi096 ceph-mon[101353]: pgmap v2741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:53:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:53:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:28 smithi159 ceph-mon[69013]: pgmap v2741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:53:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:53:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:30 smithi096 ceph-mon[101353]: pgmap v2742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:30.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:30 smithi159 ceph-mon[69013]: pgmap v2742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:32 smithi096 ceph-mon[101353]: pgmap v2743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:32 smithi159 ceph-mon[69013]: pgmap v2743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:33 smithi096 ceph-mon[101353]: pgmap v2744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:33.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:33 smithi159 ceph-mon[69013]: pgmap v2744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:35 smithi159 ceph-mon[69013]: pgmap v2745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:35 smithi096 ceph-mon[101353]: pgmap v2745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:38.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:38 smithi159 ceph-mon[69013]: pgmap v2746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:38 smithi096 ceph-mon[101353]: pgmap v2746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:40.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:40 smithi159 ceph-mon[69013]: pgmap v2747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:40.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:40 smithi096 ceph-mon[101353]: pgmap v2747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:42 smithi096 ceph-mon[101353]: pgmap v2748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:42 smithi159 ceph-mon[69013]: pgmap v2748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:44 smithi096 ceph-mon[101353]: pgmap v2749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:44 smithi159 ceph-mon[69013]: pgmap v2749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:46 smithi096 ceph-mon[101353]: pgmap v2750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:46.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:46 smithi159 ceph-mon[69013]: pgmap v2750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:48 smithi096 ceph-mon[101353]: pgmap v2751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:48 smithi159 ceph-mon[69013]: pgmap v2751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:50 smithi096 ceph-mon[101353]: pgmap v2752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:50.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:50 smithi159 ceph-mon[69013]: pgmap v2752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- 172.21.15.96:0/2131316146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 msgr2=0x7f45fc0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 --2- 172.21.15.96:0/2131316146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f6920 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f45f0004660 tx=0x7f45f0009b30).stop 2022-02-02T19:53:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- 172.21.15.96:0/2131316146 shutdown_connections 2022-02-02T19:53:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 --2- 172.21.15.96:0/2131316146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f6920 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 --2- 172.21.15.96:0/2131316146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 0x7f45fc0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- 172.21.15.96:0/2131316146 >> 172.21.15.96:0/2131316146 conn(0x7f45fc0f0de0 msgr2=0x7f45fc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- 172.21.15.96:0/2131316146 shutdown_connections 2022-02-02T19:53:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- 172.21.15.96:0/2131316146 wait complete. 2022-02-02T19:53:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 Processor -- start 2022-02-02T19:53:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.228+0000 7f4601864700 1 -- start start 2022-02-02T19:53:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f4601864700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 0x7f45fc0fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f4601864700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f4601864700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0f89e0 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f4601864700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0f8b20 con 0x7f45fc0f55e0 2022-02-02T19:53:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34048/0 (socket says 172.21.15.96:34048) 2022-02-02T19:53:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 -- 172.21.15.96:0/1854838860 learned_addr learned my addr 172.21.15.96:0/1854838860 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45faffd700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 0x7f45fc0fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 -- 172.21.15.96:0/1854838860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 msgr2=0x7f45fc0fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 0x7f45fc0fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 -- 172.21.15.96:0/1854838860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0005040 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45fa7fc700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f45f0009830 tx=0x7f45f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.229+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f0018070 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.230+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0f8da0 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.230+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f45f0007ba0 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.230+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f001c3c0 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.230+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0f9300 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.231+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f45f0007d10 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.231+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc045ad0 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.231+0000 7f45e37fe700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 0x7f45e4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.231+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f45f0083160 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.232+0000 7f45faffd700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 0x7f45e4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.232+0000 7f45faffd700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 0x7f45e4067270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f45fc0f9d90 tx=0x7f45ec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.236+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f45f0051260 con 0x7f45fc0f5ef0 2022-02-02T19:53:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.415+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45fc05fe50 con 0x7f45e4064db0 2022-02-02T19:53:51.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.417+0000 7f45e37fe700 1 -- 172.21.15.96:0/1854838860 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f45fc05fe50 con 0x7f45e4064db0 2022-02-02T19:53:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.418+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 msgr2=0x7f45e4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.418+0000 7f4601864700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 0x7f45e4067270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f45fc0f9d90 tx=0x7f45ec00b040).stop 2022-02-02T19:53:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.418+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 msgr2=0x7f45fc0f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.418+0000 7f4601864700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f45f0009830 tx=0x7f45f0009b30).stop 2022-02-02T19:53:51.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.418+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 shutdown_connections 2022-02-02T19:53:51.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e4064db0 0x7f45e4067270 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45fc0f55e0 0x7f45fc0fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 --2- 172.21.15.96:0/1854838860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45fc0f5ef0 0x7f45fc0f8480 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 >> 172.21.15.96:0/1854838860 conn(0x7f45fc0f0de0 msgr2=0x7f45fc05f740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:51.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 shutdown_connections 2022-02-02T19:53:51.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.419+0000 7f4601864700 1 -- 172.21.15.96:0/1854838860 wait complete. 2022-02-02T19:53:51.431 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:53:51.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 -- 172.21.15.96:0/2600088874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f77d0 msgr2=0x7fef6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 --2- 172.21.15.96:0/2600088874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f77d0 0x7fef6c0f7c30 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fef60004660 tx=0x7fef60009b30).stop 2022-02-02T19:53:51.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 -- 172.21.15.96:0/2600088874 shutdown_connections 2022-02-02T19:53:51.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 --2- 172.21.15.96:0/2600088874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f77d0 0x7fef6c0f7c30 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 --2- 172.21.15.96:0/2600088874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f6530 0x7fef6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 -- 172.21.15.96:0/2600088874 >> 172.21.15.96:0/2600088874 conn(0x7fef6c0f1c90 msgr2=0x7fef6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 -- 172.21.15.96:0/2600088874 shutdown_connections 2022-02-02T19:53:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.517+0000 7fef6bfff700 1 -- 172.21.15.96:0/2600088874 wait complete. 2022-02-02T19:53:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 Processor -- start 2022-02-02T19:53:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 -- start start 2022-02-02T19:53:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f77d0 0x7fef6c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c107880 con 0x7fef6c0f6530 2022-02-02T19:53:51.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c108090 con 0x7fef6c0f77d0 2022-02-02T19:53:51.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34054/0 (socket says 172.21.15.96:34054) 2022-02-02T19:53:51.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.518+0000 7fef6affd700 1 -- 172.21.15.96:0/1709432726 learned_addr learned my addr 172.21.15.96:0/1709432726 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:51.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6a7fc700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f77d0 0x7fef6c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6affd700 1 -- 172.21.15.96:0/1709432726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f77d0 msgr2=0x7fef6c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6affd700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f77d0 0x7fef6c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6affd700 1 -- 172.21.15.96:0/1709432726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60005040 con 0x7fef6c0f6530 2022-02-02T19:53:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6affd700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fef5c00c530 tx=0x7fef5c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c00f650 con 0x7fef6c0f6530 2022-02-02T19:53:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c108310 con 0x7fef6c0f6530 2022-02-02T19:53:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef5c00fc60 con 0x7fef6c0f6530 2022-02-02T19:53:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c012d20 con 0x7fef6c0f6530 2022-02-02T19:53:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.519+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1088d0 con 0x7fef6c0f6530 2022-02-02T19:53:51.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.520+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c059100 con 0x7fef6c0f6530 2022-02-02T19:53:51.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.520+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fef5c019030 con 0x7fef6c0f6530 2022-02-02T19:53:51.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.521+0000 7fef537fe700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 0x7fef540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.521+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fef5c0816b0 con 0x7fef6c0f6530 2022-02-02T19:53:51.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.521+0000 7fef6a7fc700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 0x7fef540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.521+0000 7fef6a7fc700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 0x7fef540672e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fef60004e30 tx=0x7fef60009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.525+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fef5c04f800 con 0x7fef6c0f6530 2022-02-02T19:53:51.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.696+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fef6c0fedd0 con 0x7fef54064e20 2022-02-02T19:53:51.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.706+0000 7fef537fe700 1 -- 172.21.15.96:0/1709432726 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fef6c0fedd0 con 0x7fef54064e20 2022-02-02T19:53:51.709 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:53:51.709 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (97m) 67m ago 98m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:53:51.710 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (89m) 67m ago 98m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:53:51.710 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (89m) 66m ago 97m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:53:51.710 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (97m) 67m ago 98m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:53:51.710 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (94m) 67m ago 94m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:53:51.711 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (89m) 67m ago 94m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:53:51.711 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (94m) 66m ago 94m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:53:51.711 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (90m) 66m ago 94m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:53:51.711 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (91m) 67m ago 99m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:53:51.712 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (91m) 66m ago 97m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:53:51.712 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (90m) 67m ago 99m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:53:51.712 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (90m) 66m ago 97m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:53:51.712 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (98m) 67m ago 98m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:53:51.713 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (97m) 66m ago 97m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:53:51.713 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (89m) 67m ago 97m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:53:51.713 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (88m) 67m ago 96m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:53:51.713 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (88m) 67m ago 96m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:53:51.713 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (87m) 66m ago 96m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:53:51.714 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (87m) 66m ago 95m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:53:51.714 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (86m) 66m ago 95m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:53:51.714 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (96m) 67m ago 97m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:53:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 msgr2=0x7fef540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 0x7fef540672e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fef60004e30 tx=0x7fef60009b30).stop 2022-02-02T19:53:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 msgr2=0x7fef6c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fef5c00c530 tx=0x7fef5c007e10).stop 2022-02-02T19:53:51.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 shutdown_connections 2022-02-02T19:53:51.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef54064e20 0x7fef540672e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef6c0f6530 0x7fef6c106d90 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 --2- 172.21.15.96:0/1709432726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef6c0f77d0 0x7fef6c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 >> 172.21.15.96:0/1709432726 conn(0x7fef6c0f1c90 msgr2=0x7fef6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:51.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 shutdown_connections 2022-02-02T19:53:51.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.708+0000 7fef6bfff700 1 -- 172.21.15.96:0/1709432726 wait complete. 2022-02-02T19:53:51.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 -- 172.21.15.96:0/2347458801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 msgr2=0x7f9eb00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 --2- 172.21.15.96:0/2347458801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb00f5860 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f9eac004660 tx=0x7f9eac009b30).stop 2022-02-02T19:53:51.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 -- 172.21.15.96:0/2347458801 shutdown_connections 2022-02-02T19:53:51.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 --2- 172.21.15.96:0/2347458801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 0x7f9eb00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 --2- 172.21.15.96:0/2347458801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb00f5860 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 -- 172.21.15.96:0/2347458801 >> 172.21.15.96:0/2347458801 conn(0x7f9eb00f0ba0 msgr2=0x7f9eb00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:51.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.804+0000 7f9eb7433700 1 -- 172.21.15.96:0/2347458801 shutdown_connections 2022-02-02T19:53:51.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 -- 172.21.15.96:0/2347458801 wait complete. 2022-02-02T19:53:51.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 Processor -- start 2022-02-02T19:53:51.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 -- start start 2022-02-02T19:53:51.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 0x7f9eb010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00603e0 con 0x7f9eb00f5440 2022-02-02T19:53:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.805+0000 7f9eb7433700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0060520 con 0x7f9eb00f66e0 2022-02-02T19:53:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34062/0 (socket says 172.21.15.96:34062) 2022-02-02T19:53:51.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 -- 172.21.15.96:0/767752999 learned_addr learned my addr 172.21.15.96:0/767752999 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:51.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb5c30700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 0x7f9eb010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 -- 172.21.15.96:0/767752999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 msgr2=0x7f9eb010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:51.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 0x7f9eb010bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:51.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 -- 172.21.15.96:0/767752999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac005040 con 0x7f9eb00f5440 2022-02-02T19:53:51.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb6431700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f9eac013a70 tx=0x7f9eac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eac018070 con 0x7f9eb00f5440 2022-02-02T19:53:51.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb010c4e0 con 0x7f9eb00f5440 2022-02-02T19:53:51.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9eac0097d0 con 0x7f9eb00f5440 2022-02-02T19:53:51.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eac01c3c0 con 0x7f9eb00f5440 2022-02-02T19:53:51.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.806+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb010ca40 con 0x7f9eb00f5440 2022-02-02T19:53:51.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.807+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0045ad0 con 0x7f9eb00f5440 2022-02-02T19:53:51.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.809+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9eac007ba0 con 0x7f9eb00f5440 2022-02-02T19:53:51.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.809+0000 7f9ea6ffd700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 0x7f9e9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:51.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.809+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9eac083c10 con 0x7f9eb00f5440 2022-02-02T19:53:51.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.809+0000 7f9eb5c30700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 0x7f9e9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:51.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.810+0000 7f9eb5c30700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 0x7f9e9c0672e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f9ea00096c0 tx=0x7f9ea0009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:51.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:51.813+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9eac051c30 con 0x7f9eb00f5440 2022-02-02T19:53:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.042+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9eb00fdd00 con 0x7f9eb00f5440 2022-02-02T19:53:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.043+0000 7f9ea6ffd700 1 -- 172.21.15.96:0/767752999 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9eac055250 con 0x7f9eb00f5440 2022-02-02T19:53:52.047 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:53:52.047 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:53:52.047 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:53:52.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:52.048 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:53:52.048 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:53:52.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:52.048 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:53:52.048 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:53:52.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:52.049 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:53:52.049 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:53:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:53:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:53:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:53:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:53:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:53:52.051 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:53:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.044+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 msgr2=0x7f9e9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.044+0000 7f9eb7433700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 0x7f9e9c0672e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f9ea00096c0 tx=0x7f9ea0009be0).stop 2022-02-02T19:53:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 msgr2=0x7f9eb0109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f9eac013a70 tx=0x7f9eac009b30).stop 2022-02-02T19:53:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 shutdown_connections 2022-02-02T19:53:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e9c064e20 0x7f9e9c0672e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eb00f5440 0x7f9eb0109a90 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 --2- 172.21.15.96:0/767752999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9eb00f66e0 0x7f9eb010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 >> 172.21.15.96:0/767752999 conn(0x7f9eb00f0ba0 msgr2=0x7f9eb00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 shutdown_connections 2022-02-02T19:53:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.045+0000 7f9eb7433700 1 -- 172.21.15.96:0/767752999 wait complete. 2022-02-02T19:53:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 -- 172.21.15.96:0/1220427282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f7980 msgr2=0x7fc9b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/1220427282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f7980 0x7fc9b40f7de0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fc9a4004660 tx=0x7fc9a4009b30).stop 2022-02-02T19:53:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 -- 172.21.15.96:0/1220427282 shutdown_connections 2022-02-02T19:53:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/1220427282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f7980 0x7fc9b40f7de0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/1220427282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f66e0 0x7fc9b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 -- 172.21.15.96:0/1220427282 >> 172.21.15.96:0/1220427282 conn(0x7fc9b40f1e40 msgr2=0x7fc9b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 -- 172.21.15.96:0/1220427282 shutdown_connections 2022-02-02T19:53:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.142+0000 7fc9b9d75700 1 -- 172.21.15.96:0/1220427282 wait complete. 2022-02-02T19:53:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 Processor -- start 2022-02-02T19:53:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 -- start start 2022-02-02T19:53:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f7980 0x7fc9b4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4107a00 con 0x7fc9b40f66e0 2022-02-02T19:53:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b9d75700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4107b40 con 0x7fc9b40f7980 2022-02-02T19:53:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34072/0 (socket says 172.21.15.96:34072) 2022-02-02T19:53:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 -- 172.21.15.96:0/638100814 learned_addr learned my addr 172.21.15.96:0/638100814 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:53:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b2ffd700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f7980 0x7fc9b4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 -- 172.21.15.96:0/638100814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f7980 msgr2=0x7fc9b4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f7980 0x7fc9b4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.143+0000 7fc9b37fe700 1 -- 172.21.15.96:0/638100814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4005040 con 0x7fc9b40f66e0 2022-02-02T19:53:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc9b37fe700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fc9a8002700 tx=0x7fc9a8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a80079c0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc9a800f040 con 0x7fc9b40f66e0 2022-02-02T19:53:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b41084e0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a8014860 con 0x7fc9b40f66e0 2022-02-02T19:53:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.144+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b4108aa0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.145+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b4045ad0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.145+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc9a801b060 con 0x7fc9b40f66e0 2022-02-02T19:53:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.146+0000 7fc99bfff700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 0x7fc99c067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:53:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.146+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc9a80817a0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.146+0000 7fc9b2ffd700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 0x7fc99c067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:53:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.146+0000 7fc9b2ffd700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 0x7fc99c067360 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fc9a4004630 tx=0x7fc9a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:53:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.150+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc9a80534a0 con 0x7fc9b40f66e0 2022-02-02T19:53:52.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.352+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9b40ff020 con 0x7fc9b40f66e0 2022-02-02T19:53:52.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.353+0000 7fc99bfff700 1 -- 172.21.15.96:0/638100814 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc9a8019070 con 0x7fc9b40f66e0 2022-02-02T19:53:52.356 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:53:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:53:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:53:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:53:52.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:52.358 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:53:52.358 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:53:52.358 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:53:52.358 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:53:52.359 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:53:52.359 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:53:52.359 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:53:52.359 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:53:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:53:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:53:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:53:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:53:52.361 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:53:52.361 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:53:52.361 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:53:52.361 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:53:52.362 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:53:52.362 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:53:52.362 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:53:52.362 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:53:52.362 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:53:52.363 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:53:52.363 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:53:52.363 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:53:52.364 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:53:52.364 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:53:52.364 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:53:52.364 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:52.366 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:53:52.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 msgr2=0x7fc99c067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 0x7fc99c067360 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fc9a4004630 tx=0x7fc9a4009b30).stop 2022-02-02T19:53:52.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 msgr2=0x7fc9b4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:53:52.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fc9a8002700 tx=0x7fc9a8009d80).stop 2022-02-02T19:53:52.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 shutdown_connections 2022-02-02T19:53:52.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc99c064ea0 0x7fc99c067360 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b40f66e0 0x7fc9b4106f60 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 --2- 172.21.15.96:0/638100814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b40f7980 0x7fc9b4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:53:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 >> 172.21.15.96:0/638100814 conn(0x7fc9b40f1e40 msgr2=0x7fc9b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:53:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.354+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 shutdown_connections 2022-02-02T19:53:52.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:53:52.355+0000 7fc9b9d75700 1 -- 172.21.15.96:0/638100814 wait complete. 2022-02-02T19:53:52.370 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:53:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:52 smithi096 ceph-mon[101353]: pgmap v2753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/767752999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:53:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:52 smithi159 ceph-mon[69013]: pgmap v2753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/767752999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:53:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:53 smithi096 ceph-mon[101353]: from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:53 smithi096 ceph-mon[101353]: from='client.36938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:53.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/638100814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:53:53.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:53 smithi159 ceph-mon[69013]: from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:53.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:53 smithi159 ceph-mon[69013]: from='client.36938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:53:53.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/638100814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:53:54.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:54 smithi096 ceph-mon[101353]: pgmap v2754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:54 smithi159 ceph-mon[69013]: pgmap v2754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:55 smithi159 ceph-mon[69013]: pgmap v2755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:55.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:55 smithi096 ceph-mon[101353]: pgmap v2755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:58.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:53:58 smithi159 ceph-mon[69013]: pgmap v2756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:53:58.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:53:58 smithi096 ceph-mon[101353]: pgmap v2756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:00 smithi096 ceph-mon[101353]: pgmap v2757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:00.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:00 smithi159 ceph-mon[69013]: pgmap v2757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:02 smithi096 ceph-mon[101353]: pgmap v2758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:02 smithi159 ceph-mon[69013]: pgmap v2758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:04 smithi096 ceph-mon[101353]: pgmap v2759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:04 smithi159 ceph-mon[69013]: pgmap v2759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:06.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:06 smithi096 ceph-mon[101353]: pgmap v2760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:06 smithi159 ceph-mon[69013]: pgmap v2760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:08 smithi096 ceph-mon[101353]: pgmap v2761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:08 smithi159 ceph-mon[69013]: pgmap v2761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:10 smithi096 ceph-mon[101353]: pgmap v2762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:10 smithi159 ceph-mon[69013]: pgmap v2762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:12 smithi096 ceph-mon[101353]: pgmap v2763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:12 smithi159 ceph-mon[69013]: pgmap v2763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:14.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:14 smithi096 ceph-mon[101353]: pgmap v2764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:14 smithi159 ceph-mon[69013]: pgmap v2764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:16.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:16 smithi096 ceph-mon[101353]: pgmap v2765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:16 smithi159 ceph-mon[69013]: pgmap v2765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:17 smithi159 ceph-mon[69013]: pgmap v2766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:17.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:17 smithi096 ceph-mon[101353]: pgmap v2766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:19 smithi159 ceph-mon[69013]: pgmap v2767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:20.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:19 smithi096 ceph-mon[101353]: pgmap v2767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:22.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 -- 172.21.15.96:0/577983454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f6860 msgr2=0x7f07d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/577983454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f6860 0x7f07d80f6cc0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f07c8004660 tx=0x7f07c8009b30).stop 2022-02-02T19:54:22.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 -- 172.21.15.96:0/577983454 shutdown_connections 2022-02-02T19:54:22.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/577983454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f6860 0x7f07d80f6cc0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/577983454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f55c0 0x7f07d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 -- 172.21.15.96:0/577983454 >> 172.21.15.96:0/577983454 conn(0x7f07d80f0d40 msgr2=0x7f07d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:22.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 -- 172.21.15.96:0/577983454 shutdown_connections 2022-02-02T19:54:22.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 -- 172.21.15.96:0/577983454 wait complete. 2022-02-02T19:54:22.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.465+0000 7f07ddd0a700 1 Processor -- start 2022-02-02T19:54:22.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07ddd0a700 1 -- start start 2022-02-02T19:54:22.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07ddd0a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07ddd0a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f6860 0x7f07d810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07ddd0a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80602b0 con 0x7f07d80f55c0 2022-02-02T19:54:22.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07ddd0a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80603f0 con 0x7f07d80f6860 2022-02-02T19:54:22.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34092/0 (socket says 172.21.15.96:34092) 2022-02-02T19:54:22.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07d77fe700 1 -- 172.21.15.96:0/3685623548 learned_addr learned my addr 172.21.15.96:0/3685623548 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:22.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.466+0000 7f07d6ffd700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f6860 0x7f07d810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07d77fe700 1 -- 172.21.15.96:0/3685623548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f6860 msgr2=0x7f07d810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07d77fe700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f6860 0x7f07d810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07d77fe700 1 -- 172.21.15.96:0/3685623548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8005040 con 0x7f07d80f55c0 2022-02-02T19:54:22.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07d77fe700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f07cc002700 tx=0x7f07cc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:22.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07cc0079c0 con 0x7f07d80f55c0 2022-02-02T19:54:22.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d810ea60 con 0x7f07d80f55c0 2022-02-02T19:54:22.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f07cc00f040 con 0x7f07d80f55c0 2022-02-02T19:54:22.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07cc014860 con 0x7f07d80f55c0 2022-02-02T19:54:22.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.467+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d810eee0 con 0x7f07d80f55c0 2022-02-02T19:54:22.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.468+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d8045ad0 con 0x7f07d80f55c0 2022-02-02T19:54:22.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.469+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f07cc01b060 con 0x7f07d80f55c0 2022-02-02T19:54:22.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.469+0000 7f07bffff700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 0x7f07c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.469+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f07cc081810 con 0x7f07d80f55c0 2022-02-02T19:54:22.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.470+0000 7f07d6ffd700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 0x7f07c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.470+0000 7f07d6ffd700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 0x7f07c0067290 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f07c8004630 tx=0x7f07c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:22.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.474+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f07cc04f910 con 0x7f07d80f55c0 2022-02-02T19:54:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:22 smithi096 ceph-mon[101353]: pgmap v2768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:22.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.654+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07d8057f10 con 0x7f07c0064dd0 2022-02-02T19:54:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.655+0000 7f07bffff700 1 -- 172.21.15.96:0/3685623548 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f07d8057f10 con 0x7f07c0064dd0 2022-02-02T19:54:22.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 msgr2=0x7f07c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 0x7f07c0067290 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f07c8004630 tx=0x7f07c8009b30).stop 2022-02-02T19:54:22.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 msgr2=0x7f07d810c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f07cc002700 tx=0x7f07cc009d80).stop 2022-02-02T19:54:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 shutdown_connections 2022-02-02T19:54:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07c0064dd0 0x7f07c0067290 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d80f55c0 0x7f07d810c070 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 --2- 172.21.15.96:0/3685623548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07d80f6860 0x7f07d810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.657+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 >> 172.21.15.96:0/3685623548 conn(0x7f07d80f0d40 msgr2=0x7f07d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.658+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 shutdown_connections 2022-02-02T19:54:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.658+0000 7f07ddd0a700 1 -- 172.21.15.96:0/3685623548 wait complete. 2022-02-02T19:54:22.671 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:54:22.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- 172.21.15.96:0/2061303685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f7960 msgr2=0x7f6bb40f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/2061303685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f7960 0x7f6bb40f7dc0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f6bb0004660 tx=0x7f6bb0009b30).stop 2022-02-02T19:54:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- 172.21.15.96:0/2061303685 shutdown_connections 2022-02-02T19:54:22.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/2061303685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f7960 0x7f6bb40f7dc0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/2061303685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f66c0 0x7f6bb40f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- 172.21.15.96:0/2061303685 >> 172.21.15.96:0/2061303685 conn(0x7f6bb40f1e20 msgr2=0x7f6bb40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:22.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- 172.21.15.96:0/2061303685 shutdown_connections 2022-02-02T19:54:22.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- 172.21.15.96:0/2061303685 wait complete. 2022-02-02T19:54:22.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 Processor -- start 2022-02-02T19:54:22.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.755+0000 7f6bbb85b700 1 -- start start 2022-02-02T19:54:22.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bbb85b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bbb85b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f7960 0x7f6bb4107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bbb85b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb41079e0 con 0x7f6bb40f66c0 2022-02-02T19:54:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bbb85b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4107b20 con 0x7f6bb40f7960 2022-02-02T19:54:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34102/0 (socket says 172.21.15.96:34102) 2022-02-02T19:54:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 -- 172.21.15.96:0/3724973035 learned_addr learned my addr 172.21.15.96:0/3724973035 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:22.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb8df6700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f7960 0x7f6bb4107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 -- 172.21.15.96:0/3724973035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f7960 msgr2=0x7f6bb4107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f7960 0x7f6bb4107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 -- 172.21.15.96:0/3724973035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0005040 con 0x7f6bb40f66c0 2022-02-02T19:54:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6bb95f7700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f6ba8002700 tx=0x7f6ba8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.756+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba80079c0 con 0x7f6bb40f66c0 2022-02-02T19:54:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.757+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb41084c0 con 0x7f6bb40f66c0 2022-02-02T19:54:22.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.757+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ba800f040 con 0x7f6bb40f66c0 2022-02-02T19:54:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.757+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba8014860 con 0x7f6bb40f66c0 2022-02-02T19:54:22.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.757+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4108a80 con 0x7f6bb40f66c0 2022-02-02T19:54:22.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.758+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4045ad0 con 0x7f6bb40f66c0 2022-02-02T19:54:22.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.758+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6ba801b060 con 0x7f6bb40f66c0 2022-02-02T19:54:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.758+0000 7f6ba5ffb700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 0x7f6ba0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.759+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6ba80819a0 con 0x7f6bb40f66c0 2022-02-02T19:54:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.759+0000 7f6bb8df6700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 0x7f6ba0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:22.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.759+0000 7f6bb8df6700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 0x7f6ba0067290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f6bb0004630 tx=0x7f6bb0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:22.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:22 smithi159 ceph-mon[69013]: pgmap v2768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.763+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6ba8053410 con 0x7f6bb40f66c0 2022-02-02T19:54:22.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.935+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb4108d00 con 0x7f6ba0064dd0 2022-02-02T19:54:22.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.944+0000 7f6ba5ffb700 1 -- 172.21.15.96:0/3724973035 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f6bb4108d00 con 0x7f6ba0064dd0 2022-02-02T19:54:22.948 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:54:22.949 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (97m) 68m ago 98m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:54:22.949 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (90m) 68m ago 98m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:54:22.950 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (90m) 66m ago 98m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:54:22.950 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (97m) 68m ago 98m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:54:22.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (94m) 68m ago 94m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:54:22.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (90m) 68m ago 94m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:54:22.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (94m) 66m ago 94m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:54:22.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (90m) 66m ago 94m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:54:22.952 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (92m) 68m ago 99m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:54:22.953 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (91m) 66m ago 98m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:54:22.954 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (91m) 68m ago 100m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:54:22.954 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (90m) 66m ago 98m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:54:22.954 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (98m) 68m ago 98m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:54:22.954 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (98m) 66m ago 98m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:54:22.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (89m) 68m ago 97m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:54:22.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (89m) 68m ago 97m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:54:22.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (88m) 68m ago 97m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:54:22.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (88m) 66m ago 96m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:54:22.956 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (87m) 66m ago 96m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:54:22.956 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (87m) 66m ago 96m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:54:22.957 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (97m) 68m ago 98m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:54:22.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 msgr2=0x7f6ba0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 0x7f6ba0067290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f6bb0004630 tx=0x7f6bb0009b30).stop 2022-02-02T19:54:22.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 msgr2=0x7f6bb4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:22.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f6ba8002700 tx=0x7f6ba8009d80).stop 2022-02-02T19:54:22.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 shutdown_connections 2022-02-02T19:54:22.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ba0064dd0 0x7f6ba0067290 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb40f66c0 0x7f6bb4106f40 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 --2- 172.21.15.96:0/3724973035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40f7960 0x7f6bb4107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 >> 172.21.15.96:0/3724973035 conn(0x7f6bb40f1e20 msgr2=0x7f6bb40fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.946+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 shutdown_connections 2022-02-02T19:54:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:22.947+0000 7f6bbb85b700 1 -- 172.21.15.96:0/3724973035 wait complete. 2022-02-02T19:54:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 -- 172.21.15.96:0/3450305694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 msgr2=0x7f0e740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 --2- 172.21.15.96:0/3450305694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e740f6b00 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f0e64004660 tx=0x7f0e64009b30).stop 2022-02-02T19:54:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 -- 172.21.15.96:0/3450305694 shutdown_connections 2022-02-02T19:54:23.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 --2- 172.21.15.96:0/3450305694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:54:23.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 --2- 172.21.15.96:0/3450305694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e740f6b00 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.042+0000 7f0e7a224700 1 -- 172.21.15.96:0/3450305694 >> 172.21.15.96:0/3450305694 conn(0x7f0e740f1e40 msgr2=0x7f0e740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:23.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.043+0000 7f0e7a224700 1 -- 172.21.15.96:0/3450305694 shutdown_connections 2022-02-02T19:54:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.043+0000 7f0e7a224700 1 -- 172.21.15.96:0/3450305694 wait complete. 2022-02-02T19:54:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.043+0000 7f0e7a224700 1 Processor -- start 2022-02-02T19:54:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.043+0000 7f0e7a224700 1 -- start start 2022-02-02T19:54:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e7a224700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e7a224700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e7a224700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7406a410 con 0x7f0e740f66e0 2022-02-02T19:54:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e7a224700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7406a550 con 0x7f0e740f7980 2022-02-02T19:54:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34112/0 (socket says 172.21.15.96:34112) 2022-02-02T19:54:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 -- 172.21.15.96:0/1210765107 learned_addr learned my addr 172.21.15.96:0/1210765107 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:23.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e72ffd700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 -- 172.21.15.96:0/1210765107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 msgr2=0x7f0e74069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e74069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 -- 172.21.15.96:0/1210765107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64005040 con 0x7f0e740f66e0 2022-02-02T19:54:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e72ffd700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e74069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:54:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e737fe700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f0e64000c00 tx=0x7f0e64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e64018070 con 0x7f0e740f66e0 2022-02-02T19:54:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e64007d70 con 0x7f0e740f66e0 2022-02-02T19:54:23.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7406a7d0 con 0x7f0e740f66e0 2022-02-02T19:54:23.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.044+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e6401c620 con 0x7f0e740f66e0 2022-02-02T19:54:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.045+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7410efe0 con 0x7f0e740f66e0 2022-02-02T19:54:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.046+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e74045ad0 con 0x7f0e740f66e0 2022-02-02T19:54:23.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.046+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e6401c860 con 0x7f0e740f66e0 2022-02-02T19:54:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.046+0000 7f0e5bfff700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 0x7f0e5c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.047+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e64083900 con 0x7f0e740f66e0 2022-02-02T19:54:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.047+0000 7f0e72ffd700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 0x7f0e5c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.047+0000 7f0e72ffd700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 0x7f0e5c067270 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0e6800a880 tx=0x7f0e68008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:23.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.051+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e64051a00 con 0x7f0e740f66e0 2022-02-02T19:54:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.283+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e740feff0 con 0x7f0e740f66e0 2022-02-02T19:54:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.284+0000 7f0e5bfff700 1 -- 172.21.15.96:0/1210765107 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0e64055020 con 0x7f0e740f66e0 2022-02-02T19:54:23.288 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:54:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:54:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:54:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:23.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:54:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:54:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:54:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:54:23.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:54:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:54:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:23.291 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:54:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:54:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:54:23.292 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:54:23.292 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:54:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 msgr2=0x7f0e5c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 0x7f0e5c067270 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0e6800a880 tx=0x7f0e68008040).stop 2022-02-02T19:54:23.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 msgr2=0x7f0e7406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f0e64000c00 tx=0x7f0e64009b30).stop 2022-02-02T19:54:23.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 shutdown_connections 2022-02-02T19:54:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e5c064db0 0x7f0e5c067270 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f66e0 0x7f0e7406b9a0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 --2- 172.21.15.96:0/1210765107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f7980 0x7f0e74069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 >> 172.21.15.96:0/1210765107 conn(0x7f0e740f1e40 msgr2=0x7f0e740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 shutdown_connections 2022-02-02T19:54:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.286+0000 7f0e7a224700 1 -- 172.21.15.96:0/1210765107 wait complete. 2022-02-02T19:54:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- 172.21.15.96:0/4081378338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 msgr2=0x7f98080f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 --2- 172.21.15.96:0/4081378338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f92a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f97f80099e0 tx=0x7f97f8004d10).stop 2022-02-02T19:54:23.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- 172.21.15.96:0/4081378338 shutdown_connections 2022-02-02T19:54:23.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 --2- 172.21.15.96:0/4081378338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 --2- 172.21.15.96:0/4081378338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f92a0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- 172.21.15.96:0/4081378338 >> 172.21.15.96:0/4081378338 conn(0x7f98080f0d40 msgr2=0x7f98080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- 172.21.15.96:0/4081378338 shutdown_connections 2022-02-02T19:54:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- 172.21.15.96:0/4081378338 wait complete. 2022-02-02T19:54:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 Processor -- start 2022-02-02T19:54:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.384+0000 7f980f732700 1 -- start start 2022-02-02T19:54:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980f732700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980f732700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980f732700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080f5700 con 0x7f9808060310 2022-02-02T19:54:23.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980f732700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080f5840 con 0x7f98080f9820 2022-02-02T19:54:23.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34122/0 (socket says 172.21.15.96:34122) 2022-02-02T19:54:23.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 -- 172.21.15.96:0/2232259116 learned_addr learned my addr 172.21.15.96:0/2232259116 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:23.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980cccd700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 -- 172.21.15.96:0/2232259116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 msgr2=0x7f98080f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 -- 172.21.15.96:0/2232259116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009640 con 0x7f9808060310 2022-02-02T19:54:23.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980cccd700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:54:23.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980d4ce700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f97f8004b70 tx=0x7f97f8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:23.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f800e030 con 0x7f9808060310 2022-02-02T19:54:23.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97f80049b0 con 0x7f9808060310 2022-02-02T19:54:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f8018070 con 0x7f9808060310 2022-02-02T19:54:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.385+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98080f5ac0 con 0x7f9808060310 2022-02-02T19:54:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.386+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98080f5fa0 con 0x7f9808060310 2022-02-02T19:54:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.387+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9808045ad0 con 0x7f9808060310 2022-02-02T19:54:23.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.387+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f97f801db40 con 0x7f9808060310 2022-02-02T19:54:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.388+0000 7f9805ffb700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 0x7f97f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.388+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f97f8083a10 con 0x7f9808060310 2022-02-02T19:54:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.388+0000 7f980cccd700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 0x7f97f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.388+0000 7f980cccd700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 0x7f97f0067290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f97fc0041d0 tx=0x7f97fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:23.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.392+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f97f80519f0 con 0x7f9808060310 2022-02-02T19:54:23.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.594+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98080586e0 con 0x7f9808060310 2022-02-02T19:54:23.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.595+0000 7f9805ffb700 1 -- 172.21.15.96:0/2232259116 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f97f8055010 con 0x7f9808060310 2022-02-02T19:54:23.599 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:54:23.599 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:54:23.599 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:54:23.600 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:54:23.600 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:23.600 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:54:23.600 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:54:23.601 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:54:23.601 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:54:23.601 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:54:23.601 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:54:23.601 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:54:23.602 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:54:23.602 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:54:23.602 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:54:23.602 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:54:23.603 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:54:23.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:54:23.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:54:23.603 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:54:23.604 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:54:23.604 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:54:23.604 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:54:23.604 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:54:23.604 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:54:23.605 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:54:23.605 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:54:23.605 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:54:23.605 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:54:23.606 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:54:23.606 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:54:23.606 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:54:23.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:23.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:23.607 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:54:23.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:23.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:23.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:23.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 msgr2=0x7f97f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 0x7f97f0067290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f97fc0041d0 tx=0x7f97fc009040).stop 2022-02-02T19:54:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 msgr2=0x7f98080f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f97f8004b70 tx=0x7f97f8004d10).stop 2022-02-02T19:54:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 shutdown_connections 2022-02-02T19:54:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97f0064dd0 0x7f97f0067290 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9808060310 0x7f98080f6d20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 --2- 172.21.15.96:0/2232259116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98080f9820 0x7f98080f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 >> 172.21.15.96:0/2232259116 conn(0x7f98080f0d40 msgr2=0x7f98080f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 shutdown_connections 2022-02-02T19:54:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:23.597+0000 7f980f732700 1 -- 172.21.15.96:0/2232259116 wait complete. 2022-02-02T19:54:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:54:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:24 smithi096 ceph-mon[101353]: pgmap v2769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:24 smithi096 ceph-mon[101353]: from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:24 smithi096 ceph-mon[101353]: from='client.36954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1210765107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:54:24.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2232259116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:54:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:24 smithi159 ceph-mon[69013]: pgmap v2769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:24 smithi159 ceph-mon[69013]: from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:24 smithi159 ceph-mon[69013]: from='client.36954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1210765107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:54:24.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2232259116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:54:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:26 smithi096 ceph-mon[101353]: pgmap v2770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:26 smithi159 ceph-mon[69013]: pgmap v2770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:28 smithi096 ceph-mon[101353]: pgmap v2771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:54:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:54:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:28 smithi159 ceph-mon[69013]: pgmap v2771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:54:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:54:30.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:30 smithi096 ceph-mon[101353]: pgmap v2772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:30.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:30 smithi159 ceph-mon[69013]: pgmap v2772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:32.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:32 smithi096 ceph-mon[101353]: pgmap v2773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:32 smithi159 ceph-mon[69013]: pgmap v2773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:34.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:34 smithi096 ceph-mon[101353]: pgmap v2774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:34 smithi159 ceph-mon[69013]: pgmap v2774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:36.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:36 smithi096 ceph-mon[101353]: pgmap v2775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:36 smithi159 ceph-mon[69013]: pgmap v2775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:38 smithi096 ceph-mon[101353]: pgmap v2776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:38 smithi159 ceph-mon[69013]: pgmap v2776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:40.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:40 smithi159 ceph-mon[69013]: pgmap v2777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:40.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:40 smithi096 ceph-mon[101353]: pgmap v2777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:42 smithi096 ceph-mon[101353]: pgmap v2778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:42 smithi159 ceph-mon[69013]: pgmap v2778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:44 smithi096 ceph-mon[101353]: pgmap v2779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:44 smithi159 ceph-mon[69013]: pgmap v2779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:46 smithi096 ceph-mon[101353]: pgmap v2780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:46.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:46 smithi159 ceph-mon[69013]: pgmap v2780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:48 smithi096 ceph-mon[101353]: pgmap v2781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:48 smithi159 ceph-mon[69013]: pgmap v2781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:50 smithi096 ceph-mon[101353]: pgmap v2782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:50.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:50 smithi159 ceph-mon[69013]: pgmap v2782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:52.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:52 smithi096 ceph-mon[101353]: pgmap v2783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:52.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:52 smithi159 ceph-mon[69013]: pgmap v2783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:53.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- 172.21.15.96:0/1785093407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 msgr2=0x7fc3e80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:53.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/1785093407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e80f5850 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fc3dc004660 tx=0x7fc3dc009b30).stop 2022-02-02T19:54:53.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- 172.21.15.96:0/1785093407 shutdown_connections 2022-02-02T19:54:53.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/1785093407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:54:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/1785093407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e80f5850 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- 172.21.15.96:0/1785093407 >> 172.21.15.96:0/1785093407 conn(0x7fc3e80f0b90 msgr2=0x7fc3e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- 172.21.15.96:0/1785093407 shutdown_connections 2022-02-02T19:54:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- 172.21.15.96:0/1785093407 wait complete. 2022-02-02T19:54:53.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 Processor -- start 2022-02-02T19:54:53.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.707+0000 7fc3edb9e700 1 -- start start 2022-02-02T19:54:53.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3edb9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3edb9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e810bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3edb9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8060450 con 0x7fc3e80f5430 2022-02-02T19:54:53.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3edb9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8060590 con 0x7fc3e80f66d0 2022-02-02T19:54:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34142/0 (socket says 172.21.15.96:34142) 2022-02-02T19:54:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 -- 172.21.15.96:0/2981590699 learned_addr learned my addr 172.21.15.96:0/2981590699 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3e7fff700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e810bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 -- 172.21.15.96:0/2981590699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 msgr2=0x7fc3e810bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e810bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3ecb9c700 1 -- 172.21.15.96:0/2981590699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc005040 con 0x7fc3e80f5430 2022-02-02T19:54:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.708+0000 7fc3e7fff700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e810bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:54:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3ecb9c700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fc3dc004f60 tx=0x7fc3dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc018070 con 0x7fc3e80f5430 2022-02-02T19:54:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3dc007ba0 con 0x7fc3e80f5430 2022-02-02T19:54:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e810c580 con 0x7fc3e80f5430 2022-02-02T19:54:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc01dea0 con 0x7fc3e80f5430 2022-02-02T19:54:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.709+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e810cae0 con 0x7fc3e80f5430 2022-02-02T19:54:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.710+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8045ad0 con 0x7fc3e80f5430 2022-02-02T19:54:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.710+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc3dc01d420 con 0x7fc3e80f5430 2022-02-02T19:54:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.711+0000 7fc3e57fa700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 0x7fc3d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.711+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc3dc0838c0 con 0x7fc3e80f5430 2022-02-02T19:54:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.711+0000 7fc3e7fff700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 0x7fc3d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.711+0000 7fc3e7fff700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 0x7fc3d80672e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fc3d400b830 tx=0x7fc3d4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.715+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3dc0519c0 con 0x7fc3e80f5430 2022-02-02T19:54:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.893+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3e80fde20 con 0x7fc3d8064e20 2022-02-02T19:54:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.894+0000 7fc3e57fa700 1 -- 172.21.15.96:0/2981590699 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc3d400b4c0 con 0x7fc3d8064e20 2022-02-02T19:54:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 msgr2=0x7fc3d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 0x7fc3d80672e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fc3d400b830 tx=0x7fc3d4008040).stop 2022-02-02T19:54:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 msgr2=0x7fc3e8109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fc3dc004f60 tx=0x7fc3dc009b30).stop 2022-02-02T19:54:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 shutdown_connections 2022-02-02T19:54:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3d8064e20 0x7fc3d80672e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3e80f5430 0x7fc3e8109ad0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 --2- 172.21.15.96:0/2981590699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3e80f66d0 0x7fc3e810bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 >> 172.21.15.96:0/2981590699 conn(0x7fc3e80f0b90 msgr2=0x7fc3e80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 shutdown_connections 2022-02-02T19:54:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.896+0000 7fc3edb9e700 1 -- 172.21.15.96:0/2981590699 wait complete. 2022-02-02T19:54:53.910 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:54:53.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.993+0000 7fc1f83ca700 1 -- 172.21.15.96:0/1264854857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f6860 msgr2=0x7fc1f00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:53.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.993+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/1264854857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f6860 0x7fc1f00f6cc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fc1e0004660 tx=0x7fc1e0009b30).stop 2022-02-02T19:54:53.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 -- 172.21.15.96:0/1264854857 shutdown_connections 2022-02-02T19:54:53.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/1264854857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f6860 0x7fc1f00f6cc0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/1264854857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f55c0 0x7fc1f00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:53.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 -- 172.21.15.96:0/1264854857 >> 172.21.15.96:0/1264854857 conn(0x7fc1f00f0d40 msgr2=0x7fc1f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 -- 172.21.15.96:0/1264854857 shutdown_connections 2022-02-02T19:54:54.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.994+0000 7fc1f83ca700 1 -- 172.21.15.96:0/1264854857 wait complete. 2022-02-02T19:54:54.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 Processor -- start 2022-02-02T19:54:54.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 -- start start 2022-02-02T19:54:54.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 0x7fc1f0109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00603e0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f83ca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0060520 con 0x7fc1f00f6860 2022-02-02T19:54:54.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f5965700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f5965700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:38258/0 (socket says 172.21.15.96:38258) 2022-02-02T19:54:54.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f5965700 1 -- 172.21.15.96:0/3768688594 learned_addr learned my addr 172.21.15.96:0/3768688594 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:54.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.995+0000 7fc1f6166700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 0x7fc1f0109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f6166700 1 -- 172.21.15.96:0/3768688594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 msgr2=0x7fc1f010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f6166700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f6166700 1 -- 172.21.15.96:0/3768688594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0005040 con 0x7fc1f00f55c0 2022-02-02T19:54:54.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f5965700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:54:54.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f6166700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 0x7fc1f0109c50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc1ec0026d0 tx=0x7fc1ec009ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ec0079c0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f010c700 con 0x7fc1f00f55c0 2022-02-02T19:54:54.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1ec00f040 con 0x7fc1f00f55c0 2022-02-02T19:54:54.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ec014750 con 0x7fc1f00f55c0 2022-02-02T19:54:54.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.996+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f010ccc0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.997+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f0045ad0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.997+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1ec01b060 con 0x7fc1f00f55c0 2022-02-02T19:54:54.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.998+0000 7fc1e6ffd700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 0x7fc1dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.998+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1ec0817f0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.998+0000 7fc1f5965700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 0x7fc1dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:53.998+0000 7fc1f5965700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 0x7fc1dc067290 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fc1e0013690 tx=0x7fc1e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.002+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1ec04f8f0 con 0x7fc1f00f55c0 2022-02-02T19:54:54.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.173+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1f00fde90 con 0x7fc1dc064dd0 2022-02-02T19:54:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.182+0000 7fc1e6ffd700 1 -- 172.21.15.96:0/3768688594 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fc1f00fde90 con 0x7fc1dc064dd0 2022-02-02T19:54:54.187 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:54:54.187 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (98m) 68m ago 99m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:54:54.187 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (90m) 68m ago 99m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:54:54.187 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (90m) 67m ago 98m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:54:54.188 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (98m) 68m ago 99m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:54:54.188 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (95m) 68m ago 95m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:54:54.188 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (91m) 68m ago 95m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:54:54.188 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (95m) 67m ago 95m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:54:54.189 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (91m) 67m ago 95m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:54:54.189 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (92m) 68m ago 100m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:54:54.189 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (92m) 67m ago 98m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:54:54.189 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (91m) 68m ago 100m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:54:54.189 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (91m) 67m ago 98m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:54:54.190 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (99m) 68m ago 99m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:54:54.190 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (98m) 67m ago 98m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:54:54.190 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (90m) 68m ago 98m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:54:54.190 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (89m) 68m ago 97m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:54:54.191 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (89m) 68m ago 97m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:54:54.191 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (88m) 67m ago 97m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:54:54.191 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (88m) 67m ago 96m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:54:54.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (87m) 67m ago 96m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:54:54.192 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (98m) 68m ago 98m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:54:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 msgr2=0x7fc1dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 0x7fc1dc067290 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fc1e0013690 tx=0x7fc1e0009b30).stop 2022-02-02T19:54:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 msgr2=0x7fc1f0109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 0x7fc1f0109c50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc1ec0026d0 tx=0x7fc1ec009ce0).stop 2022-02-02T19:54:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 shutdown_connections 2022-02-02T19:54:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1dc064dd0 0x7fc1dc067290 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f00f55c0 0x7fc1f0109c50 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 --2- 172.21.15.96:0/3768688594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f00f6860 0x7fc1f010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 >> 172.21.15.96:0/3768688594 conn(0x7fc1f00f0d40 msgr2=0x7fc1f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 shutdown_connections 2022-02-02T19:54:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.184+0000 7fc1f83ca700 1 -- 172.21.15.96:0/3768688594 wait complete. 2022-02-02T19:54:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 -- 172.21.15.96:0/3315766411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 msgr2=0x7fa9d80f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/3315766411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d80f7920 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fa9c8004660 tx=0x7fa9c8009b30).stop 2022-02-02T19:54:54.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 -- 172.21.15.96:0/3315766411 shutdown_connections 2022-02-02T19:54:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/3315766411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d80f7920 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/3315766411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d80f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:54:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 -- 172.21.15.96:0/3315766411 >> 172.21.15.96:0/3315766411 conn(0x7fa9d80f0320 msgr2=0x7fa9d80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 -- 172.21.15.96:0/3315766411 shutdown_connections 2022-02-02T19:54:54.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.281+0000 7fa9df2a1700 1 -- 172.21.15.96:0/3315766411 wait complete. 2022-02-02T19:54:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 Processor -- start 2022-02-02T19:54:54.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 -- start start 2022-02-02T19:54:54.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d8106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81079d0 con 0x7fa9d80f51a0 2022-02-02T19:54:54.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.282+0000 7fa9df2a1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8108150 con 0x7fa9d80f4800 2022-02-02T19:54:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34162/0 (socket says 172.21.15.96:34162) 2022-02-02T19:54:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 -- 172.21.15.96:0/202360722 learned_addr learned my addr 172.21.15.96:0/202360722 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:54.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9de29f700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d8106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 -- 172.21.15.96:0/202360722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 msgr2=0x7fa9d8106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d8106e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 -- 172.21.15.96:0/202360722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8005040 con 0x7fa9d80f51a0 2022-02-02T19:54:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9de29f700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:54:54.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9dda9e700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fa9c8004f60 tx=0x7fa9c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c8018070 con 0x7fa9d80f51a0 2022-02-02T19:54:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9c8007ba0 con 0x7fa9d80f51a0 2022-02-02T19:54:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c801c620 con 0x7fa9d80f51a0 2022-02-02T19:54:54.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d8108370 con 0x7fa9d80f51a0 2022-02-02T19:54:54.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.283+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d8108880 con 0x7fa9d80f51a0 2022-02-02T19:54:54.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.284+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d8045ad0 con 0x7fa9d80f51a0 2022-02-02T19:54:54.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.285+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa9c801c8e0 con 0x7fa9d80f51a0 2022-02-02T19:54:54.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.285+0000 7fa9ceffd700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 0x7fa9c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.286+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa9c8083960 con 0x7fa9d80f51a0 2022-02-02T19:54:54.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.286+0000 7fa9de29f700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 0x7fa9c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.286+0000 7fa9de29f700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 0x7fa9c40672e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fa9d8106bc0 tx=0x7fa9d4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.290+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa9c8051a60 con 0x7fa9d80f51a0 2022-02-02T19:54:54.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.521+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9d80fef00 con 0x7fa9d80f51a0 2022-02-02T19:54:54.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.521+0000 7fa9ceffd700 1 -- 172.21.15.96:0/202360722 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa9c8055080 con 0x7fa9d80f51a0 2022-02-02T19:54:54.526 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:54:54.526 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:54:54.526 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:54:54.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:54.527 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:54:54.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:54:54.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:54.528 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:54:54.528 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:54:54.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:54.528 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:54:54.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:54:54.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:54:54.529 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:54:54.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:54:54.530 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:54:54.530 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:54:54.530 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:54:54.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 msgr2=0x7fa9c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 0x7fa9c40672e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fa9d8106bc0 tx=0x7fa9d4008040).stop 2022-02-02T19:54:54.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 msgr2=0x7fa9d8107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fa9c8004f60 tx=0x7fa9c8009b30).stop 2022-02-02T19:54:54.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 shutdown_connections 2022-02-02T19:54:54.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa9c4064e20 0x7fa9c40672e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d80f4800 0x7fa9d8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 --2- 172.21.15.96:0/202360722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9d80f51a0 0x7fa9d8107340 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 >> 172.21.15.96:0/202360722 conn(0x7fa9d80f0320 msgr2=0x7fa9d80fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 shutdown_connections 2022-02-02T19:54:54.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.523+0000 7fa9df2a1700 1 -- 172.21.15.96:0/202360722 wait complete. 2022-02-02T19:54:54.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:54 smithi096 ceph-mon[101353]: pgmap v2784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- 172.21.15.96:0/3596342652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 msgr2=0x7f5ea00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/3596342652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea00f6b00 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f5e94004660 tx=0x7f5e94009b30).stop 2022-02-02T19:54:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- 172.21.15.96:0/3596342652 shutdown_connections 2022-02-02T19:54:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/3596342652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 0x7f5ea00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/3596342652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea00f6b00 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- 172.21.15.96:0/3596342652 >> 172.21.15.96:0/3596342652 conn(0x7f5ea00f1e40 msgr2=0x7f5ea00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- 172.21.15.96:0/3596342652 shutdown_connections 2022-02-02T19:54:54.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- 172.21.15.96:0/3596342652 wait complete. 2022-02-02T19:54:54.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 Processor -- start 2022-02-02T19:54:54.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.621+0000 7f5ea6d14700 1 -- start start 2022-02-02T19:54:54.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea6d14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea6d14700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 0x7f5ea01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea6d14700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0107a50 con 0x7f5ea00f66e0 2022-02-02T19:54:54.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea6d14700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0107b90 con 0x7f5ea00f7980 2022-02-02T19:54:54.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34170/0 (socket says 172.21.15.96:34170) 2022-02-02T19:54:54.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 -- 172.21.15.96:0/4292740369 learned_addr learned my addr 172.21.15.96:0/4292740369 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:54:54.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5e9ffff700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 0x7f5ea01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 -- 172.21.15.96:0/4292740369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 msgr2=0x7f5ea01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 0x7f5ea01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 -- 172.21.15.96:0/4292740369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94005040 con 0x7f5ea00f66e0 2022-02-02T19:54:54.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5ea4ab0700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f5e94013a70 tx=0x7f5e94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.622+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e94018070 con 0x7f5ea00f66e0 2022-02-02T19:54:54.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.623+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea01084d0 con 0x7f5ea00f66e0 2022-02-02T19:54:54.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.623+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e940097d0 con 0x7f5ea00f66e0 2022-02-02T19:54:54.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.623+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9401de80 con 0x7f5ea00f66e0 2022-02-02T19:54:54.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.623+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea0108a30 con 0x7f5ea00f66e0 2022-02-02T19:54:54.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.623+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea0045ad0 con 0x7f5ea00f66e0 2022-02-02T19:54:54.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.624+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e94007ba0 con 0x7f5ea00f66e0 2022-02-02T19:54:54.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.624+0000 7f5e9d7fa700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:54:54.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.624+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5e94083560 con 0x7f5ea00f66e0 2022-02-02T19:54:54.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.624+0000 7f5e9ffff700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:54:54.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.625+0000 7f5e9ffff700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f5e8c004c40 tx=0x7f5e8c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:54:54.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.629+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e94055090 con 0x7f5ea00f66e0 2022-02-02T19:54:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:54 smithi159 ceph-mon[69013]: pgmap v2784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:54.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.830+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5ea00fefb0 con 0x7f5ea00f66e0 2022-02-02T19:54:54.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.830+0000 7f5e9d7fa700 1 -- 172.21.15.96:0/4292740369 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5e94054c80 con 0x7f5ea00f66e0 2022-02-02T19:54:54.835 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:54:54.835 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:54:54.836 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:54:54.836 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:54:54.836 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:54.836 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:54:54.837 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:54:54.837 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:54:54.837 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:54:54.837 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:54:54.837 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:54:54.838 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:54:54.838 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:54:54.838 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:54:54.838 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:54:54.839 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:54:54.839 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:54:54.839 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:54:54.839 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:54:54.839 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:54:54.840 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:54:54.840 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:54:54.840 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:54:54.840 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:54:54.841 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:54:54.841 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:54:54.842 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:54:54.842 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:54:54.843 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:54:54.843 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:54:54.843 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:54:54.843 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:54:54.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:54.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:54.845 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:54:54.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:54:54.845 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:54.846 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:54.846 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:54:54.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 msgr2=0x7f5e90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f5e8c004c40 tx=0x7f5e8c00b040).stop 2022-02-02T19:54:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 msgr2=0x7f5ea0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:54:54.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f5e94013a70 tx=0x7f5e94009b30).stop 2022-02-02T19:54:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 shutdown_connections 2022-02-02T19:54:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e90064dd0 0x7f5e90067290 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ea00f66e0 0x7f5ea0106fb0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 --2- 172.21.15.96:0/4292740369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ea00f7980 0x7f5ea01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:54:54.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 >> 172.21.15.96:0/4292740369 conn(0x7f5ea00f1e40 msgr2=0x7f5ea00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:54:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 shutdown_connections 2022-02-02T19:54:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:54:54.832+0000 7f5ea6d14700 1 -- 172.21.15.96:0/4292740369 wait complete. 2022-02-02T19:54:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:54:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:55 smithi159 ceph-mon[69013]: from='client.36966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:55 smithi159 ceph-mon[69013]: from='client.36970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/202360722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:54:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4292740369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:54:55.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:55 smithi096 ceph-mon[101353]: from='client.36966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:55.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:55 smithi096 ceph-mon[101353]: from='client.36970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:54:55.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/202360722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:54:55.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4292740369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:54:56.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:56 smithi159 ceph-mon[69013]: pgmap v2785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:56.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:56 smithi096 ceph-mon[101353]: pgmap v2785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:57 smithi159 ceph-mon[69013]: pgmap v2786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:54:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:57 smithi096 ceph-mon[101353]: pgmap v2786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:54:59 smithi159 ceph-mon[69013]: pgmap v2787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:00.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:54:59 smithi096 ceph-mon[101353]: pgmap v2787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:02 smithi096 ceph-mon[101353]: pgmap v2788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:02 smithi159 ceph-mon[69013]: pgmap v2788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:04 smithi096 ceph-mon[101353]: pgmap v2789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:04 smithi159 ceph-mon[69013]: pgmap v2789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:06.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:06 smithi096 ceph-mon[101353]: pgmap v2790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:06 smithi159 ceph-mon[69013]: pgmap v2790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:08.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:08 smithi096 ceph-mon[101353]: pgmap v2791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:08 smithi159 ceph-mon[69013]: pgmap v2791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:10.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:10 smithi096 ceph-mon[101353]: pgmap v2792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:10 smithi159 ceph-mon[69013]: pgmap v2792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:12.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:12 smithi096 ceph-mon[101353]: pgmap v2793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:12 smithi159 ceph-mon[69013]: pgmap v2793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:14 smithi159 ceph-mon[69013]: pgmap v2794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:14.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:14 smithi096 ceph-mon[101353]: pgmap v2794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:16 smithi159 ceph-mon[69013]: pgmap v2795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:16.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:16 smithi096 ceph-mon[101353]: pgmap v2795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:17 smithi159 ceph-mon[69013]: pgmap v2796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:17.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:17 smithi096 ceph-mon[101353]: pgmap v2796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:19 smithi159 ceph-mon[69013]: pgmap v2797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:20.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:19 smithi096 ceph-mon[101353]: pgmap v2797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:22.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:22 smithi096 ceph-mon[101353]: pgmap v2798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:22 smithi159 ceph-mon[69013]: pgmap v2798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:24.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:24 smithi096 ceph-mon[101353]: pgmap v2799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:24 smithi159 ceph-mon[69013]: pgmap v2799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:24.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 -- 172.21.15.96:0/3671584936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 msgr2=0x7f52a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:24.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 --2- 172.21.15.96:0/3671584936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a40f59e0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f5298004660 tx=0x7f5298009b30).stop 2022-02-02T19:55:24.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 -- 172.21.15.96:0/3671584936 shutdown_connections 2022-02-02T19:55:24.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 --2- 172.21.15.96:0/3671584936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 0x7f52a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:24.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 --2- 172.21.15.96:0/3671584936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a40f59e0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:24.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 -- 172.21.15.96:0/3671584936 >> 172.21.15.96:0/3671584936 conn(0x7f52a40f0d40 msgr2=0x7f52a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 -- 172.21.15.96:0/3671584936 shutdown_connections 2022-02-02T19:55:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.943+0000 7f52a9962700 1 -- 172.21.15.96:0/3671584936 wait complete. 2022-02-02T19:55:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 Processor -- start 2022-02-02T19:55:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 -- start start 2022-02-02T19:55:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 0x7f52a4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4069880 con 0x7f52a40f55c0 2022-02-02T19:55:24.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a9962700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a410f9f0 con 0x7f52a40f6860 2022-02-02T19:55:24.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:24.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34190/0 (socket says 172.21.15.96:34190) 2022-02-02T19:55:24.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 -- 172.21.15.96:0/999538935 learned_addr learned my addr 172.21.15.96:0/999538935 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:24.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a27fc700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 0x7f52a4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:24.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 -- 172.21.15.96:0/999538935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 msgr2=0x7f52a4069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:24.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 0x7f52a4069280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:24.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 -- 172.21.15.96:0/999538935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298005040 con 0x7f52a40f55c0 2022-02-02T19:55:24.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.944+0000 7f52a2ffd700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f5298013a70 tx=0x7f5298009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:24.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.945+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5298018070 con 0x7f52a40f55c0 2022-02-02T19:55:24.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.945+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52980097d0 con 0x7f52a40f55c0 2022-02-02T19:55:24.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.945+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a410fc70 con 0x7f52a40f55c0 2022-02-02T19:55:24.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.945+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529801de80 con 0x7f52a40f55c0 2022-02-02T19:55:24.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.945+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a41101d0 con 0x7f52a40f55c0 2022-02-02T19:55:24.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.946+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a40f49b0 con 0x7f52a40f55c0 2022-02-02T19:55:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.946+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5298007ba0 con 0x7f52a40f55c0 2022-02-02T19:55:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.947+0000 7f528b7fe700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 0x7f528c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.947+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5298083630 con 0x7f52a40f55c0 2022-02-02T19:55:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.947+0000 7f52a27fc700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 0x7f528c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.947+0000 7f52a27fc700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 0x7f528c067290 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f52a4068b20 tx=0x7f529400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:24.951+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5298055160 con 0x7f52a40f55c0 2022-02-02T19:55:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.129+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a405f620 con 0x7f528c064dd0 2022-02-02T19:55:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.130+0000 7f528b7fe700 1 -- 172.21.15.96:0/999538935 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f52a405f620 con 0x7f528c064dd0 2022-02-02T19:55:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 msgr2=0x7f528c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 0x7f528c067290 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f52a4068b20 tx=0x7f529400b040).stop 2022-02-02T19:55:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 msgr2=0x7f52a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f5298013a70 tx=0x7f5298009b30).stop 2022-02-02T19:55:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 shutdown_connections 2022-02-02T19:55:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f528c064dd0 0x7f528c067290 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52a40f55c0 0x7f52a4068d90 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 --2- 172.21.15.96:0/999538935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52a40f6860 0x7f52a4069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 >> 172.21.15.96:0/999538935 conn(0x7f52a40f0d40 msgr2=0x7f52a40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 shutdown_connections 2022-02-02T19:55:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.132+0000 7f52a9962700 1 -- 172.21.15.96:0/999538935 wait complete. 2022-02-02T19:55:25.145 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:55:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 -- 172.21.15.96:0/3109345632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 msgr2=0x7f18400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 --2- 172.21.15.96:0/3109345632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f18400f7de0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f183c004660 tx=0x7f183c009b30).stop 2022-02-02T19:55:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 -- 172.21.15.96:0/3109345632 shutdown_connections 2022-02-02T19:55:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 --2- 172.21.15.96:0/3109345632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f18400f7de0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 --2- 172.21.15.96:0/3109345632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 0x7f18400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 -- 172.21.15.96:0/3109345632 >> 172.21.15.96:0/3109345632 conn(0x7f18400f1e40 msgr2=0x7f18400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 -- 172.21.15.96:0/3109345632 shutdown_connections 2022-02-02T19:55:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.229+0000 7f18482ba700 1 -- 172.21.15.96:0/3109345632 wait complete. 2022-02-02T19:55:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 Processor -- start 2022-02-02T19:55:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 -- start start 2022-02-02T19:55:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 0x7f1840106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18401079e0 con 0x7f18400f7980 2022-02-02T19:55:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f18482ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840107b20 con 0x7f18400f66e0 2022-02-02T19:55:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f1845855700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f1845855700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34202/0 (socket says 172.21.15.96:34202) 2022-02-02T19:55:25.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f1845855700 1 -- 172.21.15.96:0/1704762645 learned_addr learned my addr 172.21.15.96:0/1704762645 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:25.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.230+0000 7f1846056700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 0x7f1840106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1845855700 1 -- 172.21.15.96:0/1704762645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 msgr2=0x7f1840106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1845855700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 0x7f1840106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1845855700 1 -- 172.21.15.96:0/1704762645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c005040 con 0x7f18400f7980 2022-02-02T19:55:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1845855700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f183c009990 tx=0x7f183c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f183c018070 con 0x7f18400f7980 2022-02-02T19:55:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1840108460 con 0x7f18400f7980 2022-02-02T19:55:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18401089c0 con 0x7f18400f7980 2022-02-02T19:55:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f183c007ba0 con 0x7f18400f7980 2022-02-02T19:55:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.231+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f183c01c620 con 0x7f18400f7980 2022-02-02T19:55:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.232+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828004fa0 con 0x7f18400f7980 2022-02-02T19:55:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.233+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f183c01c890 con 0x7f18400f7980 2022-02-02T19:55:25.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.233+0000 7f1836ffd700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 0x7f182c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.233+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f183c083770 con 0x7f18400f7980 2022-02-02T19:55:25.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.233+0000 7f1846056700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 0x7f182c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.233+0000 7f1846056700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 0x7f182c067290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f18400f77e0 tx=0x7f1830009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.237+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f183c055350 con 0x7f18400f7980 2022-02-02T19:55:25.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.411+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1828000bc0 con 0x7f182c064dd0 2022-02-02T19:55:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.420+0000 7f1836ffd700 1 -- 172.21.15.96:0/1704762645 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f1828000bc0 con 0x7f182c064dd0 2022-02-02T19:55:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:55:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (98m) 69m ago 99m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:55:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (91m) 69m ago 99m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:55:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (91m) 67m ago 99m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:55:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (98m) 69m ago 99m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:55:25.425 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (95m) 69m ago 95m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:55:25.425 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (91m) 69m ago 95m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:55:25.425 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (95m) 67m ago 95m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:55:25.425 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (91m) 67m ago 96m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:55:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (93m) 69m ago 100m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:55:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (92m) 67m ago 99m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:55:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (92m) 69m ago 101m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:55:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (91m) 67m ago 99m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:55:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (99m) 69m ago 99m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:55:25.427 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (99m) 67m ago 99m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:55:25.427 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (90m) 69m ago 98m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:55:25.427 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (90m) 69m ago 98m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:55:25.427 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (89m) 69m ago 98m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:55:25.428 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (89m) 67m ago 97m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:55:25.428 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (88m) 67m ago 97m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:55:25.428 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (88m) 67m ago 97m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:55:25.428 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (98m) 69m ago 99m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:55:25.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 msgr2=0x7f182c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 0x7f182c067290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f18400f77e0 tx=0x7f1830009040).stop 2022-02-02T19:55:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 msgr2=0x7f1840107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f183c009990 tx=0x7f183c009b30).stop 2022-02-02T19:55:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 shutdown_connections 2022-02-02T19:55:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f182c064dd0 0x7f182c067290 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18400f66e0 0x7f1840106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 --2- 172.21.15.96:0/1704762645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18400f7980 0x7f1840107430 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 >> 172.21.15.96:0/1704762645 conn(0x7f18400f1e40 msgr2=0x7f18400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 shutdown_connections 2022-02-02T19:55:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.422+0000 7f18482ba700 1 -- 172.21.15.96:0/1704762645 wait complete. 2022-02-02T19:55:25.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1256180449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f77d0 msgr2=0x7fa5b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1256180449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f77d0 0x7fa5b00f7c30 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fa5ac004660 tx=0x7fa5ac009b30).stop 2022-02-02T19:55:25.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1256180449 shutdown_connections 2022-02-02T19:55:25.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1256180449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f77d0 0x7fa5b00f7c30 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1256180449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f6530 0x7fa5b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1256180449 >> 172.21.15.96:0/1256180449 conn(0x7fa5b00f1c90 msgr2=0x7fa5b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1256180449 shutdown_connections 2022-02-02T19:55:25.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1256180449 wait complete. 2022-02-02T19:55:25.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.518+0000 7fa5b70b3700 1 Processor -- start 2022-02-02T19:55:25.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b70b3700 1 -- start start 2022-02-02T19:55:25.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b70b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b70b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f77d0 0x7fa5b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b70b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b006a380 con 0x7fa5b00f6530 2022-02-02T19:55:25.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b70b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b006a4c0 con 0x7fa5b00f77d0 2022-02-02T19:55:25.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34210/0 (socket says 172.21.15.96:34210) 2022-02-02T19:55:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 -- 172.21.15.96:0/1267204255 learned_addr learned my addr 172.21.15.96:0/1267204255 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b58b0700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f77d0 0x7fa5b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 -- 172.21.15.96:0/1267204255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f77d0 msgr2=0x7fa5b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f77d0 0x7fa5b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 -- 172.21.15.96:0/1267204255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac005040 con 0x7fa5b00f6530 2022-02-02T19:55:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.519+0000 7fa5b60b1700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fa5a0002700 tx=0x7fa5a0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.520+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a00079c0 con 0x7fa5b00f6530 2022-02-02T19:55:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.520+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b006a7a0 con 0x7fa5b00f6530 2022-02-02T19:55:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.520+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa5a000f040 con 0x7fa5b00f6530 2022-02-02T19:55:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.520+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a0014860 con 0x7fa5b00f6530 2022-02-02T19:55:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.520+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b010ed50 con 0x7fa5b00f6530 2022-02-02T19:55:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.521+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b0045ad0 con 0x7fa5b00f6530 2022-02-02T19:55:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.521+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa5a001b060 con 0x7fa5b00f6530 2022-02-02T19:55:25.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.521+0000 7fa5a6ffd700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 0x7fa59c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.522+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa5a00818e0 con 0x7fa5b00f6530 2022-02-02T19:55:25.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.522+0000 7fa5b58b0700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 0x7fa59c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.522+0000 7fa5b58b0700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 0x7fa59c0672e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fa5ac004630 tx=0x7fa5ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.526+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa5a004f9e0 con 0x7fa5b00f6530 2022-02-02T19:55:25.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.759+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5b00fee30 con 0x7fa5b00f6530 2022-02-02T19:55:25.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.760+0000 7fa5a6ffd700 1 -- 172.21.15.96:0/1267204255 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa5a00192e0 con 0x7fa5b00f6530 2022-02-02T19:55:25.764 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:55:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:55:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:55:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:55:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:55:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:55:25.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:55:25.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:25.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:55:25.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:55:25.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:25.767 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:55:25.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:55:25.768 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:55:25.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:55:25.768 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:55:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 msgr2=0x7fa59c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 0x7fa59c0672e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fa5ac004630 tx=0x7fa5ac009b30).stop 2022-02-02T19:55:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 msgr2=0x7fa5b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fa5a0002700 tx=0x7fa5a0009d80).stop 2022-02-02T19:55:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 shutdown_connections 2022-02-02T19:55:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa59c064e20 0x7fa59c0672e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5b00f6530 0x7fa5b006b9a0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 --2- 172.21.15.96:0/1267204255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5b00f77d0 0x7fa5b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 >> 172.21.15.96:0/1267204255 conn(0x7fa5b00f1c90 msgr2=0x7fa5b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 shutdown_connections 2022-02-02T19:55:25.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.762+0000 7fa5b70b3700 1 -- 172.21.15.96:0/1267204255 wait complete. 2022-02-02T19:55:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/1517787779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f6860 msgr2=0x7f5cb80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/1517787779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f6860 0x7f5cb80f6cc0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f5cb4004660 tx=0x7f5cb4009b30).stop 2022-02-02T19:55:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/1517787779 shutdown_connections 2022-02-02T19:55:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/1517787779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f6860 0x7f5cb80f6cc0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/1517787779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f55c0 0x7f5cb80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/1517787779 >> 172.21.15.96:0/1517787779 conn(0x7f5cb80f0d40 msgr2=0x7f5cb80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:25.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/1517787779 shutdown_connections 2022-02-02T19:55:25.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.860+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/1517787779 wait complete. 2022-02-02T19:55:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 Processor -- start 2022-02-02T19:55:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 -- start start 2022-02-02T19:55:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f6860 0x7f5cb810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80603c0 con 0x7f5cb80f55c0 2022-02-02T19:55:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8060500 con 0x7f5cb80f6860 2022-02-02T19:55:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34220/0 (socket says 172.21.15.96:34220) 2022-02-02T19:55:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 -- 172.21.15.96:0/470139286 learned_addr learned my addr 172.21.15.96:0/470139286 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbd25d700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f6860 0x7f5cb810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 -- 172.21.15.96:0/470139286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f6860 msgr2=0x7f5cb810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f6860 0x7f5cb810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 -- 172.21.15.96:0/470139286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4005040 con 0x7f5cb80f55c0 2022-02-02T19:55:25.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbda5e700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f5ca8002700 tx=0x7f5ca8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca8009320 con 0x7f5cb80f55c0 2022-02-02T19:55:25.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5ca800f040 con 0x7f5cb80f55c0 2022-02-02T19:55:25.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.861+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb810c720 con 0x7f5cb80f55c0 2022-02-02T19:55:25.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.862+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca8014900 con 0x7f5cb80f55c0 2022-02-02T19:55:25.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.862+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb810ccb0 con 0x7f5cb80f55c0 2022-02-02T19:55:25.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.862+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb80f49b0 con 0x7f5cb80f55c0 2022-02-02T19:55:25.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.863+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5ca8009480 con 0x7f5cb80f55c0 2022-02-02T19:55:25.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.863+0000 7f5cae7fc700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 0x7f5ca4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:25.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.863+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5ca8081cc0 con 0x7f5cb80f55c0 2022-02-02T19:55:25.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.863+0000 7f5cbd25d700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 0x7f5ca4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:25.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.864+0000 7f5cbd25d700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 0x7f5ca4067290 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f5cb4004630 tx=0x7f5cb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:25.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:25.867+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5ca804fe80 con 0x7f5cb80f55c0 2022-02-02T19:55:26.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.067+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5cb80586e0 con 0x7f5cb80f55c0 2022-02-02T19:55:26.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.067+0000 7f5cae7fc700 1 -- 172.21.15.96:0/470139286 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5ca80534a0 con 0x7f5cb80f55c0 2022-02-02T19:55:26.071 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:55:26.072 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:55:26.072 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:55:26.072 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:55:26.072 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:26.072 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:55:26.073 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:55:26.073 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:55:26.073 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:55:26.073 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:55:26.074 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:55:26.074 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:55:26.074 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:55:26.074 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:55:26.075 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:55:26.075 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:55:26.075 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:55:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:55:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:55:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:55:26.077 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:55:26.077 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:55:26.077 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:55:26.078 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:55:26.078 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:55:26.079 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:55:26.079 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:55:26.079 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:55:26.080 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:55:26.080 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:55:26.081 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:55:26.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:55:26.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:26.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:55:26.083 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:26.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 msgr2=0x7f5ca4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 0x7f5ca4067290 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f5cb4004630 tx=0x7f5cb4009b30).stop 2022-02-02T19:55:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 msgr2=0x7f5cb8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:26.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f5ca8002700 tx=0x7f5ca8009d80).stop 2022-02-02T19:55:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 shutdown_connections 2022-02-02T19:55:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ca4064dd0 0x7f5ca4067290 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb80f55c0 0x7f5cb8109c70 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:26.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 --2- 172.21.15.96:0/470139286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb80f6860 0x7f5cb810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 >> 172.21.15.96:0/470139286 conn(0x7f5cb80f0d40 msgr2=0x7f5cb80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:26.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 shutdown_connections 2022-02-02T19:55:26.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:26.069+0000 7f5cbfcc2700 1 -- 172.21.15.96:0/470139286 wait complete. 2022-02-02T19:55:26.090 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:55:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:26 smithi096 ceph-mon[101353]: pgmap v2800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:26 smithi096 ceph-mon[101353]: from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:26.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1267204255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:55:26.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/470139286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:55:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:26 smithi159 ceph-mon[69013]: pgmap v2800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:26 smithi159 ceph-mon[69013]: from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:26.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1267204255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:55:26.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/470139286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:55:27.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:27 smithi096 ceph-mon[101353]: from='client.36986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:27 smithi159 ceph-mon[69013]: from='client.36986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:28 smithi096 ceph-mon[101353]: pgmap v2801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:55:28.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:55:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:28 smithi159 ceph-mon[69013]: pgmap v2801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:55:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:55:30.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:30 smithi159 ceph-mon[69013]: pgmap v2802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:30.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:30 smithi096 ceph-mon[101353]: pgmap v2802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:32 smithi159 ceph-mon[69013]: pgmap v2803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:32.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:32 smithi096 ceph-mon[101353]: pgmap v2803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:34 smithi159 ceph-mon[69013]: pgmap v2804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:34.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:34 smithi096 ceph-mon[101353]: pgmap v2804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:36 smithi159 ceph-mon[69013]: pgmap v2805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:36.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:36 smithi096 ceph-mon[101353]: pgmap v2805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:37 smithi159 ceph-mon[69013]: pgmap v2806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:37 smithi096 ceph-mon[101353]: pgmap v2806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:39 smithi159 ceph-mon[69013]: pgmap v2807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:39 smithi096 ceph-mon[101353]: pgmap v2807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:42.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:42 smithi096 ceph-mon[101353]: pgmap v2808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:42 smithi159 ceph-mon[69013]: pgmap v2808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:44.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:44 smithi096 ceph-mon[101353]: pgmap v2809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:44 smithi159 ceph-mon[69013]: pgmap v2809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:46.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:46 smithi096 ceph-mon[101353]: pgmap v2810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:46.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:46 smithi159 ceph-mon[69013]: pgmap v2810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:48.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:48 smithi096 ceph-mon[101353]: pgmap v2811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:48 smithi159 ceph-mon[69013]: pgmap v2811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:50.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:50 smithi159 ceph-mon[69013]: pgmap v2812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:50.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:50 smithi096 ceph-mon[101353]: pgmap v2812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:52 smithi159 ceph-mon[69013]: pgmap v2813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:52.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:52 smithi096 ceph-mon[101353]: pgmap v2813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:54 smithi159 ceph-mon[69013]: pgmap v2814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:54 smithi096 ceph-mon[101353]: pgmap v2814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:56.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.179+0000 7fb770cba700 1 -- 172.21.15.96:0/1502999703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 msgr2=0x7fb76c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.179+0000 7fb770cba700 1 --2- 172.21.15.96:0/1502999703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c0f7de0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fb760004660 tx=0x7fb760009b30).stop 2022-02-02T19:55:56.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 -- 172.21.15.96:0/1502999703 shutdown_connections 2022-02-02T19:55:56.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 --2- 172.21.15.96:0/1502999703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c0f7de0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 --2- 172.21.15.96:0/1502999703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 0x7fb76c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 -- 172.21.15.96:0/1502999703 >> 172.21.15.96:0/1502999703 conn(0x7fb76c0f1e40 msgr2=0x7fb76c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:56.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 -- 172.21.15.96:0/1502999703 shutdown_connections 2022-02-02T19:55:56.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 -- 172.21.15.96:0/1502999703 wait complete. 2022-02-02T19:55:56.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 Processor -- start 2022-02-02T19:55:56.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.180+0000 7fb770cba700 1 -- start start 2022-02-02T19:55:56.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb770cba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 0x7fb76c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb770cba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb770cba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c107a00 con 0x7fb76c0f7980 2022-02-02T19:55:56.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb770cba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c107b40 con 0x7fb76c0f66e0 2022-02-02T19:55:56.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34242/0 (socket says 172.21.15.96:34242) 2022-02-02T19:55:56.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 -- 172.21.15.96:0/1192104668 learned_addr learned my addr 172.21.15.96:0/1192104668 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:56.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb76a59c700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 0x7fb76c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 -- 172.21.15.96:0/1192104668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 msgr2=0x7fb76c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 0x7fb76c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 -- 172.21.15.96:0/1192104668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760005040 con 0x7fb76c0f7980 2022-02-02T19:55:56.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb769d9b700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fb760009990 tx=0x7fb760009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.181+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb760018070 con 0x7fb76c0f7980 2022-02-02T19:55:56.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.182+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb760007ca0 con 0x7fb76c0f7980 2022-02-02T19:55:56.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.182+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c108480 con 0x7fb76c0f7980 2022-02-02T19:55:56.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.182+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb76001c620 con 0x7fb76c0f7980 2022-02-02T19:55:56.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.182+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c1089e0 con 0x7fb76c0f7980 2022-02-02T19:55:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.183+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c045ad0 con 0x7fb76c0f7980 2022-02-02T19:55:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.183+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb76001d960 con 0x7fb76c0f7980 2022-02-02T19:55:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.183+0000 7fb75affd700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 0x7fb754067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.184+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb7600837e0 con 0x7fb76c0f7980 2022-02-02T19:55:56.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.184+0000 7fb76a59c700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 0x7fb754067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.184+0000 7fb76a59c700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 0x7fb754067290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fb76c0f77e0 tx=0x7fb75c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.188+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb7600553d0 con 0x7fb76c0f7980 2022-02-02T19:55:56.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.368+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb76c108c00 con 0x7fb754064dd0 2022-02-02T19:55:56.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.369+0000 7fb75affd700 1 -- 172.21.15.96:0/1192104668 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb76c108c00 con 0x7fb754064dd0 2022-02-02T19:55:56.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 msgr2=0x7fb754067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 0x7fb754067290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fb76c0f77e0 tx=0x7fb75c009040).stop 2022-02-02T19:55:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 msgr2=0x7fb76c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fb760009990 tx=0x7fb760009b30).stop 2022-02-02T19:55:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 shutdown_connections 2022-02-02T19:55:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb754064dd0 0x7fb754067290 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb76c0f66e0 0x7fb76c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 --2- 172.21.15.96:0/1192104668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c0f7980 0x7fb76c107450 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 >> 172.21.15.96:0/1192104668 conn(0x7fb76c0f1e40 msgr2=0x7fb76c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 shutdown_connections 2022-02-02T19:55:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.371+0000 7fb770cba700 1 -- 172.21.15.96:0/1192104668 wait complete. 2022-02-02T19:55:56.383 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:55:56.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- 172.21.15.96:0/3901868894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f66e0 msgr2=0x7f68100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 --2- 172.21.15.96:0/3901868894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f66e0 0x7f68100f6b00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f67f8004660 tx=0x7f67f8009b30).stop 2022-02-02T19:55:56.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- 172.21.15.96:0/3901868894 shutdown_connections 2022-02-02T19:55:56.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 --2- 172.21.15.96:0/3901868894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f7980 0x7f68100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 --2- 172.21.15.96:0/3901868894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f66e0 0x7f68100f6b00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- 172.21.15.96:0/3901868894 >> 172.21.15.96:0/3901868894 conn(0x7f68100f1e40 msgr2=0x7f68100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:56.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- 172.21.15.96:0/3901868894 shutdown_connections 2022-02-02T19:55:56.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- 172.21.15.96:0/3901868894 wait complete. 2022-02-02T19:55:56.473 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:56 smithi096 ceph-mon[101353]: pgmap v2815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 Processor -- start 2022-02-02T19:55:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.468+0000 7f681627f700 1 -- start start 2022-02-02T19:55:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f681627f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f66e0 0x7f681006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f681627f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f681627f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681006a380 con 0x7f68100f7980 2022-02-02T19:55:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f681627f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681006a4c0 con 0x7f68100f66e0 2022-02-02T19:55:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34252/0 (socket says 172.21.15.96:34252) 2022-02-02T19:55:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 -- 172.21.15.96:0/2001030006 learned_addr learned my addr 172.21.15.96:0/2001030006 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680ffff700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f66e0 0x7f681006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 -- 172.21.15.96:0/2001030006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f66e0 msgr2=0x7f681006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f66e0 0x7f681006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 -- 172.21.15.96:0/2001030006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8005040 con 0x7f68100f7980 2022-02-02T19:55:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680f7fe700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f680000c530 tx=0x7f6800007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680000f650 con 0x7f68100f7980 2022-02-02T19:55:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f680000fc60 con 0x7f68100f7980 2022-02-02T19:55:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681006a7a0 con 0x7f68100f7980 2022-02-02T19:55:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.469+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6800012cd0 con 0x7f68100f7980 2022-02-02T19:55:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.470+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681010efe0 con 0x7f68100f7980 2022-02-02T19:55:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.471+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810045ad0 con 0x7f68100f7980 2022-02-02T19:55:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.471+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6800010070 con 0x7f68100f7980 2022-02-02T19:55:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.472+0000 7f680cff9700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 0x7f67fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.472+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68000817c0 con 0x7f68100f7980 2022-02-02T19:55:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.472+0000 7f680ffff700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 0x7f67fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.472+0000 7f680ffff700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 0x7f67fc067290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f67f8004e30 tx=0x7f67f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.476+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f680004f8c0 con 0x7f68100f7980 2022-02-02T19:55:56.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.651+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6810057f10 con 0x7f67fc064dd0 2022-02-02T19:55:56.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.662+0000 7f680cff9700 1 -- 172.21.15.96:0/2001030006 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f6810057f10 con 0x7f67fc064dd0 2022-02-02T19:55:56.665 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:55:56.665 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (99m) 69m ago 100m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:55:56.666 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (91m) 69m ago 100m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:55:56.666 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (91m) 68m ago 99m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:55:56.666 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (99m) 69m ago 100m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:55:56.666 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (96m) 69m ago 96m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:55:56.667 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (92m) 69m ago 96m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:55:56.667 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (96m) 68m ago 96m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:55:56.667 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (92m) 68m ago 96m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:55:56.667 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (93m) 69m ago 101m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:55:56.667 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (93m) 68m ago 99m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:55:56.668 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (92m) 69m ago 101m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:55:56.668 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (92m) 68m ago 99m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:55:56.668 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (100m) 69m ago 100m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:55:56.668 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (99m) 68m ago 99m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (91m) 69m ago 99m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (90m) 69m ago 98m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (90m) 69m ago 98m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:55:56.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (89m) 68m ago 98m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:55:56.670 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (89m) 68m ago 98m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:55:56.670 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (88m) 68m ago 97m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:55:56.670 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (99m) 69m ago 99m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:55:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 msgr2=0x7f67fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 0x7f67fc067290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f67f8004e30 tx=0x7f67f8009b30).stop 2022-02-02T19:55:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 msgr2=0x7f6810069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f680000c530 tx=0x7f6800007e20).stop 2022-02-02T19:55:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 shutdown_connections 2022-02-02T19:55:56.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67fc064dd0 0x7f67fc067290 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68100f66e0 0x7f681006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 --2- 172.21.15.96:0/2001030006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68100f7980 0x7f6810069e20 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 >> 172.21.15.96:0/2001030006 conn(0x7f68100f1e40 msgr2=0x7f68100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 shutdown_connections 2022-02-02T19:55:56.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.664+0000 7f681627f700 1 -- 172.21.15.96:0/2001030006 wait complete. 2022-02-02T19:55:56.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 -- 172.21.15.96:0/3594099842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 msgr2=0x7f34a40f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 --2- 172.21.15.96:0/3594099842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a40f6b60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f3494004660 tx=0x7f3494009b30).stop 2022-02-02T19:55:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 -- 172.21.15.96:0/3594099842 shutdown_connections 2022-02-02T19:55:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 --2- 172.21.15.96:0/3594099842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a40f6b60 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 --2- 172.21.15.96:0/3594099842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 0x7f34a40f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.760+0000 7f34a9560700 1 -- 172.21.15.96:0/3594099842 >> 172.21.15.96:0/3594099842 conn(0x7f34a40f0bc0 msgr2=0x7f34a40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.761+0000 7f34a9560700 1 -- 172.21.15.96:0/3594099842 shutdown_connections 2022-02-02T19:55:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.761+0000 7f34a9560700 1 -- 172.21.15.96:0/3594099842 wait complete. 2022-02-02T19:55:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.761+0000 7f34a9560700 1 Processor -- start 2022-02-02T19:55:56.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.761+0000 7f34a9560700 1 -- start start 2022-02-02T19:55:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a9560700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 0x7f34a4105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a9560700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a9560700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41067d0 con 0x7f34a40f6700 2022-02-02T19:55:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a9560700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4106fd0 con 0x7f34a40f5460 2022-02-02T19:55:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34262/0 (socket says 172.21.15.96:34262) 2022-02-02T19:55:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 -- 172.21.15.96:0/1726296550 learned_addr learned my addr 172.21.15.96:0/1726296550 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a2ffd700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 0x7f34a4105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 -- 172.21.15.96:0/1726296550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 msgr2=0x7f34a4105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 0x7f34a4105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 -- 172.21.15.96:0/1726296550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494005040 con 0x7f34a40f6700 2022-02-02T19:55:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f34a27fc700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f3494009990 tx=0x7f3494009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.762+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3494018070 con 0x7f34a40f6700 2022-02-02T19:55:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.763+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3494007ba0 con 0x7f34a40f6700 2022-02-02T19:55:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.763+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a4107250 con 0x7f34a40f6700 2022-02-02T19:55:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.763+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349401c620 con 0x7f34a40f6700 2022-02-02T19:55:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.763+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a41077b0 con 0x7f34a40f6700 2022-02-02T19:55:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.763+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4059100 con 0x7f34a40f6700 2022-02-02T19:55:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.765+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f349401c8e0 con 0x7f34a40f6700 2022-02-02T19:55:56.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.765+0000 7f348b7fe700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 0x7f348c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:56.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.765+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3494083b10 con 0x7f34a40f6700 2022-02-02T19:55:56.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.765+0000 7f34a2ffd700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 0x7f348c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:56.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.765+0000 7f34a2ffd700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 0x7f348c0672e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f34a40f6560 tx=0x7f3498009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:56.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:56.768+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3494055640 con 0x7f34a40f6700 2022-02-02T19:55:56.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:56 smithi159 ceph-mon[69013]: pgmap v2815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.001+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34a4027a00 con 0x7f34a40f6700 2022-02-02T19:55:57.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.002+0000 7f348b7fe700 1 -- 172.21.15.96:0/1726296550 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3494055230 con 0x7f34a40f6700 2022-02-02T19:55:57.006 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:55:57.006 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:55:57.006 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:55:57.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:57.007 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:55:57.007 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:55:57.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:57.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:55:57.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:55:57.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:57.008 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:55:57.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:55:57.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:55:57.009 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:55:57.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:55:57.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:55:57.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:55:57.009 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:55:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 msgr2=0x7f348c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 0x7f348c0672e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f34a40f6560 tx=0x7f3498009040).stop 2022-02-02T19:55:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 msgr2=0x7f34a4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f3494009990 tx=0x7f3494009b30).stop 2022-02-02T19:55:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 shutdown_connections 2022-02-02T19:55:57.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f348c064e20 0x7f348c0672e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a40f5460 0x7f34a4105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 --2- 172.21.15.96:0/1726296550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34a40f6700 0x7f34a4106220 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 >> 172.21.15.96:0/1726296550 conn(0x7f34a40f0bc0 msgr2=0x7f34a40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:57.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 shutdown_connections 2022-02-02T19:55:57.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.004+0000 7f34a9560700 1 -- 172.21.15.96:0/1726296550 wait complete. 2022-02-02T19:55:57.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 -- 172.21.15.96:0/1681028643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f6860 msgr2=0x7f53080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 --2- 172.21.15.96:0/1681028643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f6860 0x7f53080f6cc0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f52f8004660 tx=0x7f52f8009b30).stop 2022-02-02T19:55:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 -- 172.21.15.96:0/1681028643 shutdown_connections 2022-02-02T19:55:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 --2- 172.21.15.96:0/1681028643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f6860 0x7f53080f6cc0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 --2- 172.21.15.96:0/1681028643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f55c0 0x7f53080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 -- 172.21.15.96:0/1681028643 >> 172.21.15.96:0/1681028643 conn(0x7f53080f0d40 msgr2=0x7f53080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:57.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 -- 172.21.15.96:0/1681028643 shutdown_connections 2022-02-02T19:55:57.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.103+0000 7f530e49b700 1 -- 172.21.15.96:0/1681028643 wait complete. 2022-02-02T19:55:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 Processor -- start 2022-02-02T19:55:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 -- start start 2022-02-02T19:55:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6860 0x7f53081063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081069b0 con 0x7f53080f55c0 2022-02-02T19:55:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f530e49b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081071c0 con 0x7f53080f6860 2022-02-02T19:55:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f5307fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f5307fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34270/0 (socket says 172.21.15.96:34270) 2022-02-02T19:55:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f5307fff700 1 -- 172.21.15.96:0/3033249775 learned_addr learned my addr 172.21.15.96:0/3033249775 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:55:57.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f53077fe700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6860 0x7f53081063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:57.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f5307fff700 1 -- 172.21.15.96:0/3033249775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6860 msgr2=0x7f53081063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.104+0000 7f5307fff700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6860 0x7f53081063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f5307fff700 1 -- 172.21.15.96:0/3033249775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8005040 con 0x7f53080f55c0 2022-02-02T19:55:57.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f5307fff700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f52fc00f910 tx=0x7f52fc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:57.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc009500 con 0x7f53080f55c0 2022-02-02T19:55:57.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52fc009660 con 0x7f53080f55c0 2022-02-02T19:55:57.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53081073e0 con 0x7f53080f55c0 2022-02-02T19:55:57.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc00de20 con 0x7f53080f55c0 2022-02-02T19:55:57.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.105+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308107970 con 0x7f53080f55c0 2022-02-02T19:55:57.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.106+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53080f49b0 con 0x7f53080f55c0 2022-02-02T19:55:57.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.106+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52fc00e040 con 0x7f53080f55c0 2022-02-02T19:55:57.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.107+0000 7f5304ff9700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 0x7f52f0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:55:57.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.107+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52fc084150 con 0x7f53080f55c0 2022-02-02T19:55:57.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.107+0000 7f53077fe700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 0x7f52f0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:55:57.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.107+0000 7f53077fe700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 0x7f52f0067270 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f52f8004e30 tx=0x7f52f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:55:57.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.111+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52fc052250 con 0x7f53080f55c0 2022-02-02T19:55:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.316+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53080ff850 con 0x7f53080f55c0 2022-02-02T19:55:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.316+0000 7f5304ff9700 1 -- 172.21.15.96:0/3033249775 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f52fc055870 con 0x7f53080f55c0 2022-02-02T19:55:57.320 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:55:57.320 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:55:57.321 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:55:57.321 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:55:57.321 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:57.321 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:55:57.321 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:55:57.322 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:55:57.322 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:55:57.322 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:55:57.322 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:55:57.323 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:55:57.323 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:55:57.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:55:57.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:55:57.324 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:55:57.324 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:55:57.324 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:55:57.324 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:55:57.324 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:55:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:55:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:55:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:55:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:55:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:55:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:55:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:55:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:55:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:55:57.327 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:55:57.327 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:55:57.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:55:57.327 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:57.327 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:57.328 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:55:57.328 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:55:57.328 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:57.328 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:57.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:55:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 msgr2=0x7f52f0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 0x7f52f0067270 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f52f8004e30 tx=0x7f52f8009b30).stop 2022-02-02T19:55:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 msgr2=0x7f5308105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:55:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f52fc00f910 tx=0x7f52fc009d80).stop 2022-02-02T19:55:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 shutdown_connections 2022-02-02T19:55:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064db0 0x7f52f0067270 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f55c0 0x7f5308105ec0 secure :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0x7f52fc00f910 tx=0x7f52fc009d80).stop 2022-02-02T19:55:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 --2- 172.21.15.96:0/3033249775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6860 0x7f53081063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:55:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 >> 172.21.15.96:0/3033249775 conn(0x7f53080f0d40 msgr2=0x7f53080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:55:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 shutdown_connections 2022-02-02T19:55:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:55:57.318+0000 7f530e49b700 1 -- 172.21.15.96:0/3033249775 wait complete. 2022-02-02T19:55:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:55:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1726296550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:55:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3033249775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:55:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1726296550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:55:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3033249775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:55:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:58 smithi159 ceph-mon[69013]: from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:58 smithi159 ceph-mon[69013]: pgmap v2816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:58 smithi159 ceph-mon[69013]: from='client.37002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:58 smithi096 ceph-mon[101353]: from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:58 smithi096 ceph-mon[101353]: pgmap v2816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:58 smithi096 ceph-mon[101353]: from='client.37002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:55:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:55:59 smithi159 ceph-mon[69013]: pgmap v2817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:55:59.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:55:59 smithi096 ceph-mon[101353]: pgmap v2817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:02.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:02 smithi096 ceph-mon[101353]: pgmap v2818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:02 smithi159 ceph-mon[69013]: pgmap v2818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:04.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:04 smithi096 ceph-mon[101353]: pgmap v2819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:04 smithi159 ceph-mon[69013]: pgmap v2819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:06 smithi159 ceph-mon[69013]: pgmap v2820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:06.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:06 smithi096 ceph-mon[101353]: pgmap v2820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:08 smithi159 ceph-mon[69013]: pgmap v2821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:08.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:08 smithi096 ceph-mon[101353]: pgmap v2821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:10 smithi159 ceph-mon[69013]: pgmap v2822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:10 smithi096 ceph-mon[101353]: pgmap v2822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:12 smithi159 ceph-mon[69013]: pgmap v2823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:12.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:12 smithi096 ceph-mon[101353]: pgmap v2823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:14.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:14 smithi159 ceph-mon[69013]: pgmap v2824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:14.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:14 smithi096 ceph-mon[101353]: pgmap v2824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:15 smithi159 ceph-mon[69013]: pgmap v2825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:15.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:15 smithi096 ceph-mon[101353]: pgmap v2825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:18.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:18 smithi159 ceph-mon[69013]: pgmap v2826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:18.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:18 smithi096 ceph-mon[101353]: pgmap v2826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:20 smithi159 ceph-mon[69013]: pgmap v2827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:20.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:20 smithi096 ceph-mon[101353]: pgmap v2827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:22 smithi159 ceph-mon[69013]: pgmap v2828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:22.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:22 smithi096 ceph-mon[101353]: pgmap v2828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:24 smithi159 ceph-mon[69013]: pgmap v2829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:24.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:24 smithi096 ceph-mon[101353]: pgmap v2829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:26 smithi159 ceph-mon[69013]: pgmap v2830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:26.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:26 smithi096 ceph-mon[101353]: pgmap v2830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 -- 172.21.15.96:0/2320948158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 msgr2=0x7fddf40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 --2- 172.21.15.96:0/2320948158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf40f6cc0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fdde0004660 tx=0x7fdde0009b30).stop 2022-02-02T19:56:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 -- 172.21.15.96:0/2320948158 shutdown_connections 2022-02-02T19:56:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 --2- 172.21.15.96:0/2320948158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf40f6cc0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 --2- 172.21.15.96:0/2320948158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 0x7fddf40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 -- 172.21.15.96:0/2320948158 >> 172.21.15.96:0/2320948158 conn(0x7fddf40f0d40 msgr2=0x7fddf40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 -- 172.21.15.96:0/2320948158 shutdown_connections 2022-02-02T19:56:27.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.427+0000 7fddfab76700 1 -- 172.21.15.96:0/2320948158 wait complete. 2022-02-02T19:56:27.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 Processor -- start 2022-02-02T19:56:27.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 -- start start 2022-02-02T19:56:27.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 0x7fddf4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40603c0 con 0x7fddf40f6860 2022-02-02T19:56:27.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddfab76700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4060500 con 0x7fddf40f55c0 2022-02-02T19:56:27.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddf3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddf3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34290/0 (socket says 172.21.15.96:34290) 2022-02-02T19:56:27.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.428+0000 7fddf3fff700 1 -- 172.21.15.96:0/2507199326 learned_addr learned my addr 172.21.15.96:0/2507199326 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:27.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf8912700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 0x7fddf4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf3fff700 1 -- 172.21.15.96:0/2507199326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 msgr2=0x7fddf4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf3fff700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 0x7fddf4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf3fff700 1 -- 172.21.15.96:0/2507199326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0005040 con 0x7fddf40f6860 2022-02-02T19:56:27.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf3fff700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fdde0009990 tx=0x7fdde0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:27.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde0018070 con 0x7fddf40f6860 2022-02-02T19:56:27.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf410c6c0 con 0x7fddf40f6860 2022-02-02T19:56:27.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdde0007ba0 con 0x7fddf40f6860 2022-02-02T19:56:27.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde001c3c0 con 0x7fddf40f6860 2022-02-02T19:56:27.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.429+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf410cbf0 con 0x7fddf40f6860 2022-02-02T19:56:27.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.430+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40f49b0 con 0x7fddf40f6860 2022-02-02T19:56:27.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.431+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdde001d420 con 0x7fddf40f6860 2022-02-02T19:56:27.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.431+0000 7fddf17fa700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 0x7fdde4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.431+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdde00835e0 con 0x7fddf40f6860 2022-02-02T19:56:27.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.431+0000 7fddf8912700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 0x7fdde4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.431+0000 7fddf8912700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 0x7fdde4067290 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7fddf4060040 tx=0x7fdde800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:27.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.435+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdde00516e0 con 0x7fddf40f6860 2022-02-02T19:56:27.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.612+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf40fdf00 con 0x7fdde4064dd0 2022-02-02T19:56:27.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.614+0000 7fddf17fa700 1 -- 172.21.15.96:0/2507199326 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fddf40fdf00 con 0x7fdde4064dd0 2022-02-02T19:56:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 msgr2=0x7fdde4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 0x7fdde4067290 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7fddf4060040 tx=0x7fdde800b040).stop 2022-02-02T19:56:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 msgr2=0x7fddf410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fdde0009990 tx=0x7fdde0009b30).stop 2022-02-02T19:56:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 shutdown_connections 2022-02-02T19:56:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde4064dd0 0x7fdde4067290 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f55c0 0x7fddf4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 --2- 172.21.15.96:0/2507199326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f6860 0x7fddf410c170 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.615+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 >> 172.21.15.96:0/2507199326 conn(0x7fddf40f0d40 msgr2=0x7fddf40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:27.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.616+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 shutdown_connections 2022-02-02T19:56:27.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.616+0000 7fddfab76700 1 -- 172.21.15.96:0/2507199326 wait complete. 2022-02-02T19:56:27.628 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:56:27.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 -- 172.21.15.96:0/1167760572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 msgr2=0x7f55300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 --2- 172.21.15.96:0/1167760572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f55300f6950 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f5520004660 tx=0x7f5520009b30).stop 2022-02-02T19:56:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 -- 172.21.15.96:0/1167760572 shutdown_connections 2022-02-02T19:56:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 --2- 172.21.15.96:0/1167760572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 0x7f55300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 --2- 172.21.15.96:0/1167760572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f55300f6950 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 -- 172.21.15.96:0/1167760572 >> 172.21.15.96:0/1167760572 conn(0x7f55300f1c90 msgr2=0x7f55300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 -- 172.21.15.96:0/1167760572 shutdown_connections 2022-02-02T19:56:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 -- 172.21.15.96:0/1167760572 wait complete. 2022-02-02T19:56:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.713+0000 7f55354e3700 1 Processor -- start 2022-02-02T19:56:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f55354e3700 1 -- start start 2022-02-02T19:56:27.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f55354e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f55354e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 0x7f5530069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f55354e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553006a380 con 0x7f55300f6530 2022-02-02T19:56:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f55354e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553006a4c0 con 0x7f55300f77d0 2022-02-02T19:56:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34298/0 (socket says 172.21.15.96:34298) 2022-02-02T19:56:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 -- 172.21.15.96:0/1496072571 learned_addr learned my addr 172.21.15.96:0/1496072571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552f7fe700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 0x7f5530069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 -- 172.21.15.96:0/1496072571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 msgr2=0x7f5530069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 0x7f5530069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 -- 172.21.15.96:0/1496072571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520005040 con 0x7f55300f6530 2022-02-02T19:56:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552ffff700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f5520004f60 tx=0x7f5520009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.714+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5520018070 con 0x7f55300f6530 2022-02-02T19:56:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.715+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553006a740 con 0x7f55300f6530 2022-02-02T19:56:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.715+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5520009770 con 0x7f55300f6530 2022-02-02T19:56:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.715+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552001c3c0 con 0x7f55300f6530 2022-02-02T19:56:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.715+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553006aca0 con 0x7f55300f6530 2022-02-02T19:56:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.716+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5530045ad0 con 0x7f55300f6530 2022-02-02T19:56:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.716+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f552001d420 con 0x7f55300f6530 2022-02-02T19:56:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.716+0000 7f552cff9700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 0x7f55180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.716+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5520083840 con 0x7f55300f6530 2022-02-02T19:56:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.716+0000 7f552f7fe700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 0x7f55180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.717+0000 7f552f7fe700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 0x7f55180672e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f55240041d0 tx=0x7f5524009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.721+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5520051a00 con 0x7f55300f6530 2022-02-02T19:56:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.894+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5530057f10 con 0x7f5518064e20 2022-02-02T19:56:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.904+0000 7f552cff9700 1 -- 172.21.15.96:0/1496072571 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f5530057f10 con 0x7f5518064e20 2022-02-02T19:56:27.908 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:56:27.908 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (99m) 70m ago 100m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:56:27.909 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (92m) 70m ago 100m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:56:27.909 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (92m) 68m ago 100m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:56:27.910 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (99m) 70m ago 100m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:56:27.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (96m) 70m ago 96m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:56:27.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (92m) 70m ago 97m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:56:27.911 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (96m) 68m ago 96m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:56:27.911 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (92m) 68m ago 97m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:56:27.912 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (94m) 70m ago 102m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:56:27.912 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (93m) 68m ago 100m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:56:27.913 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (93m) 70m ago 102m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:56:27.913 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (92m) 68m ago 100m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:56:27.913 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (100m) 70m ago 100m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:56:27.914 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (100m) 68m ago 100m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:56:27.914 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (91m) 70m ago 99m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:56:27.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (91m) 70m ago 99m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:56:27.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (90m) 70m ago 99m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:56:27.916 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (90m) 68m ago 98m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:56:27.916 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (89m) 68m ago 98m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:56:27.917 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (89m) 68m ago 98m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:56:27.917 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (99m) 70m ago 100m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:56:27.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.905+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 msgr2=0x7f55180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.905+0000 7f55354e3700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 0x7f55180672e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f55240041d0 tx=0x7f5524009040).stop 2022-02-02T19:56:27.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.905+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 msgr2=0x7f553006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.905+0000 7f55354e3700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f5520004f60 tx=0x7f5520009b30).stop 2022-02-02T19:56:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 shutdown_connections 2022-02-02T19:56:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5518064e20 0x7f55180672e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55300f6530 0x7f553006b9a0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 --2- 172.21.15.96:0/1496072571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55300f77d0 0x7f5530069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 >> 172.21.15.96:0/1496072571 conn(0x7f55300f1c90 msgr2=0x7f55300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 shutdown_connections 2022-02-02T19:56:27.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:27.906+0000 7f55354e3700 1 -- 172.21.15.96:0/1496072571 wait complete. 2022-02-02T19:56:28.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.002+0000 7f968b6e2700 1 -- 172.21.15.96:0/135517190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f55c0 msgr2=0x7f96840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.002+0000 7f968b6e2700 1 --2- 172.21.15.96:0/135517190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f55c0 0x7f96840f59e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f9674004660 tx=0x7f9674009b30).stop 2022-02-02T19:56:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.002+0000 7f968b6e2700 1 -- 172.21.15.96:0/135517190 shutdown_connections 2022-02-02T19:56:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.002+0000 7f968b6e2700 1 --2- 172.21.15.96:0/135517190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f6860 0x7f96840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.002+0000 7f968b6e2700 1 --2- 172.21.15.96:0/135517190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f55c0 0x7f96840f59e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.003+0000 7f968b6e2700 1 -- 172.21.15.96:0/135517190 >> 172.21.15.96:0/135517190 conn(0x7f96840f0d40 msgr2=0x7f96840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.003+0000 7f968b6e2700 1 -- 172.21.15.96:0/135517190 shutdown_connections 2022-02-02T19:56:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.003+0000 7f968b6e2700 1 -- 172.21.15.96:0/135517190 wait complete. 2022-02-02T19:56:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.003+0000 7f968b6e2700 1 Processor -- start 2022-02-02T19:56:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.003+0000 7f968b6e2700 1 -- start start 2022-02-02T19:56:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968b6e2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f55c0 0x7f9684109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968b6e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968b6e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840603e0 con 0x7f96840f6860 2022-02-02T19:56:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968b6e2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9684060520 con 0x7f96840f55c0 2022-02-02T19:56:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34308/0 (socket says 172.21.15.96:34308) 2022-02-02T19:56:28.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 -- 172.21.15.96:0/932955005 learned_addr learned my addr 172.21.15.96:0/932955005 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:28.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968947e700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f55c0 0x7f9684109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 -- 172.21.15.96:0/932955005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f55c0 msgr2=0x7f9684109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f55c0 0x7f9684109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 -- 172.21.15.96:0/932955005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674005040 con 0x7f96840f6860 2022-02-02T19:56:28.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9688c7d700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f96800026d0 tx=0x7f9680009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:28.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96800079c0 con 0x7f96840f6860 2022-02-02T19:56:28.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f968000f040 con 0x7f96840f6860 2022-02-02T19:56:28.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.004+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968410c720 con 0x7f96840f6860 2022-02-02T19:56:28.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.005+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96800148b0 con 0x7f96840f6860 2022-02-02T19:56:28.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.005+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968410cce0 con 0x7f96840f6860 2022-02-02T19:56:28.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.006+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9680007b20 con 0x7f96840f6860 2022-02-02T19:56:28.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.006+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9684045ad0 con 0x7f96840f6860 2022-02-02T19:56:28.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.006+0000 7f9679ffb700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 0x7f9670067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.006+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f96800819e0 con 0x7f96840f6860 2022-02-02T19:56:28.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.007+0000 7f968947e700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 0x7f9670067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.007+0000 7f968947e700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 0x7f9670067290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f9674013690 tx=0x7f9674009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:28.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.011+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f968004fae0 con 0x7f96840f6860 2022-02-02T19:56:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.239+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9684027a00 con 0x7f96840f6860 2022-02-02T19:56:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.240+0000 7f9679ffb700 1 -- 172.21.15.96:0/932955005 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9680053100 con 0x7f96840f6860 2022-02-02T19:56:28.244 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:56:28.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:56:28.244 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:56:28.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:28.245 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:56:28.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:56:28.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:28.245 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:56:28.246 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:56:28.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:28.246 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:56:28.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:56:28.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:28.247 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:56:28.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:56:28.248 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:56:28.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:56:28.248 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:56:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.241+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 msgr2=0x7f9670067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.241+0000 7f968b6e2700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 0x7f9670067290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f9674013690 tx=0x7f9674009b30).stop 2022-02-02T19:56:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.241+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 msgr2=0x7f968410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.241+0000 7f968b6e2700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f96800026d0 tx=0x7f9680009de0).stop 2022-02-02T19:56:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 shutdown_connections 2022-02-02T19:56:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9670064dd0 0x7f9670067290 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96840f55c0 0x7f9684109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 --2- 172.21.15.96:0/932955005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96840f6860 0x7f968410c170 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 >> 172.21.15.96:0/932955005 conn(0x7f96840f0d40 msgr2=0x7f96840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 shutdown_connections 2022-02-02T19:56:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.242+0000 7f968b6e2700 1 -- 172.21.15.96:0/932955005 wait complete. 2022-02-02T19:56:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 -- 172.21.15.96:0/3573189820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 msgr2=0x7fd33c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 --2- 172.21.15.96:0/3573189820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c0f6b30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fd32c004660 tx=0x7fd32c009b30).stop 2022-02-02T19:56:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 -- 172.21.15.96:0/3573189820 shutdown_connections 2022-02-02T19:56:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 --2- 172.21.15.96:0/3573189820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c0f6b30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 --2- 172.21.15.96:0/3573189820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 0x7fd33c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 -- 172.21.15.96:0/3573189820 >> 172.21.15.96:0/3573189820 conn(0x7fd33c0f0b90 msgr2=0x7fd33c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 -- 172.21.15.96:0/3573189820 shutdown_connections 2022-02-02T19:56:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.340+0000 7fd33b59e700 1 -- 172.21.15.96:0/3573189820 wait complete. 2022-02-02T19:56:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 Processor -- start 2022-02-02T19:56:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 -- start start 2022-02-02T19:56:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 0x7fd33c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c106760 con 0x7fd33c0f66d0 2022-02-02T19:56:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c106f60 con 0x7fd33c0f5430 2022-02-02T19:56:28.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd339d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd339d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34318/0 (socket says 172.21.15.96:34318) 2022-02-02T19:56:28.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd339d9b700 1 -- 172.21.15.96:0/247878948 learned_addr learned my addr 172.21.15.96:0/247878948 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:28.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd33a59c700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 0x7fd33c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd339d9b700 1 -- 172.21.15.96:0/247878948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 msgr2=0x7fd33c105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.341+0000 7fd339d9b700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 0x7fd33c105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd339d9b700 1 -- 172.21.15.96:0/247878948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c005040 con 0x7fd33c0f66d0 2022-02-02T19:56:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd339d9b700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fd32c009990 tx=0x7fd32c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c01a070 con 0x7fd33c0f66d0 2022-02-02T19:56:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c1071e0 con 0x7fd33c0f66d0 2022-02-02T19:56:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd32c012a80 con 0x7fd33c0f66d0 2022-02-02T19:56:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32c01f9a0 con 0x7fd33c0f66d0 2022-02-02T19:56:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.342+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c107740 con 0x7fd33c0f66d0 2022-02-02T19:56:28.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.343+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c059100 con 0x7fd33c0f66d0 2022-02-02T19:56:28.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.343+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd32c012bf0 con 0x7fd33c0f66d0 2022-02-02T19:56:28.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.344+0000 7fd332ffd700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 0x7fd3280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:28.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.344+0000 7fd33a59c700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 0x7fd3280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:28.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.344+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd32c085d00 con 0x7fd33c0f66d0 2022-02-02T19:56:28.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.344+0000 7fd33a59c700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 0x7fd3280672e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fd33c0f6530 tx=0x7fd324009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:28.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.348+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd32c089030 con 0x7fd33c0f66d0 2022-02-02T19:56:28.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.548+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd33c0ff600 con 0x7fd33c0f66d0 2022-02-02T19:56:28.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.548+0000 7fd332ffd700 1 -- 172.21.15.96:0/247878948 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd32c057830 con 0x7fd33c0f66d0 2022-02-02T19:56:28.552 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:56:28.553 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:56:28.553 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:56:28.553 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:56:28.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:28.553 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:56:28.554 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:56:28.554 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:56:28.554 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:56:28.554 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:56:28.555 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:56:28.555 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:56:28.555 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:56:28.555 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:56:28.556 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:56:28.556 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:56:28.556 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:56:28.556 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:56:28.556 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:56:28.557 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:56:28.557 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:56:28.557 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:56:28.557 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:56:28.558 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:56:28.558 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:56:28.558 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:56:28.558 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:56:28.558 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:56:28.559 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:56:28.559 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:56:28.559 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:56:28.559 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:56:28.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:28.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:28.560 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:56:28.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:28.560 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:28.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:28.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:28.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 msgr2=0x7fd3280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 0x7fd3280672e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fd33c0f6530 tx=0x7fd324009040).stop 2022-02-02T19:56:28.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 msgr2=0x7fd33c1061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:28.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fd32c009990 tx=0x7fd32c009b30).stop 2022-02-02T19:56:28.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 shutdown_connections 2022-02-02T19:56:28.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd328064e20 0x7fd3280672e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c0f5430 0x7fd33c105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 --2- 172.21.15.96:0/247878948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd33c0f66d0 0x7fd33c1061b0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:28.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 >> 172.21.15.96:0/247878948 conn(0x7fd33c0f0b90 msgr2=0x7fd33c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:28.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 shutdown_connections 2022-02-02T19:56:28.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:28.550+0000 7fd33b59e700 1 -- 172.21.15.96:0/247878948 wait complete. 2022-02-02T19:56:28.565 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:56:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:28 smithi159 ceph-mon[69013]: pgmap v2831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:56:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:56:28.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/932955005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:56:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:28 smithi096 ceph-mon[101353]: pgmap v2831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:56:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:56:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/932955005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:56:29.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:29 smithi159 ceph-mon[69013]: from='client.37014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:29.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:29 smithi159 ceph-mon[69013]: from='client.37018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:29.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/247878948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:56:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:29 smithi096 ceph-mon[101353]: from='client.37014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:29 smithi096 ceph-mon[101353]: from='client.37018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/247878948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:56:30.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:30 smithi159 ceph-mon[69013]: pgmap v2832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:30.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:30 smithi096 ceph-mon[101353]: pgmap v2832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:32 smithi159 ceph-mon[69013]: pgmap v2833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:32 smithi096 ceph-mon[101353]: pgmap v2833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:34 smithi159 ceph-mon[69013]: pgmap v2834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:34 smithi096 ceph-mon[101353]: pgmap v2834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:36 smithi159 ceph-mon[69013]: pgmap v2835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:36.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:36 smithi096 ceph-mon[101353]: pgmap v2835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:38 smithi159 ceph-mon[69013]: pgmap v2836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:38.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:38 smithi096 ceph-mon[101353]: pgmap v2836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:40.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:40 smithi159 ceph-mon[69013]: pgmap v2837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:40.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:40 smithi096 ceph-mon[101353]: pgmap v2837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:42 smithi159 ceph-mon[69013]: pgmap v2838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:42.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:42 smithi096 ceph-mon[101353]: pgmap v2838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:43.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:43 smithi096 ceph-mon[101353]: pgmap v2839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:43 smithi159 ceph-mon[69013]: pgmap v2839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:46.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:45 smithi159 ceph-mon[69013]: pgmap v2840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:46.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:45 smithi096 ceph-mon[101353]: pgmap v2840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:48 smithi159 ceph-mon[69013]: pgmap v2841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:48 smithi096 ceph-mon[101353]: pgmap v2841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:50.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:50 smithi159 ceph-mon[69013]: pgmap v2842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:50.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:50 smithi096 ceph-mon[101353]: pgmap v2842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:52 smithi159 ceph-mon[69013]: pgmap v2843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:52.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:52 smithi096 ceph-mon[101353]: pgmap v2843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:54 smithi159 ceph-mon[69013]: pgmap v2844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:54 smithi096 ceph-mon[101353]: pgmap v2844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:56.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:56 smithi159 ceph-mon[69013]: pgmap v2845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:56.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:56 smithi096 ceph-mon[101353]: pgmap v2845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:58.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.659+0000 7f1b72f5c700 1 -- 172.21.15.96:0/214019814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 msgr2=0x7f1b6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.659+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/214019814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c0f7c30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f1b5c004660 tx=0x7f1b5c009b30).stop 2022-02-02T19:56:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 -- 172.21.15.96:0/214019814 shutdown_connections 2022-02-02T19:56:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/214019814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c0f7c30 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/214019814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 0x7f1b6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 -- 172.21.15.96:0/214019814 >> 172.21.15.96:0/214019814 conn(0x7f1b6c0f1c90 msgr2=0x7f1b6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:58.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:58 smithi096 ceph-mon[101353]: pgmap v2846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:58.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 -- 172.21.15.96:0/214019814 shutdown_connections 2022-02-02T19:56:58.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 -- 172.21.15.96:0/214019814 wait complete. 2022-02-02T19:56:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 Processor -- start 2022-02-02T19:56:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 -- start start 2022-02-02T19:56:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.660+0000 7f1b72f5c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 0x7f1b6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b72f5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b72f5c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c06a380 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b72f5c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c06a4c0 con 0x7f1b6c0f6530 2022-02-02T19:56:58.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34340/0 (socket says 172.21.15.96:34340) 2022-02-02T19:56:58.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 -- 172.21.15.96:0/2008147557 learned_addr learned my addr 172.21.15.96:0/2008147557 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:58.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71f5a700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 0x7f1b6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 -- 172.21.15.96:0/2008147557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 msgr2=0x7f1b6c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 0x7f1b6c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 -- 172.21.15.96:0/2008147557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c005040 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b71759700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f1b5c009da0 tx=0x7f1b5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:58.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.661+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c018070 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.662+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b5c007cf0 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.662+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c01c620 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.662+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c06a740 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.662+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c06aca0 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.663+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c045ad0 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.663+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b5c01d420 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.664+0000 7f1b627fc700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 0x7f1b580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.664+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b5c0838a0 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.664+0000 7f1b71f5a700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 0x7f1b580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.664+0000 7f1b71f5a700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 0x7f1b580672e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f1b6c06b730 tx=0x7f1b68009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:58.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.668+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b5c051a60 con 0x7f1b6c0f77d0 2022-02-02T19:56:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:58 smithi159 ceph-mon[69013]: pgmap v2846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.847+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b6c0feea0 con 0x7f1b58064e20 2022-02-02T19:56:58.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.849+0000 7f1b627fc700 1 -- 172.21.15.96:0/2008147557 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b68004780 con 0x7f1b58064e20 2022-02-02T19:56:58.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 msgr2=0x7f1b580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 0x7f1b580672e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f1b6c06b730 tx=0x7f1b68009040).stop 2022-02-02T19:56:58.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 msgr2=0x7f1b6c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f1b5c009da0 tx=0x7f1b5c009b30).stop 2022-02-02T19:56:58.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 shutdown_connections 2022-02-02T19:56:58.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b58064e20 0x7f1b580672e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6c0f6530 0x7f1b6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 --2- 172.21.15.96:0/2008147557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6c0f77d0 0x7f1b6c069e20 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 >> 172.21.15.96:0/2008147557 conn(0x7f1b6c0f1c90 msgr2=0x7f1b6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:58.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.850+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 shutdown_connections 2022-02-02T19:56:58.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.851+0000 7f1b72f5c700 1 -- 172.21.15.96:0/2008147557 wait complete. 2022-02-02T19:56:58.864 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:56:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 -- 172.21.15.96:0/31778203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f6860 msgr2=0x7f63800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 --2- 172.21.15.96:0/31778203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f6860 0x7f63800f6cc0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f637c004660 tx=0x7f637c009b30).stop 2022-02-02T19:56:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 -- 172.21.15.96:0/31778203 shutdown_connections 2022-02-02T19:56:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 --2- 172.21.15.96:0/31778203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f6860 0x7f63800f6cc0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 --2- 172.21.15.96:0/31778203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f55c0 0x7f63800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 -- 172.21.15.96:0/31778203 >> 172.21.15.96:0/31778203 conn(0x7f63800f0d40 msgr2=0x7f63800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 -- 172.21.15.96:0/31778203 shutdown_connections 2022-02-02T19:56:58.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.948+0000 7f6387546700 1 -- 172.21.15.96:0/31778203 wait complete. 2022-02-02T19:56:58.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 Processor -- start 2022-02-02T19:56:58.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 -- start start 2022-02-02T19:56:58.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 0x7f63801063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801069b0 con 0x7f63800f55c0 2022-02-02T19:56:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6387546700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801071c0 con 0x7f63800f6860 2022-02-02T19:56:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34348/0 (socket says 172.21.15.96:34348) 2022-02-02T19:56:58.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 -- 172.21.15.96:0/1910113427 learned_addr learned my addr 172.21.15.96:0/1910113427 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:58.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6384ae1700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 0x7f63801063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 -- 172.21.15.96:0/1910113427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 msgr2=0x7f63801063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:58.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 0x7f63801063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:58.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f63852e2700 1 -- 172.21.15.96:0/1910113427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c005040 con 0x7f63800f55c0 2022-02-02T19:56:58.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.949+0000 7f6384ae1700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 0x7f63801063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:56:58.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f63852e2700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f637000e9a0 tx=0x7f6370007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:58.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f637000c9b0 con 0x7f63800f55c0 2022-02-02T19:56:58.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63801073e0 con 0x7f63800f55c0 2022-02-02T19:56:58.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6370011470 con 0x7f63800f55c0 2022-02-02T19:56:58.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6370010610 con 0x7f63800f55c0 2022-02-02T19:56:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.950+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6380107970 con 0x7f63800f55c0 2022-02-02T19:56:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.951+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63800f49b0 con 0x7f63800f55c0 2022-02-02T19:56:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.951+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f63700108d0 con 0x7f63800f55c0 2022-02-02T19:56:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.951+0000 7f6375ffb700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 0x7f636c067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:58.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.952+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6370084a30 con 0x7f63800f55c0 2022-02-02T19:56:58.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.952+0000 7f6384ae1700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 0x7f636c067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:58.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.952+0000 7f6384ae1700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 0x7f636c067230 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f637c009da0 tx=0x7f637c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:58.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:58.956+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6370052ad0 con 0x7f63800f55c0 2022-02-02T19:56:59.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.129+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f638005f620 con 0x7f636c064d70 2022-02-02T19:56:59.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.138+0000 7f6375ffb700 1 -- 172.21.15.96:0/1910113427 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f638005f620 con 0x7f636c064d70 2022-02-02T19:56:59.143 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:56:59.144 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (100m) 70m ago 101m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:56:59.144 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (92m) 70m ago 101m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:56:59.144 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (92m) 69m ago 100m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:56:59.145 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (100m) 70m ago 101m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:56:59.145 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (97m) 70m ago 97m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:56:59.145 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (93m) 70m ago 97m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:56:59.146 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (97m) 69m ago 97m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:56:59.146 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (93m) 69m ago 97m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:56:59.146 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (94m) 70m ago 102m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:56:59.146 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (94m) 69m ago 100m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:56:59.146 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (93m) 70m ago 102m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:56:59.147 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (93m) 69m ago 100m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:56:59.147 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (101m) 70m ago 101m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:56:59.147 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (100m) 69m ago 100m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:56:59.147 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (92m) 70m ago 100m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:56:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (91m) 70m ago 99m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:56:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (91m) 70m ago 99m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:56:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (90m) 69m ago 99m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:56:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (90m) 69m ago 99m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:56:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (89m) 69m ago 98m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:56:59.149 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (100m) 70m ago 101m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:56:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 msgr2=0x7f636c067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 0x7f636c067230 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f637c009da0 tx=0x7f637c009b30).stop 2022-02-02T19:56:59.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 msgr2=0x7f6380105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f637000e9a0 tx=0x7f6370007e20).stop 2022-02-02T19:56:59.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 shutdown_connections 2022-02-02T19:56:59.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f636c064d70 0x7f636c067230 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63800f55c0 0x7f6380105ec0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 --2- 172.21.15.96:0/1910113427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63800f6860 0x7f63801063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 >> 172.21.15.96:0/1910113427 conn(0x7f63800f0d40 msgr2=0x7f63800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:59.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 shutdown_connections 2022-02-02T19:56:59.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.140+0000 7f6387546700 1 -- 172.21.15.96:0/1910113427 wait complete. 2022-02-02T19:56:59.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 -- 172.21.15.96:0/3590494066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 msgr2=0x7f61c40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3590494066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c40f5850 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f61b8004660 tx=0x7f61b8009b30).stop 2022-02-02T19:56:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 -- 172.21.15.96:0/3590494066 shutdown_connections 2022-02-02T19:56:59.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3590494066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 0x7f61c40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3590494066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c40f5850 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 -- 172.21.15.96:0/3590494066 >> 172.21.15.96:0/3590494066 conn(0x7f61c40f0b90 msgr2=0x7f61c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:59.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 -- 172.21.15.96:0/3590494066 shutdown_connections 2022-02-02T19:56:59.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.237+0000 7f61c9b70700 1 -- 172.21.15.96:0/3590494066 wait complete. 2022-02-02T19:56:59.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 Processor -- start 2022-02-02T19:56:59.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 -- start start 2022-02-02T19:56:59.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 0x7f61c4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41067d0 con 0x7f61c40f5430 2022-02-02T19:56:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.238+0000 7f61c9b70700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4106fd0 con 0x7f61c40f66d0 2022-02-02T19:56:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 0x7f61c4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34358/0 (socket says 172.21.15.96:34358) 2022-02-02T19:56:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 -- 172.21.15.96:0/3343339155 learned_addr learned my addr 172.21.15.96:0/3343339155 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 -- 172.21.15.96:0/3343339155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 msgr2=0x7f61c4106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 0x7f61c4106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 -- 172.21.15.96:0/3343339155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8005040 con 0x7f61c40f5430 2022-02-02T19:56:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c8b6e700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f61b8004f60 tx=0x7f61b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b8018070 con 0x7f61c40f5430 2022-02-02T19:56:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c4107250 con 0x7f61c40f5430 2022-02-02T19:56:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c41077b0 con 0x7f61c40f5430 2022-02-02T19:56:59.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61b8009770 con 0x7f61c40f5430 2022-02-02T19:56:59.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.239+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b801dcc0 con 0x7f61c40f5430 2022-02-02T19:56:59.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.240+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4004fa0 con 0x7f61c40f5430 2022-02-02T19:56:59.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.241+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f61b8027440 con 0x7f61c40f5430 2022-02-02T19:56:59.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.241+0000 7f61c17fa700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 0x7f61b40694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.241+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f61b8083570 con 0x7f61c40f5430 2022-02-02T19:56:59.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.241+0000 7f61c3fff700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 0x7f61b40694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.242+0000 7f61c3fff700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 0x7f61b40694f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f61b0007fd0 tx=0x7f61b0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:59.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.245+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f61b8055110 con 0x7f61c40f5430 2022-02-02T19:56:59.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.476+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61a4005e80 con 0x7f61c40f5430 2022-02-02T19:56:59.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.477+0000 7f61c17fa700 1 -- 172.21.15.96:0/3343339155 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f61b8054d00 con 0x7f61c40f5430 2022-02-02T19:56:59.481 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:56:59.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:56:59.482 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:56:59.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:59.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:56:59.483 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:56:59.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:59.483 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:56:59.483 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:56:59.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:59.484 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:56:59.484 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:56:59.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:56:59.484 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:56:59.484 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:56:59.485 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:56:59.485 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:56:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:56:59.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 msgr2=0x7f61b40694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 0x7f61b40694f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f61b0007fd0 tx=0x7f61b0009040).stop 2022-02-02T19:56:59.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 msgr2=0x7f61c4105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f61b8004f60 tx=0x7f61b8009b30).stop 2022-02-02T19:56:59.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 shutdown_connections 2022-02-02T19:56:59.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61b4067030 0x7f61b40694f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61c40f5430 0x7f61c4105d30 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 --2- 172.21.15.96:0/3343339155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c40f66d0 0x7f61c4106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.478+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 >> 172.21.15.96:0/3343339155 conn(0x7f61c40f0b90 msgr2=0x7f61c40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.479+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 shutdown_connections 2022-02-02T19:56:59.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.479+0000 7f61c9b70700 1 -- 172.21.15.96:0/3343339155 wait complete. 2022-02-02T19:56:59.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:59 smithi096 ceph-mon[101353]: pgmap v2847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:59.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:59 smithi096 ceph-mon[101353]: from='client.37030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:59.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:56:59 smithi096 ceph-mon[101353]: from='client.37034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 -- 172.21.15.96:0/960366970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f4d60 msgr2=0x7f06880f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 --2- 172.21.15.96:0/960366970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f4d60 0x7f06880f5180 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f067c004770 tx=0x7f067c00ac40).stop 2022-02-02T19:56:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 -- 172.21.15.96:0/960366970 shutdown_connections 2022-02-02T19:56:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 --2- 172.21.15.96:0/960366970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f5f60 0x7f06880f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 --2- 172.21.15.96:0/960366970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f4d60 0x7f06880f5180 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 -- 172.21.15.96:0/960366970 >> 172.21.15.96:0/960366970 conn(0x7f06880f04c0 msgr2=0x7f06880f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 -- 172.21.15.96:0/960366970 shutdown_connections 2022-02-02T19:56:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.576+0000 7f068e43f700 1 -- 172.21.15.96:0/960366970 wait complete. 2022-02-02T19:56:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 Processor -- start 2022-02-02T19:56:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 -- start start 2022-02-02T19:56:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f4d60 0x7f0688106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688107a80 con 0x7f06880f5f60 2022-02-02T19:56:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f068e43f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688107bc0 con 0x7f06880f4d60 2022-02-02T19:56:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f06877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f06877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34370/0 (socket says 172.21.15.96:34370) 2022-02-02T19:56:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f06877fe700 1 -- 172.21.15.96:0/670427587 learned_addr learned my addr 172.21.15.96:0/670427587 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:56:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f0687fff700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f4d60 0x7f0688106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.577+0000 7f06877fe700 1 -- 172.21.15.96:0/670427587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f4d60 msgr2=0x7f0688106fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f06877fe700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f4d60 0x7f0688106fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f06877fe700 1 -- 172.21.15.96:0/670427587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c005040 con 0x7f06880f5f60 2022-02-02T19:56:59.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f06877fe700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f067800c530 tx=0x7f0678007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f067800f650 con 0x7f06880f5f60 2022-02-02T19:56:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f067800fc60 con 0x7f06880f5f60 2022-02-02T19:56:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0678012c20 con 0x7f06880f5f60 2022-02-02T19:56:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0688108560 con 0x7f06880f5f60 2022-02-02T19:56:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.578+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0688108ad0 con 0x7f06880f5f60 2022-02-02T19:56:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.579+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0678010070 con 0x7f06880f5f60 2022-02-02T19:56:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.580+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0688045ad0 con 0x7f06880f5f60 2022-02-02T19:56:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.580+0000 7f0684ff9700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 0x7f0670067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:56:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.580+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0678081720 con 0x7f06880f5f60 2022-02-02T19:56:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.580+0000 7f0687fff700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 0x7f0670067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:56:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.580+0000 7f0687fff700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 0x7f0670067290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f067c004740 tx=0x7f067c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:56:59.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.584+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0678053250 con 0x7f06880f5f60 2022-02-02T19:56:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:59 smithi159 ceph-mon[69013]: pgmap v2847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:56:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:59 smithi159 ceph-mon[69013]: from='client.37030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:56:59 smithi159 ceph-mon[69013]: from='client.37034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:56:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.784+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0688027a00 con 0x7f06880f5f60 2022-02-02T19:56:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.784+0000 7f0684ff9700 1 -- 172.21.15.96:0/670427587 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f067804f020 con 0x7f06880f5f60 2022-02-02T19:56:59.790 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:56:59.790 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:56:59.790 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:56:59.791 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:56:59.791 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:59.791 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:56:59.791 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:56:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:56:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:56:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:56:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:56:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:56:59.793 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:56:59.793 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:56:59.793 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:56:59.793 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:56:59.794 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:56:59.794 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:56:59.794 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:56:59.794 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:56:59.794 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:56:59.795 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:56:59.795 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:56:59.795 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:56:59.795 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:56:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:56:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:56:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:56:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:56:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:56:59.797 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:56:59.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:56:59.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:59.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:59.797 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:56:59.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:56:59.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:59.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:59.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:56:59.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 msgr2=0x7f0670067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 0x7f0670067290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f067c004740 tx=0x7f067c016040).stop 2022-02-02T19:56:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 msgr2=0x7f06881074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:56:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f067800c530 tx=0x7f0678007e20).stop 2022-02-02T19:56:59.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 shutdown_connections 2022-02-02T19:56:59.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0670064dd0 0x7f0670067290 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880f4d60 0x7f0688106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 --2- 172.21.15.96:0/670427587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06880f5f60 0x7f06881074d0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:56:59.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 >> 172.21.15.96:0/670427587 conn(0x7f06880f04c0 msgr2=0x7f06880f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:56:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.786+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 shutdown_connections 2022-02-02T19:56:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:56:59.787+0000 7f068e43f700 1 -- 172.21.15.96:0/670427587 wait complete. 2022-02-02T19:56:59.802 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:57:00.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3343339155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:57:00.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/670427587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:57:00.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3343339155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:57:00.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/670427587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:57:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:02 smithi159 ceph-mon[69013]: pgmap v2848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:02 smithi096 ceph-mon[101353]: pgmap v2848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:04 smithi159 ceph-mon[69013]: pgmap v2849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:04 smithi096 ceph-mon[101353]: pgmap v2849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:06 smithi159 ceph-mon[69013]: pgmap v2850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:06.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:06 smithi096 ceph-mon[101353]: pgmap v2850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:08 smithi159 ceph-mon[69013]: pgmap v2851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:08.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:08 smithi096 ceph-mon[101353]: pgmap v2851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:10 smithi159 ceph-mon[69013]: pgmap v2852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:10 smithi096 ceph-mon[101353]: pgmap v2852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:12 smithi159 ceph-mon[69013]: pgmap v2853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:12 smithi096 ceph-mon[101353]: pgmap v2853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:14 smithi159 ceph-mon[69013]: pgmap v2854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:14.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:14 smithi096 ceph-mon[101353]: pgmap v2854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:15.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:15 smithi159 ceph-mon[69013]: pgmap v2855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:15.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:15 smithi096 ceph-mon[101353]: pgmap v2855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:18.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:18 smithi159 ceph-mon[69013]: pgmap v2856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:18.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:18 smithi096 ceph-mon[101353]: pgmap v2856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:20.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:20 smithi159 ceph-mon[69013]: pgmap v2857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:20.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:20 smithi096 ceph-mon[101353]: pgmap v2857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:22 smithi159 ceph-mon[69013]: pgmap v2858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:22.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:22 smithi096 ceph-mon[101353]: pgmap v2858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:24 smithi159 ceph-mon[69013]: pgmap v2859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:24.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:24 smithi096 ceph-mon[101353]: pgmap v2859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:26 smithi159 ceph-mon[69013]: pgmap v2860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:26.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:26 smithi096 ceph-mon[101353]: pgmap v2860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:27 smithi159 ceph-mon[69013]: pgmap v2861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:57:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:57:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:27 smithi096 ceph-mon[101353]: pgmap v2861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:57:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:57:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 -- 172.21.15.96:0/3265367395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 msgr2=0x7f5ef00f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/3265367395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f93c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f5ee0004660 tx=0x7f5ee0009b30).stop 2022-02-02T19:57:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 -- 172.21.15.96:0/3265367395 shutdown_connections 2022-02-02T19:57:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/3265367395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:57:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/3265367395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f93c0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 -- 172.21.15.96:0/3265367395 >> 172.21.15.96:0/3265367395 conn(0x7f5ef00f0de0 msgr2=0x7f5ef00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 -- 172.21.15.96:0/3265367395 shutdown_connections 2022-02-02T19:57:29.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.897+0000 7f5ef52e4700 1 -- 172.21.15.96:0/3265367395 wait complete. 2022-02-02T19:57:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 Processor -- start 2022-02-02T19:57:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 -- start start 2022-02-02T19:57:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef010acc0 con 0x7f5ef0060310 2022-02-02T19:57:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.898+0000 7f5ef52e4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef010ae00 con 0x7f5ef00f98b0 2022-02-02T19:57:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34388/0 (socket says 172.21.15.96:34388) 2022-02-02T19:57:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 -- 172.21.15.96:0/2732614508 learned_addr learned my addr 172.21.15.96:0/2732614508 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:57:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eee7fc700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 -- 172.21.15.96:0/2732614508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 msgr2=0x7f5ef00f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 -- 172.21.15.96:0/2732614508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0005040 con 0x7f5ef0060310 2022-02-02T19:57:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eee7fc700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:57:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5eeeffd700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f5ee0004f60 tx=0x7f5ee0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee0018070 con 0x7f5ef0060310 2022-02-02T19:57:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5ee0007ba0 con 0x7f5ef0060310 2022-02-02T19:57:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef00f58a0 con 0x7f5ef0060310 2022-02-02T19:57:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee001c620 con 0x7f5ef0060310 2022-02-02T19:57:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.899+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef00f5e00 con 0x7f5ef0060310 2022-02-02T19:57:29.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.901+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0045ad0 con 0x7f5ef0060310 2022-02-02T19:57:29.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.901+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5ee001c8e0 con 0x7f5ef0060310 2022-02-02T19:57:29.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.901+0000 7f5ed77fe700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 0x7f5ed8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:29.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.901+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5ee0083960 con 0x7f5ef0060310 2022-02-02T19:57:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.901+0000 7f5eee7fc700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 0x7f5ed8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.902+0000 7f5eee7fc700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 0x7f5ed8067290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5ee400a880 tx=0x7f5ee4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:29.906+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5ee0051b20 con 0x7f5ef0060310 2022-02-02T19:57:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:29 smithi159 ceph-mon[69013]: pgmap v2862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:30.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:29 smithi096 ceph-mon[101353]: pgmap v2862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:30.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.086+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ef00fef30 con 0x7f5ed8064dd0 2022-02-02T19:57:30.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.088+0000 7f5ed77fe700 1 -- 172.21.15.96:0/2732614508 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5ef00fef30 con 0x7f5ed8064dd0 2022-02-02T19:57:30.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 msgr2=0x7f5ed8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 0x7f5ed8067290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5ee400a880 tx=0x7f5ee4008040).stop 2022-02-02T19:57:30.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 msgr2=0x7f5ef00f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f5ee0004f60 tx=0x7f5ee0009b30).stop 2022-02-02T19:57:30.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 shutdown_connections 2022-02-02T19:57:30.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ed8064dd0 0x7f5ed8067290 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ef0060310 0x7f5ef00f6e40 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 --2- 172.21.15.96:0/2732614508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef00f98b0 0x7f5ef00f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.089+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 >> 172.21.15.96:0/2732614508 conn(0x7f5ef00f0de0 msgr2=0x7f5ef00f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.090+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 shutdown_connections 2022-02-02T19:57:30.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.090+0000 7f5ef52e4700 1 -- 172.21.15.96:0/2732614508 wait complete. 2022-02-02T19:57:30.102 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:57:30.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 -- 172.21.15.96:0/2649991512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f66e0 msgr2=0x7fd9e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/2649991512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f66e0 0x7fd9e40f6b00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fd9d4004660 tx=0x7fd9d4009b30).stop 2022-02-02T19:57:30.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 -- 172.21.15.96:0/2649991512 shutdown_connections 2022-02-02T19:57:30.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/2649991512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f7980 0x7fd9e40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/2649991512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f66e0 0x7fd9e40f6b00 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 -- 172.21.15.96:0/2649991512 >> 172.21.15.96:0/2649991512 conn(0x7fd9e40f1e40 msgr2=0x7fd9e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 -- 172.21.15.96:0/2649991512 shutdown_connections 2022-02-02T19:57:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.187+0000 7fd9ec06a700 1 -- 172.21.15.96:0/2649991512 wait complete. 2022-02-02T19:57:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 Processor -- start 2022-02-02T19:57:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 -- start start 2022-02-02T19:57:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 0x7fd9e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e406a380 con 0x7fd9e40f7980 2022-02-02T19:57:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9ec06a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e406a4c0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9605700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9605700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34400/0 (socket says 172.21.15.96:34400) 2022-02-02T19:57:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9605700 1 -- 172.21.15.96:0/1562622100 learned_addr learned my addr 172.21.15.96:0/1562622100 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:57:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9e06700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 0x7fd9e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9e06700 1 -- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 msgr2=0x7fd9e4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9e06700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9e06700 1 -- 172.21.15.96:0/1562622100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4005040 con 0x7fd9e40f66e0 2022-02-02T19:57:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.188+0000 7fd9e9605700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T19:57:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9e9e06700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 0x7fd9e406b9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd9d4000c00 tx=0x7fd9d4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d4018070 con 0x7fd9e40f66e0 2022-02-02T19:57:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e406a740 con 0x7fd9e40f66e0 2022-02-02T19:57:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9d40097d0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d401ddb0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.189+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e406aca0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.190+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e4045ad0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.190+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9d401d420 con 0x7fd9e40f66e0 2022-02-02T19:57:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.191+0000 7fd9da7fc700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 0x7fd9d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.191+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9d40835f0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.191+0000 7fd9e9605700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 0x7fd9d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.191+0000 7fd9e9605700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 0x7fd9d0067290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fd9e00041d0 tx=0x7fd9e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.195+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9d40517b0 con 0x7fd9e40f66e0 2022-02-02T19:57:30.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.369+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9e40fefb0 con 0x7fd9d0064dd0 2022-02-02T19:57:30.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.379+0000 7fd9da7fc700 1 -- 172.21.15.96:0/1562622100 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fd9e40fefb0 con 0x7fd9d0064dd0 2022-02-02T19:57:30.382 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:57:30.383 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (100m) 71m ago 101m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:57:30.383 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (93m) 71m ago 101m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:57:30.383 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (93m) 69m ago 101m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:57:30.383 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (100m) 71m ago 101m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:57:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (97m) 71m ago 97m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:57:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (93m) 71m ago 98m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:57:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (98m) 69m ago 98m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:57:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (93m) 69m ago 98m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:57:30.384 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (95m) 71m ago 103m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:57:30.385 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (94m) 69m ago 101m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:57:30.385 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (94m) 71m ago 103m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:57:30.385 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (93m) 69m ago 101m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:57:30.385 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (101m) 71m ago 101m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:57:30.386 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (101m) 69m ago 101m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:57:30.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (92m) 71m ago 100m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:57:30.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (92m) 71m ago 100m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:57:30.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (91m) 71m ago 100m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:57:30.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (91m) 69m ago 99m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:57:30.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (90m) 69m ago 99m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:57:30.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (90m) 69m ago 99m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:57:30.387 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (100m) 71m ago 101m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:57:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 msgr2=0x7fd9d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 0x7fd9d0067290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fd9e00041d0 tx=0x7fd9e000b040).stop 2022-02-02T19:57:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 msgr2=0x7fd9e406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 0x7fd9e406b9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd9d4000c00 tx=0x7fd9d4009b30).stop 2022-02-02T19:57:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 shutdown_connections 2022-02-02T19:57:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9d0064dd0 0x7fd9d0067290 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e40f66e0 0x7fd9e406b9a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 --2- 172.21.15.96:0/1562622100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9e40f7980 0x7fd9e4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 >> 172.21.15.96:0/1562622100 conn(0x7fd9e40f1e40 msgr2=0x7fd9e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.380+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 shutdown_connections 2022-02-02T19:57:30.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.381+0000 7fd9ec06a700 1 -- 172.21.15.96:0/1562622100 wait complete. 2022-02-02T19:57:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.476+0000 7fcd5e009700 1 -- 172.21.15.96:0/3732235209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f5440 msgr2=0x7fcd580f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.476+0000 7fcd5e009700 1 --2- 172.21.15.96:0/3732235209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f5440 0x7fcd580f5860 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fcd54004660 tx=0x7fcd54009b30).stop 2022-02-02T19:57:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- 172.21.15.96:0/3732235209 shutdown_connections 2022-02-02T19:57:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 --2- 172.21.15.96:0/3732235209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f66e0 0x7fcd580f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 --2- 172.21.15.96:0/3732235209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f5440 0x7fcd580f5860 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- 172.21.15.96:0/3732235209 >> 172.21.15.96:0/3732235209 conn(0x7fcd580f0ba0 msgr2=0x7fcd580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- 172.21.15.96:0/3732235209 shutdown_connections 2022-02-02T19:57:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- 172.21.15.96:0/3732235209 wait complete. 2022-02-02T19:57:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 Processor -- start 2022-02-02T19:57:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- start start 2022-02-02T19:57:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 0x7fcd58106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58107900 con 0x7fcd580f66e0 2022-02-02T19:57:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5e009700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58108110 con 0x7fcd580f5440 2022-02-02T19:57:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.477+0000 7fcd5c806700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34408/0 (socket says 172.21.15.96:34408) 2022-02-02T19:57:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 -- 172.21.15.96:0/1391108303 learned_addr learned my addr 172.21.15.96:0/1391108303 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:57:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5d007700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 0x7fcd58106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 -- 172.21.15.96:0/1391108303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 msgr2=0x7fcd58106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 0x7fcd58106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 -- 172.21.15.96:0/1391108303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54005040 con 0x7fcd580f66e0 2022-02-02T19:57:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5d007700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 0x7fcd58106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:57:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5c806700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fcd4800c790 tx=0x7fcd48007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4800e680 con 0x7fcd580f66e0 2022-02-02T19:57:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd4800ec90 con 0x7fcd580f66e0 2022-02-02T19:57:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd58108390 con 0x7fcd580f66e0 2022-02-02T19:57:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd48013d60 con 0x7fcd580f66e0 2022-02-02T19:57:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.478+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd58108950 con 0x7fcd580f66e0 2022-02-02T19:57:30.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.479+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58059100 con 0x7fcd580f66e0 2022-02-02T19:57:30.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.479+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd4801a060 con 0x7fcd580f66e0 2022-02-02T19:57:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.480+0000 7fcd4dffb700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 0x7fcd440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.480+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd48081ca0 con 0x7fcd580f66e0 2022-02-02T19:57:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.480+0000 7fcd5d007700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 0x7fcd440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.480+0000 7fcd5d007700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 0x7fcd440672e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fcd54004e30 tx=0x7fcd54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.484+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd48086070 con 0x7fcd580f66e0 2022-02-02T19:57:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.715+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd5810d350 con 0x7fcd580f66e0 2022-02-02T19:57:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.715+0000 7fcd4dffb700 1 -- 172.21.15.96:0/1391108303 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcd48018070 con 0x7fcd580f66e0 2022-02-02T19:57:30.719 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:57:30.719 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:57:30.720 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:57:30.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:57:30.720 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:57:30.721 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:57:30.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:57:30.721 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:57:30.722 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:57:30.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:57:30.723 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:57:30.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:57:30.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:57:30.724 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:57:30.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:57:30.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:57:30.725 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:57:30.726 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:57:30.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 msgr2=0x7fcd440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 0x7fcd440672e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fcd54004e30 tx=0x7fcd54009b30).stop 2022-02-02T19:57:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 msgr2=0x7fcd58107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fcd4800c790 tx=0x7fcd48007d70).stop 2022-02-02T19:57:30.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 shutdown_connections 2022-02-02T19:57:30.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd44064e20 0x7fcd440672e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd580f5440 0x7fcd58106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 --2- 172.21.15.96:0/1391108303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd580f66e0 0x7fcd58107300 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 >> 172.21.15.96:0/1391108303 conn(0x7fcd580f0ba0 msgr2=0x7fcd5805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 shutdown_connections 2022-02-02T19:57:30.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.718+0000 7fcd5e009700 1 -- 172.21.15.96:0/1391108303 wait complete. 2022-02-02T19:57:30.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 -- 172.21.15.96:0/3674320827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f6860 msgr2=0x7f3c640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 --2- 172.21.15.96:0/3674320827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f6860 0x7f3c640f6cc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f3c4c004660 tx=0x7f3c4c009b30).stop 2022-02-02T19:57:30.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 -- 172.21.15.96:0/3674320827 shutdown_connections 2022-02-02T19:57:30.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 --2- 172.21.15.96:0/3674320827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f6860 0x7f3c640f6cc0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 --2- 172.21.15.96:0/3674320827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f55c0 0x7f3c640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:57:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 -- 172.21.15.96:0/3674320827 >> 172.21.15.96:0/3674320827 conn(0x7f3c640f0d40 msgr2=0x7f3c640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 -- 172.21.15.96:0/3674320827 shutdown_connections 2022-02-02T19:57:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.815+0000 7f3c6a471700 1 -- 172.21.15.96:0/3674320827 wait complete. 2022-02-02T19:57:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 Processor -- start 2022-02-02T19:57:30.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 -- start start 2022-02-02T19:57:30.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f6860 0x7f3c641063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c641069e0 con 0x7f3c640f55c0 2022-02-02T19:57:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c6a471700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64107290 con 0x7f3c640f6860 2022-02-02T19:57:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34416/0 (socket says 172.21.15.96:34416) 2022-02-02T19:57:30.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 -- 172.21.15.96:0/4293198014 learned_addr learned my addr 172.21.15.96:0/4293198014 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:57:30.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 -- 172.21.15.96:0/4293198014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f6860 msgr2=0x7f3c641063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:30.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f6860 0x7f3c641063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:57:30.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.816+0000 7f3c63fff700 1 -- 172.21.15.96:0/4293198014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c005040 con 0x7f3c640f55c0 2022-02-02T19:57:30.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c63fff700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f3c540093f0 tx=0x7f3c54006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c54009ea0 con 0x7f3c640f55c0 2022-02-02T19:57:30.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c54013af0 con 0x7f3c640f55c0 2022-02-02T19:57:30.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64107570 con 0x7f3c640f55c0 2022-02-02T19:57:30.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5400db10 con 0x7f3c640f55c0 2022-02-02T19:57:30.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.817+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c64107b30 con 0x7f3c640f55c0 2022-02-02T19:57:30.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.818+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c640f49b0 con 0x7f3c640f55c0 2022-02-02T19:57:30.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.818+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c5401a060 con 0x7f3c640f55c0 2022-02-02T19:57:30.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.819+0000 7f3c60ff9700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 0x7f3c50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:57:30.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.819+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3c54081aa0 con 0x7f3c640f55c0 2022-02-02T19:57:30.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.819+0000 7f3c637fe700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 0x7f3c50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:57:30.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.819+0000 7f3c637fe700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 0x7f3c50067290 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f3c4c004e30 tx=0x7f3c4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:57:30.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:30.823+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c540535d0 con 0x7f3c640f55c0 2022-02-02T19:57:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.023+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c640fdf50 con 0x7f3c640f55c0 2022-02-02T19:57:31.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:30 smithi096 ceph-mon[101353]: from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:57:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.023+0000 7f3c60ff9700 1 -- 172.21.15.96:0/4293198014 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3c54018020 con 0x7f3c640f55c0 2022-02-02T19:57:31.028 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:57:31.028 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:57:31.028 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:57:31.029 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:57:31.029 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:57:31.029 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:57:31.029 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:57:31.030 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:57:31.030 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:57:31.030 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:57:31.030 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:57:31.031 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:57:31.031 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:57:31.031 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:57:31.031 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:57:31.031 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:57:31.032 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:57:31.032 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:57:31.033 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:57:31.033 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:57:31.033 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:57:31.033 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:57:31.033 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:57:31.034 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:57:31.034 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:57:31.034 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:57:31.034 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:57:31.035 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:57:31.035 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:57:31.035 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:57:31.035 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:57:31.036 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:57:31.036 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:57:31.036 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:57:31.036 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:57:31.037 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:57:31.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:57:31.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:57:31.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:57:31.038 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:30 smithi159 ceph-mon[69013]: from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:57:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 msgr2=0x7f3c50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 0x7f3c50067290 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f3c4c004e30 tx=0x7f3c4c009b30).stop 2022-02-02T19:57:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 msgr2=0x7f3c64105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:57:31.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f3c540093f0 tx=0x7f3c54006ec0).stop 2022-02-02T19:57:31.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 shutdown_connections 2022-02-02T19:57:31.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c50064dd0 0x7f3c50067290 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:31.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f55c0 0x7f3c64105eb0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:57:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 --2- 172.21.15.96:0/4293198014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f6860 0x7f3c641063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:57:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.025+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 >> 172.21.15.96:0/4293198014 conn(0x7f3c640f0d40 msgr2=0x7f3c640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:57:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.026+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 shutdown_connections 2022-02-02T19:57:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:57:31.026+0000 7f3c6a471700 1 -- 172.21.15.96:0/4293198014 wait complete. 2022-02-02T19:57:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:57:32.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:31 smithi159 ceph-mon[69013]: from='client.45923 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:57:32.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:31 smithi159 ceph-mon[69013]: pgmap v2863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:32.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1391108303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:57:32.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4293198014' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:57:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:31 smithi096 ceph-mon[101353]: from='client.45923 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:57:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:31 smithi096 ceph-mon[101353]: pgmap v2863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:32.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1391108303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:57:32.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4293198014' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:57:33.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:33 smithi159 ceph-mon[69013]: pgmap v2864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:34.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:33 smithi096 ceph-mon[101353]: pgmap v2864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:35 smithi159 ceph-mon[69013]: pgmap v2865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:35 smithi096 ceph-mon[101353]: pgmap v2865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:38 smithi159 ceph-mon[69013]: pgmap v2866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:38 smithi096 ceph-mon[101353]: pgmap v2866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:40.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:40 smithi159 ceph-mon[69013]: pgmap v2867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:40.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:40 smithi096 ceph-mon[101353]: pgmap v2867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:42 smithi159 ceph-mon[69013]: pgmap v2868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:42.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:42 smithi096 ceph-mon[101353]: pgmap v2868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:44 smithi159 ceph-mon[69013]: pgmap v2869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:44.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:44 smithi096 ceph-mon[101353]: pgmap v2869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:46.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:46 smithi159 ceph-mon[69013]: pgmap v2870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:46.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:46 smithi096 ceph-mon[101353]: pgmap v2870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:47 smithi159 ceph-mon[69013]: pgmap v2871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:47 smithi096 ceph-mon[101353]: pgmap v2871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:50.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:49 smithi159 ceph-mon[69013]: pgmap v2872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:49 smithi096 ceph-mon[101353]: pgmap v2872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:52 smithi159 ceph-mon[69013]: pgmap v2873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:52.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:52 smithi096 ceph-mon[101353]: pgmap v2873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:54 smithi159 ceph-mon[69013]: pgmap v2874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:54 smithi096 ceph-mon[101353]: pgmap v2874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:56.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:56 smithi159 ceph-mon[69013]: pgmap v2875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:56.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:56 smithi096 ceph-mon[101353]: pgmap v2875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:57:58 smithi159 ceph-mon[69013]: pgmap v2876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:57:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:57:58 smithi096 ceph-mon[101353]: pgmap v2876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:00.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:00 smithi159 ceph-mon[69013]: pgmap v2877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:00.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:00 smithi096 ceph-mon[101353]: pgmap v2877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:01.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 -- 172.21.15.96:0/3385758943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f7980 msgr2=0x7f881c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 --2- 172.21.15.96:0/3385758943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f7980 0x7f881c0f7de0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f880c004660 tx=0x7f880c009b30).stop 2022-02-02T19:58:01.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 -- 172.21.15.96:0/3385758943 shutdown_connections 2022-02-02T19:58:01.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 --2- 172.21.15.96:0/3385758943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f7980 0x7f881c0f7de0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 --2- 172.21.15.96:0/3385758943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f66e0 0x7f881c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.137+0000 7f8823aee700 1 -- 172.21.15.96:0/3385758943 >> 172.21.15.96:0/3385758943 conn(0x7f881c0f1e40 msgr2=0x7f881c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.138+0000 7f8823aee700 1 -- 172.21.15.96:0/3385758943 shutdown_connections 2022-02-02T19:58:01.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.138+0000 7f8823aee700 1 -- 172.21.15.96:0/3385758943 wait complete. 2022-02-02T19:58:01.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 Processor -- start 2022-02-02T19:58:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 -- start start 2022-02-02T19:58:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 0x7f881c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06a380 con 0x7f881c0f66e0 2022-02-02T19:58:01.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8823aee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06a4c0 con 0x7f881c0f7980 2022-02-02T19:58:01.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34438/0 (socket says 172.21.15.96:34438) 2022-02-02T19:58:01.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 -- 172.21.15.96:0/2003529816 learned_addr learned my addr 172.21.15.96:0/2003529816 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:01.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8821089700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 0x7f881c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 -- 172.21.15.96:0/2003529816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 msgr2=0x7f881c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 0x7f881c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f882188a700 1 -- 172.21.15.96:0/2003529816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c005040 con 0x7f881c0f66e0 2022-02-02T19:58:01.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.139+0000 7f8821089700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 0x7f881c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T19:58:01.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f882188a700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f8818002700 tx=0x7f8818009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8818009320 con 0x7f881c0f66e0 2022-02-02T19:58:01.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c06a7a0 con 0x7f881c0f66e0 2022-02-02T19:58:01.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f881800f040 con 0x7f881c0f66e0 2022-02-02T19:58:01.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c10ef40 con 0x7f881c0f66e0 2022-02-02T19:58:01.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.140+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88180148e0 con 0x7f881c0f66e0 2022-02-02T19:58:01.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.141+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c045ad0 con 0x7f881c0f66e0 2022-02-02T19:58:01.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.141+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8818009480 con 0x7f881c0f66e0 2022-02-02T19:58:01.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.142+0000 7f88127fc700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 0x7f8808067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.142+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8818081d90 con 0x7f881c0f66e0 2022-02-02T19:58:01.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.142+0000 7f8821089700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 0x7f8808067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.142+0000 7f8821089700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 0x7f8808067290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f880c004630 tx=0x7f880c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.146+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f881804fe90 con 0x7f881c0f66e0 2022-02-02T19:58:01.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.324+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f881c0fefe0 con 0x7f8808064dd0 2022-02-02T19:58:01.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.326+0000 7f88127fc700 1 -- 172.21.15.96:0/2003529816 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f881c0fefe0 con 0x7f8808064dd0 2022-02-02T19:58:01.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.327+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 msgr2=0x7f8808067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.327+0000 7f8823aee700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 0x7f8808067290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f880c004630 tx=0x7f880c009b30).stop 2022-02-02T19:58:01.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.327+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 msgr2=0x7f881c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.327+0000 7f8823aee700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f8818002700 tx=0x7f8818009e00).stop 2022-02-02T19:58:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 shutdown_connections 2022-02-02T19:58:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8808064dd0 0x7f8808067290 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f881c0f66e0 0x7f881c06b9a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 --2- 172.21.15.96:0/2003529816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f881c0f7980 0x7f881c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 >> 172.21.15.96:0/2003529816 conn(0x7f881c0f1e40 msgr2=0x7f881c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 shutdown_connections 2022-02-02T19:58:01.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.328+0000 7f8823aee700 1 -- 172.21.15.96:0/2003529816 wait complete. 2022-02-02T19:58:01.341 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:58:01.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 -- 172.21.15.96:0/2713044346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 msgr2=0x7fb1d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/2713044346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d40f7de0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fb1bc004660 tx=0x7fb1bc009b30).stop 2022-02-02T19:58:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 -- 172.21.15.96:0/2713044346 shutdown_connections 2022-02-02T19:58:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/2713044346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d40f7de0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/2713044346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 0x7fb1d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:58:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 -- 172.21.15.96:0/2713044346 >> 172.21.15.96:0/2713044346 conn(0x7fb1d40f1e40 msgr2=0x7fb1d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 -- 172.21.15.96:0/2713044346 shutdown_connections 2022-02-02T19:58:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.425+0000 7fb1d9edb700 1 -- 172.21.15.96:0/2713044346 wait complete. 2022-02-02T19:58:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 Processor -- start 2022-02-02T19:58:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 -- start start 2022-02-02T19:58:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 0x7fb1d4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4107ab0 con 0x7fb1d40f7980 2022-02-02T19:58:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.426+0000 7fb1d9edb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4108360 con 0x7fb1d40f66e0 2022-02-02T19:58:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34450/0 (socket says 172.21.15.96:34450) 2022-02-02T19:58:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 -- 172.21.15.96:0/4127307325 learned_addr learned my addr 172.21.15.96:0/4127307325 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d37fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 0x7fb1d4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 -- 172.21.15.96:0/4127307325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 msgr2=0x7fb1d4106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 0x7fb1d4106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 -- 172.21.15.96:0/4127307325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc005040 con 0x7fb1d40f7980 2022-02-02T19:58:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d2ffd700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fb1bc009990 tx=0x7fb1bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc018070 con 0x7fb1d40f7980 2022-02-02T19:58:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d41085e0 con 0x7fb1d40f7980 2022-02-02T19:58:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d4108b40 con 0x7fb1d40f7980 2022-02-02T19:58:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1bc007ba0 con 0x7fb1d40f7980 2022-02-02T19:58:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.427+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc01c620 con 0x7fb1d40f7980 2022-02-02T19:58:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.428+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d40f5ad0 con 0x7fb1d40f7980 2022-02-02T19:58:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.429+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb1bc01c8e0 con 0x7fb1d40f7980 2022-02-02T19:58:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.429+0000 7fb1cbfff700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 0x7fb1c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.429+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb1bc0838a0 con 0x7fb1d40f7980 2022-02-02T19:58:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.429+0000 7fb1d37fe700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 0x7fb1c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.430+0000 7fb1d37fe700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 0x7fb1c0067290 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb1d40f77e0 tx=0x7fb1c4009220).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.433+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb1bc055490 con 0x7fb1d40f7980 2022-02-02T19:58:01.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.606+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d40fefb0 con 0x7fb1c0064dd0 2022-02-02T19:58:01.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.616+0000 7fb1cbfff700 1 -- 172.21.15.96:0/4127307325 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fb1d40fefb0 con 0x7fb1c0064dd0 2022-02-02T19:58:01.620 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:58:01.620 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (101m) 72m ago 102m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:58:01.620 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (93m) 72m ago 102m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:58:01.621 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (93m) 70m ago 101m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:58:01.621 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (101m) 72m ago 102m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:58:01.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (98m) 72m ago 98m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:58:01.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (94m) 72m ago 98m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:58:01.622 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (98m) 70m ago 98m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:58:01.622 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (94m) 70m ago 98m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:58:01.622 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (95m) 72m ago 103m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:58:01.622 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (95m) 70m ago 101m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:58:01.623 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (94m) 72m ago 103m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:58:01.623 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (94m) 70m ago 101m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:58:01.623 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (102m) 72m ago 102m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:58:01.623 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (101m) 70m ago 101m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:58:01.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (93m) 72m ago 101m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:58:01.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (92m) 72m ago 100m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:58:01.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (92m) 72m ago 100m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:58:01.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (91m) 70m ago 100m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:58:01.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (91m) 70m ago 100m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:58:01.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (90m) 70m ago 99m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:58:01.625 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (101m) 72m ago 102m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:58:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 msgr2=0x7fb1c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 0x7fb1c0067290 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb1d40f77e0 tx=0x7fb1c4009220).stop 2022-02-02T19:58:01.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 msgr2=0x7fb1d4107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fb1bc009990 tx=0x7fb1bc009b30).stop 2022-02-02T19:58:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 shutdown_connections 2022-02-02T19:58:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1c0064dd0 0x7fb1c0067290 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1d40f66e0 0x7fb1d4106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 --2- 172.21.15.96:0/4127307325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1d40f7980 0x7fb1d4107470 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.617+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 >> 172.21.15.96:0/4127307325 conn(0x7fb1d40f1e40 msgr2=0x7fb1d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.618+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 shutdown_connections 2022-02-02T19:58:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.618+0000 7fb1d9edb700 1 -- 172.21.15.96:0/4127307325 wait complete. 2022-02-02T19:58:01.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 -- 172.21.15.96:0/1009640157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 msgr2=0x7f76cc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 --2- 172.21.15.96:0/1009640157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc0f6b30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f76c0004660 tx=0x7f76c0009b30).stop 2022-02-02T19:58:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 -- 172.21.15.96:0/1009640157 shutdown_connections 2022-02-02T19:58:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 --2- 172.21.15.96:0/1009640157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc0f6b30 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 --2- 172.21.15.96:0/1009640157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 0x7f76cc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 -- 172.21.15.96:0/1009640157 >> 172.21.15.96:0/1009640157 conn(0x7f76cc0f0b90 msgr2=0x7f76cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 -- 172.21.15.96:0/1009640157 shutdown_connections 2022-02-02T19:58:01.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.714+0000 7f76cb59e700 1 -- 172.21.15.96:0/1009640157 wait complete. 2022-02-02T19:58:01.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 Processor -- start 2022-02-02T19:58:01.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 -- start start 2022-02-02T19:58:01.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 0x7f76cc105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc106760 con 0x7f76cc0f66d0 2022-02-02T19:58:01.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76cb59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc106f60 con 0x7f76cc0f5430 2022-02-02T19:58:01.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76c9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76c9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34458/0 (socket says 172.21.15.96:34458) 2022-02-02T19:58:01.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.715+0000 7f76c9d9b700 1 -- 172.21.15.96:0/3955217515 learned_addr learned my addr 172.21.15.96:0/3955217515 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:01.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76ca59c700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 0x7f76cc105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76c9d9b700 1 -- 172.21.15.96:0/3955217515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 msgr2=0x7f76cc105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76c9d9b700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 0x7f76cc105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76c9d9b700 1 -- 172.21.15.96:0/3955217515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0005040 con 0x7f76cc0f66d0 2022-02-02T19:58:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76c9d9b700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f76c0009990 tx=0x7f76c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c001c070 con 0x7f76cc0f66d0 2022-02-02T19:58:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc1071e0 con 0x7f76cc0f66d0 2022-02-02T19:58:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc107740 con 0x7f76cc0f66d0 2022-02-02T19:58:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76c0004490 con 0x7f76cc0f66d0 2022-02-02T19:58:01.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.716+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c00216e0 con 0x7f76cc0f66d0 2022-02-02T19:58:01.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.717+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b0004fa0 con 0x7f76cc0f66d0 2022-02-02T19:58:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.718+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f76c00125d0 con 0x7f76cc0f66d0 2022-02-02T19:58:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.718+0000 7f76baffd700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 0x7f76b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.718+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f76c00879e0 con 0x7f76cc0f66d0 2022-02-02T19:58:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.718+0000 7f76ca59c700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 0x7f76b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.718+0000 7f76ca59c700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 0x7f76b40672e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f76cc0f6530 tx=0x7f76bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.722+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76c0059510 con 0x7f76cc0f66d0 2022-02-02T19:58:01.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.950+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76b0005e80 con 0x7f76cc0f66d0 2022-02-02T19:58:01.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.951+0000 7f76baffd700 1 -- 172.21.15.96:0/3955217515 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f76c0059100 con 0x7f76cc0f66d0 2022-02-02T19:58:01.955 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:58:01.956 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:58:01.956 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:58:01.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:01.957 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:58:01.957 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:58:01.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:01.957 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:58:01.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:58:01.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:01.958 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:58:01.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:58:01.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:01.959 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:58:01.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:58:01.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:58:01.959 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:58:01.960 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:58:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 msgr2=0x7f76b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 0x7f76b40672e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f76cc0f6530 tx=0x7f76bc009040).stop 2022-02-02T19:58:01.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 msgr2=0x7f76cc1061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:01.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f76c0009990 tx=0x7f76c0009b30).stop 2022-02-02T19:58:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 shutdown_connections 2022-02-02T19:58:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76b4064e20 0x7f76b40672e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc0f5430 0x7f76cc105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 --2- 172.21.15.96:0/3955217515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76cc0f66d0 0x7f76cc1061b0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:01.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 >> 172.21.15.96:0/3955217515 conn(0x7f76cc0f0b90 msgr2=0x7f76cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:01.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 shutdown_connections 2022-02-02T19:58:01.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:01.953+0000 7f76cb59e700 1 -- 172.21.15.96:0/3955217515 wait complete. 2022-02-02T19:58:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3864916276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd028060310 msgr2=0x7fd0280f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3864916276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd028060310 0x7fd0280f9120 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fd024004660 tx=0x7fd024009b30).stop 2022-02-02T19:58:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3864916276 shutdown_connections 2022-02-02T19:58:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3864916276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0280f96a0 0x7fd0280fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3864916276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd028060310 0x7fd0280f9120 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3864916276 >> 172.21.15.96:0/3864916276 conn(0x7fd0280f0ba0 msgr2=0x7fd0280f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3864916276 shutdown_connections 2022-02-02T19:58:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.050+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3864916276 wait complete. 2022-02-02T19:58:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 Processor -- start 2022-02-02T19:58:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 -- start start 2022-02-02T19:58:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd028060310 0x7fd028108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd028109a20 con 0x7fd0280f96a0 2022-02-02T19:58:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02e6c5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd028109b60 con 0x7fd028060310 2022-02-02T19:58:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02cec2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02cec2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34468/0 (socket says 172.21.15.96:34468) 2022-02-02T19:58:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02cec2700 1 -- 172.21.15.96:0/3639062894 learned_addr learned my addr 172.21.15.96:0/3639062894 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.051+0000 7fd02d6c3700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd028060310 0x7fd028108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02cec2700 1 -- 172.21.15.96:0/3639062894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd028060310 msgr2=0x7fd028108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:02.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02cec2700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd028060310 0x7fd028108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02cec2700 1 -- 172.21.15.96:0/3639062894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024005040 con 0x7fd0280f96a0 2022-02-02T19:58:02.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02cec2700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fd018002700 tx=0x7fd018009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:02.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0180079c0 con 0x7fd0280f96a0 2022-02-02T19:58:02.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd01800f040 con 0x7fd0280f96a0 2022-02-02T19:58:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02810a500 con 0x7fd0280f96a0 2022-02-02T19:58:02.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd018014740 con 0x7fd0280f96a0 2022-02-02T19:58:02.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.052+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02810aac0 con 0x7fd0280f96a0 2022-02-02T19:58:02.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.053+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd028045ad0 con 0x7fd0280f96a0 2022-02-02T19:58:02.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.054+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd01801b060 con 0x7fd0280f96a0 2022-02-02T19:58:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.054+0000 7fd01dffb700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.054+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd018081920 con 0x7fd0280f96a0 2022-02-02T19:58:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.054+0000 7fd02d6c3700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:02.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.055+0000 7fd02d6c3700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 0x7fd0140672e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fd024004630 tx=0x7fd024009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:02.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.058+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd0180533f0 con 0x7fd0280f96a0 2022-02-02T19:58:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.259+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd02810b160 con 0x7fd0280f96a0 2022-02-02T19:58:02.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.259+0000 7fd01dffb700 1 -- 172.21.15.96:0/3639062894 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd018052fe0 con 0x7fd0280f96a0 2022-02-02T19:58:02.264 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:58:02.264 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:58:02.264 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:58:02.264 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:58:02.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:02.265 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:58:02.265 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:58:02.265 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:58:02.266 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:58:02.266 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:58:02.267 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:58:02.267 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:58:02.268 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:58:02.268 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:58:02.268 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:58:02.269 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:58:02.269 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:58:02.269 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:58:02.269 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:58:02.270 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:58:02.270 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:58:02.271 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:58:02.271 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:58:02.271 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:58:02.271 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:58:02.272 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:58:02.272 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:58:02.272 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:58:02.273 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:58:02.273 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:58:02.273 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:58:02.273 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:58:02.274 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:02.274 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:02.274 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:58:02.274 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:02.275 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:02.275 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:02.275 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:02.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 msgr2=0x7fd0140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:02.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 0x7fd0140672e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fd024004630 tx=0x7fd024009b30).stop 2022-02-02T19:58:02.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 msgr2=0x7fd028109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:02.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fd018002700 tx=0x7fd018009d60).stop 2022-02-02T19:58:02.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 shutdown_connections 2022-02-02T19:58:02.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd028060310 0x7fd028108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 --2- 172.21.15.96:0/3639062894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0280f96a0 0x7fd028109470 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:02.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 >> 172.21.15.96:0/3639062894 conn(0x7fd0280f0ba0 msgr2=0x7fd0280f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:02.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 shutdown_connections 2022-02-02T19:58:02.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:02.262+0000 7fd02e6c5700 1 -- 172.21.15.96:0/3639062894 wait complete. 2022-02-02T19:58:02.280 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:58:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:02 smithi159 ceph-mon[69013]: pgmap v2878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:02.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:02 smithi159 ceph-mon[69013]: from='client.37062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:02.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3955217515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:58:02.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3639062894' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:58:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:02 smithi096 ceph-mon[101353]: pgmap v2878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:02 smithi096 ceph-mon[101353]: from='client.37062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3955217515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:58:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3639062894' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:58:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:03 smithi096 ceph-mon[101353]: from='client.37066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:03.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:03 smithi096 ceph-mon[101353]: pgmap v2879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:03.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:03 smithi159 ceph-mon[69013]: from='client.37066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:03.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:03 smithi159 ceph-mon[69013]: pgmap v2879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:06.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:05 smithi159 ceph-mon[69013]: pgmap v2880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:06.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:05 smithi096 ceph-mon[101353]: pgmap v2880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:08 smithi159 ceph-mon[69013]: pgmap v2881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:08.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:08 smithi096 ceph-mon[101353]: pgmap v2881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:10 smithi159 ceph-mon[69013]: pgmap v2882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:10 smithi096 ceph-mon[101353]: pgmap v2882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:12 smithi159 ceph-mon[69013]: pgmap v2883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:12 smithi096 ceph-mon[101353]: pgmap v2883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:14 smithi159 ceph-mon[69013]: pgmap v2884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:14.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:14 smithi096 ceph-mon[101353]: pgmap v2884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:16 smithi159 ceph-mon[69013]: pgmap v2885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:16.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:16 smithi096 ceph-mon[101353]: pgmap v2885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:17 smithi159 ceph-mon[69013]: pgmap v2886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:17 smithi096 ceph-mon[101353]: pgmap v2886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:19 smithi159 ceph-mon[69013]: pgmap v2887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:19 smithi096 ceph-mon[101353]: pgmap v2887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:22 smithi159 ceph-mon[69013]: pgmap v2888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:22.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:22 smithi096 ceph-mon[101353]: pgmap v2888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:24 smithi159 ceph-mon[69013]: pgmap v2889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:24.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:24 smithi096 ceph-mon[101353]: pgmap v2889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:26 smithi159 ceph-mon[69013]: pgmap v2890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:26.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:26 smithi096 ceph-mon[101353]: pgmap v2890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:27 smithi159 ceph-mon[69013]: pgmap v2891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:58:27.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:58:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:27 smithi096 ceph-mon[101353]: pgmap v2891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:58:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:58:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:29 smithi159 ceph-mon[69013]: pgmap v2892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:30.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:29 smithi096 ceph-mon[101353]: pgmap v2892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:32.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.373+0000 7fe2f3996700 1 -- 172.21.15.96:0/807567704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6690 msgr2=0x7fe2ec0f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.373+0000 7fe2f3996700 1 --2- 172.21.15.96:0/807567704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec0f6ab0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fe2e8004660 tx=0x7fe2e8009b30).stop 2022-02-02T19:58:32.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 -- 172.21.15.96:0/807567704 shutdown_connections 2022-02-02T19:58:32.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 --2- 172.21.15.96:0/807567704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec0f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 --2- 172.21.15.96:0/807567704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec0f6ab0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 -- 172.21.15.96:0/807567704 >> 172.21.15.96:0/807567704 conn(0x7fe2ec0f1eb0 msgr2=0x7fe2ec0f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:32.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 -- 172.21.15.96:0/807567704 shutdown_connections 2022-02-02T19:58:32.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 -- 172.21.15.96:0/807567704 wait complete. 2022-02-02T19:58:32.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 Processor -- start 2022-02-02T19:58:32.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.374+0000 7fe2f3996700 1 -- start start 2022-02-02T19:58:32.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f3996700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f3996700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f3996700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec107970 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f3996700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec107ab0 con 0x7fe2ec0f6690 2022-02-02T19:58:32.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34486/0 (socket says 172.21.15.96:34486) 2022-02-02T19:58:32.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 -- 172.21.15.96:0/756674529 learned_addr learned my addr 172.21.15.96:0/756674529 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:32.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f1732700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 -- 172.21.15.96:0/756674529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6690 msgr2=0x7fe2ec106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 -- 172.21.15.96:0/756674529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8005040 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.375+0000 7fe2f0f31700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fe2dc00c510 tx=0x7fe2dc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.376+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc00f650 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.376+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec108450 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.376+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2dc00fc60 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.376+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc012c50 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.376+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec108a10 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.377+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec045ad0 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.377+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2dc010070 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.377+0000 7fe2e1ffb700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 0x7fe2d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.378+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2dc0817a0 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.378+0000 7fe2f1732700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 0x7fe2d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.378+0000 7fe2f1732700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 0x7fe2d80672e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fe2e8004630 tx=0x7fe2e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.382+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2dc0533b0 con 0x7fe2ec0f6fa0 2022-02-02T19:58:32.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.560+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2ec0ff010 con 0x7fe2d8064e20 2022-02-02T19:58:32.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.561+0000 7fe2e1ffb700 1 -- 172.21.15.96:0/756674529 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe2ec0ff010 con 0x7fe2d8064e20 2022-02-02T19:58:32.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 msgr2=0x7fe2d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 0x7fe2d80672e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fe2e8004630 tx=0x7fe2e8009b30).stop 2022-02-02T19:58:32.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 msgr2=0x7fe2ec1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fe2dc00c510 tx=0x7fe2dc007e00).stop 2022-02-02T19:58:32.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 shutdown_connections 2022-02-02T19:58:32.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064e20 0x7fe2d80672e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2ec0f6690 0x7fe2ec106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 --2- 172.21.15.96:0/756674529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2ec0f6fa0 0x7fe2ec1073c0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 >> 172.21.15.96:0/756674529 conn(0x7fe2ec0f1eb0 msgr2=0x7fe2ec0fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 shutdown_connections 2022-02-02T19:58:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.563+0000 7fe2f3996700 1 -- 172.21.15.96:0/756674529 wait complete. 2022-02-02T19:58:32.577 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:58:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 -- 172.21.15.96:0/1135723189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 msgr2=0x7f71c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 --2- 172.21.15.96:0/1135723189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c80f59e0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f71b8004660 tx=0x7f71b8009b30).stop 2022-02-02T19:58:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 -- 172.21.15.96:0/1135723189 shutdown_connections 2022-02-02T19:58:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 --2- 172.21.15.96:0/1135723189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 --2- 172.21.15.96:0/1135723189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c80f59e0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 -- 172.21.15.96:0/1135723189 >> 172.21.15.96:0/1135723189 conn(0x7f71c80f0d40 msgr2=0x7f71c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.660+0000 7f71cd013700 1 -- 172.21.15.96:0/1135723189 shutdown_connections 2022-02-02T19:58:32.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:32 smithi096 ceph-mon[101353]: pgmap v2893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.661+0000 7f71cd013700 1 -- 172.21.15.96:0/1135723189 wait complete. 2022-02-02T19:58:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.661+0000 7f71cd013700 1 Processor -- start 2022-02-02T19:58:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.661+0000 7f71cd013700 1 -- start start 2022-02-02T19:58:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71cd013700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71cd013700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71cd013700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80603c0 con 0x7f71c80f55c0 2022-02-02T19:58:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71cd013700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8060500 con 0x7f71c80f6860 2022-02-02T19:58:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34494/0 (socket says 172.21.15.96:34494) 2022-02-02T19:58:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 -- 172.21.15.96:0/2868397564 learned_addr learned my addr 172.21.15.96:0/2868397564 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c659c700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 -- 172.21.15.96:0/2868397564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 msgr2=0x7f71c810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 -- 172.21.15.96:0/2868397564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8005040 con 0x7f71c80f55c0 2022-02-02T19:58:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.662+0000 7f71c6d9d700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f71b8004f60 tx=0x7f71b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.663+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b8018070 con 0x7f71c80f55c0 2022-02-02T19:58:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.663+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c810c6e0 con 0x7f71c80f55c0 2022-02-02T19:58:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.663+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71b8009770 con 0x7f71c80f55c0 2022-02-02T19:58:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.663+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b801c3c0 con 0x7f71c80f55c0 2022-02-02T19:58:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.663+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c810cc10 con 0x7f71c80f55c0 2022-02-02T19:58:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.664+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a8004fa0 con 0x7f71c80f55c0 2022-02-02T19:58:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.664+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71b801c630 con 0x7f71c80f55c0 2022-02-02T19:58:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.665+0000 7f71af7fe700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.665+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71b80836f0 con 0x7f71c80f55c0 2022-02-02T19:58:32.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.665+0000 7f71c659c700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.665+0000 7f71c659c700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f71bc007fd0 tx=0x7f71bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.669+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71b80517f0 con 0x7f71c80f55c0 2022-02-02T19:58:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:32 smithi159 ceph-mon[69013]: pgmap v2893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:32.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.840+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71a8000bc0 con 0x7f71b0064dd0 2022-02-02T19:58:32.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.850+0000 7f71af7fe700 1 -- 172.21.15.96:0/2868397564 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f71a8000bc0 con 0x7f71b0064dd0 2022-02-02T19:58:32.854 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:58:32.854 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (101m) 72m ago 103m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:58:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (94m) 72m ago 102m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:58:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (94m) 70m ago 102m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:58:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (101m) 72m ago 102m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:58:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (99m) 72m ago 99m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:58:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (94m) 72m ago 99m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:58:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (99m) 70m ago 99m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:58:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (94m) 70m ago 99m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:58:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (96m) 72m ago 104m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:58:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (95m) 70m ago 102m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:58:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (95m) 72m ago 104m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:58:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (94m) 70m ago 102m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:58:32.858 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (102m) 72m ago 102m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:58:32.858 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (102m) 70m ago 102m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:58:32.858 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (93m) 72m ago 101m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:58:32.858 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (93m) 72m ago 101m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:58:32.859 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (92m) 72m ago 101m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:58:32.859 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (92m) 70m ago 100m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:58:32.859 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (91m) 70m ago 100m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:58:32.859 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (91m) 70m ago 100m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:58:32.860 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (101m) 72m ago 102m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:58:32.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 msgr2=0x7f71b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f71bc007fd0 tx=0x7f71bc009040).stop 2022-02-02T19:58:32.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 msgr2=0x7f71c8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f71b8004f60 tx=0x7f71b8009b30).stop 2022-02-02T19:58:32.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 shutdown_connections 2022-02-02T19:58:32.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c90 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 --2- 172.21.15.96:0/2868397564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 >> 172.21.15.96:0/2868397564 conn(0x7f71c80f0d40 msgr2=0x7f71c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:32.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 shutdown_connections 2022-02-02T19:58:32.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.852+0000 7f71cd013700 1 -- 172.21.15.96:0/2868397564 wait complete. 2022-02-02T19:58:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 -- 172.21.15.96:0/2535753849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f6530 msgr2=0x7f62840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 --2- 172.21.15.96:0/2535753849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f6530 0x7f62840f6950 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f626c004660 tx=0x7f626c009b30).stop 2022-02-02T19:58:32.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 -- 172.21.15.96:0/2535753849 shutdown_connections 2022-02-02T19:58:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 --2- 172.21.15.96:0/2535753849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f77d0 0x7f62840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 --2- 172.21.15.96:0/2535753849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f6530 0x7f62840f6950 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 -- 172.21.15.96:0/2535753849 >> 172.21.15.96:0/2535753849 conn(0x7f62840f1c90 msgr2=0x7f62840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.948+0000 7f628359e700 1 -- 172.21.15.96:0/2535753849 shutdown_connections 2022-02-02T19:58:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 -- 172.21.15.96:0/2535753849 wait complete. 2022-02-02T19:58:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 Processor -- start 2022-02-02T19:58:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 -- start start 2022-02-02T19:58:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f6530 0x7f6284106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62841078f0 con 0x7f62840f77d0 2022-02-02T19:58:32.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6284108100 con 0x7f62840f6530 2022-02-02T19:58:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f6281d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f6281d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34504/0 (socket says 172.21.15.96:34504) 2022-02-02T19:58:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f6281d9b700 1 -- 172.21.15.96:0/2771764005 learned_addr learned my addr 172.21.15.96:0/2771764005 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.949+0000 7f628259c700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f6530 0x7f6284106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f6281d9b700 1 -- 172.21.15.96:0/2771764005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f6530 msgr2=0x7f6284106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f6281d9b700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f6530 0x7f6284106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f6281d9b700 1 -- 172.21.15.96:0/2771764005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c005040 con 0x7f62840f77d0 2022-02-02T19:58:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f6281d9b700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f62740026d0 tx=0x7f6274009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62740079c0 con 0x7f62840f77d0 2022-02-02T19:58:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f627400f040 con 0x7f62840f77d0 2022-02-02T19:58:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62740148b0 con 0x7f62840f77d0 2022-02-02T19:58:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6284108380 con 0x7f62840f77d0 2022-02-02T19:58:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.950+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6284108940 con 0x7f62840f77d0 2022-02-02T19:58:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.951+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284059100 con 0x7f62840f77d0 2022-02-02T19:58:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.952+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6274007b20 con 0x7f62840f77d0 2022-02-02T19:58:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.952+0000 7f627affd700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 0x7f62700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:32.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.952+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f62740818c0 con 0x7f62840f77d0 2022-02-02T19:58:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.952+0000 7f628259c700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 0x7f62700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.953+0000 7f628259c700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 0x7f62700672e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f626c013690 tx=0x7f626c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:32.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:32.956+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f627404f9c0 con 0x7f62840f77d0 2022-02-02T19:58:33.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.185+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62840fedf0 con 0x7f62840f77d0 2022-02-02T19:58:33.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.186+0000 7f627affd700 1 -- 172.21.15.96:0/2771764005 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6274052fe0 con 0x7f62840f77d0 2022-02-02T19:58:33.191 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:58:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:58:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:58:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:58:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:58:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:58:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:58:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:58:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:58:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:58:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:58:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:58:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:58:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:58:33.195 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:58:33.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.187+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 msgr2=0x7f62700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.187+0000 7f628359e700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 0x7f62700672e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f626c013690 tx=0x7f626c009b30).stop 2022-02-02T19:58:33.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.187+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 msgr2=0x7f62841072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.187+0000 7f628359e700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f62740026d0 tx=0x7f6274009de0).stop 2022-02-02T19:58:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 shutdown_connections 2022-02-02T19:58:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6270064e20 0x7f62700672e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62840f6530 0x7f6284106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 --2- 172.21.15.96:0/2771764005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62840f77d0 0x7f62841072f0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 >> 172.21.15.96:0/2771764005 conn(0x7f62840f1c90 msgr2=0x7f62840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 shutdown_connections 2022-02-02T19:58:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.188+0000 7f628359e700 1 -- 172.21.15.96:0/2771764005 wait complete. 2022-02-02T19:58:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 -- 172.21.15.96:0/2450187447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 msgr2=0x7fca6c0f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 --2- 172.21.15.96:0/2450187447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c0f9180 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fca60004660 tx=0x7fca60009b30).stop 2022-02-02T19:58:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 -- 172.21.15.96:0/2450187447 shutdown_connections 2022-02-02T19:58:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 --2- 172.21.15.96:0/2450187447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 0x7fca6c0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 --2- 172.21.15.96:0/2450187447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c0f9180 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.287+0000 7fca70f15700 1 -- 172.21.15.96:0/2450187447 >> 172.21.15.96:0/2450187447 conn(0x7fca6c0f0ba0 msgr2=0x7fca6c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 -- 172.21.15.96:0/2450187447 shutdown_connections 2022-02-02T19:58:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 -- 172.21.15.96:0/2450187447 wait complete. 2022-02-02T19:58:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 Processor -- start 2022-02-02T19:58:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 -- start start 2022-02-02T19:58:33.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:33.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 0x7fca6c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:33.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c107830 con 0x7fca6c0602b0 2022-02-02T19:58:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.288+0000 7fca70f15700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c108040 con 0x7fca6c0f9700 2022-02-02T19:58:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34512/0 (socket says 172.21.15.96:34512) 2022-02-02T19:58:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 -- 172.21.15.96:0/3758496655 learned_addr learned my addr 172.21.15.96:0/3758496655 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:58:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6affd700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 0x7fca6c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 -- 172.21.15.96:0/3758496655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 msgr2=0x7fca6c107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 0x7fca6c107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 -- 172.21.15.96:0/3758496655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60005040 con 0x7fca6c0602b0 2022-02-02T19:58:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca6b7fe700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fca60000c00 tx=0x7fca6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60019070 con 0x7fca6c0602b0 2022-02-02T19:58:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fca60007e70 con 0x7fca6c0602b0 2022-02-02T19:58:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c108260 con 0x7fca6c0602b0 2022-02-02T19:58:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60014d90 con 0x7fca6c0602b0 2022-02-02T19:58:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.289+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c1087c0 con 0x7fca6c0602b0 2022-02-02T19:58:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.290+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c059100 con 0x7fca6c0602b0 2022-02-02T19:58:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.291+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fca60025070 con 0x7fca6c0602b0 2022-02-02T19:58:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.291+0000 7fca53fff700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 0x7fca540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:58:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.291+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fca60082a10 con 0x7fca6c0602b0 2022-02-02T19:58:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.291+0000 7fca6affd700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 0x7fca540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:58:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.291+0000 7fca6affd700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 0x7fca540672e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fca6c060080 tx=0x7fca5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:58:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.295+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fca60050b10 con 0x7fca6c0602b0 2022-02-02T19:58:33.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.498+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca6c0fed20 con 0x7fca6c0602b0 2022-02-02T19:58:33.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2771764005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:58:33.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.499+0000 7fca53fff700 1 -- 172.21.15.96:0/3758496655 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fca60023020 con 0x7fca6c0602b0 2022-02-02T19:58:33.504 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:58:33.504 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:58:33.505 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:58:33.505 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:58:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:33.505 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:58:33.506 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:58:33.506 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:58:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:58:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:58:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:58:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:58:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:58:33.508 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:58:33.508 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:58:33.508 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:58:33.508 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:58:33.509 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:58:33.509 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:58:33.509 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:58:33.509 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:58:33.509 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:58:33.510 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:58:33.510 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:58:33.510 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:58:33.510 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:58:33.511 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:58:33.511 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:58:33.511 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:58:33.512 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:58:33.512 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:58:33.512 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:58:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:33.513 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:58:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:58:33.513 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:33.513 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:33.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:58:33.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 msgr2=0x7fca540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 0x7fca540672e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fca6c060080 tx=0x7fca5c00b040).stop 2022-02-02T19:58:33.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 msgr2=0x7fca6c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:58:33.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fca60000c00 tx=0x7fca6000b040).stop 2022-02-02T19:58:33.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 shutdown_connections 2022-02-02T19:58:33.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca54064e20 0x7fca540672e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca6c0602b0 0x7fca6c106d40 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 --2- 172.21.15.96:0/3758496655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca6c0f9700 0x7fca6c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:58:33.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 >> 172.21.15.96:0/3758496655 conn(0x7fca6c0f0ba0 msgr2=0x7fca6c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:58:33.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 shutdown_connections 2022-02-02T19:58:33.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:58:33.502+0000 7fca70f15700 1 -- 172.21.15.96:0/3758496655 wait complete. 2022-02-02T19:58:33.518 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:58:33.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2771764005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:58:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:34 smithi159 ceph-mon[69013]: from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:34 smithi159 ceph-mon[69013]: pgmap v2894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:34 smithi159 ceph-mon[69013]: from='client.37082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:34.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3758496655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:58:34.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:34 smithi096 ceph-mon[101353]: from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:34.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:34 smithi096 ceph-mon[101353]: pgmap v2894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:34.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:34 smithi096 ceph-mon[101353]: from='client.37082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:58:34.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3758496655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:58:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:36 smithi159 ceph-mon[69013]: pgmap v2895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:36.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:36 smithi096 ceph-mon[101353]: pgmap v2895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:38 smithi159 ceph-mon[69013]: pgmap v2896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:38.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:38 smithi096 ceph-mon[101353]: pgmap v2896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:39.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:39 smithi159 ceph-mon[69013]: pgmap v2897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:39 smithi096 ceph-mon[101353]: pgmap v2897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:42 smithi159 ceph-mon[69013]: pgmap v2898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:42.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:42 smithi096 ceph-mon[101353]: pgmap v2898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:44 smithi159 ceph-mon[69013]: pgmap v2899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:44 smithi096 ceph-mon[101353]: pgmap v2899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:46.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:46 smithi159 ceph-mon[69013]: pgmap v2900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:46.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:46 smithi096 ceph-mon[101353]: pgmap v2900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:48 smithi159 ceph-mon[69013]: pgmap v2901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:48 smithi096 ceph-mon[101353]: pgmap v2901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:49.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:49 smithi159 ceph-mon[69013]: pgmap v2902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:49.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:49 smithi096 ceph-mon[101353]: pgmap v2902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:52 smithi159 ceph-mon[69013]: pgmap v2903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:52.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:52 smithi096 ceph-mon[101353]: pgmap v2903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:54 smithi159 ceph-mon[69013]: pgmap v2904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:54 smithi096 ceph-mon[101353]: pgmap v2904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:56.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:56 smithi159 ceph-mon[69013]: pgmap v2905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:56.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:56 smithi096 ceph-mon[101353]: pgmap v2905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:58 smithi159 ceph-mon[69013]: pgmap v2906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:58.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:58 smithi096 ceph-mon[101353]: pgmap v2906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:58:59 smithi159 ceph-mon[69013]: pgmap v2907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:58:59.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:58:59 smithi096 ceph-mon[101353]: pgmap v2907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:02 smithi159 ceph-mon[69013]: pgmap v2908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:02.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:02 smithi096 ceph-mon[101353]: pgmap v2908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- 172.21.15.96:0/2481334341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480602b0 msgr2=0x7f14480fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 --2- 172.21.15.96:0/2481334341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480602b0 0x7f14480fb570 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f1438004660 tx=0x7f1438009b30).stop 2022-02-02T19:59:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- 172.21.15.96:0/2481334341 shutdown_connections 2022-02-02T19:59:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 --2- 172.21.15.96:0/2481334341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480fba60 0x7f14480fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 --2- 172.21.15.96:0/2481334341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480602b0 0x7f14480fb570 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- 172.21.15.96:0/2481334341 >> 172.21.15.96:0/2481334341 conn(0x7f14480f0b90 msgr2=0x7f14480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- 172.21.15.96:0/2481334341 shutdown_connections 2022-02-02T19:59:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- 172.21.15.96:0/2481334341 wait complete. 2022-02-02T19:59:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 Processor -- start 2022-02-02T19:59:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- start start 2022-02-02T19:59:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480602b0 0x7f1448104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448105610 con 0x7f14480fba60 2022-02-02T19:59:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.615+0000 7f144759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448105750 con 0x7f14480602b0 2022-02-02T19:59:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f144659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480602b0 0x7f1448104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34532/0 (socket says 172.21.15.96:34532) 2022-02-02T19:59:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 -- 172.21.15.96:0/1870083778 learned_addr learned my addr 172.21.15.96:0/1870083778 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 -- 172.21.15.96:0/1870083778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480602b0 msgr2=0x7f1448104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480602b0 0x7f1448104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 -- 172.21.15.96:0/1870083778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438005040 con 0x7f14480fba60 2022-02-02T19:59:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1445d9b700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f143c002700 tx=0x7f143c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143c0079c0 con 0x7f14480fba60 2022-02-02T19:59:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f143c00f040 con 0x7f14480fba60 2022-02-02T19:59:03.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1448109310 con 0x7f14480fba60 2022-02-02T19:59:03.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143c014740 con 0x7f14480fba60 2022-02-02T19:59:03.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.616+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481098d0 con 0x7f14480fba60 2022-02-02T19:59:03.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.618+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448045ad0 con 0x7f14480fba60 2022-02-02T19:59:03.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.618+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f143c01b060 con 0x7f14480fba60 2022-02-02T19:59:03.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.618+0000 7f1436ffd700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 0x7f14300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.619+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f143c081920 con 0x7f14480fba60 2022-02-02T19:59:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.619+0000 7f144659c700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 0x7f14300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.619+0000 7f144659c700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 0x7f14300672e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f1438004630 tx=0x7f1438009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:03.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.623+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f143c04f9c0 con 0x7f14480fba60 2022-02-02T19:59:03.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.800+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14480f85c0 con 0x7f1430064e20 2022-02-02T19:59:03.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.802+0000 7f1436ffd700 1 -- 172.21.15.96:0/1870083778 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f14480f85c0 con 0x7f1430064e20 2022-02-02T19:59:03.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.803+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 msgr2=0x7f14300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.803+0000 7f144759e700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 0x7f14300672e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f1438004630 tx=0x7f1438009b30).stop 2022-02-02T19:59:03.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.803+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 msgr2=0x7f1448105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.803+0000 7f144759e700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f143c002700 tx=0x7f143c009d60).stop 2022-02-02T19:59:03.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 shutdown_connections 2022-02-02T19:59:03.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1430064e20 0x7f14300672e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14480602b0 0x7f1448104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 --2- 172.21.15.96:0/1870083778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14480fba60 0x7f1448105010 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 >> 172.21.15.96:0/1870083778 conn(0x7f14480f0b90 msgr2=0x7f14480f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:03.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 shutdown_connections 2022-02-02T19:59:03.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.804+0000 7f144759e700 1 -- 172.21.15.96:0/1870083778 wait complete. 2022-02-02T19:59:03.816 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:59:03.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 -- 172.21.15.96:0/3857867835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 msgr2=0x7f86480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 --2- 172.21.15.96:0/3857867835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f86480f6cc0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f863c004660 tx=0x7f863c009b30).stop 2022-02-02T19:59:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 -- 172.21.15.96:0/3857867835 shutdown_connections 2022-02-02T19:59:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 --2- 172.21.15.96:0/3857867835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f86480f6cc0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 --2- 172.21.15.96:0/3857867835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 0x7f86480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:59:03.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 -- 172.21.15.96:0/3857867835 >> 172.21.15.96:0/3857867835 conn(0x7f86480f0d40 msgr2=0x7f86480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:03.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 -- 172.21.15.96:0/3857867835 shutdown_connections 2022-02-02T19:59:03.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 -- 172.21.15.96:0/3857867835 wait complete. 2022-02-02T19:59:03.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.901+0000 7f864e2bb700 1 Processor -- start 2022-02-02T19:59:03.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f864e2bb700 1 -- start start 2022-02-02T19:59:03.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f864e2bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 0x7f8648068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f864e2bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f864e2bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86480697f0 con 0x7f86480f6860 2022-02-02T19:59:03.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f864e2bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864810faa0 con 0x7f86480f55c0 2022-02-02T19:59:03.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34542/0 (socket says 172.21.15.96:34542) 2022-02-02T19:59:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 -- 172.21.15.96:0/251149191 learned_addr learned my addr 172.21.15.96:0/251149191 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f8647fff700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 0x7f8648068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 -- 172.21.15.96:0/251149191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 msgr2=0x7f8648068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 0x7f8648068c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:03.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.902+0000 7f86477fe700 1 -- 172.21.15.96:0/251149191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c005040 con 0x7f86480f6860 2022-02-02T19:59:03.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f86477fe700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f863c009990 tx=0x7f863c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:03.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863c01a070 con 0x7f86480f6860 2022-02-02T19:59:03.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f863c012a80 con 0x7f86480f6860 2022-02-02T19:59:03.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863c01f9a0 con 0x7f86480f6860 2022-02-02T19:59:03.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864810fd20 con 0x7f86480f6860 2022-02-02T19:59:03.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.903+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8648110230 con 0x7f86480f6860 2022-02-02T19:59:03.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.904+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86480f49b0 con 0x7f86480f6860 2022-02-02T19:59:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.905+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f863c012bf0 con 0x7f86480f6860 2022-02-02T19:59:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.905+0000 7f8644ff9700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 0x7f8630067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:03.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.905+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f863c085d10 con 0x7f86480f6860 2022-02-02T19:59:03.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.905+0000 7f8647fff700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 0x7f8630067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:03.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.906+0000 7f8647fff700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 0x7f8630067290 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f8648068a20 tx=0x7f8638008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:03.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:03.909+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f863c053e10 con 0x7f86480f6860 2022-02-02T19:59:04.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.081+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f864805f620 con 0x7f8630064dd0 2022-02-02T19:59:04.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.090+0000 7f8644ff9700 1 -- 172.21.15.96:0/251149191 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f864805f620 con 0x7f8630064dd0 2022-02-02T19:59:04.094 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:59:04.094 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (102m) 73m ago 103m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:59:04.094 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (94m) 73m ago 103m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:59:04.095 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (94m) 71m ago 102m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:59:04.095 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (102m) 73m ago 103m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:59:04.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (99m) 73m ago 99m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:59:04.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (95m) 73m ago 99m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:59:04.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (99m) 71m ago 99m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:59:04.096 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (95m) 71m ago 99m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:59:04.096 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (96m) 73m ago 104m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:59:04.097 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (96m) 71m ago 102m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:59:04.097 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (95m) 73m ago 104m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:59:04.097 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (95m) 71m ago 102m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:59:04.097 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (103m) 73m ago 103m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:59:04.097 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (102m) 71m ago 102m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:59:04.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (94m) 73m ago 102m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:59:04.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (93m) 73m ago 102m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:59:04.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (93m) 73m ago 101m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:59:04.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (92m) 71m ago 101m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:59:04.099 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (92m) 71m ago 101m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:59:04.099 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (91m) 71m ago 100m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:59:04.099 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (102m) 73m ago 103m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:59:04.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 msgr2=0x7f8630067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 0x7f8630067290 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f8648068a20 tx=0x7f8638008040).stop 2022-02-02T19:59:04.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 msgr2=0x7f8648069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f863c009990 tx=0x7f863c009b30).stop 2022-02-02T19:59:04.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 shutdown_connections 2022-02-02T19:59:04.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8630064dd0 0x7f8630067290 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86480f55c0 0x7f8648068c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 --2- 172.21.15.96:0/251149191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86480f6860 0x7f8648069180 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 >> 172.21.15.96:0/251149191 conn(0x7f86480f0d40 msgr2=0x7f86480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:04.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 shutdown_connections 2022-02-02T19:59:04.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.092+0000 7f864e2bb700 1 -- 172.21.15.96:0/251149191 wait complete. 2022-02-02T19:59:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.188+0000 7f2bc90d4700 1 -- 172.21.15.96:0/1554093414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f66d0 msgr2=0x7f2bc40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.188+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/1554093414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f66d0 0x7f2bc40f6b30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f2bb4004660 tx=0x7f2bb4009b30).stop 2022-02-02T19:59:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.188+0000 7f2bc90d4700 1 -- 172.21.15.96:0/1554093414 shutdown_connections 2022-02-02T19:59:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.188+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/1554093414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f66d0 0x7f2bc40f6b30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.189+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/1554093414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f5430 0x7f2bc40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.189+0000 7f2bc90d4700 1 -- 172.21.15.96:0/1554093414 >> 172.21.15.96:0/1554093414 conn(0x7f2bc40f0b90 msgr2=0x7f2bc40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.189+0000 7f2bc90d4700 1 -- 172.21.15.96:0/1554093414 shutdown_connections 2022-02-02T19:59:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.191+0000 7f2bc90d4700 1 -- 172.21.15.96:0/1554093414 wait complete. 2022-02-02T19:59:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.191+0000 7f2bc90d4700 1 Processor -- start 2022-02-02T19:59:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.191+0000 7f2bc90d4700 1 -- start start 2022-02-02T19:59:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.191+0000 7f2bc90d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc90d4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f66d0 0x7f2bc4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc90d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4107870 con 0x7f2bc40f5430 2022-02-02T19:59:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc90d4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41080b0 con 0x7f2bc40f66d0 2022-02-02T19:59:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34550/0 (socket says 172.21.15.96:34550) 2022-02-02T19:59:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 -- 172.21.15.96:0/4288067392 learned_addr learned my addr 172.21.15.96:0/4288067392 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc37fe700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f66d0 0x7f2bc4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 -- 172.21.15.96:0/4288067392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f66d0 msgr2=0x7f2bc4107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f66d0 0x7f2bc4107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 -- 172.21.15.96:0/4288067392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4005040 con 0x7f2bc40f5430 2022-02-02T19:59:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc3fff700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f2bac00c530 tx=0x7f2bac007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac00f650 con 0x7f2bc40f5430 2022-02-02T19:59:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4108390 con 0x7f2bc40f5430 2022-02-02T19:59:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2bac00fc60 con 0x7f2bc40f5430 2022-02-02T19:59:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac012d20 con 0x7f2bc40f5430 2022-02-02T19:59:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.192+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc41088d0 con 0x7f2bc40f5430 2022-02-02T19:59:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.193+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4059100 con 0x7f2bc40f5430 2022-02-02T19:59:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.194+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2bac019030 con 0x7f2bc40f5430 2022-02-02T19:59:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.194+0000 7f2bc0ff9700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 0x7f2bb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.194+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2bac0816b0 con 0x7f2bc40f5430 2022-02-02T19:59:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.194+0000 7f2bc37fe700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 0x7f2bb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.195+0000 7f2bc37fe700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 0x7f2bb00672e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2bb4004e30 tx=0x7f2bb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.198+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2bac04f800 con 0x7f2bc40f5430 2022-02-02T19:59:04.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.430+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2bc4045b50 con 0x7f2bc40f5430 2022-02-02T19:59:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.430+0000 7f2bc0ff9700 1 -- 172.21.15.96:0/4288067392 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2bc4045b50 con 0x7f2bc40f5430 2022-02-02T19:59:04.434 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:59:04.434 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:59:04.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:59:04.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:04.435 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:59:04.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:59:04.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:04.436 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:59:04.436 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:59:04.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:04.437 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:59:04.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:59:04.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:04.437 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:59:04.438 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:59:04.438 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:59:04.438 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:59:04.438 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:59:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 msgr2=0x7f2bb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 0x7f2bb00672e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2bb4004e30 tx=0x7f2bb4009b30).stop 2022-02-02T19:59:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 msgr2=0x7f2bc4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f2bac00c530 tx=0x7f2bac007e10).stop 2022-02-02T19:59:04.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 shutdown_connections 2022-02-02T19:59:04.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2bb0064e20 0x7f2bb00672e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bc40f5430 0x7f2bc4106d80 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 --2- 172.21.15.96:0/4288067392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bc40f66d0 0x7f2bc4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 >> 172.21.15.96:0/4288067392 conn(0x7f2bc40f0b90 msgr2=0x7f2bc405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 shutdown_connections 2022-02-02T19:59:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.432+0000 7f2bc90d4700 1 -- 172.21.15.96:0/4288067392 wait complete. 2022-02-02T19:59:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/1596036009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 msgr2=0x7f6e480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/1596036009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e480f6b00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f6e3c004660 tx=0x7f6e3c009b30).stop 2022-02-02T19:59:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/1596036009 shutdown_connections 2022-02-02T19:59:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/1596036009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e480f7980 0x7f6e480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/1596036009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e480f6b00 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/1596036009 >> 172.21.15.96:0/1596036009 conn(0x7f6e480f1e40 msgr2=0x7f6e480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/1596036009 shutdown_connections 2022-02-02T19:59:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.530+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/1596036009 wait complete. 2022-02-02T19:59:04.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:04 smithi096 ceph-mon[101353]: pgmap v2909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.531+0000 7f6e4ddc9700 1 Processor -- start 2022-02-02T19:59:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.531+0000 7f6e4ddc9700 1 -- start start 2022-02-02T19:59:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.531+0000 7f6e4ddc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e4ddc9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e480f7980 0x7f6e481096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e4ddc9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48109c50 con 0x7f6e480f66e0 2022-02-02T19:59:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e4ddc9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48109d90 con 0x7f6e480f7980 2022-02-02T19:59:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34560/0 (socket says 172.21.15.96:34560) 2022-02-02T19:59:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 -- 172.21.15.96:0/3277237640 learned_addr learned my addr 172.21.15.96:0/3277237640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 -- 172.21.15.96:0/3277237640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e480f7980 msgr2=0x7f6e481096a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T19:59:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e480f7980 0x7f6e481096a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:59:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 -- 172.21.15.96:0/3277237640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c005040 con 0x7f6e480f66e0 2022-02-02T19:59:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e477fe700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f6e3c009830 tx=0x7f6e3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c018070 con 0x7f6e480f66e0 2022-02-02T19:59:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4810a6d0 con 0x7f6e480f66e0 2022-02-02T19:59:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.532+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4810ac30 con 0x7f6e480f66e0 2022-02-02T19:59:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.533+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e3c007ba0 con 0x7f6e480f66e0 2022-02-02T19:59:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.533+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c01c620 con 0x7f6e480f66e0 2022-02-02T19:59:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.534+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28004fa0 con 0x7f6e480f66e0 2022-02-02T19:59:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.534+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e3c01c850 con 0x7f6e480f66e0 2022-02-02T19:59:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.534+0000 7f6e2ffff700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 0x7f6e30067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.535+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6e3c0836f0 con 0x7f6e480f66e0 2022-02-02T19:59:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.535+0000 7f6e46ffd700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 0x7f6e30067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.535+0000 7f6e46ffd700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 0x7f6e30067270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f6e38004a10 tx=0x7f6e380099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:04.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.539+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e3c055300 con 0x7f6e480f66e0 2022-02-02T19:59:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.739+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e28005e80 con 0x7f6e480f66e0 2022-02-02T19:59:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.739+0000 7f6e2ffff700 1 -- 172.21.15.96:0/3277237640 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6e3c054ef0 con 0x7f6e480f66e0 2022-02-02T19:59:04.743 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:59:04.743 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:59:04.744 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:59:04.744 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:59:04.744 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:04.744 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:59:04.745 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:59:04.745 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:59:04.745 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:59:04.745 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:59:04.745 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:59:04.746 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:59:04.746 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:59:04.746 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:59:04.746 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:59:04.747 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:59:04.747 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:59:04.747 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:59:04.747 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:59:04.748 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:59:04.748 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:59:04.748 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:59:04.748 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:59:04.748 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:59:04.749 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:59:04.749 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:59:04.749 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:59:04.749 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:59:04.749 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:59:04.750 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:59:04.750 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:59:04.750 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:59:04.750 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:04.751 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:04.751 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:59:04.751 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:04.751 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:04.752 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:04.752 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:04.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 msgr2=0x7f6e30067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 0x7f6e30067270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f6e38004a10 tx=0x7f6e380099e0).stop 2022-02-02T19:59:04.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 msgr2=0x7f6e481091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:04.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f6e3c009830 tx=0x7f6e3c009b30).stop 2022-02-02T19:59:04.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 shutdown_connections 2022-02-02T19:59:04.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e30064db0 0x7f6e30067270 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e480f66e0 0x7f6e481091b0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:04.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 --2- 172.21.15.96:0/3277237640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e480f7980 0x7f6e481096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T19:59:04.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 >> 172.21.15.96:0/3277237640 conn(0x7f6e480f1e40 msgr2=0x7f6e480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:04.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 shutdown_connections 2022-02-02T19:59:04.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:04.741+0000 7f6e4ddc9700 1 -- 172.21.15.96:0/3277237640 wait complete. 2022-02-02T19:59:04.756 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:59:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:04 smithi159 ceph-mon[69013]: pgmap v2909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:05 smithi159 ceph-mon[69013]: from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:05 smithi159 ceph-mon[69013]: from='client.37098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4288067392' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:59:05.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3277237640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:59:05.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:05 smithi096 ceph-mon[101353]: from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:05.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:05 smithi096 ceph-mon[101353]: from='client.37098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:05.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4288067392' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:59:05.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3277237640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:59:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:06 smithi159 ceph-mon[69013]: pgmap v2910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:06.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:06 smithi096 ceph-mon[101353]: pgmap v2910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:07 smithi159 ceph-mon[69013]: pgmap v2911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:07 smithi096 ceph-mon[101353]: pgmap v2911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:10.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:09 smithi159 ceph-mon[69013]: pgmap v2912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:10.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:09 smithi096 ceph-mon[101353]: pgmap v2912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:12 smithi159 ceph-mon[69013]: pgmap v2913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:12.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:12 smithi096 ceph-mon[101353]: pgmap v2913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:14 smithi159 ceph-mon[69013]: pgmap v2914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:14.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:14 smithi096 ceph-mon[101353]: pgmap v2914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:16 smithi159 ceph-mon[69013]: pgmap v2915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:16.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:16 smithi096 ceph-mon[101353]: pgmap v2915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:18.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:18 smithi159 ceph-mon[69013]: pgmap v2916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:18.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:18 smithi096 ceph-mon[101353]: pgmap v2916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:19.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:19 smithi159 ceph-mon[69013]: pgmap v2917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:19.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:19 smithi096 ceph-mon[101353]: pgmap v2917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:22 smithi159 ceph-mon[69013]: pgmap v2918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:22.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:22 smithi096 ceph-mon[101353]: pgmap v2918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:24 smithi159 ceph-mon[69013]: pgmap v2919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:24.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:24 smithi096 ceph-mon[101353]: pgmap v2919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:26.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:26 smithi159 ceph-mon[69013]: pgmap v2920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:26.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:26 smithi096 ceph-mon[101353]: pgmap v2920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:59:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:59:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T19:59:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T19:59:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:28 smithi159 ceph-mon[69013]: pgmap v2921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:28 smithi096 ceph-mon[101353]: pgmap v2921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:29.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:29 smithi159 ceph-mon[69013]: pgmap v2922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:29.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:29 smithi096 ceph-mon[101353]: pgmap v2922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:32 smithi159 ceph-mon[69013]: pgmap v2923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:32.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:32 smithi096 ceph-mon[101353]: pgmap v2923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:34 smithi159 ceph-mon[69013]: pgmap v2924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:34 smithi096 ceph-mon[101353]: pgmap v2924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:34.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 -- 172.21.15.96:0/3503701813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f55c0 msgr2=0x7f17900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:34.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 --2- 172.21.15.96:0/3503701813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f55c0 0x7f17900f59e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f1784004660 tx=0x7f1784009b30).stop 2022-02-02T19:59:34.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 -- 172.21.15.96:0/3503701813 shutdown_connections 2022-02-02T19:59:34.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 --2- 172.21.15.96:0/3503701813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f6860 0x7f17900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:34.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 --2- 172.21.15.96:0/3503701813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f55c0 0x7f17900f59e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:34.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 -- 172.21.15.96:0/3503701813 >> 172.21.15.96:0/3503701813 conn(0x7f17900f0d40 msgr2=0x7f17900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:34.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 -- 172.21.15.96:0/3503701813 shutdown_connections 2022-02-02T19:59:34.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.852+0000 7f1797c6d700 1 -- 172.21.15.96:0/3503701813 wait complete. 2022-02-02T19:59:34.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 Processor -- start 2022-02-02T19:59:34.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 -- start start 2022-02-02T19:59:34.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f55c0 0x7f1790105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:34.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:34.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790106910 con 0x7f17900f6860 2022-02-02T19:59:34.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1797c6d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790106a50 con 0x7f17900f55c0 2022-02-02T19:59:34.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1795208700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:34.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1795208700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34578/0 (socket says 172.21.15.96:34578) 2022-02-02T19:59:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.853+0000 7f1795208700 1 -- 172.21.15.96:0/2046782190 learned_addr learned my addr 172.21.15.96:0/2046782190 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1795a09700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f55c0 0x7f1790105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1795208700 1 -- 172.21.15.96:0/2046782190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f55c0 msgr2=0x7f1790105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1795208700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f55c0 0x7f1790105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1795208700 1 -- 172.21.15.96:0/2046782190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784005040 con 0x7f17900f6860 2022-02-02T19:59:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1795208700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f178c00c530 tx=0x7f178c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c00f650 con 0x7f17900f6860 2022-02-02T19:59:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f178c00fc60 con 0x7f17900f6860 2022-02-02T19:59:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17901073f0 con 0x7f17900f6860 2022-02-02T19:59:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c012c20 con 0x7f17900f6860 2022-02-02T19:59:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.854+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17901079b0 con 0x7f17900f6860 2022-02-02T19:59:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.855+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790045ad0 con 0x7f17900f6860 2022-02-02T19:59:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.856+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f178c010070 con 0x7f17900f6860 2022-02-02T19:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.856+0000 7f17827fc700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 0x7f177c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.856+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f178c081610 con 0x7f17900f6860 2022-02-02T19:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.856+0000 7f1795a09700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 0x7f177c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.857+0000 7f1795a09700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 0x7f177c067290 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1784004630 tx=0x7f1784009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:34.861+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f178c0477d0 con 0x7f17900f6860 2022-02-02T19:59:35.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.037+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17900ff800 con 0x7f177c064dd0 2022-02-02T19:59:35.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.038+0000 7f17827fc700 1 -- 172.21.15.96:0/2046782190 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f17900ff800 con 0x7f177c064dd0 2022-02-02T19:59:35.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 msgr2=0x7f177c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 0x7f177c067290 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1784004630 tx=0x7f1784009b30).stop 2022-02-02T19:59:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 msgr2=0x7f1790106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f178c00c530 tx=0x7f178c007e20).stop 2022-02-02T19:59:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 shutdown_connections 2022-02-02T19:59:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f177c064dd0 0x7f177c067290 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f55c0 0x7f1790105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 --2- 172.21.15.96:0/2046782190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f6860 0x7f1790106360 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 >> 172.21.15.96:0/2046782190 conn(0x7f17900f0d40 msgr2=0x7f17900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 shutdown_connections 2022-02-02T19:59:35.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.040+0000 7f1797c6d700 1 -- 172.21.15.96:0/2046782190 wait complete. 2022-02-02T19:59:35.053 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T19:59:35.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 -- 172.21.15.96:0/551600236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6530 msgr2=0x7f40780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 --2- 172.21.15.96:0/551600236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6530 0x7f40780f6950 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f4068004660 tx=0x7f4068009b30).stop 2022-02-02T19:59:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 -- 172.21.15.96:0/551600236 shutdown_connections 2022-02-02T19:59:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 --2- 172.21.15.96:0/551600236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f77d0 0x7f40780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 --2- 172.21.15.96:0/551600236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f6530 0x7f40780f6950 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 -- 172.21.15.96:0/551600236 >> 172.21.15.96:0/551600236 conn(0x7f40780f1c90 msgr2=0x7f40780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 -- 172.21.15.96:0/551600236 shutdown_connections 2022-02-02T19:59:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.137+0000 7f407e484700 1 -- 172.21.15.96:0/551600236 wait complete. 2022-02-02T19:59:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 Processor -- start 2022-02-02T19:59:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 -- start start 2022-02-02T19:59:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f6530 0x7f4078106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40781078f0 con 0x7f40780f77d0 2022-02-02T19:59:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407e484700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078108100 con 0x7f40780f6530 2022-02-02T19:59:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407cc81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407cc81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34588/0 (socket says 172.21.15.96:34588) 2022-02-02T19:59:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.138+0000 7f407cc81700 1 -- 172.21.15.96:0/484868278 learned_addr learned my addr 172.21.15.96:0/484868278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407d482700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f6530 0x7f4078106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407cc81700 1 -- 172.21.15.96:0/484868278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f6530 msgr2=0x7f4078106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407cc81700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f6530 0x7f4078106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407cc81700 1 -- 172.21.15.96:0/484868278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068005040 con 0x7f40780f77d0 2022-02-02T19:59:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407cc81700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f407400c530 tx=0x7f4074007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407400f650 con 0x7f40780f77d0 2022-02-02T19:59:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f407400fc60 con 0x7f40780f77d0 2022-02-02T19:59:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078108380 con 0x7f40780f77d0 2022-02-02T19:59:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4074012c20 con 0x7f40780f77d0 2022-02-02T19:59:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.139+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4078108940 con 0x7f40780f77d0 2022-02-02T19:59:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.140+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078059100 con 0x7f40780f77d0 2022-02-02T19:59:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.141+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4074010070 con 0x7f40780f77d0 2022-02-02T19:59:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.141+0000 7f406dffb700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.141+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f40740816b0 con 0x7f40780f77d0 2022-02-02T19:59:35.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.141+0000 7f407d482700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.142+0000 7f407d482700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f4068013690 tx=0x7f4068009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.145+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f407404f7b0 con 0x7f40780f77d0 2022-02-02T19:59:35.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.315+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40780fee60 con 0x7f4064064e20 2022-02-02T19:59:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.324+0000 7f406dffb700 1 -- 172.21.15.96:0/484868278 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f40780fee60 con 0x7f4064064e20 2022-02-02T19:59:35.328 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T19:59:35.328 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (102m) 73m ago 104m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T19:59:35.328 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (95m) 73m ago 103m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T19:59:35.329 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (95m) 71m ago 103m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T19:59:35.329 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (102m) 73m ago 103m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T19:59:35.329 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (100m) 73m ago 100m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T19:59:35.330 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (95m) 73m ago 100m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T19:59:35.330 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (100m) 71m ago 100m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T19:59:35.330 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (95m) 71m ago 100m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T19:59:35.330 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (97m) 73m ago 105m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T19:59:35.331 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (96m) 71m ago 103m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T19:59:35.331 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (96m) 73m ago 105m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T19:59:35.331 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (95m) 71m ago 103m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T19:59:35.331 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (103m) 73m ago 103m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T19:59:35.332 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (103m) 71m ago 103m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T19:59:35.332 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (95m) 73m ago 102m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T19:59:35.332 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (94m) 73m ago 102m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T19:59:35.333 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (93m) 73m ago 102m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T19:59:35.333 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (93m) 71m ago 101m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T19:59:35.333 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (92m) 71m ago 101m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T19:59:35.333 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (92m) 71m ago 101m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T19:59:35.333 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (102m) 73m ago 103m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T19:59:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 msgr2=0x7f40640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f4068013690 tx=0x7f4068009b30).stop 2022-02-02T19:59:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 msgr2=0x7f40781072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f407400c530 tx=0x7f4074007e20).stop 2022-02-02T19:59:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 shutdown_connections 2022-02-02T19:59:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f6530 0x7f4078106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 --2- 172.21.15.96:0/484868278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f77d0 0x7f40781072f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 >> 172.21.15.96:0/484868278 conn(0x7f40780f1c90 msgr2=0x7f40780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 shutdown_connections 2022-02-02T19:59:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.326+0000 7f407e484700 1 -- 172.21.15.96:0/484868278 wait complete. 2022-02-02T19:59:35.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 -- 172.21.15.96:0/989579500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66d0 msgr2=0x7f6ee80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 --2- 172.21.15.96:0/989579500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66d0 0x7f6ee80f6b30 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f6edc004660 tx=0x7f6edc009b30).stop 2022-02-02T19:59:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 -- 172.21.15.96:0/989579500 shutdown_connections 2022-02-02T19:59:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 --2- 172.21.15.96:0/989579500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f66d0 0x7f6ee80f6b30 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 --2- 172.21.15.96:0/989579500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f5430 0x7f6ee80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.422+0000 7f6eecf95700 1 -- 172.21.15.96:0/989579500 >> 172.21.15.96:0/989579500 conn(0x7f6ee80f0b90 msgr2=0x7f6ee80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 -- 172.21.15.96:0/989579500 shutdown_connections 2022-02-02T19:59:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 -- 172.21.15.96:0/989579500 wait complete. 2022-02-02T19:59:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 Processor -- start 2022-02-02T19:59:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 -- start start 2022-02-02T19:59:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.423+0000 7f6eecf95700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66d0 0x7f6ee81093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6eecf95700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8109970 con 0x7f6ee80f5430 2022-02-02T19:59:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6eecf95700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8109ab0 con 0x7f6ee80f66d0 2022-02-02T19:59:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34596/0 (socket says 172.21.15.96:34596) 2022-02-02T19:59:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 -- 172.21.15.96:0/910295211 learned_addr learned my addr 172.21.15.96:0/910295211 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee6ffd700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66d0 0x7f6ee81093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 -- 172.21.15.96:0/910295211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66d0 msgr2=0x7f6ee81093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66d0 0x7f6ee81093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 -- 172.21.15.96:0/910295211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc005040 con 0x7f6ee80f5430 2022-02-02T19:59:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ee77fe700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f6ed800e7c0 tx=0x7f6ed800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed80092e0 con 0x7f6ee80f5430 2022-02-02T19:59:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee810a450 con 0x7f6ee80f5430 2022-02-02T19:59:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x7f6ee80f5430 2022-02-02T19:59:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed80147e0 con 0x7f6ee80f5430 2022-02-02T19:59:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.424+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee810aa10 con 0x7f6ee80f5430 2022-02-02T19:59:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.426+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8045ad0 con 0x7f6ee80f5430 2022-02-02T19:59:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.426+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6ed801b030 con 0x7f6ee80f5430 2022-02-02T19:59:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.426+0000 7f6ecffff700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 0x7f6ed00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.426+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6ed80819f0 con 0x7f6ee80f5430 2022-02-02T19:59:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.426+0000 7f6ee6ffd700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 0x7f6ed00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.427+0000 7f6ee6ffd700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 0x7f6ed00672e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6edc005010 tx=0x7f6edc016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.431+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6ed8083e60 con 0x7f6ee80f5430 2022-02-02T19:59:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.660+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ee810f4f0 con 0x7f6ee80f5430 2022-02-02T19:59:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.661+0000 7f6ecffff700 1 -- 172.21.15.96:0/910295211 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6ed8019070 con 0x7f6ee80f5430 2022-02-02T19:59:35.665 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T19:59:35.665 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T19:59:35.665 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:59:35.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:35.666 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T19:59:35.666 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T19:59:35.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:35.667 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T19:59:35.669 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T19:59:35.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:35.670 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T19:59:35.670 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T19:59:35.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T19:59:35.670 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T19:59:35.671 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T19:59:35.671 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T19:59:35.671 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T19:59:35.671 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T19:59:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 msgr2=0x7f6ed00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 0x7f6ed00672e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6edc005010 tx=0x7f6edc016040).stop 2022-02-02T19:59:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 msgr2=0x7f6ee8108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f6ed800e7c0 tx=0x7f6ed800b040).stop 2022-02-02T19:59:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 shutdown_connections 2022-02-02T19:59:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ed0064e20 0x7f6ed00672e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ee80f5430 0x7f6ee8108ed0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 --2- 172.21.15.96:0/910295211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ee80f66d0 0x7f6ee81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 >> 172.21.15.96:0/910295211 conn(0x7f6ee80f0b90 msgr2=0x7f6ee805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 shutdown_connections 2022-02-02T19:59:35.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.663+0000 7f6eecf95700 1 -- 172.21.15.96:0/910295211 wait complete. 2022-02-02T19:59:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 -- 172.21.15.96:0/3506977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 msgr2=0x7f7a980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 --2- 172.21.15.96:0/3506977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a980f7de0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f7a88004660 tx=0x7f7a88009b30).stop 2022-02-02T19:59:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 -- 172.21.15.96:0/3506977577 shutdown_connections 2022-02-02T19:59:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 --2- 172.21.15.96:0/3506977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a980f7de0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 --2- 172.21.15.96:0/3506977577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T19:59:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.761+0000 7f7a9e765700 1 -- 172.21.15.96:0/3506977577 >> 172.21.15.96:0/3506977577 conn(0x7f7a980f1e40 msgr2=0x7f7a980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.762+0000 7f7a9e765700 1 -- 172.21.15.96:0/3506977577 shutdown_connections 2022-02-02T19:59:35.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.762+0000 7f7a9e765700 1 -- 172.21.15.96:0/3506977577 wait complete. 2022-02-02T19:59:35.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.762+0000 7f7a9e765700 1 Processor -- start 2022-02-02T19:59:35.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.762+0000 7f7a9e765700 1 -- start start 2022-02-02T19:59:35.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a9e765700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a98106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a9e765700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a9e765700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98107ab0 con 0x7f7a980f7980 2022-02-02T19:59:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a9e765700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98108360 con 0x7f7a980f66e0 2022-02-02T19:59:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34608/0 (socket says 172.21.15.96:34608) 2022-02-02T19:59:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 -- 172.21.15.96:0/4198329191 learned_addr learned my addr 172.21.15.96:0/4198329191 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T19:59:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a97fff700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a98106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 -- 172.21.15.96:0/4198329191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 msgr2=0x7f7a98106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a98106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 -- 172.21.15.96:0/4198329191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a88005040 con 0x7f7a980f7980 2022-02-02T19:59:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a97fff700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a98106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T19:59:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a977fe700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f7a88009990 tx=0x7f7a88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.763+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a88018070 con 0x7f7a980f7980 2022-02-02T19:59:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.764+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a88007ca0 con 0x7f7a980f7980 2022-02-02T19:59:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.764+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8801c620 con 0x7f7a980f7980 2022-02-02T19:59:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.764+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a981085e0 con 0x7f7a980f7980 2022-02-02T19:59:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.764+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a98108af0 con 0x7f7a980f7980 2022-02-02T19:59:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.764+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a980f5ad0 con 0x7f7a980f7980 2022-02-02T19:59:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.765+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a8801d960 con 0x7f7a980f7980 2022-02-02T19:59:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.765+0000 7f7a94ff9700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 0x7f7a80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T19:59:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.766+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a88083860 con 0x7f7a980f7980 2022-02-02T19:59:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.766+0000 7f7a97fff700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 0x7f7a80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T19:59:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.766+0000 7f7a97fff700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 0x7f7a80067290 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f7a980f77e0 tx=0x7f7a8c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T19:59:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.770+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a880553d0 con 0x7f7a980f7980 2022-02-02T19:59:35.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.972+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7a98045ad0 con 0x7f7a980f7980 2022-02-02T19:59:35.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.973+0000 7f7a94ff9700 1 -- 172.21.15.96:0/4198329191 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7a88054fc0 con 0x7f7a980f7980 2022-02-02T19:59:35.977 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T19:59:35.977 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T19:59:35.977 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:59:35.978 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T19:59:35.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:35.978 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T19:59:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T19:59:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T19:59:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T19:59:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T19:59:35.980 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T19:59:35.980 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T19:59:35.980 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T19:59:35.980 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T19:59:35.981 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T19:59:35.981 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T19:59:35.981 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T19:59:35.981 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T19:59:35.982 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T19:59:35.982 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T19:59:35.982 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T19:59:35.983 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T19:59:35.983 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T19:59:35.983 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T19:59:35.983 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T19:59:35.984 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T19:59:35.984 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T19:59:35.984 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T19:59:35.984 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T19:59:35.985 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T19:59:35.985 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T19:59:35.985 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T19:59:35.986 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:35.986 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:35.986 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T19:59:35.987 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T19:59:35.987 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:35.987 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:35.987 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T19:59:35.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 msgr2=0x7f7a80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 0x7f7a80067290 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f7a980f77e0 tx=0x7f7a8c008040).stop 2022-02-02T19:59:35.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 msgr2=0x7f7a98107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T19:59:35.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f7a88009990 tx=0x7f7a88009b30).stop 2022-02-02T19:59:35.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 shutdown_connections 2022-02-02T19:59:35.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a80064dd0 0x7f7a80067290 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a980f66e0 0x7f7a98106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 --2- 172.21.15.96:0/4198329191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a980f7980 0x7f7a98107470 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T19:59:35.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 >> 172.21.15.96:0/4198329191 conn(0x7f7a980f1e40 msgr2=0x7f7a980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T19:59:35.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 shutdown_connections 2022-02-02T19:59:35.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T19:59:35.974+0000 7f7a9e765700 1 -- 172.21.15.96:0/4198329191 wait complete. 2022-02-02T19:59:35.992 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T19:59:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:36 smithi159 ceph-mon[69013]: pgmap v2925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:36 smithi159 ceph-mon[69013]: from='client.37110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:36.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:36 smithi159 ceph-mon[69013]: from='client.37114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/910295211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:59:36.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4198329191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:59:36.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:36 smithi096 ceph-mon[101353]: pgmap v2925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:36.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:36 smithi096 ceph-mon[101353]: from='client.37110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:36.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:36 smithi096 ceph-mon[101353]: from='client.37114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T19:59:36.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/910295211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T19:59:36.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4198329191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T19:59:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:37 smithi159 ceph-mon[69013]: pgmap v2926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:37 smithi096 ceph-mon[101353]: pgmap v2926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:39 smithi159 ceph-mon[69013]: pgmap v2927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:40.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:39 smithi096 ceph-mon[101353]: pgmap v2927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:42 smithi159 ceph-mon[69013]: pgmap v2928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:42.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:42 smithi096 ceph-mon[101353]: pgmap v2928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:44 smithi159 ceph-mon[69013]: pgmap v2929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:44 smithi096 ceph-mon[101353]: pgmap v2929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:46.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:46 smithi159 ceph-mon[69013]: pgmap v2930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:46.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:46 smithi096 ceph-mon[101353]: pgmap v2930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:47 smithi159 ceph-mon[69013]: pgmap v2931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:47 smithi096 ceph-mon[101353]: pgmap v2931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:50.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:49 smithi159 ceph-mon[69013]: pgmap v2932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:49 smithi096 ceph-mon[101353]: pgmap v2932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:52 smithi159 ceph-mon[69013]: pgmap v2933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:52.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:52 smithi096 ceph-mon[101353]: pgmap v2933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:54 smithi159 ceph-mon[69013]: pgmap v2934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:54.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:54 smithi096 ceph-mon[101353]: pgmap v2934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:56.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:56 smithi159 ceph-mon[69013]: pgmap v2935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:56.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:56 smithi096 ceph-mon[101353]: pgmap v2935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:57 smithi159 ceph-mon[69013]: pgmap v2936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T19:59:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:57 smithi096 ceph-mon[101353]: pgmap v2936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 19:59:59 smithi159 ceph-mon[69013]: pgmap v2937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 19:59:59 smithi096 ceph-mon[101353]: pgmap v2937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:01.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:00:01.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:00:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:02 smithi159 ceph-mon[69013]: pgmap v2938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:02 smithi096 ceph-mon[101353]: pgmap v2938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:04.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:04 smithi159 ceph-mon[69013]: pgmap v2939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:04.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:04 smithi096 ceph-mon[101353]: pgmap v2939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:06.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.083+0000 7f42e47b4700 1 -- 172.21.15.96:0/4018966822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f55c0 msgr2=0x7f42dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.083+0000 7f42e47b4700 1 --2- 172.21.15.96:0/4018966822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f55c0 0x7f42dc0f59e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f42d8004660 tx=0x7f42d8009b30).stop 2022-02-02T20:00:06.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- 172.21.15.96:0/4018966822 shutdown_connections 2022-02-02T20:00:06.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 --2- 172.21.15.96:0/4018966822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f6860 0x7f42dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 --2- 172.21.15.96:0/4018966822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f55c0 0x7f42dc0f59e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- 172.21.15.96:0/4018966822 >> 172.21.15.96:0/4018966822 conn(0x7f42dc0f0d40 msgr2=0x7f42dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- 172.21.15.96:0/4018966822 shutdown_connections 2022-02-02T20:00:06.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- 172.21.15.96:0/4018966822 wait complete. 2022-02-02T20:00:06.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 Processor -- start 2022-02-02T20:00:06.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- start start 2022-02-02T20:00:06.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f55c0 0x7f42dc109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc109c00 con 0x7f42dc0f6860 2022-02-02T20:00:06.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.084+0000 7f42e47b4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc109d40 con 0x7f42dc0f55c0 2022-02-02T20:00:06.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34624/0 (socket says 172.21.15.96:34624) 2022-02-02T20:00:06.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 -- 172.21.15.96:0/2398310188 learned_addr learned my addr 172.21.15.96:0/2398310188 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:06.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e2550700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f55c0 0x7f42dc109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 -- 172.21.15.96:0/2398310188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f55c0 msgr2=0x7f42dc109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f55c0 0x7f42dc109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 -- 172.21.15.96:0/2398310188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8005040 con 0x7f42dc0f6860 2022-02-02T20:00:06.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e1d4f700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f42cc00c530 tx=0x7f42cc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc00f650 con 0x7f42dc0f6860 2022-02-02T20:00:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42cc00fc60 con 0x7f42dc0f6860 2022-02-02T20:00:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc10a6e0 con 0x7f42dc0f6860 2022-02-02T20:00:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc012c20 con 0x7f42dc0f6860 2022-02-02T20:00:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.085+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc10aca0 con 0x7f42dc0f6860 2022-02-02T20:00:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.086+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc045ad0 con 0x7f42dc0f6860 2022-02-02T20:00:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.087+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42cc010070 con 0x7f42dc0f6860 2022-02-02T20:00:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.088+0000 7f42d2ffd700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.088+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42cc081f20 con 0x7f42dc0f6860 2022-02-02T20:00:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.088+0000 7f42e2550700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.088+0000 7f42e2550700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f42d8004630 tx=0x7f42d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.091+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42cc053a10 con 0x7f42dc0f6860 2022-02-02T20:00:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.267+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42dc0faaa0 con 0x7f42c8064dd0 2022-02-02T20:00:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.269+0000 7f42d2ffd700 1 -- 172.21.15.96:0/2398310188 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f42dc0faaa0 con 0x7f42c8064dd0 2022-02-02T20:00:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 msgr2=0x7f42c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f42d8004630 tx=0x7f42d8009b30).stop 2022-02-02T20:00:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 msgr2=0x7f42dc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f42cc00c530 tx=0x7f42cc007e20).stop 2022-02-02T20:00:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 shutdown_connections 2022-02-02T20:00:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42dc0f55c0 0x7f42dc109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 --2- 172.21.15.96:0/2398310188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42dc0f6860 0x7f42dc109650 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.270+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 >> 172.21.15.96:0/2398310188 conn(0x7f42dc0f0d40 msgr2=0x7f42dc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.271+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 shutdown_connections 2022-02-02T20:00:06.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.271+0000 7f42e47b4700 1 -- 172.21.15.96:0/2398310188 wait complete. 2022-02-02T20:00:06.284 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:00:06.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 -- 172.21.15.96:0/2981287939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b4060310 msgr2=0x7f26b40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 --2- 172.21.15.96:0/2981287939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b4060310 0x7f26b40f9110 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f269c004660 tx=0x7f269c009b30).stop 2022-02-02T20:00:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 -- 172.21.15.96:0/2981287939 shutdown_connections 2022-02-02T20:00:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 --2- 172.21.15.96:0/2981287939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b40f9690 0x7f26b40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 --2- 172.21.15.96:0/2981287939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b4060310 0x7f26b40f9110 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.370+0000 7f26b92b7700 1 -- 172.21.15.96:0/2981287939 >> 172.21.15.96:0/2981287939 conn(0x7f26b40f0b90 msgr2=0x7f26b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 -- 172.21.15.96:0/2981287939 shutdown_connections 2022-02-02T20:00:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 -- 172.21.15.96:0/2981287939 wait complete. 2022-02-02T20:00:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 Processor -- start 2022-02-02T20:00:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 -- start start 2022-02-02T20:00:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b4060310 0x7f26b40f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40f5570 con 0x7f26b40f9690 2022-02-02T20:00:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.371+0000 7f26b92b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40f56b0 con 0x7f26b4060310 2022-02-02T20:00:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34632/0 (socket says 172.21.15.96:34632) 2022-02-02T20:00:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 -- 172.21.15.96:0/794959225 learned_addr learned my addr 172.21.15.96:0/794959225 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:06.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b3fff700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b4060310 0x7f26b40f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 -- 172.21.15.96:0/794959225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b4060310 msgr2=0x7f26b40f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b4060310 0x7f26b40f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 -- 172.21.15.96:0/794959225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c005040 con 0x7f26b40f9690 2022-02-02T20:00:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b37fe700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f26a4002700 tx=0x7f26a4009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a40079c0 con 0x7f26b40f9690 2022-02-02T20:00:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b40f5990 con 0x7f26b40f9690 2022-02-02T20:00:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26a400f040 con 0x7f26b40f9690 2022-02-02T20:00:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a4014740 con 0x7f26b40f9690 2022-02-02T20:00:06.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.372+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b410ed70 con 0x7f26b40f9690 2022-02-02T20:00:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.373+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b4045ad0 con 0x7f26b40f9690 2022-02-02T20:00:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.374+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26a401b060 con 0x7f26b40f9690 2022-02-02T20:00:06.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.374+0000 7f26b0ff9700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 0x7f26a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.374+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26a4081930 con 0x7f26b40f9690 2022-02-02T20:00:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.374+0000 7f26b3fff700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 0x7f26a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.374+0000 7f26b3fff700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 0x7f26a00672e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f269c004630 tx=0x7f269c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.378+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26a404fb10 con 0x7f26b40f9690 2022-02-02T20:00:06.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.552+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26b40fee20 con 0x7f26a0064e20 2022-02-02T20:00:06.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.561+0000 7f26b0ff9700 1 -- 172.21.15.96:0/794959225 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f26b40fee20 con 0x7f26a0064e20 2022-02-02T20:00:06.566 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:00:06.566 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (103m) 74m ago 104m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:00:06.566 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (95m) 74m ago 104m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:00:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (95m) 72m ago 104m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:00:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (103m) 74m ago 104m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:00:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (100m) 74m ago 100m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:00:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (96m) 74m ago 100m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:00:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (100m) 72m ago 100m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:00:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (96m) 72m ago 100m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:00:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (97m) 74m ago 105m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:00:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (97m) 72m ago 104m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:00:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (96m) 74m ago 105m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:00:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (96m) 72m ago 103m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:00:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (104m) 74m ago 104m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:00:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (103m) 72m ago 103m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:00:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (95m) 74m ago 103m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:00:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (94m) 74m ago 103m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:00:06.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (94m) 74m ago 102m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:00:06.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (93m) 72m ago 102m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:00:06.570 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (93m) 72m ago 102m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:00:06.571 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (92m) 72m ago 101m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:00:06.571 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (103m) 74m ago 104m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:00:06.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 msgr2=0x7f26a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 0x7f26a00672e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f269c004630 tx=0x7f269c009b30).stop 2022-02-02T20:00:06.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 msgr2=0x7f26b40f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f26a4002700 tx=0x7f26a4009d60).stop 2022-02-02T20:00:06.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 shutdown_connections 2022-02-02T20:00:06.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26a0064e20 0x7f26a00672e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b4060310 0x7f26b40f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 --2- 172.21.15.96:0/794959225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b40f9690 0x7f26b40f5010 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 >> 172.21.15.96:0/794959225 conn(0x7f26b40f0b90 msgr2=0x7f26b40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 shutdown_connections 2022-02-02T20:00:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.563+0000 7f26b92b7700 1 -- 172.21.15.96:0/794959225 wait complete. 2022-02-02T20:00:06.665 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:06 smithi096 ceph-mon[101353]: pgmap v2940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:06.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 -- 172.21.15.96:0/3021202667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f5430 msgr2=0x7f12780f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 --2- 172.21.15.96:0/3021202667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f5430 0x7f12780f5850 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f126c004660 tx=0x7f126c009b30).stop 2022-02-02T20:00:06.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 -- 172.21.15.96:0/3021202667 shutdown_connections 2022-02-02T20:00:06.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 --2- 172.21.15.96:0/3021202667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f66d0 0x7f12780f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 --2- 172.21.15.96:0/3021202667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f5430 0x7f12780f5850 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 -- 172.21.15.96:0/3021202667 >> 172.21.15.96:0/3021202667 conn(0x7f12780f0b90 msgr2=0x7f12780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 -- 172.21.15.96:0/3021202667 shutdown_connections 2022-02-02T20:00:06.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.661+0000 7f127759e700 1 -- 172.21.15.96:0/3021202667 wait complete. 2022-02-02T20:00:06.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 Processor -- start 2022-02-02T20:00:06.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 -- start start 2022-02-02T20:00:06.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f5430 0x7f127810beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780602b0 con 0x7f12780f66d0 2022-02-02T20:00:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780603f0 con 0x7f12780f5430 2022-02-02T20:00:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34642/0 (socket says 172.21.15.96:34642) 2022-02-02T20:00:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 -- 172.21.15.96:0/1224465333 learned_addr learned my addr 172.21.15.96:0/1224465333 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f127659c700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f5430 0x7f127810beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 -- 172.21.15.96:0/1224465333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f5430 msgr2=0x7f127810beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f5430 0x7f127810beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 -- 172.21.15.96:0/1224465333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c005040 con 0x7f12780f66d0 2022-02-02T20:00:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.662+0000 7f1275d9b700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f126800c530 tx=0x7f1268007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.663+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126800f650 con 0x7f12780f66d0 2022-02-02T20:00:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.663+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f126800fc60 con 0x7f12780f66d0 2022-02-02T20:00:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.663+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127810e8a0 con 0x7f12780f66d0 2022-02-02T20:00:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.663+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1268012bd0 con 0x7f12780f66d0 2022-02-02T20:00:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.663+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127810ed20 con 0x7f12780f66d0 2022-02-02T20:00:06.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.664+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c004fa0 con 0x7f12780f66d0 2022-02-02T20:00:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.665+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1268010070 con 0x7f12780f66d0 2022-02-02T20:00:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.666+0000 7f1266ffd700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 0x7f12600673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.666+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1268081d60 con 0x7f12780f66d0 2022-02-02T20:00:06.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.666+0000 7f127659c700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 0x7f12600673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.666+0000 7f127659c700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 0x7f12600673b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f126c013690 tx=0x7f126c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:06.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.670+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1268050020 con 0x7f12780f66d0 2022-02-02T20:00:06.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:06 smithi159 ceph-mon[69013]: pgmap v2940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:06.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.901+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f125c005940 con 0x7f12780f66d0 2022-02-02T20:00:06.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.901+0000 7f1266ffd700 1 -- 172.21.15.96:0/1224465333 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1268053640 con 0x7f12780f66d0 2022-02-02T20:00:06.906 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:00:06.906 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:00:06.907 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:00:06.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:06.907 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:00:06.907 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:00:06.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:06.908 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:00:06.908 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:00:06.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:06.909 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:00:06.909 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:00:06.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:06.909 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:00:06.910 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:00:06.910 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:00:06.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:00:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:00:06.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 msgr2=0x7f12600673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 0x7f12600673b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f126c013690 tx=0x7f126c009b30).stop 2022-02-02T20:00:06.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 msgr2=0x7f127810e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:06.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f126800c530 tx=0x7f1268007e20).stop 2022-02-02T20:00:06.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 shutdown_connections 2022-02-02T20:00:06.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1260064ef0 0x7f12600673b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12780f5430 0x7f127810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 --2- 172.21.15.96:0/1224465333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780f66d0 0x7f127810e3b0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:06.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 >> 172.21.15.96:0/1224465333 conn(0x7f12780f0b90 msgr2=0x7f12780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:06.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 shutdown_connections 2022-02-02T20:00:06.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:06.903+0000 7f127759e700 1 -- 172.21.15.96:0/1224465333 wait complete. 2022-02-02T20:00:07.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 -- 172.21.15.96:0/1893657123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f5970 msgr2=0x7fd8b00f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:07.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/1893657123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f5970 0x7fd8b00f5df0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fd8ac004660 tx=0x7fd8ac009b30).stop 2022-02-02T20:00:07.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 -- 172.21.15.96:0/1893657123 shutdown_connections 2022-02-02T20:00:07.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/1893657123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f5970 0x7fd8b00f5df0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:07.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/1893657123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6c60 0x7fd8b00f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:00:07.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 -- 172.21.15.96:0/1893657123 >> 172.21.15.96:0/1893657123 conn(0x7fd8b00f04c0 msgr2=0x7fd8b00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:07.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 -- 172.21.15.96:0/1893657123 shutdown_connections 2022-02-02T20:00:07.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.000+0000 7fd8b83ec700 1 -- 172.21.15.96:0/1893657123 wait complete. 2022-02-02T20:00:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 Processor -- start 2022-02-02T20:00:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 -- start start 2022-02-02T20:00:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 0x7fd8b0109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00f5690 con 0x7fd8b00f6c60 2022-02-02T20:00:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b83ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00f57d0 con 0x7fd8b00f5970 2022-02-02T20:00:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b5987700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b5987700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34652/0 (socket says 172.21.15.96:34652) 2022-02-02T20:00:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.001+0000 7fd8b5987700 1 -- 172.21.15.96:0/4284834275 learned_addr learned my addr 172.21.15.96:0/4284834275 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b6188700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 0x7fd8b0109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b5987700 1 -- 172.21.15.96:0/4284834275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 msgr2=0x7fd8b0109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b5987700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 0x7fd8b0109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b5987700 1 -- 172.21.15.96:0/4284834275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac005040 con 0x7fd8b00f6c60 2022-02-02T20:00:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b6188700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 0x7fd8b0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:00:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b5987700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fd8ac009990 tx=0x7fd8ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ac018070 con 0x7fd8b00f6c60 2022-02-02T20:00:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8ac007ba0 con 0x7fd8b00f6c60 2022-02-02T20:00:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b010c7b0 con 0x7fd8b00f6c60 2022-02-02T20:00:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ac01c620 con 0x7fd8b00f6c60 2022-02-02T20:00:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.002+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b010cd10 con 0x7fd8b00f6c60 2022-02-02T20:00:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.003+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0045ad0 con 0x7fd8b00f6c60 2022-02-02T20:00:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.004+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8ac01d420 con 0x7fd8b00f6c60 2022-02-02T20:00:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.004+0000 7fd8a6ffd700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 0x7fd89c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.004+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8ac083920 con 0x7fd8b00f6c60 2022-02-02T20:00:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.004+0000 7fd8b6188700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 0x7fd89c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.004+0000 7fd8b6188700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 0x7fd89c067290 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fd8b00f5280 tx=0x7fd8a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.008+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8ac051a20 con 0x7fd8b00f6c60 2022-02-02T20:00:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.207+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd8b0027a00 con 0x7fd8b00f6c60 2022-02-02T20:00:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.208+0000 7fd8a6ffd700 1 -- 172.21.15.96:0/4284834275 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd8ac055040 con 0x7fd8b00f6c60 2022-02-02T20:00:07.212 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:00:07.213 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:00:07.213 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:00:07.213 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:00:07.213 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:07.214 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:00:07.214 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:00:07.214 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:00:07.214 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:00:07.215 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:00:07.215 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:00:07.215 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:00:07.215 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:00:07.215 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:00:07.216 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:00:07.216 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:00:07.216 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:00:07.216 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:00:07.217 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:00:07.217 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:00:07.217 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:00:07.217 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:00:07.218 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:00:07.218 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:00:07.218 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:00:07.218 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:00:07.218 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:00:07.219 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:00:07.219 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:00:07.219 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:00:07.219 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:00:07.220 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:00:07.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:07.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:07.220 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:00:07.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:07.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:07.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:07.221 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:07.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 msgr2=0x7fd89c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:07.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 0x7fd89c067290 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fd8b00f5280 tx=0x7fd8a0008040).stop 2022-02-02T20:00:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 msgr2=0x7fd8b010c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fd8ac009990 tx=0x7fd8ac009b30).stop 2022-02-02T20:00:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 shutdown_connections 2022-02-02T20:00:07.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd89c064dd0 0x7fd89c067290 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f5970 0x7fd8b0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 --2- 172.21.15.96:0/4284834275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6c60 0x7fd8b010c200 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:07.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.209+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 >> 172.21.15.96:0/4284834275 conn(0x7fd8b00f04c0 msgr2=0x7fd8b00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:07.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.210+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 shutdown_connections 2022-02-02T20:00:07.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:07.210+0000 7fd8b83ec700 1 -- 172.21.15.96:0/4284834275 wait complete. 2022-02-02T20:00:07.225 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:00:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:07 smithi159 ceph-mon[69013]: from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:07 smithi159 ceph-mon[69013]: from='client.37130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:07 smithi159 ceph-mon[69013]: pgmap v2941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:07.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1224465333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:00:07.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4284834275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:00:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:07 smithi096 ceph-mon[101353]: from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:07 smithi096 ceph-mon[101353]: from='client.37130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:07 smithi096 ceph-mon[101353]: pgmap v2941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1224465333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:00:07.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4284834275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:00:10.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:09 smithi159 ceph-mon[69013]: pgmap v2942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:09 smithi096 ceph-mon[101353]: pgmap v2942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:12 smithi159 ceph-mon[69013]: pgmap v2943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:12 smithi096 ceph-mon[101353]: pgmap v2943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:14.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:14 smithi159 ceph-mon[69013]: pgmap v2944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:14.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:14 smithi096 ceph-mon[101353]: pgmap v2944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:16.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:16 smithi159 ceph-mon[69013]: pgmap v2945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:16.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:16 smithi096 ceph-mon[101353]: pgmap v2945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:17 smithi159 ceph-mon[69013]: pgmap v2946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:17 smithi096 ceph-mon[101353]: pgmap v2946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:19 smithi159 ceph-mon[69013]: pgmap v2947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:20.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:19 smithi096 ceph-mon[101353]: pgmap v2947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:22 smithi159 ceph-mon[69013]: pgmap v2948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:22.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:22 smithi096 ceph-mon[101353]: pgmap v2948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:24.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:24 smithi159 ceph-mon[69013]: pgmap v2949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:24.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:24 smithi096 ceph-mon[101353]: pgmap v2949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:25.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:25 smithi159 ceph-mon[69013]: pgmap v2950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:25.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:25 smithi096 ceph-mon[101353]: pgmap v2950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:00:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:00:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:00:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:00:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:28 smithi159 ceph-mon[69013]: pgmap v2951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:28 smithi096 ceph-mon[101353]: pgmap v2951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:29.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:29 smithi159 ceph-mon[69013]: pgmap v2952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:29.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:29 smithi096 ceph-mon[101353]: pgmap v2952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:32 smithi159 ceph-mon[69013]: pgmap v2953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:32 smithi096 ceph-mon[101353]: pgmap v2953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:34.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:34 smithi159 ceph-mon[69013]: pgmap v2954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:34 smithi096 ceph-mon[101353]: pgmap v2954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:35.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:35 smithi159 ceph-mon[69013]: pgmap v2955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:35.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:35 smithi096 ceph-mon[101353]: pgmap v2955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- 172.21.15.96:0/235190476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 msgr2=0x7f46fc0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 --2- 172.21.15.96:0/235190476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc0f5860 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f46ec004660 tx=0x7f46ec009b30).stop 2022-02-02T20:00:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- 172.21.15.96:0/235190476 shutdown_connections 2022-02-02T20:00:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 --2- 172.21.15.96:0/235190476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 --2- 172.21.15.96:0/235190476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc0f5860 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- 172.21.15.96:0/235190476 >> 172.21.15.96:0/235190476 conn(0x7f46fc0f0ba0 msgr2=0x7f46fc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- 172.21.15.96:0/235190476 shutdown_connections 2022-02-02T20:00:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- 172.21.15.96:0/235190476 wait complete. 2022-02-02T20:00:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 Processor -- start 2022-02-02T20:00:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.320+0000 7f46fb59e700 1 -- start start 2022-02-02T20:00:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fb59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fb59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fb59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc107900 con 0x7f46fc0f5440 2022-02-02T20:00:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fb59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc108110 con 0x7f46fc0f66e0 2022-02-02T20:00:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34666/0 (socket says 172.21.15.96:34666) 2022-02-02T20:00:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 -- 172.21.15.96:0/4045800322 learned_addr learned my addr 172.21.15.96:0/4045800322 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46f9d9b700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 -- 172.21.15.96:0/4045800322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 msgr2=0x7f46fc107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 -- 172.21.15.96:0/4045800322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec005040 con 0x7f46fc0f5440 2022-02-02T20:00:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46f9d9b700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:00:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fa59c700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f46ec004f60 tx=0x7f46ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46ec018070 con 0x7f46fc0f5440 2022-02-02T20:00:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46ec007ba0 con 0x7f46fc0f5440 2022-02-02T20:00:37.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc108330 con 0x7f46fc0f5440 2022-02-02T20:00:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.321+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46ec01c620 con 0x7f46fc0f5440 2022-02-02T20:00:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.322+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc108890 con 0x7f46fc0f5440 2022-02-02T20:00:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.323+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc059100 con 0x7f46fc0f5440 2022-02-02T20:00:37.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.323+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f46ec01c8e0 con 0x7f46fc0f5440 2022-02-02T20:00:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.323+0000 7f46eaffd700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 0x7f46e40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.323+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f46ec083960 con 0x7f46fc0f5440 2022-02-02T20:00:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.323+0000 7f46f9d9b700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 0x7f46e40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.324+0000 7f46f9d9b700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 0x7f46e40672e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f46f0004a90 tx=0x7f46f0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.328+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46ec051b20 con 0x7f46fc0f5440 2022-02-02T20:00:37.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.506+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46fc0fab20 con 0x7f46e4064e20 2022-02-02T20:00:37.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.507+0000 7f46eaffd700 1 -- 172.21.15.96:0/4045800322 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f46fc0fab20 con 0x7f46e4064e20 2022-02-02T20:00:37.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 msgr2=0x7f46e40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 0x7f46e40672e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f46f0004a90 tx=0x7f46f0009040).stop 2022-02-02T20:00:37.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 msgr2=0x7f46fc106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f46ec004f60 tx=0x7f46ec009b30).stop 2022-02-02T20:00:37.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 shutdown_connections 2022-02-02T20:00:37.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46e4064e20 0x7f46e40672e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46fc0f5440 0x7f46fc106e10 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 --2- 172.21.15.96:0/4045800322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46fc0f66e0 0x7f46fc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 >> 172.21.15.96:0/4045800322 conn(0x7f46fc0f0ba0 msgr2=0x7f46fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:37.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 shutdown_connections 2022-02-02T20:00:37.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.509+0000 7f46fb59e700 1 -- 172.21.15.96:0/4045800322 wait complete. 2022-02-02T20:00:37.523 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:00:37.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 -- 172.21.15.96:0/1110457889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f66e0 msgr2=0x7fb77c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 --2- 172.21.15.96:0/1110457889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f66e0 0x7fb77c0f6b00 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fb76c0099e0 tx=0x7fb76c004d10).stop 2022-02-02T20:00:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 -- 172.21.15.96:0/1110457889 shutdown_connections 2022-02-02T20:00:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 --2- 172.21.15.96:0/1110457889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f7980 0x7fb77c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:00:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 --2- 172.21.15.96:0/1110457889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f66e0 0x7fb77c0f6b00 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 -- 172.21.15.96:0/1110457889 >> 172.21.15.96:0/1110457889 conn(0x7fb77c0f1e40 msgr2=0x7fb77c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 -- 172.21.15.96:0/1110457889 shutdown_connections 2022-02-02T20:00:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.607+0000 7fb781257700 1 -- 172.21.15.96:0/1110457889 wait complete. 2022-02-02T20:00:37.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 Processor -- start 2022-02-02T20:00:37.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 -- start start 2022-02-02T20:00:37.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f66e0 0x7fb77c107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c107c50 con 0x7fb77c0f7980 2022-02-02T20:00:37.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb781257700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c108500 con 0x7fb77c0f66e0 2022-02-02T20:00:37.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb77a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb77a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34678/0 (socket says 172.21.15.96:34678) 2022-02-02T20:00:37.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.608+0000 7fb77a59c700 1 -- 172.21.15.96:0/2267116953 learned_addr learned my addr 172.21.15.96:0/2267116953 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:37.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb77ad9d700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f66e0 0x7fb77c107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb77a59c700 1 -- 172.21.15.96:0/2267116953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f66e0 msgr2=0x7fb77c107120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb77a59c700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f66e0 0x7fb77c107120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb77a59c700 1 -- 172.21.15.96:0/2267116953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009640 con 0x7fb77c0f7980 2022-02-02T20:00:37.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb77a59c700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fb76400b410 tx=0x7fb764006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7640125f0 con 0x7fb77c0f7980 2022-02-02T20:00:37.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb764012c00 con 0x7fb77c0f7980 2022-02-02T20:00:37.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c1087e0 con 0x7fb77c0f7980 2022-02-02T20:00:37.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb764002ae0 con 0x7fb77c0f7980 2022-02-02T20:00:37.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.609+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c108d20 con 0x7fb77c0f7980 2022-02-02T20:00:37.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.610+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c0f5ad0 con 0x7fb77c0f7980 2022-02-02T20:00:37.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.610+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb76400f030 con 0x7fb77c0f7980 2022-02-02T20:00:37.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.611+0000 7fb7737fe700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 0x7fb768067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.611+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb764081f10 con 0x7fb77c0f7980 2022-02-02T20:00:37.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.611+0000 7fb77ad9d700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 0x7fb768067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.611+0000 7fb77ad9d700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 0x7fb768067290 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fb76c009f50 tx=0x7fb76c004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.615+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb764053a40 con 0x7fb77c0f7980 2022-02-02T20:00:37.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.788+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb77c0fef90 con 0x7fb768064dd0 2022-02-02T20:00:37.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.797+0000 7fb7737fe700 1 -- 172.21.15.96:0/2267116953 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fb77c0fef90 con 0x7fb768064dd0 2022-02-02T20:00:37.802 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:00:37.802 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (104m) 74m ago 105m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:00:37.803 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (96m) 74m ago 105m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:00:37.803 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (96m) 73m ago 104m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:00:37.803 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (103m) 74m ago 104m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:00:37.803 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (101m) 74m ago 101m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:00:37.804 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (96m) 74m ago 101m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:00:37.804 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (101m) 73m ago 101m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:00:37.804 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (96m) 73m ago 101m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:00:37.804 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (98m) 74m ago 106m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:00:37.804 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (97m) 73m ago 104m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:00:37.805 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (97m) 74m ago 106m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:00:37.805 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (96m) 73m ago 104m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:00:37.805 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (104m) 74m ago 104m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:00:37.805 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (104m) 73m ago 104m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:00:37.805 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (96m) 74m ago 103m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:00:37.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (95m) 74m ago 103m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:00:37.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (94m) 74m ago 103m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:00:37.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (94m) 73m ago 102m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:00:37.806 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (93m) 73m ago 102m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:00:37.807 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (93m) 73m ago 102m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:00:37.807 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (103m) 74m ago 104m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:00:37.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 msgr2=0x7fb768067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 0x7fb768067290 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fb76c009f50 tx=0x7fb76c004d10).stop 2022-02-02T20:00:37.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 msgr2=0x7fb77c107610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fb76400b410 tx=0x7fb764006ef0).stop 2022-02-02T20:00:37.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 shutdown_connections 2022-02-02T20:00:37.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb768064dd0 0x7fb768067290 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb77c0f66e0 0x7fb77c107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 --2- 172.21.15.96:0/2267116953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb77c0f7980 0x7fb77c107610 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.799+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 >> 172.21.15.96:0/2267116953 conn(0x7fb77c0f1e40 msgr2=0x7fb77c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:37.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.800+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 shutdown_connections 2022-02-02T20:00:37.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.800+0000 7fb781257700 1 -- 172.21.15.96:0/2267116953 wait complete. 2022-02-02T20:00:37.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 -- 172.21.15.96:0/4048596463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 msgr2=0x7fcb900fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 --2- 172.21.15.96:0/4048596463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb900fbc80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fcb84004660 tx=0x7fcb84009b30).stop 2022-02-02T20:00:37.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 -- 172.21.15.96:0/4048596463 shutdown_connections 2022-02-02T20:00:37.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 --2- 172.21.15.96:0/4048596463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb900fbc80 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 --2- 172.21.15.96:0/4048596463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 0x7fcb900f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 -- 172.21.15.96:0/4048596463 >> 172.21.15.96:0/4048596463 conn(0x7fcb900f0d40 msgr2=0x7fcb900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:37.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 -- 172.21.15.96:0/4048596463 shutdown_connections 2022-02-02T20:00:37.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.896+0000 7fcb965a2700 1 -- 172.21.15.96:0/4048596463 wait complete. 2022-02-02T20:00:37.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 Processor -- start 2022-02-02T20:00:37.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 -- start start 2022-02-02T20:00:37.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 0x7fcb90106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901079e0 con 0x7fcb900f9830 2022-02-02T20:00:37.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb965a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90107b20 con 0x7fcb90060270 2022-02-02T20:00:37.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34688/0 (socket says 172.21.15.96:34688) 2022-02-02T20:00:37.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.897+0000 7fcb8f7fe700 1 -- 172.21.15.96:0/3904005758 learned_addr learned my addr 172.21.15.96:0/3904005758 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:37.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8ffff700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 0x7fcb90106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8f7fe700 1 -- 172.21.15.96:0/3904005758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 msgr2=0x7fcb90106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:37.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8f7fe700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 0x7fcb90106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:37.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8f7fe700 1 -- 172.21.15.96:0/3904005758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84005040 con 0x7fcb900f9830 2022-02-02T20:00:37.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8f7fe700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fcb84004f60 tx=0x7fcb84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb84018070 con 0x7fcb900f9830 2022-02-02T20:00:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb965a2700 1 -- 172.21.15.96:0/3904005758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90108460 con 0x7fcb900f9830 2022-02-02T20:00:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb84007c70 con 0x7fcb900f9830 2022-02-02T20:00:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8401c620 con 0x7fcb900f9830 2022-02-02T20:00:37.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.898+0000 7fcb965a2700 1 -- 172.21.15.96:0/3904005758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901089c0 con 0x7fcb900f9830 2022-02-02T20:00:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.899+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb68004fa0 con 0x7fcb900f9830 2022-02-02T20:00:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.899+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb8401d420 con 0x7fcb900f9830 2022-02-02T20:00:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.900+0000 7fcb8cff9700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 0x7fcb78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:37.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.900+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb84083890 con 0x7fcb900f9830 2022-02-02T20:00:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.900+0000 7fcb8ffff700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 0x7fcb78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.900+0000 7fcb8ffff700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 0x7fcb78067290 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fcb80007fd0 tx=0x7fcb80009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:37.904+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb84055570 con 0x7fcb900f9830 2022-02-02T20:00:38.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.137+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb68005e80 con 0x7fcb900f9830 2022-02-02T20:00:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.137+0000 7fcb8cff9700 1 -- 172.21.15.96:0/3904005758 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcb84055160 con 0x7fcb900f9830 2022-02-02T20:00:38.143 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:00:38.143 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:00:38.143 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:00:38.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:38.144 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:00:38.144 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:00:38.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:38.144 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:00:38.144 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:00:38.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:38.145 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:00:38.145 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:00:38.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:00:38.146 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:00:38.146 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:00:38.146 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:00:38.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:00:38.147 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:00:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 msgr2=0x7fcb78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 0x7fcb78067290 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fcb80007fd0 tx=0x7fcb80009040).stop 2022-02-02T20:00:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 msgr2=0x7fcb90107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fcb84004f60 tx=0x7fcb84009b30).stop 2022-02-02T20:00:38.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 shutdown_connections 2022-02-02T20:00:38.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb78064dd0 0x7fcb78067290 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb90060270 0x7fcb90106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 --2- 172.21.15.96:0/3904005758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb900f9830 0x7fcb90107430 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.139+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 >> 172.21.15.96:0/3904005758 conn(0x7fcb900f0d40 msgr2=0x7fcb900f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:38.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.140+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 shutdown_connections 2022-02-02T20:00:38.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.141+0000 7fcb767fc700 1 -- 172.21.15.96:0/3904005758 wait complete. 2022-02-02T20:00:38.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 -- 172.21.15.96:0/3430809919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 msgr2=0x7fea480f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/3430809919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea480f69b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fea38004660 tx=0x7fea38009b30).stop 2022-02-02T20:00:38.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 -- 172.21.15.96:0/3430809919 shutdown_connections 2022-02-02T20:00:38.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/3430809919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea480f69b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/3430809919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 0x7fea480f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 -- 172.21.15.96:0/3430809919 >> 172.21.15.96:0/3430809919 conn(0x7fea480f04c0 msgr2=0x7fea480f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:38.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 -- 172.21.15.96:0/3430809919 shutdown_connections 2022-02-02T20:00:38.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.238+0000 7fea4ccdf700 1 -- 172.21.15.96:0/3430809919 wait complete. 2022-02-02T20:00:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 Processor -- start 2022-02-02T20:00:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 -- start start 2022-02-02T20:00:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 0x7fea48105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:38.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48106970 con 0x7fea480f6550 2022-02-02T20:00:38.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4ccdf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48106ab0 con 0x7fea480f5bb0 2022-02-02T20:00:38.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:38.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34698/0 (socket says 172.21.15.96:34698) 2022-02-02T20:00:38.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 -- 172.21.15.96:0/1556281851 learned_addr learned my addr 172.21.15.96:0/1556281851 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:00:38.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea4659c700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 0x7fea48105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:38.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 -- 172.21.15.96:0/1556281851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 msgr2=0x7fea48105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 0x7fea48105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 -- 172.21.15.96:0/1556281851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38005040 con 0x7fea480f6550 2022-02-02T20:00:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.239+0000 7fea45d9b700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fea38009990 tx=0x7fea38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.240+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea38018070 con 0x7fea480f6550 2022-02-02T20:00:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.240+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea481073f0 con 0x7fea480f6550 2022-02-02T20:00:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.240+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea38007ba0 con 0x7fea480f6550 2022-02-02T20:00:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.240+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3801de50 con 0x7fea480f6550 2022-02-02T20:00:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.240+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea48107950 con 0x7fea480f6550 2022-02-02T20:00:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.241+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48045ad0 con 0x7fea480f6550 2022-02-02T20:00:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.241+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fea3801d420 con 0x7fea480f6550 2022-02-02T20:00:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.241+0000 7fea36ffd700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 0x7fea30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:00:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.242+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fea38083690 con 0x7fea480f6550 2022-02-02T20:00:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.242+0000 7fea4659c700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 0x7fea30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:00:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.242+0000 7fea4659c700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 0x7fea30067290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fea4805eae0 tx=0x7fea3c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:00:38.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.246+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fea380551c0 con 0x7fea480f6550 2022-02-02T20:00:38.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.452+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea48027a00 con 0x7fea480f6550 2022-02-02T20:00:38.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.453+0000 7fea36ffd700 1 -- 172.21.15.96:0/1556281851 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fea38054db0 con 0x7fea480f6550 2022-02-02T20:00:38.458 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:00:38.458 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:00:38.458 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:00:38.458 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:00:38.459 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:38.459 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:00:38.459 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:00:38.459 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:00:38.459 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:00:38.460 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:00:38.460 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:00:38.460 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:00:38.460 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:00:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:00:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:00:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:00:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:00:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:00:38.462 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:00:38.462 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:00:38.462 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:00:38.462 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:00:38.463 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:00:38.463 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:00:38.463 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:00:38.463 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:00:38.463 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:00:38.464 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:00:38.464 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:00:38.464 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:00:38.464 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:00:38.465 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:00:38.465 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:38.465 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:38.465 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:00:38.465 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:00:38.466 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:38.466 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:38.466 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:00:38.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 msgr2=0x7fea30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 0x7fea30067290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fea4805eae0 tx=0x7fea3c00b040).stop 2022-02-02T20:00:38.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 msgr2=0x7fea481063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:00:38.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fea38009990 tx=0x7fea38009b30).stop 2022-02-02T20:00:38.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 shutdown_connections 2022-02-02T20:00:38.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea30064dd0 0x7fea30067290 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea480f5bb0 0x7fea48105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 --2- 172.21.15.96:0/1556281851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea480f6550 0x7fea481063c0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:00:38.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 >> 172.21.15.96:0/1556281851 conn(0x7fea480f04c0 msgr2=0x7fea480fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:00:38.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 shutdown_connections 2022-02-02T20:00:38.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:00:38.455+0000 7fea4ccdf700 1 -- 172.21.15.96:0/1556281851 wait complete. 2022-02-02T20:00:38.470 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:00:38.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:38 smithi096 ceph-mon[101353]: pgmap v2956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:38.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3904005758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:00:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:38 smithi159 ceph-mon[69013]: pgmap v2956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:38.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3904005758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:00:39.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:39 smithi159 ceph-mon[69013]: from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:39.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:39 smithi159 ceph-mon[69013]: from='client.37146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:39.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1556281851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:00:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:39 smithi096 ceph-mon[101353]: from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:39.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:39 smithi096 ceph-mon[101353]: from='client.37146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:00:39.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1556281851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:00:40.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:40 smithi159 ceph-mon[69013]: pgmap v2957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:40.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:40 smithi096 ceph-mon[101353]: pgmap v2957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:42.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:42 smithi159 ceph-mon[69013]: pgmap v2958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:42.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:42 smithi096 ceph-mon[101353]: pgmap v2958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:44.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:44 smithi159 ceph-mon[69013]: pgmap v2959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:44 smithi096 ceph-mon[101353]: pgmap v2959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:45.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:45 smithi159 ceph-mon[69013]: pgmap v2960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:45.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:45 smithi096 ceph-mon[101353]: pgmap v2960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:48 smithi159 ceph-mon[69013]: pgmap v2961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:48 smithi096 ceph-mon[101353]: pgmap v2961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:49.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:49 smithi159 ceph-mon[69013]: pgmap v2962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:49.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:49 smithi096 ceph-mon[101353]: pgmap v2962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:52.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:52 smithi159 ceph-mon[69013]: pgmap v2963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:52.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:52 smithi096 ceph-mon[101353]: pgmap v2963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:54.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:54 smithi159 ceph-mon[69013]: pgmap v2964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:54.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:54 smithi096 ceph-mon[101353]: pgmap v2964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:55.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:55 smithi159 ceph-mon[69013]: pgmap v2965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:55.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:55 smithi096 ceph-mon[101353]: pgmap v2965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:58.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:58 smithi159 ceph-mon[69013]: pgmap v2966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:58 smithi096 ceph-mon[101353]: pgmap v2966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:59.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:00:59 smithi159 ceph-mon[69013]: pgmap v2967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:00:59.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:00:59 smithi096 ceph-mon[101353]: pgmap v2967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:02.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:02 smithi159 ceph-mon[69013]: pgmap v2968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:02.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:02 smithi096 ceph-mon[101353]: pgmap v2968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:03 smithi096 ceph-mon[101353]: pgmap v2969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:03.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:03 smithi159 ceph-mon[69013]: pgmap v2969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:06.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:05 smithi159 ceph-mon[69013]: pgmap v2970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:06.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:05 smithi096 ceph-mon[101353]: pgmap v2970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:08.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 -- 172.21.15.96:0/2262635219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f6860 msgr2=0x7f274c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 --2- 172.21.15.96:0/2262635219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f6860 0x7f274c0f6cc0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f2748004660 tx=0x7f2748009b30).stop 2022-02-02T20:01:08.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 -- 172.21.15.96:0/2262635219 shutdown_connections 2022-02-02T20:01:08.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 --2- 172.21.15.96:0/2262635219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f6860 0x7f274c0f6cc0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 --2- 172.21.15.96:0/2262635219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f55c0 0x7f274c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 -- 172.21.15.96:0/2262635219 >> 172.21.15.96:0/2262635219 conn(0x7f274c0f0d40 msgr2=0x7f274c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:08.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 -- 172.21.15.96:0/2262635219 shutdown_connections 2022-02-02T20:01:08.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.566+0000 7f2754505700 1 -- 172.21.15.96:0/2262635219 wait complete. 2022-02-02T20:01:08.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 Processor -- start 2022-02-02T20:01:08.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 -- start start 2022-02-02T20:01:08.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f6860 0x7f274c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c107a10 con 0x7f274c0f55c0 2022-02-02T20:01:08.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2754505700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c107b50 con 0x7f274c0f6860 2022-02-02T20:01:08.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f27522a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f27522a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34714/0 (socket says 172.21.15.96:34714) 2022-02-02T20:01:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f27522a1700 1 -- 172.21.15.96:0/180066625 learned_addr learned my addr 172.21.15.96:0/180066625 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f2751aa0700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f6860 0x7f274c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f27522a1700 1 -- 172.21.15.96:0/180066625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f6860 msgr2=0x7f274c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.567+0000 7f27522a1700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f6860 0x7f274c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f27522a1700 1 -- 172.21.15.96:0/180066625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748005040 con 0x7f274c0f55c0 2022-02-02T20:01:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f27522a1700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f273c00c790 tx=0x7f273c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f273c013630 con 0x7f274c0f55c0 2022-02-02T20:01:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f273c012860 con 0x7f274c0f55c0 2022-02-02T20:01:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c1084f0 con 0x7f274c0f55c0 2022-02-02T20:01:08.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f273c002780 con 0x7f274c0f55c0 2022-02-02T20:01:08.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.568+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c108ab0 con 0x7f274c0f55c0 2022-02-02T20:01:08.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.569+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c045ad0 con 0x7f274c0f55c0 2022-02-02T20:01:08.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.569+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f273c010070 con 0x7f274c0f55c0 2022-02-02T20:01:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.570+0000 7f2742ffd700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 0x7f2738067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.570+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f273c081b30 con 0x7f274c0f55c0 2022-02-02T20:01:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.570+0000 7f2751aa0700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 0x7f2738067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.570+0000 7f2751aa0700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 0x7f2738067290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f2748004630 tx=0x7f2748009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.574+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f273c053600 con 0x7f274c0f55c0 2022-02-02T20:01:08.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.752+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f274c0faca0 con 0x7f2738064dd0 2022-02-02T20:01:08.756 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:08 smithi096 ceph-mon[101353]: pgmap v2971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:08.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.753+0000 7f2742ffd700 1 -- 172.21.15.96:0/180066625 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f274c0faca0 con 0x7f2738064dd0 2022-02-02T20:01:08.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 msgr2=0x7f2738067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 0x7f2738067290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f2748004630 tx=0x7f2748009b30).stop 2022-02-02T20:01:08.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 msgr2=0x7f274c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f273c00c790 tx=0x7f273c007d90).stop 2022-02-02T20:01:08.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 shutdown_connections 2022-02-02T20:01:08.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2738064dd0 0x7f2738067290 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f274c0f55c0 0x7f274c106f70 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 --2- 172.21.15.96:0/180066625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0f6860 0x7f274c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 >> 172.21.15.96:0/180066625 conn(0x7f274c0f0d40 msgr2=0x7f274c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:08.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 shutdown_connections 2022-02-02T20:01:08.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.755+0000 7f2754505700 1 -- 172.21.15.96:0/180066625 wait complete. 2022-02-02T20:01:08.768 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:01:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:08 smithi159 ceph-mon[69013]: pgmap v2971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:08.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- 172.21.15.96:0/3053048737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 msgr2=0x7f18f40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3053048737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f40f5850 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f18e8004660 tx=0x7f18e8009b30).stop 2022-02-02T20:01:08.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- 172.21.15.96:0/3053048737 shutdown_connections 2022-02-02T20:01:08.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3053048737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 0x7f18f40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3053048737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f40f5850 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- 172.21.15.96:0/3053048737 >> 172.21.15.96:0/3053048737 conn(0x7f18f40f0b90 msgr2=0x7f18f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:08.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- 172.21.15.96:0/3053048737 shutdown_connections 2022-02-02T20:01:08.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- 172.21.15.96:0/3053048737 wait complete. 2022-02-02T20:01:08.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 Processor -- start 2022-02-02T20:01:08.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.853+0000 7f18f3fff700 1 -- start start 2022-02-02T20:01:08.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 0x7f18f4107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f3fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4107900 con 0x7f18f40f5430 2022-02-02T20:01:08.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4108110 con 0x7f18f40f66d0 2022-02-02T20:01:08.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34724/0 (socket says 172.21.15.96:34724) 2022-02-02T20:01:08.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 -- 172.21.15.96:0/3945917592 learned_addr learned my addr 172.21.15.96:0/3945917592 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:08.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f27fc700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 0x7f18f4107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 -- 172.21.15.96:0/3945917592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 msgr2=0x7f18f4107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:08.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 0x7f18f4107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:08.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 -- 172.21.15.96:0/3945917592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8005040 con 0x7f18f40f5430 2022-02-02T20:01:08.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f2ffd700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f18e8004f60 tx=0x7f18e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:08.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e8018070 con 0x7f18f40f5430 2022-02-02T20:01:08.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18e8009770 con 0x7f18f40f5430 2022-02-02T20:01:08.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f4108330 con 0x7f18f40f5430 2022-02-02T20:01:08.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.854+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e801c3c0 con 0x7f18f40f5430 2022-02-02T20:01:08.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.855+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f4108890 con 0x7f18f40f5430 2022-02-02T20:01:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.855+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4059100 con 0x7f18f40f5430 2022-02-02T20:01:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.856+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18e801d420 con 0x7f18f40f5430 2022-02-02T20:01:08.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.856+0000 7f18db7fe700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 0x7f18dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:08.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.856+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f18e8083880 con 0x7f18f40f5430 2022-02-02T20:01:08.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.856+0000 7f18f27fc700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 0x7f18dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:08.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.857+0000 7f18f27fc700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 0x7f18dc0672e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f18e40041d0 tx=0x7f18e4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:08.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:08.861+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18e8051a40 con 0x7f18f40f5430 2022-02-02T20:01:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.033+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f40fab10 con 0x7f18dc064e20 2022-02-02T20:01:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.042+0000 7f18db7fe700 1 -- 172.21.15.96:0/3945917592 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f18f40fab10 con 0x7f18dc064e20 2022-02-02T20:01:09.046 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:01:09.046 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (104m) 75m ago 105m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:01:09.046 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (96m) 75m ago 105m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:01:09.047 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (96m) 73m ago 105m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:01:09.047 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (104m) 75m ago 105m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:01:09.047 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (101m) 75m ago 101m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:01:09.047 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (97m) 75m ago 101m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:01:09.048 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (101m) 73m ago 101m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:01:09.049 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (97m) 73m ago 101m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:01:09.049 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (98m) 75m ago 106m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:01:09.049 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (98m) 73m ago 105m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:01:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (97m) 75m ago 106m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:01:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (97m) 73m ago 104m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:01:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (105m) 75m ago 105m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:01:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (104m) 73m ago 104m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:01:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (96m) 75m ago 104m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:01:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (96m) 75m ago 104m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:01:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (95m) 75m ago 103m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:01:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (94m) 73m ago 103m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:01:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (94m) 73m ago 103m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:01:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (93m) 73m ago 102m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:01:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (104m) 75m ago 105m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:01:09.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 msgr2=0x7f18dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 0x7f18dc0672e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f18e40041d0 tx=0x7f18e4009040).stop 2022-02-02T20:01:09.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 msgr2=0x7f18f4106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f18e8004f60 tx=0x7f18e8009b30).stop 2022-02-02T20:01:09.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 shutdown_connections 2022-02-02T20:01:09.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18dc064e20 0x7f18dc0672e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f40f5430 0x7f18f4106e10 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 --2- 172.21.15.96:0/3945917592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f40f66d0 0x7f18f4107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 >> 172.21.15.96:0/3945917592 conn(0x7f18f40f0b90 msgr2=0x7f18f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:09.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 shutdown_connections 2022-02-02T20:01:09.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.044+0000 7f18f3fff700 1 -- 172.21.15.96:0/3945917592 wait complete. 2022-02-02T20:01:09.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 -- 172.21.15.96:0/3337837907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 msgr2=0x7ff2400f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 --2- 172.21.15.96:0/3337837907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2400f6b60 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7ff234004660 tx=0x7ff234009b30).stop 2022-02-02T20:01:09.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 -- 172.21.15.96:0/3337837907 shutdown_connections 2022-02-02T20:01:09.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 --2- 172.21.15.96:0/3337837907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2400f6b60 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 --2- 172.21.15.96:0/3337837907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff2400f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:01:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 -- 172.21.15.96:0/3337837907 >> 172.21.15.96:0/3337837907 conn(0x7ff2400f0bc0 msgr2=0x7ff2400f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 -- 172.21.15.96:0/3337837907 shutdown_connections 2022-02-02T20:01:09.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.140+0000 7ff245804700 1 -- 172.21.15.96:0/3337837907 wait complete. 2022-02-02T20:01:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 Processor -- start 2022-02-02T20:01:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 -- start start 2022-02-02T20:01:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff240106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240107980 con 0x7ff2400f6700 2022-02-02T20:01:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff245804700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240108100 con 0x7ff2400f5460 2022-02-02T20:01:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff23e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff23e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34736/0 (socket says 172.21.15.96:34736) 2022-02-02T20:01:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.141+0000 7ff23e7fc700 1 -- 172.21.15.96:0/3955389597 learned_addr learned my addr 172.21.15.96:0/3955389597 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:09.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23effd700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff240106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23e7fc700 1 -- 172.21.15.96:0/3955389597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 msgr2=0x7ff240106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23e7fc700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff240106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23e7fc700 1 -- 172.21.15.96:0/3955389597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234005040 con 0x7ff2400f6700 2022-02-02T20:01:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23effd700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff240106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:01:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff23e7fc700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7ff234009990 tx=0x7ff234009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff234018070 con 0x7ff2400f6700 2022-02-02T20:01:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff234007ca0 con 0x7ff2400f6700 2022-02-02T20:01:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240108320 con 0x7ff2400f6700 2022-02-02T20:01:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff23401c620 con 0x7ff2400f6700 2022-02-02T20:01:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.142+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff240108880 con 0x7ff2400f6700 2022-02-02T20:01:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.143+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240045ad0 con 0x7ff2400f6700 2022-02-02T20:01:09.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.144+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff23401d960 con 0x7ff2400f6700 2022-02-02T20:01:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.144+0000 7ff2277fe700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 0x7ff2280673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.144+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff234083660 con 0x7ff2400f6700 2022-02-02T20:01:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.144+0000 7ff23effd700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 0x7ff2280673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.145+0000 7ff23effd700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 0x7ff2280673b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff240106b70 tx=0x7ff230008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:09.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.148+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2340517e0 con 0x7ff2400f6700 2022-02-02T20:01:09.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.382+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff24010d410 con 0x7ff2400f6700 2022-02-02T20:01:09.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.382+0000 7ff2277fe700 1 -- 172.21.15.96:0/3955389597 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff234054e00 con 0x7ff2400f6700 2022-02-02T20:01:09.386 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:01:09.386 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:01:09.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:01:09.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:09.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:01:09.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:01:09.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:09.388 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:01:09.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:01:09.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:09.388 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:01:09.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:01:09.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:09.389 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:01:09.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:01:09.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:01:09.390 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:01:09.390 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:01:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 msgr2=0x7ff2280673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 0x7ff2280673b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff240106b70 tx=0x7ff230008040).stop 2022-02-02T20:01:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 msgr2=0x7ff2401072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7ff234009990 tx=0x7ff234009b30).stop 2022-02-02T20:01:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 shutdown_connections 2022-02-02T20:01:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff228064ef0 0x7ff2280673b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2400f5460 0x7ff240106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 --2- 172.21.15.96:0/3955389597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2400f6700 0x7ff2401072f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 >> 172.21.15.96:0/3955389597 conn(0x7ff2400f0bc0 msgr2=0x7ff24005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 shutdown_connections 2022-02-02T20:01:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.385+0000 7ff245804700 1 -- 172.21.15.96:0/3955389597 wait complete. 2022-02-02T20:01:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 -- 172.21.15.96:0/3238959487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 msgr2=0x7ff4cc0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/3238959487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc0f5860 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7ff4bc004660 tx=0x7ff4bc009b30).stop 2022-02-02T20:01:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 -- 172.21.15.96:0/3238959487 shutdown_connections 2022-02-02T20:01:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/3238959487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 0x7ff4cc0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:01:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/3238959487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc0f5860 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.482+0000 7ff4cbfff700 1 -- 172.21.15.96:0/3238959487 >> 172.21.15.96:0/3238959487 conn(0x7ff4cc0f0ba0 msgr2=0x7ff4cc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.483+0000 7ff4cbfff700 1 -- 172.21.15.96:0/3238959487 shutdown_connections 2022-02-02T20:01:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.483+0000 7ff4cbfff700 1 -- 172.21.15.96:0/3238959487 wait complete. 2022-02-02T20:01:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.483+0000 7ff4cbfff700 1 Processor -- start 2022-02-02T20:01:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.483+0000 7ff4cbfff700 1 -- start start 2022-02-02T20:01:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 0x7ff4cc10bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4cbfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc060450 con 0x7ff4cc0f5440 2022-02-02T20:01:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4cbfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc060590 con 0x7ff4cc0f66e0 2022-02-02T20:01:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34742/0 (socket says 172.21.15.96:34742) 2022-02-02T20:01:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 -- 172.21.15.96:0/2401933017 learned_addr learned my addr 172.21.15.96:0/2401933017 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4ca7fc700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 0x7ff4cc10bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 -- 172.21.15.96:0/2401933017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 msgr2=0x7ff4cc10bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 0x7ff4cc10bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 -- 172.21.15.96:0/2401933017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc005040 con 0x7ff4cc0f5440 2022-02-02T20:01:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4caffd700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7ff4bc004f60 tx=0x7ff4bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc018070 con 0x7ff4cc0f5440 2022-02-02T20:01:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4bc007ba0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc10c580 con 0x7ff4cc0f5440 2022-02-02T20:01:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.484+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc01dea0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.485+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc10cae0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.485+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc045ad0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.486+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4bc01d420 con 0x7ff4cc0f5440 2022-02-02T20:01:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.486+0000 7ff4b37fe700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 0x7ff4b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:09.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.486+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4bc0839b0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.486+0000 7ff4ca7fc700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 0x7ff4b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:09.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.487+0000 7ff4ca7fc700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 0x7ff4b40672e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7ff4c000b790 tx=0x7ff4c0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:09.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.490+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4bc051ab0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.692+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff4cc027a00 con 0x7ff4cc0f5440 2022-02-02T20:01:09.696 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:09 smithi096 ceph-mon[101353]: pgmap v2972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:09.696 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:09 smithi096 ceph-mon[101353]: from='client.37158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:09.696 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:09 smithi096 ceph-mon[101353]: from='client.37162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.692+0000 7ff4b37fe700 1 -- 172.21.15.96:0/2401933017 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff4bc0550d0 con 0x7ff4cc0f5440 2022-02-02T20:01:09.697 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:01:09.697 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:01:09.698 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:01:09.698 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:01:09.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:09.698 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:01:09.699 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:01:09.699 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:01:09.699 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:01:09.699 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:01:09.700 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:01:09.700 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:01:09.700 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:01:09.700 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:01:09.700 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:01:09.701 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:01:09.701 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:01:09.701 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:01:09.701 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:01:09.701 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:01:09.702 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:01:09.702 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:01:09.702 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:01:09.702 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:01:09.703 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:01:09.703 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:01:09.704 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:01:09.704 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:01:09.704 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:01:09.704 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:01:09.704 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:01:09.705 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:01:09.705 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:09.705 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:09.705 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:01:09.706 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:09.706 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:09.706 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:09.706 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:09.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 msgr2=0x7ff4b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 0x7ff4b40672e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7ff4c000b790 tx=0x7ff4c0008040).stop 2022-02-02T20:01:09.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 msgr2=0x7ff4cc109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:09.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7ff4bc004f60 tx=0x7ff4bc009b30).stop 2022-02-02T20:01:09.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 shutdown_connections 2022-02-02T20:01:09.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4b4064e20 0x7ff4b40672e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4cc0f5440 0x7ff4cc109ad0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 --2- 172.21.15.96:0/2401933017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4cc0f66e0 0x7ff4cc10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:09.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.694+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 >> 172.21.15.96:0/2401933017 conn(0x7ff4cc0f0ba0 msgr2=0x7ff4cc0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:09.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.695+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 shutdown_connections 2022-02-02T20:01:09.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:09.695+0000 7ff4cbfff700 1 -- 172.21.15.96:0/2401933017 wait complete. 2022-02-02T20:01:09.710 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:01:09.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:09 smithi159 ceph-mon[69013]: pgmap v2972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:09.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:09 smithi159 ceph-mon[69013]: from='client.37158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:09.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:09 smithi159 ceph-mon[69013]: from='client.37162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3955389597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:01:10.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2401933017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:01:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3955389597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:01:10.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2401933017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:01:12.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:12 smithi159 ceph-mon[69013]: pgmap v2973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:12.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:12 smithi096 ceph-mon[101353]: pgmap v2973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:13.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:13 smithi096 ceph-mon[101353]: pgmap v2974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:13.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:13 smithi159 ceph-mon[69013]: pgmap v2974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:16.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:15 smithi159 ceph-mon[69013]: pgmap v2975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:15 smithi096 ceph-mon[101353]: pgmap v2975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:18.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:18 smithi159 ceph-mon[69013]: pgmap v2976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:18.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:18 smithi096 ceph-mon[101353]: pgmap v2976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:19.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:19 smithi159 ceph-mon[69013]: pgmap v2977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:19.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:19 smithi096 ceph-mon[101353]: pgmap v2977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:22.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:22 smithi159 ceph-mon[69013]: pgmap v2978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:22.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:22 smithi096 ceph-mon[101353]: pgmap v2978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:23.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:23 smithi096 ceph-mon[101353]: pgmap v2979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:23.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:23 smithi159 ceph-mon[69013]: pgmap v2979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:26.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:25 smithi159 ceph-mon[69013]: pgmap v2980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:26.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:25 smithi096 ceph-mon[101353]: pgmap v2980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:01:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:01:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:01:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:01:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:28 smithi159 ceph-mon[69013]: pgmap v2981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:28.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:28 smithi096 ceph-mon[101353]: pgmap v2981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:29.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:29 smithi159 ceph-mon[69013]: pgmap v2982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:29.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:29 smithi096 ceph-mon[101353]: pgmap v2982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:32.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:32 smithi159 ceph-mon[69013]: pgmap v2983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:32 smithi096 ceph-mon[101353]: pgmap v2983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:33 smithi096 ceph-mon[101353]: pgmap v2984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:33.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:33 smithi159 ceph-mon[69013]: pgmap v2984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:35 smithi159 ceph-mon[69013]: pgmap v2985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:35 smithi096 ceph-mon[101353]: pgmap v2985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:37 smithi159 ceph-mon[69013]: pgmap v2986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:37 smithi096 ceph-mon[101353]: pgmap v2986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:39.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 -- 172.21.15.96:0/3343705553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f55c0 msgr2=0x7faf000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:39.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 --2- 172.21.15.96:0/3343705553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f55c0 0x7faf000f59e0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7faef0004660 tx=0x7faef0009b30).stop 2022-02-02T20:01:39.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 -- 172.21.15.96:0/3343705553 shutdown_connections 2022-02-02T20:01:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 --2- 172.21.15.96:0/3343705553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f6860 0x7faf000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 --2- 172.21.15.96:0/3343705553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f55c0 0x7faf000f59e0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 -- 172.21.15.96:0/3343705553 >> 172.21.15.96:0/3343705553 conn(0x7faf000f0d40 msgr2=0x7faf000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 -- 172.21.15.96:0/3343705553 shutdown_connections 2022-02-02T20:01:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 -- 172.21.15.96:0/3343705553 wait complete. 2022-02-02T20:01:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.806+0000 7faf0815b700 1 Processor -- start 2022-02-02T20:01:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf0815b700 1 -- start start 2022-02-02T20:01:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf0815b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f55c0 0x7faf000f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf0815b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf0815b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf000f8100 con 0x7faf000f6860 2022-02-02T20:01:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf0815b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf000f8240 con 0x7faf000f55c0 2022-02-02T20:01:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34762/0 (socket says 172.21.15.96:34762) 2022-02-02T20:01:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 -- 172.21.15.96:0/429563335 learned_addr learned my addr 172.21.15.96:0/429563335 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf05ef7700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f55c0 0x7faf000f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 -- 172.21.15.96:0/429563335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f55c0 msgr2=0x7faf000f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f55c0 0x7faf000f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 -- 172.21.15.96:0/429563335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0005040 con 0x7faf000f6860 2022-02-02T20:01:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.807+0000 7faf056f6700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7faefc0026d0 tx=0x7faefc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.808+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faefc0079c0 con 0x7faf000f6860 2022-02-02T20:01:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.808+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faefc00f040 con 0x7faf000f6860 2022-02-02T20:01:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.808+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf000f8520 con 0x7faf000f6860 2022-02-02T20:01:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.808+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0010efa0 con 0x7faf000f6860 2022-02-02T20:01:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.808+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faefc0148b0 con 0x7faf000f6860 2022-02-02T20:01:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.809+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf00045ad0 con 0x7faf000f6860 2022-02-02T20:01:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.809+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faefc007b20 con 0x7faf000f6860 2022-02-02T20:01:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.810+0000 7faef67fc700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 0x7faeec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.810+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faefc0819e0 con 0x7faf000f6860 2022-02-02T20:01:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.810+0000 7faf05ef7700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 0x7faeec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.810+0000 7faf05ef7700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 0x7faeec067290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7faef0013690 tx=0x7faef0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.814+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faefc04fae0 con 0x7faf000f6860 2022-02-02T20:01:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.990+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf000faca0 con 0x7faeec064dd0 2022-02-02T20:01:39.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.991+0000 7faef67fc700 1 -- 172.21.15.96:0/429563335 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faf000faca0 con 0x7faeec064dd0 2022-02-02T20:01:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 msgr2=0x7faeec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 0x7faeec067290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7faef0013690 tx=0x7faef0009b30).stop 2022-02-02T20:01:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 msgr2=0x7faf000f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7faefc0026d0 tx=0x7faefc009de0).stop 2022-02-02T20:01:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 shutdown_connections 2022-02-02T20:01:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeec064dd0 0x7faeec067290 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf000f55c0 0x7faf000f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 --2- 172.21.15.96:0/429563335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf000f6860 0x7faf000f7ba0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 >> 172.21.15.96:0/429563335 conn(0x7faf000f0d40 msgr2=0x7faf0005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 shutdown_connections 2022-02-02T20:01:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:39.993+0000 7faf0815b700 1 -- 172.21.15.96:0/429563335 wait complete. 2022-02-02T20:01:40.006 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:01:40.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:39 smithi096 ceph-mon[101353]: pgmap v2987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:39 smithi159 ceph-mon[69013]: pgmap v2987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/1132704700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 msgr2=0x7ff5b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/1132704700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b80f59e0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7ff5a0004660 tx=0x7ff5a0009b30).stop 2022-02-02T20:01:40.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/1132704700 shutdown_connections 2022-02-02T20:01:40.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/1132704700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 0x7ff5b80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/1132704700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b80f59e0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/1132704700 >> 172.21.15.96:0/1132704700 conn(0x7ff5b80f0de0 msgr2=0x7ff5b80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/1132704700 shutdown_connections 2022-02-02T20:01:40.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.091+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/1132704700 wait complete. 2022-02-02T20:01:40.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 Processor -- start 2022-02-02T20:01:40.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 -- start start 2022-02-02T20:01:40.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 0x7ff5b8109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8109bd0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5bdf9b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8109d10 con 0x7ff5b80f5ed0 2022-02-02T20:01:40.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34770/0 (socket says 172.21.15.96:34770) 2022-02-02T20:01:40.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 -- 172.21.15.96:0/513839656 learned_addr learned my addr 172.21.15.96:0/513839656 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:40.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b6ffd700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 0x7ff5b8109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 -- 172.21.15.96:0/513839656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 msgr2=0x7ff5b8109620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 0x7ff5b8109620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 -- 172.21.15.96:0/513839656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0005040 con 0x7ff5b80f55c0 2022-02-02T20:01:40.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.092+0000 7ff5b77fe700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7ff5a0009990 tx=0x7ff5a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.093+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a0018070 con 0x7ff5b80f55c0 2022-02-02T20:01:40.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.093+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5a0007ca0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.093+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b810a650 con 0x7ff5b80f55c0 2022-02-02T20:01:40.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.093+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a001c620 con 0x7ff5b80f55c0 2022-02-02T20:01:40.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.093+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b810abb0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.094+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff5a001d960 con 0x7ff5b80f55c0 2022-02-02T20:01:40.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.094+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b8045ad0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.094+0000 7ff5affff700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 0x7ff5a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.095+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff5a00837e0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.095+0000 7ff5b6ffd700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 0x7ff5a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.095+0000 7ff5b6ffd700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 0x7ff5a4067290 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff5a80041d0 tx=0x7ff5a8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.099+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5a00553d0 con 0x7ff5b80f55c0 2022-02-02T20:01:40.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.268+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5b80fab40 con 0x7ff5a4064dd0 2022-02-02T20:01:40.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.278+0000 7ff5affff700 1 -- 172.21.15.96:0/513839656 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7ff5b80fab40 con 0x7ff5a4064dd0 2022-02-02T20:01:40.282 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:01:40.282 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (105m) 75m ago 106m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:01:40.283 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (97m) 75m ago 106m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:01:40.283 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (97m) 74m ago 105m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:01:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (104m) 75m ago 105m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:01:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (102m) 75m ago 102m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:01:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (97m) 75m ago 102m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:01:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (102m) 74m ago 102m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:01:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (98m) 74m ago 102m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:01:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (99m) 75m ago 107m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:01:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (98m) 74m ago 105m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:01:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (98m) 75m ago 107m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:01:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (98m) 74m ago 105m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:01:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (105m) 75m ago 105m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:01:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (105m) 74m ago 105m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:01:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (97m) 75m ago 104m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:01:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (96m) 75m ago 104m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:01:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (95m) 75m ago 104m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:01:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (95m) 74m ago 104m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:01:40.288 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (94m) 74m ago 103m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:01:40.288 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (94m) 74m ago 103m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:01:40.288 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (104m) 75m ago 105m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:01:40.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 msgr2=0x7ff5a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 0x7ff5a4067290 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff5a80041d0 tx=0x7ff5a8009040).stop 2022-02-02T20:01:40.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 msgr2=0x7ff5b8109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7ff5a0009990 tx=0x7ff5a0009b30).stop 2022-02-02T20:01:40.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 shutdown_connections 2022-02-02T20:01:40.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5a4064dd0 0x7ff5a4067290 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b80f55c0 0x7ff5b8109130 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 --2- 172.21.15.96:0/513839656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b80f5ed0 0x7ff5b8109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 >> 172.21.15.96:0/513839656 conn(0x7ff5b80f0de0 msgr2=0x7ff5b805ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 shutdown_connections 2022-02-02T20:01:40.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.280+0000 7ff5bdf9b700 1 -- 172.21.15.96:0/513839656 wait complete. 2022-02-02T20:01:40.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 -- 172.21.15.96:0/1255817456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 msgr2=0x7f3cf00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 --2- 172.21.15.96:0/1255817456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf00f5860 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f3ce0004660 tx=0x7f3ce0009b30).stop 2022-02-02T20:01:40.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 -- 172.21.15.96:0/1255817456 shutdown_connections 2022-02-02T20:01:40.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 --2- 172.21.15.96:0/1255817456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 --2- 172.21.15.96:0/1255817456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf00f5860 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 -- 172.21.15.96:0/1255817456 >> 172.21.15.96:0/1255817456 conn(0x7f3cf00f0ba0 msgr2=0x7f3cf00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.376+0000 7f3cef59e700 1 -- 172.21.15.96:0/1255817456 shutdown_connections 2022-02-02T20:01:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 -- 172.21.15.96:0/1255817456 wait complete. 2022-02-02T20:01:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 Processor -- start 2022-02-02T20:01:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 -- start start 2022-02-02T20:01:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf01094f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0109aa0 con 0x7f3cf00f5440 2022-02-02T20:01:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cef59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0109be0 con 0x7f3cf00f66e0 2022-02-02T20:01:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34780/0 (socket says 172.21.15.96:34780) 2022-02-02T20:01:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cee59c700 1 -- 172.21.15.96:0/3609920771 learned_addr learned my addr 172.21.15.96:0/3609920771 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.377+0000 7f3cedd9b700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf01094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cee59c700 1 -- 172.21.15.96:0/3609920771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 msgr2=0x7f3cf01094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cee59c700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf01094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cee59c700 1 -- 172.21.15.96:0/3609920771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0005040 con 0x7f3cf00f5440 2022-02-02T20:01:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cedd9b700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf01094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:01:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cee59c700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f3ce0013a70 tx=0x7f3ce0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce0018070 con 0x7f3cf00f5440 2022-02-02T20:01:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ce00097d0 con 0x7f3cf00f5440 2022-02-02T20:01:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf010a4d0 con 0x7f3cf00f5440 2022-02-02T20:01:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce001c3c0 con 0x7f3cf00f5440 2022-02-02T20:01:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.378+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf010aa30 con 0x7f3cf00f5440 2022-02-02T20:01:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.379+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf0045ad0 con 0x7f3cf00f5440 2022-02-02T20:01:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.380+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ce0007ba0 con 0x7f3cf00f5440 2022-02-02T20:01:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.380+0000 7f3cdeffd700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 0x7f3cd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.380+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3ce0083720 con 0x7f3cf00f5440 2022-02-02T20:01:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.380+0000 7f3cedd9b700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 0x7f3cd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.380+0000 7f3cedd9b700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 0x7f3cd80672e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f3ce4009740 tx=0x7f3ce4009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.384+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ce0055310 con 0x7f3cf00f5440 2022-02-02T20:01:40.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.616+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3cf00fdd80 con 0x7f3cf00f5440 2022-02-02T20:01:40.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.617+0000 7f3cdeffd700 1 -- 172.21.15.96:0/3609920771 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3ce0054f00 con 0x7f3cf00f5440 2022-02-02T20:01:40.621 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:01:40.621 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:01:40.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:01:40.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:40.622 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:01:40.622 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:01:40.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:40.622 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:01:40.623 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:01:40.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:40.624 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:01:40.624 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:01:40.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:01:40.624 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:01:40.624 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:01:40.625 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:01:40.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:01:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:01:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 msgr2=0x7f3cd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 0x7f3cd80672e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f3ce4009740 tx=0x7f3ce4009be0).stop 2022-02-02T20:01:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 msgr2=0x7f3cf0109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f3ce0013a70 tx=0x7f3ce0009b30).stop 2022-02-02T20:01:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 shutdown_connections 2022-02-02T20:01:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064e20 0x7f3cd80672e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cf00f5440 0x7f3cf0109000 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 --2- 172.21.15.96:0/3609920771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cf00f66e0 0x7f3cf01094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 >> 172.21.15.96:0/3609920771 conn(0x7f3cf00f0ba0 msgr2=0x7f3cf005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 shutdown_connections 2022-02-02T20:01:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.619+0000 7f3cef59e700 1 -- 172.21.15.96:0/3609920771 wait complete. 2022-02-02T20:01:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 -- 172.21.15.96:0/4227608874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 msgr2=0x7f9b740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 --2- 172.21.15.96:0/4227608874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b740f59e0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f9b64004660 tx=0x7f9b64009b30).stop 2022-02-02T20:01:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 -- 172.21.15.96:0/4227608874 shutdown_connections 2022-02-02T20:01:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 --2- 172.21.15.96:0/4227608874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 --2- 172.21.15.96:0/4227608874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b740f59e0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 -- 172.21.15.96:0/4227608874 >> 172.21.15.96:0/4227608874 conn(0x7f9b740f0d40 msgr2=0x7f9b740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 -- 172.21.15.96:0/4227608874 shutdown_connections 2022-02-02T20:01:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.716+0000 7f9b79c32700 1 -- 172.21.15.96:0/4227608874 wait complete. 2022-02-02T20:01:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 Processor -- start 2022-02-02T20:01:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 -- start start 2022-02-02T20:01:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b74109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74109c00 con 0x7f9b740f6860 2022-02-02T20:01:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b79c32700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74109d40 con 0x7f9b740f55c0 2022-02-02T20:01:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34792/0 (socket says 172.21.15.96:34792) 2022-02-02T20:01:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b72ffd700 1 -- 172.21.15.96:0/2285168229 learned_addr learned my addr 172.21.15.96:0/2285168229 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:01:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.717+0000 7f9b737fe700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b74109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b72ffd700 1 -- 172.21.15.96:0/2285168229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 msgr2=0x7f9b74109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b72ffd700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b74109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b72ffd700 1 -- 172.21.15.96:0/2285168229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64005040 con 0x7f9b740f6860 2022-02-02T20:01:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b737fe700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b74109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:01:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b72ffd700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f9b5c00c530 tx=0x7f9b5c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c00f650 con 0x7f9b740f6860 2022-02-02T20:01:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b5c00fc60 con 0x7f9b740f6860 2022-02-02T20:01:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7410a6e0 con 0x7f9b740f6860 2022-02-02T20:01:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c012cd0 con 0x7f9b740f6860 2022-02-02T20:01:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.718+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7410aca0 con 0x7f9b740f6860 2022-02-02T20:01:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.719+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74045ad0 con 0x7f9b740f6860 2022-02-02T20:01:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.720+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b5c010070 con 0x7f9b740f6860 2022-02-02T20:01:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.720+0000 7f9b6bfff700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:01:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.720+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b5c0817b0 con 0x7f9b740f6860 2022-02-02T20:01:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.720+0000 7f9b737fe700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:01:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.720+0000 7f9b737fe700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f9b64009da0 tx=0x7f9b64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:01:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.724+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b5c0532e0 con 0x7f9b740f6860 2022-02-02T20:01:40.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.924+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b7410f780 con 0x7f9b740f6860 2022-02-02T20:01:40.929 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:40 smithi096 ceph-mon[101353]: from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:40.929 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:40 smithi096 ceph-mon[101353]: from='client.37178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:40.929 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3609920771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:01:40.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.925+0000 7f9b6bfff700 1 -- 172.21.15.96:0/2285168229 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9b5c052ed0 con 0x7f9b740f6860 2022-02-02T20:01:40.931 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:01:40.931 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:01:40.931 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:01:40.932 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:01:40.932 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:40.932 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:01:40.932 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:01:40.933 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:01:40.933 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:01:40.933 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:01:40.934 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:01:40.934 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:01:40.935 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:01:40.935 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:01:40.935 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:01:40.935 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:01:40.935 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:01:40.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:01:40.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:01:40.936 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:01:40.936 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:01:40.937 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:01:40.937 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:01:40.937 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:01:40.938 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:01:40.938 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:01:40.939 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:01:40.939 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:01:40.940 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:01:40.940 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:01:40.941 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:01:40.941 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:01:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:40.942 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:01:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:01:40.942 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:40.943 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:40.943 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:01:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 msgr2=0x7f9b60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f9b64009da0 tx=0x7f9b64009b30).stop 2022-02-02T20:01:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 msgr2=0x7f9b74109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:01:40.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f9b5c00c530 tx=0x7f9b5c007e20).stop 2022-02-02T20:01:40.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 shutdown_connections 2022-02-02T20:01:40.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b74109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 --2- 172.21.15.96:0/2285168229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b74109650 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:01:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.926+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 >> 172.21.15.96:0/2285168229 conn(0x7f9b740f0d40 msgr2=0x7f9b7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:01:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.927+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 shutdown_connections 2022-02-02T20:01:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:01:40.927+0000 7f9b79c32700 1 -- 172.21.15.96:0/2285168229 wait complete. 2022-02-02T20:01:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:01:41.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:40 smithi159 ceph-mon[69013]: from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:41.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:40 smithi159 ceph-mon[69013]: from='client.37178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:01:41.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3609920771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:01:42.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:41 smithi159 ceph-mon[69013]: pgmap v2988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:42.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2285168229' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:01:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:41 smithi096 ceph-mon[101353]: pgmap v2988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2285168229' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:01:44.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:43 smithi159 ceph-mon[69013]: pgmap v2989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:43 smithi096 ceph-mon[101353]: pgmap v2989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:46.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:45 smithi159 ceph-mon[69013]: pgmap v2990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:45 smithi096 ceph-mon[101353]: pgmap v2990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:47 smithi159 ceph-mon[69013]: pgmap v2991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:47.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:47 smithi096 ceph-mon[101353]: pgmap v2991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:50.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:49 smithi159 ceph-mon[69013]: pgmap v2992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:50.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:49 smithi096 ceph-mon[101353]: pgmap v2992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:52.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:51 smithi159 ceph-mon[69013]: pgmap v2993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:51 smithi096 ceph-mon[101353]: pgmap v2993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:54.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:53 smithi159 ceph-mon[69013]: pgmap v2994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:54.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:53 smithi096 ceph-mon[101353]: pgmap v2994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:56.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:55 smithi159 ceph-mon[69013]: pgmap v2995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:56.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:55 smithi096 ceph-mon[101353]: pgmap v2995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:57 smithi159 ceph-mon[69013]: pgmap v2996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:01:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:57 smithi096 ceph-mon[101353]: pgmap v2996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:01:59 smithi159 ceph-mon[69013]: pgmap v2997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:00.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:01:59 smithi096 ceph-mon[101353]: pgmap v2997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:02.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:01 smithi159 ceph-mon[69013]: pgmap v2998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:02.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:01 smithi096 ceph-mon[101353]: pgmap v2998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:04.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:03 smithi159 ceph-mon[69013]: pgmap v2999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:04.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:03 smithi096 ceph-mon[101353]: pgmap v2999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:06.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:05 smithi159 ceph-mon[69013]: pgmap v3000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:06.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:05 smithi096 ceph-mon[101353]: pgmap v3000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:07 smithi159 ceph-mon[69013]: pgmap v3001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:07 smithi096 ceph-mon[101353]: pgmap v3001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:10.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:09 smithi159 ceph-mon[69013]: pgmap v3002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:10.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:09 smithi096 ceph-mon[101353]: pgmap v3002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:11.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.035+0000 7f977c584700 1 -- 172.21.15.96:0/515592478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 msgr2=0x7f97740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.035+0000 7f977c584700 1 --2- 172.21.15.96:0/515592478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97740f7de0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f9764004660 tx=0x7f9764009b30).stop 2022-02-02T20:02:11.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 -- 172.21.15.96:0/515592478 shutdown_connections 2022-02-02T20:02:11.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 --2- 172.21.15.96:0/515592478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97740f7de0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 --2- 172.21.15.96:0/515592478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f97740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:02:11.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 -- 172.21.15.96:0/515592478 >> 172.21.15.96:0/515592478 conn(0x7f97740f1e40 msgr2=0x7f97740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 -- 172.21.15.96:0/515592478 shutdown_connections 2022-02-02T20:02:11.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 -- 172.21.15.96:0/515592478 wait complete. 2022-02-02T20:02:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 Processor -- start 2022-02-02T20:02:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.036+0000 7f977c584700 1 -- start start 2022-02-02T20:02:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977c584700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f9774106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977c584700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977c584700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774107ae0 con 0x7f97740f7980 2022-02-02T20:02:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977c584700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774108390 con 0x7f97740f66e0 2022-02-02T20:02:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34808/0 (socket says 172.21.15.96:34808) 2022-02-02T20:02:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 -- 172.21.15.96:0/3564989681 learned_addr learned my addr 172.21.15.96:0/3564989681 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977a320700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f9774106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 -- 172.21.15.96:0/3564989681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 msgr2=0x7f9774106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f9774106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 -- 172.21.15.96:0/3564989681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764005040 con 0x7f97740f7980 2022-02-02T20:02:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f977a320700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f9774106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:02:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.037+0000 7f9779b1f700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f9764009990 tx=0x7f9764009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.038+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9764018070 con 0x7f97740f7980 2022-02-02T20:02:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.038+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9764007ca0 con 0x7f97740f7980 2022-02-02T20:02:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.038+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774108610 con 0x7f97740f7980 2022-02-02T20:02:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.038+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976401c620 con 0x7f97740f7980 2022-02-02T20:02:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.038+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774108b70 con 0x7f97740f7980 2022-02-02T20:02:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.039+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740f5ad0 con 0x7f97740f7980 2022-02-02T20:02:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.040+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f976401d960 con 0x7f97740f7980 2022-02-02T20:02:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.040+0000 7f976affd700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 0x7f9760067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.040+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9764083310 con 0x7f97740f7980 2022-02-02T20:02:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.041+0000 7f977a320700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 0x7f9760067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.041+0000 7f977a320700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 0x7f9760067290 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f97740f77e0 tx=0x7f9770008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.045+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9764054d80 con 0x7f97740f7980 2022-02-02T20:02:11.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.223+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97740fefb0 con 0x7f9760064dd0 2022-02-02T20:02:11.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.225+0000 7f976affd700 1 -- 172.21.15.96:0/3564989681 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f97740fefb0 con 0x7f9760064dd0 2022-02-02T20:02:11.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.226+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 msgr2=0x7f9760067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.226+0000 7f977c584700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 0x7f9760067290 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f97740f77e0 tx=0x7f9770008040).stop 2022-02-02T20:02:11.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.226+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 msgr2=0x7f97741074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.226+0000 7f977c584700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f9764009990 tx=0x7f9764009b30).stop 2022-02-02T20:02:11.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 shutdown_connections 2022-02-02T20:02:11.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9760064dd0 0x7f9760067290 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97740f66e0 0x7f9774106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 --2- 172.21.15.96:0/3564989681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740f7980 0x7f97741074a0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 >> 172.21.15.96:0/3564989681 conn(0x7f97740f1e40 msgr2=0x7f97740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 shutdown_connections 2022-02-02T20:02:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.227+0000 7f977c584700 1 -- 172.21.15.96:0/3564989681 wait complete. 2022-02-02T20:02:11.240 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:02:11.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.324+0000 7fe6f8e09700 1 -- 172.21.15.96:0/2585167156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f6550 msgr2=0x7fe6f40f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.324+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/2585167156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f6550 0x7fe6f40f69b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fe6e4004660 tx=0x7fe6e4009b30).stop 2022-02-02T20:02:11.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- 172.21.15.96:0/2585167156 shutdown_connections 2022-02-02T20:02:11.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/2585167156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f6550 0x7fe6f40f69b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/2585167156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f40f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- 172.21.15.96:0/2585167156 >> 172.21.15.96:0/2585167156 conn(0x7fe6f40f04c0 msgr2=0x7fe6f40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- 172.21.15.96:0/2585167156 shutdown_connections 2022-02-02T20:02:11.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- 172.21.15.96:0/2585167156 wait complete. 2022-02-02T20:02:11.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 Processor -- start 2022-02-02T20:02:11.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- start start 2022-02-02T20:02:11.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f40f6550 0x7fe6f410c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40f5680 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f8e09700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40f57c0 con 0x7fe6f40f6550 2022-02-02T20:02:11.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.325+0000 7fe6f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34816/0 (socket says 172.21.15.96:34816) 2022-02-02T20:02:11.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 -- 172.21.15.96:0/1701999234 learned_addr learned my addr 172.21.15.96:0/1701999234 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:11.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 -- 172.21.15.96:0/1701999234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f40f6550 msgr2=0x7fe6f410c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f40f6550 0x7fe6f410c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:02:11.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 -- 172.21.15.96:0/1701999234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4005040 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f259c700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fe6e800c530 tx=0x7fe6e8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e800f650 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe6e800fc60 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f410c7a0 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e8012d20 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.326+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f410cd30 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.327+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40f4150 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.327+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe6e8019030 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.328+0000 7fe6e2ffd700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 0x7fe6dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.328+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe6e80816c0 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.328+0000 7fe6f1d9b700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 0x7fe6dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.328+0000 7fe6f1d9b700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 0x7fe6dc067290 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7fe6e4000c00 tx=0x7fe6e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.332+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe6e804f810 con 0x7fe6f40f5bb0 2022-02-02T20:02:11.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.507+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6f4057f10 con 0x7fe6dc064dd0 2022-02-02T20:02:11.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.516+0000 7fe6e2ffd700 1 -- 172.21.15.96:0/1701999234 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fe6f4057f10 con 0x7fe6dc064dd0 2022-02-02T20:02:11.521 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:02:11.521 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (105m) 76m ago 106m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:02:11.521 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (97m) 76m ago 106m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:02:11.521 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (97m) 74m ago 106m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:02:11.522 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (105m) 76m ago 106m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:02:11.522 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (102m) 76m ago 102m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:02:11.522 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (98m) 76m ago 102m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:02:11.522 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (102m) 74m ago 102m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:02:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (98m) 74m ago 102m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:02:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (99m) 76m ago 107m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:02:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (99m) 74m ago 106m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:02:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (98m) 76m ago 107m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:02:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (98m) 74m ago 106m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:02:11.524 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (106m) 76m ago 106m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:02:11.524 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (105m) 74m ago 105m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:02:11.524 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (97m) 76m ago 105m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:02:11.524 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (97m) 76m ago 105m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:02:11.524 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (96m) 76m ago 104m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:02:11.525 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (95m) 74m ago 104m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:02:11.526 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (95m) 74m ago 104m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:02:11.526 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (94m) 74m ago 103m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:02:11.526 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (105m) 76m ago 106m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:02:11.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 msgr2=0x7fe6dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 0x7fe6dc067290 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7fe6e4000c00 tx=0x7fe6e4009b30).stop 2022-02-02T20:02:11.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 msgr2=0x7fe6f4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fe6e800c530 tx=0x7fe6e8007e10).stop 2022-02-02T20:02:11.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 shutdown_connections 2022-02-02T20:02:11.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe6dc064dd0 0x7fe6dc067290 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6f40f5bb0 0x7fe6f4109cf0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 --2- 172.21.15.96:0/1701999234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f40f6550 0x7fe6f410c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:02:11.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.518+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 >> 172.21.15.96:0/1701999234 conn(0x7fe6f40f04c0 msgr2=0x7fe6f40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.519+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 shutdown_connections 2022-02-02T20:02:11.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.519+0000 7fe6f8e09700 1 -- 172.21.15.96:0/1701999234 wait complete. 2022-02-02T20:02:11.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 -- 172.21.15.96:0/1112437310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f5430 msgr2=0x7fc4180f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 --2- 172.21.15.96:0/1112437310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f5430 0x7fc4180f5850 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fc408004660 tx=0x7fc408009b30).stop 2022-02-02T20:02:11.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 -- 172.21.15.96:0/1112437310 shutdown_connections 2022-02-02T20:02:11.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 --2- 172.21.15.96:0/1112437310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f66d0 0x7fc4180f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 --2- 172.21.15.96:0/1112437310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f5430 0x7fc4180f5850 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 -- 172.21.15.96:0/1112437310 >> 172.21.15.96:0/1112437310 conn(0x7fc4180f0b90 msgr2=0x7fc4180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 -- 172.21.15.96:0/1112437310 shutdown_connections 2022-02-02T20:02:11.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.614+0000 7fc41c964700 1 -- 172.21.15.96:0/1112437310 wait complete. 2022-02-02T20:02:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 Processor -- start 2022-02-02T20:02:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 -- start start 2022-02-02T20:02:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f66d0 0x7fc41810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180603e0 con 0x7fc4180f66d0 2022-02-02T20:02:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.615+0000 7fc41c964700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418060520 con 0x7fc4180f5430 2022-02-02T20:02:11.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:38930/0 (socket says 172.21.15.96:38930) 2022-02-02T20:02:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 -- 172.21.15.96:0/3292340288 learned_addr learned my addr 172.21.15.96:0/3292340288 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc41659c700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f66d0 0x7fc41810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 -- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f66d0 msgr2=0x7fc41810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f66d0 0x7fc41810bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 -- 172.21.15.96:0/3292340288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408005040 con 0x7fc4180f5430 2022-02-02T20:02:11.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc416d9d700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc408013a70 tx=0x7fc408009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc408018070 con 0x7fc4180f5430 2022-02-02T20:02:11.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc4080097d0 con 0x7fc4180f5430 2022-02-02T20:02:11.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41810c4e0 con 0x7fc4180f5430 2022-02-02T20:02:11.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc40801c3c0 con 0x7fc4180f5430 2022-02-02T20:02:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.616+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41810ca40 con 0x7fc4180f5430 2022-02-02T20:02:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.617+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc418045ad0 con 0x7fc4180f5430 2022-02-02T20:02:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.618+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc408007ba0 con 0x7fc4180f5430 2022-02-02T20:02:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.618+0000 7fc3ff7fe700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 0x7fc4000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.619+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc408083710 con 0x7fc4180f5430 2022-02-02T20:02:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.619+0000 7fc41659c700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 0x7fc4000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.619+0000 7fc41659c700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 0x7fc4000672e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fc40c0096e0 tx=0x7fc40c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.623+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc4080518d0 con 0x7fc4180f5430 2022-02-02T20:02:11.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.854+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc4180fdd00 con 0x7fc4180f5430 2022-02-02T20:02:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.855+0000 7fc3ff7fe700 1 -- 172.21.15.96:0/3292340288 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc408054ef0 con 0x7fc4180f5430 2022-02-02T20:02:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:02:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:02:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:02:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:02:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:02:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:02:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:02:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:02:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:02:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:02:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:02:11.864 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:02:11.864 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:02:11.864 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:02:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 msgr2=0x7fc4000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 0x7fc4000672e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fc40c0096e0 tx=0x7fc40c009be0).stop 2022-02-02T20:02:11.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 msgr2=0x7fc418109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc408013a70 tx=0x7fc408009b30).stop 2022-02-02T20:02:11.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 shutdown_connections 2022-02-02T20:02:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc400064e20 0x7fc4000672e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4180f5430 0x7fc418109a90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 --2- 172.21.15.96:0/3292340288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4180f66d0 0x7fc41810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 >> 172.21.15.96:0/3292340288 conn(0x7fc4180f0b90 msgr2=0x7fc4180fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 shutdown_connections 2022-02-02T20:02:11.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.857+0000 7fc41c964700 1 -- 172.21.15.96:0/3292340288 wait complete. 2022-02-02T20:02:11.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 -- 172.21.15.96:0/3602251663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f5430 msgr2=0x7f9e640f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/3602251663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f5430 0x7f9e640f5850 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f9e54004660 tx=0x7f9e54009b30).stop 2022-02-02T20:02:11.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 -- 172.21.15.96:0/3602251663 shutdown_connections 2022-02-02T20:02:11.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/3602251663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f66d0 0x7f9e640f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/3602251663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f5430 0x7f9e640f5850 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 -- 172.21.15.96:0/3602251663 >> 172.21.15.96:0/3602251663 conn(0x7f9e640f0b90 msgr2=0x7f9e640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:11.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:11 smithi096 ceph-mon[101353]: pgmap v3003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:11.961 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:11 smithi096 ceph-mon[101353]: from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:11.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 -- 172.21.15.96:0/3602251663 shutdown_connections 2022-02-02T20:02:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.954+0000 7f9e6a27e700 1 -- 172.21.15.96:0/3602251663 wait complete. 2022-02-02T20:02:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 Processor -- start 2022-02-02T20:02:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 -- start start 2022-02-02T20:02:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f5430 0x7f9e64106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64107900 con 0x7f9e640f66d0 2022-02-02T20:02:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e6a27e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64108110 con 0x7f9e640f5430 2022-02-02T20:02:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e68a7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e68a7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34838/0 (socket says 172.21.15.96:34838) 2022-02-02T20:02:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.955+0000 7f9e68a7b700 1 -- 172.21.15.96:0/2966631383 learned_addr learned my addr 172.21.15.96:0/2966631383 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e6927c700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f5430 0x7f9e64106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e68a7b700 1 -- 172.21.15.96:0/2966631383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f5430 msgr2=0x7f9e64106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e68a7b700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f5430 0x7f9e64106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e68a7b700 1 -- 172.21.15.96:0/2966631383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54005040 con 0x7f9e640f66d0 2022-02-02T20:02:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e68a7b700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f9e6000c530 tx=0x7f9e60007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6000f650 con 0x7f9e640f66d0 2022-02-02T20:02:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e6000fc60 con 0x7f9e640f66d0 2022-02-02T20:02:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e64108390 con 0x7f9e640f66d0 2022-02-02T20:02:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e60012cd0 con 0x7f9e640f66d0 2022-02-02T20:02:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.956+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e64108950 con 0x7f9e640f66d0 2022-02-02T20:02:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.957+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e64059100 con 0x7f9e640f66d0 2022-02-02T20:02:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.958+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e60010070 con 0x7f9e640f66d0 2022-02-02T20:02:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.958+0000 7f9e59ffb700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 0x7f9e500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.958+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e600817c0 con 0x7f9e640f66d0 2022-02-02T20:02:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.958+0000 7f9e6927c700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 0x7f9e500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.958+0000 7f9e6927c700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 0x7f9e500672e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f9e54004e30 tx=0x7f9e54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:11.962+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e6004f8c0 con 0x7f9e640f66d0 2022-02-02T20:02:12.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:11 smithi159 ceph-mon[69013]: pgmap v3003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:12.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:11 smithi159 ceph-mon[69013]: from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:12.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.163+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e640fdbf0 con 0x7f9e640f66d0 2022-02-02T20:02:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.164+0000 7f9e59ffb700 1 -- 172.21.15.96:0/2966631383 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9e60052ee0 con 0x7f9e640f66d0 2022-02-02T20:02:12.171 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:02:12.171 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:02:12.172 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:02:12.172 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:02:12.173 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:12.174 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:02:12.174 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:02:12.174 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:02:12.175 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:02:12.175 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:02:12.176 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:02:12.176 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:02:12.177 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:02:12.177 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:02:12.177 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:02:12.178 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:02:12.178 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:02:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:02:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:02:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:02:12.181 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:02:12.182 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:02:12.182 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:02:12.183 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:02:12.183 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:02:12.184 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:02:12.184 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:02:12.184 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:02:12.185 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:02:12.185 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:02:12.186 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:02:12.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:02:12.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:12.188 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:12.188 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:02:12.189 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:12.189 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:12.189 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:12.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:12.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 msgr2=0x7f9e500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:12.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 0x7f9e500672e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f9e54004e30 tx=0x7f9e54009b30).stop 2022-02-02T20:02:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 msgr2=0x7f9e64107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:12.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f9e6000c530 tx=0x7f9e60007e20).stop 2022-02-02T20:02:12.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 shutdown_connections 2022-02-02T20:02:12.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e50064e20 0x7f9e500672e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:12.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e640f5430 0x7f9e64106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:12.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 --2- 172.21.15.96:0/2966631383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e640f66d0 0x7f9e64107300 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:12.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 >> 172.21.15.96:0/2966631383 conn(0x7f9e640f0b90 msgr2=0x7f9e6405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 shutdown_connections 2022-02-02T20:02:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:12.166+0000 7f9e6a27e700 1 -- 172.21.15.96:0/2966631383 wait complete. 2022-02-02T20:02:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:02:13.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:12 smithi159 ceph-mon[69013]: from='client.37194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:13.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3292340288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:02:13.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2966631383' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:02:13.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:12 smithi096 ceph-mon[101353]: from='client.37194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:13.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3292340288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:02:13.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2966631383' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:02:14.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:13 smithi159 ceph-mon[69013]: pgmap v3004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:13 smithi096 ceph-mon[101353]: pgmap v3004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:16.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:15 smithi159 ceph-mon[69013]: pgmap v3005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:15 smithi096 ceph-mon[101353]: pgmap v3005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:17 smithi159 ceph-mon[69013]: pgmap v3006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:17 smithi096 ceph-mon[101353]: pgmap v3006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:20.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:19 smithi159 ceph-mon[69013]: pgmap v3007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:20.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:19 smithi096 ceph-mon[101353]: pgmap v3007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:22.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:21 smithi159 ceph-mon[69013]: pgmap v3008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:22.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:21 smithi096 ceph-mon[101353]: pgmap v3008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:24.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:23 smithi159 ceph-mon[69013]: pgmap v3009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:23 smithi096 ceph-mon[101353]: pgmap v3009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:26.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:25 smithi159 ceph-mon[69013]: pgmap v3010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:26.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:25 smithi096 ceph-mon[101353]: pgmap v3010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:27 smithi159 ceph-mon[69013]: pgmap v3011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:02:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:02:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:27 smithi096 ceph-mon[101353]: pgmap v3011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:02:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:02:30.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:29 smithi159 ceph-mon[69013]: pgmap v3012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:30.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:29 smithi096 ceph-mon[101353]: pgmap v3012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:32.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:31 smithi159 ceph-mon[69013]: pgmap v3013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:31 smithi096 ceph-mon[101353]: pgmap v3013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:34.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:33 smithi159 ceph-mon[69013]: pgmap v3014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:34.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:33 smithi096 ceph-mon[101353]: pgmap v3014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:36.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:35 smithi159 ceph-mon[69013]: pgmap v3015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:36.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:35 smithi096 ceph-mon[101353]: pgmap v3015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:37 smithi159 ceph-mon[69013]: pgmap v3016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:37.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:37 smithi096 ceph-mon[101353]: pgmap v3016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:39 smithi159 ceph-mon[69013]: pgmap v3017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:39 smithi096 ceph-mon[101353]: pgmap v3017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:42.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:41 smithi159 ceph-mon[69013]: pgmap v3018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:42.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:41 smithi096 ceph-mon[101353]: pgmap v3018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 -- 172.21.15.96:0/2194731252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 msgr2=0x7f90440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 --2- 172.21.15.96:0/2194731252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f90440f59e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f9038004660 tx=0x7f9038009b30).stop 2022-02-02T20:02:42.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 -- 172.21.15.96:0/2194731252 shutdown_connections 2022-02-02T20:02:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 --2- 172.21.15.96:0/2194731252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f90440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:02:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 --2- 172.21.15.96:0/2194731252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f90440f59e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 -- 172.21.15.96:0/2194731252 >> 172.21.15.96:0/2194731252 conn(0x7f90440f0d40 msgr2=0x7f90440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:42.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 -- 172.21.15.96:0/2194731252 shutdown_connections 2022-02-02T20:02:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.274+0000 7f904b21c700 1 -- 172.21.15.96:0/2194731252 wait complete. 2022-02-02T20:02:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 Processor -- start 2022-02-02T20:02:42.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 -- start start 2022-02-02T20:02:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f904410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044060450 con 0x7f90440f55c0 2022-02-02T20:02:42.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f904b21c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044060590 con 0x7f90440f6860 2022-02-02T20:02:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f9048fb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f9048fb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34854/0 (socket says 172.21.15.96:34854) 2022-02-02T20:02:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.275+0000 7f9048fb8700 1 -- 172.21.15.96:0/2765439288 learned_addr learned my addr 172.21.15.96:0/2765439288 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:42.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9043fff700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f904410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9048fb8700 1 -- 172.21.15.96:0/2765439288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 msgr2=0x7f904410c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9048fb8700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f904410c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9048fb8700 1 -- 172.21.15.96:0/2765439288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038005040 con 0x7f90440f55c0 2022-02-02T20:02:42.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9043fff700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f904410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:02:42.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f9048fb8700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f9038004f60 tx=0x7f9038009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9038018070 con 0x7f90440f55c0 2022-02-02T20:02:42.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9038007ba0 con 0x7f90440f55c0 2022-02-02T20:02:42.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904410c790 con 0x7f90440f55c0 2022-02-02T20:02:42.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904410ccf0 con 0x7f90440f55c0 2022-02-02T20:02:42.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.276+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903801dea0 con 0x7f90440f55c0 2022-02-02T20:02:42.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.277+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9024004fa0 con 0x7f90440f55c0 2022-02-02T20:02:42.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.278+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f903801d420 con 0x7f90440f55c0 2022-02-02T20:02:42.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.278+0000 7f90417fa700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 0x7f9034067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.278+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9038083ef0 con 0x7f90440f55c0 2022-02-02T20:02:42.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.279+0000 7f9043fff700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 0x7f9034067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.279+0000 7f9043fff700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 0x7f9034067290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f903000b830 tx=0x7f9030008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.282+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f90380520b0 con 0x7f90440f55c0 2022-02-02T20:02:42.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.459+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9024000b90 con 0x7f9034064dd0 2022-02-02T20:02:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.460+0000 7f90417fa700 1 -- 172.21.15.96:0/2765439288 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9024000b90 con 0x7f9034064dd0 2022-02-02T20:02:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 msgr2=0x7f9034067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 0x7f9034067290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f903000b830 tx=0x7f9030008040).stop 2022-02-02T20:02:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 msgr2=0x7f9044109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f9038004f60 tx=0x7f9038009b30).stop 2022-02-02T20:02:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 shutdown_connections 2022-02-02T20:02:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9034064dd0 0x7f9034067290 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90440f55c0 0x7f9044109ce0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 --2- 172.21.15.96:0/2765439288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90440f6860 0x7f904410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 >> 172.21.15.96:0/2765439288 conn(0x7f90440f0d40 msgr2=0x7f90440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 shutdown_connections 2022-02-02T20:02:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.462+0000 7f904b21c700 1 -- 172.21.15.96:0/2765439288 wait complete. 2022-02-02T20:02:42.475 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:02:42.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 -- 172.21.15.96:0/1850666132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 msgr2=0x7f41a40f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 --2- 172.21.15.96:0/1850666132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a40f6810 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f4198004660 tx=0x7f4198009b30).stop 2022-02-02T20:02:42.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 -- 172.21.15.96:0/1850666132 shutdown_connections 2022-02-02T20:02:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 --2- 172.21.15.96:0/1850666132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a40f6810 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 --2- 172.21.15.96:0/1850666132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 0x7f41a40f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:02:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 -- 172.21.15.96:0/1850666132 >> 172.21.15.96:0/1850666132 conn(0x7f41a40f0320 msgr2=0x7f41a40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 -- 172.21.15.96:0/1850666132 shutdown_connections 2022-02-02T20:02:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.559+0000 7f41a9457700 1 -- 172.21.15.96:0/1850666132 wait complete. 2022-02-02T20:02:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 Processor -- start 2022-02-02T20:02:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 -- start start 2022-02-02T20:02:42.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 0x7f41a4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4109a70 con 0x7f41a40f63b0 2022-02-02T20:02:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a9457700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a410a320 con 0x7f41a40f5a10 2022-02-02T20:02:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34866/0 (socket says 172.21.15.96:34866) 2022-02-02T20:02:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.560+0000 7f41a37fe700 1 -- 172.21.15.96:0/1472882676 learned_addr learned my addr 172.21.15.96:0/1472882676 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a3fff700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 0x7f41a4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a37fe700 1 -- 172.21.15.96:0/1472882676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 msgr2=0x7f41a4108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a37fe700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 0x7f41a4108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a37fe700 1 -- 172.21.15.96:0/1472882676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198005040 con 0x7f41a40f63b0 2022-02-02T20:02:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a37fe700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f4198009990 tx=0x7f4198009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4198018070 con 0x7f41a40f63b0 2022-02-02T20:02:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a410a5a0 con 0x7f41a40f63b0 2022-02-02T20:02:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4198007ca0 con 0x7f41a40f63b0 2022-02-02T20:02:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419801c620 con 0x7f41a40f63b0 2022-02-02T20:02:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.561+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a410ab00 con 0x7f41a40f63b0 2022-02-02T20:02:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.562+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a4059100 con 0x7f41a40f63b0 2022-02-02T20:02:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.562+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f419801d960 con 0x7f41a40f63b0 2022-02-02T20:02:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.563+0000 7f41a0ff9700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 0x7f418c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.563+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41980837d0 con 0x7f41a40f63b0 2022-02-02T20:02:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.563+0000 7f41a3fff700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 0x7f418c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.563+0000 7f41a3fff700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 0x7f418c0672e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f41a405eae0 tx=0x7f4194008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.567+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4198055470 con 0x7f41a40f63b0 2022-02-02T20:02:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.741+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f41a40faaa0 con 0x7f418c064e20 2022-02-02T20:02:42.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.750+0000 7f41a0ff9700 1 -- 172.21.15.96:0/1472882676 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f41a40faaa0 con 0x7f418c064e20 2022-02-02T20:02:42.753 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:02:42.754 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (106m) 76m ago 107m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:02:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (98m) 76m ago 107m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:02:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (98m) 75m ago 106m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:02:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (105m) 76m ago 106m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:02:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (103m) 76m ago 103m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:02:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (98m) 76m ago 103m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:02:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (103m) 75m ago 103m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:02:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (99m) 75m ago 103m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:02:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (100m) 76m ago 108m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:02:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (99m) 75m ago 106m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:02:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (99m) 76m ago 108m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:02:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (99m) 75m ago 106m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:02:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (106m) 76m ago 106m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:02:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (106m) 75m ago 106m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:02:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (98m) 76m ago 105m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:02:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (97m) 76m ago 105m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:02:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (97m) 76m ago 105m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:02:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (96m) 75m ago 105m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:02:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (95m) 75m ago 104m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:02:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (95m) 75m ago 104m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:02:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (105m) 76m ago 106m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:02:42.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 msgr2=0x7f418c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 0x7f418c0672e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f41a405eae0 tx=0x7f4194008040).stop 2022-02-02T20:02:42.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 msgr2=0x7f41a4109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f4198009990 tx=0x7f4198009b30).stop 2022-02-02T20:02:42.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 shutdown_connections 2022-02-02T20:02:42.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f418c064e20 0x7f418c0672e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a40f5a10 0x7f41a4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 --2- 172.21.15.96:0/1472882676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41a40f63b0 0x7f41a4109430 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 >> 172.21.15.96:0/1472882676 conn(0x7f41a40f0320 msgr2=0x7f41a40f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:42.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 shutdown_connections 2022-02-02T20:02:42.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.752+0000 7f41a9457700 1 -- 172.21.15.96:0/1472882676 wait complete. 2022-02-02T20:02:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 -- 172.21.15.96:0/4031240594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f77d0 msgr2=0x7fae400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 --2- 172.21.15.96:0/4031240594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f77d0 0x7fae400f7c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fae30004660 tx=0x7fae30009b30).stop 2022-02-02T20:02:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 -- 172.21.15.96:0/4031240594 shutdown_connections 2022-02-02T20:02:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 --2- 172.21.15.96:0/4031240594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f77d0 0x7fae400f7c30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 --2- 172.21.15.96:0/4031240594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f6530 0x7fae400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 -- 172.21.15.96:0/4031240594 >> 172.21.15.96:0/4031240594 conn(0x7fae400f1c90 msgr2=0x7fae400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 -- 172.21.15.96:0/4031240594 shutdown_connections 2022-02-02T20:02:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.848+0000 7fae4622a700 1 -- 172.21.15.96:0/4031240594 wait complete. 2022-02-02T20:02:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 Processor -- start 2022-02-02T20:02:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 -- start start 2022-02-02T20:02:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 0x7fae40107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae401077f0 con 0x7fae400f6530 2022-02-02T20:02:42.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.849+0000 7fae4622a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae40107ff0 con 0x7fae400f77d0 2022-02-02T20:02:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34874/0 (socket says 172.21.15.96:34874) 2022-02-02T20:02:42.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 -- 172.21.15.96:0/2329797019 learned_addr learned my addr 172.21.15.96:0/2329797019 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:42.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae44a27700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 0x7fae40107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 -- 172.21.15.96:0/2329797019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 msgr2=0x7fae40107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:42.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 0x7fae40107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 -- 172.21.15.96:0/2329797019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30005040 con 0x7fae400f6530 2022-02-02T20:02:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae44a27700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 0x7fae40107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:02:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae45228700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fae3c002700 tx=0x7fae3c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae3c009320 con 0x7fae400f6530 2022-02-02T20:02:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fae3c00f040 con 0x7fae400f6530 2022-02-02T20:02:42.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae401082d0 con 0x7fae400f6530 2022-02-02T20:02:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.850+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae3c014900 con 0x7fae400f6530 2022-02-02T20:02:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.851+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae40108890 con 0x7fae400f6530 2022-02-02T20:02:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.852+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40059100 con 0x7fae400f6530 2022-02-02T20:02:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.852+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fae3c0077b0 con 0x7fae400f6530 2022-02-02T20:02:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.852+0000 7fae35ffb700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 0x7fae2c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.853+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fae3c081bd0 con 0x7fae400f6530 2022-02-02T20:02:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.853+0000 7fae44a27700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 0x7fae2c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.853+0000 7fae44a27700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 0x7fae2c0672e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fae30004630 tx=0x7fae30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:42.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:42.857+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fae3c053700 con 0x7fae400f6530 2022-02-02T20:02:43.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.090+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae40027a00 con 0x7fae400f6530 2022-02-02T20:02:43.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.090+0000 7fae35ffb700 1 -- 172.21.15.96:0/2329797019 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fae3c0532f0 con 0x7fae400f6530 2022-02-02T20:02:43.094 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:02:43.094 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:02:43.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:02:43.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:43.095 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:02:43.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:02:43.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:43.096 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:02:43.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:02:43.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:43.096 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:02:43.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:02:43.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:02:43.097 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:02:43.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:02:43.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:02:43.098 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:02:43.098 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:02:43.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 msgr2=0x7fae2c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 0x7fae2c0672e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fae30004630 tx=0x7fae30009b30).stop 2022-02-02T20:02:43.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 msgr2=0x7fae40106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fae3c002700 tx=0x7fae3c009d80).stop 2022-02-02T20:02:43.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 shutdown_connections 2022-02-02T20:02:43.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae2c064e20 0x7fae2c0672e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae400f6530 0x7fae40106d50 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 --2- 172.21.15.96:0/2329797019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae400f77d0 0x7fae40107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 >> 172.21.15.96:0/2329797019 conn(0x7fae400f1c90 msgr2=0x7fae400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:43.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 shutdown_connections 2022-02-02T20:02:43.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.093+0000 7fae4622a700 1 -- 172.21.15.96:0/2329797019 wait complete. 2022-02-02T20:02:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- 172.21.15.96:0/705960038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f6860 msgr2=0x7f9f340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/705960038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f6860 0x7f9f340f6cc0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f9f20004660 tx=0x7f9f20009b30).stop 2022-02-02T20:02:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- 172.21.15.96:0/705960038 shutdown_connections 2022-02-02T20:02:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/705960038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f6860 0x7f9f340f6cc0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/705960038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f55c0 0x7f9f340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- 172.21.15.96:0/705960038 >> 172.21.15.96:0/705960038 conn(0x7f9f340f0d40 msgr2=0x7f9f340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- 172.21.15.96:0/705960038 shutdown_connections 2022-02-02T20:02:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- 172.21.15.96:0/705960038 wait complete. 2022-02-02T20:02:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 Processor -- start 2022-02-02T20:02:43.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.190+0000 7f9f3ace7700 1 -- start start 2022-02-02T20:02:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f3ace7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f3ace7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f6860 0x7f9f340f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f3ace7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340f8920 con 0x7f9f340f55c0 2022-02-02T20:02:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f3ace7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340f8a60 con 0x7f9f340f6860 2022-02-02T20:02:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34884/0 (socket says 172.21.15.96:34884) 2022-02-02T20:02:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 -- 172.21.15.96:0/4234937794 learned_addr learned my addr 172.21.15.96:0/4234937794 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:02:43.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f33fff700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f6860 0x7f9f340f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:43.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 -- 172.21.15.96:0/4234937794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f6860 msgr2=0x7f9f340f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f6860 0x7f9f340f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 -- 172.21.15.96:0/4234937794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f20005040 con 0x7f9f340f55c0 2022-02-02T20:02:43.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.191+0000 7f9f38a83700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f9f2800c790 tx=0x7f9f28007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.192+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f28013630 con 0x7f9f340f55c0 2022-02-02T20:02:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.192+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f28012860 con 0x7f9f340f55c0 2022-02-02T20:02:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.192+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f340f8d40 con 0x7f9f340f55c0 2022-02-02T20:02:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.192+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f28002780 con 0x7f9f340f55c0 2022-02-02T20:02:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.192+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3410efa0 con 0x7f9f340f55c0 2022-02-02T20:02:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.193+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f34045ad0 con 0x7f9f340f55c0 2022-02-02T20:02:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.193+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f28010070 con 0x7f9f340f55c0 2022-02-02T20:02:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.194+0000 7f9f317fa700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 0x7f9f24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:02:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.194+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f28081b20 con 0x7f9f340f55c0 2022-02-02T20:02:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.194+0000 7f9f33fff700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 0x7f9f24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:02:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.194+0000 7f9f33fff700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 0x7f9f24067290 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f9f20004630 tx=0x7f9f20009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:02:43.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.198+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f2804fbc0 con 0x7f9f340f55c0 2022-02-02T20:02:43.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.398+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9f3410f610 con 0x7f9f340f55c0 2022-02-02T20:02:43.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.398+0000 7f9f317fa700 1 -- 172.21.15.96:0/4234937794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9f280531e0 con 0x7f9f340f55c0 2022-02-02T20:02:43.402 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:02:43.403 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:02:43.403 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:02:43.403 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:02:43.403 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:43.403 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:02:43.404 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:02:43.404 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:02:43.404 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:02:43.404 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:02:43.405 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:02:43.405 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:02:43.405 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:02:43.406 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:02:43.406 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:02:43.406 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:02:43.406 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:02:43.407 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:02:43.407 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:02:43.407 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:02:43.407 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:02:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:02:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:02:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:02:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:02:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:02:43.409 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:02:43.409 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:02:43.409 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:02:43.409 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:02:43.410 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:02:43.410 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:02:43.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:43.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:43.410 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:02:43.411 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:02:43.411 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:43.411 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:43.411 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:02:43.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.401+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 msgr2=0x7f9f24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.401+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 0x7f9f24067290 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f9f20004630 tx=0x7f9f20009b30).stop 2022-02-02T20:02:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.401+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 msgr2=0x7f9f340f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:02:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.401+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f9f2800c790 tx=0x7f9f28007d90).stop 2022-02-02T20:02:43.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 shutdown_connections 2022-02-02T20:02:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f24064dd0 0x7f9f24067290 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f340f55c0 0x7f9f340f9f40 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 --2- 172.21.15.96:0/4234937794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340f6860 0x7f9f340f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:02:43.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 >> 172.21.15.96:0/4234937794 conn(0x7f9f340f0d40 msgr2=0x7f9f3405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:02:43.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 shutdown_connections 2022-02-02T20:02:43.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:02:43.402+0000 7f9f3ace7700 1 -- 172.21.15.96:0/4234937794 wait complete. 2022-02-02T20:02:43.417 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:02:44.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:43 smithi159 ceph-mon[69013]: from='client.37206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:44.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:43 smithi159 ceph-mon[69013]: pgmap v3019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:44.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:43 smithi159 ceph-mon[69013]: from='client.37210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:44.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2329797019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:02:44.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4234937794' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:02:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:43 smithi096 ceph-mon[101353]: from='client.37206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:44.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:43 smithi096 ceph-mon[101353]: pgmap v3019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:43 smithi096 ceph-mon[101353]: from='client.37210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:02:44.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2329797019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:02:44.060 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4234937794' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:02:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:45 smithi096 ceph-mon[101353]: pgmap v3020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:45 smithi159 ceph-mon[69013]: pgmap v3020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:47 smithi159 ceph-mon[69013]: pgmap v3021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:47.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:47 smithi096 ceph-mon[101353]: pgmap v3021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:50.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:49 smithi159 ceph-mon[69013]: pgmap v3022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:50.182 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:49 smithi096 ceph-mon[101353]: pgmap v3022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:51 smithi096 ceph-mon[101353]: pgmap v3023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:51 smithi159 ceph-mon[69013]: pgmap v3023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:54.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:53 smithi096 ceph-mon[101353]: pgmap v3024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:53 smithi159 ceph-mon[69013]: pgmap v3024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:56.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:55 smithi096 ceph-mon[101353]: pgmap v3025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:55 smithi159 ceph-mon[69013]: pgmap v3025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:57 smithi159 ceph-mon[69013]: pgmap v3026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:02:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:57 smithi096 ceph-mon[101353]: pgmap v3026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:02:59 smithi159 ceph-mon[69013]: pgmap v3027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:02:59 smithi096 ceph-mon[101353]: pgmap v3027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:02.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:01 smithi096 ceph-mon[101353]: pgmap v3028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:01 smithi159 ceph-mon[69013]: pgmap v3028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:04.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:03 smithi096 ceph-mon[101353]: pgmap v3029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:03 smithi159 ceph-mon[69013]: pgmap v3029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:06.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:05 smithi096 ceph-mon[101353]: pgmap v3030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:05 smithi159 ceph-mon[69013]: pgmap v3030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:07 smithi159 ceph-mon[69013]: pgmap v3031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:07 smithi096 ceph-mon[101353]: pgmap v3031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:09 smithi096 ceph-mon[101353]: pgmap v3032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:09 smithi159 ceph-mon[69013]: pgmap v3032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:12.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:11 smithi096 ceph-mon[101353]: pgmap v3033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:11 smithi159 ceph-mon[69013]: pgmap v3033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:13.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 -- 172.21.15.96:0/1728094623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f7980 msgr2=0x7fb5a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1728094623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f7980 0x7fb5a80f7de0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fb598004660 tx=0x7fb598009b30).stop 2022-02-02T20:03:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 -- 172.21.15.96:0/1728094623 shutdown_connections 2022-02-02T20:03:13.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1728094623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f7980 0x7fb5a80f7de0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1728094623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f66e0 0x7fb5a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 -- 172.21.15.96:0/1728094623 >> 172.21.15.96:0/1728094623 conn(0x7fb5a80f1e40 msgr2=0x7fb5a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:13.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 -- 172.21.15.96:0/1728094623 shutdown_connections 2022-02-02T20:03:13.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.512+0000 7fb5b0429700 1 -- 172.21.15.96:0/1728094623 wait complete. 2022-02-02T20:03:13.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 Processor -- start 2022-02-02T20:03:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 -- start start 2022-02-02T20:03:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 0x7fb5a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a806a380 con 0x7fb5a80f66e0 2022-02-02T20:03:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5b0429700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a806a4c0 con 0x7fb5a80f7980 2022-02-02T20:03:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.513+0000 7fb5ae1c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34902/0 (socket says 172.21.15.96:34902) 2022-02-02T20:03:13.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 -- 172.21.15.96:0/1802525309 learned_addr learned my addr 172.21.15.96:0/1802525309 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:13.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ad9c4700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 0x7fb5a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 -- 172.21.15.96:0/1802525309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 msgr2=0x7fb5a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 0x7fb5a8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 -- 172.21.15.96:0/1802525309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598005040 con 0x7fb5a80f66e0 2022-02-02T20:03:13.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ad9c4700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 0x7fb5a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:03:13.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5ae1c5700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fb5a4002700 tx=0x7fb5a4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:13.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a4009320 con 0x7fb5a80f66e0 2022-02-02T20:03:13.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a806a7a0 con 0x7fb5a80f66e0 2022-02-02T20:03:13.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb5a400f040 con 0x7fb5a80f66e0 2022-02-02T20:03:13.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a4014900 con 0x7fb5a80f66e0 2022-02-02T20:03:13.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.514+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a810ef90 con 0x7fb5a80f66e0 2022-02-02T20:03:13.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.515+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a8045ad0 con 0x7fb5a80f66e0 2022-02-02T20:03:13.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.516+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb5a4009480 con 0x7fb5a80f66e0 2022-02-02T20:03:13.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.517+0000 7fb59effd700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 0x7fb594067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.517+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb5a4081ff0 con 0x7fb5a80f66e0 2022-02-02T20:03:13.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.517+0000 7fb5ad9c4700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 0x7fb594067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.517+0000 7fb5ad9c4700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 0x7fb594067290 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fb598004630 tx=0x7fb598009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:13.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.521+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb5a40501a0 con 0x7fb5a80f66e0 2022-02-02T20:03:13.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.697+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5a8057f10 con 0x7fb594064dd0 2022-02-02T20:03:13.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.698+0000 7fb59effd700 1 -- 172.21.15.96:0/1802525309 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb5a8057f10 con 0x7fb594064dd0 2022-02-02T20:03:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 msgr2=0x7fb594067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 0x7fb594067290 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fb598004630 tx=0x7fb598009b30).stop 2022-02-02T20:03:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 msgr2=0x7fb5a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fb5a4002700 tx=0x7fb5a4009d80).stop 2022-02-02T20:03:13.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 shutdown_connections 2022-02-02T20:03:13.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb594064dd0 0x7fb594067290 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5a80f66e0 0x7fb5a806b9a0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 --2- 172.21.15.96:0/1802525309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5a80f7980 0x7fb5a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 >> 172.21.15.96:0/1802525309 conn(0x7fb5a80f1e40 msgr2=0x7fb5a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:13.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 shutdown_connections 2022-02-02T20:03:13.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.700+0000 7fb5b0429700 1 -- 172.21.15.96:0/1802525309 wait complete. 2022-02-02T20:03:13.713 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:03:13.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- 172.21.15.96:0/2102193781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 msgr2=0x7fcf7c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 --2- 172.21.15.96:0/2102193781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c0f6950 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fcf6c004660 tx=0x7fcf6c009b30).stop 2022-02-02T20:03:13.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- 172.21.15.96:0/2102193781 shutdown_connections 2022-02-02T20:03:13.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 --2- 172.21.15.96:0/2102193781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 0x7fcf7c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 --2- 172.21.15.96:0/2102193781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c0f6950 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- 172.21.15.96:0/2102193781 >> 172.21.15.96:0/2102193781 conn(0x7fcf7c0f1c90 msgr2=0x7fcf7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:13.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- 172.21.15.96:0/2102193781 shutdown_connections 2022-02-02T20:03:13.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- 172.21.15.96:0/2102193781 wait complete. 2022-02-02T20:03:13.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 Processor -- start 2022-02-02T20:03:13.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.798+0000 7fcf82517700 1 -- start start 2022-02-02T20:03:13.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf82517700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf82517700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 0x7fcf7c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf82517700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06a380 con 0x7fcf7c0f6530 2022-02-02T20:03:13.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf82517700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06a4c0 con 0x7fcf7c0f77d0 2022-02-02T20:03:13.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34912/0 (socket says 172.21.15.96:34912) 2022-02-02T20:03:13.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 -- 172.21.15.96:0/1974960971 learned_addr learned my addr 172.21.15.96:0/1974960971 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:13.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf80d14700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 0x7fcf7c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 -- 172.21.15.96:0/1974960971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 msgr2=0x7fcf7c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 0x7fcf7c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 -- 172.21.15.96:0/1974960971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c005040 con 0x7fcf7c0f6530 2022-02-02T20:03:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf81515700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fcf6c004f60 tx=0x7fcf6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c018070 con 0x7fcf7c0f6530 2022-02-02T20:03:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c06a740 con 0x7fcf7c0f6530 2022-02-02T20:03:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf6c007ba0 con 0x7fcf7c0f6530 2022-02-02T20:03:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.799+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c01c620 con 0x7fcf7c0f6530 2022-02-02T20:03:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.800+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c06aca0 con 0x7fcf7c0f6530 2022-02-02T20:03:13.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.801+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c045ad0 con 0x7fcf7c0f6530 2022-02-02T20:03:13.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.801+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf6c01c8e0 con 0x7fcf7c0f6530 2022-02-02T20:03:13.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.801+0000 7fcf71ffb700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 0x7fcf680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.802+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf6c083940 con 0x7fcf7c0f6530 2022-02-02T20:03:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.802+0000 7fcf80d14700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 0x7fcf680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.802+0000 7fcf80d14700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 0x7fcf680672e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fcf780041d0 tx=0x7fcf78009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.806+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf6c051a40 con 0x7fcf7c0f6530 2022-02-02T20:03:13.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.980+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf7c0fee30 con 0x7fcf68064e20 2022-02-02T20:03:13.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.989+0000 7fcf71ffb700 1 -- 172.21.15.96:0/1974960971 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fcf7c0fee30 con 0x7fcf68064e20 2022-02-02T20:03:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:03:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (106m) 77m ago 107m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:03:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (99m) 77m ago 107m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:03:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (98m) 75m ago 107m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:03:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (106m) 77m ago 107m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:03:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (103m) 77m ago 103m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:03:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (99m) 77m ago 103m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:03:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (103m) 75m ago 103m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:03:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (99m) 75m ago 103m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:03:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (100m) 77m ago 108m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:03:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (100m) 75m ago 107m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:03:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (99m) 77m ago 108m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:03:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (99m) 75m ago 107m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:03:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (107m) 77m ago 107m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:03:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (106m) 75m ago 106m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:03:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (98m) 77m ago 106m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:03:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (98m) 77m ago 106m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:03:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (97m) 77m ago 105m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:03:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (97m) 75m ago 105m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:03:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (96m) 75m ago 105m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:03:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (96m) 75m ago 105m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:03:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (106m) 77m ago 107m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:03:14.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 msgr2=0x7fcf680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 0x7fcf680672e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fcf780041d0 tx=0x7fcf78009040).stop 2022-02-02T20:03:14.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 msgr2=0x7fcf7c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fcf6c004f60 tx=0x7fcf6c009b30).stop 2022-02-02T20:03:14.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 shutdown_connections 2022-02-02T20:03:14.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf68064e20 0x7fcf680672e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf7c0f6530 0x7fcf7c06b9a0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 --2- 172.21.15.96:0/1974960971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf7c0f77d0 0x7fcf7c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.991+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 >> 172.21.15.96:0/1974960971 conn(0x7fcf7c0f1c90 msgr2=0x7fcf7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:14.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.992+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 shutdown_connections 2022-02-02T20:03:14.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:13.992+0000 7fcf82517700 1 -- 172.21.15.96:0/1974960971 wait complete. 2022-02-02T20:03:14.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:13 smithi096 ceph-mon[101353]: pgmap v3034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:14.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 -- 172.21.15.96:0/902346741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f7980 msgr2=0x7f30400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 --2- 172.21.15.96:0/902346741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f7980 0x7f30400f7de0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f3034004660 tx=0x7f3034009b30).stop 2022-02-02T20:03:14.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 -- 172.21.15.96:0/902346741 shutdown_connections 2022-02-02T20:03:14.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 --2- 172.21.15.96:0/902346741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f7980 0x7f30400f7de0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 --2- 172.21.15.96:0/902346741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30400f66e0 0x7f30400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 -- 172.21.15.96:0/902346741 >> 172.21.15.96:0/902346741 conn(0x7f30400f1e40 msgr2=0x7f30400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:14.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 -- 172.21.15.96:0/902346741 shutdown_connections 2022-02-02T20:03:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.089+0000 7f3045f8e700 1 -- 172.21.15.96:0/902346741 wait complete. 2022-02-02T20:03:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 Processor -- start 2022-02-02T20:03:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 -- start start 2022-02-02T20:03:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3040069e20 0x7f304006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304006a790 con 0x7f30400f66e0 2022-02-02T20:03:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f3045f8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304006a8d0 con 0x7f3040069e20 2022-02-02T20:03:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f303f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f303f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34922/0 (socket says 172.21.15.96:34922) 2022-02-02T20:03:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.090+0000 7f303f7fe700 1 -- 172.21.15.96:0/926233892 learned_addr learned my addr 172.21.15.96:0/926233892 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f303effd700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3040069e20 0x7f304006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f303f7fe700 1 -- 172.21.15.96:0/926233892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3040069e20 msgr2=0x7f304006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f303f7fe700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3040069e20 0x7f304006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f303f7fe700 1 -- 172.21.15.96:0/926233892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034005040 con 0x7f30400f66e0 2022-02-02T20:03:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f303f7fe700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f3030002700 tx=0x7f3030009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3030009320 con 0x7f30400f66e0 2022-02-02T20:03:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f303000f040 con 0x7f30400f66e0 2022-02-02T20:03:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3030014900 con 0x7f30400f66e0 2022-02-02T20:03:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304006ab80 con 0x7f30400f66e0 2022-02-02T20:03:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.091+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304010f410 con 0x7f30400f66e0 2022-02-02T20:03:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.092+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040045ad0 con 0x7f30400f66e0 2022-02-02T20:03:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.093+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3030009480 con 0x7f30400f66e0 2022-02-02T20:03:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.093+0000 7f3027fff700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 0x7f3028067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.093+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3030082240 con 0x7f30400f66e0 2022-02-02T20:03:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.093+0000 7f303effd700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 0x7f3028067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.094+0000 7f303effd700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 0x7f3028067290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3034000c00 tx=0x7f3034009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.097+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f30300503f0 con 0x7f30400f66e0 2022-02-02T20:03:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:13 smithi159 ceph-mon[69013]: pgmap v3034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.325+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30400586e0 con 0x7f30400f66e0 2022-02-02T20:03:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.326+0000 7f3027fff700 1 -- 172.21.15.96:0/926233892 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3030053a10 con 0x7f30400f66e0 2022-02-02T20:03:14.330 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:03:14.330 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:03:14.330 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:03:14.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:14.331 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:03:14.331 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:03:14.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:14.331 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:03:14.332 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:03:14.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:14.332 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:03:14.332 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:03:14.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:14.333 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:03:14.333 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:03:14.333 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:03:14.333 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:03:14.334 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:03:14.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 msgr2=0x7f3028067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 0x7f3028067290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3034000c00 tx=0x7f3034009b30).stop 2022-02-02T20:03:14.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 msgr2=0x7f304006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f3030002700 tx=0x7f3030009d80).stop 2022-02-02T20:03:14.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 shutdown_connections 2022-02-02T20:03:14.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3028064dd0 0x7f3028067290 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30400f66e0 0x7f304006b9a0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 --2- 172.21.15.96:0/926233892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3040069e20 0x7f304006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.327+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 >> 172.21.15.96:0/926233892 conn(0x7f30400f1e40 msgr2=0x7f30400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:14.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.328+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 shutdown_connections 2022-02-02T20:03:14.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.328+0000 7f3045f8e700 1 -- 172.21.15.96:0/926233892 wait complete. 2022-02-02T20:03:14.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1328096639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f66e0 msgr2=0x7f6fd00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1328096639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f66e0 0x7f6fd00f6b00 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f6fc4004660 tx=0x7f6fc4009b30).stop 2022-02-02T20:03:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1328096639 shutdown_connections 2022-02-02T20:03:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1328096639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f7980 0x7f6fd00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:03:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1328096639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f66e0 0x7f6fd00f6b00 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1328096639 >> 172.21.15.96:0/1328096639 conn(0x7f6fd00f1e40 msgr2=0x7f6fd00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1328096639 shutdown_connections 2022-02-02T20:03:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.425+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1328096639 wait complete. 2022-02-02T20:03:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 Processor -- start 2022-02-02T20:03:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 -- start start 2022-02-02T20:03:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f66e0 0x7f6fd006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd006a410 con 0x7f6fd00f7980 2022-02-02T20:03:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fd61ad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd006a550 con 0x7f6fd00f66e0 2022-02-02T20:03:14.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:14.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34934/0 (socket says 172.21.15.96:34934) 2022-02-02T20:03:14.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.426+0000 7f6fceffd700 1 -- 172.21.15.96:0/1183091192 learned_addr learned my addr 172.21.15.96:0/1183091192 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:14.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fceffd700 1 -- 172.21.15.96:0/1183091192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f66e0 msgr2=0x7f6fd006b9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T20:03:14.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fceffd700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f66e0 0x7f6fd006b9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:03:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fceffd700 1 -- 172.21.15.96:0/1183091192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4005040 con 0x7f6fd00f7980 2022-02-02T20:03:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fceffd700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f6fc000b410 tx=0x7f6fc0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fc00125f0 con 0x7f6fd00f7980 2022-02-02T20:03:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6fc0012c00 con 0x7f6fd00f7980 2022-02-02T20:03:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd006a830 con 0x7f6fd00f7980 2022-02-02T20:03:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd010efe0 con 0x7f6fd00f7980 2022-02-02T20:03:14.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.427+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fc0002ae0 con 0x7f6fd00f7980 2022-02-02T20:03:14.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.428+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0004fa0 con 0x7f6fd00f7980 2022-02-02T20:03:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.429+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6fc000f030 con 0x7f6fd00f7980 2022-02-02T20:03:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.429+0000 7f6fb7fff700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 0x7f6fb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.429+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6fc0081e80 con 0x7f6fd00f7980 2022-02-02T20:03:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.429+0000 7f6fcf7fe700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 0x7f6fb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.429+0000 7f6fcf7fe700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 0x7f6fb8067290 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f6fc4004e30 tx=0x7f6fc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.433+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6fc004ff80 con 0x7f6fd00f7980 2022-02-02T20:03:14.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.635+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6fb0005e80 con 0x7f6fd00f7980 2022-02-02T20:03:14.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.635+0000 7f6fb7fff700 1 -- 172.21.15.96:0/1183091192 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6fc00535a0 con 0x7f6fd00f7980 2022-02-02T20:03:14.639 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:03:14.639 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:03:14.640 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:03:14.640 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:03:14.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:14.640 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:03:14.641 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:03:14.641 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:03:14.641 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:03:14.641 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:03:14.642 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:03:14.642 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:03:14.642 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:03:14.642 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:03:14.642 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:03:14.643 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:03:14.643 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:03:14.643 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:03:14.644 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:03:14.644 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:03:14.644 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:03:14.644 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:03:14.644 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:03:14.645 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:03:14.645 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:03:14.645 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:03:14.645 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:03:14.645 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:03:14.646 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:03:14.646 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:03:14.646 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:03:14.646 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:03:14.647 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:14.647 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:14.647 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:03:14.647 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:14.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:14.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:14.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 msgr2=0x7f6fb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 0x7f6fb8067290 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f6fc4004e30 tx=0x7f6fc4009b30).stop 2022-02-02T20:03:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 msgr2=0x7f6fd0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f6fc000b410 tx=0x7f6fc0006ef0).stop 2022-02-02T20:03:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 shutdown_connections 2022-02-02T20:03:14.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fb8064dd0 0x7f6fb8067290 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f66e0 0x7f6fd006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:03:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 --2- 172.21.15.96:0/1183091192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f7980 0x7f6fd0069e20 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 >> 172.21.15.96:0/1183091192 conn(0x7f6fd00f1e40 msgr2=0x7f6fd00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 shutdown_connections 2022-02-02T20:03:14.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:14.637+0000 7f6fd61ad700 1 -- 172.21.15.96:0/1183091192 wait complete. 2022-02-02T20:03:14.652 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:03:15.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:14 smithi096 ceph-mon[101353]: from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:15.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:14 smithi096 ceph-mon[101353]: from='client.37226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:15.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/926233892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:03:15.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1183091192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:03:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:14 smithi159 ceph-mon[69013]: from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:14 smithi159 ceph-mon[69013]: from='client.37226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:15.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/926233892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:03:15.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1183091192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:03:16.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:15 smithi096 ceph-mon[101353]: pgmap v3035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:15 smithi159 ceph-mon[69013]: pgmap v3035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:17 smithi159 ceph-mon[69013]: pgmap v3036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:17.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:17 smithi096 ceph-mon[101353]: pgmap v3036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:19 smithi096 ceph-mon[101353]: pgmap v3037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:19 smithi159 ceph-mon[69013]: pgmap v3037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:22.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:21 smithi096 ceph-mon[101353]: pgmap v3038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:21 smithi159 ceph-mon[69013]: pgmap v3038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:24.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:23 smithi096 ceph-mon[101353]: pgmap v3039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:23 smithi159 ceph-mon[69013]: pgmap v3039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:26.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:25 smithi096 ceph-mon[101353]: pgmap v3040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:25 smithi159 ceph-mon[69013]: pgmap v3040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:27 smithi159 ceph-mon[69013]: pgmap v3041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:03:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:03:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:27 smithi096 ceph-mon[101353]: pgmap v3041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:03:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:03:30.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:29 smithi096 ceph-mon[101353]: pgmap v3042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:29 smithi159 ceph-mon[69013]: pgmap v3042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:31 smithi096 ceph-mon[101353]: pgmap v3043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:31 smithi159 ceph-mon[69013]: pgmap v3043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:34.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:33 smithi096 ceph-mon[101353]: pgmap v3044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:34.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:33 smithi159 ceph-mon[69013]: pgmap v3044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:36.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:35 smithi096 ceph-mon[101353]: pgmap v3045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:35 smithi159 ceph-mon[69013]: pgmap v3045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:37 smithi159 ceph-mon[69013]: pgmap v3046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:37.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:37 smithi096 ceph-mon[101353]: pgmap v3046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:39 smithi096 ceph-mon[101353]: pgmap v3047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:39 smithi159 ceph-mon[69013]: pgmap v3047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:41 smithi096 ceph-mon[101353]: pgmap v3048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:41 smithi159 ceph-mon[69013]: pgmap v3048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:44.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:43 smithi096 ceph-mon[101353]: pgmap v3049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:43 smithi159 ceph-mon[69013]: pgmap v3049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 -- 172.21.15.96:0/1045901169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 msgr2=0x7fdff40fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 --2- 172.21.15.96:0/1045901169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff40fbd10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fdfe8004660 tx=0x7fdfe8009b30).stop 2022-02-02T20:03:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 -- 172.21.15.96:0/1045901169 shutdown_connections 2022-02-02T20:03:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 --2- 172.21.15.96:0/1045901169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff40fbd10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 --2- 172.21.15.96:0/1045901169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 0x7fdff40f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:03:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 -- 172.21.15.96:0/1045901169 >> 172.21.15.96:0/1045901169 conn(0x7fdff40f0540 msgr2=0x7fdff40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 -- 172.21.15.96:0/1045901169 shutdown_connections 2022-02-02T20:03:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.747+0000 7fdffa438700 1 -- 172.21.15.96:0/1045901169 wait complete. 2022-02-02T20:03:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 Processor -- start 2022-02-02T20:03:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 -- start start 2022-02-02T20:03:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 0x7fdff4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4107a60 con 0x7fdff40f5410 2022-02-02T20:03:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdffa438700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4108310 con 0x7fdff40f4b00 2022-02-02T20:03:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdff37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdff37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34952/0 (socket says 172.21.15.96:34952) 2022-02-02T20:03:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdff37fe700 1 -- 172.21.15.96:0/446531416 learned_addr learned my addr 172.21.15.96:0/446531416 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.748+0000 7fdff3fff700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 0x7fdff4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff37fe700 1 -- 172.21.15.96:0/446531416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 msgr2=0x7fdff4106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff37fe700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 0x7fdff4106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff37fe700 1 -- 172.21.15.96:0/446531416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe8005040 con 0x7fdff40f5410 2022-02-02T20:03:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff37fe700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fdfe8009990 tx=0x7fdfe8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe8018070 con 0x7fdff40f5410 2022-02-02T20:03:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff4108590 con 0x7fdff40f5410 2022-02-02T20:03:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdfe8007ba0 con 0x7fdff40f5410 2022-02-02T20:03:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe801c620 con 0x7fdff40f5410 2022-02-02T20:03:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.749+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4108af0 con 0x7fdff40f5410 2022-02-02T20:03:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.750+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff40f41d0 con 0x7fdff40f5410 2022-02-02T20:03:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.751+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdfe801c8e0 con 0x7fdff40f5410 2022-02-02T20:03:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.751+0000 7fdff0ff9700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 0x7fdfdc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.751+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdfe8083890 con 0x7fdff40f5410 2022-02-02T20:03:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.751+0000 7fdff3fff700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 0x7fdfdc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.752+0000 7fdff3fff700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 0x7fdfdc067290 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fdfe4006fd0 tx=0x7fdfe4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.756+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdfe80553c0 con 0x7fdff40f5410 2022-02-02T20:03:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.934+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdff40fefa0 con 0x7fdfdc064dd0 2022-02-02T20:03:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.935+0000 7fdff0ff9700 1 -- 172.21.15.96:0/446531416 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdff40fefa0 con 0x7fdfdc064dd0 2022-02-02T20:03:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 msgr2=0x7fdfdc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 0x7fdfdc067290 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fdfe4006fd0 tx=0x7fdfe4008040).stop 2022-02-02T20:03:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 msgr2=0x7fdff4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fdfe8009990 tx=0x7fdfe8009b30).stop 2022-02-02T20:03:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 shutdown_connections 2022-02-02T20:03:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfdc064dd0 0x7fdfdc067290 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdff40f4b00 0x7fdff4106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:44.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 --2- 172.21.15.96:0/446531416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff40f5410 0x7fdff4107420 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:44.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 >> 172.21.15.96:0/446531416 conn(0x7fdff40f0540 msgr2=0x7fdff40f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:44.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 shutdown_connections 2022-02-02T20:03:44.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:44.937+0000 7fdffa438700 1 -- 172.21.15.96:0/446531416 wait complete. 2022-02-02T20:03:44.951 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:03:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 -- 172.21.15.96:0/955124770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f7980 msgr2=0x7f2b1c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/955124770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c0f7de0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f2b0c004660 tx=0x7f2b0c009b30).stop 2022-02-02T20:03:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 -- 172.21.15.96:0/955124770 shutdown_connections 2022-02-02T20:03:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/955124770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c0f7de0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/955124770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 -- 172.21.15.96:0/955124770 >> 172.21.15.96:0/955124770 conn(0x7f2b1c0f1e40 msgr2=0x7f2b1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 -- 172.21.15.96:0/955124770 shutdown_connections 2022-02-02T20:03:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.034+0000 7f2b21a6b700 1 -- 172.21.15.96:0/955124770 wait complete. 2022-02-02T20:03:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 Processor -- start 2022-02-02T20:03:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 -- start start 2022-02-02T20:03:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c06a380 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b21a6b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c06a4c0 con 0x7f2b1c0f7980 2022-02-02T20:03:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b1b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b1b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34960/0 (socket says 172.21.15.96:34960) 2022-02-02T20:03:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b1b7fe700 1 -- 172.21.15.96:0/2659072620 learned_addr learned my addr 172.21.15.96:0/2659072620 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.035+0000 7f2b1affd700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b1b7fe700 1 -- 172.21.15.96:0/2659072620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 msgr2=0x7f2b1c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b1b7fe700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b1b7fe700 1 -- 172.21.15.96:0/2659072620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c005040 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b1affd700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:03:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b1b7fe700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f2b1000c530 tx=0x7f2b10007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1000f650 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c06a7a0 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b1000fc60 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b10012d20 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.036+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c10ef90 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.037+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c045ad0 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.037+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b10019030 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.038+0000 7f2b03fff700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 0x7f2b04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.038+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2b10081700 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.038+0000 7f2b1affd700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 0x7f2b04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.038+0000 7f2b1affd700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 0x7f2b04067290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f2b0c004e30 tx=0x7f2b0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.042+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b1004f8b0 con 0x7f2b1c0f66e0 2022-02-02T20:03:45.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.214+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b1c057f10 con 0x7f2b04064dd0 2022-02-02T20:03:45.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.223+0000 7f2b03fff700 1 -- 172.21.15.96:0/2659072620 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f2b1c057f10 con 0x7f2b04064dd0 2022-02-02T20:03:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:03:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (107m) 77m ago 108m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:03:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (99m) 77m ago 108m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:03:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (99m) 76m ago 107m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:03:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (106m) 77m ago 107m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:03:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (104m) 77m ago 104m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:03:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (99m) 77m ago 104m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:03:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (104m) 76m ago 104m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:03:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (100m) 76m ago 104m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:03:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (101m) 77m ago 109m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:03:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (100m) 76m ago 107m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:03:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (100m) 77m ago 109m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:03:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (100m) 76m ago 107m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:03:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (107m) 77m ago 107m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:03:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (107m) 76m ago 107m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:03:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (99m) 77m ago 107m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:03:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (98m) 77m ago 106m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:03:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (98m) 77m ago 106m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:03:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (97m) 76m ago 106m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:03:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (97m) 76m ago 105m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:03:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (96m) 76m ago 105m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:03:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (106m) 77m ago 107m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:03:45.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 msgr2=0x7f2b04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 0x7f2b04067290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f2b0c004e30 tx=0x7f2b0c009b30).stop 2022-02-02T20:03:45.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 msgr2=0x7f2b1c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f2b1000c530 tx=0x7f2b10007e10).stop 2022-02-02T20:03:45.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 shutdown_connections 2022-02-02T20:03:45.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b04064dd0 0x7f2b04067290 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b1c0f66e0 0x7f2b1c06b9a0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 --2- 172.21.15.96:0/2659072620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b1c0f7980 0x7f2b1c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 >> 172.21.15.96:0/2659072620 conn(0x7f2b1c0f1e40 msgr2=0x7f2b1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 shutdown_connections 2022-02-02T20:03:45.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.226+0000 7f2b21a6b700 1 -- 172.21.15.96:0/2659072620 wait complete. 2022-02-02T20:03:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 -- 172.21.15.96:0/1391355697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 msgr2=0x7f5e580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/1391355697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e580f59e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f5e4c004660 tx=0x7f5e4c009b30).stop 2022-02-02T20:03:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 -- 172.21.15.96:0/1391355697 shutdown_connections 2022-02-02T20:03:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/1391355697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 0x7f5e580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/1391355697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e580f59e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 -- 172.21.15.96:0/1391355697 >> 172.21.15.96:0/1391355697 conn(0x7f5e580f0d40 msgr2=0x7f5e580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 -- 172.21.15.96:0/1391355697 shutdown_connections 2022-02-02T20:03:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.322+0000 7f5e5ef24700 1 -- 172.21.15.96:0/1391355697 wait complete. 2022-02-02T20:03:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.323+0000 7f5e5ef24700 1 Processor -- start 2022-02-02T20:03:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.323+0000 7f5e5ef24700 1 -- start start 2022-02-02T20:03:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 0x7f5e5810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58060420 con 0x7f5e580f55c0 2022-02-02T20:03:45.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58060560 con 0x7f5e580f6860 2022-02-02T20:03:45.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34970/0 (socket says 172.21.15.96:34970) 2022-02-02T20:03:45.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 -- 172.21.15.96:0/2594953492 learned_addr learned my addr 172.21.15.96:0/2594953492 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e57fff700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 0x7f5e5810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 -- 172.21.15.96:0/2594953492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 msgr2=0x7f5e5810c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 0x7f5e5810c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 -- 172.21.15.96:0/2594953492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c005040 con 0x7f5e580f55c0 2022-02-02T20:03:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ccc0700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f5e4c009830 tx=0x7f5e4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c018070 con 0x7f5e580f55c0 2022-02-02T20:03:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e4c007ba0 con 0x7f5e580f55c0 2022-02-02T20:03:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c01de60 con 0x7f5e580f55c0 2022-02-02T20:03:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5810c6e0 con 0x7f5e580f55c0 2022-02-02T20:03:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.324+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5810cc10 con 0x7f5e580f55c0 2022-02-02T20:03:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.325+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e580f49b0 con 0x7f5e580f55c0 2022-02-02T20:03:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.326+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e4c007d10 con 0x7f5e580f55c0 2022-02-02T20:03:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.326+0000 7f5e557fa700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 0x7f5e48067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.326+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5e4c0835a0 con 0x7f5e580f55c0 2022-02-02T20:03:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.326+0000 7f5e57fff700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 0x7f5e48067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.327+0000 7f5e57fff700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 0x7f5e48067270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f5e44004c40 tx=0x7f5e4400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.330+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e4c051700 con 0x7f5e580f55c0 2022-02-02T20:03:45.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.561+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e580fde90 con 0x7f5e580f55c0 2022-02-02T20:03:45.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.561+0000 7f5e557fa700 1 -- 172.21.15.96:0/2594953492 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5e4c054d20 con 0x7f5e580f55c0 2022-02-02T20:03:45.566 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:03:45.566 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:03:45.567 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:03:45.567 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:45.567 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:03:45.567 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:03:45.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:45.568 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:03:45.568 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:03:45.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:45.569 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:03:45.569 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:03:45.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:03:45.569 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:03:45.569 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:03:45.570 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:03:45.570 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:03:45.570 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:03:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 msgr2=0x7f5e48067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 0x7f5e48067270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f5e44004c40 tx=0x7f5e4400b040).stop 2022-02-02T20:03:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 msgr2=0x7f5e58109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f5e4c009830 tx=0x7f5e4c009b30).stop 2022-02-02T20:03:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 shutdown_connections 2022-02-02T20:03:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e48064db0 0x7f5e48067270 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e580f55c0 0x7f5e58109c30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 --2- 172.21.15.96:0/2594953492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e580f6860 0x7f5e5810c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 >> 172.21.15.96:0/2594953492 conn(0x7f5e580f0d40 msgr2=0x7f5e580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 shutdown_connections 2022-02-02T20:03:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.563+0000 7f5e5ef24700 1 -- 172.21.15.96:0/2594953492 wait complete. 2022-02-02T20:03:45.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/788393051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 msgr2=0x7f6fa40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/788393051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa40f7de0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f6f94004660 tx=0x7f6f94009b30).stop 2022-02-02T20:03:45.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/788393051 shutdown_connections 2022-02-02T20:03:45.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/788393051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa40f7de0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/788393051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 0x7f6fa40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/788393051 >> 172.21.15.96:0/788393051 conn(0x7f6fa40f1e40 msgr2=0x7f6fa40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/788393051 shutdown_connections 2022-02-02T20:03:45.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/788393051 wait complete. 2022-02-02T20:03:45.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 Processor -- start 2022-02-02T20:03:45.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.660+0000 7f6fa9a1d700 1 -- start start 2022-02-02T20:03:45.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 0x7f6fa4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4107a00 con 0x7f6fa40f7980 2022-02-02T20:03:45.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4107b40 con 0x7f6fa40f66e0 2022-02-02T20:03:45.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34982/0 (socket says 172.21.15.96:34982) 2022-02-02T20:03:45.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 -- 172.21.15.96:0/4077819722 learned_addr learned my addr 172.21.15.96:0/4077819722 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:03:45.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa2ffd700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 0x7f6fa4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 -- 172.21.15.96:0/4077819722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 msgr2=0x7f6fa4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 0x7f6fa4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 -- 172.21.15.96:0/4077819722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94005040 con 0x7f6fa40f7980 2022-02-02T20:03:45.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa27fc700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f6f94009990 tx=0x7f6f94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f94018070 con 0x7f6fa40f7980 2022-02-02T20:03:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4108480 con 0x7f6fa40f7980 2022-02-02T20:03:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f94007ba0 con 0x7f6fa40f7980 2022-02-02T20:03:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9401c3c0 con 0x7f6fa40f7980 2022-02-02T20:03:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.661+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa41089e0 con 0x7f6fa40f7980 2022-02-02T20:03:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.663+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f9401d420 con 0x7f6fa40f7980 2022-02-02T20:03:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.663+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4045ad0 con 0x7f6fa40f7980 2022-02-02T20:03:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.663+0000 7f6f8b7fe700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 0x7f6f8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:03:45.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.663+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f940836a0 con 0x7f6fa40f7980 2022-02-02T20:03:45.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.664+0000 7f6fa2ffd700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 0x7f6f8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:03:45.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.664+0000 7f6fa2ffd700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 0x7f6f8c067290 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f6fa40f77e0 tx=0x7f6f9800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:03:45.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.668+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f94055290 con 0x7f6fa40f7980 2022-02-02T20:03:45.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.872+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6fa4027a00 con 0x7f6fa40f7980 2022-02-02T20:03:45.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.872+0000 7f6f8b7fe700 1 -- 172.21.15.96:0/4077819722 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6f94054e80 con 0x7f6fa40f7980 2022-02-02T20:03:45.877 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:03:45.877 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:03:45.878 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:03:45.878 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:03:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:45.878 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:03:45.879 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:03:45.879 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:03:45.879 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:03:45.879 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:03:45.879 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:03:45.880 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:03:45.880 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:03:45.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:03:45.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:03:45.881 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:03:45.881 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:03:45.881 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:03:45.881 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:03:45.881 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:03:45.882 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:03:45.882 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:03:45.882 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:03:45.882 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:03:45.883 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:03:45.883 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:03:45.883 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:03:45.883 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:03:45.884 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:03:45.884 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:03:45.884 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:03:45.884 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:03:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:45.885 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:03:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:03:45.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:45.886 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:45.886 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:03:45.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 msgr2=0x7f6f8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 0x7f6f8c067290 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f6fa40f77e0 tx=0x7f6f9800b040).stop 2022-02-02T20:03:45.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 msgr2=0x7f6fa4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:03:45.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f6f94009990 tx=0x7f6f94009b30).stop 2022-02-02T20:03:45.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 shutdown_connections 2022-02-02T20:03:45.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f8c064dd0 0x7f6f8c067290 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fa40f66e0 0x7f6fa4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 --2- 172.21.15.96:0/4077819722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fa40f7980 0x7f6fa4107450 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:03:45.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 >> 172.21.15.96:0/4077819722 conn(0x7f6fa40f1e40 msgr2=0x7f6fa40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:03:45.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 shutdown_connections 2022-02-02T20:03:45.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:03:45.874+0000 7f6fa9a1d700 1 -- 172.21.15.96:0/4077819722 wait complete. 2022-02-02T20:03:45.891 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:03:46.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:45 smithi096 ceph-mon[101353]: pgmap v3050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:45 smithi096 ceph-mon[101353]: from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:46.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:45 smithi096 ceph-mon[101353]: from='client.37242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:46.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2594953492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:03:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:45 smithi159 ceph-mon[69013]: pgmap v3050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:45 smithi159 ceph-mon[69013]: from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:45 smithi159 ceph-mon[69013]: from='client.37242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:03:46.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2594953492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:03:47.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4077819722' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:03:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4077819722' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:03:48.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:47 smithi096 ceph-mon[101353]: pgmap v3051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:48.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:47 smithi159 ceph-mon[69013]: pgmap v3051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:49 smithi096 ceph-mon[101353]: pgmap v3052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:49 smithi159 ceph-mon[69013]: pgmap v3052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:52.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:51 smithi096 ceph-mon[101353]: pgmap v3053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:51 smithi159 ceph-mon[69013]: pgmap v3053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:54.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:53 smithi096 ceph-mon[101353]: pgmap v3054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:53 smithi159 ceph-mon[69013]: pgmap v3054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:55 smithi159 ceph-mon[69013]: pgmap v3055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:55 smithi096 ceph-mon[101353]: pgmap v3055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:57 smithi159 ceph-mon[69013]: pgmap v3056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:03:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:57 smithi096 ceph-mon[101353]: pgmap v3056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:03:59 smithi096 ceph-mon[101353]: pgmap v3057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:03:59 smithi159 ceph-mon[69013]: pgmap v3057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:02.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:01 smithi096 ceph-mon[101353]: pgmap v3058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:01 smithi159 ceph-mon[69013]: pgmap v3058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:04.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:03 smithi096 ceph-mon[101353]: pgmap v3059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:03 smithi159 ceph-mon[69013]: pgmap v3059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:06.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:05 smithi096 ceph-mon[101353]: pgmap v3060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:05 smithi159 ceph-mon[69013]: pgmap v3060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:07 smithi159 ceph-mon[69013]: pgmap v3061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:07 smithi096 ceph-mon[101353]: pgmap v3061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:10.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:09 smithi096 ceph-mon[101353]: pgmap v3062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:09 smithi159 ceph-mon[69013]: pgmap v3062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:12.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:11 smithi096 ceph-mon[101353]: pgmap v3063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:11 smithi159 ceph-mon[69013]: pgmap v3063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:14.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:13 smithi096 ceph-mon[101353]: pgmap v3064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:13 smithi159 ceph-mon[69013]: pgmap v3064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 -- 172.21.15.96:0/2266862530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f55c0 msgr2=0x7fb1e80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2266862530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f55c0 0x7fb1e80f59e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fb1d8004660 tx=0x7fb1d8009b30).stop 2022-02-02T20:04:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 -- 172.21.15.96:0/2266862530 shutdown_connections 2022-02-02T20:04:15.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2266862530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f6860 0x7fb1e80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:15.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2266862530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f55c0 0x7fb1e80f59e0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.983+0000 7fb1ee731700 1 -- 172.21.15.96:0/2266862530 >> 172.21.15.96:0/2266862530 conn(0x7fb1e80f0d40 msgr2=0x7fb1e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.984+0000 7fb1ee731700 1 -- 172.21.15.96:0/2266862530 shutdown_connections 2022-02-02T20:04:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.984+0000 7fb1ee731700 1 -- 172.21.15.96:0/2266862530 wait complete. 2022-02-02T20:04:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.984+0000 7fb1ee731700 1 Processor -- start 2022-02-02T20:04:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.984+0000 7fb1ee731700 1 -- start start 2022-02-02T20:04:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1ee731700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 0x7fb1e8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1ee731700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1ee731700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80603c0 con 0x7fb1e80f6860 2022-02-02T20:04:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1ee731700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8060500 con 0x7fb1e80f55c0 2022-02-02T20:04:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35000/0 (socket says 172.21.15.96:35000) 2022-02-02T20:04:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 -- 172.21.15.96:0/2331484791 learned_addr learned my addr 172.21.15.96:0/2331484791 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e7fff700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 0x7fb1e8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 -- 172.21.15.96:0/2331484791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 msgr2=0x7fb1e8109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 0x7fb1e8109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 -- 172.21.15.96:0/2331484791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8005040 con 0x7fb1e80f6860 2022-02-02T20:04:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e7fff700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 0x7fb1e8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:04:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.985+0000 7fb1e77fe700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fb1dc00c530 tx=0x7fb1dc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.986+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1dc00f650 con 0x7fb1e80f6860 2022-02-02T20:04:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.986+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e810c740 con 0x7fb1e80f6860 2022-02-02T20:04:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.986+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1dc00fc60 con 0x7fb1e80f6860 2022-02-02T20:04:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.986+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1dc012cd0 con 0x7fb1e80f6860 2022-02-02T20:04:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.986+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e810ccd0 con 0x7fb1e80f6860 2022-02-02T20:04:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.987+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8045ad0 con 0x7fb1e80f6860 2022-02-02T20:04:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.988+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb1dc010070 con 0x7fb1e80f6860 2022-02-02T20:04:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.988+0000 7fb1e4ff9700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 0x7fb1d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.989+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb1dc081e90 con 0x7fb1e80f6860 2022-02-02T20:04:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.989+0000 7fb1e7fff700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 0x7fb1d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.989+0000 7fb1e7fff700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 0x7fb1d0067290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb1d8004e30 tx=0x7fb1d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:15.992+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb1dc050010 con 0x7fb1e80f6860 2022-02-02T20:04:16.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:15 smithi096 ceph-mon[101353]: pgmap v3065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:16.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.173+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1e8057f10 con 0x7fb1d0064dd0 2022-02-02T20:04:16.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.174+0000 7fb1e4ff9700 1 -- 172.21.15.96:0/2331484791 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb1e8057f10 con 0x7fb1d0064dd0 2022-02-02T20:04:16.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 msgr2=0x7fb1d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 0x7fb1d0067290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb1d8004e30 tx=0x7fb1d8009b30).stop 2022-02-02T20:04:16.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 msgr2=0x7fb1e810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fb1dc00c530 tx=0x7fb1dc007e20).stop 2022-02-02T20:04:16.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 shutdown_connections 2022-02-02T20:04:16.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1d0064dd0 0x7fb1d0067290 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1e80f55c0 0x7fb1e8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 --2- 172.21.15.96:0/2331484791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e80f6860 0x7fb1e810c190 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 >> 172.21.15.96:0/2331484791 conn(0x7fb1e80f0d40 msgr2=0x7fb1e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 shutdown_connections 2022-02-02T20:04:16.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.176+0000 7fb1ee731700 1 -- 172.21.15.96:0/2331484791 wait complete. 2022-02-02T20:04:16.190 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:04:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:15 smithi159 ceph-mon[69013]: pgmap v3065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:16.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 -- 172.21.15.96:0/1229004102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f66d0 msgr2=0x7f5d800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/1229004102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f66d0 0x7f5d800f6b30 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f5d74004660 tx=0x7f5d74009b30).stop 2022-02-02T20:04:16.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 -- 172.21.15.96:0/1229004102 shutdown_connections 2022-02-02T20:04:16.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/1229004102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f66d0 0x7f5d800f6b30 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/1229004102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f5430 0x7f5d800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 -- 172.21.15.96:0/1229004102 >> 172.21.15.96:0/1229004102 conn(0x7f5d800f0b90 msgr2=0x7f5d800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 -- 172.21.15.96:0/1229004102 shutdown_connections 2022-02-02T20:04:16.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.273+0000 7f5d84a8f700 1 -- 172.21.15.96:0/1229004102 wait complete. 2022-02-02T20:04:16.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 Processor -- start 2022-02-02T20:04:16.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 -- start start 2022-02-02T20:04:16.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 0x7f5d8010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800603c0 con 0x7f5d800f5430 2022-02-02T20:04:16.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d84a8f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80060500 con 0x7f5d800f66d0 2022-02-02T20:04:16.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d7f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d7f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35012/0 (socket says 172.21.15.96:35012) 2022-02-02T20:04:16.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.274+0000 7f5d7f7fe700 1 -- 172.21.15.96:0/2060546728 learned_addr learned my addr 172.21.15.96:0/2060546728 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:16.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7effd700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 0x7f5d8010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7f7fe700 1 -- 172.21.15.96:0/2060546728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 msgr2=0x7f5d8010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7f7fe700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 0x7f5d8010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7f7fe700 1 -- 172.21.15.96:0/2060546728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74005040 con 0x7f5d800f5430 2022-02-02T20:04:16.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7effd700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 0x7f5d8010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:04:16.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d7f7fe700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f5d7000c530 tx=0x7f5d70007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7000f650 con 0x7f5d800f5430 2022-02-02T20:04:16.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8010c4f0 con 0x7f5d800f5430 2022-02-02T20:04:16.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d7000fc60 con 0x7f5d800f5430 2022-02-02T20:04:16.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d70012d20 con 0x7f5d800f5430 2022-02-02T20:04:16.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.275+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8010ca80 con 0x7f5d800f5430 2022-02-02T20:04:16.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.276+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d80059100 con 0x7f5d800f5430 2022-02-02T20:04:16.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.276+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5d70019030 con 0x7f5d800f5430 2022-02-02T20:04:16.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.277+0000 7f5d67fff700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 0x7f5d680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.277+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5d70081710 con 0x7f5d800f5430 2022-02-02T20:04:16.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.277+0000 7f5d7effd700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 0x7f5d680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.277+0000 7f5d7effd700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 0x7f5d680672e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5d74009da0 tx=0x7f5d74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.281+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5d7004f8c0 con 0x7f5d800f5430 2022-02-02T20:04:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.453+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d80057f10 con 0x7f5d68064e20 2022-02-02T20:04:16.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.464+0000 7f5d67fff700 1 -- 172.21.15.96:0/2060546728 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f5d80057f10 con 0x7f5d68064e20 2022-02-02T20:04:16.468 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:04:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (107m) 78m ago 108m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:04:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (100m) 78m ago 108m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:04:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (100m) 76m ago 108m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:04:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (107m) 78m ago 108m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:04:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (104m) 78m ago 104m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:04:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (100m) 78m ago 104m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:04:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (104m) 76m ago 104m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:04:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (100m) 76m ago 104m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:04:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (101m) 78m ago 109m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:04:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (101m) 76m ago 108m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:04:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (100m) 78m ago 109m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:04:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (100m) 76m ago 108m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:04:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (108m) 78m ago 108m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:04:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (107m) 76m ago 107m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:04:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (99m) 78m ago 107m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:04:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (99m) 78m ago 107m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:04:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (98m) 78m ago 106m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:04:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (98m) 76m ago 106m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:04:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (97m) 76m ago 106m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:04:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (97m) 76m ago 106m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:04:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (107m) 78m ago 108m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:04:16.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 msgr2=0x7f5d680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 0x7f5d680672e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5d74009da0 tx=0x7f5d74009b30).stop 2022-02-02T20:04:16.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 msgr2=0x7f5d80109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f5d7000c530 tx=0x7f5d70007e10).stop 2022-02-02T20:04:16.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 shutdown_connections 2022-02-02T20:04:16.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d68064e20 0x7f5d680672e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d800f5430 0x7f5d80109a40 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 --2- 172.21.15.96:0/2060546728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d800f66d0 0x7f5d8010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 >> 172.21.15.96:0/2060546728 conn(0x7f5d800f0b90 msgr2=0x7f5d800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 shutdown_connections 2022-02-02T20:04:16.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.466+0000 7f5d84a8f700 1 -- 172.21.15.96:0/2060546728 wait complete. 2022-02-02T20:04:16.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 -- 172.21.15.96:0/1885523566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f55c0 msgr2=0x7f56ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 --2- 172.21.15.96:0/1885523566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f55c0 0x7f56ac0f59e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f569c004660 tx=0x7f569c009b30).stop 2022-02-02T20:04:16.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 -- 172.21.15.96:0/1885523566 shutdown_connections 2022-02-02T20:04:16.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 --2- 172.21.15.96:0/1885523566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f6860 0x7f56ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 --2- 172.21.15.96:0/1885523566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f55c0 0x7f56ac0f59e0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 -- 172.21.15.96:0/1885523566 >> 172.21.15.96:0/1885523566 conn(0x7f56ac0f0d40 msgr2=0x7f56ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 -- 172.21.15.96:0/1885523566 shutdown_connections 2022-02-02T20:04:16.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.564+0000 7f56b25bb700 1 -- 172.21.15.96:0/1885523566 wait complete. 2022-02-02T20:04:16.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 Processor -- start 2022-02-02T20:04:16.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 -- start start 2022-02-02T20:04:16.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f55c0 0x7f56ac10bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0602d0 con 0x7f56ac0f6860 2022-02-02T20:04:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56b25bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac060410 con 0x7f56ac0f55c0 2022-02-02T20:04:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35024/0 (socket says 172.21.15.96:35024) 2022-02-02T20:04:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.565+0000 7f56ab7fe700 1 -- 172.21.15.96:0/702102675 learned_addr learned my addr 172.21.15.96:0/702102675 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56abfff700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f55c0 0x7f56ac10bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56ab7fe700 1 -- 172.21.15.96:0/702102675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f55c0 msgr2=0x7f56ac10bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56ab7fe700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f55c0 0x7f56ac10bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56ab7fe700 1 -- 172.21.15.96:0/702102675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c005040 con 0x7f56ac0f6860 2022-02-02T20:04:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56ab7fe700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f56a000e7f0 tx=0x7f56a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a00092e0 con 0x7f56ac0f6860 2022-02-02T20:04:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56a000f040 con 0x7f56ac0f6860 2022-02-02T20:04:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac10e9e0 con 0x7f56ac0f6860 2022-02-02T20:04:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a0014750 con 0x7f56ac0f6860 2022-02-02T20:04:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.566+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac10ee60 con 0x7f56ac0f6860 2022-02-02T20:04:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.567+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac045ad0 con 0x7f56ac0f6860 2022-02-02T20:04:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.567+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56a001b030 con 0x7f56ac0f6860 2022-02-02T20:04:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.568+0000 7f56a8ff9700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.568+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56a00817a0 con 0x7f56ac0f6860 2022-02-02T20:04:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.568+0000 7f56abfff700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.568+0000 7f56abfff700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 0x7f5694067290 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f569c004d80 tx=0x7f569c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.572+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56a004f950 con 0x7f56ac0f6860 2022-02-02T20:04:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.806+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56ac0605a0 con 0x7f56ac0f6860 2022-02-02T20:04:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.806+0000 7f56a8ff9700 1 -- 172.21.15.96:0/702102675 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f56a0052f70 con 0x7f56ac0f6860 2022-02-02T20:04:16.812 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:04:16.812 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:04:16.812 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:04:16.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:16.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:04:16.813 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:04:16.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:16.814 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:04:16.815 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:04:16.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:16.815 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:04:16.815 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:04:16.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:16.816 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:04:16.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:04:16.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:04:16.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:04:16.817 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:04:16.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 msgr2=0x7f5694067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 0x7f5694067290 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f569c004d80 tx=0x7f569c00b040).stop 2022-02-02T20:04:16.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 msgr2=0x7f56ac10e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f56a000e7f0 tx=0x7f56a000b040).stop 2022-02-02T20:04:16.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 shutdown_connections 2022-02-02T20:04:16.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56ac0f55c0 0x7f56ac10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 --2- 172.21.15.96:0/702102675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56ac0f6860 0x7f56ac10e4f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 >> 172.21.15.96:0/702102675 conn(0x7f56ac0f0d40 msgr2=0x7f56ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 shutdown_connections 2022-02-02T20:04:16.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.808+0000 7f56b25bb700 1 -- 172.21.15.96:0/702102675 wait complete. 2022-02-02T20:04:16.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 -- 172.21.15.96:0/125427879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 msgr2=0x7f1e280f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/125427879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e280f7fe0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f1e18004660 tx=0x7f1e18009b30).stop 2022-02-02T20:04:16.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 -- 172.21.15.96:0/125427879 shutdown_connections 2022-02-02T20:04:16.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/125427879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e280f7fe0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/125427879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e280f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 -- 172.21.15.96:0/125427879 >> 172.21.15.96:0/125427879 conn(0x7f1e280f2020 msgr2=0x7f1e280f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:16.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 -- 172.21.15.96:0/125427879 shutdown_connections 2022-02-02T20:04:16.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.905+0000 7f1e2d65f700 1 -- 172.21.15.96:0/125427879 wait complete. 2022-02-02T20:04:16.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 Processor -- start 2022-02-02T20:04:16.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 -- start start 2022-02-02T20:04:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2810ae00 con 0x7f1e280f7b80 2022-02-02T20:04:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e2d65f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2810af40 con 0x7f1e280f68e0 2022-02-02T20:04:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35034/0 (socket says 172.21.15.96:35034) 2022-02-02T20:04:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e267fc700 1 -- 172.21.15.96:0/1424476915 learned_addr learned my addr 172.21.15.96:0/1424476915 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.906+0000 7f1e26ffd700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e267fc700 1 -- 172.21.15.96:0/1424476915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 msgr2=0x7f1e2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e267fc700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e267fc700 1 -- 172.21.15.96:0/1424476915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18005040 con 0x7f1e280f7b80 2022-02-02T20:04:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e26ffd700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:04:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e267fc700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f1e18009990 tx=0x7f1e18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e18018070 con 0x7f1e280f7b80 2022-02-02T20:04:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e18007ba0 con 0x7f1e280f7b80 2022-02-02T20:04:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2806a370 con 0x7f1e280f7b80 2022-02-02T20:04:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1801c3c0 con 0x7f1e280f7b80 2022-02-02T20:04:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.907+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2806a8d0 con 0x7f1e280f7b80 2022-02-02T20:04:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.908+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28045ad0 con 0x7f1e280f7b80 2022-02-02T20:04:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.908+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e1801d420 con 0x7f1e280f7b80 2022-02-02T20:04:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.909+0000 7f1e1f7fe700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 0x7f1e14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.909+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1e18083760 con 0x7f1e280f7b80 2022-02-02T20:04:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.909+0000 7f1e26ffd700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 0x7f1e14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.909+0000 7f1e26ffd700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 0x7f1e14067290 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f1e10009fd0 tx=0x7f1e1000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:16.913+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e18051800 con 0x7f1e280f7b80 2022-02-02T20:04:17.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:16 smithi096 ceph-mon[101353]: from='client.37254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:17.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.114+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1e28027a00 con 0x7f1e280f7b80 2022-02-02T20:04:17.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.114+0000 7f1e1f7fe700 1 -- 172.21.15.96:0/1424476915 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1e18054e20 con 0x7f1e280f7b80 2022-02-02T20:04:17.119 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:04:17.119 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:04:17.119 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:04:17.120 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:04:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:17.120 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:04:17.120 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:04:17.120 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:04:17.121 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:04:17.121 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:04:17.121 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:04:17.121 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:04:17.122 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:04:17.122 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:04:17.122 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:04:17.122 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:04:17.123 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:04:17.123 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:04:17.123 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:04:17.123 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:04:17.124 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:04:17.124 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:04:17.124 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:04:17.124 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:04:17.124 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:04:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:04:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:04:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:04:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:04:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:04:17.126 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:04:17.126 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:04:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:17.127 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:04:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:17.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:17.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:17.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 msgr2=0x7f1e14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 0x7f1e14067290 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f1e10009fd0 tx=0x7f1e1000b040).stop 2022-02-02T20:04:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 msgr2=0x7f1e28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f1e18009990 tx=0x7f1e18009b30).stop 2022-02-02T20:04:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 shutdown_connections 2022-02-02T20:04:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e14064dd0 0x7f1e14067290 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e280f68e0 0x7f1e2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 --2- 172.21.15.96:0/1424476915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e280f7b80 0x7f1e28069e20 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 >> 172.21.15.96:0/1424476915 conn(0x7f1e280f2020 msgr2=0x7f1e280fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 shutdown_connections 2022-02-02T20:04:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:17.116+0000 7f1e2d65f700 1 -- 172.21.15.96:0/1424476915 wait complete. 2022-02-02T20:04:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:04:17.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:16 smithi159 ceph-mon[69013]: from='client.37254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:18.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:17 smithi096 ceph-mon[101353]: from='client.37258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:17 smithi096 ceph-mon[101353]: pgmap v3066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/702102675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:04:18.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1424476915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:04:18.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:17 smithi159 ceph-mon[69013]: from='client.37258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:18.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:17 smithi159 ceph-mon[69013]: pgmap v3066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:18.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/702102675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:04:18.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1424476915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:04:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:19 smithi159 ceph-mon[69013]: pgmap v3067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:19 smithi096 ceph-mon[101353]: pgmap v3067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:21 smithi159 ceph-mon[69013]: pgmap v3068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:21 smithi096 ceph-mon[101353]: pgmap v3068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:23 smithi159 ceph-mon[69013]: pgmap v3069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:23 smithi096 ceph-mon[101353]: pgmap v3069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:25 smithi159 ceph-mon[69013]: pgmap v3070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:25 smithi096 ceph-mon[101353]: pgmap v3070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:27 smithi159 ceph-mon[69013]: pgmap v3071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:04:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:04:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:27 smithi096 ceph-mon[101353]: pgmap v3071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:04:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:04:30.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:29 smithi096 ceph-mon[101353]: pgmap v3072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:29 smithi159 ceph-mon[69013]: pgmap v3072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:31 smithi096 ceph-mon[101353]: pgmap v3073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:31 smithi159 ceph-mon[69013]: pgmap v3073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:34.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:33 smithi096 ceph-mon[101353]: pgmap v3074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:34.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:33 smithi159 ceph-mon[69013]: pgmap v3074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:35 smithi159 ceph-mon[69013]: pgmap v3075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:35 smithi096 ceph-mon[101353]: pgmap v3075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:37 smithi159 ceph-mon[69013]: pgmap v3076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:37.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:37 smithi096 ceph-mon[101353]: pgmap v3076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:40.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:39 smithi096 ceph-mon[101353]: pgmap v3077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:39 smithi159 ceph-mon[69013]: pgmap v3077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:42.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:41 smithi096 ceph-mon[101353]: pgmap v3078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:41 smithi159 ceph-mon[69013]: pgmap v3078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:43 smithi159 ceph-mon[69013]: pgmap v3079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:44.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:43 smithi096 ceph-mon[101353]: pgmap v3079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:45 smithi159 ceph-mon[69013]: pgmap v3080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:45 smithi096 ceph-mon[101353]: pgmap v3080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:47.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2558655288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f6860 msgr2=0x7efe180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2558655288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f6860 0x7efe180f6cc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7efe0c004660 tx=0x7efe0c009b30).stop 2022-02-02T20:04:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2558655288 shutdown_connections 2022-02-02T20:04:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2558655288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f6860 0x7efe180f6cc0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2558655288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f55c0 0x7efe180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2558655288 >> 172.21.15.96:0/2558655288 conn(0x7efe180f0d40 msgr2=0x7efe180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.227+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2558655288 shutdown_connections 2022-02-02T20:04:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.228+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2558655288 wait complete. 2022-02-02T20:04:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.228+0000 7efe1e3e2700 1 Processor -- start 2022-02-02T20:04:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.228+0000 7efe1e3e2700 1 -- start start 2022-02-02T20:04:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe1e3e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe1e3e2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 0x7efe1810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe1e3e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18060420 con 0x7efe180f55c0 2022-02-02T20:04:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe1e3e2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18060560 con 0x7efe180f6860 2022-02-02T20:04:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35050/0 (socket says 172.21.15.96:35050) 2022-02-02T20:04:47.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 -- 172.21.15.96:0/2069330264 learned_addr learned my addr 172.21.15.96:0/2069330264 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe177fe700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 0x7efe1810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 -- 172.21.15.96:0/2069330264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 msgr2=0x7efe1810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 0x7efe1810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 -- 172.21.15.96:0/2069330264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c005040 con 0x7efe180f55c0 2022-02-02T20:04:47.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe177fe700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 0x7efe1810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:04:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe17fff700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7efe0800c790 tx=0x7efe08007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0800e680 con 0x7efe180f55c0 2022-02-02T20:04:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1810c720 con 0x7efe180f55c0 2022-02-02T20:04:47.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe0800ec90 con 0x7efe180f55c0 2022-02-02T20:04:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.229+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe08012d00 con 0x7efe180f55c0 2022-02-02T20:04:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.230+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1810ccb0 con 0x7efe180f55c0 2022-02-02T20:04:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.230+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe180f49b0 con 0x7efe180f55c0 2022-02-02T20:04:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.231+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe08010070 con 0x7efe180f55c0 2022-02-02T20:04:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.231+0000 7efe14ff9700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 0x7efe00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.231+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efe08081b30 con 0x7efe180f55c0 2022-02-02T20:04:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.231+0000 7efe177fe700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 0x7efe00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.232+0000 7efe177fe700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 0x7efe00067290 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7efe0c009da0 tx=0x7efe0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.236+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe0804fc30 con 0x7efe180f55c0 2022-02-02T20:04:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.415+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe180fdef0 con 0x7efe00064dd0 2022-02-02T20:04:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.416+0000 7efe14ff9700 1 -- 172.21.15.96:0/2069330264 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7efe180fdef0 con 0x7efe00064dd0 2022-02-02T20:04:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 msgr2=0x7efe00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 0x7efe00067290 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7efe0c009da0 tx=0x7efe0c009b30).stop 2022-02-02T20:04:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 msgr2=0x7efe18109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7efe0800c790 tx=0x7efe08007d90).stop 2022-02-02T20:04:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 shutdown_connections 2022-02-02T20:04:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe00064dd0 0x7efe00067290 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe180f55c0 0x7efe18109c10 secure :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0x7efe0800c790 tx=0x7efe08007d90).stop 2022-02-02T20:04:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 --2- 172.21.15.96:0/2069330264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe180f6860 0x7efe1810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 >> 172.21.15.96:0/2069330264 conn(0x7efe180f0d40 msgr2=0x7efe180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 shutdown_connections 2022-02-02T20:04:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.418+0000 7efe1e3e2700 1 -- 172.21.15.96:0/2069330264 wait complete. 2022-02-02T20:04:47.431 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:04:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 -- 172.21.15.96:0/677634505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 msgr2=0x7f165c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 --2- 172.21.15.96:0/677634505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c0f6cc0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f164c004660 tx=0x7f164c009b30).stop 2022-02-02T20:04:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 -- 172.21.15.96:0/677634505 shutdown_connections 2022-02-02T20:04:47.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 --2- 172.21.15.96:0/677634505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c0f6cc0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 --2- 172.21.15.96:0/677634505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 0x7f165c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.516+0000 7f166363a700 1 -- 172.21.15.96:0/677634505 >> 172.21.15.96:0/677634505 conn(0x7f165c0f0d40 msgr2=0x7f165c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:47.522 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:47 smithi096 ceph-mon[101353]: pgmap v3081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:47.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.517+0000 7f166363a700 1 -- 172.21.15.96:0/677634505 shutdown_connections 2022-02-02T20:04:47.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.517+0000 7f166363a700 1 -- 172.21.15.96:0/677634505 wait complete. 2022-02-02T20:04:47.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.517+0000 7f166363a700 1 Processor -- start 2022-02-02T20:04:47.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.517+0000 7f166363a700 1 -- start start 2022-02-02T20:04:47.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f166363a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 0x7f165c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f166363a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f166363a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c109c20 con 0x7f165c0f6860 2022-02-02T20:04:47.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f166363a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c109d60 con 0x7f165c0f55c0 2022-02-02T20:04:47.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35062/0 (socket says 172.21.15.96:35062) 2022-02-02T20:04:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 -- 172.21.15.96:0/3705250112 learned_addr learned my addr 172.21.15.96:0/3705250112 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f16613d6700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 0x7f165c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 -- 172.21.15.96:0/3705250112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 msgr2=0x7f165c109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 0x7f165c109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 -- 172.21.15.96:0/3705250112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c005040 con 0x7f165c0f6860 2022-02-02T20:04:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1660bd5700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f164c009990 tx=0x7f164c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.518+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f164c018070 con 0x7f165c0f6860 2022-02-02T20:04:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.519+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f164c007ba0 con 0x7f165c0f6860 2022-02-02T20:04:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.519+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c10a6a0 con 0x7f165c0f6860 2022-02-02T20:04:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.519+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f164c01c3c0 con 0x7f165c0f6860 2022-02-02T20:04:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.519+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c10ac00 con 0x7f165c0f6860 2022-02-02T20:04:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.520+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c045ad0 con 0x7f165c0f6860 2022-02-02T20:04:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.520+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f164c01d420 con 0x7f165c0f6860 2022-02-02T20:04:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.521+0000 7f1651ffb700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 0x7f1648067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.521+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f164c083630 con 0x7f165c0f6860 2022-02-02T20:04:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.521+0000 7f16613d6700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 0x7f1648067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.521+0000 7f16613d6700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 0x7f1648067290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f165c0f66c0 tx=0x7f165800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.525+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f164c055160 con 0x7f165c0f6860 2022-02-02T20:04:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.699+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f165c0fb2c0 con 0x7f1648064dd0 2022-02-02T20:04:47.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.708+0000 7f1651ffb700 1 -- 172.21.15.96:0/3705250112 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f165c0fb2c0 con 0x7f1648064dd0 2022-02-02T20:04:47.711 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:04:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (108m) 78m ago 109m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:04:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (100m) 78m ago 109m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:04:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (100m) 77m ago 108m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:04:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (108m) 78m ago 109m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:04:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (105m) 78m ago 105m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:04:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (100m) 78m ago 105m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:04:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (105m) 77m ago 105m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:04:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (101m) 77m ago 105m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:04:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (102m) 78m ago 110m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:04:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (101m) 77m ago 108m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:04:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (101m) 78m ago 110m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:04:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (101m) 77m ago 108m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:04:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (108m) 78m ago 108m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:04:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (108m) 77m ago 108m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:04:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (100m) 78m ago 108m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:04:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (99m) 78m ago 107m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:04:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (99m) 78m ago 107m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:04:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (98m) 77m ago 107m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:04:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (98m) 77m ago 106m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:04:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (97m) 77m ago 106m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:04:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (107m) 78m ago 108m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:04:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 msgr2=0x7f1648067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 0x7f1648067290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f165c0f66c0 tx=0x7f165800b040).stop 2022-02-02T20:04:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 msgr2=0x7f165c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f164c009990 tx=0x7f164c009b30).stop 2022-02-02T20:04:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 shutdown_connections 2022-02-02T20:04:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1648064dd0 0x7f1648067290 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f55c0 0x7f165c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 --2- 172.21.15.96:0/3705250112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f6860 0x7f165c109670 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 >> 172.21.15.96:0/3705250112 conn(0x7f165c0f0d40 msgr2=0x7f165c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 shutdown_connections 2022-02-02T20:04:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.710+0000 7f166363a700 1 -- 172.21.15.96:0/3705250112 wait complete. 2022-02-02T20:04:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:47 smithi159 ceph-mon[69013]: pgmap v3081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:47.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 -- 172.21.15.96:0/482474648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 msgr2=0x7f34400f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 --2- 172.21.15.96:0/482474648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34400f6b40 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f342c004660 tx=0x7f342c009b30).stop 2022-02-02T20:04:47.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 -- 172.21.15.96:0/482474648 shutdown_connections 2022-02-02T20:04:47.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 --2- 172.21.15.96:0/482474648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34400f6b40 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 --2- 172.21.15.96:0/482474648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 0x7f34400f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 -- 172.21.15.96:0/482474648 >> 172.21.15.96:0/482474648 conn(0x7f34400f0ba0 msgr2=0x7f34400f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:47.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 -- 172.21.15.96:0/482474648 shutdown_connections 2022-02-02T20:04:47.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.805+0000 7f3445992700 1 -- 172.21.15.96:0/482474648 wait complete. 2022-02-02T20:04:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 Processor -- start 2022-02-02T20:04:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 -- start start 2022-02-02T20:04:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 0x7f3440105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440106770 con 0x7f34400f66e0 2022-02-02T20:04:47.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f3445992700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440106f70 con 0x7f34400f5440 2022-02-02T20:04:47.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.806+0000 7f343ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35072/0 (socket says 172.21.15.96:35072) 2022-02-02T20:04:47.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 -- 172.21.15.96:0/2308434625 learned_addr learned my addr 172.21.15.96:0/2308434625 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:47.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f3444990700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 0x7f3440105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 -- 172.21.15.96:0/2308434625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 msgr2=0x7f3440105cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:47.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 0x7f3440105cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:47.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 -- 172.21.15.96:0/2308434625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c005040 con 0x7f34400f66e0 2022-02-02T20:04:47.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343ffff700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f342c009990 tx=0x7f342c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f342c01a070 con 0x7f34400f66e0 2022-02-02T20:04:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f342c012a80 con 0x7f34400f66e0 2022-02-02T20:04:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34401071f0 con 0x7f34400f66e0 2022-02-02T20:04:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f342c01f870 con 0x7f34400f66e0 2022-02-02T20:04:47.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.807+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3440107750 con 0x7f34400f66e0 2022-02-02T20:04:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.808+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440059100 con 0x7f34400f66e0 2022-02-02T20:04:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.809+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f342c012bf0 con 0x7f34400f66e0 2022-02-02T20:04:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.809+0000 7f343d7fa700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 0x7f34300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.809+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f342c085c50 con 0x7f34400f66e0 2022-02-02T20:04:47.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.809+0000 7f3444990700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 0x7f34300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.809+0000 7f3444990700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 0x7f34300672e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f34400f6540 tx=0x7f3434009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:47.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:47.813+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f342c057840 con 0x7f34400f66e0 2022-02-02T20:04:48.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.044+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34400ff610 con 0x7f34400f66e0 2022-02-02T20:04:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.045+0000 7f343d7fa700 1 -- 172.21.15.96:0/2308434625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f342c057430 con 0x7f34400f66e0 2022-02-02T20:04:48.049 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:04:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:04:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:04:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:04:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:04:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:04:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:04:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:04:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:04:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:04:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:04:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:04:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:04:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:04:48.053 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:04:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 msgr2=0x7f34300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 0x7f34300672e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f34400f6540 tx=0x7f3434009040).stop 2022-02-02T20:04:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 msgr2=0x7f34401061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f342c009990 tx=0x7f342c009b30).stop 2022-02-02T20:04:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 shutdown_connections 2022-02-02T20:04:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3430064e20 0x7f34300672e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34400f5440 0x7f3440105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 --2- 172.21.15.96:0/2308434625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34400f66e0 0x7f34401061c0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 >> 172.21.15.96:0/2308434625 conn(0x7f34400f0ba0 msgr2=0x7f34400fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 shutdown_connections 2022-02-02T20:04:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.047+0000 7f3445992700 1 -- 172.21.15.96:0/2308434625 wait complete. 2022-02-02T20:04:48.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 -- 172.21.15.96:0/2047259781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f77d0 msgr2=0x7f7cd00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/2047259781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f77d0 0x7f7cd00f7c30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f7cc4004660 tx=0x7f7cc4009b30).stop 2022-02-02T20:04:48.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 -- 172.21.15.96:0/2047259781 shutdown_connections 2022-02-02T20:04:48.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/2047259781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f77d0 0x7f7cd00f7c30 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/2047259781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f6530 0x7f7cd00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.144+0000 7f7ccf59e700 1 -- 172.21.15.96:0/2047259781 >> 172.21.15.96:0/2047259781 conn(0x7f7cd00f1c90 msgr2=0x7f7cd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:48.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 -- 172.21.15.96:0/2047259781 shutdown_connections 2022-02-02T20:04:48.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 -- 172.21.15.96:0/2047259781 wait complete. 2022-02-02T20:04:48.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 Processor -- start 2022-02-02T20:04:48.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 -- start start 2022-02-02T20:04:48.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:48.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 0x7f7cd0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:48.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd006a380 con 0x7f7cd00f6530 2022-02-02T20:04:48.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7ccf59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd006a4c0 con 0x7f7cd00f77d0 2022-02-02T20:04:48.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7cce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:48.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7cce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35080/0 (socket says 172.21.15.96:35080) 2022-02-02T20:04:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.145+0000 7f7cce59c700 1 -- 172.21.15.96:0/4140837078 learned_addr learned my addr 172.21.15.96:0/4140837078 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:04:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7ccdd9b700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 0x7f7cd0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cce59c700 1 -- 172.21.15.96:0/4140837078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 msgr2=0x7f7cd0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cce59c700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 0x7f7cd0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cce59c700 1 -- 172.21.15.96:0/4140837078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4005040 con 0x7f7cd00f6530 2022-02-02T20:04:48.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7ccdd9b700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 0x7f7cd0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:04:48.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cce59c700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f7cc0002700 tx=0x7f7cc0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:48.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc0009320 con 0x7f7cd00f6530 2022-02-02T20:04:48.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cc000f040 con 0x7f7cd00f6530 2022-02-02T20:04:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc0014900 con 0x7f7cd00f6530 2022-02-02T20:04:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd006a7a0 con 0x7f7cd00f6530 2022-02-02T20:04:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.146+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd010ed50 con 0x7f7cd00f6530 2022-02-02T20:04:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.147+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd0045ad0 con 0x7f7cd00f6530 2022-02-02T20:04:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.147+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cc0009480 con 0x7f7cd00f6530 2022-02-02T20:04:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.148+0000 7f7cbeffd700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 0x7f7cb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:04:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.148+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7cc0081be0 con 0x7f7cd00f6530 2022-02-02T20:04:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.148+0000 7f7ccdd9b700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 0x7f7cb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:04:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.148+0000 7f7ccdd9b700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 0x7f7cb80672e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f7cc4004630 tx=0x7f7cc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:04:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.152+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cc004fce0 con 0x7f7cd00f6530 2022-02-02T20:04:48.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.353+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7cd00fedf0 con 0x7f7cd00f6530 2022-02-02T20:04:48.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.353+0000 7f7cbeffd700 1 -- 172.21.15.96:0/4140837078 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7cc0053300 con 0x7f7cd00f6530 2022-02-02T20:04:48.357 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:04:48.357 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:04:48.358 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:04:48.358 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:04:48.358 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:48.358 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:04:48.359 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:04:48.359 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:04:48.359 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:04:48.360 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:04:48.360 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:04:48.360 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:04:48.361 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:04:48.361 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:04:48.361 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:04:48.362 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:04:48.362 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:04:48.362 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:04:48.362 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:04:48.363 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:04:48.363 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:04:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:04:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:04:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:04:48.364 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:04:48.365 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:04:48.365 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:04:48.365 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:04:48.365 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:04:48.366 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:04:48.366 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:04:48.366 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:04:48.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:48.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:48.367 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:04:48.368 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:04:48.368 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:48.368 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:48.369 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:04:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 msgr2=0x7f7cb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 0x7f7cb80672e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f7cc4004630 tx=0x7f7cc4009b30).stop 2022-02-02T20:04:48.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 msgr2=0x7f7cd006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:04:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f7cc0002700 tx=0x7f7cc0009d80).stop 2022-02-02T20:04:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 shutdown_connections 2022-02-02T20:04:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7cb8064e20 0x7f7cb80672e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cd00f6530 0x7f7cd006b9a0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 --2- 172.21.15.96:0/4140837078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cd00f77d0 0x7f7cd0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:04:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 >> 172.21.15.96:0/4140837078 conn(0x7f7cd00f1c90 msgr2=0x7f7cd00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:04:48.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 shutdown_connections 2022-02-02T20:04:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:04:48.355+0000 7f7ccf59e700 1 -- 172.21.15.96:0/4140837078 wait complete. 2022-02-02T20:04:48.373 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:04:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:48 smithi159 ceph-mon[69013]: from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:48 smithi159 ceph-mon[69013]: from='client.37274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:48.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2308434625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:04:48.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4140837078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:04:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:48 smithi096 ceph-mon[101353]: from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:48.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:48 smithi096 ceph-mon[101353]: from='client.37274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:04:48.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2308434625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:04:48.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4140837078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:04:49.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:49 smithi159 ceph-mon[69013]: pgmap v3082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:49.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:49 smithi096 ceph-mon[101353]: pgmap v3082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:52.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:51 smithi096 ceph-mon[101353]: pgmap v3083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:51 smithi159 ceph-mon[69013]: pgmap v3083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:53 smithi159 ceph-mon[69013]: pgmap v3084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:53 smithi096 ceph-mon[101353]: pgmap v3084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:55 smithi159 ceph-mon[69013]: pgmap v3085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:55 smithi096 ceph-mon[101353]: pgmap v3085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:57 smithi159 ceph-mon[69013]: pgmap v3086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:04:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:57 smithi096 ceph-mon[101353]: pgmap v3086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:04:59 smithi096 ceph-mon[101353]: pgmap v3087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:04:59 smithi159 ceph-mon[69013]: pgmap v3087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:02.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:01 smithi159 ceph-mon[69013]: pgmap v3088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:01 smithi096 ceph-mon[101353]: pgmap v3088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:03 smithi159 ceph-mon[69013]: pgmap v3089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:04.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:03 smithi096 ceph-mon[101353]: pgmap v3089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:05 smithi159 ceph-mon[69013]: pgmap v3090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:05 smithi096 ceph-mon[101353]: pgmap v3090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:07 smithi159 ceph-mon[69013]: pgmap v3091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:07 smithi096 ceph-mon[101353]: pgmap v3091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:09 smithi159 ceph-mon[69013]: pgmap v3092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:09 smithi096 ceph-mon[101353]: pgmap v3092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:11 smithi159 ceph-mon[69013]: pgmap v3093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:12.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:11 smithi096 ceph-mon[101353]: pgmap v3093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:13 smithi159 ceph-mon[69013]: pgmap v3094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:14.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:13 smithi096 ceph-mon[101353]: pgmap v3094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:15 smithi159 ceph-mon[69013]: pgmap v3095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:15 smithi096 ceph-mon[101353]: pgmap v3095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:17 smithi159 ceph-mon[69013]: pgmap v3096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:17.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:17 smithi096 ceph-mon[101353]: pgmap v3096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 -- 172.21.15.96:0/515281341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 msgr2=0x7f41f80f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/515281341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f80f81c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f41e8004660 tx=0x7f41e8009b30).stop 2022-02-02T20:05:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 -- 172.21.15.96:0/515281341 shutdown_connections 2022-02-02T20:05:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/515281341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 0x7f41f80f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/515281341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f80f81c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 -- 172.21.15.96:0/515281341 >> 172.21.15.96:0/515281341 conn(0x7f41f80f0540 msgr2=0x7f41f80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 -- 172.21.15.96:0/515281341 shutdown_connections 2022-02-02T20:05:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.465+0000 7f41fe1b6700 1 -- 172.21.15.96:0/515281341 wait complete. 2022-02-02T20:05:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.466+0000 7f41fe1b6700 1 Processor -- start 2022-02-02T20:05:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.466+0000 7f41fe1b6700 1 -- start start 2022-02-02T20:05:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41fe1b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41fe1b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 0x7f41f8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41fe1b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8107a10 con 0x7f41f80f7da0 2022-02-02T20:05:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41fe1b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8107b50 con 0x7f41f80f86b0 2022-02-02T20:05:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35098/0 (socket says 172.21.15.96:35098) 2022-02-02T20:05:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 -- 172.21.15.96:0/378350415 learned_addr learned my addr 172.21.15.96:0/378350415 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41eeffd700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 0x7f41f8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 -- 172.21.15.96:0/378350415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 msgr2=0x7f41f8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 0x7f41f8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 -- 172.21.15.96:0/378350415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8005040 con 0x7f41f80f7da0 2022-02-02T20:05:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f77fe700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f41e8009990 tx=0x7f41e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:18.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41e8018070 con 0x7f41f80f7da0 2022-02-02T20:05:18.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41e8007ba0 con 0x7f41f80f7da0 2022-02-02T20:05:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.467+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f8108490 con 0x7f41f80f7da0 2022-02-02T20:05:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.468+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41e801c3c0 con 0x7f41f80f7da0 2022-02-02T20:05:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.468+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81089f0 con 0x7f41f80f7da0 2022-02-02T20:05:18.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.468+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8045ad0 con 0x7f41f80f7da0 2022-02-02T20:05:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.469+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f41e801d420 con 0x7f41f80f7da0 2022-02-02T20:05:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.469+0000 7f41f4ff9700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 0x7f41e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.470+0000 7f41eeffd700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 0x7f41e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.470+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41e80836a0 con 0x7f41f80f7da0 2022-02-02T20:05:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.470+0000 7f41eeffd700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 0x7f41e4067290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f41e0004c40 tx=0x7f41e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.474+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41e8055290 con 0x7f41f80f7da0 2022-02-02T20:05:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.653+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41f8108c10 con 0x7f41e4064dd0 2022-02-02T20:05:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.654+0000 7f41f4ff9700 1 -- 172.21.15.96:0/378350415 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f41f8108c10 con 0x7f41e4064dd0 2022-02-02T20:05:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 msgr2=0x7f41e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 0x7f41e4067290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f41e0004c40 tx=0x7f41e000b040).stop 2022-02-02T20:05:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 msgr2=0x7f41f8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f41e8009990 tx=0x7f41e8009b30).stop 2022-02-02T20:05:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 shutdown_connections 2022-02-02T20:05:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41e4064dd0 0x7f41e4067290 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f80f7da0 0x7f41f8106f70 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 --2- 172.21.15.96:0/378350415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f80f86b0 0x7f41f8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 >> 172.21.15.96:0/378350415 conn(0x7f41f80f0540 msgr2=0x7f41f80fb630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 shutdown_connections 2022-02-02T20:05:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.656+0000 7f41fe1b6700 1 -- 172.21.15.96:0/378350415 wait complete. 2022-02-02T20:05:18.669 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:05:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 -- 172.21.15.96:0/2953875131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 msgr2=0x7fed240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 --2- 172.21.15.96:0/2953875131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed240f6950 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fed20004660 tx=0x7fed20009b30).stop 2022-02-02T20:05:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 -- 172.21.15.96:0/2953875131 shutdown_connections 2022-02-02T20:05:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 --2- 172.21.15.96:0/2953875131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 --2- 172.21.15.96:0/2953875131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed240f6950 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.753+0000 7fed2a628700 1 -- 172.21.15.96:0/2953875131 >> 172.21.15.96:0/2953875131 conn(0x7fed240f1c90 msgr2=0x7fed240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.754+0000 7fed2a628700 1 -- 172.21.15.96:0/2953875131 shutdown_connections 2022-02-02T20:05:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.754+0000 7fed2a628700 1 -- 172.21.15.96:0/2953875131 wait complete. 2022-02-02T20:05:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.754+0000 7fed2a628700 1 Processor -- start 2022-02-02T20:05:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.754+0000 7fed2a628700 1 -- start start 2022-02-02T20:05:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.754+0000 7fed2a628700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed24106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed2a628700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed241072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed2a628700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed241078f0 con 0x7fed240f6530 2022-02-02T20:05:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed2a628700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed24108100 con 0x7fed240f77d0 2022-02-02T20:05:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed28e25700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed241072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed28e25700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed241072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:39214/0 (socket says 172.21.15.96:39214) 2022-02-02T20:05:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed28e25700 1 -- 172.21.15.96:0/3900549746 learned_addr learned my addr 172.21.15.96:0/3900549746 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed29626700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed24106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed29626700 1 -- 172.21.15.96:0/3900549746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 msgr2=0x7fed241072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed29626700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed241072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed29626700 1 -- 172.21.15.96:0/3900549746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20005040 con 0x7fed240f6530 2022-02-02T20:05:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed29626700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed24106e00 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fed20000c00 tx=0x7fed20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20018070 con 0x7fed240f6530 2022-02-02T20:05:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed24108320 con 0x7fed240f6530 2022-02-02T20:05:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed200097d0 con 0x7fed240f6530 2022-02-02T20:05:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.755+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2001ddb0 con 0x7fed240f6530 2022-02-02T20:05:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.756+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed24108880 con 0x7fed240f6530 2022-02-02T20:05:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.757+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24059100 con 0x7fed240f6530 2022-02-02T20:05:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.757+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed20007ca0 con 0x7fed240f6530 2022-02-02T20:05:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.757+0000 7fed19ffb700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 0x7fed100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:18.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.757+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed20083540 con 0x7fed240f6530 2022-02-02T20:05:18.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.758+0000 7fed28e25700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 0x7fed100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:18.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.758+0000 7fed28e25700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 0x7fed100672e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fed140041d0 tx=0x7fed1400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.762+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed20051700 con 0x7fed240f6530 2022-02-02T20:05:18.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.936+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed240fecf0 con 0x7fed10064e20 2022-02-02T20:05:18.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.945+0000 7fed19ffb700 1 -- 172.21.15.96:0/3900549746 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fed240fecf0 con 0x7fed10064e20 2022-02-02T20:05:18.950 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:05:18.950 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (108m) 79m ago 109m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:05:18.951 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (101m) 79m ago 109m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:05:18.951 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (101m) 77m ago 109m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:05:18.952 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (108m) 79m ago 109m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:05:18.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (105m) 79m ago 105m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:05:18.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (101m) 79m ago 105m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:05:18.953 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (105m) 77m ago 105m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:05:18.953 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (101m) 77m ago 105m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:05:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (102m) 79m ago 110m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:05:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (102m) 77m ago 109m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:05:18.955 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (101m) 79m ago 110m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:05:18.956 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (101m) 77m ago 109m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:05:18.956 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (109m) 79m ago 109m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:05:18.957 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (109m) 77m ago 109m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:05:18.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (100m) 79m ago 108m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:05:18.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (100m) 79m ago 108m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:05:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (99m) 79m ago 107m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:05:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (99m) 77m ago 107m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:05:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (98m) 77m ago 107m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:05:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (98m) 77m ago 107m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:05:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (108m) 79m ago 109m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:05:18.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 msgr2=0x7fed100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 0x7fed100672e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fed140041d0 tx=0x7fed1400b040).stop 2022-02-02T20:05:18.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 msgr2=0x7fed24106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:18.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed24106e00 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fed20000c00 tx=0x7fed20009b30).stop 2022-02-02T20:05:18.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 shutdown_connections 2022-02-02T20:05:18.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed10064e20 0x7fed100672e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed240f6530 0x7fed24106e00 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 --2- 172.21.15.96:0/3900549746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed240f77d0 0x7fed241072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:18.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 >> 172.21.15.96:0/3900549746 conn(0x7fed240f1c90 msgr2=0x7fed240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:18.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 shutdown_connections 2022-02-02T20:05:18.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:18.947+0000 7fed2a628700 1 -- 172.21.15.96:0/3900549746 wait complete. 2022-02-02T20:05:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 -- 172.21.15.96:0/3801955110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f5430 msgr2=0x7f6f880f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 --2- 172.21.15.96:0/3801955110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f5430 0x7f6f880f5850 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f6f7c004660 tx=0x7f6f7c009b30).stop 2022-02-02T20:05:19.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 -- 172.21.15.96:0/3801955110 shutdown_connections 2022-02-02T20:05:19.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 --2- 172.21.15.96:0/3801955110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f66d0 0x7f6f880f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 --2- 172.21.15.96:0/3801955110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f5430 0x7f6f880f5850 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 -- 172.21.15.96:0/3801955110 >> 172.21.15.96:0/3801955110 conn(0x7f6f880f0b90 msgr2=0x7f6f880f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:19.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 -- 172.21.15.96:0/3801955110 shutdown_connections 2022-02-02T20:05:19.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.043+0000 7f6f8759e700 1 -- 172.21.15.96:0/3801955110 wait complete. 2022-02-02T20:05:19.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 Processor -- start 2022-02-02T20:05:19.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 -- start start 2022-02-02T20:05:19.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f5430 0x7f6f88109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880603e0 con 0x7f6f880f66d0 2022-02-02T20:05:19.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f8759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88060520 con 0x7f6f880f5430 2022-02-02T20:05:19.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f85d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.044+0000 7f6f85d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35120/0 (socket says 172.21.15.96:35120) 2022-02-02T20:05:19.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f85d9b700 1 -- 172.21.15.96:0/1659828427 learned_addr learned my addr 172.21.15.96:0/1659828427 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:19.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f8659c700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f5430 0x7f6f88109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f85d9b700 1 -- 172.21.15.96:0/1659828427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f5430 msgr2=0x7f6f88109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f85d9b700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f5430 0x7f6f88109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f85d9b700 1 -- 172.21.15.96:0/1659828427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c005040 con 0x7f6f880f66d0 2022-02-02T20:05:19.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f85d9b700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f6f780026d0 tx=0x7f6f78009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:19.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f780079c0 con 0x7f6f880f66d0 2022-02-02T20:05:19.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f7800f040 con 0x7f6f880f66d0 2022-02-02T20:05:19.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8810c540 con 0x7f6f880f66d0 2022-02-02T20:05:19.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f780148b0 con 0x7f6f880f66d0 2022-02-02T20:05:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.045+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810cb00 con 0x7f6f880f66d0 2022-02-02T20:05:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.046+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f88045ad0 con 0x7f6f880f66d0 2022-02-02T20:05:19.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.047+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f78007b20 con 0x7f6f880f66d0 2022-02-02T20:05:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.047+0000 7f6f76ffd700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 0x7f6f700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.047+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f78081900 con 0x7f6f880f66d0 2022-02-02T20:05:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.047+0000 7f6f8659c700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 0x7f6f700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.048+0000 7f6f8659c700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 0x7f6f700672e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f6f7c013690 tx=0x7f6f7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.051+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f7804fa00 con 0x7f6f880f66d0 2022-02-02T20:05:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.285+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f880fdcf0 con 0x7f6f880f66d0 2022-02-02T20:05:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.285+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1659828427 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6f78053020 con 0x7f6f880f66d0 2022-02-02T20:05:19.289 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:05:19.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:05:19.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:05:19.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:19.290 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:05:19.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:05:19.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:19.291 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:05:19.291 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:05:19.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:19.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:05:19.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:05:19.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:19.292 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:05:19.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:05:19.293 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:05:19.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:05:19.293 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:05:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 msgr2=0x7f6f700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 0x7f6f700672e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f6f7c013690 tx=0x7f6f7c009b30).stop 2022-02-02T20:05:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 msgr2=0x7f6f8810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f6f780026d0 tx=0x7f6f78009de0).stop 2022-02-02T20:05:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 shutdown_connections 2022-02-02T20:05:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f70064e20 0x7f6f700672e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f880f5430 0x7f6f88109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 --2- 172.21.15.96:0/1659828427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f880f66d0 0x7f6f8810bf90 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 >> 172.21.15.96:0/1659828427 conn(0x7f6f880f0b90 msgr2=0x7f6f880fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 shutdown_connections 2022-02-02T20:05:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.287+0000 7f6f8759e700 1 -- 172.21.15.96:0/1659828427 wait complete. 2022-02-02T20:05:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 -- 172.21.15.96:0/422632335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f77d0 msgr2=0x7f00700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 --2- 172.21.15.96:0/422632335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f77d0 0x7f00700f7c30 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f0064004660 tx=0x7f0064009b30).stop 2022-02-02T20:05:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 -- 172.21.15.96:0/422632335 shutdown_connections 2022-02-02T20:05:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 --2- 172.21.15.96:0/422632335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f77d0 0x7f00700f7c30 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 --2- 172.21.15.96:0/422632335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f6530 0x7f00700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 -- 172.21.15.96:0/422632335 >> 172.21.15.96:0/422632335 conn(0x7f00700f1c90 msgr2=0x7f00700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 -- 172.21.15.96:0/422632335 shutdown_connections 2022-02-02T20:05:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.385+0000 7f0075664700 1 -- 172.21.15.96:0/422632335 wait complete. 2022-02-02T20:05:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 Processor -- start 2022-02-02T20:05:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 -- start start 2022-02-02T20:05:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f77d0 0x7f0070069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007006a380 con 0x7f00700f6530 2022-02-02T20:05:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f0075664700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007006a4c0 con 0x7f00700f77d0 2022-02-02T20:05:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f006ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f006ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35128/0 (socket says 172.21.15.96:35128) 2022-02-02T20:05:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f006ffff700 1 -- 172.21.15.96:0/2317649629 learned_addr learned my addr 172.21.15.96:0/2317649629 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.386+0000 7f006f7fe700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f77d0 0x7f0070069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006ffff700 1 -- 172.21.15.96:0/2317649629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f77d0 msgr2=0x7f0070069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006ffff700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f77d0 0x7f0070069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006ffff700 1 -- 172.21.15.96:0/2317649629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064005040 con 0x7f00700f6530 2022-02-02T20:05:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006ffff700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f006000c530 tx=0x7f0060007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006000f650 con 0x7f00700f6530 2022-02-02T20:05:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f006000fc60 con 0x7f00700f6530 2022-02-02T20:05:19.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007006a7a0 con 0x7f00700f6530 2022-02-02T20:05:19.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0060012d20 con 0x7f00700f6530 2022-02-02T20:05:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.387+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007010ed50 con 0x7f00700f6530 2022-02-02T20:05:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.388+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070045ad0 con 0x7f00700f6530 2022-02-02T20:05:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.388+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0060019030 con 0x7f00700f6530 2022-02-02T20:05:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.389+0000 7f006cff9700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 0x7f00580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.389+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f00600816b0 con 0x7f00700f6530 2022-02-02T20:05:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.389+0000 7f006f7fe700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 0x7f00580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:19.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.389+0000 7f006f7fe700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 0x7f00580672e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0064004e30 tx=0x7f0064009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:19.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.393+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00600487d0 con 0x7f00700f6530 2022-02-02T20:05:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.593+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00700fedf0 con 0x7f00700f6530 2022-02-02T20:05:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.594+0000 7f006cff9700 1 -- 172.21.15.96:0/2317649629 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f006004f8c0 con 0x7f00700f6530 2022-02-02T20:05:19.598 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:05:19.598 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:05:19.599 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:05:19.599 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:05:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:19.600 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:05:19.600 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:05:19.601 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:05:19.601 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:05:19.601 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:05:19.601 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:05:19.602 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:05:19.602 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:05:19.602 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:05:19.602 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:05:19.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:05:19.603 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:05:19.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:05:19.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:05:19.603 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:05:19.604 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:05:19.604 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:05:19.604 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:05:19.604 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:05:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:05:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:05:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:05:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:05:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:05:19.606 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:05:19.607 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:05:19.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:05:19.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:19.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:19.608 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:05:19.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:19.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:19.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:19.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:19.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 msgr2=0x7f00580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 0x7f00580672e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0064004e30 tx=0x7f0064009b30).stop 2022-02-02T20:05:19.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 msgr2=0x7f007006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:19.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f006000c530 tx=0x7f0060007e10).stop 2022-02-02T20:05:19.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 shutdown_connections 2022-02-02T20:05:19.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0058064e20 0x7f00580672e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700f6530 0x7f007006b9a0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 --2- 172.21.15.96:0/2317649629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00700f77d0 0x7f0070069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:19.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 >> 172.21.15.96:0/2317649629 conn(0x7f00700f1c90 msgr2=0x7f00700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:19.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 shutdown_connections 2022-02-02T20:05:19.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:19.596+0000 7f0075664700 1 -- 172.21.15.96:0/2317649629 wait complete. 2022-02-02T20:05:19.613 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:05:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:19 smithi159 ceph-mon[69013]: from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:19 smithi159 ceph-mon[69013]: pgmap v3097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:19 smithi159 ceph-mon[69013]: from='client.37290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1659828427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:05:20.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2317649629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:05:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:19 smithi096 ceph-mon[101353]: from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:20.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:19 smithi096 ceph-mon[101353]: pgmap v3097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:19 smithi096 ceph-mon[101353]: from='client.37290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:20.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1659828427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:05:20.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2317649629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:05:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:21 smithi159 ceph-mon[69013]: pgmap v3098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:21 smithi096 ceph-mon[101353]: pgmap v3098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:23 smithi159 ceph-mon[69013]: pgmap v3099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:23 smithi096 ceph-mon[101353]: pgmap v3099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:25 smithi159 ceph-mon[69013]: pgmap v3100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:25 smithi096 ceph-mon[101353]: pgmap v3100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:27 smithi159 ceph-mon[69013]: pgmap v3101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:05:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:05:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:27 smithi096 ceph-mon[101353]: pgmap v3101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:05:27.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:05:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:29 smithi159 ceph-mon[69013]: pgmap v3102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:29 smithi096 ceph-mon[101353]: pgmap v3102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:32.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:31 smithi159 ceph-mon[69013]: pgmap v3103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:32.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:31 smithi096 ceph-mon[101353]: pgmap v3103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:34.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:33 smithi159 ceph-mon[69013]: pgmap v3104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:34.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:33 smithi096 ceph-mon[101353]: pgmap v3104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:35 smithi159 ceph-mon[69013]: pgmap v3105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:36.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:35 smithi096 ceph-mon[101353]: pgmap v3105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:37 smithi159 ceph-mon[69013]: pgmap v3106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:37.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:37 smithi096 ceph-mon[101353]: pgmap v3106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:39 smithi159 ceph-mon[69013]: pgmap v3107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:39 smithi096 ceph-mon[101353]: pgmap v3107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:41 smithi159 ceph-mon[69013]: pgmap v3108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:41 smithi096 ceph-mon[101353]: pgmap v3108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:43 smithi159 ceph-mon[69013]: pgmap v3109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:44.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:43 smithi096 ceph-mon[101353]: pgmap v3109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:45 smithi159 ceph-mon[69013]: pgmap v3110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:46.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:45 smithi096 ceph-mon[101353]: pgmap v3110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:47 smithi159 ceph-mon[69013]: pgmap v3111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:47 smithi096 ceph-mon[101353]: pgmap v3111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:49.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 -- 172.21.15.96:0/3763054381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 msgr2=0x7fd1140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:49.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 --2- 172.21.15.96:0/3763054381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd1140f6cc0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fd108004660 tx=0x7fd108009b30).stop 2022-02-02T20:05:49.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 -- 172.21.15.96:0/3763054381 shutdown_connections 2022-02-02T20:05:49.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 --2- 172.21.15.96:0/3763054381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd1140f6cc0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 --2- 172.21.15.96:0/3763054381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 0x7fd1140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 -- 172.21.15.96:0/3763054381 >> 172.21.15.96:0/3763054381 conn(0x7fd1140f0d40 msgr2=0x7fd1140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 -- 172.21.15.96:0/3763054381 shutdown_connections 2022-02-02T20:05:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.705+0000 7fd11a96d700 1 -- 172.21.15.96:0/3763054381 wait complete. 2022-02-02T20:05:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 Processor -- start 2022-02-02T20:05:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 -- start start 2022-02-02T20:05:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 0x7fd114109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140603c0 con 0x7fd1140f6860 2022-02-02T20:05:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.706+0000 7fd11a96d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd114060500 con 0x7fd1140f55c0 2022-02-02T20:05:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35148/0 (socket says 172.21.15.96:35148) 2022-02-02T20:05:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 -- 172.21.15.96:0/1148887838 learned_addr learned my addr 172.21.15.96:0/1148887838 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd113fff700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 0x7fd114109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 -- 172.21.15.96:0/1148887838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 msgr2=0x7fd114109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 0x7fd114109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 -- 172.21.15.96:0/1148887838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108005040 con 0x7fd1140f6860 2022-02-02T20:05:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd1137fe700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fd108009990 tx=0x7fd108009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd108018070 con 0x7fd1140f6860 2022-02-02T20:05:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11410c630 con 0x7fd1140f6860 2022-02-02T20:05:49.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd108007ba0 con 0x7fd1140f6860 2022-02-02T20:05:49.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11410cb60 con 0x7fd1140f6860 2022-02-02T20:05:49.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.707+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10801c3c0 con 0x7fd1140f6860 2022-02-02T20:05:49.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.708+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140f49b0 con 0x7fd1140f6860 2022-02-02T20:05:49.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.709+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd10801d420 con 0x7fd1140f6860 2022-02-02T20:05:49.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.709+0000 7fd110ff9700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:49.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.709+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1080836c0 con 0x7fd1140f6860 2022-02-02T20:05:49.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.709+0000 7fd113fff700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:49.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.710+0000 7fd113fff700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fd114060040 tx=0x7fd10400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:49.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.714+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd108051820 con 0x7fd1140f6860 2022-02-02T20:05:49.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.894+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1140fdec0 con 0x7fd0fc064dd0 2022-02-02T20:05:49.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.895+0000 7fd110ff9700 1 -- 172.21.15.96:0/1148887838 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd1140fdec0 con 0x7fd0fc064dd0 2022-02-02T20:05:49.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 msgr2=0x7fd0fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:49.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fd114060040 tx=0x7fd10400b040).stop 2022-02-02T20:05:49.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 msgr2=0x7fd11410c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:49.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fd108009990 tx=0x7fd108009b30).stop 2022-02-02T20:05:49.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 shutdown_connections 2022-02-02T20:05:49.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd0fc064dd0 0x7fd0fc067290 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140f55c0 0x7fd114109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 --2- 172.21.15.96:0/1148887838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1140f6860 0x7fd11410c0e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:49.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 >> 172.21.15.96:0/1148887838 conn(0x7fd1140f0d40 msgr2=0x7fd1140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:49.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 shutdown_connections 2022-02-02T20:05:49.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.897+0000 7fd11a96d700 1 -- 172.21.15.96:0/1148887838 wait complete. 2022-02-02T20:05:49.911 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:05:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 -- 172.21.15.96:0/36454460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 msgr2=0x7fd6a80f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/36454460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a80f7080 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fd698004660 tx=0x7fd698009b30).stop 2022-02-02T20:05:49.999 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:49 smithi096 ceph-mon[101353]: pgmap v3112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 -- 172.21.15.96:0/36454460 shutdown_connections 2022-02-02T20:05:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/36454460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 0x7fd6a80f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/36454460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a80f7080 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 -- 172.21.15.96:0/36454460 >> 172.21.15.96:0/36454460 conn(0x7fd6a80f04c0 msgr2=0x7fd6a80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 -- 172.21.15.96:0/36454460 shutdown_connections 2022-02-02T20:05:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 -- 172.21.15.96:0/36454460 wait complete. 2022-02-02T20:05:50.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.994+0000 7fd6af2bf700 1 Processor -- start 2022-02-02T20:05:50.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6af2bf700 1 -- start start 2022-02-02T20:05:50.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6af2bf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 0x7fd6a810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6af2bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6af2bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80f54f0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6af2bf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80f5630 con 0x7fd6a80f5970 2022-02-02T20:05:50.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35158/0 (socket says 172.21.15.96:35158) 2022-02-02T20:05:50.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 -- 172.21.15.96:0/3183720338 learned_addr learned my addr 172.21.15.96:0/3183720338 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 -- 172.21.15.96:0/3183720338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 msgr2=0x7fd6a810c050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T20:05:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ad05b700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 0x7fd6a810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 0x7fd6a810c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 -- 172.21.15.96:0/3183720338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698005040 con 0x7fd6a80f6c60 2022-02-02T20:05:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.995+0000 7fd6ac85a700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fd6a4002700 tx=0x7fd6a4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.996+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a4009320 con 0x7fd6a80f6c60 2022-02-02T20:05:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.996+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6a400f040 con 0x7fd6a80f6c60 2022-02-02T20:05:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.996+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a810ea40 con 0x7fd6a80f6c60 2022-02-02T20:05:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.996+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a4014820 con 0x7fd6a80f6c60 2022-02-02T20:05:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.996+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a810eec0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.997+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8045ad0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.997+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6a40077b0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.998+0000 7fd69dffb700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 0x7fd694067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.998+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd6a4081dd0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.998+0000 7fd6ad05b700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 0x7fd694067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:49.998+0000 7fd6ad05b700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 0x7fd694067290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fd698009da0 tx=0x7fd698009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.002+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6a404fed0 con 0x7fd6a80f6c60 2022-02-02T20:05:50.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.175+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6a8057f10 con 0x7fd694064dd0 2022-02-02T20:05:50.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.184+0000 7fd69dffb700 1 -- 172.21.15.96:0/3183720338 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fd6a8057f10 con 0x7fd694064dd0 2022-02-02T20:05:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:05:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (109m) 79m ago 110m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:05:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (101m) 79m ago 110m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:05:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (101m) 78m ago 109m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:05:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (109m) 79m ago 110m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:05:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (106m) 79m ago 106m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:05:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (101m) 79m ago 106m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:05:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (106m) 78m ago 106m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:05:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (102m) 78m ago 106m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:05:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (103m) 79m ago 111m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:05:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (102m) 78m ago 109m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:05:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (102m) 79m ago 111m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:05:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (102m) 78m ago 109m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:05:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (110m) 79m ago 110m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:05:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (109m) 78m ago 109m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:05:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (101m) 79m ago 109m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:05:50.193 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (100m) 79m ago 108m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:05:50.193 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (100m) 79m ago 108m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:05:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (99m) 78m ago 108m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:05:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (99m) 78m ago 107m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:05:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (98m) 78m ago 107m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:05:50.195 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (108m) 79m ago 109m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:05:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 msgr2=0x7fd694067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 0x7fd694067290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fd698009da0 tx=0x7fd698009b30).stop 2022-02-02T20:05:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 msgr2=0x7fd6a810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fd6a4002700 tx=0x7fd6a4009e00).stop 2022-02-02T20:05:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 shutdown_connections 2022-02-02T20:05:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd694064dd0 0x7fd694067290 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6a80f5970 0x7fd6a810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.186+0000 7fd6af2bf700 1 --2- 172.21.15.96:0/3183720338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6a80f6c60 0x7fd6a810e550 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.187+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 >> 172.21.15.96:0/3183720338 conn(0x7fd6a80f04c0 msgr2=0x7fd6a80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.187+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 shutdown_connections 2022-02-02T20:05:50.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.187+0000 7fd6af2bf700 1 -- 172.21.15.96:0/3183720338 wait complete. 2022-02-02T20:05:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:49 smithi159 ceph-mon[69013]: pgmap v3112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:50.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 -- 172.21.15.96:0/620068110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 msgr2=0x7fb8400f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 --2- 172.21.15.96:0/620068110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb8400f5df0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fb834004660 tx=0x7fb834009b30).stop 2022-02-02T20:05:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 -- 172.21.15.96:0/620068110 shutdown_connections 2022-02-02T20:05:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 --2- 172.21.15.96:0/620068110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb8400f5df0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 --2- 172.21.15.96:0/620068110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb8400f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 -- 172.21.15.96:0/620068110 >> 172.21.15.96:0/620068110 conn(0x7fb8400f04c0 msgr2=0x7fb8400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.283+0000 7fb845df3700 1 -- 172.21.15.96:0/620068110 shutdown_connections 2022-02-02T20:05:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.284+0000 7fb845df3700 1 -- 172.21.15.96:0/620068110 wait complete. 2022-02-02T20:05:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.284+0000 7fb845df3700 1 Processor -- start 2022-02-02T20:05:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb845df3700 1 -- start start 2022-02-02T20:05:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb845df3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb845df3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb84010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb845df3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400f5620 con 0x7fb8400f5970 2022-02-02T20:05:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb845df3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400f5760 con 0x7fb8400f6c60 2022-02-02T20:05:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35166/0 (socket says 172.21.15.96:35166) 2022-02-02T20:05:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 -- 172.21.15.96:0/2612512897 learned_addr learned my addr 172.21.15.96:0/2612512897 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83effd700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb84010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 -- 172.21.15.96:0/2612512897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 msgr2=0x7fb84010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb84010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 -- 172.21.15.96:0/2612512897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834005040 con 0x7fb8400f5970 2022-02-02T20:05:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83effd700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb84010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:05:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.285+0000 7fb83f7fe700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fb8300026d0 tx=0x7fb830009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.286+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb830009320 con 0x7fb8400f5970 2022-02-02T20:05:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.286+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84010c780 con 0x7fb8400f5970 2022-02-02T20:05:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.286+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb83000f040 con 0x7fb8400f5970 2022-02-02T20:05:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.286+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8300147e0 con 0x7fb8400f5970 2022-02-02T20:05:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.286+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84010cd40 con 0x7fb8400f5970 2022-02-02T20:05:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.287+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840045ad0 con 0x7fb8400f5970 2022-02-02T20:05:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.287+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb830009480 con 0x7fb8400f5970 2022-02-02T20:05:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.288+0000 7fb827fff700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 0x7fb828067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.288+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb830082120 con 0x7fb8400f5970 2022-02-02T20:05:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.288+0000 7fb83effd700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 0x7fb828067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.288+0000 7fb83effd700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 0x7fb828067290 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fb834004630 tx=0x7fb834009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.292+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb830050220 con 0x7fb8400f5970 2022-02-02T20:05:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.528+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8400fdf80 con 0x7fb8400f5970 2022-02-02T20:05:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.528+0000 7fb827fff700 1 -- 172.21.15.96:0/2612512897 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb830053840 con 0x7fb8400f5970 2022-02-02T20:05:50.533 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:05:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:05:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:05:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:05:50.534 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:05:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:05:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:05:50.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:05:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:05:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:05:50.536 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:05:50.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:05:50.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:05:50.537 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:05:50.537 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:05:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 msgr2=0x7fb828067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 0x7fb828067290 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fb834004630 tx=0x7fb834009b30).stop 2022-02-02T20:05:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 msgr2=0x7fb840109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fb8300026d0 tx=0x7fb830009de0).stop 2022-02-02T20:05:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 shutdown_connections 2022-02-02T20:05:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb828064dd0 0x7fb828067290 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8400f5970 0x7fb840109cd0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 --2- 172.21.15.96:0/2612512897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8400f6c60 0x7fb84010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.530+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 >> 172.21.15.96:0/2612512897 conn(0x7fb8400f04c0 msgr2=0x7fb8400fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.531+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 shutdown_connections 2022-02-02T20:05:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.531+0000 7fb845df3700 1 -- 172.21.15.96:0/2612512897 wait complete. 2022-02-02T20:05:50.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 -- 172.21.15.96:0/21693927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 msgr2=0x7fc2bc0f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 --2- 172.21.15.96:0/21693927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc0f5180 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7fc2b0004660 tx=0x7fc2b0009b30).stop 2022-02-02T20:05:50.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 -- 172.21.15.96:0/21693927 shutdown_connections 2022-02-02T20:05:50.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 --2- 172.21.15.96:0/21693927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc0f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 --2- 172.21.15.96:0/21693927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc0f5180 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 -- 172.21.15.96:0/21693927 >> 172.21.15.96:0/21693927 conn(0x7fc2bc0f04c0 msgr2=0x7fc2bc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 -- 172.21.15.96:0/21693927 shutdown_connections 2022-02-02T20:05:50.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.629+0000 7fc2c1536700 1 -- 172.21.15.96:0/21693927 wait complete. 2022-02-02T20:05:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 Processor -- start 2022-02-02T20:05:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 -- start start 2022-02-02T20:05:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0fbfd0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2c1536700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0fc110 con 0x7fc2bc0f5f60 2022-02-02T20:05:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35176/0 (socket says 172.21.15.96:35176) 2022-02-02T20:05:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 -- 172.21.15.96:0/2029168497 learned_addr learned my addr 172.21.15.96:0/2029168497 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:05:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2ba7fc700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 -- 172.21.15.96:0/2029168497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 msgr2=0x7fc2bc10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2baffd700 1 -- 172.21.15.96:0/2029168497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0005040 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.630+0000 7fc2ba7fc700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:05:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2baffd700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fc2b0009990 tx=0x7fc2b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b0018070 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2b0007ba0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc10c6e0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b001c3c0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.631+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc10cc10 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.632+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc0f4150 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.632+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2b001d420 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.633+0000 7fc2a37fe700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 0x7fc2a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:05:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.633+0000 7fc2ba7fc700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 0x7fc2a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:05:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.633+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2b0083740 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.633+0000 7fc2ba7fc700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 0x7fc2a4067290 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc2ac009740 tx=0x7fc2ac009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:05:50.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.637+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2b00517e0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.840+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2bc0fdee0 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.841+0000 7fc2a37fe700 1 -- 172.21.15.96:0/2029168497 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc2b0054e00 con 0x7fc2bc0f4d60 2022-02-02T20:05:50.847 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:05:50.847 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:05:50.848 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:05:50.848 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:05:50.849 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:05:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:05:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:05:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:05:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:05:50.852 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:05:50.852 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:05:50.852 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:05:50.852 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:05:50.853 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:05:50.853 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:05:50.853 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:05:50.853 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:05:50.854 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:05:50.854 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:05:50.854 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:05:50.854 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:05:50.855 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:05:50.855 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:05:50.855 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:05:50.855 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:05:50.855 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:05:50.856 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:05:50.856 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:05:50.856 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:05:50.856 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:05:50.857 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:05:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:50.857 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:50.857 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:05:50.858 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:05:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:05:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.842+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 msgr2=0x7fc2a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.842+0000 7fc2c1536700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 0x7fc2a4067290 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc2ac009740 tx=0x7fc2ac009be0).stop 2022-02-02T20:05:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 msgr2=0x7fc2bc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:05:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fc2b0009990 tx=0x7fc2b0009b30).stop 2022-02-02T20:05:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 shutdown_connections 2022-02-02T20:05:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2a4064dd0 0x7fc2a4067290 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2bc0f4d60 0x7fc2bc109c90 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 --2- 172.21.15.96:0/2029168497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2bc0f5f60 0x7fc2bc10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:05:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 >> 172.21.15.96:0/2029168497 conn(0x7fc2bc0f04c0 msgr2=0x7fc2bc0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:05:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 shutdown_connections 2022-02-02T20:05:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:05:50.843+0000 7fc2c1536700 1 -- 172.21.15.96:0/2029168497 wait complete. 2022-02-02T20:05:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:05:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:50 smithi096 ceph-mon[101353]: from='client.37302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:50 smithi096 ceph-mon[101353]: from='client.37306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:51.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2612512897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:05:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:50 smithi159 ceph-mon[69013]: from='client.37302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:51.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:50 smithi159 ceph-mon[69013]: from='client.37306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:05:51.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2612512897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:05:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:51 smithi159 ceph-mon[69013]: pgmap v3113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2029168497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:05:52.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:51 smithi096 ceph-mon[101353]: pgmap v3113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:52.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2029168497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:05:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:53 smithi159 ceph-mon[69013]: pgmap v3114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:53 smithi096 ceph-mon[101353]: pgmap v3114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:55 smithi159 ceph-mon[69013]: pgmap v3115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:55 smithi096 ceph-mon[101353]: pgmap v3115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:57 smithi159 ceph-mon[69013]: pgmap v3116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:05:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:57 smithi096 ceph-mon[101353]: pgmap v3116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:05:59 smithi159 ceph-mon[69013]: pgmap v3117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:05:59 smithi096 ceph-mon[101353]: pgmap v3117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:01 smithi159 ceph-mon[69013]: pgmap v3118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:01 smithi096 ceph-mon[101353]: pgmap v3118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:03 smithi159 ceph-mon[69013]: pgmap v3119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:04.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:03 smithi096 ceph-mon[101353]: pgmap v3119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:05 smithi159 ceph-mon[69013]: pgmap v3120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:06.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:05 smithi096 ceph-mon[101353]: pgmap v3120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:07 smithi159 ceph-mon[69013]: pgmap v3121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:07.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:07 smithi096 ceph-mon[101353]: pgmap v3121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:09 smithi159 ceph-mon[69013]: pgmap v3122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:10.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:09 smithi096 ceph-mon[101353]: pgmap v3122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:11 smithi159 ceph-mon[69013]: pgmap v3123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:12.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:11 smithi096 ceph-mon[101353]: pgmap v3123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:13 smithi159 ceph-mon[69013]: pgmap v3124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:13 smithi096 ceph-mon[101353]: pgmap v3124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:15 smithi159 ceph-mon[69013]: pgmap v3125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:15 smithi096 ceph-mon[101353]: pgmap v3125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:17 smithi159 ceph-mon[69013]: pgmap v3126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:17.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:17 smithi096 ceph-mon[101353]: pgmap v3126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:19 smithi159 ceph-mon[69013]: pgmap v3127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:19 smithi096 ceph-mon[101353]: pgmap v3127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:20.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/3199686649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 msgr2=0x7fd3ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:20.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/3199686649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac0f59e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fd39c004660 tx=0x7fd39c009b30).stop 2022-02-02T20:06:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/3199686649 shutdown_connections 2022-02-02T20:06:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/3199686649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/3199686649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac0f59e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/3199686649 >> 172.21.15.96:0/3199686649 conn(0x7fd3ac0f0d40 msgr2=0x7fd3ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/3199686649 shutdown_connections 2022-02-02T20:06:20.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.954+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/3199686649 wait complete. 2022-02-02T20:06:20.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 Processor -- start 2022-02-02T20:06:20.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 -- start start 2022-02-02T20:06:20.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac1069f0 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b3d1f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac1072a0 con 0x7fd3ac0f6860 2022-02-02T20:06:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b1abb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b1abb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35192/0 (socket says 172.21.15.96:35192) 2022-02-02T20:06:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.955+0000 7fd3b1abb700 1 -- 172.21.15.96:0/587395463 learned_addr learned my addr 172.21.15.96:0/587395463 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b12ba700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b1abb700 1 -- 172.21.15.96:0/587395463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 msgr2=0x7fd3ac1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b1abb700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b1abb700 1 -- 172.21.15.96:0/587395463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c005040 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b12ba700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:06:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b1abb700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd39c004f60 tx=0x7fd39c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39c018070 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac107520 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd39c007ba0 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39c01c620 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.956+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac107a80 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.957+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac0f49b0 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.958+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd39c01c8e0 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.958+0000 7fd3a27fc700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 0x7fd398067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.958+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd39c083960 con 0x7fd3ac0f55c0 2022-02-02T20:06:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.958+0000 7fd3b12ba700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 0x7fd398067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:20.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.959+0000 7fd3b12ba700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 0x7fd398067290 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fd3a800a7e0 tx=0x7fd3a8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:20.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:20.962+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd39c055490 con 0x7fd3ac0f55c0 2022-02-02T20:06:21.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.142+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3ac0fdec0 con 0x7fd398064dd0 2022-02-02T20:06:21.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.143+0000 7fd3a27fc700 1 -- 172.21.15.96:0/587395463 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd3ac0fdec0 con 0x7fd398064dd0 2022-02-02T20:06:21.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 msgr2=0x7fd398067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 0x7fd398067290 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fd3a800a7e0 tx=0x7fd3a8008040).stop 2022-02-02T20:06:21.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 msgr2=0x7fd3ac105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd39c004f60 tx=0x7fd39c009b30).stop 2022-02-02T20:06:21.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 shutdown_connections 2022-02-02T20:06:21.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd398064dd0 0x7fd398067290 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3ac0f55c0 0x7fd3ac105ec0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 --2- 172.21.15.96:0/587395463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3ac0f6860 0x7fd3ac1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 >> 172.21.15.96:0/587395463 conn(0x7fd3ac0f0d40 msgr2=0x7fd3ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 shutdown_connections 2022-02-02T20:06:21.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.145+0000 7fd3b3d1f700 1 -- 172.21.15.96:0/587395463 wait complete. 2022-02-02T20:06:21.158 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:06:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 -- 172.21.15.96:0/1228566791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f6860 msgr2=0x7f12280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1228566791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f6860 0x7f12280f6cc0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f1224004660 tx=0x7f1224009b30).stop 2022-02-02T20:06:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 -- 172.21.15.96:0/1228566791 shutdown_connections 2022-02-02T20:06:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1228566791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f6860 0x7f12280f6cc0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1228566791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f55c0 0x7f12280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 -- 172.21.15.96:0/1228566791 >> 172.21.15.96:0/1228566791 conn(0x7f12280f0d40 msgr2=0x7f12280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 -- 172.21.15.96:0/1228566791 shutdown_connections 2022-02-02T20:06:21.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 -- 172.21.15.96:0/1228566791 wait complete. 2022-02-02T20:06:21.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.243+0000 7f122f2c4700 1 Processor -- start 2022-02-02T20:06:21.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 -- start start 2022-02-02T20:06:21.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f6860 0x7f1228107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228107a10 con 0x7f12280f55c0 2022-02-02T20:06:21.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228107b50 con 0x7f12280f6860 2022-02-02T20:06:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35200/0 (socket says 172.21.15.96:35200) 2022-02-02T20:06:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 -- 172.21.15.96:0/1422570035 learned_addr learned my addr 172.21.15.96:0/1422570035 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122c85f700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f6860 0x7f1228107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 -- 172.21.15.96:0/1422570035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f6860 msgr2=0x7f1228107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f6860 0x7f1228107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 -- 172.21.15.96:0/1422570035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224005040 con 0x7f12280f55c0 2022-02-02T20:06:21.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122d060700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f121800c530 tx=0x7f1218007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121800f650 con 0x7f12280f55c0 2022-02-02T20:06:21.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12281084f0 con 0x7f12280f55c0 2022-02-02T20:06:21.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f121800fc60 con 0x7f12280f55c0 2022-02-02T20:06:21.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.244+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1218012d20 con 0x7f12280f55c0 2022-02-02T20:06:21.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.245+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228108ab0 con 0x7f12280f55c0 2022-02-02T20:06:21.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.246+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228045ad0 con 0x7f12280f55c0 2022-02-02T20:06:21.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.246+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1218019030 con 0x7f12280f55c0 2022-02-02T20:06:21.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.246+0000 7f121dffb700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 0x7f1214067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.246+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f12180816b0 con 0x7f12280f55c0 2022-02-02T20:06:21.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.246+0000 7f122c85f700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 0x7f1214067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.247+0000 7f122c85f700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 0x7f1214067290 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f1224004e30 tx=0x7f1224009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.251+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1218053230 con 0x7f12280f55c0 2022-02-02T20:06:21.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.423+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12280faca0 con 0x7f1214064dd0 2022-02-02T20:06:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.432+0000 7f121dffb700 1 -- 172.21.15.96:0/1422570035 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f12280faca0 con 0x7f1214064dd0 2022-02-02T20:06:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:06:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (109m) 80m ago 110m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:06:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (102m) 80m ago 110m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:06:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (102m) 78m ago 110m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:06:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (109m) 80m ago 110m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:06:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (106m) 80m ago 106m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:06:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (102m) 80m ago 106m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:06:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (106m) 78m ago 106m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:06:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (102m) 78m ago 106m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:06:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (103m) 80m ago 111m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:06:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (103m) 78m ago 110m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:06:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (103m) 80m ago 112m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:06:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (102m) 78m ago 110m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:06:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (110m) 80m ago 110m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:06:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (110m) 78m ago 110m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:06:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (101m) 80m ago 109m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:06:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (101m) 80m ago 109m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:06:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (100m) 80m ago 108m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:06:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (100m) 78m ago 108m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:06:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (99m) 78m ago 108m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:06:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (99m) 78m ago 108m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:06:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (109m) 80m ago 110m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:06:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 msgr2=0x7f1214067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 0x7f1214067290 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f1224004e30 tx=0x7f1224009b30).stop 2022-02-02T20:06:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 msgr2=0x7f1228106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f121800c530 tx=0x7f1218007e10).stop 2022-02-02T20:06:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 shutdown_connections 2022-02-02T20:06:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1214064dd0 0x7f1214067290 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12280f55c0 0x7f1228106f70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 --2- 172.21.15.96:0/1422570035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12280f6860 0x7f1228107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.434+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 >> 172.21.15.96:0/1422570035 conn(0x7f12280f0d40 msgr2=0x7f122805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.435+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 shutdown_connections 2022-02-02T20:06:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.435+0000 7f122f2c4700 1 -- 172.21.15.96:0/1422570035 wait complete. 2022-02-02T20:06:21.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- 172.21.15.96:0/3254035410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f5970 msgr2=0x7f5c200f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 --2- 172.21.15.96:0/3254035410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f5970 0x7f5c200f5df0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f5c10004660 tx=0x7f5c10009b30).stop 2022-02-02T20:06:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- 172.21.15.96:0/3254035410 shutdown_connections 2022-02-02T20:06:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 --2- 172.21.15.96:0/3254035410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f5970 0x7f5c200f5df0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 --2- 172.21.15.96:0/3254035410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f6c60 0x7f5c200f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- 172.21.15.96:0/3254035410 >> 172.21.15.96:0/3254035410 conn(0x7f5c200f04c0 msgr2=0x7f5c200f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- 172.21.15.96:0/3254035410 shutdown_connections 2022-02-02T20:06:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- 172.21.15.96:0/3254035410 wait complete. 2022-02-02T20:06:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 Processor -- start 2022-02-02T20:06:21.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.531+0000 7f5c24f19700 1 -- start start 2022-02-02T20:06:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 0x7f5c20104d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c20105860 con 0x7f5c200f6c60 2022-02-02T20:06:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201059a0 con 0x7f5c200f5970 2022-02-02T20:06:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35212/0 (socket says 172.21.15.96:35212) 2022-02-02T20:06:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 -- 172.21.15.96:0/2304286924 learned_addr learned my addr 172.21.15.96:0/2304286924 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1e59c700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 0x7f5c20104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 -- 172.21.15.96:0/2304286924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 msgr2=0x7f5c20104d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 0x7f5c20104d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 -- 172.21.15.96:0/2304286924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10005040 con 0x7f5c200f6c60 2022-02-02T20:06:21.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1e59c700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 0x7f5c20104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:06:21.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c1dd9b700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f5c10009990 tx=0x7f5c10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c10018070 con 0x7f5c200f6c60 2022-02-02T20:06:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c201062b0 con 0x7f5c200f6c60 2022-02-02T20:06:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c10007ba0 con 0x7f5c200f6c60 2022-02-02T20:06:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c1001c3c0 con 0x7f5c200f6c60 2022-02-02T20:06:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.532+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c20106810 con 0x7f5c200f6c60 2022-02-02T20:06:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.533+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c20045ad0 con 0x7f5c200f6c60 2022-02-02T20:06:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.534+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c1001d420 con 0x7f5c200f6c60 2022-02-02T20:06:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.534+0000 7f5c0effd700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 0x7f5c08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.534+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5c10083750 con 0x7f5c200f6c60 2022-02-02T20:06:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.534+0000 7f5c1e59c700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 0x7f5c08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.535+0000 7f5c1e59c700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 0x7f5c08067290 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f5c20104b00 tx=0x7f5c14009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.538+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c10051850 con 0x7f5c200f6c60 2022-02-02T20:06:21.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.767+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c201093f0 con 0x7f5c200f6c60 2022-02-02T20:06:21.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.768+0000 7f5c0effd700 1 -- 172.21.15.96:0/2304286924 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5c10054e70 con 0x7f5c200f6c60 2022-02-02T20:06:21.772 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:06:21.773 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:06:21.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:06:21.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:21.774 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:06:21.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:06:21.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:21.775 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:06:21.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:06:21.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:21.775 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:06:21.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:06:21.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:21.776 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:06:21.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:06:21.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:06:21.777 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:06:21.777 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:06:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 msgr2=0x7f5c08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 0x7f5c08067290 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f5c20104b00 tx=0x7f5c14009c00).stop 2022-02-02T20:06:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 msgr2=0x7f5c20105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f5c10009990 tx=0x7f5c10009b30).stop 2022-02-02T20:06:21.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 shutdown_connections 2022-02-02T20:06:21.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c08064dd0 0x7f5c08067290 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c200f5970 0x7f5c20104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 --2- 172.21.15.96:0/2304286924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c200f6c60 0x7f5c20105260 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 >> 172.21.15.96:0/2304286924 conn(0x7f5c200f04c0 msgr2=0x7f5c200f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 shutdown_connections 2022-02-02T20:06:21.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.769+0000 7f5c24f19700 1 -- 172.21.15.96:0/2304286924 wait complete. 2022-02-02T20:06:21.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 -- 172.21.15.96:0/1192260436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 msgr2=0x7f64f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1192260436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f40f6b00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f64e8004660 tx=0x7f64e8009b30).stop 2022-02-02T20:06:21.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 -- 172.21.15.96:0/1192260436 shutdown_connections 2022-02-02T20:06:21.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1192260436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 0x7f64f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1192260436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f40f6b00 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.867+0000 7f64f93a1700 1 -- 172.21.15.96:0/1192260436 >> 172.21.15.96:0/1192260436 conn(0x7f64f40f1e40 msgr2=0x7f64f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 -- 172.21.15.96:0/1192260436 shutdown_connections 2022-02-02T20:06:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 -- 172.21.15.96:0/1192260436 wait complete. 2022-02-02T20:06:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 Processor -- start 2022-02-02T20:06:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 -- start start 2022-02-02T20:06:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 0x7f64f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f406a380 con 0x7f64f40f66e0 2022-02-02T20:06:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.868+0000 7f64f93a1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f406a4c0 con 0x7f64f40f7980 2022-02-02T20:06:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35218/0 (socket says 172.21.15.96:35218) 2022-02-02T20:06:21.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 -- 172.21.15.96:0/1217505048 learned_addr learned my addr 172.21.15.96:0/1217505048 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:21.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f27fc700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 0x7f64f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 -- 172.21.15.96:0/1217505048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 msgr2=0x7f64f4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:21.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 0x7f64f4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:21.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 -- 172.21.15.96:0/1217505048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8005040 con 0x7f64f40f66e0 2022-02-02T20:06:21.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f2ffd700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f64e8013a70 tx=0x7f64e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e8018070 con 0x7f64f40f66e0 2022-02-02T20:06:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64e80097d0 con 0x7f64f40f66e0 2022-02-02T20:06:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f406a740 con 0x7f64f40f66e0 2022-02-02T20:06:21.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e801c3c0 con 0x7f64f40f66e0 2022-02-02T20:06:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.869+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f406aca0 con 0x7f64f40f66e0 2022-02-02T20:06:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.870+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f4045ad0 con 0x7f64f40f66e0 2022-02-02T20:06:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.871+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f64e8007ba0 con 0x7f64f40f66e0 2022-02-02T20:06:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.871+0000 7f64db7fe700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.871+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64e8083730 con 0x7f64f40f66e0 2022-02-02T20:06:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.871+0000 7f64f27fc700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.872+0000 7f64f27fc700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f64e4009760 tx=0x7f64e4009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:21.875+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f64e80518f0 con 0x7f64f40f66e0 2022-02-02T20:06:22.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.074+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64f40586e0 con 0x7f64f40f66e0 2022-02-02T20:06:22.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.075+0000 7f64db7fe700 1 -- 172.21.15.96:0/1217505048 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f64e8054f10 con 0x7f64f40f66e0 2022-02-02T20:06:22.078 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:06:22.079 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:06:22.079 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:06:22.079 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:06:22.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:22.080 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:06:22.080 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:06:22.080 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:06:22.081 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:06:22.081 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:06:22.081 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:06:22.082 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:06:22.082 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:06:22.082 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:06:22.082 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:06:22.082 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:06:22.083 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:06:22.083 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:06:22.083 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:06:22.083 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:06:22.084 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:06:22.084 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:06:22.084 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:06:22.084 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:06:22.084 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:06:22.085 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:06:22.085 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:06:22.085 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:06:22.085 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:06:22.086 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:06:22.086 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:06:22.086 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:06:22.086 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:22.086 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:22.087 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:06:22.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:22.087 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:22.087 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:22.088 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:22.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 msgr2=0x7f64dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:22.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f64e4009760 tx=0x7f64e4009c60).stop 2022-02-02T20:06:22.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 msgr2=0x7f64f406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:22.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f64e8013a70 tx=0x7f64e8009b30).stop 2022-02-02T20:06:22.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 shutdown_connections 2022-02-02T20:06:22.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:22.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f40f66e0 0x7f64f406b9a0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:22.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 --2- 172.21.15.96:0/1217505048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f40f7980 0x7f64f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:22.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.076+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 >> 172.21.15.96:0/1217505048 conn(0x7f64f40f1e40 msgr2=0x7f64f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:22.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.077+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 shutdown_connections 2022-02-02T20:06:22.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:22.077+0000 7f64f93a1700 1 -- 172.21.15.96:0/1217505048 wait complete. 2022-02-02T20:06:22.094 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:06:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:21 smithi159 ceph-mon[69013]: pgmap v3128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:21 smithi159 ceph-mon[69013]: from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2304286924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:06:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:21 smithi096 ceph-mon[101353]: pgmap v3128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:22.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:21 smithi096 ceph-mon[101353]: from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:22.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2304286924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:06:23.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:22 smithi096 ceph-mon[101353]: from='client.37322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:23.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1217505048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:06:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:22 smithi159 ceph-mon[69013]: from='client.37322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:23.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1217505048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:06:24.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:23 smithi159 ceph-mon[69013]: pgmap v3129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:23 smithi096 ceph-mon[101353]: pgmap v3129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:25 smithi159 ceph-mon[69013]: pgmap v3130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:25 smithi096 ceph-mon[101353]: pgmap v3130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:27 smithi159 ceph-mon[69013]: pgmap v3131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:06:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:06:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:27 smithi096 ceph-mon[101353]: pgmap v3131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:06:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:06:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:29 smithi159 ceph-mon[69013]: pgmap v3132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:29 smithi096 ceph-mon[101353]: pgmap v3132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:31 smithi159 ceph-mon[69013]: pgmap v3133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:31 smithi096 ceph-mon[101353]: pgmap v3133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:34.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:33 smithi159 ceph-mon[69013]: pgmap v3134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:33 smithi096 ceph-mon[101353]: pgmap v3134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:36.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:35 smithi159 ceph-mon[69013]: pgmap v3135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:35 smithi096 ceph-mon[101353]: pgmap v3135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:37 smithi159 ceph-mon[69013]: pgmap v3136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:37.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:37 smithi096 ceph-mon[101353]: pgmap v3136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:40.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:39 smithi159 ceph-mon[69013]: pgmap v3137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:40.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:39 smithi096 ceph-mon[101353]: pgmap v3137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:41 smithi159 ceph-mon[69013]: pgmap v3138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:41 smithi096 ceph-mon[101353]: pgmap v3138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:44.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:43 smithi159 ceph-mon[69013]: pgmap v3139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:43 smithi096 ceph-mon[101353]: pgmap v3139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:45 smithi159 ceph-mon[69013]: pgmap v3140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:45 smithi096 ceph-mon[101353]: pgmap v3140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:47 smithi159 ceph-mon[69013]: pgmap v3141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:47 smithi096 ceph-mon[101353]: pgmap v3141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:49 smithi159 ceph-mon[69013]: pgmap v3142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:49 smithi096 ceph-mon[101353]: pgmap v3142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 -- 172.21.15.96:0/2932737875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 msgr2=0x7f1b900f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 --2- 172.21.15.96:0/2932737875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b900f5df0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f1b78004660 tx=0x7f1b78009b30).stop 2022-02-02T20:06:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 -- 172.21.15.96:0/2932737875 shutdown_connections 2022-02-02T20:06:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 --2- 172.21.15.96:0/2932737875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b900f5df0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 --2- 172.21.15.96:0/2932737875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b900f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 -- 172.21.15.96:0/2932737875 >> 172.21.15.96:0/2932737875 conn(0x7f1b900f04c0 msgr2=0x7f1b900f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 -- 172.21.15.96:0/2932737875 shutdown_connections 2022-02-02T20:06:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.187+0000 7f1b96930700 1 -- 172.21.15.96:0/2932737875 wait complete. 2022-02-02T20:06:52.193 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:51 smithi096 ceph-mon[101353]: pgmap v3143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 Processor -- start 2022-02-02T20:06:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 -- start start 2022-02-02T20:06:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b9010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900f5660 con 0x7f1b900f5970 2022-02-02T20:06:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b96930700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900f57a0 con 0x7f1b900f6c60 2022-02-02T20:06:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b8ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b8ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35238/0 (socket says 172.21.15.96:35238) 2022-02-02T20:06:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b8ffff700 1 -- 172.21.15.96:0/415559271 learned_addr learned my addr 172.21.15.96:0/415559271 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.188+0000 7f1b87fff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b9010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8ffff700 1 -- 172.21.15.96:0/415559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 msgr2=0x7f1b9010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8ffff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b9010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8ffff700 1 -- 172.21.15.96:0/415559271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78005040 con 0x7f1b900f5970 2022-02-02T20:06:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b87fff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b9010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:06:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8ffff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f1b800026d0 tx=0x7f1b80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b80009320 con 0x7f1b900f5970 2022-02-02T20:06:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9010c7a0 con 0x7f1b900f5970 2022-02-02T20:06:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b8000f040 con 0x7f1b900f5970 2022-02-02T20:06:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b800147e0 con 0x7f1b900f5970 2022-02-02T20:06:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.189+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9010cd30 con 0x7f1b900f5970 2022-02-02T20:06:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.190+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b900f4150 con 0x7f1b900f5970 2022-02-02T20:06:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.190+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b80009480 con 0x7f1b900f5970 2022-02-02T20:06:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.191+0000 7f1b8d7fa700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 0x7f1b7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.191+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b80082140 con 0x7f1b900f5970 2022-02-02T20:06:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.191+0000 7f1b87fff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 0x7f1b7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.191+0000 7f1b87fff700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 0x7f1b7c067290 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f1b78004630 tx=0x7f1b78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.195+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b80050240 con 0x7f1b900f5970 2022-02-02T20:06:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:51 smithi159 ceph-mon[69013]: pgmap v3143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.374+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b900fdfb0 con 0x7f1b7c064dd0 2022-02-02T20:06:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.375+0000 7f1b8d7fa700 1 -- 172.21.15.96:0/415559271 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b900fdfb0 con 0x7f1b7c064dd0 2022-02-02T20:06:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 msgr2=0x7f1b7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 0x7f1b7c067290 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f1b78004630 tx=0x7f1b78009b30).stop 2022-02-02T20:06:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 msgr2=0x7f1b90109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f1b800026d0 tx=0x7f1b80009de0).stop 2022-02-02T20:06:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 shutdown_connections 2022-02-02T20:06:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b7c064dd0 0x7f1b7c067290 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b900f5970 0x7f1b90109c90 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 --2- 172.21.15.96:0/415559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b900f6c60 0x7f1b9010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 >> 172.21.15.96:0/415559271 conn(0x7f1b900f04c0 msgr2=0x7f1b900fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:52.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 shutdown_connections 2022-02-02T20:06:52.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.377+0000 7f1b96930700 1 -- 172.21.15.96:0/415559271 wait complete. 2022-02-02T20:06:52.390 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:06:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 -- 172.21.15.96:0/1644465395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 msgr2=0x7f00fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 --2- 172.21.15.96:0/1644465395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f59e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f00ec004660 tx=0x7f00ec009b30).stop 2022-02-02T20:06:52.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 -- 172.21.15.96:0/1644465395 shutdown_connections 2022-02-02T20:06:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 --2- 172.21.15.96:0/1644465395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 0x7f00fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 --2- 172.21.15.96:0/1644465395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f59e0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 -- 172.21.15.96:0/1644465395 >> 172.21.15.96:0/1644465395 conn(0x7f00fc0f0d20 msgr2=0x7f00fc0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 -- 172.21.15.96:0/1644465395 shutdown_connections 2022-02-02T20:06:52.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.475+0000 7f0103a98700 1 -- 172.21.15.96:0/1644465395 wait complete. 2022-02-02T20:06:52.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 Processor -- start 2022-02-02T20:06:52.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 -- start start 2022-02-02T20:06:52.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 0x7f00fc0f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0f8920 con 0x7f00fc0f55c0 2022-02-02T20:06:52.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0103a98700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0f8a60 con 0x7f00fc0f6860 2022-02-02T20:06:52.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0101834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0101834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35248/0 (socket says 172.21.15.96:35248) 2022-02-02T20:06:52.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0101834700 1 -- 172.21.15.96:0/1824353872 learned_addr learned my addr 172.21.15.96:0/1824353872 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.476+0000 7f0101033700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 0x7f00fc0f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0101834700 1 -- 172.21.15.96:0/1824353872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 msgr2=0x7f00fc0f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0101834700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 0x7f00fc0f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0101834700 1 -- 172.21.15.96:0/1824353872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec005040 con 0x7f00fc0f55c0 2022-02-02T20:06:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0101834700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f00ec004f60 tx=0x7f00ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ec018070 con 0x7f00fc0f55c0 2022-02-02T20:06:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00ec007ba0 con 0x7f00fc0f55c0 2022-02-02T20:06:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ec01c620 con 0x7f00fc0f55c0 2022-02-02T20:06:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc0f8ce0 con 0x7f00fc0f55c0 2022-02-02T20:06:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.477+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc0f9240 con 0x7f00fc0f55c0 2022-02-02T20:06:52.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.478+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc045ad0 con 0x7f00fc0f55c0 2022-02-02T20:06:52.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.479+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f00ec01d420 con 0x7f00fc0f55c0 2022-02-02T20:06:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.480+0000 7f00f27fc700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 0x7f00e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.480+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f00ec083d50 con 0x7f00fc0f55c0 2022-02-02T20:06:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.480+0000 7f0101033700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 0x7f00e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.480+0000 7f0101033700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 0x7f00e8067290 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f00f80041d0 tx=0x7f00f8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.483+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00ec051d90 con 0x7f00fc0f55c0 2022-02-02T20:06:52.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.658+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f00fc05fe90 con 0x7f00e8064dd0 2022-02-02T20:06:52.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.667+0000 7f00f27fc700 1 -- 172.21.15.96:0/1824353872 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f00fc05fe90 con 0x7f00e8064dd0 2022-02-02T20:06:52.671 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:06:52.671 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (110m) 80m ago 111m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:06:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (102m) 80m ago 111m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:06:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (102m) 79m ago 110m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:06:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (110m) 80m ago 111m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:06:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (107m) 80m ago 107m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:06:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (102m) 80m ago 107m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:06:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (107m) 79m ago 107m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:06:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (103m) 79m ago 107m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:06:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (104m) 80m ago 112m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:06:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (104m) 79m ago 110m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:06:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (103m) 80m ago 112m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:06:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (103m) 79m ago 110m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:06:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (111m) 80m ago 111m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:06:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (110m) 79m ago 110m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:06:52.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (102m) 80m ago 110m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:06:52.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (101m) 80m ago 109m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:06:52.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (101m) 80m ago 109m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:06:52.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (100m) 79m ago 109m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:06:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (100m) 79m ago 108m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:06:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (99m) 79m ago 108m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:06:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (110m) 80m ago 110m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:06:52.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 msgr2=0x7f00e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 0x7f00e8067290 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f00f80041d0 tx=0x7f00f8009040).stop 2022-02-02T20:06:52.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 msgr2=0x7f00fc0f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f00ec004f60 tx=0x7f00ec009b30).stop 2022-02-02T20:06:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 shutdown_connections 2022-02-02T20:06:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00e8064dd0 0x7f00e8067290 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00fc0f55c0 0x7f00fc0f9f40 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 --2- 172.21.15.96:0/1824353872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc0f6860 0x7f00fc0f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 >> 172.21.15.96:0/1824353872 conn(0x7f00fc0f0d20 msgr2=0x7f00fc05f780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 shutdown_connections 2022-02-02T20:06:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.669+0000 7f0103a98700 1 -- 172.21.15.96:0/1824353872 wait complete. 2022-02-02T20:06:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 -- 172.21.15.96:0/483150047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 msgr2=0x7ffbc00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 --2- 172.21.15.96:0/483150047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc00f6950 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7ffbb0004660 tx=0x7ffbb0009b30).stop 2022-02-02T20:06:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 -- 172.21.15.96:0/483150047 shutdown_connections 2022-02-02T20:06:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 --2- 172.21.15.96:0/483150047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbc00f77d0 0x7ffbc00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 --2- 172.21.15.96:0/483150047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc00f6950 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 -- 172.21.15.96:0/483150047 >> 172.21.15.96:0/483150047 conn(0x7ffbc00f1c90 msgr2=0x7ffbc00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 -- 172.21.15.96:0/483150047 shutdown_connections 2022-02-02T20:06:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.765+0000 7ffbc5119700 1 -- 172.21.15.96:0/483150047 wait complete. 2022-02-02T20:06:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 Processor -- start 2022-02-02T20:06:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 -- start start 2022-02-02T20:06:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbc00f77d0 0x7ffbc01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01078f0 con 0x7ffbc00f6530 2022-02-02T20:06:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbc5119700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0108100 con 0x7ffbc00f77d0 2022-02-02T20:06:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35258/0 (socket says 172.21.15.96:35258) 2022-02-02T20:06:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.766+0000 7ffbbffff700 1 -- 172.21.15.96:0/723720019 learned_addr learned my addr 172.21.15.96:0/723720019 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbffff700 1 -- 172.21.15.96:0/723720019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbc00f77d0 msgr2=0x7ffbc01072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbffff700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbc00f77d0 0x7ffbc01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbffff700 1 -- 172.21.15.96:0/723720019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0005040 con 0x7ffbc00f6530 2022-02-02T20:06:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbffff700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7ffbb0013a70 tx=0x7ffbb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb0018070 con 0x7ffbc00f6530 2022-02-02T20:06:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffbb00097d0 con 0x7ffbc00f6530 2022-02-02T20:06:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc0108320 con 0x7ffbc00f6530 2022-02-02T20:06:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb001c3c0 con 0x7ffbc00f6530 2022-02-02T20:06:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.767+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc0108880 con 0x7ffbc00f6530 2022-02-02T20:06:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.768+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0059100 con 0x7ffbc00f6530 2022-02-02T20:06:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.768+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffbb0007ba0 con 0x7ffbc00f6530 2022-02-02T20:06:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.769+0000 7ffbbcff9700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 0x7ffbac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.769+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffbb0083640 con 0x7ffbc00f6530 2022-02-02T20:06:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.769+0000 7ffbbf7fe700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 0x7ffbac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.769+0000 7ffbbf7fe700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 0x7ffbac0672e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7ffba8004a10 tx=0x7ffba80099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:52.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:52.773+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffbb0051800 con 0x7ffbc00f6530 2022-02-02T20:06:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.004+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffbc00fedc0 con 0x7ffbc00f6530 2022-02-02T20:06:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.004+0000 7ffbbcff9700 1 -- 172.21.15.96:0/723720019 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ffbb0054e20 con 0x7ffbc00f6530 2022-02-02T20:06:53.008 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:06:53.008 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:06:53.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:06:53.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:53.009 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:06:53.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:06:53.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:53.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:06:53.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:06:53.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:53.010 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:06:53.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:06:53.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:06:53.011 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:06:53.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:06:53.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:06:53.011 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:06:53.012 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:06:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 msgr2=0x7ffbac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 0x7ffbac0672e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7ffba8004a10 tx=0x7ffba80099e0).stop 2022-02-02T20:06:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 msgr2=0x7ffbc0106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7ffbb0013a70 tx=0x7ffbb0009b30).stop 2022-02-02T20:06:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 shutdown_connections 2022-02-02T20:06:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbac064e20 0x7ffbac0672e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbc00f6530 0x7ffbc0106e00 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 --2- 172.21.15.96:0/723720019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbc00f77d0 0x7ffbc01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 >> 172.21.15.96:0/723720019 conn(0x7ffbc00f1c90 msgr2=0x7ffbc00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 shutdown_connections 2022-02-02T20:06:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.006+0000 7ffbc5119700 1 -- 172.21.15.96:0/723720019 wait complete. 2022-02-02T20:06:53.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:52 smithi096 ceph-mon[101353]: from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- 172.21.15.96:0/3372361266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f6860 msgr2=0x7f02b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 --2- 172.21.15.96:0/3372361266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f6860 0x7f02b00f6cc0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f02ac004660 tx=0x7f02ac009b30).stop 2022-02-02T20:06:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- 172.21.15.96:0/3372361266 shutdown_connections 2022-02-02T20:06:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 --2- 172.21.15.96:0/3372361266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f6860 0x7f02b00f6cc0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 --2- 172.21.15.96:0/3372361266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b00f55c0 0x7f02b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- 172.21.15.96:0/3372361266 >> 172.21.15.96:0/3372361266 conn(0x7f02b00f0d40 msgr2=0x7f02b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- 172.21.15.96:0/3372361266 shutdown_connections 2022-02-02T20:06:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- 172.21.15.96:0/3372361266 wait complete. 2022-02-02T20:06:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 Processor -- start 2022-02-02T20:06:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.106+0000 7f02b83f3700 1 -- start start 2022-02-02T20:06:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b00f6860 0x7f02b010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00602b0 con 0x7f02b00f55c0 2022-02-02T20:06:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00603f0 con 0x7f02b00f6860 2022-02-02T20:06:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35266/0 (socket says 172.21.15.96:35266) 2022-02-02T20:06:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 -- 172.21.15.96:0/4099841730 learned_addr learned my addr 172.21.15.96:0/4099841730 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:06:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 -- 172.21.15.96:0/4099841730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b00f6860 msgr2=0x7f02b010e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b00f6860 0x7f02b010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 -- 172.21.15.96:0/4099841730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac005040 con 0x7f02b00f55c0 2022-02-02T20:06:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b618f700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f02a00093f0 tx=0x7f02a0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a0009ea0 con 0x7f02b00f55c0 2022-02-02T20:06:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02a0013af0 con 0x7f02b00f55c0 2022-02-02T20:06:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b010eac0 con 0x7f02b00f55c0 2022-02-02T20:06:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a000db10 con 0x7f02b00f55c0 2022-02-02T20:06:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.107+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b010efa0 con 0x7f02b00f55c0 2022-02-02T20:06:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.108+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0045ad0 con 0x7f02b00f55c0 2022-02-02T20:06:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.109+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f02a001a060 con 0x7f02b00f55c0 2022-02-02T20:06:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.109+0000 7f02a6ffd700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 0x7f029c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:06:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.109+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02a0081a90 con 0x7f02b00f55c0 2022-02-02T20:06:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.109+0000 7f02b598e700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 0x7f029c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:06:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.109+0000 7f02b598e700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 0x7f029c067290 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f02ac004e30 tx=0x7f02ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:06:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.113+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02a004fb90 con 0x7f02b00f55c0 2022-02-02T20:06:53.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:52 smithi159 ceph-mon[69013]: from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:53.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.316+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02b0060580 con 0x7f02b00f55c0 2022-02-02T20:06:53.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.316+0000 7f02a6ffd700 1 -- 172.21.15.96:0/4099841730 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f02a0018020 con 0x7f02b00f55c0 2022-02-02T20:06:53.320 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:06:53.320 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:06:53.321 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:06:53.321 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:06:53.321 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:53.321 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:06:53.322 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:06:53.322 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:06:53.322 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:06:53.322 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:06:53.322 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:06:53.323 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:06:53.323 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:06:53.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:06:53.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:06:53.324 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:06:53.324 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:06:53.325 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:06:53.325 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:06:53.325 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:06:53.325 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:06:53.326 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:06:53.326 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:06:53.326 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:06:53.326 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:06:53.327 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:06:53.327 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:06:53.327 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:06:53.328 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:06:53.328 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:06:53.328 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:06:53.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:06:53.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:53.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:53.329 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:06:53.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:06:53.330 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:53.330 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:53.330 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:06:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 msgr2=0x7f029c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 0x7f029c067290 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f02ac004e30 tx=0x7f02ac009b30).stop 2022-02-02T20:06:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 msgr2=0x7f02b010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:06:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f02a00093f0 tx=0x7f02a0006ec0).stop 2022-02-02T20:06:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 shutdown_connections 2022-02-02T20:06:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f029c064dd0 0x7f029c067290 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b00f55c0 0x7f02b010c0d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:06:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 --2- 172.21.15.96:0/4099841730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b00f6860 0x7f02b010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:06:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 >> 172.21.15.96:0/4099841730 conn(0x7f02b00f0d40 msgr2=0x7f02b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:06:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 shutdown_connections 2022-02-02T20:06:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:06:53.318+0000 7f02b83f3700 1 -- 172.21.15.96:0/4099841730 wait complete. 2022-02-02T20:06:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:06:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:53 smithi159 ceph-mon[69013]: from='client.37338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:53 smithi159 ceph-mon[69013]: pgmap v3144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/723720019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:06:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4099841730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:06:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:53 smithi096 ceph-mon[101353]: from='client.37338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:06:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:53 smithi096 ceph-mon[101353]: pgmap v3144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/723720019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:06:54.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4099841730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:06:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:55 smithi159 ceph-mon[69013]: pgmap v3145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:55 smithi096 ceph-mon[101353]: pgmap v3145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:57.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:57 smithi159 ceph-mon[69013]: pgmap v3146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:06:57.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:57 smithi096 ceph-mon[101353]: pgmap v3146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:00.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:06:59 smithi159 ceph-mon[69013]: pgmap v3147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:00.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:06:59 smithi096 ceph-mon[101353]: pgmap v3147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:02.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:01 smithi159 ceph-mon[69013]: pgmap v3148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:01 smithi096 ceph-mon[101353]: pgmap v3148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:03 smithi159 ceph-mon[69013]: pgmap v3149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:03 smithi096 ceph-mon[101353]: pgmap v3149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:05 smithi159 ceph-mon[69013]: pgmap v3150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:05 smithi096 ceph-mon[101353]: pgmap v3150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:07.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:07 smithi159 ceph-mon[69013]: pgmap v3151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:07 smithi096 ceph-mon[101353]: pgmap v3151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:09 smithi159 ceph-mon[69013]: pgmap v3152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:09 smithi096 ceph-mon[101353]: pgmap v3152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:12.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:11 smithi159 ceph-mon[69013]: pgmap v3153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:11 smithi096 ceph-mon[101353]: pgmap v3153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:13 smithi159 ceph-mon[69013]: pgmap v3154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:13 smithi096 ceph-mon[101353]: pgmap v3154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:15 smithi159 ceph-mon[69013]: pgmap v3155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:15 smithi096 ceph-mon[101353]: pgmap v3155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:17.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:17 smithi159 ceph-mon[69013]: pgmap v3156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:17 smithi096 ceph-mon[101353]: pgmap v3156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:20.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:19 smithi159 ceph-mon[69013]: pgmap v3157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:19 smithi096 ceph-mon[101353]: pgmap v3157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:21 smithi159 ceph-mon[69013]: pgmap v3158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:21 smithi096 ceph-mon[101353]: pgmap v3158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:23.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 -- 172.21.15.96:0/3458524175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f66e0 msgr2=0x7f82500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 --2- 172.21.15.96:0/3458524175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f66e0 0x7f82500f6b00 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f8240004660 tx=0x7f8240009b30).stop 2022-02-02T20:07:23.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 -- 172.21.15.96:0/3458524175 shutdown_connections 2022-02-02T20:07:23.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 --2- 172.21.15.96:0/3458524175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f7980 0x7f82500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:07:23.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 --2- 172.21.15.96:0/3458524175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f66e0 0x7f82500f6b00 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 -- 172.21.15.96:0/3458524175 >> 172.21.15.96:0/3458524175 conn(0x7f82500f1e40 msgr2=0x7f82500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:23.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 -- 172.21.15.96:0/3458524175 shutdown_connections 2022-02-02T20:07:23.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.429+0000 7f82574b1700 1 -- 172.21.15.96:0/3458524175 wait complete. 2022-02-02T20:07:23.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 Processor -- start 2022-02-02T20:07:23.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 -- start start 2022-02-02T20:07:23.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 0x7f825006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825006a410 con 0x7f82500f7980 2022-02-02T20:07:23.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f82574b1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825006a550 con 0x7f82500f66e0 2022-02-02T20:07:23.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f8254a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f8254a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35286/0 (socket says 172.21.15.96:35286) 2022-02-02T20:07:23.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.430+0000 7f8254a4c700 1 -- 172.21.15.96:0/1373637877 learned_addr learned my addr 172.21.15.96:0/1373637877 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:23.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f825524d700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 0x7f825006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8254a4c700 1 -- 172.21.15.96:0/1373637877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 msgr2=0x7f825006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8254a4c700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 0x7f825006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8254a4c700 1 -- 172.21.15.96:0/1373637877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240005040 con 0x7f82500f7980 2022-02-02T20:07:23.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f825524d700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 0x7f825006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:07:23.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8254a4c700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f824c00b410 tx=0x7f824c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:23.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f824c0125f0 con 0x7f82500f7980 2022-02-02T20:07:23.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f824c012c00 con 0x7f82500f7980 2022-02-02T20:07:23.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825006a830 con 0x7f82500f7980 2022-02-02T20:07:23.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f824c002ae0 con 0x7f82500f7980 2022-02-02T20:07:23.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.431+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825010efe0 con 0x7f82500f7980 2022-02-02T20:07:23.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.432+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250045ad0 con 0x7f82500f7980 2022-02-02T20:07:23.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.433+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f824c00f030 con 0x7f82500f7980 2022-02-02T20:07:23.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.433+0000 7f8245ffb700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 0x7f823c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.433+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f824c081f10 con 0x7f82500f7980 2022-02-02T20:07:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.433+0000 7f825524d700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 0x7f823c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.433+0000 7f825524d700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 0x7f823c067270 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f8240009830 tx=0x7f8240009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.437+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f824c050010 con 0x7f82500f7980 2022-02-02T20:07:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.617+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82500ff0d0 con 0x7f823c064db0 2022-02-02T20:07:23.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.618+0000 7f8245ffb700 1 -- 172.21.15.96:0/1373637877 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8240013410 con 0x7f823c064db0 2022-02-02T20:07:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 msgr2=0x7f823c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 0x7f823c067270 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f8240009830 tx=0x7f8240009b30).stop 2022-02-02T20:07:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 msgr2=0x7f8250069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f824c00b410 tx=0x7f824c006ef0).stop 2022-02-02T20:07:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 shutdown_connections 2022-02-02T20:07:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f823c064db0 0x7f823c067270 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500f66e0 0x7f825006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 --2- 172.21.15.96:0/1373637877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500f7980 0x7f8250069e20 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 >> 172.21.15.96:0/1373637877 conn(0x7f82500f1e40 msgr2=0x7f82500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:23.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 shutdown_connections 2022-02-02T20:07:23.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.621+0000 7f82574b1700 1 -- 172.21.15.96:0/1373637877 wait complete. 2022-02-02T20:07:23.634 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:07:23.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 -- 172.21.15.96:0/4283264980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 msgr2=0x7fdc240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/4283264980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc240f7c30 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7fdc10004660 tx=0x7fdc10009b30).stop 2022-02-02T20:07:23.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 -- 172.21.15.96:0/4283264980 shutdown_connections 2022-02-02T20:07:23.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/4283264980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc240f7c30 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/4283264980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 -- 172.21.15.96:0/4283264980 >> 172.21.15.96:0/4283264980 conn(0x7fdc240f1c90 msgr2=0x7fdc240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 -- 172.21.15.96:0/4283264980 shutdown_connections 2022-02-02T20:07:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.717+0000 7fdc29f9b700 1 -- 172.21.15.96:0/4283264980 wait complete. 2022-02-02T20:07:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 Processor -- start 2022-02-02T20:07:23.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 -- start start 2022-02-02T20:07:23.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc2406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406a110 con 0x7fdc240f77d0 2022-02-02T20:07:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc29f9b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406a250 con 0x7fdc240f6530 2022-02-02T20:07:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35296/0 (socket says 172.21.15.96:35296) 2022-02-02T20:07:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.718+0000 7fdc23fff700 1 -- 172.21.15.96:0/461193535 learned_addr learned my addr 172.21.15.96:0/461193535 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:23.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc28f99700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc2406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc23fff700 1 -- 172.21.15.96:0/461193535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 msgr2=0x7fdc2406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc23fff700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc2406b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc23fff700 1 -- 172.21.15.96:0/461193535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10005040 con 0x7fdc240f77d0 2022-02-02T20:07:23.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc28f99700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc2406b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:07:23.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc23fff700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7fdc10009990 tx=0x7fdc10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:23.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc10018070 con 0x7fdc240f77d0 2022-02-02T20:07:23.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2406a440 con 0x7fdc240f77d0 2022-02-02T20:07:23.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2406a9a0 con 0x7fdc240f77d0 2022-02-02T20:07:23.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc10007ca0 con 0x7fdc240f77d0 2022-02-02T20:07:23.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.719+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc1001c620 con 0x7fdc240f77d0 2022-02-02T20:07:23.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.720+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04004fa0 con 0x7fdc240f77d0 2022-02-02T20:07:23.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.720+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc1001c890 con 0x7fdc240f77d0 2022-02-02T20:07:23.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.721+0000 7fdc217fa700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 0x7fdc140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:23.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.721+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc100836a0 con 0x7fdc240f77d0 2022-02-02T20:07:23.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.721+0000 7fdc28f99700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 0x7fdc140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:23.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.721+0000 7fdc28f99700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 0x7fdc140672e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fdc18007fd0 tx=0x7fdc18009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:23.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.726+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc10051860 con 0x7fdc240f77d0 2022-02-02T20:07:23.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.897+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc04000bc0 con 0x7fdc14064e20 2022-02-02T20:07:23.902 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:23 smithi096 ceph-mon[101353]: pgmap v3159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:23.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.908+0000 7fdc217fa700 1 -- 172.21.15.96:0/461193535 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fdc04000bc0 con 0x7fdc14064e20 2022-02-02T20:07:23.911 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:07:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (110m) 81m ago 111m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:07:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (103m) 81m ago 111m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:07:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (103m) 79m ago 111m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:07:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (110m) 81m ago 111m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:07:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (107m) 81m ago 107m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:07:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (103m) 81m ago 107m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:07:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (107m) 79m ago 107m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:07:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (103m) 79m ago 107m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:07:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (105m) 81m ago 112m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:07:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (104m) 79m ago 111m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:07:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (104m) 81m ago 113m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:07:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (103m) 79m ago 111m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:07:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (111m) 81m ago 111m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:07:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (111m) 79m ago 111m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:07:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (102m) 81m ago 110m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:07:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (102m) 81m ago 110m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:07:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (101m) 81m ago 110m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:07:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (101m) 79m ago 109m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:07:23.916 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (100m) 79m ago 109m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:07:23.916 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (100m) 79m ago 109m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:07:23.919 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (110m) 81m ago 111m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:07:23.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 msgr2=0x7fdc140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 0x7fdc140672e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fdc18007fd0 tx=0x7fdc18009040).stop 2022-02-02T20:07:23.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 msgr2=0x7fdc2406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7fdc10009990 tx=0x7fdc10009b30).stop 2022-02-02T20:07:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 shutdown_connections 2022-02-02T20:07:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc14064e20 0x7fdc140672e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc240f6530 0x7fdc2406b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 --2- 172.21.15.96:0/461193535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc240f77d0 0x7fdc2406b9c0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 >> 172.21.15.96:0/461193535 conn(0x7fdc240f1c90 msgr2=0x7fdc240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 shutdown_connections 2022-02-02T20:07:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:23.910+0000 7fdc29f9b700 1 -- 172.21.15.96:0/461193535 wait complete. 2022-02-02T20:07:24.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 -- 172.21.15.96:0/3787273230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f7590 msgr2=0x7f67340f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 --2- 172.21.15.96:0/3787273230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f7590 0x7f67340f59b0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f671c004660 tx=0x7f671c009b30).stop 2022-02-02T20:07:24.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 -- 172.21.15.96:0/3787273230 shutdown_connections 2022-02-02T20:07:24.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 --2- 172.21.15.96:0/3787273230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f7590 0x7f67340f59b0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 --2- 172.21.15.96:0/3787273230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f6bf0 0x7f67340f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:07:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 -- 172.21.15.96:0/3787273230 >> 172.21.15.96:0/3787273230 conn(0x7f67340f04c0 msgr2=0x7f67340f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 -- 172.21.15.96:0/3787273230 shutdown_connections 2022-02-02T20:07:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 -- 172.21.15.96:0/3787273230 wait complete. 2022-02-02T20:07:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.006+0000 7f673a9ac700 1 Processor -- start 2022-02-02T20:07:24.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f673a9ac700 1 -- start start 2022-02-02T20:07:24.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f673a9ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f673a9ac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f7590 0x7f6734107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f673a9ac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734107b60 con 0x7f67340f6bf0 2022-02-02T20:07:24.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f673a9ac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734108410 con 0x7f67340f7590 2022-02-02T20:07:24.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35304/0 (socket says 172.21.15.96:35304) 2022-02-02T20:07:24.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 -- 172.21.15.96:0/1896476390 learned_addr learned my addr 172.21.15.96:0/1896476390 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:24.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f67337fe700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f7590 0x7f6734107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 -- 172.21.15.96:0/1896476390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f7590 msgr2=0x7f6734107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f7590 0x7f6734107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 -- 172.21.15.96:0/1896476390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c005040 con 0x7f67340f6bf0 2022-02-02T20:07:24.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6733fff700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f67240093f0 tx=0x7f6724006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:24.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.007+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6724009ea0 con 0x7f67340f6bf0 2022-02-02T20:07:24.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.008+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67341086f0 con 0x7f67340f6bf0 2022-02-02T20:07:24.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.008+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6724013af0 con 0x7f67340f6bf0 2022-02-02T20:07:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.008+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f672400db10 con 0x7f67340f6bf0 2022-02-02T20:07:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.008+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734108cb0 con 0x7f67340f6bf0 2022-02-02T20:07:24.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.008+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67340f4150 con 0x7f67340f6bf0 2022-02-02T20:07:24.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.009+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f672401a060 con 0x7f67340f6bf0 2022-02-02T20:07:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.009+0000 7f6730ff9700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 0x7f6720067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.009+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6724081aa0 con 0x7f67340f6bf0 2022-02-02T20:07:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.009+0000 7f67337fe700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 0x7f6720067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.010+0000 7f67337fe700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 0x7f6720067290 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f671c004e30 tx=0x7f671c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.014+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f67240535d0 con 0x7f67340f6bf0 2022-02-02T20:07:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.245+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f673410d650 con 0x7f67340f6bf0 2022-02-02T20:07:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.245+0000 7f6730ff9700 1 -- 172.21.15.96:0/1896476390 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6724018070 con 0x7f67340f6bf0 2022-02-02T20:07:24.251 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:07:24.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:07:24.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:07:24.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:24.252 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:07:24.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:07:24.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:24.254 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:07:24.254 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:07:24.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:24.255 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:07:24.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:07:24.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:24.256 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:07:24.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:07:24.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:07:24.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:07:24.258 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:07:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 msgr2=0x7f6720067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 0x7f6720067290 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f671c004e30 tx=0x7f671c009b30).stop 2022-02-02T20:07:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 msgr2=0x7f6734107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f67240093f0 tx=0x7f6724006ec0).stop 2022-02-02T20:07:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 shutdown_connections 2022-02-02T20:07:24.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6720064dd0 0x7f6720067290 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67340f6bf0 0x7f6734107030 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.248+0000 7f673a9ac700 1 --2- 172.21.15.96:0/1896476390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67340f7590 0x7f6734107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.249+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 >> 172.21.15.96:0/1896476390 conn(0x7f67340f04c0 msgr2=0x7f67340f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.249+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 shutdown_connections 2022-02-02T20:07:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.249+0000 7f673a9ac700 1 -- 172.21.15.96:0/1896476390 wait complete. 2022-02-02T20:07:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:23 smithi159 ceph-mon[69013]: pgmap v3159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:24.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 -- 172.21.15.96:0/1905344739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 msgr2=0x7f9da00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 --2- 172.21.15.96:0/1905344739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da00f6b30 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f9d90004660 tx=0x7f9d90009b30).stop 2022-02-02T20:07:24.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 -- 172.21.15.96:0/1905344739 shutdown_connections 2022-02-02T20:07:24.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 --2- 172.21.15.96:0/1905344739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da00f6b30 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 --2- 172.21.15.96:0/1905344739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:07:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 -- 172.21.15.96:0/1905344739 >> 172.21.15.96:0/1905344739 conn(0x7f9da00f0b90 msgr2=0x7f9da00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 -- 172.21.15.96:0/1905344739 shutdown_connections 2022-02-02T20:07:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.346+0000 7f9da4987700 1 -- 172.21.15.96:0/1905344739 wait complete. 2022-02-02T20:07:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 Processor -- start 2022-02-02T20:07:24.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 -- start start 2022-02-02T20:07:24.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da010be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00602d0 con 0x7f9da00f66d0 2022-02-02T20:07:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9da4987700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0060410 con 0x7f9da00f5430 2022-02-02T20:07:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35316/0 (socket says 172.21.15.96:35316) 2022-02-02T20:07:24.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.347+0000 7f9d9e59c700 1 -- 172.21.15.96:0/247968310 learned_addr learned my addr 172.21.15.96:0/247968310 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:24.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9ed9d700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da010be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9e59c700 1 -- 172.21.15.96:0/247968310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 msgr2=0x7f9da010be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9e59c700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da010be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9e59c700 1 -- 172.21.15.96:0/247968310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90005040 con 0x7f9da00f66d0 2022-02-02T20:07:24.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9ed9d700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:07:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d9e59c700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f9d90009da0 tx=0x7f9d90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d90018070 con 0x7f9da00f66d0 2022-02-02T20:07:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d90007d70 con 0x7f9da00f66d0 2022-02-02T20:07:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da010e880 con 0x7f9da00f66d0 2022-02-02T20:07:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9001dea0 con 0x7f9da00f66d0 2022-02-02T20:07:24.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.348+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da010ecb0 con 0x7f9da00f66d0 2022-02-02T20:07:24.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.349+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0045ad0 con 0x7f9da00f66d0 2022-02-02T20:07:24.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.349+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9d9001d420 con 0x7f9da00f66d0 2022-02-02T20:07:24.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.350+0000 7f9d977fe700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 0x7f9d8c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:24.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.350+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9d90083930 con 0x7f9da00f66d0 2022-02-02T20:07:24.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.350+0000 7f9d9ed9d700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 0x7f9d8c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:24.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.350+0000 7f9d9ed9d700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 0x7f9d8c0672e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f9da0060060 tx=0x7f9d88008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:24.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.354+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9d90051a30 con 0x7f9da00f66d0 2022-02-02T20:07:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.554+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9da00586e0 con 0x7f9da00f66d0 2022-02-02T20:07:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.554+0000 7f9d977fe700 1 -- 172.21.15.96:0/247968310 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9d90055050 con 0x7f9da00f66d0 2022-02-02T20:07:24.558 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:07:24.558 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:07:24.558 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:07:24.558 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:07:24.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:24.559 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:07:24.559 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:07:24.559 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:07:24.560 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:07:24.560 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:07:24.560 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:07:24.560 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:07:24.560 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:07:24.561 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:07:24.561 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:07:24.561 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:07:24.562 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:07:24.562 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:07:24.562 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:07:24.562 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:07:24.563 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:07:24.563 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:07:24.563 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:07:24.563 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:07:24.563 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:07:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:07:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:07:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:07:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:07:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:07:24.565 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:07:24.565 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:07:24.565 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:24.565 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:24.566 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:07:24.566 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:24.566 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:24.566 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:24.566 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 msgr2=0x7f9d8c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 0x7f9d8c0672e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f9da0060060 tx=0x7f9d88008040).stop 2022-02-02T20:07:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 msgr2=0x7f9da010e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:24.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f9d90009da0 tx=0x7f9d90009b30).stop 2022-02-02T20:07:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 shutdown_connections 2022-02-02T20:07:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d8c064e20 0x7f9d8c0672e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da00f5430 0x7f9da010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 --2- 172.21.15.96:0/247968310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9da00f66d0 0x7f9da010e390 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:24.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 >> 172.21.15.96:0/247968310 conn(0x7f9da00f0b90 msgr2=0x7f9da00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 shutdown_connections 2022-02-02T20:07:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:24.556+0000 7f9da4987700 1 -- 172.21.15.96:0/247968310 wait complete. 2022-02-02T20:07:24.570 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:07:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:24 smithi159 ceph-mon[69013]: from='client.37350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:24 smithi159 ceph-mon[69013]: from='client.37354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1896476390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:07:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/247968310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:07:25.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:24 smithi096 ceph-mon[101353]: from='client.37350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:24 smithi096 ceph-mon[101353]: from='client.37354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1896476390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:07:25.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/247968310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:07:26.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:25 smithi159 ceph-mon[69013]: pgmap v3160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:25 smithi096 ceph-mon[101353]: pgmap v3160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:27 smithi159 ceph-mon[69013]: pgmap v3161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:07:27.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:07:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:27 smithi096 ceph-mon[101353]: pgmap v3161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:07:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:07:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:29 smithi159 ceph-mon[69013]: pgmap v3162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:29 smithi096 ceph-mon[101353]: pgmap v3162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:31 smithi159 ceph-mon[69013]: pgmap v3163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:32.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:31 smithi096 ceph-mon[101353]: pgmap v3163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:34.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:33 smithi159 ceph-mon[69013]: pgmap v3164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:33 smithi096 ceph-mon[101353]: pgmap v3164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:35 smithi159 ceph-mon[69013]: pgmap v3165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:35 smithi096 ceph-mon[101353]: pgmap v3165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:37 smithi159 ceph-mon[69013]: pgmap v3166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:37 smithi096 ceph-mon[101353]: pgmap v3166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:39 smithi159 ceph-mon[69013]: pgmap v3167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:39 smithi096 ceph-mon[101353]: pgmap v3167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:41 smithi159 ceph-mon[69013]: pgmap v3168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:42.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:41 smithi096 ceph-mon[101353]: pgmap v3168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:43 smithi159 ceph-mon[69013]: pgmap v3169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:43 smithi096 ceph-mon[101353]: pgmap v3169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:46.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:45 smithi159 ceph-mon[69013]: pgmap v3170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:45 smithi096 ceph-mon[101353]: pgmap v3170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:47 smithi159 ceph-mon[69013]: pgmap v3171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:47 smithi096 ceph-mon[101353]: pgmap v3171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:50.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:49 smithi159 ceph-mon[69013]: pgmap v3172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:49 smithi096 ceph-mon[101353]: pgmap v3172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:51 smithi159 ceph-mon[69013]: pgmap v3173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:51 smithi096 ceph-mon[101353]: pgmap v3173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:53 smithi159 ceph-mon[69013]: pgmap v3174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:53 smithi096 ceph-mon[101353]: pgmap v3174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:54.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 -- 172.21.15.96:0/150717088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f6860 msgr2=0x7fb2f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 --2- 172.21.15.96:0/150717088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f6860 0x7fb2f80f6cc0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fb2f4004660 tx=0x7fb2f4009b30).stop 2022-02-02T20:07:54.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 -- 172.21.15.96:0/150717088 shutdown_connections 2022-02-02T20:07:54.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 --2- 172.21.15.96:0/150717088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f6860 0x7fb2f80f6cc0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 --2- 172.21.15.96:0/150717088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f55c0 0x7fb2f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 -- 172.21.15.96:0/150717088 >> 172.21.15.96:0/150717088 conn(0x7fb2f80f0d40 msgr2=0x7fb2f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:54.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 -- 172.21.15.96:0/150717088 shutdown_connections 2022-02-02T20:07:54.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 -- 172.21.15.96:0/150717088 wait complete. 2022-02-02T20:07:54.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.666+0000 7fb3004e8700 1 Processor -- start 2022-02-02T20:07:54.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb3004e8700 1 -- start start 2022-02-02T20:07:54.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb3004e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb3004e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 0x7fb2f810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb3004e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8060420 con 0x7fb2f80f55c0 2022-02-02T20:07:54.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb3004e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8060560 con 0x7fb2f80f6860 2022-02-02T20:07:54.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35332/0 (socket says 172.21.15.96:35332) 2022-02-02T20:07:54.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 -- 172.21.15.96:0/606629686 learned_addr learned my addr 172.21.15.96:0/606629686 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:54.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fda83700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 0x7fb2f810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 -- 172.21.15.96:0/606629686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 msgr2=0x7fb2f810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 0x7fb2f810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 -- 172.21.15.96:0/606629686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4005040 con 0x7fb2f80f55c0 2022-02-02T20:07:54.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fda83700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 0x7fb2f810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:07:54.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.667+0000 7fb2fe284700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fb2e8002700 tx=0x7fb2e8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:54.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.668+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8009320 con 0x7fb2f80f55c0 2022-02-02T20:07:54.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.668+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f810c720 con 0x7fb2f80f55c0 2022-02-02T20:07:54.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.668+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2e800f040 con 0x7fb2f80f55c0 2022-02-02T20:07:54.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.668+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8014900 con 0x7fb2f80f55c0 2022-02-02T20:07:54.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.668+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f810ccb0 con 0x7fb2f80f55c0 2022-02-02T20:07:54.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.669+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f8045ad0 con 0x7fb2f80f55c0 2022-02-02T20:07:54.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.670+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2e8009480 con 0x7fb2f80f55c0 2022-02-02T20:07:54.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.670+0000 7fb2eeffd700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 0x7fb2e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.670+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb2e8082170 con 0x7fb2f80f55c0 2022-02-02T20:07:54.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.670+0000 7fb2fda83700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 0x7fb2e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.671+0000 7fb2fda83700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 0x7fb2e4067290 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fb2f4004630 tx=0x7fb2f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:54.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.674+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2e80503e0 con 0x7fb2f80f55c0 2022-02-02T20:07:54.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.852+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2f8057f10 con 0x7fb2e4064dd0 2022-02-02T20:07:54.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.853+0000 7fb2eeffd700 1 -- 172.21.15.96:0/606629686 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb2f8057f10 con 0x7fb2e4064dd0 2022-02-02T20:07:54.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 msgr2=0x7fb2e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 0x7fb2e4067290 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fb2f4004630 tx=0x7fb2f4009b30).stop 2022-02-02T20:07:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 msgr2=0x7fb2f8109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fb2e8002700 tx=0x7fb2e8009d80).stop 2022-02-02T20:07:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 shutdown_connections 2022-02-02T20:07:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2e4064dd0 0x7fb2e4067290 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f80f55c0 0x7fb2f8109c10 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 --2- 172.21.15.96:0/606629686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2f80f6860 0x7fb2f810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 >> 172.21.15.96:0/606629686 conn(0x7fb2f80f0d40 msgr2=0x7fb2f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 shutdown_connections 2022-02-02T20:07:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.855+0000 7fb3004e8700 1 -- 172.21.15.96:0/606629686 wait complete. 2022-02-02T20:07:54.869 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:07:54.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.953+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/4108445886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f55c0 msgr2=0x7f0bd40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.953+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/4108445886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f55c0 0x7f0bd40f59e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f0bd0004660 tx=0x7f0bd0009b30).stop 2022-02-02T20:07:54.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/4108445886 shutdown_connections 2022-02-02T20:07:54.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/4108445886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f6860 0x7f0bd40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/4108445886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f55c0 0x7f0bd40f59e0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/4108445886 >> 172.21.15.96:0/4108445886 conn(0x7f0bd40f0d40 msgr2=0x7f0bd40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:54.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/4108445886 shutdown_connections 2022-02-02T20:07:54.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.954+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/4108445886 wait complete. 2022-02-02T20:07:54.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 Processor -- start 2022-02-02T20:07:54.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 -- start start 2022-02-02T20:07:54.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f55c0 0x7f0bd4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40603e0 con 0x7f0bd40f6860 2022-02-02T20:07:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bdbe7e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4060520 con 0x7f0bd40f55c0 2022-02-02T20:07:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bd9419700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bd9419700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35344/0 (socket says 172.21.15.96:35344) 2022-02-02T20:07:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bd9419700 1 -- 172.21.15.96:0/2983858667 learned_addr learned my addr 172.21.15.96:0/2983858667 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.955+0000 7f0bd9c1a700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f55c0 0x7f0bd4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bd9419700 1 -- 172.21.15.96:0/2983858667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f55c0 msgr2=0x7f0bd4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bd9419700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f55c0 0x7f0bd4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bd9419700 1 -- 172.21.15.96:0/2983858667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0005040 con 0x7f0bd40f6860 2022-02-02T20:07:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bd9419700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f0bc400c530 tx=0x7f0bc4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc400f650 con 0x7f0bd40f6860 2022-02-02T20:07:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0bc400fc60 con 0x7f0bd40f6860 2022-02-02T20:07:54.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd410c720 con 0x7f0bd40f6860 2022-02-02T20:07:54.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc4012cd0 con 0x7f0bd40f6860 2022-02-02T20:07:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.956+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd410cce0 con 0x7f0bd40f6860 2022-02-02T20:07:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.957+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd4045ad0 con 0x7f0bd40f6860 2022-02-02T20:07:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.957+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0bc4010070 con 0x7f0bd40f6860 2022-02-02T20:07:54.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.958+0000 7f0bca7fc700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 0x7f0bc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:54.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.958+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0bc40817c0 con 0x7f0bd40f6860 2022-02-02T20:07:54.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.958+0000 7f0bd9c1a700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 0x7f0bc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:54.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.958+0000 7f0bd9c1a700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 0x7f0bc0067290 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f0bd0004e30 tx=0x7f0bd0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:54.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:54.962+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0bc404f8c0 con 0x7f0bd40f6860 2022-02-02T20:07:55.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.135+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bd40008d0 con 0x7f0bc0064dd0 2022-02-02T20:07:55.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.144+0000 7f0bca7fc700 1 -- 172.21.15.96:0/2983858667 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f0bd40008d0 con 0x7f0bc0064dd0 2022-02-02T20:07:55.148 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:07:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (111m) 81m ago 112m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:07:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (103m) 81m ago 112m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:07:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (103m) 80m ago 111m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:07:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (111m) 81m ago 112m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:07:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (108m) 81m ago 108m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:07:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (104m) 81m ago 108m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:07:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (108m) 80m ago 108m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:07:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (104m) 80m ago 108m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:07:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (105m) 81m ago 113m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:07:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (105m) 80m ago 111m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:07:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (104m) 81m ago 113m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:07:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (104m) 80m ago 111m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:07:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (112m) 81m ago 112m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:07:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (111m) 80m ago 111m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:07:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (103m) 81m ago 111m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:07:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (102m) 81m ago 110m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:07:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (102m) 81m ago 110m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:07:55.153 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (101m) 80m ago 110m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:07:55.153 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (101m) 80m ago 109m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:07:55.153 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (100m) 80m ago 109m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:07:55.153 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (111m) 81m ago 111m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:07:55.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 msgr2=0x7f0bc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 0x7f0bc0067290 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f0bd0004e30 tx=0x7f0bd0009b30).stop 2022-02-02T20:07:55.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 msgr2=0x7f0bd410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f0bc400c530 tx=0x7f0bc4007e20).stop 2022-02-02T20:07:55.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 shutdown_connections 2022-02-02T20:07:55.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc0064dd0 0x7f0bc0067290 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd40f55c0 0x7f0bd4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 --2- 172.21.15.96:0/2983858667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bd40f6860 0x7f0bd410c170 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 >> 172.21.15.96:0/2983858667 conn(0x7f0bd40f0d40 msgr2=0x7f0bd40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:55.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 shutdown_connections 2022-02-02T20:07:55.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.146+0000 7f0bdbe7e700 1 -- 172.21.15.96:0/2983858667 wait complete. 2022-02-02T20:07:55.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.242+0000 7f80b51b7700 1 -- 172.21.15.96:0/1901178606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 msgr2=0x7f80b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.242+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1901178606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b00f6cc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f80a0004660 tx=0x7f80a0009b30).stop 2022-02-02T20:07:55.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- 172.21.15.96:0/1901178606 shutdown_connections 2022-02-02T20:07:55.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1901178606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b00f6cc0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1901178606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- 172.21.15.96:0/1901178606 >> 172.21.15.96:0/1901178606 conn(0x7f80b00f0d40 msgr2=0x7f80b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:55.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- 172.21.15.96:0/1901178606 shutdown_connections 2022-02-02T20:07:55.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- 172.21.15.96:0/1901178606 wait complete. 2022-02-02T20:07:55.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 Processor -- start 2022-02-02T20:07:55.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- start start 2022-02-02T20:07:55.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b0109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00603e0 con 0x7f80b00f6860 2022-02-02T20:07:55.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.243+0000 7f80b51b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0060520 con 0x7f80b00f55c0 2022-02-02T20:07:55.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35352/0 (socket says 172.21.15.96:35352) 2022-02-02T20:07:55.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 -- 172.21.15.96:0/1343730970 learned_addr learned my addr 172.21.15.96:0/1343730970 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:55.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80aed9d700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b0109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 -- 172.21.15.96:0/1343730970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 msgr2=0x7f80b0109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b0109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 -- 172.21.15.96:0/1343730970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0005040 con 0x7f80b00f6860 2022-02-02T20:07:55.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80aed9d700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:07:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80ae59c700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f80a0009990 tx=0x7f80a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a0018070 con 0x7f80b00f6860 2022-02-02T20:07:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80a0007ba0 con 0x7f80b00f6860 2022-02-02T20:07:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b010c6a0 con 0x7f80b00f6860 2022-02-02T20:07:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b010cc00 con 0x7f80b00f6860 2022-02-02T20:07:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.244+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a001c3c0 con 0x7f80b00f6860 2022-02-02T20:07:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.245+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8090004fa0 con 0x7f80b00f6860 2022-02-02T20:07:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.246+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80a001c680 con 0x7f80b00f6860 2022-02-02T20:07:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.246+0000 7f80977fe700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 0x7f8098067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.246+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80a00836e0 con 0x7f80b00f6860 2022-02-02T20:07:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.246+0000 7f80aed9d700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 0x7f8098067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.247+0000 7f80aed9d700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 0x7f8098067290 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f80b0060060 tx=0x7f80a4009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:55.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.250+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80a0052840 con 0x7f80b00f6860 2022-02-02T20:07:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.484+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8090005e80 con 0x7f80b00f6860 2022-02-02T20:07:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.485+0000 7f80977fe700 1 -- 172.21.15.96:0/1343730970 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f80a0055e60 con 0x7f80b00f6860 2022-02-02T20:07:55.489 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:07:55.490 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:07:55.490 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:07:55.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:55.490 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:07:55.491 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:07:55.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:55.491 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:07:55.491 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:07:55.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:55.492 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:07:55.492 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:07:55.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:07:55.493 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:07:55.493 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:07:55.493 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:07:55.493 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:07:55.493 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:07:55.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 msgr2=0x7f8098067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 0x7f8098067290 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f80b0060060 tx=0x7f80a4009c00).stop 2022-02-02T20:07:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 msgr2=0x7f80b010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f80a0009990 tx=0x7f80a0009b30).stop 2022-02-02T20:07:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 shutdown_connections 2022-02-02T20:07:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8098064dd0 0x7f8098067290 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00f55c0 0x7f80b0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 --2- 172.21.15.96:0/1343730970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80b00f6860 0x7f80b010c150 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 >> 172.21.15.96:0/1343730970 conn(0x7f80b00f0d40 msgr2=0x7f80b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:55.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 shutdown_connections 2022-02-02T20:07:55.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.487+0000 7f80b51b7700 1 -- 172.21.15.96:0/1343730970 wait complete. 2022-02-02T20:07:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 -- 172.21.15.96:0/3939125309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f66d0 msgr2=0x7f7b200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 --2- 172.21.15.96:0/3939125309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f66d0 0x7f7b200f6b30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f7b0c004660 tx=0x7f7b0c009b30).stop 2022-02-02T20:07:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 -- 172.21.15.96:0/3939125309 shutdown_connections 2022-02-02T20:07:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 --2- 172.21.15.96:0/3939125309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f66d0 0x7f7b200f6b30 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 --2- 172.21.15.96:0/3939125309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f5430 0x7f7b200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.585+0000 7f7b25871700 1 -- 172.21.15.96:0/3939125309 >> 172.21.15.96:0/3939125309 conn(0x7f7b200f0b90 msgr2=0x7f7b200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 -- 172.21.15.96:0/3939125309 shutdown_connections 2022-02-02T20:07:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 -- 172.21.15.96:0/3939125309 wait complete. 2022-02-02T20:07:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 Processor -- start 2022-02-02T20:07:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 -- start start 2022-02-02T20:07:55.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f66d0 0x7f7b20107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.586+0000 7f7b25871700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b20107890 con 0x7f7b200f5430 2022-02-02T20:07:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b25871700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201080d0 con 0x7f7b200f66d0 2022-02-02T20:07:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35360/0 (socket says 172.21.15.96:35360) 2022-02-02T20:07:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 -- 172.21.15.96:0/14471585 learned_addr learned my addr 172.21.15.96:0/14471585 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:07:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b1ffff700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f66d0 0x7f7b20107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 -- 172.21.15.96:0/14471585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f66d0 msgr2=0x7f7b20107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f66d0 0x7f7b20107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 -- 172.21.15.96:0/14471585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c005040 con 0x7f7b200f5430 2022-02-02T20:07:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b2486f700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f7b14002700 tx=0x7f7b14009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b140079c0 con 0x7f7b200f5430 2022-02-02T20:07:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b201083b0 con 0x7f7b200f5430 2022-02-02T20:07:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b1400f040 con 0x7f7b200f5430 2022-02-02T20:07:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b201088f0 con 0x7f7b200f5430 2022-02-02T20:07:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.587+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14014860 con 0x7f7b200f5430 2022-02-02T20:07:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.588+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b20059100 con 0x7f7b200f5430 2022-02-02T20:07:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.589+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b1401b060 con 0x7f7b200f5430 2022-02-02T20:07:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.589+0000 7f7b1d7fa700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 0x7f7b100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:07:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.589+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b14081900 con 0x7f7b200f5430 2022-02-02T20:07:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.589+0000 7f7b1ffff700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 0x7f7b100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:07:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.590+0000 7f7b1ffff700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 0x7f7b100672e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f7b0c004630 tx=0x7f7b0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:07:55.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.593+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b1404fa00 con 0x7f7b200f5430 2022-02-02T20:07:55.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.790+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b2010d450 con 0x7f7b200f5430 2022-02-02T20:07:55.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.790+0000 7f7b1d7fa700 1 -- 172.21.15.96:0/14471585 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7b14019070 con 0x7f7b200f5430 2022-02-02T20:07:55.795 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:07:55.795 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:07:55.795 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:07:55.795 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:07:55.796 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:55.796 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:07:55.796 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:07:55.796 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:07:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:07:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:07:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:07:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:07:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:07:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:07:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:07:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:07:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:07:55.799 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:07:55.799 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:07:55.799 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:07:55.799 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:07:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:07:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:07:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:07:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:07:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:07:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:07:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:07:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:07:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:07:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:07:55.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:07:55.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:55.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:55.802 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:07:55.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:07:55.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:55.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:55.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:07:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 msgr2=0x7f7b100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 0x7f7b100672e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f7b0c004630 tx=0x7f7b0c009b30).stop 2022-02-02T20:07:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 msgr2=0x7f7b20106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:07:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f7b14002700 tx=0x7f7b14009d80).stop 2022-02-02T20:07:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 shutdown_connections 2022-02-02T20:07:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b10064e20 0x7f7b100672e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b200f5430 0x7f7b20106da0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 --2- 172.21.15.96:0/14471585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b200f66d0 0x7f7b20107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:07:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 >> 172.21.15.96:0/14471585 conn(0x7f7b200f0b90 msgr2=0x7f7b2005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:07:55.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 shutdown_connections 2022-02-02T20:07:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:07:55.792+0000 7f7b25871700 1 -- 172.21.15.96:0/14471585 wait complete. 2022-02-02T20:07:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:07:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:55 smithi159 ceph-mon[69013]: pgmap v3175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:55 smithi159 ceph-mon[69013]: from='client.37366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:55 smithi159 ceph-mon[69013]: from='client.37370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:56.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1343730970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:07:56.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/14471585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:07:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:55 smithi096 ceph-mon[101353]: pgmap v3175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:55 smithi096 ceph-mon[101353]: from='client.37366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:55 smithi096 ceph-mon[101353]: from='client.37370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:07:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1343730970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:07:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/14471585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:07:57.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:57 smithi159 ceph-mon[69013]: pgmap v3176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:07:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:57 smithi096 ceph-mon[101353]: pgmap v3176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:07:59 smithi159 ceph-mon[69013]: pgmap v3177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:07:59 smithi096 ceph-mon[101353]: pgmap v3177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:01 smithi159 ceph-mon[69013]: pgmap v3178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:02.610 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:01 smithi096 ceph-mon[101353]: pgmap v3178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:03 smithi159 ceph-mon[69013]: pgmap v3179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:03 smithi096 ceph-mon[101353]: pgmap v3179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:05 smithi159 ceph-mon[69013]: pgmap v3180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:05 smithi096 ceph-mon[101353]: pgmap v3180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:07 smithi159 ceph-mon[69013]: pgmap v3181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:07 smithi096 ceph-mon[101353]: pgmap v3181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:10.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:09 smithi159 ceph-mon[69013]: pgmap v3182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:09 smithi096 ceph-mon[101353]: pgmap v3182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:11 smithi159 ceph-mon[69013]: pgmap v3183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:12.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:11 smithi096 ceph-mon[101353]: pgmap v3183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:13 smithi159 ceph-mon[69013]: pgmap v3184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:14.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:13 smithi096 ceph-mon[101353]: pgmap v3184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:15 smithi159 ceph-mon[69013]: pgmap v3185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:15 smithi096 ceph-mon[101353]: pgmap v3185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:17 smithi159 ceph-mon[69013]: pgmap v3186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:17 smithi096 ceph-mon[101353]: pgmap v3186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:19 smithi159 ceph-mon[69013]: pgmap v3187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:19 smithi096 ceph-mon[101353]: pgmap v3187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:21 smithi159 ceph-mon[69013]: pgmap v3188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:21 smithi096 ceph-mon[101353]: pgmap v3188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:23 smithi159 ceph-mon[69013]: pgmap v3189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:24.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:23 smithi096 ceph-mon[101353]: pgmap v3189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 -- 172.21.15.96:0/761578107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 msgr2=0x7f58400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 --2- 172.21.15.96:0/761578107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f58400f59e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f5834004660 tx=0x7f5834009b30).stop 2022-02-02T20:08:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 -- 172.21.15.96:0/761578107 shutdown_connections 2022-02-02T20:08:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 --2- 172.21.15.96:0/761578107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 0x7f58400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:08:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 --2- 172.21.15.96:0/761578107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f58400f59e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 -- 172.21.15.96:0/761578107 >> 172.21.15.96:0/761578107 conn(0x7f58400f0d40 msgr2=0x7f58400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 -- 172.21.15.96:0/761578107 shutdown_connections 2022-02-02T20:08:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.904+0000 7f5845b33700 1 -- 172.21.15.96:0/761578107 wait complete. 2022-02-02T20:08:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 Processor -- start 2022-02-02T20:08:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 -- start start 2022-02-02T20:08:25.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 0x7f58401063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401069f0 con 0x7f58400f55c0 2022-02-02T20:08:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f5845b33700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401072a0 con 0x7f58400f6860 2022-02-02T20:08:25.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f583f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:25.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f583f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35378/0 (socket says 172.21.15.96:35378) 2022-02-02T20:08:25.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f583f7fe700 1 -- 172.21.15.96:0/3891899745 learned_addr learned my addr 172.21.15.96:0/3891899745 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:25.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.905+0000 7f583effd700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 0x7f58401063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:25.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f583f7fe700 1 -- 172.21.15.96:0/3891899745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 msgr2=0x7f58401063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:25.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f583f7fe700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 0x7f58401063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:25.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f583f7fe700 1 -- 172.21.15.96:0/3891899745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834005040 con 0x7f58400f55c0 2022-02-02T20:08:25.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f583f7fe700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f5834004f60 tx=0x7f5834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:25.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5834018070 con 0x7f58400f55c0 2022-02-02T20:08:25.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5834007ba0 con 0x7f58400f55c0 2022-02-02T20:08:25.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5840107520 con 0x7f58400f55c0 2022-02-02T20:08:25.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583401c620 con 0x7f58400f55c0 2022-02-02T20:08:25.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.906+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840107a80 con 0x7f58400f55c0 2022-02-02T20:08:25.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.907+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58400f49b0 con 0x7f58400f55c0 2022-02-02T20:08:25.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.907+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f583401d420 con 0x7f58400f55c0 2022-02-02T20:08:25.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.908+0000 7f5827fff700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 0x7f5828067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:25.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.908+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5834083960 con 0x7f58400f55c0 2022-02-02T20:08:25.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.908+0000 7f583effd700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 0x7f5828067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:25.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.908+0000 7f583effd700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 0x7f5828067290 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f583000b790 tx=0x7f5830008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:25.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:25.912+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5834055490 con 0x7f58400f55c0 2022-02-02T20:08:26.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.089+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58400fde70 con 0x7f5828064dd0 2022-02-02T20:08:26.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.090+0000 7f5827fff700 1 -- 172.21.15.96:0/3891899745 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f58400fde70 con 0x7f5828064dd0 2022-02-02T20:08:26.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 msgr2=0x7f5828067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 0x7f5828067290 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f583000b790 tx=0x7f5830008040).stop 2022-02-02T20:08:26.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 msgr2=0x7f5840105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f5834004f60 tx=0x7f5834009b30).stop 2022-02-02T20:08:26.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 shutdown_connections 2022-02-02T20:08:26.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5828064dd0 0x7f5828067290 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58400f55c0 0x7f5840105ec0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 --2- 172.21.15.96:0/3891899745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58400f6860 0x7f58401063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 >> 172.21.15.96:0/3891899745 conn(0x7f58400f0d40 msgr2=0x7f58400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 shutdown_connections 2022-02-02T20:08:26.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.092+0000 7f5845b33700 1 -- 172.21.15.96:0/3891899745 wait complete. 2022-02-02T20:08:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:08:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 -- 172.21.15.96:0/540362438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 msgr2=0x7f7b600f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 --2- 172.21.15.96:0/540362438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b600f7010 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f7b48004660 tx=0x7f7b48009b30).stop 2022-02-02T20:08:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 -- 172.21.15.96:0/540362438 shutdown_connections 2022-02-02T20:08:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 --2- 172.21.15.96:0/540362438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 0x7f7b600f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 --2- 172.21.15.96:0/540362438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b600f7010 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 -- 172.21.15.96:0/540362438 >> 172.21.15.96:0/540362438 conn(0x7f7b600f04c0 msgr2=0x7f7b600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.197 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:25 smithi096 ceph-mon[101353]: pgmap v3190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:26.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 -- 172.21.15.96:0/540362438 shutdown_connections 2022-02-02T20:08:26.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.191+0000 7f7b648d8700 1 -- 172.21.15.96:0/540362438 wait complete. 2022-02-02T20:08:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 Processor -- start 2022-02-02T20:08:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 -- start start 2022-02-02T20:08:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 0x7f7b6010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600f5620 con 0x7f7b600f6bf0 2022-02-02T20:08:26.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b648d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600f5760 con 0x7f7b600f7590 2022-02-02T20:08:26.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35388/0 (socket says 172.21.15.96:35388) 2022-02-02T20:08:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b5e59c700 1 -- 172.21.15.96:0/620745308 learned_addr learned my addr 172.21.15.96:0/620745308 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.192+0000 7f7b5dd9b700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 0x7f7b6010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b5e59c700 1 -- 172.21.15.96:0/620745308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 msgr2=0x7f7b6010c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b5e59c700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 0x7f7b6010c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b5e59c700 1 -- 172.21.15.96:0/620745308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48005040 con 0x7f7b600f6bf0 2022-02-02T20:08:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b5e59c700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f7b48013a70 tx=0x7f7b48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b48018070 con 0x7f7b600f6bf0 2022-02-02T20:08:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6010c730 con 0x7f7b600f6bf0 2022-02-02T20:08:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b480097d0 con 0x7f7b600f6bf0 2022-02-02T20:08:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4801de80 con 0x7f7b600f6bf0 2022-02-02T20:08:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.193+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6010cc60 con 0x7f7b600f6bf0 2022-02-02T20:08:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.194+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b600f4150 con 0x7f7b600f6bf0 2022-02-02T20:08:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.194+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b48007ba0 con 0x7f7b600f6bf0 2022-02-02T20:08:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.195+0000 7f7b56ffd700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 0x7f7b4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.195+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b48083280 con 0x7f7b600f6bf0 2022-02-02T20:08:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.195+0000 7f7b5dd9b700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 0x7f7b4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.195+0000 7f7b5dd9b700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 0x7f7b4c067290 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7b50004c40 tx=0x7f7b5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.199+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b48051360 con 0x7f7b600f6bf0 2022-02-02T20:08:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:25 smithi159 ceph-mon[69013]: pgmap v3190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:26.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.372+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b600fdf30 con 0x7f7b4c064dd0 2022-02-02T20:08:26.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.381+0000 7f7b56ffd700 1 -- 172.21.15.96:0/620745308 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f7b600fdf30 con 0x7f7b4c064dd0 2022-02-02T20:08:26.384 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:08:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (111m) 82m ago 112m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:08:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (104m) 82m ago 112m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:08:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (104m) 80m ago 112m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:08:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (111m) 82m ago 112m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:08:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (108m) 82m ago 108m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:08:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (104m) 82m ago 108m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:08:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (108m) 80m ago 108m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:08:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (104m) 80m ago 109m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:08:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (106m) 82m ago 114m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:08:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (105m) 80m ago 112m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:08:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (105m) 82m ago 114m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:08:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (104m) 80m ago 112m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:08:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (112m) 82m ago 112m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:08:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (112m) 80m ago 112m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:08:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (103m) 82m ago 111m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:08:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (103m) 82m ago 111m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:08:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (102m) 82m ago 111m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:08:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (102m) 80m ago 110m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:08:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (101m) 80m ago 110m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:08:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (101m) 80m ago 110m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:08:26.390 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (111m) 82m ago 112m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:08:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 msgr2=0x7f7b4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 0x7f7b4c067290 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7b50004c40 tx=0x7f7b5000b040).stop 2022-02-02T20:08:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 msgr2=0x7f7b60109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f7b48013a70 tx=0x7f7b48009b30).stop 2022-02-02T20:08:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 shutdown_connections 2022-02-02T20:08:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b4c064dd0 0x7f7b4c067290 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b600f6bf0 0x7f7b60109ce0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 --2- 172.21.15.96:0/620745308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b600f7590 0x7f7b6010c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.383+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 >> 172.21.15.96:0/620745308 conn(0x7f7b600f04c0 msgr2=0x7f7b600fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.384+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 shutdown_connections 2022-02-02T20:08:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.384+0000 7f7b648d8700 1 -- 172.21.15.96:0/620745308 wait complete. 2022-02-02T20:08:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 -- 172.21.15.96:0/868012680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 msgr2=0x7f41ec0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 --2- 172.21.15.96:0/868012680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec0f7de0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f41d4004660 tx=0x7f41d4009b30).stop 2022-02-02T20:08:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 -- 172.21.15.96:0/868012680 shutdown_connections 2022-02-02T20:08:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 --2- 172.21.15.96:0/868012680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec0f7de0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 --2- 172.21.15.96:0/868012680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 0x7f41ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 -- 172.21.15.96:0/868012680 >> 172.21.15.96:0/868012680 conn(0x7f41ec0f1e40 msgr2=0x7f41ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 -- 172.21.15.96:0/868012680 shutdown_connections 2022-02-02T20:08:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.480+0000 7f41f24d6700 1 -- 172.21.15.96:0/868012680 wait complete. 2022-02-02T20:08:26.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 Processor -- start 2022-02-02T20:08:26.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 -- start start 2022-02-02T20:08:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 0x7f41ec106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec107a00 con 0x7f41ec0f7980 2022-02-02T20:08:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41f24d6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec107b40 con 0x7f41ec0f66e0 2022-02-02T20:08:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35400/0 (socket says 172.21.15.96:35400) 2022-02-02T20:08:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.481+0000 7f41eb7fe700 1 -- 172.21.15.96:0/4076991451 learned_addr learned my addr 172.21.15.96:0/4076991451 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41ebfff700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 0x7f41ec106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41eb7fe700 1 -- 172.21.15.96:0/4076991451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 msgr2=0x7f41ec106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41eb7fe700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 0x7f41ec106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41eb7fe700 1 -- 172.21.15.96:0/4076991451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4005040 con 0x7f41ec0f7980 2022-02-02T20:08:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41eb7fe700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f41d4009990 tx=0x7f41d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d4018070 con 0x7f41ec0f7980 2022-02-02T20:08:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec108480 con 0x7f41ec0f7980 2022-02-02T20:08:26.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41d4007ba0 con 0x7f41ec0f7980 2022-02-02T20:08:26.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d401c3c0 con 0x7f41ec0f7980 2022-02-02T20:08:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.482+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec1089e0 con 0x7f41ec0f7980 2022-02-02T20:08:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.483+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec045ad0 con 0x7f41ec0f7980 2022-02-02T20:08:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.484+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f41d401d420 con 0x7f41ec0f7980 2022-02-02T20:08:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.485+0000 7f41e8ff9700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 0x7f41d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.485+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41d40836b0 con 0x7f41ec0f7980 2022-02-02T20:08:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.485+0000 7f41ebfff700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 0x7f41d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.485+0000 7f41ebfff700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 0x7f41d8067290 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f41ec0f77e0 tx=0x7f41dc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.489+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41d4055240 con 0x7f41ec0f7980 2022-02-02T20:08:26.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.723+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41ec027a00 con 0x7f41ec0f7980 2022-02-02T20:08:26.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.724+0000 7f41e8ff9700 1 -- 172.21.15.96:0/4076991451 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f41d4054e30 con 0x7f41ec0f7980 2022-02-02T20:08:26.728 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:08:26.728 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:08:26.728 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:08:26.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:26.729 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:08:26.729 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:08:26.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:26.729 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:08:26.729 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:08:26.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:26.730 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:08:26.730 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:08:26.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:26.731 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:08:26.731 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:08:26.731 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:08:26.731 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:08:26.732 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:08:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 msgr2=0x7f41d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 0x7f41d8067290 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f41ec0f77e0 tx=0x7f41dc00b040).stop 2022-02-02T20:08:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 msgr2=0x7f41ec107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f41d4009990 tx=0x7f41d4009b30).stop 2022-02-02T20:08:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 shutdown_connections 2022-02-02T20:08:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41d8064dd0 0x7f41d8067290 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41ec0f66e0 0x7f41ec106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 --2- 172.21.15.96:0/4076991451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41ec0f7980 0x7f41ec107450 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 >> 172.21.15.96:0/4076991451 conn(0x7f41ec0f1e40 msgr2=0x7f41ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 shutdown_connections 2022-02-02T20:08:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.726+0000 7f41f24d6700 1 -- 172.21.15.96:0/4076991451 wait complete. 2022-02-02T20:08:26.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 -- 172.21.15.96:0/72192926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f55c0 msgr2=0x7fb3d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 --2- 172.21.15.96:0/72192926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f55c0 0x7fb3d80f59e0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fb3c8004660 tx=0x7fb3c8009b30).stop 2022-02-02T20:08:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 -- 172.21.15.96:0/72192926 shutdown_connections 2022-02-02T20:08:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 --2- 172.21.15.96:0/72192926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f6860 0x7fb3d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 --2- 172.21.15.96:0/72192926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f55c0 0x7fb3d80f59e0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 -- 172.21.15.96:0/72192926 >> 172.21.15.96:0/72192926 conn(0x7fb3d80f0d40 msgr2=0x7fb3d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 -- 172.21.15.96:0/72192926 shutdown_connections 2022-02-02T20:08:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.824+0000 7fb3de82f700 1 -- 172.21.15.96:0/72192926 wait complete. 2022-02-02T20:08:26.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 Processor -- start 2022-02-02T20:08:26.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 -- start start 2022-02-02T20:08:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 0x7fb3d8105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8106910 con 0x7fb3d80f6860 2022-02-02T20:08:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3de82f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8106a50 con 0x7fb3d80f55c0 2022-02-02T20:08:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35408/0 (socket says 172.21.15.96:35408) 2022-02-02T20:08:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.825+0000 7fb3d77fe700 1 -- 172.21.15.96:0/665686210 learned_addr learned my addr 172.21.15.96:0/665686210 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d7fff700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 0x7fb3d8105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d77fe700 1 -- 172.21.15.96:0/665686210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 msgr2=0x7fb3d8105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d77fe700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 0x7fb3d8105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d77fe700 1 -- 172.21.15.96:0/665686210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8005040 con 0x7fb3d80f6860 2022-02-02T20:08:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d7fff700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 0x7fb3d8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:08:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d77fe700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fb3c000c790 tx=0x7fb3c0007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c000e680 con 0x7fb3d80f6860 2022-02-02T20:08:26.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3c000ec90 con 0x7fb3d80f6860 2022-02-02T20:08:26.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c0013d60 con 0x7fb3d80f6860 2022-02-02T20:08:26.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d81073f0 con 0x7fb3d80f6860 2022-02-02T20:08:26.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.826+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d81079b0 con 0x7fb3d80f6860 2022-02-02T20:08:26.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.827+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8045ad0 con 0x7fb3d80f6860 2022-02-02T20:08:26.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.827+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb3c001a060 con 0x7fb3d80f6860 2022-02-02T20:08:26.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.828+0000 7fb3d4ff9700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 0x7fb3c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:26.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.828+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb3c0081c90 con 0x7fb3d80f6860 2022-02-02T20:08:26.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.828+0000 7fb3d7fff700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 0x7fb3c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:26.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.828+0000 7fb3d7fff700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 0x7fb3c4067290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fb3c8009da0 tx=0x7fb3c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:26.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:26.832+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb3c00537c0 con 0x7fb3d80f6860 2022-02-02T20:08:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.031+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3d80fde80 con 0x7fb3d80f6860 2022-02-02T20:08:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.031+0000 7fb3d4ff9700 1 -- 172.21.15.96:0/665686210 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb3c0018020 con 0x7fb3d80f6860 2022-02-02T20:08:27.035 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:08:27.035 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:08:27.035 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:08:27.035 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:08:27.036 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:27.036 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:08:27.036 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:08:27.036 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:08:27.037 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:08:27.037 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:08:27.037 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:08:27.037 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:08:27.038 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:08:27.038 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:08:27.038 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:08:27.038 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:08:27.039 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:08:27.039 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:08:27.040 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:08:27.040 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:08:27.040 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:08:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:08:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:08:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:08:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:08:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:08:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:08:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:08:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:08:27.043 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:08:27.043 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:08:27.043 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:08:27.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:27.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:27.044 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:08:27.044 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:27.044 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:27.044 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:27.045 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:27.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 msgr2=0x7fb3c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 0x7fb3c4067290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fb3c8009da0 tx=0x7fb3c8009b30).stop 2022-02-02T20:08:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 msgr2=0x7fb3d8106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fb3c000c790 tx=0x7fb3c0007d70).stop 2022-02-02T20:08:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 shutdown_connections 2022-02-02T20:08:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3c4064dd0 0x7fb3c4067290 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d80f55c0 0x7fb3d8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 --2- 172.21.15.96:0/665686210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3d80f6860 0x7fb3d8106360 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 >> 172.21.15.96:0/665686210 conn(0x7fb3d80f0d40 msgr2=0x7fb3d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 shutdown_connections 2022-02-02T20:08:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:27.033+0000 7fb3de82f700 1 -- 172.21.15.96:0/665686210 wait complete. 2022-02-02T20:08:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:08:27.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:26 smithi159 ceph-mon[69013]: from='client.37382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:26 smithi159 ceph-mon[69013]: from='client.37386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:27.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4076991451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:08:27.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:26 smithi096 ceph-mon[101353]: from='client.37382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:27.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:26 smithi096 ceph-mon[101353]: from='client.37386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:27.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4076991451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:08:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:27 smithi159 ceph-mon[69013]: pgmap v3191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/665686210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:08:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:08:28.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:08:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:27 smithi096 ceph-mon[101353]: pgmap v3191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/665686210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:08:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:08:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:08:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:29 smithi159 ceph-mon[69013]: pgmap v3192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:29 smithi096 ceph-mon[101353]: pgmap v3192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:31 smithi159 ceph-mon[69013]: pgmap v3193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:32.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:31 smithi096 ceph-mon[101353]: pgmap v3193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:33 smithi159 ceph-mon[69013]: pgmap v3194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:33 smithi096 ceph-mon[101353]: pgmap v3194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:35 smithi159 ceph-mon[69013]: pgmap v3195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:35 smithi096 ceph-mon[101353]: pgmap v3195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:37 smithi159 ceph-mon[69013]: pgmap v3196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:37 smithi096 ceph-mon[101353]: pgmap v3196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:39 smithi159 ceph-mon[69013]: pgmap v3197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:39 smithi096 ceph-mon[101353]: pgmap v3197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:41 smithi159 ceph-mon[69013]: pgmap v3198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:41 smithi096 ceph-mon[101353]: pgmap v3198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:43 smithi159 ceph-mon[69013]: pgmap v3199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:43 smithi096 ceph-mon[101353]: pgmap v3199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:45 smithi159 ceph-mon[69013]: pgmap v3200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:45 smithi096 ceph-mon[101353]: pgmap v3200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:47.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:47 smithi159 ceph-mon[69013]: pgmap v3201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:47 smithi096 ceph-mon[101353]: pgmap v3201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:49 smithi159 ceph-mon[69013]: pgmap v3202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:49 smithi096 ceph-mon[101353]: pgmap v3202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:52.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:51 smithi159 ceph-mon[69013]: pgmap v3203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:51 smithi096 ceph-mon[101353]: pgmap v3203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:53 smithi159 ceph-mon[69013]: pgmap v3204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:53 smithi096 ceph-mon[101353]: pgmap v3204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:55 smithi159 ceph-mon[69013]: pgmap v3205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:55 smithi096 ceph-mon[101353]: pgmap v3205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 -- 172.21.15.96:0/2793365483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f55c0 msgr2=0x7f241c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 --2- 172.21.15.96:0/2793365483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f55c0 0x7f241c0f59e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f2404004660 tx=0x7f2404009b30).stop 2022-02-02T20:08:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 -- 172.21.15.96:0/2793365483 shutdown_connections 2022-02-02T20:08:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 --2- 172.21.15.96:0/2793365483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f6860 0x7f241c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 --2- 172.21.15.96:0/2793365483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f55c0 0x7f241c0f59e0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 -- 172.21.15.96:0/2793365483 >> 172.21.15.96:0/2793365483 conn(0x7f241c0f0d20 msgr2=0x7f241c0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 -- 172.21.15.96:0/2793365483 shutdown_connections 2022-02-02T20:08:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.143+0000 7f2421c68700 1 -- 172.21.15.96:0/2793365483 wait complete. 2022-02-02T20:08:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 Processor -- start 2022-02-02T20:08:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 -- start start 2022-02-02T20:08:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 0x7f241c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c1079d0 con 0x7f241c0f6860 2022-02-02T20:08:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.144+0000 7f2421c68700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c107b10 con 0x7f241c0f55c0 2022-02-02T20:08:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35440/0 (socket says 172.21.15.96:35440) 2022-02-02T20:08:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 -- 172.21.15.96:0/3224365870 learned_addr learned my addr 172.21.15.96:0/3224365870 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241b7fe700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 0x7f241c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 -- 172.21.15.96:0/3224365870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 msgr2=0x7f241c106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 0x7f241c106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 -- 172.21.15.96:0/3224365870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404005040 con 0x7f241c0f6860 2022-02-02T20:08:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241b7fe700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 0x7f241c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:08:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f241affd700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f240c002700 tx=0x7f240c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240c009320 con 0x7f241c0f6860 2022-02-02T20:08:57.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c1084b0 con 0x7f241c0f6860 2022-02-02T20:08:57.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f240c00f040 con 0x7f241c0f6860 2022-02-02T20:08:57.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240c014820 con 0x7f241c0f6860 2022-02-02T20:08:57.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.145+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c108a70 con 0x7f241c0f6860 2022-02-02T20:08:57.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.146+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c045ad0 con 0x7f241c0f6860 2022-02-02T20:08:57.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.147+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f240c009480 con 0x7f241c0f6860 2022-02-02T20:08:57.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.147+0000 7f2413fff700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 0x7f2408067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.147+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f240c081dd0 con 0x7f241c0f6860 2022-02-02T20:08:57.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.147+0000 7f241b7fe700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 0x7f2408067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.148+0000 7f241b7fe700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 0x7f2408067290 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f2404005010 tx=0x7f2404009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.151+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f240c053900 con 0x7f241c0f6860 2022-02-02T20:08:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.334+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f241c0faca0 con 0x7f2408064dd0 2022-02-02T20:08:57.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.335+0000 7f2413fff700 1 -- 172.21.15.96:0/3224365870 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f241c0faca0 con 0x7f2408064dd0 2022-02-02T20:08:57.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 msgr2=0x7f2408067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 0x7f2408067290 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f2404005010 tx=0x7f2404009b30).stop 2022-02-02T20:08:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 msgr2=0x7f241c107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f240c002700 tx=0x7f240c009e00).stop 2022-02-02T20:08:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 shutdown_connections 2022-02-02T20:08:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2408064dd0 0x7f2408067290 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f241c0f55c0 0x7f241c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 --2- 172.21.15.96:0/3224365870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f241c0f6860 0x7f241c107420 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 >> 172.21.15.96:0/3224365870 conn(0x7f241c0f0d20 msgr2=0x7f241c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 shutdown_connections 2022-02-02T20:08:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.337+0000 7f2421c68700 1 -- 172.21.15.96:0/3224365870 wait complete. 2022-02-02T20:08:57.349 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:08:57.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 -- 172.21.15.96:0/844490872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f66d0 msgr2=0x7f43e40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/844490872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f66d0 0x7f43e40f6b30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f43d8004660 tx=0x7f43d8009b30).stop 2022-02-02T20:08:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 -- 172.21.15.96:0/844490872 shutdown_connections 2022-02-02T20:08:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/844490872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f66d0 0x7f43e40f6b30 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/844490872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f5430 0x7f43e40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 -- 172.21.15.96:0/844490872 >> 172.21.15.96:0/844490872 conn(0x7f43e40f0b90 msgr2=0x7f43e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.435+0000 7f43e8b3c700 1 -- 172.21.15.96:0/844490872 shutdown_connections 2022-02-02T20:08:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 -- 172.21.15.96:0/844490872 wait complete. 2022-02-02T20:08:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 Processor -- start 2022-02-02T20:08:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 -- start start 2022-02-02T20:08:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f66d0 0x7f43e4107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4107830 con 0x7f43e40f5430 2022-02-02T20:08:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.436+0000 7f43e8b3c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4108040 con 0x7f43e40f66d0 2022-02-02T20:08:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35448/0 (socket says 172.21.15.96:35448) 2022-02-02T20:08:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 -- 172.21.15.96:0/1825039105 learned_addr learned my addr 172.21.15.96:0/1825039105 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:57.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e2ffd700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f66d0 0x7f43e4107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 -- 172.21.15.96:0/1825039105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f66d0 msgr2=0x7f43e4107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f66d0 0x7f43e4107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 -- 172.21.15.96:0/1825039105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d8005040 con 0x7f43e40f5430 2022-02-02T20:08:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e37fe700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f43d4002700 tx=0x7f43d4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d4009320 con 0x7f43e40f5430 2022-02-02T20:08:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f43d400f040 con 0x7f43e40f5430 2022-02-02T20:08:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e41082c0 con 0x7f43e40f5430 2022-02-02T20:08:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d40148e0 con 0x7f43e40f5430 2022-02-02T20:08:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.437+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e4108880 con 0x7f43e40f5430 2022-02-02T20:08:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.438+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e4059100 con 0x7f43e40f5430 2022-02-02T20:08:57.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.439+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f43d4009480 con 0x7f43e40f5430 2022-02-02T20:08:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.439+0000 7f43cbfff700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 0x7f43cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.440+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f43d4082290 con 0x7f43e40f5430 2022-02-02T20:08:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.440+0000 7f43e2ffd700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 0x7f43cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.440+0000 7f43e2ffd700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 0x7f43cc0672e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f43d8004630 tx=0x7f43d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.443+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f43d40504d0 con 0x7f43e40f5430 2022-02-02T20:08:57.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.618+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e40fab10 con 0x7f43cc064e20 2022-02-02T20:08:57.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.627+0000 7f43cbfff700 1 -- 172.21.15.96:0/1825039105 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f43e40fab10 con 0x7f43cc064e20 2022-02-02T20:08:57.631 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:08:57.631 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (112m) 82m ago 113m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:08:57.631 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (104m) 82m ago 113m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:08:57.631 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (104m) 81m ago 112m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:08:57.632 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (112m) 82m ago 113m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:08:57.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (109m) 82m ago 109m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:08:57.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (105m) 82m ago 109m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:08:57.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (109m) 81m ago 109m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:08:57.633 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (105m) 81m ago 109m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:08:57.633 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (106m) 82m ago 114m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:08:57.633 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (106m) 81m ago 112m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:08:57.633 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (105m) 82m ago 114m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:08:57.634 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (105m) 81m ago 112m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:08:57.634 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (113m) 82m ago 113m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:08:57.634 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (112m) 81m ago 112m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:08:57.634 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (104m) 82m ago 112m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:08:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (103m) 82m ago 111m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:08:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (103m) 82m ago 111m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:08:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (102m) 81m ago 111m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:08:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (102m) 81m ago 111m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:08:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (101m) 81m ago 110m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:08:57.636 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (112m) 82m ago 113m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:08:57.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 msgr2=0x7f43cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 0x7f43cc0672e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f43d8004630 tx=0x7f43d8009b30).stop 2022-02-02T20:08:57.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 msgr2=0x7f43e4106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f43d4002700 tx=0x7f43d4009e00).stop 2022-02-02T20:08:57.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 shutdown_connections 2022-02-02T20:08:57.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f43cc064e20 0x7f43cc0672e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43e40f5430 0x7f43e4106d40 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 --2- 172.21.15.96:0/1825039105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43e40f66d0 0x7f43e4107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.629+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 >> 172.21.15.96:0/1825039105 conn(0x7f43e40f0b90 msgr2=0x7f43e405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.630+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 shutdown_connections 2022-02-02T20:08:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.630+0000 7f43e8b3c700 1 -- 172.21.15.96:0/1825039105 wait complete. 2022-02-02T20:08:57.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 -- 172.21.15.96:0/3067432910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 msgr2=0x7fdf600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/3067432910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf600f6cc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fdf50004660 tx=0x7fdf50009b30).stop 2022-02-02T20:08:57.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 -- 172.21.15.96:0/3067432910 shutdown_connections 2022-02-02T20:08:57.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/3067432910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf600f6cc0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/3067432910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 -- 172.21.15.96:0/3067432910 >> 172.21.15.96:0/3067432910 conn(0x7fdf600f0d40 msgr2=0x7fdf600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.731 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:57 smithi096 ceph-mon[101353]: pgmap v3206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:57.731 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:57 smithi096 ceph-mon[101353]: from='client.37398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:57.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 -- 172.21.15.96:0/3067432910 shutdown_connections 2022-02-02T20:08:57.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.726+0000 7fdf64c7f700 1 -- 172.21.15.96:0/3067432910 wait complete. 2022-02-02T20:08:57.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 Processor -- start 2022-02-02T20:08:57.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 -- start start 2022-02-02T20:08:57.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf601051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf601057e0 con 0x7fdf600f6860 2022-02-02T20:08:57.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf64c7f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60105920 con 0x7fdf600f55c0 2022-02-02T20:08:57.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf5e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf5e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:39562/0 (socket says 172.21.15.96:39562) 2022-02-02T20:08:57.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.727+0000 7fdf5e59c700 1 -- 172.21.15.96:0/4258376548 learned_addr learned my addr 172.21.15.96:0/4258376548 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:57.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5dd9b700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf601051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5e59c700 1 -- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 msgr2=0x7fdf601051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5e59c700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf601051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5e59c700 1 -- 172.21.15.96:0/4258376548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50005040 con 0x7fdf600f55c0 2022-02-02T20:08:57.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5dd9b700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf601051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:08:57.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf5e59c700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdf48002700 tx=0x7fdf48009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf480079c0 con 0x7fdf600f55c0 2022-02-02T20:08:57.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf60106290 con 0x7fdf600f55c0 2022-02-02T20:08:57.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf4800f040 con 0x7fdf600f55c0 2022-02-02T20:08:57.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf48014860 con 0x7fdf600f55c0 2022-02-02T20:08:57.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.728+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60106850 con 0x7fdf600f55c0 2022-02-02T20:08:57.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.729+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60045ad0 con 0x7fdf600f55c0 2022-02-02T20:08:57.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.730+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf4801b060 con 0x7fdf600f55c0 2022-02-02T20:08:57.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.730+0000 7fdf56ffd700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:57.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.731+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdf480819a0 con 0x7fdf600f55c0 2022-02-02T20:08:57.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.731+0000 7fdf5dd9b700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:57.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.731+0000 7fdf5dd9b700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdf50005010 tx=0x7fdf50009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:57.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.735+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf4804f9e0 con 0x7fdf600f55c0 2022-02-02T20:08:57.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:57 smithi159 ceph-mon[69013]: pgmap v3206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:57.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:57 smithi159 ceph-mon[69013]: from='client.37398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:57.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.962+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf60109430 con 0x7fdf600f55c0 2022-02-02T20:08:57.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.963+0000 7fdf56ffd700 1 -- 172.21.15.96:0/4258376548 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdf480192e0 con 0x7fdf600f55c0 2022-02-02T20:08:57.966 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:08:57.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:08:57.967 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:08:57.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:57.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:08:57.968 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:08:57.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:57.968 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:08:57.968 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:08:57.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:57.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:08:57.969 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:08:57.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:08:57.969 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:08:57.970 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:08:57.970 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:08:57.970 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:08:57.970 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:08:57.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 msgr2=0x7fdf4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdf50005010 tx=0x7fdf50009b30).stop 2022-02-02T20:08:57.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 msgr2=0x7fdf60104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:57.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdf48002700 tx=0x7fdf48009d80).stop 2022-02-02T20:08:57.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 shutdown_connections 2022-02-02T20:08:57.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf4c064dd0 0x7fdf4c067290 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf600f55c0 0x7fdf60104cf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 --2- 172.21.15.96:0/4258376548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf600f6860 0x7fdf601051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 >> 172.21.15.96:0/4258376548 conn(0x7fdf600f0d40 msgr2=0x7fdf6005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 shutdown_connections 2022-02-02T20:08:57.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:57.965+0000 7fdf64c7f700 1 -- 172.21.15.96:0/4258376548 wait complete. 2022-02-02T20:08:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/463773441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 msgr2=0x7f4a280f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/463773441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a280f7d20 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f4a14004660 tx=0x7f4a14009b30).stop 2022-02-02T20:08:58.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/463773441 shutdown_connections 2022-02-02T20:08:58.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/463773441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a280f7d20 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/463773441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a280f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/463773441 >> 172.21.15.96:0/463773441 conn(0x7f4a280f04c0 msgr2=0x7f4a280f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:58.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/463773441 shutdown_connections 2022-02-02T20:08:58.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/463773441 wait complete. 2022-02-02T20:08:58.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 Processor -- start 2022-02-02T20:08:58.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.063+0000 7f4a2ef4c700 1 -- start start 2022-02-02T20:08:58.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2ef4c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a28107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:58.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2ef4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:58.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2ef4c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28107ce0 con 0x7f4a280f53e0 2022-02-02T20:08:58.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2ef4c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28107e20 con 0x7f4a280f4a40 2022-02-02T20:08:58.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:58.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35470/0 (socket says 172.21.15.96:35470) 2022-02-02T20:08:58.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 -- 172.21.15.96:0/1624036694 learned_addr learned my addr 172.21.15.96:0/1624036694 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:08:58.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2cce8700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a28107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:58.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 -- 172.21.15.96:0/1624036694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 msgr2=0x7f4a28107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:58.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a28107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 -- 172.21.15.96:0/1624036694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14005040 con 0x7f4a280f53e0 2022-02-02T20:08:58.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a2cce8700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a28107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:08:58.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a27fff700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f4a14009d80 tx=0x7f4a14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:58.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a14018070 con 0x7f4a280f53e0 2022-02-02T20:08:58.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.064+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a14007ba0 con 0x7f4a280f53e0 2022-02-02T20:08:58.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.065+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a28108760 con 0x7f4a280f53e0 2022-02-02T20:08:58.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.065+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1401c620 con 0x7f4a280f53e0 2022-02-02T20:08:58.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.065+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a28108cc0 con 0x7f4a280f53e0 2022-02-02T20:08:58.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.066+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28045ad0 con 0x7f4a280f53e0 2022-02-02T20:08:58.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.066+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a1401d420 con 0x7f4a280f53e0 2022-02-02T20:08:58.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.066+0000 7f4a257fa700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:08:58.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.066+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4a14083880 con 0x7f4a280f53e0 2022-02-02T20:08:58.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.066+0000 7f4a2cce8700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:08:58.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.067+0000 7f4a2cce8700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f4a1c0041d0 tx=0x7f4a1c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:08:58.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.071+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a14055410 con 0x7f4a280f53e0 2022-02-02T20:08:58.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.272+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a280ff0f0 con 0x7f4a280f53e0 2022-02-02T20:08:58.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.273+0000 7f4a257fa700 1 -- 172.21.15.96:0/1624036694 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4a14055000 con 0x7f4a280f53e0 2022-02-02T20:08:58.277 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:08:58.277 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:08:58.277 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:08:58.277 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:08:58.278 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:58.278 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:08:58.278 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:08:58.278 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:08:58.279 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:08:58.279 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:08:58.279 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:08:58.279 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:08:58.279 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:08:58.280 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:08:58.280 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:08:58.280 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:08:58.280 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:08:58.281 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:08:58.281 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:08:58.281 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:08:58.281 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:08:58.282 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:08:58.282 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:08:58.282 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:08:58.283 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:08:58.283 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:08:58.283 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:08:58.284 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:08:58.284 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:08:58.285 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:08:58.285 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:08:58.285 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:08:58.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:58.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:58.286 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:08:58.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:08:58.286 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:58.287 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:58.287 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:08:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 msgr2=0x7f4a18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f4a1c0041d0 tx=0x7f4a1c009040).stop 2022-02-02T20:08:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 msgr2=0x7f4a28107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:08:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f4a14009d80 tx=0x7f4a14009b30).stop 2022-02-02T20:08:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 shutdown_connections 2022-02-02T20:08:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a280f4a40 0x7f4a28107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 --2- 172.21.15.96:0/1624036694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a280f53e0 0x7f4a28107730 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:08:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 >> 172.21.15.96:0/1624036694 conn(0x7f4a280f04c0 msgr2=0x7f4a280fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:08:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 shutdown_connections 2022-02-02T20:08:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:08:58.276+0000 7f4a2ef4c700 1 -- 172.21.15.96:0/1624036694 wait complete. 2022-02-02T20:08:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:08:58.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:58 smithi159 ceph-mon[69013]: from='client.37402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:58.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4258376548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:08:58.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1624036694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:08:58.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:58 smithi096 ceph-mon[101353]: from='client.37402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:08:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4258376548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:08:58.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1624036694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:08:59.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:08:59 smithi159 ceph-mon[69013]: pgmap v3207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:08:59.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:08:59 smithi096 ceph-mon[101353]: pgmap v3207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:01 smithi159 ceph-mon[69013]: pgmap v3208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:02.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:01 smithi096 ceph-mon[101353]: pgmap v3208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:03 smithi159 ceph-mon[69013]: pgmap v3209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:03 smithi096 ceph-mon[101353]: pgmap v3209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:05 smithi159 ceph-mon[69013]: pgmap v3210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:05 smithi096 ceph-mon[101353]: pgmap v3210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:07 smithi159 ceph-mon[69013]: pgmap v3211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:07 smithi096 ceph-mon[101353]: pgmap v3211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:09 smithi159 ceph-mon[69013]: pgmap v3212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:09 smithi096 ceph-mon[101353]: pgmap v3212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:11 smithi159 ceph-mon[69013]: pgmap v3213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:11 smithi096 ceph-mon[101353]: pgmap v3213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:13 smithi159 ceph-mon[69013]: pgmap v3214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:13 smithi096 ceph-mon[101353]: pgmap v3214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:15 smithi159 ceph-mon[69013]: pgmap v3215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:15 smithi096 ceph-mon[101353]: pgmap v3215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:17 smithi159 ceph-mon[69013]: pgmap v3216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:17 smithi096 ceph-mon[101353]: pgmap v3216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:19 smithi159 ceph-mon[69013]: pgmap v3217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:19 smithi096 ceph-mon[101353]: pgmap v3217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:21 smithi159 ceph-mon[69013]: pgmap v3218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:21 smithi096 ceph-mon[101353]: pgmap v3218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:23 smithi159 ceph-mon[69013]: pgmap v3219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:23 smithi096 ceph-mon[101353]: pgmap v3219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:25 smithi159 ceph-mon[69013]: pgmap v3220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:25 smithi096 ceph-mon[101353]: pgmap v3220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:27 smithi159 ceph-mon[69013]: pgmap v3221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:09:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:09:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:27 smithi096 ceph-mon[101353]: pgmap v3221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:09:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:09:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 -- 172.21.15.96:0/4160833312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 msgr2=0x7f3fec0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 --2- 172.21.15.96:0/4160833312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec0f6ce0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f3fdc004660 tx=0x7f3fdc009b30).stop 2022-02-02T20:09:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 -- 172.21.15.96:0/4160833312 shutdown_connections 2022-02-02T20:09:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 --2- 172.21.15.96:0/4160833312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec0f6ce0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 --2- 172.21.15.96:0/4160833312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 -- 172.21.15.96:0/4160833312 >> 172.21.15.96:0/4160833312 conn(0x7f3fec0f0d40 msgr2=0x7f3fec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 -- 172.21.15.96:0/4160833312 shutdown_connections 2022-02-02T20:09:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.385+0000 7f3ff2898700 1 -- 172.21.15.96:0/4160833312 wait complete. 2022-02-02T20:09:28.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 Processor -- start 2022-02-02T20:09:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 -- start start 2022-02-02T20:09:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec060540 con 0x7f3fec0f6880 2022-02-02T20:09:28.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3ff2898700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec060680 con 0x7f3fec0f55e0 2022-02-02T20:09:28.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35488/0 (socket says 172.21.15.96:35488) 2022-02-02T20:09:28.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.386+0000 7f3feb7fe700 1 -- 172.21.15.96:0/100440500 learned_addr learned my addr 172.21.15.96:0/100440500 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:28.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3febfff700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3feb7fe700 1 -- 172.21.15.96:0/100440500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 msgr2=0x7f3fec109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3feb7fe700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3feb7fe700 1 -- 172.21.15.96:0/100440500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc005040 con 0x7f3fec0f6880 2022-02-02T20:09:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3febfff700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:09:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3feb7fe700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f3fdc009990 tx=0x7f3fdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fdc018070 con 0x7f3fec0f6880 2022-02-02T20:09:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec10c6c0 con 0x7f3fec0f6880 2022-02-02T20:09:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fdc007ca0 con 0x7f3fec0f6880 2022-02-02T20:09:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fdc01c620 con 0x7f3fec0f6880 2022-02-02T20:09:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.387+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec10cbf0 con 0x7f3fec0f6880 2022-02-02T20:09:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.388+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec045ad0 con 0x7f3fec0f6880 2022-02-02T20:09:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.389+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fdc01d960 con 0x7f3fec0f6880 2022-02-02T20:09:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.389+0000 7f3fe8ff9700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 0x7f3fd4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.389+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3fdc0837c0 con 0x7f3fec0f6880 2022-02-02T20:09:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.389+0000 7f3febfff700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 0x7f3fd4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.390+0000 7f3febfff700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 0x7f3fd4067290 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3fec0601c0 tx=0x7f3fe0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.394+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fdc051800 con 0x7f3fec0f6880 2022-02-02T20:09:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.572+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fec057f10 con 0x7f3fd4064dd0 2022-02-02T20:09:28.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.573+0000 7f3fe8ff9700 1 -- 172.21.15.96:0/100440500 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3fec057f10 con 0x7f3fd4064dd0 2022-02-02T20:09:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 msgr2=0x7f3fd4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 0x7f3fd4067290 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3fec0601c0 tx=0x7f3fe0009040).stop 2022-02-02T20:09:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 msgr2=0x7f3fec10c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f3fdc009990 tx=0x7f3fdc009b30).stop 2022-02-02T20:09:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 shutdown_connections 2022-02-02T20:09:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fd4064dd0 0x7f3fd4067290 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0f55e0 0x7f3fec109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 --2- 172.21.15.96:0/100440500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec0f6880 0x7f3fec10c110 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 >> 172.21.15.96:0/100440500 conn(0x7f3fec0f0d40 msgr2=0x7f3fec0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 shutdown_connections 2022-02-02T20:09:28.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.575+0000 7f3ff2898700 1 -- 172.21.15.96:0/100440500 wait complete. 2022-02-02T20:09:28.588 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:09:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 -- 172.21.15.96:0/172834367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 msgr2=0x7efccc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 --2- 172.21.15.96:0/172834367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc0f6cc0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7efcbc004660 tx=0x7efcbc009b30).stop 2022-02-02T20:09:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 -- 172.21.15.96:0/172834367 shutdown_connections 2022-02-02T20:09:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 --2- 172.21.15.96:0/172834367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc0f6cc0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 --2- 172.21.15.96:0/172834367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 0x7efccc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 -- 172.21.15.96:0/172834367 >> 172.21.15.96:0/172834367 conn(0x7efccc0f0d40 msgr2=0x7efccc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 -- 172.21.15.96:0/172834367 shutdown_connections 2022-02-02T20:09:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.672+0000 7efcd0feb700 1 -- 172.21.15.96:0/172834367 wait complete. 2022-02-02T20:09:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 Processor -- start 2022-02-02T20:09:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 -- start start 2022-02-02T20:09:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 0x7efccc109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0603e0 con 0x7efccc0f6860 2022-02-02T20:09:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcd0feb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc060520 con 0x7efccc0f55c0 2022-02-02T20:09:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35498/0 (socket says 172.21.15.96:35498) 2022-02-02T20:09:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 -- 172.21.15.96:0/636930030 learned_addr learned my addr 172.21.15.96:0/636930030 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcca59c700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 0x7efccc109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 -- 172.21.15.96:0/636930030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 msgr2=0x7efccc109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 0x7efccc109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 -- 172.21.15.96:0/636930030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc005040 con 0x7efccc0f6860 2022-02-02T20:09:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.673+0000 7efcc9d9b700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7efcbc009990 tx=0x7efcbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.674+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc018070 con 0x7efccc0f6860 2022-02-02T20:09:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.674+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc10c6a0 con 0x7efccc0f6860 2022-02-02T20:09:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.674+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efcbc007ba0 con 0x7efccc0f6860 2022-02-02T20:09:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.674+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc01c3c0 con 0x7efccc0f6860 2022-02-02T20:09:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.674+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc10cc00 con 0x7efccc0f6860 2022-02-02T20:09:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.675+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc045ad0 con 0x7efccc0f6860 2022-02-02T20:09:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.675+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efcbc01d420 con 0x7efccc0f6860 2022-02-02T20:09:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.676+0000 7efcbaffd700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 0x7efcb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.676+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efcbc0831d0 con 0x7efccc0f6860 2022-02-02T20:09:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.676+0000 7efcca59c700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 0x7efcb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.676+0000 7efcca59c700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 0x7efcb4067290 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7efccc060060 tx=0x7efcc0009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.680+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efcbc0512d0 con 0x7efccc0f6860 2022-02-02T20:09:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.855+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efccc057f10 con 0x7efcb4064dd0 2022-02-02T20:09:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.864+0000 7efcbaffd700 1 -- 172.21.15.96:0/636930030 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7efccc057f10 con 0x7efcb4064dd0 2022-02-02T20:09:28.868 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:09:28.868 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (112m) 83m ago 113m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:09:28.868 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (105m) 83m ago 113m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:09:28.868 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (105m) 81m ago 113m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:09:28.869 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (112m) 83m ago 113m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:09:28.869 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (109m) 83m ago 109m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:09:28.869 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (105m) 83m ago 110m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:09:28.869 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (110m) 81m ago 109m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:09:28.870 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (105m) 81m ago 110m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:09:28.870 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (107m) 83m ago 115m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:09:28.870 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (106m) 81m ago 113m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:09:28.871 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (106m) 83m ago 115m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:09:28.871 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (105m) 81m ago 113m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:09:28.872 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (113m) 83m ago 113m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:09:28.872 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (113m) 81m ago 113m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:09:28.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (104m) 83m ago 112m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:09:28.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (104m) 83m ago 112m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:09:28.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (103m) 83m ago 112m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:09:28.874 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (103m) 81m ago 111m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:09:28.874 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (102m) 81m ago 111m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:09:28.875 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (102m) 81m ago 111m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:09:28.875 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (112m) 83m ago 113m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:09:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 msgr2=0x7efcb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 0x7efcb4067290 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7efccc060060 tx=0x7efcc0009c00).stop 2022-02-02T20:09:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 msgr2=0x7efccc10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7efcbc009990 tx=0x7efcbc009b30).stop 2022-02-02T20:09:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 shutdown_connections 2022-02-02T20:09:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efcb4064dd0 0x7efcb4067290 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efccc0f55c0 0x7efccc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 --2- 172.21.15.96:0/636930030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efccc0f6860 0x7efccc10c150 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 >> 172.21.15.96:0/636930030 conn(0x7efccc0f0d40 msgr2=0x7efccc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 shutdown_connections 2022-02-02T20:09:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.866+0000 7efcd0feb700 1 -- 172.21.15.96:0/636930030 wait complete. 2022-02-02T20:09:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 -- 172.21.15.96:0/2269959995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f6860 msgr2=0x7ff11c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 --2- 172.21.15.96:0/2269959995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f6860 0x7ff11c0f6cc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7ff10c004660 tx=0x7ff10c009b30).stop 2022-02-02T20:09:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 -- 172.21.15.96:0/2269959995 shutdown_connections 2022-02-02T20:09:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 --2- 172.21.15.96:0/2269959995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f6860 0x7ff11c0f6cc0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 --2- 172.21.15.96:0/2269959995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f55c0 0x7ff11c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 -- 172.21.15.96:0/2269959995 >> 172.21.15.96:0/2269959995 conn(0x7ff11c0f0d40 msgr2=0x7ff11c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:28.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 -- 172.21.15.96:0/2269959995 shutdown_connections 2022-02-02T20:09:28.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 -- 172.21.15.96:0/2269959995 wait complete. 2022-02-02T20:09:28.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.962+0000 7ff12086d700 1 Processor -- start 2022-02-02T20:09:28.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff12086d700 1 -- start start 2022-02-02T20:09:28.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff12086d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff12086d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 0x7ff11c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff12086d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0602d0 con 0x7ff11c0f55c0 2022-02-02T20:09:28.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff12086d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c060410 con 0x7ff11c0f6860 2022-02-02T20:09:28.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35504/0 (socket says 172.21.15.96:35504) 2022-02-02T20:09:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 -- 172.21.15.96:0/172126131 learned_addr learned my addr 172.21.15.96:0/172126131 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff119d9b700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 0x7ff11c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 -- 172.21.15.96:0/172126131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 msgr2=0x7ff11c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 0x7ff11c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 -- 172.21.15.96:0/172126131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c005040 con 0x7ff11c0f55c0 2022-02-02T20:09:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff119d9b700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 0x7ff11c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:09:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.963+0000 7ff11a59c700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7ff11000c530 tx=0x7ff110007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.964+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11000f650 con 0x7ff11c0f55c0 2022-02-02T20:09:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.964+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c10ea40 con 0x7ff11c0f55c0 2022-02-02T20:09:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.964+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff11000fc60 con 0x7ff11c0f55c0 2022-02-02T20:09:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.964+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff110012d20 con 0x7ff11c0f55c0 2022-02-02T20:09:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.964+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c10eec0 con 0x7ff11c0f55c0 2022-02-02T20:09:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.965+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c045ad0 con 0x7ff11c0f55c0 2022-02-02T20:09:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.965+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff110019030 con 0x7ff11c0f55c0 2022-02-02T20:09:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.966+0000 7ff10affd700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 0x7ff104067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.966+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff110081670 con 0x7ff11c0f55c0 2022-02-02T20:09:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.966+0000 7ff119d9b700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 0x7ff104067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.966+0000 7ff119d9b700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 0x7ff104067290 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7ff10c004e30 tx=0x7ff10c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:28.970+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff11004f880 con 0x7ff11c0f55c0 2022-02-02T20:09:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.201+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff11c0605a0 con 0x7ff11c0f55c0 2022-02-02T20:09:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.202+0000 7ff10affd700 1 -- 172.21.15.96:0/172126131 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff110052ea0 con 0x7ff11c0f55c0 2022-02-02T20:09:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:09:29.206 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:09:29.207 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:09:29.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:09:29.207 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:09:29.207 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:09:29.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:09:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:09:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:09:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:09:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:09:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:09:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:09:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:09:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:09:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:09:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:09:29.210 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:09:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 msgr2=0x7ff104067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 0x7ff104067290 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7ff10c004e30 tx=0x7ff10c009b30).stop 2022-02-02T20:09:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 msgr2=0x7ff11c10c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7ff11000c530 tx=0x7ff110007e10).stop 2022-02-02T20:09:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 shutdown_connections 2022-02-02T20:09:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff104064dd0 0x7ff104067290 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff11c0f55c0 0x7ff11c10c050 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 --2- 172.21.15.96:0/172126131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff11c0f6860 0x7ff11c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 >> 172.21.15.96:0/172126131 conn(0x7ff11c0f0d40 msgr2=0x7ff11c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 shutdown_connections 2022-02-02T20:09:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.204+0000 7ff12086d700 1 -- 172.21.15.96:0/172126131 wait complete. 2022-02-02T20:09:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 -- 172.21.15.96:0/2622022371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 msgr2=0x7f49a00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 --2- 172.21.15.96:0/2622022371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a00f59e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f4994004660 tx=0x7f4994009b30).stop 2022-02-02T20:09:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 -- 172.21.15.96:0/2622022371 shutdown_connections 2022-02-02T20:09:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 --2- 172.21.15.96:0/2622022371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 0x7f49a00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 --2- 172.21.15.96:0/2622022371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a00f59e0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 -- 172.21.15.96:0/2622022371 >> 172.21.15.96:0/2622022371 conn(0x7f49a00f0d40 msgr2=0x7f49a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 -- 172.21.15.96:0/2622022371 shutdown_connections 2022-02-02T20:09:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 -- 172.21.15.96:0/2622022371 wait complete. 2022-02-02T20:09:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.302+0000 7f49a484e700 1 Processor -- start 2022-02-02T20:09:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f49a484e700 1 -- start start 2022-02-02T20:09:29.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f49a484e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f49a484e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 0x7f49a0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f49a484e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0106910 con 0x7f49a00f55c0 2022-02-02T20:09:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f49a484e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0106a50 con 0x7f49a00f6860 2022-02-02T20:09:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35514/0 (socket says 172.21.15.96:35514) 2022-02-02T20:09:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 -- 172.21.15.96:0/1854492667 learned_addr learned my addr 172.21.15.96:0/1854492667 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499dd9b700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 0x7f49a0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 -- 172.21.15.96:0/1854492667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 msgr2=0x7f49a0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 0x7f49a0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 -- 172.21.15.96:0/1854492667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994005040 con 0x7f49a00f55c0 2022-02-02T20:09:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.303+0000 7f499e59c700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f4994004f60 tx=0x7f4994009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.304+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4994018070 con 0x7f49a00f55c0 2022-02-02T20:09:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.304+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4994009770 con 0x7f49a00f55c0 2022-02-02T20:09:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.304+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0107390 con 0x7f49a00f55c0 2022-02-02T20:09:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.304+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499401c3c0 con 0x7f49a00f55c0 2022-02-02T20:09:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.304+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a01078f0 con 0x7f49a00f55c0 2022-02-02T20:09:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.305+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a0045ad0 con 0x7f49a00f55c0 2022-02-02T20:09:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.305+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f499401d420 con 0x7f49a00f55c0 2022-02-02T20:09:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.305+0000 7f498effd700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 0x7f4988067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.306+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4994083780 con 0x7f49a00f55c0 2022-02-02T20:09:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.306+0000 7f499dd9b700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 0x7f4988067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.306+0000 7f499dd9b700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 0x7f4988067290 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f49900041d0 tx=0x7f4990009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:29.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.310+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49940552b0 con 0x7f49a00f55c0 2022-02-02T20:09:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.511+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49a00fde90 con 0x7f49a00f55c0 2022-02-02T20:09:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.511+0000 7f498effd700 1 -- 172.21.15.96:0/1854492667 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4994054ea0 con 0x7f49a00f55c0 2022-02-02T20:09:29.516 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:09:29.516 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:09:29.516 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:09:29.517 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:09:29.517 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:09:29.518 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:09:29.518 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:09:29.518 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:09:29.518 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:09:29.519 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:09:29.519 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:09:29.519 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:09:29.519 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:09:29.520 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:09:29.520 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:09:29.520 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:09:29.520 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:09:29.520 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:09:29.521 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:09:29.521 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:09:29.521 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:09:29.522 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:09:29.522 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:09:29.522 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:09:29.522 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:09:29.523 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:09:29.523 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:09:29.523 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:09:29.523 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:09:29.523 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:09:29.524 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:09:29.524 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:09:29.524 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:09:29.524 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:09:29.525 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:09:29.525 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:09:29.525 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:09:29.525 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:09:29.525 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:09:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 msgr2=0x7f4988067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 0x7f4988067290 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f49900041d0 tx=0x7f4990009040).stop 2022-02-02T20:09:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 msgr2=0x7f49a0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f4994004f60 tx=0x7f4994009b30).stop 2022-02-02T20:09:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 shutdown_connections 2022-02-02T20:09:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4988064dd0 0x7f4988067290 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49a00f55c0 0x7f49a0105e70 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 --2- 172.21.15.96:0/1854492667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49a00f6860 0x7f49a0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 >> 172.21.15.96:0/1854492667 conn(0x7f49a00f0d40 msgr2=0x7f49a00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 shutdown_connections 2022-02-02T20:09:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:29.513+0000 7f49a484e700 1 -- 172.21.15.96:0/1854492667 wait complete. 2022-02-02T20:09:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:09:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:29 smithi159 ceph-mon[69013]: from='client.37414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:09:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:29 smithi159 ceph-mon[69013]: pgmap v3222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:29 smithi159 ceph-mon[69013]: from='client.37418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:09:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/172126131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:09:30.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1854492667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:09:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:29 smithi096 ceph-mon[101353]: from='client.37414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:09:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:29 smithi096 ceph-mon[101353]: pgmap v3222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:29 smithi096 ceph-mon[101353]: from='client.37418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:09:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/172126131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:09:30.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1854492667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:09:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:31 smithi159 ceph-mon[69013]: pgmap v3223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:31 smithi096 ceph-mon[101353]: pgmap v3223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:33 smithi159 ceph-mon[69013]: pgmap v3224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:33 smithi096 ceph-mon[101353]: pgmap v3224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:35 smithi159 ceph-mon[69013]: pgmap v3225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:35 smithi096 ceph-mon[101353]: pgmap v3225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:37.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:37 smithi159 ceph-mon[69013]: pgmap v3226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:37 smithi096 ceph-mon[101353]: pgmap v3226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:39 smithi159 ceph-mon[69013]: pgmap v3227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:39 smithi096 ceph-mon[101353]: pgmap v3227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:41 smithi159 ceph-mon[69013]: pgmap v3228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:41 smithi096 ceph-mon[101353]: pgmap v3228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:43 smithi159 ceph-mon[69013]: pgmap v3229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:43 smithi096 ceph-mon[101353]: pgmap v3229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:45 smithi159 ceph-mon[69013]: pgmap v3230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:45 smithi096 ceph-mon[101353]: pgmap v3230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:47.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:47 smithi159 ceph-mon[69013]: pgmap v3231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:47 smithi096 ceph-mon[101353]: pgmap v3231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:49 smithi159 ceph-mon[69013]: pgmap v3232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:49 smithi096 ceph-mon[101353]: pgmap v3232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:51 smithi159 ceph-mon[69013]: pgmap v3233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:51 smithi096 ceph-mon[101353]: pgmap v3233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:53 smithi159 ceph-mon[69013]: pgmap v3234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:53 smithi096 ceph-mon[101353]: pgmap v3234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:55 smithi159 ceph-mon[69013]: pgmap v3235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:55 smithi096 ceph-mon[101353]: pgmap v3235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:57.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:57 smithi159 ceph-mon[69013]: pgmap v3236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:57 smithi096 ceph-mon[101353]: pgmap v3236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:09:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.624+0000 7f53fc878700 1 -- 172.21.15.96:0/4210866103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 msgr2=0x7f53f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.624+0000 7f53fc878700 1 --2- 172.21.15.96:0/4210866103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f80f6cc0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f53ec004660 tx=0x7f53ec009b30).stop 2022-02-02T20:09:59.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.624+0000 7f53fc878700 1 -- 172.21.15.96:0/4210866103 shutdown_connections 2022-02-02T20:09:59.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.625+0000 7f53fc878700 1 --2- 172.21.15.96:0/4210866103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f80f6cc0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.625+0000 7f53fc878700 1 --2- 172.21.15.96:0/4210866103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 0x7f53f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.625+0000 7f53fc878700 1 -- 172.21.15.96:0/4210866103 >> 172.21.15.96:0/4210866103 conn(0x7f53f80f0d40 msgr2=0x7f53f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:59.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.625+0000 7f53fc878700 1 -- 172.21.15.96:0/4210866103 shutdown_connections 2022-02-02T20:09:59.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.625+0000 7f53fc878700 1 -- 172.21.15.96:0/4210866103 wait complete. 2022-02-02T20:09:59.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 Processor -- start 2022-02-02T20:09:59.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 -- start start 2022-02-02T20:09:59.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 0x7f53f8105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8106920 con 0x7f53f80f6860 2022-02-02T20:09:59.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53fc878700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8107130 con 0x7f53f80f55c0 2022-02-02T20:09:59.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35536/0 (socket says 172.21.15.96:35536) 2022-02-02T20:09:59.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 -- 172.21.15.96:0/2455388012 learned_addr learned my addr 172.21.15.96:0/2455388012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:59.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f659c700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 0x7f53f8105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 -- 172.21.15.96:0/2455388012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 msgr2=0x7f53f8105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 0x7f53f8105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.626+0000 7f53f5d9b700 1 -- 172.21.15.96:0/2455388012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec005040 con 0x7f53f80f6860 2022-02-02T20:09:59.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53f5d9b700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f53ec009990 tx=0x7f53ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:59.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec018070 con 0x7f53f80f6860 2022-02-02T20:09:59.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f53ec007ba0 con 0x7f53f80f6860 2022-02-02T20:09:59.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f8107350 con 0x7f53f80f6860 2022-02-02T20:09:59.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f81078b0 con 0x7f53f80f6860 2022-02-02T20:09:59.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.627+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec01c3c0 con 0x7f53f80f6860 2022-02-02T20:09:59.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.628+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc004fa0 con 0x7f53f80f6860 2022-02-02T20:09:59.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.628+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f53ec01d420 con 0x7f53f80f6860 2022-02-02T20:09:59.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.629+0000 7f53e6ffd700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 0x7f53e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.629+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f53ec083650 con 0x7f53f80f6860 2022-02-02T20:09:59.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.629+0000 7f53f659c700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 0x7f53e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.629+0000 7f53f659c700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 0x7f53e0067290 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f53f8105ba0 tx=0x7f53e800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:59.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.633+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f53ec051750 con 0x7f53f80f6860 2022-02-02T20:09:59.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.813+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53dc000bc0 con 0x7f53e0064dd0 2022-02-02T20:09:59.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.814+0000 7f53e6ffd700 1 -- 172.21.15.96:0/2455388012 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f53dc000bc0 con 0x7f53e0064dd0 2022-02-02T20:09:59.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 msgr2=0x7f53e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 0x7f53e0067290 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f53f8105ba0 tx=0x7f53e800b040).stop 2022-02-02T20:09:59.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 msgr2=0x7f53f8106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f53ec009990 tx=0x7f53ec009b30).stop 2022-02-02T20:09:59.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 shutdown_connections 2022-02-02T20:09:59.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53e0064dd0 0x7f53e0067290 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53f80f55c0 0x7f53f8105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 --2- 172.21.15.96:0/2455388012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f80f6860 0x7f53f8106320 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 >> 172.21.15.96:0/2455388012 conn(0x7f53f80f0d40 msgr2=0x7f53f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 shutdown_connections 2022-02-02T20:09:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.816+0000 7f53fc878700 1 -- 172.21.15.96:0/2455388012 wait complete. 2022-02-02T20:09:59.828 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:09:59.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 -- 172.21.15.96:0/2006792572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f380f96c0 msgr2=0x7f9f380fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/2006792572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f380f96c0 0x7f9f380fbaf0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f9f2c004660 tx=0x7f9f2c009b30).stop 2022-02-02T20:09:59.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 -- 172.21.15.96:0/2006792572 shutdown_connections 2022-02-02T20:09:59.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/2006792572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f380f96c0 0x7f9f380fbaf0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/2006792572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f38060250 0x7f9f380f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:09:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 -- 172.21.15.96:0/2006792572 >> 172.21.15.96:0/2006792572 conn(0x7f9f380f0b90 msgr2=0x7f9f380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:09:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 -- 172.21.15.96:0/2006792572 shutdown_connections 2022-02-02T20:09:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.915+0000 7f9f3db5b700 1 -- 172.21.15.96:0/2006792572 wait complete. 2022-02-02T20:09:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 Processor -- start 2022-02-02T20:09:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 -- start start 2022-02-02T20:09:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f380f96c0 0x7f9f381072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38107980 con 0x7f9f38060250 2022-02-02T20:09:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.916+0000 7f9f3db5b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38108100 con 0x7f9f380f96c0 2022-02-02T20:09:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35544/0 (socket says 172.21.15.96:35544) 2022-02-02T20:09:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 -- 172.21.15.96:0/3982144947 learned_addr learned my addr 172.21.15.96:0/3982144947 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:09:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f37fff700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f380f96c0 0x7f9f381072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 -- 172.21.15.96:0/3982144947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f380f96c0 msgr2=0x7f9f381072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:09:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f380f96c0 0x7f9f381072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:09:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 -- 172.21.15.96:0/3982144947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c005040 con 0x7f9f38060250 2022-02-02T20:09:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3cb59700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f9f2800b410 tx=0x7f9f28006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f280125f0 con 0x7f9f38060250 2022-02-02T20:09:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38108380 con 0x7f9f38060250 2022-02-02T20:09:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f2800be30 con 0x7f9f38060250 2022-02-02T20:09:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f28002a70 con 0x7f9f38060250 2022-02-02T20:09:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.917+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38108940 con 0x7f9f38060250 2022-02-02T20:09:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.918+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f38045ad0 con 0x7f9f38060250 2022-02-02T20:09:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.919+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f2800f030 con 0x7f9f38060250 2022-02-02T20:09:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.919+0000 7f9f357fa700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 0x7f9f200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:09:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.919+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f28081e60 con 0x7f9f38060250 2022-02-02T20:09:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.919+0000 7f9f37fff700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 0x7f9f200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:09:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.919+0000 7f9f37fff700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 0x7f9f200672e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9f2c013690 tx=0x7f9f2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:09:59.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:09:59.923+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f2804ff60 con 0x7f9f38060250 2022-02-02T20:10:00.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.094+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f380feef0 con 0x7f9f20064e20 2022-02-02T20:10:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.104+0000 7f9f357fa700 1 -- 172.21.15.96:0/3982144947 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f9f380feef0 con 0x7f9f20064e20 2022-02-02T20:10:00.106 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:10:00.107 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (113m) 83m ago 114m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:10:00.107 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (105m) 83m ago 114m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:10:00.107 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (105m) 82m ago 113m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:10:00.107 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (113m) 83m ago 114m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:10:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (110m) 83m ago 110m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:10:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (106m) 83m ago 110m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:10:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (110m) 82m ago 110m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:10:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (106m) 82m ago 110m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:10:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (107m) 83m ago 115m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:10:00.109 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (107m) 82m ago 113m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:10:00.109 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (106m) 83m ago 115m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:10:00.109 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (106m) 82m ago 113m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:10:00.109 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (114m) 83m ago 114m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:10:00.110 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (113m) 82m ago 113m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:10:00.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (105m) 83m ago 113m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:10:00.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (104m) 83m ago 112m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:10:00.110 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (104m) 83m ago 112m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:10:00.111 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (103m) 82m ago 112m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:10:00.111 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (103m) 82m ago 112m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:10:00.111 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (102m) 82m ago 111m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:10:00.111 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (113m) 83m ago 114m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:10:00.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 msgr2=0x7f9f200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 0x7f9f200672e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9f2c013690 tx=0x7f9f2c009b30).stop 2022-02-02T20:10:00.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 msgr2=0x7f9f38106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f9f2800b410 tx=0x7f9f28006ef0).stop 2022-02-02T20:10:00.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 shutdown_connections 2022-02-02T20:10:00.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f20064e20 0x7f9f200672e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f38060250 0x7f9f38106e00 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 --2- 172.21.15.96:0/3982144947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f380f96c0 0x7f9f381072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 >> 172.21.15.96:0/3982144947 conn(0x7f9f380f0b90 msgr2=0x7f9f380f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:00.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 shutdown_connections 2022-02-02T20:10:00.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.106+0000 7f9f3db5b700 1 -- 172.21.15.96:0/3982144947 wait complete. 2022-02-02T20:10:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 -- 172.21.15.96:0/1928988763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 msgr2=0x7f810c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 --2- 172.21.15.96:0/1928988763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c0f7c30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f8100004660 tx=0x7f8100009b30).stop 2022-02-02T20:10:00.206 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:09:59 smithi096 ceph-mon[101353]: pgmap v3237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:00.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 -- 172.21.15.96:0/1928988763 shutdown_connections 2022-02-02T20:10:00.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 --2- 172.21.15.96:0/1928988763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c0f7c30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 --2- 172.21.15.96:0/1928988763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 0x7f810c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.202+0000 7f811086f700 1 -- 172.21.15.96:0/1928988763 >> 172.21.15.96:0/1928988763 conn(0x7f810c0f1c90 msgr2=0x7f810c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.203+0000 7f811086f700 1 -- 172.21.15.96:0/1928988763 shutdown_connections 2022-02-02T20:10:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.203+0000 7f811086f700 1 -- 172.21.15.96:0/1928988763 wait complete. 2022-02-02T20:10:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.203+0000 7f811086f700 1 Processor -- start 2022-02-02T20:10:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f811086f700 1 -- start start 2022-02-02T20:10:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f811086f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 0x7f810c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f811086f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f811086f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c06a380 con 0x7f810c0f77d0 2022-02-02T20:10:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f811086f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c06a4c0 con 0x7f810c0f6530 2022-02-02T20:10:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35556/0 (socket says 172.21.15.96:35556) 2022-02-02T20:10:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 -- 172.21.15.96:0/1217505493 learned_addr learned my addr 172.21.15.96:0/1217505493 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810ad9d700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 0x7f810c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 -- 172.21.15.96:0/1217505493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 msgr2=0x7f810c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 0x7f810c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 -- 172.21.15.96:0/1217505493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100005040 con 0x7f810c0f77d0 2022-02-02T20:10:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f810a59c700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f8100009990 tx=0x7f8100009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.204+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8100018070 con 0x7f810c0f77d0 2022-02-02T20:10:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.205+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c06a740 con 0x7f810c0f77d0 2022-02-02T20:10:00.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.205+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8100007ba0 con 0x7f810c0f77d0 2022-02-02T20:10:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.205+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810001c3c0 con 0x7f810c0f77d0 2022-02-02T20:10:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.205+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c06aca0 con 0x7f810c0f77d0 2022-02-02T20:10:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.206+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c045ad0 con 0x7f810c0f77d0 2022-02-02T20:10:00.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.206+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f810001d420 con 0x7f810c0f77d0 2022-02-02T20:10:00.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.206+0000 7f80f37fe700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.206+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8100083680 con 0x7f810c0f77d0 2022-02-02T20:10:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.206+0000 7f810ad9d700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.207+0000 7f810ad9d700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f810c06b730 tx=0x7f80fc009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.211+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8100051720 con 0x7f810c0f77d0 2022-02-02T20:10:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:09:59 smithi159 ceph-mon[69013]: pgmap v3237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:00.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.440+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f810c027a00 con 0x7f810c0f77d0 2022-02-02T20:10:00.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.440+0000 7f80f37fe700 1 -- 172.21.15.96:0/1217505493 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8100054d40 con 0x7f810c0f77d0 2022-02-02T20:10:00.444 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:10:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:10:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:10:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:10:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:10:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:10:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:10:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:10:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:10:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:10:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:10:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:10:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:10:00.447 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:10:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 msgr2=0x7f80f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f810c06b730 tx=0x7f80fc009c00).stop 2022-02-02T20:10:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 msgr2=0x7f810c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f8100009990 tx=0x7f8100009b30).stop 2022-02-02T20:10:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 shutdown_connections 2022-02-02T20:10:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80f4064e20 0x7f80f40672e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0f6530 0x7f810c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 --2- 172.21.15.96:0/1217505493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f810c0f77d0 0x7f810c069e20 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 >> 172.21.15.96:0/1217505493 conn(0x7f810c0f1c90 msgr2=0x7f810c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 shutdown_connections 2022-02-02T20:10:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.443+0000 7f811086f700 1 -- 172.21.15.96:0/1217505493 wait complete. 2022-02-02T20:10:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- 172.21.15.96:0/4134952946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 msgr2=0x7fe5640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 --2- 172.21.15.96:0/4134952946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe5640f6cc0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fe550004660 tx=0x7fe550009b30).stop 2022-02-02T20:10:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- 172.21.15.96:0/4134952946 shutdown_connections 2022-02-02T20:10:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 --2- 172.21.15.96:0/4134952946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe5640f6cc0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 --2- 172.21.15.96:0/4134952946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 0x7fe5640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- 172.21.15.96:0/4134952946 >> 172.21.15.96:0/4134952946 conn(0x7fe5640f0d40 msgr2=0x7fe5640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- 172.21.15.96:0/4134952946 shutdown_connections 2022-02-02T20:10:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- 172.21.15.96:0/4134952946 wait complete. 2022-02-02T20:10:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 Processor -- start 2022-02-02T20:10:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.540+0000 7fe56abca700 1 -- start start 2022-02-02T20:10:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe56abca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 0x7fe564109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe56abca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe56abca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640603e0 con 0x7fe5640f6860 2022-02-02T20:10:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe56abca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564060520 con 0x7fe5640f55c0 2022-02-02T20:10:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35566/0 (socket says 172.21.15.96:35566) 2022-02-02T20:10:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 -- 172.21.15.96:0/1528951002 learned_addr learned my addr 172.21.15.96:0/1528951002 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe568966700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 0x7fe564109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 -- 172.21.15.96:0/1528951002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 msgr2=0x7fe564109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 0x7fe564109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.541+0000 7fe563fff700 1 -- 172.21.15.96:0/1528951002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550005040 con 0x7fe5640f6860 2022-02-02T20:10:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe563fff700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fe550009990 tx=0x7fe550009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe550018070 con 0x7fe5640f6860 2022-02-02T20:10:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe550007ba0 con 0x7fe5640f6860 2022-02-02T20:10:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56410c6a0 con 0x7fe5640f6860 2022-02-02T20:10:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55001c3c0 con 0x7fe5640f6860 2022-02-02T20:10:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.542+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56410cc00 con 0x7fe5640f6860 2022-02-02T20:10:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.543+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe564045ad0 con 0x7fe5640f6860 2022-02-02T20:10:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.543+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe55001d420 con 0x7fe5640f6860 2022-02-02T20:10:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.544+0000 7fe5617fa700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 0x7fe554067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.544+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5500836b0 con 0x7fe5640f6860 2022-02-02T20:10:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.544+0000 7fe568966700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 0x7fe554067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:00.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.544+0000 7fe568966700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 0x7fe554067290 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fe564060060 tx=0x7fe55800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:00.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.548+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe550051810 con 0x7fe5640f6860 2022-02-02T20:10:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.748+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe5640fde20 con 0x7fe5640f6860 2022-02-02T20:10:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.749+0000 7fe5617fa700 1 -- 172.21.15.96:0/1528951002 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe550054e30 con 0x7fe5640f6860 2022-02-02T20:10:00.752 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:10:00.752 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:10:00.753 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:10:00.753 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:10:00.753 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:00.753 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:10:00.753 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:10:00.754 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:10:00.754 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:10:00.754 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:10:00.754 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:10:00.755 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:10:00.755 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:10:00.755 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:10:00.755 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:10:00.756 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:10:00.756 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:10:00.756 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:10:00.756 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:10:00.756 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:10:00.757 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:10:00.757 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:10:00.757 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:10:00.757 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:10:00.758 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:10:00.758 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:10:00.758 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:10:00.758 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:10:00.758 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:10:00.759 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:10:00.759 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:10:00.759 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:10:00.759 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:00.760 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:00.760 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:10:00.760 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:00.760 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:00.760 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:00.761 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 msgr2=0x7fe554067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 0x7fe554067290 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fe564060060 tx=0x7fe55800b040).stop 2022-02-02T20:10:00.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 msgr2=0x7fe56410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fe550009990 tx=0x7fe550009b30).stop 2022-02-02T20:10:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 shutdown_connections 2022-02-02T20:10:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe554064dd0 0x7fe554067290 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f55c0 0x7fe564109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 --2- 172.21.15.96:0/1528951002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5640f6860 0x7fe56410c150 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 >> 172.21.15.96:0/1528951002 conn(0x7fe5640f0d40 msgr2=0x7fe5640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 shutdown_connections 2022-02-02T20:10:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:00.752+0000 7fe56abca700 1 -- 172.21.15.96:0/1528951002 wait complete. 2022-02-02T20:10:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:10:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:00 smithi159 ceph-mon[69013]: from='client.37430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:10:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:00 smithi159 ceph-mon[69013]: from='client.37434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1217505493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:10:01.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1528951002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:10:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:00 smithi096 ceph-mon[101353]: from='client.37430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:10:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:00 smithi096 ceph-mon[101353]: from='client.37434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1217505493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:10:01.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1528951002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:10:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:01 smithi159 ceph-mon[69013]: pgmap v3238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:01 smithi096 ceph-mon[101353]: pgmap v3238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:03 smithi159 ceph-mon[69013]: pgmap v3239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:03 smithi096 ceph-mon[101353]: pgmap v3239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:05 smithi159 ceph-mon[69013]: pgmap v3240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:05 smithi096 ceph-mon[101353]: pgmap v3240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:07 smithi159 ceph-mon[69013]: pgmap v3241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:07 smithi096 ceph-mon[101353]: pgmap v3241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:09 smithi159 ceph-mon[69013]: pgmap v3242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:09 smithi096 ceph-mon[101353]: pgmap v3242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:11 smithi159 ceph-mon[69013]: pgmap v3243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:11 smithi096 ceph-mon[101353]: pgmap v3243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:14.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:13 smithi159 ceph-mon[69013]: pgmap v3244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:13 smithi096 ceph-mon[101353]: pgmap v3244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:15 smithi159 ceph-mon[69013]: pgmap v3245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:15 smithi096 ceph-mon[101353]: pgmap v3245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:17 smithi159 ceph-mon[69013]: pgmap v3246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:17 smithi096 ceph-mon[101353]: pgmap v3246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:19 smithi159 ceph-mon[69013]: pgmap v3247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:19 smithi096 ceph-mon[101353]: pgmap v3247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:22.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:21 smithi159 ceph-mon[69013]: pgmap v3248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:21 smithi096 ceph-mon[101353]: pgmap v3248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:23 smithi159 ceph-mon[69013]: pgmap v3249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:23 smithi096 ceph-mon[101353]: pgmap v3249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:25 smithi159 ceph-mon[69013]: pgmap v3250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:25 smithi096 ceph-mon[101353]: pgmap v3250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:27 smithi159 ceph-mon[69013]: pgmap v3251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:10:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:10:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:27 smithi096 ceph-mon[101353]: pgmap v3251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:10:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:10:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:29 smithi159 ceph-mon[69013]: pgmap v3252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:29 smithi096 ceph-mon[101353]: pgmap v3252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- 172.21.15.96:0/875332615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f5440 msgr2=0x7fcef40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 --2- 172.21.15.96:0/875332615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f5440 0x7fcef40f5860 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fcee8004660 tx=0x7fcee8009b30).stop 2022-02-02T20:10:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- 172.21.15.96:0/875332615 shutdown_connections 2022-02-02T20:10:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 --2- 172.21.15.96:0/875332615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f66e0 0x7fcef40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:10:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 --2- 172.21.15.96:0/875332615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f5440 0x7fcef40f5860 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- 172.21.15.96:0/875332615 >> 172.21.15.96:0/875332615 conn(0x7fcef40f0ba0 msgr2=0x7fcef40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- 172.21.15.96:0/875332615 shutdown_connections 2022-02-02T20:10:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- 172.21.15.96:0/875332615 wait complete. 2022-02-02T20:10:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 Processor -- start 2022-02-02T20:10:30.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.863+0000 7fcef359e700 1 -- start start 2022-02-02T20:10:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 0x7fcef4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef4069820 con 0x7fcef40f66e0 2022-02-02T20:10:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef410f800 con 0x7fcef40f5440 2022-02-02T20:10:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35584/0 (socket says 172.21.15.96:35584) 2022-02-02T20:10:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 -- 172.21.15.96:0/2209422990 learned_addr learned my addr 172.21.15.96:0/2209422990 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef259c700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 0x7fcef4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 -- 172.21.15.96:0/2209422990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 msgr2=0x7fcef4068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 0x7fcef4068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 -- 172.21.15.96:0/2209422990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8005040 con 0x7fcef40f66e0 2022-02-02T20:10:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef259c700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 0x7fcef4068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:10:30.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.864+0000 7fcef1d9b700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fcee400b410 tx=0x7fcee4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.865+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee40125f0 con 0x7fcef40f66e0 2022-02-02T20:10:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.865+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcee4012c00 con 0x7fcef40f66e0 2022-02-02T20:10:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.865+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef410fab0 con 0x7fcef40f66e0 2022-02-02T20:10:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.865+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef4110070 con 0x7fcef40f66e0 2022-02-02T20:10:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.865+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee4002ae0 con 0x7fcef40f66e0 2022-02-02T20:10:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.866+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8004fa0 con 0x7fcef40f66e0 2022-02-02T20:10:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.866+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcee400f030 con 0x7fcef40f66e0 2022-02-02T20:10:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.867+0000 7fcee2ffd700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 0x7fcedc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.867+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcee4081e50 con 0x7fcef40f66e0 2022-02-02T20:10:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.867+0000 7fcef259c700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 0x7fcedc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.867+0000 7fcef259c700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 0x7fcedc0672e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fcee8004e30 tx=0x7fcee8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:30.871+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcee4053a30 con 0x7fcef40f66e0 2022-02-02T20:10:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.050+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fced8000bc0 con 0x7fcedc064e20 2022-02-02T20:10:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.051+0000 7fcee2ffd700 1 -- 172.21.15.96:0/2209422990 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fced8000bc0 con 0x7fcedc064e20 2022-02-02T20:10:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 msgr2=0x7fcedc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 0x7fcedc0672e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fcee8004e30 tx=0x7fcee8009b30).stop 2022-02-02T20:10:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 msgr2=0x7fcef4069190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fcee400b410 tx=0x7fcee4006ef0).stop 2022-02-02T20:10:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 shutdown_connections 2022-02-02T20:10:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcedc064e20 0x7fcedc0672e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef40f5440 0x7fcef4068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 --2- 172.21.15.96:0/2209422990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef40f66e0 0x7fcef4069190 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 >> 172.21.15.96:0/2209422990 conn(0x7fcef40f0ba0 msgr2=0x7fcef40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 shutdown_connections 2022-02-02T20:10:31.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.053+0000 7fcef359e700 1 -- 172.21.15.96:0/2209422990 wait complete. 2022-02-02T20:10:31.065 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:10:31.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 -- 172.21.15.96:0/976352738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 msgr2=0x7f5f740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 --2- 172.21.15.96:0/976352738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f740f59e0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f5f64004660 tx=0x7f5f64009b30).stop 2022-02-02T20:10:31.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 -- 172.21.15.96:0/976352738 shutdown_connections 2022-02-02T20:10:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 --2- 172.21.15.96:0/976352738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 0x7f5f740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 --2- 172.21.15.96:0/976352738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f740f59e0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 -- 172.21.15.96:0/976352738 >> 172.21.15.96:0/976352738 conn(0x7f5f740f0d40 msgr2=0x7f5f740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 -- 172.21.15.96:0/976352738 shutdown_connections 2022-02-02T20:10:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.151+0000 7f5f7a703700 1 -- 172.21.15.96:0/976352738 wait complete. 2022-02-02T20:10:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.152+0000 7f5f7a703700 1 Processor -- start 2022-02-02T20:10:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.152+0000 7f5f7a703700 1 -- start start 2022-02-02T20:10:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 0x7f5f7410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740603c0 con 0x7f5f740f55c0 2022-02-02T20:10:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74060500 con 0x7f5f740f6860 2022-02-02T20:10:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35592/0 (socket says 172.21.15.96:35592) 2022-02-02T20:10:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 -- 172.21.15.96:0/798960485 learned_addr learned my addr 172.21.15.96:0/798960485 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f737fe700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 0x7f5f7410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 -- 172.21.15.96:0/798960485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 msgr2=0x7f5f7410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 0x7f5f7410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 -- 172.21.15.96:0/798960485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64005040 con 0x7f5f740f55c0 2022-02-02T20:10:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f73fff700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f5f64013a70 tx=0x7f5f64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f64018070 con 0x7f5f740f55c0 2022-02-02T20:10:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f640097d0 con 0x7f5f740f55c0 2022-02-02T20:10:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7410c6e0 con 0x7f5f740f55c0 2022-02-02T20:10:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6401c3c0 con 0x7f5f740f55c0 2022-02-02T20:10:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.153+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7410cc10 con 0x7f5f740f55c0 2022-02-02T20:10:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.155+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f740f49b0 con 0x7f5f740f55c0 2022-02-02T20:10:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.155+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f64007ba0 con 0x7f5f740f55c0 2022-02-02T20:10:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.155+0000 7f5f70ff9700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 0x7f5f60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.155+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f640836d0 con 0x7f5f740f55c0 2022-02-02T20:10:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.155+0000 7f5f737fe700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 0x7f5f60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.156+0000 7f5f737fe700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 0x7f5f60067290 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f5f5c004a70 tx=0x7f5f5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.159+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f64051890 con 0x7f5f740f55c0 2022-02-02T20:10:31.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.330+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f740fdf30 con 0x7f5f60064dd0 2022-02-02T20:10:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.340+0000 7f5f70ff9700 1 -- 172.21.15.96:0/798960485 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f5f5c00f040 con 0x7f5f60064dd0 2022-02-02T20:10:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:10:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (113m) 84m ago 115m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:10:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (106m) 84m ago 114m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:10:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (106m) 82m ago 114m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:10:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (113m) 84m ago 114m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:10:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (110m) 84m ago 110m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:10:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (106m) 84m ago 111m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:10:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (111m) 82m ago 111m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:10:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (106m) 82m ago 111m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:10:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (108m) 84m ago 116m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:10:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (107m) 82m ago 114m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:10:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (107m) 84m ago 116m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:10:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (106m) 82m ago 114m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:10:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (114m) 84m ago 114m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:10:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (114m) 82m ago 114m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:10:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (105m) 84m ago 113m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:10:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (105m) 84m ago 113m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:10:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (104m) 84m ago 113m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:10:31.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (104m) 82m ago 112m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:10:31.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (103m) 82m ago 112m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:10:31.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (103m) 82m ago 112m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:10:31.348 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (113m) 84m ago 114m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:10:31.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 msgr2=0x7f5f60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 0x7f5f60067290 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f5f5c004a70 tx=0x7f5f5c00b040).stop 2022-02-02T20:10:31.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 msgr2=0x7f5f74109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f5f64013a70 tx=0x7f5f64009b30).stop 2022-02-02T20:10:31.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 shutdown_connections 2022-02-02T20:10:31.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f60064dd0 0x7f5f60067290 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740f55c0 0x7f5f74109c90 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 --2- 172.21.15.96:0/798960485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f740f6860 0x7f5f7410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 >> 172.21.15.96:0/798960485 conn(0x7f5f740f0d40 msgr2=0x7f5f740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 shutdown_connections 2022-02-02T20:10:31.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.342+0000 7f5f7a703700 1 -- 172.21.15.96:0/798960485 wait complete. 2022-02-02T20:10:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.437+0000 7fde6cc7a700 1 -- 172.21.15.96:0/193390047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680f96f0 msgr2=0x7fde680fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.437+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/193390047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680f96f0 0x7fde680fbae0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fde58004660 tx=0x7fde58009b30).stop 2022-02-02T20:10:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.437+0000 7fde6cc7a700 1 -- 172.21.15.96:0/193390047 shutdown_connections 2022-02-02T20:10:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.437+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/193390047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680f96f0 0x7fde680fbae0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.437+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/193390047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680602b0 0x7fde680f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.438+0000 7fde6cc7a700 1 -- 172.21.15.96:0/193390047 >> 172.21.15.96:0/193390047 conn(0x7fde680f0b90 msgr2=0x7fde680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.438+0000 7fde6cc7a700 1 -- 172.21.15.96:0/193390047 shutdown_connections 2022-02-02T20:10:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.438+0000 7fde6cc7a700 1 -- 172.21.15.96:0/193390047 wait complete. 2022-02-02T20:10:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.438+0000 7fde6cc7a700 1 Processor -- start 2022-02-02T20:10:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.438+0000 7fde6cc7a700 1 -- start start 2022-02-02T20:10:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde6cc7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde6cc7a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680f96f0 0x7fde68107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde6cc7a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68107820 con 0x7fde680602b0 2022-02-02T20:10:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde6cc7a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68108030 con 0x7fde680f96f0 2022-02-02T20:10:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35606/0 (socket says 172.21.15.96:35606) 2022-02-02T20:10:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 -- 172.21.15.96:0/2612831335 learned_addr learned my addr 172.21.15.96:0/2612831335 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde66ffd700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680f96f0 0x7fde68107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 -- 172.21.15.96:0/2612831335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680f96f0 msgr2=0x7fde68107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680f96f0 0x7fde68107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 -- 172.21.15.96:0/2612831335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58005040 con 0x7fde680602b0 2022-02-02T20:10:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde677fe700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fde5c002700 tx=0x7fde5c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.439+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5c009320 con 0x7fde680602b0 2022-02-02T20:10:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.440+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde681082b0 con 0x7fde680602b0 2022-02-02T20:10:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.440+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde5c00f040 con 0x7fde680602b0 2022-02-02T20:10:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.440+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5c014870 con 0x7fde680602b0 2022-02-02T20:10:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.440+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde68108870 con 0x7fde680602b0 2022-02-02T20:10:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.440+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde68059100 con 0x7fde680602b0 2022-02-02T20:10:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.441+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde5c009480 con 0x7fde680602b0 2022-02-02T20:10:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.442+0000 7fde4ffff700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 0x7fde500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.442+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde5c082270 con 0x7fde680602b0 2022-02-02T20:10:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.442+0000 7fde66ffd700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 0x7fde500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.442+0000 7fde66ffd700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 0x7fde500672e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fde58004630 tx=0x7fde58009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.445+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde5c0503c0 con 0x7fde680602b0 2022-02-02T20:10:31.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.677+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde680fed50 con 0x7fde680602b0 2022-02-02T20:10:31.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.678+0000 7fde4ffff700 1 -- 172.21.15.96:0/2612831335 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fde5c0539e0 con 0x7fde680602b0 2022-02-02T20:10:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:10:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:10:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:10:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:10:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:10:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:10:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:10:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:10:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:10:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:10:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:10:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:10:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:10:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:10:31.685 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:10:31.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 msgr2=0x7fde500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 0x7fde500672e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fde58004630 tx=0x7fde58009b30).stop 2022-02-02T20:10:31.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 msgr2=0x7fde68106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fde5c002700 tx=0x7fde5c009e00).stop 2022-02-02T20:10:31.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 shutdown_connections 2022-02-02T20:10:31.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde50064e20 0x7fde500672e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde680602b0 0x7fde68106d30 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 --2- 172.21.15.96:0/2612831335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde680f96f0 0x7fde68107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 >> 172.21.15.96:0/2612831335 conn(0x7fde680f0b90 msgr2=0x7fde680f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 shutdown_connections 2022-02-02T20:10:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.680+0000 7fde6cc7a700 1 -- 172.21.15.96:0/2612831335 wait complete. 2022-02-02T20:10:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- 172.21.15.96:0/2826735724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 msgr2=0x7f22600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 --2- 172.21.15.96:0/2826735724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f6cc0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7f2254004660 tx=0x7f2254009b30).stop 2022-02-02T20:10:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- 172.21.15.96:0/2826735724 shutdown_connections 2022-02-02T20:10:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 --2- 172.21.15.96:0/2826735724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f6cc0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 --2- 172.21.15.96:0/2826735724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 0x7f22600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- 172.21.15.96:0/2826735724 >> 172.21.15.96:0/2826735724 conn(0x7f22600f0d40 msgr2=0x7f22600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- 172.21.15.96:0/2826735724 shutdown_connections 2022-02-02T20:10:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- 172.21.15.96:0/2826735724 wait complete. 2022-02-02T20:10:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 Processor -- start 2022-02-02T20:10:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.778+0000 7f2265cec700 1 -- start start 2022-02-02T20:10:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f2265cec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 0x7f22600f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f2265cec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f2265cec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600f8100 con 0x7f22600f6860 2022-02-02T20:10:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f2265cec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600f8240 con 0x7f22600f55c0 2022-02-02T20:10:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35616/0 (socket says 172.21.15.96:35616) 2022-02-02T20:10:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 -- 172.21.15.96:0/2633705202 learned_addr learned my addr 172.21.15.96:0/2633705202 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:10:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225f7fe700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 0x7f22600f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 -- 172.21.15.96:0/2633705202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 msgr2=0x7f22600f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 0x7f22600f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 -- 172.21.15.96:0/2633705202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254005040 con 0x7f22600f6860 2022-02-02T20:10:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f225effd700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f2254009990 tx=0x7f2254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.779+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2254018070 con 0x7f22600f6860 2022-02-02T20:10:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.780+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2254007ba0 con 0x7f22600f6860 2022-02-02T20:10:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.780+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22600f84c0 con 0x7f22600f6860 2022-02-02T20:10:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.780+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225401c620 con 0x7f22600f6860 2022-02-02T20:10:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.780+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22600f8a20 con 0x7f22600f6860 2022-02-02T20:10:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.781+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2260045ad0 con 0x7f22600f6860 2022-02-02T20:10:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.781+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f225401d420 con 0x7f22600f6860 2022-02-02T20:10:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.781+0000 7f2247fff700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 0x7f2248067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:10:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.782+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2254083880 con 0x7f22600f6860 2022-02-02T20:10:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.782+0000 7f225f7fe700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 0x7f2248067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:10:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.782+0000 7f225f7fe700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 0x7f2248067290 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f22600f94b0 tx=0x7f2250009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:10:31.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.786+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2254051a40 con 0x7f22600f6860 2022-02-02T20:10:31.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.987+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f226010f570 con 0x7f22600f6860 2022-02-02T20:10:31.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.988+0000 7f2247fff700 1 -- 172.21.15.96:0/2633705202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2254055060 con 0x7f22600f6860 2022-02-02T20:10:31.991 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:10:31.991 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:10:31.991 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:10:31.992 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:10:31.992 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:31.992 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:10:31.992 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:10:31.993 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:10:31.993 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:10:31.993 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:10:31.993 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:10:31.993 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:10:31.994 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:10:31.994 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:10:31.994 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:10:31.994 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:10:31.995 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:10:31.995 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:10:31.995 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:10:31.995 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:10:31.996 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:10:31.996 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:10:31.996 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:10:31.996 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:10:31.997 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:10:31.997 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:10:31.997 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:10:31.997 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:10:31.998 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:10:31.998 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:10:31.998 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:10:31.998 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:10:32.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:32.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:32.000 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:10:32.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:10:32.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:32.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:32.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:10:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 msgr2=0x7f2248067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 0x7f2248067290 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f22600f94b0 tx=0x7f2250009040).stop 2022-02-02T20:10:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 msgr2=0x7f22600f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:10:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f2254009990 tx=0x7f2254009b30).stop 2022-02-02T20:10:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 shutdown_connections 2022-02-02T20:10:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2248064dd0 0x7f2248067290 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22600f55c0 0x7f22600f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 --2- 172.21.15.96:0/2633705202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600f6860 0x7f22600f7ba0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:10:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 >> 172.21.15.96:0/2633705202 conn(0x7f22600f0d40 msgr2=0x7f226005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:10:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 shutdown_connections 2022-02-02T20:10:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:10:31.990+0000 7f2265cec700 1 -- 172.21.15.96:0/2633705202 wait complete. 2022-02-02T20:10:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:10:32.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:31 smithi096 ceph-mon[101353]: pgmap v3253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:31 smithi096 ceph-mon[101353]: from='client.37446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:31 smithi096 ceph-mon[101353]: from='client.37450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:32.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2612831335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:10:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:31 smithi159 ceph-mon[69013]: pgmap v3253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:31 smithi159 ceph-mon[69013]: from='client.37446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:31 smithi159 ceph-mon[69013]: from='client.37450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:10:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2612831335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:10:33.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2633705202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:10:33.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2633705202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:10:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:33 smithi159 ceph-mon[69013]: pgmap v3254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:33 smithi096 ceph-mon[101353]: pgmap v3254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:35 smithi159 ceph-mon[69013]: pgmap v3255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:35 smithi096 ceph-mon[101353]: pgmap v3255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:37.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:37 smithi159 ceph-mon[69013]: pgmap v3256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:37 smithi096 ceph-mon[101353]: pgmap v3256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:39 smithi159 ceph-mon[69013]: pgmap v3257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:39 smithi096 ceph-mon[101353]: pgmap v3257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:41 smithi159 ceph-mon[69013]: pgmap v3258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:41 smithi096 ceph-mon[101353]: pgmap v3258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:43 smithi159 ceph-mon[69013]: pgmap v3259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:43 smithi096 ceph-mon[101353]: pgmap v3259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:45 smithi159 ceph-mon[69013]: pgmap v3260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:45 smithi096 ceph-mon[101353]: pgmap v3260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:47.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:47 smithi159 ceph-mon[69013]: pgmap v3261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:47 smithi096 ceph-mon[101353]: pgmap v3261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:49 smithi159 ceph-mon[69013]: pgmap v3262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:49 smithi096 ceph-mon[101353]: pgmap v3262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:51 smithi159 ceph-mon[69013]: pgmap v3263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:51 smithi096 ceph-mon[101353]: pgmap v3263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:53 smithi159 ceph-mon[69013]: pgmap v3264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:53 smithi096 ceph-mon[101353]: pgmap v3264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:55 smithi159 ceph-mon[69013]: pgmap v3265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:55 smithi096 ceph-mon[101353]: pgmap v3265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:57.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:57 smithi159 ceph-mon[69013]: pgmap v3266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:10:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:57 smithi096 ceph-mon[101353]: pgmap v3266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:10:59 smithi159 ceph-mon[69013]: pgmap v3267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:10:59 smithi096 ceph-mon[101353]: pgmap v3267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:02.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/839348213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f5430 msgr2=0x7fd7c40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/839348213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f5430 0x7fd7c40f5850 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fd7c0004660 tx=0x7fd7c0009b30).stop 2022-02-02T20:11:02.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/839348213 shutdown_connections 2022-02-02T20:11:02.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/839348213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f66d0 0x7fd7c40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/839348213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f5430 0x7fd7c40f5850 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/839348213 >> 172.21.15.96:0/839348213 conn(0x7fd7c40f0b90 msgr2=0x7fd7c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/839348213 shutdown_connections 2022-02-02T20:11:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/839348213 wait complete. 2022-02-02T20:11:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 Processor -- start 2022-02-02T20:11:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- start start 2022-02-02T20:11:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f5430 0x7fd7c4105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.100+0000 7fd7ca6c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41067d0 con 0x7fd7c40f66d0 2022-02-02T20:11:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7ca6c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4106fd0 con 0x7fd7c40f5430 2022-02-02T20:11:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35636/0 (socket says 172.21.15.96:35636) 2022-02-02T20:11:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 -- 172.21.15.96:0/2924093530 learned_addr learned my addr 172.21.15.96:0/2924093530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c96c1700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f5430 0x7fd7c4105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 -- 172.21.15.96:0/2924093530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f5430 msgr2=0x7fd7c4105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f5430 0x7fd7c4105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 -- 172.21.15.96:0/2924093530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0005040 con 0x7fd7c40f66d0 2022-02-02T20:11:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7c8ec0700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fd7b400f940 tx=0x7fd7b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b4009500 con 0x7fd7c40f66d0 2022-02-02T20:11:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd7b4009660 con 0x7fd7c40f66d0 2022-02-02T20:11:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c4107250 con 0x7fd7c40f66d0 2022-02-02T20:11:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.101+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b400de30 con 0x7fd7c40f66d0 2022-02-02T20:11:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.102+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c41077c0 con 0x7fd7c40f66d0 2022-02-02T20:11:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.103+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4059100 con 0x7fd7c40f66d0 2022-02-02T20:11:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.103+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd7b400e040 con 0x7fd7c40f66d0 2022-02-02T20:11:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.103+0000 7fd7b9ffb700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.103+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7b4084400 con 0x7fd7c40f66d0 2022-02-02T20:11:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.103+0000 7fd7c96c1700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.104+0000 7fd7c96c1700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd7c0004630 tx=0x7fd7c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.108+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd7b4055f30 con 0x7fd7c40f66d0 2022-02-02T20:11:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:01 smithi159 ceph-mon[69013]: pgmap v3268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:02.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.289+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7c405f620 con 0x7fd7b0064e20 2022-02-02T20:11:02.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:01 smithi096 ceph-mon[101353]: pgmap v3268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:02.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.290+0000 7fd7b9ffb700 1 -- 172.21.15.96:0/2924093530 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd7c405f620 con 0x7fd7b0064e20 2022-02-02T20:11:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 msgr2=0x7fd7b00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd7c0004630 tx=0x7fd7c0009b30).stop 2022-02-02T20:11:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 msgr2=0x7fd7c4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fd7b400f940 tx=0x7fd7b4009de0).stop 2022-02-02T20:11:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 shutdown_connections 2022-02-02T20:11:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c40f5430 0x7fd7c4105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 --2- 172.21.15.96:0/2924093530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c40f66d0 0x7fd7c4106220 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 >> 172.21.15.96:0/2924093530 conn(0x7fd7c40f0b90 msgr2=0x7fd7c40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 shutdown_connections 2022-02-02T20:11:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.292+0000 7fd7ca6c3700 1 -- 172.21.15.96:0/2924093530 wait complete. 2022-02-02T20:11:02.304 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:11:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- 172.21.15.96:0/1561031185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0602b0 msgr2=0x7fc4fc0f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 --2- 172.21.15.96:0/1561031185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f9300 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fc4ec004660 tx=0x7fc4ec009b30).stop 2022-02-02T20:11:02.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- 172.21.15.96:0/1561031185 shutdown_connections 2022-02-02T20:11:02.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 --2- 172.21.15.96:0/1561031185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 --2- 172.21.15.96:0/1561031185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f9300 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- 172.21.15.96:0/1561031185 >> 172.21.15.96:0/1561031185 conn(0x7fc4fc0f0d40 msgr2=0x7fc4fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- 172.21.15.96:0/1561031185 shutdown_connections 2022-02-02T20:11:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- 172.21.15.96:0/1561031185 wait complete. 2022-02-02T20:11:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 Processor -- start 2022-02-02T20:11:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.394+0000 7fc5045ee700 1 -- start start 2022-02-02T20:11:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc5045ee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc5045ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc5045ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0f5760 con 0x7fc4fc0f9880 2022-02-02T20:11:02.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc5045ee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0f58a0 con 0x7fc4fc0602b0 2022-02-02T20:11:02.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35646/0 (socket says 172.21.15.96:35646) 2022-02-02T20:11:02.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 -- 172.21.15.96:0/449215494 learned_addr learned my addr 172.21.15.96:0/449215494 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:02.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc50238a700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 -- 172.21.15.96:0/449215494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0602b0 msgr2=0x7fc4fc0f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 -- 172.21.15.96:0/449215494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec005040 con 0x7fc4fc0f9880 2022-02-02T20:11:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc501b89700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fc4f800c510 tx=0x7fc4f8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.395+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4f800f650 con 0x7fc4fc0f9880 2022-02-02T20:11:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.396+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc4f800fc60 con 0x7fc4fc0f9880 2022-02-02T20:11:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.396+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0f5b80 con 0x7fc4fc0f9880 2022-02-02T20:11:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.396+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4f8012c20 con 0x7fc4fc0f9880 2022-02-02T20:11:02.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.396+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc10ef50 con 0x7fc4fc0f9880 2022-02-02T20:11:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.397+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc045ad0 con 0x7fc4fc0f9880 2022-02-02T20:11:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.397+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc4f8010070 con 0x7fc4fc0f9880 2022-02-02T20:11:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.397+0000 7fc4f2ffd700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 0x7fc4e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.397+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc4f80815e0 con 0x7fc4fc0f9880 2022-02-02T20:11:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.397+0000 7fc50238a700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 0x7fc4e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.398+0000 7fc50238a700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 0x7fc4e8067290 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc4ec004630 tx=0x7fc4ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.401+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc4f80477d0 con 0x7fc4fc0f9880 2022-02-02T20:11:02.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.575+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4fc0fefb0 con 0x7fc4e8064dd0 2022-02-02T20:11:02.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.585+0000 7fc4f2ffd700 1 -- 172.21.15.96:0/449215494 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fc4fc0fefb0 con 0x7fc4e8064dd0 2022-02-02T20:11:02.588 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:11:02.588 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (114m) 85m ago 115m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:11:02.588 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (106m) 85m ago 115m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:11:02.588 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (106m) 83m ago 114m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:11:02.589 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (114m) 85m ago 115m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:11:02.589 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (111m) 85m ago 111m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:11:02.589 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (107m) 85m ago 111m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:11:02.589 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (111m) 83m ago 111m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:11:02.590 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (107m) 83m ago 111m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:11:02.590 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (108m) 85m ago 116m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:11:02.590 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (108m) 83m ago 114m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:11:02.590 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (107m) 85m ago 116m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:11:02.591 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (107m) 83m ago 114m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:11:02.591 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (115m) 85m ago 115m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:11:02.591 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (114m) 83m ago 114m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:11:02.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (106m) 85m ago 114m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:11:02.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (105m) 85m ago 113m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:11:02.592 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (105m) 85m ago 113m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:11:02.592 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (104m) 83m ago 113m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:11:02.592 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (104m) 83m ago 113m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:11:02.592 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (103m) 83m ago 112m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:11:02.593 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (114m) 85m ago 115m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:11:02.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 msgr2=0x7fc4e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 0x7fc4e8067290 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc4ec004630 tx=0x7fc4ec009b30).stop 2022-02-02T20:11:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 msgr2=0x7fc4fc0f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fc4f800c510 tx=0x7fc4f8007df0).stop 2022-02-02T20:11:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 shutdown_connections 2022-02-02T20:11:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4e8064dd0 0x7fc4e8067290 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc0602b0 0x7fc4fc0f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 --2- 172.21.15.96:0/449215494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4fc0f9880 0x7fc4fc0f5200 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 >> 172.21.15.96:0/449215494 conn(0x7fc4fc0f0d40 msgr2=0x7fc4fc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 shutdown_connections 2022-02-02T20:11:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.587+0000 7fc5045ee700 1 -- 172.21.15.96:0/449215494 wait complete. 2022-02-02T20:11:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 -- 172.21.15.96:0/1008236384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f66e0 msgr2=0x7f91440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 --2- 172.21.15.96:0/1008236384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f66e0 0x7f91440f6b00 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f912c004660 tx=0x7f912c009b30).stop 2022-02-02T20:11:02.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 -- 172.21.15.96:0/1008236384 shutdown_connections 2022-02-02T20:11:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 --2- 172.21.15.96:0/1008236384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f7980 0x7f91440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:11:02.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 --2- 172.21.15.96:0/1008236384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f66e0 0x7f91440f6b00 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 -- 172.21.15.96:0/1008236384 >> 172.21.15.96:0/1008236384 conn(0x7f91440f1e40 msgr2=0x7f91440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 -- 172.21.15.96:0/1008236384 shutdown_connections 2022-02-02T20:11:02.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.684+0000 7f91499ce700 1 -- 172.21.15.96:0/1008236384 wait complete. 2022-02-02T20:11:02.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 Processor -- start 2022-02-02T20:11:02.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 -- start start 2022-02-02T20:11:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f66e0 0x7f9144106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144107ae0 con 0x7f91440f7980 2022-02-02T20:11:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91499ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144108390 con 0x7f91440f66e0 2022-02-02T20:11:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35654/0 (socket says 172.21.15.96:35654) 2022-02-02T20:11:02.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f91427fc700 1 -- 172.21.15.96:0/2678864113 learned_addr learned my addr 172.21.15.96:0/2678864113 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:02.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.685+0000 7f9142ffd700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f66e0 0x7f9144106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91427fc700 1 -- 172.21.15.96:0/2678864113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f66e0 msgr2=0x7f9144106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91427fc700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f66e0 0x7f9144106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91427fc700 1 -- 172.21.15.96:0/2678864113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c005040 con 0x7f91440f7980 2022-02-02T20:11:02.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91427fc700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f913400b410 tx=0x7f9134006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91340125f0 con 0x7f91440f7980 2022-02-02T20:11:02.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9144108670 con 0x7f91440f7980 2022-02-02T20:11:02.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f913400be30 con 0x7f91440f7980 2022-02-02T20:11:02.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9134002a70 con 0x7f91440f7980 2022-02-02T20:11:02.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.686+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9144108c30 con 0x7f91440f7980 2022-02-02T20:11:02.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.687+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9128004fa0 con 0x7f91440f7980 2022-02-02T20:11:02.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.687+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f913400f030 con 0x7f91440f7980 2022-02-02T20:11:02.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.688+0000 7f913b7fe700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 0x7f9130067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:02.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.688+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9134081db0 con 0x7f91440f7980 2022-02-02T20:11:02.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.688+0000 7f9142ffd700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 0x7f9130067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:02.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.688+0000 7f9142ffd700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 0x7f9130067290 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f912c004630 tx=0x7f912c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:02.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.692+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f91340538e0 con 0x7f91440f7980 2022-02-02T20:11:02.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.921+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9128005e80 con 0x7f91440f7980 2022-02-02T20:11:02.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.921+0000 7f913b7fe700 1 -- 172.21.15.96:0/2678864113 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f91340534d0 con 0x7f91440f7980 2022-02-02T20:11:02.924 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:11:02.924 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:11:02.924 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:11:02.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:02.925 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:11:02.925 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:11:02.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:02.926 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:11:02.926 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:11:02.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:02.926 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:11:02.926 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:11:02.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:02.927 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:11:02.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:11:02.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:11:02.928 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:11:02.928 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:11:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 msgr2=0x7f9130067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 0x7f9130067290 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f912c004630 tx=0x7f912c009b30).stop 2022-02-02T20:11:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 msgr2=0x7f91441074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f913400b410 tx=0x7f9134006ef0).stop 2022-02-02T20:11:02.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 shutdown_connections 2022-02-02T20:11:02.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9130064dd0 0x7f9130067290 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91440f66e0 0x7f9144106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 --2- 172.21.15.96:0/2678864113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91440f7980 0x7f91441074a0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:02.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 >> 172.21.15.96:0/2678864113 conn(0x7f91440f1e40 msgr2=0x7f91440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:02.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 shutdown_connections 2022-02-02T20:11:02.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:02.923+0000 7f91499ce700 1 -- 172.21.15.96:0/2678864113 wait complete. 2022-02-02T20:11:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 -- 172.21.15.96:0/641079065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 msgr2=0x7f2fb40f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/641079065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb40f4cc0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f2fb0004660 tx=0x7f2fb0009b30).stop 2022-02-02T20:11:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 -- 172.21.15.96:0/641079065 shutdown_connections 2022-02-02T20:11:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/641079065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb40f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:11:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/641079065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb40f4cc0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.020+0000 7f2fbad9d700 1 -- 172.21.15.96:0/641079065 >> 172.21.15.96:0/641079065 conn(0x7f2fb40f0320 msgr2=0x7f2fb40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.021+0000 7f2fbad9d700 1 -- 172.21.15.96:0/641079065 shutdown_connections 2022-02-02T20:11:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.021+0000 7f2fbad9d700 1 -- 172.21.15.96:0/641079065 wait complete. 2022-02-02T20:11:03.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.021+0000 7f2fbad9d700 1 Processor -- start 2022-02-02T20:11:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fbad9d700 1 -- start start 2022-02-02T20:11:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fbad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fbad9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fbad9d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4107aa0 con 0x7f2fb40f48a0 2022-02-02T20:11:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fbad9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4108350 con 0x7f2fb40f5240 2022-02-02T20:11:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35662/0 (socket says 172.21.15.96:35662) 2022-02-02T20:11:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 -- 172.21.15.96:0/1516575130 learned_addr learned my addr 172.21.15.96:0/1516575130 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb959a700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 -- 172.21.15.96:0/1516575130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 msgr2=0x7f2fb4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 -- 172.21.15.96:0/1516575130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0005040 con 0x7f2fb40f48a0 2022-02-02T20:11:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb959a700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:11:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.022+0000 7f2fb9d9b700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f2fb0009990 tx=0x7f2fb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb0018070 con 0x7f2fb40f48a0 2022-02-02T20:11:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2fb0007ca0 con 0x7f2fb40f48a0 2022-02-02T20:11:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb41085d0 con 0x7f2fb40f48a0 2022-02-02T20:11:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb001c620 con 0x7f2fb40f48a0 2022-02-02T20:11:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb4108b30 con 0x7f2fb40f48a0 2022-02-02T20:11:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.023+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb4059100 con 0x7f2fb40f48a0 2022-02-02T20:11:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.024+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2fb001d960 con 0x7f2fb40f48a0 2022-02-02T20:11:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.024+0000 7f2faa7fc700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 0x7f2fa00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.024+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2fb0083710 con 0x7f2fb40f48a0 2022-02-02T20:11:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.024+0000 7f2fb959a700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 0x7f2fa00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.025+0000 7f2fb959a700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 0x7f2fa00672e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f2fb40f56c0 tx=0x7f2fa4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.028+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2fb0055300 con 0x7f2fb40f48a0 2022-02-02T20:11:03.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.228+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2fb4027ac0 con 0x7f2fb40f48a0 2022-02-02T20:11:03.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:02 smithi096 ceph-mon[101353]: from='client.37462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:03.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.228+0000 7f2faa7fc700 1 -- 172.21.15.96:0/1516575130 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2fb0054ef0 con 0x7f2fb40f48a0 2022-02-02T20:11:03.232 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:11:03.232 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:11:03.233 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:11:03.233 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:11:03.234 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:03.234 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:11:03.234 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:11:03.235 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:11:03.235 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:11:03.236 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:11:03.236 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:11:03.237 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:11:03.237 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:11:03.238 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:11:03.238 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:11:03.239 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:11:03.240 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:11:03.240 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:11:03.241 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:11:03.241 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:11:03.242 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:11:03.242 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:11:03.242 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:11:03.243 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:11:03.243 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:11:03.243 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:11:03.244 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:11:03.244 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:11:03.245 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:11:03.245 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:11:03.246 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:11:03.246 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:11:03.247 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:03.247 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:03.248 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:11:03.248 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:03.248 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:03.249 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:03.249 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:03.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 msgr2=0x7f2fa00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:03.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 0x7f2fa00672e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f2fb40f56c0 tx=0x7f2fa4008040).stop 2022-02-02T20:11:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 msgr2=0x7f2fb4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f2fb0009990 tx=0x7f2fb0009b30).stop 2022-02-02T20:11:03.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 shutdown_connections 2022-02-02T20:11:03.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2fa0064e20 0x7f2fa00672e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:03.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb40f48a0 0x7f2fb4106f70 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:03.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 --2- 172.21.15.96:0/1516575130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40f5240 0x7f2fb4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:03.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 >> 172.21.15.96:0/1516575130 conn(0x7f2fb40f0320 msgr2=0x7f2fb40fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:03.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 shutdown_connections 2022-02-02T20:11:03.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:03.231+0000 7f2fbad9d700 1 -- 172.21.15.96:0/1516575130 wait complete. 2022-02-02T20:11:03.258 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:11:03.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:02 smithi159 ceph-mon[69013]: from='client.37462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:03 smithi159 ceph-mon[69013]: from='client.37466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:03 smithi159 ceph-mon[69013]: pgmap v3269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2678864113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:11:04.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1516575130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:11:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:03 smithi096 ceph-mon[101353]: from='client.37466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:03 smithi096 ceph-mon[101353]: pgmap v3269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2678864113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:11:04.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1516575130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:11:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:05 smithi159 ceph-mon[69013]: pgmap v3270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:05 smithi096 ceph-mon[101353]: pgmap v3270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:07 smithi159 ceph-mon[69013]: pgmap v3271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:07 smithi096 ceph-mon[101353]: pgmap v3271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:09 smithi159 ceph-mon[69013]: pgmap v3272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:09 smithi096 ceph-mon[101353]: pgmap v3272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:11 smithi159 ceph-mon[69013]: pgmap v3273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:11 smithi096 ceph-mon[101353]: pgmap v3273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:13 smithi159 ceph-mon[69013]: pgmap v3274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:13 smithi096 ceph-mon[101353]: pgmap v3274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:15 smithi159 ceph-mon[69013]: pgmap v3275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:15 smithi096 ceph-mon[101353]: pgmap v3275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:17.780 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:17 smithi159 ceph-mon[69013]: pgmap v3276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:17 smithi096 ceph-mon[101353]: pgmap v3276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:19 smithi159 ceph-mon[69013]: pgmap v3277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:19 smithi096 ceph-mon[101353]: pgmap v3277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:21 smithi159 ceph-mon[69013]: pgmap v3278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:21 smithi096 ceph-mon[101353]: pgmap v3278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:23 smithi159 ceph-mon[69013]: pgmap v3279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:23 smithi096 ceph-mon[101353]: pgmap v3279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:25 smithi159 ceph-mon[69013]: pgmap v3280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:25 smithi096 ceph-mon[101353]: pgmap v3280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:27 smithi159 ceph-mon[69013]: pgmap v3281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:11:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:11:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:27 smithi096 ceph-mon[101353]: pgmap v3281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:11:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:11:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:29 smithi159 ceph-mon[69013]: pgmap v3282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:29 smithi096 ceph-mon[101353]: pgmap v3282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:31 smithi159 ceph-mon[69013]: pgmap v3283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:31 smithi096 ceph-mon[101353]: pgmap v3283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:33.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1748543725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f55c0 msgr2=0x7f6fd00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1748543725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f55c0 0x7f6fd00f59e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f6fc0004660 tx=0x7f6fc0009b30).stop 2022-02-02T20:11:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1748543725 shutdown_connections 2022-02-02T20:11:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1748543725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f6860 0x7f6fd00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1748543725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f55c0 0x7f6fd00f59e0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1748543725 >> 172.21.15.96:0/1748543725 conn(0x7f6fd00f0d40 msgr2=0x7f6fd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1748543725 shutdown_connections 2022-02-02T20:11:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.340+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1748543725 wait complete. 2022-02-02T20:11:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 Processor -- start 2022-02-02T20:11:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 -- start start 2022-02-02T20:11:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f55c0 0x7f6fd010c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd00602b0 con 0x7f6fd00f6860 2022-02-02T20:11:33.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd75c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd00603f0 con 0x7f6fd00f55c0 2022-02-02T20:11:33.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd4b5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd4b5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35680/0 (socket says 172.21.15.96:35680) 2022-02-02T20:11:33.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd4b5e700 1 -- 172.21.15.96:0/1870727063 learned_addr learned my addr 172.21.15.96:0/1870727063 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:33.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.341+0000 7f6fd535f700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f55c0 0x7f6fd010c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd4b5e700 1 -- 172.21.15.96:0/1870727063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f55c0 msgr2=0x7f6fd010c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd4b5e700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f55c0 0x7f6fd010c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd4b5e700 1 -- 172.21.15.96:0/1870727063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0005040 con 0x7f6fd00f6860 2022-02-02T20:11:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd4b5e700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f6fcc0026d0 tx=0x7f6fcc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fcc0079c0 con 0x7f6fd00f6860 2022-02-02T20:11:33.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd010ea10 con 0x7f6fd00f6860 2022-02-02T20:11:33.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6fcc00f040 con 0x7f6fd00f6860 2022-02-02T20:11:33.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fcc0148b0 con 0x7f6fd00f6860 2022-02-02T20:11:33.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.342+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd010ee90 con 0x7f6fd00f6860 2022-02-02T20:11:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.343+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd0045ad0 con 0x7f6fd00f6860 2022-02-02T20:11:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.344+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6fcc007b20 con 0x7f6fd00f6860 2022-02-02T20:11:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.344+0000 7f6fc5ffb700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 0x7f6fbc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.344+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6fcc081990 con 0x7f6fd00f6860 2022-02-02T20:11:33.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.344+0000 7f6fd535f700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 0x7f6fbc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.344+0000 7f6fd535f700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 0x7f6fbc067290 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6fc0013690 tx=0x7f6fc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.348+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6fcc04fa90 con 0x7f6fd00f6860 2022-02-02T20:11:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.527+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fd0057f10 con 0x7f6fbc064dd0 2022-02-02T20:11:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.528+0000 7f6fc5ffb700 1 -- 172.21.15.96:0/1870727063 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6fd0057f10 con 0x7f6fbc064dd0 2022-02-02T20:11:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 msgr2=0x7f6fbc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 0x7f6fbc067290 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f6fc0013690 tx=0x7f6fc0009b30).stop 2022-02-02T20:11:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 msgr2=0x7f6fd010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f6fcc0026d0 tx=0x7f6fcc009de0).stop 2022-02-02T20:11:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 shutdown_connections 2022-02-02T20:11:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6fbc064dd0 0x7f6fbc067290 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fd00f55c0 0x7f6fd010c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 --2- 172.21.15.96:0/1870727063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fd00f6860 0x7f6fd010e520 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 >> 172.21.15.96:0/1870727063 conn(0x7f6fd00f0d40 msgr2=0x7f6fd00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 shutdown_connections 2022-02-02T20:11:33.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.530+0000 7f6fd75c3700 1 -- 172.21.15.96:0/1870727063 wait complete. 2022-02-02T20:11:33.543 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:11:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 -- 172.21.15.96:0/2518487262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 msgr2=0x7fc8600f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 --2- 172.21.15.96:0/2518487262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc8600f6920 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fc85c004660 tx=0x7fc85c009b30).stop 2022-02-02T20:11:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 -- 172.21.15.96:0/2518487262 shutdown_connections 2022-02-02T20:11:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 --2- 172.21.15.96:0/2518487262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc8600f6920 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 --2- 172.21.15.96:0/2518487262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 0x7fc8600f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 -- 172.21.15.96:0/2518487262 >> 172.21.15.96:0/2518487262 conn(0x7fc8600f0de0 msgr2=0x7fc8600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 -- 172.21.15.96:0/2518487262 shutdown_connections 2022-02-02T20:11:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.628+0000 7fc86859b700 1 -- 172.21.15.96:0/2518487262 wait complete. 2022-02-02T20:11:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 Processor -- start 2022-02-02T20:11:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 -- start start 2022-02-02T20:11:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 0x7fc860109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860060500 con 0x7fc8600f5ef0 2022-02-02T20:11:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc86859b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860060640 con 0x7fc8600f55e0 2022-02-02T20:11:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35688/0 (socket says 172.21.15.96:35688) 2022-02-02T20:11:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 -- 172.21.15.96:0/2153398872 learned_addr learned my addr 172.21.15.96:0/2153398872 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc866337700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 0x7fc860109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 -- 172.21.15.96:0/2153398872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 msgr2=0x7fc860109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 0x7fc860109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 -- 172.21.15.96:0/2153398872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c005040 con 0x7fc8600f5ef0 2022-02-02T20:11:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.629+0000 7fc865b36700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fc85c009990 tx=0x7fc85c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.630+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85c018070 con 0x7fc8600f5ef0 2022-02-02T20:11:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.630+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc85c007ba0 con 0x7fc8600f5ef0 2022-02-02T20:11:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.630+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85c01c3c0 con 0x7fc8600f5ef0 2022-02-02T20:11:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.630+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86010c6e0 con 0x7fc8600f5ef0 2022-02-02T20:11:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.630+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86010cc40 con 0x7fc8600f5ef0 2022-02-02T20:11:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.631+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860045ad0 con 0x7fc8600f5ef0 2022-02-02T20:11:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.631+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc85c01d420 con 0x7fc8600f5ef0 2022-02-02T20:11:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.631+0000 7fc856ffd700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.631+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc85c0836a0 con 0x7fc8600f5ef0 2022-02-02T20:11:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.631+0000 7fc866337700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.632+0000 7fc866337700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fc860060180 tx=0x7fc85000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.636+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc85c051860 con 0x7fc8600f5ef0 2022-02-02T20:11:33.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.807+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8600fdf40 con 0x7fc84c064dd0 2022-02-02T20:11:33.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.816+0000 7fc856ffd700 1 -- 172.21.15.96:0/2153398872 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fc8600fdf40 con 0x7fc84c064dd0 2022-02-02T20:11:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:11:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (114m) 85m ago 116m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:11:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (107m) 85m ago 115m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:11:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (107m) 83m ago 115m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:11:33.821 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (114m) 85m ago 115m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:11:33.821 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (112m) 85m ago 112m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:11:33.821 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (107m) 85m ago 112m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:11:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (112m) 83m ago 112m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:11:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (107m) 83m ago 112m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:11:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (109m) 85m ago 117m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:11:33.823 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (108m) 83m ago 115m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:11:33.823 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (108m) 85m ago 117m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:11:33.823 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (107m) 83m ago 115m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:11:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (115m) 85m ago 115m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:11:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (115m) 83m ago 115m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:11:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (106m) 85m ago 114m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:11:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (106m) 85m ago 114m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:11:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (105m) 85m ago 114m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:11:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (105m) 83m ago 113m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:11:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (104m) 83m ago 113m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:11:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (104m) 83m ago 113m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:11:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (114m) 85m ago 115m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:11:33.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 msgr2=0x7fc84c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fc860060180 tx=0x7fc85000b040).stop 2022-02-02T20:11:33.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 msgr2=0x7fc86010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fc85c009990 tx=0x7fc85c009b30).stop 2022-02-02T20:11:33.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 shutdown_connections 2022-02-02T20:11:33.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8600f55e0 0x7fc860109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 --2- 172.21.15.96:0/2153398872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8600f5ef0 0x7fc86010c190 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 >> 172.21.15.96:0/2153398872 conn(0x7fc8600f0de0 msgr2=0x7fc8600fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:33.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 shutdown_connections 2022-02-02T20:11:33.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.819+0000 7fc86859b700 1 -- 172.21.15.96:0/2153398872 wait complete. 2022-02-02T20:11:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 -- 172.21.15.96:0/245188265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f68e0 msgr2=0x7f51380f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 --2- 172.21.15.96:0/245188265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f68e0 0x7f51380f6d00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f5134004660 tx=0x7f5134009b30).stop 2022-02-02T20:11:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 -- 172.21.15.96:0/245188265 shutdown_connections 2022-02-02T20:11:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 --2- 172.21.15.96:0/245188265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f7b80 0x7f51380f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 --2- 172.21.15.96:0/245188265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f68e0 0x7f51380f6d00 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.915+0000 7f514005f700 1 -- 172.21.15.96:0/245188265 >> 172.21.15.96:0/245188265 conn(0x7f51380f2020 msgr2=0x7f51380f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 -- 172.21.15.96:0/245188265 shutdown_connections 2022-02-02T20:11:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 -- 172.21.15.96:0/245188265 wait complete. 2022-02-02T20:11:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 Processor -- start 2022-02-02T20:11:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 -- start start 2022-02-02T20:11:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f68e0 0x7f51381071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138107c80 con 0x7f51380f7b80 2022-02-02T20:11:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.916+0000 7f514005f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138107dc0 con 0x7f51380f68e0 2022-02-02T20:11:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35698/0 (socket says 172.21.15.96:35698) 2022-02-02T20:11:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 -- 172.21.15.96:0/3140814118 learned_addr learned my addr 172.21.15.96:0/3140814118 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513ddfb700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f68e0 0x7f51381071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 -- 172.21.15.96:0/3140814118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f68e0 msgr2=0x7f51381071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f68e0 0x7f51381071e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 -- 172.21.15.96:0/3140814118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134005040 con 0x7f51380f7b80 2022-02-02T20:11:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f513d5fa700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f51280026d0 tx=0x7f5128009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51280079c0 con 0x7f51380f7b80 2022-02-02T20:11:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5138108760 con 0x7f51380f7b80 2022-02-02T20:11:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f512800f040 con 0x7f51380f7b80 2022-02-02T20:11:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51280148b0 con 0x7f51380f7b80 2022-02-02T20:11:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.917+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5138108d20 con 0x7f51380f7b80 2022-02-02T20:11:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.918+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138045ad0 con 0x7f51380f7b80 2022-02-02T20:11:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.919+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5128007b20 con 0x7f51380f7b80 2022-02-02T20:11:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.919+0000 7f512e7fc700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 0x7f5124067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.919+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5128081990 con 0x7f51380f7b80 2022-02-02T20:11:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.919+0000 7f513ddfb700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 0x7f5124067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.920+0000 7f513ddfb700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 0x7f5124067290 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f5134004630 tx=0x7f5134009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:33.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:33.925+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f51280534c0 con 0x7f51380f7b80 2022-02-02T20:11:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.155+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51380612d0 con 0x7f51380f7b80 2022-02-02T20:11:34.160 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:33 smithi096 ceph-mon[101353]: pgmap v3284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:34.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.155+0000 7f512e7fc700 1 -- 172.21.15.96:0/3140814118 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f51280530b0 con 0x7f51380f7b80 2022-02-02T20:11:34.161 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:11:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:11:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:11:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:11:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:11:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:11:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:11:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:11:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:11:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:11:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:11:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:11:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:11:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:11:34.165 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:11:34.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 msgr2=0x7f5124067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 0x7f5124067290 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f5134004630 tx=0x7f5134009b30).stop 2022-02-02T20:11:34.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 msgr2=0x7f51381076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f51280026d0 tx=0x7f5128009de0).stop 2022-02-02T20:11:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 shutdown_connections 2022-02-02T20:11:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5124064dd0 0x7f5124067290 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51380f68e0 0x7f51381071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 --2- 172.21.15.96:0/3140814118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380f7b80 0x7f51381076d0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 >> 172.21.15.96:0/3140814118 conn(0x7f51380f2020 msgr2=0x7f51380fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:34.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 shutdown_connections 2022-02-02T20:11:34.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.158+0000 7f514005f700 1 -- 172.21.15.96:0/3140814118 wait complete. 2022-02-02T20:11:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 -- 172.21.15.96:0/2447940806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f48a0 msgr2=0x7f57080f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 --2- 172.21.15.96:0/2447940806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f48a0 0x7f57080f4cc0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f56fc004660 tx=0x7f56fc009b30).stop 2022-02-02T20:11:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 -- 172.21.15.96:0/2447940806 shutdown_connections 2022-02-02T20:11:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 --2- 172.21.15.96:0/2447940806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f5240 0x7f57080f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:11:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 --2- 172.21.15.96:0/2447940806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f48a0 0x7f57080f4cc0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 -- 172.21.15.96:0/2447940806 >> 172.21.15.96:0/2447940806 conn(0x7f57080f0320 msgr2=0x7f57080f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 -- 172.21.15.96:0/2447940806 shutdown_connections 2022-02-02T20:11:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.255+0000 7f570d973700 1 -- 172.21.15.96:0/2447940806 wait complete. 2022-02-02T20:11:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 Processor -- start 2022-02-02T20:11:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 -- start start 2022-02-02T20:11:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f48a0 0x7f57080f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080f5f00 con 0x7f57080f5240 2022-02-02T20:11:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f570d973700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080f6040 con 0x7f57080f48a0 2022-02-02T20:11:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f5707fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f5707fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35708/0 (socket says 172.21.15.96:35708) 2022-02-02T20:11:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.256+0000 7f5707fff700 1 -- 172.21.15.96:0/2454062872 learned_addr learned my addr 172.21.15.96:0/2454062872 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:11:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f570c971700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f48a0 0x7f57080f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f5707fff700 1 -- 172.21.15.96:0/2454062872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f48a0 msgr2=0x7f57080f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f5707fff700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f48a0 0x7f57080f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f5707fff700 1 -- 172.21.15.96:0/2454062872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc005040 con 0x7f57080f5240 2022-02-02T20:11:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f5707fff700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f56f40093f0 tx=0x7f56f4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f4013640 con 0x7f57080f5240 2022-02-02T20:11:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56f4013c50 con 0x7f57080f5240 2022-02-02T20:11:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57080f6320 con 0x7f57080f5240 2022-02-02T20:11:34.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f4012c70 con 0x7f57080f5240 2022-02-02T20:11:34.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.257+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570810efb0 con 0x7f57080f5240 2022-02-02T20:11:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.258+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5708045ad0 con 0x7f57080f5240 2022-02-02T20:11:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.258+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56f401a060 con 0x7f57080f5240 2022-02-02T20:11:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.259+0000 7f57057fa700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 0x7f56f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:11:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.259+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56f4081a50 con 0x7f57080f5240 2022-02-02T20:11:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.259+0000 7f570c971700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 0x7f56f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:11:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.259+0000 7f570c971700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 0x7f56f80672e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f56fc004630 tx=0x7f56fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:11:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.263+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56f404faf0 con 0x7f57080f5240 2022-02-02T20:11:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:33 smithi159 ceph-mon[69013]: pgmap v3284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.464+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f570805f440 con 0x7f57080f5240 2022-02-02T20:11:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.464+0000 7f57057fa700 1 -- 172.21.15.96:0/2454062872 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f56f4018720 con 0x7f57080f5240 2022-02-02T20:11:34.468 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:11:34.469 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:11:34.469 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:11:34.469 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:11:34.469 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:34.470 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:11:34.470 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:11:34.470 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:11:34.470 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:11:34.470 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:11:34.471 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:11:34.471 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:11:34.471 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:11:34.471 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:11:34.472 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:11:34.472 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:11:34.472 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:11:34.472 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:11:34.472 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:11:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:11:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:11:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:11:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:11:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:11:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:11:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:11:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:11:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:11:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:11:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:11:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:11:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:11:34.476 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:34.476 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:34.476 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:11:34.476 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:11:34.476 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:34.477 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:34.477 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:11:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 msgr2=0x7f56f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 0x7f56f80672e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f56fc004630 tx=0x7f56fc009b30).stop 2022-02-02T20:11:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 msgr2=0x7f57080f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:11:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f56f40093f0 tx=0x7f56f4006ec0).stop 2022-02-02T20:11:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 shutdown_connections 2022-02-02T20:11:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56f8064e20 0x7f56f80672e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57080f48a0 0x7f57080f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 --2- 172.21.15.96:0/2454062872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57080f5240 0x7f57080f5910 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:11:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 >> 172.21.15.96:0/2454062872 conn(0x7f57080f0320 msgr2=0x7f57080fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:11:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 shutdown_connections 2022-02-02T20:11:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:11:34.467+0000 7f570d973700 1 -- 172.21.15.96:0/2454062872 wait complete. 2022-02-02T20:11:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:11:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:34 smithi159 ceph-mon[69013]: from='client.37478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:34 smithi159 ceph-mon[69013]: from='client.37482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3140814118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:11:35.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2454062872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:11:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:34 smithi096 ceph-mon[101353]: from='client.37478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:34 smithi096 ceph-mon[101353]: from='client.37482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:11:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3140814118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:11:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2454062872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:11:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:35 smithi159 ceph-mon[69013]: pgmap v3285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:36.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:35 smithi096 ceph-mon[101353]: pgmap v3285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:37.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:37 smithi159 ceph-mon[69013]: pgmap v3286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:37 smithi096 ceph-mon[101353]: pgmap v3286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:39 smithi159 ceph-mon[69013]: pgmap v3287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:39 smithi096 ceph-mon[101353]: pgmap v3287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:41 smithi159 ceph-mon[69013]: pgmap v3288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:41 smithi096 ceph-mon[101353]: pgmap v3288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:43 smithi159 ceph-mon[69013]: pgmap v3289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:43 smithi096 ceph-mon[101353]: pgmap v3289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:45 smithi159 ceph-mon[69013]: pgmap v3290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:45 smithi096 ceph-mon[101353]: pgmap v3290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:47.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:47 smithi159 ceph-mon[69013]: pgmap v3291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:47 smithi096 ceph-mon[101353]: pgmap v3291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:49 smithi159 ceph-mon[69013]: pgmap v3292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:49 smithi096 ceph-mon[101353]: pgmap v3292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:51 smithi159 ceph-mon[69013]: pgmap v3293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:51 smithi096 ceph-mon[101353]: pgmap v3293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:53 smithi159 ceph-mon[69013]: pgmap v3294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:53 smithi096 ceph-mon[101353]: pgmap v3294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:55 smithi159 ceph-mon[69013]: pgmap v3295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:55 smithi096 ceph-mon[101353]: pgmap v3295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:57.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:57 smithi159 ceph-mon[69013]: pgmap v3296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:11:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:57 smithi096 ceph-mon[101353]: pgmap v3296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:11:59 smithi159 ceph-mon[69013]: pgmap v3297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:11:59 smithi096 ceph-mon[101353]: pgmap v3297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:01 smithi159 ceph-mon[69013]: pgmap v3298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:01 smithi096 ceph-mon[101353]: pgmap v3298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:03 smithi159 ceph-mon[69013]: pgmap v3299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:03 smithi096 ceph-mon[101353]: pgmap v3299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:04.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.578+0000 7f495adb0700 1 -- 172.21.15.96:0/3257790124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 msgr2=0x7f49540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.578+0000 7f495adb0700 1 --2- 172.21.15.96:0/3257790124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f49540f7c30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f4944004660 tx=0x7f4944009b30).stop 2022-02-02T20:12:04.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 -- 172.21.15.96:0/3257790124 shutdown_connections 2022-02-02T20:12:04.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 --2- 172.21.15.96:0/3257790124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f49540f7c30 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 --2- 172.21.15.96:0/3257790124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 0x7f49540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 -- 172.21.15.96:0/3257790124 >> 172.21.15.96:0/3257790124 conn(0x7f49540f1cd0 msgr2=0x7f49540f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 -- 172.21.15.96:0/3257790124 shutdown_connections 2022-02-02T20:12:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 -- 172.21.15.96:0/3257790124 wait complete. 2022-02-02T20:12:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 Processor -- start 2022-02-02T20:12:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.579+0000 7f495adb0700 1 -- start start 2022-02-02T20:12:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f495adb0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 0x7f4954106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f495adb0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f495adb0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4954107870 con 0x7f49540f77d0 2022-02-02T20:12:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f495adb0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4954108080 con 0x7f49540f6530 2022-02-02T20:12:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35726/0 (socket says 172.21.15.96:35726) 2022-02-02T20:12:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 -- 172.21.15.96:0/2671415280 learned_addr learned my addr 172.21.15.96:0/2671415280 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f4959dae700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 0x7f4954106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 -- 172.21.15.96:0/2671415280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 msgr2=0x7f4954106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 0x7f4954106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 -- 172.21.15.96:0/2671415280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944005040 con 0x7f49540f77d0 2022-02-02T20:12:04.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f49595ad700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f4944009990 tx=0x7f4944009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:04.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4944018070 con 0x7f49540f77d0 2022-02-02T20:12:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4944007ba0 con 0x7f49540f77d0 2022-02-02T20:12:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.580+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49541082a0 con 0x7f49540f77d0 2022-02-02T20:12:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.581+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494401c3c0 con 0x7f49540f77d0 2022-02-02T20:12:04.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.581+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4954108800 con 0x7f49540f77d0 2022-02-02T20:12:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.581+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4954059100 con 0x7f49540f77d0 2022-02-02T20:12:04.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.582+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f494401d420 con 0x7f49540f77d0 2022-02-02T20:12:04.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.582+0000 7f494a7fc700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 0x7f49400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.583+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49440836b0 con 0x7f49540f77d0 2022-02-02T20:12:04.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.583+0000 7f4959dae700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 0x7f49400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.583+0000 7f4959dae700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 0x7f49400672e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f4954106af0 tx=0x7f495000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:04.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.587+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4944051810 con 0x7f49540f77d0 2022-02-02T20:12:04.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.764+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49540fee60 con 0x7f4940064e20 2022-02-02T20:12:04.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.765+0000 7f494a7fc700 1 -- 172.21.15.96:0/2671415280 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f49540fee60 con 0x7f4940064e20 2022-02-02T20:12:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 msgr2=0x7f49400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 0x7f49400672e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f4954106af0 tx=0x7f495000b040).stop 2022-02-02T20:12:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 msgr2=0x7f4954107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f4944009990 tx=0x7f4944009b30).stop 2022-02-02T20:12:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 shutdown_connections 2022-02-02T20:12:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4940064e20 0x7f49400672e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49540f6530 0x7f4954106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 --2- 172.21.15.96:0/2671415280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49540f77d0 0x7f4954107270 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 >> 172.21.15.96:0/2671415280 conn(0x7f49540f1cd0 msgr2=0x7f49540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 shutdown_connections 2022-02-02T20:12:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.767+0000 7f495adb0700 1 -- 172.21.15.96:0/2671415280 wait complete. 2022-02-02T20:12:04.779 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:12:04.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 -- 172.21.15.96:0/4291421411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f66d0 msgr2=0x7f68dc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 --2- 172.21.15.96:0/4291421411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f66d0 0x7f68dc0f6b30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f68c80046e0 tx=0x7f68c8009b30).stop 2022-02-02T20:12:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 -- 172.21.15.96:0/4291421411 shutdown_connections 2022-02-02T20:12:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 --2- 172.21.15.96:0/4291421411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f66d0 0x7f68dc0f6b30 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 --2- 172.21.15.96:0/4291421411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f5430 0x7f68dc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.863+0000 7f68e1bec700 1 -- 172.21.15.96:0/4291421411 >> 172.21.15.96:0/4291421411 conn(0x7f68dc0f0b90 msgr2=0x7f68dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:04.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.864+0000 7f68e1bec700 1 -- 172.21.15.96:0/4291421411 shutdown_connections 2022-02-02T20:12:04.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.864+0000 7f68e1bec700 1 -- 172.21.15.96:0/4291421411 wait complete. 2022-02-02T20:12:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.864+0000 7f68e1bec700 1 Processor -- start 2022-02-02T20:12:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.864+0000 7f68e1bec700 1 -- start start 2022-02-02T20:12:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f66d0 0x7f68dc105000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc1055b0 con 0x7f68dc0f5430 2022-02-02T20:12:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc1056f0 con 0x7f68dc0f66d0 2022-02-02T20:12:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35734/0 (socket says 172.21.15.96:35734) 2022-02-02T20:12:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 -- 172.21.15.96:0/3530638911 learned_addr learned my addr 172.21.15.96:0/3530638911 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68dbfff700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f66d0 0x7f68dc105000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 -- 172.21.15.96:0/3530638911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f66d0 msgr2=0x7f68dc105000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f66d0 0x7f68dc105000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 -- 172.21.15.96:0/3530638911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8005040 con 0x7f68dc0f5430 2022-02-02T20:12:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e0bea700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f68d000c790 tx=0x7f68d0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d000e680 con 0x7f68dc0f5430 2022-02-02T20:12:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68d000ec90 con 0x7f68dc0f5430 2022-02-02T20:12:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d0012d00 con 0x7f68dc0f5430 2022-02-02T20:12:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc106090 con 0x7f68dc0f5430 2022-02-02T20:12:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.865+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc106650 con 0x7f68dc0f5430 2022-02-02T20:12:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.867+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68d0010070 con 0x7f68dc0f5430 2022-02-02T20:12:04.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.867+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc045ad0 con 0x7f68dc0f5430 2022-02-02T20:12:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.867+0000 7f68d97fa700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 0x7f68cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.867+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68d0081a50 con 0x7f68dc0f5430 2022-02-02T20:12:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.867+0000 7f68dbfff700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 0x7f68cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.868+0000 7f68dbfff700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 0x7f68cc0672e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f68c8004eb0 tx=0x7f68c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:04.872+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68d0053520 con 0x7f68dc0f5430 2022-02-02T20:12:05.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.045+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68dc0fcc50 con 0x7f68cc064e20 2022-02-02T20:12:05.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.055+0000 7f68d97fa700 1 -- 172.21.15.96:0/3530638911 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f68dc0fcc50 con 0x7f68cc064e20 2022-02-02T20:12:05.057 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:12:05.058 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (115m) 86m ago 116m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:12:05.058 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (107m) 86m ago 116m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:12:05.058 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (107m) 84m ago 116m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:12:05.058 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (115m) 86m ago 116m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:12:05.059 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (112m) 86m ago 112m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:12:05.059 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (108m) 86m ago 112m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:12:05.059 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (112m) 84m ago 112m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:12:05.059 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (108m) 84m ago 112m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:12:05.059 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (109m) 86m ago 117m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:12:05.060 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (109m) 84m ago 115m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:12:05.060 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (108m) 86m ago 117m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:12:05.060 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (108m) 84m ago 115m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:12:05.060 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (116m) 86m ago 116m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:12:05.061 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (115m) 84m ago 115m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:12:05.061 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (107m) 86m ago 115m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:12:05.061 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (106m) 86m ago 115m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:12:05.061 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (106m) 86m ago 114m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:12:05.062 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (105m) 84m ago 114m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:12:05.062 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (105m) 84m ago 114m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:12:05.062 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (104m) 84m ago 113m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:12:05.062 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (115m) 86m ago 116m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:12:05.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 msgr2=0x7f68cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 0x7f68cc0672e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f68c8004eb0 tx=0x7f68c8009b30).stop 2022-02-02T20:12:05.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 msgr2=0x7f68dc104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f68d000c790 tx=0x7f68d0007d90).stop 2022-02-02T20:12:05.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 shutdown_connections 2022-02-02T20:12:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68cc064e20 0x7f68cc0672e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68dc0f5430 0x7f68dc104b10 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 --2- 172.21.15.96:0/3530638911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68dc0f66d0 0x7f68dc105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 >> 172.21.15.96:0/3530638911 conn(0x7f68dc0f0b90 msgr2=0x7f68dc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 shutdown_connections 2022-02-02T20:12:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.057+0000 7f68e1bec700 1 -- 172.21.15.96:0/3530638911 wait complete. 2022-02-02T20:12:05.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 -- 172.21.15.96:0/1550392645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 msgr2=0x7f6c8c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1550392645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f6b30 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f6c7c004660 tx=0x7f6c7c009b30).stop 2022-02-02T20:12:05.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 -- 172.21.15.96:0/1550392645 shutdown_connections 2022-02-02T20:12:05.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1550392645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f6b30 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1550392645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 0x7f6c8c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.152+0000 7f6c917b3700 1 -- 172.21.15.96:0/1550392645 >> 172.21.15.96:0/1550392645 conn(0x7f6c8c0f0b90 msgr2=0x7f6c8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 -- 172.21.15.96:0/1550392645 shutdown_connections 2022-02-02T20:12:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 -- 172.21.15.96:0/1550392645 wait complete. 2022-02-02T20:12:05.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 Processor -- start 2022-02-02T20:12:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 -- start start 2022-02-02T20:12:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 0x7f6c8c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0f7f70 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.153+0000 7f6c917b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0f80b0 con 0x7f6c8c0f5430 2022-02-02T20:12:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35746/0 (socket says 172.21.15.96:35746) 2022-02-02T20:12:05.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 -- 172.21.15.96:0/1069407244 learned_addr learned my addr 172.21.15.96:0/1069407244 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8bfff700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 0x7f6c8c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 -- 172.21.15.96:0/1069407244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 msgr2=0x7f6c8c0f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 0x7f6c8c0f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 -- 172.21.15.96:0/1069407244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c005040 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c8b7fe700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f6c7c000c00 tx=0x7f6c7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c019070 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0f8330 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c7c007e70 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c014ce0 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.154+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0f8890 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.155+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c045ad0 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.156+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c7c025070 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.156+0000 7f6c88ff9700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 0x7f6c740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.156+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6c7c082db0 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.157+0000 7f6c8bfff700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 0x7f6c740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.157+0000 7f6c8bfff700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 0x7f6c740672e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f6c8c0f9320 tx=0x7f6c8000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:05.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.160+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c7c050eb0 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.389+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c8c0fdbf0 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.389+0000 7f6c88ff9700 1 -- 172.21.15.96:0/1069407244 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6c7c023020 con 0x7f6c8c0f66d0 2022-02-02T20:12:05.392 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:12:05.393 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:12:05.393 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:12:05.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:05.393 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:12:05.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:12:05.394 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:05.394 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:12:05.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:12:05.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:05.395 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:12:05.395 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:12:05.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:05.395 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:12:05.396 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:12:05.396 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:12:05.396 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:12:05.396 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:12:05.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 msgr2=0x7f6c740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 0x7f6c740672e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f6c8c0f9320 tx=0x7f6c8000b040).stop 2022-02-02T20:12:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 msgr2=0x7f6c8c0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f6c7c000c00 tx=0x7f6c7c00b040).stop 2022-02-02T20:12:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 shutdown_connections 2022-02-02T20:12:05.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c74064e20 0x7f6c740672e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c8c0f5430 0x7f6c8c0f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 --2- 172.21.15.96:0/1069407244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c8c0f66d0 0x7f6c8c0f7a10 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 >> 172.21.15.96:0/1069407244 conn(0x7f6c8c0f0b90 msgr2=0x7f6c8c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:05.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 shutdown_connections 2022-02-02T20:12:05.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.391+0000 7f6c917b3700 1 -- 172.21.15.96:0/1069407244 wait complete. 2022-02-02T20:12:05.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 -- 172.21.15.96:0/2644363899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f66d0 msgr2=0x7f9ec80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2644363899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f66d0 0x7f9ec80f6b30 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f9ebc004660 tx=0x7f9ebc009b30).stop 2022-02-02T20:12:05.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 -- 172.21.15.96:0/2644363899 shutdown_connections 2022-02-02T20:12:05.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2644363899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f66d0 0x7f9ec80f6b30 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2644363899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec80f5430 0x7f9ec80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 -- 172.21.15.96:0/2644363899 >> 172.21.15.96:0/2644363899 conn(0x7f9ec80f0b90 msgr2=0x7f9ec80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 -- 172.21.15.96:0/2644363899 shutdown_connections 2022-02-02T20:12:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.488+0000 7f9eccf11700 1 -- 172.21.15.96:0/2644363899 wait complete. 2022-02-02T20:12:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 Processor -- start 2022-02-02T20:12:05.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 -- start start 2022-02-02T20:12:05.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec81095d0 0x7f9ec810a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8109aa0 con 0x7f9ec80f5430 2022-02-02T20:12:05.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.489+0000 7f9eccf11700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8109be0 con 0x7f9ec81095d0 2022-02-02T20:12:05.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35754/0 (socket says 172.21.15.96:35754) 2022-02-02T20:12:05.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 -- 172.21.15.96:0/2742123831 learned_addr learned my addr 172.21.15.96:0/2742123831 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:05.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec6ffd700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec81095d0 0x7f9ec810a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 -- 172.21.15.96:0/2742123831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec81095d0 msgr2=0x7f9ec810a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec81095d0 0x7f9ec810a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 -- 172.21.15.96:0/2742123831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc005040 con 0x7f9ec80f5430 2022-02-02T20:12:05.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9ec77fe700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f9eb8002700 tx=0x7f9eb8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb80079c0 con 0x7f9ec80f5430 2022-02-02T20:12:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9eb800f040 con 0x7f9ec80f5430 2022-02-02T20:12:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec810aa70 con 0x7f9ec80f5430 2022-02-02T20:12:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb8014860 con 0x7f9ec80f5430 2022-02-02T20:12:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.490+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec810b030 con 0x7f9ec80f5430 2022-02-02T20:12:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.491+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec810b2b0 con 0x7f9ec80f5430 2022-02-02T20:12:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.492+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9eb801b060 con 0x7f9ec80f5430 2022-02-02T20:12:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.492+0000 7f9eaffff700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 0x7f9eb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.493+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9eb80818e0 con 0x7f9ec80f5430 2022-02-02T20:12:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.493+0000 7f9ec6ffd700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 0x7f9eb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.493+0000 7f9ec6ffd700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 0x7f9eb00672e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f9ebc000c00 tx=0x7f9ebc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.497+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9eb8053410 con 0x7f9ec80f5430 2022-02-02T20:12:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.696+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9ec810fb20 con 0x7f9ec80f5430 2022-02-02T20:12:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.697+0000 7f9eaffff700 1 -- 172.21.15.96:0/2742123831 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9eb8019070 con 0x7f9ec80f5430 2022-02-02T20:12:05.700 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:12:05.700 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:12:05.701 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:12:05.701 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:12:05.701 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:05.701 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:12:05.701 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:12:05.702 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:12:05.702 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:12:05.702 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:12:05.703 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:12:05.703 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:12:05.703 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:12:05.703 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:12:05.703 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:12:05.704 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:12:05.704 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:12:05.705 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:12:05.705 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:12:05.705 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:12:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:12:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:12:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:12:05.707 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:12:05.707 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:12:05.707 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:12:05.708 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:12:05.708 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:12:05.708 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:12:05.709 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:12:05.709 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:12:05.709 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:12:05.709 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:05.709 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:05.710 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:12:05.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:05.710 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:05.710 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:05.711 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 msgr2=0x7f9eb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 0x7f9eb00672e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f9ebc000c00 tx=0x7f9ebc009b30).stop 2022-02-02T20:12:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 msgr2=0x7f9ec81090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f9eb8002700 tx=0x7f9eb8009d80).stop 2022-02-02T20:12:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 shutdown_connections 2022-02-02T20:12:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9eb0064e20 0x7f9eb00672e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ec80f5430 0x7f9ec81090e0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 --2- 172.21.15.96:0/2742123831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ec81095d0 0x7f9ec810a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 >> 172.21.15.96:0/2742123831 conn(0x7f9ec80f0b90 msgr2=0x7f9ec805fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 shutdown_connections 2022-02-02T20:12:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:05.699+0000 7f9eccf11700 1 -- 172.21.15.96:0/2742123831 wait complete. 2022-02-02T20:12:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:12:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:05 smithi159 ceph-mon[69013]: from='client.37494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:05 smithi159 ceph-mon[69013]: pgmap v3300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:05 smithi159 ceph-mon[69013]: from='client.37498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1069407244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:12:06.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2742123831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:12:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:05 smithi096 ceph-mon[101353]: from='client.37494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:05 smithi096 ceph-mon[101353]: pgmap v3300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:05 smithi096 ceph-mon[101353]: from='client.37498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1069407244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:12:06.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2742123831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:12:07.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:07 smithi159 ceph-mon[69013]: pgmap v3301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:07 smithi096 ceph-mon[101353]: pgmap v3301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:09 smithi159 ceph-mon[69013]: pgmap v3302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:09 smithi096 ceph-mon[101353]: pgmap v3302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:11 smithi159 ceph-mon[69013]: pgmap v3303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:12.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:11 smithi096 ceph-mon[101353]: pgmap v3303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:13 smithi159 ceph-mon[69013]: pgmap v3304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:13 smithi096 ceph-mon[101353]: pgmap v3304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:15 smithi159 ceph-mon[69013]: pgmap v3305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:15 smithi096 ceph-mon[101353]: pgmap v3305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:17.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:17 smithi159 ceph-mon[69013]: pgmap v3306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:17.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:17 smithi096 ceph-mon[101353]: pgmap v3306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:19 smithi159 ceph-mon[69013]: pgmap v3307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:20.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:19 smithi096 ceph-mon[101353]: pgmap v3307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:21 smithi159 ceph-mon[69013]: pgmap v3308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:21 smithi096 ceph-mon[101353]: pgmap v3308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:23 smithi159 ceph-mon[69013]: pgmap v3309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:23 smithi096 ceph-mon[101353]: pgmap v3309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:25 smithi159 ceph-mon[69013]: pgmap v3310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:25 smithi096 ceph-mon[101353]: pgmap v3310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:27 smithi159 ceph-mon[69013]: pgmap v3311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:12:27.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:12:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:27 smithi096 ceph-mon[101353]: pgmap v3311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:12:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:12:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:29 smithi159 ceph-mon[69013]: pgmap v3312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:29 smithi096 ceph-mon[101353]: pgmap v3312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:31 smithi159 ceph-mon[69013]: pgmap v3313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:32.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:31 smithi096 ceph-mon[101353]: pgmap v3313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:33 smithi159 ceph-mon[69013]: pgmap v3314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:34.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:33 smithi096 ceph-mon[101353]: pgmap v3314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 -- 172.21.15.96:0/1368576222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 msgr2=0x7ff9240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 --2- 172.21.15.96:0/1368576222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff9240f59e0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7ff918004660 tx=0x7ff918009b30).stop 2022-02-02T20:12:35.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 -- 172.21.15.96:0/1368576222 shutdown_connections 2022-02-02T20:12:35.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 --2- 172.21.15.96:0/1368576222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:12:35.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 --2- 172.21.15.96:0/1368576222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff9240f59e0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:35.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 -- 172.21.15.96:0/1368576222 >> 172.21.15.96:0/1368576222 conn(0x7ff9240f0d40 msgr2=0x7ff9240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:35.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 -- 172.21.15.96:0/1368576222 shutdown_connections 2022-02-02T20:12:35.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.809+0000 7ff92aee9700 1 -- 172.21.15.96:0/1368576222 wait complete. 2022-02-02T20:12:35.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.810+0000 7ff92aee9700 1 Processor -- start 2022-02-02T20:12:35.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.810+0000 7ff92aee9700 1 -- start start 2022-02-02T20:12:35.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.810+0000 7ff92aee9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:35.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.810+0000 7ff92aee9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9241063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:35.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff92aee9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241069f0 con 0x7ff9240f55c0 2022-02-02T20:12:35.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff92aee9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241072a0 con 0x7ff9240f6860 2022-02-02T20:12:35.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:35.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35774/0 (socket says 172.21.15.96:35774) 2022-02-02T20:12:35.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 -- 172.21.15.96:0/3471875692 learned_addr learned my addr 172.21.15.96:0/3471875692 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:35.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff923fff700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9241063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:35.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 -- 172.21.15.96:0/3471875692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 msgr2=0x7ff9241063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:35.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9241063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:35.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 -- 172.21.15.96:0/3471875692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918005040 con 0x7ff9240f55c0 2022-02-02T20:12:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff923fff700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9241063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:12:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff928c85700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7ff918009d30 tx=0x7ff918009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91801a070 con 0x7ff9240f55c0 2022-02-02T20:12:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9180097d0 con 0x7ff9240f55c0 2022-02-02T20:12:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924107520 con 0x7ff9240f55c0 2022-02-02T20:12:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91801f8d0 con 0x7ff9240f55c0 2022-02-02T20:12:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.811+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924107a80 con 0x7ff9240f55c0 2022-02-02T20:12:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.812+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9240f49b0 con 0x7ff9240f55c0 2022-02-02T20:12:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.813+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9180125d0 con 0x7ff9240f55c0 2022-02-02T20:12:35.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.813+0000 7ff9217fa700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 0x7ff914067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:35.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.813+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff918085cf0 con 0x7ff9240f55c0 2022-02-02T20:12:35.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.813+0000 7ff923fff700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 0x7ff914067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:35.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.814+0000 7ff923fff700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 0x7ff914067290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7ff91000a7e0 tx=0x7ff910008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:35.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.818+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff918057820 con 0x7ff9240f55c0 2022-02-02T20:12:36.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.998+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff92405f620 con 0x7ff914064dd0 2022-02-02T20:12:36.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:35.999+0000 7ff9217fa700 1 -- 172.21.15.96:0/3471875692 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff92405f620 con 0x7ff914064dd0 2022-02-02T20:12:36.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 msgr2=0x7ff914067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 0x7ff914067290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7ff91000a7e0 tx=0x7ff910008040).stop 2022-02-02T20:12:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 msgr2=0x7ff924105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7ff918009d30 tx=0x7ff918009b30).stop 2022-02-02T20:12:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 shutdown_connections 2022-02-02T20:12:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff914064dd0 0x7ff914067290 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9240f55c0 0x7ff924105ec0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 --2- 172.21.15.96:0/3471875692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9240f6860 0x7ff9241063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 >> 172.21.15.96:0/3471875692 conn(0x7ff9240f0d40 msgr2=0x7ff9240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 shutdown_connections 2022-02-02T20:12:36.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.001+0000 7ff92aee9700 1 -- 172.21.15.96:0/3471875692 wait complete. 2022-02-02T20:12:36.013 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:12:36.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 -- 172.21.15.96:0/4027065181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 msgr2=0x7fcec80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 --2- 172.21.15.96:0/4027065181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec80f6cc0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fceb4004660 tx=0x7fceb4009b30).stop 2022-02-02T20:12:36.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 -- 172.21.15.96:0/4027065181 shutdown_connections 2022-02-02T20:12:36.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 --2- 172.21.15.96:0/4027065181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec80f6cc0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 --2- 172.21.15.96:0/4027065181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 0x7fcec80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 -- 172.21.15.96:0/4027065181 >> 172.21.15.96:0/4027065181 conn(0x7fcec80f0d40 msgr2=0x7fcec80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.102 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:35 smithi096 ceph-mon[101353]: pgmap v3315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 -- 172.21.15.96:0/4027065181 shutdown_connections 2022-02-02T20:12:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 -- 172.21.15.96:0/4027065181 wait complete. 2022-02-02T20:12:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.098+0000 7fceced02700 1 Processor -- start 2022-02-02T20:12:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fceced02700 1 -- start start 2022-02-02T20:12:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fceced02700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 0x7fcec8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fceced02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fceced02700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8060420 con 0x7fcec80f6860 2022-02-02T20:12:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fceced02700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8060560 con 0x7fcec80f55c0 2022-02-02T20:12:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35786/0 (socket says 172.21.15.96:35786) 2022-02-02T20:12:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 -- 172.21.15.96:0/1354496441 learned_addr learned my addr 172.21.15.96:0/1354496441 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcecca9e700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 0x7fcec8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 -- 172.21.15.96:0/1354496441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 msgr2=0x7fcec8109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 0x7fcec8109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.099+0000 7fcec7fff700 1 -- 172.21.15.96:0/1354496441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4005040 con 0x7fcec80f6860 2022-02-02T20:12:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fcec7fff700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7fceb4009990 tx=0x7fceb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb4018070 con 0x7fcec80f6860 2022-02-02T20:12:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec810c6c0 con 0x7fcec80f6860 2022-02-02T20:12:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fceb4007ba0 con 0x7fcec80f6860 2022-02-02T20:12:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb401c3c0 con 0x7fcec80f6860 2022-02-02T20:12:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.100+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec810cbf0 con 0x7fcec80f6860 2022-02-02T20:12:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.101+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8045ad0 con 0x7fcec80f6860 2022-02-02T20:12:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.101+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fceb401d420 con 0x7fcec80f6860 2022-02-02T20:12:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.102+0000 7fcec57fa700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 0x7fceb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.102+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fceb4083740 con 0x7fcec80f6860 2022-02-02T20:12:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.102+0000 7fcecca9e700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 0x7fceb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.102+0000 7fcecca9e700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 0x7fceb8067290 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fcec80600a0 tx=0x7fcebc009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.106+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fceb40517e0 con 0x7fcec80f6860 2022-02-02T20:12:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:35 smithi159 ceph-mon[69013]: pgmap v3315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:36.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.278+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcec8057f10 con 0x7fceb8064dd0 2022-02-02T20:12:36.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.288+0000 7fcec57fa700 1 -- 172.21.15.96:0/1354496441 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fcec8057f10 con 0x7fceb8064dd0 2022-02-02T20:12:36.290 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:12:36.291 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (115m) 86m ago 117m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:12:36.291 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (108m) 86m ago 117m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:12:36.291 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (108m) 85m ago 116m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:12:36.292 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (115m) 86m ago 116m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:12:36.292 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (113m) 86m ago 113m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:12:36.292 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (108m) 86m ago 113m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:12:36.292 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (113m) 85m ago 113m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:12:36.293 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (108m) 85m ago 113m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:12:36.293 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (110m) 86m ago 118m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:12:36.293 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (109m) 85m ago 116m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:12:36.293 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (109m) 86m ago 118m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:12:36.293 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (108m) 85m ago 116m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:12:36.294 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (116m) 86m ago 116m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:12:36.294 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (116m) 85m ago 116m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:12:36.294 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (108m) 86m ago 115m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:12:36.294 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (107m) 86m ago 115m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:12:36.295 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (106m) 86m ago 115m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:12:36.295 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (106m) 85m ago 114m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:12:36.295 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (105m) 85m ago 114m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:12:36.295 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (105m) 85m ago 114m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:12:36.296 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (115m) 86m ago 116m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:12:36.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 msgr2=0x7fceb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 0x7fceb8067290 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fcec80600a0 tx=0x7fcebc009c00).stop 2022-02-02T20:12:36.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 msgr2=0x7fcec810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7fceb4009990 tx=0x7fceb4009b30).stop 2022-02-02T20:12:36.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 shutdown_connections 2022-02-02T20:12:36.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb8064dd0 0x7fceb8067290 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec80f55c0 0x7fcec8109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 --2- 172.21.15.96:0/1354496441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec80f6860 0x7fcec810c110 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 >> 172.21.15.96:0/1354496441 conn(0x7fcec80f0d40 msgr2=0x7fcec80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 shutdown_connections 2022-02-02T20:12:36.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.290+0000 7fceced02700 1 -- 172.21.15.96:0/1354496441 wait complete. 2022-02-02T20:12:36.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 -- 172.21.15.96:0/2883467015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 msgr2=0x7f43000fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 --2- 172.21.15.96:0/2883467015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f43000fb700 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f42f0004660 tx=0x7f42f0009b30).stop 2022-02-02T20:12:36.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 -- 172.21.15.96:0/2883467015 shutdown_connections 2022-02-02T20:12:36.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 --2- 172.21.15.96:0/2883467015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 0x7f43000fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 --2- 172.21.15.96:0/2883467015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f43000fb700 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 -- 172.21.15.96:0/2883467015 >> 172.21.15.96:0/2883467015 conn(0x7f43000f0d40 msgr2=0x7f43000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.385+0000 7f4305ae8700 1 -- 172.21.15.96:0/2883467015 shutdown_connections 2022-02-02T20:12:36.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 -- 172.21.15.96:0/2883467015 wait complete. 2022-02-02T20:12:36.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 Processor -- start 2022-02-02T20:12:36.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 -- start start 2022-02-02T20:12:36.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 0x7f4300109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4300109c10 con 0x7f43000603f0 2022-02-02T20:12:36.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.386+0000 7f4305ae8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4300109d50 con 0x7f43000fbbf0 2022-02-02T20:12:36.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35794/0 (socket says 172.21.15.96:35794) 2022-02-02T20:12:36.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 -- 172.21.15.96:0/4048875169 learned_addr learned my addr 172.21.15.96:0/4048875169 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:36.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42feffd700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 0x7f4300109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 -- 172.21.15.96:0/4048875169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 msgr2=0x7f4300109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 0x7f4300109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 -- 172.21.15.96:0/4048875169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0005040 con 0x7f43000603f0 2022-02-02T20:12:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42ff7fe700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f42f0009990 tx=0x7f42f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f0018070 con 0x7f43000603f0 2022-02-02T20:12:36.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430010a690 con 0x7f43000603f0 2022-02-02T20:12:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42f0007ba0 con 0x7f43000603f0 2022-02-02T20:12:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f001c3c0 con 0x7f43000603f0 2022-02-02T20:12:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.387+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430010abf0 con 0x7f43000603f0 2022-02-02T20:12:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.388+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4300045ad0 con 0x7f43000603f0 2022-02-02T20:12:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.389+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42f001d420 con 0x7f43000603f0 2022-02-02T20:12:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.389+0000 7f42e7fff700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 0x7f42e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.389+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42f0083740 con 0x7f43000603f0 2022-02-02T20:12:36.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.389+0000 7f42feffd700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 0x7f42e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.390+0000 7f42feffd700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 0x7f42e8067290 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f43000601c0 tx=0x7f42f400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.393+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42f00552d0 con 0x7f43000603f0 2022-02-02T20:12:36.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.626+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4300027a00 con 0x7f43000603f0 2022-02-02T20:12:36.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.626+0000 7f42e7fff700 1 -- 172.21.15.96:0/4048875169 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f42f0054ec0 con 0x7f43000603f0 2022-02-02T20:12:36.629 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:12:36.629 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:12:36.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:12:36.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:36.630 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:12:36.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:12:36.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:36.631 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:12:36.631 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:12:36.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:36.631 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:12:36.632 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:12:36.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:12:36.632 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:12:36.632 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:12:36.633 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:12:36.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:12:36.633 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:12:36.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 msgr2=0x7f42e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 0x7f42e8067290 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f43000601c0 tx=0x7f42f400b040).stop 2022-02-02T20:12:36.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 msgr2=0x7f4300109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f42f0009990 tx=0x7f42f0009b30).stop 2022-02-02T20:12:36.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 shutdown_connections 2022-02-02T20:12:36.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42e8064dd0 0x7f42e8067290 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43000603f0 0x7f4300109170 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 --2- 172.21.15.96:0/4048875169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43000fbbf0 0x7f4300109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 >> 172.21.15.96:0/4048875169 conn(0x7f43000f0d40 msgr2=0x7f43000f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 shutdown_connections 2022-02-02T20:12:36.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.628+0000 7f4305ae8700 1 -- 172.21.15.96:0/4048875169 wait complete. 2022-02-02T20:12:36.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 -- 172.21.15.96:0/3501972494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 msgr2=0x7f06bc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 --2- 172.21.15.96:0/3501972494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc0f7de0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7f06a8004660 tx=0x7f06a8009b30).stop 2022-02-02T20:12:36.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 -- 172.21.15.96:0/3501972494 shutdown_connections 2022-02-02T20:12:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 --2- 172.21.15.96:0/3501972494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc0f7de0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 --2- 172.21.15.96:0/3501972494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 0x7f06bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.728+0000 7f06c2b76700 1 -- 172.21.15.96:0/3501972494 >> 172.21.15.96:0/3501972494 conn(0x7f06bc0f1e40 msgr2=0x7f06bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.729+0000 7f06c2b76700 1 -- 172.21.15.96:0/3501972494 shutdown_connections 2022-02-02T20:12:36.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.729+0000 7f06c2b76700 1 -- 172.21.15.96:0/3501972494 wait complete. 2022-02-02T20:12:36.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.729+0000 7f06c2b76700 1 Processor -- start 2022-02-02T20:12:36.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.729+0000 7f06c2b76700 1 -- start start 2022-02-02T20:12:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06c2b76700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 0x7f06bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06c2b76700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06c2b76700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc10abf0 con 0x7f06bc0f7980 2022-02-02T20:12:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06c2b76700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc10ad30 con 0x7f06bc0f66e0 2022-02-02T20:12:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35806/0 (socket says 172.21.15.96:35806) 2022-02-02T20:12:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 -- 172.21.15.96:0/2819504796 learned_addr learned my addr 172.21.15.96:0/2819504796 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:12:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06c0912700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 0x7f06bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 -- 172.21.15.96:0/2819504796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 msgr2=0x7f06bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 0x7f06bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 -- 172.21.15.96:0/2819504796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8005040 con 0x7f06bc0f7980 2022-02-02T20:12:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06bbfff700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f06a8009990 tx=0x7f06a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.730+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a8018070 con 0x7f06bc0f7980 2022-02-02T20:12:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.731+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06a8007ba0 con 0x7f06bc0f7980 2022-02-02T20:12:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.731+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc06a370 con 0x7f06bc0f7980 2022-02-02T20:12:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.731+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc06a8d0 con 0x7f06bc0f7980 2022-02-02T20:12:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.731+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a801c3c0 con 0x7f06bc0f7980 2022-02-02T20:12:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.732+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c004fa0 con 0x7f06bc0f7980 2022-02-02T20:12:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.732+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06a801d420 con 0x7f06bc0f7980 2022-02-02T20:12:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.732+0000 7f06b97fa700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 0x7f06ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:12:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.733+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f06a80836c0 con 0x7f06bc0f7980 2022-02-02T20:12:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.733+0000 7f06c0912700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 0x7f06ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:12:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.733+0000 7f06c0912700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 0x7f06ac067290 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f06bc06b730 tx=0x7f06b000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:12:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.737+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06a8051880 con 0x7f06bc0f7980 2022-02-02T20:12:36.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.937+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f069c005e80 con 0x7f06bc0f7980 2022-02-02T20:12:36.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.937+0000 7f06b97fa700 1 -- 172.21.15.96:0/2819504796 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f06a8054ea0 con 0x7f06bc0f7980 2022-02-02T20:12:36.940 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:12:36.941 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:12:36.941 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:12:36.941 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:12:36.941 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:36.941 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:12:36.942 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:12:36.942 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:12:36.942 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:12:36.942 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:12:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:12:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:12:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:12:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:12:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:12:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:12:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:12:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:12:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:12:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:12:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:12:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:12:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:12:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:12:36.946 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:12:36.946 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:12:36.946 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:12:36.946 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:12:36.947 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:12:36.947 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:12:36.947 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:12:36.947 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:12:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:36.948 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:12:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:12:36.948 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:36.948 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:36.949 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:12:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 msgr2=0x7f06ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 0x7f06ac067290 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f06bc06b730 tx=0x7f06b000b040).stop 2022-02-02T20:12:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 msgr2=0x7f06bc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:12:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f06a8009990 tx=0x7f06a8009b30).stop 2022-02-02T20:12:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 shutdown_connections 2022-02-02T20:12:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06ac064dd0 0x7f06ac067290 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06bc0f66e0 0x7f06bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 --2- 172.21.15.96:0/2819504796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06bc0f7980 0x7f06bc069e20 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:12:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 >> 172.21.15.96:0/2819504796 conn(0x7f06bc0f1e40 msgr2=0x7f06bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:12:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 shutdown_connections 2022-02-02T20:12:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:12:36.939+0000 7f06c2b76700 1 -- 172.21.15.96:0/2819504796 wait complete. 2022-02-02T20:12:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:12:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:36 smithi096 ceph-mon[101353]: from='client.37510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:36 smithi096 ceph-mon[101353]: from='client.37514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4048875169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:12:37.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2819504796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:12:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:36 smithi159 ceph-mon[69013]: from='client.37510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:36 smithi159 ceph-mon[69013]: from='client.37514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:12:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4048875169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:12:37.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2819504796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:12:38.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:37 smithi159 ceph-mon[69013]: pgmap v3316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:37 smithi096 ceph-mon[101353]: pgmap v3316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:40.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:39 smithi159 ceph-mon[69013]: pgmap v3317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:40.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:39 smithi096 ceph-mon[101353]: pgmap v3317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:41 smithi159 ceph-mon[69013]: pgmap v3318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:41 smithi096 ceph-mon[101353]: pgmap v3318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:43 smithi159 ceph-mon[69013]: pgmap v3319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:43 smithi096 ceph-mon[101353]: pgmap v3319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:45 smithi159 ceph-mon[69013]: pgmap v3320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:45 smithi096 ceph-mon[101353]: pgmap v3320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:47 smithi096 ceph-mon[101353]: pgmap v3321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:47 smithi159 ceph-mon[69013]: pgmap v3321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:49 smithi159 ceph-mon[69013]: pgmap v3322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:49 smithi096 ceph-mon[101353]: pgmap v3322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:51 smithi159 ceph-mon[69013]: pgmap v3323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:51 smithi096 ceph-mon[101353]: pgmap v3323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:53 smithi159 ceph-mon[69013]: pgmap v3324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:53 smithi096 ceph-mon[101353]: pgmap v3324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:55 smithi159 ceph-mon[69013]: pgmap v3325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:55 smithi096 ceph-mon[101353]: pgmap v3325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:57 smithi096 ceph-mon[101353]: pgmap v3326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:12:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:57 smithi159 ceph-mon[69013]: pgmap v3326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:12:59 smithi159 ceph-mon[69013]: pgmap v3327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:00.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:12:59 smithi096 ceph-mon[101353]: pgmap v3327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:01 smithi159 ceph-mon[69013]: pgmap v3328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:02.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:01 smithi096 ceph-mon[101353]: pgmap v3328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:03 smithi159 ceph-mon[69013]: pgmap v3329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:03 smithi096 ceph-mon[101353]: pgmap v3329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:05 smithi159 ceph-mon[69013]: pgmap v3330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:05 smithi096 ceph-mon[101353]: pgmap v3330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:07.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 -- 172.21.15.96:0/3377104590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 msgr2=0x7fc3d00f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 --2- 172.21.15.96:0/3377104590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f6900 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7fc3c4004660 tx=0x7fc3c4009b30).stop 2022-02-02T20:13:07.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 -- 172.21.15.96:0/3377104590 shutdown_connections 2022-02-02T20:13:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 --2- 172.21.15.96:0/3377104590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f6900 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 --2- 172.21.15.96:0/3377104590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.048+0000 7fc3d6563700 1 -- 172.21.15.96:0/3377104590 >> 172.21.15.96:0/3377104590 conn(0x7fc3d00f0de0 msgr2=0x7fc3d00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.049+0000 7fc3d6563700 1 -- 172.21.15.96:0/3377104590 shutdown_connections 2022-02-02T20:13:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.049+0000 7fc3d6563700 1 -- 172.21.15.96:0/3377104590 wait complete. 2022-02-02T20:13:07.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.049+0000 7fc3d6563700 1 Processor -- start 2022-02-02T20:13:07.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.049+0000 7fc3d6563700 1 -- start start 2022-02-02T20:13:07.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00f81a0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00f82e0 con 0x7fc3d00f55c0 2022-02-02T20:13:07.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35824/0 (socket says 172.21.15.96:35824) 2022-02-02T20:13:07.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 -- 172.21.15.96:0/1698346682 learned_addr learned my addr 172.21.15.96:0/1698346682 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:07.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cffff700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 -- 172.21.15.96:0/1698346682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 msgr2=0x7fc3d00f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 -- 172.21.15.96:0/1698346682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4005040 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cffff700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:13:07.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3cf7fe700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7fc3c4009990 tx=0x7fc3c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c4018070 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00f8560 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3c4007ca0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c401c620 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.050+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d00f8ac0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.052+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d0045ad0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.052+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc3c401d960 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.052+0000 7fc3ccff9700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 0x7fc3b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.052+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc3c40837e0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.053+0000 7fc3cffff700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 0x7fc3b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.053+0000 7fc3cffff700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 0x7fc3b8067290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fc3d00f9550 tx=0x7fc3c0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.057+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3c40519a0 con 0x7fc3d00f5ed0 2022-02-02T20:13:07.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.237+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d00fad40 con 0x7fc3b8064dd0 2022-02-02T20:13:07.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.238+0000 7fc3ccff9700 1 -- 172.21.15.96:0/1698346682 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc3d00fad40 con 0x7fc3b8064dd0 2022-02-02T20:13:07.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 msgr2=0x7fc3b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 0x7fc3b8067290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fc3d00f9550 tx=0x7fc3c0009040).stop 2022-02-02T20:13:07.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 msgr2=0x7fc3d00f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7fc3c4009990 tx=0x7fc3c4009b30).stop 2022-02-02T20:13:07.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 shutdown_connections 2022-02-02T20:13:07.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc3b8064dd0 0x7fc3b8067290 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d00f55c0 0x7fc3d00f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 --2- 172.21.15.96:0/1698346682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d00f5ed0 0x7fc3d00f7c40 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 >> 172.21.15.96:0/1698346682 conn(0x7fc3d00f0de0 msgr2=0x7fc3d005ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 shutdown_connections 2022-02-02T20:13:07.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.240+0000 7fc3d6563700 1 -- 172.21.15.96:0/1698346682 wait complete. 2022-02-02T20:13:07.253 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:13:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- 172.21.15.96:0/1904754933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f55c0 msgr2=0x7f4a980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/1904754933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f55c0 0x7f4a980f59e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f4a8c004660 tx=0x7f4a8c009b30).stop 2022-02-02T20:13:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- 172.21.15.96:0/1904754933 shutdown_connections 2022-02-02T20:13:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/1904754933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f6860 0x7f4a980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:13:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/1904754933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f55c0 0x7f4a980f59e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- 172.21.15.96:0/1904754933 >> 172.21.15.96:0/1904754933 conn(0x7f4a980f0d40 msgr2=0x7f4a980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- 172.21.15.96:0/1904754933 shutdown_connections 2022-02-02T20:13:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- 172.21.15.96:0/1904754933 wait complete. 2022-02-02T20:13:07.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 Processor -- start 2022-02-02T20:13:07.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.338+0000 7f4a9ef83700 1 -- start start 2022-02-02T20:13:07.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f55c0 0x7f4a98109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98060450 con 0x7f4a980f6860 2022-02-02T20:13:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98060590 con 0x7f4a980f55c0 2022-02-02T20:13:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35834/0 (socket says 172.21.15.96:35834) 2022-02-02T20:13:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 -- 172.21.15.96:0/2783118858 learned_addr learned my addr 172.21.15.96:0/2783118858 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9cd1f700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f55c0 0x7f4a98109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 -- 172.21.15.96:0/2783118858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f55c0 msgr2=0x7f4a98109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f55c0 0x7f4a98109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 -- 172.21.15.96:0/2783118858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c005040 con 0x7f4a980f6860 2022-02-02T20:13:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a97fff700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f4a8400b410 tx=0x7f4a84006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a840125f0 con 0x7f4a980f6860 2022-02-02T20:13:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a8400be80 con 0x7f4a980f6860 2022-02-02T20:13:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9810c7f0 con 0x7f4a980f6860 2022-02-02T20:13:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a84002ac0 con 0x7f4a980f6860 2022-02-02T20:13:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.339+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9810cdb0 con 0x7f4a980f6860 2022-02-02T20:13:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.341+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a98045ad0 con 0x7f4a980f6860 2022-02-02T20:13:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.341+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a8400f030 con 0x7f4a980f6860 2022-02-02T20:13:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.341+0000 7f4a957fa700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 0x7f4a88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.341+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4a84081ec0 con 0x7f4a980f6860 2022-02-02T20:13:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.341+0000 7f4a9cd1f700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 0x7f4a88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.342+0000 7f4a9cd1f700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 0x7f4a88067290 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f4a8c009da0 tx=0x7f4a8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.345+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a8404ff60 con 0x7f4a980f6860 2022-02-02T20:13:07.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.517+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a980fdfb0 con 0x7f4a88064dd0 2022-02-02T20:13:07.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.527+0000 7f4a957fa700 1 -- 172.21.15.96:0/2783118858 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f4a8c009630 con 0x7f4a88064dd0 2022-02-02T20:13:07.530 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:13:07.531 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (116m) 87m ago 117m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:13:07.531 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (108m) 87m ago 117m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:13:07.531 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (108m) 85m ago 117m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:13:07.531 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (116m) 87m ago 117m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:13:07.532 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (113m) 87m ago 113m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:13:07.532 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (109m) 87m ago 113m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:13:07.532 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (113m) 85m ago 113m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:13:07.532 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (109m) 85m ago 113m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:13:07.533 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (110m) 87m ago 118m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:13:07.533 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (110m) 85m ago 117m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:13:07.533 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (109m) 87m ago 118m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:13:07.533 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (109m) 85m ago 116m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:13:07.533 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (117m) 87m ago 117m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:13:07.534 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (116m) 85m ago 116m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:13:07.534 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (108m) 87m ago 116m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:13:07.534 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (108m) 87m ago 116m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:13:07.534 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (107m) 87m ago 115m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:13:07.535 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (106m) 85m ago 115m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:13:07.535 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (106m) 85m ago 115m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:13:07.535 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (105m) 85m ago 114m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:13:07.535 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (116m) 87m ago 117m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:13:07.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 msgr2=0x7f4a88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 0x7f4a88067290 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f4a8c009da0 tx=0x7f4a8c009b30).stop 2022-02-02T20:13:07.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 msgr2=0x7f4a9810c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f4a8400b410 tx=0x7f4a84006ef0).stop 2022-02-02T20:13:07.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 shutdown_connections 2022-02-02T20:13:07.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a88064dd0 0x7f4a88067290 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a980f55c0 0x7f4a98109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 --2- 172.21.15.96:0/2783118858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a980f6860 0x7f4a9810c1e0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 >> 172.21.15.96:0/2783118858 conn(0x7f4a980f0d40 msgr2=0x7f4a980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 shutdown_connections 2022-02-02T20:13:07.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.530+0000 7f4a9ef83700 1 -- 172.21.15.96:0/2783118858 wait complete. 2022-02-02T20:13:07.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3876092084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f55c0 msgr2=0x7f8f3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3876092084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c0f59e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f8f30004660 tx=0x7f8f30009b30).stop 2022-02-02T20:13:07.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3876092084 shutdown_connections 2022-02-02T20:13:07.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3876092084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3876092084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c0f59e0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3876092084 >> 172.21.15.96:0/3876092084 conn(0x7f8f3c0f0d40 msgr2=0x7f8f3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.631 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:07 smithi096 ceph-mon[101353]: pgmap v3331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:07.631 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:07 smithi096 ceph-mon[101353]: from='client.37526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:07.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3876092084 shutdown_connections 2022-02-02T20:13:07.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3876092084 wait complete. 2022-02-02T20:13:07.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 Processor -- start 2022-02-02T20:13:07.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.626+0000 7f8f40dbc700 1 -- start start 2022-02-02T20:13:07.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f40dbc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f40dbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f40dbc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1069c0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f40dbc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1071d0 con 0x7f8f3c0f55c0 2022-02-02T20:13:07.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35844/0 (socket says 172.21.15.96:35844) 2022-02-02T20:13:07.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 -- 172.21.15.96:0/3697154733 learned_addr learned my addr 172.21.15.96:0/3697154733 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:07.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f3a59c700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 -- 172.21.15.96:0/3697154733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f55c0 msgr2=0x7f8f3c105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 -- 172.21.15.96:0/3697154733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30005040 con 0x7f8f3c0f6860 2022-02-02T20:13:07.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f39d9b700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f8f2c00e7f0 tx=0x7f8f2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.627+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c0092e0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.628+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f2c00f040 con 0x7f8f3c0f6860 2022-02-02T20:13:07.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.628+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c014830 con 0x7f8f3c0f6860 2022-02-02T20:13:07.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.628+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c107450 con 0x7f8f3c0f6860 2022-02-02T20:13:07.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.628+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c107a10 con 0x7f8f3c0f6860 2022-02-02T20:13:07.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.629+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c0f49b0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.629+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f2c0077b0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.629+0000 7f8f2affd700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.630+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8f2c081a80 con 0x7f8f3c0f6860 2022-02-02T20:13:07.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.630+0000 7f8f3a59c700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.630+0000 7f8f3a59c700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f8f30000c00 tx=0x7f8f30016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.634+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f2c0497d0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.862+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f3c045ad0 con 0x7f8f3c0f6860 2022-02-02T20:13:07.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.863+0000 7f8f2affd700 1 -- 172.21.15.96:0/3697154733 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8f2c04fb80 con 0x7f8f3c0f6860 2022-02-02T20:13:07.867 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:13:07.867 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:13:07.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:13:07.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:07.868 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:13:07.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:13:07.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:07.868 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:13:07.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:13:07.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:07.869 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:13:07.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:13:07.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:07.870 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:13:07.870 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:13:07.870 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:13:07.871 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:13:07.871 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:13:07.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.864+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 msgr2=0x7f8f24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.864+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f8f30000c00 tx=0x7f8f30016040).stop 2022-02-02T20:13:07.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.864+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 msgr2=0x7f8f3c1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.864+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f8f2c00e7f0 tx=0x7f8f2c00b040).stop 2022-02-02T20:13:07.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.864+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 shutdown_connections 2022-02-02T20:13:07.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f3c0f55c0 0x7f8f3c105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 --2- 172.21.15.96:0/3697154733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f3c0f6860 0x7f8f3c1063c0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 >> 172.21.15.96:0/3697154733 conn(0x7f8f3c0f0d40 msgr2=0x7f8f3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 shutdown_connections 2022-02-02T20:13:07.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.865+0000 7f8f40dbc700 1 -- 172.21.15.96:0/3697154733 wait complete. 2022-02-02T20:13:07.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 -- 172.21.15.96:0/97606128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 msgr2=0x7f51680f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 --2- 172.21.15.96:0/97606128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7080 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f515c004660 tx=0x7f515c009b30).stop 2022-02-02T20:13:07.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 -- 172.21.15.96:0/97606128 shutdown_connections 2022-02-02T20:13:07.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 --2- 172.21.15.96:0/97606128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 0x7f51680f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 --2- 172.21.15.96:0/97606128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7080 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 -- 172.21.15.96:0/97606128 >> 172.21.15.96:0/97606128 conn(0x7f51680f04c0 msgr2=0x7f51680f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:07.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 -- 172.21.15.96:0/97606128 shutdown_connections 2022-02-02T20:13:07.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 -- 172.21.15.96:0/97606128 wait complete. 2022-02-02T20:13:07.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.962+0000 7f516e5a6700 1 Processor -- start 2022-02-02T20:13:07.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f516e5a6700 1 -- start start 2022-02-02T20:13:07.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f516e5a6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 0x7f51680f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f516e5a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f516e5a6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680f8220 con 0x7f51680f6c60 2022-02-02T20:13:07.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f516e5a6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680f8360 con 0x7f51680f5970 2022-02-02T20:13:07.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35852/0 (socket says 172.21.15.96:35852) 2022-02-02T20:13:07.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 -- 172.21.15.96:0/37845202 learned_addr learned my addr 172.21.15.96:0/37845202 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:07.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f5167fff700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 0x7f51680f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 -- 172.21.15.96:0/37845202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 msgr2=0x7f51680f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 0x7f51680f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 -- 172.21.15.96:0/37845202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c005040 con 0x7f51680f6c60 2022-02-02T20:13:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.963+0000 7f51677fe700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f515800c530 tx=0x7f5158007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.964+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515800f650 con 0x7f51680f6c60 2022-02-02T20:13:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.964+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f515800fc60 con 0x7f51680f6c60 2022-02-02T20:13:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.964+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51680f8640 con 0x7f51680f6c60 2022-02-02T20:13:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.964+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5158012c20 con 0x7f51680f6c60 2022-02-02T20:13:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.964+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516810ef60 con 0x7f51680f6c60 2022-02-02T20:13:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.965+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5168045ad0 con 0x7f51680f6c60 2022-02-02T20:13:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.965+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5158010070 con 0x7f51680f6c60 2022-02-02T20:13:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.966+0000 7f5164ff9700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 0x7f5150067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.966+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f51580816b0 con 0x7f51680f6c60 2022-02-02T20:13:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.966+0000 7f5167fff700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 0x7f5150067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:07.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.966+0000 7f5167fff700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 0x7f5150067290 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f515c004630 tx=0x7f515c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:07.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:07.970+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f515804f7b0 con 0x7f51680f6c60 2022-02-02T20:13:08.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:07 smithi159 ceph-mon[69013]: pgmap v3331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:08.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:07 smithi159 ceph-mon[69013]: from='client.37526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:08.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.175+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f51680fde40 con 0x7f51680f6c60 2022-02-02T20:13:08.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.175+0000 7f5164ff9700 1 -- 172.21.15.96:0/37845202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5158052dd0 con 0x7f51680f6c60 2022-02-02T20:13:08.179 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:13:08.179 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:13:08.180 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:13:08.180 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:13:08.180 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:08.180 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:13:08.180 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:13:08.181 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:13:08.181 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:13:08.181 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:13:08.181 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:13:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:13:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:13:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:13:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:13:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:13:08.183 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:13:08.183 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:13:08.183 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:13:08.183 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:13:08.183 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:13:08.184 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:13:08.184 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:13:08.184 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:13:08.184 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:13:08.185 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:13:08.186 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:13:08.186 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:08.186 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:08.186 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:13:08.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:08.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:08.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:08.187 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 msgr2=0x7f5150067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 0x7f5150067290 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f515c004630 tx=0x7f515c009b30).stop 2022-02-02T20:13:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 msgr2=0x7f51680f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f515800c530 tx=0x7f5158007e20).stop 2022-02-02T20:13:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 shutdown_connections 2022-02-02T20:13:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5150064dd0 0x7f5150067290 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:08.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51680f5970 0x7f51680f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:08.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 --2- 172.21.15.96:0/37845202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51680f6c60 0x7f51680f7cc0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:08.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 >> 172.21.15.96:0/37845202 conn(0x7f51680f04c0 msgr2=0x7f51680f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:08.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 shutdown_connections 2022-02-02T20:13:08.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:08.177+0000 7f516e5a6700 1 -- 172.21.15.96:0/37845202 wait complete. 2022-02-02T20:13:08.191 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:13:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:08 smithi096 ceph-mon[101353]: from='client.37530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3697154733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:13:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/37845202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:13:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:08 smithi159 ceph-mon[69013]: from='client.37530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3697154733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:13:09.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/37845202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:13:09.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:09 smithi096 ceph-mon[101353]: pgmap v3332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:10.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:09 smithi159 ceph-mon[69013]: pgmap v3332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:11 smithi159 ceph-mon[69013]: pgmap v3333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:11 smithi096 ceph-mon[101353]: pgmap v3333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:13 smithi159 ceph-mon[69013]: pgmap v3334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:13 smithi096 ceph-mon[101353]: pgmap v3334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:15 smithi159 ceph-mon[69013]: pgmap v3335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:15 smithi096 ceph-mon[101353]: pgmap v3335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:17.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:17 smithi096 ceph-mon[101353]: pgmap v3336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:18.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:17 smithi159 ceph-mon[69013]: pgmap v3336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:19 smithi159 ceph-mon[69013]: pgmap v3337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:19 smithi096 ceph-mon[101353]: pgmap v3337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:21 smithi159 ceph-mon[69013]: pgmap v3338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:21 smithi096 ceph-mon[101353]: pgmap v3338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:23 smithi159 ceph-mon[69013]: pgmap v3339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:24.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:23 smithi096 ceph-mon[101353]: pgmap v3339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:25 smithi159 ceph-mon[69013]: pgmap v3340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:26.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:25 smithi096 ceph-mon[101353]: pgmap v3340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:27 smithi096 ceph-mon[101353]: pgmap v3341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:13:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:13:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:27 smithi159 ceph-mon[69013]: pgmap v3341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:13:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:13:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:29 smithi159 ceph-mon[69013]: pgmap v3342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:30.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:29 smithi096 ceph-mon[101353]: pgmap v3342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:31 smithi159 ceph-mon[69013]: pgmap v3343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:31 smithi096 ceph-mon[101353]: pgmap v3343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:33 smithi159 ceph-mon[69013]: pgmap v3344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:33 smithi096 ceph-mon[101353]: pgmap v3344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:35 smithi159 ceph-mon[69013]: pgmap v3345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:36.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:35 smithi096 ceph-mon[101353]: pgmap v3345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:37.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:37 smithi096 ceph-mon[101353]: pgmap v3346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:37 smithi159 ceph-mon[69013]: pgmap v3346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:38.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 -- 172.21.15.96:0/1835553901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 msgr2=0x7f2bb40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/1835553901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb40f7a20 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f2ba4004660 tx=0x7f2ba4009b30).stop 2022-02-02T20:13:38.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 -- 172.21.15.96:0/1835553901 shutdown_connections 2022-02-02T20:13:38.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/1835553901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb40f7a20 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/1835553901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 0x7f2bb40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 -- 172.21.15.96:0/1835553901 >> 172.21.15.96:0/1835553901 conn(0x7f2bb40f1f00 msgr2=0x7f2bb40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:38.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 -- 172.21.15.96:0/1835553901 shutdown_connections 2022-02-02T20:13:38.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.289+0000 7f2bb95fa700 1 -- 172.21.15.96:0/1835553901 wait complete. 2022-02-02T20:13:38.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 Processor -- start 2022-02-02T20:13:38.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 -- start start 2022-02-02T20:13:38.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 0x7f2bb406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb406a380 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb95fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb406a4c0 con 0x7f2bb40f66e0 2022-02-02T20:13:38.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35870/0 (socket says 172.21.15.96:35870) 2022-02-02T20:13:38.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.290+0000 7f2bb27fc700 1 -- 172.21.15.96:0/2561906362 learned_addr learned my addr 172.21.15.96:0/2561906362 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:38.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb2ffd700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 0x7f2bb406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb27fc700 1 -- 172.21.15.96:0/2561906362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 msgr2=0x7f2bb406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb27fc700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 0x7f2bb406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb27fc700 1 -- 172.21.15.96:0/2561906362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4005040 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb27fc700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f2ba4009da0 tx=0x7f2ba4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba4018070 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ba4007cf0 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba401c620 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb406a740 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.291+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb406ac50 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.292+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb4045ad0 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.293+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2ba401d420 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.293+0000 7f2b9b7fe700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 0x7f2b9c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.293+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2ba40839b0 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.293+0000 7f2bb2ffd700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 0x7f2b9c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.294+0000 7f2bb2ffd700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 0x7f2b9c067270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f2ba80041d0 tx=0x7f2ba8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.298+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2ba4051ab0 con 0x7f2bb40f6ff0 2022-02-02T20:13:38.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.477+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bb40fefe0 con 0x7f2b9c064db0 2022-02-02T20:13:38.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.478+0000 7f2b9b7fe700 1 -- 172.21.15.96:0/2561906362 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2bb40fefe0 con 0x7f2b9c064db0 2022-02-02T20:13:38.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 msgr2=0x7f2b9c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 0x7f2b9c067270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f2ba80041d0 tx=0x7f2ba8009040).stop 2022-02-02T20:13:38.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 msgr2=0x7f2bb4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f2ba4009da0 tx=0x7f2ba4009b30).stop 2022-02-02T20:13:38.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 shutdown_connections 2022-02-02T20:13:38.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b9c064db0 0x7f2b9c067270 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb40f66e0 0x7f2bb406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 --2- 172.21.15.96:0/2561906362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb40f6ff0 0x7f2bb4069e20 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 >> 172.21.15.96:0/2561906362 conn(0x7f2bb40f1f00 msgr2=0x7f2bb40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:38.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 shutdown_connections 2022-02-02T20:13:38.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.480+0000 7f2bb95fa700 1 -- 172.21.15.96:0/2561906362 wait complete. 2022-02-02T20:13:38.492 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:13:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:38 smithi096 ceph-mon[101353]: from='client.37542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:38.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/1154645410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f55c0 msgr2=0x7f9e180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/1154645410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f55c0 0x7f9e180f59e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f9e0c004660 tx=0x7f9e0c009b30).stop 2022-02-02T20:13:38.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/1154645410 shutdown_connections 2022-02-02T20:13:38.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/1154645410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f6860 0x7f9e180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/1154645410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f55c0 0x7f9e180f59e0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/1154645410 >> 172.21.15.96:0/1154645410 conn(0x7f9e180f0d40 msgr2=0x7f9e180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:38.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.577+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/1154645410 shutdown_connections 2022-02-02T20:13:38.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/1154645410 wait complete. 2022-02-02T20:13:38.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 Processor -- start 2022-02-02T20:13:38.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 -- start start 2022-02-02T20:13:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f55c0 0x7f9e18109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180603c0 con 0x7f9e180f6860 2022-02-02T20:13:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.578+0000 7f9e1e4c9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18060500 con 0x7f9e180f55c0 2022-02-02T20:13:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35878/0 (socket says 172.21.15.96:35878) 2022-02-02T20:13:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 -- 172.21.15.96:0/2622500703 learned_addr learned my addr 172.21.15.96:0/2622500703 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e17fff700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f55c0 0x7f9e18109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 -- 172.21.15.96:0/2622500703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f55c0 msgr2=0x7f9e18109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f55c0 0x7f9e18109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 -- 172.21.15.96:0/2622500703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c005040 con 0x7f9e180f6860 2022-02-02T20:13:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e177fe700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f9e0800c530 tx=0x7f9e08007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0800f650 con 0x7f9e180f6860 2022-02-02T20:13:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1810c740 con 0x7f9e180f6860 2022-02-02T20:13:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e0800fc60 con 0x7f9e180f6860 2022-02-02T20:13:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e08012cd0 con 0x7f9e180f6860 2022-02-02T20:13:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.579+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1810ccd0 con 0x7f9e180f6860 2022-02-02T20:13:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.580+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e180f49b0 con 0x7f9e180f6860 2022-02-02T20:13:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.581+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e08010070 con 0x7f9e180f6860 2022-02-02T20:13:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.581+0000 7f9e14ff9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 0x7f9e00067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.581+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e08081780 con 0x7f9e180f6860 2022-02-02T20:13:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.581+0000 7f9e17fff700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 0x7f9e00067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.581+0000 7f9e17fff700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 0x7f9e00067270 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f9e18060040 tx=0x7f9e0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.585+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e0804f880 con 0x7f9e180f6860 2022-02-02T20:13:38.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.755+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e180fdf00 con 0x7f9e00064db0 2022-02-02T20:13:38.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.765+0000 7f9e14ff9700 1 -- 172.21.15.96:0/2622500703 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f9e180fdf00 con 0x7f9e00064db0 2022-02-02T20:13:38.768 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:13:38.768 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (117m) 87m ago 118m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:13:38.768 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (109m) 87m ago 118m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:13:38.769 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (109m) 86m ago 117m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:13:38.769 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (116m) 87m ago 117m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:13:38.769 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (114m) 87m ago 114m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:13:38.769 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (109m) 87m ago 114m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:13:38.769 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (114m) 86m ago 114m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:13:38.770 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (109m) 86m ago 114m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:13:38.770 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (111m) 87m ago 119m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:13:38.770 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (110m) 86m ago 117m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:13:38.770 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (110m) 87m ago 119m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:13:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (110m) 86m ago 117m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:13:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (117m) 87m ago 117m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:13:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (117m) 86m ago 117m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:13:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (109m) 87m ago 116m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:13:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (108m) 87m ago 116m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:13:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (107m) 87m ago 116m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:13:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (107m) 86m ago 116m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:13:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (106m) 86m ago 115m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:13:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (106m) 86m ago 115m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:13:38.773 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (116m) 87m ago 117m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:13:38.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.766+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 msgr2=0x7f9e00067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.766+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 0x7f9e00067270 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f9e18060040 tx=0x7f9e0c009b30).stop 2022-02-02T20:13:38.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.766+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 msgr2=0x7f9e1810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.766+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f9e0800c530 tx=0x7f9e08007e20).stop 2022-02-02T20:13:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.766+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 shutdown_connections 2022-02-02T20:13:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e00064db0 0x7f9e00067270 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e180f55c0 0x7f9e18109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 --2- 172.21.15.96:0/2622500703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180f6860 0x7f9e1810c190 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 >> 172.21.15.96:0/2622500703 conn(0x7f9e180f0d40 msgr2=0x7f9e180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 shutdown_connections 2022-02-02T20:13:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.767+0000 7f9e1e4c9700 1 -- 172.21.15.96:0/2622500703 wait complete. 2022-02-02T20:13:38.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 -- 172.21.15.96:0/2150989778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f7980 msgr2=0x7f2f1c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 --2- 172.21.15.96:0/2150989778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c0f7de0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f2f0c004660 tx=0x7f2f0c009b30).stop 2022-02-02T20:13:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 -- 172.21.15.96:0/2150989778 shutdown_connections 2022-02-02T20:13:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 --2- 172.21.15.96:0/2150989778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c0f7de0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 --2- 172.21.15.96:0/2150989778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 -- 172.21.15.96:0/2150989778 >> 172.21.15.96:0/2150989778 conn(0x7f2f1c0f1e40 msgr2=0x7f2f1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:38.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 -- 172.21.15.96:0/2150989778 shutdown_connections 2022-02-02T20:13:38.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.863+0000 7f2f21964700 1 -- 172.21.15.96:0/2150989778 wait complete. 2022-02-02T20:13:38.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 Processor -- start 2022-02-02T20:13:38.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 -- start start 2022-02-02T20:13:38.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c107a00 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f21964700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c107b40 con 0x7f2f1c0f7980 2022-02-02T20:13:38.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35886/0 (socket says 172.21.15.96:35886) 2022-02-02T20:13:38.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f1affd700 1 -- 172.21.15.96:0/3720949964 learned_addr learned my addr 172.21.15.96:0/3720949964 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:38.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.864+0000 7f2f1a7fc700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f1affd700 1 -- 172.21.15.96:0/3720949964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 msgr2=0x7f2f1c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:38.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f1affd700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:38.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f1affd700 1 -- 172.21.15.96:0/3720949964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c005040 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f1a7fc700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:13:38.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f1affd700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f2f10002700 tx=0x7f2f10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f10009320 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f1000f040 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c1084e0 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f10014900 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.865+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c108aa0 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.866+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f10009480 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.867+0000 7f2f037fe700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 0x7f2f04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:38.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.867+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2f10081cc0 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.867+0000 7f2f1a7fc700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 0x7f2f04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:38.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.867+0000 7f2f1a7fc700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 0x7f2f04067290 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f2f0c004630 tx=0x7f2f0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:38.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.867+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c0f5ad0 con 0x7f2f1c0f66e0 2022-02-02T20:13:38.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:38.872+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f100538b0 con 0x7f2f1c0f66e0 2022-02-02T20:13:39.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:38 smithi159 ceph-mon[69013]: from='client.37542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:39.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.105+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f1c0feea0 con 0x7f2f1c0f66e0 2022-02-02T20:13:39.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.105+0000 7f2f037fe700 1 -- 172.21.15.96:0/3720949964 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2f100534a0 con 0x7f2f1c0f66e0 2022-02-02T20:13:39.109 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:13:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:13:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:13:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:13:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:13:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:13:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:13:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:13:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:13:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:13:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:13:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:13:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:13:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:13:39.113 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:13:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 msgr2=0x7f2f04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 0x7f2f04067290 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f2f0c004630 tx=0x7f2f0c009b30).stop 2022-02-02T20:13:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 msgr2=0x7f2f1c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f2f10002700 tx=0x7f2f10009d80).stop 2022-02-02T20:13:39.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 shutdown_connections 2022-02-02T20:13:39.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f04064dd0 0x7f2f04067290 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f1c0f66e0 0x7f2f1c106f60 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 --2- 172.21.15.96:0/3720949964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f1c0f7980 0x7f2f1c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 >> 172.21.15.96:0/3720949964 conn(0x7f2f1c0f1e40 msgr2=0x7f2f1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:39.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 shutdown_connections 2022-02-02T20:13:39.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.107+0000 7f2f21964700 1 -- 172.21.15.96:0/3720949964 wait complete. 2022-02-02T20:13:39.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1520327261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f55c0 msgr2=0x7f72b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1520327261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f55c0 0x7f72b40f59e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f72a4004660 tx=0x7f72a4009b30).stop 2022-02-02T20:13:39.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1520327261 shutdown_connections 2022-02-02T20:13:39.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1520327261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f6860 0x7f72b40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:13:39.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1520327261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f55c0 0x7f72b40f59e0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1520327261 >> 172.21.15.96:0/1520327261 conn(0x7f72b40f0d40 msgr2=0x7f72b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:39.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1520327261 shutdown_connections 2022-02-02T20:13:39.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.205+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1520327261 wait complete. 2022-02-02T20:13:39.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 Processor -- start 2022-02-02T20:13:39.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 -- start start 2022-02-02T20:13:39.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 0x7f72b40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:39.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:39.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40f8190 con 0x7f72b40f6860 2022-02-02T20:13:39.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72bb2fe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40f82d0 con 0x7f72b40f55c0 2022-02-02T20:13:39.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35898/0 (socket says 172.21.15.96:35898) 2022-02-02T20:13:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 -- 172.21.15.96:0/1025869242 learned_addr learned my addr 172.21.15.96:0/1025869242 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:13:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b909a700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 0x7f72b40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 -- 172.21.15.96:0/1025869242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 msgr2=0x7f72b40f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 0x7f72b40f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b8899700 1 -- 172.21.15.96:0/1025869242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4005040 con 0x7f72b40f6860 2022-02-02T20:13:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.206+0000 7f72b909a700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 0x7f72b40f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:13:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72b8899700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f72b000b410 tx=0x7f72b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b00125f0 con 0x7f72b40f6860 2022-02-02T20:13:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72b0012c00 con 0x7f72b40f6860 2022-02-02T20:13:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0002ae0 con 0x7f72b40f6860 2022-02-02T20:13:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b40f85b0 con 0x7f72b40f6860 2022-02-02T20:13:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.207+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b410efc0 con 0x7f72b40f6860 2022-02-02T20:13:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.208+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4045ad0 con 0x7f72b40f6860 2022-02-02T20:13:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.209+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72b000f030 con 0x7f72b40f6860 2022-02-02T20:13:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.209+0000 7f72a9ffb700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 0x7f72a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:13:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.209+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f72b0081ed0 con 0x7f72b40f6860 2022-02-02T20:13:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.209+0000 7f72b909a700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 0x7f72a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:13:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.210+0000 7f72b909a700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 0x7f72a0067290 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f72a4004e30 tx=0x7f72a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:13:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.213+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72b004ffd0 con 0x7f72b40f6860 2022-02-02T20:13:39.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.412+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72b40fde00 con 0x7f72b40f6860 2022-02-02T20:13:39.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.412+0000 7f72a9ffb700 1 -- 172.21.15.96:0/1025869242 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f72b00535f0 con 0x7f72b40f6860 2022-02-02T20:13:39.416 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:13:39.416 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:13:39.416 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:13:39.416 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:13:39.417 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:39.417 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:13:39.417 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:13:39.417 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:13:39.417 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:13:39.418 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:13:39.418 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:13:39.418 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:13:39.418 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:13:39.418 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:13:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:13:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:13:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:13:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:13:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:13:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:13:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:13:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:13:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:13:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:13:39.421 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:13:39.421 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:13:39.421 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:13:39.421 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:13:39.422 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:13:39.422 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:13:39.422 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:13:39.422 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:13:39.422 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:39.423 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:39.423 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:13:39.423 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:13:39.423 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:39.424 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:39.424 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:13:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 msgr2=0x7f72a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 0x7f72a0067290 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f72a4004e30 tx=0x7f72a4009b30).stop 2022-02-02T20:13:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 msgr2=0x7f72b40f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:13:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f72b000b410 tx=0x7f72b0006ef0).stop 2022-02-02T20:13:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 shutdown_connections 2022-02-02T20:13:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72a0064dd0 0x7f72a0067290 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b40f55c0 0x7f72b40f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 --2- 172.21.15.96:0/1025869242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72b40f6860 0x7f72b40f7ba0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:13:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 >> 172.21.15.96:0/1025869242 conn(0x7f72b40f0d40 msgr2=0x7f72b405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:13:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 shutdown_connections 2022-02-02T20:13:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:13:39.414+0000 7f72bb2fe700 1 -- 172.21.15.96:0/1025869242 wait complete. 2022-02-02T20:13:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:13:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:39 smithi096 ceph-mon[101353]: from='client.37546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:39 smithi096 ceph-mon[101353]: pgmap v3347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3720949964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:13:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1025869242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:13:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:39 smithi159 ceph-mon[69013]: from='client.37546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:13:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:39 smithi159 ceph-mon[69013]: pgmap v3347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3720949964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:13:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1025869242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:13:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:41 smithi159 ceph-mon[69013]: pgmap v3348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:41 smithi096 ceph-mon[101353]: pgmap v3348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:43 smithi159 ceph-mon[69013]: pgmap v3349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:43 smithi096 ceph-mon[101353]: pgmap v3349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:46.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:45 smithi159 ceph-mon[69013]: pgmap v3350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:46.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:45 smithi096 ceph-mon[101353]: pgmap v3350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:47.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:47 smithi096 ceph-mon[101353]: pgmap v3351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:47 smithi159 ceph-mon[69013]: pgmap v3351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:49 smithi159 ceph-mon[69013]: pgmap v3352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:49 smithi096 ceph-mon[101353]: pgmap v3352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:51 smithi159 ceph-mon[69013]: pgmap v3353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:51 smithi096 ceph-mon[101353]: pgmap v3353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:53 smithi159 ceph-mon[69013]: pgmap v3354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:53 smithi096 ceph-mon[101353]: pgmap v3354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:55 smithi159 ceph-mon[69013]: pgmap v3355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:55 smithi096 ceph-mon[101353]: pgmap v3355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:57 smithi096 ceph-mon[101353]: pgmap v3356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:13:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:57 smithi159 ceph-mon[69013]: pgmap v3356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:13:59 smithi159 ceph-mon[69013]: pgmap v3357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:13:59 smithi096 ceph-mon[101353]: pgmap v3357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:01 smithi159 ceph-mon[69013]: pgmap v3358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:01 smithi096 ceph-mon[101353]: pgmap v3358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:03 smithi159 ceph-mon[69013]: pgmap v3359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:03 smithi096 ceph-mon[101353]: pgmap v3359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:05 smithi159 ceph-mon[69013]: pgmap v3360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:05 smithi096 ceph-mon[101353]: pgmap v3360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:07.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:07 smithi096 ceph-mon[101353]: pgmap v3361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:08.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:07 smithi159 ceph-mon[69013]: pgmap v3361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.526+0000 7f8af0d39700 1 -- 172.21.15.96:0/2873273573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 msgr2=0x7f8aec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.526+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2873273573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec0f59e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f8adc004660 tx=0x7f8adc009b30).stop 2022-02-02T20:14:09.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- 172.21.15.96:0/2873273573 shutdown_connections 2022-02-02T20:14:09.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2873273573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2873273573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec0f59e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- 172.21.15.96:0/2873273573 >> 172.21.15.96:0/2873273573 conn(0x7f8aec0f0d40 msgr2=0x7f8aec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:09.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- 172.21.15.96:0/2873273573 shutdown_connections 2022-02-02T20:14:09.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- 172.21.15.96:0/2873273573 wait complete. 2022-02-02T20:14:09.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 Processor -- start 2022-02-02T20:14:09.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- start start 2022-02-02T20:14:09.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0603e0 con 0x7f8aec0f55c0 2022-02-02T20:14:09.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8af0d39700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec060520 con 0x7f8aec0f6860 2022-02-02T20:14:09.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.527+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:09.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35914/0 (socket says 172.21.15.96:35914) 2022-02-02T20:14:09.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 -- 172.21.15.96:0/2963262090 learned_addr learned my addr 172.21.15.96:0/2963262090 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:09.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8ae9d9b700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:09.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 -- 172.21.15.96:0/2963262090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 msgr2=0x7f8aec109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 -- 172.21.15.96:0/2963262090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc005040 con 0x7f8aec0f55c0 2022-02-02T20:14:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8ae9d9b700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:14:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8aea59c700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f8adc004f60 tx=0x7f8adc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8adc018070 con 0x7f8aec0f55c0 2022-02-02T20:14:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8adc007ba0 con 0x7f8aec0f55c0 2022-02-02T20:14:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8adc01c620 con 0x7f8aec0f55c0 2022-02-02T20:14:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec10a4b0 con 0x7f8aec0f55c0 2022-02-02T20:14:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.528+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec10aa10 con 0x7f8aec0f55c0 2022-02-02T20:14:09.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.529+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec0f49b0 con 0x7f8aec0f55c0 2022-02-02T20:14:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.530+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8adc01d420 con 0x7f8aec0f55c0 2022-02-02T20:14:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.531+0000 7f8adaffd700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 0x7f8ad4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.531+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8adc083e10 con 0x7f8aec0f55c0 2022-02-02T20:14:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.531+0000 7f8ae9d9b700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 0x7f8ad4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.531+0000 7f8ae9d9b700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 0x7f8ad4067290 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f8ae00041d0 tx=0x7f8ae0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:09.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.534+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8adc051ed0 con 0x7f8aec0f55c0 2022-02-02T20:14:09.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.715+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aec0ffc20 con 0x7f8ad4064dd0 2022-02-02T20:14:09.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.716+0000 7f8adaffd700 1 -- 172.21.15.96:0/2963262090 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8aec0ffc20 con 0x7f8ad4064dd0 2022-02-02T20:14:09.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 msgr2=0x7f8ad4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 0x7f8ad4067290 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f8ae00041d0 tx=0x7f8ae0009040).stop 2022-02-02T20:14:09.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 msgr2=0x7f8aec107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f8adc004f60 tx=0x7f8adc009b30).stop 2022-02-02T20:14:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 shutdown_connections 2022-02-02T20:14:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8ad4064dd0 0x7f8ad4067290 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f55c0 0x7f8aec107a60 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 --2- 172.21.15.96:0/2963262090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6860 0x7f8aec109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 >> 172.21.15.96:0/2963262090 conn(0x7f8aec0f0d40 msgr2=0x7f8aec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 shutdown_connections 2022-02-02T20:14:09.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.718+0000 7f8af0d39700 1 -- 172.21.15.96:0/2963262090 wait complete. 2022-02-02T20:14:09.730 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:14:09.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 -- 172.21.15.96:0/1770126140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 msgr2=0x7fadf80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 --2- 172.21.15.96:0/1770126140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf80f5850 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fade8004660 tx=0x7fade8009b30).stop 2022-02-02T20:14:09.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 -- 172.21.15.96:0/1770126140 shutdown_connections 2022-02-02T20:14:09.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 --2- 172.21.15.96:0/1770126140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf80f66d0 0x7fadf80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 --2- 172.21.15.96:0/1770126140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf80f5850 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:09.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 -- 172.21.15.96:0/1770126140 >> 172.21.15.96:0/1770126140 conn(0x7fadf80f0b90 msgr2=0x7fadf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 -- 172.21.15.96:0/1770126140 shutdown_connections 2022-02-02T20:14:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.815+0000 7fadfca9b700 1 -- 172.21.15.96:0/1770126140 wait complete. 2022-02-02T20:14:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.816+0000 7fadfca9b700 1 Processor -- start 2022-02-02T20:14:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.816+0000 7fadfca9b700 1 -- start start 2022-02-02T20:14:09.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.816+0000 7fadfca9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadfca9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf80f66d0 0x7fadf810bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadfca9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80603e0 con 0x7fadf80f5430 2022-02-02T20:14:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadfca9b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf8060520 con 0x7fadf80f66d0 2022-02-02T20:14:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35924/0 (socket says 172.21.15.96:35924) 2022-02-02T20:14:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 -- 172.21.15.96:0/3880328071 learned_addr learned my addr 172.21.15.96:0/3880328071 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 -- 172.21.15.96:0/3880328071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf80f66d0 msgr2=0x7fadf810bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf80f66d0 0x7fadf810bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:14:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 -- 172.21.15.96:0/3880328071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8005040 con 0x7fadf80f5430 2022-02-02T20:14:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadf77fe700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fade8013a70 tx=0x7fade8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade8018070 con 0x7fadf80f5430 2022-02-02T20:14:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fade80097d0 con 0x7fadf80f5430 2022-02-02T20:14:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf810c520 con 0x7fadf80f5430 2022-02-02T20:14:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade801c3c0 con 0x7fadf80f5430 2022-02-02T20:14:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.817+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf810ca80 con 0x7fadf80f5430 2022-02-02T20:14:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.818+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8045ad0 con 0x7fadf80f5430 2022-02-02T20:14:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.819+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fade8007ba0 con 0x7fadf80f5430 2022-02-02T20:14:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.819+0000 7faddffff700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 0x7fade00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.819+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fade8083740 con 0x7fadf80f5430 2022-02-02T20:14:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.819+0000 7fadf6ffd700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 0x7fade00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.820+0000 7fadf6ffd700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 0x7fade00672e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fadec004a10 tx=0x7fadec0099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:09.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.823+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fade8051900 con 0x7fadf80f5430 2022-02-02T20:14:09.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:09.995+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fadf80fdd80 con 0x7fade0064e20 2022-02-02T20:14:10.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.004+0000 7faddffff700 1 -- 172.21.15.96:0/3880328071 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fadf80fdd80 con 0x7fade0064e20 2022-02-02T20:14:10.007 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:14:10.007 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (117m) 88m ago 118m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:14:10.008 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (109m) 88m ago 118m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:14:10.008 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (109m) 86m ago 118m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:14:10.008 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (117m) 88m ago 118m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:14:10.008 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (114m) 88m ago 114m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:14:10.008 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (110m) 88m ago 114m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:14:10.009 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (114m) 86m ago 114m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:14:10.009 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (110m) 86m ago 114m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:14:10.009 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (111m) 88m ago 119m 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:14:10.010 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (111m) 86m ago 118m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:14:10.010 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (110m) 88m ago 119m 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:14:10.010 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (110m) 86m ago 117m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:14:10.010 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (118m) 88m ago 118m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:14:10.011 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (117m) 86m ago 117m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:14:10.011 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (109m) 88m ago 117m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:14:10.011 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (109m) 88m ago 117m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:14:10.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (108m) 88m ago 116m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:14:10.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (107m) 86m ago 116m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:14:10.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (107m) 86m ago 116m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:14:10.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (106m) 86m ago 115m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:14:10.013 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (117m) 88m ago 118m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:14:10.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 msgr2=0x7fade00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 0x7fade00672e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fadec004a10 tx=0x7fadec0099e0).stop 2022-02-02T20:14:10.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 msgr2=0x7fadf8109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fade8013a70 tx=0x7fade8009b30).stop 2022-02-02T20:14:10.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 shutdown_connections 2022-02-02T20:14:10.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fade0064e20 0x7fade00672e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf80f5430 0x7fadf8109ad0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 --2- 172.21.15.96:0/3880328071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf80f66d0 0x7fadf810bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:14:10.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 >> 172.21.15.96:0/3880328071 conn(0x7fadf80f0b90 msgr2=0x7fadf80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:10.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.006+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 shutdown_connections 2022-02-02T20:14:10.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.007+0000 7fadfca9b700 1 -- 172.21.15.96:0/3880328071 wait complete. 2022-02-02T20:14:10.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 -- 172.21.15.96:0/4001976740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 msgr2=0x7f717c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 --2- 172.21.15.96:0/4001976740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c0f59e0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f7170004660 tx=0x7f7170009b30).stop 2022-02-02T20:14:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 -- 172.21.15.96:0/4001976740 shutdown_connections 2022-02-02T20:14:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 --2- 172.21.15.96:0/4001976740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 --2- 172.21.15.96:0/4001976740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c0f59e0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 -- 172.21.15.96:0/4001976740 >> 172.21.15.96:0/4001976740 conn(0x7f717c0f0d40 msgr2=0x7f717c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 -- 172.21.15.96:0/4001976740 shutdown_connections 2022-02-02T20:14:10.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:09 smithi096 ceph-mon[101353]: pgmap v3362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.103+0000 7f71809b6700 1 -- 172.21.15.96:0/4001976740 wait complete. 2022-02-02T20:14:10.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 Processor -- start 2022-02-02T20:14:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 -- start start 2022-02-02T20:14:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0603c0 con 0x7f717c0f55c0 2022-02-02T20:14:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f71809b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c060500 con 0x7f717c0f6860 2022-02-02T20:14:10.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f7179d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f7179d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:40040/0 (socket says 172.21.15.96:40040) 2022-02-02T20:14:10.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f7179d9b700 1 -- 172.21.15.96:0/771499185 learned_addr learned my addr 172.21.15.96:0/771499185 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.104+0000 7f717a59c700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f7179d9b700 1 -- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 msgr2=0x7f717c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f7179d9b700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f7179d9b700 1 -- 172.21.15.96:0/771499185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170005040 con 0x7f717c0f6860 2022-02-02T20:14:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f7179d9b700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f716c00c530 tx=0x7f716c007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716c00f650 con 0x7f717c0f6860 2022-02-02T20:14:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c10c740 con 0x7f717c0f6860 2022-02-02T20:14:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f716c00fc60 con 0x7f717c0f6860 2022-02-02T20:14:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716c012cd0 con 0x7f717c0f6860 2022-02-02T20:14:10.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.105+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c10ccd0 con 0x7f717c0f6860 2022-02-02T20:14:10.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.106+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c0f49b0 con 0x7f717c0f6860 2022-02-02T20:14:10.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.106+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f716c010070 con 0x7f717c0f6860 2022-02-02T20:14:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.107+0000 7f716affd700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 0x7f7164067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.107+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f716c081780 con 0x7f717c0f6860 2022-02-02T20:14:10.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.107+0000 7f717a59c700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 0x7f7164067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.107+0000 7f717a59c700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 0x7f7164067290 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f7170004e30 tx=0x7f7170009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:10.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.111+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f716c04f880 con 0x7f717c0f6860 2022-02-02T20:14:10.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:09 smithi159 ceph-mon[69013]: pgmap v3362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:10.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.340+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f717c045ad0 con 0x7f717c0f6860 2022-02-02T20:14:10.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.341+0000 7f716affd700 1 -- 172.21.15.96:0/771499185 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f716c052ea0 con 0x7f717c0f6860 2022-02-02T20:14:10.343 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:14:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:14:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:14:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:14:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:14:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:14:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:14:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:14:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:14:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:14:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:14:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:14:10.347 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:14:10.347 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:14:10.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 msgr2=0x7f7164067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 0x7f7164067290 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f7170004e30 tx=0x7f7170009b30).stop 2022-02-02T20:14:10.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 msgr2=0x7f717c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f716c00c530 tx=0x7f716c007e20).stop 2022-02-02T20:14:10.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 shutdown_connections 2022-02-02T20:14:10.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.342+0000 7f71809b6700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7164064dd0 0x7f7164067290 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.343+0000 7f71809b6700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f717c0f55c0 0x7f717c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.343+0000 7f71809b6700 1 --2- 172.21.15.96:0/771499185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f717c0f6860 0x7f717c10c190 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.343+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 >> 172.21.15.96:0/771499185 conn(0x7f717c0f0d40 msgr2=0x7f717c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:10.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.343+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 shutdown_connections 2022-02-02T20:14:10.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.343+0000 7f71809b6700 1 -- 172.21.15.96:0/771499185 wait complete. 2022-02-02T20:14:10.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 -- 172.21.15.96:0/3163851882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 msgr2=0x7f51240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 --2- 172.21.15.96:0/3163851882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f51240f6b00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f5118004660 tx=0x7f5118009b30).stop 2022-02-02T20:14:10.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 -- 172.21.15.96:0/3163851882 shutdown_connections 2022-02-02T20:14:10.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 --2- 172.21.15.96:0/3163851882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 --2- 172.21.15.96:0/3163851882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f51240f6b00 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 -- 172.21.15.96:0/3163851882 >> 172.21.15.96:0/3163851882 conn(0x7f51240f1e40 msgr2=0x7f51240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:10.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 -- 172.21.15.96:0/3163851882 shutdown_connections 2022-02-02T20:14:10.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 -- 172.21.15.96:0/3163851882 wait complete. 2022-02-02T20:14:10.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.440+0000 7f512b0fa700 1 Processor -- start 2022-02-02T20:14:10.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f512b0fa700 1 -- start start 2022-02-02T20:14:10.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f512b0fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f512b0fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51241074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f512b0fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124107a50 con 0x7f51240f66e0 2022-02-02T20:14:10.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f512b0fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124107b90 con 0x7f51240f7980 2022-02-02T20:14:10.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35944/0 (socket says 172.21.15.96:35944) 2022-02-02T20:14:10.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 -- 172.21.15.96:0/353822856 learned_addr learned my addr 172.21.15.96:0/353822856 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:10.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5123fff700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51241074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 -- 172.21.15.96:0/353822856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 msgr2=0x7f51241074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51241074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5128e96700 1 -- 172.21.15.96:0/353822856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118005040 con 0x7f51240f66e0 2022-02-02T20:14:10.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.441+0000 7f5123fff700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51241074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:14:10.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f5128e96700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f5118004f60 tx=0x7f5118009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:10.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5118018070 con 0x7f51240f66e0 2022-02-02T20:14:10.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5118007ba0 con 0x7f51240f66e0 2022-02-02T20:14:10.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511801c620 con 0x7f51240f66e0 2022-02-02T20:14:10.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51241084d0 con 0x7f51240f66e0 2022-02-02T20:14:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.442+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5124108a30 con 0x7f51240f66e0 2022-02-02T20:14:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.443+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5124045ad0 con 0x7f51240f66e0 2022-02-02T20:14:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.443+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f511801c8e0 con 0x7f51240f66e0 2022-02-02T20:14:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.444+0000 7f51217fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:10.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.444+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5118083960 con 0x7f51240f66e0 2022-02-02T20:14:10.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.444+0000 7f5123fff700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:10.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.444+0000 7f5123fff700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f51100041d0 tx=0x7f5110009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:10.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.448+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5118055490 con 0x7f51240f66e0 2022-02-02T20:14:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.648+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f51240fefb0 con 0x7f51240f66e0 2022-02-02T20:14:10.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.649+0000 7f51217fa700 1 -- 172.21.15.96:0/353822856 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5118055080 con 0x7f51240f66e0 2022-02-02T20:14:10.651 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:14:10.652 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:14:10.652 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:14:10.652 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:14:10.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:10.652 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:14:10.653 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:14:10.653 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:14:10.653 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:14:10.653 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:14:10.654 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:14:10.654 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:14:10.654 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:14:10.654 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:14:10.655 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:14:10.655 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:14:10.655 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:14:10.655 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:14:10.656 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:14:10.656 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:14:10.656 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:14:10.656 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:14:10.657 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:14:10.657 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:14:10.657 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:14:10.657 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:14:10.658 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:14:10.658 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:14:10.658 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:14:10.659 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:14:10.659 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:14:10.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:14:10.660 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:10.660 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:10.660 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:14:10.660 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:10.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:10.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:10.661 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.650+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 msgr2=0x7f5114067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.650+0000 7f512b0fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f51100041d0 tx=0x7f5110009040).stop 2022-02-02T20:14:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.650+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 msgr2=0x7f5124106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.650+0000 7f512b0fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f5118004f60 tx=0x7f5118009b30).stop 2022-02-02T20:14:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 shutdown_connections 2022-02-02T20:14:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240f66e0 0x7f5124106fb0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 --2- 172.21.15.96:0/353822856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51240f7980 0x7f51241074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 >> 172.21.15.96:0/353822856 conn(0x7f51240f1e40 msgr2=0x7f51240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 shutdown_connections 2022-02-02T20:14:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:10.651+0000 7f512b0fa700 1 -- 172.21.15.96:0/353822856 wait complete. 2022-02-02T20:14:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:14:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:10 smithi159 ceph-mon[69013]: from='client.37558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:10 smithi159 ceph-mon[69013]: from='client.37562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/771499185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:14:11.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/353822856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:14:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:10 smithi096 ceph-mon[101353]: from='client.37558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:10 smithi096 ceph-mon[101353]: from='client.37562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/771499185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:14:11.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/353822856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:14:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:11 smithi159 ceph-mon[69013]: pgmap v3363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:11 smithi096 ceph-mon[101353]: pgmap v3363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:13 smithi159 ceph-mon[69013]: pgmap v3364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:13 smithi096 ceph-mon[101353]: pgmap v3364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:15 smithi159 ceph-mon[69013]: pgmap v3365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:15 smithi096 ceph-mon[101353]: pgmap v3365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:17.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:17 smithi096 ceph-mon[101353]: pgmap v3366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:17 smithi159 ceph-mon[69013]: pgmap v3366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:19 smithi159 ceph-mon[69013]: pgmap v3367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:19 smithi096 ceph-mon[101353]: pgmap v3367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:21 smithi159 ceph-mon[69013]: pgmap v3368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:22.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:21 smithi096 ceph-mon[101353]: pgmap v3368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:23 smithi159 ceph-mon[69013]: pgmap v3369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:23 smithi096 ceph-mon[101353]: pgmap v3369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:25 smithi159 ceph-mon[69013]: pgmap v3370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:26.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:25 smithi096 ceph-mon[101353]: pgmap v3370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:27 smithi096 ceph-mon[101353]: pgmap v3371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:27.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:14:27.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:14:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:27 smithi159 ceph-mon[69013]: pgmap v3371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:14:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:14:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:29 smithi159 ceph-mon[69013]: pgmap v3372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:29 smithi096 ceph-mon[101353]: pgmap v3372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:31 smithi159 ceph-mon[69013]: pgmap v3373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:31 smithi096 ceph-mon[101353]: pgmap v3373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:33 smithi159 ceph-mon[69013]: pgmap v3374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:33 smithi096 ceph-mon[101353]: pgmap v3374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:36.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:35 smithi159 ceph-mon[69013]: pgmap v3375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:36.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:35 smithi096 ceph-mon[101353]: pgmap v3375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:37.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:37 smithi096 ceph-mon[101353]: pgmap v3376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:37 smithi159 ceph-mon[69013]: pgmap v3376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:39 smithi159 ceph-mon[69013]: pgmap v3377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:39 smithi096 ceph-mon[101353]: pgmap v3377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:40.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 -- 172.21.15.96:0/3607786445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 msgr2=0x7f7af40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:40.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/3607786445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af40f59e0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f7ae8004660 tx=0x7f7ae8009b30).stop 2022-02-02T20:14:40.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 -- 172.21.15.96:0/3607786445 shutdown_connections 2022-02-02T20:14:40.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/3607786445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 0x7f7af40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/3607786445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af40f59e0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.760+0000 7f7afb0b2700 1 -- 172.21.15.96:0/3607786445 >> 172.21.15.96:0/3607786445 conn(0x7f7af40f0d40 msgr2=0x7f7af40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.761+0000 7f7afb0b2700 1 -- 172.21.15.96:0/3607786445 shutdown_connections 2022-02-02T20:14:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.761+0000 7f7afb0b2700 1 -- 172.21.15.96:0/3607786445 wait complete. 2022-02-02T20:14:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 Processor -- start 2022-02-02T20:14:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 -- start start 2022-02-02T20:14:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 0x7f7af410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40602b0 con 0x7f7af40f55c0 2022-02-02T20:14:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7afb0b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40603f0 con 0x7f7af40f6860 2022-02-02T20:14:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7af8e4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7af8e4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35962/0 (socket says 172.21.15.96:35962) 2022-02-02T20:14:40.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.762+0000 7f7af8e4e700 1 -- 172.21.15.96:0/2496830358 learned_addr learned my addr 172.21.15.96:0/2496830358 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:40.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af3fff700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 0x7f7af410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:40.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af8e4e700 1 -- 172.21.15.96:0/2496830358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 msgr2=0x7f7af410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:40.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af8e4e700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 0x7f7af410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af8e4e700 1 -- 172.21.15.96:0/2496830358 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8005040 con 0x7f7af40f55c0 2022-02-02T20:14:40.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af8e4e700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f7ae8004f60 tx=0x7f7ae8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:40.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8018070 con 0x7f7af40f55c0 2022-02-02T20:14:40.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ae8007ba0 con 0x7f7af40f55c0 2022-02-02T20:14:40.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af410ea80 con 0x7f7af40f55c0 2022-02-02T20:14:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae801c620 con 0x7f7af40f55c0 2022-02-02T20:14:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.763+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af410ee50 con 0x7f7af40f55c0 2022-02-02T20:14:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.764+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4045ad0 con 0x7f7af40f55c0 2022-02-02T20:14:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.765+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ae801c8e0 con 0x7f7af40f55c0 2022-02-02T20:14:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.766+0000 7f7af17fa700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 0x7f7ae4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.766+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ae8083e90 con 0x7f7af40f55c0 2022-02-02T20:14:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.766+0000 7f7af3fff700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 0x7f7ae4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.766+0000 7f7af3fff700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 0x7f7ae4067290 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f7ae00041d0 tx=0x7f7ae0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:40.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.769+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ae8051ed0 con 0x7f7af40f55c0 2022-02-02T20:14:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.947+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7af4057f10 con 0x7f7ae4064dd0 2022-02-02T20:14:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.948+0000 7f7af17fa700 1 -- 172.21.15.96:0/2496830358 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7af4057f10 con 0x7f7ae4064dd0 2022-02-02T20:14:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 msgr2=0x7f7ae4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 0x7f7ae4067290 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f7ae00041d0 tx=0x7f7ae0009040).stop 2022-02-02T20:14:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 msgr2=0x7f7af410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f7ae8004f60 tx=0x7f7ae8009b30).stop 2022-02-02T20:14:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 shutdown_connections 2022-02-02T20:14:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ae4064dd0 0x7f7ae4067290 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7af40f55c0 0x7f7af410c090 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 --2- 172.21.15.96:0/2496830358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40f6860 0x7f7af410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 >> 172.21.15.96:0/2496830358 conn(0x7f7af40f0d40 msgr2=0x7f7af40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:40.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 shutdown_connections 2022-02-02T20:14:40.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:40.950+0000 7f7afb0b2700 1 -- 172.21.15.96:0/2496830358 wait complete. 2022-02-02T20:14:40.962 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:14:41.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 -- 172.21.15.96:0/3809683452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 msgr2=0x7fc2000f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 --2- 172.21.15.96:0/3809683452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc2000f5850 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fc1f4004660 tx=0x7fc1f4009b30).stop 2022-02-02T20:14:41.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 -- 172.21.15.96:0/3809683452 shutdown_connections 2022-02-02T20:14:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 --2- 172.21.15.96:0/3809683452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 0x7fc2000f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 --2- 172.21.15.96:0/3809683452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc2000f5850 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 -- 172.21.15.96:0/3809683452 >> 172.21.15.96:0/3809683452 conn(0x7fc2000f0b90 msgr2=0x7fc2000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.048+0000 7fc205c54700 1 -- 172.21.15.96:0/3809683452 shutdown_connections 2022-02-02T20:14:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 -- 172.21.15.96:0/3809683452 wait complete. 2022-02-02T20:14:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 Processor -- start 2022-02-02T20:14:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 -- start start 2022-02-02T20:14:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 0x7fc20010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000603c0 con 0x7fc2000f5430 2022-02-02T20:14:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.049+0000 7fc205c54700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200060500 con 0x7fc2000f66d0 2022-02-02T20:14:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35972/0 (socket says 172.21.15.96:35972) 2022-02-02T20:14:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 -- 172.21.15.96:0/2501182423 learned_addr learned my addr 172.21.15.96:0/2501182423 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc1fffff700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 0x7fc20010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 -- 172.21.15.96:0/2501182423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 msgr2=0x7fc20010bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 0x7fc20010bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 -- 172.21.15.96:0/2501182423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4005040 con 0x7fc2000f5430 2022-02-02T20:14:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc204c52700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fc1f4013a70 tx=0x7fc1f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f4018070 con 0x7fc2000f5430 2022-02-02T20:14:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20010c500 con 0x7fc2000f5430 2022-02-02T20:14:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1f40097d0 con 0x7fc2000f5430 2022-02-02T20:14:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f401c3c0 con 0x7fc2000f5430 2022-02-02T20:14:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.050+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20010ca30 con 0x7fc2000f5430 2022-02-02T20:14:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.051+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc200045ad0 con 0x7fc2000f5430 2022-02-02T20:14:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.052+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1f4007ba0 con 0x7fc2000f5430 2022-02-02T20:14:41.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.052+0000 7fc1fd7fa700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 0x7fc1f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.052+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1f4083720 con 0x7fc2000f5430 2022-02-02T20:14:41.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.052+0000 7fc1fffff700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 0x7fc1f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.053+0000 7fc1fffff700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 0x7fc1f00672e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fc1ec0096c0 tx=0x7fc1ec009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.056+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1f4051820 con 0x7fc2000f5430 2022-02-02T20:14:41.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.230+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc200057f10 con 0x7fc1f0064e20 2022-02-02T20:14:41.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.239+0000 7fc1fd7fa700 1 -- 172.21.15.96:0/2501182423 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fc200057f10 con 0x7fc1f0064e20 2022-02-02T20:14:41.242 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:14:41.242 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (118m) 88m ago 119m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:14:41.243 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (110m) 88m ago 119m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:14:41.243 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (110m) 87m ago 118m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:14:41.244 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (117m) 88m ago 118m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:14:41.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (115m) 88m ago 115m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:14:41.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (110m) 88m ago 115m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:14:41.244 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (115m) 87m ago 115m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:14:41.245 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (111m) 87m ago 115m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:14:41.245 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (112m) 88m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:14:41.245 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (111m) 87m ago 118m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:14:41.245 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (111m) 88m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:14:41.246 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (111m) 87m ago 118m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:14:41.246 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (118m) 88m ago 118m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:14:41.246 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (118m) 87m ago 118m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:14:41.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (110m) 88m ago 117m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:14:41.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (109m) 88m ago 117m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:14:41.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (109m) 88m ago 117m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:14:41.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (108m) 87m ago 117m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:14:41.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (107m) 87m ago 116m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:14:41.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (107m) 87m ago 116m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:14:41.248 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (117m) 88m ago 118m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:14:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 msgr2=0x7fc1f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 0x7fc1f00672e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fc1ec0096c0 tx=0x7fc1ec009be0).stop 2022-02-02T20:14:41.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 msgr2=0x7fc200109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fc1f4013a70 tx=0x7fc1f4009b30).stop 2022-02-02T20:14:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 shutdown_connections 2022-02-02T20:14:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1f0064e20 0x7fc1f00672e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2000f5430 0x7fc200109ab0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 --2- 172.21.15.96:0/2501182423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000f66d0 0x7fc20010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 >> 172.21.15.96:0/2501182423 conn(0x7fc2000f0b90 msgr2=0x7fc2000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 shutdown_connections 2022-02-02T20:14:41.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.241+0000 7fc205c54700 1 -- 172.21.15.96:0/2501182423 wait complete. 2022-02-02T20:14:41.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 -- 172.21.15.96:0/1777412494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 msgr2=0x7fe3140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1777412494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe3140f6cc0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7fe310004660 tx=0x7fe310009b30).stop 2022-02-02T20:14:41.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 -- 172.21.15.96:0/1777412494 shutdown_connections 2022-02-02T20:14:41.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1777412494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe3140f6cc0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1777412494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 0x7fe3140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 -- 172.21.15.96:0/1777412494 >> 172.21.15.96:0/1777412494 conn(0x7fe3140f0d40 msgr2=0x7fe3140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 -- 172.21.15.96:0/1777412494 shutdown_connections 2022-02-02T20:14:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.339+0000 7fe31bedf700 1 -- 172.21.15.96:0/1777412494 wait complete. 2022-02-02T20:14:41.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 Processor -- start 2022-02-02T20:14:41.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 -- start start 2022-02-02T20:14:41.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 0x7fe31410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140602b0 con 0x7fe3140f6860 2022-02-02T20:14:41.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31bedf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140603f0 con 0x7fe3140f55c0 2022-02-02T20:14:41.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31947a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31947a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35984/0 (socket says 172.21.15.96:35984) 2022-02-02T20:14:41.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31947a700 1 -- 172.21.15.96:0/1864590758 learned_addr learned my addr 172.21.15.96:0/1864590758 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:41.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe319c7b700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 0x7fe31410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31947a700 1 -- 172.21.15.96:0/1864590758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 msgr2=0x7fe31410c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.340+0000 7fe31947a700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 0x7fe31410c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe31947a700 1 -- 172.21.15.96:0/1864590758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310005040 con 0x7fe3140f6860 2022-02-02T20:14:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe31947a700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fe310009990 tx=0x7fe310009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe310018070 con 0x7fe3140f6860 2022-02-02T20:14:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe310007ca0 con 0x7fe3140f6860 2022-02-02T20:14:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31410ea60 con 0x7fe3140f6860 2022-02-02T20:14:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31001c620 con 0x7fe3140f6860 2022-02-02T20:14:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.341+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31410ee30 con 0x7fe3140f6860 2022-02-02T20:14:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.342+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe314045ad0 con 0x7fe3140f6860 2022-02-02T20:14:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.342+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe31001d960 con 0x7fe3140f6860 2022-02-02T20:14:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.343+0000 7fe30a7fc700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 0x7fe300067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.343+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe310083710 con 0x7fe3140f6860 2022-02-02T20:14:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.343+0000 7fe319c7b700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 0x7fe300067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.343+0000 7fe319c7b700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 0x7fe300067290 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fe314060040 tx=0x7fe304009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.350+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe3100518d0 con 0x7fe3140f6860 2022-02-02T20:14:41.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.577+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe314027a00 con 0x7fe3140f6860 2022-02-02T20:14:41.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.578+0000 7fe30a7fc700 1 -- 172.21.15.96:0/1864590758 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe310054ef0 con 0x7fe3140f6860 2022-02-02T20:14:41.580 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:14:41.581 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:14:41.581 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:14:41.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:41.582 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:14:41.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:14:41.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:41.582 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:14:41.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:14:41.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:41.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:14:41.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:14:41.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:14:41.584 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:14:41.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:14:41.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:14:41.585 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:14:41.585 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:14:41.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 msgr2=0x7fe300067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 0x7fe300067290 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fe314060040 tx=0x7fe304009040).stop 2022-02-02T20:14:41.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 msgr2=0x7fe31410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fe310009990 tx=0x7fe310009b30).stop 2022-02-02T20:14:41.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 shutdown_connections 2022-02-02T20:14:41.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe300064dd0 0x7fe300067290 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3140f55c0 0x7fe31410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 --2- 172.21.15.96:0/1864590758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3140f6860 0x7fe31410e570 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 >> 172.21.15.96:0/1864590758 conn(0x7fe3140f0d40 msgr2=0x7fe3140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 shutdown_connections 2022-02-02T20:14:41.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.580+0000 7fe31bedf700 1 -- 172.21.15.96:0/1864590758 wait complete. 2022-02-02T20:14:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 -- 172.21.15.96:0/3169396206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 msgr2=0x7f30c00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 --2- 172.21.15.96:0/3169396206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c00f6b30 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f30b4004660 tx=0x7f30b4009b30).stop 2022-02-02T20:14:41.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 -- 172.21.15.96:0/3169396206 shutdown_connections 2022-02-02T20:14:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 --2- 172.21.15.96:0/3169396206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c00f6b30 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 --2- 172.21.15.96:0/3169396206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.677+0000 7f30bffff700 1 -- 172.21.15.96:0/3169396206 >> 172.21.15.96:0/3169396206 conn(0x7f30c00f0b90 msgr2=0x7f30c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.678+0000 7f30bffff700 1 -- 172.21.15.96:0/3169396206 shutdown_connections 2022-02-02T20:14:41.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.678+0000 7f30bffff700 1 -- 172.21.15.96:0/3169396206 wait complete. 2022-02-02T20:14:41.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.678+0000 7f30bffff700 1 Processor -- start 2022-02-02T20:14:41.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.678+0000 7f30bffff700 1 -- start start 2022-02-02T20:14:41.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30bffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30bffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c010be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30bffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0060420 con 0x7f30c00f66d0 2022-02-02T20:14:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30bffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0060560 con 0x7f30c00f5430 2022-02-02T20:14:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:40096/0 (socket says 172.21.15.96:40096) 2022-02-02T20:14:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 -- 172.21.15.96:0/186159690 learned_addr learned my addr 172.21.15.96:0/186159690 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:14:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30be7fc700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c010be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 -- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 msgr2=0x7f30c010be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c010be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 -- 172.21.15.96:0/186159690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4005040 con 0x7f30c00f5430 2022-02-02T20:14:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30be7fc700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:14:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.679+0000 7f30beffd700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f30b000e7c0 tx=0x7f30b000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.680+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30b00092e0 con 0x7f30c00f5430 2022-02-02T20:14:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.680+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c010c4a0 con 0x7f30c00f5430 2022-02-02T20:14:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.680+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30b000f040 con 0x7f30c00f5430 2022-02-02T20:14:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.680+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30b00147e0 con 0x7f30c00f5430 2022-02-02T20:14:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.680+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c010ca30 con 0x7f30c00f5430 2022-02-02T20:14:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.681+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c0059100 con 0x7f30c00f5430 2022-02-02T20:14:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.681+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f30b001b030 con 0x7f30c00f5430 2022-02-02T20:14:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.681+0000 7f30a77fe700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 0x7f30a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:14:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.682+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f30b00819b0 con 0x7f30c00f5430 2022-02-02T20:14:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.682+0000 7f30be7fc700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 0x7f30a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:14:41.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.682+0000 7f30be7fc700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 0x7f30a80672e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f30b4005010 tx=0x7f30b4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:14:41.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.686+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f30b004fab0 con 0x7f30c00f5430 2022-02-02T20:14:41.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.886+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f30c00fdd80 con 0x7f30c00f5430 2022-02-02T20:14:41.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.886+0000 7f30a77fe700 1 -- 172.21.15.96:0/186159690 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f30b0019720 con 0x7f30c00f5430 2022-02-02T20:14:41.889 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:14:41.889 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:14:41.890 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:14:41.890 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:14:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:41.891 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:14:41.891 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:14:41.891 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:14:41.891 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:14:41.892 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:14:41.892 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:14:41.892 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:14:41.893 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:14:41.893 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:14:41.893 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:14:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:14:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:14:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:14:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:14:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:14:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:14:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:14:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:14:41.896 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:14:41.896 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:14:41.896 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:14:41.897 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:14:41.897 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:14:41.897 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:14:41.897 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:14:41.898 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:14:41.898 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:14:41.898 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:41.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:41.899 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:14:41.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:14:41.899 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:41.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:41.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:14:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.888+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 msgr2=0x7f30a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.888+0000 7f30bffff700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 0x7f30a80672e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f30b4005010 tx=0x7f30b4016040).stop 2022-02-02T20:14:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.888+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 msgr2=0x7f30c0109990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:14:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.888+0000 7f30bffff700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f30b000e7c0 tx=0x7f30b000b040).stop 2022-02-02T20:14:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 shutdown_connections 2022-02-02T20:14:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30a8064e20 0x7f30a80672e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30c00f5430 0x7f30c0109990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 --2- 172.21.15.96:0/186159690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30c00f66d0 0x7f30c010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:14:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 >> 172.21.15.96:0/186159690 conn(0x7f30c00f0b90 msgr2=0x7f30c00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:14:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 shutdown_connections 2022-02-02T20:14:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:14:41.889+0000 7f30bffff700 1 -- 172.21.15.96:0/186159690 wait complete. 2022-02-02T20:14:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:14:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:41 smithi159 ceph-mon[69013]: pgmap v3378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:41 smithi159 ceph-mon[69013]: from='client.37574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:41 smithi159 ceph-mon[69013]: from='client.37578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:42.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1864590758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:14:42.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/186159690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:14:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:41 smithi096 ceph-mon[101353]: pgmap v3378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:41 smithi096 ceph-mon[101353]: from='client.37574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:41 smithi096 ceph-mon[101353]: from='client.37578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:14:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1864590758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:14:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/186159690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:14:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:43 smithi159 ceph-mon[69013]: pgmap v3379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:43 smithi096 ceph-mon[101353]: pgmap v3379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:45 smithi159 ceph-mon[69013]: pgmap v3380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:46.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:45 smithi096 ceph-mon[101353]: pgmap v3380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:47.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:47 smithi096 ceph-mon[101353]: pgmap v3381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:47 smithi159 ceph-mon[69013]: pgmap v3381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:49 smithi159 ceph-mon[69013]: pgmap v3382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:50.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:49 smithi096 ceph-mon[101353]: pgmap v3382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:51 smithi159 ceph-mon[69013]: pgmap v3383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:51 smithi096 ceph-mon[101353]: pgmap v3383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:53 smithi159 ceph-mon[69013]: pgmap v3384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:53 smithi096 ceph-mon[101353]: pgmap v3384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:55 smithi159 ceph-mon[69013]: pgmap v3385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:55 smithi096 ceph-mon[101353]: pgmap v3385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:57.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:57 smithi096 ceph-mon[101353]: pgmap v3386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:14:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:57 smithi159 ceph-mon[69013]: pgmap v3386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:14:59 smithi159 ceph-mon[69013]: pgmap v3387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:14:59 smithi096 ceph-mon[101353]: pgmap v3387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:02.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:01 smithi159 ceph-mon[69013]: pgmap v3388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:01 smithi096 ceph-mon[101353]: pgmap v3388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:03 smithi159 ceph-mon[69013]: pgmap v3389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:03 smithi096 ceph-mon[101353]: pgmap v3389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:05 smithi159 ceph-mon[69013]: pgmap v3390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:05 smithi096 ceph-mon[101353]: pgmap v3390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:07 smithi159 ceph-mon[69013]: pgmap v3391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:08.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:07 smithi096 ceph-mon[101353]: pgmap v3391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:10.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:09 smithi159 ceph-mon[69013]: pgmap v3392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:09 smithi096 ceph-mon[101353]: pgmap v3392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:12.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 -- 172.21.15.96:0/3903728089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f6c60 msgr2=0x7f0a8c0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 --2- 172.21.15.96:0/3903728089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c0f7080 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f0a80004660 tx=0x7f0a80009b30).stop 2022-02-02T20:15:12.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 -- 172.21.15.96:0/3903728089 shutdown_connections 2022-02-02T20:15:12.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 --2- 172.21.15.96:0/3903728089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 --2- 172.21.15.96:0/3903728089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c0f7080 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 -- 172.21.15.96:0/3903728089 >> 172.21.15.96:0/3903728089 conn(0x7f0a8c0f04c0 msgr2=0x7f0a8c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 -- 172.21.15.96:0/3903728089 shutdown_connections 2022-02-02T20:15:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.998+0000 7f0a91645700 1 -- 172.21.15.96:0/3903728089 wait complete. 2022-02-02T20:15:12.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.999+0000 7f0a91645700 1 Processor -- start 2022-02-02T20:15:12.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:11.999+0000 7f0a91645700 1 -- start start 2022-02-02T20:15:12.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a91645700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a91645700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a91645700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1079b0 con 0x7f0a8c0f5970 2022-02-02T20:15:12.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a91645700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c107af0 con 0x7f0a8c0f6c60 2022-02-02T20:15:12.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36010/0 (socket says 172.21.15.96:36010) 2022-02-02T20:15:12.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 -- 172.21.15.96:0/3359815214 learned_addr learned my addr 172.21.15.96:0/3359815214 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:12.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8a7fc700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 -- 172.21.15.96:0/3359815214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f6c60 msgr2=0x7f0a8c107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 -- 172.21.15.96:0/3359815214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80005040 con 0x7f0a8c0f5970 2022-02-02T20:15:12.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.000+0000 7f0a8affd700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f0a80009990 tx=0x7f0a80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.001+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a80018070 con 0x7f0a8c0f5970 2022-02-02T20:15:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.001+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a80007ba0 con 0x7f0a8c0f5970 2022-02-02T20:15:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.001+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c108430 con 0x7f0a8c0f5970 2022-02-02T20:15:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.001+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a8001c3c0 con 0x7f0a8c0f5970 2022-02-02T20:15:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.001+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c108990 con 0x7f0a8c0f5970 2022-02-02T20:15:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.002+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a8001d420 con 0x7f0a8c0f5970 2022-02-02T20:15:12.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.002+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c045ad0 con 0x7f0a8c0f5970 2022-02-02T20:15:12.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.002+0000 7f0a737fe700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.003+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a80083740 con 0x7f0a8c0f5970 2022-02-02T20:15:12.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.003+0000 7f0a8a7fc700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.003+0000 7f0a8a7fc700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0a7c0096c0 tx=0x7f0a7c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.007+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a800552d0 con 0x7f0a8c0f5970 2022-02-02T20:15:12.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.186+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a8c0ff0c0 con 0x7f0a74064dd0 2022-02-02T20:15:12.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.187+0000 7f0a737fe700 1 -- 172.21.15.96:0/3359815214 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a8c0ff0c0 con 0x7f0a74064dd0 2022-02-02T20:15:12.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.188+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 msgr2=0x7f0a74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.188+0000 7f0a91645700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0a7c0096c0 tx=0x7f0a7c009be0).stop 2022-02-02T20:15:12.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.188+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 msgr2=0x7f0a8c106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.188+0000 7f0a91645700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f0a80009990 tx=0x7f0a80009b30).stop 2022-02-02T20:15:12.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 shutdown_connections 2022-02-02T20:15:12.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a8c0f5970 0x7f0a8c106f10 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 --2- 172.21.15.96:0/3359815214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a8c0f6c60 0x7f0a8c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 >> 172.21.15.96:0/3359815214 conn(0x7f0a8c0f04c0 msgr2=0x7f0a8c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 shutdown_connections 2022-02-02T20:15:12.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.189+0000 7f0a91645700 1 -- 172.21.15.96:0/3359815214 wait complete. 2022-02-02T20:15:12.201 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:15:12.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:11 smithi159 ceph-mon[69013]: pgmap v3393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:12.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 -- 172.21.15.96:0/943745312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 msgr2=0x7f201c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 --2- 172.21.15.96:0/943745312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c0f7c30 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f2010004660 tx=0x7f2010009b30).stop 2022-02-02T20:15:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 -- 172.21.15.96:0/943745312 shutdown_connections 2022-02-02T20:15:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 --2- 172.21.15.96:0/943745312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c0f7c30 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 --2- 172.21.15.96:0/943745312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 0x7f201c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.286+0000 7f202153f700 1 -- 172.21.15.96:0/943745312 >> 172.21.15.96:0/943745312 conn(0x7f201c0f1c90 msgr2=0x7f201c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:11 smithi096 ceph-mon[101353]: pgmap v3393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:12.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.287+0000 7f202153f700 1 -- 172.21.15.96:0/943745312 shutdown_connections 2022-02-02T20:15:12.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 -- 172.21.15.96:0/943745312 wait complete. 2022-02-02T20:15:12.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 Processor -- start 2022-02-02T20:15:12.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 -- start start 2022-02-02T20:15:12.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 0x7f201c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c107880 con 0x7f201c0f77d0 2022-02-02T20:15:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.288+0000 7f202153f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c108090 con 0x7f201c0f6530 2022-02-02T20:15:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36022/0 (socket says 172.21.15.96:36022) 2022-02-02T20:15:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 -- 172.21.15.96:0/3743846239 learned_addr learned my addr 172.21.15.96:0/3743846239 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201bfff700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 0x7f201c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 -- 172.21.15.96:0/3743846239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 msgr2=0x7f201c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 0x7f201c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 -- 172.21.15.96:0/3743846239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010005040 con 0x7f201c0f77d0 2022-02-02T20:15:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f201b7fe700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f2010009990 tx=0x7f2010009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2010018070 con 0x7f201c0f77d0 2022-02-02T20:15:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c1082b0 con 0x7f201c0f77d0 2022-02-02T20:15:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2010007ca0 con 0x7f201c0f77d0 2022-02-02T20:15:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f201001c620 con 0x7f201c0f77d0 2022-02-02T20:15:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.289+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c108810 con 0x7f201c0f77d0 2022-02-02T20:15:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.290+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c059100 con 0x7f201c0f77d0 2022-02-02T20:15:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.291+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f201001d960 con 0x7f201c0f77d0 2022-02-02T20:15:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.291+0000 7f2018ff9700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 0x7f20040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.291+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2010083700 con 0x7f201c0f77d0 2022-02-02T20:15:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.291+0000 7f201bfff700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 0x7f20040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.292+0000 7f201bfff700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 0x7f20040672e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f201c106b00 tx=0x7f200c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.295+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2010051800 con 0x7f201c0f77d0 2022-02-02T20:15:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.470+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f201c0008d0 con 0x7f2004064e20 2022-02-02T20:15:12.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.479+0000 7f2018ff9700 1 -- 172.21.15.96:0/3743846239 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f201c0008d0 con 0x7f2004064e20 2022-02-02T20:15:12.485 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:15:12.486 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (118m) 89m ago 119m 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:15:12.486 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (111m) 89m ago 119m 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:15:12.486 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (110m) 87m ago 119m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:15:12.486 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (118m) 89m ago 119m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:15:12.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (115m) 89m ago 115m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:15:12.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (111m) 89m ago 115m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:15:12.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (115m) 87m ago 115m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:15:12.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (111m) 87m ago 115m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:15:12.487 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (112m) 89m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:15:12.488 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (112m) 87m ago 119m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:15:12.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (111m) 89m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:15:12.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (111m) 87m ago 119m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:15:12.489 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (119m) 89m ago 119m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:15:12.489 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (118m) 87m ago 118m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:15:12.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (110m) 89m ago 118m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:15:12.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (110m) 89m ago 118m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:15:12.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (109m) 89m ago 117m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:15:12.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (108m) 87m ago 117m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:15:12.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (108m) 87m ago 117m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:15:12.491 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (107m) 87m ago 116m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:15:12.492 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (118m) 89m ago 119m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:15:12.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 msgr2=0x7f20040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 0x7f20040672e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f201c106b00 tx=0x7f200c009040).stop 2022-02-02T20:15:12.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 msgr2=0x7f201c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f2010009990 tx=0x7f2010009b30).stop 2022-02-02T20:15:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 shutdown_connections 2022-02-02T20:15:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2004064e20 0x7f20040672e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f201c0f6530 0x7f201c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 --2- 172.21.15.96:0/3743846239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c0f77d0 0x7f201c107280 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 >> 172.21.15.96:0/3743846239 conn(0x7f201c0f1c90 msgr2=0x7f201c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 shutdown_connections 2022-02-02T20:15:12.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.481+0000 7f202153f700 1 -- 172.21.15.96:0/3743846239 wait complete. 2022-02-02T20:15:12.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 -- 172.21.15.96:0/3180844524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 msgr2=0x7fdd400f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/3180844524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd400f5850 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7fdd34004660 tx=0x7fdd34009b30).stop 2022-02-02T20:15:12.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 -- 172.21.15.96:0/3180844524 shutdown_connections 2022-02-02T20:15:12.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/3180844524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd400f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/3180844524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd400f5850 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 -- 172.21.15.96:0/3180844524 >> 172.21.15.96:0/3180844524 conn(0x7fdd400f0b90 msgr2=0x7fdd400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 -- 172.21.15.96:0/3180844524 shutdown_connections 2022-02-02T20:15:12.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.578+0000 7fdd45cd8700 1 -- 172.21.15.96:0/3180844524 wait complete. 2022-02-02T20:15:12.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 Processor -- start 2022-02-02T20:15:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 -- start start 2022-02-02T20:15:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd4010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400603c0 con 0x7fdd400f5430 2022-02-02T20:15:12.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd45cd8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40060500 con 0x7fdd400f66d0 2022-02-02T20:15:12.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36030/0 (socket says 172.21.15.96:36030) 2022-02-02T20:15:12.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 -- 172.21.15.96:0/2499371530 learned_addr learned my addr 172.21.15.96:0/2499371530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:12.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd3ffff700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd4010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 -- 172.21.15.96:0/2499371530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 msgr2=0x7fdd4010bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd4010bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd44cd6700 1 -- 172.21.15.96:0/2499371530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34005040 con 0x7fdd400f5430 2022-02-02T20:15:12.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.579+0000 7fdd3ffff700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd4010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:15:12.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd44cd6700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7fdd34013a70 tx=0x7fdd34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd34018070 con 0x7fdd400f5430 2022-02-02T20:15:12.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd340097d0 con 0x7fdd400f5430 2022-02-02T20:15:12.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4010c500 con 0x7fdd400f5430 2022-02-02T20:15:12.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3401c3c0 con 0x7fdd400f5430 2022-02-02T20:15:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.580+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4010ca30 con 0x7fdd400f5430 2022-02-02T20:15:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.581+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40059100 con 0x7fdd400f5430 2022-02-02T20:15:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.581+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdd34007ba0 con 0x7fdd400f5430 2022-02-02T20:15:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.581+0000 7fdd3d7fa700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 0x7fdd300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.582+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdd340836d0 con 0x7fdd400f5430 2022-02-02T20:15:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.582+0000 7fdd3ffff700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 0x7fdd300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.582+0000 7fdd3ffff700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 0x7fdd300672e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fdd2c009740 tx=0x7fdd2c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.586+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdd34051890 con 0x7fdd400f5430 2022-02-02T20:15:12.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.814+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd400fdd00 con 0x7fdd400f5430 2022-02-02T20:15:12.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.815+0000 7fdd3d7fa700 1 -- 172.21.15.96:0/2499371530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdd34054eb0 con 0x7fdd400f5430 2022-02-02T20:15:12.819 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:15:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:15:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:15:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:15:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:15:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:15:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:15:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:15:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:15:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:15:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:15:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:15:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:15:12.823 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:15:12.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 msgr2=0x7fdd300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 0x7fdd300672e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fdd2c009740 tx=0x7fdd2c009be0).stop 2022-02-02T20:15:12.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 msgr2=0x7fdd40109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7fdd34013a70 tx=0x7fdd34009b30).stop 2022-02-02T20:15:12.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 shutdown_connections 2022-02-02T20:15:12.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd30064e20 0x7fdd300672e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd400f5430 0x7fdd40109ab0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 --2- 172.21.15.96:0/2499371530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd400f66d0 0x7fdd4010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 >> 172.21.15.96:0/2499371530 conn(0x7fdd400f0b90 msgr2=0x7fdd400fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 shutdown_connections 2022-02-02T20:15:12.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.817+0000 7fdd45cd8700 1 -- 172.21.15.96:0/2499371530 wait complete. 2022-02-02T20:15:12.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 -- 172.21.15.96:0/2635033234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b100f96a0 msgr2=0x7f2b100fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 --2- 172.21.15.96:0/2635033234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b100f96a0 0x7f2b100fbaf0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f2b00004660 tx=0x7f2b00009b30).stop 2022-02-02T20:15:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 -- 172.21.15.96:0/2635033234 shutdown_connections 2022-02-02T20:15:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 --2- 172.21.15.96:0/2635033234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b100f96a0 0x7f2b100fbaf0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 --2- 172.21.15.96:0/2635033234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b10060270 0x7f2b100f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 -- 172.21.15.96:0/2635033234 >> 172.21.15.96:0/2635033234 conn(0x7f2b100f0b90 msgr2=0x7f2b100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 -- 172.21.15.96:0/2635033234 shutdown_connections 2022-02-02T20:15:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.914+0000 7f2b1662c700 1 -- 172.21.15.96:0/2635033234 wait complete. 2022-02-02T20:15:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 Processor -- start 2022-02-02T20:15:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 -- start start 2022-02-02T20:15:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 0x7f2b100f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100f5610 con 0x7f2b10060270 2022-02-02T20:15:12.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1662c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100f5750 con 0x7f2b100f96a0 2022-02-02T20:15:12.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36040/0 (socket says 172.21.15.96:36040) 2022-02-02T20:15:12.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 -- 172.21.15.96:0/462003545 learned_addr learned my addr 172.21.15.96:0/462003545 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:12.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b14e29700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 0x7f2b100f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 -- 172.21.15.96:0/462003545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 msgr2=0x7f2b100f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:12.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 0x7f2b100f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:12.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b1562a700 1 -- 172.21.15.96:0/462003545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00005040 con 0x7f2b10060270 2022-02-02T20:15:12.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.915+0000 7f2b14e29700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 0x7f2b100f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:15:12.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b1562a700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f2b0c00c530 tx=0x7f2b0c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c00f650 con 0x7f2b10060270 2022-02-02T20:15:12.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100f5a30 con 0x7f2b10060270 2022-02-02T20:15:12.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b0c00fc60 con 0x7f2b10060270 2022-02-02T20:15:12.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c012cd0 con 0x7f2b10060270 2022-02-02T20:15:12.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.916+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1010ed70 con 0x7f2b10060270 2022-02-02T20:15:12.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.917+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b0c010070 con 0x7f2b10060270 2022-02-02T20:15:12.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.917+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b10045ad0 con 0x7f2b10060270 2022-02-02T20:15:12.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.918+0000 7f2b05ffb700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 0x7f2afc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:12.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.918+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2b0c081830 con 0x7f2b10060270 2022-02-02T20:15:12.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.918+0000 7f2b14e29700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 0x7f2afc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:12.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.918+0000 7f2b14e29700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 0x7f2afc0672e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f2b00004e30 tx=0x7f2b00009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:12.922+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b0c04f8b0 con 0x7f2b10060270 2022-02-02T20:15:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.124+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b10027a00 con 0x7f2b10060270 2022-02-02T20:15:13.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.125+0000 7f2b05ffb700 1 -- 172.21.15.96:0/462003545 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2b0c052ed0 con 0x7f2b10060270 2022-02-02T20:15:13.128 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:15:13.128 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:15:13.129 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:15:13.129 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:15:13.129 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:13.129 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:15:13.130 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:15:13.130 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:15:13.130 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:15:13.130 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:15:13.130 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:15:13.131 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:15:13.131 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:15:13.131 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:15:13.131 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:15:13.132 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:15:13.132 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:15:13.132 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:15:13.132 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:15:13.132 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:15:13.133 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:15:13.133 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:15:13.133 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:15:13.134 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:15:13.135 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:15:13.135 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:15:13.135 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:15:13.135 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:15:13.136 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:15:13.136 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:15:13.136 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:15:13.136 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:15:13.136 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:13.137 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:13.137 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:15:13.137 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:13.138 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:13.138 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:13.139 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 msgr2=0x7f2afc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:13.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 0x7f2afc0672e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f2b00004e30 tx=0x7f2b00009b30).stop 2022-02-02T20:15:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 msgr2=0x7f2b100f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:13.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f2b0c00c530 tx=0x7f2b0c007e20).stop 2022-02-02T20:15:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 shutdown_connections 2022-02-02T20:15:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.126+0000 7f2b1662c700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2afc064e20 0x7f2afc0672e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.127+0000 7f2b1662c700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10060270 0x7f2b100f6c30 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.127+0000 7f2b1662c700 1 --2- 172.21.15.96:0/462003545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b100f96a0 0x7f2b100f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:13.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.127+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 >> 172.21.15.96:0/462003545 conn(0x7f2b100f0b90 msgr2=0x7f2b100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.127+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 shutdown_connections 2022-02-02T20:15:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:13.127+0000 7f2b1662c700 1 -- 172.21.15.96:0/462003545 wait complete. 2022-02-02T20:15:13.146 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:15:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:12 smithi096 ceph-mon[101353]: from='client.37590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:13.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:12 smithi096 ceph-mon[101353]: from='client.37594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:13.240 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2499371530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:15:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:12 smithi159 ceph-mon[69013]: from='client.37590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:12 smithi159 ceph-mon[69013]: from='client.37594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2499371530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:15:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:13 smithi159 ceph-mon[69013]: pgmap v3394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/462003545' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:15:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:13 smithi096 ceph-mon[101353]: pgmap v3394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:14.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/462003545' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:15:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:15 smithi159 ceph-mon[69013]: pgmap v3395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:15 smithi096 ceph-mon[101353]: pgmap v3395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:17 smithi159 ceph-mon[69013]: pgmap v3396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:17 smithi096 ceph-mon[101353]: pgmap v3396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:20.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:19 smithi159 ceph-mon[69013]: pgmap v3397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:19 smithi096 ceph-mon[101353]: pgmap v3397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:21 smithi159 ceph-mon[69013]: pgmap v3398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:22.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:21 smithi096 ceph-mon[101353]: pgmap v3398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:23 smithi159 ceph-mon[69013]: pgmap v3399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:24.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:23 smithi096 ceph-mon[101353]: pgmap v3399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:26.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:25 smithi159 ceph-mon[69013]: pgmap v3400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:26.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:25 smithi096 ceph-mon[101353]: pgmap v3400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:27 smithi159 ceph-mon[69013]: pgmap v3401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:15:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:15:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:27 smithi096 ceph-mon[101353]: pgmap v3401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:15:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:15:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:29 smithi159 ceph-mon[69013]: pgmap v3402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:30.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:29 smithi096 ceph-mon[101353]: pgmap v3402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:31 smithi159 ceph-mon[69013]: pgmap v3403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:31 smithi096 ceph-mon[101353]: pgmap v3403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:33 smithi159 ceph-mon[69013]: pgmap v3404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:33 smithi096 ceph-mon[101353]: pgmap v3404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:35 smithi159 ceph-mon[69013]: pgmap v3405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:36.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:35 smithi096 ceph-mon[101353]: pgmap v3405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:37 smithi159 ceph-mon[69013]: pgmap v3406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:37 smithi096 ceph-mon[101353]: pgmap v3406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:39 smithi159 ceph-mon[69013]: pgmap v3407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:39 smithi096 ceph-mon[101353]: pgmap v3407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:41 smithi159 ceph-mon[69013]: pgmap v3408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:41 smithi096 ceph-mon[101353]: pgmap v3408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 -- 172.21.15.96:0/2315566779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 msgr2=0x7f39d40f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 --2- 172.21.15.96:0/2315566779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d40f4dc0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f39c4004660 tx=0x7f39c4009b30).stop 2022-02-02T20:15:43.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 -- 172.21.15.96:0/2315566779 shutdown_connections 2022-02-02T20:15:43.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 --2- 172.21.15.96:0/2315566779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 0x7f39d40f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 --2- 172.21.15.96:0/2315566779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d40f4dc0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 -- 172.21.15.96:0/2315566779 >> 172.21.15.96:0/2315566779 conn(0x7f39d40f04c0 msgr2=0x7f39d40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:43.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 -- 172.21.15.96:0/2315566779 shutdown_connections 2022-02-02T20:15:43.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.238+0000 7f39da0f4700 1 -- 172.21.15.96:0/2315566779 wait complete. 2022-02-02T20:15:43.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 Processor -- start 2022-02-02T20:15:43.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 -- start start 2022-02-02T20:15:43.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 0x7f39d4107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4107af0 con 0x7f39d40f49a0 2022-02-02T20:15:43.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39da0f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4107c30 con 0x7f39d40f5340 2022-02-02T20:15:43.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36058/0 (socket says 172.21.15.96:36058) 2022-02-02T20:15:43.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39d37fe700 1 -- 172.21.15.96:0/1763455690 learned_addr learned my addr 172.21.15.96:0/1763455690 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:43.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.239+0000 7f39d2ffd700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 0x7f39d4107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39d37fe700 1 -- 172.21.15.96:0/1763455690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 msgr2=0x7f39d4107540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39d37fe700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 0x7f39d4107540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39d37fe700 1 -- 172.21.15.96:0/1763455690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4005040 con 0x7f39d40f49a0 2022-02-02T20:15:43.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39d37fe700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f39c40043a0 tx=0x7f39c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4018070 con 0x7f39d40f49a0 2022-02-02T20:15:43.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4108570 con 0x7f39d40f49a0 2022-02-02T20:15:43.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39c4007ba0 con 0x7f39d40f49a0 2022-02-02T20:15:43.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c401de30 con 0x7f39d40f49a0 2022-02-02T20:15:43.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.240+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4108ad0 con 0x7f39d40f49a0 2022-02-02T20:15:43.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.241+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d4045ad0 con 0x7f39d40f49a0 2022-02-02T20:15:43.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.242+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f39c401d420 con 0x7f39d40f49a0 2022-02-02T20:15:43.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.242+0000 7f39bbfff700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 0x7f39bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.242+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f39c4083650 con 0x7f39d40f49a0 2022-02-02T20:15:43.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.242+0000 7f39d2ffd700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 0x7f39bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.243+0000 7f39d2ffd700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 0x7f39bc067290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f39d40f5780 tx=0x7f39c800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.246+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39c4055180 con 0x7f39d40f49a0 2022-02-02T20:15:43.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.423+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d40ff060 con 0x7f39bc064dd0 2022-02-02T20:15:43.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.425+0000 7f39bbfff700 1 -- 172.21.15.96:0/1763455690 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f39d40ff060 con 0x7f39bc064dd0 2022-02-02T20:15:43.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 msgr2=0x7f39bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 0x7f39bc067290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f39d40f5780 tx=0x7f39c800b040).stop 2022-02-02T20:15:43.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 msgr2=0x7f39d4107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f39c40043a0 tx=0x7f39c4009b30).stop 2022-02-02T20:15:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 shutdown_connections 2022-02-02T20:15:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39bc064dd0 0x7f39bc067290 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39d40f49a0 0x7f39d4107050 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 --2- 172.21.15.96:0/1763455690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39d40f5340 0x7f39d4107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.426+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 >> 172.21.15.96:0/1763455690 conn(0x7f39d40f04c0 msgr2=0x7f39d40fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.427+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 shutdown_connections 2022-02-02T20:15:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.427+0000 7f39da0f4700 1 -- 172.21.15.96:0/1763455690 wait complete. 2022-02-02T20:15:43.438 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:15:43.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 -- 172.21.15.96:0/2477407190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66e0 msgr2=0x7fb00c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 --2- 172.21.15.96:0/2477407190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66e0 0x7fb00c0f6b00 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fb000004660 tx=0x7fb000009b30).stop 2022-02-02T20:15:43.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 -- 172.21.15.96:0/2477407190 shutdown_connections 2022-02-02T20:15:43.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 --2- 172.21.15.96:0/2477407190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f7980 0x7fb00c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 --2- 172.21.15.96:0/2477407190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66e0 0x7fb00c0f6b00 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 -- 172.21.15.96:0/2477407190 >> 172.21.15.96:0/2477407190 conn(0x7fb00c0f1e40 msgr2=0x7fb00c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:43.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 -- 172.21.15.96:0/2477407190 shutdown_connections 2022-02-02T20:15:43.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.524+0000 7fb011974700 1 -- 172.21.15.96:0/2477407190 wait complete. 2022-02-02T20:15:43.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 Processor -- start 2022-02-02T20:15:43.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 -- start start 2022-02-02T20:15:43.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66e0 0x7fb00c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c06a380 con 0x7fb00c0f7980 2022-02-02T20:15:43.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb011974700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c06a4c0 con 0x7fb00c0f66e0 2022-02-02T20:15:43.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb00a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb00a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36070/0 (socket says 172.21.15.96:36070) 2022-02-02T20:15:43.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb00a7fc700 1 -- 172.21.15.96:0/1447752027 learned_addr learned my addr 172.21.15.96:0/1447752027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:43.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb00affd700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66e0 0x7fb00c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.525+0000 7fb00a7fc700 1 -- 172.21.15.96:0/1447752027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66e0 msgr2=0x7fb00c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7fb00a7fc700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66e0 0x7fb00c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7fb00a7fc700 1 -- 172.21.15.96:0/1447752027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000005040 con 0x7fb00c0f7980 2022-02-02T20:15:43.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7fb00a7fc700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7faffc00c530 tx=0x7faffc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc00f650 con 0x7fb00c0f7980 2022-02-02T20:15:43.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faffc00fc60 con 0x7fb00c0f7980 2022-02-02T20:15:43.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c06a7a0 con 0x7fb00c0f7980 2022-02-02T20:15:43.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.526+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc012c20 con 0x7fb00c0f7980 2022-02-02T20:15:43.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.527+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c10efe0 con 0x7fb00c0f7980 2022-02-02T20:15:43.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.527+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faffc010070 con 0x7fb00c0f7980 2022-02-02T20:15:43.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.527+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c045ad0 con 0x7fb00c0f7980 2022-02-02T20:15:43.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.528+0000 7faff37fe700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.528+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faffc081720 con 0x7fb00c0f7980 2022-02-02T20:15:43.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.528+0000 7fb00affd700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.528+0000 7fb00affd700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fb000013690 tx=0x7fb000009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.532+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faffc04f820 con 0x7fb00c0f7980 2022-02-02T20:15:43.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.704+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb00c0fefe0 con 0x7faff4064dd0 2022-02-02T20:15:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.713+0000 7faff37fe700 1 -- 172.21.15.96:0/1447752027 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fb00c0fefe0 con 0x7faff4064dd0 2022-02-02T20:15:43.716 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:15:43.716 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (119m) 89m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:15:43.716 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (111m) 89m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:15:43.717 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (111m) 88m ago 119m 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:15:43.717 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (118m) 89m ago 119m 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:15:43.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (116m) 89m ago 116m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:15:43.718 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (111m) 89m ago 116m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:15:43.718 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (116m) 88m ago 116m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:15:43.718 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (112m) 88m ago 116m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:15:43.718 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (113m) 89m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:15:43.719 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (112m) 88m ago 119m 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:15:43.719 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (112m) 89m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:15:43.719 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (112m) 88m ago 119m 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:15:43.719 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (119m) 89m ago 119m 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:15:43.720 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (119m) 88m ago 119m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:15:43.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (111m) 89m ago 119m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:15:43.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (110m) 89m ago 118m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:15:43.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (110m) 89m ago 118m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:15:43.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (109m) 88m ago 118m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:15:43.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (109m) 88m ago 117m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:15:43.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (108m) 88m ago 117m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:15:43.721 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (118m) 89m ago 119m 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:15:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 msgr2=0x7faff4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fb000013690 tx=0x7fb000009b30).stop 2022-02-02T20:15:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 msgr2=0x7fb00c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7faffc00c530 tx=0x7faffc007e20).stop 2022-02-02T20:15:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 shutdown_connections 2022-02-02T20:15:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66e0 0x7fb00c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 --2- 172.21.15.96:0/1447752027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7980 0x7fb00c069e20 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 >> 172.21.15.96:0/1447752027 conn(0x7fb00c0f1e40 msgr2=0x7fb00c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 shutdown_connections 2022-02-02T20:15:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.715+0000 7fb011974700 1 -- 172.21.15.96:0/1447752027 wait complete. 2022-02-02T20:15:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- 172.21.15.96:0/59259600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f6860 msgr2=0x7f16ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 --2- 172.21.15.96:0/59259600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f6860 0x7f16ec0f6cc0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f16dc004660 tx=0x7f16dc009b30).stop 2022-02-02T20:15:43.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- 172.21.15.96:0/59259600 shutdown_connections 2022-02-02T20:15:43.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 --2- 172.21.15.96:0/59259600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f6860 0x7f16ec0f6cc0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 --2- 172.21.15.96:0/59259600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f55c0 0x7f16ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:15:43.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- 172.21.15.96:0/59259600 >> 172.21.15.96:0/59259600 conn(0x7f16ec0f0d40 msgr2=0x7f16ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:43.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- 172.21.15.96:0/59259600 shutdown_connections 2022-02-02T20:15:43.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- 172.21.15.96:0/59259600 wait complete. 2022-02-02T20:15:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 Processor -- start 2022-02-02T20:15:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.812+0000 7f16f124e700 1 -- start start 2022-02-02T20:15:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f6860 0x7f16ec105300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec105990 con 0x7f16ec0f55c0 2022-02-02T20:15:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec106110 con 0x7f16ec0f6860 2022-02-02T20:15:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36078/0 (socket says 172.21.15.96:36078) 2022-02-02T20:15:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 -- 172.21.15.96:0/3473591003 learned_addr learned my addr 172.21.15.96:0/3473591003 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:43.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ea59c700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f6860 0x7f16ec105300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 -- 172.21.15.96:0/3473591003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f6860 msgr2=0x7f16ec105300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f6860 0x7f16ec105300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 -- 172.21.15.96:0/3473591003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc005040 con 0x7f16ec0f55c0 2022-02-02T20:15:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16ead9d700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f16e00093f0 tx=0x7f16e0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e0009ea0 con 0x7f16ec0f55c0 2022-02-02T20:15:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec106390 con 0x7f16ec0f55c0 2022-02-02T20:15:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16e0013af0 con 0x7f16ec0f55c0 2022-02-02T20:15:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e000db10 con 0x7f16ec0f55c0 2022-02-02T20:15:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.813+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec106950 con 0x7f16ec0f55c0 2022-02-02T20:15:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.814+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec045ad0 con 0x7f16ec0f55c0 2022-02-02T20:15:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.815+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f16e001a060 con 0x7f16ec0f55c0 2022-02-02T20:15:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.815+0000 7f16d37fe700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 0x7f16d40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.815+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f16e0081aa0 con 0x7f16ec0f55c0 2022-02-02T20:15:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.815+0000 7f16ea59c700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 0x7f16d40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.816+0000 7f16ea59c700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 0x7f16d40694a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f16dc004e30 tx=0x7f16dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:43.820+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f16e004fba0 con 0x7f16ec0f55c0 2022-02-02T20:15:44.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.048+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16ec027a00 con 0x7f16ec0f55c0 2022-02-02T20:15:44.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.049+0000 7f16d37fe700 1 -- 172.21.15.96:0/3473591003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f16e0018070 con 0x7f16ec0f55c0 2022-02-02T20:15:44.052 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:15:44.052 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:15:44.052 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:15:44.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:44.052 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:15:44.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:15:44.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:44.053 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:15:44.053 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:15:44.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:44.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:15:44.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:15:44.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:15:44.055 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:15:44.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:15:44.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:15:44.056 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:15:44.056 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:15:44.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 msgr2=0x7f16d40694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 0x7f16d40694a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f16dc004e30 tx=0x7f16dc009b30).stop 2022-02-02T20:15:44.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 msgr2=0x7f16ec104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f16e00093f0 tx=0x7f16e0006ec0).stop 2022-02-02T20:15:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 shutdown_connections 2022-02-02T20:15:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16d4066fe0 0x7f16d40694a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16ec0f55c0 0x7f16ec104e10 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 --2- 172.21.15.96:0/3473591003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16ec0f6860 0x7f16ec105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 >> 172.21.15.96:0/3473591003 conn(0x7f16ec0f0d40 msgr2=0x7f16ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 shutdown_connections 2022-02-02T20:15:44.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.051+0000 7f16f124e700 1 -- 172.21.15.96:0/3473591003 wait complete. 2022-02-02T20:15:44.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 -- 172.21.15.96:0/3779719211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f55c0 msgr2=0x7f70340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 --2- 172.21.15.96:0/3779719211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f55c0 0x7f70340f59e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f7024004660 tx=0x7f7024009b30).stop 2022-02-02T20:15:44.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 -- 172.21.15.96:0/3779719211 shutdown_connections 2022-02-02T20:15:44.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 --2- 172.21.15.96:0/3779719211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f6860 0x7f70340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 --2- 172.21.15.96:0/3779719211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f55c0 0x7f70340f59e0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 -- 172.21.15.96:0/3779719211 >> 172.21.15.96:0/3779719211 conn(0x7f70340f0d40 msgr2=0x7f70340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:44.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 -- 172.21.15.96:0/3779719211 shutdown_connections 2022-02-02T20:15:44.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.149+0000 7f70397f3700 1 -- 172.21.15.96:0/3779719211 wait complete. 2022-02-02T20:15:44.153 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:43 smithi096 ceph-mon[101353]: pgmap v3409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:44.154 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:43 smithi096 ceph-mon[101353]: from='client.37606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:44.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 Processor -- start 2022-02-02T20:15:44.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 -- start start 2022-02-02T20:15:44.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f55c0 0x7f7034109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:44.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:44.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340603e0 con 0x7f70340f6860 2022-02-02T20:15:44.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70397f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034060520 con 0x7f70340f55c0 2022-02-02T20:15:44.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:44.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36090/0 (socket says 172.21.15.96:36090) 2022-02-02T20:15:44.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 -- 172.21.15.96:0/2377489847 learned_addr learned my addr 172.21.15.96:0/2377489847 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:15:44.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f7032ffd700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f55c0 0x7f7034109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:44.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 -- 172.21.15.96:0/2377489847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f55c0 msgr2=0x7f7034109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f55c0 0x7f7034109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.150+0000 7f70327fc700 1 -- 172.21.15.96:0/2377489847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024005040 con 0x7f70340f6860 2022-02-02T20:15:44.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f70327fc700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f702800c790 tx=0x7f7028007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:44.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7028002590 con 0x7f70340f6860 2022-02-02T20:15:44.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703410c720 con 0x7f70340f6860 2022-02-02T20:15:44.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7028002ba0 con 0x7f70340f6860 2022-02-02T20:15:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7028013d90 con 0x7f70340f6860 2022-02-02T20:15:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.151+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703410cce0 con 0x7f70340f6860 2022-02-02T20:15:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.152+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f702801a060 con 0x7f70340f6860 2022-02-02T20:15:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.152+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7034045ad0 con 0x7f70340f6860 2022-02-02T20:15:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.152+0000 7f701b7fe700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:15:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.153+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7028081cc0 con 0x7f70340f6860 2022-02-02T20:15:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.153+0000 7f7032ffd700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:15:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.153+0000 7f7032ffd700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 0x7f701c067290 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f7024013690 tx=0x7f7024009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:15:44.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.157+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f702804fd60 con 0x7f70340f6860 2022-02-02T20:15:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:43 smithi159 ceph-mon[69013]: pgmap v3409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:43 smithi159 ceph-mon[69013]: from='client.37606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.360+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7034027a00 con 0x7f70340f6860 2022-02-02T20:15:44.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.360+0000 7f701b7fe700 1 -- 172.21.15.96:0/2377489847 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7028053380 con 0x7f70340f6860 2022-02-02T20:15:44.363 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:15:44.363 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:15:44.364 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:15:44.364 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:15:44.364 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:44.365 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:15:44.365 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:15:44.365 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:15:44.365 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:15:44.365 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:15:44.366 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:15:44.366 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:15:44.366 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:15:44.366 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:15:44.367 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:15:44.367 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:15:44.367 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:15:44.367 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:15:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:15:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:15:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:15:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:15:44.368 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:15:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:15:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:15:44.369 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:15:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:15:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:15:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:15:44.370 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:15:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:15:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:15:44.371 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:44.371 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:15:44.372 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:15:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:44.372 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:15:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 msgr2=0x7f701c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 0x7f701c067290 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f7024013690 tx=0x7f7024009b30).stop 2022-02-02T20:15:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 msgr2=0x7f703410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:15:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f702800c790 tx=0x7f7028007d70).stop 2022-02-02T20:15:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 shutdown_connections 2022-02-02T20:15:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70340f55c0 0x7f7034109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 --2- 172.21.15.96:0/2377489847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70340f6860 0x7f703410c170 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:15:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 >> 172.21.15.96:0/2377489847 conn(0x7f70340f0d40 msgr2=0x7f70340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:15:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 shutdown_connections 2022-02-02T20:15:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:15:44.364+0000 7f70397f3700 1 -- 172.21.15.96:0/2377489847 wait complete. 2022-02-02T20:15:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:15:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:44 smithi159 ceph-mon[69013]: from='client.37610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3473591003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:15:45.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2377489847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:15:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:44 smithi096 ceph-mon[101353]: from='client.37610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:15:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3473591003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:15:45.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2377489847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:15:46.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:45 smithi159 ceph-mon[69013]: pgmap v3410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:46.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:45 smithi096 ceph-mon[101353]: pgmap v3410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:47 smithi159 ceph-mon[69013]: pgmap v3411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:47 smithi096 ceph-mon[101353]: pgmap v3411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:50.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:49 smithi159 ceph-mon[69013]: pgmap v3412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:49 smithi096 ceph-mon[101353]: pgmap v3412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:52.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:51 smithi159 ceph-mon[69013]: pgmap v3413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:51 smithi096 ceph-mon[101353]: pgmap v3413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:53 smithi159 ceph-mon[69013]: pgmap v3414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:53 smithi096 ceph-mon[101353]: pgmap v3414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:56.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:55 smithi159 ceph-mon[69013]: pgmap v3415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:55 smithi096 ceph-mon[101353]: pgmap v3415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:57 smithi159 ceph-mon[69013]: pgmap v3416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:15:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:57 smithi096 ceph-mon[101353]: pgmap v3416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:00.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:15:59 smithi159 ceph-mon[69013]: pgmap v3417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:15:59 smithi096 ceph-mon[101353]: pgmap v3417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:02.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:01 smithi159 ceph-mon[69013]: pgmap v3418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:01 smithi096 ceph-mon[101353]: pgmap v3418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:04.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:03 smithi159 ceph-mon[69013]: pgmap v3419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:03 smithi096 ceph-mon[101353]: pgmap v3419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:05 smithi159 ceph-mon[69013]: pgmap v3420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:05 smithi096 ceph-mon[101353]: pgmap v3420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:07 smithi159 ceph-mon[69013]: pgmap v3421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:08.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:07 smithi096 ceph-mon[101353]: pgmap v3421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:10.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:09 smithi159 ceph-mon[69013]: pgmap v3422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:09 smithi096 ceph-mon[101353]: pgmap v3422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:11 smithi159 ceph-mon[69013]: pgmap v3423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:11 smithi096 ceph-mon[101353]: pgmap v3423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:13 smithi159 ceph-mon[69013]: pgmap v3424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:13 smithi096 ceph-mon[101353]: pgmap v3424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:14.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 -- 172.21.15.96:0/1412467990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f55c0 msgr2=0x7f8b140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 --2- 172.21.15.96:0/1412467990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f55c0 0x7f8b140f59e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f8b08004660 tx=0x7f8b08009b30).stop 2022-02-02T20:16:14.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 -- 172.21.15.96:0/1412467990 shutdown_connections 2022-02-02T20:16:14.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 --2- 172.21.15.96:0/1412467990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f6860 0x7f8b140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:16:14.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 --2- 172.21.15.96:0/1412467990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f55c0 0x7f8b140f59e0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 -- 172.21.15.96:0/1412467990 >> 172.21.15.96:0/1412467990 conn(0x7f8b140f0d40 msgr2=0x7f8b140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:14.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 -- 172.21.15.96:0/1412467990 shutdown_connections 2022-02-02T20:16:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.469+0000 7f8b1924e700 1 -- 172.21.15.96:0/1412467990 wait complete. 2022-02-02T20:16:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 Processor -- start 2022-02-02T20:16:14.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 -- start start 2022-02-02T20:16:14.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f55c0 0x7f8b14106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14107ac0 con 0x7f8b140f6860 2022-02-02T20:16:14.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.470+0000 7f8b1924e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14108370 con 0x7f8b140f55c0 2022-02-02T20:16:14.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36108/0 (socket says 172.21.15.96:36108) 2022-02-02T20:16:14.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 -- 172.21.15.96:0/2449181571 learned_addr learned my addr 172.21.15.96:0/2449181571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:14.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b12d9d700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f55c0 0x7f8b14106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 -- 172.21.15.96:0/2449181571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f55c0 msgr2=0x7f8b14106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f55c0 0x7f8b14106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 -- 172.21.15.96:0/2449181571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08005040 con 0x7f8b140f6860 2022-02-02T20:16:14.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1259c700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f8b0400b410 tx=0x7f8b04006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:14.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b040125f0 con 0x7f8b140f6860 2022-02-02T20:16:14.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b0400be30 con 0x7f8b140f6860 2022-02-02T20:16:14.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b04002a70 con 0x7f8b140f6860 2022-02-02T20:16:14.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b14108650 con 0x7f8b140f6860 2022-02-02T20:16:14.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.471+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14108c10 con 0x7f8b140f6860 2022-02-02T20:16:14.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.472+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b140f49b0 con 0x7f8b140f6860 2022-02-02T20:16:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.473+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8b0400f030 con 0x7f8b140f6860 2022-02-02T20:16:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.473+0000 7f8afb7fe700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 0x7f8afc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.473+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8b04081da0 con 0x7f8b140f6860 2022-02-02T20:16:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.473+0000 7f8b12d9d700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 0x7f8afc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.473+0000 7f8b12d9d700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 0x7f8afc067290 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8b08004630 tx=0x7f8b08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:14.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.477+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8b040538d0 con 0x7f8b140f6860 2022-02-02T20:16:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.656+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b1405fd30 con 0x7f8afc064dd0 2022-02-02T20:16:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.657+0000 7f8afb7fe700 1 -- 172.21.15.96:0/2449181571 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8b1405fd30 con 0x7f8afc064dd0 2022-02-02T20:16:14.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 msgr2=0x7f8afc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 0x7f8afc067290 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8b08004630 tx=0x7f8b08009b30).stop 2022-02-02T20:16:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 msgr2=0x7f8b14107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f8b0400b410 tx=0x7f8b04006ef0).stop 2022-02-02T20:16:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 shutdown_connections 2022-02-02T20:16:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8afc064dd0 0x7f8afc067290 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140f55c0 0x7f8b14106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 --2- 172.21.15.96:0/2449181571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b140f6860 0x7f8b14107480 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 >> 172.21.15.96:0/2449181571 conn(0x7f8b140f0d40 msgr2=0x7f8b1405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 shutdown_connections 2022-02-02T20:16:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.659+0000 7f8b1924e700 1 -- 172.21.15.96:0/2449181571 wait complete. 2022-02-02T20:16:14.671 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:16:14.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 -- 172.21.15.96:0/1481930804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 msgr2=0x7f52c00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1481930804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c00f5850 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f52b4004660 tx=0x7f52b4009b30).stop 2022-02-02T20:16:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 -- 172.21.15.96:0/1481930804 shutdown_connections 2022-02-02T20:16:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1481930804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 0x7f52c00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:16:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1481930804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c00f5850 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 -- 172.21.15.96:0/1481930804 >> 172.21.15.96:0/1481930804 conn(0x7f52c00f0b90 msgr2=0x7f52c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:14.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 -- 172.21.15.96:0/1481930804 shutdown_connections 2022-02-02T20:16:14.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.757+0000 7f52bf59e700 1 -- 172.21.15.96:0/1481930804 wait complete. 2022-02-02T20:16:14.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 Processor -- start 2022-02-02T20:16:14.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 -- start start 2022-02-02T20:16:14.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 0x7f52c0107350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c01079e0 con 0x7f52c00f5430 2022-02-02T20:16:14.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bf59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0108110 con 0x7f52c00f66d0 2022-02-02T20:16:14.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52be59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52be59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36116/0 (socket says 172.21.15.96:36116) 2022-02-02T20:16:14.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52be59c700 1 -- 172.21.15.96:0/1618567344 learned_addr learned my addr 172.21.15.96:0/1618567344 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:14.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.758+0000 7f52bdd9b700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 0x7f52c0107350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52be59c700 1 -- 172.21.15.96:0/1618567344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 msgr2=0x7f52c0107350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52be59c700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 0x7f52c0107350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52be59c700 1 -- 172.21.15.96:0/1618567344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4005040 con 0x7f52c00f5430 2022-02-02T20:16:14.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52be59c700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f52b4009d80 tx=0x7f52b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:14.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b4018070 con 0x7f52c00f5430 2022-02-02T20:16:14.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52b4007ba0 con 0x7f52c00f5430 2022-02-02T20:16:14.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c0108330 con 0x7f52c00f5430 2022-02-02T20:16:14.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b401c3c0 con 0x7f52c00f5430 2022-02-02T20:16:14.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.759+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c0108890 con 0x7f52c00f5430 2022-02-02T20:16:14.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.760+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c0045ad0 con 0x7f52c00f5430 2022-02-02T20:16:14.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.761+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52b401d420 con 0x7f52c00f5430 2022-02-02T20:16:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.761+0000 7f52aeffd700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 0x7f52a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.761+0000 7f52bdd9b700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 0x7f52a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.761+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52b408b350 con 0x7f52c00f5430 2022-02-02T20:16:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.762+0000 7f52bdd9b700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 0x7f52a80672e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f52b0006fd0 tx=0x7f52b0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.766+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52b4088060 con 0x7f52c00f5430 2022-02-02T20:16:14.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.938+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52c0108b00 con 0x7f52a8064e20 2022-02-02T20:16:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.947+0000 7f52aeffd700 1 -- 172.21.15.96:0/1618567344 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f52c0108b00 con 0x7f52a8064e20 2022-02-02T20:16:14.950 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:16:14.950 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (119m) 90m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:16:14.950 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (112m) 90m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:16:14.951 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (111m) 88m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:16:14.951 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (119m) 90m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:16:14.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (116m) 90m ago 116m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:16:14.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (112m) 90m ago 116m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:16:14.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (116m) 88m ago 116m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:16:14.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (112m) 88m ago 116m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:16:14.952 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (113m) 90m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:16:14.952 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (113m) 88m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:16:14.952 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (112m) 90m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:16:14.953 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (112m) 88m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:16:14.953 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 90m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:16:14.953 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (119m) 88m ago 119m 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:16:14.953 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (111m) 90m ago 119m 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:16:14.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (111m) 90m ago 119m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:16:14.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (110m) 90m ago 118m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:16:14.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (110m) 88m ago 118m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:16:14.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (109m) 88m ago 118m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:16:14.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (109m) 88m ago 118m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:16:14.955 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (119m) 90m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:16:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 msgr2=0x7f52a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 0x7f52a80672e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f52b0006fd0 tx=0x7f52b0008040).stop 2022-02-02T20:16:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 msgr2=0x7f52c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f52b4009d80 tx=0x7f52b4009b30).stop 2022-02-02T20:16:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 shutdown_connections 2022-02-02T20:16:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a8064e20 0x7f52a80672e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c00f5430 0x7f52c0106e60 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 --2- 172.21.15.96:0/1618567344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c00f66d0 0x7f52c0107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 >> 172.21.15.96:0/1618567344 conn(0x7f52c00f0b90 msgr2=0x7f52c00fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 shutdown_connections 2022-02-02T20:16:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:14.949+0000 7f52bf59e700 1 -- 172.21.15.96:0/1618567344 wait complete. 2022-02-02T20:16:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 -- 172.21.15.96:0/3236904791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 msgr2=0x7f32500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 --2- 172.21.15.96:0/3236904791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f32500f6b00 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f3244004660 tx=0x7f3244009b30).stop 2022-02-02T20:16:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 -- 172.21.15.96:0/3236904791 shutdown_connections 2022-02-02T20:16:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 --2- 172.21.15.96:0/3236904791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 --2- 172.21.15.96:0/3236904791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f32500f6b00 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 -- 172.21.15.96:0/3236904791 >> 172.21.15.96:0/3236904791 conn(0x7f32500f1e40 msgr2=0x7f32500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 -- 172.21.15.96:0/3236904791 shutdown_connections 2022-02-02T20:16:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 -- 172.21.15.96:0/3236904791 wait complete. 2022-02-02T20:16:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.046+0000 7f3256c40700 1 Processor -- start 2022-02-02T20:16:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f3256c40700 1 -- start start 2022-02-02T20:16:15.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f3256c40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f3250106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f3256c40700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f3256c40700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3250107a50 con 0x7f32500f66e0 2022-02-02T20:16:15.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f3256c40700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3250107b90 con 0x7f32500f7980 2022-02-02T20:16:15.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f324ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f324ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:40232/0 (socket says 172.21.15.96:40232) 2022-02-02T20:16:15.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f324ffff700 1 -- 172.21.15.96:0/3164014610 learned_addr learned my addr 172.21.15.96:0/3164014610 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:15.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.047+0000 7f32549dc700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f3250106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324ffff700 1 -- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 msgr2=0x7f3250106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324ffff700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f3250106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324ffff700 1 -- 172.21.15.96:0/3164014610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244005040 con 0x7f32500f7980 2022-02-02T20:16:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f32549dc700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f3250106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:16:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324ffff700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f323c0026d0 tx=0x7f323c009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f323c0079c0 con 0x7f32500f7980 2022-02-02T20:16:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f323c00f040 con 0x7f32500f7980 2022-02-02T20:16:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3250108530 con 0x7f32500f7980 2022-02-02T20:16:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f323c0148b0 con 0x7f32500f7980 2022-02-02T20:16:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.048+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3250108af0 con 0x7f32500f7980 2022-02-02T20:16:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.049+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250045ad0 con 0x7f32500f7980 2022-02-02T20:16:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.050+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f323c007b20 con 0x7f32500f7980 2022-02-02T20:16:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.050+0000 7f324d7fa700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 0x7f3240067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.050+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f323c0819a0 con 0x7f32500f7980 2022-02-02T20:16:15.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.050+0000 7f32549dc700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 0x7f3240067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.050+0000 7f32549dc700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 0x7f3240067290 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f3244005010 tx=0x7f3244009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:15.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.055+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f323c0534d0 con 0x7f32500f7980 2022-02-02T20:16:15.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.287+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f32500fefa0 con 0x7f32500f7980 2022-02-02T20:16:15.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.288+0000 7f324d7fa700 1 -- 172.21.15.96:0/3164014610 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f323c0530c0 con 0x7f32500f7980 2022-02-02T20:16:15.291 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:16:15.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:16:15.291 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:16:15.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:15.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:16:15.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:16:15.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:15.292 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:16:15.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:16:15.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:15.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:16:15.293 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:16:15.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:15.294 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:16:15.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:16:15.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:16:15.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:16:15.295 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:16:15.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 msgr2=0x7f3240067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 0x7f3240067290 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f3244005010 tx=0x7f3244009b30).stop 2022-02-02T20:16:15.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 msgr2=0x7f32501074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f323c0026d0 tx=0x7f323c009de0).stop 2022-02-02T20:16:15.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 shutdown_connections 2022-02-02T20:16:15.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3240064dd0 0x7f3240067290 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32500f66e0 0x7f3250106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 --2- 172.21.15.96:0/3164014610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500f7980 0x7f32501074a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 >> 172.21.15.96:0/3164014610 conn(0x7f32500f1e40 msgr2=0x7f32500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:15.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 shutdown_connections 2022-02-02T20:16:15.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.290+0000 7f3256c40700 1 -- 172.21.15.96:0/3164014610 wait complete. 2022-02-02T20:16:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 -- 172.21.15.96:0/2575843428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f6860 msgr2=0x7f03740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 --2- 172.21.15.96:0/2575843428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f6860 0x7f03740f6cc0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f035c004660 tx=0x7f035c009b30).stop 2022-02-02T20:16:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 -- 172.21.15.96:0/2575843428 shutdown_connections 2022-02-02T20:16:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 --2- 172.21.15.96:0/2575843428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f6860 0x7f03740f6cc0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 --2- 172.21.15.96:0/2575843428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f55c0 0x7f03740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 -- 172.21.15.96:0/2575843428 >> 172.21.15.96:0/2575843428 conn(0x7f03740f0d40 msgr2=0x7f03740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 -- 172.21.15.96:0/2575843428 shutdown_connections 2022-02-02T20:16:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.388+0000 7f037a6cc700 1 -- 172.21.15.96:0/2575843428 wait complete. 2022-02-02T20:16:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 Processor -- start 2022-02-02T20:16:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 -- start start 2022-02-02T20:16:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 0x7f037410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740603e0 con 0x7f03740f55c0 2022-02-02T20:16:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f037a6cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374060520 con 0x7f03740f6860 2022-02-02T20:16:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f0373fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f0373fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36136/0 (socket says 172.21.15.96:36136) 2022-02-02T20:16:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.389+0000 7f0373fff700 1 -- 172.21.15.96:0/3874633751 learned_addr learned my addr 172.21.15.96:0/3874633751 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f03737fe700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 0x7f037410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0373fff700 1 -- 172.21.15.96:0/3874633751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 msgr2=0x7f037410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0373fff700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 0x7f037410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0373fff700 1 -- 172.21.15.96:0/3874633751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c005040 con 0x7f03740f55c0 2022-02-02T20:16:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f03737fe700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 0x7f037410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:16:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0373fff700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f0364002700 tx=0x7f0364009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364009320 con 0x7f03740f55c0 2022-02-02T20:16:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037410c700 con 0x7f03740f55c0 2022-02-02T20:16:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f036400f040 con 0x7f03740f55c0 2022-02-02T20:16:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364014900 con 0x7f03740f55c0 2022-02-02T20:16:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.390+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037410ccc0 con 0x7f03740f55c0 2022-02-02T20:16:15.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.391+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374045ad0 con 0x7f03740f55c0 2022-02-02T20:16:15.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.391+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0364009480 con 0x7f03740f55c0 2022-02-02T20:16:15.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.392+0000 7f0370ff9700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 0x7f0360067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:15.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.392+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0364081cc0 con 0x7f03740f55c0 2022-02-02T20:16:15.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.392+0000 7f03737fe700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 0x7f0360067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:15.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.392+0000 7f03737fe700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 0x7f0360067290 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f035c009da0 tx=0x7f035c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:15.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.396+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f036404fe80 con 0x7f03740f55c0 2022-02-02T20:16:15.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.596+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03740fdf00 con 0x7f03740f55c0 2022-02-02T20:16:15.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.597+0000 7f0370ff9700 1 -- 172.21.15.96:0/3874633751 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f03640534a0 con 0x7f03740f55c0 2022-02-02T20:16:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:16:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:16:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:16:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:16:15.601 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:15.601 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:16:15.601 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:16:15.601 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:16:15.602 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:16:15.602 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:16:15.602 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:16:15.602 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:16:15.603 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:16:15.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:16:15.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:16:15.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:16:15.604 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:16:15.604 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:16:15.604 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:16:15.604 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:16:15.604 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:16:15.605 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:16:15.605 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:16:15.605 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:16:15.605 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:16:15.606 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:16:15.606 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:16:15.606 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:16:15.606 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:16:15.607 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:16:15.607 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:16:15.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:16:15.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:15.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:15.608 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:16:15.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:15.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:15.609 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:15.609 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:15.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 msgr2=0x7f0360067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 0x7f0360067290 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f035c009da0 tx=0x7f035c009b30).stop 2022-02-02T20:16:15.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 msgr2=0x7f0374109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:15.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f0364002700 tx=0x7f0364009d80).stop 2022-02-02T20:16:15.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 shutdown_connections 2022-02-02T20:16:15.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0360064dd0 0x7f0360067290 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03740f55c0 0x7f0374109c50 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 --2- 172.21.15.96:0/3874633751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03740f6860 0x7f037410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:15.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 >> 172.21.15.96:0/3874633751 conn(0x7f03740f0d40 msgr2=0x7f03740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:15.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 shutdown_connections 2022-02-02T20:16:15.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:15.599+0000 7f037a6cc700 1 -- 172.21.15.96:0/3874633751 wait complete. 2022-02-02T20:16:15.613 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:16:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:16 smithi159 ceph-mon[69013]: from='client.37622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:16 smithi159 ceph-mon[69013]: from='client.37626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:16 smithi159 ceph-mon[69013]: pgmap v3425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:16.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3164014610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:16:16.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3874633751' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:16:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:16 smithi096 ceph-mon[101353]: from='client.37622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:16 smithi096 ceph-mon[101353]: from='client.37626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:16 smithi096 ceph-mon[101353]: pgmap v3425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3164014610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:16:16.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3874633751' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:16:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:17 smithi159 ceph-mon[69013]: pgmap v3426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:17 smithi096 ceph-mon[101353]: pgmap v3426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:20.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:19 smithi159 ceph-mon[69013]: pgmap v3427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:19 smithi096 ceph-mon[101353]: pgmap v3427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:22.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:21 smithi159 ceph-mon[69013]: pgmap v3428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:22.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:21 smithi096 ceph-mon[101353]: pgmap v3428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:24 smithi159 ceph-mon[69013]: pgmap v3429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:24.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:24 smithi096 ceph-mon[101353]: pgmap v3429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:26.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:26 smithi159 ceph-mon[69013]: pgmap v3430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:26.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:26 smithi096 ceph-mon[101353]: pgmap v3430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:27 smithi159 ceph-mon[69013]: pgmap v3431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:16:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:16:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:27 smithi096 ceph-mon[101353]: pgmap v3431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:16:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:16:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:29 smithi159 ceph-mon[69013]: pgmap v3432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:29 smithi096 ceph-mon[101353]: pgmap v3432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:32 smithi159 ceph-mon[69013]: pgmap v3433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:32 smithi096 ceph-mon[101353]: pgmap v3433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:34 smithi159 ceph-mon[69013]: pgmap v3434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:34 smithi096 ceph-mon[101353]: pgmap v3434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:36.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:36 smithi159 ceph-mon[69013]: pgmap v3435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:36.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:36 smithi096 ceph-mon[101353]: pgmap v3435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:37 smithi159 ceph-mon[69013]: pgmap v3436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:37 smithi096 ceph-mon[101353]: pgmap v3436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:40 smithi159 ceph-mon[69013]: pgmap v3437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:40 smithi096 ceph-mon[101353]: pgmap v3437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:42 smithi159 ceph-mon[69013]: pgmap v3438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:42 smithi096 ceph-mon[101353]: pgmap v3438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:44 smithi159 ceph-mon[69013]: pgmap v3439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:44 smithi096 ceph-mon[101353]: pgmap v3439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:45.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 -- 172.21.15.96:0/3141964463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 msgr2=0x7f420c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 --2- 172.21.15.96:0/3141964463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c0f59e0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f4200004660 tx=0x7f4200009b30).stop 2022-02-02T20:16:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 -- 172.21.15.96:0/3141964463 shutdown_connections 2022-02-02T20:16:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 --2- 172.21.15.96:0/3141964463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:16:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 --2- 172.21.15.96:0/3141964463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c0f59e0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 -- 172.21.15.96:0/3141964463 >> 172.21.15.96:0/3141964463 conn(0x7f420c0f0d40 msgr2=0x7f420c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 -- 172.21.15.96:0/3141964463 shutdown_connections 2022-02-02T20:16:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 -- 172.21.15.96:0/3141964463 wait complete. 2022-02-02T20:16:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.708+0000 7f42129f2700 1 Processor -- start 2022-02-02T20:16:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f42129f2700 1 -- start start 2022-02-02T20:16:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f42129f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f42129f2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f42129f2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c060470 con 0x7f420c0f55c0 2022-02-02T20:16:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f42129f2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0605b0 con 0x7f420c0f6860 2022-02-02T20:16:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36154/0 (socket says 172.21.15.96:36154) 2022-02-02T20:16:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 -- 172.21.15.96:0/742206813 learned_addr learned my addr 172.21.15.96:0/742206813 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420b7fe700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 -- 172.21.15.96:0/742206813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 msgr2=0x7f420c10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420bfff700 1 -- 172.21.15.96:0/742206813 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200005040 con 0x7f420c0f55c0 2022-02-02T20:16:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.709+0000 7f420b7fe700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:16:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f420bfff700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f4200004f60 tx=0x7f4200009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200018070 con 0x7f420c0f55c0 2022-02-02T20:16:45.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4200007ba0 con 0x7f420c0f55c0 2022-02-02T20:16:45.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c10c7c0 con 0x7f420c0f55c0 2022-02-02T20:16:45.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420001c620 con 0x7f420c0f55c0 2022-02-02T20:16:45.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.710+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c10ccf0 con 0x7f420c0f55c0 2022-02-02T20:16:45.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.711+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0f49b0 con 0x7f420c0f55c0 2022-02-02T20:16:45.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.711+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f420001c8e0 con 0x7f420c0f55c0 2022-02-02T20:16:45.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.712+0000 7f4208ff9700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 0x7f41f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:45.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.712+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4200083960 con 0x7f420c0f55c0 2022-02-02T20:16:45.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.712+0000 7f420b7fe700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 0x7f41f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:45.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.712+0000 7f420b7fe700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 0x7f41f4067290 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f41fc00b830 tx=0x7f41fc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:45.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.716+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4200051b20 con 0x7f420c0f55c0 2022-02-02T20:16:45.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.894+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f420c0008d0 con 0x7f41f4064dd0 2022-02-02T20:16:45.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.895+0000 7f4208ff9700 1 -- 172.21.15.96:0/742206813 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f420c0008d0 con 0x7f41f4064dd0 2022-02-02T20:16:45.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 msgr2=0x7f41f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:45.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 0x7f41f4067290 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f41fc00b830 tx=0x7f41fc008040).stop 2022-02-02T20:16:45.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 msgr2=0x7f420c109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:45.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f4200004f60 tx=0x7f4200009b30).stop 2022-02-02T20:16:45.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 shutdown_connections 2022-02-02T20:16:45.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41f4064dd0 0x7f41f4067290 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:45.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420c0f55c0 0x7f420c109cc0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:45.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 --2- 172.21.15.96:0/742206813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f420c0f6860 0x7f420c10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:45.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 >> 172.21.15.96:0/742206813 conn(0x7f420c0f0d40 msgr2=0x7f420c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:45.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 shutdown_connections 2022-02-02T20:16:45.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.897+0000 7f42129f2700 1 -- 172.21.15.96:0/742206813 wait complete. 2022-02-02T20:16:45.910 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:16:45.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 -- 172.21.15.96:0/474789417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f55e0 msgr2=0x7f03d40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:45.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/474789417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f55e0 0x7f03d40f5a00 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f03c4004660 tx=0x7f03c4009b30).stop 2022-02-02T20:16:45.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 -- 172.21.15.96:0/474789417 shutdown_connections 2022-02-02T20:16:45.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/474789417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f6880 0x7f03d40f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:16:45.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/474789417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f55e0 0x7f03d40f5a00 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 -- 172.21.15.96:0/474789417 >> 172.21.15.96:0/474789417 conn(0x7f03d40f0d40 msgr2=0x7f03d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 -- 172.21.15.96:0/474789417 shutdown_connections 2022-02-02T20:16:46.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.995+0000 7f03dc0c7700 1 -- 172.21.15.96:0/474789417 wait complete. 2022-02-02T20:16:46.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 Processor -- start 2022-02-02T20:16:46.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 -- start start 2022-02-02T20:16:46.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f55e0 0x7f03d4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4060570 con 0x7f03d40f6880 2022-02-02T20:16:46.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03dc0c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40606b0 con 0x7f03d40f55e0 2022-02-02T20:16:46.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03d9662700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03d9662700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36166/0 (socket says 172.21.15.96:36166) 2022-02-02T20:16:46.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03d9662700 1 -- 172.21.15.96:0/2971662597 learned_addr learned my addr 172.21.15.96:0/2971662597 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:46.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.996+0000 7f03d9e63700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f55e0 0x7f03d4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03d9662700 1 -- 172.21.15.96:0/2971662597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f55e0 msgr2=0x7f03d4109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03d9662700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f55e0 0x7f03d4109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03d9662700 1 -- 172.21.15.96:0/2971662597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4005040 con 0x7f03d40f6880 2022-02-02T20:16:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03d9662700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f03d000f650 tx=0x7f03d000f960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0012070 con 0x7f03d40f6880 2022-02-02T20:16:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03d000d2e0 con 0x7f03d40f6880 2022-02-02T20:16:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d4105af0 con 0x7f03d40f6880 2022-02-02T20:16:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0017a70 con 0x7f03d40f6880 2022-02-02T20:16:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.997+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d41060b0 con 0x7f03d40f6880 2022-02-02T20:16:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.998+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d4045ad0 con 0x7f03d40f6880 2022-02-02T20:16:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.999+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03d000b630 con 0x7f03d40f6880 2022-02-02T20:16:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.999+0000 7f03ca7fc700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 0x7f03c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.999+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f03d0085c90 con 0x7f03d40f6880 2022-02-02T20:16:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.999+0000 7f03d9e63700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 0x7f03c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:45.999+0000 7f03d9e63700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 0x7f03c0067290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f03c4013690 tx=0x7f03c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.003+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03d0053d90 con 0x7f03d40f6880 2022-02-02T20:16:46.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.175+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d40fdf30 con 0x7f03c0064dd0 2022-02-02T20:16:46.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.184+0000 7f03ca7fc700 1 -- 172.21.15.96:0/2971662597 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f03d40fdf30 con 0x7f03c0064dd0 2022-02-02T20:16:46.188 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:16:46.188 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 90m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:16:46.188 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (112m) 90m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:16:46.189 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (112m) 89m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:16:46.189 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (119m) 90m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:16:46.189 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (117m) 90m ago 117m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:16:46.189 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (112m) 90m ago 117m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:16:46.189 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (117m) 89m ago 117m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:16:46.190 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (113m) 89m ago 117m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:16:46.190 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (114m) 90m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:16:46.190 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (113m) 89m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:16:46.190 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (113m) 90m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:16:46.191 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (113m) 89m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:16:46.191 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 90m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:16:46.191 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 89m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:16:46.191 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (112m) 90m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:16:46.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (111m) 90m ago 119m 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:16:46.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (111m) 90m ago 119m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:16:46.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (110m) 89m ago 119m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:16:46.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (110m) 89m ago 118m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:16:46.192 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (109m) 89m ago 118m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:16:46.193 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (119m) 90m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:16:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 msgr2=0x7f03c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 0x7f03c0067290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f03c4013690 tx=0x7f03c4009b30).stop 2022-02-02T20:16:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 msgr2=0x7f03d410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f03d000f650 tx=0x7f03d000f960).stop 2022-02-02T20:16:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 shutdown_connections 2022-02-02T20:16:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c0064dd0 0x7f03c0067290 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f55e0 0x7f03d4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 --2- 172.21.15.96:0/2971662597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f6880 0x7f03d410c1b0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 >> 172.21.15.96:0/2971662597 conn(0x7f03d40f0d40 msgr2=0x7f03d40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 shutdown_connections 2022-02-02T20:16:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.186+0000 7f03dc0c7700 1 -- 172.21.15.96:0/2971662597 wait complete. 2022-02-02T20:16:46.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:46 smithi159 ceph-mon[69013]: pgmap v3440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:46.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 -- 172.21.15.96:0/1162860806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 msgr2=0x7f4f900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/1162860806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f900f6b00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f4f80004660 tx=0x7f4f80009b30).stop 2022-02-02T20:16:46.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 -- 172.21.15.96:0/1162860806 shutdown_connections 2022-02-02T20:16:46.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/1162860806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 0x7f4f900f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/1162860806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f900f6b00 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 -- 172.21.15.96:0/1162860806 >> 172.21.15.96:0/1162860806 conn(0x7f4f900f1e40 msgr2=0x7f4f900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 -- 172.21.15.96:0/1162860806 shutdown_connections 2022-02-02T20:16:46.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:46 smithi096 ceph-mon[101353]: pgmap v3440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:46.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 -- 172.21.15.96:0/1162860806 wait complete. 2022-02-02T20:16:46.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.284+0000 7f4f95b8e700 1 Processor -- start 2022-02-02T20:16:46.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f95b8e700 1 -- start start 2022-02-02T20:16:46.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f95b8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f95b8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 0x7f4f90069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f95b8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9006a380 con 0x7f4f900f66e0 2022-02-02T20:16:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f95b8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9006a4c0 con 0x7f4f900f7980 2022-02-02T20:16:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36178/0 (socket says 172.21.15.96:36178) 2022-02-02T20:16:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 -- 172.21.15.96:0/3642924209 learned_addr learned my addr 172.21.15.96:0/3642924209 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8effd700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 0x7f4f90069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 -- 172.21.15.96:0/3642924209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 msgr2=0x7f4f90069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 0x7f4f90069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 -- 172.21.15.96:0/3642924209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80005040 con 0x7f4f900f66e0 2022-02-02T20:16:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f8f7fe700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f4f80013a70 tx=0x7f4f80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.285+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f80018070 con 0x7f4f900f66e0 2022-02-02T20:16:46.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.286+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f800097d0 con 0x7f4f900f66e0 2022-02-02T20:16:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.286+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9006a740 con 0x7f4f900f66e0 2022-02-02T20:16:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.286+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8001c3c0 con 0x7f4f900f66e0 2022-02-02T20:16:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.286+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9006aca0 con 0x7f4f900f66e0 2022-02-02T20:16:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.287+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90045ad0 con 0x7f4f900f66e0 2022-02-02T20:16:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.287+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f8001c680 con 0x7f4f900f66e0 2022-02-02T20:16:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.287+0000 7f4f77fff700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.288+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4f80083760 con 0x7f4f900f66e0 2022-02-02T20:16:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.288+0000 7f4f8effd700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.288+0000 7f4f8effd700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f4f84009760 tx=0x7f4f84009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.292+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f80051920 con 0x7f4f900f66e0 2022-02-02T20:16:46.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.519+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f900586e0 con 0x7f4f900f66e0 2022-02-02T20:16:46.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.519+0000 7f4f77fff700 1 -- 172.21.15.96:0/3642924209 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4f80054f40 con 0x7f4f900f66e0 2022-02-02T20:16:46.523 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:16:46.523 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:16:46.523 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:16:46.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:46.524 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:16:46.524 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:16:46.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:46.525 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:16:46.525 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:16:46.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:46.526 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:16:46.526 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:16:46.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:16:46.527 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:16:46.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:16:46.527 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:16:46.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:16:46.528 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:16:46.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 msgr2=0x7f4f78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f4f84009760 tx=0x7f4f84009c60).stop 2022-02-02T20:16:46.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 msgr2=0x7f4f9006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f4f80013a70 tx=0x7f4f80009b30).stop 2022-02-02T20:16:46.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 shutdown_connections 2022-02-02T20:16:46.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f66e0 0x7f4f9006b9a0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 --2- 172.21.15.96:0/3642924209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f7980 0x7f4f90069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 >> 172.21.15.96:0/3642924209 conn(0x7f4f900f1e40 msgr2=0x7f4f900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 shutdown_connections 2022-02-02T20:16:46.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.521+0000 7f4f95b8e700 1 -- 172.21.15.96:0/3642924209 wait complete. 2022-02-02T20:16:46.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 -- 172.21.15.96:0/1831521566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 msgr2=0x7fd2fc0f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 --2- 172.21.15.96:0/1831521566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc0f5db0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7fd2f8004660 tx=0x7fd2f8009b30).stop 2022-02-02T20:16:46.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 -- 172.21.15.96:0/1831521566 shutdown_connections 2022-02-02T20:16:46.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 --2- 172.21.15.96:0/1831521566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc0f5db0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 --2- 172.21.15.96:0/1831521566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 0x7fd2fc0f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 -- 172.21.15.96:0/1831521566 >> 172.21.15.96:0/1831521566 conn(0x7fd2fc0f04c0 msgr2=0x7fd2fc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.621+0000 7fd303535700 1 -- 172.21.15.96:0/1831521566 shutdown_connections 2022-02-02T20:16:46.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 -- 172.21.15.96:0/1831521566 wait complete. 2022-02-02T20:16:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 Processor -- start 2022-02-02T20:16:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 -- start start 2022-02-02T20:16:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 0x7fd2fc10c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0f55c0 con 0x7fd2fc0f5930 2022-02-02T20:16:46.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd303535700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0f5700 con 0x7fd2fc0f6be0 2022-02-02T20:16:46.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd3012d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd3012d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36188/0 (socket says 172.21.15.96:36188) 2022-02-02T20:16:46.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd3012d1700 1 -- 172.21.15.96:0/3640724727 learned_addr learned my addr 172.21.15.96:0/3640724727 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:16:46.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.622+0000 7fd300ad0700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 0x7fd2fc10c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd3012d1700 1 -- 172.21.15.96:0/3640724727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 msgr2=0x7fd2fc10c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd3012d1700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 0x7fd2fc10c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd3012d1700 1 -- 172.21.15.96:0/3640724727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8005040 con 0x7fd2fc0f5930 2022-02-02T20:16:46.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd3012d1700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fd2ec00c530 tx=0x7fd2ec007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec00f650 con 0x7fd2fc0f5930 2022-02-02T20:16:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd2ec00fc60 con 0x7fd2fc0f5930 2022-02-02T20:16:46.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc10c7f0 con 0x7fd2fc0f5930 2022-02-02T20:16:46.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec012cb0 con 0x7fd2fc0f5930 2022-02-02T20:16:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.623+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc10cd80 con 0x7fd2fc0f5930 2022-02-02T20:16:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.624+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc0f4150 con 0x7fd2fc0f5930 2022-02-02T20:16:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.624+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd2ec019030 con 0x7fd2fc0f5930 2022-02-02T20:16:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.625+0000 7fd2f1ffb700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 0x7fd2e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:16:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.625+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd2ec081520 con 0x7fd2fc0f5930 2022-02-02T20:16:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.625+0000 7fd300ad0700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 0x7fd2e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:16:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.625+0000 7fd300ad0700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 0x7fd2e8067290 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fd2f8004580 tx=0x7fd2f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:16:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.629+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd2ec0487d0 con 0x7fd2fc0f5930 2022-02-02T20:16:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.835+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd2fc0586e0 con 0x7fd2fc0f5930 2022-02-02T20:16:46.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.835+0000 7fd2f1ffb700 1 -- 172.21.15.96:0/3640724727 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd2ec017070 con 0x7fd2fc0f5930 2022-02-02T20:16:46.840 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:16:46.840 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:16:46.840 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:16:46.841 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:16:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:46.841 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:16:46.842 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:16:46.842 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:16:46.842 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:16:46.843 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:16:46.843 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:16:46.844 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:16:46.844 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:16:46.844 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:16:46.845 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:16:46.845 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:16:46.845 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:16:46.846 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:16:46.846 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:16:46.847 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:16:46.847 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:16:46.847 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:16:46.848 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:16:46.848 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:16:46.848 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:16:46.849 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:16:46.849 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:16:46.849 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:16:46.850 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:16:46.850 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:16:46.850 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:16:46.850 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:16:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:46.851 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:16:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:16:46.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:46.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:46.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:16:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 msgr2=0x7fd2e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 0x7fd2e8067290 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fd2f8004580 tx=0x7fd2f8009b30).stop 2022-02-02T20:16:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 msgr2=0x7fd2fc109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:16:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fd2ec00c530 tx=0x7fd2ec007e10).stop 2022-02-02T20:16:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 shutdown_connections 2022-02-02T20:16:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd2e8064dd0 0x7fd2e8067290 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2fc0f5930 0x7fd2fc109d40 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 --2- 172.21.15.96:0/3640724727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2fc0f6be0 0x7fd2fc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:16:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 >> 172.21.15.96:0/3640724727 conn(0x7fd2fc0f04c0 msgr2=0x7fd2fc0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:16:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 shutdown_connections 2022-02-02T20:16:46.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:16:46.837+0000 7fd303535700 1 -- 172.21.15.96:0/3640724727 wait complete. 2022-02-02T20:16:46.856 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:16:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:47 smithi159 ceph-mon[69013]: from='client.37638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:47.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:47 smithi159 ceph-mon[69013]: from='client.37642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:47.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3642924209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:16:47.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3640724727' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:16:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:47 smithi096 ceph-mon[101353]: from='client.37638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:47.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:47 smithi096 ceph-mon[101353]: from='client.37642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:16:47.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3642924209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:16:47.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3640724727' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:16:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:48 smithi159 ceph-mon[69013]: pgmap v3441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:48 smithi096 ceph-mon[101353]: pgmap v3441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:50.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:50 smithi159 ceph-mon[69013]: pgmap v3442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:50 smithi096 ceph-mon[101353]: pgmap v3442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:52.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:52 smithi096 ceph-mon[101353]: pgmap v3443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:52.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:52 smithi159 ceph-mon[69013]: pgmap v3443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:54 smithi096 ceph-mon[101353]: pgmap v3444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:54 smithi159 ceph-mon[69013]: pgmap v3444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:56 smithi096 ceph-mon[101353]: pgmap v3445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:56.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:56 smithi159 ceph-mon[69013]: pgmap v3445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:16:57 smithi159 ceph-mon[69013]: pgmap v3446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:16:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:16:57 smithi096 ceph-mon[101353]: pgmap v3446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:00.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:00 smithi159 ceph-mon[69013]: pgmap v3447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:00 smithi096 ceph-mon[101353]: pgmap v3447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:02.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:02 smithi159 ceph-mon[69013]: pgmap v3448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:02 smithi096 ceph-mon[101353]: pgmap v3448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:04 smithi159 ceph-mon[69013]: pgmap v3449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:04 smithi096 ceph-mon[101353]: pgmap v3449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:06 smithi159 ceph-mon[69013]: pgmap v3450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:06 smithi096 ceph-mon[101353]: pgmap v3450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:07 smithi159 ceph-mon[69013]: pgmap v3451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:07 smithi096 ceph-mon[101353]: pgmap v3451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:10.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:10 smithi159 ceph-mon[69013]: pgmap v3452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:10 smithi096 ceph-mon[101353]: pgmap v3452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:12 smithi159 ceph-mon[69013]: pgmap v3453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:12 smithi096 ceph-mon[101353]: pgmap v3453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:14.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:14 smithi159 ceph-mon[69013]: pgmap v3454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:14 smithi096 ceph-mon[101353]: pgmap v3454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:16.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:16 smithi159 ceph-mon[69013]: pgmap v3455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:16 smithi096 ceph-mon[101353]: pgmap v3455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:16.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 -- 172.21.15.96:0/4264691047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 msgr2=0x7feef00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:16.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 --2- 172.21.15.96:0/4264691047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef00f59e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7feee0004660 tx=0x7feee0009b30).stop 2022-02-02T20:17:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 -- 172.21.15.96:0/4264691047 shutdown_connections 2022-02-02T20:17:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 --2- 172.21.15.96:0/4264691047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 0x7feef00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 --2- 172.21.15.96:0/4264691047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef00f59e0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:16.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 -- 172.21.15.96:0/4264691047 >> 172.21.15.96:0/4264691047 conn(0x7feef00f0d40 msgr2=0x7feef00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 -- 172.21.15.96:0/4264691047 shutdown_connections 2022-02-02T20:17:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.947+0000 7feef487e700 1 -- 172.21.15.96:0/4264691047 wait complete. 2022-02-02T20:17:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 Processor -- start 2022-02-02T20:17:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 -- start start 2022-02-02T20:17:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 0x7feef010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0060420 con 0x7feef00f55c0 2022-02-02T20:17:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.948+0000 7feef487e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0060560 con 0x7feef00f6860 2022-02-02T20:17:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36210/0 (socket says 172.21.15.96:36210) 2022-02-02T20:17:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 -- 172.21.15.96:0/3405621348 learned_addr learned my addr 172.21.15.96:0/3405621348 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:16.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeedd9b700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 0x7feef010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 -- 172.21.15.96:0/3405621348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 msgr2=0x7feef010c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 0x7feef010c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 -- 172.21.15.96:0/3405621348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0005040 con 0x7feef00f55c0 2022-02-02T20:17:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feeee59c700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7feee0004f60 tx=0x7feee0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee0018070 con 0x7feef00f55c0 2022-02-02T20:17:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef010c6e0 con 0x7feef00f55c0 2022-02-02T20:17:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feee0007ba0 con 0x7feef00f55c0 2022-02-02T20:17:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee001c620 con 0x7feef00f55c0 2022-02-02T20:17:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.949+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef010cc10 con 0x7feef00f55c0 2022-02-02T20:17:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.950+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef00f49b0 con 0x7feef00f55c0 2022-02-02T20:17:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.951+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feee001c8e0 con 0x7feef00f55c0 2022-02-02T20:17:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.951+0000 7feee6ffd700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 0x7feedc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.951+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feee0083960 con 0x7feef00f55c0 2022-02-02T20:17:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.951+0000 7feeedd9b700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 0x7feedc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:16.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.952+0000 7feeedd9b700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 0x7feedc067290 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7feed8007fd0 tx=0x7feed8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:16.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:16.956+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feee0051b20 con 0x7feef00f55c0 2022-02-02T20:17:17.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.135+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feef00fdec0 con 0x7feedc064dd0 2022-02-02T20:17:17.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.136+0000 7feee6ffd700 1 -- 172.21.15.96:0/3405621348 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7feef00fdec0 con 0x7feedc064dd0 2022-02-02T20:17:17.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.137+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 msgr2=0x7feedc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.137+0000 7feef487e700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 0x7feedc067290 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7feed8007fd0 tx=0x7feed8009040).stop 2022-02-02T20:17:17.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.137+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 msgr2=0x7feef0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.137+0000 7feef487e700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7feee0004f60 tx=0x7feee0009b30).stop 2022-02-02T20:17:17.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 shutdown_connections 2022-02-02T20:17:17.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feedc064dd0 0x7feedc067290 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef00f55c0 0x7feef0109c30 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 --2- 172.21.15.96:0/3405621348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef00f6860 0x7feef010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 >> 172.21.15.96:0/3405621348 conn(0x7feef00f0d40 msgr2=0x7feef00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 shutdown_connections 2022-02-02T20:17:17.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.138+0000 7feef487e700 1 -- 172.21.15.96:0/3405621348 wait complete. 2022-02-02T20:17:17.150 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:17:17.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 -- 172.21.15.96:0/3058566701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f5bb0 msgr2=0x7fe4140f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 --2- 172.21.15.96:0/3058566701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f5bb0 0x7fe4140f5fd0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fe408004660 tx=0x7fe408009b30).stop 2022-02-02T20:17:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 -- 172.21.15.96:0/3058566701 shutdown_connections 2022-02-02T20:17:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 --2- 172.21.15.96:0/3058566701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f64c0 0x7fe4140f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:17:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 --2- 172.21.15.96:0/3058566701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f5bb0 0x7fe4140f5fd0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 -- 172.21.15.96:0/3058566701 >> 172.21.15.96:0/3058566701 conn(0x7fe4140f0540 msgr2=0x7fe4140f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 -- 172.21.15.96:0/3058566701 shutdown_connections 2022-02-02T20:17:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 -- 172.21.15.96:0/3058566701 wait complete. 2022-02-02T20:17:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.236+0000 7fe419324700 1 Processor -- start 2022-02-02T20:17:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 -- start start 2022-02-02T20:17:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f5bb0 0x7fe41410c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140f5570 con 0x7fe4140f64c0 2022-02-02T20:17:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140f56b0 con 0x7fe4140f5bb0 2022-02-02T20:17:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36222/0 (socket says 172.21.15.96:36222) 2022-02-02T20:17:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 -- 172.21.15.96:0/590273688 learned_addr learned my addr 172.21.15.96:0/590273688 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe412ffd700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f5bb0 0x7fe41410c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 -- 172.21.15.96:0/590273688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f5bb0 msgr2=0x7fe41410c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f5bb0 0x7fe41410c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 -- 172.21.15.96:0/590273688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408005040 con 0x7fe4140f64c0 2022-02-02T20:17:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe4127fc700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fe40400b410 tx=0x7fe404006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4040125f0 con 0x7fe4140f64c0 2022-02-02T20:17:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.237+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41410eae0 con 0x7fe4140f64c0 2022-02-02T20:17:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.238+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe40400be30 con 0x7fe4140f64c0 2022-02-02T20:17:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.238+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe404002a70 con 0x7fe4140f64c0 2022-02-02T20:17:17.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.238+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41410efc0 con 0x7fe4140f64c0 2022-02-02T20:17:17.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.239+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4140f41d0 con 0x7fe4140f64c0 2022-02-02T20:17:17.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.239+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe40400f030 con 0x7fe4140f64c0 2022-02-02T20:17:17.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.239+0000 7fe3fb7fe700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 0x7fe3fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.239+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe404081e80 con 0x7fe4140f64c0 2022-02-02T20:17:17.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.239+0000 7fe412ffd700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 0x7fe3fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.240+0000 7fe412ffd700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 0x7fe3fc067290 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe408013690 tx=0x7fe408009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.244+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe40404ff80 con 0x7fe4140f64c0 2022-02-02T20:17:17.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.420+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4140fde80 con 0x7fe3fc064dd0 2022-02-02T20:17:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.429+0000 7fe3fb7fe700 1 -- 172.21.15.96:0/590273688 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fe4140fde80 con 0x7fe3fc064dd0 2022-02-02T20:17:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:17:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 91m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:17:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (113m) 91m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:17:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (113m) 89m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:17:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 91m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:17:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (117m) 91m ago 117m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:17:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (113m) 91m ago 117m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:17:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (117m) 89m ago 117m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:17:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (113m) 89m ago 117m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:17:17.435 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (114m) 91m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:17:17.435 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (114m) 89m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:17:17.435 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (113m) 91m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:17:17.435 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (113m) 89m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:17:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 91m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:17:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 89m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:17:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (112m) 91m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:17:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (112m) 91m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:17:17.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (111m) 91m ago 119m 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:17:17.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (111m) 89m ago 119m 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:17:17.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (110m) 89m ago 119m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:17:17.437 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (110m) 89m ago 119m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:17:17.438 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 91m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:17:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 msgr2=0x7fe3fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 0x7fe3fc067290 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe408013690 tx=0x7fe408009b30).stop 2022-02-02T20:17:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 msgr2=0x7fe41410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fe40400b410 tx=0x7fe404006ef0).stop 2022-02-02T20:17:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 shutdown_connections 2022-02-02T20:17:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe3fc064dd0 0x7fe3fc067290 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4140f5bb0 0x7fe41410c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 --2- 172.21.15.96:0/590273688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4140f64c0 0x7fe41410e5f0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 >> 172.21.15.96:0/590273688 conn(0x7fe4140f0540 msgr2=0x7fe4140fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.431+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 shutdown_connections 2022-02-02T20:17:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.432+0000 7fe419324700 1 -- 172.21.15.96:0/590273688 wait complete. 2022-02-02T20:17:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 -- 172.21.15.96:0/4151048646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f55c0 msgr2=0x7f4cdc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 --2- 172.21.15.96:0/4151048646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc0f59e0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f4ccc004660 tx=0x7f4ccc009b30).stop 2022-02-02T20:17:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 -- 172.21.15.96:0/4151048646 shutdown_connections 2022-02-02T20:17:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 --2- 172.21.15.96:0/4151048646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:17:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 --2- 172.21.15.96:0/4151048646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc0f59e0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 -- 172.21.15.96:0/4151048646 >> 172.21.15.96:0/4151048646 conn(0x7f4cdc0f0d40 msgr2=0x7f4cdc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 -- 172.21.15.96:0/4151048646 shutdown_connections 2022-02-02T20:17:17.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 -- 172.21.15.96:0/4151048646 wait complete. 2022-02-02T20:17:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.528+0000 7f4ce4349700 1 Processor -- start 2022-02-02T20:17:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce4349700 1 -- start start 2022-02-02T20:17:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce4349700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce4349700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce4349700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0604b0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce4349700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0605f0 con 0x7f4cdc0f55c0 2022-02-02T20:17:17.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36230/0 (socket says 172.21.15.96:36230) 2022-02-02T20:17:17.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 -- 172.21.15.96:0/2735908339 learned_addr learned my addr 172.21.15.96:0/2735908339 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce20e5700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 -- 172.21.15.96:0/2735908339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f55c0 msgr2=0x7f4cdc109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 -- 172.21.15.96:0/2735908339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc005040 con 0x7f4cdc0f6860 2022-02-02T20:17:17.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.529+0000 7f4ce18e4700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4cd800b410 tx=0x7f4cd8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.530+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cd80125f0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.530+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cd800be30 con 0x7f4cdc0f6860 2022-02-02T20:17:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.530+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc10c7e0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.530+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cd8002a70 con 0x7f4cdc0f6860 2022-02-02T20:17:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.530+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc10cda0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.531+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cd800f030 con 0x7f4cdc0f6860 2022-02-02T20:17:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.531+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc045ad0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.531+0000 7f4cd2ffd700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 0x7f4cc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.532+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4cd8081ab0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.532+0000 7f4ce20e5700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 0x7f4cc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.532+0000 7f4ce20e5700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 0x7f4cc8067290 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f4ccc013690 tx=0x7f4ccc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.536+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cd804fb90 con 0x7f4cdc0f6860 2022-02-02T20:17:17.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.768+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4cdc027a00 con 0x7f4cdc0f6860 2022-02-02T20:17:17.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.769+0000 7f4cd2ffd700 1 -- 172.21.15.96:0/2735908339 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4cd80531b0 con 0x7f4cdc0f6860 2022-02-02T20:17:17.772 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:17:17.772 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:17:17.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:17:17.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:17.773 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:17:17.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:17:17.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:17.774 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:17:17.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:17:17.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:17.775 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:17:17.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:17:17.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:17.775 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:17:17.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:17:17.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:17:17.776 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:17:17.776 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:17:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 msgr2=0x7f4cc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 0x7f4cc8067290 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f4ccc013690 tx=0x7f4ccc009b30).stop 2022-02-02T20:17:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 msgr2=0x7f4cdc10c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4cd800b410 tx=0x7f4cd8006ef0).stop 2022-02-02T20:17:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 shutdown_connections 2022-02-02T20:17:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc8064dd0 0x7f4cc8067290 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc0f55c0 0x7f4cdc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 --2- 172.21.15.96:0/2735908339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0f6860 0x7f4cdc10c180 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.770+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 >> 172.21.15.96:0/2735908339 conn(0x7f4cdc0f0d40 msgr2=0x7f4cdc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.771+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 shutdown_connections 2022-02-02T20:17:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.771+0000 7f4ce4349700 1 -- 172.21.15.96:0/2735908339 wait complete. 2022-02-02T20:17:17.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:17 smithi096 ceph-mon[101353]: pgmap v3456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:17.953 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:17 smithi096 ceph-mon[101353]: from='client.37654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:17.954 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:17 smithi096 ceph-mon[101353]: from='client.37658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 -- 172.21.15.96:0/1846369261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 msgr2=0x7ff8280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 --2- 172.21.15.96:0/1846369261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff8280f6b00 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7ff818004660 tx=0x7ff818009b30).stop 2022-02-02T20:17:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 -- 172.21.15.96:0/1846369261 shutdown_connections 2022-02-02T20:17:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 --2- 172.21.15.96:0/1846369261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff8280f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:17:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 --2- 172.21.15.96:0/1846369261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff8280f6b00 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 -- 172.21.15.96:0/1846369261 >> 172.21.15.96:0/1846369261 conn(0x7ff8280f1e40 msgr2=0x7ff8280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 -- 172.21.15.96:0/1846369261 shutdown_connections 2022-02-02T20:17:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.868+0000 7ff82f332700 1 -- 172.21.15.96:0/1846369261 wait complete. 2022-02-02T20:17:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 Processor -- start 2022-02-02T20:17:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 -- start start 2022-02-02T20:17:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff828069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82806a410 con 0x7ff8280f66e0 2022-02-02T20:17:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82f332700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82806a550 con 0x7ff8280f7980 2022-02-02T20:17:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36238/0 (socket says 172.21.15.96:36238) 2022-02-02T20:17:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 -- 172.21.15.96:0/3801982123 learned_addr learned my addr 172.21.15.96:0/3801982123 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 -- 172.21.15.96:0/3801982123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 msgr2=0x7ff828069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82c8cd700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff828069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff828069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82d0ce700 1 -- 172.21.15.96:0/3801982123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818005040 con 0x7ff8280f66e0 2022-02-02T20:17:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.869+0000 7ff82c8cd700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff828069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:17:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff82d0ce700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7ff818004f60 tx=0x7ff818009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff818018070 con 0x7ff8280f66e0 2022-02-02T20:17:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff818007ba0 con 0x7ff8280f66e0 2022-02-02T20:17:17.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82806a7d0 con 0x7ff8280f66e0 2022-02-02T20:17:17.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff81801c620 con 0x7ff8280f66e0 2022-02-02T20:17:17.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.870+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82810efe0 con 0x7ff8280f66e0 2022-02-02T20:17:17.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.871+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff828045ad0 con 0x7ff8280f66e0 2022-02-02T20:17:17.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.872+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff81801c8e0 con 0x7ff8280f66e0 2022-02-02T20:17:17.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.872+0000 7ff81dffb700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 0x7ff814067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:17.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.872+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff818083960 con 0x7ff8280f66e0 2022-02-02T20:17:17.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.872+0000 7ff82c8cd700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 0x7ff814067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:17.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.872+0000 7ff82c8cd700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 0x7ff814067290 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff82400a880 tx=0x7ff824008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:17.876+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff818051a60 con 0x7ff8280f66e0 2022-02-02T20:17:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:17 smithi159 ceph-mon[69013]: pgmap v3456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:18.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:17 smithi159 ceph-mon[69013]: from='client.37654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:18.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:17 smithi159 ceph-mon[69013]: from='client.37658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:18.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.075+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8280ff030 con 0x7ff8280f66e0 2022-02-02T20:17:18.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.076+0000 7ff81dffb700 1 -- 172.21.15.96:0/3801982123 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff818055080 con 0x7ff8280f66e0 2022-02-02T20:17:18.080 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:17:18.081 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:17:18.081 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:17:18.081 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:17:18.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:18.082 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:17:18.082 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:17:18.082 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:17:18.082 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:17:18.083 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:17:18.083 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:17:18.083 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:17:18.083 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:17:18.084 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:17:18.084 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:17:18.084 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:17:18.084 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:17:18.084 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:17:18.085 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:17:18.085 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:17:18.085 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:17:18.085 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:17:18.086 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:17:18.086 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:17:18.086 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:17:18.086 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:17:18.087 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:17:18.087 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:17:18.087 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:17:18.087 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:17:18.087 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:17:18.088 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:17:18.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:18.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:18.088 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:17:18.089 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:18.089 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:18.089 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:18.089 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:18.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 msgr2=0x7ff814067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:18.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 0x7ff814067290 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff82400a880 tx=0x7ff824008040).stop 2022-02-02T20:17:18.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 msgr2=0x7ff82806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:18.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7ff818004f60 tx=0x7ff818009b30).stop 2022-02-02T20:17:18.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 shutdown_connections 2022-02-02T20:17:18.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff814064dd0 0x7ff814067290 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:18.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8280f66e0 0x7ff82806b9a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:18.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 --2- 172.21.15.96:0/3801982123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8280f7980 0x7ff828069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:18.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 >> 172.21.15.96:0/3801982123 conn(0x7ff8280f1e40 msgr2=0x7ff8280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:18.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 shutdown_connections 2022-02-02T20:17:18.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:18.078+0000 7ff82f332700 1 -- 172.21.15.96:0/3801982123 wait complete. 2022-02-02T20:17:18.093 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:17:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2735908339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:17:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3801982123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:17:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2735908339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:17:19.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3801982123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:17:20.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:19 smithi159 ceph-mon[69013]: pgmap v3457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:19 smithi096 ceph-mon[101353]: pgmap v3457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:22.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:22 smithi159 ceph-mon[69013]: pgmap v3458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:22.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:22 smithi096 ceph-mon[101353]: pgmap v3458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:24.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:24 smithi159 ceph-mon[69013]: pgmap v3459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:24.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:24 smithi096 ceph-mon[101353]: pgmap v3459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:26.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:26 smithi159 ceph-mon[69013]: pgmap v3460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:26.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:26 smithi096 ceph-mon[101353]: pgmap v3460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:27 smithi159 ceph-mon[69013]: pgmap v3461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:17:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:17:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:27 smithi096 ceph-mon[101353]: pgmap v3461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:17:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:17:30.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:30 smithi159 ceph-mon[69013]: pgmap v3462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:30.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:30 smithi096 ceph-mon[101353]: pgmap v3462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:32.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:32 smithi159 ceph-mon[69013]: pgmap v3463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:32 smithi096 ceph-mon[101353]: pgmap v3463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:34.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:34 smithi159 ceph-mon[69013]: pgmap v3464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:34 smithi096 ceph-mon[101353]: pgmap v3464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:36.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:36 smithi159 ceph-mon[69013]: pgmap v3465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:36.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:36 smithi096 ceph-mon[101353]: pgmap v3465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:37 smithi159 ceph-mon[69013]: pgmap v3466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:38.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:37 smithi096 ceph-mon[101353]: pgmap v3466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:40 smithi159 ceph-mon[69013]: pgmap v3467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:40 smithi096 ceph-mon[101353]: pgmap v3467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:42 smithi159 ceph-mon[69013]: pgmap v3468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:42 smithi096 ceph-mon[101353]: pgmap v3468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:44 smithi159 ceph-mon[69013]: pgmap v3469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:44 smithi096 ceph-mon[101353]: pgmap v3469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:46.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:46 smithi096 ceph-mon[101353]: pgmap v3470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:46 smithi159 ceph-mon[69013]: pgmap v3470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:47 smithi159 ceph-mon[69013]: pgmap v3471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:47 smithi096 ceph-mon[101353]: pgmap v3471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:48.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- 172.21.15.96:0/933324704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 msgr2=0x7fc5f00f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/933324704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f00f6f00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fc5ec004660 tx=0x7fc5ec009b30).stop 2022-02-02T20:17:48.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- 172.21.15.96:0/933324704 shutdown_connections 2022-02-02T20:17:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/933324704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 0x7fc5f00f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/933324704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f00f6f00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- 172.21.15.96:0/933324704 >> 172.21.15.96:0/933324704 conn(0x7fc5f00f0b90 msgr2=0x7fc5f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- 172.21.15.96:0/933324704 shutdown_connections 2022-02-02T20:17:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- 172.21.15.96:0/933324704 wait complete. 2022-02-02T20:17:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 Processor -- start 2022-02-02T20:17:48.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.189+0000 7fc5f6f07700 1 -- start start 2022-02-02T20:17:48.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f6f07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f6f07700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 0x7fc5f010d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f6f07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f010de00 con 0x7fc5f0060310 2022-02-02T20:17:48.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f6f07700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f010df40 con 0x7fc5f00f7480 2022-02-02T20:17:48.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36254/0 (socket says 172.21.15.96:36254) 2022-02-02T20:17:48.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 -- 172.21.15.96:0/214811739 learned_addr learned my addr 172.21.15.96:0/214811739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:48.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5704700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 0x7fc5f010d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 -- 172.21.15.96:0/214811739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 msgr2=0x7fc5f010d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 0x7fc5f010d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 -- 172.21.15.96:0/214811739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec005040 con 0x7fc5f0060310 2022-02-02T20:17:48.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f5f05700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7fc5ec009990 tx=0x7fc5ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec018070 con 0x7fc5f0060310 2022-02-02T20:17:48.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5ec007ca0 con 0x7fc5f0060310 2022-02-02T20:17:48.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.190+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f010e880 con 0x7fc5f0060310 2022-02-02T20:17:48.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.191+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec01c620 con 0x7fc5f0060310 2022-02-02T20:17:48.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.191+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f010ede0 con 0x7fc5f0060310 2022-02-02T20:17:48.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.191+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f0045ad0 con 0x7fc5f0060310 2022-02-02T20:17:48.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.192+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc5ec01d960 con 0x7fc5f0060310 2022-02-02T20:17:48.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.192+0000 7fc5e67fc700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 0x7fc5dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.192+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc5ec0837d0 con 0x7fc5f0060310 2022-02-02T20:17:48.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.192+0000 7fc5f5704700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 0x7fc5dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.193+0000 7fc5f5704700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 0x7fc5dc0672e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fc5e00041d0 tx=0x7fc5e0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.197+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc5ec055470 con 0x7fc5f0060310 2022-02-02T20:17:48.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.375+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5f00008d0 con 0x7fc5dc064e20 2022-02-02T20:17:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.376+0000 7fc5e67fc700 1 -- 172.21.15.96:0/214811739 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5f00008d0 con 0x7fc5dc064e20 2022-02-02T20:17:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.378+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 msgr2=0x7fc5dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.378+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 0x7fc5dc0672e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fc5e00041d0 tx=0x7fc5e0009040).stop 2022-02-02T20:17:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.378+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 msgr2=0x7fc5f010d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.378+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7fc5ec009990 tx=0x7fc5ec009b30).stop 2022-02-02T20:17:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 shutdown_connections 2022-02-02T20:17:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5dc064e20 0x7fc5dc0672e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0060310 0x7fc5f010d360 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 --2- 172.21.15.96:0/214811739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f00f7480 0x7fc5f010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 >> 172.21.15.96:0/214811739 conn(0x7fc5f00f0b90 msgr2=0x7fc5f00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 shutdown_connections 2022-02-02T20:17:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.379+0000 7fc5f6f07700 1 -- 172.21.15.96:0/214811739 wait complete. 2022-02-02T20:17:48.390 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:17:48.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 -- 172.21.15.96:0/3144585392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 msgr2=0x7fc4c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 --2- 172.21.15.96:0/3144585392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c80f6cc0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fc4b8004660 tx=0x7fc4b8009b30).stop 2022-02-02T20:17:48.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 -- 172.21.15.96:0/3144585392 shutdown_connections 2022-02-02T20:17:48.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 --2- 172.21.15.96:0/3144585392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c80f6cc0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 --2- 172.21.15.96:0/3144585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 0x7fc4c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 -- 172.21.15.96:0/3144585392 >> 172.21.15.96:0/3144585392 conn(0x7fc4c80f0d40 msgr2=0x7fc4c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:48.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 -- 172.21.15.96:0/3144585392 shutdown_connections 2022-02-02T20:17:48.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.476+0000 7fc4cc922700 1 -- 172.21.15.96:0/3144585392 wait complete. 2022-02-02T20:17:48.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 Processor -- start 2022-02-02T20:17:48.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 -- start start 2022-02-02T20:17:48.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 0x7fc4c8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81069b0 con 0x7fc4c80f6860 2022-02-02T20:17:48.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4cc922700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81071c0 con 0x7fc4c80f55c0 2022-02-02T20:17:48.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4c5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4c5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36266/0 (socket says 172.21.15.96:36266) 2022-02-02T20:17:48.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4c5d9b700 1 -- 172.21.15.96:0/1532187395 learned_addr learned my addr 172.21.15.96:0/1532187395 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:48.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.477+0000 7fc4c659c700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 0x7fc4c8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4c5d9b700 1 -- 172.21.15.96:0/1532187395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 msgr2=0x7fc4c8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4c5d9b700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 0x7fc4c8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4c5d9b700 1 -- 172.21.15.96:0/1532187395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b8005040 con 0x7fc4c80f6860 2022-02-02T20:17:48.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4c5d9b700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fc4b8009990 tx=0x7fc4b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4b8018070 con 0x7fc4c80f6860 2022-02-02T20:17:48.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c81073e0 con 0x7fc4c80f6860 2022-02-02T20:17:48.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc4b8007ba0 con 0x7fc4c80f6860 2022-02-02T20:17:48.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4b801c3c0 con 0x7fc4c80f6860 2022-02-02T20:17:48.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.478+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c8107860 con 0x7fc4c80f6860 2022-02-02T20:17:48.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.479+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8045ad0 con 0x7fc4c80f6860 2022-02-02T20:17:48.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.480+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc4b801d420 con 0x7fc4c80f6860 2022-02-02T20:17:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.480+0000 7fc4beffd700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 0x7fc4b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.480+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc4b80835b0 con 0x7fc4c80f6860 2022-02-02T20:17:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.480+0000 7fc4c659c700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 0x7fc4b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.480+0000 7fc4c659c700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 0x7fc4b4067290 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fc4c8105c30 tx=0x7fc4b000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.484+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc4b8051710 con 0x7fc4c80f6860 2022-02-02T20:17:48.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.659+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4c80ff800 con 0x7fc4b4064dd0 2022-02-02T20:17:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.668+0000 7fc4beffd700 1 -- 172.21.15.96:0/1532187395 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fc4c80ff800 con 0x7fc4b4064dd0 2022-02-02T20:17:48.670 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:17:48.672 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 91m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:17:48.673 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (113m) 91m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:17:48.673 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (113m) 90m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:17:48.673 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 91m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:17:48.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (118m) 91m ago 118m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:17:48.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (113m) 91m ago 118m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:17:48.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (118m) 90m ago 118m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:17:48.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (114m) 90m ago 118m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:17:48.675 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (115m) 91m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:17:48.675 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (114m) 90m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:17:48.675 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (114m) 91m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:17:48.675 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (114m) 90m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:17:48.676 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 91m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:17:48.676 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 90m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:17:48.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (113m) 91m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:17:48.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (112m) 91m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:17:48.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (112m) 91m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:17:48.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (111m) 90m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:17:48.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (111m) 90m ago 119m 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:17:48.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (110m) 90m ago 119m 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:17:48.677 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 91m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:17:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 msgr2=0x7fc4b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 0x7fc4b4067290 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fc4c8105c30 tx=0x7fc4b000b040).stop 2022-02-02T20:17:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 msgr2=0x7fc4c81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fc4b8009990 tx=0x7fc4b8009b30).stop 2022-02-02T20:17:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 shutdown_connections 2022-02-02T20:17:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc4b4064dd0 0x7fc4b4067290 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c80f55c0 0x7fc4c8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 --2- 172.21.15.96:0/1532187395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4c80f6860 0x7fc4c81063b0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 >> 172.21.15.96:0/1532187395 conn(0x7fc4c80f0d40 msgr2=0x7fc4c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 shutdown_connections 2022-02-02T20:17:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.670+0000 7fc4cc922700 1 -- 172.21.15.96:0/1532187395 wait complete. 2022-02-02T20:17:48.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 -- 172.21.15.96:0/2860405679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 msgr2=0x7f71c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 --2- 172.21.15.96:0/2860405679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c80f6cc0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f71c4004660 tx=0x7f71c4009b30).stop 2022-02-02T20:17:48.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 -- 172.21.15.96:0/2860405679 shutdown_connections 2022-02-02T20:17:48.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 --2- 172.21.15.96:0/2860405679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c80f6cc0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 --2- 172.21.15.96:0/2860405679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 -- 172.21.15.96:0/2860405679 >> 172.21.15.96:0/2860405679 conn(0x7f71c80f0d40 msgr2=0x7f71c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:48.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 -- 172.21.15.96:0/2860405679 shutdown_connections 2022-02-02T20:17:48.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.766+0000 7f71d07e5700 1 -- 172.21.15.96:0/2860405679 wait complete. 2022-02-02T20:17:48.799 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:48 smithi096 ceph-mon[101353]: from='client.37670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:48.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 Processor -- start 2022-02-02T20:17:48.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 -- start start 2022-02-02T20:17:48.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80603e0 con 0x7f71c80f6860 2022-02-02T20:17:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71d07e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8060520 con 0x7f71c80f55c0 2022-02-02T20:17:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71cdd80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71cdd80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36276/0 (socket says 172.21.15.96:36276) 2022-02-02T20:17:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71cdd80700 1 -- 172.21.15.96:0/810974107 learned_addr learned my addr 172.21.15.96:0/810974107 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:48.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.767+0000 7f71ce581700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71cdd80700 1 -- 172.21.15.96:0/810974107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 msgr2=0x7f71c8109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:48.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71cdd80700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:48.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71cdd80700 1 -- 172.21.15.96:0/810974107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4005040 con 0x7f71c80f6860 2022-02-02T20:17:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71cdd80700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f71c4009990 tx=0x7f71c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c4018070 con 0x7f71c80f6860 2022-02-02T20:17:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71c4007ca0 con 0x7f71c80f6860 2022-02-02T20:17:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c810c6a0 con 0x7f71c80f6860 2022-02-02T20:17:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c810cc00 con 0x7f71c80f6860 2022-02-02T20:17:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.768+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c401c620 con 0x7f71c80f6860 2022-02-02T20:17:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.769+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b0004fa0 con 0x7f71c80f6860 2022-02-02T20:17:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.770+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71c401d420 con 0x7f71c80f6860 2022-02-02T20:17:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.770+0000 7f71baffd700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 0x7f71b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.770+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71c4083730 con 0x7f71c80f6860 2022-02-02T20:17:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.770+0000 7f71ce581700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 0x7f71b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.771+0000 7f71ce581700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 0x7f71b4067290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f71c8060060 tx=0x7f71bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:48.774+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71c40518f0 con 0x7f71c80f6860 2022-02-02T20:17:49.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.008+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71b0005e80 con 0x7f71c80f6860 2022-02-02T20:17:49.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.008+0000 7f71baffd700 1 -- 172.21.15.96:0/810974107 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f71c4054f10 con 0x7f71c80f6860 2022-02-02T20:17:49.011 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:17:49.011 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:17:49.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:17:49.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:49.012 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:17:49.012 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:17:49.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:49.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:17:49.013 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:17:49.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:49.013 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:17:49.014 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:17:49.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:17:49.014 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:17:49.014 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:17:49.014 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:17:49.015 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:17:49.015 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:17:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 msgr2=0x7f71b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 0x7f71b4067290 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f71c8060060 tx=0x7f71bc009040).stop 2022-02-02T20:17:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 msgr2=0x7f71c810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f71c4009990 tx=0x7f71c4009b30).stop 2022-02-02T20:17:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 shutdown_connections 2022-02-02T20:17:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064dd0 0x7f71b4067290 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 --2- 172.21.15.96:0/810974107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c810c150 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 >> 172.21.15.96:0/810974107 conn(0x7f71c80f0d40 msgr2=0x7f71c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 shutdown_connections 2022-02-02T20:17:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.010+0000 7f71d07e5700 1 -- 172.21.15.96:0/810974107 wait complete. 2022-02-02T20:17:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:48 smithi159 ceph-mon[69013]: from='client.37670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:49.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 -- 172.21.15.96:0/2732139097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f6870 msgr2=0x7f61f00f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 --2- 172.21.15.96:0/2732139097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f6870 0x7f61f00f6cd0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f61e0004660 tx=0x7f61e0009b30).stop 2022-02-02T20:17:49.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 -- 172.21.15.96:0/2732139097 shutdown_connections 2022-02-02T20:17:49.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 --2- 172.21.15.96:0/2732139097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f6870 0x7f61f00f6cd0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 --2- 172.21.15.96:0/2732139097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f55d0 0x7f61f00f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 -- 172.21.15.96:0/2732139097 >> 172.21.15.96:0/2732139097 conn(0x7f61f00f0d70 msgr2=0x7f61f00f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:49.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 -- 172.21.15.96:0/2732139097 shutdown_connections 2022-02-02T20:17:49.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.107+0000 7f61f5072700 1 -- 172.21.15.96:0/2732139097 wait complete. 2022-02-02T20:17:49.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 Processor -- start 2022-02-02T20:17:49.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 -- start start 2022-02-02T20:17:49.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:49.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f6870 0x7f61f01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:49.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0106960 con 0x7f61f00f55d0 2022-02-02T20:17:49.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61f5072700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0107160 con 0x7f61f00f6870 2022-02-02T20:17:49.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:49.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36284/0 (socket says 172.21.15.96:36284) 2022-02-02T20:17:49.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61eed9d700 1 -- 172.21.15.96:0/3872771341 learned_addr learned my addr 172.21.15.96:0/3872771341 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:17:49.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.108+0000 7f61ee59c700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f6870 0x7f61f01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:49.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61eed9d700 1 -- 172.21.15.96:0/3872771341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f6870 msgr2=0x7f61f01063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61eed9d700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f6870 0x7f61f01063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61eed9d700 1 -- 172.21.15.96:0/3872771341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0005040 con 0x7f61f00f55d0 2022-02-02T20:17:49.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61eed9d700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f61e400c790 tx=0x7f61e4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:49.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e400e680 con 0x7f61f00f55d0 2022-02-02T20:17:49.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61e400ec90 con 0x7f61f00f55d0 2022-02-02T20:17:49.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e4012d00 con 0x7f61f00f55d0 2022-02-02T20:17:49.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f0107440 con 0x7f61f00f55d0 2022-02-02T20:17:49.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.109+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f01079b0 con 0x7f61f00f55d0 2022-02-02T20:17:49.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.110+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00f49c0 con 0x7f61f00f55d0 2022-02-02T20:17:49.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.111+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f61e4010070 con 0x7f61f00f55d0 2022-02-02T20:17:49.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.111+0000 7f61d77fe700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 0x7f61d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:17:49.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.111+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f61e4081b30 con 0x7f61f00f55d0 2022-02-02T20:17:49.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.111+0000 7f61ee59c700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 0x7f61d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:17:49.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.111+0000 7f61ee59c700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 0x7f61d8067290 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f61e0004e30 tx=0x7f61e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:17:49.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.115+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f61e4053660 con 0x7f61f00f55d0 2022-02-02T20:17:49.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.317+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f61f00fde50 con 0x7f61f00f55d0 2022-02-02T20:17:49.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.318+0000 7f61d77fe700 1 -- 172.21.15.96:0/3872771341 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f61e4053250 con 0x7f61f00f55d0 2022-02-02T20:17:49.320 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:17:49.320 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:17:49.321 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:17:49.321 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:17:49.321 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:49.321 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:17:49.322 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:17:49.322 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:17:49.322 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:17:49.322 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:17:49.323 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:17:49.323 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:17:49.323 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:17:49.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:17:49.324 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:17:49.324 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:17:49.324 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:17:49.324 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:17:49.325 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:17:49.325 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:17:49.325 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:17:49.326 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:17:49.326 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:17:49.326 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:17:49.326 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:17:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:17:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:17:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:17:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:17:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:17:49.328 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:17:49.328 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:17:49.328 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:49.328 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:49.329 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:17:49.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:17:49.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:49.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:49.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:17:49.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 msgr2=0x7f61d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 0x7f61d8067290 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f61e0004e30 tx=0x7f61e0009b30).stop 2022-02-02T20:17:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 msgr2=0x7f61f0105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:17:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f61e400c790 tx=0x7f61e4007d90).stop 2022-02-02T20:17:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 shutdown_connections 2022-02-02T20:17:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f61d8064dd0 0x7f61d8067290 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61f00f55d0 0x7f61f0105ec0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 --2- 172.21.15.96:0/3872771341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61f00f6870 0x7f61f01063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:17:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.319+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 >> 172.21.15.96:0/3872771341 conn(0x7f61f00f0d70 msgr2=0x7f61f00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:17:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.320+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 shutdown_connections 2022-02-02T20:17:49.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:17:49.320+0000 7f61f5072700 1 -- 172.21.15.96:0/3872771341 wait complete. 2022-02-02T20:17:49.333 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:17:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:49 smithi159 ceph-mon[69013]: from='client.37674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:50.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:49 smithi159 ceph-mon[69013]: pgmap v3472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:50.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/810974107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:17:50.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3872771341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:17:50.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:49 smithi096 ceph-mon[101353]: from='client.37674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:17:50.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:49 smithi096 ceph-mon[101353]: pgmap v3472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:50.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/810974107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:17:50.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3872771341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:17:52.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:52 smithi159 ceph-mon[69013]: pgmap v3473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:52 smithi096 ceph-mon[101353]: pgmap v3473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:54 smithi159 ceph-mon[69013]: pgmap v3474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:54 smithi096 ceph-mon[101353]: pgmap v3474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:56 smithi096 ceph-mon[101353]: pgmap v3475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:56 smithi159 ceph-mon[69013]: pgmap v3475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:17:57 smithi159 ceph-mon[69013]: pgmap v3476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:17:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:17:57 smithi096 ceph-mon[101353]: pgmap v3476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:00.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:00 smithi159 ceph-mon[69013]: pgmap v3477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:00 smithi096 ceph-mon[101353]: pgmap v3477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:02 smithi096 ceph-mon[101353]: pgmap v3478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:02 smithi159 ceph-mon[69013]: pgmap v3478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:04 smithi096 ceph-mon[101353]: pgmap v3479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:04 smithi159 ceph-mon[69013]: pgmap v3479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:06 smithi096 ceph-mon[101353]: pgmap v3480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:06 smithi159 ceph-mon[69013]: pgmap v3480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:08.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:07 smithi159 ceph-mon[69013]: pgmap v3481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:07 smithi096 ceph-mon[101353]: pgmap v3481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:10 smithi096 ceph-mon[101353]: pgmap v3482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:10 smithi159 ceph-mon[69013]: pgmap v3482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:12 smithi096 ceph-mon[101353]: pgmap v3483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:12 smithi159 ceph-mon[69013]: pgmap v3483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:14 smithi096 ceph-mon[101353]: pgmap v3484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:14 smithi159 ceph-mon[69013]: pgmap v3484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:16 smithi096 ceph-mon[101353]: pgmap v3485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:16 smithi159 ceph-mon[69013]: pgmap v3485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:17 smithi159 ceph-mon[69013]: pgmap v3486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:17 smithi096 ceph-mon[101353]: pgmap v3486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 -- 172.21.15.96:0/378182794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 msgr2=0x7f90700f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 --2- 172.21.15.96:0/378182794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f90700f5fd0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f9064004660 tx=0x7f9064009b30).stop 2022-02-02T20:18:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 -- 172.21.15.96:0/378182794 shutdown_connections 2022-02-02T20:18:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 --2- 172.21.15.96:0/378182794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 0x7f90700f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 --2- 172.21.15.96:0/378182794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f90700f5fd0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 -- 172.21.15.96:0/378182794 >> 172.21.15.96:0/378182794 conn(0x7f90700f04c0 msgr2=0x7f90700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:19.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 -- 172.21.15.96:0/378182794 shutdown_connections 2022-02-02T20:18:19.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.430+0000 7f9075171700 1 -- 172.21.15.96:0/378182794 wait complete. 2022-02-02T20:18:19.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 Processor -- start 2022-02-02T20:18:19.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 -- start start 2022-02-02T20:18:19.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 0x7f907010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700f5570 con 0x7f90700f5bb0 2022-02-02T20:18:19.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f9075171700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700f56b0 con 0x7f90700f6550 2022-02-02T20:18:19.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:19.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36302/0 (socket says 172.21.15.96:36302) 2022-02-02T20:18:19.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 -- 172.21.15.96:0/709772058 learned_addr learned my addr 172.21.15.96:0/709772058 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906e59c700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 0x7f907010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 -- 172.21.15.96:0/709772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 msgr2=0x7f907010e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 0x7f907010e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.431+0000 7f906ed9d700 1 -- 172.21.15.96:0/709772058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064005040 con 0x7f90700f5bb0 2022-02-02T20:18:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f906ed9d700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f9064013a70 tx=0x7f9064009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9064018070 con 0x7f90700f5bb0 2022-02-02T20:18:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90640097d0 con 0x7f90700f5bb0 2022-02-02T20:18:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907010eaa0 con 0x7f90700f5bb0 2022-02-02T20:18:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906401de80 con 0x7f90700f5bb0 2022-02-02T20:18:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.432+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907010ee70 con 0x7f90700f5bb0 2022-02-02T20:18:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.433+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070045ad0 con 0x7f90700f5bb0 2022-02-02T20:18:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.433+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9064007ba0 con 0x7f90700f5bb0 2022-02-02T20:18:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.434+0000 7f90577fe700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 0x7f9058067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.434+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9064083650 con 0x7f90700f5bb0 2022-02-02T20:18:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.434+0000 7f906e59c700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 0x7f9058067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.434+0000 7f906e59c700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 0x7f9058067290 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f9060004c40 tx=0x7f906000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.438+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9064051750 con 0x7f90700f5bb0 2022-02-02T20:18:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.615+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9070057f10 con 0x7f9058064dd0 2022-02-02T20:18:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.616+0000 7f90577fe700 1 -- 172.21.15.96:0/709772058 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9070057f10 con 0x7f9058064dd0 2022-02-02T20:18:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 msgr2=0x7f9058067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 0x7f9058067290 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f9060004c40 tx=0x7f906000b040).stop 2022-02-02T20:18:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 msgr2=0x7f907010c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f9064013a70 tx=0x7f9064009b30).stop 2022-02-02T20:18:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 shutdown_connections 2022-02-02T20:18:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9058064dd0 0x7f9058067290 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f5bb0 0x7f907010c0b0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 --2- 172.21.15.96:0/709772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f6550 0x7f907010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 >> 172.21.15.96:0/709772058 conn(0x7f90700f04c0 msgr2=0x7f90700fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:19.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 shutdown_connections 2022-02-02T20:18:19.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.618+0000 7f9075171700 1 -- 172.21.15.96:0/709772058 wait complete. 2022-02-02T20:18:19.630 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:18:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 -- 172.21.15.96:0/3248880080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 msgr2=0x7fa8ec0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 --2- 172.21.15.96:0/3248880080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec0f7de0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fa8d4004660 tx=0x7fa8d4009b30).stop 2022-02-02T20:18:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 -- 172.21.15.96:0/3248880080 shutdown_connections 2022-02-02T20:18:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 --2- 172.21.15.96:0/3248880080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec0f7de0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 --2- 172.21.15.96:0/3248880080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 -- 172.21.15.96:0/3248880080 >> 172.21.15.96:0/3248880080 conn(0x7fa8ec0f1e40 msgr2=0x7fa8ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:19.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 -- 172.21.15.96:0/3248880080 shutdown_connections 2022-02-02T20:18:19.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.715+0000 7fa8f2851700 1 -- 172.21.15.96:0/3248880080 wait complete. 2022-02-02T20:18:19.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 Processor -- start 2022-02-02T20:18:19.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 -- start start 2022-02-02T20:18:19.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec107a00 con 0x7fa8ec0f7980 2022-02-02T20:18:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8f2851700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec107b40 con 0x7fa8ec0f66e0 2022-02-02T20:18:19.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:19.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36312/0 (socket says 172.21.15.96:36312) 2022-02-02T20:18:19.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.716+0000 7fa8eb7fe700 1 -- 172.21.15.96:0/2909001460 learned_addr learned my addr 172.21.15.96:0/2909001460 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:19.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8eb7fe700 1 -- 172.21.15.96:0/2909001460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ec0f66e0 msgr2=0x7fa8ec106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8eb7fe700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:18:19.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8eb7fe700 1 -- 172.21.15.96:0/2909001460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4005040 con 0x7fa8ec0f7980 2022-02-02T20:18:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8eb7fe700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7fa8d4009990 tx=0x7fa8d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d4018070 con 0x7fa8ec0f7980 2022-02-02T20:18:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa8d4007ba0 con 0x7fa8ec0f7980 2022-02-02T20:18:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d401c3c0 con 0x7fa8ec0f7980 2022-02-02T20:18:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec108480 con 0x7fa8ec0f7980 2022-02-02T20:18:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.717+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec1089e0 con 0x7fa8ec0f7980 2022-02-02T20:18:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.718+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec045ad0 con 0x7fa8ec0f7980 2022-02-02T20:18:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.719+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa8d401d420 con 0x7fa8ec0f7980 2022-02-02T20:18:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.719+0000 7fa8e8ff9700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 0x7fa8d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.719+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8d4083760 con 0x7fa8ec0f7980 2022-02-02T20:18:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.719+0000 7fa8ebfff700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 0x7fa8d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.720+0000 7fa8ebfff700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 0x7fa8d8067290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fa8ec0f77e0 tx=0x7fa8dc0099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.724+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8d4055170 con 0x7fa8ec0f7980 2022-02-02T20:18:19.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.896+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8ec0fefe0 con 0x7fa8d8064dd0 2022-02-02T20:18:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.905+0000 7fa8e8ff9700 1 -- 172.21.15.96:0/2909001460 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fa8ec0fefe0 con 0x7fa8d8064dd0 2022-02-02T20:18:19.907 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:18:19.908 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 92m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:18:19.908 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (114m) 92m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:18:19.908 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (114m) 90m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:18:19.908 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 92m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:18:19.908 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (118m) 92m ago 118m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:18:19.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (114m) 92m ago 118m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:18:19.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (118m) 90m ago 118m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:18:19.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (114m) 90m ago 118m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:18:19.909 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (115m) 92m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:18:19.910 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (115m) 90m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:18:19.910 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (115m) 92m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:18:19.910 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (114m) 90m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:18:19.910 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 92m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:18:19.911 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 90m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:18:19.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (113m) 92m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:18:19.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (113m) 92m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:18:19.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (112m) 92m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:18:19.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (112m) 90m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:18:19.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (111m) 90m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:18:19.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (111m) 90m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:18:19.912 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 92m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:18:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 msgr2=0x7fa8d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 0x7fa8d8067290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fa8ec0f77e0 tx=0x7fa8dc0099e0).stop 2022-02-02T20:18:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 msgr2=0x7fa8ec107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7fa8d4009990 tx=0x7fa8d4009b30).stop 2022-02-02T20:18:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 shutdown_connections 2022-02-02T20:18:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8d8064dd0 0x7fa8d8067290 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:18:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 --2- 172.21.15.96:0/2909001460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec107450 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 >> 172.21.15.96:0/2909001460 conn(0x7fa8ec0f1e40 msgr2=0x7fa8ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 shutdown_connections 2022-02-02T20:18:19.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:19.907+0000 7fa8f2851700 1 -- 172.21.15.96:0/2909001460 wait complete. 2022-02-02T20:18:20.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 -- 172.21.15.96:0/2833240712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 msgr2=0x7fbb480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/2833240712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb480f59e0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7fbb3c004660 tx=0x7fbb3c009b30).stop 2022-02-02T20:18:20.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 -- 172.21.15.96:0/2833240712 shutdown_connections 2022-02-02T20:18:20.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/2833240712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 0x7fbb480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/2833240712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb480f59e0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 -- 172.21.15.96:0/2833240712 >> 172.21.15.96:0/2833240712 conn(0x7fbb480f0d40 msgr2=0x7fbb480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 -- 172.21.15.96:0/2833240712 shutdown_connections 2022-02-02T20:18:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.004+0000 7fbb4c83a700 1 -- 172.21.15.96:0/2833240712 wait complete. 2022-02-02T20:18:20.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 Processor -- start 2022-02-02T20:18:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 -- start start 2022-02-02T20:18:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 0x7fbb4810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480602d0 con 0x7fbb480f55c0 2022-02-02T20:18:20.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4c83a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48060410 con 0x7fbb480f6860 2022-02-02T20:18:20.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36320/0 (socket says 172.21.15.96:36320) 2022-02-02T20:18:20.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.005+0000 7fbb4659c700 1 -- 172.21.15.96:0/3774434638 learned_addr learned my addr 172.21.15.96:0/3774434638 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb45d9b700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 0x7fbb4810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb4659c700 1 -- 172.21.15.96:0/3774434638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 msgr2=0x7fbb4810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb4659c700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 0x7fbb4810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb4659c700 1 -- 172.21.15.96:0/3774434638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c005040 con 0x7fbb480f55c0 2022-02-02T20:18:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb4659c700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fbb3c004f60 tx=0x7fbb3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:20.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3c018070 con 0x7fbb480f55c0 2022-02-02T20:18:20.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb3c007ba0 con 0x7fbb480f55c0 2022-02-02T20:18:20.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3c01c620 con 0x7fbb480f55c0 2022-02-02T20:18:20.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.006+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4810ea60 con 0x7fbb480f55c0 2022-02-02T20:18:20.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.007+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4810ee30 con 0x7fbb480f55c0 2022-02-02T20:18:20.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.007+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48045ad0 con 0x7fbb480f55c0 2022-02-02T20:18:20.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.008+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb3c01d420 con 0x7fbb480f55c0 2022-02-02T20:18:20.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.008+0000 7fbb36ffd700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 0x7fbb30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.008+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbb3c0838e0 con 0x7fbb480f55c0 2022-02-02T20:18:20.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.008+0000 7fbb45d9b700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 0x7fbb30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.009+0000 7fbb45d9b700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 0x7fbb30067290 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fbb38007fd0 tx=0x7fbb38009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:20.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.012+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb3c051aa0 con 0x7fbb480f55c0 2022-02-02T20:18:20.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.241+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb480fde20 con 0x7fbb480f55c0 2022-02-02T20:18:20.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.242+0000 7fbb36ffd700 1 -- 172.21.15.96:0/3774434638 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbb3c0550c0 con 0x7fbb480f55c0 2022-02-02T20:18:20.244 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:18:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:18:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:18:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:18:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:18:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:18:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:18:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:18:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:18:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:18:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:18:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:18:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:18:20.248 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:18:20.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 msgr2=0x7fbb30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 0x7fbb30067290 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fbb38007fd0 tx=0x7fbb38009040).stop 2022-02-02T20:18:20.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 msgr2=0x7fbb4810c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fbb3c004f60 tx=0x7fbb3c009b30).stop 2022-02-02T20:18:20.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 shutdown_connections 2022-02-02T20:18:20.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb30064dd0 0x7fbb30067290 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb480f55c0 0x7fbb4810c070 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 --2- 172.21.15.96:0/3774434638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb480f6860 0x7fbb4810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 >> 172.21.15.96:0/3774434638 conn(0x7fbb480f0d40 msgr2=0x7fbb480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 shutdown_connections 2022-02-02T20:18:20.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.244+0000 7fbb4c83a700 1 -- 172.21.15.96:0/3774434638 wait complete. 2022-02-02T20:18:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:20 smithi096 ceph-mon[101353]: pgmap v3487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:20.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- 172.21.15.96:0/694122306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6860 msgr2=0x7faf800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 --2- 172.21.15.96:0/694122306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6860 0x7faf800f6cc0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7faf6c004660 tx=0x7faf6c009b30).stop 2022-02-02T20:18:20.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- 172.21.15.96:0/694122306 shutdown_connections 2022-02-02T20:18:20.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 --2- 172.21.15.96:0/694122306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6860 0x7faf800f6cc0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 --2- 172.21.15.96:0/694122306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f55c0 0x7faf800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:18:20.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- 172.21.15.96:0/694122306 >> 172.21.15.96:0/694122306 conn(0x7faf800f0d40 msgr2=0x7faf800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:20.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- 172.21.15.96:0/694122306 shutdown_connections 2022-02-02T20:18:20.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- 172.21.15.96:0/694122306 wait complete. 2022-02-02T20:18:20.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 Processor -- start 2022-02-02T20:18:20.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.343+0000 7faf86d5f700 1 -- start start 2022-02-02T20:18:20.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf86d5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf86d5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f6860 0x7faf8010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf86d5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80060450 con 0x7faf800f55c0 2022-02-02T20:18:20.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf86d5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80060590 con 0x7faf800f6860 2022-02-02T20:18:20.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36330/0 (socket says 172.21.15.96:36330) 2022-02-02T20:18:20.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 -- 172.21.15.96:0/2387650118 learned_addr learned my addr 172.21.15.96:0/2387650118 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:20.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf7ffff700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f6860 0x7faf8010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 -- 172.21.15.96:0/2387650118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f6860 msgr2=0x7faf8010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f6860 0x7faf8010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 -- 172.21.15.96:0/2387650118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c005040 con 0x7faf800f55c0 2022-02-02T20:18:20.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.344+0000 7faf84afb700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7faf740093f0 tx=0x7faf74006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:20.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.345+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf74013640 con 0x7faf800f55c0 2022-02-02T20:18:20.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.345+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8010c7e0 con 0x7faf800f55c0 2022-02-02T20:18:20.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.345+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf74009e40 con 0x7faf800f55c0 2022-02-02T20:18:20.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.345+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf7400dbf0 con 0x7faf800f55c0 2022-02-02T20:18:20.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.345+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8010cda0 con 0x7faf800f55c0 2022-02-02T20:18:20.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.346+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf80045ad0 con 0x7faf800f55c0 2022-02-02T20:18:20.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.346+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf7401a060 con 0x7faf800f55c0 2022-02-02T20:18:20.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.347+0000 7faf7d7fa700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 0x7faf70067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:20.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.347+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faf74081a30 con 0x7faf800f55c0 2022-02-02T20:18:20.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.347+0000 7faf7ffff700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 0x7faf70067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:20.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.347+0000 7faf7ffff700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 0x7faf70067270 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7faf6c004e30 tx=0x7faf6c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:20.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.351+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf7404fb30 con 0x7faf800f55c0 2022-02-02T20:18:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:20 smithi159 ceph-mon[69013]: pgmap v3487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.552+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf80027a00 con 0x7faf800f55c0 2022-02-02T20:18:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.552+0000 7faf7d7fa700 1 -- 172.21.15.96:0/2387650118 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7faf74018020 con 0x7faf800f55c0 2022-02-02T20:18:20.555 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:18:20.555 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:18:20.555 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:18:20.555 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:18:20.556 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:20.556 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:18:20.556 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:18:20.556 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:18:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:18:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:18:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:18:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:18:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:18:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:18:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:18:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:18:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:18:20.559 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:18:20.559 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:18:20.559 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:18:20.559 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:18:20.560 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:18:20.560 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:18:20.560 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:18:20.560 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:18:20.561 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:18:20.561 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:18:20.561 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:18:20.561 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:18:20.561 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:18:20.562 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:18:20.562 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:18:20.562 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:20.562 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:20.563 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:18:20.563 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:20.563 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:20.563 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:20.563 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:20.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 msgr2=0x7faf70067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 0x7faf70067270 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7faf6c004e30 tx=0x7faf6c009b30).stop 2022-02-02T20:18:20.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 msgr2=0x7faf80109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:20.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7faf740093f0 tx=0x7faf74006ec0).stop 2022-02-02T20:18:20.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 shutdown_connections 2022-02-02T20:18:20.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064db0 0x7faf70067270 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f55c0 0x7faf80109cd0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 --2- 172.21.15.96:0/2387650118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f6860 0x7faf8010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:20.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 >> 172.21.15.96:0/2387650118 conn(0x7faf800f0d40 msgr2=0x7faf800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:20.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 shutdown_connections 2022-02-02T20:18:20.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:20.554+0000 7faf86d5f700 1 -- 172.21.15.96:0/2387650118 wait complete. 2022-02-02T20:18:20.567 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:18:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:21 smithi096 ceph-mon[101353]: from='client.37686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:21.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:21 smithi096 ceph-mon[101353]: from='client.37690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3774434638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:18:21.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2387650118' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:18:21.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:21 smithi159 ceph-mon[69013]: from='client.37686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:21 smithi159 ceph-mon[69013]: from='client.37690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3774434638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:18:21.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2387650118' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:18:22.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:22 smithi096 ceph-mon[101353]: pgmap v3488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:22 smithi159 ceph-mon[69013]: pgmap v3488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:24.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:24 smithi096 ceph-mon[101353]: pgmap v3489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:24 smithi159 ceph-mon[69013]: pgmap v3489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:26.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:26 smithi096 ceph-mon[101353]: pgmap v3490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:26 smithi159 ceph-mon[69013]: pgmap v3490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:27 smithi159 ceph-mon[69013]: pgmap v3491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:18:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:18:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:27 smithi096 ceph-mon[101353]: pgmap v3491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:18:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:18:30.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:30 smithi096 ceph-mon[101353]: pgmap v3492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:30 smithi159 ceph-mon[69013]: pgmap v3492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:32 smithi096 ceph-mon[101353]: pgmap v3493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:32 smithi159 ceph-mon[69013]: pgmap v3493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:34.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:34 smithi096 ceph-mon[101353]: pgmap v3494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:34 smithi159 ceph-mon[69013]: pgmap v3494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:36.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:36 smithi096 ceph-mon[101353]: pgmap v3495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:36 smithi159 ceph-mon[69013]: pgmap v3495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:37 smithi159 ceph-mon[69013]: pgmap v3496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:37 smithi096 ceph-mon[101353]: pgmap v3496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:40 smithi096 ceph-mon[101353]: pgmap v3497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:40 smithi159 ceph-mon[69013]: pgmap v3497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:42 smithi096 ceph-mon[101353]: pgmap v3498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:42 smithi159 ceph-mon[69013]: pgmap v3498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:44 smithi096 ceph-mon[101353]: pgmap v3499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:44 smithi159 ceph-mon[69013]: pgmap v3499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:46.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:46 smithi096 ceph-mon[101353]: pgmap v3500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:46 smithi159 ceph-mon[69013]: pgmap v3500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:47 smithi159 ceph-mon[69013]: pgmap v3501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:47 smithi096 ceph-mon[101353]: pgmap v3501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:50 smithi096 ceph-mon[101353]: pgmap v3502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:50 smithi159 ceph-mon[69013]: pgmap v3502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 -- 172.21.15.96:0/3507497693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 msgr2=0x7ff29c0fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/3507497693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c0fbaf0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7ff28c004660 tx=0x7ff28c009b30).stop 2022-02-02T20:18:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 -- 172.21.15.96:0/3507497693 shutdown_connections 2022-02-02T20:18:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/3507497693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c0fbaf0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/3507497693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 0x7ff29c0f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 -- 172.21.15.96:0/3507497693 >> 172.21.15.96:0/3507497693 conn(0x7ff29c0f0ba0 msgr2=0x7ff29c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 -- 172.21.15.96:0/3507497693 shutdown_connections 2022-02-02T20:18:50.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.664+0000 7ff2a25d5700 1 -- 172.21.15.96:0/3507497693 wait complete. 2022-02-02T20:18:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 Processor -- start 2022-02-02T20:18:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 -- start start 2022-02-02T20:18:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 0x7ff29c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c107870 con 0x7ff29c0f96a0 2022-02-02T20:18:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a25d5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1080b0 con 0x7ff29c060310 2022-02-02T20:18:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a0dd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a0dd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36350/0 (socket says 172.21.15.96:36350) 2022-02-02T20:18:50.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a0dd2700 1 -- 172.21.15.96:0/752342711 learned_addr learned my addr 172.21.15.96:0/752342711 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.665+0000 7ff2a15d3700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 0x7ff29c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a0dd2700 1 -- 172.21.15.96:0/752342711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 msgr2=0x7ff29c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a0dd2700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 0x7ff29c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a0dd2700 1 -- 172.21.15.96:0/752342711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c005040 con 0x7ff29c0f96a0 2022-02-02T20:18:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a0dd2700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7ff28c004f60 tx=0x7ff28c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c018070 con 0x7ff29c0f96a0 2022-02-02T20:18:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c108330 con 0x7ff29c0f96a0 2022-02-02T20:18:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff28c009770 con 0x7ff29c0f96a0 2022-02-02T20:18:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c01c3c0 con 0x7ff29c0f96a0 2022-02-02T20:18:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.666+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c108810 con 0x7ff29c0f96a0 2022-02-02T20:18:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.667+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c059100 con 0x7ff29c0f96a0 2022-02-02T20:18:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.668+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff28c01d420 con 0x7ff29c0f96a0 2022-02-02T20:18:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.668+0000 7ff291ffb700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 0x7ff2880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.668+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff28c083840 con 0x7ff29c0f96a0 2022-02-02T20:18:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.668+0000 7ff2a15d3700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 0x7ff2880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.669+0000 7ff2a15d3700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 0x7ff2880672e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7ff298007fd0 tx=0x7ff298009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.673+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff28c051a00 con 0x7ff29c0f96a0 2022-02-02T20:18:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.850+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff29c0fedf0 con 0x7ff288064e20 2022-02-02T20:18:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.851+0000 7ff291ffb700 1 -- 172.21.15.96:0/752342711 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff29c0fedf0 con 0x7ff288064e20 2022-02-02T20:18:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 msgr2=0x7ff2880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 0x7ff2880672e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7ff298007fd0 tx=0x7ff298009040).stop 2022-02-02T20:18:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 msgr2=0x7ff29c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7ff28c004f60 tx=0x7ff28c009b30).stop 2022-02-02T20:18:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 shutdown_connections 2022-02-02T20:18:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff288064e20 0x7ff2880672e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29c060310 0x7ff29c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 --2- 172.21.15.96:0/752342711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff29c0f96a0 0x7ff29c107270 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 >> 172.21.15.96:0/752342711 conn(0x7ff29c0f0ba0 msgr2=0x7ff29c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:50.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 shutdown_connections 2022-02-02T20:18:50.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.853+0000 7ff2a25d5700 1 -- 172.21.15.96:0/752342711 wait complete. 2022-02-02T20:18:50.865 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 -- 172.21.15.96:0/1260039456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 msgr2=0x7fd1380f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/1260039456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd1380f59e0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fd128004660 tx=0x7fd128009b30).stop 2022-02-02T20:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 -- 172.21.15.96:0/1260039456 shutdown_connections 2022-02-02T20:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/1260039456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/1260039456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd1380f59e0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 -- 172.21.15.96:0/1260039456 >> 172.21.15.96:0/1260039456 conn(0x7fd1380f0d40 msgr2=0x7fd1380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:50.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 -- 172.21.15.96:0/1260039456 shutdown_connections 2022-02-02T20:18:50.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.950+0000 7fd13f6d0700 1 -- 172.21.15.96:0/1260039456 wait complete. 2022-02-02T20:18:50.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 Processor -- start 2022-02-02T20:18:50.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 -- start start 2022-02-02T20:18:50.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd13810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138060420 con 0x7fd1380f55c0 2022-02-02T20:18:50.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13f6d0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138060560 con 0x7fd1380f6860 2022-02-02T20:18:50.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13d46c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13d46c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36358/0 (socket says 172.21.15.96:36358) 2022-02-02T20:18:50.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.951+0000 7fd13d46c700 1 -- 172.21.15.96:0/2901911368 learned_addr learned my addr 172.21.15.96:0/2901911368 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:50.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13cc6b700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd13810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13d46c700 1 -- 172.21.15.96:0/2901911368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 msgr2=0x7fd13810c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:50.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13d46c700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd13810c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:50.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13d46c700 1 -- 172.21.15.96:0/2901911368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128005040 con 0x7fd1380f55c0 2022-02-02T20:18:50.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13cc6b700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd13810c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:18:50.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13d46c700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fd128013a70 tx=0x7fd128009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:50.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd128018070 con 0x7fd1380f55c0 2022-02-02T20:18:50.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13810c6e0 con 0x7fd1380f55c0 2022-02-02T20:18:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1280097d0 con 0x7fd1380f55c0 2022-02-02T20:18:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12801c3c0 con 0x7fd1380f55c0 2022-02-02T20:18:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.952+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13810cc10 con 0x7fd1380f55c0 2022-02-02T20:18:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.953+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1380f49b0 con 0x7fd1380f55c0 2022-02-02T20:18:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.954+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd128007ba0 con 0x7fd1380f55c0 2022-02-02T20:18:50.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.954+0000 7fd12dffb700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:50.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.954+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1280836d0 con 0x7fd1380f55c0 2022-02-02T20:18:50.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.954+0000 7fd13cc6b700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:50.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.955+0000 7fd13cc6b700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fd134009fd0 tx=0x7fd13400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:50.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:50.958+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd128051890 con 0x7fd1380f55c0 2022-02-02T20:18:51.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.135+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1380fde60 con 0x7fd124064dd0 2022-02-02T20:18:51.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.144+0000 7fd12dffb700 1 -- 172.21.15.96:0/2901911368 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fd1380fde60 con 0x7fd124064dd0 2022-02-02T20:18:51.147 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:18:51.148 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 92m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:18:51.148 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (114m) 92m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:18:51.148 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (114m) 91m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:18:51.148 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 92m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:18:51.149 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (119m) 92m ago 119m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:18:51.149 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (114m) 92m ago 119m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:18:51.149 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (119m) 91m ago 119m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:18:51.149 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (115m) 91m ago 119m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:18:51.149 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (116m) 92m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:18:51.150 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (115m) 91m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:18:51.150 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (115m) 92m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:18:51.150 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (115m) 91m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:18:51.150 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 92m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:18:51.151 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 91m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:18:51.151 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (114m) 92m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:18:51.151 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (113m) 92m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:18:51.151 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (113m) 92m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:18:51.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (112m) 91m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:18:51.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (112m) 91m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:18:51.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (111m) 91m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:18:51.152 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 92m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:18:51.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 msgr2=0x7fd124067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fd134009fd0 tx=0x7fd13400b040).stop 2022-02-02T20:18:51.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 msgr2=0x7fd138109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fd128013a70 tx=0x7fd128009b30).stop 2022-02-02T20:18:51.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 shutdown_connections 2022-02-02T20:18:51.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd138109c30 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 --2- 172.21.15.96:0/2901911368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd13810c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 >> 172.21.15.96:0/2901911368 conn(0x7fd1380f0d40 msgr2=0x7fd1380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:51.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 shutdown_connections 2022-02-02T20:18:51.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.146+0000 7fd13f6d0700 1 -- 172.21.15.96:0/2901911368 wait complete. 2022-02-02T20:18:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 -- 172.21.15.96:0/1573508923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 msgr2=0x7f0a040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 --2- 172.21.15.96:0/1573508923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a040f6950 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f09f4004660 tx=0x7f09f4009b30).stop 2022-02-02T20:18:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 -- 172.21.15.96:0/1573508923 shutdown_connections 2022-02-02T20:18:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 --2- 172.21.15.96:0/1573508923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 0x7f0a040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:18:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 --2- 172.21.15.96:0/1573508923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a040f6950 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 -- 172.21.15.96:0/1573508923 >> 172.21.15.96:0/1573508923 conn(0x7f0a040f1c90 msgr2=0x7f0a040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 -- 172.21.15.96:0/1573508923 shutdown_connections 2022-02-02T20:18:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.242+0000 7f0a089df700 1 -- 172.21.15.96:0/1573508923 wait complete. 2022-02-02T20:18:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 Processor -- start 2022-02-02T20:18:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 -- start start 2022-02-02T20:18:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 0x7f0a04107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041079a0 con 0x7f0a040f6530 2022-02-02T20:18:51.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.243+0000 7f0a089df700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04108120 con 0x7f0a040f77d0 2022-02-02T20:18:51.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36368/0 (socket says 172.21.15.96:36368) 2022-02-02T20:18:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 -- 172.21.15.96:0/968380853 learned_addr learned my addr 172.21.15.96:0/968380853 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a02ffd700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 0x7f0a04107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 -- 172.21.15.96:0/968380853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 msgr2=0x7f0a04107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 0x7f0a04107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 -- 172.21.15.96:0/968380853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4005040 con 0x7f0a040f6530 2022-02-02T20:18:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a037fe700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f09f4004f60 tx=0x7f09f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09f4018070 con 0x7f0a040f6530 2022-02-02T20:18:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a04108340 con 0x7f0a040f6530 2022-02-02T20:18:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09f4007ba0 con 0x7f0a040f6530 2022-02-02T20:18:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09f401c620 con 0x7f0a040f6530 2022-02-02T20:18:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.244+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a041088a0 con 0x7f0a040f6530 2022-02-02T20:18:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.246+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04059100 con 0x7f0a040f6530 2022-02-02T20:18:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.246+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09f401c8e0 con 0x7f0a040f6530 2022-02-02T20:18:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.246+0000 7f09ebfff700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 0x7f09ec06b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.246+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f09f4083940 con 0x7f0a040f6530 2022-02-02T20:18:51.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.246+0000 7f0a02ffd700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 0x7f09ec06b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.247+0000 7f0a02ffd700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 0x7f09ec06b6f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f09f800b790 tx=0x7f09f8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:51.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.251+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09f4051a40 con 0x7f0a040f6530 2022-02-02T20:18:51.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.481+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a04045ad0 con 0x7f0a040f6530 2022-02-02T20:18:51.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.482+0000 7f09ebfff700 1 -- 172.21.15.96:0/968380853 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f09f4055060 con 0x7f0a040f6530 2022-02-02T20:18:51.488 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:18:51.488 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:18:51.489 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:18:51.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:51.489 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:18:51.489 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:18:51.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:51.490 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:18:51.490 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:18:51.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:51.491 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:18:51.491 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:18:51.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:18:51.492 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:18:51.492 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:18:51.493 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:18:51.493 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:18:51.493 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:18:51.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 msgr2=0x7f09ec06b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 0x7f09ec06b6f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f09f800b790 tx=0x7f09f8008040).stop 2022-02-02T20:18:51.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 msgr2=0x7f0a04106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f09f4004f60 tx=0x7f09f4009b30).stop 2022-02-02T20:18:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 shutdown_connections 2022-02-02T20:18:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09ec069230 0x7f09ec06b6f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a040f6530 0x7f0a04106e20 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 --2- 172.21.15.96:0/968380853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a040f77d0 0x7f0a04107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 >> 172.21.15.96:0/968380853 conn(0x7f0a040f1c90 msgr2=0x7f0a040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:51.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 shutdown_connections 2022-02-02T20:18:51.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.484+0000 7f0a089df700 1 -- 172.21.15.96:0/968380853 wait complete. 2022-02-02T20:18:51.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 -- 172.21.15.96:0/597079407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 msgr2=0x7f02ac0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 --2- 172.21.15.96:0/597079407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac0f7ac0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f029c004660 tx=0x7f029c009b30).stop 2022-02-02T20:18:51.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 -- 172.21.15.96:0/597079407 shutdown_connections 2022-02-02T20:18:51.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 --2- 172.21.15.96:0/597079407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac0f7ac0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 --2- 172.21.15.96:0/597079407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 0x7f02ac0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 -- 172.21.15.96:0/597079407 >> 172.21.15.96:0/597079407 conn(0x7f02ac0f04c0 msgr2=0x7f02ac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:51.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 -- 172.21.15.96:0/597079407 shutdown_connections 2022-02-02T20:18:51.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.582+0000 7f02b37b7700 1 -- 172.21.15.96:0/597079407 wait complete. 2022-02-02T20:18:51.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 Processor -- start 2022-02-02T20:18:51.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 -- start start 2022-02-02T20:18:51.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 0x7f02ac106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac107a50 con 0x7f02ac0f5340 2022-02-02T20:18:51.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b37b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac107b90 con 0x7f02ac0f49a0 2022-02-02T20:18:51.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36380/0 (socket says 172.21.15.96:36380) 2022-02-02T20:18:51.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 -- 172.21.15.96:0/2557746943 learned_addr learned my addr 172.21.15.96:0/2557746943 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:18:51.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b1553700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 0x7f02ac106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 -- 172.21.15.96:0/2557746943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 msgr2=0x7f02ac106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 0x7f02ac106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 -- 172.21.15.96:0/2557746943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c005040 con 0x7f02ac0f5340 2022-02-02T20:18:51.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02b0d52700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f029c004f60 tx=0x7f029c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:51.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.583+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c018070 con 0x7f02ac0f5340 2022-02-02T20:18:51.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.584+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac1084d0 con 0x7f02ac0f5340 2022-02-02T20:18:51.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.584+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f029c007ba0 con 0x7f02ac0f5340 2022-02-02T20:18:51.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.584+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c01c620 con 0x7f02ac0f5340 2022-02-02T20:18:51.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.584+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac108a30 con 0x7f02ac0f5340 2022-02-02T20:18:51.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.585+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac045ad0 con 0x7f02ac0f5340 2022-02-02T20:18:51.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.585+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f029c01d420 con 0x7f02ac0f5340 2022-02-02T20:18:51.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.586+0000 7f02a1ffb700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:18:51.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.586+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f029c083970 con 0x7f02ac0f5340 2022-02-02T20:18:51.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.586+0000 7f02b1553700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:18:51.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.586+0000 7f02b1553700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f02ac05f460 tx=0x7f02a8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:18:51.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.590+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f029c0553e0 con 0x7f02ac0f5340 2022-02-02T20:18:51.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.789+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02ac027a00 con 0x7f02ac0f5340 2022-02-02T20:18:51.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.790+0000 7f02a1ffb700 1 -- 172.21.15.96:0/2557746943 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f029c054fd0 con 0x7f02ac0f5340 2022-02-02T20:18:51.793 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:18:51.794 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:18:51.794 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:18:51.794 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:18:51.794 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:51.795 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:18:51.795 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:18:51.795 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:18:51.796 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:18:51.796 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:18:51.796 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:18:51.796 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:18:51.796 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:18:51.797 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:18:51.797 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:18:51.797 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:18:51.797 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:18:51.798 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:18:51.798 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:18:51.798 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:18:51.798 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:18:51.799 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:18:51.799 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:18:51.799 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:18:51.799 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:18:51.799 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:18:51.800 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:18:51.800 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:18:51.800 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:18:51.800 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:18:51.801 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:18:51.801 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:18:51.801 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:51.801 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:51.802 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:18:51.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:18:51.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:51.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:51.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:18:51.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 msgr2=0x7f0298067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f02ac05f460 tx=0x7f02a8009040).stop 2022-02-02T20:18:51.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 msgr2=0x7f02ac1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:18:51.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f029c004f60 tx=0x7f029c009b30).stop 2022-02-02T20:18:51.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 shutdown_connections 2022-02-02T20:18:51.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f49a0 0x7f02ac106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 --2- 172.21.15.96:0/2557746943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f5340 0x7f02ac1074a0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:18:51.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 >> 172.21.15.96:0/2557746943 conn(0x7f02ac0f04c0 msgr2=0x7f02ac0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:18:51.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 shutdown_connections 2022-02-02T20:18:51.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:18:51.793+0000 7f02b37b7700 1 -- 172.21.15.96:0/2557746943 wait complete. 2022-02-02T20:18:51.806 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:18:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:52 smithi096 ceph-mon[101353]: from='client.37702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:52 smithi096 ceph-mon[101353]: pgmap v3503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:52 smithi096 ceph-mon[101353]: from='client.37706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/968380853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:18:52.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2557746943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:18:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:52 smithi159 ceph-mon[69013]: from='client.37702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:52.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:52 smithi159 ceph-mon[69013]: pgmap v3503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:52.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:52 smithi159 ceph-mon[69013]: from='client.37706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:18:52.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/968380853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:18:52.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2557746943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:18:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:54 smithi096 ceph-mon[101353]: pgmap v3504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:54 smithi159 ceph-mon[69013]: pgmap v3504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:56 smithi096 ceph-mon[101353]: pgmap v3505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:56 smithi159 ceph-mon[69013]: pgmap v3505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:58.030 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:18:57 smithi159 ceph-mon[69013]: pgmap v3506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:18:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:18:57 smithi096 ceph-mon[101353]: pgmap v3506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:00.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:00 smithi096 ceph-mon[101353]: pgmap v3507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:00 smithi159 ceph-mon[69013]: pgmap v3507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:02 smithi096 ceph-mon[101353]: pgmap v3508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:02 smithi159 ceph-mon[69013]: pgmap v3508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:04 smithi096 ceph-mon[101353]: pgmap v3509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:04 smithi159 ceph-mon[69013]: pgmap v3509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:06 smithi096 ceph-mon[101353]: pgmap v3510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:06 smithi159 ceph-mon[69013]: pgmap v3510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:07 smithi159 ceph-mon[69013]: pgmap v3511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:07 smithi096 ceph-mon[101353]: pgmap v3511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:10 smithi096 ceph-mon[101353]: pgmap v3512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:10 smithi159 ceph-mon[69013]: pgmap v3512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:12.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:12 smithi096 ceph-mon[101353]: pgmap v3513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:12 smithi159 ceph-mon[69013]: pgmap v3513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:14 smithi096 ceph-mon[101353]: pgmap v3514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:14 smithi159 ceph-mon[69013]: pgmap v3514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:16 smithi096 ceph-mon[101353]: pgmap v3515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:16 smithi159 ceph-mon[69013]: pgmap v3515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:17 smithi159 ceph-mon[69013]: pgmap v3516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:17 smithi096 ceph-mon[101353]: pgmap v3516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:20.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:20 smithi096 ceph-mon[101353]: pgmap v3517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:20 smithi159 ceph-mon[69013]: pgmap v3517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:21.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 -- 172.21.15.96:0/1138377587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f66e0 msgr2=0x7f90400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:21.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 --2- 172.21.15.96:0/1138377587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f66e0 0x7f90400f6b00 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f9030004660 tx=0x7f9030009b30).stop 2022-02-02T20:19:21.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 -- 172.21.15.96:0/1138377587 shutdown_connections 2022-02-02T20:19:21.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 --2- 172.21.15.96:0/1138377587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f7980 0x7f90400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:21.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 --2- 172.21.15.96:0/1138377587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f66e0 0x7f90400f6b00 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:21.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 -- 172.21.15.96:0/1138377587 >> 172.21.15.96:0/1138377587 conn(0x7f90400f1e40 msgr2=0x7f90400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 -- 172.21.15.96:0/1138377587 shutdown_connections 2022-02-02T20:19:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.904+0000 7f9047429700 1 -- 172.21.15.96:0/1138377587 wait complete. 2022-02-02T20:19:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 Processor -- start 2022-02-02T20:19:21.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 -- start start 2022-02-02T20:19:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 0x7f9040106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040107a50 con 0x7f90400f7980 2022-02-02T20:19:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f9047429700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040107b90 con 0x7f90400f66e0 2022-02-02T20:19:21.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90449c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90449c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36398/0 (socket says 172.21.15.96:36398) 2022-02-02T20:19:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90449c4700 1 -- 172.21.15.96:0/4066322192 learned_addr learned my addr 172.21.15.96:0/4066322192 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:21.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90451c5700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 0x7f9040106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:21.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90449c4700 1 -- 172.21.15.96:0/4066322192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 msgr2=0x7f9040106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:21.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.905+0000 7f90449c4700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 0x7f9040106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:21.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f90449c4700 1 -- 172.21.15.96:0/4066322192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030005040 con 0x7f90400f7980 2022-02-02T20:19:21.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f90451c5700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 0x7f9040106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:19:21.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f90449c4700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f903c00c530 tx=0x7f903c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:21.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903c011950 con 0x7f90400f7980 2022-02-02T20:19:21.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9040108530 con 0x7f90400f7980 2022-02-02T20:19:21.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f903c018380 con 0x7f90400f7980 2022-02-02T20:19:21.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903c019630 con 0x7f90400f7980 2022-02-02T20:19:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.906+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9040108af0 con 0x7f90400f7980 2022-02-02T20:19:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.907+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9040045ad0 con 0x7f90400f7980 2022-02-02T20:19:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.907+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f903c021070 con 0x7f90400f7980 2022-02-02T20:19:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.908+0000 7f9035ffb700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 0x7f902c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.908+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f903c085c60 con 0x7f90400f7980 2022-02-02T20:19:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.908+0000 7f90451c5700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 0x7f902c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:21.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.908+0000 7f90451c5700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 0x7f902c067290 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f9030004e30 tx=0x7f9030009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:21.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:21.912+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f903c057870 con 0x7f90400f7980 2022-02-02T20:19:22.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.092+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9040108d70 con 0x7f902c064dd0 2022-02-02T20:19:22.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.093+0000 7f9035ffb700 1 -- 172.21.15.96:0/4066322192 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9040108d70 con 0x7f902c064dd0 2022-02-02T20:19:22.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 msgr2=0x7f902c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 0x7f902c067290 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f9030004e30 tx=0x7f9030009b30).stop 2022-02-02T20:19:22.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 msgr2=0x7f90401074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f903c00c530 tx=0x7f903c007e20).stop 2022-02-02T20:19:22.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 shutdown_connections 2022-02-02T20:19:22.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f902c064dd0 0x7f902c067290 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90400f66e0 0x7f9040106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 --2- 172.21.15.96:0/4066322192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90400f7980 0x7f90401074a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 >> 172.21.15.96:0/4066322192 conn(0x7f90400f1e40 msgr2=0x7f90400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 shutdown_connections 2022-02-02T20:19:22.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.095+0000 7f9047429700 1 -- 172.21.15.96:0/4066322192 wait complete. 2022-02-02T20:19:22.107 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:19:22.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.192+0000 7f8032356700 1 -- 172.21.15.96:0/1266517220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 msgr2=0x7f802c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.192+0000 7f8032356700 1 --2- 172.21.15.96:0/1266517220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c0f6cc0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f8020004660 tx=0x7f8020009b30).stop 2022-02-02T20:19:22.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 -- 172.21.15.96:0/1266517220 shutdown_connections 2022-02-02T20:19:22.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 --2- 172.21.15.96:0/1266517220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c0f6cc0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 --2- 172.21.15.96:0/1266517220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 -- 172.21.15.96:0/1266517220 >> 172.21.15.96:0/1266517220 conn(0x7f802c0f0d40 msgr2=0x7f802c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.196 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:22 smithi096 ceph-mon[101353]: pgmap v3518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:22.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 -- 172.21.15.96:0/1266517220 shutdown_connections 2022-02-02T20:19:22.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 -- 172.21.15.96:0/1266517220 wait complete. 2022-02-02T20:19:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 Processor -- start 2022-02-02T20:19:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.193+0000 7f8032356700 1 -- start start 2022-02-02T20:19:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8032356700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8032356700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8032356700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0603c0 con 0x7f802c0f6860 2022-02-02T20:19:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8032356700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c060500 con 0x7f802c0f55c0 2022-02-02T20:19:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36406/0 (socket says 172.21.15.96:36406) 2022-02-02T20:19:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 -- 172.21.15.96:0/1133022164 learned_addr learned my addr 172.21.15.96:0/1133022164 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802bfff700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 -- 172.21.15.96:0/1133022164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 msgr2=0x7f802c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 -- 172.21.15.96:0/1133022164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020005040 con 0x7f802c0f6860 2022-02-02T20:19:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802bfff700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:19:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f802b7fe700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f8020009990 tx=0x7f8020009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8020018070 con 0x7f802c0f6860 2022-02-02T20:19:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8020007ba0 con 0x7f802c0f6860 2022-02-02T20:19:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c10c6c0 con 0x7f802c0f6860 2022-02-02T20:19:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.194+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802001c3c0 con 0x7f802c0f6860 2022-02-02T20:19:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.195+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c10cbf0 con 0x7f802c0f6860 2022-02-02T20:19:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.195+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c0f49b0 con 0x7f802c0f6860 2022-02-02T20:19:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.196+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f802001d420 con 0x7f802c0f6860 2022-02-02T20:19:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.196+0000 7f8028ff9700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 0x7f8014067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.196+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8020083740 con 0x7f802c0f6860 2022-02-02T20:19:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.196+0000 7f802bfff700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 0x7f8014067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.197+0000 7f802bfff700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 0x7f8014067290 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f802c060040 tx=0x7f801c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.200+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80200517e0 con 0x7f802c0f6860 2022-02-02T20:19:22.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.374+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f802c0fdf00 con 0x7f8014064dd0 2022-02-02T20:19:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.384+0000 7f8028ff9700 1 -- 172.21.15.96:0/1133022164 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f802c0fdf00 con 0x7f8014064dd0 2022-02-02T20:19:22.386 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:19:22.387 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 93m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:19:22.387 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (115m) 93m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:19:22.388 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (115m) 91m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:19:22.388 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 93m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:19:22.389 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (119m) 93m ago 119m 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:19:22.389 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (115m) 93m ago 119m 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:19:22.390 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (119m) 91m ago 119m 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:19:22.390 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (115m) 91m ago 119m 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:19:22.391 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (117m) 93m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:19:22.391 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (116m) 91m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:19:22.391 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (116m) 93m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:19:22.392 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (115m) 91m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:19:22.392 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 93m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:19:22.393 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 91m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:19:22.393 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (114m) 93m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:19:22.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (114m) 93m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:19:22.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (113m) 93m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:19:22.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (113m) 91m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:19:22.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (112m) 91m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:19:22.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (112m) 91m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:19:22.396 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 93m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:19:22.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 msgr2=0x7f8014067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 0x7f8014067290 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f802c060040 tx=0x7f801c009c00).stop 2022-02-02T20:19:22.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 msgr2=0x7f802c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f8020009990 tx=0x7f8020009b30).stop 2022-02-02T20:19:22.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 shutdown_connections 2022-02-02T20:19:22.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8014064dd0 0x7f8014067290 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f802c0f55c0 0x7f802c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 --2- 172.21.15.96:0/1133022164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f802c0f6860 0x7f802c10c170 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.385+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 >> 172.21.15.96:0/1133022164 conn(0x7f802c0f0d40 msgr2=0x7f802c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.386+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 shutdown_connections 2022-02-02T20:19:22.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.386+0000 7f8032356700 1 -- 172.21.15.96:0/1133022164 wait complete. 2022-02-02T20:19:22.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3814546898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f66d0 msgr2=0x7f0eb40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3814546898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f66d0 0x7f0eb40f6b30 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f0ea4004660 tx=0x7f0ea4009b30).stop 2022-02-02T20:19:22.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3814546898 shutdown_connections 2022-02-02T20:19:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3814546898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f66d0 0x7f0eb40f6b30 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3814546898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f5430 0x7f0eb40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3814546898 >> 172.21.15.96:0/3814546898 conn(0x7f0eb40f0b90 msgr2=0x7f0eb40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.481+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3814546898 shutdown_connections 2022-02-02T20:19:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3814546898 wait complete. 2022-02-02T20:19:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 Processor -- start 2022-02-02T20:19:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 -- start start 2022-02-02T20:19:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 0x7f0eb41061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4106760 con 0x7f0eb40f5430 2022-02-02T20:19:22.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.482+0000 7f0eb3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4106f60 con 0x7f0eb40f66d0 2022-02-02T20:19:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb27fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 0x7f0eb41061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36414/0 (socket says 172.21.15.96:36414) 2022-02-02T20:19:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb27fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 0x7f0eb41061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:40520/0 (socket says 172.21.15.96:40520) 2022-02-02T20:19:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 -- 172.21.15.96:0/3078230560 learned_addr learned my addr 172.21.15.96:0/3078230560 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:22.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 -- 172.21.15.96:0/3078230560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 msgr2=0x7f0eb41061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 0x7f0eb41061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 -- 172.21.15.96:0/3078230560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4005040 con 0x7f0eb40f5430 2022-02-02T20:19:22.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb2ffd700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0ea800c530 tx=0x7f0ea8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ea800f650 con 0x7f0eb40f5430 2022-02-02T20:19:22.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb4107240 con 0x7f0eb40f5430 2022-02-02T20:19:22.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ea800fc60 con 0x7f0eb40f5430 2022-02-02T20:19:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ea8012cb0 con 0x7f0eb40f5430 2022-02-02T20:19:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.483+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb4107800 con 0x7f0eb40f5430 2022-02-02T20:19:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.485+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ea8019030 con 0x7f0eb40f5430 2022-02-02T20:19:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.485+0000 7f0e9b7fe700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 0x7f0e9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.485+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4059100 con 0x7f0eb40f5430 2022-02-02T20:19:22.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.485+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ea8081530 con 0x7f0eb40f5430 2022-02-02T20:19:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.485+0000 7f0eb27fc700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 0x7f0e9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.486+0000 7f0eb27fc700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 0x7f0e9c0672e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f0ea4004630 tx=0x7f0ea4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.490+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ea8021030 con 0x7f0eb40f5430 2022-02-02T20:19:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:22 smithi159 ceph-mon[69013]: pgmap v3518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:22.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.718+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0eb4027a00 con 0x7f0eb40f5430 2022-02-02T20:19:22.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.719+0000 7f0e9b7fe700 1 -- 172.21.15.96:0/3078230560 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0ea8017020 con 0x7f0eb40f5430 2022-02-02T20:19:22.722 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:19:22.723 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:19:22.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:19:22.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:22.723 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:19:22.724 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:19:22.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:22.724 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:19:22.724 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:19:22.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:22.725 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:19:22.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:19:22.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:22.725 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:19:22.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:19:22.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:19:22.726 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:19:22.726 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:19:22.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 msgr2=0x7f0e9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 0x7f0e9c0672e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f0ea4004630 tx=0x7f0ea4009b30).stop 2022-02-02T20:19:22.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 msgr2=0x7f0eb4105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0ea800c530 tx=0x7f0ea8007e10).stop 2022-02-02T20:19:22.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 shutdown_connections 2022-02-02T20:19:22.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e9c064e20 0x7f0e9c0672e0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0eb40f5430 0x7f0eb4105cc0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 --2- 172.21.15.96:0/3078230560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eb40f66d0 0x7f0eb41061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.720+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 >> 172.21.15.96:0/3078230560 conn(0x7f0eb40f0b90 msgr2=0x7f0eb40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.721+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 shutdown_connections 2022-02-02T20:19:22.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.721+0000 7f0eb3fff700 1 -- 172.21.15.96:0/3078230560 wait complete. 2022-02-02T20:19:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 -- 172.21.15.96:0/79079100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 msgr2=0x7f25d00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 --2- 172.21.15.96:0/79079100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00fbae0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f25c0004660 tx=0x7f25c0009b30).stop 2022-02-02T20:19:22.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 -- 172.21.15.96:0/79079100 shutdown_connections 2022-02-02T20:19:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 --2- 172.21.15.96:0/79079100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00fbae0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 --2- 172.21.15.96:0/79079100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 0x7f25d00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 -- 172.21.15.96:0/79079100 >> 172.21.15.96:0/79079100 conn(0x7f25d00f0b90 msgr2=0x7f25d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:22.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 -- 172.21.15.96:0/79079100 shutdown_connections 2022-02-02T20:19:22.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.817+0000 7f25d7270700 1 -- 172.21.15.96:0/79079100 wait complete. 2022-02-02T20:19:22.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 Processor -- start 2022-02-02T20:19:22.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 -- start start 2022-02-02T20:19:22.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 0x7f25d00f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00f5570 con 0x7f25d00f9690 2022-02-02T20:19:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d7270700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00f56b0 con 0x7f25d0060310 2022-02-02T20:19:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d5a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d5a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36424/0 (socket says 172.21.15.96:36424) 2022-02-02T20:19:22.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d5a6d700 1 -- 172.21.15.96:0/2793363664 learned_addr learned my addr 172.21.15.96:0/2793363664 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:22.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.818+0000 7f25d626e700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 0x7f25d00f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d5a6d700 1 -- 172.21.15.96:0/2793363664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 msgr2=0x7f25d00f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:22.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d5a6d700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 0x7f25d00f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:22.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d5a6d700 1 -- 172.21.15.96:0/2793363664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0005040 con 0x7f25d00f9690 2022-02-02T20:19:22.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d5a6d700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f25c0013a70 tx=0x7f25c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c0018070 con 0x7f25d00f9690 2022-02-02T20:19:22.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d00f5930 con 0x7f25d00f9690 2022-02-02T20:19:22.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25c00097d0 con 0x7f25d00f9690 2022-02-02T20:19:22.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d00f5e90 con 0x7f25d00f9690 2022-02-02T20:19:22.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.819+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c001de80 con 0x7f25d00f9690 2022-02-02T20:19:22.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.820+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b8004fa0 con 0x7f25d00f9690 2022-02-02T20:19:22.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.821+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f25c0007ba0 con 0x7f25d00f9690 2022-02-02T20:19:22.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.821+0000 7f25c6ffd700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 0x7f25bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:22.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.821+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f25c00835a0 con 0x7f25d00f9690 2022-02-02T20:19:22.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.821+0000 7f25d626e700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 0x7f25bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:22.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.821+0000 7f25d626e700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 0x7f25bc0672e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f25d00f6920 tx=0x7f25cc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:22.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:22.825+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f25c0051760 con 0x7f25d00f9690 2022-02-02T20:19:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.026+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f25b8005e80 con 0x7f25d00f9690 2022-02-02T20:19:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.026+0000 7f25c6ffd700 1 -- 172.21.15.96:0/2793363664 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f25c0054d80 con 0x7f25d00f9690 2022-02-02T20:19:23.029 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:19:23.029 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:19:23.029 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:19:23.030 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:19:23.030 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:23.030 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:19:23.030 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:19:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:19:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:19:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:19:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:19:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:19:23.032 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:19:23.032 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:19:23.032 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:19:23.032 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:19:23.032 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:19:23.033 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:19:23.033 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:19:23.033 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:19:23.033 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:19:23.033 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:19:23.034 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:19:23.034 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:19:23.034 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:19:23.034 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:19:23.034 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:19:23.035 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:19:23.035 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:19:23.036 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:19:23.036 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:19:23.036 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:19:23.036 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:23.037 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:23.037 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:19:23.037 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:23.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:23.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:23.038 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:23.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 msgr2=0x7f25bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:23.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 0x7f25bc0672e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f25d00f6920 tx=0x7f25cc00b040).stop 2022-02-02T20:19:23.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 msgr2=0x7f25d00f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:23.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f25c0013a70 tx=0x7f25c0009b30).stop 2022-02-02T20:19:23.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 shutdown_connections 2022-02-02T20:19:23.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25bc064e20 0x7f25bc0672e0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:23.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d0060310 0x7f25d00f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:23.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 --2- 172.21.15.96:0/2793363664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d00f9690 0x7f25d00f5010 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 >> 172.21.15.96:0/2793363664 conn(0x7f25d00f0b90 msgr2=0x7f25d00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 shutdown_connections 2022-02-02T20:19:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:23.028+0000 7f25d7270700 1 -- 172.21.15.96:0/2793363664 wait complete. 2022-02-02T20:19:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:19:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:23 smithi096 ceph-mon[101353]: from='client.37718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:23 smithi096 ceph-mon[101353]: from='client.37722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3078230560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:19:23.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2793363664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:19:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:23 smithi159 ceph-mon[69013]: from='client.37718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:23 smithi159 ceph-mon[69013]: from='client.37722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3078230560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:19:23.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2793363664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:19:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:24 smithi159 ceph-mon[69013]: pgmap v3519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:24 smithi096 ceph-mon[101353]: pgmap v3519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:26 smithi159 ceph-mon[69013]: pgmap v3520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:26 smithi096 ceph-mon[101353]: pgmap v3520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:27 smithi159 ceph-mon[69013]: pgmap v3521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:19:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:19:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:27 smithi096 ceph-mon[101353]: pgmap v3521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:19:28.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:19:30.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:30 smithi096 ceph-mon[101353]: pgmap v3522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:30 smithi159 ceph-mon[69013]: pgmap v3522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:32 smithi096 ceph-mon[101353]: pgmap v3523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:32 smithi159 ceph-mon[69013]: pgmap v3523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:34.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:34 smithi096 ceph-mon[101353]: pgmap v3524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:34 smithi159 ceph-mon[69013]: pgmap v3524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:36 smithi159 ceph-mon[69013]: pgmap v3525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:36 smithi096 ceph-mon[101353]: pgmap v3525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:37 smithi159 ceph-mon[69013]: pgmap v3526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:37 smithi096 ceph-mon[101353]: pgmap v3526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:40 smithi096 ceph-mon[101353]: pgmap v3527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:40 smithi159 ceph-mon[69013]: pgmap v3527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:42 smithi159 ceph-mon[69013]: pgmap v3528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:42 smithi096 ceph-mon[101353]: pgmap v3528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:44 smithi159 ceph-mon[69013]: pgmap v3529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:44 smithi096 ceph-mon[101353]: pgmap v3529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:46 smithi159 ceph-mon[69013]: pgmap v3530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:46 smithi096 ceph-mon[101353]: pgmap v3530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:47 smithi159 ceph-mon[69013]: pgmap v3531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:47 smithi096 ceph-mon[101353]: pgmap v3531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:50 smithi096 ceph-mon[101353]: pgmap v3532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:50 smithi159 ceph-mon[69013]: pgmap v3532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:52 smithi159 ceph-mon[69013]: pgmap v3533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:52 smithi096 ceph-mon[101353]: pgmap v3533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 -- 172.21.15.96:0/2435444600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 msgr2=0x7f37a00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2435444600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a00f6b30 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f3790004660 tx=0x7f3790009b30).stop 2022-02-02T20:19:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 -- 172.21.15.96:0/2435444600 shutdown_connections 2022-02-02T20:19:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2435444600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a00f6b30 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2435444600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 0x7f37a00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 -- 172.21.15.96:0/2435444600 >> 172.21.15.96:0/2435444600 conn(0x7f37a00f0b90 msgr2=0x7f37a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 -- 172.21.15.96:0/2435444600 shutdown_connections 2022-02-02T20:19:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.140+0000 7f37a69a2700 1 -- 172.21.15.96:0/2435444600 wait complete. 2022-02-02T20:19:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 Processor -- start 2022-02-02T20:19:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 -- start start 2022-02-02T20:19:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 0x7f37a0109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00603c0 con 0x7f37a00f66d0 2022-02-02T20:19:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a69a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a0060500 con 0x7f37a00f5430 2022-02-02T20:19:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36442/0 (socket says 172.21.15.96:36442) 2022-02-02T20:19:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 -- 172.21.15.96:0/2919493876 learned_addr learned my addr 172.21.15.96:0/2919493876 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a59a0700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 0x7f37a0109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 -- 172.21.15.96:0/2919493876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 msgr2=0x7f37a0109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 0x7f37a0109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.141+0000 7f37a519f700 1 -- 172.21.15.96:0/2919493876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790005040 con 0x7f37a00f66d0 2022-02-02T20:19:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37a519f700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f3790009990 tx=0x7f3790009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3790018070 con 0x7f37a00f66d0 2022-02-02T20:19:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a010c490 con 0x7f37a00f66d0 2022-02-02T20:19:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3790007ba0 con 0x7f37a00f66d0 2022-02-02T20:19:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379001c3c0 con 0x7f37a00f66d0 2022-02-02T20:19:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.142+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a010c9c0 con 0x7f37a00f66d0 2022-02-02T20:19:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.143+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0059100 con 0x7f37a00f66d0 2022-02-02T20:19:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.143+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f379001d420 con 0x7f37a00f66d0 2022-02-02T20:19:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.144+0000 7f37967fc700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 0x7f378c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.144+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3790083690 con 0x7f37a00f66d0 2022-02-02T20:19:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.144+0000 7f37a59a0700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 0x7f378c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.144+0000 7f37a59a0700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 0x7f378c0672e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f37a0060040 tx=0x7f379c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.148+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37900517f0 con 0x7f37a00f66d0 2022-02-02T20:19:53.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.327+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37a00fdd70 con 0x7f378c064e20 2022-02-02T20:19:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.328+0000 7f37967fc700 1 -- 172.21.15.96:0/2919493876 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f37a00fdd70 con 0x7f378c064e20 2022-02-02T20:19:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 msgr2=0x7f378c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 0x7f378c0672e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f37a0060040 tx=0x7f379c00b040).stop 2022-02-02T20:19:53.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 msgr2=0x7f37a010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f3790009990 tx=0x7f3790009b30).stop 2022-02-02T20:19:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 shutdown_connections 2022-02-02T20:19:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f378c064e20 0x7f378c0672e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a00f5430 0x7f37a0109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 --2- 172.21.15.96:0/2919493876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37a00f66d0 0x7f37a010bf40 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 >> 172.21.15.96:0/2919493876 conn(0x7f37a00f0b90 msgr2=0x7f37a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 shutdown_connections 2022-02-02T20:19:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.330+0000 7f37a69a2700 1 -- 172.21.15.96:0/2919493876 wait complete. 2022-02-02T20:19:53.342 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:19:53.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.428+0000 7f25dda97700 1 -- 172.21.15.96:0/3386958495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f66e0 msgr2=0x7f25d80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.428+0000 7f25dda97700 1 --2- 172.21.15.96:0/3386958495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f66e0 0x7f25d80f6b00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f25cc004660 tx=0x7f25cc009b30).stop 2022-02-02T20:19:53.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 -- 172.21.15.96:0/3386958495 shutdown_connections 2022-02-02T20:19:53.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 --2- 172.21.15.96:0/3386958495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f7980 0x7f25d80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 --2- 172.21.15.96:0/3386958495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f66e0 0x7f25d80f6b00 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 -- 172.21.15.96:0/3386958495 >> 172.21.15.96:0/3386958495 conn(0x7f25d80f1e40 msgr2=0x7f25d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 -- 172.21.15.96:0/3386958495 shutdown_connections 2022-02-02T20:19:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.429+0000 7f25dda97700 1 -- 172.21.15.96:0/3386958495 wait complete. 2022-02-02T20:19:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 Processor -- start 2022-02-02T20:19:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 -- start start 2022-02-02T20:19:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 0x7f25d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d806a380 con 0x7f25d80f7980 2022-02-02T20:19:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25dda97700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d806a4c0 con 0x7f25d80f66e0 2022-02-02T20:19:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36452/0 (socket says 172.21.15.96:36452) 2022-02-02T20:19:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d6ffd700 1 -- 172.21.15.96:0/1171009703 learned_addr learned my addr 172.21.15.96:0/1171009703 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d77fe700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 0x7f25d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d6ffd700 1 -- 172.21.15.96:0/1171009703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 msgr2=0x7f25d806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.430+0000 7f25d6ffd700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 0x7f25d806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25d6ffd700 1 -- 172.21.15.96:0/1171009703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005040 con 0x7f25d80f7980 2022-02-02T20:19:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25d77fe700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 0x7f25d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:19:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25d6ffd700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f25c800c530 tx=0x7f25c8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c800f650 con 0x7f25d80f7980 2022-02-02T20:19:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d806a7a0 con 0x7f25d80f7980 2022-02-02T20:19:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25c800fc60 con 0x7f25d80f7980 2022-02-02T20:19:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c8012cd0 con 0x7f25d80f7980 2022-02-02T20:19:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.431+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d810efe0 con 0x7f25d80f7980 2022-02-02T20:19:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.432+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d8045ad0 con 0x7f25d80f7980 2022-02-02T20:19:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.432+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f25c8010070 con 0x7f25d80f7980 2022-02-02T20:19:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.433+0000 7f25bffff700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 0x7f25c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.433+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f25c80816f0 con 0x7f25d80f7980 2022-02-02T20:19:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.433+0000 7f25d77fe700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 0x7f25c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.433+0000 7f25d77fe700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 0x7f25c0067290 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f25cc004e30 tx=0x7f25cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.437+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f25c80477d0 con 0x7f25d80f7980 2022-02-02T20:19:53.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.607+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f25d8057f10 con 0x7f25c0064dd0 2022-02-02T20:19:53.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.617+0000 7f25bffff700 1 -- 172.21.15.96:0/1171009703 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f25d8057f10 con 0x7f25c0064dd0 2022-02-02T20:19:53.619 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:19:53.619 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 93m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:19:53.619 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (115m) 93m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:19:53.620 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (115m) 92m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:19:53.620 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 93m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:19:53.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 93m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:19:53.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (115m) 93m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:19:53.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 92m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:19:53.621 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (116m) 92m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:19:53.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (117m) 93m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:19:53.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (117m) 92m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:19:53.622 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (116m) 93m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:19:53.622 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (116m) 92m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:19:53.622 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 93m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:19:53.622 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 92m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:19:53.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (115m) 93m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:19:53.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (114m) 93m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:19:53.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (114m) 93m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:19:53.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (113m) 92m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:19:53.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (113m) 92m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:19:53.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (112m) 92m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:19:53.624 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 93m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:19:53.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.618+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 msgr2=0x7f25c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.618+0000 7f25dda97700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 0x7f25c0067290 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f25cc004e30 tx=0x7f25cc009b30).stop 2022-02-02T20:19:53.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.618+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 msgr2=0x7f25d8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.618+0000 7f25dda97700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f25c800c530 tx=0x7f25c8007e20).stop 2022-02-02T20:19:53.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 shutdown_connections 2022-02-02T20:19:53.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25c0064dd0 0x7f25c0067290 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25d80f66e0 0x7f25d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 --2- 172.21.15.96:0/1171009703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d80f7980 0x7f25d8069e20 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 >> 172.21.15.96:0/1171009703 conn(0x7f25d80f1e40 msgr2=0x7f25d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 shutdown_connections 2022-02-02T20:19:53.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.619+0000 7f25dda97700 1 -- 172.21.15.96:0/1171009703 wait complete. 2022-02-02T20:19:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 -- 172.21.15.96:0/568865704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 msgr2=0x7ffbd00f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/568865704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd00f5880 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7ffbc0004660 tx=0x7ffbc0009b30).stop 2022-02-02T20:19:53.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 -- 172.21.15.96:0/568865704 shutdown_connections 2022-02-02T20:19:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/568865704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 0x7ffbd00f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:19:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/568865704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd00f5880 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.714+0000 7ffbd52a0700 1 -- 172.21.15.96:0/568865704 >> 172.21.15.96:0/568865704 conn(0x7ffbd00f0bc0 msgr2=0x7ffbd00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 -- 172.21.15.96:0/568865704 shutdown_connections 2022-02-02T20:19:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 -- 172.21.15.96:0/568865704 wait complete. 2022-02-02T20:19:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 Processor -- start 2022-02-02T20:19:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 -- start start 2022-02-02T20:19:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 0x7ffbd0069150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.715+0000 7ffbd52a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0069790 con 0x7ffbd00f5460 2022-02-02T20:19:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbd52a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd010f880 con 0x7ffbd00f6700 2022-02-02T20:19:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36460/0 (socket says 172.21.15.96:36460) 2022-02-02T20:19:53.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 -- 172.21.15.96:0/2148710261 learned_addr learned my addr 172.21.15.96:0/2148710261 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbce7fc700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 0x7ffbd0069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 -- 172.21.15.96:0/2148710261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 msgr2=0x7ffbd0069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 0x7ffbd0069150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 -- 172.21.15.96:0/2148710261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0005040 con 0x7ffbd00f5460 2022-02-02T20:19:53.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbceffd700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7ffbc0009d30 tx=0x7ffbc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc001a070 con 0x7ffbd00f5460 2022-02-02T20:19:53.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffbc00097d0 con 0x7ffbd00f5460 2022-02-02T20:19:53.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd010fb00 con 0x7ffbd00f5460 2022-02-02T20:19:53.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc001f8d0 con 0x7ffbd00f5460 2022-02-02T20:19:53.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.716+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd0110060 con 0x7ffbd00f5460 2022-02-02T20:19:53.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.718+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd0059100 con 0x7ffbd00f5460 2022-02-02T20:19:53.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.718+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffbc00125d0 con 0x7ffbd00f5460 2022-02-02T20:19:53.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.718+0000 7ffbb77fe700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 0x7ffbb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:53.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.718+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffbc0085cd0 con 0x7ffbd00f5460 2022-02-02T20:19:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.718+0000 7ffbce7fc700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 0x7ffbb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.719+0000 7ffbce7fc700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 0x7ffbb80672e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7ffbc400b790 tx=0x7ffbc4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.723+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffbc0057800 con 0x7ffbd00f5460 2022-02-02T20:19:53.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.953+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffbd00fde20 con 0x7ffbd00f5460 2022-02-02T20:19:53.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.953+0000 7ffbb77fe700 1 -- 172.21.15.96:0/2148710261 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ffbc00573f0 con 0x7ffbd00f5460 2022-02-02T20:19:53.956 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:19:53.956 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:19:53.956 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:19:53.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:53.957 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:19:53.957 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:19:53.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:53.957 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:19:53.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:19:53.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:53.958 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:19:53.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:19:53.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:19:53.959 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:19:53.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:19:53.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:19:53.959 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:19:53.960 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:19:53.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 msgr2=0x7ffbb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 0x7ffbb80672e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7ffbc400b790 tx=0x7ffbc4008040).stop 2022-02-02T20:19:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 msgr2=0x7ffbd0068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:53.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7ffbc0009d30 tx=0x7ffbc0009b30).stop 2022-02-02T20:19:53.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 shutdown_connections 2022-02-02T20:19:53.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffbb8064e20 0x7ffbb80672e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbd00f5460 0x7ffbd0068c60 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 --2- 172.21.15.96:0/2148710261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd00f6700 0x7ffbd0069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:53.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 >> 172.21.15.96:0/2148710261 conn(0x7ffbd00f0bc0 msgr2=0x7ffbd00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:53.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 shutdown_connections 2022-02-02T20:19:53.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:53.955+0000 7ffbd52a0700 1 -- 172.21.15.96:0/2148710261 wait complete. 2022-02-02T20:19:54.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 -- 172.21.15.96:0/2347364274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f55c0 msgr2=0x7fb4940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:54.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2347364274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f55c0 0x7fb4940f59e0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fb484004660 tx=0x7fb484009b30).stop 2022-02-02T20:19:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 -- 172.21.15.96:0/2347364274 shutdown_connections 2022-02-02T20:19:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2347364274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f6860 0x7fb4940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2347364274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f55c0 0x7fb4940f59e0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 -- 172.21.15.96:0/2347364274 >> 172.21.15.96:0/2347364274 conn(0x7fb4940f0d40 msgr2=0x7fb4940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:54.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 -- 172.21.15.96:0/2347364274 shutdown_connections 2022-02-02T20:19:54.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.053+0000 7fb4992c4700 1 -- 172.21.15.96:0/2347364274 wait complete. 2022-02-02T20:19:54.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 Processor -- start 2022-02-02T20:19:54.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 -- start start 2022-02-02T20:19:54.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f55c0 0x7fb494106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:54.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494107a60 con 0x7fb4940f6860 2022-02-02T20:19:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb4992c4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494107ba0 con 0x7fb4940f55c0 2022-02-02T20:19:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:54.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36472/0 (socket says 172.21.15.96:36472) 2022-02-02T20:19:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 -- 172.21.15.96:0/2691273138 learned_addr learned my addr 172.21.15.96:0/2691273138 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:19:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb492ffd700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f55c0 0x7fb494106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 -- 172.21.15.96:0/2691273138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f55c0 msgr2=0x7fb494106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:54.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f55c0 0x7fb494106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.054+0000 7fb48a7fc700 1 -- 172.21.15.96:0/2691273138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484005040 con 0x7fb4940f6860 2022-02-02T20:19:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb48a7fc700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fb47c0026d0 tx=0x7fb47c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47c009320 con 0x7fb4940f6860 2022-02-02T20:19:54.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494108540 con 0x7fb4940f6860 2022-02-02T20:19:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb47c00f040 con 0x7fb4940f6860 2022-02-02T20:19:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47c0148f0 con 0x7fb4940f6860 2022-02-02T20:19:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.055+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494108b00 con 0x7fb4940f6860 2022-02-02T20:19:54.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.056+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494045ad0 con 0x7fb4940f6860 2022-02-02T20:19:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.056+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb47c01b060 con 0x7fb4940f6860 2022-02-02T20:19:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.057+0000 7fb48bfff700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 0x7fb480067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:19:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.057+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb47c0819a0 con 0x7fb4940f6860 2022-02-02T20:19:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.057+0000 7fb492ffd700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 0x7fb480067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:19:54.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.057+0000 7fb492ffd700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 0x7fb480067290 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb484004630 tx=0x7fb484009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:19:54.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.061+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb47c0534d0 con 0x7fb4940f6860 2022-02-02T20:19:54.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.261+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4941091a0 con 0x7fb4940f6860 2022-02-02T20:19:54.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.261+0000 7fb48bfff700 1 -- 172.21.15.96:0/2691273138 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb47c0530c0 con 0x7fb4940f6860 2022-02-02T20:19:54.263 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:19:54.264 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:19:54.264 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:19:54.264 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:19:54.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:54.264 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:19:54.265 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:19:54.265 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:19:54.265 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:19:54.265 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:19:54.266 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:19:54.266 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:19:54.266 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:19:54.266 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:19:54.266 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:19:54.267 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:19:54.267 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:19:54.268 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:19:54.268 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:19:54.268 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:19:54.268 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:19:54.269 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:19:54.269 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:19:54.269 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:19:54.269 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:19:54.270 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:19:54.270 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:19:54.270 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:19:54.270 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:19:54.271 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:19:54.271 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:19:54.271 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:19:54.271 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:54.271 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:54.272 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:19:54.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:19:54.272 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:54.272 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:54.273 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:19:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 msgr2=0x7fb480067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 0x7fb480067290 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb484004630 tx=0x7fb484009b30).stop 2022-02-02T20:19:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 msgr2=0x7fb4941074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:19:54.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fb47c0026d0 tx=0x7fb47c009de0).stop 2022-02-02T20:19:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 shutdown_connections 2022-02-02T20:19:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb480064dd0 0x7fb480067290 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4940f55c0 0x7fb494106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 --2- 172.21.15.96:0/2691273138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940f6860 0x7fb4941074b0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:19:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 >> 172.21.15.96:0/2691273138 conn(0x7fb4940f0d40 msgr2=0x7fb49405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:19:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 shutdown_connections 2022-02-02T20:19:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:19:54.263+0000 7fb4992c4700 1 -- 172.21.15.96:0/2691273138 wait complete. 2022-02-02T20:19:54.276 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:19:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:54 smithi096 ceph-mon[101353]: pgmap v3534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:54 smithi096 ceph-mon[101353]: from='client.37734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2148710261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:19:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:54 smithi159 ceph-mon[69013]: pgmap v3534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:54 smithi159 ceph-mon[69013]: from='client.37734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2148710261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:19:55.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:55 smithi159 ceph-mon[69013]: from='client.37738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:55.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2691273138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:19:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:55 smithi096 ceph-mon[101353]: from='client.37738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:19:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2691273138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:19:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:56 smithi159 ceph-mon[69013]: pgmap v3535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:56 smithi096 ceph-mon[101353]: pgmap v3535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:19:57 smithi159 ceph-mon[69013]: pgmap v3536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:19:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:19:57 smithi096 ceph-mon[101353]: pgmap v3536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:00 smithi159 ceph-mon[69013]: pgmap v3537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:20:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:00 smithi096 ceph-mon[101353]: pgmap v3537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:20:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:02 smithi159 ceph-mon[69013]: pgmap v3538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:02 smithi096 ceph-mon[101353]: pgmap v3538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:04 smithi159 ceph-mon[69013]: pgmap v3539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:04 smithi096 ceph-mon[101353]: pgmap v3539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:06 smithi159 ceph-mon[69013]: pgmap v3540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:06 smithi096 ceph-mon[101353]: pgmap v3540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:07 smithi159 ceph-mon[69013]: pgmap v3541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:07 smithi096 ceph-mon[101353]: pgmap v3541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:10 smithi159 ceph-mon[69013]: pgmap v3542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:10 smithi096 ceph-mon[101353]: pgmap v3542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:12 smithi159 ceph-mon[69013]: pgmap v3543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:12 smithi096 ceph-mon[101353]: pgmap v3543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:14 smithi159 ceph-mon[69013]: pgmap v3544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:14 smithi096 ceph-mon[101353]: pgmap v3544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:16 smithi159 ceph-mon[69013]: pgmap v3545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:16 smithi096 ceph-mon[101353]: pgmap v3545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:17 smithi159 ceph-mon[69013]: pgmap v3546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:17 smithi096 ceph-mon[101353]: pgmap v3546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:20 smithi159 ceph-mon[69013]: pgmap v3547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:20 smithi096 ceph-mon[101353]: pgmap v3547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:22 smithi159 ceph-mon[69013]: pgmap v3548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:22 smithi096 ceph-mon[101353]: pgmap v3548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:24.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/1568144760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f55c0 msgr2=0x7f4adc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/1568144760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f59e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f4acc004660 tx=0x7f4acc009b30).stop 2022-02-02T20:20:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/1568144760 shutdown_connections 2022-02-02T20:20:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/1568144760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/1568144760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f59e0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/1568144760 >> 172.21.15.96:0/1568144760 conn(0x7f4adc0f0d40 msgr2=0x7f4adc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:24.378 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:24 smithi096 ceph-mon[101353]: pgmap v3549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:24.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/1568144760 shutdown_connections 2022-02-02T20:20:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.373+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/1568144760 wait complete. 2022-02-02T20:20:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 Processor -- start 2022-02-02T20:20:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 -- start start 2022-02-02T20:20:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0f8100 con 0x7f4adc0f6860 2022-02-02T20:20:24.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae3ff6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0f8240 con 0x7f4adc0f55c0 2022-02-02T20:20:24.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1591700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1591700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36494/0 (socket says 172.21.15.96:36494) 2022-02-02T20:20:24.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1591700 1 -- 172.21.15.96:0/2810773118 learned_addr learned my addr 172.21.15.96:0/2810773118 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:24.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1d92700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1591700 1 -- 172.21.15.96:0/2810773118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f55c0 msgr2=0x7f4adc0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.374+0000 7f4ae1591700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ae1591700 1 -- 172.21.15.96:0/2810773118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc005040 con 0x7f4adc0f6860 2022-02-02T20:20:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ae1591700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f4ad80026d0 tx=0x7f4ad8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad80079c0 con 0x7f4adc0f6860 2022-02-02T20:20:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ad800f040 con 0x7f4adc0f6860 2022-02-02T20:20:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc0f8520 con 0x7f4adc0f6860 2022-02-02T20:20:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad80148b0 con 0x7f4adc0f6860 2022-02-02T20:20:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.375+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc10efa0 con 0x7f4adc0f6860 2022-02-02T20:20:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.376+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc045ad0 con 0x7f4adc0f6860 2022-02-02T20:20:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.376+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ad8007b20 con 0x7f4adc0f6860 2022-02-02T20:20:24.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.377+0000 7f4ad27fc700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 0x7f4ac8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.377+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4ad80819e0 con 0x7f4adc0f6860 2022-02-02T20:20:24.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.377+0000 7f4ae1d92700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 0x7f4ac8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.377+0000 7f4ae1d92700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 0x7f4ac8067290 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f4acc013690 tx=0x7f4acc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.381+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ad804fae0 con 0x7f4adc0f6860 2022-02-02T20:20:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:24 smithi159 ceph-mon[69013]: pgmap v3549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:24.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.558+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4adc0faca0 con 0x7f4ac8064dd0 2022-02-02T20:20:24.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.559+0000 7f4ad27fc700 1 -- 172.21.15.96:0/2810773118 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4adc0faca0 con 0x7f4ac8064dd0 2022-02-02T20:20:24.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.560+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 msgr2=0x7f4ac8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.560+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 0x7f4ac8067290 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f4acc013690 tx=0x7f4acc009b30).stop 2022-02-02T20:20:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.560+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 msgr2=0x7f4adc0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.560+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f4ad80026d0 tx=0x7f4ad8009de0).stop 2022-02-02T20:20:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 shutdown_connections 2022-02-02T20:20:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ac8064dd0 0x7f4ac8067290 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc0f55c0 0x7f4adc0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 --2- 172.21.15.96:0/2810773118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4adc0f6860 0x7f4adc0f7ba0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 >> 172.21.15.96:0/2810773118 conn(0x7f4adc0f0d40 msgr2=0x7f4adc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:24.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 shutdown_connections 2022-02-02T20:20:24.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.561+0000 7f4ae3ff6700 1 -- 172.21.15.96:0/2810773118 wait complete. 2022-02-02T20:20:24.574 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:20:24.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 -- 172.21.15.96:0/40255632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f6ff0 msgr2=0x7f0cfc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 --2- 172.21.15.96:0/40255632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc0f7a20 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f0cec004660 tx=0x7f0cec009b30).stop 2022-02-02T20:20:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 -- 172.21.15.96:0/40255632 shutdown_connections 2022-02-02T20:20:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 --2- 172.21.15.96:0/40255632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc0f7a20 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 --2- 172.21.15.96:0/40255632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:20:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 -- 172.21.15.96:0/40255632 >> 172.21.15.96:0/40255632 conn(0x7f0cfc0f1f00 msgr2=0x7f0cfc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 -- 172.21.15.96:0/40255632 shutdown_connections 2022-02-02T20:20:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.659+0000 7f0d01880700 1 -- 172.21.15.96:0/40255632 wait complete. 2022-02-02T20:20:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 Processor -- start 2022-02-02T20:20:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 -- start start 2022-02-02T20:20:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc1074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc107af0 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0d01880700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1083a0 con 0x7f0cfc0f6ff0 2022-02-02T20:20:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36502/0 (socket says 172.21.15.96:36502) 2022-02-02T20:20:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 -- 172.21.15.96:0/2071581916 learned_addr learned my addr 172.21.15.96:0/2071581916 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfa7fc700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc1074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 -- 172.21.15.96:0/2071581916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f6ff0 msgr2=0x7f0cfc1074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc1074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.660+0000 7f0cfaffd700 1 -- 172.21.15.96:0/2071581916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec005040 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0cfaffd700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f0cf000b410 tx=0x7f0cf0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf00125f0 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cf0012c00 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc108680 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf0002ae0 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.661+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc108c40 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.662+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc0f5b70 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.662+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0cf000f030 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.663+0000 7f0ce37fe700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 0x7f0ce4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.663+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0cf0081f10 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.663+0000 7f0cfa7fc700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 0x7f0ce4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.663+0000 7f0cfa7fc700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 0x7f0ce4067290 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f0cec004e30 tx=0x7f0cec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.667+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0cf0053a40 con 0x7f0cfc0f66e0 2022-02-02T20:20:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.840+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cfc0fefc0 con 0x7f0ce4064dd0 2022-02-02T20:20:24.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.849+0000 7f0ce37fe700 1 -- 172.21.15.96:0/2071581916 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f0cfc0fefc0 con 0x7f0ce4064dd0 2022-02-02T20:20:24.852 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:20:24.852 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 94m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:20:24.853 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (116m) 94m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:20:24.853 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (116m) 92m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:20:24.853 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 94m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:20:24.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 94m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:20:24.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (116m) 94m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:20:24.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 92m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:20:24.854 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (116m) 92m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:20:24.855 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (118m) 94m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:20:24.855 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (117m) 92m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:20:24.855 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (117m) 94m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:20:24.855 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (116m) 92m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:20:24.856 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 94m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:20:24.856 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 92m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:20:24.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (115m) 94m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:20:24.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (115m) 94m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:20:24.856 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (114m) 94m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:20:24.857 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (114m) 92m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:20:24.857 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (113m) 92m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:20:24.857 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (113m) 92m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:20:24.857 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 94m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:20:24.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 msgr2=0x7f0ce4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 0x7f0ce4067290 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f0cec004e30 tx=0x7f0cec009b30).stop 2022-02-02T20:20:24.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 msgr2=0x7f0cfc106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f0cf000b410 tx=0x7f0cf0006ef0).stop 2022-02-02T20:20:24.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 shutdown_connections 2022-02-02T20:20:24.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce4064dd0 0x7f0ce4067290 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cfc0f66e0 0x7f0cfc106fc0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 --2- 172.21.15.96:0/2071581916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cfc0f6ff0 0x7f0cfc1074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 >> 172.21.15.96:0/2071581916 conn(0x7f0cfc0f1f00 msgr2=0x7f0cfc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:24.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 shutdown_connections 2022-02-02T20:20:24.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.851+0000 7f0d01880700 1 -- 172.21.15.96:0/2071581916 wait complete. 2022-02-02T20:20:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 -- 172.21.15.96:0/1377440235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 msgr2=0x7f9aac0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 --2- 172.21.15.96:0/1377440235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac0f5850 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f9aa0004660 tx=0x7f9aa0009b30).stop 2022-02-02T20:20:24.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 -- 172.21.15.96:0/1377440235 shutdown_connections 2022-02-02T20:20:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 --2- 172.21.15.96:0/1377440235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 0x7f9aac0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 --2- 172.21.15.96:0/1377440235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac0f5850 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 -- 172.21.15.96:0/1377440235 >> 172.21.15.96:0/1377440235 conn(0x7f9aac0f0b90 msgr2=0x7f9aac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:24.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 -- 172.21.15.96:0/1377440235 shutdown_connections 2022-02-02T20:20:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 -- 172.21.15.96:0/1377440235 wait complete. 2022-02-02T20:20:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.947+0000 7f9aabfff700 1 Processor -- start 2022-02-02T20:20:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aabfff700 1 -- start start 2022-02-02T20:20:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 0x7f9aac10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aabfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0603c0 con 0x7f9aac0f5430 2022-02-02T20:20:24.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aabfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac060500 con 0x7f9aac0f66d0 2022-02-02T20:20:24.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36510/0 (socket says 172.21.15.96:36510) 2022-02-02T20:20:24.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 -- 172.21.15.96:0/510021899 learned_addr learned my addr 172.21.15.96:0/510021899 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:24.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaa7fc700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 0x7f9aac10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 -- 172.21.15.96:0/510021899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 msgr2=0x7f9aac10bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:24.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 0x7f9aac10bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:24.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 -- 172.21.15.96:0/510021899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0005040 con 0x7f9aac0f5430 2022-02-02T20:20:24.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.948+0000 7f9aaaffd700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f9aa0013a70 tx=0x7f9aa0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.949+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa0018070 con 0x7f9aac0f5430 2022-02-02T20:20:24.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.949+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac10c500 con 0x7f9aac0f5430 2022-02-02T20:20:24.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.949+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9aa00097d0 con 0x7f9aac0f5430 2022-02-02T20:20:24.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.949+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa001de80 con 0x7f9aac0f5430 2022-02-02T20:20:24.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.949+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac10ca30 con 0x7f9aac0f5430 2022-02-02T20:20:24.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.950+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac045ad0 con 0x7f9aac0f5430 2022-02-02T20:20:24.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.951+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9aa0007ba0 con 0x7f9aac0f5430 2022-02-02T20:20:24.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.951+0000 7f9a937fe700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 0x7f9a940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:24.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.951+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9aa0083b20 con 0x7f9aac0f5430 2022-02-02T20:20:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.951+0000 7f9aaa7fc700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 0x7f9a940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:24.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.952+0000 7f9aaa7fc700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 0x7f9a940672e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f9a9c004c40 tx=0x7f9a9c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:24.955+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9aa0051d60 con 0x7f9aac0f5430 2022-02-02T20:20:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.189+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9aac0fdd70 con 0x7f9aac0f5430 2022-02-02T20:20:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.189+0000 7f9a937fe700 1 -- 172.21.15.96:0/510021899 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9aa0055380 con 0x7f9aac0f5430 2022-02-02T20:20:25.193 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:20:25.193 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:20:25.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:20:25.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:25.194 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:20:25.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:20:25.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:25.195 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:20:25.196 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:20:25.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:25.196 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:20:25.196 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:20:25.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:25.197 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:20:25.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:20:25.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:20:25.197 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:20:25.198 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:20:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 msgr2=0x7f9a940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 0x7f9a940672e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f9a9c004c40 tx=0x7f9a9c00b040).stop 2022-02-02T20:20:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 msgr2=0x7f9aac109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f9aa0013a70 tx=0x7f9aa0009b30).stop 2022-02-02T20:20:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 shutdown_connections 2022-02-02T20:20:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a94064e20 0x7f9a940672e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aac0f5430 0x7f9aac109ab0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 --2- 172.21.15.96:0/510021899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aac0f66d0 0x7f9aac10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.191+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 >> 172.21.15.96:0/510021899 conn(0x7f9aac0f0b90 msgr2=0x7f9aac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:25.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.192+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 shutdown_connections 2022-02-02T20:20:25.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.192+0000 7f9aabfff700 1 -- 172.21.15.96:0/510021899 wait complete. 2022-02-02T20:20:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 -- 172.21.15.96:0/695859045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 msgr2=0x7f59e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 --2- 172.21.15.96:0/695859045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e80f6cc0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f59e4004660 tx=0x7f59e4009b30).stop 2022-02-02T20:20:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 -- 172.21.15.96:0/695859045 shutdown_connections 2022-02-02T20:20:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 --2- 172.21.15.96:0/695859045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e80f6cc0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 --2- 172.21.15.96:0/695859045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 0x7f59e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 -- 172.21.15.96:0/695859045 >> 172.21.15.96:0/695859045 conn(0x7f59e80f0d40 msgr2=0x7f59e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:25.294 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:25 smithi096 ceph-mon[101353]: from='client.37750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.289+0000 7f59ef82e700 1 -- 172.21.15.96:0/695859045 shutdown_connections 2022-02-02T20:20:25.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.291+0000 7f59ef82e700 1 -- 172.21.15.96:0/695859045 wait complete. 2022-02-02T20:20:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.291+0000 7f59ef82e700 1 Processor -- start 2022-02-02T20:20:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ef82e700 1 -- start start 2022-02-02T20:20:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ef82e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 0x7f59e8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ef82e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ef82e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80603e0 con 0x7f59e80f6860 2022-02-02T20:20:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ef82e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8060520 con 0x7f59e80f55c0 2022-02-02T20:20:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36522/0 (socket says 172.21.15.96:36522) 2022-02-02T20:20:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 -- 172.21.15.96:0/164677510 learned_addr learned my addr 172.21.15.96:0/164677510 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ed5ca700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 0x7f59e8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 -- 172.21.15.96:0/164677510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 msgr2=0x7f59e8109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 0x7f59e8109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.292+0000 7f59ecdc9700 1 -- 172.21.15.96:0/164677510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4005040 con 0x7f59e80f6860 2022-02-02T20:20:25.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ecdc9700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f59e4009990 tx=0x7f59e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:25.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e4018070 con 0x7f59e80f6860 2022-02-02T20:20:25.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e810c6a0 con 0x7f59e80f6860 2022-02-02T20:20:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f59e4007ba0 con 0x7f59e80f6860 2022-02-02T20:20:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e401c3c0 con 0x7f59e80f6860 2022-02-02T20:20:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.293+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e810cc00 con 0x7f59e80f6860 2022-02-02T20:20:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.294+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e8045ad0 con 0x7f59e80f6860 2022-02-02T20:20:25.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.294+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f59e401d420 con 0x7f59e80f6860 2022-02-02T20:20:25.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.295+0000 7f59ddffb700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 0x7f59d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:25.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.295+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f59e40836a0 con 0x7f59e80f6860 2022-02-02T20:20:25.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.295+0000 7f59ed5ca700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 0x7f59d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:25.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.295+0000 7f59ed5ca700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 0x7f59d4067290 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f59e8060060 tx=0x7f59d800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:25.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.299+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f59e4051860 con 0x7f59e80f6860 2022-02-02T20:20:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.501+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f59e8027a00 con 0x7f59e80f6860 2022-02-02T20:20:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.502+0000 7f59ddffb700 1 -- 172.21.15.96:0/164677510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f59e4054e80 con 0x7f59e80f6860 2022-02-02T20:20:25.505 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:20:25.505 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:20:25.506 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:20:25.506 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:20:25.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:25.506 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:20:25.507 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:20:25.507 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:20:25.507 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:20:25.507 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:20:25.508 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:20:25.508 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:20:25.508 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:20:25.508 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:20:25.509 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:20:25.509 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:20:25.509 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:20:25.509 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:20:25.509 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:20:25.510 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:20:25.510 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:20:25.510 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:20:25.510 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:20:25.511 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:20:25.511 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:20:25.511 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:20:25.511 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:20:25.511 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:20:25.512 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:20:25.512 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:20:25.512 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:20:25.512 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:20:25.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:25.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:25.513 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:20:25.513 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:25.513 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:25.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:25.514 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 msgr2=0x7f59d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 0x7f59d4067290 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f59e8060060 tx=0x7f59d800b040).stop 2022-02-02T20:20:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 msgr2=0x7f59e810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:25.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f59e4009990 tx=0x7f59e4009b30).stop 2022-02-02T20:20:25.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 shutdown_connections 2022-02-02T20:20:25.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59d4064dd0 0x7f59d4067290 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e80f55c0 0x7f59e8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 --2- 172.21.15.96:0/164677510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59e80f6860 0x7f59e810c150 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 >> 172.21.15.96:0/164677510 conn(0x7f59e80f0d40 msgr2=0x7f59e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 shutdown_connections 2022-02-02T20:20:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:25.505+0000 7f59ef82e700 1 -- 172.21.15.96:0/164677510 wait complete. 2022-02-02T20:20:25.519 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:20:25.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:25 smithi159 ceph-mon[69013]: from='client.37750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:26.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:26 smithi159 ceph-mon[69013]: from='client.37754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:26 smithi159 ceph-mon[69013]: pgmap v3550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/510021899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:20:26.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/164677510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:20:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:26 smithi096 ceph-mon[101353]: from='client.37754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:26 smithi096 ceph-mon[101353]: pgmap v3550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:26.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/510021899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:20:26.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/164677510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:20:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:27 smithi159 ceph-mon[69013]: pgmap v3551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:20:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:20:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:27 smithi096 ceph-mon[101353]: pgmap v3551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:20:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:20:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:30 smithi159 ceph-mon[69013]: pgmap v3552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:30 smithi096 ceph-mon[101353]: pgmap v3552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:32 smithi159 ceph-mon[69013]: pgmap v3553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:32.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:32 smithi096 ceph-mon[101353]: pgmap v3553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:34 smithi159 ceph-mon[69013]: pgmap v3554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:34 smithi096 ceph-mon[101353]: pgmap v3554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:36 smithi159 ceph-mon[69013]: pgmap v3555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:36 smithi096 ceph-mon[101353]: pgmap v3555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:37 smithi159 ceph-mon[69013]: pgmap v3556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:37 smithi096 ceph-mon[101353]: pgmap v3556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:40 smithi159 ceph-mon[69013]: pgmap v3557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:40 smithi096 ceph-mon[101353]: pgmap v3557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:42 smithi159 ceph-mon[69013]: pgmap v3558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:42 smithi096 ceph-mon[101353]: pgmap v3558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:44 smithi159 ceph-mon[69013]: pgmap v3559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:44 smithi096 ceph-mon[101353]: pgmap v3559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:46 smithi159 ceph-mon[69013]: pgmap v3560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:46 smithi096 ceph-mon[101353]: pgmap v3560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:47 smithi159 ceph-mon[69013]: pgmap v3561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:47 smithi096 ceph-mon[101353]: pgmap v3561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:50 smithi159 ceph-mon[69013]: pgmap v3562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:50 smithi096 ceph-mon[101353]: pgmap v3562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:52 smithi159 ceph-mon[69013]: pgmap v3563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:52 smithi096 ceph-mon[101353]: pgmap v3563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:54 smithi159 ceph-mon[69013]: pgmap v3564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:54 smithi096 ceph-mon[101353]: pgmap v3564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:55.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 -- 172.21.15.96:0/3306243102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 msgr2=0x7f370c0f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 --2- 172.21.15.96:0/3306243102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c0f4820 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f36fc004660 tx=0x7f36fc009b30).stop 2022-02-02T20:20:55.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 -- 172.21.15.96:0/3306243102 shutdown_connections 2022-02-02T20:20:55.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 --2- 172.21.15.96:0/3306243102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c0f4820 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 --2- 172.21.15.96:0/3306243102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c0f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 -- 172.21.15.96:0/3306243102 >> 172.21.15.96:0/3306243102 conn(0x7f370c0f0540 msgr2=0x7f370c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:55.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 -- 172.21.15.96:0/3306243102 shutdown_connections 2022-02-02T20:20:55.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 -- 172.21.15.96:0/3306243102 wait complete. 2022-02-02T20:20:55.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.616+0000 7f3711c41700 1 Processor -- start 2022-02-02T20:20:55.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f3711c41700 1 -- start start 2022-02-02T20:20:55.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f3711c41700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f3711c41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f3711c41700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c10dfb0 con 0x7f370c0f8610 2022-02-02T20:20:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f3711c41700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c10e0f0 con 0x7f370c0f7d00 2022-02-02T20:20:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36544/0 (socket says 172.21.15.96:36544) 2022-02-02T20:20:55.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 -- 172.21.15.96:0/2260395876 learned_addr learned my addr 172.21.15.96:0/2260395876 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:55.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370b7fe700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 -- 172.21.15.96:0/2260395876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 msgr2=0x7f370c10d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c10d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 -- 172.21.15.96:0/2260395876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc005040 con 0x7f370c0f8610 2022-02-02T20:20:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370b7fe700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:20:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.617+0000 7f370affd700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f36fc009990 tx=0x7f36fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.618+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc018070 con 0x7f370c0f8610 2022-02-02T20:20:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.618+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c10ea30 con 0x7f370c0f8610 2022-02-02T20:20:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.618+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f36fc007ba0 con 0x7f370c0f8610 2022-02-02T20:20:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.618+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc01c3c0 con 0x7f370c0f8610 2022-02-02T20:20:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.618+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c10ef90 con 0x7f370c0f8610 2022-02-02T20:20:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.619+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c045ad0 con 0x7f370c0f8610 2022-02-02T20:20:55.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.620+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f36fc01d420 con 0x7f370c0f8610 2022-02-02T20:20:55.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.620+0000 7f3703fff700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 0x7f36f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.620+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f36fc083570 con 0x7f370c0f8610 2022-02-02T20:20:55.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.620+0000 7f370b7fe700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 0x7f36f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.620+0000 7f370b7fe700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 0x7f36f8067290 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f36f4009740 tx=0x7f36f4009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:55.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.624+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f36fc055120 con 0x7f370c0f8610 2022-02-02T20:20:55.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.801+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f370c0feff0 con 0x7f36f8064dd0 2022-02-02T20:20:55.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.803+0000 7f3703fff700 1 -- 172.21.15.96:0/2260395876 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f370c0feff0 con 0x7f36f8064dd0 2022-02-02T20:20:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 msgr2=0x7f36f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 0x7f36f8067290 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f36f4009740 tx=0x7f36f4009be0).stop 2022-02-02T20:20:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 msgr2=0x7f370c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f36fc009990 tx=0x7f36fc009b30).stop 2022-02-02T20:20:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 shutdown_connections 2022-02-02T20:20:55.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064dd0 0x7f36f8067290 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f7d00 0x7f370c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 --2- 172.21.15.96:0/2260395876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f8610 0x7f370c10da00 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.804+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 >> 172.21.15.96:0/2260395876 conn(0x7f370c0f0540 msgr2=0x7f370c0f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:55.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.805+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 shutdown_connections 2022-02-02T20:20:55.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.805+0000 7f3711c41700 1 -- 172.21.15.96:0/2260395876 wait complete. 2022-02-02T20:20:55.818 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:20:55.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 -- 172.21.15.96:0/2053920096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 msgr2=0x7fe7580f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/2053920096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe7580f5850 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fe748004660 tx=0x7fe748009b30).stop 2022-02-02T20:20:55.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 -- 172.21.15.96:0/2053920096 shutdown_connections 2022-02-02T20:20:55.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/2053920096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe7580f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:20:55.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/2053920096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe7580f5850 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.901+0000 7fe75d3d1700 1 -- 172.21.15.96:0/2053920096 >> 172.21.15.96:0/2053920096 conn(0x7fe7580f0b90 msgr2=0x7fe7580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:55.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.902+0000 7fe75d3d1700 1 -- 172.21.15.96:0/2053920096 shutdown_connections 2022-02-02T20:20:55.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.902+0000 7fe75d3d1700 1 -- 172.21.15.96:0/2053920096 wait complete. 2022-02-02T20:20:55.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.902+0000 7fe75d3d1700 1 Processor -- start 2022-02-02T20:20:55.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe75d3d1700 1 -- start start 2022-02-02T20:20:55.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe75d3d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe75d3d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe75810bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe75d3d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580604b0 con 0x7fe7580f5430 2022-02-02T20:20:55.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe75d3d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580605f0 con 0x7fe7580f66d0 2022-02-02T20:20:55.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36552/0 (socket says 172.21.15.96:36552) 2022-02-02T20:20:55.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 -- 172.21.15.96:0/1217309148 learned_addr learned my addr 172.21.15.96:0/1217309148 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:55.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe7577fe700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe75810bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 -- 172.21.15.96:0/1217309148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 msgr2=0x7fe75810bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe75810bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe757fff700 1 -- 172.21.15.96:0/1217309148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748005040 con 0x7fe7580f5430 2022-02-02T20:20:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.903+0000 7fe7577fe700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe75810bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:20:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe757fff700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fe748004f60 tx=0x7fe748009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe748018070 con 0x7fe7580f5430 2022-02-02T20:20:55.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe748007ba0 con 0x7fe7580f5430 2022-02-02T20:20:55.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75810c570 con 0x7fe7580f5430 2022-02-02T20:20:55.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74801c620 con 0x7fe7580f5430 2022-02-02T20:20:55.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.904+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75810cad0 con 0x7fe7580f5430 2022-02-02T20:20:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.905+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe758045ad0 con 0x7fe7580f5430 2022-02-02T20:20:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.905+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe74801c8e0 con 0x7fe7580f5430 2022-02-02T20:20:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.906+0000 7fe754ff9700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 0x7fe7400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.906+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe748083960 con 0x7fe7580f5430 2022-02-02T20:20:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.906+0000 7fe7577fe700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 0x7fe7400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.906+0000 7fe7577fe700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 0x7fe7400672e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe74c00a7e0 tx=0x7fe74c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:55.910+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe748051a60 con 0x7fe7580f5430 2022-02-02T20:20:56.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.082+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7580fddf0 con 0x7fe740064e20 2022-02-02T20:20:56.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.091+0000 7fe754ff9700 1 -- 172.21.15.96:0/1217309148 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fe7580fddf0 con 0x7fe740064e20 2022-02-02T20:20:56.094 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:20:56.094 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 94m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:20:56.094 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (116m) 94m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:20:56.094 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (116m) 93m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:20:56.095 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 94m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:20:56.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 94m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:20:56.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (117m) 94m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:20:56.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 93m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:20:56.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (117m) 93m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:20:56.096 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (118m) 94m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:20:56.096 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (118m) 93m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:20:56.096 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (117m) 94m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:20:56.096 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (117m) 93m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:20:56.097 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 94m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:20:56.097 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 93m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:20:56.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (116m) 94m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:20:56.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (115m) 94m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:20:56.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (115m) 94m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:20:56.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (114m) 93m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:20:56.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (114m) 93m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:20:56.098 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (113m) 93m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:20:56.098 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 94m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:20:56.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 msgr2=0x7fe7400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 0x7fe7400672e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe74c00a7e0 tx=0x7fe74c008040).stop 2022-02-02T20:20:56.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 msgr2=0x7fe758109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fe748004f60 tx=0x7fe748009b30).stop 2022-02-02T20:20:56.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 shutdown_connections 2022-02-02T20:20:56.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe740064e20 0x7fe7400672e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7580f5430 0x7fe758109a70 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 --2- 172.21.15.96:0/1217309148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7580f66d0 0x7fe75810bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 >> 172.21.15.96:0/1217309148 conn(0x7fe7580f0b90 msgr2=0x7fe7580fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:56.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 shutdown_connections 2022-02-02T20:20:56.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.093+0000 7fe75d3d1700 1 -- 172.21.15.96:0/1217309148 wait complete. 2022-02-02T20:20:56.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 -- 172.21.15.96:0/1765858929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 msgr2=0x7f79cc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 --2- 172.21.15.96:0/1765858929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc0f7de0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f79c8004660 tx=0x7f79c8009b30).stop 2022-02-02T20:20:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 -- 172.21.15.96:0/1765858929 shutdown_connections 2022-02-02T20:20:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 --2- 172.21.15.96:0/1765858929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc0f7de0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 --2- 172.21.15.96:0/1765858929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 0x7f79cc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:20:56.194 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:56 smithi096 ceph-mon[101353]: pgmap v3565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:56.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 -- 172.21.15.96:0/1765858929 >> 172.21.15.96:0/1765858929 conn(0x7f79cc0f1e40 msgr2=0x7f79cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:56.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.189+0000 7f79d3457700 1 -- 172.21.15.96:0/1765858929 shutdown_connections 2022-02-02T20:20:56.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 -- 172.21.15.96:0/1765858929 wait complete. 2022-02-02T20:20:56.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 Processor -- start 2022-02-02T20:20:56.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 -- start start 2022-02-02T20:20:56.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 0x7f79cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc10acd0 con 0x7f79cc0f7980 2022-02-02T20:20:56.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d3457700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc10ae10 con 0x7f79cc0f66e0 2022-02-02T20:20:56.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d09f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d09f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36564/0 (socket says 172.21.15.96:36564) 2022-02-02T20:20:56.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.190+0000 7f79d09f2700 1 -- 172.21.15.96:0/864367031 learned_addr learned my addr 172.21.15.96:0/864367031 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:56.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d11f3700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 0x7f79cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d09f2700 1 -- 172.21.15.96:0/864367031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 msgr2=0x7f79cc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d09f2700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 0x7f79cc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d09f2700 1 -- 172.21.15.96:0/864367031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8005040 con 0x7f79cc0f7980 2022-02-02T20:20:56.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d09f2700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f79c8009990 tx=0x7f79c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:56.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c8018070 con 0x7f79cc0f7980 2022-02-02T20:20:56.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc06a400 con 0x7f79cc0f7980 2022-02-02T20:20:56.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79c8007ba0 con 0x7f79cc0f7980 2022-02-02T20:20:56.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c801c620 con 0x7f79cc0f7980 2022-02-02T20:20:56.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.191+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc06a960 con 0x7f79cc0f7980 2022-02-02T20:20:56.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.192+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc045ad0 con 0x7f79cc0f7980 2022-02-02T20:20:56.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.193+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f79c801c8e0 con 0x7f79cc0f7980 2022-02-02T20:20:56.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.193+0000 7f79bdffb700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 0x7f79b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.193+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f79c8083850 con 0x7f79cc0f7980 2022-02-02T20:20:56.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.193+0000 7f79d11f3700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 0x7f79b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.194+0000 7f79d11f3700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 0x7f79b8067290 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f79cc06b730 tx=0x7f79c0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:56.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.197+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79c8051950 con 0x7f79cc0f7980 2022-02-02T20:20:56.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.430+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f79cc06ac40 con 0x7f79cc0f7980 2022-02-02T20:20:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.430+0000 7f79bdffb700 1 -- 172.21.15.96:0/864367031 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f79c8054f70 con 0x7f79cc0f7980 2022-02-02T20:20:56.433 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:20:56.434 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:20:56.434 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:20:56.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:56.434 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:20:56.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:20:56.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:56.435 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:20:56.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:20:56.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:56.436 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:20:56.436 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:20:56.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:20:56.436 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:20:56.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:20:56.437 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:20:56.437 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:20:56.437 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:20:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 msgr2=0x7f79b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 0x7f79b8067290 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f79cc06b730 tx=0x7f79c0008040).stop 2022-02-02T20:20:56.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 msgr2=0x7f79cc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f79c8009990 tx=0x7f79c8009b30).stop 2022-02-02T20:20:56.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 shutdown_connections 2022-02-02T20:20:56.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b8064dd0 0x7f79b8067290 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79cc0f66e0 0x7f79cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 --2- 172.21.15.96:0/864367031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79cc0f7980 0x7f79cc069e20 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 >> 172.21.15.96:0/864367031 conn(0x7f79cc0f1e40 msgr2=0x7f79cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:56.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 shutdown_connections 2022-02-02T20:20:56.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.432+0000 7f79d3457700 1 -- 172.21.15.96:0/864367031 wait complete. 2022-02-02T20:20:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:56 smithi159 ceph-mon[69013]: pgmap v3565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 -- 172.21.15.96:0/3876556752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 msgr2=0x7fec500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 --2- 172.21.15.96:0/3876556752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 0x7fec500f5850 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7fec40004660 tx=0x7fec40009b30).stop 2022-02-02T20:20:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 -- 172.21.15.96:0/3876556752 shutdown_connections 2022-02-02T20:20:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 --2- 172.21.15.96:0/3876556752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f66d0 0x7fec500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 --2- 172.21.15.96:0/3876556752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 0x7fec500f5850 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 -- 172.21.15.96:0/3876556752 >> 172.21.15.96:0/3876556752 conn(0x7fec500f0b90 msgr2=0x7fec500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 -- 172.21.15.96:0/3876556752 shutdown_connections 2022-02-02T20:20:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.529+0000 7fec56a99700 1 -- 172.21.15.96:0/3876556752 wait complete. 2022-02-02T20:20:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 Processor -- start 2022-02-02T20:20:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 -- start start 2022-02-02T20:20:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec50109a40 con 0x7fec500f66d0 2022-02-02T20:20:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec56a99700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec50109b80 con 0x7fec500f5430 2022-02-02T20:20:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec55296700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec55296700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36574/0 (socket says 172.21.15.96:36574) 2022-02-02T20:20:56.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.530+0000 7fec55296700 1 -- 172.21.15.96:0/2799164736 learned_addr learned my addr 172.21.15.96:0/2799164736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:20:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec55a97700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec55296700 1 -- 172.21.15.96:0/2799164736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 msgr2=0x7fec50108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec55296700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec55296700 1 -- 172.21.15.96:0/2799164736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40005040 con 0x7fec500f66d0 2022-02-02T20:20:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec55296700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fec4c0026d0 tx=0x7fec4c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4c009320 con 0x7fec500f66d0 2022-02-02T20:20:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5010a520 con 0x7fec500f66d0 2022-02-02T20:20:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec4c00f040 con 0x7fec500f66d0 2022-02-02T20:20:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4c0147e0 con 0x7fec500f66d0 2022-02-02T20:20:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.531+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5010aae0 con 0x7fec500f66d0 2022-02-02T20:20:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.532+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec50045ad0 con 0x7fec500f66d0 2022-02-02T20:20:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.533+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec4c009480 con 0x7fec500f66d0 2022-02-02T20:20:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.533+0000 7fec467fc700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:20:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.533+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec4c082090 con 0x7fec500f66d0 2022-02-02T20:20:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.533+0000 7fec55a97700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:20:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.534+0000 7fec55a97700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fec40009da0 tx=0x7fec40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:20:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.537+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec4c053bc0 con 0x7fec500f66d0 2022-02-02T20:20:56.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.743+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec5010f5c0 con 0x7fec500f66d0 2022-02-02T20:20:56.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.743+0000 7fec467fc700 1 -- 172.21.15.96:0/2799164736 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fec4c0537b0 con 0x7fec500f66d0 2022-02-02T20:20:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:20:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:20:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:20:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:20:56.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:20:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:20:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:20:56.749 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:20:56.749 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:20:56.749 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:20:56.749 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:20:56.749 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:20:56.750 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:20:56.750 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:20:56.750 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:20:56.750 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:20:56.751 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:20:56.751 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:20:56.751 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:20:56.751 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:20:56.752 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:20:56.752 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:20:56.752 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:20:56.752 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:20:56.753 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:20:56.753 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:20:56.753 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:20:56.753 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:20:56.754 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:20:56.754 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:20:56.754 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:20:56.754 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:56.754 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:56.755 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:20:56.755 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:20:56.755 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:56.755 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:56.756 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:20:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 msgr2=0x7fec3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fec40009da0 tx=0x7fec40009b30).stop 2022-02-02T20:20:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 msgr2=0x7fec50109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:20:56.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fec4c0026d0 tx=0x7fec4c009de0).stop 2022-02-02T20:20:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 shutdown_connections 2022-02-02T20:20:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 --2- 172.21.15.96:0/2799164736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec50109490 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:20:56.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 >> 172.21.15.96:0/2799164736 conn(0x7fec500f0b90 msgr2=0x7fec5005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:20:56.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 shutdown_connections 2022-02-02T20:20:56.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:20:56.746+0000 7fec56a99700 1 -- 172.21.15.96:0/2799164736 wait complete. 2022-02-02T20:20:56.760 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:20:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:57 smithi159 ceph-mon[69013]: from='client.37766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:57 smithi159 ceph-mon[69013]: from='client.37770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/864367031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:20:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2799164736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:20:57.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:57 smithi096 ceph-mon[101353]: from='client.37766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:57.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:57 smithi096 ceph-mon[101353]: from='client.37770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:20:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/864367031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:20:57.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2799164736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:20:58.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:20:58 smithi159 ceph-mon[69013]: pgmap v3566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:20:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:20:58 smithi096 ceph-mon[101353]: pgmap v3566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:00 smithi159 ceph-mon[69013]: pgmap v3567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:00 smithi096 ceph-mon[101353]: pgmap v3567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:02 smithi159 ceph-mon[69013]: pgmap v3568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:02 smithi096 ceph-mon[101353]: pgmap v3568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:04 smithi159 ceph-mon[69013]: pgmap v3569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:04 smithi096 ceph-mon[101353]: pgmap v3569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:06 smithi159 ceph-mon[69013]: pgmap v3570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:06 smithi096 ceph-mon[101353]: pgmap v3570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:07 smithi159 ceph-mon[69013]: pgmap v3571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:07 smithi096 ceph-mon[101353]: pgmap v3571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:10 smithi159 ceph-mon[69013]: pgmap v3572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:10 smithi096 ceph-mon[101353]: pgmap v3572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:12 smithi159 ceph-mon[69013]: pgmap v3573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:12 smithi096 ceph-mon[101353]: pgmap v3573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:14 smithi159 ceph-mon[69013]: pgmap v3574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:14 smithi096 ceph-mon[101353]: pgmap v3574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:16.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:16 smithi159 ceph-mon[69013]: pgmap v3575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:16 smithi096 ceph-mon[101353]: pgmap v3575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:17 smithi159 ceph-mon[69013]: pgmap v3576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:17 smithi096 ceph-mon[101353]: pgmap v3576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:20 smithi159 ceph-mon[69013]: pgmap v3577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:20 smithi096 ceph-mon[101353]: pgmap v3577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:22 smithi159 ceph-mon[69013]: pgmap v3578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:22 smithi096 ceph-mon[101353]: pgmap v3578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:24 smithi159 ceph-mon[69013]: pgmap v3579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:24 smithi096 ceph-mon[101353]: pgmap v3579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:26 smithi159 ceph-mon[69013]: pgmap v3580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:26 smithi096 ceph-mon[101353]: pgmap v3580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:26.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- 172.21.15.96:0/223604643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 msgr2=0x7fcc500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:26.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 --2- 172.21.15.96:0/223604643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc500f6cc0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fcc40004660 tx=0x7fcc40009b30).stop 2022-02-02T20:21:26.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- 172.21.15.96:0/223604643 shutdown_connections 2022-02-02T20:21:26.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 --2- 172.21.15.96:0/223604643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc500f6cc0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:26.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 --2- 172.21.15.96:0/223604643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:26.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- 172.21.15.96:0/223604643 >> 172.21.15.96:0/223604643 conn(0x7fcc500f0d40 msgr2=0x7fcc500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:26.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- 172.21.15.96:0/223604643 shutdown_connections 2022-02-02T20:21:26.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- 172.21.15.96:0/223604643 wait complete. 2022-02-02T20:21:26.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 Processor -- start 2022-02-02T20:21:26.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- start start 2022-02-02T20:21:26.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc50105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:26.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:26.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc501069b0 con 0x7fcc500f6860 2022-02-02T20:21:26.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.857+0000 7fcc5808a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc501071c0 con 0x7fcc500f55c0 2022-02-02T20:21:26.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:26.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36596/0 (socket says 172.21.15.96:36596) 2022-02-02T20:21:26.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 -- 172.21.15.96:0/1588806918 learned_addr learned my addr 172.21.15.96:0/1588806918 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:26.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55e26700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc50105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:26.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 -- 172.21.15.96:0/1588806918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 msgr2=0x7fcc50105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:26.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc50105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:26.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 -- 172.21.15.96:0/1588806918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40005040 con 0x7fcc500f6860 2022-02-02T20:21:26.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55e26700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc50105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:21:26.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc55625700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fcc40009990 tx=0x7fcc40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:26.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc40018070 con 0x7fcc500f6860 2022-02-02T20:21:26.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc501073e0 con 0x7fcc500f6860 2022-02-02T20:21:26.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc40007ca0 con 0x7fcc500f6860 2022-02-02T20:21:26.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4001c620 con 0x7fcc500f6860 2022-02-02T20:21:26.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.858+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc50107940 con 0x7fcc500f6860 2022-02-02T20:21:26.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.859+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc500f49b0 con 0x7fcc500f6860 2022-02-02T20:21:26.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.860+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcc4001d960 con 0x7fcc500f6860 2022-02-02T20:21:26.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.860+0000 7fcc467fc700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 0x7fcc3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:26.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.860+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcc400837d0 con 0x7fcc500f6860 2022-02-02T20:21:26.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.860+0000 7fcc55e26700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 0x7fcc3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:26.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.861+0000 7fcc55e26700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 0x7fcc3c067290 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fcc4c007fd0 tx=0x7fcc4c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:26.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:26.865+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcc40051a40 con 0x7fcc500f6860 2022-02-02T20:21:27.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.043+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc500fdf10 con 0x7fcc3c064dd0 2022-02-02T20:21:27.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.044+0000 7fcc467fc700 1 -- 172.21.15.96:0/1588806918 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcc500fdf10 con 0x7fcc3c064dd0 2022-02-02T20:21:27.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 msgr2=0x7fcc3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 0x7fcc3c067290 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fcc4c007fd0 tx=0x7fcc4c009040).stop 2022-02-02T20:21:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 msgr2=0x7fcc501063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fcc40009990 tx=0x7fcc40009b30).stop 2022-02-02T20:21:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 shutdown_connections 2022-02-02T20:21:27.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc3c064dd0 0x7fcc3c067290 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc500f55c0 0x7fcc50105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 --2- 172.21.15.96:0/1588806918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc500f6860 0x7fcc501063b0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 >> 172.21.15.96:0/1588806918 conn(0x7fcc500f0d40 msgr2=0x7fcc500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 shutdown_connections 2022-02-02T20:21:27.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.046+0000 7fcc5808a700 1 -- 172.21.15.96:0/1588806918 wait complete. 2022-02-02T20:21:27.057 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:21:27.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 -- 172.21.15.96:0/64924384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 msgr2=0x7f51a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 --2- 172.21.15.96:0/64924384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f6cc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f5194004660 tx=0x7f5194009b30).stop 2022-02-02T20:21:27.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 -- 172.21.15.96:0/64924384 shutdown_connections 2022-02-02T20:21:27.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 --2- 172.21.15.96:0/64924384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f6cc0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 --2- 172.21.15.96:0/64924384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 0x7f51a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 -- 172.21.15.96:0/64924384 >> 172.21.15.96:0/64924384 conn(0x7f51a00f0d40 msgr2=0x7f51a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 -- 172.21.15.96:0/64924384 shutdown_connections 2022-02-02T20:21:27.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.143+0000 7f51a6465700 1 -- 172.21.15.96:0/64924384 wait complete. 2022-02-02T20:21:27.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 Processor -- start 2022-02-02T20:21:27.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 -- start start 2022-02-02T20:21:27.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 0x7f51a00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00f8100 con 0x7f51a00f6860 2022-02-02T20:21:27.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f51a6465700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00f8240 con 0x7f51a00f55c0 2022-02-02T20:21:27.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36606/0 (socket says 172.21.15.96:36606) 2022-02-02T20:21:27.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.144+0000 7f519f7fe700 1 -- 172.21.15.96:0/671319391 learned_addr learned my addr 172.21.15.96:0/671319391 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519ffff700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 0x7f51a00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519f7fe700 1 -- 172.21.15.96:0/671319391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 msgr2=0x7f51a00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519f7fe700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 0x7f51a00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519f7fe700 1 -- 172.21.15.96:0/671319391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194005040 con 0x7f51a00f6860 2022-02-02T20:21:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519f7fe700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f5194009990 tx=0x7f5194009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5194018070 con 0x7f51a00f6860 2022-02-02T20:21:27.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a00f84c0 con 0x7f51a00f6860 2022-02-02T20:21:27.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00f8a20 con 0x7f51a00f6860 2022-02-02T20:21:27.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5194007ba0 con 0x7f51a00f6860 2022-02-02T20:21:27.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.145+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f519401c3c0 con 0x7f51a00f6860 2022-02-02T20:21:27.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.146+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0045ad0 con 0x7f51a00f6860 2022-02-02T20:21:27.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.147+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f519401d420 con 0x7f51a00f6860 2022-02-02T20:21:27.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.147+0000 7f519cff9700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 0x7f5188067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.147+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5194083640 con 0x7f51a00f6860 2022-02-02T20:21:27.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.147+0000 7f519ffff700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 0x7f5188067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.147+0000 7f519ffff700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 0x7f5188067290 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f51a00f94b0 tx=0x7f5190009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.151+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5194051740 con 0x7f51a00f6860 2022-02-02T20:21:27.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.345+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51a00faca0 con 0x7f5188064dd0 2022-02-02T20:21:27.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.355+0000 7f519cff9700 1 -- 172.21.15.96:0/671319391 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f51a00faca0 con 0x7f5188064dd0 2022-02-02T20:21:27.357 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:21:27.357 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 95m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:21:27.357 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (117m) 95m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:21:27.358 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (117m) 93m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:21:27.358 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 95m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:21:27.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 95m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:21:27.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (117m) 95m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:21:27.359 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 93m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:21:27.359 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (117m) 93m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:21:27.359 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (119m) 95m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:21:27.359 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (118m) 93m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:21:27.360 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (118m) 95m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:21:27.360 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (117m) 93m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:21:27.360 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 95m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:21:27.360 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 93m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:21:27.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (116m) 95m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:21:27.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (116m) 95m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:21:27.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (115m) 95m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:21:27.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (115m) 93m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:21:27.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (114m) 93m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:21:27.362 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (114m) 93m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:21:27.362 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 95m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:21:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.356+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 msgr2=0x7f5188067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 0x7f5188067290 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f51a00f94b0 tx=0x7f5190009040).stop 2022-02-02T20:21:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 msgr2=0x7f51a00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f5194009990 tx=0x7f5194009b30).stop 2022-02-02T20:21:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 shutdown_connections 2022-02-02T20:21:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5188064dd0 0x7f5188067290 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51a00f55c0 0x7f51a00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 --2- 172.21.15.96:0/671319391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51a00f6860 0x7f51a00f7ba0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 >> 172.21.15.96:0/671319391 conn(0x7f51a00f0d40 msgr2=0x7f51a005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 shutdown_connections 2022-02-02T20:21:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.357+0000 7f51a6465700 1 -- 172.21.15.96:0/671319391 wait complete. 2022-02-02T20:21:27.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 -- 172.21.15.96:0/3515488897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f66e0 msgr2=0x7f18a00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 --2- 172.21.15.96:0/3515488897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f66e0 0x7f18a00f6b00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f1890004660 tx=0x7f1890009b30).stop 2022-02-02T20:21:27.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 -- 172.21.15.96:0/3515488897 shutdown_connections 2022-02-02T20:21:27.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 --2- 172.21.15.96:0/3515488897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f7980 0x7f18a00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 --2- 172.21.15.96:0/3515488897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f66e0 0x7f18a00f6b00 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 -- 172.21.15.96:0/3515488897 >> 172.21.15.96:0/3515488897 conn(0x7f18a00f1e40 msgr2=0x7f18a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 -- 172.21.15.96:0/3515488897 shutdown_connections 2022-02-02T20:21:27.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.454+0000 7f18a7b34700 1 -- 172.21.15.96:0/3515488897 wait complete. 2022-02-02T20:21:27.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 Processor -- start 2022-02-02T20:21:27.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 -- start start 2022-02-02T20:21:27.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 0x7f18a006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006a380 con 0x7f18a00f7980 2022-02-02T20:21:27.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a7b34700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006a4c0 con 0x7f18a00f66e0 2022-02-02T20:21:27.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36616/0 (socket says 172.21.15.96:36616) 2022-02-02T20:21:27.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 -- 172.21.15.96:0/4182018886 learned_addr learned my addr 172.21.15.96:0/4182018886 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:27.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a58d0700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 0x7f18a006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 -- 172.21.15.96:0/4182018886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 msgr2=0x7f18a006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 0x7f18a006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a50cf700 1 -- 172.21.15.96:0/4182018886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890005040 con 0x7f18a00f7980 2022-02-02T20:21:27.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.455+0000 7f18a58d0700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 0x7f18a006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:21:27.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18a50cf700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f189c00e7f0 tx=0x7f189c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c0092e0 con 0x7f18a00f7980 2022-02-02T20:21:27.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a006a7a0 con 0x7f18a00f7980 2022-02-02T20:21:27.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a010ef90 con 0x7f18a00f7980 2022-02-02T20:21:27.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f189c00f040 con 0x7f18a00f7980 2022-02-02T20:21:27.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.456+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c014750 con 0x7f18a00f7980 2022-02-02T20:21:27.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.457+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1888004fa0 con 0x7f18a00f7980 2022-02-02T20:21:27.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.458+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f189c01b030 con 0x7f18a00f7980 2022-02-02T20:21:27.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.458+0000 7f18967fc700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 0x7f188c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.458+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f189c0816c0 con 0x7f18a00f7980 2022-02-02T20:21:27.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.458+0000 7f18a58d0700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 0x7f188c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.459+0000 7f18a58d0700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 0x7f188c067270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f1890000c00 tx=0x7f1890016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.462+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f189c04f870 con 0x7f18a00f7980 2022-02-02T20:21:27.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.691+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1888005e80 con 0x7f18a00f7980 2022-02-02T20:21:27.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.692+0000 7f18967fc700 1 -- 172.21.15.96:0/4182018886 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f189c0192e0 con 0x7f18a00f7980 2022-02-02T20:21:27.698 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:21:27.699 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:21:27.699 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:21:27.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:27.699 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:21:27.700 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:21:27.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:27.700 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:21:27.700 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:21:27.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:27.701 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:21:27.701 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:21:27.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:27.701 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:21:27.702 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:21:27.702 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:21:27.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:21:27.702 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:21:27.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.693+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 msgr2=0x7f188c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.693+0000 7f18a7b34700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 0x7f188c067270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f1890000c00 tx=0x7f1890016040).stop 2022-02-02T20:21:27.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.693+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 msgr2=0x7f18a0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.693+0000 7f18a7b34700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f189c00e7f0 tx=0x7f189c00b040).stop 2022-02-02T20:21:27.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 shutdown_connections 2022-02-02T20:21:27.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f188c064db0 0x7f188c067270 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18a00f66e0 0x7f18a006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 --2- 172.21.15.96:0/4182018886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18a00f7980 0x7f18a0069e20 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 >> 172.21.15.96:0/4182018886 conn(0x7f18a00f1e40 msgr2=0x7f18a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 shutdown_connections 2022-02-02T20:21:27.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.694+0000 7f18a7b34700 1 -- 172.21.15.96:0/4182018886 wait complete. 2022-02-02T20:21:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 -- 172.21.15.96:0/1660542287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 msgr2=0x7f4efc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/1660542287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc0f59e0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f4eec004660 tx=0x7f4eec009b30).stop 2022-02-02T20:21:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 -- 172.21.15.96:0/1660542287 shutdown_connections 2022-02-02T20:21:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/1660542287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:21:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/1660542287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc0f59e0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 -- 172.21.15.96:0/1660542287 >> 172.21.15.96:0/1660542287 conn(0x7f4efc0f0d40 msgr2=0x7f4efc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:27.794 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:27 smithi096 ceph-mon[101353]: pgmap v3581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:27.794 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:27 smithi096 ceph-mon[101353]: from='client.37782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:27.795 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:27 smithi096 ceph-mon[101353]: from='client.37786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:27.795 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:21:27.795 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:21:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 -- 172.21.15.96:0/1660542287 shutdown_connections 2022-02-02T20:21:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.790+0000 7f4f03b7b700 1 -- 172.21.15.96:0/1660542287 wait complete. 2022-02-02T20:21:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 Processor -- start 2022-02-02T20:21:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 -- start start 2022-02-02T20:21:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc060470 con 0x7f4efc0f55c0 2022-02-02T20:21:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f03b7b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0605b0 con 0x7f4efc0f6860 2022-02-02T20:21:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36624/0 (socket says 172.21.15.96:36624) 2022-02-02T20:21:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 -- 172.21.15.96:0/2691828667 learned_addr learned my addr 172.21.15.96:0/2691828667 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01116700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 -- 172.21.15.96:0/2691828667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 msgr2=0x7f4efc10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01917700 1 -- 172.21.15.96:0/2691828667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec005040 con 0x7f4efc0f55c0 2022-02-02T20:21:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.791+0000 7f4f01116700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:21:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4f01917700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f4eec004f60 tx=0x7f4eec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eec018070 con 0x7f4efc0f55c0 2022-02-02T20:21:27.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc10c7c0 con 0x7f4efc0f55c0 2022-02-02T20:21:27.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4eec007ba0 con 0x7f4efc0f55c0 2022-02-02T20:21:27.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eec01c620 con 0x7f4efc0f55c0 2022-02-02T20:21:27.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.792+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc10ccf0 con 0x7f4efc0f55c0 2022-02-02T20:21:27.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.793+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee4004fa0 con 0x7f4efc0f55c0 2022-02-02T20:21:27.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.793+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4eec01c8e0 con 0x7f4efc0f55c0 2022-02-02T20:21:27.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.794+0000 7f4ef27fc700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 0x7f4ee8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:27.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.794+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4eec083d80 con 0x7f4efc0f55c0 2022-02-02T20:21:27.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.794+0000 7f4f01116700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 0x7f4ee8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:27.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.794+0000 7f4f01116700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 0x7f4ee8067290 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4ef800b830 tx=0x7f4ef8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:27.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.798+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4eec051e80 con 0x7f4efc0f55c0 2022-02-02T20:21:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.997+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ee4005940 con 0x7f4efc0f55c0 2022-02-02T20:21:27.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.997+0000 7f4ef27fc700 1 -- 172.21.15.96:0/2691828667 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4eec0554a0 con 0x7f4efc0f55c0 2022-02-02T20:21:28.000 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:21:28.000 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:21:28.000 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:21:28.000 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:21:28.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:28.001 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:21:28.001 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:21:28.001 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:21:28.001 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:21:28.002 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:21:28.002 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:21:28.002 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:21:28.002 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:21:28.003 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:21:28.003 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:21:28.003 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:21:28.003 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:21:28.003 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:21:28.004 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:21:28.004 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:21:28.004 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:21:28.004 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:21:28.005 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:21:28.005 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:21:28.005 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:21:28.005 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:21:28.005 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:21:28.006 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:21:28.006 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:21:28.006 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:21:28.006 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:21:28.006 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:21:28.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:28.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:28.007 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:21:28.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:28.008 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:28.008 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:28.008 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:28.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 msgr2=0x7f4ee8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 0x7f4ee8067290 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4ef800b830 tx=0x7f4ef8008040).stop 2022-02-02T20:21:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 msgr2=0x7f4efc109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f4eec004f60 tx=0x7f4eec009b30).stop 2022-02-02T20:21:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 shutdown_connections 2022-02-02T20:21:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ee8064dd0 0x7f4ee8067290 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4efc0f55c0 0x7f4efc109cc0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 --2- 172.21.15.96:0/2691828667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4efc0f6860 0x7f4efc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 >> 172.21.15.96:0/2691828667 conn(0x7f4efc0f0d40 msgr2=0x7f4efc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:28.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 shutdown_connections 2022-02-02T20:21:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:27.999+0000 7f4f03b7b700 1 -- 172.21.15.96:0/2691828667 wait complete. 2022-02-02T20:21:28.012 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:21:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:27 smithi159 ceph-mon[69013]: pgmap v3581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:27 smithi159 ceph-mon[69013]: from='client.37782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:27 smithi159 ceph-mon[69013]: from='client.37786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:21:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:21:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4182018886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:21:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2691828667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:21:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4182018886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:21:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2691828667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:21:30.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:29 smithi159 ceph-mon[69013]: pgmap v3582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:30.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:29 smithi096 ceph-mon[101353]: pgmap v3582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:32 smithi159 ceph-mon[69013]: pgmap v3583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:32 smithi096 ceph-mon[101353]: pgmap v3583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:34 smithi159 ceph-mon[69013]: pgmap v3584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:34 smithi096 ceph-mon[101353]: pgmap v3584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:36 smithi159 ceph-mon[69013]: pgmap v3585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:36 smithi096 ceph-mon[101353]: pgmap v3585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:37 smithi159 ceph-mon[69013]: pgmap v3586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:37 smithi096 ceph-mon[101353]: pgmap v3586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:40.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:40 smithi159 ceph-mon[69013]: pgmap v3587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:40 smithi096 ceph-mon[101353]: pgmap v3587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:42 smithi159 ceph-mon[69013]: pgmap v3588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:42 smithi096 ceph-mon[101353]: pgmap v3588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:44 smithi159 ceph-mon[69013]: pgmap v3589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:44 smithi096 ceph-mon[101353]: pgmap v3589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:46 smithi159 ceph-mon[69013]: pgmap v3590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:46 smithi096 ceph-mon[101353]: pgmap v3590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:47 smithi159 ceph-mon[69013]: pgmap v3591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:47 smithi096 ceph-mon[101353]: pgmap v3591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:50 smithi159 ceph-mon[69013]: pgmap v3592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:50 smithi096 ceph-mon[101353]: pgmap v3592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:52 smithi159 ceph-mon[69013]: pgmap v3593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:52 smithi096 ceph-mon[101353]: pgmap v3593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:54 smithi159 ceph-mon[69013]: pgmap v3594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:54 smithi096 ceph-mon[101353]: pgmap v3594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:56 smithi159 ceph-mon[69013]: pgmap v3595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:56 smithi096 ceph-mon[101353]: pgmap v3595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:57 smithi159 ceph-mon[69013]: pgmap v3596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:57 smithi096 ceph-mon[101353]: pgmap v3596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:21:58.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- 172.21.15.96:0/2354103226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 msgr2=0x7f33ec0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 --2- 172.21.15.96:0/2354103226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec0f6b30 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f33dc004660 tx=0x7f33dc009b30).stop 2022-02-02T20:21:58.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- 172.21.15.96:0/2354103226 shutdown_connections 2022-02-02T20:21:58.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 --2- 172.21.15.96:0/2354103226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec0f6b30 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 --2- 172.21.15.96:0/2354103226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 0x7f33ec0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- 172.21.15.96:0/2354103226 >> 172.21.15.96:0/2354103226 conn(0x7f33ec0f0b90 msgr2=0x7f33ec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- 172.21.15.96:0/2354103226 shutdown_connections 2022-02-02T20:21:58.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- 172.21.15.96:0/2354103226 wait complete. 2022-02-02T20:21:58.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 Processor -- start 2022-02-02T20:21:58.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.110+0000 7f33f178a700 1 -- start start 2022-02-02T20:21:58.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33f178a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 0x7f33ec106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33f178a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33f178a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec107870 con 0x7f33ec0f66d0 2022-02-02T20:21:58.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33f178a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1080b0 con 0x7f33ec0f5430 2022-02-02T20:21:58.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36644/0 (socket says 172.21.15.96:36644) 2022-02-02T20:21:58.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 -- 172.21.15.96:0/634111464 learned_addr learned my addr 172.21.15.96:0/634111464 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:58.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33ebfff700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 0x7f33ec106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 -- 172.21.15.96:0/634111464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 msgr2=0x7f33ec106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 0x7f33ec106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 -- 172.21.15.96:0/634111464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc005040 con 0x7f33ec0f66d0 2022-02-02T20:21:58.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33eb7fe700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f33dc009990 tx=0x7f33dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33dc018070 con 0x7f33ec0f66d0 2022-02-02T20:21:58.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec108330 con 0x7f33ec0f66d0 2022-02-02T20:21:58.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.111+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33dc007ba0 con 0x7f33ec0f66d0 2022-02-02T20:21:58.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.112+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33dc01c620 con 0x7f33ec0f66d0 2022-02-02T20:21:58.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.112+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec108810 con 0x7f33ec0f66d0 2022-02-02T20:21:58.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.113+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec059100 con 0x7f33ec0f66d0 2022-02-02T20:21:58.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.113+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f33dc01c8e0 con 0x7f33ec0f66d0 2022-02-02T20:21:58.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.113+0000 7f33e8ff9700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 0x7f33d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.113+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f33dc083890 con 0x7f33ec0f66d0 2022-02-02T20:21:58.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.114+0000 7f33ebfff700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 0x7f33d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.114+0000 7f33ebfff700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 0x7f33d40672e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f33ec107b40 tx=0x7f33e0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.118+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f33dc051990 con 0x7f33ec0f66d0 2022-02-02T20:21:58.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.297+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33ec0fab10 con 0x7f33d4064e20 2022-02-02T20:21:58.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.299+0000 7f33e8ff9700 1 -- 172.21.15.96:0/634111464 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f33ec0fab10 con 0x7f33d4064e20 2022-02-02T20:21:58.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 msgr2=0x7f33d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 0x7f33d40672e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f33ec107b40 tx=0x7f33e0009040).stop 2022-02-02T20:21:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 msgr2=0x7f33ec107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f33dc009990 tx=0x7f33dc009b30).stop 2022-02-02T20:21:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 shutdown_connections 2022-02-02T20:21:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33d4064e20 0x7f33d40672e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33ec0f5430 0x7f33ec106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 --2- 172.21.15.96:0/634111464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33ec0f66d0 0x7f33ec107270 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.300+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 >> 172.21.15.96:0/634111464 conn(0x7f33ec0f0b90 msgr2=0x7f33ec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.301+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 shutdown_connections 2022-02-02T20:21:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.301+0000 7f33f178a700 1 -- 172.21.15.96:0/634111464 wait complete. 2022-02-02T20:21:58.312 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:21:58.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 -- 172.21.15.96:0/296057045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f5970 msgr2=0x7f75a40f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 --2- 172.21.15.96:0/296057045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f5970 0x7f75a40f5df0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f7594004660 tx=0x7f7594009b30).stop 2022-02-02T20:21:58.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 -- 172.21.15.96:0/296057045 shutdown_connections 2022-02-02T20:21:58.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 --2- 172.21.15.96:0/296057045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f5970 0x7f75a40f5df0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 --2- 172.21.15.96:0/296057045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f6c60 0x7f75a40f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.398+0000 7f75a996c700 1 -- 172.21.15.96:0/296057045 >> 172.21.15.96:0/296057045 conn(0x7f75a40f04c0 msgr2=0x7f75a40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.399+0000 7f75a996c700 1 -- 172.21.15.96:0/296057045 shutdown_connections 2022-02-02T20:21:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.399+0000 7f75a996c700 1 -- 172.21.15.96:0/296057045 wait complete. 2022-02-02T20:21:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.399+0000 7f75a996c700 1 Processor -- start 2022-02-02T20:21:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.399+0000 7f75a996c700 1 -- start start 2022-02-02T20:21:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f5970 0x7f75a4106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41079c0 con 0x7f75a40f6c60 2022-02-02T20:21:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4107b00 con 0x7f75a40f5970 2022-02-02T20:21:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36654/0 (socket says 172.21.15.96:36654) 2022-02-02T20:21:58.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 -- 172.21.15.96:0/2404600004 learned_addr learned my addr 172.21.15.96:0/2404600004 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:58.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a2ffd700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f5970 0x7f75a4106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 -- 172.21.15.96:0/2404600004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f5970 msgr2=0x7f75a4106f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f5970 0x7f75a4106f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 -- 172.21.15.96:0/2404600004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594005040 con 0x7f75a40f6c60 2022-02-02T20:21:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a27fc700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7594009990 tx=0x7f7594009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7594018070 con 0x7f75a40f6c60 2022-02-02T20:21:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a4108440 con 0x7f75a40f6c60 2022-02-02T20:21:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7594007ca0 con 0x7f75a40f6c60 2022-02-02T20:21:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759401c620 con 0x7f75a40f6c60 2022-02-02T20:21:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.400+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a41089a0 con 0x7f75a40f6c60 2022-02-02T20:21:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.402+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f759401d960 con 0x7f75a40f6c60 2022-02-02T20:21:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.402+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4045ad0 con 0x7f75a40f6c60 2022-02-02T20:21:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.402+0000 7f758b7fe700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 0x7f758c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.402+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f75940837e0 con 0x7f75a40f6c60 2022-02-02T20:21:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.402+0000 7f75a2ffd700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 0x7f758c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.403+0000 7f75a2ffd700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 0x7f758c067290 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f7598007fd0 tx=0x7f7598009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.407+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f75940553d0 con 0x7f75a40f6c60 2022-02-02T20:21:58.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.581+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a4109190 con 0x7f758c064dd0 2022-02-02T20:21:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.590+0000 7f758b7fe700 1 -- 172.21.15.96:0/2404600004 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f75980045e0 con 0x7f758c064dd0 2022-02-02T20:21:58.592 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:21:58.593 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 95m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:21:58.593 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (117m) 95m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:21:58.594 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (117m) 94m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:21:58.594 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 95m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:21:58.594 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 95m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:21:58.594 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (118m) 95m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:21:58.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 94m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:21:58.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (118m) 94m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:21:58.595 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (119m) 95m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:21:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (119m) 94m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:21:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (118m) 95m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:21:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (118m) 94m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:21:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 95m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:21:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 94m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:21:58.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (117m) 95m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:21:58.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (116m) 95m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:21:58.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (116m) 95m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:21:58.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (115m) 94m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:21:58.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (115m) 94m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:21:58.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (114m) 94m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:21:58.598 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 95m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:21:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 msgr2=0x7f758c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 0x7f758c067290 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f7598007fd0 tx=0x7f7598009040).stop 2022-02-02T20:21:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 msgr2=0x7f75a4107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7594009990 tx=0x7f7594009b30).stop 2022-02-02T20:21:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 shutdown_connections 2022-02-02T20:21:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f758c064dd0 0x7f758c067290 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75a40f5970 0x7f75a4106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 --2- 172.21.15.96:0/2404600004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75a40f6c60 0x7f75a4107410 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 >> 172.21.15.96:0/2404600004 conn(0x7f75a40f04c0 msgr2=0x7f75a40f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 shutdown_connections 2022-02-02T20:21:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.592+0000 7f75a996c700 1 -- 172.21.15.96:0/2404600004 wait complete. 2022-02-02T20:21:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 -- 172.21.15.96:0/1315585495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f5440 msgr2=0x7f4cd40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 --2- 172.21.15.96:0/1315585495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f5440 0x7f4cd40f5860 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f4cd0004660 tx=0x7f4cd0009b30).stop 2022-02-02T20:21:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 -- 172.21.15.96:0/1315585495 shutdown_connections 2022-02-02T20:21:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 --2- 172.21.15.96:0/1315585495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f66e0 0x7f4cd40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 --2- 172.21.15.96:0/1315585495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f5440 0x7f4cd40f5860 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.690+0000 7f4cda28c700 1 -- 172.21.15.96:0/1315585495 >> 172.21.15.96:0/1315585495 conn(0x7f4cd40f0ba0 msgr2=0x7f4cd40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.694 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:58 smithi096 ceph-mon[101353]: from='client.37798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.691+0000 7f4cda28c700 1 -- 172.21.15.96:0/1315585495 shutdown_connections 2022-02-02T20:21:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.691+0000 7f4cda28c700 1 -- 172.21.15.96:0/1315585495 wait complete. 2022-02-02T20:21:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 Processor -- start 2022-02-02T20:21:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 -- start start 2022-02-02T20:21:58.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f5440 0x7f4cd4105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41067d0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cda28c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4106fd0 con 0x7f4cd40f5440 2022-02-02T20:21:58.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36664/0 (socket says 172.21.15.96:36664) 2022-02-02T20:21:58.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 -- 172.21.15.96:0/624821844 learned_addr learned my addr 172.21.15.96:0/624821844 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:58.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd928a700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f5440 0x7f4cd4105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 -- 172.21.15.96:0/624821844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f5440 msgr2=0x7f4cd4105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f5440 0x7f4cd4105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 -- 172.21.15.96:0/624821844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0005040 con 0x7f4cd40f66e0 2022-02-02T20:21:58.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.692+0000 7f4cd8a89700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f4cc40026d0 tx=0x7f4cc4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.693+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc40079c0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.693+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cc400f040 con 0x7f4cd40f66e0 2022-02-02T20:21:58.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.693+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc40148b0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.693+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd41072b0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.693+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd4107870 con 0x7f4cd40f66e0 2022-02-02T20:21:58.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.694+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd4059100 con 0x7f4cd40f66e0 2022-02-02T20:21:58.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.694+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cc4007b20 con 0x7f4cd40f66e0 2022-02-02T20:21:58.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.695+0000 7f4cc9ffb700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 0x7f4cc00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:58.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.695+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4cc4081990 con 0x7f4cd40f66e0 2022-02-02T20:21:58.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.695+0000 7f4cd928a700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 0x7f4cc00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:58.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.695+0000 7f4cd928a700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 0x7f4cc00672e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f4cd0004630 tx=0x7f4cd0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:58.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.699+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cc40534c0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.927+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4cd4045ad0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.928+0000 7f4cc9ffb700 1 -- 172.21.15.96:0/624821844 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4cc40530b0 con 0x7f4cd40f66e0 2022-02-02T20:21:58.930 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:21:58.930 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:21:58.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:21:58.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:58.931 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:21:58.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:21:58.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:58.931 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:21:58.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:21:58.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:58.932 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:21:58.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:21:58.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:21:58.933 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:21:58.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:21:58.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:21:58.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:21:58.934 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:21:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.929+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 msgr2=0x7f4cc00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.929+0000 7f4cda28c700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 0x7f4cc00672e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f4cd0004630 tx=0x7f4cd0009b30).stop 2022-02-02T20:21:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.929+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 msgr2=0x7f4cd4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.929+0000 7f4cda28c700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f4cc40026d0 tx=0x7f4cc4009de0).stop 2022-02-02T20:21:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 shutdown_connections 2022-02-02T20:21:58.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4cc0064e20 0x7f4cc00672e0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cd40f5440 0x7f4cd4105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 --2- 172.21.15.96:0/624821844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cd40f66e0 0x7f4cd4106220 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:58.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 >> 172.21.15.96:0/624821844 conn(0x7f4cd40f0ba0 msgr2=0x7f4cd40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:58.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 shutdown_connections 2022-02-02T20:21:58.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:58.930+0000 7f4cda28c700 1 -- 172.21.15.96:0/624821844 wait complete. 2022-02-02T20:21:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:58 smithi159 ceph-mon[69013]: from='client.37798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:21:59.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 -- 172.21.15.96:0/222342572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f66e0 msgr2=0x7f1b640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:59.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 --2- 172.21.15.96:0/222342572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f66e0 0x7f1b640f6b00 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f1b54004660 tx=0x7f1b54009b30).stop 2022-02-02T20:21:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 -- 172.21.15.96:0/222342572 shutdown_connections 2022-02-02T20:21:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 --2- 172.21.15.96:0/222342572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f7980 0x7f1b640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 --2- 172.21.15.96:0/222342572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f66e0 0x7f1b640f6b00 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 -- 172.21.15.96:0/222342572 >> 172.21.15.96:0/222342572 conn(0x7f1b640f1e40 msgr2=0x7f1b640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:59.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.027+0000 7f1b6a821700 1 -- 172.21.15.96:0/222342572 shutdown_connections 2022-02-02T20:21:59.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.028+0000 7f1b6a821700 1 -- 172.21.15.96:0/222342572 wait complete. 2022-02-02T20:21:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.028+0000 7f1b6a821700 1 Processor -- start 2022-02-02T20:21:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.028+0000 7f1b6a821700 1 -- start start 2022-02-02T20:21:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.028+0000 7f1b6a821700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f66e0 0x7f1b6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:59.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b6a821700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b6a821700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6406a380 con 0x7f1b640f7980 2022-02-02T20:21:59.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b6a821700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6406a4c0 con 0x7f1b640f66e0 2022-02-02T20:21:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36674/0 (socket says 172.21.15.96:36674) 2022-02-02T20:21:59.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 -- 172.21.15.96:0/1999013473 learned_addr learned my addr 172.21.15.96:0/1999013473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:21:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b63fff700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f66e0 0x7f1b6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 -- 172.21.15.96:0/1999013473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f66e0 msgr2=0x7f1b6406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f66e0 0x7f1b6406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 -- 172.21.15.96:0/1999013473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54005040 con 0x7f1b640f7980 2022-02-02T20:21:59.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b637fe700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f1b5800c530 tx=0x7f1b58007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5800f650 con 0x7f1b640f7980 2022-02-02T20:21:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b5800fc60 con 0x7f1b640f7980 2022-02-02T20:21:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6406a7a0 con 0x7f1b640f7980 2022-02-02T20:21:59.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.029+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b58012c20 con 0x7f1b640f7980 2022-02-02T20:21:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.030+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6410efe0 con 0x7f1b640f7980 2022-02-02T20:21:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.030+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b64045ad0 con 0x7f1b640f7980 2022-02-02T20:21:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.031+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b58010070 con 0x7f1b640f7980 2022-02-02T20:21:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.031+0000 7f1b60ff9700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 0x7f1b4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:21:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.032+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b580816b0 con 0x7f1b640f7980 2022-02-02T20:21:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.032+0000 7f1b63fff700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 0x7f1b4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:21:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.032+0000 7f1b63fff700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 0x7f1b4c067290 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f1b54013690 tx=0x7f1b54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:21:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.036+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b5804f7b0 con 0x7f1b640f7980 2022-02-02T20:21:59.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.235+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b64027a00 con 0x7f1b640f7980 2022-02-02T20:21:59.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.236+0000 7f1b60ff9700 1 -- 172.21.15.96:0/1999013473 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1b58052dd0 con 0x7f1b640f7980 2022-02-02T20:21:59.238 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:21:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:21:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:21:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:21:59.239 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:21:59.240 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:21:59.240 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:21:59.240 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:21:59.240 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:21:59.241 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:21:59.241 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:21:59.241 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:21:59.241 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:21:59.241 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:21:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:21:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:21:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:21:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:21:59.243 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:21:59.243 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:21:59.243 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:21:59.243 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:21:59.244 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:21:59.244 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:21:59.244 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:21:59.244 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:21:59.244 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:21:59.245 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:21:59.245 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:21:59.245 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:21:59.245 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:21:59.246 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:59.246 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:59.246 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:21:59.246 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:21:59.247 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:59.247 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:59.247 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:21:59.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 msgr2=0x7f1b4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 0x7f1b4c067290 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f1b54013690 tx=0x7f1b54009b30).stop 2022-02-02T20:21:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 msgr2=0x7f1b64069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:21:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f1b5800c530 tx=0x7f1b58007e20).stop 2022-02-02T20:21:59.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 shutdown_connections 2022-02-02T20:21:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b4c064dd0 0x7f1b4c067290 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640f66e0 0x7f1b6406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 --2- 172.21.15.96:0/1999013473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b640f7980 0x7f1b64069e20 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:21:59.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 >> 172.21.15.96:0/1999013473 conn(0x7f1b640f1e40 msgr2=0x7f1b640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:21:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 shutdown_connections 2022-02-02T20:21:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:21:59.238+0000 7f1b6a821700 1 -- 172.21.15.96:0/1999013473 wait complete. 2022-02-02T20:21:59.251 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:22:00.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:59 smithi159 ceph-mon[69013]: from='client.37802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:00.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/624821844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:22:00.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:59 smithi159 ceph-mon[69013]: pgmap v3597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:00.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:21:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1999013473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:22:00.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:59 smithi096 ceph-mon[101353]: from='client.37802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:00.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/624821844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:22:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:59 smithi096 ceph-mon[101353]: pgmap v3597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:00.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:21:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1999013473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:22:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:02 smithi159 ceph-mon[69013]: pgmap v3598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:02 smithi096 ceph-mon[101353]: pgmap v3598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:04 smithi159 ceph-mon[69013]: pgmap v3599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:04 smithi096 ceph-mon[101353]: pgmap v3599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:06 smithi159 ceph-mon[69013]: pgmap v3600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:06 smithi096 ceph-mon[101353]: pgmap v3600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:07 smithi159 ceph-mon[69013]: pgmap v3601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:07 smithi096 ceph-mon[101353]: pgmap v3601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:10 smithi159 ceph-mon[69013]: pgmap v3602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:10 smithi096 ceph-mon[101353]: pgmap v3602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:12 smithi159 ceph-mon[69013]: pgmap v3603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:12 smithi096 ceph-mon[101353]: pgmap v3603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:14 smithi159 ceph-mon[69013]: pgmap v3604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:14 smithi096 ceph-mon[101353]: pgmap v3604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:16 smithi159 ceph-mon[69013]: pgmap v3605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:16 smithi096 ceph-mon[101353]: pgmap v3605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:17 smithi159 ceph-mon[69013]: pgmap v3606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:18.062 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:17 smithi096 ceph-mon[101353]: pgmap v3606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:20 smithi159 ceph-mon[69013]: pgmap v3607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:20 smithi096 ceph-mon[101353]: pgmap v3607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:22 smithi159 ceph-mon[69013]: pgmap v3608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:22 smithi096 ceph-mon[101353]: pgmap v3608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:24 smithi159 ceph-mon[69013]: pgmap v3609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:24 smithi096 ceph-mon[101353]: pgmap v3609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:26.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:26 smithi159 ceph-mon[69013]: pgmap v3610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:26 smithi096 ceph-mon[101353]: pgmap v3610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:27 smithi159 ceph-mon[69013]: pgmap v3611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:22:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:22:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:27 smithi096 ceph-mon[101353]: pgmap v3611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:22:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:22:29.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 -- 172.21.15.96:0/2786702631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 msgr2=0x7fe7b00f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/2786702631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f91b0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7fe7ac004660 tx=0x7fe7ac009b30).stop 2022-02-02T20:22:29.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 -- 172.21.15.96:0/2786702631 shutdown_connections 2022-02-02T20:22:29.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/2786702631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 0x7fe7b00fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/2786702631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f91b0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 -- 172.21.15.96:0/2786702631 >> 172.21.15.96:0/2786702631 conn(0x7fe7b00f0b90 msgr2=0x7fe7b00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 -- 172.21.15.96:0/2786702631 shutdown_connections 2022-02-02T20:22:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.348+0000 7fe7b62d4700 1 -- 172.21.15.96:0/2786702631 wait complete. 2022-02-02T20:22:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 Processor -- start 2022-02-02T20:22:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 -- start start 2022-02-02T20:22:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 0x7fe7b00f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00f5610 con 0x7fe7b0060270 2022-02-02T20:22:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b62d4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00f5750 con 0x7fe7b00f96a0 2022-02-02T20:22:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36692/0 (socket says 172.21.15.96:36692) 2022-02-02T20:22:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 -- 172.21.15.96:0/1819543885 learned_addr learned my addr 172.21.15.96:0/1819543885 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:22:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b4ad1700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 0x7fe7b00f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 -- 172.21.15.96:0/1819543885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 msgr2=0x7fe7b00f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 0x7fe7b00f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.349+0000 7fe7b52d2700 1 -- 172.21.15.96:0/1819543885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac005040 con 0x7fe7b0060270 2022-02-02T20:22:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7b52d2700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fe7ac000c00 tx=0x7fe7ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac019070 con 0x7fe7b0060270 2022-02-02T20:22:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7ac007e70 con 0x7fe7b0060270 2022-02-02T20:22:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b00f59d0 con 0x7fe7b0060270 2022-02-02T20:22:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac014d70 con 0x7fe7b0060270 2022-02-02T20:22:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.350+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00f5f30 con 0x7fe7b0060270 2022-02-02T20:22:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.351+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0045ad0 con 0x7fe7b0060270 2022-02-02T20:22:29.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.351+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7ac025070 con 0x7fe7b0060270 2022-02-02T20:22:29.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.352+0000 7fe7a5ffb700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 0x7fe79c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.352+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe7ac082a50 con 0x7fe7b0060270 2022-02-02T20:22:29.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.352+0000 7fe7b4ad1700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 0x7fe79c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.352+0000 7fe7b4ad1700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 0x7fe79c0672e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fe7a0009fd0 tx=0x7fe7a000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.356+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7ac050af0 con 0x7fe7b0060270 2022-02-02T20:22:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.536+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7b00fee60 con 0x7fe79c064e20 2022-02-02T20:22:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.537+0000 7fe7a5ffb700 1 -- 172.21.15.96:0/1819543885 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe7b00fee60 con 0x7fe79c064e20 2022-02-02T20:22:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 msgr2=0x7fe79c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 0x7fe79c0672e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fe7a0009fd0 tx=0x7fe7a000b040).stop 2022-02-02T20:22:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 msgr2=0x7fe7b00f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fe7ac000c00 tx=0x7fe7ac00b040).stop 2022-02-02T20:22:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 shutdown_connections 2022-02-02T20:22:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe79c064e20 0x7fe79c0672e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7b0060270 0x7fe7b00f6c30 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 --2- 172.21.15.96:0/1819543885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7b00f96a0 0x7fe7b00f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 >> 172.21.15.96:0/1819543885 conn(0x7fe7b00f0b90 msgr2=0x7fe7b00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 shutdown_connections 2022-02-02T20:22:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.539+0000 7fe7b62d4700 1 -- 172.21.15.96:0/1819543885 wait complete. 2022-02-02T20:22:29.551 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:22:29.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 -- 172.21.15.96:0/2112341630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 msgr2=0x7fd2980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 --2- 172.21.15.96:0/2112341630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2980f7de0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fd28c004660 tx=0x7fd28c009b30).stop 2022-02-02T20:22:29.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 -- 172.21.15.96:0/2112341630 shutdown_connections 2022-02-02T20:22:29.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 --2- 172.21.15.96:0/2112341630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2980f7de0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 --2- 172.21.15.96:0/2112341630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd2980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:22:29.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 -- 172.21.15.96:0/2112341630 >> 172.21.15.96:0/2112341630 conn(0x7fd2980f1e40 msgr2=0x7fd2980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:29.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 -- 172.21.15.96:0/2112341630 shutdown_connections 2022-02-02T20:22:29.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.636+0000 7fd29e484700 1 -- 172.21.15.96:0/2112341630 wait complete. 2022-02-02T20:22:29.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 Processor -- start 2022-02-02T20:22:29.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 -- start start 2022-02-02T20:22:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd298106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298107ae0 con 0x7fd2980f7980 2022-02-02T20:22:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd29e484700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298108390 con 0x7fd2980f66e0 2022-02-02T20:22:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd2977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd2977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36704/0 (socket says 172.21.15.96:36704) 2022-02-02T20:22:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.637+0000 7fd2977fe700 1 -- 172.21.15.96:0/1407279761 learned_addr learned my addr 172.21.15.96:0/1407279761 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:22:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd297fff700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd298106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd2977fe700 1 -- 172.21.15.96:0/1407279761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 msgr2=0x7fd298106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd2977fe700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd298106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd2977fe700 1 -- 172.21.15.96:0/1407279761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c005040 con 0x7fd2980f7980 2022-02-02T20:22:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd297fff700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd298106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:22:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd2977fe700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fd28c009990 tx=0x7fd28c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd28c018070 con 0x7fd2980f7980 2022-02-02T20:22:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd28c007ca0 con 0x7fd2980f7980 2022-02-02T20:22:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd298108610 con 0x7fd2980f7980 2022-02-02T20:22:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298108b70 con 0x7fd2980f7980 2022-02-02T20:22:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.638+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd28c01c620 con 0x7fd2980f7980 2022-02-02T20:22:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.639+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278004fa0 con 0x7fd2980f7980 2022-02-02T20:22:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.639+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd28c01c8e0 con 0x7fd2980f7980 2022-02-02T20:22:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.640+0000 7fd294ff9700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 0x7fd280067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.640+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd28c0837d0 con 0x7fd2980f7980 2022-02-02T20:22:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.640+0000 7fd297fff700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 0x7fd280067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.640+0000 7fd297fff700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 0x7fd280067290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd2980f77e0 tx=0x7fd288008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.644+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd28c0553c0 con 0x7fd2980f7980 2022-02-02T20:22:29.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.818+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd278000bc0 con 0x7fd280064dd0 2022-02-02T20:22:29.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.828+0000 7fd294ff9700 1 -- 172.21.15.96:0/1407279761 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fd278000bc0 con 0x7fd280064dd0 2022-02-02T20:22:29.831 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:22:29.831 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 96m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:22:29.831 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (118m) 96m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:22:29.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (118m) 94m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:22:29.832 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 96m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:22:29.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 96m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:22:29.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (118m) 96m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:22:29.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 94m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:22:29.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (118m) 94m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:22:29.833 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 96m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:22:29.833 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (119m) 94m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:22:29.833 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (119m) 96m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:22:29.834 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (118m) 94m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:22:29.834 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 96m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:22:29.834 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 94m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:22:29.834 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (117m) 96m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:22:29.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (117m) 96m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:22:29.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (116m) 96m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:22:29.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (116m) 94m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:22:29.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (115m) 94m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:22:29.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (115m) 94m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:22:29.836 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 96m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:22:29.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 msgr2=0x7fd280067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 0x7fd280067290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd2980f77e0 tx=0x7fd288008040).stop 2022-02-02T20:22:29.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 msgr2=0x7fd2981074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fd28c009990 tx=0x7fd28c009b30).stop 2022-02-02T20:22:29.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 shutdown_connections 2022-02-02T20:22:29.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd280064dd0 0x7fd280067290 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2980f66e0 0x7fd298106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 --2- 172.21.15.96:0/1407279761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2980f7980 0x7fd2981074a0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 >> 172.21.15.96:0/1407279761 conn(0x7fd2980f1e40 msgr2=0x7fd2980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 shutdown_connections 2022-02-02T20:22:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.830+0000 7fd29e484700 1 -- 172.21.15.96:0/1407279761 wait complete. 2022-02-02T20:22:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 -- 172.21.15.96:0/1896975988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0060350 msgr2=0x7f55e00f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 --2- 172.21.15.96:0/1896975988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0060350 0x7f55e00f9350 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f55d0004660 tx=0x7f55d0009b30).stop 2022-02-02T20:22:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 -- 172.21.15.96:0/1896975988 shutdown_connections 2022-02-02T20:22:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 --2- 172.21.15.96:0/1896975988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e00f9840 0x7f55e00fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:22:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 --2- 172.21.15.96:0/1896975988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0060350 0x7f55e00f9350 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 -- 172.21.15.96:0/1896975988 >> 172.21.15.96:0/1896975988 conn(0x7f55e00f0d70 msgr2=0x7f55e00f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 -- 172.21.15.96:0/1896975988 shutdown_connections 2022-02-02T20:22:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.926+0000 7f55e7475700 1 -- 172.21.15.96:0/1896975988 wait complete. 2022-02-02T20:22:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 Processor -- start 2022-02-02T20:22:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 -- start start 2022-02-02T20:22:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e0060350 0x7f55e0106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0107a80 con 0x7f55e00f9840 2022-02-02T20:22:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e7475700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0108330 con 0x7f55e0060350 2022-02-02T20:22:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e4a10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e4a10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36712/0 (socket says 172.21.15.96:36712) 2022-02-02T20:22:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e4a10700 1 -- 172.21.15.96:0/3939794148 learned_addr learned my addr 172.21.15.96:0/3939794148 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:22:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.927+0000 7f55e5211700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e0060350 0x7f55e0106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e4a10700 1 -- 172.21.15.96:0/3939794148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e0060350 msgr2=0x7f55e0106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e4a10700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e0060350 0x7f55e0106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e4a10700 1 -- 172.21.15.96:0/3939794148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0005040 con 0x7f55e00f9840 2022-02-02T20:22:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e4a10700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f55dc0093f0 tx=0x7f55dc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55dc013640 con 0x7f55e00f9840 2022-02-02T20:22:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0108610 con 0x7f55e00f9840 2022-02-02T20:22:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55dc013c50 con 0x7f55e00f9840 2022-02-02T20:22:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55dc012c70 con 0x7f55e00f9840 2022-02-02T20:22:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.928+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0108bd0 con 0x7f55e00f9840 2022-02-02T20:22:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.929+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0004fa0 con 0x7f55e00f9840 2022-02-02T20:22:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.930+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55dc01a060 con 0x7f55e00f9840 2022-02-02T20:22:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.930+0000 7f55d5ffb700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 0x7f55cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.930+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55dc081890 con 0x7f55e00f9840 2022-02-02T20:22:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.930+0000 7f55e5211700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 0x7f55cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.930+0000 7f55e5211700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 0x7f55cc067290 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f55d0004630 tx=0x7f55d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:29.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:29.934+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55dc052ff0 con 0x7f55e00f9840 2022-02-02T20:22:30.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.162+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55c0005e80 con 0x7f55e00f9840 2022-02-02T20:22:30.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.163+0000 7f55d5ffb700 1 -- 172.21.15.96:0/3939794148 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f55dc0182e0 con 0x7f55e00f9840 2022-02-02T20:22:30.166 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:22:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:22:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:22:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:22:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:22:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:22:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:22:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:22:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:22:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:22:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:22:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:22:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:22:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:22:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:22:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:22:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:22:30.170 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:22:30.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 msgr2=0x7f55cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 0x7f55cc067290 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f55d0004630 tx=0x7f55d0009b30).stop 2022-02-02T20:22:30.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 msgr2=0x7f55e0107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f55dc0093f0 tx=0x7f55dc006ec0).stop 2022-02-02T20:22:30.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 shutdown_connections 2022-02-02T20:22:30.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55cc064dd0 0x7f55cc067290 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55e0060350 0x7f55e0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 --2- 172.21.15.96:0/3939794148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e00f9840 0x7f55e0107440 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 >> 172.21.15.96:0/3939794148 conn(0x7f55e00f0d70 msgr2=0x7f55e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:30.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 shutdown_connections 2022-02-02T20:22:30.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.165+0000 7f55e7475700 1 -- 172.21.15.96:0/3939794148 wait complete. 2022-02-02T20:22:30.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 -- 172.21.15.96:0/927006690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 msgr2=0x7f99400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 --2- 172.21.15.96:0/927006690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f99400f7de0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f9930004660 tx=0x7f9930009b30).stop 2022-02-02T20:22:30.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 -- 172.21.15.96:0/927006690 shutdown_connections 2022-02-02T20:22:30.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 --2- 172.21.15.96:0/927006690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f99400f7de0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 --2- 172.21.15.96:0/927006690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 0x7f99400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 -- 172.21.15.96:0/927006690 >> 172.21.15.96:0/927006690 conn(0x7f99400f1e40 msgr2=0x7f99400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:30.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:30 smithi096 ceph-mon[101353]: pgmap v3612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:30 smithi096 ceph-mon[101353]: from='client.37814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:30.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 -- 172.21.15.96:0/927006690 shutdown_connections 2022-02-02T20:22:30.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 -- 172.21.15.96:0/927006690 wait complete. 2022-02-02T20:22:30.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.262+0000 7f994787f700 1 Processor -- start 2022-02-02T20:22:30.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994787f700 1 -- start start 2022-02-02T20:22:30.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994787f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 0x7f994006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:30.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994787f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:30.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994787f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994006a380 con 0x7f99400f7980 2022-02-02T20:22:30.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994787f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994006a4c0 con 0x7f99400f66e0 2022-02-02T20:22:30.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:30.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36724/0 (socket says 172.21.15.96:36724) 2022-02-02T20:22:30.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 -- 172.21.15.96:0/1973099323 learned_addr learned my addr 172.21.15.96:0/1973099323 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:22:30.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f994561b700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 0x7f994006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:30.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 -- 172.21.15.96:0/1973099323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 msgr2=0x7f994006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 0x7f994006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 -- 172.21.15.96:0/1973099323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930005040 con 0x7f99400f7980 2022-02-02T20:22:30.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.263+0000 7f9944e1a700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f9930000c00 tx=0x7f993000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:30.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.264+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9930019070 con 0x7f99400f7980 2022-02-02T20:22:30.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.264+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994006a740 con 0x7f99400f7980 2022-02-02T20:22:30.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.264+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9930007e70 con 0x7f99400f7980 2022-02-02T20:22:30.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.264+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9930014ce0 con 0x7f99400f7980 2022-02-02T20:22:30.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.264+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994006aca0 con 0x7f99400f7980 2022-02-02T20:22:30.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.265+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9940045ad0 con 0x7f99400f7980 2022-02-02T20:22:30.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.266+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9930025070 con 0x7f99400f7980 2022-02-02T20:22:30.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.266+0000 7f9935ffb700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 0x7f992c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:22:30.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.266+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99300828f0 con 0x7f99400f7980 2022-02-02T20:22:30.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.266+0000 7f994561b700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 0x7f992c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:22:30.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.266+0000 7f994561b700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 0x7f992c067290 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f994006b730 tx=0x7f993c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:22:30.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.270+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99300509f0 con 0x7f99400f7980 2022-02-02T20:22:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.469+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9940027a00 con 0x7f99400f7980 2022-02-02T20:22:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.470+0000 7f9935ffb700 1 -- 172.21.15.96:0/1973099323 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9930023020 con 0x7f99400f7980 2022-02-02T20:22:30.473 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:22:30.473 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:22:30.474 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:22:30.474 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:22:30.474 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:22:30.474 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:22:30.475 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:22:30.475 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:22:30.475 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:22:30.475 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:22:30.476 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:22:30.476 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:22:30.476 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:22:30.476 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:22:30.477 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:22:30.477 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:22:30.477 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:22:30.477 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:22:30.477 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:22:30.478 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:22:30.478 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:22:30.478 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:22:30.478 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:22:30.479 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:22:30.479 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:22:30.479 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:22:30.479 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:22:30.480 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:22:30.480 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:22:30.480 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:22:30.480 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:22:30.480 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:22:30.481 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:22:30.481 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:22:30.481 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:22:30.481 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:22:30.482 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:22:30.482 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:22:30.482 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:22:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 msgr2=0x7f992c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 0x7f992c067290 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f994006b730 tx=0x7f993c00b040).stop 2022-02-02T20:22:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 msgr2=0x7f9940069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:22:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f9930000c00 tx=0x7f993000b040).stop 2022-02-02T20:22:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 shutdown_connections 2022-02-02T20:22:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f992c064dd0 0x7f992c067290 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99400f66e0 0x7f994006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 --2- 172.21.15.96:0/1973099323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99400f7980 0x7f9940069e20 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:22:30.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 >> 172.21.15.96:0/1973099323 conn(0x7f99400f1e40 msgr2=0x7f99400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:22:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 shutdown_connections 2022-02-02T20:22:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:22:30.472+0000 7f994787f700 1 -- 172.21.15.96:0/1973099323 wait complete. 2022-02-02T20:22:30.486 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:22:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:30 smithi159 ceph-mon[69013]: pgmap v3612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:30 smithi159 ceph-mon[69013]: from='client.37814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:31.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:31 smithi159 ceph-mon[69013]: from='client.37818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3939794148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:22:31.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1973099323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:22:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:31 smithi096 ceph-mon[101353]: from='client.37818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:22:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3939794148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:22:31.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1973099323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:22:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:32 smithi159 ceph-mon[69013]: pgmap v3613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:32 smithi096 ceph-mon[101353]: pgmap v3613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:34 smithi159 ceph-mon[69013]: pgmap v3614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:34 smithi096 ceph-mon[101353]: pgmap v3614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:36 smithi159 ceph-mon[69013]: pgmap v3615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:36 smithi096 ceph-mon[101353]: pgmap v3615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:37 smithi159 ceph-mon[69013]: pgmap v3616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:37 smithi096 ceph-mon[101353]: pgmap v3616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:40 smithi159 ceph-mon[69013]: pgmap v3617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:40 smithi096 ceph-mon[101353]: pgmap v3617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:42 smithi159 ceph-mon[69013]: pgmap v3618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:42 smithi096 ceph-mon[101353]: pgmap v3618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:44 smithi159 ceph-mon[69013]: pgmap v3619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:44 smithi096 ceph-mon[101353]: pgmap v3619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:46 smithi159 ceph-mon[69013]: pgmap v3620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:46 smithi096 ceph-mon[101353]: pgmap v3620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:47 smithi159 ceph-mon[69013]: pgmap v3621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:47 smithi096 ceph-mon[101353]: pgmap v3621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:50 smithi159 ceph-mon[69013]: pgmap v3622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:50 smithi096 ceph-mon[101353]: pgmap v3622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:52 smithi159 ceph-mon[69013]: pgmap v3623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:52 smithi096 ceph-mon[101353]: pgmap v3623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:54 smithi159 ceph-mon[69013]: pgmap v3624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:54 smithi096 ceph-mon[101353]: pgmap v3624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:56 smithi159 ceph-mon[69013]: pgmap v3625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:56 smithi096 ceph-mon[101353]: pgmap v3625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:22:57 smithi159 ceph-mon[69013]: pgmap v3626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:22:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:22:57 smithi096 ceph-mon[101353]: pgmap v3626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:00 smithi159 ceph-mon[69013]: pgmap v3627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:00 smithi096 ceph-mon[101353]: pgmap v3627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:00.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- 172.21.15.96:0/2449692127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 msgr2=0x7fe0000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 --2- 172.21.15.96:0/2449692127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f6cc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fdffc004660 tx=0x7fdffc009b30).stop 2022-02-02T20:23:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- 172.21.15.96:0/2449692127 shutdown_connections 2022-02-02T20:23:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 --2- 172.21.15.96:0/2449692127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f6cc0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 --2- 172.21.15.96:0/2449692127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- 172.21.15.96:0/2449692127 >> 172.21.15.96:0/2449692127 conn(0x7fe0000f0d40 msgr2=0x7fe0000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- 172.21.15.96:0/2449692127 shutdown_connections 2022-02-02T20:23:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- 172.21.15.96:0/2449692127 wait complete. 2022-02-02T20:23:00.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 Processor -- start 2022-02-02T20:23:00.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.584+0000 7fe007806700 1 -- start start 2022-02-02T20:23:00.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe007806700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe007806700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe007806700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000f8100 con 0x7fe0000f6860 2022-02-02T20:23:00.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe007806700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000f8240 con 0x7fe0000f55c0 2022-02-02T20:23:00.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36742/0 (socket says 172.21.15.96:36742) 2022-02-02T20:23:00.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 -- 172.21.15.96:0/2935265107 learned_addr learned my addr 172.21.15.96:0/2935265107 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:00.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 -- 172.21.15.96:0/2935265107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 msgr2=0x7fe0000f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe0055a2700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 -- 172.21.15.96:0/2935265107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc005040 con 0x7fe0000f6860 2022-02-02T20:23:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe0055a2700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:23:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe004da1700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fdffc009990 tx=0x7fdffc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdffc018070 con 0x7fe0000f6860 2022-02-02T20:23:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdffc007ca0 con 0x7fe0000f6860 2022-02-02T20:23:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000f84c0 con 0x7fe0000f6860 2022-02-02T20:23:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.585+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdffc01c620 con 0x7fe0000f6860 2022-02-02T20:23:00.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.586+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000f8a20 con 0x7fe0000f6860 2022-02-02T20:23:00.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.587+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000045ad0 con 0x7fe0000f6860 2022-02-02T20:23:00.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.587+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdffc01d960 con 0x7fe0000f6860 2022-02-02T20:23:00.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.588+0000 7fdff5ffb700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 0x7fdfec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.588+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdffc0838a0 con 0x7fe0000f6860 2022-02-02T20:23:00.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.588+0000 7fe0055a2700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 0x7fdfec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.588+0000 7fe0055a2700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 0x7fdfec067290 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fe0000f94b0 tx=0x7fdff0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:00.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.592+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdffc0519a0 con 0x7fe0000f6860 2022-02-02T20:23:00.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.767+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0000faca0 con 0x7fdfec064dd0 2022-02-02T20:23:00.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.769+0000 7fdff5ffb700 1 -- 172.21.15.96:0/2935265107 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe0000faca0 con 0x7fdfec064dd0 2022-02-02T20:23:00.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 msgr2=0x7fdfec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 0x7fdfec067290 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fe0000f94b0 tx=0x7fdff0009040).stop 2022-02-02T20:23:00.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 msgr2=0x7fe0000f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fdffc009990 tx=0x7fdffc009b30).stop 2022-02-02T20:23:00.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 shutdown_connections 2022-02-02T20:23:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdfec064dd0 0x7fdfec067290 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0000f55c0 0x7fe0000f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.770+0000 7fe007806700 1 --2- 172.21.15.96:0/2935265107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0000f6860 0x7fe0000f7ba0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.771+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 >> 172.21.15.96:0/2935265107 conn(0x7fe0000f0d40 msgr2=0x7fe00005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:00.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.771+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 shutdown_connections 2022-02-02T20:23:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.771+0000 7fe007806700 1 -- 172.21.15.96:0/2935265107 wait complete. 2022-02-02T20:23:00.782 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:23:00.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 -- 172.21.15.96:0/556482215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f66e0 msgr2=0x7f30d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 --2- 172.21.15.96:0/556482215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f66e0 0x7f30d00f6b00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f30c4004660 tx=0x7f30c4009b30).stop 2022-02-02T20:23:00.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 -- 172.21.15.96:0/556482215 shutdown_connections 2022-02-02T20:23:00.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 --2- 172.21.15.96:0/556482215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f7980 0x7f30d00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 --2- 172.21.15.96:0/556482215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f66e0 0x7f30d00f6b00 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 -- 172.21.15.96:0/556482215 >> 172.21.15.96:0/556482215 conn(0x7f30d00f1e40 msgr2=0x7f30d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:00.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 -- 172.21.15.96:0/556482215 shutdown_connections 2022-02-02T20:23:00.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 -- 172.21.15.96:0/556482215 wait complete. 2022-02-02T20:23:00.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.868+0000 7f30d4df8700 1 Processor -- start 2022-02-02T20:23:00.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30d4df8700 1 -- start start 2022-02-02T20:23:00.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30d4df8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f66e0 0x7f30d0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30d4df8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30d4df8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d0107990 con 0x7f30d00f7980 2022-02-02T20:23:00.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30d4df8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d0107ad0 con 0x7f30d00f66e0 2022-02-02T20:23:00.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36752/0 (socket says 172.21.15.96:36752) 2022-02-02T20:23:00.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 -- 172.21.15.96:0/1680204623 learned_addr learned my addr 172.21.15.96:0/1680204623 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:00.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30ce59c700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f66e0 0x7f30d0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 -- 172.21.15.96:0/1680204623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f66e0 msgr2=0x7f30d0106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:00.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f66e0 0x7f30d0106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:00.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 -- 172.21.15.96:0/1680204623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4005040 con 0x7f30d00f7980 2022-02-02T20:23:00.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.869+0000 7f30cdd9b700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f30c0002700 tx=0x7f30c0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:00.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.870+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c0009320 con 0x7f30d00f7980 2022-02-02T20:23:00.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.870+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30c000f040 con 0x7f30d00f7980 2022-02-02T20:23:00.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.870+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d0108470 con 0x7f30d00f7980 2022-02-02T20:23:00.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.870+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c0014870 con 0x7f30d00f7980 2022-02-02T20:23:00.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.870+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d0108a30 con 0x7f30d00f7980 2022-02-02T20:23:00.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.871+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d0045ad0 con 0x7f30d00f7980 2022-02-02T20:23:00.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.871+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f30c0009480 con 0x7f30d00f7980 2022-02-02T20:23:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.871+0000 7f30beffd700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 0x7f30b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.871+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f30c0081c50 con 0x7f30d00f7980 2022-02-02T20:23:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.872+0000 7f30ce59c700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 0x7f30b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.872+0000 7f30ce59c700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 0x7f30b8067290 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f30c4004630 tx=0x7f30c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:00.876+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f30c0053780 con 0x7f30d00f7980 2022-02-02T20:23:01.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.049+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30d00ff010 con 0x7f30b8064dd0 2022-02-02T20:23:01.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.058+0000 7f30beffd700 1 -- 172.21.15.96:0/1680204623 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f30d00ff010 con 0x7f30b8064dd0 2022-02-02T20:23:01.060 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:23:01.061 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 96m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:23:01.061 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (118m) 96m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:23:01.061 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (118m) 95m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:23:01.061 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 96m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:23:01.061 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 96m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:23:01.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (119m) 96m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:23:01.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 95m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:23:01.062 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (119m) 95m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:23:01.062 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 96m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:23:01.063 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 95m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:23:01.063 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (119m) 96m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:23:01.063 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (119m) 95m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:23:01.063 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 96m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:23:01.063 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 95m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:23:01.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (118m) 96m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:23:01.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (117m) 96m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:23:01.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (117m) 96m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:23:01.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (116m) 95m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:23:01.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (116m) 95m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:23:01.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (115m) 95m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:23:01.065 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 96m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:23:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 msgr2=0x7f30b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 0x7f30b8067290 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f30c4004630 tx=0x7f30c4009b30).stop 2022-02-02T20:23:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 msgr2=0x7f30d01073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f30c0002700 tx=0x7f30c0009e00).stop 2022-02-02T20:23:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 shutdown_connections 2022-02-02T20:23:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30b8064dd0 0x7f30b8067290 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30d00f66e0 0x7f30d0106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 --2- 172.21.15.96:0/1680204623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30d00f7980 0x7f30d01073e0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 >> 172.21.15.96:0/1680204623 conn(0x7f30d00f1e40 msgr2=0x7f30d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 shutdown_connections 2022-02-02T20:23:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.060+0000 7f30d4df8700 1 -- 172.21.15.96:0/1680204623 wait complete. 2022-02-02T20:23:01.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 -- 172.21.15.96:0/1175024143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f55c0 msgr2=0x7f77340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 --2- 172.21.15.96:0/1175024143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f55c0 0x7f77340f59e0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f7724004660 tx=0x7f7724009b30).stop 2022-02-02T20:23:01.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 -- 172.21.15.96:0/1175024143 shutdown_connections 2022-02-02T20:23:01.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 --2- 172.21.15.96:0/1175024143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f6860 0x7f77340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 --2- 172.21.15.96:0/1175024143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f55c0 0x7f77340f59e0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 -- 172.21.15.96:0/1175024143 >> 172.21.15.96:0/1175024143 conn(0x7f77340f0d40 msgr2=0x7f77340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:01.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 -- 172.21.15.96:0/1175024143 shutdown_connections 2022-02-02T20:23:01.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.156+0000 7f773a694700 1 -- 172.21.15.96:0/1175024143 wait complete. 2022-02-02T20:23:01.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 Processor -- start 2022-02-02T20:23:01.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 -- start start 2022-02-02T20:23:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f55c0 0x7f7734109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734060420 con 0x7f77340f6860 2022-02-02T20:23:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f773a694700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734060560 con 0x7f77340f55c0 2022-02-02T20:23:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f77337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f77337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36760/0 (socket says 172.21.15.96:36760) 2022-02-02T20:23:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.157+0000 7f77337fe700 1 -- 172.21.15.96:0/1921730481 learned_addr learned my addr 172.21.15.96:0/1921730481 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f7733fff700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f55c0 0x7f7734109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f77337fe700 1 -- 172.21.15.96:0/1921730481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f55c0 msgr2=0x7f7734109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f77337fe700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f55c0 0x7f7734109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f77337fe700 1 -- 172.21.15.96:0/1921730481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7724005040 con 0x7f77340f6860 2022-02-02T20:23:01.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f77337fe700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f772800c530 tx=0x7f7728007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f772800f650 con 0x7f77340f6860 2022-02-02T20:23:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773410c740 con 0x7f77340f6860 2022-02-02T20:23:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f772800fc60 con 0x7f77340f6860 2022-02-02T20:23:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773410ccd0 con 0x7f77340f6860 2022-02-02T20:23:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.158+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7728012c20 con 0x7f77340f6860 2022-02-02T20:23:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.159+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7714004fa0 con 0x7f77340f6860 2022-02-02T20:23:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.160+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7728010070 con 0x7f77340f6860 2022-02-02T20:23:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.160+0000 7f7730ff9700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 0x7f771c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.160+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7728081610 con 0x7f77340f6860 2022-02-02T20:23:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.160+0000 7f7733fff700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 0x7f771c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.160+0000 7f7733fff700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 0x7f771c067290 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f7724013690 tx=0x7f7724009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:01.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.164+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7728052d90 con 0x7f77340f6860 2022-02-02T20:23:01.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.396+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7714005e80 con 0x7f77340f6860 2022-02-02T20:23:01.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.397+0000 7f7730ff9700 1 -- 172.21.15.96:0/1921730481 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7728053390 con 0x7f77340f6860 2022-02-02T20:23:01.399 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:23:01.399 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:23:01.400 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:23:01.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:01.400 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:23:01.400 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:23:01.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:01.401 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:23:01.401 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:23:01.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:01.401 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:23:01.402 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:23:01.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:01.402 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:23:01.402 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:23:01.402 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:23:01.403 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:23:01.403 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:23:01.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 msgr2=0x7f771c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 0x7f771c067290 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f7724013690 tx=0x7f7724009b30).stop 2022-02-02T20:23:01.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 msgr2=0x7f773410c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f772800c530 tx=0x7f7728007e20).stop 2022-02-02T20:23:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 shutdown_connections 2022-02-02T20:23:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f771c064dd0 0x7f771c067290 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340f55c0 0x7f7734109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 --2- 172.21.15.96:0/1921730481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77340f6860 0x7f773410c130 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 >> 172.21.15.96:0/1921730481 conn(0x7f77340f0d40 msgr2=0x7f77340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 shutdown_connections 2022-02-02T20:23:01.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.399+0000 7f773a694700 1 -- 172.21.15.96:0/1921730481 wait complete. 2022-02-02T20:23:01.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 -- 172.21.15.96:0/766094999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 msgr2=0x7fd9400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 --2- 172.21.15.96:0/766094999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd9400f7de0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7fd930004660 tx=0x7fd930009b30).stop 2022-02-02T20:23:01.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 -- 172.21.15.96:0/766094999 shutdown_connections 2022-02-02T20:23:01.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 --2- 172.21.15.96:0/766094999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd9400f7de0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 --2- 172.21.15.96:0/766094999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 0x7fd9400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:23:01.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 -- 172.21.15.96:0/766094999 >> 172.21.15.96:0/766094999 conn(0x7fd9400f1e40 msgr2=0x7fd9400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:01.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 -- 172.21.15.96:0/766094999 shutdown_connections 2022-02-02T20:23:01.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.496+0000 7fd944c55700 1 -- 172.21.15.96:0/766094999 wait complete. 2022-02-02T20:23:01.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 Processor -- start 2022-02-02T20:23:01.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 -- start start 2022-02-02T20:23:01.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 0x7fd94006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94006a410 con 0x7fd9400f7980 2022-02-02T20:23:01.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd944c55700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94006a550 con 0x7fd9400f66e0 2022-02-02T20:23:01.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd93dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd93dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36776/0 (socket says 172.21.15.96:36776) 2022-02-02T20:23:01.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd93dd9b700 1 -- 172.21.15.96:0/2137488057 learned_addr learned my addr 172.21.15.96:0/2137488057 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:01.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.497+0000 7fd93e59c700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 0x7fd94006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd93dd9b700 1 -- 172.21.15.96:0/2137488057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 msgr2=0x7fd94006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd93dd9b700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 0x7fd94006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd93dd9b700 1 -- 172.21.15.96:0/2137488057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930005040 con 0x7fd9400f7980 2022-02-02T20:23:01.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd93dd9b700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7fd930009990 tx=0x7fd930009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:01.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd930018070 con 0x7fd9400f7980 2022-02-02T20:23:01.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94006a7d0 con 0x7fd9400f7980 2022-02-02T20:23:01.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd930007ba0 con 0x7fd9400f7980 2022-02-02T20:23:01.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93001c620 con 0x7fd9400f7980 2022-02-02T20:23:01.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.498+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94010efe0 con 0x7fd9400f7980 2022-02-02T20:23:01.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.499+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd940045ad0 con 0x7fd9400f7980 2022-02-02T20:23:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.499+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd93001c8e0 con 0x7fd9400f7980 2022-02-02T20:23:01.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.500+0000 7fd92effd700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 0x7fd928067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:01.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.500+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd930083890 con 0x7fd9400f7980 2022-02-02T20:23:01.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.500+0000 7fd93e59c700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 0x7fd928067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:01.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.500+0000 7fd93e59c700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 0x7fd928067290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fd94006b730 tx=0x7fd934008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:01.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.504+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd930051990 con 0x7fd9400f7980 2022-02-02T20:23:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.707+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd940027a00 con 0x7fd9400f7980 2022-02-02T20:23:01.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.708+0000 7fd92effd700 1 -- 172.21.15.96:0/2137488057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd930054fb0 con 0x7fd9400f7980 2022-02-02T20:23:01.710 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:23:01.711 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:23:01.711 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:23:01.711 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:23:01.712 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:01.712 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:23:01.712 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:23:01.712 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:23:01.712 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:23:01.714 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:23:01.714 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:23:01.714 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:23:01.714 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:23:01.715 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:23:01.715 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:23:01.715 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:23:01.715 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:23:01.715 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:23:01.716 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:23:01.716 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:23:01.716 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:23:01.716 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:23:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:23:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:23:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:23:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:23:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:23:01.718 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:23:01.718 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:23:01.718 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:23:01.718 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:23:01.718 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:23:01.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:01.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:01.719 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:23:01.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:01.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:01.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:01.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 msgr2=0x7fd928067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 0x7fd928067290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fd94006b730 tx=0x7fd934008040).stop 2022-02-02T20:23:01.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 msgr2=0x7fd940069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:01.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7fd930009990 tx=0x7fd930009b30).stop 2022-02-02T20:23:01.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 shutdown_connections 2022-02-02T20:23:01.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd928064dd0 0x7fd928067290 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f66e0 0x7fd94006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 --2- 172.21.15.96:0/2137488057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f7980 0x7fd940069e20 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:01.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 >> 172.21.15.96:0/2137488057 conn(0x7fd9400f1e40 msgr2=0x7fd9400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:01.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 shutdown_connections 2022-02-02T20:23:01.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:01.710+0000 7fd944c55700 1 -- 172.21.15.96:0/2137488057 wait complete. 2022-02-02T20:23:01.724 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:23:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:02 smithi159 ceph-mon[69013]: from='client.37830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:02 smithi159 ceph-mon[69013]: from='client.37834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:02 smithi159 ceph-mon[69013]: pgmap v3628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1921730481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:23:02.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2137488057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:23:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:02 smithi096 ceph-mon[101353]: from='client.37830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:02 smithi096 ceph-mon[101353]: from='client.37834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:02 smithi096 ceph-mon[101353]: pgmap v3628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1921730481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:23:02.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2137488057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:23:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:04 smithi159 ceph-mon[69013]: pgmap v3629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:04 smithi096 ceph-mon[101353]: pgmap v3629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:06 smithi159 ceph-mon[69013]: pgmap v3630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:06 smithi096 ceph-mon[101353]: pgmap v3630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:07 smithi159 ceph-mon[69013]: pgmap v3631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:07 smithi096 ceph-mon[101353]: pgmap v3631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:10 smithi159 ceph-mon[69013]: pgmap v3632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:10 smithi096 ceph-mon[101353]: pgmap v3632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:12 smithi159 ceph-mon[69013]: pgmap v3633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:12 smithi096 ceph-mon[101353]: pgmap v3633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:14 smithi159 ceph-mon[69013]: pgmap v3634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:14 smithi096 ceph-mon[101353]: pgmap v3634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:16 smithi159 ceph-mon[69013]: pgmap v3635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:16 smithi096 ceph-mon[101353]: pgmap v3635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:17 smithi159 ceph-mon[69013]: pgmap v3636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:17 smithi096 ceph-mon[101353]: pgmap v3636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:20 smithi159 ceph-mon[69013]: pgmap v3637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:20 smithi096 ceph-mon[101353]: pgmap v3637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:22 smithi159 ceph-mon[69013]: pgmap v3638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:22 smithi096 ceph-mon[101353]: pgmap v3638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:24 smithi159 ceph-mon[69013]: pgmap v3639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:24 smithi096 ceph-mon[101353]: pgmap v3639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:26 smithi159 ceph-mon[69013]: pgmap v3640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:26 smithi096 ceph-mon[101353]: pgmap v3640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:27 smithi159 ceph-mon[69013]: pgmap v3641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:23:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:23:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:27 smithi096 ceph-mon[101353]: pgmap v3641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:23:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:23:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:30 smithi159 ceph-mon[69013]: pgmap v3642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:30 smithi096 ceph-mon[101353]: pgmap v3642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:31.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 -- 172.21.15.96:0/1845542006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 msgr2=0x7f60e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1845542006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e80f6cc0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f60e4004660 tx=0x7f60e4009b30).stop 2022-02-02T20:23:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 -- 172.21.15.96:0/1845542006 shutdown_connections 2022-02-02T20:23:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1845542006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e80f6cc0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1845542006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 0x7f60e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:23:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 -- 172.21.15.96:0/1845542006 >> 172.21.15.96:0/1845542006 conn(0x7f60e80f0d40 msgr2=0x7f60e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 -- 172.21.15.96:0/1845542006 shutdown_connections 2022-02-02T20:23:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.820+0000 7f60ef52e700 1 -- 172.21.15.96:0/1845542006 wait complete. 2022-02-02T20:23:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 Processor -- start 2022-02-02T20:23:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 -- start start 2022-02-02T20:23:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 0x7f60e810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80602b0 con 0x7f60e80f6860 2022-02-02T20:23:31.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ef52e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80603f0 con 0x7f60e80f55c0 2022-02-02T20:23:31.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:31.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36808/0 (socket says 172.21.15.96:36808) 2022-02-02T20:23:31.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 -- 172.21.15.96:0/1672590605 learned_addr learned my addr 172.21.15.96:0/1672590605 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ed2ca700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 0x7f60e810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 -- 172.21.15.96:0/1672590605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 msgr2=0x7f60e810c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 0x7f60e810c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.821+0000 7f60ecac9700 1 -- 172.21.15.96:0/1672590605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4005040 con 0x7f60e80f6860 2022-02-02T20:23:31.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ecac9700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f60e4009990 tx=0x7f60e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e4018070 con 0x7f60e80f6860 2022-02-02T20:23:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e810eac0 con 0x7f60e80f6860 2022-02-02T20:23:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60e4007ba0 con 0x7f60e80f6860 2022-02-02T20:23:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e401c620 con 0x7f60e80f6860 2022-02-02T20:23:31.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.822+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e810eee0 con 0x7f60e80f6860 2022-02-02T20:23:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.823+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8045ad0 con 0x7f60e80f6860 2022-02-02T20:23:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.824+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f60e401c8e0 con 0x7f60e80f6860 2022-02-02T20:23:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.824+0000 7f60ddffb700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 0x7f60d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.824+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f60e4083850 con 0x7f60e80f6860 2022-02-02T20:23:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.824+0000 7f60ed2ca700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 0x7f60d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.824+0000 7f60ed2ca700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 0x7f60d4067290 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f60e8060040 tx=0x7f60d8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:31.828+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60e4051950 con 0x7f60e80f6860 2022-02-02T20:23:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.006+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60e80fdfd0 con 0x7f60d4064dd0 2022-02-02T20:23:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.007+0000 7f60ddffb700 1 -- 172.21.15.96:0/1672590605 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f60d800b5f0 con 0x7f60d4064dd0 2022-02-02T20:23:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 msgr2=0x7f60d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 0x7f60d4067290 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f60e8060040 tx=0x7f60d8008040).stop 2022-02-02T20:23:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 msgr2=0x7f60e810e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f60e4009990 tx=0x7f60e4009b30).stop 2022-02-02T20:23:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 shutdown_connections 2022-02-02T20:23:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f60d4064dd0 0x7f60d4067290 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60e80f55c0 0x7f60e810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 --2- 172.21.15.96:0/1672590605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60e80f6860 0x7f60e810e5d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 >> 172.21.15.96:0/1672590605 conn(0x7f60e80f0d40 msgr2=0x7f60e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 shutdown_connections 2022-02-02T20:23:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.009+0000 7f60ef52e700 1 -- 172.21.15.96:0/1672590605 wait complete. 2022-02-02T20:23:32.020 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:23:32.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/1598644434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 msgr2=0x7f5fac0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/1598644434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac0f7dc0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f5f9c004660 tx=0x7f5f9c009b30).stop 2022-02-02T20:23:32.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/1598644434 shutdown_connections 2022-02-02T20:23:32.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/1598644434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac0f7dc0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/1598644434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 0x7f5fac0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/1598644434 >> 172.21.15.96:0/1598644434 conn(0x7f5fac0f1e20 msgr2=0x7f5fac0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/1598644434 shutdown_connections 2022-02-02T20:23:32.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.106+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/1598644434 wait complete. 2022-02-02T20:23:32.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 Processor -- start 2022-02-02T20:23:32.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 -- start start 2022-02-02T20:23:32.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 0x7f5fac106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1079f0 con 0x7f5fac0f7960 2022-02-02T20:23:32.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5fb1a5d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac107b30 con 0x7f5fac0f66c0 2022-02-02T20:23:32.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5faa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5faa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36818/0 (socket says 172.21.15.96:36818) 2022-02-02T20:23:32.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5faa7fc700 1 -- 172.21.15.96:0/3876202284 learned_addr learned my addr 172.21.15.96:0/3876202284 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:32.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.107+0000 7f5faaffd700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 0x7f5fac106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5faa7fc700 1 -- 172.21.15.96:0/3876202284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 msgr2=0x7f5fac106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5faa7fc700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 0x7f5fac106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5faa7fc700 1 -- 172.21.15.96:0/3876202284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c005040 con 0x7f5fac0f7960 2022-02-02T20:23:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5faa7fc700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f5f9c009990 tx=0x7f5f9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9c018070 con 0x7f5fac0f7960 2022-02-02T20:23:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f9c007ba0 con 0x7f5fac0f7960 2022-02-02T20:23:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac108470 con 0x7f5fac0f7960 2022-02-02T20:23:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9c01c3c0 con 0x7f5fac0f7960 2022-02-02T20:23:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.108+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac1089d0 con 0x7f5fac0f7960 2022-02-02T20:23:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.109+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac045ad0 con 0x7f5fac0f7960 2022-02-02T20:23:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.110+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f9c01d420 con 0x7f5fac0f7960 2022-02-02T20:23:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.110+0000 7f5fa37fe700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 0x7f5f98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.110+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f9c0836a0 con 0x7f5fac0f7960 2022-02-02T20:23:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.110+0000 7f5faaffd700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 0x7f5f98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.110+0000 7f5faaffd700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 0x7f5f98067290 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f5fac0f77c0 tx=0x7f5f9400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.114+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f9c055290 con 0x7f5fac0f7960 2022-02-02T20:23:32.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.291+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fac108bf0 con 0x7f5f98064dd0 2022-02-02T20:23:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.300+0000 7f5fa37fe700 1 -- 172.21.15.96:0/3876202284 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f5fac108bf0 con 0x7f5f98064dd0 2022-02-02T20:23:32.303 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:23:32.303 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 97m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:23:32.303 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (119m) 97m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:23:32.303 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (119m) 95m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:23:32.304 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 97m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:23:32.304 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 97m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:23:32.304 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (119m) 97m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:23:32.304 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 95m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:23:32.305 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (119m) 95m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:23:32.305 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 97m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:23:32.305 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 95m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:23:32.305 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 97m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:23:32.305 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (119m) 95m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:23:32.306 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 97m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:23:32.306 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 95m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:23:32.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (118m) 97m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:23:32.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (118m) 97m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:23:32.307 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (117m) 97m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:23:32.307 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (117m) 95m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:23:32.307 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (116m) 95m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:23:32.307 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (116m) 95m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:23:32.308 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 97m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:23:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 msgr2=0x7f5f98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 0x7f5f98067290 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f5fac0f77c0 tx=0x7f5f9400b040).stop 2022-02-02T20:23:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 msgr2=0x7f5fac107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f5f9c009990 tx=0x7f5f9c009b30).stop 2022-02-02T20:23:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 shutdown_connections 2022-02-02T20:23:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f98064dd0 0x7f5f98067290 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fac0f66c0 0x7f5fac106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 --2- 172.21.15.96:0/3876202284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fac0f7960 0x7f5fac107440 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 >> 172.21.15.96:0/3876202284 conn(0x7f5fac0f1e20 msgr2=0x7f5fac0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 shutdown_connections 2022-02-02T20:23:32.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.302+0000 7f5fb1a5d700 1 -- 172.21.15.96:0/3876202284 wait complete. 2022-02-02T20:23:32.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- 172.21.15.96:0/1594499462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f55c0 msgr2=0x7f41c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 --2- 172.21.15.96:0/1594499462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f55c0 0x7f41c40f59e0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f41b8004660 tx=0x7f41b8009b30).stop 2022-02-02T20:23:32.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- 172.21.15.96:0/1594499462 shutdown_connections 2022-02-02T20:23:32.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 --2- 172.21.15.96:0/1594499462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f6860 0x7f41c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 --2- 172.21.15.96:0/1594499462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f55c0 0x7f41c40f59e0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- 172.21.15.96:0/1594499462 >> 172.21.15.96:0/1594499462 conn(0x7f41c40f0d40 msgr2=0x7f41c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- 172.21.15.96:0/1594499462 shutdown_connections 2022-02-02T20:23:32.403 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:32 smithi096 ceph-mon[101353]: pgmap v3643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:32.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- 172.21.15.96:0/1594499462 wait complete. 2022-02-02T20:23:32.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 Processor -- start 2022-02-02T20:23:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.399+0000 7f41c8ece700 1 -- start start 2022-02-02T20:23:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c8ece700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f55c0 0x7f41c4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c8ece700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c8ece700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40603c0 con 0x7f41c40f6860 2022-02-02T20:23:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c8ece700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c4060500 con 0x7f41c40f55c0 2022-02-02T20:23:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36828/0 (socket says 172.21.15.96:36828) 2022-02-02T20:23:32.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 -- 172.21.15.96:0/2460678319 learned_addr learned my addr 172.21.15.96:0/2460678319 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:32.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c259c700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f55c0 0x7f41c4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 -- 172.21.15.96:0/2460678319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f55c0 msgr2=0x7f41c4109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f55c0 0x7f41c4109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 -- 172.21.15.96:0/2460678319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8005040 con 0x7f41c40f6860 2022-02-02T20:23:32.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.400+0000 7f41c1d9b700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f41b400c790 tx=0x7f41b4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.401+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41b4002590 con 0x7f41c40f6860 2022-02-02T20:23:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.401+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41b4002ba0 con 0x7f41c40f6860 2022-02-02T20:23:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.401+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c410c740 con 0x7f41c40f6860 2022-02-02T20:23:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.401+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c410ccd0 con 0x7f41c40f6860 2022-02-02T20:23:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.401+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41b4013d90 con 0x7f41c40f6860 2022-02-02T20:23:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.402+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f41b401a060 con 0x7f41c40f6860 2022-02-02T20:23:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.402+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a8004fa0 con 0x7f41c40f6860 2022-02-02T20:23:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.402+0000 7f41b2ffd700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 0x7f41ac067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.402+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41b4081c80 con 0x7f41c40f6860 2022-02-02T20:23:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.402+0000 7f41c259c700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 0x7f41ac067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.403+0000 7f41c259c700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 0x7f41ac067270 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f41c4060040 tx=0x7f41b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.407+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41b4087020 con 0x7f41c40f6860 2022-02-02T20:23:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:32 smithi159 ceph-mon[69013]: pgmap v3643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:32.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.637+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41a8005e80 con 0x7f41c40f6860 2022-02-02T20:23:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.637+0000 7f41b2ffd700 1 -- 172.21.15.96:0/2460678319 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f41b40536d0 con 0x7f41c40f6860 2022-02-02T20:23:32.641 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:23:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:23:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:23:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:23:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:23:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:23:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:23:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:23:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:23:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:23:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:23:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:23:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:23:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:23:32.645 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:23:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 msgr2=0x7f41ac067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 0x7f41ac067270 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f41c4060040 tx=0x7f41b8009b30).stop 2022-02-02T20:23:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 msgr2=0x7f41c410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f41b400c790 tx=0x7f41b4007d70).stop 2022-02-02T20:23:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 shutdown_connections 2022-02-02T20:23:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41ac064db0 0x7f41ac067270 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41c40f55c0 0x7f41c4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 --2- 172.21.15.96:0/2460678319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c40f6860 0x7f41c410c190 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.639+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 >> 172.21.15.96:0/2460678319 conn(0x7f41c40f0d40 msgr2=0x7f41c40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.640+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 shutdown_connections 2022-02-02T20:23:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.640+0000 7f41c8ece700 1 -- 172.21.15.96:0/2460678319 wait complete. 2022-02-02T20:23:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 -- 172.21.15.96:0/2044405207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 msgr2=0x7fec3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 --2- 172.21.15.96:0/2044405207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c0f7c30 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fec30004660 tx=0x7fec30009b30).stop 2022-02-02T20:23:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 -- 172.21.15.96:0/2044405207 shutdown_connections 2022-02-02T20:23:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 --2- 172.21.15.96:0/2044405207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c0f7c30 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 --2- 172.21.15.96:0/2044405207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 -- 172.21.15.96:0/2044405207 >> 172.21.15.96:0/2044405207 conn(0x7fec3c0f1c90 msgr2=0x7fec3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 -- 172.21.15.96:0/2044405207 shutdown_connections 2022-02-02T20:23:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.736+0000 7fec411b4700 1 -- 172.21.15.96:0/2044405207 wait complete. 2022-02-02T20:23:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.737+0000 7fec411b4700 1 Processor -- start 2022-02-02T20:23:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.737+0000 7fec411b4700 1 -- start start 2022-02-02T20:23:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec411b4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec411b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec411b4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06a380 con 0x7fec3c0f77d0 2022-02-02T20:23:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec411b4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06a4c0 con 0x7fec3c0f6530 2022-02-02T20:23:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36838/0 (socket says 172.21.15.96:36838) 2022-02-02T20:23:32.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 -- 172.21.15.96:0/1237778173 learned_addr learned my addr 172.21.15.96:0/1237778173 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:23:32.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3bfff700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 -- 172.21.15.96:0/1237778173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 msgr2=0x7fec3c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 -- 172.21.15.96:0/1237778173 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30005040 con 0x7fec3c0f77d0 2022-02-02T20:23:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3bfff700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:23:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec3b7fe700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7fec30000c00 tx=0x7fec3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec30019070 con 0x7fec3c0f77d0 2022-02-02T20:23:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec30007e70 con 0x7fec3c0f77d0 2022-02-02T20:23:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c06a740 con 0x7fec3c0f77d0 2022-02-02T20:23:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.738+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec30014d90 con 0x7fec3c0f77d0 2022-02-02T20:23:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.739+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c06aca0 con 0x7fec3c0f77d0 2022-02-02T20:23:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.739+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c045ad0 con 0x7fec3c0f77d0 2022-02-02T20:23:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.740+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec30025070 con 0x7fec3c0f77d0 2022-02-02T20:23:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.741+0000 7fec38ff9700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 0x7fec240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:23:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.741+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec30082de0 con 0x7fec3c0f77d0 2022-02-02T20:23:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.741+0000 7fec3bfff700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 0x7fec240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:23:32.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.741+0000 7fec3bfff700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 0x7fec240672e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fec2c009da0 tx=0x7fec2c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:23:32.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.744+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec30050ee0 con 0x7fec3c0f77d0 2022-02-02T20:23:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.946+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec3c027a00 con 0x7fec3c0f77d0 2022-02-02T20:23:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.947+0000 7fec38ff9700 1 -- 172.21.15.96:0/1237778173 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fec30023020 con 0x7fec3c0f77d0 2022-02-02T20:23:32.949 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:23:32.949 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:23:32.949 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:23:32.950 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:23:32.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:32.950 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:23:32.950 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:23:32.951 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:23:32.951 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:23:32.952 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:23:32.952 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:23:32.952 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:23:32.952 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:23:32.952 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:23:32.953 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:23:32.954 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:23:32.954 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:23:32.954 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:23:32.954 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:23:32.954 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:23:32.955 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:23:32.955 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:23:32.955 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:23:32.955 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:23:32.956 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:23:32.956 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:23:32.956 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:23:32.956 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:23:32.957 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:23:32.957 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:23:32.957 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:23:32.957 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:23:32.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:32.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:32.958 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:23:32.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:23:32.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:32.959 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:32.959 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:23:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.948+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 msgr2=0x7fec240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.948+0000 7fec411b4700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 0x7fec240672e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fec2c009da0 tx=0x7fec2c00b040).stop 2022-02-02T20:23:32.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.948+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 msgr2=0x7fec3c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:23:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.948+0000 7fec411b4700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7fec30000c00 tx=0x7fec3000b040).stop 2022-02-02T20:23:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 shutdown_connections 2022-02-02T20:23:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec24064e20 0x7fec240672e0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec3c0f6530 0x7fec3c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 --2- 172.21.15.96:0/1237778173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec3c0f77d0 0x7fec3c069e20 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:23:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 >> 172.21.15.96:0/1237778173 conn(0x7fec3c0f1c90 msgr2=0x7fec3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:23:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 shutdown_connections 2022-02-02T20:23:32.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:23:32.949+0000 7fec411b4700 1 -- 172.21.15.96:0/1237778173 wait complete. 2022-02-02T20:23:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:23:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:33 smithi159 ceph-mon[69013]: from='client.37846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:33 smithi159 ceph-mon[69013]: from='client.37850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2460678319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:23:33.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1237778173' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:23:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:33 smithi096 ceph-mon[101353]: from='client.37846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:33 smithi096 ceph-mon[101353]: from='client.37850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:23:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2460678319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:23:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1237778173' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:23:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:34 smithi159 ceph-mon[69013]: pgmap v3644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:34 smithi096 ceph-mon[101353]: pgmap v3644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:36 smithi159 ceph-mon[69013]: pgmap v3645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:36 smithi096 ceph-mon[101353]: pgmap v3645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:37 smithi159 ceph-mon[69013]: pgmap v3646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:37 smithi096 ceph-mon[101353]: pgmap v3646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:40 smithi159 ceph-mon[69013]: pgmap v3647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:40 smithi096 ceph-mon[101353]: pgmap v3647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:42.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:42 smithi159 ceph-mon[69013]: pgmap v3648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:42 smithi096 ceph-mon[101353]: pgmap v3648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:44 smithi159 ceph-mon[69013]: pgmap v3649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:44 smithi096 ceph-mon[101353]: pgmap v3649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:46 smithi159 ceph-mon[69013]: pgmap v3650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:46 smithi096 ceph-mon[101353]: pgmap v3650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:47 smithi159 ceph-mon[69013]: pgmap v3651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:47 smithi096 ceph-mon[101353]: pgmap v3651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:50 smithi159 ceph-mon[69013]: pgmap v3652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:50 smithi096 ceph-mon[101353]: pgmap v3652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:52 smithi159 ceph-mon[69013]: pgmap v3653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:52 smithi096 ceph-mon[101353]: pgmap v3653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:54 smithi159 ceph-mon[69013]: pgmap v3654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:54 smithi096 ceph-mon[101353]: pgmap v3654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:56 smithi159 ceph-mon[69013]: pgmap v3655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:56 smithi096 ceph-mon[101353]: pgmap v3655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:23:57 smithi159 ceph-mon[69013]: pgmap v3656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:23:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:23:57 smithi096 ceph-mon[101353]: pgmap v3656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:00 smithi159 ceph-mon[69013]: pgmap v3657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:00 smithi096 ceph-mon[101353]: pgmap v3657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:02 smithi159 ceph-mon[69013]: pgmap v3658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:02.796 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:02 smithi096 ceph-mon[101353]: pgmap v3658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:03.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 -- 172.21.15.96:0/2352173306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f66d0 msgr2=0x7ffa240f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/2352173306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f66d0 0x7ffa240f6b30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7ffa10004660 tx=0x7ffa10009b30).stop 2022-02-02T20:24:03.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 -- 172.21.15.96:0/2352173306 shutdown_connections 2022-02-02T20:24:03.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/2352173306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f66d0 0x7ffa240f6b30 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/2352173306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f5430 0x7ffa240f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:24:03.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 -- 172.21.15.96:0/2352173306 >> 172.21.15.96:0/2352173306 conn(0x7ffa240f0b90 msgr2=0x7ffa240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 -- 172.21.15.96:0/2352173306 shutdown_connections 2022-02-02T20:24:03.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 -- 172.21.15.96:0/2352173306 wait complete. 2022-02-02T20:24:03.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.059+0000 7ffa29ddd700 1 Processor -- start 2022-02-02T20:24:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa29ddd700 1 -- start start 2022-02-02T20:24:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa29ddd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa29ddd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f66d0 0x7ffa24109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa29ddd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24109ac0 con 0x7ffa240f5430 2022-02-02T20:24:03.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa29ddd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2410a370 con 0x7ffa240f66d0 2022-02-02T20:24:03.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa28ddb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa28ddb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36858/0 (socket says 172.21.15.96:36858) 2022-02-02T20:24:03.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa28ddb700 1 -- 172.21.15.96:0/626698763 learned_addr learned my addr 172.21.15.96:0/626698763 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:03.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa23fff700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f66d0 0x7ffa24109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa28ddb700 1 -- 172.21.15.96:0/626698763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f66d0 msgr2=0x7ffa24109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.060+0000 7ffa28ddb700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f66d0 0x7ffa24109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa28ddb700 1 -- 172.21.15.96:0/626698763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10005040 con 0x7ffa240f5430 2022-02-02T20:24:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa28ddb700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7ffa180093f0 tx=0x7ffa18006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa18013640 con 0x7ffa240f5430 2022-02-02T20:24:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2410a650 con 0x7ffa240f5430 2022-02-02T20:24:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa18013c50 con 0x7ffa240f5430 2022-02-02T20:24:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa18012c10 con 0x7ffa240f5430 2022-02-02T20:24:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.061+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2410ac10 con 0x7ffa240f5430 2022-02-02T20:24:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.062+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa24059100 con 0x7ffa240f5430 2022-02-02T20:24:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.062+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa1801a060 con 0x7ffa240f5430 2022-02-02T20:24:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.063+0000 7ffa217fa700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 0x7ffa140672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.063+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa18081ac0 con 0x7ffa240f5430 2022-02-02T20:24:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.063+0000 7ffa23fff700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 0x7ffa140672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.063+0000 7ffa23fff700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 0x7ffa140672c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7ffa10004e30 tx=0x7ffa10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.067+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa180536d0 con 0x7ffa240f5430 2022-02-02T20:24:03.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.246+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa240fa910 con 0x7ffa14064e00 2022-02-02T20:24:03.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.248+0000 7ffa217fa700 1 -- 172.21.15.96:0/626698763 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffa240fa910 con 0x7ffa14064e00 2022-02-02T20:24:03.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 msgr2=0x7ffa140672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 0x7ffa140672c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7ffa10004e30 tx=0x7ffa10009b30).stop 2022-02-02T20:24:03.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 msgr2=0x7ffa24108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7ffa180093f0 tx=0x7ffa18006ec0).stop 2022-02-02T20:24:03.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 shutdown_connections 2022-02-02T20:24:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa14064e00 0x7ffa140672c0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa240f5430 0x7ffa24108f90 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 --2- 172.21.15.96:0/626698763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa240f66d0 0x7ffa24109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 >> 172.21.15.96:0/626698763 conn(0x7ffa240f0b90 msgr2=0x7ffa2405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 shutdown_connections 2022-02-02T20:24:03.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.250+0000 7ffa29ddd700 1 -- 172.21.15.96:0/626698763 wait complete. 2022-02-02T20:24:03.262 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:24:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- 172.21.15.96:0/2834337999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f6860 msgr2=0x7f97c00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 --2- 172.21.15.96:0/2834337999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f6860 0x7f97c00f6cc0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f97bc004660 tx=0x7f97bc009b30).stop 2022-02-02T20:24:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- 172.21.15.96:0/2834337999 shutdown_connections 2022-02-02T20:24:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 --2- 172.21.15.96:0/2834337999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f6860 0x7f97c00f6cc0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 --2- 172.21.15.96:0/2834337999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f55c0 0x7f97c00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- 172.21.15.96:0/2834337999 >> 172.21.15.96:0/2834337999 conn(0x7f97c00f0d40 msgr2=0x7f97c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- 172.21.15.96:0/2834337999 shutdown_connections 2022-02-02T20:24:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- 172.21.15.96:0/2834337999 wait complete. 2022-02-02T20:24:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 Processor -- start 2022-02-02T20:24:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.347+0000 7f97c7488700 1 -- start start 2022-02-02T20:24:03.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c7488700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c7488700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f6860 0x7f97c010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c7488700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00602b0 con 0x7f97c00f55c0 2022-02-02T20:24:03.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c7488700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00603f0 con 0x7f97c00f6860 2022-02-02T20:24:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36868/0 (socket says 172.21.15.96:36868) 2022-02-02T20:24:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 -- 172.21.15.96:0/785004608 learned_addr learned my addr 172.21.15.96:0/785004608 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c4a23700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f6860 0x7f97c010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 -- 172.21.15.96:0/785004608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f6860 msgr2=0x7f97c010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f6860 0x7f97c010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 -- 172.21.15.96:0/785004608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97c00f55c0 2022-02-02T20:24:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c5224700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f97b400c790 tx=0x7f97b4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b400e680 con 0x7f97c00f55c0 2022-02-02T20:24:03.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97b400ec90 con 0x7f97c00f55c0 2022-02-02T20:24:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c010ea60 con 0x7f97c00f55c0 2022-02-02T20:24:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.348+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b4012d00 con 0x7f97c00f55c0 2022-02-02T20:24:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.349+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c010eee0 con 0x7f97c00f55c0 2022-02-02T20:24:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.350+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c0045ad0 con 0x7f97c00f55c0 2022-02-02T20:24:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.350+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f97b4010070 con 0x7f97c00f55c0 2022-02-02T20:24:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.350+0000 7f97b1ffb700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 0x7f97ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.350+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f97b4081a20 con 0x7f97c00f55c0 2022-02-02T20:24:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.350+0000 7f97c4a23700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 0x7f97ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.351+0000 7f97c4a23700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 0x7f97ac067290 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f97bc004e30 tx=0x7f97bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.355+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f97b404fac0 con 0x7f97c00f55c0 2022-02-02T20:24:03.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.527+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f97c00fde60 con 0x7f97ac064dd0 2022-02-02T20:24:03.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.536+0000 7f97b1ffb700 1 -- 172.21.15.96:0/785004608 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f97c00fde60 con 0x7f97ac064dd0 2022-02-02T20:24:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:24:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 98m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:24:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (119m) 98m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:24:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (119m) 96m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:24:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 98m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:24:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 98m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:24:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 98m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:24:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 96m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:24:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 96m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:24:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 98m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:24:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 96m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:24:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 98m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:24:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 96m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:24:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 98m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:24:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 96m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:24:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (119m) 98m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:24:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (118m) 98m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:24:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (118m) 98m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:24:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (117m) 96m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:24:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (117m) 96m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:24:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (116m) 96m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:24:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 98m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:24:03.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 msgr2=0x7f97ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 0x7f97ac067290 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f97bc004e30 tx=0x7f97bc009b30).stop 2022-02-02T20:24:03.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 msgr2=0x7f97c010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f97b400c790 tx=0x7f97b4007d90).stop 2022-02-02T20:24:03.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 shutdown_connections 2022-02-02T20:24:03.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f97ac064dd0 0x7f97ac067290 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97c00f55c0 0x7f97c010c070 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 --2- 172.21.15.96:0/785004608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c00f6860 0x7f97c010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 >> 172.21.15.96:0/785004608 conn(0x7f97c00f0d40 msgr2=0x7f97c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 shutdown_connections 2022-02-02T20:24:03.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.538+0000 7f97c7488700 1 -- 172.21.15.96:0/785004608 wait complete. 2022-02-02T20:24:03.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 -- 172.21.15.96:0/3266313798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f6880 msgr2=0x7f1c000f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 --2- 172.21.15.96:0/3266313798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f6880 0x7f1c000f6ce0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f1bfc004660 tx=0x7f1bfc009b30).stop 2022-02-02T20:24:03.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 -- 172.21.15.96:0/3266313798 shutdown_connections 2022-02-02T20:24:03.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 --2- 172.21.15.96:0/3266313798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f6880 0x7f1c000f6ce0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 --2- 172.21.15.96:0/3266313798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f55e0 0x7f1c000f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 -- 172.21.15.96:0/3266313798 >> 172.21.15.96:0/3266313798 conn(0x7f1c000f0d40 msgr2=0x7f1c000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 -- 172.21.15.96:0/3266313798 shutdown_connections 2022-02-02T20:24:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.634+0000 7f1c086ce700 1 -- 172.21.15.96:0/3266313798 wait complete. 2022-02-02T20:24:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 Processor -- start 2022-02-02T20:24:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 -- start start 2022-02-02T20:24:03.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 0x7f1c000fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000fc140 con 0x7f1c000f55e0 2022-02-02T20:24:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c086ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000fc280 con 0x7f1c000f6880 2022-02-02T20:24:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c0646a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c0646a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36878/0 (socket says 172.21.15.96:36878) 2022-02-02T20:24:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c0646a700 1 -- 172.21.15.96:0/1418646629 learned_addr learned my addr 172.21.15.96:0/1418646629 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.635+0000 7f1c05c69700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 0x7f1c000fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c0646a700 1 -- 172.21.15.96:0/1418646629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 msgr2=0x7f1c000fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c0646a700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 0x7f1c000fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c0646a700 1 -- 172.21.15.96:0/1418646629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc005040 con 0x7f1c000f55e0 2022-02-02T20:24:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c05c69700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 0x7f1c000fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:24:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c0646a700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f1bf000c530 tx=0x7f1bf0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf000f650 con 0x7f1c000f55e0 2022-02-02T20:24:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1bf000fc60 con 0x7f1c000f55e0 2022-02-02T20:24:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000fc560 con 0x7f1c000f55e0 2022-02-02T20:24:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf0012d20 con 0x7f1c000f55e0 2022-02-02T20:24:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.636+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0010ef80 con 0x7f1c000f55e0 2022-02-02T20:24:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.637+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00045ad0 con 0x7f1c000f55e0 2022-02-02T20:24:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.637+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1bf0019030 con 0x7f1c000f55e0 2022-02-02T20:24:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.638+0000 7f1bf6ffd700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 0x7f1bec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.638+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1bf00816b0 con 0x7f1c000f55e0 2022-02-02T20:24:03.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.638+0000 7f1c05c69700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 0x7f1bec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.638+0000 7f1c05c69700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 0x7f1bec067290 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f1bfc004e30 tx=0x7f1bfc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.642+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1bf004f800 con 0x7f1c000f55e0 2022-02-02T20:24:03.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.870+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c000ff020 con 0x7f1c000f55e0 2022-02-02T20:24:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.870+0000 7f1bf6ffd700 1 -- 172.21.15.96:0/1418646629 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1bf0052e20 con 0x7f1c000f55e0 2022-02-02T20:24:03.873 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:24:03.874 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:24:03.874 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:24:03.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:03.874 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:24:03.875 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:24:03.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:03.875 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:24:03.875 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:24:03.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:03.876 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:24:03.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:24:03.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:03.876 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:24:03.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:24:03.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:24:03.877 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:24:03.877 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:24:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 msgr2=0x7f1bec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 0x7f1bec067290 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f1bfc004e30 tx=0x7f1bfc009b30).stop 2022-02-02T20:24:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 msgr2=0x7f1c000fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f1bf000c530 tx=0x7f1bf0007e10).stop 2022-02-02T20:24:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 shutdown_connections 2022-02-02T20:24:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1bec064dd0 0x7f1bec067290 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c000f55e0 0x7f1c000fd760 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 --2- 172.21.15.96:0/1418646629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c000f6880 0x7f1c000fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 >> 172.21.15.96:0/1418646629 conn(0x7f1c000f0d40 msgr2=0x7f1c000fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 shutdown_connections 2022-02-02T20:24:03.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.872+0000 7f1c086ce700 1 -- 172.21.15.96:0/1418646629 wait complete. 2022-02-02T20:24:03.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 -- 172.21.15.96:0/2739836065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 msgr2=0x7faec80f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 --2- 172.21.15.96:0/2739836065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec80f7d20 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7faec4004660 tx=0x7faec4009b30).stop 2022-02-02T20:24:03.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 -- 172.21.15.96:0/2739836065 shutdown_connections 2022-02-02T20:24:03.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 --2- 172.21.15.96:0/2739836065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec80f7d20 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 --2- 172.21.15.96:0/2739836065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 0x7faec80f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 -- 172.21.15.96:0/2739836065 >> 172.21.15.96:0/2739836065 conn(0x7faec80f04c0 msgr2=0x7faec80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:03.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 -- 172.21.15.96:0/2739836065 shutdown_connections 2022-02-02T20:24:03.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.969+0000 7faed00df700 1 -- 172.21.15.96:0/2739836065 wait complete. 2022-02-02T20:24:03.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 Processor -- start 2022-02-02T20:24:03.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 -- start start 2022-02-02T20:24:03.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 0x7faec8107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8107ce0 con 0x7faec80f53e0 2022-02-02T20:24:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faed00df700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8107e20 con 0x7faec80f4a40 2022-02-02T20:24:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36890/0 (socket says 172.21.15.96:36890) 2022-02-02T20:24:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 -- 172.21.15.96:0/389144548 learned_addr learned my addr 172.21.15.96:0/389144548 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecde7b700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 0x7faec8107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 -- 172.21.15.96:0/389144548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 msgr2=0x7faec8107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 0x7faec8107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.970+0000 7faecd67a700 1 -- 172.21.15.96:0/389144548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4005040 con 0x7faec80f53e0 2022-02-02T20:24:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faecd67a700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7faec40043a0 tx=0x7faec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec4018070 con 0x7faec80f53e0 2022-02-02T20:24:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faec4007ba0 con 0x7faec80f53e0 2022-02-02T20:24:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8108760 con 0x7faec80f53e0 2022-02-02T20:24:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec401de30 con 0x7faec80f53e0 2022-02-02T20:24:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.971+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec8108cc0 con 0x7faec80f53e0 2022-02-02T20:24:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.972+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8045ad0 con 0x7faec80f53e0 2022-02-02T20:24:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.972+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faec401d420 con 0x7faec80f53e0 2022-02-02T20:24:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.973+0000 7faebe7fc700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 0x7faeb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:03.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.973+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faec40835f0 con 0x7faec80f53e0 2022-02-02T20:24:03.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.973+0000 7faecde7b700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 0x7faeb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:03.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.973+0000 7faecde7b700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 0x7faeb4067290 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7faeb8004c40 tx=0x7faeb800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:03.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:03.977+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faec40551e0 con 0x7faec80f53e0 2022-02-02T20:24:04.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.177+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faec80ff0f0 con 0x7faec80f53e0 2022-02-02T20:24:04.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.177+0000 7faebe7fc700 1 -- 172.21.15.96:0/389144548 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7faec4054dd0 con 0x7faec80f53e0 2022-02-02T20:24:04.181 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:24:04.182 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:24:04.182 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:24:04.183 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:24:04.183 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:04.183 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:24:04.184 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:24:04.185 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:24:04.185 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:24:04.185 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:24:04.185 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:24:04.186 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:24:04.186 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:24:04.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:24:04.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:24:04.187 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:24:04.187 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:24:04.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:24:04.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:24:04.187 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:24:04.188 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:24:04.188 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:24:04.188 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:24:04.188 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:24:04.189 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:24:04.189 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:24:04.189 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:24:04.189 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:24:04.189 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:24:04.190 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:24:04.190 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:24:04.190 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:24:04.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:04.191 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:04.191 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:24:04.191 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:04.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:04.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:04.192 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 msgr2=0x7faeb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 0x7faeb4067290 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7faeb8004c40 tx=0x7faeb800b040).stop 2022-02-02T20:24:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 msgr2=0x7faec8107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:04.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7faec40043a0 tx=0x7faec4009b30).stop 2022-02-02T20:24:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 shutdown_connections 2022-02-02T20:24:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faeb4064dd0 0x7faeb4067290 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faec80f4a40 0x7faec8107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 --2- 172.21.15.96:0/389144548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec80f53e0 0x7faec8107730 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:04.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 >> 172.21.15.96:0/389144548 conn(0x7faec80f04c0 msgr2=0x7faec80fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 shutdown_connections 2022-02-02T20:24:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:04.179+0000 7faed00df700 1 -- 172.21.15.96:0/389144548 wait complete. 2022-02-02T20:24:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:24:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:04 smithi096 ceph-mon[101353]: pgmap v3659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:04 smithi096 ceph-mon[101353]: from='client.37862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:04 smithi096 ceph-mon[101353]: from='client.37866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1418646629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:24:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:04 smithi159 ceph-mon[69013]: pgmap v3659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:04 smithi159 ceph-mon[69013]: from='client.37862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:04 smithi159 ceph-mon[69013]: from='client.37866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:04.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1418646629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:24:05.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/389144548' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:24:05.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/389144548' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:24:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:06 smithi159 ceph-mon[69013]: pgmap v3660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:06 smithi096 ceph-mon[101353]: pgmap v3660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:08.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:07 smithi159 ceph-mon[69013]: pgmap v3661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:07 smithi096 ceph-mon[101353]: pgmap v3661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:10 smithi159 ceph-mon[69013]: pgmap v3662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:10 smithi096 ceph-mon[101353]: pgmap v3662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:12 smithi159 ceph-mon[69013]: pgmap v3663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:12 smithi096 ceph-mon[101353]: pgmap v3663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:14 smithi159 ceph-mon[69013]: pgmap v3664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:14 smithi096 ceph-mon[101353]: pgmap v3664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:16 smithi159 ceph-mon[69013]: pgmap v3665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:16 smithi096 ceph-mon[101353]: pgmap v3665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:17 smithi159 ceph-mon[69013]: pgmap v3666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:17 smithi096 ceph-mon[101353]: pgmap v3666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:20 smithi159 ceph-mon[69013]: pgmap v3667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:20 smithi096 ceph-mon[101353]: pgmap v3667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:22 smithi159 ceph-mon[69013]: pgmap v3668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:22 smithi096 ceph-mon[101353]: pgmap v3668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:24 smithi159 ceph-mon[69013]: pgmap v3669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:24 smithi096 ceph-mon[101353]: pgmap v3669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:26 smithi159 ceph-mon[69013]: pgmap v3670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:26 smithi096 ceph-mon[101353]: pgmap v3670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:27 smithi159 ceph-mon[69013]: pgmap v3671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:24:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:24:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:27 smithi096 ceph-mon[101353]: pgmap v3671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:24:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:24:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:30 smithi159 ceph-mon[69013]: pgmap v3672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:30 smithi096 ceph-mon[101353]: pgmap v3672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:32 smithi159 ceph-mon[69013]: pgmap v3673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:32 smithi096 ceph-mon[101353]: pgmap v3673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 -- 172.21.15.96:0/3289155663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 msgr2=0x7fdca00f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 --2- 172.21.15.96:0/3289155663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f69b0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fdc90004660 tx=0x7fdc90009b30).stop 2022-02-02T20:24:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 -- 172.21.15.96:0/3289155663 shutdown_connections 2022-02-02T20:24:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 --2- 172.21.15.96:0/3289155663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f69b0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 --2- 172.21.15.96:0/3289155663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 0x7fdca00f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:24:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 -- 172.21.15.96:0/3289155663 >> 172.21.15.96:0/3289155663 conn(0x7fdca00f04c0 msgr2=0x7fdca00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 -- 172.21.15.96:0/3289155663 shutdown_connections 2022-02-02T20:24:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.285+0000 7fdca7736700 1 -- 172.21.15.96:0/3289155663 wait complete. 2022-02-02T20:24:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 Processor -- start 2022-02-02T20:24:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 -- start start 2022-02-02T20:24:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 0x7fdca00f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00f8330 con 0x7fdca00f6550 2022-02-02T20:24:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca7736700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00f8470 con 0x7fdca00f5bb0 2022-02-02T20:24:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36908/0 (socket says 172.21.15.96:36908) 2022-02-02T20:24:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 -- 172.21.15.96:0/2532043398 learned_addr learned my addr 172.21.15.96:0/2532043398 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca54d2700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 0x7fdca00f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 -- 172.21.15.96:0/2532043398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 msgr2=0x7fdca00f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 0x7fdca00f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.286+0000 7fdca4cd1700 1 -- 172.21.15.96:0/2532043398 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90005040 con 0x7fdca00f6550 2022-02-02T20:24:34.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdca4cd1700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fdc90009990 tx=0x7fdc90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc90018070 con 0x7fdca00f6550 2022-02-02T20:24:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc90007ba0 con 0x7fdca00f6550 2022-02-02T20:24:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00f86f0 con 0x7fdca00f6550 2022-02-02T20:24:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9001c620 con 0x7fdca00f6550 2022-02-02T20:24:34.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.287+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca010efd0 con 0x7fdca00f6550 2022-02-02T20:24:34.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.288+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0045ad0 con 0x7fdca00f6550 2022-02-02T20:24:34.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.288+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc9001c8e0 con 0x7fdca00f6550 2022-02-02T20:24:34.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.289+0000 7fdc95ffb700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 0x7fdc8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.289+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc90083850 con 0x7fdca00f6550 2022-02-02T20:24:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.289+0000 7fdca54d2700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 0x7fdc8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.289+0000 7fdca54d2700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 0x7fdc8c067290 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fdca00f9650 tx=0x7fdc9c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.293+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc90051950 con 0x7fdca00f6550 2022-02-02T20:24:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.469+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdca00fae40 con 0x7fdc8c064dd0 2022-02-02T20:24:34.473 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:34 smithi096 ceph-mon[101353]: pgmap v3674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.471+0000 7fdc95ffb700 1 -- 172.21.15.96:0/2532043398 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdca00fae40 con 0x7fdc8c064dd0 2022-02-02T20:24:34.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 msgr2=0x7fdc8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 0x7fdc8c067290 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fdca00f9650 tx=0x7fdc9c008040).stop 2022-02-02T20:24:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 msgr2=0x7fdca00f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fdc90009990 tx=0x7fdc90009b30).stop 2022-02-02T20:24:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 shutdown_connections 2022-02-02T20:24:34.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc8c064dd0 0x7fdc8c067290 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdca00f5bb0 0x7fdca00f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 --2- 172.21.15.96:0/2532043398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdca00f6550 0x7fdca00f7d40 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.472+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 >> 172.21.15.96:0/2532043398 conn(0x7fdca00f04c0 msgr2=0x7fdca00f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.473+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 shutdown_connections 2022-02-02T20:24:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.473+0000 7fdca7736700 1 -- 172.21.15.96:0/2532043398 wait complete. 2022-02-02T20:24:34.485 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:24:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:34 smithi159 ceph-mon[69013]: pgmap v3674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 -- 172.21.15.96:0/55619149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 msgr2=0x7f17900f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 --2- 172.21.15.96:0/55619149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f17900f5850 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f1780004660 tx=0x7f1780009b30).stop 2022-02-02T20:24:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 -- 172.21.15.96:0/55619149 shutdown_connections 2022-02-02T20:24:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 --2- 172.21.15.96:0/55619149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f17900f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 --2- 172.21.15.96:0/55619149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f17900f5850 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.569+0000 7f178ffff700 1 -- 172.21.15.96:0/55619149 >> 172.21.15.96:0/55619149 conn(0x7f17900f0b90 msgr2=0x7f17900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.570+0000 7f178ffff700 1 -- 172.21.15.96:0/55619149 shutdown_connections 2022-02-02T20:24:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.570+0000 7f178ffff700 1 -- 172.21.15.96:0/55619149 wait complete. 2022-02-02T20:24:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.570+0000 7f178ffff700 1 Processor -- start 2022-02-02T20:24:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.570+0000 7f178ffff700 1 -- start start 2022-02-02T20:24:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f179010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900603c0 con 0x7f17900f5430 2022-02-02T20:24:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790060500 con 0x7f17900f66d0 2022-02-02T20:24:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36916/0 (socket says 172.21.15.96:36916) 2022-02-02T20:24:34.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 -- 172.21.15.96:0/477454226 learned_addr learned my addr 172.21.15.96:0/477454226 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:34.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178e7fc700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f179010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 -- 172.21.15.96:0/477454226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 msgr2=0x7f179010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f179010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 -- 172.21.15.96:0/477454226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780005040 con 0x7f17900f5430 2022-02-02T20:24:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178e7fc700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f179010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:24:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178effd700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f1780013a70 tx=0x7f1780009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1780018070 con 0x7f17900f5430 2022-02-02T20:24:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179010c490 con 0x7f17900f5430 2022-02-02T20:24:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f17800097d0 con 0x7f17900f5430 2022-02-02T20:24:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178001c3c0 con 0x7f17900f5430 2022-02-02T20:24:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.571+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179010c9c0 con 0x7f17900f5430 2022-02-02T20:24:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.572+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790059100 con 0x7f17900f5430 2022-02-02T20:24:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.573+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1780007ba0 con 0x7f17900f5430 2022-02-02T20:24:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.573+0000 7f17777fe700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 0x7f17780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.573+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1780083720 con 0x7f17900f5430 2022-02-02T20:24:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.573+0000 7f178e7fc700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 0x7f17780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.574+0000 7f178e7fc700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 0x7f17780672e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f1784009740 tx=0x7f1784009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.577+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1780051820 con 0x7f17900f5430 2022-02-02T20:24:34.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.749+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f17900fdd70 con 0x7f1778064e20 2022-02-02T20:24:34.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.758+0000 7f17777fe700 1 -- 172.21.15.96:0/477454226 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f17900fdd70 con 0x7f1778064e20 2022-02-02T20:24:34.761 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:24:34.762 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 98m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:24:34.762 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 98m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:24:34.762 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 96m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:24:34.762 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 98m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:24:34.763 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 98m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:24:34.763 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 98m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:24:34.763 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 96m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:24:34.763 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 96m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:24:34.763 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 98m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:24:34.764 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 96m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:24:34.764 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 98m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:24:34.764 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 96m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:24:34.764 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 98m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:24:34.765 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 96m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:24:34.765 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 98m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:24:34.765 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (119m) 98m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:24:34.765 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (118m) 98m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:24:34.765 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (118m) 96m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:24:34.766 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (117m) 96m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:24:34.766 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (117m) 96m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:24:34.766 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 98m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:24:34.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 msgr2=0x7f17780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 0x7f17780672e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f1784009740 tx=0x7f1784009be0).stop 2022-02-02T20:24:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 msgr2=0x7f1790109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f1780013a70 tx=0x7f1780009b30).stop 2022-02-02T20:24:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 shutdown_connections 2022-02-02T20:24:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064e20 0x7f17780672e0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17900f5430 0x7f1790109a40 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 --2- 172.21.15.96:0/477454226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17900f66d0 0x7f179010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 >> 172.21.15.96:0/477454226 conn(0x7f17900f0b90 msgr2=0x7f17900fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:34.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 shutdown_connections 2022-02-02T20:24:34.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.761+0000 7f178ffff700 1 -- 172.21.15.96:0/477454226 wait complete. 2022-02-02T20:24:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 -- 172.21.15.96:0/1213629138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 msgr2=0x7f31140f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 --2- 172.21.15.96:0/1213629138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f31140f6cd0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f3108004660 tx=0x7f3108009b30).stop 2022-02-02T20:24:34.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 -- 172.21.15.96:0/1213629138 shutdown_connections 2022-02-02T20:24:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 --2- 172.21.15.96:0/1213629138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f31140f6cd0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 --2- 172.21.15.96:0/1213629138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 0x7f31140f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 -- 172.21.15.96:0/1213629138 >> 172.21.15.96:0/1213629138 conn(0x7f31140f0d70 msgr2=0x7f31140f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:34.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 -- 172.21.15.96:0/1213629138 shutdown_connections 2022-02-02T20:24:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.857+0000 7f3119295700 1 -- 172.21.15.96:0/1213629138 wait complete. 2022-02-02T20:24:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 Processor -- start 2022-02-02T20:24:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 -- start start 2022-02-02T20:24:34.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 0x7f3114106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31141079d0 con 0x7f31140f6870 2022-02-02T20:24:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f3119295700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3114107b10 con 0x7f31140f55d0 2022-02-02T20:24:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f31127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f31127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36928/0 (socket says 172.21.15.96:36928) 2022-02-02T20:24:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.858+0000 7f31127fc700 1 -- 172.21.15.96:0/569718682 learned_addr learned my addr 172.21.15.96:0/569718682 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f3112ffd700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 0x7f3114106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f31127fc700 1 -- 172.21.15.96:0/569718682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 msgr2=0x7f3114106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:34.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f31127fc700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 0x7f3114106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f31127fc700 1 -- 172.21.15.96:0/569718682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108005040 con 0x7f31140f6870 2022-02-02T20:24:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f31127fc700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f3108009990 tx=0x7f3108009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3108018070 con 0x7f31140f6870 2022-02-02T20:24:34.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3108007ba0 con 0x7f31140f6870 2022-02-02T20:24:34.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3114108450 con 0x7f31140f6870 2022-02-02T20:24:34.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f310801c3c0 con 0x7f31140f6870 2022-02-02T20:24:34.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.859+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31141089b0 con 0x7f31140f6870 2022-02-02T20:24:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.860+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3114045ad0 con 0x7f31140f6870 2022-02-02T20:24:34.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.861+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f310801d420 con 0x7f31140f6870 2022-02-02T20:24:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.861+0000 7f30fb7fe700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 0x7f30fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.861+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3108083a20 con 0x7f31140f6870 2022-02-02T20:24:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.861+0000 7f3112ffd700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 0x7f30fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:34.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.862+0000 7f3112ffd700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 0x7f30fc067290 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f31140f66d0 tx=0x7f310400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:34.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:34.865+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3108055490 con 0x7f31140f6870 2022-02-02T20:24:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.096+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31141090b0 con 0x7f31140f6870 2022-02-02T20:24:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.096+0000 7f30fb7fe700 1 -- 172.21.15.96:0/569718682 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3108055080 con 0x7f31140f6870 2022-02-02T20:24:35.100 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:24:35.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:24:35.101 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:24:35.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:35.102 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:24:35.103 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:24:35.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:35.103 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:24:35.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:24:35.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:35.105 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:24:35.105 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:24:35.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:24:35.105 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:24:35.106 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:24:35.106 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:24:35.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:24:35.107 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:24:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 msgr2=0x7f30fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 0x7f30fc067290 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f31140f66d0 tx=0x7f310400b040).stop 2022-02-02T20:24:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 msgr2=0x7f3114107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f3108009990 tx=0x7f3108009b30).stop 2022-02-02T20:24:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 shutdown_connections 2022-02-02T20:24:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30fc064dd0 0x7f30fc067290 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31140f55d0 0x7f3114106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 --2- 172.21.15.96:0/569718682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31140f6870 0x7f3114107420 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 >> 172.21.15.96:0/569718682 conn(0x7f31140f0d70 msgr2=0x7f311405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.098+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 shutdown_connections 2022-02-02T20:24:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.099+0000 7f3119295700 1 -- 172.21.15.96:0/569718682 wait complete. 2022-02-02T20:24:35.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 -- 172.21.15.96:0/1826193370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f7d00 msgr2=0x7f13280f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 --2- 172.21.15.96:0/1826193370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f7d00 0x7f13280f8120 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f131c004660 tx=0x7f131c009b30).stop 2022-02-02T20:24:35.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 -- 172.21.15.96:0/1826193370 shutdown_connections 2022-02-02T20:24:35.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 --2- 172.21.15.96:0/1826193370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f8610 0x7f13280f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 --2- 172.21.15.96:0/1826193370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f7d00 0x7f13280f8120 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 -- 172.21.15.96:0/1826193370 >> 172.21.15.96:0/1826193370 conn(0x7f13280f0540 msgr2=0x7f13280f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 -- 172.21.15.96:0/1826193370 shutdown_connections 2022-02-02T20:24:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.198+0000 7f132e9e7700 1 -- 172.21.15.96:0/1826193370 wait complete. 2022-02-02T20:24:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 Processor -- start 2022-02-02T20:24:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 -- start start 2022-02-02T20:24:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f7d00 0x7f1328106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1328107a10 con 0x7f13280f8610 2022-02-02T20:24:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f132e9e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1328107b50 con 0x7f13280f7d00 2022-02-02T20:24:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f13277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f13277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36938/0 (socket says 172.21.15.96:36938) 2022-02-02T20:24:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f13277fe700 1 -- 172.21.15.96:0/468307957 learned_addr learned my addr 172.21.15.96:0/468307957 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:24:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.199+0000 7f1327fff700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f7d00 0x7f1328106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f13277fe700 1 -- 172.21.15.96:0/468307957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f7d00 msgr2=0x7f1328106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f13277fe700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f7d00 0x7f1328106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f13277fe700 1 -- 172.21.15.96:0/468307957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c005040 con 0x7f13280f8610 2022-02-02T20:24:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f13277fe700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f131800c530 tx=0x7f1318007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f131800f650 con 0x7f13280f8610 2022-02-02T20:24:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13281084f0 con 0x7f13280f8610 2022-02-02T20:24:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f131800fc60 con 0x7f13280f8610 2022-02-02T20:24:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1318012c20 con 0x7f13280f8610 2022-02-02T20:24:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.200+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328108ab0 con 0x7f13280f8610 2022-02-02T20:24:35.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.201+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1328045ad0 con 0x7f13280f8610 2022-02-02T20:24:35.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.202+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1318010070 con 0x7f13280f8610 2022-02-02T20:24:35.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.202+0000 7f1324ff9700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 0x7f1310067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:24:35.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.202+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f13180816b0 con 0x7f13280f8610 2022-02-02T20:24:35.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.202+0000 7f1327fff700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 0x7f1310067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:24:35.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.202+0000 7f1327fff700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 0x7f1310067290 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f131c004630 tx=0x7f131c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:24:35.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.206+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13180531e0 con 0x7f13280f8610 2022-02-02T20:24:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.407+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13280fefb0 con 0x7f13280f8610 2022-02-02T20:24:35.410 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:35 smithi096 ceph-mon[101353]: from='client.37878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:35.410 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/569718682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:24:35.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.407+0000 7f1324ff9700 1 -- 172.21.15.96:0/468307957 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1318052dd0 con 0x7f13280f8610 2022-02-02T20:24:35.411 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:24:35.412 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:24:35.412 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:24:35.412 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:24:35.412 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:35.413 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:24:35.413 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:24:35.413 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:24:35.413 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:24:35.413 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:24:35.414 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:24:35.414 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:24:35.414 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:24:35.414 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:24:35.415 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:24:35.415 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:24:35.415 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:24:35.415 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:24:35.416 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:24:35.416 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:24:35.416 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:24:35.417 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:24:35.417 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:24:35.417 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:24:35.417 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:24:35.418 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:24:35.418 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:24:35.418 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:24:35.418 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:24:35.418 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:24:35.419 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:24:35.419 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:24:35.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:35.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:35.420 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:24:35.420 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:24:35.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:35.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:35.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:24:35.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 msgr2=0x7f1310067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 0x7f1310067290 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f131c004630 tx=0x7f131c009b30).stop 2022-02-02T20:24:35.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 msgr2=0x7f1328107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:24:35.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f131800c530 tx=0x7f1318007e20).stop 2022-02-02T20:24:35.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 shutdown_connections 2022-02-02T20:24:35.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1310064dd0 0x7f1310067290 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13280f7d00 0x7f1328106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 --2- 172.21.15.96:0/468307957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13280f8610 0x7f1328107460 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:24:35.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 >> 172.21.15.96:0/468307957 conn(0x7f13280f0540 msgr2=0x7f13280fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:24:35.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 shutdown_connections 2022-02-02T20:24:35.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:24:35.409+0000 7f132e9e7700 1 -- 172.21.15.96:0/468307957 wait complete. 2022-02-02T20:24:35.424 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:24:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:35 smithi159 ceph-mon[69013]: from='client.37878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:35.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/569718682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:24:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:36 smithi159 ceph-mon[69013]: from='client.37882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:36 smithi159 ceph-mon[69013]: pgmap v3675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:36.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/468307957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:24:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:36 smithi096 ceph-mon[101353]: from='client.37882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:24:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:36 smithi096 ceph-mon[101353]: pgmap v3675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/468307957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:24:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:37 smithi159 ceph-mon[69013]: pgmap v3676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:37 smithi096 ceph-mon[101353]: pgmap v3676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:40 smithi159 ceph-mon[69013]: pgmap v3677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:40 smithi096 ceph-mon[101353]: pgmap v3677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:42 smithi159 ceph-mon[69013]: pgmap v3678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:42 smithi096 ceph-mon[101353]: pgmap v3678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:44 smithi159 ceph-mon[69013]: pgmap v3679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:44 smithi096 ceph-mon[101353]: pgmap v3679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:46 smithi159 ceph-mon[69013]: pgmap v3680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:46 smithi096 ceph-mon[101353]: pgmap v3680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:47 smithi159 ceph-mon[69013]: pgmap v3681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:47 smithi096 ceph-mon[101353]: pgmap v3681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:50 smithi159 ceph-mon[69013]: pgmap v3682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:50 smithi096 ceph-mon[101353]: pgmap v3682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:52 smithi159 ceph-mon[69013]: pgmap v3683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:52 smithi096 ceph-mon[101353]: pgmap v3683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:54.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:54 smithi159 ceph-mon[69013]: pgmap v3684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:54 smithi096 ceph-mon[101353]: pgmap v3684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:56 smithi159 ceph-mon[69013]: pgmap v3685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:56 smithi096 ceph-mon[101353]: pgmap v3685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:24:57 smithi159 ceph-mon[69013]: pgmap v3686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:24:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:24:57 smithi096 ceph-mon[101353]: pgmap v3686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:00 smithi159 ceph-mon[69013]: pgmap v3687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:00 smithi096 ceph-mon[101353]: pgmap v3687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:02 smithi159 ceph-mon[69013]: pgmap v3688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:02 smithi096 ceph-mon[101353]: pgmap v3688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:04 smithi159 ceph-mon[69013]: pgmap v3689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:04 smithi096 ceph-mon[101353]: pgmap v3689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 -- 172.21.15.96:0/3685186893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f55c0 msgr2=0x7fc5540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3685186893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f55c0 0x7fc5540f59e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fc548004660 tx=0x7fc548009b30).stop 2022-02-02T20:25:05.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 -- 172.21.15.96:0/3685186893 shutdown_connections 2022-02-02T20:25:05.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3685186893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f6860 0x7fc5540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3685186893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f55c0 0x7fc5540f59e0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.521+0000 7fc55aaab700 1 -- 172.21.15.96:0/3685186893 >> 172.21.15.96:0/3685186893 conn(0x7fc5540f0d40 msgr2=0x7fc5540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:05.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 -- 172.21.15.96:0/3685186893 shutdown_connections 2022-02-02T20:25:05.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 -- 172.21.15.96:0/3685186893 wait complete. 2022-02-02T20:25:05.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 Processor -- start 2022-02-02T20:25:05.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 -- start start 2022-02-02T20:25:05.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f55c0 0x7fc554109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540603e0 con 0x7fc5540f6860 2022-02-02T20:25:05.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.522+0000 7fc55aaab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc554060520 con 0x7fc5540f55c0 2022-02-02T20:25:05.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36954/0 (socket says 172.21.15.96:36954) 2022-02-02T20:25:05.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 -- 172.21.15.96:0/3316774085 learned_addr learned my addr 172.21.15.96:0/3316774085 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:05.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc558847700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f55c0 0x7fc554109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 -- 172.21.15.96:0/3316774085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f55c0 msgr2=0x7fc554109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f55c0 0x7fc554109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 -- 172.21.15.96:0/3316774085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548005040 con 0x7fc5540f6860 2022-02-02T20:25:05.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc553fff700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fc5400026d0 tx=0x7fc540009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:05.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5400079c0 con 0x7fc5540f6860 2022-02-02T20:25:05.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc54000f040 con 0x7fc5540f6860 2022-02-02T20:25:05.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55410c720 con 0x7fc5540f6860 2022-02-02T20:25:05.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5400148b0 con 0x7fc5540f6860 2022-02-02T20:25:05.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.523+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55410cce0 con 0x7fc5540f6860 2022-02-02T20:25:05.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.524+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc554045ad0 con 0x7fc5540f6860 2022-02-02T20:25:05.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.525+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc540007b20 con 0x7fc5540f6860 2022-02-02T20:25:05.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.525+0000 7fc5517fa700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 0x7fc544067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.525+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc5400819e0 con 0x7fc5540f6860 2022-02-02T20:25:05.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.525+0000 7fc558847700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 0x7fc544067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.526+0000 7fc558847700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 0x7fc544067290 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fc548013690 tx=0x7fc548009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:05.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.530+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc54004fae0 con 0x7fc5540f6860 2022-02-02T20:25:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.709+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5540fdef0 con 0x7fc544064dd0 2022-02-02T20:25:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.711+0000 7fc5517fa700 1 -- 172.21.15.96:0/3316774085 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5540fdef0 con 0x7fc544064dd0 2022-02-02T20:25:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 msgr2=0x7fc544067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 0x7fc544067290 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fc548013690 tx=0x7fc548009b30).stop 2022-02-02T20:25:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 msgr2=0x7fc55410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fc5400026d0 tx=0x7fc540009de0).stop 2022-02-02T20:25:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 shutdown_connections 2022-02-02T20:25:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc544064dd0 0x7fc544067290 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5540f55c0 0x7fc554109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 --2- 172.21.15.96:0/3316774085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540f6860 0x7fc55410c170 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.712+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 >> 172.21.15.96:0/3316774085 conn(0x7fc5540f0d40 msgr2=0x7fc5540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.713+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 shutdown_connections 2022-02-02T20:25:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.713+0000 7fc55aaab700 1 -- 172.21.15.96:0/3316774085 wait complete. 2022-02-02T20:25:05.724 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:25:05.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 -- 172.21.15.96:0/2798645402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 msgr2=0x7fbb8c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 --2- 172.21.15.96:0/2798645402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c0f6b40 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7fbb88004660 tx=0x7fbb88009b30).stop 2022-02-02T20:25:05.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 -- 172.21.15.96:0/2798645402 shutdown_connections 2022-02-02T20:25:05.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 --2- 172.21.15.96:0/2798645402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c0f6b40 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 --2- 172.21.15.96:0/2798645402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 0x7fbb8c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 -- 172.21.15.96:0/2798645402 >> 172.21.15.96:0/2798645402 conn(0x7fbb8c0f0ba0 msgr2=0x7fbb8c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:05.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 -- 172.21.15.96:0/2798645402 shutdown_connections 2022-02-02T20:25:05.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.810+0000 7fbb92a04700 1 -- 172.21.15.96:0/2798645402 wait complete. 2022-02-02T20:25:05.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 Processor -- start 2022-02-02T20:25:05.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 -- start start 2022-02-02T20:25:05.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 0x7fbb8c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0603c0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb92a04700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c060500 con 0x7fbb8c0f5440 2022-02-02T20:25:05.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91201700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91201700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36964/0 (socket says 172.21.15.96:36964) 2022-02-02T20:25:05.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91201700 1 -- 172.21.15.96:0/759733449 learned_addr learned my addr 172.21.15.96:0/759733449 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:05.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91a02700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 0x7fbb8c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91201700 1 -- 172.21.15.96:0/759733449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 msgr2=0x7fbb8c109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:05.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.811+0000 7fbb91201700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 0x7fbb8c109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:05.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb91201700 1 -- 172.21.15.96:0/759733449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88005040 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb91201700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7fbb88009990 tx=0x7fbb88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:05.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88018070 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb88007ba0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8801c3c0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c10c500 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.812+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c10c9e0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.813+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c045ad0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.813+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb8801d420 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.814+0000 7fbb827fc700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 0x7fbb780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:05.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.814+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbb880836c0 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.814+0000 7fbb91a02700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 0x7fbb780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:05.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.814+0000 7fbb91a02700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 0x7fbb780672e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fbb8c060040 tx=0x7fbb7c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:05.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.818+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb88051820 con 0x7fbb8c0f66e0 2022-02-02T20:25:05.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.990+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb8c057f10 con 0x7fbb78064e20 2022-02-02T20:25:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:05.999+0000 7fbb827fc700 1 -- 172.21.15.96:0/759733449 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fbb8c057f10 con 0x7fbb78064e20 2022-02-02T20:25:06.001 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:25:06.001 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 99m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:25:06.001 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 99m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:25:06.001 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 97m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:25:06.002 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 99m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:25:06.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 99m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:25:06.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 99m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:25:06.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 97m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:25:06.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 97m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:25:06.003 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 99m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:25:06.003 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 97m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:25:06.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 99m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:25:06.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 97m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:25:06.004 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 99m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:25:06.004 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 97m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:25:06.004 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 99m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:25:06.004 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (119m) 99m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:25:06.004 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (119m) 99m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:25:06.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (118m) 97m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:25:06.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (118m) 97m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:25:06.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (117m) 97m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:25:06.005 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 99m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:25:06.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 msgr2=0x7fbb780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 0x7fbb780672e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fbb8c060040 tx=0x7fbb7c00b040).stop 2022-02-02T20:25:06.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 msgr2=0x7fbb8c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7fbb88009990 tx=0x7fbb88009b30).stop 2022-02-02T20:25:06.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 shutdown_connections 2022-02-02T20:25:06.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb78064e20 0x7fbb780672e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb8c0f5440 0x7fbb8c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 --2- 172.21.15.96:0/759733449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb8c0f66e0 0x7fbb8c10bfb0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 >> 172.21.15.96:0/759733449 conn(0x7fbb8c0f0ba0 msgr2=0x7fbb8c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 shutdown_connections 2022-02-02T20:25:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.001+0000 7fbb92a04700 1 -- 172.21.15.96:0/759733449 wait complete. 2022-02-02T20:25:06.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 -- 172.21.15.96:0/3641006057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 msgr2=0x7fc3300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 --2- 172.21.15.96:0/3641006057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc3300f59e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fc320004660 tx=0x7fc320009b30).stop 2022-02-02T20:25:06.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 -- 172.21.15.96:0/3641006057 shutdown_connections 2022-02-02T20:25:06.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 --2- 172.21.15.96:0/3641006057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f6860 0x7fc3300f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:25:06.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 --2- 172.21.15.96:0/3641006057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc3300f59e0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 -- 172.21.15.96:0/3641006057 >> 172.21.15.96:0/3641006057 conn(0x7fc3300f0d40 msgr2=0x7fc3300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:06.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 -- 172.21.15.96:0/3641006057 shutdown_connections 2022-02-02T20:25:06.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.098+0000 7fc335292700 1 -- 172.21.15.96:0/3641006057 wait complete. 2022-02-02T20:25:06.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 Processor -- start 2022-02-02T20:25:06.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 -- start start 2022-02-02T20:25:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc330109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330060470 con 0x7fc3300f6860 2022-02-02T20:25:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc335292700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300605b0 con 0x7fc3300f55c0 2022-02-02T20:25:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc32e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc32e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36974/0 (socket says 172.21.15.96:36974) 2022-02-02T20:25:06.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc32e7fc700 1 -- 172.21.15.96:0/3273442102 learned_addr learned my addr 172.21.15.96:0/3273442102 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:06.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.099+0000 7fc32effd700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc330109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc32e7fc700 1 -- 172.21.15.96:0/3273442102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 msgr2=0x7fc330109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc32e7fc700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc330109cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc32e7fc700 1 -- 172.21.15.96:0/3273442102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320005040 con 0x7fc3300f6860 2022-02-02T20:25:06.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc32effd700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc330109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:25:06.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc32e7fc700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fc32400b410 tx=0x7fc324006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:06.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3240125f0 con 0x7fc3300f6860 2022-02-02T20:25:06.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33010c820 con 0x7fc3300f6860 2022-02-02T20:25:06.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc324012c00 con 0x7fc3300f6860 2022-02-02T20:25:06.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc324002ae0 con 0x7fc3300f6860 2022-02-02T20:25:06.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.100+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33010cdb0 con 0x7fc3300f6860 2022-02-02T20:25:06.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.101+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310004fa0 con 0x7fc3300f6860 2022-02-02T20:25:06.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.102+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc32400f030 con 0x7fc3300f6860 2022-02-02T20:25:06.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.102+0000 7fc3177fe700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.102+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc324081d50 con 0x7fc3300f6860 2022-02-02T20:25:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.102+0000 7fc32effd700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.103+0000 7fc32effd700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc320004e30 tx=0x7fc320009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.106+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc32404fe50 con 0x7fc3300f6860 2022-02-02T20:25:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.338+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc310005e80 con 0x7fc3300f6860 2022-02-02T20:25:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.338+0000 7fc3177fe700 1 -- 172.21.15.96:0/3273442102 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc324053470 con 0x7fc3300f6860 2022-02-02T20:25:06.340 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:25:06.341 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:25:06.341 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:25:06.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:06.341 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:25:06.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:25:06.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:06.342 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:25:06.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:25:06.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:25:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:25:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:25:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:25:06.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:25:06.344 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:25:06.344 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:25:06.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 msgr2=0x7fc318067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc320004e30 tx=0x7fc320009b30).stop 2022-02-02T20:25:06.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 msgr2=0x7fc33010c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fc32400b410 tx=0x7fc324006ef0).stop 2022-02-02T20:25:06.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 shutdown_connections 2022-02-02T20:25:06.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc330109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 --2- 172.21.15.96:0/3273442102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f6860 0x7fc33010c1c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 >> 172.21.15.96:0/3273442102 conn(0x7fc3300f0d40 msgr2=0x7fc3300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:06.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 shutdown_connections 2022-02-02T20:25:06.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.340+0000 7fc335292700 1 -- 172.21.15.96:0/3273442102 wait complete. 2022-02-02T20:25:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 -- 172.21.15.96:0/3374038815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f7980 msgr2=0x7f003c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 --2- 172.21.15.96:0/3374038815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f7980 0x7f003c0f7de0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f0030004660 tx=0x7f0030009b30).stop 2022-02-02T20:25:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 -- 172.21.15.96:0/3374038815 shutdown_connections 2022-02-02T20:25:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 --2- 172.21.15.96:0/3374038815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f7980 0x7f003c0f7de0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 --2- 172.21.15.96:0/3374038815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f66e0 0x7f003c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:25:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 -- 172.21.15.96:0/3374038815 >> 172.21.15.96:0/3374038815 conn(0x7f003c0f1e40 msgr2=0x7f003c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:06.441 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:06 smithi096 ceph-mon[101353]: pgmap v3690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:06.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.437+0000 7f0041d22700 1 -- 172.21.15.96:0/3374038815 shutdown_connections 2022-02-02T20:25:06.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.438+0000 7f0041d22700 1 -- 172.21.15.96:0/3374038815 wait complete. 2022-02-02T20:25:06.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.438+0000 7f0041d22700 1 Processor -- start 2022-02-02T20:25:06.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.438+0000 7f0041d22700 1 -- start start 2022-02-02T20:25:06.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f0041d22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f0041d22700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f7980 0x7f003c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f0041d22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c107ae0 con 0x7f003c0f66e0 2022-02-02T20:25:06.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f0041d22700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c108390 con 0x7f003c0f7980 2022-02-02T20:25:06.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36982/0 (socket says 172.21.15.96:36982) 2022-02-02T20:25:06.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 -- 172.21.15.96:0/3425160323 learned_addr learned my addr 172.21.15.96:0/3425160323 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:06.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003affd700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f7980 0x7f003c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 -- 172.21.15.96:0/3425160323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f7980 msgr2=0x7f003c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f7980 0x7f003c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 -- 172.21.15.96:0/3425160323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0030005040 con 0x7f003c0f66e0 2022-02-02T20:25:06.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f003b7fe700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f002c0093f0 tx=0x7f002c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:06.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.439+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f002c009ea0 con 0x7f003c0f66e0 2022-02-02T20:25:06.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.440+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f002c013af0 con 0x7f003c0f66e0 2022-02-02T20:25:06.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.440+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c108670 con 0x7f003c0f66e0 2022-02-02T20:25:06.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.440+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f002c00db10 con 0x7f003c0f66e0 2022-02-02T20:25:06.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.440+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c108c30 con 0x7f003c0f66e0 2022-02-02T20:25:06.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.441+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c0f5ad0 con 0x7f003c0f66e0 2022-02-02T20:25:06.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.441+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f002c01a060 con 0x7f003c0f66e0 2022-02-02T20:25:06.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.441+0000 7f0023fff700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 0x7f0024067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:06.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.442+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f002c081aa0 con 0x7f003c0f66e0 2022-02-02T20:25:06.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.442+0000 7f003affd700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 0x7f0024067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:06.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.442+0000 7f003affd700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 0x7f0024067290 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f0030004e30 tx=0x7f0030009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:06.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.446+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f002c0535d0 con 0x7f003c0f66e0 2022-02-02T20:25:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:06 smithi159 ceph-mon[69013]: pgmap v3690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:06.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.648+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f003c027a00 con 0x7f003c0f66e0 2022-02-02T20:25:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.648+0000 7f0023fff700 1 -- 172.21.15.96:0/3425160323 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f002c018020 con 0x7f003c0f66e0 2022-02-02T20:25:06.650 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:25:06.651 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:25:06.651 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:25:06.651 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:25:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:25:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:25:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:25:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:25:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:25:06.653 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:25:06.653 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:25:06.653 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:25:06.653 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:25:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:25:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:25:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:25:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:25:06.655 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:25:06.655 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:25:06.655 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:25:06.655 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:25:06.655 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:25:06.656 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:25:06.656 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:25:06.656 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:25:06.656 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:25:06.656 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:25:06.657 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:25:06.657 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:25:06.657 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:25:06.657 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:25:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:06.658 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:25:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:06.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:06.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:06.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:06.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 msgr2=0x7f0024067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 0x7f0024067290 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f0030004e30 tx=0x7f0030009b30).stop 2022-02-02T20:25:06.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 msgr2=0x7f003c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:06.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f002c0093f0 tx=0x7f002c006ec0).stop 2022-02-02T20:25:06.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 shutdown_connections 2022-02-02T20:25:06.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0024064dd0 0x7f0024067290 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f003c0f66e0 0x7f003c106fb0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 --2- 172.21.15.96:0/3425160323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f003c0f7980 0x7f003c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:06.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 >> 172.21.15.96:0/3425160323 conn(0x7f003c0f1e40 msgr2=0x7f003c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:06.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 shutdown_connections 2022-02-02T20:25:06.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:06.650+0000 7f0041d22700 1 -- 172.21.15.96:0/3425160323 wait complete. 2022-02-02T20:25:06.663 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:25:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:07 smithi159 ceph-mon[69013]: from='client.37894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:07.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:07 smithi159 ceph-mon[69013]: from='client.37898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:07.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3273442102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:25:07.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3425160323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:25:07.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:07 smithi096 ceph-mon[101353]: from='client.37894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:07.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:07 smithi096 ceph-mon[101353]: from='client.37898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:07.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3273442102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:25:07.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3425160323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:25:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:08 smithi159 ceph-mon[69013]: pgmap v3691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:08 smithi096 ceph-mon[101353]: pgmap v3691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:10 smithi159 ceph-mon[69013]: pgmap v3692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:10 smithi096 ceph-mon[101353]: pgmap v3692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:12 smithi159 ceph-mon[69013]: pgmap v3693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:12 smithi096 ceph-mon[101353]: pgmap v3693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:14 smithi159 ceph-mon[69013]: pgmap v3694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:14 smithi096 ceph-mon[101353]: pgmap v3694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:16 smithi159 ceph-mon[69013]: pgmap v3695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:16 smithi096 ceph-mon[101353]: pgmap v3695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:17 smithi159 ceph-mon[69013]: pgmap v3696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:17 smithi096 ceph-mon[101353]: pgmap v3696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:20 smithi159 ceph-mon[69013]: pgmap v3697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:20 smithi096 ceph-mon[101353]: pgmap v3697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:22 smithi159 ceph-mon[69013]: pgmap v3698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:22 smithi096 ceph-mon[101353]: pgmap v3698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:24 smithi159 ceph-mon[69013]: pgmap v3699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:24 smithi096 ceph-mon[101353]: pgmap v3699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:26 smithi159 ceph-mon[69013]: pgmap v3700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:26 smithi096 ceph-mon[101353]: pgmap v3700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:27 smithi159 ceph-mon[69013]: pgmap v3701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:25:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:25:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:27 smithi096 ceph-mon[101353]: pgmap v3701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:25:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:25:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:30 smithi159 ceph-mon[69013]: pgmap v3702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:30 smithi096 ceph-mon[101353]: pgmap v3702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:32 smithi159 ceph-mon[69013]: pgmap v3703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:32 smithi096 ceph-mon[101353]: pgmap v3703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:34 smithi159 ceph-mon[69013]: pgmap v3704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:34 smithi096 ceph-mon[101353]: pgmap v3704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:36 smithi159 ceph-mon[69013]: pgmap v3705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:36 smithi096 ceph-mon[101353]: pgmap v3705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:36.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 -- 172.21.15.96:0/249695910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 msgr2=0x7f8c100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:36.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 --2- 172.21.15.96:0/249695910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c100f59e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f8c04004660 tx=0x7f8c04009b30).stop 2022-02-02T20:25:36.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 -- 172.21.15.96:0/249695910 shutdown_connections 2022-02-02T20:25:36.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 --2- 172.21.15.96:0/249695910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f5ed0 0x7f8c100f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:25:36.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 --2- 172.21.15.96:0/249695910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c100f59e0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:36.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 -- 172.21.15.96:0/249695910 >> 172.21.15.96:0/249695910 conn(0x7f8c100f0de0 msgr2=0x7f8c100f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:36.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 -- 172.21.15.96:0/249695910 shutdown_connections 2022-02-02T20:25:36.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.762+0000 7f8c1561b700 1 -- 172.21.15.96:0/249695910 wait complete. 2022-02-02T20:25:36.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 Processor -- start 2022-02-02T20:25:36.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 -- start start 2022-02-02T20:25:36.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c10109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:36.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:36.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100605d0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.763+0000 7f8c1561b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10060710 con 0x7f8c100f55c0 2022-02-02T20:25:36.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:36.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37004/0 (socket says 172.21.15.96:37004) 2022-02-02T20:25:36.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 -- 172.21.15.96:0/1073701997 learned_addr learned my addr 172.21.15.96:0/1073701997 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:36.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0effd700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c10109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:36.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 -- 172.21.15.96:0/1073701997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 msgr2=0x7f8c10109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:36.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c10109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:36.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 -- 172.21.15.96:0/1073701997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04005040 con 0x7f8c100f5ed0 2022-02-02T20:25:36.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0effd700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c10109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:25:36.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c0e7fc700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f8c0000b410 tx=0x7f8c00006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:36.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c000125f0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1010c7b0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c00012c00 con 0x7f8c100f5ed0 2022-02-02T20:25:36.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c00002ae0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.764+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1010cd40 con 0x7f8c100f5ed0 2022-02-02T20:25:36.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.765+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c100f4a50 con 0x7f8c100f5ed0 2022-02-02T20:25:36.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.766+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c0000f030 con 0x7f8c100f5ed0 2022-02-02T20:25:36.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.766+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:36.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.766+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c00081ea0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.766+0000 7f8c0effd700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:36.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.766+0000 7f8c0effd700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f8c04004e30 tx=0x7f8c04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:36.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.770+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c0004ffa0 con 0x7f8c100f5ed0 2022-02-02T20:25:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.947+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c100fdf70 con 0x7f8bf8064dd0 2022-02-02T20:25:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.949+0000 7f8bf77fe700 1 -- 172.21.15.96:0/1073701997 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8c100fdf70 con 0x7f8bf8064dd0 2022-02-02T20:25:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 msgr2=0x7f8bf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f8c04004e30 tx=0x7f8c04009b30).stop 2022-02-02T20:25:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 msgr2=0x7f8c1010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f8c0000b410 tx=0x7f8c00006ef0).stop 2022-02-02T20:25:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 shutdown_connections 2022-02-02T20:25:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c10109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 --2- 172.21.15.96:0/1073701997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f5ed0 0x7f8c1010c150 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.950+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 >> 172.21.15.96:0/1073701997 conn(0x7f8c100f0de0 msgr2=0x7f8c100fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.951+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 shutdown_connections 2022-02-02T20:25:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:36.951+0000 7f8c1561b700 1 -- 172.21.15.96:0/1073701997 wait complete. 2022-02-02T20:25:36.962 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:25:37.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 -- 172.21.15.96:0/3706242422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 msgr2=0x7fb4880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 --2- 172.21.15.96:0/3706242422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb4880f59e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fb470004660 tx=0x7fb470009b30).stop 2022-02-02T20:25:37.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 -- 172.21.15.96:0/3706242422 shutdown_connections 2022-02-02T20:25:37.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 --2- 172.21.15.96:0/3706242422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 0x7fb4880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 --2- 172.21.15.96:0/3706242422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb4880f59e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 -- 172.21.15.96:0/3706242422 >> 172.21.15.96:0/3706242422 conn(0x7fb4880f0d40 msgr2=0x7fb4880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.048+0000 7fb48ca62700 1 -- 172.21.15.96:0/3706242422 shutdown_connections 2022-02-02T20:25:37.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 -- 172.21.15.96:0/3706242422 wait complete. 2022-02-02T20:25:37.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 Processor -- start 2022-02-02T20:25:37.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 -- start start 2022-02-02T20:25:37.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 0x7fb48810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880602b0 con 0x7fb4880f55c0 2022-02-02T20:25:37.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48ca62700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880603f0 con 0x7fb4880f6860 2022-02-02T20:25:37.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37012/0 (socket says 172.21.15.96:37012) 2022-02-02T20:25:37.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.049+0000 7fb48659c700 1 -- 172.21.15.96:0/159193989 learned_addr learned my addr 172.21.15.96:0/159193989 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:37.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb485d9b700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 0x7fb48810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48659c700 1 -- 172.21.15.96:0/159193989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 msgr2=0x7fb48810e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48659c700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 0x7fb48810e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48659c700 1 -- 172.21.15.96:0/159193989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470005040 con 0x7fb4880f55c0 2022-02-02T20:25:37.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48659c700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7fb470013a70 tx=0x7fb470009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb470018070 con 0x7fb4880f55c0 2022-02-02T20:25:37.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb4700097d0 con 0x7fb4880f55c0 2022-02-02T20:25:37.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48810ea80 con 0x7fb4880f55c0 2022-02-02T20:25:37.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47001de80 con 0x7fb4880f55c0 2022-02-02T20:25:37.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.050+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48810ee50 con 0x7fb4880f55c0 2022-02-02T20:25:37.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.051+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4880f49b0 con 0x7fb4880f55c0 2022-02-02T20:25:37.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.052+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb470007ba0 con 0x7fb4880f55c0 2022-02-02T20:25:37.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.052+0000 7fb47effd700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 0x7fb474067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.052+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb470083590 con 0x7fb4880f55c0 2022-02-02T20:25:37.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.052+0000 7fb485d9b700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 0x7fb474067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.052+0000 7fb485d9b700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 0x7fb474067290 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fb478004c40 tx=0x7fb47800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.056+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb470051690 con 0x7fb4880f55c0 2022-02-02T20:25:37.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.229+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4880fdea0 con 0x7fb474064dd0 2022-02-02T20:25:37.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.239+0000 7fb47effd700 1 -- 172.21.15.96:0/159193989 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fb4880fdea0 con 0x7fb474064dd0 2022-02-02T20:25:37.241 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:25:37.242 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 99m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:25:37.242 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 99m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:25:37.242 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 98m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:25:37.242 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 99m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:25:37.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 99m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:25:37.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 99m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:25:37.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 98m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:25:37.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 98m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:25:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 99m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:25:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 98m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:25:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 99m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:25:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 98m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:25:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 99m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:25:37.245 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 98m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:25:37.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 99m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:25:37.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 99m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:25:37.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (119m) 99m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:25:37.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (119m) 98m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:25:37.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (118m) 98m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:25:37.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (118m) 98m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:25:37.246 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 99m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:25:37.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 msgr2=0x7fb474067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 0x7fb474067290 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fb478004c40 tx=0x7fb47800b040).stop 2022-02-02T20:25:37.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 msgr2=0x7fb48810c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7fb470013a70 tx=0x7fb470009b30).stop 2022-02-02T20:25:37.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 shutdown_connections 2022-02-02T20:25:37.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb474064dd0 0x7fb474067290 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4880f55c0 0x7fb48810c090 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 --2- 172.21.15.96:0/159193989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4880f6860 0x7fb48810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 >> 172.21.15.96:0/159193989 conn(0x7fb4880f0d40 msgr2=0x7fb4880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 shutdown_connections 2022-02-02T20:25:37.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.241+0000 7fb48ca62700 1 -- 172.21.15.96:0/159193989 wait complete. 2022-02-02T20:25:37.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.338+0000 7f88b55f5700 1 -- 172.21.15.96:0/3792130986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b00f96a0 msgr2=0x7f88b00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.338+0000 7f88b55f5700 1 --2- 172.21.15.96:0/3792130986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b00f96a0 0x7f88b00fbaf0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f88a0004660 tx=0x7f88a0009b30).stop 2022-02-02T20:25:37.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 -- 172.21.15.96:0/3792130986 shutdown_connections 2022-02-02T20:25:37.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 --2- 172.21.15.96:0/3792130986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b00f96a0 0x7f88b00fbaf0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 --2- 172.21.15.96:0/3792130986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b0060310 0x7f88b00f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 -- 172.21.15.96:0/3792130986 >> 172.21.15.96:0/3792130986 conn(0x7f88b00f0ba0 msgr2=0x7f88b00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 -- 172.21.15.96:0/3792130986 shutdown_connections 2022-02-02T20:25:37.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 -- 172.21.15.96:0/3792130986 wait complete. 2022-02-02T20:25:37.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 Processor -- start 2022-02-02T20:25:37.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.339+0000 7f88b55f5700 1 -- start start 2022-02-02T20:25:37.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 0x7f88b0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0107870 con 0x7f88b0060310 2022-02-02T20:25:37.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01080b0 con 0x7f88b00f96a0 2022-02-02T20:25:37.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37022/0 (socket says 172.21.15.96:37022) 2022-02-02T20:25:37.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 -- 172.21.15.96:0/1700870526 learned_addr learned my addr 172.21.15.96:0/1700870526 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:37.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88af7fe700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 0x7f88b0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 -- 172.21.15.96:0/1700870526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 msgr2=0x7f88b0107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 0x7f88b0107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 -- 172.21.15.96:0/1700870526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0005040 con 0x7f88b0060310 2022-02-02T20:25:37.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88af7fe700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 0x7f88b0107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:25:37.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88affff700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f88a40026d0 tx=0x7f88a4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a4009320 con 0x7f88b0060310 2022-02-02T20:25:37.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88a400f040 con 0x7f88b0060310 2022-02-02T20:25:37.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0108390 con 0x7f88b0060310 2022-02-02T20:25:37.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a40147e0 con 0x7f88b0060310 2022-02-02T20:25:37.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.340+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b01088d0 con 0x7f88b0060310 2022-02-02T20:25:37.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.341+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0059100 con 0x7f88b0060310 2022-02-02T20:25:37.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.342+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f88a4009480 con 0x7f88b0060310 2022-02-02T20:25:37.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.342+0000 7f88acff9700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 0x7f88980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.342+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f88a4082090 con 0x7f88b0060310 2022-02-02T20:25:37.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.342+0000 7f88af7fe700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 0x7f88980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.342+0000 7f88af7fe700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 0x7f88980672e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f88a0004e30 tx=0x7f88a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.346+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f88a4050190 con 0x7f88b0060310 2022-02-02T20:25:37.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.575+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88b00fee00 con 0x7f88b0060310 2022-02-02T20:25:37.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.576+0000 7f88acff9700 1 -- 172.21.15.96:0/1700870526 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f88a40537b0 con 0x7f88b0060310 2022-02-02T20:25:37.578 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:25:37.579 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:25:37.579 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:25:37.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:37.580 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:25:37.580 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:25:37.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:37.581 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:25:37.581 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:25:37.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:37.582 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:25:37.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:25:37.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:25:37.583 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:25:37.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:25:37.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:25:37.584 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:25:37.584 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:25:37.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.577+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 msgr2=0x7f88980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.577+0000 7f88b55f5700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 0x7f88980672e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f88a0004e30 tx=0x7f88a0009b30).stop 2022-02-02T20:25:37.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.577+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 msgr2=0x7f88b0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.577+0000 7f88b55f5700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f88a40026d0 tx=0x7f88a4009de0).stop 2022-02-02T20:25:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 shutdown_connections 2022-02-02T20:25:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8898064e20 0x7f88980672e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88b0060310 0x7f88b0106d80 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 --2- 172.21.15.96:0/1700870526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88b00f96a0 0x7f88b0107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 >> 172.21.15.96:0/1700870526 conn(0x7f88b00f0ba0 msgr2=0x7f88b00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 shutdown_connections 2022-02-02T20:25:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.578+0000 7f88b55f5700 1 -- 172.21.15.96:0/1700870526 wait complete. 2022-02-02T20:25:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 -- 172.21.15.96:0/3233974774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 msgr2=0x7fddbc0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 --2- 172.21.15.96:0/3233974774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc0f6ae0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fddac004660 tx=0x7fddac009b30).stop 2022-02-02T20:25:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 -- 172.21.15.96:0/3233974774 shutdown_connections 2022-02-02T20:25:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 --2- 172.21.15.96:0/3233974774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f7960 0x7fddbc0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 --2- 172.21.15.96:0/3233974774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc0f6ae0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 -- 172.21.15.96:0/3233974774 >> 172.21.15.96:0/3233974774 conn(0x7fddbc0f1e20 msgr2=0x7fddbc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 -- 172.21.15.96:0/3233974774 shutdown_connections 2022-02-02T20:25:37.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.675+0000 7fddc1991700 1 -- 172.21.15.96:0/3233974774 wait complete. 2022-02-02T20:25:37.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 Processor -- start 2022-02-02T20:25:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 -- start start 2022-02-02T20:25:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f7960 0x7fddbc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc06a380 con 0x7fddbc0f66c0 2022-02-02T20:25:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddc1991700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc06a4c0 con 0x7fddbc0f7960 2022-02-02T20:25:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37032/0 (socket says 172.21.15.96:37032) 2022-02-02T20:25:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.676+0000 7fddbaffd700 1 -- 172.21.15.96:0/1695744390 learned_addr learned my addr 172.21.15.96:0/1695744390 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:25:37.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddbaffd700 1 -- 172.21.15.96:0/1695744390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f7960 msgr2=0x7fddbc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddbaffd700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f7960 0x7fddbc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:25:37.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddbaffd700 1 -- 172.21.15.96:0/1695744390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac005040 con 0x7fddbc0f66c0 2022-02-02T20:25:37.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddbaffd700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fddac013a70 tx=0x7fddac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac018070 con 0x7fddbc0f66c0 2022-02-02T20:25:37.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fddac0097d0 con 0x7fddbc0f66c0 2022-02-02T20:25:37.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc06a740 con 0x7fddbc0f66c0 2022-02-02T20:25:37.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac01c3c0 con 0x7fddbc0f66c0 2022-02-02T20:25:37.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.677+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc06aca0 con 0x7fddbc0f66c0 2022-02-02T20:25:37.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.678+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc045ad0 con 0x7fddbc0f66c0 2022-02-02T20:25:37.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.679+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fddac007ba0 con 0x7fddbc0f66c0 2022-02-02T20:25:37.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.679+0000 7fdda37fe700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:25:37.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.679+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fddac083640 con 0x7fddbc0f66c0 2022-02-02T20:25:37.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.679+0000 7fddba7fc700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:25:37.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.679+0000 7fddba7fc700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fddb0004ad0 tx=0x7fddb0009af0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:25:37.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.683+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fddac051800 con 0x7fddbc0f66c0 2022-02-02T20:25:37.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.886+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fddbc0fef50 con 0x7fddbc0f66c0 2022-02-02T20:25:37.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.887+0000 7fdda37fe700 1 -- 172.21.15.96:0/1695744390 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fddac054e20 con 0x7fddbc0f66c0 2022-02-02T20:25:37.889 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:25:37.889 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:25:37.889 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:25:37.889 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:25:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:37.890 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:25:37.890 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:25:37.890 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:25:37.891 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:25:37.891 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:25:37.891 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:25:37.891 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:25:37.892 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:25:37.892 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:25:37.892 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:25:37.892 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:25:37.892 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:25:37.893 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:25:37.893 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:25:37.893 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:25:37.893 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:25:37.894 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:25:37.894 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:25:37.894 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:25:37.894 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:25:37.894 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:25:37.895 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:25:37.895 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:25:37.895 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:25:37.895 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:25:37.896 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:25:37.896 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:25:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:37.896 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:25:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:25:37.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:37.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:37.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:25:37.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 msgr2=0x7fdda4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fddb0004ad0 tx=0x7fddb0009af0).stop 2022-02-02T20:25:37.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 msgr2=0x7fddbc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:25:37.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fddac013a70 tx=0x7fddac009b30).stop 2022-02-02T20:25:37.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 shutdown_connections 2022-02-02T20:25:37.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f66c0 0x7fddbc06b9a0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:25:37.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 --2- 172.21.15.96:0/1695744390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f7960 0x7fddbc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:25:37.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 >> 172.21.15.96:0/1695744390 conn(0x7fddbc0f1e20 msgr2=0x7fddbc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:25:37.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 shutdown_connections 2022-02-02T20:25:37.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:25:37.889+0000 7fddc1991700 1 -- 172.21.15.96:0/1695744390 wait complete. 2022-02-02T20:25:37.901 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:25:38.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:37 smithi159 ceph-mon[69013]: from='client.37910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:38.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:37 smithi159 ceph-mon[69013]: pgmap v3706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:38.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:37 smithi159 ceph-mon[69013]: from='client.37914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:38.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1700870526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:25:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:37 smithi096 ceph-mon[101353]: from='client.37910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:37 smithi096 ceph-mon[101353]: pgmap v3706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:37 smithi096 ceph-mon[101353]: from='client.37914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:25:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1700870526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:25:39.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1695744390' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:25:39.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1695744390' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:25:40.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:39 smithi159 ceph-mon[69013]: pgmap v3707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:40.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:39 smithi096 ceph-mon[101353]: pgmap v3707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:42 smithi159 ceph-mon[69013]: pgmap v3708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:42 smithi096 ceph-mon[101353]: pgmap v3708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:44 smithi159 ceph-mon[69013]: pgmap v3709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:44 smithi096 ceph-mon[101353]: pgmap v3709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:46 smithi159 ceph-mon[69013]: pgmap v3710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:46 smithi096 ceph-mon[101353]: pgmap v3710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:47 smithi159 ceph-mon[69013]: pgmap v3711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:47 smithi096 ceph-mon[101353]: pgmap v3711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:50 smithi159 ceph-mon[69013]: pgmap v3712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:50 smithi096 ceph-mon[101353]: pgmap v3712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:52 smithi159 ceph-mon[69013]: pgmap v3713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:52 smithi096 ceph-mon[101353]: pgmap v3713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:54 smithi159 ceph-mon[69013]: pgmap v3714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:54 smithi096 ceph-mon[101353]: pgmap v3714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:56 smithi159 ceph-mon[69013]: pgmap v3715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:56 smithi096 ceph-mon[101353]: pgmap v3715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:25:57 smithi159 ceph-mon[69013]: pgmap v3716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:25:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:25:57 smithi096 ceph-mon[101353]: pgmap v3716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:00 smithi159 ceph-mon[69013]: pgmap v3717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:00 smithi096 ceph-mon[101353]: pgmap v3717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:02 smithi159 ceph-mon[69013]: pgmap v3718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:02 smithi096 ceph-mon[101353]: pgmap v3718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:04 smithi159 ceph-mon[69013]: pgmap v3719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:04 smithi096 ceph-mon[101353]: pgmap v3719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:06 smithi159 ceph-mon[69013]: pgmap v3720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:06 smithi096 ceph-mon[101353]: pgmap v3720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:07.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 -- 172.21.15.96:0/1831921895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f55c0 msgr2=0x7fcea40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:07.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 --2- 172.21.15.96:0/1831921895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f55c0 0x7fcea40f59e0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fce98004660 tx=0x7fce98009b30).stop 2022-02-02T20:26:07.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 -- 172.21.15.96:0/1831921895 shutdown_connections 2022-02-02T20:26:07.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 --2- 172.21.15.96:0/1831921895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f6860 0x7fcea40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:07.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 --2- 172.21.15.96:0/1831921895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f55c0 0x7fcea40f59e0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:07.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 -- 172.21.15.96:0/1831921895 >> 172.21.15.96:0/1831921895 conn(0x7fcea40f0d40 msgr2=0x7fcea40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:07.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 -- 172.21.15.96:0/1831921895 shutdown_connections 2022-02-02T20:26:07.998 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:07 smithi096 ceph-mon[101353]: pgmap v3721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:08.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.993+0000 7fceaad1a700 1 -- 172.21.15.96:0/1831921895 wait complete. 2022-02-02T20:26:08.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 Processor -- start 2022-02-02T20:26:08.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 -- start start 2022-02-02T20:26:08.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f55c0 0x7fcea4109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4109c00 con 0x7fcea40f6860 2022-02-02T20:26:08.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fceaad1a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4109d40 con 0x7fcea40f55c0 2022-02-02T20:26:08.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fcea3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.994+0000 7fcea3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37056/0 (socket says 172.21.15.96:37056) 2022-02-02T20:26:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea3fff700 1 -- 172.21.15.96:0/325467493 learned_addr learned my addr 172.21.15.96:0/325467493 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea8ab6700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f55c0 0x7fcea4109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea3fff700 1 -- 172.21.15.96:0/325467493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f55c0 msgr2=0x7fcea4109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea3fff700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f55c0 0x7fcea4109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea3fff700 1 -- 172.21.15.96:0/325467493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98005040 con 0x7fcea40f6860 2022-02-02T20:26:08.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea3fff700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7fce900026d0 tx=0x7fce90009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce900079c0 con 0x7fcea40f6860 2022-02-02T20:26:08.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea410a6e0 con 0x7fcea40f6860 2022-02-02T20:26:08.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce9000f040 con 0x7fcea40f6860 2022-02-02T20:26:08.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce900148b0 con 0x7fcea40f6860 2022-02-02T20:26:08.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.995+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea410aca0 con 0x7fcea40f6860 2022-02-02T20:26:08.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.996+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea4045ad0 con 0x7fcea40f6860 2022-02-02T20:26:08.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.997+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce90007b20 con 0x7fcea40f6860 2022-02-02T20:26:08.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.998+0000 7fcea17fa700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.998+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce90081df0 con 0x7fcea40f6860 2022-02-02T20:26:08.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.998+0000 7fcea8ab6700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:07.998+0000 7fcea8ab6700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fce98004630 tx=0x7fce98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.001+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce90053920 con 0x7fcea40f6860 2022-02-02T20:26:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:07 smithi159 ceph-mon[69013]: pgmap v3721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:08.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.180+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea40faaa0 con 0x7fce94064dd0 2022-02-02T20:26:08.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.181+0000 7fcea17fa700 1 -- 172.21.15.96:0/325467493 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcea40faaa0 con 0x7fce94064dd0 2022-02-02T20:26:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.182+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 msgr2=0x7fce94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.182+0000 7fceaad1a700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fce98004630 tx=0x7fce98009b30).stop 2022-02-02T20:26:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.182+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 msgr2=0x7fcea4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.182+0000 7fceaad1a700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7fce900026d0 tx=0x7fce90009de0).stop 2022-02-02T20:26:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 shutdown_connections 2022-02-02T20:26:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea40f55c0 0x7fcea4109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 --2- 172.21.15.96:0/325467493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea40f6860 0x7fcea4109650 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 >> 172.21.15.96:0/325467493 conn(0x7fcea40f0d40 msgr2=0x7fcea40f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 shutdown_connections 2022-02-02T20:26:08.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.183+0000 7fceaad1a700 1 -- 172.21.15.96:0/325467493 wait complete. 2022-02-02T20:26:08.195 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:26:08.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 -- 172.21.15.96:0/2624566780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 msgr2=0x7ff2d40f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 --2- 172.21.15.96:0/2624566780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f9330 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7ff2c4004660 tx=0x7ff2c4009b30).stop 2022-02-02T20:26:08.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 -- 172.21.15.96:0/2624566780 shutdown_connections 2022-02-02T20:26:08.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 --2- 172.21.15.96:0/2624566780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 0x7ff2d40fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 --2- 172.21.15.96:0/2624566780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f9330 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 -- 172.21.15.96:0/2624566780 >> 172.21.15.96:0/2624566780 conn(0x7ff2d40f0d70 msgr2=0x7ff2d40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 -- 172.21.15.96:0/2624566780 shutdown_connections 2022-02-02T20:26:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.280+0000 7ff2d967b700 1 -- 172.21.15.96:0/2624566780 wait complete. 2022-02-02T20:26:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 Processor -- start 2022-02-02T20:26:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 -- start start 2022-02-02T20:26:08.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 0x7ff2d40f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40f5790 con 0x7ff2d4060370 2022-02-02T20:26:08.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d967b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40f58d0 con 0x7ff2d40f98b0 2022-02-02T20:26:08.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37064/0 (socket says 172.21.15.96:37064) 2022-02-02T20:26:08.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d2ffd700 1 -- 172.21.15.96:0/1984087839 learned_addr learned my addr 172.21.15.96:0/1984087839 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:08.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.281+0000 7ff2d27fc700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 0x7ff2d40f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d2ffd700 1 -- 172.21.15.96:0/1984087839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 msgr2=0x7ff2d40f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d2ffd700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 0x7ff2d40f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d2ffd700 1 -- 172.21.15.96:0/1984087839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4005040 con 0x7ff2d4060370 2022-02-02T20:26:08.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d2ffd700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff2c4009830 tx=0x7ff2c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c4018070 con 0x7ff2d4060370 2022-02-02T20:26:08.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d40f5b50 con 0x7ff2d4060370 2022-02-02T20:26:08.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2c4007ba0 con 0x7ff2d4060370 2022-02-02T20:26:08.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c401c3c0 con 0x7ff2d4060370 2022-02-02T20:26:08.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.282+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d40f60b0 con 0x7ff2d4060370 2022-02-02T20:26:08.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.283+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4045ad0 con 0x7ff2d4060370 2022-02-02T20:26:08.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.283+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2c4007d10 con 0x7ff2d4060370 2022-02-02T20:26:08.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.284+0000 7ff2bb7fe700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 0x7ff2bc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.284+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2c4083620 con 0x7ff2d4060370 2022-02-02T20:26:08.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.284+0000 7ff2d27fc700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 0x7ff2bc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.284+0000 7ff2d27fc700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 0x7ff2bc067270 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7ff2d4060140 tx=0x7ff2c800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.288+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2c40517e0 con 0x7ff2d4060370 2022-02-02T20:26:08.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.466+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d4057f10 con 0x7ff2bc064db0 2022-02-02T20:26:08.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.475+0000 7ff2bb7fe700 1 -- 172.21.15.96:0/1984087839 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7ff2d4057f10 con 0x7ff2bc064db0 2022-02-02T20:26:08.478 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:26:08.478 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 100m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:26:08.478 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 100m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:26:08.478 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 98m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:26:08.479 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 100m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:26:08.479 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 100m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:26:08.479 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 100m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:26:08.479 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 98m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:26:08.480 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 98m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:26:08.480 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 100m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:26:08.480 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 98m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:26:08.480 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 100m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:26:08.480 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 98m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:26:08.481 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 100m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:26:08.481 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 98m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:26:08.481 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 100m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:26:08.481 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 100m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:26:08.482 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 100m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:26:08.482 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (119m) 98m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:26:08.482 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (119m) 98m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:26:08.482 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (118m) 98m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:26:08.482 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 100m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:26:08.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 msgr2=0x7ff2bc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 0x7ff2bc067270 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7ff2d4060140 tx=0x7ff2c800b040).stop 2022-02-02T20:26:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 msgr2=0x7ff2d40f6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff2c4009830 tx=0x7ff2c4009b30).stop 2022-02-02T20:26:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 shutdown_connections 2022-02-02T20:26:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2bc064db0 0x7ff2bc067270 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d4060370 0x7ff2d40f6db0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 --2- 172.21.15.96:0/1984087839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f98b0 0x7ff2d40f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 >> 172.21.15.96:0/1984087839 conn(0x7ff2d40f0d70 msgr2=0x7ff2d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 shutdown_connections 2022-02-02T20:26:08.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.477+0000 7ff2d967b700 1 -- 172.21.15.96:0/1984087839 wait complete. 2022-02-02T20:26:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 -- 172.21.15.96:0/271988000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 msgr2=0x7fa4fc0f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 --2- 172.21.15.96:0/271988000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc0f9180 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fa4f0004660 tx=0x7fa4f0009b30).stop 2022-02-02T20:26:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 -- 172.21.15.96:0/271988000 shutdown_connections 2022-02-02T20:26:08.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 --2- 172.21.15.96:0/271988000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 0x7fa4fc0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 --2- 172.21.15.96:0/271988000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc0f9180 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 -- 172.21.15.96:0/271988000 >> 172.21.15.96:0/271988000 conn(0x7fa4fc0f0ba0 msgr2=0x7fa4fc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 -- 172.21.15.96:0/271988000 shutdown_connections 2022-02-02T20:26:08.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.573+0000 7fa501b84700 1 -- 172.21.15.96:0/271988000 wait complete. 2022-02-02T20:26:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 Processor -- start 2022-02-02T20:26:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 -- start start 2022-02-02T20:26:08.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 0x7fa4fc1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc1078a0 con 0x7fa4fc0602b0 2022-02-02T20:26:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa501b84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc1080e0 con 0x7fa4fc0f9700 2022-02-02T20:26:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.574+0000 7fa500b82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37074/0 (socket says 172.21.15.96:37074) 2022-02-02T20:26:08.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 -- 172.21.15.96:0/370779510 learned_addr learned my addr 172.21.15.96:0/370779510 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:08.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa4fbfff700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 0x7fa4fc1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 -- 172.21.15.96:0/370779510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 msgr2=0x7fa4fc1072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 0x7fa4fc1072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 -- 172.21.15.96:0/370779510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f0005040 con 0x7fa4fc0602b0 2022-02-02T20:26:08.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa500b82700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fa4f0009990 tx=0x7fa4f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f0018070 con 0x7fa4fc0602b0 2022-02-02T20:26:08.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa4f0007ba0 con 0x7fa4fc0602b0 2022-02-02T20:26:08.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc108360 con 0x7fa4fc0602b0 2022-02-02T20:26:08.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f001c3c0 con 0x7fa4fc0602b0 2022-02-02T20:26:08.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.575+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc108840 con 0x7fa4fc0602b0 2022-02-02T20:26:08.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.576+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc059100 con 0x7fa4fc0602b0 2022-02-02T20:26:08.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.577+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa4f001d420 con 0x7fa4fc0602b0 2022-02-02T20:26:08.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.577+0000 7fa4f97fa700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 0x7fa4ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.577+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa4f0083740 con 0x7fa4fc0602b0 2022-02-02T20:26:08.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.577+0000 7fa4fbfff700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 0x7fa4ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.577+0000 7fa4fbfff700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 0x7fa4ec0672e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fa4fc106b40 tx=0x7fa4e8009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.581+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4f00518a0 con 0x7fa4fc0602b0 2022-02-02T20:26:08.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.814+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4fc0fed20 con 0x7fa4fc0602b0 2022-02-02T20:26:08.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.814+0000 7fa4f97fa700 1 -- 172.21.15.96:0/370779510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa4f0054ec0 con 0x7fa4fc0602b0 2022-02-02T20:26:08.817 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:26:08.818 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:26:08.818 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:26:08.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:08.818 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:26:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:26:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:26:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:26:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:08.820 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:26:08.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:26:08.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:08.820 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:26:08.821 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:26:08.821 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:26:08.821 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:26:08.821 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:26:08.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.816+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 msgr2=0x7fa4ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.816+0000 7fa501b84700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 0x7fa4ec0672e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fa4fc106b40 tx=0x7fa4e8009be0).stop 2022-02-02T20:26:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.816+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 msgr2=0x7fa4fc106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.816+0000 7fa501b84700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fa4f0009990 tx=0x7fa4f0009b30).stop 2022-02-02T20:26:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 shutdown_connections 2022-02-02T20:26:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa4ec064e20 0x7fa4ec0672e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4fc0602b0 0x7fa4fc106db0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 --2- 172.21.15.96:0/370779510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4fc0f9700 0x7fa4fc1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 >> 172.21.15.96:0/370779510 conn(0x7fa4fc0f0ba0 msgr2=0x7fa4fc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 shutdown_connections 2022-02-02T20:26:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.817+0000 7fa501b84700 1 -- 172.21.15.96:0/370779510 wait complete. 2022-02-02T20:26:08.916 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:08 smithi096 ceph-mon[101353]: from='client.37926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:08.916 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:08 smithi096 ceph-mon[101353]: from='client.37930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:08.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 -- 172.21.15.96:0/869642841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 msgr2=0x7f8f380f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/869642841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f380f8120 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f8f280099e0 tx=0x7f8f28004d10).stop 2022-02-02T20:26:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 -- 172.21.15.96:0/869642841 shutdown_connections 2022-02-02T20:26:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/869642841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 0x7f8f380f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:26:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/869642841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f380f8120 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 -- 172.21.15.96:0/869642841 >> 172.21.15.96:0/869642841 conn(0x7f8f380f0540 msgr2=0x7f8f380f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 -- 172.21.15.96:0/869642841 shutdown_connections 2022-02-02T20:26:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.913+0000 7f8f3d4de700 1 -- 172.21.15.96:0/869642841 wait complete. 2022-02-02T20:26:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 Processor -- start 2022-02-02T20:26:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 -- start start 2022-02-02T20:26:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 0x7f8f381075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38107c00 con 0x7f8f380f7d00 2022-02-02T20:26:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f3d4de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381084b0 con 0x7f8f380f8610 2022-02-02T20:26:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37084/0 (socket says 172.21.15.96:37084) 2022-02-02T20:26:08.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f36ffd700 1 -- 172.21.15.96:0/2819224547 learned_addr learned my addr 172.21.15.96:0/2819224547 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:08.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.914+0000 7f8f367fc700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 0x7f8f381075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f36ffd700 1 -- 172.21.15.96:0/2819224547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 msgr2=0x7f8f381075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f36ffd700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 0x7f8f381075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f36ffd700 1 -- 172.21.15.96:0/2819224547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009640 con 0x7f8f380f7d00 2022-02-02T20:26:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f36ffd700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f8f28004b70 tx=0x7f8f28004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2800e030 con 0x7f8f380f7d00 2022-02-02T20:26:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f280049b0 con 0x7f8f380f7d00 2022-02-02T20:26:08.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f38108730 con 0x7f8f380f7d00 2022-02-02T20:26:08.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f28018070 con 0x7f8f380f7d00 2022-02-02T20:26:08.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.915+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f38108c10 con 0x7f8f380f7d00 2022-02-02T20:26:08.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.916+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380f41d0 con 0x7f8f380f7d00 2022-02-02T20:26:08.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.917+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f2801db40 con 0x7f8f380f7d00 2022-02-02T20:26:08.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.917+0000 7f8f2f7fe700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:08.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.917+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8f280839f0 con 0x7f8f380f7d00 2022-02-02T20:26:08.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.917+0000 7f8f367fc700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:08.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.918+0000 7f8f367fc700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f8f2000b790 tx=0x7f8f20008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:08.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:08.922+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f28085e60 con 0x7f8f380f7d00 2022-02-02T20:26:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:08 smithi159 ceph-mon[69013]: from='client.37926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:08 smithi159 ceph-mon[69013]: from='client.37930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:09.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.123+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f38027a00 con 0x7f8f380f7d00 2022-02-02T20:26:09.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.124+0000 7f8f2f7fe700 1 -- 172.21.15.96:0/2819224547 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8f280554c0 con 0x7f8f380f7d00 2022-02-02T20:26:09.127 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:26:09.127 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:26:09.127 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:26:09.128 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:26:09.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:09.128 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:26:09.128 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:26:09.129 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:26:09.129 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:26:09.129 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:26:09.129 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:26:09.129 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:26:09.130 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:26:09.130 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:26:09.130 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:26:09.130 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:26:09.131 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:26:09.131 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:26:09.131 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:26:09.131 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:26:09.131 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:26:09.132 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:26:09.132 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:26:09.132 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:26:09.132 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:26:09.134 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:26:09.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:26:09.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:09.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:09.134 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:26:09.135 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:09.135 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:09.135 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:09.135 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:09.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 msgr2=0x7f8f24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:09.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f8f2000b790 tx=0x7f8f20008040).stop 2022-02-02T20:26:09.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 msgr2=0x7f8f381070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:09.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f8f28004b70 tx=0x7f8f28004d10).stop 2022-02-02T20:26:09.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 shutdown_connections 2022-02-02T20:26:09.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f24064dd0 0x7f8f24067290 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:09.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f380f7d00 0x7f8f381070d0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:09.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 --2- 172.21.15.96:0/2819224547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f380f8610 0x7f8f381075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:09.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 >> 172.21.15.96:0/2819224547 conn(0x7f8f380f0540 msgr2=0x7f8f380fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:09.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 shutdown_connections 2022-02-02T20:26:09.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:09.126+0000 7f8f3d4de700 1 -- 172.21.15.96:0/2819224547 wait complete. 2022-02-02T20:26:09.139 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:26:10.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/370779510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:26:10.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:09 smithi159 ceph-mon[69013]: pgmap v3722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:10.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2819224547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:26:10.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/370779510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:26:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:09 smithi096 ceph-mon[101353]: pgmap v3722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:10.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2819224547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:26:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:12 smithi159 ceph-mon[69013]: pgmap v3723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:12 smithi096 ceph-mon[101353]: pgmap v3723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:14 smithi159 ceph-mon[69013]: pgmap v3724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:14 smithi096 ceph-mon[101353]: pgmap v3724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:16 smithi159 ceph-mon[69013]: pgmap v3725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:16 smithi096 ceph-mon[101353]: pgmap v3725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:17 smithi159 ceph-mon[69013]: pgmap v3726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:17 smithi096 ceph-mon[101353]: pgmap v3726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:20 smithi159 ceph-mon[69013]: pgmap v3727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:20 smithi096 ceph-mon[101353]: pgmap v3727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:22 smithi159 ceph-mon[69013]: pgmap v3728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:22 smithi096 ceph-mon[101353]: pgmap v3728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:24 smithi159 ceph-mon[69013]: pgmap v3729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:24 smithi096 ceph-mon[101353]: pgmap v3729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:26 smithi159 ceph-mon[69013]: pgmap v3730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:26 smithi096 ceph-mon[101353]: pgmap v3730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:27 smithi159 ceph-mon[69013]: pgmap v3731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:26:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:26:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:27 smithi096 ceph-mon[101353]: pgmap v3731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:26:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:26:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:30 smithi159 ceph-mon[69013]: pgmap v3732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:30 smithi096 ceph-mon[101353]: pgmap v3732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:32 smithi159 ceph-mon[69013]: pgmap v3733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:32 smithi096 ceph-mon[101353]: pgmap v3733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:34 smithi159 ceph-mon[69013]: pgmap v3734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:34 smithi096 ceph-mon[101353]: pgmap v3734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:36 smithi159 ceph-mon[69013]: pgmap v3735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:36 smithi096 ceph-mon[101353]: pgmap v3735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:37 smithi159 ceph-mon[69013]: pgmap v3736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:37 smithi096 ceph-mon[101353]: pgmap v3736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:39.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 -- 172.21.15.96:0/2870049007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f7980 msgr2=0x7fd0940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 --2- 172.21.15.96:0/2870049007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f7980 0x7fd0940f7de0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7fd090004660 tx=0x7fd090009b30).stop 2022-02-02T20:26:39.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 -- 172.21.15.96:0/2870049007 shutdown_connections 2022-02-02T20:26:39.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 --2- 172.21.15.96:0/2870049007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f7980 0x7fd0940f7de0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 --2- 172.21.15.96:0/2870049007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f66e0 0x7fd0940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.239+0000 7fd09be74700 1 -- 172.21.15.96:0/2870049007 >> 172.21.15.96:0/2870049007 conn(0x7fd0940f1e40 msgr2=0x7fd0940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:39.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 -- 172.21.15.96:0/2870049007 shutdown_connections 2022-02-02T20:26:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 -- 172.21.15.96:0/2870049007 wait complete. 2022-02-02T20:26:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 Processor -- start 2022-02-02T20:26:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 -- start start 2022-02-02T20:26:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f7980 0x7fd094069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09406a380 con 0x7fd0940f66e0 2022-02-02T20:26:39.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd09be74700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09406a4c0 con 0x7fd0940f7980 2022-02-02T20:26:39.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd099c10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd099c10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37106/0 (socket says 172.21.15.96:37106) 2022-02-02T20:26:39.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.240+0000 7fd099c10700 1 -- 172.21.15.96:0/201255628 learned_addr learned my addr 172.21.15.96:0/201255628 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:39.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd09940f700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f7980 0x7fd094069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd099c10700 1 -- 172.21.15.96:0/201255628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f7980 msgr2=0x7fd094069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd099c10700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f7980 0x7fd094069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd099c10700 1 -- 172.21.15.96:0/201255628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090005040 con 0x7fd0940f66e0 2022-02-02T20:26:39.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd099c10700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fd088002700 tx=0x7fd088009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0880079c0 con 0x7fd0940f66e0 2022-02-02T20:26:39.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd08800f040 con 0x7fd0940f66e0 2022-02-02T20:26:39.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09406a7a0 con 0x7fd0940f66e0 2022-02-02T20:26:39.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd088014860 con 0x7fd0940f66e0 2022-02-02T20:26:39.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.241+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09410ef90 con 0x7fd0940f66e0 2022-02-02T20:26:39.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.242+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd094045ad0 con 0x7fd0940f66e0 2022-02-02T20:26:39.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.243+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd08801b060 con 0x7fd0940f66e0 2022-02-02T20:26:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.243+0000 7fd0867fc700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 0x7fd080067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.243+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd0880818e0 con 0x7fd0940f66e0 2022-02-02T20:26:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.243+0000 7fd09940f700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 0x7fd080067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.243+0000 7fd09940f700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 0x7fd080067290 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd090004630 tx=0x7fd090009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.247+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd08804f9e0 con 0x7fd0940f66e0 2022-02-02T20:26:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.426+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd094057f10 con 0x7fd080064dd0 2022-02-02T20:26:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.428+0000 7fd0867fc700 1 -- 172.21.15.96:0/201255628 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd094057f10 con 0x7fd080064dd0 2022-02-02T20:26:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 msgr2=0x7fd080067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 0x7fd080067290 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd090004630 tx=0x7fd090009b30).stop 2022-02-02T20:26:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 msgr2=0x7fd09406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fd088002700 tx=0x7fd088009d80).stop 2022-02-02T20:26:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 shutdown_connections 2022-02-02T20:26:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064dd0 0x7fd080067290 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0940f66e0 0x7fd09406b9a0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 --2- 172.21.15.96:0/201255628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940f7980 0x7fd094069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.429+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 >> 172.21.15.96:0/201255628 conn(0x7fd0940f1e40 msgr2=0x7fd0940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.430+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 shutdown_connections 2022-02-02T20:26:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.430+0000 7fd09be74700 1 -- 172.21.15.96:0/201255628 wait complete. 2022-02-02T20:26:39.441 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:26:39.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 -- 172.21.15.96:0/103055636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f55c0 msgr2=0x7f18c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 --2- 172.21.15.96:0/103055636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f55c0 0x7f18c80f59e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f18b8004660 tx=0x7f18b8009b30).stop 2022-02-02T20:26:39.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 -- 172.21.15.96:0/103055636 shutdown_connections 2022-02-02T20:26:39.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 --2- 172.21.15.96:0/103055636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f5ed0 0x7f18c80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:26:39.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 --2- 172.21.15.96:0/103055636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f55c0 0x7f18c80f59e0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 -- 172.21.15.96:0/103055636 >> 172.21.15.96:0/103055636 conn(0x7f18c80f0de0 msgr2=0x7f18c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:39.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 -- 172.21.15.96:0/103055636 shutdown_connections 2022-02-02T20:26:39.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.526+0000 7f18cd54a700 1 -- 172.21.15.96:0/103055636 wait complete. 2022-02-02T20:26:39.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.527+0000 7f18cd54a700 1 Processor -- start 2022-02-02T20:26:39.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.527+0000 7f18cd54a700 1 -- start start 2022-02-02T20:26:39.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.527+0000 7f18cd54a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f55c0 0x7f18c8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.527+0000 7f18cd54a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18cd54a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8107a80 con 0x7f18c80f5ed0 2022-02-02T20:26:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18cd54a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8108330 con 0x7f18c80f55c0 2022-02-02T20:26:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c6ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f55c0 0x7f18c8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37118/0 (socket says 172.21.15.96:37118) 2022-02-02T20:26:39.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 -- 172.21.15.96:0/1668547771 learned_addr learned my addr 172.21.15.96:0/1668547771 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:39.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 -- 172.21.15.96:0/1668547771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f55c0 msgr2=0x7f18c8106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f55c0 0x7f18c8106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 -- 172.21.15.96:0/1668547771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8005040 con 0x7f18c80f5ed0 2022-02-02T20:26:39.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18c67fc700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f18bc00b410 tx=0x7f18bc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.528+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18bc0125f0 con 0x7f18c80f5ed0 2022-02-02T20:26:39.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.529+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c8108610 con 0x7f18c80f5ed0 2022-02-02T20:26:39.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.529+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18bc00be30 con 0x7f18c80f5ed0 2022-02-02T20:26:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.529+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18bc002a70 con 0x7f18c80f5ed0 2022-02-02T20:26:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.529+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c8108bd0 con 0x7f18c80f5ed0 2022-02-02T20:26:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.530+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c80f4a50 con 0x7f18c80f5ed0 2022-02-02T20:26:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.530+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18bc00f030 con 0x7f18c80f5ed0 2022-02-02T20:26:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.530+0000 7f18af7fe700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 0x7f18b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.531+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f18bc081e60 con 0x7f18c80f5ed0 2022-02-02T20:26:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.531+0000 7f18c6ffd700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 0x7f18b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.531+0000 7f18c6ffd700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 0x7f18b0067290 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f18b8004630 tx=0x7f18b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.535+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18bc053990 con 0x7f18c80f5ed0 2022-02-02T20:26:39.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.704+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18c80fefa0 con 0x7f18b0064dd0 2022-02-02T20:26:39.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.714+0000 7f18af7fe700 1 -- 172.21.15.96:0/1668547771 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f18c80fefa0 con 0x7f18b0064dd0 2022-02-02T20:26:39.716 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:26:39.716 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 100m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:26:39.716 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 100m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:26:39.716 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 99m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:26:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 100m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:26:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 100m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:26:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 100m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:26:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 99m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:26:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 99m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:26:39.718 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 100m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:26:39.718 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 99m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:26:39.718 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 100m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:26:39.718 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 99m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:26:39.719 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 100m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:26:39.719 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 99m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:26:39.719 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 100m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:26:39.719 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 100m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:26:39.719 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 100m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:26:39.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 99m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:26:39.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (119m) 99m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:26:39.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (119m) 99m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:26:39.720 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 100m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:26:39.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 msgr2=0x7f18b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 0x7f18b0067290 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f18b8004630 tx=0x7f18b8009b30).stop 2022-02-02T20:26:39.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 msgr2=0x7f18c8107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f18bc00b410 tx=0x7f18bc006ef0).stop 2022-02-02T20:26:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 shutdown_connections 2022-02-02T20:26:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18b0064dd0 0x7f18b0067290 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c80f55c0 0x7f18c8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 --2- 172.21.15.96:0/1668547771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18c80f5ed0 0x7f18c8107440 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 >> 172.21.15.96:0/1668547771 conn(0x7f18c80f0de0 msgr2=0x7f18c80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 shutdown_connections 2022-02-02T20:26:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.716+0000 7f18cd54a700 1 -- 172.21.15.96:0/1668547771 wait complete. 2022-02-02T20:26:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 -- 172.21.15.96:0/2837994931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b80f9690 msgr2=0x7f83b80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 --2- 172.21.15.96:0/2837994931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b80f9690 0x7f83b80fbae0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f83ac004660 tx=0x7f83ac009b30).stop 2022-02-02T20:26:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 -- 172.21.15.96:0/2837994931 shutdown_connections 2022-02-02T20:26:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 --2- 172.21.15.96:0/2837994931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b80f9690 0x7f83b80fbae0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 --2- 172.21.15.96:0/2837994931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b8060310 0x7f83b80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 -- 172.21.15.96:0/2837994931 >> 172.21.15.96:0/2837994931 conn(0x7f83b80f0b90 msgr2=0x7f83b80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 -- 172.21.15.96:0/2837994931 shutdown_connections 2022-02-02T20:26:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.814+0000 7f83bce45700 1 -- 172.21.15.96:0/2837994931 wait complete. 2022-02-02T20:26:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 Processor -- start 2022-02-02T20:26:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 -- start start 2022-02-02T20:26:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b80f9690 0x7f83b80f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80f5570 con 0x7f83b8060310 2022-02-02T20:26:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83bce45700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80f56b0 con 0x7f83b80f9690 2022-02-02T20:26:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37126/0 (socket says 172.21.15.96:37126) 2022-02-02T20:26:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83b77fe700 1 -- 172.21.15.96:0/2584936389 learned_addr learned my addr 172.21.15.96:0/2584936389 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.815+0000 7f83b6ffd700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b80f9690 0x7f83b80f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83b77fe700 1 -- 172.21.15.96:0/2584936389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b80f9690 msgr2=0x7f83b80f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83b77fe700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b80f9690 0x7f83b80f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83b77fe700 1 -- 172.21.15.96:0/2584936389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac005040 con 0x7f83b8060310 2022-02-02T20:26:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83b77fe700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f83a80026d0 tx=0x7f83a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a80079c0 con 0x7f83b8060310 2022-02-02T20:26:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83a800f040 con 0x7f83b8060310 2022-02-02T20:26:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b80f5990 con 0x7f83b8060310 2022-02-02T20:26:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a80148b0 con 0x7f83b8060310 2022-02-02T20:26:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.816+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b810ed80 con 0x7f83b8060310 2022-02-02T20:26:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.817+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8045ad0 con 0x7f83b8060310 2022-02-02T20:26:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.817+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83a8007b20 con 0x7f83b8060310 2022-02-02T20:26:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.818+0000 7f839ffff700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 0x7f83a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.818+0000 7f83b6ffd700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 0x7f83a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:39.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.818+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83a80819a0 con 0x7f83b8060310 2022-02-02T20:26:39.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.818+0000 7f83b6ffd700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 0x7f83a00672e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f83ac004630 tx=0x7f83ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:39.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:39.822+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83a804faa0 con 0x7f83b8060310 2022-02-02T20:26:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.050+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f83b8027a00 con 0x7f83b8060310 2022-02-02T20:26:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.051+0000 7f839ffff700 1 -- 172.21.15.96:0/2584936389 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f83a80530c0 con 0x7f83b8060310 2022-02-02T20:26:40.054 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:26:40.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:26:40.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:26:40.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:40.055 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:26:40.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:26:40.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:40.056 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:26:40.056 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:26:40.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:40.057 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:26:40.057 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:26:40.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:26:40.057 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:26:40.058 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:26:40.058 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:26:40.058 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:26:40.058 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:26:40.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 msgr2=0x7f83a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 0x7f83a00672e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f83ac004630 tx=0x7f83ac009b30).stop 2022-02-02T20:26:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 msgr2=0x7f83b80f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f83a80026d0 tx=0x7f83a8009de0).stop 2022-02-02T20:26:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 shutdown_connections 2022-02-02T20:26:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83a0064e20 0x7f83a00672e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b8060310 0x7f83b80f6b90 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 --2- 172.21.15.96:0/2584936389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b80f9690 0x7f83b80f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 >> 172.21.15.96:0/2584936389 conn(0x7f83b80f0b90 msgr2=0x7f83b80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 shutdown_connections 2022-02-02T20:26:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.053+0000 7f83bce45700 1 -- 172.21.15.96:0/2584936389 wait complete. 2022-02-02T20:26:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.150+0000 7f84620de700 1 -- 172.21.15.96:0/3469516161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f5ed0 msgr2=0x7f845c0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.150+0000 7f84620de700 1 --2- 172.21.15.96:0/3469516161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f5ed0 0x7f845c0f6900 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f844c004660 tx=0x7f844c009b30).stop 2022-02-02T20:26:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 -- 172.21.15.96:0/3469516161 shutdown_connections 2022-02-02T20:26:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 --2- 172.21.15.96:0/3469516161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f5ed0 0x7f845c0f6900 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 --2- 172.21.15.96:0/3469516161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f55c0 0x7f845c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 -- 172.21.15.96:0/3469516161 >> 172.21.15.96:0/3469516161 conn(0x7f845c0f0de0 msgr2=0x7f845c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 -- 172.21.15.96:0/3469516161 shutdown_connections 2022-02-02T20:26:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 -- 172.21.15.96:0/3469516161 wait complete. 2022-02-02T20:26:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 Processor -- start 2022-02-02T20:26:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.151+0000 7f84620de700 1 -- start start 2022-02-02T20:26:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f84620de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f84620de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f5ed0 0x7f845c10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f84620de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c060410 con 0x7f845c0f55c0 2022-02-02T20:26:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f84620de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c060550 con 0x7f845c0f5ed0 2022-02-02T20:26:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37134/0 (socket says 172.21.15.96:37134) 2022-02-02T20:26:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 -- 172.21.15.96:0/771376016 learned_addr learned my addr 172.21.15.96:0/771376016 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:26:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845affd700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f5ed0 0x7f845c10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 -- 172.21.15.96:0/771376016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f5ed0 msgr2=0x7f845c10e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f5ed0 0x7f845c10e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 -- 172.21.15.96:0/771376016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c005040 con 0x7f845c0f55c0 2022-02-02T20:26:40.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f845b7fe700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f845000c530 tx=0x7f8450007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:40.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845000f650 con 0x7f845c0f55c0 2022-02-02T20:26:40.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f845000fc60 con 0x7f845c0f55c0 2022-02-02T20:26:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c10ea80 con 0x7f845c0f55c0 2022-02-02T20:26:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.152+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8450012c20 con 0x7f845c0f55c0 2022-02-02T20:26:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.153+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c10ef00 con 0x7f845c0f55c0 2022-02-02T20:26:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.154+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c045ad0 con 0x7f845c0f55c0 2022-02-02T20:26:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.154+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8450010070 con 0x7f845c0f55c0 2022-02-02T20:26:40.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.154+0000 7f8443fff700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 0x7f8444067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:26:40.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.155+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84500816e0 con 0x7f845c0f55c0 2022-02-02T20:26:40.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.155+0000 7f845affd700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 0x7f8444067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:26:40.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.155+0000 7f845affd700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 0x7f8444067290 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f844c004630 tx=0x7f844c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:26:40.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.159+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f845004f7e0 con 0x7f845c0f55c0 2022-02-02T20:26:40.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.358+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f845c0586e0 con 0x7f845c0f55c0 2022-02-02T20:26:40.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.359+0000 7f8443fff700 1 -- 172.21.15.96:0/771376016 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8450052e00 con 0x7f845c0f55c0 2022-02-02T20:26:40.361 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:26:40.361 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:26:40.362 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:26:40.362 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:26:40.362 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:40.362 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:26:40.363 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:26:40.363 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:26:40.363 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:26:40.363 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:26:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:26:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:26:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:26:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:26:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:26:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:26:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:26:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:26:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:26:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:26:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:26:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:26:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:26:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:26:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:26:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:26:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:26:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:26:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:26:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:26:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:26:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:26:40.369 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:40.369 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:40.370 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:26:40.370 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:26:40.370 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:40.370 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:40.371 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:26:40.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.360+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 msgr2=0x7f8444067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.360+0000 7f84620de700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 0x7f8444067290 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f844c004630 tx=0x7f844c009b30).stop 2022-02-02T20:26:40.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.360+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 msgr2=0x7f845c10c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:26:40.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.360+0000 7f84620de700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f845000c530 tx=0x7f8450007e20).stop 2022-02-02T20:26:40.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 shutdown_connections 2022-02-02T20:26:40.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8444064dd0 0x7f8444067290 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845c0f55c0 0x7f845c10c090 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 --2- 172.21.15.96:0/771376016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f845c0f5ed0 0x7f845c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:26:40.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 >> 172.21.15.96:0/771376016 conn(0x7f845c0f0de0 msgr2=0x7f845c0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:26:40.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 shutdown_connections 2022-02-02T20:26:40.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:26:40.361+0000 7f84620de700 1 -- 172.21.15.96:0/771376016 wait complete. 2022-02-02T20:26:40.375 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:26:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:40 smithi159 ceph-mon[69013]: pgmap v3737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:40.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:40 smithi159 ceph-mon[69013]: from='client.37942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:40.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2584936389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:26:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:40 smithi096 ceph-mon[101353]: pgmap v3737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:40 smithi096 ceph-mon[101353]: from='client.37942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:40.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2584936389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:26:41.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:41 smithi159 ceph-mon[69013]: from='client.37946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:41.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/771376016' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:41 smithi096 ceph-mon[101353]: from='client.37946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:26:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/771376016' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:26:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:42 smithi159 ceph-mon[69013]: pgmap v3738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:42 smithi096 ceph-mon[101353]: pgmap v3738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:44 smithi159 ceph-mon[69013]: pgmap v3739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:44 smithi096 ceph-mon[101353]: pgmap v3739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:46 smithi159 ceph-mon[69013]: pgmap v3740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:46 smithi096 ceph-mon[101353]: pgmap v3740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:47 smithi159 ceph-mon[69013]: pgmap v3741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:47 smithi096 ceph-mon[101353]: pgmap v3741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:50 smithi159 ceph-mon[69013]: pgmap v3742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:50 smithi096 ceph-mon[101353]: pgmap v3742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:52 smithi159 ceph-mon[69013]: pgmap v3743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:52 smithi096 ceph-mon[101353]: pgmap v3743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:54 smithi159 ceph-mon[69013]: pgmap v3744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:54 smithi096 ceph-mon[101353]: pgmap v3744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:56 smithi159 ceph-mon[69013]: pgmap v3745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:56 smithi096 ceph-mon[101353]: pgmap v3745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:26:57 smithi159 ceph-mon[69013]: pgmap v3746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:26:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:26:57 smithi096 ceph-mon[101353]: pgmap v3746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:00 smithi159 ceph-mon[69013]: pgmap v3747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:00 smithi096 ceph-mon[101353]: pgmap v3747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:02 smithi159 ceph-mon[69013]: pgmap v3748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:02 smithi096 ceph-mon[101353]: pgmap v3748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:04 smithi159 ceph-mon[69013]: pgmap v3749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:04 smithi096 ceph-mon[101353]: pgmap v3749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:06 smithi159 ceph-mon[69013]: pgmap v3750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:06.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:06 smithi096 ceph-mon[101353]: pgmap v3750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:07 smithi159 ceph-mon[69013]: pgmap v3751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:07 smithi096 ceph-mon[101353]: pgmap v3751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:10.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 -- 172.21.15.96:0/967832894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f66e0 msgr2=0x7fcd1c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 --2- 172.21.15.96:0/967832894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c0f6b00 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7fcd0c004660 tx=0x7fcd0c009b30).stop 2022-02-02T20:27:10.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 -- 172.21.15.96:0/967832894 shutdown_connections 2022-02-02T20:27:10.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 --2- 172.21.15.96:0/967832894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 --2- 172.21.15.96:0/967832894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c0f6b00 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 -- 172.21.15.96:0/967832894 >> 172.21.15.96:0/967832894 conn(0x7fcd1c0f1e40 msgr2=0x7fcd1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:10.474 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:10 smithi096 ceph-mon[101353]: pgmap v3752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:10.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 -- 172.21.15.96:0/967832894 shutdown_connections 2022-02-02T20:27:10.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.470+0000 7fcd2378c700 1 -- 172.21.15.96:0/967832894 wait complete. 2022-02-02T20:27:10.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 Processor -- start 2022-02-02T20:27:10.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 -- start start 2022-02-02T20:27:10.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c107a50 con 0x7fcd1c0f7980 2022-02-02T20:27:10.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd2378c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c107b90 con 0x7fcd1c0f66e0 2022-02-02T20:27:10.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd20d27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd20d27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37162/0 (socket says 172.21.15.96:37162) 2022-02-02T20:27:10.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd20d27700 1 -- 172.21.15.96:0/2763877438 learned_addr learned my addr 172.21.15.96:0/2763877438 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:10.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.471+0000 7fcd21528700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd20d27700 1 -- 172.21.15.96:0/2763877438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 msgr2=0x7fcd1c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd20d27700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd20d27700 1 -- 172.21.15.96:0/2763877438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c005040 con 0x7fcd1c0f7980 2022-02-02T20:27:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd21528700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:27:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd20d27700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7fcd180026d0 tx=0x7fcd18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd18009320 con 0x7fcd1c0f7980 2022-02-02T20:27:10.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd1800f040 con 0x7fcd1c0f7980 2022-02-02T20:27:10.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c108530 con 0x7fcd1c0f7980 2022-02-02T20:27:10.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd180147e0 con 0x7fcd1c0f7980 2022-02-02T20:27:10.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.472+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c108af0 con 0x7fcd1c0f7980 2022-02-02T20:27:10.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.473+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c045ad0 con 0x7fcd1c0f7980 2022-02-02T20:27:10.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.474+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd180077b0 con 0x7fcd1c0f7980 2022-02-02T20:27:10.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.474+0000 7fcd11ffb700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.474+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd18082080 con 0x7fcd1c0f7980 2022-02-02T20:27:10.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.474+0000 7fcd21528700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.474+0000 7fcd21528700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fcd0c005010 tx=0x7fcd0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:10.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.478+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd18053c70 con 0x7fcd1c0f7980 2022-02-02T20:27:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:10 smithi159 ceph-mon[69013]: pgmap v3752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:10.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.657+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd1c108dc0 con 0x7fcd08064dd0 2022-02-02T20:27:10.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.659+0000 7fcd11ffb700 1 -- 172.21.15.96:0/2763877438 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcd1c108dc0 con 0x7fcd08064dd0 2022-02-02T20:27:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 msgr2=0x7fcd08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fcd0c005010 tx=0x7fcd0c009b30).stop 2022-02-02T20:27:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 msgr2=0x7fcd1c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7fcd180026d0 tx=0x7fcd18009de0).stop 2022-02-02T20:27:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 shutdown_connections 2022-02-02T20:27:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd1c0f66e0 0x7fcd1c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 --2- 172.21.15.96:0/2763877438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd1c0f7980 0x7fcd1c1074a0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 >> 172.21.15.96:0/2763877438 conn(0x7fcd1c0f1e40 msgr2=0x7fcd1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 shutdown_connections 2022-02-02T20:27:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.661+0000 7fcd2378c700 1 -- 172.21.15.96:0/2763877438 wait complete. 2022-02-02T20:27:10.672 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:27:10.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/3516815092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f7980 msgr2=0x7fc5d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/3516815092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f7980 0x7fc5d40f7de0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fc5bc004660 tx=0x7fc5bc009b30).stop 2022-02-02T20:27:10.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/3516815092 shutdown_connections 2022-02-02T20:27:10.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/3516815092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f7980 0x7fc5d40f7de0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/3516815092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f66e0 0x7fc5d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/3516815092 >> 172.21.15.96:0/3516815092 conn(0x7fc5d40f1e40 msgr2=0x7fc5d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:10.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/3516815092 shutdown_connections 2022-02-02T20:27:10.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.759+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/3516815092 wait complete. 2022-02-02T20:27:10.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 Processor -- start 2022-02-02T20:27:10.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 -- start start 2022-02-02T20:27:10.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f7980 0x7fc5d4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d41079b0 con 0x7fc5d40f66e0 2022-02-02T20:27:10.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d9cb5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4107af0 con 0x7fc5d40f7980 2022-02-02T20:27:10.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37170/0 (socket says 172.21.15.96:37170) 2022-02-02T20:27:10.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d37fe700 1 -- 172.21.15.96:0/910961405 learned_addr learned my addr 172.21.15.96:0/910961405 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:10.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.760+0000 7fc5d2ffd700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f7980 0x7fc5d4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d37fe700 1 -- 172.21.15.96:0/910961405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f7980 msgr2=0x7fc5d4107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d37fe700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f7980 0x7fc5d4107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d37fe700 1 -- 172.21.15.96:0/910961405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc005040 con 0x7fc5d40f66e0 2022-02-02T20:27:10.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d37fe700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fc5cc00eb70 tx=0x7fc5cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:10.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc0092e0 con 0x7fc5d40f66e0 2022-02-02T20:27:10.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4108490 con 0x7fc5d40f66e0 2022-02-02T20:27:10.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5cc00f040 con 0x7fc5d40f66e0 2022-02-02T20:27:10.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc00c9a0 con 0x7fc5d40f66e0 2022-02-02T20:27:10.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.761+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d4108a50 con 0x7fc5d40f66e0 2022-02-02T20:27:10.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.762+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d4045ad0 con 0x7fc5d40f66e0 2022-02-02T20:27:10.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.762+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc5cc01b030 con 0x7fc5d40f66e0 2022-02-02T20:27:10.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.763+0000 7fc5cbfff700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 0x7fc5c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:10.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.763+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc5cc081c90 con 0x7fc5d40f66e0 2022-02-02T20:27:10.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.763+0000 7fc5d2ffd700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 0x7fc5c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:10.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.763+0000 7fc5d2ffd700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 0x7fc5c0067290 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fc5bc004d80 tx=0x7fc5bc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:10.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.767+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc5cc0537c0 con 0x7fc5d40f66e0 2022-02-02T20:27:10.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.939+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d4108c70 con 0x7fc5c0064dd0 2022-02-02T20:27:10.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.948+0000 7fc5cbfff700 1 -- 172.21.15.96:0/910961405 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fc5d4108c70 con 0x7fc5c0064dd0 2022-02-02T20:27:10.950 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:27:10.951 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 101m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:27:10.951 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 101m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:27:10.951 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 99m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:27:10.951 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 101m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:27:10.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 101m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:27:10.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 101m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:27:10.952 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 99m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:27:10.953 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 99m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:27:10.953 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 101m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:27:10.953 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 99m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:27:10.953 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 101m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:27:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 99m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:27:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 101m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:27:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 99m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:27:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 101m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:27:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 101m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:27:10.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 101m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:27:10.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 99m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:27:10.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 99m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:27:10.956 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (119m) 99m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:27:10.956 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 101m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:27:10.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 msgr2=0x7fc5c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 0x7fc5c0067290 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fc5bc004d80 tx=0x7fc5bc00b040).stop 2022-02-02T20:27:10.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 msgr2=0x7fc5d4106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:10.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fc5cc00eb70 tx=0x7fc5cc00b040).stop 2022-02-02T20:27:10.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 shutdown_connections 2022-02-02T20:27:10.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5c0064dd0 0x7fc5c0067290 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d40f66e0 0x7fc5d4106f10 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 --2- 172.21.15.96:0/910961405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5d40f7980 0x7fc5d4107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 >> 172.21.15.96:0/910961405 conn(0x7fc5d40f1e40 msgr2=0x7fc5d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:10.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 shutdown_connections 2022-02-02T20:27:10.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:10.950+0000 7fc5d9cb5700 1 -- 172.21.15.96:0/910961405 wait complete. 2022-02-02T20:27:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 -- 172.21.15.96:0/3761276973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f55c0 msgr2=0x7f872c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 --2- 172.21.15.96:0/3761276973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f55c0 0x7f872c0f59e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f87240099e0 tx=0x7f8724004d10).stop 2022-02-02T20:27:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 -- 172.21.15.96:0/3761276973 shutdown_connections 2022-02-02T20:27:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 --2- 172.21.15.96:0/3761276973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f6860 0x7f872c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 --2- 172.21.15.96:0/3761276973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f55c0 0x7f872c0f59e0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 -- 172.21.15.96:0/3761276973 >> 172.21.15.96:0/3761276973 conn(0x7f872c0f0d40 msgr2=0x7f872c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 -- 172.21.15.96:0/3761276973 shutdown_connections 2022-02-02T20:27:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.047+0000 7f8732b84700 1 -- 172.21.15.96:0/3761276973 wait complete. 2022-02-02T20:27:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 Processor -- start 2022-02-02T20:27:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 -- start start 2022-02-02T20:27:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f55c0 0x7f872c105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c106a00 con 0x7f872c0f6860 2022-02-02T20:27:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8732b84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c106b40 con 0x7f872c0f55c0 2022-02-02T20:27:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37182/0 (socket says 172.21.15.96:37182) 2022-02-02T20:27:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 -- 172.21.15.96:0/2155175327 learned_addr learned my addr 172.21.15.96:0/2155175327 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f8730920700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f55c0 0x7f872c105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 -- 172.21.15.96:0/2155175327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f55c0 msgr2=0x7f872c105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f55c0 0x7f872c105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.048+0000 7f872bfff700 1 -- 172.21.15.96:0/2155175327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009640 con 0x7f872c0f6860 2022-02-02T20:27:11.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f872bfff700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f871400c790 tx=0x7f8714007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:11.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8714002590 con 0x7f872c0f6860 2022-02-02T20:27:11.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8714002ba0 con 0x7f872c0f6860 2022-02-02T20:27:11.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c1074e0 con 0x7f872c0f6860 2022-02-02T20:27:11.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8714013d90 con 0x7f872c0f6860 2022-02-02T20:27:11.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.049+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c107a20 con 0x7f872c0f6860 2022-02-02T20:27:11.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.050+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c045ad0 con 0x7f872c0f6860 2022-02-02T20:27:11.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.050+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f871401a060 con 0x7f872c0f6860 2022-02-02T20:27:11.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.051+0000 7f87297fa700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.051+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8714081ce0 con 0x7f872c0f6860 2022-02-02T20:27:11.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.051+0000 7f8730920700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.051+0000 7f8730920700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f872400b730 tx=0x7f8724004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:11.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.055+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8714053810 con 0x7f872c0f6860 2022-02-02T20:27:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.289+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f872c108060 con 0x7f872c0f6860 2022-02-02T20:27:11.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.289+0000 7f87297fa700 1 -- 172.21.15.96:0/2155175327 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f87140182e0 con 0x7f872c0f6860 2022-02-02T20:27:11.291 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:27:11.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:27:11.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:27:11.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:11.292 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:27:11.292 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:27:11.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:11.293 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:27:11.293 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:27:11.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:11.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:27:11.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:27:11.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:11.294 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:27:11.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:27:11.295 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:27:11.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:27:11.295 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:27:11.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 msgr2=0x7f8718067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f872400b730 tx=0x7f8724004d10).stop 2022-02-02T20:27:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 msgr2=0x7f872c106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f871400c790 tx=0x7f8714007d70).stop 2022-02-02T20:27:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 shutdown_connections 2022-02-02T20:27:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8718064dd0 0x7f8718067290 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f872c0f55c0 0x7f872c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 --2- 172.21.15.96:0/2155175327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f872c0f6860 0x7f872c106450 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 >> 172.21.15.96:0/2155175327 conn(0x7f872c0f0d40 msgr2=0x7f872c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 shutdown_connections 2022-02-02T20:27:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.291+0000 7f8732b84700 1 -- 172.21.15.96:0/2155175327 wait complete. 2022-02-02T20:27:11.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 -- 172.21.15.96:0/2269472947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f6ff0 msgr2=0x7f761c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 --2- 172.21.15.96:0/2269472947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f6ff0 0x7f761c0f7a20 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f760c004660 tx=0x7f760c009b30).stop 2022-02-02T20:27:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 -- 172.21.15.96:0/2269472947 shutdown_connections 2022-02-02T20:27:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 --2- 172.21.15.96:0/2269472947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f6ff0 0x7f761c0f7a20 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 --2- 172.21.15.96:0/2269472947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f66e0 0x7f761c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 -- 172.21.15.96:0/2269472947 >> 172.21.15.96:0/2269472947 conn(0x7f761c0f1f00 msgr2=0x7f761c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 -- 172.21.15.96:0/2269472947 shutdown_connections 2022-02-02T20:27:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.390+0000 7f7621522700 1 -- 172.21.15.96:0/2269472947 wait complete. 2022-02-02T20:27:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 Processor -- start 2022-02-02T20:27:11.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 -- start start 2022-02-02T20:27:11.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f6ff0 0x7f761c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c06a380 con 0x7f761c0f66e0 2022-02-02T20:27:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f7621522700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c06a4c0 con 0x7f761c0f6ff0 2022-02-02T20:27:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37188/0 (socket says 172.21.15.96:37188) 2022-02-02T20:27:11.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 -- 172.21.15.96:0/3859489048 learned_addr learned my addr 172.21.15.96:0/3859489048 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:11.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761a7fc700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f6ff0 0x7f761c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 -- 172.21.15.96:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f6ff0 msgr2=0x7f761c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f6ff0 0x7f761c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 -- 172.21.15.96:0/3859489048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c005040 con 0x7f761c0f66e0 2022-02-02T20:27:11.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.391+0000 7f761affd700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f76100026d0 tx=0x7f7610009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:11.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.392+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76100079c0 con 0x7f761c0f66e0 2022-02-02T20:27:11.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.392+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f761000f040 con 0x7f761c0f66e0 2022-02-02T20:27:11.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.392+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c06a7a0 con 0x7f761c0f66e0 2022-02-02T20:27:11.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.392+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76100148b0 con 0x7f761c0f66e0 2022-02-02T20:27:11.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.392+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c10efa0 con 0x7f761c0f66e0 2022-02-02T20:27:11.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.393+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c045ad0 con 0x7f761c0f66e0 2022-02-02T20:27:11.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.393+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7610007b20 con 0x7f761c0f66e0 2022-02-02T20:27:11.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.393+0000 7f76037fe700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 0x7f7604067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:11.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.393+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f76100818b0 con 0x7f761c0f66e0 2022-02-02T20:27:11.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.393+0000 7f761a7fc700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 0x7f7604067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:11.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.394+0000 7f761a7fc700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 0x7f7604067290 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f760c004630 tx=0x7f760c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:11.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.397+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f761004f9b0 con 0x7f761c0f66e0 2022-02-02T20:27:11.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.597+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f761c0fef70 con 0x7f761c0f66e0 2022-02-02T20:27:11.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.597+0000 7f76037fe700 1 -- 172.21.15.96:0/3859489048 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7610052fd0 con 0x7f761c0f66e0 2022-02-02T20:27:11.600 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:27:11.600 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:27:11.600 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:27:11.600 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:27:11.601 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:11.601 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:27:11.601 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:27:11.601 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:27:11.601 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:27:11.602 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:27:11.602 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:27:11.602 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:27:11.602 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:27:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:27:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:27:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:27:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:27:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:27:11.604 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:27:11.604 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:27:11.604 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:27:11.604 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:27:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:27:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:27:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:27:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:27:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:27:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:27:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:27:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:27:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:27:11.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:27:11.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:11.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:11.607 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:27:11.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:11.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:11.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:11.608 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:11.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 msgr2=0x7f7604067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 0x7f7604067290 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f760c004630 tx=0x7f760c009b30).stop 2022-02-02T20:27:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 msgr2=0x7f761c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f76100026d0 tx=0x7f7610009de0).stop 2022-02-02T20:27:11.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 shutdown_connections 2022-02-02T20:27:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7604064dd0 0x7f7604067290 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f761c0f66e0 0x7f761c06b9a0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 --2- 172.21.15.96:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c0f6ff0 0x7f761c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:11.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 >> 172.21.15.96:0/3859489048 conn(0x7f761c0f1f00 msgr2=0x7f761c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 shutdown_connections 2022-02-02T20:27:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:11.599+0000 7f7621522700 1 -- 172.21.15.96:0/3859489048 wait complete. 2022-02-02T20:27:11.612 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:27:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:12 smithi159 ceph-mon[69013]: from='client.37958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:12 smithi159 ceph-mon[69013]: from='client.37962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:12.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:12 smithi159 ceph-mon[69013]: pgmap v3753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2155175327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:27:12.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3859489048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:12 smithi096 ceph-mon[101353]: from='client.37958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:12 smithi096 ceph-mon[101353]: from='client.37962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:12 smithi096 ceph-mon[101353]: pgmap v3753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2155175327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:27:12.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3859489048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:27:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:14 smithi159 ceph-mon[69013]: pgmap v3754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:14 smithi096 ceph-mon[101353]: pgmap v3754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:16 smithi159 ceph-mon[69013]: pgmap v3755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:16 smithi096 ceph-mon[101353]: pgmap v3755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:17 smithi159 ceph-mon[69013]: pgmap v3756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:17 smithi096 ceph-mon[101353]: pgmap v3756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:20 smithi159 ceph-mon[69013]: pgmap v3757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:20.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:20 smithi096 ceph-mon[101353]: pgmap v3757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:22 smithi159 ceph-mon[69013]: pgmap v3758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:22 smithi096 ceph-mon[101353]: pgmap v3758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:24 smithi159 ceph-mon[69013]: pgmap v3759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:24 smithi096 ceph-mon[101353]: pgmap v3759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:26 smithi159 ceph-mon[69013]: pgmap v3760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:26 smithi096 ceph-mon[101353]: pgmap v3760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:27 smithi159 ceph-mon[69013]: pgmap v3761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:27:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:27:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:27 smithi096 ceph-mon[101353]: pgmap v3761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:27:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:27:30.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:30 smithi159 ceph-mon[69013]: pgmap v3762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:30 smithi096 ceph-mon[101353]: pgmap v3762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:32 smithi159 ceph-mon[69013]: pgmap v3763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:32 smithi096 ceph-mon[101353]: pgmap v3763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:34 smithi159 ceph-mon[69013]: pgmap v3764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:34 smithi096 ceph-mon[101353]: pgmap v3764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:36 smithi159 ceph-mon[69013]: pgmap v3765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:36 smithi096 ceph-mon[101353]: pgmap v3765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:37 smithi159 ceph-mon[69013]: pgmap v3766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:37 smithi096 ceph-mon[101353]: pgmap v3766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:40.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:40 smithi159 ceph-mon[69013]: pgmap v3767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:40 smithi096 ceph-mon[101353]: pgmap v3767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:41.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 -- 172.21.15.96:0/1970155515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 msgr2=0x7f61280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:41.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 --2- 172.21.15.96:0/1970155515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f61280f6b00 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f6118004660 tx=0x7f6118009b30).stop 2022-02-02T20:27:41.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 -- 172.21.15.96:0/1970155515 shutdown_connections 2022-02-02T20:27:41.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 --2- 172.21.15.96:0/1970155515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 0x7f61280f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 --2- 172.21.15.96:0/1970155515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f61280f6b00 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.708+0000 7f612e540700 1 -- 172.21.15.96:0/1970155515 >> 172.21.15.96:0/1970155515 conn(0x7f61280f1e40 msgr2=0x7f61280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:41.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.709+0000 7f612e540700 1 -- 172.21.15.96:0/1970155515 shutdown_connections 2022-02-02T20:27:41.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.709+0000 7f612e540700 1 -- 172.21.15.96:0/1970155515 wait complete. 2022-02-02T20:27:41.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.709+0000 7f612e540700 1 Processor -- start 2022-02-02T20:27:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f612e540700 1 -- start start 2022-02-02T20:27:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f612e540700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f612e540700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 0x7f6128069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f612e540700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612806a380 con 0x7f61280f66e0 2022-02-02T20:27:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f612e540700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612806a4c0 con 0x7f61280f7980 2022-02-02T20:27:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37210/0 (socket says 172.21.15.96:37210) 2022-02-02T20:27:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 -- 172.21.15.96:0/755520798 learned_addr learned my addr 172.21.15.96:0/755520798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f61277fe700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 0x7f6128069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:41.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 -- 172.21.15.96:0/755520798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 msgr2=0x7f6128069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:41.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 0x7f6128069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 -- 172.21.15.96:0/755520798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005040 con 0x7f61280f66e0 2022-02-02T20:27:41.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6127fff700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f6118013a70 tx=0x7f6118009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:41.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.710+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6118018070 con 0x7f61280f66e0 2022-02-02T20:27:41.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.711+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612806a740 con 0x7f61280f66e0 2022-02-02T20:27:41.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.711+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61180097d0 con 0x7f61280f66e0 2022-02-02T20:27:41.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.711+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612806aca0 con 0x7f61280f66e0 2022-02-02T20:27:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.711+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611801de80 con 0x7f61280f66e0 2022-02-02T20:27:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.712+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128045ad0 con 0x7f61280f66e0 2022-02-02T20:27:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.712+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6118007ba0 con 0x7f61280f66e0 2022-02-02T20:27:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.713+0000 7f6124ff9700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 0x7f6110067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.713+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6118083660 con 0x7f61280f66e0 2022-02-02T20:27:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.713+0000 7f61277fe700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 0x7f6110067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.713+0000 7f61277fe700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 0x7f6110067290 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f611c004e20 tx=0x7f611c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.717+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6118051820 con 0x7f61280f66e0 2022-02-02T20:27:41.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.895+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61280fefb0 con 0x7f6110064dd0 2022-02-02T20:27:41.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.897+0000 7f6124ff9700 1 -- 172.21.15.96:0/755520798 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f61280fefb0 con 0x7f6110064dd0 2022-02-02T20:27:41.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 msgr2=0x7f6110067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 0x7f6110067290 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f611c004e20 tx=0x7f611c00b040).stop 2022-02-02T20:27:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 msgr2=0x7f612806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f6118013a70 tx=0x7f6118009b30).stop 2022-02-02T20:27:41.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 shutdown_connections 2022-02-02T20:27:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064dd0 0x7f6110067290 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66e0 0x7f612806b9a0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 --2- 172.21.15.96:0/755520798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f7980 0x7f6128069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.898+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 >> 172.21.15.96:0/755520798 conn(0x7f61280f1e40 msgr2=0x7f61280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:41.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.899+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 shutdown_connections 2022-02-02T20:27:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.899+0000 7f612e540700 1 -- 172.21.15.96:0/755520798 wait complete. 2022-02-02T20:27:41.911 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:27:41.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 -- 172.21.15.96:0/852564138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 msgr2=0x7f61480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:41.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 --2- 172.21.15.96:0/852564138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f61480f6950 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f613c004660 tx=0x7f613c009b30).stop 2022-02-02T20:27:41.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 -- 172.21.15.96:0/852564138 shutdown_connections 2022-02-02T20:27:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 --2- 172.21.15.96:0/852564138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 0x7f61480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 --2- 172.21.15.96:0/852564138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f61480f6950 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 -- 172.21.15.96:0/852564138 >> 172.21.15.96:0/852564138 conn(0x7f61480f1c90 msgr2=0x7f61480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 -- 172.21.15.96:0/852564138 shutdown_connections 2022-02-02T20:27:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.996+0000 7f614cfb1700 1 -- 172.21.15.96:0/852564138 wait complete. 2022-02-02T20:27:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 Processor -- start 2022-02-02T20:27:42.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 -- start start 2022-02-02T20:27:42.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 0x7f6148069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614806a380 con 0x7f61480f6530 2022-02-02T20:27:42.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f614cfb1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614806a4c0 con 0x7f61480f77d0 2022-02-02T20:27:42.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f61477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f61477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37218/0 (socket says 172.21.15.96:37218) 2022-02-02T20:27:42.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f61477fe700 1 -- 172.21.15.96:0/2974206604 learned_addr learned my addr 172.21.15.96:0/2974206604 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:42.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.997+0000 7f6146ffd700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 0x7f6148069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f61477fe700 1 -- 172.21.15.96:0/2974206604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 msgr2=0x7f6148069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f61477fe700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 0x7f6148069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f61477fe700 1 -- 172.21.15.96:0/2974206604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c005040 con 0x7f61480f6530 2022-02-02T20:27:42.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f61477fe700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f613c013a70 tx=0x7f613c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c018070 con 0x7f61480f6530 2022-02-02T20:27:42.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f613c0097d0 con 0x7f61480f6530 2022-02-02T20:27:42.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614806a740 con 0x7f61480f6530 2022-02-02T20:27:42.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c01de80 con 0x7f61480f6530 2022-02-02T20:27:42.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.998+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614806aca0 con 0x7f61480f6530 2022-02-02T20:27:42.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.999+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6148045ad0 con 0x7f61480f6530 2022-02-02T20:27:42.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.999+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f613c01c4e0 con 0x7f61480f6530 2022-02-02T20:27:42.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:41.999+0000 7f612ffff700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 0x7f61300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.000+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f613c083670 con 0x7f61480f6530 2022-02-02T20:27:42.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.000+0000 7f6146ffd700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 0x7f61300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.000+0000 7f6146ffd700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 0x7f61300672e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6138004e20 tx=0x7f613800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.004+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f613c051770 con 0x7f61480f6530 2022-02-02T20:27:42.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.177+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61480fee30 con 0x7f6130064e20 2022-02-02T20:27:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.191+0000 7f612ffff700 1 -- 172.21.15.96:0/2974206604 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f61480fee30 con 0x7f6130064e20 2022-02-02T20:27:42.194 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:27:42.195 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 101m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:27:42.195 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 101m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:27:42.195 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 100m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:27:42.195 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 101m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:27:42.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 101m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:27:42.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 101m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:27:42.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 100m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:27:42.196 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 100m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:27:42.196 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 101m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:27:42.197 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 100m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:27:42.197 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 101m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:27:42.197 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 100m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:27:42.197 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 101m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:27:42.197 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 100m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:27:42.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 101m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:27:42.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 101m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:27:42.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 101m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:27:42.198 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 100m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:27:42.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 100m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:27:42.199 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 100m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:27:42.199 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 101m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:27:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 msgr2=0x7f61300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 0x7f61300672e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6138004e20 tx=0x7f613800b040).stop 2022-02-02T20:27:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 msgr2=0x7f614806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f613c013a70 tx=0x7f613c009b30).stop 2022-02-02T20:27:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 shutdown_connections 2022-02-02T20:27:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6130064e20 0x7f61300672e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61480f6530 0x7f614806b9a0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 --2- 172.21.15.96:0/2974206604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61480f77d0 0x7f6148069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 >> 172.21.15.96:0/2974206604 conn(0x7f61480f1c90 msgr2=0x7f61480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 shutdown_connections 2022-02-02T20:27:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.194+0000 7f614cfb1700 1 -- 172.21.15.96:0/2974206604 wait complete. 2022-02-02T20:27:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 -- 172.21.15.96:0/3374896071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 msgr2=0x7f9a1c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 --2- 172.21.15.96:0/3374896071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c0f6cc0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f9a18004660 tx=0x7f9a18009b30).stop 2022-02-02T20:27:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 -- 172.21.15.96:0/3374896071 shutdown_connections 2022-02-02T20:27:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 --2- 172.21.15.96:0/3374896071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c0f6cc0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 --2- 172.21.15.96:0/3374896071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 -- 172.21.15.96:0/3374896071 >> 172.21.15.96:0/3374896071 conn(0x7f9a1c0f0d40 msgr2=0x7f9a1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 -- 172.21.15.96:0/3374896071 shutdown_connections 2022-02-02T20:27:42.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:42 smithi096 ceph-mon[101353]: pgmap v3768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:42.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.291+0000 7f9a24585700 1 -- 172.21.15.96:0/3374896071 wait complete. 2022-02-02T20:27:42.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 Processor -- start 2022-02-02T20:27:42.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 -- start start 2022-02-02T20:27:42.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c106920 con 0x7f9a1c0f6860 2022-02-02T20:27:42.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a24585700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c107130 con 0x7f9a1c0f55c0 2022-02-02T20:27:42.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a21b20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a21b20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37230/0 (socket says 172.21.15.96:37230) 2022-02-02T20:27:42.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a21b20700 1 -- 172.21.15.96:0/76112992 learned_addr learned my addr 172.21.15.96:0/76112992 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:42.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.292+0000 7f9a22321700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a21b20700 1 -- 172.21.15.96:0/76112992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 msgr2=0x7f9a1c105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a21b20700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a21b20700 1 -- 172.21.15.96:0/76112992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18005040 con 0x7f9a1c0f6860 2022-02-02T20:27:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a22321700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:27:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a21b20700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f9a18000c00 tx=0x7f9a1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1801b070 con 0x7f9a1c0f6860 2022-02-02T20:27:42.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c107350 con 0x7f9a1c0f6860 2022-02-02T20:27:42.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a18007e70 con 0x7f9a1c0f6860 2022-02-02T20:27:42.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a18014d90 con 0x7f9a1c0f6860 2022-02-02T20:27:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.293+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c1078b0 con 0x7f9a1c0f6860 2022-02-02T20:27:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.294+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c0f49b0 con 0x7f9a1c0f6860 2022-02-02T20:27:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.294+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a18027070 con 0x7f9a1c0f6860 2022-02-02T20:27:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.295+0000 7f9a12ffd700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 0x7f9a08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.295+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a180847e0 con 0x7f9a1c0f6860 2022-02-02T20:27:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.295+0000 7f9a22321700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 0x7f9a08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.295+0000 7f9a22321700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 0x7f9a08067290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f9a1c105ba0 tx=0x7f9a0c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.299+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a180528e0 con 0x7f9a1c0f6860 2022-02-02T20:27:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:42 smithi159 ceph-mon[69013]: pgmap v3768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:42.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.529+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a1c0ff790 con 0x7f9a1c0f6860 2022-02-02T20:27:42.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.529+0000 7f9a12ffd700 1 -- 172.21.15.96:0/76112992 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9a180252e0 con 0x7f9a1c0f6860 2022-02-02T20:27:42.532 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:27:42.533 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:27:42.533 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:27:42.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:42.533 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:27:42.534 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:27:42.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:42.534 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:27:42.534 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:27:42.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:42.535 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:27:42.535 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:27:42.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:27:42.536 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:27:42.536 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:27:42.536 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:27:42.536 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:27:42.536 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:27:42.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 msgr2=0x7f9a08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 0x7f9a08067290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f9a1c105ba0 tx=0x7f9a0c00b040).stop 2022-02-02T20:27:42.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 msgr2=0x7f9a1c106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f9a18000c00 tx=0x7f9a1800b040).stop 2022-02-02T20:27:42.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 shutdown_connections 2022-02-02T20:27:42.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064dd0 0x7f9a08067290 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f55c0 0x7f9a1c105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 --2- 172.21.15.96:0/76112992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6860 0x7f9a1c106320 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.531+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 >> 172.21.15.96:0/76112992 conn(0x7f9a1c0f0d40 msgr2=0x7f9a1c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.532+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 shutdown_connections 2022-02-02T20:27:42.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.532+0000 7f9a24585700 1 -- 172.21.15.96:0/76112992 wait complete. 2022-02-02T20:27:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 -- 172.21.15.96:0/3996110867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 msgr2=0x7f1a100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 --2- 172.21.15.96:0/3996110867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a100f59e0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f1a00004660 tx=0x7f1a00009b30).stop 2022-02-02T20:27:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 -- 172.21.15.96:0/3996110867 shutdown_connections 2022-02-02T20:27:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 --2- 172.21.15.96:0/3996110867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 0x7f1a100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 --2- 172.21.15.96:0/3996110867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a100f59e0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 -- 172.21.15.96:0/3996110867 >> 172.21.15.96:0/3996110867 conn(0x7f1a100f0d40 msgr2=0x7f1a100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 -- 172.21.15.96:0/3996110867 shutdown_connections 2022-02-02T20:27:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.630+0000 7f1a14876700 1 -- 172.21.15.96:0/3996110867 wait complete. 2022-02-02T20:27:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 Processor -- start 2022-02-02T20:27:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 -- start start 2022-02-02T20:27:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 0x7f1a1010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100603e0 con 0x7f1a100f55c0 2022-02-02T20:27:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a14876700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10060520 con 0x7f1a100f6860 2022-02-02T20:27:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37236/0 (socket says 172.21.15.96:37236) 2022-02-02T20:27:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 -- 172.21.15.96:0/3600612845 learned_addr learned my addr 172.21.15.96:0/3600612845 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:27:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0dd9b700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 0x7f1a1010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 -- 172.21.15.96:0/3600612845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 msgr2=0x7f1a1010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 0x7f1a1010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 -- 172.21.15.96:0/3600612845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00005040 con 0x7f1a100f55c0 2022-02-02T20:27:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.631+0000 7f1a0e59c700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7f1a00004f60 tx=0x7f1a00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.632+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a00018070 con 0x7f1a100f55c0 2022-02-02T20:27:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.632+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1a00009770 con 0x7f1a100f55c0 2022-02-02T20:27:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.632+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1010c6c0 con 0x7f1a100f55c0 2022-02-02T20:27:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.632+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0001c3c0 con 0x7f1a100f55c0 2022-02-02T20:27:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.632+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1010cc20 con 0x7f1a100f55c0 2022-02-02T20:27:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.633+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a10045ad0 con 0x7f1a100f55c0 2022-02-02T20:27:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.633+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1a0001d420 con 0x7f1a100f55c0 2022-02-02T20:27:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.633+0000 7f19feffd700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 0x7f19f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:27:42.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.633+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1a00083840 con 0x7f1a100f55c0 2022-02-02T20:27:42.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.633+0000 7f1a0dd9b700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 0x7f19f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:27:42.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.634+0000 7f1a0dd9b700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 0x7f19f8067290 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1a04007fd0 tx=0x7f1a04009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:27:42.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.638+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1a00051a00 con 0x7f1a100f55c0 2022-02-02T20:27:42.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.839+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1a100fde20 con 0x7f1a100f55c0 2022-02-02T20:27:42.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.840+0000 7f19feffd700 1 -- 172.21.15.96:0/3600612845 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1a00055020 con 0x7f1a100f55c0 2022-02-02T20:27:42.843 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:27:42.843 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:27:42.844 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:27:42.844 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:27:42.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:42.845 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:27:42.845 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:27:42.845 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:27:42.845 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:27:42.846 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:27:42.846 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:27:42.846 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:27:42.846 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:27:42.847 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:27:42.847 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:27:42.847 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:27:42.847 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:27:42.848 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:27:42.848 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:27:42.848 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:27:42.848 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:27:42.848 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:27:42.849 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:27:42.849 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:27:42.849 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:27:42.849 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:27:42.849 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:27:42.850 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:27:42.850 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:27:42.850 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:27:42.850 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:27:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:27:42.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:42.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:27:42.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:27:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:27:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 msgr2=0x7f19f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 0x7f19f8067290 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1a04007fd0 tx=0x7f1a04009040).stop 2022-02-02T20:27:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 msgr2=0x7f1a10109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:27:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7f1a00004f60 tx=0x7f1a00009b30).stop 2022-02-02T20:27:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 shutdown_connections 2022-02-02T20:27:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f8064dd0 0x7f19f8067290 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a100f55c0 0x7f1a10109c70 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 --2- 172.21.15.96:0/3600612845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a100f6860 0x7f1a1010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:27:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 >> 172.21.15.96:0/3600612845 conn(0x7f1a100f0d40 msgr2=0x7f1a100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:27:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 shutdown_connections 2022-02-02T20:27:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:27:42.842+0000 7f1a14876700 1 -- 172.21.15.96:0/3600612845 wait complete. 2022-02-02T20:27:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:27:43.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:43 smithi159 ceph-mon[69013]: from='client.37974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:43.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:43 smithi159 ceph-mon[69013]: from='client.37978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:43.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/76112992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:27:43.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3600612845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:43 smithi096 ceph-mon[101353]: from='client.37974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:43 smithi096 ceph-mon[101353]: from='client.37978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:27:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/76112992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:27:43.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3600612845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:27:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:44 smithi159 ceph-mon[69013]: pgmap v3769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:44 smithi096 ceph-mon[101353]: pgmap v3769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:46 smithi159 ceph-mon[69013]: pgmap v3770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:46 smithi096 ceph-mon[101353]: pgmap v3770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:47 smithi159 ceph-mon[69013]: pgmap v3771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:47 smithi096 ceph-mon[101353]: pgmap v3771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:50 smithi159 ceph-mon[69013]: pgmap v3772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:50 smithi096 ceph-mon[101353]: pgmap v3772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:52 smithi159 ceph-mon[69013]: pgmap v3773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:52 smithi096 ceph-mon[101353]: pgmap v3773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:54 smithi159 ceph-mon[69013]: pgmap v3774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:54 smithi096 ceph-mon[101353]: pgmap v3774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:56 smithi159 ceph-mon[69013]: pgmap v3775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:56 smithi096 ceph-mon[101353]: pgmap v3775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:27:57 smithi159 ceph-mon[69013]: pgmap v3776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:27:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:27:57 smithi096 ceph-mon[101353]: pgmap v3776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:00 smithi159 ceph-mon[69013]: pgmap v3777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:00 smithi096 ceph-mon[101353]: pgmap v3777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:02 smithi159 ceph-mon[69013]: pgmap v3778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:02 smithi096 ceph-mon[101353]: pgmap v3778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:04 smithi159 ceph-mon[69013]: pgmap v3779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:04 smithi096 ceph-mon[101353]: pgmap v3779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:06 smithi159 ceph-mon[69013]: pgmap v3780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:06.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:06 smithi096 ceph-mon[101353]: pgmap v3780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:07 smithi159 ceph-mon[69013]: pgmap v3781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:07 smithi096 ceph-mon[101353]: pgmap v3781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:10 smithi159 ceph-mon[69013]: pgmap v3782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:10 smithi096 ceph-mon[101353]: pgmap v3782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:12 smithi159 ceph-mon[69013]: pgmap v3783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:12 smithi096 ceph-mon[101353]: pgmap v3783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:12.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 -- 172.21.15.96:0/1743400578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 msgr2=0x7f0cf00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:12.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1743400578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf00f7a20 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f0ce4004660 tx=0x7f0ce4009b30).stop 2022-02-02T20:28:12.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 -- 172.21.15.96:0/1743400578 shutdown_connections 2022-02-02T20:28:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1743400578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf00f7a20 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:12.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1743400578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 0x7f0cf00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 -- 172.21.15.96:0/1743400578 >> 172.21.15.96:0/1743400578 conn(0x7f0cf00f1f00 msgr2=0x7f0cf00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:12.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 -- 172.21.15.96:0/1743400578 shutdown_connections 2022-02-02T20:28:12.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.953+0000 7f0cf7608700 1 -- 172.21.15.96:0/1743400578 wait complete. 2022-02-02T20:28:12.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 Processor -- start 2022-02-02T20:28:12.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 -- start start 2022-02-02T20:28:12.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 0x7f0cf0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:12.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:12.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0107a10 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf7608700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0107b50 con 0x7f0cf00f66e0 2022-02-02T20:28:12.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf4ba3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:12.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf4ba3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37256/0 (socket says 172.21.15.96:37256) 2022-02-02T20:28:12.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf4ba3700 1 -- 172.21.15.96:0/1977972520 learned_addr learned my addr 172.21.15.96:0/1977972520 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:12.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.954+0000 7f0cf53a4700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 0x7f0cf0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:12.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf4ba3700 1 -- 172.21.15.96:0/1977972520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 msgr2=0x7f0cf0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:12.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf4ba3700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 0x7f0cf0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:12.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf4ba3700 1 -- 172.21.15.96:0/1977972520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4005040 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf4ba3700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f0ce4009990 tx=0x7f0ce4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:12.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce4018070 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf0108490 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ce4007ba0 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce401c3c0 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.955+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf01089f0 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.956+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0045ad0 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.957+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ce401d420 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.957+0000 7f0ce1ffb700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 0x7f0cdc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:12.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.957+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ce40836b0 con 0x7f0cf00f6ff0 2022-02-02T20:28:12.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.957+0000 7f0cf53a4700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 0x7f0cdc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:12.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.958+0000 7f0cf53a4700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 0x7f0cdc067290 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0cec004c40 tx=0x7f0cec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:12.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:12.961+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ce4055240 con 0x7f0cf00f6ff0 2022-02-02T20:28:13.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.141+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cf00fefe0 con 0x7f0cdc064dd0 2022-02-02T20:28:13.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.142+0000 7f0ce1ffb700 1 -- 172.21.15.96:0/1977972520 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0cf00fefe0 con 0x7f0cdc064dd0 2022-02-02T20:28:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 msgr2=0x7f0cdc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 0x7f0cdc067290 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0cec004c40 tx=0x7f0cec00b040).stop 2022-02-02T20:28:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 msgr2=0x7f0cf0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f0ce4009990 tx=0x7f0ce4009b30).stop 2022-02-02T20:28:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 shutdown_connections 2022-02-02T20:28:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cdc064dd0 0x7f0cdc067290 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf00f66e0 0x7f0cf0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 --2- 172.21.15.96:0/1977972520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf00f6ff0 0x7f0cf0107460 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 >> 172.21.15.96:0/1977972520 conn(0x7f0cf00f1f00 msgr2=0x7f0cf00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 shutdown_connections 2022-02-02T20:28:13.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.144+0000 7f0cf7608700 1 -- 172.21.15.96:0/1977972520 wait complete. 2022-02-02T20:28:13.156 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:28:13.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2318487443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f5430 msgr2=0x7fd8f40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2318487443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f5430 0x7fd8f40f5850 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7fd8e4004660 tx=0x7fd8e4009b30).stop 2022-02-02T20:28:13.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2318487443 shutdown_connections 2022-02-02T20:28:13.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2318487443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f66d0 0x7fd8f40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:28:13.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2318487443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f5430 0x7fd8f40f5850 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2318487443 >> 172.21.15.96:0/2318487443 conn(0x7fd8f40f0b90 msgr2=0x7fd8f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2318487443 shutdown_connections 2022-02-02T20:28:13.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2318487443 wait complete. 2022-02-02T20:28:13.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.243+0000 7fd8f8dbe700 1 Processor -- start 2022-02-02T20:28:13.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f8dbe700 1 -- start start 2022-02-02T20:28:13.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f8dbe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f5430 0x7fd8f4108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f8dbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f8dbe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4109ac0 con 0x7fd8f40f66d0 2022-02-02T20:28:13.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f8dbe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f410a370 con 0x7fd8f40f5430 2022-02-02T20:28:13.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37266/0 (socket says 172.21.15.96:37266) 2022-02-02T20:28:13.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 -- 172.21.15.96:0/2375842280 learned_addr learned my addr 172.21.15.96:0/2375842280 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:13.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f37fe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f5430 0x7fd8f4108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 -- 172.21.15.96:0/2375842280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f5430 msgr2=0x7fd8f4108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f5430 0x7fd8f4108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 -- 172.21.15.96:0/2375842280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4005040 con 0x7fd8f40f66d0 2022-02-02T20:28:13.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.244+0000 7fd8f2ffd700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fd8dc00b410 tx=0x7fd8dc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.245+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc0125f0 con 0x7fd8f40f66d0 2022-02-02T20:28:13.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.245+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f410a650 con 0x7fd8f40f66d0 2022-02-02T20:28:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.245+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f410ac10 con 0x7fd8f40f66d0 2022-02-02T20:28:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.245+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8dc00be30 con 0x7fd8f40f66d0 2022-02-02T20:28:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.245+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc002a70 con 0x7fd8f40f66d0 2022-02-02T20:28:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.246+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8004fa0 con 0x7fd8f40f66d0 2022-02-02T20:28:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.246+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8dc00f030 con 0x7fd8f40f66d0 2022-02-02T20:28:13.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.246+0000 7fd8ebfff700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 0x7fd8e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.247+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8dc081cb0 con 0x7fd8f40f66d0 2022-02-02T20:28:13.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.247+0000 7fd8f37fe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 0x7fd8e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.247+0000 7fd8f37fe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 0x7fd8e00672e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fd8e4004630 tx=0x7fd8e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.251+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8dc0537e0 con 0x7fd8f40f66d0 2022-02-02T20:28:13.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.424+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d8000bc0 con 0x7fd8e0064e20 2022-02-02T20:28:13.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.434+0000 7fd8ebfff700 1 -- 172.21.15.96:0/2375842280 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd8d8000bc0 con 0x7fd8e0064e20 2022-02-02T20:28:13.437 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:28:13.437 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 102m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:28:13.437 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 102m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:28:13.437 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 100m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:28:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 102m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:28:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 102m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:28:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 102m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:28:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 100m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:28:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 100m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:28:13.439 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 102m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:28:13.439 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 100m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:28:13.439 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 102m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:28:13.440 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 100m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:28:13.440 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 102m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:28:13.440 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 100m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:28:13.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 102m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:28:13.441 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 102m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:28:13.441 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 102m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:28:13.441 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 100m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:28:13.441 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 100m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:28:13.442 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 100m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:28:13.442 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 102m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:28:13.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 msgr2=0x7fd8e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 0x7fd8e00672e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fd8e4004630 tx=0x7fd8e4009b30).stop 2022-02-02T20:28:13.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 msgr2=0x7fd8f4109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fd8dc00b410 tx=0x7fd8dc006ef0).stop 2022-02-02T20:28:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 shutdown_connections 2022-02-02T20:28:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8e0064e20 0x7fd8e00672e0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f40f5430 0x7fd8f4108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 --2- 172.21.15.96:0/2375842280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8f40f66d0 0x7fd8f4109480 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.435+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 >> 172.21.15.96:0/2375842280 conn(0x7fd8f40f0b90 msgr2=0x7fd8f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.436+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 shutdown_connections 2022-02-02T20:28:13.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.436+0000 7fd8f8dbe700 1 -- 172.21.15.96:0/2375842280 wait complete. 2022-02-02T20:28:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 -- 172.21.15.96:0/4121761348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f4d60 msgr2=0x7fc4700f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 --2- 172.21.15.96:0/4121761348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f4d60 0x7fc4700f5180 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7fc464004660 tx=0x7fc464009b30).stop 2022-02-02T20:28:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 -- 172.21.15.96:0/4121761348 shutdown_connections 2022-02-02T20:28:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 --2- 172.21.15.96:0/4121761348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f5f60 0x7fc4700f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 --2- 172.21.15.96:0/4121761348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f4d60 0x7fc4700f5180 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 -- 172.21.15.96:0/4121761348 >> 172.21.15.96:0/4121761348 conn(0x7fc4700f04c0 msgr2=0x7fc4700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 -- 172.21.15.96:0/4121761348 shutdown_connections 2022-02-02T20:28:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.532+0000 7fc4756c6700 1 -- 172.21.15.96:0/4121761348 wait complete. 2022-02-02T20:28:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 Processor -- start 2022-02-02T20:28:13.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 -- start start 2022-02-02T20:28:13.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 0x7fc470107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701079e0 con 0x7fc4700f5f60 2022-02-02T20:28:13.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.533+0000 7fc4756c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470107b20 con 0x7fc4700f4d60 2022-02-02T20:28:13.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:41376/0 (socket says 172.21.15.96:41376) 2022-02-02T20:28:13.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 -- 172.21.15.96:0/2742098934 learned_addr learned my addr 172.21.15.96:0/2742098934 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:13.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46e7fc700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 0x7fc470107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 -- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 msgr2=0x7fc470107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 0x7fc470107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 -- 172.21.15.96:0/2742098934 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc464005040 con 0x7fc4700f4d60 2022-02-02T20:28:13.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46e7fc700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 0x7fc470107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:28:13.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.534+0000 7fc46effd700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc464009990 tx=0x7fc464009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc464018070 con 0x7fc4700f4d60 2022-02-02T20:28:13.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470108460 con 0x7fc4700f4d60 2022-02-02T20:28:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc464007ba0 con 0x7fc4700f4d60 2022-02-02T20:28:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc46401c3c0 con 0x7fc4700f4d60 2022-02-02T20:28:13.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4701089c0 con 0x7fc4700f4d60 2022-02-02T20:28:13.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.535+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470045ad0 con 0x7fc4700f4d60 2022-02-02T20:28:13.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.536+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc46401d420 con 0x7fc4700f4d60 2022-02-02T20:28:13.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.537+0000 7fc4577fe700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 0x7fc458067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.537+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc464083760 con 0x7fc4700f4d60 2022-02-02T20:28:13.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.537+0000 7fc46e7fc700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 0x7fc458067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.537+0000 7fc46e7fc700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 0x7fc458067290 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fc46000a700 tx=0x7fc460009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.541+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc464055230 con 0x7fc4700f4d60 2022-02-02T20:28:13.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.773+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc470027a00 con 0x7fc4700f4d60 2022-02-02T20:28:13.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.774+0000 7fc4577fe700 1 -- 172.21.15.96:0/2742098934 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc464054e20 con 0x7fc4700f4d60 2022-02-02T20:28:13.777 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:28:13.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:28:13.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:28:13.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:13.778 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:28:13.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:28:13.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:13.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:28:13.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:28:13.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:13.779 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:28:13.779 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:28:13.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:13.780 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:28:13.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:28:13.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:28:13.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:28:13.781 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:28:13.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 msgr2=0x7fc458067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 0x7fc458067290 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fc46000a700 tx=0x7fc460009040).stop 2022-02-02T20:28:13.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 msgr2=0x7fc470106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc464009990 tx=0x7fc464009b30).stop 2022-02-02T20:28:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 shutdown_connections 2022-02-02T20:28:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc458064dd0 0x7fc458067290 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4700f4d60 0x7fc470106f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 --2- 172.21.15.96:0/2742098934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4700f5f60 0x7fc470107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 >> 172.21.15.96:0/2742098934 conn(0x7fc4700f04c0 msgr2=0x7fc4700f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 shutdown_connections 2022-02-02T20:28:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.776+0000 7fc4756c6700 1 -- 172.21.15.96:0/2742098934 wait complete. 2022-02-02T20:28:13.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 -- 172.21.15.96:0/4067795232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6ff0 msgr2=0x7f86680f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 --2- 172.21.15.96:0/4067795232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6ff0 0x7f86680f7a20 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f8658004660 tx=0x7f8658009b30).stop 2022-02-02T20:28:13.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 -- 172.21.15.96:0/4067795232 shutdown_connections 2022-02-02T20:28:13.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 --2- 172.21.15.96:0/4067795232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86680f6ff0 0x7f86680f7a20 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 --2- 172.21.15.96:0/4067795232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 0x7f86680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 -- 172.21.15.96:0/4067795232 >> 172.21.15.96:0/4067795232 conn(0x7f86680f1f00 msgr2=0x7f86680f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 -- 172.21.15.96:0/4067795232 shutdown_connections 2022-02-02T20:28:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.875+0000 7f866d4a5700 1 -- 172.21.15.96:0/4067795232 wait complete. 2022-02-02T20:28:13.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 Processor -- start 2022-02-02T20:28:13.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 -- start start 2022-02-02T20:28:13.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 0x7f86681070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668107ab0 con 0x7f86681075e0 2022-02-02T20:28:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f866d4a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668107bf0 con 0x7f86680f66e0 2022-02-02T20:28:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f86667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f86667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37284/0 (socket says 172.21.15.96:37284) 2022-02-02T20:28:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f86667fc700 1 -- 172.21.15.96:0/538147297 learned_addr learned my addr 172.21.15.96:0/538147297 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.876+0000 7f8666ffd700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 0x7f86681070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f86667fc700 1 -- 172.21.15.96:0/538147297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 msgr2=0x7f86681070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f86667fc700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 0x7f86681070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f86667fc700 1 -- 172.21.15.96:0/538147297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658005040 con 0x7f86681075e0 2022-02-02T20:28:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f86667fc700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f8658000c00 tx=0x7f8658009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8658019070 con 0x7f86681075e0 2022-02-02T20:28:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668108a20 con 0x7f86681075e0 2022-02-02T20:28:13.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f86580097d0 con 0x7f86681075e0 2022-02-02T20:28:13.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8658014480 con 0x7f86681075e0 2022-02-02T20:28:13.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.877+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8668108f20 con 0x7f86681075e0 2022-02-02T20:28:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.878+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668045ad0 con 0x7f86681075e0 2022-02-02T20:28:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.878+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8658007bc0 con 0x7f86681075e0 2022-02-02T20:28:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.879+0000 7f864f7fe700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 0x7f8650067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.879+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8658082c40 con 0x7f86681075e0 2022-02-02T20:28:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.879+0000 7f8666ffd700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 0x7f8650067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.879+0000 7f8666ffd700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 0x7f8650067290 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f865c004c40 tx=0x7f865c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:13.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:13.883+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8658054770 con 0x7f86681075e0 2022-02-02T20:28:14.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.084+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8668027a00 con 0x7f86681075e0 2022-02-02T20:28:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.084+0000 7f864f7fe700 1 -- 172.21.15.96:0/538147297 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8658054360 con 0x7f86681075e0 2022-02-02T20:28:14.087 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:28:14.089 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:28:14.089 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:28:14.089 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:28:14.090 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:14.090 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:28:14.090 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:28:14.091 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:28:14.091 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:28:14.091 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:28:14.091 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:28:14.092 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:28:14.092 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:28:14.092 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:28:14.092 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:28:14.093 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:28:14.093 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:28:14.093 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:28:14.093 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:28:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:28:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:28:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:28:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:28:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:28:14.095 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:28:14.095 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:28:14.095 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:28:14.095 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:28:14.096 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:28:14.096 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:28:14.096 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:28:14.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:28:14.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:14.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:14.097 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:28:14.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:14.097 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:14.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:14.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 msgr2=0x7f8650067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 0x7f8650067290 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f865c004c40 tx=0x7f865c00b040).stop 2022-02-02T20:28:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 msgr2=0x7f86681084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f8658000c00 tx=0x7f8658009b30).stop 2022-02-02T20:28:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 shutdown_connections 2022-02-02T20:28:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8650064dd0 0x7f8650067290 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86680f66e0 0x7f86681070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 --2- 172.21.15.96:0/538147297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86681075e0 0x7f86681084d0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 >> 172.21.15.96:0/538147297 conn(0x7f86680f1f00 msgr2=0x7f86680fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 shutdown_connections 2022-02-02T20:28:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:14.086+0000 7f866d4a5700 1 -- 172.21.15.96:0/538147297 wait complete. 2022-02-02T20:28:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:28:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:14 smithi159 ceph-mon[69013]: pgmap v3784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:14 smithi159 ceph-mon[69013]: from='client.37990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:14 smithi159 ceph-mon[69013]: from='client.37994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2742098934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:28:14.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/538147297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:28:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:14 smithi096 ceph-mon[101353]: pgmap v3784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:14 smithi096 ceph-mon[101353]: from='client.37990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:14 smithi096 ceph-mon[101353]: from='client.37994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:14.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2742098934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:28:14.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/538147297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:28:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:16 smithi159 ceph-mon[69013]: pgmap v3785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:16 smithi096 ceph-mon[101353]: pgmap v3785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:17 smithi159 ceph-mon[69013]: pgmap v3786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:17 smithi096 ceph-mon[101353]: pgmap v3786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:20 smithi159 ceph-mon[69013]: pgmap v3787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:20 smithi096 ceph-mon[101353]: pgmap v3787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:22 smithi159 ceph-mon[69013]: pgmap v3788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:22 smithi096 ceph-mon[101353]: pgmap v3788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:24 smithi159 ceph-mon[69013]: pgmap v3789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:24 smithi096 ceph-mon[101353]: pgmap v3789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:26 smithi159 ceph-mon[69013]: pgmap v3790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:26 smithi096 ceph-mon[101353]: pgmap v3790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:27 smithi159 ceph-mon[69013]: pgmap v3791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:28:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:28:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:27 smithi096 ceph-mon[101353]: pgmap v3791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:28:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:28:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:30 smithi159 ceph-mon[69013]: pgmap v3792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:30 smithi096 ceph-mon[101353]: pgmap v3792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:32 smithi159 ceph-mon[69013]: pgmap v3793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:32 smithi096 ceph-mon[101353]: pgmap v3793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:34 smithi159 ceph-mon[69013]: pgmap v3794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:34 smithi096 ceph-mon[101353]: pgmap v3794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:36 smithi159 ceph-mon[69013]: pgmap v3795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:36 smithi096 ceph-mon[101353]: pgmap v3795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:37 smithi159 ceph-mon[69013]: pgmap v3796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:37 smithi096 ceph-mon[101353]: pgmap v3796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:40 smithi159 ceph-mon[69013]: pgmap v3797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:40 smithi096 ceph-mon[101353]: pgmap v3797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:42 smithi159 ceph-mon[69013]: pgmap v3798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:42 smithi096 ceph-mon[101353]: pgmap v3798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:44.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.196+0000 7f594bfff700 1 -- 172.21.15.96:0/4283608043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f66d0 msgr2=0x7f594c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.196+0000 7f594bfff700 1 --2- 172.21.15.96:0/4283608043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f66d0 0x7f594c0f6b30 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f5940004660 tx=0x7f5940009b30).stop 2022-02-02T20:28:44.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 -- 172.21.15.96:0/4283608043 shutdown_connections 2022-02-02T20:28:44.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 --2- 172.21.15.96:0/4283608043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f66d0 0x7f594c0f6b30 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 --2- 172.21.15.96:0/4283608043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f5430 0x7f594c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 -- 172.21.15.96:0/4283608043 >> 172.21.15.96:0/4283608043 conn(0x7f594c0f0b90 msgr2=0x7f594c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:44.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 -- 172.21.15.96:0/4283608043 shutdown_connections 2022-02-02T20:28:44.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 -- 172.21.15.96:0/4283608043 wait complete. 2022-02-02T20:28:44.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.197+0000 7f594bfff700 1 Processor -- start 2022-02-02T20:28:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594bfff700 1 -- start start 2022-02-02T20:28:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f66d0 0x7f594c10bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0603e0 con 0x7f594c0f5430 2022-02-02T20:28:44.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c060520 con 0x7f594c0f66d0 2022-02-02T20:28:44.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37300/0 (socket says 172.21.15.96:37300) 2022-02-02T20:28:44.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 -- 172.21.15.96:0/1347238624 learned_addr learned my addr 172.21.15.96:0/1347238624 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:44.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594a7fc700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f66d0 0x7f594c10bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 -- 172.21.15.96:0/1347238624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f66d0 msgr2=0x7f594c10bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f66d0 0x7f594c10bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 -- 172.21.15.96:0/1347238624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940005040 con 0x7f594c0f5430 2022-02-02T20:28:44.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.198+0000 7f594affd700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f593c00e7c0 tx=0x7f593c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.199+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c0092e0 con 0x7f594c0f5430 2022-02-02T20:28:44.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.199+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f593c00f040 con 0x7f594c0f5430 2022-02-02T20:28:44.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.199+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c10c480 con 0x7f594c0f5430 2022-02-02T20:28:44.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.199+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c014750 con 0x7f594c0f5430 2022-02-02T20:28:44.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.199+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c10ca40 con 0x7f594c0f5430 2022-02-02T20:28:44.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.200+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c045ad0 con 0x7f594c0f5430 2022-02-02T20:28:44.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.200+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f593c01b030 con 0x7f594c0f5430 2022-02-02T20:28:44.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.200+0000 7f59337fe700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 0x7f59340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.201+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f593c081b10 con 0x7f594c0f5430 2022-02-02T20:28:44.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.201+0000 7f594a7fc700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 0x7f59340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.201+0000 7f594a7fc700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 0x7f59340672e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f5940004d80 tx=0x7f594000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.205+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f593c04fc10 con 0x7f594c0f5430 2022-02-02T20:28:44.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.389+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f594c0fdd60 con 0x7f5934064e20 2022-02-02T20:28:44.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.390+0000 7f59337fe700 1 -- 172.21.15.96:0/1347238624 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f594c0fdd60 con 0x7f5934064e20 2022-02-02T20:28:44.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 msgr2=0x7f59340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 0x7f59340672e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f5940004d80 tx=0x7f594000b040).stop 2022-02-02T20:28:44.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 msgr2=0x7f594c1099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f593c00e7c0 tx=0x7f593c00b040).stop 2022-02-02T20:28:44.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 shutdown_connections 2022-02-02T20:28:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5934064e20 0x7f59340672e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f5430 0x7f594c1099d0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 --2- 172.21.15.96:0/1347238624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f66d0 0x7f594c10bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 >> 172.21.15.96:0/1347238624 conn(0x7f594c0f0b90 msgr2=0x7f594c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 shutdown_connections 2022-02-02T20:28:44.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.392+0000 7f594bfff700 1 -- 172.21.15.96:0/1347238624 wait complete. 2022-02-02T20:28:44.403 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:28:44.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/3584598155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f55c0 msgr2=0x7f7ec00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/3584598155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f55c0 0x7f7ec00f59e0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f7eb0004660 tx=0x7f7eb0009b30).stop 2022-02-02T20:28:44.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/3584598155 shutdown_connections 2022-02-02T20:28:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/3584598155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f6860 0x7f7ec00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:28:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/3584598155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f55c0 0x7f7ec00f59e0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/3584598155 >> 172.21.15.96:0/3584598155 conn(0x7f7ec00f0d40 msgr2=0x7f7ec00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/3584598155 shutdown_connections 2022-02-02T20:28:44.493 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:44 smithi096 ceph-mon[101353]: pgmap v3799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.489+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/3584598155 wait complete. 2022-02-02T20:28:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 Processor -- start 2022-02-02T20:28:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 -- start start 2022-02-02T20:28:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f55c0 0x7f7ec010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00602b0 con 0x7f7ec00f6860 2022-02-02T20:28:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ec5cf7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00603f0 con 0x7f7ec00f55c0 2022-02-02T20:28:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37312/0 (socket says 172.21.15.96:37312) 2022-02-02T20:28:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 -- 172.21.15.96:0/1773983350 learned_addr learned my addr 172.21.15.96:0/1773983350 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebf7fe700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f55c0 0x7f7ec010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 -- 172.21.15.96:0/1773983350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f55c0 msgr2=0x7f7ec010c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f55c0 0x7f7ec010c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.490+0000 7f7ebeffd700 1 -- 172.21.15.96:0/1773983350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0005040 con 0x7f7ec00f6860 2022-02-02T20:28:44.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7ebeffd700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f7ea800b410 tx=0x7f7ea8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea80125f0 con 0x7f7ec00f6860 2022-02-02T20:28:44.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ea800be30 con 0x7f7ec00f6860 2022-02-02T20:28:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec010ea60 con 0x7f7ec00f6860 2022-02-02T20:28:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea8002a70 con 0x7f7ec00f6860 2022-02-02T20:28:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.491+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec010ef40 con 0x7f7ec00f6860 2022-02-02T20:28:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.492+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec0045ad0 con 0x7f7ec00f6860 2022-02-02T20:28:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.492+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ea800f030 con 0x7f7ec00f6860 2022-02-02T20:28:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.493+0000 7f7eb7fff700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 0x7f7eac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.493+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ea8081e70 con 0x7f7ec00f6860 2022-02-02T20:28:44.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.493+0000 7f7ebf7fe700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 0x7f7eac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.493+0000 7f7ebf7fe700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 0x7f7eac067290 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f7eb0013690 tx=0x7f7eb0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.497+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ea804ff70 con 0x7f7ec00f6860 2022-02-02T20:28:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:44 smithi159 ceph-mon[69013]: pgmap v3799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:44.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.668+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ec0057f10 con 0x7f7eac064dd0 2022-02-02T20:28:44.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.677+0000 7f7eb7fff700 1 -- 172.21.15.96:0/1773983350 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ec0057f10 con 0x7f7eac064dd0 2022-02-02T20:28:44.679 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:28:44.679 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 102m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:28:44.679 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 102m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:28:44.680 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 101m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:28:44.680 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 102m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:28:44.680 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 102m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:28:44.680 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 102m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:28:44.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 101m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:28:44.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 101m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:28:44.681 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 102m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:28:44.681 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 101m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:28:44.682 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 102m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:28:44.682 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 101m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:28:44.682 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 102m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:28:44.682 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 101m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:28:44.683 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 102m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:28:44.683 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 102m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:28:44.683 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 102m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:28:44.683 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 101m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:28:44.683 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 101m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:28:44.684 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 101m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:28:44.684 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 102m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:28:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 msgr2=0x7f7eac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 0x7f7eac067290 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f7eb0013690 tx=0x7f7eb0009b30).stop 2022-02-02T20:28:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 msgr2=0x7f7ec010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f7ea800b410 tx=0x7f7ea8006ef0).stop 2022-02-02T20:28:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 shutdown_connections 2022-02-02T20:28:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eac064dd0 0x7f7eac067290 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00f55c0 0x7f7ec010c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 --2- 172.21.15.96:0/1773983350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ec00f6860 0x7f7ec010e570 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 >> 172.21.15.96:0/1773983350 conn(0x7f7ec00f0d40 msgr2=0x7f7ec00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 shutdown_connections 2022-02-02T20:28:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.679+0000 7f7ec5cf7700 1 -- 172.21.15.96:0/1773983350 wait complete. 2022-02-02T20:28:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 -- 172.21.15.96:0/3925554197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 msgr2=0x7f3f340fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3925554197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f340fbaf0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f3f28004660 tx=0x7f3f28009b30).stop 2022-02-02T20:28:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 -- 172.21.15.96:0/3925554197 shutdown_connections 2022-02-02T20:28:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3925554197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f340fbaf0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3925554197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f340f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 -- 172.21.15.96:0/3925554197 >> 172.21.15.96:0/3925554197 conn(0x7f3f340f0ba0 msgr2=0x7f3f340f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:44.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.775+0000 7f3f33fff700 1 -- 172.21.15.96:0/3925554197 shutdown_connections 2022-02-02T20:28:44.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.776+0000 7f3f33fff700 1 -- 172.21.15.96:0/3925554197 wait complete. 2022-02-02T20:28:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 Processor -- start 2022-02-02T20:28:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 -- start start 2022-02-02T20:28:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f34106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f34107870 con 0x7f3f340f96a0 2022-02-02T20:28:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f33fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341080b0 con 0x7f3f34060310 2022-02-02T20:28:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37322/0 (socket says 172.21.15.96:37322) 2022-02-02T20:28:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 -- 172.21.15.96:0/3712064606 learned_addr learned my addr 172.21.15.96:0/3712064606 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f32ffd700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f34106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 -- 172.21.15.96:0/3712064606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 msgr2=0x7f3f34106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f34106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 -- 172.21.15.96:0/3712064606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28005040 con 0x7f3f340f96a0 2022-02-02T20:28:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f32ffd700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f34106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:28:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.777+0000 7f3f327fc700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f3f28013a70 tx=0x7f3f28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.778+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f28018070 con 0x7f3f340f96a0 2022-02-02T20:28:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.778+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f280097d0 con 0x7f3f340f96a0 2022-02-02T20:28:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.778+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34108330 con 0x7f3f340f96a0 2022-02-02T20:28:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.778+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2801c3c0 con 0x7f3f340f96a0 2022-02-02T20:28:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.778+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f34108810 con 0x7f3f340f96a0 2022-02-02T20:28:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.779+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f34059100 con 0x7f3f340f96a0 2022-02-02T20:28:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.779+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f28007ba0 con 0x7f3f340f96a0 2022-02-02T20:28:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.780+0000 7f3f1b7fe700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 0x7f3f1c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.780+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f28083740 con 0x7f3f340f96a0 2022-02-02T20:28:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.780+0000 7f3f32ffd700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 0x7f3f1c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.780+0000 7f3f32ffd700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 0x7f3f1c0672e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3f34107b40 tx=0x7f3f24009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:44.784+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f28051900 con 0x7f3f340f96a0 2022-02-02T20:28:45.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.015+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f340008d0 con 0x7f3f340f96a0 2022-02-02T20:28:45.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.015+0000 7f3f1b7fe700 1 -- 172.21.15.96:0/3712064606 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3f28054f20 con 0x7f3f340f96a0 2022-02-02T20:28:45.075 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:28:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:28:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:28:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:28:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:28:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:28:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:28:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:28:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:28:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:28:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:28:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:28:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:28:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:28:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:28:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 msgr2=0x7f3f1c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 0x7f3f1c0672e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3f34107b40 tx=0x7f3f24009c00).stop 2022-02-02T20:28:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 msgr2=0x7f3f34107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7f3f28013a70 tx=0x7f3f28009b30).stop 2022-02-02T20:28:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 shutdown_connections 2022-02-02T20:28:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f1c064e20 0x7f3f1c0672e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f34060310 0x7f3f34106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 --2- 172.21.15.96:0/3712064606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f340f96a0 0x7f3f34107270 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 >> 172.21.15.96:0/3712064606 conn(0x7f3f340f0ba0 msgr2=0x7f3f340f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 shutdown_connections 2022-02-02T20:28:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.017+0000 7f3f33fff700 1 -- 172.21.15.96:0/3712064606 wait complete. 2022-02-02T20:28:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- 172.21.15.96:0/2058397342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 msgr2=0x7f863c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 --2- 172.21.15.96:0/2058397342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c0f6b00 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f8630004660 tx=0x7f8630009b30).stop 2022-02-02T20:28:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- 172.21.15.96:0/2058397342 shutdown_connections 2022-02-02T20:28:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 --2- 172.21.15.96:0/2058397342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 --2- 172.21.15.96:0/2058397342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c0f6b00 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- 172.21.15.96:0/2058397342 >> 172.21.15.96:0/2058397342 conn(0x7f863c0f1e40 msgr2=0x7f863c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- 172.21.15.96:0/2058397342 shutdown_connections 2022-02-02T20:28:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- 172.21.15.96:0/2058397342 wait complete. 2022-02-02T20:28:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 Processor -- start 2022-02-02T20:28:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.116+0000 7f8641a79700 1 -- start start 2022-02-02T20:28:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c06a380 con 0x7f863c0f66e0 2022-02-02T20:28:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c06a4c0 con 0x7f863c0f7980 2022-02-02T20:28:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37330/0 (socket says 172.21.15.96:37330) 2022-02-02T20:28:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 -- 172.21.15.96:0/1064403408 learned_addr learned my addr 172.21.15.96:0/1064403408 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:28:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863affd700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 -- 172.21.15.96:0/1064403408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 msgr2=0x7f863c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 -- 172.21.15.96:0/1064403408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630005040 con 0x7f863c0f66e0 2022-02-02T20:28:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863affd700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:28:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f863b7fe700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f8630004f60 tx=0x7f8630009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8630018070 con 0x7f863c0f66e0 2022-02-02T20:28:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c06a740 con 0x7f863c0f66e0 2022-02-02T20:28:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c06aca0 con 0x7f863c0f66e0 2022-02-02T20:28:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8630007ba0 con 0x7f863c0f66e0 2022-02-02T20:28:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.117+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863001c620 con 0x7f863c0f66e0 2022-02-02T20:28:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.118+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c045ad0 con 0x7f863c0f66e0 2022-02-02T20:28:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.119+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f863001d420 con 0x7f863c0f66e0 2022-02-02T20:28:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.119+0000 7f8623fff700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 0x7f8624067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:28:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.119+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8630083890 con 0x7f863c0f66e0 2022-02-02T20:28:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.119+0000 7f863affd700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 0x7f8624067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:28:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.120+0000 7f863affd700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 0x7f8624067290 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f862c0041d0 tx=0x7f862c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:28:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.124+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8630051a50 con 0x7f863c0f66e0 2022-02-02T20:28:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.327+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f863c0586e0 con 0x7f863c0f66e0 2022-02-02T20:28:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.327+0000 7f8623fff700 1 -- 172.21.15.96:0/1064403408 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8630055070 con 0x7f863c0f66e0 2022-02-02T20:28:45.329 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:28:45.329 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:28:45.330 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:28:45.330 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:28:45.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:45.330 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:28:45.331 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:28:45.331 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:28:45.331 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:28:45.331 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:28:45.331 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:28:45.332 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:28:45.332 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:28:45.332 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:28:45.332 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:28:45.333 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:28:45.333 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:28:45.333 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:28:45.333 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:28:45.333 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:28:45.334 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:28:45.334 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:28:45.334 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:28:45.335 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:28:45.335 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:28:45.335 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:28:45.335 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:28:45.336 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:28:45.336 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:28:45.336 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:28:45.337 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:28:45.337 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:28:45.337 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:45.337 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:45.337 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:28:45.338 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:28:45.338 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:45.338 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:45.338 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:28:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 msgr2=0x7f8624067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 0x7f8624067290 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f862c0041d0 tx=0x7f862c009040).stop 2022-02-02T20:28:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 msgr2=0x7f863c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:28:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f8630004f60 tx=0x7f8630009b30).stop 2022-02-02T20:28:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 shutdown_connections 2022-02-02T20:28:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8624064dd0 0x7f8624067290 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f863c0f66e0 0x7f863c06b9a0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 --2- 172.21.15.96:0/1064403408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f863c0f7980 0x7f863c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:28:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 >> 172.21.15.96:0/1064403408 conn(0x7f863c0f1e40 msgr2=0x7f863c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:28:45.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 shutdown_connections 2022-02-02T20:28:45.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:28:45.330+0000 7f8641a79700 1 -- 172.21.15.96:0/1064403408 wait complete. 2022-02-02T20:28:45.342 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:28:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:45 smithi159 ceph-mon[69013]: from='client.38004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3712064606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:28:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:45 smithi096 ceph-mon[101353]: from='client.38004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:45.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3712064606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:28:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:46 smithi159 ceph-mon[69013]: from='client.38008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:46 smithi159 ceph-mon[69013]: pgmap v3800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:46.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1064403408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:28:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:46 smithi096 ceph-mon[101353]: from='client.38008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:28:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:46 smithi096 ceph-mon[101353]: pgmap v3800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1064403408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:28:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:47 smithi159 ceph-mon[69013]: pgmap v3801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:47 smithi096 ceph-mon[101353]: pgmap v3801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:50 smithi159 ceph-mon[69013]: pgmap v3802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:50 smithi096 ceph-mon[101353]: pgmap v3802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:52 smithi159 ceph-mon[69013]: pgmap v3803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:52 smithi096 ceph-mon[101353]: pgmap v3803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:54 smithi159 ceph-mon[69013]: pgmap v3804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:54 smithi096 ceph-mon[101353]: pgmap v3804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:56 smithi159 ceph-mon[69013]: pgmap v3805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:56 smithi096 ceph-mon[101353]: pgmap v3805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:28:57 smithi159 ceph-mon[69013]: pgmap v3806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:28:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:28:57 smithi096 ceph-mon[101353]: pgmap v3806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:00 smithi159 ceph-mon[69013]: pgmap v3807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:00 smithi096 ceph-mon[101353]: pgmap v3807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:02 smithi159 ceph-mon[69013]: pgmap v3808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:02 smithi096 ceph-mon[101353]: pgmap v3808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:04 smithi159 ceph-mon[69013]: pgmap v3809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:04 smithi096 ceph-mon[101353]: pgmap v3809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:06 smithi159 ceph-mon[69013]: pgmap v3810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:06 smithi096 ceph-mon[101353]: pgmap v3810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:07 smithi159 ceph-mon[69013]: pgmap v3811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:07 smithi096 ceph-mon[101353]: pgmap v3811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:10 smithi159 ceph-mon[69013]: pgmap v3812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:10 smithi096 ceph-mon[101353]: pgmap v3812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:12 smithi159 ceph-mon[69013]: pgmap v3813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:12 smithi096 ceph-mon[101353]: pgmap v3813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:14 smithi159 ceph-mon[69013]: pgmap v3814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:14 smithi096 ceph-mon[101353]: pgmap v3814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:15.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.440+0000 7f1a07fff700 1 -- 172.21.15.96:0/2234920752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f5430 msgr2=0x7f1a080f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.440+0000 7f1a07fff700 1 --2- 172.21.15.96:0/2234920752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f5430 0x7f1a080f5850 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f19f8004660 tx=0x7f19f8009b30).stop 2022-02-02T20:29:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 -- 172.21.15.96:0/2234920752 shutdown_connections 2022-02-02T20:29:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 --2- 172.21.15.96:0/2234920752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f66d0 0x7f1a080f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 --2- 172.21.15.96:0/2234920752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f5430 0x7f1a080f5850 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 -- 172.21.15.96:0/2234920752 >> 172.21.15.96:0/2234920752 conn(0x7f1a080f0b90 msgr2=0x7f1a080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:15.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 -- 172.21.15.96:0/2234920752 shutdown_connections 2022-02-02T20:29:15.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 -- 172.21.15.96:0/2234920752 wait complete. 2022-02-02T20:29:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 Processor -- start 2022-02-02T20:29:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.441+0000 7f1a07fff700 1 -- start start 2022-02-02T20:29:15.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f5430 0x7f1a08109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a07fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080603c0 con 0x7f1a080f66d0 2022-02-02T20:29:15.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a07fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08060500 con 0x7f1a080f5430 2022-02-02T20:29:15.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37352/0 (socket says 172.21.15.96:37352) 2022-02-02T20:29:15.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 -- 172.21.15.96:0/680433291 learned_addr learned my addr 172.21.15.96:0/680433291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:15.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a06ffd700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f5430 0x7f1a08109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 -- 172.21.15.96:0/680433291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f5430 msgr2=0x7f1a08109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f5430 0x7f1a08109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 -- 172.21.15.96:0/680433291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8005040 con 0x7f1a080f66d0 2022-02-02T20:29:15.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a067fc700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f19fc00fae0 tx=0x7f19fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:15.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc014070 con 0x7f1a080f66d0 2022-02-02T20:29:15.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19fc009500 con 0x7f1a080f66d0 2022-02-02T20:29:15.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a081058f0 con 0x7f1a080f66d0 2022-02-02T20:29:15.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.442+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc002ba0 con 0x7f1a080f66d0 2022-02-02T20:29:15.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.443+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a08105eb0 con 0x7f1a080f66d0 2022-02-02T20:29:15.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.444+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19fc0077b0 con 0x7f1a080f66d0 2022-02-02T20:29:15.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.444+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08045ad0 con 0x7f1a080f66d0 2022-02-02T20:29:15.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.444+0000 7f19ef7fe700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 0x7f19f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.444+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19fc085e90 con 0x7f1a080f66d0 2022-02-02T20:29:15.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.444+0000 7f1a06ffd700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 0x7f19f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.445+0000 7f1a06ffd700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 0x7f19f00672e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f19f8013690 tx=0x7f19f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:15.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.449+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19fc053f90 con 0x7f1a080f66d0 2022-02-02T20:29:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.631+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a080fdd30 con 0x7f19f0064e20 2022-02-02T20:29:15.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.632+0000 7f19ef7fe700 1 -- 172.21.15.96:0/680433291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1a080fdd30 con 0x7f19f0064e20 2022-02-02T20:29:15.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 msgr2=0x7f19f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 0x7f19f00672e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f19f8013690 tx=0x7f19f8009b30).stop 2022-02-02T20:29:15.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 msgr2=0x7f1a0810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f19fc00fae0 tx=0x7f19fc009de0).stop 2022-02-02T20:29:15.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 shutdown_connections 2022-02-02T20:29:15.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19f0064e20 0x7f19f00672e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a080f5430 0x7f1a08109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 --2- 172.21.15.96:0/680433291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a080f66d0 0x7f1a0810bfb0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 >> 172.21.15.96:0/680433291 conn(0x7f1a080f0b90 msgr2=0x7f1a080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:15.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 shutdown_connections 2022-02-02T20:29:15.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.634+0000 7f1a07fff700 1 -- 172.21.15.96:0/680433291 wait complete. 2022-02-02T20:29:15.664 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:29:15.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 -- 172.21.15.96:0/3599261393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 msgr2=0x7fe3b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 --2- 172.21.15.96:0/3599261393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b40f7de0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7fe3a4004660 tx=0x7fe3a4009b30).stop 2022-02-02T20:29:15.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 -- 172.21.15.96:0/3599261393 shutdown_connections 2022-02-02T20:29:15.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 --2- 172.21.15.96:0/3599261393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b40f7de0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 --2- 172.21.15.96:0/3599261393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 0x7fe3b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 -- 172.21.15.96:0/3599261393 >> 172.21.15.96:0/3599261393 conn(0x7fe3b40f1e40 msgr2=0x7fe3b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:15.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 -- 172.21.15.96:0/3599261393 shutdown_connections 2022-02-02T20:29:15.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.731+0000 7fe3b984a700 1 -- 172.21.15.96:0/3599261393 wait complete. 2022-02-02T20:29:15.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 Processor -- start 2022-02-02T20:29:15.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 -- start start 2022-02-02T20:29:15.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 0x7fe3b4109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4109c00 con 0x7fe3b40f7980 2022-02-02T20:29:15.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b984a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4109d40 con 0x7fe3b40f66e0 2022-02-02T20:29:15.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37362/0 (socket says 172.21.15.96:37362) 2022-02-02T20:29:15.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b27fc700 1 -- 172.21.15.96:0/2322240166 learned_addr learned my addr 172.21.15.96:0/2322240166 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:15.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.732+0000 7fe3b2ffd700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 0x7fe3b4109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b27fc700 1 -- 172.21.15.96:0/2322240166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 msgr2=0x7fe3b4109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b27fc700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 0x7fe3b4109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b27fc700 1 -- 172.21.15.96:0/2322240166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4005040 con 0x7fe3b40f7980 2022-02-02T20:29:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b27fc700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fe3a4009990 tx=0x7fe3a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3a4018070 con 0x7fe3b40f7980 2022-02-02T20:29:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe3a4007ba0 con 0x7fe3b40f7980 2022-02-02T20:29:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b410a680 con 0x7fe3b40f7980 2022-02-02T20:29:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b410abe0 con 0x7fe3b40f7980 2022-02-02T20:29:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.733+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3a401c3c0 con 0x7fe3b40f7980 2022-02-02T20:29:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.734+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4045ad0 con 0x7fe3b40f7980 2022-02-02T20:29:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.734+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe3a401c630 con 0x7fe3b40f7980 2022-02-02T20:29:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.735+0000 7fe39b7fe700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 0x7fe39c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.735+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe3a4083620 con 0x7fe3b40f7980 2022-02-02T20:29:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.735+0000 7fe3b2ffd700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 0x7fe39c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.735+0000 7fe3b2ffd700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 0x7fe39c067290 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe3b40f77e0 tx=0x7fe3a800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.739+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe3a4055230 con 0x7fe3b40f7980 2022-02-02T20:29:15.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.910+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3b410ae50 con 0x7fe39c064dd0 2022-02-02T20:29:15.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.919+0000 7fe39b7fe700 1 -- 172.21.15.96:0/2322240166 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe3b410ae50 con 0x7fe39c064dd0 2022-02-02T20:29:15.921 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:29:15.921 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 103m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:29:15.921 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 103m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:29:15.922 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 101m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:29:15.922 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 103m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:29:15.922 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 103m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:29:15.922 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 103m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:29:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 101m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:29:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 101m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:29:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 103m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:29:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 101m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:29:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 103m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:29:15.924 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 101m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:29:15.924 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 103m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:29:15.924 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 101m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:29:15.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 103m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:29:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 103m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:29:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 103m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:29:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 101m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:29:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 101m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:29:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 101m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:29:15.926 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 103m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:29:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 msgr2=0x7fe39c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 0x7fe39c067290 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe3b40f77e0 tx=0x7fe3a800b040).stop 2022-02-02T20:29:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 msgr2=0x7fe3b4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fe3a4009990 tx=0x7fe3a4009b30).stop 2022-02-02T20:29:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 shutdown_connections 2022-02-02T20:29:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe39c064dd0 0x7fe39c067290 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40f66e0 0x7fe3b4109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 --2- 172.21.15.96:0/2322240166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3b40f7980 0x7fe3b4109650 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 >> 172.21.15.96:0/2322240166 conn(0x7fe3b40f1e40 msgr2=0x7fe3b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 shutdown_connections 2022-02-02T20:29:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:15.921+0000 7fe3b984a700 1 -- 172.21.15.96:0/2322240166 wait complete. 2022-02-02T20:29:16.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- 172.21.15.96:0/3815063162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f66d0 msgr2=0x7fcea80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3815063162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f66d0 0x7fcea80f6b30 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7fce98004660 tx=0x7fce98009b30).stop 2022-02-02T20:29:16.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- 172.21.15.96:0/3815063162 shutdown_connections 2022-02-02T20:29:16.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3815063162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f66d0 0x7fcea80f6b30 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3815063162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5430 0x7fcea80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- 172.21.15.96:0/3815063162 >> 172.21.15.96:0/3815063162 conn(0x7fcea80f0b90 msgr2=0x7fcea80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:16.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- 172.21.15.96:0/3815063162 shutdown_connections 2022-02-02T20:29:16.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- 172.21.15.96:0/3815063162 wait complete. 2022-02-02T20:29:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 Processor -- start 2022-02-02T20:29:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.018+0000 7fceae4d8700 1 -- start start 2022-02-02T20:29:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceae4d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceae4d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 0x7fcea81060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceae4d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8106670 con 0x7fcea80f5430 2022-02-02T20:29:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceae4d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81067b0 con 0x7fcea80f66d0 2022-02-02T20:29:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37370/0 (socket says 172.21.15.96:37370) 2022-02-02T20:29:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 -- 172.21.15.96:0/3115131789 learned_addr learned my addr 172.21.15.96:0/3115131789 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceaccd5700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 0x7fcea81060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 -- 172.21.15.96:0/3115131789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 msgr2=0x7fcea81060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 0x7fcea81060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 -- 172.21.15.96:0/3115131789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98005040 con 0x7fcea80f5430 2022-02-02T20:29:16.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceaccd5700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 0x7fcea81060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:29:16.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fcead4d6700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fcea4002700 tx=0x7fcea4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:16.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea4009320 con 0x7fcea80f5430 2022-02-02T20:29:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.019+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8107150 con 0x7fcea80f5430 2022-02-02T20:29:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.020+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcea400f040 con 0x7fcea80f5430 2022-02-02T20:29:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.020+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea4014620 con 0x7fcea80f5430 2022-02-02T20:29:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.020+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea8107710 con 0x7fcea80f5430 2022-02-02T20:29:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.021+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea8045ad0 con 0x7fcea80f5430 2022-02-02T20:29:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.021+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcea40077b0 con 0x7fcea80f5430 2022-02-02T20:29:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.021+0000 7fce9dffb700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 0x7fce940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.021+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcea4081b30 con 0x7fcea80f5430 2022-02-02T20:29:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.021+0000 7fceaccd5700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 0x7fce940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.022+0000 7fceaccd5700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 0x7fce940672e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fce98004e30 tx=0x7fce98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.025+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcea4053600 con 0x7fcea80f5430 2022-02-02T20:29:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.254+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcea8107990 con 0x7fcea80f5430 2022-02-02T20:29:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.254+0000 7fce9dffb700 1 -- 172.21.15.96:0/3115131789 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcea40531f0 con 0x7fcea80f5430 2022-02-02T20:29:16.257 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:29:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:29:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:29:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:29:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:29:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:29:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:29:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:29:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:29:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:29:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:29:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:29:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:29:16.260 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:29:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 msgr2=0x7fce940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 0x7fce940672e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fce98004e30 tx=0x7fce98009b30).stop 2022-02-02T20:29:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 msgr2=0x7fcea8105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fcea4002700 tx=0x7fcea4009e00).stop 2022-02-02T20:29:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 shutdown_connections 2022-02-02T20:29:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064e20 0x7fce940672e0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5430 0x7fcea8105bd0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 --2- 172.21.15.96:0/3115131789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f66d0 0x7fcea81060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 >> 172.21.15.96:0/3115131789 conn(0x7fcea80f0b90 msgr2=0x7fcea80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 shutdown_connections 2022-02-02T20:29:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.256+0000 7fceae4d8700 1 -- 172.21.15.96:0/3115131789 wait complete. 2022-02-02T20:29:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:16 smithi096 ceph-mon[101353]: pgmap v3815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:16 smithi096 ceph-mon[101353]: from='client.38020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:16.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 -- 172.21.15.96:0/1327759776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 msgr2=0x7f9aa00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 --2- 172.21.15.96:0/1327759776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa00f59e0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f9a90004660 tx=0x7f9a90009b30).stop 2022-02-02T20:29:16.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 -- 172.21.15.96:0/1327759776 shutdown_connections 2022-02-02T20:29:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 --2- 172.21.15.96:0/1327759776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 --2- 172.21.15.96:0/1327759776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa00f59e0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 -- 172.21.15.96:0/1327759776 >> 172.21.15.96:0/1327759776 conn(0x7f9aa00f0d40 msgr2=0x7f9aa00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 -- 172.21.15.96:0/1327759776 shutdown_connections 2022-02-02T20:29:16.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.355+0000 7f9aa5889700 1 -- 172.21.15.96:0/1327759776 wait complete. 2022-02-02T20:29:16.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 Processor -- start 2022-02-02T20:29:16.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 -- start start 2022-02-02T20:29:16.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0106910 con 0x7f9aa00f55c0 2022-02-02T20:29:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9aa5889700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0106a50 con 0x7f9aa00f6860 2022-02-02T20:29:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9a9effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9a9effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37386/0 (socket says 172.21.15.96:37386) 2022-02-02T20:29:16.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9a9effd700 1 -- 172.21.15.96:0/2309122993 learned_addr learned my addr 172.21.15.96:0/2309122993 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:16.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.356+0000 7f9a9e7fc700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a9effd700 1 -- 172.21.15.96:0/2309122993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 msgr2=0x7f9aa0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a9effd700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a9effd700 1 -- 172.21.15.96:0/2309122993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90005040 con 0x7f9aa00f55c0 2022-02-02T20:29:16.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a9e7fc700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:29:16.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a9effd700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f9a90013a70 tx=0x7f9a90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:16.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a90018070 con 0x7f9aa00f55c0 2022-02-02T20:29:16.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a900097d0 con 0x7f9aa00f55c0 2022-02-02T20:29:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9001c3c0 con 0x7f9aa00f55c0 2022-02-02T20:29:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0107390 con 0x7f9aa00f55c0 2022-02-02T20:29:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.357+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa01078f0 con 0x7f9aa00f55c0 2022-02-02T20:29:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.358+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa0045ad0 con 0x7f9aa00f55c0 2022-02-02T20:29:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.358+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a90007ba0 con 0x7f9aa00f55c0 2022-02-02T20:29:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.359+0000 7f9a877fe700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 0x7f9a88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.359+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a90083730 con 0x7f9aa00f55c0 2022-02-02T20:29:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.359+0000 7f9a9e7fc700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 0x7f9a88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.359+0000 7f9a9e7fc700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 0x7f9a88067290 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f9a94009740 tx=0x7f9a94009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:16.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.363+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a90055320 con 0x7f9aa00f55c0 2022-02-02T20:29:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:16 smithi159 ceph-mon[69013]: pgmap v3815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:16.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:16 smithi159 ceph-mon[69013]: from='client.38020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:16.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.563+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9aa00fde90 con 0x7f9aa00f55c0 2022-02-02T20:29:16.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.563+0000 7f9a877fe700 1 -- 172.21.15.96:0/2309122993 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9a90054f10 con 0x7f9aa00f55c0 2022-02-02T20:29:16.566 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:29:16.566 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:29:16.566 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:29:16.566 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:29:16.567 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:16.567 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:29:16.567 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:29:16.567 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:29:16.568 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:29:16.568 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:29:16.568 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:29:16.568 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:29:16.568 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:29:16.569 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:29:16.569 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:29:16.569 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:29:16.569 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:29:16.570 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:29:16.570 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:29:16.570 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:29:16.570 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:29:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:29:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:29:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:29:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:29:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:29:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:29:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:29:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:29:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:29:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:29:16.573 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:29:16.573 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:16.573 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:16.573 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:29:16.574 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:16.574 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:16.574 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:16.575 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 msgr2=0x7f9a88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 0x7f9a88067290 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f9a94009740 tx=0x7f9a94009be0).stop 2022-02-02T20:29:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 msgr2=0x7f9aa0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:16.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f9a90013a70 tx=0x7f9a90009b30).stop 2022-02-02T20:29:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 shutdown_connections 2022-02-02T20:29:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a88064dd0 0x7f9a88067290 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa00f55c0 0x7f9aa0105e70 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 --2- 172.21.15.96:0/2309122993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa00f6860 0x7f9aa0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 >> 172.21.15.96:0/2309122993 conn(0x7f9aa00f0d40 msgr2=0x7f9aa00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 shutdown_connections 2022-02-02T20:29:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:16.565+0000 7f9aa5889700 1 -- 172.21.15.96:0/2309122993 wait complete. 2022-02-02T20:29:16.578 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:29:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:17 smithi159 ceph-mon[69013]: from='client.38024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3115131789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:29:17.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2309122993' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:29:17.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:17 smithi096 ceph-mon[101353]: from='client.38024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:17.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3115131789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:29:17.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2309122993' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:29:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:18 smithi159 ceph-mon[69013]: pgmap v3816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:18 smithi096 ceph-mon[101353]: pgmap v3816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:20 smithi159 ceph-mon[69013]: pgmap v3817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:20 smithi096 ceph-mon[101353]: pgmap v3817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:22 smithi159 ceph-mon[69013]: pgmap v3818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:22 smithi096 ceph-mon[101353]: pgmap v3818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:24 smithi159 ceph-mon[69013]: pgmap v3819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:24 smithi096 ceph-mon[101353]: pgmap v3819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:26 smithi159 ceph-mon[69013]: pgmap v3820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:26 smithi096 ceph-mon[101353]: pgmap v3820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:27 smithi159 ceph-mon[69013]: pgmap v3821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:29:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:29:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:27 smithi096 ceph-mon[101353]: pgmap v3821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:29:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:29:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:30 smithi159 ceph-mon[69013]: pgmap v3822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:30 smithi096 ceph-mon[101353]: pgmap v3822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:32 smithi159 ceph-mon[69013]: pgmap v3823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:32 smithi096 ceph-mon[101353]: pgmap v3823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:34 smithi159 ceph-mon[69013]: pgmap v3824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:34 smithi096 ceph-mon[101353]: pgmap v3824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:36.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:36 smithi159 ceph-mon[69013]: pgmap v3825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:36 smithi096 ceph-mon[101353]: pgmap v3825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:37 smithi159 ceph-mon[69013]: pgmap v3826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:37 smithi096 ceph-mon[101353]: pgmap v3826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:40 smithi159 ceph-mon[69013]: pgmap v3827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:40 smithi096 ceph-mon[101353]: pgmap v3827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:42 smithi159 ceph-mon[69013]: pgmap v3828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:42 smithi096 ceph-mon[101353]: pgmap v3828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:44 smithi159 ceph-mon[69013]: pgmap v3829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:44 smithi096 ceph-mon[101353]: pgmap v3829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:46 smithi159 ceph-mon[69013]: pgmap v3830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:46 smithi096 ceph-mon[101353]: pgmap v3830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:46.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 -- 172.21.15.96:0/4183100524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f7980 msgr2=0x7f1a300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 --2- 172.21.15.96:0/4183100524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f7980 0x7f1a300f7de0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f1a24004660 tx=0x7f1a24009b30).stop 2022-02-02T20:29:46.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 -- 172.21.15.96:0/4183100524 shutdown_connections 2022-02-02T20:29:46.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 --2- 172.21.15.96:0/4183100524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f7980 0x7f1a300f7de0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 --2- 172.21.15.96:0/4183100524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f66e0 0x7f1a300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 -- 172.21.15.96:0/4183100524 >> 172.21.15.96:0/4183100524 conn(0x7f1a300f1e40 msgr2=0x7f1a300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.676+0000 7f1a3623f700 1 -- 172.21.15.96:0/4183100524 shutdown_connections 2022-02-02T20:29:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.677+0000 7f1a3623f700 1 -- 172.21.15.96:0/4183100524 wait complete. 2022-02-02T20:29:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.677+0000 7f1a3623f700 1 Processor -- start 2022-02-02T20:29:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.677+0000 7f1a3623f700 1 -- start start 2022-02-02T20:29:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a3623f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a3623f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f7980 0x7f1a30107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a3623f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30107a00 con 0x7f1a300f66e0 2022-02-02T20:29:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a3623f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30107b40 con 0x7f1a300f7980 2022-02-02T20:29:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37404/0 (socket says 172.21.15.96:37404) 2022-02-02T20:29:46.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 -- 172.21.15.96:0/3708145008 learned_addr learned my addr 172.21.15.96:0/3708145008 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:46.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2effd700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f7980 0x7f1a30107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 -- 172.21.15.96:0/3708145008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f7980 msgr2=0x7f1a30107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f7980 0x7f1a30107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 -- 172.21.15.96:0/3708145008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24005040 con 0x7f1a300f66e0 2022-02-02T20:29:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.678+0000 7f1a2f7fe700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f1a20002700 tx=0x7f1a20009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.679+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a200079c0 con 0x7f1a300f66e0 2022-02-02T20:29:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.679+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1a2000f040 con 0x7f1a300f66e0 2022-02-02T20:29:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.679+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a301084e0 con 0x7f1a300f66e0 2022-02-02T20:29:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.679+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a20014860 con 0x7f1a300f66e0 2022-02-02T20:29:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.679+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a30108aa0 con 0x7f1a300f66e0 2022-02-02T20:29:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.680+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a30045ad0 con 0x7f1a300f66e0 2022-02-02T20:29:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.680+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1a2001b060 con 0x7f1a300f66e0 2022-02-02T20:29:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.680+0000 7f1a17fff700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 0x7f1a18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.681+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1a200818e0 con 0x7f1a300f66e0 2022-02-02T20:29:46.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.681+0000 7f1a2effd700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 0x7f1a18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.681+0000 7f1a2effd700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 0x7f1a18067290 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f1a24004630 tx=0x7f1a24009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:46.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.685+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1a20053410 con 0x7f1a300f66e0 2022-02-02T20:29:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.865+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a30108d20 con 0x7f1a18064dd0 2022-02-02T20:29:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.866+0000 7f1a17fff700 1 -- 172.21.15.96:0/3708145008 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1a30108d20 con 0x7f1a18064dd0 2022-02-02T20:29:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 msgr2=0x7f1a18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 0x7f1a18067290 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f1a24004630 tx=0x7f1a24009b30).stop 2022-02-02T20:29:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 msgr2=0x7f1a30106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f1a20002700 tx=0x7f1a20009d80).stop 2022-02-02T20:29:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 shutdown_connections 2022-02-02T20:29:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a18064dd0 0x7f1a18067290 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a300f66e0 0x7f1a30106f60 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 --2- 172.21.15.96:0/3708145008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a300f7980 0x7f1a30107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 >> 172.21.15.96:0/3708145008 conn(0x7f1a300f1e40 msgr2=0x7f1a300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 shutdown_connections 2022-02-02T20:29:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.868+0000 7f1a3623f700 1 -- 172.21.15.96:0/3708145008 wait complete. 2022-02-02T20:29:46.880 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:29:46.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.965+0000 7ff2f13cc700 1 -- 172.21.15.96:0/251790023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 msgr2=0x7ff2ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.965+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/251790023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec0f59e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7ff2e40099e0 tx=0x7ff2e4004d10).stop 2022-02-02T20:29:46.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 -- 172.21.15.96:0/251790023 shutdown_connections 2022-02-02T20:29:46.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/251790023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:29:46.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/251790023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec0f59e0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 -- 172.21.15.96:0/251790023 >> 172.21.15.96:0/251790023 conn(0x7ff2ec0f0d40 msgr2=0x7ff2ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:46.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 -- 172.21.15.96:0/251790023 shutdown_connections 2022-02-02T20:29:46.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 -- 172.21.15.96:0/251790023 wait complete. 2022-02-02T20:29:46.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.966+0000 7ff2f13cc700 1 Processor -- start 2022-02-02T20:29:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2f13cc700 1 -- start start 2022-02-02T20:29:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2f13cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2f13cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2f13cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec106b60 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2f13cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec107410 con 0x7ff2ec0f6860 2022-02-02T20:29:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37414/0 (socket says 172.21.15.96:37414) 2022-02-02T20:29:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 -- 172.21.15.96:0/3180811669 learned_addr learned my addr 172.21.15.96:0/3180811669 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2ea7fc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 -- 172.21.15.96:0/3180811669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 msgr2=0x7ff2ec106520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:46.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:46.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.967+0000 7ff2eaffd700 1 -- 172.21.15.96:0/3180811669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4009640 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2eaffd700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7ff2e400c010 tx=0x7ff2e4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e400e070 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2e4007d10 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4018070 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec107690 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.968+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec107b70 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.969+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec0f49b0 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.970+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2e4024060 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.970+0000 7ff2d37fe700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 0x7ff2d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.970+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2e4083450 con 0x7ff2ec0f55c0 2022-02-02T20:29:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.970+0000 7ff2ea7fc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 0x7ff2d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.971+0000 7ff2ea7fc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 0x7ff2d4067290 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7ff2e0006fd0 tx=0x7ff2e0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:46.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:46.975+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2e4054f80 con 0x7ff2ec0f55c0 2022-02-02T20:29:47.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.150+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2ec0fde70 con 0x7ff2d4064dd0 2022-02-02T20:29:47.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.159+0000 7ff2d37fe700 1 -- 172.21.15.96:0/3180811669 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff2ec0fde70 con 0x7ff2d4064dd0 2022-02-02T20:29:47.162 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:29:47.162 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 103m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:29:47.162 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 103m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:29:47.162 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 102m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:29:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 103m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:29:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 103m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:29:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 103m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:29:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 102m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:29:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 102m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:29:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 103m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:29:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 102m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:29:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 103m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:29:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 102m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:29:47.165 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 103m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:29:47.165 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 102m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:29:47.165 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 103m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:29:47.165 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 103m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:29:47.165 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 103m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:29:47.166 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 102m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:29:47.166 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 102m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:29:47.166 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 102m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:29:47.166 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 103m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:29:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 msgr2=0x7ff2d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 0x7ff2d4067290 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7ff2e0006fd0 tx=0x7ff2e0008040).stop 2022-02-02T20:29:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 msgr2=0x7ff2ec106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7ff2e400c010 tx=0x7ff2e4004d10).stop 2022-02-02T20:29:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 shutdown_connections 2022-02-02T20:29:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d4064dd0 0x7ff2d4067290 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec106030 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 --2- 172.21.15.96:0/3180811669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 >> 172.21.15.96:0/3180811669 conn(0x7ff2ec0f0d40 msgr2=0x7ff2ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 shutdown_connections 2022-02-02T20:29:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.161+0000 7ff2f13cc700 1 -- 172.21.15.96:0/3180811669 wait complete. 2022-02-02T20:29:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/1915128661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 msgr2=0x7fd8bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/1915128661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc0f59e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7fd8b0004660 tx=0x7fd8b0009b30).stop 2022-02-02T20:29:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/1915128661 shutdown_connections 2022-02-02T20:29:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/1915128661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 0x7fd8bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/1915128661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc0f59e0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/1915128661 >> 172.21.15.96:0/1915128661 conn(0x7fd8bc0f0d40 msgr2=0x7fd8bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/1915128661 shutdown_connections 2022-02-02T20:29:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/1915128661 wait complete. 2022-02-02T20:29:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 Processor -- start 2022-02-02T20:29:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 -- start start 2022-02-02T20:29:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.258+0000 7fd8c0eb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8c0eb6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 0x7fd8bc10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8c0eb6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc060420 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8c0eb6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc060560 con 0x7fd8bc0f6860 2022-02-02T20:29:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37424/0 (socket says 172.21.15.96:37424) 2022-02-02T20:29:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 -- 172.21.15.96:0/872341436 learned_addr learned my addr 172.21.15.96:0/872341436 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8b9d9b700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 0x7fd8bc10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 -- 172.21.15.96:0/872341436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 msgr2=0x7fd8bc10c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 0x7fd8bc10c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 -- 172.21.15.96:0/872341436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0005040 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8ba59c700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fd8b0004f60 tx=0x7fd8b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b0018070 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8b0009770 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc10c6e0 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.259+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b001c3c0 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.260+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc10cc10 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.260+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc0f49b0 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.261+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8b001d420 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.261+0000 7fd8aaffd700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 0x7fd8a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.261+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8b0083730 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.261+0000 7fd8b9d9b700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 0x7fd8a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.262+0000 7fd8b9d9b700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 0x7fd8a4067290 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd8ac0041d0 tx=0x7fd8ac009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:47.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.265+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8b0051830 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.497+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd8bc0fde90 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.498+0000 7fd8aaffd700 1 -- 172.21.15.96:0/872341436 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd8b0054e50 con 0x7fd8bc0f55c0 2022-02-02T20:29:47.501 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:29:47.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:29:47.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:29:47.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:47.502 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:29:47.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:29:47.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:47.503 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:29:47.503 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:29:47.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:47.503 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:29:47.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:29:47.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:29:47.504 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:29:47.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:29:47.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:29:47.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:29:47.505 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:29:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 msgr2=0x7fd8a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 0x7fd8a4067290 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd8ac0041d0 tx=0x7fd8ac009040).stop 2022-02-02T20:29:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 msgr2=0x7fd8bc109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fd8b0004f60 tx=0x7fd8b0009b30).stop 2022-02-02T20:29:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 shutdown_connections 2022-02-02T20:29:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8a4064dd0 0x7fd8a4067290 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8bc0f55c0 0x7fd8bc109c30 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 --2- 172.21.15.96:0/872341436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0f6860 0x7fd8bc10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 >> 172.21.15.96:0/872341436 conn(0x7fd8bc0f0d40 msgr2=0x7fd8bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 shutdown_connections 2022-02-02T20:29:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.500+0000 7fd8c0eb6700 1 -- 172.21.15.96:0/872341436 wait complete. 2022-02-02T20:29:47.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 -- 172.21.15.96:0/97630415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 msgr2=0x7fbff00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/97630415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff00fbae0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7fbfdc004660 tx=0x7fbfdc009b30).stop 2022-02-02T20:29:47.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 -- 172.21.15.96:0/97630415 shutdown_connections 2022-02-02T20:29:47.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/97630415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff00fbae0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/97630415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 0x7fbff00f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 -- 172.21.15.96:0/97630415 >> 172.21.15.96:0/97630415 conn(0x7fbff00f0b90 msgr2=0x7fbff00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:47.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 -- 172.21.15.96:0/97630415 shutdown_connections 2022-02-02T20:29:47.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.598+0000 7fbff5e5b700 1 -- 172.21.15.96:0/97630415 wait complete. 2022-02-02T20:29:47.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 Processor -- start 2022-02-02T20:29:47.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 -- start start 2022-02-02T20:29:47.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 0x7fbff0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0107870 con 0x7fbff00f96f0 2022-02-02T20:29:47.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff5e5b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01080b0 con 0x7fbff00602b0 2022-02-02T20:29:47.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37436/0 (socket says 172.21.15.96:37436) 2022-02-02T20:29:47.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbfeffff700 1 -- 172.21.15.96:0/2049099640 learned_addr learned my addr 172.21.15.96:0/2049099640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:29:47.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.599+0000 7fbff4e59700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 0x7fbff0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfeffff700 1 -- 172.21.15.96:0/2049099640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 msgr2=0x7fbff0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfeffff700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 0x7fbff0106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfeffff700 1 -- 172.21.15.96:0/2049099640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc005040 con 0x7fbff00f96f0 2022-02-02T20:29:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfeffff700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7fbfdc013a70 tx=0x7fbfdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:47.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfdc018070 con 0x7fbff00f96f0 2022-02-02T20:29:47.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff0108330 con 0x7fbff00f96f0 2022-02-02T20:29:47.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfdc0097d0 con 0x7fbff00f96f0 2022-02-02T20:29:47.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfdc01de80 con 0x7fbff00f96f0 2022-02-02T20:29:47.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.600+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0108810 con 0x7fbff00f96f0 2022-02-02T20:29:47.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.601+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff0059100 con 0x7fbff00f96f0 2022-02-02T20:29:47.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.601+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbfdc007ba0 con 0x7fbff00f96f0 2022-02-02T20:29:47.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.602+0000 7fbfed7fa700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 0x7fbfe00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:29:47.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.602+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbfdc083660 con 0x7fbff00f96f0 2022-02-02T20:29:47.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.602+0000 7fbff4e59700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 0x7fbfe00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:29:47.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.602+0000 7fbff4e59700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 0x7fbfe00672e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fbff0107b40 tx=0x7fbfe400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:29:47.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.606+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbfdc051760 con 0x7fbff00f96f0 2022-02-02T20:29:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.809+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbff00fed20 con 0x7fbff00f96f0 2022-02-02T20:29:47.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.809+0000 7fbfed7fa700 1 -- 172.21.15.96:0/2049099640 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbfdc054d80 con 0x7fbff00f96f0 2022-02-02T20:29:47.812 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:29:47.813 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:29:47.813 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:29:47.813 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:29:47.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:47.814 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:29:47.814 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:29:47.814 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:29:47.814 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:29:47.815 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:29:47.815 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:29:47.815 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:29:47.815 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:29:47.815 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:29:47.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:29:47.816 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:29:47.816 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:29:47.816 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:29:47.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:29:47.817 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:29:47.817 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:29:47.817 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:29:47.818 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:29:47.818 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:29:47.818 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:29:47.819 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:29:47.819 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:29:47.819 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:29:47.819 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:29:47.820 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:29:47.820 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:29:47.820 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:29:47.821 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:47.821 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:47.821 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:29:47.821 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:29:47.821 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:47.822 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:47.822 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:29:47.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 msgr2=0x7fbfe00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 0x7fbfe00672e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fbff0107b40 tx=0x7fbfe400b040).stop 2022-02-02T20:29:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 msgr2=0x7fbff0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:29:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7fbfdc013a70 tx=0x7fbfdc009b30).stop 2022-02-02T20:29:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 shutdown_connections 2022-02-02T20:29:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfe0064e20 0x7fbfe00672e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00602b0 0x7fbff0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 --2- 172.21.15.96:0/2049099640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f96f0 0x7fbff0107270 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:29:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 >> 172.21.15.96:0/2049099640 conn(0x7fbff00f0b90 msgr2=0x7fbff00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:29:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 shutdown_connections 2022-02-02T20:29:47.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:29:47.811+0000 7fbff5e5b700 1 -- 172.21.15.96:0/2049099640 wait complete. 2022-02-02T20:29:47.826 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:29:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:47 smithi159 ceph-mon[69013]: from='client.38036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:47 smithi159 ceph-mon[69013]: from='client.38040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:47 smithi159 ceph-mon[69013]: pgmap v3831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/872341436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:29:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:47 smithi096 ceph-mon[101353]: from='client.38036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:47 smithi096 ceph-mon[101353]: from='client.38040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:29:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:47 smithi096 ceph-mon[101353]: pgmap v3831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:48.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/872341436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:29:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2049099640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:29:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2049099640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:29:50.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:49 smithi159 ceph-mon[69013]: pgmap v3832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:50.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:49 smithi096 ceph-mon[101353]: pgmap v3832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:52 smithi159 ceph-mon[69013]: pgmap v3833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:52 smithi096 ceph-mon[101353]: pgmap v3833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:54 smithi159 ceph-mon[69013]: pgmap v3834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:54 smithi096 ceph-mon[101353]: pgmap v3834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:56 smithi159 ceph-mon[69013]: pgmap v3835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:56 smithi096 ceph-mon[101353]: pgmap v3835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:29:57 smithi159 ceph-mon[69013]: pgmap v3836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:29:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:29:57 smithi096 ceph-mon[101353]: pgmap v3836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:00 smithi159 ceph-mon[69013]: pgmap v3837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:30:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:00 smithi096 ceph-mon[101353]: pgmap v3837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:30:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:02 smithi159 ceph-mon[69013]: pgmap v3838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:02 smithi096 ceph-mon[101353]: pgmap v3838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:04 smithi159 ceph-mon[69013]: pgmap v3839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:04 smithi096 ceph-mon[101353]: pgmap v3839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:06 smithi159 ceph-mon[69013]: pgmap v3840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:06 smithi096 ceph-mon[101353]: pgmap v3840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:07 smithi159 ceph-mon[69013]: pgmap v3841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:07 smithi096 ceph-mon[101353]: pgmap v3841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:10.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:10 smithi159 ceph-mon[69013]: pgmap v3842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:10 smithi096 ceph-mon[101353]: pgmap v3842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:12 smithi159 ceph-mon[69013]: pgmap v3843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:12 smithi096 ceph-mon[101353]: pgmap v3843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:14 smithi159 ceph-mon[69013]: pgmap v3844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:14 smithi096 ceph-mon[101353]: pgmap v3844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:16 smithi159 ceph-mon[69013]: pgmap v3845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:16 smithi096 ceph-mon[101353]: pgmap v3845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- 172.21.15.96:0/331194476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f77d0 msgr2=0x7f366c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 --2- 172.21.15.96:0/331194476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f77d0 0x7f366c0f7c30 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f365c004660 tx=0x7f365c009b30).stop 2022-02-02T20:30:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- 172.21.15.96:0/331194476 shutdown_connections 2022-02-02T20:30:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 --2- 172.21.15.96:0/331194476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f77d0 0x7f366c0f7c30 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 --2- 172.21.15.96:0/331194476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f6530 0x7f366c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- 172.21.15.96:0/331194476 >> 172.21.15.96:0/331194476 conn(0x7f366c0f1c90 msgr2=0x7f366c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- 172.21.15.96:0/331194476 shutdown_connections 2022-02-02T20:30:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- 172.21.15.96:0/331194476 wait complete. 2022-02-02T20:30:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 Processor -- start 2022-02-02T20:30:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.923+0000 7f367281b700 1 -- start start 2022-02-02T20:30:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f367281b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f367281b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f77d0 0x7f366c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f367281b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c109a00 con 0x7f366c0f6530 2022-02-02T20:30:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f367281b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c109b40 con 0x7f366c0f77d0 2022-02-02T20:30:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37452/0 (socket says 172.21.15.96:37452) 2022-02-02T20:30:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 -- 172.21.15.96:0/2654256631 learned_addr learned my addr 172.21.15.96:0/2654256631 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671018700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f77d0 0x7f366c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 -- 172.21.15.96:0/2654256631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f77d0 msgr2=0x7f366c109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f77d0 0x7f366c109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:17.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 -- 172.21.15.96:0/2654256631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c005040 con 0x7f366c0f6530 2022-02-02T20:30:17.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f3671819700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f3668002700 tx=0x7f3668009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:17.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.924+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36680079c0 con 0x7f366c0f6530 2022-02-02T20:30:17.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.925+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f366800f040 con 0x7f366c0f6530 2022-02-02T20:30:17.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.925+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c10a4e0 con 0x7f366c0f6530 2022-02-02T20:30:17.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.925+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3668014860 con 0x7f366c0f6530 2022-02-02T20:30:17.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.925+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c10aaa0 con 0x7f366c0f6530 2022-02-02T20:30:17.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.926+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c045ad0 con 0x7f366c0f6530 2022-02-02T20:30:17.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.926+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f366801b060 con 0x7f366c0f6530 2022-02-02T20:30:17.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.926+0000 7f36627fc700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 0x7f36580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:17.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.927+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f36680817f0 con 0x7f366c0f6530 2022-02-02T20:30:17.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.927+0000 7f3671018700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 0x7f36580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:17.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.927+0000 7f3671018700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 0x7f36580672e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f365c004630 tx=0x7f365c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:17.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:17.931+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3668053320 con 0x7f366c0f6530 2022-02-02T20:30:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:17 smithi159 ceph-mon[69013]: pgmap v3846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:17 smithi096 ceph-mon[101353]: pgmap v3846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.112+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f366c0fee60 con 0x7f3658064e20 2022-02-02T20:30:18.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.114+0000 7f36627fc700 1 -- 172.21.15.96:0/2654256631 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f366c0fee60 con 0x7f3658064e20 2022-02-02T20:30:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 msgr2=0x7f36580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 0x7f36580672e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f365c004630 tx=0x7f365c009b30).stop 2022-02-02T20:30:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 msgr2=0x7f366c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f3668002700 tx=0x7f3668009d80).stop 2022-02-02T20:30:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 shutdown_connections 2022-02-02T20:30:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3658064e20 0x7f36580672e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c0f6530 0x7f366c108f60 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 --2- 172.21.15.96:0/2654256631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f366c0f77d0 0x7f366c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.115+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 >> 172.21.15.96:0/2654256631 conn(0x7f366c0f1c90 msgr2=0x7f366c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.116+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 shutdown_connections 2022-02-02T20:30:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.116+0000 7f367281b700 1 -- 172.21.15.96:0/2654256631 wait complete. 2022-02-02T20:30:18.127 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:30:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 -- 172.21.15.96:0/2764582118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 msgr2=0x7f38800f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 --2- 172.21.15.96:0/2764582118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f38800f6b00 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f3868004660 tx=0x7f3868009b30).stop 2022-02-02T20:30:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 -- 172.21.15.96:0/2764582118 shutdown_connections 2022-02-02T20:30:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 --2- 172.21.15.96:0/2764582118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38800f7980 0x7f38800f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:30:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 --2- 172.21.15.96:0/2764582118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f38800f6b00 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 -- 172.21.15.96:0/2764582118 >> 172.21.15.96:0/2764582118 conn(0x7f38800f1e40 msgr2=0x7f38800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 -- 172.21.15.96:0/2764582118 shutdown_connections 2022-02-02T20:30:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.213+0000 7f38868c3700 1 -- 172.21.15.96:0/2764582118 wait complete. 2022-02-02T20:30:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 Processor -- start 2022-02-02T20:30:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 -- start start 2022-02-02T20:30:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38800f7980 0x7f38801074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880107ae0 con 0x7f38800f66e0 2022-02-02T20:30:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f38868c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880108390 con 0x7f38800f7980 2022-02-02T20:30:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f387ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f387ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37462/0 (socket says 172.21.15.96:37462) 2022-02-02T20:30:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.214+0000 7f387ffff700 1 -- 172.21.15.96:0/4115292093 learned_addr learned my addr 172.21.15.96:0/4115292093 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387ffff700 1 -- 172.21.15.96:0/4115292093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38800f7980 msgr2=0x7f38801074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387ffff700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38800f7980 0x7f38801074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:30:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387ffff700 1 -- 172.21.15.96:0/4115292093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868005040 con 0x7f38800f66e0 2022-02-02T20:30:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387ffff700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f3868004f60 tx=0x7f3868009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3868018070 con 0x7f38800f66e0 2022-02-02T20:30:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3868007ba0 con 0x7f38800f66e0 2022-02-02T20:30:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3880108610 con 0x7f38800f66e0 2022-02-02T20:30:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386801c620 con 0x7f38800f66e0 2022-02-02T20:30:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.215+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880108b70 con 0x7f38800f66e0 2022-02-02T20:30:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.216+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38800f5ad0 con 0x7f38800f66e0 2022-02-02T20:30:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.216+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f386801c8e0 con 0x7f38800f66e0 2022-02-02T20:30:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.217+0000 7f387cff9700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 0x7f386c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.217+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3868083960 con 0x7f38800f66e0 2022-02-02T20:30:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.217+0000 7f387f7fe700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 0x7f386c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.217+0000 7f387f7fe700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 0x7f386c067290 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f3870009610 tx=0x7f3870006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.221+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3868055490 con 0x7f38800f66e0 2022-02-02T20:30:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.394+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f38800ff0b0 con 0x7f386c064dd0 2022-02-02T20:30:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.404+0000 7f387cff9700 1 -- 172.21.15.96:0/4115292093 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f38800ff0b0 con 0x7f386c064dd0 2022-02-02T20:30:18.406 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:30:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 104m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:30:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 104m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:30:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 102m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:30:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 104m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:30:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 104m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:30:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 104m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:30:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 102m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:30:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 102m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:30:18.408 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 104m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:30:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 102m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:30:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 104m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:30:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 102m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:30:18.409 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 104m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:30:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 102m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:30:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 104m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:30:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 104m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:30:18.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 104m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:30:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 102m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:30:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 102m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:30:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 102m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:30:18.411 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 104m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:30:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 msgr2=0x7f386c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 0x7f386c067290 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f3870009610 tx=0x7f3870006ab0).stop 2022-02-02T20:30:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 msgr2=0x7f3880106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f3868004f60 tx=0x7f3868009b30).stop 2022-02-02T20:30:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 shutdown_connections 2022-02-02T20:30:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f386c064dd0 0x7f386c067290 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38800f66e0 0x7f3880106fb0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 --2- 172.21.15.96:0/4115292093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38800f7980 0x7f38801074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:30:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 >> 172.21.15.96:0/4115292093 conn(0x7f38800f1e40 msgr2=0x7f38800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 shutdown_connections 2022-02-02T20:30:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.406+0000 7f38868c3700 1 -- 172.21.15.96:0/4115292093 wait complete. 2022-02-02T20:30:18.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 -- 172.21.15.96:0/3576973282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 msgr2=0x7f7bfc0f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 --2- 172.21.15.96:0/3576973282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc0f6d00 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f7bf0004660 tx=0x7f7bf0009b30).stop 2022-02-02T20:30:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 -- 172.21.15.96:0/3576973282 shutdown_connections 2022-02-02T20:30:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 --2- 172.21.15.96:0/3576973282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 0x7f7bfc0f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 --2- 172.21.15.96:0/3576973282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc0f6d00 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 -- 172.21.15.96:0/3576973282 >> 172.21.15.96:0/3576973282 conn(0x7f7bfc0f2020 msgr2=0x7f7bfc0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 -- 172.21.15.96:0/3576973282 shutdown_connections 2022-02-02T20:30:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 -- 172.21.15.96:0/3576973282 wait complete. 2022-02-02T20:30:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.503+0000 7f7c0205c700 1 Processor -- start 2022-02-02T20:30:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7c0205c700 1 -- start start 2022-02-02T20:30:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7c0205c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7c0205c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 0x7f7bfc107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7c0205c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc107c00 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7c0205c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc107d40 con 0x7f7bfc0f7b80 2022-02-02T20:30:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37472/0 (socket says 172.21.15.96:37472) 2022-02-02T20:30:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 -- 172.21.15.96:0/1396209984 learned_addr learned my addr 172.21.15.96:0/1396209984 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfaffd700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 0x7f7bfc107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 -- 172.21.15.96:0/1396209984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 msgr2=0x7f7bfc107650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 0x7f7bfc107650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 -- 172.21.15.96:0/1396209984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0005040 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.504+0000 7f7bfb7fe700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f7bf0014040 tx=0x7f7bf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.505+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf0019070 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.505+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc108680 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.505+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bf0007e70 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.505+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf0014d10 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.505+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc108be0 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.506+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc045ad0 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.506+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7bf0025070 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.506+0000 7f7be3fff700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 0x7f7be4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.507+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7bf0082a30 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.507+0000 7f7bfaffd700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 0x7f7be4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.507+0000 7f7bfaffd700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 0x7f7be4067290 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f7bec009fd0 tx=0x7f7bec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.511+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7bf0054560 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.744+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bfc0ff0a0 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.745+0000 7f7be3fff700 1 -- 172.21.15.96:0/1396209984 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7bf0023070 con 0x7f7bfc0f68e0 2022-02-02T20:30:18.748 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:30:18.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:30:18.748 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:30:18.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:18.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:30:18.750 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:30:18.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:18.751 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:30:18.751 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:30:18.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:18.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:30:18.755 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:30:18.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:18.756 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:30:18.757 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:30:18.757 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:30:18.757 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:30:18.758 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:30:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 msgr2=0x7f7be4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 0x7f7be4067290 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f7bec009fd0 tx=0x7f7bec00b040).stop 2022-02-02T20:30:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 msgr2=0x7f7bfc107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f7bf0014040 tx=0x7f7bf000b040).stop 2022-02-02T20:30:18.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 shutdown_connections 2022-02-02T20:30:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7be4064dd0 0x7f7be4067290 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bfc0f68e0 0x7f7bfc107160 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 --2- 172.21.15.96:0/1396209984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bfc0f7b80 0x7f7bfc107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 >> 172.21.15.96:0/1396209984 conn(0x7f7bfc0f2020 msgr2=0x7f7bfc0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 shutdown_connections 2022-02-02T20:30:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.747+0000 7f7c0205c700 1 -- 172.21.15.96:0/1396209984 wait complete. 2022-02-02T20:30:18.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 -- 172.21.15.96:0/964637730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 msgr2=0x7f8dc00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 --2- 172.21.15.96:0/964637730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc00f7de0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f8db0004660 tx=0x7f8db0009b30).stop 2022-02-02T20:30:18.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 -- 172.21.15.96:0/964637730 shutdown_connections 2022-02-02T20:30:18.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 --2- 172.21.15.96:0/964637730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc00f7de0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 --2- 172.21.15.96:0/964637730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:30:18.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 -- 172.21.15.96:0/964637730 >> 172.21.15.96:0/964637730 conn(0x7f8dc00f1e40 msgr2=0x7f8dc00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:18.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 -- 172.21.15.96:0/964637730 shutdown_connections 2022-02-02T20:30:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 -- 172.21.15.96:0/964637730 wait complete. 2022-02-02T20:30:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.846+0000 7f8dc7443700 1 Processor -- start 2022-02-02T20:30:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 -- start start 2022-02-02T20:30:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0107ae0 con 0x7f8dc00f7980 2022-02-02T20:30:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0108390 con 0x7f8dc00f66e0 2022-02-02T20:30:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37484/0 (socket says 172.21.15.96:37484) 2022-02-02T20:30:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 -- 172.21.15.96:0/4198902368 learned_addr learned my addr 172.21.15.96:0/4198902368 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc51df700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 -- 172.21.15.96:0/4198902368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 msgr2=0x7f8dc0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 -- 172.21.15.96:0/4198902368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0005040 con 0x7f8dc00f7980 2022-02-02T20:30:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc51df700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:30:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc49de700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f8db0009990 tx=0x7f8db0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db0018070 con 0x7f8dc00f7980 2022-02-02T20:30:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc0108610 con 0x7f8dc00f7980 2022-02-02T20:30:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8db0007ca0 con 0x7f8dc00f7980 2022-02-02T20:30:18.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.847+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db001c620 con 0x7f8dc00f7980 2022-02-02T20:30:18.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.848+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc0108b70 con 0x7f8dc00f7980 2022-02-02T20:30:18.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.849+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc00f5ad0 con 0x7f8dc00f7980 2022-02-02T20:30:18.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.849+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8db001d960 con 0x7f8dc00f7980 2022-02-02T20:30:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.849+0000 7f8db5ffb700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 0x7f8dac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.850+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8db0083700 con 0x7f8dc00f7980 2022-02-02T20:30:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.850+0000 7f8dc51df700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 0x7f8dac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.850+0000 7f8dc51df700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 0x7f8dac067290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f8dc00f77e0 tx=0x7f8dbc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:18.854+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8db0055230 con 0x7f8dc00f7980 2022-02-02T20:30:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:18 smithi159 ceph-mon[69013]: from='client.38052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:18 smithi159 ceph-mon[69013]: from='client.38056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:19.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1396209984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:30:19.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.053+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8dc00fef40 con 0x7f8dc00f7980 2022-02-02T20:30:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:18 smithi096 ceph-mon[101353]: from='client.38052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:18 smithi096 ceph-mon[101353]: from='client.38056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:19.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1396209984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:30:19.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.054+0000 7f8db5ffb700 1 -- 172.21.15.96:0/4198902368 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8db0054e20 con 0x7f8dc00f7980 2022-02-02T20:30:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:30:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:30:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:30:19.057 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:30:19.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:30:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:30:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:30:19.058 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:30:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:30:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:30:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:30:19.059 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:30:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:30:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:30:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:30:19.060 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:30:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:30:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:30:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:30:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:30:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:30:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:30:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:30:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:30:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:30:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:30:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:30:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:30:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:30:19.063 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:30:19.064 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:30:19.064 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:19.064 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:19.065 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:30:19.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:19.065 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:19.065 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:19.066 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:19.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 msgr2=0x7f8dac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 0x7f8dac067290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f8dc00f77e0 tx=0x7f8dbc008040).stop 2022-02-02T20:30:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 msgr2=0x7f8dc01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f8db0009990 tx=0x7f8db0009b30).stop 2022-02-02T20:30:19.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 shutdown_connections 2022-02-02T20:30:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8dac064dd0 0x7f8dac067290 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc00f66e0 0x7f8dc0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 --2- 172.21.15.96:0/4198902368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8dc00f7980 0x7f8dc01074a0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:19.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 >> 172.21.15.96:0/4198902368 conn(0x7f8dc00f1e40 msgr2=0x7f8dc00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 shutdown_connections 2022-02-02T20:30:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:19.056+0000 7f8dc7443700 1 -- 172.21.15.96:0/4198902368 wait complete. 2022-02-02T20:30:19.069 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:30:20.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4198902368' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:30:20.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:19 smithi159 ceph-mon[69013]: pgmap v3847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4198902368' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:30:20.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:19 smithi096 ceph-mon[101353]: pgmap v3847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:22 smithi159 ceph-mon[69013]: pgmap v3848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:22 smithi096 ceph-mon[101353]: pgmap v3848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:24 smithi159 ceph-mon[69013]: pgmap v3849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:24 smithi096 ceph-mon[101353]: pgmap v3849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:26 smithi159 ceph-mon[69013]: pgmap v3850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:26 smithi096 ceph-mon[101353]: pgmap v3850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:27 smithi159 ceph-mon[69013]: pgmap v3851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:28.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:30:28.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:30:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:27 smithi096 ceph-mon[101353]: pgmap v3851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:30:28.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:30:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:30 smithi159 ceph-mon[69013]: pgmap v3852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:30 smithi096 ceph-mon[101353]: pgmap v3852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:32.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:32 smithi159 ceph-mon[69013]: pgmap v3853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:32 smithi096 ceph-mon[101353]: pgmap v3853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:34 smithi159 ceph-mon[69013]: pgmap v3854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:34 smithi096 ceph-mon[101353]: pgmap v3854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:36 smithi159 ceph-mon[69013]: pgmap v3855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:36 smithi096 ceph-mon[101353]: pgmap v3855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:37 smithi159 ceph-mon[69013]: pgmap v3856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:37 smithi096 ceph-mon[101353]: pgmap v3856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:40 smithi159 ceph-mon[69013]: pgmap v3857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:40.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:40 smithi096 ceph-mon[101353]: pgmap v3857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:42 smithi159 ceph-mon[69013]: pgmap v3858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:42 smithi096 ceph-mon[101353]: pgmap v3858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:44 smithi159 ceph-mon[69013]: pgmap v3859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:44 smithi096 ceph-mon[101353]: pgmap v3859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:46 smithi159 ceph-mon[69013]: pgmap v3860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:46 smithi096 ceph-mon[101353]: pgmap v3860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:47 smithi159 ceph-mon[69013]: pgmap v3861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:47 smithi096 ceph-mon[101353]: pgmap v3861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 -- 172.21.15.96:0/3816839957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 msgr2=0x7fed280f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 --2- 172.21.15.96:0/3816839957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed280f4820 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7fed24004660 tx=0x7fed24009b30).stop 2022-02-02T20:30:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 -- 172.21.15.96:0/3816839957 shutdown_connections 2022-02-02T20:30:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 --2- 172.21.15.96:0/3816839957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed280f4820 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 --2- 172.21.15.96:0/3816839957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 0x7fed280f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:30:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 -- 172.21.15.96:0/3816839957 >> 172.21.15.96:0/3816839957 conn(0x7fed280f0540 msgr2=0x7fed280f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 -- 172.21.15.96:0/3816839957 shutdown_connections 2022-02-02T20:30:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.166+0000 7fed2feb7700 1 -- 172.21.15.96:0/3816839957 wait complete. 2022-02-02T20:30:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 Processor -- start 2022-02-02T20:30:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 -- start start 2022-02-02T20:30:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 0x7fed28106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28107a80 con 0x7fed280f8610 2022-02-02T20:30:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2feb7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28108330 con 0x7fed280f7d00 2022-02-02T20:30:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37504/0 (socket says 172.21.15.96:37504) 2022-02-02T20:30:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 -- 172.21.15.96:0/868021080 learned_addr learned my addr 172.21.15.96:0/868021080 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2dc53700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 0x7fed28106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 -- 172.21.15.96:0/868021080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 msgr2=0x7fed28106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 0x7fed28106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 -- 172.21.15.96:0/868021080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24005040 con 0x7fed280f8610 2022-02-02T20:30:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.167+0000 7fed2d452700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fed24009990 tx=0x7fed24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.168+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed24018070 con 0x7fed280f8610 2022-02-02T20:30:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.168+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed24007ca0 con 0x7fed280f8610 2022-02-02T20:30:49.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.168+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed281085b0 con 0x7fed280f8610 2022-02-02T20:30:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.168+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2401c620 con 0x7fed280f8610 2022-02-02T20:30:49.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.168+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed28108b10 con 0x7fed280f8610 2022-02-02T20:30:49.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.169+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed280f41d0 con 0x7fed280f8610 2022-02-02T20:30:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.169+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed2401d960 con 0x7fed280f8610 2022-02-02T20:30:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.170+0000 7fed1e7fc700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.170+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed240837d0 con 0x7fed280f8610 2022-02-02T20:30:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.170+0000 7fed2dc53700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.170+0000 7fed2dc53700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 0x7fed14067290 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fed1800b790 tx=0x7fed18008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.174+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed24055470 con 0x7fed280f8610 2022-02-02T20:30:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.351+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed280fef30 con 0x7fed14064dd0 2022-02-02T20:30:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.352+0000 7fed1e7fc700 1 -- 172.21.15.96:0/868021080 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fed280fef30 con 0x7fed14064dd0 2022-02-02T20:30:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 msgr2=0x7fed14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 0x7fed14067290 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fed1800b790 tx=0x7fed18008040).stop 2022-02-02T20:30:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 msgr2=0x7fed28107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fed24009990 tx=0x7fed24009b30).stop 2022-02-02T20:30:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 shutdown_connections 2022-02-02T20:30:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed280f7d00 0x7fed28106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 --2- 172.21.15.96:0/868021080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed280f8610 0x7fed28107440 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 >> 172.21.15.96:0/868021080 conn(0x7fed280f0540 msgr2=0x7fed280fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 shutdown_connections 2022-02-02T20:30:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.354+0000 7fed2feb7700 1 -- 172.21.15.96:0/868021080 wait complete. 2022-02-02T20:30:49.365 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:30:49.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 -- 172.21.15.96:0/681745458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 msgr2=0x7fb1c80f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 --2- 172.21.15.96:0/681745458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f6ce0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fb1c4004660 tx=0x7fb1c4009b30).stop 2022-02-02T20:30:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 -- 172.21.15.96:0/681745458 shutdown_connections 2022-02-02T20:30:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 --2- 172.21.15.96:0/681745458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f6ce0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 --2- 172.21.15.96:0/681745458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 0x7fb1c80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 -- 172.21.15.96:0/681745458 >> 172.21.15.96:0/681745458 conn(0x7fb1c80f0d40 msgr2=0x7fb1c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 -- 172.21.15.96:0/681745458 shutdown_connections 2022-02-02T20:30:49.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.452+0000 7fb1cf661700 1 -- 172.21.15.96:0/681745458 wait complete. 2022-02-02T20:30:49.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 Processor -- start 2022-02-02T20:30:49.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 -- start start 2022-02-02T20:30:49.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 0x7fb1c80f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80f8940 con 0x7fb1c80f6880 2022-02-02T20:30:49.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cf661700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80f8a80 con 0x7fb1c80f55e0 2022-02-02T20:30:49.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1ccbfc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1ccbfc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37514/0 (socket says 172.21.15.96:37514) 2022-02-02T20:30:49.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1ccbfc700 1 -- 172.21.15.96:0/1388654397 learned_addr learned my addr 172.21.15.96:0/1388654397 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:49.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.453+0000 7fb1cd3fd700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 0x7fb1c80f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1ccbfc700 1 -- 172.21.15.96:0/1388654397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 msgr2=0x7fb1c80f9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1ccbfc700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 0x7fb1c80f9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1ccbfc700 1 -- 172.21.15.96:0/1388654397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4005040 con 0x7fb1c80f6880 2022-02-02T20:30:49.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1ccbfc700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fb1c4009990 tx=0x7fb1c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c4018070 con 0x7fb1c80f6880 2022-02-02T20:30:49.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1c4007ba0 con 0x7fb1c80f6880 2022-02-02T20:30:49.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80f8d00 con 0x7fb1c80f6880 2022-02-02T20:30:49.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c401c3c0 con 0x7fb1c80f6880 2022-02-02T20:30:49.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.454+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80f9260 con 0x7fb1c80f6880 2022-02-02T20:30:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.455+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8045ad0 con 0x7fb1c80f6880 2022-02-02T20:30:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.456+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb1c401d420 con 0x7fb1c80f6880 2022-02-02T20:30:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.456+0000 7fb1bdffb700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 0x7fb1b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.456+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb1c4083630 con 0x7fb1c80f6880 2022-02-02T20:30:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.456+0000 7fb1cd3fd700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 0x7fb1b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.457+0000 7fb1cd3fd700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 0x7fb1b4067290 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb1c80f9cf0 tx=0x7fb1b800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.460+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb1c4051730 con 0x7fb1c80f6880 2022-02-02T20:30:49.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.632+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1c805fe50 con 0x7fb1b4064dd0 2022-02-02T20:30:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.642+0000 7fb1bdffb700 1 -- 172.21.15.96:0/1388654397 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb1c805fe50 con 0x7fb1b4064dd0 2022-02-02T20:30:49.643 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:30:49.644 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 104m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:30:49.644 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 104m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:30:49.644 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 103m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:30:49.644 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 104m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:30:49.644 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 104m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:30:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 104m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:30:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 103m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:30:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 103m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:30:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 104m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:30:49.646 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 103m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:30:49.646 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 104m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:30:49.646 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 103m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:30:49.647 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 104m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:30:49.647 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 103m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:30:49.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 104m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:30:49.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 104m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:30:49.648 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 104m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:30:49.648 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 103m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:30:49.648 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 103m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:30:49.648 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 103m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:30:49.648 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 104m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:30:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 msgr2=0x7fb1b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 0x7fb1b4067290 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb1c80f9cf0 tx=0x7fb1b800b040).stop 2022-02-02T20:30:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 msgr2=0x7fb1c80f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fb1c4009990 tx=0x7fb1c4009b30).stop 2022-02-02T20:30:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 shutdown_connections 2022-02-02T20:30:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1b4064dd0 0x7fb1b4067290 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1c80f55e0 0x7fb1c80f9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 --2- 172.21.15.96:0/1388654397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1c80f6880 0x7fb1c80f83e0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.643+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 >> 172.21.15.96:0/1388654397 conn(0x7fb1c80f0d40 msgr2=0x7fb1c805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.644+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 shutdown_connections 2022-02-02T20:30:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.644+0000 7fb1cf661700 1 -- 172.21.15.96:0/1388654397 wait complete. 2022-02-02T20:30:49.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- 172.21.15.96:0/2525415050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 msgr2=0x7fe2300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 --2- 172.21.15.96:0/2525415050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe2300f59e0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7fe224004660 tx=0x7fe224009b30).stop 2022-02-02T20:30:49.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- 172.21.15.96:0/2525415050 shutdown_connections 2022-02-02T20:30:49.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 --2- 172.21.15.96:0/2525415050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2300f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 --2- 172.21.15.96:0/2525415050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe2300f59e0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- 172.21.15.96:0/2525415050 >> 172.21.15.96:0/2525415050 conn(0x7fe2300f0d40 msgr2=0x7fe2300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- 172.21.15.96:0/2525415050 shutdown_connections 2022-02-02T20:30:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- 172.21.15.96:0/2525415050 wait complete. 2022-02-02T20:30:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 Processor -- start 2022-02-02T20:30:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.740+0000 7fe234c71700 1 -- start start 2022-02-02T20:30:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe234c71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe234c71700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2301051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe234c71700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301057f0 con 0x7fe2300f55c0 2022-02-02T20:30:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe234c71700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230105930 con 0x7fe2300f6860 2022-02-02T20:30:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37522/0 (socket says 172.21.15.96:37522) 2022-02-02T20:30:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 -- 172.21.15.96:0/1952735862 learned_addr learned my addr 172.21.15.96:0/1952735862 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22dd9b700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2301051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 -- 172.21.15.96:0/1952735862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 msgr2=0x7fe2301051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2301051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 -- 172.21.15.96:0/1952735862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224005040 con 0x7fe2300f55c0 2022-02-02T20:30:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22dd9b700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2301051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:30:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe22e59c700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7fe224013a70 tx=0x7fe224009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe224018070 con 0x7fe2300f55c0 2022-02-02T20:30:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2240097d0 con 0x7fe2300f55c0 2022-02-02T20:30:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe230106240 con 0x7fe2300f55c0 2022-02-02T20:30:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.741+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22401c3c0 con 0x7fe2300f55c0 2022-02-02T20:30:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.742+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2301067a0 con 0x7fe2300f55c0 2022-02-02T20:30:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.742+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe230045ad0 con 0x7fe2300f55c0 2022-02-02T20:30:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.743+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe224007ba0 con 0x7fe2300f55c0 2022-02-02T20:30:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.743+0000 7fe21effd700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 0x7fe218067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.743+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe224083740 con 0x7fe2300f55c0 2022-02-02T20:30:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.743+0000 7fe22dd9b700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 0x7fe218067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.744+0000 7fe22dd9b700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 0x7fe218067290 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fe220009740 tx=0x7fe220009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.748+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe224051900 con 0x7fe2300f55c0 2022-02-02T20:30:49.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.981+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2300fde80 con 0x7fe2300f55c0 2022-02-02T20:30:49.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.981+0000 7fe21effd700 1 -- 172.21.15.96:0/1952735862 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe224054f20 con 0x7fe2300f55c0 2022-02-02T20:30:49.983 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:30:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:30:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:30:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:49.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:30:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:30:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:49.985 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:30:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:30:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:30:49.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:30:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:30:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:30:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:30:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:30:49.987 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:30:49.988 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:30:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 msgr2=0x7fe218067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 0x7fe218067290 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fe220009740 tx=0x7fe220009be0).stop 2022-02-02T20:30:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 msgr2=0x7fe230104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7fe224013a70 tx=0x7fe224009b30).stop 2022-02-02T20:30:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 shutdown_connections 2022-02-02T20:30:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe218064dd0 0x7fe218067290 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2300f55c0 0x7fe230104d00 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 --2- 172.21.15.96:0/1952735862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2300f6860 0x7fe2301051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.983+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 >> 172.21.15.96:0/1952735862 conn(0x7fe2300f0d40 msgr2=0x7fe23005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.984+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 shutdown_connections 2022-02-02T20:30:49.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:49.984+0000 7fe234c71700 1 -- 172.21.15.96:0/1952735862 wait complete. 2022-02-02T20:30:50.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 -- 172.21.15.96:0/930068869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 msgr2=0x7f96000f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:50.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 --2- 172.21.15.96:0/930068869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96000f6b30 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f95ec004660 tx=0x7f95ec009b30).stop 2022-02-02T20:30:50.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 -- 172.21.15.96:0/930068869 shutdown_connections 2022-02-02T20:30:50.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 --2- 172.21.15.96:0/930068869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96000f6b30 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 --2- 172.21.15.96:0/930068869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 0x7f96000f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 -- 172.21.15.96:0/930068869 >> 172.21.15.96:0/930068869 conn(0x7f96000f0b90 msgr2=0x7f96000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:50.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 -- 172.21.15.96:0/930068869 shutdown_connections 2022-02-02T20:30:50.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.081+0000 7f9605e0f700 1 -- 172.21.15.96:0/930068869 wait complete. 2022-02-02T20:30:50.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.082+0000 7f9605e0f700 1 Processor -- start 2022-02-02T20:30:50.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.082+0000 7f9605e0f700 1 -- start start 2022-02-02T20:30:50.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 0x7f9600105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:50.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:50.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9600106670 con 0x7f96000f66d0 2022-02-02T20:30:50.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001067b0 con 0x7f96000f5430 2022-02-02T20:30:50.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:50.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37534/0 (socket says 172.21.15.96:37534) 2022-02-02T20:30:50.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 -- 172.21.15.96:0/2600216276 learned_addr learned my addr 172.21.15.96:0/2600216276 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:30:50.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9604e0d700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 0x7f9600105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:50.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 -- 172.21.15.96:0/2600216276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 msgr2=0x7f9600105bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:50.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 0x7f9600105bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 -- 172.21.15.96:0/2600216276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec005040 con 0x7f96000f66d0 2022-02-02T20:30:50.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fffff700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f95ec000c00 tx=0x7f95ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:50.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec019070 con 0x7f96000f66d0 2022-02-02T20:30:50.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96001070f0 con 0x7f96000f66d0 2022-02-02T20:30:50.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95ec007e70 con 0x7f96000f66d0 2022-02-02T20:30:50.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec014d90 con 0x7f96000f66d0 2022-02-02T20:30:50.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.083+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9600107650 con 0x7f96000f66d0 2022-02-02T20:30:50.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.084+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600045ad0 con 0x7f96000f66d0 2022-02-02T20:30:50.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.085+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f95ec025070 con 0x7f96000f66d0 2022-02-02T20:30:50.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.085+0000 7f95fd7fa700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 0x7f95f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:30:50.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.085+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95ec082a10 con 0x7f96000f66d0 2022-02-02T20:30:50.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.085+0000 7f9604e0d700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 0x7f95f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:30:50.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.085+0000 7f9604e0d700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 0x7f95f00672e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f96000f6530 tx=0x7f95f400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:30:50.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.089+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95ec054540 con 0x7f96000f66d0 2022-02-02T20:30:50.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.291+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9600027a00 con 0x7f96000f66d0 2022-02-02T20:30:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.291+0000 7f95fd7fa700 1 -- 172.21.15.96:0/2600216276 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f95ec023020 con 0x7f96000f66d0 2022-02-02T20:30:50.293 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:30:50.293 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:30:50.294 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:30:50.294 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:30:50.294 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:50.294 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:30:50.295 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:30:50.295 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:30:50.295 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:30:50.295 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:30:50.295 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:30:50.296 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:30:50.296 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:30:50.296 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:30:50.296 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:30:50.297 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:30:50.297 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:30:50.297 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:30:50.297 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:30:50.297 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:30:50.298 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:30:50.298 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:30:50.298 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:30:50.298 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:30:50.298 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:30:50.299 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:30:50.299 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:30:50.299 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:30:50.299 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:30:50.300 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:30:50.300 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:30:50.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:30:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:50.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:50.301 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:30:50.301 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:30:50.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:50.302 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:50.302 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:30:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 msgr2=0x7f95f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 0x7f95f00672e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f96000f6530 tx=0x7f95f400b040).stop 2022-02-02T20:30:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 msgr2=0x7f96001060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:30:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f95ec000c00 tx=0x7f95ec00b040).stop 2022-02-02T20:30:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 shutdown_connections 2022-02-02T20:30:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95f0064e20 0x7f95f00672e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96000f5430 0x7f9600105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 --2- 172.21.15.96:0/2600216276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96000f66d0 0x7f96001060c0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:30:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 >> 172.21.15.96:0/2600216276 conn(0x7f96000f0b90 msgr2=0x7f96000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:30:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 shutdown_connections 2022-02-02T20:30:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:30:50.293+0000 7f9605e0f700 1 -- 172.21.15.96:0/2600216276 wait complete. 2022-02-02T20:30:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:30:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:50 smithi159 ceph-mon[69013]: pgmap v3862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:50 smithi159 ceph-mon[69013]: from='client.38068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:50 smithi159 ceph-mon[69013]: from='client.38072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1952735862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:30:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:50 smithi096 ceph-mon[101353]: pgmap v3862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:50 smithi096 ceph-mon[101353]: from='client.38068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:50 smithi096 ceph-mon[101353]: from='client.38072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:30:50.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1952735862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:30:51.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2600216276' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:30:51.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2600216276' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:30:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:52 smithi159 ceph-mon[69013]: pgmap v3863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:52 smithi096 ceph-mon[101353]: pgmap v3863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:54 smithi159 ceph-mon[69013]: pgmap v3864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:54 smithi096 ceph-mon[101353]: pgmap v3864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:56 smithi159 ceph-mon[69013]: pgmap v3865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:56 smithi096 ceph-mon[101353]: pgmap v3865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:30:57 smithi159 ceph-mon[69013]: pgmap v3866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:30:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:30:57 smithi096 ceph-mon[101353]: pgmap v3866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:00 smithi159 ceph-mon[69013]: pgmap v3867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:00 smithi096 ceph-mon[101353]: pgmap v3867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:02 smithi159 ceph-mon[69013]: pgmap v3868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:02 smithi096 ceph-mon[101353]: pgmap v3868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:04 smithi159 ceph-mon[69013]: pgmap v3869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:04 smithi096 ceph-mon[101353]: pgmap v3869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:06 smithi159 ceph-mon[69013]: pgmap v3870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:06 smithi096 ceph-mon[101353]: pgmap v3870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:08.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:07 smithi159 ceph-mon[69013]: pgmap v3871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:07 smithi096 ceph-mon[101353]: pgmap v3871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:10 smithi159 ceph-mon[69013]: pgmap v3872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:10 smithi096 ceph-mon[101353]: pgmap v3872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:12 smithi159 ceph-mon[69013]: pgmap v3873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:12 smithi096 ceph-mon[101353]: pgmap v3873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:14 smithi159 ceph-mon[69013]: pgmap v3874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:14 smithi096 ceph-mon[101353]: pgmap v3874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:16 smithi159 ceph-mon[69013]: pgmap v3875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:16 smithi096 ceph-mon[101353]: pgmap v3875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:18.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:17 smithi159 ceph-mon[69013]: pgmap v3876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:17 smithi096 ceph-mon[101353]: pgmap v3876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:20.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 -- 172.21.15.96:0/3222764355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 msgr2=0x7f50480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 --2- 172.21.15.96:0/3222764355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f50480f7de0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f5038004660 tx=0x7f5038009b30).stop 2022-02-02T20:31:20.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 -- 172.21.15.96:0/3222764355 shutdown_connections 2022-02-02T20:31:20.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 --2- 172.21.15.96:0/3222764355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f50480f7de0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 --2- 172.21.15.96:0/3222764355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 0x7f50480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 -- 172.21.15.96:0/3222764355 >> 172.21.15.96:0/3222764355 conn(0x7f50480f1e40 msgr2=0x7f50480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 -- 172.21.15.96:0/3222764355 shutdown_connections 2022-02-02T20:31:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.405+0000 7f504d0c1700 1 -- 172.21.15.96:0/3222764355 wait complete. 2022-02-02T20:31:20.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 Processor -- start 2022-02-02T20:31:20.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 -- start start 2022-02-02T20:31:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 0x7f5048106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481079b0 con 0x7f50480f7980 2022-02-02T20:31:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504d0c1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048107af0 con 0x7f50480f66e0 2022-02-02T20:31:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37554/0 (socket says 172.21.15.96:37554) 2022-02-02T20:31:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f504659c700 1 -- 172.21.15.96:0/1026469413 learned_addr learned my addr 172.21.15.96:0/1026469413 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.406+0000 7f5046d9d700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 0x7f5048106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504659c700 1 -- 172.21.15.96:0/1026469413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 msgr2=0x7f5048106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504659c700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 0x7f5048106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504659c700 1 -- 172.21.15.96:0/1026469413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f50480f7980 2022-02-02T20:31:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504659c700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f5038000c00 tx=0x7f503800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038019070 con 0x7f50480f7980 2022-02-02T20:31:20.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5038007e70 con 0x7f50480f7980 2022-02-02T20:31:20.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048108430 con 0x7f50480f7980 2022-02-02T20:31:20.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038014ce0 con 0x7f50480f7980 2022-02-02T20:31:20.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.407+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048108990 con 0x7f50480f7980 2022-02-02T20:31:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.408+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048045ad0 con 0x7f50480f7980 2022-02-02T20:31:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.409+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5038025070 con 0x7f50480f7980 2022-02-02T20:31:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.409+0000 7f502f7fe700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.409+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50380829a0 con 0x7f50480f7980 2022-02-02T20:31:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.409+0000 7f5046d9d700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.410+0000 7f5046d9d700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f503c009fd0 tx=0x7f503c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.414+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50380544d0 con 0x7f50480f7980 2022-02-02T20:31:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:20 smithi159 ceph-mon[69013]: pgmap v3877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:20 smithi096 ceph-mon[101353]: pgmap v3877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.593+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5048108bb0 con 0x7f5030064dd0 2022-02-02T20:31:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.594+0000 7f502f7fe700 1 -- 172.21.15.96:0/1026469413 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5048108bb0 con 0x7f5030064dd0 2022-02-02T20:31:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 msgr2=0x7f5030067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f503c009fd0 tx=0x7f503c00b040).stop 2022-02-02T20:31:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 msgr2=0x7f5048107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f5038000c00 tx=0x7f503800b040).stop 2022-02-02T20:31:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 shutdown_connections 2022-02-02T20:31:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f66e0 0x7f5048106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 --2- 172.21.15.96:0/1026469413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f7980 0x7f5048107400 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 >> 172.21.15.96:0/1026469413 conn(0x7f50480f1e40 msgr2=0x7f50480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 shutdown_connections 2022-02-02T20:31:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.596+0000 7f504d0c1700 1 -- 172.21.15.96:0/1026469413 wait complete. 2022-02-02T20:31:20.608 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:31:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/1260466022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 msgr2=0x7f1c680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/1260466022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c680f6b00 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f1c58004660 tx=0x7f1c58009b30).stop 2022-02-02T20:31:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/1260466022 shutdown_connections 2022-02-02T20:31:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/1260466022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 0x7f1c680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/1260466022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c680f6b00 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/1260466022 >> 172.21.15.96:0/1260466022 conn(0x7f1c680f1e40 msgr2=0x7f1c680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/1260466022 shutdown_connections 2022-02-02T20:31:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.694+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/1260466022 wait complete. 2022-02-02T20:31:20.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 Processor -- start 2022-02-02T20:31:20.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 -- start start 2022-02-02T20:31:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 0x7f1c681074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68107a50 con 0x7f1c680f66e0 2022-02-02T20:31:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c6e4fc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68107b90 con 0x7f1c680f7980 2022-02-02T20:31:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37560/0 (socket says 172.21.15.96:37560) 2022-02-02T20:31:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.695+0000 7f1c67fff700 1 -- 172.21.15.96:0/4153459266 learned_addr learned my addr 172.21.15.96:0/4153459266 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c677fe700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 0x7f1c681074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c67fff700 1 -- 172.21.15.96:0/4153459266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 msgr2=0x7f1c681074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c67fff700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 0x7f1c681074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c67fff700 1 -- 172.21.15.96:0/4153459266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58005040 con 0x7f1c680f66e0 2022-02-02T20:31:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c67fff700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7f1c58013a70 tx=0x7f1c58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c58018070 con 0x7f1c680f66e0 2022-02-02T20:31:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c681084d0 con 0x7f1c680f66e0 2022-02-02T20:31:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c580097d0 con 0x7f1c680f66e0 2022-02-02T20:31:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5801de80 con 0x7f1c680f66e0 2022-02-02T20:31:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.696+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68108a30 con 0x7f1c680f66e0 2022-02-02T20:31:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.697+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68045ad0 con 0x7f1c680f66e0 2022-02-02T20:31:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.697+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c58007ba0 con 0x7f1c680f66e0 2022-02-02T20:31:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.698+0000 7f1c64ff9700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 0x7f1c50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.698+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c58083650 con 0x7f1c680f66e0 2022-02-02T20:31:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.698+0000 7f1c677fe700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 0x7f1c50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.698+0000 7f1c677fe700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 0x7f1c50067290 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f1c5c004c40 tx=0x7f1c5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.703+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c58055180 con 0x7f1c680f66e0 2022-02-02T20:31:20.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.876+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c680fefb0 con 0x7f1c50064dd0 2022-02-02T20:31:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.886+0000 7f1c64ff9700 1 -- 172.21.15.96:0/4153459266 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1c680fefb0 con 0x7f1c50064dd0 2022-02-02T20:31:20.888 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:31:20.888 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 105m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:31:20.889 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 105m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:31:20.889 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 103m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:31:20.889 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 105m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:31:20.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 105m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:31:20.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 105m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:31:20.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 103m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:31:20.890 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 103m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:31:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 105m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:31:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 103m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:31:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 105m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:31:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 103m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:31:20.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 105m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:31:20.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 103m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:31:20.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 105m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:31:20.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 105m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:31:20.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 105m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:31:20.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 103m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:31:20.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 103m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:31:20.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 103m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:31:20.893 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 105m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:31:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 msgr2=0x7f1c50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 0x7f1c50067290 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f1c5c004c40 tx=0x7f1c5c00b040).stop 2022-02-02T20:31:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 msgr2=0x7f1c68106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7f1c58013a70 tx=0x7f1c58009b30).stop 2022-02-02T20:31:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 shutdown_connections 2022-02-02T20:31:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064dd0 0x7f1c50067290 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106fb0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 --2- 172.21.15.96:0/4153459266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f7980 0x7f1c681074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 >> 172.21.15.96:0/4153459266 conn(0x7f1c680f1e40 msgr2=0x7f1c680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 shutdown_connections 2022-02-02T20:31:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.888+0000 7f1c6e4fc700 1 -- 172.21.15.96:0/4153459266 wait complete. 2022-02-02T20:31:20.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.985+0000 7ff5b8467700 1 -- 172.21.15.96:0/150571770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f6be0 msgr2=0x7ff5b00f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.985+0000 7ff5b8467700 1 --2- 172.21.15.96:0/150571770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f6be0 0x7ff5b00f7000 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7ff5a0004660 tx=0x7ff5a0009b30).stop 2022-02-02T20:31:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.985+0000 7ff5b8467700 1 -- 172.21.15.96:0/150571770 shutdown_connections 2022-02-02T20:31:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.985+0000 7ff5b8467700 1 --2- 172.21.15.96:0/150571770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f7580 0x7ff5b00f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.985+0000 7ff5b8467700 1 --2- 172.21.15.96:0/150571770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f6be0 0x7ff5b00f7000 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.986+0000 7ff5b8467700 1 -- 172.21.15.96:0/150571770 >> 172.21.15.96:0/150571770 conn(0x7ff5b00f04c0 msgr2=0x7ff5b00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:20.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.986+0000 7ff5b8467700 1 -- 172.21.15.96:0/150571770 shutdown_connections 2022-02-02T20:31:20.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.986+0000 7ff5b8467700 1 -- 172.21.15.96:0/150571770 wait complete. 2022-02-02T20:31:20.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.986+0000 7ff5b8467700 1 Processor -- start 2022-02-02T20:31:20.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.986+0000 7ff5b8467700 1 -- start start 2022-02-02T20:31:20.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b8467700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f6be0 0x7ff5b0109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b8467700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b8467700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00f5680 con 0x7ff5b00f7580 2022-02-02T20:31:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b8467700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00f57c0 con 0x7ff5b00f6be0 2022-02-02T20:31:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37572/0 (socket says 172.21.15.96:37572) 2022-02-02T20:31:20.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 -- 172.21.15.96:0/3452054563 learned_addr learned my addr 172.21.15.96:0/3452054563 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:20.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b6203700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f6be0 0x7ff5b0109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 -- 172.21.15.96:0/3452054563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f6be0 msgr2=0x7ff5b0109d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:20.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f6be0 0x7ff5b0109d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:20.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 -- 172.21.15.96:0/3452054563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0005040 con 0x7ff5b00f7580 2022-02-02T20:31:20.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5b5a02700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7ff5ac002700 tx=0x7ff5ac009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.987+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5ac0079c0 con 0x7ff5b00f7580 2022-02-02T20:31:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.988+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b010c7e0 con 0x7ff5b00f7580 2022-02-02T20:31:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.988+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5ac00f040 con 0x7ff5b00f7580 2022-02-02T20:31:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.988+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5ac014740 con 0x7ff5b00f7580 2022-02-02T20:31:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.988+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b010cda0 con 0x7ff5b00f7580 2022-02-02T20:31:20.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.988+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b0045ad0 con 0x7ff5b00f7580 2022-02-02T20:31:20.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.989+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff5ac01b060 con 0x7ff5b00f7580 2022-02-02T20:31:20.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.989+0000 7ff5a6ffd700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 0x7ff59c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:20.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.989+0000 7ff5b6203700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 0x7ff59c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:20.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.989+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff5ac081920 con 0x7ff5b00f7580 2022-02-02T20:31:20.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.990+0000 7ff5b6203700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 0x7ff59c067270 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7ff5b00f5300 tx=0x7ff5a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:20.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:20.994+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5ac04f9c0 con 0x7ff5b00f7580 2022-02-02T20:31:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.223+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5b0027a00 con 0x7ff5b00f7580 2022-02-02T20:31:21.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.223+0000 7ff5a6ffd700 1 -- 172.21.15.96:0/3452054563 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff5ac052fe0 con 0x7ff5b00f7580 2022-02-02T20:31:21.226 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:31:21.226 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:31:21.226 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:31:21.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:21.227 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:31:21.227 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:31:21.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:21.227 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:31:21.227 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:31:21.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:21.228 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:31:21.228 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:31:21.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:21.230 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:31:21.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:31:21.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:31:21.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:31:21.231 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:31:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 msgr2=0x7ff59c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 0x7ff59c067270 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7ff5b00f5300 tx=0x7ff5a0009b30).stop 2022-02-02T20:31:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 msgr2=0x7ff5b010c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7ff5ac002700 tx=0x7ff5ac009d60).stop 2022-02-02T20:31:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 shutdown_connections 2022-02-02T20:31:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff59c064db0 0x7ff59c067270 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5b00f6be0 0x7ff5b0109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 --2- 172.21.15.96:0/3452054563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5b00f7580 0x7ff5b010c230 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.225+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 >> 172.21.15.96:0/3452054563 conn(0x7ff5b00f04c0 msgr2=0x7ff5b00fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.226+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 shutdown_connections 2022-02-02T20:31:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.226+0000 7ff5b8467700 1 -- 172.21.15.96:0/3452054563 wait complete. 2022-02-02T20:31:21.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 -- 172.21.15.96:0/2482543647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 msgr2=0x7fd3a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 --2- 172.21.15.96:0/2482543647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f6cc0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7fd3a0004660 tx=0x7fd3a0009b30).stop 2022-02-02T20:31:21.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 -- 172.21.15.96:0/2482543647 shutdown_connections 2022-02-02T20:31:21.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 --2- 172.21.15.96:0/2482543647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f6860 0x7fd3a40f6cc0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 --2- 172.21.15.96:0/2482543647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f55c0 0x7fd3a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:31:21.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 -- 172.21.15.96:0/2482543647 >> 172.21.15.96:0/2482543647 conn(0x7fd3a40f0d40 msgr2=0x7fd3a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:21.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 -- 172.21.15.96:0/2482543647 shutdown_connections 2022-02-02T20:31:21.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.323+0000 7fd3ab990700 1 -- 172.21.15.96:0/2482543647 wait complete. 2022-02-02T20:31:21.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 Processor -- start 2022-02-02T20:31:21.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 -- start start 2022-02-02T20:31:21.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:21.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:21.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4060470 con 0x7fd3a40f55c0 2022-02-02T20:31:21.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3ab990700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40605b0 con 0x7fd3a40f6860 2022-02-02T20:31:21.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:21.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37580/0 (socket says 172.21.15.96:37580) 2022-02-02T20:31:21.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 -- 172.21.15.96:0/796110840 learned_addr learned my addr 172.21.15.96:0/796110840 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:21.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a8f2b700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:21.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 -- 172.21.15.96:0/796110840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 msgr2=0x7fd3a410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a972c700 1 -- 172.21.15.96:0/796110840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0005040 con 0x7fd3a40f55c0 2022-02-02T20:31:21.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.324+0000 7fd3a8f2b700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:31:21.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd3a972c700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fd3940093f0 tx=0x7fd394006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:21.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd394009ea0 con 0x7fd3a40f55c0 2022-02-02T20:31:21.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a410c810 con 0x7fd3a40f55c0 2022-02-02T20:31:21.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd394013af0 con 0x7fd3a40f55c0 2022-02-02T20:31:21.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39400db10 con 0x7fd3a40f55c0 2022-02-02T20:31:21.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.325+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a410cda0 con 0x7fd3a40f55c0 2022-02-02T20:31:21.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.326+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a40f49b0 con 0x7fd3a40f55c0 2022-02-02T20:31:21.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.326+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd39401a060 con 0x7fd3a40f55c0 2022-02-02T20:31:21.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.327+0000 7fd399ffb700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 0x7fd390067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:21.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.327+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd394081a90 con 0x7fd3a40f55c0 2022-02-02T20:31:21.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.327+0000 7fd3a8f2b700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 0x7fd390067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:21.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.327+0000 7fd3a8f2b700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 0x7fd390067290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fd3a0004e30 tx=0x7fd3a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:21.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.331+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd39404fb90 con 0x7fd3a40f55c0 2022-02-02T20:31:21.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:21 smithi159 ceph-mon[69013]: from='client.38084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3452054563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:31:21.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.529+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3a4045ad0 con 0x7fd3a40f55c0 2022-02-02T20:31:21.531 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:21 smithi096 ceph-mon[101353]: from='client.38084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:21.531 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3452054563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:31:21.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.530+0000 7fd399ffb700 1 -- 172.21.15.96:0/796110840 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd394018020 con 0x7fd3a40f55c0 2022-02-02T20:31:21.532 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:31:21.533 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:31:21.533 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:31:21.533 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:31:21.534 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:31:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:31:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:31:21.535 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:31:21.535 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:31:21.535 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:31:21.535 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:31:21.536 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:31:21.536 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:31:21.536 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:31:21.536 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:31:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:31:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:31:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:31:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:31:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:31:21.538 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:31:21.538 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:31:21.538 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:31:21.538 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:31:21.539 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:31:21.539 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:31:21.539 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:31:21.539 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:31:21.539 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:31:21.540 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:31:21.540 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:31:21.540 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:21.540 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:21.540 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:31:21.541 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:21.541 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:21.541 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:21.541 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 msgr2=0x7fd390067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 0x7fd390067290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fd3a0004e30 tx=0x7fd3a0009b30).stop 2022-02-02T20:31:21.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 msgr2=0x7fd3a4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fd3940093f0 tx=0x7fd394006ec0).stop 2022-02-02T20:31:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 shutdown_connections 2022-02-02T20:31:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd390064dd0 0x7fd390067290 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40f55c0 0x7fd3a4109cb0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 --2- 172.21.15.96:0/796110840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3a40f6860 0x7fd3a410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 >> 172.21.15.96:0/796110840 conn(0x7fd3a40f0d40 msgr2=0x7fd3a40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 shutdown_connections 2022-02-02T20:31:21.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:21.532+0000 7fd3ab990700 1 -- 172.21.15.96:0/796110840 wait complete. 2022-02-02T20:31:21.546 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:31:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:22 smithi159 ceph-mon[69013]: from='client.38088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:22 smithi159 ceph-mon[69013]: pgmap v3878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:22.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/796110840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:31:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:22 smithi096 ceph-mon[101353]: from='client.38088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:22 smithi096 ceph-mon[101353]: pgmap v3878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:22.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/796110840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:31:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:24 smithi159 ceph-mon[69013]: pgmap v3879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:24 smithi096 ceph-mon[101353]: pgmap v3879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:26 smithi159 ceph-mon[69013]: pgmap v3880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:26 smithi096 ceph-mon[101353]: pgmap v3880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:27 smithi096 ceph-mon[101353]: pgmap v3881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:31:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:31:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:27 smithi159 ceph-mon[69013]: pgmap v3881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:31:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:31:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:30 smithi159 ceph-mon[69013]: pgmap v3882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:30 smithi096 ceph-mon[101353]: pgmap v3882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:32 smithi159 ceph-mon[69013]: pgmap v3883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:32 smithi096 ceph-mon[101353]: pgmap v3883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:34 smithi159 ceph-mon[69013]: pgmap v3884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:34 smithi096 ceph-mon[101353]: pgmap v3884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:36 smithi159 ceph-mon[69013]: pgmap v3885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:36 smithi096 ceph-mon[101353]: pgmap v3885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:37 smithi096 ceph-mon[101353]: pgmap v3886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:37 smithi159 ceph-mon[69013]: pgmap v3886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:40 smithi159 ceph-mon[69013]: pgmap v3887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:40 smithi096 ceph-mon[101353]: pgmap v3887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:42 smithi159 ceph-mon[69013]: pgmap v3888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:42 smithi096 ceph-mon[101353]: pgmap v3888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:44 smithi159 ceph-mon[69013]: pgmap v3889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:44 smithi096 ceph-mon[101353]: pgmap v3889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:46.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:46 smithi159 ceph-mon[69013]: pgmap v3890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:46 smithi096 ceph-mon[101353]: pgmap v3890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:47 smithi096 ceph-mon[101353]: pgmap v3891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:47 smithi159 ceph-mon[69013]: pgmap v3891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:50 smithi159 ceph-mon[69013]: pgmap v3892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:50 smithi096 ceph-mon[101353]: pgmap v3892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.637+0000 7f8825aeb700 1 -- 172.21.15.96:0/4177032822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 msgr2=0x7f88200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.637+0000 7f8825aeb700 1 --2- 172.21.15.96:0/4177032822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f88200f7c30 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f880c004660 tx=0x7f880c009b30).stop 2022-02-02T20:31:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.637+0000 7f8825aeb700 1 -- 172.21.15.96:0/4177032822 shutdown_connections 2022-02-02T20:31:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.637+0000 7f8825aeb700 1 --2- 172.21.15.96:0/4177032822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f88200f7c30 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 --2- 172.21.15.96:0/4177032822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 0x7f88200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 -- 172.21.15.96:0/4177032822 >> 172.21.15.96:0/4177032822 conn(0x7f88200f1c90 msgr2=0x7f88200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 -- 172.21.15.96:0/4177032822 shutdown_connections 2022-02-02T20:31:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 -- 172.21.15.96:0/4177032822 wait complete. 2022-02-02T20:31:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 Processor -- start 2022-02-02T20:31:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 -- start start 2022-02-02T20:31:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.638+0000 7f8825aeb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 0x7f882006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8825aeb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8825aeb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882006a380 con 0x7f88200f77d0 2022-02-02T20:31:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8825aeb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882006a4c0 con 0x7f88200f6530 2022-02-02T20:31:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37602/0 (socket says 172.21.15.96:37602) 2022-02-02T20:31:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 -- 172.21.15.96:0/42354625 learned_addr learned my addr 172.21.15.96:0/42354625 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 -- 172.21.15.96:0/42354625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 msgr2=0x7f882006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8824ae9700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 0x7f882006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 0x7f882006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 -- 172.21.15.96:0/42354625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c005040 con 0x7f88200f77d0 2022-02-02T20:31:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881ffff700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f880c009990 tx=0x7f880c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f880c018070 con 0x7f88200f77d0 2022-02-02T20:31:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882006a740 con 0x7f88200f77d0 2022-02-02T20:31:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f880c007ca0 con 0x7f88200f77d0 2022-02-02T20:31:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f880c01c620 con 0x7f88200f77d0 2022-02-02T20:31:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.639+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882006aca0 con 0x7f88200f77d0 2022-02-02T20:31:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.640+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8820045ad0 con 0x7f88200f77d0 2022-02-02T20:31:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.641+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f880c01d960 con 0x7f88200f77d0 2022-02-02T20:31:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.641+0000 7f881d7fa700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 0x7f88100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.641+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f880c0837d0 con 0x7f88200f77d0 2022-02-02T20:31:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.641+0000 7f8824ae9700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 0x7f88100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.642+0000 7f8824ae9700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 0x7f88100672e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f882006b730 tx=0x7f8814009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.646+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f880c051a40 con 0x7f88200f77d0 2022-02-02T20:31:51.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.825+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88200008d0 con 0x7f8810064e20 2022-02-02T20:31:51.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.826+0000 7f881d7fa700 1 -- 172.21.15.96:0/42354625 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f88200008d0 con 0x7f8810064e20 2022-02-02T20:31:51.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 msgr2=0x7f88100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 0x7f88100672e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f882006b730 tx=0x7f8814009040).stop 2022-02-02T20:31:51.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 msgr2=0x7f8820069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f880c009990 tx=0x7f880c009b30).stop 2022-02-02T20:31:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 shutdown_connections 2022-02-02T20:31:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8810064e20 0x7f88100672e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88200f6530 0x7f882006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 --2- 172.21.15.96:0/42354625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88200f77d0 0x7f8820069e20 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 >> 172.21.15.96:0/42354625 conn(0x7f88200f1c90 msgr2=0x7f88200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:51.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 shutdown_connections 2022-02-02T20:31:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.828+0000 7f8825aeb700 1 -- 172.21.15.96:0/42354625 wait complete. 2022-02-02T20:31:51.840 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:31:51.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 -- 172.21.15.96:0/1541155789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f66e0 msgr2=0x7f01680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 --2- 172.21.15.96:0/1541155789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f66e0 0x7f01680f6b00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f0164004660 tx=0x7f0164009b30).stop 2022-02-02T20:31:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 -- 172.21.15.96:0/1541155789 shutdown_connections 2022-02-02T20:31:51.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 --2- 172.21.15.96:0/1541155789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f7980 0x7f01680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 --2- 172.21.15.96:0/1541155789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f66e0 0x7f01680f6b00 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 -- 172.21.15.96:0/1541155789 >> 172.21.15.96:0/1541155789 conn(0x7f01680f1e40 msgr2=0x7f01680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 -- 172.21.15.96:0/1541155789 shutdown_connections 2022-02-02T20:31:51.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.925+0000 7f016f420700 1 -- 172.21.15.96:0/1541155789 wait complete. 2022-02-02T20:31:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 Processor -- start 2022-02-02T20:31:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 -- start start 2022-02-02T20:31:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f66e0 0x7f01681091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168109c40 con 0x7f01680f7980 2022-02-02T20:31:51.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016f420700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168109d80 con 0x7f01680f66e0 2022-02-02T20:31:51.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016c9bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016c9bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37612/0 (socket says 172.21.15.96:37612) 2022-02-02T20:31:51.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016c9bb700 1 -- 172.21.15.96:0/2503978416 learned_addr learned my addr 172.21.15.96:0/2503978416 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:51.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.926+0000 7f016d1bc700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f66e0 0x7f01681091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016c9bb700 1 -- 172.21.15.96:0/2503978416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f66e0 msgr2=0x7f01681091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:51.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016c9bb700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f66e0 0x7f01681091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:51.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016c9bb700 1 -- 172.21.15.96:0/2503978416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164005040 con 0x7f01680f7980 2022-02-02T20:31:51.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016c9bb700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f01580026d0 tx=0x7f0158009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:51.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01580079c0 con 0x7f01680f7980 2022-02-02T20:31:51.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016810a720 con 0x7f01680f7980 2022-02-02T20:31:51.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f015800f040 con 0x7f01680f7980 2022-02-02T20:31:51.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01580148b0 con 0x7f01680f7980 2022-02-02T20:31:51.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.927+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016810ace0 con 0x7f01680f7980 2022-02-02T20:31:51.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.928+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0168045ad0 con 0x7f01680f7980 2022-02-02T20:31:51.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.928+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0158014a10 con 0x7f01680f7980 2022-02-02T20:31:51.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.929+0000 7f015dffb700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:51.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.929+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f01580819b0 con 0x7f01680f7980 2022-02-02T20:31:51.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.929+0000 7f016d1bc700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:51.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.929+0000 7f016d1bc700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0164004630 tx=0x7f0164009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:51.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:51.933+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f01580535c0 con 0x7f01680f7980 2022-02-02T20:31:52.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.106+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f016810af60 con 0x7f0154064dd0 2022-02-02T20:31:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.115+0000 7f015dffb700 1 -- 172.21.15.96:0/2503978416 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f016810af60 con 0x7f0154064dd0 2022-02-02T20:31:52.119 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:31:52.119 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 105m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:31:52.119 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 105m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:31:52.119 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 104m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:31:52.120 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 105m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:31:52.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 105m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:31:52.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 105m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:31:52.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 104m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:31:52.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 104m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:31:52.121 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 105m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:31:52.121 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 104m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:31:52.121 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 105m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:31:52.121 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 104m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:31:52.122 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 105m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:31:52.122 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 104m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:31:52.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 105m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:31:52.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 105m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:31:52.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 105m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:31:52.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 104m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:31:52.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 104m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:31:52.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 104m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:31:52.123 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 105m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:31:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.117+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 msgr2=0x7f0154067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.117+0000 7f016f420700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0164004630 tx=0x7f0164009b30).stop 2022-02-02T20:31:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.117+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 msgr2=0x7f0168109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.117+0000 7f016f420700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f01580026d0 tx=0x7f0158009de0).stop 2022-02-02T20:31:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 shutdown_connections 2022-02-02T20:31:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f66e0 0x7f01681091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 --2- 172.21.15.96:0/2503978416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f7980 0x7f0168109690 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 >> 172.21.15.96:0/2503978416 conn(0x7f01680f1e40 msgr2=0x7f016806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 shutdown_connections 2022-02-02T20:31:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.118+0000 7f016f420700 1 -- 172.21.15.96:0/2503978416 wait complete. 2022-02-02T20:31:52.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/2759672530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 msgr2=0x7fe2dc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/2759672530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc0f6cc0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7fe2d8004660 tx=0x7fe2d8009b30).stop 2022-02-02T20:31:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/2759672530 shutdown_connections 2022-02-02T20:31:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/2759672530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc0f6cc0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/2759672530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 0x7fe2dc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/2759672530 >> 172.21.15.96:0/2759672530 conn(0x7fe2dc0f0d40 msgr2=0x7fe2dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/2759672530 shutdown_connections 2022-02-02T20:31:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.214+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/2759672530 wait complete. 2022-02-02T20:31:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 Processor -- start 2022-02-02T20:31:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 -- start start 2022-02-02T20:31:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 0x7fe2dc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc1069b0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e3a0f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc1071c0 con 0x7fe2dc0f55c0 2022-02-02T20:31:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e0faa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e0faa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37622/0 (socket says 172.21.15.96:37622) 2022-02-02T20:31:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e0faa700 1 -- 172.21.15.96:0/1823970972 learned_addr learned my addr 172.21.15.96:0/1823970972 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.215+0000 7fe2e17ab700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 0x7fe2dc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e0faa700 1 -- 172.21.15.96:0/1823970972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 msgr2=0x7fe2dc105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e0faa700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 0x7fe2dc105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e0faa700 1 -- 172.21.15.96:0/1823970972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8005040 con 0x7fe2dc0f6860 2022-02-02T20:31:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e0faa700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fe2d8009990 tx=0x7fe2d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d8018070 con 0x7fe2dc0f6860 2022-02-02T20:31:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc1073e0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2d8007ba0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d801c3c0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.216+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc107940 con 0x7fe2dc0f6860 2022-02-02T20:31:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.217+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc0f49b0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.218+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2d801d420 con 0x7fe2dc0f6860 2022-02-02T20:31:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.218+0000 7fe2d1ffb700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 0x7fe2c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.219+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2d80836b0 con 0x7fe2dc0f6860 2022-02-02T20:31:52.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.219+0000 7fe2e17ab700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 0x7fe2c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.219+0000 7fe2e17ab700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 0x7fe2c8067290 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fe2dc105c30 tx=0x7fe2cc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.223+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2d8051810 con 0x7fe2dc0f6860 2022-02-02T20:31:52.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.452+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2dc045b20 con 0x7fe2dc0f6860 2022-02-02T20:31:52.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.453+0000 7fe2d1ffb700 1 -- 172.21.15.96:0/1823970972 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe2d8054e30 con 0x7fe2dc0f6860 2022-02-02T20:31:52.456 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:31:52.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:31:52.456 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:31:52.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:52.457 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:31:52.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:31:52.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:52.457 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:31:52.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:31:52.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:52.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:31:52.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:31:52.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:31:52.459 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:31:52.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:31:52.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:31:52.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:31:52.460 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:31:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 msgr2=0x7fe2c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 0x7fe2c8067290 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fe2dc105c30 tx=0x7fe2cc00b040).stop 2022-02-02T20:31:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 msgr2=0x7fe2dc1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fe2d8009990 tx=0x7fe2d8009b30).stop 2022-02-02T20:31:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 shutdown_connections 2022-02-02T20:31:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2c8064dd0 0x7fe2c8067290 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f55c0 0x7fe2dc105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 --2- 172.21.15.96:0/1823970972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f6860 0x7fe2dc1063b0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 >> 172.21.15.96:0/1823970972 conn(0x7fe2dc0f0d40 msgr2=0x7fe2dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 shutdown_connections 2022-02-02T20:31:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.455+0000 7fe2e3a0f700 1 -- 172.21.15.96:0/1823970972 wait complete. 2022-02-02T20:31:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:52 smithi159 ceph-mon[69013]: pgmap v3893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 -- 172.21.15.96:0/1059714244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f55c0 msgr2=0x7f2f3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 --2- 172.21.15.96:0/1059714244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c0f59e0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f2f2c004660 tx=0x7f2f2c009b30).stop 2022-02-02T20:31:52.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 -- 172.21.15.96:0/1059714244 shutdown_connections 2022-02-02T20:31:52.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 --2- 172.21.15.96:0/1059714244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 --2- 172.21.15.96:0/1059714244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c0f59e0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 -- 172.21.15.96:0/1059714244 >> 172.21.15.96:0/1059714244 conn(0x7f2f3c0f0d40 msgr2=0x7f2f3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:52.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 -- 172.21.15.96:0/1059714244 shutdown_connections 2022-02-02T20:31:52.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.552+0000 7f2f44674700 1 -- 172.21.15.96:0/1059714244 wait complete. 2022-02-02T20:31:52.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:52 smithi096 ceph-mon[101353]: pgmap v3893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:52.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 Processor -- start 2022-02-02T20:31:52.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 -- start start 2022-02-02T20:31:52.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0602b0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f44674700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0603f0 con 0x7f2f3c0f55c0 2022-02-02T20:31:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f41c0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f41c0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37632/0 (socket says 172.21.15.96:37632) 2022-02-02T20:31:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f41c0f700 1 -- 172.21.15.96:0/2202463532 learned_addr learned my addr 172.21.15.96:0/2202463532 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:31:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.553+0000 7f2f42410700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f41c0f700 1 -- 172.21.15.96:0/2202463532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 msgr2=0x7f2f3c10c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f41c0f700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c10c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f41c0f700 1 -- 172.21.15.96:0/2202463532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c005040 con 0x7f2f3c0f6860 2022-02-02T20:31:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f42410700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:31:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f41c0f700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f2f380026d0 tx=0x7f2f38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f380079c0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f3800f040 con 0x7f2f3c0f6860 2022-02-02T20:31:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c10ea80 con 0x7f2f3c0f6860 2022-02-02T20:31:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f380148b0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.554+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c10ef00 con 0x7f2f3c0f6860 2022-02-02T20:31:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.555+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c045ad0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.556+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f38007b20 con 0x7f2f3c0f6860 2022-02-02T20:31:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.556+0000 7f2f32ffd700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 0x7f2f28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:31:52.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.556+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2f380818b0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.556+0000 7f2f42410700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 0x7f2f28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:31:52.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.556+0000 7f2f42410700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 0x7f2f28067290 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f2f2c013690 tx=0x7f2f2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:31:52.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.560+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f3804f9b0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.763+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f3c060580 con 0x7f2f3c0f6860 2022-02-02T20:31:52.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.763+0000 7f2f32ffd700 1 -- 172.21.15.96:0/2202463532 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2f38052fd0 con 0x7f2f3c0f6860 2022-02-02T20:31:52.767 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:31:52.767 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:31:52.767 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:31:52.768 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:31:52.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:52.768 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:31:52.768 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:31:52.769 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:31:52.769 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:31:52.769 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:31:52.769 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:31:52.770 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:31:52.770 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:31:52.770 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:31:52.770 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:31:52.771 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:31:52.771 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:31:52.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:31:52.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:31:52.771 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:31:52.772 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:31:52.772 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:31:52.772 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:31:52.772 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:31:52.773 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:31:52.773 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:31:52.773 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:31:52.773 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:31:52.773 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:31:52.774 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:31:52.774 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:31:52.774 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:31:52.774 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:52.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:52.775 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:31:52.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:31:52.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:52.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:52.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:31:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 msgr2=0x7f2f28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 0x7f2f28067290 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f2f2c013690 tx=0x7f2f2c009b30).stop 2022-02-02T20:31:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 msgr2=0x7f2f3c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:31:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f2f380026d0 tx=0x7f2f38009de0).stop 2022-02-02T20:31:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 shutdown_connections 2022-02-02T20:31:52.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f28064dd0 0x7f2f28067290 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f3c0f55c0 0x7f2f3c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 --2- 172.21.15.96:0/2202463532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f3c0f6860 0x7f2f3c10e590 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:31:52.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 >> 172.21.15.96:0/2202463532 conn(0x7f2f3c0f0d40 msgr2=0x7f2f3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:31:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 shutdown_connections 2022-02-02T20:31:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:31:52.765+0000 7f2f44674700 1 -- 172.21.15.96:0/2202463532 wait complete. 2022-02-02T20:31:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:31:53.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:53 smithi159 ceph-mon[69013]: from='client.38100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:53.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:53 smithi159 ceph-mon[69013]: from='client.38104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1823970972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:31:53.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2202463532' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:31:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:53 smithi096 ceph-mon[101353]: from='client.38100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:53 smithi096 ceph-mon[101353]: from='client.38104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:31:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1823970972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:31:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2202463532' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:31:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:54 smithi159 ceph-mon[69013]: pgmap v3894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:54 smithi096 ceph-mon[101353]: pgmap v3894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:56.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:56 smithi159 ceph-mon[69013]: pgmap v3895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:56 smithi096 ceph-mon[101353]: pgmap v3895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:31:57 smithi096 ceph-mon[101353]: pgmap v3896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:31:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:31:57 smithi159 ceph-mon[69013]: pgmap v3896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:00 smithi159 ceph-mon[69013]: pgmap v3897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:00 smithi096 ceph-mon[101353]: pgmap v3897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:02 smithi159 ceph-mon[69013]: pgmap v3898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:02 smithi096 ceph-mon[101353]: pgmap v3898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:04 smithi159 ceph-mon[69013]: pgmap v3899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:04 smithi096 ceph-mon[101353]: pgmap v3899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:06 smithi159 ceph-mon[69013]: pgmap v3900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:06 smithi096 ceph-mon[101353]: pgmap v3900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:07 smithi096 ceph-mon[101353]: pgmap v3901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:07 smithi159 ceph-mon[69013]: pgmap v3901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:10 smithi159 ceph-mon[69013]: pgmap v3902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:10 smithi096 ceph-mon[101353]: pgmap v3902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:12 smithi159 ceph-mon[69013]: pgmap v3903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:12 smithi096 ceph-mon[101353]: pgmap v3903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:14 smithi159 ceph-mon[69013]: pgmap v3904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:14 smithi096 ceph-mon[101353]: pgmap v3904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:16 smithi159 ceph-mon[69013]: pgmap v3905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:16 smithi096 ceph-mon[101353]: pgmap v3905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:17 smithi096 ceph-mon[101353]: pgmap v3906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:17 smithi159 ceph-mon[69013]: pgmap v3906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:20 smithi159 ceph-mon[69013]: pgmap v3907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:20 smithi096 ceph-mon[101353]: pgmap v3907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:22.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:22 smithi159 ceph-mon[69013]: pgmap v3908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:22 smithi096 ceph-mon[101353]: pgmap v3908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 -- 172.21.15.96:0/2532185924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f55c0 msgr2=0x7fa1200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2532185924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f55c0 0x7fa1200f59e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7fa110004660 tx=0x7fa110009b30).stop 2022-02-02T20:32:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 -- 172.21.15.96:0/2532185924 shutdown_connections 2022-02-02T20:32:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2532185924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f6860 0x7fa1200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2532185924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f55c0 0x7fa1200f59e0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.876+0000 7fa125d6d700 1 -- 172.21.15.96:0/2532185924 >> 172.21.15.96:0/2532185924 conn(0x7fa1200f0d40 msgr2=0x7fa1200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.877+0000 7fa125d6d700 1 -- 172.21.15.96:0/2532185924 shutdown_connections 2022-02-02T20:32:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.877+0000 7fa125d6d700 1 -- 172.21.15.96:0/2532185924 wait complete. 2022-02-02T20:32:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.877+0000 7fa125d6d700 1 Processor -- start 2022-02-02T20:32:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa125d6d700 1 -- start start 2022-02-02T20:32:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa125d6d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f55c0 0x7fa120109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa125d6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa125d6d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200603c0 con 0x7fa1200f6860 2022-02-02T20:32:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa125d6d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120060500 con 0x7fa1200f55c0 2022-02-02T20:32:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37654/0 (socket says 172.21.15.96:37654) 2022-02-02T20:32:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 -- 172.21.15.96:0/2040655447 learned_addr learned my addr 172.21.15.96:0/2040655447 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11f7fe700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f55c0 0x7fa120109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 -- 172.21.15.96:0/2040655447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f55c0 msgr2=0x7fa120109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f55c0 0x7fa120109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 -- 172.21.15.96:0/2040655447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110005040 con 0x7fa1200f6860 2022-02-02T20:32:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa11effd700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fa1140026d0 tx=0x7fa114009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.878+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1140079c0 con 0x7fa1200f6860 2022-02-02T20:32:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.879+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12010c740 con 0x7fa1200f6860 2022-02-02T20:32:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.879+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa11400f040 con 0x7fa1200f6860 2022-02-02T20:32:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.879+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1140148b0 con 0x7fa1200f6860 2022-02-02T20:32:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.879+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12010ccd0 con 0x7fa1200f6860 2022-02-02T20:32:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.880+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120045ad0 con 0x7fa1200f6860 2022-02-02T20:32:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.880+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa114007b20 con 0x7fa1200f6860 2022-02-02T20:32:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.881+0000 7fa107fff700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 0x7fa108067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.881+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa1140818a0 con 0x7fa1200f6860 2022-02-02T20:32:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.881+0000 7fa11f7fe700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 0x7fa108067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.881+0000 7fa11f7fe700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 0x7fa108067290 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fa110013690 tx=0x7fa110009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:22.885+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa11404f9a0 con 0x7fa1200f6860 2022-02-02T20:32:23.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.065+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa120057f10 con 0x7fa108064dd0 2022-02-02T20:32:23.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.066+0000 7fa107fff700 1 -- 172.21.15.96:0/2040655447 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa120057f10 con 0x7fa108064dd0 2022-02-02T20:32:23.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 msgr2=0x7fa108067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 0x7fa108067290 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fa110013690 tx=0x7fa110009b30).stop 2022-02-02T20:32:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 msgr2=0x7fa12010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fa1140026d0 tx=0x7fa114009de0).stop 2022-02-02T20:32:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 shutdown_connections 2022-02-02T20:32:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa108064dd0 0x7fa108067290 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1200f55c0 0x7fa120109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 --2- 172.21.15.96:0/2040655447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1200f6860 0x7fa12010c190 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 >> 172.21.15.96:0/2040655447 conn(0x7fa1200f0d40 msgr2=0x7fa1200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 shutdown_connections 2022-02-02T20:32:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.068+0000 7fa125d6d700 1 -- 172.21.15.96:0/2040655447 wait complete. 2022-02-02T20:32:23.079 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:32:23.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 -- 172.21.15.96:0/3484039688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 msgr2=0x7fe2500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 --2- 172.21.15.96:0/3484039688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe2500f6b00 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7fe240004660 tx=0x7fe240009b30).stop 2022-02-02T20:32:23.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 -- 172.21.15.96:0/3484039688 shutdown_connections 2022-02-02T20:32:23.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 --2- 172.21.15.96:0/3484039688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 0x7fe2500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 --2- 172.21.15.96:0/3484039688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe2500f6b00 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 -- 172.21.15.96:0/3484039688 >> 172.21.15.96:0/3484039688 conn(0x7fe2500f1e40 msgr2=0x7fe2500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 -- 172.21.15.96:0/3484039688 shutdown_connections 2022-02-02T20:32:23.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.165+0000 7fe2587c5700 1 -- 172.21.15.96:0/3484039688 wait complete. 2022-02-02T20:32:23.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 Processor -- start 2022-02-02T20:32:23.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 -- start start 2022-02-02T20:32:23.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 0x7fe2501074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250107a50 con 0x7fe2500f66e0 2022-02-02T20:32:23.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe2587c5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250107b90 con 0x7fe2500f7980 2022-02-02T20:32:23.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37662/0 (socket says 172.21.15.96:37662) 2022-02-02T20:32:23.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 -- 172.21.15.96:0/983313677 learned_addr learned my addr 172.21.15.96:0/983313677 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:23.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe255d60700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 0x7fe2501074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 -- 172.21.15.96:0/983313677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 msgr2=0x7fe2501074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 0x7fe2501074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.166+0000 7fe256561700 1 -- 172.21.15.96:0/983313677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240005040 con 0x7fe2500f66e0 2022-02-02T20:32:23.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe256561700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7fe240013a70 tx=0x7fe240009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe240018070 con 0x7fe2500f66e0 2022-02-02T20:32:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2501084d0 con 0x7fe2500f66e0 2022-02-02T20:32:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe250108a30 con 0x7fe2500f66e0 2022-02-02T20:32:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2400097d0 con 0x7fe2500f66e0 2022-02-02T20:32:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.167+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24001de80 con 0x7fe2500f66e0 2022-02-02T20:32:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.168+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe240007ba0 con 0x7fe2500f66e0 2022-02-02T20:32:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.168+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238004fa0 con 0x7fe2500f66e0 2022-02-02T20:32:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.169+0000 7fe246ffd700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 0x7fe23c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.169+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe240083550 con 0x7fe2500f66e0 2022-02-02T20:32:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.173+0000 7fe255d60700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 0x7fe23c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.173+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe240055080 con 0x7fe2500f66e0 2022-02-02T20:32:23.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.173+0000 7fe255d60700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 0x7fe23c067290 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fe24c004c40 tx=0x7fe24c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.346+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe238000bc0 con 0x7fe23c064dd0 2022-02-02T20:32:23.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.357+0000 7fe246ffd700 1 -- 172.21.15.96:0/983313677 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe238000bc0 con 0x7fe23c064dd0 2022-02-02T20:32:23.359 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:32:23.360 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 106m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:32:23.361 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 106m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:32:23.361 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 104m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:32:23.362 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 106m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:32:23.362 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 106m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:32:23.362 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 106m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:32:23.362 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 104m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:32:23.363 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 104m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:32:23.363 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 106m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:32:23.363 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 104m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:32:23.363 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 106m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:32:23.364 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 104m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:32:23.364 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 106m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:32:23.364 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 104m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:32:23.364 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 106m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:32:23.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 106m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:32:23.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 106m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:32:23.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 104m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:32:23.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 104m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:32:23.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 104m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:32:23.366 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 106m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:32:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 msgr2=0x7fe23c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 0x7fe23c067290 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fe24c004c40 tx=0x7fe24c00b040).stop 2022-02-02T20:32:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 msgr2=0x7fe250106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7fe240013a70 tx=0x7fe240009b30).stop 2022-02-02T20:32:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 shutdown_connections 2022-02-02T20:32:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe23c064dd0 0x7fe23c067290 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2500f66e0 0x7fe250106fb0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 --2- 172.21.15.96:0/983313677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2500f7980 0x7fe2501074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.359+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 >> 172.21.15.96:0/983313677 conn(0x7fe2500f1e40 msgr2=0x7fe2500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.360+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 shutdown_connections 2022-02-02T20:32:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.360+0000 7fe2587c5700 1 -- 172.21.15.96:0/983313677 wait complete. 2022-02-02T20:32:23.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 -- 172.21.15.96:0/4098367553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f66e0 msgr2=0x7f0ce80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/4098367553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f66e0 0x7f0ce80f6b00 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f0cdc004660 tx=0x7f0cdc009b30).stop 2022-02-02T20:32:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 -- 172.21.15.96:0/4098367553 shutdown_connections 2022-02-02T20:32:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/4098367553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f7980 0x7f0ce80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/4098367553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f66e0 0x7f0ce80f6b00 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 -- 172.21.15.96:0/4098367553 >> 172.21.15.96:0/4098367553 conn(0x7f0ce80f1e40 msgr2=0x7f0ce80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 -- 172.21.15.96:0/4098367553 shutdown_connections 2022-02-02T20:32:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 -- 172.21.15.96:0/4098367553 wait complete. 2022-02-02T20:32:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.456+0000 7f0ceeffe700 1 Processor -- start 2022-02-02T20:32:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ceeffe700 1 -- start start 2022-02-02T20:32:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ceeffe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f66e0 0x7f0ce8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ceeffe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ceeffe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8107a50 con 0x7f0ce80f7980 2022-02-02T20:32:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ceeffe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8107b90 con 0x7f0ce80f66e0 2022-02-02T20:32:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37674/0 (socket says 172.21.15.96:37674) 2022-02-02T20:32:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 -- 172.21.15.96:0/3211892046 learned_addr learned my addr 172.21.15.96:0/3211892046 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0cecd9a700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f66e0 0x7f0ce8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 -- 172.21.15.96:0/3211892046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f66e0 msgr2=0x7f0ce8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f66e0 0x7f0ce8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.457+0000 7f0ce7fff700 1 -- 172.21.15.96:0/3211892046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc005040 con 0x7f0ce80f7980 2022-02-02T20:32:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ce7fff700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f0cd400c530 tx=0x7f0cd4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd400f650 con 0x7f0ce80f7980 2022-02-02T20:32:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cd400fc60 con 0x7f0ce80f7980 2022-02-02T20:32:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce8108530 con 0x7f0ce80f7980 2022-02-02T20:32:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd4012cd0 con 0x7f0ce80f7980 2022-02-02T20:32:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.458+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8108af0 con 0x7f0ce80f7980 2022-02-02T20:32:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.459+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0cd4010070 con 0x7f0ce80f7980 2022-02-02T20:32:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.459+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce8045ad0 con 0x7f0ce80f7980 2022-02-02T20:32:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.460+0000 7f0ce57fa700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 0x7f0cd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.460+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0cd40816c0 con 0x7f0ce80f7980 2022-02-02T20:32:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.460+0000 7f0cecd9a700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 0x7f0cd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.460+0000 7f0cecd9a700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 0x7f0cd8067290 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0cdc004e30 tx=0x7f0cdc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.464+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0cd40477d0 con 0x7f0ce80f7980 2022-02-02T20:32:23.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.693+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ce80ff020 con 0x7f0ce80f7980 2022-02-02T20:32:23.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.694+0000 7f0ce57fa700 1 -- 172.21.15.96:0/3211892046 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0cd40531f0 con 0x7f0ce80f7980 2022-02-02T20:32:23.695 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:32:23.696 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:32:23.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:32:23.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:23.696 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:32:23.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:32:23.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:23.697 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:32:23.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:32:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:32:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:32:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:32:23.699 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:32:23.699 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:32:23.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:32:23.699 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:32:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 msgr2=0x7f0cd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 0x7f0cd8067290 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0cdc004e30 tx=0x7f0cdc009b30).stop 2022-02-02T20:32:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 msgr2=0x7f0ce81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f0cd400c530 tx=0x7f0cd4007e20).stop 2022-02-02T20:32:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 shutdown_connections 2022-02-02T20:32:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cd8064dd0 0x7f0cd8067290 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80f66e0 0x7f0ce8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 --2- 172.21.15.96:0/3211892046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce80f7980 0x7f0ce81074a0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.695+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 >> 172.21.15.96:0/3211892046 conn(0x7f0ce80f1e40 msgr2=0x7f0ce80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.696+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 shutdown_connections 2022-02-02T20:32:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.696+0000 7f0ceeffe700 1 -- 172.21.15.96:0/3211892046 wait complete. 2022-02-02T20:32:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 -- 172.21.15.96:0/2586124962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f6860 msgr2=0x7f53440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 --2- 172.21.15.96:0/2586124962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f6860 0x7f53440f6cc0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f5338004660 tx=0x7f5338009b30).stop 2022-02-02T20:32:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 -- 172.21.15.96:0/2586124962 shutdown_connections 2022-02-02T20:32:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 --2- 172.21.15.96:0/2586124962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f6860 0x7f53440f6cc0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 --2- 172.21.15.96:0/2586124962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f55c0 0x7f53440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:32:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 -- 172.21.15.96:0/2586124962 >> 172.21.15.96:0/2586124962 conn(0x7f53440f0d40 msgr2=0x7f53440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 -- 172.21.15.96:0/2586124962 shutdown_connections 2022-02-02T20:32:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.793+0000 7f5348e85700 1 -- 172.21.15.96:0/2586124962 wait complete. 2022-02-02T20:32:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 Processor -- start 2022-02-02T20:32:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 -- start start 2022-02-02T20:32:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f6860 0x7f534410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344060450 con 0x7f53440f55c0 2022-02-02T20:32:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5348e85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344060590 con 0x7f53440f6860 2022-02-02T20:32:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37682/0 (socket says 172.21.15.96:37682) 2022-02-02T20:32:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 -- 172.21.15.96:0/1224395432 learned_addr learned my addr 172.21.15.96:0/1224395432 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f5341d9b700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f6860 0x7f534410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 -- 172.21.15.96:0/1224395432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f6860 msgr2=0x7f534410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f6860 0x7f534410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:23.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.794+0000 7f534259c700 1 -- 172.21.15.96:0/1224395432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338005040 con 0x7f53440f55c0 2022-02-02T20:32:23.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f534259c700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f53340093f0 tx=0x7f5334006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5334013640 con 0x7f53440f55c0 2022-02-02T20:32:23.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5334009e40 con 0x7f53440f55c0 2022-02-02T20:32:23.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533400dbf0 con 0x7f53440f55c0 2022-02-02T20:32:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534410c7e0 con 0x7f53440f55c0 2022-02-02T20:32:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.795+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534410cda0 con 0x7f53440f55c0 2022-02-02T20:32:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.796+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344045ad0 con 0x7f53440f55c0 2022-02-02T20:32:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.797+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f533401a060 con 0x7f53440f55c0 2022-02-02T20:32:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.797+0000 7f5332ffd700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 0x7f532c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.797+0000 7f5341d9b700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 0x7f532c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:23.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.797+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5334080fe0 con 0x7f53440f55c0 2022-02-02T20:32:23.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.798+0000 7f5341d9b700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 0x7f532c067290 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f5338004e30 tx=0x7f5338009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:23.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:23.802+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5334086060 con 0x7f53440f55c0 2022-02-02T20:32:24.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.003+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5344027a00 con 0x7f53440f55c0 2022-02-02T20:32:24.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.003+0000 7f5332ffd700 1 -- 172.21.15.96:0/1224395432 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f533404f050 con 0x7f53440f55c0 2022-02-02T20:32:24.006 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:32:24.006 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:32:24.006 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:32:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:32:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:32:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:32:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:32:24.008 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:32:24.008 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:32:24.008 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:32:24.008 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:32:24.009 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:32:24.009 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:32:24.009 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:32:24.009 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:32:24.010 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:32:24.010 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:32:24.010 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:32:24.010 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:32:24.011 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:32:24.011 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:32:24.011 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:32:24.011 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:32:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:32:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:32:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:32:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:32:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:32:24.013 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:32:24.013 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:32:24.013 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:32:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:24.014 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:32:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:24.014 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:24.014 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:24.015 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:24.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 msgr2=0x7f532c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:24.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 0x7f532c067290 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f5338004e30 tx=0x7f5338009b30).stop 2022-02-02T20:32:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 msgr2=0x7f5344109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f53340093f0 tx=0x7f5334006ec0).stop 2022-02-02T20:32:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 shutdown_connections 2022-02-02T20:32:24.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f532c064dd0 0x7f532c067290 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53440f55c0 0x7f5344109cd0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 --2- 172.21.15.96:0/1224395432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53440f6860 0x7f534410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 >> 172.21.15.96:0/1224395432 conn(0x7f53440f0d40 msgr2=0x7f53440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 shutdown_connections 2022-02-02T20:32:24.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:24.005+0000 7f5348e85700 1 -- 172.21.15.96:0/1224395432 wait complete. 2022-02-02T20:32:24.019 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:32:24.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:24 smithi159 ceph-mon[69013]: from='client.38116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:24.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:24 smithi159 ceph-mon[69013]: pgmap v3909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:24 smithi159 ceph-mon[69013]: from='client.38120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3211892046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:32:24.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1224395432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:32:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:24 smithi096 ceph-mon[101353]: from='client.38116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:24 smithi096 ceph-mon[101353]: pgmap v3909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:24 smithi096 ceph-mon[101353]: from='client.38120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3211892046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:32:24.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1224395432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:32:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:26 smithi159 ceph-mon[69013]: pgmap v3910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:26 smithi096 ceph-mon[101353]: pgmap v3910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:27 smithi096 ceph-mon[101353]: pgmap v3911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:32:28.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:32:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:27 smithi159 ceph-mon[69013]: pgmap v3911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:32:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:32:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:30 smithi159 ceph-mon[69013]: pgmap v3912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:30 smithi096 ceph-mon[101353]: pgmap v3912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:32 smithi159 ceph-mon[69013]: pgmap v3913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:32 smithi096 ceph-mon[101353]: pgmap v3913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:34.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:34 smithi159 ceph-mon[69013]: pgmap v3914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:34 smithi096 ceph-mon[101353]: pgmap v3914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:36 smithi159 ceph-mon[69013]: pgmap v3915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:36 smithi096 ceph-mon[101353]: pgmap v3915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:37 smithi096 ceph-mon[101353]: pgmap v3916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:37 smithi159 ceph-mon[69013]: pgmap v3916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:40 smithi159 ceph-mon[69013]: pgmap v3917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:40 smithi096 ceph-mon[101353]: pgmap v3917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:42.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:42 smithi159 ceph-mon[69013]: pgmap v3918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:42.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:42 smithi096 ceph-mon[101353]: pgmap v3918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:44 smithi096 ceph-mon[101353]: pgmap v3919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:44 smithi159 ceph-mon[69013]: pgmap v3919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:46 smithi096 ceph-mon[101353]: pgmap v3920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:46 smithi159 ceph-mon[69013]: pgmap v3920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:47 smithi096 ceph-mon[101353]: pgmap v3921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:47 smithi159 ceph-mon[69013]: pgmap v3921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:50 smithi159 ceph-mon[69013]: pgmap v3922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:50.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:50 smithi096 ceph-mon[101353]: pgmap v3922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:52 smithi096 ceph-mon[101353]: pgmap v3923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:52 smithi159 ceph-mon[69013]: pgmap v3923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:54.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 -- 172.21.15.96:0/3451612424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f6860 msgr2=0x7f5acc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/3451612424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f6860 0x7f5acc0f6cc0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f5ac8004660 tx=0x7f5ac8009b30).stop 2022-02-02T20:32:54.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 -- 172.21.15.96:0/3451612424 shutdown_connections 2022-02-02T20:32:54.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/3451612424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f6860 0x7f5acc0f6cc0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/3451612424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f55c0 0x7f5acc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.111+0000 7f5ad3f28700 1 -- 172.21.15.96:0/3451612424 >> 172.21.15.96:0/3451612424 conn(0x7f5acc0f0d40 msgr2=0x7f5acc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.112+0000 7f5ad3f28700 1 -- 172.21.15.96:0/3451612424 shutdown_connections 2022-02-02T20:32:54.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.112+0000 7f5ad3f28700 1 -- 172.21.15.96:0/3451612424 wait complete. 2022-02-02T20:32:54.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.112+0000 7f5ad3f28700 1 Processor -- start 2022-02-02T20:32:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.112+0000 7f5ad3f28700 1 -- start start 2022-02-02T20:32:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f6860 0x7f5acc10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc060500 con 0x7f5acc0f55c0 2022-02-02T20:32:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc060640 con 0x7f5acc0f6860 2022-02-02T20:32:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37698/0 (socket says 172.21.15.96:37698) 2022-02-02T20:32:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 -- 172.21.15.96:0/2771846028 learned_addr learned my addr 172.21.15.96:0/2771846028 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad14c3700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f6860 0x7f5acc10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 -- 172.21.15.96:0/2771846028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f6860 msgr2=0x7f5acc10c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f6860 0x7f5acc10c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 -- 172.21.15.96:0/2771846028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8005040 con 0x7f5acc0f55c0 2022-02-02T20:32:54.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad1cc4700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f5abc002700 tx=0x7f5abc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc009320 con 0x7f5acc0f55c0 2022-02-02T20:32:54.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5abc00f040 con 0x7f5acc0f55c0 2022-02-02T20:32:54.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc10c6e0 con 0x7f5acc0f55c0 2022-02-02T20:32:54.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc10cca0 con 0x7f5acc0f55c0 2022-02-02T20:32:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.113+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc014900 con 0x7f5acc0f55c0 2022-02-02T20:32:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.115+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc045ad0 con 0x7f5acc0f55c0 2022-02-02T20:32:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.115+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5abc009480 con 0x7f5acc0f55c0 2022-02-02T20:32:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.115+0000 7f5ac27fc700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.115+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5abc081cc0 con 0x7f5acc0f55c0 2022-02-02T20:32:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.115+0000 7f5ad14c3700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.116+0000 7f5ad14c3700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 0x7f5ab8067290 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f5ac8004630 tx=0x7f5ac8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.120+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5abc04fe80 con 0x7f5acc0f55c0 2022-02-02T20:32:54.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.299+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5acc0fdec0 con 0x7f5ab8064dd0 2022-02-02T20:32:54.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.301+0000 7f5ac27fc700 1 -- 172.21.15.96:0/2771846028 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5acc0fdec0 con 0x7f5ab8064dd0 2022-02-02T20:32:54.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.302+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 msgr2=0x7f5ab8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.302+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 0x7f5ab8067290 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f5ac8004630 tx=0x7f5ac8009b30).stop 2022-02-02T20:32:54.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.302+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 msgr2=0x7f5acc109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.302+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f5abc002700 tx=0x7f5abc009d80).stop 2022-02-02T20:32:54.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 shutdown_connections 2022-02-02T20:32:54.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5acc0f55c0 0x7f5acc109c30 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 --2- 172.21.15.96:0/2771846028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5acc0f6860 0x7f5acc10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 >> 172.21.15.96:0/2771846028 conn(0x7f5acc0f0d40 msgr2=0x7f5acc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 shutdown_connections 2022-02-02T20:32:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.303+0000 7f5ad3f28700 1 -- 172.21.15.96:0/2771846028 wait complete. 2022-02-02T20:32:54.314 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:32:54.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/3347885139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 msgr2=0x7fdf940f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/3347885139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f4ee0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7fdf84004660 tx=0x7fdf84009b30).stop 2022-02-02T20:32:54.402 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:54 smithi096 ceph-mon[101353]: pgmap v3924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:54.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/3347885139 shutdown_connections 2022-02-02T20:32:54.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/3347885139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 0x7fdf940f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:32:54.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/3347885139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f4ee0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/3347885139 >> 172.21.15.96:0/3347885139 conn(0x7fdf940f0540 msgr2=0x7fdf940f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/3347885139 shutdown_connections 2022-02-02T20:32:54.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.400+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/3347885139 wait complete. 2022-02-02T20:32:54.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 Processor -- start 2022-02-02T20:32:54.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 -- start start 2022-02-02T20:32:54.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 0x7fdf940f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940f6120 con 0x7fdf940f4ac0 2022-02-02T20:32:54.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf9b2b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940f6260 con 0x7fdf940f53d0 2022-02-02T20:32:54.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37708/0 (socket says 172.21.15.96:37708) 2022-02-02T20:32:54.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 -- 172.21.15.96:0/2370043091 learned_addr learned my addr 172.21.15.96:0/2370043091 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:54.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf98853700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 0x7fdf940f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 -- 172.21.15.96:0/2370043091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 msgr2=0x7fdf940f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 0x7fdf940f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 -- 172.21.15.96:0/2370043091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84005040 con 0x7fdf940f4ac0 2022-02-02T20:32:54.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.401+0000 7fdf99054700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7fdf84009da0 tx=0x7fdf84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.402+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf84018070 con 0x7fdf940f4ac0 2022-02-02T20:32:54.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.402+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf84007cf0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.402+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf8401c620 con 0x7fdf940f4ac0 2022-02-02T20:32:54.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.402+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf940f64e0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.402+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9410f1c0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.403+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94045ad0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.403+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf8401d420 con 0x7fdf940f4ac0 2022-02-02T20:32:54.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.404+0000 7fdf89ffb700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 0x7fdf80067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.404+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdf840838f0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.404+0000 7fdf98853700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 0x7fdf80067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.404+0000 7fdf98853700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 0x7fdf80067270 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fdf90006fd0 tx=0x7fdf90008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.408+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf840519f0 con 0x7fdf940f4ac0 2022-02-02T20:32:54.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.582+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf940ff150 con 0x7fdf80064db0 2022-02-02T20:32:54.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.591+0000 7fdf89ffb700 1 -- 172.21.15.96:0/2370043091 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdf940ff150 con 0x7fdf80064db0 2022-02-02T20:32:54.593 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:32:54.594 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 106m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:32:54.594 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 106m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:32:54.594 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 105m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:32:54.594 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 106m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:32:54.594 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 106m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:32:54.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 106m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:32:54.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 105m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:32:54.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 105m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:32:54.595 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 106m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:32:54.596 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 105m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:32:54.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 106m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:32:54.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 105m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:32:54.596 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 106m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:32:54.596 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 105m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:32:54.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 106m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:32:54.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 106m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:32:54.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 106m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:32:54.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 105m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:32:54.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 105m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:32:54.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 105m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:32:54.598 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 106m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:32:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 msgr2=0x7fdf80067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 0x7fdf80067270 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fdf90006fd0 tx=0x7fdf90008040).stop 2022-02-02T20:32:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 msgr2=0x7fdf940f76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7fdf84009da0 tx=0x7fdf84009b30).stop 2022-02-02T20:32:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 shutdown_connections 2022-02-02T20:32:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdf80064db0 0x7fdf80067270 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf940f4ac0 0x7fdf940f76b0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 --2- 172.21.15.96:0/2370043091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf940f53d0 0x7fdf940f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 >> 172.21.15.96:0/2370043091 conn(0x7fdf940f0540 msgr2=0x7fdf940fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 shutdown_connections 2022-02-02T20:32:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.593+0000 7fdf9b2b8700 1 -- 172.21.15.96:0/2370043091 wait complete. 2022-02-02T20:32:54.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 -- 172.21.15.96:0/1108936279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 msgr2=0x7f42d80f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 --2- 172.21.15.96:0/1108936279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f59f0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f42cc004660 tx=0x7f42cc009b30).stop 2022-02-02T20:32:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 -- 172.21.15.96:0/1108936279 shutdown_connections 2022-02-02T20:32:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 --2- 172.21.15.96:0/1108936279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 0x7f42d80f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 --2- 172.21.15.96:0/1108936279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f59f0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 -- 172.21.15.96:0/1108936279 >> 172.21.15.96:0/1108936279 conn(0x7f42d80f0d70 msgr2=0x7f42d80f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 -- 172.21.15.96:0/1108936279 shutdown_connections 2022-02-02T20:32:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.690+0000 7f42ded12700 1 -- 172.21.15.96:0/1108936279 wait complete. 2022-02-02T20:32:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 Processor -- start 2022-02-02T20:32:54.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 -- start start 2022-02-02T20:32:54.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 0x7f42d80f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80f8110 con 0x7f42d80f55d0 2022-02-02T20:32:54.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.691+0000 7f42ded12700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80f8250 con 0x7f42d80f6870 2022-02-02T20:32:54.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37718/0 (socket says 172.21.15.96:37718) 2022-02-02T20:32:54.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 -- 172.21.15.96:0/259287809 learned_addr learned my addr 172.21.15.96:0/259287809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:54.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42d7fff700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 0x7f42d80f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 -- 172.21.15.96:0/259287809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 msgr2=0x7f42d80f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 0x7f42d80f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 -- 172.21.15.96:0/259287809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc005040 con 0x7f42d80f55d0 2022-02-02T20:32:54.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42dcaae700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f42cc013a70 tx=0x7f42cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc018070 con 0x7f42d80f55d0 2022-02-02T20:32:54.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d80f84d0 con 0x7f42d80f55d0 2022-02-02T20:32:54.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42cc0097d0 con 0x7f42d80f55d0 2022-02-02T20:32:54.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42cc01c3c0 con 0x7f42d80f55d0 2022-02-02T20:32:54.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.692+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d80f8a30 con 0x7f42d80f55d0 2022-02-02T20:32:54.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.693+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8045ad0 con 0x7f42d80f55d0 2022-02-02T20:32:54.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.694+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42cc007ba0 con 0x7f42d80f55d0 2022-02-02T20:32:54.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.694+0000 7f42d57fa700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:54.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.695+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42cc083640 con 0x7f42d80f55d0 2022-02-02T20:32:54.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.695+0000 7f42d7fff700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:54.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.695+0000 7f42d7fff700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f42c4009760 tx=0x7f42c4009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:54.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.699+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42cc051800 con 0x7f42d80f55d0 2022-02-02T20:32:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:54 smithi159 ceph-mon[69013]: pgmap v3924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:54.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.929+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42d810f630 con 0x7f42d80f55d0 2022-02-02T20:32:54.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.930+0000 7f42d57fa700 1 -- 172.21.15.96:0/259287809 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f42cc054e20 con 0x7f42d80f55d0 2022-02-02T20:32:54.933 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:32:54.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:32:54.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:32:54.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:54.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:32:54.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:32:54.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:54.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:32:54.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:32:54.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:54.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:32:54.938 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:32:54.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:32:54.938 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:32:54.939 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:32:54.939 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:32:54.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:32:54.939 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:32:54.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 msgr2=0x7f42c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f42c4009760 tx=0x7f42c4009c60).stop 2022-02-02T20:32:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 msgr2=0x7f42d80f9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f42cc013a70 tx=0x7f42cc009b30).stop 2022-02-02T20:32:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 shutdown_connections 2022-02-02T20:32:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42c8064dd0 0x7f42c8067290 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42d80f55d0 0x7f42d80f9730 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 --2- 172.21.15.96:0/259287809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d80f6870 0x7f42d80f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:54.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 >> 172.21.15.96:0/259287809 conn(0x7f42d80f0d70 msgr2=0x7f42d805ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:54.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 shutdown_connections 2022-02-02T20:32:54.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:54.932+0000 7f42ded12700 1 -- 172.21.15.96:0/259287809 wait complete. 2022-02-02T20:32:55.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 -- 172.21.15.96:0/2061542110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f5ed0 msgr2=0x7f50ec0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:55.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 --2- 172.21.15.96:0/2061542110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec0f6900 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7f50e0004660 tx=0x7f50e0009b30).stop 2022-02-02T20:32:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 -- 172.21.15.96:0/2061542110 shutdown_connections 2022-02-02T20:32:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 --2- 172.21.15.96:0/2061542110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec0f6900 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 --2- 172.21.15.96:0/2061542110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f55c0 0x7f50ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 -- 172.21.15.96:0/2061542110 >> 172.21.15.96:0/2061542110 conn(0x7f50ec0f0de0 msgr2=0x7f50ec0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 -- 172.21.15.96:0/2061542110 shutdown_connections 2022-02-02T20:32:55.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.029+0000 7f50f183d700 1 -- 172.21.15.96:0/2061542110 wait complete. 2022-02-02T20:32:55.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 Processor -- start 2022-02-02T20:32:55.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 -- start start 2022-02-02T20:32:55.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:55.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:55.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0604c0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50f183d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec060600 con 0x7f50ec0f5ed0 2022-02-02T20:32:55.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:55.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37728/0 (socket says 172.21.15.96:37728) 2022-02-02T20:32:55.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.030+0000 7f50eaffd700 1 -- 172.21.15.96:0/4200352130 learned_addr learned my addr 172.21.15.96:0/4200352130 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:32:55.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50ea7fc700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:55.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50eaffd700 1 -- 172.21.15.96:0/4200352130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f5ed0 msgr2=0x7f50ec10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:55.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50eaffd700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50eaffd700 1 -- 172.21.15.96:0/4200352130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0005040 con 0x7f50ec0f55c0 2022-02-02T20:32:55.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50eaffd700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f50dc0026d0 tx=0x7f50dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:55.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc0079c0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec10c720 con 0x7f50ec0f55c0 2022-02-02T20:32:55.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f50dc00f040 con 0x7f50ec0f55c0 2022-02-02T20:32:55.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc0148b0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.031+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec10cce0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.032+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec045ad0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.033+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f50dc007b20 con 0x7f50ec0f55c0 2022-02-02T20:32:55.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.033+0000 7f50d37fe700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:32:55.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.033+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50dc081990 con 0x7f50ec0f55c0 2022-02-02T20:32:55.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.033+0000 7f50ea7fc700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:32:55.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.034+0000 7f50ea7fc700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 0x7f50d4067290 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f50e0004630 tx=0x7f50e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:32:55.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.038+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50dc04fa90 con 0x7f50ec0f55c0 2022-02-02T20:32:55.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.239+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50ec10c8b0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.240+0000 7f50d37fe700 1 -- 172.21.15.96:0/4200352130 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f50ec10c8b0 con 0x7f50ec0f55c0 2022-02-02T20:32:55.242 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:32:55.243 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:32:55.243 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:32:55.243 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:32:55.243 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:55.244 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:32:55.244 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:32:55.244 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:32:55.244 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:32:55.245 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:32:55.245 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:32:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:32:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:32:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:32:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:32:55.247 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:32:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:32:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:32:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:32:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:32:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:32:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:32:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:32:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:32:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:32:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:32:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:32:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:32:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:32:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:32:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:32:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:32:55.253 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:55.253 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:32:55.253 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:32:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:55.254 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:55.254 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:32:55.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 msgr2=0x7f50d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 0x7f50d4067290 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f50e0004630 tx=0x7f50e0009b30).stop 2022-02-02T20:32:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 msgr2=0x7f50ec109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:32:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f50dc0026d0 tx=0x7f50dc009de0).stop 2022-02-02T20:32:55.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 shutdown_connections 2022-02-02T20:32:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50ec0f55c0 0x7f50ec109c70 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 --2- 172.21.15.96:0/4200352130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50ec0f5ed0 0x7f50ec10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:32:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 >> 172.21.15.96:0/4200352130 conn(0x7f50ec0f0de0 msgr2=0x7f50ec0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:32:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 shutdown_connections 2022-02-02T20:32:55.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:32:55.243+0000 7f50f183d700 1 -- 172.21.15.96:0/4200352130 wait complete. 2022-02-02T20:32:55.259 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:32:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:55 smithi096 ceph-mon[101353]: from='client.38132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:55 smithi096 ceph-mon[101353]: from='client.38136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/259287809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:32:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4200352130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:32:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:55 smithi159 ceph-mon[69013]: from='client.38132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:55 smithi159 ceph-mon[69013]: from='client.38136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:32:55.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/259287809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:32:55.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4200352130' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:32:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:56 smithi096 ceph-mon[101353]: pgmap v3925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:56 smithi159 ceph-mon[69013]: pgmap v3925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:32:57 smithi096 ceph-mon[101353]: pgmap v3926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:32:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:32:57 smithi159 ceph-mon[69013]: pgmap v3926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:00 smithi159 ceph-mon[69013]: pgmap v3927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:00 smithi096 ceph-mon[101353]: pgmap v3927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:02 smithi096 ceph-mon[101353]: pgmap v3928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:02 smithi159 ceph-mon[69013]: pgmap v3928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:04 smithi096 ceph-mon[101353]: pgmap v3929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:04 smithi159 ceph-mon[69013]: pgmap v3929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:06 smithi096 ceph-mon[101353]: pgmap v3930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:06 smithi159 ceph-mon[69013]: pgmap v3930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:07 smithi096 ceph-mon[101353]: pgmap v3931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:07 smithi159 ceph-mon[69013]: pgmap v3931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:10 smithi096 ceph-mon[101353]: pgmap v3932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:10.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:10 smithi159 ceph-mon[69013]: pgmap v3932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:12 smithi096 ceph-mon[101353]: pgmap v3933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:12 smithi159 ceph-mon[69013]: pgmap v3933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:14 smithi096 ceph-mon[101353]: pgmap v3934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:14 smithi159 ceph-mon[69013]: pgmap v3934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:16 smithi096 ceph-mon[101353]: pgmap v3935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:16 smithi159 ceph-mon[69013]: pgmap v3935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:18.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:17 smithi096 ceph-mon[101353]: pgmap v3936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:17 smithi159 ceph-mon[69013]: pgmap v3936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:20.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:20 smithi096 ceph-mon[101353]: pgmap v3937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:20 smithi159 ceph-mon[69013]: pgmap v3937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:22 smithi096 ceph-mon[101353]: pgmap v3938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:22 smithi159 ceph-mon[69013]: pgmap v3938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:24 smithi096 ceph-mon[101353]: pgmap v3939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:24 smithi159 ceph-mon[69013]: pgmap v3939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:25.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.352+0000 7f71df59e700 1 -- 172.21.15.96:0/3959418573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 msgr2=0x7f71e00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.352+0000 7f71df59e700 1 --2- 172.21.15.96:0/3959418573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e00fbae0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f71d0004660 tx=0x7f71d0009b30).stop 2022-02-02T20:33:25.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 -- 172.21.15.96:0/3959418573 shutdown_connections 2022-02-02T20:33:25.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 --2- 172.21.15.96:0/3959418573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e00fbae0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 --2- 172.21.15.96:0/3959418573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 0x7f71e00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 -- 172.21.15.96:0/3959418573 >> 172.21.15.96:0/3959418573 conn(0x7f71e00f0b90 msgr2=0x7f71e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:25.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 -- 172.21.15.96:0/3959418573 shutdown_connections 2022-02-02T20:33:25.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 -- 172.21.15.96:0/3959418573 wait complete. 2022-02-02T20:33:25.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.353+0000 7f71df59e700 1 Processor -- start 2022-02-02T20:33:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71df59e700 1 -- start start 2022-02-02T20:33:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71df59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 0x7f71e0106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71df59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71df59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e01078b0 con 0x7f71e00f9690 2022-02-02T20:33:25.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71df59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e01080f0 con 0x7f71e0060310 2022-02-02T20:33:25.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37750/0 (socket says 172.21.15.96:37750) 2022-02-02T20:33:25.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 -- 172.21.15.96:0/1002828768 learned_addr learned my addr 172.21.15.96:0/1002828768 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:25.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71de59c700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 0x7f71e0106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 -- 172.21.15.96:0/1002828768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 msgr2=0x7f71e0106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 0x7f71e0106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 -- 172.21.15.96:0/1002828768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0005040 con 0x7f71e00f9690 2022-02-02T20:33:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.354+0000 7f71ddd9b700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f71d0013a70 tx=0x7f71d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.355+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d0018070 con 0x7f71e00f9690 2022-02-02T20:33:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.355+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e0108370 con 0x7f71e00f9690 2022-02-02T20:33:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.355+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e0108850 con 0x7f71e00f9690 2022-02-02T20:33:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.355+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71d00097d0 con 0x7f71e00f9690 2022-02-02T20:33:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.355+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d001de80 con 0x7f71e00f9690 2022-02-02T20:33:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.356+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4004fa0 con 0x7f71e00f9690 2022-02-02T20:33:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.356+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71d0007ba0 con 0x7f71e00f9690 2022-02-02T20:33:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.357+0000 7f71ceffd700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 0x7f71c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.357+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71d0083580 con 0x7f71e00f9690 2022-02-02T20:33:25.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.357+0000 7f71de59c700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 0x7f71c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.357+0000 7f71de59c700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 0x7f71c80672e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f71e0107b80 tx=0x7f71d400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.361+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71d0051680 con 0x7f71e00f9690 2022-02-02T20:33:25.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.538+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71c4000bc0 con 0x7f71c8064e20 2022-02-02T20:33:25.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.540+0000 7f71ceffd700 1 -- 172.21.15.96:0/1002828768 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f71c4000bc0 con 0x7f71c8064e20 2022-02-02T20:33:25.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 msgr2=0x7f71c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 0x7f71c80672e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f71e0107b80 tx=0x7f71d400b040).stop 2022-02-02T20:33:25.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 msgr2=0x7f71e01072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f71d0013a70 tx=0x7f71d0009b30).stop 2022-02-02T20:33:25.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 shutdown_connections 2022-02-02T20:33:25.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71c8064e20 0x7f71c80672e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71e0060310 0x7f71e0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 --2- 172.21.15.96:0/1002828768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71e00f9690 0x7f71e01072b0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 >> 172.21.15.96:0/1002828768 conn(0x7f71e00f0b90 msgr2=0x7f71e00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:25.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 shutdown_connections 2022-02-02T20:33:25.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.541+0000 7f71df59e700 1 -- 172.21.15.96:0/1002828768 wait complete. 2022-02-02T20:33:25.553 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:33:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 -- 172.21.15.96:0/4167998363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 msgr2=0x7f7c740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 --2- 172.21.15.96:0/4167998363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c740f6cc0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f7c64004660 tx=0x7f7c64009b30).stop 2022-02-02T20:33:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 -- 172.21.15.96:0/4167998363 shutdown_connections 2022-02-02T20:33:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 --2- 172.21.15.96:0/4167998363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c740f6cc0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 --2- 172.21.15.96:0/4167998363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 0x7f7c740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 -- 172.21.15.96:0/4167998363 >> 172.21.15.96:0/4167998363 conn(0x7f7c740f0d40 msgr2=0x7f7c740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 -- 172.21.15.96:0/4167998363 shutdown_connections 2022-02-02T20:33:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.639+0000 7f7c79527700 1 -- 172.21.15.96:0/4167998363 wait complete. 2022-02-02T20:33:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 Processor -- start 2022-02-02T20:33:25.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 -- start start 2022-02-02T20:33:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 0x7f7c74109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74060480 con 0x7f7c740f6860 2022-02-02T20:33:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c79527700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740605c0 con 0x7f7c740f55c0 2022-02-02T20:33:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37760/0 (socket says 172.21.15.96:37760) 2022-02-02T20:33:25.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c727fc700 1 -- 172.21.15.96:0/3685447216 learned_addr learned my addr 172.21.15.96:0/3685447216 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:25.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.640+0000 7f7c72ffd700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 0x7f7c74109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c727fc700 1 -- 172.21.15.96:0/3685447216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 msgr2=0x7f7c74109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c727fc700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 0x7f7c74109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c727fc700 1 -- 172.21.15.96:0/3685447216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64005040 con 0x7f7c740f6860 2022-02-02T20:33:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c727fc700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f7c64009990 tx=0x7f7c64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64018070 con 0x7f7c740f6860 2022-02-02T20:33:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c64007ba0 con 0x7f7c740f6860 2022-02-02T20:33:25.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7410c6a0 con 0x7f7c740f6860 2022-02-02T20:33:25.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6401c3c0 con 0x7f7c740f6860 2022-02-02T20:33:25.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.641+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7410cc00 con 0x7f7c740f6860 2022-02-02T20:33:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.642+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74045ad0 con 0x7f7c740f6860 2022-02-02T20:33:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.642+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c6401d420 con 0x7f7c740f6860 2022-02-02T20:33:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.643+0000 7f7c6b7fe700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.643+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7c64083630 con 0x7f7c740f6860 2022-02-02T20:33:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.643+0000 7f7c72ffd700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.643+0000 7f7c72ffd700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 0x7f7c60067290 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7c74060100 tx=0x7f7c5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.647+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c64051730 con 0x7f7c740f6860 2022-02-02T20:33:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.818+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c74057f10 con 0x7f7c60064dd0 2022-02-02T20:33:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.827+0000 7f7c6b7fe700 1 -- 172.21.15.96:0/3685447216 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7c74057f10 con 0x7f7c60064dd0 2022-02-02T20:33:25.830 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:33:25.830 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 107m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:33:25.831 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 107m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:33:25.831 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 105m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:33:25.831 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 107m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:33:25.831 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 107m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:33:25.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 107m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:33:25.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 105m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:33:25.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 105m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:33:25.832 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 107m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:33:25.833 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 105m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:33:25.833 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 107m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:33:25.833 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 105m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:33:25.833 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 107m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:33:25.834 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 105m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:33:25.834 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 107m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:33:25.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 107m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:33:25.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 107m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:33:25.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 105m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:33:25.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 105m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:33:25.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 105m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:33:25.837 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 107m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:33:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 msgr2=0x7f7c60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 0x7f7c60067290 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f7c74060100 tx=0x7f7c5c00b040).stop 2022-02-02T20:33:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 msgr2=0x7f7c7410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f7c64009990 tx=0x7f7c64009b30).stop 2022-02-02T20:33:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 shutdown_connections 2022-02-02T20:33:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f55c0 0x7f7c74109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 --2- 172.21.15.96:0/3685447216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6860 0x7f7c7410c150 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 >> 172.21.15.96:0/3685447216 conn(0x7f7c740f0d40 msgr2=0x7f7c740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 shutdown_connections 2022-02-02T20:33:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.829+0000 7f7c79527700 1 -- 172.21.15.96:0/3685447216 wait complete. 2022-02-02T20:33:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 -- 172.21.15.96:0/3831399570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f55c0 msgr2=0x7f9b680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 --2- 172.21.15.96:0/3831399570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f55c0 0x7f9b680f59e0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f9b58004660 tx=0x7f9b58009b30).stop 2022-02-02T20:33:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 -- 172.21.15.96:0/3831399570 shutdown_connections 2022-02-02T20:33:25.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 --2- 172.21.15.96:0/3831399570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f6860 0x7f9b680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 --2- 172.21.15.96:0/3831399570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f55c0 0x7f9b680f59e0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 -- 172.21.15.96:0/3831399570 >> 172.21.15.96:0/3831399570 conn(0x7f9b680f0d40 msgr2=0x7f9b680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:25.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.925+0000 7f9b6db71700 1 -- 172.21.15.96:0/3831399570 shutdown_connections 2022-02-02T20:33:25.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.927+0000 7f9b6db71700 1 -- 172.21.15.96:0/3831399570 wait complete. 2022-02-02T20:33:25.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.927+0000 7f9b6db71700 1 Processor -- start 2022-02-02T20:33:25.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.927+0000 7f9b6db71700 1 -- start start 2022-02-02T20:33:25.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 0x7f9b68106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68107a10 con 0x7f9b680f6860 2022-02-02T20:33:25.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68107b50 con 0x7f9b680f55c0 2022-02-02T20:33:25.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37770/0 (socket says 172.21.15.96:37770) 2022-02-02T20:33:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 -- 172.21.15.96:0/2606362099 learned_addr learned my addr 172.21.15.96:0/2606362099 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b677fe700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 0x7f9b68106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 -- 172.21.15.96:0/2606362099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 msgr2=0x7f9b68106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:25.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 0x7f9b68106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 -- 172.21.15.96:0/2606362099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58005040 con 0x7f9b680f6860 2022-02-02T20:33:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b677fe700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 0x7f9b68106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:33:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b66ffd700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f9b5c00c530 tx=0x7f9b5c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c00f650 con 0x7f9b680f6860 2022-02-02T20:33:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b5c00fc60 con 0x7f9b680f6860 2022-02-02T20:33:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b681084f0 con 0x7f9b680f6860 2022-02-02T20:33:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c012cd0 con 0x7f9b680f6860 2022-02-02T20:33:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.928+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b68108ab0 con 0x7f9b680f6860 2022-02-02T20:33:25.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.929+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b68045ad0 con 0x7f9b680f6860 2022-02-02T20:33:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.930+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b5c010070 con 0x7f9b680f6860 2022-02-02T20:33:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.930+0000 7f9b4ffff700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 0x7f9b50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.930+0000 7f9b677fe700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 0x7f9b50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.930+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b5c0817b0 con 0x7f9b680f6860 2022-02-02T20:33:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.931+0000 7f9b677fe700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 0x7f9b50067290 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9b58009da0 tx=0x7f9b58009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:25.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:25.935+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b5c0532e0 con 0x7f9b680f6860 2022-02-02T20:33:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.163+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b6810d590 con 0x7f9b680f6860 2022-02-02T20:33:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.163+0000 7f9b4ffff700 1 -- 172.21.15.96:0/2606362099 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9b5c052ed0 con 0x7f9b680f6860 2022-02-02T20:33:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:33:26.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:33:26.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:33:26.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:26.168 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:33:26.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:33:26.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:26.168 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:33:26.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:33:26.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:26.169 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:33:26.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:33:26.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:26.170 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:33:26.170 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:33:26.171 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:33:26.171 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:33:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:33:26.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 msgr2=0x7f9b50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 0x7f9b50067290 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9b58009da0 tx=0x7f9b58009b30).stop 2022-02-02T20:33:26.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 msgr2=0x7f9b68107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f9b5c00c530 tx=0x7f9b5c007e20).stop 2022-02-02T20:33:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 shutdown_connections 2022-02-02T20:33:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b50064dd0 0x7f9b50067290 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b680f55c0 0x7f9b68106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 --2- 172.21.15.96:0/2606362099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b680f6860 0x7f9b68107460 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 >> 172.21.15.96:0/2606362099 conn(0x7f9b680f0d40 msgr2=0x7f9b6805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:26.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 shutdown_connections 2022-02-02T20:33:26.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.165+0000 7f9b6db71700 1 -- 172.21.15.96:0/2606362099 wait complete. 2022-02-02T20:33:26.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 -- 172.21.15.96:0/1997811315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 msgr2=0x7f805c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 --2- 172.21.15.96:0/1997811315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f59e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f804c004660 tx=0x7f804c009b30).stop 2022-02-02T20:33:26.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 -- 172.21.15.96:0/1997811315 shutdown_connections 2022-02-02T20:33:26.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 --2- 172.21.15.96:0/1997811315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 0x7f805c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 --2- 172.21.15.96:0/1997811315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f59e0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.262+0000 7f80612ba700 1 -- 172.21.15.96:0/1997811315 >> 172.21.15.96:0/1997811315 conn(0x7f805c0f0d40 msgr2=0x7f805c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:26.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 -- 172.21.15.96:0/1997811315 shutdown_connections 2022-02-02T20:33:26.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 -- 172.21.15.96:0/1997811315 wait complete. 2022-02-02T20:33:26.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 Processor -- start 2022-02-02T20:33:26.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 -- start start 2022-02-02T20:33:26.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:26.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 0x7f805c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:26.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0f8100 con 0x7f805c0f55c0 2022-02-02T20:33:26.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.263+0000 7f80612ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0f8240 con 0x7f805c0f6860 2022-02-02T20:33:26.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:26.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37778/0 (socket says 172.21.15.96:37778) 2022-02-02T20:33:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 -- 172.21.15.96:0/2193392956 learned_addr learned my addr 172.21.15.96:0/2193392956 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805a7fc700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 0x7f805c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 -- 172.21.15.96:0/2193392956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 msgr2=0x7f805c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 0x7f805c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 -- 172.21.15.96:0/2193392956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c005040 con 0x7f805c0f55c0 2022-02-02T20:33:26.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f805affd700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f804c013a70 tx=0x7f804c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:26.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f804c018070 con 0x7f805c0f55c0 2022-02-02T20:33:26.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f804c0097d0 con 0x7f805c0f55c0 2022-02-02T20:33:26.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f804c01de80 con 0x7f805c0f55c0 2022-02-02T20:33:26.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c0f84c0 con 0x7f805c0f55c0 2022-02-02T20:33:26.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.264+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c0f8a20 con 0x7f805c0f55c0 2022-02-02T20:33:26.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.266+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c045ad0 con 0x7f805c0f55c0 2022-02-02T20:33:26.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.266+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f804c007ba0 con 0x7f805c0f55c0 2022-02-02T20:33:26.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.267+0000 7f80437fe700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 0x7f8044067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:26.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.267+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f804c083650 con 0x7f805c0f55c0 2022-02-02T20:33:26.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.267+0000 7f805a7fc700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 0x7f8044067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:26.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.267+0000 7f805a7fc700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 0x7f8044067290 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f8050004e20 tx=0x7f805000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:26.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.271+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f804c051750 con 0x7f805c0f55c0 2022-02-02T20:33:26.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.475+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f805c10f660 con 0x7f805c0f55c0 2022-02-02T20:33:26.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.476+0000 7f80437fe700 1 -- 172.21.15.96:0/2193392956 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f804c054d70 con 0x7f805c0f55c0 2022-02-02T20:33:26.479 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:33:26.479 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:33:26.479 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:33:26.480 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:33:26.480 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:26.480 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:33:26.480 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:33:26.481 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:33:26.481 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:33:26.481 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:33:26.481 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:33:26.481 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:33:26.482 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:33:26.482 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:33:26.482 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:33:26.482 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:33:26.483 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:33:26.483 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:33:26.483 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:33:26.483 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:33:26.484 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:33:26.484 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:33:26.484 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:33:26.485 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:33:26.485 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:33:26.485 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:33:26.485 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:33:26.486 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:33:26.486 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:33:26.486 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:33:26.486 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:33:26.486 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:33:26.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:26.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:26.487 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:33:26.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:26.487 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:26.488 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:26.488 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 msgr2=0x7f8044067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 0x7f8044067290 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f8050004e20 tx=0x7f805000b040).stop 2022-02-02T20:33:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 msgr2=0x7f805c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f804c013a70 tx=0x7f804c009b30).stop 2022-02-02T20:33:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 shutdown_connections 2022-02-02T20:33:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8044064dd0 0x7f8044067290 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f805c0f55c0 0x7f805c0f9720 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 --2- 172.21.15.96:0/2193392956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f805c0f6860 0x7f805c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 >> 172.21.15.96:0/2193392956 conn(0x7f805c0f0d40 msgr2=0x7f805c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 shutdown_connections 2022-02-02T20:33:26.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:26.478+0000 7f80612ba700 1 -- 172.21.15.96:0/2193392956 wait complete. 2022-02-02T20:33:26.492 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:33:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:26 smithi096 ceph-mon[101353]: pgmap v3940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:26 smithi096 ceph-mon[101353]: from='client.38148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:26.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2606362099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:33:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:26 smithi159 ceph-mon[69013]: pgmap v3940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:26 smithi159 ceph-mon[69013]: from='client.38148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:26.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2606362099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:33:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:27 smithi096 ceph-mon[101353]: from='client.38152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2193392956' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:33:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:27 smithi159 ceph-mon[69013]: from='client.38152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2193392956' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:33:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:28 smithi096 ceph-mon[101353]: pgmap v3941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:28.559 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:33:28.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:33:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:28 smithi159 ceph-mon[69013]: pgmap v3941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:33:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:33:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:30 smithi096 ceph-mon[101353]: pgmap v3942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:30.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:30 smithi159 ceph-mon[69013]: pgmap v3942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:32 smithi096 ceph-mon[101353]: pgmap v3943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:32 smithi159 ceph-mon[69013]: pgmap v3943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:34 smithi159 ceph-mon[69013]: pgmap v3944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:34 smithi096 ceph-mon[101353]: pgmap v3944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:36 smithi159 ceph-mon[69013]: pgmap v3945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:36 smithi096 ceph-mon[101353]: pgmap v3945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:37 smithi096 ceph-mon[101353]: pgmap v3946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:37 smithi159 ceph-mon[69013]: pgmap v3946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:40 smithi096 ceph-mon[101353]: pgmap v3947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:40 smithi159 ceph-mon[69013]: pgmap v3947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:42 smithi096 ceph-mon[101353]: pgmap v3948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:42 smithi159 ceph-mon[69013]: pgmap v3948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:44.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:44 smithi096 ceph-mon[101353]: pgmap v3949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:44 smithi159 ceph-mon[69013]: pgmap v3949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:46.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:46 smithi096 ceph-mon[101353]: pgmap v3950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:46 smithi159 ceph-mon[69013]: pgmap v3950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:47 smithi096 ceph-mon[101353]: pgmap v3951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:47 smithi159 ceph-mon[69013]: pgmap v3951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:50 smithi096 ceph-mon[101353]: pgmap v3952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:50 smithi159 ceph-mon[69013]: pgmap v3952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:52 smithi096 ceph-mon[101353]: pgmap v3953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:52 smithi159 ceph-mon[69013]: pgmap v3953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:54.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:54 smithi096 ceph-mon[101353]: pgmap v3954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:54 smithi159 ceph-mon[69013]: pgmap v3954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:56.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:56 smithi096 ceph-mon[101353]: pgmap v3955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/1633842770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 msgr2=0x7fcfa40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/1633842770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa40f7de0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7fcf98004660 tx=0x7fcf98009b30).stop 2022-02-02T20:33:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/1633842770 shutdown_connections 2022-02-02T20:33:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/1633842770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa40f7de0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/1633842770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 0x7fcfa40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/1633842770 >> 172.21.15.96:0/1633842770 conn(0x7fcfa40f1e40 msgr2=0x7fcfa40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/1633842770 shutdown_connections 2022-02-02T20:33:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.589+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/1633842770 wait complete. 2022-02-02T20:33:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 Processor -- start 2022-02-02T20:33:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 -- start start 2022-02-02T20:33:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 0x7fcfa406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa406a380 con 0x7fcfa40f7980 2022-02-02T20:33:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.590+0000 7fcfa9cf0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa406a4c0 con 0x7fcfa40f66e0 2022-02-02T20:33:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37798/0 (socket says 172.21.15.96:37798) 2022-02-02T20:33:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 -- 172.21.15.96:0/2904768672 learned_addr learned my addr 172.21.15.96:0/2904768672 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa37fe700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 0x7fcfa406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 -- 172.21.15.96:0/2904768672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 msgr2=0x7fcfa406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 0x7fcfa406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 -- 172.21.15.96:0/2904768672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98005040 con 0x7fcfa40f7980 2022-02-02T20:33:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa2ffd700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7fcf98009990 tx=0x7fcf98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:56.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf98018070 con 0x7fcfa40f7980 2022-02-02T20:33:56.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa406a740 con 0x7fcfa40f7980 2022-02-02T20:33:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf98007ba0 con 0x7fcfa40f7980 2022-02-02T20:33:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9801c620 con 0x7fcfa40f7980 2022-02-02T20:33:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.591+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa406aca0 con 0x7fcfa40f7980 2022-02-02T20:33:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.592+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa4045ad0 con 0x7fcfa40f7980 2022-02-02T20:33:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.593+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf9801c8e0 con 0x7fcfa40f7980 2022-02-02T20:33:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.593+0000 7fcf8bfff700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.593+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf98083950 con 0x7fcfa40f7980 2022-02-02T20:33:56.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.593+0000 7fcfa37fe700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.594+0000 7fcfa37fe700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 0x7fcf8c067290 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fcfa406b730 tx=0x7fcf94009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:56.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.598+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf98051990 con 0x7fcfa40f7980 2022-02-02T20:33:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:56 smithi159 ceph-mon[69013]: pgmap v3955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:56.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.780+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfa40ff010 con 0x7fcf8c064dd0 2022-02-02T20:33:56.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.781+0000 7fcf8bfff700 1 -- 172.21.15.96:0/2904768672 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcfa40ff010 con 0x7fcf8c064dd0 2022-02-02T20:33:56.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 msgr2=0x7fcf8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 0x7fcf8c067290 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fcfa406b730 tx=0x7fcf94009040).stop 2022-02-02T20:33:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 msgr2=0x7fcfa4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7fcf98009990 tx=0x7fcf98009b30).stop 2022-02-02T20:33:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 shutdown_connections 2022-02-02T20:33:56.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa40f66e0 0x7fcfa406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 --2- 172.21.15.96:0/2904768672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfa40f7980 0x7fcfa4069e20 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 >> 172.21.15.96:0/2904768672 conn(0x7fcfa40f1e40 msgr2=0x7fcfa40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:56.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 shutdown_connections 2022-02-02T20:33:56.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.783+0000 7fcfa9cf0700 1 -- 172.21.15.96:0/2904768672 wait complete. 2022-02-02T20:33:56.794 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:33:56.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 -- 172.21.15.96:0/3553281825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 msgr2=0x7f20dc0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/3553281825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc0f9340 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f20c4004660 tx=0x7f20c4009b30).stop 2022-02-02T20:33:56.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 -- 172.21.15.96:0/3553281825 shutdown_connections 2022-02-02T20:33:56.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/3553281825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 0x7f20dc0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/3553281825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc0f9340 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 -- 172.21.15.96:0/3553281825 >> 172.21.15.96:0/3553281825 conn(0x7f20dc0f0d40 msgr2=0x7f20dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:56.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 -- 172.21.15.96:0/3553281825 shutdown_connections 2022-02-02T20:33:56.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 -- 172.21.15.96:0/3553281825 wait complete. 2022-02-02T20:33:56.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.881+0000 7f20e1f4b700 1 Processor -- start 2022-02-02T20:33:56.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20e1f4b700 1 -- start start 2022-02-02T20:33:56.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20e1f4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20e1f4b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 0x7f20dc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20e1f4b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc107a00 con 0x7f20dc060270 2022-02-02T20:33:56.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20e1f4b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc107b40 con 0x7f20dc0f9830 2022-02-02T20:33:56.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37806/0 (socket says 172.21.15.96:37806) 2022-02-02T20:33:56.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 -- 172.21.15.96:0/2494553103 learned_addr learned my addr 172.21.15.96:0/2494553103 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:56.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20daffd700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 0x7f20dc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 -- 172.21.15.96:0/2494553103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 msgr2=0x7f20dc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:56.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 0x7f20dc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:56.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.882+0000 7f20db7fe700 1 -- 172.21.15.96:0/2494553103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4005040 con 0x7f20dc060270 2022-02-02T20:33:56.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20db7fe700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f20c4009990 tx=0x7f20c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:56.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c4018070 con 0x7f20dc060270 2022-02-02T20:33:56.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20c4007c70 con 0x7f20dc060270 2022-02-02T20:33:56.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc108480 con 0x7f20dc060270 2022-02-02T20:33:56.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c401c620 con 0x7f20dc060270 2022-02-02T20:33:56.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.883+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc1089e0 con 0x7f20dc060270 2022-02-02T20:33:56.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.884+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc045ad0 con 0x7f20dc060270 2022-02-02T20:33:56.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.884+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f20c401c890 con 0x7f20dc060270 2022-02-02T20:33:56.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.884+0000 7f20d3fff700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 0x7f20c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:56.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.885+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20c4083850 con 0x7f20dc060270 2022-02-02T20:33:56.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.885+0000 7f20daffd700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 0x7f20c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:56.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.885+0000 7f20daffd700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 0x7f20c8067290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f20cc0041d0 tx=0x7f20cc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:56.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:56.889+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20c4055440 con 0x7f20dc060270 2022-02-02T20:33:57.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.064+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20dc0ff030 con 0x7f20c8064dd0 2022-02-02T20:33:57.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.073+0000 7f20d3fff700 1 -- 172.21.15.96:0/2494553103 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f20dc0ff030 con 0x7f20c8064dd0 2022-02-02T20:33:57.075 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:33:57.075 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 107m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:33:57.075 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 107m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:33:57.076 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 106m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:33:57.076 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 107m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:33:57.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 107m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:33:57.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 107m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:33:57.077 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 106m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:33:57.077 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 106m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:33:57.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 107m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:33:57.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 106m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:33:57.077 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 107m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:33:57.078 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 106m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:33:57.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 107m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:33:57.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 106m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:33:57.078 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 107m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:33:57.078 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 107m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:33:57.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 107m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:33:57.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 106m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:33:57.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 106m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:33:57.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 106m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:33:57.080 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 107m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:33:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 msgr2=0x7f20c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 0x7f20c8067290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f20cc0041d0 tx=0x7f20cc009040).stop 2022-02-02T20:33:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 msgr2=0x7f20dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f20c4009990 tx=0x7f20c4009b30).stop 2022-02-02T20:33:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 shutdown_connections 2022-02-02T20:33:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20c8064dd0 0x7f20c8067290 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc060270 0x7f20dc106f60 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 --2- 172.21.15.96:0/2494553103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20dc0f9830 0x7f20dc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 >> 172.21.15.96:0/2494553103 conn(0x7f20dc0f0d40 msgr2=0x7f20dc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 shutdown_connections 2022-02-02T20:33:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.075+0000 7f20e1f4b700 1 -- 172.21.15.96:0/2494553103 wait complete. 2022-02-02T20:33:57.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 -- 172.21.15.96:0/3782612692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 msgr2=0x7f41b00f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 --2- 172.21.15.96:0/3782612692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f5df0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f41a00099e0 tx=0x7f41a0004d10).stop 2022-02-02T20:33:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 -- 172.21.15.96:0/3782612692 shutdown_connections 2022-02-02T20:33:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 --2- 172.21.15.96:0/3782612692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f5df0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 --2- 172.21.15.96:0/3782612692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 0x7f41b00f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.171+0000 7f41b704e700 1 -- 172.21.15.96:0/3782612692 >> 172.21.15.96:0/3782612692 conn(0x7f41b00f04c0 msgr2=0x7f41b00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.172+0000 7f41b704e700 1 -- 172.21.15.96:0/3782612692 shutdown_connections 2022-02-02T20:33:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.172+0000 7f41b704e700 1 -- 172.21.15.96:0/3782612692 wait complete. 2022-02-02T20:33:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 Processor -- start 2022-02-02T20:33:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 -- start start 2022-02-02T20:33:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 0x7f41b00f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00f8220 con 0x7f41b00f5970 2022-02-02T20:33:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b704e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00f8360 con 0x7f41b00f6c60 2022-02-02T20:33:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37816/0 (socket says 172.21.15.96:37816) 2022-02-02T20:33:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 -- 172.21.15.96:0/3363009740 learned_addr learned my addr 172.21.15.96:0/3363009740 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:57.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41affff700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 0x7f41b00f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 -- 172.21.15.96:0/3363009740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 msgr2=0x7f41b00f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 0x7f41b00f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.173+0000 7f41b4dea700 1 -- 172.21.15.96:0/3363009740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0009640 con 0x7f41b00f5970 2022-02-02T20:33:57.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41b4dea700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f41a800c530 tx=0x7f41a8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:57.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a800f650 con 0x7f41b00f5970 2022-02-02T20:33:57.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41a800fc60 con 0x7f41b00f5970 2022-02-02T20:33:57.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b00f8640 con 0x7f41b00f5970 2022-02-02T20:33:57.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a8012c20 con 0x7f41b00f5970 2022-02-02T20:33:57.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.174+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b010f050 con 0x7f41b00f5970 2022-02-02T20:33:57.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.175+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b0045ad0 con 0x7f41b00f5970 2022-02-02T20:33:57.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.176+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f41a8010070 con 0x7f41b00f5970 2022-02-02T20:33:57.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.176+0000 7f41ad7fa700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 0x7f419c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.176+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41a8081e60 con 0x7f41b00f5970 2022-02-02T20:33:57.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.176+0000 7f41affff700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 0x7f419c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.177+0000 7f41affff700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 0x7f419c067290 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f41a0003380 tx=0x7f41a0004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:57.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.179+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41a804ffe0 con 0x7f41b00f5970 2022-02-02T20:33:57.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.415+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41b010f780 con 0x7f41b00f5970 2022-02-02T20:33:57.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.415+0000 7f41ad7fa700 1 -- 172.21.15.96:0/3363009740 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f41a8020070 con 0x7f41b00f5970 2022-02-02T20:33:57.418 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:33:57.419 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:33:57.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:33:57.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:57.419 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:33:57.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:33:57.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:57.420 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:33:57.420 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:33:57.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:57.421 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:33:57.421 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:33:57.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:33:57.421 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:33:57.421 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:33:57.422 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:33:57.422 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:33:57.422 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:33:57.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 msgr2=0x7f419c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 0x7f419c067290 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f41a0003380 tx=0x7f41a0004d10).stop 2022-02-02T20:33:57.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 msgr2=0x7f41b00f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f41a800c530 tx=0x7f41a8007e20).stop 2022-02-02T20:33:57.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 shutdown_connections 2022-02-02T20:33:57.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f419c064dd0 0x7f419c067290 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b00f5970 0x7f41b00f9840 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 --2- 172.21.15.96:0/3363009740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41b00f6c60 0x7f41b00f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 >> 172.21.15.96:0/3363009740 conn(0x7f41b00f04c0 msgr2=0x7f41b00f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 shutdown_connections 2022-02-02T20:33:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.417+0000 7f41b704e700 1 -- 172.21.15.96:0/3363009740 wait complete. 2022-02-02T20:33:57.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 -- 172.21.15.96:0/3248630696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f7980 msgr2=0x7ff8dc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/3248630696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc0f7de0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7ff8d0004660 tx=0x7ff8d0009b30).stop 2022-02-02T20:33:57.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 -- 172.21.15.96:0/3248630696 shutdown_connections 2022-02-02T20:33:57.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/3248630696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc0f7de0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/3248630696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 -- 172.21.15.96:0/3248630696 >> 172.21.15.96:0/3248630696 conn(0x7ff8dc0f1e40 msgr2=0x7ff8dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:57.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.515+0000 7ff8e1fea700 1 -- 172.21.15.96:0/3248630696 shutdown_connections 2022-02-02T20:33:57.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.516+0000 7ff8e1fea700 1 -- 172.21.15.96:0/3248630696 wait complete. 2022-02-02T20:33:57.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.516+0000 7ff8e1fea700 1 Processor -- start 2022-02-02T20:33:57.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8e1fea700 1 -- start start 2022-02-02T20:33:57.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8e1fea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8e1fea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8e1fea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc107a00 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8e1fea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc107b40 con 0x7ff8dc0f7980 2022-02-02T20:33:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8daffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8daffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:41932/0 (socket says 172.21.15.96:41932) 2022-02-02T20:33:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8daffd700 1 -- 172.21.15.96:0/2767642517 learned_addr learned my addr 172.21.15.96:0/2767642517 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:33:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8db7fe700 1 -- 172.21.15.96:0/2767642517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 msgr2=0x7ff8dc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8db7fe700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8db7fe700 1 -- 172.21.15.96:0/2767642517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0005040 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.517+0000 7ff8db7fe700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc106f60 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7ff8cc0026d0 tx=0x7ff8cc009ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.518+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8cc0079c0 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.518+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8cc00f040 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.518+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc1084e0 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.518+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8cc014750 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.518+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc108aa0 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.519+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc045ad0 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.519+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff8cc01b060 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.520+0000 7ff8c3fff700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 0x7ff8c4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:33:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.520+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff8cc081710 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.520+0000 7ff8daffd700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 0x7ff8c4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:33:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.520+0000 7ff8daffd700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 0x7ff8c4067270 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7ff8d0004e30 tx=0x7ff8d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:33:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.524+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff8cc053240 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.724+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8dc0ff020 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.724+0000 7ff8c3fff700 1 -- 172.21.15.96:0/2767642517 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff8cc019070 con 0x7ff8dc0f66e0 2022-02-02T20:33:57.729 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:33:57.729 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:33:57.730 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:33:57.730 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:33:57.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:57.731 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:33:57.731 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:33:57.732 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:33:57.732 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:33:57.732 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:33:57.733 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:33:57.733 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:33:57.733 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:33:57.733 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:33:57.734 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:33:57.734 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:33:57.734 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:33:57.735 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:33:57.735 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:33:57.735 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:33:57.735 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:33:57.735 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:33:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:33:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:33:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:33:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:33:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:33:57.737 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:33:57.737 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:33:57.737 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:33:57.737 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:33:57.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:33:57.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:57.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:57.738 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:33:57.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:33:57.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:57.740 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:57.740 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:33:57.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 msgr2=0x7ff8c4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 0x7ff8c4067270 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7ff8d0004e30 tx=0x7ff8d0009b30).stop 2022-02-02T20:33:57.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 msgr2=0x7ff8dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:33:57.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc106f60 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7ff8cc0026d0 tx=0x7ff8cc009ce0).stop 2022-02-02T20:33:57.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 shutdown_connections 2022-02-02T20:33:57.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8c4064db0 0x7ff8c4067270 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8dc0f66e0 0x7ff8dc106f60 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 --2- 172.21.15.96:0/2767642517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8dc0f7980 0x7ff8dc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:33:57.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 >> 172.21.15.96:0/2767642517 conn(0x7ff8dc0f1e40 msgr2=0x7ff8dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:33:57.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 shutdown_connections 2022-02-02T20:33:57.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:33:57.726+0000 7ff8e1fea700 1 -- 172.21.15.96:0/2767642517 wait complete. 2022-02-02T20:33:57.744 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:33:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:57 smithi096 ceph-mon[101353]: from='client.38164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:57 smithi096 ceph-mon[101353]: from='client.38168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:57 smithi096 ceph-mon[101353]: pgmap v3956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3363009740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:33:58.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:33:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2767642517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:33:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:57 smithi159 ceph-mon[69013]: from='client.38164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:57 smithi159 ceph-mon[69013]: from='client.38168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:33:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:57 smithi159 ceph-mon[69013]: pgmap v3956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:33:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3363009740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:33:58.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:33:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2767642517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:34:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:00 smithi096 ceph-mon[101353]: pgmap v3957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:00 smithi159 ceph-mon[69013]: pgmap v3957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:02 smithi096 ceph-mon[101353]: pgmap v3958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:02 smithi159 ceph-mon[69013]: pgmap v3958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:04 smithi096 ceph-mon[101353]: pgmap v3959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:04 smithi159 ceph-mon[69013]: pgmap v3959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:06 smithi096 ceph-mon[101353]: pgmap v3960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:06 smithi159 ceph-mon[69013]: pgmap v3960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:07 smithi159 ceph-mon[69013]: pgmap v3961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:07 smithi096 ceph-mon[101353]: pgmap v3961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:10 smithi096 ceph-mon[101353]: pgmap v3962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:10 smithi159 ceph-mon[69013]: pgmap v3962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:12 smithi096 ceph-mon[101353]: pgmap v3963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:12 smithi159 ceph-mon[69013]: pgmap v3963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:14.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:14 smithi096 ceph-mon[101353]: pgmap v3964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:14 smithi159 ceph-mon[69013]: pgmap v3964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:16.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:16 smithi096 ceph-mon[101353]: pgmap v3965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:16 smithi159 ceph-mon[69013]: pgmap v3965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:17 smithi159 ceph-mon[69013]: pgmap v3966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:17 smithi096 ceph-mon[101353]: pgmap v3966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:20 smithi096 ceph-mon[101353]: pgmap v3967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:20 smithi159 ceph-mon[69013]: pgmap v3967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:22.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:22 smithi096 ceph-mon[101353]: pgmap v3968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:22 smithi159 ceph-mon[69013]: pgmap v3968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:24.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:24 smithi096 ceph-mon[101353]: pgmap v3969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:24 smithi159 ceph-mon[69013]: pgmap v3969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:26 smithi096 ceph-mon[101353]: pgmap v3970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:26 smithi159 ceph-mon[69013]: pgmap v3970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 -- 172.21.15.96:0/1902728189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f7980 msgr2=0x7f79880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:27.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 --2- 172.21.15.96:0/1902728189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f7980 0x7f79880f7de0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f7984004660 tx=0x7f7984009b30).stop 2022-02-02T20:34:27.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 -- 172.21.15.96:0/1902728189 shutdown_connections 2022-02-02T20:34:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 --2- 172.21.15.96:0/1902728189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f7980 0x7f79880f7de0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 --2- 172.21.15.96:0/1902728189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f66e0 0x7f79880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 -- 172.21.15.96:0/1902728189 >> 172.21.15.96:0/1902728189 conn(0x7f79880f1e40 msgr2=0x7f79880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 -- 172.21.15.96:0/1902728189 shutdown_connections 2022-02-02T20:34:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.839+0000 7f798f7e3700 1 -- 172.21.15.96:0/1902728189 wait complete. 2022-02-02T20:34:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 Processor -- start 2022-02-02T20:34:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 -- start start 2022-02-02T20:34:27.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f7980 0x7f7988069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798806a380 con 0x7f79880f66e0 2022-02-02T20:34:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798f7e3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798806a4c0 con 0x7f79880f7980 2022-02-02T20:34:27.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:27.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37844/0 (socket says 172.21.15.96:37844) 2022-02-02T20:34:27.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 -- 172.21.15.96:0/2216420271 learned_addr learned my addr 172.21.15.96:0/2216420271 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:27.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798cd7e700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f7980 0x7f7988069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:27.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 -- 172.21.15.96:0/2216420271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f7980 msgr2=0x7f7988069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:27.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f7980 0x7f7988069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:27.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.840+0000 7f798d57f700 1 -- 172.21.15.96:0/2216420271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984005040 con 0x7f79880f66e0 2022-02-02T20:34:27.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f798d57f700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f797c00c530 tx=0x7f797c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:27.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797c00f650 con 0x7f79880f66e0 2022-02-02T20:34:27.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f797c00fc60 con 0x7f79880f66e0 2022-02-02T20:34:27.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798806a7a0 con 0x7f79880f66e0 2022-02-02T20:34:27.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797c012cb0 con 0x7f79880f66e0 2022-02-02T20:34:27.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.841+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798810ef90 con 0x7f79880f66e0 2022-02-02T20:34:27.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.842+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7988045ad0 con 0x7f79880f66e0 2022-02-02T20:34:27.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.842+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f797c019030 con 0x7f79880f66e0 2022-02-02T20:34:27.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.843+0000 7f7979ffb700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 0x7f7974067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:27.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.843+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f797c081630 con 0x7f79880f66e0 2022-02-02T20:34:27.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.843+0000 7f798cd7e700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 0x7f7974067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:27.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.843+0000 7f798cd7e700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 0x7f7974067290 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7984004630 tx=0x7f7984009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:27.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:27.847+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f797c04f7e0 con 0x7f79880f66e0 2022-02-02T20:34:28.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.024+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7988057f10 con 0x7f7974064dd0 2022-02-02T20:34:28.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.025+0000 7f7979ffb700 1 -- 172.21.15.96:0/2216420271 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7988057f10 con 0x7f7974064dd0 2022-02-02T20:34:28.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.026+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 msgr2=0x7f7974067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.026+0000 7f798f7e3700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 0x7f7974067290 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7984004630 tx=0x7f7984009b30).stop 2022-02-02T20:34:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.026+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 msgr2=0x7f798806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.026+0000 7f798f7e3700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f797c00c530 tx=0x7f797c007e10).stop 2022-02-02T20:34:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 shutdown_connections 2022-02-02T20:34:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7974064dd0 0x7f7974067290 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79880f66e0 0x7f798806b9a0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 --2- 172.21.15.96:0/2216420271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880f7980 0x7f7988069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 >> 172.21.15.96:0/2216420271 conn(0x7f79880f1e40 msgr2=0x7f79880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 shutdown_connections 2022-02-02T20:34:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.027+0000 7f798f7e3700 1 -- 172.21.15.96:0/2216420271 wait complete. 2022-02-02T20:34:28.038 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:34:28.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 -- 172.21.15.96:0/789421098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f5400 msgr2=0x7fa80c0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 --2- 172.21.15.96:0/789421098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f5400 0x7fa80c0fbd10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7fa7f8004660 tx=0x7fa7f8009b30).stop 2022-02-02T20:34:28.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 -- 172.21.15.96:0/789421098 shutdown_connections 2022-02-02T20:34:28.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 --2- 172.21.15.96:0/789421098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f5400 0x7fa80c0fbd10 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 --2- 172.21.15.96:0/789421098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f4a60 0x7fa80c0f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 -- 172.21.15.96:0/789421098 >> 172.21.15.96:0/789421098 conn(0x7fa80c0f04c0 msgr2=0x7fa80c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.128 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:27 smithi096 ceph-mon[101353]: pgmap v3971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:28.128 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:34:28.128 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:34:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.124+0000 7fa812bef700 1 -- 172.21.15.96:0/789421098 shutdown_connections 2022-02-02T20:34:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.125+0000 7fa812bef700 1 -- 172.21.15.96:0/789421098 wait complete. 2022-02-02T20:34:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.125+0000 7fa812bef700 1 Processor -- start 2022-02-02T20:34:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.125+0000 7fa812bef700 1 -- start start 2022-02-02T20:34:28.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa812bef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 0x7fa80c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa812bef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa812bef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c107a90 con 0x7fa80c0f4a60 2022-02-02T20:34:28.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa812bef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c107bd0 con 0x7fa80c0f5400 2022-02-02T20:34:28.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa81098b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 0x7fa80c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:41960/0 (socket says 172.21.15.96:41960) 2022-02-02T20:34:28.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa80bfff700 1 -- 172.21.15.96:0/1220232352 learned_addr learned my addr 172.21.15.96:0/1220232352 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa81098b700 1 -- 172.21.15.96:0/1220232352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 msgr2=0x7fa80c1074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa81098b700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa81098b700 1 -- 172.21.15.96:0/1220232352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8005040 con 0x7fa80c0f4a60 2022-02-02T20:34:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa80bfff700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T20:34:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.126+0000 7fa81098b700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 0x7fa80c106ff0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fa800002700 tx=0x7fa800009cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.127+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8000079c0 con 0x7fa80c0f4a60 2022-02-02T20:34:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.127+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c108570 con 0x7fa80c0f4a60 2022-02-02T20:34:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.127+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa80000f040 con 0x7fa80c0f4a60 2022-02-02T20:34:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.127+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8000146a0 con 0x7fa80c0f4a60 2022-02-02T20:34:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.127+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c108b30 con 0x7fa80c0f4a60 2022-02-02T20:34:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.128+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c045ad0 con 0x7fa80c0f4a60 2022-02-02T20:34:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.128+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa80001b060 con 0x7fa80c0f4a60 2022-02-02T20:34:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.129+0000 7fa8097fa700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 0x7fa7fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.129+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa800081840 con 0x7fa80c0f4a60 2022-02-02T20:34:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.129+0000 7fa80bfff700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 0x7fa7fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.129+0000 7fa80bfff700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 0x7fa7fc067290 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fa7f8004e30 tx=0x7fa7f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.133+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa800053370 con 0x7fa80c0f4a60 2022-02-02T20:34:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:27 smithi159 ceph-mon[69013]: pgmap v3971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:34:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:34:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.305+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa80c0ff030 con 0x7fa7fc064dd0 2022-02-02T20:34:28.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.314+0000 7fa8097fa700 1 -- 172.21.15.96:0/1220232352 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa80c0ff030 con 0x7fa7fc064dd0 2022-02-02T20:34:28.316 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:34:28.316 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 108m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:34:28.317 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 108m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:34:28.317 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 106m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:34:28.317 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 108m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:34:28.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 108m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:34:28.318 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 108m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:34:28.318 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 106m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:34:28.318 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 106m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:34:28.318 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 108m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:34:28.318 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 106m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:34:28.319 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 108m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:34:28.319 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 106m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:34:28.319 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 108m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:34:28.320 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 106m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:34:28.320 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 108m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:34:28.320 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 108m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:34:28.320 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 108m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:34:28.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 106m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:34:28.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 106m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:34:28.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 106m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:34:28.321 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 108m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:34:28.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 msgr2=0x7fa7fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 0x7fa7fc067290 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fa7f8004e30 tx=0x7fa7f8009b30).stop 2022-02-02T20:34:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 msgr2=0x7fa80c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 0x7fa80c106ff0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fa800002700 tx=0x7fa800009cc0).stop 2022-02-02T20:34:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 shutdown_connections 2022-02-02T20:34:28.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7fc064dd0 0x7fa7fc067290 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa80c0f4a60 0x7fa80c106ff0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 --2- 172.21.15.96:0/1220232352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa80c0f5400 0x7fa80c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 >> 172.21.15.96:0/1220232352 conn(0x7fa80c0f04c0 msgr2=0x7fa80c0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 shutdown_connections 2022-02-02T20:34:28.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.316+0000 7fa812bef700 1 -- 172.21.15.96:0/1220232352 wait complete. 2022-02-02T20:34:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 -- 172.21.15.96:0/2423477564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 msgr2=0x7f4c140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2423477564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c140f6b00 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f4c08004660 tx=0x7f4c08009b30).stop 2022-02-02T20:34:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 -- 172.21.15.96:0/2423477564 shutdown_connections 2022-02-02T20:34:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2423477564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 0x7f4c140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2423477564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c140f6b00 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 -- 172.21.15.96:0/2423477564 >> 172.21.15.96:0/2423477564 conn(0x7f4c140f1e40 msgr2=0x7f4c140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 -- 172.21.15.96:0/2423477564 shutdown_connections 2022-02-02T20:34:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.412+0000 7f4c188eb700 1 -- 172.21.15.96:0/2423477564 wait complete. 2022-02-02T20:34:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 Processor -- start 2022-02-02T20:34:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 -- start start 2022-02-02T20:34:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 0x7f4c141074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14107a50 con 0x7f4c140f66e0 2022-02-02T20:34:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c188eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14107b90 con 0x7f4c140f7980 2022-02-02T20:34:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37864/0 (socket says 172.21.15.96:37864) 2022-02-02T20:34:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c1259c700 1 -- 172.21.15.96:0/2292317707 learned_addr learned my addr 172.21.15.96:0/2292317707 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.413+0000 7f4c11d9b700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 0x7f4c141074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c1259c700 1 -- 172.21.15.96:0/2292317707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 msgr2=0x7f4c141074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c1259c700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 0x7f4c141074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c1259c700 1 -- 172.21.15.96:0/2292317707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005040 con 0x7f4c140f66e0 2022-02-02T20:34:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c1259c700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f4c08013a70 tx=0x7f4c08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c08018070 con 0x7f4c140f66e0 2022-02-02T20:34:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c080097d0 con 0x7f4c140f66e0 2022-02-02T20:34:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c141084d0 con 0x7f4c140f66e0 2022-02-02T20:34:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c0801de80 con 0x7f4c140f66e0 2022-02-02T20:34:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.414+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14108a30 con 0x7f4c140f66e0 2022-02-02T20:34:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.415+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c14045ad0 con 0x7f4c140f66e0 2022-02-02T20:34:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.415+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c08007ba0 con 0x7f4c140f66e0 2022-02-02T20:34:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.416+0000 7f4c02ffd700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 0x7f4bfc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.416+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4c08083560 con 0x7f4c140f66e0 2022-02-02T20:34:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.416+0000 7f4c11d9b700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 0x7f4bfc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.416+0000 7f4c11d9b700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 0x7f4bfc067290 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f4c04004c40 tx=0x7f4c0400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.420+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c08055090 con 0x7f4c140f66e0 2022-02-02T20:34:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.651+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c140fef40 con 0x7f4c140f66e0 2022-02-02T20:34:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.651+0000 7f4c02ffd700 1 -- 172.21.15.96:0/2292317707 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4c08054c80 con 0x7f4c140f66e0 2022-02-02T20:34:28.654 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:34:28.654 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:34:28.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:34:28.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:28.655 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:34:28.655 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:34:28.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:28.655 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:34:28.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:34:28.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:28.656 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:34:28.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:34:28.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:28.657 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:34:28.657 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:34:28.657 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:34:28.658 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:34:28.659 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:34:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 msgr2=0x7f4bfc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 0x7f4bfc067290 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f4c04004c40 tx=0x7f4c0400b040).stop 2022-02-02T20:34:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 msgr2=0x7f4c14106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f4c08013a70 tx=0x7f4c08009b30).stop 2022-02-02T20:34:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 shutdown_connections 2022-02-02T20:34:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064dd0 0x7f4bfc067290 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f66e0 0x7f4c14106fb0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 --2- 172.21.15.96:0/2292317707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f7980 0x7f4c141074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 >> 172.21.15.96:0/2292317707 conn(0x7f4c140f1e40 msgr2=0x7f4c140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 shutdown_connections 2022-02-02T20:34:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.653+0000 7f4c188eb700 1 -- 172.21.15.96:0/2292317707 wait complete. 2022-02-02T20:34:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/868857012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 msgr2=0x7fbfd80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/868857012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd80f7de0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fbfd4004660 tx=0x7fbfd4009b30).stop 2022-02-02T20:34:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/868857012 shutdown_connections 2022-02-02T20:34:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/868857012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd80f7de0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/868857012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 0x7fbfd80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/868857012 >> 172.21.15.96:0/868857012 conn(0x7fbfd80f1e40 msgr2=0x7fbfd80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/868857012 shutdown_connections 2022-02-02T20:34:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.750+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/868857012 wait complete. 2022-02-02T20:34:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 Processor -- start 2022-02-02T20:34:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 -- start start 2022-02-02T20:34:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 0x7fbfd806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd806a380 con 0x7fbfd80f7980 2022-02-02T20:34:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.751+0000 7fbfdfc3c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd806a4c0 con 0x7fbfd80f66e0 2022-02-02T20:34:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37876/0 (socket says 172.21.15.96:37876) 2022-02-02T20:34:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 -- 172.21.15.96:0/2061674333 learned_addr learned my addr 172.21.15.96:0/2061674333 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd9d8700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 0x7fbfd806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 -- 172.21.15.96:0/2061674333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 msgr2=0x7fbfd806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 0x7fbfd806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 -- 172.21.15.96:0/2061674333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4005040 con 0x7fbfd80f7980 2022-02-02T20:34:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdd1d7700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fbfd4009990 tx=0x7fbfd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd4018070 con 0x7fbfd80f7980 2022-02-02T20:34:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfd4007ca0 con 0x7fbfd80f7980 2022-02-02T20:34:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd806a740 con 0x7fbfd80f7980 2022-02-02T20:34:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd806aca0 con 0x7fbfd80f7980 2022-02-02T20:34:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.752+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd401c620 con 0x7fbfd80f7980 2022-02-02T20:34:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.754+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc0004fa0 con 0x7fbfd80f7980 2022-02-02T20:34:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.754+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbfd401c890 con 0x7fbfd80f7980 2022-02-02T20:34:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.754+0000 7fbfca7fc700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 0x7fbfc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.754+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbfd40836b0 con 0x7fbfd80f7980 2022-02-02T20:34:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.754+0000 7fbfdd9d8700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 0x7fbfc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.755+0000 7fbfdd9d8700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 0x7fbfc4067290 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fbfd806b730 tx=0x7fbfcc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.758+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbfd40517b0 con 0x7fbfd80f7980 2022-02-02T20:34:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.962+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbfc0005e80 con 0x7fbfd80f7980 2022-02-02T20:34:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.963+0000 7fbfca7fc700 1 -- 172.21.15.96:0/2061674333 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbfd4054dd0 con 0x7fbfd80f7980 2022-02-02T20:34:28.965 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:34:28.965 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:34:28.965 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:34:28.966 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:34:28.966 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:34:28.966 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:34:28.966 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:34:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:34:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:34:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:34:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:34:28.968 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:34:28.968 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:34:28.968 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:34:28.968 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:34:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:34:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:34:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:34:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:34:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:34:28.970 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:34:28.970 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:34:28.970 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:34:28.970 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:34:28.971 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:34:28.971 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:34:28.971 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:34:28.971 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:34:28.971 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:34:28.972 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:34:28.972 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:34:28.972 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:34:28.972 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:34:28.973 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:34:28.973 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:34:28.973 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:34:28.973 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:34:28.973 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:34:28.974 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:34:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 msgr2=0x7fbfc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 0x7fbfc4067290 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fbfd806b730 tx=0x7fbfcc009040).stop 2022-02-02T20:34:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 msgr2=0x7fbfd8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fbfd4009990 tx=0x7fbfd4009b30).stop 2022-02-02T20:34:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 shutdown_connections 2022-02-02T20:34:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfc4064dd0 0x7fbfc4067290 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd80f66e0 0x7fbfd806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 --2- 172.21.15.96:0/2061674333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfd80f7980 0x7fbfd8069e20 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.964+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 >> 172.21.15.96:0/2061674333 conn(0x7fbfd80f1e40 msgr2=0x7fbfd80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.965+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 shutdown_connections 2022-02-02T20:34:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:28.965+0000 7fbfdfc3c700 1 -- 172.21.15.96:0/2061674333 wait complete. 2022-02-02T20:34:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:34:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:28 smithi096 ceph-mon[101353]: from='client.38180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:34:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:28 smithi096 ceph-mon[101353]: from='client.38184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:34:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2292317707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:34:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:28 smithi159 ceph-mon[69013]: from='client.38180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:34:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:28 smithi159 ceph-mon[69013]: from='client.38184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:34:29.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2292317707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:34:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2061674333' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:34:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:29 smithi159 ceph-mon[69013]: pgmap v3972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:30.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2061674333' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:34:30.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:29 smithi096 ceph-mon[101353]: pgmap v3972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:32 smithi096 ceph-mon[101353]: pgmap v3973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:32 smithi159 ceph-mon[69013]: pgmap v3973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:34 smithi096 ceph-mon[101353]: pgmap v3974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:34 smithi159 ceph-mon[69013]: pgmap v3974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:36 smithi096 ceph-mon[101353]: pgmap v3975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:36 smithi159 ceph-mon[69013]: pgmap v3975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:37 smithi159 ceph-mon[69013]: pgmap v3976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:37 smithi096 ceph-mon[101353]: pgmap v3976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:40 smithi096 ceph-mon[101353]: pgmap v3977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:40 smithi159 ceph-mon[69013]: pgmap v3977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:42.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:42 smithi096 ceph-mon[101353]: pgmap v3978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:42 smithi159 ceph-mon[69013]: pgmap v3978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:44 smithi159 ceph-mon[69013]: pgmap v3979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:44 smithi096 ceph-mon[101353]: pgmap v3979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:46 smithi159 ceph-mon[69013]: pgmap v3980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:46 smithi096 ceph-mon[101353]: pgmap v3980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:47 smithi159 ceph-mon[69013]: pgmap v3981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:47 smithi096 ceph-mon[101353]: pgmap v3981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:50 smithi096 ceph-mon[101353]: pgmap v3982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:50.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:50 smithi159 ceph-mon[69013]: pgmap v3982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:52 smithi159 ceph-mon[69013]: pgmap v3983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:52 smithi096 ceph-mon[101353]: pgmap v3983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:54 smithi159 ceph-mon[69013]: pgmap v3984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:54 smithi096 ceph-mon[101353]: pgmap v3984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:56 smithi159 ceph-mon[69013]: pgmap v3985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:56 smithi096 ceph-mon[101353]: pgmap v3985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:34:57 smithi159 ceph-mon[69013]: pgmap v3986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:34:57 smithi096 ceph-mon[101353]: pgmap v3986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:34:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2007918675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 msgr2=0x7f80a40f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2007918675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a40f4e60 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f8098004660 tx=0x7f8098009b30).stop 2022-02-02T20:34:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2007918675 shutdown_connections 2022-02-02T20:34:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2007918675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a40f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2007918675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a40f4e60 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2007918675 >> 172.21.15.96:0/2007918675 conn(0x7f80a40f04c0 msgr2=0x7f80a40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.075+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2007918675 shutdown_connections 2022-02-02T20:34:59.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.076+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2007918675 wait complete. 2022-02-02T20:34:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.076+0000 7f80ab1fb700 1 Processor -- start 2022-02-02T20:34:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.076+0000 7f80ab1fb700 1 -- start start 2022-02-02T20:34:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80ab1fb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80ab1fb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a4109870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80ab1fb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4109e20 con 0x7f80a40f4a40 2022-02-02T20:34:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80ab1fb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4109f60 con 0x7f80a40f53e0 2022-02-02T20:34:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37892/0 (socket says 172.21.15.96:37892) 2022-02-02T20:34:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 -- 172.21.15.96:0/2925986804 learned_addr learned my addr 172.21.15.96:0/2925986804 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a3fff700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a4109870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 -- 172.21.15.96:0/2925986804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 msgr2=0x7f80a4109870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a4109870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 -- 172.21.15.96:0/2925986804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098005040 con 0x7f80a40f4a40 2022-02-02T20:34:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a3fff700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a4109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:34:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.077+0000 7f80a8f97700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f8098009990 tx=0x7f8098009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.078+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8098018070 con 0x7f80a40f4a40 2022-02-02T20:34:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.078+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8098007ba0 con 0x7f80a40f4a40 2022-02-02T20:34:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.078+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a410a8a0 con 0x7f80a40f4a40 2022-02-02T20:34:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.078+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809801c3c0 con 0x7f80a40f4a40 2022-02-02T20:34:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.078+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a410ae00 con 0x7f80a40f4a40 2022-02-02T20:34:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.079+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a4045ad0 con 0x7f80a40f4a40 2022-02-02T20:34:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.079+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f809801d420 con 0x7f80a40f4a40 2022-02-02T20:34:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.080+0000 7f80a17fa700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 0x7f8094067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.080+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8098083680 con 0x7f80a40f4a40 2022-02-02T20:34:59.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.080+0000 7f80a3fff700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 0x7f8094067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.080+0000 7f80a3fff700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 0x7f8094067290 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f80a40f5860 tx=0x7f8090009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.084+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8098055150 con 0x7f80a40f4a40 2022-02-02T20:34:59.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.264+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80a40ff140 con 0x7f8094064dd0 2022-02-02T20:34:59.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.265+0000 7f80a17fa700 1 -- 172.21.15.96:0/2925986804 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f80a40ff140 con 0x7f8094064dd0 2022-02-02T20:34:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 msgr2=0x7f8094067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 0x7f8094067290 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f80a40f5860 tx=0x7f8090009c00).stop 2022-02-02T20:34:59.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 msgr2=0x7f80a4109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f8098009990 tx=0x7f8098009b30).stop 2022-02-02T20:34:59.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 shutdown_connections 2022-02-02T20:34:59.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064dd0 0x7f8094067290 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a40f4a40 0x7f80a4109380 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 --2- 172.21.15.96:0/2925986804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a40f53e0 0x7f80a4109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 >> 172.21.15.96:0/2925986804 conn(0x7f80a40f04c0 msgr2=0x7f80a40f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.267+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 shutdown_connections 2022-02-02T20:34:59.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.268+0000 7f80ab1fb700 1 -- 172.21.15.96:0/2925986804 wait complete. 2022-02-02T20:34:59.278 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:34:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 -- 172.21.15.96:0/2322066900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f7980 msgr2=0x7efe8c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 --2- 172.21.15.96:0/2322066900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f7980 0x7efe8c0f7de0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7efe88004660 tx=0x7efe88009b30).stop 2022-02-02T20:34:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 -- 172.21.15.96:0/2322066900 shutdown_connections 2022-02-02T20:34:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 --2- 172.21.15.96:0/2322066900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f7980 0x7efe8c0f7de0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 --2- 172.21.15.96:0/2322066900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f66e0 0x7efe8c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 -- 172.21.15.96:0/2322066900 >> 172.21.15.96:0/2322066900 conn(0x7efe8c0f1e40 msgr2=0x7efe8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 -- 172.21.15.96:0/2322066900 shutdown_connections 2022-02-02T20:34:59.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.366+0000 7efe93bbf700 1 -- 172.21.15.96:0/2322066900 wait complete. 2022-02-02T20:34:59.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 Processor -- start 2022-02-02T20:34:59.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 -- start start 2022-02-02T20:34:59.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 0x7efe8c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c107a00 con 0x7efe8c0f66e0 2022-02-02T20:34:59.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe93bbf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c107b40 con 0x7efe8c0f7980 2022-02-02T20:34:59.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37902/0 (socket says 172.21.15.96:37902) 2022-02-02T20:34:59.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 -- 172.21.15.96:0/435158326 learned_addr learned my addr 172.21.15.96:0/435158326 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:59.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9115a700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 0x7efe8c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 -- 172.21.15.96:0/435158326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 msgr2=0x7efe8c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 0x7efe8c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9195b700 1 -- 172.21.15.96:0/435158326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88005040 con 0x7efe8c0f66e0 2022-02-02T20:34:59.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.367+0000 7efe9115a700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 0x7efe8c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:34:59.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe9195b700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7efe7c00c790 tx=0x7efe7c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe7c00e680 con 0x7efe8c0f66e0 2022-02-02T20:34:59.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe7c00ec90 con 0x7efe8c0f66e0 2022-02-02T20:34:59.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe7c012d00 con 0x7efe8c0f66e0 2022-02-02T20:34:59.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c1084e0 con 0x7efe8c0f66e0 2022-02-02T20:34:59.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.368+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c108aa0 con 0x7efe8c0f66e0 2022-02-02T20:34:59.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.369+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c045ad0 con 0x7efe8c0f66e0 2022-02-02T20:34:59.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.369+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe7c010070 con 0x7efe8c0f66e0 2022-02-02T20:34:59.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.370+0000 7efe827fc700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 0x7efe78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.370+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efe7c081b30 con 0x7efe8c0f66e0 2022-02-02T20:34:59.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.370+0000 7efe9115a700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 0x7efe78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.370+0000 7efe9115a700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 0x7efe78067290 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7efe88004e30 tx=0x7efe88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.374+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe7c053660 con 0x7efe8c0f66e0 2022-02-02T20:34:59.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.547+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe8c0fefe0 con 0x7efe78064dd0 2022-02-02T20:34:59.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.556+0000 7efe827fc700 1 -- 172.21.15.96:0/435158326 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efe8c0fefe0 con 0x7efe78064dd0 2022-02-02T20:34:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:34:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 108m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:34:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 108m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:34:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 107m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:34:59.560 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 108m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:34:59.560 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 108m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:34:59.560 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 108m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:34:59.560 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 107m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:34:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 107m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:34:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 108m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:34:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 107m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:34:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 108m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:34:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 107m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:34:59.562 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 108m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:34:59.562 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 107m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:34:59.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 108m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:34:59.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 108m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:34:59.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 108m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:34:59.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 107m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:34:59.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 107m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:34:59.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 107m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:34:59.564 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 108m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:34:59.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 msgr2=0x7efe78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 0x7efe78067290 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7efe88004e30 tx=0x7efe88009b30).stop 2022-02-02T20:34:59.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 msgr2=0x7efe8c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7efe7c00c790 tx=0x7efe7c007d90).stop 2022-02-02T20:34:59.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 shutdown_connections 2022-02-02T20:34:59.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe78064dd0 0x7efe78067290 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8c0f66e0 0x7efe8c106f60 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 --2- 172.21.15.96:0/435158326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe8c0f7980 0x7efe8c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 >> 172.21.15.96:0/435158326 conn(0x7efe8c0f1e40 msgr2=0x7efe8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 shutdown_connections 2022-02-02T20:34:59.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.558+0000 7efe93bbf700 1 -- 172.21.15.96:0/435158326 wait complete. 2022-02-02T20:34:59.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 -- 172.21.15.96:0/3275121322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 msgr2=0x7f7e5c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3275121322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c0f6b00 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7f7e4c004660 tx=0x7f7e4c009b30).stop 2022-02-02T20:34:59.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 -- 172.21.15.96:0/3275121322 shutdown_connections 2022-02-02T20:34:59.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3275121322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 0x7f7e5c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3275121322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c0f6b00 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 -- 172.21.15.96:0/3275121322 >> 172.21.15.96:0/3275121322 conn(0x7f7e5c0f1e40 msgr2=0x7f7e5c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 -- 172.21.15.96:0/3275121322 shutdown_connections 2022-02-02T20:34:59.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.655+0000 7f7e620a3700 1 -- 172.21.15.96:0/3275121322 wait complete. 2022-02-02T20:34:59.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 Processor -- start 2022-02-02T20:34:59.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 -- start start 2022-02-02T20:34:59.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 0x7f7e5c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c06a380 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e620a3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c06a4c0 con 0x7f7e5c0f7980 2022-02-02T20:34:59.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e5b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e5b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37912/0 (socket says 172.21.15.96:37912) 2022-02-02T20:34:59.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.656+0000 7f7e5b7fe700 1 -- 172.21.15.96:0/3110406534 learned_addr learned my addr 172.21.15.96:0/3110406534 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:34:59.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e5affd700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 0x7f7e5c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e5b7fe700 1 -- 172.21.15.96:0/3110406534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 msgr2=0x7f7e5c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e5b7fe700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 0x7f7e5c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e5b7fe700 1 -- 172.21.15.96:0/3110406534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c005040 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e5b7fe700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f7e4c014040 tx=0x7f7e4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c019070 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c06a740 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e4c007e70 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c06aca0 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.657+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c014d10 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.658+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c045ad0 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.659+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e4c025070 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.659+0000 7f7e43fff700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 0x7f7e44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:34:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.659+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7e4c082920 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.659+0000 7f7e5affd700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 0x7f7e44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:34:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.660+0000 7f7e5affd700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 0x7f7e44067290 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f7e50009fd0 tx=0x7f7e5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:34:59.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.663+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e4c050a20 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.896+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e5c0586e0 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.896+0000 7f7e43fff700 1 -- 172.21.15.96:0/3110406534 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7e4c023070 con 0x7f7e5c0f66e0 2022-02-02T20:34:59.898 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:34:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:34:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:34:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:34:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:34:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:34:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:34:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:59.901 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:34:59.901 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:34:59.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:34:59.901 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:34:59.902 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:34:59.902 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:34:59.902 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:34:59.902 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:34:59.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 msgr2=0x7f7e44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 0x7f7e44067290 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f7e50009fd0 tx=0x7f7e5000b040).stop 2022-02-02T20:34:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 msgr2=0x7f7e5c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f7e4c014040 tx=0x7f7e4c00b040).stop 2022-02-02T20:34:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 shutdown_connections 2022-02-02T20:34:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e44064dd0 0x7f7e44067290 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e5c0f66e0 0x7f7e5c06b9a0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 --2- 172.21.15.96:0/3110406534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e5c0f7980 0x7f7e5c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.898+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 >> 172.21.15.96:0/3110406534 conn(0x7f7e5c0f1e40 msgr2=0x7f7e5c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.899+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 shutdown_connections 2022-02-02T20:34:59.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.899+0000 7f7e620a3700 1 -- 172.21.15.96:0/3110406534 wait complete. 2022-02-02T20:34:59.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.995+0000 7f0b6b59e700 1 -- 172.21.15.96:0/1014444555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 msgr2=0x7f0b6c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:34:59.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.995+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/1014444555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c0f6b30 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f0b60004660 tx=0x7f0b60009b30).stop 2022-02-02T20:34:59.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- 172.21.15.96:0/1014444555 shutdown_connections 2022-02-02T20:34:59.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/1014444555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c0f6b30 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:34:59.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/1014444555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 0x7f0b6c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:34:59.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- 172.21.15.96:0/1014444555 >> 172.21.15.96:0/1014444555 conn(0x7f0b6c0f0b90 msgr2=0x7f0b6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:34:59.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- 172.21.15.96:0/1014444555 shutdown_connections 2022-02-02T20:34:59.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- 172.21.15.96:0/1014444555 wait complete. 2022-02-02T20:35:00.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 Processor -- start 2022-02-02T20:35:00.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- start start 2022-02-02T20:35:00.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 0x7f0b6c109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:00.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:00.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0604b0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.996+0000 7f0b6b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0605f0 con 0x7f0b6c0f5430 2022-02-02T20:35:00.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:00.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37924/0 (socket says 172.21.15.96:37924) 2022-02-02T20:35:00.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 -- 172.21.15.96:0/2735290484 learned_addr learned my addr 172.21.15.96:0/2735290484 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:35:00.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b6a59c700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 0x7f0b6c109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:00.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 -- 172.21.15.96:0/2735290484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 msgr2=0x7f0b6c109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:00.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 0x7f0b6c109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:00.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 -- 172.21.15.96:0/2735290484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60005040 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b69d9b700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f0b60009da0 tx=0x7f0b60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:00.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b60018070 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c10c550 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.997+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c10cab0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.998+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0b60004490 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.998+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6001c3c0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.998+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b50004fa0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:34:59.999+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0b6001d420 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.000+0000 7f0b5affd700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 0x7f0b540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:00.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.000+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0b60083df0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.000+0000 7f0b6a59c700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 0x7f0b540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:00.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.000+0000 7f0b6a59c700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 0x7f0b540672e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f0b6c0600a0 tx=0x7f0b5c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:00.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.003+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0b60051fb0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.204+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0b50005940 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.204+0000 7f0b5affd700 1 -- 172.21.15.96:0/2735290484 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0b600555d0 con 0x7f0b6c0f66d0 2022-02-02T20:35:00.206 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:35:00.206 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:35:00.207 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:35:00.207 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:35:00.207 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:00.207 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:35:00.208 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:35:00.208 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:35:00.208 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:35:00.209 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:35:00.209 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:35:00.209 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:35:00.209 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:35:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:35:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:35:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:35:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:35:00.211 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:35:00.211 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:35:00.211 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:35:00.211 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:35:00.211 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:35:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:35:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:35:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:35:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:35:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:35:00.213 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:35:00.213 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:35:00.213 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:35:00.213 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:35:00.214 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:35:00.214 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:00.214 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:00.214 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:35:00.214 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:00.215 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:00.215 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:00.215 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 msgr2=0x7f0b540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:00.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 0x7f0b540672e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f0b6c0600a0 tx=0x7f0b5c008040).stop 2022-02-02T20:35:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 msgr2=0x7f0b6c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f0b60009da0 tx=0x7f0b60009b30).stop 2022-02-02T20:35:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 shutdown_connections 2022-02-02T20:35:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b54064e20 0x7f0b540672e0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c0f5430 0x7f0b6c109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 --2- 172.21.15.96:0/2735290484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b6c0f66d0 0x7f0b6c10bf50 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 >> 172.21.15.96:0/2735290484 conn(0x7f0b6c0f0b90 msgr2=0x7f0b6c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 shutdown_connections 2022-02-02T20:35:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:00.206+0000 7f0b6b59e700 1 -- 172.21.15.96:0/2735290484 wait complete. 2022-02-02T20:35:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:35:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:00 smithi096 ceph-mon[101353]: pgmap v3987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:00 smithi096 ceph-mon[101353]: from='client.38196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:00 smithi096 ceph-mon[101353]: from='client.38200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3110406534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:35:00.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2735290484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:35:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:00 smithi159 ceph-mon[69013]: pgmap v3987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:00 smithi159 ceph-mon[69013]: from='client.38196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:00.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:00 smithi159 ceph-mon[69013]: from='client.38200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:00.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3110406534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:35:00.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2735290484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:35:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:02 smithi159 ceph-mon[69013]: pgmap v3988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:02 smithi096 ceph-mon[101353]: pgmap v3988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:04 smithi159 ceph-mon[69013]: pgmap v3989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:04 smithi096 ceph-mon[101353]: pgmap v3989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:06 smithi159 ceph-mon[69013]: pgmap v3990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:06 smithi096 ceph-mon[101353]: pgmap v3990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:07 smithi159 ceph-mon[69013]: pgmap v3991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:07 smithi096 ceph-mon[101353]: pgmap v3991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:10 smithi159 ceph-mon[69013]: pgmap v3992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:10 smithi096 ceph-mon[101353]: pgmap v3992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:12 smithi159 ceph-mon[69013]: pgmap v3993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:12 smithi096 ceph-mon[101353]: pgmap v3993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:14 smithi159 ceph-mon[69013]: pgmap v3994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:14 smithi096 ceph-mon[101353]: pgmap v3994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:16 smithi159 ceph-mon[69013]: pgmap v3995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:16 smithi096 ceph-mon[101353]: pgmap v3995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:18.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:17 smithi159 ceph-mon[69013]: pgmap v3996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:17 smithi096 ceph-mon[101353]: pgmap v3996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:20.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:20 smithi159 ceph-mon[69013]: pgmap v3997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:20 smithi096 ceph-mon[101353]: pgmap v3997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:22 smithi159 ceph-mon[69013]: pgmap v3998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:22 smithi096 ceph-mon[101353]: pgmap v3998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:24 smithi159 ceph-mon[69013]: pgmap v3999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:24 smithi096 ceph-mon[101353]: pgmap v3999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:26 smithi159 ceph-mon[69013]: pgmap v4000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:26 smithi096 ceph-mon[101353]: pgmap v4000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:27 smithi159 ceph-mon[69013]: pgmap v4001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:35:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:35:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:27 smithi096 ceph-mon[101353]: pgmap v4001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:35:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:35:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 -- 172.21.15.96:0/3958151593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f55c0 msgr2=0x7f5d240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3958151593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f55c0 0x7f5d240f59e0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f5d14004660 tx=0x7f5d14009b30).stop 2022-02-02T20:35:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 -- 172.21.15.96:0/3958151593 shutdown_connections 2022-02-02T20:35:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3958151593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f6860 0x7f5d240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3958151593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f55c0 0x7f5d240f59e0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 -- 172.21.15.96:0/3958151593 >> 172.21.15.96:0/3958151593 conn(0x7f5d240f0d40 msgr2=0x7f5d240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 -- 172.21.15.96:0/3958151593 shutdown_connections 2022-02-02T20:35:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.315+0000 7f5d29d84700 1 -- 172.21.15.96:0/3958151593 wait complete. 2022-02-02T20:35:30.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 Processor -- start 2022-02-02T20:35:30.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 -- start start 2022-02-02T20:35:30.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f55c0 0x7f5d24109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24109c00 con 0x7f5d240f6860 2022-02-02T20:35:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d29d84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24109d40 con 0x7f5d240f55c0 2022-02-02T20:35:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d22ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d22ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37942/0 (socket says 172.21.15.96:37942) 2022-02-02T20:35:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d22ffd700 1 -- 172.21.15.96:0/3719046848 learned_addr learned my addr 172.21.15.96:0/3719046848 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:35:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.316+0000 7f5d237fe700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f55c0 0x7f5d24109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d22ffd700 1 -- 172.21.15.96:0/3719046848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f55c0 msgr2=0x7f5d24109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d22ffd700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f55c0 0x7f5d24109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d22ffd700 1 -- 172.21.15.96:0/3719046848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14005040 con 0x7f5d240f6860 2022-02-02T20:35:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d22ffd700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f5d180026d0 tx=0x7f5d18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d180079c0 con 0x7f5d240f6860 2022-02-02T20:35:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2410a6e0 con 0x7f5d240f6860 2022-02-02T20:35:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d1800f040 con 0x7f5d240f6860 2022-02-02T20:35:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d180148b0 con 0x7f5d240f6860 2022-02-02T20:35:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.317+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2410aca0 con 0x7f5d240f6860 2022-02-02T20:35:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.318+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24045ad0 con 0x7f5d240f6860 2022-02-02T20:35:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.319+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5d18007b20 con 0x7f5d240f6860 2022-02-02T20:35:30.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.319+0000 7f5d0bfff700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 0x7f5d0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.319+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5d180819a0 con 0x7f5d240f6860 2022-02-02T20:35:30.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.319+0000 7f5d237fe700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 0x7f5d0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.319+0000 7f5d237fe700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 0x7f5d0c067290 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f5d14004630 tx=0x7f5d14009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.323+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5d180534d0 con 0x7f5d240f6860 2022-02-02T20:35:30.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.503+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d240faaa0 con 0x7f5d0c064dd0 2022-02-02T20:35:30.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.504+0000 7f5d0bfff700 1 -- 172.21.15.96:0/3719046848 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5d240faaa0 con 0x7f5d0c064dd0 2022-02-02T20:35:30.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 msgr2=0x7f5d0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 0x7f5d0c067290 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f5d14004630 tx=0x7f5d14009b30).stop 2022-02-02T20:35:30.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 msgr2=0x7f5d24109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f5d180026d0 tx=0x7f5d18009de0).stop 2022-02-02T20:35:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 shutdown_connections 2022-02-02T20:35:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d0c064dd0 0x7f5d0c067290 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d240f55c0 0x7f5d24109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 --2- 172.21.15.96:0/3719046848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d240f6860 0x7f5d24109650 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 >> 172.21.15.96:0/3719046848 conn(0x7f5d240f0d40 msgr2=0x7f5d2405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:30.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 shutdown_connections 2022-02-02T20:35:30.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.506+0000 7f5d29d84700 1 -- 172.21.15.96:0/3719046848 wait complete. 2022-02-02T20:35:30.518 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:35:30.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- 172.21.15.96:0/119937543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 msgr2=0x7f7ce00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 --2- 172.21.15.96:0/119937543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce00f6950 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f7cd8004660 tx=0x7f7cd8009b30).stop 2022-02-02T20:35:30.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- 172.21.15.96:0/119937543 shutdown_connections 2022-02-02T20:35:30.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 --2- 172.21.15.96:0/119937543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 0x7f7ce00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 --2- 172.21.15.96:0/119937543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce00f6950 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- 172.21.15.96:0/119937543 >> 172.21.15.96:0/119937543 conn(0x7f7ce00f1c90 msgr2=0x7f7ce00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:30.608 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:30 smithi096 ceph-mon[101353]: pgmap v4002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:30.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- 172.21.15.96:0/119937543 shutdown_connections 2022-02-02T20:35:30.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- 172.21.15.96:0/119937543 wait complete. 2022-02-02T20:35:30.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 Processor -- start 2022-02-02T20:35:30.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.604+0000 7f7ce759e700 1 -- start start 2022-02-02T20:35:30.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 0x7f7ce01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce01078f0 con 0x7f7ce00f6530 2022-02-02T20:35:30.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0108100 con 0x7f7ce00f77d0 2022-02-02T20:35:30.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37950/0 (socket says 172.21.15.96:37950) 2022-02-02T20:35:30.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 -- 172.21.15.96:0/2289626309 learned_addr learned my addr 172.21.15.96:0/2289626309 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:35:30.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce5d9b700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 0x7f7ce01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 -- 172.21.15.96:0/2289626309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 msgr2=0x7f7ce01072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 0x7f7ce01072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 -- 172.21.15.96:0/2289626309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8005040 con 0x7f7ce00f6530 2022-02-02T20:35:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7ce659c700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f7cd8013a70 tx=0x7f7cd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.605+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd8018070 con 0x7f7ce00f6530 2022-02-02T20:35:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.606+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cd80097d0 con 0x7f7ce00f6530 2022-02-02T20:35:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.606+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0108320 con 0x7f7ce00f6530 2022-02-02T20:35:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.606+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd801de80 con 0x7f7ce00f6530 2022-02-02T20:35:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.606+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce0108880 con 0x7f7ce00f6530 2022-02-02T20:35:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.607+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce0059100 con 0x7f7ce00f6530 2022-02-02T20:35:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.607+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cd8007ba0 con 0x7f7ce00f6530 2022-02-02T20:35:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.607+0000 7f7cd2ffd700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 0x7f7ccc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.607+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7cd8083660 con 0x7f7ce00f6530 2022-02-02T20:35:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.607+0000 7f7ce5d9b700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 0x7f7ccc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.608+0000 7f7ce5d9b700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 0x7f7ccc0672e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f7cd4004c40 tx=0x7f7cd400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.612+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cd8051820 con 0x7f7ce00f6530 2022-02-02T20:35:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:30 smithi159 ceph-mon[69013]: pgmap v4002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.786+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ce00008d0 con 0x7f7ccc064e20 2022-02-02T20:35:30.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.795+0000 7f7cd2ffd700 1 -- 172.21.15.96:0/2289626309 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ce00008d0 con 0x7f7ccc064e20 2022-02-02T20:35:30.798 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:35:30.798 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 109m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:35:30.799 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 109m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:35:30.799 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 107m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:35:30.799 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 109m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:35:30.799 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 109m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:35:30.800 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 109m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:35:30.800 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 107m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:35:30.800 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 107m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:35:30.800 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 109m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:35:30.800 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 107m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:35:30.801 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 109m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:35:30.801 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 107m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:35:30.801 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 109m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:35:30.801 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 107m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:35:30.801 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 109m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:35:30.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 109m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:35:30.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 109m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:35:30.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 107m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:35:30.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 107m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:35:30.803 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 107m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:35:30.803 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 109m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:35:30.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 msgr2=0x7f7ccc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 0x7f7ccc0672e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f7cd4004c40 tx=0x7f7cd400b040).stop 2022-02-02T20:35:30.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 msgr2=0x7f7ce0106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f7cd8013a70 tx=0x7f7cd8009b30).stop 2022-02-02T20:35:30.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 shutdown_connections 2022-02-02T20:35:30.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ccc064e20 0x7f7ccc0672e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ce00f6530 0x7f7ce0106e00 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 --2- 172.21.15.96:0/2289626309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ce00f77d0 0x7f7ce01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.797+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 >> 172.21.15.96:0/2289626309 conn(0x7f7ce00f1c90 msgr2=0x7f7ce00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:30.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.798+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 shutdown_connections 2022-02-02T20:35:30.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.798+0000 7f7ce759e700 1 -- 172.21.15.96:0/2289626309 wait complete. 2022-02-02T20:35:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/2796093673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 msgr2=0x7f0a180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/2796093673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a180f59e0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f0a08004660 tx=0x7f0a08009b30).stop 2022-02-02T20:35:30.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/2796093673 shutdown_connections 2022-02-02T20:35:30.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/2796093673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 0x7f0a180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:35:30.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/2796093673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a180f59e0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.894+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/2796093673 >> 172.21.15.96:0/2796093673 conn(0x7f0a180f0d40 msgr2=0x7f0a180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/2796093673 shutdown_connections 2022-02-02T20:35:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/2796093673 wait complete. 2022-02-02T20:35:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 Processor -- start 2022-02-02T20:35:30.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 -- start start 2022-02-02T20:35:30.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 0x7f0a1810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18060470 con 0x7f0a180f55c0 2022-02-02T20:35:30.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.895+0000 7f0a1ff3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180605b0 con 0x7f0a180f6860 2022-02-02T20:35:30.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37960/0 (socket says 172.21.15.96:37960) 2022-02-02T20:35:30.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 -- 172.21.15.96:0/731387945 learned_addr learned my addr 172.21.15.96:0/731387945 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:35:30.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1d4d9700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 0x7f0a1810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 -- 172.21.15.96:0/731387945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 msgr2=0x7f0a1810c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:30.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 0x7f0a1810c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 -- 172.21.15.96:0/731387945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08005040 con 0x7f0a180f55c0 2022-02-02T20:35:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1dcda700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f0a08004f60 tx=0x7f0a08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a08018070 con 0x7f0a180f55c0 2022-02-02T20:35:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1810c7c0 con 0x7f0a180f55c0 2022-02-02T20:35:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1810ccf0 con 0x7f0a180f55c0 2022-02-02T20:35:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a08007ba0 con 0x7f0a180f55c0 2022-02-02T20:35:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.896+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0801c620 con 0x7f0a180f55c0 2022-02-02T20:35:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.897+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00004fa0 con 0x7f0a180f55c0 2022-02-02T20:35:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.898+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a0801d420 con 0x7f0a180f55c0 2022-02-02T20:35:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.898+0000 7f0a0e7fc700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.898+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a080837b0 con 0x7f0a180f55c0 2022-02-02T20:35:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.898+0000 7f0a1d4d9700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.899+0000 7f0a1d4d9700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f0a1400b790 tx=0x7f0a14008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:30.902+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a080518b0 con 0x7f0a180f55c0 2022-02-02T20:35:31.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.135+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a00005e80 con 0x7f0a180f55c0 2022-02-02T20:35:31.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.135+0000 7f0a0e7fc700 1 -- 172.21.15.96:0/731387945 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0a08054ed0 con 0x7f0a180f55c0 2022-02-02T20:35:31.138 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:35:31.139 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:35:31.139 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:35:31.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:35:31.139 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:35:31.139 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:35:31.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:35:31.140 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:35:31.140 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:35:31.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:35:31.141 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:35:31.141 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:35:31.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:35:31.141 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:35:31.142 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:35:31.142 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:35:31.142 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:35:31.143 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:35:31.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 msgr2=0x7f0a04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f0a1400b790 tx=0x7f0a14008040).stop 2022-02-02T20:35:31.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 msgr2=0x7f0a18109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f0a08004f60 tx=0x7f0a08009b30).stop 2022-02-02T20:35:31.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 shutdown_connections 2022-02-02T20:35:31.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a180f55c0 0x7f0a18109cc0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 --2- 172.21.15.96:0/731387945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a180f6860 0x7f0a1810c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 >> 172.21.15.96:0/731387945 conn(0x7f0a180f0d40 msgr2=0x7f0a180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:31.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 shutdown_connections 2022-02-02T20:35:31.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.137+0000 7f0a1ff3e700 1 -- 172.21.15.96:0/731387945 wait complete. 2022-02-02T20:35:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.234+0000 7fa2e84f0700 1 -- 172.21.15.96:0/1466527912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 msgr2=0x7fa2e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.234+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/1466527912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e00f59e0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fa2dc004660 tx=0x7fa2dc009b30).stop 2022-02-02T20:35:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.235+0000 7fa2e84f0700 1 -- 172.21.15.96:0/1466527912 shutdown_connections 2022-02-02T20:35:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.235+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/1466527912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 0x7fa2e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.235+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/1466527912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e00f59e0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.235+0000 7fa2e84f0700 1 -- 172.21.15.96:0/1466527912 >> 172.21.15.96:0/1466527912 conn(0x7fa2e00f0d40 msgr2=0x7fa2e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 -- 172.21.15.96:0/1466527912 shutdown_connections 2022-02-02T20:35:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 -- 172.21.15.96:0/1466527912 wait complete. 2022-02-02T20:35:31.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 Processor -- start 2022-02-02T20:35:31.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 -- start start 2022-02-02T20:35:31.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:31.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 0x7fa2e010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:31.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00603e0 con 0x7fa2e00f55c0 2022-02-02T20:35:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.236+0000 7fa2e84f0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0060520 con 0x7fa2e00f6860 2022-02-02T20:35:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37970/0 (socket says 172.21.15.96:37970) 2022-02-02T20:35:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 -- 172.21.15.96:0/2502961097 learned_addr learned my addr 172.21.15.96:0/2502961097 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:35:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e5a8b700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 0x7fa2e010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 -- 172.21.15.96:0/2502961097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 msgr2=0x7fa2e010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 0x7fa2e010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 -- 172.21.15.96:0/2502961097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc005040 con 0x7fa2e00f55c0 2022-02-02T20:35:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e628c700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fa2dc013a70 tx=0x7fa2dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2dc018070 con 0x7fa2e00f55c0 2022-02-02T20:35:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2dc0097d0 con 0x7fa2e00f55c0 2022-02-02T20:35:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e010c6c0 con 0x7fa2e00f55c0 2022-02-02T20:35:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2dc01de80 con 0x7fa2e00f55c0 2022-02-02T20:35:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.237+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e010cc20 con 0x7fa2e00f55c0 2022-02-02T20:35:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.238+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0045ad0 con 0x7fa2e00f55c0 2022-02-02T20:35:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.239+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2dc007ba0 con 0x7fa2e00f55c0 2022-02-02T20:35:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.239+0000 7fa2d6ffd700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 0x7fa2cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:35:31.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.239+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa2dc083660 con 0x7fa2e00f55c0 2022-02-02T20:35:31.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.239+0000 7fa2e5a8b700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 0x7fa2cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:35:31.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.240+0000 7fa2e5a8b700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 0x7fa2cc067290 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fa2d0004c40 tx=0x7fa2d000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:35:31.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.244+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2dc051760 con 0x7fa2e00f55c0 2022-02-02T20:35:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.445+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2e00fdf00 con 0x7fa2e00f55c0 2022-02-02T20:35:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.446+0000 7fa2d6ffd700 1 -- 172.21.15.96:0/2502961097 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa2dc054d80 con 0x7fa2e00f55c0 2022-02-02T20:35:31.449 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:35:31.450 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:35:31.450 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:35:31.450 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:35:31.450 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:31.451 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:35:31.451 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:35:31.451 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:35:31.451 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:35:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:35:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:35:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:35:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:35:31.453 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:35:31.453 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:35:31.453 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:35:31.453 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:35:31.453 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:35:31.454 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:35:31.454 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:35:31.454 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:35:31.454 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:35:31.455 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:35:31.455 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:35:31.455 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:35:31.455 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:35:31.455 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:35:31.456 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:35:31.456 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:35:31.456 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:35:31.456 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:35:31.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:35:31.457 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:31.457 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:31.457 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:35:31.458 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:35:31.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:31.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:31.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:35:31.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 msgr2=0x7fa2cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 0x7fa2cc067290 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fa2d0004c40 tx=0x7fa2d000b040).stop 2022-02-02T20:35:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 msgr2=0x7fa2e0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:35:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fa2dc013a70 tx=0x7fa2dc009b30).stop 2022-02-02T20:35:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 shutdown_connections 2022-02-02T20:35:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2cc064dd0 0x7fa2cc067290 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2e00f55c0 0x7fa2e0109c70 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 --2- 172.21.15.96:0/2502961097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e00f6860 0x7fa2e010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:35:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 >> 172.21.15.96:0/2502961097 conn(0x7fa2e00f0d40 msgr2=0x7fa2e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:35:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 shutdown_connections 2022-02-02T20:35:31.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:35:31.449+0000 7fa2e84f0700 1 -- 172.21.15.96:0/2502961097 wait complete. 2022-02-02T20:35:31.462 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:35:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:31 smithi096 ceph-mon[101353]: from='client.38212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/731387945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:35:31.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:31 smithi159 ceph-mon[69013]: from='client.38212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:31.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/731387945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:35:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:32 smithi159 ceph-mon[69013]: from='client.38216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:32 smithi159 ceph-mon[69013]: pgmap v4003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:32.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2502961097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:35:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:32 smithi096 ceph-mon[101353]: from='client.38216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:35:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:32 smithi096 ceph-mon[101353]: pgmap v4003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2502961097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:35:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:34 smithi159 ceph-mon[69013]: pgmap v4004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:34 smithi096 ceph-mon[101353]: pgmap v4004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:36 smithi159 ceph-mon[69013]: pgmap v4005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:36 smithi096 ceph-mon[101353]: pgmap v4005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:37 smithi159 ceph-mon[69013]: pgmap v4006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:37 smithi096 ceph-mon[101353]: pgmap v4006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:40 smithi159 ceph-mon[69013]: pgmap v4007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:40 smithi096 ceph-mon[101353]: pgmap v4007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:42 smithi159 ceph-mon[69013]: pgmap v4008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:42 smithi096 ceph-mon[101353]: pgmap v4008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:44 smithi159 ceph-mon[69013]: pgmap v4009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:44 smithi096 ceph-mon[101353]: pgmap v4009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:46 smithi159 ceph-mon[69013]: pgmap v4010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:46 smithi096 ceph-mon[101353]: pgmap v4010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:47 smithi159 ceph-mon[69013]: pgmap v4011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:47 smithi096 ceph-mon[101353]: pgmap v4011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:50 smithi159 ceph-mon[69013]: pgmap v4012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:50 smithi096 ceph-mon[101353]: pgmap v4012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:52 smithi159 ceph-mon[69013]: pgmap v4013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:52 smithi096 ceph-mon[101353]: pgmap v4013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:54 smithi159 ceph-mon[69013]: pgmap v4014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:54 smithi096 ceph-mon[101353]: pgmap v4014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:56 smithi159 ceph-mon[69013]: pgmap v4015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:56 smithi096 ceph-mon[101353]: pgmap v4015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:35:57 smithi159 ceph-mon[69013]: pgmap v4016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:35:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:35:57 smithi096 ceph-mon[101353]: pgmap v4016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:00 smithi159 ceph-mon[69013]: pgmap v4017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:00 smithi096 ceph-mon[101353]: pgmap v4017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 -- 172.21.15.96:0/3645104274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 msgr2=0x7f0c9c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 --2- 172.21.15.96:0/3645104274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c0f59e0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7f0c90004660 tx=0x7f0c90009b30).stop 2022-02-02T20:36:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 -- 172.21.15.96:0/3645104274 shutdown_connections 2022-02-02T20:36:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 --2- 172.21.15.96:0/3645104274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 0x7f0c9c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 --2- 172.21.15.96:0/3645104274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c0f59e0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 -- 172.21.15.96:0/3645104274 >> 172.21.15.96:0/3645104274 conn(0x7f0c9c0f0d40 msgr2=0x7f0c9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:01.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 -- 172.21.15.96:0/3645104274 shutdown_connections 2022-02-02T20:36:01.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.559+0000 7f0ca2669700 1 -- 172.21.15.96:0/3645104274 wait complete. 2022-02-02T20:36:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 Processor -- start 2022-02-02T20:36:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 -- start start 2022-02-02T20:36:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 0x7f0c9c10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c060420 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0ca2669700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c060560 con 0x7f0c9c0f6860 2022-02-02T20:36:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0c9bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.560+0000 7f0c9bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37994/0 (socket says 172.21.15.96:37994) 2022-02-02T20:36:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9bfff700 1 -- 172.21.15.96:0/120651742 learned_addr learned my addr 172.21.15.96:0/120651742 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9b7fe700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 0x7f0c9c10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9bfff700 1 -- 172.21.15.96:0/120651742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 msgr2=0x7f0c9c10c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9bfff700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 0x7f0c9c10c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9bfff700 1 -- 172.21.15.96:0/120651742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90005040 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c9bfff700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f0c90013a70 tx=0x7f0c90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:01.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c90018070 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0c900097d0 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c10c6e0 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9001de80 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.561+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c10cc10 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.562+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0f49b0 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.563+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0c90007ba0 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.563+0000 7f0c98ff9700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 0x7f0c84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.563+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0c90083620 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.563+0000 7f0c9b7fe700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 0x7f0c84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.564+0000 7f0c9b7fe700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 0x7f0c84067290 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f0c8c004c40 tx=0x7f0c8c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:01.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.567+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0c900517e0 con 0x7f0c9c0f55c0 2022-02-02T20:36:01.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.746+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c9c0fdf00 con 0x7f0c84064dd0 2022-02-02T20:36:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.747+0000 7f0c98ff9700 1 -- 172.21.15.96:0/120651742 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0c9c0fdf00 con 0x7f0c84064dd0 2022-02-02T20:36:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 msgr2=0x7f0c84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 0x7f0c84067290 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f0c8c004c40 tx=0x7f0c8c00b040).stop 2022-02-02T20:36:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 msgr2=0x7f0c9c109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f0c90013a70 tx=0x7f0c90009b30).stop 2022-02-02T20:36:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 shutdown_connections 2022-02-02T20:36:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c84064dd0 0x7f0c84067290 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c9c0f55c0 0x7f0c9c109c30 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 --2- 172.21.15.96:0/120651742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c9c0f6860 0x7f0c9c10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 >> 172.21.15.96:0/120651742 conn(0x7f0c9c0f0d40 msgr2=0x7f0c9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 shutdown_connections 2022-02-02T20:36:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.749+0000 7f0ca2669700 1 -- 172.21.15.96:0/120651742 wait complete. 2022-02-02T20:36:01.760 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:36:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 -- 172.21.15.96:0/2859302787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f5440 msgr2=0x7f9e740f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/2859302787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f5440 0x7f9e740f5860 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f9e70004660 tx=0x7f9e70009b30).stop 2022-02-02T20:36:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 -- 172.21.15.96:0/2859302787 shutdown_connections 2022-02-02T20:36:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/2859302787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f66e0 0x7f9e740f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/2859302787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f5440 0x7f9e740f5860 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 -- 172.21.15.96:0/2859302787 >> 172.21.15.96:0/2859302787 conn(0x7f9e740f0ba0 msgr2=0x7f9e740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 -- 172.21.15.96:0/2859302787 shutdown_connections 2022-02-02T20:36:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.847+0000 7f9e7aad4700 1 -- 172.21.15.96:0/2859302787 wait complete. 2022-02-02T20:36:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 Processor -- start 2022-02-02T20:36:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 -- start start 2022-02-02T20:36:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f5440 0x7f9e74106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74107920 con 0x7f9e740f66e0 2022-02-02T20:36:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e7aad4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74108130 con 0x7f9e740f5440 2022-02-02T20:36:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38006/0 (socket says 172.21.15.96:38006) 2022-02-02T20:36:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 -- 172.21.15.96:0/767672798 learned_addr learned my addr 172.21.15.96:0/767672798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e79ad2700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f5440 0x7f9e74106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 -- 172.21.15.96:0/767672798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f5440 msgr2=0x7f9e74106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f5440 0x7f9e74106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.848+0000 7f9e792d1700 1 -- 172.21.15.96:0/767672798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70005040 con 0x7f9e740f66e0 2022-02-02T20:36:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e792d1700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f9e64004f60 tx=0x7f9e64009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e64009500 con 0x7f9e740f66e0 2022-02-02T20:36:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e74108350 con 0x7f9e740f66e0 2022-02-02T20:36:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e64016070 con 0x7f9e740f66e0 2022-02-02T20:36:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e64012ce0 con 0x7f9e740f66e0 2022-02-02T20:36:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.849+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e741088e0 con 0x7f9e740f66e0 2022-02-02T20:36:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.850+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e74045ad0 con 0x7f9e740f66e0 2022-02-02T20:36:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.851+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e64022070 con 0x7f9e740f66e0 2022-02-02T20:36:01.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.851+0000 7f9e6a7fc700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 0x7f9e600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:01.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.851+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e64085e50 con 0x7f9e740f66e0 2022-02-02T20:36:01.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.851+0000 7f9e79ad2700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 0x7f9e600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:01.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.851+0000 7f9e79ad2700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 0x7f9e600672e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f9e74106ba0 tx=0x7f9e70009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:01.855+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e64053f50 con 0x7f9e740f66e0 2022-02-02T20:36:02.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.030+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e7405fd30 con 0x7f9e60064e20 2022-02-02T20:36:02.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.039+0000 7f9e6a7fc700 1 -- 172.21.15.96:0/767672798 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9e7405fd30 con 0x7f9e60064e20 2022-02-02T20:36:02.041 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:36:02.041 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 110m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:36:02.042 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 110m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:36:02.042 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 108m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:36:02.042 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 110m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:36:02.042 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 110m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:36:02.043 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 110m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:36:02.043 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 108m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:36:02.043 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 108m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:36:02.043 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 110m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:36:02.043 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 108m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:36:02.044 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 110m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:36:02.044 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 108m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:36:02.044 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 110m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:36:02.044 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 108m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:36:02.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 110m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:36:02.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 110m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:36:02.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 110m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:36:02.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 108m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:36:02.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 108m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:36:02.046 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 108m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:36:02.046 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 110m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:36:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 msgr2=0x7f9e600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 0x7f9e600672e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f9e74106ba0 tx=0x7f9e70009b30).stop 2022-02-02T20:36:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 msgr2=0x7f9e74107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f9e64004f60 tx=0x7f9e64009de0).stop 2022-02-02T20:36:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 shutdown_connections 2022-02-02T20:36:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e60064e20 0x7f9e600672e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e740f5440 0x7f9e74106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 --2- 172.21.15.96:0/767672798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e740f66e0 0x7f9e74107320 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 >> 172.21.15.96:0/767672798 conn(0x7f9e740f0ba0 msgr2=0x7f9e7405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 shutdown_connections 2022-02-02T20:36:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.041+0000 7f9e7aad4700 1 -- 172.21.15.96:0/767672798 wait complete. 2022-02-02T20:36:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 -- 172.21.15.96:0/267791851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f6860 msgr2=0x7f29700f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 --2- 172.21.15.96:0/267791851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f6860 0x7f29700f6cc0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7f296c004660 tx=0x7f296c009b30).stop 2022-02-02T20:36:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 -- 172.21.15.96:0/267791851 shutdown_connections 2022-02-02T20:36:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 --2- 172.21.15.96:0/267791851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f6860 0x7f29700f6cc0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 --2- 172.21.15.96:0/267791851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f55c0 0x7f29700f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 -- 172.21.15.96:0/267791851 >> 172.21.15.96:0/267791851 conn(0x7f29700f0d40 msgr2=0x7f29700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:02.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 -- 172.21.15.96:0/267791851 shutdown_connections 2022-02-02T20:36:02.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.138+0000 7f297755c700 1 -- 172.21.15.96:0/267791851 wait complete. 2022-02-02T20:36:02.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 Processor -- start 2022-02-02T20:36:02.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 -- start start 2022-02-02T20:36:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f6860 0x7f29700691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700697b0 con 0x7f29700f55c0 2022-02-02T20:36:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f297755c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700698f0 con 0x7f29700f6860 2022-02-02T20:36:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38012/0 (socket says 172.21.15.96:38012) 2022-02-02T20:36:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 -- 172.21.15.96:0/2363206990 learned_addr learned my addr 172.21.15.96:0/2363206990 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f2974af7700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f6860 0x7f29700691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 -- 172.21.15.96:0/2363206990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f6860 msgr2=0x7f29700691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f6860 0x7f29700691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.139+0000 7f29752f8700 1 -- 172.21.15.96:0/2363206990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c005040 con 0x7f29700f55c0 2022-02-02T20:36:02.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f29752f8700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f2960002700 tx=0x7f2960009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:02.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2960009320 con 0x7f29700f55c0 2022-02-02T20:36:02.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f296000f040 con 0x7f29700f55c0 2022-02-02T20:36:02.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297010fbc0 con 0x7f29700f55c0 2022-02-02T20:36:02.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2960014900 con 0x7f29700f55c0 2022-02-02T20:36:02.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.140+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970110180 con 0x7f29700f55c0 2022-02-02T20:36:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.141+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970045ad0 con 0x7f29700f55c0 2022-02-02T20:36:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.141+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f29600077b0 con 0x7f29700f55c0 2022-02-02T20:36:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.142+0000 7f2965ffb700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 0x7f295c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.142+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2960081c90 con 0x7f29700f55c0 2022-02-02T20:36:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.142+0000 7f2974af7700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 0x7f295c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.142+0000 7f2974af7700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 0x7f295c067290 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f296c004630 tx=0x7f296c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.146+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f296004fd90 con 0x7f29700f55c0 2022-02-02T20:36:02.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.385+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f29700fdf00 con 0x7f29700f55c0 2022-02-02T20:36:02.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.385+0000 7f2965ffb700 1 -- 172.21.15.96:0/2363206990 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f29600533b0 con 0x7f29700f55c0 2022-02-02T20:36:02.387 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:36:02.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:36:02.388 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:36:02.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:02.388 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:36:02.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:36:02.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:02.389 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:36:02.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:36:02.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:02.390 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:36:02.390 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:36:02.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:02.390 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:36:02.391 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:36:02.391 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:36:02.391 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:36:02.391 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:36:02.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.387+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 msgr2=0x7f295c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.387+0000 7f297755c700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 0x7f295c067290 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f296c004630 tx=0x7f296c009b30).stop 2022-02-02T20:36:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.387+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 msgr2=0x7f2970068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.387+0000 7f297755c700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f2960002700 tx=0x7f2960009d80).stop 2022-02-02T20:36:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 shutdown_connections 2022-02-02T20:36:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f295c064dd0 0x7f295c067290 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29700f55c0 0x7f2970068ce0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 --2- 172.21.15.96:0/2363206990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29700f6860 0x7f29700691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 >> 172.21.15.96:0/2363206990 conn(0x7f29700f0d40 msgr2=0x7f29700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 shutdown_connections 2022-02-02T20:36:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.388+0000 7f297755c700 1 -- 172.21.15.96:0/2363206990 wait complete. 2022-02-02T20:36:02.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 -- 172.21.15.96:0/1509840642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 msgr2=0x7fc0f80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 --2- 172.21.15.96:0/1509840642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f6b30 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7fc0e4004660 tx=0x7fc0e4009b30).stop 2022-02-02T20:36:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 -- 172.21.15.96:0/1509840642 shutdown_connections 2022-02-02T20:36:02.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 --2- 172.21.15.96:0/1509840642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f6b30 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 --2- 172.21.15.96:0/1509840642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 0x7fc0f80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 -- 172.21.15.96:0/1509840642 >> 172.21.15.96:0/1509840642 conn(0x7fc0f80f0b90 msgr2=0x7fc0f80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:02.488 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:02 smithi096 ceph-mon[101353]: pgmap v4018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 -- 172.21.15.96:0/1509840642 shutdown_connections 2022-02-02T20:36:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.485+0000 7fc0fddad700 1 -- 172.21.15.96:0/1509840642 wait complete. 2022-02-02T20:36:02.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 Processor -- start 2022-02-02T20:36:02.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 -- start start 2022-02-02T20:36:02.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 0x7fc0f80f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80f7f70 con 0x7fc0f80f66d0 2022-02-02T20:36:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fddad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80f80b0 con 0x7fc0f80f5430 2022-02-02T20:36:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38024/0 (socket says 172.21.15.96:38024) 2022-02-02T20:36:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0f7fff700 1 -- 172.21.15.96:0/3099427980 learned_addr learned my addr 172.21.15.96:0/3099427980 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.486+0000 7fc0fcdab700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 0x7fc0f80f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f7fff700 1 -- 172.21.15.96:0/3099427980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 msgr2=0x7fc0f80f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f7fff700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 0x7fc0f80f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f7fff700 1 -- 172.21.15.96:0/3099427980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4005040 con 0x7fc0f80f66d0 2022-02-02T20:36:02.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f7fff700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7fc0e4009990 tx=0x7fc0e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:02.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e4018070 con 0x7fc0f80f66d0 2022-02-02T20:36:02.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80f8330 con 0x7fc0f80f66d0 2022-02-02T20:36:02.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f80f8890 con 0x7fc0f80f66d0 2022-02-02T20:36:02.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0e4007ba0 con 0x7fc0f80f66d0 2022-02-02T20:36:02.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.487+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e401c620 con 0x7fc0f80f66d0 2022-02-02T20:36:02.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.488+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d8004fa0 con 0x7fc0f80f66d0 2022-02-02T20:36:02.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.489+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc0e401c890 con 0x7fc0f80f66d0 2022-02-02T20:36:02.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.489+0000 7fc0f57fa700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 0x7fc0e80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:02.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.489+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc0e4083730 con 0x7fc0f80f66d0 2022-02-02T20:36:02.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.489+0000 7fc0fcdab700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 0x7fc0e80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:02.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.489+0000 7fc0fcdab700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 0x7fc0e80672e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fc0f80f9320 tx=0x7fc0ec009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:02.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.493+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc0e4051880 con 0x7fc0f80f66d0 2022-02-02T20:36:02.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.692+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0d8005e80 con 0x7fc0f80f66d0 2022-02-02T20:36:02.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.692+0000 7fc0f57fa700 1 -- 172.21.15.96:0/3099427980 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc0e4054ea0 con 0x7fc0f80f66d0 2022-02-02T20:36:02.695 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:36:02.695 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:36:02.695 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:36:02.695 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:36:02.696 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:02.696 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:36:02.696 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:36:02.696 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:36:02.697 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:36:02.697 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:36:02.697 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:36:02.697 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:36:02.697 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:36:02.698 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:36:02.698 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:36:02.698 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:36:02.698 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:36:02.698 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:36:02.699 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:36:02.699 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:36:02.699 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:36:02.699 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:36:02.700 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:36:02.700 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:36:02.700 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:36:02.700 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:36:02.700 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:36:02.701 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:36:02.701 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:36:02.701 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:36:02.701 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:36:02.701 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:36:02.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:02.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:02.702 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:36:02.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:02.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:02.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:02.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:02.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 msgr2=0x7fc0e80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 0x7fc0e80672e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fc0f80f9320 tx=0x7fc0ec009040).stop 2022-02-02T20:36:02.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 msgr2=0x7fc0f80f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:02.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7fc0e4009990 tx=0x7fc0e4009b30).stop 2022-02-02T20:36:02.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 shutdown_connections 2022-02-02T20:36:02.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0e8064e20 0x7fc0e80672e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0f80f5430 0x7fc0f80f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 --2- 172.21.15.96:0/3099427980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f80f66d0 0x7fc0f80f7a10 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:02.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 >> 172.21.15.96:0/3099427980 conn(0x7fc0f80f0b90 msgr2=0x7fc0f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:02.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 shutdown_connections 2022-02-02T20:36:02.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:02.694+0000 7fc0fddad700 1 -- 172.21.15.96:0/3099427980 wait complete. 2022-02-02T20:36:02.707 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:36:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:02 smithi159 ceph-mon[69013]: pgmap v4018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:03 smithi096 ceph-mon[101353]: from='client.38228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:03 smithi096 ceph-mon[101353]: from='client.38232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2363206990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:36:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3099427980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:36:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:03 smithi159 ceph-mon[69013]: from='client.38228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:03 smithi159 ceph-mon[69013]: from='client.38232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2363206990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:36:03.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3099427980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:36:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:04 smithi159 ceph-mon[69013]: pgmap v4019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:04 smithi096 ceph-mon[101353]: pgmap v4019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:06 smithi159 ceph-mon[69013]: pgmap v4020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:06 smithi096 ceph-mon[101353]: pgmap v4020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:07 smithi159 ceph-mon[69013]: pgmap v4021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:07 smithi096 ceph-mon[101353]: pgmap v4021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:10 smithi159 ceph-mon[69013]: pgmap v4022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:10 smithi096 ceph-mon[101353]: pgmap v4022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:12 smithi159 ceph-mon[69013]: pgmap v4023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:12.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:12 smithi096 ceph-mon[101353]: pgmap v4023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:14 smithi159 ceph-mon[69013]: pgmap v4024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:14 smithi096 ceph-mon[101353]: pgmap v4024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:16 smithi159 ceph-mon[69013]: pgmap v4025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:16 smithi096 ceph-mon[101353]: pgmap v4025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:17 smithi159 ceph-mon[69013]: pgmap v4026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:17 smithi096 ceph-mon[101353]: pgmap v4026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:20 smithi159 ceph-mon[69013]: pgmap v4027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:20 smithi096 ceph-mon[101353]: pgmap v4027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:22 smithi159 ceph-mon[69013]: pgmap v4028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:22 smithi096 ceph-mon[101353]: pgmap v4028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:24 smithi159 ceph-mon[69013]: pgmap v4029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:24 smithi096 ceph-mon[101353]: pgmap v4029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:26 smithi159 ceph-mon[69013]: pgmap v4030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:26 smithi096 ceph-mon[101353]: pgmap v4030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:27 smithi159 ceph-mon[69013]: pgmap v4031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:36:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:36:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:27 smithi096 ceph-mon[101353]: pgmap v4031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:36:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:36:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:30 smithi159 ceph-mon[69013]: pgmap v4032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:30 smithi096 ceph-mon[101353]: pgmap v4032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:32 smithi159 ceph-mon[69013]: pgmap v4033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:32 smithi096 ceph-mon[101353]: pgmap v4033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:32.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 -- 172.21.15.96:0/1341931392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 msgr2=0x7f8d800f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:32.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/1341931392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d800f6c70 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7f8d6c004660 tx=0x7f8d6c009b30).stop 2022-02-02T20:36:32.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 -- 172.21.15.96:0/1341931392 shutdown_connections 2022-02-02T20:36:32.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/1341931392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d800f6c70 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/1341931392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 0x7f8d800f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 -- 172.21.15.96:0/1341931392 >> 172.21.15.96:0/1341931392 conn(0x7f8d800f0cd0 msgr2=0x7f8d800f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:32.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 -- 172.21.15.96:0/1341931392 shutdown_connections 2022-02-02T20:36:32.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.804+0000 7f8d86ecc700 1 -- 172.21.15.96:0/1341931392 wait complete. 2022-02-02T20:36:32.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.805+0000 7f8d86ecc700 1 Processor -- start 2022-02-02T20:36:32.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.805+0000 7f8d86ecc700 1 -- start start 2022-02-02T20:36:32.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d86ecc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 0x7f8d80109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:32.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d86ecc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:32.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d86ecc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800603c0 con 0x7f8d800f6810 2022-02-02T20:36:32.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d86ecc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80060500 con 0x7f8d800f5570 2022-02-02T20:36:32.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:32.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38044/0 (socket says 172.21.15.96:38044) 2022-02-02T20:36:32.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 -- 172.21.15.96:0/605928624 learned_addr learned my addr 172.21.15.96:0/605928624 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:32.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d84c68700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 0x7f8d80109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:32.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 -- 172.21.15.96:0/605928624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 msgr2=0x7f8d80109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:32.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 0x7f8d80109c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 -- 172.21.15.96:0/605928624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c005040 con 0x7f8d800f6810 2022-02-02T20:36:32.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.806+0000 7f8d7ffff700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f8d6c009990 tx=0x7f8d6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:32.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.807+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c018070 con 0x7f8d800f6810 2022-02-02T20:36:32.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.807+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d6c007ba0 con 0x7f8d800f6810 2022-02-02T20:36:32.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.807+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8010c650 con 0x7f8d800f6810 2022-02-02T20:36:32.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.807+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c01c3c0 con 0x7f8d800f6810 2022-02-02T20:36:32.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.807+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8010cb80 con 0x7f8d800f6810 2022-02-02T20:36:32.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.808+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d800f4960 con 0x7f8d800f6810 2022-02-02T20:36:32.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.808+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d6c01d420 con 0x7f8d800f6810 2022-02-02T20:36:32.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.808+0000 7f8d7d7fa700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:32.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.809+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d6c0836a0 con 0x7f8d800f6810 2022-02-02T20:36:32.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.809+0000 7f8d84c68700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:32.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.809+0000 7f8d84c68700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 0x7f8d700672e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f8d80060040 tx=0x7f8d7400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:32.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.813+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d6c0516e0 con 0x7f8d800f6810 2022-02-02T20:36:32.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.992+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d800fdec0 con 0x7f8d70064e20 2022-02-02T20:36:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.993+0000 7f8d7d7fa700 1 -- 172.21.15.96:0/605928624 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8d800fdec0 con 0x7f8d70064e20 2022-02-02T20:36:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 msgr2=0x7f8d700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 0x7f8d700672e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f8d80060040 tx=0x7f8d7400b040).stop 2022-02-02T20:36:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 msgr2=0x7f8d8010c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f8d6c009990 tx=0x7f8d6c009b30).stop 2022-02-02T20:36:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 shutdown_connections 2022-02-02T20:36:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d800f5570 0x7f8d80109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 --2- 172.21.15.96:0/605928624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d800f6810 0x7f8d8010c100 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 >> 172.21.15.96:0/605928624 conn(0x7f8d800f0cd0 msgr2=0x7f8d800fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:32.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 shutdown_connections 2022-02-02T20:36:32.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:32.995+0000 7f8d86ecc700 1 -- 172.21.15.96:0/605928624 wait complete. 2022-02-02T20:36:33.006 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:36:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 -- 172.21.15.96:0/2152816898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 msgr2=0x7efc5c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 --2- 172.21.15.96:0/2152816898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c0f6cc0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7efc50004660 tx=0x7efc50009b30).stop 2022-02-02T20:36:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 -- 172.21.15.96:0/2152816898 shutdown_connections 2022-02-02T20:36:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 --2- 172.21.15.96:0/2152816898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c0f6cc0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 --2- 172.21.15.96:0/2152816898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 0x7efc5c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 -- 172.21.15.96:0/2152816898 >> 172.21.15.96:0/2152816898 conn(0x7efc5c0f0d20 msgr2=0x7efc5c0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.092+0000 7efc61248700 1 -- 172.21.15.96:0/2152816898 shutdown_connections 2022-02-02T20:36:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.093+0000 7efc61248700 1 -- 172.21.15.96:0/2152816898 wait complete. 2022-02-02T20:36:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 Processor -- start 2022-02-02T20:36:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 -- start start 2022-02-02T20:36:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 0x7efc5c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1079e0 con 0x7efc5c0f6860 2022-02-02T20:36:33.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc61248700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c107b20 con 0x7efc5c0f55c0 2022-02-02T20:36:33.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc5ad9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 0x7efc5c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38054/0 (socket says 172.21.15.96:38054) 2022-02-02T20:36:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.094+0000 7efc5a59c700 1 -- 172.21.15.96:0/658354178 learned_addr learned my addr 172.21.15.96:0/658354178 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc5a59c700 1 -- 172.21.15.96:0/658354178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 msgr2=0x7efc5c106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc5a59c700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 0x7efc5c106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc5a59c700 1 -- 172.21.15.96:0/658354178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50005040 con 0x7efc5c0f6860 2022-02-02T20:36:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc5a59c700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7efc50009990 tx=0x7efc50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc50018070 con 0x7efc5c0f6860 2022-02-02T20:36:33.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c108460 con 0x7efc5c0f6860 2022-02-02T20:36:33.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc50007ba0 con 0x7efc5c0f6860 2022-02-02T20:36:33.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc5001c620 con 0x7efc5c0f6860 2022-02-02T20:36:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.095+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c1089c0 con 0x7efc5c0f6860 2022-02-02T20:36:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.096+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c045ad0 con 0x7efc5c0f6860 2022-02-02T20:36:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.096+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efc5001c890 con 0x7efc5c0f6860 2022-02-02T20:36:33.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.097+0000 7efc437fe700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 0x7efc44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.097+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efc500837b0 con 0x7efc5c0f6860 2022-02-02T20:36:33.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.097+0000 7efc5ad9d700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 0x7efc44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.097+0000 7efc5ad9d700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 0x7efc44067290 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7efc5c0f66c0 tx=0x7efc4c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.101+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efc50055390 con 0x7efc5c0f6860 2022-02-02T20:36:33.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.276+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc5c108c30 con 0x7efc44064dd0 2022-02-02T20:36:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.286+0000 7efc437fe700 1 -- 172.21.15.96:0/658354178 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efc5c108c30 con 0x7efc44064dd0 2022-02-02T20:36:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:36:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 110m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:36:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 110m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:36:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 108m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:36:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 110m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:36:33.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 110m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:36:33.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 110m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:36:33.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 108m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:36:33.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 108m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:36:33.290 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 110m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:36:33.290 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 108m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:36:33.290 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 110m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:36:33.290 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 108m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:36:33.291 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 110m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:36:33.291 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 108m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:36:33.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 110m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:36:33.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 110m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:36:33.292 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 110m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:36:33.292 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 108m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:36:33.292 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 108m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:36:33.292 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 108m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:36:33.292 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 110m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:36:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 msgr2=0x7efc44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 0x7efc44067290 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7efc5c0f66c0 tx=0x7efc4c009040).stop 2022-02-02T20:36:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 msgr2=0x7efc5c107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7efc50009990 tx=0x7efc50009b30).stop 2022-02-02T20:36:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 shutdown_connections 2022-02-02T20:36:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc44064dd0 0x7efc44067290 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc5c0f55c0 0x7efc5c106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 --2- 172.21.15.96:0/658354178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc5c0f6860 0x7efc5c107430 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 >> 172.21.15.96:0/658354178 conn(0x7efc5c0f0d20 msgr2=0x7efc5c0f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 shutdown_connections 2022-02-02T20:36:33.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.288+0000 7efc61248700 1 -- 172.21.15.96:0/658354178 wait complete. 2022-02-02T20:36:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 -- 172.21.15.96:0/3743833162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 msgr2=0x7fde440f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 --2- 172.21.15.96:0/3743833162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f9340 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7fde34004660 tx=0x7fde34009b30).stop 2022-02-02T20:36:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 -- 172.21.15.96:0/3743833162 shutdown_connections 2022-02-02T20:36:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 --2- 172.21.15.96:0/3743833162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 0x7fde440fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:36:33.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 --2- 172.21.15.96:0/3743833162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f9340 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.384+0000 7fde49a45700 1 -- 172.21.15.96:0/3743833162 >> 172.21.15.96:0/3743833162 conn(0x7fde440f0d20 msgr2=0x7fde440f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 -- 172.21.15.96:0/3743833162 shutdown_connections 2022-02-02T20:36:33.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 -- 172.21.15.96:0/3743833162 wait complete. 2022-02-02T20:36:33.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 Processor -- start 2022-02-02T20:36:33.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 -- start start 2022-02-02T20:36:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 0x7fde440f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.385+0000 7fde49a45700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440f5830 con 0x7fde440603d0 2022-02-02T20:36:33.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde49a45700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440f5970 con 0x7fde440f9830 2022-02-02T20:36:33.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38062/0 (socket says 172.21.15.96:38062) 2022-02-02T20:36:33.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 -- 172.21.15.96:0/180019467 learned_addr learned my addr 172.21.15.96:0/180019467 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:33.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde427fc700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 0x7fde440f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 -- 172.21.15.96:0/180019467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 msgr2=0x7fde440f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 0x7fde440f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 -- 172.21.15.96:0/180019467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34005040 con 0x7fde440603d0 2022-02-02T20:36:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde42ffd700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fde34009990 tx=0x7fde34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde34018070 con 0x7fde440603d0 2022-02-02T20:36:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde34007ca0 con 0x7fde440603d0 2022-02-02T20:36:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde49a45700 1 -- 172.21.15.96:0/180019467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde440f5bf0 con 0x7fde440603d0 2022-02-02T20:36:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3401c600 con 0x7fde440603d0 2022-02-02T20:36:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.386+0000 7fde49a45700 1 -- 172.21.15.96:0/180019467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4410ef90 con 0x7fde440603d0 2022-02-02T20:36:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.388+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c004fa0 con 0x7fde440603d0 2022-02-02T20:36:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.388+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde3401d9d0 con 0x7fde440603d0 2022-02-02T20:36:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.389+0000 7fde2b7fe700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 0x7fde2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.389+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde340838d0 con 0x7fde440603d0 2022-02-02T20:36:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.389+0000 7fde427fc700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 0x7fde2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.389+0000 7fde427fc700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 0x7fde2c067290 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fde440601a0 tx=0x7fde38008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.393+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde340519d0 con 0x7fde440603d0 2022-02-02T20:36:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.624+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde1c005e80 con 0x7fde440603d0 2022-02-02T20:36:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.625+0000 7fde2b7fe700 1 -- 172.21.15.96:0/180019467 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fde34054ff0 con 0x7fde440603d0 2022-02-02T20:36:33.627 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:36:33.628 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:36:33.628 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:36:33.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:33.628 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:36:33.629 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:36:33.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:33.629 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:36:33.629 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:36:33.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:33.630 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:36:33.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:36:33.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:36:33.630 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:36:33.631 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:36:33.631 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:36:33.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:36:33.631 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:36:33.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 msgr2=0x7fde2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 0x7fde2c067290 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fde440601a0 tx=0x7fde38008040).stop 2022-02-02T20:36:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 msgr2=0x7fde440f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fde34009990 tx=0x7fde34009b30).stop 2022-02-02T20:36:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 shutdown_connections 2022-02-02T20:36:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde2c064dd0 0x7fde2c067290 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde440603d0 0x7fde440f6dc0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 --2- 172.21.15.96:0/180019467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde440f9830 0x7fde440f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 >> 172.21.15.96:0/180019467 conn(0x7fde440f0d20 msgr2=0x7fde440f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 shutdown_connections 2022-02-02T20:36:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.627+0000 7fde297fa700 1 -- 172.21.15.96:0/180019467 wait complete. 2022-02-02T20:36:33.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 -- 172.21.15.96:0/3432689402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 msgr2=0x7f21040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 --2- 172.21.15.96:0/3432689402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21040f7de0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7f20f4004660 tx=0x7f20f4009b30).stop 2022-02-02T20:36:33.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 -- 172.21.15.96:0/3432689402 shutdown_connections 2022-02-02T20:36:33.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 --2- 172.21.15.96:0/3432689402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21040f7de0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 --2- 172.21.15.96:0/3432689402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 0x7f21040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:36:33.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 -- 172.21.15.96:0/3432689402 >> 172.21.15.96:0/3432689402 conn(0x7f21040f1e40 msgr2=0x7f21040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 -- 172.21.15.96:0/3432689402 shutdown_connections 2022-02-02T20:36:33.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.724+0000 7f21097ed700 1 -- 172.21.15.96:0/3432689402 wait complete. 2022-02-02T20:36:33.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 Processor -- start 2022-02-02T20:36:33.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 -- start start 2022-02-02T20:36:33.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 0x7f2104106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104107ae0 con 0x7f21040f7980 2022-02-02T20:36:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21097ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104108390 con 0x7f21040f66e0 2022-02-02T20:36:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38074/0 (socket says 172.21.15.96:38074) 2022-02-02T20:36:33.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.725+0000 7f21027fc700 1 -- 172.21.15.96:0/2801282220 learned_addr learned my addr 172.21.15.96:0/2801282220 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:36:33.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f2102ffd700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 0x7f2104106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21027fc700 1 -- 172.21.15.96:0/2801282220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 msgr2=0x7f2104106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21027fc700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 0x7f2104106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21027fc700 1 -- 172.21.15.96:0/2801282220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4005040 con 0x7f21040f7980 2022-02-02T20:36:33.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21027fc700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7f20f4009990 tx=0x7f20f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f4018070 con 0x7f21040f7980 2022-02-02T20:36:33.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20f4007ca0 con 0x7f21040f7980 2022-02-02T20:36:33.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2104108610 con 0x7f21040f7980 2022-02-02T20:36:33.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f401c620 con 0x7f21040f7980 2022-02-02T20:36:33.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.726+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104108b70 con 0x7f21040f7980 2022-02-02T20:36:33.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.727+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21040f5ad0 con 0x7f21040f7980 2022-02-02T20:36:33.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.728+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f20f401d960 con 0x7f21040f7980 2022-02-02T20:36:33.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.728+0000 7f20fb7fe700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 0x7f20f006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:36:33.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.728+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20f4083700 con 0x7f21040f7980 2022-02-02T20:36:33.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.728+0000 7f2102ffd700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 0x7f20f006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:36:33.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.728+0000 7f2102ffd700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 0x7f20f006b6a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f21040f77e0 tx=0x7f20ec008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:36:33.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.732+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20f4055230 con 0x7f21040f7980 2022-02-02T20:36:33.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.932+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21040fef40 con 0x7f21040f7980 2022-02-02T20:36:33.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.933+0000 7f20fb7fe700 1 -- 172.21.15.96:0/2801282220 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f20f4054e20 con 0x7f21040f7980 2022-02-02T20:36:33.935 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:36:33.935 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:36:33.936 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:36:33.936 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:36:33.936 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:33.937 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:36:33.937 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:36:33.937 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:36:33.937 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:36:33.938 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:36:33.938 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:36:33.938 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:36:33.939 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:36:33.939 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:36:33.939 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:36:33.939 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:36:33.940 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:36:33.940 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:36:33.940 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:36:33.940 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:36:33.940 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:36:33.941 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:36:33.941 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:36:33.941 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:36:33.941 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:36:33.941 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:36:33.942 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:36:33.942 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:36:33.942 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:36:33.942 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:36:33.943 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:36:33.943 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:36:33.943 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:33.943 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:33.943 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:36:33.944 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:36:33.944 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:33.944 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:33.944 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:36:33.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 msgr2=0x7f20f006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 0x7f20f006b6a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f21040f77e0 tx=0x7f20ec008040).stop 2022-02-02T20:36:33.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 msgr2=0x7f21041074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:36:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7f20f4009990 tx=0x7f20f4009b30).stop 2022-02-02T20:36:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 shutdown_connections 2022-02-02T20:36:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20f00691e0 0x7f20f006b6a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21040f66e0 0x7f2104106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 --2- 172.21.15.96:0/2801282220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21040f7980 0x7f21041074a0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:36:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 >> 172.21.15.96:0/2801282220 conn(0x7f21040f1e40 msgr2=0x7f21040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:36:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 shutdown_connections 2022-02-02T20:36:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:36:33.935+0000 7f21097ed700 1 -- 172.21.15.96:0/2801282220 wait complete. 2022-02-02T20:36:33.949 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:36:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:34 smithi159 ceph-mon[69013]: from='client.38244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:34 smithi159 ceph-mon[69013]: from='client.38248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:34 smithi159 ceph-mon[69013]: pgmap v4034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/180019467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:36:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2801282220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:36:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:34 smithi096 ceph-mon[101353]: from='client.38244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:34 smithi096 ceph-mon[101353]: from='client.38248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:36:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:34 smithi096 ceph-mon[101353]: pgmap v4034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/180019467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:36:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2801282220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:36:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:36 smithi159 ceph-mon[69013]: pgmap v4035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:36 smithi096 ceph-mon[101353]: pgmap v4035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:37 smithi159 ceph-mon[69013]: pgmap v4036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:37 smithi096 ceph-mon[101353]: pgmap v4036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:40 smithi159 ceph-mon[69013]: pgmap v4037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:40 smithi096 ceph-mon[101353]: pgmap v4037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:42 smithi159 ceph-mon[69013]: pgmap v4038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:42 smithi096 ceph-mon[101353]: pgmap v4038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:44 smithi159 ceph-mon[69013]: pgmap v4039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:44 smithi096 ceph-mon[101353]: pgmap v4039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:46 smithi159 ceph-mon[69013]: pgmap v4040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:46 smithi096 ceph-mon[101353]: pgmap v4040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:47 smithi159 ceph-mon[69013]: pgmap v4041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:47 smithi096 ceph-mon[101353]: pgmap v4041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:50 smithi159 ceph-mon[69013]: pgmap v4042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:50 smithi096 ceph-mon[101353]: pgmap v4042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:52 smithi159 ceph-mon[69013]: pgmap v4043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:52 smithi096 ceph-mon[101353]: pgmap v4043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:54 smithi159 ceph-mon[69013]: pgmap v4044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:54 smithi096 ceph-mon[101353]: pgmap v4044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:56 smithi159 ceph-mon[69013]: pgmap v4045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:56 smithi096 ceph-mon[101353]: pgmap v4045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:36:57 smithi159 ceph-mon[69013]: pgmap v4046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:36:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:36:57 smithi096 ceph-mon[101353]: pgmap v4046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:00 smithi159 ceph-mon[69013]: pgmap v4047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:00 smithi096 ceph-mon[101353]: pgmap v4047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:02 smithi159 ceph-mon[69013]: pgmap v4048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:02 smithi096 ceph-mon[101353]: pgmap v4048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:04.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 -- 172.21.15.96:0/2239286422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 msgr2=0x7fd98c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 --2- 172.21.15.96:0/2239286422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c0f7de0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7fd978004660 tx=0x7fd978009b30).stop 2022-02-02T20:37:04.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 -- 172.21.15.96:0/2239286422 shutdown_connections 2022-02-02T20:37:04.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 --2- 172.21.15.96:0/2239286422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c0f7de0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 --2- 172.21.15.96:0/2239286422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 0x7fd98c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.043+0000 7fd992d5e700 1 -- 172.21.15.96:0/2239286422 >> 172.21.15.96:0/2239286422 conn(0x7fd98c0f1e40 msgr2=0x7fd98c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.044+0000 7fd992d5e700 1 -- 172.21.15.96:0/2239286422 shutdown_connections 2022-02-02T20:37:04.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.044+0000 7fd992d5e700 1 -- 172.21.15.96:0/2239286422 wait complete. 2022-02-02T20:37:04.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.044+0000 7fd992d5e700 1 Processor -- start 2022-02-02T20:37:04.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.044+0000 7fd992d5e700 1 -- start start 2022-02-02T20:37:04.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.044+0000 7fd992d5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 0x7fd98c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd992d5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd992d5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06a380 con 0x7fd98c0f7980 2022-02-02T20:37:04.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd992d5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06a4c0 con 0x7fd98c0f66e0 2022-02-02T20:37:04.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38100/0 (socket says 172.21.15.96:38100) 2022-02-02T20:37:04.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 -- 172.21.15.96:0/1822443119 learned_addr learned my addr 172.21.15.96:0/1822443119 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:04.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd990afa700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 0x7fd98c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 -- 172.21.15.96:0/1822443119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 msgr2=0x7fd98c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 0x7fd98c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 -- 172.21.15.96:0/1822443119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd978005040 con 0x7fd98c0f7980 2022-02-02T20:37:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd98bfff700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7fd978009990 tx=0x7fd978009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd978018070 con 0x7fd98c0f7980 2022-02-02T20:37:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd978007ba0 con 0x7fd98c0f7980 2022-02-02T20:37:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97801c3c0 con 0x7fd98c0f7980 2022-02-02T20:37:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.045+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c06a740 con 0x7fd98c0f7980 2022-02-02T20:37:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.046+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c06aca0 con 0x7fd98c0f7980 2022-02-02T20:37:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.046+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c045ad0 con 0x7fd98c0f7980 2022-02-02T20:37:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.047+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd97801d420 con 0x7fd98c0f7980 2022-02-02T20:37:04.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.047+0000 7fd9897fa700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 0x7fd97c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.047+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9780836a0 con 0x7fd98c0f7980 2022-02-02T20:37:04.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.047+0000 7fd990afa700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 0x7fd97c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.048+0000 7fd990afa700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 0x7fd97c067290 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fd98c06b730 tx=0x7fd98000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.052+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd978051860 con 0x7fd98c0f7980 2022-02-02T20:37:04.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.229+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c057f10 con 0x7fd97c064dd0 2022-02-02T20:37:04.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.230+0000 7fd9897fa700 1 -- 172.21.15.96:0/1822443119 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd98c057f10 con 0x7fd97c064dd0 2022-02-02T20:37:04.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 msgr2=0x7fd97c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 0x7fd97c067290 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fd98c06b730 tx=0x7fd98000b040).stop 2022-02-02T20:37:04.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 msgr2=0x7fd98c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7fd978009990 tx=0x7fd978009b30).stop 2022-02-02T20:37:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 shutdown_connections 2022-02-02T20:37:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd97c064dd0 0x7fd97c067290 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f66e0 0x7fd98c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 --2- 172.21.15.96:0/1822443119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f7980 0x7fd98c069e20 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 >> 172.21.15.96:0/1822443119 conn(0x7fd98c0f1e40 msgr2=0x7fd98c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 shutdown_connections 2022-02-02T20:37:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.232+0000 7fd992d5e700 1 -- 172.21.15.96:0/1822443119 wait complete. 2022-02-02T20:37:04.244 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:37:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 -- 172.21.15.96:0/3800552880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 msgr2=0x7f015c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 --2- 172.21.15.96:0/3800552880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c0f7de0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f0148004660 tx=0x7f0148009b30).stop 2022-02-02T20:37:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 -- 172.21.15.96:0/3800552880 shutdown_connections 2022-02-02T20:37:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 --2- 172.21.15.96:0/3800552880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c0f7de0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 --2- 172.21.15.96:0/3800552880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 0x7f015c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 -- 172.21.15.96:0/3800552880 >> 172.21.15.96:0/3800552880 conn(0x7f015c0f1e40 msgr2=0x7f015c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 -- 172.21.15.96:0/3800552880 shutdown_connections 2022-02-02T20:37:04.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.330+0000 7f0163145700 1 -- 172.21.15.96:0/3800552880 wait complete. 2022-02-02T20:37:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 Processor -- start 2022-02-02T20:37:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 -- start start 2022-02-02T20:37:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 0x7f015c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c107a20 con 0x7f015c0f7980 2022-02-02T20:37:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f0163145700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c107b60 con 0x7f015c0f66e0 2022-02-02T20:37:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f015bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f015bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38110/0 (socket says 172.21.15.96:38110) 2022-02-02T20:37:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.331+0000 7f015bfff700 1 -- 172.21.15.96:0/787737539 learned_addr learned my addr 172.21.15.96:0/787737539 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f0160ee1700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 0x7f015c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f015bfff700 1 -- 172.21.15.96:0/787737539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 msgr2=0x7f015c106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f015bfff700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 0x7f015c106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f015bfff700 1 -- 172.21.15.96:0/787737539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148005040 con 0x7f015c0f7980 2022-02-02T20:37:04.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f015bfff700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f0148009990 tx=0x7f0148009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0148018070 con 0x7f015c0f7980 2022-02-02T20:37:04.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c1084a0 con 0x7f015c0f7980 2022-02-02T20:37:04.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0148007ba0 con 0x7f015c0f7980 2022-02-02T20:37:04.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f014801c3c0 con 0x7f015c0f7980 2022-02-02T20:37:04.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.332+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c108a00 con 0x7f015c0f7980 2022-02-02T20:37:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.333+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c045ad0 con 0x7f015c0f7980 2022-02-02T20:37:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.334+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f014801d420 con 0x7f015c0f7980 2022-02-02T20:37:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.334+0000 7f01597fa700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 0x7f014c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.334+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0148083760 con 0x7f015c0f7980 2022-02-02T20:37:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.334+0000 7f0160ee1700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 0x7f014c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.334+0000 7f0160ee1700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 0x7f014c067290 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f015c0f77e0 tx=0x7f0150009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.338+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0148055230 con 0x7f015c0f7980 2022-02-02T20:37:04.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.512+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f015c0fefd0 con 0x7f014c064dd0 2022-02-02T20:37:04.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.522+0000 7f01597fa700 1 -- 172.21.15.96:0/787737539 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f015c0fefd0 con 0x7f014c064dd0 2022-02-02T20:37:04.524 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:37:04.524 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 111m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:37:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 111m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:37:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 109m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:37:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 111m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:37:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 111m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:37:04.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 111m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:37:04.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 109m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:37:04.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 109m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:37:04.526 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 111m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:37:04.527 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 109m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:37:04.527 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 111m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:37:04.527 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 109m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:37:04.527 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 111m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:37:04.528 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 109m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:37:04.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 111m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:37:04.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 111m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:37:04.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 111m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:37:04.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 109m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:37:04.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 109m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:37:04.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 109m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:37:04.529 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 111m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:37:04.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 msgr2=0x7f014c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 0x7f014c067290 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f015c0f77e0 tx=0x7f0150009be0).stop 2022-02-02T20:37:04.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 msgr2=0x7f015c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f0148009990 tx=0x7f0148009b30).stop 2022-02-02T20:37:04.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 shutdown_connections 2022-02-02T20:37:04.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f014c064dd0 0x7f014c067290 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f015c0f66e0 0x7f015c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 --2- 172.21.15.96:0/787737539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f015c0f7980 0x7f015c107470 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.523+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 >> 172.21.15.96:0/787737539 conn(0x7f015c0f1e40 msgr2=0x7f015c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.524+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 shutdown_connections 2022-02-02T20:37:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.524+0000 7f0163145700 1 -- 172.21.15.96:0/787737539 wait complete. 2022-02-02T20:37:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 -- 172.21.15.96:0/1010416891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f7980 msgr2=0x7f80100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 --2- 172.21.15.96:0/1010416891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f7980 0x7f80100f7de0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f8004004660 tx=0x7f8004009b30).stop 2022-02-02T20:37:04.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 -- 172.21.15.96:0/1010416891 shutdown_connections 2022-02-02T20:37:04.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 --2- 172.21.15.96:0/1010416891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f7980 0x7f80100f7de0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 --2- 172.21.15.96:0/1010416891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f66e0 0x7f80100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:37:04.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 -- 172.21.15.96:0/1010416891 >> 172.21.15.96:0/1010416891 conn(0x7f80100f1e40 msgr2=0x7f80100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:04 smithi096 ceph-mon[101353]: pgmap v4049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:04.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 -- 172.21.15.96:0/1010416891 shutdown_connections 2022-02-02T20:37:04.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.620+0000 7f801688f700 1 -- 172.21.15.96:0/1010416891 wait complete. 2022-02-02T20:37:04.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.621+0000 7f801688f700 1 Processor -- start 2022-02-02T20:37:04.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.621+0000 7f801688f700 1 -- start start 2022-02-02T20:37:04.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 0x7f80101074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010107ae0 con 0x7f80100f66e0 2022-02-02T20:37:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010108390 con 0x7f80100f7980 2022-02-02T20:37:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38118/0 (socket says 172.21.15.96:38118) 2022-02-02T20:37:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 -- 172.21.15.96:0/1227204376 learned_addr learned my addr 172.21.15.96:0/1227204376 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800f7fe700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 0x7f80101074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 -- 172.21.15.96:0/1227204376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 msgr2=0x7f80101074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 0x7f80101074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 -- 172.21.15.96:0/1227204376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004005040 con 0x7f80100f66e0 2022-02-02T20:37:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800f7fe700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 0x7f80101074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:37:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800ffff700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f80000093f0 tx=0x7f8000006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8000009ea0 con 0x7f80100f66e0 2022-02-02T20:37:04.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8010108670 con 0x7f80100f66e0 2022-02-02T20:37:04.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8000013af0 con 0x7f80100f66e0 2022-02-02T20:37:04.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800000db10 con 0x7f80100f66e0 2022-02-02T20:37:04.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.622+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8010108c30 con 0x7f80100f66e0 2022-02-02T20:37:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.623+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100f5ad0 con 0x7f80100f66e0 2022-02-02T20:37:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.624+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f800001a060 con 0x7f80100f66e0 2022-02-02T20:37:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.624+0000 7f800cff9700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 0x7f7ff806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.624+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8000081aa0 con 0x7f80100f66e0 2022-02-02T20:37:04.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.625+0000 7f800f7fe700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 0x7f7ff806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.625+0000 7f800f7fe700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 0x7f7ff806b6a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f8004009da0 tx=0x7f8004009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.629+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80000535d0 con 0x7f80100f66e0 2022-02-02T20:37:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:04 smithi159 ceph-mon[69013]: pgmap v4049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:04.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.860+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80100fef40 con 0x7f80100f66e0 2022-02-02T20:37:04.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.860+0000 7f800cff9700 1 -- 172.21.15.96:0/1227204376 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8000018070 con 0x7f80100f66e0 2022-02-02T20:37:04.863 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:37:04.863 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:37:04.864 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:37:04.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:04.864 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:37:04.864 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:37:04.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:04.865 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:37:04.865 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:37:04.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:04.866 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:37:04.866 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:37:04.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:04.866 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:37:04.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:37:04.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:37:04.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:37:04.867 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:37:04.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 msgr2=0x7f7ff806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 0x7f7ff806b6a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f8004009da0 tx=0x7f8004009b30).stop 2022-02-02T20:37:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 msgr2=0x7f8010106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f80000093f0 tx=0x7f8000006ec0).stop 2022-02-02T20:37:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 shutdown_connections 2022-02-02T20:37:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ff80691e0 0x7f7ff806b6a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80100f66e0 0x7f8010106fb0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 --2- 172.21.15.96:0/1227204376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80100f7980 0x7f80101074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 >> 172.21.15.96:0/1227204376 conn(0x7f80100f1e40 msgr2=0x7f80100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 shutdown_connections 2022-02-02T20:37:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.862+0000 7f801688f700 1 -- 172.21.15.96:0/1227204376 wait complete. 2022-02-02T20:37:04.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.959+0000 7f098c4ba700 1 -- 172.21.15.96:0/1537353794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 msgr2=0x7f09840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.959+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1537353794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f09840f59e0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f0980004660 tx=0x7f0980009b30).stop 2022-02-02T20:37:04.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 -- 172.21.15.96:0/1537353794 shutdown_connections 2022-02-02T20:37:04.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1537353794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f09840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1537353794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f09840f59e0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 -- 172.21.15.96:0/1537353794 >> 172.21.15.96:0/1537353794 conn(0x7f09840f0d40 msgr2=0x7f09840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:04.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 -- 172.21.15.96:0/1537353794 shutdown_connections 2022-02-02T20:37:04.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 -- 172.21.15.96:0/1537353794 wait complete. 2022-02-02T20:37:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 Processor -- start 2022-02-02T20:37:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.960+0000 7f098c4ba700 1 -- start start 2022-02-02T20:37:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098c4ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098c4ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f0984106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098c4ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984106910 con 0x7f09840f55c0 2022-02-02T20:37:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098c4ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984106a50 con 0x7f09840f6860 2022-02-02T20:37:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38126/0 (socket says 172.21.15.96:38126) 2022-02-02T20:37:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 -- 172.21.15.96:0/1189468613 learned_addr learned my addr 172.21.15.96:0/1189468613 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f0989a55700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f0984106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 -- 172.21.15.96:0/1189468613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 msgr2=0x7f0984106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f0984106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 -- 172.21.15.96:0/1189468613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980005040 con 0x7f09840f55c0 2022-02-02T20:37:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098a256700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f0980013a70 tx=0x7f0980009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0980018070 con 0x7f09840f55c0 2022-02-02T20:37:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09800097d0 con 0x7f09840f55c0 2022-02-02T20:37:04.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0984107390 con 0x7f09840f55c0 2022-02-02T20:37:04.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.961+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098001c3c0 con 0x7f09840f55c0 2022-02-02T20:37:04.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.962+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09841078f0 con 0x7f09840f55c0 2022-02-02T20:37:04.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.963+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0984045ad0 con 0x7f09840f55c0 2022-02-02T20:37:04.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.963+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0980007ba0 con 0x7f09840f55c0 2022-02-02T20:37:04.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.963+0000 7f097affd700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 0x7f0970067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:04.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.963+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0980083620 con 0x7f09840f55c0 2022-02-02T20:37:04.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.964+0000 7f0989a55700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 0x7f0970067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.964+0000 7f0989a55700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 0x7f0970067290 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f0974004a70 tx=0x7f097400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:04.968+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0980055150 con 0x7f09840f55c0 2022-02-02T20:37:05.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.167+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f09840fde20 con 0x7f09840f55c0 2022-02-02T20:37:05.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.167+0000 7f097affd700 1 -- 172.21.15.96:0/1189468613 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0980054d40 con 0x7f09840f55c0 2022-02-02T20:37:05.170 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:37:05.170 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:37:05.171 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:37:05.171 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:37:05.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:05.171 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:37:05.172 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:37:05.172 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:37:05.172 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:37:05.172 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:37:05.173 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:37:05.173 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:37:05.173 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:37:05.173 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:37:05.173 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:37:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:37:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:37:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:37:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:37:05.175 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:37:05.175 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:37:05.175 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:37:05.175 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:37:05.176 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:37:05.176 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:37:05.176 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:37:05.176 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:37:05.176 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:37:05.177 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:37:05.177 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:37:05.177 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:37:05.177 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:37:05.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:05.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:05.178 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:37:05.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:05.179 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:05.179 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:05.179 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:05.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 msgr2=0x7f0970067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:05.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 0x7f0970067290 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f0974004a70 tx=0x7f097400b040).stop 2022-02-02T20:37:05.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 msgr2=0x7f0984105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:05.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f0980013a70 tx=0x7f0980009b30).stop 2022-02-02T20:37:05.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 shutdown_connections 2022-02-02T20:37:05.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0970064dd0 0x7f0970067290 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:05.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09840f55c0 0x7f0984105e70 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:05.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 --2- 172.21.15.96:0/1189468613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09840f6860 0x7f0984106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:05.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 >> 172.21.15.96:0/1189468613 conn(0x7f09840f0d40 msgr2=0x7f09840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:05.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 shutdown_connections 2022-02-02T20:37:05.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:05.169+0000 7f098c4ba700 1 -- 172.21.15.96:0/1189468613 wait complete. 2022-02-02T20:37:05.183 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:37:05.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:05 smithi159 ceph-mon[69013]: from='client.38260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:05 smithi159 ceph-mon[69013]: from='client.38264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1227204376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:37:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1189468613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:37:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:05 smithi096 ceph-mon[101353]: from='client.38260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:05 smithi096 ceph-mon[101353]: from='client.38264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1227204376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:37:05.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1189468613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:37:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:06 smithi159 ceph-mon[69013]: pgmap v4050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:06 smithi096 ceph-mon[101353]: pgmap v4050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:07 smithi159 ceph-mon[69013]: pgmap v4051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:07 smithi096 ceph-mon[101353]: pgmap v4051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:10 smithi159 ceph-mon[69013]: pgmap v4052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:10 smithi096 ceph-mon[101353]: pgmap v4052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:12 smithi159 ceph-mon[69013]: pgmap v4053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:12 smithi096 ceph-mon[101353]: pgmap v4053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:14 smithi159 ceph-mon[69013]: pgmap v4054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:14 smithi096 ceph-mon[101353]: pgmap v4054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:16 smithi159 ceph-mon[69013]: pgmap v4055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:16 smithi096 ceph-mon[101353]: pgmap v4055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:17 smithi159 ceph-mon[69013]: pgmap v4056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:17 smithi096 ceph-mon[101353]: pgmap v4056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:20.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:20 smithi159 ceph-mon[69013]: pgmap v4057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:20 smithi096 ceph-mon[101353]: pgmap v4057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:22 smithi159 ceph-mon[69013]: pgmap v4058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:22 smithi096 ceph-mon[101353]: pgmap v4058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:24 smithi159 ceph-mon[69013]: pgmap v4059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:24 smithi096 ceph-mon[101353]: pgmap v4059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:26 smithi159 ceph-mon[69013]: pgmap v4060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:26 smithi096 ceph-mon[101353]: pgmap v4060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:27 smithi159 ceph-mon[69013]: pgmap v4061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:37:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:37:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:27 smithi096 ceph-mon[101353]: pgmap v4061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:37:28.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:37:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:30 smithi159 ceph-mon[69013]: pgmap v4062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:30 smithi096 ceph-mon[101353]: pgmap v4062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:32 smithi159 ceph-mon[69013]: pgmap v4063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:32 smithi096 ceph-mon[101353]: pgmap v4063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:34 smithi159 ceph-mon[69013]: pgmap v4064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:34 smithi096 ceph-mon[101353]: pgmap v4064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:35.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 -- 172.21.15.96:0/4101458480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 msgr2=0x7f85c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/4101458480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c80f59e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f85c4004660 tx=0x7f85c4009b30).stop 2022-02-02T20:37:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 -- 172.21.15.96:0/4101458480 shutdown_connections 2022-02-02T20:37:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/4101458480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/4101458480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c80f59e0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.279+0000 7f85cf9b7700 1 -- 172.21.15.96:0/4101458480 >> 172.21.15.96:0/4101458480 conn(0x7f85c80f0de0 msgr2=0x7f85c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 -- 172.21.15.96:0/4101458480 shutdown_connections 2022-02-02T20:37:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 -- 172.21.15.96:0/4101458480 wait complete. 2022-02-02T20:37:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 Processor -- start 2022-02-02T20:37:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 -- start start 2022-02-02T20:37:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8060410 con 0x7f85c80f55c0 2022-02-02T20:37:35.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cf9b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8060550 con 0x7f85c80f5ed0 2022-02-02T20:37:35.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.280+0000 7f85cd753700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38148/0 (socket says 172.21.15.96:38148) 2022-02-02T20:37:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 -- 172.21.15.96:0/1966818883 learned_addr learned my addr 172.21.15.96:0/1966818883 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:35.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85ccf52700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 -- 172.21.15.96:0/1966818883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 msgr2=0x7f85c810e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c810e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 -- 172.21.15.96:0/1966818883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4005040 con 0x7f85c80f55c0 2022-02-02T20:37:35.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85ccf52700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:37:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cd753700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f85c4009990 tx=0x7f85c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c4018070 con 0x7f85c80f55c0 2022-02-02T20:37:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c810ea80 con 0x7f85c80f55c0 2022-02-02T20:37:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85c4007ca0 con 0x7f85c80f55c0 2022-02-02T20:37:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c401c620 con 0x7f85c80f55c0 2022-02-02T20:37:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.281+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c810ee50 con 0x7f85c80f55c0 2022-02-02T20:37:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.282+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c80f4a50 con 0x7f85c80f55c0 2022-02-02T20:37:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.283+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85c401d960 con 0x7f85c80f55c0 2022-02-02T20:37:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.283+0000 7f85bdffb700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 0x7f85b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.283+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85c4083890 con 0x7f85c80f55c0 2022-02-02T20:37:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.283+0000 7f85ccf52700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 0x7f85b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.284+0000 7f85ccf52700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 0x7f85b4067290 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f85b80041d0 tx=0x7f85b8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.288+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85c4051a40 con 0x7f85c80f55c0 2022-02-02T20:37:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.471+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c80fde80 con 0x7f85b4064dd0 2022-02-02T20:37:35.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.473+0000 7f85bdffb700 1 -- 172.21.15.96:0/1966818883 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f85c80fde80 con 0x7f85b4064dd0 2022-02-02T20:37:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 msgr2=0x7f85b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 0x7f85b4067290 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f85b80041d0 tx=0x7f85b8009040).stop 2022-02-02T20:37:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 msgr2=0x7f85c810c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f85c4009990 tx=0x7f85c4009b30).stop 2022-02-02T20:37:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 shutdown_connections 2022-02-02T20:37:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b4064dd0 0x7f85b4067290 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c80f55c0 0x7f85c810c090 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 --2- 172.21.15.96:0/1966818883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c80f5ed0 0x7f85c810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 >> 172.21.15.96:0/1966818883 conn(0x7f85c80f0de0 msgr2=0x7f85c80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.474+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 shutdown_connections 2022-02-02T20:37:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.475+0000 7f85cf9b7700 1 -- 172.21.15.96:0/1966818883 wait complete. 2022-02-02T20:37:35.487 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:37:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 -- 172.21.15.96:0/3178474714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f55c0 msgr2=0x7fe3640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 --2- 172.21.15.96:0/3178474714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f55c0 0x7fe3640f59e0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7fe358004660 tx=0x7fe358009b30).stop 2022-02-02T20:37:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 -- 172.21.15.96:0/3178474714 shutdown_connections 2022-02-02T20:37:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 --2- 172.21.15.96:0/3178474714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f6860 0x7fe3640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 --2- 172.21.15.96:0/3178474714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f55c0 0x7fe3640f59e0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 -- 172.21.15.96:0/3178474714 >> 172.21.15.96:0/3178474714 conn(0x7fe3640f0d40 msgr2=0x7fe3640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 -- 172.21.15.96:0/3178474714 shutdown_connections 2022-02-02T20:37:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.572+0000 7fe368914700 1 -- 172.21.15.96:0/3178474714 wait complete. 2022-02-02T20:37:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 Processor -- start 2022-02-02T20:37:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 -- start start 2022-02-02T20:37:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 0x7fe3640f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640f8100 con 0x7fe3640f6860 2022-02-02T20:37:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe368914700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640f8240 con 0x7fe3640f55c0 2022-02-02T20:37:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38160/0 (socket says 172.21.15.96:38160) 2022-02-02T20:37:35.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 -- 172.21.15.96:0/630226812 learned_addr learned my addr 172.21.15.96:0/630226812 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:35.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe36259c700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 0x7fe3640f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 -- 172.21.15.96:0/630226812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 msgr2=0x7fe3640f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 0x7fe3640f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe361d9b700 1 -- 172.21.15.96:0/630226812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358005040 con 0x7fe3640f6860 2022-02-02T20:37:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.573+0000 7fe36259c700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 0x7fe3640f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:37:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe361d9b700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7fe3540026d0 tx=0x7fe354009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe354009320 con 0x7fe3640f6860 2022-02-02T20:37:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe35400f040 con 0x7fe3640f6860 2022-02-02T20:37:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640f8520 con 0x7fe3640f6860 2022-02-02T20:37:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3540147e0 con 0x7fe3640f6860 2022-02-02T20:37:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.574+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36410efa0 con 0x7fe3640f6860 2022-02-02T20:37:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.575+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe364045ad0 con 0x7fe3640f6860 2022-02-02T20:37:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.575+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe354009480 con 0x7fe3640f6860 2022-02-02T20:37:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.575+0000 7fe352ffd700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 0x7fe34c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.576+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe354082070 con 0x7fe3640f6860 2022-02-02T20:37:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.576+0000 7fe36259c700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 0x7fe34c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.576+0000 7fe36259c700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 0x7fe34c067290 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fe358004e30 tx=0x7fe358009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.580+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe354050170 con 0x7fe3640f6860 2022-02-02T20:37:35.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.753+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3640faca0 con 0x7fe34c064dd0 2022-02-02T20:37:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.763+0000 7fe352ffd700 1 -- 172.21.15.96:0/630226812 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe3640faca0 con 0x7fe34c064dd0 2022-02-02T20:37:35.765 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:37:35.766 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 111m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:37:35.766 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 111m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:37:35.766 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 110m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:37:35.766 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 111m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:37:35.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 111m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:37:35.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 111m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:37:35.767 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 110m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:37:35.768 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 110m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:37:35.769 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 111m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:37:35.769 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 110m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:37:35.770 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 111m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:37:35.770 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 110m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:37:35.771 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 111m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:37:35.771 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 110m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:37:35.771 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 111m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:37:35.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 111m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:37:35.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 111m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:37:35.773 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 110m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:37:35.773 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 110m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:37:35.774 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 110m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:37:35.774 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 111m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:37:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.764+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 msgr2=0x7fe34c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.764+0000 7fe368914700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 0x7fe34c067290 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fe358004e30 tx=0x7fe358009b30).stop 2022-02-02T20:37:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 msgr2=0x7fe3640f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7fe3540026d0 tx=0x7fe354009de0).stop 2022-02-02T20:37:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 shutdown_connections 2022-02-02T20:37:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe34c064dd0 0x7fe34c067290 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3640f55c0 0x7fe3640f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 --2- 172.21.15.96:0/630226812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3640f6860 0x7fe3640f7ba0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 >> 172.21.15.96:0/630226812 conn(0x7fe3640f0d40 msgr2=0x7fe36405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 shutdown_connections 2022-02-02T20:37:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.765+0000 7fe368914700 1 -- 172.21.15.96:0/630226812 wait complete. 2022-02-02T20:37:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 -- 172.21.15.96:0/188150852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 msgr2=0x7f12880f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 --2- 172.21.15.96:0/188150852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f12880f6920 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f127c004660 tx=0x7f127c009b30).stop 2022-02-02T20:37:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 -- 172.21.15.96:0/188150852 shutdown_connections 2022-02-02T20:37:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 --2- 172.21.15.96:0/188150852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f12880f6920 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 --2- 172.21.15.96:0/188150852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 0x7f12880f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 -- 172.21.15.96:0/188150852 >> 172.21.15.96:0/188150852 conn(0x7f12880f0de0 msgr2=0x7f12880f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 -- 172.21.15.96:0/188150852 shutdown_connections 2022-02-02T20:37:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.861+0000 7f128d940700 1 -- 172.21.15.96:0/188150852 wait complete. 2022-02-02T20:37:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 Processor -- start 2022-02-02T20:37:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 -- start start 2022-02-02T20:37:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 0x7f1288105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288106930 con 0x7f12880f5ef0 2022-02-02T20:37:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f128d940700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288106a70 con 0x7f12880f55e0 2022-02-02T20:37:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f12867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f12867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38170/0 (socket says 172.21.15.96:38170) 2022-02-02T20:37:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f12867fc700 1 -- 172.21.15.96:0/1316618107 learned_addr learned my addr 172.21.15.96:0/1316618107 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.862+0000 7f1286ffd700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 0x7f1288105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f12867fc700 1 -- 172.21.15.96:0/1316618107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 msgr2=0x7f1288105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f12867fc700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 0x7f1288105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f12867fc700 1 -- 172.21.15.96:0/1316618107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c005040 con 0x7f12880f5ef0 2022-02-02T20:37:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f12867fc700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f127c009990 tx=0x7f127c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c018070 con 0x7f12880f5ef0 2022-02-02T20:37:35.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12881073b0 con 0x7f12880f5ef0 2022-02-02T20:37:35.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f127c007ba0 con 0x7f12880f5ef0 2022-02-02T20:37:35.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c01c3c0 con 0x7f12880f5ef0 2022-02-02T20:37:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.863+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1288107910 con 0x7f12880f5ef0 2022-02-02T20:37:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.864+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1288045ad0 con 0x7f12880f5ef0 2022-02-02T20:37:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.864+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f127c01d420 con 0x7f12880f5ef0 2022-02-02T20:37:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.865+0000 7f126f7fe700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 0x7f1270067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:35.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.865+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f127c0836a0 con 0x7f12880f5ef0 2022-02-02T20:37:35.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.865+0000 7f1286ffd700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 0x7f1270067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:35.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.865+0000 7f1286ffd700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 0x7f1270067290 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f1278004c40 tx=0x7f127800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:35.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:35.870+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f127c055290 con 0x7f12880f5ef0 2022-02-02T20:37:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.101+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f12880fddd0 con 0x7f12880f5ef0 2022-02-02T20:37:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.102+0000 7f126f7fe700 1 -- 172.21.15.96:0/1316618107 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f127c054e80 con 0x7f12880f5ef0 2022-02-02T20:37:36.109 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:37:36.110 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:37:36.112 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:37:36.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:36.114 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:37:36.114 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:37:36.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:36.116 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:37:36.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:37:36.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:36.120 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:37:36.121 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:37:36.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:37:36.125 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:37:36.126 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:37:36.127 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:37:36.129 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:37:36.129 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:37:36.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 msgr2=0x7f1270067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 0x7f1270067290 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f1278004c40 tx=0x7f127800b040).stop 2022-02-02T20:37:36.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 msgr2=0x7f1288106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f127c009990 tx=0x7f127c009b30).stop 2022-02-02T20:37:36.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 shutdown_connections 2022-02-02T20:37:36.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1270064dd0 0x7f1270067290 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12880f55e0 0x7f1288105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 --2- 172.21.15.96:0/1316618107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12880f5ef0 0x7f1288106380 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 >> 172.21.15.96:0/1316618107 conn(0x7f12880f0de0 msgr2=0x7f12880fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:36.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 shutdown_connections 2022-02-02T20:37:36.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.103+0000 7f128d940700 1 -- 172.21.15.96:0/1316618107 wait complete. 2022-02-02T20:37:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 -- 172.21.15.96:0/2483322439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 msgr2=0x7feba40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 --2- 172.21.15.96:0/2483322439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba40f6cc0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7feb8c004660 tx=0x7feb8c009b30).stop 2022-02-02T20:37:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 -- 172.21.15.96:0/2483322439 shutdown_connections 2022-02-02T20:37:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 --2- 172.21.15.96:0/2483322439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba40f6cc0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 --2- 172.21.15.96:0/2483322439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 -- 172.21.15.96:0/2483322439 >> 172.21.15.96:0/2483322439 conn(0x7feba40f0d40 msgr2=0x7feba40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 -- 172.21.15.96:0/2483322439 shutdown_connections 2022-02-02T20:37:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.201+0000 7febaa7dc700 1 -- 172.21.15.96:0/2483322439 wait complete. 2022-02-02T20:37:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 Processor -- start 2022-02-02T20:37:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 -- start start 2022-02-02T20:37:36.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:36.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:36.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40602b0 con 0x7feba40f6860 2022-02-02T20:37:36.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7febaa7dc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40603f0 con 0x7feba40f55c0 2022-02-02T20:37:36.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7feba37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:36.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7feba37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38180/0 (socket says 172.21.15.96:38180) 2022-02-02T20:37:36.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7feba37fe700 1 -- 172.21.15.96:0/1222434691 learned_addr learned my addr 172.21.15.96:0/1222434691 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:37:36.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.202+0000 7feba3fff700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:36.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba3fff700 1 -- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 msgr2=0x7feba410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba3fff700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba3fff700 1 -- 172.21.15.96:0/1222434691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c005040 con 0x7feba40f55c0 2022-02-02T20:37:36.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba3fff700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba410c070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7feb9400c530 tx=0x7feb94007d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:36.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb94013630 con 0x7feba40f55c0 2022-02-02T20:37:36.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb94012860 con 0x7feba40f55c0 2022-02-02T20:37:36.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba410ea60 con 0x7feba40f55c0 2022-02-02T20:37:36.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb940026e0 con 0x7feba40f55c0 2022-02-02T20:37:36.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.203+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba410eee0 con 0x7feba40f55c0 2022-02-02T20:37:36.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.204+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4045ad0 con 0x7feba40f55c0 2022-02-02T20:37:36.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.204+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb94010070 con 0x7feba40f55c0 2022-02-02T20:37:36.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.205+0000 7feba0ff9700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 0x7feb90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:37:36.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.205+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feb94081b90 con 0x7feba40f55c0 2022-02-02T20:37:36.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.205+0000 7feba37fe700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 0x7feb90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:37:36.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.205+0000 7feba37fe700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 0x7feb90067290 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7feb8c004630 tx=0x7feb8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:37:36.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.210+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb9404fc90 con 0x7feba40f55c0 2022-02-02T20:37:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.412+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feba40fde80 con 0x7feba40f55c0 2022-02-02T20:37:36.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.412+0000 7feba0ff9700 1 -- 172.21.15.96:0/1222434691 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7feb940532b0 con 0x7feba40f55c0 2022-02-02T20:37:36.417 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:37:36.417 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:37:36.418 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:37:36.418 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:37:36.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:36.419 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:37:36.419 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:37:36.420 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:37:36.420 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:37:36.421 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:37:36.421 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:37:36.421 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:37:36.422 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:37:36.422 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:37:36.423 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:37:36.423 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:37:36.423 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:37:36.424 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:37:36.424 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:37:36.425 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:37:36.425 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:37:36.425 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:37:36.426 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:37:36.427 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:37:36.427 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:37:36.427 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:37:36.428 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:37:36.428 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:37:36.428 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:37:36.429 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:37:36.429 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:37:36.430 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:37:36.430 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:36.431 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:36.431 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:37:36.431 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:37:36.432 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:36.432 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:36.433 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:37:36.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 msgr2=0x7feb90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 0x7feb90067290 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7feb8c004630 tx=0x7feb8c009b30).stop 2022-02-02T20:37:36.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 msgr2=0x7feba410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:37:36.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba410c070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7feb9400c530 tx=0x7feb94007d00).stop 2022-02-02T20:37:36.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 shutdown_connections 2022-02-02T20:37:36.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb90064dd0 0x7feb90067290 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feba40f55c0 0x7feba410c070 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 --2- 172.21.15.96:0/1222434691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feba40f6860 0x7feba410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:37:36.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 >> 172.21.15.96:0/1222434691 conn(0x7feba40f0d40 msgr2=0x7feba40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:37:36.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 shutdown_connections 2022-02-02T20:37:36.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:37:36.415+0000 7febaa7dc700 1 -- 172.21.15.96:0/1222434691 wait complete. 2022-02-02T20:37:36.439 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:37:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:36 smithi096 ceph-mon[101353]: pgmap v4065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:36 smithi096 ceph-mon[101353]: from='client.38276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1316618107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:37:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:36 smithi159 ceph-mon[69013]: pgmap v4065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:36 smithi159 ceph-mon[69013]: from='client.38276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1316618107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:37:37.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:37 smithi159 ceph-mon[69013]: from='client.38280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:37.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1222434691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:37:37.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:37 smithi096 ceph-mon[101353]: from='client.38280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:37:37.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1222434691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:37:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:38 smithi159 ceph-mon[69013]: pgmap v4066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:38 smithi096 ceph-mon[101353]: pgmap v4066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:40 smithi159 ceph-mon[69013]: pgmap v4067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:40 smithi096 ceph-mon[101353]: pgmap v4067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:42 smithi159 ceph-mon[69013]: pgmap v4068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:42 smithi096 ceph-mon[101353]: pgmap v4068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:44 smithi159 ceph-mon[69013]: pgmap v4069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:44 smithi096 ceph-mon[101353]: pgmap v4069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:46 smithi159 ceph-mon[69013]: pgmap v4070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:46 smithi096 ceph-mon[101353]: pgmap v4070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:47 smithi159 ceph-mon[69013]: pgmap v4071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:47 smithi096 ceph-mon[101353]: pgmap v4071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:50 smithi159 ceph-mon[69013]: pgmap v4072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:50 smithi096 ceph-mon[101353]: pgmap v4072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:52 smithi159 ceph-mon[69013]: pgmap v4073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:52 smithi096 ceph-mon[101353]: pgmap v4073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:54 smithi159 ceph-mon[69013]: pgmap v4074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:54 smithi096 ceph-mon[101353]: pgmap v4074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:56 smithi159 ceph-mon[69013]: pgmap v4075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:56 smithi096 ceph-mon[101353]: pgmap v4075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:37:57 smithi159 ceph-mon[69013]: pgmap v4076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:37:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:37:57 smithi096 ceph-mon[101353]: pgmap v4076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:00 smithi159 ceph-mon[69013]: pgmap v4077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:00 smithi096 ceph-mon[101353]: pgmap v4077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:02 smithi159 ceph-mon[69013]: pgmap v4078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:02 smithi096 ceph-mon[101353]: pgmap v4078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:04 smithi159 ceph-mon[69013]: pgmap v4079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:04 smithi096 ceph-mon[101353]: pgmap v4079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:06.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- 172.21.15.96:0/1848260487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f6530 msgr2=0x7f6b340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 --2- 172.21.15.96:0/1848260487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f6530 0x7f6b340f6950 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7f6b24004660 tx=0x7f6b24009b30).stop 2022-02-02T20:38:06.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- 172.21.15.96:0/1848260487 shutdown_connections 2022-02-02T20:38:06.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 --2- 172.21.15.96:0/1848260487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f77d0 0x7f6b340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 --2- 172.21.15.96:0/1848260487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f6530 0x7f6b340f6950 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- 172.21.15.96:0/1848260487 >> 172.21.15.96:0/1848260487 conn(0x7f6b340f1c90 msgr2=0x7f6b340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- 172.21.15.96:0/1848260487 shutdown_connections 2022-02-02T20:38:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- 172.21.15.96:0/1848260487 wait complete. 2022-02-02T20:38:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 Processor -- start 2022-02-02T20:38:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.526+0000 7f6b3359e700 1 -- start start 2022-02-02T20:38:06.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 0x7f6b34106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b341078f0 con 0x7f6b340f77d0 2022-02-02T20:38:06.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b34108100 con 0x7f6b340f6530 2022-02-02T20:38:06.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38200/0 (socket says 172.21.15.96:38200) 2022-02-02T20:38:06.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 -- 172.21.15.96:0/3249503668 learned_addr learned my addr 172.21.15.96:0/3249503668 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:06.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3259c700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 0x7f6b34106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 -- 172.21.15.96:0/3249503668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 msgr2=0x7f6b34106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 0x7f6b34106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 -- 172.21.15.96:0/3249503668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24005040 con 0x7f6b340f77d0 2022-02-02T20:38:06.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3259c700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 0x7f6b34106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:38:06.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b31d9b700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f6b2800c530 tx=0x7f6b28007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:06.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2800f650 con 0x7f6b340f77d0 2022-02-02T20:38:06.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b2800fc60 con 0x7f6b340f77d0 2022-02-02T20:38:06.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.527+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b34108380 con 0x7f6b340f77d0 2022-02-02T20:38:06.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.528+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b34108940 con 0x7f6b340f77d0 2022-02-02T20:38:06.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.528+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b28012cd0 con 0x7f6b340f77d0 2022-02-02T20:38:06.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.529+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b28010070 con 0x7f6b340f77d0 2022-02-02T20:38:06.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.529+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18004fa0 con 0x7f6b340f77d0 2022-02-02T20:38:06.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.529+0000 7f6b22ffd700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 0x7f6b1c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.530+0000 7f6b3259c700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 0x7f6b1c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.530+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6b28081780 con 0x7f6b340f77d0 2022-02-02T20:38:06.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.530+0000 7f6b3259c700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 0x7f6b1c0672e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f6b24004e30 tx=0x7f6b24009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:06.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.534+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b2804f880 con 0x7f6b340f77d0 2022-02-02T20:38:06.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.717+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b18000bc0 con 0x7f6b1c064e20 2022-02-02T20:38:06.719 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:06 smithi096 ceph-mon[101353]: pgmap v4080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:06.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.718+0000 7f6b22ffd700 1 -- 172.21.15.96:0/3249503668 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6b18000bc0 con 0x7f6b1c064e20 2022-02-02T20:38:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 msgr2=0x7f6b1c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 0x7f6b1c0672e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f6b24004e30 tx=0x7f6b24009b30).stop 2022-02-02T20:38:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 msgr2=0x7f6b341072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f6b2800c530 tx=0x7f6b28007e20).stop 2022-02-02T20:38:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 shutdown_connections 2022-02-02T20:38:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b1c064e20 0x7f6b1c0672e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b340f6530 0x7f6b34106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 --2- 172.21.15.96:0/3249503668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b340f77d0 0x7f6b341072f0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 >> 172.21.15.96:0/3249503668 conn(0x7f6b340f1c90 msgr2=0x7f6b340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 shutdown_connections 2022-02-02T20:38:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.720+0000 7f6b3359e700 1 -- 172.21.15.96:0/3249503668 wait complete. 2022-02-02T20:38:06.731 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:38:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:06 smithi159 ceph-mon[69013]: pgmap v4080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 -- 172.21.15.96:0/3039321282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 msgr2=0x7f43480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 --2- 172.21.15.96:0/3039321282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f43480f59e0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7f4330004660 tx=0x7f4330009b30).stop 2022-02-02T20:38:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 -- 172.21.15.96:0/3039321282 shutdown_connections 2022-02-02T20:38:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 --2- 172.21.15.96:0/3039321282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 0x7f43480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 --2- 172.21.15.96:0/3039321282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f43480f59e0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 -- 172.21.15.96:0/3039321282 >> 172.21.15.96:0/3039321282 conn(0x7f43480f0d20 msgr2=0x7f43480f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 -- 172.21.15.96:0/3039321282 shutdown_connections 2022-02-02T20:38:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.818+0000 7f434d166700 1 -- 172.21.15.96:0/3039321282 wait complete. 2022-02-02T20:38:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 Processor -- start 2022-02-02T20:38:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 -- start start 2022-02-02T20:38:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 0x7f434810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348060540 con 0x7f43480f55c0 2022-02-02T20:38:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434d166700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348060680 con 0x7f43480f6860 2022-02-02T20:38:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38208/0 (socket says 172.21.15.96:38208) 2022-02-02T20:38:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 -- 172.21.15.96:0/2589331865 learned_addr learned my addr 172.21.15.96:0/2589331865 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f434659c700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 0x7f434810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 -- 172.21.15.96:0/2589331865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 msgr2=0x7f434810c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 0x7f434810c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 -- 172.21.15.96:0/2589331865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330005040 con 0x7f43480f55c0 2022-02-02T20:38:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f4346d9d700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f4330013a70 tx=0x7f4330009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.819+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4330018070 con 0x7f43480f55c0 2022-02-02T20:38:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.820+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f43300097d0 con 0x7f43480f55c0 2022-02-02T20:38:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.820+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434810c710 con 0x7f43480f55c0 2022-02-02T20:38:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.820+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433001de80 con 0x7f43480f55c0 2022-02-02T20:38:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.820+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434810cc70 con 0x7f43480f55c0 2022-02-02T20:38:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.820+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348045ad0 con 0x7f43480f55c0 2022-02-02T20:38:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.821+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4330007ba0 con 0x7f43480f55c0 2022-02-02T20:38:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.821+0000 7f433f7fe700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 0x7f4334067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.821+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4330083660 con 0x7f43480f55c0 2022-02-02T20:38:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.821+0000 7f434659c700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 0x7f4334067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.822+0000 7f434659c700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 0x7f4334067290 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f4338004c40 tx=0x7f433800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:06.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.826+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4330051760 con 0x7f43480f55c0 2022-02-02T20:38:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:06.998+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43480fdf30 con 0x7f4334064dd0 2022-02-02T20:38:07.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.007+0000 7f433f7fe700 1 -- 172.21.15.96:0/2589331865 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f433800f040 con 0x7f4334064dd0 2022-02-02T20:38:07.009 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:38:07.009 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 112m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:38:07.009 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 112m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:38:07.009 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 110m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:38:07.010 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 112m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:38:07.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 112m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:38:07.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 112m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:38:07.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 110m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:38:07.011 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 110m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:38:07.011 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 112m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:38:07.011 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 110m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:38:07.011 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 112m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:38:07.011 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 110m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:38:07.012 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 112m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:38:07.012 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 110m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:38:07.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 112m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:38:07.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 112m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:38:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 112m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:38:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 110m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:38:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 110m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:38:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 110m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:38:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 112m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:38:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 msgr2=0x7f4334067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 0x7f4334067290 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f4338004c40 tx=0x7f433800b040).stop 2022-02-02T20:38:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 msgr2=0x7f4348109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f4330013a70 tx=0x7f4330009b30).stop 2022-02-02T20:38:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 shutdown_connections 2022-02-02T20:38:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4334064dd0 0x7f4334067290 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43480f55c0 0x7f4348109cc0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 --2- 172.21.15.96:0/2589331865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43480f6860 0x7f434810c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 >> 172.21.15.96:0/2589331865 conn(0x7f43480f0d20 msgr2=0x7f43480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 shutdown_connections 2022-02-02T20:38:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.009+0000 7f434d166700 1 -- 172.21.15.96:0/2589331865 wait complete. 2022-02-02T20:38:07.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 -- 172.21.15.96:0/2098292308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f6860 msgr2=0x7f26440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 --2- 172.21.15.96:0/2098292308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f6860 0x7f26440f6cc0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f2640004660 tx=0x7f2640009b30).stop 2022-02-02T20:38:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 -- 172.21.15.96:0/2098292308 shutdown_connections 2022-02-02T20:38:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 --2- 172.21.15.96:0/2098292308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f6860 0x7f26440f6cc0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 --2- 172.21.15.96:0/2098292308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f55c0 0x7f26440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 -- 172.21.15.96:0/2098292308 >> 172.21.15.96:0/2098292308 conn(0x7f26440f0d40 msgr2=0x7f26440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 -- 172.21.15.96:0/2098292308 shutdown_connections 2022-02-02T20:38:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.105+0000 7f264baf8700 1 -- 172.21.15.96:0/2098292308 wait complete. 2022-02-02T20:38:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 Processor -- start 2022-02-02T20:38:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 -- start start 2022-02-02T20:38:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 0x7f264410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26440603e0 con 0x7f26440f55c0 2022-02-02T20:38:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f264baf8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644060520 con 0x7f26440f6860 2022-02-02T20:38:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f2649894700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f2649894700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38218/0 (socket says 172.21.15.96:38218) 2022-02-02T20:38:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.106+0000 7f2649894700 1 -- 172.21.15.96:0/4106134694 learned_addr learned my addr 172.21.15.96:0/4106134694 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649093700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 0x7f264410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649894700 1 -- 172.21.15.96:0/4106134694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 msgr2=0x7f264410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649894700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 0x7f264410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649894700 1 -- 172.21.15.96:0/4106134694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640005040 con 0x7f26440f55c0 2022-02-02T20:38:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649093700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 0x7f264410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:38:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f2649894700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f2634002700 tx=0x7f2634009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2634009320 con 0x7f26440f55c0 2022-02-02T20:38:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264410c700 con 0x7f26440f55c0 2022-02-02T20:38:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f263400f040 con 0x7f26440f55c0 2022-02-02T20:38:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2634014900 con 0x7f26440f55c0 2022-02-02T20:38:07.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.107+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264410ccc0 con 0x7f26440f55c0 2022-02-02T20:38:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.108+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2644045ad0 con 0x7f26440f55c0 2022-02-02T20:38:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.108+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2634009480 con 0x7f26440f55c0 2022-02-02T20:38:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.109+0000 7f263a7fc700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 0x7f2630067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.109+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2634081cc0 con 0x7f26440f55c0 2022-02-02T20:38:07.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.109+0000 7f2649093700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 0x7f2630067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.109+0000 7f2649093700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 0x7f2630067290 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f2640009da0 tx=0x7f2640009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.113+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f263404fe80 con 0x7f26440f55c0 2022-02-02T20:38:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.344+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26440fdf00 con 0x7f26440f55c0 2022-02-02T20:38:07.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.345+0000 7f263a7fc700 1 -- 172.21.15.96:0/4106134694 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f26340534a0 con 0x7f26440f55c0 2022-02-02T20:38:07.347 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:38:07.347 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:38:07.349 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:38:07.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:07.350 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:38:07.350 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:38:07.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:07.351 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:38:07.351 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:38:07.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:07.353 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:38:07.353 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:38:07.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:07.354 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:38:07.354 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:38:07.355 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:38:07.355 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:38:07.355 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:38:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 msgr2=0x7f2630067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 0x7f2630067290 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f2640009da0 tx=0x7f2640009b30).stop 2022-02-02T20:38:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 msgr2=0x7f2644109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f2634002700 tx=0x7f2634009d80).stop 2022-02-02T20:38:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 shutdown_connections 2022-02-02T20:38:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2630064dd0 0x7f2630067290 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26440f55c0 0x7f2644109c50 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.346+0000 7f264baf8700 1 --2- 172.21.15.96:0/4106134694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26440f6860 0x7f264410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.347+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 >> 172.21.15.96:0/4106134694 conn(0x7f26440f0d40 msgr2=0x7f26440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.347+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 shutdown_connections 2022-02-02T20:38:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.347+0000 7f264baf8700 1 -- 172.21.15.96:0/4106134694 wait complete. 2022-02-02T20:38:07.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 -- 172.21.15.96:0/1724130283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 msgr2=0x7f54b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1724130283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b00f6cc0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f54ac004660 tx=0x7f54ac009b30).stop 2022-02-02T20:38:07.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 -- 172.21.15.96:0/1724130283 shutdown_connections 2022-02-02T20:38:07.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1724130283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b00f6cc0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1724130283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 0x7f54b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 -- 172.21.15.96:0/1724130283 >> 172.21.15.96:0/1724130283 conn(0x7f54b00f0d40 msgr2=0x7f54b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:07.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 -- 172.21.15.96:0/1724130283 shutdown_connections 2022-02-02T20:38:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.444+0000 7f54b84d7700 1 -- 172.21.15.96:0/1724130283 wait complete. 2022-02-02T20:38:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 Processor -- start 2022-02-02T20:38:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 -- start start 2022-02-02T20:38:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 0x7f54b0109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00603e0 con 0x7f54b00f6860 2022-02-02T20:38:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b84d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0060520 con 0x7f54b00f55c0 2022-02-02T20:38:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38230/0 (socket says 172.21.15.96:38230) 2022-02-02T20:38:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 -- 172.21.15.96:0/1461943048 learned_addr learned my addr 172.21.15.96:0/1461943048 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b6273700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 0x7f54b0109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 -- 172.21.15.96:0/1461943048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 msgr2=0x7f54b0109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 0x7f54b0109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.445+0000 7f54b5a72700 1 -- 172.21.15.96:0/1461943048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac005040 con 0x7f54b00f6860 2022-02-02T20:38:07.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54b5a72700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f54ac009990 tx=0x7f54ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:07.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ac018070 con 0x7f54b00f6860 2022-02-02T20:38:07.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54ac007ca0 con 0x7f54b00f6860 2022-02-02T20:38:07.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b010c6a0 con 0x7f54b00f6860 2022-02-02T20:38:07.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ac01c620 con 0x7f54b00f6860 2022-02-02T20:38:07.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.446+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b010cc00 con 0x7f54b00f6860 2022-02-02T20:38:07.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.447+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0045ad0 con 0x7f54b00f6860 2022-02-02T20:38:07.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.447+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f54ac01d960 con 0x7f54b00f6860 2022-02-02T20:38:07.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.447+0000 7f54a6ffd700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 0x7f549c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:07.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.448+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f54ac0837e0 con 0x7f54b00f6860 2022-02-02T20:38:07.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.448+0000 7f54b6273700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 0x7f549c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:07.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.448+0000 7f54b6273700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 0x7f549c067290 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f54b0060060 tx=0x7f54a0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:07.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.452+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f54ac0519a0 con 0x7f54b00f6860 2022-02-02T20:38:07.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.650+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54b0027a00 con 0x7f54b00f6860 2022-02-02T20:38:07.652 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:07 smithi096 ceph-mon[101353]: from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:07.653 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4106134694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:38:07.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.651+0000 7f54a6ffd700 1 -- 172.21.15.96:0/1461943048 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f54ac054fc0 con 0x7f54b00f6860 2022-02-02T20:38:07.654 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:38:07.654 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:38:07.654 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:38:07.655 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:38:07.655 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:07.655 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:38:07.655 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:38:07.656 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:38:07.656 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:38:07.656 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:38:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:38:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:38:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:38:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:38:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:38:07.658 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:38:07.658 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:38:07.658 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:38:07.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:38:07.659 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:38:07.659 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:38:07.659 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:38:07.660 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:38:07.660 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:38:07.660 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:38:07.660 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:38:07.660 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:38:07.661 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:38:07.661 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:38:07.661 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:38:07.661 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:38:07.662 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:38:07.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:07.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:07.662 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:38:07.662 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:07.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:07.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:07.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:07.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.652+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 msgr2=0x7f549c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.652+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 0x7f549c067290 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f54b0060060 tx=0x7f54a0009040).stop 2022-02-02T20:38:07.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.652+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 msgr2=0x7f54b010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:07.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.652+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f54ac009990 tx=0x7f54ac009b30).stop 2022-02-02T20:38:07.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 shutdown_connections 2022-02-02T20:38:07.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f549c064dd0 0x7f549c067290 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00f55c0 0x7f54b0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 --2- 172.21.15.96:0/1461943048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b00f6860 0x7f54b010c150 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:07.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 >> 172.21.15.96:0/1461943048 conn(0x7f54b00f0d40 msgr2=0x7f54b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:07.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 shutdown_connections 2022-02-02T20:38:07.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:07.653+0000 7f54b84d7700 1 -- 172.21.15.96:0/1461943048 wait complete. 2022-02-02T20:38:07.667 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:38:07.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:07 smithi159 ceph-mon[69013]: from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:07.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4106134694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:38:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:08 smithi159 ceph-mon[69013]: from='client.38296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:08 smithi159 ceph-mon[69013]: pgmap v4081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:08.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1461943048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:38:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:08 smithi096 ceph-mon[101353]: from='client.38296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:08 smithi096 ceph-mon[101353]: pgmap v4081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1461943048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:38:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:10 smithi159 ceph-mon[69013]: pgmap v4082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:10 smithi096 ceph-mon[101353]: pgmap v4082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:12 smithi159 ceph-mon[69013]: pgmap v4083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:12 smithi096 ceph-mon[101353]: pgmap v4083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:14 smithi159 ceph-mon[69013]: pgmap v4084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:14 smithi096 ceph-mon[101353]: pgmap v4084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:16 smithi159 ceph-mon[69013]: pgmap v4085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:16 smithi096 ceph-mon[101353]: pgmap v4085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:17 smithi159 ceph-mon[69013]: pgmap v4086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:17 smithi096 ceph-mon[101353]: pgmap v4086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:20 smithi159 ceph-mon[69013]: pgmap v4087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:20 smithi096 ceph-mon[101353]: pgmap v4087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:22 smithi159 ceph-mon[69013]: pgmap v4088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:22 smithi096 ceph-mon[101353]: pgmap v4088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:24 smithi159 ceph-mon[69013]: pgmap v4089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:24 smithi096 ceph-mon[101353]: pgmap v4089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:26 smithi159 ceph-mon[69013]: pgmap v4090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:26 smithi096 ceph-mon[101353]: pgmap v4090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:27 smithi159 ceph-mon[69013]: pgmap v4091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:38:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:38:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:27 smithi096 ceph-mon[101353]: pgmap v4091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:38:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:38:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:30 smithi159 ceph-mon[69013]: pgmap v4092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:30 smithi096 ceph-mon[101353]: pgmap v4092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:32 smithi159 ceph-mon[69013]: pgmap v4093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:32 smithi096 ceph-mon[101353]: pgmap v4093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:34 smithi159 ceph-mon[69013]: pgmap v4094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:34 smithi096 ceph-mon[101353]: pgmap v4094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:36 smithi159 ceph-mon[69013]: pgmap v4095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:36 smithi096 ceph-mon[101353]: pgmap v4095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 -- 172.21.15.96:0/1908180903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f6860 msgr2=0x7fe04c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 --2- 172.21.15.96:0/1908180903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f6860 0x7fe04c0f6cc0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7fe034004660 tx=0x7fe034009b30).stop 2022-02-02T20:38:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 -- 172.21.15.96:0/1908180903 shutdown_connections 2022-02-02T20:38:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 --2- 172.21.15.96:0/1908180903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f6860 0x7fe04c0f6cc0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 --2- 172.21.15.96:0/1908180903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f55c0 0x7fe04c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 -- 172.21.15.96:0/1908180903 >> 172.21.15.96:0/1908180903 conn(0x7fe04c0f0d40 msgr2=0x7fe04c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 -- 172.21.15.96:0/1908180903 shutdown_connections 2022-02-02T20:38:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.764+0000 7fe0530ca700 1 -- 172.21.15.96:0/1908180903 wait complete. 2022-02-02T20:38:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 Processor -- start 2022-02-02T20:38:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 -- start start 2022-02-02T20:38:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f6860 0x7fe04c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0602b0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe0530ca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0603f0 con 0x7fe04c0f6860 2022-02-02T20:38:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe050e66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe050e66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38258/0 (socket says 172.21.15.96:38258) 2022-02-02T20:38:37.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe050e66700 1 -- 172.21.15.96:0/991431417 learned_addr learned my addr 172.21.15.96:0/991431417 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:37.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.765+0000 7fe04bfff700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f6860 0x7fe04c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:37.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe050e66700 1 -- 172.21.15.96:0/991431417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f6860 msgr2=0x7fe04c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:37.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe050e66700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f6860 0x7fe04c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe050e66700 1 -- 172.21.15.96:0/991431417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034005040 con 0x7fe04c0f55c0 2022-02-02T20:38:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe050e66700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fe03c00d7f0 tx=0x7fe03c004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03c00f490 con 0x7fe04c0f55c0 2022-02-02T20:38:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe03c00f040 con 0x7fe04c0f55c0 2022-02-02T20:38:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c10ea60 con 0x7fe04c0f55c0 2022-02-02T20:38:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03c0139b0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.766+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c10eee0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.767+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c045ad0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.767+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe03c01a030 con 0x7fe04c0f55c0 2022-02-02T20:38:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.768+0000 7fe0497fa700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 0x7fe038067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.768+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe03c0818b0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.768+0000 7fe04bfff700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 0x7fe038067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.768+0000 7fe04bfff700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 0x7fe038067290 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fe034004630 tx=0x7fe034009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.772+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe03c04f9b0 con 0x7fe04c0f55c0 2022-02-02T20:38:37.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.952+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe04c0fdef0 con 0x7fe038064dd0 2022-02-02T20:38:37.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.953+0000 7fe0497fa700 1 -- 172.21.15.96:0/991431417 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe04c0fdef0 con 0x7fe038064dd0 2022-02-02T20:38:37.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 msgr2=0x7fe038067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:37.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 0x7fe038067290 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fe034004630 tx=0x7fe034009b30).stop 2022-02-02T20:38:37.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 msgr2=0x7fe04c10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:37.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fe03c00d7f0 tx=0x7fe03c004e80).stop 2022-02-02T20:38:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 shutdown_connections 2022-02-02T20:38:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe038064dd0 0x7fe038067290 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe04c0f55c0 0x7fe04c10c070 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 --2- 172.21.15.96:0/991431417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe04c0f6860 0x7fe04c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:37.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 >> 172.21.15.96:0/991431417 conn(0x7fe04c0f0d40 msgr2=0x7fe04c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:37.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 shutdown_connections 2022-02-02T20:38:37.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:37.955+0000 7fe0530ca700 1 -- 172.21.15.96:0/991431417 wait complete. 2022-02-02T20:38:37.966 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:38:38.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 -- 172.21.15.96:0/3931201443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f6700 msgr2=0x7f36680f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 --2- 172.21.15.96:0/3931201443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f6700 0x7f36680f6b60 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f3658004660 tx=0x7f3658009b30).stop 2022-02-02T20:38:38.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 -- 172.21.15.96:0/3931201443 shutdown_connections 2022-02-02T20:38:38.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 --2- 172.21.15.96:0/3931201443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f6700 0x7f36680f6b60 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 --2- 172.21.15.96:0/3931201443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f5460 0x7f36680f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 -- 172.21.15.96:0/3931201443 >> 172.21.15.96:0/3931201443 conn(0x7f36680f0bc0 msgr2=0x7f36680f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:37 smithi096 ceph-mon[101353]: pgmap v4096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 -- 172.21.15.96:0/3931201443 shutdown_connections 2022-02-02T20:38:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.053+0000 7f366d401700 1 -- 172.21.15.96:0/3931201443 wait complete. 2022-02-02T20:38:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 Processor -- start 2022-02-02T20:38:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 -- start start 2022-02-02T20:38:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f6700 0x7f3668107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3668107920 con 0x7f36680f5460 2022-02-02T20:38:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f366d401700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3668108130 con 0x7f36680f6700 2022-02-02T20:38:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f3666ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f3666ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38268/0 (socket says 172.21.15.96:38268) 2022-02-02T20:38:38.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f3666ffd700 1 -- 172.21.15.96:0/1850936334 learned_addr learned my addr 172.21.15.96:0/1850936334 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:38.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.054+0000 7f36667fc700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f6700 0x7f3668107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f3666ffd700 1 -- 172.21.15.96:0/1850936334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f6700 msgr2=0x7f3668107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f3666ffd700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f6700 0x7f3668107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f3666ffd700 1 -- 172.21.15.96:0/1850936334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658005040 con 0x7f36680f5460 2022-02-02T20:38:38.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f3666ffd700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7f365c00c790 tx=0x7f365c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f365c00e680 con 0x7f36680f5460 2022-02-02T20:38:38.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36681083b0 con 0x7f36680f5460 2022-02-02T20:38:38.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f365c00ec90 con 0x7f36680f5460 2022-02-02T20:38:38.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f365c012d00 con 0x7f36680f5460 2022-02-02T20:38:38.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.055+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3668108970 con 0x7f36680f5460 2022-02-02T20:38:38.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.056+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3668059100 con 0x7f36680f5460 2022-02-02T20:38:38.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.056+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f365c010070 con 0x7f36680f5460 2022-02-02T20:38:38.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.057+0000 7f364f7fe700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 0x7f36500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.057+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f365c081b30 con 0x7f36680f5460 2022-02-02T20:38:38.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.057+0000 7f36667fc700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 0x7f36500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.057+0000 7f36667fc700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 0x7f36500672e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f3658004e30 tx=0x7f3658009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.061+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f365c04fc30 con 0x7f36680f5460 2022-02-02T20:38:38.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.234+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f366805fd30 con 0x7f3650064e20 2022-02-02T20:38:38.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.243+0000 7f364f7fe700 1 -- 172.21.15.96:0/1850936334 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f366805fd30 con 0x7f3650064e20 2022-02-02T20:38:38.273 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:38:38.274 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 112m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:38:38.274 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 112m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:38:38.274 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 111m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:38:38.274 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 112m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:38:38.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 112m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:38:38.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 112m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:38:38.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 111m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:38:38.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 111m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:38:38.276 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 112m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:38:38.276 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 111m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:38:38.276 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 112m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:38:38.276 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 111m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:38:38.276 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 112m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:38:38.277 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 111m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:38:38.277 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 112m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:38:38.277 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 112m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:38:38.277 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 112m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:38:38.278 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 111m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:38:38.278 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 111m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:38:38.278 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 111m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:38:38.278 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 112m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:38:38.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 msgr2=0x7f36500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 0x7f36500672e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f3658004e30 tx=0x7f3658009b30).stop 2022-02-02T20:38:38.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 msgr2=0x7f3668106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7f365c00c790 tx=0x7f365c007d90).stop 2022-02-02T20:38:38.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 shutdown_connections 2022-02-02T20:38:38.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3650064e20 0x7f36500672e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36680f5460 0x7f3668106e30 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 --2- 172.21.15.96:0/1850936334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36680f6700 0x7f3668107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 >> 172.21.15.96:0/1850936334 conn(0x7f36680f0bc0 msgr2=0x7f366805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 shutdown_connections 2022-02-02T20:38:38.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.245+0000 7f366d401700 1 -- 172.21.15.96:0/1850936334 wait complete. 2022-02-02T20:38:38.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:37 smithi159 ceph-mon[69013]: pgmap v4096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:38.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.342+0000 7fe27359e700 1 -- 172.21.15.96:0/2257331712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740f9670 msgr2=0x7fe2740fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.342+0000 7fe27359e700 1 --2- 172.21.15.96:0/2257331712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740f9670 0x7fe2740fba60 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7fe268004660 tx=0x7fe268009b30).stop 2022-02-02T20:38:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- 172.21.15.96:0/2257331712 shutdown_connections 2022-02-02T20:38:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 --2- 172.21.15.96:0/2257331712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740f9670 0x7fe2740fba60 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 --2- 172.21.15.96:0/2257331712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740602b0 0x7fe2740f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- 172.21.15.96:0/2257331712 >> 172.21.15.96:0/2257331712 conn(0x7fe2740f0b30 msgr2=0x7fe2740f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- 172.21.15.96:0/2257331712 shutdown_connections 2022-02-02T20:38:38.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- 172.21.15.96:0/2257331712 wait complete. 2022-02-02T20:38:38.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 Processor -- start 2022-02-02T20:38:38.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- start start 2022-02-02T20:38:38.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740f9670 0x7fe274107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274107830 con 0x7fe2740602b0 2022-02-02T20:38:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274108040 con 0x7fe2740f9670 2022-02-02T20:38:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38278/0 (socket says 172.21.15.96:38278) 2022-02-02T20:38:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.343+0000 7fe27259c700 1 -- 172.21.15.96:0/505018170 learned_addr learned my addr 172.21.15.96:0/505018170 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe271d9b700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740f9670 0x7fe274107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27259c700 1 -- 172.21.15.96:0/505018170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740f9670 msgr2=0x7fe274107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27259c700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740f9670 0x7fe274107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27259c700 1 -- 172.21.15.96:0/505018170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268005040 con 0x7fe2740602b0 2022-02-02T20:38:38.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27259c700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7fe2640026d0 tx=0x7fe264009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2640079c0 con 0x7fe2740602b0 2022-02-02T20:38:38.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2741082c0 con 0x7fe2740602b0 2022-02-02T20:38:38.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe26400f040 con 0x7fe2740602b0 2022-02-02T20:38:38.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2640148b0 con 0x7fe2740602b0 2022-02-02T20:38:38.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.344+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe274108880 con 0x7fe2740602b0 2022-02-02T20:38:38.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.345+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274059100 con 0x7fe2740602b0 2022-02-02T20:38:38.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.346+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe264007b20 con 0x7fe2740602b0 2022-02-02T20:38:38.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.346+0000 7fe262ffd700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 0x7fe25c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.346+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2640819e0 con 0x7fe2740602b0 2022-02-02T20:38:38.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.346+0000 7fe271d9b700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 0x7fe25c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.347+0000 7fe271d9b700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 0x7fe25c0672e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe268004630 tx=0x7fe268009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.350+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe26404fae0 con 0x7fe2740602b0 2022-02-02T20:38:38.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.582+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2740fed70 con 0x7fe2740602b0 2022-02-02T20:38:38.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.582+0000 7fe262ffd700 1 -- 172.21.15.96:0/505018170 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe264053100 con 0x7fe2740602b0 2022-02-02T20:38:38.584 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:38:38.584 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:38:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:38:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:38:38.585 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:38:38.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:38.586 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:38:38.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:38:38.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:38.587 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:38:38.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:38:38.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:38:38.587 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:38:38.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:38:38.588 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:38:38.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:38:38.588 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:38:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 msgr2=0x7fe25c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 0x7fe25c0672e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe268004630 tx=0x7fe268009b30).stop 2022-02-02T20:38:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 msgr2=0x7fe274106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7fe2640026d0 tx=0x7fe264009de0).stop 2022-02-02T20:38:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 shutdown_connections 2022-02-02T20:38:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe25c064e20 0x7fe25c0672e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2740602b0 0x7fe274106d40 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 --2- 172.21.15.96:0/505018170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2740f9670 0x7fe274107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.584+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 >> 172.21.15.96:0/505018170 conn(0x7fe2740f0b30 msgr2=0x7fe2740f2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.585+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 shutdown_connections 2022-02-02T20:38:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.585+0000 7fe27359e700 1 -- 172.21.15.96:0/505018170 wait complete. 2022-02-02T20:38:38.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 -- 172.21.15.96:0/2292373326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 msgr2=0x7f924c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2292373326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c0f7c30 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f923c004660 tx=0x7f923c009b30).stop 2022-02-02T20:38:38.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 -- 172.21.15.96:0/2292373326 shutdown_connections 2022-02-02T20:38:38.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2292373326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c0f7c30 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2292373326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 0x7f924c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 -- 172.21.15.96:0/2292373326 >> 172.21.15.96:0/2292373326 conn(0x7f924c0f1cd0 msgr2=0x7f924c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.682+0000 7f9252c0e700 1 -- 172.21.15.96:0/2292373326 shutdown_connections 2022-02-02T20:38:38.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.683+0000 7f9252c0e700 1 -- 172.21.15.96:0/2292373326 wait complete. 2022-02-02T20:38:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.683+0000 7f9252c0e700 1 Processor -- start 2022-02-02T20:38:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.683+0000 7f9252c0e700 1 -- start start 2022-02-02T20:38:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9252c0e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 0x7f924c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9252c0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9252c0e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c1077e0 con 0x7f924c0f77d0 2022-02-02T20:38:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9252c0e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c107fe0 con 0x7f924c0f6530 2022-02-02T20:38:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38290/0 (socket says 172.21.15.96:38290) 2022-02-02T20:38:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 -- 172.21.15.96:0/2779472381 learned_addr learned my addr 172.21.15.96:0/2779472381 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:38:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9251c0c700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 0x7f924c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 -- 172.21.15.96:0/2779472381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 msgr2=0x7f924c106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 0x7f924c106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 -- 172.21.15.96:0/2779472381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c005040 con 0x7f924c0f77d0 2022-02-02T20:38:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f925140b700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7f923c009990 tx=0x7f923c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c018070 con 0x7f924c0f77d0 2022-02-02T20:38:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c108260 con 0x7f924c0f77d0 2022-02-02T20:38:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.684+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f923c007ba0 con 0x7f924c0f77d0 2022-02-02T20:38:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.685+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c01c3c0 con 0x7f924c0f77d0 2022-02-02T20:38:38.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.685+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c1087c0 con 0x7f924c0f77d0 2022-02-02T20:38:38.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.685+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c059100 con 0x7f924c0f77d0 2022-02-02T20:38:38.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.686+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f923c01d420 con 0x7f924c0f77d0 2022-02-02T20:38:38.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.686+0000 7f92427fc700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 0x7f92380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:38:38.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.687+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f923c0836b0 con 0x7f924c0f77d0 2022-02-02T20:38:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.687+0000 7f9251c0c700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 0x7f92380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:38:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.687+0000 7f9251c0c700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 0x7f92380672e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f924c0f7630 tx=0x7f924800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:38:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.691+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f923c055240 con 0x7f924c0f77d0 2022-02-02T20:38:38.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.895+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f924c0fecf0 con 0x7f924c0f77d0 2022-02-02T20:38:38.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.896+0000 7f92427fc700 1 -- 172.21.15.96:0/2779472381 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f923c054e30 con 0x7f924c0f77d0 2022-02-02T20:38:38.898 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:38:38.898 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:38:38.898 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:38:38.898 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:38:38.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:38.899 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:38:38.899 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:38:38.900 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:38:38.900 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:38:38.900 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:38:38.901 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:38:38.901 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:38:38.901 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:38:38.901 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:38:38.902 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:38:38.902 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:38:38.902 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:38:38.902 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:38:38.903 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:38:38.903 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:38:38.903 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:38:38.903 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:38:38.903 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:38:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:38:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:38:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:38:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:38:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:38:38.905 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:38:38.905 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:38:38.905 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:38:38.905 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:38.907 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:38.907 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:38:38.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 msgr2=0x7f92380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 0x7f92380672e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f924c0f7630 tx=0x7f924800b040).stop 2022-02-02T20:38:38.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 msgr2=0x7f924c107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:38:38.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7f923c009990 tx=0x7f923c009b30).stop 2022-02-02T20:38:38.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 shutdown_connections 2022-02-02T20:38:38.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9238064e20 0x7f92380672e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f924c0f6530 0x7f924c106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 --2- 172.21.15.96:0/2779472381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c0f77d0 0x7f924c107230 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:38:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 >> 172.21.15.96:0/2779472381 conn(0x7f924c0f1cd0 msgr2=0x7f924c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:38:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 shutdown_connections 2022-02-02T20:38:38.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:38:38.898+0000 7f9252c0e700 1 -- 172.21.15.96:0/2779472381 wait complete. 2022-02-02T20:38:38.912 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:38:39.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:38 smithi096 ceph-mon[101353]: from='client.38308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:39.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:38 smithi096 ceph-mon[101353]: from='client.38312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:39.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/505018170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:38:39.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:38 smithi159 ceph-mon[69013]: from='client.38308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:39.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:38 smithi159 ceph-mon[69013]: from='client.38312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:38:39.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/505018170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:38:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2779472381' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:38:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:39 smithi159 ceph-mon[69013]: pgmap v4097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2779472381' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:38:40.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:39 smithi096 ceph-mon[101353]: pgmap v4097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:42 smithi159 ceph-mon[69013]: pgmap v4098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:42 smithi096 ceph-mon[101353]: pgmap v4098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:44 smithi159 ceph-mon[69013]: pgmap v4099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:44 smithi096 ceph-mon[101353]: pgmap v4099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:46 smithi159 ceph-mon[69013]: pgmap v4100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:46 smithi096 ceph-mon[101353]: pgmap v4100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:47 smithi159 ceph-mon[69013]: pgmap v4101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:47 smithi096 ceph-mon[101353]: pgmap v4101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:50 smithi159 ceph-mon[69013]: pgmap v4102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:50 smithi096 ceph-mon[101353]: pgmap v4102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:52 smithi159 ceph-mon[69013]: pgmap v4103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:52 smithi096 ceph-mon[101353]: pgmap v4103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:54 smithi159 ceph-mon[69013]: pgmap v4104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:54 smithi096 ceph-mon[101353]: pgmap v4104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:56 smithi159 ceph-mon[69013]: pgmap v4105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:56 smithi096 ceph-mon[101353]: pgmap v4105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:38:57 smithi159 ceph-mon[69013]: pgmap v4106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:38:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:38:57 smithi096 ceph-mon[101353]: pgmap v4106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:00 smithi159 ceph-mon[69013]: pgmap v4107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:00 smithi096 ceph-mon[101353]: pgmap v4107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:02 smithi159 ceph-mon[69013]: pgmap v4108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:02 smithi096 ceph-mon[101353]: pgmap v4108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:04 smithi159 ceph-mon[69013]: pgmap v4109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:04 smithi096 ceph-mon[101353]: pgmap v4109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:06 smithi159 ceph-mon[69013]: pgmap v4110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:06 smithi096 ceph-mon[101353]: pgmap v4110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:07 smithi159 ceph-mon[69013]: pgmap v4111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:07 smithi096 ceph-mon[101353]: pgmap v4111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 -- 172.21.15.96:0/1982145272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f55c0 msgr2=0x7f02ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 --2- 172.21.15.96:0/1982145272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f59e0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f029c004660 tx=0x7f029c009b30).stop 2022-02-02T20:39:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 -- 172.21.15.96:0/1982145272 shutdown_connections 2022-02-02T20:39:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 --2- 172.21.15.96:0/1982145272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 --2- 172.21.15.96:0/1982145272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f59e0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 -- 172.21.15.96:0/1982145272 >> 172.21.15.96:0/1982145272 conn(0x7f02ac0f0d40 msgr2=0x7f02ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 -- 172.21.15.96:0/1982145272 shutdown_connections 2022-02-02T20:39:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.006+0000 7f02b3888700 1 -- 172.21.15.96:0/1982145272 wait complete. 2022-02-02T20:39:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 Processor -- start 2022-02-02T20:39:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 -- start start 2022-02-02T20:39:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0f8100 con 0x7f02ac0f6860 2022-02-02T20:39:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b3888700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0f8240 con 0x7f02ac0f55c0 2022-02-02T20:39:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b0e23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b0e23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38310/0 (socket says 172.21.15.96:38310) 2022-02-02T20:39:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b0e23700 1 -- 172.21.15.96:0/662385463 learned_addr learned my addr 172.21.15.96:0/662385463 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.007+0000 7f02b1624700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b0e23700 1 -- 172.21.15.96:0/662385463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f55c0 msgr2=0x7f02ac0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b0e23700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b0e23700 1 -- 172.21.15.96:0/662385463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c005040 con 0x7f02ac0f6860 2022-02-02T20:39:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b0e23700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f02a80026d0 tx=0x7f02a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a80079c0 con 0x7f02ac0f6860 2022-02-02T20:39:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0f8520 con 0x7f02ac0f6860 2022-02-02T20:39:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02a800f040 con 0x7f02ac0f6860 2022-02-02T20:39:09.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a80148b0 con 0x7f02ac0f6860 2022-02-02T20:39:09.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.008+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac10efa0 con 0x7f02ac0f6860 2022-02-02T20:39:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.009+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac045ad0 con 0x7f02ac0f6860 2022-02-02T20:39:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.010+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f02a8007b20 con 0x7f02ac0f6860 2022-02-02T20:39:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.010+0000 7f02a1ffb700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.010+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02a80819a0 con 0x7f02ac0f6860 2022-02-02T20:39:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.010+0000 7f02b1624700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.011+0000 7f02b1624700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f029c013690 tx=0x7f029c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.014+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02a804faa0 con 0x7f02ac0f6860 2022-02-02T20:39:09.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.192+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ac0faca0 con 0x7f0298064dd0 2022-02-02T20:39:09.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.193+0000 7f02a1ffb700 1 -- 172.21.15.96:0/662385463 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02ac0faca0 con 0x7f0298064dd0 2022-02-02T20:39:09.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 msgr2=0x7f0298067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f029c013690 tx=0x7f029c009b30).stop 2022-02-02T20:39:09.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 msgr2=0x7f02ac0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f02a80026d0 tx=0x7f02a8009de0).stop 2022-02-02T20:39:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 shutdown_connections 2022-02-02T20:39:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0298064dd0 0x7f0298067290 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac0f55c0 0x7f02ac0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 --2- 172.21.15.96:0/662385463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0f6860 0x7f02ac0f7ba0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 >> 172.21.15.96:0/662385463 conn(0x7f02ac0f0d40 msgr2=0x7f02ac05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 shutdown_connections 2022-02-02T20:39:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.195+0000 7f02b3888700 1 -- 172.21.15.96:0/662385463 wait complete. 2022-02-02T20:39:09.208 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:39:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 -- 172.21.15.96:0/4037114907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 msgr2=0x7f73700fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 --2- 172.21.15.96:0/4037114907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700fbae0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7f7364004660 tx=0x7f7364009b30).stop 2022-02-02T20:39:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 -- 172.21.15.96:0/4037114907 shutdown_connections 2022-02-02T20:39:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 --2- 172.21.15.96:0/4037114907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700fbae0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 --2- 172.21.15.96:0/4037114907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 0x7f73700f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 -- 172.21.15.96:0/4037114907 >> 172.21.15.96:0/4037114907 conn(0x7f73700f0b90 msgr2=0x7f73700f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 -- 172.21.15.96:0/4037114907 shutdown_connections 2022-02-02T20:39:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.293+0000 7f7374a3d700 1 -- 172.21.15.96:0/4037114907 wait complete. 2022-02-02T20:39:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 Processor -- start 2022-02-02T20:39:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 -- start start 2022-02-02T20:39:09.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 0x7f73700f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73700f5570 con 0x7f73700f9690 2022-02-02T20:39:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f7374a3d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73700f56b0 con 0x7f7370060310 2022-02-02T20:39:09.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f736effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f736effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38318/0 (socket says 172.21.15.96:38318) 2022-02-02T20:39:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.294+0000 7f736effd700 1 -- 172.21.15.96:0/1520475920 learned_addr learned my addr 172.21.15.96:0/1520475920 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f736f7fe700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 0x7f73700f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f736effd700 1 -- 172.21.15.96:0/1520475920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 msgr2=0x7f73700f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f736effd700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 0x7f73700f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f736effd700 1 -- 172.21.15.96:0/1520475920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364005040 con 0x7f73700f9690 2022-02-02T20:39:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f736effd700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f7364004f60 tx=0x7f7364009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7364018070 con 0x7f73700f9690 2022-02-02T20:39:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73700f5930 con 0x7f73700f9690 2022-02-02T20:39:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7364009770 con 0x7f73700f9690 2022-02-02T20:39:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f736401c3c0 con 0x7f73700f9690 2022-02-02T20:39:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.295+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73700f5e90 con 0x7f73700f9690 2022-02-02T20:39:09.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.296+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7370045ad0 con 0x7f73700f9690 2022-02-02T20:39:09.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.296+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f736401d420 con 0x7f73700f9690 2022-02-02T20:39:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.297+0000 7f7357fff700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 0x7f73580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.297+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7364083890 con 0x7f73700f9690 2022-02-02T20:39:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.297+0000 7f736f7fe700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 0x7f73580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.297+0000 7f736f7fe700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 0x7f73580672e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f7360007fd0 tx=0x7f7360009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.301+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7364051a50 con 0x7f73700f9690 2022-02-02T20:39:09.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.476+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73700008d0 con 0x7f7358064e20 2022-02-02T20:39:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.485+0000 7f7357fff700 1 -- 172.21.15.96:0/1520475920 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f73700008d0 con 0x7f7358064e20 2022-02-02T20:39:09.488 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:39:09.489 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 113m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:39:09.489 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 113m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:39:09.489 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 111m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:39:09.489 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 113m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:39:09.490 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 113m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:39:09.490 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 113m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:39:09.490 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 111m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:39:09.490 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 111m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:39:09.490 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 113m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:39:09.491 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 111m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:39:09.491 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 113m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:39:09.491 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 111m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:39:09.491 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 113m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:39:09.492 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 111m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:39:09.492 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 113m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:39:09.492 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 113m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:39:09.492 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 113m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:39:09.492 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 111m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:39:09.493 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 111m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:39:09.493 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 111m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:39:09.493 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 113m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:39:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 msgr2=0x7f73580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 0x7f73580672e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f7360007fd0 tx=0x7f7360009040).stop 2022-02-02T20:39:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 msgr2=0x7f73700f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f7364004f60 tx=0x7f7364009b30).stop 2022-02-02T20:39:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 shutdown_connections 2022-02-02T20:39:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7358064e20 0x7f73580672e0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7370060310 0x7f73700f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 --2- 172.21.15.96:0/1520475920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73700f9690 0x7f73700f5010 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.487+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 >> 172.21.15.96:0/1520475920 conn(0x7f73700f0b90 msgr2=0x7f73700f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.488+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 shutdown_connections 2022-02-02T20:39:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.488+0000 7f7374a3d700 1 -- 172.21.15.96:0/1520475920 wait complete. 2022-02-02T20:39:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 -- 172.21.15.96:0/195161697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 msgr2=0x7fa6b40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 --2- 172.21.15.96:0/195161697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b40f6b30 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7fa6a8004660 tx=0x7fa6a8009b30).stop 2022-02-02T20:39:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 -- 172.21.15.96:0/195161697 shutdown_connections 2022-02-02T20:39:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 --2- 172.21.15.96:0/195161697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b40f6b30 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 --2- 172.21.15.96:0/195161697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 0x7fa6b40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.584+0000 7fa6b359e700 1 -- 172.21.15.96:0/195161697 >> 172.21.15.96:0/195161697 conn(0x7fa6b40f0b90 msgr2=0x7fa6b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 -- 172.21.15.96:0/195161697 shutdown_connections 2022-02-02T20:39:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 -- 172.21.15.96:0/195161697 wait complete. 2022-02-02T20:39:09.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 Processor -- start 2022-02-02T20:39:09.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 -- start start 2022-02-02T20:39:09.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 0x7fa6b4106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4107890 con 0x7fa6b40f66d0 2022-02-02T20:39:09.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b41080d0 con 0x7fa6b40f5430 2022-02-02T20:39:09.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38328/0 (socket says 172.21.15.96:38328) 2022-02-02T20:39:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.585+0000 7fa6b1d9b700 1 -- 172.21.15.96:0/4214989455 learned_addr learned my addr 172.21.15.96:0/4214989455 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b259c700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 0x7fa6b4106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b1d9b700 1 -- 172.21.15.96:0/4214989455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 msgr2=0x7fa6b4106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b1d9b700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 0x7fa6b4106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b1d9b700 1 -- 172.21.15.96:0/4214989455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8005040 con 0x7fa6b40f66d0 2022-02-02T20:39:09.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b1d9b700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7fa6a8009990 tx=0x7fa6a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a8018070 con 0x7fa6b40f66d0 2022-02-02T20:39:09.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa6a8007ba0 con 0x7fa6b40f66d0 2022-02-02T20:39:09.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b4108350 con 0x7fa6b40f66d0 2022-02-02T20:39:09.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a801c3c0 con 0x7fa6b40f66d0 2022-02-02T20:39:09.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.586+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b4108830 con 0x7fa6b40f66d0 2022-02-02T20:39:09.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.587+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b4059100 con 0x7fa6b40f66d0 2022-02-02T20:39:09.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.587+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa6a801d420 con 0x7fa6b40f66d0 2022-02-02T20:39:09.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.588+0000 7fa6a2ffd700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 0x7fa69c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.588+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa6a80836a0 con 0x7fa6b40f66d0 2022-02-02T20:39:09.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.588+0000 7fa6b259c700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 0x7fa69c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.588+0000 7fa6b259c700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 0x7fa69c0672e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fa6b4107b60 tx=0x7fa6a400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.592+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa6a8051860 con 0x7fa6b40f66d0 2022-02-02T20:39:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.822+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6b410d310 con 0x7fa6b40f66d0 2022-02-02T20:39:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.822+0000 7fa6a2ffd700 1 -- 172.21.15.96:0/4214989455 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa6a8054e80 con 0x7fa6b40f66d0 2022-02-02T20:39:09.825 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:39:09.826 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:39:09.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:39:09.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:09.826 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:39:09.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:39:09.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:09.827 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:39:09.827 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:39:09.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:09.828 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:39:09.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:39:09.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:09.828 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:39:09.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:39:09.829 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:39:09.829 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:39:09.829 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:39:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 msgr2=0x7fa69c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 0x7fa69c0672e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fa6b4107b60 tx=0x7fa6a400b040).stop 2022-02-02T20:39:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 msgr2=0x7fa6b4107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7fa6a8009990 tx=0x7fa6a8009b30).stop 2022-02-02T20:39:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 shutdown_connections 2022-02-02T20:39:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa69c064e20 0x7fa69c0672e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6b40f5430 0x7fa6b4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 --2- 172.21.15.96:0/4214989455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6b40f66d0 0x7fa6b4107290 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 >> 172.21.15.96:0/4214989455 conn(0x7fa6b40f0b90 msgr2=0x7fa6b405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 shutdown_connections 2022-02-02T20:39:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.824+0000 7fa6b359e700 1 -- 172.21.15.96:0/4214989455 wait complete. 2022-02-02T20:39:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 -- 172.21.15.96:0/2689410306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f66d0 msgr2=0x7f94800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 --2- 172.21.15.96:0/2689410306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f66d0 0x7f94800f6b30 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f9470004660 tx=0x7f9470009b30).stop 2022-02-02T20:39:09.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 -- 172.21.15.96:0/2689410306 shutdown_connections 2022-02-02T20:39:09.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 --2- 172.21.15.96:0/2689410306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f66d0 0x7f94800f6b30 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 --2- 172.21.15.96:0/2689410306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f5430 0x7f94800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 -- 172.21.15.96:0/2689410306 >> 172.21.15.96:0/2689410306 conn(0x7f94800f0b90 msgr2=0x7f94800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:09.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 -- 172.21.15.96:0/2689410306 shutdown_connections 2022-02-02T20:39:09.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.921+0000 7f9486a03700 1 -- 172.21.15.96:0/2689410306 wait complete. 2022-02-02T20:39:09.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 Processor -- start 2022-02-02T20:39:09.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 -- start start 2022-02-02T20:39:09.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f66d0 0x7f948010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800603e0 con 0x7f94800f5430 2022-02-02T20:39:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.922+0000 7f9486a03700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480060520 con 0x7f94800f66d0 2022-02-02T20:39:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38336/0 (socket says 172.21.15.96:38336) 2022-02-02T20:39:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 -- 172.21.15.96:0/571372410 learned_addr learned my addr 172.21.15.96:0/571372410 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485200700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f66d0 0x7f948010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 -- 172.21.15.96:0/571372410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f66d0 msgr2=0x7f948010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f66d0 0x7f948010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:09.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 -- 172.21.15.96:0/571372410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470005040 con 0x7f94800f5430 2022-02-02T20:39:09.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9485a01700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f947c00c530 tx=0x7f947c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c00f650 con 0x7f94800f5430 2022-02-02T20:39:09.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948010c4d0 con 0x7f94800f5430 2022-02-02T20:39:09.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f947c00fc60 con 0x7f94800f5430 2022-02-02T20:39:09.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c012cb0 con 0x7f94800f5430 2022-02-02T20:39:09.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.923+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948010ca90 con 0x7f94800f5430 2022-02-02T20:39:09.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.924+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9480045ad0 con 0x7f94800f5430 2022-02-02T20:39:09.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.925+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f947c019030 con 0x7f94800f5430 2022-02-02T20:39:09.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.926+0000 7f94767fc700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 0x7f946c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:09.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.926+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f947c081650 con 0x7f94800f5430 2022-02-02T20:39:09.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.926+0000 7f9485200700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 0x7f946c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:09.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.926+0000 7f9485200700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 0x7f946c0672e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f9470004630 tx=0x7f9470009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:09.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:09.930+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f947c04f800 con 0x7f94800f5430 2022-02-02T20:39:10.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.130+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94800fdd70 con 0x7f94800f5430 2022-02-02T20:39:10.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.130+0000 7f94767fc700 1 -- 172.21.15.96:0/571372410 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f947c017070 con 0x7f94800f5430 2022-02-02T20:39:10.134 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:39:10.134 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:39:10.134 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:39:10.134 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:39:10.135 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:10.135 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:39:10.135 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:39:10.135 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:39:10.136 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:39:10.136 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:39:10.136 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:39:10.136 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:39:10.137 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:39:10.137 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:39:10.137 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:39:10.137 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:39:10.138 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:39:10.138 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:39:10.138 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:39:10.138 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:39:10.139 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:39:10.139 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:39:10.139 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:39:10.139 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:39:10.139 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:39:10.140 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:39:10.140 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:39:10.140 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:39:10.140 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:39:10.141 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:39:10.141 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:39:10.141 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:39:10.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:10.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:10.142 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:39:10.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:10.142 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:10.143 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:10.143 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:10.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 msgr2=0x7f946c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:10.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 0x7f946c0672e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f9470004630 tx=0x7f9470009b30).stop 2022-02-02T20:39:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 msgr2=0x7f9480109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f947c00c530 tx=0x7f947c007e10).stop 2022-02-02T20:39:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 shutdown_connections 2022-02-02T20:39:10.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f946c064e20 0x7f946c0672e0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94800f5430 0x7f9480109a20 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 --2- 172.21.15.96:0/571372410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94800f66d0 0x7f948010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 >> 172.21.15.96:0/571372410 conn(0x7f94800f0b90 msgr2=0x7f94800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:10.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 shutdown_connections 2022-02-02T20:39:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:10.132+0000 7f9486a03700 1 -- 172.21.15.96:0/571372410 wait complete. 2022-02-02T20:39:10.147 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:39:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:10 smithi159 ceph-mon[69013]: from='client.38324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:10 smithi159 ceph-mon[69013]: pgmap v4112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:10 smithi159 ceph-mon[69013]: from='client.38328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4214989455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:39:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/571372410' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:39:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:10 smithi096 ceph-mon[101353]: from='client.38324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:10 smithi096 ceph-mon[101353]: pgmap v4112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:10 smithi096 ceph-mon[101353]: from='client.38328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4214989455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:39:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/571372410' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:39:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:12 smithi159 ceph-mon[69013]: pgmap v4113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:12 smithi096 ceph-mon[101353]: pgmap v4113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:14 smithi159 ceph-mon[69013]: pgmap v4114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:14 smithi096 ceph-mon[101353]: pgmap v4114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:16 smithi159 ceph-mon[69013]: pgmap v4115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:16 smithi096 ceph-mon[101353]: pgmap v4115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:17 smithi159 ceph-mon[69013]: pgmap v4116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:17 smithi096 ceph-mon[101353]: pgmap v4116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:20 smithi159 ceph-mon[69013]: pgmap v4117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:20 smithi096 ceph-mon[101353]: pgmap v4117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:22 smithi159 ceph-mon[69013]: pgmap v4118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:22 smithi096 ceph-mon[101353]: pgmap v4118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:24 smithi159 ceph-mon[69013]: pgmap v4119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:24 smithi096 ceph-mon[101353]: pgmap v4119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:26 smithi159 ceph-mon[69013]: pgmap v4120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:26 smithi096 ceph-mon[101353]: pgmap v4120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:27 smithi159 ceph-mon[69013]: pgmap v4121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:39:28.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:39:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:27 smithi096 ceph-mon[101353]: pgmap v4121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:39:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:39:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:30 smithi159 ceph-mon[69013]: pgmap v4122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:30 smithi096 ceph-mon[101353]: pgmap v4122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:32 smithi159 ceph-mon[69013]: pgmap v4123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:32 smithi096 ceph-mon[101353]: pgmap v4123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:34 smithi159 ceph-mon[69013]: pgmap v4124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:34 smithi096 ceph-mon[101353]: pgmap v4124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:36 smithi159 ceph-mon[69013]: pgmap v4125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:36 smithi096 ceph-mon[101353]: pgmap v4125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:37 smithi159 ceph-mon[69013]: pgmap v4126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:37 smithi096 ceph-mon[101353]: pgmap v4126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:40.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.243+0000 7f9de4c4f700 1 -- 172.21.15.96:0/820373059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 msgr2=0x7f9de00f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.243+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/820373059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de00f5180 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f9dd0004660 tx=0x7f9dd0009b30).stop 2022-02-02T20:39:40.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- 172.21.15.96:0/820373059 shutdown_connections 2022-02-02T20:39:40.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/820373059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 0x7f9de00f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/820373059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de00f5180 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- 172.21.15.96:0/820373059 >> 172.21.15.96:0/820373059 conn(0x7f9de00f04c0 msgr2=0x7f9de00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:40.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- 172.21.15.96:0/820373059 shutdown_connections 2022-02-02T20:39:40.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- 172.21.15.96:0/820373059 wait complete. 2022-02-02T20:39:40.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 Processor -- start 2022-02-02T20:39:40.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- start start 2022-02-02T20:39:40.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 0x7f9de010c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00f7fd0 con 0x7f9de00f4d60 2022-02-02T20:39:40.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.244+0000 7f9de4c4f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00f8110 con 0x7f9de00f5f60 2022-02-02T20:39:40.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38356/0 (socket says 172.21.15.96:38356) 2022-02-02T20:39:40.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 -- 172.21.15.96:0/69123367 learned_addr learned my addr 172.21.15.96:0/69123367 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:40.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dddd9b700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 0x7f9de010c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 -- 172.21.15.96:0/69123367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 msgr2=0x7f9de010c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 0x7f9de010c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 -- 172.21.15.96:0/69123367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0005040 con 0x7f9de00f4d60 2022-02-02T20:39:40.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dde59c700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f9dd0009990 tx=0x7f9dd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd0007ba0 con 0x7f9de00f4d60 2022-02-02T20:39:40.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de0105af0 con 0x7f9de00f4d60 2022-02-02T20:39:40.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9dd0007d00 con 0x7f9de00f4d60 2022-02-02T20:39:40.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0106050 con 0x7f9de00f4d60 2022-02-02T20:39:40.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.245+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd00226a0 con 0x7f9de00f4d60 2022-02-02T20:39:40.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.246+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4004fa0 con 0x7f9de00f4d60 2022-02-02T20:39:40.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.247+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9dd0029060 con 0x7f9de00f4d60 2022-02-02T20:39:40.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.247+0000 7f9dceffd700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 0x7f9dc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.247+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9dd0087410 con 0x7f9de00f4d60 2022-02-02T20:39:40.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.247+0000 7f9dddd9b700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 0x7f9dc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.248+0000 7f9dddd9b700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 0x7f9dc8067290 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f9dd40096c0 tx=0x7f9dd4009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.252+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9dd00555d0 con 0x7f9de00f4d60 2022-02-02T20:39:40.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.429+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dc4000bc0 con 0x7f9dc8064dd0 2022-02-02T20:39:40.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.430+0000 7f9dceffd700 1 -- 172.21.15.96:0/69123367 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9dc4000bc0 con 0x7f9dc8064dd0 2022-02-02T20:39:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 msgr2=0x7f9dc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 0x7f9dc8067290 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f9dd40096c0 tx=0x7f9dd4009be0).stop 2022-02-02T20:39:40.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 msgr2=0x7f9de0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f9dd0009990 tx=0x7f9dd0009b30).stop 2022-02-02T20:39:40.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 shutdown_connections 2022-02-02T20:39:40.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc8064dd0 0x7f9dc8067290 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9de00f4d60 0x7f9de0109d10 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 --2- 172.21.15.96:0/69123367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00f5f60 0x7f9de010c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 >> 172.21.15.96:0/69123367 conn(0x7f9de00f04c0 msgr2=0x7f9de00fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:40.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 shutdown_connections 2022-02-02T20:39:40.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.432+0000 7f9de4c4f700 1 -- 172.21.15.96:0/69123367 wait complete. 2022-02-02T20:39:40.443 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:39:40.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 -- 172.21.15.96:0/1389815257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 msgr2=0x7efbfc0f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 --2- 172.21.15.96:0/1389815257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f63e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7efbec004660 tx=0x7efbec009b30).stop 2022-02-02T20:39:40.532 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:40 smithi096 ceph-mon[101353]: pgmap v4127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:40.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 -- 172.21.15.96:0/1389815257 shutdown_connections 2022-02-02T20:39:40.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 --2- 172.21.15.96:0/1389815257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f63e0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 --2- 172.21.15.96:0/1389815257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 0x7efbfc0f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 -- 172.21.15.96:0/1389815257 >> 172.21.15.96:0/1389815257 conn(0x7efbfc0f04c0 msgr2=0x7efbfc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:40.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 -- 172.21.15.96:0/1389815257 shutdown_connections 2022-02-02T20:39:40.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.530+0000 7efc0184b700 1 -- 172.21.15.96:0/1389815257 wait complete. 2022-02-02T20:39:40.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 Processor -- start 2022-02-02T20:39:40.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 -- start start 2022-02-02T20:39:40.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 0x7efbfc0f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0f89a0 con 0x7efbfc0f5f60 2022-02-02T20:39:40.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efc0184b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0f8ae0 con 0x7efbfc0f4d60 2022-02-02T20:39:40.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efbfa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efbfa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38366/0 (socket says 172.21.15.96:38366) 2022-02-02T20:39:40.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efbfa7fc700 1 -- 172.21.15.96:0/2698549448 learned_addr learned my addr 172.21.15.96:0/2698549448 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:40.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efbfaffd700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 0x7efbfc0f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.531+0000 7efbfa7fc700 1 -- 172.21.15.96:0/2698549448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 msgr2=0x7efbfc0f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbfa7fc700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 0x7efbfc0f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbfa7fc700 1 -- 172.21.15.96:0/2698549448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec005040 con 0x7efbfc0f5f60 2022-02-02T20:39:40.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbfa7fc700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7efbec009990 tx=0x7efbec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec018070 con 0x7efbfc0f5f60 2022-02-02T20:39:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efbec007ba0 con 0x7efbfc0f5f60 2022-02-02T20:39:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc0f8d60 con 0x7efbfc0f5f60 2022-02-02T20:39:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec01c620 con 0x7efbfc0f5f60 2022-02-02T20:39:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.532+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc0f92c0 con 0x7efbfc0f5f60 2022-02-02T20:39:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.533+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc045ad0 con 0x7efbfc0f5f60 2022-02-02T20:39:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.534+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efbec01c8e0 con 0x7efbfc0f5f60 2022-02-02T20:39:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.534+0000 7efbe37fe700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 0x7efbe4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.534+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efbec083850 con 0x7efbfc0f5f60 2022-02-02T20:39:40.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.534+0000 7efbfaffd700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 0x7efbe4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.535+0000 7efbfaffd700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 0x7efbe4067290 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7efbf00041d0 tx=0x7efbf0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.538+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efbec051950 con 0x7efbfc0f5f60 2022-02-02T20:39:40.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.712+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efbfc0fd5b0 con 0x7efbe4064dd0 2022-02-02T20:39:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.722+0000 7efbe37fe700 1 -- 172.21.15.96:0/2698549448 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efbfc0fd5b0 con 0x7efbe4064dd0 2022-02-02T20:39:40.723 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:39:40.723 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 113m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:39:40.724 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 113m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:39:40.724 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 112m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:39:40.724 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 113m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:39:40.724 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 113m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:39:40.724 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 113m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:39:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 112m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:39:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 112m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:39:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 113m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:39:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 112m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:39:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 113m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:39:40.726 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 112m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:39:40.726 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 113m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:39:40.726 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 112m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:39:40.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 113m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:39:40.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 113m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:39:40.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 113m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:39:40.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 112m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:39:40.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 112m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:39:40.728 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 112m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:39:40.728 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 113m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:39:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 msgr2=0x7efbe4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 0x7efbe4067290 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7efbf00041d0 tx=0x7efbf0009040).stop 2022-02-02T20:39:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 msgr2=0x7efbfc0f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7efbec009990 tx=0x7efbec009b30).stop 2022-02-02T20:39:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 shutdown_connections 2022-02-02T20:39:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efbe4064dd0 0x7efbe4067290 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbfc0f4d60 0x7efbfc0f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 --2- 172.21.15.96:0/2698549448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efbfc0f5f60 0x7efbfc0f8440 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 >> 172.21.15.96:0/2698549448 conn(0x7efbfc0f04c0 msgr2=0x7efbfc0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:40.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 shutdown_connections 2022-02-02T20:39:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.724+0000 7efc0184b700 1 -- 172.21.15.96:0/2698549448 wait complete. 2022-02-02T20:39:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:40 smithi159 ceph-mon[69013]: pgmap v4127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:40.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- 172.21.15.96:0/1947899898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 msgr2=0x7feae00f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 --2- 172.21.15.96:0/1947899898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae00f4dc0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7fead4004660 tx=0x7fead4009b30).stop 2022-02-02T20:39:40.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- 172.21.15.96:0/1947899898 shutdown_connections 2022-02-02T20:39:40.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 --2- 172.21.15.96:0/1947899898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae00f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 --2- 172.21.15.96:0/1947899898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae00f4dc0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- 172.21.15.96:0/1947899898 >> 172.21.15.96:0/1947899898 conn(0x7feae00f04c0 msgr2=0x7feae00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- 172.21.15.96:0/1947899898 shutdown_connections 2022-02-02T20:39:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- 172.21.15.96:0/1947899898 wait complete. 2022-02-02T20:39:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 Processor -- start 2022-02-02T20:39:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.822+0000 7feae6c67700 1 -- start start 2022-02-02T20:39:40.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae6c67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae6c67700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae6c67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0107a50 con 0x7feae00f49a0 2022-02-02T20:39:40.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae6c67700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0107b90 con 0x7feae00f5340 2022-02-02T20:39:40.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38374/0 (socket says 172.21.15.96:38374) 2022-02-02T20:39:40.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 -- 172.21.15.96:0/3474630853 learned_addr learned my addr 172.21.15.96:0/3474630853 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:40.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feadffff700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 -- 172.21.15.96:0/3474630853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 msgr2=0x7feae01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:40.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:40.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 -- 172.21.15.96:0/3474630853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4005040 con 0x7feae00f49a0 2022-02-02T20:39:40.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feadffff700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:39:40.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feae4a03700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fead4013a70 tx=0x7fead4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.823+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead4018070 con 0x7feae00f49a0 2022-02-02T20:39:40.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.824+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fead40097d0 con 0x7feae00f49a0 2022-02-02T20:39:40.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.824+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae01084d0 con 0x7feae00f49a0 2022-02-02T20:39:40.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.824+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead401c3c0 con 0x7feae00f49a0 2022-02-02T20:39:40.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.824+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0108a30 con 0x7feae00f49a0 2022-02-02T20:39:40.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.824+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae0045ad0 con 0x7feae00f49a0 2022-02-02T20:39:40.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.825+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fead4007ba0 con 0x7feae00f49a0 2022-02-02T20:39:40.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.825+0000 7feadd7fa700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 0x7fead0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:40.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.825+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fead4083730 con 0x7feae00f49a0 2022-02-02T20:39:40.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.825+0000 7feadffff700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 0x7fead0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:40.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.826+0000 7feadffff700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 0x7fead0067290 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7feae00f5780 tx=0x7feacc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:40.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:40.830+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fead4055320 con 0x7feae00f49a0 2022-02-02T20:39:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.057+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feae00feff0 con 0x7feae00f49a0 2022-02-02T20:39:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.058+0000 7feadd7fa700 1 -- 172.21.15.96:0/3474630853 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fead4054f10 con 0x7feae00f49a0 2022-02-02T20:39:41.059 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:39:41.060 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:39:41.060 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:39:41.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:41.060 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:39:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:39:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:39:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:39:41.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:41.062 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:39:41.062 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:39:41.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:39:41.062 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:39:41.063 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:39:41.063 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:39:41.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:39:41.063 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:39:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 msgr2=0x7fead0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 0x7fead0067290 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7feae00f5780 tx=0x7feacc009be0).stop 2022-02-02T20:39:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 msgr2=0x7feae0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fead4013a70 tx=0x7fead4009b30).stop 2022-02-02T20:39:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 shutdown_connections 2022-02-02T20:39:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead0064dd0 0x7fead0067290 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feae00f49a0 0x7feae0106fb0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 --2- 172.21.15.96:0/3474630853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae00f5340 0x7feae01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 >> 172.21.15.96:0/3474630853 conn(0x7feae00f04c0 msgr2=0x7feae00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.059+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 shutdown_connections 2022-02-02T20:39:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.060+0000 7feae6c67700 1 -- 172.21.15.96:0/3474630853 wait complete. 2022-02-02T20:39:41.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 -- 172.21.15.96:0/2707632459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f64c0 msgr2=0x7fcbf40f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 --2- 172.21.15.96:0/2707632459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f64c0 0x7fcbf40f6940 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fcbe8004660 tx=0x7fcbe8009b30).stop 2022-02-02T20:39:41.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 -- 172.21.15.96:0/2707632459 shutdown_connections 2022-02-02T20:39:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 --2- 172.21.15.96:0/2707632459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f64c0 0x7fcbf40f6940 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 --2- 172.21.15.96:0/2707632459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf40f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 -- 172.21.15.96:0/2707632459 >> 172.21.15.96:0/2707632459 conn(0x7fcbf40f0540 msgr2=0x7fcbf40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 -- 172.21.15.96:0/2707632459 shutdown_connections 2022-02-02T20:39:41.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.156+0000 7fcbf9374700 1 -- 172.21.15.96:0/2707632459 wait complete. 2022-02-02T20:39:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 Processor -- start 2022-02-02T20:39:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 -- start start 2022-02-02T20:39:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 0x7fcbf41063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4106970 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf9374700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4107170 con 0x7fcbf40f64c0 2022-02-02T20:39:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.157+0000 7fcbf2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38384/0 (socket says 172.21.15.96:38384) 2022-02-02T20:39:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 -- 172.21.15.96:0/647700685 learned_addr learned my addr 172.21.15.96:0/647700685 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:39:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf27fc700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 0x7fcbf41063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 -- 172.21.15.96:0/647700685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 msgr2=0x7fcbf41063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 0x7fcbf41063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 -- 172.21.15.96:0/647700685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8005040 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf27fc700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 0x7fcbf41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:39:41.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf2ffd700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7fcbe400c530 tx=0x7fcbe4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:41.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe400f650 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcbe400fc60 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf4107450 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf4107a10 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.158+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe4012d20 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.159+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4004fa0 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.160+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcbe4019030 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.160+0000 7fcbdb7fe700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:39:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.160+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcbe4081680 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.160+0000 7fcbf27fc700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:39:41.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.161+0000 7fcbf27fc700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fcbe8004e30 tx=0x7fcbe8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:39:41.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.164+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcbe4053200 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.367+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcbd4005e80 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.368+0000 7fcbdb7fe700 1 -- 172.21.15.96:0/647700685 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcbe4052df0 con 0x7fcbf40f5bb0 2022-02-02T20:39:41.370 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:39:41.370 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:39:41.370 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:39:41.371 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:39:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:41.371 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:39:41.372 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:39:41.372 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:39:41.372 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:39:41.372 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:39:41.373 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:39:41.373 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:39:41.373 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:39:41.373 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:39:41.373 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:39:41.374 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:39:41.374 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:39:41.374 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:39:41.374 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:39:41.375 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:39:41.375 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:39:41.375 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:39:41.375 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:39:41.375 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:39:41.376 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:39:41.376 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:39:41.376 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:39:41.376 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:39:41.377 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:39:41.377 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:39:41.377 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:39:41.377 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:39:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:41.378 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:39:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:39:41.378 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:41.378 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:41.379 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:39:41.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 msgr2=0x7fcbdc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fcbe8004e30 tx=0x7fcbe8009b30).stop 2022-02-02T20:39:41.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 msgr2=0x7fcbf4105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:39:41.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7fcbe400c530 tx=0x7fcbe4007e10).stop 2022-02-02T20:39:41.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 shutdown_connections 2022-02-02T20:39:41.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbdc064dd0 0x7fcbdc067290 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf40f5bb0 0x7fcbf4105ed0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 --2- 172.21.15.96:0/647700685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbf40f64c0 0x7fcbf41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:39:41.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 >> 172.21.15.96:0/647700685 conn(0x7fcbf40f0540 msgr2=0x7fcbf40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:39:41.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 shutdown_connections 2022-02-02T20:39:41.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:39:41.371+0000 7fcbf9374700 1 -- 172.21.15.96:0/647700685 wait complete. 2022-02-02T20:39:41.383 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:39:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:41 smithi096 ceph-mon[101353]: from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:41.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:41 smithi096 ceph-mon[101353]: from='client.38344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3474630853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:39:41.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/647700685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:39:41.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:41 smithi159 ceph-mon[69013]: from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:41.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:41 smithi159 ceph-mon[69013]: from='client.38344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:39:41.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3474630853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:39:41.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/647700685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:39:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:42 smithi159 ceph-mon[69013]: pgmap v4128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:42 smithi096 ceph-mon[101353]: pgmap v4128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:44 smithi159 ceph-mon[69013]: pgmap v4129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:44 smithi096 ceph-mon[101353]: pgmap v4129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:46 smithi159 ceph-mon[69013]: pgmap v4130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:46 smithi096 ceph-mon[101353]: pgmap v4130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:47 smithi159 ceph-mon[69013]: pgmap v4131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:47 smithi096 ceph-mon[101353]: pgmap v4131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:50 smithi159 ceph-mon[69013]: pgmap v4132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:50 smithi096 ceph-mon[101353]: pgmap v4132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:52 smithi159 ceph-mon[69013]: pgmap v4133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:52 smithi096 ceph-mon[101353]: pgmap v4133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:54 smithi159 ceph-mon[69013]: pgmap v4134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:54 smithi096 ceph-mon[101353]: pgmap v4134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:56 smithi159 ceph-mon[69013]: pgmap v4135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:56 smithi096 ceph-mon[101353]: pgmap v4135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:39:57 smithi159 ceph-mon[69013]: pgmap v4136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:39:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:39:57 smithi096 ceph-mon[101353]: pgmap v4136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:00 smithi159 ceph-mon[69013]: pgmap v4137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:00.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:40:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:00 smithi096 ceph-mon[101353]: pgmap v4137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:40:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:02 smithi159 ceph-mon[69013]: pgmap v4138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:02 smithi096 ceph-mon[101353]: pgmap v4138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:04 smithi159 ceph-mon[69013]: pgmap v4139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:04 smithi096 ceph-mon[101353]: pgmap v4139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:06 smithi159 ceph-mon[69013]: pgmap v4140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:06 smithi096 ceph-mon[101353]: pgmap v4140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:07 smithi159 ceph-mon[69013]: pgmap v4141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:07 smithi096 ceph-mon[101353]: pgmap v4141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:10 smithi159 ceph-mon[69013]: pgmap v4142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:10.943 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:10 smithi096 ceph-mon[101353]: pgmap v4142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:11.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- 172.21.15.96:0/2076955767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 msgr2=0x7f99f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2076955767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f00f6b00 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f99ec004660 tx=0x7f99ec009b30).stop 2022-02-02T20:40:11.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- 172.21.15.96:0/2076955767 shutdown_connections 2022-02-02T20:40:11.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2076955767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 0x7f99f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2076955767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f00f6b00 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- 172.21.15.96:0/2076955767 >> 172.21.15.96:0/2076955767 conn(0x7f99f00f1e40 msgr2=0x7f99f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:11.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- 172.21.15.96:0/2076955767 shutdown_connections 2022-02-02T20:40:11.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- 172.21.15.96:0/2076955767 wait complete. 2022-02-02T20:40:11.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 Processor -- start 2022-02-02T20:40:11.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.482+0000 7f99f7e51700 1 -- start start 2022-02-02T20:40:11.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f7e51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f7e51700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 0x7f99f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f7e51700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006a380 con 0x7f99f00f66e0 2022-02-02T20:40:11.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f7e51700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006a4c0 con 0x7f99f00f7980 2022-02-02T20:40:11.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38406/0 (socket says 172.21.15.96:38406) 2022-02-02T20:40:11.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 -- 172.21.15.96:0/2620691247 learned_addr learned my addr 172.21.15.96:0/2620691247 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:11.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f53ec700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 0x7f99f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 -- 172.21.15.96:0/2620691247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 msgr2=0x7f99f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 0x7f99f0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 -- 172.21.15.96:0/2620691247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec005040 con 0x7f99f00f66e0 2022-02-02T20:40:11.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f5bed700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7f99ec013a70 tx=0x7f99ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:11.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99ec018070 con 0x7f99f00f66e0 2022-02-02T20:40:11.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99ec0097d0 con 0x7f99f00f66e0 2022-02-02T20:40:11.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f006a740 con 0x7f99f00f66e0 2022-02-02T20:40:11.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.483+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99ec01de80 con 0x7f99f00f66e0 2022-02-02T20:40:11.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.484+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f006aca0 con 0x7f99f00f66e0 2022-02-02T20:40:11.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.485+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0045ad0 con 0x7f99f00f66e0 2022-02-02T20:40:11.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.485+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99ec007ba0 con 0x7f99f00f66e0 2022-02-02T20:40:11.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.485+0000 7f99e67fc700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 0x7f99dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.485+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99ec083660 con 0x7f99f00f66e0 2022-02-02T20:40:11.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.486+0000 7f99f53ec700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 0x7f99dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.486+0000 7f99f53ec700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 0x7f99dc067290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f99e0004e20 tx=0x7f99e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:11.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.490+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99ec051760 con 0x7f99f00f66e0 2022-02-02T20:40:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.669+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f0057f10 con 0x7f99dc064dd0 2022-02-02T20:40:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.670+0000 7f99e67fc700 1 -- 172.21.15.96:0/2620691247 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f99f0057f10 con 0x7f99dc064dd0 2022-02-02T20:40:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 msgr2=0x7f99dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 0x7f99dc067290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f99e0004e20 tx=0x7f99e000b040).stop 2022-02-02T20:40:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 msgr2=0x7f99f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7f99ec013a70 tx=0x7f99ec009b30).stop 2022-02-02T20:40:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 shutdown_connections 2022-02-02T20:40:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99dc064dd0 0x7f99dc067290 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99f00f66e0 0x7f99f006b9a0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 --2- 172.21.15.96:0/2620691247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f00f7980 0x7f99f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 >> 172.21.15.96:0/2620691247 conn(0x7f99f00f1e40 msgr2=0x7f99f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 shutdown_connections 2022-02-02T20:40:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.672+0000 7f99f7e51700 1 -- 172.21.15.96:0/2620691247 wait complete. 2022-02-02T20:40:11.683 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:40:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 -- 172.21.15.96:0/3276383414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f6860 msgr2=0x7f10800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 --2- 172.21.15.96:0/3276383414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f6860 0x7f10800f6cc0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f1074004660 tx=0x7f1074009b30).stop 2022-02-02T20:40:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 -- 172.21.15.96:0/3276383414 shutdown_connections 2022-02-02T20:40:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 --2- 172.21.15.96:0/3276383414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f6860 0x7f10800f6cc0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 --2- 172.21.15.96:0/3276383414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f55c0 0x7f10800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 -- 172.21.15.96:0/3276383414 >> 172.21.15.96:0/3276383414 conn(0x7f10800f0d40 msgr2=0x7f10800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 -- 172.21.15.96:0/3276383414 shutdown_connections 2022-02-02T20:40:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.769+0000 7f108651f700 1 -- 172.21.15.96:0/3276383414 wait complete. 2022-02-02T20:40:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 Processor -- start 2022-02-02T20:40:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 -- start start 2022-02-02T20:40:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 0x7f1080109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1080109c20 con 0x7f10800f55c0 2022-02-02T20:40:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f108651f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1080109d60 con 0x7f10800f6860 2022-02-02T20:40:11.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f107ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f107ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38414/0 (socket says 172.21.15.96:38414) 2022-02-02T20:40:11.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.770+0000 7f107ffff700 1 -- 172.21.15.96:0/220480164 learned_addr learned my addr 172.21.15.96:0/220480164 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:11.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107f7fe700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 0x7f1080109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107ffff700 1 -- 172.21.15.96:0/220480164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 msgr2=0x7f1080109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107ffff700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 0x7f1080109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107ffff700 1 -- 172.21.15.96:0/220480164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074005040 con 0x7f10800f55c0 2022-02-02T20:40:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107f7fe700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 0x7f1080109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:40:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107ffff700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f107000c530 tx=0x7f1070007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:11.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f107000f650 con 0x7f10800f55c0 2022-02-02T20:40:11.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f107000fc60 con 0x7f10800f55c0 2022-02-02T20:40:11.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108010a700 con 0x7f10800f55c0 2022-02-02T20:40:11.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1070012d20 con 0x7f10800f55c0 2022-02-02T20:40:11.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.771+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108010acc0 con 0x7f10800f55c0 2022-02-02T20:40:11.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.772+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1080045ad0 con 0x7f10800f55c0 2022-02-02T20:40:11.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.773+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1070019030 con 0x7f10800f55c0 2022-02-02T20:40:11.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.773+0000 7f107cff9700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 0x7f1068067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:11.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.773+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10700816b0 con 0x7f10800f55c0 2022-02-02T20:40:11.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.773+0000 7f107f7fe700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 0x7f1068067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:11.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.774+0000 7f107f7fe700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 0x7f1068067290 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1074004e30 tx=0x7f1074009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:11.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.777+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10700487d0 con 0x7f10800f55c0 2022-02-02T20:40:11.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.952+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10800faaa0 con 0x7f1068064dd0 2022-02-02T20:40:11.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.961+0000 7f107cff9700 1 -- 172.21.15.96:0/220480164 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f10800faaa0 con 0x7f1068064dd0 2022-02-02T20:40:11.963 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:40:11.963 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 114m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:40:11.964 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 114m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:40:11.964 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 112m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:40:11.964 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 114m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:40:11.964 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 114m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:40:11.965 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 114m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:40:11.965 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 112m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:40:11.965 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 112m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:40:11.965 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 114m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:40:11.965 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 112m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:40:11.966 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 114m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:40:11.966 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 112m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:40:11.966 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 114m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:40:11.966 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 112m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:40:11.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 114m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:40:11.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 114m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:40:11.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 114m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:40:11.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 112m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:40:11.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 112m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:40:11.968 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 112m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:40:11.968 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 114m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:40:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.963+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 msgr2=0x7f1068067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.963+0000 7f108651f700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 0x7f1068067290 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1074004e30 tx=0x7f1074009b30).stop 2022-02-02T20:40:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.963+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 msgr2=0x7f1080109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.963+0000 7f108651f700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f107000c530 tx=0x7f1070007e10).stop 2022-02-02T20:40:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.963+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 shutdown_connections 2022-02-02T20:40:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1068064dd0 0x7f1068067290 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10800f55c0 0x7f1080109180 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 --2- 172.21.15.96:0/220480164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10800f6860 0x7f1080109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 >> 172.21.15.96:0/220480164 conn(0x7f10800f0d40 msgr2=0x7f108005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 shutdown_connections 2022-02-02T20:40:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:11.964+0000 7f108651f700 1 -- 172.21.15.96:0/220480164 wait complete. 2022-02-02T20:40:12.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 -- 172.21.15.96:0/603919651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f77d0 msgr2=0x7f09f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 --2- 172.21.15.96:0/603919651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f77d0 0x7f09f40f7c30 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f09e0004660 tx=0x7f09e0009b30).stop 2022-02-02T20:40:12.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 -- 172.21.15.96:0/603919651 shutdown_connections 2022-02-02T20:40:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 --2- 172.21.15.96:0/603919651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f77d0 0x7f09f40f7c30 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 --2- 172.21.15.96:0/603919651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f6530 0x7f09f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 -- 172.21.15.96:0/603919651 >> 172.21.15.96:0/603919651 conn(0x7f09f40f1c90 msgr2=0x7f09f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 -- 172.21.15.96:0/603919651 shutdown_connections 2022-02-02T20:40:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.060+0000 7f09f98cb700 1 -- 172.21.15.96:0/603919651 wait complete. 2022-02-02T20:40:12.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 Processor -- start 2022-02-02T20:40:12.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 -- start start 2022-02-02T20:40:12.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 0x7f09f4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4107880 con 0x7f09f40f6530 2022-02-02T20:40:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f98cb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4108090 con 0x7f09f40f77d0 2022-02-02T20:40:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f88c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f88c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38424/0 (socket says 172.21.15.96:38424) 2022-02-02T20:40:12.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.061+0000 7f09f88c9700 1 -- 172.21.15.96:0/4118259025 learned_addr learned my addr 172.21.15.96:0/4118259025 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:12.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f3fff700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 0x7f09f4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f88c9700 1 -- 172.21.15.96:0/4118259025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 msgr2=0x7f09f4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f88c9700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 0x7f09f4107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f88c9700 1 -- 172.21.15.96:0/4118259025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0005040 con 0x7f09f40f6530 2022-02-02T20:40:12.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f3fff700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 0x7f09f4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:40:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f88c9700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f09e8002700 tx=0x7f09e8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e8009320 con 0x7f09f40f6530 2022-02-02T20:40:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4108310 con 0x7f09f40f6530 2022-02-02T20:40:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09e800f040 con 0x7f09f40f6530 2022-02-02T20:40:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e8014900 con 0x7f09f40f6530 2022-02-02T20:40:12.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.062+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f41088d0 con 0x7f09f40f6530 2022-02-02T20:40:12.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.063+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4059100 con 0x7f09f40f6530 2022-02-02T20:40:12.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.063+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09e8009480 con 0x7f09f40f6530 2022-02-02T20:40:12.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.064+0000 7f09f17fa700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 0x7f09e40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.064+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f09e8081cc0 con 0x7f09f40f6530 2022-02-02T20:40:12.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.064+0000 7f09f3fff700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 0x7f09e40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.064+0000 7f09f3fff700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 0x7f09e40672e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f09e0004630 tx=0x7f09e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:12.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.068+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09e804fe80 con 0x7f09f40f6530 2022-02-02T20:40:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.299+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09f4045ad0 con 0x7f09f40f6530 2022-02-02T20:40:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.299+0000 7f09f17fa700 1 -- 172.21.15.96:0/4118259025 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f09e80534a0 con 0x7f09f40f6530 2022-02-02T20:40:12.301 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:40:12.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:40:12.302 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:40:12.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:12.302 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:40:12.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:40:12.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:12.303 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:40:12.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:40:12.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:12.304 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:40:12.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:40:12.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:12.305 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:40:12.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:40:12.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:40:12.305 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:40:12.306 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:40:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 msgr2=0x7f09e40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 0x7f09e40672e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f09e0004630 tx=0x7f09e0009b30).stop 2022-02-02T20:40:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 msgr2=0x7f09f4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f09e8002700 tx=0x7f09e8009d80).stop 2022-02-02T20:40:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 shutdown_connections 2022-02-02T20:40:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09e4064e20 0x7f09e40672e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09f40f6530 0x7f09f4106d90 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 --2- 172.21.15.96:0/4118259025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09f40f77d0 0x7f09f4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 >> 172.21.15.96:0/4118259025 conn(0x7f09f40f1c90 msgr2=0x7f09f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:12.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 shutdown_connections 2022-02-02T20:40:12.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.301+0000 7f09f98cb700 1 -- 172.21.15.96:0/4118259025 wait complete. 2022-02-02T20:40:12.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 -- 172.21.15.96:0/1621586133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280f55c0 msgr2=0x7f7c280f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/1621586133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280f55c0 0x7f7c280f59e0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f7c18004660 tx=0x7f7c18009b30).stop 2022-02-02T20:40:12.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 -- 172.21.15.96:0/1621586133 shutdown_connections 2022-02-02T20:40:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/1621586133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 0x7f7c280f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/1621586133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280f55c0 0x7f7c280f59e0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 -- 172.21.15.96:0/1621586133 >> 172.21.15.96:0/1621586133 conn(0x7f7c280f0de0 msgr2=0x7f7c280f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 -- 172.21.15.96:0/1621586133 shutdown_connections 2022-02-02T20:40:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.402+0000 7f7c2e27f700 1 -- 172.21.15.96:0/1621586133 wait complete. 2022-02-02T20:40:12.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 Processor -- start 2022-02-02T20:40:12.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 -- start start 2022-02-02T20:40:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 0x7f7c28109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2810c7c0 con 0x7f7c280603f0 2022-02-02T20:40:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c2e27f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2810c900 con 0x7f7c280f5ed0 2022-02-02T20:40:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38436/0 (socket says 172.21.15.96:38436) 2022-02-02T20:40:12.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 -- 172.21.15.96:0/436423975 learned_addr learned my addr 172.21.15.96:0/436423975 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:12.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c27fff700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 0x7f7c28109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 -- 172.21.15.96:0/436423975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 msgr2=0x7f7c28109d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 0x7f7c28109d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.403+0000 7f7c277fe700 1 -- 172.21.15.96:0/436423975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18005040 con 0x7f7c280603f0 2022-02-02T20:40:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c277fe700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f7c1c00e7f0 tx=0x7f7c1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1c0092e0 con 0x7f7c280603f0 2022-02-02T20:40:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c1c00f040 con 0x7f7c280603f0 2022-02-02T20:40:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2810cbe0 con 0x7f7c280603f0 2022-02-02T20:40:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1c014750 con 0x7f7c280603f0 2022-02-02T20:40:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.404+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2810d1a0 con 0x7f7c280603f0 2022-02-02T20:40:12.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.405+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28045ad0 con 0x7f7c280603f0 2022-02-02T20:40:12.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.405+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c1c01b030 con 0x7f7c280603f0 2022-02-02T20:40:12.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.405+0000 7f7c24ff9700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 0x7f7c10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:12.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.406+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7c1c081750 con 0x7f7c280603f0 2022-02-02T20:40:12.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.406+0000 7f7c27fff700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 0x7f7c10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:12.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.406+0000 7f7c27fff700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 0x7f7c10067290 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f7c18004630 tx=0x7f7c18009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:12.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.410+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c1c04f900 con 0x7f7c280603f0 2022-02-02T20:40:12.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.610+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7c280fdf30 con 0x7f7c280603f0 2022-02-02T20:40:12.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.610+0000 7f7c24ff9700 1 -- 172.21.15.96:0/436423975 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7c1c019070 con 0x7f7c280603f0 2022-02-02T20:40:12.612 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:40:12.613 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:40:12.613 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:40:12.613 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:40:12.613 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:12.614 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:40:12.614 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:40:12.614 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:40:12.614 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:40:12.615 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:40:12.615 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:40:12.615 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:40:12.615 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:40:12.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:40:12.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:40:12.616 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:40:12.616 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:40:12.616 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:40:12.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:40:12.617 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:40:12.617 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:40:12.617 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:40:12.617 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:40:12.618 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:40:12.618 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:40:12.618 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:40:12.618 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:40:12.619 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:40:12.619 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:40:12.619 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:40:12.619 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:40:12.620 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:40:12.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:12.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:12.620 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:40:12.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:12.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:12.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:12.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:12.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 msgr2=0x7f7c10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 0x7f7c10067290 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f7c18004630 tx=0x7f7c18009b30).stop 2022-02-02T20:40:12.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 msgr2=0x7f7c2810c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:12.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f7c1c00e7f0 tx=0x7f7c1c00b040).stop 2022-02-02T20:40:12.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 shutdown_connections 2022-02-02T20:40:12.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c10064dd0 0x7f7c10067290 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c280f5ed0 0x7f7c28109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 --2- 172.21.15.96:0/436423975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c280603f0 0x7f7c2810c230 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:12.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 >> 172.21.15.96:0/436423975 conn(0x7f7c280f0de0 msgr2=0x7f7c280fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:12.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 shutdown_connections 2022-02-02T20:40:12.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:12.612+0000 7f7c2e27f700 1 -- 172.21.15.96:0/436423975 wait complete. 2022-02-02T20:40:12.625 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:40:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:12 smithi159 ceph-mon[69013]: pgmap v4143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:12 smithi159 ceph-mon[69013]: from='client.38356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:12.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4118259025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:40:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:12 smithi096 ceph-mon[101353]: pgmap v4143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:12 smithi096 ceph-mon[101353]: from='client.38356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4118259025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:40:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:13 smithi096 ceph-mon[101353]: from='client.38360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/436423975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:40:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:13 smithi159 ceph-mon[69013]: from='client.38360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/436423975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:40:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:14 smithi159 ceph-mon[69013]: pgmap v4144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:14 smithi096 ceph-mon[101353]: pgmap v4144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:16 smithi159 ceph-mon[69013]: pgmap v4145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:16 smithi096 ceph-mon[101353]: pgmap v4145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:17 smithi159 ceph-mon[69013]: pgmap v4146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:17 smithi096 ceph-mon[101353]: pgmap v4146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:20 smithi159 ceph-mon[69013]: pgmap v4147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:20 smithi096 ceph-mon[101353]: pgmap v4147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:22 smithi159 ceph-mon[69013]: pgmap v4148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:22 smithi096 ceph-mon[101353]: pgmap v4148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:24 smithi159 ceph-mon[69013]: pgmap v4149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:24 smithi096 ceph-mon[101353]: pgmap v4149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:26 smithi159 ceph-mon[69013]: pgmap v4150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:26 smithi096 ceph-mon[101353]: pgmap v4150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:27 smithi159 ceph-mon[69013]: pgmap v4151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:40:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:40:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:27 smithi096 ceph-mon[101353]: pgmap v4151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:40:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:40:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:30 smithi159 ceph-mon[69013]: pgmap v4152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:30 smithi096 ceph-mon[101353]: pgmap v4152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:32 smithi159 ceph-mon[69013]: pgmap v4153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:32 smithi096 ceph-mon[101353]: pgmap v4153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:34 smithi159 ceph-mon[69013]: pgmap v4154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:34 smithi096 ceph-mon[101353]: pgmap v4154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:36 smithi159 ceph-mon[69013]: pgmap v4155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:36 smithi096 ceph-mon[101353]: pgmap v4155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:37 smithi159 ceph-mon[69013]: pgmap v4156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:37 smithi096 ceph-mon[101353]: pgmap v4156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:40 smithi159 ceph-mon[69013]: pgmap v4157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:40 smithi096 ceph-mon[101353]: pgmap v4157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:42.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 -- 172.21.15.96:0/578594625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 msgr2=0x7f39f00f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:42.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/578594625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f00f7fe0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7f39ec004660 tx=0x7f39ec009b30).stop 2022-02-02T20:40:42.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 -- 172.21.15.96:0/578594625 shutdown_connections 2022-02-02T20:40:42.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/578594625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f00f7fe0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/578594625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 0x7f39f00f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 -- 172.21.15.96:0/578594625 >> 172.21.15.96:0/578594625 conn(0x7f39f00f2020 msgr2=0x7f39f00f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:42.729 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:42 smithi096 ceph-mon[101353]: pgmap v4158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:42.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 -- 172.21.15.96:0/578594625 shutdown_connections 2022-02-02T20:40:42.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.722+0000 7f39f7c5f700 1 -- 172.21.15.96:0/578594625 wait complete. 2022-02-02T20:40:42.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 Processor -- start 2022-02-02T20:40:42.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 -- start start 2022-02-02T20:40:42.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 0x7f39f0107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:42.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:42.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0107c10 con 0x7f39f00f7b80 2022-02-02T20:40:42.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f7c5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0107d50 con 0x7f39f00f68e0 2022-02-02T20:40:42.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f51fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:42.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f51fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38454/0 (socket says 172.21.15.96:38454) 2022-02-02T20:40:42.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f51fa700 1 -- 172.21.15.96:0/3145988212 learned_addr learned my addr 172.21.15.96:0/3145988212 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:42.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.723+0000 7f39f59fb700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 0x7f39f0107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:42.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f51fa700 1 -- 172.21.15.96:0/3145988212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 msgr2=0x7f39f0107170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:42.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f51fa700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 0x7f39f0107170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f51fa700 1 -- 172.21.15.96:0/3145988212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec005040 con 0x7f39f00f7b80 2022-02-02T20:40:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f51fa700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f39ec009990 tx=0x7f39ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39ec018070 con 0x7f39f00f7b80 2022-02-02T20:40:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39ec007ba0 con 0x7f39f00f7b80 2022-02-02T20:40:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0108690 con 0x7f39f00f7b80 2022-02-02T20:40:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39ec01c620 con 0x7f39f00f7b80 2022-02-02T20:40:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.724+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f0108bf0 con 0x7f39f00f7b80 2022-02-02T20:40:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.725+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f0045ad0 con 0x7f39f00f7b80 2022-02-02T20:40:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.726+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f39ec01c890 con 0x7f39f00f7b80 2022-02-02T20:40:42.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.726+0000 7f39e67fc700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:42.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.726+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f39ec0837c0 con 0x7f39f00f7b80 2022-02-02T20:40:42.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.726+0000 7f39f59fb700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:42.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.726+0000 7f39f59fb700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f39f00f79e0 tx=0x7f39e0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:42.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.730+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39ec0552f0 con 0x7f39f00f7b80 2022-02-02T20:40:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:42 smithi159 ceph-mon[69013]: pgmap v4158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:42.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.909+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39f00ff0f0 con 0x7f39dc064dd0 2022-02-02T20:40:42.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.910+0000 7f39e67fc700 1 -- 172.21.15.96:0/3145988212 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f39f00ff0f0 con 0x7f39dc064dd0 2022-02-02T20:40:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 msgr2=0x7f39dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f39f00f79e0 tx=0x7f39e0009040).stop 2022-02-02T20:40:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 msgr2=0x7f39f0107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f39ec009990 tx=0x7f39ec009b30).stop 2022-02-02T20:40:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 shutdown_connections 2022-02-02T20:40:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f00f68e0 0x7f39f0107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 --2- 172.21.15.96:0/3145988212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f00f7b80 0x7f39f0107660 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 >> 172.21.15.96:0/3145988212 conn(0x7f39f00f2020 msgr2=0x7f39f00fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 shutdown_connections 2022-02-02T20:40:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:42.912+0000 7f39f7c5f700 1 -- 172.21.15.96:0/3145988212 wait complete. 2022-02-02T20:40:42.924 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:40:43.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 -- 172.21.15.96:0/715663232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 msgr2=0x7fe2dc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/715663232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc0f6b30 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7fe2c8004660 tx=0x7fe2c8009b30).stop 2022-02-02T20:40:43.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 -- 172.21.15.96:0/715663232 shutdown_connections 2022-02-02T20:40:43.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/715663232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc0f6b30 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/715663232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 -- 172.21.15.96:0/715663232 >> 172.21.15.96:0/715663232 conn(0x7fe2dc0f0b90 msgr2=0x7fe2dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 -- 172.21.15.96:0/715663232 shutdown_connections 2022-02-02T20:40:43.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.009+0000 7fe2e18c7700 1 -- 172.21.15.96:0/715663232 wait complete. 2022-02-02T20:40:43.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 Processor -- start 2022-02-02T20:40:43.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 -- start start 2022-02-02T20:40:43.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc10bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc060310 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.010+0000 7fe2e18c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc060450 con 0x7fe2dc0f5430 2022-02-02T20:40:43.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38464/0 (socket says 172.21.15.96:38464) 2022-02-02T20:40:43.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 -- 172.21.15.96:0/2524645401 learned_addr learned my addr 172.21.15.96:0/2524645401 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:43.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2e08c5700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc10bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 -- 172.21.15.96:0/2524645401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 msgr2=0x7fe2dc10bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc10bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 -- 172.21.15.96:0/2524645401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8005040 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2e08c5700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc10bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:40:43.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2dbfff700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7fe2c8009990 tx=0x7fe2c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c8018070 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc10e7d0 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2c8007ba0 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c801c3c0 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.011+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc10ebf0 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.012+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc045ad0 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.013+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2c801d420 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.013+0000 7fe2d97fa700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 0x7fe2cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.013+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2c8083720 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.013+0000 7fe2e08c5700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 0x7fe2cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.014+0000 7fe2e08c5700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 0x7fe2cc0672e0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fe2d0009fd0 tx=0x7fe2d000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.017+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2c8051880 con 0x7fe2dc0f66d0 2022-02-02T20:40:43.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.193+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2dc057f10 con 0x7fe2cc064e20 2022-02-02T20:40:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.202+0000 7fe2d97fa700 1 -- 172.21.15.96:0/2524645401 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe2dc057f10 con 0x7fe2cc064e20 2022-02-02T20:40:43.205 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:40:43.205 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 114m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:40:43.205 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 114m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:40:43.206 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 113m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:40:43.206 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 114m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:40:43.206 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 114m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:40:43.206 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 114m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:40:43.207 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 113m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:40:43.207 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 113m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:40:43.207 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 114m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:40:43.207 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 113m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:40:43.208 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 114m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:40:43.208 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 113m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:40:43.208 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 114m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:40:43.209 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 113m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:40:43.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 114m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:40:43.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 114m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:40:43.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 114m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:40:43.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 113m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:40:43.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 113m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:40:43.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 113m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:40:43.210 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 114m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:40:43.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 msgr2=0x7fe2cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 0x7fe2cc0672e0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fe2d0009fd0 tx=0x7fe2d000b040).stop 2022-02-02T20:40:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 msgr2=0x7fe2dc10e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7fe2c8009990 tx=0x7fe2c8009b30).stop 2022-02-02T20:40:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 shutdown_connections 2022-02-02T20:40:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2cc064e20 0x7fe2cc0672e0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2dc0f5430 0x7fe2dc10bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 --2- 172.21.15.96:0/2524645401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2dc0f66d0 0x7fe2dc10e2e0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 >> 172.21.15.96:0/2524645401 conn(0x7fe2dc0f0b90 msgr2=0x7fe2dc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 shutdown_connections 2022-02-02T20:40:43.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.204+0000 7fe2e18c7700 1 -- 172.21.15.96:0/2524645401 wait complete. 2022-02-02T20:40:43.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 -- 172.21.15.96:0/1675319579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 msgr2=0x7f5b4c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 --2- 172.21.15.96:0/1675319579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c0f59e0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f5b40004660 tx=0x7f5b40009b30).stop 2022-02-02T20:40:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 -- 172.21.15.96:0/1675319579 shutdown_connections 2022-02-02T20:40:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 --2- 172.21.15.96:0/1675319579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 --2- 172.21.15.96:0/1675319579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c0f59e0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 -- 172.21.15.96:0/1675319579 >> 172.21.15.96:0/1675319579 conn(0x7f5b4c0f0d40 msgr2=0x7f5b4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 -- 172.21.15.96:0/1675319579 shutdown_connections 2022-02-02T20:40:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.301+0000 7f5b5141d700 1 -- 172.21.15.96:0/1675319579 wait complete. 2022-02-02T20:40:43.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 Processor -- start 2022-02-02T20:40:43.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 -- start start 2022-02-02T20:40:43.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c1057f0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b5141d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c105930 con 0x7f5b4c0f55c0 2022-02-02T20:40:43.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38474/0 (socket says 172.21.15.96:38474) 2022-02-02T20:40:43.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 -- 172.21.15.96:0/3632399682 learned_addr learned my addr 172.21.15.96:0/3632399682 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:43.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4affd700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 -- 172.21.15.96:0/3632399682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 msgr2=0x7f5b4c104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.302+0000 7f5b4a7fc700 1 -- 172.21.15.96:0/3632399682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40005040 con 0x7f5b4c0f6860 2022-02-02T20:40:43.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b4a7fc700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f5b3c00c790 tx=0x7f5b3c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c002590 con 0x7f5b4c0f6860 2022-02-02T20:40:43.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c1062a0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b3c002ba0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c013d90 con 0x7f5b4c0f6860 2022-02-02T20:40:43.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.303+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c106860 con 0x7f5b4c0f6860 2022-02-02T20:40:43.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.304+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c045ad0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.304+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b3c01a060 con 0x7f5b4c0f6860 2022-02-02T20:40:43.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.305+0000 7f5b337fe700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 0x7f5b34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.305+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5b3c081c30 con 0x7f5b4c0f6860 2022-02-02T20:40:43.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.305+0000 7f5b4affd700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 0x7f5b34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.305+0000 7f5b4affd700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 0x7f5b34067290 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f5b40013690 tx=0x7f5b40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.309+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b3c04fd30 con 0x7f5b4c0f6860 2022-02-02T20:40:43.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.542+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5b4c106ef0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.543+0000 7f5b337fe700 1 -- 172.21.15.96:0/3632399682 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5b3c0182e0 con 0x7f5b4c0f6860 2022-02-02T20:40:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:40:43.546 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:40:43.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:40:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:40:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:40:43.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:43.548 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:40:43.548 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:40:43.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:43.548 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:40:43.549 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:40:43.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:40:43.549 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:40:43.549 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:40:43.549 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:40:43.550 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:40:43.550 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:40:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 msgr2=0x7f5b34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 0x7f5b34067290 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f5b40013690 tx=0x7f5b40009b30).stop 2022-02-02T20:40:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 msgr2=0x7f5b4c1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f5b3c00c790 tx=0x7f5b3c007d70).stop 2022-02-02T20:40:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 shutdown_connections 2022-02-02T20:40:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b34064dd0 0x7f5b34067290 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 --2- 172.21.15.96:0/3632399682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c1051f0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 >> 172.21.15.96:0/3632399682 conn(0x7f5b4c0f0d40 msgr2=0x7f5b4c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 shutdown_connections 2022-02-02T20:40:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.545+0000 7f5b5141d700 1 -- 172.21.15.96:0/3632399682 wait complete. 2022-02-02T20:40:43.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.641+0000 7f9844d85700 1 -- 172.21.15.96:0/3308215499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6c60 msgr2=0x7f98400f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.641+0000 7f9844d85700 1 --2- 172.21.15.96:0/3308215499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6c60 0x7f98400f7080 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7f9830004660 tx=0x7f9830009b30).stop 2022-02-02T20:40:43.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- 172.21.15.96:0/3308215499 shutdown_connections 2022-02-02T20:40:43.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 --2- 172.21.15.96:0/3308215499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f5970 0x7f98400f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 --2- 172.21.15.96:0/3308215499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6c60 0x7f98400f7080 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- 172.21.15.96:0/3308215499 >> 172.21.15.96:0/3308215499 conn(0x7f98400f04c0 msgr2=0x7f98400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- 172.21.15.96:0/3308215499 shutdown_connections 2022-02-02T20:40:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- 172.21.15.96:0/3308215499 wait complete. 2022-02-02T20:40:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 Processor -- start 2022-02-02T20:40:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- start start 2022-02-02T20:40:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f6c60 0x7f98400691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400697e0 con 0x7f98400f5970 2022-02-02T20:40:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f9844d85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984010fa10 con 0x7f98400f6c60 2022-02-02T20:40:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f983e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f983e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38482/0 (socket says 172.21.15.96:38482) 2022-02-02T20:40:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.642+0000 7f983e59c700 1 -- 172.21.15.96:0/216501559 learned_addr learned my addr 172.21.15.96:0/216501559 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:40:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f983dd9b700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f6c60 0x7f98400691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f983e59c700 1 -- 172.21.15.96:0/216501559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f6c60 msgr2=0x7f98400691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f983e59c700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f6c60 0x7f98400691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f983e59c700 1 -- 172.21.15.96:0/216501559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830005040 con 0x7f98400f5970 2022-02-02T20:40:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f983e59c700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f9830009990 tx=0x7f9830009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9830018070 con 0x7f98400f5970 2022-02-02T20:40:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9830007ba0 con 0x7f98400f5970 2022-02-02T20:40:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983001de50 con 0x7f98400f5970 2022-02-02T20:40:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984010fc60 con 0x7f98400f5970 2022-02-02T20:40:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.643+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98401101c0 con 0x7f98400f5970 2022-02-02T20:40:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.644+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98400f4150 con 0x7f98400f5970 2022-02-02T20:40:43.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.644+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f983001d420 con 0x7f98400f5970 2022-02-02T20:40:43.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.645+0000 7f982effd700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 0x7f9828067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:40:43.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.645+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f98300835f0 con 0x7f98400f5970 2022-02-02T20:40:43.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.645+0000 7f983dd9b700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 0x7f9828067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:40:43.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.645+0000 7f983dd9b700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 0x7f9828067290 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f9840069b30 tx=0x7f983400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:40:43.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.649+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9830055120 con 0x7f98400f5970 2022-02-02T20:40:43.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.848+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98400fdee0 con 0x7f98400f5970 2022-02-02T20:40:43.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.848+0000 7f982effd700 1 -- 172.21.15.96:0/216501559 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9830054d10 con 0x7f98400f5970 2022-02-02T20:40:43.855 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:40:43.856 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:40:43.856 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:40:43.856 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:40:43.856 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:43.857 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:40:43.857 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:40:43.857 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:40:43.857 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:40:43.857 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:40:43.858 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:40:43.858 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:40:43.858 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:40:43.858 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:40:43.859 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:40:43.859 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:40:43.859 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:40:43.859 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:40:43.861 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:40:43.861 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:40:43.861 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:40:43.861 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:40:43.862 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:40:43.862 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:40:43.862 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:40:43.862 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:40:43.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:40:43.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:43.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:43.863 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:40:43.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:40:43.864 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:43.864 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:43.864 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:40:43.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 msgr2=0x7f9828067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 0x7f9828067290 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f9840069b30 tx=0x7f983400b040).stop 2022-02-02T20:40:43.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 msgr2=0x7f9840068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:40:43.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f9830009990 tx=0x7f9830009b30).stop 2022-02-02T20:40:43.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 shutdown_connections 2022-02-02T20:40:43.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9828064dd0 0x7f9828067290 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f5970 0x7f9840068cf0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 --2- 172.21.15.96:0/216501559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f6c60 0x7f98400691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:40:43.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.850+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 >> 172.21.15.96:0/216501559 conn(0x7f98400f04c0 msgr2=0x7f98400fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:40:43.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.851+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 shutdown_connections 2022-02-02T20:40:43.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:40:43.851+0000 7f9844d85700 1 -- 172.21.15.96:0/216501559 wait complete. 2022-02-02T20:40:43.867 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:40:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:44 smithi159 ceph-mon[69013]: from='client.38372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:44 smithi159 ceph-mon[69013]: from='client.38376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:44 smithi159 ceph-mon[69013]: pgmap v4159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3632399682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:40:44.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/216501559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:40:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:44 smithi096 ceph-mon[101353]: from='client.38372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:44 smithi096 ceph-mon[101353]: from='client.38376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:40:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:44 smithi096 ceph-mon[101353]: pgmap v4159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3632399682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:40:44.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/216501559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:40:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:46 smithi159 ceph-mon[69013]: pgmap v4160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:46 smithi096 ceph-mon[101353]: pgmap v4160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:47 smithi159 ceph-mon[69013]: pgmap v4161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:47 smithi096 ceph-mon[101353]: pgmap v4161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:50 smithi159 ceph-mon[69013]: pgmap v4162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:50 smithi096 ceph-mon[101353]: pgmap v4162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:52 smithi159 ceph-mon[69013]: pgmap v4163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:52 smithi096 ceph-mon[101353]: pgmap v4163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:54 smithi159 ceph-mon[69013]: pgmap v4164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:54 smithi096 ceph-mon[101353]: pgmap v4164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:56 smithi159 ceph-mon[69013]: pgmap v4165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:56 smithi096 ceph-mon[101353]: pgmap v4165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:40:57 smithi159 ceph-mon[69013]: pgmap v4166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:40:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:40:57 smithi096 ceph-mon[101353]: pgmap v4166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:00 smithi159 ceph-mon[69013]: pgmap v4167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:00 smithi096 ceph-mon[101353]: pgmap v4167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:02 smithi159 ceph-mon[69013]: pgmap v4168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:02 smithi096 ceph-mon[101353]: pgmap v4168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:04 smithi159 ceph-mon[69013]: pgmap v4169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:04 smithi096 ceph-mon[101353]: pgmap v4169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:06 smithi159 ceph-mon[69013]: pgmap v4170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:06 smithi096 ceph-mon[101353]: pgmap v4170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:07 smithi159 ceph-mon[69013]: pgmap v4171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:07 smithi096 ceph-mon[101353]: pgmap v4171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:10 smithi159 ceph-mon[69013]: pgmap v4172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:10 smithi096 ceph-mon[101353]: pgmap v4172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:12 smithi159 ceph-mon[69013]: pgmap v4173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:12 smithi096 ceph-mon[101353]: pgmap v4173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 -- 172.21.15.96:0/3992768231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 msgr2=0x7f58940f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 --2- 172.21.15.96:0/3992768231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f58940f6b30 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7f5880004660 tx=0x7f5880009b30).stop 2022-02-02T20:41:13.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 -- 172.21.15.96:0/3992768231 shutdown_connections 2022-02-02T20:41:13.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 --2- 172.21.15.96:0/3992768231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f58940f6b30 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:13.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 --2- 172.21.15.96:0/3992768231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f58940f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 -- 172.21.15.96:0/3992768231 >> 172.21.15.96:0/3992768231 conn(0x7f58940f0b90 msgr2=0x7f58940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 -- 172.21.15.96:0/3992768231 shutdown_connections 2022-02-02T20:41:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.960+0000 7f5899e6c700 1 -- 172.21.15.96:0/3992768231 wait complete. 2022-02-02T20:41:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 Processor -- start 2022-02-02T20:41:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 -- start start 2022-02-02T20:41:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f5894108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58941099e0 con 0x7f58940f66d0 2022-02-02T20:41:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5899e6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894109b20 con 0x7f58940f5430 2022-02-02T20:41:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.961+0000 7f5893fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38502/0 (socket says 172.21.15.96:38502) 2022-02-02T20:41:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 -- 172.21.15.96:0/790342473 learned_addr learned my addr 172.21.15.96:0/790342473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5898e6a700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f5894108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 -- 172.21.15.96:0/790342473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 msgr2=0x7f5894108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f5894108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 -- 172.21.15.96:0/790342473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880005040 con 0x7f58940f66d0 2022-02-02T20:41:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5898e6a700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f5894108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:41:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5893fff700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f5880009990 tx=0x7f5880009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5880018070 con 0x7f58940f66d0 2022-02-02T20:41:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589410a460 con 0x7f58940f66d0 2022-02-02T20:41:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5880007ca0 con 0x7f58940f66d0 2022-02-02T20:41:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588001c620 con 0x7f58940f66d0 2022-02-02T20:41:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.962+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589410a9c0 con 0x7f58940f66d0 2022-02-02T20:41:13.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.963+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5894045ad0 con 0x7f58940f66d0 2022-02-02T20:41:13.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.964+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f588001d960 con 0x7f58940f66d0 2022-02-02T20:41:13.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.964+0000 7f58917fa700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 0x7f58840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:13.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.964+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f58800837e0 con 0x7f58940f66d0 2022-02-02T20:41:13.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.964+0000 7f5898e6a700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 0x7f58840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:13.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.964+0000 7f5898e6a700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 0x7f58840672e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f58940f6530 tx=0x7f5888009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:13.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:13.968+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f58800553d0 con 0x7f58940f66d0 2022-02-02T20:41:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.147+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f589410b190 con 0x7f5884064e20 2022-02-02T20:41:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.148+0000 7f58917fa700 1 -- 172.21.15.96:0/790342473 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f589410b190 con 0x7f5884064e20 2022-02-02T20:41:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 msgr2=0x7f58840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 0x7f58840672e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f58940f6530 tx=0x7f5888009040).stop 2022-02-02T20:41:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 msgr2=0x7f5894109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f5880009990 tx=0x7f5880009b30).stop 2022-02-02T20:41:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 shutdown_connections 2022-02-02T20:41:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5884064e20 0x7f58840672e0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58940f5430 0x7f5894108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 --2- 172.21.15.96:0/790342473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58940f66d0 0x7f5894109430 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 >> 172.21.15.96:0/790342473 conn(0x7f58940f0b90 msgr2=0x7f589405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 shutdown_connections 2022-02-02T20:41:14.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.150+0000 7f5899e6c700 1 -- 172.21.15.96:0/790342473 wait complete. 2022-02-02T20:41:14.162 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:41:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 -- 172.21.15.96:0/3565009547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f55c0 msgr2=0x7f382c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 --2- 172.21.15.96:0/3565009547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f55c0 0x7f382c0f59e0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7f3820004660 tx=0x7f3820009b30).stop 2022-02-02T20:41:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 -- 172.21.15.96:0/3565009547 shutdown_connections 2022-02-02T20:41:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 --2- 172.21.15.96:0/3565009547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f6860 0x7f382c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 --2- 172.21.15.96:0/3565009547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f55c0 0x7f382c0f59e0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 -- 172.21.15.96:0/3565009547 >> 172.21.15.96:0/3565009547 conn(0x7f382c0f0d40 msgr2=0x7f382c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.248+0000 7f3831549700 1 -- 172.21.15.96:0/3565009547 shutdown_connections 2022-02-02T20:41:14.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 -- 172.21.15.96:0/3565009547 wait complete. 2022-02-02T20:41:14.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 Processor -- start 2022-02-02T20:41:14.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 -- start start 2022-02-02T20:41:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f55c0 0x7f382c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0603c0 con 0x7f382c0f6860 2022-02-02T20:41:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.249+0000 7f3831549700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c060500 con 0x7f382c0f55c0 2022-02-02T20:41:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38510/0 (socket says 172.21.15.96:38510) 2022-02-02T20:41:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 -- 172.21.15.96:0/4033175740 learned_addr learned my addr 172.21.15.96:0/4033175740 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382affd700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f55c0 0x7f382c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 -- 172.21.15.96:0/4033175740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f55c0 msgr2=0x7f382c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f55c0 0x7f382c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 -- 172.21.15.96:0/4033175740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820005040 con 0x7f382c0f6860 2022-02-02T20:41:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f382a7fc700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7f381c00c530 tx=0x7f381c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f381c00f650 con 0x7f382c0f6860 2022-02-02T20:41:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f381c00fc60 con 0x7f382c0f6860 2022-02-02T20:41:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c10c740 con 0x7f382c0f6860 2022-02-02T20:41:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f381c012c20 con 0x7f382c0f6860 2022-02-02T20:41:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.250+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c10ccd0 con 0x7f382c0f6860 2022-02-02T20:41:14.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.251+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c045ad0 con 0x7f382c0f6860 2022-02-02T20:41:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.252+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f381c010070 con 0x7f382c0f6860 2022-02-02T20:41:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.252+0000 7f38137fe700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 0x7f3814067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.253+0000 7f382affd700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 0x7f3814067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.253+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f381c081710 con 0x7f382c0f6860 2022-02-02T20:41:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.253+0000 7f382affd700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 0x7f3814067290 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f3820013690 tx=0x7f3820009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.257+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f381c04f810 con 0x7f382c0f6860 2022-02-02T20:41:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.431+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f382c057f10 con 0x7f3814064dd0 2022-02-02T20:41:14.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.440+0000 7f38137fe700 1 -- 172.21.15.96:0/4033175740 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f382c057f10 con 0x7f3814064dd0 2022-02-02T20:41:14.443 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:41:14.443 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 115m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:41:14.443 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 115m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:41:14.444 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 113m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:41:14.444 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 115m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:41:14.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 115m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:41:14.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 115m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:41:14.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 113m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:41:14.445 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 113m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:41:14.445 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 115m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:41:14.445 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 113m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:41:14.446 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 115m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:41:14.446 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 113m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:41:14.446 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 115m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:41:14.446 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 113m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:41:14.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 115m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:41:14.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 115m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:41:14.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 115m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:41:14.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 113m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:41:14.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 113m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:41:14.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 113m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:41:14.448 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 115m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:41:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 msgr2=0x7f3814067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 0x7f3814067290 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f3820013690 tx=0x7f3820009b30).stop 2022-02-02T20:41:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 msgr2=0x7f382c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7f381c00c530 tx=0x7f381c007e20).stop 2022-02-02T20:41:14.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 shutdown_connections 2022-02-02T20:41:14.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3814064dd0 0x7f3814067290 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f382c0f55c0 0x7f382c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 --2- 172.21.15.96:0/4033175740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0f6860 0x7f382c10c190 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 >> 172.21.15.96:0/4033175740 conn(0x7f382c0f0d40 msgr2=0x7f382c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 shutdown_connections 2022-02-02T20:41:14.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.442+0000 7f3831549700 1 -- 172.21.15.96:0/4033175740 wait complete. 2022-02-02T20:41:14.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 -- 172.21.15.96:0/4250474431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 msgr2=0x7f613c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 --2- 172.21.15.96:0/4250474431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c0f5850 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f6138004660 tx=0x7f6138009b30).stop 2022-02-02T20:41:14.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 -- 172.21.15.96:0/4250474431 shutdown_connections 2022-02-02T20:41:14.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 --2- 172.21.15.96:0/4250474431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:41:14.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 --2- 172.21.15.96:0/4250474431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c0f5850 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.538+0000 7f6142494700 1 -- 172.21.15.96:0/4250474431 >> 172.21.15.96:0/4250474431 conn(0x7f613c0f0b90 msgr2=0x7f613c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:14 smithi096 ceph-mon[101353]: pgmap v4174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:14.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.539+0000 7f6142494700 1 -- 172.21.15.96:0/4250474431 shutdown_connections 2022-02-02T20:41:14.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.539+0000 7f6142494700 1 -- 172.21.15.96:0/4250474431 wait complete. 2022-02-02T20:41:14.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.539+0000 7f6142494700 1 Processor -- start 2022-02-02T20:41:14.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6142494700 1 -- start start 2022-02-02T20:41:14.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6142494700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 0x7f613c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6142494700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6142494700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c060470 con 0x7f613c0f66d0 2022-02-02T20:41:14.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6142494700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0605b0 con 0x7f613c0f5430 2022-02-02T20:41:14.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38520/0 (socket says 172.21.15.96:38520) 2022-02-02T20:41:14.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 -- 172.21.15.96:0/3973363721 learned_addr learned my addr 172.21.15.96:0/3973363721 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:14.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6141492700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 0x7f613c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 -- 172.21.15.96:0/3973363721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 msgr2=0x7f613c109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 0x7f613c109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 -- 172.21.15.96:0/3973363721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138005040 con 0x7f613c0f66d0 2022-02-02T20:41:14.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.540+0000 7f6140c91700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f612c00b410 tx=0x7f612c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.541+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c0125f0 con 0x7f613c0f66d0 2022-02-02T20:41:14.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.541+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c10c610 con 0x7f613c0f66d0 2022-02-02T20:41:14.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.541+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f612c012c00 con 0x7f613c0f66d0 2022-02-02T20:41:14.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.541+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c002ae0 con 0x7f613c0f66d0 2022-02-02T20:41:14.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.541+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c10cba0 con 0x7f613c0f66d0 2022-02-02T20:41:14.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.542+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c059100 con 0x7f613c0f66d0 2022-02-02T20:41:14.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.542+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f612c00f030 con 0x7f613c0f66d0 2022-02-02T20:41:14.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.542+0000 7f6131ffb700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 0x7f61280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.543+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f612c081e70 con 0x7f613c0f66d0 2022-02-02T20:41:14.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.543+0000 7f6141492700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 0x7f61280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.543+0000 7f6141492700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 0x7f61280672e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f6138004e30 tx=0x7f6138009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.547+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f612c04ff70 con 0x7f613c0f66d0 2022-02-02T20:41:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:14 smithi159 ceph-mon[69013]: pgmap v4174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.777+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f613c045ad0 con 0x7f613c0f66d0 2022-02-02T20:41:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.778+0000 7f6131ffb700 1 -- 172.21.15.96:0/3973363721 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f612c053590 con 0x7f613c0f66d0 2022-02-02T20:41:14.781 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:41:14.781 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:41:14.781 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:41:14.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:14.781 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:41:14.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:41:14.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:14.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:41:14.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:41:14.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:14.783 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:41:14.783 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:41:14.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:14.784 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:41:14.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:41:14.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:41:14.784 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:41:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:41:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 msgr2=0x7f61280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 0x7f61280672e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f6138004e30 tx=0x7f6138009b30).stop 2022-02-02T20:41:14.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 msgr2=0x7f613c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f612c00b410 tx=0x7f612c006ef0).stop 2022-02-02T20:41:14.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 shutdown_connections 2022-02-02T20:41:14.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6128064e20 0x7f61280672e0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 0x7f613c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 --2- 172.21.15.96:0/3973363721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c10bfb0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 >> 172.21.15.96:0/3973363721 conn(0x7f613c0f0b90 msgr2=0x7f613c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 shutdown_connections 2022-02-02T20:41:14.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.780+0000 7f6142494700 1 -- 172.21.15.96:0/3973363721 wait complete. 2022-02-02T20:41:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 -- 172.21.15.96:0/2633025507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 msgr2=0x7fa7f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 --2- 172.21.15.96:0/2633025507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f00f7de0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7fa7e0004660 tx=0x7fa7e0009b30).stop 2022-02-02T20:41:14.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 -- 172.21.15.96:0/2633025507 shutdown_connections 2022-02-02T20:41:14.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 --2- 172.21.15.96:0/2633025507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f00f7de0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 --2- 172.21.15.96:0/2633025507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 0x7fa7f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 -- 172.21.15.96:0/2633025507 >> 172.21.15.96:0/2633025507 conn(0x7fa7f00f1e40 msgr2=0x7fa7f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 -- 172.21.15.96:0/2633025507 shutdown_connections 2022-02-02T20:41:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 -- 172.21.15.96:0/2633025507 wait complete. 2022-02-02T20:41:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.877+0000 7fa7f611f700 1 Processor -- start 2022-02-02T20:41:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7f611f700 1 -- start start 2022-02-02T20:41:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7f611f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 0x7fa7f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7f611f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7f611f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f006a380 con 0x7fa7f00f7980 2022-02-02T20:41:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7f611f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f006a4c0 con 0x7fa7f00f66e0 2022-02-02T20:41:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38528/0 (socket says 172.21.15.96:38528) 2022-02-02T20:41:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 -- 172.21.15.96:0/114385879 learned_addr learned my addr 172.21.15.96:0/114385879 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:14.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7ef7fe700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 0x7fa7f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 -- 172.21.15.96:0/114385879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 msgr2=0x7fa7f006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 0x7fa7f006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 -- 172.21.15.96:0/114385879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0005040 con 0x7fa7f00f7980 2022-02-02T20:41:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.878+0000 7fa7eeffd700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7fa7e0009990 tx=0x7fa7e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.879+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0018070 con 0x7fa7f00f7980 2022-02-02T20:41:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.879+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7e0007ba0 con 0x7fa7f00f7980 2022-02-02T20:41:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.879+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e001c3c0 con 0x7fa7f00f7980 2022-02-02T20:41:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.879+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f006a740 con 0x7fa7f00f7980 2022-02-02T20:41:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.879+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f006aca0 con 0x7fa7f00f7980 2022-02-02T20:41:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.880+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0045ad0 con 0x7fa7f00f7980 2022-02-02T20:41:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.880+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa7e001d420 con 0x7fa7f00f7980 2022-02-02T20:41:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.881+0000 7fa7d7fff700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 0x7fa7d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.881+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa7e00836c0 con 0x7fa7f00f7980 2022-02-02T20:41:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.881+0000 7fa7ef7fe700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 0x7fa7d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.881+0000 7fa7ef7fe700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 0x7fa7d8067290 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fa7f006b730 tx=0x7fa7e400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:14.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:14.885+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa7e0051880 con 0x7fa7f00f7980 2022-02-02T20:41:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.085+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa7f0027a00 con 0x7fa7f00f7980 2022-02-02T20:41:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.085+0000 7fa7d7fff700 1 -- 172.21.15.96:0/114385879 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa7e0054ea0 con 0x7fa7f00f7980 2022-02-02T20:41:15.089 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:41:15.089 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:41:15.089 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:41:15.089 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:41:15.089 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:15.090 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:41:15.090 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:41:15.090 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:41:15.090 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:41:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:41:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:41:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:41:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:41:15.092 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:41:15.092 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:41:15.092 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:41:15.092 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:41:15.093 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:41:15.093 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:41:15.093 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:41:15.093 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:41:15.094 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:41:15.094 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:41:15.095 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:41:15.095 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:41:15.095 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:41:15.095 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:41:15.095 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:41:15.096 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:41:15.096 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:41:15.096 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:41:15.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:41:15.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:15.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:15.097 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:41:15.098 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:15.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:15.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:15.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:15.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 msgr2=0x7fa7d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:15.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 0x7fa7d8067290 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fa7f006b730 tx=0x7fa7e400b040).stop 2022-02-02T20:41:15.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 msgr2=0x7fa7f0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:15.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7fa7e0009990 tx=0x7fa7e0009b30).stop 2022-02-02T20:41:15.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 shutdown_connections 2022-02-02T20:41:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa7d8064dd0 0x7fa7d8067290 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7f00f66e0 0x7fa7f006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 --2- 172.21.15.96:0/114385879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7f00f7980 0x7fa7f0069e20 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.088+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 >> 172.21.15.96:0/114385879 conn(0x7fa7f00f1e40 msgr2=0x7fa7f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.089+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 shutdown_connections 2022-02-02T20:41:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:15.089+0000 7fa7f611f700 1 -- 172.21.15.96:0/114385879 wait complete. 2022-02-02T20:41:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:41:15.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:15 smithi159 ceph-mon[69013]: from='client.38388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:15.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:15 smithi159 ceph-mon[69013]: from='client.38392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:15.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3973363721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:41:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/114385879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:41:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:15 smithi096 ceph-mon[101353]: from='client.38388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:15 smithi096 ceph-mon[101353]: from='client.38392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:15.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3973363721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:41:15.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/114385879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:41:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:16 smithi159 ceph-mon[69013]: pgmap v4175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:16 smithi096 ceph-mon[101353]: pgmap v4175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:17 smithi159 ceph-mon[69013]: pgmap v4176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:17 smithi096 ceph-mon[101353]: pgmap v4176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:20 smithi159 ceph-mon[69013]: pgmap v4177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:20 smithi096 ceph-mon[101353]: pgmap v4177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:22 smithi159 ceph-mon[69013]: pgmap v4178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:22 smithi096 ceph-mon[101353]: pgmap v4178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:24 smithi159 ceph-mon[69013]: pgmap v4179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:24 smithi096 ceph-mon[101353]: pgmap v4179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:26 smithi159 ceph-mon[69013]: pgmap v4180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:26 smithi096 ceph-mon[101353]: pgmap v4180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:27 smithi159 ceph-mon[69013]: pgmap v4181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:41:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:41:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:27 smithi096 ceph-mon[101353]: pgmap v4181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:41:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:41:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:30 smithi159 ceph-mon[69013]: pgmap v4182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:30 smithi096 ceph-mon[101353]: pgmap v4182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:32 smithi159 ceph-mon[69013]: pgmap v4183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:32 smithi096 ceph-mon[101353]: pgmap v4183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:34 smithi159 ceph-mon[69013]: pgmap v4184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:34 smithi096 ceph-mon[101353]: pgmap v4184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:36 smithi159 ceph-mon[69013]: pgmap v4185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:36 smithi096 ceph-mon[101353]: pgmap v4185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:37 smithi159 ceph-mon[69013]: pgmap v4186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:37 smithi096 ceph-mon[101353]: pgmap v4186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:40 smithi159 ceph-mon[69013]: pgmap v4187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:40 smithi096 ceph-mon[101353]: pgmap v4187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:42 smithi159 ceph-mon[69013]: pgmap v4188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:42 smithi096 ceph-mon[101353]: pgmap v4188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:44 smithi159 ceph-mon[69013]: pgmap v4189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:44 smithi096 ceph-mon[101353]: pgmap v4189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:45.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- 172.21.15.96:0/10263065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 msgr2=0x7fce7c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 --2- 172.21.15.96:0/10263065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c0f7c30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7fce68004660 tx=0x7fce68009b30).stop 2022-02-02T20:41:45.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- 172.21.15.96:0/10263065 shutdown_connections 2022-02-02T20:41:45.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 --2- 172.21.15.96:0/10263065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c0f7c30 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 --2- 172.21.15.96:0/10263065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 0x7fce7c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- 172.21.15.96:0/10263065 >> 172.21.15.96:0/10263065 conn(0x7fce7c0f1c90 msgr2=0x7fce7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:45.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- 172.21.15.96:0/10263065 shutdown_connections 2022-02-02T20:41:45.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- 172.21.15.96:0/10263065 wait complete. 2022-02-02T20:41:45.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 Processor -- start 2022-02-02T20:41:45.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.200+0000 7fce81e2c700 1 -- start start 2022-02-02T20:41:45.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce81e2c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 0x7fce7c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce81e2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce81e2c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c107880 con 0x7fce7c0f77d0 2022-02-02T20:41:45.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce81e2c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c108090 con 0x7fce7c0f6530 2022-02-02T20:41:45.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38546/0 (socket says 172.21.15.96:38546) 2022-02-02T20:41:45.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 -- 172.21.15.96:0/53306837 learned_addr learned my addr 172.21.15.96:0/53306837 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:45.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce80e2a700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 0x7fce7c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 -- 172.21.15.96:0/53306837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 msgr2=0x7fce7c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 0x7fce7c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.201+0000 7fce7bfff700 1 -- 172.21.15.96:0/53306837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68005040 con 0x7fce7c0f77d0 2022-02-02T20:41:45.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce7bfff700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7fce68009990 tx=0x7fce68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce68018070 con 0x7fce7c0f77d0 2022-02-02T20:41:45.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce68007ca0 con 0x7fce7c0f77d0 2022-02-02T20:41:45.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1082b0 con 0x7fce7c0f77d0 2022-02-02T20:41:45.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6801c620 con 0x7fce7c0f77d0 2022-02-02T20:41:45.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.202+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c108810 con 0x7fce7c0f77d0 2022-02-02T20:41:45.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.203+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c059100 con 0x7fce7c0f77d0 2022-02-02T20:41:45.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.203+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce6801d960 con 0x7fce7c0f77d0 2022-02-02T20:41:45.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.204+0000 7fce797fa700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 0x7fce6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.204+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce680837d0 con 0x7fce7c0f77d0 2022-02-02T20:41:45.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.204+0000 7fce80e2a700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 0x7fce6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.204+0000 7fce80e2a700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 0x7fce6c0672e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fce7c106b00 tx=0x7fce70009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.208+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce68051a40 con 0x7fce7c0f77d0 2022-02-02T20:41:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.386+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce7c0fee60 con 0x7fce6c064e20 2022-02-02T20:41:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.387+0000 7fce797fa700 1 -- 172.21.15.96:0/53306837 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fce7c0fee60 con 0x7fce6c064e20 2022-02-02T20:41:45.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 msgr2=0x7fce6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 0x7fce6c0672e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fce7c106b00 tx=0x7fce70009040).stop 2022-02-02T20:41:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 msgr2=0x7fce7c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7fce68009990 tx=0x7fce68009b30).stop 2022-02-02T20:41:45.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 shutdown_connections 2022-02-02T20:41:45.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce6c064e20 0x7fce6c0672e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f6530 0x7fce7c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 --2- 172.21.15.96:0/53306837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f77d0 0x7fce7c107280 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 >> 172.21.15.96:0/53306837 conn(0x7fce7c0f1c90 msgr2=0x7fce7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:45.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 shutdown_connections 2022-02-02T20:41:45.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.389+0000 7fce81e2c700 1 -- 172.21.15.96:0/53306837 wait complete. 2022-02-02T20:41:45.400 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:41:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 -- 172.21.15.96:0/3120986468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f5ed0 msgr2=0x7fc3300f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 --2- 172.21.15.96:0/3120986468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f5ed0 0x7fc3300f6900 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7fc320004660 tx=0x7fc320009b30).stop 2022-02-02T20:41:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 -- 172.21.15.96:0/3120986468 shutdown_connections 2022-02-02T20:41:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 --2- 172.21.15.96:0/3120986468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f5ed0 0x7fc3300f6900 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 --2- 172.21.15.96:0/3120986468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f55c0 0x7fc3300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 -- 172.21.15.96:0/3120986468 >> 172.21.15.96:0/3120986468 conn(0x7fc3300f0de0 msgr2=0x7fc3300f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 -- 172.21.15.96:0/3120986468 shutdown_connections 2022-02-02T20:41:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.487+0000 7fc3359c4700 1 -- 172.21.15.96:0/3120986468 wait complete. 2022-02-02T20:41:45.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 Processor -- start 2022-02-02T20:41:45.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 -- start start 2022-02-02T20:41:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f5ed0 0x7fc3301063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301069c0 con 0x7fc3300f55c0 2022-02-02T20:41:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc3359c4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301071d0 con 0x7fc3300f5ed0 2022-02-02T20:41:45.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc32effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc32effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38554/0 (socket says 172.21.15.96:38554) 2022-02-02T20:41:45.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc32effd700 1 -- 172.21.15.96:0/923936604 learned_addr learned my addr 172.21.15.96:0/923936604 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:45.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.488+0000 7fc32e7fc700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f5ed0 0x7fc3301063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc32effd700 1 -- 172.21.15.96:0/923936604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f5ed0 msgr2=0x7fc3301063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc32effd700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f5ed0 0x7fc3301063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc32effd700 1 -- 172.21.15.96:0/923936604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320005040 con 0x7fc3300f55c0 2022-02-02T20:41:45.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc32effd700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7fc32400c510 tx=0x7fc324007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc324011950 con 0x7fc3300f55c0 2022-02-02T20:41:45.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3301073f0 con 0x7fc3300f55c0 2022-02-02T20:41:45.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc330107980 con 0x7fc3300f55c0 2022-02-02T20:41:45.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc324018380 con 0x7fc3300f55c0 2022-02-02T20:41:45.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.489+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc324019630 con 0x7fc3300f55c0 2022-02-02T20:41:45.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.490+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310004fa0 con 0x7fc3300f55c0 2022-02-02T20:41:45.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.491+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc324021070 con 0x7fc3300f55c0 2022-02-02T20:41:45.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.491+0000 7fc3177fe700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.491+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc324085e80 con 0x7fc3300f55c0 2022-02-02T20:41:45.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.492+0000 7fc32e7fc700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.492+0000 7fc32e7fc700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fc320004630 tx=0x7fc320009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.495+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc324053fa0 con 0x7fc3300f55c0 2022-02-02T20:41:45.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.665+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc310000b90 con 0x7fc318064dd0 2022-02-02T20:41:45.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.674+0000 7fc3177fe700 1 -- 172.21.15.96:0/923936604 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc310000b90 con 0x7fc318064dd0 2022-02-02T20:41:45.677 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:41:45.677 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 115m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:41:45.677 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 115m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:41:45.677 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 114m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:41:45.678 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 115m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:41:45.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 115m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:41:45.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 115m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:41:45.678 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 114m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:41:45.679 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 114m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:41:45.679 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 115m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:41:45.679 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 114m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:41:45.679 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 115m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:41:45.679 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 114m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:41:45.680 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 115m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:41:45.680 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 114m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:41:45.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 115m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:41:45.680 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 115m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:41:45.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 115m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:41:45.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 114m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:41:45.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 114m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:41:45.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 114m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:41:45.681 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 115m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:41:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 msgr2=0x7fc318067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fc320004630 tx=0x7fc320009b30).stop 2022-02-02T20:41:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 msgr2=0x7fc330105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7fc32400c510 tx=0x7fc324007e00).stop 2022-02-02T20:41:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 shutdown_connections 2022-02-02T20:41:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc318064dd0 0x7fc318067290 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3300f55c0 0x7fc330105ed0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 --2- 172.21.15.96:0/923936604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3300f5ed0 0x7fc3301063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 >> 172.21.15.96:0/923936604 conn(0x7fc3300f0de0 msgr2=0x7fc3300fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:45.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 shutdown_connections 2022-02-02T20:41:45.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.676+0000 7fc3359c4700 1 -- 172.21.15.96:0/923936604 wait complete. 2022-02-02T20:41:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- 172.21.15.96:0/3908412216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f55c0 msgr2=0x7fa1500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 --2- 172.21.15.96:0/3908412216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f55c0 0x7fa1500f59e0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7fa140004660 tx=0x7fa140009b30).stop 2022-02-02T20:41:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- 172.21.15.96:0/3908412216 shutdown_connections 2022-02-02T20:41:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 --2- 172.21.15.96:0/3908412216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1500f6860 0x7fa1500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:41:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 --2- 172.21.15.96:0/3908412216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f55c0 0x7fa1500f59e0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- 172.21.15.96:0/3908412216 >> 172.21.15.96:0/3908412216 conn(0x7fa1500f0d40 msgr2=0x7fa1500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- 172.21.15.96:0/3908412216 shutdown_connections 2022-02-02T20:41:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- 172.21.15.96:0/3908412216 wait complete. 2022-02-02T20:41:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 Processor -- start 2022-02-02T20:41:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- start start 2022-02-02T20:41:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1500f55c0 0x7fa150105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501069f0 con 0x7fa1500f6860 2022-02-02T20:41:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.773+0000 7fa157820700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501072a0 con 0x7fa1500f55c0 2022-02-02T20:41:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38566/0 (socket says 172.21.15.96:38566) 2022-02-02T20:41:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 -- 172.21.15.96:0/1400156429 learned_addr learned my addr 172.21.15.96:0/1400156429 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 -- 172.21.15.96:0/1400156429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1500f55c0 msgr2=0x7fa150105ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T20:41:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1500f55c0 0x7fa150105ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:41:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 -- 172.21.15.96:0/1400156429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140005040 con 0x7fa1500f6860 2022-02-02T20:41:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa154dbb700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fa14c00b410 tx=0x7fa14c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14c0125f0 con 0x7fa1500f6860 2022-02-02T20:41:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1501074c0 con 0x7fa1500f6860 2022-02-02T20:41:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa14c012c00 con 0x7fa1500f6860 2022-02-02T20:41:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.774+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14c002b00 con 0x7fa1500f6860 2022-02-02T20:41:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.775+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa150107a80 con 0x7fa1500f6860 2022-02-02T20:41:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.775+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150045ad0 con 0x7fa1500f6860 2022-02-02T20:41:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.776+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa14c00f030 con 0x7fa1500f6860 2022-02-02T20:41:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.776+0000 7fa145ffb700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 0x7fa13c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.776+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa14c081e60 con 0x7fa1500f6860 2022-02-02T20:41:45.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.776+0000 7fa1555bc700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 0x7fa13c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:45.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.777+0000 7fa1555bc700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 0x7fa13c067290 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fa140004e30 tx=0x7fa140009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:45.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:45.780+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa14c053990 con 0x7fa1500f6860 2022-02-02T20:41:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.011+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa150027a00 con 0x7fa1500f6860 2022-02-02T20:41:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.012+0000 7fa145ffb700 1 -- 172.21.15.96:0/1400156429 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa14c012d70 con 0x7fa1500f6860 2022-02-02T20:41:46.014 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:41:46.014 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:41:46.015 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:41:46.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:46.015 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:41:46.015 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:41:46.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:46.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:41:46.016 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:41:46.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:46.016 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:41:46.017 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:41:46.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:41:46.017 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:41:46.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:41:46.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:41:46.018 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:41:46.018 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:41:46.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 msgr2=0x7fa13c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 0x7fa13c067290 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fa140004e30 tx=0x7fa140009b30).stop 2022-02-02T20:41:46.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 msgr2=0x7fa1501063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fa14c00b410 tx=0x7fa14c006ef0).stop 2022-02-02T20:41:46.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 shutdown_connections 2022-02-02T20:41:46.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa13c064dd0 0x7fa13c067290 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1500f55c0 0x7fa150105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:41:46.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 --2- 172.21.15.96:0/1400156429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1500f6860 0x7fa1501063b0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 >> 172.21.15.96:0/1400156429 conn(0x7fa1500f0d40 msgr2=0x7fa1500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:46.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 shutdown_connections 2022-02-02T20:41:46.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.014+0000 7fa157820700 1 -- 172.21.15.96:0/1400156429 wait complete. 2022-02-02T20:41:46.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 -- 172.21.15.96:0/2074054014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 msgr2=0x7f61280f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 --2- 172.21.15.96:0/2074054014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61280f6b30 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7f611c004660 tx=0x7f611c009b30).stop 2022-02-02T20:41:46.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 -- 172.21.15.96:0/2074054014 shutdown_connections 2022-02-02T20:41:46.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 --2- 172.21.15.96:0/2074054014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61280f6b30 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 --2- 172.21.15.96:0/2074054014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 0x7f61280f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 -- 172.21.15.96:0/2074054014 >> 172.21.15.96:0/2074054014 conn(0x7f61280f0b90 msgr2=0x7f61280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:46.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.112+0000 7f6127fff700 1 -- 172.21.15.96:0/2074054014 shutdown_connections 2022-02-02T20:41:46.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.113+0000 7f6127fff700 1 -- 172.21.15.96:0/2074054014 wait complete. 2022-02-02T20:41:46.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.113+0000 7f6127fff700 1 Processor -- start 2022-02-02T20:41:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.113+0000 7f6127fff700 1 -- start start 2022-02-02T20:41:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 0x7f6128105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128106760 con 0x7f61280f66d0 2022-02-02T20:41:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128106f60 con 0x7f61280f5430 2022-02-02T20:41:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38574/0 (socket says 172.21.15.96:38574) 2022-02-02T20:41:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 -- 172.21.15.96:0/2071763433 learned_addr learned my addr 172.21.15.96:0/2071763433 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:41:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6126ffd700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 0x7f6128105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 -- 172.21.15.96:0/2071763433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 msgr2=0x7f6128105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 0x7f6128105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 -- 172.21.15.96:0/2071763433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c005040 con 0x7f61280f66d0 2022-02-02T20:41:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f61267fc700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 rx=0x7f611c009990 tx=0x7f611c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c018070 con 0x7f61280f66d0 2022-02-02T20:41:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f611c007ba0 con 0x7f61280f66d0 2022-02-02T20:41:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61281071e0 con 0x7f61280f66d0 2022-02-02T20:41:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c01c620 con 0x7f61280f66d0 2022-02-02T20:41:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.114+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128107740 con 0x7f61280f66d0 2022-02-02T20:41:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.115+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128059100 con 0x7f61280f66d0 2022-02-02T20:41:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.116+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f611c01c8e0 con 0x7f61280f66d0 2022-02-02T20:41:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.116+0000 7f610f7fe700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 0x7f61100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:41:46.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.116+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f611c083890 con 0x7f61280f66d0 2022-02-02T20:41:46.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.116+0000 7f6126ffd700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 0x7f61100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:41:46.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.117+0000 7f6126ffd700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 0x7f61100672e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f61280f6530 tx=0x7f6118009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:41:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.120+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f611c0553c0 con 0x7f61280f66d0 2022-02-02T20:41:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.319+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f61280fdbf0 con 0x7f61280f66d0 2022-02-02T20:41:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.320+0000 7f610f7fe700 1 -- 172.21.15.96:0/2071763433 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f611c054fb0 con 0x7f61280f66d0 2022-02-02T20:41:46.322 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:41:46.322 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:41:46.322 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:41:46.323 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:41:46.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:46.323 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:41:46.324 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:41:46.324 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:41:46.324 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:41:46.324 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:41:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:41:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:41:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:41:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:41:46.326 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:41:46.326 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:41:46.326 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:41:46.326 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:41:46.326 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:41:46.327 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:41:46.327 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:41:46.327 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:41:46.327 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:41:46.328 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:41:46.328 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:41:46.328 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:41:46.328 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:41:46.328 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:41:46.329 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:41:46.329 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:41:46.330 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:41:46.330 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:41:46.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:46.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:46.331 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:41:46.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:41:46.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:46.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:46.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:41:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 msgr2=0x7f61100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 0x7f61100672e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f61280f6530 tx=0x7f6118009040).stop 2022-02-02T20:41:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 msgr2=0x7f61281061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:41:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 rx=0x7f611c009990 tx=0x7f611c009b30).stop 2022-02-02T20:41:46.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 shutdown_connections 2022-02-02T20:41:46.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6110064e20 0x7f61100672e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61280f5430 0x7f6128105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 --2- 172.21.15.96:0/2071763433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61280f66d0 0x7f61281061b0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:41:46.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 >> 172.21.15.96:0/2071763433 conn(0x7f61280f0b90 msgr2=0x7f61280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:41:46.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 shutdown_connections 2022-02-02T20:41:46.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:41:46.322+0000 7f6127fff700 1 -- 172.21.15.96:0/2071763433 wait complete. 2022-02-02T20:41:46.335 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:41:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:46 smithi159 ceph-mon[69013]: pgmap v4190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:46 smithi159 ceph-mon[69013]: from='client.38404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:46 smithi159 ceph-mon[69013]: from='client.38408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:46.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1400156429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:41:46.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2071763433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:41:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:46 smithi096 ceph-mon[101353]: pgmap v4190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:46 smithi096 ceph-mon[101353]: from='client.38404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:46 smithi096 ceph-mon[101353]: from='client.38408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:41:46.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1400156429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:41:46.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2071763433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:41:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:47 smithi159 ceph-mon[69013]: pgmap v4191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:47 smithi096 ceph-mon[101353]: pgmap v4191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:50 smithi159 ceph-mon[69013]: pgmap v4192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:50 smithi096 ceph-mon[101353]: pgmap v4192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:52 smithi159 ceph-mon[69013]: pgmap v4193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:52 smithi096 ceph-mon[101353]: pgmap v4193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:54 smithi159 ceph-mon[69013]: pgmap v4194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:54.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:54 smithi096 ceph-mon[101353]: pgmap v4194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:56 smithi159 ceph-mon[69013]: pgmap v4195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:56 smithi096 ceph-mon[101353]: pgmap v4195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:41:57 smithi159 ceph-mon[69013]: pgmap v4196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:41:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:41:57 smithi096 ceph-mon[101353]: pgmap v4196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:00 smithi159 ceph-mon[69013]: pgmap v4197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:00 smithi096 ceph-mon[101353]: pgmap v4197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:02 smithi159 ceph-mon[69013]: pgmap v4198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:02 smithi096 ceph-mon[101353]: pgmap v4198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:04 smithi159 ceph-mon[69013]: pgmap v4199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:04 smithi096 ceph-mon[101353]: pgmap v4199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:06 smithi159 ceph-mon[69013]: pgmap v4200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:06 smithi096 ceph-mon[101353]: pgmap v4200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:07 smithi159 ceph-mon[69013]: pgmap v4201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:07 smithi096 ceph-mon[101353]: pgmap v4201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:10.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:10 smithi159 ceph-mon[69013]: pgmap v4202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:10 smithi096 ceph-mon[101353]: pgmap v4202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:12 smithi159 ceph-mon[69013]: pgmap v4203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:12 smithi096 ceph-mon[101353]: pgmap v4203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:14 smithi159 ceph-mon[69013]: pgmap v4204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:14 smithi096 ceph-mon[101353]: pgmap v4204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:16.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 -- 172.21.15.96:0/807158446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f6860 msgr2=0x7f4f040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 --2- 172.21.15.96:0/807158446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f6860 0x7f4f040f6cc0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f4ef8004660 tx=0x7f4ef8009b30).stop 2022-02-02T20:42:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 -- 172.21.15.96:0/807158446 shutdown_connections 2022-02-02T20:42:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 --2- 172.21.15.96:0/807158446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f6860 0x7f4f040f6cc0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 --2- 172.21.15.96:0/807158446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f55c0 0x7f4f040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.432+0000 7f4f0a032700 1 -- 172.21.15.96:0/807158446 >> 172.21.15.96:0/807158446 conn(0x7f4f040f0d40 msgr2=0x7f4f040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.433+0000 7f4f0a032700 1 -- 172.21.15.96:0/807158446 shutdown_connections 2022-02-02T20:42:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.433+0000 7f4f0a032700 1 -- 172.21.15.96:0/807158446 wait complete. 2022-02-02T20:42:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.433+0000 7f4f0a032700 1 Processor -- start 2022-02-02T20:42:16.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.433+0000 7f4f0a032700 1 -- start start 2022-02-02T20:42:16.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f0a032700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f0a032700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f6860 0x7f4f0410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f0a032700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04060450 con 0x7f4f040f55c0 2022-02-02T20:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f0a032700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04060590 con 0x7f4f040f6860 2022-02-02T20:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38598/0 (socket says 172.21.15.96:38598) 2022-02-02T20:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 -- 172.21.15.96:0/2450411318 learned_addr learned my addr 172.21.15.96:0/2450411318 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f02ffd700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f6860 0x7f4f0410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 -- 172.21.15.96:0/2450411318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f6860 msgr2=0x7f4f0410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f6860 0x7f4f0410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.434+0000 7f4f037fe700 1 -- 172.21.15.96:0/2450411318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005040 con 0x7f4f040f55c0 2022-02-02T20:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.435+0000 7f4f037fe700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7f4ef40093f0 tx=0x7f4ef4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:16.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.436+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef4013640 con 0x7f4f040f55c0 2022-02-02T20:42:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.436+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ef4013c50 con 0x7f4f040f55c0 2022-02-02T20:42:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.436+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0410c7e0 con 0x7f4f040f55c0 2022-02-02T20:42:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.436+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef4012d10 con 0x7f4f040f55c0 2022-02-02T20:42:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.437+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0410cda0 con 0x7f4f040f55c0 2022-02-02T20:42:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.437+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f04045ad0 con 0x7f4f040f55c0 2022-02-02T20:42:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.438+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ef401a060 con 0x7f4f040f55c0 2022-02-02T20:42:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.438+0000 7f4eebfff700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 0x7f4eec067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.438+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4ef4081ab0 con 0x7f4f040f55c0 2022-02-02T20:42:16.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.438+0000 7f4f02ffd700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 0x7f4eec067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:16.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.439+0000 7f4f02ffd700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 0x7f4eec067270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f4ef8004e30 tx=0x7f4ef8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:16.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.443+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ef404fbb0 con 0x7f4f040f55c0 2022-02-02T20:42:16.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.621+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f04057f10 con 0x7f4eec064db0 2022-02-02T20:42:16.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.622+0000 7f4eebfff700 1 -- 172.21.15.96:0/2450411318 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4f04057f10 con 0x7f4eec064db0 2022-02-02T20:42:16.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 msgr2=0x7f4eec067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 0x7f4eec067270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f4ef8004e30 tx=0x7f4ef8009b30).stop 2022-02-02T20:42:16.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 msgr2=0x7f4f04109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7f4ef40093f0 tx=0x7f4ef4006ec0).stop 2022-02-02T20:42:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 shutdown_connections 2022-02-02T20:42:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4eec064db0 0x7f4eec067270 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f040f55c0 0x7f4f04109cd0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 --2- 172.21.15.96:0/2450411318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f040f6860 0x7f4f0410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.624+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 >> 172.21.15.96:0/2450411318 conn(0x7f4f040f0d40 msgr2=0x7f4f040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:16.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.625+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 shutdown_connections 2022-02-02T20:42:16.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.625+0000 7f4f0a032700 1 -- 172.21.15.96:0/2450411318 wait complete. 2022-02-02T20:42:16.636 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:42:16.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 -- 172.21.15.96:0/372202958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 msgr2=0x7f7bec0f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/372202958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec0f7da0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f7be0004660 tx=0x7f7be0009b30).stop 2022-02-02T20:42:16.728 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:16 smithi096 ceph-mon[101353]: pgmap v4205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 -- 172.21.15.96:0/372202958 shutdown_connections 2022-02-02T20:42:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/372202958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec0f7da0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/372202958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bec0f66a0 0x7f7bec0f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 -- 172.21.15.96:0/372202958 >> 172.21.15.96:0/372202958 conn(0x7f7bec0f1e00 msgr2=0x7f7bec0f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 -- 172.21.15.96:0/372202958 shutdown_connections 2022-02-02T20:42:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.726+0000 7f7bf0b26700 1 -- 172.21.15.96:0/372202958 wait complete. 2022-02-02T20:42:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 Processor -- start 2022-02-02T20:42:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 -- start start 2022-02-02T20:42:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bec0f66a0 0x7f7bec106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec1079e0 con 0x7f7bec0f7940 2022-02-02T20:42:16.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7bf0b26700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec108290 con 0x7f7bec0f66a0 2022-02-02T20:42:16.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38610/0 (socket says 172.21.15.96:38610) 2022-02-02T20:42:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 -- 172.21.15.96:0/2485777633 learned_addr learned my addr 172.21.15.96:0/2485777633 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 -- 172.21.15.96:0/2485777633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bec0f66a0 msgr2=0x7f7bec106eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T20:42:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bec0f66a0 0x7f7bec106eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.727+0000 7f7be9d9b700 1 -- 172.21.15.96:0/2485777633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0005040 con 0x7f7bec0f7940 2022-02-02T20:42:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7be9d9b700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7f7be0009990 tx=0x7f7be0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be0018070 con 0x7f7bec0f7940 2022-02-02T20:42:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7be0007ca0 con 0x7f7bec0f7940 2022-02-02T20:42:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec108510 con 0x7f7bec0f7940 2022-02-02T20:42:16.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec108a70 con 0x7f7bec0f7940 2022-02-02T20:42:16.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.728+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be001c620 con 0x7f7bec0f7940 2022-02-02T20:42:16.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.729+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd0004fa0 con 0x7f7bec0f7940 2022-02-02T20:42:16.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.729+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7be001c890 con 0x7f7bec0f7940 2022-02-02T20:42:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.730+0000 7f7bdaffd700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 0x7f7bd40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.730+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7be0083650 con 0x7f7bec0f7940 2022-02-02T20:42:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.730+0000 7f7bea59c700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 0x7f7bd40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.730+0000 7f7bea59c700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 0x7f7bd40672e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f7bec0f77a0 tx=0x7f7bdc006a30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:16.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.734+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7be0055240 con 0x7f7bec0f7940 2022-02-02T20:42:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:16 smithi159 ceph-mon[69013]: pgmap v4205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:16.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.905+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd0000bc0 con 0x7f7bd4064e20 2022-02-02T20:42:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.915+0000 7f7bdaffd700 1 -- 172.21.15.96:0/2485777633 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7bd0000bc0 con 0x7f7bd4064e20 2022-02-02T20:42:16.917 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:42:16.917 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 116m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:42:16.917 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 116m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:42:16.917 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 114m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:42:16.917 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 116m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:42:16.918 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 116m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:42:16.918 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 116m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:42:16.918 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 114m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:42:16.918 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 114m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:42:16.919 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 116m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:42:16.919 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 114m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:42:16.919 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 116m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:42:16.919 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 114m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:42:16.920 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 116m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:42:16.920 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 114m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:42:16.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 116m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:42:16.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 116m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:42:16.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 116m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:42:16.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 114m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:42:16.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 114m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:42:16.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 114m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:42:16.921 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 116m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:42:16.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 msgr2=0x7f7bd40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 0x7f7bd40672e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f7bec0f77a0 tx=0x7f7bdc006a30).stop 2022-02-02T20:42:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 msgr2=0x7f7bec1073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7f7be0009990 tx=0x7f7be0009b30).stop 2022-02-02T20:42:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 shutdown_connections 2022-02-02T20:42:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bd4064e20 0x7f7bd40672e0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bec0f66a0 0x7f7bec106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 --2- 172.21.15.96:0/2485777633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bec0f7940 0x7f7bec1073a0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.916+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 >> 172.21.15.96:0/2485777633 conn(0x7f7bec0f1e00 msgr2=0x7f7bec0fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.917+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 shutdown_connections 2022-02-02T20:42:16.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:16.917+0000 7f7bf0b26700 1 -- 172.21.15.96:0/2485777633 wait complete. 2022-02-02T20:42:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 -- 172.21.15.96:0/1170204347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f6530 msgr2=0x7f9a600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 --2- 172.21.15.96:0/1170204347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f6530 0x7f9a600f6950 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f9a50004660 tx=0x7f9a50009b30).stop 2022-02-02T20:42:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 -- 172.21.15.96:0/1170204347 shutdown_connections 2022-02-02T20:42:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 --2- 172.21.15.96:0/1170204347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f77d0 0x7f9a600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 --2- 172.21.15.96:0/1170204347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f6530 0x7f9a600f6950 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 -- 172.21.15.96:0/1170204347 >> 172.21.15.96:0/1170204347 conn(0x7f9a600f1c90 msgr2=0x7f9a600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 -- 172.21.15.96:0/1170204347 shutdown_connections 2022-02-02T20:42:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.014+0000 7f9a64edc700 1 -- 172.21.15.96:0/1170204347 wait complete. 2022-02-02T20:42:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 Processor -- start 2022-02-02T20:42:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 -- start start 2022-02-02T20:42:17.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f6530 0x7f9a60106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601078f0 con 0x7f9a600f77d0 2022-02-02T20:42:17.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.015+0000 7f9a64edc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60108100 con 0x7f9a600f6530 2022-02-02T20:42:17.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38620/0 (socket says 172.21.15.96:38620) 2022-02-02T20:42:17.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 -- 172.21.15.96:0/2919989809 learned_addr learned my addr 172.21.15.96:0/2919989809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:17.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5f7fe700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f6530 0x7f9a60106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 -- 172.21.15.96:0/2919989809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f6530 msgr2=0x7f9a60106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f6530 0x7f9a60106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 -- 172.21.15.96:0/2919989809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50005040 con 0x7f9a600f77d0 2022-02-02T20:42:17.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a5effd700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7f9a5400c530 tx=0x7f9a54007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:17.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5400f650 con 0x7f9a600f77d0 2022-02-02T20:42:17.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a60108380 con 0x7f9a600f77d0 2022-02-02T20:42:17.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a5400fc60 con 0x7f9a600f77d0 2022-02-02T20:42:17.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a54012cd0 con 0x7f9a600f77d0 2022-02-02T20:42:17.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.016+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a60108940 con 0x7f9a600f77d0 2022-02-02T20:42:17.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.017+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a60059100 con 0x7f9a600f77d0 2022-02-02T20:42:17.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.018+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a54010070 con 0x7f9a600f77d0 2022-02-02T20:42:17.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.018+0000 7f9a47fff700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 0x7f9a480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.018+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a54082020 con 0x7f9a600f77d0 2022-02-02T20:42:17.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.019+0000 7f9a5f7fe700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 0x7f9a480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.019+0000 7f9a5f7fe700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 0x7f9a480672e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f9a50004e30 tx=0x7f9a50009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:17.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.022+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a54050120 con 0x7f9a600f77d0 2022-02-02T20:42:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.253+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a600fecf0 con 0x7f9a600f77d0 2022-02-02T20:42:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.253+0000 7f9a47fff700 1 -- 172.21.15.96:0/2919989809 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9a54020070 con 0x7f9a600f77d0 2022-02-02T20:42:17.256 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:42:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:42:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:42:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:42:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:42:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:42:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:42:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:42:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:42:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:42:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:42:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:42:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:42:17.260 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:42:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 msgr2=0x7f9a480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 0x7f9a480672e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f9a50004e30 tx=0x7f9a50009b30).stop 2022-02-02T20:42:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 msgr2=0x7f9a601072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7f9a5400c530 tx=0x7f9a54007e20).stop 2022-02-02T20:42:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 shutdown_connections 2022-02-02T20:42:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a48064e20 0x7f9a480672e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a600f6530 0x7f9a60106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 --2- 172.21.15.96:0/2919989809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a600f77d0 0x7f9a601072f0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.255+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 >> 172.21.15.96:0/2919989809 conn(0x7f9a600f1c90 msgr2=0x7f9a600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.256+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 shutdown_connections 2022-02-02T20:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.256+0000 7f9a64edc700 1 -- 172.21.15.96:0/2919989809 wait complete. 2022-02-02T20:42:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.354+0000 7f7344cc8700 1 -- 172.21.15.96:0/2520656410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 msgr2=0x7f73400f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.354+0000 7f7344cc8700 1 --2- 172.21.15.96:0/2520656410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f73400f4dc0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7f7334004660 tx=0x7f7334009b30).stop 2022-02-02T20:42:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 -- 172.21.15.96:0/2520656410 shutdown_connections 2022-02-02T20:42:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 --2- 172.21.15.96:0/2520656410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 0x7f73400f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 --2- 172.21.15.96:0/2520656410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f73400f4dc0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 -- 172.21.15.96:0/2520656410 >> 172.21.15.96:0/2520656410 conn(0x7f73400f04c0 msgr2=0x7f73400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 -- 172.21.15.96:0/2520656410 shutdown_connections 2022-02-02T20:42:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 -- 172.21.15.96:0/2520656410 wait complete. 2022-02-02T20:42:17.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 Processor -- start 2022-02-02T20:42:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.355+0000 7f7344cc8700 1 -- start start 2022-02-02T20:42:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 0x7f7340107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340107b90 con 0x7f73400f49a0 2022-02-02T20:42:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340108440 con 0x7f73400f5340 2022-02-02T20:42:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38628/0 (socket says 172.21.15.96:38628) 2022-02-02T20:42:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 -- 172.21.15.96:0/3917810619 learned_addr learned my addr 172.21.15.96:0/3917810619 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:17.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733dd9b700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 0x7f7340107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 -- 172.21.15.96:0/3917810619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 msgr2=0x7f7340107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 0x7f7340107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 -- 172.21.15.96:0/3917810619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334005040 con 0x7f73400f49a0 2022-02-02T20:42:17.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f733e59c700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7f7334009d80 tx=0x7f7334009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:17.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7334018070 con 0x7f73400f49a0 2022-02-02T20:42:17.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7334007ba0 con 0x7f73400f49a0 2022-02-02T20:42:17.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73401086c0 con 0x7f73400f49a0 2022-02-02T20:42:17.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733401c3c0 con 0x7f73400f49a0 2022-02-02T20:42:17.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.356+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7340108c20 con 0x7f73400f49a0 2022-02-02T20:42:17.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.357+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400f4150 con 0x7f73400f49a0 2022-02-02T20:42:17.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.358+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f733401d420 con 0x7f73400f49a0 2022-02-02T20:42:17.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.358+0000 7f732effd700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 0x7f7328067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:17.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.358+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f73340836d0 con 0x7f73400f49a0 2022-02-02T20:42:17.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.358+0000 7f733dd9b700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 0x7f7328067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:17.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.359+0000 7f733dd9b700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 0x7f7328067290 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f7330006fd0 tx=0x7f7330008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:17.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.362+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7334055260 con 0x7f73400f49a0 2022-02-02T20:42:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.564+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7340027a00 con 0x7f73400f49a0 2022-02-02T20:42:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.564+0000 7f732effd700 1 -- 172.21.15.96:0/3917810619 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7334054e50 con 0x7f73400f49a0 2022-02-02T20:42:17.567 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:42:17.567 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:42:17.567 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:42:17.567 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:42:17.568 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:17.568 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:42:17.568 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:42:17.568 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:42:17.568 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:42:17.569 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:42:17.569 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:42:17.569 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:42:17.569 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:42:17.570 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:42:17.570 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:42:17.570 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:42:17.570 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:42:17.571 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:42:17.571 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:42:17.571 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:42:17.571 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:42:17.571 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:42:17.572 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:42:17.572 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:42:17.572 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:42:17.572 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:42:17.572 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:42:17.573 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:42:17.573 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:42:17.573 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:42:17.573 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:42:17.574 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:42:17.575 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:17.575 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:17.575 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:42:17.575 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:17.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:17.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:17.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:17.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 msgr2=0x7f7328067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 0x7f7328067290 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f7330006fd0 tx=0x7f7330008040).stop 2022-02-02T20:42:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 msgr2=0x7f7340107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7f7334009d80 tx=0x7f7334009b30).stop 2022-02-02T20:42:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 shutdown_connections 2022-02-02T20:42:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7328064dd0 0x7f7328067290 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73400f49a0 0x7f7340107060 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 --2- 172.21.15.96:0/3917810619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73400f5340 0x7f7340107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 >> 172.21.15.96:0/3917810619 conn(0x7f73400f04c0 msgr2=0x7f73400fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 shutdown_connections 2022-02-02T20:42:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:17.566+0000 7f7344cc8700 1 -- 172.21.15.96:0/3917810619 wait complete. 2022-02-02T20:42:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:42:17.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:17 smithi159 ceph-mon[69013]: from='client.38420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:17.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2919989809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:42:17.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:17 smithi096 ceph-mon[101353]: from='client.38420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:17.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2919989809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:42:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:18 smithi159 ceph-mon[69013]: from='client.38424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:18 smithi159 ceph-mon[69013]: pgmap v4206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:18.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3917810619' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:42:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:18 smithi096 ceph-mon[101353]: from='client.38424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:18 smithi096 ceph-mon[101353]: pgmap v4206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3917810619' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:42:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:20 smithi159 ceph-mon[69013]: pgmap v4207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:20 smithi096 ceph-mon[101353]: pgmap v4207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:22 smithi159 ceph-mon[69013]: pgmap v4208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:22 smithi096 ceph-mon[101353]: pgmap v4208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:24 smithi159 ceph-mon[69013]: pgmap v4209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:24 smithi096 ceph-mon[101353]: pgmap v4209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:26 smithi159 ceph-mon[69013]: pgmap v4210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:26 smithi096 ceph-mon[101353]: pgmap v4210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:27 smithi159 ceph-mon[69013]: pgmap v4211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:42:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:42:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:27 smithi096 ceph-mon[101353]: pgmap v4211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:42:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:42:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:30 smithi159 ceph-mon[69013]: pgmap v4212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:30 smithi096 ceph-mon[101353]: pgmap v4212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:32 smithi159 ceph-mon[69013]: pgmap v4213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:32 smithi096 ceph-mon[101353]: pgmap v4213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:34 smithi159 ceph-mon[69013]: pgmap v4214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:34 smithi096 ceph-mon[101353]: pgmap v4214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:36 smithi159 ceph-mon[69013]: pgmap v4215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:36 smithi096 ceph-mon[101353]: pgmap v4215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:37 smithi159 ceph-mon[69013]: pgmap v4216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:37 smithi096 ceph-mon[101353]: pgmap v4216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:40 smithi159 ceph-mon[69013]: pgmap v4217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:40 smithi096 ceph-mon[101353]: pgmap v4217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:42 smithi159 ceph-mon[69013]: pgmap v4218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:42 smithi096 ceph-mon[101353]: pgmap v4218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:44 smithi159 ceph-mon[69013]: pgmap v4219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:44 smithi096 ceph-mon[101353]: pgmap v4219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:46 smithi159 ceph-mon[69013]: pgmap v4220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:46 smithi096 ceph-mon[101353]: pgmap v4220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 -- 172.21.15.96:0/1890221001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f5340 msgr2=0x7fce400f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 --2- 172.21.15.96:0/1890221001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f5340 0x7fce400f7ac0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7fce30004660 tx=0x7fce30009b30).stop 2022-02-02T20:42:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 -- 172.21.15.96:0/1890221001 shutdown_connections 2022-02-02T20:42:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 --2- 172.21.15.96:0/1890221001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f5340 0x7fce400f7ac0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 --2- 172.21.15.96:0/1890221001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f49a0 0x7fce400f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:42:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 -- 172.21.15.96:0/1890221001 >> 172.21.15.96:0/1890221001 conn(0x7fce400f04c0 msgr2=0x7fce400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 -- 172.21.15.96:0/1890221001 shutdown_connections 2022-02-02T20:42:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.675+0000 7fce4683f700 1 -- 172.21.15.96:0/1890221001 wait complete. 2022-02-02T20:42:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 Processor -- start 2022-02-02T20:42:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 -- start start 2022-02-02T20:42:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f5340 0x7fce40109760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40109da0 con 0x7fce400f49a0 2022-02-02T20:42:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce4683f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4010a650 con 0x7fce400f5340 2022-02-02T20:42:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce3ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce3ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38646/0 (socket says 172.21.15.96:38646) 2022-02-02T20:42:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.676+0000 7fce3ffff700 1 -- 172.21.15.96:0/4228851820 learned_addr learned my addr 172.21.15.96:0/4228851820 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3f7fe700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f5340 0x7fce40109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3ffff700 1 -- 172.21.15.96:0/4228851820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f5340 msgr2=0x7fce40109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3ffff700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f5340 0x7fce40109760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3ffff700 1 -- 172.21.15.96:0/4228851820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30005040 con 0x7fce400f49a0 2022-02-02T20:42:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3ffff700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fce340093f0 tx=0x7fce34006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce34009ea0 con 0x7fce400f49a0 2022-02-02T20:42:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce34013af0 con 0x7fce400f49a0 2022-02-02T20:42:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4010a930 con 0x7fce400f49a0 2022-02-02T20:42:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3400db10 con 0x7fce400f49a0 2022-02-02T20:42:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.677+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4010aef0 con 0x7fce400f49a0 2022-02-02T20:42:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.678+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce400f4150 con 0x7fce400f49a0 2022-02-02T20:42:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.679+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce3401a060 con 0x7fce400f49a0 2022-02-02T20:42:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.679+0000 7fce3cff9700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 0x7fce28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.679+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce34081aa0 con 0x7fce400f49a0 2022-02-02T20:42:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.679+0000 7fce3f7fe700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 0x7fce28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.680+0000 7fce3f7fe700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 0x7fce28067290 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fce30004e30 tx=0x7fce30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.683+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce340535d0 con 0x7fce400f49a0 2022-02-02T20:42:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.863+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce400fefd0 con 0x7fce28064dd0 2022-02-02T20:42:47.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.864+0000 7fce3cff9700 1 -- 172.21.15.96:0/4228851820 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fce400fefd0 con 0x7fce28064dd0 2022-02-02T20:42:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 msgr2=0x7fce28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 0x7fce28067290 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fce30004e30 tx=0x7fce30009b30).stop 2022-02-02T20:42:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 msgr2=0x7fce40109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fce340093f0 tx=0x7fce34006ec0).stop 2022-02-02T20:42:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 shutdown_connections 2022-02-02T20:42:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce28064dd0 0x7fce28067290 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce400f49a0 0x7fce40109270 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 --2- 172.21.15.96:0/4228851820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce400f5340 0x7fce40109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 >> 172.21.15.96:0/4228851820 conn(0x7fce400f04c0 msgr2=0x7fce400f60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 shutdown_connections 2022-02-02T20:42:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.866+0000 7fce4683f700 1 -- 172.21.15.96:0/4228851820 wait complete. 2022-02-02T20:42:47.878 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:42:47.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1741372287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f7980 msgr2=0x7f0db40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1741372287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f7980 0x7f0db40f7de0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f0d9c004660 tx=0x7f0d9c009b30).stop 2022-02-02T20:42:47.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1741372287 shutdown_connections 2022-02-02T20:42:47.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1741372287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f7980 0x7f0db40f7de0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1741372287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f66e0 0x7f0db40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1741372287 >> 172.21.15.96:0/1741372287 conn(0x7f0db40f1e40 msgr2=0x7f0db40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:47.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1741372287 shutdown_connections 2022-02-02T20:42:47.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1741372287 wait complete. 2022-02-02T20:42:47.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.965+0000 7f0dba2dd700 1 Processor -- start 2022-02-02T20:42:47.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0dba2dd700 1 -- start start 2022-02-02T20:42:47.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0dba2dd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0dba2dd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f7980 0x7f0db4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0dba2dd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4107a00 con 0x7f0db40f66e0 2022-02-02T20:42:47.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0dba2dd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4107b40 con 0x7f0db40f7980 2022-02-02T20:42:47.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38656/0 (socket says 172.21.15.96:38656) 2022-02-02T20:42:47.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 -- 172.21.15.96:0/1257494712 learned_addr learned my addr 172.21.15.96:0/1257494712 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:47.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db37fe700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f7980 0x7f0db4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 -- 172.21.15.96:0/1257494712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f7980 msgr2=0x7f0db4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:47.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f7980 0x7f0db4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:47.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 -- 172.21.15.96:0/1257494712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c005040 con 0x7f0db40f66e0 2022-02-02T20:42:47.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.966+0000 7f0db3fff700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f0da400c530 tx=0x7f0da4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:47.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.967+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da400f650 con 0x7f0db40f66e0 2022-02-02T20:42:47.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.967+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db41084e0 con 0x7f0db40f66e0 2022-02-02T20:42:47.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.967+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0da400fc60 con 0x7f0db40f66e0 2022-02-02T20:42:47.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.967+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da4012cb0 con 0x7f0db40f66e0 2022-02-02T20:42:47.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.967+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db4108aa0 con 0x7f0db40f66e0 2022-02-02T20:42:47.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.968+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4045ad0 con 0x7f0db40f66e0 2022-02-02T20:42:47.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.968+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0da4019030 con 0x7f0db40f66e0 2022-02-02T20:42:47.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.968+0000 7f0db0ff9700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 0x7f0da0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:47.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.969+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0da4081600 con 0x7f0db40f66e0 2022-02-02T20:42:47.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.969+0000 7f0db37fe700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 0x7f0da0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:47.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.969+0000 7f0db37fe700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 0x7f0da0067290 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f0d9c004630 tx=0x7f0d9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:47.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:47.973+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0da40531e0 con 0x7f0db40f66e0 2022-02-02T20:42:48.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.145+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0db4108d20 con 0x7f0da0064dd0 2022-02-02T20:42:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.154+0000 7f0db0ff9700 1 -- 172.21.15.96:0/1257494712 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0db4108d20 con 0x7f0da0064dd0 2022-02-02T20:42:48.158 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:42:48.158 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 116m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:42:48.159 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 116m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:42:48.159 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 115m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:42:48.159 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 116m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:42:48.160 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 116m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:42:48.160 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 116m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:42:48.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 115m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:42:48.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 115m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:42:48.162 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 116m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:42:48.162 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 115m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:42:48.163 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 116m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:42:48.164 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 115m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:42:48.164 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 116m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:42:48.165 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 115m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:42:48.165 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 116m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:42:48.166 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 116m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:42:48.166 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 116m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:42:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 115m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:42:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 115m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:42:48.168 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 115m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:42:48.168 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 116m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:42:48.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 msgr2=0x7f0da0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 0x7f0da0067290 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f0d9c004630 tx=0x7f0d9c009b30).stop 2022-02-02T20:42:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 msgr2=0x7f0db4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f0da400c530 tx=0x7f0da4007e10).stop 2022-02-02T20:42:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 shutdown_connections 2022-02-02T20:42:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da0064dd0 0x7f0da0067290 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db40f66e0 0x7f0db4106f60 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 --2- 172.21.15.96:0/1257494712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db40f7980 0x7f0db4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 >> 172.21.15.96:0/1257494712 conn(0x7f0db40f1e40 msgr2=0x7f0db40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 shutdown_connections 2022-02-02T20:42:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.156+0000 7f0dba2dd700 1 -- 172.21.15.96:0/1257494712 wait complete. 2022-02-02T20:42:48.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 -- 172.21.15.96:0/3246938823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f7d40 msgr2=0x7f8a6c0f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 --2- 172.21.15.96:0/3246938823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c0f8160 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 rx=0x7f8a5c004660 tx=0x7f8a5c009b30).stop 2022-02-02T20:42:48.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 -- 172.21.15.96:0/3246938823 shutdown_connections 2022-02-02T20:42:48.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 --2- 172.21.15.96:0/3246938823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c0f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 --2- 172.21.15.96:0/3246938823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c0f8160 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 -- 172.21.15.96:0/3246938823 >> 172.21.15.96:0/3246938823 conn(0x7f8a6c0f04c0 msgr2=0x7f8a6c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:48.260 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:47 smithi096 ceph-mon[101353]: pgmap v4221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:48.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.253+0000 7f8a72067700 1 -- 172.21.15.96:0/3246938823 shutdown_connections 2022-02-02T20:42:48.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 -- 172.21.15.96:0/3246938823 wait complete. 2022-02-02T20:42:48.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 Processor -- start 2022-02-02T20:42:48.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 -- start start 2022-02-02T20:42:48.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c107ad0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.254+0000 7f8a72067700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c107c10 con 0x7f8a6c0f7d40 2022-02-02T20:42:48.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38668/0 (socket says 172.21.15.96:38668) 2022-02-02T20:42:48.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 -- 172.21.15.96:0/2504818770 learned_addr learned my addr 172.21.15.96:0/2504818770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:48.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6b7fe700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 -- 172.21.15.96:0/2504818770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f7d40 msgr2=0x7f8a6c107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 -- 172.21.15.96:0/2504818770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c005040 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a6affd700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f8a540026d0 tx=0x7f8a54009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:48.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a54009320 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c1085b0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a5400f040 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a540148f0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.255+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c108b70 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.256+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c045ad0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.257+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a5401b060 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.257+0000 7f8a63fff700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 0x7f8a58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.257+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a540819a0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.257+0000 7f8a6b7fe700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 0x7f8a58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.258+0000 7f8a6b7fe700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 0x7f8a58067290 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f8a5c009da0 tx=0x7f8a5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:48.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.261+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a540534d0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:47 smithi159 ceph-mon[69013]: pgmap v4221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.494+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a6c027a00 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.495+0000 7f8a63fff700 1 -- 172.21.15.96:0/2504818770 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8a540530c0 con 0x7f8a6c0f86e0 2022-02-02T20:42:48.499 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:42:48.500 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:42:48.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:42:48.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:48.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:42:48.501 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:42:48.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:48.502 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:42:48.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:42:48.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:48.503 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:42:48.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:42:48.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:42:48.505 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:42:48.505 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:42:48.505 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:42:48.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:42:48.507 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:42:48.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.496+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 msgr2=0x7f8a58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.496+0000 7f8a72067700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 0x7f8a58067290 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f8a5c009da0 tx=0x7f8a5c009b30).stop 2022-02-02T20:42:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.496+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 msgr2=0x7f8a6c107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.496+0000 7f8a72067700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f8a540026d0 tx=0x7f8a54009de0).stop 2022-02-02T20:42:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 shutdown_connections 2022-02-02T20:42:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a58064dd0 0x7f8a58067290 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a6c0f7d40 0x7f8a6c107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 --2- 172.21.15.96:0/2504818770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a6c0f86e0 0x7f8a6c107520 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 >> 172.21.15.96:0/2504818770 conn(0x7f8a6c0f04c0 msgr2=0x7f8a6c0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 shutdown_connections 2022-02-02T20:42:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.497+0000 7f8a72067700 1 -- 172.21.15.96:0/2504818770 wait complete. 2022-02-02T20:42:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- 172.21.15.96:0/3293052772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f6860 msgr2=0x7fb63c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3293052772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f6860 0x7fb63c0f6cc0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 rx=0x7fb62c004660 tx=0x7fb62c009b30).stop 2022-02-02T20:42:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- 172.21.15.96:0/3293052772 shutdown_connections 2022-02-02T20:42:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3293052772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f6860 0x7fb63c0f6cc0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3293052772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f55c0 0x7fb63c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- 172.21.15.96:0/3293052772 >> 172.21.15.96:0/3293052772 conn(0x7fb63c0f0d40 msgr2=0x7fb63c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- 172.21.15.96:0/3293052772 shutdown_connections 2022-02-02T20:42:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- 172.21.15.96:0/3293052772 wait complete. 2022-02-02T20:42:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 Processor -- start 2022-02-02T20:42:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.595+0000 7fb6408d7700 1 -- start start 2022-02-02T20:42:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb6408d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb6408d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f6860 0x7fb63c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb6408d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0603e0 con 0x7fb63c0f55c0 2022-02-02T20:42:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb6408d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c060520 con 0x7fb63c0f6860 2022-02-02T20:42:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38676/0 (socket says 172.21.15.96:38676) 2022-02-02T20:42:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 -- 172.21.15.96:0/3127665528 learned_addr learned my addr 172.21.15.96:0/3127665528 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:42:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb639d9b700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f6860 0x7fb63c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 -- 172.21.15.96:0/3127665528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f6860 msgr2=0x7fb63c10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f6860 0x7fb63c10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 -- 172.21.15.96:0/3127665528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c005040 con 0x7fb63c0f55c0 2022-02-02T20:42:48.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb63a59c700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7fb63000c790 tx=0x7fb630007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:48.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb63000e680 con 0x7fb63c0f55c0 2022-02-02T20:42:48.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c10c700 con 0x7fb63c0f55c0 2022-02-02T20:42:48.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.596+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb63000ec90 con 0x7fb63c0f55c0 2022-02-02T20:42:48.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.597+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c10ccc0 con 0x7fb63c0f55c0 2022-02-02T20:42:48.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.597+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb630012d00 con 0x7fb63c0f55c0 2022-02-02T20:42:48.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.598+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c045ad0 con 0x7fb63c0f55c0 2022-02-02T20:42:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.598+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb630010070 con 0x7fb63c0f55c0 2022-02-02T20:42:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.598+0000 7fb62affd700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:42:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.598+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb630081b70 con 0x7fb63c0f55c0 2022-02-02T20:42:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.598+0000 7fb639d9b700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:42:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.599+0000 7fb639d9b700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 0x7fb624067290 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fb62c009da0 tx=0x7fb62c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:42:48.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.602+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb63004fc10 con 0x7fb63c0f55c0 2022-02-02T20:42:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.803+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb63c0fdd80 con 0x7fb63c0f55c0 2022-02-02T20:42:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.804+0000 7fb62affd700 1 -- 172.21.15.96:0/3127665528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb630053230 con 0x7fb63c0f55c0 2022-02-02T20:42:48.807 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:42:48.807 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:42:48.807 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:42:48.807 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:42:48.808 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:48.808 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:42:48.808 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:42:48.808 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:42:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:42:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:42:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:42:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:42:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:42:48.810 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:42:48.810 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:42:48.810 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:42:48.810 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:42:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:42:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:42:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:42:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:42:48.812 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:42:48.812 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:42:48.813 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:42:48.813 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:42:48.813 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:42:48.813 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:42:48.813 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:42:48.814 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:42:48.814 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:42:48.814 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:42:48.814 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:42:48.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:48.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:48.815 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:42:48.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:42:48.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:48.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:48.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:42:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 msgr2=0x7fb624067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 0x7fb624067290 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fb62c009da0 tx=0x7fb62c009b30).stop 2022-02-02T20:42:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 msgr2=0x7fb63c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:42:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7fb63000c790 tx=0x7fb630007d90).stop 2022-02-02T20:42:48.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 shutdown_connections 2022-02-02T20:42:48.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c0f55c0 0x7fb63c109c50 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 --2- 172.21.15.96:0/3127665528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb63c0f6860 0x7fb63c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:42:48.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.805+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 >> 172.21.15.96:0/3127665528 conn(0x7fb63c0f0d40 msgr2=0x7fb63c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:42:48.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.806+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 shutdown_connections 2022-02-02T20:42:48.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:42:48.806+0000 7fb6408d7700 1 -- 172.21.15.96:0/3127665528 wait complete. 2022-02-02T20:42:48.822 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:42:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:48 smithi159 ceph-mon[69013]: from='client.38436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:48 smithi159 ceph-mon[69013]: from='client.38440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:49.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2504818770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:42:49.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3127665528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:42:49.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:48 smithi096 ceph-mon[101353]: from='client.38436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:49.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:48 smithi096 ceph-mon[101353]: from='client.38440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:42:49.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2504818770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:42:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3127665528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:42:50.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:49 smithi159 ceph-mon[69013]: pgmap v4222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:50.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:49 smithi096 ceph-mon[101353]: pgmap v4222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:52 smithi159 ceph-mon[69013]: pgmap v4223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:52 smithi096 ceph-mon[101353]: pgmap v4223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:54 smithi159 ceph-mon[69013]: pgmap v4224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:54 smithi096 ceph-mon[101353]: pgmap v4224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:56 smithi159 ceph-mon[69013]: pgmap v4225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:56 smithi096 ceph-mon[101353]: pgmap v4225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:42:57 smithi159 ceph-mon[69013]: pgmap v4226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:42:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:42:57 smithi096 ceph-mon[101353]: pgmap v4226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:00 smithi159 ceph-mon[69013]: pgmap v4227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:00 smithi096 ceph-mon[101353]: pgmap v4227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:02 smithi159 ceph-mon[69013]: pgmap v4228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:02 smithi096 ceph-mon[101353]: pgmap v4228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:04.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:04 smithi159 ceph-mon[69013]: pgmap v4229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:04 smithi096 ceph-mon[101353]: pgmap v4229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:06 smithi159 ceph-mon[69013]: pgmap v4230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:06 smithi096 ceph-mon[101353]: pgmap v4230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:07 smithi159 ceph-mon[69013]: pgmap v4231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:07 smithi096 ceph-mon[101353]: pgmap v4231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:10 smithi159 ceph-mon[69013]: pgmap v4232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:10 smithi096 ceph-mon[101353]: pgmap v4232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:12 smithi159 ceph-mon[69013]: pgmap v4233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:12 smithi096 ceph-mon[101353]: pgmap v4233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:14 smithi159 ceph-mon[69013]: pgmap v4234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:14 smithi096 ceph-mon[101353]: pgmap v4234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:16 smithi159 ceph-mon[69013]: pgmap v4235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:16 smithi096 ceph-mon[101353]: pgmap v4235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:17 smithi159 ceph-mon[69013]: pgmap v4236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:17 smithi096 ceph-mon[101353]: pgmap v4236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.916+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/3864795538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f77d0 msgr2=0x7fb6e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:18.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/3864795538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f77d0 0x7fb6e80f7c30 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7fb6d8004660 tx=0x7fb6d8009b30).stop 2022-02-02T20:43:18.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/3864795538 shutdown_connections 2022-02-02T20:43:18.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/3864795538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f77d0 0x7fb6e80f7c30 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:18.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/3864795538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f6530 0x7fb6e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:18.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/3864795538 >> 172.21.15.96:0/3864795538 conn(0x7fb6e80f1c90 msgr2=0x7fb6e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:18.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/3864795538 shutdown_connections 2022-02-02T20:43:18.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.917+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/3864795538 wait complete. 2022-02-02T20:43:18.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 Processor -- start 2022-02-02T20:43:18.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 -- start start 2022-02-02T20:43:18.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:18.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 0x7fb6e8107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:18.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81077f0 con 0x7fb6e80f6530 2022-02-02T20:43:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ef1b1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e8107ff0 con 0x7fb6e80f77d0 2022-02-02T20:43:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ee1af700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ee1af700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38694/0 (socket says 172.21.15.96:38694) 2022-02-02T20:43:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ee1af700 1 -- 172.21.15.96:0/2951366136 learned_addr learned my addr 172.21.15.96:0/2951366136 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:18.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.918+0000 7fb6ed9ae700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 0x7fb6e8107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:18.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ee1af700 1 -- 172.21.15.96:0/2951366136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 msgr2=0x7fb6e8107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:18.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ee1af700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 0x7fb6e8107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:18.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ee1af700 1 -- 172.21.15.96:0/2951366136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8005040 con 0x7fb6e80f6530 2022-02-02T20:43:18.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ed9ae700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 0x7fb6e8107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:43:18.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ee1af700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7fb6e4002700 tx=0x7fb6e4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:18.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6e4009320 con 0x7fb6e80f6530 2022-02-02T20:43:18.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb6e400f040 con 0x7fb6e80f6530 2022-02-02T20:43:18.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e81082d0 con 0x7fb6e80f6530 2022-02-02T20:43:18.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6e4014900 con 0x7fb6e80f6530 2022-02-02T20:43:18.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.919+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e8108890 con 0x7fb6e80f6530 2022-02-02T20:43:18.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.920+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8059100 con 0x7fb6e80f6530 2022-02-02T20:43:18.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.920+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb6e4009480 con 0x7fb6e80f6530 2022-02-02T20:43:18.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.921+0000 7fb6deffd700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 0x7fb6d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:18.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.921+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb6e4081cc0 con 0x7fb6e80f6530 2022-02-02T20:43:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.921+0000 7fb6ed9ae700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 0x7fb6d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.921+0000 7fb6ed9ae700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 0x7fb6d40672e0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fb6d8004e30 tx=0x7fb6d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:18.925+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb6e40538b0 con 0x7fb6e80f6530 2022-02-02T20:43:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.101+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6e80008d0 con 0x7fb6d4064e20 2022-02-02T20:43:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.103+0000 7fb6deffd700 1 -- 172.21.15.96:0/2951366136 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb6e80008d0 con 0x7fb6d4064e20 2022-02-02T20:43:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 msgr2=0x7fb6d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 0x7fb6d40672e0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fb6d8004e30 tx=0x7fb6d8009b30).stop 2022-02-02T20:43:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 msgr2=0x7fb6e8106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7fb6e4002700 tx=0x7fb6e4009d80).stop 2022-02-02T20:43:19.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 shutdown_connections 2022-02-02T20:43:19.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6d4064e20 0x7fb6d40672e0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e80f6530 0x7fb6e8106d50 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 --2- 172.21.15.96:0/2951366136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e80f77d0 0x7fb6e8107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 >> 172.21.15.96:0/2951366136 conn(0x7fb6e80f1c90 msgr2=0x7fb6e80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 shutdown_connections 2022-02-02T20:43:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.104+0000 7fb6ef1b1700 1 -- 172.21.15.96:0/2951366136 wait complete. 2022-02-02T20:43:19.115 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:43:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 -- 172.21.15.96:0/855293621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f5430 msgr2=0x7feaf80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 --2- 172.21.15.96:0/855293621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f5430 0x7feaf80f5850 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 rx=0x7feae8004660 tx=0x7feae8009b30).stop 2022-02-02T20:43:19.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 -- 172.21.15.96:0/855293621 shutdown_connections 2022-02-02T20:43:19.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 --2- 172.21.15.96:0/855293621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f66d0 0x7feaf80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:19.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 --2- 172.21.15.96:0/855293621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f5430 0x7feaf80f5850 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 -- 172.21.15.96:0/855293621 >> 172.21.15.96:0/855293621 conn(0x7feaf80f0b90 msgr2=0x7feaf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 -- 172.21.15.96:0/855293621 shutdown_connections 2022-02-02T20:43:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.201+0000 7feafd6b3700 1 -- 172.21.15.96:0/855293621 wait complete. 2022-02-02T20:43:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 Processor -- start 2022-02-02T20:43:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 -- start start 2022-02-02T20:43:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 0x7feaf8109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8060450 con 0x7feaf80f66d0 2022-02-02T20:43:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.202+0000 7feafd6b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8060590 con 0x7feaf80f5430 2022-02-02T20:43:19.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38706/0 (socket says 172.21.15.96:38706) 2022-02-02T20:43:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 -- 172.21.15.96:0/1670365142 learned_addr learned my addr 172.21.15.96:0/1670365142 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf7fff700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 0x7feaf8109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 -- 172.21.15.96:0/1670365142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 msgr2=0x7feaf8109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 0x7feaf8109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 -- 172.21.15.96:0/1670365142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8005040 con 0x7feaf80f66d0 2022-02-02T20:43:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf7fff700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 0x7feaf8109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:43:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf77fe700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7feaec00b410 tx=0x7feaec006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaec0125f0 con 0x7feaf80f66d0 2022-02-02T20:43:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf810c5e0 con 0x7feaf80f66d0 2022-02-02T20:43:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feaec00be80 con 0x7feaf80f66d0 2022-02-02T20:43:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaec002ac0 con 0x7feaf80f66d0 2022-02-02T20:43:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.203+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf810cba0 con 0x7feaf80f66d0 2022-02-02T20:43:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.204+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8045ad0 con 0x7feaf80f66d0 2022-02-02T20:43:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.205+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feaec00f030 con 0x7feaf80f66d0 2022-02-02T20:43:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.205+0000 7feaf4ff9700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 0x7feae00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.205+0000 7feaf7fff700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 0x7feae00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.205+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feaec081f80 con 0x7feaf80f66d0 2022-02-02T20:43:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.206+0000 7feaf7fff700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 0x7feae00672e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7feae8004e30 tx=0x7feae8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.209+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feaec050080 con 0x7feaf80f66d0 2022-02-02T20:43:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.383+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feaf80008d0 con 0x7feae0064e20 2022-02-02T20:43:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.393+0000 7feaf4ff9700 1 -- 172.21.15.96:0/1670365142 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7feaf80008d0 con 0x7feae0064e20 2022-02-02T20:43:19.394 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:43:19.395 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 117m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:43:19.395 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 117m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:43:19.395 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 115m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:43:19.395 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 117m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:43:19.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 117m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:43:19.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 117m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:43:19.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 115m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:43:19.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 115m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:43:19.397 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 117m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:43:19.397 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 115m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:43:19.398 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 117m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:43:19.398 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 115m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:43:19.398 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 117m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:43:19.398 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 115m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:43:19.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 117m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:43:19.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 117m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:43:19.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 117m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:43:19.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 115m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:43:19.399 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 115m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:43:19.400 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 115m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:43:19.400 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 117m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:43:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 msgr2=0x7feae00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 0x7feae00672e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7feae8004e30 tx=0x7feae8009b30).stop 2022-02-02T20:43:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 msgr2=0x7feaf810bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7feaec00b410 tx=0x7feaec006ef0).stop 2022-02-02T20:43:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 shutdown_connections 2022-02-02T20:43:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feae0064e20 0x7feae00672e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf80f5430 0x7feaf8109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 --2- 172.21.15.96:0/1670365142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf80f66d0 0x7feaf810bfd0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 >> 172.21.15.96:0/1670365142 conn(0x7feaf80f0b90 msgr2=0x7feaf80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 shutdown_connections 2022-02-02T20:43:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.395+0000 7feafd6b3700 1 -- 172.21.15.96:0/1670365142 wait complete. 2022-02-02T20:43:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/81392126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 msgr2=0x7f7a580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/81392126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a580f6cc0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 rx=0x7f7a48004660 tx=0x7f7a48009b30).stop 2022-02-02T20:43:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/81392126 shutdown_connections 2022-02-02T20:43:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/81392126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a580f6cc0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/81392126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 0x7f7a580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/81392126 >> 172.21.15.96:0/81392126 conn(0x7f7a580f0d40 msgr2=0x7f7a580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/81392126 shutdown_connections 2022-02-02T20:43:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/81392126 wait complete. 2022-02-02T20:43:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.492+0000 7f7a5ddf4700 1 Processor -- start 2022-02-02T20:43:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a5ddf4700 1 -- start start 2022-02-02T20:43:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a5ddf4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 0x7f7a58109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a5ddf4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a5ddf4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58060470 con 0x7f7a580f6860 2022-02-02T20:43:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a5ddf4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580605b0 con 0x7f7a580f55c0 2022-02-02T20:43:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38716/0 (socket says 172.21.15.96:38716) 2022-02-02T20:43:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 -- 172.21.15.96:0/2173026323 learned_addr learned my addr 172.21.15.96:0/2173026323 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a577fe700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 0x7f7a58109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 -- 172.21.15.96:0/2173026323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 msgr2=0x7f7a58109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 0x7f7a58109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 -- 172.21.15.96:0/2173026323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48005040 con 0x7f7a580f6860 2022-02-02T20:43:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.493+0000 7f7a56ffd700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7f7a48009990 tx=0x7f7a48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.494+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a48018070 con 0x7f7a580f6860 2022-02-02T20:43:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.494+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5810c7b0 con 0x7f7a580f6860 2022-02-02T20:43:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.494+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a48007ba0 con 0x7f7a580f6860 2022-02-02T20:43:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.494+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4801c620 con 0x7f7a580f6860 2022-02-02T20:43:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.494+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5810cce0 con 0x7f7a580f6860 2022-02-02T20:43:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.495+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a4801d420 con 0x7f7a580f6860 2022-02-02T20:43:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.495+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a580f49b0 con 0x7f7a580f6860 2022-02-02T20:43:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.495+0000 7f7a3ffff700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 0x7f7a40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.495+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a48083880 con 0x7f7a580f6860 2022-02-02T20:43:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.496+0000 7f7a577fe700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 0x7f7a40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.496+0000 7f7a577fe700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 0x7f7a40067290 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f7a58060060 tx=0x7f7a4c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.500+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a48051a40 con 0x7f7a580f6860 2022-02-02T20:43:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.730+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a580fde20 con 0x7f7a580f6860 2022-02-02T20:43:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.730+0000 7f7a3ffff700 1 -- 172.21.15.96:0/2173026323 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7a48055060 con 0x7f7a580f6860 2022-02-02T20:43:19.732 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:43:19.732 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:43:19.732 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:43:19.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:19.733 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:43:19.733 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:43:19.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:19.734 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:43:19.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:43:19.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:19.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:43:19.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:43:19.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:19.735 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:43:19.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:43:19.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:43:19.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:43:19.736 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 msgr2=0x7f7a40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 0x7f7a40067290 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f7a58060060 tx=0x7f7a4c008040).stop 2022-02-02T20:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 msgr2=0x7f7a5810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7f7a48009990 tx=0x7f7a48009b30).stop 2022-02-02T20:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 shutdown_connections 2022-02-02T20:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a40064dd0 0x7f7a40067290 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a580f55c0 0x7f7a58109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 --2- 172.21.15.96:0/2173026323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a580f6860 0x7f7a5810c1b0 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 >> 172.21.15.96:0/2173026323 conn(0x7f7a580f0d40 msgr2=0x7f7a580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 shutdown_connections 2022-02-02T20:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.732+0000 7f7a5ddf4700 1 -- 172.21.15.96:0/2173026323 wait complete. 2022-02-02T20:43:19.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 -- 172.21.15.96:0/4265988935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f6860 msgr2=0x7f341c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 --2- 172.21.15.96:0/4265988935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f6860 0x7f341c0f6cc0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 rx=0x7f340c004660 tx=0x7f340c009b30).stop 2022-02-02T20:43:19.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 -- 172.21.15.96:0/4265988935 shutdown_connections 2022-02-02T20:43:19.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 --2- 172.21.15.96:0/4265988935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f6860 0x7f341c0f6cc0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 --2- 172.21.15.96:0/4265988935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f341c0f55c0 0x7f341c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:19.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 -- 172.21.15.96:0/4265988935 >> 172.21.15.96:0/4265988935 conn(0x7f341c0f0d40 msgr2=0x7f341c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:19.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 -- 172.21.15.96:0/4265988935 shutdown_connections 2022-02-02T20:43:19.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.830+0000 7f3420b18700 1 -- 172.21.15.96:0/4265988935 wait complete. 2022-02-02T20:43:19.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 Processor -- start 2022-02-02T20:43:19.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 -- start start 2022-02-02T20:43:19.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f341c0f6860 0x7f341c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c107a10 con 0x7f341c0f55c0 2022-02-02T20:43:19.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f3420b18700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c107b50 con 0x7f341c0f6860 2022-02-02T20:43:19.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38724/0 (socket says 172.21.15.96:38724) 2022-02-02T20:43:19.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 -- 172.21.15.96:0/1587684857 learned_addr learned my addr 172.21.15.96:0/1587684857 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:19.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 -- 172.21.15.96:0/1587684857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f341c0f6860 msgr2=0x7f341c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:19.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f341c0f6860 0x7f341c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:19.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.831+0000 7f341a59c700 1 -- 172.21.15.96:0/1587684857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c005040 con 0x7f341c0f55c0 2022-02-02T20:43:19.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f341a59c700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 rx=0x7f3404002700 tx=0x7f3404009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3404009320 con 0x7f341c0f55c0 2022-02-02T20:43:19.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f340400f040 con 0x7f341c0f55c0 2022-02-02T20:43:19.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c1084f0 con 0x7f341c0f55c0 2022-02-02T20:43:19.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3404014900 con 0x7f341c0f55c0 2022-02-02T20:43:19.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.832+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c108ab0 con 0x7f341c0f55c0 2022-02-02T20:43:19.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.833+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c045ad0 con 0x7f341c0f55c0 2022-02-02T20:43:19.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.833+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3404009480 con 0x7f341c0f55c0 2022-02-02T20:43:19.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.834+0000 7f3412ffd700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 0x7f3408067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:19.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.834+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3404081cc0 con 0x7f341c0f55c0 2022-02-02T20:43:19.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.834+0000 7f3419d9b700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 0x7f3408067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:19.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.834+0000 7f3419d9b700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 0x7f3408067290 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f340c004e30 tx=0x7f340c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:19.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:19.838+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f34040538b0 con 0x7f341c0f55c0 2022-02-02T20:43:20.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.037+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f341c10d5c0 con 0x7f341c0f55c0 2022-02-02T20:43:20.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.037+0000 7f3412ffd700 1 -- 172.21.15.96:0/1587684857 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f34040534a0 con 0x7f341c0f55c0 2022-02-02T20:43:20.039 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:43:20.039 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:43:20.040 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:43:20.040 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:43:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:20.040 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:43:20.041 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:43:20.041 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:43:20.041 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:43:20.041 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:43:20.042 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:43:20.042 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:43:20.042 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:43:20.042 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:43:20.043 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:43:20.043 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:43:20.043 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:43:20.043 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:43:20.043 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:43:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:43:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:43:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:43:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:43:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:43:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:43:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:43:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:43:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:43:20.046 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:43:20.046 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:43:20.046 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:43:20.046 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:43:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:20.047 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:43:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:20.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:20.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:20.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 msgr2=0x7f3408067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 0x7f3408067290 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f340c004e30 tx=0x7f340c009b30).stop 2022-02-02T20:43:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 msgr2=0x7f341c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 rx=0x7f3404002700 tx=0x7f3404009d80).stop 2022-02-02T20:43:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 shutdown_connections 2022-02-02T20:43:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3408064dd0 0x7f3408067290 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f341c0f55c0 0x7f341c106f70 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 --2- 172.21.15.96:0/1587684857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f341c0f6860 0x7f341c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 >> 172.21.15.96:0/1587684857 conn(0x7f341c0f0d40 msgr2=0x7f341c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 shutdown_connections 2022-02-02T20:43:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:20.039+0000 7f3420b18700 1 -- 172.21.15.96:0/1587684857 wait complete. 2022-02-02T20:43:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:43:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:20 smithi159 ceph-mon[69013]: from='client.38452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:20 smithi159 ceph-mon[69013]: from='client.38456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:20.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:20 smithi159 ceph-mon[69013]: pgmap v4237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:20.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2173026323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:43:20.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1587684857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:43:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:20 smithi096 ceph-mon[101353]: from='client.38452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:20 smithi096 ceph-mon[101353]: from='client.38456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:20 smithi096 ceph-mon[101353]: pgmap v4237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:20.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2173026323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:43:20.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1587684857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:43:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:22 smithi159 ceph-mon[69013]: pgmap v4238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:22 smithi096 ceph-mon[101353]: pgmap v4238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:24 smithi159 ceph-mon[69013]: pgmap v4239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:24 smithi096 ceph-mon[101353]: pgmap v4239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:26 smithi159 ceph-mon[69013]: pgmap v4240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:26 smithi096 ceph-mon[101353]: pgmap v4240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:27 smithi159 ceph-mon[69013]: pgmap v4241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:43:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:43:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:27 smithi096 ceph-mon[101353]: pgmap v4241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:43:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:43:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:30 smithi159 ceph-mon[69013]: pgmap v4242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:30 smithi096 ceph-mon[101353]: pgmap v4242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:32 smithi159 ceph-mon[69013]: pgmap v4243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:32 smithi096 ceph-mon[101353]: pgmap v4243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:34 smithi159 ceph-mon[69013]: pgmap v4244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:34 smithi096 ceph-mon[101353]: pgmap v4244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:36 smithi159 ceph-mon[69013]: pgmap v4245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:36 smithi096 ceph-mon[101353]: pgmap v4245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:37 smithi159 ceph-mon[69013]: pgmap v4246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:37 smithi096 ceph-mon[101353]: pgmap v4246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:40 smithi159 ceph-mon[69013]: pgmap v4247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:40 smithi096 ceph-mon[101353]: pgmap v4247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:42 smithi159 ceph-mon[69013]: pgmap v4248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:42 smithi096 ceph-mon[101353]: pgmap v4248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:44 smithi159 ceph-mon[69013]: pgmap v4249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:44 smithi096 ceph-mon[101353]: pgmap v4249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:46 smithi159 ceph-mon[69013]: pgmap v4250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:46 smithi096 ceph-mon[101353]: pgmap v4250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:47 smithi159 ceph-mon[69013]: pgmap v4251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:47 smithi096 ceph-mon[101353]: pgmap v4251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:50.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 -- 172.21.15.96:0/16389679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 msgr2=0x7f0ca80f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 --2- 172.21.15.96:0/16389679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f7ac0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 rx=0x7f0ca4004660 tx=0x7f0ca4009b30).stop 2022-02-02T20:43:50.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 -- 172.21.15.96:0/16389679 shutdown_connections 2022-02-02T20:43:50.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 --2- 172.21.15.96:0/16389679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f7ac0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 --2- 172.21.15.96:0/16389679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:50.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 -- 172.21.15.96:0/16389679 >> 172.21.15.96:0/16389679 conn(0x7f0ca80f04c0 msgr2=0x7f0ca80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 -- 172.21.15.96:0/16389679 shutdown_connections 2022-02-02T20:43:50.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.149+0000 7f0caf730700 1 -- 172.21.15.96:0/16389679 wait complete. 2022-02-02T20:43:50.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 Processor -- start 2022-02-02T20:43:50.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 -- start start 2022-02-02T20:43:50.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80f5fc0 con 0x7f0ca80f5340 2022-02-02T20:43:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0caf730700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80f6100 con 0x7f0ca80f49a0 2022-02-02T20:43:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38744/0 (socket says 172.21.15.96:38744) 2022-02-02T20:43:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 -- 172.21.15.96:0/2513108906 learned_addr learned my addr 172.21.15.96:0/2513108906 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cad4cc700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 -- 172.21.15.96:0/2513108906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 msgr2=0x7f0ca80f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 -- 172.21.15.96:0/2513108906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4005040 con 0x7f0ca80f5340 2022-02-02T20:43:50.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cad4cc700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:43:50.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.150+0000 7f0cacccb700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7f0ca4009830 tx=0x7f0ca4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.151+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca4018070 con 0x7f0ca80f5340 2022-02-02T20:43:50.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.151+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80f6380 con 0x7f0ca80f5340 2022-02-02T20:43:50.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.151+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ca4007c70 con 0x7f0ca80f5340 2022-02-02T20:43:50.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.151+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca401c620 con 0x7f0ca80f5340 2022-02-02T20:43:50.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.151+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca810f070 con 0x7f0ca80f5340 2022-02-02T20:43:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.152+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8045ad0 con 0x7f0ca80f5340 2022-02-02T20:43:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.153+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ca401c8e0 con 0x7f0ca80f5340 2022-02-02T20:43:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.153+0000 7f0c9dffb700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 0x7f0c94067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.153+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ca4083810 con 0x7f0ca80f5340 2022-02-02T20:43:50.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.153+0000 7f0cad4cc700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 0x7f0c94067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.154+0000 7f0cad4cc700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 0x7f0c94067270 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0ca80f72e0 tx=0x7f0c98008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.157+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ca40519d0 con 0x7f0ca80f5340 2022-02-02T20:43:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.338+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca80ff070 con 0x7f0c94064db0 2022-02-02T20:43:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.339+0000 7f0c9dffb700 1 -- 172.21.15.96:0/2513108906 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0ca80ff070 con 0x7f0c94064db0 2022-02-02T20:43:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 msgr2=0x7f0c94067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 0x7f0c94067270 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0ca80f72e0 tx=0x7f0c98008040).stop 2022-02-02T20:43:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 msgr2=0x7f0ca80f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7f0ca4009830 tx=0x7f0ca4009b30).stop 2022-02-02T20:43:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 shutdown_connections 2022-02-02T20:43:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c94064db0 0x7f0c94067270 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca80f49a0 0x7f0ca80f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 --2- 172.21.15.96:0/2513108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca80f5340 0x7f0ca80f59d0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 >> 172.21.15.96:0/2513108906 conn(0x7f0ca80f04c0 msgr2=0x7f0ca80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 shutdown_connections 2022-02-02T20:43:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.341+0000 7f0caf730700 1 -- 172.21.15.96:0/2513108906 wait complete. 2022-02-02T20:43:50.352 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:43:50.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 -- 172.21.15.96:0/2218264363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f55c0 msgr2=0x7fd9cc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/2218264363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc0f59e0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 rx=0x7fd9c0004660 tx=0x7fd9c0009b30).stop 2022-02-02T20:43:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 -- 172.21.15.96:0/2218264363 shutdown_connections 2022-02-02T20:43:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/2218264363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/2218264363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc0f59e0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 -- 172.21.15.96:0/2218264363 >> 172.21.15.96:0/2218264363 conn(0x7fd9cc0f0d40 msgr2=0x7fd9cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 -- 172.21.15.96:0/2218264363 shutdown_connections 2022-02-02T20:43:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.439+0000 7fd9d30a0700 1 -- 172.21.15.96:0/2218264363 wait complete. 2022-02-02T20:43:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 Processor -- start 2022-02-02T20:43:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 -- start start 2022-02-02T20:43:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0603e0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d30a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc060520 con 0x7fd9cc0f55c0 2022-02-02T20:43:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9cbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9cbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38752/0 (socket says 172.21.15.96:38752) 2022-02-02T20:43:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9cbfff700 1 -- 172.21.15.96:0/969715955 learned_addr learned my addr 172.21.15.96:0/969715955 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.440+0000 7fd9d0e3c700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9cbfff700 1 -- 172.21.15.96:0/969715955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f55c0 msgr2=0x7fd9cc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9cbfff700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9cbfff700 1 -- 172.21.15.96:0/969715955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0005040 con 0x7fd9cc0f6860 2022-02-02T20:43:50.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9cbfff700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7fd9b80026d0 tx=0x7fd9b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b80079c0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9b800f040 con 0x7fd9cc0f6860 2022-02-02T20:43:50.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc10c720 con 0x7fd9cc0f6860 2022-02-02T20:43:50.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc10cce0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.441+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b80148b0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.442+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac004fa0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.443+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9b8014a10 con 0x7fd9cc0f6860 2022-02-02T20:43:50.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.443+0000 7fd9c97fa700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 0x7fd9bc067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.443+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9b80817f0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.443+0000 7fd9d0e3c700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 0x7fd9bc067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.444+0000 7fd9d0e3c700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 0x7fd9bc067360 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd9c0013690 tx=0x7fd9c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.448+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9b804f8b0 con 0x7fd9cc0f6860 2022-02-02T20:43:50.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.622+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9ac000bc0 con 0x7fd9bc064ea0 2022-02-02T20:43:50.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.631+0000 7fd9c97fa700 1 -- 172.21.15.96:0/969715955 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd9ac000bc0 con 0x7fd9bc064ea0 2022-02-02T20:43:50.633 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:43:50.633 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 117m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:43:50.633 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 117m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:43:50.634 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 116m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:43:50.634 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 117m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:43:50.634 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 117m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:43:50.634 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 117m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:43:50.635 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 116m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:43:50.635 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 116m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:43:50.635 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 117m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:43:50.635 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 116m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:43:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 117m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:43:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 116m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:43:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 117m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:43:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 116m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:43:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 117m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:43:50.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 117m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:43:50.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 117m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:43:50.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 116m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:43:50.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 116m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:43:50.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 116m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:43:50.638 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 117m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:43:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 msgr2=0x7fd9bc067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 0x7fd9bc067360 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd9c0013690 tx=0x7fd9c0009b30).stop 2022-02-02T20:43:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 msgr2=0x7fd9cc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7fd9b80026d0 tx=0x7fd9b8009de0).stop 2022-02-02T20:43:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 shutdown_connections 2022-02-02T20:43:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd9bc064ea0 0x7fd9bc067360 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9cc0f55c0 0x7fd9cc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 --2- 172.21.15.96:0/969715955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9cc0f6860 0x7fd9cc10c170 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 >> 172.21.15.96:0/969715955 conn(0x7fd9cc0f0d40 msgr2=0x7fd9cc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.633+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 shutdown_connections 2022-02-02T20:43:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.634+0000 7fd9d30a0700 1 -- 172.21.15.96:0/969715955 wait complete. 2022-02-02T20:43:50.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 -- 172.21.15.96:0/3203472033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f66e0 msgr2=0x7f92a00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 --2- 172.21.15.96:0/3203472033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f66e0 0x7f92a00f6b00 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 rx=0x7f9294004660 tx=0x7f9294009b30).stop 2022-02-02T20:43:50.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 -- 172.21.15.96:0/3203472033 shutdown_connections 2022-02-02T20:43:50.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 --2- 172.21.15.96:0/3203472033 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f7980 0x7f92a00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 --2- 172.21.15.96:0/3203472033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f66e0 0x7f92a00f6b00 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 -- 172.21.15.96:0/3203472033 >> 172.21.15.96:0/3203472033 conn(0x7f92a00f1e40 msgr2=0x7f92a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.734 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:50 smithi096 ceph-mon[101353]: pgmap v4252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:50.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.730+0000 7f92a4b56700 1 -- 172.21.15.96:0/3203472033 shutdown_connections 2022-02-02T20:43:50.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 -- 172.21.15.96:0/3203472033 wait complete. 2022-02-02T20:43:50.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 Processor -- start 2022-02-02T20:43:50.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 -- start start 2022-02-02T20:43:50.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f66e0 0x7f92a0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0107a50 con 0x7f92a00f7980 2022-02-02T20:43:50.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f92a4b56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0107b90 con 0x7f92a00f66e0 2022-02-02T20:43:50.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f929dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f929dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38762/0 (socket says 172.21.15.96:38762) 2022-02-02T20:43:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f929dd9b700 1 -- 172.21.15.96:0/2847744945 learned_addr learned my addr 172.21.15.96:0/2847744945 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.731+0000 7f929e59c700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f66e0 0x7f92a0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f929dd9b700 1 -- 172.21.15.96:0/2847744945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f66e0 msgr2=0x7f92a0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f929dd9b700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f66e0 0x7f92a0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f929dd9b700 1 -- 172.21.15.96:0/2847744945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294005040 con 0x7f92a00f7980 2022-02-02T20:43:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f929dd9b700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f929000c790 tx=0x7f9290007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9290002590 con 0x7f92a00f7980 2022-02-02T20:43:50.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a0108530 con 0x7f92a00f7980 2022-02-02T20:43:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9290002ba0 con 0x7f92a00f7980 2022-02-02T20:43:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9290013d90 con 0x7f92a00f7980 2022-02-02T20:43:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.732+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0108af0 con 0x7f92a00f7980 2022-02-02T20:43:50.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.733+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0045ad0 con 0x7f92a00f7980 2022-02-02T20:43:50.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.734+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f929001a060 con 0x7f92a00f7980 2022-02-02T20:43:50.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.734+0000 7f928effd700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 0x7f9288067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:50.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.734+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9290081cf0 con 0x7f92a00f7980 2022-02-02T20:43:50.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.734+0000 7f929e59c700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 0x7f9288067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:50.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.735+0000 7f929e59c700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 0x7f9288067290 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f9294004630 tx=0x7f9294009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:50.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.738+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f92900537c0 con 0x7f92a00f7980 2022-02-02T20:43:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:50 smithi159 ceph-mon[69013]: pgmap v4252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:50.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.966+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92a0027a00 con 0x7f92a00f7980 2022-02-02T20:43:50.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.967+0000 7f928effd700 1 -- 172.21.15.96:0/2847744945 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f92900182e0 con 0x7f92a00f7980 2022-02-02T20:43:50.969 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:43:50.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:43:50.970 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:43:50.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:50.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:43:50.970 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:43:50.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:50.971 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:43:50.971 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:43:50.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:50.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:43:50.972 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:43:50.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:43:50.972 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:43:50.972 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:43:50.973 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:43:50.973 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:43:50.973 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:43:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 msgr2=0x7f9288067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 0x7f9288067290 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f9294004630 tx=0x7f9294009b30).stop 2022-02-02T20:43:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 msgr2=0x7f92a01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:50.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f929000c790 tx=0x7f9290007d70).stop 2022-02-02T20:43:50.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 shutdown_connections 2022-02-02T20:43:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9288064dd0 0x7f9288067290 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00f66e0 0x7f92a0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 --2- 172.21.15.96:0/2847744945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92a00f7980 0x7f92a01074a0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 >> 172.21.15.96:0/2847744945 conn(0x7f92a00f1e40 msgr2=0x7f92a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 shutdown_connections 2022-02-02T20:43:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:50.969+0000 7f92a4b56700 1 -- 172.21.15.96:0/2847744945 wait complete. 2022-02-02T20:43:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 -- 172.21.15.96:0/356826239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 msgr2=0x7fbbe40f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:51.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/356826239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe40f6460 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 rx=0x7fbbd8004660 tx=0x7fbbd8009b30).stop 2022-02-02T20:43:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 -- 172.21.15.96:0/356826239 shutdown_connections 2022-02-02T20:43:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/356826239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe40f6460 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/356826239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 0x7fbbe40f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:43:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 -- 172.21.15.96:0/356826239 >> 172.21.15.96:0/356826239 conn(0x7fbbe40f0540 msgr2=0x7fbbe40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 -- 172.21.15.96:0/356826239 shutdown_connections 2022-02-02T20:43:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.066+0000 7fbbe94e5700 1 -- 172.21.15.96:0/356826239 wait complete. 2022-02-02T20:43:51.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 Processor -- start 2022-02-02T20:43:51.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 -- start start 2022-02-02T20:43:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 0x7fbbe4109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40f8050 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe94e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40f8190 con 0x7fbbe40f4de0 2022-02-02T20:43:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38770/0 (socket says 172.21.15.96:38770) 2022-02-02T20:43:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.067+0000 7fbbe27fc700 1 -- 172.21.15.96:0/3289153841 learned_addr learned my addr 172.21.15.96:0/3289153841 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:43:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe2ffd700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 0x7fbbe4109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe27fc700 1 -- 172.21.15.96:0/3289153841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 msgr2=0x7fbbe4109c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe27fc700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 0x7fbbe4109c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe27fc700 1 -- 172.21.15.96:0/3289153841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8005040 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe27fc700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 rx=0x7fbbd8009990 tx=0x7fbbd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd8018070 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbd8007ca0 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe410c740 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd801c620 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.068+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe410cc70 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.069+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe40f41d0 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.069+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbbd801d960 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.070+0000 7fbbcb7fe700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 0x7fbbcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:43:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.070+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbbd80837d0 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.070+0000 7fbbe2ffd700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 0x7fbbcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:43:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.070+0000 7fbbe2ffd700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 0x7fbbcc067290 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fbbe40f7c40 tx=0x7fbbd4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:43:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.074+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbbd8051a40 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.275+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbbe4045ad0 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.275+0000 7fbbcb7fe700 1 -- 172.21.15.96:0/3289153841 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbbd8055060 con 0x7fbbe40f5fe0 2022-02-02T20:43:51.278 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:43:51.278 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:43:51.278 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:43:51.278 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:43:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:51.279 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:43:51.279 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:43:51.279 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:43:51.280 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:43:51.280 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:43:51.280 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:43:51.280 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:43:51.280 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:43:51.281 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:43:51.281 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:43:51.281 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:43:51.281 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:43:51.282 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:43:51.282 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:43:51.282 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:43:51.282 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:43:51.282 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:43:51.283 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:43:51.283 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:43:51.283 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:43:51.283 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:43:51.284 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:43:51.284 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:43:51.284 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:43:51.284 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:43:51.284 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:43:51.285 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:43:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:51.285 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:43:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:43:51.286 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:51.286 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:51.286 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:43:51.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 msgr2=0x7fbbcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 0x7fbbcc067290 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fbbe40f7c40 tx=0x7fbbd4008040).stop 2022-02-02T20:43:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 msgr2=0x7fbbe410c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:43:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 rx=0x7fbbd8009990 tx=0x7fbbd8009b30).stop 2022-02-02T20:43:51.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 shutdown_connections 2022-02-02T20:43:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbcc064dd0 0x7fbbcc067290 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe40f4de0 0x7fbbe4109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 --2- 172.21.15.96:0/3289153841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe40f5fe0 0x7fbbe410c140 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:43:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.278+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 >> 172.21.15.96:0/3289153841 conn(0x7fbbe40f0540 msgr2=0x7fbbe40fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:43:51.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.279+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 shutdown_connections 2022-02-02T20:43:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:43:51.279+0000 7fbbe94e5700 1 -- 172.21.15.96:0/3289153841 wait complete. 2022-02-02T20:43:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:43:51.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:51 smithi159 ceph-mon[69013]: from='client.38468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:51.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:51 smithi159 ceph-mon[69013]: from='client.38472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:51.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2847744945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:43:51.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3289153841' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:43:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:51 smithi096 ceph-mon[101353]: from='client.38468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:51 smithi096 ceph-mon[101353]: from='client.38472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:43:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2847744945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:43:51.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3289153841' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:43:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:52 smithi159 ceph-mon[69013]: pgmap v4253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:52 smithi096 ceph-mon[101353]: pgmap v4253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:54 smithi159 ceph-mon[69013]: pgmap v4254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:54 smithi096 ceph-mon[101353]: pgmap v4254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:56 smithi159 ceph-mon[69013]: pgmap v4255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:56 smithi096 ceph-mon[101353]: pgmap v4255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:43:57 smithi159 ceph-mon[69013]: pgmap v4256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:43:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:43:57 smithi096 ceph-mon[101353]: pgmap v4256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:00 smithi159 ceph-mon[69013]: pgmap v4257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:00 smithi096 ceph-mon[101353]: pgmap v4257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:02 smithi159 ceph-mon[69013]: pgmap v4258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:02 smithi096 ceph-mon[101353]: pgmap v4258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:04 smithi159 ceph-mon[69013]: pgmap v4259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:04 smithi096 ceph-mon[101353]: pgmap v4259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:06 smithi159 ceph-mon[69013]: pgmap v4260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:06 smithi096 ceph-mon[101353]: pgmap v4260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:07 smithi159 ceph-mon[69013]: pgmap v4261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:07 smithi096 ceph-mon[101353]: pgmap v4261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:10 smithi159 ceph-mon[69013]: pgmap v4262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:10 smithi096 ceph-mon[101353]: pgmap v4262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:12 smithi159 ceph-mon[69013]: pgmap v4263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:12 smithi096 ceph-mon[101353]: pgmap v4263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:14 smithi159 ceph-mon[69013]: pgmap v4264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:14 smithi096 ceph-mon[101353]: pgmap v4264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:16 smithi159 ceph-mon[69013]: pgmap v4265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:16 smithi096 ceph-mon[101353]: pgmap v4265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:17 smithi159 ceph-mon[69013]: pgmap v4266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:17 smithi096 ceph-mon[101353]: pgmap v4266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:20 smithi159 ceph-mon[69013]: pgmap v4267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:20 smithi096 ceph-mon[101353]: pgmap v4267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:21.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 -- 172.21.15.96:0/1706653596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 msgr2=0x7fcce00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 --2- 172.21.15.96:0/1706653596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce00f7c30 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 rx=0x7fccd0004660 tx=0x7fccd0009b30).stop 2022-02-02T20:44:21.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 -- 172.21.15.96:0/1706653596 shutdown_connections 2022-02-02T20:44:21.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 --2- 172.21.15.96:0/1706653596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce00f7c30 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 --2- 172.21.15.96:0/1706653596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:44:21.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 -- 172.21.15.96:0/1706653596 >> 172.21.15.96:0/1706653596 conn(0x7fcce00f1c90 msgr2=0x7fcce00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:21.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 -- 172.21.15.96:0/1706653596 shutdown_connections 2022-02-02T20:44:21.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.388+0000 7fcce501a700 1 -- 172.21.15.96:0/1706653596 wait complete. 2022-02-02T20:44:21.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 Processor -- start 2022-02-02T20:44:21.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 -- start start 2022-02-02T20:44:21.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0107980 con 0x7fcce00f77d0 2022-02-02T20:44:21.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fcce501a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0108100 con 0x7fcce00f6530 2022-02-02T20:44:21.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fccdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fccdf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38788/0 (socket says 172.21.15.96:38788) 2022-02-02T20:44:21.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fccdf7fe700 1 -- 172.21.15.96:0/1503291651 learned_addr learned my addr 172.21.15.96:0/1503291651 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:21.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.389+0000 7fccdffff700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdf7fe700 1 -- 172.21.15.96:0/1503291651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 msgr2=0x7fcce0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdf7fe700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdf7fe700 1 -- 172.21.15.96:0/1503291651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0005040 con 0x7fcce00f77d0 2022-02-02T20:44:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdffff700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:44:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdf7fe700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7fccd0009da0 tx=0x7fccd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd0018070 con 0x7fcce00f77d0 2022-02-02T20:44:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0108320 con 0x7fcce00f77d0 2022-02-02T20:44:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fccd0007d70 con 0x7fcce00f77d0 2022-02-02T20:44:21.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd001dea0 con 0x7fcce00f77d0 2022-02-02T20:44:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.390+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0108880 con 0x7fcce00f77d0 2022-02-02T20:44:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.391+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0045ad0 con 0x7fcce00f77d0 2022-02-02T20:44:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.392+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fccd001d420 con 0x7fcce00f77d0 2022-02-02T20:44:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.392+0000 7fccdcff9700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 0x7fcccc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.392+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fccd0083930 con 0x7fcce00f77d0 2022-02-02T20:44:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.392+0000 7fccdffff700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 0x7fcccc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.392+0000 7fccdffff700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 0x7fcccc0672e0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fcce0106b70 tx=0x7fccc8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.397+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fccd0051a30 con 0x7fcce00f77d0 2022-02-02T20:44:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.577+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcce00fef40 con 0x7fcccc064e20 2022-02-02T20:44:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.578+0000 7fccdcff9700 1 -- 172.21.15.96:0/1503291651 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fccc800b500 con 0x7fcccc064e20 2022-02-02T20:44:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 msgr2=0x7fcccc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 0x7fcccc0672e0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fcce0106b70 tx=0x7fccc8008040).stop 2022-02-02T20:44:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 msgr2=0x7fcce01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7fccd0009da0 tx=0x7fccd0009b30).stop 2022-02-02T20:44:21.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 shutdown_connections 2022-02-02T20:44:21.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcccc064e20 0x7fcccc0672e0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce00f6530 0x7fcce0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 --2- 172.21.15.96:0/1503291651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcce00f77d0 0x7fcce01072f0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 >> 172.21.15.96:0/1503291651 conn(0x7fcce00f1c90 msgr2=0x7fcce00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:21.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 shutdown_connections 2022-02-02T20:44:21.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.580+0000 7fcce501a700 1 -- 172.21.15.96:0/1503291651 wait complete. 2022-02-02T20:44:21.591 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:44:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 -- 172.21.15.96:0/681664729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 msgr2=0x7f63f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 --2- 172.21.15.96:0/681664729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f00f6b00 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 rx=0x7f63e4004660 tx=0x7f63e4009b30).stop 2022-02-02T20:44:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 -- 172.21.15.96:0/681664729 shutdown_connections 2022-02-02T20:44:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 --2- 172.21.15.96:0/681664729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 0x7f63f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 --2- 172.21.15.96:0/681664729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f00f6b00 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 -- 172.21.15.96:0/681664729 >> 172.21.15.96:0/681664729 conn(0x7f63f00f1e40 msgr2=0x7f63f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.678+0000 7f63f4eee700 1 -- 172.21.15.96:0/681664729 shutdown_connections 2022-02-02T20:44:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 -- 172.21.15.96:0/681664729 wait complete. 2022-02-02T20:44:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 Processor -- start 2022-02-02T20:44:21.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 -- start start 2022-02-02T20:44:21.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 0x7f63f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006a380 con 0x7f63f00f66e0 2022-02-02T20:44:21.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63f4eee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006a4c0 con 0x7f63f00f7980 2022-02-02T20:44:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38796/0 (socket says 172.21.15.96:38796) 2022-02-02T20:44:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63ee59c700 1 -- 172.21.15.96:0/1350728106 learned_addr learned my addr 172.21.15.96:0/1350728106 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.679+0000 7f63edd9b700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 0x7f63f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63ee59c700 1 -- 172.21.15.96:0/1350728106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 msgr2=0x7f63f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63ee59c700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 0x7f63f0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63ee59c700 1 -- 172.21.15.96:0/1350728106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4005040 con 0x7f63f00f66e0 2022-02-02T20:44:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63ee59c700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7f63e4013a70 tx=0x7f63e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63e4018070 con 0x7f63f00f66e0 2022-02-02T20:44:21.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f006a740 con 0x7f63f00f66e0 2022-02-02T20:44:21.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f63e40097d0 con 0x7f63f00f66e0 2022-02-02T20:44:21.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63e401de80 con 0x7f63f00f66e0 2022-02-02T20:44:21.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.680+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f006aca0 con 0x7f63f00f66e0 2022-02-02T20:44:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.681+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0045ad0 con 0x7f63f00f66e0 2022-02-02T20:44:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.682+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f63e4007ba0 con 0x7f63f00f66e0 2022-02-02T20:44:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.682+0000 7f63deffd700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 0x7f63d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.682+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f63e4083b60 con 0x7f63f00f66e0 2022-02-02T20:44:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.682+0000 7f63edd9b700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 0x7f63d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.683+0000 7f63edd9b700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 0x7f63d8067290 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f63e0004e20 tx=0x7f63e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.687+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f63e4051da0 con 0x7f63f00f66e0 2022-02-02T20:44:21.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.858+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f63f0057f10 con 0x7f63d8064dd0 2022-02-02T20:44:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.867+0000 7f63deffd700 1 -- 172.21.15.96:0/1350728106 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f63f0057f10 con 0x7f63d8064dd0 2022-02-02T20:44:21.868 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:44:21.869 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 118m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:44:21.869 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 118m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:44:21.869 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 116m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:44:21.870 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 118m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:44:21.870 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 118m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:44:21.870 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 118m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:44:21.870 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 116m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:44:21.870 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 116m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:44:21.871 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 118m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:44:21.871 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 116m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:44:21.871 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 118m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:44:21.871 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 116m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:44:21.872 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 118m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:44:21.872 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 116m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:44:21.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 118m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:44:21.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 118m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:44:21.872 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 118m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:44:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 116m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:44:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 116m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:44:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 116m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:44:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 118m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:44:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.868+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 msgr2=0x7f63d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.868+0000 7f63f4eee700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 0x7f63d8067290 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f63e0004e20 tx=0x7f63e000b040).stop 2022-02-02T20:44:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.868+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 msgr2=0x7f63f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.868+0000 7f63f4eee700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7f63e4013a70 tx=0x7f63e4009b30).stop 2022-02-02T20:44:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 shutdown_connections 2022-02-02T20:44:21.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f63d8064dd0 0x7f63d8067290 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63f00f66e0 0x7f63f006b9a0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 --2- 172.21.15.96:0/1350728106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63f00f7980 0x7f63f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 >> 172.21.15.96:0/1350728106 conn(0x7f63f00f1e40 msgr2=0x7f63f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:21.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 shutdown_connections 2022-02-02T20:44:21.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.869+0000 7f63f4eee700 1 -- 172.21.15.96:0/1350728106 wait complete. 2022-02-02T20:44:21.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.965+0000 7fb001850700 1 -- 172.21.15.96:0/3682965320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f5ed0 msgr2=0x7faffc0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.965+0000 7fb001850700 1 --2- 172.21.15.96:0/3682965320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f5ed0 0x7faffc0f6900 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 rx=0x7faff0004660 tx=0x7faff0009b30).stop 2022-02-02T20:44:21.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.965+0000 7fb001850700 1 -- 172.21.15.96:0/3682965320 shutdown_connections 2022-02-02T20:44:21.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.965+0000 7fb001850700 1 --2- 172.21.15.96:0/3682965320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f5ed0 0x7faffc0f6900 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.966+0000 7fb001850700 1 --2- 172.21.15.96:0/3682965320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f55c0 0x7faffc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.966+0000 7fb001850700 1 -- 172.21.15.96:0/3682965320 >> 172.21.15.96:0/3682965320 conn(0x7faffc0f0de0 msgr2=0x7faffc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:21.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.966+0000 7fb001850700 1 -- 172.21.15.96:0/3682965320 shutdown_connections 2022-02-02T20:44:21.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.966+0000 7fb001850700 1 -- 172.21.15.96:0/3682965320 wait complete. 2022-02-02T20:44:21.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.966+0000 7fb001850700 1 Processor -- start 2022-02-02T20:44:21.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fb001850700 1 -- start start 2022-02-02T20:44:21.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fb001850700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fb001850700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 0x7faffc106330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fb001850700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc106930 con 0x7faffc0f55c0 2022-02-02T20:44:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fb001850700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc107140 con 0x7faffc0f5ed0 2022-02-02T20:44:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38804/0 (socket says 172.21.15.96:38804) 2022-02-02T20:44:21.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 -- 172.21.15.96:0/3689595361 learned_addr learned my addr 172.21.15.96:0/3689595361 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:21.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffa7fc700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 0x7faffc106330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 -- 172.21.15.96:0/3689595361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 msgr2=0x7faffc106330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:21.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 0x7faffc106330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:21.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 -- 172.21.15.96:0/3689595361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0005040 con 0x7faffc0f55c0 2022-02-02T20:44:21.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffa7fc700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 0x7faffc106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:44:21.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7faffaffd700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7fafec00e7f0 tx=0x7fafec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.967+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec0094c0 con 0x7faffc0f55c0 2022-02-02T20:44:21.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.968+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc107360 con 0x7faffc0f55c0 2022-02-02T20:44:21.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.968+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafec004510 con 0x7faffc0f55c0 2022-02-02T20:44:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.968+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec007ea0 con 0x7faffc0f55c0 2022-02-02T20:44:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.968+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc1078f0 con 0x7faffc0f55c0 2022-02-02T20:44:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.969+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc045ad0 con 0x7faffc0f55c0 2022-02-02T20:44:21.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.969+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fafec023070 con 0x7faffc0f55c0 2022-02-02T20:44:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.970+0000 7fafe37fe700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 0x7fafe4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.970+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fafec085f90 con 0x7faffc0f55c0 2022-02-02T20:44:21.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.970+0000 7faffa7fc700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 0x7fafe4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:21.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.970+0000 7faffa7fc700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 0x7fafe4067290 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7faff0004d80 tx=0x7faff000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:21.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:21.974+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fafec054030 con 0x7faffc0f55c0 2022-02-02T20:44:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.206+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faffc0ff860 con 0x7faffc0f55c0 2022-02-02T20:44:22.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.207+0000 7fafe37fe700 1 -- 172.21.15.96:0/3689595361 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fafec057650 con 0x7faffc0f55c0 2022-02-02T20:44:22.210 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:44:22.210 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:44:22.210 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:44:22.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:22.212 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:44:22.212 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:44:22.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:22.213 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:44:22.213 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:44:22.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:22.214 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:44:22.215 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:44:22.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:22.215 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:44:22.216 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:44:22.216 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:44:22.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:44:22.217 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:44:22.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.208+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 msgr2=0x7fafe4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.208+0000 7fb001850700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 0x7fafe4067290 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7faff0004d80 tx=0x7faff000b040).stop 2022-02-02T20:44:22.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.208+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 msgr2=0x7faffc105e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.208+0000 7fb001850700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7fafec00e7f0 tx=0x7fafec00b040).stop 2022-02-02T20:44:22.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 shutdown_connections 2022-02-02T20:44:22.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafe4064dd0 0x7fafe4067290 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faffc0f55c0 0x7faffc105e40 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 --2- 172.21.15.96:0/3689595361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faffc0f5ed0 0x7faffc106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 >> 172.21.15.96:0/3689595361 conn(0x7faffc0f0de0 msgr2=0x7faffc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 shutdown_connections 2022-02-02T20:44:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.209+0000 7fb001850700 1 -- 172.21.15.96:0/3689595361 wait complete. 2022-02-02T20:44:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 -- 172.21.15.96:0/213236544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f6860 msgr2=0x7f9be80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 --2- 172.21.15.96:0/213236544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f6860 0x7f9be80f6cc0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 rx=0x7f9be4004660 tx=0x7f9be4009b30).stop 2022-02-02T20:44:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 -- 172.21.15.96:0/213236544 shutdown_connections 2022-02-02T20:44:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 --2- 172.21.15.96:0/213236544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f6860 0x7f9be80f6cc0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 --2- 172.21.15.96:0/213236544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f55c0 0x7f9be80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 -- 172.21.15.96:0/213236544 >> 172.21.15.96:0/213236544 conn(0x7f9be80f0d40 msgr2=0x7f9be80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 -- 172.21.15.96:0/213236544 shutdown_connections 2022-02-02T20:44:22.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 -- 172.21.15.96:0/213236544 wait complete. 2022-02-02T20:44:22.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.306+0000 7f9befd0c700 1 Processor -- start 2022-02-02T20:44:22.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9befd0c700 1 -- start start 2022-02-02T20:44:22.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9befd0c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:22.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9befd0c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f6860 0x7f9be8106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9befd0c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8106940 con 0x7f9be80f55c0 2022-02-02T20:44:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9befd0c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8107150 con 0x7f9be80f6860 2022-02-02T20:44:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38814/0 (socket says 172.21.15.96:38814) 2022-02-02T20:44:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 -- 172.21.15.96:0/4245193264 learned_addr learned my addr 172.21.15.96:0/4245193264 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bed2a7700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f6860 0x7f9be8106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 -- 172.21.15.96:0/4245193264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f6860 msgr2=0x7f9be8106340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f6860 0x7f9be8106340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 -- 172.21.15.96:0/4245193264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4005040 con 0x7f9be80f55c0 2022-02-02T20:44:22.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bedaa8700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7f9bd8002700 tx=0x7f9bd8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:22.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.307+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd80079c0 con 0x7f9be80f55c0 2022-02-02T20:44:22.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.308+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be81073d0 con 0x7f9be80f55c0 2022-02-02T20:44:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.308+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be8107990 con 0x7f9be80f55c0 2022-02-02T20:44:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.308+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9bd800f040 con 0x7f9be80f55c0 2022-02-02T20:44:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.308+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd8014860 con 0x7f9be80f55c0 2022-02-02T20:44:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.308+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be80f49b0 con 0x7f9be80f55c0 2022-02-02T20:44:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.309+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9bd801b060 con 0x7f9be80f55c0 2022-02-02T20:44:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.309+0000 7f9bde7fc700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 0x7f9bd4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.309+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9bd80818c0 con 0x7f9be80f55c0 2022-02-02T20:44:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.310+0000 7f9bed2a7700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 0x7f9bd4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.310+0000 7f9bed2a7700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 0x7f9bd4067270 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f9be4004e30 tx=0x7f9be4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.314+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9bd804f9c0 con 0x7f9be80f55c0 2022-02-02T20:44:22.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.516+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9be80fde80 con 0x7f9be80f55c0 2022-02-02T20:44:22.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.516+0000 7f9bde7fc700 1 -- 172.21.15.96:0/4245193264 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9bd8019070 con 0x7f9be80f55c0 2022-02-02T20:44:22.518 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:44:22.518 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:44:22.519 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:44:22.519 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:44:22.519 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:22.519 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:44:22.520 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:44:22.520 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:44:22.520 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:44:22.520 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:44:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:44:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:44:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:44:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:44:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:44:22.522 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:44:22.522 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:44:22.522 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:44:22.523 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:44:22.523 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:44:22.523 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:44:22.523 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:44:22.523 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:44:22.524 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:44:22.524 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:44:22.524 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:44:22.524 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:44:22.525 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:44:22.525 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:44:22.525 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:44:22.525 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:44:22.525 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:44:22.526 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:22.526 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:22.526 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:44:22.526 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:22.526 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:22.527 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:22.527 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 msgr2=0x7f9bd4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 0x7f9bd4067270 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f9be4004e30 tx=0x7f9be4009b30).stop 2022-02-02T20:44:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 msgr2=0x7f9be8105e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7f9bd8002700 tx=0x7f9bd8009d80).stop 2022-02-02T20:44:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 shutdown_connections 2022-02-02T20:44:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bd4064db0 0x7f9bd4067270 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9be80f55c0 0x7f9be8105e50 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 --2- 172.21.15.96:0/4245193264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9be80f6860 0x7f9be8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 >> 172.21.15.96:0/4245193264 conn(0x7f9be80f0d40 msgr2=0x7f9be80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:22.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 shutdown_connections 2022-02-02T20:44:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:22.518+0000 7f9befd0c700 1 -- 172.21.15.96:0/4245193264 wait complete. 2022-02-02T20:44:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:44:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:22 smithi159 ceph-mon[69013]: pgmap v4268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:22 smithi159 ceph-mon[69013]: from='client.38484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:22.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3689595361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:44:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:22 smithi096 ceph-mon[101353]: pgmap v4268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:22 smithi096 ceph-mon[101353]: from='client.38484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3689595361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:44:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:23 smithi096 ceph-mon[101353]: from='client.38488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4245193264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:44:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:23 smithi159 ceph-mon[69013]: from='client.38488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4245193264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:44:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:24 smithi159 ceph-mon[69013]: pgmap v4269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:24 smithi096 ceph-mon[101353]: pgmap v4269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:26 smithi159 ceph-mon[69013]: pgmap v4270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:27.228 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:26 smithi096 ceph-mon[101353]: pgmap v4270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:27 smithi159 ceph-mon[69013]: pgmap v4271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:44:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:44:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:27 smithi096 ceph-mon[101353]: pgmap v4271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:44:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:44:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:30 smithi159 ceph-mon[69013]: pgmap v4272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:30 smithi096 ceph-mon[101353]: pgmap v4272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:32 smithi159 ceph-mon[69013]: pgmap v4273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:32 smithi096 ceph-mon[101353]: pgmap v4273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:34 smithi159 ceph-mon[69013]: pgmap v4274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:34 smithi096 ceph-mon[101353]: pgmap v4274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:36 smithi159 ceph-mon[69013]: pgmap v4275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:36 smithi096 ceph-mon[101353]: pgmap v4275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:37 smithi159 ceph-mon[69013]: pgmap v4276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:37 smithi096 ceph-mon[101353]: pgmap v4276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:40 smithi159 ceph-mon[69013]: pgmap v4277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:40 smithi096 ceph-mon[101353]: pgmap v4277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:42 smithi159 ceph-mon[69013]: pgmap v4278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:42 smithi096 ceph-mon[101353]: pgmap v4278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:44 smithi159 ceph-mon[69013]: pgmap v4279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:44 smithi096 ceph-mon[101353]: pgmap v4279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:46 smithi159 ceph-mon[69013]: pgmap v4280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:46.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:46 smithi096 ceph-mon[101353]: pgmap v4280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:47 smithi159 ceph-mon[69013]: pgmap v4281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:48.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:47 smithi096 ceph-mon[101353]: pgmap v4281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:50 smithi159 ceph-mon[69013]: pgmap v4282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:50 smithi096 ceph-mon[101353]: pgmap v4282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:52.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 -- 172.21.15.96:0/3876131159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 msgr2=0x7ff86c0fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 --2- 172.21.15.96:0/3876131159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c0fbc90 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 rx=0x7ff868004660 tx=0x7ff868009b30).stop 2022-02-02T20:44:52.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 -- 172.21.15.96:0/3876131159 shutdown_connections 2022-02-02T20:44:52.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 --2- 172.21.15.96:0/3876131159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c0fbc90 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 --2- 172.21.15.96:0/3876131159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 0x7ff86c0f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 -- 172.21.15.96:0/3876131159 >> 172.21.15.96:0/3876131159 conn(0x7ff86c0f0d40 msgr2=0x7ff86c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:52.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 -- 172.21.15.96:0/3876131159 shutdown_connections 2022-02-02T20:44:52.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.627+0000 7ff874623700 1 -- 172.21.15.96:0/3876131159 wait complete. 2022-02-02T20:44:52.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 Processor -- start 2022-02-02T20:44:52.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 -- start start 2022-02-02T20:44:52.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 0x7ff86c106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c1079f0 con 0x7ff86c0f98a0 2022-02-02T20:44:52.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff874623700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c107b30 con 0x7ff86c060290 2022-02-02T20:44:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38832/0 (socket says 172.21.15.96:38832) 2022-02-02T20:44:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 -- 172.21.15.96:0/2146595885 learned_addr learned my addr 172.21.15.96:0/2146595885 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff8723bf700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 0x7ff86c106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 -- 172.21.15.96:0/2146595885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 msgr2=0x7ff86c106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 0x7ff86c106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.628+0000 7ff871bbe700 1 -- 172.21.15.96:0/2146595885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868005040 con 0x7ff86c0f98a0 2022-02-02T20:44:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff871bbe700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7ff868004f60 tx=0x7ff868009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff868018070 con 0x7ff86c0f98a0 2022-02-02T20:44:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c108470 con 0x7ff86c0f98a0 2022-02-02T20:44:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff868009770 con 0x7ff86c0f98a0 2022-02-02T20:44:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86801c3c0 con 0x7ff86c0f98a0 2022-02-02T20:44:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.629+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c1089d0 con 0x7ff86c0f98a0 2022-02-02T20:44:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.630+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c045ad0 con 0x7ff86c0f98a0 2022-02-02T20:44:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.630+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff86801d420 con 0x7ff86c0f98a0 2022-02-02T20:44:52.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.631+0000 7ff862ffd700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 0x7ff858067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.631+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff868083880 con 0x7ff86c0f98a0 2022-02-02T20:44:52.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.631+0000 7ff8723bf700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 0x7ff858067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.631+0000 7ff8723bf700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 0x7ff858067290 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7ff85c0041d0 tx=0x7ff85c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:52.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.635+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff868055470 con 0x7ff86c0f98a0 2022-02-02T20:44:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:52 smithi159 ceph-mon[69013]: pgmap v4283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:52 smithi096 ceph-mon[101353]: pgmap v4283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.813+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff86c108bf0 con 0x7ff858064dd0 2022-02-02T20:44:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.814+0000 7ff862ffd700 1 -- 172.21.15.96:0/2146595885 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff86c108bf0 con 0x7ff858064dd0 2022-02-02T20:44:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 msgr2=0x7ff858067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 0x7ff858067290 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7ff85c0041d0 tx=0x7ff85c009040).stop 2022-02-02T20:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 msgr2=0x7ff86c107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7ff868004f60 tx=0x7ff868009b30).stop 2022-02-02T20:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 shutdown_connections 2022-02-02T20:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff858064dd0 0x7ff858067290 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff86c060290 0x7ff86c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 --2- 172.21.15.96:0/2146595885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff86c0f98a0 0x7ff86c107440 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 >> 172.21.15.96:0/2146595885 conn(0x7ff86c0f0d40 msgr2=0x7ff86c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 shutdown_connections 2022-02-02T20:44:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.816+0000 7ff874623700 1 -- 172.21.15.96:0/2146595885 wait complete. 2022-02-02T20:44:52.828 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:44:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 -- 172.21.15.96:0/2806704285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 msgr2=0x7fcfe80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 --2- 172.21.15.96:0/2806704285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe80f6cc0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 rx=0x7fcfe4004660 tx=0x7fcfe4009b30).stop 2022-02-02T20:44:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 -- 172.21.15.96:0/2806704285 shutdown_connections 2022-02-02T20:44:52.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 --2- 172.21.15.96:0/2806704285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe80f6cc0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 --2- 172.21.15.96:0/2806704285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 0x7fcfe80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 -- 172.21.15.96:0/2806704285 >> 172.21.15.96:0/2806704285 conn(0x7fcfe80f0d40 msgr2=0x7fcfe80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 -- 172.21.15.96:0/2806704285 shutdown_connections 2022-02-02T20:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 -- 172.21.15.96:0/2806704285 wait complete. 2022-02-02T20:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.914+0000 7fcfef76b700 1 Processor -- start 2022-02-02T20:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfef76b700 1 -- start start 2022-02-02T20:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfef76b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 0x7fcfe8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfef76b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfef76b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80603e0 con 0x7fcfe80f6860 2022-02-02T20:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfef76b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8060520 con 0x7fcfe80f55c0 2022-02-02T20:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38842/0 (socket says 172.21.15.96:38842) 2022-02-02T20:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 -- 172.21.15.96:0/3331142451 learned_addr learned my addr 172.21.15.96:0/3331142451 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfed507700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 0x7fcfe8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 -- 172.21.15.96:0/3331142451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 msgr2=0x7fcfe8109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 0x7fcfe8109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 -- 172.21.15.96:0/3331142451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4005040 con 0x7fcfe80f6860 2022-02-02T20:44:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfecd06700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x7fcfe4009990 tx=0x7fcfe4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:52.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.915+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe4018070 con 0x7fcfe80f6860 2022-02-02T20:44:52.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.916+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe810c6a0 con 0x7fcfe80f6860 2022-02-02T20:44:52.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.916+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfe4007ba0 con 0x7fcfe80f6860 2022-02-02T20:44:52.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.916+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe401c3c0 con 0x7fcfe80f6860 2022-02-02T20:44:52.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.916+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe810cc00 con 0x7fcfe80f6860 2022-02-02T20:44:52.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.917+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe8045ad0 con 0x7fcfe80f6860 2022-02-02T20:44:52.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.917+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcfe401d420 con 0x7fcfe80f6860 2022-02-02T20:44:52.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.917+0000 7fcfddffb700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 0x7fcfd4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:52.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.917+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcfe40836b0 con 0x7fcfe80f6860 2022-02-02T20:44:52.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.918+0000 7fcfed507700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 0x7fcfd4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:52.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.918+0000 7fcfed507700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 0x7fcfd4067290 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fcfe8060060 tx=0x7fcfd800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:52.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:52.922+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcfe4051810 con 0x7fcfe80f6860 2022-02-02T20:44:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.096+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe80fde90 con 0x7fcfd4064dd0 2022-02-02T20:44:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.105+0000 7fcfddffb700 1 -- 172.21.15.96:0/3331142451 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcfe80fde90 con 0x7fcfd4064dd0 2022-02-02T20:44:53.108 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:44:53.109 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 118m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:44:53.109 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 118m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:44:53.109 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 117m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:44:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 118m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:44:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 118m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:44:53.111 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 118m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:44:53.111 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 117m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:44:53.111 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 117m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:44:53.112 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 118m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:44:53.112 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 117m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:44:53.113 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 118m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:44:53.113 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 117m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:44:53.114 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 118m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:44:53.114 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 117m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:44:53.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 118m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:44:53.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 118m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:44:53.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 118m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:44:53.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 117m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:44:53.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 117m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:44:53.118 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 117m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:44:53.118 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 118m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:44:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 msgr2=0x7fcfd4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 0x7fcfd4067290 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fcfe8060060 tx=0x7fcfd800b040).stop 2022-02-02T20:44:53.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 msgr2=0x7fcfe810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x7fcfe4009990 tx=0x7fcfe4009b30).stop 2022-02-02T20:44:53.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 shutdown_connections 2022-02-02T20:44:53.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcfd4064dd0 0x7fcfd4067290 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80f55c0 0x7fcfe8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 --2- 172.21.15.96:0/3331142451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe80f6860 0x7fcfe810c150 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 >> 172.21.15.96:0/3331142451 conn(0x7fcfe80f0d40 msgr2=0x7fcfe80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 shutdown_connections 2022-02-02T20:44:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.108+0000 7fcfef76b700 1 -- 172.21.15.96:0/3331142451 wait complete. 2022-02-02T20:44:53.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 -- 172.21.15.96:0/4222379177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f6860 msgr2=0x7f8c100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 --2- 172.21.15.96:0/4222379177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f6860 0x7f8c100f6cc0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 rx=0x7f8c00004660 tx=0x7f8c00009b30).stop 2022-02-02T20:44:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 -- 172.21.15.96:0/4222379177 shutdown_connections 2022-02-02T20:44:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 --2- 172.21.15.96:0/4222379177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f6860 0x7f8c100f6cc0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 --2- 172.21.15.96:0/4222379177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f55c0 0x7f8c100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:44:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 -- 172.21.15.96:0/4222379177 >> 172.21.15.96:0/4222379177 conn(0x7f8c100f0d20 msgr2=0x7f8c100f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 -- 172.21.15.96:0/4222379177 shutdown_connections 2022-02-02T20:44:53.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.204+0000 7f8c15810700 1 -- 172.21.15.96:0/4222379177 wait complete. 2022-02-02T20:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 Processor -- start 2022-02-02T20:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 -- start start 2022-02-02T20:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f6860 0x7f8c1010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100605b0 con 0x7f8c100f55c0 2022-02-02T20:44:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c15810700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100606f0 con 0x7f8c100f6860 2022-02-02T20:44:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38850/0 (socket says 172.21.15.96:38850) 2022-02-02T20:44:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c0effd700 1 -- 172.21.15.96:0/2382174211 learned_addr learned my addr 172.21.15.96:0/2382174211 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.205+0000 7f8c0e7fc700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f6860 0x7f8c1010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c0effd700 1 -- 172.21.15.96:0/2382174211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f6860 msgr2=0x7f8c1010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c0effd700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f6860 0x7f8c1010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c0effd700 1 -- 172.21.15.96:0/2382174211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00005040 con 0x7f8c100f55c0 2022-02-02T20:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c0effd700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f8c040093f0 tx=0x7f8c04006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c04013640 con 0x7f8c100f55c0 2022-02-02T20:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1010c7c0 con 0x7f8c100f55c0 2022-02-02T20:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c04013c50 con 0x7f8c100f55c0 2022-02-02T20:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c04012d10 con 0x7f8c100f55c0 2022-02-02T20:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.206+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1010cd80 con 0x7f8c100f55c0 2022-02-02T20:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.207+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c10045ad0 con 0x7f8c100f55c0 2022-02-02T20:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.207+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c0401a060 con 0x7f8c100f55c0 2022-02-02T20:44:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.208+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.208+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c04081ab0 con 0x7f8c100f55c0 2022-02-02T20:44:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.208+0000 7f8c0e7fc700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.208+0000 7f8c0e7fc700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8c00004630 tx=0x7f8c00009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.212+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c0404fbb0 con 0x7f8c100f55c0 2022-02-02T20:44:53.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.444+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c10027a00 con 0x7f8c100f55c0 2022-02-02T20:44:53.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.445+0000 7f8bf77fe700 1 -- 172.21.15.96:0/2382174211 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8c04018070 con 0x7f8c100f55c0 2022-02-02T20:44:53.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:44:53.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:44:53.448 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:44:53.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:53.449 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:44:53.449 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:44:53.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:53.450 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:44:53.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:44:53.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:53.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:44:53.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:44:53.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:44:53.451 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:44:53.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:44:53.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:44:53.452 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:44:53.452 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:44:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 msgr2=0x7f8bf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8c00004630 tx=0x7f8c00009b30).stop 2022-02-02T20:44:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 msgr2=0x7f8c10109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f8c040093f0 tx=0x7f8c04006ec0).stop 2022-02-02T20:44:53.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 shutdown_connections 2022-02-02T20:44:53.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064dd0 0x7f8bf8067290 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c100f55c0 0x7f8c10109cb0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 --2- 172.21.15.96:0/2382174211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100f6860 0x7f8c1010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 >> 172.21.15.96:0/2382174211 conn(0x7f8c100f0d20 msgr2=0x7f8c100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:53.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 shutdown_connections 2022-02-02T20:44:53.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.447+0000 7f8c15810700 1 -- 172.21.15.96:0/2382174211 wait complete. 2022-02-02T20:44:53.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 -- 172.21.15.96:0/777314197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f6ac0 msgr2=0x7f3f700f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 --2- 172.21.15.96:0/777314197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f6ac0 0x7f3f700f6ee0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 rx=0x7f3f60004660 tx=0x7f3f60009b30).stop 2022-02-02T20:44:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 -- 172.21.15.96:0/777314197 shutdown_connections 2022-02-02T20:44:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 --2- 172.21.15.96:0/777314197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f57d0 0x7f3f700f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 --2- 172.21.15.96:0/777314197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f6ac0 0x7f3f700f6ee0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 -- 172.21.15.96:0/777314197 >> 172.21.15.96:0/777314197 conn(0x7f3f700f0320 msgr2=0x7f3f700f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 -- 172.21.15.96:0/777314197 shutdown_connections 2022-02-02T20:44:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.545+0000 7f3f74963700 1 -- 172.21.15.96:0/777314197 wait complete. 2022-02-02T20:44:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 Processor -- start 2022-02-02T20:44:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 -- start start 2022-02-02T20:44:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 0x7f3f7010bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700f5460 con 0x7f3f700f57d0 2022-02-02T20:44:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f74963700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700f55a0 con 0x7f3f700f6ac0 2022-02-02T20:44:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38860/0 (socket says 172.21.15.96:38860) 2022-02-02T20:44:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 -- 172.21.15.96:0/3157897539 learned_addr learned my addr 172.21.15.96:0/3157897539 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:44:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6e59c700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 0x7f3f7010bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 -- 172.21.15.96:0/3157897539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 msgr2=0x7f3f7010bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 0x7f3f7010bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6ed9d700 1 -- 172.21.15.96:0/3157897539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60005040 con 0x7f3f700f57d0 2022-02-02T20:44:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.546+0000 7f3f6e59c700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 0x7f3f7010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:44:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f6ed9d700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f3f60009990 tx=0x7f3f60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f60018070 con 0x7f3f700f57d0 2022-02-02T20:44:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f60007ca0 con 0x7f3f700f57d0 2022-02-02T20:44:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7010c480 con 0x7f3f700f57d0 2022-02-02T20:44:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f6001c620 con 0x7f3f700f57d0 2022-02-02T20:44:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.547+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7010c9b0 con 0x7f3f700f57d0 2022-02-02T20:44:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.548+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f70059100 con 0x7f3f700f57d0 2022-02-02T20:44:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.548+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f6001d960 con 0x7f3f700f57d0 2022-02-02T20:44:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.549+0000 7f3f677fe700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 0x7f3f5c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:44:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.549+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f600837e0 con 0x7f3f700f57d0 2022-02-02T20:44:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.549+0000 7f3f6e59c700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 0x7f3f5c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:44:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.549+0000 7f3f6e59c700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 0x7f3f5c0672e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3f580041d0 tx=0x7f3f58009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:44:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.553+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f600519a0 con 0x7f3f700f57d0 2022-02-02T20:44:53.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.751+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f700fdde0 con 0x7f3f700f57d0 2022-02-02T20:44:53.754 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:53 smithi096 ceph-mon[101353]: from='client.38500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:53.754 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2382174211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:44:53.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.752+0000 7f3f677fe700 1 -- 172.21.15.96:0/3157897539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3f60054fc0 con 0x7f3f700f57d0 2022-02-02T20:44:53.755 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:44:53.756 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:44:53.756 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:44:53.756 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:44:53.757 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:53.757 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:44:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:44:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:44:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:44:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:44:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:44:53.759 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:44:53.759 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:44:53.759 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:44:53.759 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:44:53.760 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:44:53.760 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:44:53.760 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:44:53.760 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:44:53.761 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:44:53.761 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:44:53.761 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:44:53.761 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:44:53.761 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:44:53.762 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:44:53.762 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:44:53.762 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:44:53.762 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:44:53.763 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:44:53.763 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:44:53.763 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:44:53.763 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:44:53.764 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:53.764 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:53.764 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:44:53.764 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:44:53.764 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:53.765 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:53.765 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:44:53.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 msgr2=0x7f3f5c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 0x7f3f5c0672e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3f580041d0 tx=0x7f3f58009040).stop 2022-02-02T20:44:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 msgr2=0x7f3f70109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:44:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f3f60009990 tx=0x7f3f60009b30).stop 2022-02-02T20:44:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 shutdown_connections 2022-02-02T20:44:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f5c064e20 0x7f3f5c0672e0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f700f57d0 0x7f3f70109a30 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 --2- 172.21.15.96:0/3157897539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f700f6ac0 0x7f3f7010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:44:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 >> 172.21.15.96:0/3157897539 conn(0x7f3f700f0320 msgr2=0x7f3f700fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:44:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 shutdown_connections 2022-02-02T20:44:53.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:44:53.754+0000 7f3f74963700 1 -- 172.21.15.96:0/3157897539 wait complete. 2022-02-02T20:44:53.769 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:44:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:53 smithi159 ceph-mon[69013]: from='client.38500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2382174211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:44:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:54 smithi159 ceph-mon[69013]: from='client.38504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:54 smithi159 ceph-mon[69013]: pgmap v4284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3157897539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:44:54.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:54 smithi096 ceph-mon[101353]: from='client.38504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:44:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:54 smithi096 ceph-mon[101353]: pgmap v4284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3157897539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:44:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:56 smithi159 ceph-mon[69013]: pgmap v4285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:56 smithi096 ceph-mon[101353]: pgmap v4285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:44:57 smithi159 ceph-mon[69013]: pgmap v4286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:44:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:44:57 smithi096 ceph-mon[101353]: pgmap v4286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:00 smithi159 ceph-mon[69013]: pgmap v4287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:00 smithi096 ceph-mon[101353]: pgmap v4287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:02 smithi159 ceph-mon[69013]: pgmap v4288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:02 smithi096 ceph-mon[101353]: pgmap v4288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:04 smithi159 ceph-mon[69013]: pgmap v4289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:04 smithi096 ceph-mon[101353]: pgmap v4289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:06 smithi159 ceph-mon[69013]: pgmap v4290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:06 smithi096 ceph-mon[101353]: pgmap v4290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:07 smithi159 ceph-mon[69013]: pgmap v4291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:07 smithi096 ceph-mon[101353]: pgmap v4291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:10 smithi159 ceph-mon[69013]: pgmap v4292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:10.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:10 smithi096 ceph-mon[101353]: pgmap v4292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:12 smithi159 ceph-mon[69013]: pgmap v4293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:12 smithi096 ceph-mon[101353]: pgmap v4293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:14 smithi159 ceph-mon[69013]: pgmap v4294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:14 smithi096 ceph-mon[101353]: pgmap v4294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:16 smithi159 ceph-mon[69013]: pgmap v4295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:16 smithi096 ceph-mon[101353]: pgmap v4295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:17 smithi159 ceph-mon[69013]: pgmap v4296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:17 smithi096 ceph-mon[101353]: pgmap v4296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:20 smithi159 ceph-mon[69013]: pgmap v4297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:20 smithi096 ceph-mon[101353]: pgmap v4297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:22 smithi159 ceph-mon[69013]: pgmap v4298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:22 smithi096 ceph-mon[101353]: pgmap v4298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.865+0000 7f3c1bfff700 1 -- 172.21.15.96:0/505941092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 msgr2=0x7f3c1c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.865+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/505941092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f6b30 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 rx=0x7f3c10004660 tx=0x7f3c10009b30).stop 2022-02-02T20:45:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 -- 172.21.15.96:0/505941092 shutdown_connections 2022-02-02T20:45:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/505941092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f6b30 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/505941092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 0x7f3c1c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 -- 172.21.15.96:0/505941092 >> 172.21.15.96:0/505941092 conn(0x7f3c1c0f0b90 msgr2=0x7f3c1c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 -- 172.21.15.96:0/505941092 shutdown_connections 2022-02-02T20:45:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 -- 172.21.15.96:0/505941092 wait complete. 2022-02-02T20:45:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 Processor -- start 2022-02-02T20:45:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.866+0000 7f3c1bfff700 1 -- start start 2022-02-02T20:45:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 0x7f3c1c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0f7f70 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0f80b0 con 0x7f3c1c0f5430 2022-02-02T20:45:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38880/0 (socket says 172.21.15.96:38880) 2022-02-02T20:45:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 -- 172.21.15.96:0/68545644 learned_addr learned my addr 172.21.15.96:0/68545644 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1affd700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 0x7f3c1c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 -- 172.21.15.96:0/68545644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 msgr2=0x7f3c1c0f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:23.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 0x7f3c1c0f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:23.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 -- 172.21.15.96:0/68545644 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10005040 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1a7fc700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 rx=0x7f3c10009990 tx=0x7f3c10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:23.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c10018070 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.867+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c0f8330 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.868+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c10007ba0 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.868+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c1001c3c0 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.868+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c0f8890 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.869+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c045ad0 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.869+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c1001d420 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.869+0000 7f3c037fe700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 0x7f3c040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:23.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.869+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3c100836b0 con 0x7f3c1c0f66d0 2022-02-02T20:45:23.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.869+0000 7f3c1affd700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 0x7f3c040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:23.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.870+0000 7f3c1affd700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 0x7f3c040672e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f3c1c0f9320 tx=0x7f3c0c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:23.874+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c10051810 con 0x7f3c1c0f66d0 2022-02-02T20:45:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.051+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c1c0fab10 con 0x7f3c04064e20 2022-02-02T20:45:24.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.052+0000 7f3c037fe700 1 -- 172.21.15.96:0/68545644 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3c1c0fab10 con 0x7f3c04064e20 2022-02-02T20:45:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 msgr2=0x7f3c040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 0x7f3c040672e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f3c1c0f9320 tx=0x7f3c0c00b040).stop 2022-02-02T20:45:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 msgr2=0x7f3c1c0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 rx=0x7f3c10009990 tx=0x7f3c10009b30).stop 2022-02-02T20:45:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 shutdown_connections 2022-02-02T20:45:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c04064e20 0x7f3c040672e0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c0f5430 0x7f3c1c0f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 --2- 172.21.15.96:0/68545644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c0f66d0 0x7f3c1c0f7a10 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 >> 172.21.15.96:0/68545644 conn(0x7f3c1c0f0b90 msgr2=0x7f3c1c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 shutdown_connections 2022-02-02T20:45:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.054+0000 7f3c1bfff700 1 -- 172.21.15.96:0/68545644 wait complete. 2022-02-02T20:45:24.065 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:45:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.150+0000 7f6ec174b700 1 -- 172.21.15.96:0/1523517580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f7980 msgr2=0x7f6ebc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.150+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1523517580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc0f7de0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 rx=0x7f6eac004660 tx=0x7f6eac009b30).stop 2022-02-02T20:45:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 -- 172.21.15.96:0/1523517580 shutdown_connections 2022-02-02T20:45:24.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1523517580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc0f7de0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1523517580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:45:24.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 -- 172.21.15.96:0/1523517580 >> 172.21.15.96:0/1523517580 conn(0x7f6ebc0f1e40 msgr2=0x7f6ebc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 -- 172.21.15.96:0/1523517580 shutdown_connections 2022-02-02T20:45:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.151+0000 7f6ec174b700 1 -- 172.21.15.96:0/1523517580 wait complete. 2022-02-02T20:45:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 Processor -- start 2022-02-02T20:45:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 -- start start 2022-02-02T20:45:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc06a410 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ec174b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc06a550 con 0x7f6ebc0f7980 2022-02-02T20:45:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38886/0 (socket says 172.21.15.96:38886) 2022-02-02T20:45:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 -- 172.21.15.96:0/1275688538 learned_addr learned my addr 172.21.15.96:0/1275688538 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6eba7fc700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 -- 172.21.15.96:0/1275688538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f7980 msgr2=0x7f6ebc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.152+0000 7f6ebaffd700 1 -- 172.21.15.96:0/1275688538 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac005040 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ebaffd700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f6eb00093f0 tx=0x7f6eb0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb0013640 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6eb0013c50 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc06a830 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb0012c70 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.153+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc10efe0 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.154+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc045ad0 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.154+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6eb001a060 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.155+0000 7f6ea37fe700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 0x7f6ea4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.155+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6eb0081a60 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.155+0000 7f6eba7fc700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 0x7f6ea4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.155+0000 7f6eba7fc700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 0x7f6ea4067290 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f6eac004630 tx=0x7f6eac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.159+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6eb004fb60 con 0x7f6ebc0f66e0 2022-02-02T20:45:24.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.332+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ebc057f10 con 0x7f6ea4064dd0 2022-02-02T20:45:24.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.342+0000 7f6ea37fe700 1 -- 172.21.15.96:0/1275688538 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6ebc057f10 con 0x7f6ea4064dd0 2022-02-02T20:45:24.343 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:45:24.344 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 119m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:45:24.344 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 119m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:45:24.344 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 117m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:45:24.345 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 119m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:45:24.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 119m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:45:24.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 119m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:45:24.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 117m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:45:24.345 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 117m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:45:24.346 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 119m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:45:24.346 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 117m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:45:24.346 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 119m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:45:24.347 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 117m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:45:24.347 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 119m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:45:24.347 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 117m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:45:24.347 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 119m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:45:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 119m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:45:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 119m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:45:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 117m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:45:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 117m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:45:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 117m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:45:24.349 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 119m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:45:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.343+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 msgr2=0x7f6ea4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.343+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 0x7f6ea4067290 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f6eac004630 tx=0x7f6eac009b30).stop 2022-02-02T20:45:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.343+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 msgr2=0x7f6ebc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.343+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f6eb00093f0 tx=0x7f6eb0006ec0).stop 2022-02-02T20:45:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 shutdown_connections 2022-02-02T20:45:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ea4064dd0 0x7f6ea4067290 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ebc0f66e0 0x7f6ebc06b9a0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 --2- 172.21.15.96:0/1275688538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ebc0f7980 0x7f6ebc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 >> 172.21.15.96:0/1275688538 conn(0x7f6ebc0f1e40 msgr2=0x7f6ebc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 shutdown_connections 2022-02-02T20:45:24.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.344+0000 7f6ec174b700 1 -- 172.21.15.96:0/1275688538 wait complete. 2022-02-02T20:45:24.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 -- 172.21.15.96:0/1091536450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 msgr2=0x7f29200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 --2- 172.21.15.96:0/1091536450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29200f6cc0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 rx=0x7f291c004660 tx=0x7f291c009b30).stop 2022-02-02T20:45:24.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 -- 172.21.15.96:0/1091536450 shutdown_connections 2022-02-02T20:45:24.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 --2- 172.21.15.96:0/1091536450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29200f6cc0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 --2- 172.21.15.96:0/1091536450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 0x7f29200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 -- 172.21.15.96:0/1091536450 >> 172.21.15.96:0/1091536450 conn(0x7f29200f0d40 msgr2=0x7f29200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 -- 172.21.15.96:0/1091536450 shutdown_connections 2022-02-02T20:45:24.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 -- 172.21.15.96:0/1091536450 wait complete. 2022-02-02T20:45:24.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.441+0000 7f29284bc700 1 Processor -- start 2022-02-02T20:45:24.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f29284bc700 1 -- start start 2022-02-02T20:45:24.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f29284bc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 0x7f2920105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f29284bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f29284bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201069b0 con 0x7f29200f6860 2022-02-02T20:45:24.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f29284bc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201071c0 con 0x7f29200f55c0 2022-02-02T20:45:24.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38898/0 (socket says 172.21.15.96:38898) 2022-02-02T20:45:24.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 -- 172.21.15.96:0/3127253413 learned_addr learned my addr 172.21.15.96:0/3127253413 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:24.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2926258700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 0x7f2920105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 -- 172.21.15.96:0/3127253413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 msgr2=0x7f2920105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 0x7f2920105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 -- 172.21.15.96:0/3127253413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c005040 con 0x7f29200f6860 2022-02-02T20:45:24.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.442+0000 7f2925a57700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f291c009990 tx=0x7f291c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.443+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291c018070 con 0x7f29200f6860 2022-02-02T20:45:24.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.443+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29201073e0 con 0x7f29200f6860 2022-02-02T20:45:24.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.443+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f291c007ba0 con 0x7f29200f6860 2022-02-02T20:45:24.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.443+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291c01c3c0 con 0x7f29200f6860 2022-02-02T20:45:24.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.443+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2920107940 con 0x7f29200f6860 2022-02-02T20:45:24.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.444+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29200f49b0 con 0x7f29200f6860 2022-02-02T20:45:24.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.444+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f291c01d420 con 0x7f29200f6860 2022-02-02T20:45:24.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.444+0000 7f2916ffd700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 0x7f290c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.445+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f291c0836a0 con 0x7f29200f6860 2022-02-02T20:45:24.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.445+0000 7f2926258700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 0x7f290c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.445+0000 7f2926258700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 0x7f290c0694a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f2920105c30 tx=0x7f291000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.449+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f291c051860 con 0x7f29200f6860 2022-02-02T20:45:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.682+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f29200ff790 con 0x7f29200f6860 2022-02-02T20:45:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.683+0000 7f2916ffd700 1 -- 172.21.15.96:0/3127253413 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f291c054e80 con 0x7f29200f6860 2022-02-02T20:45:24.684 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:45:24.685 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:45:24.685 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:45:24.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:24.685 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:45:24.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:45:24.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:24.686 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:45:24.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:45:24.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:24.687 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:45:24.687 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:45:24.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:24.689 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:45:24.689 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:45:24.690 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:45:24.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:45:24.690 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:45:24.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 msgr2=0x7f290c0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 0x7f290c0694a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f2920105c30 tx=0x7f291000b040).stop 2022-02-02T20:45:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 msgr2=0x7f29201063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f291c009990 tx=0x7f291c009b30).stop 2022-02-02T20:45:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 shutdown_connections 2022-02-02T20:45:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f290c066fe0 0x7f290c0694a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200f55c0 0x7f2920105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 --2- 172.21.15.96:0/3127253413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29200f6860 0x7f29201063b0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 >> 172.21.15.96:0/3127253413 conn(0x7f29200f0d40 msgr2=0x7f29200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 shutdown_connections 2022-02-02T20:45:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.685+0000 7f29284bc700 1 -- 172.21.15.96:0/3127253413 wait complete. 2022-02-02T20:45:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:24 smithi159 ceph-mon[69013]: pgmap v4299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- 172.21.15.96:0/3884404835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f6be0 msgr2=0x7f0db80f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 --2- 172.21.15.96:0/3884404835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f6be0 0x7f0db80f7000 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 rx=0x7f0db4004660 tx=0x7f0db4009b30).stop 2022-02-02T20:45:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- 172.21.15.96:0/3884404835 shutdown_connections 2022-02-02T20:45:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 --2- 172.21.15.96:0/3884404835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f5930 0x7f0db80f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 --2- 172.21.15.96:0/3884404835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f6be0 0x7f0db80f7000 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- 172.21.15.96:0/3884404835 >> 172.21.15.96:0/3884404835 conn(0x7f0db80f04c0 msgr2=0x7f0db80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:24.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:24 smithi096 ceph-mon[101353]: pgmap v4299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:24.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- 172.21.15.96:0/3884404835 shutdown_connections 2022-02-02T20:45:24.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- 172.21.15.96:0/3884404835 wait complete. 2022-02-02T20:45:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 Processor -- start 2022-02-02T20:45:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.782+0000 7f0dbf575700 1 -- start start 2022-02-02T20:45:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbf575700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbf575700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f6be0 0x7f0db810c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbf575700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80f55c0 con 0x7f0db80f5930 2022-02-02T20:45:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbf575700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80f5700 con 0x7f0db80f6be0 2022-02-02T20:45:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38906/0 (socket says 172.21.15.96:38906) 2022-02-02T20:45:24.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 -- 172.21.15.96:0/1281795691 learned_addr learned my addr 172.21.15.96:0/1281795691 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:24.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbcb10700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f6be0 0x7f0db810c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 -- 172.21.15.96:0/1281795691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f6be0 msgr2=0x7f0db810c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:24.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f6be0 0x7f0db810c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:24.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 -- 172.21.15.96:0/1281795691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4005040 con 0x7f0db80f5930 2022-02-02T20:45:24.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dbd311700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 rx=0x7f0db40043a0 tx=0x7f0db4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.783+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db4018070 con 0x7f0db80f5930 2022-02-02T20:45:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.784+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db810c790 con 0x7f0db80f5930 2022-02-02T20:45:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.784+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0db4007ba0 con 0x7f0db80f5930 2022-02-02T20:45:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.784+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db401c3c0 con 0x7f0db80f5930 2022-02-02T20:45:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.784+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db810ccc0 con 0x7f0db80f5930 2022-02-02T20:45:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.785+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80f4150 con 0x7f0db80f5930 2022-02-02T20:45:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.785+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0db401c680 con 0x7f0db80f5930 2022-02-02T20:45:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.785+0000 7f0dadffb700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 0x7f0da4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.786+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0db40836d0 con 0x7f0db80f5930 2022-02-02T20:45:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.786+0000 7f0dbcb10700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 0x7f0da4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:24.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.786+0000 7f0dbcb10700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 0x7f0da4067290 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f0db80f69b0 tx=0x7f0da8009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:24.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.790+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0db4051890 con 0x7f0db80f5930 2022-02-02T20:45:24.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.989+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0db8045ad0 con 0x7f0db80f5930 2022-02-02T20:45:24.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.990+0000 7f0dadffb700 1 -- 172.21.15.96:0/1281795691 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0db4054eb0 con 0x7f0db80f5930 2022-02-02T20:45:24.992 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:45:24.992 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:45:24.992 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:45:24.992 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:45:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:24.993 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:45:24.993 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:45:24.994 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:45:24.994 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:45:24.994 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:45:24.994 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:45:24.995 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:45:24.995 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:45:24.995 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:45:24.995 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:45:24.996 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:45:24.996 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:45:24.996 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:45:24.996 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:45:24.997 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:45:24.997 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:45:24.997 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:45:24.997 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:45:24.997 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:45:24.998 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:45:24.998 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:45:24.998 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:45:24.998 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:45:24.999 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:45:24.999 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:45:24.999 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:45:24.999 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:45:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:25.000 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:45:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:25.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:25.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:25.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:25.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.992+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 msgr2=0x7f0da4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:25.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.992+0000 7f0dbf575700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 0x7f0da4067290 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f0db80f69b0 tx=0x7f0da8009c00).stop 2022-02-02T20:45:25.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.992+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 msgr2=0x7f0db8109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:25.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.992+0000 7f0dbf575700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 rx=0x7f0db40043a0 tx=0x7f0db4009b30).stop 2022-02-02T20:45:25.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 shutdown_connections 2022-02-02T20:45:25.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da4064dd0 0x7f0da4067290 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db80f5930 0x7f0db8109d40 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 --2- 172.21.15.96:0/1281795691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db80f6be0 0x7f0db810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 >> 172.21.15.96:0/1281795691 conn(0x7f0db80f04c0 msgr2=0x7f0db80fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:25.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 shutdown_connections 2022-02-02T20:45:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:24.993+0000 7f0dbf575700 1 -- 172.21.15.96:0/1281795691 wait complete. 2022-02-02T20:45:25.005 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:45:25.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:25 smithi159 ceph-mon[69013]: from='client.38516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:25.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:25 smithi159 ceph-mon[69013]: from='client.38520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:25.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3127253413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:45:25.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1281795691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:45:25.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:25 smithi096 ceph-mon[101353]: from='client.38516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:25.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:25 smithi096 ceph-mon[101353]: from='client.38520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:25.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3127253413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:45:25.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1281795691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:45:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:26 smithi159 ceph-mon[69013]: pgmap v4300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:26 smithi096 ceph-mon[101353]: pgmap v4300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:27 smithi159 ceph-mon[69013]: pgmap v4301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:45:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:45:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:27 smithi096 ceph-mon[101353]: pgmap v4301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:45:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:45:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:30 smithi159 ceph-mon[69013]: pgmap v4302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:30 smithi096 ceph-mon[101353]: pgmap v4302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:32 smithi159 ceph-mon[69013]: pgmap v4303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:32 smithi096 ceph-mon[101353]: pgmap v4303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:34 smithi159 ceph-mon[69013]: pgmap v4304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:34.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:34 smithi096 ceph-mon[101353]: pgmap v4304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:36 smithi159 ceph-mon[69013]: pgmap v4305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:36 smithi096 ceph-mon[101353]: pgmap v4305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:37 smithi159 ceph-mon[69013]: pgmap v4306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:38.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:37 smithi096 ceph-mon[101353]: pgmap v4306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:40.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:40 smithi159 ceph-mon[69013]: pgmap v4307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:40 smithi096 ceph-mon[101353]: pgmap v4307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:42 smithi159 ceph-mon[69013]: pgmap v4308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:42 smithi096 ceph-mon[101353]: pgmap v4308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:44 smithi159 ceph-mon[69013]: pgmap v4309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:44 smithi096 ceph-mon[101353]: pgmap v4309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:46 smithi159 ceph-mon[69013]: pgmap v4310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:46 smithi096 ceph-mon[101353]: pgmap v4310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:47 smithi159 ceph-mon[69013]: pgmap v4311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:47 smithi096 ceph-mon[101353]: pgmap v4311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:50 smithi159 ceph-mon[69013]: pgmap v4312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:50 smithi096 ceph-mon[101353]: pgmap v4312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:52 smithi159 ceph-mon[69013]: pgmap v4313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:52 smithi096 ceph-mon[101353]: pgmap v4313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:54.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:54 smithi159 ceph-mon[69013]: pgmap v4314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:54 smithi096 ceph-mon[101353]: pgmap v4314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:55.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- 172.21.15.96:0/3680106199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 msgr2=0x7fed140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3680106199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed140f59e0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 rx=0x7fed04004660 tx=0x7fed04009b30).stop 2022-02-02T20:45:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- 172.21.15.96:0/3680106199 shutdown_connections 2022-02-02T20:45:55.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3680106199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 0x7fed140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3680106199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed140f59e0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- 172.21.15.96:0/3680106199 >> 172.21.15.96:0/3680106199 conn(0x7fed140f0d40 msgr2=0x7fed140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- 172.21.15.96:0/3680106199 shutdown_connections 2022-02-02T20:45:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- 172.21.15.96:0/3680106199 wait complete. 2022-02-02T20:45:55.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 Processor -- start 2022-02-02T20:45:55.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.103+0000 7fed1bb32700 1 -- start start 2022-02-02T20:45:55.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed1bb32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed1bb32700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 0x7fed1410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed1bb32700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140603e0 con 0x7fed140f55c0 2022-02-02T20:45:55.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed1bb32700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14060520 con 0x7fed140f6860 2022-02-02T20:45:55.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38924/0 (socket says 172.21.15.96:38924) 2022-02-02T20:45:55.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 -- 172.21.15.96:0/3594247973 learned_addr learned my addr 172.21.15.96:0/3594247973 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:55.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed190cd700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 0x7fed1410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 -- 172.21.15.96:0/3594247973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 msgr2=0x7fed1410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 0x7fed1410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 -- 172.21.15.96:0/3594247973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04005040 con 0x7fed140f55c0 2022-02-02T20:45:55.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed198ce700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7fed04013a70 tx=0x7fed04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed04018070 con 0x7fed140f55c0 2022-02-02T20:45:55.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed040097d0 con 0x7fed140f55c0 2022-02-02T20:45:55.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.104+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1410c6c0 con 0x7fed140f55c0 2022-02-02T20:45:55.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.105+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0401de80 con 0x7fed140f55c0 2022-02-02T20:45:55.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.105+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1410cc20 con 0x7fed140f55c0 2022-02-02T20:45:55.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.105+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed14045ad0 con 0x7fed140f55c0 2022-02-02T20:45:55.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.106+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed04007ba0 con 0x7fed140f55c0 2022-02-02T20:45:55.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.107+0000 7fed0a7fc700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 0x7fed00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.107+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed04083c40 con 0x7fed140f55c0 2022-02-02T20:45:55.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.107+0000 7fed190cd700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 0x7fed00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.107+0000 7fed190cd700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 0x7fed00067290 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fed10004c40 tx=0x7fed1000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.110+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed04051e00 con 0x7fed140f55c0 2022-02-02T20:45:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.291+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed14057f10 con 0x7fed00064dd0 2022-02-02T20:45:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.292+0000 7fed0a7fc700 1 -- 172.21.15.96:0/3594247973 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fed14057f10 con 0x7fed00064dd0 2022-02-02T20:45:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 msgr2=0x7fed00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 0x7fed00067290 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fed10004c40 tx=0x7fed1000b040).stop 2022-02-02T20:45:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 msgr2=0x7fed14109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7fed04013a70 tx=0x7fed04009b30).stop 2022-02-02T20:45:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 shutdown_connections 2022-02-02T20:45:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed00064dd0 0x7fed00067290 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed140f55c0 0x7fed14109c70 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 --2- 172.21.15.96:0/3594247973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed140f6860 0x7fed1410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 >> 172.21.15.96:0/3594247973 conn(0x7fed140f0d40 msgr2=0x7fed140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 shutdown_connections 2022-02-02T20:45:55.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.294+0000 7fed1bb32700 1 -- 172.21.15.96:0/3594247973 wait complete. 2022-02-02T20:45:55.305 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:45:55.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 -- 172.21.15.96:0/2051126853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 msgr2=0x7f03d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 --2- 172.21.15.96:0/2051126853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d40f7de0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 rx=0x7f03c0004660 tx=0x7f03c0009b30).stop 2022-02-02T20:45:55.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 -- 172.21.15.96:0/2051126853 shutdown_connections 2022-02-02T20:45:55.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 --2- 172.21.15.96:0/2051126853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d40f7de0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 --2- 172.21.15.96:0/2051126853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 0x7f03d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 -- 172.21.15.96:0/2051126853 >> 172.21.15.96:0/2051126853 conn(0x7f03d40f1e40 msgr2=0x7f03d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 -- 172.21.15.96:0/2051126853 shutdown_connections 2022-02-02T20:45:55.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.391+0000 7f03dac43700 1 -- 172.21.15.96:0/2051126853 wait complete. 2022-02-02T20:45:55.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 Processor -- start 2022-02-02T20:45:55.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 -- start start 2022-02-02T20:45:55.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 0x7f03d4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4107a00 con 0x7f03d40f7980 2022-02-02T20:45:55.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.392+0000 7f03dac43700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4107b40 con 0x7f03d40f66e0 2022-02-02T20:45:55.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38936/0 (socket says 172.21.15.96:38936) 2022-02-02T20:45:55.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 -- 172.21.15.96:0/2866272842 learned_addr learned my addr 172.21.15.96:0/2866272842 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:55.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d89df700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 0x7f03d4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 -- 172.21.15.96:0/2866272842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 msgr2=0x7f03d4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 0x7f03d4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 -- 172.21.15.96:0/2866272842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0005040 con 0x7f03d40f7980 2022-02-02T20:45:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d3fff700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7f03c0009990 tx=0x7f03c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c0018070 con 0x7f03d40f7980 2022-02-02T20:45:55.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d4108480 con 0x7f03d40f7980 2022-02-02T20:45:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03c0007ba0 con 0x7f03d40f7980 2022-02-02T20:45:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.393+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c001c620 con 0x7f03d40f7980 2022-02-02T20:45:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.394+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d41089e0 con 0x7f03d40f7980 2022-02-02T20:45:55.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.395+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d4045ad0 con 0x7f03d40f7980 2022-02-02T20:45:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.395+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03c001c8e0 con 0x7f03d40f7980 2022-02-02T20:45:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.396+0000 7f03d17fa700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 0x7f03c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.396+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f03c0083890 con 0x7f03d40f7980 2022-02-02T20:45:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.396+0000 7f03d89df700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 0x7f03c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.396+0000 7f03d89df700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 0x7f03c4067290 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f03d40f77e0 tx=0x7f03c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.400+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03c00553c0 con 0x7f03d40f7980 2022-02-02T20:45:55.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.572+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d4108c00 con 0x7f03c4064dd0 2022-02-02T20:45:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.582+0000 7f03d17fa700 1 -- 172.21.15.96:0/2866272842 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f03d4108c00 con 0x7f03c4064dd0 2022-02-02T20:45:55.583 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:45:55.584 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 119m ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:45:55.584 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 119m ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:45:55.584 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 118m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:45:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 119m ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:45:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 119m ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:45:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 119m ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:45:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 118m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:45:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 118m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:45:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 119m ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:45:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 118m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:45:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 119m ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:45:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 118m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:45:55.587 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 119m ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:45:55.587 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 118m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:45:55.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 119m ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:45:55.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 119m ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:45:55.587 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 119m ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:45:55.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 118m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:45:55.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 118m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:45:55.588 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 118m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:45:55.588 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 119m ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:45:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.583+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 msgr2=0x7f03c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.583+0000 7f03dac43700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 0x7f03c4067290 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f03d40f77e0 tx=0x7f03c8009040).stop 2022-02-02T20:45:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.583+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 msgr2=0x7f03d4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.583+0000 7f03dac43700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7f03c0009990 tx=0x7f03c0009b30).stop 2022-02-02T20:45:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 shutdown_connections 2022-02-02T20:45:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03c4064dd0 0x7f03c4067290 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03d40f66e0 0x7f03d4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 --2- 172.21.15.96:0/2866272842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03d40f7980 0x7f03d4107450 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 >> 172.21.15.96:0/2866272842 conn(0x7f03d40f1e40 msgr2=0x7f03d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 shutdown_connections 2022-02-02T20:45:55.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.584+0000 7f03dac43700 1 -- 172.21.15.96:0/2866272842 wait complete. 2022-02-02T20:45:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1715896186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 msgr2=0x7f6dd80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1715896186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd80f6cc0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 rx=0x7f6dd4004660 tx=0x7f6dd4009b30).stop 2022-02-02T20:45:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1715896186 shutdown_connections 2022-02-02T20:45:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1715896186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd80f6cc0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1715896186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 0x7f6dd80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:45:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1715896186 >> 172.21.15.96:0/1715896186 conn(0x7f6dd80f0d40 msgr2=0x7f6dd80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1715896186 shutdown_connections 2022-02-02T20:45:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1715896186 wait complete. 2022-02-02T20:45:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 Processor -- start 2022-02-02T20:45:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.680+0000 7f6ddfd93700 1 -- start start 2022-02-02T20:45:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddfd93700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 0x7f6dd810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddfd93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddfd93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80602b0 con 0x7f6dd80f6860 2022-02-02T20:45:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddfd93700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80603f0 con 0x7f6dd80f55c0 2022-02-02T20:45:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38946/0 (socket says 172.21.15.96:38946) 2022-02-02T20:45:55.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 -- 172.21.15.96:0/1926903053 learned_addr learned my addr 172.21.15.96:0/1926903053 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:55.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6dddb2f700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 0x7f6dd810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 -- 172.21.15.96:0/1926903053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 msgr2=0x7f6dd810c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 0x7f6dd810c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 -- 172.21.15.96:0/1926903053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4005040 con 0x7f6dd80f6860 2022-02-02T20:45:55.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6ddd32e700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 rx=0x7f6dd4009990 tx=0x7f6dd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.681+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd4018070 con 0x7f6dd80f6860 2022-02-02T20:45:55.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.682+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd810eac0 con 0x7f6dd80f6860 2022-02-02T20:45:55.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.682+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6dd4007ba0 con 0x7f6dd80f6860 2022-02-02T20:45:55.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.682+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd401c620 con 0x7f6dd80f6860 2022-02-02T20:45:55.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.682+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd810eee0 con 0x7f6dd80f6860 2022-02-02T20:45:55.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.683+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd8045ad0 con 0x7f6dd80f6860 2022-02-02T20:45:55.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.683+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6dd401c8e0 con 0x7f6dd80f6860 2022-02-02T20:45:55.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.683+0000 7f6dce7fc700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 0x7f6dc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:55.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.684+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6dd4083890 con 0x7f6dd80f6860 2022-02-02T20:45:55.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.684+0000 7f6dddb2f700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 0x7f6dc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:55.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.684+0000 7f6dddb2f700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 0x7f6dc4067290 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f6dd8060040 tx=0x7f6dc8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:55.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.688+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6dd4051990 con 0x7f6dd80f6860 2022-02-02T20:45:55.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.917+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6dd80fdf20 con 0x7f6dd80f6860 2022-02-02T20:45:55.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.918+0000 7f6dce7fc700 1 -- 172.21.15.96:0/1926903053 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6dd4054fb0 con 0x7f6dd80f6860 2022-02-02T20:45:55.920 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:45:55.920 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:45:55.920 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:45:55.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:55.921 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:45:55.921 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:45:55.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:55.921 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:45:55.922 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:45:55.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:55.922 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:45:55.922 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:45:55.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:45:55.923 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:45:55.923 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:45:55.923 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:45:55.923 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:45:55.924 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:45:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 msgr2=0x7f6dc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 0x7f6dc4067290 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f6dd8060040 tx=0x7f6dc8008040).stop 2022-02-02T20:45:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 msgr2=0x7f6dd810e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 rx=0x7f6dd4009990 tx=0x7f6dd4009b30).stop 2022-02-02T20:45:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 shutdown_connections 2022-02-02T20:45:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6dc4064dd0 0x7f6dc4067290 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dd80f55c0 0x7f6dd810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 --2- 172.21.15.96:0/1926903053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd80f6860 0x7f6dd810e5d0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:55.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 >> 172.21.15.96:0/1926903053 conn(0x7f6dd80f0d40 msgr2=0x7f6dd80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:55.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 shutdown_connections 2022-02-02T20:45:55.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:55.920+0000 7f6ddfd93700 1 -- 172.21.15.96:0/1926903053 wait complete. 2022-02-02T20:45:56.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 -- 172.21.15.96:0/3802009540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 msgr2=0x7fc35c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:56.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 --2- 172.21.15.96:0/3802009540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c0f5a00 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 rx=0x7fc350004660 tx=0x7fc350009b30).stop 2022-02-02T20:45:56.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 -- 172.21.15.96:0/3802009540 shutdown_connections 2022-02-02T20:45:56.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 --2- 172.21.15.96:0/3802009540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 0x7fc35c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 --2- 172.21.15.96:0/3802009540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c0f5a00 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 -- 172.21.15.96:0/3802009540 >> 172.21.15.96:0/3802009540 conn(0x7fc35c0f0de0 msgr2=0x7fc35c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:56.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 -- 172.21.15.96:0/3802009540 shutdown_connections 2022-02-02T20:45:56.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.017+0000 7fc3616aa700 1 -- 172.21.15.96:0/3802009540 wait complete. 2022-02-02T20:45:56.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 Processor -- start 2022-02-02T20:45:56.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 -- start start 2022-02-02T20:45:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 0x7fc35c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c060500 con 0x7fc35c0f55e0 2022-02-02T20:45:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.018+0000 7fc3616aa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c060640 con 0x7fc35c0f5ef0 2022-02-02T20:45:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38954/0 (socket says 172.21.15.96:38954) 2022-02-02T20:45:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 -- 172.21.15.96:0/2514816773 learned_addr learned my addr 172.21.15.96:0/2514816773 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:45:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35a7fc700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 0x7fc35c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 -- 172.21.15.96:0/2514816773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 msgr2=0x7fc35c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 0x7fc35c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 -- 172.21.15.96:0/2514816773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350005040 con 0x7fc35c0f55e0 2022-02-02T20:45:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc35affd700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 rx=0x7fc350009990 tx=0x7fc350009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc350018070 con 0x7fc35c0f55e0 2022-02-02T20:45:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c10c6e0 con 0x7fc35c0f55e0 2022-02-02T20:45:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc350007ba0 con 0x7fc35c0f55e0 2022-02-02T20:45:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35001c3c0 con 0x7fc35c0f55e0 2022-02-02T20:45:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.019+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c10cc40 con 0x7fc35c0f55e0 2022-02-02T20:45:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c045ad0 con 0x7fc35c0f55e0 2022-02-02T20:45:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc35001d420 con 0x7fc35c0f55e0 2022-02-02T20:45:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc3437fe700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 0x7fc344067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:45:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc3500836b0 con 0x7fc35c0f55e0 2022-02-02T20:45:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc35a7fc700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 0x7fc344067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:45:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.021+0000 7fc35a7fc700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 0x7fc344067290 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fc34c004c40 tx=0x7fc34c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:45:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.025+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc350051810 con 0x7fc35c0f55e0 2022-02-02T20:45:56.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.226+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc35c0fde70 con 0x7fc35c0f55e0 2022-02-02T20:45:56.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.227+0000 7fc3437fe700 1 -- 172.21.15.96:0/2514816773 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc350054e30 con 0x7fc35c0f55e0 2022-02-02T20:45:56.229 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:45:56.229 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:45:56.229 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:45:56.229 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:45:56.230 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:56.230 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:45:56.230 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:45:56.231 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:45:56.231 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:45:56.231 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:45:56.231 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:45:56.232 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:45:56.232 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:45:56.232 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:45:56.232 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:45:56.233 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:45:56.233 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:45:56.233 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:45:56.234 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:45:56.234 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:45:56.234 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:45:56.234 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:45:56.235 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:45:56.235 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:45:56.235 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:45:56.236 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:45:56.236 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:45:56.236 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:45:56.236 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:45:56.237 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:45:56.237 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:45:56.237 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:45:56.237 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:56.238 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:56.238 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:45:56.238 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:45:56.239 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:56.239 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:56.239 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:45:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 msgr2=0x7fc344067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 0x7fc344067290 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fc34c004c40 tx=0x7fc34c00b040).stop 2022-02-02T20:45:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 msgr2=0x7fc35c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:45:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 rx=0x7fc350009990 tx=0x7fc350009b30).stop 2022-02-02T20:45:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 shutdown_connections 2022-02-02T20:45:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc344064dd0 0x7fc344067290 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc35c0f55e0 0x7fc35c109c90 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 --2- 172.21.15.96:0/2514816773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc35c0f5ef0 0x7fc35c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:45:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.229+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 >> 172.21.15.96:0/2514816773 conn(0x7fc35c0f0de0 msgr2=0x7fc35c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:45:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.230+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 shutdown_connections 2022-02-02T20:45:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:45:56.230+0000 7fc3616aa700 1 -- 172.21.15.96:0/2514816773 wait complete. 2022-02-02T20:45:56.244 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:45:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:56 smithi159 ceph-mon[69013]: from='client.38532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:56 smithi159 ceph-mon[69013]: pgmap v4315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:56 smithi159 ceph-mon[69013]: from='client.38536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:56.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1926903053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:45:56.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2514816773' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:45:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:56 smithi096 ceph-mon[101353]: from='client.38532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:56 smithi096 ceph-mon[101353]: pgmap v4315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:56 smithi096 ceph-mon[101353]: from='client.38536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:45:56.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1926903053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:45:56.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2514816773' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:45:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:45:57 smithi159 ceph-mon[69013]: pgmap v4316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:45:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:45:57 smithi096 ceph-mon[101353]: pgmap v4316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:00 smithi159 ceph-mon[69013]: pgmap v4317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:00 smithi096 ceph-mon[101353]: pgmap v4317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:02 smithi159 ceph-mon[69013]: pgmap v4318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:02 smithi096 ceph-mon[101353]: pgmap v4318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:04 smithi159 ceph-mon[69013]: pgmap v4319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:04 smithi096 ceph-mon[101353]: pgmap v4319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:06 smithi159 ceph-mon[69013]: pgmap v4320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:06 smithi096 ceph-mon[101353]: pgmap v4320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:07 smithi159 ceph-mon[69013]: pgmap v4321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:07 smithi096 ceph-mon[101353]: pgmap v4321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:10 smithi159 ceph-mon[69013]: pgmap v4322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:10 smithi096 ceph-mon[101353]: pgmap v4322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:12 smithi159 ceph-mon[69013]: pgmap v4323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:12 smithi096 ceph-mon[101353]: pgmap v4323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:14 smithi159 ceph-mon[69013]: pgmap v4324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:14 smithi096 ceph-mon[101353]: pgmap v4324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:16 smithi159 ceph-mon[69013]: pgmap v4325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:16 smithi096 ceph-mon[101353]: pgmap v4325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:17 smithi159 ceph-mon[69013]: pgmap v4326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:17 smithi096 ceph-mon[101353]: pgmap v4326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:20 smithi159 ceph-mon[69013]: pgmap v4327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:20 smithi096 ceph-mon[101353]: pgmap v4327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:22 smithi159 ceph-mon[69013]: pgmap v4328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:22 smithi096 ceph-mon[101353]: pgmap v4328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:24 smithi159 ceph-mon[69013]: pgmap v4329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:24 smithi096 ceph-mon[101353]: pgmap v4329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 -- 172.21.15.96:0/736923908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f66d0 msgr2=0x7fbd540f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/736923908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f66d0 0x7fbd540f6b30 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 rx=0x7fbd44004660 tx=0x7fbd44009b30).stop 2022-02-02T20:46:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 -- 172.21.15.96:0/736923908 shutdown_connections 2022-02-02T20:46:26.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/736923908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f66d0 0x7fbd540f6b30 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/736923908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f5430 0x7fbd540f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.335+0000 7fbd5a39a700 1 -- 172.21.15.96:0/736923908 >> 172.21.15.96:0/736923908 conn(0x7fbd540f0b90 msgr2=0x7fbd540f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 -- 172.21.15.96:0/736923908 shutdown_connections 2022-02-02T20:46:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 -- 172.21.15.96:0/736923908 wait complete. 2022-02-02T20:46:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 Processor -- start 2022-02-02T20:46:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 -- start start 2022-02-02T20:46:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 0x7fbd54107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54107870 con 0x7fbd540f5430 2022-02-02T20:46:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd5a39a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541080b0 con 0x7fbd540f66d0 2022-02-02T20:46:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd59398700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.336+0000 7fbd59398700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38972/0 (socket says 172.21.15.96:38972) 2022-02-02T20:46:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd59398700 1 -- 172.21.15.96:0/3979790600 learned_addr learned my addr 172.21.15.96:0/3979790600 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd59398700 1 -- 172.21.15.96:0/3979790600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 msgr2=0x7fbd54107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd58b97700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 0x7fbd54107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd59398700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 0x7fbd54107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd59398700 1 -- 172.21.15.96:0/3979790600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44005040 con 0x7fbd540f5430 2022-02-02T20:46:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd58b97700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 0x7fbd54107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:46:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd59398700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7fbd50002700 tx=0x7fbd50009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd50009320 con 0x7fbd540f5430 2022-02-02T20:46:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd54108390 con 0x7fbd540f5430 2022-02-02T20:46:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd5000f040 con 0x7fbd540f5430 2022-02-02T20:46:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd50014900 con 0x7fbd540f5430 2022-02-02T20:46:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.337+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd541088d0 con 0x7fbd540f5430 2022-02-02T20:46:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.338+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd54059100 con 0x7fbd540f5430 2022-02-02T20:46:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.339+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbd50009480 con 0x7fbd540f5430 2022-02-02T20:46:26.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.339+0000 7fbd49ffb700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 0x7fbd400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.339+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbd50081cc0 con 0x7fbd540f5430 2022-02-02T20:46:26.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.339+0000 7fbd58b97700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 0x7fbd400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.340+0000 7fbd58b97700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 0x7fbd400672e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fbd44009da0 tx=0x7fbd44009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.344+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbd5004fe80 con 0x7fbd540f5430 2022-02-02T20:46:26.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.522+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd540fab10 con 0x7fbd40064e20 2022-02-02T20:46:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.523+0000 7fbd49ffb700 1 -- 172.21.15.96:0/3979790600 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbd540fab10 con 0x7fbd40064e20 2022-02-02T20:46:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 msgr2=0x7fbd400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 0x7fbd400672e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fbd44009da0 tx=0x7fbd44009b30).stop 2022-02-02T20:46:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 msgr2=0x7fbd54106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7fbd50002700 tx=0x7fbd50009d80).stop 2022-02-02T20:46:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 shutdown_connections 2022-02-02T20:46:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd40064e20 0x7fbd400672e0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5430 0x7fbd54106d80 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 --2- 172.21.15.96:0/3979790600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f66d0 0x7fbd54107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 >> 172.21.15.96:0/3979790600 conn(0x7fbd540f0b90 msgr2=0x7fbd5405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 shutdown_connections 2022-02-02T20:46:26.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.525+0000 7fbd5a39a700 1 -- 172.21.15.96:0/3979790600 wait complete. 2022-02-02T20:46:26.537 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:46:26.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- 172.21.15.96:0/1398244939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f6700 msgr2=0x7fb6980f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 --2- 172.21.15.96:0/1398244939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f6700 0x7fb6980f6b60 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 rx=0x7fb68c004660 tx=0x7fb68c009b30).stop 2022-02-02T20:46:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- 172.21.15.96:0/1398244939 shutdown_connections 2022-02-02T20:46:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 --2- 172.21.15.96:0/1398244939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f6700 0x7fb6980f6b60 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 --2- 172.21.15.96:0/1398244939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f5460 0x7fb6980f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- 172.21.15.96:0/1398244939 >> 172.21.15.96:0/1398244939 conn(0x7fb6980f0bc0 msgr2=0x7fb6980f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:26.628 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:26 smithi096 ceph-mon[101353]: pgmap v4330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- 172.21.15.96:0/1398244939 shutdown_connections 2022-02-02T20:46:26.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- 172.21.15.96:0/1398244939 wait complete. 2022-02-02T20:46:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 Processor -- start 2022-02-02T20:46:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.624+0000 7fb69d397700 1 -- start start 2022-02-02T20:46:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb69d397700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb69d397700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f6700 0x7fb6980f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb69d397700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980f7fa0 con 0x7fb6980f5460 2022-02-02T20:46:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb69d397700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980f80e0 con 0x7fb6980f6700 2022-02-02T20:46:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38980/0 (socket says 172.21.15.96:38980) 2022-02-02T20:46:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 -- 172.21.15.96:0/658396472 learned_addr learned my addr 172.21.15.96:0/658396472 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:26.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb6967fc700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f6700 0x7fb6980f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 -- 172.21.15.96:0/658396472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f6700 msgr2=0x7fb6980f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f6700 0x7fb6980f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 -- 172.21.15.96:0/658396472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c005040 con 0x7fb6980f5460 2022-02-02T20:46:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb696ffd700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7fb68800c530 tx=0x7fb688007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb68800f650 con 0x7fb6980f5460 2022-02-02T20:46:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6980f83c0 con 0x7fb6980f5460 2022-02-02T20:46:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb68800fc60 con 0x7fb6980f5460 2022-02-02T20:46:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.625+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688012cb0 con 0x7fb6980f5460 2022-02-02T20:46:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.626+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69810edc0 con 0x7fb6980f5460 2022-02-02T20:46:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.626+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb698045ad0 con 0x7fb6980f5460 2022-02-02T20:46:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.627+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb688019030 con 0x7fb6980f5460 2022-02-02T20:46:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.628+0000 7fb67f7fe700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 0x7fb6800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.628+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb688081b10 con 0x7fb6980f5460 2022-02-02T20:46:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.628+0000 7fb6967fc700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 0x7fb6800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.628+0000 7fb6967fc700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 0x7fb6800672e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fb68c004630 tx=0x7fb68c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.631+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb68804fe00 con 0x7fb6980f5460 2022-02-02T20:46:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:26 smithi159 ceph-mon[69013]: pgmap v4330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:26.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.805+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6980fab40 con 0x7fb680064e20 2022-02-02T20:46:26.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.814+0000 7fb67f7fe700 1 -- 172.21.15.96:0/658396472 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb6980fab40 con 0x7fb680064e20 2022-02-02T20:46:26.816 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:46:26.817 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:46:26.817 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:46:26.817 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 118m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:46:26.817 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:46:26.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:46:26.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:46:26.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 118m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:46:26.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 118m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:46:26.819 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:46:26.819 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 118m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:46:26.819 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:46:26.819 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 118m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:46:26.819 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:46:26.820 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 118m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:46:26.820 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:46:26.820 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:46:26.820 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:46:26.821 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 118m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:46:26.821 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 118m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:46:26.821 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 118m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:46:26.822 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:46:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 msgr2=0x7fb6800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 0x7fb6800672e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fb68c004630 tx=0x7fb68c009b30).stop 2022-02-02T20:46:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 msgr2=0x7fb6980f95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7fb68800c530 tx=0x7fb688007e10).stop 2022-02-02T20:46:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 shutdown_connections 2022-02-02T20:46:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb680064e20 0x7fb6800672e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6980f5460 0x7fb6980f95c0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 --2- 172.21.15.96:0/658396472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6980f6700 0x7fb6980f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 >> 172.21.15.96:0/658396472 conn(0x7fb6980f0bc0 msgr2=0x7fb69805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 shutdown_connections 2022-02-02T20:46:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.816+0000 7fb69d397700 1 -- 172.21.15.96:0/658396472 wait complete. 2022-02-02T20:46:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 -- 172.21.15.96:0/945181561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f6530 msgr2=0x7fb1f80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 --2- 172.21.15.96:0/945181561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f6530 0x7fb1f80f6950 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 rx=0x7fb1f4004660 tx=0x7fb1f4009b30).stop 2022-02-02T20:46:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 -- 172.21.15.96:0/945181561 shutdown_connections 2022-02-02T20:46:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 --2- 172.21.15.96:0/945181561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f77d0 0x7fb1f80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 --2- 172.21.15.96:0/945181561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f6530 0x7fb1f80f6950 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.911+0000 7fb1fe472700 1 -- 172.21.15.96:0/945181561 >> 172.21.15.96:0/945181561 conn(0x7fb1f80f1c90 msgr2=0x7fb1f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:26.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.912+0000 7fb1fe472700 1 -- 172.21.15.96:0/945181561 shutdown_connections 2022-02-02T20:46:26.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.912+0000 7fb1fe472700 1 -- 172.21.15.96:0/945181561 wait complete. 2022-02-02T20:46:26.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.912+0000 7fb1fe472700 1 Processor -- start 2022-02-02T20:46:26.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.912+0000 7fb1fe472700 1 -- start start 2022-02-02T20:46:26.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fe472700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f6530 0x7fb1f8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fe472700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fe472700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81078f0 con 0x7fb1f80f77d0 2022-02-02T20:46:26.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fe472700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8108100 con 0x7fb1f80f6530 2022-02-02T20:46:26.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38992/0 (socket says 172.21.15.96:38992) 2022-02-02T20:46:26.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 -- 172.21.15.96:0/3480106588 learned_addr learned my addr 172.21.15.96:0/3480106588 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fd470700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f6530 0x7fb1f8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 -- 172.21.15.96:0/3480106588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f6530 msgr2=0x7fb1f8106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f6530 0x7fb1f8106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 -- 172.21.15.96:0/3480106588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4005040 con 0x7fb1f80f77d0 2022-02-02T20:46:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1fcc6f700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 rx=0x7fb1e80026d0 tx=0x7fb1e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.913+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e80079c0 con 0x7fb1f80f77d0 2022-02-02T20:46:26.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.914+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1e800f040 con 0x7fb1f80f77d0 2022-02-02T20:46:26.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.914+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f8108380 con 0x7fb1f80f77d0 2022-02-02T20:46:26.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.914+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e80148b0 con 0x7fb1f80f77d0 2022-02-02T20:46:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.914+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f8108940 con 0x7fb1f80f77d0 2022-02-02T20:46:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.915+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f8059100 con 0x7fb1f80f77d0 2022-02-02T20:46:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.915+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb1e8007b20 con 0x7fb1f80f77d0 2022-02-02T20:46:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.916+0000 7fb1edffb700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 0x7fb1e40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.916+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb1e80819a0 con 0x7fb1f80f77d0 2022-02-02T20:46:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.916+0000 7fb1fd470700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 0x7fb1e40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.916+0000 7fb1fd470700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 0x7fb1e40672e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fb1f4013690 tx=0x7fb1f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:26.920+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb1e804faa0 con 0x7fb1f80f77d0 2022-02-02T20:46:27.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.151+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1f80fee80 con 0x7fb1f80f77d0 2022-02-02T20:46:27.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.151+0000 7fb1edffb700 1 -- 172.21.15.96:0/3480106588 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb1f80fee80 con 0x7fb1f80f77d0 2022-02-02T20:46:27.155 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:46:27.155 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:46:27.155 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:46:27.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:27.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:46:27.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:46:27.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:27.156 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:46:27.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:46:27.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:27.157 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:46:27.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:46:27.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:27.158 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:46:27.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:46:27.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:46:27.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:46:27.158 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:46:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 msgr2=0x7fb1e40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 0x7fb1e40672e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fb1f4013690 tx=0x7fb1f4009b30).stop 2022-02-02T20:46:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 msgr2=0x7fb1f81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 rx=0x7fb1e80026d0 tx=0x7fb1e8009de0).stop 2022-02-02T20:46:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 shutdown_connections 2022-02-02T20:46:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1e4064e20 0x7fb1e40672e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f80f6530 0x7fb1f8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 --2- 172.21.15.96:0/3480106588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f80f77d0 0x7fb1f81072f0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 >> 172.21.15.96:0/3480106588 conn(0x7fb1f80f1c90 msgr2=0x7fb1f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 shutdown_connections 2022-02-02T20:46:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.153+0000 7fb1fe472700 1 -- 172.21.15.96:0/3480106588 wait complete. 2022-02-02T20:46:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 -- 172.21.15.96:0/2874389058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f7980 msgr2=0x7f3fc00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 --2- 172.21.15.96:0/2874389058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f7980 0x7f3fc00f7de0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 rx=0x7f3fac004660 tx=0x7f3fac009b30).stop 2022-02-02T20:46:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 -- 172.21.15.96:0/2874389058 shutdown_connections 2022-02-02T20:46:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 --2- 172.21.15.96:0/2874389058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f7980 0x7f3fc00f7de0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 --2- 172.21.15.96:0/2874389058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f66e0 0x7f3fc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 -- 172.21.15.96:0/2874389058 >> 172.21.15.96:0/2874389058 conn(0x7f3fc00f1e40 msgr2=0x7f3fc00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 -- 172.21.15.96:0/2874389058 shutdown_connections 2022-02-02T20:46:27.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.263+0000 7f3fc7043700 1 -- 172.21.15.96:0/2874389058 wait complete. 2022-02-02T20:46:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 Processor -- start 2022-02-02T20:46:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 -- start start 2022-02-02T20:46:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f7980 0x7f3fc0109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0109c30 con 0x7f3fc00f66e0 2022-02-02T20:46:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.264+0000 7f3fc7043700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0109d70 con 0x7f3fc00f7980 2022-02-02T20:46:27.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39000/0 (socket says 172.21.15.96:39000) 2022-02-02T20:46:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 -- 172.21.15.96:0/4187353072 learned_addr learned my addr 172.21.15.96:0/4187353072 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fbffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f7980 0x7f3fc0109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:27.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 -- 172.21.15.96:0/4187353072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f7980 msgr2=0x7f3fc0109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f7980 0x7f3fc0109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 -- 172.21.15.96:0/4187353072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac005040 con 0x7f3fc00f66e0 2022-02-02T20:46:27.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc4ddf700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f3fb4002700 tx=0x7f3fb4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:27.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb40079c0 con 0x7f3fc00f66e0 2022-02-02T20:46:27.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc010a710 con 0x7f3fc00f66e0 2022-02-02T20:46:27.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fb400f040 con 0x7f3fc00f66e0 2022-02-02T20:46:27.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb4014860 con 0x7f3fc00f66e0 2022-02-02T20:46:27.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.265+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc010acd0 con 0x7f3fc00f66e0 2022-02-02T20:46:27.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.266+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc0045ad0 con 0x7f3fc00f66e0 2022-02-02T20:46:27.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.267+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fb401b060 con 0x7f3fc00f66e0 2022-02-02T20:46:27.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.267+0000 7f3fbd7fa700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 0x7f3fb0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:27.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.267+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3fb40818e0 con 0x7f3fc00f66e0 2022-02-02T20:46:27.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.267+0000 7f3fbffff700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 0x7f3fb0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:27.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.268+0000 7f3fbffff700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 0x7f3fb0067290 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f3fac004630 tx=0x7f3fac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:27.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.272+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fb4053410 con 0x7f3fc00f66e0 2022-02-02T20:46:27.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.470+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3fc00ff020 con 0x7f3fc00f66e0 2022-02-02T20:46:27.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.471+0000 7f3fbd7fa700 1 -- 172.21.15.96:0/4187353072 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3fb4019070 con 0x7f3fc00f66e0 2022-02-02T20:46:27.473 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:46:27.474 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:46:27.474 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:46:27.474 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:46:27.475 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:27.475 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:46:27.475 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:46:27.475 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:46:27.475 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:46:27.476 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:46:27.476 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:46:27.476 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:46:27.476 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:46:27.477 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:46:27.477 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:46:27.477 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:46:27.478 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:46:27.478 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:46:27.478 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:46:27.478 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:46:27.479 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:46:27.479 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:46:27.479 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:46:27.479 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:46:27.480 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:46:27.480 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:46:27.480 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:46:27.480 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:46:27.481 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:46:27.481 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:46:27.481 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:46:27.481 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:46:27.481 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:27.482 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:27.482 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:46:27.482 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:27.482 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:27.483 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:27.483 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:27.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 msgr2=0x7f3fb0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 0x7f3fb0067290 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f3fac004630 tx=0x7f3fac009b30).stop 2022-02-02T20:46:27.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 msgr2=0x7f3fc0109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:27.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f3fb4002700 tx=0x7f3fb4009d80).stop 2022-02-02T20:46:27.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 shutdown_connections 2022-02-02T20:46:27.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3fb0064dd0 0x7f3fb0067290 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fc00f66e0 0x7f3fc0109190 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 --2- 172.21.15.96:0/4187353072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fc00f7980 0x7f3fc0109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 >> 172.21.15.96:0/4187353072 conn(0x7f3fc00f1e40 msgr2=0x7f3fc006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:27.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 shutdown_connections 2022-02-02T20:46:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:27.473+0000 7f3fc7043700 1 -- 172.21.15.96:0/4187353072 wait complete. 2022-02-02T20:46:27.487 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:46:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='client.38548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='client.38552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:27.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3480106588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:46:27.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4187353072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:46:27.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:46:27.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:46:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='client.38548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='client.38552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3480106588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:46:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4187353072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:46:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:46:27.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:46:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:28 smithi159 ceph-mon[69013]: pgmap v4331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:28 smithi096 ceph-mon[101353]: pgmap v4331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:30 smithi159 ceph-mon[69013]: pgmap v4332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:30 smithi096 ceph-mon[101353]: pgmap v4332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:32 smithi159 ceph-mon[69013]: pgmap v4333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:32 smithi096 ceph-mon[101353]: pgmap v4333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:34 smithi159 ceph-mon[69013]: pgmap v4334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:34.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:34 smithi096 ceph-mon[101353]: pgmap v4334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:36 smithi159 ceph-mon[69013]: pgmap v4335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:36.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:36 smithi096 ceph-mon[101353]: pgmap v4335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:37 smithi159 ceph-mon[69013]: pgmap v4336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:37 smithi096 ceph-mon[101353]: pgmap v4336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:40 smithi159 ceph-mon[69013]: pgmap v4337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:40 smithi096 ceph-mon[101353]: pgmap v4337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:42 smithi159 ceph-mon[69013]: pgmap v4338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:42.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:42 smithi096 ceph-mon[101353]: pgmap v4338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:44 smithi159 ceph-mon[69013]: pgmap v4339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:44 smithi096 ceph-mon[101353]: pgmap v4339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:46 smithi159 ceph-mon[69013]: pgmap v4340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:46 smithi096 ceph-mon[101353]: pgmap v4340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:47 smithi159 ceph-mon[69013]: pgmap v4341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:47 smithi096 ceph-mon[101353]: pgmap v4341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:50.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:50 smithi159 ceph-mon[69013]: pgmap v4342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:50 smithi096 ceph-mon[101353]: pgmap v4342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:52 smithi159 ceph-mon[69013]: pgmap v4343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:52 smithi096 ceph-mon[101353]: pgmap v4343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:54.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:54 smithi159 ceph-mon[69013]: pgmap v4344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:54 smithi096 ceph-mon[101353]: pgmap v4344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:56 smithi159 ceph-mon[69013]: pgmap v4345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:56 smithi096 ceph-mon[101353]: pgmap v4345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:57.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 -- 172.21.15.96:0/1744296718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 msgr2=0x7f1fb80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 --2- 172.21.15.96:0/1744296718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f6cc0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 rx=0x7f1fa8004660 tx=0x7f1fa8009b30).stop 2022-02-02T20:46:57.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 -- 172.21.15.96:0/1744296718 shutdown_connections 2022-02-02T20:46:57.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 --2- 172.21.15.96:0/1744296718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f6cc0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 --2- 172.21.15.96:0/1744296718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 0x7f1fb80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 -- 172.21.15.96:0/1744296718 >> 172.21.15.96:0/1744296718 conn(0x7f1fb80f0d40 msgr2=0x7f1fb80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:57.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 -- 172.21.15.96:0/1744296718 shutdown_connections 2022-02-02T20:46:57.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 -- 172.21.15.96:0/1744296718 wait complete. 2022-02-02T20:46:57.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.583+0000 7f1fbd081700 1 Processor -- start 2022-02-02T20:46:57.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fbd081700 1 -- start start 2022-02-02T20:46:57.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fbd081700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 0x7f1fb80f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fbd081700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fbd081700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80f8920 con 0x7f1fb80f6860 2022-02-02T20:46:57.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fbd081700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80f8a60 con 0x7f1fb80f55c0 2022-02-02T20:46:57.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39024/0 (socket says 172.21.15.96:39024) 2022-02-02T20:46:57.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 -- 172.21.15.96:0/588516149 learned_addr learned my addr 172.21.15.96:0/588516149 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:57.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb6d9d700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 0x7f1fb80f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 -- 172.21.15.96:0/588516149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 msgr2=0x7f1fb80f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 0x7f1fb80f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 -- 172.21.15.96:0/588516149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8005040 con 0x7f1fb80f6860 2022-02-02T20:46:57.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.584+0000 7f1fb659c700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f1fa8009990 tx=0x7f1fa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:57.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.585+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa8018070 con 0x7f1fb80f6860 2022-02-02T20:46:57.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.585+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb80f8ce0 con 0x7f1fb80f6860 2022-02-02T20:46:57.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.585+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fa8007ba0 con 0x7f1fb80f6860 2022-02-02T20:46:57.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.585+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa801c3c0 con 0x7f1fb80f6860 2022-02-02T20:46:57.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.585+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb80f9240 con 0x7f1fb80f6860 2022-02-02T20:46:57.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.586+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8045ad0 con 0x7f1fb80f6860 2022-02-02T20:46:57.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.586+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1fa801d420 con 0x7f1fb80f6860 2022-02-02T20:46:57.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.586+0000 7f1f9f7fe700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 0x7f1fa0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.587+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1fa80836a0 con 0x7f1fb80f6860 2022-02-02T20:46:57.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.587+0000 7f1fb6d9d700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 0x7f1fa0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.587+0000 7f1fb6d9d700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 0x7f1fa0067290 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f1fb80f9cd0 tx=0x7f1fac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:57.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.591+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1fa8051860 con 0x7f1fb80f6860 2022-02-02T20:46:57.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.770+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fb805fd30 con 0x7f1fa0064dd0 2022-02-02T20:46:57.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.771+0000 7f1f9f7fe700 1 -- 172.21.15.96:0/588516149 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1fb805fd30 con 0x7f1fa0064dd0 2022-02-02T20:46:57.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 msgr2=0x7f1fa0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 0x7f1fa0067290 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f1fb80f9cd0 tx=0x7f1fac00b040).stop 2022-02-02T20:46:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 msgr2=0x7f1fb80f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f1fa8009990 tx=0x7f1fa8009b30).stop 2022-02-02T20:46:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 shutdown_connections 2022-02-02T20:46:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1fa0064dd0 0x7f1fa0067290 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fb80f55c0 0x7f1fb80f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 --2- 172.21.15.96:0/588516149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb80f6860 0x7f1fb80f83c0 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 >> 172.21.15.96:0/588516149 conn(0x7f1fb80f0d40 msgr2=0x7f1fb805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 shutdown_connections 2022-02-02T20:46:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.773+0000 7f1fbd081700 1 -- 172.21.15.96:0/588516149 wait complete. 2022-02-02T20:46:57.785 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:46:57.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 -- 172.21.15.96:0/3740352632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f5430 msgr2=0x7f6d040f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 --2- 172.21.15.96:0/3740352632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f5430 0x7f6d040f5850 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 rx=0x7f6cf8004660 tx=0x7f6cf8009b30).stop 2022-02-02T20:46:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 -- 172.21.15.96:0/3740352632 shutdown_connections 2022-02-02T20:46:57.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 --2- 172.21.15.96:0/3740352632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f66d0 0x7f6d040f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 --2- 172.21.15.96:0/3740352632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f5430 0x7f6d040f5850 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 -- 172.21.15.96:0/3740352632 >> 172.21.15.96:0/3740352632 conn(0x7f6d040f0b90 msgr2=0x7f6d040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.871+0000 7f6d09995700 1 -- 172.21.15.96:0/3740352632 shutdown_connections 2022-02-02T20:46:57.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.872+0000 7f6d09995700 1 -- 172.21.15.96:0/3740352632 wait complete. 2022-02-02T20:46:57.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.872+0000 7f6d09995700 1 Processor -- start 2022-02-02T20:46:57.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.872+0000 7f6d09995700 1 -- start start 2022-02-02T20:46:57.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d09995700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 0x7f6d04108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d09995700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d09995700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04109a00 con 0x7f6d040f66d0 2022-02-02T20:46:57.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d09995700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04109b40 con 0x7f6d040f5430 2022-02-02T20:46:57.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39034/0 (socket says 172.21.15.96:39034) 2022-02-02T20:46:57.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 -- 172.21.15.96:0/3394222406 learned_addr learned my addr 172.21.15.96:0/3394222406 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:57.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d08993700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 0x7f6d04108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 -- 172.21.15.96:0/3394222406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 msgr2=0x7f6d04108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:57.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 0x7f6d04108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:57.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 -- 172.21.15.96:0/3394222406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8005040 con 0x7f6d040f66d0 2022-02-02T20:46:57.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d08993700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 0x7f6d04108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:46:57.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.873+0000 7f6d03fff700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 rx=0x7f6cf0002700 tx=0x7f6cf0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:57.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.874+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf0009320 con 0x7f6d040f66d0 2022-02-02T20:46:57.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.874+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6cf000f040 con 0x7f6d040f66d0 2022-02-02T20:46:57.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.874+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0410a4e0 con 0x7f6d040f66d0 2022-02-02T20:46:57.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.874+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf0014820 con 0x7f6d040f66d0 2022-02-02T20:46:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.874+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0410aaa0 con 0x7f6d040f66d0 2022-02-02T20:46:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.875+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04045ad0 con 0x7f6d040f66d0 2022-02-02T20:46:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.875+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6cf0009480 con 0x7f6d040f66d0 2022-02-02T20:46:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.875+0000 7f6d017fa700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 0x7f6cf40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.875+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6cf0081d10 con 0x7f6d040f66d0 2022-02-02T20:46:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.875+0000 7f6d08993700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 0x7f6cf40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.876+0000 7f6d08993700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 0x7f6cf40672e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f6cf8005010 tx=0x7f6cf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:57.880+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6cf0053840 con 0x7f6d040f66d0 2022-02-02T20:46:58.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.053+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d040fb130 con 0x7f6cf4064e20 2022-02-02T20:46:58.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.063+0000 7f6d017fa700 1 -- 172.21.15.96:0/3394222406 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6d040fb130 con 0x7f6cf4064e20 2022-02-02T20:46:58.065 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:46:58.066 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:46:58.066 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:46:58.066 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 119m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:46:58.066 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:46:58.067 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:46:58.067 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:46:58.067 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 119m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:46:58.067 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 119m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:46:58.068 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:46:58.068 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 119m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:46:58.068 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:46:58.068 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 119m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:46:58.068 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:46:58.069 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 119m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:46:58.069 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:46:58.069 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:46:58.069 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:46:58.070 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 119m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:46:58.070 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 119m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:46:58.070 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 119m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:46:58.070 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:46:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.064+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 msgr2=0x7f6cf40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.064+0000 7f6d09995700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 0x7f6cf40672e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f6cf8005010 tx=0x7f6cf8009b30).stop 2022-02-02T20:46:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 msgr2=0x7f6d04109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 rx=0x7f6cf0002700 tx=0x7f6cf0009e00).stop 2022-02-02T20:46:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 shutdown_connections 2022-02-02T20:46:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6cf4064e20 0x7f6cf40672e0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d040f5430 0x7f6d04108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 --2- 172.21.15.96:0/3394222406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d040f66d0 0x7f6d04109450 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 >> 172.21.15.96:0/3394222406 conn(0x7f6d040f0b90 msgr2=0x7f6d0405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 shutdown_connections 2022-02-02T20:46:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.065+0000 7f6d09995700 1 -- 172.21.15.96:0/3394222406 wait complete. 2022-02-02T20:46:58.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 -- 172.21.15.96:0/399365408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 msgr2=0x7f71c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 --2- 172.21.15.96:0/399365408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c80f6cc0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 rx=0x7f71b8004660 tx=0x7f71b8009b30).stop 2022-02-02T20:46:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 -- 172.21.15.96:0/399365408 shutdown_connections 2022-02-02T20:46:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 --2- 172.21.15.96:0/399365408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f6860 0x7f71c80f6cc0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 --2- 172.21.15.96:0/399365408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f55c0 0x7f71c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 -- 172.21.15.96:0/399365408 >> 172.21.15.96:0/399365408 conn(0x7f71c80f0d40 msgr2=0x7f71c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:58.165 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:57 smithi096 ceph-mon[101353]: pgmap v4346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:58.165 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:57 smithi096 ceph-mon[101353]: from='client.38564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:58.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 -- 172.21.15.96:0/399365408 shutdown_connections 2022-02-02T20:46:58.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.161+0000 7f71cd98c700 1 -- 172.21.15.96:0/399365408 wait complete. 2022-02-02T20:46:58.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 Processor -- start 2022-02-02T20:46:58.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 -- start start 2022-02-02T20:46:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81069b0 con 0x7f71c80f55c0 2022-02-02T20:46:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71cd98c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81071c0 con 0x7f71c80f6860 2022-02-02T20:46:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39042/0 (socket says 172.21.15.96:39042) 2022-02-02T20:46:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.162+0000 7f71c6ffd700 1 -- 172.21.15.96:0/2639982571 learned_addr learned my addr 172.21.15.96:0/2639982571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71c6ffd700 1 -- 172.21.15.96:0/2639982571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 msgr2=0x7f71c81063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71c6ffd700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:46:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71c6ffd700 1 -- 172.21.15.96:0/2639982571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8005040 con 0x7f71c80f55c0 2022-02-02T20:46:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71c6ffd700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 rx=0x7f71bc00c530 tx=0x7f71bc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc00f650 con 0x7f71c80f55c0 2022-02-02T20:46:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71bc00fc60 con 0x7f71c80f55c0 2022-02-02T20:46:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8107440 con 0x7f71c80f55c0 2022-02-02T20:46:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc012d20 con 0x7f71c80f55c0 2022-02-02T20:46:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.163+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c8107a00 con 0x7f71c80f55c0 2022-02-02T20:46:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.164+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c80f49b0 con 0x7f71c80f55c0 2022-02-02T20:46:58.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.165+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71bc019030 con 0x7f71c80f55c0 2022-02-02T20:46:58.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.165+0000 7f71af7fe700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.165+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71bc081710 con 0x7f71c80f55c0 2022-02-02T20:46:58.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.165+0000 7f71c67fc700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:58.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.166+0000 7f71c67fc700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f71b8004e30 tx=0x7f71b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:58.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.170+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71bc04f8c0 con 0x7f71c80f55c0 2022-02-02T20:46:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:57 smithi159 ceph-mon[69013]: pgmap v4346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:46:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:57 smithi159 ceph-mon[69013]: from='client.38564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.401+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71c80fde80 con 0x7f71c80f55c0 2022-02-02T20:46:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.401+0000 7f71af7fe700 1 -- 172.21.15.96:0/2639982571 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f71bc052ee0 con 0x7f71c80f55c0 2022-02-02T20:46:58.404 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:46:58.404 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:46:58.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:46:58.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:58.405 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:46:58.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:46:58.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:58.406 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:46:58.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:46:58.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:58.406 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:46:58.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:46:58.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:46:58.407 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:46:58.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:46:58.408 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:46:58.408 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:46:58.408 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:46:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 msgr2=0x7f71b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f71b8004e30 tx=0x7f71b8009b30).stop 2022-02-02T20:46:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 msgr2=0x7f71c8105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 rx=0x7f71bc00c530 tx=0x7f71bc007e10).stop 2022-02-02T20:46:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 shutdown_connections 2022-02-02T20:46:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b0064dd0 0x7f71b0067290 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c80f55c0 0x7f71c8105ec0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 --2- 172.21.15.96:0/2639982571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c80f6860 0x7f71c81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:46:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 >> 172.21.15.96:0/2639982571 conn(0x7f71c80f0d40 msgr2=0x7f71c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 shutdown_connections 2022-02-02T20:46:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.403+0000 7f71cd98c700 1 -- 172.21.15.96:0/2639982571 wait complete. 2022-02-02T20:46:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.500+0000 7fe7ac08f700 1 -- 172.21.15.96:0/287927886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 msgr2=0x7fe7a40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.500+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/287927886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a40f6b00 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 rx=0x7fe7a0004660 tx=0x7fe7a0009b30).stop 2022-02-02T20:46:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.500+0000 7fe7ac08f700 1 -- 172.21.15.96:0/287927886 shutdown_connections 2022-02-02T20:46:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.500+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/287927886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 0x7fe7a40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/287927886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a40f6b00 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- 172.21.15.96:0/287927886 >> 172.21.15.96:0/287927886 conn(0x7fe7a40f1e40 msgr2=0x7fe7a40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- 172.21.15.96:0/287927886 shutdown_connections 2022-02-02T20:46:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- 172.21.15.96:0/287927886 wait complete. 2022-02-02T20:46:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 Processor -- start 2022-02-02T20:46:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- start start 2022-02-02T20:46:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 0x7fe7a41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4107a50 con 0x7fe7a40f66e0 2022-02-02T20:46:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.501+0000 7fe7ac08f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4107b90 con 0x7fe7a40f7980 2022-02-02T20:46:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39052/0 (socket says 172.21.15.96:39052) 2022-02-02T20:46:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 -- 172.21.15.96:0/2678117439 learned_addr learned my addr 172.21.15.96:0/2678117439 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:46:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a962a700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 0x7fe7a41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 -- 172.21.15.96:0/2678117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 msgr2=0x7fe7a41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 0x7fe7a41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 -- 172.21.15.96:0/2678117439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0005040 con 0x7fe7a40f66e0 2022-02-02T20:46:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7a9e2b700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7fe7a0004f60 tx=0x7fe7a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a0018070 con 0x7fe7a40f66e0 2022-02-02T20:46:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a41084d0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7a0007ba0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a001c620 con 0x7fe7a40f66e0 2022-02-02T20:46:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.502+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4108a30 con 0x7fe7a40f66e0 2022-02-02T20:46:58.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.503+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4045ad0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.504+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7a001c8e0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.504+0000 7fe79a7fc700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 0x7fe790067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:46:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.504+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe7a0083a10 con 0x7fe7a40f66e0 2022-02-02T20:46:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.504+0000 7fe7a962a700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 0x7fe790067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:46:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.505+0000 7fe7a962a700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 0x7fe790067290 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fe7940041d0 tx=0x7fe794009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:46:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.508+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7a0055600 con 0x7fe7a40f66e0 2022-02-02T20:46:58.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.708+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7a40fefb0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.709+0000 7fe79a7fc700 1 -- 172.21.15.96:0/2678117439 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe7a00551f0 con 0x7fe7a40f66e0 2022-02-02T20:46:58.712 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:46:58.712 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:46:58.712 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:46:58.712 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:46:58.713 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:46:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:46:58.713 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:46:58.714 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:46:58.714 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:46:58.714 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:46:58.714 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:46:58.714 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:46:58.715 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:46:58.715 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:46:58.715 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:46:58.715 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:46:58.716 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:46:58.716 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:46:58.716 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:46:58.716 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:46:58.717 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:46:58.717 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:46:58.717 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:46:58.717 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:46:58.718 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:46:58.718 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:46:58.718 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:46:58.718 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:46:58.719 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:46:58.719 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:46:58.719 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:46:58.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:58.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:58.720 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:46:58.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:46:58.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:58.720 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:58.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:46:58.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 msgr2=0x7fe790067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 0x7fe790067290 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fe7940041d0 tx=0x7fe794009040).stop 2022-02-02T20:46:58.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 msgr2=0x7fe7a4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:46:58.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7fe7a0004f60 tx=0x7fe7a0009b30).stop 2022-02-02T20:46:58.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 shutdown_connections 2022-02-02T20:46:58.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe790064dd0 0x7fe790067290 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7a40f66e0 0x7fe7a4106fb0 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 --2- 172.21.15.96:0/2678117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7a40f7980 0x7fe7a41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:46:58.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 >> 172.21.15.96:0/2678117439 conn(0x7fe7a40f1e40 msgr2=0x7fe7a40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:46:58.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.710+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 shutdown_connections 2022-02-02T20:46:58.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:46:58.711+0000 7fe7ac08f700 1 -- 172.21.15.96:0/2678117439 wait complete. 2022-02-02T20:46:58.724 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:46:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:58 smithi159 ceph-mon[69013]: from='client.38568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2639982571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:46:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2678117439' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:46:59.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:58 smithi096 ceph-mon[101353]: from='client.38568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:46:59.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2639982571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:46:59.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2678117439' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:47:00.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:46:59 smithi159 ceph-mon[69013]: pgmap v4347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:46:59 smithi096 ceph-mon[101353]: pgmap v4347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:02.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:02 smithi159 ceph-mon[69013]: pgmap v4348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:02.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:02 smithi096 ceph-mon[101353]: pgmap v4348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:04 smithi159 ceph-mon[69013]: pgmap v4349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:04 smithi096 ceph-mon[101353]: pgmap v4349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:06.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:06 smithi159 ceph-mon[69013]: pgmap v4350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:06.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:06 smithi096 ceph-mon[101353]: pgmap v4350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:07 smithi159 ceph-mon[69013]: pgmap v4351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:07 smithi096 ceph-mon[101353]: pgmap v4351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:10 smithi159 ceph-mon[69013]: pgmap v4352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:10 smithi096 ceph-mon[101353]: pgmap v4352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:12.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:12 smithi159 ceph-mon[69013]: pgmap v4353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:12 smithi096 ceph-mon[101353]: pgmap v4353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:14 smithi159 ceph-mon[69013]: pgmap v4354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:14 smithi096 ceph-mon[101353]: pgmap v4354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:16.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:16 smithi159 ceph-mon[69013]: pgmap v4355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:16.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:16 smithi096 ceph-mon[101353]: pgmap v4355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:17 smithi159 ceph-mon[69013]: pgmap v4356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:18.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:17 smithi096 ceph-mon[101353]: pgmap v4356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:20 smithi159 ceph-mon[69013]: pgmap v4357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:20 smithi096 ceph-mon[101353]: pgmap v4357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:22 smithi159 ceph-mon[69013]: pgmap v4358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:22 smithi096 ceph-mon[101353]: pgmap v4358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:24 smithi159 ceph-mon[69013]: pgmap v4359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:24 smithi096 ceph-mon[101353]: pgmap v4359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:26 smithi159 ceph-mon[69013]: pgmap v4360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:26 smithi096 ceph-mon[101353]: pgmap v4360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:27 smithi159 ceph-mon[69013]: pgmap v4361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:47:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:47:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:27 smithi096 ceph-mon[101353]: pgmap v4361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:47:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:47:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 -- 172.21.15.96:0/228315109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 msgr2=0x7f15780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 --2- 172.21.15.96:0/228315109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f6cc0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 rx=0x7f1574004660 tx=0x7f1574009b30).stop 2022-02-02T20:47:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 -- 172.21.15.96:0/228315109 shutdown_connections 2022-02-02T20:47:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 --2- 172.21.15.96:0/228315109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f6cc0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 --2- 172.21.15.96:0/228315109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 -- 172.21.15.96:0/228315109 >> 172.21.15.96:0/228315109 conn(0x7f15780f0d40 msgr2=0x7f15780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.822+0000 7f1580683700 1 -- 172.21.15.96:0/228315109 shutdown_connections 2022-02-02T20:47:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 -- 172.21.15.96:0/228315109 wait complete. 2022-02-02T20:47:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 Processor -- start 2022-02-02T20:47:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 -- start start 2022-02-02T20:47:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780f8100 con 0x7f15780f6860 2022-02-02T20:47:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f1580683700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780f8240 con 0x7f15780f55c0 2022-02-02T20:47:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.823+0000 7f157dc1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39074/0 (socket says 172.21.15.96:39074) 2022-02-02T20:47:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 -- 172.21.15.96:0/3597185312 learned_addr learned my addr 172.21.15.96:0/3597185312 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:47:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157e41f700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 -- 172.21.15.96:0/3597185312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 msgr2=0x7f15780f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 -- 172.21.15.96:0/3597185312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1574005040 con 0x7f15780f6860 2022-02-02T20:47:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157e41f700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:47:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f157dc1e700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 rx=0x7f1574009da0 tx=0x7f1574009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1574018070 con 0x7f15780f6860 2022-02-02T20:47:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1574007d70 con 0x7f15780f6860 2022-02-02T20:47:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780f84c0 con 0x7f15780f6860 2022-02-02T20:47:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157401dea0 con 0x7f15780f6860 2022-02-02T20:47:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.824+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15780f8a20 con 0x7f15780f6860 2022-02-02T20:47:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.825+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1578045ad0 con 0x7f15780f6860 2022-02-02T20:47:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.826+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f157401d420 con 0x7f15780f6860 2022-02-02T20:47:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.826+0000 7f156effd700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 0x7f1564067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.826+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1574083930 con 0x7f15780f6860 2022-02-02T20:47:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.826+0000 7f157e41f700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 0x7f1564067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.827+0000 7f157e41f700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 0x7f1564067270 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f1568007fd0 tx=0x7f1568009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:28.830+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1574051a30 con 0x7f15780f6860 2022-02-02T20:47:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.009+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15780faca0 con 0x7f1564064db0 2022-02-02T20:47:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.010+0000 7f156effd700 1 -- 172.21.15.96:0/3597185312 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f15780faca0 con 0x7f1564064db0 2022-02-02T20:47:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 msgr2=0x7f1564067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 0x7f1564067270 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f1568007fd0 tx=0x7f1568009040).stop 2022-02-02T20:47:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 msgr2=0x7f15780f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 rx=0x7f1574009da0 tx=0x7f1574009b30).stop 2022-02-02T20:47:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 shutdown_connections 2022-02-02T20:47:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1564064db0 0x7f1564067270 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15780f55c0 0x7f15780f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 --2- 172.21.15.96:0/3597185312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15780f6860 0x7f15780f7ba0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 >> 172.21.15.96:0/3597185312 conn(0x7f15780f0d40 msgr2=0x7f157805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 shutdown_connections 2022-02-02T20:47:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.012+0000 7f1580683700 1 -- 172.21.15.96:0/3597185312 wait complete. 2022-02-02T20:47:29.023 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:47:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 -- 172.21.15.96:0/3470934027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 msgr2=0x7f04700f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 --2- 172.21.15.96:0/3470934027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f04700f6b00 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 rx=0x7f0460004660 tx=0x7f0460009b30).stop 2022-02-02T20:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 -- 172.21.15.96:0/3470934027 shutdown_connections 2022-02-02T20:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 --2- 172.21.15.96:0/3470934027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 0x7f04700f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 --2- 172.21.15.96:0/3470934027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f04700f6b00 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 -- 172.21.15.96:0/3470934027 >> 172.21.15.96:0/3470934027 conn(0x7f04700f1e40 msgr2=0x7f04700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 -- 172.21.15.96:0/3470934027 shutdown_connections 2022-02-02T20:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.109+0000 7f04774ea700 1 -- 172.21.15.96:0/3470934027 wait complete. 2022-02-02T20:47:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 Processor -- start 2022-02-02T20:47:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 -- start start 2022-02-02T20:47:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 0x7f0470107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470107a00 con 0x7f04700f66e0 2022-02-02T20:47:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f04774ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470107b40 con 0x7f04700f7980 2022-02-02T20:47:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39082/0 (socket says 172.21.15.96:39082) 2022-02-02T20:47:29.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 -- 172.21.15.96:0/1598150003 learned_addr learned my addr 172.21.15.96:0/1598150003 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:47:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0474a85700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 0x7f0470107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 -- 172.21.15.96:0/1598150003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 msgr2=0x7f0470107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 0x7f0470107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.110+0000 7f0475286700 1 -- 172.21.15.96:0/1598150003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460005040 con 0x7f04700f66e0 2022-02-02T20:47:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f0475286700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 rx=0x7f0460014040 tx=0x7f046000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0460019070 con 0x7f04700f66e0 2022-02-02T20:47:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470108480 con 0x7f04700f66e0 2022-02-02T20:47:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04701089e0 con 0x7f04700f66e0 2022-02-02T20:47:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0460007e70 con 0x7f04700f66e0 2022-02-02T20:47:29.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.111+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0460014c00 con 0x7f04700f66e0 2022-02-02T20:47:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.112+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0450004fa0 con 0x7f04700f66e0 2022-02-02T20:47:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.113+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0460025070 con 0x7f04700f66e0 2022-02-02T20:47:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.113+0000 7f0465ffb700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 0x7f045c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.113+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f04600829c0 con 0x7f04700f66e0 2022-02-02T20:47:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.113+0000 7f0474a85700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 0x7f045c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.113+0000 7f0474a85700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 0x7f045c067290 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f046c007f80 tx=0x7f046c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.117+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f04600545b0 con 0x7f04700f66e0 2022-02-02T20:47:29.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.289+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0450000bc0 con 0x7f045c064dd0 2022-02-02T20:47:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.299+0000 7f0465ffb700 1 -- 172.21.15.96:0/1598150003 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0450000bc0 con 0x7f045c064dd0 2022-02-02T20:47:29.300 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:47:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:47:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:47:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 119m ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:47:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:47:29.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:47:29.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:47:29.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 119m ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:47:29.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 119m ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:47:29.303 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:47:29.303 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 119m ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:47:29.303 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:47:29.303 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 119m ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:47:29.303 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:47:29.304 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 119m ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:47:29.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:47:29.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:47:29.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:47:29.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 119m ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:47:29.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 119m ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:47:29.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 119m ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:47:29.305 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:47:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 msgr2=0x7f045c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 0x7f045c067290 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f046c007f80 tx=0x7f046c00b040).stop 2022-02-02T20:47:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 msgr2=0x7f0470106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 rx=0x7f0460014040 tx=0x7f046000b040).stop 2022-02-02T20:47:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 shutdown_connections 2022-02-02T20:47:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f045c064dd0 0x7f045c067290 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04700f66e0 0x7f0470106f60 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 --2- 172.21.15.96:0/1598150003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04700f7980 0x7f0470107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 >> 172.21.15.96:0/1598150003 conn(0x7f04700f1e40 msgr2=0x7f04700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 shutdown_connections 2022-02-02T20:47:29.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.301+0000 7f04774ea700 1 -- 172.21.15.96:0/1598150003 wait complete. 2022-02-02T20:47:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 -- 172.21.15.96:0/3614447900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f6bb0 msgr2=0x7f106c0f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 --2- 172.21.15.96:0/3614447900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f6bb0 0x7f106c0f6fd0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 rx=0x7f105c004660 tx=0x7f105c009b30).stop 2022-02-02T20:47:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 -- 172.21.15.96:0/3614447900 shutdown_connections 2022-02-02T20:47:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 --2- 172.21.15.96:0/3614447900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f58b0 0x7f106c0f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 --2- 172.21.15.96:0/3614447900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f6bb0 0x7f106c0f6fd0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 -- 172.21.15.96:0/3614447900 >> 172.21.15.96:0/3614447900 conn(0x7f106c0f04c0 msgr2=0x7f106c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 -- 172.21.15.96:0/3614447900 shutdown_connections 2022-02-02T20:47:29.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.398+0000 7f107407d700 1 -- 172.21.15.96:0/3614447900 wait complete. 2022-02-02T20:47:29.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 Processor -- start 2022-02-02T20:47:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 -- start start 2022-02-02T20:47:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f6bb0 0x7f106c10e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0f5430 con 0x7f106c0f58b0 2022-02-02T20:47:29.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f107407d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0f5570 con 0x7f106c0f6bb0 2022-02-02T20:47:29.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39090/0 (socket says 172.21.15.96:39090) 2022-02-02T20:47:29.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071618700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f6bb0 0x7f106c10e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 -- 172.21.15.96:0/3704415089 learned_addr learned my addr 172.21.15.96:0/3704415089 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:47:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 -- 172.21.15.96:0/3704415089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f6bb0 msgr2=0x7f106c10e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f6bb0 0x7f106c10e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.399+0000 7f1071e19700 1 -- 172.21.15.96:0/3704415089 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c005040 con 0x7f106c0f58b0 2022-02-02T20:47:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f1071e19700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 rx=0x7f105c0043a0 tx=0x7f105c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c018070 con 0x7f106c0f58b0 2022-02-02T20:47:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f105c007ba0 con 0x7f106c0f58b0 2022-02-02T20:47:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c10eb20 con 0x7f106c0f58b0 2022-02-02T20:47:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c10eef0 con 0x7f106c0f58b0 2022-02-02T20:47:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.400+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c01de30 con 0x7f106c0f58b0 2022-02-02T20:47:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.401+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1054004fa0 con 0x7f106c0f58b0 2022-02-02T20:47:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.401+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f105c01c4c0 con 0x7f106c0f58b0 2022-02-02T20:47:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.402+0000 7f10627fc700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 0x7f1058067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.402+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f105c083610 con 0x7f106c0f58b0 2022-02-02T20:47:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.402+0000 7f1071618700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 0x7f1058067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.402+0000 7f1071618700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 0x7f1058067290 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f106c0f6980 tx=0x7f106800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.406+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f105c0517f0 con 0x7f106c0f58b0 2022-02-02T20:47:29.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.636+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1054005e80 con 0x7f106c0f58b0 2022-02-02T20:47:29.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.636+0000 7f10627fc700 1 -- 172.21.15.96:0/3704415089 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f105c054e10 con 0x7f106c0f58b0 2022-02-02T20:47:29.638 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:47:29.639 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:47:29.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:47:29.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:47:29.640 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:47:29.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:47:29.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:47:29.640 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:47:29.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:47:29.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:47:29.641 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:47:29.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:47:29.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:47:29.642 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:47:29.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:47:29.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:47:29.642 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:47:29.643 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:47:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 msgr2=0x7f1058067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 0x7f1058067290 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f106c0f6980 tx=0x7f106800b040).stop 2022-02-02T20:47:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 msgr2=0x7f106c10c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 rx=0x7f105c0043a0 tx=0x7f105c009b30).stop 2022-02-02T20:47:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 shutdown_connections 2022-02-02T20:47:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1058064dd0 0x7f1058067290 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f106c0f58b0 0x7f106c10c130 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 --2- 172.21.15.96:0/3704415089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f106c0f6bb0 0x7f106c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 >> 172.21.15.96:0/3704415089 conn(0x7f106c0f04c0 msgr2=0x7f106c0fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 shutdown_connections 2022-02-02T20:47:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.638+0000 7f107407d700 1 -- 172.21.15.96:0/3704415089 wait complete. 2022-02-02T20:47:29.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 -- 172.21.15.96:0/1283576799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f6860 msgr2=0x7f48640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 --2- 172.21.15.96:0/1283576799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f6860 0x7f48640f6cc0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 rx=0x7f4854004660 tx=0x7f4854009b30).stop 2022-02-02T20:47:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 -- 172.21.15.96:0/1283576799 shutdown_connections 2022-02-02T20:47:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 --2- 172.21.15.96:0/1283576799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f6860 0x7f48640f6cc0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 --2- 172.21.15.96:0/1283576799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f55c0 0x7f48640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 -- 172.21.15.96:0/1283576799 >> 172.21.15.96:0/1283576799 conn(0x7f48640f0d40 msgr2=0x7f48640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 -- 172.21.15.96:0/1283576799 shutdown_connections 2022-02-02T20:47:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.736+0000 7f486c57c700 1 -- 172.21.15.96:0/1283576799 wait complete. 2022-02-02T20:47:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 Processor -- start 2022-02-02T20:47:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 -- start start 2022-02-02T20:47:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f6860 0x7f4864106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864106920 con 0x7f48640f55c0 2022-02-02T20:47:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486c57c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864107130 con 0x7f48640f6860 2022-02-02T20:47:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486a318700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486a318700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39100/0 (socket says 172.21.15.96:39100) 2022-02-02T20:47:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f486a318700 1 -- 172.21.15.96:0/3132761730 learned_addr learned my addr 172.21.15.96:0/3132761730 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:47:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.737+0000 7f4869b17700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f6860 0x7f4864106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486a318700 1 -- 172.21.15.96:0/3132761730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f6860 msgr2=0x7f4864106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486a318700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f6860 0x7f4864106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486a318700 1 -- 172.21.15.96:0/3132761730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854005040 con 0x7f48640f55c0 2022-02-02T20:47:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486a318700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 rx=0x7f486000e7c0 tx=0x7f486000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48600092e0 con 0x7f48640f55c0 2022-02-02T20:47:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f486000f040 con 0x7f48640f55c0 2022-02-02T20:47:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48641073b0 con 0x7f48640f55c0 2022-02-02T20:47:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48600147e0 con 0x7f48640f55c0 2022-02-02T20:47:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.738+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864107970 con 0x7f48640f55c0 2022-02-02T20:47:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.739+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48640f49b0 con 0x7f48640f55c0 2022-02-02T20:47:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.741+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f486001b030 con 0x7f48640f55c0 2022-02-02T20:47:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.741+0000 7f485affd700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 0x7f4850067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:47:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.741+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4860081de0 con 0x7f48640f55c0 2022-02-02T20:47:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.741+0000 7f4869b17700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 0x7f4850067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:47:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.741+0000 7f4869b17700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 0x7f4850067290 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f4854005010 tx=0x7f4854016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:47:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.745+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f486004fee0 con 0x7f48640f55c0 2022-02-02T20:47:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.945+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48640fddb0 con 0x7f48640f55c0 2022-02-02T20:47:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.946+0000 7f485affd700 1 -- 172.21.15.96:0/3132761730 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4860053500 con 0x7f48640f55c0 2022-02-02T20:47:29.952 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:47:29.953 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:47:29.953 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:47:29.953 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:47:29.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:47:29.954 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:47:29.954 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:47:29.954 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:47:29.954 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:47:29.954 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:47:29.955 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:47:29.955 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:47:29.955 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:47:29.955 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:47:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:47:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:47:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:47:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:47:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:47:29.957 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:47:29.957 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:47:29.957 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:47:29.957 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:47:29.958 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:47:29.958 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:47:29.958 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:47:29.958 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:47:29.961 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:47:29.962 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:47:29.962 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:47:29.962 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:47:29.964 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:47:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:47:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:47:29.964 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:47:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:47:29.965 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:47:29.965 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:47:29.966 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:47:29.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.947+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 msgr2=0x7f4850067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.947+0000 7f486c57c700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 0x7f4850067290 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f4854005010 tx=0x7f4854016040).stop 2022-02-02T20:47:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 msgr2=0x7f4864105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:47:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 rx=0x7f486000e7c0 tx=0x7f486000b040).stop 2022-02-02T20:47:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 shutdown_connections 2022-02-02T20:47:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4850064dd0 0x7f4850067290 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48640f55c0 0x7f4864105e30 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 --2- 172.21.15.96:0/3132761730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48640f6860 0x7f4864106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:47:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 >> 172.21.15.96:0/3132761730 conn(0x7f48640f0d40 msgr2=0x7f48640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:47:29.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 shutdown_connections 2022-02-02T20:47:29.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:47:29.948+0000 7f486c57c700 1 -- 172.21.15.96:0/3132761730 wait complete. 2022-02-02T20:47:29.970 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:47:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:30 smithi159 ceph-mon[69013]: from='client.38580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:47:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:30 smithi159 ceph-mon[69013]: from='client.38584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:47:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:30 smithi159 ceph-mon[69013]: pgmap v4362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:30.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3704415089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:47:30.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3132761730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:47:30.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:30 smithi096 ceph-mon[101353]: from='client.38580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:47:30.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:30 smithi096 ceph-mon[101353]: from='client.38584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:47:30.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:30 smithi096 ceph-mon[101353]: pgmap v4362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:30.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3704415089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:47:30.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3132761730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:47:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:32 smithi159 ceph-mon[69013]: pgmap v4363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:32 smithi096 ceph-mon[101353]: pgmap v4363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:34 smithi159 ceph-mon[69013]: pgmap v4364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:34.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:34 smithi096 ceph-mon[101353]: pgmap v4364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:36 smithi159 ceph-mon[69013]: pgmap v4365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:36 smithi096 ceph-mon[101353]: pgmap v4365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:37 smithi159 ceph-mon[69013]: pgmap v4366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:38.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:37 smithi096 ceph-mon[101353]: pgmap v4366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:40 smithi159 ceph-mon[69013]: pgmap v4367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:40 smithi096 ceph-mon[101353]: pgmap v4367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:42.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:42 smithi159 ceph-mon[69013]: pgmap v4368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:42 smithi096 ceph-mon[101353]: pgmap v4368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:44.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:44 smithi159 ceph-mon[69013]: pgmap v4369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:44.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:44 smithi096 ceph-mon[101353]: pgmap v4369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:46 smithi096 ceph-mon[101353]: pgmap v4370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:46 smithi159 ceph-mon[69013]: pgmap v4370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:47 smithi159 ceph-mon[69013]: pgmap v4371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:47 smithi096 ceph-mon[101353]: pgmap v4371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:50.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:50 smithi159 ceph-mon[69013]: pgmap v4372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:50 smithi096 ceph-mon[101353]: pgmap v4372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:52 smithi159 ceph-mon[69013]: pgmap v4373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:52 smithi096 ceph-mon[101353]: pgmap v4373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:54 smithi096 ceph-mon[101353]: pgmap v4374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:54 smithi159 ceph-mon[69013]: pgmap v4374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:56.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:56 smithi096 ceph-mon[101353]: pgmap v4375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:56 smithi159 ceph-mon[69013]: pgmap v4375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:47:57 smithi159 ceph-mon[69013]: pgmap v4376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:47:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:47:57 smithi096 ceph-mon[101353]: pgmap v4376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 -- 172.21.15.96:0/863610964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f7980 msgr2=0x7f800c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 --2- 172.21.15.96:0/863610964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f7980 0x7f800c0f7de0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 rx=0x7f7ff8004660 tx=0x7f7ff8009b30).stop 2022-02-02T20:48:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 -- 172.21.15.96:0/863610964 shutdown_connections 2022-02-02T20:48:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 --2- 172.21.15.96:0/863610964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f7980 0x7f800c0f7de0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 --2- 172.21.15.96:0/863610964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f66e0 0x7f800c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 -- 172.21.15.96:0/863610964 >> 172.21.15.96:0/863610964 conn(0x7f800c0f1e40 msgr2=0x7f800c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 -- 172.21.15.96:0/863610964 shutdown_connections 2022-02-02T20:48:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.058+0000 7f8012f65700 1 -- 172.21.15.96:0/863610964 wait complete. 2022-02-02T20:48:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 Processor -- start 2022-02-02T20:48:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 -- start start 2022-02-02T20:48:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f7980 0x7f800c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c107a00 con 0x7f800c0f66e0 2022-02-02T20:48:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8012f65700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c107b40 con 0x7f800c0f7980 2022-02-02T20:48:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8010d01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8010d01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39118/0 (socket says 172.21.15.96:39118) 2022-02-02T20:48:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f8010d01700 1 -- 172.21.15.96:0/891519218 learned_addr learned my addr 172.21.15.96:0/891519218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.059+0000 7f800bfff700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f7980 0x7f800c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8010d01700 1 -- 172.21.15.96:0/891519218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f7980 msgr2=0x7f800c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8010d01700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f7980 0x7f800c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8010d01700 1 -- 172.21.15.96:0/891519218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8005040 con 0x7f800c0f66e0 2022-02-02T20:48:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8010d01700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 rx=0x7f8000002700 tx=0x7f8000009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80000079c0 con 0x7f800c0f66e0 2022-02-02T20:48:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f800000f040 con 0x7f800c0f66e0 2022-02-02T20:48:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c1084e0 con 0x7f800c0f66e0 2022-02-02T20:48:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8000014860 con 0x7f800c0f66e0 2022-02-02T20:48:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.060+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c108aa0 con 0x7f800c0f66e0 2022-02-02T20:48:00.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.061+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c045ad0 con 0x7f800c0f66e0 2022-02-02T20:48:00.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.062+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f800001b060 con 0x7f800c0f66e0 2022-02-02T20:48:00.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.062+0000 7f80097fa700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 0x7f7ffc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.062+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80000818e0 con 0x7f800c0f66e0 2022-02-02T20:48:00.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.062+0000 7f800bfff700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 0x7f7ffc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.063+0000 7f800bfff700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 0x7f7ffc067290 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f7ff8004630 tx=0x7f7ff8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.066+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8000053410 con 0x7f800c0f66e0 2022-02-02T20:48:00.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.245+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f800c108d20 con 0x7f7ffc064dd0 2022-02-02T20:48:00.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.246+0000 7f80097fa700 1 -- 172.21.15.96:0/891519218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f800c108d20 con 0x7f7ffc064dd0 2022-02-02T20:48:00.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 msgr2=0x7f7ffc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 0x7f7ffc067290 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f7ff8004630 tx=0x7f7ff8009b30).stop 2022-02-02T20:48:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 msgr2=0x7f800c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 rx=0x7f8000002700 tx=0x7f8000009d80).stop 2022-02-02T20:48:00.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 shutdown_connections 2022-02-02T20:48:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ffc064dd0 0x7f7ffc067290 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f800c0f66e0 0x7f800c106f60 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 --2- 172.21.15.96:0/891519218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f800c0f7980 0x7f800c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 >> 172.21.15.96:0/891519218 conn(0x7f800c0f1e40 msgr2=0x7f800c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 shutdown_connections 2022-02-02T20:48:00.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.248+0000 7f8012f65700 1 -- 172.21.15.96:0/891519218 wait complete. 2022-02-02T20:48:00.259 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:48:00.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 -- 172.21.15.96:0/2088156288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 msgr2=0x7f10200f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 --2- 172.21.15.96:0/2088156288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f10200f7de0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 rx=0x7f1008004660 tx=0x7f1008009b30).stop 2022-02-02T20:48:00.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 -- 172.21.15.96:0/2088156288 shutdown_connections 2022-02-02T20:48:00.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 --2- 172.21.15.96:0/2088156288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f10200f7de0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 --2- 172.21.15.96:0/2088156288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f10200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:48:00.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 -- 172.21.15.96:0/2088156288 >> 172.21.15.96:0/2088156288 conn(0x7f10200f1e40 msgr2=0x7f10200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.345+0000 7f1024a8e700 1 -- 172.21.15.96:0/2088156288 shutdown_connections 2022-02-02T20:48:00.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 -- 172.21.15.96:0/2088156288 wait complete. 2022-02-02T20:48:00.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 Processor -- start 2022-02-02T20:48:00.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 -- start start 2022-02-02T20:48:00.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f102006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102006a410 con 0x7f10200f7980 2022-02-02T20:48:00.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f1024a8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102006a550 con 0x7f10200f66e0 2022-02-02T20:48:00.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f101dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f101dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39130/0 (socket says 172.21.15.96:39130) 2022-02-02T20:48:00.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.346+0000 7f101dd9b700 1 -- 172.21.15.96:0/3218191823 learned_addr learned my addr 172.21.15.96:0/3218191823 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:00.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101e59c700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f102006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101dd9b700 1 -- 172.21.15.96:0/3218191823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 msgr2=0x7f102006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101dd9b700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f102006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101dd9b700 1 -- 172.21.15.96:0/3218191823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008005040 con 0x7f10200f7980 2022-02-02T20:48:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101e59c700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f102006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:48:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f101dd9b700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 rx=0x7f1008009990 tx=0x7f1008009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1008018070 con 0x7f10200f7980 2022-02-02T20:48:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102006a7d0 con 0x7f10200f7980 2022-02-02T20:48:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1008007ca0 con 0x7f10200f7980 2022-02-02T20:48:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100801c620 con 0x7f10200f7980 2022-02-02T20:48:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.347+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102010efe0 con 0x7f10200f7980 2022-02-02T20:48:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.348+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020045ad0 con 0x7f10200f7980 2022-02-02T20:48:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.348+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f100801d960 con 0x7f10200f7980 2022-02-02T20:48:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.349+0000 7f1016ffd700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 0x7f100c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.349+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10080837e0 con 0x7f10200f7980 2022-02-02T20:48:00.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.349+0000 7f101e59c700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 0x7f100c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.349+0000 7f101e59c700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 0x7f100c067290 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f102006b730 tx=0x7f1010008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.353+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10080519a0 con 0x7f10200f7980 2022-02-02T20:48:00.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.527+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10200ff050 con 0x7f100c064dd0 2022-02-02T20:48:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.537+0000 7f1016ffd700 1 -- 172.21.15.96:0/3218191823 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f10200ff050 con 0x7f100c064dd0 2022-02-02T20:48:00.538 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:48:00.538 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:48:00.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:48:00.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:48:00.539 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:48:00.539 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:48:00.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:48:00.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:48:00.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:48:00.540 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:48:00.540 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:48:00.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:48:00.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:48:00.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:48:00.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:48:00.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:48:00.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:48:00.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:48:00.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:48:00.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:48:00.545 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:48:00.545 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:48:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 msgr2=0x7f100c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 0x7f100c067290 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f102006b730 tx=0x7f1010008040).stop 2022-02-02T20:48:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 msgr2=0x7f1020069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 rx=0x7f1008009990 tx=0x7f1008009b30).stop 2022-02-02T20:48:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 shutdown_connections 2022-02-02T20:48:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f100c064dd0 0x7f100c067290 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10200f66e0 0x7f102006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 --2- 172.21.15.96:0/3218191823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10200f7980 0x7f1020069e20 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 >> 172.21.15.96:0/3218191823 conn(0x7f10200f1e40 msgr2=0x7f10200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 shutdown_connections 2022-02-02T20:48:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.539+0000 7f1024a8e700 1 -- 172.21.15.96:0/3218191823 wait complete. 2022-02-02T20:48:00.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 -- 172.21.15.96:0/590688531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f55c0 msgr2=0x7f09500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 --2- 172.21.15.96:0/590688531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f55c0 0x7f09500f59e0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 rx=0x7f0940004660 tx=0x7f0940009b30).stop 2022-02-02T20:48:00.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 -- 172.21.15.96:0/590688531 shutdown_connections 2022-02-02T20:48:00.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 --2- 172.21.15.96:0/590688531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f6860 0x7f09500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 --2- 172.21.15.96:0/590688531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f55c0 0x7f09500f59e0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 -- 172.21.15.96:0/590688531 >> 172.21.15.96:0/590688531 conn(0x7f09500f0d40 msgr2=0x7f09500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 -- 172.21.15.96:0/590688531 shutdown_connections 2022-02-02T20:48:00.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:00 smithi096 ceph-mon[101353]: pgmap v4377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.635+0000 7f0958744700 1 -- 172.21.15.96:0/590688531 wait complete. 2022-02-02T20:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 Processor -- start 2022-02-02T20:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 -- start start 2022-02-02T20:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f55c0 0x7f095010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500602b0 con 0x7f09500f6860 2022-02-02T20:48:00.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0958744700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500603f0 con 0x7f09500f55c0 2022-02-02T20:48:00.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0955cdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0955cdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39140/0 (socket says 172.21.15.96:39140) 2022-02-02T20:48:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.636+0000 7f0955cdf700 1 -- 172.21.15.96:0/439571365 learned_addr learned my addr 172.21.15.96:0/439571365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f09564e0700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f55c0 0x7f095010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0955cdf700 1 -- 172.21.15.96:0/439571365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f55c0 msgr2=0x7f095010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0955cdf700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f55c0 0x7f095010c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0955cdf700 1 -- 172.21.15.96:0/439571365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940005040 con 0x7f09500f6860 2022-02-02T20:48:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0955cdf700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7f094c00c530 tx=0x7f094c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094c00f650 con 0x7f09500f6860 2022-02-02T20:48:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f094c00fc60 con 0x7f09500f6860 2022-02-02T20:48:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094c012cd0 con 0x7f09500f6860 2022-02-02T20:48:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095010ea80 con 0x7f09500f6860 2022-02-02T20:48:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.637+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095010ef00 con 0x7f09500f6860 2022-02-02T20:48:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.638+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09500f49b0 con 0x7f09500f6860 2022-02-02T20:48:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.639+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f094c010070 con 0x7f09500f6860 2022-02-02T20:48:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.639+0000 7f0946ffd700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 0x7f093c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.639+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f094c081f00 con 0x7f09500f6860 2022-02-02T20:48:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.639+0000 7f09564e0700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 0x7f093c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.640+0000 7f09564e0700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 0x7f093c067290 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f0940004e30 tx=0x7f0940009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.643+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f094c050140 con 0x7f09500f6860 2022-02-02T20:48:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:00 smithi159 ceph-mon[69013]: pgmap v4377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:00.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.872+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0950045ad0 con 0x7f09500f6860 2022-02-02T20:48:00.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.873+0000 7f0946ffd700 1 -- 172.21.15.96:0/439571365 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f094c020070 con 0x7f09500f6860 2022-02-02T20:48:00.875 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:48:00.875 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:48:00.875 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:48:00.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:00.876 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:48:00.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:48:00.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:00.877 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:48:00.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:48:00.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:00.878 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:48:00.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:48:00.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:00.878 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:48:00.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:48:00.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:48:00.879 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:48:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:48:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 msgr2=0x7f093c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 0x7f093c067290 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f0940004e30 tx=0x7f0940009b30).stop 2022-02-02T20:48:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 msgr2=0x7f095010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7f094c00c530 tx=0x7f094c007e20).stop 2022-02-02T20:48:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 shutdown_connections 2022-02-02T20:48:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f093c064dd0 0x7f093c067290 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09500f55c0 0x7f095010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 --2- 172.21.15.96:0/439571365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09500f6860 0x7f095010e590 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 >> 172.21.15.96:0/439571365 conn(0x7f09500f0d40 msgr2=0x7f09500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 shutdown_connections 2022-02-02T20:48:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.875+0000 7f0958744700 1 -- 172.21.15.96:0/439571365 wait complete. 2022-02-02T20:48:00.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- 172.21.15.96:0/1126507910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 msgr2=0x7f49800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 --2- 172.21.15.96:0/1126507910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49800f6b30 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 rx=0x7f4970004660 tx=0x7f4970009b30).stop 2022-02-02T20:48:00.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- 172.21.15.96:0/1126507910 shutdown_connections 2022-02-02T20:48:00.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 --2- 172.21.15.96:0/1126507910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49800f6b30 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 --2- 172.21.15.96:0/1126507910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 0x7f49800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:48:00.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- 172.21.15.96:0/1126507910 >> 172.21.15.96:0/1126507910 conn(0x7f49800f0b90 msgr2=0x7f49800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- 172.21.15.96:0/1126507910 shutdown_connections 2022-02-02T20:48:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- 172.21.15.96:0/1126507910 wait complete. 2022-02-02T20:48:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 Processor -- start 2022-02-02T20:48:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.972+0000 7f497f59e700 1 -- start start 2022-02-02T20:48:00.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 0x7f4980106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980107980 con 0x7f49800f66d0 2022-02-02T20:48:00.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980108100 con 0x7f49800f5430 2022-02-02T20:48:00.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39150/0 (socket says 172.21.15.96:39150) 2022-02-02T20:48:00.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 -- 172.21.15.96:0/3156415212 learned_addr learned my addr 172.21.15.96:0/3156415212 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:00.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497e59c700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 0x7f4980106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 -- 172.21.15.96:0/3156415212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 msgr2=0x7f4980106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 0x7f4980106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 -- 172.21.15.96:0/3156415212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970005040 con 0x7f49800f66d0 2022-02-02T20:48:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f497dd9b700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 rx=0x7f4970009990 tx=0x7f4970009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4970018070 con 0x7f49800f66d0 2022-02-02T20:48:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.973+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4970007ba0 con 0x7f49800f66d0 2022-02-02T20:48:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.974+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4980108320 con 0x7f49800f66d0 2022-02-02T20:48:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.974+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497001c620 con 0x7f49800f66d0 2022-02-02T20:48:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.974+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4980108880 con 0x7f49800f66d0 2022-02-02T20:48:00.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.975+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4980045ad0 con 0x7f49800f66d0 2022-02-02T20:48:00.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.975+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f497001c8e0 con 0x7f49800f66d0 2022-02-02T20:48:00.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.975+0000 7f496effd700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 0x7f49680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.975+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4970083850 con 0x7f49800f66d0 2022-02-02T20:48:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.975+0000 7f497e59c700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 0x7f49680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.976+0000 7f497e59c700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 0x7f49680672e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4980106b70 tx=0x7f4974008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:00.980+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4970051950 con 0x7f49800f66d0 2022-02-02T20:48:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.180+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4980108f80 con 0x7f49800f66d0 2022-02-02T20:48:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.181+0000 7f496effd700 1 -- 172.21.15.96:0/3156415212 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4970054f70 con 0x7f49800f66d0 2022-02-02T20:48:01.183 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:48:01.183 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:48:01.183 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:48:01.183 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:48:01.184 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:01.184 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:48:01.184 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:48:01.184 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:48:01.185 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:48:01.185 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:48:01.185 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:48:01.185 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:48:01.186 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:48:01.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:48:01.186 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:48:01.186 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:48:01.186 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:48:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:48:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:48:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:48:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:48:01.188 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:48:01.188 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:48:01.188 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:48:01.188 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:48:01.188 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:48:01.189 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:48:01.189 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:48:01.189 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:48:01.189 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:48:01.189 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:48:01.190 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:48:01.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:01.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:01.190 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:48:01.191 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:01.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:01.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:01.191 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:01.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 msgr2=0x7f49680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:01.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 0x7f49680672e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4980106b70 tx=0x7f4974008040).stop 2022-02-02T20:48:01.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 msgr2=0x7f49801072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:01.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 rx=0x7f4970009990 tx=0x7f4970009b30).stop 2022-02-02T20:48:01.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 shutdown_connections 2022-02-02T20:48:01.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4968064e20 0x7f49680672e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:01.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49800f5430 0x7f4980106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:01.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 --2- 172.21.15.96:0/3156415212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49800f66d0 0x7f49801072f0 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:01.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 >> 172.21.15.96:0/3156415212 conn(0x7f49800f0b90 msgr2=0x7f498005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:01.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 shutdown_connections 2022-02-02T20:48:01.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:01.183+0000 7f497f59e700 1 -- 172.21.15.96:0/3156415212 wait complete. 2022-02-02T20:48:01.195 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:48:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:01 smithi096 ceph-mon[101353]: from='client.38596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:01 smithi096 ceph-mon[101353]: from='client.38600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/439571365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:48:01.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3156415212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:48:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:01 smithi159 ceph-mon[69013]: from='client.38596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:01 smithi159 ceph-mon[69013]: from='client.38600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/439571365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:48:02.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3156415212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:48:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:02 smithi096 ceph-mon[101353]: pgmap v4378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:02 smithi159 ceph-mon[69013]: pgmap v4378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:04 smithi096 ceph-mon[101353]: pgmap v4379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:04 smithi159 ceph-mon[69013]: pgmap v4379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:06 smithi096 ceph-mon[101353]: pgmap v4380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:06 smithi159 ceph-mon[69013]: pgmap v4380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:08 smithi159 ceph-mon[69013]: pgmap v4381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:08 smithi096 ceph-mon[101353]: pgmap v4381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:10 smithi096 ceph-mon[101353]: pgmap v4382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:10 smithi159 ceph-mon[69013]: pgmap v4382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:12 smithi096 ceph-mon[101353]: pgmap v4383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:12 smithi159 ceph-mon[69013]: pgmap v4383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:14.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:14 smithi096 ceph-mon[101353]: pgmap v4384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:14 smithi159 ceph-mon[69013]: pgmap v4384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:16 smithi096 ceph-mon[101353]: pgmap v4385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:16 smithi159 ceph-mon[69013]: pgmap v4385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:18 smithi159 ceph-mon[69013]: pgmap v4386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:18 smithi096 ceph-mon[101353]: pgmap v4386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:20 smithi096 ceph-mon[101353]: pgmap v4387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:20 smithi159 ceph-mon[69013]: pgmap v4387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:22 smithi096 ceph-mon[101353]: pgmap v4388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:22 smithi159 ceph-mon[69013]: pgmap v4388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:24 smithi096 ceph-mon[101353]: pgmap v4389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:24 smithi159 ceph-mon[69013]: pgmap v4389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:26.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:26 smithi096 ceph-mon[101353]: pgmap v4390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:26 smithi159 ceph-mon[69013]: pgmap v4390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:28 smithi159 ceph-mon[69013]: pgmap v4391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:48:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:48:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:28 smithi096 ceph-mon[101353]: pgmap v4391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:48:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:48:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:30 smithi096 ceph-mon[101353]: pgmap v4392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:30 smithi159 ceph-mon[69013]: pgmap v4392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 -- 172.21.15.96:0/1467104388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 msgr2=0x7f90500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 --2- 172.21.15.96:0/1467104388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90500f5850 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 rx=0x7f90480099e0 tx=0x7f9048004d10).stop 2022-02-02T20:48:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 -- 172.21.15.96:0/1467104388 shutdown_connections 2022-02-02T20:48:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 --2- 172.21.15.96:0/1467104388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 0x7f90500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 --2- 172.21.15.96:0/1467104388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90500f5850 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 -- 172.21.15.96:0/1467104388 >> 172.21.15.96:0/1467104388 conn(0x7f90500f0b90 msgr2=0x7f90500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 -- 172.21.15.96:0/1467104388 shutdown_connections 2022-02-02T20:48:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.292+0000 7f90574f7700 1 -- 172.21.15.96:0/1467104388 wait complete. 2022-02-02T20:48:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 Processor -- start 2022-02-02T20:48:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 -- start start 2022-02-02T20:48:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 0x7f90501095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050109b60 con 0x7f90500f5430 2022-02-02T20:48:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90574f7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050109ca0 con 0x7f90500f66d0 2022-02-02T20:48:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39166/0 (socket says 172.21.15.96:39166) 2022-02-02T20:48:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 -- 172.21.15.96:0/2137017022 learned_addr learned my addr 172.21.15.96:0/2137017022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f9055cf4700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 0x7f90501095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 -- 172.21.15.96:0/2137017022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 msgr2=0x7f90501095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 0x7f90501095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.293+0000 7f90564f5700 1 -- 172.21.15.96:0/2137017022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048009640 con 0x7f90500f5430 2022-02-02T20:48:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f90564f5700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 rx=0x7f904800c010 tx=0x7f9048004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f904800e070 con 0x7f90500f5430 2022-02-02T20:48:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9048007d10 con 0x7f90500f5430 2022-02-02T20:48:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905010a5e0 con 0x7f90500f5430 2022-02-02T20:48:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9048018070 con 0x7f90500f5430 2022-02-02T20:48:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.294+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905010aac0 con 0x7f90500f5430 2022-02-02T20:48:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.295+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9050045ad0 con 0x7f90500f5430 2022-02-02T20:48:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.295+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9048024060 con 0x7f90500f5430 2022-02-02T20:48:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.296+0000 7f904effd700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 0x7f90380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.296+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9048083420 con 0x7f90500f5430 2022-02-02T20:48:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.296+0000 7f9055cf4700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 0x7f90380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.296+0000 7f9055cf4700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 0x7f90380672e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f90440041d0 tx=0x7f9044009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.300+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9048055010 con 0x7f90500f5430 2022-02-02T20:48:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.480+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f905010b2f0 con 0x7f9038064e20 2022-02-02T20:48:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.481+0000 7f904effd700 1 -- 172.21.15.96:0/2137017022 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f905010b2f0 con 0x7f9038064e20 2022-02-02T20:48:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 msgr2=0x7f90380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 0x7f90380672e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f90440041d0 tx=0x7f9044009040).stop 2022-02-02T20:48:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 msgr2=0x7f90501090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 rx=0x7f904800c010 tx=0x7f9048004d10).stop 2022-02-02T20:48:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 shutdown_connections 2022-02-02T20:48:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9038064e20 0x7f90380672e0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90500f5430 0x7f90501090c0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 --2- 172.21.15.96:0/2137017022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90500f66d0 0x7f90501095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 >> 172.21.15.96:0/2137017022 conn(0x7f90500f0b90 msgr2=0x7f905005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 shutdown_connections 2022-02-02T20:48:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.483+0000 7f90574f7700 1 -- 172.21.15.96:0/2137017022 wait complete. 2022-02-02T20:48:31.495 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:48:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 -- 172.21.15.96:0/1754954168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f7d40 msgr2=0x7f8c200f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 --2- 172.21.15.96:0/1754954168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f7d40 0x7f8c200f8160 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 rx=0x7f8c14004660 tx=0x7f8c14009b30).stop 2022-02-02T20:48:31.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 -- 172.21.15.96:0/1754954168 shutdown_connections 2022-02-02T20:48:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 --2- 172.21.15.96:0/1754954168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f86e0 0x7f8c200f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 --2- 172.21.15.96:0/1754954168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f7d40 0x7f8c200f8160 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 -- 172.21.15.96:0/1754954168 >> 172.21.15.96:0/1754954168 conn(0x7f8c200f04c0 msgr2=0x7f8c200f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 -- 172.21.15.96:0/1754954168 shutdown_connections 2022-02-02T20:48:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.583+0000 7f8c26da6700 1 -- 172.21.15.96:0/1754954168 wait complete. 2022-02-02T20:48:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 Processor -- start 2022-02-02T20:48:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 -- start start 2022-02-02T20:48:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f7d40 0x7f8c20106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20107a30 con 0x7f8c200f86e0 2022-02-02T20:48:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c26da6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20107b70 con 0x7f8c200f7d40 2022-02-02T20:48:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39184/0 (socket says 172.21.15.96:39184) 2022-02-02T20:48:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c1ffff700 1 -- 172.21.15.96:0/2705655915 learned_addr learned my addr 172.21.15.96:0/2705655915 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:31.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.584+0000 7f8c24b42700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f7d40 0x7f8c20106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1ffff700 1 -- 172.21.15.96:0/2705655915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f7d40 msgr2=0x7f8c20106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1ffff700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f7d40 0x7f8c20106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1ffff700 1 -- 172.21.15.96:0/2705655915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14005040 con 0x7f8c200f86e0 2022-02-02T20:48:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1ffff700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7f8c0c0026d0 tx=0x7f8c0c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0c0079c0 con 0x7f8c200f86e0 2022-02-02T20:48:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20108510 con 0x7f8c200f86e0 2022-02-02T20:48:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c0c00f040 con 0x7f8c200f86e0 2022-02-02T20:48:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0c0148b0 con 0x7f8c200f86e0 2022-02-02T20:48:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.585+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20108ad0 con 0x7f8c200f86e0 2022-02-02T20:48:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.586+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c20045ad0 con 0x7f8c200f86e0 2022-02-02T20:48:31.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.586+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c0c007b20 con 0x7f8c200f86e0 2022-02-02T20:48:31.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.587+0000 7f8c1d7fa700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.587+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c0c0819e0 con 0x7f8c200f86e0 2022-02-02T20:48:31.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.587+0000 7f8c24b42700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.587+0000 7f8c24b42700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 0x7f8c10067290 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f8c14004630 tx=0x7f8c14009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.591+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c0c053510 con 0x7f8c200f86e0 2022-02-02T20:48:31.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.764+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c20108d50 con 0x7f8c10064dd0 2022-02-02T20:48:31.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.774+0000 7f8c1d7fa700 1 -- 172.21.15.96:0/2705655915 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8c20108d50 con 0x7f8c10064dd0 2022-02-02T20:48:31.776 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:48:31.776 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:48:31.777 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:48:31.777 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:48:31.777 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:48:31.777 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:48:31.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:48:31.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:48:31.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:48:31.778 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:48:31.779 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:48:31.779 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:48:31.779 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:48:31.779 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:48:31.780 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:48:31.780 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:48:31.780 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:48:31.780 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:48:31.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:48:31.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:48:31.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:48:31.781 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:48:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 msgr2=0x7f8c10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 0x7f8c10067290 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f8c14004630 tx=0x7f8c14009b30).stop 2022-02-02T20:48:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 msgr2=0x7f8c20107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7f8c0c0026d0 tx=0x7f8c0c009de0).stop 2022-02-02T20:48:31.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 shutdown_connections 2022-02-02T20:48:31.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f7d40 0x7f8c20106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 --2- 172.21.15.96:0/2705655915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f86e0 0x7f8c20107480 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 >> 172.21.15.96:0/2705655915 conn(0x7f8c200f04c0 msgr2=0x7f8c200fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 shutdown_connections 2022-02-02T20:48:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.776+0000 7f8c26da6700 1 -- 172.21.15.96:0/2705655915 wait complete. 2022-02-02T20:48:31.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 -- 172.21.15.96:0/1751926241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 msgr2=0x7f0ddc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 --2- 172.21.15.96:0/1751926241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc0f59e0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 rx=0x7f0dcc004660 tx=0x7f0dcc009b30).stop 2022-02-02T20:48:31.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 -- 172.21.15.96:0/1751926241 shutdown_connections 2022-02-02T20:48:31.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 --2- 172.21.15.96:0/1751926241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 --2- 172.21.15.96:0/1751926241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc0f59e0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 -- 172.21.15.96:0/1751926241 >> 172.21.15.96:0/1751926241 conn(0x7f0ddc0f0d40 msgr2=0x7f0ddc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 -- 172.21.15.96:0/1751926241 shutdown_connections 2022-02-02T20:48:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.872+0000 7f0de348c700 1 -- 172.21.15.96:0/1751926241 wait complete. 2022-02-02T20:48:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 Processor -- start 2022-02-02T20:48:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 -- start start 2022-02-02T20:48:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0603e0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de348c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc060520 con 0x7f0ddc0f6860 2022-02-02T20:48:31.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39192/0 (socket says 172.21.15.96:39192) 2022-02-02T20:48:31.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 -- 172.21.15.96:0/556426977 learned_addr learned my addr 172.21.15.96:0/556426977 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:31.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de0a27700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 -- 172.21.15.96:0/556426977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 msgr2=0x7f0ddc10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 -- 172.21.15.96:0/556426977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc005040 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de0a27700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:48:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.873+0000 7f0de1228700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7f0dcc013a70 tx=0x7f0dcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.874+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dcc018070 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.874+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0dcc0097d0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.874+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dcc01c3c0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.874+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc10c6c0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.874+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc10cbd0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.875+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc045ad0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.875+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0dcc007ba0 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.876+0000 7f0dd1ffb700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 0x7f0dc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:31.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.876+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0dcc083730 con 0x7f0ddc0f55c0 2022-02-02T20:48:31.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.876+0000 7f0de0a27700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 0x7f0dc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:31.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.876+0000 7f0de0a27700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 0x7f0dc8067290 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f0dd8009740 tx=0x7f0dd8009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:31.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:31.880+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0dcc0518f0 con 0x7f0ddc0f55c0 2022-02-02T20:48:32.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.109+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ddc0fdec0 con 0x7f0ddc0f55c0 2022-02-02T20:48:32.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.110+0000 7f0dd1ffb700 1 -- 172.21.15.96:0/556426977 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0dcc054f10 con 0x7f0ddc0f55c0 2022-02-02T20:48:32.112 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:48:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:48:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:48:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:48:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:48:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:48:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:48:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:48:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:48:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:48:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:48:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:48:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:48:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:48:32.116 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:48:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 msgr2=0x7f0dc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 0x7f0dc8067290 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f0dd8009740 tx=0x7f0dd8009be0).stop 2022-02-02T20:48:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 msgr2=0x7f0ddc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7f0dcc013a70 tx=0x7f0dcc009b30).stop 2022-02-02T20:48:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 shutdown_connections 2022-02-02T20:48:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0dc8064dd0 0x7f0dc8067290 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc0f55c0 0x7f0ddc109c70 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 --2- 172.21.15.96:0/556426977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ddc0f6860 0x7f0ddc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 >> 172.21.15.96:0/556426977 conn(0x7f0ddc0f0d40 msgr2=0x7f0ddc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 shutdown_connections 2022-02-02T20:48:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.111+0000 7f0de348c700 1 -- 172.21.15.96:0/556426977 wait complete. 2022-02-02T20:48:32.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 -- 172.21.15.96:0/4257381251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 msgr2=0x7f68840f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 --2- 172.21.15.96:0/4257381251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f68840f6cc0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 rx=0x7f6878004660 tx=0x7f6878009b30).stop 2022-02-02T20:48:32.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 -- 172.21.15.96:0/4257381251 shutdown_connections 2022-02-02T20:48:32.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 --2- 172.21.15.96:0/4257381251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f68840f6cc0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 --2- 172.21.15.96:0/4257381251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 0x7f68840f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.208+0000 7f6888a08700 1 -- 172.21.15.96:0/4257381251 >> 172.21.15.96:0/4257381251 conn(0x7f68840f0d40 msgr2=0x7f68840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:32.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.209+0000 7f6888a08700 1 -- 172.21.15.96:0/4257381251 shutdown_connections 2022-02-02T20:48:32.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.209+0000 7f6888a08700 1 -- 172.21.15.96:0/4257381251 wait complete. 2022-02-02T20:48:32.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.209+0000 7f6888a08700 1 Processor -- start 2022-02-02T20:48:32.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.209+0000 7f6888a08700 1 -- start start 2022-02-02T20:48:32.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6888a08700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 0x7f6884109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:32.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6888a08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:32.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6888a08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840603e0 con 0x7f68840f6860 2022-02-02T20:48:32.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6888a08700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884060520 con 0x7f68840f55c0 2022-02-02T20:48:32.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:32.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39204/0 (socket says 172.21.15.96:39204) 2022-02-02T20:48:32.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 -- 172.21.15.96:0/3099886427 learned_addr learned my addr 172.21.15.96:0/3099886427 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:48:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f688259c700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 0x7f6884109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 -- 172.21.15.96:0/3099886427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 msgr2=0x7f6884109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 0x7f6884109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 -- 172.21.15.96:0/3099886427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878005040 con 0x7f68840f6860 2022-02-02T20:48:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6881d9b700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 rx=0x7f6878009830 tx=0x7f6878009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.210+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6878018070 con 0x7f68840f6860 2022-02-02T20:48:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.211+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688410c6a0 con 0x7f68840f6860 2022-02-02T20:48:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.211+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6878007ba0 con 0x7f68840f6860 2022-02-02T20:48:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.211+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687801c3c0 con 0x7f68840f6860 2022-02-02T20:48:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.211+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688410cc00 con 0x7f68840f6860 2022-02-02T20:48:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.211+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6884045ad0 con 0x7f68840f6860 2022-02-02T20:48:32.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.213+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6878007d10 con 0x7f68840f6860 2022-02-02T20:48:32.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.213+0000 7f6872ffd700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 0x7f686c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:48:32.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.214+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68780839f0 con 0x7f68840f6860 2022-02-02T20:48:32.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.214+0000 7f688259c700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 0x7f686c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:48:32.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.214+0000 7f688259c700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 0x7f686c067270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f6884060060 tx=0x7f687400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:48:32.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.217+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6878051af0 con 0x7f68840f6860 2022-02-02T20:48:32.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.418+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6884027a00 con 0x7f68840f6860 2022-02-02T20:48:32.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.418+0000 7f6872ffd700 1 -- 172.21.15.96:0/3099886427 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6878055110 con 0x7f68840f6860 2022-02-02T20:48:32.421 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:48:32.421 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:48:32.421 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:48:32.422 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:48:32.422 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:32.422 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:48:32.422 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:48:32.423 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:48:32.423 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:48:32.423 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:48:32.423 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:48:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:48:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:48:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:48:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:48:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:48:32.425 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:48:32.425 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:48:32.425 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:48:32.425 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:48:32.425 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:48:32.426 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:48:32.426 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:48:32.426 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:48:32.426 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:48:32.427 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:48:32.427 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:48:32.427 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:48:32.427 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:48:32.428 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:48:32.428 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:48:32.428 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:48:32.428 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:32.429 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:32.430 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:48:32.430 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:48:32.430 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:32.430 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:32.431 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:48:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 msgr2=0x7f686c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 0x7f686c067270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f6884060060 tx=0x7f687400b040).stop 2022-02-02T20:48:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 msgr2=0x7f688410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:48:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 rx=0x7f6878009830 tx=0x7f6878009b30).stop 2022-02-02T20:48:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 shutdown_connections 2022-02-02T20:48:32.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f686c064db0 0x7f686c067270 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68840f55c0 0x7f6884109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 --2- 172.21.15.96:0/3099886427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68840f6860 0x7f688410c150 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:48:32.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 >> 172.21.15.96:0/3099886427 conn(0x7f68840f0d40 msgr2=0x7f68840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:48:32.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 shutdown_connections 2022-02-02T20:48:32.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:48:32.420+0000 7f6888a08700 1 -- 172.21.15.96:0/3099886427 wait complete. 2022-02-02T20:48:32.435 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:48:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:32 smithi096 ceph-mon[101353]: pgmap v4393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:32.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:32 smithi096 ceph-mon[101353]: from='client.38612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:32 smithi096 ceph-mon[101353]: from='client.38616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:32.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/556426977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:48:32.808 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3099886427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:48:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:32 smithi159 ceph-mon[69013]: pgmap v4393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:32 smithi159 ceph-mon[69013]: from='client.38612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:32 smithi159 ceph-mon[69013]: from='client.38616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:48:33.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/556426977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:48:33.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3099886427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:48:34.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:34 smithi096 ceph-mon[101353]: pgmap v4394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:34 smithi159 ceph-mon[69013]: pgmap v4394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:36 smithi096 ceph-mon[101353]: pgmap v4395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:36 smithi159 ceph-mon[69013]: pgmap v4395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:38 smithi159 ceph-mon[69013]: pgmap v4396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:38 smithi096 ceph-mon[101353]: pgmap v4396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:40 smithi096 ceph-mon[101353]: pgmap v4397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:40 smithi159 ceph-mon[69013]: pgmap v4397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:42.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:42 smithi096 ceph-mon[101353]: pgmap v4398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:42 smithi159 ceph-mon[69013]: pgmap v4398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:44 smithi096 ceph-mon[101353]: pgmap v4399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:44 smithi159 ceph-mon[69013]: pgmap v4399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:46 smithi096 ceph-mon[101353]: pgmap v4400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:46 smithi159 ceph-mon[69013]: pgmap v4400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:48 smithi159 ceph-mon[69013]: pgmap v4401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:48 smithi096 ceph-mon[101353]: pgmap v4401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:50 smithi096 ceph-mon[101353]: pgmap v4402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:50 smithi159 ceph-mon[69013]: pgmap v4402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:52 smithi096 ceph-mon[101353]: pgmap v4403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:52 smithi159 ceph-mon[69013]: pgmap v4403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:54 smithi096 ceph-mon[101353]: pgmap v4404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:54 smithi159 ceph-mon[69013]: pgmap v4404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:56 smithi096 ceph-mon[101353]: pgmap v4405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:56 smithi159 ceph-mon[69013]: pgmap v4405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:48:58 smithi159 ceph-mon[69013]: pgmap v4406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:48:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:48:58 smithi096 ceph-mon[101353]: pgmap v4406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:00.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:00 smithi096 ceph-mon[101353]: pgmap v4407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:00 smithi159 ceph-mon[69013]: pgmap v4407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 -- 172.21.15.96:0/1027970396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f6550 msgr2=0x7fd98c0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 --2- 172.21.15.96:0/1027970396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f6550 0x7fd98c0f69b0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 rx=0x7fd97c004660 tx=0x7fd97c009b30).stop 2022-02-02T20:49:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 -- 172.21.15.96:0/1027970396 shutdown_connections 2022-02-02T20:49:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 --2- 172.21.15.96:0/1027970396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f6550 0x7fd98c0f69b0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 --2- 172.21.15.96:0/1027970396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c0f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 -- 172.21.15.96:0/1027970396 >> 172.21.15.96:0/1027970396 conn(0x7fd98c0f04c0 msgr2=0x7fd98c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 -- 172.21.15.96:0/1027970396 shutdown_connections 2022-02-02T20:49:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.530+0000 7fd991569700 1 -- 172.21.15.96:0/1027970396 wait complete. 2022-02-02T20:49:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 Processor -- start 2022-02-02T20:49:02.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 -- start start 2022-02-02T20:49:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f6550 0x7fd98c10c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0f56a0 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd991569700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0f57e0 con 0x7fd98c0f6550 2022-02-02T20:49:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd98affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd98affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39220/0 (socket says 172.21.15.96:39220) 2022-02-02T20:49:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.531+0000 7fd98affd700 1 -- 172.21.15.96:0/4219541993 learned_addr learned my addr 172.21.15.96:0/4219541993 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:02.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd98a7fc700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f6550 0x7fd98c10c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd98affd700 1 -- 172.21.15.96:0/4219541993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f6550 msgr2=0x7fd98c10c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd98affd700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f6550 0x7fd98c10c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd98affd700 1 -- 172.21.15.96:0/4219541993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c005040 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd98affd700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7fd98000c790 tx=0x7fd980007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd98000e680 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c10c6f0 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd98000ec90 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd980012d00 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.532+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c10ccb0 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.533+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c045ad0 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.534+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd980010070 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.534+0000 7fd9737fe700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 0x7fd974067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.534+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd980081b30 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.534+0000 7fd98a7fc700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 0x7fd974067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.535+0000 7fd98a7fc700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 0x7fd974067290 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fd97c009da0 tx=0x7fd97c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:02.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.538+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd98004fc30 con 0x7fd98c0f5bb0 2022-02-02T20:49:02.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.721+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c0fdeb0 con 0x7fd974064dd0 2022-02-02T20:49:02.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.722+0000 7fd9737fe700 1 -- 172.21.15.96:0/4219541993 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd98c0fdeb0 con 0x7fd974064dd0 2022-02-02T20:49:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 msgr2=0x7fd974067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 0x7fd974067290 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fd97c009da0 tx=0x7fd97c009b30).stop 2022-02-02T20:49:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 msgr2=0x7fd98c109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7fd98000c790 tx=0x7fd980007d90).stop 2022-02-02T20:49:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 shutdown_connections 2022-02-02T20:49:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd974064dd0 0x7fd974067290 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd98c0f5bb0 0x7fd98c109c40 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 --2- 172.21.15.96:0/4219541993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd98c0f6550 0x7fd98c10c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 >> 172.21.15.96:0/4219541993 conn(0x7fd98c0f04c0 msgr2=0x7fd98c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 shutdown_connections 2022-02-02T20:49:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.724+0000 7fd991569700 1 -- 172.21.15.96:0/4219541993 wait complete. 2022-02-02T20:49:02.735 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:49:02.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:02 smithi096 ceph-mon[101353]: pgmap v4408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:02.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 -- 172.21.15.96:0/2501634905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f7980 msgr2=0x7f05280f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 --2- 172.21.15.96:0/2501634905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f7980 0x7f05280f7de0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 rx=0x7f051c004660 tx=0x7f051c009b30).stop 2022-02-02T20:49:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 -- 172.21.15.96:0/2501634905 shutdown_connections 2022-02-02T20:49:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 --2- 172.21.15.96:0/2501634905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f7980 0x7f05280f7de0 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 --2- 172.21.15.96:0/2501634905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f66e0 0x7f05280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 -- 172.21.15.96:0/2501634905 >> 172.21.15.96:0/2501634905 conn(0x7f05280f1e40 msgr2=0x7f05280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:02.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 -- 172.21.15.96:0/2501634905 shutdown_connections 2022-02-02T20:49:02.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 -- 172.21.15.96:0/2501634905 wait complete. 2022-02-02T20:49:02.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.822+0000 7f052d23e700 1 Processor -- start 2022-02-02T20:49:02.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 -- start start 2022-02-02T20:49:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 0x7f0528107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281079e0 con 0x7f05280f66e0 2022-02-02T20:49:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528107b20 con 0x7f05280f7980 2022-02-02T20:49:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39230/0 (socket says 172.21.15.96:39230) 2022-02-02T20:49:02.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 -- 172.21.15.96:0/3974590904 learned_addr learned my addr 172.21.15.96:0/3974590904 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052659c700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 0x7f0528107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 -- 172.21.15.96:0/3974590904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 msgr2=0x7f0528107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 0x7f0528107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:02.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 -- 172.21.15.96:0/3974590904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c005040 con 0x7f05280f66e0 2022-02-02T20:49:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052659c700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 0x7f0528107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:49:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f0526d9d700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 rx=0x7f0518002700 tx=0x7f0518009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518009320 con 0x7f05280f66e0 2022-02-02T20:49:02.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05281084c0 con 0x7f05280f66e0 2022-02-02T20:49:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f051800f040 con 0x7f05280f66e0 2022-02-02T20:49:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.823+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518014900 con 0x7f05280f66e0 2022-02-02T20:49:02.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.824+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0528108a80 con 0x7f05280f66e0 2022-02-02T20:49:02.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.825+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0528045ad0 con 0x7f05280f66e0 2022-02-02T20:49:02.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.826+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0518009480 con 0x7f05280f66e0 2022-02-02T20:49:02.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.826+0000 7f050f7fe700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 0x7f0510067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:02.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.826+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0518082180 con 0x7f05280f66e0 2022-02-02T20:49:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.826+0000 7f052659c700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 0x7f0510067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.826+0000 7f052659c700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 0x7f0510067290 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f051c004630 tx=0x7f051c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:02.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:02.829+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0518053e20 con 0x7f05280f66e0 2022-02-02T20:49:03.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.003+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0528108d60 con 0x7f0510064dd0 2022-02-02T20:49:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.012+0000 7f050f7fe700 1 -- 172.21.15.96:0/3974590904 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0528108d60 con 0x7f0510064dd0 2022-02-02T20:49:03.014 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:49:03.014 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:49:03.015 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:49:03.015 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:49:03.015 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:49:03.015 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:49:03.016 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:49:03.016 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:49:03.016 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:49:03.016 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:49:03.016 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:49:03.017 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:49:03.017 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:49:03.017 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:49:03.017 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:49:03.018 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:49:03.018 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:49:03.018 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:49:03.018 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:49:03.018 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:49:03.019 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:49:03.019 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:49:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.014+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 msgr2=0x7f0510067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.014+0000 7f052d23e700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 0x7f0510067290 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f051c004630 tx=0x7f051c009b30).stop 2022-02-02T20:49:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.014+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 msgr2=0x7f0528106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.014+0000 7f052d23e700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 rx=0x7f0518002700 tx=0x7f0518009d80).stop 2022-02-02T20:49:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 shutdown_connections 2022-02-02T20:49:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064dd0 0x7f0510067290 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f66e0 0x7f0528106f40 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 --2- 172.21.15.96:0/3974590904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280f7980 0x7f0528107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 >> 172.21.15.96:0/3974590904 conn(0x7f05280f1e40 msgr2=0x7f05280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 shutdown_connections 2022-02-02T20:49:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.015+0000 7f052d23e700 1 -- 172.21.15.96:0/3974590904 wait complete. 2022-02-02T20:49:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:02 smithi159 ceph-mon[69013]: pgmap v4408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 -- 172.21.15.96:0/2738347456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f5430 msgr2=0x7f20cc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 --2- 172.21.15.96:0/2738347456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f5430 0x7f20cc0f5850 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 rx=0x7f20c8004660 tx=0x7f20c8009b30).stop 2022-02-02T20:49:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 -- 172.21.15.96:0/2738347456 shutdown_connections 2022-02-02T20:49:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 --2- 172.21.15.96:0/2738347456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f66d0 0x7f20cc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 --2- 172.21.15.96:0/2738347456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f5430 0x7f20cc0f5850 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.111+0000 7f20d2856700 1 -- 172.21.15.96:0/2738347456 >> 172.21.15.96:0/2738347456 conn(0x7f20cc0f0b90 msgr2=0x7f20cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.112+0000 7f20d2856700 1 -- 172.21.15.96:0/2738347456 shutdown_connections 2022-02-02T20:49:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.112+0000 7f20d2856700 1 -- 172.21.15.96:0/2738347456 wait complete. 2022-02-02T20:49:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.112+0000 7f20d2856700 1 Processor -- start 2022-02-02T20:49:03.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.112+0000 7f20d2856700 1 -- start start 2022-02-02T20:49:03.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d2856700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f5430 0x7f20cc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d2856700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d2856700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1067d0 con 0x7f20cc0f66d0 2022-02-02T20:49:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d2856700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc106fd0 con 0x7f20cc0f5430 2022-02-02T20:49:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39242/0 (socket says 172.21.15.96:39242) 2022-02-02T20:49:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 -- 172.21.15.96:0/3234139601 learned_addr learned my addr 172.21.15.96:0/3234139601 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1854700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f5430 0x7f20cc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 -- 172.21.15.96:0/3234139601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f5430 msgr2=0x7f20cc105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f5430 0x7f20cc105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 -- 172.21.15.96:0/3234139601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8005040 con 0x7f20cc0f66d0 2022-02-02T20:49:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d1053700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f20bc00c530 tx=0x7f20bc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:03.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20bc00f650 con 0x7f20cc0f66d0 2022-02-02T20:49:03.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20bc00fc60 con 0x7f20cc0f66d0 2022-02-02T20:49:03.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.113+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc1072b0 con 0x7f20cc0f66d0 2022-02-02T20:49:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.114+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20bc012cd0 con 0x7f20cc0f66d0 2022-02-02T20:49:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.114+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc107870 con 0x7f20cc0f66d0 2022-02-02T20:49:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.114+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4004fa0 con 0x7f20cc0f66d0 2022-02-02T20:49:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.115+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f20bc010070 con 0x7f20cc0f66d0 2022-02-02T20:49:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.115+0000 7f20c27fc700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 0x7f20b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.115+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20bc081630 con 0x7f20cc0f66d0 2022-02-02T20:49:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.116+0000 7f20d1854700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 0x7f20b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.116+0000 7f20d1854700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 0x7f20b80672e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f20c8004e30 tx=0x7f20c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:03.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.120+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20bc0477d0 con 0x7f20cc0f66d0 2022-02-02T20:49:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.351+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20b4005e80 con 0x7f20cc0f66d0 2022-02-02T20:49:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.351+0000 7f20c27fc700 1 -- 172.21.15.96:0/3234139601 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f20bc053160 con 0x7f20cc0f66d0 2022-02-02T20:49:03.353 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:49:03.353 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:49:03.354 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:49:03.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:03.354 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:49:03.354 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:49:03.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:03.355 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:49:03.355 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:49:03.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:03.356 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:49:03.356 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:49:03.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:03.356 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:49:03.356 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:49:03.357 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:49:03.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:49:03.357 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:49:03.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 msgr2=0x7f20b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 0x7f20b80672e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f20c8004e30 tx=0x7f20c8009b30).stop 2022-02-02T20:49:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 msgr2=0x7f20cc106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f20bc00c530 tx=0x7f20bc007e20).stop 2022-02-02T20:49:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 shutdown_connections 2022-02-02T20:49:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20b8064e20 0x7f20b80672e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0f5430 0x7f20cc105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 --2- 172.21.15.96:0/3234139601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20cc0f66d0 0x7f20cc106220 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 >> 172.21.15.96:0/3234139601 conn(0x7f20cc0f0b90 msgr2=0x7f20cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 shutdown_connections 2022-02-02T20:49:03.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.353+0000 7f20d2856700 1 -- 172.21.15.96:0/3234139601 wait complete. 2022-02-02T20:49:03.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2651704625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 msgr2=0x7f8b0c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2651704625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c0f7de0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 rx=0x7f8afc004660 tx=0x7f8afc009b30).stop 2022-02-02T20:49:03.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2651704625 shutdown_connections 2022-02-02T20:49:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2651704625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c0f7de0 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2651704625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b0c0f66e0 0x7f8b0c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2651704625 >> 172.21.15.96:0/2651704625 conn(0x7f8b0c0f1e40 msgr2=0x7f8b0c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2651704625 shutdown_connections 2022-02-02T20:49:03.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2651704625 wait complete. 2022-02-02T20:49:03.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.450+0000 7f8b10fb2700 1 Processor -- start 2022-02-02T20:49:03.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b10fb2700 1 -- start start 2022-02-02T20:49:03.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b10fb2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b0c0f66e0 0x7f8b0c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b10fb2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b10fb2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c06a380 con 0x7f8b0c0f7980 2022-02-02T20:49:03.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b10fb2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c06a4c0 con 0x7f8b0c0f66e0 2022-02-02T20:49:03.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:03.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39252/0 (socket says 172.21.15.96:39252) 2022-02-02T20:49:03.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 -- 172.21.15.96:0/2063109566 learned_addr learned my addr 172.21.15.96:0/2063109566 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 -- 172.21.15.96:0/2063109566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b0c0f66e0 msgr2=0x7f8b0c06b9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T20:49:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b0c0f66e0 0x7f8b0c06b9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:49:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 -- 172.21.15.96:0/2063109566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc005040 con 0x7f8b0c0f7980 2022-02-02T20:49:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b09d9b700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f8afc009830 tx=0x7f8afc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.451+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8afc018070 con 0x7f8b0c0f7980 2022-02-02T20:49:03.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.452+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c06a740 con 0x7f8b0c0f7980 2022-02-02T20:49:03.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.452+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c06aca0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.452+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8afc007ba0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.452+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8afc01ddd0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.453+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af0004fa0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.453+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8afc01d420 con 0x7f8b0c0f7980 2022-02-02T20:49:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.453+0000 7f8b02ffd700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 0x7f8af8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.453+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8afc0834e0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.453+0000 7f8b0a59c700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 0x7f8af8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.454+0000 7f8b0a59c700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 0x7f8af8067270 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f8b0c06b730 tx=0x7f8af40099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.458+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8afc0515c0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.661+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8af0005e80 con 0x7f8b0c0f7980 2022-02-02T20:49:03.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.662+0000 7f8b02ffd700 1 -- 172.21.15.96:0/2063109566 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8afc054be0 con 0x7f8b0c0f7980 2022-02-02T20:49:03.663 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:49:03.664 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:49:03.664 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:49:03.664 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:49:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:03.665 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:49:03.665 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:49:03.665 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:49:03.665 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:49:03.666 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:49:03.666 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:49:03.666 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:49:03.666 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:49:03.667 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:49:03.667 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:49:03.667 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:49:03.667 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:49:03.668 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:49:03.668 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:49:03.668 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:49:03.668 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:49:03.668 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:49:03.669 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:49:03.669 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:49:03.669 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:49:03.669 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:49:03.669 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:49:03.670 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:49:03.670 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:49:03.670 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:49:03.670 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:49:03.671 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:49:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:03.671 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:49:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:03.672 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:03.672 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:03.672 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:03.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 msgr2=0x7f8af8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 0x7f8af8067270 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f8b0c06b730 tx=0x7f8af40099e0).stop 2022-02-02T20:49:03.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 msgr2=0x7f8b0c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:03.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f8afc009830 tx=0x7f8afc009b30).stop 2022-02-02T20:49:03.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 shutdown_connections 2022-02-02T20:49:03.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8af8064db0 0x7f8af8067270 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b0c0f66e0 0x7f8b0c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:49:03.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 --2- 172.21.15.96:0/2063109566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b0c0f7980 0x7f8b0c069e20 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:03.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.663+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 >> 172.21.15.96:0/2063109566 conn(0x7f8b0c0f1e40 msgr2=0x7f8b0c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:03.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.664+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 shutdown_connections 2022-02-02T20:49:03.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:03.664+0000 7f8b10fb2700 1 -- 172.21.15.96:0/2063109566 wait complete. 2022-02-02T20:49:03.676 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:49:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:03 smithi159 ceph-mon[69013]: from='client.38628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3234139601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:49:03.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:03 smithi096 ceph-mon[101353]: from='client.38628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:03.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3234139601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:49:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:04 smithi096 ceph-mon[101353]: from='client.38632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:04 smithi096 ceph-mon[101353]: pgmap v4409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2063109566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:49:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:04 smithi159 ceph-mon[69013]: from='client.38632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:04 smithi159 ceph-mon[69013]: pgmap v4409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2063109566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:49:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:06 smithi159 ceph-mon[69013]: pgmap v4410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:06 smithi096 ceph-mon[101353]: pgmap v4410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:08 smithi159 ceph-mon[69013]: pgmap v4411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:08 smithi096 ceph-mon[101353]: pgmap v4411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:10.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:10 smithi096 ceph-mon[101353]: pgmap v4412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:10 smithi159 ceph-mon[69013]: pgmap v4412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:12 smithi096 ceph-mon[101353]: pgmap v4413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:12 smithi159 ceph-mon[69013]: pgmap v4413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:14 smithi096 ceph-mon[101353]: pgmap v4414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:14 smithi159 ceph-mon[69013]: pgmap v4414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:16 smithi096 ceph-mon[101353]: pgmap v4415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:16 smithi159 ceph-mon[69013]: pgmap v4415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:18 smithi159 ceph-mon[69013]: pgmap v4416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:18 smithi096 ceph-mon[101353]: pgmap v4416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:20.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:20 smithi096 ceph-mon[101353]: pgmap v4417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:20 smithi159 ceph-mon[69013]: pgmap v4417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:22 smithi096 ceph-mon[101353]: pgmap v4418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:22 smithi159 ceph-mon[69013]: pgmap v4418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:24 smithi096 ceph-mon[101353]: pgmap v4419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:24 smithi159 ceph-mon[69013]: pgmap v4419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:26 smithi096 ceph-mon[101353]: pgmap v4420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:26 smithi159 ceph-mon[69013]: pgmap v4420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:28 smithi159 ceph-mon[69013]: pgmap v4421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:49:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:49:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:28 smithi096 ceph-mon[101353]: pgmap v4421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:49:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:49:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:30 smithi096 ceph-mon[101353]: pgmap v4422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:30 smithi159 ceph-mon[69013]: pgmap v4422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:32 smithi096 ceph-mon[101353]: pgmap v4423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:32 smithi159 ceph-mon[69013]: pgmap v4423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.773+0000 7f4f921da700 1 -- 172.21.15.96:0/1426462813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 msgr2=0x7f4f8c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.773+0000 7f4f921da700 1 --2- 172.21.15.96:0/1426462813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c0f7c30 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 rx=0x7f4f7c004660 tx=0x7f4f7c009b30).stop 2022-02-02T20:49:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 -- 172.21.15.96:0/1426462813 shutdown_connections 2022-02-02T20:49:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 --2- 172.21.15.96:0/1426462813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c0f7c30 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 --2- 172.21.15.96:0/1426462813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 -- 172.21.15.96:0/1426462813 >> 172.21.15.96:0/1426462813 conn(0x7f4f8c0f1c90 msgr2=0x7f4f8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 -- 172.21.15.96:0/1426462813 shutdown_connections 2022-02-02T20:49:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 -- 172.21.15.96:0/1426462813 wait complete. 2022-02-02T20:49:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 Processor -- start 2022-02-02T20:49:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.774+0000 7f4f921da700 1 -- start start 2022-02-02T20:49:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f921da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f921da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f921da700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1099d0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f921da700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c109b10 con 0x7f4f8c0f6530 2022-02-02T20:49:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39272/0 (socket says 172.21.15.96:39272) 2022-02-02T20:49:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 -- 172.21.15.96:0/2419915960 learned_addr learned my addr 172.21.15.96:0/2419915960 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f911d8700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 -- 172.21.15.96:0/2419915960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 msgr2=0x7f4f8c108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 -- 172.21.15.96:0/2419915960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c005040 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f911d8700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:49:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f909d7700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7f4f7c009990 tx=0x7f4f7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7c018070 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.775+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f7c007ca0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.776+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c10a450 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.776+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7c01c620 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.776+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c10a9b0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.777+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c045ad0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.777+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f7c01d960 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.778+0000 7f4f81ffb700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 0x7f4f780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:33.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.778+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4f7c0838a0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.778+0000 7f4f911d8700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 0x7f4f780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:33.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.778+0000 7f4f911d8700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 0x7f4f780672e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f4f8c0f7630 tx=0x7f4f88009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:33.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.782+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f7c0553d0 con 0x7f4f8c0f77d0 2022-02-02T20:49:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.962+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8c10abd0 con 0x7f4f78064e20 2022-02-02T20:49:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.963+0000 7f4f81ffb700 1 -- 172.21.15.96:0/2419915960 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4f8c10abd0 con 0x7f4f78064e20 2022-02-02T20:49:33.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 msgr2=0x7f4f780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:33.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 0x7f4f780672e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f4f8c0f7630 tx=0x7f4f88009040).stop 2022-02-02T20:49:33.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 msgr2=0x7f4f8c109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:33.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7f4f7c009990 tx=0x7f4f7c009b30).stop 2022-02-02T20:49:33.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 shutdown_connections 2022-02-02T20:49:33.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064e20 0x7f4f780672e0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f8c0f6530 0x7f4f8c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 --2- 172.21.15.96:0/2419915960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f8c0f77d0 0x7f4f8c109420 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 >> 172.21.15.96:0/2419915960 conn(0x7f4f8c0f1c90 msgr2=0x7f4f8c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 shutdown_connections 2022-02-02T20:49:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:33.965+0000 7f4f921da700 1 -- 172.21.15.96:0/2419915960 wait complete. 2022-02-02T20:49:33.975 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:49:34.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- 172.21.15.96:0/326055602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f6860 msgr2=0x7f14b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 --2- 172.21.15.96:0/326055602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f6860 0x7f14b80f6cc0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 rx=0x7f14b4004660 tx=0x7f14b4009b30).stop 2022-02-02T20:49:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- 172.21.15.96:0/326055602 shutdown_connections 2022-02-02T20:49:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 --2- 172.21.15.96:0/326055602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f6860 0x7f14b80f6cc0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 --2- 172.21.15.96:0/326055602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f55c0 0x7f14b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- 172.21.15.96:0/326055602 >> 172.21.15.96:0/326055602 conn(0x7f14b80f0d40 msgr2=0x7f14b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- 172.21.15.96:0/326055602 shutdown_connections 2022-02-02T20:49:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- 172.21.15.96:0/326055602 wait complete. 2022-02-02T20:49:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 Processor -- start 2022-02-02T20:49:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.063+0000 7f14c05c3700 1 -- start start 2022-02-02T20:49:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f6860 0x7f14b8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8107a20 con 0x7f14b80f55c0 2022-02-02T20:49:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8107b60 con 0x7f14b80f6860 2022-02-02T20:49:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39278/0 (socket says 172.21.15.96:39278) 2022-02-02T20:49:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 -- 172.21.15.96:0/815692317 learned_addr learned my addr 172.21.15.96:0/815692317 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14bdb5e700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f6860 0x7f14b8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 -- 172.21.15.96:0/815692317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f6860 msgr2=0x7f14b8107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f6860 0x7f14b8107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 -- 172.21.15.96:0/815692317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4005040 con 0x7f14b80f55c0 2022-02-02T20:49:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14be35f700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 rx=0x7f14a800c510 tx=0x7f14a8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a800f650 con 0x7f14b80f55c0 2022-02-02T20:49:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f14a800fc60 con 0x7f14b80f55c0 2022-02-02T20:49:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8108500 con 0x7f14b80f55c0 2022-02-02T20:49:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a8012cb0 con 0x7f14b80f55c0 2022-02-02T20:49:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.064+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8108ac0 con 0x7f14b80f55c0 2022-02-02T20:49:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.065+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b8045ad0 con 0x7f14b80f55c0 2022-02-02T20:49:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.066+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f14a8010070 con 0x7f14b80f55c0 2022-02-02T20:49:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.067+0000 7f14aeffd700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.067+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f14a8081950 con 0x7f14b80f55c0 2022-02-02T20:49:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.067+0000 7f14bdb5e700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.067+0000 7f14bdb5e700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 0x7f14a4067290 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f14b4009da0 tx=0x7f14b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.071+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f14a80534b0 con 0x7f14b80f55c0 2022-02-02T20:49:34.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.243+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b805fd30 con 0x7f14a4064dd0 2022-02-02T20:49:34.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.252+0000 7f14aeffd700 1 -- 172.21.15.96:0/815692317 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f14b805fd30 con 0x7f14a4064dd0 2022-02-02T20:49:34.254 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:49:34.254 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:49:34.255 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:49:34.255 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:49:34.255 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:49:34.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:49:34.256 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:49:34.256 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:49:34.256 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:49:34.256 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:49:34.256 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:49:34.257 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:49:34.257 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:49:34.257 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:49:34.257 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:49:34.257 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:49:34.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:49:34.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:49:34.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:49:34.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:49:34.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:49:34.259 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:49:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 msgr2=0x7f14a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 0x7f14a4067290 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f14b4009da0 tx=0x7f14b4009b30).stop 2022-02-02T20:49:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 msgr2=0x7f14b8106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 rx=0x7f14a800c510 tx=0x7f14a8007df0).stop 2022-02-02T20:49:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 shutdown_connections 2022-02-02T20:49:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b80f55c0 0x7f14b8106f80 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 --2- 172.21.15.96:0/815692317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14b80f6860 0x7f14b8107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 >> 172.21.15.96:0/815692317 conn(0x7f14b80f0d40 msgr2=0x7f14b805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 shutdown_connections 2022-02-02T20:49:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.255+0000 7f14c05c3700 1 -- 172.21.15.96:0/815692317 wait complete. 2022-02-02T20:49:34.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 -- 172.21.15.96:0/4221931373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 msgr2=0x7fc0200f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 --2- 172.21.15.96:0/4221931373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc0200f6b00 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 rx=0x7fc010004660 tx=0x7fc010009b30).stop 2022-02-02T20:49:34.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 -- 172.21.15.96:0/4221931373 shutdown_connections 2022-02-02T20:49:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 --2- 172.21.15.96:0/4221931373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 0x7fc0200f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 --2- 172.21.15.96:0/4221931373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc0200f6b00 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 -- 172.21.15.96:0/4221931373 >> 172.21.15.96:0/4221931373 conn(0x7fc0200f1e40 msgr2=0x7fc0200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 -- 172.21.15.96:0/4221931373 shutdown_connections 2022-02-02T20:49:34.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.352+0000 7fc025e1a700 1 -- 172.21.15.96:0/4221931373 wait complete. 2022-02-02T20:49:34.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 Processor -- start 2022-02-02T20:49:34.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 -- start start 2022-02-02T20:49:34.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 0x7fc020069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006a380 con 0x7fc0200f66e0 2022-02-02T20:49:34.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc025e1a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006a4c0 con 0x7fc0200f7980 2022-02-02T20:49:34.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39288/0 (socket says 172.21.15.96:39288) 2022-02-02T20:49:34.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 -- 172.21.15.96:0/2821192520 learned_addr learned my addr 172.21.15.96:0/2821192520 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:34.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01effd700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 0x7fc020069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 -- 172.21.15.96:0/2821192520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 msgr2=0x7fc020069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 0x7fc020069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 -- 172.21.15.96:0/2821192520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010005040 con 0x7fc0200f66e0 2022-02-02T20:49:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.353+0000 7fc01f7fe700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 rx=0x7fc010013a70 tx=0x7fc010009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.354+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc010018070 con 0x7fc0200f66e0 2022-02-02T20:49:34.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.354+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0100097d0 con 0x7fc0200f66e0 2022-02-02T20:49:34.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.354+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02006a740 con 0x7fc0200f66e0 2022-02-02T20:49:34.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.354+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02006aca0 con 0x7fc0200f66e0 2022-02-02T20:49:34.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.354+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01001c3c0 con 0x7fc0200f66e0 2022-02-02T20:49:34.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.355+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc004004fa0 con 0x7fc0200f66e0 2022-02-02T20:49:34.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.355+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc01001c680 con 0x7fc0200f66e0 2022-02-02T20:49:34.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.356+0000 7fc017fff700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 0x7fc00c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.356+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc010083700 con 0x7fc0200f66e0 2022-02-02T20:49:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.356+0000 7fc01effd700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 0x7fc00c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.356+0000 7fc01effd700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 0x7fc00c067290 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fc008009760 tx=0x7fc008009cc0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.360+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc010055230 con 0x7fc0200f66e0 2022-02-02T20:49:34.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.591+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc004005e80 con 0x7fc0200f66e0 2022-02-02T20:49:34.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.591+0000 7fc017fff700 1 -- 172.21.15.96:0/2821192520 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc010051030 con 0x7fc0200f66e0 2022-02-02T20:49:34.593 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:49:34.593 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:49:34.594 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:49:34.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:34.594 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:49:34.594 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:49:34.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:34.595 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:49:34.595 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:49:34.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:34.596 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:49:34.596 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:49:34.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:49:34.596 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:49:34.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:49:34.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:49:34.597 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:49:34.598 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:49:34.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.593+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 msgr2=0x7fc00c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.593+0000 7fc025e1a700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 0x7fc00c067290 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fc008009760 tx=0x7fc008009cc0).stop 2022-02-02T20:49:34.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.593+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 msgr2=0x7fc02006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.593+0000 7fc025e1a700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 rx=0x7fc010013a70 tx=0x7fc010009b30).stop 2022-02-02T20:49:34.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 shutdown_connections 2022-02-02T20:49:34.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc00c064dd0 0x7fc00c067290 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0200f66e0 0x7fc02006b9a0 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 --2- 172.21.15.96:0/2821192520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0200f7980 0x7fc020069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 >> 172.21.15.96:0/2821192520 conn(0x7fc0200f1e40 msgr2=0x7fc0200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 shutdown_connections 2022-02-02T20:49:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.594+0000 7fc025e1a700 1 -- 172.21.15.96:0/2821192520 wait complete. 2022-02-02T20:49:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 -- 172.21.15.96:0/3054401924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 msgr2=0x7ff4d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 --2- 172.21.15.96:0/3054401924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d80f6950 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 rx=0x7ff4d4004660 tx=0x7ff4d4009b30).stop 2022-02-02T20:49:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 -- 172.21.15.96:0/3054401924 shutdown_connections 2022-02-02T20:49:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 --2- 172.21.15.96:0/3054401924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 0x7ff4d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:49:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 --2- 172.21.15.96:0/3054401924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d80f6950 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 -- 172.21.15.96:0/3054401924 >> 172.21.15.96:0/3054401924 conn(0x7ff4d80f1cd0 msgr2=0x7ff4d80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.695 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:34 smithi096 ceph-mon[101353]: pgmap v4424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 -- 172.21.15.96:0/3054401924 shutdown_connections 2022-02-02T20:49:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.692+0000 7ff4de494700 1 -- 172.21.15.96:0/3054401924 wait complete. 2022-02-02T20:49:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 Processor -- start 2022-02-02T20:49:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 -- start start 2022-02-02T20:49:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 0x7ff4d8107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8107920 con 0x7ff4d80f6530 2022-02-02T20:49:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4de494700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81080d0 con 0x7ff4d80f77d0 2022-02-02T20:49:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4dd492700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4dd492700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39298/0 (socket says 172.21.15.96:39298) 2022-02-02T20:49:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.693+0000 7ff4dd492700 1 -- 172.21.15.96:0/2976280804 learned_addr learned my addr 172.21.15.96:0/2976280804 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:49:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4dd492700 1 -- 172.21.15.96:0/2976280804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 msgr2=0x7ff4d8107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4dcc91700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 0x7ff4d8107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4dd492700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 0x7ff4d8107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4dd492700 1 -- 172.21.15.96:0/2976280804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4005040 con 0x7ff4d80f6530 2022-02-02T20:49:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4dd492700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7ff4d4004f60 tx=0x7ff4d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d4018070 con 0x7ff4d80f6530 2022-02-02T20:49:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4d4007ba0 con 0x7ff4d80f6530 2022-02-02T20:49:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d8108350 con 0x7ff4d80f6530 2022-02-02T20:49:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d401c620 con 0x7ff4d80f6530 2022-02-02T20:49:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.694+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81088b0 con 0x7ff4d80f6530 2022-02-02T20:49:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.695+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8059100 con 0x7ff4d80f6530 2022-02-02T20:49:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.696+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4d401c8e0 con 0x7ff4d80f6530 2022-02-02T20:49:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.696+0000 7ff4cdffb700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 0x7ff4c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:49:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.696+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4d4083960 con 0x7ff4d80f6530 2022-02-02T20:49:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.696+0000 7ff4dcc91700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 0x7ff4c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:49:34.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.697+0000 7ff4dcc91700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 0x7ff4c40672e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7ff4d8106b30 tx=0x7ff4c8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:49:34.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.700+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4d4051a60 con 0x7ff4d80f6530 2022-02-02T20:49:34.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.900+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff4d80fed70 con 0x7ff4d80f6530 2022-02-02T20:49:34.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.900+0000 7ff4cdffb700 1 -- 172.21.15.96:0/2976280804 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff4d4055080 con 0x7ff4d80f6530 2022-02-02T20:49:34.902 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:49:34.903 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:49:34.903 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:49:34.903 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:49:34.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:34.904 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:49:34.904 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:49:34.904 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:49:34.904 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:49:34.905 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:49:34.905 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:49:34.905 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:49:34.905 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:49:34.906 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:49:34.906 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:49:34.906 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:49:34.906 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:49:34.906 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:49:34.907 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:49:34.907 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:49:34.907 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:49:34.907 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:49:34.908 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:49:34.908 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:49:34.908 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:49:34.908 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:49:34.908 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:49:34.909 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:49:34.909 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:49:34.909 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:49:34.909 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:49:34.910 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:49:34.910 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:34.910 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:34.910 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:49:34.911 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:49:34.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:34.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:34.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:49:34.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.903+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 msgr2=0x7ff4c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.903+0000 7ff4de494700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 0x7ff4c40672e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7ff4d8106b30 tx=0x7ff4c8008040).stop 2022-02-02T20:49:34.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.903+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 msgr2=0x7ff4d8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:49:34.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.903+0000 7ff4de494700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7ff4d4004f60 tx=0x7ff4d4009b30).stop 2022-02-02T20:49:34.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 shutdown_connections 2022-02-02T20:49:34.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4c4064e20 0x7ff4c40672e0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d80f6530 0x7ff4d8106da0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 --2- 172.21.15.96:0/2976280804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4d80f77d0 0x7ff4d8107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:49:34.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 >> 172.21.15.96:0/2976280804 conn(0x7ff4d80f1cd0 msgr2=0x7ff4d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:49:34.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 shutdown_connections 2022-02-02T20:49:34.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:49:34.904+0000 7ff4de494700 1 -- 172.21.15.96:0/2976280804 wait complete. 2022-02-02T20:49:34.915 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:49:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:34 smithi159 ceph-mon[69013]: pgmap v4424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:35 smithi159 ceph-mon[69013]: from='client.38644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:35 smithi159 ceph-mon[69013]: from='client.38648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2821192520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:49:36.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2976280804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:49:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:35 smithi096 ceph-mon[101353]: from='client.38644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:35 smithi096 ceph-mon[101353]: from='client.38648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:49:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2821192520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:49:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2976280804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:49:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:36 smithi159 ceph-mon[69013]: pgmap v4425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:36 smithi096 ceph-mon[101353]: pgmap v4425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:38.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:38 smithi096 ceph-mon[101353]: pgmap v4426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:38.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:38 smithi159 ceph-mon[69013]: pgmap v4426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:40.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:40 smithi096 ceph-mon[101353]: pgmap v4427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:40 smithi159 ceph-mon[69013]: pgmap v4427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:42.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:42 smithi096 ceph-mon[101353]: pgmap v4428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:42 smithi159 ceph-mon[69013]: pgmap v4428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:44 smithi159 ceph-mon[69013]: pgmap v4429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:44 smithi096 ceph-mon[101353]: pgmap v4429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:46 smithi159 ceph-mon[69013]: pgmap v4430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:46 smithi096 ceph-mon[101353]: pgmap v4430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:48 smithi096 ceph-mon[101353]: pgmap v4431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:48 smithi159 ceph-mon[69013]: pgmap v4431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:50.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:50 smithi096 ceph-mon[101353]: pgmap v4432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:50 smithi159 ceph-mon[69013]: pgmap v4432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:52 smithi159 ceph-mon[69013]: pgmap v4433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:52 smithi096 ceph-mon[101353]: pgmap v4433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:54 smithi159 ceph-mon[69013]: pgmap v4434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:54 smithi096 ceph-mon[101353]: pgmap v4434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:56 smithi159 ceph-mon[69013]: pgmap v4435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:57.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:56 smithi096 ceph-mon[101353]: pgmap v4435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:49:58 smithi096 ceph-mon[101353]: pgmap v4436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:49:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:49:58 smithi159 ceph-mon[69013]: pgmap v4436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:00 smithi159 ceph-mon[69013]: pgmap v4437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:50:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:00 smithi096 ceph-mon[101353]: pgmap v4437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T20:50:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:02 smithi159 ceph-mon[69013]: pgmap v4438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:02 smithi096 ceph-mon[101353]: pgmap v4438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:05.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 -- 172.21.15.96:0/4028068728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0602b0 msgr2=0x7f434c0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 --2- 172.21.15.96:0/4028068728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0602b0 0x7f434c0f9170 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 rx=0x7f4334004660 tx=0x7f4334009b30).stop 2022-02-02T20:50:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 -- 172.21.15.96:0/4028068728 shutdown_connections 2022-02-02T20:50:05.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 --2- 172.21.15.96:0/4028068728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0f96f0 0x7f434c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 --2- 172.21.15.96:0/4028068728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0602b0 0x7f434c0f9170 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 -- 172.21.15.96:0/4028068728 >> 172.21.15.96:0/4028068728 conn(0x7f434c0f0b90 msgr2=0x7f434c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 -- 172.21.15.96:0/4028068728 shutdown_connections 2022-02-02T20:50:05.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:04 smithi096 ceph-mon[101353]: pgmap v4439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.013+0000 7f434b59e700 1 -- 172.21.15.96:0/4028068728 wait complete. 2022-02-02T20:50:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 Processor -- start 2022-02-02T20:50:05.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 -- start start 2022-02-02T20:50:05.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0602b0 0x7f434c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c1078a0 con 0x7f434c0f96f0 2022-02-02T20:50:05.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f434b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c1080e0 con 0x7f434c0602b0 2022-02-02T20:50:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f4349d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f4349d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39320/0 (socket says 172.21.15.96:39320) 2022-02-02T20:50:05.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.014+0000 7f4349d9b700 1 -- 172.21.15.96:0/46721459 learned_addr learned my addr 172.21.15.96:0/46721459 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:05.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f434a59c700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0602b0 0x7f434c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4349d9b700 1 -- 172.21.15.96:0/46721459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0602b0 msgr2=0x7f434c106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4349d9b700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0602b0 0x7f434c106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4349d9b700 1 -- 172.21.15.96:0/46721459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334005040 con 0x7f434c0f96f0 2022-02-02T20:50:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4349d9b700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f433c002700 tx=0x7f433c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c0079c0 con 0x7f434c0f96f0 2022-02-02T20:50:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f433c00f040 con 0x7f434c0f96f0 2022-02-02T20:50:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c014740 con 0x7f434c0f96f0 2022-02-02T20:50:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c1083c0 con 0x7f434c0f96f0 2022-02-02T20:50:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.015+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c108900 con 0x7f434c0f96f0 2022-02-02T20:50:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.016+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c059100 con 0x7f434c0f96f0 2022-02-02T20:50:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.017+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f433c01b060 con 0x7f434c0f96f0 2022-02-02T20:50:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.017+0000 7f4342ffd700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 0x7f43380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.017+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f433c081920 con 0x7f434c0f96f0 2022-02-02T20:50:05.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.017+0000 7f434a59c700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 0x7f43380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.018+0000 7f434a59c700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 0x7f43380672e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f4334004630 tx=0x7f4334009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.021+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f433c04f9c0 con 0x7f434c0f96f0 2022-02-02T20:50:05.036 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:04 smithi159 ceph-mon[69013]: pgmap v4439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:05.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.199+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f434c0feea0 con 0x7f4338064e20 2022-02-02T20:50:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.200+0000 7f4342ffd700 1 -- 172.21.15.96:0/46721459 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f434c0feea0 con 0x7f4338064e20 2022-02-02T20:50:05.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 msgr2=0x7f43380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 0x7f43380672e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f4334004630 tx=0x7f4334009b30).stop 2022-02-02T20:50:05.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 msgr2=0x7f434c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f433c002700 tx=0x7f433c009d60).stop 2022-02-02T20:50:05.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 shutdown_connections 2022-02-02T20:50:05.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4338064e20 0x7f43380672e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f434c0602b0 0x7f434c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 --2- 172.21.15.96:0/46721459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f434c0f96f0 0x7f434c1072a0 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.202+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 >> 172.21.15.96:0/46721459 conn(0x7f434c0f0b90 msgr2=0x7f434c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.203+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 shutdown_connections 2022-02-02T20:50:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.203+0000 7f434b59e700 1 -- 172.21.15.96:0/46721459 wait complete. 2022-02-02T20:50:05.215 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:50:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 -- 172.21.15.96:0/3519966778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f55d0 msgr2=0x7f27780f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 --2- 172.21.15.96:0/3519966778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f55d0 0x7f27780f59f0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 rx=0x7f2768004660 tx=0x7f2768009b30).stop 2022-02-02T20:50:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 -- 172.21.15.96:0/3519966778 shutdown_connections 2022-02-02T20:50:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 --2- 172.21.15.96:0/3519966778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f6870 0x7f27780f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 --2- 172.21.15.96:0/3519966778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f55d0 0x7f27780f59f0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 -- 172.21.15.96:0/3519966778 >> 172.21.15.96:0/3519966778 conn(0x7f27780f0d70 msgr2=0x7f27780f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 -- 172.21.15.96:0/3519966778 shutdown_connections 2022-02-02T20:50:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.300+0000 7f277e0c8700 1 -- 172.21.15.96:0/3519966778 wait complete. 2022-02-02T20:50:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 Processor -- start 2022-02-02T20:50:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 -- start start 2022-02-02T20:50:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f6870 0x7f277810da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277810e000 con 0x7f27780f6870 2022-02-02T20:50:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.301+0000 7f277e0c8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277810e140 con 0x7f27780f55d0 2022-02-02T20:50:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:43432/0 (socket says 172.21.15.96:43432) 2022-02-02T20:50:05.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 -- 172.21.15.96:0/2875994145 learned_addr learned my addr 172.21.15.96:0/2875994145 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f2776ffd700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f6870 0x7f277810da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 -- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f6870 msgr2=0x7f277810da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f6870 0x7f277810da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 -- 172.21.15.96:0/2875994145 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768005040 con 0x7f27780f55d0 2022-02-02T20:50:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f27777fe700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2768009830 tx=0x7f2768009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.302+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2768018070 con 0x7f27780f55d0 2022-02-02T20:50:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.303+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277810ea80 con 0x7f27780f55d0 2022-02-02T20:50:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.303+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2768007ba0 con 0x7f27780f55d0 2022-02-02T20:50:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.303+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277810efe0 con 0x7f27780f55d0 2022-02-02T20:50:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.303+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276801de60 con 0x7f27780f55d0 2022-02-02T20:50:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.303+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778045ad0 con 0x7f27780f55d0 2022-02-02T20:50:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.304+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2768007d10 con 0x7f27780f55d0 2022-02-02T20:50:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.304+0000 7f275ffff700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 0x7f2760067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.304+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f27680835f0 con 0x7f27780f55d0 2022-02-02T20:50:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.305+0000 7f2776ffd700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 0x7f2760067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.305+0000 7f2776ffd700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 0x7f2760067270 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f276c004c40 tx=0x7f276c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.308+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2768055170 con 0x7f27780f55d0 2022-02-02T20:50:05.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.483+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27780faab0 con 0x7f2760064db0 2022-02-02T20:50:05.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.492+0000 7f275ffff700 1 -- 172.21.15.96:0/2875994145 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f27780faab0 con 0x7f2760064db0 2022-02-02T20:50:05.495 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:50:05.495 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:50:05.496 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:50:05.496 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:50:05.496 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:50:05.496 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:50:05.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:50:05.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:50:05.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:50:05.497 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:50:05.498 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:50:05.498 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:50:05.498 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:50:05.498 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:50:05.499 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:50:05.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:50:05.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:50:05.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:50:05.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:50:05.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:50:05.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:50:05.501 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:50:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.494+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 msgr2=0x7f2760067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.494+0000 7f277e0c8700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 0x7f2760067270 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f276c004c40 tx=0x7f276c00b040).stop 2022-02-02T20:50:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.494+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 msgr2=0x7f277810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.494+0000 7f277e0c8700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2768009830 tx=0x7f2768009b30).stop 2022-02-02T20:50:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 shutdown_connections 2022-02-02T20:50:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064db0 0x7f2760067270 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f55d0 0x7f277810d560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 --2- 172.21.15.96:0/2875994145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f6870 0x7f277810da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 >> 172.21.15.96:0/2875994145 conn(0x7f27780f0d70 msgr2=0x7f277805ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 shutdown_connections 2022-02-02T20:50:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.495+0000 7f277e0c8700 1 -- 172.21.15.96:0/2875994145 wait complete. 2022-02-02T20:50:05.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 -- 172.21.15.96:0/1992052999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f66e0 msgr2=0x7efcfc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1992052999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f66e0 0x7efcfc0f6b00 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 rx=0x7efcf0004660 tx=0x7efcf0009b30).stop 2022-02-02T20:50:05.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 -- 172.21.15.96:0/1992052999 shutdown_connections 2022-02-02T20:50:05.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1992052999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f7980 0x7efcfc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:50:05.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1992052999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f66e0 0x7efcfc0f6b00 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 -- 172.21.15.96:0/1992052999 >> 172.21.15.96:0/1992052999 conn(0x7efcfc0f1e40 msgr2=0x7efcfc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 -- 172.21.15.96:0/1992052999 shutdown_connections 2022-02-02T20:50:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 -- 172.21.15.96:0/1992052999 wait complete. 2022-02-02T20:50:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.592+0000 7efd03bc4700 1 Processor -- start 2022-02-02T20:50:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd03bc4700 1 -- start start 2022-02-02T20:50:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd03bc4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f66e0 0x7efcfc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd03bc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd03bc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc06a410 con 0x7efcfc0f7980 2022-02-02T20:50:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd03bc4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc06a550 con 0x7efcfc0f66e0 2022-02-02T20:50:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39340/0 (socket says 172.21.15.96:39340) 2022-02-02T20:50:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 -- 172.21.15.96:0/1203670381 learned_addr learned my addr 172.21.15.96:0/1203670381 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd01960700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f66e0 0x7efcfc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 -- 172.21.15.96:0/1203670381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f66e0 msgr2=0x7efcfc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f66e0 0x7efcfc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 -- 172.21.15.96:0/1203670381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0005040 con 0x7efcfc0f7980 2022-02-02T20:50:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efd0115f700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7efcf800b410 tx=0x7efcf8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.593+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf80125f0 con 0x7efcfc0f7980 2022-02-02T20:50:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.594+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc06a830 con 0x7efcfc0f7980 2022-02-02T20:50:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.594+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efcf800be30 con 0x7efcfc0f7980 2022-02-02T20:50:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.594+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf8002a70 con 0x7efcfc0f7980 2022-02-02T20:50:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.594+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc10efe0 con 0x7efcfc0f7980 2022-02-02T20:50:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.595+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4004fa0 con 0x7efcfc0f7980 2022-02-02T20:50:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.595+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efcf800f030 con 0x7efcfc0f7980 2022-02-02T20:50:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.595+0000 7efcee7fc700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 0x7efce8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.596+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efcf8081d50 con 0x7efcfc0f7980 2022-02-02T20:50:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.596+0000 7efd01960700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 0x7efce8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.596+0000 7efd01960700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 0x7efce8067290 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7efcf0013690 tx=0x7efcf0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.600+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efcf804fe50 con 0x7efcfc0f7980 2022-02-02T20:50:05.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.829+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efce4005e80 con 0x7efcfc0f7980 2022-02-02T20:50:05.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.830+0000 7efcee7fc700 1 -- 172.21.15.96:0/1203670381 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7efcf8053470 con 0x7efcfc0f7980 2022-02-02T20:50:05.833 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:50:05.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:50:05.833 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:50:05.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:05.834 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:50:05.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:50:05.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:05.835 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:50:05.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:50:05.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:05.835 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:50:05.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:50:05.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:05.836 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:50:05.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:50:05.837 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:50:05.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:50:05.837 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:50:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.831+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 msgr2=0x7efce8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.831+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 0x7efce8067290 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7efcf0013690 tx=0x7efcf0009b30).stop 2022-02-02T20:50:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.831+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 msgr2=0x7efcfc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.831+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7efcf800b410 tx=0x7efcf8006ef0).stop 2022-02-02T20:50:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 shutdown_connections 2022-02-02T20:50:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efce8064dd0 0x7efce8067290 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcfc0f66e0 0x7efcfc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 --2- 172.21.15.96:0/1203670381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcfc0f7980 0x7efcfc069e20 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 >> 172.21.15.96:0/1203670381 conn(0x7efcfc0f1e40 msgr2=0x7efcfc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 shutdown_connections 2022-02-02T20:50:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.832+0000 7efd03bc4700 1 -- 172.21.15.96:0/1203670381 wait complete. 2022-02-02T20:50:05.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- 172.21.15.96:0/2509725712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f6860 msgr2=0x7f0fc80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/2509725712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f6860 0x7f0fc80f6cc0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 rx=0x7f0fc4004660 tx=0x7f0fc4009b30).stop 2022-02-02T20:50:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- 172.21.15.96:0/2509725712 shutdown_connections 2022-02-02T20:50:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/2509725712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f6860 0x7f0fc80f6cc0 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/2509725712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f55c0 0x7f0fc80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- 172.21.15.96:0/2509725712 >> 172.21.15.96:0/2509725712 conn(0x7f0fc80f0d40 msgr2=0x7f0fc80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- 172.21.15.96:0/2509725712 shutdown_connections 2022-02-02T20:50:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- 172.21.15.96:0/2509725712 wait complete. 2022-02-02T20:50:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 Processor -- start 2022-02-02T20:50:05.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.929+0000 7f0fd05e9700 1 -- start start 2022-02-02T20:50:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fd05e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fd05e9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 0x7f0fc8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fd05e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8107a10 con 0x7f0fc80f55c0 2022-02-02T20:50:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fd05e9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8107b50 con 0x7f0fc80f6860 2022-02-02T20:50:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39348/0 (socket says 172.21.15.96:39348) 2022-02-02T20:50:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 -- 172.21.15.96:0/3830110296 learned_addr learned my addr 172.21.15.96:0/3830110296 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fcdb84700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 0x7f0fc8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 -- 172.21.15.96:0/3830110296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 msgr2=0x7f0fc8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 0x7f0fc8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 -- 172.21.15.96:0/3830110296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4005040 con 0x7f0fc80f55c0 2022-02-02T20:50:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fcdb84700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 0x7f0fc8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:50:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fce385700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 rx=0x7f0fb8004ae0 tx=0x7f0fb8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb800a7a0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0fb800adb0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.930+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb8018ea0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.931+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc81084f0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.931+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc8108ab0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.932+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8045ad0 con 0x7f0fc80f55c0 2022-02-02T20:50:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.932+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0fb8020070 con 0x7f0fc80f55c0 2022-02-02T20:50:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.933+0000 7f0fbeffd700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 0x7f0fb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.933+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0fb8085770 con 0x7f0fc80f55c0 2022-02-02T20:50:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.933+0000 7f0fcdb84700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 0x7f0fb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.933+0000 7f0fcdb84700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 0x7f0fb4067290 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f0fc4004e30 tx=0x7f0fc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:05.937+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0fb80572a0 con 0x7f0fc80f55c0 2022-02-02T20:50:06.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.136+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fc80f7a80 con 0x7f0fc80f55c0 2022-02-02T20:50:06.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.137+0000 7f0fbeffd700 1 -- 172.21.15.96:0/3830110296 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0fb801e720 con 0x7f0fc80f55c0 2022-02-02T20:50:06.140 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:50:06.140 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:50:06.140 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:50:06.140 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:50:06.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:06.141 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:50:06.141 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:50:06.141 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:50:06.141 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:50:06.142 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:50:06.142 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:50:06.142 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:50:06.142 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:50:06.143 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:50:06.143 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:50:06.143 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:50:06.143 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:50:06.143 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:50:06.144 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:50:06.144 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:50:06.144 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:50:06.144 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:50:06.145 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:50:06.145 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:50:06.145 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:50:06.145 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:50:06.145 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:50:06.146 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:50:06.146 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:50:06.146 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:50:06.146 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:50:06.147 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:50:06.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:06.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:06.147 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:50:06.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:06.148 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:06.148 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:06.148 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:06.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 msgr2=0x7f0fb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:06.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 0x7f0fb4067290 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f0fc4004e30 tx=0x7f0fc4009b30).stop 2022-02-02T20:50:06.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 msgr2=0x7f0fc8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:06.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 rx=0x7f0fb8004ae0 tx=0x7f0fb8007d90).stop 2022-02-02T20:50:06.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 shutdown_connections 2022-02-02T20:50:06.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fb4064dd0 0x7f0fb4067290 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:06.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fc80f55c0 0x7f0fc8106f70 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:06.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 --2- 172.21.15.96:0/3830110296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80f6860 0x7f0fc8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:06.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 >> 172.21.15.96:0/3830110296 conn(0x7f0fc80f0d40 msgr2=0x7f0fc805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:06.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 shutdown_connections 2022-02-02T20:50:06.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:06.139+0000 7f0fd05e9700 1 -- 172.21.15.96:0/3830110296 wait complete. 2022-02-02T20:50:06.152 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:50:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:06 smithi159 ceph-mon[69013]: from='client.38660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:06 smithi159 ceph-mon[69013]: from='client.46997 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:06 smithi159 ceph-mon[69013]: pgmap v4440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1203670381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:50:07.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3830110296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:50:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:06 smithi096 ceph-mon[101353]: from='client.38660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:06 smithi096 ceph-mon[101353]: from='client.46997 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:06 smithi096 ceph-mon[101353]: pgmap v4440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1203670381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:50:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3830110296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:50:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:08 smithi096 ceph-mon[101353]: pgmap v4441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:08 smithi159 ceph-mon[69013]: pgmap v4441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:10 smithi159 ceph-mon[69013]: pgmap v4442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:10 smithi096 ceph-mon[101353]: pgmap v4442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:12 smithi159 ceph-mon[69013]: pgmap v4443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:12 smithi096 ceph-mon[101353]: pgmap v4443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:14 smithi159 ceph-mon[69013]: pgmap v4444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:14 smithi096 ceph-mon[101353]: pgmap v4444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:16 smithi159 ceph-mon[69013]: pgmap v4445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:16 smithi096 ceph-mon[101353]: pgmap v4445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:18 smithi096 ceph-mon[101353]: pgmap v4446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:18 smithi159 ceph-mon[69013]: pgmap v4446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:20 smithi159 ceph-mon[69013]: pgmap v4447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:20 smithi096 ceph-mon[101353]: pgmap v4447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:22 smithi159 ceph-mon[69013]: pgmap v4448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:22 smithi096 ceph-mon[101353]: pgmap v4448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:24 smithi159 ceph-mon[69013]: pgmap v4449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:24 smithi096 ceph-mon[101353]: pgmap v4449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:26 smithi159 ceph-mon[69013]: pgmap v4450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:26 smithi096 ceph-mon[101353]: pgmap v4450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:28 smithi096 ceph-mon[101353]: pgmap v4451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:50:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:50:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:28 smithi159 ceph-mon[69013]: pgmap v4451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:50:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:50:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:30 smithi159 ceph-mon[69013]: pgmap v4452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:30 smithi096 ceph-mon[101353]: pgmap v4452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:32 smithi159 ceph-mon[69013]: pgmap v4453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:32 smithi096 ceph-mon[101353]: pgmap v4453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:34 smithi159 ceph-mon[69013]: pgmap v4454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:34 smithi096 ceph-mon[101353]: pgmap v4454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/913783742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 msgr2=0x7f9f880f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 --2- 172.21.15.96:0/913783742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f880f6fd0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 rx=0x7f9f78004660 tx=0x7f9f78009b30).stop 2022-02-02T20:50:36.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/913783742 shutdown_connections 2022-02-02T20:50:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 --2- 172.21.15.96:0/913783742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 0x7f9f880f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 --2- 172.21.15.96:0/913783742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f880f6fd0 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/913783742 >> 172.21.15.96:0/913783742 conn(0x7f9f880f04c0 msgr2=0x7f9f880f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:36.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/913783742 shutdown_connections 2022-02-02T20:50:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.250+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/913783742 wait complete. 2022-02-02T20:50:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 Processor -- start 2022-02-02T20:50:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 -- start start 2022-02-02T20:50:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 0x7f9f881096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88109c50 con 0x7f9f880f6bb0 2022-02-02T20:50:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8fb9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88109d90 con 0x7f9f880f7550 2022-02-02T20:50:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39366/0 (socket says 172.21.15.96:39366) 2022-02-02T20:50:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 -- 172.21.15.96:0/1028289426 learned_addr learned my addr 172.21.15.96:0/1028289426 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d139700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 0x7f9f881096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 -- 172.21.15.96:0/1028289426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 msgr2=0x7f9f881096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 0x7f9f881096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 -- 172.21.15.96:0/1028289426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78005040 con 0x7f9f880f6bb0 2022-02-02T20:50:36.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.251+0000 7f9f8d93a700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 rx=0x7f9f78009990 tx=0x7f9f78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.252+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f78018070 con 0x7f9f880f6bb0 2022-02-02T20:50:36.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.252+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f78007ba0 con 0x7f9f880f6bb0 2022-02-02T20:50:36.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.252+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/1028289426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8810a6d0 con 0x7f9f880f6bb0 2022-02-02T20:50:36.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.252+0000 7f9f8fb9e700 1 -- 172.21.15.96:0/1028289426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8810ac30 con 0x7f9f880f6bb0 2022-02-02T20:50:36.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.252+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7801de50 con 0x7f9f880f6bb0 2022-02-02T20:50:36.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.253+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88045ad0 con 0x7f9f880f6bb0 2022-02-02T20:50:36.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.253+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f7801d420 con 0x7f9f880f6bb0 2022-02-02T20:50:36.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.254+0000 7f9f7e7fc700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 0x7f9f74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.254+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f78083640 con 0x7f9f880f6bb0 2022-02-02T20:50:36.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.254+0000 7f9f8d139700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 0x7f9f74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.254+0000 7f9f8d139700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 0x7f9f74067290 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f9f84004c40 tx=0x7f9f8400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.258+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f78055230 con 0x7f9f880f6bb0 2022-02-02T20:50:36.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.437+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8810b2c0 con 0x7f9f74064dd0 2022-02-02T20:50:36.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.439+0000 7f9f7e7fc700 1 -- 172.21.15.96:0/1028289426 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9f8810b2c0 con 0x7f9f74064dd0 2022-02-02T20:50:36.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 msgr2=0x7f9f74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 0x7f9f74067290 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f9f84004c40 tx=0x7f9f8400b040).stop 2022-02-02T20:50:36.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 msgr2=0x7f9f881091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 rx=0x7f9f78009990 tx=0x7f9f78009b30).stop 2022-02-02T20:50:36.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 shutdown_connections 2022-02-02T20:50:36.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f74064dd0 0x7f9f74067290 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880f6bb0 0x7f9f881091b0 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 --2- 172.21.15.96:0/1028289426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f880f7550 0x7f9f881096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 >> 172.21.15.96:0/1028289426 conn(0x7f9f880f04c0 msgr2=0x7f9f880fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:36.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.440+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 shutdown_connections 2022-02-02T20:50:36.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.441+0000 7f9f6bfff700 1 -- 172.21.15.96:0/1028289426 wait complete. 2022-02-02T20:50:36.453 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:50:36.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 -- 172.21.15.96:0/3891710827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 msgr2=0x7f60b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 --2- 172.21.15.96:0/3891710827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b40f6cc0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 rx=0x7f60a4004660 tx=0x7f60a4009b30).stop 2022-02-02T20:50:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 -- 172.21.15.96:0/3891710827 shutdown_connections 2022-02-02T20:50:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 --2- 172.21.15.96:0/3891710827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b40f6cc0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 --2- 172.21.15.96:0/3891710827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.537+0000 7f60ba46f700 1 -- 172.21.15.96:0/3891710827 >> 172.21.15.96:0/3891710827 conn(0x7f60b40f0d40 msgr2=0x7f60b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:36.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.538+0000 7f60ba46f700 1 -- 172.21.15.96:0/3891710827 shutdown_connections 2022-02-02T20:50:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.538+0000 7f60ba46f700 1 -- 172.21.15.96:0/3891710827 wait complete. 2022-02-02T20:50:36.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.538+0000 7f60ba46f700 1 Processor -- start 2022-02-02T20:50:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60ba46f700 1 -- start start 2022-02-02T20:50:36.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60ba46f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60ba46f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60ba46f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40603c0 con 0x7f60b40f6860 2022-02-02T20:50:36.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60ba46f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4060500 con 0x7f60b40f55c0 2022-02-02T20:50:36.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:43480/0 (socket says 172.21.15.96:43480) 2022-02-02T20:50:36.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 -- 172.21.15.96:0/1624538383 learned_addr learned my addr 172.21.15.96:0/1624538383 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:36.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b37fe700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 -- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 msgr2=0x7f60b410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b3fff700 1 -- 172.21.15.96:0/1624538383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4005040 con 0x7f60b40f55c0 2022-02-02T20:50:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.539+0000 7f60b37fe700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:50:36.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60b3fff700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f60a8002700 tx=0x7f60a8009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a8009320 con 0x7f60b40f55c0 2022-02-02T20:50:36.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b410c720 con 0x7f60b40f55c0 2022-02-02T20:50:36.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60a800f040 con 0x7f60b40f55c0 2022-02-02T20:50:36.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a8014900 con 0x7f60b40f55c0 2022-02-02T20:50:36.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.540+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b410ccb0 con 0x7f60b40f55c0 2022-02-02T20:50:36.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.541+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4045ad0 con 0x7f60b40f55c0 2022-02-02T20:50:36.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.541+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f60a8009480 con 0x7f60b40f55c0 2022-02-02T20:50:36.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.542+0000 7f60b0ff9700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 0x7f609c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.542+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f60a8081d20 con 0x7f60b40f55c0 2022-02-02T20:50:36.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.542+0000 7f60b37fe700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 0x7f609c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.542+0000 7f60b37fe700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 0x7f609c067290 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f60a4004630 tx=0x7f60a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.546+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60a804fd60 con 0x7f60b40f55c0 2022-02-02T20:50:36.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.725+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b4057f10 con 0x7f609c064dd0 2022-02-02T20:50:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.734+0000 7f60b0ff9700 1 -- 172.21.15.96:0/1624538383 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f60b4057f10 con 0x7f609c064dd0 2022-02-02T20:50:36.736 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:50:36.737 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:50:36.737 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:50:36.737 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:50:36.738 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:50:36.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:50:36.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:50:36.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:50:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:50:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:50:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:50:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:50:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:50:36.740 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:50:36.740 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:50:36.740 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:50:36.740 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:50:36.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:50:36.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:50:36.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:50:36.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:50:36.742 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:50:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 msgr2=0x7f609c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 0x7f609c067290 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f60a4004630 tx=0x7f60a4009b30).stop 2022-02-02T20:50:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 msgr2=0x7f60b4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f60a8002700 tx=0x7f60a8009d80).stop 2022-02-02T20:50:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 shutdown_connections 2022-02-02T20:50:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f609c064dd0 0x7f609c067290 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60b40f55c0 0x7f60b4109c70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 --2- 172.21.15.96:0/1624538383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40f6860 0x7f60b410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 >> 172.21.15.96:0/1624538383 conn(0x7f60b40f0d40 msgr2=0x7f60b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 shutdown_connections 2022-02-02T20:50:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.736+0000 7f60ba46f700 1 -- 172.21.15.96:0/1624538383 wait complete. 2022-02-02T20:50:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:36 smithi096 ceph-mon[101353]: pgmap v4455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:36.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 -- 172.21.15.96:0/3875781009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40f9860 msgr2=0x7f3ae40fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 --2- 172.21.15.96:0/3875781009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40f9860 0x7f3ae40fbc70 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 rx=0x7f3ae0004660 tx=0x7f3ae0009b30).stop 2022-02-02T20:50:36.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 -- 172.21.15.96:0/3875781009 shutdown_connections 2022-02-02T20:50:36.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 --2- 172.21.15.96:0/3875781009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40f9860 0x7f3ae40fbc70 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 --2- 172.21.15.96:0/3875781009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40602d0 0x7f3ae40f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 -- 172.21.15.96:0/3875781009 >> 172.21.15.96:0/3875781009 conn(0x7f3ae40f0d40 msgr2=0x7f3ae40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:36.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 -- 172.21.15.96:0/3875781009 shutdown_connections 2022-02-02T20:50:36.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.833+0000 7f3aec793700 1 -- 172.21.15.96:0/3875781009 wait complete. 2022-02-02T20:50:36.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 Processor -- start 2022-02-02T20:50:36.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 -- start start 2022-02-02T20:50:36.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 0x7f3ae4107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41079e0 con 0x7f3ae40602d0 2022-02-02T20:50:36.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aec793700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4107b20 con 0x7f3ae40f9860 2022-02-02T20:50:36.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39386/0 (socket says 172.21.15.96:39386) 2022-02-02T20:50:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 -- 172.21.15.96:0/2186124183 learned_addr learned my addr 172.21.15.96:0/2186124183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3ae9d2e700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 0x7f3ae4107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 -- 172.21.15.96:0/2186124183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 msgr2=0x7f3ae4107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 0x7f3ae4107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 -- 172.21.15.96:0/2186124183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0005040 con 0x7f3ae40602d0 2022-02-02T20:50:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3ae9d2e700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 0x7f3ae4107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:50:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3aea52f700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f3ad400c790 tx=0x7f3ad4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.834+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad400e680 con 0x7f3ae40602d0 2022-02-02T20:50:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.835+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ad400ec90 con 0x7f3ae40602d0 2022-02-02T20:50:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.835+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4013d60 con 0x7f3ae40602d0 2022-02-02T20:50:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.835+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae41084c0 con 0x7f3ae40602d0 2022-02-02T20:50:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.835+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae4108a80 con 0x7f3ae40602d0 2022-02-02T20:50:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.836+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae4045ad0 con 0x7f3ae40602d0 2022-02-02T20:50:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.836+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ad401a060 con 0x7f3ae40602d0 2022-02-02T20:50:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.836+0000 7f3adaffd700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 0x7f3ad0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:36.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.836+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3ad4081c90 con 0x7f3ae40602d0 2022-02-02T20:50:36.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.836+0000 7f3ae9d2e700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 0x7f3ad0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:36.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.837+0000 7f3ae9d2e700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 0x7f3ad0067290 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f3ae0004e30 tx=0x7f3ae0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:36.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:36.841+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ad40537c0 con 0x7f3ae40602d0 2022-02-02T20:50:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:36 smithi159 ceph-mon[69013]: pgmap v4455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:37.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.071+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ae40fef20 con 0x7f3ae40602d0 2022-02-02T20:50:37.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.071+0000 7f3adaffd700 1 -- 172.21.15.96:0/2186124183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3ad4018070 con 0x7f3ae40602d0 2022-02-02T20:50:37.074 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:50:37.075 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:50:37.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:50:37.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:37.075 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:50:37.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:50:37.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:37.076 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:50:37.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:50:37.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:37.077 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:50:37.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:50:37.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:50:37.077 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:50:37.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:50:37.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:50:37.078 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:50:37.079 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:50:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 msgr2=0x7f3ad0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 0x7f3ad0067290 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f3ae0004e30 tx=0x7f3ae0009b30).stop 2022-02-02T20:50:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 msgr2=0x7f3ae4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f3ad400c790 tx=0x7f3ad4007d70).stop 2022-02-02T20:50:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 shutdown_connections 2022-02-02T20:50:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ad0064dd0 0x7f3ad0067290 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae40602d0 0x7f3ae4106f40 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 --2- 172.21.15.96:0/2186124183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae40f9860 0x7f3ae4107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 >> 172.21.15.96:0/2186124183 conn(0x7f3ae40f0d40 msgr2=0x7f3ae40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 shutdown_connections 2022-02-02T20:50:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.073+0000 7f3aec793700 1 -- 172.21.15.96:0/2186124183 wait complete. 2022-02-02T20:50:37.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 -- 172.21.15.96:0/2730240698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f77d0 msgr2=0x7fba4c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 --2- 172.21.15.96:0/2730240698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f77d0 0x7fba4c0f7c30 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 rx=0x7fba40004660 tx=0x7fba40009b30).stop 2022-02-02T20:50:37.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 -- 172.21.15.96:0/2730240698 shutdown_connections 2022-02-02T20:50:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 --2- 172.21.15.96:0/2730240698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f77d0 0x7fba4c0f7c30 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 --2- 172.21.15.96:0/2730240698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f6530 0x7fba4c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 -- 172.21.15.96:0/2730240698 >> 172.21.15.96:0/2730240698 conn(0x7fba4c0f1c90 msgr2=0x7fba4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.170+0000 7fba4b59e700 1 -- 172.21.15.96:0/2730240698 shutdown_connections 2022-02-02T20:50:37.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.171+0000 7fba4b59e700 1 -- 172.21.15.96:0/2730240698 wait complete. 2022-02-02T20:50:37.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.171+0000 7fba4b59e700 1 Processor -- start 2022-02-02T20:50:37.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4b59e700 1 -- start start 2022-02-02T20:50:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 0x7fba4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c06a380 con 0x7fba4c0f6530 2022-02-02T20:50:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c06a4c0 con 0x7fba4c0f77d0 2022-02-02T20:50:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39394/0 (socket says 172.21.15.96:39394) 2022-02-02T20:50:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 -- 172.21.15.96:0/4280031885 learned_addr learned my addr 172.21.15.96:0/4280031885 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:50:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba49d9b700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 0x7fba4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 -- 172.21.15.96:0/4280031885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 msgr2=0x7fba4c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 0x7fba4c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 -- 172.21.15.96:0/4280031885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba40005040 con 0x7fba4c0f6530 2022-02-02T20:50:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba49d9b700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 0x7fba4c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:50:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.172+0000 7fba4a59c700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 rx=0x7fba3c00c530 tx=0x7fba3c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.173+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3c00f650 con 0x7fba4c0f6530 2022-02-02T20:50:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.173+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c06a7a0 con 0x7fba4c0f6530 2022-02-02T20:50:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.173+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba3c00fc60 con 0x7fba4c0f6530 2022-02-02T20:50:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.173+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3c012d20 con 0x7fba4c0f6530 2022-02-02T20:50:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.173+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c10ed50 con 0x7fba4c0f6530 2022-02-02T20:50:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.174+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba3c019030 con 0x7fba4c0f6530 2022-02-02T20:50:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.174+0000 7fba3affd700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 0x7fba340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:50:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.174+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c045ad0 con 0x7fba4c0f6530 2022-02-02T20:50:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.175+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba3c0816b0 con 0x7fba4c0f6530 2022-02-02T20:50:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.175+0000 7fba49d9b700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 0x7fba340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:50:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.175+0000 7fba49d9b700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 0x7fba340672e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fba40009da0 tx=0x7fba40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:50:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.180+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba3c04f800 con 0x7fba4c0f6530 2022-02-02T20:50:37.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.382+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba4c0fee00 con 0x7fba4c0f6530 2022-02-02T20:50:37.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.383+0000 7fba3affd700 1 -- 172.21.15.96:0/4280031885 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fba3c017020 con 0x7fba4c0f6530 2022-02-02T20:50:37.386 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:50:37.386 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:50:37.386 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:50:37.386 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:50:37.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:37.387 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:50:37.387 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:50:37.387 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:50:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:50:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:50:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:50:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:50:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:50:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:50:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:50:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:50:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:50:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:50:37.390 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:50:37.390 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:50:37.390 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:50:37.390 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:50:37.391 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:50:37.391 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:50:37.391 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:50:37.391 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:50:37.391 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:50:37.392 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:50:37.392 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:50:37.392 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:50:37.392 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:50:37.392 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:50:37.393 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:37.393 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:37.393 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:50:37.393 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:50:37.394 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:37.394 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:37.394 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:50:37.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 msgr2=0x7fba340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 0x7fba340672e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fba40009da0 tx=0x7fba40009b30).stop 2022-02-02T20:50:37.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 msgr2=0x7fba4c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:50:37.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 rx=0x7fba3c00c530 tx=0x7fba3c007e10).stop 2022-02-02T20:50:37.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 shutdown_connections 2022-02-02T20:50:37.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba34064e20 0x7fba340672e0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba4c0f6530 0x7fba4c06b9a0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 --2- 172.21.15.96:0/4280031885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4c0f77d0 0x7fba4c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:50:37.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 >> 172.21.15.96:0/4280031885 conn(0x7fba4c0f1c90 msgr2=0x7fba4c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:50:37.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 shutdown_connections 2022-02-02T20:50:37.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:50:37.386+0000 7fba4b59e700 1 -- 172.21.15.96:0/4280031885 wait complete. 2022-02-02T20:50:37.397 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:50:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:37 smithi159 ceph-mon[69013]: from='client.38676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:37 smithi159 ceph-mon[69013]: from='client.47009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2186124183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:50:38.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4280031885' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:50:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:37 smithi096 ceph-mon[101353]: from='client.38676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:37 smithi096 ceph-mon[101353]: from='client.47009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:50:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2186124183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:50:38.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4280031885' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:50:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:38 smithi159 ceph-mon[69013]: pgmap v4456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:38 smithi096 ceph-mon[101353]: pgmap v4456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:41.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:40 smithi159 ceph-mon[69013]: pgmap v4457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:40 smithi096 ceph-mon[101353]: pgmap v4457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:42 smithi159 ceph-mon[69013]: pgmap v4458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:42 smithi096 ceph-mon[101353]: pgmap v4458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:44 smithi159 ceph-mon[69013]: pgmap v4459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:44 smithi096 ceph-mon[101353]: pgmap v4459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:46 smithi159 ceph-mon[69013]: pgmap v4460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:46 smithi096 ceph-mon[101353]: pgmap v4460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:48.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:48 smithi096 ceph-mon[101353]: pgmap v4461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:48 smithi159 ceph-mon[69013]: pgmap v4461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:50 smithi159 ceph-mon[69013]: pgmap v4462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:50 smithi096 ceph-mon[101353]: pgmap v4462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:52 smithi159 ceph-mon[69013]: pgmap v4463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:52 smithi096 ceph-mon[101353]: pgmap v4463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:54 smithi159 ceph-mon[69013]: pgmap v4464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:54 smithi096 ceph-mon[101353]: pgmap v4464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:56 smithi159 ceph-mon[69013]: pgmap v4465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:56 smithi096 ceph-mon[101353]: pgmap v4465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:50:58 smithi096 ceph-mon[101353]: pgmap v4466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:50:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:50:58 smithi159 ceph-mon[69013]: pgmap v4466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:00 smithi159 ceph-mon[69013]: pgmap v4467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:00 smithi096 ceph-mon[101353]: pgmap v4467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:02 smithi159 ceph-mon[69013]: pgmap v4468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:02 smithi096 ceph-mon[101353]: pgmap v4468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:04 smithi159 ceph-mon[69013]: pgmap v4469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:04 smithi096 ceph-mon[101353]: pgmap v4469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:06 smithi159 ceph-mon[69013]: pgmap v4470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:06 smithi096 ceph-mon[101353]: pgmap v4470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:07.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 -- 172.21.15.96:0/3052397921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f6860 msgr2=0x7f19f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/3052397921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f6860 0x7f19f80f6cc0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 rx=0x7f19e8004660 tx=0x7f19e8009b30).stop 2022-02-02T20:51:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 -- 172.21.15.96:0/3052397921 shutdown_connections 2022-02-02T20:51:07.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/3052397921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f6860 0x7f19f80f6cc0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/3052397921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f55c0 0x7f19f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 -- 172.21.15.96:0/3052397921 >> 172.21.15.96:0/3052397921 conn(0x7f19f80f0d40 msgr2=0x7f19f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:07.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 -- 172.21.15.96:0/3052397921 shutdown_connections 2022-02-02T20:51:07.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 -- 172.21.15.96:0/3052397921 wait complete. 2022-02-02T20:51:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.498+0000 7f19fe9cd700 1 Processor -- start 2022-02-02T20:51:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19fe9cd700 1 -- start start 2022-02-02T20:51:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19fe9cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19fe9cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 0x7f19f8109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19fe9cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8109c20 con 0x7f19f80f55c0 2022-02-02T20:51:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19fe9cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8109d60 con 0x7f19f80f6860 2022-02-02T20:51:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39412/0 (socket says 172.21.15.96:39412) 2022-02-02T20:51:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 -- 172.21.15.96:0/2165954932 learned_addr learned my addr 172.21.15.96:0/2165954932 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f77fe700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 0x7f19f8109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 -- 172.21.15.96:0/2165954932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 msgr2=0x7f19f8109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 0x7f19f8109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 -- 172.21.15.96:0/2165954932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8005040 con 0x7f19f80f55c0 2022-02-02T20:51:07.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f77fe700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 0x7f19f8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:51:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.499+0000 7f19f7fff700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 rx=0x7f19ec00c790 tx=0x7f19ec007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.500+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec00e680 con 0x7f19f80f55c0 2022-02-02T20:51:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.500+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19ec00ec90 con 0x7f19f80f55c0 2022-02-02T20:51:07.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.500+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f810a700 con 0x7f19f80f55c0 2022-02-02T20:51:07.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.500+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec012d00 con 0x7f19f80f55c0 2022-02-02T20:51:07.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.500+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f810acc0 con 0x7f19f80f55c0 2022-02-02T20:51:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.501+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8045ad0 con 0x7f19f80f55c0 2022-02-02T20:51:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.501+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19ec010070 con 0x7f19f80f55c0 2022-02-02T20:51:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.502+0000 7f19f4ff9700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 0x7f19e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.502+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19ec081b50 con 0x7f19f80f55c0 2022-02-02T20:51:07.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.502+0000 7f19f77fe700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 0x7f19e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.502+0000 7f19f77fe700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 0x7f19e0067290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f19e8009da0 tx=0x7f19e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:07.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.506+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19ec053680 con 0x7f19f80f55c0 2022-02-02T20:51:07.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.684+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f80faaa0 con 0x7f19e0064dd0 2022-02-02T20:51:07.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.685+0000 7f19f4ff9700 1 -- 172.21.15.96:0/2165954932 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f19f80faaa0 con 0x7f19e0064dd0 2022-02-02T20:51:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 msgr2=0x7f19e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 0x7f19e0067290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f19e8009da0 tx=0x7f19e8009b30).stop 2022-02-02T20:51:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 msgr2=0x7f19f8109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 rx=0x7f19ec00c790 tx=0x7f19ec007d90).stop 2022-02-02T20:51:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 shutdown_connections 2022-02-02T20:51:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19e0064dd0 0x7f19e0067290 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19f80f55c0 0x7f19f8109180 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 --2- 172.21.15.96:0/2165954932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19f80f6860 0x7f19f8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 >> 172.21.15.96:0/2165954932 conn(0x7f19f80f0d40 msgr2=0x7f19f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 shutdown_connections 2022-02-02T20:51:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.687+0000 7f19fe9cd700 1 -- 172.21.15.96:0/2165954932 wait complete. 2022-02-02T20:51:07.699 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:51:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- 172.21.15.96:0/2181883540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 msgr2=0x7f0edc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/2181883540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc0f6cc0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 rx=0x7f0ed8004660 tx=0x7f0ed8009b30).stop 2022-02-02T20:51:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- 172.21.15.96:0/2181883540 shutdown_connections 2022-02-02T20:51:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/2181883540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc0f6cc0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/2181883540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 0x7f0edc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- 172.21.15.96:0/2181883540 >> 172.21.15.96:0/2181883540 conn(0x7f0edc0f0d40 msgr2=0x7f0edc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- 172.21.15.96:0/2181883540 shutdown_connections 2022-02-02T20:51:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- 172.21.15.96:0/2181883540 wait complete. 2022-02-02T20:51:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 Processor -- start 2022-02-02T20:51:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.785+0000 7f0ee3bce700 1 -- start start 2022-02-02T20:51:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 0x7f0edc109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0603e0 con 0x7f0edc0f6860 2022-02-02T20:51:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc060520 con 0x7f0edc0f55c0 2022-02-02T20:51:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39424/0 (socket says 172.21.15.96:39424) 2022-02-02T20:51:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 -- 172.21.15.96:0/1922748943 learned_addr learned my addr 172.21.15.96:0/1922748943 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee196a700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 0x7f0edc109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 -- 172.21.15.96:0/1922748943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 msgr2=0x7f0edc109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 0x7f0edc109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 -- 172.21.15.96:0/1922748943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8005040 con 0x7f0edc0f6860 2022-02-02T20:51:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee1169700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 rx=0x7f0ed8009990 tx=0x7f0ed8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed8018070 con 0x7f0edc0f6860 2022-02-02T20:51:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc10c6a0 con 0x7f0edc0f6860 2022-02-02T20:51:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc10cc00 con 0x7f0edc0f6860 2022-02-02T20:51:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.786+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ed8007ba0 con 0x7f0edc0f6860 2022-02-02T20:51:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.787+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed801c3c0 con 0x7f0edc0f6860 2022-02-02T20:51:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.787+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4004fa0 con 0x7f0edc0f6860 2022-02-02T20:51:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.788+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ed801d420 con 0x7f0edc0f6860 2022-02-02T20:51:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.788+0000 7f0ed27fc700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 0x7f0ec8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.788+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ed8083600 con 0x7f0edc0f6860 2022-02-02T20:51:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.788+0000 7f0ee196a700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 0x7f0ec8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.789+0000 7f0ee196a700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 0x7f0ec8067290 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f0edc060060 tx=0x7f0ecc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.793+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ed80516a0 con 0x7f0edc0f6860 2022-02-02T20:51:07.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.967+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ec4000bc0 con 0x7f0ec8064dd0 2022-02-02T20:51:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.976+0000 7f0ed27fc700 1 -- 172.21.15.96:0/1922748943 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0ec4000bc0 con 0x7f0ec8064dd0 2022-02-02T20:51:07.978 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:51:07.979 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:51:07.980 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:51:07.981 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:51:07.981 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:51:07.982 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:51:07.982 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:51:07.983 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:51:07.983 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:51:07.985 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:51:07.985 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:51:07.985 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:51:07.986 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:51:07.986 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:51:07.986 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:51:07.986 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:51:07.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:51:07.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:51:07.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:51:07.987 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:51:07.988 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:51:07.988 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:51:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 msgr2=0x7f0ec8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 0x7f0ec8067290 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f0edc060060 tx=0x7f0ecc00b040).stop 2022-02-02T20:51:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 msgr2=0x7f0edc10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 rx=0x7f0ed8009990 tx=0x7f0ed8009b30).stop 2022-02-02T20:51:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 shutdown_connections 2022-02-02T20:51:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ec8064dd0 0x7f0ec8067290 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0edc0f55c0 0x7f0edc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 --2- 172.21.15.96:0/1922748943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0edc0f6860 0x7f0edc10c150 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 >> 172.21.15.96:0/1922748943 conn(0x7f0edc0f0d40 msgr2=0x7f0edc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 shutdown_connections 2022-02-02T20:51:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:07.979+0000 7f0ee3bce700 1 -- 172.21.15.96:0/1922748943 wait complete. 2022-02-02T20:51:08.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 -- 172.21.15.96:0/3437396335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f55e0 msgr2=0x7f69280f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 --2- 172.21.15.96:0/3437396335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f55e0 0x7f69280f5a00 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 rx=0x7f691c004660 tx=0x7f691c009b30).stop 2022-02-02T20:51:08.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 -- 172.21.15.96:0/3437396335 shutdown_connections 2022-02-02T20:51:08.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 --2- 172.21.15.96:0/3437396335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f5ef0 0x7f69280f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 --2- 172.21.15.96:0/3437396335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f55e0 0x7f69280f5a00 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.076+0000 7f692da34700 1 -- 172.21.15.96:0/3437396335 >> 172.21.15.96:0/3437396335 conn(0x7f69280f0de0 msgr2=0x7f69280f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:08.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.077+0000 7f692da34700 1 -- 172.21.15.96:0/3437396335 shutdown_connections 2022-02-02T20:51:08.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.077+0000 7f692da34700 1 -- 172.21.15.96:0/3437396335 wait complete. 2022-02-02T20:51:08.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.077+0000 7f692da34700 1 Processor -- start 2022-02-02T20:51:08.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f692da34700 1 -- start start 2022-02-02T20:51:08.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f692da34700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f55e0 0x7f6928105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f692da34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f692da34700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928106930 con 0x7f69280f5ef0 2022-02-02T20:51:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f692da34700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928106a70 con 0x7f69280f55e0 2022-02-02T20:51:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39434/0 (socket says 172.21.15.96:39434) 2022-02-02T20:51:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 -- 172.21.15.96:0/1998156473 learned_addr learned my addr 172.21.15.96:0/1998156473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f6926ffd700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f55e0 0x7f6928105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 -- 172.21.15.96:0/1998156473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f55e0 msgr2=0x7f6928105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f55e0 0x7f6928105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.078+0000 7f69267fc700 1 -- 172.21.15.96:0/1998156473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c005040 con 0x7f69280f5ef0 2022-02-02T20:51:08.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f69267fc700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7f691800c530 tx=0x7f6918007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:08.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f691800f650 con 0x7f69280f5ef0 2022-02-02T20:51:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6928107410 con 0x7f69280f5ef0 2022-02-02T20:51:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f691800fc60 con 0x7f69280f5ef0 2022-02-02T20:51:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6918012cd0 con 0x7f69280f5ef0 2022-02-02T20:51:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.079+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69281079d0 con 0x7f69280f5ef0 2022-02-02T20:51:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.080+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6928045ad0 con 0x7f69280f5ef0 2022-02-02T20:51:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.080+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6918010070 con 0x7f69280f5ef0 2022-02-02T20:51:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.081+0000 7f690f7fe700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.081+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f69180817b0 con 0x7f69280f5ef0 2022-02-02T20:51:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.081+0000 7f6926ffd700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.081+0000 7f6926ffd700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f691c004e30 tx=0x7f691c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.085+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69180532e0 con 0x7f69280f5ef0 2022-02-02T20:51:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:08 smithi096 ceph-mon[101353]: pgmap v4471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:08 smithi096 ceph-mon[101353]: from='client.38692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:08.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.318+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69280fdea0 con 0x7f69280f5ef0 2022-02-02T20:51:08.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.318+0000 7f690f7fe700 1 -- 172.21.15.96:0/1998156473 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6918052ed0 con 0x7f69280f5ef0 2022-02-02T20:51:08.319 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:51:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:51:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:51:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:51:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:51:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:51:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:51:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:51:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:51:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:51:08.323 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:51:08.323 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:51:08.323 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:51:08.323 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:51:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 msgr2=0x7f6910067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f691c004e30 tx=0x7f691c009b30).stop 2022-02-02T20:51:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 msgr2=0x7f6928106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7f691800c530 tx=0x7f6918007e20).stop 2022-02-02T20:51:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 shutdown_connections 2022-02-02T20:51:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69280f55e0 0x7f6928105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 --2- 172.21.15.96:0/1998156473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69280f5ef0 0x7f6928106380 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 >> 172.21.15.96:0/1998156473 conn(0x7f69280f0de0 msgr2=0x7f69280fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 shutdown_connections 2022-02-02T20:51:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.320+0000 7f692da34700 1 -- 172.21.15.96:0/1998156473 wait complete. 2022-02-02T20:51:08.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 -- 172.21.15.96:0/3011962171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f66e0 msgr2=0x7f18500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 --2- 172.21.15.96:0/3011962171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f66e0 0x7f18500f6b00 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 rx=0x7f1840004660 tx=0x7f1840009b30).stop 2022-02-02T20:51:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 -- 172.21.15.96:0/3011962171 shutdown_connections 2022-02-02T20:51:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 --2- 172.21.15.96:0/3011962171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f7980 0x7f18500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 --2- 172.21.15.96:0/3011962171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f66e0 0x7f18500f6b00 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 -- 172.21.15.96:0/3011962171 >> 172.21.15.96:0/3011962171 conn(0x7f18500f1e40 msgr2=0x7f18500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 -- 172.21.15.96:0/3011962171 shutdown_connections 2022-02-02T20:51:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.421+0000 7f18564e7700 1 -- 172.21.15.96:0/3011962171 wait complete. 2022-02-02T20:51:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 Processor -- start 2022-02-02T20:51:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 -- start start 2022-02-02T20:51:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 0x7f18500ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18501005d0 con 0x7f18500f7980 2022-02-02T20:51:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f18564e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850100710 con 0x7f18500f66e0 2022-02-02T20:51:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39444/0 (socket says 172.21.15.96:39444) 2022-02-02T20:51:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 -- 172.21.15.96:0/1267966478 learned_addr learned my addr 172.21.15.96:0/1267966478 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184ffff700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 0x7f18500ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 -- 172.21.15.96:0/1267966478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 msgr2=0x7f18500ffae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 0x7f18500ffae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184f7fe700 1 -- 172.21.15.96:0/1267966478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1840005040 con 0x7f18500f7980 2022-02-02T20:51:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.422+0000 7f184ffff700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 0x7f18500ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:51:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f184f7fe700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f184400c790 tx=0x7f1844007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184400e680 con 0x7f18500f7980 2022-02-02T20:51:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1850101080 con 0x7f18500f7980 2022-02-02T20:51:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f184400ec90 con 0x7f18500f7980 2022-02-02T20:51:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1844013d60 con 0x7f18500f7980 2022-02-02T20:51:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.423+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1850101640 con 0x7f18500f7980 2022-02-02T20:51:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.424+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850045ad0 con 0x7f18500f7980 2022-02-02T20:51:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.424+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f184401a060 con 0x7f18500f7980 2022-02-02T20:51:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.425+0000 7f184cff9700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 0x7f1838067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.425+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1844081c90 con 0x7f18500f7980 2022-02-02T20:51:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.425+0000 7f184ffff700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 0x7f1838067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.425+0000 7f184ffff700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 0x7f1838067290 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f1840004e30 tx=0x7f1840009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.429+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f184404fd90 con 0x7f18500f7980 2022-02-02T20:51:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:08 smithi159 ceph-mon[69013]: pgmap v4471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:08 smithi159 ceph-mon[69013]: from='client.38692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:08.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.627+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1850027a00 con 0x7f18500f7980 2022-02-02T20:51:08.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.627+0000 7f184cff9700 1 -- 172.21.15.96:0/1267966478 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1844018020 con 0x7f18500f7980 2022-02-02T20:51:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:51:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:51:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:51:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:51:08.632 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:51:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:51:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:51:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:51:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:51:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:51:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:51:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:51:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:51:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:51:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:51:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:51:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:51:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:51:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:51:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:51:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:51:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:51:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:51:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:51:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:51:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:51:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:51:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:51:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:51:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:51:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:51:08.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:08.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:51:08.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 msgr2=0x7f1838067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 0x7f1838067290 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f1840004e30 tx=0x7f1840009b30).stop 2022-02-02T20:51:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 msgr2=0x7f18500fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f184400c790 tx=0x7f1844007d70).stop 2022-02-02T20:51:08.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 shutdown_connections 2022-02-02T20:51:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1838064dd0 0x7f1838067290 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18500f66e0 0x7f18500ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 --2- 172.21.15.96:0/1267966478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18500f7980 0x7f18500fffd0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 >> 172.21.15.96:0/1267966478 conn(0x7f18500f1e40 msgr2=0x7f185006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 shutdown_connections 2022-02-02T20:51:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:08.630+0000 7f18564e7700 1 -- 172.21.15.96:0/1267966478 wait complete. 2022-02-02T20:51:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:51:09.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:09 smithi096 ceph-mon[101353]: from='client.38696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:09.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1998156473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:51:09.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1267966478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:51:09.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:09 smithi159 ceph-mon[69013]: from='client.38696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:09.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1998156473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:51:09.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1267966478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:51:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:10 smithi096 ceph-mon[101353]: pgmap v4472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:10 smithi159 ceph-mon[69013]: pgmap v4472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:12 smithi159 ceph-mon[69013]: pgmap v4473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:12 smithi096 ceph-mon[101353]: pgmap v4473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:14 smithi159 ceph-mon[69013]: pgmap v4474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:14 smithi096 ceph-mon[101353]: pgmap v4474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:16 smithi159 ceph-mon[69013]: pgmap v4475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:16 smithi096 ceph-mon[101353]: pgmap v4475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:18 smithi096 ceph-mon[101353]: pgmap v4476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:18 smithi159 ceph-mon[69013]: pgmap v4476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:20 smithi159 ceph-mon[69013]: pgmap v4477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:20 smithi096 ceph-mon[101353]: pgmap v4477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:22 smithi159 ceph-mon[69013]: pgmap v4478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:22 smithi096 ceph-mon[101353]: pgmap v4478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:24 smithi159 ceph-mon[69013]: pgmap v4479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:24 smithi096 ceph-mon[101353]: pgmap v4479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:26 smithi159 ceph-mon[69013]: pgmap v4480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:26 smithi096 ceph-mon[101353]: pgmap v4480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:51:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:51:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:28 smithi096 ceph-mon[101353]: pgmap v4481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:51:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:51:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:28 smithi159 ceph-mon[69013]: pgmap v4481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:30 smithi159 ceph-mon[69013]: pgmap v4482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:30 smithi096 ceph-mon[101353]: pgmap v4482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:32 smithi159 ceph-mon[69013]: pgmap v4483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:32 smithi096 ceph-mon[101353]: pgmap v4483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:34 smithi159 ceph-mon[69013]: pgmap v4484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:34 smithi096 ceph-mon[101353]: pgmap v4484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:36 smithi159 ceph-mon[69013]: pgmap v4485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:36 smithi096 ceph-mon[101353]: pgmap v4485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:38.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:38 smithi096 ceph-mon[101353]: pgmap v4486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:38 smithi159 ceph-mon[69013]: pgmap v4486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 -- 172.21.15.96:0/1644037816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 msgr2=0x7fca7c0f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 --2- 172.21.15.96:0/1644037816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c0f5fd0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 rx=0x7fca70004660 tx=0x7fca70009b30).stop 2022-02-02T20:51:38.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 -- 172.21.15.96:0/1644037816 shutdown_connections 2022-02-02T20:51:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 --2- 172.21.15.96:0/1644037816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 0x7fca7c0f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 --2- 172.21.15.96:0/1644037816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c0f5fd0 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 -- 172.21.15.96:0/1644037816 >> 172.21.15.96:0/1644037816 conn(0x7fca7c0f04c0 msgr2=0x7fca7c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:38.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 -- 172.21.15.96:0/1644037816 shutdown_connections 2022-02-02T20:51:38.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.741+0000 7fca82f7b700 1 -- 172.21.15.96:0/1644037816 wait complete. 2022-02-02T20:51:38.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 Processor -- start 2022-02-02T20:51:38.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 -- start start 2022-02-02T20:51:38.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:38.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 0x7fca7c10c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:38.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0f56a0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca82f7b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0f57e0 con 0x7fca7c0f6550 2022-02-02T20:51:38.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca80d17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:38.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca80d17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39460/0 (socket says 172.21.15.96:39460) 2022-02-02T20:51:38.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.742+0000 7fca80d17700 1 -- 172.21.15.96:0/318446301 learned_addr learned my addr 172.21.15.96:0/318446301 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:38.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca7bfff700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 0x7fca7c10c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:38.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca80d17700 1 -- 172.21.15.96:0/318446301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 msgr2=0x7fca7c10c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca80d17700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 0x7fca7c10c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca80d17700 1 -- 172.21.15.96:0/318446301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70005040 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca80d17700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7fca700043a0 tx=0x7fca70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca70018070 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c10c790 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fca70007ba0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca7001de30 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.743+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c10ccf0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.744+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c045ad0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.745+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fca7001d420 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.745+0000 7fca797fa700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 0x7fca6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:38.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.745+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fca700836d0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.745+0000 7fca7bfff700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 0x7fca6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.746+0000 7fca7bfff700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 0x7fca6c067290 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fca68004c40 tx=0x7fca6800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.750+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fca700517d0 con 0x7fca7c0f5bb0 2022-02-02T20:51:38.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.928+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca7c057f10 con 0x7fca6c064dd0 2022-02-02T20:51:38.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.929+0000 7fca797fa700 1 -- 172.21.15.96:0/318446301 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fca7c057f10 con 0x7fca6c064dd0 2022-02-02T20:51:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 msgr2=0x7fca6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 0x7fca6c067290 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fca68004c40 tx=0x7fca6800b040).stop 2022-02-02T20:51:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 msgr2=0x7fca7c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7fca700043a0 tx=0x7fca70009b30).stop 2022-02-02T20:51:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 shutdown_connections 2022-02-02T20:51:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fca6c064dd0 0x7fca6c067290 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca7c0f5bb0 0x7fca7c109d40 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 --2- 172.21.15.96:0/318446301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7c0f6550 0x7fca7c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 >> 172.21.15.96:0/318446301 conn(0x7fca7c0f04c0 msgr2=0x7fca7c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 shutdown_connections 2022-02-02T20:51:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:38.931+0000 7fca82f7b700 1 -- 172.21.15.96:0/318446301 wait complete. 2022-02-02T20:51:38.942 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:51:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.028+0000 7f5e46b23700 1 -- 172.21.15.96:0/3173077505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f6860 msgr2=0x7f5e400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.028+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3173077505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f6860 0x7f5e400f6cc0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 rx=0x7f5e2c004660 tx=0x7f5e2c009b30).stop 2022-02-02T20:51:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.028+0000 7f5e46b23700 1 -- 172.21.15.96:0/3173077505 shutdown_connections 2022-02-02T20:51:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.029+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3173077505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f6860 0x7f5e400f6cc0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.029+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3173077505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f55c0 0x7f5e400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.029+0000 7f5e46b23700 1 -- 172.21.15.96:0/3173077505 >> 172.21.15.96:0/3173077505 conn(0x7f5e400f0d40 msgr2=0x7f5e400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.029+0000 7f5e46b23700 1 -- 172.21.15.96:0/3173077505 shutdown_connections 2022-02-02T20:51:39.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.029+0000 7f5e46b23700 1 -- 172.21.15.96:0/3173077505 wait complete. 2022-02-02T20:51:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 Processor -- start 2022-02-02T20:51:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 -- start start 2022-02-02T20:51:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f6860 0x7f5e40107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40107a10 con 0x7f5e400f55c0 2022-02-02T20:51:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e46b23700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40107b50 con 0x7f5e400f6860 2022-02-02T20:51:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e448bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e448bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39470/0 (socket says 172.21.15.96:39470) 2022-02-02T20:51:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e448bf700 1 -- 172.21.15.96:0/3378225760 learned_addr learned my addr 172.21.15.96:0/3378225760 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:39.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.030+0000 7f5e3ffff700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f6860 0x7f5e40107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e448bf700 1 -- 172.21.15.96:0/3378225760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f6860 msgr2=0x7f5e40107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e448bf700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f6860 0x7f5e40107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e448bf700 1 -- 172.21.15.96:0/3378225760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c005040 con 0x7f5e400f55c0 2022-02-02T20:51:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e448bf700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 rx=0x7f5e34002700 tx=0x7f5e34009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e340079c0 con 0x7f5e400f55c0 2022-02-02T20:51:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e3400f040 con 0x7f5e400f55c0 2022-02-02T20:51:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401084f0 con 0x7f5e400f55c0 2022-02-02T20:51:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e34014860 con 0x7f5e400f55c0 2022-02-02T20:51:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.031+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40108ab0 con 0x7f5e400f55c0 2022-02-02T20:51:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.032+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40045ad0 con 0x7f5e400f55c0 2022-02-02T20:51:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.032+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e3401b060 con 0x7f5e400f55c0 2022-02-02T20:51:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.032+0000 7f5e3d7fa700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 0x7f5e30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.033+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5e340818e0 con 0x7f5e400f55c0 2022-02-02T20:51:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.033+0000 7f5e3ffff700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 0x7f5e30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.033+0000 7f5e3ffff700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 0x7f5e30067290 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f5e2c004630 tx=0x7f5e2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.037+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e34053410 con 0x7f5e400f55c0 2022-02-02T20:51:39.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.211+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e400faca0 con 0x7f5e30064dd0 2022-02-02T20:51:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.220+0000 7f5e3d7fa700 1 -- 172.21.15.96:0/3378225760 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5e400faca0 con 0x7f5e30064dd0 2022-02-02T20:51:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:51:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:51:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:51:39.223 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:51:39.223 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:51:39.223 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:51:39.223 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:51:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:51:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:51:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:51:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:51:39.225 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:51:39.225 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:51:39.225 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:51:39.225 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:51:39.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:51:39.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:51:39.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:51:39.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:51:39.227 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:51:39.227 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:51:39.227 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:51:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 msgr2=0x7f5e30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 0x7f5e30067290 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f5e2c004630 tx=0x7f5e2c009b30).stop 2022-02-02T20:51:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 msgr2=0x7f5e40106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 rx=0x7f5e34002700 tx=0x7f5e34009d80).stop 2022-02-02T20:51:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 shutdown_connections 2022-02-02T20:51:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5e30064dd0 0x7f5e30067290 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e400f55c0 0x7f5e40106f70 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 --2- 172.21.15.96:0/3378225760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e400f6860 0x7f5e40107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 >> 172.21.15.96:0/3378225760 conn(0x7f5e400f0d40 msgr2=0x7f5e4005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 shutdown_connections 2022-02-02T20:51:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.222+0000 7f5e46b23700 1 -- 172.21.15.96:0/3378225760 wait complete. 2022-02-02T20:51:39.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 -- 172.21.15.96:0/4113815754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f55c0 msgr2=0x7f91140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 --2- 172.21.15.96:0/4113815754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f55c0 0x7f91140f59e0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 rx=0x7f9108004660 tx=0x7f9108009b30).stop 2022-02-02T20:51:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 -- 172.21.15.96:0/4113815754 shutdown_connections 2022-02-02T20:51:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 --2- 172.21.15.96:0/4113815754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f6860 0x7f91140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 --2- 172.21.15.96:0/4113815754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f55c0 0x7f91140f59e0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 -- 172.21.15.96:0/4113815754 >> 172.21.15.96:0/4113815754 conn(0x7f91140f0d40 msgr2=0x7f91140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 -- 172.21.15.96:0/4113815754 shutdown_connections 2022-02-02T20:51:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.319+0000 7f911885b700 1 -- 172.21.15.96:0/4113815754 wait complete. 2022-02-02T20:51:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 Processor -- start 2022-02-02T20:51:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 -- start start 2022-02-02T20:51:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f55c0 0x7f9114105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114106910 con 0x7f91140f6860 2022-02-02T20:51:39.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911885b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114106a50 con 0x7f91140f55c0 2022-02-02T20:51:39.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39482/0 (socket says 172.21.15.96:39482) 2022-02-02T20:51:39.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 -- 172.21.15.96:0/4119074900 learned_addr learned my addr 172.21.15.96:0/4119074900 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:39.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f911259c700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f55c0 0x7f9114105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 -- 172.21.15.96:0/4119074900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f55c0 msgr2=0x7f9114105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f55c0 0x7f9114105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.320+0000 7f9111d9b700 1 -- 172.21.15.96:0/4119074900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108005040 con 0x7f91140f6860 2022-02-02T20:51:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f9111d9b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7f910400e9a0 tx=0x7f9104007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910400cb90 con 0x7f91140f6860 2022-02-02T20:51:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91141073f0 con 0x7f91140f6860 2022-02-02T20:51:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f910400ccf0 con 0x7f91140f6860 2022-02-02T20:51:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91040106c0 con 0x7f91140f6860 2022-02-02T20:51:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.321+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91141079b0 con 0x7f91140f6860 2022-02-02T20:51:39.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.322+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9114045ad0 con 0x7f91140f6860 2022-02-02T20:51:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.322+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9104010930 con 0x7f91140f6860 2022-02-02T20:51:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.323+0000 7f9102ffd700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.323+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9104084ba0 con 0x7f91140f6860 2022-02-02T20:51:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.323+0000 7f911259c700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.323+0000 7f911259c700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f9108004e30 tx=0x7f9108009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.327+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f91040566d0 con 0x7f91140f6860 2022-02-02T20:51:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.555+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9114107ff0 con 0x7f91140f6860 2022-02-02T20:51:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.556+0000 7f9102ffd700 1 -- 172.21.15.96:0/4119074900 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f91040562c0 con 0x7f91140f6860 2022-02-02T20:51:39.557 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:51:39.558 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:51:39.558 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:51:39.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:39.558 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:51:39.559 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:51:39.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:39.559 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:51:39.559 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:51:39.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:39.560 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:51:39.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:51:39.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:51:39.561 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:51:39.561 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:51:39.561 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:51:39.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:51:39.561 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:51:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 msgr2=0x7f90fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f9108004e30 tx=0x7f9108009b30).stop 2022-02-02T20:51:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 msgr2=0x7f9114106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7f910400e9a0 tx=0x7f9104007e00).stop 2022-02-02T20:51:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 shutdown_connections 2022-02-02T20:51:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f90fc064dd0 0x7f90fc067290 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91140f55c0 0x7f9114105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 --2- 172.21.15.96:0/4119074900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91140f6860 0x7f9114106360 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 >> 172.21.15.96:0/4119074900 conn(0x7f91140f0d40 msgr2=0x7f91140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.558+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 shutdown_connections 2022-02-02T20:51:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.559+0000 7f911885b700 1 -- 172.21.15.96:0/4119074900 wait complete. 2022-02-02T20:51:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2223199989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 msgr2=0x7f7ab40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2223199989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab40f59e0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 rx=0x7f7aa8004660 tx=0x7f7aa8009b30).stop 2022-02-02T20:51:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2223199989 shutdown_connections 2022-02-02T20:51:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2223199989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 0x7f7ab40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2223199989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab40f59e0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2223199989 >> 172.21.15.96:0/2223199989 conn(0x7f7ab40f0d40 msgr2=0x7f7ab40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2223199989 shutdown_connections 2022-02-02T20:51:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.658+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2223199989 wait complete. 2022-02-02T20:51:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 Processor -- start 2022-02-02T20:51:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 -- start start 2022-02-02T20:51:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 0x7f7ab4106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4106940 con 0x7f7ab40f55c0 2022-02-02T20:51:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab93b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4107140 con 0x7f7ab40f6860 2022-02-02T20:51:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39490/0 (socket says 172.21.15.96:39490) 2022-02-02T20:51:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab2ffd700 1 -- 172.21.15.96:0/2926561607 learned_addr learned my addr 172.21.15.96:0/2926561607 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:51:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.659+0000 7f7ab27fc700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 0x7f7ab4106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab2ffd700 1 -- 172.21.15.96:0/2926561607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 msgr2=0x7f7ab4106390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab2ffd700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 0x7f7ab4106390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab2ffd700 1 -- 172.21.15.96:0/2926561607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8005040 con 0x7f7ab40f55c0 2022-02-02T20:51:39.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab2ffd700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7f7aa8000c00 tx=0x7f7aa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa8018070 con 0x7f7ab40f55c0 2022-02-02T20:51:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7aa8007d70 con 0x7f7ab40f55c0 2022-02-02T20:51:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab41073c0 con 0x7f7ab40f55c0 2022-02-02T20:51:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa801c620 con 0x7f7ab40f55c0 2022-02-02T20:51:39.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.660+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4107920 con 0x7f7ab40f55c0 2022-02-02T20:51:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.661+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40f49b0 con 0x7f7ab40f55c0 2022-02-02T20:51:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.661+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7aa801c860 con 0x7f7ab40f55c0 2022-02-02T20:51:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.662+0000 7f7a9b7fe700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 0x7f7a9c0672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:51:39.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.662+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7aa80839c0 con 0x7f7ab40f55c0 2022-02-02T20:51:39.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.662+0000 7f7ab27fc700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 0x7f7a9c0672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:51:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.662+0000 7f7ab27fc700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 0x7f7a9c0672d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f7aa40041d0 tx=0x7f7aa4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:51:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.666+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7aa80554f0 con 0x7f7ab40f55c0 2022-02-02T20:51:39.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.867+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ab40ff790 con 0x7f7ab40f55c0 2022-02-02T20:51:39.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4119074900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:51:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.867+0000 7f7a9b7fe700 1 -- 172.21.15.96:0/2926561607 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7aa80550e0 con 0x7f7ab40f55c0 2022-02-02T20:51:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:51:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:51:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:51:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:51:39.871 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:51:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:51:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:51:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:51:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:51:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:51:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:51:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:51:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:51:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:51:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:51:39.874 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:51:39.874 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:51:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:51:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:51:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:51:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:51:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:51:39.876 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:51:39.876 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:51:39.876 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:51:39.876 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:51:39.877 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:51:39.877 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:51:39.878 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:51:39.878 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:51:39.879 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:51:39.879 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:39.879 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:39.879 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:51:39.879 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:51:39.880 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:39.880 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:39.880 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:51:39.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 msgr2=0x7f7a9c0672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 0x7f7a9c0672d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f7aa40041d0 tx=0x7f7aa4009040).stop 2022-02-02T20:51:39.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 msgr2=0x7f7ab4105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:51:39.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7f7aa8000c00 tx=0x7f7aa8009b30).stop 2022-02-02T20:51:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 shutdown_connections 2022-02-02T20:51:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a9c064e10 0x7f7a9c0672d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab40f55c0 0x7f7ab4105ea0 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 --2- 172.21.15.96:0/2926561607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ab40f6860 0x7f7ab4106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:51:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 >> 172.21.15.96:0/2926561607 conn(0x7f7ab40f0d40 msgr2=0x7f7ab40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:51:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 shutdown_connections 2022-02-02T20:51:39.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:51:39.869+0000 7f7ab93b8700 1 -- 172.21.15.96:0/2926561607 wait complete. 2022-02-02T20:51:39.894 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:51:40.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4119074900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:51:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:40 smithi159 ceph-mon[69013]: from='client.38708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:40 smithi159 ceph-mon[69013]: from='client.38712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:40 smithi159 ceph-mon[69013]: pgmap v4487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:41.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2926561607' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:51:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:40 smithi096 ceph-mon[101353]: from='client.38708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:40 smithi096 ceph-mon[101353]: from='client.38712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:51:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:40 smithi096 ceph-mon[101353]: pgmap v4487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:41.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2926561607' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:51:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:42 smithi159 ceph-mon[69013]: pgmap v4488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:42 smithi096 ceph-mon[101353]: pgmap v4488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:44 smithi159 ceph-mon[69013]: pgmap v4489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:45.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:44 smithi096 ceph-mon[101353]: pgmap v4489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:46 smithi159 ceph-mon[69013]: pgmap v4490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:46 smithi096 ceph-mon[101353]: pgmap v4490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:48 smithi096 ceph-mon[101353]: pgmap v4491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:48 smithi159 ceph-mon[69013]: pgmap v4491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:50 smithi159 ceph-mon[69013]: pgmap v4492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:50 smithi096 ceph-mon[101353]: pgmap v4492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:52 smithi159 ceph-mon[69013]: pgmap v4493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:52 smithi096 ceph-mon[101353]: pgmap v4493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:54 smithi159 ceph-mon[69013]: pgmap v4494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:54 smithi096 ceph-mon[101353]: pgmap v4494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:56 smithi159 ceph-mon[69013]: pgmap v4495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:56 smithi096 ceph-mon[101353]: pgmap v4495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:51:58 smithi096 ceph-mon[101353]: pgmap v4496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:51:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:51:58 smithi159 ceph-mon[69013]: pgmap v4496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:00 smithi159 ceph-mon[69013]: pgmap v4497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:00 smithi096 ceph-mon[101353]: pgmap v4497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:02 smithi159 ceph-mon[69013]: pgmap v4498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:02 smithi096 ceph-mon[101353]: pgmap v4498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:04 smithi159 ceph-mon[69013]: pgmap v4499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:04 smithi096 ceph-mon[101353]: pgmap v4499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:06 smithi159 ceph-mon[69013]: pgmap v4500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:06 smithi096 ceph-mon[101353]: pgmap v4500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:08 smithi159 ceph-mon[69013]: pgmap v4501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:08 smithi096 ceph-mon[101353]: pgmap v4501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:09.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 -- 172.21.15.96:0/4189884470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c0f9690 msgr2=0x7fd78c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:09.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 --2- 172.21.15.96:0/4189884470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c0f9690 0x7fd78c0fbae0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 rx=0x7fd77c004660 tx=0x7fd77c009b30).stop 2022-02-02T20:52:09.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 -- 172.21.15.96:0/4189884470 shutdown_connections 2022-02-02T20:52:09.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 --2- 172.21.15.96:0/4189884470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c0f9690 0x7fd78c0fbae0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:09.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 --2- 172.21.15.96:0/4189884470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c060310 0x7fd78c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:09.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 -- 172.21.15.96:0/4189884470 >> 172.21.15.96:0/4189884470 conn(0x7fd78c0f0b90 msgr2=0x7fd78c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 -- 172.21.15.96:0/4189884470 shutdown_connections 2022-02-02T20:52:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 -- 172.21.15.96:0/4189884470 wait complete. 2022-02-02T20:52:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.979+0000 7fd790fde700 1 Processor -- start 2022-02-02T20:52:09.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd790fde700 1 -- start start 2022-02-02T20:52:09.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd790fde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:09.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd790fde700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c0f9690 0x7fd78c107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:09.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd790fde700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c107890 con 0x7fd78c060310 2022-02-02T20:52:09.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd790fde700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1080d0 con 0x7fd78c0f9690 2022-02-02T20:52:09.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:09.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39508/0 (socket says 172.21.15.96:39508) 2022-02-02T20:52:09.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 -- 172.21.15.96:0/3620672785 learned_addr learned my addr 172.21.15.96:0/3620672785 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:09.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78affd700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c0f9690 0x7fd78c107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:09.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 -- 172.21.15.96:0/3620672785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c0f9690 msgr2=0x7fd78c107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:09.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c0f9690 0x7fd78c107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:09.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.980+0000 7fd78b7fe700 1 -- 172.21.15.96:0/3620672785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c005040 con 0x7fd78c060310 2022-02-02T20:52:09.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd78b7fe700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 rx=0x7fd77400c530 tx=0x7fd774007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:09.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77400f650 con 0x7fd78c060310 2022-02-02T20:52:09.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd77400fc60 con 0x7fd78c060310 2022-02-02T20:52:09.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c1083b0 con 0x7fd78c060310 2022-02-02T20:52:09.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd774012c20 con 0x7fd78c060310 2022-02-02T20:52:09.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.981+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c1088f0 con 0x7fd78c060310 2022-02-02T20:52:09.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.982+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c059100 con 0x7fd78c060310 2022-02-02T20:52:09.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.982+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd774010070 con 0x7fd78c060310 2022-02-02T20:52:09.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.983+0000 7fd783fff700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 0x7fd7780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:09.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.983+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7740816b0 con 0x7fd78c060310 2022-02-02T20:52:09.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.983+0000 7fd78affd700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 0x7fd7780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:09.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.983+0000 7fd78affd700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 0x7fd7780672e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fd78c106b30 tx=0x7fd77c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:09.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:09.987+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd77404f7b0 con 0x7fd78c060310 2022-02-02T20:52:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.165+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd78c0fee70 con 0x7fd778064e20 2022-02-02T20:52:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.166+0000 7fd783fff700 1 -- 172.21.15.96:0/3620672785 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd78c0fee70 con 0x7fd778064e20 2022-02-02T20:52:10.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 msgr2=0x7fd7780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 0x7fd7780672e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fd78c106b30 tx=0x7fd77c009b30).stop 2022-02-02T20:52:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 msgr2=0x7fd78c106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 rx=0x7fd77400c530 tx=0x7fd774007e20).stop 2022-02-02T20:52:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 shutdown_connections 2022-02-02T20:52:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064e20 0x7fd7780672e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd78c060310 0x7fd78c106da0 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 --2- 172.21.15.96:0/3620672785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd78c0f9690 0x7fd78c107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 >> 172.21.15.96:0/3620672785 conn(0x7fd78c0f0b90 msgr2=0x7fd78c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 shutdown_connections 2022-02-02T20:52:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.168+0000 7fd790fde700 1 -- 172.21.15.96:0/3620672785 wait complete. 2022-02-02T20:52:10.180 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:52:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 -- 172.21.15.96:0/16810341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f7980 msgr2=0x7f86880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 --2- 172.21.15.96:0/16810341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f7980 0x7f86880f7de0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 rx=0x7f8670004660 tx=0x7f8670009b30).stop 2022-02-02T20:52:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 -- 172.21.15.96:0/16810341 shutdown_connections 2022-02-02T20:52:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 --2- 172.21.15.96:0/16810341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f7980 0x7f86880f7de0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 --2- 172.21.15.96:0/16810341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f66e0 0x7f86880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 -- 172.21.15.96:0/16810341 >> 172.21.15.96:0/16810341 conn(0x7f86880f1e40 msgr2=0x7f86880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.266+0000 7f868e49b700 1 -- 172.21.15.96:0/16810341 shutdown_connections 2022-02-02T20:52:10.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 -- 172.21.15.96:0/16810341 wait complete. 2022-02-02T20:52:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 Processor -- start 2022-02-02T20:52:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 -- start start 2022-02-02T20:52:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 0x7f8688069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868806a380 con 0x7f86880f66e0 2022-02-02T20:52:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.267+0000 7f868e49b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868806a4c0 con 0x7f86880f7980 2022-02-02T20:52:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39518/0 (socket says 172.21.15.96:39518) 2022-02-02T20:52:10.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 -- 172.21.15.96:0/2898000776 learned_addr learned my addr 172.21.15.96:0/2898000776 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f86877fe700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 0x7f8688069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 -- 172.21.15.96:0/2898000776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 msgr2=0x7f8688069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 0x7f8688069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 -- 172.21.15.96:0/2898000776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670005040 con 0x7f86880f66e0 2022-02-02T20:52:10.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f86877fe700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 0x7f8688069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:52:10.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8687fff700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f867800c530 tx=0x7f8678007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867800f650 con 0x7f86880f66e0 2022-02-02T20:52:10.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f867800fc60 con 0x7f86880f66e0 2022-02-02T20:52:10.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868806a7a0 con 0x7f86880f66e0 2022-02-02T20:52:10.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8678012d20 con 0x7f86880f66e0 2022-02-02T20:52:10.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.268+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868810ef90 con 0x7f86880f66e0 2022-02-02T20:52:10.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.269+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688045ad0 con 0x7f86880f66e0 2022-02-02T20:52:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.270+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8678019030 con 0x7f86880f66e0 2022-02-02T20:52:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.270+0000 7f8684ff9700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 0x7f8674067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.270+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8678081700 con 0x7f86880f66e0 2022-02-02T20:52:10.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.270+0000 7f86877fe700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 0x7f8674067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.270+0000 7f86877fe700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 0x7f8674067290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8670009da0 tx=0x7f8670009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.274+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f867804f8b0 con 0x7f86880f66e0 2022-02-02T20:52:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.449+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86880ff020 con 0x7f8674064dd0 2022-02-02T20:52:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.458+0000 7f8684ff9700 1 -- 172.21.15.96:0/2898000776 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f86880ff020 con 0x7f8674064dd0 2022-02-02T20:52:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:52:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:52:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:52:10.462 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:52:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:52:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:52:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:52:10.463 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:52:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:52:10.464 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:52:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:52:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:52:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:52:10.466 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:52:10.466 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:52:10.467 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:52:10.467 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:52:10.468 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:52:10.468 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:52:10.468 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:52:10.469 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:52:10.469 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:52:10.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 msgr2=0x7f8674067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 0x7f8674067290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8670009da0 tx=0x7f8670009b30).stop 2022-02-02T20:52:10.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 msgr2=0x7f868806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f867800c530 tx=0x7f8678007e10).stop 2022-02-02T20:52:10.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 shutdown_connections 2022-02-02T20:52:10.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8674064dd0 0x7f8674067290 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86880f66e0 0x7f868806b9a0 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 --2- 172.21.15.96:0/2898000776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86880f7980 0x7f8688069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 >> 172.21.15.96:0/2898000776 conn(0x7f86880f1e40 msgr2=0x7f86880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 shutdown_connections 2022-02-02T20:52:10.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.460+0000 7f868e49b700 1 -- 172.21.15.96:0/2898000776 wait complete. 2022-02-02T20:52:10.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 -- 172.21.15.96:0/950876494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 msgr2=0x7fa8ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/950876494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac0f59e0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 rx=0x7fa89c004660 tx=0x7fa89c009b30).stop 2022-02-02T20:52:10.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 -- 172.21.15.96:0/950876494 shutdown_connections 2022-02-02T20:52:10.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/950876494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 0x7fa8ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:52:10.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/950876494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac0f59e0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 -- 172.21.15.96:0/950876494 >> 172.21.15.96:0/950876494 conn(0x7fa8ac0f0d40 msgr2=0x7fa8ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 -- 172.21.15.96:0/950876494 shutdown_connections 2022-02-02T20:52:10.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.556+0000 7fa8b0afc700 1 -- 172.21.15.96:0/950876494 wait complete. 2022-02-02T20:52:10.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 Processor -- start 2022-02-02T20:52:10.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 -- start start 2022-02-02T20:52:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 0x7fa8ac10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0602b0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8b0afc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0603f0 con 0x7fa8ac0f6860 2022-02-02T20:52:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39528/0 (socket says 172.21.15.96:39528) 2022-02-02T20:52:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8aa59c700 1 -- 172.21.15.96:0/81774178 learned_addr learned my addr 172.21.15.96:0/81774178 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.557+0000 7fa8a9d9b700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 0x7fa8ac10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8aa59c700 1 -- 172.21.15.96:0/81774178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 msgr2=0x7fa8ac10e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8aa59c700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 0x7fa8ac10e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8aa59c700 1 -- 172.21.15.96:0/81774178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c005040 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8aa59c700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7fa89c004f60 tx=0x7fa89c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c018070 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac10ead0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa89c007ba0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c01c620 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.558+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac10eef0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.559+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac045ad0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.559+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa89c01c8e0 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.560+0000 7fa89affd700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 0x7fa894067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.560+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa89c083960 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.560+0000 7fa8a9d9b700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 0x7fa894067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.560+0000 7fa8a9d9b700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 0x7fa894067290 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fa8a000b790 tx=0x7fa8a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.564+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa89c051a60 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.797+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8ac027a00 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.797+0000 7fa89affd700 1 -- 172.21.15.96:0/81774178 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa89c055080 con 0x7fa8ac0f55c0 2022-02-02T20:52:10.800 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:52:10.800 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:52:10.800 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:52:10.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:10.801 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:52:10.801 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:52:10.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:10.802 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:52:10.802 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:52:10.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:10.802 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:52:10.802 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:52:10.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:10.803 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:52:10.803 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:52:10.803 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:52:10.804 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:52:10.804 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:52:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 msgr2=0x7fa894067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 0x7fa894067290 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fa8a000b790 tx=0x7fa8a0008040).stop 2022-02-02T20:52:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 msgr2=0x7fa8ac10c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7fa89c004f60 tx=0x7fa89c009b30).stop 2022-02-02T20:52:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 shutdown_connections 2022-02-02T20:52:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064dd0 0x7fa894067290 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8ac0f55c0 0x7fa8ac10c0e0 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 --2- 172.21.15.96:0/81774178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8ac0f6860 0x7fa8ac10e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 >> 172.21.15.96:0/81774178 conn(0x7fa8ac0f0d40 msgr2=0x7fa8ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 shutdown_connections 2022-02-02T20:52:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.799+0000 7fa8b0afc700 1 -- 172.21.15.96:0/81774178 wait complete. 2022-02-02T20:52:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 -- 172.21.15.96:0/21463477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 msgr2=0x7f0bdc0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 --2- 172.21.15.96:0/21463477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc0f5930 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 rx=0x7f0bcc004660 tx=0x7f0bcc009b30).stop 2022-02-02T20:52:10.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 -- 172.21.15.96:0/21463477 shutdown_connections 2022-02-02T20:52:10.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 --2- 172.21.15.96:0/21463477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc0f5930 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 --2- 172.21.15.96:0/21463477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 0x7f0bdc0f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:52:10.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.896+0000 7f0be3b40700 1 -- 172.21.15.96:0/21463477 >> 172.21.15.96:0/21463477 conn(0x7f0bdc0f0540 msgr2=0x7f0bdc0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:10.900 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:10 smithi096 ceph-mon[101353]: pgmap v4502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.897+0000 7f0be3b40700 1 -- 172.21.15.96:0/21463477 shutdown_connections 2022-02-02T20:52:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.897+0000 7f0be3b40700 1 -- 172.21.15.96:0/21463477 wait complete. 2022-02-02T20:52:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.897+0000 7f0be3b40700 1 Processor -- start 2022-02-02T20:52:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.897+0000 7f0be3b40700 1 -- start start 2022-02-02T20:52:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be3b40700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 0x7f0bdc105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be3b40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be3b40700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1069a0 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be3b40700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc107250 con 0x7f0bdc0f6b90 2022-02-02T20:52:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39540/0 (socket says 172.21.15.96:39540) 2022-02-02T20:52:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 -- 172.21.15.96:0/4172131320 learned_addr learned my addr 172.21.15.96:0/4172131320 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be18dc700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 0x7f0bdc105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 -- 172.21.15.96:0/4172131320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 msgr2=0x7f0bdc105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 0x7f0bdc105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 -- 172.21.15.96:0/4172131320 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc005040 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be10db700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 rx=0x7f0bcc009990 tx=0x7f0bcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bcc018070 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0bcc007ca0 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc1074d0 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.898+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bcc01c620 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.899+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc107a30 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.899+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0f41d0 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.900+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0bcc01d960 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.900+0000 7f0bd27fc700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 0x7f0bc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.900+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0bcc0837e0 con 0x7f0bdc0f74a0 2022-02-02T20:52:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.900+0000 7f0be18dc700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 0x7f0bc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.901+0000 7f0be18dc700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 0x7f0bc8067290 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0bdc05f250 tx=0x7f0bd8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:10.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:10.905+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0bcc0553d0 con 0x7f0bdc0f74a0 2022-02-02T20:52:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:10 smithi159 ceph-mon[69013]: pgmap v4502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:11.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.108+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0bdc045ad0 con 0x7f0bdc0f74a0 2022-02-02T20:52:11.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.108+0000 7f0bd27fc700 1 -- 172.21.15.96:0/4172131320 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0bcc054fc0 con 0x7f0bdc0f74a0 2022-02-02T20:52:11.111 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:52:11.112 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:52:11.112 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:52:11.112 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:52:11.112 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:11.113 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:52:11.113 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:52:11.113 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:52:11.113 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:52:11.114 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:52:11.114 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:52:11.114 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:52:11.114 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:52:11.115 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:52:11.115 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:52:11.115 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:52:11.115 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:52:11.115 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:52:11.116 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:52:11.116 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:52:11.116 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:52:11.116 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:52:11.117 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:52:11.117 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:52:11.117 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:52:11.117 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:52:11.118 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:52:11.118 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:52:11.118 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:52:11.118 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:52:11.119 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:52:11.119 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:52:11.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:11.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:11.120 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:52:11.120 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:11.120 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:11.120 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:11.121 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:11.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 msgr2=0x7f0bc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:11.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 0x7f0bc8067290 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0bdc05f250 tx=0x7f0bd8008040).stop 2022-02-02T20:52:11.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 msgr2=0x7f0bdc106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:11.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 rx=0x7f0bcc009990 tx=0x7f0bcc009b30).stop 2022-02-02T20:52:11.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 shutdown_connections 2022-02-02T20:52:11.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0bc8064dd0 0x7f0bc8067290 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:11.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bdc0f6b90 0x7f0bdc105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:11.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 --2- 172.21.15.96:0/4172131320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bdc0f74a0 0x7f0bdc106360 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:11.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 >> 172.21.15.96:0/4172131320 conn(0x7f0bdc0f0540 msgr2=0x7f0bdc0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:11.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 shutdown_connections 2022-02-02T20:52:11.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:11.110+0000 7f0be3b40700 1 -- 172.21.15.96:0/4172131320 wait complete. 2022-02-02T20:52:11.124 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:52:12.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:11 smithi159 ceph-mon[69013]: from='client.38724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:12.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:11 smithi159 ceph-mon[69013]: from='client.38728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:12.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/81774178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:52:12.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4172131320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:52:12.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:11 smithi096 ceph-mon[101353]: from='client.38724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:12.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:11 smithi096 ceph-mon[101353]: from='client.38728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:12.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/81774178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:52:12.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4172131320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:52:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:12 smithi159 ceph-mon[69013]: pgmap v4503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:12 smithi096 ceph-mon[101353]: pgmap v4503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:14 smithi159 ceph-mon[69013]: pgmap v4504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:14 smithi096 ceph-mon[101353]: pgmap v4504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:16 smithi159 ceph-mon[69013]: pgmap v4505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:16 smithi096 ceph-mon[101353]: pgmap v4505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:18 smithi159 ceph-mon[69013]: pgmap v4506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:18 smithi096 ceph-mon[101353]: pgmap v4506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:20 smithi159 ceph-mon[69013]: pgmap v4507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:20 smithi096 ceph-mon[101353]: pgmap v4507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:22 smithi159 ceph-mon[69013]: pgmap v4508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:22 smithi096 ceph-mon[101353]: pgmap v4508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:24 smithi159 ceph-mon[69013]: pgmap v4509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:24 smithi096 ceph-mon[101353]: pgmap v4509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:26 smithi159 ceph-mon[69013]: pgmap v4510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:26 smithi096 ceph-mon[101353]: pgmap v4510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:52:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:52:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:28 smithi159 ceph-mon[69013]: pgmap v4511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:52:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:52:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:28 smithi096 ceph-mon[101353]: pgmap v4511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:30 smithi159 ceph-mon[69013]: pgmap v4512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:30 smithi096 ceph-mon[101353]: pgmap v4512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:32 smithi159 ceph-mon[69013]: pgmap v4513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:32 smithi096 ceph-mon[101353]: pgmap v4513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:34 smithi159 ceph-mon[69013]: pgmap v4514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:34 smithi096 ceph-mon[101353]: pgmap v4514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:36 smithi159 ceph-mon[69013]: pgmap v4515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:36 smithi096 ceph-mon[101353]: pgmap v4515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:38 smithi159 ceph-mon[69013]: pgmap v4516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:38 smithi096 ceph-mon[101353]: pgmap v4516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:40 smithi159 ceph-mon[69013]: pgmap v4517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:40 smithi096 ceph-mon[101353]: pgmap v4517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:41.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 -- 172.21.15.96:0/1636039803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 msgr2=0x7fe4d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/1636039803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d80f59e0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 rx=0x7fe4c0004660 tx=0x7fe4c0009b30).stop 2022-02-02T20:52:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 -- 172.21.15.96:0/1636039803 shutdown_connections 2022-02-02T20:52:41.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/1636039803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/1636039803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d80f59e0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 -- 172.21.15.96:0/1636039803 >> 172.21.15.96:0/1636039803 conn(0x7fe4d80f0d40 msgr2=0x7fe4d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.221+0000 7fe4dcf74700 1 -- 172.21.15.96:0/1636039803 shutdown_connections 2022-02-02T20:52:41.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.222+0000 7fe4dcf74700 1 -- 172.21.15.96:0/1636039803 wait complete. 2022-02-02T20:52:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.222+0000 7fe4dcf74700 1 Processor -- start 2022-02-02T20:52:41.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.222+0000 7fe4dcf74700 1 -- start start 2022-02-02T20:52:41.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4dcf74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4dcf74700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d81051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4dcf74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d81057f0 con 0x7fe4d80f55c0 2022-02-02T20:52:41.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4dcf74700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8105930 con 0x7fe4d80f6860 2022-02-02T20:52:41.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d5d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d81051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39558/0 (socket says 172.21.15.96:39558) 2022-02-02T20:52:41.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d5d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d81051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:43664/0 (socket says 172.21.15.96:43664) 2022-02-02T20:52:41.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 -- 172.21.15.96:0/339420848 learned_addr learned my addr 172.21.15.96:0/339420848 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:41.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 -- 172.21.15.96:0/339420848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 msgr2=0x7fe4d81051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d81051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 -- 172.21.15.96:0/339420848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0005040 con 0x7fe4d80f55c0 2022-02-02T20:52:41.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.223+0000 7fe4d659c700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 rx=0x7fe4c0004f60 tx=0x7fe4c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.224+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c0018070 con 0x7fe4d80f55c0 2022-02-02T20:52:41.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.224+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4c0009770 con 0x7fe4d80f55c0 2022-02-02T20:52:41.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.224+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d8106240 con 0x7fe4d80f55c0 2022-02-02T20:52:41.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.224+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c001c3c0 con 0x7fe4d80f55c0 2022-02-02T20:52:41.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.224+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d81067a0 con 0x7fe4d80f55c0 2022-02-02T20:52:41.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.225+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d8045ad0 con 0x7fe4d80f55c0 2022-02-02T20:52:41.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.225+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe4c001d420 con 0x7fe4d80f55c0 2022-02-02T20:52:41.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.225+0000 7fe4ceffd700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 0x7fe4c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.226+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe4c0083780 con 0x7fe4d80f55c0 2022-02-02T20:52:41.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.226+0000 7fe4d5d9b700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 0x7fe4c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.226+0000 7fe4d5d9b700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 0x7fe4c4067290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fe4c8007fd0 tx=0x7fe4c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.230+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe4c0051880 con 0x7fe4d80f55c0 2022-02-02T20:52:41.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.409+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4d80fdf30 con 0x7fe4c4064dd0 2022-02-02T20:52:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.410+0000 7fe4ceffd700 1 -- 172.21.15.96:0/339420848 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe4c800f710 con 0x7fe4c4064dd0 2022-02-02T20:52:41.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 msgr2=0x7fe4c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 0x7fe4c4067290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fe4c8007fd0 tx=0x7fe4c8009040).stop 2022-02-02T20:52:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 msgr2=0x7fe4d8104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 rx=0x7fe4c0004f60 tx=0x7fe4c0009b30).stop 2022-02-02T20:52:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 shutdown_connections 2022-02-02T20:52:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe4c4064dd0 0x7fe4c4067290 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4d80f55c0 0x7fe4d8104d00 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 --2- 172.21.15.96:0/339420848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4d80f6860 0x7fe4d81051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 >> 172.21.15.96:0/339420848 conn(0x7fe4d80f0d40 msgr2=0x7fe4d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 shutdown_connections 2022-02-02T20:52:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.412+0000 7fe4dcf74700 1 -- 172.21.15.96:0/339420848 wait complete. 2022-02-02T20:52:41.423 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:52:41.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 -- 172.21.15.96:0/1097274159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f6870 msgr2=0x7f64880f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 --2- 172.21.15.96:0/1097274159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f6870 0x7f64880f6cd0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 rx=0x7f6484004660 tx=0x7f6484009b30).stop 2022-02-02T20:52:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 -- 172.21.15.96:0/1097274159 shutdown_connections 2022-02-02T20:52:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 --2- 172.21.15.96:0/1097274159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f6870 0x7f64880f6cd0 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 --2- 172.21.15.96:0/1097274159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f55d0 0x7f64880f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 -- 172.21.15.96:0/1097274159 >> 172.21.15.96:0/1097274159 conn(0x7f64880f0d70 msgr2=0x7f64880f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 -- 172.21.15.96:0/1097274159 shutdown_connections 2022-02-02T20:52:41.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.509+0000 7f648fd37700 1 -- 172.21.15.96:0/1097274159 wait complete. 2022-02-02T20:52:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 Processor -- start 2022-02-02T20:52:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 -- start start 2022-02-02T20:52:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f6870 0x7f648810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880604a0 con 0x7f64880f55d0 2022-02-02T20:52:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648fd37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880605e0 con 0x7f64880f6870 2022-02-02T20:52:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39568/0 (socket says 172.21.15.96:39568) 2022-02-02T20:52:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 -- 172.21.15.96:0/1914322541 learned_addr learned my addr 172.21.15.96:0/1914322541 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648d2d2700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f6870 0x7f648810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 -- 172.21.15.96:0/1914322541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f6870 msgr2=0x7f648810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f6870 0x7f648810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.510+0000 7f648dad3700 1 -- 172.21.15.96:0/1914322541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484005040 con 0x7f64880f55d0 2022-02-02T20:52:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f648dad3700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 rx=0x7f647800c530 tx=0x7f6478007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647800f650 con 0x7f64880f55d0 2022-02-02T20:52:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f647800fc60 con 0x7f64880f55d0 2022-02-02T20:52:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6478012d20 con 0x7f64880f55d0 2022-02-02T20:52:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648810c720 con 0x7f64880f55d0 2022-02-02T20:52:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.511+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648810ccb0 con 0x7f64880f55d0 2022-02-02T20:52:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.512+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64880f49c0 con 0x7f64880f55d0 2022-02-02T20:52:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.512+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6478019030 con 0x7f64880f55d0 2022-02-02T20:52:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.513+0000 7f647e7fc700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 0x7f6474067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.513+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64780816c0 con 0x7f64880f55d0 2022-02-02T20:52:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.513+0000 7f648d2d2700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 0x7f6474067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.513+0000 7f648d2d2700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 0x7f6474067290 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f6484004e30 tx=0x7f6484009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.517+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f647804f810 con 0x7f64880f55d0 2022-02-02T20:52:41.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.691+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64880fdf40 con 0x7f6474064dd0 2022-02-02T20:52:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.700+0000 7f647e7fc700 1 -- 172.21.15.96:0/1914322541 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6484019040 con 0x7f6474064dd0 2022-02-02T20:52:41.701 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:52:41.702 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:52:41.702 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:52:41.702 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:52:41.702 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:52:41.703 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:52:41.703 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:52:41.703 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:52:41.703 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:52:41.704 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:52:41.704 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:52:41.704 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:52:41.704 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:52:41.704 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:52:41.705 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:52:41.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:52:41.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:52:41.705 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:52:41.706 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:52:41.706 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:52:41.706 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:52:41.706 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:52:41.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 msgr2=0x7f6474067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 0x7f6474067290 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f6484004e30 tx=0x7f6484009b30).stop 2022-02-02T20:52:41.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 msgr2=0x7f6488109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 rx=0x7f647800c530 tx=0x7f6478007e10).stop 2022-02-02T20:52:41.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 shutdown_connections 2022-02-02T20:52:41.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6474064dd0 0x7f6474067290 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64880f55d0 0x7f6488109c70 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 --2- 172.21.15.96:0/1914322541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64880f6870 0x7f648810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 >> 172.21.15.96:0/1914322541 conn(0x7f64880f0d70 msgr2=0x7f64880fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:41.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 shutdown_connections 2022-02-02T20:52:41.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.702+0000 7f648fd37700 1 -- 172.21.15.96:0/1914322541 wait complete. 2022-02-02T20:52:41.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 -- 172.21.15.96:0/3948846273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 msgr2=0x7fba280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 --2- 172.21.15.96:0/3948846273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba280f6cc0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 rx=0x7fba18004660 tx=0x7fba18009b30).stop 2022-02-02T20:52:41.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 -- 172.21.15.96:0/3948846273 shutdown_connections 2022-02-02T20:52:41.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 --2- 172.21.15.96:0/3948846273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba280f6cc0 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 --2- 172.21.15.96:0/3948846273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:52:41.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 -- 172.21.15.96:0/3948846273 >> 172.21.15.96:0/3948846273 conn(0x7fba280f0d40 msgr2=0x7fba280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:41.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 -- 172.21.15.96:0/3948846273 shutdown_connections 2022-02-02T20:52:41.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.798+0000 7fba2d02f700 1 -- 172.21.15.96:0/3948846273 wait complete. 2022-02-02T20:52:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 Processor -- start 2022-02-02T20:52:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 -- start start 2022-02-02T20:52:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba28109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba280604b0 con 0x7fba280f6860 2022-02-02T20:52:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2d02f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba280605f0 con 0x7fba280f55c0 2022-02-02T20:52:41.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39580/0 (socket says 172.21.15.96:39580) 2022-02-02T20:52:41.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.799+0000 7fba2659c700 1 -- 172.21.15.96:0/160505733 learned_addr learned my addr 172.21.15.96:0/160505733 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:41.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba26d9d700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba28109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2659c700 1 -- 172.21.15.96:0/160505733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 msgr2=0x7fba28109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2659c700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba28109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2659c700 1 -- 172.21.15.96:0/160505733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18005040 con 0x7fba280f6860 2022-02-02T20:52:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba26d9d700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba28109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:52:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2659c700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 rx=0x7fba18009990 tx=0x7fba18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba18018070 con 0x7fba280f6860 2022-02-02T20:52:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba18007ca0 con 0x7fba280f6860 2022-02-02T20:52:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1801c620 con 0x7fba280f6860 2022-02-02T20:52:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2810c770 con 0x7fba280f6860 2022-02-02T20:52:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.800+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2810ccd0 con 0x7fba280f6860 2022-02-02T20:52:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.801+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba28045ad0 con 0x7fba280f6860 2022-02-02T20:52:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.802+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba1801d960 con 0x7fba280f6860 2022-02-02T20:52:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.802+0000 7fba0f7fe700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 0x7fba10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.802+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba18083700 con 0x7fba280f6860 2022-02-02T20:52:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.802+0000 7fba26d9d700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 0x7fba10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.802+0000 7fba26d9d700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 0x7fba10067290 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fba280600a0 tx=0x7fba1c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:41.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:41.806+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba18051800 con 0x7fba280f6860 2022-02-02T20:52:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.035+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba28027a00 con 0x7fba280f6860 2022-02-02T20:52:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.036+0000 7fba0f7fe700 1 -- 172.21.15.96:0/160505733 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fba18054e20 con 0x7fba280f6860 2022-02-02T20:52:42.038 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:52:42.038 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:52:42.038 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:52:42.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:42.039 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:52:42.039 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:52:42.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:42.039 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:52:42.040 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:52:42.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:42.040 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:52:42.040 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:52:42.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:52:42.041 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:52:42.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:52:42.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:52:42.041 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:52:42.042 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:52:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 msgr2=0x7fba10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 0x7fba10067290 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fba280600a0 tx=0x7fba1c008040).stop 2022-02-02T20:52:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 msgr2=0x7fba2810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 rx=0x7fba18009990 tx=0x7fba18009b30).stop 2022-02-02T20:52:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 shutdown_connections 2022-02-02T20:52:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba10064dd0 0x7fba10067290 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba280f55c0 0x7fba28109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 --2- 172.21.15.96:0/160505733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba280f6860 0x7fba2810c170 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 >> 172.21.15.96:0/160505733 conn(0x7fba280f0d40 msgr2=0x7fba280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:42.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 shutdown_connections 2022-02-02T20:52:42.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.038+0000 7fba2d02f700 1 -- 172.21.15.96:0/160505733 wait complete. 2022-02-02T20:52:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 -- 172.21.15.96:0/3893977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87900f9850 msgr2=0x7f87900fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 --2- 172.21.15.96:0/3893977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87900f9850 0x7f87900fbc80 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 rx=0x7f8778004660 tx=0x7f8778009b30).stop 2022-02-02T20:52:42.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 -- 172.21.15.96:0/3893977374 shutdown_connections 2022-02-02T20:52:42.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 --2- 172.21.15.96:0/3893977374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87900f9850 0x7f87900fbc80 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 --2- 172.21.15.96:0/3893977374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8790060250 0x7f87900f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:52:42.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 -- 172.21.15.96:0/3893977374 >> 172.21.15.96:0/3893977374 conn(0x7f87900f0d40 msgr2=0x7f87900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:42.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 -- 172.21.15.96:0/3893977374 shutdown_connections 2022-02-02T20:52:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.136+0000 7f879686f700 1 -- 172.21.15.96:0/3893977374 wait complete. 2022-02-02T20:52:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 Processor -- start 2022-02-02T20:52:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 -- start start 2022-02-02T20:52:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87900f9850 0x7f87901074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8790107ae0 con 0x7f8790060250 2022-02-02T20:52:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f879686f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8790108390 con 0x7f87900f9850 2022-02-02T20:52:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f878ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f878ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39588/0 (socket says 172.21.15.96:39588) 2022-02-02T20:52:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.137+0000 7f878ffff700 1 -- 172.21.15.96:0/2746670490 learned_addr learned my addr 172.21.15.96:0/2746670490 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:52:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878f7fe700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87900f9850 0x7f87901074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878ffff700 1 -- 172.21.15.96:0/2746670490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87900f9850 msgr2=0x7f87901074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878ffff700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87900f9850 0x7f87901074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878ffff700 1 -- 172.21.15.96:0/2746670490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778005040 con 0x7f8790060250 2022-02-02T20:52:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878ffff700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f878000b410 tx=0x7f8780006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87800125f0 con 0x7f8790060250 2022-02-02T20:52:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8780012c00 con 0x7f8790060250 2022-02-02T20:52:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8790108670 con 0x7f8790060250 2022-02-02T20:52:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8780002ae0 con 0x7f8790060250 2022-02-02T20:52:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.138+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8790108c30 con 0x7f8790060250 2022-02-02T20:52:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.139+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87900f49b0 con 0x7f8790060250 2022-02-02T20:52:42.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.139+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f878000f030 con 0x7f8790060250 2022-02-02T20:52:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.140+0000 7f878cff9700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 0x7f877c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:52:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.140+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8780081f10 con 0x7f8790060250 2022-02-02T20:52:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.140+0000 7f878f7fe700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 0x7f877c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:52:42.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.140+0000 7f878f7fe700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 0x7f877c067290 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f8778004e30 tx=0x7f8778009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:52:42.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.144+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8780053a40 con 0x7f8790060250 2022-02-02T20:52:42.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.345+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8790027a00 con 0x7f8790060250 2022-02-02T20:52:42.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.345+0000 7f878cff9700 1 -- 172.21.15.96:0/2746670490 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8780002d50 con 0x7f8790060250 2022-02-02T20:52:42.348 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:52:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:52:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:52:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:52:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:52:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:52:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:52:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:52:42.351 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:52:42.351 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:52:42.351 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:52:42.351 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:52:42.352 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:52:42.352 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:52:42.352 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:52:42.352 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:52:42.352 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:52:42.353 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:52:42.353 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:52:42.353 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:52:42.354 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:52:42.354 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:52:42.354 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:52:42.354 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:52:42.355 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:52:42.355 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:52:42.355 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:52:42.355 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:52:42.355 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:52:42.356 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:52:42.356 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:52:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:42.357 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:52:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:52:42.357 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:42.357 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:42.357 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:52:42.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 msgr2=0x7f877c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 0x7f877c067290 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f8778004e30 tx=0x7f8778009b30).stop 2022-02-02T20:52:42.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 msgr2=0x7f8790106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:52:42.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f878000b410 tx=0x7f8780006ef0).stop 2022-02-02T20:52:42.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 shutdown_connections 2022-02-02T20:52:42.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f877c064dd0 0x7f877c067290 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8790060250 0x7f8790106fb0 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 --2- 172.21.15.96:0/2746670490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87900f9850 0x7f87901074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:52:42.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 >> 172.21.15.96:0/2746670490 conn(0x7f87900f0d40 msgr2=0x7f87900f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:52:42.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 shutdown_connections 2022-02-02T20:52:42.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:52:42.347+0000 7f879686f700 1 -- 172.21.15.96:0/2746670490 wait complete. 2022-02-02T20:52:42.361 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:52:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:42 smithi159 ceph-mon[69013]: from='client.38740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:42 smithi159 ceph-mon[69013]: pgmap v4518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:42 smithi159 ceph-mon[69013]: from='client.38744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/160505733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:52:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2746670490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:52:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:42 smithi096 ceph-mon[101353]: from='client.38740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:42 smithi096 ceph-mon[101353]: pgmap v4518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:42 smithi096 ceph-mon[101353]: from='client.38744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:52:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/160505733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:52:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2746670490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:52:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:44 smithi159 ceph-mon[69013]: pgmap v4519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:44 smithi096 ceph-mon[101353]: pgmap v4519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:46 smithi159 ceph-mon[69013]: pgmap v4520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:46 smithi096 ceph-mon[101353]: pgmap v4520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:48 smithi159 ceph-mon[69013]: pgmap v4521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:48 smithi096 ceph-mon[101353]: pgmap v4521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:50 smithi159 ceph-mon[69013]: pgmap v4522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:50 smithi096 ceph-mon[101353]: pgmap v4522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:52 smithi159 ceph-mon[69013]: pgmap v4523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:52 smithi096 ceph-mon[101353]: pgmap v4523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:54 smithi159 ceph-mon[69013]: pgmap v4524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:54 smithi096 ceph-mon[101353]: pgmap v4524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:56 smithi159 ceph-mon[69013]: pgmap v4525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:56 smithi096 ceph-mon[101353]: pgmap v4525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:52:58 smithi159 ceph-mon[69013]: pgmap v4526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:52:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:52:58 smithi096 ceph-mon[101353]: pgmap v4526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:01.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:00 smithi159 ceph-mon[69013]: pgmap v4527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:00 smithi096 ceph-mon[101353]: pgmap v4527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:02 smithi159 ceph-mon[69013]: pgmap v4528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:02 smithi096 ceph-mon[101353]: pgmap v4528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:04 smithi159 ceph-mon[69013]: pgmap v4529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:04 smithi096 ceph-mon[101353]: pgmap v4529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:06 smithi159 ceph-mon[69013]: pgmap v4530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:06 smithi096 ceph-mon[101353]: pgmap v4530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:08 smithi159 ceph-mon[69013]: pgmap v4531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:08 smithi096 ceph-mon[101353]: pgmap v4531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:10 smithi159 ceph-mon[69013]: pgmap v4532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:10 smithi096 ceph-mon[101353]: pgmap v4532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3968308900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 msgr2=0x7f7e600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3968308900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e600f6b00 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 rx=0x7f7e54004660 tx=0x7f7e54009b30).stop 2022-02-02T20:53:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3968308900 shutdown_connections 2022-02-02T20:53:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3968308900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 0x7f7e600f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3968308900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e600f6b00 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3968308900 >> 172.21.15.96:0/3968308900 conn(0x7f7e600f1e40 msgr2=0x7f7e600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3968308900 shutdown_connections 2022-02-02T20:53:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3968308900 wait complete. 2022-02-02T20:53:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.458+0000 7f7e66ffd700 1 Processor -- start 2022-02-02T20:53:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e66ffd700 1 -- start start 2022-02-02T20:53:12.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e66ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 0x7f7e60069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e66ffd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006a380 con 0x7f7e600f66e0 2022-02-02T20:53:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e66ffd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006a4c0 con 0x7f7e600f7980 2022-02-02T20:53:12.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39610/0 (socket says 172.21.15.96:39610) 2022-02-02T20:53:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 -- 172.21.15.96:0/3623023809 learned_addr learned my addr 172.21.15.96:0/3623023809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e5ffff700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 0x7f7e60069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 -- 172.21.15.96:0/3623023809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 msgr2=0x7f7e60069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 0x7f7e60069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.459+0000 7f7e64d99700 1 -- 172.21.15.96:0/3623023809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54005040 con 0x7f7e600f66e0 2022-02-02T20:53:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e64d99700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7f7e54013a70 tx=0x7f7e54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e54018070 con 0x7f7e600f66e0 2022-02-02T20:53:12.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6006a740 con 0x7f7e600f66e0 2022-02-02T20:53:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e540097d0 con 0x7f7e600f66e0 2022-02-02T20:53:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5401de80 con 0x7f7e600f66e0 2022-02-02T20:53:12.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.460+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6006aca0 con 0x7f7e600f66e0 2022-02-02T20:53:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.461+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60045ad0 con 0x7f7e600f66e0 2022-02-02T20:53:12.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.461+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e5401d420 con 0x7f7e600f66e0 2022-02-02T20:53:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.462+0000 7f7e5d7fa700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 0x7f7e50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.462+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7e54083670 con 0x7f7e600f66e0 2022-02-02T20:53:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.462+0000 7f7e5ffff700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 0x7f7e50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.462+0000 7f7e5ffff700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 0x7f7e50067290 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f7e4c004e20 tx=0x7f7e4c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:12.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.466+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e54051820 con 0x7f7e600f66e0 2022-02-02T20:53:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.649+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e60057f10 con 0x7f7e50064dd0 2022-02-02T20:53:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.650+0000 7f7e5d7fa700 1 -- 172.21.15.96:0/3623023809 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7e60057f10 con 0x7f7e50064dd0 2022-02-02T20:53:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 msgr2=0x7f7e50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 0x7f7e50067290 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f7e4c004e20 tx=0x7f7e4c00b040).stop 2022-02-02T20:53:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 msgr2=0x7f7e6006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7f7e54013a70 tx=0x7f7e54009b30).stop 2022-02-02T20:53:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 shutdown_connections 2022-02-02T20:53:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e50064dd0 0x7f7e50067290 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e600f66e0 0x7f7e6006b9a0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 --2- 172.21.15.96:0/3623023809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e600f7980 0x7f7e60069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 >> 172.21.15.96:0/3623023809 conn(0x7f7e600f1e40 msgr2=0x7f7e600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 shutdown_connections 2022-02-02T20:53:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.652+0000 7f7e66ffd700 1 -- 172.21.15.96:0/3623023809 wait complete. 2022-02-02T20:53:12.663 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:53:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 -- 172.21.15.96:0/365618654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 msgr2=0x7ff4f00f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/365618654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7080 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 rx=0x7ff4e4004660 tx=0x7ff4e4009b30).stop 2022-02-02T20:53:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 -- 172.21.15.96:0/365618654 shutdown_connections 2022-02-02T20:53:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/365618654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 0x7ff4f00f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/365618654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7080 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 -- 172.21.15.96:0/365618654 >> 172.21.15.96:0/365618654 conn(0x7ff4f00f04c0 msgr2=0x7ff4f00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 -- 172.21.15.96:0/365618654 shutdown_connections 2022-02-02T20:53:12.755 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:12 smithi096 ceph-mon[101353]: pgmap v4533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.751+0000 7ff4f4e46700 1 -- 172.21.15.96:0/365618654 wait complete. 2022-02-02T20:53:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 Processor -- start 2022-02-02T20:53:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 -- start start 2022-02-02T20:53:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 0x7ff4f00f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00f8220 con 0x7ff4f00f6c60 2022-02-02T20:53:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4f4e46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00f8360 con 0x7ff4f00f5970 2022-02-02T20:53:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39622/0 (socket says 172.21.15.96:39622) 2022-02-02T20:53:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 -- 172.21.15.96:0/2315326171 learned_addr learned my addr 172.21.15.96:0/2315326171 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4ee59c700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 0x7ff4f00f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 -- 172.21.15.96:0/2315326171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 msgr2=0x7ff4f00f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 0x7ff4f00f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.752+0000 7ff4edd9b700 1 -- 172.21.15.96:0/2315326171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4005040 con 0x7ff4f00f6c60 2022-02-02T20:53:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4edd9b700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7ff4e00026d0 tx=0x7ff4e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e00079c0 con 0x7ff4f00f6c60 2022-02-02T20:53:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4e000f040 con 0x7ff4f00f6c60 2022-02-02T20:53:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00f8640 con 0x7ff4f00f6c60 2022-02-02T20:53:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e00148b0 con 0x7ff4f00f6c60 2022-02-02T20:53:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.753+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f010ef80 con 0x7ff4f00f6c60 2022-02-02T20:53:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.754+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f0045ad0 con 0x7ff4f00f6c60 2022-02-02T20:53:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.754+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4e0007b20 con 0x7ff4f00f6c60 2022-02-02T20:53:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.755+0000 7ff4deffd700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 0x7ff4d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:12.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.755+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4e00819e0 con 0x7ff4f00f6c60 2022-02-02T20:53:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.755+0000 7ff4ee59c700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 0x7ff4d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:12.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.755+0000 7ff4ee59c700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 0x7ff4d8067290 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7ff4e4004630 tx=0x7ff4e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:12.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.759+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4e004fae0 con 0x7ff4f00f6c60 2022-02-02T20:53:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.932+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f00fadc0 con 0x7ff4d8064dd0 2022-02-02T20:53:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.941+0000 7ff4deffd700 1 -- 172.21.15.96:0/2315326171 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4f00fadc0 con 0x7ff4d8064dd0 2022-02-02T20:53:12.943 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:53:12.943 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:53:12.943 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:53:12.943 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:53:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:53:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:53:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:53:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:53:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:53:12.945 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:53:12.945 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:53:12.945 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:53:12.945 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:53:12.946 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:53:12.946 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:53:12.946 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:53:12.946 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:53:12.946 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:53:12.947 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:53:12.947 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:53:12.947 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:53:12.947 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:53:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 msgr2=0x7ff4d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 0x7ff4d8067290 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7ff4e4004630 tx=0x7ff4e4009b30).stop 2022-02-02T20:53:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 msgr2=0x7ff4f00f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7ff4e00026d0 tx=0x7ff4e0009de0).stop 2022-02-02T20:53:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 shutdown_connections 2022-02-02T20:53:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4d8064dd0 0x7ff4d8067290 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4f00f5970 0x7ff4f00f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 --2- 172.21.15.96:0/2315326171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4f00f6c60 0x7ff4f00f7cc0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 >> 172.21.15.96:0/2315326171 conn(0x7ff4f00f04c0 msgr2=0x7ff4f00f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 shutdown_connections 2022-02-02T20:53:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:12.944+0000 7ff4f4e46700 1 -- 172.21.15.96:0/2315326171 wait complete. 2022-02-02T20:53:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:12 smithi159 ceph-mon[69013]: pgmap v4533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:13.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 -- 172.21.15.96:0/587554914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 msgr2=0x7f75600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 --2- 172.21.15.96:0/587554914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f75600f5850 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 rx=0x7f755c004660 tx=0x7f755c009b30).stop 2022-02-02T20:53:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 -- 172.21.15.96:0/587554914 shutdown_connections 2022-02-02T20:53:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 --2- 172.21.15.96:0/587554914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 0x7f75600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 --2- 172.21.15.96:0/587554914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f75600f5850 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 -- 172.21.15.96:0/587554914 >> 172.21.15.96:0/587554914 conn(0x7f75600f0b90 msgr2=0x7f75600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:13.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.040+0000 7f7566998700 1 -- 172.21.15.96:0/587554914 shutdown_connections 2022-02-02T20:53:13.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.041+0000 7f7566998700 1 -- 172.21.15.96:0/587554914 wait complete. 2022-02-02T20:53:13.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.041+0000 7f7566998700 1 Processor -- start 2022-02-02T20:53:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.041+0000 7f7566998700 1 -- start start 2022-02-02T20:53:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7566998700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7566998700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 0x7f756010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7566998700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75600603c0 con 0x7f75600f5430 2022-02-02T20:53:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7566998700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560060500 con 0x7f75600f66d0 2022-02-02T20:53:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39630/0 (socket says 172.21.15.96:39630) 2022-02-02T20:53:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 -- 172.21.15.96:0/2069356561 learned_addr learned my addr 172.21.15.96:0/2069356561 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565195700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 0x7f756010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 -- 172.21.15.96:0/2069356561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 msgr2=0x7f756010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 0x7f756010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 -- 172.21.15.96:0/2069356561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c005040 con 0x7f75600f5430 2022-02-02T20:53:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.042+0000 7f7565996700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7f755c013a70 tx=0x7f755c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.043+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c018070 con 0x7f75600f5430 2022-02-02T20:53:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.043+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756010c490 con 0x7f75600f5430 2022-02-02T20:53:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.043+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f755c0097d0 con 0x7f75600f5430 2022-02-02T20:53:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.043+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c01de80 con 0x7f75600f5430 2022-02-02T20:53:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.043+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756010c9c0 con 0x7f75600f5430 2022-02-02T20:53:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.044+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7560059100 con 0x7f75600f5430 2022-02-02T20:53:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.044+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f755c007ba0 con 0x7f75600f5430 2022-02-02T20:53:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.044+0000 7f75567fc700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 0x7f754c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.045+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f755c083640 con 0x7f75600f5430 2022-02-02T20:53:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.045+0000 7f7565195700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 0x7f754c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.045+0000 7f7565195700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 0x7f754c0672e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f7550004ce0 tx=0x7f755000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:13.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.049+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f755c051740 con 0x7f75600f5430 2022-02-02T20:53:13.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.285+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75600fdd00 con 0x7f75600f5430 2022-02-02T20:53:13.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.285+0000 7f75567fc700 1 -- 172.21.15.96:0/2069356561 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f755c054d60 con 0x7f75600f5430 2022-02-02T20:53:13.287 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:53:13.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:53:13.288 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:53:13.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:13.288 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:53:13.288 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:53:13.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:13.289 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:53:13.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:53:13.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:13.290 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:53:13.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:53:13.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:13.291 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:53:13.291 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:53:13.291 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:53:13.291 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:53:13.291 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:53:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 msgr2=0x7f754c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 0x7f754c0672e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f7550004ce0 tx=0x7f755000b040).stop 2022-02-02T20:53:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 msgr2=0x7f7560109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7f755c013a70 tx=0x7f755c009b30).stop 2022-02-02T20:53:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 shutdown_connections 2022-02-02T20:53:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f754c064e20 0x7f754c0672e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75600f5430 0x7f7560109a40 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 --2- 172.21.15.96:0/2069356561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75600f66d0 0x7f756010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 >> 172.21.15.96:0/2069356561 conn(0x7f75600f0b90 msgr2=0x7f75600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 shutdown_connections 2022-02-02T20:53:13.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.287+0000 7f7566998700 1 -- 172.21.15.96:0/2069356561 wait complete. 2022-02-02T20:53:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 -- 172.21.15.96:0/511078527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 msgr2=0x7f0fb00f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 --2- 172.21.15.96:0/511078527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb00f62c0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 rx=0x7f0fa0004770 tx=0x7f0fa000ac40).stop 2022-02-02T20:53:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 -- 172.21.15.96:0/511078527 shutdown_connections 2022-02-02T20:53:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 --2- 172.21.15.96:0/511078527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb00f62c0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 --2- 172.21.15.96:0/511078527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 0x7f0fb00f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.385+0000 7f0fb5535700 1 -- 172.21.15.96:0/511078527 >> 172.21.15.96:0/511078527 conn(0x7f0fb00f0320 msgr2=0x7f0fb00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.386+0000 7f0fb5535700 1 -- 172.21.15.96:0/511078527 shutdown_connections 2022-02-02T20:53:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.386+0000 7f0fb5535700 1 -- 172.21.15.96:0/511078527 wait complete. 2022-02-02T20:53:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.386+0000 7f0fb5535700 1 Processor -- start 2022-02-02T20:53:13.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.386+0000 7f0fb5535700 1 -- start start 2022-02-02T20:53:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 0x7f0fb0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0107870 con 0x7f0fb00f5e60 2022-02-02T20:53:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb01080b0 con 0x7f0fb00f4bc0 2022-02-02T20:53:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39642/0 (socket says 172.21.15.96:39642) 2022-02-02T20:53:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 -- 172.21.15.96:0/1132080497 learned_addr learned my addr 172.21.15.96:0/1132080497 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faffff700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 0x7f0fb0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 -- 172.21.15.96:0/1132080497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 msgr2=0x7f0fb0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 0x7f0fb0106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 -- 172.21.15.96:0/1132080497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0005040 con 0x7f0fb00f5e60 2022-02-02T20:53:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0faf7fe700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7f0fa0014450 tx=0x7f0fa000ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa000f030 con 0x7f0fb00f5e60 2022-02-02T20:53:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb0108330 con 0x7f0fb00f5e60 2022-02-02T20:53:13.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0fa0007c60 con 0x7f0fb00f5e60 2022-02-02T20:53:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa0019070 con 0x7f0fb00f5e60 2022-02-02T20:53:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.387+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb0108810 con 0x7f0fb00f5e60 2022-02-02T20:53:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.388+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb0059100 con 0x7f0fb00f5e60 2022-02-02T20:53:13.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.389+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0fa00077b0 con 0x7f0fb00f5e60 2022-02-02T20:53:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.389+0000 7f0facff9700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 0x7f0f980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.389+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0fa0083710 con 0x7f0fb00f5e60 2022-02-02T20:53:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.389+0000 7f0faffff700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 0x7f0f980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.390+0000 7f0faffff700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 0x7f0f980672e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f0fb0107b40 tx=0x7f0fa4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:13.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.393+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0fa00518d0 con 0x7f0fb00f5e60 2022-02-02T20:53:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.595+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fb00fcca0 con 0x7f0fb00f5e60 2022-02-02T20:53:13.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.596+0000 7f0facff9700 1 -- 172.21.15.96:0/1132080497 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0fb00fcca0 con 0x7f0fb00f5e60 2022-02-02T20:53:13.597 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:53:13.598 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:53:13.598 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:53:13.598 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:53:13.599 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:13.599 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:53:13.599 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:53:13.600 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:53:13.600 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:53:13.600 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:53:13.600 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:53:13.600 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:53:13.601 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:53:13.601 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:53:13.601 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:53:13.602 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:53:13.602 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:53:13.602 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:53:13.602 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:53:13.603 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:53:13.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:53:13.603 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:53:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:53:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:53:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:53:13.604 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:53:13.605 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:53:13.605 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:53:13.605 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:53:13.605 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:53:13.606 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:53:13.606 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:53:13.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:13.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:13.606 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:53:13.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:13.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:13.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:13.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 msgr2=0x7f0f980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 0x7f0f980672e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f0fb0107b40 tx=0x7f0fa4009040).stop 2022-02-02T20:53:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 msgr2=0x7f0fb0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7f0fa0014450 tx=0x7f0fa000ac40).stop 2022-02-02T20:53:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 shutdown_connections 2022-02-02T20:53:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f98064e20 0x7f0f980672e0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb00f4bc0 0x7f0fb0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 --2- 172.21.15.96:0/1132080497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fb00f5e60 0x7f0fb0107270 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.597+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 >> 172.21.15.96:0/1132080497 conn(0x7f0fb00f0320 msgr2=0x7f0fb00f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.598+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 shutdown_connections 2022-02-02T20:53:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:13.598+0000 7f0fb5535700 1 -- 172.21.15.96:0/1132080497 wait complete. 2022-02-02T20:53:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:53:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:13 smithi159 ceph-mon[69013]: from='client.38756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2069356561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:53:13.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1132080497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:53:13.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:13 smithi096 ceph-mon[101353]: from='client.38756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:13.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2069356561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:53:13.809 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1132080497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:53:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:14 smithi159 ceph-mon[69013]: from='client.38760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:14 smithi159 ceph-mon[69013]: pgmap v4534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:14 smithi096 ceph-mon[101353]: from='client.38760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:14 smithi096 ceph-mon[101353]: pgmap v4534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:16 smithi159 ceph-mon[69013]: pgmap v4535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:16 smithi096 ceph-mon[101353]: pgmap v4535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:18 smithi159 ceph-mon[69013]: pgmap v4536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:18 smithi096 ceph-mon[101353]: pgmap v4536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:20 smithi159 ceph-mon[69013]: pgmap v4537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:20 smithi096 ceph-mon[101353]: pgmap v4537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:22 smithi159 ceph-mon[69013]: pgmap v4538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:22 smithi096 ceph-mon[101353]: pgmap v4538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:24 smithi159 ceph-mon[69013]: pgmap v4539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:24 smithi096 ceph-mon[101353]: pgmap v4539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:26 smithi159 ceph-mon[69013]: pgmap v4540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:26 smithi096 ceph-mon[101353]: pgmap v4540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:53:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:53:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:28 smithi159 ceph-mon[69013]: pgmap v4541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:53:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:53:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:28 smithi096 ceph-mon[101353]: pgmap v4541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:30 smithi159 ceph-mon[69013]: pgmap v4542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:31.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:30 smithi096 ceph-mon[101353]: pgmap v4542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:32 smithi159 ceph-mon[69013]: pgmap v4543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:32 smithi096 ceph-mon[101353]: pgmap v4543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:34 smithi159 ceph-mon[69013]: pgmap v4544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:34 smithi096 ceph-mon[101353]: pgmap v4544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:36 smithi159 ceph-mon[69013]: pgmap v4545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:36 smithi096 ceph-mon[101353]: pgmap v4545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:38 smithi159 ceph-mon[69013]: pgmap v4546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:38 smithi096 ceph-mon[101353]: pgmap v4546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:40 smithi159 ceph-mon[69013]: pgmap v4547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:40 smithi096 ceph-mon[101353]: pgmap v4547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:42 smithi159 ceph-mon[69013]: pgmap v4548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:42 smithi096 ceph-mon[101353]: pgmap v4548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 -- 172.21.15.96:0/3690333997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f66e0 msgr2=0x7f50480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 --2- 172.21.15.96:0/3690333997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f66e0 0x7f50480f6b00 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 rx=0x7f503c004660 tx=0x7f503c009b30).stop 2022-02-02T20:53:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 -- 172.21.15.96:0/3690333997 shutdown_connections 2022-02-02T20:53:43.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 --2- 172.21.15.96:0/3690333997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 --2- 172.21.15.96:0/3690333997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f66e0 0x7f50480f6b00 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 -- 172.21.15.96:0/3690333997 >> 172.21.15.96:0/3690333997 conn(0x7f50480f1e40 msgr2=0x7f50480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:43.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 -- 172.21.15.96:0/3690333997 shutdown_connections 2022-02-02T20:53:43.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.708+0000 7f504f09a700 1 -- 172.21.15.96:0/3690333997 wait complete. 2022-02-02T20:53:43.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 Processor -- start 2022-02-02T20:53:43.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 -- start start 2022-02-02T20:53:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50481070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:43.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048107ab0 con 0x7f50481075e0 2022-02-02T20:53:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f504f09a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048107bf0 con 0x7f50480f7980 2022-02-02T20:53:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f5047fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f5047fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39672/0 (socket says 172.21.15.96:39672) 2022-02-02T20:53:43.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.709+0000 7f5047fff700 1 -- 172.21.15.96:0/3170523280 learned_addr learned my addr 172.21.15.96:0/3170523280 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f504ce36700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50481070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f5047fff700 1 -- 172.21.15.96:0/3170523280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 msgr2=0x7f50481070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f5047fff700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50481070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f5047fff700 1 -- 172.21.15.96:0/3170523280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c005040 con 0x7f50481075e0 2022-02-02T20:53:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f504ce36700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50481070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:53:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f5047fff700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7f50340026d0 tx=0x7f5034009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5034009320 con 0x7f50481075e0 2022-02-02T20:53:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048108a80 con 0x7f50481075e0 2022-02-02T20:53:43.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f503400f040 con 0x7f50481075e0 2022-02-02T20:53:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50340147e0 con 0x7f50481075e0 2022-02-02T20:53:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.710+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048109040 con 0x7f50481075e0 2022-02-02T20:53:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.711+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50481092c0 con 0x7f50481075e0 2022-02-02T20:53:43.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.712+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5034009480 con 0x7f50481075e0 2022-02-02T20:53:43.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.712+0000 7f50457fa700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 0x7f5038067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:43.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.712+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5034082120 con 0x7f50481075e0 2022-02-02T20:53:43.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.712+0000 7f504ce36700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 0x7f5038067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:43.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.712+0000 7f504ce36700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 0x7f5038067290 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f503c013690 tx=0x7f503c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:43.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.716+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5034053c50 con 0x7f50481075e0 2022-02-02T20:53:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.895+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50480feea0 con 0x7f5038064dd0 2022-02-02T20:53:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.896+0000 7f50457fa700 1 -- 172.21.15.96:0/3170523280 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f50480feea0 con 0x7f5038064dd0 2022-02-02T20:53:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 msgr2=0x7f5038067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 0x7f5038067290 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f503c013690 tx=0x7f503c009b30).stop 2022-02-02T20:53:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 msgr2=0x7f50481084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7f50340026d0 tx=0x7f5034009de0).stop 2022-02-02T20:53:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 shutdown_connections 2022-02-02T20:53:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5038064dd0 0x7f5038067290 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f7980 0x7f50481070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 --2- 172.21.15.96:0/3170523280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50481075e0 0x7f50481084d0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.898+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 >> 172.21.15.96:0/3170523280 conn(0x7f50480f1e40 msgr2=0x7f50480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.899+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 shutdown_connections 2022-02-02T20:53:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.899+0000 7f504f09a700 1 -- 172.21.15.96:0/3170523280 wait complete. 2022-02-02T20:53:43.909 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:53:43.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 -- 172.21.15.96:0/589733557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f9830 msgr2=0x7f1c740fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:43.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 --2- 172.21.15.96:0/589733557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f9830 0x7f1c740fbc80 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 rx=0x7f1c64004660 tx=0x7f1c64009b30).stop 2022-02-02T20:53:43.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 -- 172.21.15.96:0/589733557 shutdown_connections 2022-02-02T20:53:43.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 --2- 172.21.15.96:0/589733557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f9830 0x7f1c740fbc80 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:43.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 --2- 172.21.15.96:0/589733557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c74060270 0x7f1c740f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:53:43.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 -- 172.21.15.96:0/589733557 >> 172.21.15.96:0/589733557 conn(0x7f1c740f0d40 msgr2=0x7f1c740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:43.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 -- 172.21.15.96:0/589733557 shutdown_connections 2022-02-02T20:53:43.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.996+0000 7f1c7a101700 1 -- 172.21.15.96:0/589733557 wait complete. 2022-02-02T20:53:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 Processor -- start 2022-02-02T20:53:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 -- start start 2022-02-02T20:53:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f9830 0x7f1c740f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740f5830 con 0x7f1c74060270 2022-02-02T20:53:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c7a101700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740f5970 con 0x7f1c740f9830 2022-02-02T20:53:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39680/0 (socket says 172.21.15.96:39680) 2022-02-02T20:53:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 -- 172.21.15.96:0/3844328099 learned_addr learned my addr 172.21.15.96:0/3844328099 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f9830 0x7f1c740f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 -- 172.21.15.96:0/3844328099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f9830 msgr2=0x7f1c740f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f9830 0x7f1c740f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.997+0000 7f1c737fe700 1 -- 172.21.15.96:0/3844328099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64005040 con 0x7f1c74060270 2022-02-02T20:53:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c737fe700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 rx=0x7f1c6800b410 tx=0x7f1c68006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c680125f0 con 0x7f1c74060270 2022-02-02T20:53:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c6800be30 con 0x7f1c74060270 2022-02-02T20:53:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c740f5c50 con 0x7f1c74060270 2022-02-02T20:53:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7410ef90 con 0x7f1c74060270 2022-02-02T20:53:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.998+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c68002a70 con 0x7f1c74060270 2022-02-02T20:53:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.999+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c54004fa0 con 0x7f1c74060270 2022-02-02T20:53:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:43.999+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c6800f030 con 0x7f1c74060270 2022-02-02T20:53:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.000+0000 7f1c5bfff700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.000+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c68081ce0 con 0x7f1c74060270 2022-02-02T20:53:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.000+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.000+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f1c64004630 tx=0x7f1c64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.004+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c6804fe30 con 0x7f1c74060270 2022-02-02T20:53:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.174+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c54000bc0 con 0x7f1c5c064dd0 2022-02-02T20:53:44.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.183+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3844328099 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1c54000bc0 con 0x7f1c5c064dd0 2022-02-02T20:53:44.184 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:53:44.185 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:53:44.185 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:53:44.185 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:53:44.185 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:53:44.186 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:53:44.186 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:53:44.186 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:53:44.186 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:53:44.186 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:53:44.187 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:53:44.187 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:53:44.187 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:53:44.187 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:53:44.188 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:53:44.188 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:53:44.188 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:53:44.188 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:53:44.188 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:53:44.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:53:44.189 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:53:44.189 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:53:44.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 msgr2=0x7f1c5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f1c64004630 tx=0x7f1c64009b30).stop 2022-02-02T20:53:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 msgr2=0x7f1c740f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 rx=0x7f1c6800b410 tx=0x7f1c68006ef0).stop 2022-02-02T20:53:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 shutdown_connections 2022-02-02T20:53:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c74060270 0x7f1c740f6dc0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 --2- 172.21.15.96:0/3844328099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f9830 0x7f1c740f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 >> 172.21.15.96:0/3844328099 conn(0x7f1c740f0d40 msgr2=0x7f1c740f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:44.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 shutdown_connections 2022-02-02T20:53:44.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.185+0000 7f1c7a101700 1 -- 172.21.15.96:0/3844328099 wait complete. 2022-02-02T20:53:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 -- 172.21.15.96:0/2958841774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f5ef0 msgr2=0x7fc06c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 --2- 172.21.15.96:0/2958841774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c0f6920 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 rx=0x7fc068004660 tx=0x7fc068009b30).stop 2022-02-02T20:53:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 -- 172.21.15.96:0/2958841774 shutdown_connections 2022-02-02T20:53:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 --2- 172.21.15.96:0/2958841774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c0f6920 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 --2- 172.21.15.96:0/2958841774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f55e0 0x7fc06c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.281+0000 7fc073466700 1 -- 172.21.15.96:0/2958841774 >> 172.21.15.96:0/2958841774 conn(0x7fc06c0f0de0 msgr2=0x7fc06c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.282+0000 7fc073466700 1 -- 172.21.15.96:0/2958841774 shutdown_connections 2022-02-02T20:53:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.282+0000 7fc073466700 1 -- 172.21.15.96:0/2958841774 wait complete. 2022-02-02T20:53:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 Processor -- start 2022-02-02T20:53:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 -- start start 2022-02-02T20:53:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c109f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c060500 con 0x7fc06c0f55e0 2022-02-02T20:53:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc073466700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c060640 con 0x7fc06c0f5ef0 2022-02-02T20:53:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc071202700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc071202700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39688/0 (socket says 172.21.15.96:39688) 2022-02-02T20:53:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.283+0000 7fc071202700 1 -- 172.21.15.96:0/1504479210 learned_addr learned my addr 172.21.15.96:0/1504479210 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc070a01700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc071202700 1 -- 172.21.15.96:0/1504479210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 msgr2=0x7fc06c109f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc071202700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c109f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc071202700 1 -- 172.21.15.96:0/1504479210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068005040 con 0x7fc06c0f55e0 2022-02-02T20:53:44.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc070a01700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:53:44.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc071202700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7fc05c00c790 tx=0x7fc05c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05c00e680 con 0x7fc06c0f55e0 2022-02-02T20:53:44.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c10a530 con 0x7fc06c0f55e0 2022-02-02T20:53:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc05c00ec90 con 0x7fc06c0f55e0 2022-02-02T20:53:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05c013d60 con 0x7fc06c0f55e0 2022-02-02T20:53:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.284+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c10aaf0 con 0x7fc06c0f55e0 2022-02-02T20:53:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.285+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c0f4a70 con 0x7fc06c0f55e0 2022-02-02T20:53:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.286+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc05c01a060 con 0x7fc06c0f55e0 2022-02-02T20:53:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.286+0000 7fc061ffb700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 0x7fc058067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.286+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc05c081cb0 con 0x7fc06c0f55e0 2022-02-02T20:53:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.286+0000 7fc070a01700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 0x7fc058067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.287+0000 7fc070a01700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 0x7fc058067290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fc068009da0 tx=0x7fc068009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.290+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc05c04fdb0 con 0x7fc06c0f55e0 2022-02-02T20:53:44.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.519+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc06c0ffc00 con 0x7fc06c0f55e0 2022-02-02T20:53:44.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.519+0000 7fc061ffb700 1 -- 172.21.15.96:0/1504479210 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc05c018020 con 0x7fc06c0f55e0 2022-02-02T20:53:44.521 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:53:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:53:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:53:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:53:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:53:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:53:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:53:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:53:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:53:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:53:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:53:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:53:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:53:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:53:44.525 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:53:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.521+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 msgr2=0x7fc058067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.521+0000 7fc073466700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 0x7fc058067290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fc068009da0 tx=0x7fc068009b30).stop 2022-02-02T20:53:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.521+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 msgr2=0x7fc06c107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.521+0000 7fc073466700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7fc05c00c790 tx=0x7fc05c007d70).stop 2022-02-02T20:53:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 shutdown_connections 2022-02-02T20:53:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc058064dd0 0x7fc058067290 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc06c0f55e0 0x7fc06c107a80 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 --2- 172.21.15.96:0/1504479210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0f5ef0 0x7fc06c109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 >> 172.21.15.96:0/1504479210 conn(0x7fc06c0f0de0 msgr2=0x7fc06c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 shutdown_connections 2022-02-02T20:53:44.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.522+0000 7fc073466700 1 -- 172.21.15.96:0/1504479210 wait complete. 2022-02-02T20:53:44.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 -- 172.21.15.96:0/2909632816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f55c0 msgr2=0x7f50480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 --2- 172.21.15.96:0/2909632816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f55c0 0x7f50480f59e0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 rx=0x7f5038004660 tx=0x7f5038009b30).stop 2022-02-02T20:53:44.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 -- 172.21.15.96:0/2909632816 shutdown_connections 2022-02-02T20:53:44.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 --2- 172.21.15.96:0/2909632816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f6860 0x7f50480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 --2- 172.21.15.96:0/2909632816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f55c0 0x7f50480f59e0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 -- 172.21.15.96:0/2909632816 >> 172.21.15.96:0/2909632816 conn(0x7f50480f0d40 msgr2=0x7f50480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 -- 172.21.15.96:0/2909632816 shutdown_connections 2022-02-02T20:53:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 -- 172.21.15.96:0/2909632816 wait complete. 2022-02-02T20:53:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.620+0000 7f504faa6700 1 Processor -- start 2022-02-02T20:53:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504faa6700 1 -- start start 2022-02-02T20:53:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504faa6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504faa6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f6860 0x7f5048106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504faa6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048106910 con 0x7f50480f6860 2022-02-02T20:53:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504faa6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048106a50 con 0x7f50480f55c0 2022-02-02T20:53:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:43802/0 (socket says 172.21.15.96:43802) 2022-02-02T20:53:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 -- 172.21.15.96:0/1148345022 learned_addr learned my addr 172.21.15.96:0/1148345022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:53:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 -- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f6860 msgr2=0x7f5048106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f6860 0x7f5048106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:53:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 -- 172.21.15.96:0/1148345022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f50480f55c0 2022-02-02T20:53:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.621+0000 7f504d842700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5038013a70 tx=0x7f5038009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.624+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038018070 con 0x7f50480f55c0 2022-02-02T20:53:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.624+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f50380097d0 con 0x7f50480f55c0 2022-02-02T20:53:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.624+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048107390 con 0x7f50480f55c0 2022-02-02T20:53:44.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.624+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503801c3c0 con 0x7f50480f55c0 2022-02-02T20:53:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.624+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50481078f0 con 0x7f50480f55c0 2022-02-02T20:53:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.625+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048045ad0 con 0x7f50480f55c0 2022-02-02T20:53:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.626+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5038007ba0 con 0x7f50480f55c0 2022-02-02T20:53:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.626+0000 7f503e7fc700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 0x7f5034067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:53:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.626+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5038083640 con 0x7f50480f55c0 2022-02-02T20:53:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.626+0000 7f504d041700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 0x7f5034067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:53:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.626+0000 7f504d041700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 0x7f5034067290 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5044004a10 tx=0x7f50440099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:53:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.630+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5038055230 con 0x7f50480f55c0 2022-02-02T20:53:44.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.835+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5048027a00 con 0x7f50480f55c0 2022-02-02T20:53:44.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.836+0000 7f503e7fc700 1 -- 172.21.15.96:0/1148345022 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5038054e20 con 0x7f50480f55c0 2022-02-02T20:53:44.837 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:53:44.837 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:53:44.838 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:53:44.838 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:53:44.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:44.838 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:53:44.839 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:53:44.839 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:53:44.839 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:53:44.839 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:53:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:53:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:53:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:53:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:53:44.840 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:53:44.841 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:53:44.841 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:53:44.841 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:53:44.841 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:53:44.842 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:53:44.842 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:53:44.842 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:53:44.842 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:53:44.842 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:53:44.843 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:53:44.843 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:53:44.843 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:53:44.844 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:53:44.844 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:53:44.844 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:53:44.844 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:53:44.845 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:53:44.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:44.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:44.845 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:53:44.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:53:44.846 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:44.846 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:44.846 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:53:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.838+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 msgr2=0x7f5034067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.838+0000 7f504faa6700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 0x7f5034067290 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5044004a10 tx=0x7f50440099e0).stop 2022-02-02T20:53:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.838+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 msgr2=0x7f5048105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:53:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.838+0000 7f504faa6700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5038013a70 tx=0x7f5038009b30).stop 2022-02-02T20:53:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 shutdown_connections 2022-02-02T20:53:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5034064dd0 0x7f5034067290 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50480f55c0 0x7f5048105e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:53:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 --2- 172.21.15.96:0/1148345022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50480f6860 0x7f5048106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:53:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 >> 172.21.15.96:0/1148345022 conn(0x7f50480f0d40 msgr2=0x7f50480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:53:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 shutdown_connections 2022-02-02T20:53:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:53:44.839+0000 7f504faa6700 1 -- 172.21.15.96:0/1148345022 wait complete. 2022-02-02T20:53:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:53:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:44 smithi159 ceph-mon[69013]: pgmap v4549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:45.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:44 smithi159 ceph-mon[69013]: from='client.38772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:45.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1504479210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:53:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:44 smithi096 ceph-mon[101353]: pgmap v4549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:44 smithi096 ceph-mon[101353]: from='client.38772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1504479210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:53:46.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:45 smithi159 ceph-mon[69013]: from='client.38776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:46.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1148345022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:53:46.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:45 smithi096 ceph-mon[101353]: from='client.38776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:53:46.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1148345022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:53:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:46 smithi159 ceph-mon[69013]: pgmap v4550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:47.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:46 smithi096 ceph-mon[101353]: pgmap v4550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:48 smithi159 ceph-mon[69013]: pgmap v4551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:48 smithi096 ceph-mon[101353]: pgmap v4551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:50 smithi159 ceph-mon[69013]: pgmap v4552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:50 smithi096 ceph-mon[101353]: pgmap v4552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:52 smithi159 ceph-mon[69013]: pgmap v4553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:52 smithi096 ceph-mon[101353]: pgmap v4553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:54 smithi159 ceph-mon[69013]: pgmap v4554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:54 smithi096 ceph-mon[101353]: pgmap v4554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:56 smithi159 ceph-mon[69013]: pgmap v4555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:56 smithi096 ceph-mon[101353]: pgmap v4555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:58.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:53:58 smithi159 ceph-mon[69013]: pgmap v4556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:53:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:53:58 smithi096 ceph-mon[101353]: pgmap v4556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:00 smithi159 ceph-mon[69013]: pgmap v4557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:00 smithi096 ceph-mon[101353]: pgmap v4557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:02 smithi159 ceph-mon[69013]: pgmap v4558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:02 smithi096 ceph-mon[101353]: pgmap v4558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:04 smithi159 ceph-mon[69013]: pgmap v4559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:04 smithi096 ceph-mon[101353]: pgmap v4559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:06 smithi159 ceph-mon[69013]: pgmap v4560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:06 smithi096 ceph-mon[101353]: pgmap v4560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:08 smithi159 ceph-mon[69013]: pgmap v4561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:08 smithi096 ceph-mon[101353]: pgmap v4561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:10 smithi159 ceph-mon[69013]: pgmap v4562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:10 smithi096 ceph-mon[101353]: pgmap v4562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:12 smithi159 ceph-mon[69013]: pgmap v4563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:12 smithi096 ceph-mon[101353]: pgmap v4563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 -- 172.21.15.96:0/238391541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f77d0 msgr2=0x7f53b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 --2- 172.21.15.96:0/238391541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f77d0 0x7f53b00f7c30 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 rx=0x7f53a0004660 tx=0x7f53a0009b30).stop 2022-02-02T20:54:14.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 -- 172.21.15.96:0/238391541 shutdown_connections 2022-02-02T20:54:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 --2- 172.21.15.96:0/238391541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f77d0 0x7f53b00f7c30 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 --2- 172.21.15.96:0/238391541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f6530 0x7f53b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:14.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 -- 172.21.15.96:0/238391541 >> 172.21.15.96:0/238391541 conn(0x7f53b00f1c90 msgr2=0x7f53b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:14.953 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:14 smithi096 ceph-mon[101353]: pgmap v4564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:14.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 -- 172.21.15.96:0/238391541 shutdown_connections 2022-02-02T20:54:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.948+0000 7f53affff700 1 -- 172.21.15.96:0/238391541 wait complete. 2022-02-02T20:54:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 Processor -- start 2022-02-02T20:54:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 -- start start 2022-02-02T20:54:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f77d0 0x7f53b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b006a380 con 0x7f53b00f6530 2022-02-02T20:54:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53affff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b006a4c0 con 0x7f53b00f77d0 2022-02-02T20:54:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39720/0 (socket says 172.21.15.96:39720) 2022-02-02T20:54:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 -- 172.21.15.96:0/1266633643 learned_addr learned my addr 172.21.15.96:0/1266633643 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53ae7fc700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f77d0 0x7f53b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 -- 172.21.15.96:0/1266633643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f77d0 msgr2=0x7f53b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:14.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f77d0 0x7f53b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.949+0000 7f53aeffd700 1 -- 172.21.15.96:0/1266633643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0005040 con 0x7f53b00f6530 2022-02-02T20:54:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53aeffd700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7f53a400c790 tx=0x7f53a4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a4013630 con 0x7f53b00f6530 2022-02-02T20:54:14.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f53a4012860 con 0x7f53b00f6530 2022-02-02T20:54:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b006a7a0 con 0x7f53b00f6530 2022-02-02T20:54:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a4002780 con 0x7f53b00f6530 2022-02-02T20:54:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.950+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b010ed50 con 0x7f53b00f6530 2022-02-02T20:54:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.951+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b0045ad0 con 0x7f53b00f6530 2022-02-02T20:54:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.952+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f53a4010070 con 0x7f53b00f6530 2022-02-02T20:54:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.952+0000 7f53977fe700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 0x7f53980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.952+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f53a4081a20 con 0x7f53b00f6530 2022-02-02T20:54:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.952+0000 7f53ae7fc700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 0x7f53980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:14.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.952+0000 7f53ae7fc700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 0x7f53980672e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f53a0004630 tx=0x7f53a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:14.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:14.956+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f53a404fba0 con 0x7f53b00f6530 2022-02-02T20:54:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:14 smithi159 ceph-mon[69013]: pgmap v4564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.134+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53b00fee30 con 0x7f5398064e20 2022-02-02T20:54:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.135+0000 7f53977fe700 1 -- 172.21.15.96:0/1266633643 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f53b00fee30 con 0x7f5398064e20 2022-02-02T20:54:15.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 msgr2=0x7f53980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 0x7f53980672e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f53a0004630 tx=0x7f53a0009b30).stop 2022-02-02T20:54:15.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 msgr2=0x7f53b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7f53a400c790 tx=0x7f53a4007d90).stop 2022-02-02T20:54:15.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 shutdown_connections 2022-02-02T20:54:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5398064e20 0x7f53980672e0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53b00f6530 0x7f53b006b9a0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 --2- 172.21.15.96:0/1266633643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53b00f77d0 0x7f53b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 >> 172.21.15.96:0/1266633643 conn(0x7f53b00f1c90 msgr2=0x7f53b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 shutdown_connections 2022-02-02T20:54:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.137+0000 7f53affff700 1 -- 172.21.15.96:0/1266633643 wait complete. 2022-02-02T20:54:15.149 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:54:15.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 -- 172.21.15.96:0/2576275221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 msgr2=0x7f34800f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 --2- 172.21.15.96:0/2576275221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f34800f5850 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 rx=0x7f3474004660 tx=0x7f3474009b30).stop 2022-02-02T20:54:15.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 -- 172.21.15.96:0/2576275221 shutdown_connections 2022-02-02T20:54:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 --2- 172.21.15.96:0/2576275221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 0x7f34800f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:54:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 --2- 172.21.15.96:0/2576275221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f34800f5850 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 -- 172.21.15.96:0/2576275221 >> 172.21.15.96:0/2576275221 conn(0x7f34800f0b90 msgr2=0x7f34800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 -- 172.21.15.96:0/2576275221 shutdown_connections 2022-02-02T20:54:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.234+0000 7f34869cf700 1 -- 172.21.15.96:0/2576275221 wait complete. 2022-02-02T20:54:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 Processor -- start 2022-02-02T20:54:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 -- start start 2022-02-02T20:54:15.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 0x7f348010bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480060450 con 0x7f34800f5430 2022-02-02T20:54:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34869cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480060590 con 0x7f34800f66d0 2022-02-02T20:54:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34859cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34859cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39730/0 (socket says 172.21.15.96:39730) 2022-02-02T20:54:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.235+0000 7f34859cd700 1 -- 172.21.15.96:0/2346567421 learned_addr learned my addr 172.21.15.96:0/2346567421 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34851cc700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 0x7f348010bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34859cd700 1 -- 172.21.15.96:0/2346567421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 msgr2=0x7f348010bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34859cd700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 0x7f348010bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34859cd700 1 -- 172.21.15.96:0/2346567421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474005040 con 0x7f34800f5430 2022-02-02T20:54:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34859cd700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7f3474004f60 tx=0x7f3474009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3474018070 con 0x7f34800f5430 2022-02-02T20:54:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348010c580 con 0x7f34800f5430 2022-02-02T20:54:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f34740097d0 con 0x7f34800f5430 2022-02-02T20:54:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347401c3c0 con 0x7f34800f5430 2022-02-02T20:54:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.236+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348010cae0 con 0x7f34800f5430 2022-02-02T20:54:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.237+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480045ad0 con 0x7f34800f5430 2022-02-02T20:54:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.238+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3474007ba0 con 0x7f34800f5430 2022-02-02T20:54:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.238+0000 7f34727fc700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 0x7f346c0672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.238+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f34740836b0 con 0x7f34800f5430 2022-02-02T20:54:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.238+0000 7f34851cc700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 0x7f346c0672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.239+0000 7f34851cc700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 0x7f346c0672d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f347c006fd0 tx=0x7f347c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.242+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f34740517b0 con 0x7f34800f5430 2022-02-02T20:54:15.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.414+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34800fdde0 con 0x7f346c064e10 2022-02-02T20:54:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.423+0000 7f34727fc700 1 -- 172.21.15.96:0/2346567421 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f34800fdde0 con 0x7f346c064e10 2022-02-02T20:54:15.425 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:54:15.426 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:54:15.426 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:54:15.426 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:54:15.426 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:54:15.427 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:54:15.427 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:54:15.428 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:54:15.428 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:54:15.428 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:54:15.428 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:54:15.429 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:54:15.429 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:54:15.429 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:54:15.429 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:54:15.430 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:54:15.430 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:54:15.430 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:54:15.430 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:54:15.431 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:54:15.431 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:54:15.431 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:54:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 msgr2=0x7f346c0672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 0x7f346c0672d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f347c006fd0 tx=0x7f347c008040).stop 2022-02-02T20:54:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 msgr2=0x7f3480109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7f3474004f60 tx=0x7f3474009b30).stop 2022-02-02T20:54:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 shutdown_connections 2022-02-02T20:54:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f346c064e10 0x7f346c0672d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34800f5430 0x7f3480109ad0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 --2- 172.21.15.96:0/2346567421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34800f66d0 0x7f348010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 >> 172.21.15.96:0/2346567421 conn(0x7f34800f0b90 msgr2=0x7f34800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 shutdown_connections 2022-02-02T20:54:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.425+0000 7f34869cf700 1 -- 172.21.15.96:0/2346567421 wait complete. 2022-02-02T20:54:15.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1969294536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 msgr2=0x7f71cc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1969294536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc0f6b30 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 rx=0x7f71c0004660 tx=0x7f71c0009b30).stop 2022-02-02T20:54:15.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1969294536 shutdown_connections 2022-02-02T20:54:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1969294536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc0f6b30 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1969294536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1969294536 >> 172.21.15.96:0/1969294536 conn(0x7f71cc0f0b90 msgr2=0x7f71cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1969294536 shutdown_connections 2022-02-02T20:54:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.521+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1969294536 wait complete. 2022-02-02T20:54:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 Processor -- start 2022-02-02T20:54:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 -- start start 2022-02-02T20:54:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0603c0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71d0b5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc060500 con 0x7f71cc0f5430 2022-02-02T20:54:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.522+0000 7f71caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39742/0 (socket says 172.21.15.96:39742) 2022-02-02T20:54:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 -- 172.21.15.96:0/1798660435 learned_addr learned my addr 172.21.15.96:0/1798660435 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71cb7fe700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 -- 172.21.15.96:0/1798660435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 msgr2=0x7f71cc109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc109a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 -- 172.21.15.96:0/1798660435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0005040 con 0x7f71cc0f66d0 2022-02-02T20:54:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71cb7fe700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:54:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71caffd700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7f71c0009990 tx=0x7f71c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c0018070 con 0x7f71cc0f66d0 2022-02-02T20:54:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc10c4c0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71c0007ca0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c001c620 con 0x7f71cc0f66d0 2022-02-02T20:54:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.523+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc10c9f0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.524+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac004fa0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.525+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71c001c8e0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.525+0000 7f71b3fff700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 0x7f71b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.525+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71c00837d0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.525+0000 7f71cb7fe700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 0x7f71b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.526+0000 7f71cb7fe700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 0x7f71b40672e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f71bc0041d0 tx=0x7f71bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.529+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71c00529e0 con 0x7f71cc0f66d0 2022-02-02T20:54:15.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.760+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71ac005e80 con 0x7f71cc0f66d0 2022-02-02T20:54:15.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.760+0000 7f71b3fff700 1 -- 172.21.15.96:0/1798660435 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f71c001d460 con 0x7f71cc0f66d0 2022-02-02T20:54:15.763 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:54:15.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:54:15.764 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:54:15.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:15.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:54:15.764 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:54:15.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:15.765 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:54:15.765 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:54:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:54:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:54:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:15.766 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:54:15.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:54:15.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:54:15.767 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:54:15.767 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:54:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 msgr2=0x7f71b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 0x7f71b40672e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f71bc0041d0 tx=0x7f71bc009040).stop 2022-02-02T20:54:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 msgr2=0x7f71cc10bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7f71c0009990 tx=0x7f71c0009b30).stop 2022-02-02T20:54:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 shutdown_connections 2022-02-02T20:54:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71b4064e20 0x7f71b40672e0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71cc0f5430 0x7f71cc109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 --2- 172.21.15.96:0/1798660435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71cc0f66d0 0x7f71cc10bf70 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 >> 172.21.15.96:0/1798660435 conn(0x7f71cc0f0b90 msgr2=0x7f71cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.762+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 shutdown_connections 2022-02-02T20:54:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.763+0000 7f71d0b5e700 1 -- 172.21.15.96:0/1798660435 wait complete. 2022-02-02T20:54:15.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 -- 172.21.15.96:0/796738934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f7980 msgr2=0x7fc6840f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 --2- 172.21.15.96:0/796738934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f7980 0x7fc6840f7de0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 rx=0x7fc674004660 tx=0x7fc674009b30).stop 2022-02-02T20:54:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 -- 172.21.15.96:0/796738934 shutdown_connections 2022-02-02T20:54:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 --2- 172.21.15.96:0/796738934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f7980 0x7fc6840f7de0 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 --2- 172.21.15.96:0/796738934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66e0 0x7fc6840f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 -- 172.21.15.96:0/796738934 >> 172.21.15.96:0/796738934 conn(0x7fc6840f1e40 msgr2=0x7fc6840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 -- 172.21.15.96:0/796738934 shutdown_connections 2022-02-02T20:54:15.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.861+0000 7fc689ea1700 1 -- 172.21.15.96:0/796738934 wait complete. 2022-02-02T20:54:15.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 Processor -- start 2022-02-02T20:54:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 -- start start 2022-02-02T20:54:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f7980 0x7fc684107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684107a00 con 0x7fc6840f66e0 2022-02-02T20:54:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc689ea1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684107b40 con 0x7fc6840f7980 2022-02-02T20:54:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc6837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc6837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39750/0 (socket says 172.21.15.96:39750) 2022-02-02T20:54:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.862+0000 7fc6837fe700 1 -- 172.21.15.96:0/1889619266 learned_addr learned my addr 172.21.15.96:0/1889619266 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:15.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc682ffd700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f7980 0x7fc684107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc6837fe700 1 -- 172.21.15.96:0/1889619266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f7980 msgr2=0x7fc684107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:15.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc6837fe700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f7980 0x7fc684107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:15.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc6837fe700 1 -- 172.21.15.96:0/1889619266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674005040 con 0x7fc6840f66e0 2022-02-02T20:54:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc6837fe700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 rx=0x7fc678002700 tx=0x7fc678009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc678009320 con 0x7fc6840f66e0 2022-02-02T20:54:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6841084e0 con 0x7fc6840f66e0 2022-02-02T20:54:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc67800f040 con 0x7fc6840f66e0 2022-02-02T20:54:15.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc678014900 con 0x7fc6840f66e0 2022-02-02T20:54:15.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.863+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684108aa0 con 0x7fc6840f66e0 2022-02-02T20:54:15.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.864+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684045ad0 con 0x7fc6840f66e0 2022-02-02T20:54:15.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.864+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc678009480 con 0x7fc6840f66e0 2022-02-02T20:54:15.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.865+0000 7fc66bfff700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 0x7fc66c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:15.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.865+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc678081cc0 con 0x7fc6840f66e0 2022-02-02T20:54:15.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.865+0000 7fc682ffd700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 0x7fc66c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:15.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.865+0000 7fc682ffd700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 0x7fc66c067290 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fc674009da0 tx=0x7fc674009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:15.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:15.869+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc6780538b0 con 0x7fc6840f66e0 2022-02-02T20:54:16.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.070+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6840ff020 con 0x7fc6840f66e0 2022-02-02T20:54:16.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.071+0000 7fc66bfff700 1 -- 172.21.15.96:0/1889619266 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc6780534a0 con 0x7fc6840f66e0 2022-02-02T20:54:16.074 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:54:16.074 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:54:16.074 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:54:16.074 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:54:16.075 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:16.075 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:54:16.075 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:54:16.075 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:54:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:54:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:54:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:54:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:54:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:54:16.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:54:16.077 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:54:16.077 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:54:16.077 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:54:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:54:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:54:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:54:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:54:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:54:16.079 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:54:16.079 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:54:16.079 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:54:16.079 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:54:16.079 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:54:16.080 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:54:16.080 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:54:16.080 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:54:16.080 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:54:16.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:54:16.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:16.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:16.081 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:54:16.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:16.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:16.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:16.082 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:16.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 msgr2=0x7fc66c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:16.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 0x7fc66c067290 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fc674009da0 tx=0x7fc674009b30).stop 2022-02-02T20:54:16.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 msgr2=0x7fc684106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:16.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 rx=0x7fc678002700 tx=0x7fc678009d80).stop 2022-02-02T20:54:16.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 shutdown_connections 2022-02-02T20:54:16.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc66c064dd0 0x7fc66c067290 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:16.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f66e0 0x7fc684106f60 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:16.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 --2- 172.21.15.96:0/1889619266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f7980 0x7fc684107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:16.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 >> 172.21.15.96:0/1889619266 conn(0x7fc6840f1e40 msgr2=0x7fc6840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:16.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 shutdown_connections 2022-02-02T20:54:16.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:16.074+0000 7fc689ea1700 1 -- 172.21.15.96:0/1889619266 wait complete. 2022-02-02T20:54:16.085 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:54:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:16 smithi159 ceph-mon[69013]: from='client.38786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:16 smithi159 ceph-mon[69013]: from='client.38790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:16 smithi159 ceph-mon[69013]: pgmap v4565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1798660435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:54:17.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1889619266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:54:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:16 smithi096 ceph-mon[101353]: from='client.38786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:16 smithi096 ceph-mon[101353]: from='client.38790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:16 smithi096 ceph-mon[101353]: pgmap v4565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1798660435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:54:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1889619266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:54:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:18 smithi159 ceph-mon[69013]: pgmap v4566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:18 smithi096 ceph-mon[101353]: pgmap v4566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:20 smithi159 ceph-mon[69013]: pgmap v4567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:20 smithi096 ceph-mon[101353]: pgmap v4567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:22 smithi159 ceph-mon[69013]: pgmap v4568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:23.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:22 smithi096 ceph-mon[101353]: pgmap v4568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:24 smithi159 ceph-mon[69013]: pgmap v4569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:24 smithi096 ceph-mon[101353]: pgmap v4569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:26 smithi159 ceph-mon[69013]: pgmap v4570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:26 smithi096 ceph-mon[101353]: pgmap v4570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:54:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:54:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:28 smithi159 ceph-mon[69013]: pgmap v4571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:54:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:54:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:28 smithi096 ceph-mon[101353]: pgmap v4571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:30 smithi159 ceph-mon[69013]: pgmap v4572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:30 smithi096 ceph-mon[101353]: pgmap v4572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:32 smithi159 ceph-mon[69013]: pgmap v4573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:32 smithi096 ceph-mon[101353]: pgmap v4573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:34 smithi159 ceph-mon[69013]: pgmap v4574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:34 smithi096 ceph-mon[101353]: pgmap v4574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:36 smithi159 ceph-mon[69013]: pgmap v4575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:36 smithi096 ceph-mon[101353]: pgmap v4575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:38 smithi159 ceph-mon[69013]: pgmap v4576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:38 smithi096 ceph-mon[101353]: pgmap v4576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:40 smithi159 ceph-mon[69013]: pgmap v4577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:40 smithi096 ceph-mon[101353]: pgmap v4577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:42 smithi159 ceph-mon[69013]: pgmap v4578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:42 smithi096 ceph-mon[101353]: pgmap v4578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:44 smithi159 ceph-mon[69013]: pgmap v4579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:44 smithi096 ceph-mon[101353]: pgmap v4579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:46.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- 172.21.15.96:0/4275995529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c060290 msgr2=0x7f601c0fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 --2- 172.21.15.96:0/4275995529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c060290 0x7f601c0fb590 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 rx=0x7f6018004690 tx=0x7f6018009b30).stop 2022-02-02T20:54:46.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- 172.21.15.96:0/4275995529 shutdown_connections 2022-02-02T20:54:46.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 --2- 172.21.15.96:0/4275995529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c0fba80 0x7f601c0fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 --2- 172.21.15.96:0/4275995529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c060290 0x7f601c0fb590 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- 172.21.15.96:0/4275995529 >> 172.21.15.96:0/4275995529 conn(0x7f601c0f0b90 msgr2=0x7f601c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:46.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- 172.21.15.96:0/4275995529 shutdown_connections 2022-02-02T20:54:46.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- 172.21.15.96:0/4275995529 wait complete. 2022-02-02T20:54:46.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 Processor -- start 2022-02-02T20:54:46.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.186+0000 7f6022229700 1 -- start start 2022-02-02T20:54:46.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6022229700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c060290 0x7f601c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6022229700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6022229700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c109990 con 0x7f601c0fba80 2022-02-02T20:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6022229700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c109ad0 con 0x7f601c060290 2022-02-02T20:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39772/0 (socket says 172.21.15.96:39772) 2022-02-02T20:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 -- 172.21.15.96:0/1086492608 learned_addr learned my addr 172.21.15.96:0/1086492608 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6021227700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c060290 0x7f601c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 -- 172.21.15.96:0/1086492608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c060290 msgr2=0x7f601c108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c060290 0x7f601c108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 -- 172.21.15.96:0/1086492608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018005040 con 0x7f601c0fba80 2022-02-02T20:54:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6020a26700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7f600c002700 tx=0x7f600c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c0079c0 con 0x7f601c0fba80 2022-02-02T20:54:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.187+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c10a470 con 0x7f601c0fba80 2022-02-02T20:54:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.188+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f600c00f040 con 0x7f601c0fba80 2022-02-02T20:54:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.188+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c013640 con 0x7f601c0fba80 2022-02-02T20:54:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.188+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c10aa30 con 0x7f601c0fba80 2022-02-02T20:54:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.189+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c045ad0 con 0x7f601c0fba80 2022-02-02T20:54:46.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.189+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f600c01b060 con 0x7f601c0fba80 2022-02-02T20:54:46.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.189+0000 7f6011ffb700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 0x7f60080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.189+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f600c081530 con 0x7f601c0fba80 2022-02-02T20:54:46.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.189+0000 7f6021227700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 0x7f60080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.190+0000 7f6021227700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 0x7f60080672e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6018000c00 tx=0x7f6018009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.194+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f600c053060 con 0x7f601c0fba80 2022-02-02T20:54:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.373+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f601c10acb0 con 0x7f6008064e20 2022-02-02T20:54:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.374+0000 7f6011ffb700 1 -- 172.21.15.96:0/1086492608 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f601c10acb0 con 0x7f6008064e20 2022-02-02T20:54:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.375+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 msgr2=0x7f60080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 0x7f60080672e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6018000c00 tx=0x7f6018009b30).stop 2022-02-02T20:54:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 msgr2=0x7f601c1093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7f600c002700 tx=0x7f600c009d60).stop 2022-02-02T20:54:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 shutdown_connections 2022-02-02T20:54:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6008064e20 0x7f60080672e0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f601c060290 0x7f601c108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 --2- 172.21.15.96:0/1086492608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f601c0fba80 0x7f601c1093e0 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 >> 172.21.15.96:0/1086492608 conn(0x7f601c0f0b90 msgr2=0x7f601c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 shutdown_connections 2022-02-02T20:54:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.376+0000 7f6022229700 1 -- 172.21.15.96:0/1086492608 wait complete. 2022-02-02T20:54:46.386 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:54:46.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 -- 172.21.15.96:0/4129498367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 msgr2=0x7f25300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 --2- 172.21.15.96:0/4129498367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25300f7c30 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 rx=0x7f2524004660 tx=0x7f2524009b30).stop 2022-02-02T20:54:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 -- 172.21.15.96:0/4129498367 shutdown_connections 2022-02-02T20:54:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 --2- 172.21.15.96:0/4129498367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25300f7c30 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 --2- 172.21.15.96:0/4129498367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 0x7f25300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:54:46.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 -- 172.21.15.96:0/4129498367 >> 172.21.15.96:0/4129498367 conn(0x7f25300f1c90 msgr2=0x7f25300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:46.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 -- 172.21.15.96:0/4129498367 shutdown_connections 2022-02-02T20:54:46.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.474+0000 7f252ffff700 1 -- 172.21.15.96:0/4129498367 wait complete. 2022-02-02T20:54:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.475+0000 7f252ffff700 1 Processor -- start 2022-02-02T20:54:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.475+0000 7f252ffff700 1 -- start start 2022-02-02T20:54:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.475+0000 7f252ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 0x7f2530106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252ffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530107980 con 0x7f25300f77d0 2022-02-02T20:54:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530108100 con 0x7f25300f6530 2022-02-02T20:54:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39788/0 (socket says 172.21.15.96:39788) 2022-02-02T20:54:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 -- 172.21.15.96:0/1618311802 learned_addr learned my addr 172.21.15.96:0/1618311802 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252effd700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 0x7f2530106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 -- 172.21.15.96:0/1618311802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 msgr2=0x7f2530106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 0x7f2530106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 -- 172.21.15.96:0/1618311802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524005040 con 0x7f25300f77d0 2022-02-02T20:54:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252e7fc700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7f2524009990 tx=0x7f2524009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2524018070 con 0x7f25300f77d0 2022-02-02T20:54:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2530108320 con 0x7f25300f77d0 2022-02-02T20:54:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2524007ca0 con 0x7f25300f77d0 2022-02-02T20:54:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252401c620 con 0x7f25300f77d0 2022-02-02T20:54:46.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.476+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2530108880 con 0x7f25300f77d0 2022-02-02T20:54:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.478+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530045ad0 con 0x7f25300f77d0 2022-02-02T20:54:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.478+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f252401d960 con 0x7f25300f77d0 2022-02-02T20:54:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.478+0000 7f25177fe700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 0x7f25180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.479+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f25240837d0 con 0x7f25300f77d0 2022-02-02T20:54:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.479+0000 7f252effd700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 0x7f25180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.479+0000 7f252effd700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 0x7f25180672e0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f2530106b70 tx=0x7f2520008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.483+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2524051a40 con 0x7f25300f77d0 2022-02-02T20:54:46.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.658+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f25300fef40 con 0x7f2518064e20 2022-02-02T20:54:46.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.667+0000 7f25177fe700 1 -- 172.21.15.96:0/1618311802 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f252000b3b0 con 0x7f2518064e20 2022-02-02T20:54:46.669 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:54:46.669 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:54:46.669 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:54:46.669 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:54:46.670 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:54:46.670 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:54:46.670 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:54:46.671 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:54:46.671 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:54:46.671 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:54:46.671 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:54:46.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:54:46.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:54:46.672 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:54:46.672 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:54:46.672 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:54:46.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:54:46.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:54:46.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:54:46.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:54:46.674 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:54:46.674 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:54:46.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 msgr2=0x7f25180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 0x7f25180672e0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f2530106b70 tx=0x7f2520008040).stop 2022-02-02T20:54:46.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 msgr2=0x7f25301072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7f2524009990 tx=0x7f2524009b30).stop 2022-02-02T20:54:46.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 shutdown_connections 2022-02-02T20:54:46.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2518064e20 0x7f25180672e0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25300f6530 0x7f2530106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 --2- 172.21.15.96:0/1618311802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25300f77d0 0x7f25301072f0 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 >> 172.21.15.96:0/1618311802 conn(0x7f25300f1c90 msgr2=0x7f25300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:46.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 shutdown_connections 2022-02-02T20:54:46.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.670+0000 7f252ffff700 1 -- 172.21.15.96:0/1618311802 wait complete. 2022-02-02T20:54:46.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 -- 172.21.15.96:0/165592987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f7980 msgr2=0x7fee100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 --2- 172.21.15.96:0/165592987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f7980 0x7fee100f7de0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 rx=0x7fee00004660 tx=0x7fee00009b30).stop 2022-02-02T20:54:46.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 -- 172.21.15.96:0/165592987 shutdown_connections 2022-02-02T20:54:46.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 --2- 172.21.15.96:0/165592987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f7980 0x7fee100f7de0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 --2- 172.21.15.96:0/165592987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f66e0 0x7fee100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 -- 172.21.15.96:0/165592987 >> 172.21.15.96:0/165592987 conn(0x7fee100f1e40 msgr2=0x7fee100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:46.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:46 smithi096 ceph-mon[101353]: pgmap v4580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 -- 172.21.15.96:0/165592987 shutdown_connections 2022-02-02T20:54:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.767+0000 7fee159e0700 1 -- 172.21.15.96:0/165592987 wait complete. 2022-02-02T20:54:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 Processor -- start 2022-02-02T20:54:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 -- start start 2022-02-02T20:54:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 0x7fee10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a380 con 0x7fee100f66e0 2022-02-02T20:54:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee159e0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a4c0 con 0x7fee100f7980 2022-02-02T20:54:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39794/0 (socket says 172.21.15.96:39794) 2022-02-02T20:54:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 -- 172.21.15.96:0/3783310027 learned_addr learned my addr 172.21.15.96:0/3783310027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0e7fc700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 0x7fee10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 -- 172.21.15.96:0/3783310027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 msgr2=0x7fee10069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 0x7fee10069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0effd700 1 -- 172.21.15.96:0/3783310027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00005040 con 0x7fee100f66e0 2022-02-02T20:54:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.768+0000 7fee0e7fc700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 0x7fee10069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:54:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fee0effd700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 rx=0x7fee04002700 tx=0x7fee04009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee04009320 con 0x7fee100f66e0 2022-02-02T20:54:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee0400f040 con 0x7fee100f66e0 2022-02-02T20:54:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1006a7a0 con 0x7fee100f66e0 2022-02-02T20:54:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1010ef90 con 0x7fee100f66e0 2022-02-02T20:54:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.769+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee04014900 con 0x7fee100f66e0 2022-02-02T20:54:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.770+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee040077b0 con 0x7fee100f66e0 2022-02-02T20:54:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.770+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10045ad0 con 0x7fee100f66e0 2022-02-02T20:54:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.770+0000 7fedf77fe700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 0x7fedf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.771+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fee04081ca0 con 0x7fee100f66e0 2022-02-02T20:54:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.771+0000 7fee0e7fc700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 0x7fedf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.771+0000 7fee0e7fc700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 0x7fedf8067290 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fee00009da0 tx=0x7fee00009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:46.775+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee04086070 con 0x7fee100f66e0 2022-02-02T20:54:47.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.004+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee100fef70 con 0x7fee100f66e0 2022-02-02T20:54:47.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.005+0000 7fedf77fe700 1 -- 172.21.15.96:0/3783310027 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fee0404fda0 con 0x7fee100f66e0 2022-02-02T20:54:47.006 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:54:47.007 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:54:47.007 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:54:47.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:47.007 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:54:47.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:54:47.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:47.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:54:47.008 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:54:47.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:47.009 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:54:47.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:54:47.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:54:47.010 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:54:47.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:54:47.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:54:47.010 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:54:47.011 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:54:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 msgr2=0x7fedf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 0x7fedf8067290 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fee00009da0 tx=0x7fee00009b30).stop 2022-02-02T20:54:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 msgr2=0x7fee1006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 rx=0x7fee04002700 tx=0x7fee04009d80).stop 2022-02-02T20:54:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 shutdown_connections 2022-02-02T20:54:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fedf8064dd0 0x7fedf8067290 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f66e0 0x7fee1006b9a0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 --2- 172.21.15.96:0/3783310027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f7980 0x7fee10069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 >> 172.21.15.96:0/3783310027 conn(0x7fee100f1e40 msgr2=0x7fee100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:47.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 shutdown_connections 2022-02-02T20:54:47.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.007+0000 7fee159e0700 1 -- 172.21.15.96:0/3783310027 wait complete. 2022-02-02T20:54:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:46 smithi159 ceph-mon[69013]: pgmap v4580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:47.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 -- 172.21.15.96:0/553575129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f7980 msgr2=0x7f496c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 --2- 172.21.15.96:0/553575129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f7980 0x7f496c0f7de0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 rx=0x7f4958004660 tx=0x7f4958009b30).stop 2022-02-02T20:54:47.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 -- 172.21.15.96:0/553575129 shutdown_connections 2022-02-02T20:54:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 --2- 172.21.15.96:0/553575129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f7980 0x7f496c0f7de0 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 --2- 172.21.15.96:0/553575129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f66e0 0x7f496c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:54:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 -- 172.21.15.96:0/553575129 >> 172.21.15.96:0/553575129 conn(0x7f496c0f1e40 msgr2=0x7f496c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 -- 172.21.15.96:0/553575129 shutdown_connections 2022-02-02T20:54:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.106+0000 7f4972c51700 1 -- 172.21.15.96:0/553575129 wait complete. 2022-02-02T20:54:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 Processor -- start 2022-02-02T20:54:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 -- start start 2022-02-02T20:54:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f7980 0x7f496c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c107ae0 con 0x7f496c0f66e0 2022-02-02T20:54:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f4972c51700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c108390 con 0x7f496c0f7980 2022-02-02T20:54:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39802/0 (socket says 172.21.15.96:39802) 2022-02-02T20:54:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 -- 172.21.15.96:0/372739065 learned_addr learned my addr 172.21.15.96:0/372739065 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:54:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f496bfff700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f7980 0x7f496c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 -- 172.21.15.96:0/372739065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f7980 msgr2=0x7f496c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f7980 0x7f496c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.107+0000 7f49709ed700 1 -- 172.21.15.96:0/372739065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958005040 con 0x7f496c0f66e0 2022-02-02T20:54:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f49709ed700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 rx=0x7f49600093f0 tx=0x7f4960006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4960013640 con 0x7f496c0f66e0 2022-02-02T20:54:47.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4960013c50 con 0x7f496c0f66e0 2022-02-02T20:54:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4960012c70 con 0x7f496c0f66e0 2022-02-02T20:54:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c108670 con 0x7f496c0f66e0 2022-02-02T20:54:47.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.108+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c108c30 con 0x7f496c0f66e0 2022-02-02T20:54:47.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.109+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f496001a060 con 0x7f496c0f66e0 2022-02-02T20:54:47.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.109+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c0f5ad0 con 0x7f496c0f66e0 2022-02-02T20:54:47.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.110+0000 7f49697fa700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:54:47.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.110+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49600819b0 con 0x7f496c0f66e0 2022-02-02T20:54:47.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.110+0000 7f496bfff700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:54:47.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.110+0000 7f496bfff700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 0x7f495c067290 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f4958004630 tx=0x7f4958009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:54:47.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.114+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4960053480 con 0x7f496c0f66e0 2022-02-02T20:54:47.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.314+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f496c0ff000 con 0x7f496c0f66e0 2022-02-02T20:54:47.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.314+0000 7f49697fa700 1 -- 172.21.15.96:0/372739065 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4960053070 con 0x7f496c0f66e0 2022-02-02T20:54:47.316 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:54:47.316 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:54:47.316 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:54:47.316 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:54:47.317 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:47.317 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:54:47.317 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:54:47.317 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:54:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:54:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:54:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:54:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:54:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:54:47.319 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:54:47.319 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:54:47.319 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:54:47.319 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:54:47.320 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:54:47.320 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:54:47.320 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:54:47.320 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:54:47.320 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:54:47.321 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:54:47.321 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:54:47.321 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:54:47.321 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:54:47.321 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:54:47.322 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:54:47.322 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:54:47.322 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:54:47.322 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:54:47.323 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:54:47.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:47.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:47.323 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:54:47.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:54:47.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:47.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:47.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 msgr2=0x7f495c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 0x7f495c067290 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f4958004630 tx=0x7f4958009b30).stop 2022-02-02T20:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 msgr2=0x7f496c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:54:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 rx=0x7f49600093f0 tx=0x7f4960006ec0).stop 2022-02-02T20:54:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 shutdown_connections 2022-02-02T20:54:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f496c0f66e0 0x7f496c106fb0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 --2- 172.21.15.96:0/372739065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f496c0f7980 0x7f496c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:54:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 >> 172.21.15.96:0/372739065 conn(0x7f496c0f1e40 msgr2=0x7f496c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:54:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 shutdown_connections 2022-02-02T20:54:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:54:47.316+0000 7f4972c51700 1 -- 172.21.15.96:0/372739065 wait complete. 2022-02-02T20:54:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:54:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:47 smithi159 ceph-mon[69013]: from='client.38802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:47 smithi159 ceph-mon[69013]: from='client.38806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3783310027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:54:48.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/372739065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:54:48.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:47 smithi096 ceph-mon[101353]: from='client.38802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:47 smithi096 ceph-mon[101353]: from='client.38806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:54:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3783310027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:54:48.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/372739065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:54:49.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:48 smithi159 ceph-mon[69013]: pgmap v4581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:48 smithi096 ceph-mon[101353]: pgmap v4581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:50 smithi159 ceph-mon[69013]: pgmap v4582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:50 smithi096 ceph-mon[101353]: pgmap v4582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:52 smithi159 ceph-mon[69013]: pgmap v4583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:52 smithi096 ceph-mon[101353]: pgmap v4583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:54 smithi159 ceph-mon[69013]: pgmap v4584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:54 smithi096 ceph-mon[101353]: pgmap v4584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:56 smithi159 ceph-mon[69013]: pgmap v4585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:56 smithi096 ceph-mon[101353]: pgmap v4585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:54:58 smithi159 ceph-mon[69013]: pgmap v4586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:54:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:54:58 smithi096 ceph-mon[101353]: pgmap v4586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:00 smithi159 ceph-mon[69013]: pgmap v4587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:00 smithi096 ceph-mon[101353]: pgmap v4587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:02 smithi159 ceph-mon[69013]: pgmap v4588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:02 smithi096 ceph-mon[101353]: pgmap v4588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:04 smithi159 ceph-mon[69013]: pgmap v4589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:04 smithi096 ceph-mon[101353]: pgmap v4589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:06 smithi159 ceph-mon[69013]: pgmap v4590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:06 smithi096 ceph-mon[101353]: pgmap v4590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:08 smithi159 ceph-mon[69013]: pgmap v4591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:08 smithi096 ceph-mon[101353]: pgmap v4591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:10 smithi159 ceph-mon[69013]: pgmap v4592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:10 smithi096 ceph-mon[101353]: pgmap v4592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:12 smithi159 ceph-mon[69013]: pgmap v4593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:12 smithi096 ceph-mon[101353]: pgmap v4593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:14 smithi159 ceph-mon[69013]: pgmap v4594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:14 smithi096 ceph-mon[101353]: pgmap v4594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:16 smithi159 ceph-mon[69013]: pgmap v4595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:16 smithi096 ceph-mon[101353]: pgmap v4595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 -- 172.21.15.96:0/1840604303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 msgr2=0x7f52340f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 --2- 172.21.15.96:0/1840604303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f52340f6cd0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 rx=0x7f5220004660 tx=0x7f5220009b30).stop 2022-02-02T20:55:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 -- 172.21.15.96:0/1840604303 shutdown_connections 2022-02-02T20:55:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 --2- 172.21.15.96:0/1840604303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f52340f6cd0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 --2- 172.21.15.96:0/1840604303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 0x7f52340f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 -- 172.21.15.96:0/1840604303 >> 172.21.15.96:0/1840604303 conn(0x7f52340f0d70 msgr2=0x7f52340f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 -- 172.21.15.96:0/1840604303 shutdown_connections 2022-02-02T20:55:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.427+0000 7f523aff8700 1 -- 172.21.15.96:0/1840604303 wait complete. 2022-02-02T20:55:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 Processor -- start 2022-02-02T20:55:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 -- start start 2022-02-02T20:55:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 0x7f5234109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340604a0 con 0x7f52340f6870 2022-02-02T20:55:17.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.428+0000 7f523aff8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340605e0 con 0x7f52340f55d0 2022-02-02T20:55:17.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39824/0 (socket says 172.21.15.96:39824) 2022-02-02T20:55:17.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 -- 172.21.15.96:0/1816398251 learned_addr learned my addr 172.21.15.96:0/1816398251 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:17.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5238d94700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 0x7f5234109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 -- 172.21.15.96:0/1816398251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 msgr2=0x7f5234109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 0x7f5234109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 -- 172.21.15.96:0/1816398251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220005040 con 0x7f52340f6870 2022-02-02T20:55:17.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f5233fff700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 rx=0x7f5220009990 tx=0x7f5220009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:17.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5220018070 con 0x7f52340f6870 2022-02-02T20:55:17.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523410c610 con 0x7f52340f6870 2022-02-02T20:55:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5220007ba0 con 0x7f52340f6870 2022-02-02T20:55:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522001c3c0 con 0x7f52340f6870 2022-02-02T20:55:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.429+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523410cb40 con 0x7f52340f6870 2022-02-02T20:55:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.430+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52340f49c0 con 0x7f52340f6870 2022-02-02T20:55:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.431+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f522001d420 con 0x7f52340f6870 2022-02-02T20:55:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.431+0000 7f52317fa700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 0x7f5224067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.431+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52200836a0 con 0x7f52340f6870 2022-02-02T20:55:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.431+0000 7f5238d94700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 0x7f5224067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.432+0000 7f5238d94700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 0x7f5224067290 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f5234060120 tx=0x7f522800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.435+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5220051860 con 0x7f52340f6870 2022-02-02T20:55:17.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.615+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52340fdf10 con 0x7f5224064dd0 2022-02-02T20:55:17.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.616+0000 7f52317fa700 1 -- 172.21.15.96:0/1816398251 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f52340fdf10 con 0x7f5224064dd0 2022-02-02T20:55:17.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.617+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 msgr2=0x7f5224067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.617+0000 7f523aff8700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 0x7f5224067290 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f5234060120 tx=0x7f522800b040).stop 2022-02-02T20:55:17.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.617+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 msgr2=0x7f523410c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.617+0000 7f523aff8700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 rx=0x7f5220009990 tx=0x7f5220009b30).stop 2022-02-02T20:55:17.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 shutdown_connections 2022-02-02T20:55:17.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5224064dd0 0x7f5224067290 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52340f55d0 0x7f5234109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 --2- 172.21.15.96:0/1816398251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52340f6870 0x7f523410c0c0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 >> 172.21.15.96:0/1816398251 conn(0x7f52340f0d70 msgr2=0x7f52340fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:17.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 shutdown_connections 2022-02-02T20:55:17.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.618+0000 7f523aff8700 1 -- 172.21.15.96:0/1816398251 wait complete. 2022-02-02T20:55:17.628 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:55:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 -- 172.21.15.96:0/4056080965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f5430 msgr2=0x7f8fc80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/4056080965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f5430 0x7f8fc80f5850 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 rx=0x7f8fbc004660 tx=0x7f8fbc009b30).stop 2022-02-02T20:55:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 -- 172.21.15.96:0/4056080965 shutdown_connections 2022-02-02T20:55:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/4056080965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f66d0 0x7f8fc80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/4056080965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f5430 0x7f8fc80f5850 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 -- 172.21.15.96:0/4056080965 >> 172.21.15.96:0/4056080965 conn(0x7f8fc80f0b90 msgr2=0x7f8fc80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 -- 172.21.15.96:0/4056080965 shutdown_connections 2022-02-02T20:55:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.715+0000 7f8fcde7e700 1 -- 172.21.15.96:0/4056080965 wait complete. 2022-02-02T20:55:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 Processor -- start 2022-02-02T20:55:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 -- start start 2022-02-02T20:55:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f5430 0x7f8fc8109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80603c0 con 0x7f8fc80f66d0 2022-02-02T20:55:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.716+0000 7f8fcde7e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8060500 con 0x7f8fc80f5430 2022-02-02T20:55:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39834/0 (socket says 172.21.15.96:39834) 2022-02-02T20:55:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 -- 172.21.15.96:0/2879136546 learned_addr learned my addr 172.21.15.96:0/2879136546 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:17.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fcce7c700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f5430 0x7f8fc8109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 -- 172.21.15.96:0/2879136546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f5430 msgr2=0x7f8fc8109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f5430 0x7f8fc8109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 -- 172.21.15.96:0/2879136546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc005040 con 0x7f8fc80f66d0 2022-02-02T20:55:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc7fff700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7f8fb40026d0 tx=0x7f8fb4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:17.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb40079c0 con 0x7f8fc80f66d0 2022-02-02T20:55:17.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8fb400f040 con 0x7f8fc80f66d0 2022-02-02T20:55:17.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc810c560 con 0x7f8fc80f66d0 2022-02-02T20:55:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.717+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb40148b0 con 0x7f8fc80f66d0 2022-02-02T20:55:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.718+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc810caf0 con 0x7f8fc80f66d0 2022-02-02T20:55:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.719+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8fb4007b20 con 0x7f8fc80f66d0 2022-02-02T20:55:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.719+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc8059100 con 0x7f8fc80f66d0 2022-02-02T20:55:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.719+0000 7f8fc57fa700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 0x7f8fb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.719+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8fb4081a10 con 0x7f8fc80f66d0 2022-02-02T20:55:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.719+0000 7f8fcce7c700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 0x7f8fb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.720+0000 7f8fcce7c700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 0x7f8fb80672e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f8fbc013690 tx=0x7f8fbc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.724+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8fb404fb10 con 0x7f8fc80f66d0 2022-02-02T20:55:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.897+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fc80fdda0 con 0x7f8fb8064e20 2022-02-02T20:55:17.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.906+0000 7f8fc57fa700 1 -- 172.21.15.96:0/2879136546 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8fbc019040 con 0x7f8fb8064e20 2022-02-02T20:55:17.907 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:55:17.907 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:55:17.908 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:55:17.909 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:55:17.910 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:55:17.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:55:17.910 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:55:17.911 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:55:17.911 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:55:17.911 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:55:17.911 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:55:17.912 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:55:17.912 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:55:17.912 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:55:17.912 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:55:17.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:55:17.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:55:17.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:55:17.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:55:17.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:55:17.914 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:55:17.914 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:55:17.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 msgr2=0x7f8fb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 0x7f8fb80672e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f8fbc013690 tx=0x7f8fbc009b30).stop 2022-02-02T20:55:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 msgr2=0x7f8fc810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7f8fb40026d0 tx=0x7f8fb4009de0).stop 2022-02-02T20:55:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 shutdown_connections 2022-02-02T20:55:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fb8064e20 0x7f8fb80672e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fc80f5430 0x7f8fc8109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 --2- 172.21.15.96:0/2879136546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fc80f66d0 0x7f8fc810bfb0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 >> 172.21.15.96:0/2879136546 conn(0x7f8fc80f0b90 msgr2=0x7f8fc80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 shutdown_connections 2022-02-02T20:55:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:17.908+0000 7f8fcde7e700 1 -- 172.21.15.96:0/2879136546 wait complete. 2022-02-02T20:55:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 -- 172.21.15.96:0/3345092147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f55c0 msgr2=0x7f6a240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 --2- 172.21.15.96:0/3345092147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f55c0 0x7f6a240f59e0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 rx=0x7f6a0c004660 tx=0x7f6a0c009b30).stop 2022-02-02T20:55:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 -- 172.21.15.96:0/3345092147 shutdown_connections 2022-02-02T20:55:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 --2- 172.21.15.96:0/3345092147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f6860 0x7f6a240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 --2- 172.21.15.96:0/3345092147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f55c0 0x7f6a240f59e0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 -- 172.21.15.96:0/3345092147 >> 172.21.15.96:0/3345092147 conn(0x7f6a240f0d40 msgr2=0x7f6a240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 -- 172.21.15.96:0/3345092147 shutdown_connections 2022-02-02T20:55:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.004+0000 7f6a29260700 1 -- 172.21.15.96:0/3345092147 wait complete. 2022-02-02T20:55:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 Processor -- start 2022-02-02T20:55:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 -- start start 2022-02-02T20:55:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f55c0 0x7f6a24105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24106910 con 0x7f6a240f6860 2022-02-02T20:55:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a29260700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24106a50 con 0x7f6a240f55c0 2022-02-02T20:55:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a2259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a2259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39844/0 (socket says 172.21.15.96:39844) 2022-02-02T20:55:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a2259c700 1 -- 172.21.15.96:0/465516893 learned_addr learned my addr 172.21.15.96:0/465516893 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.005+0000 7f6a22d9d700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f55c0 0x7f6a24105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a2259c700 1 -- 172.21.15.96:0/465516893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f55c0 msgr2=0x7f6a24105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a2259c700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f55c0 0x7f6a24105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a2259c700 1 -- 172.21.15.96:0/465516893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c005040 con 0x7f6a240f6860 2022-02-02T20:55:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a2259c700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f6a1400c530 tx=0x7f6a14007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1400f650 con 0x7f6a240f6860 2022-02-02T20:55:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a1400fc60 con 0x7f6a240f6860 2022-02-02T20:55:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a14012cd0 con 0x7f6a240f6860 2022-02-02T20:55:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a241073f0 con 0x7f6a240f6860 2022-02-02T20:55:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.006+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a241079b0 con 0x7f6a240f6860 2022-02-02T20:55:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.007+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24045ad0 con 0x7f6a240f6860 2022-02-02T20:55:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.008+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a14010070 con 0x7f6a240f6860 2022-02-02T20:55:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.008+0000 7f6a1b7fe700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 0x7f6a10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.008+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6a14081fe0 con 0x7f6a240f6860 2022-02-02T20:55:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.008+0000 7f6a22d9d700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 0x7f6a10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.009+0000 7f6a22d9d700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 0x7f6a10067290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f6a0c004e30 tx=0x7f6a0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.012+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a14053b10 con 0x7f6a240f6860 2022-02-02T20:55:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.240+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a24027a00 con 0x7f6a240f6860 2022-02-02T20:55:18.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.241+0000 7f6a1b7fe700 1 -- 172.21.15.96:0/465516893 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6a14020070 con 0x7f6a240f6860 2022-02-02T20:55:18.243 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:55:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:55:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:55:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:55:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:55:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:55:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:55:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:55:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:55:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:55:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:55:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:55:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:55:18.246 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:55:18.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 msgr2=0x7f6a10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 0x7f6a10067290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f6a0c004e30 tx=0x7f6a0c009b30).stop 2022-02-02T20:55:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 msgr2=0x7f6a24106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f6a1400c530 tx=0x7f6a14007e20).stop 2022-02-02T20:55:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 shutdown_connections 2022-02-02T20:55:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a10064dd0 0x7f6a10067290 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a240f55c0 0x7f6a24105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 --2- 172.21.15.96:0/465516893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a240f6860 0x7f6a24106360 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 >> 172.21.15.96:0/465516893 conn(0x7f6a240f0d40 msgr2=0x7f6a240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 shutdown_connections 2022-02-02T20:55:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.243+0000 7f6a29260700 1 -- 172.21.15.96:0/465516893 wait complete. 2022-02-02T20:55:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:18 smithi096 ceph-mon[101353]: pgmap v4596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:18 smithi096 ceph-mon[101353]: from='client.38818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:18 smithi096 ceph-mon[101353]: from='client.38822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:18.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 -- 172.21.15.96:0/2214684714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 msgr2=0x7f183c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 --2- 172.21.15.96:0/2214684714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c0f59e0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 rx=0x7f182c004660 tx=0x7f182c009b30).stop 2022-02-02T20:55:18.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 -- 172.21.15.96:0/2214684714 shutdown_connections 2022-02-02T20:55:18.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 --2- 172.21.15.96:0/2214684714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f183c0f6860 0x7f183c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 --2- 172.21.15.96:0/2214684714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c0f59e0 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 -- 172.21.15.96:0/2214684714 >> 172.21.15.96:0/2214684714 conn(0x7f183c0f0d40 msgr2=0x7f183c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:18.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 -- 172.21.15.96:0/2214684714 shutdown_connections 2022-02-02T20:55:18.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.341+0000 7f18447b3700 1 -- 172.21.15.96:0/2214684714 wait complete. 2022-02-02T20:55:18.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 Processor -- start 2022-02-02T20:55:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 -- start start 2022-02-02T20:55:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f183c0f6860 0x7f183c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0602b0 con 0x7f183c0f55c0 2022-02-02T20:55:18.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f18447b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0603f0 con 0x7f183c0f6860 2022-02-02T20:55:18.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:18.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39852/0 (socket says 172.21.15.96:39852) 2022-02-02T20:55:18.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 -- 172.21.15.96:0/2944574549 learned_addr learned my addr 172.21.15.96:0/2944574549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:18.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 -- 172.21.15.96:0/2944574549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f183c0f6860 msgr2=0x7f183c10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f183c0f6860 0x7f183c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:55:18.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 -- 172.21.15.96:0/2944574549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c005040 con 0x7f183c0f55c0 2022-02-02T20:55:18.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.342+0000 7f184254f700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7f182c013a70 tx=0x7f182c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:18.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.343+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182c018070 con 0x7f183c0f55c0 2022-02-02T20:55:18.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.343+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f182c0097d0 con 0x7f183c0f55c0 2022-02-02T20:55:18.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.343+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c10ea00 con 0x7f183c0f55c0 2022-02-02T20:55:18.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.343+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182c01c3c0 con 0x7f183c0f55c0 2022-02-02T20:55:18.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.343+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c10edd0 con 0x7f183c0f55c0 2022-02-02T20:55:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.344+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c045ad0 con 0x7f183c0f55c0 2022-02-02T20:55:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.345+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f182c007ba0 con 0x7f183c0f55c0 2022-02-02T20:55:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.345+0000 7f1832ffd700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 0x7f1828067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.345+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f182c083aa0 con 0x7f183c0f55c0 2022-02-02T20:55:18.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.345+0000 7f1841d4e700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 0x7f1828067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.346+0000 7f1841d4e700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 0x7f1828067290 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f1838009880 tx=0x7f1838009a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:18.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.349+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f182c051b60 con 0x7f183c0f55c0 2022-02-02T20:55:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:18 smithi159 ceph-mon[69013]: pgmap v4596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:18 smithi159 ceph-mon[69013]: from='client.38818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:18 smithi159 ceph-mon[69013]: from='client.38822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:18.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.549+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f183c027a00 con 0x7f183c0f55c0 2022-02-02T20:55:18.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.549+0000 7f1832ffd700 1 -- 172.21.15.96:0/2944574549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f182c055180 con 0x7f183c0f55c0 2022-02-02T20:55:18.551 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:55:18.551 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:55:18.552 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:55:18.552 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:55:18.552 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:18.552 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:55:18.552 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:55:18.553 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:55:18.553 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:55:18.553 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:55:18.553 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:55:18.554 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:55:18.554 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:55:18.554 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:55:18.554 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:55:18.554 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:55:18.555 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:55:18.555 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:55:18.555 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:55:18.555 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:55:18.556 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:55:18.556 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:55:18.556 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:55:18.556 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:55:18.556 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:55:18.557 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:55:18.557 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:55:18.557 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:55:18.557 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:55:18.557 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:55:18.558 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:55:18.558 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:55:18.558 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:18.558 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:18.559 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:55:18.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:18.559 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:18.559 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:18.559 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 msgr2=0x7f1828067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 0x7f1828067290 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f1838009880 tx=0x7f1838009a60).stop 2022-02-02T20:55:18.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 msgr2=0x7f183c10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:18.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7f182c013a70 tx=0x7f182c009b30).stop 2022-02-02T20:55:18.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 shutdown_connections 2022-02-02T20:55:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1828064dd0 0x7f1828067290 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f183c0f55c0 0x7f183c10c010 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 --2- 172.21.15.96:0/2944574549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f183c0f6860 0x7f183c10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:55:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 >> 172.21.15.96:0/2944574549 conn(0x7f183c0f0d40 msgr2=0x7f183c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 shutdown_connections 2022-02-02T20:55:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:18.551+0000 7f18447b3700 1 -- 172.21.15.96:0/2944574549 wait complete. 2022-02-02T20:55:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:55:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/465516893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:55:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2944574549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:55:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/465516893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:55:19.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2944574549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:55:20.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:20 smithi159 ceph-mon[69013]: pgmap v4597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:20 smithi096 ceph-mon[101353]: pgmap v4597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:22 smithi159 ceph-mon[69013]: pgmap v4598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:22 smithi096 ceph-mon[101353]: pgmap v4598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:24 smithi159 ceph-mon[69013]: pgmap v4599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:24 smithi096 ceph-mon[101353]: pgmap v4599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:26 smithi159 ceph-mon[69013]: pgmap v4600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:26 smithi096 ceph-mon[101353]: pgmap v4600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:55:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:55:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:28 smithi159 ceph-mon[69013]: pgmap v4601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:55:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:55:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:28 smithi096 ceph-mon[101353]: pgmap v4601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:30 smithi159 ceph-mon[69013]: pgmap v4602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:30 smithi096 ceph-mon[101353]: pgmap v4602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:32 smithi159 ceph-mon[69013]: pgmap v4603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:32 smithi096 ceph-mon[101353]: pgmap v4603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:34 smithi159 ceph-mon[69013]: pgmap v4604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:34 smithi096 ceph-mon[101353]: pgmap v4604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:36 smithi159 ceph-mon[69013]: pgmap v4605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:36 smithi096 ceph-mon[101353]: pgmap v4605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:38 smithi159 ceph-mon[69013]: pgmap v4606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:38 smithi096 ceph-mon[101353]: pgmap v4606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:40 smithi159 ceph-mon[69013]: pgmap v4607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:40 smithi096 ceph-mon[101353]: pgmap v4607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:42 smithi159 ceph-mon[69013]: pgmap v4608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:42 smithi096 ceph-mon[101353]: pgmap v4608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:44 smithi159 ceph-mon[69013]: pgmap v4609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:44 smithi096 ceph-mon[101353]: pgmap v4609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:47.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:46 smithi159 ceph-mon[69013]: pgmap v4610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:46 smithi096 ceph-mon[101353]: pgmap v4610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:48 smithi159 ceph-mon[69013]: pgmap v4611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:48 smithi096 ceph-mon[101353]: pgmap v4611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 -- 172.21.15.96:0/3546761268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 msgr2=0x7fe1e00f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3546761268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e00f6900 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 rx=0x7fe1d0004660 tx=0x7fe1d0009b30).stop 2022-02-02T20:55:48.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 -- 172.21.15.96:0/3546761268 shutdown_connections 2022-02-02T20:55:48.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3546761268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e00f6900 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3546761268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 -- 172.21.15.96:0/3546761268 >> 172.21.15.96:0/3546761268 conn(0x7fe1e00f0de0 msgr2=0x7fe1e00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.660+0000 7fe1e532f700 1 -- 172.21.15.96:0/3546761268 shutdown_connections 2022-02-02T20:55:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.661+0000 7fe1e532f700 1 -- 172.21.15.96:0/3546761268 wait complete. 2022-02-02T20:55:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.661+0000 7fe1e532f700 1 Processor -- start 2022-02-02T20:55:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.661+0000 7fe1e532f700 1 -- start start 2022-02-02T20:55:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.661+0000 7fe1e532f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e0105e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1e532f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1e532f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0106930 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1e532f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0107140 con 0x7fe1e00f55c0 2022-02-02T20:55:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39874/0 (socket says 172.21.15.96:39874) 2022-02-02T20:55:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 -- 172.21.15.96:0/3363645388 learned_addr learned my addr 172.21.15.96:0/3363645388 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1deffd700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e0105e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 -- 172.21.15.96:0/3363645388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 msgr2=0x7fe1e0105e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e0105e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 -- 172.21.15.96:0/3363645388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0005040 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1deffd700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e0105e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:55:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1de7fc700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7fe1d0000c00 tx=0x7fe1d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d00079c0 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe1d001c480 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e0107360 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d0014680 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.662+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e01078c0 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.664+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e00f4a50 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.664+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe1d0023030 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.664+0000 7fe1d77fe700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 0x7fe1cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.664+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe1d0084b40 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.664+0000 7fe1deffd700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 0x7fe1cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.665+0000 7fe1deffd700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 0x7fe1cc067290 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fe1c8009da0 tx=0x7fe1c800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.669+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe1d0052cf0 con 0x7fe1e00f5ed0 2022-02-02T20:55:48.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.848+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1e005f780 con 0x7fe1cc064dd0 2022-02-02T20:55:48.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.850+0000 7fe1d77fe700 1 -- 172.21.15.96:0/3363645388 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe1e005f780 con 0x7fe1cc064dd0 2022-02-02T20:55:48.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 msgr2=0x7fe1cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 0x7fe1cc067290 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fe1c8009da0 tx=0x7fe1c800b040).stop 2022-02-02T20:55:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 msgr2=0x7fe1e0106330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7fe1d0000c00 tx=0x7fe1d000b040).stop 2022-02-02T20:55:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 shutdown_connections 2022-02-02T20:55:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1cc064dd0 0x7fe1cc067290 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e00f55c0 0x7fe1e0105e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 --2- 172.21.15.96:0/3363645388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1e00f5ed0 0x7fe1e0106330 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.851+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 >> 172.21.15.96:0/3363645388 conn(0x7fe1e00f0de0 msgr2=0x7fe1e00fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:48.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.852+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 shutdown_connections 2022-02-02T20:55:48.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.852+0000 7fe1e532f700 1 -- 172.21.15.96:0/3363645388 wait complete. 2022-02-02T20:55:48.864 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:55:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 -- 172.21.15.96:0/658014291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f6880 msgr2=0x7f3ea80f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/658014291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f6ce0 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 rx=0x7f3e98004660 tx=0x7f3e98009b30).stop 2022-02-02T20:55:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 -- 172.21.15.96:0/658014291 shutdown_connections 2022-02-02T20:55:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/658014291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f6ce0 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/658014291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:55:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 -- 172.21.15.96:0/658014291 >> 172.21.15.96:0/658014291 conn(0x7f3ea80f0d40 msgr2=0x7f3ea80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.949+0000 7f3ead3ee700 1 -- 172.21.15.96:0/658014291 shutdown_connections 2022-02-02T20:55:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.950+0000 7f3ead3ee700 1 -- 172.21.15.96:0/658014291 wait complete. 2022-02-02T20:55:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.950+0000 7f3ead3ee700 1 Processor -- start 2022-02-02T20:55:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.950+0000 7f3ead3ee700 1 -- start start 2022-02-02T20:55:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ead3ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ead3ee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ead3ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80f81b0 con 0x7f3ea80f55e0 2022-02-02T20:55:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ead3ee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80f82f0 con 0x7f3ea80f6880 2022-02-02T20:55:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39882/0 (socket says 172.21.15.96:39882) 2022-02-02T20:55:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 -- 172.21.15.96:0/4140912686 learned_addr learned my addr 172.21.15.96:0/4140912686 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea67fc700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 -- 172.21.15.96:0/4140912686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f6880 msgr2=0x7f3ea80f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 -- 172.21.15.96:0/4140912686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98005040 con 0x7f3ea80f55e0 2022-02-02T20:55:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3ea6ffd700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f3e9c0093f0 tx=0x7f3e9c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.951+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c009ea0 con 0x7f3ea80f55e0 2022-02-02T20:55:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.952+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e9c013af0 con 0x7f3ea80f55e0 2022-02-02T20:55:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.952+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80f85d0 con 0x7f3ea80f55e0 2022-02-02T20:55:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.952+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c00db10 con 0x7f3ea80f55e0 2022-02-02T20:55:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.952+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea810ef80 con 0x7f3ea80f55e0 2022-02-02T20:55:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.952+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8045ad0 con 0x7f3ea80f55e0 2022-02-02T20:55:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.953+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e9c01a060 con 0x7f3ea80f55e0 2022-02-02T20:55:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.954+0000 7f3e8f7fe700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 0x7f3e90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.954+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3e9c081e80 con 0x7f3ea80f55e0 2022-02-02T20:55:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.954+0000 7f3ea67fc700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 0x7f3e90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.954+0000 7f3ea67fc700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 0x7f3e90067290 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f3e98004e30 tx=0x7f3e98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:48.957+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e9c04ff80 con 0x7f3ea80f55e0 2022-02-02T20:55:49.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.129+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea80facc0 con 0x7f3e90064dd0 2022-02-02T20:55:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.139+0000 7f3e8f7fe700 1 -- 172.21.15.96:0/4140912686 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3ea80facc0 con 0x7f3e90064dd0 2022-02-02T20:55:49.141 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:55:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:55:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:55:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:55:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:55:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:55:49.143 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:55:49.143 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:55:49.143 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:55:49.143 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:55:49.144 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:55:49.144 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:55:49.144 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:55:49.144 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:55:49.144 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:55:49.145 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:55:49.145 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:55:49.145 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:55:49.145 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:55:49.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:55:49.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:55:49.146 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:55:49.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.140+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 msgr2=0x7f3e90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.140+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 0x7f3e90067290 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f3e98004e30 tx=0x7f3e98009b30).stop 2022-02-02T20:55:49.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.140+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 msgr2=0x7f3ea80f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f3e9c0093f0 tx=0x7f3e9c006ec0).stop 2022-02-02T20:55:49.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 shutdown_connections 2022-02-02T20:55:49.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e90064dd0 0x7f3e90067290 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ea80f55e0 0x7f3ea80f9740 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 --2- 172.21.15.96:0/4140912686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea80f6880 0x7f3ea80f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 >> 172.21.15.96:0/4140912686 conn(0x7f3ea80f0d40 msgr2=0x7f3ea805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:49.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 shutdown_connections 2022-02-02T20:55:49.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.141+0000 7f3ead3ee700 1 -- 172.21.15.96:0/4140912686 wait complete. 2022-02-02T20:55:49.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 -- 172.21.15.96:0/1286422721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f55c0 msgr2=0x7f20bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 --2- 172.21.15.96:0/1286422721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f55c0 0x7f20bc0f59e0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 rx=0x7f20ac004660 tx=0x7f20ac009b30).stop 2022-02-02T20:55:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 -- 172.21.15.96:0/1286422721 shutdown_connections 2022-02-02T20:55:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 --2- 172.21.15.96:0/1286422721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f6860 0x7f20bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 --2- 172.21.15.96:0/1286422721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f55c0 0x7f20bc0f59e0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 -- 172.21.15.96:0/1286422721 >> 172.21.15.96:0/1286422721 conn(0x7f20bc0f0d40 msgr2=0x7f20bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:49.241 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:49 smithi096 ceph-mon[101353]: from='client.38834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:49.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 -- 172.21.15.96:0/1286422721 shutdown_connections 2022-02-02T20:55:49.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.237+0000 7f20c45da700 1 -- 172.21.15.96:0/1286422721 wait complete. 2022-02-02T20:55:49.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 Processor -- start 2022-02-02T20:55:49.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 -- start start 2022-02-02T20:55:49.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f55c0 0x7f20bc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0603e0 con 0x7f20bc0f6860 2022-02-02T20:55:49.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c45da700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc060520 con 0x7f20bc0f55c0 2022-02-02T20:55:49.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c1b75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.238+0000 7f20c1b75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39892/0 (socket says 172.21.15.96:39892) 2022-02-02T20:55:49.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c1b75700 1 -- 172.21.15.96:0/624872828 learned_addr learned my addr 172.21.15.96:0/624872828 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:49.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c2376700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f55c0 0x7f20bc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c1b75700 1 -- 172.21.15.96:0/624872828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f55c0 msgr2=0x7f20bc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c1b75700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f55c0 0x7f20bc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c1b75700 1 -- 172.21.15.96:0/624872828 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac005040 con 0x7f20bc0f6860 2022-02-02T20:55:49.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c1b75700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7f20b800c530 tx=0x7f20b8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:49.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b800f650 con 0x7f20bc0f6860 2022-02-02T20:55:49.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc10c720 con 0x7f20bc0f6860 2022-02-02T20:55:49.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20b800fc60 con 0x7f20bc0f6860 2022-02-02T20:55:49.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b8012c20 con 0x7f20bc0f6860 2022-02-02T20:55:49.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.239+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc10cce0 con 0x7f20bc0f6860 2022-02-02T20:55:49.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.240+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a4004fa0 con 0x7f20bc0f6860 2022-02-02T20:55:49.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.241+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f20b8010070 con 0x7f20bc0f6860 2022-02-02T20:55:49.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.242+0000 7f20b2ffd700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 0x7f20a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.242+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20b8081600 con 0x7f20bc0f6860 2022-02-02T20:55:49.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.242+0000 7f20c2376700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 0x7f20a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.242+0000 7f20c2376700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 0x7f20a8067290 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f20ac013690 tx=0x7f20ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:49.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.246+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20b804f700 con 0x7f20bc0f6860 2022-02-02T20:55:49.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.476+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20a4005e80 con 0x7f20bc0f6860 2022-02-02T20:55:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.476+0000 7f20b2ffd700 1 -- 172.21.15.96:0/624872828 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f20b8052d20 con 0x7f20bc0f6860 2022-02-02T20:55:49.479 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:55:49.480 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:55:49.480 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:55:49.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:49.480 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:55:49.481 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:55:49.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:49.481 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:55:49.481 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:55:49.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:49.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:55:49.482 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:55:49.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:55:49.482 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:55:49.483 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:55:49.483 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:55:49.483 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:55:49.483 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:55:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 msgr2=0x7f20a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 0x7f20a8067290 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f20ac013690 tx=0x7f20ac009b30).stop 2022-02-02T20:55:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 msgr2=0x7f20bc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7f20b800c530 tx=0x7f20b8007e20).stop 2022-02-02T20:55:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 shutdown_connections 2022-02-02T20:55:49.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f20a8064dd0 0x7f20a8067290 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20bc0f55c0 0x7f20bc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 --2- 172.21.15.96:0/624872828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc0f6860 0x7f20bc10c170 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 >> 172.21.15.96:0/624872828 conn(0x7f20bc0f0d40 msgr2=0x7f20bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:49.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.478+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 shutdown_connections 2022-02-02T20:55:49.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.479+0000 7f20c45da700 1 -- 172.21.15.96:0/624872828 wait complete. 2022-02-02T20:55:49.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:49 smithi159 ceph-mon[69013]: from='client.38834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/579339859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f5f60 msgr2=0x7f0dbc0f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/579339859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc0f63e0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 rx=0x7f0db8004770 tx=0x7f0db800ac40).stop 2022-02-02T20:55:49.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/579339859 shutdown_connections 2022-02-02T20:55:49.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/579339859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc0f63e0 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/579339859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc0f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/579339859 >> 172.21.15.96:0/579339859 conn(0x7f0dbc0f04c0 msgr2=0x7f0dbc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:49.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/579339859 shutdown_connections 2022-02-02T20:55:49.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/579339859 wait complete. 2022-02-02T20:55:49.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 Processor -- start 2022-02-02T20:55:49.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- start start 2022-02-02T20:55:49.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1079c0 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.576+0000 7f0dc3dd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc107b00 con 0x7f0dbc0f5f60 2022-02-02T20:55:49.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39900/0 (socket says 172.21.15.96:39900) 2022-02-02T20:55:49.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 -- 172.21.15.96:0/2762712346 learned_addr learned my addr 172.21.15.96:0/2762712346 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:55:49.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1372700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 -- 172.21.15.96:0/2762712346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 msgr2=0x7f0dbc107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 -- 172.21.15.96:0/2762712346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8005040 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1372700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:55:49.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc1b73700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f0dac0026d0 tx=0x7f0dac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:49.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dac009320 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0dac00f040 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc1084a0 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dac0147e0 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.577+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc108a60 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.578+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc045ad0 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.579+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0dac009480 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.579+0000 7f0db27fc700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 0x7f0da8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:55:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.579+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0dac082120 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.579+0000 7f0dc1372700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 0x7f0da8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:55:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.580+0000 7f0dc1372700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 0x7f0da8067290 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f0db8014450 tx=0x7f0db8016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:55:49.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.583+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0dac053c50 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.785+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0dbc0fcdd0 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.786+0000 7f0db27fc700 1 -- 172.21.15.96:0/2762712346 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0dac053840 con 0x7f0dbc0f4d60 2022-02-02T20:55:49.788 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:55:49.789 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:55:49.789 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:55:49.789 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:55:49.790 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:49.790 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:55:49.790 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:55:49.790 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:55:49.792 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:55:49.792 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:55:49.792 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:55:49.792 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:55:49.793 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:55:49.793 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:55:49.793 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:55:49.793 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:55:49.793 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:55:49.794 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:55:49.794 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:55:49.794 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:55:49.794 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:55:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:55:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:55:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:55:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:55:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:55:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:55:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:55:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:55:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:55:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:55:49.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:55:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:49.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:49.797 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:55:49.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:55:49.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:49.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:49.798 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:55:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 msgr2=0x7f0da8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 0x7f0da8067290 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f0db8014450 tx=0x7f0db8016040).stop 2022-02-02T20:55:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 msgr2=0x7f0dbc106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:55:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f0dac0026d0 tx=0x7f0dac009de0).stop 2022-02-02T20:55:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 shutdown_connections 2022-02-02T20:55:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0da8064dd0 0x7f0da8067290 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dbc0f4d60 0x7f0dbc106f20 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 --2- 172.21.15.96:0/2762712346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dbc0f5f60 0x7f0dbc107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:55:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 >> 172.21.15.96:0/2762712346 conn(0x7f0dbc0f04c0 msgr2=0x7f0dbc0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:55:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 shutdown_connections 2022-02-02T20:55:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:55:49.789+0000 7f0dc3dd7700 1 -- 172.21.15.96:0/2762712346 wait complete. 2022-02-02T20:55:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:55:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:50 smithi159 ceph-mon[69013]: from='client.38838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/624872828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:55:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:50 smithi159 ceph-mon[69013]: pgmap v4612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:50.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2762712346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:55:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:50 smithi096 ceph-mon[101353]: from='client.38838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:55:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/624872828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:55:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:50 smithi096 ceph-mon[101353]: pgmap v4612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2762712346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:55:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:52 smithi159 ceph-mon[69013]: pgmap v4613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:52 smithi096 ceph-mon[101353]: pgmap v4613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:54 smithi159 ceph-mon[69013]: pgmap v4614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:54 smithi096 ceph-mon[101353]: pgmap v4614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:56 smithi159 ceph-mon[69013]: pgmap v4615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:56 smithi096 ceph-mon[101353]: pgmap v4615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:55:58 smithi159 ceph-mon[69013]: pgmap v4616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:55:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:55:58 smithi096 ceph-mon[101353]: pgmap v4616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:00 smithi159 ceph-mon[69013]: pgmap v4617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:00 smithi096 ceph-mon[101353]: pgmap v4617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:02 smithi159 ceph-mon[69013]: pgmap v4618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:02 smithi096 ceph-mon[101353]: pgmap v4618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:04 smithi159 ceph-mon[69013]: pgmap v4619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:04 smithi096 ceph-mon[101353]: pgmap v4619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:06 smithi159 ceph-mon[69013]: pgmap v4620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:06 smithi096 ceph-mon[101353]: pgmap v4620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:08 smithi159 ceph-mon[69013]: pgmap v4621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:08 smithi096 ceph-mon[101353]: pgmap v4621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:10 smithi159 ceph-mon[69013]: pgmap v4622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:10 smithi096 ceph-mon[101353]: pgmap v4622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:12 smithi159 ceph-mon[69013]: pgmap v4623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:12 smithi096 ceph-mon[101353]: pgmap v4623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:14 smithi159 ceph-mon[69013]: pgmap v4624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:14 smithi096 ceph-mon[101353]: pgmap v4624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:16 smithi159 ceph-mon[69013]: pgmap v4625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:16 smithi096 ceph-mon[101353]: pgmap v4625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:18 smithi159 ceph-mon[69013]: pgmap v4626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:18 smithi096 ceph-mon[101353]: pgmap v4626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 -- 172.21.15.96:0/2356879565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f5430 msgr2=0x7f725c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 --2- 172.21.15.96:0/2356879565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f5430 0x7f725c0f5850 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 rx=0x7f7250004660 tx=0x7f7250009b30).stop 2022-02-02T20:56:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 -- 172.21.15.96:0/2356879565 shutdown_connections 2022-02-02T20:56:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 --2- 172.21.15.96:0/2356879565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f66d0 0x7f725c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 --2- 172.21.15.96:0/2356879565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f5430 0x7f725c0f5850 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 -- 172.21.15.96:0/2356879565 >> 172.21.15.96:0/2356879565 conn(0x7f725c0f0b90 msgr2=0x7f725c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 -- 172.21.15.96:0/2356879565 shutdown_connections 2022-02-02T20:56:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 -- 172.21.15.96:0/2356879565 wait complete. 2022-02-02T20:56:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.900+0000 7f7261376700 1 Processor -- start 2022-02-02T20:56:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f7261376700 1 -- start start 2022-02-02T20:56:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f7261376700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f5430 0x7f725c105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f7261376700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f7261376700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1067d0 con 0x7f725c0f66d0 2022-02-02T20:56:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f7261376700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c106fd0 con 0x7f725c0f5430 2022-02-02T20:56:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39920/0 (socket says 172.21.15.96:39920) 2022-02-02T20:56:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 -- 172.21.15.96:0/1235885682 learned_addr learned my addr 172.21.15.96:0/1235885682 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725bfff700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f5430 0x7f725c105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 -- 172.21.15.96:0/1235885682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f5430 msgr2=0x7f725c105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f5430 0x7f725c105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.901+0000 7f725b7fe700 1 -- 172.21.15.96:0/1235885682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250005040 con 0x7f725c0f66d0 2022-02-02T20:56:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f725b7fe700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 rx=0x7f724c0026d0 tx=0x7f724c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724c0079c0 con 0x7f725c0f66d0 2022-02-02T20:56:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f724c00f040 con 0x7f725c0f66d0 2022-02-02T20:56:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c1072b0 con 0x7f725c0f66d0 2022-02-02T20:56:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724c0148b0 con 0x7f725c0f66d0 2022-02-02T20:56:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.902+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c107870 con 0x7f725c0f66d0 2022-02-02T20:56:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.903+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c059100 con 0x7f725c0f66d0 2022-02-02T20:56:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.903+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f724c007b20 con 0x7f725c0f66d0 2022-02-02T20:56:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.904+0000 7f7258ff9700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 0x7f72440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.904+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f724c0819e0 con 0x7f725c0f66d0 2022-02-02T20:56:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.904+0000 7f725bfff700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 0x7f72440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.904+0000 7f725bfff700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 0x7f72440672e0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f7250004630 tx=0x7f7250009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:19.908+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f724c053510 con 0x7f725c0f66d0 2022-02-02T20:56:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.088+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f725c0fdc60 con 0x7f7244064e20 2022-02-02T20:56:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.089+0000 7f7258ff9700 1 -- 172.21.15.96:0/1235885682 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f725c0fdc60 con 0x7f7244064e20 2022-02-02T20:56:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 msgr2=0x7f72440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 0x7f72440672e0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f7250004630 tx=0x7f7250009b30).stop 2022-02-02T20:56:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 msgr2=0x7f725c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 rx=0x7f724c0026d0 tx=0x7f724c009de0).stop 2022-02-02T20:56:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 shutdown_connections 2022-02-02T20:56:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7244064e20 0x7f72440672e0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0f5430 0x7f725c105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 --2- 172.21.15.96:0/1235885682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f725c0f66d0 0x7f725c106220 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 >> 172.21.15.96:0/1235885682 conn(0x7f725c0f0b90 msgr2=0x7f725c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 shutdown_connections 2022-02-02T20:56:20.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.091+0000 7f7261376700 1 -- 172.21.15.96:0/1235885682 wait complete. 2022-02-02T20:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:56:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 -- 172.21.15.96:0/545429212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 msgr2=0x7fec500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 --2- 172.21.15.96:0/545429212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 0x7fec500f5850 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 rx=0x7fec400099e0 tx=0x7fec40004d10).stop 2022-02-02T20:56:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 -- 172.21.15.96:0/545429212 shutdown_connections 2022-02-02T20:56:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 --2- 172.21.15.96:0/545429212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f66d0 0x7fec500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 --2- 172.21.15.96:0/545429212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f5430 0x7fec500f5850 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.188+0000 7fec4f59e700 1 -- 172.21.15.96:0/545429212 >> 172.21.15.96:0/545429212 conn(0x7fec500f0b90 msgr2=0x7fec500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 -- 172.21.15.96:0/545429212 shutdown_connections 2022-02-02T20:56:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 -- 172.21.15.96:0/545429212 wait complete. 2022-02-02T20:56:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 Processor -- start 2022-02-02T20:56:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 -- start start 2022-02-02T20:56:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50109b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec500603e0 con 0x7fec500f66d0 2022-02-02T20:56:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.189+0000 7fec4f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec50060520 con 0x7fec500f5430 2022-02-02T20:56:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39930/0 (socket says 172.21.15.96:39930) 2022-02-02T20:56:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 -- 172.21.15.96:0/2054352521 learned_addr learned my addr 172.21.15.96:0/2054352521 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4e59c700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 -- 172.21.15.96:0/2054352521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 msgr2=0x7fec50109b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50109b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 -- 172.21.15.96:0/2054352521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009640 con 0x7fec500f66d0 2022-02-02T20:56:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4dd9b700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 rx=0x7fec3800c530 tx=0x7fec38007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3800f650 con 0x7fec500f66d0 2022-02-02T20:56:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec3800fc60 con 0x7fec500f66d0 2022-02-02T20:56:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5010c640 con 0x7fec500f66d0 2022-02-02T20:56:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec38012c20 con 0x7fec500f66d0 2022-02-02T20:56:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.190+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5010cb80 con 0x7fec500f66d0 2022-02-02T20:56:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.192+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec50045ad0 con 0x7fec500f66d0 2022-02-02T20:56:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.192+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec38010070 con 0x7fec500f66d0 2022-02-02T20:56:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.193+0000 7fec46ffd700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.193+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec380816d0 con 0x7fec500f66d0 2022-02-02T20:56:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.193+0000 7fec4e59c700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.193+0000 7fec4e59c700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fec400099b0 tx=0x7fec40004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.197+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec380477d0 con 0x7fec500f66d0 2022-02-02T20:56:20.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.370+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec50057f10 con 0x7fec3c064e20 2022-02-02T20:56:20.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.380+0000 7fec46ffd700 1 -- 172.21.15.96:0/2054352521 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fec50057f10 con 0x7fec3c064e20 2022-02-02T20:56:20.382 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:56:20.382 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:56:20.383 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:56:20.383 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:56:20.383 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:56:20.383 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:56:20.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:56:20.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:56:20.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:56:20.384 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:56:20.385 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:56:20.385 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:56:20.385 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:56:20.385 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:56:20.385 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:56:20.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:56:20.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:56:20.386 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:56:20.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:56:20.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:56:20.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:56:20.387 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:56:20.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 msgr2=0x7fec3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fec400099b0 tx=0x7fec40004d10).stop 2022-02-02T20:56:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 msgr2=0x7fec5010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 rx=0x7fec3800c530 tx=0x7fec38007e20).stop 2022-02-02T20:56:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 shutdown_connections 2022-02-02T20:56:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec3c064e20 0x7fec3c0672e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec500f5430 0x7fec50109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 --2- 172.21.15.96:0/2054352521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec500f66d0 0x7fec5010c090 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 >> 172.21.15.96:0/2054352521 conn(0x7fec500f0b90 msgr2=0x7fec500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 shutdown_connections 2022-02-02T20:56:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.382+0000 7fec4f59e700 1 -- 172.21.15.96:0/2054352521 wait complete. 2022-02-02T20:56:20.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 -- 172.21.15.96:0/2417857461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 msgr2=0x7fd5d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 --2- 172.21.15.96:0/2417857461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d40f6cc0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 rx=0x7fd5bc004660 tx=0x7fd5bc009b30).stop 2022-02-02T20:56:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 -- 172.21.15.96:0/2417857461 shutdown_connections 2022-02-02T20:56:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 --2- 172.21.15.96:0/2417857461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d40f6cc0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 --2- 172.21.15.96:0/2417857461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 -- 172.21.15.96:0/2417857461 >> 172.21.15.96:0/2417857461 conn(0x7fd5d40f0d40 msgr2=0x7fd5d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 -- 172.21.15.96:0/2417857461 shutdown_connections 2022-02-02T20:56:20.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 -- 172.21.15.96:0/2417857461 wait complete. 2022-02-02T20:56:20.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.478+0000 7fd5da319700 1 Processor -- start 2022-02-02T20:56:20.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5da319700 1 -- start start 2022-02-02T20:56:20.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5da319700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5da319700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5da319700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4060420 con 0x7fd5d40f6860 2022-02-02T20:56:20.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5da319700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4060560 con 0x7fd5d40f55c0 2022-02-02T20:56:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39940/0 (socket says 172.21.15.96:39940) 2022-02-02T20:56:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 -- 172.21.15.96:0/3283312321 learned_addr learned my addr 172.21.15.96:0/3283312321 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d3fff700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 -- 172.21.15.96:0/3283312321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 msgr2=0x7fd5d4109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.479+0000 7fd5d37fe700 1 -- 172.21.15.96:0/3283312321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc005040 con 0x7fd5d40f6860 2022-02-02T20:56:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5d37fe700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 rx=0x7fd5bc009990 tx=0x7fd5bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5bc018070 con 0x7fd5d40f6860 2022-02-02T20:56:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d410c6c0 con 0x7fd5d40f6860 2022-02-02T20:56:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5bc007ba0 con 0x7fd5d40f6860 2022-02-02T20:56:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5bc01c620 con 0x7fd5d40f6860 2022-02-02T20:56:20.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.480+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d410cbf0 con 0x7fd5d40f6860 2022-02-02T20:56:20.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.481+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d40f49b0 con 0x7fd5d40f6860 2022-02-02T20:56:20.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.482+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd5bc01c890 con 0x7fd5d40f6860 2022-02-02T20:56:20.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.482+0000 7fd5d0ff9700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.482+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd5bc0837b0 con 0x7fd5d40f6860 2022-02-02T20:56:20.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.482+0000 7fd5d3fff700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.483+0000 7fd5d3fff700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fd5d40600a0 tx=0x7fd5c4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.486+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5bc0518b0 con 0x7fd5d40f6860 2022-02-02T20:56:20.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.717+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd5d40fdf10 con 0x7fd5d40f6860 2022-02-02T20:56:20.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.718+0000 7fd5d0ff9700 1 -- 172.21.15.96:0/3283312321 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd5d40fdf10 con 0x7fd5d40f6860 2022-02-02T20:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:56:20.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 msgr2=0x7fd5c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fd5d40600a0 tx=0x7fd5c4009040).stop 2022-02-02T20:56:20.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 msgr2=0x7fd5d410c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 rx=0x7fd5bc009990 tx=0x7fd5bc009b30).stop 2022-02-02T20:56:20.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 shutdown_connections 2022-02-02T20:56:20.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 --2- 172.21.15.96:0/3283312321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c110 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.719+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 >> 172.21.15.96:0/3283312321 conn(0x7fd5d40f0d40 msgr2=0x7fd5d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.720+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 shutdown_connections 2022-02-02T20:56:20.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.720+0000 7fd5da319700 1 -- 172.21.15.96:0/3283312321 wait complete. 2022-02-02T20:56:20.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:20 smithi096 ceph-mon[101353]: pgmap v4627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- 172.21.15.96:0/3603121523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 msgr2=0x7f80fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 --2- 172.21.15.96:0/3603121523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc0f6b00 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 rx=0x7f80e4004660 tx=0x7f80e4009b30).stop 2022-02-02T20:56:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- 172.21.15.96:0/3603121523 shutdown_connections 2022-02-02T20:56:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 --2- 172.21.15.96:0/3603121523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 0x7f80fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 --2- 172.21.15.96:0/3603121523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc0f6b00 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- 172.21.15.96:0/3603121523 >> 172.21.15.96:0/3603121523 conn(0x7f80fc0f1e40 msgr2=0x7f80fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:20.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- 172.21.15.96:0/3603121523 shutdown_connections 2022-02-02T20:56:20.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- 172.21.15.96:0/3603121523 wait complete. 2022-02-02T20:56:20.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 Processor -- start 2022-02-02T20:56:20.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.818+0000 7f81011f9700 1 -- start start 2022-02-02T20:56:20.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 0x7f80fc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc107a50 con 0x7f80fc0f66e0 2022-02-02T20:56:20.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc107b90 con 0x7f80fc0f7980 2022-02-02T20:56:20.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39948/0 (socket says 172.21.15.96:39948) 2022-02-02T20:56:20.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 -- 172.21.15.96:0/439350837 learned_addr learned my addr 172.21.15.96:0/439350837 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:20.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fa59c700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 0x7f80fc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 -- 172.21.15.96:0/439350837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 msgr2=0x7f80fc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:20.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 0x7f80fc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:20.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 -- 172.21.15.96:0/439350837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4005040 con 0x7f80fc0f66e0 2022-02-02T20:56:20.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80fad9d700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 rx=0x7f80e4004f60 tx=0x7f80e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e4018070 con 0x7f80fc0f66e0 2022-02-02T20:56:20.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc1084d0 con 0x7f80fc0f66e0 2022-02-02T20:56:20.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80e4007ba0 con 0x7f80fc0f66e0 2022-02-02T20:56:20.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e401c620 con 0x7f80fc0f66e0 2022-02-02T20:56:20.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.819+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc108a30 con 0x7f80fc0f66e0 2022-02-02T20:56:20.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.820+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc045ad0 con 0x7f80fc0f66e0 2022-02-02T20:56:20.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.821+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80e401c8e0 con 0x7f80fc0f66e0 2022-02-02T20:56:20.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.821+0000 7f80f37fe700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 0x7f80e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:20.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.821+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80e4083960 con 0x7f80fc0f66e0 2022-02-02T20:56:20.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.821+0000 7f80fa59c700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 0x7f80e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:20.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.822+0000 7f80fa59c700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 0x7f80e8067290 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f80ec0041d0 tx=0x7f80ec009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:20.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:20.825+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80e4055550 con 0x7f80fc0f66e0 2022-02-02T20:56:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:20 smithi159 ceph-mon[69013]: pgmap v4627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:21.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.027+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f80fc0fef70 con 0x7f80fc0f66e0 2022-02-02T20:56:21.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.028+0000 7f80f37fe700 1 -- 172.21.15.96:0/439350837 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f80e4055140 con 0x7f80fc0f66e0 2022-02-02T20:56:21.030 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:56:21.030 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:56:21.030 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:56:21.031 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:56:21.031 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:21.031 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:56:21.031 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:56:21.032 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:56:21.032 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:56:21.032 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:56:21.032 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:56:21.033 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:56:21.033 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:56:21.033 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:56:21.033 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:56:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:56:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:56:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:56:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:56:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:56:21.035 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:56:21.035 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:56:21.035 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:56:21.035 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:56:21.036 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:56:21.036 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:56:21.036 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:56:21.036 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:56:21.037 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:56:21.037 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:56:21.037 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:56:21.037 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:56:21.037 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:21.038 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:21.038 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:56:21.038 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:21.038 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:21.038 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:21.039 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:21.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 msgr2=0x7f80e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:21.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 0x7f80e8067290 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f80ec0041d0 tx=0x7f80ec009040).stop 2022-02-02T20:56:21.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 msgr2=0x7f80fc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:21.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 rx=0x7f80e4004f60 tx=0x7f80e4009b30).stop 2022-02-02T20:56:21.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 shutdown_connections 2022-02-02T20:56:21.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80e8064dd0 0x7f80e8067290 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:21.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80fc0f66e0 0x7f80fc106fb0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:21.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 --2- 172.21.15.96:0/439350837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80fc0f7980 0x7f80fc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:21.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 >> 172.21.15.96:0/439350837 conn(0x7f80fc0f1e40 msgr2=0x7f80fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:21.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 shutdown_connections 2022-02-02T20:56:21.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:21.029+0000 7f81011f9700 1 -- 172.21.15.96:0/439350837 wait complete. 2022-02-02T20:56:21.042 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:56:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:21 smithi159 ceph-mon[69013]: from='client.38850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:21 smithi159 ceph-mon[69013]: from='client.38854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3283312321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:56:22.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/439350837' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:56:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:21 smithi096 ceph-mon[101353]: from='client.38850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:21 smithi096 ceph-mon[101353]: from='client.38854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3283312321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:56:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/439350837' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:56:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:22 smithi159 ceph-mon[69013]: pgmap v4628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:22 smithi096 ceph-mon[101353]: pgmap v4628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:24 smithi159 ceph-mon[69013]: pgmap v4629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:24 smithi096 ceph-mon[101353]: pgmap v4629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:26 smithi159 ceph-mon[69013]: pgmap v4630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:26 smithi096 ceph-mon[101353]: pgmap v4630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:56:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:56:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:28 smithi159 ceph-mon[69013]: pgmap v4631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:56:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:56:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:28 smithi096 ceph-mon[101353]: pgmap v4631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:30 smithi159 ceph-mon[69013]: pgmap v4632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:30 smithi096 ceph-mon[101353]: pgmap v4632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:32 smithi159 ceph-mon[69013]: pgmap v4633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:32 smithi096 ceph-mon[101353]: pgmap v4633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:34 smithi159 ceph-mon[69013]: pgmap v4634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:34 smithi096 ceph-mon[101353]: pgmap v4634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:36 smithi159 ceph-mon[69013]: pgmap v4635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:36 smithi096 ceph-mon[101353]: pgmap v4635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:38 smithi159 ceph-mon[69013]: pgmap v4636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:38 smithi096 ceph-mon[101353]: pgmap v4636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:40 smithi159 ceph-mon[69013]: pgmap v4637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:40 smithi096 ceph-mon[101353]: pgmap v4637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:42 smithi159 ceph-mon[69013]: pgmap v4638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:42 smithi096 ceph-mon[101353]: pgmap v4638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:44 smithi159 ceph-mon[69013]: pgmap v4639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:44 smithi096 ceph-mon[101353]: pgmap v4639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:46 smithi159 ceph-mon[69013]: pgmap v4640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:46 smithi096 ceph-mon[101353]: pgmap v4640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:48 smithi159 ceph-mon[69013]: pgmap v4641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:48 smithi096 ceph-mon[101353]: pgmap v4641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:50 smithi159 ceph-mon[69013]: pgmap v4642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:50 smithi096 ceph-mon[101353]: pgmap v4642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 -- 172.21.15.96:0/828094636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98880f9850 msgr2=0x7f98880fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 --2- 172.21.15.96:0/828094636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98880f9850 0x7f98880fbc80 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 rx=0x7f9870004660 tx=0x7f9870009b30).stop 2022-02-02T20:56:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 -- 172.21.15.96:0/828094636 shutdown_connections 2022-02-02T20:56:51.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 --2- 172.21.15.96:0/828094636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98880f9850 0x7f98880fbc80 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 --2- 172.21.15.96:0/828094636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9888060250 0x7f98880f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.140+0000 7f988e1f4700 1 -- 172.21.15.96:0/828094636 >> 172.21.15.96:0/828094636 conn(0x7f98880f0d40 msgr2=0x7f98880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.141+0000 7f988e1f4700 1 -- 172.21.15.96:0/828094636 shutdown_connections 2022-02-02T20:56:51.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.141+0000 7f988e1f4700 1 -- 172.21.15.96:0/828094636 wait complete. 2022-02-02T20:56:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.141+0000 7f988e1f4700 1 Processor -- start 2022-02-02T20:56:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.141+0000 7f988e1f4700 1 -- start start 2022-02-02T20:56:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f988e1f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f988e1f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98880f9850 0x7f9888107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f988e1f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888107a10 con 0x7f9888060250 2022-02-02T20:56:51.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f988e1f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888107b50 con 0x7f98880f9850 2022-02-02T20:56:51.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39970/0 (socket says 172.21.15.96:39970) 2022-02-02T20:56:51.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 -- 172.21.15.96:0/2316736565 learned_addr learned my addr 172.21.15.96:0/2316736565 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:51.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f9886ffd700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98880f9850 0x7f9888107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 -- 172.21.15.96:0/2316736565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98880f9850 msgr2=0x7f9888107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98880f9850 0x7f9888107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 -- 172.21.15.96:0/2316736565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870005040 con 0x7f9888060250 2022-02-02T20:56:51.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f98877fe700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7f98780026d0 tx=0x7f9878009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98780079c0 con 0x7f9888060250 2022-02-02T20:56:51.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98881084f0 con 0x7f9888060250 2022-02-02T20:56:51.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f987800f040 con 0x7f9888060250 2022-02-02T20:56:51.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.142+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98780148b0 con 0x7f9888060250 2022-02-02T20:56:51.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.143+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9888108ab0 con 0x7f9888060250 2022-02-02T20:56:51.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.144+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9888045ad0 con 0x7f9888060250 2022-02-02T20:56:51.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.144+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9878007b20 con 0x7f9888060250 2022-02-02T20:56:51.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.144+0000 7f987ffff700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 0x7f9874067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.144+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f98780819a0 con 0x7f9888060250 2022-02-02T20:56:51.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.144+0000 7f9886ffd700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 0x7f9874067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.145+0000 7f9886ffd700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 0x7f9874067290 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f9870013690 tx=0x7f9870009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.149+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f98780534d0 con 0x7f9888060250 2022-02-02T20:56:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.327+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98880ff040 con 0x7f9874064dd0 2022-02-02T20:56:51.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.329+0000 7f987ffff700 1 -- 172.21.15.96:0/2316736565 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9870019040 con 0x7f9874064dd0 2022-02-02T20:56:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 msgr2=0x7f9874067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 0x7f9874067290 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f9870013690 tx=0x7f9870009b30).stop 2022-02-02T20:56:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 msgr2=0x7f9888106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7f98780026d0 tx=0x7f9878009de0).stop 2022-02-02T20:56:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 shutdown_connections 2022-02-02T20:56:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9874064dd0 0x7f9874067290 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9888060250 0x7f9888106f70 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 --2- 172.21.15.96:0/2316736565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98880f9850 0x7f9888107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.330+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 >> 172.21.15.96:0/2316736565 conn(0x7f98880f0d40 msgr2=0x7f98880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.331+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 shutdown_connections 2022-02-02T20:56:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.331+0000 7f988e1f4700 1 -- 172.21.15.96:0/2316736565 wait complete. 2022-02-02T20:56:51.342 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:56:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 -- 172.21.15.96:0/3706533443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 msgr2=0x7fda8c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 --2- 172.21.15.96:0/3706533443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c0f59e0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 rx=0x7fda80004660 tx=0x7fda80009b30).stop 2022-02-02T20:56:51.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 -- 172.21.15.96:0/3706533443 shutdown_connections 2022-02-02T20:56:51.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 --2- 172.21.15.96:0/3706533443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 --2- 172.21.15.96:0/3706533443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c0f59e0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 -- 172.21.15.96:0/3706533443 >> 172.21.15.96:0/3706533443 conn(0x7fda8c0f0d40 msgr2=0x7fda8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.428+0000 7fda908b8700 1 -- 172.21.15.96:0/3706533443 shutdown_connections 2022-02-02T20:56:51.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.429+0000 7fda908b8700 1 -- 172.21.15.96:0/3706533443 wait complete. 2022-02-02T20:56:51.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 Processor -- start 2022-02-02T20:56:51.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 -- start start 2022-02-02T20:56:51.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0603c0 con 0x7fda8c0f55c0 2022-02-02T20:56:51.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.430+0000 7fda908b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c060500 con 0x7fda8c0f6860 2022-02-02T20:56:51.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39980/0 (socket says 172.21.15.96:39980) 2022-02-02T20:56:51.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 -- 172.21.15.96:0/2745880382 learned_addr learned my addr 172.21.15.96:0/2745880382 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:51.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda89d9b700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 -- 172.21.15.96:0/2745880382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 msgr2=0x7fda8c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 -- 172.21.15.96:0/2745880382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80005040 con 0x7fda8c0f55c0 2022-02-02T20:56:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda89d9b700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:56:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda8a59c700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7fda80004f60 tx=0x7fda80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda80018070 con 0x7fda8c0f55c0 2022-02-02T20:56:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda80007ba0 con 0x7fda8c0f55c0 2022-02-02T20:56:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c10c6e0 con 0x7fda8c0f55c0 2022-02-02T20:56:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8001c620 con 0x7fda8c0f55c0 2022-02-02T20:56:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.431+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c10cc10 con 0x7fda8c0f55c0 2022-02-02T20:56:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.432+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c0f49b0 con 0x7fda8c0f55c0 2022-02-02T20:56:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.433+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda8001c8e0 con 0x7fda8c0f55c0 2022-02-02T20:56:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.433+0000 7fda7affd700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.433+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fda80083960 con 0x7fda8c0f55c0 2022-02-02T20:56:51.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.433+0000 7fda89d9b700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.433+0000 7fda89d9b700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 0x7fda74067290 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fda7c004a70 tx=0x7fda7c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.437+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda80051b20 con 0x7fda8c0f55c0 2022-02-02T20:56:51.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.611+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda8c0fdec0 con 0x7fda74064dd0 2022-02-02T20:56:51.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.621+0000 7fda7affd700 1 -- 172.21.15.96:0/2745880382 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fda8c0fdec0 con 0x7fda74064dd0 2022-02-02T20:56:51.623 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:56:51.623 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:56:51.623 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:56:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:56:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:56:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:56:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:56:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:56:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:56:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:56:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:56:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:56:51.626 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:56:51.626 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:56:51.626 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:56:51.626 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:56:51.626 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:56:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:56:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:56:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:56:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:56:51.628 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:56:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 msgr2=0x7fda74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 0x7fda74067290 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fda7c004a70 tx=0x7fda7c009040).stop 2022-02-02T20:56:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 msgr2=0x7fda8c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7fda80004f60 tx=0x7fda80009b30).stop 2022-02-02T20:56:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 shutdown_connections 2022-02-02T20:56:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0f55c0 0x7fda8c109c90 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 --2- 172.21.15.96:0/2745880382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c0f6860 0x7fda8c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 >> 172.21.15.96:0/2745880382 conn(0x7fda8c0f0d40 msgr2=0x7fda8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 shutdown_connections 2022-02-02T20:56:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.623+0000 7fda908b8700 1 -- 172.21.15.96:0/2745880382 wait complete. 2022-02-02T20:56:51.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 -- 172.21.15.96:0/3997079317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f7980 msgr2=0x7f06fc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 --2- 172.21.15.96:0/3997079317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f7980 0x7f06fc0f7de0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 rx=0x7f06f8004660 tx=0x7f06f8009b30).stop 2022-02-02T20:56:51.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 -- 172.21.15.96:0/3997079317 shutdown_connections 2022-02-02T20:56:51.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 --2- 172.21.15.96:0/3997079317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f7980 0x7f06fc0f7de0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 --2- 172.21.15.96:0/3997079317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f66e0 0x7f06fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 -- 172.21.15.96:0/3997079317 >> 172.21.15.96:0/3997079317 conn(0x7f06fc0f1e40 msgr2=0x7f06fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 -- 172.21.15.96:0/3997079317 shutdown_connections 2022-02-02T20:56:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.720+0000 7f0703fdf700 1 -- 172.21.15.96:0/3997079317 wait complete. 2022-02-02T20:56:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 Processor -- start 2022-02-02T20:56:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 -- start start 2022-02-02T20:56:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 0x7f06fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 0x7f06fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc06a380 con 0x7f06fc0f66e0 2022-02-02T20:56:51.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0703fdf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc06a4c0 con 0x7f06fc0f7980 2022-02-02T20:56:51.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f070157a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 0x7f06fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f0701d7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 0x7f06fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f070157a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 0x7f06fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:44096/0 (socket says 172.21.15.96:44096) 2022-02-02T20:56:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.721+0000 7f070157a700 1 -- 172.21.15.96:0/249206410 learned_addr learned my addr 172.21.15.96:0/249206410 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0701d7b700 1 -- 172.21.15.96:0/249206410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 msgr2=0x7f06fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0701d7b700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 0x7f06fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0701d7b700 1 -- 172.21.15.96:0/249206410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8005040 con 0x7f06fc0f66e0 2022-02-02T20:56:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0701d7b700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 0x7f06fc06b9a0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 rx=0x7f06ec00c460 tx=0x7f06ec007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ec00f650 con 0x7f06fc0f66e0 2022-02-02T20:56:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06ec00ce80 con 0x7f06fc0f66e0 2022-02-02T20:56:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc06a7a0 con 0x7f06fc0f66e0 2022-02-02T20:56:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc10ef90 con 0x7f06fc0f66e0 2022-02-02T20:56:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.722+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ec012b70 con 0x7f06fc0f66e0 2022-02-02T20:56:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.723+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4004fa0 con 0x7f06fc0f66e0 2022-02-02T20:56:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.723+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06ec019030 con 0x7f06fc0f66e0 2022-02-02T20:56:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.724+0000 7f06f27fc700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 0x7f06e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.724+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f06ec081490 con 0x7f06fc0f66e0 2022-02-02T20:56:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.724+0000 7f070157a700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 0x7f06e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:51.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.724+0000 7f070157a700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 0x7f06e8067290 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f06f8004630 tx=0x7f06f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:51.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.728+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06ec0487d0 con 0x7f06fc0f66e0 2022-02-02T20:56:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.959+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f06e4005e80 con 0x7f06fc0f66e0 2022-02-02T20:56:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.959+0000 7f06f27fc700 1 -- 172.21.15.96:0/249206410 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f06ec0172e0 con 0x7f06fc0f66e0 2022-02-02T20:56:51.961 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:56:51.961 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:56:51.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:56:51.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:51.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:56:51.962 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:56:51.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:51.962 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:56:51.963 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:56:51.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:51.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:56:51.963 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:56:51.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:56:51.964 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:56:51.964 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:56:51.964 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:56:51.965 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:56:51.965 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:56:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 msgr2=0x7f06e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 0x7f06e8067290 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f06f8004630 tx=0x7f06f8009b30).stop 2022-02-02T20:56:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 msgr2=0x7f06fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 0x7f06fc06b9a0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 rx=0x7f06ec00c460 tx=0x7f06ec007d80).stop 2022-02-02T20:56:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 shutdown_connections 2022-02-02T20:56:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f06e8064dd0 0x7f06e8067290 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06fc0f66e0 0x7f06fc06b9a0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 --2- 172.21.15.96:0/249206410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06fc0f7980 0x7f06fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.961+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 >> 172.21.15.96:0/249206410 conn(0x7f06fc0f1e40 msgr2=0x7f06fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.962+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 shutdown_connections 2022-02-02T20:56:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:51.962+0000 7f0703fdf700 1 -- 172.21.15.96:0/249206410 wait complete. 2022-02-02T20:56:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 -- 172.21.15.96:0/4176753122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f55e0 msgr2=0x7fa4380f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 --2- 172.21.15.96:0/4176753122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f55e0 0x7fa4380f5a00 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 rx=0x7fa434004660 tx=0x7fa434009b30).stop 2022-02-02T20:56:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 -- 172.21.15.96:0/4176753122 shutdown_connections 2022-02-02T20:56:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 --2- 172.21.15.96:0/4176753122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f6880 0x7fa4380f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:56:52.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 --2- 172.21.15.96:0/4176753122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f55e0 0x7fa4380f5a00 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:52.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 -- 172.21.15.96:0/4176753122 >> 172.21.15.96:0/4176753122 conn(0x7fa4380f0d40 msgr2=0x7fa4380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:52.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 -- 172.21.15.96:0/4176753122 shutdown_connections 2022-02-02T20:56:52.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 -- 172.21.15.96:0/4176753122 wait complete. 2022-02-02T20:56:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.059+0000 7fa440426700 1 Processor -- start 2022-02-02T20:56:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa440426700 1 -- start start 2022-02-02T20:56:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa440426700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f55e0 0x7fa438109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa440426700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:52.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa440426700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438060590 con 0x7fa4380f6880 2022-02-02T20:56:52.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa440426700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380606d0 con 0x7fa4380f55e0 2022-02-02T20:56:52.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:52.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43e1c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f55e0 0x7fa438109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:52.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40002/0 (socket says 172.21.15.96:40002) 2022-02-02T20:56:52.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 -- 172.21.15.96:0/3029362970 learned_addr learned my addr 172.21.15.96:0/3029362970 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:56:52.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 -- 172.21.15.96:0/3029362970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f55e0 msgr2=0x7fa438109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:52.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f55e0 0x7fa438109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:52.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 -- 172.21.15.96:0/3029362970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434005040 con 0x7fa4380f6880 2022-02-02T20:56:52.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.060+0000 7fa43d9c1700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7fa42800b410 tx=0x7fa428006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:52.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.061+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4280125f0 con 0x7fa4380f6880 2022-02-02T20:56:52.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.061+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa42800be30 con 0x7fa4380f6880 2022-02-02T20:56:52.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.061+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43810c7f0 con 0x7fa4380f6880 2022-02-02T20:56:52.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.061+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa428002a70 con 0x7fa4380f6880 2022-02-02T20:56:52.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.061+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43810cd80 con 0x7fa4380f6880 2022-02-02T20:56:52.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.062+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4380f49d0 con 0x7fa4380f6880 2022-02-02T20:56:52.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.062+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa42800f030 con 0x7fa4380f6880 2022-02-02T20:56:52.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.062+0000 7fa42effd700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 0x7fa424067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:56:52.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.062+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa428081e80 con 0x7fa4380f6880 2022-02-02T20:56:52.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.063+0000 7fa43e1c2700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 0x7fa424067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:56:52.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.063+0000 7fa43e1c2700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 0x7fa424067290 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fa434013690 tx=0x7fa434009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:56:52.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.067+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa42804ff80 con 0x7fa4380f6880 2022-02-02T20:56:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.267+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4380fde20 con 0x7fa4380f6880 2022-02-02T20:56:52.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.267+0000 7fa42effd700 1 -- 172.21.15.96:0/3029362970 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa4280535a0 con 0x7fa4380f6880 2022-02-02T20:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:56:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 msgr2=0x7fa424067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 0x7fa424067290 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fa434013690 tx=0x7fa434009b30).stop 2022-02-02T20:56:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 msgr2=0x7fa43810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:56:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7fa42800b410 tx=0x7fa428006ef0).stop 2022-02-02T20:56:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 shutdown_connections 2022-02-02T20:56:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa424064dd0 0x7fa424067290 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f55e0 0x7fa438109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 --2- 172.21.15.96:0/3029362970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f6880 0x7fa43810c190 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:56:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 >> 172.21.15.96:0/3029362970 conn(0x7fa4380f0d40 msgr2=0x7fa4380fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:56:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 shutdown_connections 2022-02-02T20:56:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:56:52.269+0000 7fa440426700 1 -- 172.21.15.96:0/3029362970 wait complete. 2022-02-02T20:56:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:56:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:52 smithi159 ceph-mon[69013]: from='client.38866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:52 smithi159 ceph-mon[69013]: from='client.38870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:52 smithi159 ceph-mon[69013]: pgmap v4643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/249206410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:56:53.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3029362970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:56:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:52 smithi096 ceph-mon[101353]: from='client.38866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:52 smithi096 ceph-mon[101353]: from='client.38870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:56:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:52 smithi096 ceph-mon[101353]: pgmap v4643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/249206410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:56:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3029362970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:56:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:54 smithi159 ceph-mon[69013]: pgmap v4644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:54 smithi096 ceph-mon[101353]: pgmap v4644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:56 smithi159 ceph-mon[69013]: pgmap v4645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:56 smithi096 ceph-mon[101353]: pgmap v4645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:56:58 smithi159 ceph-mon[69013]: pgmap v4646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:56:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:56:58 smithi096 ceph-mon[101353]: pgmap v4646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:00 smithi159 ceph-mon[69013]: pgmap v4647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:00 smithi096 ceph-mon[101353]: pgmap v4647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:02 smithi159 ceph-mon[69013]: pgmap v4648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:02 smithi096 ceph-mon[101353]: pgmap v4648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:04 smithi159 ceph-mon[69013]: pgmap v4649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:04 smithi096 ceph-mon[101353]: pgmap v4649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:06 smithi159 ceph-mon[69013]: pgmap v4650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:06 smithi096 ceph-mon[101353]: pgmap v4650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:08 smithi159 ceph-mon[69013]: pgmap v4651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:08 smithi096 ceph-mon[101353]: pgmap v4651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:10 smithi159 ceph-mon[69013]: pgmap v4652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:10 smithi096 ceph-mon[101353]: pgmap v4652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:12 smithi159 ceph-mon[69013]: pgmap v4653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:12 smithi096 ceph-mon[101353]: pgmap v4653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:14 smithi159 ceph-mon[69013]: pgmap v4654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:15.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:14 smithi096 ceph-mon[101353]: pgmap v4654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:16 smithi159 ceph-mon[69013]: pgmap v4655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:16 smithi096 ceph-mon[101353]: pgmap v4655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:18 smithi159 ceph-mon[69013]: pgmap v4656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:18 smithi096 ceph-mon[101353]: pgmap v4656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:20 smithi159 ceph-mon[69013]: pgmap v4657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:20 smithi096 ceph-mon[101353]: pgmap v4657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:22.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2779159592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 msgr2=0x7f2a280f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2779159592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a280f7de0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 rx=0x7f2a18004660 tx=0x7f2a18009b30).stop 2022-02-02T20:57:22.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2779159592 shutdown_connections 2022-02-02T20:57:22.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2779159592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a280f7de0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2779159592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2779159592 >> 172.21.15.96:0/2779159592 conn(0x7f2a280f1e40 msgr2=0x7f2a280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:22.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2779159592 shutdown_connections 2022-02-02T20:57:22.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.380+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2779159592 wait complete. 2022-02-02T20:57:22.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 Processor -- start 2022-02-02T20:57:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 -- start start 2022-02-02T20:57:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2806a380 con 0x7f2a280f7980 2022-02-02T20:57:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2ca41700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2806a4c0 con 0x7f2a280f66e0 2022-02-02T20:57:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40020/0 (socket says 172.21.15.96:40020) 2022-02-02T20:57:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 -- 172.21.15.96:0/2503671278 learned_addr learned my addr 172.21.15.96:0/2503671278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2659c700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 -- 172.21.15.96:0/2503671278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 msgr2=0x7f2a2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 -- 172.21.15.96:0/2503671278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18005040 con 0x7f2a280f7980 2022-02-02T20:57:22.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a2659c700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:57:22.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.381+0000 7f2a25d9b700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 rx=0x7f2a18009990 tx=0x7f2a18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.382+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a18018070 con 0x7f2a280f7980 2022-02-02T20:57:22.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.382+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a18007ca0 con 0x7f2a280f7980 2022-02-02T20:57:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.382+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a1801c620 con 0x7f2a280f7980 2022-02-02T20:57:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.382+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2806a740 con 0x7f2a280f7980 2022-02-02T20:57:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.382+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2806aca0 con 0x7f2a280f7980 2022-02-02T20:57:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.383+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a28045ad0 con 0x7f2a280f7980 2022-02-02T20:57:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.383+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a1801d960 con 0x7f2a280f7980 2022-02-02T20:57:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.384+0000 7f2a16ffd700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 0x7f2a10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.384+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2a180837c0 con 0x7f2a280f7980 2022-02-02T20:57:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.384+0000 7f2a2659c700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 0x7f2a10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.384+0000 7f2a2659c700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 0x7f2a10067290 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f2a2806b730 tx=0x7f2a1c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.388+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a18051800 con 0x7f2a280f7980 2022-02-02T20:57:22.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.569+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a280ff050 con 0x7f2a10064dd0 2022-02-02T20:57:22.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.570+0000 7f2a16ffd700 1 -- 172.21.15.96:0/2503671278 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2a1c004600 con 0x7f2a10064dd0 2022-02-02T20:57:22.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 msgr2=0x7f2a10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 0x7f2a10067290 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f2a2806b730 tx=0x7f2a1c009040).stop 2022-02-02T20:57:22.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 msgr2=0x7f2a28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 rx=0x7f2a18009990 tx=0x7f2a18009b30).stop 2022-02-02T20:57:22.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 shutdown_connections 2022-02-02T20:57:22.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a10064dd0 0x7f2a10067290 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a280f66e0 0x7f2a2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 --2- 172.21.15.96:0/2503671278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a280f7980 0x7f2a28069e20 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 >> 172.21.15.96:0/2503671278 conn(0x7f2a280f1e40 msgr2=0x7f2a280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 shutdown_connections 2022-02-02T20:57:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.572+0000 7f2a2ca41700 1 -- 172.21.15.96:0/2503671278 wait complete. 2022-02-02T20:57:22.582 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:57:22.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 -- 172.21.15.96:0/1376119579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f4de0 msgr2=0x7f51f40f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 --2- 172.21.15.96:0/1376119579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f4de0 0x7f51f40f5200 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 rx=0x7f51e8004660 tx=0x7f51e8009b30).stop 2022-02-02T20:57:22.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 -- 172.21.15.96:0/1376119579 shutdown_connections 2022-02-02T20:57:22.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 --2- 172.21.15.96:0/1376119579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f5fe0 0x7f51f40f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 --2- 172.21.15.96:0/1376119579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f4de0 0x7f51f40f5200 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 -- 172.21.15.96:0/1376119579 >> 172.21.15.96:0/1376119579 conn(0x7f51f40f0540 msgr2=0x7f51f40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:22.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 -- 172.21.15.96:0/1376119579 shutdown_connections 2022-02-02T20:57:22.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.669+0000 7f51fad9e700 1 -- 172.21.15.96:0/1376119579 wait complete. 2022-02-02T20:57:22.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 Processor -- start 2022-02-02T20:57:22.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 -- start start 2022-02-02T20:57:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f4de0 0x7f51f4108710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4109140 con 0x7f51f40f5fe0 2022-02-02T20:57:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51fad9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4109280 con 0x7f51f40f4de0 2022-02-02T20:57:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.670+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f8b3a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f4de0 0x7f51f4108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40030/0 (socket says 172.21.15.96:40030) 2022-02-02T20:57:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 -- 172.21.15.96:0/2343252281 learned_addr learned my addr 172.21.15.96:0/2343252281 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 -- 172.21.15.96:0/2343252281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f4de0 msgr2=0x7f51f4108710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f4de0 0x7f51f4108710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 -- 172.21.15.96:0/2343252281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8005040 con 0x7f51f40f5fe0 2022-02-02T20:57:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f3fff700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 rx=0x7f51e00026d0 tx=0x7f51e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e00079c0 con 0x7f51f40f5fe0 2022-02-02T20:57:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4105250 con 0x7f51f40f5fe0 2022-02-02T20:57:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51e000f040 con 0x7f51f40f5fe0 2022-02-02T20:57:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e00148b0 con 0x7f51f40f5fe0 2022-02-02T20:57:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.671+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f41057c0 con 0x7f51f40f5fe0 2022-02-02T20:57:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.672+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f4045ad0 con 0x7f51f40f5fe0 2022-02-02T20:57:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.673+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f51e0007b20 con 0x7f51f40f5fe0 2022-02-02T20:57:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.673+0000 7f51f17fa700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.673+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f51e0081e10 con 0x7f51f40f5fe0 2022-02-02T20:57:22.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.673+0000 7f51f8b3a700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.673+0000 7f51f8b3a700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f51e8004630 tx=0x7f51e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.677+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f51e0053940 con 0x7f51f40f5fe0 2022-02-02T20:57:22.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.850+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51f40ff4e0 con 0x7f51e4064dd0 2022-02-02T20:57:22.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.860+0000 7f51f17fa700 1 -- 172.21.15.96:0/2343252281 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f51f40ff4e0 con 0x7f51e4064dd0 2022-02-02T20:57:22.862 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:57:22.862 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:57:22.862 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:57:22.862 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:57:22.863 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:57:22.863 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:57:22.863 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:57:22.863 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:57:22.863 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:57:22.864 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:57:22.864 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:57:22.864 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:57:22.865 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:57:22.865 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:57:22.865 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:57:22.865 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:57:22.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:57:22.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:57:22.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:57:22.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:57:22.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:57:22.867 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:57:22.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 msgr2=0x7f51e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f51e8004630 tx=0x7f51e8009b30).stop 2022-02-02T20:57:22.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 msgr2=0x7f51f4108c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 rx=0x7f51e00026d0 tx=0x7f51e0009de0).stop 2022-02-02T20:57:22.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 shutdown_connections 2022-02-02T20:57:22.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f51e4064dd0 0x7f51e4067290 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51f40f4de0 0x7f51f4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 --2- 172.21.15.96:0/2343252281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51f40f5fe0 0x7f51f4108c00 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 >> 172.21.15.96:0/2343252281 conn(0x7f51f40f0540 msgr2=0x7f51f40f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:22.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 shutdown_connections 2022-02-02T20:57:22.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.862+0000 7f51fad9e700 1 -- 172.21.15.96:0/2343252281 wait complete. 2022-02-02T20:57:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.958+0000 7f3835e47700 1 -- 172.21.15.96:0/3220202747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 msgr2=0x7f38300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.958+0000 7f3835e47700 1 --2- 172.21.15.96:0/3220202747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f38300f6950 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 rx=0x7f3824004660 tx=0x7f3824009b30).stop 2022-02-02T20:57:22.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 -- 172.21.15.96:0/3220202747 shutdown_connections 2022-02-02T20:57:22.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 --2- 172.21.15.96:0/3220202747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 0x7f38300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 --2- 172.21.15.96:0/3220202747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f38300f6950 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 -- 172.21.15.96:0/3220202747 >> 172.21.15.96:0/3220202747 conn(0x7f38300f1c90 msgr2=0x7f38300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:22.962 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:22 smithi096 ceph-mon[101353]: pgmap v4658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:22.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 -- 172.21.15.96:0/3220202747 shutdown_connections 2022-02-02T20:57:22.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 -- 172.21.15.96:0/3220202747 wait complete. 2022-02-02T20:57:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 Processor -- start 2022-02-02T20:57:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.959+0000 7f3835e47700 1 -- start start 2022-02-02T20:57:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3835e47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3835e47700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 0x7f38301072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3835e47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38301078f0 con 0x7f38300f6530 2022-02-02T20:57:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3835e47700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830108100 con 0x7f38300f77d0 2022-02-02T20:57:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40040/0 (socket says 172.21.15.96:40040) 2022-02-02T20:57:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 -- 172.21.15.96:0/2077748794 learned_addr learned my addr 172.21.15.96:0/2077748794 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f382ffff700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 0x7f38301072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 -- 172.21.15.96:0/2077748794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 msgr2=0x7f38301072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 0x7f38301072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 -- 172.21.15.96:0/2077748794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824005040 con 0x7f38300f6530 2022-02-02T20:57:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.960+0000 7f3834e45700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7f3824004f60 tx=0x7f3824009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.961+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3824018070 con 0x7f38300f6530 2022-02-02T20:57:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.961+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3830108320 con 0x7f38300f6530 2022-02-02T20:57:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.961+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3830108880 con 0x7f38300f6530 2022-02-02T20:57:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.961+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3824009770 con 0x7f38300f6530 2022-02-02T20:57:22.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.961+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382401c3c0 con 0x7f38300f6530 2022-02-02T20:57:22.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.962+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3810004fa0 con 0x7f38300f6530 2022-02-02T20:57:22.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.962+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f382401d420 con 0x7f38300f6530 2022-02-02T20:57:22.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.962+0000 7f382d7fa700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 0x7f38200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:22.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.963+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3824083740 con 0x7f38300f6530 2022-02-02T20:57:22.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.963+0000 7f382ffff700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 0x7f38200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:22.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.963+0000 7f382ffff700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 0x7f38200672e0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f381c007fd0 tx=0x7f381c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:22.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:22.967+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3824051900 con 0x7f38300f6530 2022-02-02T20:57:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:22 smithi159 ceph-mon[69013]: pgmap v4658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:23.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.200+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3810005e80 con 0x7f38300f6530 2022-02-02T20:57:23.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.201+0000 7f382d7fa700 1 -- 172.21.15.96:0/2077748794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3824054f20 con 0x7f38300f6530 2022-02-02T20:57:23.203 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:57:23.203 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:57:23.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:57:23.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:23.204 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:57:23.204 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:57:23.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:23.204 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:57:23.205 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:57:23.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:23.205 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:57:23.205 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:57:23.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:23.206 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:57:23.206 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:57:23.206 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:57:23.206 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:57:23.207 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:57:23.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 msgr2=0x7f38200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 0x7f38200672e0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f381c007fd0 tx=0x7f381c009040).stop 2022-02-02T20:57:23.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 msgr2=0x7f3830106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7f3824004f60 tx=0x7f3824009b30).stop 2022-02-02T20:57:23.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 shutdown_connections 2022-02-02T20:57:23.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3820064e20 0x7f38200672e0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38300f6530 0x7f3830106e00 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 --2- 172.21.15.96:0/2077748794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38300f77d0 0x7f38301072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 >> 172.21.15.96:0/2077748794 conn(0x7f38300f1c90 msgr2=0x7f38300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:23.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 shutdown_connections 2022-02-02T20:57:23.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.203+0000 7f3835e47700 1 -- 172.21.15.96:0/2077748794 wait complete. 2022-02-02T20:57:23.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 -- 172.21.15.96:0/4112562910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f55c0 msgr2=0x7f93d40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/4112562910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f55c0 0x7f93d40f59e0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 rx=0x7f93c8004660 tx=0x7f93c8009b30).stop 2022-02-02T20:57:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 -- 172.21.15.96:0/4112562910 shutdown_connections 2022-02-02T20:57:23.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/4112562910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f6860 0x7f93d40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:57:23.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/4112562910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f55c0 0x7f93d40f59e0 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 -- 172.21.15.96:0/4112562910 >> 172.21.15.96:0/4112562910 conn(0x7f93d40f0d40 msgr2=0x7f93d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 -- 172.21.15.96:0/4112562910 shutdown_connections 2022-02-02T20:57:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 -- 172.21.15.96:0/4112562910 wait complete. 2022-02-02T20:57:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.302+0000 7f93d9fc4700 1 Processor -- start 2022-02-02T20:57:23.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d9fc4700 1 -- start start 2022-02-02T20:57:23.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d9fc4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f55c0 0x7f93d4109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:23.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d9fc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d9fc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4060470 con 0x7f93d40f6860 2022-02-02T20:57:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d9fc4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40605b0 con 0x7f93d40f55c0 2022-02-02T20:57:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40052/0 (socket says 172.21.15.96:40052) 2022-02-02T20:57:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 -- 172.21.15.96:0/1316516707 learned_addr learned my addr 172.21.15.96:0/1316516707 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d37fe700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f55c0 0x7f93d4109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 -- 172.21.15.96:0/1316516707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f55c0 msgr2=0x7f93d4109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f55c0 0x7f93d4109cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 -- 172.21.15.96:0/1316516707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8005040 con 0x7f93d40f6860 2022-02-02T20:57:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.303+0000 7f93d2ffd700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f93c400b410 tx=0x7f93c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.304+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c40125f0 con 0x7f93d40f6860 2022-02-02T20:57:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.304+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d410c820 con 0x7f93d40f6860 2022-02-02T20:57:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.304+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d410cdb0 con 0x7f93d40f6860 2022-02-02T20:57:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.304+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93c400be30 con 0x7f93d40f6860 2022-02-02T20:57:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.304+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c40027d0 con 0x7f93d40f6860 2022-02-02T20:57:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.305+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4004fa0 con 0x7f93d40f6860 2022-02-02T20:57:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.305+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93c400f030 con 0x7f93d40f6860 2022-02-02T20:57:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.305+0000 7f93bbfff700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 0x7f93bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.305+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93c4081b10 con 0x7f93d40f6860 2022-02-02T20:57:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.305+0000 7f93d37fe700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 0x7f93bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.306+0000 7f93d37fe700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 0x7f93bc067290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f93c8013690 tx=0x7f93c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.310+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93c404fc10 con 0x7f93d40f6860 2022-02-02T20:57:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.515+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93b4005e80 con 0x7f93d40f6860 2022-02-02T20:57:23.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.516+0000 7f93bbfff700 1 -- 172.21.15.96:0/1316516707 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f93c4053230 con 0x7f93d40f6860 2022-02-02T20:57:23.518 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:57:23.518 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:57:23.518 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:57:23.518 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:57:23.519 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:23.519 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:57:23.519 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:57:23.519 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:57:23.520 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:57:23.520 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:57:23.520 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:57:23.520 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:57:23.520 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:57:23.521 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:57:23.521 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:57:23.521 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:57:23.521 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:57:23.521 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:57:23.522 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:57:23.522 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:57:23.522 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:57:23.522 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:57:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:57:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:57:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:57:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:57:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:57:23.524 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:57:23.524 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:57:23.524 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:57:23.524 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:57:23.524 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:57:23.525 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:23.525 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:23.525 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:57:23.525 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:23.525 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:23.526 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:23.526 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 msgr2=0x7f93bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 0x7f93bc067290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f93c8013690 tx=0x7f93c8009b30).stop 2022-02-02T20:57:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 msgr2=0x7f93d410c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f93c400b410 tx=0x7f93c4006ef0).stop 2022-02-02T20:57:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 shutdown_connections 2022-02-02T20:57:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93bc064dd0 0x7f93bc067290 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f55c0 0x7f93d4109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 --2- 172.21.15.96:0/1316516707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f6860 0x7f93d410c1c0 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 >> 172.21.15.96:0/1316516707 conn(0x7f93d40f0d40 msgr2=0x7f93d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:23.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 shutdown_connections 2022-02-02T20:57:23.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:23.518+0000 7f93d9fc4700 1 -- 172.21.15.96:0/1316516707 wait complete. 2022-02-02T20:57:23.529 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:57:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:23 smithi159 ceph-mon[69013]: from='client.38882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:23 smithi159 ceph-mon[69013]: from='client.38886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:23.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2077748794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:57:23.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1316516707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:57:23.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:23 smithi096 ceph-mon[101353]: from='client.38882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:23.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:23 smithi096 ceph-mon[101353]: from='client.38886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:23.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2077748794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:57:23.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1316516707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:57:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:24 smithi159 ceph-mon[69013]: pgmap v4659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:24 smithi096 ceph-mon[101353]: pgmap v4659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:26 smithi159 ceph-mon[69013]: pgmap v4660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:26 smithi096 ceph-mon[101353]: pgmap v4660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:57:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:57:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:28 smithi159 ceph-mon[69013]: pgmap v4661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:57:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:57:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:28 smithi096 ceph-mon[101353]: pgmap v4661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:30 smithi159 ceph-mon[69013]: pgmap v4662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:30 smithi096 ceph-mon[101353]: pgmap v4662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:32 smithi159 ceph-mon[69013]: pgmap v4663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:32 smithi096 ceph-mon[101353]: pgmap v4663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:34 smithi159 ceph-mon[69013]: pgmap v4664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:34 smithi096 ceph-mon[101353]: pgmap v4664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:36 smithi159 ceph-mon[69013]: pgmap v4665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:36 smithi096 ceph-mon[101353]: pgmap v4665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:38 smithi159 ceph-mon[69013]: pgmap v4666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:38 smithi096 ceph-mon[101353]: pgmap v4666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:40 smithi159 ceph-mon[69013]: pgmap v4667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:40 smithi096 ceph-mon[101353]: pgmap v4667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:42 smithi159 ceph-mon[69013]: pgmap v4668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:42 smithi096 ceph-mon[101353]: pgmap v4668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:44 smithi159 ceph-mon[69013]: pgmap v4669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:44 smithi096 ceph-mon[101353]: pgmap v4669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:46 smithi159 ceph-mon[69013]: pgmap v4670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:46 smithi096 ceph-mon[101353]: pgmap v4670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:48 smithi159 ceph-mon[69013]: pgmap v4671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:48 smithi096 ceph-mon[101353]: pgmap v4671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:50 smithi159 ceph-mon[69013]: pgmap v4672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:50 smithi096 ceph-mon[101353]: pgmap v4672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:52 smithi159 ceph-mon[69013]: pgmap v4673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:52 smithi096 ceph-mon[101353]: pgmap v4673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:53.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 -- 172.21.15.96:0/3461443212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0602b0 msgr2=0x7f6ecc0f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/3461443212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f9180 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 rx=0x7f6ec0004660 tx=0x7f6ec0009b30).stop 2022-02-02T20:57:53.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 -- 172.21.15.96:0/3461443212 shutdown_connections 2022-02-02T20:57:53.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/3461443212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/3461443212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f9180 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 -- 172.21.15.96:0/3461443212 >> 172.21.15.96:0/3461443212 conn(0x7f6ecc0f0ba0 msgr2=0x7f6ecc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:53.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 -- 172.21.15.96:0/3461443212 shutdown_connections 2022-02-02T20:57:53.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.627+0000 7f6ecbfff700 1 -- 172.21.15.96:0/3461443212 wait complete. 2022-02-02T20:57:53.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 Processor -- start 2022-02-02T20:57:53.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 -- start start 2022-02-02T20:57:53.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0f55e0 con 0x7f6ecc0f9700 2022-02-02T20:57:53.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0f5720 con 0x7f6ecc0602b0 2022-02-02T20:57:53.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:53.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40068/0 (socket says 172.21.15.96:40068) 2022-02-02T20:57:53.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 -- 172.21.15.96:0/277005798 learned_addr learned my addr 172.21.15.96:0/277005798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:53.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6ecaffd700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:53.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 -- 172.21.15.96:0/277005798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0602b0 msgr2=0x7f6ecc0f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.628+0000 7f6eca7fc700 1 -- 172.21.15.96:0/277005798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0005040 con 0x7f6ecc0f9700 2022-02-02T20:57:53.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6eca7fc700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7f6ebc002700 tx=0x7f6ebc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:53.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ebc0079c0 con 0x7f6ecc0f9700 2022-02-02T20:57:53.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ebc00f040 con 0x7f6ecc0f9700 2022-02-02T20:57:53.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0f5a00 con 0x7f6ecc0f9700 2022-02-02T20:57:53.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ebc014740 con 0x7f6ecc0f9700 2022-02-02T20:57:53.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.629+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc10ed90 con 0x7f6ecc0f9700 2022-02-02T20:57:53.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.630+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc045ad0 con 0x7f6ecc0f9700 2022-02-02T20:57:53.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.630+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6ebc01b060 con 0x7f6ecc0f9700 2022-02-02T20:57:53.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.631+0000 7f6eb37fe700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 0x7f6eb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.631+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6ebc081920 con 0x7f6ecc0f9700 2022-02-02T20:57:53.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.631+0000 7f6ecaffd700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 0x7f6eb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:53.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.631+0000 7f6ecaffd700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 0x7f6eb40672e0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f6ec0004630 tx=0x7f6ec0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:53.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.635+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6ebc04f9c0 con 0x7f6ecc0f9700 2022-02-02T20:57:53.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.815+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ecc0fee30 con 0x7f6eb4064e20 2022-02-02T20:57:53.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.816+0000 7f6eb37fe700 1 -- 172.21.15.96:0/277005798 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6ecc0fee30 con 0x7f6eb4064e20 2022-02-02T20:57:53.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.817+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 msgr2=0x7f6eb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.817+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 0x7f6eb40672e0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f6ec0004630 tx=0x7f6ec0009b30).stop 2022-02-02T20:57:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 msgr2=0x7f6ecc0f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7f6ebc002700 tx=0x7f6ebc009d60).stop 2022-02-02T20:57:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 shutdown_connections 2022-02-02T20:57:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6eb4064e20 0x7f6eb40672e0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc0602b0 0x7f6ecc0f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 --2- 172.21.15.96:0/277005798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ecc0f9700 0x7f6ecc0f5080 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 >> 172.21.15.96:0/277005798 conn(0x7f6ecc0f0ba0 msgr2=0x7f6ecc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:53.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 shutdown_connections 2022-02-02T20:57:53.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.818+0000 7f6ecbfff700 1 -- 172.21.15.96:0/277005798 wait complete. 2022-02-02T20:57:53.829 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:57:53.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 -- 172.21.15.96:0/2280483254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f6c60 msgr2=0x7f70d00f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 --2- 172.21.15.96:0/2280483254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f6c60 0x7f70d00f7080 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 rx=0x7f70c0004660 tx=0x7f70c0009b30).stop 2022-02-02T20:57:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 -- 172.21.15.96:0/2280483254 shutdown_connections 2022-02-02T20:57:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 --2- 172.21.15.96:0/2280483254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d00f5970 0x7f70d00f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 --2- 172.21.15.96:0/2280483254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f6c60 0x7f70d00f7080 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.915+0000 7f70d8054700 1 -- 172.21.15.96:0/2280483254 >> 172.21.15.96:0/2280483254 conn(0x7f70d00f04c0 msgr2=0x7f70d00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.916+0000 7f70d8054700 1 -- 172.21.15.96:0/2280483254 shutdown_connections 2022-02-02T20:57:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.916+0000 7f70d8054700 1 -- 172.21.15.96:0/2280483254 wait complete. 2022-02-02T20:57:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 Processor -- start 2022-02-02T20:57:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 -- start start 2022-02-02T20:57:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d00f6c60 0x7f70d01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0106950 con 0x7f70d00f5970 2022-02-02T20:57:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d8054700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0106a90 con 0x7f70d00f6c60 2022-02-02T20:57:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40076/0 (socket says 172.21.15.96:40076) 2022-02-02T20:57:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 -- 172.21.15.96:0/784724593 learned_addr learned my addr 172.21.15.96:0/784724593 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 -- 172.21.15.96:0/784724593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d00f6c60 msgr2=0x7f70d01063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d00f6c60 0x7f70d01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:57:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.917+0000 7f70d5df0700 1 -- 172.21.15.96:0/784724593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0005040 con 0x7f70d00f5970 2022-02-02T20:57:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70d5df0700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 rx=0x7f70c0004e30 tx=0x7f70c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c001a070 con 0x7f70d00f5970 2022-02-02T20:57:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d01073d0 con 0x7f70d00f5970 2022-02-02T20:57:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70c001fab0 con 0x7f70d00f5970 2022-02-02T20:57:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c001e8a0 con 0x7f70d00f5970 2022-02-02T20:57:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.918+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d0107930 con 0x7f70d00f5970 2022-02-02T20:57:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.919+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0045ad0 con 0x7f70d00f5970 2022-02-02T20:57:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.919+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f70c001fc20 con 0x7f70d00f5970 2022-02-02T20:57:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.919+0000 7f70c67fc700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 0x7f70bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.920+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f70c0085d10 con 0x7f70d00f5970 2022-02-02T20:57:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.920+0000 7f70d55ef700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 0x7f70bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.920+0000 7f70d55ef700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 0x7f70bc067290 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f70cc0047d0 tx=0x7f70cc007a40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:53.924+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f70c0057840 con 0x7f70d00f5970 2022-02-02T20:57:54.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.100+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f70d00f4860 con 0x7f70bc064dd0 2022-02-02T20:57:54.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.109+0000 7f70c67fc700 1 -- 172.21.15.96:0/784724593 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f70d00f4860 con 0x7f70bc064dd0 2022-02-02T20:57:54.111 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:57:54.112 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:57:54.112 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:57:54.112 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:57:54.112 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:57:54.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:57:54.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:57:54.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:57:54.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:57:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:57:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:57:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:57:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:57:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:57:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:57:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:57:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:57:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:57:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:57:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:57:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:57:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:57:54.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 msgr2=0x7f70bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 0x7f70bc067290 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f70cc0047d0 tx=0x7f70cc007a40).stop 2022-02-02T20:57:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 msgr2=0x7f70d0105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 rx=0x7f70c0004e30 tx=0x7f70c0009b30).stop 2022-02-02T20:57:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 shutdown_connections 2022-02-02T20:57:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f70bc064dd0 0x7f70bc067290 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70d00f5970 0x7f70d0105eb0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 --2- 172.21.15.96:0/784724593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d00f6c60 0x7f70d01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T20:57:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 >> 172.21.15.96:0/784724593 conn(0x7f70d00f04c0 msgr2=0x7f70d00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 shutdown_connections 2022-02-02T20:57:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.111+0000 7f70d8054700 1 -- 172.21.15.96:0/784724593 wait complete. 2022-02-02T20:57:54.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 -- 172.21.15.96:0/102535604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f6860 msgr2=0x7f87c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 --2- 172.21.15.96:0/102535604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f6860 0x7f87c80f6cc0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 rx=0x7f87c4004660 tx=0x7f87c4009b30).stop 2022-02-02T20:57:54.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 -- 172.21.15.96:0/102535604 shutdown_connections 2022-02-02T20:57:54.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 --2- 172.21.15.96:0/102535604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f6860 0x7f87c80f6cc0 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 --2- 172.21.15.96:0/102535604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f55c0 0x7f87c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:57:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 -- 172.21.15.96:0/102535604 >> 172.21.15.96:0/102535604 conn(0x7f87c80f0d40 msgr2=0x7f87c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 -- 172.21.15.96:0/102535604 shutdown_connections 2022-02-02T20:57:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 -- 172.21.15.96:0/102535604 wait complete. 2022-02-02T20:57:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.207+0000 7f87d04e1700 1 Processor -- start 2022-02-02T20:57:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87d04e1700 1 -- start start 2022-02-02T20:57:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87d04e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87d04e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f6860 0x7f87c8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87d04e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8107ab0 con 0x7f87c80f55c0 2022-02-02T20:57:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87d04e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8108360 con 0x7f87c80f6860 2022-02-02T20:57:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40086/0 (socket says 172.21.15.96:40086) 2022-02-02T20:57:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 -- 172.21.15.96:0/2473462648 learned_addr learned my addr 172.21.15.96:0/2473462648 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87cda7c700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f6860 0x7f87c8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 -- 172.21.15.96:0/2473462648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f6860 msgr2=0x7f87c8107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f6860 0x7f87c8107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 -- 172.21.15.96:0/2473462648 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4005040 con 0x7f87c80f55c0 2022-02-02T20:57:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87ce27d700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 rx=0x7f87bc0093f0 tx=0x7f87bc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.208+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc013640 con 0x7f87c80f55c0 2022-02-02T20:57:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.209+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f87bc013c50 con 0x7f87c80f55c0 2022-02-02T20:57:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.209+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8108640 con 0x7f87c80f55c0 2022-02-02T20:57:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.209+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc012c70 con 0x7f87c80f55c0 2022-02-02T20:57:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.209+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c8108c00 con 0x7f87c80f55c0 2022-02-02T20:57:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.210+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c80f49b0 con 0x7f87c80f55c0 2022-02-02T20:57:54.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.210+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f87bc01a060 con 0x7f87c80f55c0 2022-02-02T20:57:54.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.210+0000 7f87baffd700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 0x7f87b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.210+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f87bc081a50 con 0x7f87c80f55c0 2022-02-02T20:57:54.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.211+0000 7f87cda7c700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 0x7f87b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.211+0000 7f87cda7c700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 0x7f87b4067290 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f87c4004630 tx=0x7f87c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:54.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.215+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f87bc053520 con 0x7f87c80f55c0 2022-02-02T20:57:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.443+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87c80fde20 con 0x7f87c80f55c0 2022-02-02T20:57:54.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.443+0000 7f87baffd700 1 -- 172.21.15.96:0/2473462648 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f87bc053110 con 0x7f87c80f55c0 2022-02-02T20:57:54.446 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:57:54.446 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:57:54.446 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:57:54.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:54.447 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:57:54.447 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:57:54.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:54.448 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:57:54.449 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:57:54.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:54.449 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:57:54.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:57:54.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:57:54.450 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:57:54.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:57:54.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:57:54.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:57:54.451 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:57:54.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 msgr2=0x7f87b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 0x7f87b4067290 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f87c4004630 tx=0x7f87c4009b30).stop 2022-02-02T20:57:54.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 msgr2=0x7f87c8106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 rx=0x7f87bc0093f0 tx=0x7f87bc006ec0).stop 2022-02-02T20:57:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 shutdown_connections 2022-02-02T20:57:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87b4064dd0 0x7f87b4067290 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c80f55c0 0x7f87c8106f80 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 --2- 172.21.15.96:0/2473462648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c80f6860 0x7f87c8107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 >> 172.21.15.96:0/2473462648 conn(0x7f87c80f0d40 msgr2=0x7f87c805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:54.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 shutdown_connections 2022-02-02T20:57:54.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.445+0000 7f87d04e1700 1 -- 172.21.15.96:0/2473462648 wait complete. 2022-02-02T20:57:54.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 -- 172.21.15.96:0/1602768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00f6870 msgr2=0x7f7da00f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1602768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00f6870 0x7f7da00f6cd0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 rx=0x7f7d94004660 tx=0x7f7d94009b30).stop 2022-02-02T20:57:54.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 -- 172.21.15.96:0/1602768526 shutdown_connections 2022-02-02T20:57:54.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1602768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00f6870 0x7f7da00f6cd0 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1602768526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 0x7f7da00f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 -- 172.21.15.96:0/1602768526 >> 172.21.15.96:0/1602768526 conn(0x7f7da00f0d70 msgr2=0x7f7da00f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:54.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 -- 172.21.15.96:0/1602768526 shutdown_connections 2022-02-02T20:57:54.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.542+0000 7f7da62f8700 1 -- 172.21.15.96:0/1602768526 wait complete. 2022-02-02T20:57:54.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 Processor -- start 2022-02-02T20:57:54.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 -- start start 2022-02-02T20:57:54.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 0x7f7da0109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da010c840 con 0x7f7da0060390 2022-02-02T20:57:54.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7da62f8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da010c980 con 0x7f7da00f55d0 2022-02-02T20:57:54.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.543+0000 7f7d9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40096/0 (socket says 172.21.15.96:40096) 2022-02-02T20:57:54.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 -- 172.21.15.96:0/1313381882 learned_addr learned my addr 172.21.15.96:0/1313381882 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:57:54.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9ffff700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 0x7f7da0109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 -- 172.21.15.96:0/1313381882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 msgr2=0x7f7da0109e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 0x7f7da0109e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 -- 172.21.15.96:0/1313381882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94005040 con 0x7f7da0060390 2022-02-02T20:57:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9f7fe700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 rx=0x7f7d94000c00 tx=0x7f7d94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:54.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d94019070 con 0x7f7da0060390 2022-02-02T20:57:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da010cc00 con 0x7f7da0060390 2022-02-02T20:57:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d940097a0 con 0x7f7da0060390 2022-02-02T20:57:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d94014490 con 0x7f7da0060390 2022-02-02T20:57:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.544+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da010d100 con 0x7f7da0060390 2022-02-02T20:57:54.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.545+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0045ad0 con 0x7f7da0060390 2022-02-02T20:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.546+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d94013c60 con 0x7f7da0060390 2022-02-02T20:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.546+0000 7f7d9cff9700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 0x7f7d88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.546+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7d94082ba0 con 0x7f7da0060390 2022-02-02T20:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.546+0000 7f7d9ffff700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 0x7f7d88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:57:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.547+0000 7f7d9ffff700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 0x7f7d88067290 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f7da0060120 tx=0x7f7d90009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:57:54.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.550+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d94050ca0 con 0x7f7da0060390 2022-02-02T20:57:54.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.752+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7da00586e0 con 0x7f7da0060390 2022-02-02T20:57:54.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.752+0000 7f7d9cff9700 1 -- 172.21.15.96:0/1313381882 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7d940542c0 con 0x7f7da0060390 2022-02-02T20:57:54.755 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:57:54.755 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:57:54.756 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:57:54.756 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:57:54.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:54.756 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:57:54.757 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:57:54.757 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:57:54.757 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:57:54.757 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:57:54.758 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:57:54.758 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:57:54.758 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:57:54.758 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:57:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:57:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:57:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:57:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:57:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:57:54.760 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:57:54.760 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:57:54.760 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:57:54.760 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:57:54.761 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:57:54.761 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:57:54.761 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:57:54.761 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:57:54.762 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:57:54.762 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:57:54.762 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:57:54.762 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:57:54.762 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:57:54.763 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:54.763 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:54.763 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:57:54.763 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:57:54.764 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:54.764 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:54.764 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:57:54.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 msgr2=0x7f7d88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 0x7f7d88067290 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f7da0060120 tx=0x7f7d90009040).stop 2022-02-02T20:57:54.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 msgr2=0x7f7da010c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:57:54.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 rx=0x7f7d94000c00 tx=0x7f7d94009b30).stop 2022-02-02T20:57:54.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 shutdown_connections 2022-02-02T20:57:54.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d88064dd0 0x7f7d88067290 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7da00f55d0 0x7f7da0109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 --2- 172.21.15.96:0/1313381882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da0060390 0x7f7da010c300 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:57:54.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.755+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 >> 172.21.15.96:0/1313381882 conn(0x7f7da00f0d70 msgr2=0x7f7da00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:57:54.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.756+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 shutdown_connections 2022-02-02T20:57:54.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:57:54.756+0000 7f7da62f8700 1 -- 172.21.15.96:0/1313381882 wait complete. 2022-02-02T20:57:54.768 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:57:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:54 smithi096 ceph-mon[101353]: pgmap v4674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:54 smithi096 ceph-mon[101353]: from='client.38898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:54.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2473462648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:57:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:54 smithi159 ceph-mon[69013]: pgmap v4674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:54 smithi159 ceph-mon[69013]: from='client.38898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2473462648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:57:56.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:55 smithi159 ceph-mon[69013]: from='client.38902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:56.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1313381882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:57:56.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:55 smithi096 ceph-mon[101353]: from='client.38902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:57:56.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1313381882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:57:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:56 smithi159 ceph-mon[69013]: pgmap v4675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:56 smithi096 ceph-mon[101353]: pgmap v4675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:57:58 smithi159 ceph-mon[69013]: pgmap v4676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:57:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:57:58 smithi096 ceph-mon[101353]: pgmap v4676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:00 smithi159 ceph-mon[69013]: pgmap v4677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:00 smithi096 ceph-mon[101353]: pgmap v4677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:02 smithi159 ceph-mon[69013]: pgmap v4678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:02 smithi096 ceph-mon[101353]: pgmap v4678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:04 smithi159 ceph-mon[69013]: pgmap v4679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:04 smithi096 ceph-mon[101353]: pgmap v4679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:06 smithi159 ceph-mon[69013]: pgmap v4680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:06 smithi096 ceph-mon[101353]: pgmap v4680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:08 smithi159 ceph-mon[69013]: pgmap v4681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:08 smithi096 ceph-mon[101353]: pgmap v4681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:10 smithi159 ceph-mon[69013]: pgmap v4682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:10 smithi096 ceph-mon[101353]: pgmap v4682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:12 smithi159 ceph-mon[69013]: pgmap v4683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:12 smithi096 ceph-mon[101353]: pgmap v4683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:14 smithi159 ceph-mon[69013]: pgmap v4684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:14 smithi096 ceph-mon[101353]: pgmap v4684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:16 smithi159 ceph-mon[69013]: pgmap v4685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:16 smithi096 ceph-mon[101353]: pgmap v4685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:18 smithi159 ceph-mon[69013]: pgmap v4686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:18 smithi096 ceph-mon[101353]: pgmap v4686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:20 smithi159 ceph-mon[69013]: pgmap v4687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:20 smithi096 ceph-mon[101353]: pgmap v4687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:22 smithi159 ceph-mon[69013]: pgmap v4688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:22 smithi096 ceph-mon[101353]: pgmap v4688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 -- 172.21.15.96:0/1824565409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f6860 msgr2=0x7f39780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 --2- 172.21.15.96:0/1824565409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f6860 0x7f39780f6cc0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 rx=0x7f3968004660 tx=0x7f3968009b30).stop 2022-02-02T20:58:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 -- 172.21.15.96:0/1824565409 shutdown_connections 2022-02-02T20:58:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 --2- 172.21.15.96:0/1824565409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f6860 0x7f39780f6cc0 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 --2- 172.21.15.96:0/1824565409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f55c0 0x7f39780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 -- 172.21.15.96:0/1824565409 >> 172.21.15.96:0/1824565409 conn(0x7f39780f0d40 msgr2=0x7f39780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 -- 172.21.15.96:0/1824565409 shutdown_connections 2022-02-02T20:58:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 -- 172.21.15.96:0/1824565409 wait complete. 2022-02-02T20:58:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.867+0000 7f397cb3f700 1 Processor -- start 2022-02-02T20:58:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397cb3f700 1 -- start start 2022-02-02T20:58:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397cb3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397cb3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6860 0x7f397810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397cb3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780603e0 con 0x7f39780f55c0 2022-02-02T20:58:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397cb3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978060520 con 0x7f39780f6860 2022-02-02T20:58:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40112/0 (socket says 172.21.15.96:40112) 2022-02-02T20:58:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 -- 172.21.15.96:0/2576391218 learned_addr learned my addr 172.21.15.96:0/2576391218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:24.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f3975d9b700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6860 0x7f397810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:24.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 -- 172.21.15.96:0/2576391218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6860 msgr2=0x7f397810c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:24.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6860 0x7f397810c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:24.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 -- 172.21.15.96:0/2576391218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968005040 con 0x7f39780f55c0 2022-02-02T20:58:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.868+0000 7f397659c700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f396c00c530 tx=0x7f396c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.869+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c00f650 con 0x7f39780f55c0 2022-02-02T20:58:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.869+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397810c700 con 0x7f39780f55c0 2022-02-02T20:58:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.869+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f396c00fc60 con 0x7f39780f55c0 2022-02-02T20:58:24.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.869+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c012cb0 con 0x7f39780f55c0 2022-02-02T20:58:24.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.869+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397810ccc0 con 0x7f39780f55c0 2022-02-02T20:58:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.870+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3978045ad0 con 0x7f39780f55c0 2022-02-02T20:58:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.870+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f396c019030 con 0x7f39780f55c0 2022-02-02T20:58:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.870+0000 7f3966ffd700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.870+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f396c081660 con 0x7f39780f55c0 2022-02-02T20:58:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.871+0000 7f3975d9b700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.871+0000 7f3975d9b700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f3968004630 tx=0x7f3968009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:24.875+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f396c04f790 con 0x7f39780f55c0 2022-02-02T20:58:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:24 smithi159 ceph-mon[69013]: pgmap v4689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:25.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.052+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39780fdf30 con 0x7f3960064dd0 2022-02-02T20:58:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:24 smithi096 ceph-mon[101353]: pgmap v4689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:25.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.053+0000 7f3966ffd700 1 -- 172.21.15.96:0/2576391218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3968019040 con 0x7f3960064dd0 2022-02-02T20:58:25.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 msgr2=0x7f3960067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f3968004630 tx=0x7f3968009b30).stop 2022-02-02T20:58:25.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 msgr2=0x7f3978109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f396c00c530 tx=0x7f396c007e10).stop 2022-02-02T20:58:25.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 shutdown_connections 2022-02-02T20:58:25.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f55c0 0x7f3978109c50 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 --2- 172.21.15.96:0/2576391218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6860 0x7f397810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.055+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 >> 172.21.15.96:0/2576391218 conn(0x7f39780f0d40 msgr2=0x7f39780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.056+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 shutdown_connections 2022-02-02T20:58:25.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.056+0000 7f397cb3f700 1 -- 172.21.15.96:0/2576391218 wait complete. 2022-02-02T20:58:25.066 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:58:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 -- 172.21.15.96:0/3350574992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 msgr2=0x7f143c0f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 --2- 172.21.15.96:0/3350574992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c0f6e70 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 rx=0x7f142c004660 tx=0x7f142c009b30).stop 2022-02-02T20:58:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 -- 172.21.15.96:0/3350574992 shutdown_connections 2022-02-02T20:58:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 --2- 172.21.15.96:0/3350574992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 0x7f143c0f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 --2- 172.21.15.96:0/3350574992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c0f6e70 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 -- 172.21.15.96:0/3350574992 >> 172.21.15.96:0/3350574992 conn(0x7f143c0f0320 msgr2=0x7f143c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.153+0000 7f143bfff700 1 -- 172.21.15.96:0/3350574992 shutdown_connections 2022-02-02T20:58:25.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.154+0000 7f143bfff700 1 -- 172.21.15.96:0/3350574992 wait complete. 2022-02-02T20:58:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.154+0000 7f143bfff700 1 Processor -- start 2022-02-02T20:58:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.154+0000 7f143bfff700 1 -- start start 2022-02-02T20:58:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 0x7f143c10e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0f5370 con 0x7f143c0f6a50 2022-02-02T20:58:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0f54b0 con 0x7f143c0f73f0 2022-02-02T20:58:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40120/0 (socket says 172.21.15.96:40120) 2022-02-02T20:58:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 -- 172.21.15.96:0/2746837153 learned_addr learned my addr 172.21.15.96:0/2746837153 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143a7fc700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 0x7f143c10e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 -- 172.21.15.96:0/2746837153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 msgr2=0x7f143c10e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 0x7f143c10e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 -- 172.21.15.96:0/2746837153 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c005040 con 0x7f143c0f6a50 2022-02-02T20:58:25.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143affd700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 rx=0x7f142c013a70 tx=0x7f142c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142c018070 con 0x7f143c0f6a50 2022-02-02T20:58:25.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f142c0097d0 con 0x7f143c0f6a50 2022-02-02T20:58:25.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c10e870 con 0x7f143c0f6a50 2022-02-02T20:58:25.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142c01de80 con 0x7f143c0f6a50 2022-02-02T20:58:25.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.155+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c10ec40 con 0x7f143c0f6a50 2022-02-02T20:58:25.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.157+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f142c007ba0 con 0x7f143c0f6a50 2022-02-02T20:58:25.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.157+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c045ad0 con 0x7f143c0f6a50 2022-02-02T20:58:25.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.157+0000 7f14237fe700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.157+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f142c083700 con 0x7f143c0f6a50 2022-02-02T20:58:25.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.157+0000 7f143a7fc700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.158+0000 7f143a7fc700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f1430004c40 tx=0x7f143000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.162+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f142c051800 con 0x7f143c0f6a50 2022-02-02T20:58:25.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.335+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f143c057f10 con 0x7f1424064e20 2022-02-02T20:58:25.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.345+0000 7f14237fe700 1 -- 172.21.15.96:0/2746837153 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f143c057f10 con 0x7f1424064e20 2022-02-02T20:58:25.346 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:58:25.347 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:58:25.347 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:58:25.347 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:58:25.347 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:58:25.347 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:58:25.348 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:58:25.348 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:58:25.348 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:58:25.348 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:58:25.349 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:58:25.349 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:58:25.349 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:58:25.349 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:58:25.349 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:58:25.350 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:58:25.350 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:58:25.350 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:58:25.350 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:58:25.351 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:58:25.351 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:58:25.351 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:58:25.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.346+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 msgr2=0x7f14240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f1430004c40 tx=0x7f143000b040).stop 2022-02-02T20:58:25.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 msgr2=0x7f143c10be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 rx=0x7f142c013a70 tx=0x7f142c009b30).stop 2022-02-02T20:58:25.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 shutdown_connections 2022-02-02T20:58:25.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f6a50 0x7f143c10be80 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 --2- 172.21.15.96:0/2746837153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f73f0 0x7f143c10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 >> 172.21.15.96:0/2746837153 conn(0x7f143c0f0320 msgr2=0x7f143c0fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 shutdown_connections 2022-02-02T20:58:25.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.347+0000 7f143bfff700 1 -- 172.21.15.96:0/2746837153 wait complete. 2022-02-02T20:58:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 -- 172.21.15.96:0/830597217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 msgr2=0x7fb07c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 --2- 172.21.15.96:0/830597217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c0f7c30 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 rx=0x7fb06c004660 tx=0x7fb06c009b30).stop 2022-02-02T20:58:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 -- 172.21.15.96:0/830597217 shutdown_connections 2022-02-02T20:58:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 --2- 172.21.15.96:0/830597217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c0f7c30 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 --2- 172.21.15.96:0/830597217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 0x7fb07c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 -- 172.21.15.96:0/830597217 >> 172.21.15.96:0/830597217 conn(0x7fb07c0f1c90 msgr2=0x7fb07c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 -- 172.21.15.96:0/830597217 shutdown_connections 2022-02-02T20:58:25.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.443+0000 7fb083245700 1 -- 172.21.15.96:0/830597217 wait complete. 2022-02-02T20:58:25.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 Processor -- start 2022-02-02T20:58:25.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 -- start start 2022-02-02T20:58:25.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 0x7fb07c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c107880 con 0x7fb07c0f77d0 2022-02-02T20:58:25.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb083245700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c108090 con 0x7fb07c0f6530 2022-02-02T20:58:25.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb081a42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb081a42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40132/0 (socket says 172.21.15.96:40132) 2022-02-02T20:58:25.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb081a42700 1 -- 172.21.15.96:0/806710112 learned_addr learned my addr 172.21.15.96:0/806710112 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:25.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.444+0000 7fb082243700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 0x7fb07c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb081a42700 1 -- 172.21.15.96:0/806710112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 msgr2=0x7fb07c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb081a42700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 0x7fb07c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb081a42700 1 -- 172.21.15.96:0/806710112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c005040 con 0x7fb07c0f77d0 2022-02-02T20:58:25.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb081a42700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 rx=0x7fb06c009830 tx=0x7fb06c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c018070 con 0x7fb07c0f77d0 2022-02-02T20:58:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb06c007ba0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1082b0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c108810 con 0x7fb07c0f77d0 2022-02-02T20:58:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.445+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c01c3c0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.446+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb064004fa0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.446+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb06c01d420 con 0x7fb07c0f77d0 2022-02-02T20:58:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.447+0000 7fb072ffd700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 0x7fb0680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.447+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb06c0834e0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.447+0000 7fb082243700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 0x7fb0680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.447+0000 7fb082243700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 0x7fb0680672e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7fb07c106b00 tx=0x7fb07800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.451+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb06c0516a0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.681+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb064005e80 con 0x7fb07c0f77d0 2022-02-02T20:58:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.682+0000 7fb072ffd700 1 -- 172.21.15.96:0/806710112 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb06c054cc0 con 0x7fb07c0f77d0 2022-02-02T20:58:25.683 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:58:25.684 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:58:25.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:58:25.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:25.685 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:58:25.685 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:58:25.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:25.686 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:58:25.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:58:25.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:25.687 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:58:25.687 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:58:25.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:25.687 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:58:25.687 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:58:25.688 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:58:25.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:58:25.688 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:58:25.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.683+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 msgr2=0x7fb0680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.683+0000 7fb083245700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 0x7fb0680672e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7fb07c106b00 tx=0x7fb07800b040).stop 2022-02-02T20:58:25.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.683+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 msgr2=0x7fb07c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.683+0000 7fb083245700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 rx=0x7fb06c009830 tx=0x7fb06c009b30).stop 2022-02-02T20:58:25.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.683+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 shutdown_connections 2022-02-02T20:58:25.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb068064e20 0x7fb0680672e0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0f6530 0x7fb07c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 --2- 172.21.15.96:0/806710112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb07c0f77d0 0x7fb07c107280 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 >> 172.21.15.96:0/806710112 conn(0x7fb07c0f1c90 msgr2=0x7fb07c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 shutdown_connections 2022-02-02T20:58:25.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.684+0000 7fb083245700 1 -- 172.21.15.96:0/806710112 wait complete. 2022-02-02T20:58:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 -- 172.21.15.96:0/2372508630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 msgr2=0x7fc3b40f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 --2- 172.21.15.96:0/2372508630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b40f6960 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 rx=0x7fc3a4004660 tx=0x7fc3a4009b30).stop 2022-02-02T20:58:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 -- 172.21.15.96:0/2372508630 shutdown_connections 2022-02-02T20:58:25.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 --2- 172.21.15.96:0/2372508630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b40f6960 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 --2- 172.21.15.96:0/2372508630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b40f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:58:25.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 -- 172.21.15.96:0/2372508630 >> 172.21.15.96:0/2372508630 conn(0x7fc3b40f0540 msgr2=0x7fc3b40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:25.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 -- 172.21.15.96:0/2372508630 shutdown_connections 2022-02-02T20:58:25.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.783+0000 7fc3b9638700 1 -- 172.21.15.96:0/2372508630 wait complete. 2022-02-02T20:58:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 Processor -- start 2022-02-02T20:58:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 -- start start 2022-02-02T20:58:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b41091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4109cd0 con 0x7fc3b40f64e0 2022-02-02T20:58:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b9638700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b410a580 con 0x7fc3b40f5bd0 2022-02-02T20:58:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40142/0 (socket says 172.21.15.96:40142) 2022-02-02T20:58:25.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 -- 172.21.15.96:0/3328861180 learned_addr learned my addr 172.21.15.96:0/3328861180 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:25.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b2ffd700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b41091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 -- 172.21.15.96:0/3328861180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 msgr2=0x7fc3b41091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b41091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 -- 172.21.15.96:0/3328861180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4005040 con 0x7fc3b40f64e0 2022-02-02T20:58:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b2ffd700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b41091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:58:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.784+0000 7fc3b27fc700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7fc3a4009990 tx=0x7fc3a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.785+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3a4018070 con 0x7fc3b40f64e0 2022-02-02T20:58:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.785+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3a4007ca0 con 0x7fc3b40f64e0 2022-02-02T20:58:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.785+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3a401c620 con 0x7fc3b40f64e0 2022-02-02T20:58:25.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.785+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b410a800 con 0x7fc3b40f64e0 2022-02-02T20:58:25.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.785+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b410ad60 con 0x7fc3b40f64e0 2022-02-02T20:58:25.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.786+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc3a401d960 con 0x7fc3b40f64e0 2022-02-02T20:58:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.786+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b40f41d0 con 0x7fc3b40f64e0 2022-02-02T20:58:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.786+0000 7fc39b7fe700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 0x7fc39c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.786+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc3a40837c0 con 0x7fc3b40f64e0 2022-02-02T20:58:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.786+0000 7fc3b2ffd700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 0x7fc39c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.787+0000 7fc3b2ffd700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 0x7fc39c067290 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fc3a800b830 tx=0x7fc3a8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:25.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.791+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3a4055230 con 0x7fc3b40f64e0 2022-02-02T20:58:25.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.989+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3b410f7c0 con 0x7fc3b40f64e0 2022-02-02T20:58:25.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/806710112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:58:25.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.990+0000 7fc39b7fe700 1 -- 172.21.15.96:0/3328861180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc3a4054e20 con 0x7fc3b40f64e0 2022-02-02T20:58:25.992 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:58:25.992 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:58:25.993 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:58:25.993 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:58:25.993 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:25.993 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:58:25.993 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:58:25.994 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:58:25.994 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:58:25.994 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:58:25.994 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:58:25.995 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:58:25.995 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:58:25.995 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:58:25.995 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:58:25.996 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:58:25.996 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:58:25.996 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:58:25.996 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:58:25.997 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:58:25.997 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:58:25.997 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:58:25.997 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:58:25.997 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:58:25.998 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:58:25.998 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:58:25.998 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:58:25.998 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:58:25.999 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:58:25.999 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:58:25.999 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:58:25.999 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:58:25.999 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:26.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:26.000 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:58:26.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:26.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:26.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:26.001 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 msgr2=0x7fc39c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 0x7fc39c067290 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fc3a800b830 tx=0x7fc3a8008040).stop 2022-02-02T20:58:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 msgr2=0x7fc3b4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7fc3a4009990 tx=0x7fc3a4009b30).stop 2022-02-02T20:58:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 shutdown_connections 2022-02-02T20:58:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc39c064dd0 0x7fc39c067290 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3b40f5bd0 0x7fc3b41091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 --2- 172.21.15.96:0/3328861180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3b40f64e0 0x7fc3b4109690 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 >> 172.21.15.96:0/3328861180 conn(0x7fc3b40f0540 msgr2=0x7fc3b40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 shutdown_connections 2022-02-02T20:58:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:25.992+0000 7fc3b9638700 1 -- 172.21.15.96:0/3328861180 wait complete. 2022-02-02T20:58:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:58:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/806710112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:58:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:26 smithi159 ceph-mon[69013]: from='client.38914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:26 smithi159 ceph-mon[69013]: from='client.38918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:26 smithi159 ceph-mon[69013]: pgmap v4690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3328861180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:58:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:26 smithi096 ceph-mon[101353]: from='client.38914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:26 smithi096 ceph-mon[101353]: from='client.38918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:26 smithi096 ceph-mon[101353]: pgmap v4690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3328861180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:58:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:58:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:58:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:28 smithi159 ceph-mon[69013]: pgmap v4691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:58:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:58:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:28 smithi096 ceph-mon[101353]: pgmap v4691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:30 smithi159 ceph-mon[69013]: pgmap v4692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:30 smithi096 ceph-mon[101353]: pgmap v4692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:32 smithi159 ceph-mon[69013]: pgmap v4693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:32 smithi096 ceph-mon[101353]: pgmap v4693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:34 smithi159 ceph-mon[69013]: pgmap v4694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:34 smithi096 ceph-mon[101353]: pgmap v4694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:36 smithi159 ceph-mon[69013]: pgmap v4695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:36 smithi096 ceph-mon[101353]: pgmap v4695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:38 smithi159 ceph-mon[69013]: pgmap v4696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:38 smithi096 ceph-mon[101353]: pgmap v4696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:40 smithi159 ceph-mon[69013]: pgmap v4697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:40 smithi096 ceph-mon[101353]: pgmap v4697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:42 smithi159 ceph-mon[69013]: pgmap v4698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:42 smithi096 ceph-mon[101353]: pgmap v4698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:44 smithi159 ceph-mon[69013]: pgmap v4699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:44 smithi096 ceph-mon[101353]: pgmap v4699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:46 smithi159 ceph-mon[69013]: pgmap v4700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:47.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:46 smithi096 ceph-mon[101353]: pgmap v4700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:48 smithi159 ceph-mon[69013]: pgmap v4701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:48 smithi096 ceph-mon[101353]: pgmap v4701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:50 smithi159 ceph-mon[69013]: pgmap v4702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:50 smithi096 ceph-mon[101353]: pgmap v4702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:52 smithi159 ceph-mon[69013]: pgmap v4703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:52 smithi096 ceph-mon[101353]: pgmap v4703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:54 smithi159 ceph-mon[69013]: pgmap v4704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:54 smithi096 ceph-mon[101353]: pgmap v4704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:56.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 -- 172.21.15.96:0/156800715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 msgr2=0x7fa8a80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 --2- 172.21.15.96:0/156800715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a80f6cc0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 rx=0x7fa898004660 tx=0x7fa898009b30).stop 2022-02-02T20:58:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 -- 172.21.15.96:0/156800715 shutdown_connections 2022-02-02T20:58:56.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 --2- 172.21.15.96:0/156800715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a80f6cc0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 --2- 172.21.15.96:0/156800715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 0x7fa8a80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 -- 172.21.15.96:0/156800715 >> 172.21.15.96:0/156800715 conn(0x7fa8a80f0d40 msgr2=0x7fa8a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 -- 172.21.15.96:0/156800715 shutdown_connections 2022-02-02T20:58:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.103+0000 7fa8ae777700 1 -- 172.21.15.96:0/156800715 wait complete. 2022-02-02T20:58:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.104+0000 7fa8ae777700 1 Processor -- start 2022-02-02T20:58:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.104+0000 7fa8ae777700 1 -- start start 2022-02-02T20:58:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8ae777700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 0x7fa8a8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8ae777700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8ae777700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81069b0 con 0x7fa8a80f6860 2022-02-02T20:58:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8ae777700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81071c0 con 0x7fa8a80f55c0 2022-02-02T20:58:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40160/0 (socket says 172.21.15.96:40160) 2022-02-02T20:58:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 -- 172.21.15.96:0/4246731987 learned_addr learned my addr 172.21.15.96:0/4246731987 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a7fff700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 0x7fa8a8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 -- 172.21.15.96:0/4246731987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 msgr2=0x7fa8a8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 0x7fa8a8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 -- 172.21.15.96:0/4246731987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898005040 con 0x7fa8a80f6860 2022-02-02T20:58:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a77fe700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 rx=0x7fa898009990 tx=0x7fa898009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa898018070 con 0x7fa8a80f6860 2022-02-02T20:58:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa898007ba0 con 0x7fa8a80f6860 2022-02-02T20:58:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a81073e0 con 0x7fa8a80f6860 2022-02-02T20:58:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.105+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89801c3c0 con 0x7fa8a80f6860 2022-02-02T20:58:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.106+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a8107940 con 0x7fa8a80f6860 2022-02-02T20:58:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.106+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a80f49b0 con 0x7fa8a80f6860 2022-02-02T20:58:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.107+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa89801d420 con 0x7fa8a80f6860 2022-02-02T20:58:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.107+0000 7fa8a4ff9700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 0x7fa890067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.107+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8980836a0 con 0x7fa8a80f6860 2022-02-02T20:58:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.107+0000 7fa8a7fff700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 0x7fa890067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.108+0000 7fa8a7fff700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 0x7fa890067290 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fa8a8105c30 tx=0x7fa89c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.112+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa898051860 con 0x7fa8a80f6860 2022-02-02T20:58:56.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.292+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8a80fdf10 con 0x7fa890064dd0 2022-02-02T20:58:56.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.293+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/4246731987 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa8a80fdf10 con 0x7fa890064dd0 2022-02-02T20:58:56.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 msgr2=0x7fa890067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 0x7fa890067290 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fa8a8105c30 tx=0x7fa89c00b040).stop 2022-02-02T20:58:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 msgr2=0x7fa8a81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 rx=0x7fa898009990 tx=0x7fa898009b30).stop 2022-02-02T20:58:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 shutdown_connections 2022-02-02T20:58:56.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa890064dd0 0x7fa890067290 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80f55c0 0x7fa8a8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 --2- 172.21.15.96:0/4246731987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f6860 0x7fa8a81063b0 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 >> 172.21.15.96:0/4246731987 conn(0x7fa8a80f0d40 msgr2=0x7fa8a80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 shutdown_connections 2022-02-02T20:58:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.295+0000 7fa8ae777700 1 -- 172.21.15.96:0/4246731987 wait complete. 2022-02-02T20:58:56.306 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:58:56.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 -- 172.21.15.96:0/1489032279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f5430 msgr2=0x7fc70c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 --2- 172.21.15.96:0/1489032279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f5430 0x7fc70c0f5850 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 rx=0x7fc6fc004660 tx=0x7fc6fc009b30).stop 2022-02-02T20:58:56.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 -- 172.21.15.96:0/1489032279 shutdown_connections 2022-02-02T20:58:56.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 --2- 172.21.15.96:0/1489032279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f66d0 0x7fc70c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 --2- 172.21.15.96:0/1489032279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f5430 0x7fc70c0f5850 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 -- 172.21.15.96:0/1489032279 >> 172.21.15.96:0/1489032279 conn(0x7fc70c0f0b90 msgr2=0x7fc70c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.394+0000 7fc710b7f700 1 -- 172.21.15.96:0/1489032279 shutdown_connections 2022-02-02T20:58:56.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.395+0000 7fc710b7f700 1 -- 172.21.15.96:0/1489032279 wait complete. 2022-02-02T20:58:56.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.395+0000 7fc710b7f700 1 Processor -- start 2022-02-02T20:58:56.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc710b7f700 1 -- start start 2022-02-02T20:58:56.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc710b7f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f5430 0x7fc70c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc710b7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc710b7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c107880 con 0x7fc70c0f66d0 2022-02-02T20:58:56.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc710b7f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c1080c0 con 0x7fc70c0f5430 2022-02-02T20:58:56.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40170/0 (socket says 172.21.15.96:40170) 2022-02-02T20:58:56.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 -- 172.21.15.96:0/3577243146 learned_addr learned my addr 172.21.15.96:0/3577243146 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:56.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70b7fe700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f5430 0x7fc70c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 -- 172.21.15.96:0/3577243146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f5430 msgr2=0x7fc70c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f5430 0x7fc70c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.396+0000 7fc70affd700 1 -- 172.21.15.96:0/3577243146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc005040 con 0x7fc70c0f66d0 2022-02-02T20:58:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc70affd700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7fc700002700 tx=0x7fc700009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc700009320 con 0x7fc70c0f66d0 2022-02-02T20:58:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc70000f040 con 0x7fc70c0f66d0 2022-02-02T20:58:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c1083a0 con 0x7fc70c0f66d0 2022-02-02T20:58:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc700014820 con 0x7fc70c0f66d0 2022-02-02T20:58:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.397+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c1088e0 con 0x7fc70c0f66d0 2022-02-02T20:58:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.398+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c059100 con 0x7fc70c0f66d0 2022-02-02T20:58:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.399+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc700009480 con 0x7fc70c0f66d0 2022-02-02T20:58:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.399+0000 7fc6f3fff700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 0x7fc6f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.399+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc700081d10 con 0x7fc70c0f66d0 2022-02-02T20:58:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.399+0000 7fc70b7fe700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 0x7fc6f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.399+0000 7fc70b7fe700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 0x7fc6f40672e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fc6fc004e30 tx=0x7fc6fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.403+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc70004fe10 con 0x7fc70c0f66d0 2022-02-02T20:58:56.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.575+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc70c05fd30 con 0x7fc6f4064e20 2022-02-02T20:58:56.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.584+0000 7fc6f3fff700 1 -- 172.21.15.96:0/3577243146 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc70c05fd30 con 0x7fc6f4064e20 2022-02-02T20:58:56.586 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:58:56.586 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:58:56.586 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:58:56.587 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:58:56.587 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:58:56.587 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:58:56.587 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:58:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:58:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:58:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:58:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:58:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:58:56.589 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:58:56.589 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:58:56.589 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:58:56.589 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:58:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:58:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:58:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:58:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:58:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:58:56.591 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:58:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 msgr2=0x7fc6f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 0x7fc6f40672e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fc6fc004e30 tx=0x7fc6fc009b30).stop 2022-02-02T20:58:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 msgr2=0x7fc70c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7fc700002700 tx=0x7fc700009e00).stop 2022-02-02T20:58:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 shutdown_connections 2022-02-02T20:58:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc6f4064e20 0x7fc6f40672e0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc70c0f5430 0x7fc70c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 --2- 172.21.15.96:0/3577243146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc70c0f66d0 0x7fc70c107280 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 >> 172.21.15.96:0/3577243146 conn(0x7fc70c0f0b90 msgr2=0x7fc70c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 shutdown_connections 2022-02-02T20:58:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.586+0000 7fc710b7f700 1 -- 172.21.15.96:0/3577243146 wait complete. 2022-02-02T20:58:56.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 -- 172.21.15.96:0/987369121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 msgr2=0x7fc4940f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/987369121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc4940f6b00 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 rx=0x7fc484004660 tx=0x7fc484009b30).stop 2022-02-02T20:58:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 -- 172.21.15.96:0/987369121 shutdown_connections 2022-02-02T20:58:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/987369121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc4940f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/987369121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc4940f6b00 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 -- 172.21.15.96:0/987369121 >> 172.21.15.96:0/987369121 conn(0x7fc4940f1e40 msgr2=0x7fc4940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 -- 172.21.15.96:0/987369121 shutdown_connections 2022-02-02T20:58:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.686+0000 7fc49a4e1700 1 -- 172.21.15.96:0/987369121 wait complete. 2022-02-02T20:58:56.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 Processor -- start 2022-02-02T20:58:56.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 -- start start 2022-02-02T20:58:56.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc49406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc494069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49406a380 con 0x7fc4940f66e0 2022-02-02T20:58:56.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc49a4e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49406a4c0 con 0x7fc4940f7980 2022-02-02T20:58:56.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc49406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc49406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40178/0 (socket says 172.21.15.96:40178) 2022-02-02T20:58:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc493fff700 1 -- 172.21.15.96:0/472784081 learned_addr learned my addr 172.21.15.96:0/472784081 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.687+0000 7fc4937fe700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc494069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc4937fe700 1 -- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 msgr2=0x7fc49406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc4937fe700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc49406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc4937fe700 1 -- 172.21.15.96:0/472784081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484005040 con 0x7fc4940f7980 2022-02-02T20:58:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc4937fe700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc494069e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc48800c470 tx=0x7fc488007d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48800f650 con 0x7fc4940f7980 2022-02-02T20:58:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49406a7a0 con 0x7fc4940f7980 2022-02-02T20:58:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49410efe0 con 0x7fc4940f7980 2022-02-02T20:58:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc48800fc60 con 0x7fc4940f7980 2022-02-02T20:58:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.688+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc488012bb0 con 0x7fc4940f7980 2022-02-02T20:58:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.689+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc474004fa0 con 0x7fc4940f7980 2022-02-02T20:58:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.690+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc488010070 con 0x7fc4940f7980 2022-02-02T20:58:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.691+0000 7fc490ff9700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 0x7fc47c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.691+0000 7fc493fff700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 0x7fc47c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.691+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc4880815e0 con 0x7fc4940f7980 2022-02-02T20:58:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.691+0000 7fc493fff700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 0x7fc47c067290 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fc484004e30 tx=0x7fc484009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.696+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc48804fa50 con 0x7fc4940f7980 2022-02-02T20:58:56.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.932+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc474005e80 con 0x7fc4940f7980 2022-02-02T20:58:56.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.933+0000 7fc490ff9700 1 -- 172.21.15.96:0/472784081 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc488052ca0 con 0x7fc4940f7980 2022-02-02T20:58:56.934 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:58:56.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:58:56.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:58:56.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:56.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:58:56.936 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:58:56.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:56.936 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:58:56.936 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:58:56.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:56.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:58:56.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:58:56.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:58:56.937 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:58:56.938 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:58:56.938 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:58:56.938 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:58:56.938 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:58:56.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 msgr2=0x7fc47c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 0x7fc47c067290 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fc484004e30 tx=0x7fc484009b30).stop 2022-02-02T20:58:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 msgr2=0x7fc494069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc494069e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc48800c470 tx=0x7fc488007d60).stop 2022-02-02T20:58:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 shutdown_connections 2022-02-02T20:58:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc47c064dd0 0x7fc47c067290 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4940f66e0 0x7fc49406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 --2- 172.21.15.96:0/472784081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4940f7980 0x7fc494069e20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.935+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 >> 172.21.15.96:0/472784081 conn(0x7fc4940f1e40 msgr2=0x7fc4940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.936+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 shutdown_connections 2022-02-02T20:58:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:56.936+0000 7fc49a4e1700 1 -- 172.21.15.96:0/472784081 wait complete. 2022-02-02T20:58:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:56 smithi159 ceph-mon[69013]: pgmap v4705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:57.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 -- 172.21.15.96:0/955085526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f77d0 msgr2=0x7f594c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:57.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 --2- 172.21.15.96:0/955085526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f77d0 0x7f594c0f7c30 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 rx=0x7f5938004660 tx=0x7f5938009b30).stop 2022-02-02T20:58:57.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 -- 172.21.15.96:0/955085526 shutdown_connections 2022-02-02T20:58:57.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 --2- 172.21.15.96:0/955085526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f77d0 0x7f594c0f7c30 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 --2- 172.21.15.96:0/955085526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f6530 0x7f594c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.032+0000 7f5951db0700 1 -- 172.21.15.96:0/955085526 >> 172.21.15.96:0/955085526 conn(0x7f594c0f1c90 msgr2=0x7f594c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:57.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:56 smithi096 ceph-mon[101353]: pgmap v4705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:57.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.033+0000 7f5951db0700 1 -- 172.21.15.96:0/955085526 shutdown_connections 2022-02-02T20:58:57.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.033+0000 7f5951db0700 1 -- 172.21.15.96:0/955085526 wait complete. 2022-02-02T20:58:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 Processor -- start 2022-02-02T20:58:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 -- start start 2022-02-02T20:58:57.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 0x7f594c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c107880 con 0x7f594c0f6530 2022-02-02T20:58:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5951db0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c108090 con 0x7f594c0f77d0 2022-02-02T20:58:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5950dae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:57.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5950dae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40186/0 (socket says 172.21.15.96:40186) 2022-02-02T20:58:57.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f5950dae700 1 -- 172.21.15.96:0/1758823842 learned_addr learned my addr 172.21.15.96:0/1758823842 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:58:57.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.034+0000 7f594bfff700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 0x7f594c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:57.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5950dae700 1 -- 172.21.15.96:0/1758823842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 msgr2=0x7f594c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:57.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5950dae700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 0x7f594c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5950dae700 1 -- 172.21.15.96:0/1758823842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938005040 con 0x7f594c0f6530 2022-02-02T20:58:57.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f594bfff700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 0x7f594c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:58:57.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5950dae700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 rx=0x7f5940002700 tx=0x7f5940009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:57.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5940009320 con 0x7f594c0f6530 2022-02-02T20:58:57.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c108310 con 0x7f594c0f6530 2022-02-02T20:58:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f594000f040 con 0x7f594c0f6530 2022-02-02T20:58:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5940014900 con 0x7f594c0f6530 2022-02-02T20:58:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.035+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c1088d0 con 0x7f594c0f6530 2022-02-02T20:58:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.036+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5940009480 con 0x7f594c0f6530 2022-02-02T20:58:57.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.036+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c059100 con 0x7f594c0f6530 2022-02-02T20:58:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.037+0000 7f59497fa700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 0x7f593c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:58:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.037+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5940081cc0 con 0x7f594c0f6530 2022-02-02T20:58:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.037+0000 7f594bfff700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 0x7f593c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:58:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.037+0000 7f594bfff700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 0x7f593c0672e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f5938009da0 tx=0x7f5938009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:58:57.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.041+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f594004fe80 con 0x7f594c0f6530 2022-02-02T20:58:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.242+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f594c0fee80 con 0x7f594c0f6530 2022-02-02T20:58:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.242+0000 7f59497fa700 1 -- 172.21.15.96:0/1758823842 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f594c0fee80 con 0x7f594c0f6530 2022-02-02T20:58:57.244 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:58:57.244 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:58:57.244 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:58:57.245 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:58:57.245 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:57.245 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:58:57.245 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:58:57.246 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:58:57.246 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:58:57.246 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:58:57.246 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:58:57.247 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:58:57.247 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:58:57.247 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:58:57.247 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:58:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:58:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:58:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:58:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:58:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:58:57.249 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:58:57.249 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:58:57.249 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:58:57.249 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:58:57.250 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:58:57.250 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:58:57.250 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:58:57.250 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:58:57.250 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:58:57.251 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:58:57.251 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:58:57.251 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:58:57.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:57.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:57.252 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:58:57.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:58:57.252 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:57.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:57.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:58:57.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 msgr2=0x7f593c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:57.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 0x7f593c0672e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f5938009da0 tx=0x7f5938009b30).stop 2022-02-02T20:58:57.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 msgr2=0x7f594c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:58:57.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 rx=0x7f5940002700 tx=0x7f5940009d80).stop 2022-02-02T20:58:57.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 shutdown_connections 2022-02-02T20:58:57.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f593c064e20 0x7f593c0672e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f594c0f6530 0x7f594c106d90 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 --2- 172.21.15.96:0/1758823842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f594c0f77d0 0x7f594c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:58:57.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 >> 172.21.15.96:0/1758823842 conn(0x7f594c0f1c90 msgr2=0x7f594c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:58:57.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 shutdown_connections 2022-02-02T20:58:57.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:58:57.244+0000 7f5951db0700 1 -- 172.21.15.96:0/1758823842 wait complete. 2022-02-02T20:58:57.257 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:58:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:57 smithi159 ceph-mon[69013]: from='client.38930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:58.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:57 smithi159 ceph-mon[69013]: from='client.38934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/472784081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:58:58.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1758823842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:58:58.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:57 smithi096 ceph-mon[101353]: from='client.38930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:57 smithi096 ceph-mon[101353]: from='client.38934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:58:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/472784081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:58:58.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1758823842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:58:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:58:58 smithi159 ceph-mon[69013]: pgmap v4706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:58:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:58:58 smithi096 ceph-mon[101353]: pgmap v4706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:00 smithi159 ceph-mon[69013]: pgmap v4707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:00 smithi096 ceph-mon[101353]: pgmap v4707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:02 smithi159 ceph-mon[69013]: pgmap v4708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:02 smithi096 ceph-mon[101353]: pgmap v4708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:04 smithi159 ceph-mon[69013]: pgmap v4709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:04 smithi096 ceph-mon[101353]: pgmap v4709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:06 smithi159 ceph-mon[69013]: pgmap v4710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:06 smithi096 ceph-mon[101353]: pgmap v4710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:08 smithi159 ceph-mon[69013]: pgmap v4711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:08 smithi096 ceph-mon[101353]: pgmap v4711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:10 smithi159 ceph-mon[69013]: pgmap v4712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:10 smithi096 ceph-mon[101353]: pgmap v4712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:12 smithi159 ceph-mon[69013]: pgmap v4713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:12 smithi096 ceph-mon[101353]: pgmap v4713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:14 smithi159 ceph-mon[69013]: pgmap v4714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:14 smithi096 ceph-mon[101353]: pgmap v4714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:16 smithi159 ceph-mon[69013]: pgmap v4715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:16 smithi096 ceph-mon[101353]: pgmap v4715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:18 smithi159 ceph-mon[69013]: pgmap v4716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:18 smithi096 ceph-mon[101353]: pgmap v4716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:20 smithi159 ceph-mon[69013]: pgmap v4717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:20 smithi096 ceph-mon[101353]: pgmap v4717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:22 smithi159 ceph-mon[69013]: pgmap v4718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:22 smithi096 ceph-mon[101353]: pgmap v4718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:24 smithi159 ceph-mon[69013]: pgmap v4719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:24 smithi096 ceph-mon[101353]: pgmap v4719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:26 smithi159 ceph-mon[69013]: pgmap v4720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:26 smithi096 ceph-mon[101353]: pgmap v4720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:27.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/993458103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 msgr2=0x7f1aac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/993458103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac0f59e0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 rx=0x7f1aa8004660 tx=0x7f1aa8009b30).stop 2022-02-02T20:59:27.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/993458103 shutdown_connections 2022-02-02T20:59:27.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/993458103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/993458103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac0f59e0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/993458103 >> 172.21.15.96:0/993458103 conn(0x7f1aac0f0d40 msgr2=0x7f1aac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:27.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/993458103 shutdown_connections 2022-02-02T20:59:27.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.352+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/993458103 wait complete. 2022-02-02T20:59:27.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 Processor -- start 2022-02-02T20:59:27.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 -- start start 2022-02-02T20:59:27.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac060420 con 0x7f1aac0f55c0 2022-02-02T20:59:27.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab3e1f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac060560 con 0x7f1aac0f6860 2022-02-02T20:59:27.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40204/0 (socket says 172.21.15.96:40204) 2022-02-02T20:59:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 -- 172.21.15.96:0/342748380 learned_addr learned my addr 172.21.15.96:0/342748380 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab13ba700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 -- 172.21.15.96:0/342748380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 msgr2=0x7f1aac10c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac10c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab1bbb700 1 -- 172.21.15.96:0/342748380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8005040 con 0x7f1aac0f55c0 2022-02-02T20:59:27.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.353+0000 7f1ab13ba700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T20:59:27.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1ab1bbb700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7f1aa8013a70 tx=0x7f1aa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa8018070 con 0x7f1aac0f55c0 2022-02-02T20:59:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1aa80097d0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa801c3c0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac10c6e0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.354+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac10cc10 con 0x7f1aac0f55c0 2022-02-02T20:59:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.355+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0f49b0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.355+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1aa8007ba0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.356+0000 7f1aa27fc700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 0x7f1a98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.356+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1aa80836d0 con 0x7f1aac0f55c0 2022-02-02T20:59:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.356+0000 7f1ab13ba700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 0x7f1a98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.356+0000 7f1ab13ba700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 0x7f1a98067290 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f1a9c009740 tx=0x7f1a9c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.360+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1aa8051890 con 0x7f1aac0f55c0 2022-02-02T20:59:27.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.536+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aac0fdf00 con 0x7f1a98064dd0 2022-02-02T20:59:27.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.537+0000 7f1aa27fc700 1 -- 172.21.15.96:0/342748380 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1aac0fdf00 con 0x7f1a98064dd0 2022-02-02T20:59:27.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 msgr2=0x7f1a98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 0x7f1a98067290 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f1a9c009740 tx=0x7f1a9c009be0).stop 2022-02-02T20:59:27.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 msgr2=0x7f1aac109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7f1aa8013a70 tx=0x7f1aa8009b30).stop 2022-02-02T20:59:27.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 shutdown_connections 2022-02-02T20:59:27.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a98064dd0 0x7f1a98067290 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1aac0f55c0 0x7f1aac109c30 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 --2- 172.21.15.96:0/342748380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1aac0f6860 0x7f1aac10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 >> 172.21.15.96:0/342748380 conn(0x7f1aac0f0d40 msgr2=0x7f1aac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:27.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.539+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 shutdown_connections 2022-02-02T20:59:27.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.540+0000 7f1ab3e1f700 1 -- 172.21.15.96:0/342748380 wait complete. 2022-02-02T20:59:27.551 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:59:27.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 -- 172.21.15.96:0/942174498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f5c30 msgr2=0x7f0ff00f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/942174498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f5c30 0x7f0ff00f6050 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 rx=0x7f0fe4004660 tx=0x7f0fe4009b30).stop 2022-02-02T20:59:27.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 -- 172.21.15.96:0/942174498 shutdown_connections 2022-02-02T20:59:27.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/942174498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f6540 0x7f0ff00f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/942174498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f5c30 0x7f0ff00f6050 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 -- 172.21.15.96:0/942174498 >> 172.21.15.96:0/942174498 conn(0x7f0ff00f0540 msgr2=0x7f0ff00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:27.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 -- 172.21.15.96:0/942174498 shutdown_connections 2022-02-02T20:59:27.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.637+0000 7f0ff5a25700 1 -- 172.21.15.96:0/942174498 wait complete. 2022-02-02T20:59:27.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 Processor -- start 2022-02-02T20:59:27.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 -- start start 2022-02-02T20:59:27.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f5c30 0x7f0ff0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00f5720 con 0x7f0ff00f6540 2022-02-02T20:59:27.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0ff5a25700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00f5860 con 0x7f0ff00f5c30 2022-02-02T20:59:27.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0fee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0fee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40216/0 (socket says 172.21.15.96:40216) 2022-02-02T20:59:27.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0fee7fc700 1 -- 172.21.15.96:0/3417938747 learned_addr learned my addr 172.21.15.96:0/3417938747 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:27.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.638+0000 7f0feeffd700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f5c30 0x7f0ff0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fee7fc700 1 -- 172.21.15.96:0/3417938747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f5c30 msgr2=0x7f0ff0109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fee7fc700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f5c30 0x7f0ff0109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fee7fc700 1 -- 172.21.15.96:0/3417938747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4005040 con 0x7f0ff00f6540 2022-02-02T20:59:27.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fee7fc700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 rx=0x7f0fe000c530 tx=0x7f0fe0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe000f650 con 0x7f0ff00f6540 2022-02-02T20:59:27.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff010c720 con 0x7f0ff00f6540 2022-02-02T20:59:27.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0fe000fc60 con 0x7f0ff00f6540 2022-02-02T20:59:27.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe0012c20 con 0x7f0ff00f6540 2022-02-02T20:59:27.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.639+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff010cce0 con 0x7f0ff00f6540 2022-02-02T20:59:27.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.640+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff0045ad0 con 0x7f0ff00f6540 2022-02-02T20:59:27.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.640+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0fe0010070 con 0x7f0ff00f6540 2022-02-02T20:59:27.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.641+0000 7f0fd77fe700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 0x7f0fd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.641+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0fe00816b0 con 0x7f0ff00f6540 2022-02-02T20:59:27.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.641+0000 7f0feeffd700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 0x7f0fd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.641+0000 7f0feeffd700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 0x7f0fd8067290 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f0fe4004630 tx=0x7f0fe4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.645+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0fe004f7b0 con 0x7f0ff00f6540 2022-02-02T20:59:27.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.816+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ff0057f10 con 0x7f0fd8064dd0 2022-02-02T20:59:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.826+0000 7f0fd77fe700 1 -- 172.21.15.96:0/3417938747 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0ff0057f10 con 0x7f0fd8064dd0 2022-02-02T20:59:27.827 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:59:27.827 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:59:27.828 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:59:27.828 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:59:27.828 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:59:27.828 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:59:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:59:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:59:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:59:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:59:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:59:27.830 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:59:27.830 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:59:27.830 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:59:27.830 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:59:27.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:59:27.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:59:27.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:59:27.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:59:27.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:59:27.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:59:27.832 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:59:27.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 msgr2=0x7f0fd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 0x7f0fd8067290 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f0fe4004630 tx=0x7f0fe4009b30).stop 2022-02-02T20:59:27.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 msgr2=0x7f0ff010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 rx=0x7f0fe000c530 tx=0x7f0fe0007e20).stop 2022-02-02T20:59:27.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 shutdown_connections 2022-02-02T20:59:27.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0fd8064dd0 0x7f0fd8067290 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ff00f5c30 0x7f0ff0109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.827+0000 7f0ff5a25700 1 --2- 172.21.15.96:0/3417938747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ff00f6540 0x7f0ff010c170 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.828+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 >> 172.21.15.96:0/3417938747 conn(0x7f0ff00f0540 msgr2=0x7f0ff00fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:27.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.828+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 shutdown_connections 2022-02-02T20:59:27.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.828+0000 7f0ff5a25700 1 -- 172.21.15.96:0/3417938747 wait complete. 2022-02-02T20:59:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 -- 172.21.15.96:0/383577294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f7980 msgr2=0x7fb0a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/383577294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f7980 0x7fb0a80f7de0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 rx=0x7fb090004660 tx=0x7fb090009b30).stop 2022-02-02T20:59:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 -- 172.21.15.96:0/383577294 shutdown_connections 2022-02-02T20:59:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/383577294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f7980 0x7fb0a80f7de0 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/383577294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f66e0 0x7fb0a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T20:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 -- 172.21.15.96:0/383577294 >> 172.21.15.96:0/383577294 conn(0x7fb0a80f1e40 msgr2=0x7fb0a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 -- 172.21.15.96:0/383577294 shutdown_connections 2022-02-02T20:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.924+0000 7fb0aeba3700 1 -- 172.21.15.96:0/383577294 wait complete. 2022-02-02T20:59:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 Processor -- start 2022-02-02T20:59:27.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 -- start start 2022-02-02T20:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 0x7fb0a81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8107ae0 con 0x7fb0a80f66e0 2022-02-02T20:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0aeba3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8108390 con 0x7fb0a80f7980 2022-02-02T20:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0ac93f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0ac93f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40224/0 (socket says 172.21.15.96:40224) 2022-02-02T20:59:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0ac93f700 1 -- 172.21.15.96:0/517746456 learned_addr learned my addr 172.21.15.96:0/517746456 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0ac93f700 1 -- 172.21.15.96:0/517746456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 msgr2=0x7fb0a81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.925+0000 7fb0a7fff700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 0x7fb0a81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0ac93f700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 0x7fb0a81074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0ac93f700 1 -- 172.21.15.96:0/517746456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090005040 con 0x7fb0a80f66e0 2022-02-02T20:59:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0a7fff700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 0x7fb0a81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T20:59:27.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0ac93f700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 rx=0x7fb0a000b790 tx=0x7fb0a00092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a000d700 con 0x7fb0a80f66e0 2022-02-02T20:59:27.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0a000dd10 con 0x7fb0a80f66e0 2022-02-02T20:59:27.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a8108670 con 0x7fb0a80f66e0 2022-02-02T20:59:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a0010e60 con 0x7fb0a80f66e0 2022-02-02T20:59:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.926+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a8108c30 con 0x7fb0a80f66e0 2022-02-02T20:59:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.927+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80f5ad0 con 0x7fb0a80f66e0 2022-02-02T20:59:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.927+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb0a000f460 con 0x7fb0a80f66e0 2022-02-02T20:59:27.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.928+0000 7fb0a57fa700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 0x7fb094067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:27.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.928+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb0a0081d40 con 0x7fb0a80f66e0 2022-02-02T20:59:27.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.928+0000 7fb0a7fff700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 0x7fb094067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:27.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.928+0000 7fb0a7fff700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 0x7fb094067270 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb090004630 tx=0x7fb090009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:27.932+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb0a0053950 con 0x7fb0a80f66e0 2022-02-02T20:59:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.163+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0a80fef40 con 0x7fb0a80f66e0 2022-02-02T20:59:28.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.164+0000 7fb0a57fa700 1 -- 172.21.15.96:0/517746456 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb0a0016070 con 0x7fb0a80f66e0 2022-02-02T20:59:28.165 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:59:28.166 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:59:28.166 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:59:28.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:28.167 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:59:28.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:59:28.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:28.167 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:59:28.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:59:28.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:28.168 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:59:28.168 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:59:28.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:59:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:59:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:59:28.169 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:59:28.169 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:59:28.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.165+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 msgr2=0x7fb094067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.165+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 0x7fb094067270 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb090004630 tx=0x7fb090009b30).stop 2022-02-02T20:59:28.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.165+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 msgr2=0x7fb0a8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.165+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 rx=0x7fb0a000b790 tx=0x7fb0a00092b0).stop 2022-02-02T20:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 shutdown_connections 2022-02-02T20:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb094064db0 0x7fb094067270 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0a80f66e0 0x7fb0a8106fb0 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 --2- 172.21.15.96:0/517746456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a80f7980 0x7fb0a81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 >> 172.21.15.96:0/517746456 conn(0x7fb0a80f1e40 msgr2=0x7fb0a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:28.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 shutdown_connections 2022-02-02T20:59:28.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.166+0000 7fb0aeba3700 1 -- 172.21.15.96:0/517746456 wait complete. 2022-02-02T20:59:28.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 -- 172.21.15.96:0/1591480233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 msgr2=0x7f41400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 --2- 172.21.15.96:0/1591480233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f41400f7de0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 rx=0x7f4130004660 tx=0x7f4130009b30).stop 2022-02-02T20:59:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 -- 172.21.15.96:0/1591480233 shutdown_connections 2022-02-02T20:59:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 --2- 172.21.15.96:0/1591480233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f41400f7de0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 --2- 172.21.15.96:0/1591480233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 0x7f41400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 -- 172.21.15.96:0/1591480233 >> 172.21.15.96:0/1591480233 conn(0x7f41400f1e40 msgr2=0x7f41400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 -- 172.21.15.96:0/1591480233 shutdown_connections 2022-02-02T20:59:28.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:28 smithi096 ceph-mon[101353]: from='client.38946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:28.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:59:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:59:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:28 smithi096 ceph-mon[101353]: pgmap v4721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:28 smithi096 ceph-mon[101353]: from='client.38950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:28.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.263+0000 7f4145bb8700 1 -- 172.21.15.96:0/1591480233 wait complete. 2022-02-02T20:59:28.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.264+0000 7f4145bb8700 1 Processor -- start 2022-02-02T20:59:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.264+0000 7f4145bb8700 1 -- start start 2022-02-02T20:59:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.264+0000 7f4145bb8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 0x7f4140106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4145bb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4145bb8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41401079b0 con 0x7f41400f7980 2022-02-02T20:59:28.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4145bb8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4140107af0 con 0x7f41400f66e0 2022-02-02T20:59:28.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:28.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40236/0 (socket says 172.21.15.96:40236) 2022-02-02T20:59:28.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 -- 172.21.15.96:0/3627872170 learned_addr learned my addr 172.21.15.96:0/3627872170 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:28.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413f7fe700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 0x7f4140106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:28.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 -- 172.21.15.96:0/3627872170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 msgr2=0x7f4140106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 0x7f4140106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 -- 172.21.15.96:0/3627872170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130005040 con 0x7f41400f7980 2022-02-02T20:59:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f413effd700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f4130009990 tx=0x7f4130009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4130018070 con 0x7f41400f7980 2022-02-02T20:59:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140108430 con 0x7f41400f7980 2022-02-02T20:59:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140108990 con 0x7f41400f7980 2022-02-02T20:59:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4130007ba0 con 0x7f41400f7980 2022-02-02T20:59:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.265+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413001c3c0 con 0x7f41400f7980 2022-02-02T20:59:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.266+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140045ad0 con 0x7f41400f7980 2022-02-02T20:59:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.267+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f413001c630 con 0x7f41400f7980 2022-02-02T20:59:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.267+0000 7f4127fff700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 0x7f4128067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.267+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4130083700 con 0x7f41400f7980 2022-02-02T20:59:28.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.267+0000 7f413f7fe700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 0x7f4128067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:28.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.268+0000 7f413f7fe700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 0x7f4128067290 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f41400f77e0 tx=0x7f413400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:28.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.271+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4130055170 con 0x7f41400f7980 2022-02-02T20:59:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.472+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4140027a00 con 0x7f41400f7980 2022-02-02T20:59:28.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.472+0000 7f4127fff700 1 -- 172.21.15.96:0/3627872170 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4130054d60 con 0x7f41400f7980 2022-02-02T20:59:28.474 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:59:28.474 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:59:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:59:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:59:28.475 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:59:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:59:28.476 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:59:28.476 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:59:28.476 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:59:28.476 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:59:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:59:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:59:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:59:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:59:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:59:28.478 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:59:28.478 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:59:28.478 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:59:28.478 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:59:28.479 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:59:28.479 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:59:28.480 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:59:28.480 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:59:28.480 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:59:28.480 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:59:28.481 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:59:28.481 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:59:28.481 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:59:28.481 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:59:28.482 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:59:28.482 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:59:28.482 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:28.483 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:28.483 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:59:28.483 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:28.483 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:28.484 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:28.484 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 msgr2=0x7f4128067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 0x7f4128067290 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f41400f77e0 tx=0x7f413400b040).stop 2022-02-02T20:59:28.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 msgr2=0x7f4140107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f4130009990 tx=0x7f4130009b30).stop 2022-02-02T20:59:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 shutdown_connections 2022-02-02T20:59:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4128064dd0 0x7f4128067290 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41400f66e0 0x7f4140106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 --2- 172.21.15.96:0/3627872170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41400f7980 0x7f4140107400 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 >> 172.21.15.96:0/3627872170 conn(0x7f41400f1e40 msgr2=0x7f41400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 shutdown_connections 2022-02-02T20:59:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:28.474+0000 7f4145bb8700 1 -- 172.21.15.96:0/3627872170 wait complete. 2022-02-02T20:59:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T20:59:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:28 smithi159 ceph-mon[69013]: from='client.38946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T20:59:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T20:59:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:28 smithi159 ceph-mon[69013]: pgmap v4721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:28 smithi159 ceph-mon[69013]: from='client.38950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/517746456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:59:29.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3627872170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:59:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/517746456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T20:59:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3627872170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T20:59:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:30 smithi159 ceph-mon[69013]: pgmap v4722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:30 smithi096 ceph-mon[101353]: pgmap v4722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:32 smithi159 ceph-mon[69013]: pgmap v4723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:32 smithi096 ceph-mon[101353]: pgmap v4723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:34 smithi159 ceph-mon[69013]: pgmap v4724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:34 smithi096 ceph-mon[101353]: pgmap v4724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:36 smithi159 ceph-mon[69013]: pgmap v4725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:36 smithi096 ceph-mon[101353]: pgmap v4725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:38 smithi159 ceph-mon[69013]: pgmap v4726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:38 smithi096 ceph-mon[101353]: pgmap v4726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:40 smithi159 ceph-mon[69013]: pgmap v4727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:40 smithi096 ceph-mon[101353]: pgmap v4727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:42 smithi159 ceph-mon[69013]: pgmap v4728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:42 smithi096 ceph-mon[101353]: pgmap v4728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:44 smithi159 ceph-mon[69013]: pgmap v4729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:44 smithi096 ceph-mon[101353]: pgmap v4729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:46 smithi159 ceph-mon[69013]: pgmap v4730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:46 smithi096 ceph-mon[101353]: pgmap v4730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:48 smithi159 ceph-mon[69013]: pgmap v4731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:48 smithi096 ceph-mon[101353]: pgmap v4731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:50 smithi159 ceph-mon[69013]: pgmap v4732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:50 smithi096 ceph-mon[101353]: pgmap v4732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:52 smithi159 ceph-mon[69013]: pgmap v4733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:52 smithi096 ceph-mon[101353]: pgmap v4733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:54 smithi159 ceph-mon[69013]: pgmap v4734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:54 smithi096 ceph-mon[101353]: pgmap v4734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:56 smithi159 ceph-mon[69013]: pgmap v4735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:56 smithi096 ceph-mon[101353]: pgmap v4735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:58.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:58 smithi159 ceph-mon[69013]: pgmap v4736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:58 smithi096 ceph-mon[101353]: pgmap v4736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T20:59:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 -- 172.21.15.96:0/990367594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 msgr2=0x7f0e740f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 --2- 172.21.15.96:0/990367594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e740f6230 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 rx=0x7f0e5c004660 tx=0x7f0e5c009b30).stop 2022-02-02T20:59:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 -- 172.21.15.96:0/990367594 shutdown_connections 2022-02-02T20:59:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 --2- 172.21.15.96:0/990367594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e740f6230 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 --2- 172.21.15.96:0/990367594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 0x7f0e740f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 -- 172.21.15.96:0/990367594 >> 172.21.15.96:0/990367594 conn(0x7f0e740f0290 msgr2=0x7f0e740f26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 -- 172.21.15.96:0/990367594 shutdown_connections 2022-02-02T20:59:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.584+0000 7f0e7359e700 1 -- 172.21.15.96:0/990367594 wait complete. 2022-02-02T20:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 Processor -- start 2022-02-02T20:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 -- start start 2022-02-02T20:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 0x7f0e741099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740f7d90 con 0x7f0e740f5dd0 2022-02-02T20:59:58.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740f7ed0 con 0x7f0e740f4b30 2022-02-02T20:59:58.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40256/0 (socket says 172.21.15.96:40256) 2022-02-02T20:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e69d9b700 1 -- 172.21.15.96:0/889231389 learned_addr learned my addr 172.21.15.96:0/889231389 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.585+0000 7f0e7259c700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 0x7f0e741099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e69d9b700 1 -- 172.21.15.96:0/889231389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 msgr2=0x7f0e741099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e69d9b700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 0x7f0e741099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e69d9b700 1 -- 172.21.15.96:0/889231389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c005040 con 0x7f0e740f5dd0 2022-02-02T20:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e69d9b700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7f0e5c009990 tx=0x7f0e5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c018070 con 0x7f0e740f5dd0 2022-02-02T20:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7410c420 con 0x7f0e740f5dd0 2022-02-02T20:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e5c007ba0 con 0x7f0e740f5dd0 2022-02-02T20:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c01c3c0 con 0x7f0e740f5dd0 2022-02-02T20:59:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.586+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7410c950 con 0x7f0e740f5dd0 2022-02-02T20:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.587+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e74045ad0 con 0x7f0e740f5dd0 2022-02-02T20:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.588+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e5c01d420 con 0x7f0e740f5dd0 2022-02-02T20:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.588+0000 7f0e6b7fe700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 0x7f0e600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.588+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e5c0836a0 con 0x7f0e740f5dd0 2022-02-02T20:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.588+0000 7f0e7259c700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 0x7f0e600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.589+0000 7f0e7259c700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 0x7f0e600672e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f0e740f7a10 tx=0x7f0e6400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.592+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e5c051860 con 0x7f0e740f5dd0 2022-02-02T20:59:58.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.773+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e740fa820 con 0x7f0e60064e20 2022-02-02T20:59:58.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.775+0000 7f0e6b7fe700 1 -- 172.21.15.96:0/889231389 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0e740fa820 con 0x7f0e60064e20 2022-02-02T20:59:58.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 msgr2=0x7f0e600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 0x7f0e600672e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f0e740f7a10 tx=0x7f0e6400b040).stop 2022-02-02T20:59:58.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 msgr2=0x7f0e7410bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7f0e5c009990 tx=0x7f0e5c009b30).stop 2022-02-02T20:59:58.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 shutdown_connections 2022-02-02T20:59:58.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e60064e20 0x7f0e600672e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e740f4b30 0x7f0e741099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 --2- 172.21.15.96:0/889231389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e740f5dd0 0x7f0e7410bed0 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.776+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 >> 172.21.15.96:0/889231389 conn(0x7f0e740f0290 msgr2=0x7f0e740fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:58.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.777+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 shutdown_connections 2022-02-02T20:59:58.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.777+0000 7f0e7359e700 1 -- 172.21.15.96:0/889231389 wait complete. 2022-02-02T20:59:58.788 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T20:59:58.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 -- 172.21.15.96:0/926709114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 msgr2=0x7f3ba80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 --2- 172.21.15.96:0/926709114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba80f5a00 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 rx=0x7f3b9c004660 tx=0x7f3b9c009b30).stop 2022-02-02T20:59:58.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 -- 172.21.15.96:0/926709114 shutdown_connections 2022-02-02T20:59:58.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 --2- 172.21.15.96:0/926709114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 --2- 172.21.15.96:0/926709114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba80f5a00 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 -- 172.21.15.96:0/926709114 >> 172.21.15.96:0/926709114 conn(0x7f3ba80f0de0 msgr2=0x7f3ba80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:58.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 -- 172.21.15.96:0/926709114 shutdown_connections 2022-02-02T20:59:58.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.874+0000 7f3baf768700 1 -- 172.21.15.96:0/926709114 wait complete. 2022-02-02T20:59:58.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 Processor -- start 2022-02-02T20:59:58.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 -- start start 2022-02-02T20:59:58.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8060500 con 0x7f3ba80f55e0 2022-02-02T20:59:58.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3baf768700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8060640 con 0x7f3ba80f5ef0 2022-02-02T20:59:58.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3bacd03700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3bacd03700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:44370/0 (socket says 172.21.15.96:44370) 2022-02-02T20:59:58.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3bacd03700 1 -- 172.21.15.96:0/1808556172 learned_addr learned my addr 172.21.15.96:0/1808556172 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:58.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.875+0000 7f3bad504700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3bad504700 1 -- 172.21.15.96:0/1808556172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 msgr2=0x7f3ba810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:58.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3bad504700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:58.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3bad504700 1 -- 172.21.15.96:0/1808556172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c005040 con 0x7f3ba80f55e0 2022-02-02T20:59:58.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3bad504700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba8109c90 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 rx=0x7f3b9c000c00 tx=0x7f3b9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:58.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9c018070 con 0x7f3ba80f55e0 2022-02-02T20:59:58.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b9c007ba0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9c01c3c0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba810c6e0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.876+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba810cbf0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.877+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba8045ad0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.878+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b9c01d420 con 0x7f3ba80f55e0 2022-02-02T20:59:58.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.878+0000 7f3b99ffb700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:58.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.879+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3b9c0837b0 con 0x7f3ba80f55e0 2022-02-02T20:59:58.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.879+0000 7f3bacd03700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:58.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.879+0000 7f3bacd03700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 0x7f3b94067290 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f3ba40041d0 tx=0x7f3ba4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:58.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:58.883+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b9c0518b0 con 0x7f3ba80f55e0 2022-02-02T20:59:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.056+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba80fdee0 con 0x7f3b94064dd0 2022-02-02T20:59:59.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.065+0000 7f3b99ffb700 1 -- 172.21.15.96:0/1808556172 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3ba80fdee0 con 0x7f3b94064dd0 2022-02-02T20:59:59.068 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T20:59:59.068 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T20:59:59.068 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T20:59:59.069 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T20:59:59.069 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T20:59:59.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T20:59:59.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T20:59:59.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T20:59:59.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T20:59:59.070 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T20:59:59.070 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T20:59:59.070 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T20:59:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T20:59:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T20:59:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T20:59:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T20:59:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T20:59:59.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T20:59:59.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T20:59:59.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T20:59:59.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T20:59:59.073 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T20:59:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 msgr2=0x7f3b94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 0x7f3b94067290 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f3ba40041d0 tx=0x7f3ba4009040).stop 2022-02-02T20:59:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 msgr2=0x7f3ba8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba8109c90 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 rx=0x7f3b9c000c00 tx=0x7f3b9c009b30).stop 2022-02-02T20:59:59.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 shutdown_connections 2022-02-02T20:59:59.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ba80f55e0 0x7f3ba8109c90 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 --2- 172.21.15.96:0/1808556172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba80f5ef0 0x7f3ba810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 >> 172.21.15.96:0/1808556172 conn(0x7f3ba80f0de0 msgr2=0x7f3ba80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 shutdown_connections 2022-02-02T20:59:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.067+0000 7f3baf768700 1 -- 172.21.15.96:0/1808556172 wait complete. 2022-02-02T20:59:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.165+0000 7f903f111700 1 -- 172.21.15.96:0/4139602549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 msgr2=0x7f90380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.165+0000 7f903f111700 1 --2- 172.21.15.96:0/4139602549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f90380f6950 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 rx=0x7f9034004660 tx=0x7f9034009b30).stop 2022-02-02T20:59:59.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 -- 172.21.15.96:0/4139602549 shutdown_connections 2022-02-02T20:59:59.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 --2- 172.21.15.96:0/4139602549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 0x7f90380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 --2- 172.21.15.96:0/4139602549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f90380f6950 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 -- 172.21.15.96:0/4139602549 >> 172.21.15.96:0/4139602549 conn(0x7f90380f1c90 msgr2=0x7f90380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:59.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 -- 172.21.15.96:0/4139602549 shutdown_connections 2022-02-02T20:59:59.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 -- 172.21.15.96:0/4139602549 wait complete. 2022-02-02T20:59:59.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 Processor -- start 2022-02-02T20:59:59.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.166+0000 7f903f111700 1 -- start start 2022-02-02T20:59:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 0x7f90381072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90381078f0 con 0x7f90380f6530 2022-02-02T20:59:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038108100 con 0x7f90380f77d0 2022-02-02T20:59:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40272/0 (socket says 172.21.15.96:40272) 2022-02-02T20:59:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 -- 172.21.15.96:0/1757716331 learned_addr learned my addr 172.21.15.96:0/1757716331 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903d90e700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 0x7f90381072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 -- 172.21.15.96:0/1757716331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 msgr2=0x7f90381072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 0x7f90381072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 -- 172.21.15.96:0/1757716331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034005040 con 0x7f90380f6530 2022-02-02T20:59:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903e10f700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 rx=0x7f9034009830 tx=0x7f9034009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9034018070 con 0x7f90380f6530 2022-02-02T20:59:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9038108320 con 0x7f90380f6530 2022-02-02T20:59:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9034007ba0 con 0x7f90380f6530 2022-02-02T20:59:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903401de60 con 0x7f90380f6530 2022-02-02T20:59:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.167+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9038108880 con 0x7f90380f6530 2022-02-02T20:59:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.168+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9038059100 con 0x7f90380f6530 2022-02-02T20:59:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.169+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9034007d10 con 0x7f90380f6530 2022-02-02T20:59:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.169+0000 7f902effd700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 0x7f9024067320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.169+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f90340836c0 con 0x7f90380f6530 2022-02-02T20:59:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.169+0000 7f903d90e700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 0x7f9024067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.170+0000 7f903d90e700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 0x7f9024067320 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f9028004c40 tx=0x7f902800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.173+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9034051760 con 0x7f90380f6530 2022-02-02T20:59:59.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.403+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90380008d0 con 0x7f90380f6530 2022-02-02T20:59:59.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.404+0000 7f902effd700 1 -- 172.21.15.96:0/1757716331 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9034054d80 con 0x7f90380f6530 2022-02-02T20:59:59.407 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T20:59:59.407 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T20:59:59.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:59:59.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:59.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T20:59:59.408 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T20:59:59.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:59.408 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T20:59:59.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T20:59:59.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:59.409 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T20:59:59.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T20:59:59.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T20:59:59.410 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T20:59:59.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T20:59:59.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T20:59:59.410 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T20:59:59.411 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T20:59:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.405+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 msgr2=0x7f9024067320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.405+0000 7f903f111700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 0x7f9024067320 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f9028004c40 tx=0x7f902800b040).stop 2022-02-02T20:59:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.405+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 msgr2=0x7f9038106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.405+0000 7f903f111700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 rx=0x7f9034009830 tx=0x7f9034009b30).stop 2022-02-02T20:59:59.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 shutdown_connections 2022-02-02T20:59:59.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9024064e60 0x7f9024067320 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90380f6530 0x7f9038106e00 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 --2- 172.21.15.96:0/1757716331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90380f77d0 0x7f90381072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 >> 172.21.15.96:0/1757716331 conn(0x7f90380f1c90 msgr2=0x7f90380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 shutdown_connections 2022-02-02T20:59:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.406+0000 7f903f111700 1 -- 172.21.15.96:0/1757716331 wait complete. 2022-02-02T20:59:59.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 -- 172.21.15.96:0/1423045428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f77d0 msgr2=0x7f23680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 --2- 172.21.15.96:0/1423045428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f77d0 0x7f23680f7c30 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 rx=0x7f235c004660 tx=0x7f235c009b30).stop 2022-02-02T20:59:59.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 -- 172.21.15.96:0/1423045428 shutdown_connections 2022-02-02T20:59:59.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 --2- 172.21.15.96:0/1423045428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f77d0 0x7f23680f7c30 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 --2- 172.21.15.96:0/1423045428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f6530 0x7f23680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 -- 172.21.15.96:0/1423045428 >> 172.21.15.96:0/1423045428 conn(0x7f23680f1c90 msgr2=0x7f23680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:59.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 -- 172.21.15.96:0/1423045428 shutdown_connections 2022-02-02T20:59:59.507 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 20:59:59 smithi096 ceph-mon[101353]: from='client.38962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:59.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.502+0000 7f236ca3c700 1 -- 172.21.15.96:0/1423045428 wait complete. 2022-02-02T20:59:59.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 Processor -- start 2022-02-02T20:59:59.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 -- start start 2022-02-02T20:59:59.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f77d0 0x7f2368107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23681077f0 con 0x7f23680f6530 2022-02-02T20:59:59.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f236ca3c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368107ff0 con 0x7f23680f77d0 2022-02-02T20:59:59.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.503+0000 7f23677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40282/0 (socket says 172.21.15.96:40282) 2022-02-02T20:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 -- 172.21.15.96:0/3363079091 learned_addr learned my addr 172.21.15.96:0/3363079091 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T20:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f2366ffd700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f77d0 0x7f2368107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 -- 172.21.15.96:0/3363079091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f77d0 msgr2=0x7f2368107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f77d0 0x7f2368107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 -- 172.21.15.96:0/3363079091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c005040 con 0x7f23680f6530 2022-02-02T20:59:59.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f23677fe700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 rx=0x7f235800c530 tx=0x7f2358007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:59.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235800f650 con 0x7f23680f6530 2022-02-02T20:59:59.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23681082d0 con 0x7f23680f6530 2022-02-02T20:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f235800fc60 con 0x7f23680f6530 2022-02-02T20:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2358012d20 con 0x7f23680f6530 2022-02-02T20:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.504+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2368108890 con 0x7f23680f6530 2022-02-02T20:59:59.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.505+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2368059100 con 0x7f23680f6530 2022-02-02T20:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.506+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2358019030 con 0x7f23680f6530 2022-02-02T20:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.506+0000 7f234ffff700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 0x7f23500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T20:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.506+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2358081710 con 0x7f23680f6530 2022-02-02T20:59:59.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.506+0000 7f2366ffd700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 0x7f23500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T20:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.507+0000 7f2366ffd700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 0x7f23500672e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f235c009da0 tx=0x7f235c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T20:59:59.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.510+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2358053290 con 0x7f23680f6530 2022-02-02T20:59:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 20:59:59 smithi159 ceph-mon[69013]: from='client.38962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T20:59:59.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.711+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23680fed90 con 0x7f23680f6530 2022-02-02T20:59:59.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.711+0000 7f234ffff700 1 -- 172.21.15.96:0/3363079091 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2358052e80 con 0x7f23680f6530 2022-02-02T20:59:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T20:59:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T20:59:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:59:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T20:59:59.715 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T20:59:59.715 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T20:59:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T20:59:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T20:59:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T20:59:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T20:59:59.716 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T20:59:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T20:59:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T20:59:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T20:59:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T20:59:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T20:59:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T20:59:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T20:59:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T20:59:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T20:59:59.719 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T20:59:59.719 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T20:59:59.719 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T20:59:59.723 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T20:59:59.723 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T20:59:59.723 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T20:59:59.723 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T20:59:59.724 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T20:59:59.724 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T20:59:59.724 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T20:59:59.725 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T20:59:59.725 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:59.725 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:59.726 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T20:59:59.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T20:59:59.726 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:59.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:59.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T20:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 msgr2=0x7f23500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 0x7f23500672e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f235c009da0 tx=0x7f235c009b30).stop 2022-02-02T20:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 msgr2=0x7f2368106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T20:59:59.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 rx=0x7f235800c530 tx=0x7f2358007e10).stop 2022-02-02T20:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 shutdown_connections 2022-02-02T20:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2350064e20 0x7f23500672e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23680f6530 0x7f2368106d50 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 --2- 172.21.15.96:0/3363079091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23680f77d0 0x7f2368107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T20:59:59.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.714+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 >> 172.21.15.96:0/3363079091 conn(0x7f23680f1c90 msgr2=0x7f23680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T20:59:59.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.715+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 shutdown_connections 2022-02-02T20:59:59.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T20:59:59.715+0000 7f236ca3c700 1 -- 172.21.15.96:0/3363079091 wait complete. 2022-02-02T20:59:59.733 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:00:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:00 smithi159 ceph-mon[69013]: from='client.38966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1757716331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:00:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:00 smithi159 ceph-mon[69013]: pgmap v4737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3363079091' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:00:00.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:00:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:00 smithi096 ceph-mon[101353]: from='client.38966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:00.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1757716331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:00:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:00 smithi096 ceph-mon[101353]: pgmap v4737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3363079091' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:00:00.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:00:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:02 smithi159 ceph-mon[69013]: pgmap v4738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:03.059 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:02 smithi096 ceph-mon[101353]: pgmap v4738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:04 smithi159 ceph-mon[69013]: pgmap v4739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:04 smithi096 ceph-mon[101353]: pgmap v4739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:06 smithi159 ceph-mon[69013]: pgmap v4740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:06 smithi096 ceph-mon[101353]: pgmap v4740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:08 smithi159 ceph-mon[69013]: pgmap v4741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:08 smithi096 ceph-mon[101353]: pgmap v4741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:10 smithi159 ceph-mon[69013]: pgmap v4742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:11.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:10 smithi096 ceph-mon[101353]: pgmap v4742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:12 smithi159 ceph-mon[69013]: pgmap v4743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:12 smithi096 ceph-mon[101353]: pgmap v4743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:14 smithi159 ceph-mon[69013]: pgmap v4744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:14 smithi096 ceph-mon[101353]: pgmap v4744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:16 smithi159 ceph-mon[69013]: pgmap v4745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:16 smithi096 ceph-mon[101353]: pgmap v4745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:18 smithi159 ceph-mon[69013]: pgmap v4746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:18 smithi096 ceph-mon[101353]: pgmap v4746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:20 smithi159 ceph-mon[69013]: pgmap v4747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:20 smithi096 ceph-mon[101353]: pgmap v4747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:22 smithi159 ceph-mon[69013]: pgmap v4748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:22 smithi096 ceph-mon[101353]: pgmap v4748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:24 smithi159 ceph-mon[69013]: pgmap v4749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:24 smithi096 ceph-mon[101353]: pgmap v4749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:26 smithi159 ceph-mon[69013]: pgmap v4750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:26 smithi096 ceph-mon[101353]: pgmap v4750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:00:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:00:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:28 smithi159 ceph-mon[69013]: pgmap v4751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:00:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:00:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:28 smithi096 ceph-mon[101353]: pgmap v4751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:29.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 -- 172.21.15.96:0/3403390994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 msgr2=0x7fd2900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:29.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 --2- 172.21.15.96:0/3403390994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f59e0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 rx=0x7fd284004660 tx=0x7fd284009b30).stop 2022-02-02T21:00:29.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 -- 172.21.15.96:0/3403390994 shutdown_connections 2022-02-02T21:00:29.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 --2- 172.21.15.96:0/3403390994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:00:29.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 --2- 172.21.15.96:0/3403390994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f59e0 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:29.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 -- 172.21.15.96:0/3403390994 >> 172.21.15.96:0/3403390994 conn(0x7fd2900f0de0 msgr2=0x7fd2900f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:29.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 -- 172.21.15.96:0/3403390994 shutdown_connections 2022-02-02T21:00:29.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.822+0000 7fd294895700 1 -- 172.21.15.96:0/3403390994 wait complete. 2022-02-02T21:00:29.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 Processor -- start 2022-02-02T21:00:29.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 -- start start 2022-02-02T21:00:29.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:29.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:29.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900f8230 con 0x7fd2900f55c0 2022-02-02T21:00:29.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd294895700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900f8370 con 0x7fd2900f5ed0 2022-02-02T21:00:29.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:29.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40300/0 (socket says 172.21.15.96:40300) 2022-02-02T21:00:29.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd28e59c700 1 -- 172.21.15.96:0/3243201035 learned_addr learned my addr 172.21.15.96:0/3243201035 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:00:29.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd28e59c700 1 -- 172.21.15.96:0/3243201035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 msgr2=0x7fd2900f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:29.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.823+0000 7fd28dd9b700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:29.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd28e59c700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:29.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd28e59c700 1 -- 172.21.15.96:0/3243201035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284005040 con 0x7fd2900f55c0 2022-02-02T21:00:29.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd28dd9b700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:00:29.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd28e59c700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 rx=0x7fd284009990 tx=0x7fd284009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:29.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd284018070 con 0x7fd2900f55c0 2022-02-02T21:00:29.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd284007ca0 con 0x7fd2900f55c0 2022-02-02T21:00:29.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2900f85f0 con 0x7fd2900f55c0 2022-02-02T21:00:29.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd28401c620 con 0x7fd2900f55c0 2022-02-02T21:00:29.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.824+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29010ef80 con 0x7fd2900f55c0 2022-02-02T21:00:29.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.825+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290045ad0 con 0x7fd2900f55c0 2022-02-02T21:00:29.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.825+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd28401d960 con 0x7fd2900f55c0 2022-02-02T21:00:29.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.826+0000 7fd27effd700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 0x7fd278067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:29.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.826+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd2840837e0 con 0x7fd2900f55c0 2022-02-02T21:00:29.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.826+0000 7fd28dd9b700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 0x7fd278067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:29.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.826+0000 7fd28dd9b700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 0x7fd278067290 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd28000a880 tx=0x7fd280008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:29.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:29.830+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd2840519a0 con 0x7fd2900f55c0 2022-02-02T21:00:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.008+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2900fad40 con 0x7fd278064dd0 2022-02-02T21:00:30.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.009+0000 7fd27effd700 1 -- 172.21.15.96:0/3243201035 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd2900fad40 con 0x7fd278064dd0 2022-02-02T21:00:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 msgr2=0x7fd278067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 0x7fd278067290 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd28000a880 tx=0x7fd280008040).stop 2022-02-02T21:00:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 msgr2=0x7fd2900f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 rx=0x7fd284009990 tx=0x7fd284009b30).stop 2022-02-02T21:00:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 shutdown_connections 2022-02-02T21:00:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd278064dd0 0x7fd278067290 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2900f55c0 0x7fd2900f97c0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 --2- 172.21.15.96:0/3243201035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2900f5ed0 0x7fd2900f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 >> 172.21.15.96:0/3243201035 conn(0x7fd2900f0de0 msgr2=0x7fd29005ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 shutdown_connections 2022-02-02T21:00:30.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.011+0000 7fd294895700 1 -- 172.21.15.96:0/3243201035 wait complete. 2022-02-02T21:00:30.022 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:00:30.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 -- 172.21.15.96:0/1646780751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f6860 msgr2=0x7fb6e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/1646780751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f6cc0 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 rx=0x7fb6d0004660 tx=0x7fb6d0009b30).stop 2022-02-02T21:00:30.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 -- 172.21.15.96:0/1646780751 shutdown_connections 2022-02-02T21:00:30.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/1646780751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f6cc0 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/1646780751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 -- 172.21.15.96:0/1646780751 >> 172.21.15.96:0/1646780751 conn(0x7fb6e00f0d40 msgr2=0x7fb6e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 -- 172.21.15.96:0/1646780751 shutdown_connections 2022-02-02T21:00:30.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.109+0000 7fb6e54ae700 1 -- 172.21.15.96:0/1646780751 wait complete. 2022-02-02T21:00:30.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 Processor -- start 2022-02-02T21:00:30.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 -- start start 2022-02-02T21:00:30.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00f8920 con 0x7fb6e00f55c0 2022-02-02T21:00:30.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6e54ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00f8a60 con 0x7fb6e00f6860 2022-02-02T21:00:30.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40310/0 (socket says 172.21.15.96:40310) 2022-02-02T21:00:30.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6deffd700 1 -- 172.21.15.96:0/3076749526 learned_addr learned my addr 172.21.15.96:0/3076749526 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:00:30.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.110+0000 7fb6de7fc700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6deffd700 1 -- 172.21.15.96:0/3076749526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 msgr2=0x7fb6e00f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6deffd700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6deffd700 1 -- 172.21.15.96:0/3076749526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0005040 con 0x7fb6e00f55c0 2022-02-02T21:00:30.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6de7fc700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:00:30.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6deffd700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 rx=0x7fb6d4002700 tx=0x7fb6d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d4009320 con 0x7fb6e00f55c0 2022-02-02T21:00:30.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00f8d40 con 0x7fb6e00f55c0 2022-02-02T21:00:30.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb6d400f040 con 0x7fb6e00f55c0 2022-02-02T21:00:30.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d4014900 con 0x7fb6e00f55c0 2022-02-02T21:00:30.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.111+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e010efa0 con 0x7fb6e00f55c0 2022-02-02T21:00:30.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.112+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0045ad0 con 0x7fb6e00f55c0 2022-02-02T21:00:30.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.113+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb6d4009480 con 0x7fb6e00f55c0 2022-02-02T21:00:30.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.113+0000 7fb6c77fe700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 0x7fb6c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.113+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb6d4081d80 con 0x7fb6e00f55c0 2022-02-02T21:00:30.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.113+0000 7fb6de7fc700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 0x7fb6c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.114+0000 7fb6de7fc700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 0x7fb6c8067290 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb6d0004630 tx=0x7fb6d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.118+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb6d404fe80 con 0x7fb6e00f55c0 2022-02-02T21:00:30.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.287+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6e005fd30 con 0x7fb6c8064dd0 2022-02-02T21:00:30.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.297+0000 7fb6c77fe700 1 -- 172.21.15.96:0/3076749526 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb6e005fd30 con 0x7fb6c8064dd0 2022-02-02T21:00:30.298 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:00:30.298 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:00:30.299 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:00:30.299 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:00:30.299 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:00:30.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:00:30.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:00:30.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:00:30.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:00:30.300 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:00:30.300 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:00:30.301 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:00:30.301 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:00:30.301 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:00:30.301 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:00:30.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:00:30.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:00:30.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:00:30.303 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:00:30.303 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:00:30.303 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:00:30.304 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:00:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 msgr2=0x7fb6c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 0x7fb6c8067290 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb6d0004630 tx=0x7fb6d0009b30).stop 2022-02-02T21:00:30.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 msgr2=0x7fb6e00f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 rx=0x7fb6d4002700 tx=0x7fb6d4009d80).stop 2022-02-02T21:00:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 shutdown_connections 2022-02-02T21:00:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb6c8064dd0 0x7fb6c8067290 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6e00f55c0 0x7fb6e00f9f40 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 --2- 172.21.15.96:0/3076749526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6e00f6860 0x7fb6e00f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.298+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 >> 172.21.15.96:0/3076749526 conn(0x7fb6e00f0d40 msgr2=0x7fb6e005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.299+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 shutdown_connections 2022-02-02T21:00:30.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.299+0000 7fb6e54ae700 1 -- 172.21.15.96:0/3076749526 wait complete. 2022-02-02T21:00:30.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 -- 172.21.15.96:0/1655591363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f55c0 msgr2=0x7fa6480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 --2- 172.21.15.96:0/1655591363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f55c0 0x7fa6480f59e0 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 rx=0x7fa63c004660 tx=0x7fa63c009b30).stop 2022-02-02T21:00:30.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 -- 172.21.15.96:0/1655591363 shutdown_connections 2022-02-02T21:00:30.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 --2- 172.21.15.96:0/1655591363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f6860 0x7fa6480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 --2- 172.21.15.96:0/1655591363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f55c0 0x7fa6480f59e0 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 -- 172.21.15.96:0/1655591363 >> 172.21.15.96:0/1655591363 conn(0x7fa6480f0d40 msgr2=0x7fa6480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 -- 172.21.15.96:0/1655591363 shutdown_connections 2022-02-02T21:00:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 -- 172.21.15.96:0/1655591363 wait complete. 2022-02-02T21:00:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.395+0000 7fa64e961700 1 Processor -- start 2022-02-02T21:00:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa64e961700 1 -- start start 2022-02-02T21:00:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa64e961700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f55c0 0x7fa648106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa64e961700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa64e961700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648107a10 con 0x7fa6480f6860 2022-02-02T21:00:30.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa64e961700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648107b50 con 0x7fa6480f55c0 2022-02-02T21:00:30.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40320/0 (socket says 172.21.15.96:40320) 2022-02-02T21:00:30.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 -- 172.21.15.96:0/3615124143 learned_addr learned my addr 172.21.15.96:0/3615124143 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:00:30.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa647fff700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f55c0 0x7fa648106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 -- 172.21.15.96:0/3615124143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f55c0 msgr2=0x7fa648106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f55c0 0x7fa648106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 -- 172.21.15.96:0/3615124143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c005040 con 0x7fa6480f6860 2022-02-02T21:00:30.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.396+0000 7fa6477fe700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 rx=0x7fa6380026d0 tx=0x7fa638009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.397+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6380079c0 con 0x7fa6480f6860 2022-02-02T21:00:30.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.397+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6481084f0 con 0x7fa6480f6860 2022-02-02T21:00:30.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.397+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa648108ab0 con 0x7fa6480f6860 2022-02-02T21:00:30.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.397+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa63800f040 con 0x7fa6480f6860 2022-02-02T21:00:30.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.397+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6380148b0 con 0x7fa6480f6860 2022-02-02T21:00:30.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.398+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa628004fa0 con 0x7fa6480f6860 2022-02-02T21:00:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.399+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa638007b20 con 0x7fa6480f6860 2022-02-02T21:00:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.399+0000 7fa644ff9700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 0x7fa630067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.399+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa638081a80 con 0x7fa6480f6860 2022-02-02T21:00:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.399+0000 7fa647fff700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 0x7fa630067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.400+0000 7fa647fff700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 0x7fa630067290 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fa63c004630 tx=0x7fa63c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.403+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa638053630 con 0x7fa6480f6860 2022-02-02T21:00:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.633+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa628005940 con 0x7fa6480f6860 2022-02-02T21:00:30.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.633+0000 7fa644ff9700 1 -- 172.21.15.96:0/3615124143 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa638007db0 con 0x7fa6480f6860 2022-02-02T21:00:30.635 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:00:30.635 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:00:30.636 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:00:30.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:00:30.636 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:00:30.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:00:30.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:00:30.637 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:00:30.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:00:30.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:00:30.638 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:00:30.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:00:30.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:00:30.639 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:00:30.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:00:30.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:00:30.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:00:30.640 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:00:30.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 msgr2=0x7fa630067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 0x7fa630067290 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fa63c004630 tx=0x7fa63c009b30).stop 2022-02-02T21:00:30.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 msgr2=0x7fa648107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 rx=0x7fa6380026d0 tx=0x7fa638009de0).stop 2022-02-02T21:00:30.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 shutdown_connections 2022-02-02T21:00:30.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa630064dd0 0x7fa630067290 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6480f55c0 0x7fa648106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 --2- 172.21.15.96:0/3615124143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6480f6860 0x7fa648107460 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 >> 172.21.15.96:0/3615124143 conn(0x7fa6480f0d40 msgr2=0x7fa64805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 shutdown_connections 2022-02-02T21:00:30.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.635+0000 7fa64e961700 1 -- 172.21.15.96:0/3615124143 wait complete. 2022-02-02T21:00:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 -- 172.21.15.96:0/4061039863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f55d0 msgr2=0x7fdcb40f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/4061039863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f55d0 0x7fdcb40f59f0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 rx=0x7fdca4004660 tx=0x7fdca4009b30).stop 2022-02-02T21:00:30.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 -- 172.21.15.96:0/4061039863 shutdown_connections 2022-02-02T21:00:30.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/4061039863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f6870 0x7fdcb40f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/4061039863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f55d0 0x7fdcb40f59f0 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 -- 172.21.15.96:0/4061039863 >> 172.21.15.96:0/4061039863 conn(0x7fdcb40f0d70 msgr2=0x7fdcb40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 -- 172.21.15.96:0/4061039863 shutdown_connections 2022-02-02T21:00:30.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.734+0000 7fdcba6c1700 1 -- 172.21.15.96:0/4061039863 wait complete. 2022-02-02T21:00:30.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 Processor -- start 2022-02-02T21:00:30.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 -- start start 2022-02-02T21:00:30.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f55d0 0x7fdcb4105e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4106940 con 0x7fdcb40f6870 2022-02-02T21:00:30.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.735+0000 7fdcba6c1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4107150 con 0x7fdcb40f55d0 2022-02-02T21:00:30.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40330/0 (socket says 172.21.15.96:40330) 2022-02-02T21:00:30.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 -- 172.21.15.96:0/1851501637 learned_addr learned my addr 172.21.15.96:0/1851501637 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:00:30.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb3fff700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f55d0 0x7fdcb4105e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 -- 172.21.15.96:0/1851501637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f55d0 msgr2=0x7fdcb4105e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f55d0 0x7fdcb4105e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 -- 172.21.15.96:0/1851501637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4005040 con 0x7fdcb40f6870 2022-02-02T21:00:30.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb37fe700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 rx=0x7fdc9c002700 tx=0x7fdc9c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c009320 con 0x7fdcb40f6870 2022-02-02T21:00:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc9c00f040 con 0x7fdcb40f6870 2022-02-02T21:00:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb41073d0 con 0x7fdcb40f6870 2022-02-02T21:00:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c014870 con 0x7fdcb40f6870 2022-02-02T21:00:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.736+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb4107990 con 0x7fdcb40f6870 2022-02-02T21:00:30.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.737+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb40f49c0 con 0x7fdcb40f6870 2022-02-02T21:00:30.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.738+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc9c009480 con 0x7fdcb40f6870 2022-02-02T21:00:30.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.738+0000 7fdcb0ff9700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 0x7fdca0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:00:30.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.738+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc9c081c50 con 0x7fdcb40f6870 2022-02-02T21:00:30.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.738+0000 7fdcb3fff700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 0x7fdca0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:00:30.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.738+0000 7fdcb3fff700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 0x7fdca0067290 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fdca4013690 tx=0x7fdca4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:00:30.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.742+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc9c04fd50 con 0x7fdcb40f6870 2022-02-02T21:00:30.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.945+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdcb40fdf20 con 0x7fdcb40f6870 2022-02-02T21:00:30.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.946+0000 7fdcb0ff9700 1 -- 172.21.15.96:0/1851501637 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdcb40fdf20 con 0x7fdcb40f6870 2022-02-02T21:00:30.949 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:00:30.949 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:00:30.949 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:00:30.949 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:00:30.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:00:30.950 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:00:30.950 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:00:30.951 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:00:30.951 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:00:30.951 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:00:30.951 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:00:30.952 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:00:30.952 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:00:30.952 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:00:30.952 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:00:30.953 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:00:30.953 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:00:30.953 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:00:30.954 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:00:30.954 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:00:30.954 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:00:30.954 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:00:30.955 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:00:30.955 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:00:30.955 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:00:30.955 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:00:30.955 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:00:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:00:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:00:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:00:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:00:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:00:30.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:00:30.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:00:30.957 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:00:30.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:00:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:00:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:00:30.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:00:30.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 msgr2=0x7fdca0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 0x7fdca0067290 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fdca4013690 tx=0x7fdca4009b30).stop 2022-02-02T21:00:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 msgr2=0x7fdcb4106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:00:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 rx=0x7fdc9c002700 tx=0x7fdc9c009e00).stop 2022-02-02T21:00:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 shutdown_connections 2022-02-02T21:00:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdca0064dd0 0x7fdca0067290 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcb40f55d0 0x7fdcb4105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 --2- 172.21.15.96:0/1851501637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcb40f6870 0x7fdcb4106340 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:00:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 >> 172.21.15.96:0/1851501637 conn(0x7fdcb40f0d70 msgr2=0x7fdcb40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:00:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 shutdown_connections 2022-02-02T21:00:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:00:30.949+0000 7fdcba6c1700 1 -- 172.21.15.96:0/1851501637 wait complete. 2022-02-02T21:00:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:00:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:30 smithi159 ceph-mon[69013]: pgmap v4752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3615124143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:00:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:30 smithi096 ceph-mon[101353]: pgmap v4752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3615124143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:00:32.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:31 smithi159 ceph-mon[69013]: from='client.38978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:32.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:31 smithi159 ceph-mon[69013]: from='client.38982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:32.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1851501637' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:00:32.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:31 smithi096 ceph-mon[101353]: from='client.38978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:32.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:31 smithi096 ceph-mon[101353]: from='client.38982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:00:32.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1851501637' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:00:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:32 smithi159 ceph-mon[69013]: pgmap v4753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:32 smithi096 ceph-mon[101353]: pgmap v4753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:34 smithi159 ceph-mon[69013]: pgmap v4754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:34 smithi096 ceph-mon[101353]: pgmap v4754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:37.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:36 smithi159 ceph-mon[69013]: pgmap v4755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:37.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:36 smithi096 ceph-mon[101353]: pgmap v4755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:38 smithi159 ceph-mon[69013]: pgmap v4756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:38 smithi096 ceph-mon[101353]: pgmap v4756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:40 smithi159 ceph-mon[69013]: pgmap v4757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:40 smithi096 ceph-mon[101353]: pgmap v4757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:43.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:42 smithi159 ceph-mon[69013]: pgmap v4758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:42 smithi096 ceph-mon[101353]: pgmap v4758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:44 smithi159 ceph-mon[69013]: pgmap v4759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:44 smithi096 ceph-mon[101353]: pgmap v4759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:46 smithi159 ceph-mon[69013]: pgmap v4760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:46 smithi096 ceph-mon[101353]: pgmap v4760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:48 smithi159 ceph-mon[69013]: pgmap v4761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:48 smithi096 ceph-mon[101353]: pgmap v4761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:50 smithi159 ceph-mon[69013]: pgmap v4762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:50 smithi096 ceph-mon[101353]: pgmap v4762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:53.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:52 smithi159 ceph-mon[69013]: pgmap v4763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:52 smithi096 ceph-mon[101353]: pgmap v4763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:54 smithi159 ceph-mon[69013]: pgmap v4764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:54 smithi096 ceph-mon[101353]: pgmap v4764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:56 smithi159 ceph-mon[69013]: pgmap v4765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:56 smithi096 ceph-mon[101353]: pgmap v4765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:00:58 smithi159 ceph-mon[69013]: pgmap v4766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:00:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:00:58 smithi096 ceph-mon[101353]: pgmap v4766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:00 smithi159 ceph-mon[69013]: pgmap v4767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:00 smithi096 ceph-mon[101353]: pgmap v4767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:01.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 -- 172.21.15.96:0/506378065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 msgr2=0x7f8f1c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/506378065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c0f6cc0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 rx=0x7f8f18004660 tx=0x7f8f18009b30).stop 2022-02-02T21:01:01.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 -- 172.21.15.96:0/506378065 shutdown_connections 2022-02-02T21:01:01.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/506378065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c0f6cc0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/506378065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:01:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 -- 172.21.15.96:0/506378065 >> 172.21.15.96:0/506378065 conn(0x7f8f1c0f0d40 msgr2=0x7f8f1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 -- 172.21.15.96:0/506378065 shutdown_connections 2022-02-02T21:01:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.059+0000 7f8f23c3e700 1 -- 172.21.15.96:0/506378065 wait complete. 2022-02-02T21:01:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 Processor -- start 2022-02-02T21:01:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 -- start start 2022-02-02T21:01:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0604b0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.060+0000 7f8f23c3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0605f0 con 0x7f8f1c0f55c0 2022-02-02T21:01:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40350/0 (socket says 172.21.15.96:40350) 2022-02-02T21:01:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 -- 172.21.15.96:0/2483295503 learned_addr learned my addr 172.21.15.96:0/2483295503 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f219da700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 -- 172.21.15.96:0/2483295503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 msgr2=0x7f8f1c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 -- 172.21.15.96:0/2483295503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18005040 con 0x7f8f1c0f6860 2022-02-02T21:01:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f219da700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:01:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f211d9700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 rx=0x7f8f18009990 tx=0x7f8f18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f18018070 con 0x7f8f1c0f6860 2022-02-02T21:01:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f18007ca0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c10c770 con 0x7f8f1c0f6860 2022-02-02T21:01:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1801c620 con 0x7f8f1c0f6860 2022-02-02T21:01:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.061+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c10ccd0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.062+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c045ad0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.063+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f1801d960 con 0x7f8f1c0f6860 2022-02-02T21:01:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.063+0000 7f8f0e7fc700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 0x7f8f08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.064+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8f180837e0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.064+0000 7f8f219da700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 0x7f8f08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.064+0000 7f8f219da700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 0x7f8f08067290 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f8f1c0600a0 tx=0x7f8f10008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.068+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f180519a0 con 0x7f8f1c0f6860 2022-02-02T21:01:01.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.246+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f1c0fdfd0 con 0x7f8f08064dd0 2022-02-02T21:01:01.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.247+0000 7f8f0e7fc700 1 -- 172.21.15.96:0/2483295503 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8f1000b500 con 0x7f8f08064dd0 2022-02-02T21:01:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.248+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 msgr2=0x7f8f08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.248+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 0x7f8f08067290 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f8f1c0600a0 tx=0x7f8f10008040).stop 2022-02-02T21:01:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.248+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 msgr2=0x7f8f1c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.248+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 rx=0x7f8f18009990 tx=0x7f8f18009b30).stop 2022-02-02T21:01:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 shutdown_connections 2022-02-02T21:01:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f08064dd0 0x7f8f08067290 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f1c0f55c0 0x7f8f1c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 --2- 172.21.15.96:0/2483295503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f1c0f6860 0x7f8f1c10c170 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 >> 172.21.15.96:0/2483295503 conn(0x7f8f1c0f0d40 msgr2=0x7f8f1c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 shutdown_connections 2022-02-02T21:01:01.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.249+0000 7f8f23c3e700 1 -- 172.21.15.96:0/2483295503 wait complete. 2022-02-02T21:01:01.260 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:01:01.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 -- 172.21.15.96:0/2654924709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 msgr2=0x7fa0300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 --2- 172.21.15.96:0/2654924709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa0300f59e0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 rx=0x7fa024004660 tx=0x7fa024009b30).stop 2022-02-02T21:01:01.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 -- 172.21.15.96:0/2654924709 shutdown_connections 2022-02-02T21:01:01.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 --2- 172.21.15.96:0/2654924709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 0x7fa0300f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 --2- 172.21.15.96:0/2654924709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa0300f59e0 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 -- 172.21.15.96:0/2654924709 >> 172.21.15.96:0/2654924709 conn(0x7fa0300f0d40 msgr2=0x7fa0300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 -- 172.21.15.96:0/2654924709 shutdown_connections 2022-02-02T21:01:01.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.346+0000 7fa034863700 1 -- 172.21.15.96:0/2654924709 wait complete. 2022-02-02T21:01:01.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 Processor -- start 2022-02-02T21:01:01.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 -- start start 2022-02-02T21:01:01.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 0x7fa03010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300603e0 con 0x7fa0300f55c0 2022-02-02T21:01:01.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa034863700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030060520 con 0x7fa0300f6860 2022-02-02T21:01:01.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40356/0 (socket says 172.21.15.96:40356) 2022-02-02T21:01:01.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02e59c700 1 -- 172.21.15.96:0/1891254205 learned_addr learned my addr 172.21.15.96:0/1891254205 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:01.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02dd9b700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 0x7fa03010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02e59c700 1 -- 172.21.15.96:0/1891254205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 msgr2=0x7fa03010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.347+0000 7fa02e59c700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 0x7fa03010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa02e59c700 1 -- 172.21.15.96:0/1891254205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024005040 con 0x7fa0300f55c0 2022-02-02T21:01:01.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa02e59c700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 rx=0x7fa024013a70 tx=0x7fa024009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa024018070 con 0x7fa0300f55c0 2022-02-02T21:01:01.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03010c6c0 con 0x7fa0300f55c0 2022-02-02T21:01:01.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0240097d0 con 0x7fa0300f55c0 2022-02-02T21:01:01.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02401de80 con 0x7fa0300f55c0 2022-02-02T21:01:01.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.348+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa030105ad0 con 0x7fa0300f55c0 2022-02-02T21:01:01.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.349+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa030045ad0 con 0x7fa0300f55c0 2022-02-02T21:01:01.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.349+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa024007ba0 con 0x7fa0300f55c0 2022-02-02T21:01:01.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.350+0000 7fa01effd700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 0x7fa01806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.350+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa024083660 con 0x7fa0300f55c0 2022-02-02T21:01:01.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.350+0000 7fa02dd9b700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 0x7fa01806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.350+0000 7fa02dd9b700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 0x7fa01806b6a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fa020004c20 tx=0x7fa02000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.354+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa024051760 con 0x7fa0300f55c0 2022-02-02T21:01:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.527+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0300fdf00 con 0x7fa0180691e0 2022-02-02T21:01:01.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.536+0000 7fa01effd700 1 -- 172.21.15.96:0/1891254205 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa0300fdf00 con 0x7fa0180691e0 2022-02-02T21:01:01.538 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:01:01.538 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:01:01.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:01:01.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:01:01.539 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:01:01.539 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:01:01.539 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:01:01.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:01:01.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:01:01.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:01:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:01:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:01:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:01:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:01:01.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:01:01.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:01:01.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:01:01.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:01:01.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:01:01.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:01:01.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:01:01.544 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:01:01.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 msgr2=0x7fa01806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 0x7fa01806b6a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fa020004c20 tx=0x7fa02000b040).stop 2022-02-02T21:01:01.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 msgr2=0x7fa030109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 rx=0x7fa024013a70 tx=0x7fa024009b30).stop 2022-02-02T21:01:01.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 shutdown_connections 2022-02-02T21:01:01.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa0180691e0 0x7fa01806b6a0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0300f55c0 0x7fa030109c70 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 --2- 172.21.15.96:0/1891254205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0300f6860 0x7fa03010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 >> 172.21.15.96:0/1891254205 conn(0x7fa0300f0d40 msgr2=0x7fa0300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 shutdown_connections 2022-02-02T21:01:01.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.538+0000 7fa034863700 1 -- 172.21.15.96:0/1891254205 wait complete. 2022-02-02T21:01:01.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 -- 172.21.15.96:0/4213771323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 msgr2=0x7f328c0fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 --2- 172.21.15.96:0/4213771323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0fbb70 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 rx=0x7f3280004660 tx=0x7f3280009b30).stop 2022-02-02T21:01:01.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 -- 172.21.15.96:0/4213771323 shutdown_connections 2022-02-02T21:01:01.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 --2- 172.21.15.96:0/4213771323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0fbb70 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 --2- 172.21.15.96:0/4213771323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 0x7f328c0f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 -- 172.21.15.96:0/4213771323 >> 172.21.15.96:0/4213771323 conn(0x7f328c0f0320 msgr2=0x7f328c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.635+0000 7f3291151700 1 -- 172.21.15.96:0/4213771323 shutdown_connections 2022-02-02T21:01:01.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 -- 172.21.15.96:0/4213771323 wait complete. 2022-02-02T21:01:01.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 Processor -- start 2022-02-02T21:01:01.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 -- start start 2022-02-02T21:01:01.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 0x7f328c0f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0f5e90 con 0x7f328c0f5260 2022-02-02T21:01:01.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.636+0000 7f3291151700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0f5fd0 con 0x7f328c0f48c0 2022-02-02T21:01:01.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40374/0 (socket says 172.21.15.96:40374) 2022-02-02T21:01:01.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 -- 172.21.15.96:0/4042357022 learned_addr learned my addr 172.21.15.96:0/4042357022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:01.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328bfff700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 0x7f328c0f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 -- 172.21.15.96:0/4042357022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 msgr2=0x7f328c0f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 0x7f328c0f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 -- 172.21.15.96:0/4042357022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280005040 con 0x7f328c0f5260 2022-02-02T21:01:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f328b7fe700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 rx=0x7f3280004f60 tx=0x7f3280009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3280018070 con 0x7f328c0f5260 2022-02-02T21:01:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0f6250 con 0x7f328c0f5260 2022-02-02T21:01:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3280007ba0 con 0x7f328c0f5260 2022-02-02T21:01:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328001c620 con 0x7f328c0f5260 2022-02-02T21:01:01.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.637+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0f67b0 con 0x7f328c0f5260 2022-02-02T21:01:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.638+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c045ad0 con 0x7f328c0f5260 2022-02-02T21:01:01.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.639+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f328001d420 con 0x7f328c0f5260 2022-02-02T21:01:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.639+0000 7f3288ff9700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 0x7f32740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.639+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3280083970 con 0x7f328c0f5260 2022-02-02T21:01:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.639+0000 7f328bfff700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 0x7f32740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.640+0000 7f328bfff700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 0x7f32740672e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f327c007fd0 tx=0x7f327c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.643+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3280051b30 con 0x7f328c0f5260 2022-02-02T21:01:01.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.875+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f328c0fede0 con 0x7f328c0f5260 2022-02-02T21:01:01.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.876+0000 7f3288ff9700 1 -- 172.21.15.96:0/4042357022 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3280055150 con 0x7f328c0f5260 2022-02-02T21:01:01.877 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:01:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:01:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:01:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:01:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:01:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:01:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:01:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:01:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:01:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:01:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:01:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:01:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:01:01.882 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:01:01.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.877+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 msgr2=0x7f32740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.877+0000 7f3291151700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 0x7f32740672e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f327c007fd0 tx=0x7f327c009040).stop 2022-02-02T21:01:01.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.877+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 msgr2=0x7f328c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.877+0000 7f3291151700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 rx=0x7f3280004f60 tx=0x7f3280009b30).stop 2022-02-02T21:01:01.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 shutdown_connections 2022-02-02T21:01:01.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3274064e20 0x7f32740672e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f328c0f48c0 0x7f328c0f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 --2- 172.21.15.96:0/4042357022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f328c0f5260 0x7f328c0f5930 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 >> 172.21.15.96:0/4042357022 conn(0x7f328c0f0320 msgr2=0x7f328c0f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 shutdown_connections 2022-02-02T21:01:01.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.878+0000 7f3291151700 1 -- 172.21.15.96:0/4042357022 wait complete. 2022-02-02T21:01:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 -- 172.21.15.96:0/326525725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f6ac0 msgr2=0x7fac4c0f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 --2- 172.21.15.96:0/326525725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c0f6ee0 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 rx=0x7fac3c004660 tx=0x7fac3c009b30).stop 2022-02-02T21:01:01.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 -- 172.21.15.96:0/326525725 shutdown_connections 2022-02-02T21:01:01.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 --2- 172.21.15.96:0/326525725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f57d0 0x7fac4c0f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:01:01.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 --2- 172.21.15.96:0/326525725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c0f6ee0 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 -- 172.21.15.96:0/326525725 >> 172.21.15.96:0/326525725 conn(0x7fac4c0f0320 msgr2=0x7fac4c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 -- 172.21.15.96:0/326525725 shutdown_connections 2022-02-02T21:01:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 -- 172.21.15.96:0/326525725 wait complete. 2022-02-02T21:01:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.975+0000 7fac52d9e700 1 Processor -- start 2022-02-02T21:01:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 -- start start 2022-02-02T21:01:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c10e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0f5350 con 0x7fac4c0f57d0 2022-02-02T21:01:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0f5490 con 0x7fac4c0f6ac0 2022-02-02T21:01:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40382/0 (socket says 172.21.15.96:40382) 2022-02-02T21:01:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 -- 172.21.15.96:0/1762488427 learned_addr learned my addr 172.21.15.96:0/1762488427 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac5159b700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c10e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 -- 172.21.15.96:0/1762488427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 msgr2=0x7fac4c10e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:01.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c10e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:01.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 -- 172.21.15.96:0/1762488427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c005040 con 0x7fac4c0f57d0 2022-02-02T21:01:01.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac5159b700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c10e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:01:01.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac51d9c700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 rx=0x7fac3c009990 tx=0x7fac3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c018070 con 0x7fac4c0f57d0 2022-02-02T21:01:01.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac3c007ca0 con 0x7fac4c0f57d0 2022-02-02T21:01:01.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.976+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c10e810 con 0x7fac4c0f57d0 2022-02-02T21:01:01.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.977+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c10ec30 con 0x7fac4c0f57d0 2022-02-02T21:01:01.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.977+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c01c620 con 0x7fac4c0f57d0 2022-02-02T21:01:01.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.977+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac34004fa0 con 0x7fac4c0f57d0 2022-02-02T21:01:01.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.978+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fac3c01c890 con 0x7fac4c0f57d0 2022-02-02T21:01:01.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.978+0000 7fac427fc700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 0x7fac380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:01.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.978+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fac3c0836a0 con 0x7fac4c0f57d0 2022-02-02T21:01:01.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.978+0000 7fac5159b700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 0x7fac380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.979+0000 7fac5159b700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 0x7fac380672e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fac4800b830 tx=0x7fac48008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:01.983+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fac3c0517a0 con 0x7fac4c0f57d0 2022-02-02T21:01:02.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.183+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac34005e80 con 0x7fac4c0f57d0 2022-02-02T21:01:02.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.183+0000 7fac427fc700 1 -- 172.21.15.96:0/1762488427 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fac3c054dc0 con 0x7fac4c0f57d0 2022-02-02T21:01:02.185 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:01:02.186 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:01:02.186 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:01:02.186 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:01:02.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:02.187 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:01:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:01:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:01:02.188 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:01:02.189 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:01:02.189 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:01:02.189 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:01:02.190 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:01:02.190 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:01:02.190 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:01:02.190 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:01:02.191 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:01:02.191 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:01:02.191 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:01:02.191 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:01:02.192 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:01:02.192 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:01:02.192 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:01:02.193 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:01:02.193 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:01:02.193 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:01:02.193 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:01:02.194 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:01:02.194 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:01:02.194 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:01:02.194 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:01:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:01:02.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:02.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:02.195 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:01:02.196 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:02.196 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:02.197 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 msgr2=0x7fac380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 0x7fac380672e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fac4800b830 tx=0x7fac48008040).stop 2022-02-02T21:01:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 msgr2=0x7fac4c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 rx=0x7fac3c009990 tx=0x7fac3c009b30).stop 2022-02-02T21:01:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 shutdown_connections 2022-02-02T21:01:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac38064e20 0x7fac380672e0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac4c0f57d0 0x7fac4c10be20 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 --2- 172.21.15.96:0/1762488427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac4c0f6ac0 0x7fac4c10e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 >> 172.21.15.96:0/1762488427 conn(0x7fac4c0f0320 msgr2=0x7fac4c0fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 shutdown_connections 2022-02-02T21:01:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:02.185+0000 7fac52d9e700 1 -- 172.21.15.96:0/1762488427 wait complete. 2022-02-02T21:01:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:01:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:02 smithi159 ceph-mon[69013]: from='client.38994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:02 smithi159 ceph-mon[69013]: from='client.38998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:02 smithi159 ceph-mon[69013]: pgmap v4768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4042357022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:01:03.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1762488427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:01:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:02 smithi096 ceph-mon[101353]: from='client.38994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:02 smithi096 ceph-mon[101353]: from='client.38998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:02 smithi096 ceph-mon[101353]: pgmap v4768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4042357022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:01:03.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1762488427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:01:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:04 smithi159 ceph-mon[69013]: pgmap v4769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:04 smithi096 ceph-mon[101353]: pgmap v4769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:06 smithi159 ceph-mon[69013]: pgmap v4770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:06 smithi096 ceph-mon[101353]: pgmap v4770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:08 smithi159 ceph-mon[69013]: pgmap v4771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:08 smithi096 ceph-mon[101353]: pgmap v4771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:10 smithi159 ceph-mon[69013]: pgmap v4772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:10 smithi096 ceph-mon[101353]: pgmap v4772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:12 smithi159 ceph-mon[69013]: pgmap v4773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:12 smithi096 ceph-mon[101353]: pgmap v4773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:15.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:14 smithi159 ceph-mon[69013]: pgmap v4774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:14 smithi096 ceph-mon[101353]: pgmap v4774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:17.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:16 smithi159 ceph-mon[69013]: pgmap v4775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:16 smithi096 ceph-mon[101353]: pgmap v4775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:18 smithi159 ceph-mon[69013]: pgmap v4776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:18 smithi096 ceph-mon[101353]: pgmap v4776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:20 smithi159 ceph-mon[69013]: pgmap v4777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:20 smithi096 ceph-mon[101353]: pgmap v4777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:22 smithi159 ceph-mon[69013]: pgmap v4778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:22 smithi096 ceph-mon[101353]: pgmap v4778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:24 smithi159 ceph-mon[69013]: pgmap v4779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:24 smithi096 ceph-mon[101353]: pgmap v4779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:26 smithi159 ceph-mon[69013]: pgmap v4780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:26 smithi096 ceph-mon[101353]: pgmap v4780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:01:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:01:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:28 smithi159 ceph-mon[69013]: pgmap v4781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:01:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:01:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:28 smithi096 ceph-mon[101353]: pgmap v4781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:31.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:30 smithi159 ceph-mon[69013]: pgmap v4782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:30 smithi096 ceph-mon[101353]: pgmap v4782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 -- 172.21.15.96:0/851333104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f7980 msgr2=0x7f08b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/851333104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f7980 0x7f08b00f7de0 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 rx=0x7f08ac004660 tx=0x7f08ac009b30).stop 2022-02-02T21:01:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 -- 172.21.15.96:0/851333104 shutdown_connections 2022-02-02T21:01:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/851333104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f7980 0x7f08b00f7de0 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/851333104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f66e0 0x7f08b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 -- 172.21.15.96:0/851333104 >> 172.21.15.96:0/851333104 conn(0x7f08b00f1e40 msgr2=0x7f08b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 -- 172.21.15.96:0/851333104 shutdown_connections 2022-02-02T21:01:32.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.295+0000 7f08b7eb1700 1 -- 172.21.15.96:0/851333104 wait complete. 2022-02-02T21:01:32.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 Processor -- start 2022-02-02T21:01:32.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 -- start start 2022-02-02T21:01:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 0x7f08b0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0107a00 con 0x7f08b00f66e0 2022-02-02T21:01:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b7eb1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0107b40 con 0x7f08b00f7980 2022-02-02T21:01:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b5c4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b5c4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40400/0 (socket says 172.21.15.96:40400) 2022-02-02T21:01:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.296+0000 7f08b5c4d700 1 -- 172.21.15.96:0/3789757218 learned_addr learned my addr 172.21.15.96:0/3789757218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b544c700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 0x7f08b0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b5c4d700 1 -- 172.21.15.96:0/3789757218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 msgr2=0x7f08b0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b5c4d700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 0x7f08b0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b5c4d700 1 -- 172.21.15.96:0/3789757218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac005040 con 0x7f08b00f66e0 2022-02-02T21:01:32.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b544c700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 0x7f08b0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:01:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b5c4d700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 rx=0x7f08a000c530 tx=0x7f08a0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a000f650 con 0x7f08b00f66e0 2022-02-02T21:01:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b01084e0 con 0x7f08b00f66e0 2022-02-02T21:01:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08a000fc60 con 0x7f08b00f66e0 2022-02-02T21:01:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a0012d20 con 0x7f08b00f66e0 2022-02-02T21:01:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.297+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b0108aa0 con 0x7f08b00f66e0 2022-02-02T21:01:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.298+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0045ad0 con 0x7f08b00f66e0 2022-02-02T21:01:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.299+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f08a0019030 con 0x7f08b00f66e0 2022-02-02T21:01:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.299+0000 7f08a67fc700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 0x7f089c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.299+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f08a00816b0 con 0x7f08b00f66e0 2022-02-02T21:01:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.299+0000 7f08b544c700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 0x7f089c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.299+0000 7f08b544c700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 0x7f089c067290 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f08ac004e30 tx=0x7f08ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.303+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08a0053230 con 0x7f08b00f66e0 2022-02-02T21:01:32.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.482+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08b0108d20 con 0x7f089c064dd0 2022-02-02T21:01:32.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.484+0000 7f08a67fc700 1 -- 172.21.15.96:0/3789757218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f08b0108d20 con 0x7f089c064dd0 2022-02-02T21:01:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 msgr2=0x7f089c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 0x7f089c067290 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f08ac004e30 tx=0x7f08ac009b30).stop 2022-02-02T21:01:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 msgr2=0x7f08b0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 rx=0x7f08a000c530 tx=0x7f08a0007e10).stop 2022-02-02T21:01:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 shutdown_connections 2022-02-02T21:01:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f089c064dd0 0x7f089c067290 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08b00f66e0 0x7f08b0106f60 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 --2- 172.21.15.96:0/3789757218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08b00f7980 0x7f08b0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 >> 172.21.15.96:0/3789757218 conn(0x7f08b00f1e40 msgr2=0x7f08b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 shutdown_connections 2022-02-02T21:01:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.486+0000 7f08b7eb1700 1 -- 172.21.15.96:0/3789757218 wait complete. 2022-02-02T21:01:32.498 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:01:32.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- 172.21.15.96:0/2707317177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f55d0 msgr2=0x7f93480f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 --2- 172.21.15.96:0/2707317177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f55d0 0x7f93480f59f0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 rx=0x7f9338004660 tx=0x7f9338009b30).stop 2022-02-02T21:01:32.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- 172.21.15.96:0/2707317177 shutdown_connections 2022-02-02T21:01:32.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 --2- 172.21.15.96:0/2707317177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f6870 0x7f93480f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 --2- 172.21.15.96:0/2707317177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f55d0 0x7f93480f59f0 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- 172.21.15.96:0/2707317177 >> 172.21.15.96:0/2707317177 conn(0x7f93480f0d30 msgr2=0x7f93480f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:32.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- 172.21.15.96:0/2707317177 shutdown_connections 2022-02-02T21:01:32.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- 172.21.15.96:0/2707317177 wait complete. 2022-02-02T21:01:32.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 Processor -- start 2022-02-02T21:01:32.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.584+0000 7f934c948700 1 -- start start 2022-02-02T21:01:32.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934c948700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f55d0 0x7f9348109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934c948700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934c948700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480604e0 con 0x7f93480f6870 2022-02-02T21:01:32.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934c948700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348060620 con 0x7f93480f55d0 2022-02-02T21:01:32.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40412/0 (socket says 172.21.15.96:40412) 2022-02-02T21:01:32.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 -- 172.21.15.96:0/3745144780 learned_addr learned my addr 172.21.15.96:0/3745144780 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:32.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934659c700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f55d0 0x7f9348109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 -- 172.21.15.96:0/3745144780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f55d0 msgr2=0x7f9348109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f55d0 0x7f9348109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 -- 172.21.15.96:0/3745144780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338005040 con 0x7f93480f6870 2022-02-02T21:01:32.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f9345d9b700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 rx=0x7f933000c790 tx=0x7f9330007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933000e680 con 0x7f93480f6870 2022-02-02T21:01:32.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f933000ec90 con 0x7f93480f6870 2022-02-02T21:01:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9330013d60 con 0x7f93480f6870 2022-02-02T21:01:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.585+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934810c720 con 0x7f93480f6870 2022-02-02T21:01:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.586+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934810cce0 con 0x7f93480f6870 2022-02-02T21:01:32.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.586+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348045ad0 con 0x7f93480f6870 2022-02-02T21:01:32.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.587+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f933001a060 con 0x7f93480f6870 2022-02-02T21:01:32.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.587+0000 7f933effd700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.587+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9330081c90 con 0x7f93480f6870 2022-02-02T21:01:32.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.587+0000 7f934659c700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.588+0000 7f934659c700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f9338004e30 tx=0x7f9338009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.591+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f933004fd90 con 0x7f93480f6870 2022-02-02T21:01:32.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.765+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93480fdf10 con 0x7f9334064dd0 2022-02-02T21:01:32.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.774+0000 7f933effd700 1 -- 172.21.15.96:0/3745144780 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f93480fdf10 con 0x7f9334064dd0 2022-02-02T21:01:32.777 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:01:32.777 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:01:32.777 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:01:32.778 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:01:32.778 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:01:32.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:01:32.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:01:32.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:01:32.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:01:32.780 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:01:32.781 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:01:32.781 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:01:32.782 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:01:32.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:01:32.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:01:32.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:01:32.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:01:32.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:01:32.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:01:32.785 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:01:32.785 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:01:32.786 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:01:32.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 msgr2=0x7f9334067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f9338004e30 tx=0x7f9338009b30).stop 2022-02-02T21:01:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 msgr2=0x7f934810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 rx=0x7f933000c790 tx=0x7f9330007d70).stop 2022-02-02T21:01:32.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 shutdown_connections 2022-02-02T21:01:32.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f55d0 0x7f9348109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 --2- 172.21.15.96:0/3745144780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6870 0x7f934810c170 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 >> 172.21.15.96:0/3745144780 conn(0x7f93480f0d30 msgr2=0x7f93480fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 shutdown_connections 2022-02-02T21:01:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.776+0000 7f934c948700 1 -- 172.21.15.96:0/3745144780 wait complete. 2022-02-02T21:01:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 -- 172.21.15.96:0/2886594729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f55c0 msgr2=0x7f2cfc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/2886594729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc0f59e0 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 rx=0x7f2cf0004660 tx=0x7f2cf0009b30).stop 2022-02-02T21:01:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 -- 172.21.15.96:0/2886594729 shutdown_connections 2022-02-02T21:01:32.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/2886594729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/2886594729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc0f59e0 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 -- 172.21.15.96:0/2886594729 >> 172.21.15.96:0/2886594729 conn(0x7f2cfc0f0d40 msgr2=0x7f2cfc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:32.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:32 smithi096 ceph-mon[101353]: pgmap v4783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.872+0000 7f2d01ed4700 1 -- 172.21.15.96:0/2886594729 shutdown_connections 2022-02-02T21:01:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 -- 172.21.15.96:0/2886594729 wait complete. 2022-02-02T21:01:32.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 Processor -- start 2022-02-02T21:01:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 -- start start 2022-02-02T21:01:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0603e0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.873+0000 7f2d01ed4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc060520 con 0x7f2cfc0f55c0 2022-02-02T21:01:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40422/0 (socket says 172.21.15.96:40422) 2022-02-02T21:01:32.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 -- 172.21.15.96:0/1972355908 learned_addr learned my addr 172.21.15.96:0/1972355908 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfb7fe700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 -- 172.21.15.96:0/1972355908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f55c0 msgr2=0x7f2cfc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 -- 172.21.15.96:0/1972355908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0005040 con 0x7f2cfc0f6860 2022-02-02T21:01:32.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2cfaffd700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 rx=0x7f2cec002650 tx=0x7f2cec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cec007ba0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2cec009580 con 0x7f2cfc0f6860 2022-02-02T21:01:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc105ab0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cec012ea0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.874+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc106070 con 0x7f2cfc0f6860 2022-02-02T21:01:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.876+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc045ad0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.876+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2cec022070 con 0x7f2cfc0f6860 2022-02-02T21:01:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.876+0000 7f2ce3fff700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 0x7f2ce4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:32.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.876+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2cec085fd0 con 0x7f2cfc0f6860 2022-02-02T21:01:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.876+0000 7f2cfb7fe700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 0x7f2ce4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.877+0000 7f2cfb7fe700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 0x7f2ce4067290 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f2cf0013690 tx=0x7f2cf0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:32.880+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2cec0540d0 con 0x7f2cfc0f6860 2022-02-02T21:01:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:32 smithi159 ceph-mon[69013]: pgmap v4783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.110+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2cfc0fde90 con 0x7f2cfc0f6860 2022-02-02T21:01:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.111+0000 7f2ce3fff700 1 -- 172.21.15.96:0/1972355908 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2cec0576f0 con 0x7f2cfc0f6860 2022-02-02T21:01:33.114 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:01:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:01:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:01:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:01:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:01:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:01:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:01:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:01:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:01:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:01:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:01:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:01:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:01:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:01:33.118 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:01:33.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 msgr2=0x7f2ce4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 0x7f2ce4067290 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f2cf0013690 tx=0x7f2cf0009b30).stop 2022-02-02T21:01:33.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 msgr2=0x7f2cfc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 rx=0x7f2cec002650 tx=0x7f2cec009de0).stop 2022-02-02T21:01:33.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 shutdown_connections 2022-02-02T21:01:33.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ce4064dd0 0x7f2ce4067290 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cfc0f55c0 0x7f2cfc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 --2- 172.21.15.96:0/1972355908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cfc0f6860 0x7f2cfc10c170 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 >> 172.21.15.96:0/1972355908 conn(0x7f2cfc0f0d40 msgr2=0x7f2cfc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:33.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 shutdown_connections 2022-02-02T21:01:33.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.113+0000 7f2d01ed4700 1 -- 172.21.15.96:0/1972355908 wait complete. 2022-02-02T21:01:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2877248813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 msgr2=0x7fe8b80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2877248813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b80f6b00 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 rx=0x7fe8a8004660 tx=0x7fe8a8009b30).stop 2022-02-02T21:01:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2877248813 shutdown_connections 2022-02-02T21:01:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2877248813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 0x7fe8b80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2877248813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b80f6b00 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2877248813 >> 172.21.15.96:0/2877248813 conn(0x7fe8b80f1f00 msgr2=0x7fe8b80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.209+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2877248813 shutdown_connections 2022-02-02T21:01:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2877248813 wait complete. 2022-02-02T21:01:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 Processor -- start 2022-02-02T21:01:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 -- start start 2022-02-02T21:01:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 0x7fe8b8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806a380 con 0x7fe8b80f66e0 2022-02-02T21:01:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.210+0000 7fe8bcee6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806a4c0 con 0x7fe8b80f6ff0 2022-02-02T21:01:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40430/0 (socket says 172.21.15.96:40430) 2022-02-02T21:01:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 -- 172.21.15.96:0/2823679093 learned_addr learned my addr 172.21.15.96:0/2823679093 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:01:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 -- 172.21.15.96:0/2823679093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 msgr2=0x7fe8b8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b5d9b700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 0x7fe8b8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 0x7fe8b8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 -- 172.21.15.96:0/2823679093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8005040 con 0x7fe8b80f66e0 2022-02-02T21:01:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8b659c700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 rx=0x7fe8a8009990 tx=0x7fe8a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a8018070 con 0x7fe8b80f66e0 2022-02-02T21:01:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe8a8007ca0 con 0x7fe8b80f66e0 2022-02-02T21:01:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b806a740 con 0x7fe8b80f66e0 2022-02-02T21:01:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a801c620 con 0x7fe8b80f66e0 2022-02-02T21:01:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.211+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b806aca0 con 0x7fe8b80f66e0 2022-02-02T21:01:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe8a801d960 con 0x7fe8b80f66e0 2022-02-02T21:01:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8a6ffd700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 0x7fe8a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:01:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe8a80837d0 con 0x7fe8b80f66e0 2022-02-02T21:01:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8b5d9b700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 0x7fe8a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:01:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b8045ad0 con 0x7fe8b80f66e0 2022-02-02T21:01:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.213+0000 7fe8b5d9b700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 0x7fe8a0067290 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fe8ac0041d0 tx=0x7fe8ac009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:01:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.218+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe8a8051a40 con 0x7fe8b80f66e0 2022-02-02T21:01:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.417+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8b80feed0 con 0x7fe8b80f66e0 2022-02-02T21:01:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.418+0000 7fe8a6ffd700 1 -- 172.21.15.96:0/2823679093 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe8a8055060 con 0x7fe8b80f66e0 2022-02-02T21:01:33.420 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:01:33.421 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:01:33.421 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:01:33.421 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:01:33.421 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:33.422 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:01:33.422 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:01:33.422 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:01:33.422 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:01:33.422 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:01:33.423 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:01:33.423 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:01:33.423 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:01:33.423 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:01:33.424 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:01:33.424 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:01:33.424 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:01:33.425 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:01:33.425 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:01:33.425 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:01:33.425 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:01:33.425 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:01:33.426 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:01:33.426 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:01:33.426 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:01:33.426 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:01:33.427 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:01:33.427 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:01:33.427 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:01:33.428 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:01:33.428 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:01:33.428 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:01:33.428 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:33.429 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:33.429 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:01:33.429 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:01:33.429 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:33.430 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:33.430 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:01:33.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.419+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 msgr2=0x7fe8a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.419+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 0x7fe8a0067290 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fe8ac0041d0 tx=0x7fe8ac009040).stop 2022-02-02T21:01:33.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.419+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 msgr2=0x7fe8b806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:01:33.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.419+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 rx=0x7fe8a8009990 tx=0x7fe8a8009b30).stop 2022-02-02T21:01:33.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 shutdown_connections 2022-02-02T21:01:33.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe8a0064dd0 0x7fe8a0067290 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8b80f66e0 0x7fe8b806b9a0 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 --2- 172.21.15.96:0/2823679093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8b80f6ff0 0x7fe8b8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:01:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 >> 172.21.15.96:0/2823679093 conn(0x7fe8b80f1f00 msgr2=0x7fe8b80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:01:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 shutdown_connections 2022-02-02T21:01:33.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:01:33.420+0000 7fe8bcee6700 1 -- 172.21.15.96:0/2823679093 wait complete. 2022-02-02T21:01:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:01:34.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:33 smithi159 ceph-mon[69013]: from='client.39010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:34.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:33 smithi159 ceph-mon[69013]: from='client.39014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:34.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1972355908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:01:34.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2823679093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:01:34.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:33 smithi096 ceph-mon[101353]: from='client.39010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:34.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:33 smithi096 ceph-mon[101353]: from='client.39014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:01:34.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1972355908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:01:34.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2823679093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:01:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:34 smithi159 ceph-mon[69013]: pgmap v4784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:34 smithi096 ceph-mon[101353]: pgmap v4784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:36 smithi159 ceph-mon[69013]: pgmap v4785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:36 smithi096 ceph-mon[101353]: pgmap v4785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:38 smithi159 ceph-mon[69013]: pgmap v4786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:38.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:38 smithi096 ceph-mon[101353]: pgmap v4786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:40 smithi159 ceph-mon[69013]: pgmap v4787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:40 smithi096 ceph-mon[101353]: pgmap v4787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:42 smithi159 ceph-mon[69013]: pgmap v4788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:42 smithi096 ceph-mon[101353]: pgmap v4788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:44 smithi159 ceph-mon[69013]: pgmap v4789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:44 smithi096 ceph-mon[101353]: pgmap v4789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:46 smithi159 ceph-mon[69013]: pgmap v4790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:46 smithi096 ceph-mon[101353]: pgmap v4790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:48 smithi159 ceph-mon[69013]: pgmap v4791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:48 smithi096 ceph-mon[101353]: pgmap v4791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:50 smithi159 ceph-mon[69013]: pgmap v4792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:50 smithi096 ceph-mon[101353]: pgmap v4792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:52 smithi159 ceph-mon[69013]: pgmap v4793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:52 smithi096 ceph-mon[101353]: pgmap v4793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:54 smithi159 ceph-mon[69013]: pgmap v4794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:54 smithi096 ceph-mon[101353]: pgmap v4794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:56 smithi159 ceph-mon[69013]: pgmap v4795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:56 smithi096 ceph-mon[101353]: pgmap v4795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:01:58 smithi159 ceph-mon[69013]: pgmap v4796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:01:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:01:58 smithi096 ceph-mon[101353]: pgmap v4796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:00 smithi159 ceph-mon[69013]: pgmap v4797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:00 smithi096 ceph-mon[101353]: pgmap v4797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:02 smithi159 ceph-mon[69013]: pgmap v4798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:02 smithi096 ceph-mon[101353]: pgmap v4798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:03.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 -- 172.21.15.96:0/3246619179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 msgr2=0x7f69140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 --2- 172.21.15.96:0/3246619179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69140f6cc0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 rx=0x7f6910004660 tx=0x7f6910009b30).stop 2022-02-02T21:02:03.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 -- 172.21.15.96:0/3246619179 shutdown_connections 2022-02-02T21:02:03.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 --2- 172.21.15.96:0/3246619179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69140f6cc0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 --2- 172.21.15.96:0/3246619179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 0x7f69140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 -- 172.21.15.96:0/3246619179 >> 172.21.15.96:0/3246619179 conn(0x7f69140f0d40 msgr2=0x7f69140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:03.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 -- 172.21.15.96:0/3246619179 shutdown_connections 2022-02-02T21:02:03.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.530+0000 7f691bb77700 1 -- 172.21.15.96:0/3246619179 wait complete. 2022-02-02T21:02:03.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 Processor -- start 2022-02-02T21:02:03.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 -- start start 2022-02-02T21:02:03.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 0x7f6914104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141057e0 con 0x7f69140f6860 2022-02-02T21:02:03.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f691bb77700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914105920 con 0x7f69140f55c0 2022-02-02T21:02:03.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40450/0 (socket says 172.21.15.96:40450) 2022-02-02T21:02:03.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 -- 172.21.15.96:0/1606375061 learned_addr learned my addr 172.21.15.96:0/1606375061 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:03.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919913700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 0x7f6914104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 -- 172.21.15.96:0/1606375061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 msgr2=0x7f6914104cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 0x7f6914104cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.531+0000 7f6919112700 1 -- 172.21.15.96:0/1606375061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910005040 con 0x7f69140f6860 2022-02-02T21:02:03.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f6919112700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 rx=0x7f6910009990 tx=0x7f6910009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:03.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6910018070 con 0x7f69140f6860 2022-02-02T21:02:03.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6914106230 con 0x7f69140f6860 2022-02-02T21:02:03.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6910007ba0 con 0x7f69140f6860 2022-02-02T21:02:03.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f691001c3c0 con 0x7f69140f6860 2022-02-02T21:02:03.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.532+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6914106790 con 0x7f69140f6860 2022-02-02T21:02:03.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.533+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914045ad0 con 0x7f69140f6860 2022-02-02T21:02:03.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.533+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f691001d420 con 0x7f69140f6860 2022-02-02T21:02:03.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.534+0000 7f690a7fc700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 0x7f6900067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.534+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f69100836b0 con 0x7f69140f6860 2022-02-02T21:02:03.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.534+0000 7f6919913700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 0x7f6900067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.534+0000 7f6919913700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 0x7f6900067290 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f6914104a80 tx=0x7f690400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:03.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.538+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6910051810 con 0x7f69140f6860 2022-02-02T21:02:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.715+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69140faaa0 con 0x7f6900064dd0 2022-02-02T21:02:03.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.716+0000 7f690a7fc700 1 -- 172.21.15.96:0/1606375061 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f69140faaa0 con 0x7f6900064dd0 2022-02-02T21:02:03.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 msgr2=0x7f6900067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 0x7f6900067290 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f6914104a80 tx=0x7f690400b040).stop 2022-02-02T21:02:03.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 msgr2=0x7f69141051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 rx=0x7f6910009990 tx=0x7f6910009b30).stop 2022-02-02T21:02:03.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 shutdown_connections 2022-02-02T21:02:03.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6900064dd0 0x7f6900067290 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69140f55c0 0x7f6914104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 --2- 172.21.15.96:0/1606375061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69140f6860 0x7f69141051e0 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 >> 172.21.15.96:0/1606375061 conn(0x7f69140f0d40 msgr2=0x7f691405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:03.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 shutdown_connections 2022-02-02T21:02:03.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.718+0000 7f691bb77700 1 -- 172.21.15.96:0/1606375061 wait complete. 2022-02-02T21:02:03.730 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:02:03.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 -- 172.21.15.96:0/371294908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 msgr2=0x7f38440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 --2- 172.21.15.96:0/371294908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f38440f6cc0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 rx=0x7f3834004660 tx=0x7f3834009b30).stop 2022-02-02T21:02:03.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 -- 172.21.15.96:0/371294908 shutdown_connections 2022-02-02T21:02:03.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 --2- 172.21.15.96:0/371294908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f38440f6cc0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 --2- 172.21.15.96:0/371294908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f38440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 -- 172.21.15.96:0/371294908 >> 172.21.15.96:0/371294908 conn(0x7f38440f0d40 msgr2=0x7f38440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:03.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 -- 172.21.15.96:0/371294908 shutdown_connections 2022-02-02T21:02:03.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.816+0000 7f3849324700 1 -- 172.21.15.96:0/371294908 wait complete. 2022-02-02T21:02:03.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 Processor -- start 2022-02-02T21:02:03.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 -- start start 2022-02-02T21:02:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f3844106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844107a10 con 0x7f38440f6860 2022-02-02T21:02:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3849324700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844107b50 con 0x7f38440f55c0 2022-02-02T21:02:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40460/0 (socket says 172.21.15.96:40460) 2022-02-02T21:02:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 -- 172.21.15.96:0/3840274834 learned_addr learned my addr 172.21.15.96:0/3840274834 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3842ffd700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f3844106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 -- 172.21.15.96:0/3840274834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 msgr2=0x7f3844106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:03.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f3844106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:03.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 -- 172.21.15.96:0/3840274834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005040 con 0x7f38440f6860 2022-02-02T21:02:03.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f3842ffd700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f3844106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:02:03.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.817+0000 7f38427fc700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 rx=0x7f3834009990 tx=0x7f3834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:03.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.818+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3834018070 con 0x7f38440f6860 2022-02-02T21:02:03.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.818+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3834007ca0 con 0x7f38440f6860 2022-02-02T21:02:03.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.818+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3844108490 con 0x7f38440f6860 2022-02-02T21:02:03.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.818+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383401c620 con 0x7f38440f6860 2022-02-02T21:02:03.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.818+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38441089f0 con 0x7f38440f6860 2022-02-02T21:02:03.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.819+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844045ad0 con 0x7f38440f6860 2022-02-02T21:02:03.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.819+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f383401d960 con 0x7f38440f6860 2022-02-02T21:02:03.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.819+0000 7f382b7fe700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 0x7f382c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:03.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.819+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f38340837d0 con 0x7f38440f6860 2022-02-02T21:02:03.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.820+0000 7f3842ffd700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 0x7f382c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:03.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.820+0000 7f3842ffd700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 0x7f382c067290 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f38440f66c0 tx=0x7f3838009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:03.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.824+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3834055470 con 0x7f38440f6860 2022-02-02T21:02:03.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:03.997+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f38440fdec0 con 0x7f382c064dd0 2022-02-02T21:02:04.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.006+0000 7f382b7fe700 1 -- 172.21.15.96:0/3840274834 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f38440fdec0 con 0x7f382c064dd0 2022-02-02T21:02:04.008 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:02:04.009 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:02:04.009 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:02:04.009 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:02:04.009 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:02:04.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:02:04.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:02:04.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:02:04.010 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:02:04.011 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:02:04.011 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:02:04.011 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:02:04.011 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:02:04.012 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:02:04.012 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:02:04.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:02:04.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:02:04.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:02:04.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:02:04.014 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:02:04.014 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:02:04.014 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:02:04.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 msgr2=0x7f382c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 0x7f382c067290 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f38440f66c0 tx=0x7f3838009040).stop 2022-02-02T21:02:04.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 msgr2=0x7f3844107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 rx=0x7f3834009990 tx=0x7f3834009b30).stop 2022-02-02T21:02:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 shutdown_connections 2022-02-02T21:02:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f382c064dd0 0x7f382c067290 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38440f55c0 0x7f3844106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 --2- 172.21.15.96:0/3840274834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38440f6860 0x7f3844107460 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 >> 172.21.15.96:0/3840274834 conn(0x7f38440f0d40 msgr2=0x7f384405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:04.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 shutdown_connections 2022-02-02T21:02:04.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.008+0000 7f3849324700 1 -- 172.21.15.96:0/3840274834 wait complete. 2022-02-02T21:02:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 -- 172.21.15.96:0/254515015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0f9880 msgr2=0x7f571c0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 --2- 172.21.15.96:0/254515015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0f9880 0x7f571c0fbc70 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 rx=0x7f5718004660 tx=0x7f5718009b30).stop 2022-02-02T21:02:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 -- 172.21.15.96:0/254515015 shutdown_connections 2022-02-02T21:02:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 --2- 172.21.15.96:0/254515015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0f9880 0x7f571c0fbc70 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 --2- 172.21.15.96:0/254515015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0602b0 0x7f571c0f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 -- 172.21.15.96:0/254515015 >> 172.21.15.96:0/254515015 conn(0x7f571c0f0d40 msgr2=0x7f571c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 -- 172.21.15.96:0/254515015 shutdown_connections 2022-02-02T21:02:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.104+0000 7f572396e700 1 -- 172.21.15.96:0/254515015 wait complete. 2022-02-02T21:02:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 Processor -- start 2022-02-02T21:02:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 -- start start 2022-02-02T21:02:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0f9880 0x7f571c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c1079d0 con 0x7f571c0602b0 2022-02-02T21:02:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572396e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c107b10 con 0x7f571c0f9880 2022-02-02T21:02:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40466/0 (socket says 172.21.15.96:40466) 2022-02-02T21:02:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 -- 172.21.15.96:0/2864902540 learned_addr learned my addr 172.21.15.96:0/2864902540 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f5720f09700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0f9880 0x7f571c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 -- 172.21.15.96:0/2864902540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0f9880 msgr2=0x7f571c107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0f9880 0x7f571c107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 -- 172.21.15.96:0/2864902540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718005040 con 0x7f571c0602b0 2022-02-02T21:02:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.105+0000 7f572170a700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 rx=0x7f570c00c790 tx=0x7f570c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.106+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c002590 con 0x7f571c0602b0 2022-02-02T21:02:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.106+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c1084b0 con 0x7f571c0602b0 2022-02-02T21:02:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.106+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f570c002ba0 con 0x7f571c0602b0 2022-02-02T21:02:04.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.106+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c013d90 con 0x7f571c0602b0 2022-02-02T21:02:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.106+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c108a70 con 0x7f571c0602b0 2022-02-02T21:02:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.107+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c045ad0 con 0x7f571c0602b0 2022-02-02T21:02:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.108+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f570c01a060 con 0x7f571c0602b0 2022-02-02T21:02:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.108+0000 7f5711ffb700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 0x7f5708067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.108+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f570c081da0 con 0x7f571c0602b0 2022-02-02T21:02:04.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.108+0000 7f5720f09700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 0x7f5708067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.109+0000 7f5720f09700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 0x7f5708067290 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f5718004630 tx=0x7f5718009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:04.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.112+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f570c0538b0 con 0x7f571c0602b0 2022-02-02T21:02:04.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.344+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f571c027a00 con 0x7f571c0602b0 2022-02-02T21:02:04.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.344+0000 7f5711ffb700 1 -- 172.21.15.96:0/2864902540 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f570c018070 con 0x7f571c0602b0 2022-02-02T21:02:04.347 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:02:04.347 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:02:04.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:02:04.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:04.348 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:02:04.348 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:02:04.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:04.348 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:02:04.349 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:02:04.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:04.349 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:02:04.349 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:02:04.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:04.350 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:02:04.350 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:02:04.350 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:02:04.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:02:04.351 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:02:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.346+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 msgr2=0x7f5708067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.346+0000 7f572396e700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 0x7f5708067290 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f5718004630 tx=0x7f5718009b30).stop 2022-02-02T21:02:04.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.346+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 msgr2=0x7f571c106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.346+0000 7f572396e700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 rx=0x7f570c00c790 tx=0x7f570c007d70).stop 2022-02-02T21:02:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 shutdown_connections 2022-02-02T21:02:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5708064dd0 0x7f5708067290 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f571c0602b0 0x7f571c106f30 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 --2- 172.21.15.96:0/2864902540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f571c0f9880 0x7f571c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 >> 172.21.15.96:0/2864902540 conn(0x7f571c0f0d40 msgr2=0x7f571c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 shutdown_connections 2022-02-02T21:02:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.347+0000 7f572396e700 1 -- 172.21.15.96:0/2864902540 wait complete. 2022-02-02T21:02:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 -- 172.21.15.96:0/108646945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 msgr2=0x7fe7980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 --2- 172.21.15.96:0/108646945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe7980f7de0 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 rx=0x7fe788004660 tx=0x7fe788009b30).stop 2022-02-02T21:02:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 -- 172.21.15.96:0/108646945 shutdown_connections 2022-02-02T21:02:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 --2- 172.21.15.96:0/108646945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe7980f7de0 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 --2- 172.21.15.96:0/108646945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 0x7fe7980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 -- 172.21.15.96:0/108646945 >> 172.21.15.96:0/108646945 conn(0x7fe7980f1e40 msgr2=0x7fe7980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:04.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 -- 172.21.15.96:0/108646945 shutdown_connections 2022-02-02T21:02:04.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.444+0000 7fe79daba700 1 -- 172.21.15.96:0/108646945 wait complete. 2022-02-02T21:02:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 Processor -- start 2022-02-02T21:02:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 -- start start 2022-02-02T21:02:04.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 0x7fe79806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79806a380 con 0x7fe7980f7980 2022-02-02T21:02:04.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe79daba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79806a4c0 con 0x7fe7980f66e0 2022-02-02T21:02:04.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe796ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe796ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40478/0 (socket says 172.21.15.96:40478) 2022-02-02T21:02:04.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.445+0000 7fe796ffd700 1 -- 172.21.15.96:0/2516371426 learned_addr learned my addr 172.21.15.96:0/2516371426 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:04.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe7977fe700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 0x7fe79806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe796ffd700 1 -- 172.21.15.96:0/2516371426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 msgr2=0x7fe79806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe796ffd700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 0x7fe79806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe796ffd700 1 -- 172.21.15.96:0/2516371426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788005040 con 0x7fe7980f7980 2022-02-02T21:02:04.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe796ffd700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 rx=0x7fe788009990 tx=0x7fe788009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:04.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe788018070 con 0x7fe7980f7980 2022-02-02T21:02:04.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79806a740 con 0x7fe7980f7980 2022-02-02T21:02:04.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe788007ba0 con 0x7fe7980f7980 2022-02-02T21:02:04.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe78801c3c0 con 0x7fe7980f7980 2022-02-02T21:02:04.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.446+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79806aca0 con 0x7fe7980f7980 2022-02-02T21:02:04.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.447+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798045ad0 con 0x7fe7980f7980 2022-02-02T21:02:04.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.447+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe78801c680 con 0x7fe7980f7980 2022-02-02T21:02:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.448+0000 7fe77ffff700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 0x7fe780067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.448+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe788083770 con 0x7fe7980f7980 2022-02-02T21:02:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.448+0000 7fe7977fe700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 0x7fe780067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.448+0000 7fe7977fe700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 0x7fe780067290 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fe79806b730 tx=0x7fe78c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:04.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.452+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe788051870 con 0x7fe7980f7980 2022-02-02T21:02:04.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.653+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe798027a00 con 0x7fe7980f7980 2022-02-02T21:02:04.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.653+0000 7fe77ffff700 1 -- 172.21.15.96:0/2516371426 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe788054e90 con 0x7fe7980f7980 2022-02-02T21:02:04.656 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:02:04.656 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:02:04.656 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:02:04.657 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:02:04.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:04.657 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:02:04.657 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:02:04.658 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:02:04.658 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:02:04.658 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:02:04.658 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:02:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:02:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:02:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:02:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:02:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:02:04.660 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:02:04.660 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:02:04.660 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:02:04.660 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:02:04.661 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:02:04.661 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:02:04.661 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:02:04.662 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:02:04.662 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:02:04.662 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:02:04.662 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:02:04.662 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:02:04.663 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:02:04.663 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:02:04.663 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:02:04.663 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:02:04.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:04.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:04.664 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:02:04.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:04.664 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:04.665 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:04.665 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:04.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 msgr2=0x7fe780067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 0x7fe780067290 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fe79806b730 tx=0x7fe78c009c00).stop 2022-02-02T21:02:04.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 msgr2=0x7fe798069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:04.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 rx=0x7fe788009990 tx=0x7fe788009b30).stop 2022-02-02T21:02:04.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 shutdown_connections 2022-02-02T21:02:04.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe780064dd0 0x7fe780067290 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7980f66e0 0x7fe79806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 --2- 172.21.15.96:0/2516371426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7980f7980 0x7fe798069e20 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:04.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 >> 172.21.15.96:0/2516371426 conn(0x7fe7980f1e40 msgr2=0x7fe7980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:04.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 shutdown_connections 2022-02-02T21:02:04.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:04.655+0000 7fe79daba700 1 -- 172.21.15.96:0/2516371426 wait complete. 2022-02-02T21:02:04.669 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:02:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:04 smithi159 ceph-mon[69013]: pgmap v4799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:04 smithi159 ceph-mon[69013]: from='client.39026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2864902540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:02:05.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2516371426' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:02:05.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:04 smithi096 ceph-mon[101353]: pgmap v4799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:04 smithi096 ceph-mon[101353]: from='client.39026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2864902540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:02:05.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2516371426' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:02:06.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:05 smithi159 ceph-mon[69013]: from='client.39030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:06.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:05 smithi096 ceph-mon[101353]: from='client.39030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:06 smithi159 ceph-mon[69013]: pgmap v4800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:06 smithi096 ceph-mon[101353]: pgmap v4800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:08 smithi159 ceph-mon[69013]: pgmap v4801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:08 smithi096 ceph-mon[101353]: pgmap v4801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:10 smithi159 ceph-mon[69013]: pgmap v4802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:10 smithi096 ceph-mon[101353]: pgmap v4802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:12 smithi159 ceph-mon[69013]: pgmap v4803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:12 smithi096 ceph-mon[101353]: pgmap v4803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:14 smithi159 ceph-mon[69013]: pgmap v4804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:15.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:14 smithi096 ceph-mon[101353]: pgmap v4804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:16 smithi159 ceph-mon[69013]: pgmap v4805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:16 smithi096 ceph-mon[101353]: pgmap v4805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:18 smithi159 ceph-mon[69013]: pgmap v4806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:18 smithi096 ceph-mon[101353]: pgmap v4806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:21.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:20 smithi159 ceph-mon[69013]: pgmap v4807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:20 smithi096 ceph-mon[101353]: pgmap v4807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:23.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:22 smithi159 ceph-mon[69013]: pgmap v4808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:22 smithi096 ceph-mon[101353]: pgmap v4808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:24 smithi159 ceph-mon[69013]: pgmap v4809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:24 smithi096 ceph-mon[101353]: pgmap v4809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:26 smithi159 ceph-mon[69013]: pgmap v4810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:26 smithi096 ceph-mon[101353]: pgmap v4810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:02:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:02:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:28 smithi159 ceph-mon[69013]: pgmap v4811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:02:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:02:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:28 smithi096 ceph-mon[101353]: pgmap v4811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:31.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:30 smithi159 ceph-mon[69013]: pgmap v4812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:30 smithi096 ceph-mon[101353]: pgmap v4812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:32 smithi159 ceph-mon[69013]: pgmap v4813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:32 smithi096 ceph-mon[101353]: pgmap v4813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:34.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 -- 172.21.15.96:0/2567481130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f5430 msgr2=0x7f21e40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 --2- 172.21.15.96:0/2567481130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f5430 0x7f21e40f5850 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 rx=0x7f21d8004660 tx=0x7f21d8009b30).stop 2022-02-02T21:02:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 -- 172.21.15.96:0/2567481130 shutdown_connections 2022-02-02T21:02:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 --2- 172.21.15.96:0/2567481130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f66d0 0x7f21e40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 --2- 172.21.15.96:0/2567481130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f5430 0x7f21e40f5850 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 -- 172.21.15.96:0/2567481130 >> 172.21.15.96:0/2567481130 conn(0x7f21e40f0b90 msgr2=0x7f21e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:34.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 -- 172.21.15.96:0/2567481130 shutdown_connections 2022-02-02T21:02:34.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.766+0000 7f21e9890700 1 -- 172.21.15.96:0/2567481130 wait complete. 2022-02-02T21:02:34.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 Processor -- start 2022-02-02T21:02:34.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 -- start start 2022-02-02T21:02:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f5430 0x7f21e4105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4106760 con 0x7f21e40f66d0 2022-02-02T21:02:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.767+0000 7f21e9890700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4106f60 con 0x7f21e40f5430 2022-02-02T21:02:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40494/0 (socket says 172.21.15.96:40494) 2022-02-02T21:02:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 -- 172.21.15.96:0/2165960265 learned_addr learned my addr 172.21.15.96:0/2165960265 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e888e700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f5430 0x7f21e4105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 -- 172.21.15.96:0/2165960265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f5430 msgr2=0x7f21e4105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f5430 0x7f21e4105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 -- 172.21.15.96:0/2165960265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8005040 con 0x7f21e40f66d0 2022-02-02T21:02:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.768+0000 7f21e3fff700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 rx=0x7f21d000e7f0 tx=0x7f21d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:34.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.771+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d00092e0 con 0x7f21e40f66d0 2022-02-02T21:02:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.771+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21d000f040 con 0x7f21e40f66d0 2022-02-02T21:02:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.771+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e4107240 con 0x7f21e40f66d0 2022-02-02T21:02:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.771+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d0014750 con 0x7f21e40f66d0 2022-02-02T21:02:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.772+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e4107780 con 0x7f21e40f66d0 2022-02-02T21:02:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.773+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c4004fa0 con 0x7f21e40f66d0 2022-02-02T21:02:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.773+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21d001b030 con 0x7f21e40f66d0 2022-02-02T21:02:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.773+0000 7f21e17fa700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 0x7f21d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.773+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f21d00816d0 con 0x7f21e40f66d0 2022-02-02T21:02:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.774+0000 7f21e888e700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 0x7f21d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.774+0000 7f21e888e700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 0x7f21d40672e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f21d8004d80 tx=0x7f21d8016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.778+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21d00532b0 con 0x7f21e40f66d0 2022-02-02T21:02:34.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.956+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21c4000bc0 con 0x7f21d4064e20 2022-02-02T21:02:34.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.957+0000 7f21e17fa700 1 -- 172.21.15.96:0/2165960265 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f21c4000bc0 con 0x7f21d4064e20 2022-02-02T21:02:34.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 msgr2=0x7f21d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:34.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 0x7f21d40672e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f21d8004d80 tx=0x7f21d8016040).stop 2022-02-02T21:02:34.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 msgr2=0x7f21e41061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:34.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 rx=0x7f21d000e7f0 tx=0x7f21d000b040).stop 2022-02-02T21:02:34.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 shutdown_connections 2022-02-02T21:02:34.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21d4064e20 0x7f21d40672e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e40f5430 0x7f21e4105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 --2- 172.21.15.96:0/2165960265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e40f66d0 0x7f21e41061b0 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:34.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 >> 172.21.15.96:0/2165960265 conn(0x7f21e40f0b90 msgr2=0x7f21e40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:34.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 shutdown_connections 2022-02-02T21:02:34.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:34.959+0000 7f21e9890700 1 -- 172.21.15.96:0/2165960265 wait complete. 2022-02-02T21:02:34.970 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:02:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:34 smithi159 ceph-mon[69013]: pgmap v4814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:34 smithi096 ceph-mon[101353]: pgmap v4814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:35.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- 172.21.15.96:0/1586775710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 msgr2=0x7f85d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 --2- 172.21.15.96:0/1586775710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d00f59e0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 rx=0x7f85c0004660 tx=0x7f85c0009b30).stop 2022-02-02T21:02:35.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- 172.21.15.96:0/1586775710 shutdown_connections 2022-02-02T21:02:35.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 --2- 172.21.15.96:0/1586775710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 0x7f85d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 --2- 172.21.15.96:0/1586775710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d00f59e0 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- 172.21.15.96:0/1586775710 >> 172.21.15.96:0/1586775710 conn(0x7f85d00f0d40 msgr2=0x7f85d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- 172.21.15.96:0/1586775710 shutdown_connections 2022-02-02T21:02:35.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- 172.21.15.96:0/1586775710 wait complete. 2022-02-02T21:02:35.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 Processor -- start 2022-02-02T21:02:35.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.057+0000 7f85d6173700 1 -- start start 2022-02-02T21:02:35.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85d6173700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85d6173700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 0x7f85d010c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85d6173700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00603e0 con 0x7f85d00f55c0 2022-02-02T21:02:35.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85d6173700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0060520 con 0x7f85d00f6860 2022-02-02T21:02:35.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40502/0 (socket says 172.21.15.96:40502) 2022-02-02T21:02:35.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 -- 172.21.15.96:0/727968278 learned_addr learned my addr 172.21.15.96:0/727968278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:35.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85ceffd700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 0x7f85d010c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 -- 172.21.15.96:0/727968278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 msgr2=0x7f85d010c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 0x7f85d010c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 -- 172.21.15.96:0/727968278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0005040 con 0x7f85d00f55c0 2022-02-02T21:02:35.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85cf7fe700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 rx=0x7f85c0013a70 tx=0x7f85c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c0018070 con 0x7f85d00f55c0 2022-02-02T21:02:35.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.058+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85c00097d0 con 0x7f85d00f55c0 2022-02-02T21:02:35.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.059+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c001de80 con 0x7f85d00f55c0 2022-02-02T21:02:35.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.059+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d010c650 con 0x7f85d00f55c0 2022-02-02T21:02:35.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.059+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d010cbb0 con 0x7f85d00f55c0 2022-02-02T21:02:35.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.059+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0045ad0 con 0x7f85d00f55c0 2022-02-02T21:02:35.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.060+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85c0007ba0 con 0x7f85d00f55c0 2022-02-02T21:02:35.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.060+0000 7f85b7fff700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 0x7f85b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.060+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85c0083650 con 0x7f85d00f55c0 2022-02-02T21:02:35.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.060+0000 7f85ceffd700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 0x7f85b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.061+0000 7f85ceffd700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 0x7f85b8067290 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f85c4004c40 tx=0x7f85c400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.065+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85c0051750 con 0x7f85d00f55c0 2022-02-02T21:02:35.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.239+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d00fde60 con 0x7f85b8064dd0 2022-02-02T21:02:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.248+0000 7f85b7fff700 1 -- 172.21.15.96:0/727968278 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f85d00fde60 con 0x7f85b8064dd0 2022-02-02T21:02:35.389 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:02:35.390 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:02:35.390 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:02:35.390 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:02:35.390 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:02:35.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:02:35.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:02:35.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:02:35.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:02:35.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:02:35.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:02:35.392 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:02:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:02:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:02:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:02:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:02:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:02:35.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:02:35.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:02:35.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:02:35.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:02:35.395 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:02:35.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 msgr2=0x7f85b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 0x7f85b8067290 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f85c4004c40 tx=0x7f85c400b040).stop 2022-02-02T21:02:35.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 msgr2=0x7f85d0109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 rx=0x7f85c0013a70 tx=0x7f85c0009b30).stop 2022-02-02T21:02:35.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 shutdown_connections 2022-02-02T21:02:35.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b8064dd0 0x7f85b8067290 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85d00f55c0 0x7f85d0109c00 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 --2- 172.21.15.96:0/727968278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d00f6860 0x7f85d010c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 >> 172.21.15.96:0/727968278 conn(0x7f85d00f0d40 msgr2=0x7f85d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 shutdown_connections 2022-02-02T21:02:35.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.251+0000 7f85d6173700 1 -- 172.21.15.96:0/727968278 wait complete. 2022-02-02T21:02:35.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- 172.21.15.96:0/250087868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500fba70 msgr2=0x7f82500fde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 --2- 172.21.15.96:0/250087868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500fba70 0x7f82500fde60 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 rx=0x7f8244004660 tx=0x7f8244009b30).stop 2022-02-02T21:02:35.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- 172.21.15.96:0/250087868 shutdown_connections 2022-02-02T21:02:35.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 --2- 172.21.15.96:0/250087868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500fba70 0x7f82500fde60 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 --2- 172.21.15.96:0/250087868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500602b0 0x7f82500fb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- 172.21.15.96:0/250087868 >> 172.21.15.96:0/250087868 conn(0x7f82500f0ba0 msgr2=0x7f82500f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- 172.21.15.96:0/250087868 shutdown_connections 2022-02-02T21:02:35.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- 172.21.15.96:0/250087868 wait complete. 2022-02-02T21:02:35.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 Processor -- start 2022-02-02T21:02:35.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.348+0000 7f82555c3700 1 -- start start 2022-02-02T21:02:35.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f82555c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f82555c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 0x7f82500f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f82555c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500f8010 con 0x7f82500602b0 2022-02-02T21:02:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f82555c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500f8150 con 0x7f82500fba70 2022-02-02T21:02:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40512/0 (socket says 172.21.15.96:40512) 2022-02-02T21:02:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 -- 172.21.15.96:0/3266657032 learned_addr learned my addr 172.21.15.96:0/3266657032 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824f7fe700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 0x7f82500f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 -- 172.21.15.96:0/3266657032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 msgr2=0x7f82500f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 0x7f82500f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 -- 172.21.15.96:0/3266657032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244005040 con 0x7f82500602b0 2022-02-02T21:02:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824f7fe700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 0x7f82500f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:02:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.349+0000 7f824ffff700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 rx=0x7f824000c530 tx=0x7f8240007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.350+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f824000f650 con 0x7f82500602b0 2022-02-02T21:02:35.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.350+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500f8ac0 con 0x7f82500602b0 2022-02-02T21:02:35.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.350+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f824000fc60 con 0x7f82500602b0 2022-02-02T21:02:35.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.350+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8240012cd0 con 0x7f82500602b0 2022-02-02T21:02:35.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.350+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500f9080 con 0x7f82500602b0 2022-02-02T21:02:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.351+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250045ad0 con 0x7f82500602b0 2022-02-02T21:02:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.352+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8240010070 con 0x7f82500602b0 2022-02-02T21:02:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.353+0000 7f824cff9700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 0x7f82380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.353+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8240081870 con 0x7f82500602b0 2022-02-02T21:02:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.353+0000 7f824f7fe700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 0x7f82380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.353+0000 7f824f7fe700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 0x7f82380672e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f8244013690 tx=0x7f8244009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.357+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f824004f8b0 con 0x7f82500602b0 2022-02-02T21:02:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.589+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82500f92a0 con 0x7f82500602b0 2022-02-02T21:02:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.589+0000 7f824cff9700 1 -- 172.21.15.96:0/3266657032 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8240052ed0 con 0x7f82500602b0 2022-02-02T21:02:35.592 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:02:35.592 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:02:35.592 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:02:35.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:35.593 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:02:35.594 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:02:35.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:35.595 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:02:35.595 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:02:35.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:35.596 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:02:35.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:02:35.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:02:35.597 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:02:35.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:02:35.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:02:35.599 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:02:35.599 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:02:35.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 msgr2=0x7f82380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 0x7f82380672e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f8244013690 tx=0x7f8244009b30).stop 2022-02-02T21:02:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 msgr2=0x7f82500f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 rx=0x7f824000c530 tx=0x7f8240007e20).stop 2022-02-02T21:02:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 shutdown_connections 2022-02-02T21:02:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8238064e20 0x7f82380672e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82500602b0 0x7f82500f7520 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 --2- 172.21.15.96:0/3266657032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82500fba70 0x7f82500f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 >> 172.21.15.96:0/3266657032 conn(0x7f82500f0ba0 msgr2=0x7f82500f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 shutdown_connections 2022-02-02T21:02:35.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.591+0000 7f82555c3700 1 -- 172.21.15.96:0/3266657032 wait complete. 2022-02-02T21:02:35.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 -- 172.21.15.96:0/3440779633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f7590 msgr2=0x7f1de80f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 --2- 172.21.15.96:0/3440779633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f7590 0x7f1de80f59b0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 rx=0x7f1dd8004660 tx=0x7f1dd8009b30).stop 2022-02-02T21:02:35.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 -- 172.21.15.96:0/3440779633 shutdown_connections 2022-02-02T21:02:35.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 --2- 172.21.15.96:0/3440779633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f7590 0x7f1de80f59b0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 --2- 172.21.15.96:0/3440779633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 -- 172.21.15.96:0/3440779633 >> 172.21.15.96:0/3440779633 conn(0x7f1de80f04c0 msgr2=0x7f1de80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 -- 172.21.15.96:0/3440779633 shutdown_connections 2022-02-02T21:02:35.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.689+0000 7f1decb58700 1 -- 172.21.15.96:0/3440779633 wait complete. 2022-02-02T21:02:35.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 Processor -- start 2022-02-02T21:02:35.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 -- start start 2022-02-02T21:02:35.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 0x7f1de80f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de810ac70 con 0x7f1de80f6bf0 2022-02-02T21:02:35.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1decb58700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de810adb0 con 0x7f1de80f7590 2022-02-02T21:02:35.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40522/0 (socket says 172.21.15.96:40522) 2022-02-02T21:02:35.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 -- 172.21.15.96:0/1324135573 learned_addr learned my addr 172.21.15.96:0/1324135573 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:02:35.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de5d9b700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 0x7f1de80f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 -- 172.21.15.96:0/1324135573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 msgr2=0x7f1de80f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 0x7f1de80f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de659c700 1 -- 172.21.15.96:0/1324135573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8005040 con 0x7f1de80f6bf0 2022-02-02T21:02:35.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.690+0000 7f1de5d9b700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 0x7f1de80f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:02:35.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1de659c700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 rx=0x7f1ddc00c530 tx=0x7f1ddc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc00f650 con 0x7f1de80f6bf0 2022-02-02T21:02:35.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ddc00fc60 con 0x7f1de80f6bf0 2022-02-02T21:02:35.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de80f8290 con 0x7f1de80f6bf0 2022-02-02T21:02:35.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc012cb0 con 0x7f1de80f6bf0 2022-02-02T21:02:35.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.691+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80f8850 con 0x7f1de80f6bf0 2022-02-02T21:02:35.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.692+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8045ad0 con 0x7f1de80f6bf0 2022-02-02T21:02:35.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.693+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ddc019030 con 0x7f1de80f6bf0 2022-02-02T21:02:35.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.693+0000 7f1dd6ffd700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 0x7f1dd0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:02:35.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.694+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ddc081a10 con 0x7f1de80f6bf0 2022-02-02T21:02:35.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.694+0000 7f1de5d9b700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 0x7f1dd0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:02:35.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.694+0000 7f1de5d9b700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 0x7f1dd0067290 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1dd8004580 tx=0x7f1dd8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:02:35.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.697+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ddc04fca0 con 0x7f1de80f6bf0 2022-02-02T21:02:35.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.898+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1de8113cc0 con 0x7f1de80f6bf0 2022-02-02T21:02:35.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.899+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/1324135573 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1ddc021720 con 0x7f1de80f6bf0 2022-02-02T21:02:35.901 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:02:35.901 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:02:35.902 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:02:35.902 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:02:35.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:35.902 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:02:35.903 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:02:35.903 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:02:35.903 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:02:35.903 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:02:35.904 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:02:35.904 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:02:35.904 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:02:35.904 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:02:35.905 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:02:35.905 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:02:35.905 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:02:35.905 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:02:35.906 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:02:35.906 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:02:35.906 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:02:35.906 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:02:35.906 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:02:35.907 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:02:35.907 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:02:35.907 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:02:35.907 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:02:35.908 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:02:35.908 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:02:35.908 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:02:35.908 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:02:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:02:35.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:35.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:35.909 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:02:35.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:02:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:35.910 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:02:35.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 msgr2=0x7f1dd0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 0x7f1dd0067290 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1dd8004580 tx=0x7f1dd8009b30).stop 2022-02-02T21:02:35.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 msgr2=0x7f1de80f9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:02:35.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 rx=0x7f1ddc00c530 tx=0x7f1ddc007e10).stop 2022-02-02T21:02:35.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 shutdown_connections 2022-02-02T21:02:35.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dd0064dd0 0x7f1dd0067290 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de80f6bf0 0x7f1de80f9860 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 --2- 172.21.15.96:0/1324135573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80f7590 0x7f1de80f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:02:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 >> 172.21.15.96:0/1324135573 conn(0x7f1de80f04c0 msgr2=0x7f1de80f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:02:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 shutdown_connections 2022-02-02T21:02:35.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:02:35.902+0000 7f1decb58700 1 -- 172.21.15.96:0/1324135573 wait complete. 2022-02-02T21:02:35.914 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:02:36.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:35 smithi096 ceph-mon[101353]: from='client.39042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:36.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3266657032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:02:36.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:35 smithi159 ceph-mon[69013]: from='client.39042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:36.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3266657032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:02:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:36 smithi096 ceph-mon[101353]: from='client.39046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:36 smithi096 ceph-mon[101353]: pgmap v4815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1324135573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:02:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:36 smithi159 ceph-mon[69013]: from='client.39046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:02:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:36 smithi159 ceph-mon[69013]: pgmap v4815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1324135573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:02:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:38 smithi159 ceph-mon[69013]: pgmap v4816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:38 smithi096 ceph-mon[101353]: pgmap v4816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:40 smithi159 ceph-mon[69013]: pgmap v4817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:40 smithi096 ceph-mon[101353]: pgmap v4817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:43.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:42 smithi159 ceph-mon[69013]: pgmap v4818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:42 smithi096 ceph-mon[101353]: pgmap v4818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:44 smithi159 ceph-mon[69013]: pgmap v4819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:44 smithi096 ceph-mon[101353]: pgmap v4819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:46 smithi159 ceph-mon[69013]: pgmap v4820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:46 smithi096 ceph-mon[101353]: pgmap v4820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:48 smithi159 ceph-mon[69013]: pgmap v4821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:48 smithi096 ceph-mon[101353]: pgmap v4821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:50 smithi159 ceph-mon[69013]: pgmap v4822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:50 smithi096 ceph-mon[101353]: pgmap v4822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:52 smithi159 ceph-mon[69013]: pgmap v4823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:52 smithi096 ceph-mon[101353]: pgmap v4823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:54 smithi159 ceph-mon[69013]: pgmap v4824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:54 smithi096 ceph-mon[101353]: pgmap v4824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:56 smithi096 ceph-mon[101353]: pgmap v4825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:56 smithi159 ceph-mon[69013]: pgmap v4825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:02:58 smithi159 ceph-mon[69013]: pgmap v4826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:02:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:02:58 smithi096 ceph-mon[101353]: pgmap v4826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:00 smithi159 ceph-mon[69013]: pgmap v4827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:00 smithi096 ceph-mon[101353]: pgmap v4827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:02 smithi159 ceph-mon[69013]: pgmap v4828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:02 smithi096 ceph-mon[101353]: pgmap v4828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:04 smithi096 ceph-mon[101353]: pgmap v4829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:04 smithi159 ceph-mon[69013]: pgmap v4829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:06.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 -- 172.21.15.96:0/371396391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f66e0 msgr2=0x7fd6d80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/371396391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f66e0 0x7fd6d80f6b00 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 rx=0x7fd6c8004660 tx=0x7fd6c8009b30).stop 2022-02-02T21:03:06.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 -- 172.21.15.96:0/371396391 shutdown_connections 2022-02-02T21:03:06.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/371396391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f7980 0x7fd6d80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:03:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/371396391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f66e0 0x7fd6d80f6b00 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 -- 172.21.15.96:0/371396391 >> 172.21.15.96:0/371396391 conn(0x7fd6d80f1e40 msgr2=0x7fd6d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 -- 172.21.15.96:0/371396391 shutdown_connections 2022-02-02T21:03:06.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.008+0000 7fd6dd20d700 1 -- 172.21.15.96:0/371396391 wait complete. 2022-02-02T21:03:06.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 Processor -- start 2022-02-02T21:03:06.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 -- start start 2022-02-02T21:03:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f66e0 0x7fd6d8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8107ae0 con 0x7fd6d80f7980 2022-02-02T21:03:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6dd20d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8108390 con 0x7fd6d80f66e0 2022-02-02T21:03:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40542/0 (socket says 172.21.15.96:40542) 2022-02-02T21:03:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 -- 172.21.15.96:0/225814409 learned_addr learned my addr 172.21.15.96:0/225814409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d6d9d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f66e0 0x7fd6d8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 -- 172.21.15.96:0/225814409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f66e0 msgr2=0x7fd6d8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f66e0 0x7fd6d8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.009+0000 7fd6d659c700 1 -- 172.21.15.96:0/225814409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8005040 con 0x7fd6d80f7980 2022-02-02T21:03:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6d659c700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 rx=0x7fd6cc00b410 tx=0x7fd6cc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6cc0125f0 con 0x7fd6d80f7980 2022-02-02T21:03:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6cc00be30 con 0x7fd6d80f7980 2022-02-02T21:03:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d8108670 con 0x7fd6d80f7980 2022-02-02T21:03:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6cc002a70 con 0x7fd6d80f7980 2022-02-02T21:03:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.010+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d8108c30 con 0x7fd6d80f7980 2022-02-02T21:03:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.011+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80f5ad0 con 0x7fd6d80f7980 2022-02-02T21:03:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.011+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6cc00f030 con 0x7fd6d80f7980 2022-02-02T21:03:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.012+0000 7fd6bf7fe700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 0x7fd6c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.012+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd6cc081da0 con 0x7fd6d80f7980 2022-02-02T21:03:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.012+0000 7fd6d6d9d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 0x7fd6c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.012+0000 7fd6d6d9d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 0x7fd6c0067290 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fd6c8004630 tx=0x7fd6c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.016+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6cc0538d0 con 0x7fd6d80f7980 2022-02-02T21:03:06.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.193+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d80fef90 con 0x7fd6c0064dd0 2022-02-02T21:03:06.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.194+0000 7fd6bf7fe700 1 -- 172.21.15.96:0/225814409 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd6d80fef90 con 0x7fd6c0064dd0 2022-02-02T21:03:06.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 msgr2=0x7fd6c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 0x7fd6c0067290 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fd6c8004630 tx=0x7fd6c8009b30).stop 2022-02-02T21:03:06.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 msgr2=0x7fd6d81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 rx=0x7fd6cc00b410 tx=0x7fd6cc006ef0).stop 2022-02-02T21:03:06.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 shutdown_connections 2022-02-02T21:03:06.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c0064dd0 0x7fd6c0067290 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f66e0 0x7fd6d8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 --2- 172.21.15.96:0/225814409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f7980 0x7fd6d81074a0 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 >> 172.21.15.96:0/225814409 conn(0x7fd6d80f1e40 msgr2=0x7fd6d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 shutdown_connections 2022-02-02T21:03:06.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.196+0000 7fd6dd20d700 1 -- 172.21.15.96:0/225814409 wait complete. 2022-02-02T21:03:06.207 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:03:06.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 -- 172.21.15.96:0/1392057329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 msgr2=0x7f50440f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1392057329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 0x7f50440f6b40 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 rx=0x7f5038004660 tx=0x7f5038009b30).stop 2022-02-02T21:03:06.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 -- 172.21.15.96:0/1392057329 shutdown_connections 2022-02-02T21:03:06.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1392057329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 0x7f50440f6b40 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1392057329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f5440 0x7f50440f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 -- 172.21.15.96:0/1392057329 >> 172.21.15.96:0/1392057329 conn(0x7f50440f0ba0 msgr2=0x7f50440f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 -- 172.21.15.96:0/1392057329 shutdown_connections 2022-02-02T21:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.293+0000 7f5048b4d700 1 -- 172.21.15.96:0/1392057329 wait complete. 2022-02-02T21:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 Processor -- start 2022-02-02T21:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 -- start start 2022-02-02T21:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f50441061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044106770 con 0x7f50440f5440 2022-02-02T21:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.294+0000 7f5048b4d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044106f70 con 0x7f50440f66e0 2022-02-02T21:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f50437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f5042ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f50441061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f50437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40550/0 (socket says 172.21.15.96:40550) 2022-02-02T21:03:06.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f50437fe700 1 -- 172.21.15.96:0/1750147125 learned_addr learned my addr 172.21.15.96:0/1750147125 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:06.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f5042ffd700 1 -- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 msgr2=0x7f5044105cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f5042ffd700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f5042ffd700 1 -- 172.21.15.96:0/1750147125 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f50440f66e0 2022-02-02T21:03:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f50437fe700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:03:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.295+0000 7f5042ffd700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f50441061c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5038000c00 tx=0x7f5038009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.296+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038018070 con 0x7f50440f66e0 2022-02-02T21:03:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.296+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50441071f0 con 0x7f50440f66e0 2022-02-02T21:03:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.296+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044107750 con 0x7f50440f66e0 2022-02-02T21:03:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.296+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f50380097d0 con 0x7f50440f66e0 2022-02-02T21:03:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.296+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503801db80 con 0x7f50440f66e0 2022-02-02T21:03:06.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.297+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024004fa0 con 0x7f50440f66e0 2022-02-02T21:03:06.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.297+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5038027440 con 0x7f50440f66e0 2022-02-02T21:03:06.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.297+0000 7f502bfff700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 0x7f502c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.297+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5038083360 con 0x7f50440f66e0 2022-02-02T21:03:06.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.297+0000 7f50437fe700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 0x7f502c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.298+0000 7f50437fe700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 0x7f502c0672e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f50340102e0 tx=0x7f503400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.302+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5038054e90 con 0x7f50440f66e0 2022-02-02T21:03:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.474+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5024000bc0 con 0x7f502c064e20 2022-02-02T21:03:06.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.484+0000 7f502bfff700 1 -- 172.21.15.96:0/1750147125 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5024000bc0 con 0x7f502c064e20 2022-02-02T21:03:06.485 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:03:06.485 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:03:06.486 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:03:06.486 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:03:06.486 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:03:06.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:03:06.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:03:06.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:03:06.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:03:06.488 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:03:06.488 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:03:06.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:03:06.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:03:06.488 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:03:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:03:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:03:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:03:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:03:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:03:06.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:03:06.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:03:06.490 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:03:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 msgr2=0x7f502c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 0x7f502c0672e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f50340102e0 tx=0x7f503400b040).stop 2022-02-02T21:03:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 msgr2=0x7f50441061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f50441061c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5038000c00 tx=0x7f5038009b30).stop 2022-02-02T21:03:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 shutdown_connections 2022-02-02T21:03:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f502c064e20 0x7f502c0672e0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f5440 0x7f5044105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 --2- 172.21.15.96:0/1750147125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f50441061c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 >> 172.21.15.96:0/1750147125 conn(0x7f50440f0ba0 msgr2=0x7f50440fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 shutdown_connections 2022-02-02T21:03:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.486+0000 7f5048b4d700 1 -- 172.21.15.96:0/1750147125 wait complete. 2022-02-02T21:03:06.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 -- 172.21.15.96:0/4048684319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f55c0 msgr2=0x7fe30c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 --2- 172.21.15.96:0/4048684319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f55c0 0x7fe30c0f59e0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 rx=0x7fe2f4004660 tx=0x7fe2f4009b30).stop 2022-02-02T21:03:06.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 -- 172.21.15.96:0/4048684319 shutdown_connections 2022-02-02T21:03:06.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 --2- 172.21.15.96:0/4048684319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f6860 0x7fe30c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 --2- 172.21.15.96:0/4048684319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f55c0 0x7fe30c0f59e0 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 -- 172.21.15.96:0/4048684319 >> 172.21.15.96:0/4048684319 conn(0x7fe30c0f0d40 msgr2=0x7fe30c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 -- 172.21.15.96:0/4048684319 shutdown_connections 2022-02-02T21:03:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.584+0000 7fe310c24700 1 -- 172.21.15.96:0/4048684319 wait complete. 2022-02-02T21:03:06.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 Processor -- start 2022-02-02T21:03:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 -- start start 2022-02-02T21:03:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f55c0 0x7fe30c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0603e0 con 0x7fe30c0f6860 2022-02-02T21:03:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe310c24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c060520 con 0x7fe30c0f55c0 2022-02-02T21:03:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40562/0 (socket says 172.21.15.96:40562) 2022-02-02T21:03:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 -- 172.21.15.96:0/4273264525 learned_addr learned my addr 172.21.15.96:0/4273264525 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe30a59c700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f55c0 0x7fe30c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 -- 172.21.15.96:0/4273264525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f55c0 msgr2=0x7fe30c109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f55c0 0x7fe30c109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 -- 172.21.15.96:0/4273264525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4005040 con 0x7fe30c0f6860 2022-02-02T21:03:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe309d9b700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 rx=0x7fe2fc0026d0 tx=0x7fe2fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.585+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2fc0079c0 con 0x7fe30c0f6860 2022-02-02T21:03:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.586+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2fc00f040 con 0x7fe30c0f6860 2022-02-02T21:03:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.586+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c10c760 con 0x7fe30c0f6860 2022-02-02T21:03:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.586+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2fc0137c0 con 0x7fe30c0f6860 2022-02-02T21:03:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.586+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c10cd20 con 0x7fe30c0f6860 2022-02-02T21:03:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.587+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c045ad0 con 0x7fe30c0f6860 2022-02-02T21:03:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.587+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2fc0090d0 con 0x7fe30c0f6860 2022-02-02T21:03:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.587+0000 7fe302ffd700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 0x7fe2f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.587+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2fc0819a0 con 0x7fe30c0f6860 2022-02-02T21:03:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.587+0000 7fe30a59c700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 0x7fe2f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.588+0000 7fe30a59c700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 0x7fe2f8067290 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fe2f4013690 tx=0x7fe2f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.591+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2fc04fa40 con 0x7fe30c0f6860 2022-02-02T21:03:06.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.831+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe30c027a00 con 0x7fe30c0f6860 2022-02-02T21:03:06.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.831+0000 7fe302ffd700 1 -- 172.21.15.96:0/4273264525 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe2fc053060 con 0x7fe30c0f6860 2022-02-02T21:03:06.833 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:03:06.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:03:06.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:03:06.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:06.834 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:03:06.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:03:06.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:06.835 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:03:06.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:03:06.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:06.835 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:03:06.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:03:06.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:06.836 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:03:06.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:03:06.837 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:03:06.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:03:06.837 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:03:06.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 msgr2=0x7fe2f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 0x7fe2f8067290 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fe2f4013690 tx=0x7fe2f4009b30).stop 2022-02-02T21:03:06.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 msgr2=0x7fe30c10c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 rx=0x7fe2fc0026d0 tx=0x7fe2fc009de0).stop 2022-02-02T21:03:06.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 shutdown_connections 2022-02-02T21:03:06.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2f8064dd0 0x7fe2f8067290 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c0f55c0 0x7fe30c109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 --2- 172.21.15.96:0/4273264525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe30c0f6860 0x7fe30c10c1b0 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 >> 172.21.15.96:0/4273264525 conn(0x7fe30c0f0d40 msgr2=0x7fe30c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 shutdown_connections 2022-02-02T21:03:06.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.833+0000 7fe310c24700 1 -- 172.21.15.96:0/4273264525 wait complete. 2022-02-02T21:03:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.929+0000 7fb79a161700 1 -- 172.21.15.96:0/2419663403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f6860 msgr2=0x7fb7940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.929+0000 7fb79a161700 1 --2- 172.21.15.96:0/2419663403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f6860 0x7fb7940f6cc0 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 rx=0x7fb788004660 tx=0x7fb788009b30).stop 2022-02-02T21:03:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 -- 172.21.15.96:0/2419663403 shutdown_connections 2022-02-02T21:03:06.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 --2- 172.21.15.96:0/2419663403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f6860 0x7fb7940f6cc0 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 --2- 172.21.15.96:0/2419663403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f55c0 0x7fb7940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 -- 172.21.15.96:0/2419663403 >> 172.21.15.96:0/2419663403 conn(0x7fb7940f0d40 msgr2=0x7fb7940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:06.933 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:06 smithi096 ceph-mon[101353]: pgmap v4830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 -- 172.21.15.96:0/2419663403 shutdown_connections 2022-02-02T21:03:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 -- 172.21.15.96:0/2419663403 wait complete. 2022-02-02T21:03:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 Processor -- start 2022-02-02T21:03:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.930+0000 7fb79a161700 1 -- start start 2022-02-02T21:03:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f6860 0x7fb794107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794107a10 con 0x7fb7940f55c0 2022-02-02T21:03:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794107b50 con 0x7fb7940f6860 2022-02-02T21:03:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40570/0 (socket says 172.21.15.96:40570) 2022-02-02T21:03:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 -- 172.21.15.96:0/1918273475 learned_addr learned my addr 172.21.15.96:0/1918273475 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb792ffd700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f6860 0x7fb794107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 -- 172.21.15.96:0/1918273475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f6860 msgr2=0x7fb794107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f6860 0x7fb794107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:06.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 -- 172.21.15.96:0/1918273475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788005040 con 0x7fb7940f55c0 2022-02-02T21:03:06.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb7937fe700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 rx=0x7fb78400c530 tx=0x7fb784007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78400f650 con 0x7fb7940f55c0 2022-02-02T21:03:06.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7941084f0 con 0x7fb7940f55c0 2022-02-02T21:03:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb78400fc60 con 0x7fb7940f55c0 2022-02-02T21:03:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb784012d20 con 0x7fb7940f55c0 2022-02-02T21:03:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.931+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb794108ab0 con 0x7fb7940f55c0 2022-02-02T21:03:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.933+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb794045ad0 con 0x7fb7940f55c0 2022-02-02T21:03:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.933+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb784019030 con 0x7fb7940f55c0 2022-02-02T21:03:06.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.934+0000 7fb77bfff700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 0x7fb77c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:06.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.934+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb784081710 con 0x7fb7940f55c0 2022-02-02T21:03:06.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.934+0000 7fb792ffd700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 0x7fb77c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:06.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.934+0000 7fb792ffd700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 0x7fb77c067290 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fb788004e30 tx=0x7fb788009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:06.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:06.939+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb784053290 con 0x7fb7940f55c0 2022-02-02T21:03:07.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.139+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb79410d590 con 0x7fb7940f55c0 2022-02-02T21:03:07.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.140+0000 7fb77bfff700 1 -- 172.21.15.96:0/1918273475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb784052e80 con 0x7fb7940f55c0 2022-02-02T21:03:07.141 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:03:07.142 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:03:07.142 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:03:07.142 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:03:07.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:07.143 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:03:07.143 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:03:07.143 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:03:07.143 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:03:07.144 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:03:07.144 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:03:07.144 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:03:07.144 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:03:07.145 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:03:07.145 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:03:07.145 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:03:07.145 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:03:07.146 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:03:07.146 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:03:07.146 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:03:07.146 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:03:07.147 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:03:07.147 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:03:07.147 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:03:07.147 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:03:07.148 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:03:07.148 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:03:07.148 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:03:07.148 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:03:07.149 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:03:07.149 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:03:07.149 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:03:07.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:07.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:03:07.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:07.151 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:07.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 msgr2=0x7fb77c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:07.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 0x7fb77c067290 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fb788004e30 tx=0x7fb788009b30).stop 2022-02-02T21:03:07.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 msgr2=0x7fb794106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:07.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 rx=0x7fb78400c530 tx=0x7fb784007e10).stop 2022-02-02T21:03:07.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 shutdown_connections 2022-02-02T21:03:07.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb77c064dd0 0x7fb77c067290 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:07.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7940f55c0 0x7fb794106f70 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:07.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 --2- 172.21.15.96:0/1918273475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7940f6860 0x7fb794107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:07.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.141+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 >> 172.21.15.96:0/1918273475 conn(0x7fb7940f0d40 msgr2=0x7fb79405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:07.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.142+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 shutdown_connections 2022-02-02T21:03:07.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:07.142+0000 7fb79a161700 1 -- 172.21.15.96:0/1918273475 wait complete. 2022-02-02T21:03:07.155 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:03:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:06 smithi159 ceph-mon[69013]: pgmap v4830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:07 smithi096 ceph-mon[101353]: from='client.39058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:07 smithi096 ceph-mon[101353]: from='client.47243 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4273264525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:03:08.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1918273475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:03:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:07 smithi159 ceph-mon[69013]: from='client.39058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:07 smithi159 ceph-mon[69013]: from='client.47243 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4273264525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:03:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1918273475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:03:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:08 smithi096 ceph-mon[101353]: pgmap v4831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:08 smithi159 ceph-mon[69013]: pgmap v4831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:10 smithi096 ceph-mon[101353]: pgmap v4832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:10 smithi159 ceph-mon[69013]: pgmap v4832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:12 smithi096 ceph-mon[101353]: pgmap v4833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:12 smithi159 ceph-mon[69013]: pgmap v4833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:14 smithi096 ceph-mon[101353]: pgmap v4834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:14 smithi159 ceph-mon[69013]: pgmap v4834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:16 smithi096 ceph-mon[101353]: pgmap v4835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:16 smithi159 ceph-mon[69013]: pgmap v4835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:18 smithi159 ceph-mon[69013]: pgmap v4836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:18 smithi096 ceph-mon[101353]: pgmap v4836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:20 smithi096 ceph-mon[101353]: pgmap v4837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:20 smithi159 ceph-mon[69013]: pgmap v4837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:22 smithi096 ceph-mon[101353]: pgmap v4838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:22 smithi159 ceph-mon[69013]: pgmap v4838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:24 smithi096 ceph-mon[101353]: pgmap v4839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:24 smithi159 ceph-mon[69013]: pgmap v4839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:26 smithi096 ceph-mon[101353]: pgmap v4840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:26 smithi159 ceph-mon[69013]: pgmap v4840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:03:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:03:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:28 smithi159 ceph-mon[69013]: pgmap v4841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:03:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:03:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:28 smithi096 ceph-mon[101353]: pgmap v4841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:30 smithi096 ceph-mon[101353]: pgmap v4842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:30 smithi159 ceph-mon[69013]: pgmap v4842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:32 smithi096 ceph-mon[101353]: pgmap v4843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:32 smithi159 ceph-mon[69013]: pgmap v4843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:34 smithi096 ceph-mon[101353]: pgmap v4844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:34 smithi159 ceph-mon[69013]: pgmap v4844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:36 smithi096 ceph-mon[101353]: pgmap v4845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:37.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 -- 172.21.15.96:0/2744902584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f4ac0 msgr2=0x7f47080f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 --2- 172.21.15.96:0/2744902584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f4ac0 0x7f47080f4ee0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 rx=0x7f46f0004660 tx=0x7f46f0009b30).stop 2022-02-02T21:03:37.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 -- 172.21.15.96:0/2744902584 shutdown_connections 2022-02-02T21:03:37.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 --2- 172.21.15.96:0/2744902584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f53d0 0x7f47080f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 --2- 172.21.15.96:0/2744902584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f4ac0 0x7f47080f4ee0 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 -- 172.21.15.96:0/2744902584 >> 172.21.15.96:0/2744902584 conn(0x7f47080f0540 msgr2=0x7f47080f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 -- 172.21.15.96:0/2744902584 shutdown_connections 2022-02-02T21:03:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.251+0000 7f470cac4700 1 -- 172.21.15.96:0/2744902584 wait complete. 2022-02-02T21:03:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 Processor -- start 2022-02-02T21:03:37.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 -- start start 2022-02-02T21:03:37.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f4ac0 0x7f47080f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080f6090 con 0x7f47080f53d0 2022-02-02T21:03:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f470cac4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080f61d0 con 0x7f47080f4ac0 2022-02-02T21:03:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f4705d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f4705d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40592/0 (socket says 172.21.15.96:40592) 2022-02-02T21:03:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.252+0000 7f4705d9b700 1 -- 172.21.15.96:0/3862946734 learned_addr learned my addr 172.21.15.96:0/3862946734 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f470659c700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f4ac0 0x7f47080f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f4705d9b700 1 -- 172.21.15.96:0/3862946734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f4ac0 msgr2=0x7f47080f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f4705d9b700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f4ac0 0x7f47080f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f4705d9b700 1 -- 172.21.15.96:0/3862946734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0005040 con 0x7f47080f53d0 2022-02-02T21:03:37.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f4705d9b700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 rx=0x7f46f80026d0 tx=0x7f46f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f80079c0 con 0x7f47080f53d0 2022-02-02T21:03:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080f64b0 con 0x7f47080f53d0 2022-02-02T21:03:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46f800f040 con 0x7f47080f53d0 2022-02-02T21:03:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f80148b0 con 0x7f47080f53d0 2022-02-02T21:03:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.253+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470810f1e0 con 0x7f47080f53d0 2022-02-02T21:03:37.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.254+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708045ad0 con 0x7f47080f53d0 2022-02-02T21:03:37.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.254+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f46f8007b20 con 0x7f47080f53d0 2022-02-02T21:03:37.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.255+0000 7f46feffd700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 0x7f46f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.255+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f46f80819e0 con 0x7f47080f53d0 2022-02-02T21:03:37.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.255+0000 7f470659c700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 0x7f46f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.255+0000 7f470659c700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 0x7f46f4067290 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f46f0004630 tx=0x7f46f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.259+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46f804fae0 con 0x7f47080f53d0 2022-02-02T21:03:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:36 smithi159 ceph-mon[69013]: pgmap v4845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:37.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.438+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47080ff0d0 con 0x7f46f4064dd0 2022-02-02T21:03:37.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.440+0000 7f46feffd700 1 -- 172.21.15.96:0/3862946734 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f47080ff0d0 con 0x7f46f4064dd0 2022-02-02T21:03:37.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 msgr2=0x7f46f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 0x7f46f4067290 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f46f0004630 tx=0x7f46f0009b30).stop 2022-02-02T21:03:37.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 msgr2=0x7f47080f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 rx=0x7f46f80026d0 tx=0x7f46f8009de0).stop 2022-02-02T21:03:37.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 shutdown_connections 2022-02-02T21:03:37.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46f4064dd0 0x7f46f4067290 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47080f4ac0 0x7f47080f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.441+0000 7f470cac4700 1 --2- 172.21.15.96:0/3862946734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47080f53d0 0x7f47080f5b30 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.442+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 >> 172.21.15.96:0/3862946734 conn(0x7f47080f0540 msgr2=0x7f47080fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:37.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.442+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 shutdown_connections 2022-02-02T21:03:37.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.442+0000 7f470cac4700 1 -- 172.21.15.96:0/3862946734 wait complete. 2022-02-02T21:03:37.453 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:03:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 -- 172.21.15.96:0/4127423636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f6860 msgr2=0x7f05f00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 --2- 172.21.15.96:0/4127423636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f6860 0x7f05f00f6cc0 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 rx=0x7f05ec004660 tx=0x7f05ec009b30).stop 2022-02-02T21:03:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 -- 172.21.15.96:0/4127423636 shutdown_connections 2022-02-02T21:03:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 --2- 172.21.15.96:0/4127423636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f6860 0x7f05f00f6cc0 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 --2- 172.21.15.96:0/4127423636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f55c0 0x7f05f00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 -- 172.21.15.96:0/4127423636 >> 172.21.15.96:0/4127423636 conn(0x7f05f00f0d40 msgr2=0x7f05f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:37.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 -- 172.21.15.96:0/4127423636 shutdown_connections 2022-02-02T21:03:37.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.539+0000 7f05f72c2700 1 -- 172.21.15.96:0/4127423636 wait complete. 2022-02-02T21:03:37.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 Processor -- start 2022-02-02T21:03:37.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 -- start start 2022-02-02T21:03:37.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f6860 0x7f05f01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01069b0 con 0x7f05f00f55c0 2022-02-02T21:03:37.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f72c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01071c0 con 0x7f05f00f6860 2022-02-02T21:03:37.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40600/0 (socket says 172.21.15.96:40600) 2022-02-02T21:03:37.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 -- 172.21.15.96:0/2155036356 learned_addr learned my addr 172.21.15.96:0/2155036356 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:37.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f485d700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f6860 0x7f05f01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 -- 172.21.15.96:0/2155036356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f6860 msgr2=0x7f05f01063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f6860 0x7f05f01063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.540+0000 7f05f505e700 1 -- 172.21.15.96:0/2155036356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec005040 con 0x7f05f00f55c0 2022-02-02T21:03:37.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05f505e700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 rx=0x7f05e0002700 tx=0x7f05e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e00079c0 con 0x7f05f00f55c0 2022-02-02T21:03:37.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f0107440 con 0x7f05f00f55c0 2022-02-02T21:03:37.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f05e000f040 con 0x7f05f00f55c0 2022-02-02T21:03:37.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e0014860 con 0x7f05f00f55c0 2022-02-02T21:03:37.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.541+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f0107a00 con 0x7f05f00f55c0 2022-02-02T21:03:37.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.542+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f00f49b0 con 0x7f05f00f55c0 2022-02-02T21:03:37.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.542+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f05e001b060 con 0x7f05f00f55c0 2022-02-02T21:03:37.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.543+0000 7f05e5ffb700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 0x7f05dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.543+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f05e0081870 con 0x7f05f00f55c0 2022-02-02T21:03:37.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.543+0000 7f05f485d700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 0x7f05dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.543+0000 7f05f485d700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 0x7f05dc067290 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f05ec004630 tx=0x7f05ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.547+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f05e004f970 con 0x7f05f00f55c0 2022-02-02T21:03:37.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.717+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05f00fde60 con 0x7f05dc064dd0 2022-02-02T21:03:37.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.726+0000 7f05e5ffb700 1 -- 172.21.15.96:0/2155036356 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f05f00fde60 con 0x7f05dc064dd0 2022-02-02T21:03:37.728 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:03:37.729 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:03:37.729 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:03:37.729 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:03:37.729 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:03:37.730 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:03:37.730 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:03:37.730 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:03:37.730 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:03:37.730 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:03:37.731 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:03:37.731 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:03:37.731 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:03:37.731 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:03:37.732 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:03:37.732 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:03:37.732 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:03:37.732 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:03:37.733 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:03:37.733 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:03:37.733 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:03:37.733 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:03:37.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 msgr2=0x7f05dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 0x7f05dc067290 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f05ec004630 tx=0x7f05ec009b30).stop 2022-02-02T21:03:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 msgr2=0x7f05f0105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 rx=0x7f05e0002700 tx=0x7f05e0009d80).stop 2022-02-02T21:03:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 shutdown_connections 2022-02-02T21:03:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05dc064dd0 0x7f05dc067290 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f00f55c0 0x7f05f0105ec0 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 --2- 172.21.15.96:0/2155036356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05f00f6860 0x7f05f01063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 >> 172.21.15.96:0/2155036356 conn(0x7f05f00f0d40 msgr2=0x7f05f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 shutdown_connections 2022-02-02T21:03:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.728+0000 7f05f72c2700 1 -- 172.21.15.96:0/2155036356 wait complete. 2022-02-02T21:03:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- 172.21.15.96:0/392371532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f6520 msgr2=0x7fe43c0f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 --2- 172.21.15.96:0/392371532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f6520 0x7fe43c0f6940 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 rx=0x7fe430004660 tx=0x7fe430009b30).stop 2022-02-02T21:03:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- 172.21.15.96:0/392371532 shutdown_connections 2022-02-02T21:03:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 --2- 172.21.15.96:0/392371532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f77c0 0x7fe43c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 --2- 172.21.15.96:0/392371532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f6520 0x7fe43c0f6940 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- 172.21.15.96:0/392371532 >> 172.21.15.96:0/392371532 conn(0x7fe43c0f1ca0 msgr2=0x7fe43c0f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- 172.21.15.96:0/392371532 shutdown_connections 2022-02-02T21:03:37.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- 172.21.15.96:0/392371532 wait complete. 2022-02-02T21:03:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 Processor -- start 2022-02-02T21:03:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.825+0000 7fe43bfff700 1 -- start start 2022-02-02T21:03:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f6520 0x7fe43c106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1078c0 con 0x7fe43c0f77c0 2022-02-02T21:03:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c108100 con 0x7fe43c0f6520 2022-02-02T21:03:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40612/0 (socket says 172.21.15.96:40612) 2022-02-02T21:03:37.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 -- 172.21.15.96:0/217783773 learned_addr learned my addr 172.21.15.96:0/217783773 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43affd700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f6520 0x7fe43c106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 -- 172.21.15.96:0/217783773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f6520 msgr2=0x7fe43c106dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f6520 0x7fe43c106dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:37.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 -- 172.21.15.96:0/217783773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430005040 con 0x7fe43c0f77c0 2022-02-02T21:03:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43a7fc700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 rx=0x7fe42c0026d0 tx=0x7fe42c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42c0079c0 con 0x7fe43c0f77c0 2022-02-02T21:03:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe42c00f040 con 0x7fe43c0f77c0 2022-02-02T21:03:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c1083e0 con 0x7fe43c0f77c0 2022-02-02T21:03:37.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42c0148b0 con 0x7fe43c0f77c0 2022-02-02T21:03:37.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.826+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c108920 con 0x7fe43c0f77c0 2022-02-02T21:03:37.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.828+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe42c007b20 con 0x7fe43c0f77c0 2022-02-02T21:03:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.828+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c059100 con 0x7fe43c0f77c0 2022-02-02T21:03:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.828+0000 7fe4237fe700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 0x7fe4240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.828+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe42c0819e0 con 0x7fe43c0f77c0 2022-02-02T21:03:37.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.828+0000 7fe43affd700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 0x7fe4240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.829+0000 7fe43affd700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 0x7fe4240672e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fe430013690 tx=0x7fe430009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:37.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:37.832+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe42c04fae0 con 0x7fe43c0f77c0 2022-02-02T21:03:38.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.063+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe43c0fee70 con 0x7fe43c0f77c0 2022-02-02T21:03:38.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.064+0000 7fe4237fe700 1 -- 172.21.15.96:0/217783773 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe43c0fee70 con 0x7fe43c0f77c0 2022-02-02T21:03:38.066 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:03:38.066 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:03:38.067 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:03:38.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:38.067 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:03:38.067 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:03:38.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:38.068 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:03:38.068 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:03:38.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:38.068 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:03:38.069 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:03:38.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:03:38.069 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:03:38.069 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:03:38.070 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:03:38.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:03:38.070 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:03:38.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 msgr2=0x7fe4240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 0x7fe4240672e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fe430013690 tx=0x7fe430009b30).stop 2022-02-02T21:03:38.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 msgr2=0x7fe43c1072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 rx=0x7fe42c0026d0 tx=0x7fe42c009de0).stop 2022-02-02T21:03:38.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 shutdown_connections 2022-02-02T21:03:38.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe424064e20 0x7fe4240672e0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0f6520 0x7fe43c106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 --2- 172.21.15.96:0/217783773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe43c0f77c0 0x7fe43c1072c0 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 >> 172.21.15.96:0/217783773 conn(0x7fe43c0f1ca0 msgr2=0x7fe43c0fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:38.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 shutdown_connections 2022-02-02T21:03:38.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.065+0000 7fe43bfff700 1 -- 172.21.15.96:0/217783773 wait complete. 2022-02-02T21:03:38.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 -- 172.21.15.96:0/1953979254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 msgr2=0x7fcd7c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/1953979254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c0f6b30 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 rx=0x7fcd6c004660 tx=0x7fcd6c009b30).stop 2022-02-02T21:03:38.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 -- 172.21.15.96:0/1953979254 shutdown_connections 2022-02-02T21:03:38.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/1953979254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c0f6b30 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/1953979254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 0x7fcd7c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 -- 172.21.15.96:0/1953979254 >> 172.21.15.96:0/1953979254 conn(0x7fcd7c0f0b90 msgr2=0x7fcd7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:38.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.162+0000 7fcd7bfff700 1 -- 172.21.15.96:0/1953979254 shutdown_connections 2022-02-02T21:03:38.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 -- 172.21.15.96:0/1953979254 wait complete. 2022-02-02T21:03:38.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 Processor -- start 2022-02-02T21:03:38.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 -- start start 2022-02-02T21:03:38.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 0x7fcd7c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:38.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:38.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1099e0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.163+0000 7fcd7bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c109b20 con 0x7fcd7c0f5430 2022-02-02T21:03:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40622/0 (socket says 172.21.15.96:40622) 2022-02-02T21:03:38.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 -- 172.21.15.96:0/483242773 learned_addr learned my addr 172.21.15.96:0/483242773 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:03:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7affd700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 0x7fcd7c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 -- 172.21.15.96:0/483242773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 msgr2=0x7fcd7c108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 0x7fcd7c108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 -- 172.21.15.96:0/483242773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c005040 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7a7fc700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 rx=0x7fcd6c009990 tx=0x7fcd6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c018070 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd6c007ba0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c10a460 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c01c3c0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.164+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c10a9c0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.165+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c045ad0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.166+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd6c01d420 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.166+0000 7fcd637fe700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 0x7fcd640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:03:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.166+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd6c0836b0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.166+0000 7fcd7affd700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 0x7fcd640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:03:38.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.167+0000 7fcd7affd700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 0x7fcd640672e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fcd7c0f6530 tx=0x7fcd7000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:03:38.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.170+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd6c055240 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.375+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd7c10b0c0 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.376+0000 7fcd637fe700 1 -- 172.21.15.96:0/483242773 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcd6c054e30 con 0x7fcd7c0f66d0 2022-02-02T21:03:38.378 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:03:38.379 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:03:38.379 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:03:38.379 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:03:38.379 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:38.380 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:03:38.380 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:03:38.380 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:03:38.380 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:03:38.381 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:03:38.381 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:03:38.381 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:03:38.381 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:03:38.381 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:03:38.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:03:38.382 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:03:38.382 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:03:38.382 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:03:38.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:03:38.383 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:03:38.383 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:03:38.383 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:03:38.384 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:03:38.384 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:03:38.384 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:03:38.384 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:03:38.384 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:03:38.385 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:03:38.385 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:03:38.385 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:03:38.385 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:03:38.386 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:03:38.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:38.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:38.386 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:03:38.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:03:38.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:38.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:38.387 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:03:38.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 msgr2=0x7fcd640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 0x7fcd640672e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fcd7c0f6530 tx=0x7fcd7000b040).stop 2022-02-02T21:03:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 msgr2=0x7fcd7c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:03:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 rx=0x7fcd6c009990 tx=0x7fcd6c009b30).stop 2022-02-02T21:03:38.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 shutdown_connections 2022-02-02T21:03:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd64064e20 0x7fcd640672e0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd7c0f5430 0x7fcd7c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 --2- 172.21.15.96:0/483242773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd7c0f66d0 0x7fcd7c109430 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:03:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 >> 172.21.15.96:0/483242773 conn(0x7fcd7c0f0b90 msgr2=0x7fcd7c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:03:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 shutdown_connections 2022-02-02T21:03:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:03:38.378+0000 7fcd7bfff700 1 -- 172.21.15.96:0/483242773 wait complete. 2022-02-02T21:03:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:03:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:38 smithi159 ceph-mon[69013]: from='client.39074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:38 smithi159 ceph-mon[69013]: from='client.39078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:38 smithi159 ceph-mon[69013]: pgmap v4846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:38.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/217783773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:03:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:38 smithi096 ceph-mon[101353]: from='client.39074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:38 smithi096 ceph-mon[101353]: from='client.39078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:03:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:38 smithi096 ceph-mon[101353]: pgmap v4846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/217783773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:03:39.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/483242773' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:03:39.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/483242773' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:03:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:40 smithi159 ceph-mon[69013]: pgmap v4847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:40 smithi096 ceph-mon[101353]: pgmap v4847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:42 smithi096 ceph-mon[101353]: pgmap v4848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:42 smithi159 ceph-mon[69013]: pgmap v4848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:44 smithi096 ceph-mon[101353]: pgmap v4849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:44 smithi159 ceph-mon[69013]: pgmap v4849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:46 smithi096 ceph-mon[101353]: pgmap v4850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:47.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:46 smithi159 ceph-mon[69013]: pgmap v4850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:48 smithi159 ceph-mon[69013]: pgmap v4851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:48 smithi096 ceph-mon[101353]: pgmap v4851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:50 smithi096 ceph-mon[101353]: pgmap v4852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:50 smithi159 ceph-mon[69013]: pgmap v4852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:52 smithi096 ceph-mon[101353]: pgmap v4853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:52 smithi159 ceph-mon[69013]: pgmap v4853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:54 smithi096 ceph-mon[101353]: pgmap v4854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:54 smithi159 ceph-mon[69013]: pgmap v4854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:56 smithi096 ceph-mon[101353]: pgmap v4855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:56 smithi159 ceph-mon[69013]: pgmap v4855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:03:58 smithi159 ceph-mon[69013]: pgmap v4856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:03:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:03:58 smithi096 ceph-mon[101353]: pgmap v4856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:00 smithi096 ceph-mon[101353]: pgmap v4857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:00 smithi159 ceph-mon[69013]: pgmap v4857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:02 smithi096 ceph-mon[101353]: pgmap v4858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:02 smithi159 ceph-mon[69013]: pgmap v4858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:04 smithi096 ceph-mon[101353]: pgmap v4859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:04 smithi159 ceph-mon[69013]: pgmap v4859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:06 smithi096 ceph-mon[101353]: pgmap v4860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:06 smithi159 ceph-mon[69013]: pgmap v4860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:08.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 -- 172.21.15.96:0/2260981850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb44060330 msgr2=0x7fcb440f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 --2- 172.21.15.96:0/2260981850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb44060330 0x7fcb440f93c0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 rx=0x7fcb38004660 tx=0x7fcb38009b30).stop 2022-02-02T21:04:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 -- 172.21.15.96:0/2260981850 shutdown_connections 2022-02-02T21:04:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 --2- 172.21.15.96:0/2260981850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb440f98b0 0x7fcb440fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 --2- 172.21.15.96:0/2260981850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb44060330 0x7fcb440f93c0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 -- 172.21.15.96:0/2260981850 >> 172.21.15.96:0/2260981850 conn(0x7fcb440f0de0 msgr2=0x7fcb440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:08.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:08 smithi096 ceph-mon[101353]: pgmap v4861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 -- 172.21.15.96:0/2260981850 shutdown_connections 2022-02-02T21:04:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.489+0000 7fcb49d56700 1 -- 172.21.15.96:0/2260981850 wait complete. 2022-02-02T21:04:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 Processor -- start 2022-02-02T21:04:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 -- start start 2022-02-02T21:04:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 0x7fcb44106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44107a70 con 0x7fcb440f98b0 2022-02-02T21:04:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb49d56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44107bb0 con 0x7fcb44060330 2022-02-02T21:04:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40642/0 (socket says 172.21.15.96:40642) 2022-02-02T21:04:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb42ffd700 1 -- 172.21.15.96:0/1530598255 learned_addr learned my addr 172.21.15.96:0/1530598255 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.490+0000 7fcb437fe700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 0x7fcb44106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb42ffd700 1 -- 172.21.15.96:0/1530598255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 msgr2=0x7fcb44106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb42ffd700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 0x7fcb44106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb42ffd700 1 -- 172.21.15.96:0/1530598255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38005040 con 0x7fcb440f98b0 2022-02-02T21:04:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb437fe700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 0x7fcb44106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:04:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb42ffd700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 rx=0x7fcb3400c530 tx=0x7fcb34007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3400f650 con 0x7fcb440f98b0 2022-02-02T21:04:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb44108550 con 0x7fcb440f98b0 2022-02-02T21:04:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb3400fc60 con 0x7fcb440f98b0 2022-02-02T21:04:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb34012cd0 con 0x7fcb440f98b0 2022-02-02T21:04:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.491+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb44108b10 con 0x7fcb440f98b0 2022-02-02T21:04:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.492+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb44045ad0 con 0x7fcb440f98b0 2022-02-02T21:04:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.492+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb34010070 con 0x7fcb440f98b0 2022-02-02T21:04:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.493+0000 7fcb2bfff700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 0x7fcb2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.493+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb340817b0 con 0x7fcb440f98b0 2022-02-02T21:04:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.493+0000 7fcb437fe700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 0x7fcb2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.493+0000 7fcb437fe700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 0x7fcb2c067290 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fcb38009da0 tx=0x7fcb38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.497+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb340532e0 con 0x7fcb440f98b0 2022-02-02T21:04:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:08 smithi159 ceph-mon[69013]: pgmap v4861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:08.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.673+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb44108d30 con 0x7fcb2c064dd0 2022-02-02T21:04:08.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.675+0000 7fcb2bfff700 1 -- 172.21.15.96:0/1530598255 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcb44108d30 con 0x7fcb2c064dd0 2022-02-02T21:04:08.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 msgr2=0x7fcb2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 0x7fcb2c067290 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fcb38009da0 tx=0x7fcb38009b30).stop 2022-02-02T21:04:08.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 msgr2=0x7fcb441074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 rx=0x7fcb3400c530 tx=0x7fcb34007e20).stop 2022-02-02T21:04:08.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 shutdown_connections 2022-02-02T21:04:08.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb2c064dd0 0x7fcb2c067290 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb44060330 0x7fcb44106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 --2- 172.21.15.96:0/1530598255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb440f98b0 0x7fcb441074c0 unknown :-1 s=CLOSED pgs=2492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 >> 172.21.15.96:0/1530598255 conn(0x7fcb440f0de0 msgr2=0x7fcb440f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:08.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 shutdown_connections 2022-02-02T21:04:08.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.677+0000 7fcb49d56700 1 -- 172.21.15.96:0/1530598255 wait complete. 2022-02-02T21:04:08.687 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:04:08.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 -- 172.21.15.96:0/897519173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f55c0 msgr2=0x7f8cd80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/897519173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f55c0 0x7f8cd80f59e0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 rx=0x7f8cc8004660 tx=0x7f8cc8009b30).stop 2022-02-02T21:04:08.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 -- 172.21.15.96:0/897519173 shutdown_connections 2022-02-02T21:04:08.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/897519173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f6860 0x7f8cd80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/897519173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f55c0 0x7f8cd80f59e0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 -- 172.21.15.96:0/897519173 >> 172.21.15.96:0/897519173 conn(0x7f8cd80f0d40 msgr2=0x7f8cd80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 -- 172.21.15.96:0/897519173 shutdown_connections 2022-02-02T21:04:08.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.776+0000 7f8cdcafa700 1 -- 172.21.15.96:0/897519173 wait complete. 2022-02-02T21:04:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 Processor -- start 2022-02-02T21:04:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 -- start start 2022-02-02T21:04:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f55c0 0x7f8cd810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80602b0 con 0x7f8cd80f6860 2022-02-02T21:04:08.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cdcafa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80603f0 con 0x7f8cd80f55c0 2022-02-02T21:04:08.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40650/0 (socket says 172.21.15.96:40650) 2022-02-02T21:04:08.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 -- 172.21.15.96:0/2964178879 learned_addr learned my addr 172.21.15.96:0/2964178879 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:08.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd659c700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f55c0 0x7f8cd810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 -- 172.21.15.96:0/2964178879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f55c0 msgr2=0x7f8cd810c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f55c0 0x7f8cd810c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.777+0000 7f8cd5d9b700 1 -- 172.21.15.96:0/2964178879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8005040 con 0x7f8cd80f6860 2022-02-02T21:04:08.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cd5d9b700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 rx=0x7f8ccc00c790 tx=0x7f8ccc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:08.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc002590 con 0x7f8cd80f6860 2022-02-02T21:04:08.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ccc002ba0 con 0x7f8cd80f6860 2022-02-02T21:04:08.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd810ea80 con 0x7f8cd80f6860 2022-02-02T21:04:08.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc013d90 con 0x7f8cd80f6860 2022-02-02T21:04:08.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.778+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd810ef00 con 0x7f8cd80f6860 2022-02-02T21:04:08.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.779+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80f49b0 con 0x7f8cd80f6860 2022-02-02T21:04:08.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.779+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ccc01a060 con 0x7f8cd80f6860 2022-02-02T21:04:08.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.779+0000 7f8cc6ffd700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:08.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.780+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8ccc081cb0 con 0x7f8cd80f6860 2022-02-02T21:04:08.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.780+0000 7f8cd659c700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:08.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.780+0000 7f8cd659c700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f8cc8013690 tx=0x7f8cc8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:08.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.784+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ccc04fe00 con 0x7f8cd80f6860 2022-02-02T21:04:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.956+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd80fddf0 con 0x7f8cc0064dd0 2022-02-02T21:04:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.965+0000 7f8cc6ffd700 1 -- 172.21.15.96:0/2964178879 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8cd80fddf0 con 0x7f8cc0064dd0 2022-02-02T21:04:08.967 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:04:08.967 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:04:08.967 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:04:08.968 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:04:08.968 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:04:08.968 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:04:08.968 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:04:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:04:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:04:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:04:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:04:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:04:08.970 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:04:08.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:04:08.970 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:04:08.970 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:04:08.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:04:08.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:04:08.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:04:08.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:04:08.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:04:08.972 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:04:08.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 msgr2=0x7f8cc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f8cc8013690 tx=0x7f8cc8009b30).stop 2022-02-02T21:04:08.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 msgr2=0x7f8cd810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:08.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 rx=0x7f8ccc00c790 tx=0x7f8ccc007d70).stop 2022-02-02T21:04:08.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 shutdown_connections 2022-02-02T21:04:08.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd80f55c0 0x7f8cd810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 --2- 172.21.15.96:0/2964178879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd80f6860 0x7f8cd810e590 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:08.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.967+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 >> 172.21.15.96:0/2964178879 conn(0x7f8cd80f0d40 msgr2=0x7f8cd80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:08.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.968+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 shutdown_connections 2022-02-02T21:04:08.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:08.968+0000 7f8cdcafa700 1 -- 172.21.15.96:0/2964178879 wait complete. 2022-02-02T21:04:09.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 -- 172.21.15.96:0/3062250499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 msgr2=0x7f80600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3062250499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600f7de0 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 rx=0x7f8050004660 tx=0x7f8050009b30).stop 2022-02-02T21:04:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 -- 172.21.15.96:0/3062250499 shutdown_connections 2022-02-02T21:04:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3062250499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600f7de0 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3062250499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 0x7f80600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 -- 172.21.15.96:0/3062250499 >> 172.21.15.96:0/3062250499 conn(0x7f80600f1e40 msgr2=0x7f80600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 -- 172.21.15.96:0/3062250499 shutdown_connections 2022-02-02T21:04:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.064+0000 7f8065e4b700 1 -- 172.21.15.96:0/3062250499 wait complete. 2022-02-02T21:04:09.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 Processor -- start 2022-02-02T21:04:09.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 -- start start 2022-02-02T21:04:09.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 0x7f80600ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80601005d0 con 0x7f80600f7980 2022-02-02T21:04:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.065+0000 7f8065e4b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8060100710 con 0x7f80600f66e0 2022-02-02T21:04:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40658/0 (socket says 172.21.15.96:40658) 2022-02-02T21:04:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 -- 172.21.15.96:0/3542401031 learned_addr learned my addr 172.21.15.96:0/3542401031 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805f7fe700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 0x7f80600ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 -- 172.21.15.96:0/3542401031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 msgr2=0x7f80600ffae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 0x7f80600ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 -- 172.21.15.96:0/3542401031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050005040 con 0x7f80600f7980 2022-02-02T21:04:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f805effd700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 rx=0x7f8050009990 tx=0x7f8050009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8050018070 con 0x7f80600f7980 2022-02-02T21:04:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8050007ba0 con 0x7f80600f7980 2022-02-02T21:04:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8060101020 con 0x7f80600f7980 2022-02-02T21:04:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805001c3c0 con 0x7f80600f7980 2022-02-02T21:04:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.066+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8060101580 con 0x7f80600f7980 2022-02-02T21:04:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.067+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8060045ad0 con 0x7f80600f7980 2022-02-02T21:04:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.068+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f805001d420 con 0x7f80600f7980 2022-02-02T21:04:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.068+0000 7f8047fff700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 0x7f8048067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.068+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80500836b0 con 0x7f80600f7980 2022-02-02T21:04:09.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.068+0000 7f805f7fe700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 0x7f8048067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.068+0000 7f805f7fe700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 0x7f8048067290 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f80600ff870 tx=0x7f805400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:09.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.072+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8050051870 con 0x7f80600f7980 2022-02-02T21:04:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.305+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80600fef40 con 0x7f80600f7980 2022-02-02T21:04:09.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.306+0000 7f8047fff700 1 -- 172.21.15.96:0/3542401031 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8050054e90 con 0x7f80600f7980 2022-02-02T21:04:09.308 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:04:09.308 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:04:09.308 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:04:09.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:09.309 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:04:09.309 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:04:09.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:09.310 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:04:09.310 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:04:09.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:09.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:04:09.311 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:04:09.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:09.311 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:04:09.311 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:04:09.311 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:04:09.312 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:04:09.312 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:04:09.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 msgr2=0x7f8048067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 0x7f8048067290 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f80600ff870 tx=0x7f805400b040).stop 2022-02-02T21:04:09.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 msgr2=0x7f80600fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 rx=0x7f8050009990 tx=0x7f8050009b30).stop 2022-02-02T21:04:09.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 shutdown_connections 2022-02-02T21:04:09.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8048064dd0 0x7f8048067290 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80600f66e0 0x7f80600ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 --2- 172.21.15.96:0/3542401031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80600f7980 0x7f80600fffd0 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.307+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 >> 172.21.15.96:0/3542401031 conn(0x7f80600f1e40 msgr2=0x7f806006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:09.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.308+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 shutdown_connections 2022-02-02T21:04:09.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.308+0000 7f8065e4b700 1 -- 172.21.15.96:0/3542401031 wait complete. 2022-02-02T21:04:09.407 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:09 smithi096 ceph-mon[101353]: from='client.39090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:09.407 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:09 smithi096 ceph-mon[101353]: from='client.39094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 -- 172.21.15.96:0/454721652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 msgr2=0x7f432c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 --2- 172.21.15.96:0/454721652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c0f5850 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 rx=0x7f4320004660 tx=0x7f4320009b30).stop 2022-02-02T21:04:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 -- 172.21.15.96:0/454721652 shutdown_connections 2022-02-02T21:04:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 --2- 172.21.15.96:0/454721652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 0x7f432c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 --2- 172.21.15.96:0/454721652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c0f5850 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.405+0000 7f4331673700 1 -- 172.21.15.96:0/454721652 >> 172.21.15.96:0/454721652 conn(0x7f432c0f0b90 msgr2=0x7f432c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.406+0000 7f4331673700 1 -- 172.21.15.96:0/454721652 shutdown_connections 2022-02-02T21:04:09.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.406+0000 7f4331673700 1 -- 172.21.15.96:0/454721652 wait complete. 2022-02-02T21:04:09.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.406+0000 7f4331673700 1 Processor -- start 2022-02-02T21:04:09.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.406+0000 7f4331673700 1 -- start start 2022-02-02T21:04:09.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 0x7f432c10bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0603c0 con 0x7f432c0f5430 2022-02-02T21:04:09.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c060500 con 0x7f432c0f66d0 2022-02-02T21:04:09.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40668/0 (socket says 172.21.15.96:40668) 2022-02-02T21:04:09.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 -- 172.21.15.96:0/1219920770 learned_addr learned my addr 172.21.15.96:0/1219920770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:09.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432b7fe700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 0x7f432c10bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 -- 172.21.15.96:0/1219920770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 msgr2=0x7f432c10bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 0x7f432c10bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 -- 172.21.15.96:0/1219920770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320005040 con 0x7f432c0f5430 2022-02-02T21:04:09.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f432bfff700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 rx=0x7f4320004f60 tx=0x7f4320009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:09.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4320007ba0 con 0x7f432c0f5430 2022-02-02T21:04:09.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4320009770 con 0x7f432c0f5430 2022-02-02T21:04:09.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c1058d0 con 0x7f432c0f5430 2022-02-02T21:04:09.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.407+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c105e30 con 0x7f432c0f5430 2022-02-02T21:04:09.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.408+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4320022630 con 0x7f432c0f5430 2022-02-02T21:04:09.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.408+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c004fa0 con 0x7f432c0f5430 2022-02-02T21:04:09.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.409+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f432002a070 con 0x7f432c0f5430 2022-02-02T21:04:09.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.409+0000 7f4328ff9700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 0x7f43140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:09.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.409+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4320086fc0 con 0x7f432c0f5430 2022-02-02T21:04:09.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.409+0000 7f432b7fe700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 0x7f43140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:09.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.410+0000 7f432b7fe700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 0x7f43140672e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f431c0041d0 tx=0x7f431c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:09.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.414+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f43200550c0 con 0x7f432c0f5430 2022-02-02T21:04:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:09 smithi159 ceph-mon[69013]: from='client.39090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:09.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:09 smithi159 ceph-mon[69013]: from='client.39094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:09.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.612+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f430c005e80 con 0x7f432c0f5430 2022-02-02T21:04:09.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.613+0000 7f4328ff9700 1 -- 172.21.15.96:0/1219920770 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f43200586e0 con 0x7f432c0f5430 2022-02-02T21:04:09.614 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:04:09.615 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:04:09.615 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:04:09.615 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:04:09.615 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:09.616 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:04:09.616 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:04:09.616 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:04:09.616 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:04:09.617 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:04:09.617 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:04:09.617 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:04:09.617 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:04:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:04:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:04:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:04:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:04:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:04:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:04:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:04:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:04:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:04:09.620 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:04:09.620 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:04:09.620 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:04:09.620 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:04:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:04:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:04:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:04:09.621 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:04:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:04:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:04:09.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:09.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:04:09.623 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:09.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:09.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.614+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 msgr2=0x7f43140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.614+0000 7f4331673700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 0x7f43140672e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f431c0041d0 tx=0x7f431c009040).stop 2022-02-02T21:04:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.614+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 msgr2=0x7f432c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.614+0000 7f4331673700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 rx=0x7f4320004f60 tx=0x7f4320009b30).stop 2022-02-02T21:04:09.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 shutdown_connections 2022-02-02T21:04:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4314064e20 0x7f43140672e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f432c0f5430 0x7f432c109af0 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 --2- 172.21.15.96:0/1219920770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f432c0f66d0 0x7f432c10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:09.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 >> 172.21.15.96:0/1219920770 conn(0x7f432c0f0b90 msgr2=0x7f432c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 shutdown_connections 2022-02-02T21:04:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:09.615+0000 7f4331673700 1 -- 172.21.15.96:0/1219920770 wait complete. 2022-02-02T21:04:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:04:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3542401031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:04:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1219920770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:04:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:10 smithi159 ceph-mon[69013]: pgmap v4862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3542401031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:04:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1219920770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:04:10.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:10 smithi096 ceph-mon[101353]: pgmap v4862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:12 smithi096 ceph-mon[101353]: pgmap v4863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:12 smithi159 ceph-mon[69013]: pgmap v4863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:15.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:14 smithi096 ceph-mon[101353]: pgmap v4864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:14 smithi159 ceph-mon[69013]: pgmap v4864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:17.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:16 smithi096 ceph-mon[101353]: pgmap v4865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:16 smithi159 ceph-mon[69013]: pgmap v4865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:18 smithi159 ceph-mon[69013]: pgmap v4866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:18 smithi096 ceph-mon[101353]: pgmap v4866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:21.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:20 smithi096 ceph-mon[101353]: pgmap v4867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:21.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:20 smithi159 ceph-mon[69013]: pgmap v4867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:22 smithi096 ceph-mon[101353]: pgmap v4868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:22 smithi159 ceph-mon[69013]: pgmap v4868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:25.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:24 smithi096 ceph-mon[101353]: pgmap v4869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:24 smithi159 ceph-mon[69013]: pgmap v4869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:26 smithi096 ceph-mon[101353]: pgmap v4870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:26 smithi159 ceph-mon[69013]: pgmap v4870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:04:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:04:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:28 smithi159 ceph-mon[69013]: pgmap v4871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:04:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:04:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:28 smithi096 ceph-mon[101353]: pgmap v4871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:31.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:30 smithi096 ceph-mon[101353]: pgmap v4872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:30 smithi159 ceph-mon[69013]: pgmap v4872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:33.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:32 smithi096 ceph-mon[101353]: pgmap v4873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:32 smithi159 ceph-mon[69013]: pgmap v4873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:34 smithi096 ceph-mon[101353]: pgmap v4874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:35.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:34 smithi159 ceph-mon[69013]: pgmap v4874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:37.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:36 smithi096 ceph-mon[101353]: pgmap v4875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:36 smithi159 ceph-mon[69013]: pgmap v4875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:38 smithi159 ceph-mon[69013]: pgmap v4876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:38 smithi096 ceph-mon[101353]: pgmap v4876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:39.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 -- 172.21.15.96:0/448081182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f7980 msgr2=0x7f42140f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:39.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 --2- 172.21.15.96:0/448081182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f7980 0x7f42140f7de0 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 rx=0x7f4208004660 tx=0x7f4208009b30).stop 2022-02-02T21:04:39.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 -- 172.21.15.96:0/448081182 shutdown_connections 2022-02-02T21:04:39.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 --2- 172.21.15.96:0/448081182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f7980 0x7f42140f7de0 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 --2- 172.21.15.96:0/448081182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f66e0 0x7f42140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 -- 172.21.15.96:0/448081182 >> 172.21.15.96:0/448081182 conn(0x7f42140f1e40 msgr2=0x7f42140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:39.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.725+0000 7f421a135700 1 -- 172.21.15.96:0/448081182 shutdown_connections 2022-02-02T21:04:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.726+0000 7f421a135700 1 -- 172.21.15.96:0/448081182 wait complete. 2022-02-02T21:04:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.726+0000 7f421a135700 1 Processor -- start 2022-02-02T21:04:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f421a135700 1 -- start start 2022-02-02T21:04:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f421a135700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f421a135700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f7980 0x7f4214069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:39.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f421a135700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421406a380 con 0x7f42140f66e0 2022-02-02T21:04:39.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f421a135700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421406a4c0 con 0x7f42140f7980 2022-02-02T21:04:39.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:39.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40686/0 (socket says 172.21.15.96:40686) 2022-02-02T21:04:39.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 -- 172.21.15.96:0/2446061200 learned_addr learned my addr 172.21.15.96:0/2446061200 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:39.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f4212ffd700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f7980 0x7f4214069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:39.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 -- 172.21.15.96:0/2446061200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f7980 msgr2=0x7f4214069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:39.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f7980 0x7f4214069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 -- 172.21.15.96:0/2446061200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208005040 con 0x7f42140f66e0 2022-02-02T21:04:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f42137fe700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 rx=0x7f4204002700 tx=0x7f4204009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.727+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4204009320 con 0x7f42140f66e0 2022-02-02T21:04:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.728+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421406a7a0 con 0x7f42140f66e0 2022-02-02T21:04:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.728+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f420400f040 con 0x7f42140f66e0 2022-02-02T21:04:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.728+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4204014900 con 0x7f42140f66e0 2022-02-02T21:04:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.728+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421410ef90 con 0x7f42140f66e0 2022-02-02T21:04:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.729+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4214045ad0 con 0x7f42140f66e0 2022-02-02T21:04:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.729+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4204009480 con 0x7f42140f66e0 2022-02-02T21:04:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.729+0000 7f41fbfff700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 0x7f41fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.729+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4204081cc0 con 0x7f42140f66e0 2022-02-02T21:04:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.729+0000 7f4212ffd700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 0x7f41fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.730+0000 7f4212ffd700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 0x7f41fc067290 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f4208004630 tx=0x7f4208009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:39.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.734+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f420404fe80 con 0x7f42140f66e0 2022-02-02T21:04:39.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.912+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4214057f10 con 0x7f41fc064dd0 2022-02-02T21:04:39.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.913+0000 7f41fbfff700 1 -- 172.21.15.96:0/2446061200 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4214057f10 con 0x7f41fc064dd0 2022-02-02T21:04:39.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 msgr2=0x7f41fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:39.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 0x7f41fc067290 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f4208004630 tx=0x7f4208009b30).stop 2022-02-02T21:04:39.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 msgr2=0x7f421406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:39.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 rx=0x7f4204002700 tx=0x7f4204009d80).stop 2022-02-02T21:04:39.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 shutdown_connections 2022-02-02T21:04:39.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41fc064dd0 0x7f41fc067290 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42140f66e0 0x7f421406b9a0 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 --2- 172.21.15.96:0/2446061200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42140f7980 0x7f4214069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:39.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 >> 172.21.15.96:0/2446061200 conn(0x7f42140f1e40 msgr2=0x7f42140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:39.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 shutdown_connections 2022-02-02T21:04:39.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:39.915+0000 7f421a135700 1 -- 172.21.15.96:0/2446061200 wait complete. 2022-02-02T21:04:39.926 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:04:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 -- 172.21.15.96:0/3847371022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 msgr2=0x7f41bc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 --2- 172.21.15.96:0/3847371022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc0f7a20 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 rx=0x7f41ac004660 tx=0x7f41ac009b30).stop 2022-02-02T21:04:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 -- 172.21.15.96:0/3847371022 shutdown_connections 2022-02-02T21:04:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 --2- 172.21.15.96:0/3847371022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc0f7a20 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 --2- 172.21.15.96:0/3847371022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 0x7f41bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 -- 172.21.15.96:0/3847371022 >> 172.21.15.96:0/3847371022 conn(0x7f41bc0f1f00 msgr2=0x7f41bc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.013+0000 7f41c1870700 1 -- 172.21.15.96:0/3847371022 shutdown_connections 2022-02-02T21:04:40.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.014+0000 7f41c1870700 1 -- 172.21.15.96:0/3847371022 wait complete. 2022-02-02T21:04:40.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.014+0000 7f41c1870700 1 Processor -- start 2022-02-02T21:04:40.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.014+0000 7f41c1870700 1 -- start start 2022-02-02T21:04:40.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41c1870700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 0x7f41bc106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41c1870700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41c1870700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc1079f0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41c1870700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc107b30 con 0x7f41bc0f66e0 2022-02-02T21:04:40.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40698/0 (socket says 172.21.15.96:40698) 2022-02-02T21:04:40.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 -- 172.21.15.96:0/3467929267 learned_addr learned my addr 172.21.15.96:0/3467929267 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:40.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41baffd700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 0x7f41bc106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 -- 172.21.15.96:0/3467929267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 msgr2=0x7f41bc106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 0x7f41bc106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 -- 172.21.15.96:0/3467929267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac005040 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41ba7fc700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 rx=0x7f41ac009990 tx=0x7f41ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.015+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ac018070 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.016+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc108470 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.016+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41ac007ba0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.016+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ac01c3c0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.016+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc1089d0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.017+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc045ad0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.017+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f41ac01d420 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.018+0000 7f41a37fe700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 0x7f41a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.018+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41ac0836a0 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.018+0000 7f41baffd700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 0x7f41a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.018+0000 7f41baffd700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 0x7f41a4067290 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f41b0004c40 tx=0x7f41b000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.022+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41ac055290 con 0x7f41bc0f6ff0 2022-02-02T21:04:40.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.197+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f41bc0ff040 con 0x7f41a4064dd0 2022-02-02T21:04:40.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.206+0000 7f41a37fe700 1 -- 172.21.15.96:0/3467929267 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f41bc0ff040 con 0x7f41a4064dd0 2022-02-02T21:04:40.208 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:04:40.208 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:04:40.208 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:04:40.208 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:04:40.209 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:04:40.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:04:40.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:04:40.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:04:40.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:04:40.210 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:04:40.210 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:04:40.210 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:04:40.211 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:04:40.211 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:04:40.211 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:04:40.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:04:40.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:04:40.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:04:40.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:04:40.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:04:40.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:04:40.213 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:04:40.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 msgr2=0x7f41a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 0x7f41a4067290 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f41b0004c40 tx=0x7f41b000b040).stop 2022-02-02T21:04:40.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 msgr2=0x7f41bc107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 rx=0x7f41ac009990 tx=0x7f41ac009b30).stop 2022-02-02T21:04:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 shutdown_connections 2022-02-02T21:04:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f41a4064dd0 0x7f41a4067290 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41bc0f66e0 0x7f41bc106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 --2- 172.21.15.96:0/3467929267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0f6ff0 0x7f41bc107440 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 >> 172.21.15.96:0/3467929267 conn(0x7f41bc0f1f00 msgr2=0x7f41bc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 shutdown_connections 2022-02-02T21:04:40.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.208+0000 7f41c1870700 1 -- 172.21.15.96:0/3467929267 wait complete. 2022-02-02T21:04:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 -- 172.21.15.96:0/4213932128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 msgr2=0x7f662c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 --2- 172.21.15.96:0/4213932128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 0x7f662c0f6950 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 rx=0x7f661c004660 tx=0x7f661c009b30).stop 2022-02-02T21:04:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 -- 172.21.15.96:0/4213932128 shutdown_connections 2022-02-02T21:04:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 --2- 172.21.15.96:0/4213932128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f77d0 0x7f662c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 --2- 172.21.15.96:0/4213932128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 0x7f662c0f6950 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 -- 172.21.15.96:0/4213932128 >> 172.21.15.96:0/4213932128 conn(0x7f662c0f1c90 msgr2=0x7f662c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 -- 172.21.15.96:0/4213932128 shutdown_connections 2022-02-02T21:04:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.304+0000 7f66324ed700 1 -- 172.21.15.96:0/4213932128 wait complete. 2022-02-02T21:04:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 Processor -- start 2022-02-02T21:04:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 -- start start 2022-02-02T21:04:40.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1078f0 con 0x7f662c0f77d0 2022-02-02T21:04:40.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f66324ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c108100 con 0x7f662c0f6530 2022-02-02T21:04:40.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f6630cea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f6630cea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40708/0 (socket says 172.21.15.96:40708) 2022-02-02T21:04:40.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.305+0000 7f6630cea700 1 -- 172.21.15.96:0/2712316333 learned_addr learned my addr 172.21.15.96:0/2712316333 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:40.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f66314eb700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6630cea700 1 -- 172.21.15.96:0/2712316333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 msgr2=0x7f662c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6630cea700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6630cea700 1 -- 172.21.15.96:0/2712316333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c005040 con 0x7f662c0f77d0 2022-02-02T21:04:40.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6630cea700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 rx=0x7f662800c530 tx=0x7f6628007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662800f650 con 0x7f662c0f77d0 2022-02-02T21:04:40.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c108380 con 0x7f662c0f77d0 2022-02-02T21:04:40.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f662800fc60 con 0x7f662c0f77d0 2022-02-02T21:04:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6628012c20 con 0x7f662c0f77d0 2022-02-02T21:04:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.306+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c108940 con 0x7f662c0f77d0 2022-02-02T21:04:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.307+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c059100 con 0x7f662c0f77d0 2022-02-02T21:04:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.308+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6628010070 con 0x7f662c0f77d0 2022-02-02T21:04:40.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.308+0000 7f6621ffb700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.308+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6628081600 con 0x7f662c0f77d0 2022-02-02T21:04:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.308+0000 7f66314eb700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.309+0000 7f66314eb700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f661c013690 tx=0x7f661c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.312+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f66280477d0 con 0x7f662c0f77d0 2022-02-02T21:04:40.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.540+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f662c0fee80 con 0x7f662c0f77d0 2022-02-02T21:04:40.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.541+0000 7f6621ffb700 1 -- 172.21.15.96:0/2712316333 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f662c0fee80 con 0x7f662c0f77d0 2022-02-02T21:04:40.542 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:04:40.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:04:40.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:04:40.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:40.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:04:40.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:04:40.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:40.544 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:04:40.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:04:40.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:40.545 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:04:40.545 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:04:40.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:04:40.545 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:04:40.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:04:40.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:04:40.546 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:04:40.546 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:04:40.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.542+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 msgr2=0x7f66180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.542+0000 7f66324ed700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f661c013690 tx=0x7f661c009b30).stop 2022-02-02T21:04:40.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.542+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 msgr2=0x7f662c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.542+0000 7f66324ed700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 rx=0x7f662800c530 tx=0x7f6628007e20).stop 2022-02-02T21:04:40.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 shutdown_connections 2022-02-02T21:04:40.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 --2- 172.21.15.96:0/2712316333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 >> 172.21.15.96:0/2712316333 conn(0x7f662c0f1c90 msgr2=0x7f662c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 shutdown_connections 2022-02-02T21:04:40.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.543+0000 7f66324ed700 1 -- 172.21.15.96:0/2712316333 wait complete. 2022-02-02T21:04:40.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 -- 172.21.15.96:0/3800595889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 msgr2=0x7efd840f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 --2- 172.21.15.96:0/3800595889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd840f6b30 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 rx=0x7efd74004660 tx=0x7efd74009b30).stop 2022-02-02T21:04:40.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 -- 172.21.15.96:0/3800595889 shutdown_connections 2022-02-02T21:04:40.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 --2- 172.21.15.96:0/3800595889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd840f6b30 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 --2- 172.21.15.96:0/3800595889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 0x7efd840f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 -- 172.21.15.96:0/3800595889 >> 172.21.15.96:0/3800595889 conn(0x7efd840f0b90 msgr2=0x7efd840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.640+0000 7efd8acf5700 1 -- 172.21.15.96:0/3800595889 shutdown_connections 2022-02-02T21:04:40.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.641+0000 7efd8acf5700 1 -- 172.21.15.96:0/3800595889 wait complete. 2022-02-02T21:04:40.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 Processor -- start 2022-02-02T21:04:40.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 -- start start 2022-02-02T21:04:40.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 0x7efd84106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84107830 con 0x7efd840f66d0 2022-02-02T21:04:40.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd8acf5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84108040 con 0x7efd840f5430 2022-02-02T21:04:40.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40718/0 (socket says 172.21.15.96:40718) 2022-02-02T21:04:40.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 -- 172.21.15.96:0/4143151373 learned_addr learned my addr 172.21.15.96:0/4143151373 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:04:40.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd89cf3700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 0x7efd84106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 -- 172.21.15.96:0/4143151373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 msgr2=0x7efd84106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 0x7efd84106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 -- 172.21.15.96:0/4143151373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74005040 con 0x7efd840f66d0 2022-02-02T21:04:40.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.642+0000 7efd894f2700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 rx=0x7efd74009990 tx=0x7efd74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.643+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd74018070 con 0x7efd840f66d0 2022-02-02T21:04:40.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.643+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd74007ba0 con 0x7efd840f66d0 2022-02-02T21:04:40.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.643+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7401c3c0 con 0x7efd840f66d0 2022-02-02T21:04:40.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.643+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84108260 con 0x7efd840f66d0 2022-02-02T21:04:40.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.643+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd841087c0 con 0x7efd840f66d0 2022-02-02T21:04:40.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.644+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd7401d420 con 0x7efd840f66d0 2022-02-02T21:04:40.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.644+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd84059100 con 0x7efd840f66d0 2022-02-02T21:04:40.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.644+0000 7efd7a7fc700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 0x7efd700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:04:40.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.645+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efd74083680 con 0x7efd840f66d0 2022-02-02T21:04:40.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.645+0000 7efd89cf3700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 0x7efd700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:04:40.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.645+0000 7efd89cf3700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 0x7efd700672e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7efd84106ab0 tx=0x7efd80009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:04:40.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.649+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd74051720 con 0x7efd840f66d0 2022-02-02T21:04:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.852+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd8410d280 con 0x7efd840f66d0 2022-02-02T21:04:40.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.853+0000 7efd7a7fc700 1 -- 172.21.15.96:0/4143151373 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efd74054d40 con 0x7efd840f66d0 2022-02-02T21:04:40.854 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:04:40.855 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:04:40.855 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:04:40.855 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:04:40.855 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:40.856 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:04:40.856 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:04:40.856 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:04:40.856 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:04:40.857 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:04:40.857 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:04:40.857 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:04:40.857 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:04:40.858 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:04:40.858 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:04:40.858 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:04:40.858 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:04:40.858 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:04:40.859 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:04:40.859 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:04:40.859 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:04:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:04:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:04:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:04:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:04:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:04:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:04:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:04:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:04:40.861 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:04:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:04:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:04:40.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:40.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:40.862 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:04:40.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:04:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:40.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:04:40.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.854+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 msgr2=0x7efd700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.854+0000 7efd8acf5700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 0x7efd700672e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7efd84106ab0 tx=0x7efd80009c80).stop 2022-02-02T21:04:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.854+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 msgr2=0x7efd84107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:04:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.854+0000 7efd8acf5700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 rx=0x7efd74009990 tx=0x7efd74009b30).stop 2022-02-02T21:04:40.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 shutdown_connections 2022-02-02T21:04:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd70064e20 0x7efd700672e0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd840f5430 0x7efd84106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 --2- 172.21.15.96:0/4143151373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd840f66d0 0x7efd84107230 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:04:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 >> 172.21.15.96:0/4143151373 conn(0x7efd840f0b90 msgr2=0x7efd8405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:04:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 shutdown_connections 2022-02-02T21:04:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:04:40.855+0000 7efd8acf5700 1 -- 172.21.15.96:0/4143151373 wait complete. 2022-02-02T21:04:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:04:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:40 smithi096 ceph-mon[101353]: pgmap v4877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:40 smithi096 ceph-mon[101353]: from='client.39106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2712316333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:04:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:40 smithi159 ceph-mon[69013]: pgmap v4877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:40 smithi159 ceph-mon[69013]: from='client.39106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2712316333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:04:42.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:41 smithi096 ceph-mon[101353]: from='client.39110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:42.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4143151373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:04:42.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:41 smithi159 ceph-mon[69013]: from='client.39110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:04:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4143151373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:04:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:42 smithi096 ceph-mon[101353]: pgmap v4878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:42 smithi159 ceph-mon[69013]: pgmap v4878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:44 smithi159 ceph-mon[69013]: pgmap v4879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:44 smithi096 ceph-mon[101353]: pgmap v4879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:46 smithi159 ceph-mon[69013]: pgmap v4880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:46 smithi096 ceph-mon[101353]: pgmap v4880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:48 smithi159 ceph-mon[69013]: pgmap v4881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:48 smithi096 ceph-mon[101353]: pgmap v4881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:50 smithi096 ceph-mon[101353]: pgmap v4882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:50 smithi159 ceph-mon[69013]: pgmap v4882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:52 smithi096 ceph-mon[101353]: pgmap v4883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:52 smithi159 ceph-mon[69013]: pgmap v4883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:54 smithi159 ceph-mon[69013]: pgmap v4884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:54 smithi096 ceph-mon[101353]: pgmap v4884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:56 smithi159 ceph-mon[69013]: pgmap v4885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:56 smithi096 ceph-mon[101353]: pgmap v4885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:04:58 smithi159 ceph-mon[69013]: pgmap v4886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:04:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:04:58 smithi096 ceph-mon[101353]: pgmap v4886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:00 smithi096 ceph-mon[101353]: pgmap v4887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:00 smithi159 ceph-mon[69013]: pgmap v4887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:03.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:02 smithi096 ceph-mon[101353]: pgmap v4888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:02 smithi159 ceph-mon[69013]: pgmap v4888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:04 smithi159 ceph-mon[69013]: pgmap v4889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:04 smithi096 ceph-mon[101353]: pgmap v4889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:06 smithi159 ceph-mon[69013]: pgmap v4890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:06 smithi096 ceph-mon[101353]: pgmap v4890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:08 smithi159 ceph-mon[69013]: pgmap v4891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:08 smithi096 ceph-mon[101353]: pgmap v4891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:10.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 -- 172.21.15.96:0/2655339363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f5eb0 msgr2=0x7f7ed00f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:10.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/2655339363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed00f68e0 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 rx=0x7f7ebc004660 tx=0x7f7ebc009b30).stop 2022-02-02T21:05:10.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 -- 172.21.15.96:0/2655339363 shutdown_connections 2022-02-02T21:05:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/2655339363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed00f68e0 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/2655339363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f55a0 0x7f7ed00f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 -- 172.21.15.96:0/2655339363 >> 172.21.15.96:0/2655339363 conn(0x7f7ed00f0da0 msgr2=0x7f7ed00f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:10.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 -- 172.21.15.96:0/2655339363 shutdown_connections 2022-02-02T21:05:10.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.964+0000 7f7ed71a6700 1 -- 172.21.15.96:0/2655339363 wait complete. 2022-02-02T21:05:10.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.965+0000 7f7ed71a6700 1 Processor -- start 2022-02-02T21:05:10.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.965+0000 7f7ed71a6700 1 -- start start 2022-02-02T21:05:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed71a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed71a6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed0106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed71a6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0106900 con 0x7f7ed00f55a0 2022-02-02T21:05:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed71a6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0107110 con 0x7f7ed00f5eb0 2022-02-02T21:05:10.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:10.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40734/0 (socket says 172.21.15.96:40734) 2022-02-02T21:05:10.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 -- 172.21.15.96:0/870930576 learned_addr learned my addr 172.21.15.96:0/870930576 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:10.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ecffff700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed0106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:10.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 -- 172.21.15.96:0/870930576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f5eb0 msgr2=0x7f7ed0106300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:10.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed0106300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 -- 172.21.15.96:0/870930576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc005040 con 0x7f7ed00f55a0 2022-02-02T21:05:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.966+0000 7f7ed4f42700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 rx=0x7f7ec400e970 tx=0x7f7ec4007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.967+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec400c980 con 0x7f7ed00f55a0 2022-02-02T21:05:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.967+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ec4011470 con 0x7f7ed00f55a0 2022-02-02T21:05:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.967+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec4010630 con 0x7f7ed00f55a0 2022-02-02T21:05:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.967+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed0107330 con 0x7f7ed00f55a0 2022-02-02T21:05:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.967+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed01078c0 con 0x7f7ed00f55a0 2022-02-02T21:05:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.968+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0045ad0 con 0x7f7ed00f55a0 2022-02-02T21:05:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.968+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ec400cae0 con 0x7f7ed00f55a0 2022-02-02T21:05:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.969+0000 7f7ecd7fa700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 0x7f7ec00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.969+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ec4084b50 con 0x7f7ed00f55a0 2022-02-02T21:05:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.969+0000 7f7ecffff700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 0x7f7ec00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.969+0000 7f7ecffff700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 0x7f7ec00672e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f7ebc004e30 tx=0x7f7ebc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:10.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:10.973+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ec4052c50 con 0x7f7ed00f55a0 2022-02-02T21:05:11.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.150+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ed005f740 con 0x7f7ec0064e20 2022-02-02T21:05:11.152 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:10 smithi096 ceph-mon[101353]: pgmap v4892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:11.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.151+0000 7f7ecd7fa700 1 -- 172.21.15.96:0/870930576 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7ed005f740 con 0x7f7ec0064e20 2022-02-02T21:05:11.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 msgr2=0x7f7ec00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 0x7f7ec00672e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f7ebc004e30 tx=0x7f7ebc009b30).stop 2022-02-02T21:05:11.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 msgr2=0x7f7ed0105e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 rx=0x7f7ec400e970 tx=0x7f7ec4007eb0).stop 2022-02-02T21:05:11.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 shutdown_connections 2022-02-02T21:05:11.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ec0064e20 0x7f7ec00672e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ed00f55a0 0x7f7ed0105e10 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 --2- 172.21.15.96:0/870930576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed00f5eb0 0x7f7ed0106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 >> 172.21.15.96:0/870930576 conn(0x7f7ed00f0da0 msgr2=0x7f7ed00fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 shutdown_connections 2022-02-02T21:05:11.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.153+0000 7f7ed71a6700 1 -- 172.21.15.96:0/870930576 wait complete. 2022-02-02T21:05:11.164 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:05:11.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 -- 172.21.15.96:0/2462610753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 msgr2=0x7f3d940f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2462610753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d940f6b00 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 rx=0x7f3d88004660 tx=0x7f3d88009b30).stop 2022-02-02T21:05:11.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 -- 172.21.15.96:0/2462610753 shutdown_connections 2022-02-02T21:05:11.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2462610753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 0x7f3d940f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:05:11.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2462610753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d940f6b00 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 -- 172.21.15.96:0/2462610753 >> 172.21.15.96:0/2462610753 conn(0x7f3d940f1e40 msgr2=0x7f3d940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 -- 172.21.15.96:0/2462610753 shutdown_connections 2022-02-02T21:05:11.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 -- 172.21.15.96:0/2462610753 wait complete. 2022-02-02T21:05:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.250+0000 7f3d9b146700 1 Processor -- start 2022-02-02T21:05:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d9b146700 1 -- start start 2022-02-02T21:05:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d9b146700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d9b146700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 0x7f3d941074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d9b146700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94107ae0 con 0x7f3d940f66e0 2022-02-02T21:05:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d9b146700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94108390 con 0x7f3d940f7980 2022-02-02T21:05:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40744/0 (socket says 172.21.15.96:40744) 2022-02-02T21:05:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 -- 172.21.15.96:0/2360106228 learned_addr learned my addr 172.21.15.96:0/2360106228 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d93fff700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 0x7f3d941074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 -- 172.21.15.96:0/2360106228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 msgr2=0x7f3d941074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 0x7f3d941074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.251+0000 7f3d98ee2700 1 -- 172.21.15.96:0/2360106228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88005040 con 0x7f3d940f66e0 2022-02-02T21:05:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d98ee2700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 rx=0x7f3d88004f60 tx=0x7f3d88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d88018070 con 0x7f3d940f66e0 2022-02-02T21:05:11.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d88009770 con 0x7f3d940f66e0 2022-02-02T21:05:11.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d8801c3c0 con 0x7f3d940f66e0 2022-02-02T21:05:11.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94108610 con 0x7f3d940f66e0 2022-02-02T21:05:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.252+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94108b70 con 0x7f3d940f66e0 2022-02-02T21:05:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.253+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d940f5ad0 con 0x7f3d940f66e0 2022-02-02T21:05:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.253+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d8801d420 con 0x7f3d940f66e0 2022-02-02T21:05:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.254+0000 7f3d917fa700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 0x7f3d84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.254+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3d88083780 con 0x7f3d940f66e0 2022-02-02T21:05:11.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.254+0000 7f3d93fff700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 0x7f3d84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.254+0000 7f3d93fff700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 0x7f3d84067290 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f3d80006fd0 tx=0x7f3d80008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.258+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d880552b0 con 0x7f3d940f66e0 2022-02-02T21:05:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:10 smithi159 ceph-mon[69013]: pgmap v4892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:11.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.433+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d940fef90 con 0x7f3d84064dd0 2022-02-02T21:05:11.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.443+0000 7f3d917fa700 1 -- 172.21.15.96:0/2360106228 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3d940fef90 con 0x7f3d84064dd0 2022-02-02T21:05:11.444 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:05:11.444 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:05:11.444 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:05:11.445 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:05:11.445 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:05:11.445 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:05:11.445 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:05:11.446 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:05:11.446 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:05:11.446 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:05:11.446 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:05:11.447 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:05:11.447 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:05:11.447 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:05:11.447 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:05:11.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:05:11.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:05:11.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:05:11.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:05:11.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:05:11.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:05:11.449 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:05:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 msgr2=0x7f3d84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 0x7f3d84067290 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f3d80006fd0 tx=0x7f3d80008040).stop 2022-02-02T21:05:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 msgr2=0x7f3d94106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 rx=0x7f3d88004f60 tx=0x7f3d88009b30).stop 2022-02-02T21:05:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 shutdown_connections 2022-02-02T21:05:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d84064dd0 0x7f3d84067290 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d940f66e0 0x7f3d94106fb0 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 --2- 172.21.15.96:0/2360106228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d940f7980 0x7f3d941074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.444+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 >> 172.21.15.96:0/2360106228 conn(0x7f3d940f1e40 msgr2=0x7f3d940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.445+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 shutdown_connections 2022-02-02T21:05:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.445+0000 7f3d9b146700 1 -- 172.21.15.96:0/2360106228 wait complete. 2022-02-02T21:05:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 -- 172.21.15.96:0/4176713900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 msgr2=0x7f60540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 --2- 172.21.15.96:0/4176713900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f60540f7c30 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 rx=0x7f603c004660 tx=0x7f603c009b30).stop 2022-02-02T21:05:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 -- 172.21.15.96:0/4176713900 shutdown_connections 2022-02-02T21:05:11.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 --2- 172.21.15.96:0/4176713900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f60540f7c30 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 --2- 172.21.15.96:0/4176713900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 0x7f60540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 -- 172.21.15.96:0/4176713900 >> 172.21.15.96:0/4176713900 conn(0x7f60540f1c90 msgr2=0x7f60540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 -- 172.21.15.96:0/4176713900 shutdown_connections 2022-02-02T21:05:11.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.540+0000 7f605884f700 1 -- 172.21.15.96:0/4176713900 wait complete. 2022-02-02T21:05:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 Processor -- start 2022-02-02T21:05:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 -- start start 2022-02-02T21:05:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 0x7f605406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605406a380 con 0x7f60540f77d0 2022-02-02T21:05:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605884f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605406a4c0 con 0x7f60540f6530 2022-02-02T21:05:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40756/0 (socket says 172.21.15.96:40756) 2022-02-02T21:05:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 -- 172.21.15.96:0/2321711608 learned_addr learned my addr 172.21.15.96:0/2321711608 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f6052d9d700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 0x7f605406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 -- 172.21.15.96:0/2321711608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 msgr2=0x7f605406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 0x7f605406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.541+0000 7f605259c700 1 -- 172.21.15.96:0/2321711608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c005040 con 0x7f60540f77d0 2022-02-02T21:05:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f605259c700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 rx=0x7f603c009990 tx=0x7f603c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f603c018070 con 0x7f60540f77d0 2022-02-02T21:05:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f603c007ba0 con 0x7f60540f77d0 2022-02-02T21:05:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605406a740 con 0x7f60540f77d0 2022-02-02T21:05:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f603c01c3c0 con 0x7f60540f77d0 2022-02-02T21:05:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.542+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605406aca0 con 0x7f60540f77d0 2022-02-02T21:05:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.543+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6054045ad0 con 0x7f60540f77d0 2022-02-02T21:05:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.543+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f603c01d420 con 0x7f60540f77d0 2022-02-02T21:05:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.544+0000 7f604b7fe700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 0x7f60400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.544+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f603c083770 con 0x7f60540f77d0 2022-02-02T21:05:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.544+0000 7f6052d9d700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 0x7f60400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.544+0000 7f6052d9d700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 0x7f60400672e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f605406b730 tx=0x7f6044009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.548+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f603c051810 con 0x7f60540f77d0 2022-02-02T21:05:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.778+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6054027a00 con 0x7f60540f77d0 2022-02-02T21:05:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.778+0000 7f604b7fe700 1 -- 172.21.15.96:0/2321711608 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f603c054e30 con 0x7f60540f77d0 2022-02-02T21:05:11.780 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:05:11.780 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:05:11.781 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:05:11.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:11.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:05:11.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:05:11.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:11.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:05:11.783 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:05:11.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:11.784 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:05:11.785 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:05:11.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:11.785 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:05:11.785 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:05:11.786 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:05:11.786 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:05:11.786 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:05:11.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 msgr2=0x7f60400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 0x7f60400672e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f605406b730 tx=0x7f6044009040).stop 2022-02-02T21:05:11.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 msgr2=0x7f6054069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 rx=0x7f603c009990 tx=0x7f603c009b30).stop 2022-02-02T21:05:11.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 shutdown_connections 2022-02-02T21:05:11.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6040064e20 0x7f60400672e0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60540f6530 0x7f605406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 --2- 172.21.15.96:0/2321711608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60540f77d0 0x7f6054069e20 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 >> 172.21.15.96:0/2321711608 conn(0x7f60540f1c90 msgr2=0x7f60540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 shutdown_connections 2022-02-02T21:05:11.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.781+0000 7f605884f700 1 -- 172.21.15.96:0/2321711608 wait complete. 2022-02-02T21:05:11.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 -- 172.21.15.96:0/3506148419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0f96f0 msgr2=0x7f703c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 --2- 172.21.15.96:0/3506148419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0f96f0 0x7f703c0fbae0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 rx=0x7f702c004660 tx=0x7f702c009b30).stop 2022-02-02T21:05:11.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 -- 172.21.15.96:0/3506148419 shutdown_connections 2022-02-02T21:05:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 --2- 172.21.15.96:0/3506148419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0f96f0 0x7f703c0fbae0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 --2- 172.21.15.96:0/3506148419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0602b0 0x7f703c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.880+0000 7f703bfff700 1 -- 172.21.15.96:0/3506148419 >> 172.21.15.96:0/3506148419 conn(0x7f703c0f0b90 msgr2=0x7f703c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 -- 172.21.15.96:0/3506148419 shutdown_connections 2022-02-02T21:05:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 -- 172.21.15.96:0/3506148419 wait complete. 2022-02-02T21:05:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 Processor -- start 2022-02-02T21:05:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 -- start start 2022-02-02T21:05:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0f96f0 0x7f703c0f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0f55d0 con 0x7f703c0602b0 2022-02-02T21:05:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.881+0000 7f703bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0f5710 con 0x7f703c0f96f0 2022-02-02T21:05:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40764/0 (socket says 172.21.15.96:40764) 2022-02-02T21:05:11.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 -- 172.21.15.96:0/1620207513 learned_addr learned my addr 172.21.15.96:0/1620207513 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:11.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703a7fc700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0f96f0 0x7f703c0f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 -- 172.21.15.96:0/1620207513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0f96f0 msgr2=0x7f703c0f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:11.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0f96f0 0x7f703c0f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 -- 172.21.15.96:0/1620207513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c005040 con 0x7f703c0602b0 2022-02-02T21:05:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703affd700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 rx=0x7f703000e7f0 tx=0x7f703000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70300092e0 con 0x7f703c0602b0 2022-02-02T21:05:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f703000f040 con 0x7f703c0602b0 2022-02-02T21:05:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7030014750 con 0x7f703c0602b0 2022-02-02T21:05:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c0f59f0 con 0x7f703c0602b0 2022-02-02T21:05:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.882+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c10ecf0 con 0x7f703c0602b0 2022-02-02T21:05:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.883+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c045ad0 con 0x7f703c0602b0 2022-02-02T21:05:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.884+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f703001b030 con 0x7f703c0602b0 2022-02-02T21:05:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.884+0000 7f70237fe700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 0x7f70240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.884+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7030081730 con 0x7f703c0602b0 2022-02-02T21:05:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.884+0000 7f703a7fc700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 0x7f70240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:11.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.884+0000 7f703a7fc700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 0x7f70240672e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f702c004d80 tx=0x7f702c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:11.888+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f703004f8e0 con 0x7f703c0602b0 2022-02-02T21:05:12.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2321711608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:05:12.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.090+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f703c027a00 con 0x7f703c0602b0 2022-02-02T21:05:12.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.090+0000 7f70237fe700 1 -- 172.21.15.96:0/1620207513 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7030019720 con 0x7f703c0602b0 2022-02-02T21:05:12.092 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:05:12.092 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:05:12.092 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:05:12.093 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:05:12.093 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:12.093 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:05:12.093 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:05:12.094 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:05:12.094 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:05:12.094 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:05:12.094 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:05:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:05:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:05:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:05:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:05:12.095 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:05:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:05:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:05:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:05:12.096 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:05:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:05:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:05:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:05:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:05:12.097 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:05:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:05:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:05:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:05:12.098 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:05:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:05:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:05:12.099 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:05:12.099 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:12.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:12.100 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:05:12.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:12.100 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:12.100 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:12.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 msgr2=0x7f70240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 0x7f70240672e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f702c004d80 tx=0x7f702c016040).stop 2022-02-02T21:05:12.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 msgr2=0x7f703c0f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 rx=0x7f703000e7f0 tx=0x7f703000b040).stop 2022-02-02T21:05:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 shutdown_connections 2022-02-02T21:05:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7024064e20 0x7f70240672e0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f703c0602b0 0x7f703c0f6bf0 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:12.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 --2- 172.21.15.96:0/1620207513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f703c0f96f0 0x7f703c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:12.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 >> 172.21.15.96:0/1620207513 conn(0x7f703c0f0b90 msgr2=0x7f703c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:12.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 shutdown_connections 2022-02-02T21:05:12.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:12.092+0000 7f703bfff700 1 -- 172.21.15.96:0/1620207513 wait complete. 2022-02-02T21:05:12.104 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:05:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2321711608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:05:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:12 smithi096 ceph-mon[101353]: from='client.39122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:12 smithi096 ceph-mon[101353]: from='client.39126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:12 smithi096 ceph-mon[101353]: pgmap v4893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1620207513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:05:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:12 smithi159 ceph-mon[69013]: from='client.39122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:12 smithi159 ceph-mon[69013]: from='client.39126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:12 smithi159 ceph-mon[69013]: pgmap v4893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:13.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1620207513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:05:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:14 smithi159 ceph-mon[69013]: pgmap v4894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:14 smithi096 ceph-mon[101353]: pgmap v4894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:16 smithi159 ceph-mon[69013]: pgmap v4895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:16 smithi096 ceph-mon[101353]: pgmap v4895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:18 smithi159 ceph-mon[69013]: pgmap v4896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:18 smithi096 ceph-mon[101353]: pgmap v4896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:20 smithi159 ceph-mon[69013]: pgmap v4897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:20 smithi096 ceph-mon[101353]: pgmap v4897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:22 smithi096 ceph-mon[101353]: pgmap v4898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:22 smithi159 ceph-mon[69013]: pgmap v4898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:24 smithi159 ceph-mon[69013]: pgmap v4899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:24 smithi096 ceph-mon[101353]: pgmap v4899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:26 smithi159 ceph-mon[69013]: pgmap v4900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:26 smithi096 ceph-mon[101353]: pgmap v4900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:05:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:05:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:28 smithi159 ceph-mon[69013]: pgmap v4901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:05:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:05:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:28 smithi096 ceph-mon[101353]: pgmap v4901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:30 smithi159 ceph-mon[69013]: pgmap v4902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:30 smithi096 ceph-mon[101353]: pgmap v4902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:32 smithi096 ceph-mon[101353]: pgmap v4903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:32 smithi159 ceph-mon[69013]: pgmap v4903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:34 smithi159 ceph-mon[69013]: pgmap v4904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:34 smithi096 ceph-mon[101353]: pgmap v4904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:36 smithi159 ceph-mon[69013]: pgmap v4905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:36 smithi096 ceph-mon[101353]: pgmap v4905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:38 smithi159 ceph-mon[69013]: pgmap v4906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:38 smithi096 ceph-mon[101353]: pgmap v4906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:40 smithi159 ceph-mon[69013]: pgmap v4907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:40 smithi096 ceph-mon[101353]: pgmap v4907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:42.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- 172.21.15.96:0/1595947789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 msgr2=0x7f85980f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 --2- 172.21.15.96:0/1595947789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f85980f6b30 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 rx=0x7f8588004660 tx=0x7f8588009b30).stop 2022-02-02T21:05:42.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- 172.21.15.96:0/1595947789 shutdown_connections 2022-02-02T21:05:42.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 --2- 172.21.15.96:0/1595947789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f85980f6b30 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 --2- 172.21.15.96:0/1595947789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 0x7f85980f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- 172.21.15.96:0/1595947789 >> 172.21.15.96:0/1595947789 conn(0x7f85980f0b90 msgr2=0x7f85980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:42.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- 172.21.15.96:0/1595947789 shutdown_connections 2022-02-02T21:05:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- 172.21.15.96:0/1595947789 wait complete. 2022-02-02T21:05:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 Processor -- start 2022-02-02T21:05:42.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.202+0000 7f859ed64700 1 -- start start 2022-02-02T21:05:42.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859ed64700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 0x7f8598109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859ed64700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859ed64700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980603c0 con 0x7f85980f66d0 2022-02-02T21:05:42.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859ed64700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8598060500 con 0x7f85980f5430 2022-02-02T21:05:42.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40784/0 (socket says 172.21.15.96:40784) 2022-02-02T21:05:42.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 -- 172.21.15.96:0/1198705152 learned_addr learned my addr 172.21.15.96:0/1198705152 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:42.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859dd62700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 0x7f8598109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 -- 172.21.15.96:0/1198705152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 msgr2=0x7f8598109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 0x7f8598109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 -- 172.21.15.96:0/1198705152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588005040 con 0x7f85980f66d0 2022-02-02T21:05:42.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859d561700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 rx=0x7f8588009990 tx=0x7f8588009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8588018070 con 0x7f85980f66d0 2022-02-02T21:05:42.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8588007ba0 con 0x7f85980f66d0 2022-02-02T21:05:42.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859810c490 con 0x7f85980f66d0 2022-02-02T21:05:42.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.203+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858801c620 con 0x7f85980f66d0 2022-02-02T21:05:42.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.204+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859810c9c0 con 0x7f85980f66d0 2022-02-02T21:05:42.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.205+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598059100 con 0x7f85980f66d0 2022-02-02T21:05:42.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.205+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f858801c890 con 0x7f85980f66d0 2022-02-02T21:05:42.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.206+0000 7f858e7fc700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 0x7f85840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.206+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85880837b0 con 0x7f85980f66d0 2022-02-02T21:05:42.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.206+0000 7f859dd62700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 0x7f85840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.206+0000 7f859dd62700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 0x7f85840672e0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f8598060040 tx=0x7f8594009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.210+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85880518b0 con 0x7f85980f66d0 2022-02-02T21:05:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.390+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85980fdd70 con 0x7f8584064e20 2022-02-02T21:05:42.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.391+0000 7f858e7fc700 1 -- 172.21.15.96:0/1198705152 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f85980fdd70 con 0x7f8584064e20 2022-02-02T21:05:42.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 msgr2=0x7f85840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 0x7f85840672e0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f8598060040 tx=0x7f8594009040).stop 2022-02-02T21:05:42.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 msgr2=0x7f859810bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 rx=0x7f8588009990 tx=0x7f8588009b30).stop 2022-02-02T21:05:42.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 shutdown_connections 2022-02-02T21:05:42.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8584064e20 0x7f85840672e0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85980f5430 0x7f8598109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 --2- 172.21.15.96:0/1198705152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85980f66d0 0x7f859810bf40 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 >> 172.21.15.96:0/1198705152 conn(0x7f85980f0b90 msgr2=0x7f85980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:42.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 shutdown_connections 2022-02-02T21:05:42.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.393+0000 7f859ed64700 1 -- 172.21.15.96:0/1198705152 wait complete. 2022-02-02T21:05:42.405 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:05:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 -- 172.21.15.96:0/3499276652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f6530 msgr2=0x7f4df00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 --2- 172.21.15.96:0/3499276652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f6530 0x7f4df00f6950 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 rx=0x7f4de4004660 tx=0x7f4de4009b30).stop 2022-02-02T21:05:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 -- 172.21.15.96:0/3499276652 shutdown_connections 2022-02-02T21:05:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 --2- 172.21.15.96:0/3499276652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f77d0 0x7f4df00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 --2- 172.21.15.96:0/3499276652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f6530 0x7f4df00f6950 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 -- 172.21.15.96:0/3499276652 >> 172.21.15.96:0/3499276652 conn(0x7f4df00f1c90 msgr2=0x7f4df00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 -- 172.21.15.96:0/3499276652 shutdown_connections 2022-02-02T21:05:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 -- 172.21.15.96:0/3499276652 wait complete. 2022-02-02T21:05:42.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.491+0000 7f4def59e700 1 Processor -- start 2022-02-02T21:05:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4def59e700 1 -- start start 2022-02-02T21:05:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4def59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f6530 0x7f4df006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4def59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4def59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df006a380 con 0x7f4df00f77d0 2022-02-02T21:05:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4def59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df006a4c0 con 0x7f4df00f6530 2022-02-02T21:05:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40794/0 (socket says 172.21.15.96:40794) 2022-02-02T21:05:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 -- 172.21.15.96:0/1164209784 learned_addr learned my addr 172.21.15.96:0/1164209784 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dee59c700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f6530 0x7f4df006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 -- 172.21.15.96:0/1164209784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f6530 msgr2=0x7f4df006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f6530 0x7f4df006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 -- 172.21.15.96:0/1164209784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4005040 con 0x7f4df00f77d0 2022-02-02T21:05:42.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.492+0000 7f4dedd9b700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 rx=0x7f4de00026d0 tx=0x7f4de0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.493+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de0009320 con 0x7f4df00f77d0 2022-02-02T21:05:42.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.493+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df006a7a0 con 0x7f4df00f77d0 2022-02-02T21:05:42.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.493+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4de000f040 con 0x7f4df00f77d0 2022-02-02T21:05:42.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.493+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de00147e0 con 0x7f4df00f77d0 2022-02-02T21:05:42.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.493+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df010edb0 con 0x7f4df00f77d0 2022-02-02T21:05:42.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.494+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0045ad0 con 0x7f4df00f77d0 2022-02-02T21:05:42.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.494+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4de0009480 con 0x7f4df00f77d0 2022-02-02T21:05:42.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.494+0000 7f4ddeffd700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 0x7f4dd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.495+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4de0082120 con 0x7f4df00f77d0 2022-02-02T21:05:42.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.495+0000 7f4dee59c700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 0x7f4dd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.495+0000 7f4dee59c700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 0x7f4dd80672e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f4de4004e30 tx=0x7f4de4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.499+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4de0050220 con 0x7f4df00f77d0 2022-02-02T21:05:42.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.672+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4df00fee00 con 0x7f4dd8064e20 2022-02-02T21:05:42.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.681+0000 7f4ddeffd700 1 -- 172.21.15.96:0/1164209784 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4df00fee00 con 0x7f4dd8064e20 2022-02-02T21:05:42.683 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:05:42.684 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:05:42.684 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:05:42.684 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:05:42.685 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:05:42.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:05:42.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:05:42.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:05:42.685 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:05:42.686 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:05:42.686 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:05:42.686 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:05:42.686 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:05:42.687 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:05:42.687 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:05:42.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:05:42.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:05:42.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:05:42.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:05:42.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:05:42.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:05:42.688 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:05:42.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 msgr2=0x7f4dd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 0x7f4dd80672e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f4de4004e30 tx=0x7f4de4009b30).stop 2022-02-02T21:05:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 msgr2=0x7f4df0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 rx=0x7f4de00026d0 tx=0x7f4de0009de0).stop 2022-02-02T21:05:42.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 shutdown_connections 2022-02-02T21:05:42.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4dd8064e20 0x7f4dd80672e0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df00f6530 0x7f4df006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 --2- 172.21.15.96:0/1164209784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df00f77d0 0x7f4df0069e20 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 >> 172.21.15.96:0/1164209784 conn(0x7f4df00f1c90 msgr2=0x7f4df00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:42.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 shutdown_connections 2022-02-02T21:05:42.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.683+0000 7f4def59e700 1 -- 172.21.15.96:0/1164209784 wait complete. 2022-02-02T21:05:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/4066128469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 msgr2=0x7ff2d00f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/4066128469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d00f4fe0 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 rx=0x7ff2c0004660 tx=0x7ff2c0009b30).stop 2022-02-02T21:05:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/4066128469 shutdown_connections 2022-02-02T21:05:42.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/4066128469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 0x7ff2d00f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/4066128469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d00f4fe0 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.778+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/4066128469 >> 172.21.15.96:0/4066128469 conn(0x7ff2d00f0320 msgr2=0x7ff2d00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:42.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/4066128469 shutdown_connections 2022-02-02T21:05:42.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/4066128469 wait complete. 2022-02-02T21:05:42.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 Processor -- start 2022-02-02T21:05:42.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 -- start start 2022-02-02T21:05:42.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.779+0000 7ff2d4f1d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 0x7ff2d010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2d4f1d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00f8660 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2d4f1d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00f87a0 con 0x7ff2d00f5e60 2022-02-02T21:05:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40802/0 (socket says 172.21.15.96:40802) 2022-02-02T21:05:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 -- 172.21.15.96:0/3946813625 learned_addr learned my addr 172.21.15.96:0/3946813625 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2ceffd700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 0x7ff2d010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 -- 172.21.15.96:0/3946813625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 msgr2=0x7ff2d010bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:42.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 0x7ff2d010bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 -- 172.21.15.96:0/3946813625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0005040 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2cf7fe700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 rx=0x7ff2c0013a70 tx=0x7ff2c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c0018070 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.780+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d010c4f0 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.781+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2c00097d0 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.781+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c001de80 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.781+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d010ca50 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.782+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0045ad0 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.782+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2c0007ba0 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.782+0000 7ff2b7fff700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 0x7ff2b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.783+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2c0083660 con 0x7ff2d00f4bc0 2022-02-02T21:05:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.783+0000 7ff2ceffd700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 0x7ff2b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:42.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.783+0000 7ff2ceffd700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 0x7ff2b80672e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7ff2c4004c40 tx=0x7ff2c400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:42.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:42.787+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2c0051760 con 0x7ff2d00f4bc0 2022-02-02T21:05:43.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.018+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2d00fd500 con 0x7ff2d00f4bc0 2022-02-02T21:05:43.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.019+0000 7ff2b7fff700 1 -- 172.21.15.96:0/3946813625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff2c0054d80 con 0x7ff2d00f4bc0 2022-02-02T21:05:43.022 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:05:43.022 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:05:43.022 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:05:43.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:43.023 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:05:43.023 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:05:43.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:43.023 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:05:43.024 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:05:43.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:43.024 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:05:43.024 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:05:43.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:05:43.025 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:05:43.025 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:05:43.025 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:05:43.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:05:43.026 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:05:43.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.020+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 msgr2=0x7ff2b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.020+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 0x7ff2b80672e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7ff2c4004c40 tx=0x7ff2c400b040).stop 2022-02-02T21:05:43.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.020+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 msgr2=0x7ff2d0109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.020+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 rx=0x7ff2c0013a70 tx=0x7ff2c0009b30).stop 2022-02-02T21:05:43.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 shutdown_connections 2022-02-02T21:05:43.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2b8064e20 0x7ff2b80672e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d00f4bc0 0x7ff2d0109aa0 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 --2- 172.21.15.96:0/3946813625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d00f5e60 0x7ff2d010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 >> 172.21.15.96:0/3946813625 conn(0x7ff2d00f0320 msgr2=0x7ff2d005e570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:43.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 shutdown_connections 2022-02-02T21:05:43.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.021+0000 7ff2d4f1d700 1 -- 172.21.15.96:0/3946813625 wait complete. 2022-02-02T21:05:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:42 smithi096 ceph-mon[101353]: pgmap v4908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:43.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 -- 172.21.15.96:0/2102088865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 msgr2=0x7f9ae40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/2102088865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae40f7de0 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 rx=0x7f9ad8004660 tx=0x7f9ad8009b30).stop 2022-02-02T21:05:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 -- 172.21.15.96:0/2102088865 shutdown_connections 2022-02-02T21:05:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/2102088865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae40f7de0 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/2102088865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 0x7f9ae40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 -- 172.21.15.96:0/2102088865 >> 172.21.15.96:0/2102088865 conn(0x7f9ae40f1e40 msgr2=0x7f9ae40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:43.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 -- 172.21.15.96:0/2102088865 shutdown_connections 2022-02-02T21:05:43.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 -- 172.21.15.96:0/2102088865 wait complete. 2022-02-02T21:05:43.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.119+0000 7f9ae90cd700 1 Processor -- start 2022-02-02T21:05:43.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 -- start start 2022-02-02T21:05:43.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 0x7f9ae4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:43.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:43.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4107a00 con 0x7f9ae40f7980 2022-02-02T21:05:43.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4107b40 con 0x7f9ae40f66e0 2022-02-02T21:05:43.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:43.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40814/0 (socket says 172.21.15.96:40814) 2022-02-02T21:05:43.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 -- 172.21.15.96:0/784500234 learned_addr learned my addr 172.21.15.96:0/784500234 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:05:43.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae2d9d700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 0x7f9ae4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:43.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 -- 172.21.15.96:0/784500234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 msgr2=0x7f9ae4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 0x7f9ae4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 -- 172.21.15.96:0/784500234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8005040 con 0x7f9ae40f7980 2022-02-02T21:05:43.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae259c700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 rx=0x7f9ad8009990 tx=0x7f9ad8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:43.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad8018070 con 0x7f9ae40f7980 2022-02-02T21:05:43.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ad8007ba0 con 0x7f9ae40f7980 2022-02-02T21:05:43.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.120+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae4108480 con 0x7f9ae40f7980 2022-02-02T21:05:43.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.121+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad801c620 con 0x7f9ae40f7980 2022-02-02T21:05:43.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.121+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae41089e0 con 0x7f9ae40f7980 2022-02-02T21:05:43.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.122+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae4045ad0 con 0x7f9ae40f7980 2022-02-02T21:05:43.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.122+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ad801c8e0 con 0x7f9ae40f7980 2022-02-02T21:05:43.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.123+0000 7f9acb7fe700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 0x7f9acc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:05:43.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.123+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ad8083bb0 con 0x7f9ae40f7980 2022-02-02T21:05:43.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.123+0000 7f9ae2d9d700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 0x7f9acc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:05:43.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.123+0000 7f9ae2d9d700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 0x7f9acc067290 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f9ae40f77e0 tx=0x7f9ad4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:05:43.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.126+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ad8055620 con 0x7f9ae40f7980 2022-02-02T21:05:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:42 smithi159 ceph-mon[69013]: pgmap v4908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.328+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9ae4027a00 con 0x7f9ae40f7980 2022-02-02T21:05:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.329+0000 7f9acb7fe700 1 -- 172.21.15.96:0/784500234 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9ad8055210 con 0x7f9ae40f7980 2022-02-02T21:05:43.331 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:05:43.332 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:05:43.332 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:05:43.332 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:05:43.333 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:43.333 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:05:43.333 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:05:43.333 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:05:43.333 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:05:43.334 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:05:43.334 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:05:43.334 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:05:43.334 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:05:43.335 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:05:43.335 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:05:43.335 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:05:43.335 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:05:43.336 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:05:43.336 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:05:43.336 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:05:43.336 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:05:43.336 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:05:43.337 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:05:43.337 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:05:43.337 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:05:43.338 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:05:43.338 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:05:43.338 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:05:43.338 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:05:43.339 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:05:43.339 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:05:43.339 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:05:43.339 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:43.339 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:05:43.340 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:05:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:05:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 msgr2=0x7f9acc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 0x7f9acc067290 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f9ae40f77e0 tx=0x7f9ad4009040).stop 2022-02-02T21:05:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 msgr2=0x7f9ae4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:05:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 rx=0x7f9ad8009990 tx=0x7f9ad8009b30).stop 2022-02-02T21:05:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 shutdown_connections 2022-02-02T21:05:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9acc064dd0 0x7f9acc067290 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ae40f66e0 0x7f9ae4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 --2- 172.21.15.96:0/784500234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae40f7980 0x7f9ae4107450 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:05:43.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.330+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 >> 172.21.15.96:0/784500234 conn(0x7f9ae40f1e40 msgr2=0x7f9ae40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:05:43.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.331+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 shutdown_connections 2022-02-02T21:05:43.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:05:43.331+0000 7f9ae90cd700 1 -- 172.21.15.96:0/784500234 wait complete. 2022-02-02T21:05:43.344 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:05:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:43 smithi159 ceph-mon[69013]: from='client.39138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:43 smithi159 ceph-mon[69013]: from='client.39142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:44.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3946813625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:05:44.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/784500234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:05:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:43 smithi096 ceph-mon[101353]: from='client.39138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:43 smithi096 ceph-mon[101353]: from='client.39142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:05:44.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3946813625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:05:44.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/784500234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:05:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:44 smithi159 ceph-mon[69013]: pgmap v4909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:44 smithi096 ceph-mon[101353]: pgmap v4909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:46 smithi159 ceph-mon[69013]: pgmap v4910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:46 smithi096 ceph-mon[101353]: pgmap v4910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:48 smithi159 ceph-mon[69013]: pgmap v4911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:48 smithi096 ceph-mon[101353]: pgmap v4911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:50 smithi159 ceph-mon[69013]: pgmap v4912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:50 smithi096 ceph-mon[101353]: pgmap v4912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:52 smithi096 ceph-mon[101353]: pgmap v4913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:52 smithi159 ceph-mon[69013]: pgmap v4913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:54 smithi159 ceph-mon[69013]: pgmap v4914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:54 smithi096 ceph-mon[101353]: pgmap v4914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:56 smithi159 ceph-mon[69013]: pgmap v4915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:56 smithi096 ceph-mon[101353]: pgmap v4915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:05:58 smithi159 ceph-mon[69013]: pgmap v4916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:05:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:05:58 smithi096 ceph-mon[101353]: pgmap v4916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:00 smithi159 ceph-mon[69013]: pgmap v4917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:00 smithi096 ceph-mon[101353]: pgmap v4917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:02 smithi096 ceph-mon[101353]: pgmap v4918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:02 smithi159 ceph-mon[69013]: pgmap v4918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:04 smithi159 ceph-mon[69013]: pgmap v4919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:04 smithi096 ceph-mon[101353]: pgmap v4919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:06 smithi159 ceph-mon[69013]: pgmap v4920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:07.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:06 smithi096 ceph-mon[101353]: pgmap v4920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:08 smithi159 ceph-mon[69013]: pgmap v4921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:08 smithi096 ceph-mon[101353]: pgmap v4921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:10 smithi159 ceph-mon[69013]: pgmap v4922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:10 smithi096 ceph-mon[101353]: pgmap v4922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:12 smithi096 ceph-mon[101353]: pgmap v4923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:12 smithi159 ceph-mon[69013]: pgmap v4923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:13.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 -- 172.21.15.96:0/1413691769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f55c0 msgr2=0x7f39f40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 --2- 172.21.15.96:0/1413691769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f55c0 0x7f39f40f59e0 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 rx=0x7f39e8004660 tx=0x7f39e8009b30).stop 2022-02-02T21:06:13.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 -- 172.21.15.96:0/1413691769 shutdown_connections 2022-02-02T21:06:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 --2- 172.21.15.96:0/1413691769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f6860 0x7f39f40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 --2- 172.21.15.96:0/1413691769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f55c0 0x7f39f40f59e0 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 -- 172.21.15.96:0/1413691769 >> 172.21.15.96:0/1413691769 conn(0x7f39f40f0d40 msgr2=0x7f39f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 -- 172.21.15.96:0/1413691769 shutdown_connections 2022-02-02T21:06:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.442+0000 7f39fa0df700 1 -- 172.21.15.96:0/1413691769 wait complete. 2022-02-02T21:06:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 Processor -- start 2022-02-02T21:06:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 -- start start 2022-02-02T21:06:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f55c0 0x7f39f4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40603e0 con 0x7f39f40f6860 2022-02-02T21:06:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39fa0df700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4060520 con 0x7f39f40f55c0 2022-02-02T21:06:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40836/0 (socket says 172.21.15.96:40836) 2022-02-02T21:06:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39f2ffd700 1 -- 172.21.15.96:0/3912038491 learned_addr learned my addr 172.21.15.96:0/3912038491 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39f37fe700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f55c0 0x7f39f4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.443+0000 7f39f2ffd700 1 -- 172.21.15.96:0/3912038491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f55c0 msgr2=0x7f39f4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39f2ffd700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f55c0 0x7f39f4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39f2ffd700 1 -- 172.21.15.96:0/3912038491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8005040 con 0x7f39f40f6860 2022-02-02T21:06:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39f2ffd700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 rx=0x7f39e40026d0 tx=0x7f39e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e40079c0 con 0x7f39f40f6860 2022-02-02T21:06:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f410c720 con 0x7f39f40f6860 2022-02-02T21:06:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39e400f040 con 0x7f39f40f6860 2022-02-02T21:06:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e40148b0 con 0x7f39f40f6860 2022-02-02T21:06:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.444+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f410cce0 con 0x7f39f40f6860 2022-02-02T21:06:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.445+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f4045ad0 con 0x7f39f40f6860 2022-02-02T21:06:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.446+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f39e4007b20 con 0x7f39f40f6860 2022-02-02T21:06:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.446+0000 7f39dbfff700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.446+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f39e4081900 con 0x7f39f40f6860 2022-02-02T21:06:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.446+0000 7f39f37fe700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.446+0000 7f39f37fe700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f39e8013690 tx=0x7f39e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:13.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.450+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39e404fa00 con 0x7f39f40f6860 2022-02-02T21:06:13.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.627+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39f4057f10 con 0x7f39dc064dd0 2022-02-02T21:06:13.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.629+0000 7f39dbfff700 1 -- 172.21.15.96:0/3912038491 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f39f4057f10 con 0x7f39dc064dd0 2022-02-02T21:06:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 msgr2=0x7f39dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f39e8013690 tx=0x7f39e8009b30).stop 2022-02-02T21:06:13.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 msgr2=0x7f39f410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 rx=0x7f39e40026d0 tx=0x7f39e4009de0).stop 2022-02-02T21:06:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 shutdown_connections 2022-02-02T21:06:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39dc064dd0 0x7f39dc067290 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f40f55c0 0x7f39f4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 --2- 172.21.15.96:0/3912038491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39f40f6860 0x7f39f410c170 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.630+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 >> 172.21.15.96:0/3912038491 conn(0x7f39f40f0d40 msgr2=0x7f39f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:13.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.631+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 shutdown_connections 2022-02-02T21:06:13.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.631+0000 7f39fa0df700 1 -- 172.21.15.96:0/3912038491 wait complete. 2022-02-02T21:06:13.641 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:06:13.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 -- 172.21.15.96:0/3021032467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f66e0 msgr2=0x7ff8700f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 --2- 172.21.15.96:0/3021032467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f66e0 0x7ff8700f6b00 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 rx=0x7ff864004660 tx=0x7ff864009b30).stop 2022-02-02T21:06:13.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 -- 172.21.15.96:0/3021032467 shutdown_connections 2022-02-02T21:06:13.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 --2- 172.21.15.96:0/3021032467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f7980 0x7ff8700f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 --2- 172.21.15.96:0/3021032467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f66e0 0x7ff8700f6b00 unknown :-1 s=CLOSED pgs=2525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 -- 172.21.15.96:0/3021032467 >> 172.21.15.96:0/3021032467 conn(0x7ff8700f1e40 msgr2=0x7ff8700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.728+0000 7ff878325700 1 -- 172.21.15.96:0/3021032467 shutdown_connections 2022-02-02T21:06:13.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 -- 172.21.15.96:0/3021032467 wait complete. 2022-02-02T21:06:13.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 Processor -- start 2022-02-02T21:06:13.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 -- start start 2022-02-02T21:06:13.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f66e0 0x7ff870106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870107a50 con 0x7ff8700f7980 2022-02-02T21:06:13.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff878325700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870107b90 con 0x7ff8700f66e0 2022-02-02T21:06:13.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff8758c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff8758c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40846/0 (socket says 172.21.15.96:40846) 2022-02-02T21:06:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff8758c0700 1 -- 172.21.15.96:0/3243829468 learned_addr learned my addr 172.21.15.96:0/3243829468 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.729+0000 7ff8760c1700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f66e0 0x7ff870106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff8758c0700 1 -- 172.21.15.96:0/3243829468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f66e0 msgr2=0x7ff870106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff8758c0700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f66e0 0x7ff870106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff8758c0700 1 -- 172.21.15.96:0/3243829468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864005040 con 0x7ff8700f7980 2022-02-02T21:06:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff8758c0700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 rx=0x7ff86c00c530 tx=0x7ff86c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86c00f650 con 0x7ff8700f7980 2022-02-02T21:06:13.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff86c00fc60 con 0x7ff8700f7980 2022-02-02T21:06:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff870108530 con 0x7ff8700f7980 2022-02-02T21:06:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86c012c20 con 0x7ff8700f7980 2022-02-02T21:06:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.730+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870108af0 con 0x7ff8700f7980 2022-02-02T21:06:13.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.731+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff870045ad0 con 0x7ff8700f7980 2022-02-02T21:06:13.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.731+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff86c010070 con 0x7ff8700f7980 2022-02-02T21:06:13.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.732+0000 7ff862ffd700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 0x7ff85c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:13.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.732+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff86c081720 con 0x7ff8700f7980 2022-02-02T21:06:13.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.732+0000 7ff8760c1700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 0x7ff85c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:13.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.732+0000 7ff8760c1700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 0x7ff85c067290 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7ff864004630 tx=0x7ff864009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:13.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.736+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff86c053250 con 0x7ff8700f7980 2022-02-02T21:06:13.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.909+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff870108d10 con 0x7ff85c064dd0 2022-02-02T21:06:13.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.918+0000 7ff862ffd700 1 -- 172.21.15.96:0/3243829468 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff870108d10 con 0x7ff85c064dd0 2022-02-02T21:06:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:06:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:06:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:06:13.921 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:06:13.921 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:06:13.921 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:06:13.921 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:06:13.921 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:06:13.922 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:06:13.922 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:06:13.922 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:06:13.922 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:06:13.923 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:06:13.923 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:06:13.923 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:06:13.923 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:06:13.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:06:13.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:06:13.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:06:13.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:06:13.924 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:06:13.925 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:06:13.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 msgr2=0x7ff85c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 0x7ff85c067290 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7ff864004630 tx=0x7ff864009b30).stop 2022-02-02T21:06:13.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 msgr2=0x7ff8701074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:13.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 rx=0x7ff86c00c530 tx=0x7ff86c007e20).stop 2022-02-02T21:06:13.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 shutdown_connections 2022-02-02T21:06:13.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff85c064dd0 0x7ff85c067290 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8700f66e0 0x7ff870106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 --2- 172.21.15.96:0/3243829468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8700f7980 0x7ff8701074a0 unknown :-1 s=CLOSED pgs=2526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:13.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 >> 172.21.15.96:0/3243829468 conn(0x7ff8700f1e40 msgr2=0x7ff8700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:13.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 shutdown_connections 2022-02-02T21:06:13.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:13.920+0000 7ff878325700 1 -- 172.21.15.96:0/3243829468 wait complete. 2022-02-02T21:06:14.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 -- 172.21.15.96:0/409730377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 msgr2=0x7fad580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 --2- 172.21.15.96:0/409730377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad580f6cc0 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 rx=0x7fad40004660 tx=0x7fad40009b30).stop 2022-02-02T21:06:14.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 -- 172.21.15.96:0/409730377 shutdown_connections 2022-02-02T21:06:14.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 --2- 172.21.15.96:0/409730377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad580f6cc0 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 --2- 172.21.15.96:0/409730377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 0x7fad580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 -- 172.21.15.96:0/409730377 >> 172.21.15.96:0/409730377 conn(0x7fad580f0d40 msgr2=0x7fad580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 -- 172.21.15.96:0/409730377 shutdown_connections 2022-02-02T21:06:14.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.016+0000 7fad5e77a700 1 -- 172.21.15.96:0/409730377 wait complete. 2022-02-02T21:06:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 Processor -- start 2022-02-02T21:06:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 -- start start 2022-02-02T21:06:14.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 0x7fad58106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58107a10 con 0x7fad580f6860 2022-02-02T21:06:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad5e77a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58107b50 con 0x7fad580f55c0 2022-02-02T21:06:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.017+0000 7fad577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40856/0 (socket says 172.21.15.96:40856) 2022-02-02T21:06:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad577fe700 1 -- 172.21.15.96:0/2035176536 learned_addr learned my addr 172.21.15.96:0/2035176536 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad57fff700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 0x7fad58106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad577fe700 1 -- 172.21.15.96:0/2035176536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 msgr2=0x7fad58106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad577fe700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 0x7fad58106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad577fe700 1 -- 172.21.15.96:0/2035176536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40005040 con 0x7fad580f6860 2022-02-02T21:06:14.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad577fe700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 rx=0x7fad40009990 tx=0x7fad40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:14.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40018070 con 0x7fad580f6860 2022-02-02T21:06:14.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad40007ba0 con 0x7fad580f6860 2022-02-02T21:06:14.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58108490 con 0x7fad580f6860 2022-02-02T21:06:14.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4001c620 con 0x7fad580f6860 2022-02-02T21:06:14.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.018+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad581089f0 con 0x7fad580f6860 2022-02-02T21:06:14.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.019+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58045ad0 con 0x7fad580f6860 2022-02-02T21:06:14.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.019+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad4001c8e0 con 0x7fad580f6860 2022-02-02T21:06:14.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.020+0000 7fad54ff9700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 0x7fad44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.020+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fad40083890 con 0x7fad580f6860 2022-02-02T21:06:14.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.020+0000 7fad57fff700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 0x7fad44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.020+0000 7fad57fff700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 0x7fad44067290 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fad580f66c0 tx=0x7fad48009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:14.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.024+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad400553c0 con 0x7fad580f6860 2022-02-02T21:06:14.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.253+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad580fdd80 con 0x7fad580f6860 2022-02-02T21:06:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.253+0000 7fad54ff9700 1 -- 172.21.15.96:0/2035176536 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fad40054fb0 con 0x7fad580f6860 2022-02-02T21:06:14.256 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:06:14.256 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:06:14.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:06:14.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:14.258 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:06:14.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:06:14.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:14.259 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:06:14.259 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:06:14.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:14.260 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:06:14.261 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:06:14.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:14.261 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:06:14.262 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:06:14.262 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:06:14.262 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:06:14.263 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:06:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 msgr2=0x7fad44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 0x7fad44067290 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fad580f66c0 tx=0x7fad48009040).stop 2022-02-02T21:06:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 msgr2=0x7fad58107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 rx=0x7fad40009990 tx=0x7fad40009b30).stop 2022-02-02T21:06:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 shutdown_connections 2022-02-02T21:06:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad44064dd0 0x7fad44067290 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580f55c0 0x7fad58106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 --2- 172.21.15.96:0/2035176536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad580f6860 0x7fad58107460 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 >> 172.21.15.96:0/2035176536 conn(0x7fad580f0d40 msgr2=0x7fad5805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 shutdown_connections 2022-02-02T21:06:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.256+0000 7fad5e77a700 1 -- 172.21.15.96:0/2035176536 wait complete. 2022-02-02T21:06:14.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 -- 172.21.15.96:0/1125481241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 msgr2=0x7f3b980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/1125481241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f6cc0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 rx=0x7f3b8c004660 tx=0x7f3b8c009b30).stop 2022-02-02T21:06:14.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 -- 172.21.15.96:0/1125481241 shutdown_connections 2022-02-02T21:06:14.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/1125481241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f6cc0 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/1125481241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 -- 172.21.15.96:0/1125481241 >> 172.21.15.96:0/1125481241 conn(0x7f3b980f0d20 msgr2=0x7f3b980f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:14.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 -- 172.21.15.96:0/1125481241 shutdown_connections 2022-02-02T21:06:14.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.354+0000 7f3b9ea45700 1 -- 172.21.15.96:0/1125481241 wait complete. 2022-02-02T21:06:14.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 Processor -- start 2022-02-02T21:06:14.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 -- start start 2022-02-02T21:06:14.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980f8100 con 0x7f3b980f6860 2022-02-02T21:06:14.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b9ea45700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980f8240 con 0x7f3b980f55c0 2022-02-02T21:06:14.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40866/0 (socket says 172.21.15.96:40866) 2022-02-02T21:06:14.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.355+0000 7f3b977fe700 1 -- 172.21.15.96:0/2617911838 learned_addr learned my addr 172.21.15.96:0/2617911838 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:14.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b97fff700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b977fe700 1 -- 172.21.15.96:0/2617911838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 msgr2=0x7f3b980f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b977fe700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b977fe700 1 -- 172.21.15.96:0/2617911838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c005040 con 0x7f3b980f6860 2022-02-02T21:06:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b97fff700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:06:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b977fe700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 rx=0x7f3b8c009990 tx=0x7f3b8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c018070 con 0x7f3b980f6860 2022-02-02T21:06:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b8c007ca0 con 0x7f3b980f6860 2022-02-02T21:06:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980f84c0 con 0x7f3b980f6860 2022-02-02T21:06:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c01c620 con 0x7f3b980f6860 2022-02-02T21:06:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.356+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980f8a20 con 0x7f3b980f6860 2022-02-02T21:06:14.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.357+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b98045ad0 con 0x7f3b980f6860 2022-02-02T21:06:14.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.358+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b8c01c8e0 con 0x7f3b980f6860 2022-02-02T21:06:14.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.358+0000 7f3b94ff9700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 0x7f3b80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.358+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3b8c0837f0 con 0x7f3b980f6860 2022-02-02T21:06:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.358+0000 7f3b97fff700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 0x7f3b80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.359+0000 7f3b97fff700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 0x7f3b80067290 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f3b980f94b0 tx=0x7f3b88009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.362+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b8c0518f0 con 0x7f3b980f6860 2022-02-02T21:06:14.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.563+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b980fdd80 con 0x7f3b980f6860 2022-02-02T21:06:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.564+0000 7f3b94ff9700 1 -- 172.21.15.96:0/2617911838 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3b8c054f10 con 0x7f3b980f6860 2022-02-02T21:06:14.565 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:06:14.566 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:06:14.566 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:06:14.566 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:06:14.567 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:14.567 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:06:14.567 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:06:14.567 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:06:14.568 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:06:14.568 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:06:14.568 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:06:14.568 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:06:14.569 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:06:14.569 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:06:14.569 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:06:14.569 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:06:14.570 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:06:14.570 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:06:14.570 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:06:14.571 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:06:14.571 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:06:14.571 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:06:14.572 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:06:14.572 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:06:14.572 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:06:14.573 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:06:14.573 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:06:14.574 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:06:14.574 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:06:14.574 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:06:14.575 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:06:14.575 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:06:14.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:14.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:06:14.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:14.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 msgr2=0x7f3b80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 0x7f3b80067290 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f3b980f94b0 tx=0x7f3b88009040).stop 2022-02-02T21:06:14.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 msgr2=0x7f3b980f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:14.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 rx=0x7f3b8c009990 tx=0x7f3b8c009b30).stop 2022-02-02T21:06:14.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 shutdown_connections 2022-02-02T21:06:14.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b80064dd0 0x7f3b80067290 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b980f55c0 0x7f3b980f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 --2- 172.21.15.96:0/2617911838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b980f6860 0x7f3b980f7ba0 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.565+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 >> 172.21.15.96:0/2617911838 conn(0x7f3b980f0d20 msgr2=0x7f3b9805ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:14.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.566+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 shutdown_connections 2022-02-02T21:06:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:14.566+0000 7f3b9ea45700 1 -- 172.21.15.96:0/2617911838 wait complete. 2022-02-02T21:06:14.584 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:06:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:14 smithi159 ceph-mon[69013]: from='client.39154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:14 smithi159 ceph-mon[69013]: pgmap v4924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:14 smithi159 ceph-mon[69013]: from='client.39158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2035176536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:06:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2617911838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:06:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:14 smithi096 ceph-mon[101353]: from='client.39154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:14 smithi096 ceph-mon[101353]: pgmap v4924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:14 smithi096 ceph-mon[101353]: from='client.39158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2035176536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:06:15.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2617911838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:06:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:16 smithi159 ceph-mon[69013]: pgmap v4925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:16 smithi096 ceph-mon[101353]: pgmap v4925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:18 smithi159 ceph-mon[69013]: pgmap v4926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:18 smithi096 ceph-mon[101353]: pgmap v4926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:20 smithi159 ceph-mon[69013]: pgmap v4927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:20 smithi096 ceph-mon[101353]: pgmap v4927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:22 smithi096 ceph-mon[101353]: pgmap v4928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:22 smithi159 ceph-mon[69013]: pgmap v4928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:24 smithi159 ceph-mon[69013]: pgmap v4929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:24 smithi096 ceph-mon[101353]: pgmap v4929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:26 smithi159 ceph-mon[69013]: pgmap v4930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:26 smithi096 ceph-mon[101353]: pgmap v4930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:06:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:06:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:28 smithi159 ceph-mon[69013]: pgmap v4931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:06:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:06:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:28 smithi096 ceph-mon[101353]: pgmap v4931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:30 smithi159 ceph-mon[69013]: pgmap v4932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:30 smithi096 ceph-mon[101353]: pgmap v4932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:32 smithi096 ceph-mon[101353]: pgmap v4933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:32 smithi159 ceph-mon[69013]: pgmap v4933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:34 smithi159 ceph-mon[69013]: pgmap v4934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:34 smithi096 ceph-mon[101353]: pgmap v4934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:36 smithi159 ceph-mon[69013]: pgmap v4935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:36 smithi096 ceph-mon[101353]: pgmap v4935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:38 smithi159 ceph-mon[69013]: pgmap v4936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:38 smithi096 ceph-mon[101353]: pgmap v4936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:40 smithi159 ceph-mon[69013]: pgmap v4937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:40 smithi096 ceph-mon[101353]: pgmap v4937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:42 smithi096 ceph-mon[101353]: pgmap v4938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:42 smithi159 ceph-mon[69013]: pgmap v4938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:44.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 -- 172.21.15.96:0/4161307054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f55c0 msgr2=0x7f46e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 --2- 172.21.15.96:0/4161307054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f55c0 0x7f46e00f59e0 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 rx=0x7f46d4004660 tx=0x7f46d4009b30).stop 2022-02-02T21:06:44.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 -- 172.21.15.96:0/4161307054 shutdown_connections 2022-02-02T21:06:44.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 --2- 172.21.15.96:0/4161307054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f5ed0 0x7f46e00f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 --2- 172.21.15.96:0/4161307054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f55c0 0x7f46e00f59e0 unknown :-1 s=CLOSED pgs=2531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 -- 172.21.15.96:0/4161307054 >> 172.21.15.96:0/4161307054 conn(0x7f46e00f0de0 msgr2=0x7f46e00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:44.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 -- 172.21.15.96:0/4161307054 shutdown_connections 2022-02-02T21:06:44.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.676+0000 7f46e6186700 1 -- 172.21.15.96:0/4161307054 wait complete. 2022-02-02T21:06:44.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 Processor -- start 2022-02-02T21:06:44.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 -- start start 2022-02-02T21:06:44.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f55c0 0x7f46e0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0106910 con 0x7f46e00f5ed0 2022-02-02T21:06:44.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46e6186700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0106a50 con 0x7f46e00f55c0 2022-02-02T21:06:44.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40884/0 (socket says 172.21.15.96:40884) 2022-02-02T21:06:44.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 -- 172.21.15.96:0/2626094759 learned_addr learned my addr 172.21.15.96:0/2626094759 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46df7fe700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f55c0 0x7f46e0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 -- 172.21.15.96:0/2626094759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f55c0 msgr2=0x7f46e0105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f55c0 0x7f46e0105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.677+0000 7f46deffd700 1 -- 172.21.15.96:0/2626094759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4005040 con 0x7f46e00f5ed0 2022-02-02T21:06:44.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46deffd700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 rx=0x7f46d00026d0 tx=0x7f46d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d0009320 con 0x7f46e00f5ed0 2022-02-02T21:06:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e01073f0 con 0x7f46e00f5ed0 2022-02-02T21:06:44.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46d000f040 con 0x7f46e00f5ed0 2022-02-02T21:06:44.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d00147e0 con 0x7f46e00f5ed0 2022-02-02T21:06:44.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.678+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e01079b0 con 0x7f46e00f5ed0 2022-02-02T21:06:44.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.679+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e0045ad0 con 0x7f46e00f5ed0 2022-02-02T21:06:44.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.679+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f46d0009480 con 0x7f46e00f5ed0 2022-02-02T21:06:44.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.680+0000 7f46c7fff700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 0x7f46c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.680+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f46d0082160 con 0x7f46e00f5ed0 2022-02-02T21:06:44.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.680+0000 7f46df7fe700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 0x7f46c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.680+0000 7f46df7fe700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 0x7f46c8067290 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f46d4004630 tx=0x7f46d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:44.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.684+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46d0053c90 con 0x7f46e00f5ed0 2022-02-02T21:06:44.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.864+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e00ff830 con 0x7f46c8064dd0 2022-02-02T21:06:44.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.865+0000 7f46c7fff700 1 -- 172.21.15.96:0/2626094759 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f46e00ff830 con 0x7f46c8064dd0 2022-02-02T21:06:44.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 msgr2=0x7f46c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 0x7f46c8067290 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f46d4004630 tx=0x7f46d4009b30).stop 2022-02-02T21:06:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 msgr2=0x7f46e0106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 rx=0x7f46d00026d0 tx=0x7f46d0009de0).stop 2022-02-02T21:06:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 shutdown_connections 2022-02-02T21:06:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46c8064dd0 0x7f46c8067290 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46e00f55c0 0x7f46e0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 --2- 172.21.15.96:0/2626094759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46e00f5ed0 0x7f46e0106360 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 >> 172.21.15.96:0/2626094759 conn(0x7f46e00f0de0 msgr2=0x7f46e00fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 shutdown_connections 2022-02-02T21:06:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.867+0000 7f46e6186700 1 -- 172.21.15.96:0/2626094759 wait complete. 2022-02-02T21:06:44.878 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:06:44.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 -- 172.21.15.96:0/3776545589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f66e0 msgr2=0x7f6a5c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 --2- 172.21.15.96:0/3776545589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c0f6b00 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 rx=0x7f6a4c0099e0 tx=0x7f6a4c004d10).stop 2022-02-02T21:06:44.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 -- 172.21.15.96:0/3776545589 shutdown_connections 2022-02-02T21:06:44.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 --2- 172.21.15.96:0/3776545589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 --2- 172.21.15.96:0/3776545589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c0f6b00 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 -- 172.21.15.96:0/3776545589 >> 172.21.15.96:0/3776545589 conn(0x7f6a5c0f1e40 msgr2=0x7f6a5c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:44.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 -- 172.21.15.96:0/3776545589 shutdown_connections 2022-02-02T21:06:44.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.965+0000 7f6a62168700 1 -- 172.21.15.96:0/3776545589 wait complete. 2022-02-02T21:06:44.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:44 smithi096 ceph-mon[101353]: pgmap v4939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:44.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 Processor -- start 2022-02-02T21:06:44.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 -- start start 2022-02-02T21:06:44.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c1070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c107b70 con 0x7f6a5c0f7980 2022-02-02T21:06:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a62168700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c107cb0 con 0x7f6a5c0f66e0 2022-02-02T21:06:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40894/0 (socket says 172.21.15.96:40894) 2022-02-02T21:06:44.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.966+0000 7f6a5affd700 1 -- 172.21.15.96:0/1107530239 learned_addr learned my addr 172.21.15.96:0/1107530239 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a5b7fe700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c1070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a5affd700 1 -- 172.21.15.96:0/1107530239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f66e0 msgr2=0x7f6a5c1070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a5affd700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c1070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:44.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a5affd700 1 -- 172.21.15.96:0/1107530239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009640 con 0x7f6a5c0f7980 2022-02-02T21:06:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a5affd700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 rx=0x7f6a440026d0 tx=0x7f6a44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a44009320 con 0x7f6a5c0f7980 2022-02-02T21:06:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c108650 con 0x7f6a5c0f7980 2022-02-02T21:06:44.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a4400f040 con 0x7f6a5c0f7980 2022-02-02T21:06:44.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.967+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a440148f0 con 0x7f6a5c0f7980 2022-02-02T21:06:44.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.968+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c108b90 con 0x7f6a5c0f7980 2022-02-02T21:06:44.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a4401b060 con 0x7f6a5c0f7980 2022-02-02T21:06:44.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c045ad0 con 0x7f6a5c0f7980 2022-02-02T21:06:44.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a53fff700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 0x7f6a48067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:44.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6a44081a90 con 0x7f6a5c0f7980 2022-02-02T21:06:44.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a5b7fe700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 0x7f6a48067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:44.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.969+0000 7f6a5b7fe700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 0x7f6a48067270 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f6a4c00b3b0 tx=0x7f6a4c004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:44.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:44.973+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a440535c0 con 0x7f6a5c0f7980 2022-02-02T21:06:45.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.145+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a5c0ff070 con 0x7f6a48064db0 2022-02-02T21:06:45.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.155+0000 7f6a53fff700 1 -- 172.21.15.96:0/1107530239 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6a4c019040 con 0x7f6a48064db0 2022-02-02T21:06:45.156 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:06:45.157 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:06:45.157 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:06:45.157 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:06:45.157 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:06:45.158 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:06:45.158 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:06:45.158 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:06:45.158 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:06:45.159 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:06:45.159 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:06:45.159 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:06:45.159 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:06:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:06:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:06:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:06:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:06:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:06:45.161 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:06:45.161 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:06:45.161 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:06:45.161 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:06:45.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 msgr2=0x7f6a48067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 0x7f6a48067270 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f6a4c00b3b0 tx=0x7f6a4c004d10).stop 2022-02-02T21:06:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 msgr2=0x7f6a5c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 rx=0x7f6a440026d0 tx=0x7f6a44009de0).stop 2022-02-02T21:06:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 shutdown_connections 2022-02-02T21:06:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a48064db0 0x7f6a48067270 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a5c0f66e0 0x7f6a5c1070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 --2- 172.21.15.96:0/1107530239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a5c0f7980 0x7f6a5c1075c0 unknown :-1 s=CLOSED pgs=2534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 >> 172.21.15.96:0/1107530239 conn(0x7f6a5c0f1e40 msgr2=0x7f6a5c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 shutdown_connections 2022-02-02T21:06:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.157+0000 7f6a62168700 1 -- 172.21.15.96:0/1107530239 wait complete. 2022-02-02T21:06:45.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 -- 172.21.15.96:0/300368874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 msgr2=0x7f80e80f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 --2- 172.21.15.96:0/300368874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e80f6960 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 rx=0x7f80d4004660 tx=0x7f80d4009b30).stop 2022-02-02T21:06:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 -- 172.21.15.96:0/300368874 shutdown_connections 2022-02-02T21:06:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 --2- 172.21.15.96:0/300368874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e80f6960 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 --2- 172.21.15.96:0/300368874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e80f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:06:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 -- 172.21.15.96:0/300368874 >> 172.21.15.96:0/300368874 conn(0x7f80e80f0540 msgr2=0x7f80e80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 -- 172.21.15.96:0/300368874 shutdown_connections 2022-02-02T21:06:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.253+0000 7f80ef158700 1 -- 172.21.15.96:0/300368874 wait complete. 2022-02-02T21:06:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 Processor -- start 2022-02-02T21:06:45.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 -- start start 2022-02-02T21:06:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e8109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80f5750 con 0x7f80e80f64e0 2022-02-02T21:06:45.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80ef158700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80f5890 con 0x7f80e80f5bd0 2022-02-02T21:06:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40904/0 (socket says 172.21.15.96:40904) 2022-02-02T21:06:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.254+0000 7f80e7fff700 1 -- 172.21.15.96:0/2133009945 learned_addr learned my addr 172.21.15.96:0/2133009945 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80ecef4700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e8109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e7fff700 1 -- 172.21.15.96:0/2133009945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 msgr2=0x7f80e8109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e7fff700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e8109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e7fff700 1 -- 172.21.15.96:0/2133009945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4005040 con 0x7f80e80f64e0 2022-02-02T21:06:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80ecef4700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e8109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:06:45.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e7fff700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 rx=0x7f80d4009990 tx=0x7f80d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d4018070 con 0x7f80e80f64e0 2022-02-02T21:06:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80d4007ca0 con 0x7f80e80f64e0 2022-02-02T21:06:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e810c780 con 0x7f80e80f64e0 2022-02-02T21:06:45.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d401c620 con 0x7f80e80f64e0 2022-02-02T21:06:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.255+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e810ccb0 con 0x7f80e80f64e0 2022-02-02T21:06:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.256+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8045ad0 con 0x7f80e80f64e0 2022-02-02T21:06:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.257+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80d401d960 con 0x7f80e80f64e0 2022-02-02T21:06:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.257+0000 7f80e57fa700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.257+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80d4083900 con 0x7f80e80f64e0 2022-02-02T21:06:45.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.257+0000 7f80ecef4700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.258+0000 7f80ecef4700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 0x7f80d8067290 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f80e80f5340 tx=0x7f80dc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:45.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.261+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80d4051a00 con 0x7f80e80f64e0 2022-02-02T21:06:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:44 smithi159 ceph-mon[69013]: pgmap v4939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.492+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80e80fdeb0 con 0x7f80e80f64e0 2022-02-02T21:06:45.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.493+0000 7f80e57fa700 1 -- 172.21.15.96:0/2133009945 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f80d4055020 con 0x7f80e80f64e0 2022-02-02T21:06:45.495 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:06:45.495 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:06:45.495 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:06:45.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:45.496 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:06:45.496 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:06:45.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:45.496 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:06:45.497 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:06:45.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:45.497 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:06:45.497 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:06:45.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:06:45.498 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:06:45.498 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:06:45.498 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:06:45.498 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:06:45.499 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:06:45.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 msgr2=0x7f80d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 0x7f80d8067290 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f80e80f5340 tx=0x7f80dc008040).stop 2022-02-02T21:06:45.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 msgr2=0x7f80e810c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 rx=0x7f80d4009990 tx=0x7f80d4009b30).stop 2022-02-02T21:06:45.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 shutdown_connections 2022-02-02T21:06:45.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80e80f5bd0 0x7f80e8109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 --2- 172.21.15.96:0/2133009945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80e80f64e0 0x7f80e810c180 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 >> 172.21.15.96:0/2133009945 conn(0x7f80e80f0540 msgr2=0x7f80e80fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:45.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 shutdown_connections 2022-02-02T21:06:45.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.495+0000 7f80ef158700 1 -- 172.21.15.96:0/2133009945 wait complete. 2022-02-02T21:06:45.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- 172.21.15.96:0/2228864861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f5430 msgr2=0x7f02280f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2228864861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f5430 0x7f02280f5850 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 rx=0x7f0218004660 tx=0x7f0218009b30).stop 2022-02-02T21:06:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- 172.21.15.96:0/2228864861 shutdown_connections 2022-02-02T21:06:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2228864861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f66d0 0x7f02280f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2228864861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f5430 0x7f02280f5850 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- 172.21.15.96:0/2228864861 >> 172.21.15.96:0/2228864861 conn(0x7f02280f0b90 msgr2=0x7f02280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- 172.21.15.96:0/2228864861 shutdown_connections 2022-02-02T21:06:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- 172.21.15.96:0/2228864861 wait complete. 2022-02-02T21:06:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 Processor -- start 2022-02-02T21:06:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- start start 2022-02-02T21:06:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f5430 0x7f0228109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280603e0 con 0x7f02280f66d0 2022-02-02T21:06:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.594+0000 7f022e8e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0228060520 con 0x7f02280f5430 2022-02-02T21:06:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40914/0 (socket says 172.21.15.96:40914) 2022-02-02T21:06:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 -- 172.21.15.96:0/2487380881 learned_addr learned my addr 172.21.15.96:0/2487380881 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:06:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d8e3700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f5430 0x7f0228109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 -- 172.21.15.96:0/2487380881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f5430 msgr2=0x7f0228109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f5430 0x7f0228109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 -- 172.21.15.96:0/2487380881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218005040 con 0x7f02280f66d0 2022-02-02T21:06:45.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022d0e2700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 rx=0x7f022400c530 tx=0x7f0224007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:45.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022400f650 con 0x7f02280f66d0 2022-02-02T21:06:45.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f022400fc60 con 0x7f02280f66d0 2022-02-02T21:06:45.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0224012c20 con 0x7f02280f66d0 2022-02-02T21:06:45.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022810c540 con 0x7f02280f66d0 2022-02-02T21:06:45.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.595+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022810cb00 con 0x7f02280f66d0 2022-02-02T21:06:45.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.596+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0228045ad0 con 0x7f02280f66d0 2022-02-02T21:06:45.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.597+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0224010070 con 0x7f02280f66d0 2022-02-02T21:06:45.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.597+0000 7f021e7fc700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 0x7f02140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:06:45.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.597+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0224081610 con 0x7f02280f66d0 2022-02-02T21:06:45.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.597+0000 7f022d8e3700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 0x7f02140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:06:45.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.598+0000 7f022d8e3700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 0x7f02140672e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f0218013690 tx=0x7f0218009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:06:45.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.601+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02240477d0 con 0x7f02280f66d0 2022-02-02T21:06:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.806+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0228027a00 con 0x7f02280f66d0 2022-02-02T21:06:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.807+0000 7f021e7fc700 1 -- 172.21.15.96:0/2487380881 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f022404f710 con 0x7f02280f66d0 2022-02-02T21:06:45.808 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:06:45.809 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:06:45.809 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:06:45.809 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:06:45.809 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:45.810 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:06:45.810 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:06:45.810 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:06:45.810 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:06:45.811 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:06:45.811 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:06:45.811 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:06:45.811 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:06:45.811 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:06:45.812 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:06:45.812 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:06:45.812 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:06:45.812 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:06:45.812 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:06:45.813 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:06:45.813 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:06:45.813 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:06:45.813 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:06:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:06:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:06:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:06:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:06:45.814 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:06:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:06:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:06:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:06:45.815 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:06:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 msgr2=0x7f02140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 0x7f02140672e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f0218013690 tx=0x7f0218009b30).stop 2022-02-02T21:06:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 msgr2=0x7f022810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:06:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 rx=0x7f022400c530 tx=0x7f0224007e20).stop 2022-02-02T21:06:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 shutdown_connections 2022-02-02T21:06:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0214064e20 0x7f02140672e0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02280f5430 0x7f0228109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 --2- 172.21.15.96:0/2487380881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02280f66d0 0x7f022810bf90 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:06:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 >> 172.21.15.96:0/2487380881 conn(0x7f02280f0b90 msgr2=0x7f02280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:06:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 shutdown_connections 2022-02-02T21:06:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:06:45.810+0000 7f022e8e5700 1 -- 172.21.15.96:0/2487380881 wait complete. 2022-02-02T21:06:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:06:46.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:45 smithi096 ceph-mon[101353]: from='client.39170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:46.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2133009945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:06:46.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2487380881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:06:46.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:45 smithi159 ceph-mon[69013]: from='client.39170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:46.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2133009945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:06:46.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2487380881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:06:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:46 smithi159 ceph-mon[69013]: from='client.39174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:46 smithi159 ceph-mon[69013]: pgmap v4940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:46 smithi096 ceph-mon[101353]: from='client.39174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:06:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:46 smithi096 ceph-mon[101353]: pgmap v4940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:48 smithi159 ceph-mon[69013]: pgmap v4941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:48 smithi096 ceph-mon[101353]: pgmap v4941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:50 smithi159 ceph-mon[69013]: pgmap v4942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:50 smithi096 ceph-mon[101353]: pgmap v4942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:52 smithi096 ceph-mon[101353]: pgmap v4943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:52 smithi159 ceph-mon[69013]: pgmap v4943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:54 smithi159 ceph-mon[69013]: pgmap v4944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:54 smithi096 ceph-mon[101353]: pgmap v4944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:56 smithi159 ceph-mon[69013]: pgmap v4945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:56 smithi096 ceph-mon[101353]: pgmap v4945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:06:58 smithi159 ceph-mon[69013]: pgmap v4946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:06:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:06:58 smithi096 ceph-mon[101353]: pgmap v4946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:00 smithi159 ceph-mon[69013]: pgmap v4947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:00 smithi096 ceph-mon[101353]: pgmap v4947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:02 smithi096 ceph-mon[101353]: pgmap v4948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:02 smithi159 ceph-mon[69013]: pgmap v4948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:04 smithi159 ceph-mon[69013]: pgmap v4949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:04 smithi096 ceph-mon[101353]: pgmap v4949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:06 smithi159 ceph-mon[69013]: pgmap v4950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:07.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:06 smithi096 ceph-mon[101353]: pgmap v4950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:08.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:08 smithi159 ceph-mon[69013]: pgmap v4951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:08 smithi096 ceph-mon[101353]: pgmap v4951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:10 smithi159 ceph-mon[69013]: pgmap v4952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:10 smithi096 ceph-mon[101353]: pgmap v4952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:12 smithi096 ceph-mon[101353]: pgmap v4953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:12 smithi159 ceph-mon[69013]: pgmap v4953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:14 smithi159 ceph-mon[69013]: pgmap v4954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:14 smithi096 ceph-mon[101353]: pgmap v4954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 -- 172.21.15.96:0/2421846619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f6860 msgr2=0x7f47240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 --2- 172.21.15.96:0/2421846619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f6860 0x7f47240f6cc0 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 rx=0x7f4714004660 tx=0x7f4714009b30).stop 2022-02-02T21:07:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 -- 172.21.15.96:0/2421846619 shutdown_connections 2022-02-02T21:07:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 --2- 172.21.15.96:0/2421846619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f6860 0x7f47240f6cc0 unknown :-1 s=CLOSED pgs=2539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 --2- 172.21.15.96:0/2421846619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240f55c0 0x7f47240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:07:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 -- 172.21.15.96:0/2421846619 >> 172.21.15.96:0/2421846619 conn(0x7f47240f0d40 msgr2=0x7f47240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 -- 172.21.15.96:0/2421846619 shutdown_connections 2022-02-02T21:07:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.920+0000 7f4729d69700 1 -- 172.21.15.96:0/2421846619 wait complete. 2022-02-02T21:07:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 Processor -- start 2022-02-02T21:07:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 -- start start 2022-02-02T21:07:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240602b0 0x7f472410e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472410ec00 con 0x7f47240f55c0 2022-02-02T21:07:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4729d69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472410ed40 con 0x7f47240602b0 2022-02-02T21:07:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f47237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f47237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40934/0 (socket says 172.21.15.96:40934) 2022-02-02T21:07:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f47237fe700 1 -- 172.21.15.96:0/1121774701 learned_addr learned my addr 172.21.15.96:0/1121774701 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:15.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.921+0000 7f4722ffd700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240602b0 0x7f472410e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:15.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f47237fe700 1 -- 172.21.15.96:0/1121774701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240602b0 msgr2=0x7f472410e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:15.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f47237fe700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240602b0 0x7f472410e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:15.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f47237fe700 1 -- 172.21.15.96:0/1121774701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714005040 con 0x7f47240f55c0 2022-02-02T21:07:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f47237fe700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 rx=0x7f47180093f0 tx=0x7f4718006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4718013640 con 0x7f47240f55c0 2022-02-02T21:07:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4718013c50 con 0x7f47240f55c0 2022-02-02T21:07:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4718012c70 con 0x7f47240f55c0 2022-02-02T21:07:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472410ef40 con 0x7f47240f55c0 2022-02-02T21:07:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.922+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472410f420 con 0x7f47240f55c0 2022-02-02T21:07:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.923+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4724045ad0 con 0x7f47240f55c0 2022-02-02T21:07:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.924+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f471801a060 con 0x7f47240f55c0 2022-02-02T21:07:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.924+0000 7f470bfff700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.924+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4718081a30 con 0x7f47240f55c0 2022-02-02T21:07:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.924+0000 7f4722ffd700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.924+0000 7f4722ffd700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 0x7f470c067290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f4714000c00 tx=0x7f4714009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:15.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:15.928+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f471804fad0 con 0x7f47240f55c0 2022-02-02T21:07:16.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.107+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4724057f10 con 0x7f470c064dd0 2022-02-02T21:07:16.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.108+0000 7f470bfff700 1 -- 172.21.15.96:0/1121774701 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4724057f10 con 0x7f470c064dd0 2022-02-02T21:07:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.109+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 msgr2=0x7f470c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.109+0000 7f4729d69700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 0x7f470c067290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f4714000c00 tx=0x7f4714009b30).stop 2022-02-02T21:07:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.109+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 msgr2=0x7f472410c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.109+0000 7f4729d69700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 rx=0x7f47180093f0 tx=0x7f4718006ec0).stop 2022-02-02T21:07:16.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 shutdown_connections 2022-02-02T21:07:16.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47240f55c0 0x7f472410c210 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 --2- 172.21.15.96:0/1121774701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47240602b0 0x7f472410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 >> 172.21.15.96:0/1121774701 conn(0x7f47240f0d40 msgr2=0x7f47240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 shutdown_connections 2022-02-02T21:07:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.110+0000 7f4729d69700 1 -- 172.21.15.96:0/1121774701 wait complete. 2022-02-02T21:07:16.122 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:07:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 -- 172.21.15.96:0/446313661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f55d0 msgr2=0x7f73900f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 --2- 172.21.15.96:0/446313661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f55d0 0x7f73900f59f0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 rx=0x7f7380004660 tx=0x7f7380009b30).stop 2022-02-02T21:07:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 -- 172.21.15.96:0/446313661 shutdown_connections 2022-02-02T21:07:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 --2- 172.21.15.96:0/446313661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f6870 0x7f73900f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 --2- 172.21.15.96:0/446313661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f55d0 0x7f73900f59f0 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 -- 172.21.15.96:0/446313661 >> 172.21.15.96:0/446313661 conn(0x7f73900f0d70 msgr2=0x7f73900f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 -- 172.21.15.96:0/446313661 shutdown_connections 2022-02-02T21:07:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.206+0000 7f7395528700 1 -- 172.21.15.96:0/446313661 wait complete. 2022-02-02T21:07:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 Processor -- start 2022-02-02T21:07:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 -- start start 2022-02-02T21:07:16.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 0x7f7390109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390109c10 con 0x7f73900f6870 2022-02-02T21:07:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f7395528700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390109d50 con 0x7f73900f55d0 2022-02-02T21:07:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.207+0000 7f738e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40946/0 (socket says 172.21.15.96:40946) 2022-02-02T21:07:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 -- 172.21.15.96:0/3080538108 learned_addr learned my addr 172.21.15.96:0/3080538108 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738effd700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 0x7f7390109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 -- 172.21.15.96:0/3080538108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 msgr2=0x7f7390109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 0x7f7390109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 -- 172.21.15.96:0/3080538108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380005040 con 0x7f73900f6870 2022-02-02T21:07:16.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738effd700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 0x7f7390109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:07:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f738e7fc700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 rx=0x7f738400c790 tx=0x7f7384007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f738400e680 con 0x7f73900f6870 2022-02-02T21:07:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739010a6f0 con 0x7f73900f6870 2022-02-02T21:07:16.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f738400ec90 con 0x7f73900f6870 2022-02-02T21:07:16.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7384013d60 con 0x7f73900f6870 2022-02-02T21:07:16.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.208+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739010acb0 con 0x7f73900f6870 2022-02-02T21:07:16.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.209+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7390045ad0 con 0x7f73900f6870 2022-02-02T21:07:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.209+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f738401a060 con 0x7f73900f6870 2022-02-02T21:07:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.210+0000 7f73777fe700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.210+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7384081c90 con 0x7f73900f6870 2022-02-02T21:07:16.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.210+0000 7f738effd700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.210+0000 7f738effd700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7380009da0 tx=0x7f7380009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.214+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f73840537c0 con 0x7f73900f6870 2022-02-02T21:07:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.386+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73900faab0 con 0x7f7378064dd0 2022-02-02T21:07:16.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.396+0000 7f73777fe700 1 -- 172.21.15.96:0/3080538108 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f73900faab0 con 0x7f7378064dd0 2022-02-02T21:07:16.399 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:07:16.399 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:07:16.399 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:07:16.400 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:07:16.400 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:07:16.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:07:16.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:07:16.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:07:16.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:07:16.401 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:07:16.401 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:07:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:07:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:07:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:07:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:07:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:07:16.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:07:16.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:07:16.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:07:16.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:07:16.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:07:16.404 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:07:16.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 msgr2=0x7f7378067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7380009da0 tx=0x7f7380009b30).stop 2022-02-02T21:07:16.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 msgr2=0x7f7390109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 rx=0x7f738400c790 tx=0x7f7384007d70).stop 2022-02-02T21:07:16.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 shutdown_connections 2022-02-02T21:07:16.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7378064dd0 0x7f7378067290 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73900f55d0 0x7f7390109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 --2- 172.21.15.96:0/3080538108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73900f6870 0x7f7390109660 unknown :-1 s=CLOSED pgs=2542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 >> 172.21.15.96:0/3080538108 conn(0x7f73900f0d70 msgr2=0x7f739005ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 shutdown_connections 2022-02-02T21:07:16.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.398+0000 7f7395528700 1 -- 172.21.15.96:0/3080538108 wait complete. 2022-02-02T21:07:16.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 -- 172.21.15.96:0/352053107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f49a0 msgr2=0x7f519c0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 --2- 172.21.15.96:0/352053107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f49a0 0x7f519c0f4dc0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 rx=0x7f5190004660 tx=0x7f5190009b30).stop 2022-02-02T21:07:16.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 -- 172.21.15.96:0/352053107 shutdown_connections 2022-02-02T21:07:16.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 --2- 172.21.15.96:0/352053107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f5340 0x7f519c0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 --2- 172.21.15.96:0/352053107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f49a0 0x7f519c0f4dc0 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 -- 172.21.15.96:0/352053107 >> 172.21.15.96:0/352053107 conn(0x7f519c0f04c0 msgr2=0x7f519c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 -- 172.21.15.96:0/352053107 shutdown_connections 2022-02-02T21:07:16.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.495+0000 7f51a0b63700 1 -- 172.21.15.96:0/352053107 wait complete. 2022-02-02T21:07:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 Processor -- start 2022-02-02T21:07:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 -- start start 2022-02-02T21:07:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f49a0 0x7f519c107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c107af0 con 0x7f519c0f5340 2022-02-02T21:07:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f51a0b63700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c107c30 con 0x7f519c0f49a0 2022-02-02T21:07:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f5199d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f519a59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f49a0 0x7f519c107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f5199d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40960/0 (socket says 172.21.15.96:40960) 2022-02-02T21:07:16.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.496+0000 7f5199d9b700 1 -- 172.21.15.96:0/1120188292 learned_addr learned my addr 172.21.15.96:0/1120188292 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:16.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f5199d9b700 1 -- 172.21.15.96:0/1120188292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f49a0 msgr2=0x7f519c107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f5199d9b700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f49a0 0x7f519c107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f5199d9b700 1 -- 172.21.15.96:0/1120188292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190005040 con 0x7f519c0f5340 2022-02-02T21:07:16.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f5199d9b700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 rx=0x7f518c002700 tx=0x7f518c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f518c0079c0 con 0x7f519c0f5340 2022-02-02T21:07:16.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f518c00f040 con 0x7f519c0f5340 2022-02-02T21:07:16.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c1085d0 con 0x7f519c0f5340 2022-02-02T21:07:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f518c014740 con 0x7f519c0f5340 2022-02-02T21:07:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.497+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c108b90 con 0x7f519c0f5340 2022-02-02T21:07:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.498+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c045ad0 con 0x7f519c0f5340 2022-02-02T21:07:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.499+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f518c01b060 con 0x7f519c0f5340 2022-02-02T21:07:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.499+0000 7f518affd700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 0x7f5184067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.499+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f518c081920 con 0x7f519c0f5340 2022-02-02T21:07:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.499+0000 7f519a59c700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 0x7f5184067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.499+0000 7f519a59c700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 0x7f5184067290 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f5190004630 tx=0x7f5190009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.504+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f518c0533f0 con 0x7f519c0f5340 2022-02-02T21:07:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.736+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f519c027a00 con 0x7f519c0f5340 2022-02-02T21:07:16.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.736+0000 7f518affd700 1 -- 172.21.15.96:0/1120188292 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f518c052fe0 con 0x7f519c0f5340 2022-02-02T21:07:16.739 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:07:16.739 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:07:16.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:07:16.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:16.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:07:16.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:07:16.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:16.741 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:07:16.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:07:16.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:16.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:07:16.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:07:16.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:16.742 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:07:16.742 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:07:16.742 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:07:16.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:07:16.743 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:07:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 msgr2=0x7f5184067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 0x7f5184067290 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f5190004630 tx=0x7f5190009b30).stop 2022-02-02T21:07:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 msgr2=0x7f519c107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 rx=0x7f518c002700 tx=0x7f518c009d60).stop 2022-02-02T21:07:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 shutdown_connections 2022-02-02T21:07:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5184064dd0 0x7f5184067290 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f519c0f49a0 0x7f519c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 --2- 172.21.15.96:0/1120188292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f519c0f5340 0x7f519c107540 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 >> 172.21.15.96:0/1120188292 conn(0x7f519c0f04c0 msgr2=0x7f519c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 shutdown_connections 2022-02-02T21:07:16.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.738+0000 7f51a0b63700 1 -- 172.21.15.96:0/1120188292 wait complete. 2022-02-02T21:07:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 -- 172.21.15.96:0/1815558450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f6530 msgr2=0x7f77740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 --2- 172.21.15.96:0/1815558450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f6530 0x7f77740f6950 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 rx=0x7f7768004660 tx=0x7f7768009b30).stop 2022-02-02T21:07:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 -- 172.21.15.96:0/1815558450 shutdown_connections 2022-02-02T21:07:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 --2- 172.21.15.96:0/1815558450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f77d0 0x7f77740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 --2- 172.21.15.96:0/1815558450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f6530 0x7f77740f6950 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.835+0000 7f7773fff700 1 -- 172.21.15.96:0/1815558450 >> 172.21.15.96:0/1815558450 conn(0x7f77740f1c90 msgr2=0x7f77740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 -- 172.21.15.96:0/1815558450 shutdown_connections 2022-02-02T21:07:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 -- 172.21.15.96:0/1815558450 wait complete. 2022-02-02T21:07:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 Processor -- start 2022-02-02T21:07:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 -- start start 2022-02-02T21:07:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f6530 0x7f7774106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741078f0 con 0x7f77740f77d0 2022-02-02T21:07:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.836+0000 7f7773fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774108100 con 0x7f77740f6530 2022-02-02T21:07:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40970/0 (socket says 172.21.15.96:40970) 2022-02-02T21:07:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 -- 172.21.15.96:0/2667357853 learned_addr learned my addr 172.21.15.96:0/2667357853 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f7772ffd700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f6530 0x7f7774106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 -- 172.21.15.96:0/2667357853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f6530 msgr2=0x7f7774106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:16.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f6530 0x7f7774106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:16.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 -- 172.21.15.96:0/2667357853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768005040 con 0x7f77740f77d0 2022-02-02T21:07:16.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f77727fc700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 rx=0x7f7764004ae0 tx=0x7f7764007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776400a590 con 0x7f77740f77d0 2022-02-02T21:07:16.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f776400aba0 con 0x7f77740f77d0 2022-02-02T21:07:16.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774108320 con 0x7f77740f77d0 2022-02-02T21:07:16.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77741088b0 con 0x7f77740f77d0 2022-02-02T21:07:16.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.837+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776400fb70 con 0x7f77740f77d0 2022-02-02T21:07:16.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.838+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774059100 con 0x7f77740f77d0 2022-02-02T21:07:16.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.839+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7764021070 con 0x7f77740f77d0 2022-02-02T21:07:16.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.839+0000 7f775b7fe700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 0x7f775c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:16.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.839+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7764085c60 con 0x7f77740f77d0 2022-02-02T21:07:16.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.839+0000 7f7772ffd700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 0x7f775c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:16.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.839+0000 7f7772ffd700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 0x7f775c0672e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f7768013690 tx=0x7f7768009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:16.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:16.844+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7764053d60 con 0x7f77740f77d0 2022-02-02T21:07:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.046+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7774045ad0 con 0x7f77740f77d0 2022-02-02T21:07:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.046+0000 7f775b7fe700 1 -- 172.21.15.96:0/2667357853 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7764057380 con 0x7f77740f77d0 2022-02-02T21:07:17.049 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:07:17.049 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:07:17.050 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:07:17.050 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:07:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:17.050 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:07:17.051 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:07:17.051 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:07:17.051 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:07:17.051 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:07:17.052 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:07:17.052 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:07:17.052 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:07:17.052 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:07:17.052 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:07:17.053 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:07:17.053 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:07:17.053 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:07:17.053 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:07:17.054 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:07:17.054 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:07:17.054 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:07:17.054 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:07:17.055 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:07:17.055 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:07:17.055 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:07:17.055 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:07:17.055 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:07:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:07:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:07:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:07:17.056 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:07:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:07:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:17.057 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:17.058 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 msgr2=0x7f775c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 0x7f775c0672e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f7768013690 tx=0x7f7768009b30).stop 2022-02-02T21:07:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 msgr2=0x7f77741072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:17.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 rx=0x7f7764004ae0 tx=0x7f7764007d70).stop 2022-02-02T21:07:17.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 shutdown_connections 2022-02-02T21:07:17.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f775c064e20 0x7f775c0672e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:17.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77740f6530 0x7f7774106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 --2- 172.21.15.96:0/2667357853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77740f77d0 0x7f77741072f0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 >> 172.21.15.96:0/2667357853 conn(0x7f77740f1c90 msgr2=0x7f77740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 shutdown_connections 2022-02-02T21:07:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:17.048+0000 7f7773fff700 1 -- 172.21.15.96:0/2667357853 wait complete. 2022-02-02T21:07:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:07:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:16 smithi159 ceph-mon[69013]: pgmap v4955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1120188292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:07:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:16 smithi096 ceph-mon[101353]: pgmap v4955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1120188292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:07:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:17 smithi159 ceph-mon[69013]: from='client.39186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:17 smithi159 ceph-mon[69013]: from='client.39190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2667357853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:07:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:17 smithi096 ceph-mon[101353]: from='client.39186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:17 smithi096 ceph-mon[101353]: from='client.39190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:18.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2667357853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:07:19.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:18 smithi159 ceph-mon[69013]: pgmap v4956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:19.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:18 smithi096 ceph-mon[101353]: pgmap v4956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:20 smithi159 ceph-mon[69013]: pgmap v4957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:20 smithi096 ceph-mon[101353]: pgmap v4957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:22 smithi096 ceph-mon[101353]: pgmap v4958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:22 smithi159 ceph-mon[69013]: pgmap v4958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:24 smithi159 ceph-mon[69013]: pgmap v4959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:24 smithi096 ceph-mon[101353]: pgmap v4959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:26 smithi159 ceph-mon[69013]: pgmap v4960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:26 smithi096 ceph-mon[101353]: pgmap v4960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:07:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:07:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:28 smithi159 ceph-mon[69013]: pgmap v4961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:07:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:07:28.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:28 smithi096 ceph-mon[101353]: pgmap v4961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:30 smithi159 ceph-mon[69013]: pgmap v4962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:30 smithi096 ceph-mon[101353]: pgmap v4962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:32 smithi096 ceph-mon[101353]: pgmap v4963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:32 smithi159 ceph-mon[69013]: pgmap v4963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:34 smithi159 ceph-mon[69013]: pgmap v4964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:34 smithi096 ceph-mon[101353]: pgmap v4964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:36 smithi159 ceph-mon[69013]: pgmap v4965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:36 smithi096 ceph-mon[101353]: pgmap v4965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:38 smithi159 ceph-mon[69013]: pgmap v4966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:38 smithi096 ceph-mon[101353]: pgmap v4966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:40 smithi159 ceph-mon[69013]: pgmap v4967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:40 smithi096 ceph-mon[101353]: pgmap v4967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:42 smithi096 ceph-mon[101353]: pgmap v4968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:42 smithi159 ceph-mon[69013]: pgmap v4968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:44 smithi159 ceph-mon[69013]: pgmap v4969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:44 smithi096 ceph-mon[101353]: pgmap v4969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:47.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.158+0000 7f453083c700 1 -- 172.21.15.96:0/1704559933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f77d0 msgr2=0x7f452c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.158+0000 7f453083c700 1 --2- 172.21.15.96:0/1704559933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f77d0 0x7f452c0f7c30 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 rx=0x7f4520004660 tx=0x7f4520009b30).stop 2022-02-02T21:07:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 -- 172.21.15.96:0/1704559933 shutdown_connections 2022-02-02T21:07:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 --2- 172.21.15.96:0/1704559933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f77d0 0x7f452c0f7c30 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 --2- 172.21.15.96:0/1704559933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f6530 0x7f452c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 -- 172.21.15.96:0/1704559933 >> 172.21.15.96:0/1704559933 conn(0x7f452c0f1c90 msgr2=0x7f452c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 -- 172.21.15.96:0/1704559933 shutdown_connections 2022-02-02T21:07:47.163 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:46 smithi096 ceph-mon[101353]: pgmap v4970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 -- 172.21.15.96:0/1704559933 wait complete. 2022-02-02T21:07:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.159+0000 7f453083c700 1 Processor -- start 2022-02-02T21:07:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f453083c700 1 -- start start 2022-02-02T21:07:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f453083c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f453083c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f77d0 0x7f452c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f453083c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c107830 con 0x7f452c0f6530 2022-02-02T21:07:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f453083c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c108040 con 0x7f452c0f77d0 2022-02-02T21:07:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40990/0 (socket says 172.21.15.96:40990) 2022-02-02T21:07:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 -- 172.21.15.96:0/2235808405 learned_addr learned my addr 172.21.15.96:0/2235808405 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452affd700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f77d0 0x7f452c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 -- 172.21.15.96:0/2235808405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f77d0 msgr2=0x7f452c107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f77d0 0x7f452c107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 -- 172.21.15.96:0/2235808405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520005040 con 0x7f452c0f6530 2022-02-02T21:07:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.160+0000 7f452b7fe700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 rx=0x7f451c002700 tx=0x7f451c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.161+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c0079c0 con 0x7f452c0f6530 2022-02-02T21:07:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.161+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c1082c0 con 0x7f452c0f6530 2022-02-02T21:07:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.161+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f451c00f040 con 0x7f452c0f6530 2022-02-02T21:07:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.161+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c014850 con 0x7f452c0f6530 2022-02-02T21:07:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.161+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c108880 con 0x7f452c0f6530 2022-02-02T21:07:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.162+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c059100 con 0x7f452c0f6530 2022-02-02T21:07:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.162+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f451c01b060 con 0x7f452c0f6530 2022-02-02T21:07:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.163+0000 7f4513fff700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 0x7f45140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.163+0000 7f452affd700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 0x7f45140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.163+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f451c0818b0 con 0x7f452c0f6530 2022-02-02T21:07:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.163+0000 7f452affd700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 0x7f45140672e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f4520004630 tx=0x7f4520009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.167+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f451c04f9b0 con 0x7f452c0f6530 2022-02-02T21:07:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:46 smithi159 ceph-mon[69013]: pgmap v4970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.347+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f452c0fedd0 con 0x7f4514064e20 2022-02-02T21:07:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.348+0000 7f4513fff700 1 -- 172.21.15.96:0/2235808405 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f452c0fedd0 con 0x7f4514064e20 2022-02-02T21:07:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 msgr2=0x7f45140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 0x7f45140672e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f4520004630 tx=0x7f4520009b30).stop 2022-02-02T21:07:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 msgr2=0x7f452c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 rx=0x7f451c002700 tx=0x7f451c009e00).stop 2022-02-02T21:07:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 shutdown_connections 2022-02-02T21:07:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4514064e20 0x7f45140672e0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f452c0f6530 0x7f452c106d40 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 --2- 172.21.15.96:0/2235808405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f452c0f77d0 0x7f452c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 >> 172.21.15.96:0/2235808405 conn(0x7f452c0f1c90 msgr2=0x7f452c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 shutdown_connections 2022-02-02T21:07:47.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.350+0000 7f453083c700 1 -- 172.21.15.96:0/2235808405 wait complete. 2022-02-02T21:07:47.362 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:07:47.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 -- 172.21.15.96:0/754546444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f66d0 msgr2=0x7fef2c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 --2- 172.21.15.96:0/754546444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f66d0 0x7fef2c0f6b30 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 rx=0x7fef1c004660 tx=0x7fef1c009b30).stop 2022-02-02T21:07:47.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 -- 172.21.15.96:0/754546444 shutdown_connections 2022-02-02T21:07:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 --2- 172.21.15.96:0/754546444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f66d0 0x7fef2c0f6b30 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 --2- 172.21.15.96:0/754546444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f5430 0x7fef2c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 -- 172.21.15.96:0/754546444 >> 172.21.15.96:0/754546444 conn(0x7fef2c0f0b90 msgr2=0x7fef2c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 -- 172.21.15.96:0/754546444 shutdown_connections 2022-02-02T21:07:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.447+0000 7fef332c0700 1 -- 172.21.15.96:0/754546444 wait complete. 2022-02-02T21:07:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 Processor -- start 2022-02-02T21:07:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 -- start start 2022-02-02T21:07:47.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f66d0 0x7fef2c10e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0602b0 con 0x7fef2c0f5430 2022-02-02T21:07:47.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.448+0000 7fef332c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0603f0 con 0x7fef2c0f66d0 2022-02-02T21:07:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41000/0 (socket says 172.21.15.96:41000) 2022-02-02T21:07:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 -- 172.21.15.96:0/1166259633 learned_addr learned my addr 172.21.15.96:0/1166259633 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef31abd700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f66d0 0x7fef2c10e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 -- 172.21.15.96:0/1166259633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f66d0 msgr2=0x7fef2c10e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f66d0 0x7fef2c10e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 -- 172.21.15.96:0/1166259633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c005040 con 0x7fef2c0f5430 2022-02-02T21:07:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef322be700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 rx=0x7fef2800c530 tx=0x7fef28007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2800f650 con 0x7fef2c0f5430 2022-02-02T21:07:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef2800fc60 con 0x7fef2c0f5430 2022-02-02T21:07:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c10e830 con 0x7fef2c0f5430 2022-02-02T21:07:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef28012cb0 con 0x7fef2c0f5430 2022-02-02T21:07:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.449+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c10ecb0 con 0x7fef2c0f5430 2022-02-02T21:07:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.450+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef14004fa0 con 0x7fef2c0f5430 2022-02-02T21:07:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.451+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fef28019030 con 0x7fef2c0f5430 2022-02-02T21:07:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.451+0000 7fef22ffd700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 0x7fef180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.451+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fef28081600 con 0x7fef2c0f5430 2022-02-02T21:07:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.451+0000 7fef31abd700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 0x7fef180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.452+0000 7fef31abd700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 0x7fef180672e0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fef1c004630 tx=0x7fef1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.455+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fef2804f7b0 con 0x7fef2c0f5430 2022-02-02T21:07:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.631+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fef14000bc0 con 0x7fef18064e20 2022-02-02T21:07:47.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.641+0000 7fef22ffd700 1 -- 172.21.15.96:0/1166259633 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fef14000bc0 con 0x7fef18064e20 2022-02-02T21:07:47.643 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:07:47.643 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:07:47.643 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:07:47.644 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:07:47.644 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:07:47.644 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:07:47.644 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:07:47.645 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:07:47.645 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:07:47.645 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:07:47.645 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:07:47.645 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:07:47.646 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:07:47.646 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:07:47.646 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:07:47.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:07:47.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:07:47.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:07:47.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:07:47.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:07:47.647 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:07:47.647 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:07:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 msgr2=0x7fef180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 0x7fef180672e0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fef1c004630 tx=0x7fef1c009b30).stop 2022-02-02T21:07:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 msgr2=0x7fef2c10be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 rx=0x7fef2800c530 tx=0x7fef28007e10).stop 2022-02-02T21:07:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 shutdown_connections 2022-02-02T21:07:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fef18064e20 0x7fef180672e0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef2c0f5430 0x7fef2c10be40 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 --2- 172.21.15.96:0/1166259633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef2c0f66d0 0x7fef2c10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.642+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 >> 172.21.15.96:0/1166259633 conn(0x7fef2c0f0b90 msgr2=0x7fef2c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.643+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 shutdown_connections 2022-02-02T21:07:47.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.643+0000 7fef332c0700 1 -- 172.21.15.96:0/1166259633 wait complete. 2022-02-02T21:07:47.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/2523738979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 msgr2=0x7f8d680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/2523738979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d680f6b00 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 rx=0x7f8d64004660 tx=0x7f8d64009b30).stop 2022-02-02T21:07:47.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/2523738979 shutdown_connections 2022-02-02T21:07:47.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/2523738979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 0x7f8d680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/2523738979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d680f6b00 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/2523738979 >> 172.21.15.96:0/2523738979 conn(0x7f8d680f1e40 msgr2=0x7f8d680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/2523738979 shutdown_connections 2022-02-02T21:07:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/2523738979 wait complete. 2022-02-02T21:07:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.740+0000 7f8d6fd5e700 1 Processor -- start 2022-02-02T21:07:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6fd5e700 1 -- start start 2022-02-02T21:07:47.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6fd5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6fd5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 0x7f8d681074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6fd5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68107a50 con 0x7f8d680f66e0 2022-02-02T21:07:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6fd5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68107b90 con 0x7f8d680f7980 2022-02-02T21:07:47.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41010/0 (socket says 172.21.15.96:41010) 2022-02-02T21:07:47.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 -- 172.21.15.96:0/1998875515 learned_addr learned my addr 172.21.15.96:0/1998875515 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:47.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6d2f9700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 0x7f8d681074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 -- 172.21.15.96:0/1998875515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 msgr2=0x7f8d681074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 0x7f8d681074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 -- 172.21.15.96:0/1998875515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64005040 con 0x7f8d680f66e0 2022-02-02T21:07:47.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.741+0000 7f8d6dafa700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 rx=0x7f8d64013a70 tx=0x7f8d64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.742+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d64018070 con 0x7f8d680f66e0 2022-02-02T21:07:47.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.742+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d640097d0 con 0x7f8d680f66e0 2022-02-02T21:07:47.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.742+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d681084d0 con 0x7f8d680f66e0 2022-02-02T21:07:47.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.742+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6401de80 con 0x7f8d680f66e0 2022-02-02T21:07:47.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.742+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68108a30 con 0x7f8d680f66e0 2022-02-02T21:07:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.743+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68045ad0 con 0x7f8d680f66e0 2022-02-02T21:07:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.743+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d64007ba0 con 0x7f8d680f66e0 2022-02-02T21:07:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.744+0000 7f8d5a7fc700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 0x7f8d54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:47.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.744+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d64083650 con 0x7f8d680f66e0 2022-02-02T21:07:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.744+0000 7f8d6d2f9700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 0x7f8d54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.744+0000 7f8d6d2f9700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 0x7f8d54067290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8d5c004c40 tx=0x7f8d5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:47.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.748+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d64055240 con 0x7f8d680f66e0 2022-02-02T21:07:47.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.979+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d680fef40 con 0x7f8d680f66e0 2022-02-02T21:07:47.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.980+0000 7f8d5a7fc700 1 -- 172.21.15.96:0/1998875515 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8d64054e30 con 0x7f8d680f66e0 2022-02-02T21:07:47.982 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:07:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:07:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:07:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:07:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:07:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:07:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:07:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:07:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:07:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:07:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:07:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:07:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:07:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:07:47.987 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:07:47.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 msgr2=0x7f8d54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 0x7f8d54067290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8d5c004c40 tx=0x7f8d5c00b040).stop 2022-02-02T21:07:47.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 msgr2=0x7f8d68106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:47.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 rx=0x7f8d64013a70 tx=0x7f8d64009b30).stop 2022-02-02T21:07:47.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 shutdown_connections 2022-02-02T21:07:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d54064dd0 0x7f8d54067290 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d680f66e0 0x7f8d68106fb0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 --2- 172.21.15.96:0/1998875515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d680f7980 0x7f8d681074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 >> 172.21.15.96:0/1998875515 conn(0x7f8d680f1e40 msgr2=0x7f8d680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 shutdown_connections 2022-02-02T21:07:47.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:47.982+0000 7f8d6fd5e700 1 -- 172.21.15.96:0/1998875515 wait complete. 2022-02-02T21:07:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 -- 172.21.15.96:0/1750844713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 msgr2=0x7faaf80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 --2- 172.21.15.96:0/1750844713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80fbae0 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 rx=0x7faae8004660 tx=0x7faae8009b30).stop 2022-02-02T21:07:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 -- 172.21.15.96:0/1750844713 shutdown_connections 2022-02-02T21:07:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 --2- 172.21.15.96:0/1750844713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80fbae0 unknown :-1 s=CLOSED pgs=2553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 --2- 172.21.15.96:0/1750844713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 0x7faaf80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.080+0000 7faafd74f700 1 -- 172.21.15.96:0/1750844713 >> 172.21.15.96:0/1750844713 conn(0x7faaf80f0b90 msgr2=0x7faaf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 -- 172.21.15.96:0/1750844713 shutdown_connections 2022-02-02T21:07:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 -- 172.21.15.96:0/1750844713 wait complete. 2022-02-02T21:07:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 Processor -- start 2022-02-02T21:07:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 -- start start 2022-02-02T21:07:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 0x7faaf80f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80f5570 con 0x7faaf80f9690 2022-02-02T21:07:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.081+0000 7faafd74f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80f56b0 con 0x7faaf8060310 2022-02-02T21:07:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41020/0 (socket says 172.21.15.96:41020) 2022-02-02T21:07:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 -- 172.21.15.96:0/3178614848 learned_addr learned my addr 172.21.15.96:0/3178614848 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:07:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf7fff700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 0x7faaf80f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 -- 172.21.15.96:0/3178614848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 msgr2=0x7faaf80f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 0x7faaf80f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 -- 172.21.15.96:0/3178614848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8005040 con 0x7faaf80f9690 2022-02-02T21:07:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf77fe700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 rx=0x7faae8013a70 tx=0x7faae8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8018070 con 0x7faaf80f9690 2022-02-02T21:07:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf80f5930 con 0x7faaf80f9690 2022-02-02T21:07:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faae80097d0 con 0x7faaf80f9690 2022-02-02T21:07:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae801de80 con 0x7faaf80f9690 2022-02-02T21:07:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.082+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf80f5e90 con 0x7faaf80f9690 2022-02-02T21:07:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.083+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8045ad0 con 0x7faaf80f9690 2022-02-02T21:07:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.084+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faae8007ba0 con 0x7faaf80f9690 2022-02-02T21:07:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.084+0000 7faaf4ff9700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:07:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.084+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faae8083660 con 0x7faaf80f9690 2022-02-02T21:07:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.084+0000 7faaf7fff700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:07:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.084+0000 7faaf7fff700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7faaf80f6920 tx=0x7faaec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:07:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.088+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faae8051760 con 0x7faaf80f9690 2022-02-02T21:07:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.289+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaf8027a00 con 0x7faaf80f9690 2022-02-02T21:07:48.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.289+0000 7faaf4ff9700 1 -- 172.21.15.96:0/3178614848 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7faae8054d80 con 0x7faaf80f9690 2022-02-02T21:07:48.292 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:07:48.292 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:07:48.292 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:07:48.293 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:07:48.293 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:48.293 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:07:48.293 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:07:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:07:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:07:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:07:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:07:48.294 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:07:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:07:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:07:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:07:48.295 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:07:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:07:48.296 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:07:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:07:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:07:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:07:48.297 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:07:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:07:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:07:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:07:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:07:48.298 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:07:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:07:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:07:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:07:48.299 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:07:48.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:07:48.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:48.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:48.300 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:07:48.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:07:48.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:48.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:48.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:07:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 msgr2=0x7faae00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7faaf80f6920 tx=0x7faaec00b040).stop 2022-02-02T21:07:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 msgr2=0x7faaf80f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:07:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 rx=0x7faae8013a70 tx=0x7faae8009b30).stop 2022-02-02T21:07:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 shutdown_connections 2022-02-02T21:07:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf8060310 0x7faaf80f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 --2- 172.21.15.96:0/3178614848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf80f9690 0x7faaf80f5010 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:07:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 >> 172.21.15.96:0/3178614848 conn(0x7faaf80f0b90 msgr2=0x7faaf80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:07:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 shutdown_connections 2022-02-02T21:07:48.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:07:48.291+0000 7faafd74f700 1 -- 172.21.15.96:0/3178614848 wait complete. 2022-02-02T21:07:48.305 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:07:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:48 smithi159 ceph-mon[69013]: from='client.39202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:48 smithi159 ceph-mon[69013]: from='client.39206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:48 smithi159 ceph-mon[69013]: pgmap v4971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1998875515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:07:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:48 smithi096 ceph-mon[101353]: from='client.39202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:48 smithi096 ceph-mon[101353]: from='client.39206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:07:48.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:48 smithi096 ceph-mon[101353]: pgmap v4971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:48.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1998875515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:07:49.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3178614848' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:07:49.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3178614848' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:07:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:50 smithi159 ceph-mon[69013]: pgmap v4972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:50 smithi096 ceph-mon[101353]: pgmap v4972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:52 smithi096 ceph-mon[101353]: pgmap v4973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:52 smithi159 ceph-mon[69013]: pgmap v4973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:54 smithi159 ceph-mon[69013]: pgmap v4974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:54 smithi096 ceph-mon[101353]: pgmap v4974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:56 smithi159 ceph-mon[69013]: pgmap v4975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:56 smithi096 ceph-mon[101353]: pgmap v4975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:07:58 smithi159 ceph-mon[69013]: pgmap v4976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:07:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:07:58 smithi096 ceph-mon[101353]: pgmap v4976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:00 smithi159 ceph-mon[69013]: pgmap v4977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:00 smithi096 ceph-mon[101353]: pgmap v4977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:03.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:02 smithi096 ceph-mon[101353]: pgmap v4978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:02 smithi159 ceph-mon[69013]: pgmap v4978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:04 smithi159 ceph-mon[69013]: pgmap v4979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:04 smithi096 ceph-mon[101353]: pgmap v4979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:06 smithi159 ceph-mon[69013]: pgmap v4980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:06 smithi096 ceph-mon[101353]: pgmap v4980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:08 smithi159 ceph-mon[69013]: pgmap v4981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:08.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:08 smithi096 ceph-mon[101353]: pgmap v4981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:10 smithi159 ceph-mon[69013]: pgmap v4982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:10 smithi096 ceph-mon[101353]: pgmap v4982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:12 smithi096 ceph-mon[101353]: pgmap v4983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:12 smithi159 ceph-mon[69013]: pgmap v4983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:14 smithi159 ceph-mon[69013]: pgmap v4984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:14 smithi096 ceph-mon[101353]: pgmap v4984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:16 smithi159 ceph-mon[69013]: pgmap v4985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:16 smithi096 ceph-mon[101353]: pgmap v4985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 -- 172.21.15.96:0/2153050035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 msgr2=0x7f2a300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 --2- 172.21.15.96:0/2153050035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a300f7de0 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 rx=0x7f2a2c004660 tx=0x7f2a2c009b30).stop 2022-02-02T21:08:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 -- 172.21.15.96:0/2153050035 shutdown_connections 2022-02-02T21:08:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 --2- 172.21.15.96:0/2153050035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a300f7de0 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 --2- 172.21.15.96:0/2153050035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 0x7f2a300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:08:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 -- 172.21.15.96:0/2153050035 >> 172.21.15.96:0/2153050035 conn(0x7f2a300f1e40 msgr2=0x7f2a300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 -- 172.21.15.96:0/2153050035 shutdown_connections 2022-02-02T21:08:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.402+0000 7f2a37f66700 1 -- 172.21.15.96:0/2153050035 wait complete. 2022-02-02T21:08:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 Processor -- start 2022-02-02T21:08:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 -- start start 2022-02-02T21:08:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 0x7f2a3006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3006a410 con 0x7f2a300f7980 2022-02-02T21:08:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a37f66700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3006a550 con 0x7f2a300f66e0 2022-02-02T21:08:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41038/0 (socket says 172.21.15.96:41038) 2022-02-02T21:08:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 -- 172.21.15.96:0/1904800650 learned_addr learned my addr 172.21.15.96:0/1904800650 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35d02700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 0x7f2a3006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 -- 172.21.15.96:0/1904800650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 msgr2=0x7f2a3006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 0x7f2a3006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.403+0000 7f2a35501700 1 -- 172.21.15.96:0/1904800650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c005040 con 0x7f2a300f7980 2022-02-02T21:08:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a35501700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 rx=0x7f2a2c009990 tx=0x7f2a2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c018070 con 0x7f2a300f7980 2022-02-02T21:08:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a2c007ca0 con 0x7f2a300f7980 2022-02-02T21:08:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3006a7d0 con 0x7f2a300f7980 2022-02-02T21:08:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c01c620 con 0x7f2a300f7980 2022-02-02T21:08:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.404+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3010efe0 con 0x7f2a300f7980 2022-02-02T21:08:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.405+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30045ad0 con 0x7f2a300f7980 2022-02-02T21:08:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.405+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a2c01d960 con 0x7f2a300f7980 2022-02-02T21:08:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.406+0000 7f2a267fc700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 0x7f2a1c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.406+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2a2c0837d0 con 0x7f2a300f7980 2022-02-02T21:08:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.406+0000 7f2a35d02700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 0x7f2a1c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.406+0000 7f2a35d02700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 0x7f2a1c067290 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f2a3006b730 tx=0x7f2a20008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.410+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a2c051a40 con 0x7f2a300f7980 2022-02-02T21:08:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:18 smithi159 ceph-mon[69013]: pgmap v4986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:18 smithi096 ceph-mon[101353]: pgmap v4986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:18.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.589+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a300008d0 con 0x7f2a1c064dd0 2022-02-02T21:08:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.590+0000 7f2a267fc700 1 -- 172.21.15.96:0/1904800650 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2a300008d0 con 0x7f2a1c064dd0 2022-02-02T21:08:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 msgr2=0x7f2a1c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 0x7f2a1c067290 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f2a3006b730 tx=0x7f2a20008040).stop 2022-02-02T21:08:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 msgr2=0x7f2a30069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 rx=0x7f2a2c009990 tx=0x7f2a2c009b30).stop 2022-02-02T21:08:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 shutdown_connections 2022-02-02T21:08:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a1c064dd0 0x7f2a1c067290 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a300f66e0 0x7f2a3006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 --2- 172.21.15.96:0/1904800650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a300f7980 0x7f2a30069e20 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 >> 172.21.15.96:0/1904800650 conn(0x7f2a300f1e40 msgr2=0x7f2a300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 shutdown_connections 2022-02-02T21:08:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.592+0000 7f2a37f66700 1 -- 172.21.15.96:0/1904800650 wait complete. 2022-02-02T21:08:18.603 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:08:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.690+0000 7fa2d0dee700 1 -- 172.21.15.96:0/2058183817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 msgr2=0x7fa2cc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.690+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/2058183817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc0f6950 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 rx=0x7fa2bc004660 tx=0x7fa2bc009b30).stop 2022-02-02T21:08:18.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 -- 172.21.15.96:0/2058183817 shutdown_connections 2022-02-02T21:08:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/2058183817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/2058183817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc0f6950 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 -- 172.21.15.96:0/2058183817 >> 172.21.15.96:0/2058183817 conn(0x7fa2cc0f1c90 msgr2=0x7fa2cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 -- 172.21.15.96:0/2058183817 shutdown_connections 2022-02-02T21:08:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 -- 172.21.15.96:0/2058183817 wait complete. 2022-02-02T21:08:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 Processor -- start 2022-02-02T21:08:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.691+0000 7fa2d0dee700 1 -- start start 2022-02-02T21:08:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1078f0 con 0x7fa2cc0f6530 2022-02-02T21:08:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc108100 con 0x7fa2cc0f77d0 2022-02-02T21:08:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41046/0 (socket says 172.21.15.96:41046) 2022-02-02T21:08:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 -- 172.21.15.96:0/3441157436 learned_addr learned my addr 172.21.15.96:0/3441157436 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2caffd700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 -- 172.21.15.96:0/3441157436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 msgr2=0x7fa2cc1072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc1072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 -- 172.21.15.96:0/3441157436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc005040 con 0x7fa2cc0f6530 2022-02-02T21:08:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2caffd700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:08:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2cb7fe700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 rx=0x7fa2bc004f60 tx=0x7fa2bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc018070 con 0x7fa2cc0f6530 2022-02-02T21:08:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc108320 con 0x7fa2cc0f6530 2022-02-02T21:08:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2bc007ba0 con 0x7fa2cc0f6530 2022-02-02T21:08:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc01c620 con 0x7fa2cc0f6530 2022-02-02T21:08:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.692+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc108880 con 0x7fa2cc0f6530 2022-02-02T21:08:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.693+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc059100 con 0x7fa2cc0f6530 2022-02-02T21:08:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.694+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2bc01c8e0 con 0x7fa2cc0f6530 2022-02-02T21:08:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.694+0000 7fa2b3fff700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 0x7fa2b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.694+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa2bc083a10 con 0x7fa2cc0f6530 2022-02-02T21:08:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.694+0000 7fa2caffd700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 0x7fa2b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.695+0000 7fa2caffd700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 0x7fa2b40672e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fa2c00041d0 tx=0x7fa2c0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.698+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2bc051bd0 con 0x7fa2cc0f6530 2022-02-02T21:08:18.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.870+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2cc0fee60 con 0x7fa2b4064e20 2022-02-02T21:08:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.880+0000 7fa2b3fff700 1 -- 172.21.15.96:0/3441157436 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa2cc0fee60 con 0x7fa2b4064e20 2022-02-02T21:08:18.883 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:08:18.884 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:08:18.884 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:08:18.884 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:08:18.884 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:08:18.885 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:08:18.885 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:08:18.885 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:08:18.885 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:08:18.885 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:08:18.886 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:08:18.886 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:08:18.886 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:08:18.886 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:08:18.887 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:08:18.887 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:08:18.887 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:08:18.887 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:08:18.887 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:08:18.888 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:08:18.888 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:08:18.888 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:08:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.881+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 msgr2=0x7fa2b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.881+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 0x7fa2b40672e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fa2c00041d0 tx=0x7fa2c0009040).stop 2022-02-02T21:08:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.881+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 msgr2=0x7fa2cc106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.881+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 rx=0x7fa2bc004f60 tx=0x7fa2bc009b30).stop 2022-02-02T21:08:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 shutdown_connections 2022-02-02T21:08:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2b4064e20 0x7fa2b40672e0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2cc0f6530 0x7fa2cc106e00 unknown :-1 s=CLOSED pgs=2558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 --2- 172.21.15.96:0/3441157436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc0f77d0 0x7fa2cc1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 >> 172.21.15.96:0/3441157436 conn(0x7fa2cc0f1c90 msgr2=0x7fa2cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 shutdown_connections 2022-02-02T21:08:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.882+0000 7fa2d0dee700 1 -- 172.21.15.96:0/3441157436 wait complete. 2022-02-02T21:08:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 -- 172.21.15.96:0/1456099261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f77d0 msgr2=0x7f67ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 --2- 172.21.15.96:0/1456099261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f77d0 0x7f67ec0f7c30 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 rx=0x7f67dc004660 tx=0x7f67dc009b30).stop 2022-02-02T21:08:18.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 -- 172.21.15.96:0/1456099261 shutdown_connections 2022-02-02T21:08:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 --2- 172.21.15.96:0/1456099261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f77d0 0x7f67ec0f7c30 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 --2- 172.21.15.96:0/1456099261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f6530 0x7f67ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:08:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.977+0000 7f67f268e700 1 -- 172.21.15.96:0/1456099261 >> 172.21.15.96:0/1456099261 conn(0x7f67ec0f1c90 msgr2=0x7f67ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.978+0000 7f67f268e700 1 -- 172.21.15.96:0/1456099261 shutdown_connections 2022-02-02T21:08:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.978+0000 7f67f268e700 1 -- 172.21.15.96:0/1456099261 wait complete. 2022-02-02T21:08:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.978+0000 7f67f268e700 1 Processor -- start 2022-02-02T21:08:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.978+0000 7f67f268e700 1 -- start start 2022-02-02T21:08:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f268e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f268e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 0x7f67ec1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f268e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec107980 con 0x7f67ec0f6530 2022-02-02T21:08:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f268e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec108100 con 0x7f67ec0f77d0 2022-02-02T21:08:18.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41054/0 (socket says 172.21.15.96:41054) 2022-02-02T21:08:18.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 -- 172.21.15.96:0/3125462485 learned_addr learned my addr 172.21.15.96:0/3125462485 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:18.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f0e8b700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 0x7f67ec1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 -- 172.21.15.96:0/3125462485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 msgr2=0x7f67ec1072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:18.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 0x7f67ec1072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:18.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 -- 172.21.15.96:0/3125462485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc005040 con 0x7f67ec0f6530 2022-02-02T21:08:18.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f0e8b700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 0x7f67ec1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:08:18.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f168c700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 rx=0x7f67e80093f0 tx=0x7f67e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e8009ea0 con 0x7f67ec0f6530 2022-02-02T21:08:18.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec108380 con 0x7f67ec0f6530 2022-02-02T21:08:18.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f67e8013af0 con 0x7f67ec0f6530 2022-02-02T21:08:18.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.979+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e800db10 con 0x7f67ec0f6530 2022-02-02T21:08:18.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.980+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec108940 con 0x7f67ec0f6530 2022-02-02T21:08:18.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.981+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec045ad0 con 0x7f67ec0f6530 2022-02-02T21:08:18.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.981+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f67e801a060 con 0x7f67ec0f6530 2022-02-02T21:08:18.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.981+0000 7f67e1ffb700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 0x7f67d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:18.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.981+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f67e8081aa0 con 0x7f67ec0f6530 2022-02-02T21:08:18.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.981+0000 7f67f0e8b700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 0x7f67d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:18.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.982+0000 7f67f0e8b700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 0x7f67d80672e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f67dc009da0 tx=0x7f67dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:18.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:18.986+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f67e804fba0 con 0x7f67ec0f6530 2022-02-02T21:08:19.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.214+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67ec0feed0 con 0x7f67ec0f6530 2022-02-02T21:08:19.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.215+0000 7f67e1ffb700 1 -- 172.21.15.96:0/3125462485 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f67e8018070 con 0x7f67ec0f6530 2022-02-02T21:08:19.217 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:08:19.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:08:19.217 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:08:19.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:19.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:08:19.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:08:19.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:19.219 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:08:19.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:08:19.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:19.219 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:08:19.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:08:19.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:19.221 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:08:19.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:08:19.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:08:19.221 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:08:19.221 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:08:19.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 msgr2=0x7f67d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 0x7f67d80672e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f67dc009da0 tx=0x7f67dc009b30).stop 2022-02-02T21:08:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 msgr2=0x7f67ec106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 rx=0x7f67e80093f0 tx=0x7f67e8006ec0).stop 2022-02-02T21:08:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 shutdown_connections 2022-02-02T21:08:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f67d8064e20 0x7f67d80672e0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67ec0f6530 0x7f67ec106e00 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 --2- 172.21.15.96:0/3125462485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ec0f77d0 0x7f67ec1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 >> 172.21.15.96:0/3125462485 conn(0x7f67ec0f1c90 msgr2=0x7f67ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 shutdown_connections 2022-02-02T21:08:19.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.218+0000 7f67f268e700 1 -- 172.21.15.96:0/3125462485 wait complete. 2022-02-02T21:08:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 -- 172.21.15.96:0/1372333771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f6860 msgr2=0x7fde240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1372333771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f6860 0x7fde240f6cc0 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 rx=0x7fde10004660 tx=0x7fde10009b30).stop 2022-02-02T21:08:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 -- 172.21.15.96:0/1372333771 shutdown_connections 2022-02-02T21:08:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1372333771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f6860 0x7fde240f6cc0 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1372333771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f55c0 0x7fde240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 -- 172.21.15.96:0/1372333771 >> 172.21.15.96:0/1372333771 conn(0x7fde240f0d40 msgr2=0x7fde240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 -- 172.21.15.96:0/1372333771 shutdown_connections 2022-02-02T21:08:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.317+0000 7fde2abf2700 1 -- 172.21.15.96:0/1372333771 wait complete. 2022-02-02T21:08:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 Processor -- start 2022-02-02T21:08:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 -- start start 2022-02-02T21:08:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f6860 0x7fde241063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:19.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241069b0 con 0x7fde240f55c0 2022-02-02T21:08:19.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2abf2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241071c0 con 0x7fde240f6860 2022-02-02T21:08:19.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:19.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41064/0 (socket says 172.21.15.96:41064) 2022-02-02T21:08:19.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 -- 172.21.15.96:0/1421522547 learned_addr learned my addr 172.21.15.96:0/1421522547 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:19.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde23fff700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f6860 0x7fde241063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:19.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 -- 172.21.15.96:0/1421522547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f6860 msgr2=0x7fde241063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f6860 0x7fde241063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.318+0000 7fde2898e700 1 -- 172.21.15.96:0/1421522547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10005040 con 0x7fde240f55c0 2022-02-02T21:08:19.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde2898e700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 rx=0x7fde1800f910 tx=0x7fde18009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:19.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde18009500 con 0x7fde240f55c0 2022-02-02T21:08:19.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde18009660 con 0x7fde240f55c0 2022-02-02T21:08:19.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde241073e0 con 0x7fde240f55c0 2022-02-02T21:08:19.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800de20 con 0x7fde240f55c0 2022-02-02T21:08:19.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.319+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde24107970 con 0x7fde240f55c0 2022-02-02T21:08:19.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.320+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde240f49b0 con 0x7fde240f55c0 2022-02-02T21:08:19.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.320+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde1800e040 con 0x7fde240f55c0 2022-02-02T21:08:19.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.321+0000 7fde217fa700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 0x7fde14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:19.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.321+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde180840e0 con 0x7fde240f55c0 2022-02-02T21:08:19.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.321+0000 7fde23fff700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 0x7fde14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:19.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.321+0000 7fde23fff700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 0x7fde14067290 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fde10004630 tx=0x7fde10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:19.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.325+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde180521e0 con 0x7fde240f55c0 2022-02-02T21:08:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.524+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde240ff830 con 0x7fde240f55c0 2022-02-02T21:08:19.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:19 smithi096 ceph-mon[101353]: from='client.39218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:19.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:19 smithi096 ceph-mon[101353]: from='client.39222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:19.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3125462485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:08:19.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.525+0000 7fde217fa700 1 -- 172.21.15.96:0/1421522547 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fde18055800 con 0x7fde240f55c0 2022-02-02T21:08:19.528 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:08:19.529 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:08:19.529 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:08:19.529 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:08:19.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:19.530 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:08:19.530 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:08:19.530 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:08:19.530 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:08:19.531 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:08:19.531 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:08:19.531 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:08:19.531 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:08:19.532 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:08:19.532 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:08:19.532 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:08:19.532 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:08:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:08:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:08:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:08:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:08:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:08:19.534 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:08:19.534 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:08:19.534 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:08:19.534 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:08:19.535 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:08:19.535 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:08:19.535 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:08:19.535 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:08:19.535 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:08:19.536 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:08:19.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:19.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:19.536 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:08:19.537 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:19.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:19.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:19.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 msgr2=0x7fde14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 0x7fde14067290 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fde10004630 tx=0x7fde10009b30).stop 2022-02-02T21:08:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 msgr2=0x7fde24105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 rx=0x7fde1800f910 tx=0x7fde18009d80).stop 2022-02-02T21:08:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 shutdown_connections 2022-02-02T21:08:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde14064dd0 0x7fde14067290 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde240f55c0 0x7fde24105ec0 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 --2- 172.21.15.96:0/1421522547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde240f6860 0x7fde241063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 >> 172.21.15.96:0/1421522547 conn(0x7fde240f0d40 msgr2=0x7fde240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 shutdown_connections 2022-02-02T21:08:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:19.528+0000 7fde2abf2700 1 -- 172.21.15.96:0/1421522547 wait complete. 2022-02-02T21:08:19.541 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:08:19.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:19 smithi159 ceph-mon[69013]: from='client.39218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:19.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:19 smithi159 ceph-mon[69013]: from='client.39222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:19.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3125462485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:08:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1421522547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:08:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:20 smithi096 ceph-mon[101353]: pgmap v4987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1421522547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:08:20.778 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:20 smithi159 ceph-mon[69013]: pgmap v4987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:22 smithi096 ceph-mon[101353]: pgmap v4988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:22 smithi159 ceph-mon[69013]: pgmap v4988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:24 smithi159 ceph-mon[69013]: pgmap v4989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:24 smithi096 ceph-mon[101353]: pgmap v4989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:26 smithi159 ceph-mon[69013]: pgmap v4990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:26 smithi096 ceph-mon[101353]: pgmap v4990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:08:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:08:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:28 smithi159 ceph-mon[69013]: pgmap v4991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:08:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:08:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:28 smithi096 ceph-mon[101353]: pgmap v4991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:30 smithi159 ceph-mon[69013]: pgmap v4992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:30 smithi096 ceph-mon[101353]: pgmap v4992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:32 smithi096 ceph-mon[101353]: pgmap v4993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:32 smithi159 ceph-mon[69013]: pgmap v4993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:34 smithi159 ceph-mon[69013]: pgmap v4994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:34 smithi096 ceph-mon[101353]: pgmap v4994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:36 smithi159 ceph-mon[69013]: pgmap v4995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:36 smithi096 ceph-mon[101353]: pgmap v4995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:38 smithi096 ceph-mon[101353]: pgmap v4996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:38 smithi159 ceph-mon[69013]: pgmap v4996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:40 smithi159 ceph-mon[69013]: pgmap v4997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:40 smithi096 ceph-mon[101353]: pgmap v4997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:42 smithi096 ceph-mon[101353]: pgmap v4998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:42 smithi159 ceph-mon[69013]: pgmap v4998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:44 smithi159 ceph-mon[69013]: pgmap v4999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:44 smithi096 ceph-mon[101353]: pgmap v4999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:47.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:46 smithi159 ceph-mon[69013]: pgmap v5000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:46 smithi096 ceph-mon[101353]: pgmap v5000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:48 smithi096 ceph-mon[101353]: pgmap v5001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:48 smithi159 ceph-mon[69013]: pgmap v5001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:49.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 -- 172.21.15.96:0/2579108446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5340 msgr2=0x7fcea80f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 --2- 172.21.15.96:0/2579108446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5340 0x7fcea80f7ac0 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 rx=0x7fcea4004660 tx=0x7fcea4009b30).stop 2022-02-02T21:08:49.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 -- 172.21.15.96:0/2579108446 shutdown_connections 2022-02-02T21:08:49.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 --2- 172.21.15.96:0/2579108446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f5340 0x7fcea80f7ac0 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 --2- 172.21.15.96:0/2579108446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f49a0 0x7fcea80f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.637+0000 7fceafdcf700 1 -- 172.21.15.96:0/2579108446 >> 172.21.15.96:0/2579108446 conn(0x7fcea80f04c0 msgr2=0x7fcea80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 -- 172.21.15.96:0/2579108446 shutdown_connections 2022-02-02T21:08:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 -- 172.21.15.96:0/2579108446 wait complete. 2022-02-02T21:08:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 Processor -- start 2022-02-02T21:08:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 -- start start 2022-02-02T21:08:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5340 0x7fcea8107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8107af0 con 0x7fcea80f49a0 2022-02-02T21:08:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceafdcf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8107c30 con 0x7fcea80f5340 2022-02-02T21:08:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceadb6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.638+0000 7fceadb6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41094/0 (socket says 172.21.15.96:41094) 2022-02-02T21:08:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceadb6b700 1 -- 172.21.15.96:0/3642730022 learned_addr learned my addr 172.21.15.96:0/3642730022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fcead36a700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5340 0x7fcea8107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceadb6b700 1 -- 172.21.15.96:0/3642730022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5340 msgr2=0x7fcea8107540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceadb6b700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5340 0x7fcea8107540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceadb6b700 1 -- 172.21.15.96:0/3642730022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4005040 con 0x7fcea80f49a0 2022-02-02T21:08:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceadb6b700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 rx=0x7fce9c00c530 tx=0x7fce9c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:49.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c00f650 con 0x7fcea80f49a0 2022-02-02T21:08:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce9c00fc60 con 0x7fcea80f49a0 2022-02-02T21:08:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea81085d0 con 0x7fcea80f49a0 2022-02-02T21:08:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c012cb0 con 0x7fcea80f49a0 2022-02-02T21:08:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.639+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea8108b90 con 0x7fcea80f49a0 2022-02-02T21:08:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.640+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea8045ad0 con 0x7fcea80f49a0 2022-02-02T21:08:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.642+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce9c019030 con 0x7fcea80f49a0 2022-02-02T21:08:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.642+0000 7fce9a7fc700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.642+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce9c081a50 con 0x7fcea80f49a0 2022-02-02T21:08:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.642+0000 7fcead36a700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.643+0000 7fcead36a700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fcea4004580 tx=0x7fcea4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.646+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce9c053630 con 0x7fcea80f49a0 2022-02-02T21:08:49.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.823+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea8108ec0 con 0x7fce94064dd0 2022-02-02T21:08:49.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.824+0000 7fce9a7fc700 1 -- 172.21.15.96:0/3642730022 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcea8108ec0 con 0x7fce94064dd0 2022-02-02T21:08:49.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 msgr2=0x7fce94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fcea4004580 tx=0x7fcea4009b30).stop 2022-02-02T21:08:49.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 msgr2=0x7fcea8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 rx=0x7fce9c00c530 tx=0x7fce9c007e10).stop 2022-02-02T21:08:49.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 shutdown_connections 2022-02-02T21:08:49.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcea80f49a0 0x7fcea8107050 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 --2- 172.21.15.96:0/3642730022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcea80f5340 0x7fcea8107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 >> 172.21.15.96:0/3642730022 conn(0x7fcea80f04c0 msgr2=0x7fcea80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:49.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 shutdown_connections 2022-02-02T21:08:49.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.826+0000 7fceafdcf700 1 -- 172.21.15.96:0/3642730022 wait complete. 2022-02-02T21:08:49.836 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:08:49.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 -- 172.21.15.96:0/1457120263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 msgr2=0x7f53080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 --2- 172.21.15.96:0/1457120263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f53080f6b00 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 rx=0x7f52fc004660 tx=0x7f52fc009b30).stop 2022-02-02T21:08:49.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 -- 172.21.15.96:0/1457120263 shutdown_connections 2022-02-02T21:08:49.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 --2- 172.21.15.96:0/1457120263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 0x7f53080f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 --2- 172.21.15.96:0/1457120263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f53080f6b00 unknown :-1 s=CLOSED pgs=2565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 -- 172.21.15.96:0/1457120263 >> 172.21.15.96:0/1457120263 conn(0x7f53080f1f00 msgr2=0x7f53080f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:49.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 -- 172.21.15.96:0/1457120263 shutdown_connections 2022-02-02T21:08:49.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.924+0000 7f530d5f5700 1 -- 172.21.15.96:0/1457120263 wait complete. 2022-02-02T21:08:49.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 Processor -- start 2022-02-02T21:08:49.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 -- start start 2022-02-02T21:08:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 0x7f5308107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308107a00 con 0x7f53080f66e0 2022-02-02T21:08:49.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f530d5f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308107b40 con 0x7f53080f6ff0 2022-02-02T21:08:49.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.925+0000 7f5306ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41102/0 (socket says 172.21.15.96:41102) 2022-02-02T21:08:49.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 -- 172.21.15.96:0/622374939 learned_addr learned my addr 172.21.15.96:0/622374939 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:49.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f53067fc700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 0x7f5308107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 -- 172.21.15.96:0/622374939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 msgr2=0x7f5308107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:49.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 0x7f5308107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:49.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 -- 172.21.15.96:0/622374939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc005040 con 0x7f53080f66e0 2022-02-02T21:08:49.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f5306ffd700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 rx=0x7f52fc009990 tx=0x7f52fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:49.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc018070 con 0x7f53080f66e0 2022-02-02T21:08:49.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52fc007ba0 con 0x7f53080f66e0 2022-02-02T21:08:49.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5308108480 con 0x7f53080f66e0 2022-02-02T21:08:49.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc01c3c0 con 0x7f53080f66e0 2022-02-02T21:08:49.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.926+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53081089e0 con 0x7f53080f66e0 2022-02-02T21:08:49.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.927+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308045ad0 con 0x7f53080f66e0 2022-02-02T21:08:49.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.928+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52fc01d420 con 0x7f53080f66e0 2022-02-02T21:08:49.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.929+0000 7f52ef7fe700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 0x7f52f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:49.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.929+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52fc0838a0 con 0x7f53080f66e0 2022-02-02T21:08:49.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.929+0000 7f53067fc700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 0x7f52f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:49.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.929+0000 7f53067fc700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 0x7f52f0067290 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f52f8004c40 tx=0x7f52f800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:49.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:49.932+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52fc0553d0 con 0x7f53080f66e0 2022-02-02T21:08:50.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.105+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53080ff010 con 0x7f52f0064dd0 2022-02-02T21:08:50.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.115+0000 7f52ef7fe700 1 -- 172.21.15.96:0/622374939 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f53080ff010 con 0x7f52f0064dd0 2022-02-02T21:08:50.117 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:08:50.117 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:08:50.117 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:08:50.117 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:08:50.118 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:08:50.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:08:50.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:08:50.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:08:50.118 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:08:50.119 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:08:50.119 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:08:50.119 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:08:50.120 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:08:50.120 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:08:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:08:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:08:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:08:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:08:50.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:08:50.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:08:50.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:08:50.122 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:08:50.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.116+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 msgr2=0x7f52f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.116+0000 7f530d5f5700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 0x7f52f0067290 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f52f8004c40 tx=0x7f52f800b040).stop 2022-02-02T21:08:50.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.116+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 msgr2=0x7f5308106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.116+0000 7f530d5f5700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 rx=0x7f52fc009990 tx=0x7f52fc009b30).stop 2022-02-02T21:08:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 shutdown_connections 2022-02-02T21:08:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52f0064dd0 0x7f52f0067290 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53080f66e0 0x7f5308106f60 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 --2- 172.21.15.96:0/622374939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53080f6ff0 0x7f5308107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 >> 172.21.15.96:0/622374939 conn(0x7f53080f1f00 msgr2=0x7f53080fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 shutdown_connections 2022-02-02T21:08:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.117+0000 7f530d5f5700 1 -- 172.21.15.96:0/622374939 wait complete. 2022-02-02T21:08:50.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/2741619204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f6700 msgr2=0x7fb5e80f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/2741619204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f6700 0x7fb5e80f6b60 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 rx=0x7fb5dc004660 tx=0x7fb5dc009b30).stop 2022-02-02T21:08:50.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/2741619204 shutdown_connections 2022-02-02T21:08:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/2741619204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f6700 0x7fb5e80f6b60 unknown :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/2741619204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f5460 0x7fb5e80f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/2741619204 >> 172.21.15.96:0/2741619204 conn(0x7fb5e80f0bc0 msgr2=0x7fb5e80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/2741619204 shutdown_connections 2022-02-02T21:08:50.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.212+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/2741619204 wait complete. 2022-02-02T21:08:50.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 Processor -- start 2022-02-02T21:08:50.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 -- start start 2022-02-02T21:08:50.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f6700 0x7fb5e8109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8060420 con 0x7fb5e80f5460 2022-02-02T21:08:50.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5ed6ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8060560 con 0x7fb5e80f6700 2022-02-02T21:08:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5e6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5e6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41112/0 (socket says 172.21.15.96:41112) 2022-02-02T21:08:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.213+0000 7fb5e6ffd700 1 -- 172.21.15.96:0/1900148023 learned_addr learned my addr 172.21.15.96:0/1900148023 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:50.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5e67fc700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f6700 0x7fb5e8109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5e6ffd700 1 -- 172.21.15.96:0/1900148023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f6700 msgr2=0x7fb5e8109d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5e6ffd700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f6700 0x7fb5e8109d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5e6ffd700 1 -- 172.21.15.96:0/1900148023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc005040 con 0x7fb5e80f5460 2022-02-02T21:08:50.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5e6ffd700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 rx=0x7fb5d800c530 tx=0x7fb5d8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:50.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d800f650 con 0x7fb5e80f5460 2022-02-02T21:08:50.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e810a350 con 0x7fb5e80f5460 2022-02-02T21:08:50.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb5d800fc60 con 0x7fb5e80f5460 2022-02-02T21:08:50.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e810a910 con 0x7fb5e80f5460 2022-02-02T21:08:50.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.214+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d8012cb0 con 0x7fb5e80f5460 2022-02-02T21:08:50.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.215+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8004fa0 con 0x7fb5e80f5460 2022-02-02T21:08:50.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.216+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb5d8019030 con 0x7fb5e80f5460 2022-02-02T21:08:50.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.216+0000 7fb5cf7fe700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 0x7fb5d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.216+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb5d80814b0 con 0x7fb5e80f5460 2022-02-02T21:08:50.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.216+0000 7fb5e67fc700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 0x7fb5d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.216+0000 7fb5e67fc700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 0x7fb5d00672e0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fb5dc004630 tx=0x7fb5dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:50.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.220+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb5d80487d0 con 0x7fb5e80f5460 2022-02-02T21:08:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.452+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5c8005e80 con 0x7fb5e80f5460 2022-02-02T21:08:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.452+0000 7fb5cf7fe700 1 -- 172.21.15.96:0/1900148023 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb5d804f660 con 0x7fb5e80f5460 2022-02-02T21:08:50.454 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:08:50.454 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:08:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:08:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:08:50.455 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:08:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:08:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:08:50.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:08:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:08:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:08:50.457 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:08:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:08:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:08:50.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:08:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:08:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 msgr2=0x7fb5d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 0x7fb5d00672e0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fb5dc004630 tx=0x7fb5dc009b30).stop 2022-02-02T21:08:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 msgr2=0x7fb5e8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 rx=0x7fb5d800c530 tx=0x7fb5d8007e10).stop 2022-02-02T21:08:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 shutdown_connections 2022-02-02T21:08:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5d0064e20 0x7fb5d00672e0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80f5460 0x7fb5e8107840 unknown :-1 s=CLOSED pgs=2568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 --2- 172.21.15.96:0/1900148023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e80f6700 0x7fb5e8109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 >> 172.21.15.96:0/1900148023 conn(0x7fb5e80f0bc0 msgr2=0x7fb5e80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:50.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 shutdown_connections 2022-02-02T21:08:50.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.454+0000 7fb5ed6ce700 1 -- 172.21.15.96:0/1900148023 wait complete. 2022-02-02T21:08:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 -- 172.21.15.96:0/3752159646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 msgr2=0x7f49ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 --2- 172.21.15.96:0/3752159646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec0f6cc0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 rx=0x7f49d8004660 tx=0x7f49d8009b30).stop 2022-02-02T21:08:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 -- 172.21.15.96:0/3752159646 shutdown_connections 2022-02-02T21:08:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 --2- 172.21.15.96:0/3752159646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec0f6cc0 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 --2- 172.21.15.96:0/3752159646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 0x7f49ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:08:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 -- 172.21.15.96:0/3752159646 >> 172.21.15.96:0/3752159646 conn(0x7f49ec0f0d40 msgr2=0x7f49ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:50.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 -- 172.21.15.96:0/3752159646 shutdown_connections 2022-02-02T21:08:50.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.552+0000 7f49f311e700 1 -- 172.21.15.96:0/3752159646 wait complete. 2022-02-02T21:08:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 Processor -- start 2022-02-02T21:08:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 -- start start 2022-02-02T21:08:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 0x7f49ec05ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec060590 con 0x7f49ec0f6860 2022-02-02T21:08:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f311e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec068d70 con 0x7f49ec0f55c0 2022-02-02T21:08:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41124/0 (socket says 172.21.15.96:41124) 2022-02-02T21:08:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49ebfff700 1 -- 172.21.15.96:0/2096407581 learned_addr learned my addr 172.21.15.96:0/2096407581 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:08:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.553+0000 7f49f0eba700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 0x7f49ec05ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49ebfff700 1 -- 172.21.15.96:0/2096407581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 msgr2=0x7f49ec05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49ebfff700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 0x7f49ec05ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49ebfff700 1 -- 172.21.15.96:0/2096407581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8005040 con 0x7f49ec0f6860 2022-02-02T21:08:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49ebfff700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 rx=0x7f49d8009990 tx=0x7f49d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d8018070 con 0x7f49ec0f6860 2022-02-02T21:08:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec068f00 con 0x7f49ec0f6860 2022-02-02T21:08:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec069460 con 0x7f49ec0f6860 2022-02-02T21:08:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49d8007ba0 con 0x7f49ec0f6860 2022-02-02T21:08:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.554+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d801c620 con 0x7f49ec0f6860 2022-02-02T21:08:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.555+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc004fa0 con 0x7f49ec0f6860 2022-02-02T21:08:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.556+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f49d801c890 con 0x7f49ec0f6860 2022-02-02T21:08:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.556+0000 7f49e97fa700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:08:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.556+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49d8083630 con 0x7f49ec0f6860 2022-02-02T21:08:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.556+0000 7f49f0eba700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:08:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.557+0000 7f49f0eba700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f49ec05fc90 tx=0x7f49e0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:08:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.561+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49d80516d0 con 0x7f49ec0f6860 2022-02-02T21:08:50.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.764+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49cc005e80 con 0x7f49ec0f6860 2022-02-02T21:08:50.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.765+0000 7f49e97fa700 1 -- 172.21.15.96:0/2096407581 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f49d8054cf0 con 0x7f49ec0f6860 2022-02-02T21:08:50.767 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:08:50.767 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:08:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:08:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:08:50.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:08:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:08:50.769 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:08:50.769 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:08:50.769 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:08:50.769 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:08:50.770 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:08:50.770 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:08:50.770 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:08:50.770 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:08:50.770 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:08:50.771 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:08:50.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:08:50.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:08:50.771 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:08:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:08:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:08:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:08:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:08:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:08:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:08:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:08:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:08:50.773 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:08:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:08:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:08:50.774 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:08:50.774 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:50.775 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:08:50.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:08:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:50.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:08:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 msgr2=0x7f49dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f49ec05fc90 tx=0x7f49e0008040).stop 2022-02-02T21:08:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 msgr2=0x7f49ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:08:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 rx=0x7f49d8009990 tx=0x7f49d8009b30).stop 2022-02-02T21:08:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 shutdown_connections 2022-02-02T21:08:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49dc064dd0 0x7f49dc067290 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49ec0f55c0 0x7f49ec05ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 --2- 172.21.15.96:0/2096407581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49ec0f6860 0x7f49ec068880 unknown :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:08:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 >> 172.21.15.96:0/2096407581 conn(0x7f49ec0f0d40 msgr2=0x7f49ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:08:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 shutdown_connections 2022-02-02T21:08:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:08:50.767+0000 7f49f311e700 1 -- 172.21.15.96:0/2096407581 wait complete. 2022-02-02T21:08:50.780 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:08:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:50 smithi159 ceph-mon[69013]: pgmap v5002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:50 smithi159 ceph-mon[69013]: from='client.39234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1900148023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:08:51.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2096407581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:08:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:50 smithi096 ceph-mon[101353]: pgmap v5002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:50 smithi096 ceph-mon[101353]: from='client.39234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1900148023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:08:51.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2096407581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:08:52.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:51 smithi159 ceph-mon[69013]: from='client.39238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:52.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:51 smithi096 ceph-mon[101353]: from='client.39238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:08:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:52 smithi096 ceph-mon[101353]: pgmap v5003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:52 smithi159 ceph-mon[69013]: pgmap v5003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:54 smithi159 ceph-mon[69013]: pgmap v5004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:54 smithi096 ceph-mon[101353]: pgmap v5004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:56 smithi159 ceph-mon[69013]: pgmap v5005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:56 smithi096 ceph-mon[101353]: pgmap v5005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:58.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:08:58 smithi096 ceph-mon[101353]: pgmap v5006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:08:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:08:58 smithi159 ceph-mon[69013]: pgmap v5006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:00 smithi159 ceph-mon[69013]: pgmap v5007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:00 smithi096 ceph-mon[101353]: pgmap v5007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:02 smithi096 ceph-mon[101353]: pgmap v5008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:02 smithi159 ceph-mon[69013]: pgmap v5008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:04 smithi159 ceph-mon[69013]: pgmap v5009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:04 smithi096 ceph-mon[101353]: pgmap v5009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:06 smithi159 ceph-mon[69013]: pgmap v5010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:06 smithi096 ceph-mon[101353]: pgmap v5010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:08 smithi096 ceph-mon[101353]: pgmap v5011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:08 smithi159 ceph-mon[69013]: pgmap v5011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:10 smithi159 ceph-mon[69013]: pgmap v5012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:10 smithi096 ceph-mon[101353]: pgmap v5012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:12 smithi096 ceph-mon[101353]: pgmap v5013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:12 smithi159 ceph-mon[69013]: pgmap v5013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:14 smithi159 ceph-mon[69013]: pgmap v5014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:14 smithi096 ceph-mon[101353]: pgmap v5014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:16 smithi159 ceph-mon[69013]: pgmap v5015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:16 smithi096 ceph-mon[101353]: pgmap v5015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:18 smithi096 ceph-mon[101353]: pgmap v5016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:18 smithi159 ceph-mon[69013]: pgmap v5016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 -- 172.21.15.96:0/569192685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 msgr2=0x7fcf200f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 --2- 172.21.15.96:0/569192685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf200f5850 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 rx=0x7fcf10004660 tx=0x7fcf10009b30).stop 2022-02-02T21:09:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 -- 172.21.15.96:0/569192685 shutdown_connections 2022-02-02T21:09:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 --2- 172.21.15.96:0/569192685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 0x7fcf200f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:09:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 --2- 172.21.15.96:0/569192685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf200f5850 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.877+0000 7fcf248c6700 1 -- 172.21.15.96:0/569192685 >> 172.21.15.96:0/569192685 conn(0x7fcf200f0b90 msgr2=0x7fcf200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.878+0000 7fcf248c6700 1 -- 172.21.15.96:0/569192685 shutdown_connections 2022-02-02T21:09:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.878+0000 7fcf248c6700 1 -- 172.21.15.96:0/569192685 wait complete. 2022-02-02T21:09:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.878+0000 7fcf248c6700 1 Processor -- start 2022-02-02T21:09:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.878+0000 7fcf248c6700 1 -- start start 2022-02-02T21:09:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.878+0000 7fcf248c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf248c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 0x7fcf201072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf248c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20107950 con 0x7fcf200f5430 2022-02-02T21:09:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf248c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20108100 con 0x7fcf200f66d0 2022-02-02T21:09:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41144/0 (socket says 172.21.15.96:41144) 2022-02-02T21:09:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 -- 172.21.15.96:0/3354383525 learned_addr learned my addr 172.21.15.96:0/3354383525 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1e59c700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 0x7fcf201072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 -- 172.21.15.96:0/3354383525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 msgr2=0x7fcf201072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 0x7fcf201072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 -- 172.21.15.96:0/3354383525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10005040 con 0x7fcf200f5430 2022-02-02T21:09:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf1ed9d700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 rx=0x7fcf10000c00 tx=0x7fcf10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf10018070 con 0x7fcf200f5430 2022-02-02T21:09:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20108380 con 0x7fcf200f5430 2022-02-02T21:09:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf10007cf0 con 0x7fcf200f5430 2022-02-02T21:09:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1001c3c0 con 0x7fcf200f5430 2022-02-02T21:09:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.879+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf201088e0 con 0x7fcf200f5430 2022-02-02T21:09:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.880+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20059100 con 0x7fcf200f5430 2022-02-02T21:09:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.881+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf1001d420 con 0x7fcf200f5430 2022-02-02T21:09:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.881+0000 7fcf077fe700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 0x7fcf080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.881+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf100838f0 con 0x7fcf200f5430 2022-02-02T21:09:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.881+0000 7fcf1e59c700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 0x7fcf080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.882+0000 7fcf1e59c700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 0x7fcf080672e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7fcf20106b60 tx=0x7fcf14008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:20.886+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf100519f0 con 0x7fcf200f5430 2022-02-02T21:09:21.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.063+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf200fab10 con 0x7fcf08064e20 2022-02-02T21:09:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.064+0000 7fcf077fe700 1 -- 172.21.15.96:0/3354383525 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcf200fab10 con 0x7fcf08064e20 2022-02-02T21:09:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 msgr2=0x7fcf080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 0x7fcf080672e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7fcf20106b60 tx=0x7fcf14008040).stop 2022-02-02T21:09:21.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 msgr2=0x7fcf20106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 rx=0x7fcf10000c00 tx=0x7fcf10009b30).stop 2022-02-02T21:09:21.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 shutdown_connections 2022-02-02T21:09:21.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf08064e20 0x7fcf080672e0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf200f5430 0x7fcf20106dd0 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 --2- 172.21.15.96:0/3354383525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf200f66d0 0x7fcf201072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 >> 172.21.15.96:0/3354383525 conn(0x7fcf200f0b90 msgr2=0x7fcf2005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 shutdown_connections 2022-02-02T21:09:21.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.066+0000 7fcf248c6700 1 -- 172.21.15.96:0/3354383525 wait complete. 2022-02-02T21:09:21.078 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:09:21.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 -- 172.21.15.96:0/1188814454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f66d0 msgr2=0x7fd8700f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 --2- 172.21.15.96:0/1188814454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f66d0 0x7fd8700f6b30 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 rx=0x7fd86c004660 tx=0x7fd86c009b30).stop 2022-02-02T21:09:21.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 -- 172.21.15.96:0/1188814454 shutdown_connections 2022-02-02T21:09:21.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 --2- 172.21.15.96:0/1188814454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f66d0 0x7fd8700f6b30 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 --2- 172.21.15.96:0/1188814454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f5430 0x7fd8700f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 -- 172.21.15.96:0/1188814454 >> 172.21.15.96:0/1188814454 conn(0x7fd8700f0b90 msgr2=0x7fd8700f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 -- 172.21.15.96:0/1188814454 shutdown_connections 2022-02-02T21:09:21.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.163+0000 7fd8771ce700 1 -- 172.21.15.96:0/1188814454 wait complete. 2022-02-02T21:09:21.168 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:20 smithi096 ceph-mon[101353]: pgmap v5017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:21.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 Processor -- start 2022-02-02T21:09:21.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 -- start start 2022-02-02T21:09:21.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f66d0 0x7fd8701061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd870106760 con 0x7fd8700f5430 2022-02-02T21:09:21.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8771ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd870106f60 con 0x7fd8700f66d0 2022-02-02T21:09:21.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8761cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8761cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41154/0 (socket says 172.21.15.96:41154) 2022-02-02T21:09:21.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8761cc700 1 -- 172.21.15.96:0/2123279987 learned_addr learned my addr 172.21.15.96:0/2123279987 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:21.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.164+0000 7fd8759cb700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f66d0 0x7fd8701061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8761cc700 1 -- 172.21.15.96:0/2123279987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f66d0 msgr2=0x7fd8701061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8761cc700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f66d0 0x7fd8701061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8761cc700 1 -- 172.21.15.96:0/2123279987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c005040 con 0x7fd8700f5430 2022-02-02T21:09:21.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8761cc700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 rx=0x7fd860002700 tx=0x7fd860009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8600079c0 con 0x7fd8700f5430 2022-02-02T21:09:21.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd86000f040 con 0x7fd8700f5430 2022-02-02T21:09:21.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd860014860 con 0x7fd8700f5430 2022-02-02T21:09:21.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd870107240 con 0x7fd8700f5430 2022-02-02T21:09:21.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.165+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8701077b0 con 0x7fd8700f5430 2022-02-02T21:09:21.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.166+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870059100 con 0x7fd8700f5430 2022-02-02T21:09:21.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.166+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd86001b060 con 0x7fd8700f5430 2022-02-02T21:09:21.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.167+0000 7fd866ffd700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 0x7fd85c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.167+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8600818e0 con 0x7fd8700f5430 2022-02-02T21:09:21.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.167+0000 7fd8759cb700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 0x7fd85c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.167+0000 7fd8759cb700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 0x7fd85c0672e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fd86c004630 tx=0x7fd86c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.171+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd860053410 con 0x7fd8700f5430 2022-02-02T21:09:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:20 smithi159 ceph-mon[69013]: pgmap v5017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:21.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.342+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8700008d0 con 0x7fd85c064e20 2022-02-02T21:09:21.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.352+0000 7fd866ffd700 1 -- 172.21.15.96:0/2123279987 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd8700008d0 con 0x7fd85c064e20 2022-02-02T21:09:21.354 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:09:21.355 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:09:21.355 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:09:21.355 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:09:21.355 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:09:21.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:09:21.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:09:21.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:09:21.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:09:21.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:09:21.358 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:09:21.358 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:09:21.358 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:09:21.358 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:09:21.359 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:09:21.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:09:21.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:09:21.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:09:21.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:09:21.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:09:21.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:09:21.360 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:09:21.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.353+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 msgr2=0x7fd85c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.353+0000 7fd8771ce700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 0x7fd85c0672e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fd86c004630 tx=0x7fd86c009b30).stop 2022-02-02T21:09:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.353+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 msgr2=0x7fd870105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.353+0000 7fd8771ce700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 rx=0x7fd860002700 tx=0x7fd860009d80).stop 2022-02-02T21:09:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 shutdown_connections 2022-02-02T21:09:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd85c064e20 0x7fd85c0672e0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8700f5430 0x7fd870105cc0 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 --2- 172.21.15.96:0/2123279987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8700f66d0 0x7fd8701061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 >> 172.21.15.96:0/2123279987 conn(0x7fd8700f0b90 msgr2=0x7fd8700fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 shutdown_connections 2022-02-02T21:09:21.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.354+0000 7fd8771ce700 1 -- 172.21.15.96:0/2123279987 wait complete. 2022-02-02T21:09:21.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 -- 172.21.15.96:0/1894566104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f66e0 msgr2=0x7f98a80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 --2- 172.21.15.96:0/1894566104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f66e0 0x7f98a80f6b00 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 rx=0x7f989c004660 tx=0x7f989c009b30).stop 2022-02-02T21:09:21.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 -- 172.21.15.96:0/1894566104 shutdown_connections 2022-02-02T21:09:21.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 --2- 172.21.15.96:0/1894566104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f7980 0x7f98a80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:09:21.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 --2- 172.21.15.96:0/1894566104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f66e0 0x7f98a80f6b00 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 -- 172.21.15.96:0/1894566104 >> 172.21.15.96:0/1894566104 conn(0x7f98a80f1e40 msgr2=0x7f98a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 -- 172.21.15.96:0/1894566104 shutdown_connections 2022-02-02T21:09:21.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.450+0000 7f98ad517700 1 -- 172.21.15.96:0/1894566104 wait complete. 2022-02-02T21:09:21.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 Processor -- start 2022-02-02T21:09:21.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 -- start start 2022-02-02T21:09:21.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f66e0 0x7f98a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a806a410 con 0x7f98a80f7980 2022-02-02T21:09:21.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98ad517700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a806a550 con 0x7f98a80f66e0 2022-02-02T21:09:21.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98a67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98a67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41166/0 (socket says 172.21.15.96:41166) 2022-02-02T21:09:21.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.451+0000 7f98a67fc700 1 -- 172.21.15.96:0/4030087244 learned_addr learned my addr 172.21.15.96:0/4030087244 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:21.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98a6ffd700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f66e0 0x7f98a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98a67fc700 1 -- 172.21.15.96:0/4030087244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f66e0 msgr2=0x7f98a806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98a67fc700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f66e0 0x7f98a806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98a67fc700 1 -- 172.21.15.96:0/4030087244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c005040 con 0x7f98a80f7980 2022-02-02T21:09:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98a67fc700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 rx=0x7f989800b410 tx=0x7f9898006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98980125f0 con 0x7f98a80f7980 2022-02-02T21:09:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a806a830 con 0x7f98a80f7980 2022-02-02T21:09:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f989800be30 con 0x7f98a80f7980 2022-02-02T21:09:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9898002a70 con 0x7f98a80f7980 2022-02-02T21:09:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.452+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a810efe0 con 0x7f98a80f7980 2022-02-02T21:09:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.453+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a8045ad0 con 0x7f98a80f7980 2022-02-02T21:09:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.454+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f989800f030 con 0x7f98a80f7980 2022-02-02T21:09:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.454+0000 7f988f7fe700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 0x7f9890067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.454+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9898081e70 con 0x7f98a80f7980 2022-02-02T21:09:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.454+0000 7f98a6ffd700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 0x7f9890067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.454+0000 7f98a6ffd700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 0x7f9890067290 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f989c013690 tx=0x7f989c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.458+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f989804ff70 con 0x7f98a80f7980 2022-02-02T21:09:21.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.689+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98a8027a00 con 0x7f98a80f7980 2022-02-02T21:09:21.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.689+0000 7f988f7fe700 1 -- 172.21.15.96:0/4030087244 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9898053590 con 0x7f98a80f7980 2022-02-02T21:09:21.692 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:09:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:09:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:09:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:09:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:09:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:09:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:09:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:09:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:09:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:09:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:09:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:09:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:09:21.696 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:09:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 msgr2=0x7f9890067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 0x7f9890067290 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f989c013690 tx=0x7f989c009b30).stop 2022-02-02T21:09:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 msgr2=0x7f98a8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 rx=0x7f989800b410 tx=0x7f9898006ef0).stop 2022-02-02T21:09:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 shutdown_connections 2022-02-02T21:09:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9890064dd0 0x7f9890067290 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80f66e0 0x7f98a806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 --2- 172.21.15.96:0/4030087244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98a80f7980 0x7f98a8069e20 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 >> 172.21.15.96:0/4030087244 conn(0x7f98a80f1e40 msgr2=0x7f98a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 shutdown_connections 2022-02-02T21:09:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.691+0000 7f98ad517700 1 -- 172.21.15.96:0/4030087244 wait complete. 2022-02-02T21:09:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 -- 172.21.15.96:0/1516850791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f55c0 msgr2=0x7f4e0c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 --2- 172.21.15.96:0/1516850791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f55c0 0x7f4e0c0f59e0 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 rx=0x7f4e00004660 tx=0x7f4e00009b30).stop 2022-02-02T21:09:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 -- 172.21.15.96:0/1516850791 shutdown_connections 2022-02-02T21:09:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 --2- 172.21.15.96:0/1516850791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 --2- 172.21.15.96:0/1516850791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f55c0 0x7f4e0c0f59e0 unknown :-1 s=CLOSED pgs=2577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 -- 172.21.15.96:0/1516850791 >> 172.21.15.96:0/1516850791 conn(0x7f4e0c0f0d40 msgr2=0x7f4e0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 -- 172.21.15.96:0/1516850791 shutdown_connections 2022-02-02T21:09:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.789+0000 7f4e11db4700 1 -- 172.21.15.96:0/1516850791 wait complete. 2022-02-02T21:09:21.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 Processor -- start 2022-02-02T21:09:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 -- start start 2022-02-02T21:09:21.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 0x7f4e0c10c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c10c870 con 0x7f4e0c0f6860 2022-02-02T21:09:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e11db4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c10c9b0 con 0x7f4e0c0602b0 2022-02-02T21:09:21.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41174/0 (socket says 172.21.15.96:41174) 2022-02-02T21:09:21.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e0b7fe700 1 -- 172.21.15.96:0/309528349 learned_addr learned my addr 172.21.15.96:0/309528349 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:21.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.790+0000 7f4e0affd700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 0x7f4e0c10c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e0b7fe700 1 -- 172.21.15.96:0/309528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 msgr2=0x7f4e0c10c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e0b7fe700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 0x7f4e0c10c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:21.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e0b7fe700 1 -- 172.21.15.96:0/309528349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00005040 con 0x7f4e0c0f6860 2022-02-02T21:09:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e0affd700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 0x7f4e0c10c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:09:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e0b7fe700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 rx=0x7f4e00000c00 tx=0x7f4e00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e00019070 con 0x7f4e0c0f6860 2022-02-02T21:09:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c10cc30 con 0x7f4e0c0f6860 2022-02-02T21:09:21.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e000097d0 con 0x7f4e0c0f6860 2022-02-02T21:09:21.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e000144f0 con 0x7f4e0c0f6860 2022-02-02T21:09:21.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.791+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c10d0b0 con 0x7f4e0c0f6860 2022-02-02T21:09:21.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.792+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c045ad0 con 0x7f4e0c0f6860 2022-02-02T21:09:21.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.792+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4e00007c50 con 0x7f4e0c0f6860 2022-02-02T21:09:21.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.793+0000 7f4df3fff700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 0x7f4df4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:21.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.793+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4e00082d80 con 0x7f4e0c0f6860 2022-02-02T21:09:21.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.793+0000 7f4e0affd700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 0x7f4df4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:21.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.793+0000 7f4e0affd700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 0x7f4df4067290 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f4e0c05fa30 tx=0x7f4dfc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:21.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:21.798+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4e00050e20 con 0x7f4e0c0f6860 2022-02-02T21:09:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.000+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e0c0586e0 con 0x7f4e0c0f6860 2022-02-02T21:09:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.000+0000 7f4df3fff700 1 -- 172.21.15.96:0/309528349 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4e00015040 con 0x7f4e0c0f6860 2022-02-02T21:09:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:09:22.003 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:09:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:09:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:09:22.004 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:09:22.004 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:09:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:09:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:09:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:09:22.005 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:09:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:09:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:09:22.006 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:09:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:09:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:09:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:09:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:09:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:09:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:09:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:09:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:09:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:09:22.009 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:09:22.009 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:09:22.009 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:09:22.009 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:09:22.010 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:09:22.010 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:09:22.010 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:09:22.010 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:09:22.010 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:09:22.011 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:22.011 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:22.011 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:09:22.011 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:22.012 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:22.012 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:22.012 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 msgr2=0x7f4df4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 0x7f4df4067290 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f4e0c05fa30 tx=0x7f4dfc00b040).stop 2022-02-02T21:09:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 msgr2=0x7f4e0c109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 rx=0x7f4e00000c00 tx=0x7f4e00009b30).stop 2022-02-02T21:09:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 shutdown_connections 2022-02-02T21:09:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4df4064dd0 0x7f4df4067290 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e0c0f6860 0x7f4e0c109e30 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 --2- 172.21.15.96:0/309528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0602b0 0x7f4e0c10c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 >> 172.21.15.96:0/309528349 conn(0x7f4e0c0f0d40 msgr2=0x7f4e0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 shutdown_connections 2022-02-02T21:09:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:22.002+0000 7f4e11db4700 1 -- 172.21.15.96:0/309528349 wait complete. 2022-02-02T21:09:22.016 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:09:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:21 smithi096 ceph-mon[101353]: from='client.39250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4030087244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:09:22.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:21 smithi159 ceph-mon[69013]: from='client.39250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:22.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4030087244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:09:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:22 smithi096 ceph-mon[101353]: from='client.39254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:22 smithi096 ceph-mon[101353]: pgmap v5018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/309528349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:09:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:22 smithi159 ceph-mon[69013]: from='client.39254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:22 smithi159 ceph-mon[69013]: pgmap v5018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:23.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/309528349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:09:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:24 smithi159 ceph-mon[69013]: pgmap v5019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:24 smithi096 ceph-mon[101353]: pgmap v5019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:26 smithi159 ceph-mon[69013]: pgmap v5020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:26 smithi096 ceph-mon[101353]: pgmap v5020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:09:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:09:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:28 smithi096 ceph-mon[101353]: pgmap v5021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:09:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:09:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:28 smithi159 ceph-mon[69013]: pgmap v5021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:30 smithi159 ceph-mon[69013]: pgmap v5022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:30 smithi096 ceph-mon[101353]: pgmap v5022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:33.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:32 smithi096 ceph-mon[101353]: pgmap v5023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:32 smithi159 ceph-mon[69013]: pgmap v5023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:34 smithi159 ceph-mon[69013]: pgmap v5024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:34 smithi096 ceph-mon[101353]: pgmap v5024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:36 smithi159 ceph-mon[69013]: pgmap v5025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:36 smithi096 ceph-mon[101353]: pgmap v5025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:38 smithi096 ceph-mon[101353]: pgmap v5026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:38 smithi159 ceph-mon[69013]: pgmap v5026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:40 smithi159 ceph-mon[69013]: pgmap v5027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:40 smithi096 ceph-mon[101353]: pgmap v5027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:42 smithi096 ceph-mon[101353]: pgmap v5028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:42 smithi159 ceph-mon[69013]: pgmap v5028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:44 smithi159 ceph-mon[69013]: pgmap v5029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:44 smithi096 ceph-mon[101353]: pgmap v5029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:46 smithi159 ceph-mon[69013]: pgmap v5030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:46 smithi096 ceph-mon[101353]: pgmap v5030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:48 smithi096 ceph-mon[101353]: pgmap v5031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:48 smithi159 ceph-mon[69013]: pgmap v5031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:50 smithi159 ceph-mon[69013]: pgmap v5032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:50 smithi096 ceph-mon[101353]: pgmap v5032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 -- 172.21.15.96:0/3565668571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f66e0 msgr2=0x7fe0680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 --2- 172.21.15.96:0/3565668571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f66e0 0x7fe0680f6b00 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 rx=0x7fe05c004660 tx=0x7fe05c009b30).stop 2022-02-02T21:09:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 -- 172.21.15.96:0/3565668571 shutdown_connections 2022-02-02T21:09:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 --2- 172.21.15.96:0/3565668571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f7980 0x7fe0680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 --2- 172.21.15.96:0/3565668571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f66e0 0x7fe0680f6b00 unknown :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 -- 172.21.15.96:0/3565668571 >> 172.21.15.96:0/3565668571 conn(0x7fe0680f1e40 msgr2=0x7fe0680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 -- 172.21.15.96:0/3565668571 shutdown_connections 2022-02-02T21:09:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 -- 172.21.15.96:0/3565668571 wait complete. 2022-02-02T21:09:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.112+0000 7fe06c92a700 1 Processor -- start 2022-02-02T21:09:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06c92a700 1 -- start start 2022-02-02T21:09:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06c92a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 0x7fe068106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06c92a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06c92a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068107a10 con 0x7fe0680f7980 2022-02-02T21:09:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06c92a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068107b50 con 0x7fe0680f66e0 2022-02-02T21:09:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41198/0 (socket says 172.21.15.96:41198) 2022-02-02T21:09:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 -- 172.21.15.96:0/2378463991 learned_addr learned my addr 172.21.15.96:0/2378463991 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06659c700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 0x7fe068106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 -- 172.21.15.96:0/2378463991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 msgr2=0x7fe068106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 0x7fe068106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 -- 172.21.15.96:0/2378463991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c005040 con 0x7fe0680f7980 2022-02-02T21:09:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe06659c700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 0x7fe068106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:09:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe065d9b700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 rx=0x7fe05800c530 tx=0x7fe058007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.113+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe05800f650 con 0x7fe0680f7980 2022-02-02T21:09:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.114+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe05800fc60 con 0x7fe0680f7980 2022-02-02T21:09:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.114+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe058012cd0 con 0x7fe0680f7980 2022-02-02T21:09:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.114+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0681084f0 con 0x7fe0680f7980 2022-02-02T21:09:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.114+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe068108a60 con 0x7fe0680f7980 2022-02-02T21:09:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.115+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe068045ad0 con 0x7fe0680f7980 2022-02-02T21:09:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.115+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe058010070 con 0x7fe0680f7980 2022-02-02T21:09:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.116+0000 7fe056ffd700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 0x7fe050067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.116+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0580817b0 con 0x7fe0680f7980 2022-02-02T21:09:52.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.116+0000 7fe06659c700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 0x7fe050067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.116+0000 7fe06659c700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 0x7fe050067290 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fe05c004e30 tx=0x7fe05c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.120+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0580532e0 con 0x7fe0680f7980 2022-02-02T21:09:52.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.301+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0680ff020 con 0x7fe050064dd0 2022-02-02T21:09:52.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.302+0000 7fe056ffd700 1 -- 172.21.15.96:0/2378463991 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe0680ff020 con 0x7fe050064dd0 2022-02-02T21:09:52.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 msgr2=0x7fe050067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 0x7fe050067290 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fe05c004e30 tx=0x7fe05c009b30).stop 2022-02-02T21:09:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 msgr2=0x7fe068107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 rx=0x7fe05800c530 tx=0x7fe058007e20).stop 2022-02-02T21:09:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 shutdown_connections 2022-02-02T21:09:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe050064dd0 0x7fe050067290 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0680f66e0 0x7fe068106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 --2- 172.21.15.96:0/2378463991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0680f7980 0x7fe068107460 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 >> 172.21.15.96:0/2378463991 conn(0x7fe0680f1e40 msgr2=0x7fe0680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 shutdown_connections 2022-02-02T21:09:52.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.304+0000 7fe06c92a700 1 -- 172.21.15.96:0/2378463991 wait complete. 2022-02-02T21:09:52.316 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:09:52.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 -- 172.21.15.96:0/1710017263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f77d0 msgr2=0x7f56e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/1710017263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f77d0 0x7f56e40f7c30 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 rx=0x7f56d8004660 tx=0x7f56d8009b30).stop 2022-02-02T21:09:52.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 -- 172.21.15.96:0/1710017263 shutdown_connections 2022-02-02T21:09:52.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/1710017263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f77d0 0x7f56e40f7c30 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/1710017263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f6530 0x7f56e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 -- 172.21.15.96:0/1710017263 >> 172.21.15.96:0/1710017263 conn(0x7f56e40f1c90 msgr2=0x7f56e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 -- 172.21.15.96:0/1710017263 shutdown_connections 2022-02-02T21:09:52.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.401+0000 7f56e8f5a700 1 -- 172.21.15.96:0/1710017263 wait complete. 2022-02-02T21:09:52.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 Processor -- start 2022-02-02T21:09:52.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 -- start start 2022-02-02T21:09:52.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f77d0 0x7f56e4107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e41077f0 con 0x7f56e40f6530 2022-02-02T21:09:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.402+0000 7f56e8f5a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4107ff0 con 0x7f56e40f77d0 2022-02-02T21:09:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41206/0 (socket says 172.21.15.96:41206) 2022-02-02T21:09:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 -- 172.21.15.96:0/2555843256 learned_addr learned my addr 172.21.15.96:0/2555843256 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e2ffd700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f77d0 0x7f56e4107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 -- 172.21.15.96:0/2555843256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f77d0 msgr2=0x7f56e4107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f77d0 0x7f56e4107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 -- 172.21.15.96:0/2555843256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8005040 con 0x7f56e40f6530 2022-02-02T21:09:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e37fe700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 rx=0x7f56d4002700 tx=0x7f56d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d40079c0 con 0x7f56e40f6530 2022-02-02T21:09:52.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e41082d0 con 0x7f56e40f6530 2022-02-02T21:09:52.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56d400f040 con 0x7f56e40f6530 2022-02-02T21:09:52.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d4014860 con 0x7f56e40f6530 2022-02-02T21:09:52.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.403+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e4108890 con 0x7f56e40f6530 2022-02-02T21:09:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.404+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e4059100 con 0x7f56e40f6530 2022-02-02T21:09:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.405+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56d401b060 con 0x7f56e40f6530 2022-02-02T21:09:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.405+0000 7f56cbfff700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 0x7f56cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.405+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56d40818e0 con 0x7f56e40f6530 2022-02-02T21:09:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.406+0000 7f56e2ffd700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 0x7f56cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.406+0000 7f56e2ffd700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 0x7f56cc0672e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f56d8004630 tx=0x7f56d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.410+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56d4053410 con 0x7f56e40f6530 2022-02-02T21:09:52.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.582+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56e40008d0 con 0x7f56cc064e20 2022-02-02T21:09:52.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.592+0000 7f56cbfff700 1 -- 172.21.15.96:0/2555843256 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f56e40008d0 con 0x7f56cc064e20 2022-02-02T21:09:52.595 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:09:52.595 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:09:52.595 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:09:52.596 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:09:52.596 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:09:52.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:09:52.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:09:52.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:09:52.597 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:09:52.597 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:09:52.597 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:09:52.597 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:09:52.598 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:09:52.598 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:09:52.598 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:09:52.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:09:52.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:09:52.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:09:52.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:09:52.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:09:52.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:09:52.601 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:09:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.593+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 msgr2=0x7f56cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.593+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 0x7f56cc0672e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f56d8004630 tx=0x7f56d8009b30).stop 2022-02-02T21:09:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.593+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 msgr2=0x7f56e4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.593+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 rx=0x7f56d4002700 tx=0x7f56d4009d80).stop 2022-02-02T21:09:52.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 shutdown_connections 2022-02-02T21:09:52.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f56cc064e20 0x7f56cc0672e0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56e40f6530 0x7f56e4106d50 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 --2- 172.21.15.96:0/2555843256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56e40f77d0 0x7f56e4107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 >> 172.21.15.96:0/2555843256 conn(0x7f56e40f1c90 msgr2=0x7f56e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 shutdown_connections 2022-02-02T21:09:52.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.594+0000 7f56e8f5a700 1 -- 172.21.15.96:0/2555843256 wait complete. 2022-02-02T21:09:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 -- 172.21.15.96:0/371441709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 msgr2=0x7f93d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/371441709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d40f7de0 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 rx=0x7f93c4004660 tx=0x7f93c4009b30).stop 2022-02-02T21:09:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 -- 172.21.15.96:0/371441709 shutdown_connections 2022-02-02T21:09:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/371441709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d40f7de0 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/371441709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 -- 172.21.15.96:0/371441709 >> 172.21.15.96:0/371441709 conn(0x7f93d40f1e40 msgr2=0x7f93d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 -- 172.21.15.96:0/371441709 shutdown_connections 2022-02-02T21:09:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.690+0000 7f93d8eb2700 1 -- 172.21.15.96:0/371441709 wait complete. 2022-02-02T21:09:52.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 Processor -- start 2022-02-02T21:09:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 -- start start 2022-02-02T21:09:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4107a20 con 0x7f93d40f7980 2022-02-02T21:09:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d8eb2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4107b60 con 0x7f93d40f66e0 2022-02-02T21:09:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41218/0 (socket says 172.21.15.96:41218) 2022-02-02T21:09:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.691+0000 7f93d1d9b700 1 -- 172.21.15.96:0/4019099276 learned_addr learned my addr 172.21.15.96:0/4019099276 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d259c700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d1d9b700 1 -- 172.21.15.96:0/4019099276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 msgr2=0x7f93d4106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d1d9b700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d4106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d1d9b700 1 -- 172.21.15.96:0/4019099276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4005040 con 0x7f93d40f7980 2022-02-02T21:09:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d259c700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d4106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:09:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d1d9b700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 rx=0x7f93c4009990 tx=0x7f93c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c4018070 con 0x7f93d40f7980 2022-02-02T21:09:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d41084a0 con 0x7f93d40f7980 2022-02-02T21:09:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93c4007ca0 con 0x7f93d40f7980 2022-02-02T21:09:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d4108a00 con 0x7f93d40f7980 2022-02-02T21:09:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.692+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c401c620 con 0x7f93d40f7980 2022-02-02T21:09:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.693+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8004fa0 con 0x7f93d40f7980 2022-02-02T21:09:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.694+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93c401c890 con 0x7f93d40f7980 2022-02-02T21:09:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.694+0000 7f93caffd700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 0x7f93c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.694+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93c4083650 con 0x7f93d40f7980 2022-02-02T21:09:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.694+0000 7f93d259c700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 0x7f93c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.694+0000 7f93d259c700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 0x7f93c0067290 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f93bc0041d0 tx=0x7f93bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:52.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.698+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93c4055240 con 0x7f93d40f7980 2022-02-02T21:09:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.931+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f93b8005e80 con 0x7f93d40f7980 2022-02-02T21:09:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.931+0000 7f93caffd700 1 -- 172.21.15.96:0/4019099276 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f93c4054e30 con 0x7f93d40f7980 2022-02-02T21:09:52.934 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:09:52.934 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:09:52.934 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:09:52.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:52.935 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:09:52.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:09:52.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:52.936 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:09:52.936 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:09:52.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:52.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:09:52.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:09:52.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:09:52.937 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:09:52.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:09:52.938 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:09:52.938 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:09:52.938 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:09:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 msgr2=0x7f93c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 0x7f93c0067290 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f93bc0041d0 tx=0x7f93bc009040).stop 2022-02-02T21:09:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 msgr2=0x7f93d4107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 rx=0x7f93c4009990 tx=0x7f93c4009b30).stop 2022-02-02T21:09:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 shutdown_connections 2022-02-02T21:09:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93c0064dd0 0x7f93c0067290 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93d40f66e0 0x7f93d4106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 --2- 172.21.15.96:0/4019099276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93d40f7980 0x7f93d4107470 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 >> 172.21.15.96:0/4019099276 conn(0x7f93d40f1e40 msgr2=0x7f93d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 shutdown_connections 2022-02-02T21:09:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:52.933+0000 7f93d8eb2700 1 -- 172.21.15.96:0/4019099276 wait complete. 2022-02-02T21:09:53.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1311475555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 msgr2=0x7f2cf00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:53.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1311475555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf00f6b30 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 rx=0x7f2ce4004660 tx=0x7f2ce4009b30).stop 2022-02-02T21:09:53.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:52 smithi096 ceph-mon[101353]: pgmap v5033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1311475555 shutdown_connections 2022-02-02T21:09:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1311475555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf00f6b30 unknown :-1 s=CLOSED pgs=2585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1311475555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 0x7f2cf00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1311475555 >> 172.21.15.96:0/1311475555 conn(0x7f2cf00f0b90 msgr2=0x7f2cf00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.030+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1311475555 shutdown_connections 2022-02-02T21:09:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.031+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1311475555 wait complete. 2022-02-02T21:09:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.031+0000 7f2cf56b1700 1 Processor -- start 2022-02-02T21:09:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.031+0000 7f2cf56b1700 1 -- start start 2022-02-02T21:09:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cf56b1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 0x7f2cf0105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cf56b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cf56b1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0106760 con 0x7f2cf00f66d0 2022-02-02T21:09:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cf56b1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0106f60 con 0x7f2cf00f5430 2022-02-02T21:09:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:53.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41228/0 (socket says 172.21.15.96:41228) 2022-02-02T21:09:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 -- 172.21.15.96:0/1140484979 learned_addr learned my addr 172.21.15.96:0/1140484979 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:09:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2ceffff700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 0x7f2cf0105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 -- 172.21.15.96:0/1140484979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 msgr2=0x7f2cf0105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 0x7f2cf0105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 -- 172.21.15.96:0/1140484979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4005040 con 0x7f2cf00f66d0 2022-02-02T21:09:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cef7fe700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 rx=0x7f2ce4009da0 tx=0x7f2ce4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.032+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce4018070 con 0x7f2cf00f66d0 2022-02-02T21:09:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.033+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ce4007cf0 con 0x7f2cf00f66d0 2022-02-02T21:09:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.033+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce401c620 con 0x7f2cf00f66d0 2022-02-02T21:09:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.033+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf01071e0 con 0x7f2cf00f66d0 2022-02-02T21:09:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.033+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0107740 con 0x7f2cf00f66d0 2022-02-02T21:09:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.033+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0059100 con 0x7f2cf00f66d0 2022-02-02T21:09:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.034+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2ce401d420 con 0x7f2cf00f66d0 2022-02-02T21:09:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.034+0000 7f2cecff9700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 0x7f2cd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:09:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.034+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2ce4083990 con 0x7f2cf00f66d0 2022-02-02T21:09:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.035+0000 7f2ceffff700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 0x7f2cd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:09:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.035+0000 7f2ceffff700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 0x7f2cd80672e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f2cf00f6530 tx=0x7f2ce0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:09:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.039+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2ce40554c0 con 0x7f2cf00f66d0 2022-02-02T21:09:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.243+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2cf00fdbf0 con 0x7f2cf00f66d0 2022-02-02T21:09:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.244+0000 7f2cecff9700 1 -- 172.21.15.96:0/1140484979 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2ce40550b0 con 0x7f2cf00f66d0 2022-02-02T21:09:53.247 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:09:53.247 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:09:53.247 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:09:53.247 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:09:53.248 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:53.248 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:09:53.248 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:09:53.248 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:09:53.248 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:09:53.249 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:09:53.249 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:09:53.249 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:09:53.249 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:09:53.250 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:09:53.250 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:09:53.250 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:09:53.250 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:09:53.251 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:09:53.251 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:09:53.251 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:09:53.251 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:09:53.251 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:09:53.252 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:09:53.252 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:09:53.252 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:09:53.252 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:09:53.253 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:09:53.253 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:09:53.253 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:09:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:09:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:09:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:09:53.255 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:53.255 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:53.255 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:09:53.255 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:09:53.255 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:53.256 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:53.256 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:09:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 msgr2=0x7f2cd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 0x7f2cd80672e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f2cf00f6530 tx=0x7f2ce0009040).stop 2022-02-02T21:09:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 msgr2=0x7f2cf01061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:09:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 rx=0x7f2ce4009da0 tx=0x7f2ce4009b30).stop 2022-02-02T21:09:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 shutdown_connections 2022-02-02T21:09:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cd8064e20 0x7f2cd80672e0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf00f5430 0x7f2cf0105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 --2- 172.21.15.96:0/1140484979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf00f66d0 0x7f2cf01061b0 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:09:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 >> 172.21.15.96:0/1140484979 conn(0x7f2cf00f0b90 msgr2=0x7f2cf00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:09:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 shutdown_connections 2022-02-02T21:09:53.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:09:53.246+0000 7f2cf56b1700 1 -- 172.21.15.96:0/1140484979 wait complete. 2022-02-02T21:09:53.260 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:09:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:52 smithi159 ceph-mon[69013]: pgmap v5033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:53 smithi159 ceph-mon[69013]: from='client.39266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:53 smithi159 ceph-mon[69013]: from='client.39270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4019099276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:09:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1140484979' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:09:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:53 smithi096 ceph-mon[101353]: from='client.39266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:53 smithi096 ceph-mon[101353]: from='client.39270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:09:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4019099276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:09:54.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1140484979' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:09:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:54 smithi159 ceph-mon[69013]: pgmap v5034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:54 smithi096 ceph-mon[101353]: pgmap v5034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:56 smithi159 ceph-mon[69013]: pgmap v5035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:56 smithi096 ceph-mon[101353]: pgmap v5035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:09:58 smithi096 ceph-mon[101353]: pgmap v5036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:09:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:09:58 smithi159 ceph-mon[69013]: pgmap v5036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:00 smithi159 ceph-mon[69013]: pgmap v5037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:10:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:00 smithi096 ceph-mon[101353]: pgmap v5037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:10:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:02 smithi096 ceph-mon[101353]: pgmap v5038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:02 smithi159 ceph-mon[69013]: pgmap v5038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:04 smithi159 ceph-mon[69013]: pgmap v5039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:04 smithi096 ceph-mon[101353]: pgmap v5039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:06 smithi159 ceph-mon[69013]: pgmap v5040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:07.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:06 smithi096 ceph-mon[101353]: pgmap v5040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:08.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:08 smithi096 ceph-mon[101353]: pgmap v5041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:08 smithi159 ceph-mon[69013]: pgmap v5041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:10 smithi159 ceph-mon[69013]: pgmap v5042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:10 smithi096 ceph-mon[101353]: pgmap v5042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:13.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:12 smithi096 ceph-mon[101353]: pgmap v5043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:12 smithi159 ceph-mon[69013]: pgmap v5043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:14 smithi159 ceph-mon[69013]: pgmap v5044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:14 smithi096 ceph-mon[101353]: pgmap v5044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:16 smithi159 ceph-mon[69013]: pgmap v5045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:16 smithi096 ceph-mon[101353]: pgmap v5045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:18 smithi096 ceph-mon[101353]: pgmap v5046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:18 smithi159 ceph-mon[69013]: pgmap v5046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:20 smithi159 ceph-mon[69013]: pgmap v5047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:20 smithi096 ceph-mon[101353]: pgmap v5047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:22 smithi096 ceph-mon[101353]: pgmap v5048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:22 smithi159 ceph-mon[69013]: pgmap v5048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:23.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- 172.21.15.96:0/1165562738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 msgr2=0x7fecb00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 --2- 172.21.15.96:0/1165562738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00fbae0 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 rx=0x7feca0004660 tx=0x7feca0009b30).stop 2022-02-02T21:10:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- 172.21.15.96:0/1165562738 shutdown_connections 2022-02-02T21:10:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 --2- 172.21.15.96:0/1165562738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00fbae0 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 --2- 172.21.15.96:0/1165562738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 0x7fecb00f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- 172.21.15.96:0/1165562738 >> 172.21.15.96:0/1165562738 conn(0x7fecb00f0b90 msgr2=0x7fecb00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- 172.21.15.96:0/1165562738 shutdown_connections 2022-02-02T21:10:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- 172.21.15.96:0/1165562738 wait complete. 2022-02-02T21:10:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 Processor -- start 2022-02-02T21:10:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.360+0000 7fecb6227700 1 -- start start 2022-02-02T21:10:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb6227700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 0x7fecb00f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb6227700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb6227700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00f55d0 con 0x7fecb00f96f0 2022-02-02T21:10:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb6227700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00f5710 con 0x7fecb00602b0 2022-02-02T21:10:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41248/0 (socket says 172.21.15.96:41248) 2022-02-02T21:10:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 -- 172.21.15.96:0/3450019647 learned_addr learned my addr 172.21.15.96:0/3450019647 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb5225700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 0x7fecb00f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 -- 172.21.15.96:0/3450019647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 msgr2=0x7fecb00f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 0x7fecb00f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 -- 172.21.15.96:0/3450019647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0005040 con 0x7fecb00f96f0 2022-02-02T21:10:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7fecb4a24700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 rx=0x7feca0013a70 tx=0x7feca0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca0018070 con 0x7fecb00f96f0 2022-02-02T21:10:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.361+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feca00097d0 con 0x7fecb00f96f0 2022-02-02T21:10:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.362+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00f5990 con 0x7fecb00f96f0 2022-02-02T21:10:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.362+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca001c3c0 con 0x7fecb00f96f0 2022-02-02T21:10:23.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.362+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb00f5ef0 con 0x7fecb00f96f0 2022-02-02T21:10:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.363+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb0045ad0 con 0x7fecb00f96f0 2022-02-02T21:10:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.363+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feca0007ba0 con 0x7fecb00f96f0 2022-02-02T21:10:23.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.363+0000 7feca5ffb700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 0x7fec9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.364+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feca0083740 con 0x7fecb00f96f0 2022-02-02T21:10:23.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.364+0000 7fecb5225700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 0x7fec9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.364+0000 7fecb5225700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 0x7fec9c0672e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fecb00f6980 tx=0x7fecac009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.368+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feca0051900 con 0x7fecb00f96f0 2022-02-02T21:10:23.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.547+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecb00fee00 con 0x7fec9c064e20 2022-02-02T21:10:23.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.548+0000 7feca5ffb700 1 -- 172.21.15.96:0/3450019647 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fecb00fee00 con 0x7fec9c064e20 2022-02-02T21:10:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 msgr2=0x7fec9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 0x7fec9c0672e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fecb00f6980 tx=0x7fecac009be0).stop 2022-02-02T21:10:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 msgr2=0x7fecb00f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 rx=0x7feca0013a70 tx=0x7feca0009b30).stop 2022-02-02T21:10:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 shutdown_connections 2022-02-02T21:10:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec9c064e20 0x7fec9c0672e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb00602b0 0x7fecb00f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 --2- 172.21.15.96:0/3450019647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb00f96f0 0x7fecb00f5070 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 >> 172.21.15.96:0/3450019647 conn(0x7fecb00f0b90 msgr2=0x7fecb00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 shutdown_connections 2022-02-02T21:10:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.550+0000 7fecb6227700 1 -- 172.21.15.96:0/3450019647 wait complete. 2022-02-02T21:10:23.561 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:10:23.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- 172.21.15.96:0/2461807889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f7940 msgr2=0x7fc3000f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 --2- 172.21.15.96:0/2461807889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f7940 0x7fc3000f7da0 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 rx=0x7fc2fc004660 tx=0x7fc2fc009b30).stop 2022-02-02T21:10:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- 172.21.15.96:0/2461807889 shutdown_connections 2022-02-02T21:10:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 --2- 172.21.15.96:0/2461807889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f7940 0x7fc3000f7da0 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 --2- 172.21.15.96:0/2461807889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f66a0 0x7fc3000f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:10:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- 172.21.15.96:0/2461807889 >> 172.21.15.96:0/2461807889 conn(0x7fc3000f1e00 msgr2=0x7fc3000f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- 172.21.15.96:0/2461807889 shutdown_connections 2022-02-02T21:10:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- 172.21.15.96:0/2461807889 wait complete. 2022-02-02T21:10:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 Processor -- start 2022-02-02T21:10:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- start start 2022-02-02T21:10:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f7940 0x7fc3001073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3001079e0 con 0x7fc3000f66a0 2022-02-02T21:10:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.648+0000 7fc307e8a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300108290 con 0x7fc3000f7940 2022-02-02T21:10:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41256/0 (socket says 172.21.15.96:41256) 2022-02-02T21:10:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 -- 172.21.15.96:0/1800581406 learned_addr learned my addr 172.21.15.96:0/1800581406 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305425700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f7940 0x7fc3001073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 -- 172.21.15.96:0/1800581406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f7940 msgr2=0x7fc3001073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f7940 0x7fc3001073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 -- 172.21.15.96:0/1800581406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc005040 con 0x7fc3000f66a0 2022-02-02T21:10:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc305c26700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 rx=0x7fc2f00093f0 tx=0x7fc2f0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f0009ea0 con 0x7fc3000f66a0 2022-02-02T21:10:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2f0013af0 con 0x7fc3000f66a0 2022-02-02T21:10:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc300108570 con 0x7fc3000f66a0 2022-02-02T21:10:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc300108b30 con 0x7fc3000f66a0 2022-02-02T21:10:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.649+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f000db10 con 0x7fc3000f66a0 2022-02-02T21:10:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.650+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3000f5a90 con 0x7fc3000f66a0 2022-02-02T21:10:23.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.650+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2f001a060 con 0x7fc3000f66a0 2022-02-02T21:10:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.651+0000 7fc2f67fc700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 0x7fc2ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.651+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2f0081aa0 con 0x7fc3000f66a0 2022-02-02T21:10:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.651+0000 7fc305425700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 0x7fc2ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.651+0000 7fc305425700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 0x7fc2ec0672e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fc2fc009da0 tx=0x7fc2fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.655+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2f00535d0 con 0x7fc3000f66a0 2022-02-02T21:10:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.828+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3000fef70 con 0x7fc2ec064e20 2022-02-02T21:10:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.837+0000 7fc2f67fc700 1 -- 172.21.15.96:0/1800581406 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc3000fef70 con 0x7fc2ec064e20 2022-02-02T21:10:23.839 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:10:23.839 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:10:23.839 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:10:23.840 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:10:23.840 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:10:23.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:10:23.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:10:23.841 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:10:23.841 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:10:23.841 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:10:23.841 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:10:23.841 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:10:23.842 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:10:23.842 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:10:23.842 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:10:23.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:10:23.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:10:23.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:10:23.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:10:23.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:10:23.843 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:10:23.844 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:10:23.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 msgr2=0x7fc2ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 0x7fc2ec0672e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fc2fc009da0 tx=0x7fc2fc009b30).stop 2022-02-02T21:10:23.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 msgr2=0x7fc300106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 rx=0x7fc2f00093f0 tx=0x7fc2f0006ec0).stop 2022-02-02T21:10:23.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 shutdown_connections 2022-02-02T21:10:23.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2ec064e20 0x7fc2ec0672e0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3000f66a0 0x7fc300106eb0 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 --2- 172.21.15.96:0/1800581406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3000f7940 0x7fc3001073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 >> 172.21.15.96:0/1800581406 conn(0x7fc3000f1e00 msgr2=0x7fc3000fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:23.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 shutdown_connections 2022-02-02T21:10:23.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.839+0000 7fc307e8a700 1 -- 172.21.15.96:0/1800581406 wait complete. 2022-02-02T21:10:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 -- 172.21.15.96:0/2879738601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f7980 msgr2=0x7ff2340f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/2879738601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f7980 0x7ff2340f7de0 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 rx=0x7ff21c004660 tx=0x7ff21c009b30).stop 2022-02-02T21:10:23.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 -- 172.21.15.96:0/2879738601 shutdown_connections 2022-02-02T21:10:23.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/2879738601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f7980 0x7ff2340f7de0 unknown :-1 s=CLOSED pgs=2591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/2879738601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f66e0 0x7ff2340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 -- 172.21.15.96:0/2879738601 >> 172.21.15.96:0/2879738601 conn(0x7ff2340f1e40 msgr2=0x7ff2340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:23.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 -- 172.21.15.96:0/2879738601 shutdown_connections 2022-02-02T21:10:23.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 -- 172.21.15.96:0/2879738601 wait complete. 2022-02-02T21:10:23.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.937+0000 7ff23a8c2700 1 Processor -- start 2022-02-02T21:10:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 -- start start 2022-02-02T21:10:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 0x7ff234107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234107a00 con 0x7ff2340f66e0 2022-02-02T21:10:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234107b40 con 0x7ff2340f7980 2022-02-02T21:10:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41266/0 (socket says 172.21.15.96:41266) 2022-02-02T21:10:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 -- 172.21.15.96:0/384964947 learned_addr learned my addr 172.21.15.96:0/384964947 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff2337fe700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 0x7ff234107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 -- 172.21.15.96:0/384964947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 msgr2=0x7ff234107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 0x7ff234107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 -- 172.21.15.96:0/384964947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c005040 con 0x7ff2340f66e0 2022-02-02T21:10:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff2337fe700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 0x7ff234107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:10:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff233fff700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 rx=0x7ff224002700 tx=0x7ff224009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff224009320 con 0x7ff2340f66e0 2022-02-02T21:10:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff22400f040 con 0x7ff2340f66e0 2022-02-02T21:10:23.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2341084e0 con 0x7ff2340f66e0 2022-02-02T21:10:23.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.938+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff224014900 con 0x7ff2340f66e0 2022-02-02T21:10:23.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.939+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234108aa0 con 0x7ff2340f66e0 2022-02-02T21:10:23.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.940+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff234045ad0 con 0x7ff2340f66e0 2022-02-02T21:10:23.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.940+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff224009480 con 0x7ff2340f66e0 2022-02-02T21:10:23.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.940+0000 7ff230ff9700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 0x7ff220067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:23.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.940+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff224081cc0 con 0x7ff2340f66e0 2022-02-02T21:10:23.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.940+0000 7ff2337fe700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 0x7ff220067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:23.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.941+0000 7ff2337fe700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 0x7ff220067290 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7ff21c004630 tx=0x7ff21c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:23.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:23.944+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2240538b0 con 0x7ff2340f66e0 2022-02-02T21:10:24.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.172+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2340ff020 con 0x7ff2340f66e0 2022-02-02T21:10:24.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.173+0000 7ff230ff9700 1 -- 172.21.15.96:0/384964947 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff2240534a0 con 0x7ff2340f66e0 2022-02-02T21:10:24.175 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:10:24.176 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:10:24.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:10:24.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:24.177 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:10:24.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:10:24.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:24.179 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:10:24.179 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:10:24.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:24.180 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:10:24.180 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:10:24.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:24.180 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:10:24.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:10:24.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:10:24.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:10:24.181 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:10:24.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 msgr2=0x7ff220067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 0x7ff220067290 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7ff21c004630 tx=0x7ff21c009b30).stop 2022-02-02T21:10:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 msgr2=0x7ff234106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 rx=0x7ff224002700 tx=0x7ff224009d80).stop 2022-02-02T21:10:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 shutdown_connections 2022-02-02T21:10:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff220064dd0 0x7ff220067290 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2340f66e0 0x7ff234106f60 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 --2- 172.21.15.96:0/384964947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2340f7980 0x7ff234107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 >> 172.21.15.96:0/384964947 conn(0x7ff2340f1e40 msgr2=0x7ff2340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 shutdown_connections 2022-02-02T21:10:24.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.175+0000 7ff23a8c2700 1 -- 172.21.15.96:0/384964947 wait complete. 2022-02-02T21:10:24.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.272+0000 7f5f4152c700 1 -- 172.21.15.96:0/1292076060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 msgr2=0x7f5f3c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 --2- 172.21.15.96:0/1292076060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c0f6cc0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 rx=0x7f5f30004660 tx=0x7f5f30009b30).stop 2022-02-02T21:10:24.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 -- 172.21.15.96:0/1292076060 shutdown_connections 2022-02-02T21:10:24.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 --2- 172.21.15.96:0/1292076060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c0f6cc0 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 --2- 172.21.15.96:0/1292076060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 0x7f5f3c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 -- 172.21.15.96:0/1292076060 >> 172.21.15.96:0/1292076060 conn(0x7f5f3c0f0d40 msgr2=0x7f5f3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:24.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 -- 172.21.15.96:0/1292076060 shutdown_connections 2022-02-02T21:10:24.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.273+0000 7f5f4152c700 1 -- 172.21.15.96:0/1292076060 wait complete. 2022-02-02T21:10:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 Processor -- start 2022-02-02T21:10:24.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 -- start start 2022-02-02T21:10:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 0x7f5f3c109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:24.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0603c0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f4152c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c060500 con 0x7f5f3c0f55c0 2022-02-02T21:10:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41278/0 (socket says 172.21.15.96:41278) 2022-02-02T21:10:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 -- 172.21.15.96:0/2899045199 learned_addr learned my addr 172.21.15.96:0/2899045199 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3affd700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 0x7f5f3c109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 -- 172.21.15.96:0/2899045199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 msgr2=0x7f5f3c109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 0x7f5f3c109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 -- 172.21.15.96:0/2899045199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30005040 con 0x7f5f3c0f6860 2022-02-02T21:10:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.274+0000 7f5f3a7fc700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 rx=0x7f5f30000c00 tx=0x7f5f3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.275+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f30019070 con 0x7f5f3c0f6860 2022-02-02T21:10:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.275+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f30007e70 con 0x7f5f3c0f6860 2022-02-02T21:10:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.275+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c10c630 con 0x7f5f3c0f6860 2022-02-02T21:10:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.275+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f30014ce0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.275+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c10cb60 con 0x7f5f3c0f6860 2022-02-02T21:10:24.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.276+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0f49b0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.276+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f30025070 con 0x7f5f3c0f6860 2022-02-02T21:10:24.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.276+0000 7f5f237fe700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 0x7f5f24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.277+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f300829c0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.277+0000 7f5f3affd700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 0x7f5f24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.277+0000 7f5f3affd700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 0x7f5f24067290 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5f3c060040 tx=0x7f5f2c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.281+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f30050ac0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.481+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f3c045ad0 con 0x7f5f3c0f6860 2022-02-02T21:10:24.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.482+0000 7f5f237fe700 1 -- 172.21.15.96:0/2899045199 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5f30023020 con 0x7f5f3c0f6860 2022-02-02T21:10:24.484 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:10:24.484 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:10:24.484 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:10:24.484 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:10:24.485 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:24.485 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:10:24.485 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:10:24.485 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:10:24.486 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:10:24.486 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:10:24.486 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:10:24.486 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:10:24.486 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:10:24.487 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:10:24.487 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:10:24.487 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:10:24.487 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:10:24.487 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:10:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:10:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:10:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:10:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:10:24.489 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:10:24.489 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:10:24.489 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:10:24.489 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:10:24.489 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:10:24.490 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:10:24.490 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:10:24.490 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:10:24.490 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:10:24.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:10:24.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:24.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:24.491 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:10:24.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:24.492 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:24.492 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:24.492 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 msgr2=0x7f5f24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 0x7f5f24067290 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5f3c060040 tx=0x7f5f2c00b040).stop 2022-02-02T21:10:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 msgr2=0x7f5f3c10c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 rx=0x7f5f30000c00 tx=0x7f5f3000b040).stop 2022-02-02T21:10:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 shutdown_connections 2022-02-02T21:10:24.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f24064dd0 0x7f5f24067290 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f3c0f55c0 0x7f5f3c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 --2- 172.21.15.96:0/2899045199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0f6860 0x7f5f3c10c0e0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 >> 172.21.15.96:0/2899045199 conn(0x7f5f3c0f0d40 msgr2=0x7f5f3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 shutdown_connections 2022-02-02T21:10:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:24.484+0000 7f5f4152c700 1 -- 172.21.15.96:0/2899045199 wait complete. 2022-02-02T21:10:24.496 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:10:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:24 smithi159 ceph-mon[69013]: from='client.39282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:24 smithi159 ceph-mon[69013]: from='client.39286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:24 smithi159 ceph-mon[69013]: pgmap v5049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/384964947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:10:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2899045199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:10:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:24 smithi096 ceph-mon[101353]: from='client.39282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:24 smithi096 ceph-mon[101353]: from='client.39286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:24 smithi096 ceph-mon[101353]: pgmap v5049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:25.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/384964947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:10:25.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2899045199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:10:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:26 smithi159 ceph-mon[69013]: pgmap v5050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:26 smithi096 ceph-mon[101353]: pgmap v5050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:10:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:10:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:28 smithi096 ceph-mon[101353]: pgmap v5051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:10:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:10:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:28 smithi159 ceph-mon[69013]: pgmap v5051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:30 smithi159 ceph-mon[69013]: pgmap v5052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:30 smithi096 ceph-mon[101353]: pgmap v5052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:33.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:32 smithi096 ceph-mon[101353]: pgmap v5053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:32 smithi159 ceph-mon[69013]: pgmap v5053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:34 smithi159 ceph-mon[69013]: pgmap v5054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:34 smithi096 ceph-mon[101353]: pgmap v5054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:36 smithi159 ceph-mon[69013]: pgmap v5055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:36 smithi096 ceph-mon[101353]: pgmap v5055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:38 smithi096 ceph-mon[101353]: pgmap v5056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:38 smithi159 ceph-mon[69013]: pgmap v5056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:40 smithi159 ceph-mon[69013]: pgmap v5057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:40 smithi096 ceph-mon[101353]: pgmap v5057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:42 smithi096 ceph-mon[101353]: pgmap v5058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:42 smithi159 ceph-mon[69013]: pgmap v5058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:44 smithi159 ceph-mon[69013]: pgmap v5059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:44 smithi096 ceph-mon[101353]: pgmap v5059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:46 smithi159 ceph-mon[69013]: pgmap v5060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:46 smithi096 ceph-mon[101353]: pgmap v5060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:48 smithi096 ceph-mon[101353]: pgmap v5061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:48 smithi159 ceph-mon[69013]: pgmap v5061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:50 smithi159 ceph-mon[69013]: pgmap v5062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:50 smithi096 ceph-mon[101353]: pgmap v5062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:52 smithi096 ceph-mon[101353]: pgmap v5063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:52 smithi159 ceph-mon[69013]: pgmap v5063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:54.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 -- 172.21.15.96:0/4073722581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 msgr2=0x7fc0080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 --2- 172.21.15.96:0/4073722581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc0080f6b00 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 rx=0x7fc004004660 tx=0x7fc004009b30).stop 2022-02-02T21:10:54.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 -- 172.21.15.96:0/4073722581 shutdown_connections 2022-02-02T21:10:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 --2- 172.21.15.96:0/4073722581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 0x7fc0080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 --2- 172.21.15.96:0/4073722581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc0080f6b00 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 -- 172.21.15.96:0/4073722581 >> 172.21.15.96:0/4073722581 conn(0x7fc0080f1e40 msgr2=0x7fc0080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 -- 172.21.15.96:0/4073722581 shutdown_connections 2022-02-02T21:10:54.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.594+0000 7fc01004d700 1 -- 172.21.15.96:0/4073722581 wait complete. 2022-02-02T21:10:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 Processor -- start 2022-02-02T21:10:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 -- start start 2022-02-02T21:10:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 0x7fc0081074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008107a90 con 0x7fc0080f66e0 2022-02-02T21:10:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.595+0000 7fc01004d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008107bd0 con 0x7fc0080f7980 2022-02-02T21:10:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41298/0 (socket says 172.21.15.96:41298) 2022-02-02T21:10:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 -- 172.21.15.96:0/1856800365 learned_addr learned my addr 172.21.15.96:0/1856800365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00d5e8700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 0x7fc0081074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 -- 172.21.15.96:0/1856800365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 msgr2=0x7fc0081074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 0x7fc0081074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 -- 172.21.15.96:0/1856800365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004005040 con 0x7fc0080f66e0 2022-02-02T21:10:54.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc00dde9700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 rx=0x7fc004004f60 tx=0x7fc004009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:54.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc004018070 con 0x7fc0080f66e0 2022-02-02T21:10:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc004009770 con 0x7fc0080f66e0 2022-02-02T21:10:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc008108510 con 0x7fc0080f66e0 2022-02-02T21:10:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00401c3c0 con 0x7fc0080f66e0 2022-02-02T21:10:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.596+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc008108a70 con 0x7fc0080f66e0 2022-02-02T21:10:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.597+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008045ad0 con 0x7fc0080f66e0 2022-02-02T21:10:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.598+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc00401d420 con 0x7fc0080f66e0 2022-02-02T21:10:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.598+0000 7fbffa7fc700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 0x7fbff4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.598+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc004083880 con 0x7fc0080f66e0 2022-02-02T21:10:54.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.598+0000 7fc00d5e8700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 0x7fbff4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.599+0000 7fc00d5e8700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 0x7fbff4067290 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fbffc0041d0 tx=0x7fbffc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:54.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.603+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc004055470 con 0x7fc0080f66e0 2022-02-02T21:10:54.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.781+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0080ff070 con 0x7fbff4064dd0 2022-02-02T21:10:54.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.782+0000 7fbffa7fc700 1 -- 172.21.15.96:0/1856800365 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbffc004700 con 0x7fbff4064dd0 2022-02-02T21:10:54.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 msgr2=0x7fbff4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 0x7fbff4067290 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fbffc0041d0 tx=0x7fbffc009040).stop 2022-02-02T21:10:54.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 msgr2=0x7fc008106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 rx=0x7fc004004f60 tx=0x7fc004009b30).stop 2022-02-02T21:10:54.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 shutdown_connections 2022-02-02T21:10:54.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbff4064dd0 0x7fbff4067290 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0080f66e0 0x7fc008106ff0 unknown :-1 s=CLOSED pgs=2596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 --2- 172.21.15.96:0/1856800365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0080f7980 0x7fc0081074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 >> 172.21.15.96:0/1856800365 conn(0x7fc0080f1e40 msgr2=0x7fc0080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:54.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.784+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 shutdown_connections 2022-02-02T21:10:54.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.785+0000 7fc01004d700 1 -- 172.21.15.96:0/1856800365 wait complete. 2022-02-02T21:10:54.795 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:10:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.881+0000 7f10ce0ca700 1 -- 172.21.15.96:0/3763675515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 msgr2=0x7f10c80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.881+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/3763675515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80fbae0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 rx=0x7f10c4004660 tx=0x7f10c4009b30).stop 2022-02-02T21:10:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 -- 172.21.15.96:0/3763675515 shutdown_connections 2022-02-02T21:10:54.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/3763675515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80fbae0 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/3763675515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 0x7f10c80f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 -- 172.21.15.96:0/3763675515 >> 172.21.15.96:0/3763675515 conn(0x7f10c80f0b90 msgr2=0x7f10c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:54.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 -- 172.21.15.96:0/3763675515 shutdown_connections 2022-02-02T21:10:54.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 -- 172.21.15.96:0/3763675515 wait complete. 2022-02-02T21:10:54.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 Processor -- start 2022-02-02T21:10:54.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.882+0000 7f10ce0ca700 1 -- start start 2022-02-02T21:10:54.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10ce0ca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 0x7f10c80f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10ce0ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10ce0ca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80f55d0 con 0x7f10c80f96f0 2022-02-02T21:10:54.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10ce0ca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80f5710 con 0x7f10c80602b0 2022-02-02T21:10:54.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41310/0 (socket says 172.21.15.96:41310) 2022-02-02T21:10:54.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 -- 172.21.15.96:0/1098017655 learned_addr learned my addr 172.21.15.96:0/1098017655 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cd0c8700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 0x7f10c80f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 -- 172.21.15.96:0/1098017655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 msgr2=0x7f10c80f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 0x7f10c80f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 -- 172.21.15.96:0/1098017655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4005040 con 0x7f10c80f96f0 2022-02-02T21:10:54.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10cc8c7700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 rx=0x7f10c4013a70 tx=0x7f10c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:54.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c4018070 con 0x7f10c80f96f0 2022-02-02T21:10:54.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.883+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c80f5990 con 0x7f10c80f96f0 2022-02-02T21:10:54.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.884+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f10c40097d0 con 0x7f10c80f96f0 2022-02-02T21:10:54.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.884+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c401de80 con 0x7f10c80f96f0 2022-02-02T21:10:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.884+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c80f5ef0 con 0x7f10c80f96f0 2022-02-02T21:10:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.885+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c8045ad0 con 0x7f10c80f96f0 2022-02-02T21:10:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.885+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f10c4007ba0 con 0x7f10c80f96f0 2022-02-02T21:10:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.886+0000 7f10bdffb700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 0x7f10b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:54.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.886+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10c4083560 con 0x7f10c80f96f0 2022-02-02T21:10:54.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.886+0000 7f10cd0c8700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 0x7f10b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:54.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.886+0000 7f10cd0c8700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 0x7f10b40672e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f10c80f6980 tx=0x7f10b800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:54.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:54.890+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10c4051660 con 0x7f10c80f96f0 2022-02-02T21:10:55.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.063+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c80fed60 con 0x7f10b4064e20 2022-02-02T21:10:55.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.072+0000 7f10bdffb700 1 -- 172.21.15.96:0/1098017655 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f10c80fed60 con 0x7f10b4064e20 2022-02-02T21:10:55.074 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:10:55.075 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:10:55.075 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:10:55.075 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:10:55.075 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:10:55.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:10:55.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:10:55.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:10:55.077 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:10:55.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:10:55.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:10:55.077 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:10:55.078 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:10:55.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:10:55.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:10:55.078 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:10:55.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:10:55.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:10:55.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:10:55.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:10:55.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:10:55.081 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:10:55.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 msgr2=0x7f10b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 0x7f10b40672e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f10c80f6980 tx=0x7f10b800b040).stop 2022-02-02T21:10:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 msgr2=0x7f10c80f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 rx=0x7f10c4013a70 tx=0x7f10c4009b30).stop 2022-02-02T21:10:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 shutdown_connections 2022-02-02T21:10:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f10b4064e20 0x7f10b40672e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.074+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c80602b0 0x7f10c80f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.075+0000 7f10ce0ca700 1 --2- 172.21.15.96:0/1098017655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10c80f96f0 0x7f10c80f5070 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.075+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 >> 172.21.15.96:0/1098017655 conn(0x7f10c80f0b90 msgr2=0x7f10c80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.075+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 shutdown_connections 2022-02-02T21:10:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.075+0000 7f10ce0ca700 1 -- 172.21.15.96:0/1098017655 wait complete. 2022-02-02T21:10:55.172 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:54 smithi096 ceph-mon[101353]: pgmap v5064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 -- 172.21.15.96:0/2820427295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f6860 msgr2=0x7f39000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 --2- 172.21.15.96:0/2820427295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f6860 0x7f39000f6cc0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 rx=0x7f38f0004660 tx=0x7f38f0009b30).stop 2022-02-02T21:10:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 -- 172.21.15.96:0/2820427295 shutdown_connections 2022-02-02T21:10:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 --2- 172.21.15.96:0/2820427295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f6860 0x7f39000f6cc0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 --2- 172.21.15.96:0/2820427295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f55c0 0x7f39000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 -- 172.21.15.96:0/2820427295 >> 172.21.15.96:0/2820427295 conn(0x7f39000f0d40 msgr2=0x7f39000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:55.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 -- 172.21.15.96:0/2820427295 shutdown_connections 2022-02-02T21:10:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 -- 172.21.15.96:0/2820427295 wait complete. 2022-02-02T21:10:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.171+0000 7f39054e0700 1 Processor -- start 2022-02-02T21:10:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f39054e0700 1 -- start start 2022-02-02T21:10:55.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f39054e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f39054e0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f6860 0x7f3900107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f39054e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900107a10 con 0x7f39000f55c0 2022-02-02T21:10:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f39054e0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900107b50 con 0x7f39000f6860 2022-02-02T21:10:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41318/0 (socket says 172.21.15.96:41318) 2022-02-02T21:10:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 -- 172.21.15.96:0/1453639795 learned_addr learned my addr 172.21.15.96:0/1453639795 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38fe7fc700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f6860 0x7f3900107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 -- 172.21.15.96:0/1453639795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f6860 msgr2=0x7f3900107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f6860 0x7f3900107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 -- 172.21.15.96:0/1453639795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f39000f55c0 2022-02-02T21:10:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.172+0000 7f38feffd700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 rx=0x7f38f4002700 tx=0x7f38f4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.173+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f4009320 con 0x7f39000f55c0 2022-02-02T21:10:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.173+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38f400f040 con 0x7f39000f55c0 2022-02-02T21:10:55.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.173+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39001084f0 con 0x7f39000f55c0 2022-02-02T21:10:55.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.173+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f4014900 con 0x7f39000f55c0 2022-02-02T21:10:55.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.173+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3900108ab0 con 0x7f39000f55c0 2022-02-02T21:10:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.174+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900045ad0 con 0x7f39000f55c0 2022-02-02T21:10:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.174+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f38f4009480 con 0x7f39000f55c0 2022-02-02T21:10:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.175+0000 7f38e77fe700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 0x7f38e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.175+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f38f4081cc0 con 0x7f39000f55c0 2022-02-02T21:10:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.175+0000 7f38fe7fc700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 0x7f38e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.175+0000 7f38fe7fc700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 0x7f38e8067290 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f38f0009da0 tx=0x7f38f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.179+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f38f40538b0 con 0x7f39000f55c0 2022-02-02T21:10:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:54 smithi159 ceph-mon[69013]: pgmap v5064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:55.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.408+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f390010d590 con 0x7f39000f55c0 2022-02-02T21:10:55.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.409+0000 7f38e77fe700 1 -- 172.21.15.96:0/1453639795 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f38f40534a0 con 0x7f39000f55c0 2022-02-02T21:10:55.411 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:10:55.411 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:10:55.412 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:10:55.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:55.412 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:10:55.413 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:10:55.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:55.413 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:10:55.414 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:10:55.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:55.414 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:10:55.415 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:10:55.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:10:55.415 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:10:55.415 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:10:55.416 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:10:55.416 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:10:55.416 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:10:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 msgr2=0x7f38e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 0x7f38e8067290 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f38f0009da0 tx=0x7f38f0009b30).stop 2022-02-02T21:10:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 msgr2=0x7f3900106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 rx=0x7f38f4002700 tx=0x7f38f4009d80).stop 2022-02-02T21:10:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 shutdown_connections 2022-02-02T21:10:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38e8064dd0 0x7f38e8067290 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39000f55c0 0x7f3900106f70 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 --2- 172.21.15.96:0/1453639795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39000f6860 0x7f3900107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 >> 172.21.15.96:0/1453639795 conn(0x7f39000f0d40 msgr2=0x7f390005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 shutdown_connections 2022-02-02T21:10:55.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.411+0000 7f39054e0700 1 -- 172.21.15.96:0/1453639795 wait complete. 2022-02-02T21:10:55.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.507+0000 7f2cd5749700 1 -- 172.21.15.96:0/3209028183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 msgr2=0x7f2cd00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.507+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3209028183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd00f6b00 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 rx=0x7f2cc4004660 tx=0x7f2cc4009b30).stop 2022-02-02T21:10:55.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 -- 172.21.15.96:0/3209028183 shutdown_connections 2022-02-02T21:10:55.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3209028183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 0x7f2cd00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3209028183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd00f6b00 unknown :-1 s=CLOSED pgs=2601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 -- 172.21.15.96:0/3209028183 >> 172.21.15.96:0/3209028183 conn(0x7f2cd00f1e40 msgr2=0x7f2cd00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:55.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 -- 172.21.15.96:0/3209028183 shutdown_connections 2022-02-02T21:10:55.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.508+0000 7f2cd5749700 1 -- 172.21.15.96:0/3209028183 wait complete. 2022-02-02T21:10:55.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 Processor -- start 2022-02-02T21:10:55.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 -- start start 2022-02-02T21:10:55.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 0x7f2cd01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0107a50 con 0x7f2cd00f66e0 2022-02-02T21:10:55.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cd5749700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0107b90 con 0x7f2cd00f7980 2022-02-02T21:10:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41328/0 (socket says 172.21.15.96:41328) 2022-02-02T21:10:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.509+0000 7f2cceffd700 1 -- 172.21.15.96:0/3944924263 learned_addr learned my addr 172.21.15.96:0/3944924263 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:10:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cce7fc700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 0x7f2cd01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cceffd700 1 -- 172.21.15.96:0/3944924263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 msgr2=0x7f2cd01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cceffd700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 0x7f2cd01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cceffd700 1 -- 172.21.15.96:0/3944924263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4005040 con 0x7f2cd00f66e0 2022-02-02T21:10:55.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cceffd700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 rx=0x7f2cc4013a70 tx=0x7f2cc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:55.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc4018070 con 0x7f2cd00f66e0 2022-02-02T21:10:55.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd01084d0 con 0x7f2cd00f66e0 2022-02-02T21:10:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0108a30 con 0x7f2cd00f66e0 2022-02-02T21:10:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2cc40097d0 con 0x7f2cd00f66e0 2022-02-02T21:10:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.510+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc401dc00 con 0x7f2cd00f66e0 2022-02-02T21:10:55.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.511+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb0004fa0 con 0x7f2cd00f66e0 2022-02-02T21:10:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.512+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2cc4007ca0 con 0x7f2cd00f66e0 2022-02-02T21:10:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.512+0000 7f2cb77fe700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 0x7f2cb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:10:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.512+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2cc40833f0 con 0x7f2cd00f66e0 2022-02-02T21:10:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.512+0000 7f2cce7fc700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 0x7f2cb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:10:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.513+0000 7f2cce7fc700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 0x7f2cb8067290 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f2cc00096c0 tx=0x7f2cc0009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:10:55.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.516+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2cc4054f80 con 0x7f2cd00f66e0 2022-02-02T21:10:55.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.716+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2cb0005e80 con 0x7f2cd00f66e0 2022-02-02T21:10:55.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.716+0000 7f2cb77fe700 1 -- 172.21.15.96:0/3944924263 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2cc4054b70 con 0x7f2cd00f66e0 2022-02-02T21:10:55.718 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:10:55.718 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:10:55.719 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:10:55.719 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:10:55.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:55.719 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:10:55.720 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:10:55.720 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:10:55.720 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:10:55.720 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:10:55.720 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:10:55.721 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:10:55.721 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:10:55.721 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:10:55.721 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:10:55.722 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:10:55.722 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:10:55.722 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:10:55.722 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:10:55.722 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:10:55.723 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:10:55.723 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:10:55.723 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:10:55.723 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:10:55.724 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:10:55.724 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:10:55.724 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:10:55.724 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:10:55.724 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:10:55.725 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:10:55.725 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:10:55.725 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:10:55.725 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:55.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:55.726 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:10:55.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:10:55.726 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:55.726 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:55.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:10:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 msgr2=0x7f2cb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 0x7f2cb8067290 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f2cc00096c0 tx=0x7f2cc0009be0).stop 2022-02-02T21:10:55.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 msgr2=0x7f2cd0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:10:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 rx=0x7f2cc4013a70 tx=0x7f2cc4009b30).stop 2022-02-02T21:10:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 shutdown_connections 2022-02-02T21:10:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cb8064dd0 0x7f2cb8067290 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cd00f66e0 0x7f2cd0106fb0 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 --2- 172.21.15.96:0/3944924263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cd00f7980 0x7f2cd01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:10:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 >> 172.21.15.96:0/3944924263 conn(0x7f2cd00f1e40 msgr2=0x7f2cd00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:10:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 shutdown_connections 2022-02-02T21:10:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:10:55.718+0000 7f2cd5749700 1 -- 172.21.15.96:0/3944924263 wait complete. 2022-02-02T21:10:55.730 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:10:56.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:55 smithi159 ceph-mon[69013]: from='client.39298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:56.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:55 smithi159 ceph-mon[69013]: from='client.39302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1453639795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:10:56.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3944924263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:10:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:55 smithi096 ceph-mon[101353]: from='client.39298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:55 smithi096 ceph-mon[101353]: from='client.39302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:10:56.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1453639795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:10:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3944924263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:10:57.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:56 smithi159 ceph-mon[69013]: pgmap v5065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:56 smithi096 ceph-mon[101353]: pgmap v5065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:10:58 smithi159 ceph-mon[69013]: pgmap v5066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:10:58.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:10:58 smithi096 ceph-mon[101353]: pgmap v5066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:00 smithi159 ceph-mon[69013]: pgmap v5067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:00 smithi096 ceph-mon[101353]: pgmap v5067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:03.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:02 smithi096 ceph-mon[101353]: pgmap v5068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:02 smithi159 ceph-mon[69013]: pgmap v5068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:04 smithi159 ceph-mon[69013]: pgmap v5069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:04 smithi096 ceph-mon[101353]: pgmap v5069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:06 smithi159 ceph-mon[69013]: pgmap v5070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:06 smithi096 ceph-mon[101353]: pgmap v5070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:08 smithi159 ceph-mon[69013]: pgmap v5071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:08 smithi096 ceph-mon[101353]: pgmap v5071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:10 smithi159 ceph-mon[69013]: pgmap v5072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:10 smithi096 ceph-mon[101353]: pgmap v5072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:12 smithi096 ceph-mon[101353]: pgmap v5073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:12 smithi159 ceph-mon[69013]: pgmap v5073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:14 smithi159 ceph-mon[69013]: pgmap v5074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:14 smithi096 ceph-mon[101353]: pgmap v5074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:16 smithi159 ceph-mon[69013]: pgmap v5075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:16 smithi096 ceph-mon[101353]: pgmap v5075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:18 smithi159 ceph-mon[69013]: pgmap v5076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:18 smithi096 ceph-mon[101353]: pgmap v5076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:20 smithi159 ceph-mon[69013]: pgmap v5077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:20 smithi096 ceph-mon[101353]: pgmap v5077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:22 smithi096 ceph-mon[101353]: pgmap v5078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:23.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:22 smithi159 ceph-mon[69013]: pgmap v5078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:25.053 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:24 smithi096 ceph-mon[101353]: pgmap v5079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:24 smithi159 ceph-mon[69013]: pgmap v5079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:25.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 -- 172.21.15.96:0/1854389320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 msgr2=0x7f5c6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:25.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 --2- 172.21.15.96:0/1854389320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c0f6cc0 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 rx=0x7f5c54004660 tx=0x7f5c54009b30).stop 2022-02-02T21:11:25.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 -- 172.21.15.96:0/1854389320 shutdown_connections 2022-02-02T21:11:25.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 --2- 172.21.15.96:0/1854389320 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c0f6cc0 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 --2- 172.21.15.96:0/1854389320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:11:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 -- 172.21.15.96:0/1854389320 >> 172.21.15.96:0/1854389320 conn(0x7f5c6c0f0d40 msgr2=0x7f5c6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 -- 172.21.15.96:0/1854389320 shutdown_connections 2022-02-02T21:11:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.820+0000 7f5c726c8700 1 -- 172.21.15.96:0/1854389320 wait complete. 2022-02-02T21:11:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 Processor -- start 2022-02-02T21:11:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 -- start start 2022-02-02T21:11:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c107af0 con 0x7f5c6c0f6860 2022-02-02T21:11:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c726c8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1083a0 con 0x7f5c6c0f55c0 2022-02-02T21:11:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41350/0 (socket says 172.21.15.96:41350) 2022-02-02T21:11:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 -- 172.21.15.96:0/75492789 learned_addr learned my addr 172.21.15.96:0/75492789 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6bfff700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 -- 172.21.15.96:0/75492789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 msgr2=0x7f5c6c106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.821+0000 7f5c6b7fe700 1 -- 172.21.15.96:0/75492789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54005040 con 0x7f5c6c0f6860 2022-02-02T21:11:25.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c6b7fe700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 rx=0x7f5c54009990 tx=0x7f5c54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:25.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c54018070 con 0x7f5c6c0f6860 2022-02-02T21:11:25.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c108620 con 0x7f5c6c0f6860 2022-02-02T21:11:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c54007ba0 con 0x7f5c6c0f6860 2022-02-02T21:11:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c5401c3c0 con 0x7f5c6c0f6860 2022-02-02T21:11:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.822+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c108b80 con 0x7f5c6c0f6860 2022-02-02T21:11:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.823+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c0f49b0 con 0x7f5c6c0f6860 2022-02-02T21:11:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.823+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c5401d420 con 0x7f5c6c0f6860 2022-02-02T21:11:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.824+0000 7f5c68ff9700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 0x7f5c58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.824+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5c540837a0 con 0x7f5c6c0f6860 2022-02-02T21:11:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.824+0000 7f5c6bfff700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 0x7f5c58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.824+0000 7f5c6bfff700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 0x7f5c58067290 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f5c5c006fd0 tx=0x7f5c5c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:25.828+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c540552d0 con 0x7f5c6c0f6860 2022-02-02T21:11:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.006+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c6c0fde90 con 0x7f5c58064dd0 2022-02-02T21:11:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.007+0000 7f5c68ff9700 1 -- 172.21.15.96:0/75492789 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5c6c0fde90 con 0x7f5c58064dd0 2022-02-02T21:11:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 msgr2=0x7f5c58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 0x7f5c58067290 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f5c5c006fd0 tx=0x7f5c5c008040).stop 2022-02-02T21:11:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 msgr2=0x7f5c6c1074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 rx=0x7f5c54009990 tx=0x7f5c54009b30).stop 2022-02-02T21:11:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 shutdown_connections 2022-02-02T21:11:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c58064dd0 0x7f5c58067290 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 --2- 172.21.15.96:0/75492789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c1074b0 unknown :-1 s=CLOSED pgs=2604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 >> 172.21.15.96:0/75492789 conn(0x7f5c6c0f0d40 msgr2=0x7f5c6c0fb240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 shutdown_connections 2022-02-02T21:11:26.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.009+0000 7f5c726c8700 1 -- 172.21.15.96:0/75492789 wait complete. 2022-02-02T21:11:26.021 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:11:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 -- 172.21.15.96:0/2102201838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f66e0 msgr2=0x7ff0840f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 --2- 172.21.15.96:0/2102201838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f66e0 0x7ff0840f6b40 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 rx=0x7ff078004660 tx=0x7ff078009b30).stop 2022-02-02T21:11:26.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 -- 172.21.15.96:0/2102201838 shutdown_connections 2022-02-02T21:11:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 --2- 172.21.15.96:0/2102201838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f66e0 0x7ff0840f6b40 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 --2- 172.21.15.96:0/2102201838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f5440 0x7ff0840f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 -- 172.21.15.96:0/2102201838 >> 172.21.15.96:0/2102201838 conn(0x7ff0840f0ba0 msgr2=0x7ff0840f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.106+0000 7ff0888d1700 1 -- 172.21.15.96:0/2102201838 shutdown_connections 2022-02-02T21:11:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.107+0000 7ff0888d1700 1 -- 172.21.15.96:0/2102201838 wait complete. 2022-02-02T21:11:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.107+0000 7ff0888d1700 1 Processor -- start 2022-02-02T21:11:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.107+0000 7ff0888d1700 1 -- start start 2022-02-02T21:11:26.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 0x7ff08410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840603c0 con 0x7ff0840f5440 2022-02-02T21:11:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084060500 con 0x7ff0840f66e0 2022-02-02T21:11:26.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41358/0 (socket says 172.21.15.96:41358) 2022-02-02T21:11:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 -- 172.21.15.96:0/1309471973 learned_addr learned my addr 172.21.15.96:0/1309471973 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff082ffd700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 0x7ff08410bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 -- 172.21.15.96:0/1309471973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 msgr2=0x7ff08410bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 0x7ff08410bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 -- 172.21.15.96:0/1309471973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078005040 con 0x7ff0840f5440 2022-02-02T21:11:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff082ffd700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 0x7ff08410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:11:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0837fe700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 rx=0x7ff074002700 tx=0x7ff074009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff074009320 con 0x7ff0840f5440 2022-02-02T21:11:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08410c500 con 0x7ff0840f5440 2022-02-02T21:11:26.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff07400f040 con 0x7ff0840f5440 2022-02-02T21:11:26.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff074014900 con 0x7ff0840f5440 2022-02-02T21:11:26.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.108+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08410ca90 con 0x7ff0840f5440 2022-02-02T21:11:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.109+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084045ad0 con 0x7ff0840f5440 2022-02-02T21:11:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.110+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff074009480 con 0x7ff0840f5440 2022-02-02T21:11:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.110+0000 7ff06bfff700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 0x7ff06c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.110+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff074081c20 con 0x7ff0840f5440 2022-02-02T21:11:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.111+0000 7ff082ffd700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 0x7ff06c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.111+0000 7ff082ffd700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 0x7ff06c0672e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff078004630 tx=0x7ff078009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.115+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff07404fd20 con 0x7ff0840f5440 2022-02-02T21:11:26.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.285+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff084057f10 con 0x7ff06c064e20 2022-02-02T21:11:26.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.295+0000 7ff06bfff700 1 -- 172.21.15.96:0/1309471973 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff084057f10 con 0x7ff06c064e20 2022-02-02T21:11:26.298 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:11:26.298 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:11:26.298 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:11:26.299 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:11:26.299 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:11:26.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:11:26.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:11:26.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:11:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:11:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:11:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:11:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:11:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:11:26.301 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:11:26.301 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:11:26.301 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:11:26.301 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:11:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:11:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:11:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:11:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:11:26.303 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:11:26.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 msgr2=0x7ff06c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 0x7ff06c0672e0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff078004630 tx=0x7ff078009b30).stop 2022-02-02T21:11:26.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 msgr2=0x7ff084109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 rx=0x7ff074002700 tx=0x7ff074009d80).stop 2022-02-02T21:11:26.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 shutdown_connections 2022-02-02T21:11:26.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064e20 0x7ff06c0672e0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f5440 0x7ff084109a50 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 --2- 172.21.15.96:0/1309471973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f66e0 0x7ff08410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 >> 172.21.15.96:0/1309471973 conn(0x7ff0840f0ba0 msgr2=0x7ff0840fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 shutdown_connections 2022-02-02T21:11:26.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.297+0000 7ff0888d1700 1 -- 172.21.15.96:0/1309471973 wait complete. 2022-02-02T21:11:26.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4020210909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 msgr2=0x7fc7e00f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4020210909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f4e60 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 rx=0x7fc7d4004660 tx=0x7fc7d4009b30).stop 2022-02-02T21:11:26.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4020210909 shutdown_connections 2022-02-02T21:11:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4020210909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 0x7fc7e00f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4020210909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f4e60 unknown :-1 s=CLOSED pgs=2607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4020210909 >> 172.21.15.96:0/4020210909 conn(0x7fc7e00f04c0 msgr2=0x7fc7e00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4020210909 shutdown_connections 2022-02-02T21:11:26.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.393+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4020210909 wait complete. 2022-02-02T21:11:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 Processor -- start 2022-02-02T21:11:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 -- start start 2022-02-02T21:11:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 0x7fc7e00f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00f6010 con 0x7fc7e00f4a40 2022-02-02T21:11:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7e48bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00f6150 con 0x7fc7e00f53e0 2022-02-02T21:11:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.394+0000 7fc7de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41368/0 (socket says 172.21.15.96:41368) 2022-02-02T21:11:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7de59c700 1 -- 172.21.15.96:0/4027119954 learned_addr learned my addr 172.21.15.96:0/4027119954 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7ddd9b700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 0x7fc7e00f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7de59c700 1 -- 172.21.15.96:0/4027119954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 msgr2=0x7fc7e00f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7de59c700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 0x7fc7e00f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7de59c700 1 -- 172.21.15.96:0/4027119954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4005040 con 0x7fc7e00f4a40 2022-02-02T21:11:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7de59c700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 rx=0x7fc7d4009990 tx=0x7fc7d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d4018070 con 0x7fc7e00f4a40 2022-02-02T21:11:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7d4007ba0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e00f63d0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d401c620 con 0x7fc7e00f4a40 2022-02-02T21:11:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.395+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00f6930 con 0x7fc7e00f4a40 2022-02-02T21:11:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.396+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0045ad0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.397+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc7d401d420 con 0x7fc7e00f4a40 2022-02-02T21:11:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.397+0000 7fc7ceffd700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 0x7fc7c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.397+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc7d40838d0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.397+0000 7fc7ddd9b700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 0x7fc7c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.398+0000 7fc7ddd9b700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 0x7fc7c8067290 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fc7e00f5860 tx=0x7fc7d0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.402+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7d40519d0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.630+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7e005ebe0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.630+0000 7fc7ceffd700 1 -- 172.21.15.96:0/4027119954 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc7d4054ff0 con 0x7fc7e00f4a40 2022-02-02T21:11:26.633 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:11:26.633 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:11:26.634 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:11:26.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:26.634 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:11:26.634 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:11:26.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:26.635 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:11:26.635 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:11:26.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:26.636 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:11:26.636 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:11:26.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:26.636 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:11:26.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:11:26.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:11:26.637 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:11:26.638 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:11:26.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 msgr2=0x7fc7c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 0x7fc7c8067290 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fc7e00f5860 tx=0x7fc7d0009040).stop 2022-02-02T21:11:26.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 msgr2=0x7fc7e00f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 rx=0x7fc7d4009990 tx=0x7fc7d4009b30).stop 2022-02-02T21:11:26.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 shutdown_connections 2022-02-02T21:11:26.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7c8064dd0 0x7fc7c8067290 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7e00f4a40 0x7fc7e00f7630 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 --2- 172.21.15.96:0/4027119954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e00f53e0 0x7fc7e00f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 >> 172.21.15.96:0/4027119954 conn(0x7fc7e00f04c0 msgr2=0x7fc7e00fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 shutdown_connections 2022-02-02T21:11:26.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.632+0000 7fc7e48bb700 1 -- 172.21.15.96:0/4027119954 wait complete. 2022-02-02T21:11:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 -- 172.21.15.96:0/481890622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f5430 msgr2=0x7f56480f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 --2- 172.21.15.96:0/481890622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f5430 0x7f56480f5850 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 rx=0x7f5644004660 tx=0x7f5644009b30).stop 2022-02-02T21:11:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 -- 172.21.15.96:0/481890622 shutdown_connections 2022-02-02T21:11:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 --2- 172.21.15.96:0/481890622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f66d0 0x7f56480f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 --2- 172.21.15.96:0/481890622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f5430 0x7f56480f5850 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.732+0000 7f564eb44700 1 -- 172.21.15.96:0/481890622 >> 172.21.15.96:0/481890622 conn(0x7f56480f0b90 msgr2=0x7f56480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.733+0000 7f564eb44700 1 -- 172.21.15.96:0/481890622 shutdown_connections 2022-02-02T21:11:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.733+0000 7f564eb44700 1 -- 172.21.15.96:0/481890622 wait complete. 2022-02-02T21:11:26.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.733+0000 7f564eb44700 1 Processor -- start 2022-02-02T21:11:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564eb44700 1 -- start start 2022-02-02T21:11:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564eb44700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f5430 0x7f5648105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564eb44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564eb44700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481067d0 con 0x7f56480f66d0 2022-02-02T21:11:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564eb44700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648106fd0 con 0x7f56480f5430 2022-02-02T21:11:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41380/0 (socket says 172.21.15.96:41380) 2022-02-02T21:11:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 -- 172.21.15.96:0/307136873 learned_addr learned my addr 172.21.15.96:0/307136873 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564db42700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f5430 0x7f5648105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 -- 172.21.15.96:0/307136873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f5430 msgr2=0x7f5648105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f5430 0x7f5648105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 -- 172.21.15.96:0/307136873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644005040 con 0x7f56480f66d0 2022-02-02T21:11:26.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.734+0000 7f564d341700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 rx=0x7f563800c790 tx=0x7f5638007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.735+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563800e680 con 0x7f56480f66d0 2022-02-02T21:11:26.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.735+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f563800ec90 con 0x7f56480f66d0 2022-02-02T21:11:26.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.735+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56481072b0 con 0x7f56480f66d0 2022-02-02T21:11:26.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.735+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5638013d60 con 0x7f56480f66d0 2022-02-02T21:11:26.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.735+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5648107870 con 0x7f56480f66d0 2022-02-02T21:11:26.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.736+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648059100 con 0x7f56480f66d0 2022-02-02T21:11:26.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.736+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f563801a060 con 0x7f56480f66d0 2022-02-02T21:11:26.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.736+0000 7f563e7fc700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 0x7f56340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:26.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.736+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5638081c90 con 0x7f56480f66d0 2022-02-02T21:11:26.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.737+0000 7f564db42700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 0x7f56340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:26.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.737+0000 7f564db42700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 0x7f56340672e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f5644004e30 tx=0x7f5644009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:26.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.741+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56380537c0 con 0x7f56480f66d0 2022-02-02T21:11:26.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.943+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56480fdbf0 con 0x7f56480f66d0 2022-02-02T21:11:26.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.944+0000 7f563e7fc700 1 -- 172.21.15.96:0/307136873 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5638018020 con 0x7f56480f66d0 2022-02-02T21:11:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:11:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:11:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:11:26.947 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:11:26.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:11:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:11:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:11:26.948 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:11:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:11:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:11:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:11:26.949 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:11:26.950 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:11:26.950 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:11:26.951 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:11:26.951 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:11:26.951 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:11:26.951 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:11:26.952 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:11:26.952 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:11:26.952 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:11:26.952 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:11:26.952 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:11:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:11:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:11:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:11:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:11:26.953 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:11:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:11:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:11:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:11:26.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:26.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:11:26.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:26.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:26.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 msgr2=0x7f56340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 0x7f56340672e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f5644004e30 tx=0x7f5644009b30).stop 2022-02-02T21:11:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 msgr2=0x7f5648106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:26.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 rx=0x7f563800c790 tx=0x7f5638007d70).stop 2022-02-02T21:11:26.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 shutdown_connections 2022-02-02T21:11:26.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5634064e20 0x7f56340672e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56480f5430 0x7f5648105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 --2- 172.21.15.96:0/307136873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56480f66d0 0x7f5648106220 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 >> 172.21.15.96:0/307136873 conn(0x7f56480f0b90 msgr2=0x7f56480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 shutdown_connections 2022-02-02T21:11:26.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:26.946+0000 7f564eb44700 1 -- 172.21.15.96:0/307136873 wait complete. 2022-02-02T21:11:26.960 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:11:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:26 smithi096 ceph-mon[101353]: pgmap v5080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:26 smithi096 ceph-mon[101353]: from='client.39314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:27.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4027119954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:11:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:26 smithi159 ceph-mon[69013]: pgmap v5080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:26 smithi159 ceph-mon[69013]: from='client.39314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4027119954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:11:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:27 smithi159 ceph-mon[69013]: from='client.39318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/307136873' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:11:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:11:28.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:11:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:27 smithi096 ceph-mon[101353]: from='client.39318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/307136873' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:11:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:11:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:11:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:28 smithi159 ceph-mon[69013]: pgmap v5081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:29.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:28 smithi096 ceph-mon[101353]: pgmap v5081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:30 smithi159 ceph-mon[69013]: pgmap v5082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:30 smithi096 ceph-mon[101353]: pgmap v5082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:32 smithi096 ceph-mon[101353]: pgmap v5083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:32 smithi159 ceph-mon[69013]: pgmap v5083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:34 smithi159 ceph-mon[69013]: pgmap v5084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:34 smithi096 ceph-mon[101353]: pgmap v5084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:36 smithi159 ceph-mon[69013]: pgmap v5085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:36 smithi096 ceph-mon[101353]: pgmap v5085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:38 smithi159 ceph-mon[69013]: pgmap v5086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:38 smithi096 ceph-mon[101353]: pgmap v5086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:40 smithi159 ceph-mon[69013]: pgmap v5087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:40 smithi096 ceph-mon[101353]: pgmap v5087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:42 smithi096 ceph-mon[101353]: pgmap v5088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:42 smithi159 ceph-mon[69013]: pgmap v5088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:44 smithi159 ceph-mon[69013]: pgmap v5089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:44 smithi096 ceph-mon[101353]: pgmap v5089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:46 smithi159 ceph-mon[69013]: pgmap v5090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:46 smithi096 ceph-mon[101353]: pgmap v5090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:48 smithi159 ceph-mon[69013]: pgmap v5091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:48.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:48 smithi096 ceph-mon[101353]: pgmap v5091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:50 smithi159 ceph-mon[69013]: pgmap v5092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:50 smithi096 ceph-mon[101353]: pgmap v5092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:52 smithi096 ceph-mon[101353]: pgmap v5093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:52 smithi159 ceph-mon[69013]: pgmap v5093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:54 smithi159 ceph-mon[69013]: pgmap v5094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:54 smithi096 ceph-mon[101353]: pgmap v5094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:57.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 -- 172.21.15.96:0/2352271088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde84060310 msgr2=0x7fde840f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 --2- 172.21.15.96:0/2352271088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde84060310 0x7fde840f9110 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 rx=0x7fde74004660 tx=0x7fde74009b30).stop 2022-02-02T21:11:57.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 -- 172.21.15.96:0/2352271088 shutdown_connections 2022-02-02T21:11:57.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 --2- 172.21.15.96:0/2352271088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f9690 0x7fde840fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 --2- 172.21.15.96:0/2352271088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde84060310 0x7fde840f9110 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 -- 172.21.15.96:0/2352271088 >> 172.21.15.96:0/2352271088 conn(0x7fde840f0b90 msgr2=0x7fde840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 -- 172.21.15.96:0/2352271088 shutdown_connections 2022-02-02T21:11:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.057+0000 7fde8979e700 1 -- 172.21.15.96:0/2352271088 wait complete. 2022-02-02T21:11:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 Processor -- start 2022-02-02T21:11:57.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 -- start start 2022-02-02T21:11:57.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde84060310 0x7fde84108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84109960 con 0x7fde840f9690 2022-02-02T21:11:57.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde8979e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84109aa0 con 0x7fde84060310 2022-02-02T21:11:57.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.058+0000 7fde837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41400/0 (socket says 172.21.15.96:41400) 2022-02-02T21:11:57.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde837fe700 1 -- 172.21.15.96:0/105364366 learned_addr learned my addr 172.21.15.96:0/105364366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:57.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde83fff700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde84060310 0x7fde84108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde837fe700 1 -- 172.21.15.96:0/105364366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde84060310 msgr2=0x7fde84108ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde837fe700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde84060310 0x7fde84108ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde837fe700 1 -- 172.21.15.96:0/105364366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74005040 con 0x7fde840f9690 2022-02-02T21:11:57.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde837fe700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 rx=0x7fde780026d0 tx=0x7fde78009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde78009320 con 0x7fde840f9690 2022-02-02T21:11:57.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8410a440 con 0x7fde840f9690 2022-02-02T21:11:57.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde7800f040 con 0x7fde840f9690 2022-02-02T21:11:57.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde78014870 con 0x7fde840f9690 2022-02-02T21:11:57.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.059+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8410aa00 con 0x7fde840f9690 2022-02-02T21:11:57.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.060+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84045ad0 con 0x7fde840f9690 2022-02-02T21:11:57.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.061+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde78009480 con 0x7fde840f9690 2022-02-02T21:11:57.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.061+0000 7fde80ff9700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 0x7fde6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.061+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde78081e50 con 0x7fde840f9690 2022-02-02T21:11:57.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.061+0000 7fde83fff700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 0x7fde6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.062+0000 7fde83fff700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 0x7fde6c0672e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fde74004630 tx=0x7fde74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.066+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde780538c0 con 0x7fde840f9690 2022-02-02T21:11:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.246+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde840f5650 con 0x7fde6c064e20 2022-02-02T21:11:57.248 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:56 smithi096 ceph-mon[101353]: pgmap v5095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.247+0000 7fde80ff9700 1 -- 172.21.15.96:0/105364366 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fde840f5650 con 0x7fde6c064e20 2022-02-02T21:11:57.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 msgr2=0x7fde6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 0x7fde6c0672e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fde74004630 tx=0x7fde74009b30).stop 2022-02-02T21:11:57.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 msgr2=0x7fde841093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 rx=0x7fde780026d0 tx=0x7fde78009e00).stop 2022-02-02T21:11:57.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 shutdown_connections 2022-02-02T21:11:57.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064e20 0x7fde6c0672e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde84060310 0x7fde84108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 --2- 172.21.15.96:0/105364366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f9690 0x7fde841093b0 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 >> 172.21.15.96:0/105364366 conn(0x7fde840f0b90 msgr2=0x7fde840f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 shutdown_connections 2022-02-02T21:11:57.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.249+0000 7fde8979e700 1 -- 172.21.15.96:0/105364366 wait complete. 2022-02-02T21:11:57.261 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:11:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:56 smithi159 ceph-mon[69013]: pgmap v5095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.348+0000 7f5f590ef700 1 -- 172.21.15.96:0/2728429633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 msgr2=0x7f5f540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 --2- 172.21.15.96:0/2728429633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f540f59e0 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 rx=0x7f5f48004660 tx=0x7f5f48009b30).stop 2022-02-02T21:11:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 -- 172.21.15.96:0/2728429633 shutdown_connections 2022-02-02T21:11:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 --2- 172.21.15.96:0/2728429633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 0x7f5f540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:11:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 --2- 172.21.15.96:0/2728429633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f540f59e0 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 -- 172.21.15.96:0/2728429633 >> 172.21.15.96:0/2728429633 conn(0x7f5f540f0d40 msgr2=0x7f5f540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 -- 172.21.15.96:0/2728429633 shutdown_connections 2022-02-02T21:11:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 -- 172.21.15.96:0/2728429633 wait complete. 2022-02-02T21:11:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 Processor -- start 2022-02-02T21:11:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.349+0000 7f5f590ef700 1 -- start start 2022-02-02T21:11:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f590ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f590ef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 0x7f5f5410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f590ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54060450 con 0x7f5f540f55c0 2022-02-02T21:11:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f590ef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54060590 con 0x7f5f540f6860 2022-02-02T21:11:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41408/0 (socket says 172.21.15.96:41408) 2022-02-02T21:11:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 -- 172.21.15.96:0/3570460638 learned_addr learned my addr 172.21.15.96:0/3570460638 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f5259c700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 0x7f5f5410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 -- 172.21.15.96:0/3570460638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 msgr2=0x7f5f5410c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 0x7f5f5410c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 -- 172.21.15.96:0/3570460638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48005040 con 0x7f5f540f55c0 2022-02-02T21:11:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f52d9d700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 rx=0x7f5f48004f60 tx=0x7f5f48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f48018070 con 0x7f5f540f55c0 2022-02-02T21:11:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5410c790 con 0x7f5f540f55c0 2022-02-02T21:11:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f48007ba0 con 0x7f5f540f55c0 2022-02-02T21:11:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.350+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4801dea0 con 0x7f5f540f55c0 2022-02-02T21:11:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.351+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5410ccf0 con 0x7f5f540f55c0 2022-02-02T21:11:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.351+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54045ad0 con 0x7f5f540f55c0 2022-02-02T21:11:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.352+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f4801d420 con 0x7f5f540f55c0 2022-02-02T21:11:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.352+0000 7f5f3b7fe700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 0x7f5f3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.352+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f480839b0 con 0x7f5f540f55c0 2022-02-02T21:11:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.352+0000 7f5f5259c700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 0x7f5f3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.353+0000 7f5f5259c700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 0x7f5f3c067290 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f5f4400b790 tx=0x7f5f44008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.357+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f48051ab0 con 0x7f5f540f55c0 2022-02-02T21:11:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.527+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f540fdf10 con 0x7f5f3c064dd0 2022-02-02T21:11:57.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.537+0000 7f5f3b7fe700 1 -- 172.21.15.96:0/3570460638 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5f540fdf10 con 0x7f5f3c064dd0 2022-02-02T21:11:57.538 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:11:57.539 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:11:57.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:11:57.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:11:57.539 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:11:57.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:11:57.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:11:57.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:11:57.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:11:57.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:11:57.541 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:11:57.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:11:57.541 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:11:57.541 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:11:57.542 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:11:57.542 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:11:57.542 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:11:57.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:11:57.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:11:57.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:11:57.543 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:11:57.543 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:11:57.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 msgr2=0x7f5f3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 0x7f5f3c067290 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f5f4400b790 tx=0x7f5f44008040).stop 2022-02-02T21:11:57.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 msgr2=0x7f5f54109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 rx=0x7f5f48004f60 tx=0x7f5f48009b30).stop 2022-02-02T21:11:57.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 shutdown_connections 2022-02-02T21:11:57.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f3c064dd0 0x7f5f3c067290 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f540f55c0 0x7f5f54109ce0 unknown :-1 s=CLOSED pgs=2614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 --2- 172.21.15.96:0/3570460638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f540f6860 0x7f5f5410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.538+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 >> 172.21.15.96:0/3570460638 conn(0x7f5f540f0d40 msgr2=0x7f5f540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.539+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 shutdown_connections 2022-02-02T21:11:57.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.539+0000 7f5f590ef700 1 -- 172.21.15.96:0/3570460638 wait complete. 2022-02-02T21:11:57.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 -- 172.21.15.96:0/1601265129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f6530 msgr2=0x7f54e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 --2- 172.21.15.96:0/1601265129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f6530 0x7f54e00f6950 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 rx=0x7f54dc004660 tx=0x7f54dc009b30).stop 2022-02-02T21:11:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 -- 172.21.15.96:0/1601265129 shutdown_connections 2022-02-02T21:11:57.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 --2- 172.21.15.96:0/1601265129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f77d0 0x7f54e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:11:57.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 --2- 172.21.15.96:0/1601265129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f6530 0x7f54e00f6950 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 -- 172.21.15.96:0/1601265129 >> 172.21.15.96:0/1601265129 conn(0x7f54e00f1c90 msgr2=0x7f54e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 -- 172.21.15.96:0/1601265129 shutdown_connections 2022-02-02T21:11:57.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.635+0000 7f54e7458700 1 -- 172.21.15.96:0/1601265129 wait complete. 2022-02-02T21:11:57.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 Processor -- start 2022-02-02T21:11:57.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 -- start start 2022-02-02T21:11:57.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f6530 0x7f54e0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01079a0 con 0x7f54e00f77d0 2022-02-02T21:11:57.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e7458700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0108120 con 0x7f54e00f6530 2022-02-02T21:11:57.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e5c55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e5c55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41420/0 (socket says 172.21.15.96:41420) 2022-02-02T21:11:57.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e5c55700 1 -- 172.21.15.96:0/4165452200 learned_addr learned my addr 172.21.15.96:0/4165452200 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:57.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.636+0000 7f54e6456700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f6530 0x7f54e0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e5c55700 1 -- 172.21.15.96:0/4165452200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f6530 msgr2=0x7f54e0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e5c55700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f6530 0x7f54e0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e5c55700 1 -- 172.21.15.96:0/4165452200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc005040 con 0x7f54e00f77d0 2022-02-02T21:11:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e5c55700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 rx=0x7f54d000b410 tx=0x7f54d0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d00125f0 con 0x7f54e00f77d0 2022-02-02T21:11:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54d000be30 con 0x7f54e00f77d0 2022-02-02T21:11:57.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e01083a0 con 0x7f54e00f77d0 2022-02-02T21:11:57.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d0002a70 con 0x7f54e00f77d0 2022-02-02T21:11:57.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.637+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0108960 con 0x7f54e00f77d0 2022-02-02T21:11:57.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.638+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0045ad0 con 0x7f54e00f77d0 2022-02-02T21:11:57.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.638+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f54d000f030 con 0x7f54e00f77d0 2022-02-02T21:11:57.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.639+0000 7f54d6ffd700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 0x7f54cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.639+0000 7f54e6456700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 0x7f54cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.639+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f54d0081da0 con 0x7f54e00f77d0 2022-02-02T21:11:57.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.639+0000 7f54e6456700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 0x7f54cc0672e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f54dc013690 tx=0x7f54dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.643+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f54d004fea0 con 0x7f54e00f77d0 2022-02-02T21:11:57.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.875+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54e0027a00 con 0x7f54e00f77d0 2022-02-02T21:11:57.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.876+0000 7f54d6ffd700 1 -- 172.21.15.96:0/4165452200 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f54d00534c0 con 0x7f54e00f77d0 2022-02-02T21:11:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:11:57.878 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:11:57.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:11:57.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:57.878 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:11:57.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:11:57.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:57.879 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:11:57.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:11:57.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:57.880 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:11:57.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:11:57.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:11:57.880 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:11:57.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:11:57.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:11:57.881 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:11:57.881 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:11:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 msgr2=0x7f54cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 0x7f54cc0672e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f54dc013690 tx=0x7f54dc009b30).stop 2022-02-02T21:11:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 msgr2=0x7f54e0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 rx=0x7f54d000b410 tx=0x7f54d0006ef0).stop 2022-02-02T21:11:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 shutdown_connections 2022-02-02T21:11:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54cc064e20 0x7f54cc0672e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54e00f6530 0x7f54e0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 --2- 172.21.15.96:0/4165452200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54e00f77d0 0x7f54e0107310 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.877+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 >> 172.21.15.96:0/4165452200 conn(0x7f54e00f1c90 msgr2=0x7f54e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.878+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 shutdown_connections 2022-02-02T21:11:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.878+0000 7f54e7458700 1 -- 172.21.15.96:0/4165452200 wait complete. 2022-02-02T21:11:57.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 -- 172.21.15.96:0/4234997370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f66d0 msgr2=0x7fc13c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 --2- 172.21.15.96:0/4234997370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f66d0 0x7fc13c0f6b30 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 rx=0x7fc12c004660 tx=0x7fc12c009b30).stop 2022-02-02T21:11:57.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 -- 172.21.15.96:0/4234997370 shutdown_connections 2022-02-02T21:11:57.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 --2- 172.21.15.96:0/4234997370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f66d0 0x7fc13c0f6b30 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 --2- 172.21.15.96:0/4234997370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f5430 0x7fc13c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 -- 172.21.15.96:0/4234997370 >> 172.21.15.96:0/4234997370 conn(0x7fc13c0f0b90 msgr2=0x7fc13c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:57.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 -- 172.21.15.96:0/4234997370 shutdown_connections 2022-02-02T21:11:57.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.975+0000 7fc13b59e700 1 -- 172.21.15.96:0/4234997370 wait complete. 2022-02-02T21:11:57.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 Processor -- start 2022-02-02T21:11:57.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 -- start start 2022-02-02T21:11:57.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f66d0 0x7fc13c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0603c0 con 0x7fc13c0f5430 2022-02-02T21:11:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c060500 con 0x7fc13c0f66d0 2022-02-02T21:11:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41428/0 (socket says 172.21.15.96:41428) 2022-02-02T21:11:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc13a59c700 1 -- 172.21.15.96:0/2548428463 learned_addr learned my addr 172.21.15.96:0/2548428463 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:11:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.976+0000 7fc139d9b700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f66d0 0x7fc13c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13a59c700 1 -- 172.21.15.96:0/2548428463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f66d0 msgr2=0x7fc13c10bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13a59c700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f66d0 0x7fc13c10bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:57.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13a59c700 1 -- 172.21.15.96:0/2548428463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c005040 con 0x7fc13c0f5430 2022-02-02T21:11:57.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13a59c700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 rx=0x7fc130002700 tx=0x7fc130009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc130009320 con 0x7fc13c0f5430 2022-02-02T21:11:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc13000f040 con 0x7fc13c0f5430 2022-02-02T21:11:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c10c4f0 con 0x7fc13c0f5430 2022-02-02T21:11:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc130014900 con 0x7fc13c0f5430 2022-02-02T21:11:57.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.977+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c10ca80 con 0x7fc13c0f5430 2022-02-02T21:11:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.978+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c059100 con 0x7fc13c0f5430 2022-02-02T21:11:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.978+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc130009480 con 0x7fc13c0f5430 2022-02-02T21:11:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.979+0000 7fc12affd700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 0x7fc1240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:11:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.979+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc130081cc0 con 0x7fc13c0f5430 2022-02-02T21:11:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.979+0000 7fc139d9b700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 0x7fc1240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:11:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.979+0000 7fc139d9b700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 0x7fc1240672e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fc12c004630 tx=0x7fc12c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:11:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:57.983+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc13004fe80 con 0x7fc13c0f5430 2022-02-02T21:11:58.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.183+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc13c0586e0 con 0x7fc13c0f5430 2022-02-02T21:11:58.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.184+0000 7fc12affd700 1 -- 172.21.15.96:0/2548428463 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc1300534a0 con 0x7fc13c0f5430 2022-02-02T21:11:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:11:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:11:58.186 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:11:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:11:58.187 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:11:58.187 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:11:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:11:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:11:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:11:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:11:58.188 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:11:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:11:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:11:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:11:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:11:58.189 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:11:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:11:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:11:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:11:58.190 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:11:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:11:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:11:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:11:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:11:58.191 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:11:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:11:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:11:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:11:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:11:58.193 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:11:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:11:58.194 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:58.194 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:58.195 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:11:58.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:11:58.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:58.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:58.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:11:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 msgr2=0x7fc1240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 0x7fc1240672e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fc12c004630 tx=0x7fc12c009b30).stop 2022-02-02T21:11:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 msgr2=0x7fc13c109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:11:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 rx=0x7fc130002700 tx=0x7fc130009d80).stop 2022-02-02T21:11:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 shutdown_connections 2022-02-02T21:11:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc124064e20 0x7fc1240672e0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc13c0f5430 0x7fc13c109a40 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 --2- 172.21.15.96:0/2548428463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0f66d0 0x7fc13c10bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:11:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 >> 172.21.15.96:0/2548428463 conn(0x7fc13c0f0b90 msgr2=0x7fc13c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:11:58.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 shutdown_connections 2022-02-02T21:11:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:11:58.186+0000 7fc13b59e700 1 -- 172.21.15.96:0/2548428463 wait complete. 2022-02-02T21:11:58.200 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:11:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:58 smithi096 ceph-mon[101353]: from='client.39330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:58 smithi096 ceph-mon[101353]: from='client.39334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:58 smithi096 ceph-mon[101353]: pgmap v5096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:58.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4165452200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:11:58.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:11:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2548428463' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:11:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:58 smithi159 ceph-mon[69013]: from='client.39330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:58 smithi159 ceph-mon[69013]: from='client.39334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:11:58.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:58 smithi159 ceph-mon[69013]: pgmap v5096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:11:58.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4165452200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:11:58.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:11:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2548428463' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:12:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:00 smithi159 ceph-mon[69013]: pgmap v5097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:00 smithi096 ceph-mon[101353]: pgmap v5097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:02 smithi096 ceph-mon[101353]: pgmap v5098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:02 smithi159 ceph-mon[69013]: pgmap v5098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:04 smithi159 ceph-mon[69013]: pgmap v5099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:04 smithi096 ceph-mon[101353]: pgmap v5099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:06 smithi159 ceph-mon[69013]: pgmap v5100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:07.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:06 smithi096 ceph-mon[101353]: pgmap v5100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:08 smithi159 ceph-mon[69013]: pgmap v5101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:08 smithi096 ceph-mon[101353]: pgmap v5101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:10 smithi159 ceph-mon[69013]: pgmap v5102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:10 smithi096 ceph-mon[101353]: pgmap v5102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:12 smithi096 ceph-mon[101353]: pgmap v5103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:12 smithi159 ceph-mon[69013]: pgmap v5103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:14 smithi159 ceph-mon[69013]: pgmap v5104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:14 smithi096 ceph-mon[101353]: pgmap v5104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:16 smithi159 ceph-mon[69013]: pgmap v5105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:16 smithi096 ceph-mon[101353]: pgmap v5105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:18.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:18 smithi159 ceph-mon[69013]: pgmap v5106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:18 smithi096 ceph-mon[101353]: pgmap v5106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:20 smithi159 ceph-mon[69013]: pgmap v5107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:20 smithi096 ceph-mon[101353]: pgmap v5107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:22 smithi096 ceph-mon[101353]: pgmap v5108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:22 smithi159 ceph-mon[69013]: pgmap v5108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:24 smithi159 ceph-mon[69013]: pgmap v5109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:24 smithi096 ceph-mon[101353]: pgmap v5109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:26 smithi159 ceph-mon[69013]: pgmap v5110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:26 smithi096 ceph-mon[101353]: pgmap v5110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 -- 172.21.15.96:0/2466161160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f66e0 msgr2=0x7f24d40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/2466161160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f66e0 0x7f24d40f6b00 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 rx=0x7f24c8004660 tx=0x7f24c8009b30).stop 2022-02-02T21:12:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 -- 172.21.15.96:0/2466161160 shutdown_connections 2022-02-02T21:12:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/2466161160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f7980 0x7f24d40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:12:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/2466161160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f66e0 0x7f24d40f6b00 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 -- 172.21.15.96:0/2466161160 >> 172.21.15.96:0/2466161160 conn(0x7f24d40f1e40 msgr2=0x7f24d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 -- 172.21.15.96:0/2466161160 shutdown_connections 2022-02-02T21:12:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.297+0000 7f24d8e8f700 1 -- 172.21.15.96:0/2466161160 wait complete. 2022-02-02T21:12:28.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 Processor -- start 2022-02-02T21:12:28.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 -- start start 2022-02-02T21:12:28.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f66e0 0x7f24d4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4107ae0 con 0x7f24d40f7980 2022-02-02T21:12:28.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d8e8f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4108390 con 0x7f24d40f66e0 2022-02-02T21:12:28.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41450/0 (socket says 172.21.15.96:41450) 2022-02-02T21:12:28.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 -- 172.21.15.96:0/661859571 learned_addr learned my addr 172.21.15.96:0/661859571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:28.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d259c700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f66e0 0x7f24d4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 -- 172.21.15.96:0/661859571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f66e0 msgr2=0x7f24d4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f66e0 0x7f24d4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.298+0000 7f24d1d9b700 1 -- 172.21.15.96:0/661859571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8005040 con 0x7f24d40f7980 2022-02-02T21:12:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24d1d9b700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 rx=0x7f24c400b410 tx=0x7f24c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c40125f0 con 0x7f24d40f7980 2022-02-02T21:12:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24c400be30 con 0x7f24d40f7980 2022-02-02T21:12:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c4002a70 con 0x7f24d40f7980 2022-02-02T21:12:28.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d4108670 con 0x7f24d40f7980 2022-02-02T21:12:28.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.299+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d4108c30 con 0x7f24d40f7980 2022-02-02T21:12:28.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.300+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d40f5ad0 con 0x7f24d40f7980 2022-02-02T21:12:28.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.300+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24c400f030 con 0x7f24d40f7980 2022-02-02T21:12:28.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.300+0000 7f24c2ffd700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 0x7f24bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.301+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f24c4081e80 con 0x7f24d40f7980 2022-02-02T21:12:28.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.301+0000 7f24d259c700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 0x7f24bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.301+0000 7f24d259c700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 0x7f24bc067290 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f24c8004630 tx=0x7f24c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.305+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24c40539b0 con 0x7f24d40f7980 2022-02-02T21:12:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.486+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d40fef90 con 0x7f24bc064dd0 2022-02-02T21:12:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.487+0000 7f24c2ffd700 1 -- 172.21.15.96:0/661859571 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f24d40fef90 con 0x7f24bc064dd0 2022-02-02T21:12:28.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 msgr2=0x7f24bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 0x7f24bc067290 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f24c8004630 tx=0x7f24c8009b30).stop 2022-02-02T21:12:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 msgr2=0x7f24d41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 rx=0x7f24c400b410 tx=0x7f24c4006ef0).stop 2022-02-02T21:12:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 shutdown_connections 2022-02-02T21:12:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24bc064dd0 0x7f24bc067290 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d40f66e0 0x7f24d4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 --2- 172.21.15.96:0/661859571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24d40f7980 0x7f24d41074a0 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 >> 172.21.15.96:0/661859571 conn(0x7f24d40f1e40 msgr2=0x7f24d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:28.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 shutdown_connections 2022-02-02T21:12:28.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.489+0000 7f24d8e8f700 1 -- 172.21.15.96:0/661859571 wait complete. 2022-02-02T21:12:28.500 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:12:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:12:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:12:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:28 smithi096 ceph-mon[101353]: pgmap v5111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 -- 172.21.15.96:0/2731511021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f66e0 msgr2=0x7fc80c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 --2- 172.21.15.96:0/2731511021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f66e0 0x7fc80c0f6b00 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 rx=0x7fc7fc004660 tx=0x7fc7fc009b30).stop 2022-02-02T21:12:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 -- 172.21.15.96:0/2731511021 shutdown_connections 2022-02-02T21:12:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 --2- 172.21.15.96:0/2731511021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f7980 0x7fc80c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 --2- 172.21.15.96:0/2731511021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f66e0 0x7fc80c0f6b00 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 -- 172.21.15.96:0/2731511021 >> 172.21.15.96:0/2731511021 conn(0x7fc80c0f1e40 msgr2=0x7fc80c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 -- 172.21.15.96:0/2731511021 shutdown_connections 2022-02-02T21:12:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.587+0000 7fc810954700 1 -- 172.21.15.96:0/2731511021 wait complete. 2022-02-02T21:12:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 Processor -- start 2022-02-02T21:12:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 -- start start 2022-02-02T21:12:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 0x7fc80c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c06a380 con 0x7fc80c0f7980 2022-02-02T21:12:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c06a4c0 con 0x7fc80c0f66e0 2022-02-02T21:12:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41460/0 (socket says 172.21.15.96:41460) 2022-02-02T21:12:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 -- 172.21.15.96:0/3416170884 learned_addr learned my addr 172.21.15.96:0/3416170884 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:28.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc80a59c700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 0x7fc80c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 -- 172.21.15.96:0/3416170884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 msgr2=0x7fc80c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 0x7fc80c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 -- 172.21.15.96:0/3416170884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc005040 con 0x7fc80c0f7980 2022-02-02T21:12:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc80a59c700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 0x7fc80c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:12:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc809d9b700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 rx=0x7fc8000026d0 tx=0x7fc800009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc800009320 con 0x7fc80c0f7980 2022-02-02T21:12:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc80000f040 con 0x7fc80c0f7980 2022-02-02T21:12:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c06a7a0 con 0x7fc80c0f7980 2022-02-02T21:12:28.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.588+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8000147e0 con 0x7fc80c0f7980 2022-02-02T21:12:28.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.589+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c10efe0 con 0x7fc80c0f7980 2022-02-02T21:12:28.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.589+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c045ad0 con 0x7fc80c0f7980 2022-02-02T21:12:28.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.590+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc800009480 con 0x7fc80c0f7980 2022-02-02T21:12:28.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.591+0000 7fc7faffd700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 0x7fc7f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.591+0000 7fc80a59c700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 0x7fc7f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.591+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc800082470 con 0x7fc80c0f7980 2022-02-02T21:12:28.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.591+0000 7fc80a59c700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 0x7fc7f4067290 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fc7fc004e30 tx=0x7fc7fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.594+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8000506b0 con 0x7fc80c0f7980 2022-02-02T21:12:28.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.768+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc80c0ff050 con 0x7fc7f4064dd0 2022-02-02T21:12:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:12:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:12:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:28 smithi159 ceph-mon[69013]: pgmap v5111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:28.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.777+0000 7fc7faffd700 1 -- 172.21.15.96:0/3416170884 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc7fc013410 con 0x7fc7f4064dd0 2022-02-02T21:12:28.779 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:12:28.779 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:12:28.779 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:12:28.779 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:12:28.780 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:12:28.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:12:28.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:12:28.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:12:28.781 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:12:28.781 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:12:28.781 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:12:28.781 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:12:28.781 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:12:28.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:12:28.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:12:28.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:12:28.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:12:28.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:12:28.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:12:28.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:12:28.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:12:28.783 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:12:28.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 msgr2=0x7fc7f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 0x7fc7f4067290 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fc7fc004e30 tx=0x7fc7fc009b30).stop 2022-02-02T21:12:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 msgr2=0x7fc80c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 rx=0x7fc8000026d0 tx=0x7fc800009de0).stop 2022-02-02T21:12:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 shutdown_connections 2022-02-02T21:12:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc7f4064dd0 0x7fc7f4067290 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc80c0f66e0 0x7fc80c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 --2- 172.21.15.96:0/3416170884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc80c0f7980 0x7fc80c069e20 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 >> 172.21.15.96:0/3416170884 conn(0x7fc80c0f1e40 msgr2=0x7fc80c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 shutdown_connections 2022-02-02T21:12:28.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.780+0000 7fc810954700 1 -- 172.21.15.96:0/3416170884 wait complete. 2022-02-02T21:12:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 -- 172.21.15.96:0/1323841059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66d0 msgr2=0x7fb00c0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 --2- 172.21.15.96:0/1323841059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66d0 0x7fb00c0f6af0 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 rx=0x7fb000004660 tx=0x7fb000009b30).stop 2022-02-02T21:12:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 -- 172.21.15.96:0/1323841059 shutdown_connections 2022-02-02T21:12:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 --2- 172.21.15.96:0/1323841059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f7970 0x7fb00c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 --2- 172.21.15.96:0/1323841059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f66d0 0x7fb00c0f6af0 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 -- 172.21.15.96:0/1323841059 >> 172.21.15.96:0/1323841059 conn(0x7fb00c0f1e50 msgr2=0x7fb00c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 -- 172.21.15.96:0/1323841059 shutdown_connections 2022-02-02T21:12:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.876+0000 7fb010928700 1 -- 172.21.15.96:0/1323841059 wait complete. 2022-02-02T21:12:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 Processor -- start 2022-02-02T21:12:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 -- start start 2022-02-02T21:12:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66d0 0x7fb00c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c107a20 con 0x7fb00c0f7970 2022-02-02T21:12:28.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb010928700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c107b60 con 0x7fb00c0f66d0 2022-02-02T21:12:28.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb009d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb009d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41468/0 (socket says 172.21.15.96:41468) 2022-02-02T21:12:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb009d9b700 1 -- 172.21.15.96:0/2930575965 learned_addr learned my addr 172.21.15.96:0/2930575965 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.877+0000 7fb00a59c700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66d0 0x7fb00c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb009d9b700 1 -- 172.21.15.96:0/2930575965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66d0 msgr2=0x7fb00c106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb009d9b700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66d0 0x7fb00c106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb009d9b700 1 -- 172.21.15.96:0/2930575965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000005040 con 0x7fb00c0f7970 2022-02-02T21:12:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb009d9b700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 rx=0x7faffc0049b0 tx=0x7faffc007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc013070 con 0x7fb00c0f7970 2022-02-02T21:12:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c108500 con 0x7fb00c0f7970 2022-02-02T21:12:28.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faffc00e2e0 con 0x7fb00c0f7970 2022-02-02T21:12:28.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc00c950 con 0x7fb00c0f7970 2022-02-02T21:12:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.878+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c108ac0 con 0x7fb00c0f7970 2022-02-02T21:12:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.879+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c045ad0 con 0x7fb00c0f7970 2022-02-02T21:12:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.880+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faffc00cc10 con 0x7fb00c0f7970 2022-02-02T21:12:28.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.880+0000 7faffaffd700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:28.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.880+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faffc086040 con 0x7fb00c0f7970 2022-02-02T21:12:28.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.880+0000 7fb00a59c700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:28.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.880+0000 7fb00a59c700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fb000004630 tx=0x7fb000009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:28.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:28.884+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faffc057b10 con 0x7fb00c0f7970 2022-02-02T21:12:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.116+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb00c027a00 con 0x7fb00c0f7970 2022-02-02T21:12:29.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.117+0000 7faffaffd700 1 -- 172.21.15.96:0/2930575965 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faffc057700 con 0x7fb00c0f7970 2022-02-02T21:12:29.119 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:12:29.119 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:12:29.119 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:12:29.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:12:29.120 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:12:29.120 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:12:29.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:12:29.120 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:12:29.121 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:12:29.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:12:29.121 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:12:29.121 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:12:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:12:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:12:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:12:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:12:29.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:12:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:12:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 msgr2=0x7faff4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fb000004630 tx=0x7fb000009b30).stop 2022-02-02T21:12:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 msgr2=0x7fb00c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:29.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 rx=0x7faffc0049b0 tx=0x7faffc007eb0).stop 2022-02-02T21:12:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 shutdown_connections 2022-02-02T21:12:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faff4064dd0 0x7faff4067290 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00c0f66d0 0x7fb00c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 --2- 172.21.15.96:0/2930575965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c0f7970 0x7fb00c107470 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 >> 172.21.15.96:0/2930575965 conn(0x7fb00c0f1e50 msgr2=0x7fb00c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:29.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 shutdown_connections 2022-02-02T21:12:29.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.119+0000 7fb010928700 1 -- 172.21.15.96:0/2930575965 wait complete. 2022-02-02T21:12:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 -- 172.21.15.96:0/3963213990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f77d0 msgr2=0x7ff9840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 --2- 172.21.15.96:0/3963213990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f77d0 0x7ff9840f7c30 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 rx=0x7ff974004660 tx=0x7ff974009b30).stop 2022-02-02T21:12:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 -- 172.21.15.96:0/3963213990 shutdown_connections 2022-02-02T21:12:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 --2- 172.21.15.96:0/3963213990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f77d0 0x7ff9840f7c30 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 --2- 172.21.15.96:0/3963213990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9840f6530 0x7ff9840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.216+0000 7ff9897c2700 1 -- 172.21.15.96:0/3963213990 >> 172.21.15.96:0/3963213990 conn(0x7ff9840f1c90 msgr2=0x7ff9840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.217+0000 7ff9897c2700 1 -- 172.21.15.96:0/3963213990 shutdown_connections 2022-02-02T21:12:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.217+0000 7ff9897c2700 1 -- 172.21.15.96:0/3963213990 wait complete. 2022-02-02T21:12:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.217+0000 7ff9897c2700 1 Processor -- start 2022-02-02T21:12:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.217+0000 7ff9897c2700 1 -- start start 2022-02-02T21:12:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9840f77d0 0x7ff984107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9841077f0 con 0x7ff9840f6530 2022-02-02T21:12:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984107ff0 con 0x7ff9840f77d0 2022-02-02T21:12:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41476/0 (socket says 172.21.15.96:41476) 2022-02-02T21:12:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 -- 172.21.15.96:0/1615182671 learned_addr learned my addr 172.21.15.96:0/1615182671 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 -- 172.21.15.96:0/1615182671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9840f77d0 msgr2=0x7ff984107240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T21:12:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9840f77d0 0x7ff984107240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:12:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 -- 172.21.15.96:0/1615182671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974005040 con 0x7ff9840f6530 2022-02-02T21:12:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff983fff700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 rx=0x7ff97800c790 tx=0x7ff978007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97800e680 con 0x7ff9840f6530 2022-02-02T21:12:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff97800ec90 con 0x7ff9840f6530 2022-02-02T21:12:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9841082d0 con 0x7ff9840f6530 2022-02-02T21:12:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff978012d00 con 0x7ff9840f6530 2022-02-02T21:12:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.218+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984108890 con 0x7ff9840f6530 2022-02-02T21:12:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.220+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff964004fa0 con 0x7ff9840f6530 2022-02-02T21:12:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.220+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff978010070 con 0x7ff9840f6530 2022-02-02T21:12:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.220+0000 7ff980ff9700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 0x7ff96c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.220+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff978081a30 con 0x7ff9840f6530 2022-02-02T21:12:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.220+0000 7ff9837fe700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 0x7ff96c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.221+0000 7ff9837fe700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 0x7ff96c0672e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7ff974004e30 tx=0x7ff974009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.224+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff978053560 con 0x7ff9840f6530 2022-02-02T21:12:29.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.431+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff964005e80 con 0x7ff9840f6530 2022-02-02T21:12:29.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.432+0000 7ff980ff9700 1 -- 172.21.15.96:0/1615182671 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff97800ee00 con 0x7ff9840f6530 2022-02-02T21:12:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:12:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:12:29.434 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:12:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:12:29.435 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:12:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:12:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:12:29.435 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:12:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:12:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:12:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:12:29.436 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:12:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:12:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:12:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:12:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:12:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:12:29.438 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:12:29.438 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:12:29.439 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:12:29.439 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:12:29.440 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:12:29.440 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:12:29.440 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:12:29.441 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:12:29.441 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:12:29.442 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:12:29.442 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:12:29.442 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:12:29.443 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:12:29.443 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:12:29.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:12:29.444 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:12:29.445 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:12:29.445 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:12:29.445 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:12:29.446 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:12:29.446 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:12:29.446 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:12:29.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 msgr2=0x7ff96c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 0x7ff96c0672e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7ff974004e30 tx=0x7ff974009b30).stop 2022-02-02T21:12:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 msgr2=0x7ff984106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 rx=0x7ff97800c790 tx=0x7ff978007d90).stop 2022-02-02T21:12:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 shutdown_connections 2022-02-02T21:12:29.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff96c064e20 0x7ff96c0672e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9840f6530 0x7ff984106d50 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 --2- 172.21.15.96:0/1615182671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9840f77d0 0x7ff984107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:12:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 >> 172.21.15.96:0/1615182671 conn(0x7ff9840f1c90 msgr2=0x7ff9840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 shutdown_connections 2022-02-02T21:12:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:29.434+0000 7ff9897c2700 1 -- 172.21.15.96:0/1615182671 wait complete. 2022-02-02T21:12:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:12:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:29 smithi096 ceph-mon[101353]: from='client.39346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:12:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:29 smithi096 ceph-mon[101353]: from='client.39350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:12:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2930575965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:12:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:29 smithi159 ceph-mon[69013]: from='client.39346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:12:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:29 smithi159 ceph-mon[69013]: from='client.39350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:12:29.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2930575965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:12:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1615182671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:12:30.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:30 smithi159 ceph-mon[69013]: pgmap v5112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1615182671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:12:30.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:30 smithi096 ceph-mon[101353]: pgmap v5112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:32 smithi096 ceph-mon[101353]: pgmap v5113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:32 smithi159 ceph-mon[69013]: pgmap v5113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:34 smithi159 ceph-mon[69013]: pgmap v5114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:34 smithi096 ceph-mon[101353]: pgmap v5114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:36 smithi159 ceph-mon[69013]: pgmap v5115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:36 smithi096 ceph-mon[101353]: pgmap v5115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:38 smithi159 ceph-mon[69013]: pgmap v5116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:38 smithi096 ceph-mon[101353]: pgmap v5116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:40 smithi159 ceph-mon[69013]: pgmap v5117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:40 smithi096 ceph-mon[101353]: pgmap v5117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:42 smithi096 ceph-mon[101353]: pgmap v5118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:42 smithi159 ceph-mon[69013]: pgmap v5118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:44 smithi159 ceph-mon[69013]: pgmap v5119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:44 smithi096 ceph-mon[101353]: pgmap v5119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:46 smithi159 ceph-mon[69013]: pgmap v5120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:46 smithi096 ceph-mon[101353]: pgmap v5120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:48 smithi159 ceph-mon[69013]: pgmap v5121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:48.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:48 smithi096 ceph-mon[101353]: pgmap v5121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:50 smithi159 ceph-mon[69013]: pgmap v5122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:50 smithi096 ceph-mon[101353]: pgmap v5122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:52 smithi096 ceph-mon[101353]: pgmap v5123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:52 smithi159 ceph-mon[69013]: pgmap v5123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:54 smithi159 ceph-mon[69013]: pgmap v5124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:54 smithi096 ceph-mon[101353]: pgmap v5124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:56 smithi159 ceph-mon[69013]: pgmap v5125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:56 smithi096 ceph-mon[101353]: pgmap v5125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:12:58 smithi159 ceph-mon[69013]: pgmap v5126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:58.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:12:58 smithi096 ceph-mon[101353]: pgmap v5126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:12:59.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 -- 172.21.15.96:0/1973621046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 msgr2=0x7fd0940fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 --2- 172.21.15.96:0/1973621046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd0940fb520 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 rx=0x7fd090004660 tx=0x7fd090009b30).stop 2022-02-02T21:12:59.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 -- 172.21.15.96:0/1973621046 shutdown_connections 2022-02-02T21:12:59.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 --2- 172.21.15.96:0/1973621046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd0940fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:12:59.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 --2- 172.21.15.96:0/1973621046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd0940fb520 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 -- 172.21.15.96:0/1973621046 >> 172.21.15.96:0/1973621046 conn(0x7fd0940f0ba0 msgr2=0x7fd0940f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:59.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 -- 172.21.15.96:0/1973621046 shutdown_connections 2022-02-02T21:12:59.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.545+0000 7fd09ad77700 1 -- 172.21.15.96:0/1973621046 wait complete. 2022-02-02T21:12:59.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 Processor -- start 2022-02-02T21:12:59.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 -- start start 2022-02-02T21:12:59.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd094109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd094109ab0 con 0x7fd094060310 2022-02-02T21:12:59.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd09ad77700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09410a360 con 0x7fd0940fba10 2022-02-02T21:12:59.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41498/0 (socket says 172.21.15.96:41498) 2022-02-02T21:12:59.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 -- 172.21.15.96:0/2973034760 learned_addr learned my addr 172.21.15.96:0/2973034760 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:59.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099574700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd094109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 -- 172.21.15.96:0/2973034760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 msgr2=0x7fd094109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd094109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 -- 172.21.15.96:0/2973034760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090005040 con 0x7fd094060310 2022-02-02T21:12:59.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099574700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd094109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:12:59.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd099d75700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 rx=0x7fd090009990 tx=0x7fd090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:59.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.546+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd090018070 con 0x7fd094060310 2022-02-02T21:12:59.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.547+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09410a5e0 con 0x7fd094060310 2022-02-02T21:12:59.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.547+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd090007ca0 con 0x7fd094060310 2022-02-02T21:12:59.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.547+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09001c600 con 0x7fd094060310 2022-02-02T21:12:59.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.547+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09410ab40 con 0x7fd094060310 2022-02-02T21:12:59.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.548+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd094059100 con 0x7fd094060310 2022-02-02T21:12:59.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.548+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd09001d9d0 con 0x7fd094060310 2022-02-02T21:12:59.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.548+0000 7fd08a7fc700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 0x7fd0800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.549+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd090083350 con 0x7fd094060310 2022-02-02T21:12:59.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.549+0000 7fd099574700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 0x7fd0800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.549+0000 7fd099574700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 0x7fd0800672e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd0940600e0 tx=0x7fd084008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:59.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.553+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd090054e80 con 0x7fd094060310 2022-02-02T21:12:59.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.729+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0941010a0 con 0x7fd080064e20 2022-02-02T21:12:59.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.730+0000 7fd08a7fc700 1 -- 172.21.15.96:0/2973034760 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd0941010a0 con 0x7fd080064e20 2022-02-02T21:12:59.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 msgr2=0x7fd0800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 0x7fd0800672e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd0940600e0 tx=0x7fd084008040).stop 2022-02-02T21:12:59.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 msgr2=0x7fd094108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 rx=0x7fd090009990 tx=0x7fd090009b30).stop 2022-02-02T21:12:59.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 shutdown_connections 2022-02-02T21:12:59.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd080064e20 0x7fd0800672e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd094060310 0x7fd094108f80 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 --2- 172.21.15.96:0/2973034760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0940fba10 0x7fd094109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 >> 172.21.15.96:0/2973034760 conn(0x7fd0940f0ba0 msgr2=0x7fd0940f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:59.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 shutdown_connections 2022-02-02T21:12:59.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.732+0000 7fd09ad77700 1 -- 172.21.15.96:0/2973034760 wait complete. 2022-02-02T21:12:59.743 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:12:59.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 -- 172.21.15.96:0/3097654935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f6530 msgr2=0x7fcc580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 --2- 172.21.15.96:0/3097654935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f6530 0x7fcc580f6950 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 rx=0x7fcc48004660 tx=0x7fcc48009b30).stop 2022-02-02T21:12:59.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 -- 172.21.15.96:0/3097654935 shutdown_connections 2022-02-02T21:12:59.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 --2- 172.21.15.96:0/3097654935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f77d0 0x7fcc580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:12:59.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 --2- 172.21.15.96:0/3097654935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f6530 0x7fcc580f6950 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 -- 172.21.15.96:0/3097654935 >> 172.21.15.96:0/3097654935 conn(0x7fcc580f1c90 msgr2=0x7fcc580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:12:59.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 -- 172.21.15.96:0/3097654935 shutdown_connections 2022-02-02T21:12:59.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.829+0000 7fcc57fff700 1 -- 172.21.15.96:0/3097654935 wait complete. 2022-02-02T21:12:59.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 Processor -- start 2022-02-02T21:12:59.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 -- start start 2022-02-02T21:12:59.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f6530 0x7fcc58106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581079a0 con 0x7fcc580f77d0 2022-02-02T21:12:59.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc57fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58108120 con 0x7fcc580f6530 2022-02-02T21:12:59.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc567fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41510/0 (socket says 172.21.15.96:41510) 2022-02-02T21:12:59.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.830+0000 7fcc567fc700 1 -- 172.21.15.96:0/354049477 learned_addr learned my addr 172.21.15.96:0/354049477 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:12:59.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc56ffd700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f6530 0x7fcc58106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc567fc700 1 -- 172.21.15.96:0/354049477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f6530 msgr2=0x7fcc58106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:12:59.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc567fc700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f6530 0x7fcc58106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:12:59.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc567fc700 1 -- 172.21.15.96:0/354049477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48005040 con 0x7fcc580f77d0 2022-02-02T21:12:59.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc567fc700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 rx=0x7fcc4c00b410 tx=0x7fcc4c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:59.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4c0125f0 con 0x7fcc580f77d0 2022-02-02T21:12:59.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc581083a0 con 0x7fcc580f77d0 2022-02-02T21:12:59.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc4c00be30 con 0x7fcc580f77d0 2022-02-02T21:12:59.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4c002a70 con 0x7fcc580f77d0 2022-02-02T21:12:59.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.831+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc58108960 con 0x7fcc580f77d0 2022-02-02T21:12:59.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.832+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc58045ad0 con 0x7fcc580f77d0 2022-02-02T21:12:59.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.832+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcc4c00f030 con 0x7fcc580f77d0 2022-02-02T21:12:59.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.833+0000 7fcc3f7fe700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 0x7fcc400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:12:59.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.833+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcc4c081de0 con 0x7fcc580f77d0 2022-02-02T21:12:59.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.833+0000 7fcc56ffd700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 0x7fcc400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:12:59.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.833+0000 7fcc56ffd700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 0x7fcc400672e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fcc48013690 tx=0x7fcc48009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:12:59.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:12:59.837+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcc4c04fee0 con 0x7fcc580f77d0 2022-02-02T21:13:00.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.009+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc580fef20 con 0x7fcc40064e20 2022-02-02T21:13:00.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.018+0000 7fcc3f7fe700 1 -- 172.21.15.96:0/354049477 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcc48019040 con 0x7fcc40064e20 2022-02-02T21:13:00.020 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:13:00.021 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:13:00.021 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:13:00.021 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:13:00.021 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:13:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:13:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:13:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:13:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:13:00.023 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:13:00.023 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:13:00.023 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:13:00.023 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:13:00.024 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:13:00.024 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:13:00.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:13:00.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:13:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:13:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:13:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:13:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:13:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:13:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 msgr2=0x7fcc400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 0x7fcc400672e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fcc48013690 tx=0x7fcc48009b30).stop 2022-02-02T21:13:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 msgr2=0x7fcc58107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 rx=0x7fcc4c00b410 tx=0x7fcc4c006ef0).stop 2022-02-02T21:13:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 shutdown_connections 2022-02-02T21:13:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcc40064e20 0x7fcc400672e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc580f6530 0x7fcc58106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 --2- 172.21.15.96:0/354049477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc580f77d0 0x7fcc58107310 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 >> 172.21.15.96:0/354049477 conn(0x7fcc580f1c90 msgr2=0x7fcc580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 shutdown_connections 2022-02-02T21:13:00.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.020+0000 7fcc57fff700 1 -- 172.21.15.96:0/354049477 wait complete. 2022-02-02T21:13:00.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 -- 172.21.15.96:0/1821270581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f66e0 msgr2=0x7f39940f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 --2- 172.21.15.96:0/1821270581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f66e0 0x7f39940f6b40 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 rx=0x7f3984004660 tx=0x7f3984009b30).stop 2022-02-02T21:13:00.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 -- 172.21.15.96:0/1821270581 shutdown_connections 2022-02-02T21:13:00.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 --2- 172.21.15.96:0/1821270581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f66e0 0x7f39940f6b40 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 --2- 172.21.15.96:0/1821270581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f5440 0x7f39940f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:13:00.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.116+0000 7f399957b700 1 -- 172.21.15.96:0/1821270581 >> 172.21.15.96:0/1821270581 conn(0x7f39940f0ba0 msgr2=0x7f39940f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:00.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 -- 172.21.15.96:0/1821270581 shutdown_connections 2022-02-02T21:13:00.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 -- 172.21.15.96:0/1821270581 wait complete. 2022-02-02T21:13:00.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 Processor -- start 2022-02-02T21:13:00.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 -- start start 2022-02-02T21:13:00.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f66e0 0x7f399410bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994060450 con 0x7f39940f5440 2022-02-02T21:13:00.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.117+0000 7f399957b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994060590 con 0x7f39940f66e0 2022-02-02T21:13:00.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41518/0 (socket says 172.21.15.96:41518) 2022-02-02T21:13:00.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 -- 172.21.15.96:0/3922938363 learned_addr learned my addr 172.21.15.96:0/3922938363 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:00.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f39937fe700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f66e0 0x7f399410bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 -- 172.21.15.96:0/3922938363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f66e0 msgr2=0x7f399410bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f66e0 0x7f399410bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 -- 172.21.15.96:0/3922938363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984005040 con 0x7f39940f5440 2022-02-02T21:13:00.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3993fff700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 rx=0x7f39880093f0 tx=0x7f3988006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:00.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3988013640 con 0x7f39940f5440 2022-02-02T21:13:00.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3988009e40 con 0x7f39940f5440 2022-02-02T21:13:00.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f398800dbf0 con 0x7f39940f5440 2022-02-02T21:13:00.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.118+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399410c5b0 con 0x7f39940f5440 2022-02-02T21:13:00.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.119+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399410cb20 con 0x7f39940f5440 2022-02-02T21:13:00.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.120+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994045ad0 con 0x7f39940f5440 2022-02-02T21:13:00.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.120+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f398801a060 con 0x7f39940f5440 2022-02-02T21:13:00.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.120+0000 7f3990ff9700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 0x7f397c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.120+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3988081ab0 con 0x7f39940f5440 2022-02-02T21:13:00.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.121+0000 7f39937fe700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 0x7f397c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.121+0000 7f39937fe700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 0x7f397c0672e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f3984009da0 tx=0x7f3984009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:00.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.125+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f398804fbb0 con 0x7f39940f5440 2022-02-02T21:13:00.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.353+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f39940fdde0 con 0x7f39940f5440 2022-02-02T21:13:00.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.354+0000 7f3990ff9700 1 -- 172.21.15.96:0/3922938363 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f39880531d0 con 0x7f39940f5440 2022-02-02T21:13:00.356 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:13:00.356 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:13:00.356 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:13:00.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:00.357 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:13:00.357 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:13:00.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:00.357 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:13:00.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:13:00.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:00.358 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:13:00.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:13:00.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:00.359 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:13:00.359 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:13:00.359 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:13:00.360 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:13:00.360 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:13:00.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 msgr2=0x7f397c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 0x7f397c0672e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f3984009da0 tx=0x7f3984009b30).stop 2022-02-02T21:13:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 msgr2=0x7f3994109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 rx=0x7f39880093f0 tx=0x7f3988006ec0).stop 2022-02-02T21:13:00.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 shutdown_connections 2022-02-02T21:13:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f397c064e20 0x7f397c0672e0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39940f5440 0x7f3994109aa0 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 --2- 172.21.15.96:0/3922938363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39940f66e0 0x7f399410bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.355+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 >> 172.21.15.96:0/3922938363 conn(0x7f39940f0ba0 msgr2=0x7f39940fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.356+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 shutdown_connections 2022-02-02T21:13:00.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.356+0000 7f399957b700 1 -- 172.21.15.96:0/3922938363 wait complete. 2022-02-02T21:13:00.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.453+0000 7f2393c29700 1 -- 172.21.15.96:0/3650478144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f6860 msgr2=0x7f238c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.453+0000 7f2393c29700 1 --2- 172.21.15.96:0/3650478144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f6860 0x7f238c0f6cc0 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 rx=0x7f237c004660 tx=0x7f237c009b30).stop 2022-02-02T21:13:00.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.453+0000 7f2393c29700 1 -- 172.21.15.96:0/3650478144 shutdown_connections 2022-02-02T21:13:00.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.453+0000 7f2393c29700 1 --2- 172.21.15.96:0/3650478144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f6860 0x7f238c0f6cc0 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.453+0000 7f2393c29700 1 --2- 172.21.15.96:0/3650478144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f55c0 0x7f238c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:13:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- 172.21.15.96:0/3650478144 >> 172.21.15.96:0/3650478144 conn(0x7f238c0f0d40 msgr2=0x7f238c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- 172.21.15.96:0/3650478144 shutdown_connections 2022-02-02T21:13:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- 172.21.15.96:0/3650478144 wait complete. 2022-02-02T21:13:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 Processor -- start 2022-02-02T21:13:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- start start 2022-02-02T21:13:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f6860 0x7f238c10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0602b0 con 0x7f238c0f55c0 2022-02-02T21:13:00.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.454+0000 7f2393c29700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0603f0 con 0x7f238c0f6860 2022-02-02T21:13:00.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41528/0 (socket says 172.21.15.96:41528) 2022-02-02T21:13:00.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 -- 172.21.15.96:0/1924641286 learned_addr learned my addr 172.21.15.96:0/1924641286 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:00.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23911c4700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f6860 0x7f238c10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 -- 172.21.15.96:0/1924641286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f6860 msgr2=0x7f238c10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f6860 0x7f238c10e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 -- 172.21.15.96:0/1924641286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c005040 con 0x7f238c0f55c0 2022-02-02T21:13:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23919c5700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 rx=0x7f23880093f0 tx=0x7f2388006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2388009ea0 con 0x7f238c0f55c0 2022-02-02T21:13:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2388013af0 con 0x7f238c0f55c0 2022-02-02T21:13:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238800db10 con 0x7f238c0f55c0 2022-02-02T21:13:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c10eac0 con 0x7f238c0f55c0 2022-02-02T21:13:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.455+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c10efa0 con 0x7f238c0f55c0 2022-02-02T21:13:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.456+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c045ad0 con 0x7f238c0f55c0 2022-02-02T21:13:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.457+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f238801a060 con 0x7f238c0f55c0 2022-02-02T21:13:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.458+0000 7f23827fc700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 0x7f2378067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.458+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2388081dc0 con 0x7f238c0f55c0 2022-02-02T21:13:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.458+0000 7f23911c4700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 0x7f2378067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.458+0000 7f23911c4700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 0x7f2378067290 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f237c009da0 tx=0x7f237c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.461+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f238804ff40 con 0x7f238c0f55c0 2022-02-02T21:13:00.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.662+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f238c060580 con 0x7f238c0f55c0 2022-02-02T21:13:00.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.662+0000 7f23827fc700 1 -- 172.21.15.96:0/1924641286 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2388018020 con 0x7f238c0f55c0 2022-02-02T21:13:00.664 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:13:00.665 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:13:00.665 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:13:00.665 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:13:00.665 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:00.666 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:13:00.666 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:13:00.666 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:13:00.667 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:13:00.667 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:13:00.667 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:13:00.667 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:13:00.668 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:13:00.668 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:13:00.668 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:13:00.668 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:13:00.668 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:13:00.669 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:13:00.669 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:13:00.669 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:13:00.669 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:13:00.670 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:13:00.670 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:13:00.670 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:13:00.670 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:13:00.670 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:13:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:13:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:13:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:13:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:13:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:13:00.672 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:13:00.672 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:00.672 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:00.672 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:13:00.673 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:00.673 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:00.673 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:00.673 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:00.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 msgr2=0x7f2378067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 0x7f2378067290 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f237c009da0 tx=0x7f237c009b30).stop 2022-02-02T21:13:00.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 msgr2=0x7f238c10c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:00.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 rx=0x7f23880093f0 tx=0x7f2388006ec0).stop 2022-02-02T21:13:00.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 shutdown_connections 2022-02-02T21:13:00.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2378064dd0 0x7f2378067290 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0f55c0 0x7f238c10c0d0 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 --2- 172.21.15.96:0/1924641286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f238c0f6860 0x7f238c10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:00.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.665+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 >> 172.21.15.96:0/1924641286 conn(0x7f238c0f0d40 msgr2=0x7f238c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:00.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.666+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 shutdown_connections 2022-02-02T21:13:00.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:00.666+0000 7f2393c29700 1 -- 172.21.15.96:0/1924641286 wait complete. 2022-02-02T21:13:00.677 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:13:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:00 smithi159 ceph-mon[69013]: from='client.39362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:00 smithi159 ceph-mon[69013]: pgmap v5127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:00 smithi159 ceph-mon[69013]: from='client.39366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3922938363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:13:01.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1924641286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:13:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:00 smithi096 ceph-mon[101353]: from='client.39362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:00 smithi096 ceph-mon[101353]: pgmap v5127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:00 smithi096 ceph-mon[101353]: from='client.39366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3922938363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:13:01.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1924641286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:13:03.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:02 smithi096 ceph-mon[101353]: pgmap v5128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:02 smithi159 ceph-mon[69013]: pgmap v5128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:04 smithi159 ceph-mon[69013]: pgmap v5129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:04 smithi096 ceph-mon[101353]: pgmap v5129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:06 smithi159 ceph-mon[69013]: pgmap v5130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:06 smithi096 ceph-mon[101353]: pgmap v5130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:08 smithi159 ceph-mon[69013]: pgmap v5131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:08 smithi096 ceph-mon[101353]: pgmap v5131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:10 smithi159 ceph-mon[69013]: pgmap v5132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:10 smithi096 ceph-mon[101353]: pgmap v5132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:12 smithi096 ceph-mon[101353]: pgmap v5133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:12 smithi159 ceph-mon[69013]: pgmap v5133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:14 smithi159 ceph-mon[69013]: pgmap v5134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:14 smithi096 ceph-mon[101353]: pgmap v5134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:16 smithi159 ceph-mon[69013]: pgmap v5135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:16 smithi096 ceph-mon[101353]: pgmap v5135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:18 smithi159 ceph-mon[69013]: pgmap v5136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:18 smithi096 ceph-mon[101353]: pgmap v5136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:20 smithi159 ceph-mon[69013]: pgmap v5137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:20 smithi096 ceph-mon[101353]: pgmap v5137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:22 smithi096 ceph-mon[101353]: pgmap v5138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:22 smithi159 ceph-mon[69013]: pgmap v5138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:24 smithi159 ceph-mon[69013]: pgmap v5139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:24 smithi096 ceph-mon[101353]: pgmap v5139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:26 smithi159 ceph-mon[69013]: pgmap v5140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:26 smithi096 ceph-mon[101353]: pgmap v5140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:13:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:13:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:28 smithi159 ceph-mon[69013]: pgmap v5141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:13:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:13:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:28 smithi096 ceph-mon[101353]: pgmap v5141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:30.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 -- 172.21.15.96:0/1644004371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 msgr2=0x7fdaec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:30.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 --2- 172.21.15.96:0/1644004371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec0f59e0 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 rx=0x7fdadc004660 tx=0x7fdadc009b30).stop 2022-02-02T21:13:30.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 -- 172.21.15.96:0/1644004371 shutdown_connections 2022-02-02T21:13:30.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 --2- 172.21.15.96:0/1644004371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 --2- 172.21.15.96:0/1644004371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec0f59e0 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 -- 172.21.15.96:0/1644004371 >> 172.21.15.96:0/1644004371 conn(0x7fdaec0f0d40 msgr2=0x7fdaec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:30.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 -- 172.21.15.96:0/1644004371 shutdown_connections 2022-02-02T21:13:30.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.775+0000 7fdaf2834700 1 -- 172.21.15.96:0/1644004371 wait complete. 2022-02-02T21:13:30.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 Processor -- start 2022-02-02T21:13:30.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 -- start start 2022-02-02T21:13:30.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:30.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:30.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec060420 con 0x7fdaec0f55c0 2022-02-02T21:13:30.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.776+0000 7fdaf2834700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec060560 con 0x7fdaec0f6860 2022-02-02T21:13:30.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:30.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41548/0 (socket says 172.21.15.96:41548) 2022-02-02T21:13:30.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 -- 172.21.15.96:0/3996517396 learned_addr learned my addr 172.21.15.96:0/3996517396 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:30.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdae3fff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 -- 172.21.15.96:0/3996517396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 msgr2=0x7fdaec10c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec10c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 -- 172.21.15.96:0/3996517396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc005040 con 0x7fdaec0f55c0 2022-02-02T21:13:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdae3fff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:13:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaebfff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 rx=0x7fdadc004f60 tx=0x7fdadc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:30.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdadc018070 con 0x7fdaec0f55c0 2022-02-02T21:13:30.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec10c6e0 con 0x7fdaec0f55c0 2022-02-02T21:13:30.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdadc007ba0 con 0x7fdaec0f55c0 2022-02-02T21:13:30.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdadc01c620 con 0x7fdaec0f55c0 2022-02-02T21:13:30.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.777+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec10cc10 con 0x7fdaec0f55c0 2022-02-02T21:13:30.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.779+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec0f49b0 con 0x7fdaec0f55c0 2022-02-02T21:13:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.779+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdadc01c8e0 con 0x7fdaec0f55c0 2022-02-02T21:13:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.779+0000 7fdae97fa700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 0x7fdad8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.779+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdadc083970 con 0x7fdaec0f55c0 2022-02-02T21:13:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.779+0000 7fdae3fff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 0x7fdad8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.780+0000 7fdae3fff700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 0x7fdad8067290 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fdad40041d0 tx=0x7fdad4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.784+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdadc051b30 con 0x7fdaec0f55c0 2022-02-02T21:13:30.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.963+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaec0fdf00 con 0x7fdad8064dd0 2022-02-02T21:13:30.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.964+0000 7fdae97fa700 1 -- 172.21.15.96:0/3996517396 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdaec0fdf00 con 0x7fdad8064dd0 2022-02-02T21:13:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 msgr2=0x7fdad8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 0x7fdad8067290 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fdad40041d0 tx=0x7fdad4009040).stop 2022-02-02T21:13:30.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 msgr2=0x7fdaec109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 rx=0x7fdadc004f60 tx=0x7fdadc009b30).stop 2022-02-02T21:13:30.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 shutdown_connections 2022-02-02T21:13:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdad8064dd0 0x7fdad8067290 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaec0f55c0 0x7fdaec109c30 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 --2- 172.21.15.96:0/3996517396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaec0f6860 0x7fdaec10c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:30.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 >> 172.21.15.96:0/3996517396 conn(0x7fdaec0f0d40 msgr2=0x7fdaec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 shutdown_connections 2022-02-02T21:13:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:30.966+0000 7fdaf2834700 1 -- 172.21.15.96:0/3996517396 wait complete. 2022-02-02T21:13:30.978 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:13:31.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:30 smithi096 ceph-mon[101353]: pgmap v5142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 -- 172.21.15.96:0/1264612184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 msgr2=0x7f64840f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 --2- 172.21.15.96:0/1264612184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f64840f6b00 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 rx=0x7f6478004660 tx=0x7f6478009b30).stop 2022-02-02T21:13:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 -- 172.21.15.96:0/1264612184 shutdown_connections 2022-02-02T21:13:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 --2- 172.21.15.96:0/1264612184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64840f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:13:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 --2- 172.21.15.96:0/1264612184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f64840f6b00 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 -- 172.21.15.96:0/1264612184 >> 172.21.15.96:0/1264612184 conn(0x7f64840f1e40 msgr2=0x7f64840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 -- 172.21.15.96:0/1264612184 shutdown_connections 2022-02-02T21:13:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 -- 172.21.15.96:0/1264612184 wait complete. 2022-02-02T21:13:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.063+0000 7f6488b02700 1 Processor -- start 2022-02-02T21:13:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6488b02700 1 -- start start 2022-02-02T21:13:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6488b02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6488b02700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64841074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6488b02700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484107ae0 con 0x7f64840f66e0 2022-02-02T21:13:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6488b02700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484108390 con 0x7f64840f7980 2022-02-02T21:13:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41558/0 (socket says 172.21.15.96:41558) 2022-02-02T21:13:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 -- 172.21.15.96:0/974629854 learned_addr learned my addr 172.21.15.96:0/974629854 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6481d9b700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64841074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 -- 172.21.15.96:0/974629854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 msgr2=0x7f64841074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64841074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 -- 172.21.15.96:0/974629854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478005040 con 0x7f64840f66e0 2022-02-02T21:13:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6481d9b700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:13:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f648259c700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 rx=0x7f6478004f60 tx=0x7f6478009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.064+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6478018070 con 0x7f64840f66e0 2022-02-02T21:13:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.065+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6484108610 con 0x7f64840f66e0 2022-02-02T21:13:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.065+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6478007ba0 con 0x7f64840f66e0 2022-02-02T21:13:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.065+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647801c620 con 0x7f64840f66e0 2022-02-02T21:13:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.065+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6484108b70 con 0x7f64840f66e0 2022-02-02T21:13:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.066+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64840f5ad0 con 0x7f64840f66e0 2022-02-02T21:13:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.066+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f647801d420 con 0x7f64840f66e0 2022-02-02T21:13:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.066+0000 7f6472ffd700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 0x7f646c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.066+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6478083890 con 0x7f64840f66e0 2022-02-02T21:13:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.066+0000 7f6481d9b700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 0x7f646c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.067+0000 7f6481d9b700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 0x7f646c067290 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f647400b830 tx=0x7f6474008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.071+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6478055480 con 0x7f64840f66e0 2022-02-02T21:13:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.244+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64840ff010 con 0x7f646c064dd0 2022-02-02T21:13:31.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.253+0000 7f6472ffd700 1 -- 172.21.15.96:0/974629854 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f64840ff010 con 0x7f646c064dd0 2022-02-02T21:13:31.256 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:13:31.256 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:13:31.256 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:13:31.257 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:13:31.257 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:13:31.257 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:13:31.257 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:13:31.257 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:13:31.258 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:13:31.258 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:13:31.258 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:13:31.258 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:13:31.259 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:13:31.259 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:13:31.259 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:13:31.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:13:31.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:13:31.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:13:31.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:13:31.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:13:31.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:13:31.261 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:13:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 msgr2=0x7f646c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 0x7f646c067290 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f647400b830 tx=0x7f6474008040).stop 2022-02-02T21:13:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 msgr2=0x7f6484106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 rx=0x7f6478004f60 tx=0x7f6478009b30).stop 2022-02-02T21:13:31.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 shutdown_connections 2022-02-02T21:13:31.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f646c064dd0 0x7f646c067290 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64840f66e0 0x7f6484106fb0 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 --2- 172.21.15.96:0/974629854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64840f7980 0x7f64841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 >> 172.21.15.96:0/974629854 conn(0x7f64840f1e40 msgr2=0x7f64840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 shutdown_connections 2022-02-02T21:13:31.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.255+0000 7f6488b02700 1 -- 172.21.15.96:0/974629854 wait complete. 2022-02-02T21:13:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:30 smithi159 ceph-mon[69013]: pgmap v5142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:31.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 -- 172.21.15.96:0/894916335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f66e0 msgr2=0x7f30540f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 --2- 172.21.15.96:0/894916335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f66e0 0x7f30540f6b40 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 rx=0x7f3044004660 tx=0x7f3044009b30).stop 2022-02-02T21:13:31.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 -- 172.21.15.96:0/894916335 shutdown_connections 2022-02-02T21:13:31.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 --2- 172.21.15.96:0/894916335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f66e0 0x7f30540f6b40 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 --2- 172.21.15.96:0/894916335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f5440 0x7f30540f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:13:31.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 -- 172.21.15.96:0/894916335 >> 172.21.15.96:0/894916335 conn(0x7f30540f0ba0 msgr2=0x7f30540f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 -- 172.21.15.96:0/894916335 shutdown_connections 2022-02-02T21:13:31.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 -- 172.21.15.96:0/894916335 wait complete. 2022-02-02T21:13:31.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.353+0000 7f30589f5700 1 Processor -- start 2022-02-02T21:13:31.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30589f5700 1 -- start start 2022-02-02T21:13:31.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30589f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30589f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f66e0 0x7f305410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30589f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054060470 con 0x7f30540f5440 2022-02-02T21:13:31.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30589f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540605b0 con 0x7f30540f66e0 2022-02-02T21:13:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41568/0 (socket says 172.21.15.96:41568) 2022-02-02T21:13:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30537fe700 1 -- 172.21.15.96:0/679399279 learned_addr learned my addr 172.21.15.96:0/679399279 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f3052ffd700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f66e0 0x7f305410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.354+0000 7f30537fe700 1 -- 172.21.15.96:0/679399279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f66e0 msgr2=0x7f305410bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f30537fe700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f66e0 0x7f305410bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f30537fe700 1 -- 172.21.15.96:0/679399279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044005040 con 0x7f30540f5440 2022-02-02T21:13:31.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f30537fe700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 rx=0x7f30480093f0 tx=0x7f3048006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3048009ea0 con 0x7f30540f5440 2022-02-02T21:13:31.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305410c5e0 con 0x7f30540f5440 2022-02-02T21:13:31.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3048013af0 con 0x7f30540f5440 2022-02-02T21:13:31.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304800db10 con 0x7f30540f5440 2022-02-02T21:13:31.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.355+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305410cb70 con 0x7f30540f5440 2022-02-02T21:13:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.356+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f304801a060 con 0x7f30540f5440 2022-02-02T21:13:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.357+0000 7f303bfff700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 0x7f303c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.357+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3048081aa0 con 0x7f30540f5440 2022-02-02T21:13:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.357+0000 7f3052ffd700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 0x7f303c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.357+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054059100 con 0x7f30540f5440 2022-02-02T21:13:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.357+0000 7f3052ffd700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 0x7f303c0672e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3044004e30 tx=0x7f3044009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.361+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f304804fc80 con 0x7f30540f5440 2022-02-02T21:13:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.593+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3054027b50 con 0x7f30540f5440 2022-02-02T21:13:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.594+0000 7f303bfff700 1 -- 172.21.15.96:0/679399279 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3048018030 con 0x7f30540f5440 2022-02-02T21:13:31.597 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:13:31.597 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:13:31.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:13:31.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:31.598 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:13:31.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:13:31.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:31.598 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:13:31.599 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:13:31.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:31.599 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:13:31.599 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:13:31.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:13:31.600 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:13:31.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:13:31.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:13:31.600 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:13:31.601 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:13:31.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 msgr2=0x7f303c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 0x7f303c0672e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3044004e30 tx=0x7f3044009b30).stop 2022-02-02T21:13:31.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 msgr2=0x7f3054109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 rx=0x7f30480093f0 tx=0x7f3048006ec0).stop 2022-02-02T21:13:31.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 shutdown_connections 2022-02-02T21:13:31.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f303c064e20 0x7f303c0672e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30540f5440 0x7f3054109a80 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 --2- 172.21.15.96:0/679399279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30540f66e0 0x7f305410bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 >> 172.21.15.96:0/679399279 conn(0x7f30540f0ba0 msgr2=0x7f30540fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 shutdown_connections 2022-02-02T21:13:31.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.596+0000 7f30589f5700 1 -- 172.21.15.96:0/679399279 wait complete. 2022-02-02T21:13:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 -- 172.21.15.96:0/1170981038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f66d0 msgr2=0x7f9b8c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/1170981038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f6b30 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 rx=0x7f9b80004660 tx=0x7f9b80009b30).stop 2022-02-02T21:13:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 -- 172.21.15.96:0/1170981038 shutdown_connections 2022-02-02T21:13:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/1170981038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f6b30 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/1170981038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 -- 172.21.15.96:0/1170981038 >> 172.21.15.96:0/1170981038 conn(0x7f9b8c0f0b90 msgr2=0x7f9b8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.693+0000 7f9b8bfff700 1 -- 172.21.15.96:0/1170981038 shutdown_connections 2022-02-02T21:13:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 -- 172.21.15.96:0/1170981038 wait complete. 2022-02-02T21:13:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 Processor -- start 2022-02-02T21:13:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 -- start start 2022-02-02T21:13:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0f7f70 con 0x7f9b8c0f5430 2022-02-02T21:13:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.694+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0f80b0 con 0x7f9b8c0f66d0 2022-02-02T21:13:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41584/0 (socket says 172.21.15.96:41584) 2022-02-02T21:13:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 -- 172.21.15.96:0/4275755493 learned_addr learned my addr 172.21.15.96:0/4275755493 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:13:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8a7fc700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 -- 172.21.15.96:0/4275755493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f66d0 msgr2=0x7f9b8c0f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 -- 172.21.15.96:0/4275755493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80005040 con 0x7f9b8c0f5430 2022-02-02T21:13:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8affd700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 rx=0x7f9b7c00c790 tx=0x7f9b7c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b7c00e680 con 0x7f9b8c0f5430 2022-02-02T21:13:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c0f8390 con 0x7f9b8c0f5430 2022-02-02T21:13:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b7c00ec90 con 0x7f9b8c0f5430 2022-02-02T21:13:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b7c012d00 con 0x7f9b8c0f5430 2022-02-02T21:13:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.695+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c10ed60 con 0x7f9b8c0f5430 2022-02-02T21:13:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.696+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c045ad0 con 0x7f9b8c0f5430 2022-02-02T21:13:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.697+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b7c010070 con 0x7f9b8c0f5430 2022-02-02T21:13:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.697+0000 7f9b737fe700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 0x7f9b740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:13:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.697+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b7c081bf0 con 0x7f9b8c0f5430 2022-02-02T21:13:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.697+0000 7f9b8a7fc700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 0x7f9b740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:13:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.698+0000 7f9b8a7fc700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 0x7f9b740672e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f9b80004e30 tx=0x7f9b80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:13:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.701+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b7c04fc30 con 0x7f9b8c0f5430 2022-02-02T21:13:31.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.903+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b8c10f410 con 0x7f9b8c0f5430 2022-02-02T21:13:31.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.904+0000 7f9b737fe700 1 -- 172.21.15.96:0/4275755493 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9b7c053250 con 0x7f9b8c0f5430 2022-02-02T21:13:31.906 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:13:31.907 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:13:31.907 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:13:31.907 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:13:31.907 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:31.908 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:13:31.908 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:13:31.909 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:13:31.909 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:13:31.909 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:13:31.909 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:13:31.909 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:13:31.910 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:13:31.910 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:13:31.910 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:13:31.910 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:13:31.911 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:13:31.911 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:13:31.911 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:13:31.912 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:13:31.912 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:13:31.912 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:13:31.912 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:13:31.913 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:13:31.913 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:13:31.913 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:13:31.913 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:13:31.914 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:13:31.914 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:13:31.914 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:13:31.914 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:13:31.915 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:13:31.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:31.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:31.915 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:13:31.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:13:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:31.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:13:31.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 msgr2=0x7f9b740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 0x7f9b740672e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f9b80004e30 tx=0x7f9b80009b30).stop 2022-02-02T21:13:31.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 msgr2=0x7f9b8c0f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:13:31.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 rx=0x7f9b7c00c790 tx=0x7f9b7c007d90).stop 2022-02-02T21:13:31.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 shutdown_connections 2022-02-02T21:13:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b74064e20 0x7f9b740672e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f5430 0x7f9b8c0f9590 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4275755493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f66d0 0x7f9b8c0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:13:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 >> 172.21.15.96:0/4275755493 conn(0x7f9b8c0f0b90 msgr2=0x7f9b8c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:13:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.905+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 shutdown_connections 2022-02-02T21:13:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:13:31.906+0000 7f9b8bfff700 1 -- 172.21.15.96:0/4275755493 wait complete. 2022-02-02T21:13:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:13:32.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:31 smithi159 ceph-mon[69013]: from='client.39378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:32.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/679399279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:13:32.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4275755493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:13:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:31 smithi096 ceph-mon[101353]: from='client.39378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/679399279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:13:32.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4275755493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:13:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:32 smithi096 ceph-mon[101353]: from='client.39382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:32 smithi096 ceph-mon[101353]: pgmap v5143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:32 smithi159 ceph-mon[69013]: from='client.39382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:13:33.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:32 smithi159 ceph-mon[69013]: pgmap v5143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:34 smithi159 ceph-mon[69013]: pgmap v5144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:34 smithi096 ceph-mon[101353]: pgmap v5144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:36 smithi159 ceph-mon[69013]: pgmap v5145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:36 smithi096 ceph-mon[101353]: pgmap v5145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:38 smithi159 ceph-mon[69013]: pgmap v5146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:38 smithi096 ceph-mon[101353]: pgmap v5146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:40 smithi159 ceph-mon[69013]: pgmap v5147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:40 smithi096 ceph-mon[101353]: pgmap v5147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:42 smithi096 ceph-mon[101353]: pgmap v5148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:42 smithi159 ceph-mon[69013]: pgmap v5148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:44 smithi159 ceph-mon[69013]: pgmap v5149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:44 smithi096 ceph-mon[101353]: pgmap v5149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:46 smithi159 ceph-mon[69013]: pgmap v5150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:46 smithi096 ceph-mon[101353]: pgmap v5150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:48 smithi159 ceph-mon[69013]: pgmap v5151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:48 smithi096 ceph-mon[101353]: pgmap v5151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:50 smithi159 ceph-mon[69013]: pgmap v5152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:51.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:50 smithi096 ceph-mon[101353]: pgmap v5152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:52 smithi096 ceph-mon[101353]: pgmap v5153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:52 smithi159 ceph-mon[69013]: pgmap v5153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:54 smithi159 ceph-mon[69013]: pgmap v5154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:54 smithi096 ceph-mon[101353]: pgmap v5154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:56 smithi159 ceph-mon[69013]: pgmap v5155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:56 smithi096 ceph-mon[101353]: pgmap v5155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:13:58 smithi159 ceph-mon[69013]: pgmap v5156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:13:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:13:58 smithi096 ceph-mon[101353]: pgmap v5156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:00 smithi159 ceph-mon[69013]: pgmap v5157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:00 smithi096 ceph-mon[101353]: pgmap v5157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:02.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 -- 172.21.15.96:0/290375698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f68e0 msgr2=0x7fa2ec0f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 --2- 172.21.15.96:0/290375698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec0f6d00 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 rx=0x7fa2e0004660 tx=0x7fa2e0009b30).stop 2022-02-02T21:14:02.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 -- 172.21.15.96:0/290375698 shutdown_connections 2022-02-02T21:14:02.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 --2- 172.21.15.96:0/290375698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec0f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 --2- 172.21.15.96:0/290375698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec0f6d00 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 -- 172.21.15.96:0/290375698 >> 172.21.15.96:0/290375698 conn(0x7fa2ec0f2020 msgr2=0x7fa2ec0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 -- 172.21.15.96:0/290375698 shutdown_connections 2022-02-02T21:14:02.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.018+0000 7fa2f265d700 1 -- 172.21.15.96:0/290375698 wait complete. 2022-02-02T21:14:02.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 Processor -- start 2022-02-02T21:14:02.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 -- start start 2022-02-02T21:14:02.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec1071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec107c80 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2f265d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec107dc0 con 0x7fa2ec0f68e0 2022-02-02T21:14:02.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41602/0 (socket says 172.21.15.96:41602) 2022-02-02T21:14:02.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2eb7fe700 1 -- 172.21.15.96:0/2719623022 learned_addr learned my addr 172.21.15.96:0/2719623022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:02.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.019+0000 7fa2ebfff700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec1071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2eb7fe700 1 -- 172.21.15.96:0/2719623022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f68e0 msgr2=0x7fa2ec1071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2eb7fe700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec1071e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2eb7fe700 1 -- 172.21.15.96:0/2719623022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0005040 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2eb7fe700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 rx=0x7fa2dc0026d0 tx=0x7fa2dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2dc0079c0 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2dc00f040 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec108760 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2dc0148b0 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.020+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec108d20 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.021+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec045ad0 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.022+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2dc007b20 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.022+0000 7fa2e8ff9700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 0x7fa2d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.022+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa2dc0819e0 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.022+0000 7fa2ebfff700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 0x7fa2d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.023+0000 7fa2ebfff700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 0x7fa2d4067290 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fa2e0004630 tx=0x7fa2e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.026+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2dc053510 con 0x7fa2ec0f7b80 2022-02-02T21:14:02.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.206+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2ec0ff0a0 con 0x7fa2d4064dd0 2022-02-02T21:14:02.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.207+0000 7fa2e8ff9700 1 -- 172.21.15.96:0/2719623022 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa2ec0ff0a0 con 0x7fa2d4064dd0 2022-02-02T21:14:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 msgr2=0x7fa2d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 0x7fa2d4067290 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fa2e0004630 tx=0x7fa2e0009b30).stop 2022-02-02T21:14:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 msgr2=0x7fa2ec1076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 rx=0x7fa2dc0026d0 tx=0x7fa2dc009de0).stop 2022-02-02T21:14:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 shutdown_connections 2022-02-02T21:14:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2d4064dd0 0x7fa2d4067290 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec0f68e0 0x7fa2ec1071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 --2- 172.21.15.96:0/2719623022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0f7b80 0x7fa2ec1076d0 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 >> 172.21.15.96:0/2719623022 conn(0x7fa2ec0f2020 msgr2=0x7fa2ec0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 shutdown_connections 2022-02-02T21:14:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.209+0000 7fa2f265d700 1 -- 172.21.15.96:0/2719623022 wait complete. 2022-02-02T21:14:02.220 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:14:02.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 -- 172.21.15.96:0/1787554463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 msgr2=0x7f99fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 --2- 172.21.15.96:0/1787554463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc0f6b00 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 rx=0x7f99ec004660 tx=0x7f99ec009b30).stop 2022-02-02T21:14:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 -- 172.21.15.96:0/1787554463 shutdown_connections 2022-02-02T21:14:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 --2- 172.21.15.96:0/1787554463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 0x7f99fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:14:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 --2- 172.21.15.96:0/1787554463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc0f6b00 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 -- 172.21.15.96:0/1787554463 >> 172.21.15.96:0/1787554463 conn(0x7f99fc0f1e40 msgr2=0x7f99fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 -- 172.21.15.96:0/1787554463 shutdown_connections 2022-02-02T21:14:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.307+0000 7f9a03b52700 1 -- 172.21.15.96:0/1787554463 wait complete. 2022-02-02T21:14:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 Processor -- start 2022-02-02T21:14:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 -- start start 2022-02-02T21:14:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 0x7f99fc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc107ae0 con 0x7f99fc0f66e0 2022-02-02T21:14:02.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a03b52700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc108390 con 0x7f99fc0f7980 2022-02-02T21:14:02.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41610/0 (socket says 172.21.15.96:41610) 2022-02-02T21:14:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 -- 172.21.15.96:0/2989424250 learned_addr learned my addr 172.21.15.96:0/2989424250 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a010ed700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 0x7f99fc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 -- 172.21.15.96:0/2989424250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 msgr2=0x7f99fc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 0x7f99fc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 -- 172.21.15.96:0/2989424250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec005040 con 0x7f99fc0f66e0 2022-02-02T21:14:02.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f9a018ee700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 rx=0x7f99ec004f60 tx=0x7f99ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.308+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99ec018070 con 0x7f99fc0f66e0 2022-02-02T21:14:02.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.309+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99ec009770 con 0x7f99fc0f66e0 2022-02-02T21:14:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.309+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc108610 con 0x7f99fc0f66e0 2022-02-02T21:14:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.309+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99ec01c3c0 con 0x7f99fc0f66e0 2022-02-02T21:14:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.309+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc108b70 con 0x7f99fc0f66e0 2022-02-02T21:14:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.310+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc0f5ad0 con 0x7f99fc0f66e0 2022-02-02T21:14:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.310+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99ec01d420 con 0x7f99fc0f66e0 2022-02-02T21:14:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.310+0000 7f99f27fc700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 0x7f99e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.311+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99ec083880 con 0x7f99fc0f66e0 2022-02-02T21:14:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.311+0000 7f9a010ed700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 0x7f99e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.311+0000 7f9a010ed700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 0x7f99e8067290 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f99f8006fd0 tx=0x7f99f8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.315+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99ec055470 con 0x7f99fc0f66e0 2022-02-02T21:14:02.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.493+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99fc0fef20 con 0x7f99e8064dd0 2022-02-02T21:14:02.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.502+0000 7f99f27fc700 1 -- 172.21.15.96:0/2989424250 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f99fc0fef20 con 0x7f99e8064dd0 2022-02-02T21:14:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:14:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:14:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:14:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:14:02.505 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:14:02.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:14:02.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:14:02.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:14:02.505 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:14:02.506 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 2h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:14:02.506 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:14:02.506 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 2h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:14:02.506 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:14:02.507 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:14:02.507 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:14:02.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:14:02.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:14:02.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:14:02.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:14:02.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:14:02.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:14:02.508 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:14:02.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 msgr2=0x7f99e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 0x7f99e8067290 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f99f8006fd0 tx=0x7f99f8008040).stop 2022-02-02T21:14:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 msgr2=0x7f99fc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 rx=0x7f99ec004f60 tx=0x7f99ec009b30).stop 2022-02-02T21:14:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 shutdown_connections 2022-02-02T21:14:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99e8064dd0 0x7f99e8067290 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99fc0f66e0 0x7f99fc106fb0 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 --2- 172.21.15.96:0/2989424250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99fc0f7980 0x7f99fc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 >> 172.21.15.96:0/2989424250 conn(0x7f99fc0f1e40 msgr2=0x7f99fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 shutdown_connections 2022-02-02T21:14:02.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.504+0000 7f9a03b52700 1 -- 172.21.15.96:0/2989424250 wait complete. 2022-02-02T21:14:02.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/219372275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 msgr2=0x7f2bb00f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/219372275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb00f69b0 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 rx=0x7f2b9c004660 tx=0x7f2b9c009b30).stop 2022-02-02T21:14:02.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/219372275 shutdown_connections 2022-02-02T21:14:02.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/219372275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb00f69b0 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/219372275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 0x7f2bb00f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:14:02.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/219372275 >> 172.21.15.96:0/219372275 conn(0x7f2bb00f04c0 msgr2=0x7f2bb00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/219372275 shutdown_connections 2022-02-02T21:14:02.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.601+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/219372275 wait complete. 2022-02-02T21:14:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 Processor -- start 2022-02-02T21:14:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 -- start start 2022-02-02T21:14:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 0x7f2bb0109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00f5730 con 0x7f2bb00f6550 2022-02-02T21:14:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb6fd4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00f5870 con 0x7f2bb00f5bb0 2022-02-02T21:14:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2baffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2baffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41622/0 (socket says 172.21.15.96:41622) 2022-02-02T21:14:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2baffff700 1 -- 172.21.15.96:0/4195233694 learned_addr learned my addr 172.21.15.96:0/4195233694 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2bb4d70700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 0x7f2bb0109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2baffff700 1 -- 172.21.15.96:0/4195233694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 msgr2=0x7f2bb0109d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.602+0000 7f2baffff700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 0x7f2bb0109d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2baffff700 1 -- 172.21.15.96:0/4195233694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c005040 con 0x7f2bb00f6550 2022-02-02T21:14:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2baffff700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 rx=0x7f2b9c009990 tx=0x7f2b9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9c018070 con 0x7f2bb00f6550 2022-02-02T21:14:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b9c007ba0 con 0x7f2bb00f6550 2022-02-02T21:14:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9c01c3c0 con 0x7f2bb00f6550 2022-02-02T21:14:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb010c810 con 0x7f2bb00f6550 2022-02-02T21:14:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.603+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb010ccf0 con 0x7f2bb00f6550 2022-02-02T21:14:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.604+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb0045ad0 con 0x7f2bb00f6550 2022-02-02T21:14:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.605+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b9c023020 con 0x7f2bb00f6550 2022-02-02T21:14:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.606+0000 7f2bad7fa700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 0x7f2ba0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.606+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2b9c0837b0 con 0x7f2bb00f6550 2022-02-02T21:14:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.606+0000 7f2bb4d70700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 0x7f2ba0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.606+0000 7f2bb4d70700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 0x7f2ba0067290 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2bb00f5320 tx=0x7f2ba4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.609+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b9c0518b0 con 0x7f2bb00f6550 2022-02-02T21:14:02.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.840+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2bb0027a00 con 0x7f2bb00f6550 2022-02-02T21:14:02.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.841+0000 7f2bad7fa700 1 -- 172.21.15.96:0/4195233694 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2b9c054ed0 con 0x7f2bb00f6550 2022-02-02T21:14:02.843 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:14:02.843 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:14:02.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:14:02.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:02.844 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:14:02.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:14:02.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:02.845 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:14:02.845 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:14:02.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:02.845 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:14:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:14:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:14:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:14:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:14:02.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:14:02.847 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:14:02.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 msgr2=0x7f2ba0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 0x7f2ba0067290 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2bb00f5320 tx=0x7f2ba4008040).stop 2022-02-02T21:14:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 msgr2=0x7f2bb010c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 rx=0x7f2b9c009990 tx=0x7f2b9c009b30).stop 2022-02-02T21:14:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 shutdown_connections 2022-02-02T21:14:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2ba0064dd0 0x7f2ba0067290 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb00f5bb0 0x7f2bb0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 --2- 172.21.15.96:0/4195233694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bb00f6550 0x7f2bb010c210 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.843+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 >> 172.21.15.96:0/4195233694 conn(0x7f2bb00f04c0 msgr2=0x7f2bb00fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.844+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 shutdown_connections 2022-02-02T21:14:02.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.844+0000 7f2bb6fd4700 1 -- 172.21.15.96:0/4195233694 wait complete. 2022-02-02T21:14:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- 172.21.15.96:0/3484449772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 msgr2=0x7f32f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3484449772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f00f6b00 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 rx=0x7f32e4004660 tx=0x7f32e4009b30).stop 2022-02-02T21:14:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- 172.21.15.96:0/3484449772 shutdown_connections 2022-02-02T21:14:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3484449772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 0x7f32f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3484449772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f00f6b00 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- 172.21.15.96:0/3484449772 >> 172.21.15.96:0/3484449772 conn(0x7f32f00f1e40 msgr2=0x7f32f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- 172.21.15.96:0/3484449772 shutdown_connections 2022-02-02T21:14:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- 172.21.15.96:0/3484449772 wait complete. 2022-02-02T21:14:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 Processor -- start 2022-02-02T21:14:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.941+0000 7f32f6d56700 1 -- start start 2022-02-02T21:14:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f6d56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f6d56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 0x7f32f01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f6d56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0107a50 con 0x7f32f00f66e0 2022-02-02T21:14:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f6d56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0107b90 con 0x7f32f00f7980 2022-02-02T21:14:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41630/0 (socket says 172.21.15.96:41630) 2022-02-02T21:14:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 -- 172.21.15.96:0/3199063080 learned_addr learned my addr 172.21.15.96:0/3199063080 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32effff700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 0x7f32f01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 -- 172.21.15.96:0/3199063080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 msgr2=0x7f32f01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 0x7f32f01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 -- 172.21.15.96:0/3199063080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4005040 con 0x7f32f00f66e0 2022-02-02T21:14:02.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32f4af2700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 rx=0x7f32e4004f60 tx=0x7f32e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.942+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e4018070 con 0x7f32f00f66e0 2022-02-02T21:14:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.943+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32e4009770 con 0x7f32f00f66e0 2022-02-02T21:14:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.943+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e401c3c0 con 0x7f32f00f66e0 2022-02-02T21:14:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.943+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f01084d0 con 0x7f32f00f66e0 2022-02-02T21:14:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.943+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f01089b0 con 0x7f32f00f66e0 2022-02-02T21:14:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.944+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f0045ad0 con 0x7f32f00f66e0 2022-02-02T21:14:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.945+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f32e401d420 con 0x7f32f00f66e0 2022-02-02T21:14:02.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.945+0000 7f32ed7fa700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 0x7f32e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.946+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f32e4083450 con 0x7f32f00f66e0 2022-02-02T21:14:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.946+0000 7f32effff700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 0x7f32e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.946+0000 7f32effff700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 0x7f32e0067290 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f32dc0041d0 tx=0x7f32dc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:02.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:02.950+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32e4054f20 con 0x7f32f00f66e0 2022-02-02T21:14:03.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.151+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32f010d5d0 con 0x7f32f00f66e0 2022-02-02T21:14:03.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.151+0000 7f32ed7fa700 1 -- 172.21.15.96:0/3199063080 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f32e4054b10 con 0x7f32f00f66e0 2022-02-02T21:14:03.153 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:14:03.153 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:14:03.154 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:14:03.154 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:14:03.154 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:03.154 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:14:03.155 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:14:03.155 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:14:03.155 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:14:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:14:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:14:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:14:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:14:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:14:03.157 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:14:03.157 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:14:03.157 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:14:03.157 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:14:03.158 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:14:03.158 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:14:03.158 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:14:03.158 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:14:03.159 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:14:03.159 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:14:03.159 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:14:03.159 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:14:03.160 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:14:03.160 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:14:03.160 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:14:03.160 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:14:03.161 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:14:03.161 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:14:03.161 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:03.161 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:03.162 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:14:03.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:03.162 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:03.162 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:03.162 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:03.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 msgr2=0x7f32e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:03.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 0x7f32e0067290 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f32dc0041d0 tx=0x7f32dc009040).stop 2022-02-02T21:14:03.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 msgr2=0x7f32f0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:03.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 rx=0x7f32e4004f60 tx=0x7f32e4009b30).stop 2022-02-02T21:14:03.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 shutdown_connections 2022-02-02T21:14:03.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32e0064dd0 0x7f32e0067290 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:03.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32f00f66e0 0x7f32f0106fb0 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:03.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 --2- 172.21.15.96:0/3199063080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32f00f7980 0x7f32f01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:03.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 >> 172.21.15.96:0/3199063080 conn(0x7f32f00f1e40 msgr2=0x7f32f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:03.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 shutdown_connections 2022-02-02T21:14:03.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:03.154+0000 7f32f6d56700 1 -- 172.21.15.96:0/3199063080 wait complete. 2022-02-02T21:14:03.167 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:02 smithi096 ceph-mon[101353]: pgmap v5158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:03.167 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4195233694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:14:03.167 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:14:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:02 smithi159 ceph-mon[69013]: pgmap v5158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4195233694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:14:04.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:03 smithi159 ceph-mon[69013]: from='client.39394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:03 smithi159 ceph-mon[69013]: from='client.39398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3199063080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:14:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:03 smithi096 ceph-mon[101353]: from='client.39394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:03 smithi096 ceph-mon[101353]: from='client.39398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:04.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3199063080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:14:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:04 smithi159 ceph-mon[69013]: pgmap v5159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:05.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:04 smithi096 ceph-mon[101353]: pgmap v5159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:06 smithi159 ceph-mon[69013]: pgmap v5160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:06 smithi096 ceph-mon[101353]: pgmap v5160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:08 smithi159 ceph-mon[69013]: pgmap v5161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:08 smithi096 ceph-mon[101353]: pgmap v5161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:10 smithi159 ceph-mon[69013]: pgmap v5162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:10 smithi096 ceph-mon[101353]: pgmap v5162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:12 smithi096 ceph-mon[101353]: pgmap v5163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:12 smithi159 ceph-mon[69013]: pgmap v5163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:14 smithi159 ceph-mon[69013]: pgmap v5164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:15.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:14 smithi096 ceph-mon[101353]: pgmap v5164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:16 smithi159 ceph-mon[69013]: pgmap v5165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:16 smithi096 ceph-mon[101353]: pgmap v5165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:18 smithi159 ceph-mon[69013]: pgmap v5166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:18 smithi096 ceph-mon[101353]: pgmap v5166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:20 smithi159 ceph-mon[69013]: pgmap v5167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:21.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:20 smithi096 ceph-mon[101353]: pgmap v5167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:22 smithi096 ceph-mon[101353]: pgmap v5168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:22 smithi159 ceph-mon[69013]: pgmap v5168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:24 smithi159 ceph-mon[69013]: pgmap v5169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:24 smithi096 ceph-mon[101353]: pgmap v5169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:26 smithi159 ceph-mon[69013]: pgmap v5170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:26 smithi096 ceph-mon[101353]: pgmap v5170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:14:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:14:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:28 smithi159 ceph-mon[69013]: pgmap v5171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:14:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:14:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:28 smithi096 ceph-mon[101353]: pgmap v5171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:30 smithi159 ceph-mon[69013]: pgmap v5172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:30 smithi096 ceph-mon[101353]: pgmap v5172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:33.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:32 smithi096 ceph-mon[101353]: pgmap v5173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:33.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- 172.21.15.96:0/3253532961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f77d0 msgr2=0x7f84380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 --2- 172.21.15.96:0/3253532961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f77d0 0x7f84380f7c30 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 rx=0x7f8428004660 tx=0x7f8428009b30).stop 2022-02-02T21:14:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- 172.21.15.96:0/3253532961 shutdown_connections 2022-02-02T21:14:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 --2- 172.21.15.96:0/3253532961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f77d0 0x7f84380f7c30 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 --2- 172.21.15.96:0/3253532961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f6530 0x7f84380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- 172.21.15.96:0/3253532961 >> 172.21.15.96:0/3253532961 conn(0x7f84380f1cd0 msgr2=0x7f84380f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- 172.21.15.96:0/3253532961 shutdown_connections 2022-02-02T21:14:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- 172.21.15.96:0/3253532961 wait complete. 2022-02-02T21:14:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 Processor -- start 2022-02-02T21:14:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.266+0000 7f843edf9700 1 -- start start 2022-02-02T21:14:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843edf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843edf9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f77d0 0x7f8438069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843edf9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843806a380 con 0x7f84380f6530 2022-02-02T21:14:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843edf9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843806a4c0 con 0x7f84380f77d0 2022-02-02T21:14:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41648/0 (socket says 172.21.15.96:41648) 2022-02-02T21:14:33.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 -- 172.21.15.96:0/3629442716 learned_addr learned my addr 172.21.15.96:0/3629442716 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:33.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843d5f6700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f77d0 0x7f8438069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 -- 172.21.15.96:0/3629442716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f77d0 msgr2=0x7f8438069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f77d0 0x7f8438069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 -- 172.21.15.96:0/3629442716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428005040 con 0x7f84380f6530 2022-02-02T21:14:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f843ddf7700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 rx=0x7f8434002700 tx=0x7f8434009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.267+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84340079c0 con 0x7f84380f6530 2022-02-02T21:14:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.268+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f843400f040 con 0x7f84380f6530 2022-02-02T21:14:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.268+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843806a7a0 con 0x7f84380f6530 2022-02-02T21:14:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.268+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8434014860 con 0x7f84380f6530 2022-02-02T21:14:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.268+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843810ed50 con 0x7f84380f6530 2022-02-02T21:14:33.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:32 smithi159 ceph-mon[69013]: pgmap v5173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.269+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8438045ad0 con 0x7f84380f6530 2022-02-02T21:14:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.269+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f843401b060 con 0x7f84380f6530 2022-02-02T21:14:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.269+0000 7f842e7fc700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 0x7f84240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.270+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84340818e0 con 0x7f84380f6530 2022-02-02T21:14:33.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.270+0000 7f843d5f6700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 0x7f84240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.270+0000 7f843d5f6700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 0x7f84240672e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f8428004630 tx=0x7f8428009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.274+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f843404f9e0 con 0x7f84380f6530 2022-02-02T21:14:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.450+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84380feea0 con 0x7f8424064e20 2022-02-02T21:14:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.451+0000 7f842e7fc700 1 -- 172.21.15.96:0/3629442716 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8428019040 con 0x7f8424064e20 2022-02-02T21:14:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 msgr2=0x7f84240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 0x7f84240672e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f8428004630 tx=0x7f8428009b30).stop 2022-02-02T21:14:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 msgr2=0x7f843806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 rx=0x7f8434002700 tx=0x7f8434009d80).stop 2022-02-02T21:14:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 shutdown_connections 2022-02-02T21:14:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8424064e20 0x7f84240672e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84380f6530 0x7f843806b9a0 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 --2- 172.21.15.96:0/3629442716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84380f77d0 0x7f8438069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 >> 172.21.15.96:0/3629442716 conn(0x7f84380f1cd0 msgr2=0x7f84380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 shutdown_connections 2022-02-02T21:14:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.453+0000 7f843edf9700 1 -- 172.21.15.96:0/3629442716 wait complete. 2022-02-02T21:14:33.465 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:14:33.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- 172.21.15.96:0/175464519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 msgr2=0x7f9ac40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/175464519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac40f6cc0 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 rx=0x7f9ac0004660 tx=0x7f9ac0009b30).stop 2022-02-02T21:14:33.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- 172.21.15.96:0/175464519 shutdown_connections 2022-02-02T21:14:33.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/175464519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac40f6cc0 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/175464519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 0x7f9ac40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- 172.21.15.96:0/175464519 >> 172.21.15.96:0/175464519 conn(0x7f9ac40f0d40 msgr2=0x7f9ac40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:33.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- 172.21.15.96:0/175464519 shutdown_connections 2022-02-02T21:14:33.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- 172.21.15.96:0/175464519 wait complete. 2022-02-02T21:14:33.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 Processor -- start 2022-02-02T21:14:33.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.551+0000 7f9acb9f3700 1 -- start start 2022-02-02T21:14:33.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9acb9f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 0x7f9ac4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9acb9f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9acb9f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40603e0 con 0x7f9ac40f6860 2022-02-02T21:14:33.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9acb9f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4060520 con 0x7f9ac40f55c0 2022-02-02T21:14:33.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41660/0 (socket says 172.21.15.96:41660) 2022-02-02T21:14:33.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 -- 172.21.15.96:0/3701859598 learned_addr learned my addr 172.21.15.96:0/3701859598 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:33.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac978f700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 0x7f9ac4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 -- 172.21.15.96:0/3701859598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 msgr2=0x7f9ac4109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 0x7f9ac4109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 -- 172.21.15.96:0/3701859598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0005040 con 0x7f9ac40f6860 2022-02-02T21:14:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ac8f8e700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 rx=0x7f9ac0009990 tx=0x7f9ac0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.552+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac0018070 con 0x7f9ac40f6860 2022-02-02T21:14:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.553+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ac0007ba0 con 0x7f9ac40f6860 2022-02-02T21:14:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.553+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac410c6a0 con 0x7f9ac40f6860 2022-02-02T21:14:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.553+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac001c620 con 0x7f9ac40f6860 2022-02-02T21:14:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.553+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac410cc00 con 0x7f9ac40f6860 2022-02-02T21:14:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.554+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac4045ad0 con 0x7f9ac40f6860 2022-02-02T21:14:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.554+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ac001c890 con 0x7f9ac40f6860 2022-02-02T21:14:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.554+0000 7f9ab9ffb700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 0x7f9ab0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.555+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ac0083870 con 0x7f9ac40f6860 2022-02-02T21:14:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.555+0000 7f9ac978f700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 0x7f9ab0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.555+0000 7f9ac978f700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 0x7f9ab0067290 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f9ac4060060 tx=0x7f9ab4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.559+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ac0051960 con 0x7f9ac40f6860 2022-02-02T21:14:33.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.730+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ac40fde90 con 0x7f9ab0064dd0 2022-02-02T21:14:33.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.739+0000 7f9ab9ffb700 1 -- 172.21.15.96:0/3701859598 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9ac40fde90 con 0x7f9ab0064dd0 2022-02-02T21:14:33.741 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:14:33.742 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:14:33.742 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:14:33.742 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:14:33.742 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:14:33.743 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:14:33.743 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:14:33.743 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:14:33.743 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:14:33.744 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:14:33.744 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:14:33.744 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:14:33.744 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:14:33.745 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:14:33.745 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:14:33.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:14:33.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:14:33.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:14:33.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:14:33.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:14:33.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:14:33.747 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:14:33.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 msgr2=0x7f9ab0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 0x7f9ab0067290 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f9ac4060060 tx=0x7f9ab4009040).stop 2022-02-02T21:14:33.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 msgr2=0x7f9ac410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 rx=0x7f9ac0009990 tx=0x7f9ac0009b30).stop 2022-02-02T21:14:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 shutdown_connections 2022-02-02T21:14:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ab0064dd0 0x7f9ab0067290 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ac40f55c0 0x7f9ac4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 --2- 172.21.15.96:0/3701859598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ac40f6860 0x7f9ac410c150 unknown :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.741+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 >> 172.21.15.96:0/3701859598 conn(0x7f9ac40f0d40 msgr2=0x7f9ac40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:33.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.742+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 shutdown_connections 2022-02-02T21:14:33.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.742+0000 7f9acb9f3700 1 -- 172.21.15.96:0/3701859598 wait complete. 2022-02-02T21:14:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- 172.21.15.96:0/650033280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f6860 msgr2=0x7f13880f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 --2- 172.21.15.96:0/650033280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f6860 0x7f13880f6cc0 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 rx=0x7f1378004660 tx=0x7f1378009b30).stop 2022-02-02T21:14:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- 172.21.15.96:0/650033280 shutdown_connections 2022-02-02T21:14:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 --2- 172.21.15.96:0/650033280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f6860 0x7f13880f6cc0 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 --2- 172.21.15.96:0/650033280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f55c0 0x7f13880f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- 172.21.15.96:0/650033280 >> 172.21.15.96:0/650033280 conn(0x7f13880f0d40 msgr2=0x7f13880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- 172.21.15.96:0/650033280 shutdown_connections 2022-02-02T21:14:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- 172.21.15.96:0/650033280 wait complete. 2022-02-02T21:14:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 Processor -- start 2022-02-02T21:14:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.839+0000 7f138def1700 1 -- start start 2022-02-02T21:14:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f138def1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f138def1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f6860 0x7f138810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f138def1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880603c0 con 0x7f13880f55c0 2022-02-02T21:14:33.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f138def1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388060500 con 0x7f13880f6860 2022-02-02T21:14:33.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41668/0 (socket says 172.21.15.96:41668) 2022-02-02T21:14:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 -- 172.21.15.96:0/416327587 learned_addr learned my addr 172.21.15.96:0/416327587 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f1386ffd700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f6860 0x7f138810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 -- 172.21.15.96:0/416327587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f6860 msgr2=0x7f138810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f6860 0x7f138810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 -- 172.21.15.96:0/416327587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378005040 con 0x7f13880f55c0 2022-02-02T21:14:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f13877fe700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 rx=0x7f137c002700 tx=0x7f137c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c0079c0 con 0x7f13880f55c0 2022-02-02T21:14:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.840+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f137c00f040 con 0x7f13880f55c0 2022-02-02T21:14:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.841+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138810c720 con 0x7f13880f55c0 2022-02-02T21:14:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.841+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c014860 con 0x7f13880f55c0 2022-02-02T21:14:33.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.841+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138810ccb0 con 0x7f13880f55c0 2022-02-02T21:14:33.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.842+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13880f49b0 con 0x7f13880f55c0 2022-02-02T21:14:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.842+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f137c01b060 con 0x7f13880f55c0 2022-02-02T21:14:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.842+0000 7f136ffff700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 0x7f1370067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.842+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f137c0817e0 con 0x7f13880f55c0 2022-02-02T21:14:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.843+0000 7f1386ffd700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 0x7f1370067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.843+0000 7f1386ffd700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 0x7f1370067290 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f1378004630 tx=0x7f1378009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:33.846+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f137c04f8e0 con 0x7f13880f55c0 2022-02-02T21:14:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.078+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13880586e0 con 0x7f13880f55c0 2022-02-02T21:14:34.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.079+0000 7f136ffff700 1 -- 172.21.15.96:0/416327587 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f137c0192e0 con 0x7f13880f55c0 2022-02-02T21:14:34.080 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:14:34.081 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:14:34.081 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:14:34.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:34.081 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:14:34.082 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:14:34.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:34.082 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:14:34.082 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:14:34.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:34.083 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:14:34.083 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:14:34.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:14:34.083 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:14:34.084 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:14:34.084 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:14:34.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:14:34.085 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:14:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 msgr2=0x7f1370067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 0x7f1370067290 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f1378004630 tx=0x7f1378009b30).stop 2022-02-02T21:14:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 msgr2=0x7f1388109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 rx=0x7f137c002700 tx=0x7f137c009d80).stop 2022-02-02T21:14:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 shutdown_connections 2022-02-02T21:14:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1370064dd0 0x7f1370067290 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13880f55c0 0x7f1388109c70 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 --2- 172.21.15.96:0/416327587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13880f6860 0x7f138810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.080+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 >> 172.21.15.96:0/416327587 conn(0x7f13880f0d40 msgr2=0x7f13880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:34.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.081+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 shutdown_connections 2022-02-02T21:14:34.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.081+0000 7f138def1700 1 -- 172.21.15.96:0/416327587 wait complete. 2022-02-02T21:14:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 -- 172.21.15.96:0/2308338515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 msgr2=0x7fcdb80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 --2- 172.21.15.96:0/2308338515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb80f5850 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 rx=0x7fcda8004660 tx=0x7fcda8009b30).stop 2022-02-02T21:14:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 -- 172.21.15.96:0/2308338515 shutdown_connections 2022-02-02T21:14:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 --2- 172.21.15.96:0/2308338515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 0x7fcdb80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 --2- 172.21.15.96:0/2308338515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb80f5850 unknown :-1 s=CLOSED pgs=2657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 -- 172.21.15.96:0/2308338515 >> 172.21.15.96:0/2308338515 conn(0x7fcdb80f0b90 msgr2=0x7fcdb80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.178+0000 7fcdb759e700 1 -- 172.21.15.96:0/2308338515 shutdown_connections 2022-02-02T21:14:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 -- 172.21.15.96:0/2308338515 wait complete. 2022-02-02T21:14:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 Processor -- start 2022-02-02T21:14:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 -- start start 2022-02-02T21:14:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 0x7fcdb810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80603c0 con 0x7fcdb80f5430 2022-02-02T21:14:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.180+0000 7fcdb759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8060500 con 0x7fcdb80f66d0 2022-02-02T21:14:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41678/0 (socket says 172.21.15.96:41678) 2022-02-02T21:14:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 -- 172.21.15.96:0/59484673 learned_addr learned my addr 172.21.15.96:0/59484673 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:14:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb5d9b700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 0x7fcdb810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 -- 172.21.15.96:0/59484673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 msgr2=0x7fcdb810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 0x7fcdb810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 -- 172.21.15.96:0/59484673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8005040 con 0x7fcdb80f5430 2022-02-02T21:14:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb659c700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 rx=0x7fcda8013a70 tx=0x7fcda8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda8018070 con 0x7fcdb80f5430 2022-02-02T21:14:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcda80097d0 con 0x7fcdb80f5430 2022-02-02T21:14:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb810c500 con 0x7fcdb80f5430 2022-02-02T21:14:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda801c3c0 con 0x7fcdb80f5430 2022-02-02T21:14:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.181+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb810ca30 con 0x7fcdb80f5430 2022-02-02T21:14:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.182+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8045ad0 con 0x7fcdb80f5430 2022-02-02T21:14:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.183+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcda8007ba0 con 0x7fcdb80f5430 2022-02-02T21:14:34.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.183+0000 7fcda6ffd700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 0x7fcda00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:14:34.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.184+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcda8083720 con 0x7fcdb80f5430 2022-02-02T21:14:34.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.184+0000 7fcdb5d9b700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 0x7fcda00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:14:34.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.184+0000 7fcdb5d9b700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 0x7fcda00672e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fcdac004a70 tx=0x7fcdac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:14:34.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.188+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcda8051820 con 0x7fcdb80f5430 2022-02-02T21:14:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.389+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdb80fdcc0 con 0x7fcdb80f5430 2022-02-02T21:14:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.390+0000 7fcda6ffd700 1 -- 172.21.15.96:0/59484673 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcda8051020 con 0x7fcdb80f5430 2022-02-02T21:14:34.392 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:14:34.392 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:14:34.392 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:14:34.392 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:14:34.392 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:34.393 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:14:34.393 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:14:34.393 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:14:34.393 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:14:34.394 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:14:34.394 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:14:34.394 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:14:34.395 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:14:34.395 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:14:34.395 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:14:34.395 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:14:34.395 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:14:34.396 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:14:34.396 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:14:34.396 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:14:34.396 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:14:34.397 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:14:34.397 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:14:34.397 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:14:34.397 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:14:34.398 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:14:34.398 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:14:34.398 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:14:34.398 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:14:34.398 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:14:34.399 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:14:34.399 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:14:34.399 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:34.399 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:14:34.400 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:14:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:14:34.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 msgr2=0x7fcda00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 0x7fcda00672e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fcdac004a70 tx=0x7fcdac00b040).stop 2022-02-02T21:14:34.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 msgr2=0x7fcdb8109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:14:34.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 rx=0x7fcda8013a70 tx=0x7fcda8009b30).stop 2022-02-02T21:14:34.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 shutdown_connections 2022-02-02T21:14:34.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcda0064e20 0x7fcda00672e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdb80f5430 0x7fcdb8109ab0 unknown :-1 s=CLOSED pgs=2658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 --2- 172.21.15.96:0/59484673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb80f66d0 0x7fcdb810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:14:34.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.391+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 >> 172.21.15.96:0/59484673 conn(0x7fcdb80f0b90 msgr2=0x7fcdb80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:14:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.392+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 shutdown_connections 2022-02-02T21:14:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:14:34.392+0000 7fcdb759e700 1 -- 172.21.15.96:0/59484673 wait complete. 2022-02-02T21:14:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:14:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:34 smithi159 ceph-mon[69013]: from='client.39410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:34 smithi159 ceph-mon[69013]: from='client.39414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:34 smithi159 ceph-mon[69013]: pgmap v5174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/416327587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:14:35.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/59484673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:14:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:34 smithi096 ceph-mon[101353]: from='client.39410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:34 smithi096 ceph-mon[101353]: from='client.39414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:14:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:34 smithi096 ceph-mon[101353]: pgmap v5174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/416327587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:14:35.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/59484673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:14:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:36 smithi159 ceph-mon[69013]: pgmap v5175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:36 smithi096 ceph-mon[101353]: pgmap v5175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:38 smithi159 ceph-mon[69013]: pgmap v5176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:38 smithi096 ceph-mon[101353]: pgmap v5176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:40 smithi159 ceph-mon[69013]: pgmap v5177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:40 smithi096 ceph-mon[101353]: pgmap v5177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:42 smithi096 ceph-mon[101353]: pgmap v5178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:42 smithi159 ceph-mon[69013]: pgmap v5178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:44 smithi159 ceph-mon[69013]: pgmap v5179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:44 smithi096 ceph-mon[101353]: pgmap v5179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:46 smithi159 ceph-mon[69013]: pgmap v5180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:46 smithi096 ceph-mon[101353]: pgmap v5180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:48 smithi159 ceph-mon[69013]: pgmap v5181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:48 smithi096 ceph-mon[101353]: pgmap v5181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:50 smithi159 ceph-mon[69013]: pgmap v5182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:50 smithi096 ceph-mon[101353]: pgmap v5182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:53.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:52 smithi096 ceph-mon[101353]: pgmap v5183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:52 smithi159 ceph-mon[69013]: pgmap v5183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:54 smithi159 ceph-mon[69013]: pgmap v5184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:54 smithi096 ceph-mon[101353]: pgmap v5184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:56 smithi159 ceph-mon[69013]: pgmap v5185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:56 smithi096 ceph-mon[101353]: pgmap v5185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:14:58 smithi159 ceph-mon[69013]: pgmap v5186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:14:58.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:14:58 smithi096 ceph-mon[101353]: pgmap v5186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:00 smithi159 ceph-mon[69013]: pgmap v5187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:00 smithi096 ceph-mon[101353]: pgmap v5187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:02 smithi096 ceph-mon[101353]: pgmap v5188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:02 smithi159 ceph-mon[69013]: pgmap v5188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:04.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/3218166098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f66e0 msgr2=0x7fcb080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/3218166098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f66e0 0x7fcb080f6b00 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 rx=0x7fcafc004660 tx=0x7fcafc009b30).stop 2022-02-02T21:15:04.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/3218166098 shutdown_connections 2022-02-02T21:15:04.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/3218166098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f7980 0x7fcb080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/3218166098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f66e0 0x7fcb080f6b00 unknown :-1 s=CLOSED pgs=2659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/3218166098 >> 172.21.15.96:0/3218166098 conn(0x7fcb080f1e40 msgr2=0x7fcb080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:04.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/3218166098 shutdown_connections 2022-02-02T21:15:04.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.496+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/3218166098 wait complete. 2022-02-02T21:15:04.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 Processor -- start 2022-02-02T21:15:04.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 -- start start 2022-02-02T21:15:04.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66e0 0x7fcb0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0806a380 con 0x7fcb080f7980 2022-02-02T21:15:04.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0fb6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0806a4c0 con 0x7fcb080f66e0 2022-02-02T21:15:04.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0d107700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0d107700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41696/0 (socket says 172.21.15.96:41696) 2022-02-02T21:15:04.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0d107700 1 -- 172.21.15.96:0/2339913029 learned_addr learned my addr 172.21.15.96:0/2339913029 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:04.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.497+0000 7fcb0d908700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66e0 0x7fcb0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0d107700 1 -- 172.21.15.96:0/2339913029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66e0 msgr2=0x7fcb0806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0d107700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66e0 0x7fcb0806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0d107700 1 -- 172.21.15.96:0/2339913029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc005040 con 0x7fcb080f7980 2022-02-02T21:15:04.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0d107700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 secure :-1 s=READY pgs=2660 cs=0 l=1 rev1=1 rx=0x7fcb0400c790 tx=0x7fcb04007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:04.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04002590 con 0x7fcb080f7980 2022-02-02T21:15:04.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb04002ba0 con 0x7fcb080f7980 2022-02-02T21:15:04.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0806a7a0 con 0x7fcb080f7980 2022-02-02T21:15:04.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04013d90 con 0x7fcb080f7980 2022-02-02T21:15:04.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.498+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0810efe0 con 0x7fcb080f7980 2022-02-02T21:15:04.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.499+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08045ad0 con 0x7fcb080f7980 2022-02-02T21:15:04.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.499+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb0401a060 con 0x7fcb080f7980 2022-02-02T21:15:04.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.500+0000 7fcafa7fc700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 0x7fcaf4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.500+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb04081c20 con 0x7fcb080f7980 2022-02-02T21:15:04.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.500+0000 7fcb0d908700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 0x7fcaf4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.500+0000 7fcb0d908700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 0x7fcaf4067290 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fcafc013690 tx=0x7fcafc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:04.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.504+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb0404fcc0 con 0x7fcb080f7980 2022-02-02T21:15:04.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.681+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb08057f10 con 0x7fcaf4064dd0 2022-02-02T21:15:04.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.683+0000 7fcafa7fc700 1 -- 172.21.15.96:0/2339913029 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcb08057f10 con 0x7fcaf4064dd0 2022-02-02T21:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 msgr2=0x7fcaf4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 0x7fcaf4067290 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fcafc013690 tx=0x7fcafc009b30).stop 2022-02-02T21:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 msgr2=0x7fcb08069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 secure :-1 s=READY pgs=2660 cs=0 l=1 rev1=1 rx=0x7fcb0400c790 tx=0x7fcb04007d70).stop 2022-02-02T21:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 shutdown_connections 2022-02-02T21:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcaf4064dd0 0x7fcaf4067290 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb080f66e0 0x7fcb0806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 --2- 172.21.15.96:0/2339913029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb080f7980 0x7fcb08069e20 unknown :-1 s=CLOSED pgs=2660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 >> 172.21.15.96:0/2339913029 conn(0x7fcb080f1e40 msgr2=0x7fcb080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 shutdown_connections 2022-02-02T21:15:04.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.685+0000 7fcb0fb6c700 1 -- 172.21.15.96:0/2339913029 wait complete. 2022-02-02T21:15:04.696 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:15:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 -- 172.21.15.96:0/529615414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 msgr2=0x7fc7140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 --2- 172.21.15.96:0/529615414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc7140f5850 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 rx=0x7fc708004660 tx=0x7fc708009b30).stop 2022-02-02T21:15:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 -- 172.21.15.96:0/529615414 shutdown_connections 2022-02-02T21:15:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 --2- 172.21.15.96:0/529615414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 0x7fc7140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 --2- 172.21.15.96:0/529615414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc7140f5850 unknown :-1 s=CLOSED pgs=2661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 -- 172.21.15.96:0/529615414 >> 172.21.15.96:0/529615414 conn(0x7fc7140f0b90 msgr2=0x7fc7140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:04.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 -- 172.21.15.96:0/529615414 shutdown_connections 2022-02-02T21:15:04.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.782+0000 7fc71986f700 1 -- 172.21.15.96:0/529615414 wait complete. 2022-02-02T21:15:04.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.783+0000 7fc71986f700 1 Processor -- start 2022-02-02T21:15:04.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.783+0000 7fc71986f700 1 -- start start 2022-02-02T21:15:04.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71986f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71986f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 0x7fc71410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71986f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714060420 con 0x7fc7140f5430 2022-02-02T21:15:04.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71986f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714060560 con 0x7fc7140f66d0 2022-02-02T21:15:04.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41704/0 (socket says 172.21.15.96:41704) 2022-02-02T21:15:04.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 -- 172.21.15.96:0/1529130171 learned_addr learned my addr 172.21.15.96:0/1529130171 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:04.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc713fff700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 0x7fc71410bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 -- 172.21.15.96:0/1529130171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 msgr2=0x7fc71410bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 0x7fc71410bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 -- 172.21.15.96:0/1529130171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708005040 con 0x7fc7140f5430 2022-02-02T21:15:04.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71886d700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 rx=0x7fc708004f60 tx=0x7fc708009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:04.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc708018070 con 0x7fc7140f5430 2022-02-02T21:15:04.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc708009770 con 0x7fc7140f5430 2022-02-02T21:15:04.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70801c3c0 con 0x7fc7140f5430 2022-02-02T21:15:04.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.784+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71410c500 con 0x7fc7140f5430 2022-02-02T21:15:04.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.785+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71410ca30 con 0x7fc7140f5430 2022-02-02T21:15:04.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.786+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc714059100 con 0x7fc7140f5430 2022-02-02T21:15:04.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.786+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc70801d420 con 0x7fc7140f5430 2022-02-02T21:15:04.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.786+0000 7fc7117fa700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 0x7fc7040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:04.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.786+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc708083730 con 0x7fc7140f5430 2022-02-02T21:15:04.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.786+0000 7fc713fff700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 0x7fc7040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:04.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.787+0000 7fc713fff700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 0x7fc7040672e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fc7000041d0 tx=0x7fc700009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:04.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.791+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc708051830 con 0x7fc7140f5430 2022-02-02T21:15:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.965+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7140fdd70 con 0x7fc704064e20 2022-02-02T21:15:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.974+0000 7fc7117fa700 1 -- 172.21.15.96:0/1529130171 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc7140fdd70 con 0x7fc704064e20 2022-02-02T21:15:04.977 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:15:04.977 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 2h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:15:04.977 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 2h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:15:04.978 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:15:04.978 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:15:04.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:15:04.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:15:04.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:15:04.979 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:15:04.980 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:15:04.980 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:15:04.980 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:15:04.980 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:15:04.981 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:15:04.981 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:15:04.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:15:04.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:15:04.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:15:04.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:15:04.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:15:04.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:15:04.982 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:15:04.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 msgr2=0x7fc7040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 0x7fc7040672e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fc7000041d0 tx=0x7fc700009040).stop 2022-02-02T21:15:04.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 msgr2=0x7fc714109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:04.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 rx=0x7fc708004f60 tx=0x7fc708009b30).stop 2022-02-02T21:15:04.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 shutdown_connections 2022-02-02T21:15:04.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc704064e20 0x7fc7040672e0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7140f5430 0x7fc714109a50 unknown :-1 s=CLOSED pgs=2662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 --2- 172.21.15.96:0/1529130171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7140f66d0 0x7fc71410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:04.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 >> 172.21.15.96:0/1529130171 conn(0x7fc7140f0b90 msgr2=0x7fc7140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:04.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 shutdown_connections 2022-02-02T21:15:04.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:04.976+0000 7fc71986f700 1 -- 172.21.15.96:0/1529130171 wait complete. 2022-02-02T21:15:05.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:04 smithi096 ceph-mon[101353]: pgmap v5189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:05.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 -- 172.21.15.96:0/30073573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 msgr2=0x7f72c80f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 --2- 172.21.15.96:0/30073573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c80f5df0 secure :-1 s=READY pgs=2663 cs=0 l=1 rev1=1 rx=0x7f72bc004660 tx=0x7f72bc009b30).stop 2022-02-02T21:15:05.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 -- 172.21.15.96:0/30073573 shutdown_connections 2022-02-02T21:15:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 --2- 172.21.15.96:0/30073573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c80f5df0 unknown :-1 s=CLOSED pgs=2663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 --2- 172.21.15.96:0/30073573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 0x7f72c80f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:15:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 -- 172.21.15.96:0/30073573 >> 172.21.15.96:0/30073573 conn(0x7f72c80f04c0 msgr2=0x7f72c80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 -- 172.21.15.96:0/30073573 shutdown_connections 2022-02-02T21:15:05.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.073+0000 7f72ce60f700 1 -- 172.21.15.96:0/30073573 wait complete. 2022-02-02T21:15:05.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 Processor -- start 2022-02-02T21:15:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 -- start start 2022-02-02T21:15:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 0x7f72c810c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80f56f0 con 0x7f72c80f5970 2022-02-02T21:15:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72ce60f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80f5830 con 0x7f72c80f6c60 2022-02-02T21:15:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41714/0 (socket says 172.21.15.96:41714) 2022-02-02T21:15:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.074+0000 7f72c7fff700 1 -- 172.21.15.96:0/2277654513 learned_addr learned my addr 172.21.15.96:0/2277654513 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c77fe700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 0x7f72c810c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c7fff700 1 -- 172.21.15.96:0/2277654513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 msgr2=0x7f72c810c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c7fff700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 0x7f72c810c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c7fff700 1 -- 172.21.15.96:0/2277654513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc005040 con 0x7f72c80f5970 2022-02-02T21:15:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c7fff700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 rx=0x7f72b800b410 tx=0x7f72b8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b80125f0 con 0x7f72c80f5970 2022-02-02T21:15:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c810c800 con 0x7f72c80f5970 2022-02-02T21:15:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72b800be30 con 0x7f72c80f5970 2022-02-02T21:15:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b8002a70 con 0x7f72c80f5970 2022-02-02T21:15:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.075+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c8105a80 con 0x7f72c80f5970 2022-02-02T21:15:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.076+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c8045ad0 con 0x7f72c80f5970 2022-02-02T21:15:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.077+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72b800f030 con 0x7f72c80f5970 2022-02-02T21:15:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.077+0000 7f72c4ff9700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 0x7f72b006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.077+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f72b8081ec0 con 0x7f72c80f5970 2022-02-02T21:15:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.077+0000 7f72c77fe700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 0x7f72b006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.077+0000 7f72c77fe700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 0x7f72b006b6a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f72bc004580 tx=0x7f72bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.082+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72b804ffc0 con 0x7f72c80f5970 2022-02-02T21:15:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:04 smithi159 ceph-mon[69013]: pgmap v5189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.314+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72c80fdf60 con 0x7f72c80f5970 2022-02-02T21:15:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.314+0000 7f72c4ff9700 1 -- 172.21.15.96:0/2277654513 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f72b80535e0 con 0x7f72c80f5970 2022-02-02T21:15:05.316 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:15:05.316 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:15:05.316 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:15:05.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:05.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:15:05.317 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:15:05.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:05.317 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:15:05.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:15:05.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:05.318 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:15:05.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:15:05.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:05.319 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:15:05.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:15:05.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:15:05.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:15:05.320 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:15:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.315+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 msgr2=0x7f72b006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.315+0000 7f72ce60f700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 0x7f72b006b6a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f72bc004580 tx=0x7f72bc009b30).stop 2022-02-02T21:15:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.315+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 msgr2=0x7f72c8109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.315+0000 7f72ce60f700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 rx=0x7f72b800b410 tx=0x7f72b8006ef0).stop 2022-02-02T21:15:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 shutdown_connections 2022-02-02T21:15:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72b00691e0 0x7f72b006b6a0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c80f5970 0x7f72c8109ca0 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 --2- 172.21.15.96:0/2277654513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c80f6c60 0x7f72c810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 >> 172.21.15.96:0/2277654513 conn(0x7f72c80f04c0 msgr2=0x7f72c80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 shutdown_connections 2022-02-02T21:15:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.316+0000 7f72ce60f700 1 -- 172.21.15.96:0/2277654513 wait complete. 2022-02-02T21:15:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 -- 172.21.15.96:0/5764553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f55c0 msgr2=0x7f27980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 --2- 172.21.15.96:0/5764553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f55c0 0x7f27980f59e0 secure :-1 s=READY pgs=2665 cs=0 l=1 rev1=1 rx=0x7f2788004660 tx=0x7f2788009b30).stop 2022-02-02T21:15:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 -- 172.21.15.96:0/5764553 shutdown_connections 2022-02-02T21:15:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 --2- 172.21.15.96:0/5764553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f6860 0x7f27980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 --2- 172.21.15.96:0/5764553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f55c0 0x7f27980f59e0 unknown :-1 s=CLOSED pgs=2665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 -- 172.21.15.96:0/5764553 >> 172.21.15.96:0/5764553 conn(0x7f27980f0d40 msgr2=0x7f27980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 -- 172.21.15.96:0/5764553 shutdown_connections 2022-02-02T21:15:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.414+0000 7f279ff97700 1 -- 172.21.15.96:0/5764553 wait complete. 2022-02-02T21:15:05.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 Processor -- start 2022-02-02T21:15:05.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 -- start start 2022-02-02T21:15:05.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f55c0 0x7f2798109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980603c0 con 0x7f27980f6860 2022-02-02T21:15:05.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279ff97700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798060500 con 0x7f27980f55c0 2022-02-02T21:15:05.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41726/0 (socket says 172.21.15.96:41726) 2022-02-02T21:15:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 -- 172.21.15.96:0/2370835182 learned_addr learned my addr 172.21.15.96:0/2370835182 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279dd33700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f55c0 0x7f2798109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 -- 172.21.15.96:0/2370835182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f55c0 msgr2=0x7f2798109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f55c0 0x7f2798109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.416+0000 7f279d532700 1 -- 172.21.15.96:0/2370835182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788005040 con 0x7f27980f6860 2022-02-02T21:15:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f279d532700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 rx=0x7f27940026d0 tx=0x7f2794009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27940079c0 con 0x7f27980f6860 2022-02-02T21:15:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f279400f040 con 0x7f27980f6860 2022-02-02T21:15:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279810c740 con 0x7f27980f6860 2022-02-02T21:15:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27940148b0 con 0x7f27980f6860 2022-02-02T21:15:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.417+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279810ccd0 con 0x7f27980f6860 2022-02-02T21:15:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.418+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27980f49b0 con 0x7f27980f6860 2022-02-02T21:15:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.418+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2794007b20 con 0x7f27980f6860 2022-02-02T21:15:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.419+0000 7f278e7fc700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 0x7f2784067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.419+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2794081990 con 0x7f27980f6860 2022-02-02T21:15:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.419+0000 7f279dd33700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 0x7f2784067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.419+0000 7f279dd33700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 0x7f2784067290 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f2788013690 tx=0x7f2788009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.423+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f279404fa90 con 0x7f27980f6860 2022-02-02T21:15:05.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.621+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2798045ad0 con 0x7f27980f6860 2022-02-02T21:15:05.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.622+0000 7f278e7fc700 1 -- 172.21.15.96:0/2370835182 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f27940530b0 con 0x7f27980f6860 2022-02-02T21:15:05.624 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:15:05.624 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:15:05.624 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:15:05.625 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:15:05.625 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:05.625 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:15:05.626 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:15:05.626 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:15:05.626 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:15:05.626 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:15:05.626 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:15:05.627 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:15:05.627 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:15:05.627 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:15:05.628 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:15:05.628 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:15:05.628 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:15:05.628 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:15:05.628 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:15:05.629 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:15:05.629 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:15:05.629 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:15:05.629 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:15:05.630 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:15:05.630 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:15:05.630 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:15:05.630 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:15:05.630 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:15:05.631 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:15:05.631 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:15:05.631 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:15:05.631 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:15:05.632 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:05.632 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:05.632 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:15:05.632 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:05.632 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:05.633 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:05.633 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:05.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 msgr2=0x7f2784067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 0x7f2784067290 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f2788013690 tx=0x7f2788009b30).stop 2022-02-02T21:15:05.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 msgr2=0x7f279810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:05.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 rx=0x7f27940026d0 tx=0x7f2794009de0).stop 2022-02-02T21:15:05.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 shutdown_connections 2022-02-02T21:15:05.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2784064dd0 0x7f2784067290 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27980f55c0 0x7f2798109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 --2- 172.21.15.96:0/2370835182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27980f6860 0x7f279810c190 unknown :-1 s=CLOSED pgs=2666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.623+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 >> 172.21.15.96:0/2370835182 conn(0x7f27980f0d40 msgr2=0x7f27980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.624+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 shutdown_connections 2022-02-02T21:15:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:05.624+0000 7f279ff97700 1 -- 172.21.15.96:0/2370835182 wait complete. 2022-02-02T21:15:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:15:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:05 smithi159 ceph-mon[69013]: from='client.39426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:05 smithi159 ceph-mon[69013]: from='client.39430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2277654513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:15:06.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2370835182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:15:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:05 smithi096 ceph-mon[101353]: from='client.39426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:05 smithi096 ceph-mon[101353]: from='client.39430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2277654513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:15:06.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2370835182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:15:07.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:06 smithi159 ceph-mon[69013]: pgmap v5190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:06 smithi096 ceph-mon[101353]: pgmap v5190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:08 smithi159 ceph-mon[69013]: pgmap v5191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:08 smithi096 ceph-mon[101353]: pgmap v5191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:10 smithi159 ceph-mon[69013]: pgmap v5192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:10 smithi096 ceph-mon[101353]: pgmap v5192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:12 smithi096 ceph-mon[101353]: pgmap v5193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:12 smithi159 ceph-mon[69013]: pgmap v5193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:14 smithi159 ceph-mon[69013]: pgmap v5194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:14 smithi096 ceph-mon[101353]: pgmap v5194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:16 smithi159 ceph-mon[69013]: pgmap v5195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:16 smithi096 ceph-mon[101353]: pgmap v5195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:18 smithi159 ceph-mon[69013]: pgmap v5196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:18 smithi096 ceph-mon[101353]: pgmap v5196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:20 smithi159 ceph-mon[69013]: pgmap v5197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:20 smithi096 ceph-mon[101353]: pgmap v5197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:22 smithi096 ceph-mon[101353]: pgmap v5198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:22 smithi159 ceph-mon[69013]: pgmap v5198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:24 smithi159 ceph-mon[69013]: pgmap v5199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:24 smithi096 ceph-mon[101353]: pgmap v5199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:26 smithi159 ceph-mon[69013]: pgmap v5200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:26 smithi096 ceph-mon[101353]: pgmap v5200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:15:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:15:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:28 smithi159 ceph-mon[69013]: pgmap v5201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:15:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:15:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:28 smithi096 ceph-mon[101353]: pgmap v5201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:30 smithi159 ceph-mon[69013]: pgmap v5202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:30 smithi096 ceph-mon[101353]: pgmap v5202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:33.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:32 smithi096 ceph-mon[101353]: pgmap v5203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:32 smithi159 ceph-mon[69013]: pgmap v5203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:34 smithi159 ceph-mon[69013]: pgmap v5204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:34 smithi096 ceph-mon[101353]: pgmap v5204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 -- 172.21.15.96:0/2991201149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 msgr2=0x7f15800f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 --2- 172.21.15.96:0/2991201149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f15800f5180 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 rx=0x7f1570004660 tx=0x7f1570009b30).stop 2022-02-02T21:15:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 -- 172.21.15.96:0/2991201149 shutdown_connections 2022-02-02T21:15:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 --2- 172.21.15.96:0/2991201149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f15800f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:15:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 --2- 172.21.15.96:0/2991201149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f15800f5180 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 -- 172.21.15.96:0/2991201149 >> 172.21.15.96:0/2991201149 conn(0x7f15800f04c0 msgr2=0x7f15800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 -- 172.21.15.96:0/2991201149 shutdown_connections 2022-02-02T21:15:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.732+0000 7f158508b700 1 -- 172.21.15.96:0/2991201149 wait complete. 2022-02-02T21:15:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.733+0000 7f158508b700 1 Processor -- start 2022-02-02T21:15:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.733+0000 7f158508b700 1 -- start start 2022-02-02T21:15:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f158508b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f158508b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f158010c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f158508b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15800f8040 con 0x7f15800f4d60 2022-02-02T21:15:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f158508b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15800f8180 con 0x7f15800f5f60 2022-02-02T21:15:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41744/0 (socket says 172.21.15.96:41744) 2022-02-02T21:15:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 -- 172.21.15.96:0/2972644308 learned_addr learned my addr 172.21.15.96:0/2972644308 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157e59c700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f158010c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 -- 172.21.15.96:0/2972644308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 msgr2=0x7f158010c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f158010c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 -- 172.21.15.96:0/2972644308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570005040 con 0x7f15800f4d60 2022-02-02T21:15:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157e59c700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f158010c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:15:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f157ed9d700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 rx=0x7f1570004e30 tx=0x7f1570009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1570018070 con 0x7f15800f4d60 2022-02-02T21:15:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158010c7e0 con 0x7f15800f4d60 2022-02-02T21:15:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1570007d70 con 0x7f15800f4d60 2022-02-02T21:15:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.734+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157001c620 con 0x7f15800f4d60 2022-02-02T21:15:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.735+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158010cd40 con 0x7f15800f4d60 2022-02-02T21:15:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.735+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580045ad0 con 0x7f15800f4d60 2022-02-02T21:15:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.736+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f157001c890 con 0x7f15800f4d60 2022-02-02T21:15:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.736+0000 7f15677fe700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 0x7f1568067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.736+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1570083840 con 0x7f15800f4d60 2022-02-02T21:15:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.736+0000 7f157e59c700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 0x7f1568067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.737+0000 7f157e59c700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 0x7f1568067270 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f157400a7e0 tx=0x7f1574008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.740+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1570051a00 con 0x7f15800f4d60 2022-02-02T21:15:35.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.918+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15800faa40 con 0x7f1568064db0 2022-02-02T21:15:35.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.920+0000 7f15677fe700 1 -- 172.21.15.96:0/2972644308 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f15800faa40 con 0x7f1568064db0 2022-02-02T21:15:35.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.921+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 msgr2=0x7f1568067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:35.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.921+0000 7f158508b700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 0x7f1568067270 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f157400a7e0 tx=0x7f1574008040).stop 2022-02-02T21:15:35.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.921+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 msgr2=0x7f1580109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:35.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.921+0000 7f158508b700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 rx=0x7f1570004e30 tx=0x7f1570009b30).stop 2022-02-02T21:15:35.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 shutdown_connections 2022-02-02T21:15:35.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064db0 0x7f1568067270 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:35.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f4d60 0x7f1580109d30 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:35.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 --2- 172.21.15.96:0/2972644308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f5f60 0x7f158010c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:35.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 >> 172.21.15.96:0/2972644308 conn(0x7f15800f04c0 msgr2=0x7f15800fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:35.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 shutdown_connections 2022-02-02T21:15:35.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:35.922+0000 7f158508b700 1 -- 172.21.15.96:0/2972644308 wait complete. 2022-02-02T21:15:35.934 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:15:36.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 -- 172.21.15.96:0/2572108375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f77d0 msgr2=0x7f66600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 --2- 172.21.15.96:0/2572108375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f77d0 0x7f66600f7c30 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 rx=0x7f6650004660 tx=0x7f6650009b30).stop 2022-02-02T21:15:36.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 -- 172.21.15.96:0/2572108375 shutdown_connections 2022-02-02T21:15:36.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 --2- 172.21.15.96:0/2572108375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f77d0 0x7f66600f7c30 unknown :-1 s=CLOSED pgs=2669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 --2- 172.21.15.96:0/2572108375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f6530 0x7f66600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.020+0000 7f6664e82700 1 -- 172.21.15.96:0/2572108375 >> 172.21.15.96:0/2572108375 conn(0x7f66600f1cd0 msgr2=0x7f66600f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.021+0000 7f6664e82700 1 -- 172.21.15.96:0/2572108375 shutdown_connections 2022-02-02T21:15:36.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.021+0000 7f6664e82700 1 -- 172.21.15.96:0/2572108375 wait complete. 2022-02-02T21:15:36.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.021+0000 7f6664e82700 1 Processor -- start 2022-02-02T21:15:36.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.021+0000 7f6664e82700 1 -- start start 2022-02-02T21:15:36.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f6664e82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f6664e82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f77d0 0x7f6660107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f6664e82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660107870 con 0x7f66600f6530 2022-02-02T21:15:36.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f6664e82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660108080 con 0x7f66600f77d0 2022-02-02T21:15:36.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41754/0 (socket says 172.21.15.96:41754) 2022-02-02T21:15:36.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 -- 172.21.15.96:0/789362959 learned_addr learned my addr 172.21.15.96:0/789362959 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:36.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665effd700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f77d0 0x7f6660107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 -- 172.21.15.96:0/789362959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f77d0 msgr2=0x7f6660107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f77d0 0x7f6660107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 -- 172.21.15.96:0/789362959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650005040 con 0x7f66600f6530 2022-02-02T21:15:36.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f665f7fe700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 rx=0x7f665400c790 tx=0x7f6654007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.022+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665400e680 con 0x7f66600f6530 2022-02-02T21:15:36.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.023+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6660108300 con 0x7f66600f6530 2022-02-02T21:15:36.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.023+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f665400ec90 con 0x7f66600f6530 2022-02-02T21:15:36.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.023+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6654012d00 con 0x7f66600f6530 2022-02-02T21:15:36.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.023+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66601088c0 con 0x7f66600f6530 2022-02-02T21:15:36.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.024+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6660059100 con 0x7f66600f6530 2022-02-02T21:15:36.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.024+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6654010070 con 0x7f66600f6530 2022-02-02T21:15:36.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.024+0000 7f6647fff700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 0x7f66480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.024+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6654081b70 con 0x7f66600f6530 2022-02-02T21:15:36.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.024+0000 7f665effd700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 0x7f66480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.025+0000 7f665effd700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 0x7f66480672e0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f6650004e30 tx=0x7f6650009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.029+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f665404fc70 con 0x7f66600f6530 2022-02-02T21:15:36.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.201+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66600008d0 con 0x7f6648064e20 2022-02-02T21:15:36.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.210+0000 7f6647fff700 1 -- 172.21.15.96:0/789362959 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f66600008d0 con 0x7f6648064e20 2022-02-02T21:15:36.213 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:15:36.214 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:15:36.214 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:15:36.215 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 2h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:15:36.215 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 2h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:15:36.215 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:15:36.216 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:15:36.216 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:15:36.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:15:36.217 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:15:36.218 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 2h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:15:36.218 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:15:36.219 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:15:36.219 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2h) 2h ago 2h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:15:36.220 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:15:36.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:15:36.221 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:15:36.221 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:15:36.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:15:36.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:15:36.223 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:15:36.223 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 2h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:15:36.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 msgr2=0x7f66480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 0x7f66480672e0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f6650004e30 tx=0x7f6650009b30).stop 2022-02-02T21:15:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 msgr2=0x7f6660106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 rx=0x7f665400c790 tx=0x7f6654007d90).stop 2022-02-02T21:15:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 shutdown_connections 2022-02-02T21:15:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6648064e20 0x7f66480672e0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66600f6530 0x7f6660106d80 unknown :-1 s=CLOSED pgs=2670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 --2- 172.21.15.96:0/789362959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66600f77d0 0x7f6660107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 >> 172.21.15.96:0/789362959 conn(0x7f66600f1cd0 msgr2=0x7f66600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 shutdown_connections 2022-02-02T21:15:36.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.212+0000 7f6664e82700 1 -- 172.21.15.96:0/789362959 wait complete. 2022-02-02T21:15:36.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 -- 172.21.15.96:0/728308314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 msgr2=0x7f33c80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 --2- 172.21.15.96:0/728308314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c80f5850 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 rx=0x7f33b8004660 tx=0x7f33b8009b30).stop 2022-02-02T21:15:36.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 -- 172.21.15.96:0/728308314 shutdown_connections 2022-02-02T21:15:36.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 --2- 172.21.15.96:0/728308314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 --2- 172.21.15.96:0/728308314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c80f5850 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 -- 172.21.15.96:0/728308314 >> 172.21.15.96:0/728308314 conn(0x7f33c80f0b90 msgr2=0x7f33c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 -- 172.21.15.96:0/728308314 shutdown_connections 2022-02-02T21:15:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.308+0000 7f33c759e700 1 -- 172.21.15.96:0/728308314 wait complete. 2022-02-02T21:15:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 Processor -- start 2022-02-02T21:15:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 -- start start 2022-02-02T21:15:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c8106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c81067d0 con 0x7f33c80f5430 2022-02-02T21:15:36.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8106fd0 con 0x7f33c80f66d0 2022-02-02T21:15:36.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41764/0 (socket says 172.21.15.96:41764) 2022-02-02T21:15:36.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c659c700 1 -- 172.21.15.96:0/510008615 learned_addr learned my addr 172.21.15.96:0/510008615 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:36.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.309+0000 7f33c5d9b700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c8106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c659c700 1 -- 172.21.15.96:0/510008615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 msgr2=0x7f33c8106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c659c700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c8106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c659c700 1 -- 172.21.15.96:0/510008615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8005040 con 0x7f33c80f5430 2022-02-02T21:15:36.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c5d9b700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c8106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:15:36.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c659c700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 rx=0x7f33b8009830 tx=0x7f33b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b8018070 con 0x7f33c80f5430 2022-02-02T21:15:36.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c8107250 con 0x7f33c80f5430 2022-02-02T21:15:36.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33b8007ba0 con 0x7f33c80f5430 2022-02-02T21:15:36.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b801c620 con 0x7f33c80f5430 2022-02-02T21:15:36.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.310+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81077b0 con 0x7f33c80f5430 2022-02-02T21:15:36.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.311+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac004fa0 con 0x7f33c80f5430 2022-02-02T21:15:36.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.311+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f33b8007d10 con 0x7f33c80f5430 2022-02-02T21:15:36.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.312+0000 7f33b6ffd700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 0x7f33b00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.312+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f33b80837a0 con 0x7f33c80f5430 2022-02-02T21:15:36.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.312+0000 7f33c5d9b700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 0x7f33b00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.312+0000 7f33c5d9b700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 0x7f33b00672e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f33bc009740 tx=0x7f33bc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.316+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f33b8055390 con 0x7f33c80f5430 2022-02-02T21:15:36.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.547+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33ac005e80 con 0x7f33c80f5430 2022-02-02T21:15:36.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.548+0000 7f33b6ffd700 1 -- 172.21.15.96:0/510008615 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f33b8054f80 con 0x7f33c80f5430 2022-02-02T21:15:36.550 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:15:36.551 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:15:36.551 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:15:36.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:36.551 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:15:36.552 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:15:36.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:36.552 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:15:36.552 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:15:36.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:36.553 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:15:36.553 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:15:36.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:15:36.553 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:15:36.554 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:15:36.554 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:15:36.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:15:36.554 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:15:36.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.549+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 msgr2=0x7f33b00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 0x7f33b00672e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f33bc009740 tx=0x7f33bc009be0).stop 2022-02-02T21:15:36.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 msgr2=0x7f33c8105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 rx=0x7f33b8009830 tx=0x7f33b8009b30).stop 2022-02-02T21:15:36.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 shutdown_connections 2022-02-02T21:15:36.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33b0064e20 0x7f33b00672e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33c80f5430 0x7f33c8105d30 unknown :-1 s=CLOSED pgs=2672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 --2- 172.21.15.96:0/510008615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80f66d0 0x7f33c8106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 >> 172.21.15.96:0/510008615 conn(0x7f33c80f0b90 msgr2=0x7f33c80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 shutdown_connections 2022-02-02T21:15:36.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.550+0000 7f33c759e700 1 -- 172.21.15.96:0/510008615 wait complete. 2022-02-02T21:15:36.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 -- 172.21.15.96:0/3014903632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f66e0 msgr2=0x7f85a80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 --2- 172.21.15.96:0/3014903632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f66e0 0x7f85a80f6b00 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 rx=0x7f85a00099e0 tx=0x7f85a0004d10).stop 2022-02-02T21:15:36.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 -- 172.21.15.96:0/3014903632 shutdown_connections 2022-02-02T21:15:36.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 --2- 172.21.15.96:0/3014903632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f7980 0x7f85a80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 --2- 172.21.15.96:0/3014903632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f66e0 0x7f85a80f6b00 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 -- 172.21.15.96:0/3014903632 >> 172.21.15.96:0/3014903632 conn(0x7f85a80f1e40 msgr2=0x7f85a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 -- 172.21.15.96:0/3014903632 shutdown_connections 2022-02-02T21:15:36.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.647+0000 7f85ac91d700 1 -- 172.21.15.96:0/3014903632 wait complete. 2022-02-02T21:15:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 Processor -- start 2022-02-02T21:15:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 -- start start 2022-02-02T21:15:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f66e0 0x7f85a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a806a380 con 0x7f85a80f7980 2022-02-02T21:15:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85ac91d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a806a4c0 con 0x7f85a80f66e0 2022-02-02T21:15:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41776/0 (socket says 172.21.15.96:41776) 2022-02-02T21:15:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 -- 172.21.15.96:0/428408630 learned_addr learned my addr 172.21.15.96:0/428408630 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:15:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a659c700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f66e0 0x7f85a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 -- 172.21.15.96:0/428408630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f66e0 msgr2=0x7f85a806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f66e0 0x7f85a806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.648+0000 7f85a5d9b700 1 -- 172.21.15.96:0/428408630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009640 con 0x7f85a80f7980 2022-02-02T21:15:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f85a5d9b700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 rx=0x7f859000c510 tx=0x7f8590007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859000f650 con 0x7f85a80f7980 2022-02-02T21:15:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a806a7a0 con 0x7f85a80f7980 2022-02-02T21:15:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f859000fc60 con 0x7f85a80f7980 2022-02-02T21:15:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8590012c50 con 0x7f85a80f7980 2022-02-02T21:15:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.649+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a810f100 con 0x7f85a80f7980 2022-02-02T21:15:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.650+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80f5ad0 con 0x7f85a80f7980 2022-02-02T21:15:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.651+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8590010070 con 0x7f85a80f7980 2022-02-02T21:15:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.651+0000 7f859effd700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 0x7f8594067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:15:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.651+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8590081750 con 0x7f85a80f7980 2022-02-02T21:15:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.651+0000 7f85a659c700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 0x7f8594067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:15:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.652+0000 7f85a659c700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 0x7f8594067290 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f85a00099b0 tx=0x7f85a0004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:15:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.656+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f859004f850 con 0x7f85a80f7980 2022-02-02T21:15:36.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.857+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85a8045ad0 con 0x7f85a80f7980 2022-02-02T21:15:36.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.858+0000 7f859effd700 1 -- 172.21.15.96:0/428408630 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8590052e70 con 0x7f85a80f7980 2022-02-02T21:15:36.861 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:15:36.861 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:15:36.861 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:15:36.861 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:15:36.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:36.862 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:15:36.862 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:15:36.862 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:15:36.863 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:15:36.863 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:15:36.863 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:15:36.863 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:15:36.864 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:15:36.864 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:15:36.864 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:15:36.864 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:15:36.864 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:15:36.865 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:15:36.865 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:15:36.865 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:15:36.865 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:15:36.866 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:15:36.866 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:15:36.866 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:15:36.866 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:15:36.867 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:15:36.867 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:15:36.867 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:15:36.867 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:15:36.868 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:15:36.868 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:15:36.868 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:15:36.868 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:36.869 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:36.869 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:15:36.869 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:15:36.869 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:36.869 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:36.870 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:15:36.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 msgr2=0x7f8594067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 0x7f8594067290 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f85a00099b0 tx=0x7f85a0004d10).stop 2022-02-02T21:15:36.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 msgr2=0x7f85a8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:15:36.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 rx=0x7f859000c510 tx=0x7f8590007e00).stop 2022-02-02T21:15:36.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 shutdown_connections 2022-02-02T21:15:36.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8594064dd0 0x7f8594067290 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85a80f66e0 0x7f85a806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 --2- 172.21.15.96:0/428408630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85a80f7980 0x7f85a8069e20 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:15:36.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 >> 172.21.15.96:0/428408630 conn(0x7f85a80f1e40 msgr2=0x7f85a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:15:36.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.859+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 shutdown_connections 2022-02-02T21:15:36.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:15:36.860+0000 7f85ac91d700 1 -- 172.21.15.96:0/428408630 wait complete. 2022-02-02T21:15:36.873 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:15:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:36 smithi159 ceph-mon[69013]: from='client.39442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:36 smithi159 ceph-mon[69013]: pgmap v5205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/510008615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:15:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/428408630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:15:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:36 smithi096 ceph-mon[101353]: from='client.39442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:36 smithi096 ceph-mon[101353]: pgmap v5205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/510008615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:15:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/428408630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:15:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:37 smithi159 ceph-mon[69013]: from='client.39446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:38.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:37 smithi096 ceph-mon[101353]: from='client.39446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:15:39.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:38 smithi159 ceph-mon[69013]: pgmap v5206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:38 smithi096 ceph-mon[101353]: pgmap v5206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:41.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:40 smithi159 ceph-mon[69013]: pgmap v5207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:40 smithi096 ceph-mon[101353]: pgmap v5207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:42 smithi159 ceph-mon[69013]: pgmap v5208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:42 smithi096 ceph-mon[101353]: pgmap v5208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:44 smithi159 ceph-mon[69013]: pgmap v5209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:44 smithi096 ceph-mon[101353]: pgmap v5209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:47 smithi159 ceph-mon[69013]: pgmap v5210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:46 smithi096 ceph-mon[101353]: pgmap v5210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:48 smithi159 ceph-mon[69013]: pgmap v5211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:48 smithi096 ceph-mon[101353]: pgmap v5211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:50 smithi159 ceph-mon[69013]: pgmap v5212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:51.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:50 smithi096 ceph-mon[101353]: pgmap v5212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:52 smithi096 ceph-mon[101353]: pgmap v5213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:52 smithi159 ceph-mon[69013]: pgmap v5213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:54 smithi159 ceph-mon[69013]: pgmap v5214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:55.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:54 smithi096 ceph-mon[101353]: pgmap v5214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:57.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:56 smithi159 ceph-mon[69013]: pgmap v5215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:56 smithi096 ceph-mon[101353]: pgmap v5215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:15:58 smithi159 ceph-mon[69013]: pgmap v5216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:15:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:15:58 smithi096 ceph-mon[101353]: pgmap v5216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:00 smithi159 ceph-mon[69013]: pgmap v5217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:01.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:00 smithi096 ceph-mon[101353]: pgmap v5217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:02 smithi159 ceph-mon[69013]: pgmap v5218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:03.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:02 smithi096 ceph-mon[101353]: pgmap v5218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:04 smithi159 ceph-mon[69013]: pgmap v5219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:05.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:04 smithi096 ceph-mon[101353]: pgmap v5219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 -- 172.21.15.96:0/1020044586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f77d0 msgr2=0x7f4f940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/1020044586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f77d0 0x7f4f940f7c30 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 rx=0x7f4f88004660 tx=0x7f4f88009b30).stop 2022-02-02T21:16:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 -- 172.21.15.96:0/1020044586 shutdown_connections 2022-02-02T21:16:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/1020044586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f77d0 0x7f4f940f7c30 unknown :-1 s=CLOSED pgs=2675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/1020044586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f6530 0x7f4f940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:16:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 -- 172.21.15.96:0/1020044586 >> 172.21.15.96:0/1020044586 conn(0x7f4f940f1c90 msgr2=0x7f4f940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 -- 172.21.15.96:0/1020044586 shutdown_connections 2022-02-02T21:16:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.970+0000 7f4f98c7c700 1 -- 172.21.15.96:0/1020044586 wait complete. 2022-02-02T21:16:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 Processor -- start 2022-02-02T21:16:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 -- start start 2022-02-02T21:16:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 0x7f4f941072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94107980 con 0x7f4f940f6530 2022-02-02T21:16:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.971+0000 7f4f98c7c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94108100 con 0x7f4f940f77d0 2022-02-02T21:16:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:06.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41794/0 (socket says 172.21.15.96:41794) 2022-02-02T21:16:06.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 -- 172.21.15.96:0/3273188888 learned_addr learned my addr 172.21.15.96:0/3273188888 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:06.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f92ffd700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 0x7f4f941072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:06.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 -- 172.21.15.96:0/3273188888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 msgr2=0x7f4f941072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:06.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 0x7f4f941072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:06.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 -- 172.21.15.96:0/3273188888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88005040 con 0x7f4f940f6530 2022-02-02T21:16:06.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f92ffd700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 0x7f4f941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:16:06.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f937fe700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 rx=0x7f4f840093f0 tx=0x7f4f84006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:06.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f84009ea0 con 0x7f4f940f6530 2022-02-02T21:16:06.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f84013af0 con 0x7f4f940f6530 2022-02-02T21:16:06.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f94108380 con 0x7f4f940f6530 2022-02-02T21:16:06.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8400db10 con 0x7f4f940f6530 2022-02-02T21:16:06.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.972+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94108940 con 0x7f4f940f6530 2022-02-02T21:16:06.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.973+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94045ad0 con 0x7f4f940f6530 2022-02-02T21:16:06.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.974+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f8401a060 con 0x7f4f940f6530 2022-02-02T21:16:06.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.974+0000 7f4f7bfff700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 0x7f4f7c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:06.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.974+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4f840819d0 con 0x7f4f940f6530 2022-02-02T21:16:06.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.974+0000 7f4f92ffd700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 0x7f4f7c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:06.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.975+0000 7f4f92ffd700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 0x7f4f7c0672e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f4f88004e30 tx=0x7f4f88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:06.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:06.978+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f8404fad0 con 0x7f4f940f6530 2022-02-02T21:16:07.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.158+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f940fef00 con 0x7f4f7c064e20 2022-02-02T21:16:07.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.159+0000 7f4f7bfff700 1 -- 172.21.15.96:0/3273188888 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4f940fef00 con 0x7f4f7c064e20 2022-02-02T21:16:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 msgr2=0x7f4f7c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 0x7f4f7c0672e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f4f88004e30 tx=0x7f4f88009b30).stop 2022-02-02T21:16:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 msgr2=0x7f4f94106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 rx=0x7f4f840093f0 tx=0x7f4f84006ec0).stop 2022-02-02T21:16:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 shutdown_connections 2022-02-02T21:16:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f7c064e20 0x7f4f7c0672e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f940f6530 0x7f4f94106e00 unknown :-1 s=CLOSED pgs=2676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 --2- 172.21.15.96:0/3273188888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f940f77d0 0x7f4f941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 >> 172.21.15.96:0/3273188888 conn(0x7f4f940f1c90 msgr2=0x7f4f940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 shutdown_connections 2022-02-02T21:16:07.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.161+0000 7f4f98c7c700 1 -- 172.21.15.96:0/3273188888 wait complete. 2022-02-02T21:16:07.172 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:16:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 -- 172.21.15.96:0/329589764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 msgr2=0x7fe4180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/329589764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe4180f7de0 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 rx=0x7fe414004660 tx=0x7fe414009b30).stop 2022-02-02T21:16:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 -- 172.21.15.96:0/329589764 shutdown_connections 2022-02-02T21:16:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/329589764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe4180f7de0 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/329589764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 0x7fe4180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 -- 172.21.15.96:0/329589764 >> 172.21.15.96:0/329589764 conn(0x7fe4180f1e40 msgr2=0x7fe4180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.262 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:06 smithi096 ceph-mon[101353]: pgmap v5220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 -- 172.21.15.96:0/329589764 shutdown_connections 2022-02-02T21:16:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.259+0000 7fe41f2ae700 1 -- 172.21.15.96:0/329589764 wait complete. 2022-02-02T21:16:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 Processor -- start 2022-02-02T21:16:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 -- start start 2022-02-02T21:16:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 0x7fe418106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418107a00 con 0x7fe4180f7980 2022-02-02T21:16:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41f2ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418107b40 con 0x7fe4180f66e0 2022-02-02T21:16:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41806/0 (socket says 172.21.15.96:41806) 2022-02-02T21:16:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 -- 172.21.15.96:0/2761176562 learned_addr learned my addr 172.21.15.96:0/2761176562 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41d04a700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 0x7fe418106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 -- 172.21.15.96:0/2761176562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 msgr2=0x7fe418106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 0x7fe418106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.260+0000 7fe41c849700 1 -- 172.21.15.96:0/2761176562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414005040 con 0x7fe4180f7980 2022-02-02T21:16:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe41c849700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 rx=0x7fe414009990 tx=0x7fe414009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe414018070 con 0x7fe4180f7980 2022-02-02T21:16:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe414007ba0 con 0x7fe4180f7980 2022-02-02T21:16:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe418108480 con 0x7fe4180f7980 2022-02-02T21:16:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41401c3c0 con 0x7fe4180f7980 2022-02-02T21:16:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.261+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4181089e0 con 0x7fe4180f7980 2022-02-02T21:16:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.262+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418045ad0 con 0x7fe4180f7980 2022-02-02T21:16:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.262+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe41401d420 con 0x7fe4180f7980 2022-02-02T21:16:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.263+0000 7fe40dffb700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 0x7fe404067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.263+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe4140836b0 con 0x7fe4180f7980 2022-02-02T21:16:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.263+0000 7fe41d04a700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 0x7fe404067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.263+0000 7fe41d04a700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 0x7fe404067290 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fe4180f77e0 tx=0x7fe40800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.267+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe414055240 con 0x7fe4180f7980 2022-02-02T21:16:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:06 smithi159 ceph-mon[69013]: pgmap v5220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:07.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.441+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4180fefb0 con 0x7fe404064dd0 2022-02-02T21:16:07.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.450+0000 7fe40dffb700 1 -- 172.21.15.96:0/2761176562 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe4180fefb0 con 0x7fe404064dd0 2022-02-02T21:16:07.451 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:16:07.452 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:16:07.452 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:16:07.452 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:16:07.452 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:16:07.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:16:07.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:16:07.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:16:07.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:16:07.454 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:16:07.454 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:16:07.454 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:16:07.454 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 2h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:16:07.454 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:16:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (2h) 2h ago 2h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:16:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:16:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:16:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:16:07.456 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:16:07.456 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:16:07.456 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:16:07.456 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:16:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 msgr2=0x7fe404067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 0x7fe404067290 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fe4180f77e0 tx=0x7fe40800b040).stop 2022-02-02T21:16:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 msgr2=0x7fe418107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 rx=0x7fe414009990 tx=0x7fe414009b30).stop 2022-02-02T21:16:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 shutdown_connections 2022-02-02T21:16:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064dd0 0x7fe404067290 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f66e0 0x7fe418106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 --2- 172.21.15.96:0/2761176562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f7980 0x7fe418107450 unknown :-1 s=CLOSED pgs=2678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 >> 172.21.15.96:0/2761176562 conn(0x7fe4180f1e40 msgr2=0x7fe4180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 shutdown_connections 2022-02-02T21:16:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.452+0000 7fe41f2ae700 1 -- 172.21.15.96:0/2761176562 wait complete. 2022-02-02T21:16:07.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 -- 172.21.15.96:0/2583941303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f6860 msgr2=0x7efda00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 --2- 172.21.15.96:0/2583941303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f6860 0x7efda00f6cc0 secure :-1 s=READY pgs=2679 cs=0 l=1 rev1=1 rx=0x7efd90004660 tx=0x7efd90009b30).stop 2022-02-02T21:16:07.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 -- 172.21.15.96:0/2583941303 shutdown_connections 2022-02-02T21:16:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 --2- 172.21.15.96:0/2583941303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f6860 0x7efda00f6cc0 unknown :-1 s=CLOSED pgs=2679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 --2- 172.21.15.96:0/2583941303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f55c0 0x7efda00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:16:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 -- 172.21.15.96:0/2583941303 >> 172.21.15.96:0/2583941303 conn(0x7efda00f0d40 msgr2=0x7efda00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 -- 172.21.15.96:0/2583941303 shutdown_connections 2022-02-02T21:16:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.549+0000 7efda4c9a700 1 -- 172.21.15.96:0/2583941303 wait complete. 2022-02-02T21:16:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 Processor -- start 2022-02-02T21:16:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 -- start start 2022-02-02T21:16:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f6860 0x7efda0109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda0109ca0 con 0x7efda00f55c0 2022-02-02T21:16:07.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efda4c9a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda010a550 con 0x7efda00f6860 2022-02-02T21:16:07.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41814/0 (socket says 172.21.15.96:41814) 2022-02-02T21:16:07.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 -- 172.21.15.96:0/971283554 learned_addr learned my addr 172.21.15.96:0/971283554 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:07.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9dd9b700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f6860 0x7efda0109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 -- 172.21.15.96:0/971283554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f6860 msgr2=0x7efda0109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f6860 0x7efda0109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 -- 172.21.15.96:0/971283554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90005040 con 0x7efda00f55c0 2022-02-02T21:16:07.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.550+0000 7efd9e59c700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 rx=0x7efd880093f0 tx=0x7efd88006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.551+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd88009ea0 con 0x7efda00f55c0 2022-02-02T21:16:07.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.551+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd88013af0 con 0x7efda00f55c0 2022-02-02T21:16:07.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.551+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda010a830 con 0x7efda00f55c0 2022-02-02T21:16:07.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.551+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda010adf0 con 0x7efda00f55c0 2022-02-02T21:16:07.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.551+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8800db10 con 0x7efda00f55c0 2022-02-02T21:16:07.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.552+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd8801a060 con 0x7efda00f55c0 2022-02-02T21:16:07.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.552+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd84004fa0 con 0x7efda00f55c0 2022-02-02T21:16:07.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.552+0000 7efd96ffd700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 0x7efd8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.552+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efd88081a20 con 0x7efda00f55c0 2022-02-02T21:16:07.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.552+0000 7efd9dd9b700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 0x7efd8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.553+0000 7efd9dd9b700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 0x7efd8c067290 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7efd90004e30 tx=0x7efd90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.557+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd88053600 con 0x7efda00f55c0 2022-02-02T21:16:07.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.785+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd84005e80 con 0x7efda00f55c0 2022-02-02T21:16:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.785+0000 7efd96ffd700 1 -- 172.21.15.96:0/971283554 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7efd880182e0 con 0x7efda00f55c0 2022-02-02T21:16:07.787 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:16:07.787 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:16:07.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:16:07.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:07.788 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:16:07.788 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:16:07.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:07.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:16:07.789 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:16:07.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:07.789 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:16:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:16:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:16:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:16:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:16:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:16:07.791 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:16:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 msgr2=0x7efd8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 0x7efd8c067290 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7efd90004e30 tx=0x7efd90009b30).stop 2022-02-02T21:16:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 msgr2=0x7efda0109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 rx=0x7efd880093f0 tx=0x7efd88006ec0).stop 2022-02-02T21:16:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 shutdown_connections 2022-02-02T21:16:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd8c064dd0 0x7efd8c067290 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efda00f55c0 0x7efda0109170 unknown :-1 s=CLOSED pgs=2680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 --2- 172.21.15.96:0/971283554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efda00f6860 0x7efda0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 >> 172.21.15.96:0/971283554 conn(0x7efda00f0d40 msgr2=0x7efda005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 shutdown_connections 2022-02-02T21:16:07.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.787+0000 7efda4c9a700 1 -- 172.21.15.96:0/971283554 wait complete. 2022-02-02T21:16:07.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 -- 172.21.15.96:0/1449867017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f66e0 msgr2=0x7f9e8c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/1449867017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c0f6b40 secure :-1 s=READY pgs=2681 cs=0 l=1 rev1=1 rx=0x7f9e7c004660 tx=0x7f9e7c009b30).stop 2022-02-02T21:16:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 -- 172.21.15.96:0/1449867017 shutdown_connections 2022-02-02T21:16:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/1449867017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c0f6b40 unknown :-1 s=CLOSED pgs=2681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/1449867017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 -- 172.21.15.96:0/1449867017 >> 172.21.15.96:0/1449867017 conn(0x7f9e8c0f0ba0 msgr2=0x7f9e8c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:07.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 -- 172.21.15.96:0/1449867017 shutdown_connections 2022-02-02T21:16:07.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.885+0000 7f9e8b59e700 1 -- 172.21.15.96:0/1449867017 wait complete. 2022-02-02T21:16:07.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 Processor -- start 2022-02-02T21:16:07.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 -- start start 2022-02-02T21:16:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c10bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0603c0 con 0x7f9e8c0f5440 2022-02-02T21:16:07.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c060500 con 0x7f9e8c0f66e0 2022-02-02T21:16:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41824/0 (socket says 172.21.15.96:41824) 2022-02-02T21:16:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e8a59c700 1 -- 172.21.15.96:0/2643551220 learned_addr learned my addr 172.21.15.96:0/2643551220 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.886+0000 7f9e89d9b700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c10bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8a59c700 1 -- 172.21.15.96:0/2643551220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f66e0 msgr2=0x7f9e8c10bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8a59c700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c10bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8a59c700 1 -- 172.21.15.96:0/2643551220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c005040 con 0x7f9e8c0f5440 2022-02-02T21:16:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8a59c700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 rx=0x7f9e80002700 tx=0x7f9e80009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e80009320 con 0x7f9e8c0f5440 2022-02-02T21:16:07.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e8000f040 con 0x7f9e8c0f5440 2022-02-02T21:16:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c10c450 con 0x7f9e8c0f5440 2022-02-02T21:16:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e800148e0 con 0x7f9e8c0f5440 2022-02-02T21:16:07.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.887+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c10c9e0 con 0x7f9e8c0f5440 2022-02-02T21:16:07.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.888+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c059100 con 0x7f9e8c0f5440 2022-02-02T21:16:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.888+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e80009480 con 0x7f9e8c0f5440 2022-02-02T21:16:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.889+0000 7f9e7affd700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 0x7f9e740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.889+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e80081d60 con 0x7f9e8c0f5440 2022-02-02T21:16:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.889+0000 7f9e89d9b700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 0x7f9e740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.889+0000 7f9e89d9b700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 0x7f9e740672e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f9e7c004630 tx=0x7f9e7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:07.893+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e8004fe60 con 0x7f9e8c0f5440 2022-02-02T21:16:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.096+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e8c0586e0 con 0x7f9e8c0f5440 2022-02-02T21:16:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.097+0000 7f9e7affd700 1 -- 172.21.15.96:0/2643551220 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9e80053480 con 0x7f9e8c0f5440 2022-02-02T21:16:08.099 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:16:08.099 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:16:08.099 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:16:08.099 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:16:08.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:08.100 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:16:08.100 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:16:08.100 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:16:08.100 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:16:08.101 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:16:08.101 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:16:08.101 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:16:08.101 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:16:08.101 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:16:08.102 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:16:08.102 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:16:08.102 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:16:08.103 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:16:08.103 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:16:08.103 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:16:08.103 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:16:08.103 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:16:08.104 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:16:08.104 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:16:08.104 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:16:08.104 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:16:08.104 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:16:08.105 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:16:08.105 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:16:08.105 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:16:08.105 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:16:08.106 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:16:08.106 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:08.106 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:08.106 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:16:08.106 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:08.107 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:08.107 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:08.107 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:08.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 msgr2=0x7f9e740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:08.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 0x7f9e740672e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f9e7c004630 tx=0x7f9e7c009b30).stop 2022-02-02T21:16:08.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 msgr2=0x7f9e8c1099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:08.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 rx=0x7f9e80002700 tx=0x7f9e80009e00).stop 2022-02-02T21:16:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 shutdown_connections 2022-02-02T21:16:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.098+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e74064e20 0x7f9e740672e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.099+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e8c0f5440 0x7f9e8c1099a0 unknown :-1 s=CLOSED pgs=2682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.099+0000 7f9e8b59e700 1 --2- 172.21.15.96:0/2643551220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c0f66e0 0x7f9e8c10bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:08.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.099+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 >> 172.21.15.96:0/2643551220 conn(0x7f9e8c0f0ba0 msgr2=0x7f9e8c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:08.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.099+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 shutdown_connections 2022-02-02T21:16:08.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:08.099+0000 7f9e8b59e700 1 -- 172.21.15.96:0/2643551220 wait complete. 2022-02-02T21:16:08.111 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:16:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:08 smithi159 ceph-mon[69013]: from='client.39458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:08 smithi159 ceph-mon[69013]: from='client.39462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/971283554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:16:08.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:08 smithi159 ceph-mon[69013]: pgmap v5221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:08.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2643551220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:16:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:08 smithi096 ceph-mon[101353]: from='client.39458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:08 smithi096 ceph-mon[101353]: from='client.39462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/971283554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:16:08.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:08 smithi096 ceph-mon[101353]: pgmap v5221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:08.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2643551220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:16:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:10 smithi159 ceph-mon[69013]: pgmap v5222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:10 smithi096 ceph-mon[101353]: pgmap v5222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:12 smithi159 ceph-mon[69013]: pgmap v5223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:13.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:12 smithi096 ceph-mon[101353]: pgmap v5223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:15.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:14 smithi159 ceph-mon[69013]: pgmap v5224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:14 smithi096 ceph-mon[101353]: pgmap v5224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:16 smithi159 ceph-mon[69013]: pgmap v5225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:17.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:16 smithi096 ceph-mon[101353]: pgmap v5225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:18 smithi159 ceph-mon[69013]: pgmap v5226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:18.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:18 smithi096 ceph-mon[101353]: pgmap v5226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:20 smithi159 ceph-mon[69013]: pgmap v5227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:20 smithi096 ceph-mon[101353]: pgmap v5227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:22 smithi159 ceph-mon[69013]: pgmap v5228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:22 smithi096 ceph-mon[101353]: pgmap v5228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:24 smithi159 ceph-mon[69013]: pgmap v5229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:24 smithi096 ceph-mon[101353]: pgmap v5229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:26 smithi159 ceph-mon[69013]: pgmap v5230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:26 smithi096 ceph-mon[101353]: pgmap v5230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:16:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:16:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:28 smithi159 ceph-mon[69013]: pgmap v5231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:16:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:16:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:28 smithi096 ceph-mon[101353]: pgmap v5231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:30 smithi159 ceph-mon[69013]: pgmap v5232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:30 smithi096 ceph-mon[101353]: pgmap v5232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:32 smithi159 ceph-mon[69013]: pgmap v5233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:33.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:32 smithi096 ceph-mon[101353]: pgmap v5233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:34 smithi159 ceph-mon[69013]: pgmap v5234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:35.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:34 smithi096 ceph-mon[101353]: pgmap v5234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:37.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:37 smithi159 ceph-mon[69013]: pgmap v5235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:37 smithi096 ceph-mon[101353]: pgmap v5235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:38.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 -- 172.21.15.96:0/1214850717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f6860 msgr2=0x7f69800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 --2- 172.21.15.96:0/1214850717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f6860 0x7f69800f6cc0 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 rx=0x7f696c004660 tx=0x7f696c009b30).stop 2022-02-02T21:16:38.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 -- 172.21.15.96:0/1214850717 shutdown_connections 2022-02-02T21:16:38.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 --2- 172.21.15.96:0/1214850717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f6860 0x7f69800f6cc0 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 --2- 172.21.15.96:0/1214850717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f55c0 0x7f69800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 -- 172.21.15.96:0/1214850717 >> 172.21.15.96:0/1214850717 conn(0x7f69800f0d40 msgr2=0x7f69800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:38.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.209+0000 7f69870d8700 1 -- 172.21.15.96:0/1214850717 shutdown_connections 2022-02-02T21:16:38.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.210+0000 7f69870d8700 1 -- 172.21.15.96:0/1214850717 wait complete. 2022-02-02T21:16:38.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.210+0000 7f69870d8700 1 Processor -- start 2022-02-02T21:16:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.210+0000 7f69870d8700 1 -- start start 2022-02-02T21:16:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f69870d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f69870d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f6860 0x7f698010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f69870d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980060420 con 0x7f69800f55c0 2022-02-02T21:16:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f69870d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980060560 con 0x7f69800f6860 2022-02-02T21:16:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41842/0 (socket says 172.21.15.96:41842) 2022-02-02T21:16:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 -- 172.21.15.96:0/2369903463 learned_addr learned my addr 172.21.15.96:0/2369903463 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:38.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f697ffff700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f6860 0x7f698010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 -- 172.21.15.96:0/2369903463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f6860 msgr2=0x7f698010c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f6860 0x7f698010c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 -- 172.21.15.96:0/2369903463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c005040 con 0x7f69800f55c0 2022-02-02T21:16:38.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.211+0000 7f6984e74700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 rx=0x7f697400e7c0 tx=0x7f697400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.212+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69740092e0 con 0x7f69800f55c0 2022-02-02T21:16:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.212+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f697400f040 con 0x7f69800f55c0 2022-02-02T21:16:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.212+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698010c690 con 0x7f69800f55c0 2022-02-02T21:16:38.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.212+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69740147e0 con 0x7f69800f55c0 2022-02-02T21:16:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.212+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698010cc20 con 0x7f69800f55c0 2022-02-02T21:16:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.213+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980045ad0 con 0x7f69800f55c0 2022-02-02T21:16:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.214+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f697401b030 con 0x7f69800f55c0 2022-02-02T21:16:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.214+0000 7f697d7fa700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 0x7f6970067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.214+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6974081da0 con 0x7f69800f55c0 2022-02-02T21:16:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.214+0000 7f697ffff700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 0x7f6970067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.215+0000 7f697ffff700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 0x7f6970067290 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f696c005010 tx=0x7f696c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.218+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f697404fea0 con 0x7f69800f55c0 2022-02-02T21:16:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.399+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6980057f10 con 0x7f6970064dd0 2022-02-02T21:16:38.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.400+0000 7f697d7fa700 1 -- 172.21.15.96:0/2369903463 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6980057f10 con 0x7f6970064dd0 2022-02-02T21:16:38.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 msgr2=0x7f6970067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 0x7f6970067290 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f696c005010 tx=0x7f696c016040).stop 2022-02-02T21:16:38.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 msgr2=0x7f6980109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 rx=0x7f697400e7c0 tx=0x7f697400b040).stop 2022-02-02T21:16:38.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 shutdown_connections 2022-02-02T21:16:38.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6970064dd0 0x7f6970067290 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69800f55c0 0x7f6980109b80 unknown :-1 s=CLOSED pgs=2684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 --2- 172.21.15.96:0/2369903463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69800f6860 0x7f698010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 >> 172.21.15.96:0/2369903463 conn(0x7f69800f0d40 msgr2=0x7f69800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:38.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.402+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 shutdown_connections 2022-02-02T21:16:38.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.403+0000 7f69870d8700 1 -- 172.21.15.96:0/2369903463 wait complete. 2022-02-02T21:16:38.413 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:16:38.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.499+0000 7fa51cf33700 1 -- 172.21.15.96:0/3805339088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f96f0 msgr2=0x7fa5180fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.499+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3805339088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f96f0 0x7fa5180fbae0 secure :-1 s=READY pgs=2685 cs=0 l=1 rev1=1 rx=0x7fa508004660 tx=0x7fa508009b30).stop 2022-02-02T21:16:38.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 -- 172.21.15.96:0/3805339088 shutdown_connections 2022-02-02T21:16:38.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3805339088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180f96f0 0x7fa5180fbae0 unknown :-1 s=CLOSED pgs=2685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3805339088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180602b0 0x7fa5180f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 -- 172.21.15.96:0/3805339088 >> 172.21.15.96:0/3805339088 conn(0x7fa5180f0b90 msgr2=0x7fa5180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:38.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:38 smithi096 ceph-mon[101353]: pgmap v5236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:38.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 -- 172.21.15.96:0/3805339088 shutdown_connections 2022-02-02T21:16:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 -- 172.21.15.96:0/3805339088 wait complete. 2022-02-02T21:16:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 Processor -- start 2022-02-02T21:16:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.500+0000 7fa51cf33700 1 -- start start 2022-02-02T21:16:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa51cf33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa51cf33700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f96f0 0x7fa518107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa51cf33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518107870 con 0x7fa5180602b0 2022-02-02T21:16:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa51cf33700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5181080b0 con 0x7fa5180f96f0 2022-02-02T21:16:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41852/0 (socket says 172.21.15.96:41852) 2022-02-02T21:16:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 -- 172.21.15.96:0/3349878522 learned_addr learned my addr 172.21.15.96:0/3349878522 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa516ffd700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f96f0 0x7fa518107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 -- 172.21.15.96:0/3349878522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f96f0 msgr2=0x7fa518107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f96f0 0x7fa518107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 -- 172.21.15.96:0/3349878522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508005040 con 0x7fa5180602b0 2022-02-02T21:16:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa5177fe700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 rx=0x7fa5000026d0 tx=0x7fa500009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa500009320 con 0x7fa5180602b0 2022-02-02T21:16:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa518108390 con 0x7fa5180602b0 2022-02-02T21:16:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa50000f040 con 0x7fa5180602b0 2022-02-02T21:16:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.501+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5000147e0 con 0x7fa5180602b0 2022-02-02T21:16:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.502+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5181088d0 con 0x7fa5180602b0 2022-02-02T21:16:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.503+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa518059100 con 0x7fa5180602b0 2022-02-02T21:16:38.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.503+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa500014a50 con 0x7fa5180602b0 2022-02-02T21:16:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.503+0000 7fa50ffff700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 0x7fa5040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.503+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa500082090 con 0x7fa5180602b0 2022-02-02T21:16:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.503+0000 7fa516ffd700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 0x7fa5040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.504+0000 7fa516ffd700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 0x7fa5040672e0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa508004e30 tx=0x7fa508009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.509+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa500050190 con 0x7fa5180602b0 2022-02-02T21:16:38.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.680+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5180fee60 con 0x7fa504064e20 2022-02-02T21:16:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.690+0000 7fa50ffff700 1 -- 172.21.15.96:0/3349878522 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa5180fee60 con 0x7fa504064e20 2022-02-02T21:16:38.693 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:16:38.693 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:16:38.693 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:16:38.693 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:16:38.694 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:16:38.694 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:16:38.694 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:16:38.694 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:16:38.695 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:16:38.695 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:16:38.695 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:16:38.696 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:16:38.696 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:16:38.696 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:16:38.696 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:16:38.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 2h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:16:38.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 2h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:16:38.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:16:38.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:16:38.698 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:16:38.698 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:16:38.698 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:16:38.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 msgr2=0x7fa5040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 0x7fa5040672e0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa508004e30 tx=0x7fa508009b30).stop 2022-02-02T21:16:38.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 msgr2=0x7fa518106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 rx=0x7fa5000026d0 tx=0x7fa500009de0).stop 2022-02-02T21:16:38.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 shutdown_connections 2022-02-02T21:16:38.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa504064e20 0x7fa5040672e0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5180602b0 0x7fa518106d80 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 --2- 172.21.15.96:0/3349878522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5180f96f0 0x7fa518107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 >> 172.21.15.96:0/3349878522 conn(0x7fa5180f0b90 msgr2=0x7fa5180f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:38.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 shutdown_connections 2022-02-02T21:16:38.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.692+0000 7fa51cf33700 1 -- 172.21.15.96:0/3349878522 wait complete. 2022-02-02T21:16:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:38 smithi159 ceph-mon[69013]: pgmap v5236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/2350250709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f6530 msgr2=0x7f7a240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/2350250709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f6530 0x7f7a240f6950 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 rx=0x7f7a20004660 tx=0x7f7a20009b30).stop 2022-02-02T21:16:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/2350250709 shutdown_connections 2022-02-02T21:16:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/2350250709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f77d0 0x7f7a240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:16:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/2350250709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f6530 0x7f7a240f6950 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/2350250709 >> 172.21.15.96:0/2350250709 conn(0x7f7a240f1c90 msgr2=0x7f7a240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.788+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/2350250709 shutdown_connections 2022-02-02T21:16:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/2350250709 wait complete. 2022-02-02T21:16:38.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 Processor -- start 2022-02-02T21:16:38.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 -- start start 2022-02-02T21:16:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f6530 0x7f7a24106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241079a0 con 0x7f7a240f77d0 2022-02-02T21:16:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.789+0000 7f7a2a8e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24108120 con 0x7f7a240f6530 2022-02-02T21:16:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41864/0 (socket says 172.21.15.96:41864) 2022-02-02T21:16:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 -- 172.21.15.96:0/1362741095 learned_addr learned my addr 172.21.15.96:0/1362741095 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a298df700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f6530 0x7f7a24106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 -- 172.21.15.96:0/1362741095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f6530 msgr2=0x7f7a24106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:38.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f6530 0x7f7a24106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:38.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 -- 172.21.15.96:0/1362741095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a20005040 con 0x7f7a240f77d0 2022-02-02T21:16:38.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a290de700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 rx=0x7f7a1400b410 tx=0x7f7a14006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a140125f0 con 0x7f7a240f77d0 2022-02-02T21:16:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a241083a0 con 0x7f7a240f77d0 2022-02-02T21:16:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a1400be30 con 0x7f7a240f77d0 2022-02-02T21:16:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a14002a70 con 0x7f7a240f77d0 2022-02-02T21:16:38.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.790+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a24108960 con 0x7f7a240f77d0 2022-02-02T21:16:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.792+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a1400f030 con 0x7f7a240f77d0 2022-02-02T21:16:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.792+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24045ad0 con 0x7f7a240f77d0 2022-02-02T21:16:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.792+0000 7f7a1a7fc700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 0x7f7a100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:38.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.792+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a14081e60 con 0x7f7a240f77d0 2022-02-02T21:16:38.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.792+0000 7f7a298df700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 0x7f7a100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:38.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.793+0000 7f7a298df700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 0x7f7a100672e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f7a20013690 tx=0x7f7a20009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:38.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:38.797+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a1404ff60 con 0x7f7a240f77d0 2022-02-02T21:16:39.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.025+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a24027a00 con 0x7f7a240f77d0 2022-02-02T21:16:39.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.026+0000 7f7a1a7fc700 1 -- 172.21.15.96:0/1362741095 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7a14053580 con 0x7f7a240f77d0 2022-02-02T21:16:39.027 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:16:39.028 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:16:39.028 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:16:39.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:39.028 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:16:39.028 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:16:39.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:39.029 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:16:39.029 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:16:39.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:39.030 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:16:39.031 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:16:39.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:16:39.031 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:16:39.032 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:16:39.032 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:16:39.032 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:16:39.032 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:16:39.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.027+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 msgr2=0x7f7a100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.027+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 0x7f7a100672e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f7a20013690 tx=0x7f7a20009b30).stop 2022-02-02T21:16:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.027+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 msgr2=0x7f7a24107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.027+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 rx=0x7f7a1400b410 tx=0x7f7a14006ef0).stop 2022-02-02T21:16:39.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 shutdown_connections 2022-02-02T21:16:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a10064e20 0x7f7a100672e0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a240f6530 0x7f7a24106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 --2- 172.21.15.96:0/1362741095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a240f77d0 0x7f7a24107310 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 >> 172.21.15.96:0/1362741095 conn(0x7f7a240f1c90 msgr2=0x7f7a240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:39.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 shutdown_connections 2022-02-02T21:16:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.028+0000 7f7a2a8e1700 1 -- 172.21.15.96:0/1362741095 wait complete. 2022-02-02T21:16:39.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.126+0000 7f0810a96700 1 -- 172.21.15.96:0/2470161558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f6860 msgr2=0x7f080c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.126+0000 7f0810a96700 1 --2- 172.21.15.96:0/2470161558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f6860 0x7f080c0f6cc0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 rx=0x7f0800004660 tx=0x7f0800009b30).stop 2022-02-02T21:16:39.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 -- 172.21.15.96:0/2470161558 shutdown_connections 2022-02-02T21:16:39.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 --2- 172.21.15.96:0/2470161558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f6860 0x7f080c0f6cc0 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 --2- 172.21.15.96:0/2470161558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f55c0 0x7f080c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 -- 172.21.15.96:0/2470161558 >> 172.21.15.96:0/2470161558 conn(0x7f080c0f0d40 msgr2=0x7f080c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:39.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 -- 172.21.15.96:0/2470161558 shutdown_connections 2022-02-02T21:16:39.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 -- 172.21.15.96:0/2470161558 wait complete. 2022-02-02T21:16:39.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 Processor -- start 2022-02-02T21:16:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 -- start start 2022-02-02T21:16:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.127+0000 7f0810a96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0810a96700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f6860 0x7f080c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:39.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0810a96700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0603d0 con 0x7f080c0f55c0 2022-02-02T21:16:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0810a96700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c060510 con 0x7f080c0f6860 2022-02-02T21:16:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41872/0 (socket says 172.21.15.96:41872) 2022-02-02T21:16:39.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 -- 172.21.15.96:0/2996093195 learned_addr learned my addr 172.21.15.96:0/2996093195 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:16:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0809d9b700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f6860 0x7f080c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 -- 172.21.15.96:0/2996093195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f6860 msgr2=0x7f080c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f6860 0x7f080c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 -- 172.21.15.96:0/2996093195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800005040 con 0x7f080c0f55c0 2022-02-02T21:16:39.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f080a59c700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 rx=0x7f07fc00c790 tx=0x7f07fc007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:39.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc00e680 con 0x7f080c0f55c0 2022-02-02T21:16:39.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f07fc00ec90 con 0x7f080c0f55c0 2022-02-02T21:16:39.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c10ea40 con 0x7f080c0f55c0 2022-02-02T21:16:39.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc012d00 con 0x7f080c0f55c0 2022-02-02T21:16:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.128+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c10eec0 con 0x7f080c0f55c0 2022-02-02T21:16:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.129+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c045ad0 con 0x7f080c0f55c0 2022-02-02T21:16:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.130+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f07fc010070 con 0x7f080c0f55c0 2022-02-02T21:16:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.130+0000 7f07faffd700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 0x7f07f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:16:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.130+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f07fc081a40 con 0x7f080c0f55c0 2022-02-02T21:16:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.130+0000 7f0809d9b700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 0x7f07f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:16:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.130+0000 7f0809d9b700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 0x7f07f4067290 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f0800004e30 tx=0x7f0800009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:16:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.134+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f07fc04fae0 con 0x7f080c0f55c0 2022-02-02T21:16:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.332+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f080c0fdec0 con 0x7f080c0f55c0 2022-02-02T21:16:39.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.333+0000 7f07faffd700 1 -- 172.21.15.96:0/2996093195 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f07fc053100 con 0x7f080c0f55c0 2022-02-02T21:16:39.334 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:16:39.335 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:16:39.335 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:16:39.335 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:16:39.335 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:39.336 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:16:39.336 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:16:39.336 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:16:39.336 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:16:39.336 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:16:39.337 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:16:39.337 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:16:39.337 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:16:39.337 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:16:39.338 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:16:39.338 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:16:39.338 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:16:39.338 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:16:39.338 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:16:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:16:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:16:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:16:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:16:39.340 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:16:39.340 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:16:39.340 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:16:39.340 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:16:39.340 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:16:39.341 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:16:39.341 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:16:39.341 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:16:39.341 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:16:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:39.342 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:16:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:16:39.342 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:39.343 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:39.343 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:16:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 msgr2=0x7f07f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 0x7f07f4067290 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f0800004e30 tx=0x7f0800009b30).stop 2022-02-02T21:16:39.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 msgr2=0x7f080c10c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:16:39.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 rx=0x7f07fc00c790 tx=0x7f07fc007d90).stop 2022-02-02T21:16:39.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 shutdown_connections 2022-02-02T21:16:39.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f07f4064dd0 0x7f07f4067290 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f080c0f55c0 0x7f080c10c050 unknown :-1 s=CLOSED pgs=2690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 --2- 172.21.15.96:0/2996093195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0f6860 0x7f080c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:16:39.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.334+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 >> 172.21.15.96:0/2996093195 conn(0x7f080c0f0d40 msgr2=0x7f080c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:16:39.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.335+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 shutdown_connections 2022-02-02T21:16:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:16:39.335+0000 7f0810a96700 1 -- 172.21.15.96:0/2996093195 wait complete. 2022-02-02T21:16:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:16:39.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:39 smithi159 ceph-mon[69013]: from='client.39474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:39.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:39 smithi159 ceph-mon[69013]: from='client.39478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:39.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1362741095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:16:39.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2996093195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:16:39.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:39 smithi096 ceph-mon[101353]: from='client.39474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:39.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:39 smithi096 ceph-mon[101353]: from='client.39478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:16:39.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1362741095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:16:39.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2996093195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:16:40.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:40 smithi159 ceph-mon[69013]: pgmap v5237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:40.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:40 smithi096 ceph-mon[101353]: pgmap v5237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:42 smithi159 ceph-mon[69013]: pgmap v5238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:42 smithi096 ceph-mon[101353]: pgmap v5238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:44 smithi159 ceph-mon[69013]: pgmap v5239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:44 smithi096 ceph-mon[101353]: pgmap v5239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:47 smithi159 ceph-mon[69013]: pgmap v5240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:47 smithi096 ceph-mon[101353]: pgmap v5240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:48 smithi159 ceph-mon[69013]: pgmap v5241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:48 smithi096 ceph-mon[101353]: pgmap v5241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:50 smithi159 ceph-mon[69013]: pgmap v5242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:50 smithi096 ceph-mon[101353]: pgmap v5242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:53 smithi159 ceph-mon[69013]: pgmap v5243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:53.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:53 smithi096 ceph-mon[101353]: pgmap v5243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:55 smithi159 ceph-mon[69013]: pgmap v5244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:55 smithi096 ceph-mon[101353]: pgmap v5244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:57 smithi159 ceph-mon[69013]: pgmap v5245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:57 smithi096 ceph-mon[101353]: pgmap v5245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:16:58 smithi159 ceph-mon[69013]: pgmap v5246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:16:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:16:58 smithi096 ceph-mon[101353]: pgmap v5246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:01 smithi159 ceph-mon[69013]: pgmap v5247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:01 smithi096 ceph-mon[101353]: pgmap v5247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:03 smithi159 ceph-mon[69013]: pgmap v5248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:03.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:03 smithi096 ceph-mon[101353]: pgmap v5248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:05.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:05 smithi159 ceph-mon[69013]: pgmap v5249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:05 smithi096 ceph-mon[101353]: pgmap v5249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:07.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:07 smithi159 ceph-mon[69013]: pgmap v5250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:07 smithi096 ceph-mon[101353]: pgmap v5250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:08.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:08 smithi159 ceph-mon[69013]: pgmap v5251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:08 smithi096 ceph-mon[101353]: pgmap v5251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:09.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.443+0000 7feecdfa8700 1 -- 172.21.15.96:0/2615546091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f49a0 msgr2=0x7feec80f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.443+0000 7feecdfa8700 1 --2- 172.21.15.96:0/2615546091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f49a0 0x7feec80f4dc0 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 rx=0x7feeb0004660 tx=0x7feeb0009b30).stop 2022-02-02T21:17:09.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 -- 172.21.15.96:0/2615546091 shutdown_connections 2022-02-02T21:17:09.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 --2- 172.21.15.96:0/2615546091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f5340 0x7feec80f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:17:09.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 --2- 172.21.15.96:0/2615546091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f49a0 0x7feec80f4dc0 unknown :-1 s=CLOSED pgs=2691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 -- 172.21.15.96:0/2615546091 >> 172.21.15.96:0/2615546091 conn(0x7feec80f04c0 msgr2=0x7feec80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:09.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 -- 172.21.15.96:0/2615546091 shutdown_connections 2022-02-02T21:17:09.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 -- 172.21.15.96:0/2615546091 wait complete. 2022-02-02T21:17:09.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 Processor -- start 2022-02-02T21:17:09.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.444+0000 7feecdfa8700 1 -- start start 2022-02-02T21:17:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feecdfa8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f49a0 0x7feec8107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feecdfa8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feecdfa8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8107b90 con 0x7feec80f5340 2022-02-02T21:17:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feecdfa8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8108440 con 0x7feec80f49a0 2022-02-02T21:17:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41898/0 (socket says 172.21.15.96:41898) 2022-02-02T21:17:09.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 -- 172.21.15.96:0/1013472406 learned_addr learned my addr 172.21.15.96:0/1013472406 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:09.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec77fe700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f49a0 0x7feec8107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 -- 172.21.15.96:0/1013472406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f49a0 msgr2=0x7feec8107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f49a0 0x7feec8107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 -- 172.21.15.96:0/1013472406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0005040 con 0x7feec80f5340 2022-02-02T21:17:09.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.445+0000 7feec6ffd700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 rx=0x7feeb80093f0 tx=0x7feeb8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:09.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.446+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb8013640 con 0x7feec80f5340 2022-02-02T21:17:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.446+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feeb8013c50 con 0x7feec80f5340 2022-02-02T21:17:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.446+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb8012c70 con 0x7feec80f5340 2022-02-02T21:17:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.446+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec8108720 con 0x7feec80f5340 2022-02-02T21:17:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.446+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec8108ce0 con 0x7feec80f5340 2022-02-02T21:17:09.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.447+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec80f4150 con 0x7feec80f5340 2022-02-02T21:17:09.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.448+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feeb801a060 con 0x7feec80f5340 2022-02-02T21:17:09.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.448+0000 7feebffff700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.448+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feeb8081e40 con 0x7feec80f5340 2022-02-02T21:17:09.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.448+0000 7feec77fe700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.449+0000 7feec77fe700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7feeb0004580 tx=0x7feeb0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:09.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.452+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feeb8053980 con 0x7feec80f5340 2022-02-02T21:17:09.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.629+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feec80ff070 con 0x7feeb4064dd0 2022-02-02T21:17:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.631+0000 7feebffff700 1 -- 172.21.15.96:0/1013472406 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7feec80ff070 con 0x7feeb4064dd0 2022-02-02T21:17:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 msgr2=0x7feeb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7feeb0004580 tx=0x7feeb0009b30).stop 2022-02-02T21:17:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 msgr2=0x7feec8107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 rx=0x7feeb80093f0 tx=0x7feeb8006ec0).stop 2022-02-02T21:17:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 shutdown_connections 2022-02-02T21:17:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feec80f49a0 0x7feec8107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 --2- 172.21.15.96:0/1013472406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feec80f5340 0x7feec8107550 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.632+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 >> 172.21.15.96:0/1013472406 conn(0x7feec80f04c0 msgr2=0x7feec80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.633+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 shutdown_connections 2022-02-02T21:17:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.633+0000 7feecdfa8700 1 -- 172.21.15.96:0/1013472406 wait complete. 2022-02-02T21:17:09.644 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:17:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2182473029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f6860 msgr2=0x7ff2d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2182473029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f6860 0x7ff2d40f6cc0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 rx=0x7ff2c4004660 tx=0x7ff2c4009b30).stop 2022-02-02T21:17:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2182473029 shutdown_connections 2022-02-02T21:17:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2182473029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f6860 0x7ff2d40f6cc0 unknown :-1 s=CLOSED pgs=2693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2182473029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f55c0 0x7ff2d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2182473029 >> 172.21.15.96:0/2182473029 conn(0x7ff2d40f0d40 msgr2=0x7ff2d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2182473029 shutdown_connections 2022-02-02T21:17:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.730+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2182473029 wait complete. 2022-02-02T21:17:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 Processor -- start 2022-02-02T21:17:09.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 -- start start 2022-02-02T21:17:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f6860 0x7ff2d410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40602b0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d8b2f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40603f0 con 0x7ff2d40f6860 2022-02-02T21:17:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41906/0 (socket says 172.21.15.96:41906) 2022-02-02T21:17:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 -- 172.21.15.96:0/2131805162 learned_addr learned my addr 172.21.15.96:0/2131805162 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:09.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d1d9b700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f6860 0x7ff2d410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 -- 172.21.15.96:0/2131805162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f6860 msgr2=0x7ff2d410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f6860 0x7ff2d410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.731+0000 7ff2d259c700 1 -- 172.21.15.96:0/2131805162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4005040 con 0x7ff2d40f55c0 2022-02-02T21:17:09.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2d259c700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 rx=0x7ff2bc002700 tx=0x7ff2bc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc0079c0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2bc00f040 con 0x7ff2d40f55c0 2022-02-02T21:17:09.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d410ea60 con 0x7ff2d40f55c0 2022-02-02T21:17:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc014860 con 0x7ff2d40f55c0 2022-02-02T21:17:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.732+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d410eee0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.733+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4045ad0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.733+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2bc01b060 con 0x7ff2d40f55c0 2022-02-02T21:17:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.733+0000 7ff2caffd700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 0x7ff2c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.733+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2bc0818f0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.734+0000 7ff2d1d9b700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 0x7ff2c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:09.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.734+0000 7ff2d1d9b700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 0x7ff2c0067290 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7ff2c4004630 tx=0x7ff2c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:09.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.738+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2bc04f9f0 con 0x7ff2d40f55c0 2022-02-02T21:17:09.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.909+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d4057f10 con 0x7ff2c0064dd0 2022-02-02T21:17:09.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.919+0000 7ff2caffd700 1 -- 172.21.15.96:0/2131805162 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff2d4057f10 con 0x7ff2c0064dd0 2022-02-02T21:17:09.923 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:17:09.923 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:17:09.924 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:17:09.924 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:17:09.924 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:17:09.924 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:17:09.925 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:17:09.925 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:17:09.925 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:17:09.925 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:17:09.926 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:17:09.926 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:17:09.926 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:17:09.926 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:17:09.926 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:17:09.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:17:09.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:17:09.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 2h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:17:09.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 2h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:17:09.928 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:17:09.928 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:17:09.928 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:17:09.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 msgr2=0x7ff2c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 0x7ff2c0067290 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7ff2c4004630 tx=0x7ff2c4009b30).stop 2022-02-02T21:17:09.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 msgr2=0x7ff2d410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 rx=0x7ff2bc002700 tx=0x7ff2bc009d80).stop 2022-02-02T21:17:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 shutdown_connections 2022-02-02T21:17:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2c0064dd0 0x7ff2c0067290 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2d40f55c0 0x7ff2d410c070 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 --2- 172.21.15.96:0/2131805162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2d40f6860 0x7ff2d410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 >> 172.21.15.96:0/2131805162 conn(0x7ff2d40f0d40 msgr2=0x7ff2d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 shutdown_connections 2022-02-02T21:17:09.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:09.921+0000 7ff2d8b2f700 1 -- 172.21.15.96:0/2131805162 wait complete. 2022-02-02T21:17:10.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 -- 172.21.15.96:0/1956637607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f66e0 msgr2=0x7fa4380f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 --2- 172.21.15.96:0/1956637607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f66e0 0x7fa4380f6b00 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 rx=0x7fa428004660 tx=0x7fa428009b30).stop 2022-02-02T21:17:10.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 -- 172.21.15.96:0/1956637607 shutdown_connections 2022-02-02T21:17:10.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 --2- 172.21.15.96:0/1956637607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f7980 0x7fa4380f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 --2- 172.21.15.96:0/1956637607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f66e0 0x7fa4380f6b00 unknown :-1 s=CLOSED pgs=2695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 -- 172.21.15.96:0/1956637607 >> 172.21.15.96:0/1956637607 conn(0x7fa4380f1e40 msgr2=0x7fa4380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:10.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.018+0000 7fa43e245700 1 -- 172.21.15.96:0/1956637607 shutdown_connections 2022-02-02T21:17:10.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 -- 172.21.15.96:0/1956637607 wait complete. 2022-02-02T21:17:10.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 Processor -- start 2022-02-02T21:17:10.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 -- start start 2022-02-02T21:17:10.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438107a50 con 0x7fa4380f7980 2022-02-02T21:17:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.019+0000 7fa43e245700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438107b90 con 0x7fa4380f66e0 2022-02-02T21:17:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41918/0 (socket says 172.21.15.96:41918) 2022-02-02T21:17:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 -- 172.21.15.96:0/1884801938 learned_addr learned my addr 172.21.15.96:0/1884801938 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa4377fe700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 -- 172.21.15.96:0/1884801938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 msgr2=0x7fa438106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 -- 172.21.15.96:0/1884801938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428005040 con 0x7fa4380f7980 2022-02-02T21:17:10.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa436ffd700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 rx=0x7fa42c00c790 tx=0x7fa42c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:10.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c002590 con 0x7fa4380f7980 2022-02-02T21:17:10.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438108530 con 0x7fa4380f7980 2022-02-02T21:17:10.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa438108af0 con 0x7fa4380f7980 2022-02-02T21:17:10.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa42c002ba0 con 0x7fa4380f7980 2022-02-02T21:17:10.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.020+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c012d20 con 0x7fa4380f7980 2022-02-02T21:17:10.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.021+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa418004fa0 con 0x7fa4380f7980 2022-02-02T21:17:10.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.022+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa42c01a060 con 0x7fa4380f7980 2022-02-02T21:17:10.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.022+0000 7fa41ffff700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 0x7fa420067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.022+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa42c081840 con 0x7fa4380f7980 2022-02-02T21:17:10.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.023+0000 7fa4377fe700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 0x7fa420067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.023+0000 7fa4377fe700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 0x7fa420067290 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fa428004630 tx=0x7fa428009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:10.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.027+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa42c0532b0 con 0x7fa4380f7980 2022-02-02T21:17:10.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.256+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa418005e80 con 0x7fa4380f7980 2022-02-02T21:17:10.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.256+0000 7fa41ffff700 1 -- 172.21.15.96:0/1884801938 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa42c0182e0 con 0x7fa4380f7980 2022-02-02T21:17:10.259 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:17:10.260 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:17:10.260 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:17:10.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:10.261 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:17:10.262 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:17:10.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:10.262 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:17:10.263 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:17:10.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:10.263 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:17:10.264 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:17:10.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:10.264 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:17:10.265 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:17:10.265 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:17:10.265 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:17:10.265 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:17:10.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 msgr2=0x7fa420067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 0x7fa420067290 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fa428004630 tx=0x7fa428009b30).stop 2022-02-02T21:17:10.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 msgr2=0x7fa4381074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 rx=0x7fa42c00c790 tx=0x7fa42c007d70).stop 2022-02-02T21:17:10.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 shutdown_connections 2022-02-02T21:17:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa420064dd0 0x7fa420067290 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 --2- 172.21.15.96:0/1884801938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4381074a0 unknown :-1 s=CLOSED pgs=2696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 >> 172.21.15.96:0/1884801938 conn(0x7fa4380f1e40 msgr2=0x7fa4380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 shutdown_connections 2022-02-02T21:17:10.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.258+0000 7fa43e245700 1 -- 172.21.15.96:0/1884801938 wait complete. 2022-02-02T21:17:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 -- 172.21.15.96:0/3226109788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f6860 msgr2=0x7fd6d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 --2- 172.21.15.96:0/3226109788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f6860 0x7fd6d80f6cc0 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 rx=0x7fd6c0004660 tx=0x7fd6c0009b30).stop 2022-02-02T21:17:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 -- 172.21.15.96:0/3226109788 shutdown_connections 2022-02-02T21:17:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 --2- 172.21.15.96:0/3226109788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f6860 0x7fd6d80f6cc0 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 --2- 172.21.15.96:0/3226109788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f55c0 0x7fd6d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 -- 172.21.15.96:0/3226109788 >> 172.21.15.96:0/3226109788 conn(0x7fd6d80f0d40 msgr2=0x7fd6d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 -- 172.21.15.96:0/3226109788 shutdown_connections 2022-02-02T21:17:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 -- 172.21.15.96:0/3226109788 wait complete. 2022-02-02T21:17:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.357+0000 7fd6de81b700 1 Processor -- start 2022-02-02T21:17:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6de81b700 1 -- start start 2022-02-02T21:17:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6de81b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6de81b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f6860 0x7fd6d810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6de81b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80603e0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6de81b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8060520 con 0x7fd6d80f6860 2022-02-02T21:17:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41926/0 (socket says 172.21.15.96:41926) 2022-02-02T21:17:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 -- 172.21.15.96:0/2763982603 learned_addr learned my addr 172.21.15.96:0/2763982603 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d77fe700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f6860 0x7fd6d810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 -- 172.21.15.96:0/2763982603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f6860 msgr2=0x7fd6d810c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f6860 0x7fd6d810c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 -- 172.21.15.96:0/2763982603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0005040 con 0x7fd6d80f55c0 2022-02-02T21:17:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.358+0000 7fd6d7fff700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 rx=0x7fd6c8002700 tx=0x7fd6c8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.359+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c80079c0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.359+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6c800f040 con 0x7fd6d80f55c0 2022-02-02T21:17:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.359+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d810c710 con 0x7fd6d80f55c0 2022-02-02T21:17:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.359+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c80147e0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.359+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d810ccd0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.360+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8045ad0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.360+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6c801b060 con 0x7fd6d80f55c0 2022-02-02T21:17:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.360+0000 7fd6d4ff9700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 0x7fd6c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.360+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd6c8081880 con 0x7fd6d80f55c0 2022-02-02T21:17:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.361+0000 7fd6d77fe700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 0x7fd6c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.361+0000 7fd6d77fe700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 0x7fd6c4067290 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fd6c0004630 tx=0x7fd6c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:10.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.365+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6c804f920 con 0x7fd6d80f55c0 2022-02-02T21:17:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.564+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6d80fdeb0 con 0x7fd6d80f55c0 2022-02-02T21:17:10.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.564+0000 7fd6d4ff9700 1 -- 172.21.15.96:0/2763982603 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd6c8052f40 con 0x7fd6d80f55c0 2022-02-02T21:17:10.570 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:17:10.571 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:17:10.571 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:17:10.572 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:17:10.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:10.572 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:17:10.572 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:17:10.573 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:17:10.573 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:17:10.573 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:17:10.573 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:17:10.574 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:17:10.574 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:17:10.575 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:17:10.575 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:17:10.575 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:17:10.575 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:17:10.575 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:17:10.576 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:17:10.576 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:17:10.576 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:17:10.576 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:17:10.577 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:17:10.577 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:17:10.577 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:17:10.577 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:17:10.577 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:17:10.578 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:17:10.578 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:17:10.578 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:17:10.578 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:17:10.579 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:17:10.579 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:10.579 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:10.579 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:17:10.579 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:10.580 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:10.580 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:10.580 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:10.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 msgr2=0x7fd6c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 0x7fd6c4067290 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fd6c0004630 tx=0x7fd6c0009b30).stop 2022-02-02T21:17:10.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 msgr2=0x7fd6d8109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:10.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 rx=0x7fd6c8002700 tx=0x7fd6c8009d60).stop 2022-02-02T21:17:10.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 shutdown_connections 2022-02-02T21:17:10.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd6c4064dd0 0x7fd6c4067290 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6d80f55c0 0x7fd6d8109c60 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 --2- 172.21.15.96:0/2763982603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80f6860 0x7fd6d810c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.567+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 >> 172.21.15.96:0/2763982603 conn(0x7fd6d80f0d40 msgr2=0x7fd6d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.568+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 shutdown_connections 2022-02-02T21:17:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:10.568+0000 7fd6de81b700 1 -- 172.21.15.96:0/2763982603 wait complete. 2022-02-02T21:17:10.584 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:17:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:11 smithi159 ceph-mon[69013]: from='client.39490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:11 smithi159 ceph-mon[69013]: from='client.39494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:11 smithi159 ceph-mon[69013]: pgmap v5252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1884801938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:17:11.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2763982603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:17:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:11 smithi096 ceph-mon[101353]: from='client.39490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:11 smithi096 ceph-mon[101353]: from='client.39494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:11 smithi096 ceph-mon[101353]: pgmap v5252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1884801938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:17:11.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2763982603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:17:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:13 smithi159 ceph-mon[69013]: pgmap v5253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:13.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:13 smithi096 ceph-mon[101353]: pgmap v5253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:15.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:15 smithi159 ceph-mon[69013]: pgmap v5254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:15.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:15 smithi096 ceph-mon[101353]: pgmap v5254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:17.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:17 smithi159 ceph-mon[69013]: pgmap v5255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:17 smithi096 ceph-mon[101353]: pgmap v5255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:18 smithi159 ceph-mon[69013]: pgmap v5256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:18 smithi096 ceph-mon[101353]: pgmap v5256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:21 smithi159 ceph-mon[69013]: pgmap v5257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:21 smithi096 ceph-mon[101353]: pgmap v5257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:23 smithi159 ceph-mon[69013]: pgmap v5258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:23 smithi096 ceph-mon[101353]: pgmap v5258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:25 smithi159 ceph-mon[69013]: pgmap v5259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:25 smithi096 ceph-mon[101353]: pgmap v5259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:27 smithi159 ceph-mon[69013]: pgmap v5260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:27 smithi096 ceph-mon[101353]: pgmap v5260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:17:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:17:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:28 smithi159 ceph-mon[69013]: pgmap v5261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:17:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:17:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:28 smithi096 ceph-mon[101353]: pgmap v5261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:31 smithi159 ceph-mon[69013]: pgmap v5262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:31 smithi096 ceph-mon[101353]: pgmap v5262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:33 smithi159 ceph-mon[69013]: pgmap v5263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:33.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:33 smithi096 ceph-mon[101353]: pgmap v5263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:35 smithi159 ceph-mon[69013]: pgmap v5264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:35 smithi096 ceph-mon[101353]: pgmap v5264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:37 smithi159 ceph-mon[69013]: pgmap v5265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:37 smithi096 ceph-mon[101353]: pgmap v5265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:38 smithi159 ceph-mon[69013]: pgmap v5266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:38 smithi096 ceph-mon[101353]: pgmap v5266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:40.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 -- 172.21.15.96:0/3841732428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f6860 msgr2=0x7fb1640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/3841732428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f6860 0x7fb1640f6cc0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 rx=0x7fb150004660 tx=0x7fb150009b30).stop 2022-02-02T21:17:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 -- 172.21.15.96:0/3841732428 shutdown_connections 2022-02-02T21:17:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/3841732428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f6860 0x7fb1640f6cc0 unknown :-1 s=CLOSED pgs=2699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/3841732428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f55c0 0x7fb1640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 -- 172.21.15.96:0/3841732428 >> 172.21.15.96:0/3841732428 conn(0x7fb1640f0d40 msgr2=0x7fb1640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:40.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 -- 172.21.15.96:0/3841732428 shutdown_connections 2022-02-02T21:17:40.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.677+0000 7fb16b0e7700 1 -- 172.21.15.96:0/3841732428 wait complete. 2022-02-02T21:17:40.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 Processor -- start 2022-02-02T21:17:40.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 -- start start 2022-02-02T21:17:40.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f6860 0x7fb16410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640603e0 con 0x7fb1640f55c0 2022-02-02T21:17:40.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.678+0000 7fb16b0e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164060520 con 0x7fb1640f6860 2022-02-02T21:17:40.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41944/0 (socket says 172.21.15.96:41944) 2022-02-02T21:17:40.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 -- 172.21.15.96:0/1148552958 learned_addr learned my addr 172.21.15.96:0/1148552958 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:40.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb163fff700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f6860 0x7fb16410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 -- 172.21.15.96:0/1148552958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f6860 msgr2=0x7fb16410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f6860 0x7fb16410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 -- 172.21.15.96:0/1148552958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150005040 con 0x7fb1640f55c0 2022-02-02T21:17:40.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb168e83700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 rx=0x7fb158002700 tx=0x7fb158009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:40.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1580079c0 con 0x7fb1640f55c0 2022-02-02T21:17:40.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb15800f040 con 0x7fb1640f55c0 2022-02-02T21:17:40.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16410c700 con 0x7fb1640f55c0 2022-02-02T21:17:40.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb158014860 con 0x7fb1640f55c0 2022-02-02T21:17:40.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.679+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16410ccc0 con 0x7fb1640f55c0 2022-02-02T21:17:40.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.680+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164045ad0 con 0x7fb1640f55c0 2022-02-02T21:17:40.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.681+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb15801b060 con 0x7fb1640f55c0 2022-02-02T21:17:40.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.681+0000 7fb1617fa700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 0x7fb154067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.681+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb1580818e0 con 0x7fb1640f55c0 2022-02-02T21:17:40.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.681+0000 7fb163fff700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 0x7fb154067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.682+0000 7fb163fff700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 0x7fb154067270 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fb150004e30 tx=0x7fb150009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:40.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.686+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb15804f9e0 con 0x7fb1640f55c0 2022-02-02T21:17:40.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.865+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1640fdf30 con 0x7fb154064db0 2022-02-02T21:17:40.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.866+0000 7fb1617fa700 1 -- 172.21.15.96:0/1148552958 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb150019040 con 0x7fb154064db0 2022-02-02T21:17:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.867+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 msgr2=0x7fb154067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.867+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 0x7fb154067270 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fb150004e30 tx=0x7fb150009b30).stop 2022-02-02T21:17:40.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.867+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 msgr2=0x7fb164109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.867+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 rx=0x7fb158002700 tx=0x7fb158009d80).stop 2022-02-02T21:17:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 shutdown_connections 2022-02-02T21:17:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb154064db0 0x7fb154067270 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640f55c0 0x7fb164109c50 unknown :-1 s=CLOSED pgs=2700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 --2- 172.21.15.96:0/1148552958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1640f6860 0x7fb16410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 >> 172.21.15.96:0/1148552958 conn(0x7fb1640f0d40 msgr2=0x7fb1640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 shutdown_connections 2022-02-02T21:17:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.868+0000 7fb16b0e7700 1 -- 172.21.15.96:0/1148552958 wait complete. 2022-02-02T21:17:40.879 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:17:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- 172.21.15.96:0/792450377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 msgr2=0x7f9ca40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 --2- 172.21.15.96:0/792450377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca40f59e0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 rx=0x7f9c94004660 tx=0x7f9c94009b30).stop 2022-02-02T21:17:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- 172.21.15.96:0/792450377 shutdown_connections 2022-02-02T21:17:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 --2- 172.21.15.96:0/792450377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:17:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 --2- 172.21.15.96:0/792450377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca40f59e0 unknown :-1 s=CLOSED pgs=2701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- 172.21.15.96:0/792450377 >> 172.21.15.96:0/792450377 conn(0x7f9ca40f0d40 msgr2=0x7f9ca40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- 172.21.15.96:0/792450377 shutdown_connections 2022-02-02T21:17:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- 172.21.15.96:0/792450377 wait complete. 2022-02-02T21:17:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 Processor -- start 2022-02-02T21:17:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.965+0000 7f9cac72e700 1 -- start start 2022-02-02T21:17:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9cac72e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9cac72e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9cac72e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4060310 con 0x7f9ca40f55c0 2022-02-02T21:17:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9cac72e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4060450 con 0x7f9ca40f6860 2022-02-02T21:17:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41954/0 (socket says 172.21.15.96:41954) 2022-02-02T21:17:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 -- 172.21.15.96:0/4038573496 learned_addr learned my addr 172.21.15.96:0/4038573496 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 -- 172.21.15.96:0/4038573496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 msgr2=0x7f9ca410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9ca9cc9700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 -- 172.21.15.96:0/4038573496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94005040 con 0x7f9ca40f55c0 2022-02-02T21:17:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9caa4ca700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 rx=0x7f9c94004f60 tx=0x7f9c94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c94018070 con 0x7f9ca40f55c0 2022-02-02T21:17:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca410ea00 con 0x7f9ca40f55c0 2022-02-02T21:17:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c94007ba0 con 0x7f9ca40f55c0 2022-02-02T21:17:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.966+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9401c620 con 0x7f9ca40f55c0 2022-02-02T21:17:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.967+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca410ee80 con 0x7f9ca40f55c0 2022-02-02T21:17:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.968+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4045ad0 con 0x7f9ca40f55c0 2022-02-02T21:17:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.968+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c9401c8e0 con 0x7f9ca40f55c0 2022-02-02T21:17:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.968+0000 7f9c9affd700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.969+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9c940839b0 con 0x7f9ca40f55c0 2022-02-02T21:17:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.969+0000 7f9ca9cc9700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.969+0000 7f9ca9cc9700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f9ca000a6f0 tx=0x7f9ca0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:40.973+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c94051ab0 con 0x7f9ca40f55c0 2022-02-02T21:17:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.148+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca4057f10 con 0x7f9c90064dd0 2022-02-02T21:17:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.158+0000 7f9c9affd700 1 -- 172.21.15.96:0/4038573496 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9ca4057f10 con 0x7f9c90064dd0 2022-02-02T21:17:41.160 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:17:41.160 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:17:41.160 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:17:41.160 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:17:41.161 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:17:41.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:17:41.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:17:41.161 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:17:41.162 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:17:41.162 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:17:41.162 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:17:41.162 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:17:41.163 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:17:41.163 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:17:41.163 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:17:41.163 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:17:41.163 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:17:41.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:17:41.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:17:41.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 2h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:17:41.164 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:17:41.165 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:17:41.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 msgr2=0x7f9c90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f9ca000a6f0 tx=0x7f9ca0008040).stop 2022-02-02T21:17:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 msgr2=0x7f9ca410c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 rx=0x7f9c94004f60 tx=0x7f9c94009b30).stop 2022-02-02T21:17:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 shutdown_connections 2022-02-02T21:17:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c90064dd0 0x7f9c90067290 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ca40f55c0 0x7f9ca410c010 unknown :-1 s=CLOSED pgs=2702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 --2- 172.21.15.96:0/4038573496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca40f6860 0x7f9ca410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.159+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 >> 172.21.15.96:0/4038573496 conn(0x7f9ca40f0d40 msgr2=0x7f9ca40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:41.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.160+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 shutdown_connections 2022-02-02T21:17:41.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.160+0000 7f9cac72e700 1 -- 172.21.15.96:0/4038573496 wait complete. 2022-02-02T21:17:41.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 -- 172.21.15.96:0/1510911234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 msgr2=0x7fe9200f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 --2- 172.21.15.96:0/1510911234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe9200f6920 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 rx=0x7fe91c004660 tx=0x7fe91c009b30).stop 2022-02-02T21:17:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 -- 172.21.15.96:0/1510911234 shutdown_connections 2022-02-02T21:17:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 --2- 172.21.15.96:0/1510911234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe9200f6920 unknown :-1 s=CLOSED pgs=2703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 --2- 172.21.15.96:0/1510911234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 0x7fe9200f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 -- 172.21.15.96:0/1510911234 >> 172.21.15.96:0/1510911234 conn(0x7fe9200f0de0 msgr2=0x7fe9200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 -- 172.21.15.96:0/1510911234 shutdown_connections 2022-02-02T21:17:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 -- 172.21.15.96:0/1510911234 wait complete. 2022-02-02T21:17:41.261 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:41 smithi096 ceph-mon[101353]: pgmap v5267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.256+0000 7fe928358700 1 Processor -- start 2022-02-02T21:17:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe928358700 1 -- start start 2022-02-02T21:17:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe928358700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 0x7fe920109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe928358700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe928358700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920060500 con 0x7fe9200f5ef0 2022-02-02T21:17:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe928358700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920060640 con 0x7fe9200f55e0 2022-02-02T21:17:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41964/0 (socket says 172.21.15.96:41964) 2022-02-02T21:17:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 -- 172.21.15.96:0/565764450 learned_addr learned my addr 172.21.15.96:0/565764450 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9260f4700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 0x7fe920109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 -- 172.21.15.96:0/565764450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 msgr2=0x7fe920109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 0x7fe920109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 -- 172.21.15.96:0/565764450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c005040 con 0x7fe9200f5ef0 2022-02-02T21:17:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.257+0000 7fe9258f3700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 rx=0x7fe91c009990 tx=0x7fe91c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.258+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c018070 con 0x7fe9200f5ef0 2022-02-02T21:17:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.258+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92010c6e0 con 0x7fe9200f5ef0 2022-02-02T21:17:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.258+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe91c007ba0 con 0x7fe9200f5ef0 2022-02-02T21:17:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.258+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c01c3c0 con 0x7fe9200f5ef0 2022-02-02T21:17:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.258+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92010cc40 con 0x7fe9200f5ef0 2022-02-02T21:17:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.259+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920045ad0 con 0x7fe9200f5ef0 2022-02-02T21:17:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.259+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe91c01d420 con 0x7fe9200f5ef0 2022-02-02T21:17:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.260+0000 7fe916ffd700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 0x7fe90c0672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.260+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe91c083760 con 0x7fe9200f5ef0 2022-02-02T21:17:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.260+0000 7fe9260f4700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 0x7fe90c0672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.260+0000 7fe9260f4700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 0x7fe90c0672d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fe920060180 tx=0x7fe91000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.264+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe91c051860 con 0x7fe9200f5ef0 2022-02-02T21:17:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:41 smithi159 ceph-mon[69013]: pgmap v5267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:41.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.498+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe920027a00 con 0x7fe9200f5ef0 2022-02-02T21:17:41.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.498+0000 7fe916ffd700 1 -- 172.21.15.96:0/565764450 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe91c054e80 con 0x7fe9200f5ef0 2022-02-02T21:17:41.501 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:17:41.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:17:41.501 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:17:41.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:41.502 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:17:41.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:17:41.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:41.502 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:17:41.503 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:17:41.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:41.503 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:17:41.503 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:17:41.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:17:41.504 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:17:41.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:17:41.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:17:41.504 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:17:41.505 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:17:41.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 msgr2=0x7fe90c0672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 0x7fe90c0672d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fe920060180 tx=0x7fe91000b040).stop 2022-02-02T21:17:41.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 msgr2=0x7fe92010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 rx=0x7fe91c009990 tx=0x7fe91c009b30).stop 2022-02-02T21:17:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 shutdown_connections 2022-02-02T21:17:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe90c064e10 0x7fe90c0672d0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f55e0 0x7fe920109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 --2- 172.21.15.96:0/565764450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5ef0 0x7fe92010c190 unknown :-1 s=CLOSED pgs=2704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 >> 172.21.15.96:0/565764450 conn(0x7fe9200f0de0 msgr2=0x7fe9200fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 shutdown_connections 2022-02-02T21:17:41.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.500+0000 7fe928358700 1 -- 172.21.15.96:0/565764450 wait complete. 2022-02-02T21:17:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 -- 172.21.15.96:0/3067793614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f6860 msgr2=0x7f372c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 --2- 172.21.15.96:0/3067793614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f6860 0x7f372c0f6cc0 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 rx=0x7f3720004660 tx=0x7f3720009b30).stop 2022-02-02T21:17:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 -- 172.21.15.96:0/3067793614 shutdown_connections 2022-02-02T21:17:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 --2- 172.21.15.96:0/3067793614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f6860 0x7f372c0f6cc0 unknown :-1 s=CLOSED pgs=2705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 --2- 172.21.15.96:0/3067793614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f55c0 0x7f372c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 -- 172.21.15.96:0/3067793614 >> 172.21.15.96:0/3067793614 conn(0x7f372c0f0d40 msgr2=0x7f372c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 -- 172.21.15.96:0/3067793614 shutdown_connections 2022-02-02T21:17:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.597+0000 7f3731fa2700 1 -- 172.21.15.96:0/3067793614 wait complete. 2022-02-02T21:17:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 Processor -- start 2022-02-02T21:17:41.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 -- start start 2022-02-02T21:17:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 0x7f372c0f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0f8920 con 0x7f372c0f55c0 2022-02-02T21:17:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f3731fa2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0f8a60 con 0x7f372c0f6860 2022-02-02T21:17:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f372b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f372b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41972/0 (socket says 172.21.15.96:41972) 2022-02-02T21:17:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f372b7fe700 1 -- 172.21.15.96:0/2366080651 learned_addr learned my addr 172.21.15.96:0/2366080651 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:17:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.598+0000 7f372affd700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 0x7f372c0f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f372b7fe700 1 -- 172.21.15.96:0/2366080651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 msgr2=0x7f372c0f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f372b7fe700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 0x7f372c0f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f372b7fe700 1 -- 172.21.15.96:0/2366080651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720005040 con 0x7f372c0f55c0 2022-02-02T21:17:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f372affd700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 0x7f372c0f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:17:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f372b7fe700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 rx=0x7f371c002700 tx=0x7f371c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c009320 con 0x7f372c0f55c0 2022-02-02T21:17:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f371c00f040 con 0x7f372c0f55c0 2022-02-02T21:17:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c0f8d40 con 0x7f372c0f55c0 2022-02-02T21:17:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c014900 con 0x7f372c0f55c0 2022-02-02T21:17:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.599+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c10efa0 con 0x7f372c0f55c0 2022-02-02T21:17:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.600+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c045ad0 con 0x7f372c0f55c0 2022-02-02T21:17:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.600+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f371c009480 con 0x7f372c0f55c0 2022-02-02T21:17:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.601+0000 7f3713fff700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 0x7f3714067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:17:41.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.601+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f371c081cc0 con 0x7f372c0f55c0 2022-02-02T21:17:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.601+0000 7f372affd700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 0x7f3714067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:17:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.601+0000 7f372affd700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 0x7f3714067290 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f3720004630 tx=0x7f3720009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:17:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.605+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f371c04fe80 con 0x7f372c0f55c0 2022-02-02T21:17:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.806+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f372c0f8ed0 con 0x7f372c0f55c0 2022-02-02T21:17:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.806+0000 7f3713fff700 1 -- 172.21.15.96:0/2366080651 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f372c0f8ed0 con 0x7f372c0f55c0 2022-02-02T21:17:41.809 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:17:41.809 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:17:41.809 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:17:41.810 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:17:41.810 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:41.810 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:17:41.810 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:17:41.810 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:17:41.811 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:17:41.811 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:17:41.811 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:17:41.811 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:17:41.812 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:17:41.812 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:17:41.812 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:17:41.812 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:17:41.812 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:17:41.813 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:17:41.813 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:17:41.813 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:17:41.813 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:17:41.813 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:17:41.814 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:17:41.814 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:17:41.814 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:17:41.815 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:17:41.815 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:17:41.815 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:17:41.815 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:17:41.816 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:17:41.816 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:17:41.816 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:17:41.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:41.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:41.817 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:17:41.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:17:41.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:41.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:41.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:17:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 msgr2=0x7f3714067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 0x7f3714067290 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f3720004630 tx=0x7f3720009b30).stop 2022-02-02T21:17:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 msgr2=0x7f372c0f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:17:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 rx=0x7f371c002700 tx=0x7f371c009d80).stop 2022-02-02T21:17:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 shutdown_connections 2022-02-02T21:17:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3714064dd0 0x7f3714067290 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f372c0f55c0 0x7f372c0f9f40 unknown :-1 s=CLOSED pgs=2706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 --2- 172.21.15.96:0/2366080651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0f6860 0x7f372c0f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:17:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 >> 172.21.15.96:0/2366080651 conn(0x7f372c0f0d40 msgr2=0x7f372c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:17:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 shutdown_connections 2022-02-02T21:17:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:17:41.808+0000 7f3731fa2700 1 -- 172.21.15.96:0/2366080651 wait complete. 2022-02-02T21:17:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:17:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:42 smithi159 ceph-mon[69013]: from='client.39506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:42 smithi159 ceph-mon[69013]: from='client.39510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/565764450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:17:42.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2366080651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:17:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:42 smithi096 ceph-mon[101353]: from='client.39506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:42.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:42 smithi096 ceph-mon[101353]: from='client.39510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:17:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/565764450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:17:42.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2366080651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:17:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:43 smithi159 ceph-mon[69013]: pgmap v5268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:43 smithi096 ceph-mon[101353]: pgmap v5268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:45 smithi159 ceph-mon[69013]: pgmap v5269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:45 smithi096 ceph-mon[101353]: pgmap v5269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:47 smithi096 ceph-mon[101353]: pgmap v5270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:47 smithi159 ceph-mon[69013]: pgmap v5270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:48 smithi159 ceph-mon[69013]: pgmap v5271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:48 smithi096 ceph-mon[101353]: pgmap v5271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:51.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:51 smithi159 ceph-mon[69013]: pgmap v5272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:51 smithi096 ceph-mon[101353]: pgmap v5272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:53 smithi159 ceph-mon[69013]: pgmap v5273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:53.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:53 smithi096 ceph-mon[101353]: pgmap v5273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:55 smithi159 ceph-mon[69013]: pgmap v5274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:55 smithi096 ceph-mon[101353]: pgmap v5274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:57 smithi096 ceph-mon[101353]: pgmap v5275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:57.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:57 smithi159 ceph-mon[69013]: pgmap v5275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:17:58 smithi159 ceph-mon[69013]: pgmap v5276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:17:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:17:58 smithi096 ceph-mon[101353]: pgmap v5276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:01 smithi159 ceph-mon[69013]: pgmap v5277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:01 smithi096 ceph-mon[101353]: pgmap v5277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:03.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:03 smithi159 ceph-mon[69013]: pgmap v5278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:03.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:03 smithi096 ceph-mon[101353]: pgmap v5278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:05 smithi159 ceph-mon[69013]: pgmap v5279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:05 smithi096 ceph-mon[101353]: pgmap v5279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:07 smithi096 ceph-mon[101353]: pgmap v5280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:07 smithi159 ceph-mon[69013]: pgmap v5280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:08 smithi159 ceph-mon[69013]: pgmap v5281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:08 smithi096 ceph-mon[101353]: pgmap v5281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:11 smithi159 ceph-mon[69013]: pgmap v5282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:11 smithi096 ceph-mon[101353]: pgmap v5282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:11.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 -- 172.21.15.96:0/3245831296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 msgr2=0x7f45340f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:11.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 --2- 172.21.15.96:0/3245831296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f45340f7de0 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 rx=0x7f4530004660 tx=0x7f4530009b30).stop 2022-02-02T21:18:11.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 -- 172.21.15.96:0/3245831296 shutdown_connections 2022-02-02T21:18:11.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 --2- 172.21.15.96:0/3245831296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f45340f7de0 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:11.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 --2- 172.21.15.96:0/3245831296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f45340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:11.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 -- 172.21.15.96:0/3245831296 >> 172.21.15.96:0/3245831296 conn(0x7f45340f1e40 msgr2=0x7f45340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:11.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 -- 172.21.15.96:0/3245831296 shutdown_connections 2022-02-02T21:18:11.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.920+0000 7f453c1df700 1 -- 172.21.15.96:0/3245831296 wait complete. 2022-02-02T21:18:11.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 Processor -- start 2022-02-02T21:18:11.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 -- start start 2022-02-02T21:18:11.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f453406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:11.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:11.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453406a380 con 0x7f45340f7980 2022-02-02T21:18:11.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453c1df700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453406a4c0 con 0x7f45340f66e0 2022-02-02T21:18:11.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453977a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:11.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453977a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41994/0 (socket says 172.21.15.96:41994) 2022-02-02T21:18:11.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f453977a700 1 -- 172.21.15.96:0/1489476676 learned_addr learned my addr 172.21.15.96:0/1489476676 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:11.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.921+0000 7f4539f7b700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f453406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:11.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453977a700 1 -- 172.21.15.96:0/1489476676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 msgr2=0x7f453406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:11.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453977a700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f453406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:11.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453977a700 1 -- 172.21.15.96:0/1489476676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530005040 con 0x7f45340f7980 2022-02-02T21:18:11.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f4539f7b700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f453406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:18:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453977a700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 rx=0x7f4530009990 tx=0x7f4530009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4530018070 con 0x7f45340f7980 2022-02-02T21:18:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453406a740 con 0x7f45340f7980 2022-02-02T21:18:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4530007ba0 con 0x7f45340f7980 2022-02-02T21:18:11.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453001c3c0 con 0x7f45340f7980 2022-02-02T21:18:11.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.922+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453406aca0 con 0x7f45340f7980 2022-02-02T21:18:11.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.923+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534045ad0 con 0x7f45340f7980 2022-02-02T21:18:11.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.923+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f453001d420 con 0x7f45340f7980 2022-02-02T21:18:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.924+0000 7f452a7fc700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 0x7f4520067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.924+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4530083760 con 0x7f45340f7980 2022-02-02T21:18:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.924+0000 7f4539f7b700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 0x7f4520067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.924+0000 7f4539f7b700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 0x7f4520067290 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f453406b730 tx=0x7f4524009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:11.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:11.928+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4530051800 con 0x7f45340f7980 2022-02-02T21:18:12.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.107+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45340ff010 con 0x7f4520064dd0 2022-02-02T21:18:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.108+0000 7f452a7fc700 1 -- 172.21.15.96:0/1489476676 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f45340ff010 con 0x7f4520064dd0 2022-02-02T21:18:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 msgr2=0x7f4520067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 0x7f4520067290 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f453406b730 tx=0x7f4524009c00).stop 2022-02-02T21:18:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 msgr2=0x7f4534069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 rx=0x7f4530009990 tx=0x7f4530009b30).stop 2022-02-02T21:18:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 shutdown_connections 2022-02-02T21:18:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4520064dd0 0x7f4520067290 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45340f66e0 0x7f453406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 --2- 172.21.15.96:0/1489476676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45340f7980 0x7f4534069e20 unknown :-1 s=CLOSED pgs=2708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 >> 172.21.15.96:0/1489476676 conn(0x7f45340f1e40 msgr2=0x7f45340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 shutdown_connections 2022-02-02T21:18:12.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.110+0000 7f453c1df700 1 -- 172.21.15.96:0/1489476676 wait complete. 2022-02-02T21:18:12.121 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:18:12.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 -- 172.21.15.96:0/3185838267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 msgr2=0x7fde100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 --2- 172.21.15.96:0/3185838267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde100f6cc0 secure :-1 s=READY pgs=2709 cs=0 l=1 rev1=1 rx=0x7fde00004660 tx=0x7fde00009b30).stop 2022-02-02T21:18:12.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 -- 172.21.15.96:0/3185838267 shutdown_connections 2022-02-02T21:18:12.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 --2- 172.21.15.96:0/3185838267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde100f6cc0 unknown :-1 s=CLOSED pgs=2709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 --2- 172.21.15.96:0/3185838267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 -- 172.21.15.96:0/3185838267 >> 172.21.15.96:0/3185838267 conn(0x7fde100f0d40 msgr2=0x7fde100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 -- 172.21.15.96:0/3185838267 shutdown_connections 2022-02-02T21:18:12.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.207+0000 7fde172eb700 1 -- 172.21.15.96:0/3185838267 wait complete. 2022-02-02T21:18:12.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 Processor -- start 2022-02-02T21:18:12.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 -- start start 2022-02-02T21:18:12.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde10105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde101069c0 con 0x7fde100f6860 2022-02-02T21:18:12.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde172eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde101071d0 con 0x7fde100f55c0 2022-02-02T21:18:12.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde14886700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde14886700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42004/0 (socket says 172.21.15.96:42004) 2022-02-02T21:18:12.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde14886700 1 -- 172.21.15.96:0/1776585218 learned_addr learned my addr 172.21.15.96:0/1776585218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:12.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.208+0000 7fde15087700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde10105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde14886700 1 -- 172.21.15.96:0/1776585218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 msgr2=0x7fde10105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde14886700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde10105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde14886700 1 -- 172.21.15.96:0/1776585218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00005040 con 0x7fde100f6860 2022-02-02T21:18:12.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde15087700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde10105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:18:12.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde14886700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 rx=0x7fde00009990 tx=0x7fde00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde00018070 con 0x7fde100f6860 2022-02-02T21:18:12.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde00007ba0 con 0x7fde100f6860 2022-02-02T21:18:12.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde101073f0 con 0x7fde100f6860 2022-02-02T21:18:12.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0001c3c0 con 0x7fde100f6860 2022-02-02T21:18:12.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.209+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde10107950 con 0x7fde100f6860 2022-02-02T21:18:12.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.210+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde0001d420 con 0x7fde100f6860 2022-02-02T21:18:12.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.210+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde100f49b0 con 0x7fde100f6860 2022-02-02T21:18:12.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.211+0000 7fde05ffb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 0x7fddfc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.211+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde00083760 con 0x7fde100f6860 2022-02-02T21:18:12.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.211+0000 7fde15087700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 0x7fddfc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.211+0000 7fde15087700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 0x7fddfc067290 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fde10105c40 tx=0x7fde0c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.215+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde00051800 con 0x7fde100f6860 2022-02-02T21:18:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.387+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde100fdf10 con 0x7fddfc064dd0 2022-02-02T21:18:12.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.397+0000 7fde05ffb700 1 -- 172.21.15.96:0/1776585218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fde100fdf10 con 0x7fddfc064dd0 2022-02-02T21:18:12.398 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:18:12.398 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:18:12.399 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:18:12.399 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:18:12.399 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:18:12.399 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:18:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:18:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:18:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:18:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:18:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:18:12.401 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:18:12.401 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:18:12.401 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:18:12.401 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:18:12.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:18:12.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:18:12.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:18:12.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:18:12.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:18:12.403 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 2h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:18:12.403 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:18:12.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.399+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 msgr2=0x7fddfc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.399+0000 7fde172eb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 0x7fddfc067290 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fde10105c40 tx=0x7fde0c009c00).stop 2022-02-02T21:18:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.399+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 msgr2=0x7fde101063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.399+0000 7fde172eb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 rx=0x7fde00009990 tx=0x7fde00009b30).stop 2022-02-02T21:18:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 shutdown_connections 2022-02-02T21:18:12.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fddfc064dd0 0x7fddfc067290 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde100f55c0 0x7fde10105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 --2- 172.21.15.96:0/1776585218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde100f6860 0x7fde101063c0 unknown :-1 s=CLOSED pgs=2710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 >> 172.21.15.96:0/1776585218 conn(0x7fde100f0d40 msgr2=0x7fde100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 shutdown_connections 2022-02-02T21:18:12.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.400+0000 7fde172eb700 1 -- 172.21.15.96:0/1776585218 wait complete. 2022-02-02T21:18:12.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- 172.21.15.96:0/3357412529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 msgr2=0x7fb3a00f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/3357412529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a00f6ae0 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 rx=0x7fb39c004660 tx=0x7fb39c009b30).stop 2022-02-02T21:18:12.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- 172.21.15.96:0/3357412529 shutdown_connections 2022-02-02T21:18:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/3357412529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 0x7fb3a00f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/3357412529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a00f6ae0 unknown :-1 s=CLOSED pgs=2711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- 172.21.15.96:0/3357412529 >> 172.21.15.96:0/3357412529 conn(0x7fb3a00f1e20 msgr2=0x7fb3a00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- 172.21.15.96:0/3357412529 shutdown_connections 2022-02-02T21:18:12.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- 172.21.15.96:0/3357412529 wait complete. 2022-02-02T21:18:12.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 Processor -- start 2022-02-02T21:18:12.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.496+0000 7fb3a7c47700 1 -- start start 2022-02-02T21:18:12.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a7c47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a7c47700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 0x7fb3a0107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a7c47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a0107a30 con 0x7fb3a00f66c0 2022-02-02T21:18:12.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a7c47700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a0107b70 con 0x7fb3a00f7960 2022-02-02T21:18:12.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42012/0 (socket says 172.21.15.96:42012) 2022-02-02T21:18:12.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 -- 172.21.15.96:0/2969124873 learned_addr learned my addr 172.21.15.96:0/2969124873 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:12.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a51e2700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 0x7fb3a0107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 -- 172.21.15.96:0/2969124873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 msgr2=0x7fb3a0107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 0x7fb3a0107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 -- 172.21.15.96:0/2969124873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c005040 con 0x7fb3a00f66c0 2022-02-02T21:18:12.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3a59e3700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 rx=0x7fb39c013a70 tx=0x7fb39c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.497+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39c018070 con 0x7fb3a00f66c0 2022-02-02T21:18:12.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.498+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a01084b0 con 0x7fb3a00f66c0 2022-02-02T21:18:12.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.498+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb39c0097d0 con 0x7fb3a00f66c0 2022-02-02T21:18:12.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.498+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a0108a10 con 0x7fb3a00f66c0 2022-02-02T21:18:12.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.498+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39c01dd70 con 0x7fb3a00f66c0 2022-02-02T21:18:12.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.499+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a0045ad0 con 0x7fb3a00f66c0 2022-02-02T21:18:12.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.499+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb39c007ba0 con 0x7fb3a00f66c0 2022-02-02T21:18:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.500+0000 7fb3967fc700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 0x7fb38c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.500+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb39c083440 con 0x7fb3a00f66c0 2022-02-02T21:18:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.500+0000 7fb3a51e2700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 0x7fb38c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.500+0000 7fb3a51e2700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 0x7fb38c067290 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fb3900096c0 tx=0x7fb390009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.504+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb39c054f70 con 0x7fb3a00f66c0 2022-02-02T21:18:12.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.733+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3a00fef90 con 0x7fb3a00f66c0 2022-02-02T21:18:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.733+0000 7fb3967fc700 1 -- 172.21.15.96:0/2969124873 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb39c054b60 con 0x7fb3a00f66c0 2022-02-02T21:18:12.930 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:18:12.930 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:18:12.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:18:12.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:12.931 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:18:12.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:18:12.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:12.931 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:18:12.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:18:12.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:12.932 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:18:12.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:18:12.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:12.933 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:18:12.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:18:12.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:18:12.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:18:12.934 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:18:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 msgr2=0x7fb38c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 0x7fb38c067290 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fb3900096c0 tx=0x7fb390009be0).stop 2022-02-02T21:18:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 msgr2=0x7fb3a0106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 rx=0x7fb39c013a70 tx=0x7fb39c009b30).stop 2022-02-02T21:18:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 shutdown_connections 2022-02-02T21:18:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb38c064dd0 0x7fb38c067290 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3a00f66c0 0x7fb3a0106f90 unknown :-1 s=CLOSED pgs=2712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 --2- 172.21.15.96:0/2969124873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a00f7960 0x7fb3a0107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 >> 172.21.15.96:0/2969124873 conn(0x7fb3a00f1e20 msgr2=0x7fb3a00fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 shutdown_connections 2022-02-02T21:18:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.735+0000 7fb3a7c47700 1 -- 172.21.15.96:0/2969124873 wait complete. 2022-02-02T21:18:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 -- 172.21.15.96:0/454478762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 msgr2=0x7f613c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 --2- 172.21.15.96:0/454478762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c0f6b30 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 rx=0x7f612c004660 tx=0x7f612c009b30).stop 2022-02-02T21:18:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 -- 172.21.15.96:0/454478762 shutdown_connections 2022-02-02T21:18:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 --2- 172.21.15.96:0/454478762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f66d0 0x7f613c0f6b30 unknown :-1 s=CLOSED pgs=2713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 --2- 172.21.15.96:0/454478762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f5430 0x7f613c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 -- 172.21.15.96:0/454478762 >> 172.21.15.96:0/454478762 conn(0x7f613c0f0b90 msgr2=0x7f613c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 -- 172.21.15.96:0/454478762 shutdown_connections 2022-02-02T21:18:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.833+0000 7f613b59e700 1 -- 172.21.15.96:0/454478762 wait complete. 2022-02-02T21:18:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 Processor -- start 2022-02-02T21:18:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 -- start start 2022-02-02T21:18:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0603e0 con 0x7f613c0f5430 2022-02-02T21:18:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c060520 con 0x7f613c0f66d0 2022-02-02T21:18:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42022/0 (socket says 172.21.15.96:42022) 2022-02-02T21:18:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.834+0000 7f613a59c700 1 -- 172.21.15.96:0/2062605465 learned_addr learned my addr 172.21.15.96:0/2062605465 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613a59c700 1 -- 172.21.15.96:0/2062605465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 msgr2=0x7f613c10bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f6139d9b700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613a59c700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c10bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613a59c700 1 -- 172.21.15.96:0/2062605465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c005040 con 0x7f613c0f5430 2022-02-02T21:18:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f6139d9b700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:18:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613a59c700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 secure :-1 s=READY pgs=2714 cs=0 l=1 rev1=1 rx=0x7f613000c530 tx=0x7f6130007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613000f650 con 0x7f613c0f5430 2022-02-02T21:18:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c10c4d0 con 0x7f613c0f5430 2022-02-02T21:18:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f613000fc60 con 0x7f613c0f5430 2022-02-02T21:18:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6130012d20 con 0x7f613c0f5430 2022-02-02T21:18:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.835+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c10ca90 con 0x7f613c0f5430 2022-02-02T21:18:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.836+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c045ad0 con 0x7f613c0f5430 2022-02-02T21:18:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.836+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6130019030 con 0x7f613c0f5430 2022-02-02T21:18:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.837+0000 7f612affd700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 0x7f61240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.837+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f61300816b0 con 0x7f613c0f5430 2022-02-02T21:18:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.837+0000 7f6139d9b700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 0x7f61240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.837+0000 7f6139d9b700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 0x7f61240672e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f612c009da0 tx=0x7f612c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:12.841+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f61300487d0 con 0x7f613c0f5430 2022-02-02T21:18:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.043+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f613c0fdd70 con 0x7f613c0f5430 2022-02-02T21:18:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.044+0000 7f612affd700 1 -- 172.21.15.96:0/2062605465 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f613004f8c0 con 0x7f613c0f5430 2022-02-02T21:18:13.045 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:18:13.046 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:18:13.046 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:18:13.046 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:18:13.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:13.047 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:18:13.047 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:18:13.047 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:18:13.047 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:18:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:18:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:18:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:18:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:18:13.048 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:18:13.049 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:18:13.049 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:18:13.049 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:18:13.049 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:18:13.050 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:18:13.050 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:18:13.050 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:18:13.050 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:18:13.050 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:18:13.051 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:18:13.051 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:18:13.051 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:18:13.051 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:18:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:18:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:18:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:18:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:18:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:18:13.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:13.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:13.053 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:18:13.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:13.054 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:13.054 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:13.054 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.045+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 msgr2=0x7f61240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.045+0000 7f613b59e700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 0x7f61240672e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f612c009da0 tx=0x7f612c009b30).stop 2022-02-02T21:18:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.045+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 msgr2=0x7f613c109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 secure :-1 s=READY pgs=2714 cs=0 l=1 rev1=1 rx=0x7f613000c530 tx=0x7f6130007e10).stop 2022-02-02T21:18:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 shutdown_connections 2022-02-02T21:18:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6124064e20 0x7f61240672e0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f613c0f5430 0x7f613c109a20 unknown :-1 s=CLOSED pgs=2714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 --2- 172.21.15.96:0/2062605465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f613c0f66d0 0x7f613c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 >> 172.21.15.96:0/2062605465 conn(0x7f613c0f0b90 msgr2=0x7f613c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 shutdown_connections 2022-02-02T21:18:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:13.046+0000 7f613b59e700 1 -- 172.21.15.96:0/2062605465 wait complete. 2022-02-02T21:18:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:18:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:13 smithi096 ceph-mon[101353]: pgmap v5283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:13 smithi096 ceph-mon[101353]: from='client.39522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:13.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2969124873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:18:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:13 smithi159 ceph-mon[69013]: pgmap v5283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:13 smithi159 ceph-mon[69013]: from='client.39522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2969124873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:18:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:14 smithi096 ceph-mon[101353]: from='client.39526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2062605465' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:18:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:14 smithi159 ceph-mon[69013]: from='client.39526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2062605465' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:18:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:15 smithi096 ceph-mon[101353]: pgmap v5284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:15 smithi159 ceph-mon[69013]: pgmap v5284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:17 smithi096 ceph-mon[101353]: pgmap v5285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:17 smithi159 ceph-mon[69013]: pgmap v5285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:18 smithi159 ceph-mon[69013]: pgmap v5286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:18 smithi096 ceph-mon[101353]: pgmap v5286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:21.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:21 smithi159 ceph-mon[69013]: pgmap v5287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:21 smithi096 ceph-mon[101353]: pgmap v5287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:23 smithi096 ceph-mon[101353]: pgmap v5288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:23 smithi159 ceph-mon[69013]: pgmap v5288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:25 smithi096 ceph-mon[101353]: pgmap v5289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:25 smithi159 ceph-mon[69013]: pgmap v5289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:27 smithi096 ceph-mon[101353]: pgmap v5290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:27 smithi159 ceph-mon[69013]: pgmap v5290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:18:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:18:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:28 smithi159 ceph-mon[69013]: pgmap v5291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:18:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:18:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:28 smithi096 ceph-mon[101353]: pgmap v5291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:31 smithi096 ceph-mon[101353]: pgmap v5292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:31 smithi159 ceph-mon[69013]: pgmap v5292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:33.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:33 smithi096 ceph-mon[101353]: pgmap v5293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:33 smithi159 ceph-mon[69013]: pgmap v5293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:35 smithi096 ceph-mon[101353]: pgmap v5294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:35 smithi159 ceph-mon[69013]: pgmap v5294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:37 smithi096 ceph-mon[101353]: pgmap v5295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:37.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:37 smithi159 ceph-mon[69013]: pgmap v5295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:38 smithi159 ceph-mon[69013]: pgmap v5296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:38 smithi096 ceph-mon[101353]: pgmap v5296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:41 smithi096 ceph-mon[101353]: pgmap v5297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:41.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:41 smithi159 ceph-mon[69013]: pgmap v5297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:43.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 -- 172.21.15.96:0/1785218566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f6ac0 msgr2=0x7f370c0f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 --2- 172.21.15.96:0/1785218566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f6ac0 0x7f370c0f6ee0 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 rx=0x7f36fc004660 tx=0x7f36fc009b30).stop 2022-02-02T21:18:43.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 -- 172.21.15.96:0/1785218566 shutdown_connections 2022-02-02T21:18:43.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 --2- 172.21.15.96:0/1785218566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f57d0 0x7f370c0f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 --2- 172.21.15.96:0/1785218566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f6ac0 0x7f370c0f6ee0 unknown :-1 s=CLOSED pgs=2715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.156+0000 7f370b59e700 1 -- 172.21.15.96:0/1785218566 >> 172.21.15.96:0/1785218566 conn(0x7f370c0f0320 msgr2=0x7f370c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 -- 172.21.15.96:0/1785218566 shutdown_connections 2022-02-02T21:18:43.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 -- 172.21.15.96:0/1785218566 wait complete. 2022-02-02T21:18:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 Processor -- start 2022-02-02T21:18:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 -- start start 2022-02-02T21:18:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 0x7f370c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c107880 con 0x7f370c0f57d0 2022-02-02T21:18:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c1080c0 con 0x7f370c0f6ac0 2022-02-02T21:18:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42040/0 (socket says 172.21.15.96:42040) 2022-02-02T21:18:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.157+0000 7f370a59c700 1 -- 172.21.15.96:0/1836879400 learned_addr learned my addr 172.21.15.96:0/1836879400 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f3709d9b700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 0x7f370c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370a59c700 1 -- 172.21.15.96:0/1836879400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 msgr2=0x7f370c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370a59c700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 0x7f370c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370a59c700 1 -- 172.21.15.96:0/1836879400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc005040 con 0x7f370c0f57d0 2022-02-02T21:18:43.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f3709d9b700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 0x7f370c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:18:43.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370a59c700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 rx=0x7f36fc009990 tx=0x7f36fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc018070 con 0x7f370c0f57d0 2022-02-02T21:18:43.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f36fc007ca0 con 0x7f370c0f57d0 2022-02-02T21:18:43.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c108340 con 0x7f370c0f57d0 2022-02-02T21:18:43.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc01c620 con 0x7f370c0f57d0 2022-02-02T21:18:43.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.158+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c108820 con 0x7f370c0f57d0 2022-02-02T21:18:43.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.159+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c059100 con 0x7f370c0f57d0 2022-02-02T21:18:43.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.160+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f36fc01d960 con 0x7f370c0f57d0 2022-02-02T21:18:43.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.160+0000 7f3702ffd700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 0x7f36f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.160+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f36fc0837e0 con 0x7f370c0f57d0 2022-02-02T21:18:43.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.160+0000 7f3709d9b700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 0x7f36f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.161+0000 7f3709d9b700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 0x7f36f80672e0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f370c106b20 tx=0x7f36f4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.164+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f36fc0519a0 con 0x7f370c0f57d0 2022-02-02T21:18:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:43 smithi096 ceph-mon[101353]: pgmap v5298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:43.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.349+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f370c0fac20 con 0x7f36f8064e20 2022-02-02T21:18:43.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.350+0000 7f3702ffd700 1 -- 172.21.15.96:0/1836879400 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f370c0fac20 con 0x7f36f8064e20 2022-02-02T21:18:43.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 msgr2=0x7f36f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 0x7f36f80672e0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f370c106b20 tx=0x7f36f4009040).stop 2022-02-02T21:18:43.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 msgr2=0x7f370c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 rx=0x7f36fc009990 tx=0x7f36fc009b30).stop 2022-02-02T21:18:43.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 shutdown_connections 2022-02-02T21:18:43.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f36f8064e20 0x7f36f80672e0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f370c0f57d0 0x7f370c106d90 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 --2- 172.21.15.96:0/1836879400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f370c0f6ac0 0x7f370c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 >> 172.21.15.96:0/1836879400 conn(0x7f370c0f0320 msgr2=0x7f370c0f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 shutdown_connections 2022-02-02T21:18:43.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.352+0000 7f370b59e700 1 -- 172.21.15.96:0/1836879400 wait complete. 2022-02-02T21:18:43.363 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:18:43.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 -- 172.21.15.96:0/1798597372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f7980 msgr2=0x7f13800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 --2- 172.21.15.96:0/1798597372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f7980 0x7f13800f7de0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 rx=0x7f1370004660 tx=0x7f1370009b30).stop 2022-02-02T21:18:43.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 -- 172.21.15.96:0/1798597372 shutdown_connections 2022-02-02T21:18:43.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 --2- 172.21.15.96:0/1798597372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f7980 0x7f13800f7de0 unknown :-1 s=CLOSED pgs=2717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 --2- 172.21.15.96:0/1798597372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f66e0 0x7f13800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 -- 172.21.15.96:0/1798597372 >> 172.21.15.96:0/1798597372 conn(0x7f13800f1e40 msgr2=0x7f13800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 -- 172.21.15.96:0/1798597372 shutdown_connections 2022-02-02T21:18:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.450+0000 7f1385db8700 1 -- 172.21.15.96:0/1798597372 wait complete. 2022-02-02T21:18:43.595 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:43 smithi159 ceph-mon[69013]: pgmap v5298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 Processor -- start 2022-02-02T21:18:43.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 -- start start 2022-02-02T21:18:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f7980 0x7f1380107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380107a00 con 0x7f13800f66e0 2022-02-02T21:18:43.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f1385db8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380107b40 con 0x7f13800f7980 2022-02-02T21:18:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.451+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42050/0 (socket says 172.21.15.96:42050) 2022-02-02T21:18:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 -- 172.21.15.96:0/3130046530 learned_addr learned my addr 172.21.15.96:0/3130046530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137effd700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f7980 0x7f1380107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 -- 172.21.15.96:0/3130046530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f7980 msgr2=0x7f1380107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f7980 0x7f1380107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 -- 172.21.15.96:0/3130046530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370005040 con 0x7f13800f66e0 2022-02-02T21:18:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f137f7fe700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 rx=0x7f1374002700 tx=0x7f1374009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1374009320 con 0x7f13800f66e0 2022-02-02T21:18:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13801084e0 con 0x7f13800f66e0 2022-02-02T21:18:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f137400f040 con 0x7f13800f66e0 2022-02-02T21:18:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1374014900 con 0x7f13800f66e0 2022-02-02T21:18:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.452+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1380108aa0 con 0x7f13800f66e0 2022-02-02T21:18:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.453+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1380045ad0 con 0x7f13800f66e0 2022-02-02T21:18:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.454+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1374009480 con 0x7f13800f66e0 2022-02-02T21:18:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.454+0000 7f1367fff700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 0x7f1368067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.454+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1374081df0 con 0x7f13800f66e0 2022-02-02T21:18:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.454+0000 7f137effd700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 0x7f1368067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.455+0000 7f137effd700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 0x7f1368067290 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f1370004630 tx=0x7f1370009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.458+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1374053920 con 0x7f13800f66e0 2022-02-02T21:18:43.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.631+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1380108dd0 con 0x7f1368064dd0 2022-02-02T21:18:43.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.640+0000 7f1367fff700 1 -- 172.21.15.96:0/3130046530 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1380108dd0 con 0x7f1368064dd0 2022-02-02T21:18:43.642 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:18:43.642 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:18:43.642 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:18:43.642 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:18:43.643 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:18:43.643 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:18:43.643 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:18:43.643 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:18:43.644 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:18:43.644 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:18:43.644 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:18:43.644 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:18:43.645 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:18:43.645 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:18:43.645 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:18:43.645 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:18:43.645 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:18:43.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:18:43.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:18:43.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:18:43.646 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:18:43.647 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:18:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 msgr2=0x7f1368067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 0x7f1368067290 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f1370004630 tx=0x7f1370009b30).stop 2022-02-02T21:18:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 msgr2=0x7f1380106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 rx=0x7f1374002700 tx=0x7f1374009d80).stop 2022-02-02T21:18:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 shutdown_connections 2022-02-02T21:18:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1368064dd0 0x7f1368067290 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f66e0 0x7f1380106f60 unknown :-1 s=CLOSED pgs=2718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 --2- 172.21.15.96:0/3130046530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f7980 0x7f1380107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 >> 172.21.15.96:0/3130046530 conn(0x7f13800f1e40 msgr2=0x7f13800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 shutdown_connections 2022-02-02T21:18:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.642+0000 7f1385db8700 1 -- 172.21.15.96:0/3130046530 wait complete. 2022-02-02T21:18:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 -- 172.21.15.96:0/3262425976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 msgr2=0x7f44c80f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 --2- 172.21.15.96:0/3262425976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c80f5df0 secure :-1 s=READY pgs=2719 cs=0 l=1 rev1=1 rx=0x7f44bc004660 tx=0x7f44bc009b30).stop 2022-02-02T21:18:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 -- 172.21.15.96:0/3262425976 shutdown_connections 2022-02-02T21:18:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 --2- 172.21.15.96:0/3262425976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c80f5df0 unknown :-1 s=CLOSED pgs=2719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 --2- 172.21.15.96:0/3262425976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 0x7f44c80f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:18:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 -- 172.21.15.96:0/3262425976 >> 172.21.15.96:0/3262425976 conn(0x7f44c80f04c0 msgr2=0x7f44c80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 -- 172.21.15.96:0/3262425976 shutdown_connections 2022-02-02T21:18:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.738+0000 7f44cd873700 1 -- 172.21.15.96:0/3262425976 wait complete. 2022-02-02T21:18:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 Processor -- start 2022-02-02T21:18:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 -- start start 2022-02-02T21:18:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 0x7f44c810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80f56f0 con 0x7f44c80f5970 2022-02-02T21:18:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.739+0000 7f44cd873700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80f5830 con 0x7f44c80f6c60 2022-02-02T21:18:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42060/0 (socket says 172.21.15.96:42060) 2022-02-02T21:18:43.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 -- 172.21.15.96:0/1000963123 learned_addr learned my addr 172.21.15.96:0/1000963123 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:43.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c67fc700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 0x7f44c810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 -- 172.21.15.96:0/1000963123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 msgr2=0x7f44c810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 0x7f44c810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 -- 172.21.15.96:0/1000963123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc005040 con 0x7f44c80f5970 2022-02-02T21:18:43.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44c6ffd700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 rx=0x7f44b800b410 tx=0x7f44b8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b80125f0 con 0x7f44c80f5970 2022-02-02T21:18:43.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c810c770 con 0x7f44c80f5970 2022-02-02T21:18:43.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f44b800be30 con 0x7f44c80f5970 2022-02-02T21:18:43.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c810cd30 con 0x7f44c80f5970 2022-02-02T21:18:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.740+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b8002a70 con 0x7f44c80f5970 2022-02-02T21:18:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.741+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8045ad0 con 0x7f44c80f5970 2022-02-02T21:18:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.742+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f44b800f030 con 0x7f44c80f5970 2022-02-02T21:18:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.742+0000 7f44af7fe700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 0x7f44b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.742+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f44b8081e80 con 0x7f44c80f5970 2022-02-02T21:18:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.742+0000 7f44c67fc700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 0x7f44b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.743+0000 7f44c67fc700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 0x7f44b0067290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f44bc004630 tx=0x7f44bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.746+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f44b804ff80 con 0x7f44c80f5970 2022-02-02T21:18:43.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.977+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f44c80fdec0 con 0x7f44c80f5970 2022-02-02T21:18:43.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.978+0000 7f44af7fe700 1 -- 172.21.15.96:0/1000963123 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f44b80535a0 con 0x7f44c80f5970 2022-02-02T21:18:43.979 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:18:43.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:18:43.979 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:18:43.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:43.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:18:43.980 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:18:43.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:43.981 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:18:43.981 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:18:43.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:43.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:18:43.981 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:18:43.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:18:43.982 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:18:43.982 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:18:43.982 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:18:43.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:18:43.983 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:18:43.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 msgr2=0x7f44b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 0x7f44b0067290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f44bc004630 tx=0x7f44bc009b30).stop 2022-02-02T21:18:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 msgr2=0x7f44c8109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 rx=0x7f44b800b410 tx=0x7f44b8006ef0).stop 2022-02-02T21:18:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 shutdown_connections 2022-02-02T21:18:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f44b0064dd0 0x7f44b0067290 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80f5970 0x7f44c8109c10 unknown :-1 s=CLOSED pgs=2720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 --2- 172.21.15.96:0/1000963123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44c80f6c60 0x7f44c810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 >> 172.21.15.96:0/1000963123 conn(0x7f44c80f04c0 msgr2=0x7f44c80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 shutdown_connections 2022-02-02T21:18:43.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:43.979+0000 7f44cd873700 1 -- 172.21.15.96:0/1000963123 wait complete. 2022-02-02T21:18:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 -- 172.21.15.96:0/769109659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f66e0 msgr2=0x7f7b280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 --2- 172.21.15.96:0/769109659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f66e0 0x7f7b280f6b00 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 rx=0x7f7b1c004660 tx=0x7f7b1c009b30).stop 2022-02-02T21:18:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 -- 172.21.15.96:0/769109659 shutdown_connections 2022-02-02T21:18:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 --2- 172.21.15.96:0/769109659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f6ff0 0x7f7b280f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 --2- 172.21.15.96:0/769109659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f66e0 0x7f7b280f6b00 unknown :-1 s=CLOSED pgs=2721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 -- 172.21.15.96:0/769109659 >> 172.21.15.96:0/769109659 conn(0x7f7b280f1f00 msgr2=0x7f7b280f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 -- 172.21.15.96:0/769109659 shutdown_connections 2022-02-02T21:18:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.078+0000 7f7b2f076700 1 -- 172.21.15.96:0/769109659 wait complete. 2022-02-02T21:18:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 Processor -- start 2022-02-02T21:18:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 -- start start 2022-02-02T21:18:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806a380 con 0x7f7b280f6ff0 2022-02-02T21:18:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2f076700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806a4c0 con 0x7f7b280f66e0 2022-02-02T21:18:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42072/0 (socket says 172.21.15.96:42072) 2022-02-02T21:18:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b27fff700 1 -- 172.21.15.96:0/864941749 learned_addr learned my addr 172.21.15.96:0/864941749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:18:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.079+0000 7f7b2ce12700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b27fff700 1 -- 172.21.15.96:0/864941749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 msgr2=0x7f7b2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b27fff700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b27fff700 1 -- 172.21.15.96:0/864941749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c005040 con 0x7f7b280f6ff0 2022-02-02T21:18:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b2ce12700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:18:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b27fff700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 rx=0x7f7b140026d0 tx=0x7f7b14009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14009320 con 0x7f7b280f6ff0 2022-02-02T21:18:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b1400f040 con 0x7f7b280f6ff0 2022-02-02T21:18:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2806a7a0 con 0x7f7b280f6ff0 2022-02-02T21:18:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b140147e0 con 0x7f7b280f6ff0 2022-02-02T21:18:44.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.080+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2810ef90 con 0x7f7b280f6ff0 2022-02-02T21:18:44.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.081+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b28045ad0 con 0x7f7b280f6ff0 2022-02-02T21:18:44.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.081+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b14009480 con 0x7f7b280f6ff0 2022-02-02T21:18:44.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.082+0000 7f7b257fa700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:18:44.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.082+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b14082120 con 0x7f7b280f6ff0 2022-02-02T21:18:44.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.082+0000 7f7b2ce12700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:18:44.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.082+0000 7f7b2ce12700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f7b1c005010 tx=0x7f7b1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:18:44.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.086+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b14050220 con 0x7f7b280f6ff0 2022-02-02T21:18:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.288+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b280feed0 con 0x7f7b280f6ff0 2022-02-02T21:18:44.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1000963123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:18:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.288+0000 7f7b257fa700 1 -- 172.21.15.96:0/864941749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7b14053840 con 0x7f7b280f6ff0 2022-02-02T21:18:44.291 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:18:44.291 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:18:44.291 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:18:44.292 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:18:44.292 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:44.292 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:18:44.292 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:18:44.293 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:18:44.293 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:18:44.293 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:18:44.293 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:18:44.294 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:18:44.294 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:18:44.294 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:18:44.295 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:18:44.295 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:18:44.295 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:18:44.295 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:18:44.296 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:18:44.296 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:18:44.296 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:18:44.296 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:18:44.297 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:18:44.297 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:18:44.297 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:18:44.297 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:18:44.298 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:18:44.298 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:18:44.298 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:18:44.298 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:18:44.299 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:18:44.299 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:18:44.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:44.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:44.299 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:18:44.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:18:44.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:44.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:44.301 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:18:44.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 msgr2=0x7f7b18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:44.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f7b1c005010 tx=0x7f7b1c009b30).stop 2022-02-02T21:18:44.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 msgr2=0x7f7b28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:18:44.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 rx=0x7f7b140026d0 tx=0x7f7b14009de0).stop 2022-02-02T21:18:44.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 shutdown_connections 2022-02-02T21:18:44.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 --2- 172.21.15.96:0/864941749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f6ff0 0x7f7b28069e20 unknown :-1 s=CLOSED pgs=2722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:18:44.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.291+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 >> 172.21.15.96:0/864941749 conn(0x7f7b280f1f00 msgr2=0x7f7b280fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:18:44.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.292+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 shutdown_connections 2022-02-02T21:18:44.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:18:44.292+0000 7f7b2f076700 1 -- 172.21.15.96:0/864941749 wait complete. 2022-02-02T21:18:44.305 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:18:44.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1000963123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:18:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:45 smithi096 ceph-mon[101353]: from='client.39538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:45 smithi096 ceph-mon[101353]: from='client.39542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:45 smithi096 ceph-mon[101353]: pgmap v5299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/864941749' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:18:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:45 smithi159 ceph-mon[69013]: from='client.39538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:45 smithi159 ceph-mon[69013]: from='client.39542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:18:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:45 smithi159 ceph-mon[69013]: pgmap v5299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/864941749' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:18:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:47 smithi096 ceph-mon[101353]: pgmap v5300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:47 smithi159 ceph-mon[69013]: pgmap v5300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:48 smithi159 ceph-mon[69013]: pgmap v5301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:48 smithi096 ceph-mon[101353]: pgmap v5301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:51 smithi096 ceph-mon[101353]: pgmap v5302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:51.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:51 smithi159 ceph-mon[69013]: pgmap v5302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:53.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:53 smithi096 ceph-mon[101353]: pgmap v5303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:53 smithi159 ceph-mon[69013]: pgmap v5303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:55 smithi096 ceph-mon[101353]: pgmap v5304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:55.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:55 smithi159 ceph-mon[69013]: pgmap v5304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:57 smithi096 ceph-mon[101353]: pgmap v5305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:57.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:57 smithi159 ceph-mon[69013]: pgmap v5305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:18:58 smithi159 ceph-mon[69013]: pgmap v5306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:18:58.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:18:58 smithi096 ceph-mon[101353]: pgmap v5306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:01 smithi096 ceph-mon[101353]: pgmap v5307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:01 smithi159 ceph-mon[69013]: pgmap v5307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:03.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:03 smithi096 ceph-mon[101353]: pgmap v5308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:03 smithi159 ceph-mon[69013]: pgmap v5308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:05 smithi096 ceph-mon[101353]: pgmap v5309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:05 smithi159 ceph-mon[69013]: pgmap v5309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:07 smithi096 ceph-mon[101353]: pgmap v5310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:07 smithi159 ceph-mon[69013]: pgmap v5310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:08 smithi159 ceph-mon[69013]: pgmap v5311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:08 smithi096 ceph-mon[101353]: pgmap v5311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:11 smithi096 ceph-mon[101353]: pgmap v5312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:11 smithi159 ceph-mon[69013]: pgmap v5312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:13.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:13 smithi096 ceph-mon[101353]: pgmap v5313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:13 smithi159 ceph-mon[69013]: pgmap v5313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:14.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 -- 172.21.15.96:0/4140484389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06a350 msgr2=0x7fd46c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 --2- 172.21.15.96:0/4140484389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06a350 0x7fd46c06a7d0 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 rx=0x7fd460004660 tx=0x7fd460009b30).stop 2022-02-02T21:19:14.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 -- 172.21.15.96:0/4140484389 shutdown_connections 2022-02-02T21:19:14.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 --2- 172.21.15.96:0/4140484389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06a350 0x7fd46c06a7d0 unknown :-1 s=CLOSED pgs=2723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 --2- 172.21.15.96:0/4140484389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06b960 0x7fd46c069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 -- 172.21.15.96:0/4140484389 >> 172.21.15.96:0/4140484389 conn(0x7fd46c0f1e40 msgr2=0x7fd46c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:14.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 -- 172.21.15.96:0/4140484389 shutdown_connections 2022-02-02T21:19:14.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.401+0000 7fd473923700 1 -- 172.21.15.96:0/4140484389 wait complete. 2022-02-02T21:19:14.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 Processor -- start 2022-02-02T21:19:14.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 -- start start 2022-02-02T21:19:14.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 0x7fd46c109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c109be0 con 0x7fd46c06b960 2022-02-02T21:19:14.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd473923700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c109d20 con 0x7fd46c06a350 2022-02-02T21:19:14.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42090/0 (socket says 172.21.15.96:42090) 2022-02-02T21:19:14.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 -- 172.21.15.96:0/3134833201 learned_addr learned my addr 172.21.15.96:0/3134833201 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:14.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd4716bf700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 0x7fd46c109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 -- 172.21.15.96:0/3134833201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 msgr2=0x7fd46c109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 0x7fd46c109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd470ebe700 1 -- 172.21.15.96:0/3134833201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460005040 con 0x7fd46c06b960 2022-02-02T21:19:14.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.402+0000 7fd4716bf700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 0x7fd46c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:19:14.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd470ebe700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 rx=0x7fd460009990 tx=0x7fd460009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460018070 con 0x7fd46c06b960 2022-02-02T21:19:14.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd460007ba0 con 0x7fd46c06b960 2022-02-02T21:19:14.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c10a660 con 0x7fd46c06b960 2022-02-02T21:19:14.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd46001c3c0 con 0x7fd46c06b960 2022-02-02T21:19:14.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.403+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c10abc0 con 0x7fd46c06b960 2022-02-02T21:19:14.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.404+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c045ad0 con 0x7fd46c06b960 2022-02-02T21:19:14.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.404+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd46001d420 con 0x7fd46c06b960 2022-02-02T21:19:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.405+0000 7fd45dffb700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 0x7fd458067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.405+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd460083760 con 0x7fd46c06b960 2022-02-02T21:19:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.405+0000 7fd4716bf700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 0x7fd458067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.405+0000 7fd4716bf700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 0x7fd458067290 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fd468009740 tx=0x7fd468009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.409+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd460055230 con 0x7fd46c06b960 2022-02-02T21:19:14.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.589+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd46c1011a0 con 0x7fd458064dd0 2022-02-02T21:19:14.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.590+0000 7fd45dffb700 1 -- 172.21.15.96:0/3134833201 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd46c1011a0 con 0x7fd458064dd0 2022-02-02T21:19:14.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 msgr2=0x7fd458067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 0x7fd458067290 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fd468009740 tx=0x7fd468009be0).stop 2022-02-02T21:19:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 msgr2=0x7fd46c109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 rx=0x7fd460009990 tx=0x7fd460009b30).stop 2022-02-02T21:19:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 shutdown_connections 2022-02-02T21:19:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd458064dd0 0x7fd458067290 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c06a350 0x7fd46c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 --2- 172.21.15.96:0/3134833201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd46c06b960 0x7fd46c109630 unknown :-1 s=CLOSED pgs=2724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 >> 172.21.15.96:0/3134833201 conn(0x7fd46c0f1e40 msgr2=0x7fd46c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 shutdown_connections 2022-02-02T21:19:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.592+0000 7fd473923700 1 -- 172.21.15.96:0/3134833201 wait complete. 2022-02-02T21:19:14.603 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:19:14.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 -- 172.21.15.96:0/3374663586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f7980 msgr2=0x7fbe1c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/3374663586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c0f7de0 secure :-1 s=READY pgs=2725 cs=0 l=1 rev1=1 rx=0x7fbe0c004660 tx=0x7fbe0c009b30).stop 2022-02-02T21:19:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 -- 172.21.15.96:0/3374663586 shutdown_connections 2022-02-02T21:19:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/3374663586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c0f7de0 unknown :-1 s=CLOSED pgs=2725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/3374663586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 -- 172.21.15.96:0/3374663586 >> 172.21.15.96:0/3374663586 conn(0x7fbe1c0f1e40 msgr2=0x7fbe1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 -- 172.21.15.96:0/3374663586 shutdown_connections 2022-02-02T21:19:14.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.690+0000 7fbe20a5e700 1 -- 172.21.15.96:0/3374663586 wait complete. 2022-02-02T21:19:14.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 Processor -- start 2022-02-02T21:19:14.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 -- start start 2022-02-02T21:19:14.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c107a00 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe20a5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c107b40 con 0x7fbe1c0f7980 2022-02-02T21:19:14.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe1a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe1a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42098/0 (socket says 172.21.15.96:42098) 2022-02-02T21:19:14.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.691+0000 7fbe1a59c700 1 -- 172.21.15.96:0/1906359199 learned_addr learned my addr 172.21.15.96:0/1906359199 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:14.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe19d9b700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe1a59c700 1 -- 172.21.15.96:0/1906359199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f7980 msgr2=0x7fbe1c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe1a59c700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe1a59c700 1 -- 172.21.15.96:0/1906359199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c005040 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe1a59c700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 rx=0x7fbe10002700 tx=0x7fbe10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe10009320 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe1000f040 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c1084e0 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe10014900 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.692+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c108aa0 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.693+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c045ad0 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.693+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe10009480 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.694+0000 7fbe0affd700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.694+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbe10081cc0 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.694+0000 7fbe19d9b700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.694+0000 7fbe19d9b700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 0x7fbe04067290 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fbe0c004630 tx=0x7fbe0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.698+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe100538b0 con 0x7fbe1c0f66e0 2022-02-02T21:19:14.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.869+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe1c108d20 con 0x7fbe04064dd0 2022-02-02T21:19:14.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.878+0000 7fbe0affd700 1 -- 172.21.15.96:0/1906359199 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbe1c108d20 con 0x7fbe04064dd0 2022-02-02T21:19:14.882 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:19:14.882 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:19:14.882 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:19:14.882 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:19:14.883 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:19:14.883 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (2h) 2h ago 2h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:19:14.883 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 2h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:19:14.883 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (2h) 2h ago 2h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:19:14.884 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 2h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:19:14.884 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:19:14.884 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:19:14.884 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:19:14.884 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:19:14.885 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:19:14.885 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:19:14.885 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:19:14.885 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:19:14.886 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:19:14.886 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:19:14.886 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:19:14.886 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:19:14.886 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:19:14.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 msgr2=0x7fbe04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 0x7fbe04067290 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fbe0c004630 tx=0x7fbe0c009b30).stop 2022-02-02T21:19:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 msgr2=0x7fbe1c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 rx=0x7fbe10002700 tx=0x7fbe10009d80).stop 2022-02-02T21:19:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 shutdown_connections 2022-02-02T21:19:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106f60 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 --2- 172.21.15.96:0/1906359199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 >> 172.21.15.96:0/1906359199 conn(0x7fbe1c0f1e40 msgr2=0x7fbe1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 shutdown_connections 2022-02-02T21:19:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.881+0000 7fbe20a5e700 1 -- 172.21.15.96:0/1906359199 wait complete. 2022-02-02T21:19:14.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 -- 172.21.15.96:0/468049581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 msgr2=0x7f13800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 --2- 172.21.15.96:0/468049581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f13800f59e0 secure :-1 s=READY pgs=2727 cs=0 l=1 rev1=1 rx=0x7f1368004660 tx=0x7f1368009b30).stop 2022-02-02T21:19:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 -- 172.21.15.96:0/468049581 shutdown_connections 2022-02-02T21:19:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 --2- 172.21.15.96:0/468049581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 0x7f13800f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 --2- 172.21.15.96:0/468049581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f13800f59e0 unknown :-1 s=CLOSED pgs=2727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 -- 172.21.15.96:0/468049581 >> 172.21.15.96:0/468049581 conn(0x7f13800f0d40 msgr2=0x7f13800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 -- 172.21.15.96:0/468049581 shutdown_connections 2022-02-02T21:19:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.977+0000 7f1385e51700 1 -- 172.21.15.96:0/468049581 wait complete. 2022-02-02T21:19:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 Processor -- start 2022-02-02T21:19:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 -- start start 2022-02-02T21:19:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 0x7f1380106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380106910 con 0x7f13800f55c0 2022-02-02T21:19:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f1385e51700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380106a50 con 0x7f13800f6860 2022-02-02T21:19:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42108/0 (socket says 172.21.15.96:42108) 2022-02-02T21:19:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f137f7fe700 1 -- 172.21.15.96:0/1356965110 learned_addr learned my addr 172.21.15.96:0/1356965110 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.978+0000 7f137effd700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 0x7f1380106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f137f7fe700 1 -- 172.21.15.96:0/1356965110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 msgr2=0x7f1380106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f137f7fe700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 0x7f1380106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:14.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f137f7fe700 1 -- 172.21.15.96:0/1356965110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368005040 con 0x7f13800f55c0 2022-02-02T21:19:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f137f7fe700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 rx=0x7f1368013a70 tx=0x7f1368009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1368018070 con 0x7f13800f55c0 2022-02-02T21:19:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1380107390 con 0x7f13800f55c0 2022-02-02T21:19:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13680097d0 con 0x7f13800f55c0 2022-02-02T21:19:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136801de80 con 0x7f13800f55c0 2022-02-02T21:19:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.979+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13801078f0 con 0x7f13800f55c0 2022-02-02T21:19:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.980+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1380045ad0 con 0x7f13800f55c0 2022-02-02T21:19:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.981+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1368007ba0 con 0x7f13800f55c0 2022-02-02T21:19:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.981+0000 7f1377fff700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 0x7f136c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.981+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1368083660 con 0x7f13800f55c0 2022-02-02T21:19:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.981+0000 7f137effd700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 0x7f136c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.982+0000 7f137effd700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 0x7f136c067290 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f1370004c40 tx=0x7f137000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:14.985+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1368055190 con 0x7f13800f55c0 2022-02-02T21:19:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.217+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13800fdf00 con 0x7f13800f55c0 2022-02-02T21:19:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.217+0000 7f1377fff700 1 -- 172.21.15.96:0/1356965110 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1368054d80 con 0x7f13800f55c0 2022-02-02T21:19:15.221 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:19:15.221 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:19:15.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:19:15.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:15.222 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:19:15.222 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:19:15.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:15.223 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:19:15.223 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:19:15.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:15.223 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:19:15.224 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:19:15.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:15.225 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:19:15.225 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:19:15.226 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:19:15.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:19:15.226 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:19:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 msgr2=0x7f136c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 0x7f136c067290 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f1370004c40 tx=0x7f137000b040).stop 2022-02-02T21:19:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 msgr2=0x7f1380105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 rx=0x7f1368013a70 tx=0x7f1368009b30).stop 2022-02-02T21:19:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 shutdown_connections 2022-02-02T21:19:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f136c064dd0 0x7f136c067290 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13800f55c0 0x7f1380105e70 unknown :-1 s=CLOSED pgs=2728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 --2- 172.21.15.96:0/1356965110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13800f6860 0x7f1380106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 >> 172.21.15.96:0/1356965110 conn(0x7f13800f0d40 msgr2=0x7f13800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 shutdown_connections 2022-02-02T21:19:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.219+0000 7f1385e51700 1 -- 172.21.15.96:0/1356965110 wait complete. 2022-02-02T21:19:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:15 smithi096 ceph-mon[101353]: pgmap v5314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 -- 172.21.15.96:0/1002419894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f7980 msgr2=0x7f196c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 --2- 172.21.15.96:0/1002419894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f7980 0x7f196c0f7de0 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 rx=0x7f1960004660 tx=0x7f1960009b30).stop 2022-02-02T21:19:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 -- 172.21.15.96:0/1002419894 shutdown_connections 2022-02-02T21:19:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 --2- 172.21.15.96:0/1002419894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f7980 0x7f196c0f7de0 unknown :-1 s=CLOSED pgs=2729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 --2- 172.21.15.96:0/1002419894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f66e0 0x7f196c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 -- 172.21.15.96:0/1002419894 >> 172.21.15.96:0/1002419894 conn(0x7f196c0f1e40 msgr2=0x7f196c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:15.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 -- 172.21.15.96:0/1002419894 shutdown_connections 2022-02-02T21:19:15.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 -- 172.21.15.96:0/1002419894 wait complete. 2022-02-02T21:19:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.319+0000 7f197241b700 1 Processor -- start 2022-02-02T21:19:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f197241b700 1 -- start start 2022-02-02T21:19:15.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f197241b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f197241b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f7980 0x7f196c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f197241b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c107a00 con 0x7f196c0f66e0 2022-02-02T21:19:15.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f197241b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c107b40 con 0x7f196c0f7980 2022-02-02T21:19:15.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:15.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42118/0 (socket says 172.21.15.96:42118) 2022-02-02T21:19:15.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 -- 172.21.15.96:0/3535834460 learned_addr learned my addr 172.21.15.96:0/3535834460 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196b7fe700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f7980 0x7f196c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 -- 172.21.15.96:0/3535834460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f7980 msgr2=0x7f196c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f7980 0x7f196c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.320+0000 7f196bfff700 1 -- 172.21.15.96:0/3535834460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960005040 con 0x7f196c0f66e0 2022-02-02T21:19:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f196bfff700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 rx=0x7f195c00c790 tx=0x7f195c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f195c00e680 con 0x7f196c0f66e0 2022-02-02T21:19:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c1084e0 con 0x7f196c0f66e0 2022-02-02T21:19:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f195c00ec90 con 0x7f196c0f66e0 2022-02-02T21:19:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f195c012d00 con 0x7f196c0f66e0 2022-02-02T21:19:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.321+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c108aa0 con 0x7f196c0f66e0 2022-02-02T21:19:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.322+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c045ad0 con 0x7f196c0f66e0 2022-02-02T21:19:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.322+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f195c010070 con 0x7f196c0f66e0 2022-02-02T21:19:15.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.323+0000 7f1968ff9700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 0x7f1954067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.323+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f195c081bf0 con 0x7f196c0f66e0 2022-02-02T21:19:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.323+0000 7f196b7fe700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 0x7f1954067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:15.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.323+0000 7f196b7fe700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 0x7f1954067290 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f1960004e30 tx=0x7f1960009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.327+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f195c053660 con 0x7f196c0f66e0 2022-02-02T21:19:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:15 smithi159 ceph-mon[69013]: pgmap v5314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.528+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f196c0fef70 con 0x7f196c0f66e0 2022-02-02T21:19:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.528+0000 7f1968ff9700 1 -- 172.21.15.96:0/3535834460 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f195c053250 con 0x7f196c0f66e0 2022-02-02T21:19:15.530 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:19:15.531 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:19:15.531 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:19:15.531 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:19:15.531 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:15.532 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:19:15.532 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:19:15.532 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:19:15.532 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:19:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:19:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:19:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:19:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:19:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:19:15.534 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:19:15.534 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:19:15.534 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:19:15.534 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:19:15.535 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:19:15.535 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:19:15.535 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:19:15.536 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:19:15.536 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:19:15.536 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:19:15.536 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:19:15.537 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:19:15.537 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:19:15.537 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:19:15.537 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:19:15.537 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:19:15.538 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:19:15.538 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:19:15.538 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:15.538 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:15.539 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:19:15.539 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:15.539 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:15.539 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:15.539 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 msgr2=0x7f1954067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 0x7f1954067290 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f1960004e30 tx=0x7f1960009b30).stop 2022-02-02T21:19:15.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 msgr2=0x7f196c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:15.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 rx=0x7f195c00c790 tx=0x7f195c007d90).stop 2022-02-02T21:19:15.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 shutdown_connections 2022-02-02T21:19:15.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1954064dd0 0x7f1954067290 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f196c0f66e0 0x7f196c106f60 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 --2- 172.21.15.96:0/3535834460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c0f7980 0x7f196c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:15.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 >> 172.21.15.96:0/3535834460 conn(0x7f196c0f1e40 msgr2=0x7f196c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 shutdown_connections 2022-02-02T21:19:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:15.530+0000 7f197241b700 1 -- 172.21.15.96:0/3535834460 wait complete. 2022-02-02T21:19:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:19:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:16 smithi096 ceph-mon[101353]: from='client.39554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:16 smithi096 ceph-mon[101353]: from='client.39558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1356965110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:19:16.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3535834460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:19:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:16 smithi159 ceph-mon[69013]: from='client.39554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:16 smithi159 ceph-mon[69013]: from='client.39558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1356965110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:19:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3535834460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:19:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:17 smithi096 ceph-mon[101353]: pgmap v5315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:17 smithi159 ceph-mon[69013]: pgmap v5315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:18 smithi159 ceph-mon[69013]: pgmap v5316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:18 smithi096 ceph-mon[101353]: pgmap v5316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:21 smithi096 ceph-mon[101353]: pgmap v5317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:21 smithi159 ceph-mon[69013]: pgmap v5317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:23.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:23 smithi096 ceph-mon[101353]: pgmap v5318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:23 smithi159 ceph-mon[69013]: pgmap v5318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:25 smithi096 ceph-mon[101353]: pgmap v5319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:25 smithi159 ceph-mon[69013]: pgmap v5319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:27 smithi096 ceph-mon[101353]: pgmap v5320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:27 smithi159 ceph-mon[69013]: pgmap v5320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:19:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:19:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:28 smithi159 ceph-mon[69013]: pgmap v5321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:19:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:19:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:28 smithi096 ceph-mon[101353]: pgmap v5321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:31 smithi096 ceph-mon[101353]: pgmap v5322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:31 smithi159 ceph-mon[69013]: pgmap v5322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:33.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:33 smithi096 ceph-mon[101353]: pgmap v5323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:33 smithi159 ceph-mon[69013]: pgmap v5323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:35 smithi096 ceph-mon[101353]: pgmap v5324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:35 smithi159 ceph-mon[69013]: pgmap v5324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:37 smithi096 ceph-mon[101353]: pgmap v5325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:37 smithi159 ceph-mon[69013]: pgmap v5325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:38 smithi159 ceph-mon[69013]: pgmap v5326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:38 smithi096 ceph-mon[101353]: pgmap v5326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:41 smithi096 ceph-mon[101353]: pgmap v5327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:41 smithi159 ceph-mon[69013]: pgmap v5327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:43 smithi096 ceph-mon[101353]: pgmap v5328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:43 smithi159 ceph-mon[69013]: pgmap v5328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:45 smithi096 ceph-mon[101353]: pgmap v5329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:45 smithi159 ceph-mon[69013]: pgmap v5329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:45.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.641+0000 7fda85607700 1 -- 172.21.15.96:0/3575389286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f6860 msgr2=0x7fda800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.641+0000 7fda85607700 1 --2- 172.21.15.96:0/3575389286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f6860 0x7fda800f6cc0 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 rx=0x7fda74004660 tx=0x7fda74009b30).stop 2022-02-02T21:19:45.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 -- 172.21.15.96:0/3575389286 shutdown_connections 2022-02-02T21:19:45.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 --2- 172.21.15.96:0/3575389286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f6860 0x7fda800f6cc0 unknown :-1 s=CLOSED pgs=2731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 --2- 172.21.15.96:0/3575389286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f55c0 0x7fda800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 -- 172.21.15.96:0/3575389286 >> 172.21.15.96:0/3575389286 conn(0x7fda800f0d40 msgr2=0x7fda800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:45.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 -- 172.21.15.96:0/3575389286 shutdown_connections 2022-02-02T21:19:45.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 -- 172.21.15.96:0/3575389286 wait complete. 2022-02-02T21:19:45.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 Processor -- start 2022-02-02T21:19:45.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.642+0000 7fda85607700 1 -- start start 2022-02-02T21:19:45.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda85607700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda85607700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f6860 0x7fda800f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda85607700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800f8920 con 0x7fda800f55c0 2022-02-02T21:19:45.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda85607700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800f8a60 con 0x7fda800f6860 2022-02-02T21:19:45.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42134/0 (socket says 172.21.15.96:42134) 2022-02-02T21:19:45.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 -- 172.21.15.96:0/2429797333 learned_addr learned my addr 172.21.15.96:0/2429797333 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:45.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7e7fc700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f6860 0x7fda800f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 -- 172.21.15.96:0/2429797333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f6860 msgr2=0x7fda800f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f6860 0x7fda800f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 -- 172.21.15.96:0/2429797333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74005040 con 0x7fda800f55c0 2022-02-02T21:19:45.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda7effd700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 rx=0x7fda7000c530 tx=0x7fda70007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:45.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7000f650 con 0x7fda800f55c0 2022-02-02T21:19:45.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda7000fc60 con 0x7fda800f55c0 2022-02-02T21:19:45.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800f8d40 con 0x7fda800f55c0 2022-02-02T21:19:45.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.643+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda70012cb0 con 0x7fda800f55c0 2022-02-02T21:19:45.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.644+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8010efa0 con 0x7fda800f55c0 2022-02-02T21:19:45.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.645+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80045ad0 con 0x7fda800f55c0 2022-02-02T21:19:45.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.645+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda70019030 con 0x7fda800f55c0 2022-02-02T21:19:45.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.645+0000 7fda677fe700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 0x7fda68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.645+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fda70081550 con 0x7fda800f55c0 2022-02-02T21:19:45.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.645+0000 7fda7e7fc700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 0x7fda68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.646+0000 7fda7e7fc700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 0x7fda68067290 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fda74004630 tx=0x7fda74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:45.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.649+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda700487d0 con 0x7fda800f55c0 2022-02-02T21:19:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.827+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda8005fd30 con 0x7fda68064dd0 2022-02-02T21:19:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.828+0000 7fda677fe700 1 -- 172.21.15.96:0/2429797333 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fda8005fd30 con 0x7fda68064dd0 2022-02-02T21:19:45.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 msgr2=0x7fda68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 0x7fda68067290 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fda74004630 tx=0x7fda74009b30).stop 2022-02-02T21:19:45.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 msgr2=0x7fda800f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 rx=0x7fda7000c530 tx=0x7fda70007e10).stop 2022-02-02T21:19:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 shutdown_connections 2022-02-02T21:19:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda68064dd0 0x7fda68067290 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda800f55c0 0x7fda800f9f40 unknown :-1 s=CLOSED pgs=2732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 --2- 172.21.15.96:0/2429797333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda800f6860 0x7fda800f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 >> 172.21.15.96:0/2429797333 conn(0x7fda800f0d40 msgr2=0x7fda8005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 shutdown_connections 2022-02-02T21:19:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.830+0000 7fda85607700 1 -- 172.21.15.96:0/2429797333 wait complete. 2022-02-02T21:19:45.841 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:19:45.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 -- 172.21.15.96:0/2347891394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f66d0 msgr2=0x7f5be80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/2347891394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f66d0 0x7f5be80f6b30 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 rx=0x7f5bd4004660 tx=0x7f5bd4009b30).stop 2022-02-02T21:19:45.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 -- 172.21.15.96:0/2347891394 shutdown_connections 2022-02-02T21:19:45.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/2347891394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f66d0 0x7f5be80f6b30 unknown :-1 s=CLOSED pgs=2733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/2347891394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f5430 0x7f5be80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 -- 172.21.15.96:0/2347891394 >> 172.21.15.96:0/2347891394 conn(0x7f5be80f0b90 msgr2=0x7f5be80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:45.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 -- 172.21.15.96:0/2347891394 shutdown_connections 2022-02-02T21:19:45.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.928+0000 7f5bedbe4700 1 -- 172.21.15.96:0/2347891394 wait complete. 2022-02-02T21:19:45.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 Processor -- start 2022-02-02T21:19:45.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 -- start start 2022-02-02T21:19:45.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f66d0 0x7f5be81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8106760 con 0x7f5be80f5430 2022-02-02T21:19:45.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.929+0000 7f5bedbe4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8106f60 con 0x7f5be80f66d0 2022-02-02T21:19:45.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42144/0 (socket says 172.21.15.96:42144) 2022-02-02T21:19:45.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 -- 172.21.15.96:0/3717519820 learned_addr learned my addr 172.21.15.96:0/3717519820 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:45.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5be7fff700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f66d0 0x7f5be81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 -- 172.21.15.96:0/3717519820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f66d0 msgr2=0x7f5be81061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:45.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f66d0 0x7f5be81061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:45.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 -- 172.21.15.96:0/3717519820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4005040 con 0x7f5be80f5430 2022-02-02T21:19:45.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5becbe2700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 rx=0x7f5bdc00f910 tx=0x7f5bdc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:45.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc009500 con 0x7f5be80f5430 2022-02-02T21:19:45.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5bdc009660 con 0x7f5be80f5430 2022-02-02T21:19:45.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be81071e0 con 0x7f5be80f5430 2022-02-02T21:19:45.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc00dd30 con 0x7f5be80f5430 2022-02-02T21:19:45.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.930+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8107750 con 0x7f5be80f5430 2022-02-02T21:19:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.931+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8045ad0 con 0x7f5be80f5430 2022-02-02T21:19:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.932+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5bdc00e040 con 0x7f5be80f5430 2022-02-02T21:19:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.932+0000 7f5be57fa700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 0x7f5bd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.932+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5bdc0840f0 con 0x7f5be80f5430 2022-02-02T21:19:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.933+0000 7f5be7fff700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 0x7f5bd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.933+0000 7f5be7fff700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 0x7f5bd80672e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f5bd4004630 tx=0x7f5bd4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:45.937+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5bdc055c20 con 0x7f5be80f5430 2022-02-02T21:19:46.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.110+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be80ff710 con 0x7f5bd8064e20 2022-02-02T21:19:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.119+0000 7f5be57fa700 1 -- 172.21.15.96:0/3717519820 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5be80ff710 con 0x7f5bd8064e20 2022-02-02T21:19:46.120 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:19:46.120 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:19:46.121 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:19:46.121 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:19:46.121 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:19:46.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:19:46.122 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:19:46.122 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:19:46.122 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:19:46.122 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:19:46.123 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:19:46.123 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:19:46.123 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:19:46.123 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:19:46.123 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:19:46.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:19:46.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:19:46.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:19:46.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:19:46.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:19:46.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:19:46.125 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:19:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 msgr2=0x7f5bd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 0x7f5bd80672e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f5bd4004630 tx=0x7f5bd4009b30).stop 2022-02-02T21:19:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 msgr2=0x7f5be8105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 rx=0x7f5bdc00f910 tx=0x7f5bdc009d80).stop 2022-02-02T21:19:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 shutdown_connections 2022-02-02T21:19:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bd8064e20 0x7f5bd80672e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be80f5430 0x7f5be8105cc0 unknown :-1 s=CLOSED pgs=2734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 --2- 172.21.15.96:0/3717519820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be80f66d0 0x7f5be81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 >> 172.21.15.96:0/3717519820 conn(0x7f5be80f0b90 msgr2=0x7f5be80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 shutdown_connections 2022-02-02T21:19:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.121+0000 7f5bedbe4700 1 -- 172.21.15.96:0/3717519820 wait complete. 2022-02-02T21:19:46.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 -- 172.21.15.96:0/860315462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 msgr2=0x7f05280fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 --2- 172.21.15.96:0/860315462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f05280fbae0 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 rx=0x7f0518004660 tx=0x7f0518009b30).stop 2022-02-02T21:19:46.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 -- 172.21.15.96:0/860315462 shutdown_connections 2022-02-02T21:19:46.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 --2- 172.21.15.96:0/860315462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f05280fbae0 unknown :-1 s=CLOSED pgs=2735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 --2- 172.21.15.96:0/860315462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f05280f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 -- 172.21.15.96:0/860315462 >> 172.21.15.96:0/860315462 conn(0x7f05280f0b90 msgr2=0x7f05280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:46.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 -- 172.21.15.96:0/860315462 shutdown_connections 2022-02-02T21:19:46.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.217+0000 7f052c975700 1 -- 172.21.15.96:0/860315462 wait complete. 2022-02-02T21:19:46.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 Processor -- start 2022-02-02T21:19:46.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 -- start start 2022-02-02T21:19:46.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f0528106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528107870 con 0x7f05280f96f0 2022-02-02T21:19:46.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052c975700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281080b0 con 0x7f05280602b0 2022-02-02T21:19:46.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42156/0 (socket says 172.21.15.96:42156) 2022-02-02T21:19:46.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 -- 172.21.15.96:0/1212558634 learned_addr learned my addr 172.21.15.96:0/1212558634 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:46.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f0526d9d700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f0528106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 -- 172.21.15.96:0/1212558634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 msgr2=0x7f0528106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f0528106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f052659c700 1 -- 172.21.15.96:0/1212558634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518005040 con 0x7f05280f96f0 2022-02-02T21:19:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.218+0000 7f0526d9d700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f0528106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:19:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f052659c700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 rx=0x7f0518013a70 tx=0x7f0518009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518018070 con 0x7f05280f96f0 2022-02-02T21:19:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f05180097d0 con 0x7f05280f96f0 2022-02-02T21:19:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0528108330 con 0x7f05280f96f0 2022-02-02T21:19:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f051801c3c0 con 0x7f05280f96f0 2022-02-02T21:19:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.219+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0528108810 con 0x7f05280f96f0 2022-02-02T21:19:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.220+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0528059100 con 0x7f05280f96f0 2022-02-02T21:19:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.220+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0518007ba0 con 0x7f05280f96f0 2022-02-02T21:19:46.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.221+0000 7f050f7fe700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 0x7f05100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.221+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0518083640 con 0x7f05280f96f0 2022-02-02T21:19:46.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.221+0000 7f0526d9d700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 0x7f05100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.221+0000 7f0526d9d700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 0x7f05100672e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0528107b40 tx=0x7f051c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.225+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0518051800 con 0x7f05280f96f0 2022-02-02T21:19:46.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.454+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0528045ad0 con 0x7f05280f96f0 2022-02-02T21:19:46.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.455+0000 7f050f7fe700 1 -- 172.21.15.96:0/1212558634 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0518054e20 con 0x7f05280f96f0 2022-02-02T21:19:46.456 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:19:46.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:19:46.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:19:46.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:46.457 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:19:46.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:19:46.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:46.458 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:19:46.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:19:46.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:46.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:19:46.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:19:46.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:19:46.459 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:19:46.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:19:46.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:19:46.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:19:46.460 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:19:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.456+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 msgr2=0x7f05100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.456+0000 7f052c975700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 0x7f05100672e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0528107b40 tx=0x7f051c009c00).stop 2022-02-02T21:19:46.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.456+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 msgr2=0x7f0528107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.456+0000 7f052c975700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 rx=0x7f0518013a70 tx=0x7f0518009b30).stop 2022-02-02T21:19:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 shutdown_connections 2022-02-02T21:19:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0510064e20 0x7f05100672e0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05280602b0 0x7f0528106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 --2- 172.21.15.96:0/1212558634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05280f96f0 0x7f0528107270 unknown :-1 s=CLOSED pgs=2736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 >> 172.21.15.96:0/1212558634 conn(0x7f05280f0b90 msgr2=0x7f05280f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 shutdown_connections 2022-02-02T21:19:46.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.457+0000 7f052c975700 1 -- 172.21.15.96:0/1212558634 wait complete. 2022-02-02T21:19:46.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.553+0000 7f5228a91700 1 -- 172.21.15.96:0/2972997018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f7980 msgr2=0x7f52240f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.553+0000 7f5228a91700 1 --2- 172.21.15.96:0/2972997018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f7980 0x7f52240f7de0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 rx=0x7f5218004660 tx=0x7f5218009b30).stop 2022-02-02T21:19:46.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 -- 172.21.15.96:0/2972997018 shutdown_connections 2022-02-02T21:19:46.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 --2- 172.21.15.96:0/2972997018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f7980 0x7f52240f7de0 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 --2- 172.21.15.96:0/2972997018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f66e0 0x7f52240f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 -- 172.21.15.96:0/2972997018 >> 172.21.15.96:0/2972997018 conn(0x7f52240f1e40 msgr2=0x7f52240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:46.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 -- 172.21.15.96:0/2972997018 shutdown_connections 2022-02-02T21:19:46.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.554+0000 7f5228a91700 1 -- 172.21.15.96:0/2972997018 wait complete. 2022-02-02T21:19:46.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 Processor -- start 2022-02-02T21:19:46.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 -- start start 2022-02-02T21:19:46.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 0x7f5224107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5224107a00 con 0x7f52240f66e0 2022-02-02T21:19:46.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5228a91700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5224107b40 con 0x7f52240f7980 2022-02-02T21:19:46.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42164/0 (socket says 172.21.15.96:42164) 2022-02-02T21:19:46.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 -- 172.21.15.96:0/771170954 learned_addr learned my addr 172.21.15.96:0/771170954 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:19:46.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f5221d9b700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 0x7f5224107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 -- 172.21.15.96:0/771170954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 msgr2=0x7f5224107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 0x7f5224107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.555+0000 7f522259c700 1 -- 172.21.15.96:0/771170954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218005040 con 0x7f52240f66e0 2022-02-02T21:19:46.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5221d9b700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 0x7f5224107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:19:46.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f522259c700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 rx=0x7f5214002700 tx=0x7f5214009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:46.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5214009320 con 0x7f52240f66e0 2022-02-02T21:19:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52241084e0 con 0x7f52240f66e0 2022-02-02T21:19:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5224108aa0 con 0x7f52240f66e0 2022-02-02T21:19:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f521400f040 con 0x7f52240f66e0 2022-02-02T21:19:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.556+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5214014900 con 0x7f52240f66e0 2022-02-02T21:19:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.557+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208004fa0 con 0x7f52240f66e0 2022-02-02T21:19:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.557+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5214009480 con 0x7f52240f66e0 2022-02-02T21:19:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.558+0000 7f5212ffd700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 0x7f520c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:19:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.558+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5214081c30 con 0x7f52240f66e0 2022-02-02T21:19:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.558+0000 7f5221d9b700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 0x7f520c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:19:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.558+0000 7f5221d9b700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 0x7f520c067290 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f5218009da0 tx=0x7f5218009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:19:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.562+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5214053760 con 0x7f52240f66e0 2022-02-02T21:19:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.766+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5208005e80 con 0x7f52240f66e0 2022-02-02T21:19:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.766+0000 7f5212ffd700 1 -- 172.21.15.96:0/771170954 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5214053350 con 0x7f52240f66e0 2022-02-02T21:19:46.767 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:19:46.768 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:19:46.768 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:19:46.768 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:19:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:46.769 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:19:46.769 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:19:46.769 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:19:46.769 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:19:46.770 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:19:46.770 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:19:46.770 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:19:46.770 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:19:46.771 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:19:46.771 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:19:46.771 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:19:46.771 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:19:46.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:19:46.772 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:19:46.772 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:19:46.772 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:19:46.772 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:19:46.773 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:19:46.773 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:19:46.773 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:19:46.773 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:19:46.774 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:19:46.774 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:19:46.774 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:19:46.774 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:19:46.774 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:19:46.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:19:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:46.775 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:19:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:19:46.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:46.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:46.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:19:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 msgr2=0x7f520c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 0x7f520c067290 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f5218009da0 tx=0x7f5218009b30).stop 2022-02-02T21:19:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 msgr2=0x7f5224106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:19:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 rx=0x7f5214002700 tx=0x7f5214009d80).stop 2022-02-02T21:19:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 shutdown_connections 2022-02-02T21:19:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f520c064dd0 0x7f520c067290 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52240f66e0 0x7f5224106f60 unknown :-1 s=CLOSED pgs=2738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 --2- 172.21.15.96:0/771170954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52240f7980 0x7f5224107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:19:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 >> 172.21.15.96:0/771170954 conn(0x7f52240f1e40 msgr2=0x7f52240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:19:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 shutdown_connections 2022-02-02T21:19:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:19:46.768+0000 7f5228a91700 1 -- 172.21.15.96:0/771170954 wait complete. 2022-02-02T21:19:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:19:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:47 smithi096 ceph-mon[101353]: from='client.39570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:47 smithi096 ceph-mon[101353]: pgmap v5330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:47 smithi096 ceph-mon[101353]: from='client.39574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1212558634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:19:47.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/771170954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:19:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:47 smithi159 ceph-mon[69013]: from='client.39570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:47.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:47 smithi159 ceph-mon[69013]: pgmap v5330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:47.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:47 smithi159 ceph-mon[69013]: from='client.39574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:19:47.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1212558634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:19:47.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/771170954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:19:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:48 smithi159 ceph-mon[69013]: pgmap v5331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:48 smithi096 ceph-mon[101353]: pgmap v5331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:51 smithi096 ceph-mon[101353]: pgmap v5332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:51 smithi159 ceph-mon[69013]: pgmap v5332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:53.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:53 smithi096 ceph-mon[101353]: pgmap v5333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:53 smithi159 ceph-mon[69013]: pgmap v5333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:55 smithi096 ceph-mon[101353]: pgmap v5334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:55 smithi159 ceph-mon[69013]: pgmap v5334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:57 smithi159 ceph-mon[69013]: pgmap v5335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:57 smithi096 ceph-mon[101353]: pgmap v5335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:19:58 smithi159 ceph-mon[69013]: pgmap v5336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:19:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:19:58 smithi096 ceph-mon[101353]: pgmap v5336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:20:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:20:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:01 smithi096 ceph-mon[101353]: pgmap v5337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:01 smithi159 ceph-mon[69013]: pgmap v5337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:03 smithi159 ceph-mon[69013]: pgmap v5338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:03.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:03 smithi096 ceph-mon[101353]: pgmap v5338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:05 smithi159 ceph-mon[69013]: pgmap v5339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:05 smithi096 ceph-mon[101353]: pgmap v5339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:07 smithi159 ceph-mon[69013]: pgmap v5340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:07 smithi096 ceph-mon[101353]: pgmap v5340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:08 smithi159 ceph-mon[69013]: pgmap v5341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:08 smithi096 ceph-mon[101353]: pgmap v5341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:11 smithi096 ceph-mon[101353]: pgmap v5342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:11 smithi159 ceph-mon[69013]: pgmap v5342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:13 smithi159 ceph-mon[69013]: pgmap v5343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:13 smithi096 ceph-mon[101353]: pgmap v5343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:15 smithi159 ceph-mon[69013]: pgmap v5344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:15 smithi096 ceph-mon[101353]: pgmap v5344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:16.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 -- 172.21.15.96:0/1306763945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 msgr2=0x7f62780f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:16.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 --2- 172.21.15.96:0/1306763945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f62780f4c30 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 rx=0x7f626c004660 tx=0x7f626c009b30).stop 2022-02-02T21:20:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 -- 172.21.15.96:0/1306763945 shutdown_connections 2022-02-02T21:20:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 --2- 172.21.15.96:0/1306763945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 0x7f62780f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 --2- 172.21.15.96:0/1306763945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f62780f4c30 unknown :-1 s=CLOSED pgs=2739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:16.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 -- 172.21.15.96:0/1306763945 >> 172.21.15.96:0/1306763945 conn(0x7f62780f0330 msgr2=0x7f62780f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 -- 172.21.15.96:0/1306763945 shutdown_connections 2022-02-02T21:20:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.878+0000 7f627d47d700 1 -- 172.21.15.96:0/1306763945 wait complete. 2022-02-02T21:20:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 Processor -- start 2022-02-02T21:20:16.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 -- start start 2022-02-02T21:20:16.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:16.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 0x7f6278107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:16.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278107920 con 0x7f62780f4810 2022-02-02T21:20:16.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f627d47d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278108130 con 0x7f62780f51b0 2022-02-02T21:20:16.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f6276ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:16.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f6276ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42188/0 (socket says 172.21.15.96:42188) 2022-02-02T21:20:16.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f6276ffd700 1 -- 172.21.15.96:0/4067612739 learned_addr learned my addr 172.21.15.96:0/4067612739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:16.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.879+0000 7f62767fc700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 0x7f6278107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:16.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f6276ffd700 1 -- 172.21.15.96:0/4067612739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 msgr2=0x7f6278107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:16.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f6276ffd700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 0x7f6278107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:16.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f6276ffd700 1 -- 172.21.15.96:0/4067612739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c005040 con 0x7f62780f4810 2022-02-02T21:20:16.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f6276ffd700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 rx=0x7f626c013a70 tx=0x7f626c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:16.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c018070 con 0x7f62780f4810 2022-02-02T21:20:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f626c0097d0 con 0x7f62780f4810 2022-02-02T21:20:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278108350 con 0x7f62780f4810 2022-02-02T21:20:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c01de80 con 0x7f62780f4810 2022-02-02T21:20:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.880+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62781088b0 con 0x7f62780f4810 2022-02-02T21:20:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.881+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278059100 con 0x7f62780f4810 2022-02-02T21:20:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.882+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f626c007ba0 con 0x7f62780f4810 2022-02-02T21:20:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.882+0000 7f625f7fe700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 0x7f62600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.882+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f626c083c50 con 0x7f62780f4810 2022-02-02T21:20:16.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.882+0000 7f62767fc700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 0x7f62600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:16.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.883+0000 7f62767fc700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 0x7f62600672e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f62780f55f0 tx=0x7f626800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:16.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:16.886+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f626c051e90 con 0x7f62780f4810 2022-02-02T21:20:17.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.063+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62780fedc0 con 0x7f6260064e20 2022-02-02T21:20:17.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.065+0000 7f625f7fe700 1 -- 172.21.15.96:0/4067612739 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f62780fedc0 con 0x7f6260064e20 2022-02-02T21:20:17.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 msgr2=0x7f62600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 0x7f62600672e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f62780f55f0 tx=0x7f626800b040).stop 2022-02-02T21:20:17.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 msgr2=0x7f6278106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 rx=0x7f626c013a70 tx=0x7f626c009b30).stop 2022-02-02T21:20:17.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 shutdown_connections 2022-02-02T21:20:17.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6260064e20 0x7f62600672e0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62780f4810 0x7f6278106e30 unknown :-1 s=CLOSED pgs=2740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 --2- 172.21.15.96:0/4067612739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62780f51b0 0x7f6278107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.066+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 >> 172.21.15.96:0/4067612739 conn(0x7f62780f0330 msgr2=0x7f62780fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.067+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 shutdown_connections 2022-02-02T21:20:17.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.067+0000 7f627d47d700 1 -- 172.21.15.96:0/4067612739 wait complete. 2022-02-02T21:20:17.077 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:20:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 -- 172.21.15.96:0/25468505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f55c0 msgr2=0x7fcad00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 --2- 172.21.15.96:0/25468505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f55c0 0x7fcad00f59e0 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 rx=0x7fcac0004660 tx=0x7fcac0009b30).stop 2022-02-02T21:20:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 -- 172.21.15.96:0/25468505 shutdown_connections 2022-02-02T21:20:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 --2- 172.21.15.96:0/25468505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f6860 0x7fcad00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 --2- 172.21.15.96:0/25468505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f55c0 0x7fcad00f59e0 unknown :-1 s=CLOSED pgs=2741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 -- 172.21.15.96:0/25468505 >> 172.21.15.96:0/25468505 conn(0x7fcad00f0d40 msgr2=0x7fcad00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.166 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:17 smithi096 ceph-mon[101353]: pgmap v5345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:17.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 -- 172.21.15.96:0/25468505 shutdown_connections 2022-02-02T21:20:17.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.163+0000 7fcad5745700 1 -- 172.21.15.96:0/25468505 wait complete. 2022-02-02T21:20:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 Processor -- start 2022-02-02T21:20:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 -- start start 2022-02-02T21:20:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f55c0 0x7fcad0106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01079c0 con 0x7fcad00f6860 2022-02-02T21:20:17.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcad5745700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0107b00 con 0x7fcad00f55c0 2022-02-02T21:20:17.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcace7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcace7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42200/0 (socket says 172.21.15.96:42200) 2022-02-02T21:20:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcace7fc700 1 -- 172.21.15.96:0/747058683 learned_addr learned my addr 172.21.15.96:0/747058683 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.164+0000 7fcaceffd700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f55c0 0x7fcad0106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcace7fc700 1 -- 172.21.15.96:0/747058683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f55c0 msgr2=0x7fcad0106f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcace7fc700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f55c0 0x7fcad0106f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcace7fc700 1 -- 172.21.15.96:0/747058683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0005040 con 0x7fcad00f6860 2022-02-02T21:20:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcace7fc700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 rx=0x7fcac4002700 tx=0x7fcac4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac4009320 con 0x7fcad00f6860 2022-02-02T21:20:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad01084a0 con 0x7fcad00f6860 2022-02-02T21:20:17.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcac400f040 con 0x7fcad00f6860 2022-02-02T21:20:17.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac4014870 con 0x7fcad00f6860 2022-02-02T21:20:17.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.165+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0108a60 con 0x7fcad00f6860 2022-02-02T21:20:17.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.166+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad0045ad0 con 0x7fcad00f6860 2022-02-02T21:20:17.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.166+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcac4009480 con 0x7fcad00f6860 2022-02-02T21:20:17.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.167+0000 7fcab77fe700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 0x7fcab8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.167+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcac4081c50 con 0x7fcad00f6860 2022-02-02T21:20:17.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.167+0000 7fcaceffd700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 0x7fcab8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.167+0000 7fcaceffd700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 0x7fcab8067290 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fcac0004630 tx=0x7fcac0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.171+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcac4053780 con 0x7fcad00f6860 2022-02-02T21:20:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.342+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcad005fd30 con 0x7fcab8064dd0 2022-02-02T21:20:17.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.352+0000 7fcab77fe700 1 -- 172.21.15.96:0/747058683 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcad005fd30 con 0x7fcab8064dd0 2022-02-02T21:20:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:20:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:20:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:20:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:20:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:20:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:20:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:20:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:20:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:20:17.356 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:20:17.356 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:20:17.356 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:20:17.356 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:20:17.357 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:20:17.357 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:20:17.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:20:17.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:20:17.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:20:17.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:20:17.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:20:17.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:20:17.359 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:20:17.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 msgr2=0x7fcab8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 0x7fcab8067290 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fcac0004630 tx=0x7fcac0009b30).stop 2022-02-02T21:20:17.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 msgr2=0x7fcad0107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 rx=0x7fcac4002700 tx=0x7fcac4009e00).stop 2022-02-02T21:20:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 shutdown_connections 2022-02-02T21:20:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcab8064dd0 0x7fcab8067290 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00f55c0 0x7fcad0106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 --2- 172.21.15.96:0/747058683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad00f6860 0x7fcad0107410 unknown :-1 s=CLOSED pgs=2742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 >> 172.21.15.96:0/747058683 conn(0x7fcad00f0d40 msgr2=0x7fcad005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 shutdown_connections 2022-02-02T21:20:17.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.354+0000 7fcad5745700 1 -- 172.21.15.96:0/747058683 wait complete. 2022-02-02T21:20:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 -- 172.21.15.96:0/1729059394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 msgr2=0x7f24740f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 --2- 172.21.15.96:0/1729059394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f24740f59b0 secure :-1 s=READY pgs=2743 cs=0 l=1 rev1=1 rx=0x7f2470004660 tx=0x7f2470009b30).stop 2022-02-02T21:20:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 -- 172.21.15.96:0/1729059394 shutdown_connections 2022-02-02T21:20:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 --2- 172.21.15.96:0/1729059394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f24740f59b0 unknown :-1 s=CLOSED pgs=2743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 --2- 172.21.15.96:0/1729059394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 0x7f24740f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:20:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 -- 172.21.15.96:0/1729059394 >> 172.21.15.96:0/1729059394 conn(0x7f24740f04c0 msgr2=0x7f24740f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 -- 172.21.15.96:0/1729059394 shutdown_connections 2022-02-02T21:20:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.451+0000 7f247ba37700 1 -- 172.21.15.96:0/1729059394 wait complete. 2022-02-02T21:20:17.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 Processor -- start 2022-02-02T21:20:17.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 -- start start 2022-02-02T21:20:17.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 0x7f2474109d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740f56d0 con 0x7f24740f7590 2022-02-02T21:20:17.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f247ba37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740f5810 con 0x7f24740f6bf0 2022-02-02T21:20:17.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42210/0 (socket says 172.21.15.96:42210) 2022-02-02T21:20:17.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 -- 172.21.15.96:0/2022211662 learned_addr learned my addr 172.21.15.96:0/2022211662 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:17.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f24797d3700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 0x7f2474109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 -- 172.21.15.96:0/2022211662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 msgr2=0x7f2474109d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 0x7f2474109d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.452+0000 7f2478fd2700 1 -- 172.21.15.96:0/2022211662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470005040 con 0x7f24740f7590 2022-02-02T21:20:17.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f2478fd2700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 rx=0x7f2470009990 tx=0x7f2470009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2470018070 con 0x7f24740f7590 2022-02-02T21:20:17.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247410c830 con 0x7f24740f7590 2022-02-02T21:20:17.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2470007ba0 con 0x7f24740f7590 2022-02-02T21:20:17.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247001c3c0 con 0x7f24740f7590 2022-02-02T21:20:17.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.453+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247410cd60 con 0x7f24740f7590 2022-02-02T21:20:17.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.454+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24740f4150 con 0x7f24740f7590 2022-02-02T21:20:17.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.454+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f247001d420 con 0x7f24740f7590 2022-02-02T21:20:17.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.455+0000 7f2469ffb700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 0x7f2460067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.455+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2470083780 con 0x7f24740f7590 2022-02-02T21:20:17.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.455+0000 7f24797d3700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 0x7f2460067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.455+0000 7f24797d3700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 0x7f2460067290 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f24740f52c0 tx=0x7f2464008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.459+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2470051940 con 0x7f24740f7590 2022-02-02T21:20:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:17 smithi159 ceph-mon[69013]: pgmap v5345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:17.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.688+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2474045ad0 con 0x7f24740f7590 2022-02-02T21:20:17.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.689+0000 7f2469ffb700 1 -- 172.21.15.96:0/2022211662 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2470054f60 con 0x7f24740f7590 2022-02-02T21:20:17.690 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:20:17.690 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:20:17.690 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:20:17.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:17.691 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:20:17.691 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:20:17.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:17.692 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:20:17.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:20:17.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:17.692 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:20:17.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:20:17.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:17.693 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:20:17.693 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:20:17.693 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:20:17.694 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:20:17.694 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:20:17.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 msgr2=0x7f2460067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 0x7f2460067290 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f24740f52c0 tx=0x7f2464008040).stop 2022-02-02T21:20:17.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 msgr2=0x7f247410c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 rx=0x7f2470009990 tx=0x7f2470009b30).stop 2022-02-02T21:20:17.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 shutdown_connections 2022-02-02T21:20:17.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2460064dd0 0x7f2460067290 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24740f6bf0 0x7f2474109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 --2- 172.21.15.96:0/2022211662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24740f7590 0x7f247410c230 unknown :-1 s=CLOSED pgs=2744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.690+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 >> 172.21.15.96:0/2022211662 conn(0x7f24740f04c0 msgr2=0x7f24740fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.691+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 shutdown_connections 2022-02-02T21:20:17.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.691+0000 7f247ba37700 1 -- 172.21.15.96:0/2022211662 wait complete. 2022-02-02T21:20:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 -- 172.21.15.96:0/62942867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f55c0 msgr2=0x7f2d6c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 --2- 172.21.15.96:0/62942867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c0f59e0 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 rx=0x7f2d60004660 tx=0x7f2d60009b30).stop 2022-02-02T21:20:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 -- 172.21.15.96:0/62942867 shutdown_connections 2022-02-02T21:20:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 --2- 172.21.15.96:0/62942867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 --2- 172.21.15.96:0/62942867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c0f59e0 unknown :-1 s=CLOSED pgs=2745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 -- 172.21.15.96:0/62942867 >> 172.21.15.96:0/62942867 conn(0x7f2d6c0f0d40 msgr2=0x7f2d6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 -- 172.21.15.96:0/62942867 shutdown_connections 2022-02-02T21:20:17.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.787+0000 7f2d74642700 1 -- 172.21.15.96:0/62942867 wait complete. 2022-02-02T21:20:17.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 Processor -- start 2022-02-02T21:20:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 -- start start 2022-02-02T21:20:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c109c20 con 0x7f2d6c0f6860 2022-02-02T21:20:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d74642700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c109d60 con 0x7f2d6c0f55c0 2022-02-02T21:20:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d71bdd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d71bdd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42218/0 (socket says 172.21.15.96:42218) 2022-02-02T21:20:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d71bdd700 1 -- 172.21.15.96:0/1284308832 learned_addr learned my addr 172.21.15.96:0/1284308832 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.788+0000 7f2d723de700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d71bdd700 1 -- 172.21.15.96:0/1284308832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f55c0 msgr2=0x7f2d6c109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d71bdd700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d71bdd700 1 -- 172.21.15.96:0/1284308832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60005040 con 0x7f2d6c0f6860 2022-02-02T21:20:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d71bdd700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 secure :-1 s=READY pgs=2746 cs=0 l=1 rev1=1 rx=0x7f2d680026d0 tx=0x7f2d68009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d680079c0 con 0x7f2d6c0f6860 2022-02-02T21:20:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c10a700 con 0x7f2d6c0f6860 2022-02-02T21:20:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d6800f040 con 0x7f2d6c0f6860 2022-02-02T21:20:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d680148b0 con 0x7f2d6c0f6860 2022-02-02T21:20:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.789+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c10acc0 con 0x7f2d6c0f6860 2022-02-02T21:20:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.790+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c045ad0 con 0x7f2d6c0f6860 2022-02-02T21:20:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.791+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d68007b20 con 0x7f2d6c0f6860 2022-02-02T21:20:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.791+0000 7f2d5effd700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 0x7f2d58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:17.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.791+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2d680819e0 con 0x7f2d6c0f6860 2022-02-02T21:20:17.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.791+0000 7f2d723de700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 0x7f2d58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.791+0000 7f2d723de700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 0x7f2d58067290 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f2d60004630 tx=0x7f2d60009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.795+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d68053510 con 0x7f2d6c0f6860 2022-02-02T21:20:17.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.995+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2d6c10b360 con 0x7f2d6c0f6860 2022-02-02T21:20:17.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.995+0000 7f2d5effd700 1 -- 172.21.15.96:0/1284308832 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2d68053100 con 0x7f2d6c0f6860 2022-02-02T21:20:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:20:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:20:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:20:17.997 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:20:17.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:20:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:20:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:20:17.998 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:20:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:20:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:20:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:20:17.999 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:20:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:20:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:20:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:20:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:20:18.000 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:20:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:20:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:20:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:20:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:20:18.001 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:20:18.002 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:20:18.002 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:20:18.002 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:20:18.002 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:20:18.003 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:20:18.003 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:20:18.003 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:20:18.004 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:20:18.004 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:20:18.004 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:18.004 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:18.005 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:20:18.005 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:18.005 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:18.005 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:18.005 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 msgr2=0x7f2d58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 0x7f2d58067290 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f2d60004630 tx=0x7f2d60009b30).stop 2022-02-02T21:20:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 msgr2=0x7f2d6c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 secure :-1 s=READY pgs=2746 cs=0 l=1 rev1=1 rx=0x7f2d680026d0 tx=0x7f2d68009de0).stop 2022-02-02T21:20:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 shutdown_connections 2022-02-02T21:20:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d58064dd0 0x7f2d58067290 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d6c0f55c0 0x7f2d6c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 --2- 172.21.15.96:0/1284308832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d6c0f6860 0x7f2d6c109670 unknown :-1 s=CLOSED pgs=2746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 >> 172.21.15.96:0/1284308832 conn(0x7f2d6c0f0d40 msgr2=0x7f2d6c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 shutdown_connections 2022-02-02T21:20:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:17.997+0000 7f2d74642700 1 -- 172.21.15.96:0/1284308832 wait complete. 2022-02-02T21:20:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:20:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:18 smithi159 ceph-mon[69013]: from='client.39586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2022211662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:20:18.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1284308832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:20:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:18 smithi096 ceph-mon[101353]: from='client.39586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2022211662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:20:18.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1284308832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:20:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:19 smithi159 ceph-mon[69013]: from='client.39590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:19 smithi159 ceph-mon[69013]: pgmap v5346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:19 smithi096 ceph-mon[101353]: from='client.39590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:19.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:19 smithi096 ceph-mon[101353]: pgmap v5346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:21 smithi159 ceph-mon[69013]: pgmap v5347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:21 smithi096 ceph-mon[101353]: pgmap v5347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:23 smithi159 ceph-mon[69013]: pgmap v5348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:23 smithi096 ceph-mon[101353]: pgmap v5348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:25 smithi159 ceph-mon[69013]: pgmap v5349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:25 smithi096 ceph-mon[101353]: pgmap v5349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:27.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:27 smithi159 ceph-mon[69013]: pgmap v5350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:27 smithi096 ceph-mon[101353]: pgmap v5350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:20:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:20:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:28 smithi159 ceph-mon[69013]: pgmap v5351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:20:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:20:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:28 smithi096 ceph-mon[101353]: pgmap v5351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:31 smithi159 ceph-mon[69013]: pgmap v5352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:31 smithi096 ceph-mon[101353]: pgmap v5352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:33 smithi159 ceph-mon[69013]: pgmap v5353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:33 smithi096 ceph-mon[101353]: pgmap v5353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:35 smithi159 ceph-mon[69013]: pgmap v5354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:35 smithi096 ceph-mon[101353]: pgmap v5354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:37 smithi159 ceph-mon[69013]: pgmap v5355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:37.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:37 smithi096 ceph-mon[101353]: pgmap v5355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:38 smithi159 ceph-mon[69013]: pgmap v5356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:38 smithi096 ceph-mon[101353]: pgmap v5356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:41 smithi159 ceph-mon[69013]: pgmap v5357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:41 smithi096 ceph-mon[101353]: pgmap v5357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:41.563 DEBUG:teuthology.orchestra.run:got remote process result: 124 2022-02-02T21:20:41.579 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2022-02-02T21:20:41.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2022-02-02T21:20:41.823 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 148, in task cleanup=cleanup) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 298, in _spawn_on_all_clients timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 427, in _run_tests label="workunit test {workunit}".format(workunit=workunit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsstress.sh) on smithi159 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78571b80ad21c56cce214a3fbfb0b1a080f78167 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' 2022-02-02T21:20:41.936 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ebd5ed1649c847e19f889e45f20afc90 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 148, in task cleanup=cleanup) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 298, in _spawn_on_all_clients timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_78571b80ad21c56cce214a3fbfb0b1a080f78167/qa/tasks/workunit.py", line 427, in _run_tests label="workunit test {workunit}".format(workunit=workunit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsstress.sh) on smithi159 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78571b80ad21c56cce214a3fbfb0b1a080f78167 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' 2022-02-02T21:20:42.092 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2022-02-02T21:20:42.102 INFO:tasks.kclient:Unmounting kernel clients... 2022-02-02T21:20:42.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-02-02T21:20:42.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-02-02T21:20:42.108 DEBUG:teuthology.orchestra.run.smithi096:> sudo umount /home/ubuntu/cephtest/mnt.0 2022-02-02T21:20:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:43 smithi159 ceph-mon[69013]: pgmap v5358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:43 smithi096 ceph-mon[101353]: pgmap v5358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:45 smithi159 ceph-mon[69013]: pgmap v5359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:45 smithi096 ceph-mon[101353]: pgmap v5359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:47 smithi159 ceph-mon[69013]: pgmap v5360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:47 smithi096 ceph-mon[101353]: pgmap v5360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 -- 172.21.15.96:0/2878916143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f4ac0 msgr2=0x7f5d340f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 --2- 172.21.15.96:0/2878916143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f4ac0 0x7f5d340f4ee0 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 rx=0x7f5d28004660 tx=0x7f5d28009b30).stop 2022-02-02T21:20:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 -- 172.21.15.96:0/2878916143 shutdown_connections 2022-02-02T21:20:48.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 --2- 172.21.15.96:0/2878916143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f53d0 0x7f5d340f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 --2- 172.21.15.96:0/2878916143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f4ac0 0x7f5d340f4ee0 unknown :-1 s=CLOSED pgs=2747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 -- 172.21.15.96:0/2878916143 >> 172.21.15.96:0/2878916143 conn(0x7f5d340f0540 msgr2=0x7f5d340f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 -- 172.21.15.96:0/2878916143 shutdown_connections 2022-02-02T21:20:48.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.109+0000 7f5d397a2700 1 -- 172.21.15.96:0/2878916143 wait complete. 2022-02-02T21:20:48.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.110+0000 7f5d397a2700 1 Processor -- start 2022-02-02T21:20:48.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.110+0000 7f5d397a2700 1 -- start start 2022-02-02T21:20:48.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.110+0000 7f5d397a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f4ac0 0x7f5d341071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.110+0000 7f5d397a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.110+0000 7f5d397a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34107c50 con 0x7f5d340f53d0 2022-02-02T21:20:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d397a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34107d90 con 0x7f5d340f4ac0 2022-02-02T21:20:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42236/0 (socket says 172.21.15.96:42236) 2022-02-02T21:20:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 -- 172.21.15.96:0/1985504432 learned_addr learned my addr 172.21.15.96:0/1985504432 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d32ffd700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f4ac0 0x7f5d341071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 -- 172.21.15.96:0/1985504432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f4ac0 msgr2=0x7f5d341071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f4ac0 0x7f5d341071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 -- 172.21.15.96:0/1985504432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28005040 con 0x7f5d340f53d0 2022-02-02T21:20:48.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d327fc700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 rx=0x7f5d2400c790 tx=0x7f5d24007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d24002590 con 0x7f5d340f53d0 2022-02-02T21:20:48.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d24002ba0 con 0x7f5d340f53d0 2022-02-02T21:20:48.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d34108730 con 0x7f5d340f53d0 2022-02-02T21:20:48.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d24013d90 con 0x7f5d340f53d0 2022-02-02T21:20:48.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.111+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d34108cf0 con 0x7f5d340f53d0 2022-02-02T21:20:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.113+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d34045ad0 con 0x7f5d340f53d0 2022-02-02T21:20:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.113+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5d2401a060 con 0x7f5d340f53d0 2022-02-02T21:20:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.113+0000 7f5d1b7fe700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 0x7f5d1c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.113+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5d24081cd0 con 0x7f5d340f53d0 2022-02-02T21:20:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.113+0000 7f5d32ffd700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 0x7f5d1c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.114+0000 7f5d32ffd700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 0x7f5d1c067290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f5d28004630 tx=0x7f5d28009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.118+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5d24053800 con 0x7f5d340f53d0 2022-02-02T21:20:48.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.295+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d340ff0d0 con 0x7f5d1c064dd0 2022-02-02T21:20:48.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.296+0000 7f5d1b7fe700 1 -- 172.21.15.96:0/1985504432 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5d340ff0d0 con 0x7f5d1c064dd0 2022-02-02T21:20:48.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 msgr2=0x7f5d1c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 0x7f5d1c067290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f5d28004630 tx=0x7f5d28009b30).stop 2022-02-02T21:20:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 msgr2=0x7f5d341076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 rx=0x7f5d2400c790 tx=0x7f5d24007d70).stop 2022-02-02T21:20:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 shutdown_connections 2022-02-02T21:20:48.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5d1c064dd0 0x7f5d1c067290 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340f4ac0 0x7f5d341071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 --2- 172.21.15.96:0/1985504432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d340f53d0 0x7f5d341076a0 unknown :-1 s=CLOSED pgs=2748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 >> 172.21.15.96:0/1985504432 conn(0x7f5d340f0540 msgr2=0x7f5d340fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 shutdown_connections 2022-02-02T21:20:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.298+0000 7f5d397a2700 1 -- 172.21.15.96:0/1985504432 wait complete. 2022-02-02T21:20:48.308 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:20:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 -- 172.21.15.96:0/2579334372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f5440 msgr2=0x7fa0040f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 --2- 172.21.15.96:0/2579334372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f5440 0x7fa0040f5860 secure :-1 s=READY pgs=2749 cs=0 l=1 rev1=1 rx=0x7f9ff8004660 tx=0x7f9ff8009b30).stop 2022-02-02T21:20:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 -- 172.21.15.96:0/2579334372 shutdown_connections 2022-02-02T21:20:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 --2- 172.21.15.96:0/2579334372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f66e0 0x7fa0040f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 --2- 172.21.15.96:0/2579334372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f5440 0x7fa0040f5860 unknown :-1 s=CLOSED pgs=2749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 -- 172.21.15.96:0/2579334372 >> 172.21.15.96:0/2579334372 conn(0x7fa0040f0ba0 msgr2=0x7fa0040f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 -- 172.21.15.96:0/2579334372 shutdown_connections 2022-02-02T21:20:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.396+0000 7fa00359e700 1 -- 172.21.15.96:0/2579334372 wait complete. 2022-02-02T21:20:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 Processor -- start 2022-02-02T21:20:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 -- start start 2022-02-02T21:20:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 0x7fa004106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041078f0 con 0x7fa0040f66e0 2022-02-02T21:20:48.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa00359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004108100 con 0x7fa0040f5440 2022-02-02T21:20:48.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa001d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa001d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42246/0 (socket says 172.21.15.96:42246) 2022-02-02T21:20:48.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.397+0000 7fa001d9b700 1 -- 172.21.15.96:0/3586623590 learned_addr learned my addr 172.21.15.96:0/3586623590 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:48.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa00259c700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 0x7fa004106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa001d9b700 1 -- 172.21.15.96:0/3586623590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 msgr2=0x7fa004106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa001d9b700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 0x7fa004106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa001d9b700 1 -- 172.21.15.96:0/3586623590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8005040 con 0x7fa0040f66e0 2022-02-02T21:20:48.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa00259c700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 0x7fa004106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:20:48.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa001d9b700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 secure :-1 s=READY pgs=2750 cs=0 l=1 rev1=1 rx=0x7f9ff400c790 tx=0x7f9ff4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff400e680 con 0x7fa0040f66e0 2022-02-02T21:20:48.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ff400ec90 con 0x7fa0040f66e0 2022-02-02T21:20:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004108320 con 0x7fa0040f66e0 2022-02-02T21:20:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff4013d60 con 0x7fa0040f66e0 2022-02-02T21:20:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.398+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0041088b0 con 0x7fa0040f66e0 2022-02-02T21:20:48.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.399+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004059100 con 0x7fa0040f66e0 2022-02-02T21:20:48.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.400+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ff401a060 con 0x7fa0040f66e0 2022-02-02T21:20:48.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.400+0000 7f9ff2ffd700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 0x7f9fec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.400+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ff4081be0 con 0x7fa0040f66e0 2022-02-02T21:20:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.400+0000 7fa00259c700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 0x7f9fec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.400+0000 7fa00259c700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 0x7f9fec0672e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f9ff8004e30 tx=0x7f9ff8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.404+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ff404fc80 con 0x7fa0040f66e0 2022-02-02T21:20:48.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.582+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa00405fd30 con 0x7f9fec064e20 2022-02-02T21:20:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.591+0000 7f9ff2ffd700 1 -- 172.21.15.96:0/3586623590 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa00405fd30 con 0x7f9fec064e20 2022-02-02T21:20:48.592 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:20:48.592 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:20:48.593 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:20:48.593 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:20:48.593 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:20:48.594 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:20:48.594 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:20:48.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:20:48.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:20:48.595 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:20:48.596 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:20:48.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:20:48.596 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:20:48.597 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:20:48.597 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:20:48.597 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:20:48.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:20:48.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:20:48.598 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:20:48.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:20:48.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:20:48.599 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:20:48.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 msgr2=0x7f9fec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 0x7f9fec0672e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f9ff8004e30 tx=0x7f9ff8009b30).stop 2022-02-02T21:20:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 msgr2=0x7fa0041072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 secure :-1 s=READY pgs=2750 cs=0 l=1 rev1=1 rx=0x7f9ff400c790 tx=0x7f9ff4007d70).stop 2022-02-02T21:20:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 shutdown_connections 2022-02-02T21:20:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fec064e20 0x7f9fec0672e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0040f5440 0x7fa004106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 --2- 172.21.15.96:0/3586623590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0040f66e0 0x7fa0041072f0 unknown :-1 s=CLOSED pgs=2750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 >> 172.21.15.96:0/3586623590 conn(0x7fa0040f0ba0 msgr2=0x7fa00405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 shutdown_connections 2022-02-02T21:20:48.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.593+0000 7fa00359e700 1 -- 172.21.15.96:0/3586623590 wait complete. 2022-02-02T21:20:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- 172.21.15.96:0/297064529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 msgr2=0x7f8d280f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 --2- 172.21.15.96:0/297064529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d280f69b0 secure :-1 s=READY pgs=2751 cs=0 l=1 rev1=1 rx=0x7f8d24004660 tx=0x7f8d24009b30).stop 2022-02-02T21:20:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- 172.21.15.96:0/297064529 shutdown_connections 2022-02-02T21:20:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 --2- 172.21.15.96:0/297064529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d280f69b0 unknown :-1 s=CLOSED pgs=2751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 --2- 172.21.15.96:0/297064529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d280f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:20:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- 172.21.15.96:0/297064529 >> 172.21.15.96:0/297064529 conn(0x7f8d280f04c0 msgr2=0x7f8d280f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:48 smithi096 ceph-mon[101353]: pgmap v5361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- 172.21.15.96:0/297064529 shutdown_connections 2022-02-02T21:20:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- 172.21.15.96:0/297064529 wait complete. 2022-02-02T21:20:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 Processor -- start 2022-02-02T21:20:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.689+0000 7f8d2f321700 1 -- start start 2022-02-02T21:20:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2f321700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d28105f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2f321700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2f321700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28106a40 con 0x7f8d280f6550 2022-02-02T21:20:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2f321700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d281072f0 con 0x7f8d280f5bb0 2022-02-02T21:20:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42256/0 (socket says 172.21.15.96:42256) 2022-02-02T21:20:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 -- 172.21.15.96:0/1270682331 learned_addr learned my addr 172.21.15.96:0/1270682331 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2d0bd700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d28105f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 -- 172.21.15.96:0/1270682331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 msgr2=0x7f8d28105f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d28105f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 -- 172.21.15.96:0/1270682331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24005040 con 0x7f8d280f6550 2022-02-02T21:20:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2d0bd700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d28105f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:20:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d2c8bc700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 rx=0x7f8d24009990 tx=0x7f8d24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.690+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d24018070 con 0x7f8d280f6550 2022-02-02T21:20:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.691+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d28107570 con 0x7f8d280f6550 2022-02-02T21:20:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.691+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d24007ba0 con 0x7f8d280f6550 2022-02-02T21:20:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.691+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d2401c620 con 0x7f8d280f6550 2022-02-02T21:20:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.691+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d28107ad0 con 0x7f8d280f6550 2022-02-02T21:20:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.692+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d280f4150 con 0x7f8d280f6550 2022-02-02T21:20:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.692+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d2401d420 con 0x7f8d280f6550 2022-02-02T21:20:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.693+0000 7f8d1dffb700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 0x7f8d14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.693+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d240838b0 con 0x7f8d280f6550 2022-02-02T21:20:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.693+0000 7f8d2d0bd700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 0x7f8d14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.693+0000 7f8d2d0bd700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 0x7f8d14067290 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f8d2805eae0 tx=0x7f8d18008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.697+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d240553e0 con 0x7f8d280f6550 2022-02-02T21:20:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:48 smithi159 ceph-mon[69013]: pgmap v5361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:48.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.928+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d280fde40 con 0x7f8d280f6550 2022-02-02T21:20:48.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.928+0000 7f8d1dffb700 1 -- 172.21.15.96:0/1270682331 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8d24054fd0 con 0x7f8d280f6550 2022-02-02T21:20:48.930 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:20:48.930 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:20:48.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:20:48.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:48.931 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:20:48.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:20:48.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:48.932 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:20:48.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:20:48.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:48.933 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:20:48.934 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:20:48.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:20:48.934 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:20:48.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:20:48.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:20:48.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:20:48.936 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:20:48.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 msgr2=0x7f8d14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 0x7f8d14067290 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f8d2805eae0 tx=0x7f8d18008040).stop 2022-02-02T21:20:48.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 msgr2=0x7f8d28106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:48.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 rx=0x7f8d24009990 tx=0x7f8d24009b30).stop 2022-02-02T21:20:48.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 shutdown_connections 2022-02-02T21:20:48.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d14064dd0 0x7f8d14067290 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d280f5bb0 0x7f8d28105f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 --2- 172.21.15.96:0/1270682331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d280f6550 0x7f8d28106400 unknown :-1 s=CLOSED pgs=2752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:48.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 >> 172.21.15.96:0/1270682331 conn(0x7f8d280f04c0 msgr2=0x7f8d280fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:48.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 shutdown_connections 2022-02-02T21:20:48.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:48.930+0000 7f8d2f321700 1 -- 172.21.15.96:0/1270682331 wait complete. 2022-02-02T21:20:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 -- 172.21.15.96:0/1732447451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f6c60 msgr2=0x7f6a880f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 --2- 172.21.15.96:0/1732447451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f6c60 0x7f6a880f7080 secure :-1 s=READY pgs=2753 cs=0 l=1 rev1=1 rx=0x7f6a78004660 tx=0x7f6a78009b30).stop 2022-02-02T21:20:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 -- 172.21.15.96:0/1732447451 shutdown_connections 2022-02-02T21:20:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 --2- 172.21.15.96:0/1732447451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f5970 0x7f6a880f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 --2- 172.21.15.96:0/1732447451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f6c60 0x7f6a880f7080 unknown :-1 s=CLOSED pgs=2753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 -- 172.21.15.96:0/1732447451 >> 172.21.15.96:0/1732447451 conn(0x7f6a880f04c0 msgr2=0x7f6a880f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 -- 172.21.15.96:0/1732447451 shutdown_connections 2022-02-02T21:20:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 -- 172.21.15.96:0/1732447451 wait complete. 2022-02-02T21:20:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.028+0000 7f6a90558700 1 Processor -- start 2022-02-02T21:20:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a90558700 1 -- start start 2022-02-02T21:20:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a90558700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a90558700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 0x7f6a8810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a90558700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880f5620 con 0x7f6a880f5970 2022-02-02T21:20:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a90558700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880f5760 con 0x7f6a880f6c60 2022-02-02T21:20:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8daf3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 0x7f6a8810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8daf3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 0x7f6a8810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:46370/0 (socket says 172.21.15.96:46370) 2022-02-02T21:20:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42264/0 (socket says 172.21.15.96:42264) 2022-02-02T21:20:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8daf3700 1 -- 172.21.15.96:0/3480625245 learned_addr learned my addr 172.21.15.96:0/3480625245 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:20:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 -- 172.21.15.96:0/3480625245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 msgr2=0x7f6a8810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 0x7f6a8810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 -- 172.21.15.96:0/3480625245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a78005040 con 0x7f6a880f5970 2022-02-02T21:20:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.029+0000 7f6a8e2f4700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 rx=0x7f6a78000c00 tx=0x7f6a78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.030+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a78018070 con 0x7f6a880f5970 2022-02-02T21:20:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.030+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8810c660 con 0x7f6a880f5970 2022-02-02T21:20:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.030+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a78007ba0 con 0x7f6a880f5970 2022-02-02T21:20:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.030+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7801c3c0 con 0x7f6a880f5970 2022-02-02T21:20:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.030+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8810cbc0 con 0x7f6a880f5970 2022-02-02T21:20:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.031+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a88045ad0 con 0x7f6a880f5970 2022-02-02T21:20:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.031+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a7801d420 con 0x7f6a880f5970 2022-02-02T21:20:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.031+0000 7f6a7effd700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 0x7f6a74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:20:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.031+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6a780837b0 con 0x7f6a880f5970 2022-02-02T21:20:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.032+0000 7f6a8daf3700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 0x7f6a74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:20:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.032+0000 7f6a8daf3700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 0x7f6a74067290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f6a840041d0 tx=0x7f6a84009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:20:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.036+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a780518b0 con 0x7f6a880f5970 2022-02-02T21:20:49.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.237+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a880fdf10 con 0x7f6a880f5970 2022-02-02T21:20:49.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.237+0000 7f6a7effd700 1 -- 172.21.15.96:0/3480625245 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6a78054ed0 con 0x7f6a880f5970 2022-02-02T21:20:49.239 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:20:49.239 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:20:49.240 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:20:49.240 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:20:49.241 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:49.241 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:20:49.241 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:20:49.242 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:20:49.242 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:20:49.242 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:20:49.243 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:20:49.243 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:20:49.243 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:20:49.244 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:20:49.244 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:20:49.244 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:20:49.245 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:20:49.245 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:20:49.245 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:20:49.246 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:20:49.246 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:20:49.246 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:20:49.247 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:20:49.247 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:20:49.247 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:20:49.248 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:20:49.248 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:20:49.248 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:20:49.249 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:20:49.249 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:20:49.249 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:20:49.250 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:20:49.250 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:49.250 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:49.251 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:20:49.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:20:49.251 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:49.252 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:49.252 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:20:49.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 msgr2=0x7f6a74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:49.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 0x7f6a74067290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f6a840041d0 tx=0x7f6a84009040).stop 2022-02-02T21:20:49.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 msgr2=0x7f6a88109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:20:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 rx=0x7f6a78000c00 tx=0x7f6a78009b30).stop 2022-02-02T21:20:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 shutdown_connections 2022-02-02T21:20:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6a74064dd0 0x7f6a74067290 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a880f5970 0x7f6a88109c10 unknown :-1 s=CLOSED pgs=2754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 --2- 172.21.15.96:0/3480625245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a880f6c60 0x7f6a8810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:20:49.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 >> 172.21.15.96:0/3480625245 conn(0x7f6a880f04c0 msgr2=0x7f6a880fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:20:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 shutdown_connections 2022-02-02T21:20:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:20:49.239+0000 7f6a90558700 1 -- 172.21.15.96:0/3480625245 wait complete. 2022-02-02T21:20:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:20:49.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:49 smithi159 ceph-mon[69013]: from='client.39602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:49.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:49 smithi159 ceph-mon[69013]: from='client.39606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:49.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1270682331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:20:49.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3480625245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:20:49.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:49 smithi096 ceph-mon[101353]: from='client.39602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:49.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:49 smithi096 ceph-mon[101353]: from='client.39606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:20:49.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1270682331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:20:49.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3480625245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:20:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:50 smithi159 ceph-mon[69013]: pgmap v5362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:50.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:50 smithi096 ceph-mon[101353]: pgmap v5362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:53 smithi159 ceph-mon[69013]: pgmap v5363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:53 smithi096 ceph-mon[101353]: pgmap v5363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:55 smithi159 ceph-mon[69013]: pgmap v5364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:55 smithi096 ceph-mon[101353]: pgmap v5364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:57 smithi159 ceph-mon[69013]: pgmap v5365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:57 smithi096 ceph-mon[101353]: pgmap v5365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:20:58 smithi159 ceph-mon[69013]: pgmap v5366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:20:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:20:58 smithi096 ceph-mon[101353]: pgmap v5366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:01 smithi159 ceph-mon[69013]: pgmap v5367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:01 smithi096 ceph-mon[101353]: pgmap v5367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:03 smithi159 ceph-mon[69013]: pgmap v5368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:03 smithi096 ceph-mon[101353]: pgmap v5368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:05 smithi159 ceph-mon[69013]: pgmap v5369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:05 smithi096 ceph-mon[101353]: pgmap v5369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:07 smithi159 ceph-mon[69013]: pgmap v5370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:07 smithi096 ceph-mon[101353]: pgmap v5370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:08 smithi159 ceph-mon[69013]: pgmap v5371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:08 smithi096 ceph-mon[101353]: pgmap v5371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:11 smithi159 ceph-mon[69013]: pgmap v5372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:11 smithi096 ceph-mon[101353]: pgmap v5372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:13 smithi159 ceph-mon[69013]: pgmap v5373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:13 smithi096 ceph-mon[101353]: pgmap v5373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:15.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:15 smithi159 ceph-mon[69013]: pgmap v5374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:15 smithi096 ceph-mon[101353]: pgmap v5374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:17 smithi159 ceph-mon[69013]: pgmap v5375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:17 smithi096 ceph-mon[101353]: pgmap v5375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:18 smithi159 ceph-mon[69013]: pgmap v5376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:18 smithi096 ceph-mon[101353]: pgmap v5376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 -- 172.21.15.96:0/1020116875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 msgr2=0x7f855c0f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1020116875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f6c70 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 rx=0x7f8558004660 tx=0x7f8558009b30).stop 2022-02-02T21:21:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 -- 172.21.15.96:0/1020116875 shutdown_connections 2022-02-02T21:21:19.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1020116875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f6c70 unknown :-1 s=CLOSED pgs=2755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1020116875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 0x7f855c0f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:21:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 -- 172.21.15.96:0/1020116875 >> 172.21.15.96:0/1020116875 conn(0x7f855c0f0cd0 msgr2=0x7f855c0f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:19.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.349+0000 7f8563f6f700 1 -- 172.21.15.96:0/1020116875 shutdown_connections 2022-02-02T21:21:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.350+0000 7f8563f6f700 1 -- 172.21.15.96:0/1020116875 wait complete. 2022-02-02T21:21:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.350+0000 7f8563f6f700 1 Processor -- start 2022-02-02T21:21:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.350+0000 7f8563f6f700 1 -- start start 2022-02-02T21:21:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f8563f6f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 0x7f855c0f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f8563f6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f8563f6f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0f8140 con 0x7f855c0f6810 2022-02-02T21:21:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f8563f6f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0f8280 con 0x7f855c0f5570 2022-02-02T21:21:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42286/0 (socket says 172.21.15.96:42286) 2022-02-02T21:21:19.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 -- 172.21.15.96:0/1073215245 learned_addr learned my addr 172.21.15.96:0/1073215245 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:19.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f8561d0b700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 0x7f855c0f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 -- 172.21.15.96:0/1073215245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 msgr2=0x7f855c0f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 0x7f855c0f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 -- 172.21.15.96:0/1073215245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558005040 con 0x7f855c0f6810 2022-02-02T21:21:19.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f856150a700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 rx=0x7f8558009990 tx=0x7f8558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.351+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8558018070 con 0x7f855c0f6810 2022-02-02T21:21:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.352+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c0f8500 con 0x7f855c0f6810 2022-02-02T21:21:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.352+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8558007ba0 con 0x7f855c0f6810 2022-02-02T21:21:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.352+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f855801c620 con 0x7f855c0f6810 2022-02-02T21:21:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.352+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c10eed0 con 0x7f855c0f6810 2022-02-02T21:21:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.353+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c045ad0 con 0x7f855c0f6810 2022-02-02T21:21:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.353+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f855801c8e0 con 0x7f855c0f6810 2022-02-02T21:21:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.354+0000 7f85527fc700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.354+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8558083910 con 0x7f855c0f6810 2022-02-02T21:21:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.354+0000 7f8561d0b700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.354+0000 7f8561d0b700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 0x7f85480672e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f855c0f9460 tx=0x7f854c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.358+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8558051950 con 0x7f855c0f6810 2022-02-02T21:21:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.537+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f855c0fac50 con 0x7f8548064e20 2022-02-02T21:21:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.538+0000 7f85527fc700 1 -- 172.21.15.96:0/1073215245 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f855c0fac50 con 0x7f8548064e20 2022-02-02T21:21:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 msgr2=0x7f85480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 0x7f85480672e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f855c0f9460 tx=0x7f854c008040).stop 2022-02-02T21:21:19.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 msgr2=0x7f855c0f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 rx=0x7f8558009990 tx=0x7f8558009b30).stop 2022-02-02T21:21:19.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 shutdown_connections 2022-02-02T21:21:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f855c0f5570 0x7f855c0f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 --2- 172.21.15.96:0/1073215245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f855c0f6810 0x7f855c0f7b50 unknown :-1 s=CLOSED pgs=2756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 >> 172.21.15.96:0/1073215245 conn(0x7f855c0f0cd0 msgr2=0x7f855c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 shutdown_connections 2022-02-02T21:21:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.540+0000 7f8563f6f700 1 -- 172.21.15.96:0/1073215245 wait complete. 2022-02-02T21:21:19.551 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:21:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 -- 172.21.15.96:0/1831298836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 msgr2=0x7f28200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 --2- 172.21.15.96:0/1831298836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f28200f59e0 secure :-1 s=READY pgs=2757 cs=0 l=1 rev1=1 rx=0x7f2810004660 tx=0x7f2810009b30).stop 2022-02-02T21:21:19.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 -- 172.21.15.96:0/1831298836 shutdown_connections 2022-02-02T21:21:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 --2- 172.21.15.96:0/1831298836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 0x7f28200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 --2- 172.21.15.96:0/1831298836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f28200f59e0 unknown :-1 s=CLOSED pgs=2757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 -- 172.21.15.96:0/1831298836 >> 172.21.15.96:0/1831298836 conn(0x7f28200f0d40 msgr2=0x7f28200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:19.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 -- 172.21.15.96:0/1831298836 shutdown_connections 2022-02-02T21:21:19.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.637+0000 7f2828319700 1 -- 172.21.15.96:0/1831298836 wait complete. 2022-02-02T21:21:19.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 Processor -- start 2022-02-02T21:21:19.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 -- start start 2022-02-02T21:21:19.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 0x7f2820106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2820106910 con 0x7f28200f55c0 2022-02-02T21:21:19.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f2828319700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2820106a50 con 0x7f28200f6860 2022-02-02T21:21:19.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42294/0 (socket says 172.21.15.96:42294) 2022-02-02T21:21:19.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 -- 172.21.15.96:0/3601522251 learned_addr learned my addr 172.21.15.96:0/3601522251 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:19.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28258b4700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 0x7f2820106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 -- 172.21.15.96:0/3601522251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 msgr2=0x7f2820106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 0x7f2820106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 -- 172.21.15.96:0/3601522251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810005040 con 0x7f28200f55c0 2022-02-02T21:21:19.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.638+0000 7f28260b5700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 rx=0x7f2810004f60 tx=0x7f2810009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.639+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2810018070 con 0x7f28200f55c0 2022-02-02T21:21:19.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.639+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2810007ba0 con 0x7f28200f55c0 2022-02-02T21:21:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.639+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281001c620 con 0x7f28200f55c0 2022-02-02T21:21:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.639+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2820107390 con 0x7f28200f55c0 2022-02-02T21:21:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.639+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28201078a0 con 0x7f28200f55c0 2022-02-02T21:21:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.640+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f281001c8e0 con 0x7f28200f55c0 2022-02-02T21:21:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.640+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2820045ad0 con 0x7f28200f55c0 2022-02-02T21:21:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.641+0000 7f2816ffd700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 0x7f280c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.641+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f28100839c0 con 0x7f28200f55c0 2022-02-02T21:21:19.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.641+0000 7f28258b4700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 0x7f280c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.641+0000 7f28258b4700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 0x7f280c067290 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f281c0041d0 tx=0x7f281c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.645+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2810055470 con 0x7f28200f55c0 2022-02-02T21:21:19.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.816+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28200fde90 con 0x7f280c064dd0 2022-02-02T21:21:19.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.826+0000 7f2816ffd700 1 -- 172.21.15.96:0/3601522251 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f28200fde90 con 0x7f280c064dd0 2022-02-02T21:21:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:21:19.829 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:21:19.830 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:21:19.830 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:21:19.831 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:21:19.831 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:21:19.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:21:19.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:21:19.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:21:19.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:21:19.835 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:21:19.835 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:21:19.836 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:21:19.836 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:21:19.837 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:21:19.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:21:19.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:21:19.839 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:21:19.839 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:21:19.840 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:21:19.841 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:21:19.841 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:21:19.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 msgr2=0x7f280c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 0x7f280c067290 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f281c0041d0 tx=0x7f281c009040).stop 2022-02-02T21:21:19.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 msgr2=0x7f2820105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 rx=0x7f2810004f60 tx=0x7f2810009b30).stop 2022-02-02T21:21:19.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 shutdown_connections 2022-02-02T21:21:19.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f280c064dd0 0x7f280c067290 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28200f55c0 0x7f2820105e70 unknown :-1 s=CLOSED pgs=2758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 --2- 172.21.15.96:0/3601522251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28200f6860 0x7f2820106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.827+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 >> 172.21.15.96:0/3601522251 conn(0x7f28200f0d40 msgr2=0x7f28200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:19.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.828+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 shutdown_connections 2022-02-02T21:21:19.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.828+0000 7f2828319700 1 -- 172.21.15.96:0/3601522251 wait complete. 2022-02-02T21:21:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 -- 172.21.15.96:0/4246908893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 msgr2=0x7f662c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 --2- 172.21.15.96:0/4246908893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 0x7f662c0f6950 secure :-1 s=READY pgs=2759 cs=0 l=1 rev1=1 rx=0x7f661c004660 tx=0x7f661c009b30).stop 2022-02-02T21:21:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 -- 172.21.15.96:0/4246908893 shutdown_connections 2022-02-02T21:21:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 --2- 172.21.15.96:0/4246908893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f77d0 0x7f662c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 --2- 172.21.15.96:0/4246908893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f6530 0x7f662c0f6950 unknown :-1 s=CLOSED pgs=2759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 -- 172.21.15.96:0/4246908893 >> 172.21.15.96:0/4246908893 conn(0x7f662c0f1c90 msgr2=0x7f662c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 -- 172.21.15.96:0/4246908893 shutdown_connections 2022-02-02T21:21:19.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.925+0000 7f662b59e700 1 -- 172.21.15.96:0/4246908893 wait complete. 2022-02-02T21:21:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 Processor -- start 2022-02-02T21:21:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 -- start start 2022-02-02T21:21:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1078f0 con 0x7f662c0f77d0 2022-02-02T21:21:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c108100 con 0x7f662c0f6530 2022-02-02T21:21:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42306/0 (socket says 172.21.15.96:42306) 2022-02-02T21:21:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 -- 172.21.15.96:0/1579287633 learned_addr learned my addr 172.21.15.96:0/1579287633 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f662a59c700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 -- 172.21.15.96:0/1579287633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 msgr2=0x7f662c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.926+0000 7f6629d9b700 1 -- 172.21.15.96:0/1579287633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c005040 con 0x7f662c0f77d0 2022-02-02T21:21:19.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f6629d9b700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 rx=0x7f66140026d0 tx=0x7f6614009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66140079c0 con 0x7f662c0f77d0 2022-02-02T21:21:19.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f661400f040 con 0x7f662c0f77d0 2022-02-02T21:21:19.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66140148b0 con 0x7f662c0f77d0 2022-02-02T21:21:19.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c108380 con 0x7f662c0f77d0 2022-02-02T21:21:19.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.927+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c108940 con 0x7f662c0f77d0 2022-02-02T21:21:19.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.928+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c045ad0 con 0x7f662c0f77d0 2022-02-02T21:21:19.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.929+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6614007b20 con 0x7f662c0f77d0 2022-02-02T21:21:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.930+0000 7f6622ffd700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.930+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f66140820e0 con 0x7f662c0f77d0 2022-02-02T21:21:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.930+0000 7f662a59c700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:19.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.930+0000 7f662a59c700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f661c013690 tx=0x7f661c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:19.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:19.933+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f66140501e0 con 0x7f662c0f77d0 2022-02-02T21:21:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.167+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f662c0fecf0 con 0x7f662c0f77d0 2022-02-02T21:21:20.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.167+0000 7f6622ffd700 1 -- 172.21.15.96:0/1579287633 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6614053800 con 0x7f662c0f77d0 2022-02-02T21:21:20.171 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:21:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:21:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:21:20.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:20.173 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:21:20.174 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:21:20.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:20.175 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:21:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:21:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:21:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:21:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:21:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:21:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:21:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:21:20.182 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:21:20.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 msgr2=0x7f66180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f661c013690 tx=0x7f661c009b30).stop 2022-02-02T21:21:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 msgr2=0x7f662c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 rx=0x7f66140026d0 tx=0x7f6614009de0).stop 2022-02-02T21:21:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 shutdown_connections 2022-02-02T21:21:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6618064e20 0x7f66180672e0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f662c0f6530 0x7f662c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 --2- 172.21.15.96:0/1579287633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f662c0f77d0 0x7f662c1072f0 unknown :-1 s=CLOSED pgs=2760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 >> 172.21.15.96:0/1579287633 conn(0x7f662c0f1c90 msgr2=0x7f662c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:20.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 shutdown_connections 2022-02-02T21:21:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.169+0000 7f662b59e700 1 -- 172.21.15.96:0/1579287633 wait complete. 2022-02-02T21:21:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 -- 172.21.15.96:0/7071708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f66d0 msgr2=0x7f52680f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 --2- 172.21.15.96:0/7071708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f66d0 0x7f52680f6b30 secure :-1 s=READY pgs=2761 cs=0 l=1 rev1=1 rx=0x7f5258004660 tx=0x7f5258009b30).stop 2022-02-02T21:21:20.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 -- 172.21.15.96:0/7071708 shutdown_connections 2022-02-02T21:21:20.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 --2- 172.21.15.96:0/7071708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f66d0 0x7f52680f6b30 unknown :-1 s=CLOSED pgs=2761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 --2- 172.21.15.96:0/7071708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f5430 0x7f52680f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 -- 172.21.15.96:0/7071708 >> 172.21.15.96:0/7071708 conn(0x7f52680f0b90 msgr2=0x7f52680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:20.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.266+0000 7f5267fff700 1 -- 172.21.15.96:0/7071708 shutdown_connections 2022-02-02T21:21:20.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 -- 172.21.15.96:0/7071708 wait complete. 2022-02-02T21:21:20.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 Processor -- start 2022-02-02T21:21:20.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 -- start start 2022-02-02T21:21:20.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:20.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 0x7f5268107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:20.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268107870 con 0x7f52680f5430 2022-02-02T21:21:20.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.267+0000 7f5267fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52681080b0 con 0x7f52680f66d0 2022-02-02T21:21:20.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:20.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42314/0 (socket says 172.21.15.96:42314) 2022-02-02T21:21:20.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 -- 172.21.15.96:0/958215528 learned_addr learned my addr 172.21.15.96:0/958215528 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:20.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f52667fc700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 0x7f5268107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:20.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 -- 172.21.15.96:0/958215528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 msgr2=0x7f5268107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 0x7f5268107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 -- 172.21.15.96:0/958215528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258005040 con 0x7f52680f5430 2022-02-02T21:21:20.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f52667fc700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 0x7f5268107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:21:20.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5266ffd700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 secure :-1 s=READY pgs=2762 cs=0 l=1 rev1=1 rx=0x7f525c00c790 tx=0x7f525c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:20.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525c00e680 con 0x7f52680f5430 2022-02-02T21:21:20.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f525c00ec90 con 0x7f52680f5430 2022-02-02T21:21:20.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525c012d00 con 0x7f52680f5430 2022-02-02T21:21:20.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5268108390 con 0x7f52680f5430 2022-02-02T21:21:20.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.268+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681088d0 con 0x7f52680f5430 2022-02-02T21:21:20.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.269+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268059100 con 0x7f52680f5430 2022-02-02T21:21:20.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.270+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f525c010070 con 0x7f52680f5430 2022-02-02T21:21:20.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.271+0000 7f524f7fe700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 0x7f52500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:20.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.271+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f525c081b30 con 0x7f52680f5430 2022-02-02T21:21:20.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.271+0000 7f52667fc700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 0x7f52500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.271+0000 7f52667fc700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 0x7f52500672e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f5258009da0 tx=0x7f5258009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:20.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.274+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f525c04fc30 con 0x7f52680f5430 2022-02-02T21:21:20.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.480+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5268045ad0 con 0x7f52680f5430 2022-02-02T21:21:20.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.480+0000 7f524f7fe700 1 -- 172.21.15.96:0/958215528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f525c053250 con 0x7f52680f5430 2022-02-02T21:21:20.483 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:21:20.483 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:21:20.483 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:21:20.484 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:21:20.484 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:20.484 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:21:20.485 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:21:20.485 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:21:20.485 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:21:20.486 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:21:20.486 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:21:20.486 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:21:20.487 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:21:20.487 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:21:20.488 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:21:20.488 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:21:20.488 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:21:20.489 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:21:20.489 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:21:20.489 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:21:20.490 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:21:20.490 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:21:20.490 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:21:20.491 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:21:20.491 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:21:20.491 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:21:20.492 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:21:20.492 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:21:20.492 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:21:20.493 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:21:20.493 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:21:20.493 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:21:20.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:20.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:20.494 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:21:20.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:20.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:20.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:20.496 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 msgr2=0x7f52500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 0x7f52500672e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f5258009da0 tx=0x7f5258009b30).stop 2022-02-02T21:21:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 msgr2=0x7f5268106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 secure :-1 s=READY pgs=2762 cs=0 l=1 rev1=1 rx=0x7f525c00c790 tx=0x7f525c007d90).stop 2022-02-02T21:21:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 shutdown_connections 2022-02-02T21:21:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5250064e20 0x7f52500672e0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52680f5430 0x7f5268106d80 unknown :-1 s=CLOSED pgs=2762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 --2- 172.21.15.96:0/958215528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52680f66d0 0x7f5268107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 >> 172.21.15.96:0/958215528 conn(0x7f52680f0b90 msgr2=0x7f526805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 shutdown_connections 2022-02-02T21:21:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:20.483+0000 7f5267fff700 1 -- 172.21.15.96:0/958215528 wait complete. 2022-02-02T21:21:20.501 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:21:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:21 smithi159 ceph-mon[69013]: from='client.39618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:21.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:21 smithi159 ceph-mon[69013]: from='client.39622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:21.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:21 smithi159 ceph-mon[69013]: pgmap v5377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1579287633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:21:21.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/958215528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:21:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:21 smithi096 ceph-mon[101353]: from='client.39618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:21 smithi096 ceph-mon[101353]: from='client.39622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:21.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:21 smithi096 ceph-mon[101353]: pgmap v5377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:21.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1579287633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:21:21.560 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/958215528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:21:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:23 smithi159 ceph-mon[69013]: pgmap v5378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:23 smithi096 ceph-mon[101353]: pgmap v5378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:25 smithi159 ceph-mon[69013]: pgmap v5379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:25 smithi096 ceph-mon[101353]: pgmap v5379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:27 smithi159 ceph-mon[69013]: pgmap v5380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:27 smithi096 ceph-mon[101353]: pgmap v5380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:21:28.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:21:28.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:28 smithi159 ceph-mon[69013]: pgmap v5381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:21:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:21:28.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:28 smithi096 ceph-mon[101353]: pgmap v5381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:31 smithi159 ceph-mon[69013]: pgmap v5382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:31 smithi096 ceph-mon[101353]: pgmap v5382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:33 smithi159 ceph-mon[69013]: pgmap v5383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:33 smithi096 ceph-mon[101353]: pgmap v5383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:35 smithi159 ceph-mon[69013]: pgmap v5384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:35 smithi096 ceph-mon[101353]: pgmap v5384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:37 smithi159 ceph-mon[69013]: pgmap v5385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:37 smithi096 ceph-mon[101353]: pgmap v5385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:38 smithi159 ceph-mon[69013]: pgmap v5386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:38 smithi096 ceph-mon[101353]: pgmap v5386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:41 smithi159 ceph-mon[69013]: pgmap v5387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:41 smithi096 ceph-mon[101353]: pgmap v5387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:43 smithi159 ceph-mon[69013]: pgmap v5388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:43 smithi096 ceph-mon[101353]: pgmap v5388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:45 smithi159 ceph-mon[69013]: pgmap v5389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:45 smithi096 ceph-mon[101353]: pgmap v5389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:47 smithi159 ceph-mon[69013]: pgmap v5390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:47 smithi096 ceph-mon[101353]: pgmap v5390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:48 smithi159 ceph-mon[69013]: pgmap v5391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:48 smithi096 ceph-mon[101353]: pgmap v5391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 -- 172.21.15.96:0/681146496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 msgr2=0x7f26a80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 --2- 172.21.15.96:0/681146496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a80f59e0 secure :-1 s=READY pgs=2763 cs=0 l=1 rev1=1 rx=0x7f2698004660 tx=0x7f2698009b30).stop 2022-02-02T21:21:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 -- 172.21.15.96:0/681146496 shutdown_connections 2022-02-02T21:21:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 --2- 172.21.15.96:0/681146496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 0x7f26a80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 --2- 172.21.15.96:0/681146496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a80f59e0 unknown :-1 s=CLOSED pgs=2763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.594+0000 7f26ad899700 1 -- 172.21.15.96:0/681146496 >> 172.21.15.96:0/681146496 conn(0x7f26a80f0d40 msgr2=0x7f26a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.595+0000 7f26ad899700 1 -- 172.21.15.96:0/681146496 shutdown_connections 2022-02-02T21:21:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.595+0000 7f26ad899700 1 -- 172.21.15.96:0/681146496 wait complete. 2022-02-02T21:21:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.595+0000 7f26ad899700 1 Processor -- start 2022-02-02T21:21:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.595+0000 7f26ad899700 1 -- start start 2022-02-02T21:21:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26ad899700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26ad899700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 0x7f26a81095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26ad899700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8109ba0 con 0x7f26a80f55c0 2022-02-02T21:21:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26ad899700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8109ce0 con 0x7f26a80f6860 2022-02-02T21:21:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42334/0 (socket says 172.21.15.96:42334) 2022-02-02T21:21:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 -- 172.21.15.96:0/3804589431 learned_addr learned my addr 172.21.15.96:0/3804589431 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a67fc700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 0x7f26a81095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 -- 172.21.15.96:0/3804589431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 msgr2=0x7f26a81095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 0x7f26a81095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 -- 172.21.15.96:0/3804589431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698005040 con 0x7f26a80f55c0 2022-02-02T21:21:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26a6ffd700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 rx=0x7f2698013a70 tx=0x7f2698009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:50.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2698018070 con 0x7f26a80f55c0 2022-02-02T21:21:50.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a810a620 con 0x7f26a80f55c0 2022-02-02T21:21:50.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26980097d0 con 0x7f26a80f55c0 2022-02-02T21:21:50.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.596+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269801c3c0 con 0x7f26a80f55c0 2022-02-02T21:21:50.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.597+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a810ab80 con 0x7f26a80f55c0 2022-02-02T21:21:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.597+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a8045ad0 con 0x7f26a80f55c0 2022-02-02T21:21:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.598+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2698007ba0 con 0x7f26a80f55c0 2022-02-02T21:21:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.598+0000 7f268f7fe700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 0x7f2690067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.599+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2698083740 con 0x7f26a80f55c0 2022-02-02T21:21:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.599+0000 7f26a67fc700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 0x7f2690067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.599+0000 7f26a67fc700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 0x7f2690067290 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f269c009740 tx=0x7f269c009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:50.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.603+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2698055330 con 0x7f26a80f55c0 2022-02-02T21:21:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.784+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a80faaa0 con 0x7f2690064dd0 2022-02-02T21:21:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.785+0000 7f268f7fe700 1 -- 172.21.15.96:0/3804589431 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f26a80faaa0 con 0x7f2690064dd0 2022-02-02T21:21:50.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 msgr2=0x7f2690067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 0x7f2690067290 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f269c009740 tx=0x7f269c009c60).stop 2022-02-02T21:21:50.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 msgr2=0x7f26a8109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 rx=0x7f2698013a70 tx=0x7f2698009b30).stop 2022-02-02T21:21:50.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 shutdown_connections 2022-02-02T21:21:50.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2690064dd0 0x7f2690067290 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26a80f55c0 0x7f26a8109100 unknown :-1 s=CLOSED pgs=2764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 --2- 172.21.15.96:0/3804589431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a80f6860 0x7f26a81095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 >> 172.21.15.96:0/3804589431 conn(0x7f26a80f0d40 msgr2=0x7f26a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:50.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 shutdown_connections 2022-02-02T21:21:50.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.787+0000 7f26ad899700 1 -- 172.21.15.96:0/3804589431 wait complete. 2022-02-02T21:21:50.798 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:21:50.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 -- 172.21.15.96:0/121785337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f7980 msgr2=0x7fe0b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 --2- 172.21.15.96:0/121785337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f7980 0x7fe0b00f7de0 secure :-1 s=READY pgs=2765 cs=0 l=1 rev1=1 rx=0x7fe0ac004660 tx=0x7fe0ac009b30).stop 2022-02-02T21:21:50.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 -- 172.21.15.96:0/121785337 shutdown_connections 2022-02-02T21:21:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 --2- 172.21.15.96:0/121785337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f7980 0x7fe0b00f7de0 unknown :-1 s=CLOSED pgs=2765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 --2- 172.21.15.96:0/121785337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f66e0 0x7fe0b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 -- 172.21.15.96:0/121785337 >> 172.21.15.96:0/121785337 conn(0x7fe0b00f1e40 msgr2=0x7fe0b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 -- 172.21.15.96:0/121785337 shutdown_connections 2022-02-02T21:21:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.885+0000 7fe0b7505700 1 -- 172.21.15.96:0/121785337 wait complete. 2022-02-02T21:21:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 Processor -- start 2022-02-02T21:21:50.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 -- start start 2022-02-02T21:21:50.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 0x7fe0b0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 0x7fe0b0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0107a00 con 0x7fe0b00f66e0 2022-02-02T21:21:50.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b7505700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0107b40 con 0x7fe0b00f7980 2022-02-02T21:21:50.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b4aa0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 0x7fe0b0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b52a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 0x7fe0b0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b4aa0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 0x7fe0b0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:46450/0 (socket says 172.21.15.96:46450) 2022-02-02T21:21:50.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b4aa0700 1 -- 172.21.15.96:0/100739282 learned_addr learned my addr 172.21.15.96:0/100739282 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b52a1700 1 -- 172.21.15.96:0/100739282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 msgr2=0x7fe0b0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b52a1700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 0x7fe0b0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.886+0000 7fe0b52a1700 1 -- 172.21.15.96:0/100739282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac005040 con 0x7fe0b00f66e0 2022-02-02T21:21:50.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0b52a1700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 0x7fe0b0106f60 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 rx=0x7fe0a000c460 tx=0x7fe0a0007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:50.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a000f650 con 0x7fe0b00f66e0 2022-02-02T21:21:50.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0a000ce80 con 0x7fe0b00f66e0 2022-02-02T21:21:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b01084e0 con 0x7fe0b00f66e0 2022-02-02T21:21:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a0012b70 con 0x7fe0b00f66e0 2022-02-02T21:21:50.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.887+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b0108aa0 con 0x7fe0b00f66e0 2022-02-02T21:21:50.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.888+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b0045ad0 con 0x7fe0b00f66e0 2022-02-02T21:21:50.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.888+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0a0019030 con 0x7fe0b00f66e0 2022-02-02T21:21:50.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.889+0000 7fe0a5ffb700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 0x7fe09c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:50.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.889+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0a0081590 con 0x7fe0b00f66e0 2022-02-02T21:21:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.889+0000 7fe0b4aa0700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 0x7fe09c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.889+0000 7fe0b4aa0700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 0x7fe09c067290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe0ac004630 tx=0x7fe0ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:50.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:50.893+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0a0053170 con 0x7fe0b00f66e0 2022-02-02T21:21:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.065+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0b00ff050 con 0x7fe09c064dd0 2022-02-02T21:21:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.074+0000 7fe0a5ffb700 1 -- 172.21.15.96:0/100739282 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe0ac019040 con 0x7fe09c064dd0 2022-02-02T21:21:51.075 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:21:51.076 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:21:51.076 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:21:51.076 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:21:51.077 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:21:51.077 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:21:51.077 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:21:51.078 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:21:51.078 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:21:51.078 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:21:51.079 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:21:51.079 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:21:51.079 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:21:51.080 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:21:51.080 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:21:51.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:21:51.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:21:51.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:21:51.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:21:51.082 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:21:51.082 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:21:51.083 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:21:51.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 msgr2=0x7fe09c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 0x7fe09c067290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe0ac004630 tx=0x7fe0ac009b30).stop 2022-02-02T21:21:51.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 msgr2=0x7fe0b0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 0x7fe0b0106f60 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 rx=0x7fe0a000c460 tx=0x7fe0a0007d80).stop 2022-02-02T21:21:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 shutdown_connections 2022-02-02T21:21:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe09c064dd0 0x7fe09c067290 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0b00f66e0 0x7fe0b0106f60 unknown :-1 s=CLOSED pgs=2766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 --2- 172.21.15.96:0/100739282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b00f7980 0x7fe0b0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 >> 172.21.15.96:0/100739282 conn(0x7fe0b00f1e40 msgr2=0x7fe0b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:51.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 shutdown_connections 2022-02-02T21:21:51.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.076+0000 7fe0b7505700 1 -- 172.21.15.96:0/100739282 wait complete. 2022-02-02T21:21:51.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 -- 172.21.15.96:0/879133001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f6860 msgr2=0x7f77c00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 --2- 172.21.15.96:0/879133001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f6860 0x7f77c00f6cc0 secure :-1 s=READY pgs=2767 cs=0 l=1 rev1=1 rx=0x7f77b0004660 tx=0x7f77b0009b30).stop 2022-02-02T21:21:51.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 -- 172.21.15.96:0/879133001 shutdown_connections 2022-02-02T21:21:51.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 --2- 172.21.15.96:0/879133001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f6860 0x7f77c00f6cc0 unknown :-1 s=CLOSED pgs=2767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 --2- 172.21.15.96:0/879133001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f55c0 0x7f77c00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 -- 172.21.15.96:0/879133001 >> 172.21.15.96:0/879133001 conn(0x7f77c00f0d40 msgr2=0x7f77c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:51.176 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:51 smithi096 ceph-mon[101353]: pgmap v5392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:51.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 -- 172.21.15.96:0/879133001 shutdown_connections 2022-02-02T21:21:51.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 -- 172.21.15.96:0/879133001 wait complete. 2022-02-02T21:21:51.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.173+0000 7f77c56be700 1 Processor -- start 2022-02-02T21:21:51.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77c56be700 1 -- start start 2022-02-02T21:21:51.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77c56be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77c56be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f6860 0x7f77c00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77c56be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00f8100 con 0x7f77c00f55c0 2022-02-02T21:21:51.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77c56be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00f8240 con 0x7f77c00f6860 2022-02-02T21:21:51.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42354/0 (socket says 172.21.15.96:42354) 2022-02-02T21:21:51.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 -- 172.21.15.96:0/2541878076 learned_addr learned my addr 172.21.15.96:0/2541878076 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:51.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77be7fc700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f6860 0x7f77c00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 -- 172.21.15.96:0/2541878076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f6860 msgr2=0x7f77c00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f6860 0x7f77c00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 -- 172.21.15.96:0/2541878076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0005040 con 0x7f77c00f55c0 2022-02-02T21:21:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.174+0000 7f77beffd700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 secure :-1 s=READY pgs=2768 cs=0 l=1 rev1=1 rx=0x7f77b4002700 tx=0x7f77b4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.175+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b40079c0 con 0x7f77c00f55c0 2022-02-02T21:21:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.175+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77b400f040 con 0x7f77c00f55c0 2022-02-02T21:21:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.175+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c00f8520 con 0x7f77c00f55c0 2022-02-02T21:21:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.175+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c010efa0 con 0x7f77c00f55c0 2022-02-02T21:21:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.175+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b4014860 con 0x7f77c00f55c0 2022-02-02T21:21:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.176+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c0045ad0 con 0x7f77c00f55c0 2022-02-02T21:21:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.176+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77b401b060 con 0x7f77c00f55c0 2022-02-02T21:21:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.177+0000 7f77a77fe700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 0x7f77a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.177+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77b4081920 con 0x7f77c00f55c0 2022-02-02T21:21:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.177+0000 7f77be7fc700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 0x7f77a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.177+0000 7f77be7fc700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 0x7f77a8067290 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f77b0004630 tx=0x7f77b0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:51.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.181+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77b404fa20 con 0x7f77c00f55c0 2022-02-02T21:21:51.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.410+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f77c010f720 con 0x7f77c00f55c0 2022-02-02T21:21:51.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.411+0000 7f77a77fe700 1 -- 172.21.15.96:0/2541878076 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f77b4053040 con 0x7f77c00f55c0 2022-02-02T21:21:51.412 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:21:51.413 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:21:51.413 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:21:51.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:51.414 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:21:51.414 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:21:51.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:51.415 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:21:51.415 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:21:51.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:51.415 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:21:51.416 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:21:51.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:21:51.416 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:21:51.417 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:21:51.417 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:21:51.417 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:21:51.418 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:21:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.412+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 msgr2=0x7f77a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.412+0000 7f77c56be700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 0x7f77a8067290 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f77b0004630 tx=0x7f77b0009b30).stop 2022-02-02T21:21:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.412+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 msgr2=0x7f77c00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.412+0000 7f77c56be700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 secure :-1 s=READY pgs=2768 cs=0 l=1 rev1=1 rx=0x7f77b4002700 tx=0x7f77b4009d80).stop 2022-02-02T21:21:51.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 shutdown_connections 2022-02-02T21:21:51.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77a8064dd0 0x7f77a8067290 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c00f55c0 0x7f77c00f9720 unknown :-1 s=CLOSED pgs=2768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 --2- 172.21.15.96:0/2541878076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77c00f6860 0x7f77c00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 >> 172.21.15.96:0/2541878076 conn(0x7f77c00f0d40 msgr2=0x7f77c005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 shutdown_connections 2022-02-02T21:21:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.413+0000 7f77c56be700 1 -- 172.21.15.96:0/2541878076 wait complete. 2022-02-02T21:21:51.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 -- 172.21.15.96:0/1815299100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f55e0 msgr2=0x7fb5140f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 --2- 172.21.15.96:0/1815299100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f55e0 0x7fb5140f5a00 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 rx=0x7fb504004660 tx=0x7fb504009b30).stop 2022-02-02T21:21:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 -- 172.21.15.96:0/1815299100 shutdown_connections 2022-02-02T21:21:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 --2- 172.21.15.96:0/1815299100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f6880 0x7fb5140f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 --2- 172.21.15.96:0/1815299100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f55e0 0x7fb5140f5a00 unknown :-1 s=CLOSED pgs=2769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 -- 172.21.15.96:0/1815299100 >> 172.21.15.96:0/1815299100 conn(0x7fb5140f0d40 msgr2=0x7fb5140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:51.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 -- 172.21.15.96:0/1815299100 shutdown_connections 2022-02-02T21:21:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.510+0000 7fb5192ba700 1 -- 172.21.15.96:0/1815299100 wait complete. 2022-02-02T21:21:51.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.511+0000 7fb5192ba700 1 Processor -- start 2022-02-02T21:21:51.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.511+0000 7fb5192ba700 1 -- start start 2022-02-02T21:21:51.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5192ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f55e0 0x7fb514109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5192ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5192ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140604e0 con 0x7fb5140f6880 2022-02-02T21:21:51.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5192ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514060620 con 0x7fb5140f55e0 2022-02-02T21:21:51.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42366/0 (socket says 172.21.15.96:42366) 2022-02-02T21:21:51.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 -- 172.21.15.96:0/3822092729 learned_addr learned my addr 172.21.15.96:0/3822092729 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:21:51.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb512ffd700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f55e0 0x7fb514109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 -- 172.21.15.96:0/3822092729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f55e0 msgr2=0x7fb514109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f55e0 0x7fb514109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 -- 172.21.15.96:0/3822092729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504005040 con 0x7fb5140f6880 2022-02-02T21:21:51.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5127fc700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 rx=0x7fb5080026d0 tx=0x7fb508009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:51.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5080079c0 con 0x7fb5140f6880 2022-02-02T21:21:51.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51410c780 con 0x7fb5140f6880 2022-02-02T21:21:51.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.512+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb50800f040 con 0x7fb5140f6880 2022-02-02T21:21:51.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.513+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5080148b0 con 0x7fb5140f6880 2022-02-02T21:21:51.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.513+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51410cd10 con 0x7fb5140f6880 2022-02-02T21:21:51.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.514+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb514045ad0 con 0x7fb5140f6880 2022-02-02T21:21:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.514+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb508007b20 con 0x7fb5140f6880 2022-02-02T21:21:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.515+0000 7fb4fb7fe700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 0x7fb4fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:21:51.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.515+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb508081990 con 0x7fb5140f6880 2022-02-02T21:21:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.515+0000 7fb512ffd700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 0x7fb4fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:21:51.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.515+0000 7fb512ffd700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 0x7fb4fc067290 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb504013690 tx=0x7fb504009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:21:51.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:51 smithi159 ceph-mon[69013]: pgmap v5392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:51.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.519+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb50804fa90 con 0x7fb5140f6880 2022-02-02T21:21:51.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.719+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb514027a00 con 0x7fb5140f6880 2022-02-02T21:21:51.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.720+0000 7fb4fb7fe700 1 -- 172.21.15.96:0/3822092729 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb5080530b0 con 0x7fb5140f6880 2022-02-02T21:21:51.722 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:21:51.722 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:21:51.723 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:21:51.723 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:21:51.723 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:51.724 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:21:51.724 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:21:51.724 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:21:51.725 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:21:51.725 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:21:51.725 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:21:51.726 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:21:51.726 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:21:51.727 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:21:51.727 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:21:51.727 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:21:51.728 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:21:51.728 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:21:51.728 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:21:51.729 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:21:51.729 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:21:51.729 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:21:51.730 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:21:51.730 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:21:51.731 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:21:51.731 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:21:51.731 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:21:51.732 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:21:51.732 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:21:51.733 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:21:51.733 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:21:51.733 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:21:51.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:51.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:51.734 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:21:51.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:21:51.735 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:51.735 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:51.736 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:21:51.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.721+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 msgr2=0x7fb4fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.721+0000 7fb5192ba700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 0x7fb4fc067290 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb504013690 tx=0x7fb504009b30).stop 2022-02-02T21:21:51.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.721+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 msgr2=0x7fb51410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:21:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.721+0000 7fb5192ba700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 rx=0x7fb5080026d0 tx=0x7fb508009de0).stop 2022-02-02T21:21:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 shutdown_connections 2022-02-02T21:21:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb4fc064dd0 0x7fb4fc067290 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5140f55e0 0x7fb514109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 --2- 172.21.15.96:0/3822092729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5140f6880 0x7fb51410c1d0 unknown :-1 s=CLOSED pgs=2770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:21:51.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 >> 172.21.15.96:0/3822092729 conn(0x7fb5140f0d40 msgr2=0x7fb5140fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:21:51.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 shutdown_connections 2022-02-02T21:21:51.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:21:51.722+0000 7fb5192ba700 1 -- 172.21.15.96:0/3822092729 wait complete. 2022-02-02T21:21:51.741 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:21:52.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:52 smithi159 ceph-mon[69013]: from='client.39634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:52 smithi159 ceph-mon[69013]: from='client.39638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2541878076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:21:52.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3822092729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:21:52.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:52 smithi096 ceph-mon[101353]: from='client.39634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:52.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:52 smithi096 ceph-mon[101353]: from='client.39638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:21:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2541878076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:21:52.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3822092729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:21:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:53 smithi159 ceph-mon[69013]: pgmap v5393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:53 smithi096 ceph-mon[101353]: pgmap v5393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:55 smithi159 ceph-mon[69013]: pgmap v5394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:55 smithi096 ceph-mon[101353]: pgmap v5394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:57 smithi159 ceph-mon[69013]: pgmap v5395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:57 smithi096 ceph-mon[101353]: pgmap v5395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:21:58 smithi159 ceph-mon[69013]: pgmap v5396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:21:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:21:58 smithi096 ceph-mon[101353]: pgmap v5396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:01 smithi159 ceph-mon[69013]: pgmap v5397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:01 smithi096 ceph-mon[101353]: pgmap v5397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:03 smithi159 ceph-mon[69013]: pgmap v5398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:03 smithi096 ceph-mon[101353]: pgmap v5398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:05 smithi159 ceph-mon[69013]: pgmap v5399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:05 smithi096 ceph-mon[101353]: pgmap v5399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:07 smithi159 ceph-mon[69013]: pgmap v5400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:07 smithi096 ceph-mon[101353]: pgmap v5400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:08 smithi159 ceph-mon[69013]: pgmap v5401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:08 smithi096 ceph-mon[101353]: pgmap v5401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:11 smithi159 ceph-mon[69013]: pgmap v5402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:11 smithi096 ceph-mon[101353]: pgmap v5402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:13 smithi159 ceph-mon[69013]: pgmap v5403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:13 smithi096 ceph-mon[101353]: pgmap v5403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:15 smithi159 ceph-mon[69013]: pgmap v5404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:15 smithi096 ceph-mon[101353]: pgmap v5404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:17 smithi159 ceph-mon[69013]: pgmap v5405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:17 smithi096 ceph-mon[101353]: pgmap v5405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:18 smithi159 ceph-mon[69013]: pgmap v5406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:18 smithi096 ceph-mon[101353]: pgmap v5406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:21 smithi159 ceph-mon[69013]: pgmap v5407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:21 smithi096 ceph-mon[101353]: pgmap v5407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:21.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 -- 172.21.15.96:0/2905779178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 msgr2=0x7f76f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:21.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 --2- 172.21.15.96:0/2905779178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f40f6b00 secure :-1 s=READY pgs=2771 cs=0 l=1 rev1=1 rx=0x7f76e8004660 tx=0x7f76e8009b30).stop 2022-02-02T21:22:21.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 -- 172.21.15.96:0/2905779178 shutdown_connections 2022-02-02T21:22:21.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 --2- 172.21.15.96:0/2905779178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:22:21.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 --2- 172.21.15.96:0/2905779178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f40f6b00 unknown :-1 s=CLOSED pgs=2771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:21.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 -- 172.21.15.96:0/2905779178 >> 172.21.15.96:0/2905779178 conn(0x7f76f40f1e40 msgr2=0x7f76f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:21.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 -- 172.21.15.96:0/2905779178 shutdown_connections 2022-02-02T21:22:21.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.832+0000 7f76f8bee700 1 -- 172.21.15.96:0/2905779178 wait complete. 2022-02-02T21:22:21.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 Processor -- start 2022-02-02T21:22:21.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 -- start start 2022-02-02T21:22:21.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:21.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:21.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4107ae0 con 0x7f76f40f66e0 2022-02-02T21:22:21.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f8bee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4108390 con 0x7f76f40f7980 2022-02-02T21:22:21.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:21.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42384/0 (socket says 172.21.15.96:42384) 2022-02-02T21:22:21.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f259c700 1 -- 172.21.15.96:0/1093279984 learned_addr learned my addr 172.21.15.96:0/1093279984 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:21.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f1d9b700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:21.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f259c700 1 -- 172.21.15.96:0/1093279984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 msgr2=0x7f76f41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:21.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.833+0000 7f76f259c700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:21.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76f259c700 1 -- 172.21.15.96:0/1093279984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8005040 con 0x7f76f40f66e0 2022-02-02T21:22:21.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76f1d9b700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:22:21.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76f259c700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 rx=0x7f76e8004f60 tx=0x7f76e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:21.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e8018070 con 0x7f76f40f66e0 2022-02-02T21:22:21.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4108610 con 0x7f76f40f66e0 2022-02-02T21:22:21.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76e8007ba0 con 0x7f76f40f66e0 2022-02-02T21:22:21.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e801c620 con 0x7f76f40f66e0 2022-02-02T21:22:21.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.834+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f4108b70 con 0x7f76f40f66e0 2022-02-02T21:22:21.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.835+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f40f5ad0 con 0x7f76f40f66e0 2022-02-02T21:22:21.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.836+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f76e801c8e0 con 0x7f76f40f66e0 2022-02-02T21:22:21.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.836+0000 7f76e2ffd700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 0x7f76dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:21.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.836+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f76e8083e70 con 0x7f76f40f66e0 2022-02-02T21:22:21.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.836+0000 7f76f1d9b700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 0x7f76dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.837+0000 7f76f1d9b700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 0x7f76dc067290 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f76e400b830 tx=0x7f76e4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:21.840+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76e80559a0 con 0x7f76f40f66e0 2022-02-02T21:22:22.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.016+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f40fef90 con 0x7f76dc064dd0 2022-02-02T21:22:22.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.017+0000 7f76e2ffd700 1 -- 172.21.15.96:0/1093279984 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f76f40fef90 con 0x7f76dc064dd0 2022-02-02T21:22:22.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 msgr2=0x7f76dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 0x7f76dc067290 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f76e400b830 tx=0x7f76e4008040).stop 2022-02-02T21:22:22.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 msgr2=0x7f76f4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 rx=0x7f76e8004f60 tx=0x7f76e8009b30).stop 2022-02-02T21:22:22.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 shutdown_connections 2022-02-02T21:22:22.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064dd0 0x7f76dc067290 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76f40f66e0 0x7f76f4106fb0 unknown :-1 s=CLOSED pgs=2772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 --2- 172.21.15.96:0/1093279984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76f40f7980 0x7f76f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 >> 172.21.15.96:0/1093279984 conn(0x7f76f40f1e40 msgr2=0x7f76f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 shutdown_connections 2022-02-02T21:22:22.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.019+0000 7f76f8bee700 1 -- 172.21.15.96:0/1093279984 wait complete. 2022-02-02T21:22:22.029 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:22:22.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 -- 172.21.15.96:0/1708617762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f66d0 msgr2=0x7f50540f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 --2- 172.21.15.96:0/1708617762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f66d0 0x7f50540f6b30 secure :-1 s=READY pgs=2773 cs=0 l=1 rev1=1 rx=0x7f5050004660 tx=0x7f5050009b30).stop 2022-02-02T21:22:22.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 -- 172.21.15.96:0/1708617762 shutdown_connections 2022-02-02T21:22:22.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 --2- 172.21.15.96:0/1708617762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f66d0 0x7f50540f6b30 unknown :-1 s=CLOSED pgs=2773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 --2- 172.21.15.96:0/1708617762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f5430 0x7f50540f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:22:22.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.118+0000 7f505a304700 1 -- 172.21.15.96:0/1708617762 >> 172.21.15.96:0/1708617762 conn(0x7f50540f0b90 msgr2=0x7f50540f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 -- 172.21.15.96:0/1708617762 shutdown_connections 2022-02-02T21:22:22.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 -- 172.21.15.96:0/1708617762 wait complete. 2022-02-02T21:22:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 Processor -- start 2022-02-02T21:22:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 -- start start 2022-02-02T21:22:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f66d0 0x7f505410e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540602d0 con 0x7f50540f5430 2022-02-02T21:22:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.119+0000 7f505a304700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5054060410 con 0x7f50540f66d0 2022-02-02T21:22:22.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42394/0 (socket says 172.21.15.96:42394) 2022-02-02T21:22:22.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 -- 172.21.15.96:0/2164907000 learned_addr learned my addr 172.21.15.96:0/2164907000 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:22.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5058b01700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f66d0 0x7f505410e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 -- 172.21.15.96:0/2164907000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f66d0 msgr2=0x7f505410e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f66d0 0x7f505410e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 -- 172.21.15.96:0/2164907000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050005040 con 0x7f50540f5430 2022-02-02T21:22:22.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5059302700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 rx=0x7f50440093f0 tx=0x7f5044006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5044013640 con 0x7f50540f5430 2022-02-02T21:22:22.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505410e880 con 0x7f50540f5430 2022-02-02T21:22:22.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5044013c50 con 0x7f50540f5430 2022-02-02T21:22:22.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.120+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5044012c70 con 0x7f50540f5430 2022-02-02T21:22:22.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.121+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505410ed90 con 0x7f50540f5430 2022-02-02T21:22:22.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.122+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5054045ad0 con 0x7f50540f5430 2022-02-02T21:22:22.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.122+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f504401a060 con 0x7f50540f5430 2022-02-02T21:22:22.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.122+0000 7f5049ffb700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 0x7f50400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.122+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5044081990 con 0x7f50540f5430 2022-02-02T21:22:22.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.122+0000 7f5058b01700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 0x7f50400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.123+0000 7f5058b01700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 0x7f50400672e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f5050004630 tx=0x7f5050009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.127+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f504404fa90 con 0x7f50540f5430 2022-02-02T21:22:22.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.298+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5054057f10 con 0x7f5040064e20 2022-02-02T21:22:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.307+0000 7f5049ffb700 1 -- 172.21.15.96:0/2164907000 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5054057f10 con 0x7f5040064e20 2022-02-02T21:22:22.308 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:22:22.308 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:22:22.309 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:22:22.309 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:22:22.310 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:22:22.310 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:22:22.311 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:22:22.311 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:22:22.311 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:22:22.312 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (2h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:22:22.312 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (2h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:22:22.312 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:22:22.313 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:22:22.313 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:22:22.313 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:22:22.314 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:22:22.314 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:22:22.314 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:22:22.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:22:22.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:22:22.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:22:22.316 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:22:22.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 msgr2=0x7f50400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 0x7f50400672e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f5050004630 tx=0x7f5050009b30).stop 2022-02-02T21:22:22.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 msgr2=0x7f505410be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 rx=0x7f50440093f0 tx=0x7f5044006ec0).stop 2022-02-02T21:22:22.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 shutdown_connections 2022-02-02T21:22:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5040064e20 0x7f50400672e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50540f5430 0x7f505410be90 unknown :-1 s=CLOSED pgs=2774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 --2- 172.21.15.96:0/2164907000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50540f66d0 0x7f505410e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 >> 172.21.15.96:0/2164907000 conn(0x7f50540f0b90 msgr2=0x7f50540fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 shutdown_connections 2022-02-02T21:22:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.309+0000 7f505a304700 1 -- 172.21.15.96:0/2164907000 wait complete. 2022-02-02T21:22:22.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 -- 172.21.15.96:0/1736866882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f7980 msgr2=0x7fc47c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 --2- 172.21.15.96:0/1736866882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f7980 0x7fc47c0f7de0 secure :-1 s=READY pgs=2775 cs=0 l=1 rev1=1 rx=0x7fc468004660 tx=0x7fc468009b30).stop 2022-02-02T21:22:22.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 -- 172.21.15.96:0/1736866882 shutdown_connections 2022-02-02T21:22:22.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 --2- 172.21.15.96:0/1736866882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f7980 0x7fc47c0f7de0 unknown :-1 s=CLOSED pgs=2775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 --2- 172.21.15.96:0/1736866882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f66e0 0x7fc47c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 -- 172.21.15.96:0/1736866882 >> 172.21.15.96:0/1736866882 conn(0x7fc47c0f1e40 msgr2=0x7fc47c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 -- 172.21.15.96:0/1736866882 shutdown_connections 2022-02-02T21:22:22.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.405+0000 7fc4831be700 1 -- 172.21.15.96:0/1736866882 wait complete. 2022-02-02T21:22:22.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 Processor -- start 2022-02-02T21:22:22.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 -- start start 2022-02-02T21:22:22.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f66e0 0x7fc47c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1079b0 con 0x7fc47c0f66e0 2022-02-02T21:22:22.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc4831be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c107af0 con 0x7fc47c0f7980 2022-02-02T21:22:22.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc47bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc47bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:46510/0 (socket says 172.21.15.96:46510) 2022-02-02T21:22:22.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.406+0000 7fc47bfff700 1 -- 172.21.15.96:0/3161701777 learned_addr learned my addr 172.21.15.96:0/3161701777 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:22.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc480f5a700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f66e0 0x7fc47c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc47bfff700 1 -- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f66e0 msgr2=0x7fc47c106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc47bfff700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f66e0 0x7fc47c106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc47bfff700 1 -- 172.21.15.96:0/3161701777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468005040 con 0x7fc47c0f7980 2022-02-02T21:22:22.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc47bfff700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc468000c00 tx=0x7fc46800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc468019070 con 0x7fc47c0f7980 2022-02-02T21:22:22.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c108430 con 0x7fc47c0f7980 2022-02-02T21:22:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc468007e70 con 0x7fc47c0f7980 2022-02-02T21:22:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc468014ce0 con 0x7fc47c0f7980 2022-02-02T21:22:22.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.407+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c108990 con 0x7fc47c0f7980 2022-02-02T21:22:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.408+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c045ad0 con 0x7fc47c0f7980 2022-02-02T21:22:22.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.409+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc468025070 con 0x7fc47c0f7980 2022-02-02T21:22:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.409+0000 7fc4797fa700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 0x7fc46c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.409+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc4680829a0 con 0x7fc47c0f7980 2022-02-02T21:22:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.409+0000 7fc480f5a700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 0x7fc46c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.410+0000 7fc480f5a700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 0x7fc46c067290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fc470009fd0 tx=0x7fc47000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.414+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc4680544d0 con 0x7fc47c0f7980 2022-02-02T21:22:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.646+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc47c027a00 con 0x7fc47c0f7980 2022-02-02T21:22:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.647+0000 7fc4797fa700 1 -- 172.21.15.96:0/3161701777 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc468023070 con 0x7fc47c0f7980 2022-02-02T21:22:22.649 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:22:22.649 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:22:22.649 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:22:22.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:22.650 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:22:22.651 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:22:22.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:22.651 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:22:22.652 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:22:22.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:22.653 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:22:22.653 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:22:22.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:22.654 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:22:22.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:22:22.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:22:22.655 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:22:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:22:22.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 msgr2=0x7fc46c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 0x7fc46c067290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fc470009fd0 tx=0x7fc47000b040).stop 2022-02-02T21:22:22.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 msgr2=0x7fc47c107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc468000c00 tx=0x7fc46800b040).stop 2022-02-02T21:22:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 shutdown_connections 2022-02-02T21:22:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc46c064dd0 0x7fc46c067290 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc47c0f66e0 0x7fc47c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 --2- 172.21.15.96:0/3161701777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc47c0f7980 0x7fc47c107400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 >> 172.21.15.96:0/3161701777 conn(0x7fc47c0f1e40 msgr2=0x7fc47c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 shutdown_connections 2022-02-02T21:22:22.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.649+0000 7fc4831be700 1 -- 172.21.15.96:0/3161701777 wait complete. 2022-02-02T21:22:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 -- 172.21.15.96:0/3141340260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f5440 msgr2=0x7f0d580f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 --2- 172.21.15.96:0/3141340260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f5440 0x7f0d580f5860 secure :-1 s=READY pgs=2776 cs=0 l=1 rev1=1 rx=0x7f0d4c004660 tx=0x7f0d4c009b30).stop 2022-02-02T21:22:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 -- 172.21.15.96:0/3141340260 shutdown_connections 2022-02-02T21:22:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 --2- 172.21.15.96:0/3141340260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f66e0 0x7f0d580f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 --2- 172.21.15.96:0/3141340260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f5440 0x7f0d580f5860 unknown :-1 s=CLOSED pgs=2776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 -- 172.21.15.96:0/3141340260 >> 172.21.15.96:0/3141340260 conn(0x7f0d580f0ba0 msgr2=0x7f0d580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 -- 172.21.15.96:0/3141340260 shutdown_connections 2022-02-02T21:22:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.747+0000 7f0d5de56700 1 -- 172.21.15.96:0/3141340260 wait complete. 2022-02-02T21:22:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.748+0000 7f0d5de56700 1 Processor -- start 2022-02-02T21:22:22.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.748+0000 7f0d5de56700 1 -- start start 2022-02-02T21:22:22.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.748+0000 7f0d5de56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f5440 0x7f0d58105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5de56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5de56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581067e0 con 0x7f0d580f66e0 2022-02-02T21:22:22.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5de56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58106fe0 con 0x7f0d580f5440 2022-02-02T21:22:22.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42414/0 (socket says 172.21.15.96:42414) 2022-02-02T21:22:22.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 -- 172.21.15.96:0/4230265557 learned_addr learned my addr 172.21.15.96:0/4230265557 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:22.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5ce54700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f5440 0x7f0d58105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 -- 172.21.15.96:0/4230265557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f5440 msgr2=0x7f0d58105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f5440 0x7f0d58105d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 -- 172.21.15.96:0/4230265557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c005040 con 0x7f0d580f66e0 2022-02-02T21:22:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d57fff700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 rx=0x7f0d4400f960 tx=0x7f0d44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44009500 con 0x7f0d580f66e0 2022-02-02T21:22:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58107260 con 0x7f0d580f66e0 2022-02-02T21:22:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d44009660 con 0x7f0d580f66e0 2022-02-02T21:22:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44011ce0 con 0x7f0d580f66e0 2022-02-02T21:22:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.749+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d581077d0 con 0x7f0d580f66e0 2022-02-02T21:22:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.751+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d38004fa0 con 0x7f0d580f66e0 2022-02-02T21:22:22.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.751+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d44011490 con 0x7f0d580f66e0 2022-02-02T21:22:22.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.751+0000 7f0d557fa700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 0x7f0d480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:22.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.751+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0d440842c0 con 0x7f0d580f66e0 2022-02-02T21:22:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.752+0000 7f0d5ce54700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 0x7f0d480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:22.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.752+0000 7f0d5ce54700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 0x7f0d480672e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f0d4c004630 tx=0x7f0d4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:22.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.756+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d44055df0 con 0x7f0d580f66e0 2022-02-02T21:22:22.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.955+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d38005e80 con 0x7f0d580f66e0 2022-02-02T21:22:22.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.955+0000 7f0d557fa700 1 -- 172.21.15.96:0/4230265557 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0d440559e0 con 0x7f0d580f66e0 2022-02-02T21:22:22.957 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:22:22.957 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:22:22.958 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:22:22.958 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:22:22.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:22.959 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:22:22.959 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:22:22.959 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:22:22.960 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:22:22.960 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:22:22.960 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:22:22.961 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:22:22.961 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:22:22.961 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:22:22.962 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:22:22.962 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:22:22.962 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:22:22.963 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:22:22.963 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:22:22.963 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:22:22.964 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:22:22.964 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:22:22.964 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:22:22.965 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:22:22.965 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:22:22.965 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:22:22.966 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:22:22.966 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:22:22.966 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:22:22.967 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:22:22.967 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:22:22.967 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:22:22.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:22.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:22.968 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:22:22.969 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:22.970 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:22.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 msgr2=0x7f0d480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 0x7f0d480672e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f0d4c004630 tx=0x7f0d4c009b30).stop 2022-02-02T21:22:22.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 msgr2=0x7f0d58106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:22.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 rx=0x7f0d4400f960 tx=0x7f0d44009de0).stop 2022-02-02T21:22:22.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 shutdown_connections 2022-02-02T21:22:22.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0d48064e20 0x7f0d480672e0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d580f5440 0x7f0d58105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 --2- 172.21.15.96:0/4230265557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d580f66e0 0x7f0d58106230 unknown :-1 s=CLOSED pgs=2777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:22.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 >> 172.21.15.96:0/4230265557 conn(0x7f0d580f0ba0 msgr2=0x7f0d580fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:22.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 shutdown_connections 2022-02-02T21:22:22.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:22.957+0000 7f0d5de56700 1 -- 172.21.15.96:0/4230265557 wait complete. 2022-02-02T21:22:22.975 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:22:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:23 smithi159 ceph-mon[69013]: from='client.39650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:23 smithi159 ceph-mon[69013]: pgmap v5408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3161701777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:22:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4230265557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:22:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:23 smithi096 ceph-mon[101353]: from='client.39650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:23 smithi096 ceph-mon[101353]: pgmap v5408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3161701777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:22:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4230265557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:22:24.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:24 smithi159 ceph-mon[69013]: from='client.39654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:24.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:24 smithi096 ceph-mon[101353]: from='client.39654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:25 smithi159 ceph-mon[69013]: pgmap v5409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:25 smithi096 ceph-mon[101353]: pgmap v5409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:27 smithi159 ceph-mon[69013]: pgmap v5410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:27 smithi096 ceph-mon[101353]: pgmap v5410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:22:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:22:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:28 smithi159 ceph-mon[69013]: pgmap v5411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:22:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:22:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:28 smithi096 ceph-mon[101353]: pgmap v5411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:31 smithi159 ceph-mon[69013]: pgmap v5412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:31 smithi096 ceph-mon[101353]: pgmap v5412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:33 smithi159 ceph-mon[69013]: pgmap v5413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:33 smithi096 ceph-mon[101353]: pgmap v5413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:35 smithi159 ceph-mon[69013]: pgmap v5414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:35 smithi096 ceph-mon[101353]: pgmap v5414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:37 smithi159 ceph-mon[69013]: pgmap v5415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:37 smithi096 ceph-mon[101353]: pgmap v5415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:38 smithi159 ceph-mon[69013]: pgmap v5416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:38 smithi096 ceph-mon[101353]: pgmap v5416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:41 smithi159 ceph-mon[69013]: pgmap v5417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:41 smithi096 ceph-mon[101353]: pgmap v5417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:43 smithi159 ceph-mon[69013]: pgmap v5418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:43 smithi096 ceph-mon[101353]: pgmap v5418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:45 smithi159 ceph-mon[69013]: pgmap v5419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:45 smithi096 ceph-mon[101353]: pgmap v5419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:47 smithi159 ceph-mon[69013]: pgmap v5420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:47 smithi096 ceph-mon[101353]: pgmap v5420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:48.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:48 smithi159 ceph-mon[69013]: pgmap v5421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:48.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:48 smithi096 ceph-mon[101353]: pgmap v5421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:51 smithi159 ceph-mon[69013]: pgmap v5422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:51.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:51 smithi096 ceph-mon[101353]: pgmap v5422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- 172.21.15.96:0/2444658739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f5440 msgr2=0x7fabb00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/2444658739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f5440 0x7fabb00f5860 secure :-1 s=READY pgs=2778 cs=0 l=1 rev1=1 rx=0x7faba4004660 tx=0x7faba4009b30).stop 2022-02-02T21:22:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- 172.21.15.96:0/2444658739 shutdown_connections 2022-02-02T21:22:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/2444658739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f66e0 0x7fabb00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/2444658739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f5440 0x7fabb00f5860 unknown :-1 s=CLOSED pgs=2778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- 172.21.15.96:0/2444658739 >> 172.21.15.96:0/2444658739 conn(0x7fabb00f0ba0 msgr2=0x7fabb00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- 172.21.15.96:0/2444658739 shutdown_connections 2022-02-02T21:22:53.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- 172.21.15.96:0/2444658739 wait complete. 2022-02-02T21:22:53.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 Processor -- start 2022-02-02T21:22:53.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.067+0000 7fabb5cc5700 1 -- start start 2022-02-02T21:22:53.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabb5cc5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f5440 0x7fabb0109a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabb5cc5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabb5cc5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0060420 con 0x7fabb00f66e0 2022-02-02T21:22:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabb5cc5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0060560 con 0x7fabb00f5440 2022-02-02T21:22:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42434/0 (socket says 172.21.15.96:42434) 2022-02-02T21:22:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 -- 172.21.15.96:0/576108522 learned_addr learned my addr 172.21.15.96:0/576108522 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabb4cc3700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f5440 0x7fabb0109a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 -- 172.21.15.96:0/576108522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f5440 msgr2=0x7fabb0109a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f5440 0x7fabb0109a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 -- 172.21.15.96:0/576108522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4005040 con 0x7fabb00f66e0 2022-02-02T21:22:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.068+0000 7fabaffff700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 rx=0x7fab9c0026d0 tx=0x7fab9c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.069+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c0079c0 con 0x7fabb00f66e0 2022-02-02T21:22:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.069+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb010c570 con 0x7fabb00f66e0 2022-02-02T21:22:53.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.069+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab9c00f040 con 0x7fabb00f66e0 2022-02-02T21:22:53.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.069+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb010cb00 con 0x7fabb00f66e0 2022-02-02T21:22:53.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.069+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c0148b0 con 0x7fabb00f66e0 2022-02-02T21:22:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.070+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90004fa0 con 0x7fabb00f66e0 2022-02-02T21:22:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.070+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fab9c014a10 con 0x7fabb00f66e0 2022-02-02T21:22:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.070+0000 7fabad7fa700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 0x7faba00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.071+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fab9c0818d0 con 0x7fabb00f66e0 2022-02-02T21:22:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.071+0000 7fabb4cc3700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 0x7faba00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.071+0000 7fabb4cc3700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 0x7faba00672e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fabb00600a0 tx=0x7faba4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.075+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fab9c0534e0 con 0x7fabb00f66e0 2022-02-02T21:22:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.257+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab90000bc0 con 0x7faba0064e20 2022-02-02T21:22:53.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.259+0000 7fabad7fa700 1 -- 172.21.15.96:0/576108522 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fab90000bc0 con 0x7faba0064e20 2022-02-02T21:22:53.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.260+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 msgr2=0x7faba00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.260+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 0x7faba00672e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fabb00600a0 tx=0x7faba4009b30).stop 2022-02-02T21:22:53.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.260+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 msgr2=0x7fabb010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.260+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 rx=0x7fab9c0026d0 tx=0x7fab9c009de0).stop 2022-02-02T21:22:53.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 shutdown_connections 2022-02-02T21:22:53.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faba0064e20 0x7faba00672e0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabb00f5440 0x7fabb0109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 --2- 172.21.15.96:0/576108522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb00f66e0 0x7fabb010bf60 unknown :-1 s=CLOSED pgs=2779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 >> 172.21.15.96:0/576108522 conn(0x7fabb00f0ba0 msgr2=0x7fabb00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 shutdown_connections 2022-02-02T21:22:53.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.261+0000 7fabb5cc5700 1 -- 172.21.15.96:0/576108522 wait complete. 2022-02-02T21:22:53.272 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:22:53.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 -- 172.21.15.96:0/3353290934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 msgr2=0x7fb9780f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3353290934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb9780f7de0 secure :-1 s=READY pgs=2780 cs=0 l=1 rev1=1 rx=0x7fb968004660 tx=0x7fb968009b30).stop 2022-02-02T21:22:53.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 -- 172.21.15.96:0/3353290934 shutdown_connections 2022-02-02T21:22:53.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3353290934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb9780f7de0 unknown :-1 s=CLOSED pgs=2780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3353290934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 0x7fb9780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 -- 172.21.15.96:0/3353290934 >> 172.21.15.96:0/3353290934 conn(0x7fb9780f1e40 msgr2=0x7fb9780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.363 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:53 smithi096 ceph-mon[101353]: pgmap v5423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 -- 172.21.15.96:0/3353290934 shutdown_connections 2022-02-02T21:22:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.359+0000 7fb9806bb700 1 -- 172.21.15.96:0/3353290934 wait complete. 2022-02-02T21:22:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 Processor -- start 2022-02-02T21:22:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 -- start start 2022-02-02T21:22:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 0x7fb97806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97806a380 con 0x7fb9780f7980 2022-02-02T21:22:53.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb9806bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97806a4c0 con 0x7fb9780f66e0 2022-02-02T21:22:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42442/0 (socket says 172.21.15.96:42442) 2022-02-02T21:22:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 -- 172.21.15.96:0/3288849811 learned_addr learned my addr 172.21.15.96:0/3288849811 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97e457700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 0x7fb97806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 -- 172.21.15.96:0/3288849811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 msgr2=0x7fb97806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 0x7fb97806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 -- 172.21.15.96:0/3288849811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb968005040 con 0x7fb9780f7980 2022-02-02T21:22:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.360+0000 7fb97dc56700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 secure :-1 s=READY pgs=2781 cs=0 l=1 rev1=1 rx=0x7fb968009990 tx=0x7fb968009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.361+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb968018070 con 0x7fb9780f7980 2022-02-02T21:22:53.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.361+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb968007ba0 con 0x7fb9780f7980 2022-02-02T21:22:53.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.361+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97806a740 con 0x7fb9780f7980 2022-02-02T21:22:53.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.361+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96801c620 con 0x7fb9780f7980 2022-02-02T21:22:53.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.361+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97806aca0 con 0x7fb9780f7980 2022-02-02T21:22:53.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.362+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978045ad0 con 0x7fb9780f7980 2022-02-02T21:22:53.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.362+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb96801c8e0 con 0x7fb9780f7980 2022-02-02T21:22:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.362+0000 7fb96effd700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.363+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb968083890 con 0x7fb9780f7980 2022-02-02T21:22:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.363+0000 7fb97e457700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.363+0000 7fb97e457700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 0x7fb964067290 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fb97806b730 tx=0x7fb974009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.366+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb968051990 con 0x7fb9780f7980 2022-02-02T21:22:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:53 smithi159 ceph-mon[69013]: pgmap v5423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.538+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9780ff010 con 0x7fb964064dd0 2022-02-02T21:22:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.547+0000 7fb96effd700 1 -- 172.21.15.96:0/3288849811 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb9780ff010 con 0x7fb964064dd0 2022-02-02T21:22:53.549 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:22:53.549 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:22:53.550 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:22:53.550 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:22:53.551 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:22:53.551 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:22:53.551 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:22:53.552 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:22:53.552 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:22:53.552 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:22:53.552 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:22:53.553 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:22:53.554 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:22:53.554 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:22:53.554 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:22:53.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:22:53.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:22:53.555 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:22:53.556 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:22:53.556 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:22:53.556 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:22:53.557 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:22:53.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 msgr2=0x7fb964067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 0x7fb964067290 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fb97806b730 tx=0x7fb974009040).stop 2022-02-02T21:22:53.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 msgr2=0x7fb978069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 secure :-1 s=READY pgs=2781 cs=0 l=1 rev1=1 rx=0x7fb968009990 tx=0x7fb968009b30).stop 2022-02-02T21:22:53.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 shutdown_connections 2022-02-02T21:22:53.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9780f66e0 0x7fb97806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 --2- 172.21.15.96:0/3288849811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9780f7980 0x7fb978069e20 unknown :-1 s=CLOSED pgs=2781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 >> 172.21.15.96:0/3288849811 conn(0x7fb9780f1e40 msgr2=0x7fb9780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 shutdown_connections 2022-02-02T21:22:53.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.549+0000 7fb9806bb700 1 -- 172.21.15.96:0/3288849811 wait complete. 2022-02-02T21:22:53.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 -- 172.21.15.96:0/3114731586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f6860 msgr2=0x7f80ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 --2- 172.21.15.96:0/3114731586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f6860 0x7f80ac0f6cc0 secure :-1 s=READY pgs=2782 cs=0 l=1 rev1=1 rx=0x7f8098004660 tx=0x7f8098009b30).stop 2022-02-02T21:22:53.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 -- 172.21.15.96:0/3114731586 shutdown_connections 2022-02-02T21:22:53.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 --2- 172.21.15.96:0/3114731586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f6860 0x7f80ac0f6cc0 unknown :-1 s=CLOSED pgs=2782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 --2- 172.21.15.96:0/3114731586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f55c0 0x7f80ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 -- 172.21.15.96:0/3114731586 >> 172.21.15.96:0/3114731586 conn(0x7f80ac0f0d40 msgr2=0x7f80ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 -- 172.21.15.96:0/3114731586 shutdown_connections 2022-02-02T21:22:53.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.645+0000 7f80b2da6700 1 -- 172.21.15.96:0/3114731586 wait complete. 2022-02-02T21:22:53.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 Processor -- start 2022-02-02T21:22:53.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 -- start start 2022-02-02T21:22:53.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f6860 0x7f80ac109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac109bc0 con 0x7f80ac0f55c0 2022-02-02T21:22:53.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b2da6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac109d00 con 0x7f80ac0f6860 2022-02-02T21:22:53.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b0b42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b0b42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42450/0 (socket says 172.21.15.96:42450) 2022-02-02T21:22:53.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.646+0000 7f80b0b42700 1 -- 172.21.15.96:0/550823141 learned_addr learned my addr 172.21.15.96:0/550823141 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:53.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80abfff700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f6860 0x7f80ac109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b0b42700 1 -- 172.21.15.96:0/550823141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f6860 msgr2=0x7f80ac109610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b0b42700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f6860 0x7f80ac109610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b0b42700 1 -- 172.21.15.96:0/550823141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098005040 con 0x7f80ac0f55c0 2022-02-02T21:22:53.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b0b42700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 rx=0x7f80a0002700 tx=0x7f80a0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a00079c0 con 0x7f80ac0f55c0 2022-02-02T21:22:53.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80a000f040 con 0x7f80ac0f55c0 2022-02-02T21:22:53.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac10a6a0 con 0x7f80ac0f55c0 2022-02-02T21:22:53.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a0014860 con 0x7f80ac0f55c0 2022-02-02T21:22:53.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.647+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac10ac60 con 0x7f80ac0f55c0 2022-02-02T21:22:53.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.648+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac045ad0 con 0x7f80ac0f55c0 2022-02-02T21:22:53.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.649+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80a001b060 con 0x7f80ac0f55c0 2022-02-02T21:22:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.649+0000 7f80a97fa700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 0x7f809c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.649+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80a0081810 con 0x7f80ac0f55c0 2022-02-02T21:22:53.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.649+0000 7f80abfff700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 0x7f809c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.650+0000 7f80abfff700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 0x7f809c067290 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f8098004630 tx=0x7f8098009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.653+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80a0053340 con 0x7f80ac0f55c0 2022-02-02T21:22:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.882+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80ac10f770 con 0x7f80ac0f55c0 2022-02-02T21:22:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.882+0000 7f80a97fa700 1 -- 172.21.15.96:0/550823141 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f80a00192e0 con 0x7f80ac0f55c0 2022-02-02T21:22:53.885 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:22:53.886 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:22:53.886 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:22:53.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:53.887 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:22:53.887 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:22:53.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:53.888 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:22:53.888 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:22:53.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:53.889 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:22:53.889 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:22:53.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:22:53.890 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:22:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:22:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:22:53.891 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:22:53.892 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:22:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 msgr2=0x7f809c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 0x7f809c067290 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f8098004630 tx=0x7f8098009b30).stop 2022-02-02T21:22:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 msgr2=0x7f80ac109120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 rx=0x7f80a0002700 tx=0x7f80a0009d80).stop 2022-02-02T21:22:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 shutdown_connections 2022-02-02T21:22:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f809c064dd0 0x7f809c067290 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ac0f55c0 0x7f80ac109120 unknown :-1 s=CLOSED pgs=2783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 --2- 172.21.15.96:0/550823141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ac0f6860 0x7f80ac109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 >> 172.21.15.96:0/550823141 conn(0x7f80ac0f0d40 msgr2=0x7f80ac05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 shutdown_connections 2022-02-02T21:22:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.885+0000 7f80b2da6700 1 -- 172.21.15.96:0/550823141 wait complete. 2022-02-02T21:22:53.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 -- 172.21.15.96:0/796680795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f5430 msgr2=0x7fc6140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/796680795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f5430 0x7fc6140f5850 secure :-1 s=READY pgs=2784 cs=0 l=1 rev1=1 rx=0x7fc604004660 tx=0x7fc604009b30).stop 2022-02-02T21:22:53.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 -- 172.21.15.96:0/796680795 shutdown_connections 2022-02-02T21:22:53.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/796680795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f66d0 0x7fc6140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:22:53.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/796680795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f5430 0x7fc6140f5850 unknown :-1 s=CLOSED pgs=2784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.981+0000 7fc61a1b3700 1 -- 172.21.15.96:0/796680795 >> 172.21.15.96:0/796680795 conn(0x7fc6140f0b90 msgr2=0x7fc6140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:53.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 -- 172.21.15.96:0/796680795 shutdown_connections 2022-02-02T21:22:53.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 -- 172.21.15.96:0/796680795 wait complete. 2022-02-02T21:22:53.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 Processor -- start 2022-02-02T21:22:53.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 -- start start 2022-02-02T21:22:53.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f5430 0x7fc614109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614060470 con 0x7fc6140f66d0 2022-02-02T21:22:53.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.982+0000 7fc61a1b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140605b0 con 0x7fc6140f5430 2022-02-02T21:22:53.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42462/0 (socket says 172.21.15.96:42462) 2022-02-02T21:22:53.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 -- 172.21.15.96:0/2846503816 learned_addr learned my addr 172.21.15.96:0/2846503816 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:22:53.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6191b1700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f5430 0x7fc614109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 -- 172.21.15.96:0/2846503816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f5430 msgr2=0x7fc614109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:53.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f5430 0x7fc614109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:53.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 -- 172.21.15.96:0/2846503816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604005040 con 0x7fc6140f66d0 2022-02-02T21:22:53.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc6189b0700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 secure :-1 s=READY pgs=2785 cs=0 l=1 rev1=1 rx=0x7fc61000b410 tx=0x7fc610006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6100125f0 con 0x7fc6140f66d0 2022-02-02T21:22:53.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc610012c00 con 0x7fc6140f66d0 2022-02-02T21:22:53.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61410c610 con 0x7fc6140f66d0 2022-02-02T21:22:53.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.983+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc610002ae0 con 0x7fc6140f66d0 2022-02-02T21:22:53.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.984+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61410cba0 con 0x7fc6140f66d0 2022-02-02T21:22:53.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.985+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f4004fa0 con 0x7fc6140f66d0 2022-02-02T21:22:53.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.985+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc61000f030 con 0x7fc6140f66d0 2022-02-02T21:22:53.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.986+0000 7fc609ffb700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 0x7fc6000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:22:53.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.986+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc610081d40 con 0x7fc6140f66d0 2022-02-02T21:22:53.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.986+0000 7fc6191b1700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 0x7fc6000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:22:53.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.986+0000 7fc6191b1700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 0x7fc6000672e0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fc604004e30 tx=0x7fc604009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:22:53.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:53.991+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc61004fe40 con 0x7fc6140f66d0 2022-02-02T21:22:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.192+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5f4005e80 con 0x7fc6140f66d0 2022-02-02T21:22:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.193+0000 7fc609ffb700 1 -- 172.21.15.96:0/2846503816 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc610053460 con 0x7fc6140f66d0 2022-02-02T21:22:54.195 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:22:54.196 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:22:54.196 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:22:54.197 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:22:54.198 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:54.198 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:22:54.199 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:22:54.199 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:22:54.199 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:22:54.200 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:22:54.201 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:22:54.201 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:22:54.201 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:22:54.202 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:22:54.202 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:22:54.202 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:22:54.203 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:22:54.203 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:22:54.203 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:22:54.204 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:22:54.204 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:22:54.204 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:22:54.205 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:22:54.205 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:22:54.205 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:22:54.206 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:22:54.206 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:22:54.206 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:22:54.207 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:22:54.207 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:22:54.207 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:22:54.207 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:22:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:54.209 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:22:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:22:54.209 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:54.209 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:54.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:22:54.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 msgr2=0x7fc6000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 0x7fc6000672e0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fc604004e30 tx=0x7fc604009b30).stop 2022-02-02T21:22:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 msgr2=0x7fc61410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:22:54.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 secure :-1 s=READY pgs=2785 cs=0 l=1 rev1=1 rx=0x7fc61000b410 tx=0x7fc610006ef0).stop 2022-02-02T21:22:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 shutdown_connections 2022-02-02T21:22:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc600064e20 0x7fc6000672e0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:54.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6140f5430 0x7fc614109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 --2- 172.21.15.96:0/2846503816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6140f66d0 0x7fc61410bfb0 unknown :-1 s=CLOSED pgs=2785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:22:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 >> 172.21.15.96:0/2846503816 conn(0x7fc6140f0b90 msgr2=0x7fc6140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:22:54.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 shutdown_connections 2022-02-02T21:22:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:22:54.195+0000 7fc61a1b3700 1 -- 172.21.15.96:0/2846503816 wait complete. 2022-02-02T21:22:54.215 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:22:54.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/550823141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:22:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/550823141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:22:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:55 smithi159 ceph-mon[69013]: from='client.39666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:55.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:55 smithi159 ceph-mon[69013]: from='client.39670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:55.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:55 smithi159 ceph-mon[69013]: pgmap v5424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:55.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2846503816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:22:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:55 smithi096 ceph-mon[101353]: from='client.39666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:55 smithi096 ceph-mon[101353]: from='client.39670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:22:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:55 smithi096 ceph-mon[101353]: pgmap v5424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:55.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2846503816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:22:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:57 smithi159 ceph-mon[69013]: pgmap v5425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:57 smithi096 ceph-mon[101353]: pgmap v5425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:22:58 smithi159 ceph-mon[69013]: pgmap v5426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:22:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:22:58 smithi096 ceph-mon[101353]: pgmap v5426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:01 smithi159 ceph-mon[69013]: pgmap v5427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:01 smithi096 ceph-mon[101353]: pgmap v5427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:03 smithi159 ceph-mon[69013]: pgmap v5428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:03 smithi096 ceph-mon[101353]: pgmap v5428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:05 smithi159 ceph-mon[69013]: pgmap v5429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:05 smithi096 ceph-mon[101353]: pgmap v5429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:07 smithi159 ceph-mon[69013]: pgmap v5430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:07 smithi096 ceph-mon[101353]: pgmap v5430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:08 smithi159 ceph-mon[69013]: pgmap v5431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:08 smithi096 ceph-mon[101353]: pgmap v5431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:11 smithi159 ceph-mon[69013]: pgmap v5432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:11 smithi096 ceph-mon[101353]: pgmap v5432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:13 smithi159 ceph-mon[69013]: pgmap v5433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:13 smithi096 ceph-mon[101353]: pgmap v5433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:15 smithi159 ceph-mon[69013]: pgmap v5434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:15 smithi096 ceph-mon[101353]: pgmap v5434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:17 smithi159 ceph-mon[69013]: pgmap v5435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:17 smithi096 ceph-mon[101353]: pgmap v5435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:18 smithi159 ceph-mon[69013]: pgmap v5436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:18 smithi096 ceph-mon[101353]: pgmap v5436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:21 smithi159 ceph-mon[69013]: pgmap v5437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:21.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:21 smithi096 ceph-mon[101353]: pgmap v5437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:23 smithi159 ceph-mon[69013]: pgmap v5438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:23 smithi096 ceph-mon[101353]: pgmap v5438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:24.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 -- 172.21.15.96:0/3035352727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f66e0 msgr2=0x7f7d280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3035352727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f66e0 0x7f7d280f6b00 secure :-1 s=READY pgs=2786 cs=0 l=1 rev1=1 rx=0x7f7d10004660 tx=0x7f7d10009b30).stop 2022-02-02T21:23:24.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 -- 172.21.15.96:0/3035352727 shutdown_connections 2022-02-02T21:23:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3035352727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f7980 0x7f7d280f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3035352727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f66e0 0x7f7d280f6b00 unknown :-1 s=CLOSED pgs=2786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 -- 172.21.15.96:0/3035352727 >> 172.21.15.96:0/3035352727 conn(0x7f7d280f1e40 msgr2=0x7f7d280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 -- 172.21.15.96:0/3035352727 shutdown_connections 2022-02-02T21:23:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.305+0000 7f7d2cced700 1 -- 172.21.15.96:0/3035352727 wait complete. 2022-02-02T21:23:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 Processor -- start 2022-02-02T21:23:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 -- start start 2022-02-02T21:23:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f66e0 0x7f7d2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806a380 con 0x7f7d280f7980 2022-02-02T21:23:24.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2cced700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806a4c0 con 0x7f7d280f66e0 2022-02-02T21:23:24.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42482/0 (socket says 172.21.15.96:42482) 2022-02-02T21:23:24.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 -- 172.21.15.96:0/3708222798 learned_addr learned my addr 172.21.15.96:0/3708222798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d2659c700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f66e0 0x7f7d2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 -- 172.21.15.96:0/3708222798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f66e0 msgr2=0x7f7d2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f66e0 0x7f7d2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.306+0000 7f7d25d9b700 1 -- 172.21.15.96:0/3708222798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10005040 con 0x7f7d280f7980 2022-02-02T21:23:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d25d9b700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 rx=0x7f7d1800c510 tx=0x7f7d18007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d1800f650 con 0x7f7d280f7980 2022-02-02T21:23:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d1800fc60 con 0x7f7d280f7980 2022-02-02T21:23:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d18012c50 con 0x7f7d280f7980 2022-02-02T21:23:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2806a7a0 con 0x7f7d280f7980 2022-02-02T21:23:24.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.307+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2810f020 con 0x7f7d280f7980 2022-02-02T21:23:24.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.308+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d28045ad0 con 0x7f7d280f7980 2022-02-02T21:23:24.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.309+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d18010070 con 0x7f7d280f7980 2022-02-02T21:23:24.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.309+0000 7f7d1effd700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 0x7f7d14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.309+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7d18081750 con 0x7f7d280f7980 2022-02-02T21:23:24.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.309+0000 7f7d2659c700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 0x7f7d14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.310+0000 7f7d2659c700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 0x7f7d14067290 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f7d10013690 tx=0x7f7d10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.313+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d1804f850 con 0x7f7d280f7980 2022-02-02T21:23:24.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.492+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d28057f10 con 0x7f7d14064dd0 2022-02-02T21:23:24.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.493+0000 7f7d1effd700 1 -- 172.21.15.96:0/3708222798 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7d28057f10 con 0x7f7d14064dd0 2022-02-02T21:23:24.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.495+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 msgr2=0x7f7d14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.495+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 0x7f7d14067290 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f7d10013690 tx=0x7f7d10009b30).stop 2022-02-02T21:23:24.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.495+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 msgr2=0x7f7d28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.495+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 rx=0x7f7d1800c510 tx=0x7f7d18007e00).stop 2022-02-02T21:23:24.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 shutdown_connections 2022-02-02T21:23:24.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d14064dd0 0x7f7d14067290 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d280f66e0 0x7f7d2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 --2- 172.21.15.96:0/3708222798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d280f7980 0x7f7d28069e20 unknown :-1 s=CLOSED pgs=2787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 >> 172.21.15.96:0/3708222798 conn(0x7f7d280f1e40 msgr2=0x7f7d280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:24.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 shutdown_connections 2022-02-02T21:23:24.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.496+0000 7f7d2cced700 1 -- 172.21.15.96:0/3708222798 wait complete. 2022-02-02T21:23:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:23:24.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 -- 172.21.15.96:0/1851709050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f77d0 msgr2=0x7f2d280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 --2- 172.21.15.96:0/1851709050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f77d0 0x7f2d280f7c30 secure :-1 s=READY pgs=2788 cs=0 l=1 rev1=1 rx=0x7f2d1c004660 tx=0x7f2d1c009b30).stop 2022-02-02T21:23:24.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 -- 172.21.15.96:0/1851709050 shutdown_connections 2022-02-02T21:23:24.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 --2- 172.21.15.96:0/1851709050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f77d0 0x7f2d280f7c30 unknown :-1 s=CLOSED pgs=2788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 --2- 172.21.15.96:0/1851709050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f6530 0x7f2d280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.593+0000 7f2d2759e700 1 -- 172.21.15.96:0/1851709050 >> 172.21.15.96:0/1851709050 conn(0x7f2d280f1c90 msgr2=0x7f2d280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 -- 172.21.15.96:0/1851709050 shutdown_connections 2022-02-02T21:23:24.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 -- 172.21.15.96:0/1851709050 wait complete. 2022-02-02T21:23:24.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 Processor -- start 2022-02-02T21:23:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 -- start start 2022-02-02T21:23:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f77d0 0x7f2d28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2806a380 con 0x7f2d280f6530 2022-02-02T21:23:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.594+0000 7f2d2759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2806a4c0 con 0x7f2d280f77d0 2022-02-02T21:23:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42490/0 (socket says 172.21.15.96:42490) 2022-02-02T21:23:24.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 -- 172.21.15.96:0/2297577571 learned_addr learned my addr 172.21.15.96:0/2297577571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:24.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d25d9b700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f77d0 0x7f2d28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 -- 172.21.15.96:0/2297577571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f77d0 msgr2=0x7f2d28069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f77d0 0x7f2d28069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 -- 172.21.15.96:0/2297577571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c005040 con 0x7f2d280f6530 2022-02-02T21:23:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2659c700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 secure :-1 s=READY pgs=2789 cs=0 l=1 rev1=1 rx=0x7f2d1800e7c0 tx=0x7f2d1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d180092e0 con 0x7f2d280f6530 2022-02-02T21:23:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2806a7a0 con 0x7f2d280f6530 2022-02-02T21:23:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d1800f040 con 0x7f2d280f6530 2022-02-02T21:23:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d180147e0 con 0x7f2d280f6530 2022-02-02T21:23:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.595+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2810ed00 con 0x7f2d280f6530 2022-02-02T21:23:24.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.596+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28045ad0 con 0x7f2d280f6530 2022-02-02T21:23:24.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.597+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d1801b030 con 0x7f2d280f6530 2022-02-02T21:23:24.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.597+0000 7f2d16ffd700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 0x7f2d100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.597+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2d180819b0 con 0x7f2d280f6530 2022-02-02T21:23:24.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.597+0000 7f2d25d9b700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 0x7f2d100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.598+0000 7f2d25d9b700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 0x7f2d100672e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f2d1c005010 tx=0x7f2d1c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.601+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d1804fab0 con 0x7f2d280f6530 2022-02-02T21:23:24.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.773+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d28057f10 con 0x7f2d10064e20 2022-02-02T21:23:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.782+0000 7f2d16ffd700 1 -- 172.21.15.96:0/2297577571 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2d28057f10 con 0x7f2d10064e20 2022-02-02T21:23:24.784 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:23:24.785 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:23:24.785 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:23:24.785 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:23:24.786 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:23:24.786 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:23:24.786 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (2h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:23:24.787 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:23:24.787 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (2h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:23:24.787 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:23:24.788 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:23:24.788 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:23:24.788 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (2h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:23:24.789 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:23:24.789 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:23:24.790 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:23:24.790 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:23:24.791 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:23:24.791 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:23:24.791 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:23:24.792 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:23:24.792 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:23:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 msgr2=0x7f2d100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 0x7f2d100672e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f2d1c005010 tx=0x7f2d1c016040).stop 2022-02-02T21:23:24.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 msgr2=0x7f2d2806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 secure :-1 s=READY pgs=2789 cs=0 l=1 rev1=1 rx=0x7f2d1800e7c0 tx=0x7f2d1800b040).stop 2022-02-02T21:23:24.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 shutdown_connections 2022-02-02T21:23:24.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d10064e20 0x7f2d100672e0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d280f6530 0x7f2d2806b9a0 unknown :-1 s=CLOSED pgs=2789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 --2- 172.21.15.96:0/2297577571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d280f77d0 0x7f2d28069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 >> 172.21.15.96:0/2297577571 conn(0x7f2d280f1c90 msgr2=0x7f2d280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:24.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 shutdown_connections 2022-02-02T21:23:24.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.784+0000 7f2d2759e700 1 -- 172.21.15.96:0/2297577571 wait complete. 2022-02-02T21:23:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.879+0000 7f92bde2e700 1 -- 172.21.15.96:0/3023061139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f55c0 msgr2=0x7f92b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.879+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3023061139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f55c0 0x7f92b80f59e0 secure :-1 s=READY pgs=2790 cs=0 l=1 rev1=1 rx=0x7f92a8004660 tx=0x7f92a8009b30).stop 2022-02-02T21:23:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 -- 172.21.15.96:0/3023061139 shutdown_connections 2022-02-02T21:23:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3023061139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f6860 0x7f92b80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3023061139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f55c0 0x7f92b80f59e0 unknown :-1 s=CLOSED pgs=2790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 -- 172.21.15.96:0/3023061139 >> 172.21.15.96:0/3023061139 conn(0x7f92b80f0d40 msgr2=0x7f92b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 -- 172.21.15.96:0/3023061139 shutdown_connections 2022-02-02T21:23:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 -- 172.21.15.96:0/3023061139 wait complete. 2022-02-02T21:23:24.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.880+0000 7f92bde2e700 1 Processor -- start 2022-02-02T21:23:24.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92bde2e700 1 -- start start 2022-02-02T21:23:24.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92bde2e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f55c0 0x7f92b8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92bde2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92bde2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80603c0 con 0x7f92b80f6860 2022-02-02T21:23:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92bde2e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8060500 con 0x7f92b80f55c0 2022-02-02T21:23:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42502/0 (socket says 172.21.15.96:42502) 2022-02-02T21:23:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 -- 172.21.15.96:0/3613276880 learned_addr learned my addr 172.21.15.96:0/3613276880 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b77fe700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f55c0 0x7f92b8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 -- 172.21.15.96:0/3613276880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f55c0 msgr2=0x7f92b8109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f55c0 0x7f92b8109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.881+0000 7f92b6ffd700 1 -- 172.21.15.96:0/3613276880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a8005040 con 0x7f92b80f6860 2022-02-02T21:23:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f92b6ffd700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 rx=0x7f92ac0026d0 tx=0x7f92ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac0079c0 con 0x7f92b80f6860 2022-02-02T21:23:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f92ac00f040 con 0x7f92b80f6860 2022-02-02T21:23:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b810c740 con 0x7f92b80f6860 2022-02-02T21:23:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac0148b0 con 0x7f92b80f6860 2022-02-02T21:23:24.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.882+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b810ccd0 con 0x7f92b80f6860 2022-02-02T21:23:24.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.883+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f92ac007b20 con 0x7f92b80f6860 2022-02-02T21:23:24.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.884+0000 7f929ffff700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 0x7f92a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:24.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.884+0000 7f92b77fe700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 0x7f92a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.884+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f92ac081a50 con 0x7f92b80f6860 2022-02-02T21:23:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.884+0000 7f92b77fe700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 0x7f92a0067290 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f92a8013690 tx=0x7f92a8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.885+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b80f49b0 con 0x7f92b80f6860 2022-02-02T21:23:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:24.889+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f92ac04fa90 con 0x7f92b80f6860 2022-02-02T21:23:25.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.120+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92b8045ad0 con 0x7f92b80f6860 2022-02-02T21:23:25.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.120+0000 7f929ffff700 1 -- 172.21.15.96:0/3613276880 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f92ac0530b0 con 0x7f92b80f6860 2022-02-02T21:23:25.123 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:23:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:23:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:23:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:25.125 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:23:25.126 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:23:25.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:25.127 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:23:25.127 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:23:25.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:25.128 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:23:25.129 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:23:25.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:25.129 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:23:25.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:23:25.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:23:25.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:23:25.131 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:23:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 msgr2=0x7f92a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 0x7f92a0067290 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f92a8013690 tx=0x7f92a8009b30).stop 2022-02-02T21:23:25.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 msgr2=0x7f92b810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 rx=0x7f92ac0026d0 tx=0x7f92ac009de0).stop 2022-02-02T21:23:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 shutdown_connections 2022-02-02T21:23:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92a0064dd0 0x7f92a0067290 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b80f55c0 0x7f92b8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 --2- 172.21.15.96:0/3613276880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92b80f6860 0x7f92b810c190 unknown :-1 s=CLOSED pgs=2791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 >> 172.21.15.96:0/3613276880 conn(0x7f92b80f0d40 msgr2=0x7f92b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 shutdown_connections 2022-02-02T21:23:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.122+0000 7f92bde2e700 1 -- 172.21.15.96:0/3613276880 wait complete. 2022-02-02T21:23:25.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 -- 172.21.15.96:0/330097462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 msgr2=0x7fec280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 --2- 172.21.15.96:0/330097462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec280f6b00 secure :-1 s=READY pgs=2792 cs=0 l=1 rev1=1 rx=0x7fec1c004660 tx=0x7fec1c009b30).stop 2022-02-02T21:23:25.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 -- 172.21.15.96:0/330097462 shutdown_connections 2022-02-02T21:23:25.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 --2- 172.21.15.96:0/330097462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 0x7fec280f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 --2- 172.21.15.96:0/330097462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec280f6b00 unknown :-1 s=CLOSED pgs=2792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 -- 172.21.15.96:0/330097462 >> 172.21.15.96:0/330097462 conn(0x7fec280f1e40 msgr2=0x7fec280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:25.224 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:25 smithi096 ceph-mon[101353]: pgmap v5439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 -- 172.21.15.96:0/330097462 shutdown_connections 2022-02-02T21:23:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.219+0000 7fec2f93c700 1 -- 172.21.15.96:0/330097462 wait complete. 2022-02-02T21:23:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 Processor -- start 2022-02-02T21:23:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 -- start start 2022-02-02T21:23:25.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:25.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 0x7fec28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2806a380 con 0x7fec280f66e0 2022-02-02T21:23:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2f93c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2806a4c0 con 0x7fec280f7980 2022-02-02T21:23:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42510/0 (socket says 172.21.15.96:42510) 2022-02-02T21:23:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 -- 172.21.15.96:0/3380610677 learned_addr learned my addr 172.21.15.96:0/3380610677 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2ced7700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 0x7fec28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 -- 172.21.15.96:0/3380610677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 msgr2=0x7fec28069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 0x7fec28069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.220+0000 7fec2d6d8700 1 -- 172.21.15.96:0/3380610677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c005040 con 0x7fec280f66e0 2022-02-02T21:23:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec2d6d8700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 secure :-1 s=READY pgs=2793 cs=0 l=1 rev1=1 rx=0x7fec1c004f60 tx=0x7fec1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c018070 con 0x7fec280f66e0 2022-02-02T21:23:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec1c009770 con 0x7fec280f66e0 2022-02-02T21:23:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2806a740 con 0x7fec280f66e0 2022-02-02T21:23:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c01c3c0 con 0x7fec280f66e0 2022-02-02T21:23:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.221+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2806aca0 con 0x7fec280f66e0 2022-02-02T21:23:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.222+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec28045ad0 con 0x7fec280f66e0 2022-02-02T21:23:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.223+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec1c01d420 con 0x7fec280f66e0 2022-02-02T21:23:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.223+0000 7fec19ffb700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 0x7fec14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.223+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec1c083780 con 0x7fec280f66e0 2022-02-02T21:23:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.223+0000 7fec2ced7700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 0x7fec14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.224+0000 7fec2ced7700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 0x7fec14067290 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7fec24007fd0 tx=0x7fec24009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.228+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec1c051880 con 0x7fec280f66e0 2022-02-02T21:23:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.429+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec280feff0 con 0x7fec280f66e0 2022-02-02T21:23:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.429+0000 7fec19ffb700 1 -- 172.21.15.96:0/3380610677 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fec1c054ea0 con 0x7fec280f66e0 2022-02-02T21:23:25.432 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:23:25.432 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:23:25.432 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:23:25.433 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:23:25.433 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:25.433 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:23:25.434 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:23:25.434 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:23:25.434 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:23:25.435 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:23:25.435 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:23:25.435 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:23:25.436 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:23:25.436 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:23:25.436 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:23:25.437 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:23:25.437 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:23:25.437 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:23:25.438 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:23:25.438 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:23:25.438 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:23:25.439 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:23:25.439 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:23:25.439 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:23:25.440 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:23:25.440 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:23:25.440 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:23:25.441 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:23:25.441 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:23:25.441 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:23:25.442 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:23:25.442 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:23:25.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:25.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:25.443 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:23:25.444 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:25.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:25.444 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:25.445 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:25.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 msgr2=0x7fec14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 0x7fec14067290 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7fec24007fd0 tx=0x7fec24009040).stop 2022-02-02T21:23:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 msgr2=0x7fec2806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 secure :-1 s=READY pgs=2793 cs=0 l=1 rev1=1 rx=0x7fec1c004f60 tx=0x7fec1c009b30).stop 2022-02-02T21:23:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 shutdown_connections 2022-02-02T21:23:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec14064dd0 0x7fec14067290 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec280f66e0 0x7fec2806b9a0 unknown :-1 s=CLOSED pgs=2793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 --2- 172.21.15.96:0/3380610677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280f7980 0x7fec28069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 >> 172.21.15.96:0/3380610677 conn(0x7fec280f1e40 msgr2=0x7fec280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 shutdown_connections 2022-02-02T21:23:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:25.431+0000 7fec2f93c700 1 -- 172.21.15.96:0/3380610677 wait complete. 2022-02-02T21:23:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:23:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:25 smithi159 ceph-mon[69013]: pgmap v5439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:26 smithi159 ceph-mon[69013]: from='client.39682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:26 smithi159 ceph-mon[69013]: from='client.39686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3613276880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:23:26.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3380610677' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:23:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:26 smithi096 ceph-mon[101353]: from='client.39682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:26 smithi096 ceph-mon[101353]: from='client.39686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3613276880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:23:26.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3380610677' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:23:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:27 smithi159 ceph-mon[69013]: pgmap v5440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:27 smithi096 ceph-mon[101353]: pgmap v5440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:23:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:23:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:28 smithi159 ceph-mon[69013]: pgmap v5441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:23:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:23:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:28 smithi096 ceph-mon[101353]: pgmap v5441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:31 smithi159 ceph-mon[69013]: pgmap v5442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:31 smithi096 ceph-mon[101353]: pgmap v5442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:33 smithi159 ceph-mon[69013]: pgmap v5443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:33 smithi096 ceph-mon[101353]: pgmap v5443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:35 smithi159 ceph-mon[69013]: pgmap v5444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:35 smithi096 ceph-mon[101353]: pgmap v5444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:37 smithi159 ceph-mon[69013]: pgmap v5445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:37 smithi096 ceph-mon[101353]: pgmap v5445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:38 smithi159 ceph-mon[69013]: pgmap v5446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:38 smithi096 ceph-mon[101353]: pgmap v5446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:41 smithi159 ceph-mon[69013]: pgmap v5447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:41 smithi096 ceph-mon[101353]: pgmap v5447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:43.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:43 smithi159 ceph-mon[69013]: pgmap v5448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:43 smithi096 ceph-mon[101353]: pgmap v5448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:45 smithi159 ceph-mon[69013]: pgmap v5449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:45 smithi096 ceph-mon[101353]: pgmap v5449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:47 smithi159 ceph-mon[69013]: pgmap v5450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:47 smithi096 ceph-mon[101353]: pgmap v5450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:48 smithi159 ceph-mon[69013]: pgmap v5451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:48 smithi096 ceph-mon[101353]: pgmap v5451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:51 smithi159 ceph-mon[69013]: pgmap v5452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:51 smithi096 ceph-mon[101353]: pgmap v5452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:53 smithi159 ceph-mon[69013]: pgmap v5453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:53 smithi096 ceph-mon[101353]: pgmap v5453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:55 smithi159 ceph-mon[69013]: pgmap v5454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:55.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.542+0000 7fd1886a9700 1 -- 172.21.15.96:0/2585820233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f66e0 msgr2=0x7fd1800f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.542+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2585820233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f66e0 0x7fd1800f6b00 secure :-1 s=READY pgs=2794 cs=0 l=1 rev1=1 rx=0x7fd17c004660 tx=0x7fd17c009b30).stop 2022-02-02T21:23:55.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- 172.21.15.96:0/2585820233 shutdown_connections 2022-02-02T21:23:55.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2585820233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f7980 0x7fd1800f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:23:55.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2585820233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f66e0 0x7fd1800f6b00 unknown :-1 s=CLOSED pgs=2794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- 172.21.15.96:0/2585820233 >> 172.21.15.96:0/2585820233 conn(0x7fd1800f1e40 msgr2=0x7fd1800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:55.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- 172.21.15.96:0/2585820233 shutdown_connections 2022-02-02T21:23:55.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- 172.21.15.96:0/2585820233 wait complete. 2022-02-02T21:23:55.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 Processor -- start 2022-02-02T21:23:55.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- start start 2022-02-02T21:23:55.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f66e0 0x7fd18006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18006a410 con 0x7fd1800f7980 2022-02-02T21:23:55.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.543+0000 7fd1886a9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18006a550 con 0x7fd1800f66e0 2022-02-02T21:23:55.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:55.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42542/0 (socket says 172.21.15.96:42542) 2022-02-02T21:23:55.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 -- 172.21.15.96:0/2062273783 learned_addr learned my addr 172.21.15.96:0/2062273783 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:55.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd186445700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f66e0 0x7fd18006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:55.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 -- 172.21.15.96:0/2062273783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f66e0 msgr2=0x7fd18006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f66e0 0x7fd18006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 -- 172.21.15.96:0/2062273783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c005040 con 0x7fd1800f7980 2022-02-02T21:23:55.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd185c44700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 secure :-1 s=READY pgs=2795 cs=0 l=1 rev1=1 rx=0x7fd17000b410 tx=0x7fd170006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:55.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1700125f0 con 0x7fd1800f7980 2022-02-02T21:23:55.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd170012c00 con 0x7fd1800f7980 2022-02-02T21:23:55.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18006a830 con 0x7fd1800f7980 2022-02-02T21:23:55.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd170002ae0 con 0x7fd1800f7980 2022-02-02T21:23:55.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.544+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18010efe0 con 0x7fd1800f7980 2022-02-02T21:23:55.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:55 smithi096 ceph-mon[101353]: pgmap v5454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:55.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.545+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd180045ad0 con 0x7fd1800f7980 2022-02-02T21:23:55.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.546+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd170012d70 con 0x7fd1800f7980 2022-02-02T21:23:55.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.547+0000 7fd176ffd700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 0x7fd16c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.547+0000 7fd186445700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 0x7fd16c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:55.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.547+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1700822e0 con 0x7fd1800f7980 2022-02-02T21:23:55.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.547+0000 7fd186445700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 0x7fd16c067270 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fd17c000c00 tx=0x7fd17c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:55.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.551+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1700503e0 con 0x7fd1800f7980 2022-02-02T21:23:55.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.730+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd180057f10 con 0x7fd16c064db0 2022-02-02T21:23:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.732+0000 7fd176ffd700 1 -- 172.21.15.96:0/2062273783 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd180057f10 con 0x7fd16c064db0 2022-02-02T21:23:55.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 msgr2=0x7fd16c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 0x7fd16c067270 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fd17c000c00 tx=0x7fd17c009b30).stop 2022-02-02T21:23:55.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 msgr2=0x7fd180069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 secure :-1 s=READY pgs=2795 cs=0 l=1 rev1=1 rx=0x7fd17000b410 tx=0x7fd170006ef0).stop 2022-02-02T21:23:55.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 shutdown_connections 2022-02-02T21:23:55.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd16c064db0 0x7fd16c067270 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1800f66e0 0x7fd18006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 --2- 172.21.15.96:0/2062273783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1800f7980 0x7fd180069e20 unknown :-1 s=CLOSED pgs=2795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.733+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 >> 172.21.15.96:0/2062273783 conn(0x7fd1800f1e40 msgr2=0x7fd1800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.734+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 shutdown_connections 2022-02-02T21:23:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.734+0000 7fd1886a9700 1 -- 172.21.15.96:0/2062273783 wait complete. 2022-02-02T21:23:55.744 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:23:55.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 -- 172.21.15.96:0/2764046900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 msgr2=0x7f09080f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 --2- 172.21.15.96:0/2764046900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f09080f5850 secure :-1 s=READY pgs=2796 cs=0 l=1 rev1=1 rx=0x7f08f8004660 tx=0x7f08f8009b30).stop 2022-02-02T21:23:55.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 -- 172.21.15.96:0/2764046900 shutdown_connections 2022-02-02T21:23:55.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 --2- 172.21.15.96:0/2764046900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f66d0 0x7f09080f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 --2- 172.21.15.96:0/2764046900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f09080f5850 unknown :-1 s=CLOSED pgs=2796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:55.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 -- 172.21.15.96:0/2764046900 >> 172.21.15.96:0/2764046900 conn(0x7f09080f0b90 msgr2=0x7f09080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:55.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 -- 172.21.15.96:0/2764046900 shutdown_connections 2022-02-02T21:23:55.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.831+0000 7f090759e700 1 -- 172.21.15.96:0/2764046900 wait complete. 2022-02-02T21:23:55.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 Processor -- start 2022-02-02T21:23:55.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 -- start start 2022-02-02T21:23:55.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f66d0 0x7f090810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908060420 con 0x7f09080f5430 2022-02-02T21:23:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908060560 con 0x7f09080f66d0 2022-02-02T21:23:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42552/0 (socket says 172.21.15.96:42552) 2022-02-02T21:23:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.832+0000 7f090659c700 1 -- 172.21.15.96:0/3149058345 learned_addr learned my addr 172.21.15.96:0/3149058345 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090659c700 1 -- 172.21.15.96:0/3149058345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f66d0 msgr2=0x7f090810bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090659c700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f66d0 0x7f090810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:23:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090659c700 1 -- 172.21.15.96:0/3149058345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8005040 con 0x7f09080f5430 2022-02-02T21:23:55.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090659c700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 secure :-1 s=READY pgs=2797 cs=0 l=1 rev1=1 rx=0x7f08f8004f60 tx=0x7f08f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:55.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f8018070 con 0x7f09080f5430 2022-02-02T21:23:55.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08f8007ba0 con 0x7f09080f5430 2022-02-02T21:23:55.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f801c620 con 0x7f09080f5430 2022-02-02T21:23:55.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090810c500 con 0x7f09080f5430 2022-02-02T21:23:55.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.833+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090810ca30 con 0x7f09080f5430 2022-02-02T21:23:55.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.834+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908045ad0 con 0x7f09080f5430 2022-02-02T21:23:55.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.834+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f08f801d420 con 0x7f09080f5430 2022-02-02T21:23:55.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.835+0000 7f08f6ffd700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 0x7f08f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:55.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.835+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f08f80838a0 con 0x7f09080f5430 2022-02-02T21:23:55.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.835+0000 7f0905d9b700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 0x7f08f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:55.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.835+0000 7f0905d9b700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 0x7f08f00672e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f08fc0047d0 tx=0x7f08fc007a40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:55.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:55.839+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08f80519a0 con 0x7f09080f5430 2022-02-02T21:23:56.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.011+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0908057f10 con 0x7f08f0064e20 2022-02-02T21:23:56.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.020+0000 7f08f6ffd700 1 -- 172.21.15.96:0/3149058345 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0908057f10 con 0x7f08f0064e20 2022-02-02T21:23:56.021 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:23:56.022 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:23:56.022 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:23:56.022 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (2h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:23:56.023 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:23:56.023 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:23:56.023 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:23:56.024 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:23:56.024 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:23:56.024 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:23:56.025 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:23:56.025 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:23:56.025 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:23:56.026 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:23:56.026 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:23:56.026 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:23:56.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:23:56.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:23:56.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:23:56.028 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:23:56.028 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:23:56.028 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:23:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 msgr2=0x7f08f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 0x7f08f00672e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f08fc0047d0 tx=0x7f08fc007a40).stop 2022-02-02T21:23:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 msgr2=0x7f0908109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 secure :-1 s=READY pgs=2797 cs=0 l=1 rev1=1 rx=0x7f08f8004f60 tx=0x7f08f8009b30).stop 2022-02-02T21:23:56.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 shutdown_connections 2022-02-02T21:23:56.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064e20 0x7f08f00672e0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f5430 0x7f0908109a50 unknown :-1 s=CLOSED pgs=2797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.022+0000 7f090759e700 1 --2- 172.21.15.96:0/3149058345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f66d0 0x7f090810bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:23:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.023+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 >> 172.21.15.96:0/3149058345 conn(0x7f09080f0b90 msgr2=0x7f09080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:56.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.023+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 shutdown_connections 2022-02-02T21:23:56.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.023+0000 7f090759e700 1 -- 172.21.15.96:0/3149058345 wait complete. 2022-02-02T21:23:56.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.119+0000 7f72c975e700 1 -- 172.21.15.96:0/2443647194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f6700 msgr2=0x7f72c40f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.119+0000 7f72c975e700 1 --2- 172.21.15.96:0/2443647194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f6700 0x7f72c40f6b60 secure :-1 s=READY pgs=2798 cs=0 l=1 rev1=1 rx=0x7f72b4004660 tx=0x7f72b4009b30).stop 2022-02-02T21:23:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 -- 172.21.15.96:0/2443647194 shutdown_connections 2022-02-02T21:23:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 --2- 172.21.15.96:0/2443647194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f6700 0x7f72c40f6b60 unknown :-1 s=CLOSED pgs=2798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 --2- 172.21.15.96:0/2443647194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f5460 0x7f72c40f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 -- 172.21.15.96:0/2443647194 >> 172.21.15.96:0/2443647194 conn(0x7f72c40f0bc0 msgr2=0x7f72c40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:56.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 -- 172.21.15.96:0/2443647194 shutdown_connections 2022-02-02T21:23:56.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 -- 172.21.15.96:0/2443647194 wait complete. 2022-02-02T21:23:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 Processor -- start 2022-02-02T21:23:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.120+0000 7f72c975e700 1 -- start start 2022-02-02T21:23:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c975e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c975e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f6700 0x7f72c410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c975e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40603c0 con 0x7f72c40f5460 2022-02-02T21:23:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c975e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4060500 con 0x7f72c40f6700 2022-02-02T21:23:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42562/0 (socket says 172.21.15.96:42562) 2022-02-02T21:23:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 -- 172.21.15.96:0/4054116581 learned_addr learned my addr 172.21.15.96:0/4054116581 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c27fc700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f6700 0x7f72c410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 -- 172.21.15.96:0/4054116581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f6700 msgr2=0x7f72c410bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f6700 0x7f72c410bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 -- 172.21.15.96:0/4054116581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4005040 con 0x7f72c40f5460 2022-02-02T21:23:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.121+0000 7f72c2ffd700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 secure :-1 s=READY pgs=2799 cs=0 l=1 rev1=1 rx=0x7f72b80049e0 tx=0x7f72b8007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.122+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b8013070 con 0x7f72c40f5460 2022-02-02T21:23:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.122+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72b800e2e0 con 0x7f72c40f5460 2022-02-02T21:23:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.122+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b800caf0 con 0x7f72c40f5460 2022-02-02T21:23:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.122+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c41058f0 con 0x7f72c40f5460 2022-02-02T21:23:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.122+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4105eb0 con 0x7f72c40f5460 2022-02-02T21:23:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.123+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4045ad0 con 0x7f72c40f5460 2022-02-02T21:23:56.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.124+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72b800cd60 con 0x7f72c40f5460 2022-02-02T21:23:56.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.124+0000 7f72ab7fe700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 0x7f72ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.124+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f72b8086480 con 0x7f72c40f5460 2022-02-02T21:23:56.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.124+0000 7f72c27fc700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 0x7f72ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.125+0000 7f72c27fc700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 0x7f72ac0672e0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f72b4004e30 tx=0x7f72b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:56.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.129+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72b8054580 con 0x7f72c40f5460 2022-02-02T21:23:56.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.365+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72c40fdcf0 con 0x7f72c40f5460 2022-02-02T21:23:56.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.365+0000 7f72ab7fe700 1 -- 172.21.15.96:0/4054116581 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f72b8057ba0 con 0x7f72c40f5460 2022-02-02T21:23:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:23:56.369 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:23:56.369 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:23:56.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:56.370 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:23:56.370 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:23:56.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:56.371 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:23:56.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:23:56.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:56.372 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:23:56.372 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:23:56.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:23:56.373 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:23:56.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:23:56.374 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:23:56.374 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:23:56.374 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:23:56.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 msgr2=0x7f72ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 0x7f72ac0672e0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f72b4004e30 tx=0x7f72b4009b30).stop 2022-02-02T21:23:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 msgr2=0x7f72c4109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 secure :-1 s=READY pgs=2799 cs=0 l=1 rev1=1 rx=0x7f72b80049e0 tx=0x7f72b8007ea0).stop 2022-02-02T21:23:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 shutdown_connections 2022-02-02T21:23:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f72ac064e20 0x7f72ac0672e0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72c40f5460 0x7f72c4109ab0 unknown :-1 s=CLOSED pgs=2799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 --2- 172.21.15.96:0/4054116581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c40f6700 0x7f72c410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 >> 172.21.15.96:0/4054116581 conn(0x7f72c40f0bc0 msgr2=0x7f72c40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:56.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 shutdown_connections 2022-02-02T21:23:56.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.367+0000 7f72c975e700 1 -- 172.21.15.96:0/4054116581 wait complete. 2022-02-02T21:23:56.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.464+0000 7fe780329700 1 -- 172.21.15.96:0/3435315916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 msgr2=0x7fe7780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.464+0000 7fe780329700 1 --2- 172.21.15.96:0/3435315916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f59e0 secure :-1 s=READY pgs=2800 cs=0 l=1 rev1=1 rx=0x7fe774004660 tx=0x7fe774009b30).stop 2022-02-02T21:23:56.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 -- 172.21.15.96:0/3435315916 shutdown_connections 2022-02-02T21:23:56.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 --2- 172.21.15.96:0/3435315916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 0x7fe7780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 --2- 172.21.15.96:0/3435315916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f59e0 unknown :-1 s=CLOSED pgs=2800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 -- 172.21.15.96:0/3435315916 >> 172.21.15.96:0/3435315916 conn(0x7fe7780f0d40 msgr2=0x7fe7780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:56.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 -- 172.21.15.96:0/3435315916 shutdown_connections 2022-02-02T21:23:56.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.465+0000 7fe780329700 1 -- 172.21.15.96:0/3435315916 wait complete. 2022-02-02T21:23:56.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 Processor -- start 2022-02-02T21:23:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 -- start start 2022-02-02T21:23:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 0x7fe7780f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7780f8100 con 0x7fe7780f55c0 2022-02-02T21:23:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe780329700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7780f8240 con 0x7fe7780f6860 2022-02-02T21:23:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42572/0 (socket says 172.21.15.96:42572) 2022-02-02T21:23:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 -- 172.21.15.96:0/37095144 learned_addr learned my addr 172.21.15.96:0/37095144 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:23:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77d8c4700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 0x7fe7780f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 -- 172.21.15.96:0/37095144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 msgr2=0x7fe7780f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 0x7fe7780f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.466+0000 7fe77e0c5700 1 -- 172.21.15.96:0/37095144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774005040 con 0x7fe7780f55c0 2022-02-02T21:23:56.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe77e0c5700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 secure :-1 s=READY pgs=2801 cs=0 l=1 rev1=1 rx=0x7fe774013a70 tx=0x7fe774009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe774018070 con 0x7fe7780f55c0 2022-02-02T21:23:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7740097d0 con 0x7fe7780f55c0 2022-02-02T21:23:56.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7780f84c0 con 0x7fe7780f55c0 2022-02-02T21:23:56.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe77401de80 con 0x7fe7780f55c0 2022-02-02T21:23:56.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.467+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7780f8a20 con 0x7fe7780f55c0 2022-02-02T21:23:56.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.468+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe774007ba0 con 0x7fe7780f55c0 2022-02-02T21:23:56.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.468+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe778045ad0 con 0x7fe7780f55c0 2022-02-02T21:23:56.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.469+0000 7fe76effd700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 0x7fe764067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:23:56.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.469+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe774083350 con 0x7fe7780f55c0 2022-02-02T21:23:56.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.469+0000 7fe77d8c4700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 0x7fe764067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:23:56.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.469+0000 7fe77d8c4700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 0x7fe764067290 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fe768004e20 tx=0x7fe76800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:23:56.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.473+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7740514f0 con 0x7fe7780f55c0 2022-02-02T21:23:56.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.680+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe77810f630 con 0x7fe7780f55c0 2022-02-02T21:23:56.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.681+0000 7fe76effd700 1 -- 172.21.15.96:0/37095144 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe774054b10 con 0x7fe7780f55c0 2022-02-02T21:23:56.682 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:23:56.683 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:23:56.683 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:23:56.683 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:23:56.684 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:56.684 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:23:56.684 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:23:56.685 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:23:56.685 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:23:56.686 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:23:56.686 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:23:56.687 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:23:56.687 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:23:56.687 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:23:56.688 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:23:56.689 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:23:56.689 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:23:56.690 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:23:56.690 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:23:56.690 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:23:56.691 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:23:56.691 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:23:56.691 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:23:56.692 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:23:56.692 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:23:56.692 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:23:56.693 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:23:56.693 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:23:56.694 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:23:56.694 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:23:56.694 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:23:56.695 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:23:56.695 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:56.695 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:56.696 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:23:56.696 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:23:56.696 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:56.697 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:56.697 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:23:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 msgr2=0x7fe764067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 0x7fe764067290 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fe768004e20 tx=0x7fe76800b040).stop 2022-02-02T21:23:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 msgr2=0x7fe7780f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:23:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 secure :-1 s=READY pgs=2801 cs=0 l=1 rev1=1 rx=0x7fe774013a70 tx=0x7fe774009b30).stop 2022-02-02T21:23:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 shutdown_connections 2022-02-02T21:23:56.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe764064dd0 0x7fe764067290 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7780f55c0 0x7fe7780f9720 unknown :-1 s=CLOSED pgs=2801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 --2- 172.21.15.96:0/37095144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7780f6860 0x7fe7780f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:23:56.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 >> 172.21.15.96:0/37095144 conn(0x7fe7780f0d40 msgr2=0x7fe77805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:23:56.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 shutdown_connections 2022-02-02T21:23:56.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:23:56.683+0000 7fe780329700 1 -- 172.21.15.96:0/37095144 wait complete. 2022-02-02T21:23:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:23:57.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:57 smithi159 ceph-mon[69013]: from='client.39698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:57 smithi159 ceph-mon[69013]: from='client.39702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:57.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:57 smithi159 ceph-mon[69013]: pgmap v5455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4054116581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:23:57.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/37095144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:23:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:57 smithi096 ceph-mon[101353]: from='client.39698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:57 smithi096 ceph-mon[101353]: from='client.39702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:23:57.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:57 smithi096 ceph-mon[101353]: pgmap v5455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:57.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4054116581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:23:57.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/37095144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:23:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:23:58 smithi159 ceph-mon[69013]: pgmap v5456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:23:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:23:58 smithi096 ceph-mon[101353]: pgmap v5456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:01 smithi159 ceph-mon[69013]: pgmap v5457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:01 smithi096 ceph-mon[101353]: pgmap v5457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:03 smithi159 ceph-mon[69013]: pgmap v5458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:03 smithi096 ceph-mon[101353]: pgmap v5458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:05 smithi159 ceph-mon[69013]: pgmap v5459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:05 smithi096 ceph-mon[101353]: pgmap v5459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:07 smithi159 ceph-mon[69013]: pgmap v5460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:07.610 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:07 smithi096 ceph-mon[101353]: pgmap v5460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:08 smithi159 ceph-mon[69013]: pgmap v5461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:08 smithi096 ceph-mon[101353]: pgmap v5461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:11 smithi159 ceph-mon[69013]: pgmap v5462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:11 smithi096 ceph-mon[101353]: pgmap v5462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:13 smithi159 ceph-mon[69013]: pgmap v5463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:13 smithi096 ceph-mon[101353]: pgmap v5463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:15 smithi159 ceph-mon[69013]: pgmap v5464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:15 smithi096 ceph-mon[101353]: pgmap v5464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:17 smithi159 ceph-mon[69013]: pgmap v5465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:17 smithi096 ceph-mon[101353]: pgmap v5465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:18 smithi159 ceph-mon[69013]: pgmap v5466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:18 smithi096 ceph-mon[101353]: pgmap v5466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:21 smithi159 ceph-mon[69013]: pgmap v5467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:21 smithi096 ceph-mon[101353]: pgmap v5467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:23 smithi159 ceph-mon[69013]: pgmap v5468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:23 smithi096 ceph-mon[101353]: pgmap v5468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:25.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:25 smithi159 ceph-mon[69013]: pgmap v5469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:25 smithi096 ceph-mon[101353]: pgmap v5469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:26.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 -- 172.21.15.96:0/2863799814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 msgr2=0x7f3b0c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:26.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/2863799814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f9110 secure :-1 s=READY pgs=2802 cs=0 l=1 rev1=1 rx=0x7f3afc004660 tx=0x7f3afc009b30).stop 2022-02-02T21:24:26.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 -- 172.21.15.96:0/2863799814 shutdown_connections 2022-02-02T21:24:26.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/2863799814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 0x7f3b0c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/2863799814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f9110 unknown :-1 s=CLOSED pgs=2802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 -- 172.21.15.96:0/2863799814 >> 172.21.15.96:0/2863799814 conn(0x7f3b0c0f0b90 msgr2=0x7f3b0c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:26.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 -- 172.21.15.96:0/2863799814 shutdown_connections 2022-02-02T21:24:26.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.788+0000 7f3b10bdb700 1 -- 172.21.15.96:0/2863799814 wait complete. 2022-02-02T21:24:26.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.789+0000 7f3b10bdb700 1 Processor -- start 2022-02-02T21:24:26.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.789+0000 7f3b10bdb700 1 -- start start 2022-02-02T21:24:26.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b10bdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:26.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b10bdb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 0x7f3b0c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b10bdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0f5570 con 0x7f3b0c060310 2022-02-02T21:24:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b10bdb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0f56b0 con 0x7f3b0c0f9690 2022-02-02T21:24:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42592/0 (socket says 172.21.15.96:42592) 2022-02-02T21:24:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 -- 172.21.15.96:0/3601101143 learned_addr learned my addr 172.21.15.96:0/3601101143 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0affd700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 0x7f3b0c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:26.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 -- 172.21.15.96:0/3601101143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 msgr2=0x7f3b0c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:26.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 0x7f3b0c0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 -- 172.21.15.96:0/3601101143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc005040 con 0x7f3b0c060310 2022-02-02T21:24:26.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b0b7fe700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 secure :-1 s=READY pgs=2803 cs=0 l=1 rev1=1 rx=0x7f3afc009990 tx=0x7f3afc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:26.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3afc018070 con 0x7f3b0c060310 2022-02-02T21:24:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c0f5930 con 0x7f3b0c060310 2022-02-02T21:24:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3afc007ba0 con 0x7f3b0c060310 2022-02-02T21:24:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.790+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3afc01c3c0 con 0x7f3b0c060310 2022-02-02T21:24:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.791+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c0f5e90 con 0x7f3b0c060310 2022-02-02T21:24:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.791+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c045ad0 con 0x7f3b0c060310 2022-02-02T21:24:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.792+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3afc01d420 con 0x7f3b0c060310 2022-02-02T21:24:26.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.793+0000 7f3af3fff700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 0x7f3af40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:26.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.793+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3afc083930 con 0x7f3b0c060310 2022-02-02T21:24:26.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.793+0000 7f3b0affd700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 0x7f3af40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:26.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.793+0000 7f3b0affd700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 0x7f3af40672e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f3b0c0600e0 tx=0x7f3b0000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:26.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.796+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3afc051a30 con 0x7f3b0c060310 2022-02-02T21:24:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.975+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b0c057f10 con 0x7f3af4064e20 2022-02-02T21:24:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.976+0000 7f3af3fff700 1 -- 172.21.15.96:0/3601101143 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3b0c057f10 con 0x7f3af4064e20 2022-02-02T21:24:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 msgr2=0x7f3af40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:26.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 0x7f3af40672e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f3b0c0600e0 tx=0x7f3b0000b040).stop 2022-02-02T21:24:26.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 msgr2=0x7f3b0c0f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 secure :-1 s=READY pgs=2803 cs=0 l=1 rev1=1 rx=0x7f3afc009990 tx=0x7f3afc009b30).stop 2022-02-02T21:24:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 shutdown_connections 2022-02-02T21:24:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3af4064e20 0x7f3af40672e0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b0c060310 0x7f3b0c0f6b90 unknown :-1 s=CLOSED pgs=2803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 --2- 172.21.15.96:0/3601101143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b0c0f9690 0x7f3b0c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 >> 172.21.15.96:0/3601101143 conn(0x7f3b0c0f0b90 msgr2=0x7f3b0c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 shutdown_connections 2022-02-02T21:24:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:26.978+0000 7f3b10bdb700 1 -- 172.21.15.96:0/3601101143 wait complete. 2022-02-02T21:24:26.989 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:24:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 -- 172.21.15.96:0/1932749824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f66e0 msgr2=0x7fde8c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 --2- 172.21.15.96:0/1932749824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f66e0 0x7fde8c0f6b00 secure :-1 s=READY pgs=2804 cs=0 l=1 rev1=1 rx=0x7fde7c004660 tx=0x7fde7c009b30).stop 2022-02-02T21:24:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 -- 172.21.15.96:0/1932749824 shutdown_connections 2022-02-02T21:24:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 --2- 172.21.15.96:0/1932749824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f7980 0x7fde8c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 --2- 172.21.15.96:0/1932749824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f66e0 0x7fde8c0f6b00 unknown :-1 s=CLOSED pgs=2804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 -- 172.21.15.96:0/1932749824 >> 172.21.15.96:0/1932749824 conn(0x7fde8c0f1e40 msgr2=0x7fde8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 -- 172.21.15.96:0/1932749824 shutdown_connections 2022-02-02T21:24:27.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.076+0000 7fde944a8700 1 -- 172.21.15.96:0/1932749824 wait complete. 2022-02-02T21:24:27.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 Processor -- start 2022-02-02T21:24:27.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 -- start start 2022-02-02T21:24:27.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f66e0 0x7fde8c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c107a50 con 0x7fde8c0f7980 2022-02-02T21:24:27.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde944a8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c107b90 con 0x7fde8c0f66e0 2022-02-02T21:24:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde91a43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde91a43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42604/0 (socket says 172.21.15.96:42604) 2022-02-02T21:24:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde91a43700 1 -- 172.21.15.96:0/4144343970 learned_addr learned my addr 172.21.15.96:0/4144343970 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.077+0000 7fde92244700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f66e0 0x7fde8c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde91a43700 1 -- 172.21.15.96:0/4144343970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f66e0 msgr2=0x7fde8c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde91a43700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f66e0 0x7fde8c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde91a43700 1 -- 172.21.15.96:0/4144343970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c005040 con 0x7fde8c0f7980 2022-02-02T21:24:27.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde91a43700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 secure :-1 s=READY pgs=2805 cs=0 l=1 rev1=1 rx=0x7fde880026d0 tx=0x7fde88009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde88009320 con 0x7fde8c0f7980 2022-02-02T21:24:27.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde8800f040 con 0x7fde8c0f7980 2022-02-02T21:24:27.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde880147e0 con 0x7fde8c0f7980 2022-02-02T21:24:27.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c108530 con 0x7fde8c0f7980 2022-02-02T21:24:27.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.078+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c108aa0 con 0x7fde8c0f7980 2022-02-02T21:24:27.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.079+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c045ad0 con 0x7fde8c0f7980 2022-02-02T21:24:27.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.079+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde88009480 con 0x7fde8c0f7980 2022-02-02T21:24:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.080+0000 7fde82ffd700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 0x7fde78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.080+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde88082120 con 0x7fde8c0f7980 2022-02-02T21:24:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.080+0000 7fde92244700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 0x7fde78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.080+0000 7fde92244700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 0x7fde78067290 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fde7c004630 tx=0x7fde7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.084+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde88053c50 con 0x7fde8c0f7980 2022-02-02T21:24:27.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.257+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde8c108d70 con 0x7fde78064dd0 2022-02-02T21:24:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.271+0000 7fde82ffd700 1 -- 172.21.15.96:0/4144343970 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fde8c108d70 con 0x7fde78064dd0 2022-02-02T21:24:27.273 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:24:27.273 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:24:27.273 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:24:27.274 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:24:27.274 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:24:27.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:24:27.275 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:24:27.276 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:24:27.276 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:24:27.276 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:24:27.277 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:24:27.277 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:24:27.277 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:24:27.278 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:24:27.278 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:24:27.279 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:24:27.279 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:24:27.279 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:24:27.280 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:24:27.280 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:24:27.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:24:27.281 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:24:27.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 msgr2=0x7fde78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 0x7fde78067290 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fde7c004630 tx=0x7fde7c009b30).stop 2022-02-02T21:24:27.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 msgr2=0x7fde8c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 secure :-1 s=READY pgs=2805 cs=0 l=1 rev1=1 rx=0x7fde880026d0 tx=0x7fde88009de0).stop 2022-02-02T21:24:27.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 shutdown_connections 2022-02-02T21:24:27.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde78064dd0 0x7fde78067290 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde8c0f66e0 0x7fde8c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 --2- 172.21.15.96:0/4144343970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde8c0f7980 0x7fde8c1074a0 unknown :-1 s=CLOSED pgs=2805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 >> 172.21.15.96:0/4144343970 conn(0x7fde8c0f1e40 msgr2=0x7fde8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 shutdown_connections 2022-02-02T21:24:27.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.273+0000 7fde944a8700 1 -- 172.21.15.96:0/4144343970 wait complete. 2022-02-02T21:24:27.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 -- 172.21.15.96:0/557846508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f5460 msgr2=0x7fbd8c0f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 --2- 172.21.15.96:0/557846508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c0f5880 secure :-1 s=READY pgs=2806 cs=0 l=1 rev1=1 rx=0x7fbd7c004660 tx=0x7fbd7c009b30).stop 2022-02-02T21:24:27.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 -- 172.21.15.96:0/557846508 shutdown_connections 2022-02-02T21:24:27.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 --2- 172.21.15.96:0/557846508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c0f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 --2- 172.21.15.96:0/557846508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c0f5880 unknown :-1 s=CLOSED pgs=2806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 -- 172.21.15.96:0/557846508 >> 172.21.15.96:0/557846508 conn(0x7fbd8c0f0bc0 msgr2=0x7fbd8c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.374 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:27 smithi096 ceph-mon[101353]: pgmap v5470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:27.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 -- 172.21.15.96:0/557846508 shutdown_connections 2022-02-02T21:24:27.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.370+0000 7fbd9133a700 1 -- 172.21.15.96:0/557846508 wait complete. 2022-02-02T21:24:27.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 Processor -- start 2022-02-02T21:24:27.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 -- start start 2022-02-02T21:24:27.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c104b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c105660 con 0x7fbd8c0f6700 2022-02-02T21:24:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd9133a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c1057a0 con 0x7fbd8c0f5460 2022-02-02T21:24:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.371+0000 7fbd8a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42614/0 (socket says 172.21.15.96:42614) 2022-02-02T21:24:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 -- 172.21.15.96:0/3510464839 learned_addr learned my addr 172.21.15.96:0/3510464839 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8affd700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 -- 172.21.15.96:0/3510464839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f5460 msgr2=0x7fbd8c104b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c104b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 -- 172.21.15.96:0/3510464839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c005040 con 0x7fbd8c0f6700 2022-02-02T21:24:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd8a7fc700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 secure :-1 s=READY pgs=2807 cs=0 l=1 rev1=1 rx=0x7fbd800026d0 tx=0x7fbd80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd800079c0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c106110 con 0x7fbd8c0f6700 2022-02-02T21:24:27.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd8000f040 con 0x7fbd8c0f6700 2022-02-02T21:24:27.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.372+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd800148b0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.373+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c1066d0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.374+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbd80007b20 con 0x7fbd8c0f6700 2022-02-02T21:24:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.374+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c045ad0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.374+0000 7fbd737fe700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 0x7fbd740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.374+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbd80081a00 con 0x7fbd8c0f6700 2022-02-02T21:24:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.374+0000 7fbd8affd700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 0x7fbd740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.375+0000 7fbd8affd700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 0x7fbd740672e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fbd8c104900 tx=0x7fbd7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.379+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbd8004fbb0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:27 smithi159 ceph-mon[69013]: pgmap v5470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:27.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.607+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbd8c106d40 con 0x7fbd8c0f6700 2022-02-02T21:24:27.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.608+0000 7fbd737fe700 1 -- 172.21.15.96:0/3510464839 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbd800531d0 con 0x7fbd8c0f6700 2022-02-02T21:24:27.609 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:24:27.610 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:24:27.610 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:24:27.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:27.611 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:24:27.611 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:24:27.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:27.612 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:24:27.612 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:24:27.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:27.613 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:24:27.613 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:24:27.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:27.614 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:24:27.614 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:24:27.615 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:24:27.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:24:27.615 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:24:27.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.609+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 msgr2=0x7fbd740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.609+0000 7fbd9133a700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 0x7fbd740672e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fbd8c104900 tx=0x7fbd7c009b30).stop 2022-02-02T21:24:27.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 msgr2=0x7fbd8c105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 secure :-1 s=READY pgs=2807 cs=0 l=1 rev1=1 rx=0x7fbd800026d0 tx=0x7fbd80009de0).stop 2022-02-02T21:24:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 shutdown_connections 2022-02-02T21:24:27.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd74064e20 0x7fbd740672e0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd8c0f5460 0x7fbd8c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 --2- 172.21.15.96:0/3510464839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd8c0f6700 0x7fbd8c105060 unknown :-1 s=CLOSED pgs=2807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 >> 172.21.15.96:0/3510464839 conn(0x7fbd8c0f0bc0 msgr2=0x7fbd8c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 shutdown_connections 2022-02-02T21:24:27.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.610+0000 7fbd9133a700 1 -- 172.21.15.96:0/3510464839 wait complete. 2022-02-02T21:24:27.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 -- 172.21.15.96:0/2372719595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55e0 msgr2=0x7ffb180f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/2372719595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55e0 0x7ffb180f5a00 secure :-1 s=READY pgs=2808 cs=0 l=1 rev1=1 rx=0x7ffb08004660 tx=0x7ffb08009b30).stop 2022-02-02T21:24:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 -- 172.21.15.96:0/2372719595 shutdown_connections 2022-02-02T21:24:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/2372719595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb180f6880 0x7ffb180f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/2372719595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f55e0 0x7ffb180f5a00 unknown :-1 s=CLOSED pgs=2808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 -- 172.21.15.96:0/2372719595 >> 172.21.15.96:0/2372719595 conn(0x7ffb180f0d40 msgr2=0x7ffb180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 -- 172.21.15.96:0/2372719595 shutdown_connections 2022-02-02T21:24:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.710+0000 7ffb1dd26700 1 -- 172.21.15.96:0/2372719595 wait complete. 2022-02-02T21:24:27.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 Processor -- start 2022-02-02T21:24:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 -- start start 2022-02-02T21:24:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 0x7ffb18068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18060700 con 0x7ffb180f6880 2022-02-02T21:24:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb1dd26700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18069430 con 0x7ffb18068ac0 2022-02-02T21:24:27.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42624/0 (socket says 172.21.15.96:42624) 2022-02-02T21:24:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.711+0000 7ffb177fe700 1 -- 172.21.15.96:0/1555559676 learned_addr learned my addr 172.21.15.96:0/1555559676 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:27.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb16ffd700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 0x7ffb18068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb177fe700 1 -- 172.21.15.96:0/1555559676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 msgr2=0x7ffb18068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb177fe700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 0x7ffb18068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb177fe700 1 -- 172.21.15.96:0/1555559676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08005040 con 0x7ffb180f6880 2022-02-02T21:24:27.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb16ffd700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 0x7ffb18068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:24:27.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb177fe700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 secure :-1 s=READY pgs=2809 cs=0 l=1 rev1=1 rx=0x7ffb08000c00 tx=0x7ffb08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb08019070 con 0x7ffb180f6880 2022-02-02T21:24:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb180696b0 con 0x7ffb180f6880 2022-02-02T21:24:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb18115a30 con 0x7ffb180f6880 2022-02-02T21:24:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb080097d0 con 0x7ffb180f6880 2022-02-02T21:24:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.712+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb080144c0 con 0x7ffb180f6880 2022-02-02T21:24:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.713+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc004fa0 con 0x7ffb180f6880 2022-02-02T21:24:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.714+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb08007bc0 con 0x7ffb180f6880 2022-02-02T21:24:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.714+0000 7ffb0ffff700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 0x7ffb04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.714+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffb08082c20 con 0x7ffb180f6880 2022-02-02T21:24:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.715+0000 7ffb16ffd700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 0x7ffb04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.715+0000 7ffb16ffd700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 0x7ffb04067290 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7ffb1805f940 tx=0x7ffb0000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.719+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb08050d20 con 0x7ffb180f6880 2022-02-02T21:24:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.919+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffafc005e80 con 0x7ffb180f6880 2022-02-02T21:24:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.919+0000 7ffb0ffff700 1 -- 172.21.15.96:0/1555559676 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ffb08015040 con 0x7ffb180f6880 2022-02-02T21:24:27.922 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:24:27.923 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:24:27.923 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:24:27.924 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:24:27.924 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:27.925 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:24:27.925 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:24:27.925 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:24:27.926 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:24:27.926 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:24:27.926 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:24:27.927 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:24:27.927 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:24:27.927 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:24:27.928 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:24:27.928 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:24:27.928 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:24:27.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:24:27.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:24:27.929 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:24:27.930 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:24:27.930 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:24:27.930 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:24:27.931 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:24:27.931 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:24:27.931 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:24:27.932 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:24:27.932 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:24:27.932 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:24:27.933 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:24:27.933 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:24:27.933 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:24:27.934 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:27.934 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:27.935 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:24:27.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:27.935 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:27.936 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:27.936 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.921+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 msgr2=0x7ffb04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.921+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 0x7ffb04067290 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7ffb1805f940 tx=0x7ffb0000b040).stop 2022-02-02T21:24:27.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.921+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 msgr2=0x7ffb180601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:27.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.921+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 secure :-1 s=READY pgs=2809 cs=0 l=1 rev1=1 rx=0x7ffb08000c00 tx=0x7ffb08009b30).stop 2022-02-02T21:24:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 shutdown_connections 2022-02-02T21:24:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064dd0 0x7ffb04067290 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb180f6880 0x7ffb180601c0 unknown :-1 s=CLOSED pgs=2809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 --2- 172.21.15.96:0/1555559676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb18068ac0 0x7ffb18068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 >> 172.21.15.96:0/1555559676 conn(0x7ffb180f0d40 msgr2=0x7ffb180fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 shutdown_connections 2022-02-02T21:24:27.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:27.922+0000 7ffb1dd26700 1 -- 172.21.15.96:0/1555559676 wait complete. 2022-02-02T21:24:27.941 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:24:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:28 smithi159 ceph-mon[69013]: from='client.39714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3510464839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:24:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:24:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:24:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1555559676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:24:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:28 smithi096 ceph-mon[101353]: from='client.39714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3510464839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:24:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:24:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:24:28.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1555559676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:24:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:29 smithi159 ceph-mon[69013]: from='client.39718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:29.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:29 smithi159 ceph-mon[69013]: pgmap v5471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:29 smithi096 ceph-mon[101353]: from='client.39718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:29.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:29 smithi096 ceph-mon[101353]: pgmap v5471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:31 smithi159 ceph-mon[69013]: pgmap v5472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:31 smithi096 ceph-mon[101353]: pgmap v5472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:33 smithi159 ceph-mon[69013]: pgmap v5473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:33 smithi096 ceph-mon[101353]: pgmap v5473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:35 smithi159 ceph-mon[69013]: pgmap v5474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:35 smithi096 ceph-mon[101353]: pgmap v5474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:37 smithi159 ceph-mon[69013]: pgmap v5475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:37 smithi096 ceph-mon[101353]: pgmap v5475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:38 smithi159 ceph-mon[69013]: pgmap v5476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:38 smithi096 ceph-mon[101353]: pgmap v5476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:41 smithi159 ceph-mon[69013]: pgmap v5477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:41 smithi096 ceph-mon[101353]: pgmap v5477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:43 smithi159 ceph-mon[69013]: pgmap v5478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:43 smithi096 ceph-mon[101353]: pgmap v5478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:45 smithi159 ceph-mon[69013]: pgmap v5479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:45 smithi096 ceph-mon[101353]: pgmap v5479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:47 smithi159 ceph-mon[69013]: pgmap v5480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:47 smithi096 ceph-mon[101353]: pgmap v5480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:48 smithi159 ceph-mon[69013]: pgmap v5481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:48 smithi096 ceph-mon[101353]: pgmap v5481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:51 smithi159 ceph-mon[69013]: pgmap v5482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:51 smithi096 ceph-mon[101353]: pgmap v5482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:53 smithi159 ceph-mon[69013]: pgmap v5483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:53 smithi096 ceph-mon[101353]: pgmap v5483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:55 smithi159 ceph-mon[69013]: pgmap v5484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:55 smithi096 ceph-mon[101353]: pgmap v5484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:57.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:57 smithi159 ceph-mon[69013]: pgmap v5485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:57 smithi096 ceph-mon[101353]: pgmap v5485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:58.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 -- 172.21.15.96:0/907263264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 msgr2=0x7f42e40f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/907263264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e40f6ae0 secure :-1 s=READY pgs=2810 cs=0 l=1 rev1=1 rx=0x7f42d4004660 tx=0x7f42d4009b30).stop 2022-02-02T21:24:58.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 -- 172.21.15.96:0/907263264 shutdown_connections 2022-02-02T21:24:58.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/907263264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 0x7f42e40f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/907263264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e40f6ae0 unknown :-1 s=CLOSED pgs=2810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 -- 172.21.15.96:0/907263264 >> 172.21.15.96:0/907263264 conn(0x7f42e40f1e20 msgr2=0x7f42e40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 -- 172.21.15.96:0/907263264 shutdown_connections 2022-02-02T21:24:58.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.032+0000 7f42ea8e8700 1 -- 172.21.15.96:0/907263264 wait complete. 2022-02-02T21:24:58.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.033+0000 7f42ea8e8700 1 Processor -- start 2022-02-02T21:24:58.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.033+0000 7f42ea8e8700 1 -- start start 2022-02-02T21:24:58.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.033+0000 7f42ea8e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42ea8e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 0x7f42e4107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42ea8e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4107a30 con 0x7f42e40f66c0 2022-02-02T21:24:58.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42ea8e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4107b70 con 0x7f42e40f7960 2022-02-02T21:24:58.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e37fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 0x7f42e4107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42642/0 (socket says 172.21.15.96:42642) 2022-02-02T21:24:58.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 -- 172.21.15.96:0/188051505 learned_addr learned my addr 172.21.15.96:0/188051505 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:58.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 -- 172.21.15.96:0/188051505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 msgr2=0x7f42e4107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 0x7f42e4107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 -- 172.21.15.96:0/188051505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4005040 con 0x7f42e40f66c0 2022-02-02T21:24:58.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e3fff700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 secure :-1 s=READY pgs=2811 cs=0 l=1 rev1=1 rx=0x7f42d4013a70 tx=0x7f42d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d4018070 con 0x7f42e40f66c0 2022-02-02T21:24:58.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.034+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42d40097d0 con 0x7f42e40f66c0 2022-02-02T21:24:58.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.035+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e41084b0 con 0x7f42e40f66c0 2022-02-02T21:24:58.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.035+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d401de80 con 0x7f42e40f66c0 2022-02-02T21:24:58.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.035+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e4108a10 con 0x7f42e40f66c0 2022-02-02T21:24:58.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.035+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4045ad0 con 0x7f42e40f66c0 2022-02-02T21:24:58.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.036+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42d4007ba0 con 0x7f42e40f66c0 2022-02-02T21:24:58.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.036+0000 7f42e0ff9700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 0x7f42cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.037+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42d4083660 con 0x7f42e40f66c0 2022-02-02T21:24:58.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.037+0000 7f42e37fe700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 0x7f42cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.037+0000 7f42e37fe700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 0x7f42cc067290 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f42d8004c40 tx=0x7f42d800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.041+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42d4055250 con 0x7f42e40f66c0 2022-02-02T21:24:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.221+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42e4108c80 con 0x7f42cc064dd0 2022-02-02T21:24:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.223+0000 7f42e0ff9700 1 -- 172.21.15.96:0/188051505 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f42e4108c80 con 0x7f42cc064dd0 2022-02-02T21:24:58.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 msgr2=0x7f42cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 0x7f42cc067290 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f42d8004c40 tx=0x7f42d800b040).stop 2022-02-02T21:24:58.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 msgr2=0x7f42e4106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 secure :-1 s=READY pgs=2811 cs=0 l=1 rev1=1 rx=0x7f42d4013a70 tx=0x7f42d4009b30).stop 2022-02-02T21:24:58.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 shutdown_connections 2022-02-02T21:24:58.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42cc064dd0 0x7f42cc067290 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f66c0 0x7f42e4106f90 unknown :-1 s=CLOSED pgs=2811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 --2- 172.21.15.96:0/188051505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f7960 0x7f42e4107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.224+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 >> 172.21.15.96:0/188051505 conn(0x7f42e40f1e20 msgr2=0x7f42e40fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.225+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 shutdown_connections 2022-02-02T21:24:58.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.225+0000 7f42ea8e8700 1 -- 172.21.15.96:0/188051505 wait complete. 2022-02-02T21:24:58.236 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:24:58.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 -- 172.21.15.96:0/2783613204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 msgr2=0x7faf800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 --2- 172.21.15.96:0/2783613204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf800f6950 secure :-1 s=READY pgs=2812 cs=0 l=1 rev1=1 rx=0x7faf74004660 tx=0x7faf74009b30).stop 2022-02-02T21:24:58.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 -- 172.21.15.96:0/2783613204 shutdown_connections 2022-02-02T21:24:58.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 --2- 172.21.15.96:0/2783613204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 0x7faf800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 --2- 172.21.15.96:0/2783613204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf800f6950 unknown :-1 s=CLOSED pgs=2812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 -- 172.21.15.96:0/2783613204 >> 172.21.15.96:0/2783613204 conn(0x7faf800f1c90 msgr2=0x7faf800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.321+0000 7faf859bd700 1 -- 172.21.15.96:0/2783613204 shutdown_connections 2022-02-02T21:24:58.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 -- 172.21.15.96:0/2783613204 wait complete. 2022-02-02T21:24:58.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 Processor -- start 2022-02-02T21:24:58.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 -- start start 2022-02-02T21:24:58.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 0x7faf801072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf801078f0 con 0x7faf800f6530 2022-02-02T21:24:58.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf859bd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80108100 con 0x7faf800f77d0 2022-02-02T21:24:58.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.322+0000 7faf849bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42652/0 (socket says 172.21.15.96:42652) 2022-02-02T21:24:58.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 -- 172.21.15.96:0/1161120631 learned_addr learned my addr 172.21.15.96:0/1161120631 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:58.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf7ffff700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 0x7faf801072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 -- 172.21.15.96:0/1161120631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 msgr2=0x7faf801072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 0x7faf801072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 -- 172.21.15.96:0/1161120631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74005040 con 0x7faf800f6530 2022-02-02T21:24:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf849bb700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 secure :-1 s=READY pgs=2813 cs=0 l=1 rev1=1 rx=0x7faf74013a70 tx=0x7faf74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf74018070 con 0x7faf800f6530 2022-02-02T21:24:58.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf740097d0 con 0x7faf800f6530 2022-02-02T21:24:58.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf80108320 con 0x7faf800f6530 2022-02-02T21:24:58.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf7401c3c0 con 0x7faf800f6530 2022-02-02T21:24:58.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.323+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf80108880 con 0x7faf800f6530 2022-02-02T21:24:58.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.324+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf80059100 con 0x7faf800f6530 2022-02-02T21:24:58.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.325+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf74007ba0 con 0x7faf800f6530 2022-02-02T21:24:58.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.325+0000 7faf7d7fa700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 0x7faf700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.325+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faf74083740 con 0x7faf800f6530 2022-02-02T21:24:58.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.325+0000 7faf7ffff700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 0x7faf700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.326+0000 7faf7ffff700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 0x7faf700672e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7faf6c004a70 tx=0x7faf6c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.329+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf74051900 con 0x7faf800f6530 2022-02-02T21:24:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.501+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf800fee00 con 0x7faf70064e20 2022-02-02T21:24:58.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.511+0000 7faf7d7fa700 1 -- 172.21.15.96:0/1161120631 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faf800fee00 con 0x7faf70064e20 2022-02-02T21:24:58.513 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:24:58.513 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:24:58.513 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:24:58.514 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:24:58.514 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:24:58.514 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:24:58.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:24:58.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:24:58.515 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:24:58.516 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:24:58.516 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:24:58.516 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:24:58.517 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:24:58.517 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:24:58.517 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:24:58.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:24:58.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:24:58.518 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:24:58.519 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:24:58.519 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:24:58.519 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:24:58.520 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:24:58.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.512+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 msgr2=0x7faf700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.512+0000 7faf859bd700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 0x7faf700672e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7faf6c004a70 tx=0x7faf6c00b040).stop 2022-02-02T21:24:58.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.512+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 msgr2=0x7faf80106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.512+0000 7faf859bd700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 secure :-1 s=READY pgs=2813 cs=0 l=1 rev1=1 rx=0x7faf74013a70 tx=0x7faf74009b30).stop 2022-02-02T21:24:58.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 shutdown_connections 2022-02-02T21:24:58.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf70064e20 0x7faf700672e0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf800f6530 0x7faf80106e00 unknown :-1 s=CLOSED pgs=2813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 --2- 172.21.15.96:0/1161120631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf800f77d0 0x7faf801072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 >> 172.21.15.96:0/1161120631 conn(0x7faf800f1c90 msgr2=0x7faf800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 shutdown_connections 2022-02-02T21:24:58.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.513+0000 7faf859bd700 1 -- 172.21.15.96:0/1161120631 wait complete. 2022-02-02T21:24:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 -- 172.21.15.96:0/2639356363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 msgr2=0x7fe7440f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 --2- 172.21.15.96:0/2639356363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe7440f7c30 secure :-1 s=READY pgs=2814 cs=0 l=1 rev1=1 rx=0x7fe734004660 tx=0x7fe734009b30).stop 2022-02-02T21:24:58.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 -- 172.21.15.96:0/2639356363 shutdown_connections 2022-02-02T21:24:58.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 --2- 172.21.15.96:0/2639356363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe7440f7c30 unknown :-1 s=CLOSED pgs=2814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 --2- 172.21.15.96:0/2639356363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe7440f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 -- 172.21.15.96:0/2639356363 >> 172.21.15.96:0/2639356363 conn(0x7fe7440f1c90 msgr2=0x7fe7440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 -- 172.21.15.96:0/2639356363 shutdown_connections 2022-02-02T21:24:58.614 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:58 smithi096 ceph-mon[101353]: pgmap v5486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:58.614 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:58 smithi096 ceph-mon[101353]: from='client.39730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:58.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.610+0000 7fe74b108700 1 -- 172.21.15.96:0/2639356363 wait complete. 2022-02-02T21:24:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 Processor -- start 2022-02-02T21:24:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 -- start start 2022-02-02T21:24:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe74406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74406a380 con 0x7fe7440f77d0 2022-02-02T21:24:58.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74b108700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74406a4c0 con 0x7fe7440f6530 2022-02-02T21:24:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42664/0 (socket says 172.21.15.96:42664) 2022-02-02T21:24:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 -- 172.21.15.96:0/1435665058 learned_addr learned my addr 172.21.15.96:0/1435665058 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74a106700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe74406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 -- 172.21.15.96:0/1435665058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 msgr2=0x7fe74406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe74406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe749905700 1 -- 172.21.15.96:0/1435665058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734005040 con 0x7fe7440f77d0 2022-02-02T21:24:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.611+0000 7fe74a106700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe74406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:24:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe749905700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 secure :-1 s=READY pgs=2815 cs=0 l=1 rev1=1 rx=0x7fe734000c00 tx=0x7fe73400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe734019070 con 0x7fe7440f77d0 2022-02-02T21:24:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe734007e70 con 0x7fe7440f77d0 2022-02-02T21:24:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe734014ce0 con 0x7fe7440f77d0 2022-02-02T21:24:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74406a740 con 0x7fe7440f77d0 2022-02-02T21:24:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.612+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74406aca0 con 0x7fe7440f77d0 2022-02-02T21:24:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.613+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744045ad0 con 0x7fe7440f77d0 2022-02-02T21:24:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.614+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe734025070 con 0x7fe7440f77d0 2022-02-02T21:24:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.614+0000 7fe73affd700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 0x7fe7300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.614+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe734082910 con 0x7fe7440f77d0 2022-02-02T21:24:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.614+0000 7fe74a106700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 0x7fe7300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.614+0000 7fe74a106700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 0x7fe7300672e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fe74406b730 tx=0x7fe74000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.618+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe734050a10 con 0x7fe7440f77d0 2022-02-02T21:24:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:58 smithi159 ceph-mon[69013]: pgmap v5486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:24:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:58 smithi159 ceph-mon[69013]: from='client.39730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:58.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.850+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe744027a00 con 0x7fe7440f77d0 2022-02-02T21:24:58.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.850+0000 7fe73affd700 1 -- 172.21.15.96:0/1435665058 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe734023070 con 0x7fe7440f77d0 2022-02-02T21:24:58.853 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:24:58.853 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:24:58.854 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:24:58.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:58.854 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:24:58.855 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:24:58.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:58.855 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:24:58.856 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:24:58.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:58.856 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:24:58.857 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:24:58.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:24:58.857 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:24:58.858 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:24:58.858 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:24:58.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:24:58.859 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:24:58.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 msgr2=0x7fe7300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 0x7fe7300672e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fe74406b730 tx=0x7fe74000b040).stop 2022-02-02T21:24:58.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 msgr2=0x7fe744069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 secure :-1 s=READY pgs=2815 cs=0 l=1 rev1=1 rx=0x7fe734000c00 tx=0x7fe73400b040).stop 2022-02-02T21:24:58.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 shutdown_connections 2022-02-02T21:24:58.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe730064e20 0x7fe7300672e0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7440f6530 0x7fe74406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 --2- 172.21.15.96:0/1435665058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7440f77d0 0x7fe744069e20 unknown :-1 s=CLOSED pgs=2815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 >> 172.21.15.96:0/1435665058 conn(0x7fe7440f1c90 msgr2=0x7fe7440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 shutdown_connections 2022-02-02T21:24:58.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.852+0000 7fe74b108700 1 -- 172.21.15.96:0/1435665058 wait complete. 2022-02-02T21:24:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 -- 172.21.15.96:0/1236895725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 msgr2=0x7f34bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/1236895725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc0f6cc0 secure :-1 s=READY pgs=2816 cs=0 l=1 rev1=1 rx=0x7f34a4004660 tx=0x7f34a4009b30).stop 2022-02-02T21:24:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 -- 172.21.15.96:0/1236895725 shutdown_connections 2022-02-02T21:24:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/1236895725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc0f6cc0 unknown :-1 s=CLOSED pgs=2816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/1236895725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 0x7f34bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 -- 172.21.15.96:0/1236895725 >> 172.21.15.96:0/1236895725 conn(0x7f34bc0f0d40 msgr2=0x7f34bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:58.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 -- 172.21.15.96:0/1236895725 shutdown_connections 2022-02-02T21:24:58.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.950+0000 7f34c0c2d700 1 -- 172.21.15.96:0/1236895725 wait complete. 2022-02-02T21:24:58.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 Processor -- start 2022-02-02T21:24:58.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 -- start start 2022-02-02T21:24:58.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 0x7f34bc106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc107990 con 0x7f34bc0f6860 2022-02-02T21:24:58.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34c0c2d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc107ad0 con 0x7f34bc0f55c0 2022-02-02T21:24:58.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34ba59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 0x7f34bc106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42674/0 (socket says 172.21.15.96:42674) 2022-02-02T21:24:58.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 -- 172.21.15.96:0/2693440550 learned_addr learned my addr 172.21.15.96:0/2693440550 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:24:58.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 -- 172.21.15.96:0/2693440550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 msgr2=0x7f34bc106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:58.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 0x7f34bc106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:58.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 -- 172.21.15.96:0/2693440550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4005040 con 0x7f34bc0f6860 2022-02-02T21:24:58.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.951+0000 7f34b9d9b700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 secure :-1 s=READY pgs=2817 cs=0 l=1 rev1=1 rx=0x7f34a4000c00 tx=0x7f34a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.952+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a4019070 con 0x7f34bc0f6860 2022-02-02T21:24:58.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.952+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc108410 con 0x7f34bc0f6860 2022-02-02T21:24:58.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.952+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f34a4007e70 con 0x7f34bc0f6860 2022-02-02T21:24:58.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.952+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a4014ce0 con 0x7f34bc0f6860 2022-02-02T21:24:58.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.952+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc108970 con 0x7f34bc0f6860 2022-02-02T21:24:58.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.953+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc045ad0 con 0x7f34bc0f6860 2022-02-02T21:24:58.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.953+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f34a4025070 con 0x7f34bc0f6860 2022-02-02T21:24:58.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.953+0000 7f34b2ffd700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 0x7f34a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:24:58.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.953+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f34a40829a0 con 0x7f34bc0f6860 2022-02-02T21:24:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.954+0000 7f34ba59c700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 0x7f34a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:24:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.954+0000 7f34ba59c700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 0x7f34a8067290 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f34ac009fd0 tx=0x7f34ac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:24:58.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:58.958+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f34a40544d0 con 0x7f34bc0f6860 2022-02-02T21:24:59.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.161+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34bc0fdd80 con 0x7f34bc0f6860 2022-02-02T21:24:59.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.161+0000 7f34b2ffd700 1 -- 172.21.15.96:0/2693440550 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f34a4023020 con 0x7f34bc0f6860 2022-02-02T21:24:59.164 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:24:59.164 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:24:59.164 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:24:59.165 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:24:59.165 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:59.165 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:24:59.166 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:24:59.166 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:24:59.166 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:24:59.167 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:24:59.167 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:24:59.167 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:24:59.168 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:24:59.168 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:24:59.168 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:24:59.169 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:24:59.169 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:24:59.169 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:24:59.170 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:24:59.170 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:24:59.170 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:24:59.171 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:24:59.171 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:24:59.171 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:24:59.172 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:24:59.172 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:24:59.172 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:24:59.173 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:24:59.173 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:24:59.173 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:24:59.174 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:24:59.174 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:24:59.174 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:59.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:59.175 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:24:59.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:24:59.176 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:59.176 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:59.176 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:24:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 msgr2=0x7f34a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 0x7f34a8067290 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f34ac009fd0 tx=0x7f34ac00b040).stop 2022-02-02T21:24:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 msgr2=0x7f34bc1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:24:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 secure :-1 s=READY pgs=2817 cs=0 l=1 rev1=1 rx=0x7f34a4000c00 tx=0x7f34a400b040).stop 2022-02-02T21:24:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 shutdown_connections 2022-02-02T21:24:59.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f34a8064dd0 0x7f34a8067290 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc0f55c0 0x7f34bc106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 --2- 172.21.15.96:0/2693440550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34bc0f6860 0x7f34bc1073e0 unknown :-1 s=CLOSED pgs=2817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:24:59.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 >> 172.21.15.96:0/2693440550 conn(0x7f34bc0f0d40 msgr2=0x7f34bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:24:59.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 shutdown_connections 2022-02-02T21:24:59.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:24:59.163+0000 7f34c0c2d700 1 -- 172.21.15.96:0/2693440550 wait complete. 2022-02-02T21:24:59.181 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:24:59.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:59 smithi159 ceph-mon[69013]: from='client.39734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:59.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1435665058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:24:59.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:24:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2693440550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:24:59.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:59 smithi096 ceph-mon[101353]: from='client.39734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:24:59.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1435665058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:24:59.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:24:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2693440550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:25:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:00 smithi159 ceph-mon[69013]: pgmap v5487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:00 smithi096 ceph-mon[101353]: pgmap v5487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:03 smithi159 ceph-mon[69013]: pgmap v5488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:03 smithi096 ceph-mon[101353]: pgmap v5488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:05 smithi159 ceph-mon[69013]: pgmap v5489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:05 smithi096 ceph-mon[101353]: pgmap v5489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:07 smithi159 ceph-mon[69013]: pgmap v5490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:07 smithi096 ceph-mon[101353]: pgmap v5490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:08 smithi159 ceph-mon[69013]: pgmap v5491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:08 smithi096 ceph-mon[101353]: pgmap v5491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:11 smithi159 ceph-mon[69013]: pgmap v5492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:11 smithi096 ceph-mon[101353]: pgmap v5492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:13 smithi159 ceph-mon[69013]: pgmap v5493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:13 smithi096 ceph-mon[101353]: pgmap v5493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:15 smithi159 ceph-mon[69013]: pgmap v5494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:15 smithi096 ceph-mon[101353]: pgmap v5494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:17 smithi159 ceph-mon[69013]: pgmap v5495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:17 smithi096 ceph-mon[101353]: pgmap v5495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:18 smithi159 ceph-mon[69013]: pgmap v5496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:18 smithi096 ceph-mon[101353]: pgmap v5496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:21 smithi159 ceph-mon[69013]: pgmap v5497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:21 smithi096 ceph-mon[101353]: pgmap v5497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:23 smithi159 ceph-mon[69013]: pgmap v5498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:23 smithi096 ceph-mon[101353]: pgmap v5498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:25 smithi159 ceph-mon[69013]: pgmap v5499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:25 smithi096 ceph-mon[101353]: pgmap v5499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:27 smithi159 ceph-mon[69013]: pgmap v5500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:27 smithi096 ceph-mon[101353]: pgmap v5500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:25:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:25:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:28 smithi159 ceph-mon[69013]: pgmap v5501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:25:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:25:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:28 smithi096 ceph-mon[101353]: pgmap v5501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:29.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 -- 172.21.15.96:0/1327352375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f6860 msgr2=0x7f1d440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1327352375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f6860 0x7f1d440f6cc0 secure :-1 s=READY pgs=2818 cs=0 l=1 rev1=1 rx=0x7f1d2c004660 tx=0x7f1d2c009b30).stop 2022-02-02T21:25:29.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 -- 172.21.15.96:0/1327352375 shutdown_connections 2022-02-02T21:25:29.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1327352375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f6860 0x7f1d440f6cc0 unknown :-1 s=CLOSED pgs=2818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1327352375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f55c0 0x7f1d440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 -- 172.21.15.96:0/1327352375 >> 172.21.15.96:0/1327352375 conn(0x7f1d440f0d40 msgr2=0x7f1d440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:29.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.274+0000 7f1d48a43700 1 -- 172.21.15.96:0/1327352375 shutdown_connections 2022-02-02T21:25:29.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 -- 172.21.15.96:0/1327352375 wait complete. 2022-02-02T21:25:29.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 Processor -- start 2022-02-02T21:25:29.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 -- start start 2022-02-02T21:25:29.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f6860 0x7f1d4410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d440603e0 con 0x7f1d440f55c0 2022-02-02T21:25:29.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d48a43700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44060520 con 0x7f1d440f6860 2022-02-02T21:25:29.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d4259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d4259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42696/0 (socket says 172.21.15.96:42696) 2022-02-02T21:25:29.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.275+0000 7f1d4259c700 1 -- 172.21.15.96:0/1383275257 learned_addr learned my addr 172.21.15.96:0/1383275257 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:25:29.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d41d9b700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f6860 0x7f1d4410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d4259c700 1 -- 172.21.15.96:0/1383275257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f6860 msgr2=0x7f1d4410c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d4259c700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f6860 0x7f1d4410c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d4259c700 1 -- 172.21.15.96:0/1383275257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c005040 con 0x7f1d440f55c0 2022-02-02T21:25:29.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d4259c700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 secure :-1 s=READY pgs=2819 cs=0 l=1 rev1=1 rx=0x7f1d3400c510 tx=0x7f1d34007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d3400f650 con 0x7f1d440f55c0 2022-02-02T21:25:29.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d3400fc60 con 0x7f1d440f55c0 2022-02-02T21:25:29.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4410c710 con 0x7f1d440f55c0 2022-02-02T21:25:29.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d34012cb0 con 0x7f1d440f55c0 2022-02-02T21:25:29.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.276+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4410ccd0 con 0x7f1d440f55c0 2022-02-02T21:25:29.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.277+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d44045ad0 con 0x7f1d440f55c0 2022-02-02T21:25:29.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.278+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1d34010070 con 0x7f1d440f55c0 2022-02-02T21:25:29.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.278+0000 7f1d3affd700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 0x7f1d300672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.278+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1d34081990 con 0x7f1d440f55c0 2022-02-02T21:25:29.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.278+0000 7f1d41d9b700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 0x7f1d300672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.279+0000 7f1d41d9b700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 0x7f1d300672d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f1d2c004e30 tx=0x7f1d2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.282+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1d3404fa80 con 0x7f1d440f55c0 2022-02-02T21:25:29.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.463+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d44057f10 con 0x7f1d30064e10 2022-02-02T21:25:29.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.465+0000 7f1d3affd700 1 -- 172.21.15.96:0/1383275257 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1d44057f10 con 0x7f1d30064e10 2022-02-02T21:25:29.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 msgr2=0x7f1d300672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 0x7f1d300672d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f1d2c004e30 tx=0x7f1d2c009b30).stop 2022-02-02T21:25:29.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 msgr2=0x7f1d44109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 secure :-1 s=READY pgs=2819 cs=0 l=1 rev1=1 rx=0x7f1d3400c510 tx=0x7f1d34007df0).stop 2022-02-02T21:25:29.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 shutdown_connections 2022-02-02T21:25:29.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d30064e10 0x7f1d300672d0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d440f55c0 0x7f1d44109c60 unknown :-1 s=CLOSED pgs=2819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 --2- 172.21.15.96:0/1383275257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d440f6860 0x7f1d4410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.466+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 >> 172.21.15.96:0/1383275257 conn(0x7f1d440f0d40 msgr2=0x7f1d440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:29.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.467+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 shutdown_connections 2022-02-02T21:25:29.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.467+0000 7f1d48a43700 1 -- 172.21.15.96:0/1383275257 wait complete. 2022-02-02T21:25:29.478 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:25:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 -- 172.21.15.96:0/2471110436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f6530 msgr2=0x7ff9940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/2471110436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f6530 0x7ff9940f6950 secure :-1 s=READY pgs=2820 cs=0 l=1 rev1=1 rx=0x7ff984004660 tx=0x7ff984009b30).stop 2022-02-02T21:25:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 -- 172.21.15.96:0/2471110436 shutdown_connections 2022-02-02T21:25:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/2471110436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f77d0 0x7ff9940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:25:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/2471110436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f6530 0x7ff9940f6950 unknown :-1 s=CLOSED pgs=2820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 -- 172.21.15.96:0/2471110436 >> 172.21.15.96:0/2471110436 conn(0x7ff9940f1cd0 msgr2=0x7ff9940f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 -- 172.21.15.96:0/2471110436 shutdown_connections 2022-02-02T21:25:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.564+0000 7ff99a4fd700 1 -- 172.21.15.96:0/2471110436 wait complete. 2022-02-02T21:25:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 Processor -- start 2022-02-02T21:25:29.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 -- start start 2022-02-02T21:25:29.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 0x7ff994106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994107920 con 0x7ff9940f77d0 2022-02-02T21:25:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff99a4fd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9941080d0 con 0x7ff9940f6530 2022-02-02T21:25:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42708/0 (socket says 172.21.15.96:42708) 2022-02-02T21:25:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 -- 172.21.15.96:0/1325503825 learned_addr learned my addr 172.21.15.96:0/1325503825 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:25:29.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff9994fb700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 0x7ff994106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 -- 172.21.15.96:0/1325503825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 msgr2=0x7ff994106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 0x7ff994106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff998cfa700 1 -- 172.21.15.96:0/1325503825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984005040 con 0x7ff9940f77d0 2022-02-02T21:25:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.565+0000 7ff9994fb700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 0x7ff994106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:25:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff998cfa700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 secure :-1 s=READY pgs=2821 cs=0 l=1 rev1=1 rx=0x7ff99000b410 tx=0x7ff990006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9900125f0 con 0x7ff9940f77d0 2022-02-02T21:25:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff990012c00 con 0x7ff9940f77d0 2022-02-02T21:25:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9941083b0 con 0x7ff9940f77d0 2022-02-02T21:25:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff990002ae0 con 0x7ff9940f77d0 2022-02-02T21:25:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.566+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff994108970 con 0x7ff9940f77d0 2022-02-02T21:25:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.567+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff994059100 con 0x7ff9940f77d0 2022-02-02T21:25:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.567+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff99000f030 con 0x7ff9940f77d0 2022-02-02T21:25:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.568+0000 7ff989ffb700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 0x7ff9800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.568+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff990081f10 con 0x7ff9940f77d0 2022-02-02T21:25:29.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.568+0000 7ff9994fb700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 0x7ff9800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.568+0000 7ff9994fb700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 0x7ff9800672e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7ff984004e30 tx=0x7ff984009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.572+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff990050010 con 0x7ff9940f77d0 2022-02-02T21:25:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.744+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9940fee80 con 0x7ff980064e20 2022-02-02T21:25:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.753+0000 7ff989ffb700 1 -- 172.21.15.96:0/1325503825 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff9940fee80 con 0x7ff980064e20 2022-02-02T21:25:29.755 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:25:29.755 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:25:29.756 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:25:29.756 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:25:29.756 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:25:29.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:25:29.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:25:29.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:25:29.758 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:25:29.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:25:29.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:25:29.759 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:25:29.759 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:25:29.759 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:25:29.760 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:25:29.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:25:29.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:25:29.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:25:29.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:25:29.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:25:29.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:25:29.762 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:25:29.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 msgr2=0x7ff9800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 0x7ff9800672e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7ff984004e30 tx=0x7ff984009b30).stop 2022-02-02T21:25:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 msgr2=0x7ff994107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 secure :-1 s=READY pgs=2821 cs=0 l=1 rev1=1 rx=0x7ff99000b410 tx=0x7ff990006ef0).stop 2022-02-02T21:25:29.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 shutdown_connections 2022-02-02T21:25:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff980064e20 0x7ff9800672e0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9940f6530 0x7ff994106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 --2- 172.21.15.96:0/1325503825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9940f77d0 0x7ff994107290 unknown :-1 s=CLOSED pgs=2821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 >> 172.21.15.96:0/1325503825 conn(0x7ff9940f1cd0 msgr2=0x7ff9940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 shutdown_connections 2022-02-02T21:25:29.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.756+0000 7ff99a4fd700 1 -- 172.21.15.96:0/1325503825 wait complete. 2022-02-02T21:25:29.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 -- 172.21.15.96:0/2124543874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f6860 msgr2=0x7fb9a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2124543874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f6860 0x7fb9a40f6cc0 secure :-1 s=READY pgs=2822 cs=0 l=1 rev1=1 rx=0x7fb994004660 tx=0x7fb994009b30).stop 2022-02-02T21:25:29.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 -- 172.21.15.96:0/2124543874 shutdown_connections 2022-02-02T21:25:29.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2124543874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f6860 0x7fb9a40f6cc0 unknown :-1 s=CLOSED pgs=2822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2124543874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f55c0 0x7fb9a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:25:29.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.851+0000 7fb9a9170700 1 -- 172.21.15.96:0/2124543874 >> 172.21.15.96:0/2124543874 conn(0x7fb9a40f0d40 msgr2=0x7fb9a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.852+0000 7fb9a9170700 1 -- 172.21.15.96:0/2124543874 shutdown_connections 2022-02-02T21:25:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.852+0000 7fb9a9170700 1 -- 172.21.15.96:0/2124543874 wait complete. 2022-02-02T21:25:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.852+0000 7fb9a9170700 1 Processor -- start 2022-02-02T21:25:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.852+0000 7fb9a9170700 1 -- start start 2022-02-02T21:25:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.852+0000 7fb9a9170700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a9170700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f6860 0x7fb9a4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a9170700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4107ab0 con 0x7fb9a40f55c0 2022-02-02T21:25:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a9170700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4108360 con 0x7fb9a40f6860 2022-02-02T21:25:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42716/0 (socket says 172.21.15.96:42716) 2022-02-02T21:25:29.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 -- 172.21.15.96:0/2500611809 learned_addr learned my addr 172.21.15.96:0/2500611809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:25:29.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a259c700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f6860 0x7fb9a4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 -- 172.21.15.96:0/2500611809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f6860 msgr2=0x7fb9a4107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:29.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f6860 0x7fb9a4107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:29.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 -- 172.21.15.96:0/2500611809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994005040 con 0x7fb9a40f55c0 2022-02-02T21:25:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a2d9d700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 secure :-1 s=READY pgs=2823 cs=0 l=1 rev1=1 rx=0x7fb9980093f0 tx=0x7fb998006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb998013640 con 0x7fb9a40f55c0 2022-02-02T21:25:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb998013c50 con 0x7fb9a40f55c0 2022-02-02T21:25:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.853+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a4108640 con 0x7fb9a40f55c0 2022-02-02T21:25:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.854+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb998012c70 con 0x7fb9a40f55c0 2022-02-02T21:25:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.854+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a4108c00 con 0x7fb9a40f55c0 2022-02-02T21:25:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.854+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a40f49b0 con 0x7fb9a40f55c0 2022-02-02T21:25:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.856+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb99801a060 con 0x7fb9a40f55c0 2022-02-02T21:25:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.856+0000 7fb98b7fe700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 0x7fb98c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.856+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb998081d70 con 0x7fb9a40f55c0 2022-02-02T21:25:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.856+0000 7fb9a259c700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 0x7fb98c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.857+0000 7fb9a259c700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 0x7fb98c067290 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fb994004630 tx=0x7fb994009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:29.859+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9980538c0 con 0x7fb9a40f55c0 2022-02-02T21:25:30.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.091+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9a40fde20 con 0x7fb9a40f55c0 2022-02-02T21:25:30.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.091+0000 7fb98b7fe700 1 -- 172.21.15.96:0/2500611809 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb9980182e0 con 0x7fb9a40f55c0 2022-02-02T21:25:30.094 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:25:30.094 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:25:30.094 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:25:30.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:25:30.095 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:25:30.095 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:25:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:25:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:25:30.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:25:30.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:25:30.097 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:25:30.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:25:30.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:25:30.098 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:25:30.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:25:30.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:25:30.100 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:25:30.100 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:25:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 msgr2=0x7fb98c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 0x7fb98c067290 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fb994004630 tx=0x7fb994009b30).stop 2022-02-02T21:25:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 msgr2=0x7fb9a4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 secure :-1 s=READY pgs=2823 cs=0 l=1 rev1=1 rx=0x7fb9980093f0 tx=0x7fb998006ec0).stop 2022-02-02T21:25:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 shutdown_connections 2022-02-02T21:25:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb98c064dd0 0x7fb98c067290 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a40f55c0 0x7fb9a4106f80 unknown :-1 s=CLOSED pgs=2823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 --2- 172.21.15.96:0/2500611809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a40f6860 0x7fb9a4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 >> 172.21.15.96:0/2500611809 conn(0x7fb9a40f0d40 msgr2=0x7fb9a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 shutdown_connections 2022-02-02T21:25:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.093+0000 7fb9a9170700 1 -- 172.21.15.96:0/2500611809 wait complete. 2022-02-02T21:25:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 -- 172.21.15.96:0/2476257604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 msgr2=0x7fc2e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 --2- 172.21.15.96:0/2476257604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e00f59e0 secure :-1 s=READY pgs=2824 cs=0 l=1 rev1=1 rx=0x7fc2d0004660 tx=0x7fc2d0009b30).stop 2022-02-02T21:25:30.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 -- 172.21.15.96:0/2476257604 shutdown_connections 2022-02-02T21:25:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 --2- 172.21.15.96:0/2476257604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f6860 0x7fc2e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 --2- 172.21.15.96:0/2476257604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e00f59e0 unknown :-1 s=CLOSED pgs=2824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 -- 172.21.15.96:0/2476257604 >> 172.21.15.96:0/2476257604 conn(0x7fc2e00f0d40 msgr2=0x7fc2e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 -- 172.21.15.96:0/2476257604 shutdown_connections 2022-02-02T21:25:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 -- 172.21.15.96:0/2476257604 wait complete. 2022-02-02T21:25:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.192+0000 7fc2e676f700 1 Processor -- start 2022-02-02T21:25:30.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 -- start start 2022-02-02T21:25:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f6860 0x7fc2e0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0106910 con 0x7fc2e00f55c0 2022-02-02T21:25:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0106a50 con 0x7fc2e00f6860 2022-02-02T21:25:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42726/0 (socket says 172.21.15.96:42726) 2022-02-02T21:25:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 -- 172.21.15.96:0/899975490 learned_addr learned my addr 172.21.15.96:0/899975490 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:25:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 -- 172.21.15.96:0/899975490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f6860 msgr2=0x7fc2e0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f6860 0x7fc2e0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:25:30.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 -- 172.21.15.96:0/899975490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0005040 con 0x7fc2e00f55c0 2022-02-02T21:25:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dffff700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 secure :-1 s=READY pgs=2825 cs=0 l=1 rev1=1 rx=0x7fc2d0009d30 tx=0x7fc2d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d001a070 con 0x7fc2e00f55c0 2022-02-02T21:25:30.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2d00097d0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e0107390 con 0x7fc2e00f55c0 2022-02-02T21:25:30.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.193+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d001f8d0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.194+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e01078f0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.194+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0045ad0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.195+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2d00125d0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.195+0000 7fc2dcff9700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 0x7fc2c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:25:30.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.195+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2d0085df0 con 0x7fc2e00f55c0 2022-02-02T21:25:30.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.195+0000 7fc2df7fe700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 0x7fc2c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:25:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.196+0000 7fc2df7fe700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 0x7fc2c8067290 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fc2d40047d0 tx=0x7fc2d4007a40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:25:30.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.200+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2d0057920 con 0x7fc2e00f55c0 2022-02-02T21:25:30.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.401+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2e00fdd80 con 0x7fc2e00f55c0 2022-02-02T21:25:30.403 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2500611809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:25:30.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.401+0000 7fc2dcff9700 1 -- 172.21.15.96:0/899975490 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc2d0057510 con 0x7fc2e00f55c0 2022-02-02T21:25:30.405 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:25:30.405 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:25:30.406 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:25:30.406 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:25:30.406 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:25:30.407 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:25:30.407 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:25:30.407 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:25:30.408 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:25:30.408 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:25:30.408 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:25:30.409 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:25:30.409 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:25:30.409 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:25:30.410 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:25:30.410 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:25:30.411 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:25:30.411 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:25:30.411 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:25:30.412 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:25:30.412 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:25:30.412 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:25:30.413 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:25:30.413 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:25:30.413 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:25:30.414 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:25:30.414 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:25:30.414 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:25:30.415 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:25:30.415 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:25:30.415 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:25:30.416 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:25:30.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:25:30.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:25:30.417 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:25:30.417 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:25:30.417 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:25:30.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:25:30.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:25:30.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 msgr2=0x7fc2c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 0x7fc2c8067290 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fc2d40047d0 tx=0x7fc2d4007a40).stop 2022-02-02T21:25:30.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 msgr2=0x7fc2e0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:25:30.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 secure :-1 s=READY pgs=2825 cs=0 l=1 rev1=1 rx=0x7fc2d0009d30 tx=0x7fc2d0009b30).stop 2022-02-02T21:25:30.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 shutdown_connections 2022-02-02T21:25:30.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c8064dd0 0x7fc2c8067290 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f55c0 0x7fc2e0105e70 unknown :-1 s=CLOSED pgs=2825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:25:30.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 --2- 172.21.15.96:0/899975490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f6860 0x7fc2e0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:25:30.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.403+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 >> 172.21.15.96:0/899975490 conn(0x7fc2e00f0d40 msgr2=0x7fc2e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:25:30.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.404+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 shutdown_connections 2022-02-02T21:25:30.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:25:30.404+0000 7fc2e676f700 1 -- 172.21.15.96:0/899975490 wait complete. 2022-02-02T21:25:30.423 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:25:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2500611809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:25:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:31 smithi159 ceph-mon[69013]: from='client.39746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:25:31.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:31 smithi159 ceph-mon[69013]: from='client.39750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:25:31.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:31 smithi159 ceph-mon[69013]: pgmap v5502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:31.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/899975490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:25:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:31 smithi096 ceph-mon[101353]: from='client.39746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:25:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:31 smithi096 ceph-mon[101353]: from='client.39750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:25:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:31 smithi096 ceph-mon[101353]: pgmap v5502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/899975490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:25:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:33 smithi159 ceph-mon[69013]: pgmap v5503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:33 smithi096 ceph-mon[101353]: pgmap v5503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:35 smithi159 ceph-mon[69013]: pgmap v5504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:35 smithi096 ceph-mon[101353]: pgmap v5504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:37 smithi159 ceph-mon[69013]: pgmap v5505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:37 smithi096 ceph-mon[101353]: pgmap v5505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:38 smithi159 ceph-mon[69013]: pgmap v5506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:38 smithi096 ceph-mon[101353]: pgmap v5506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:41 smithi159 ceph-mon[69013]: pgmap v5507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:41 smithi096 ceph-mon[101353]: pgmap v5507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:43 smithi159 ceph-mon[69013]: pgmap v5508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:43 smithi096 ceph-mon[101353]: pgmap v5508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:45 smithi159 ceph-mon[69013]: pgmap v5509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:45 smithi096 ceph-mon[101353]: pgmap v5509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:47 smithi159 ceph-mon[69013]: pgmap v5510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:47 smithi096 ceph-mon[101353]: pgmap v5510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:48 smithi159 ceph-mon[69013]: pgmap v5511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:48 smithi096 ceph-mon[101353]: pgmap v5511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:51 smithi159 ceph-mon[69013]: pgmap v5512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:51 smithi096 ceph-mon[101353]: pgmap v5512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:53 smithi159 ceph-mon[69013]: pgmap v5513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:53 smithi096 ceph-mon[101353]: pgmap v5513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:55 smithi159 ceph-mon[69013]: pgmap v5514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:55 smithi096 ceph-mon[101353]: pgmap v5514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:57 smithi159 ceph-mon[69013]: pgmap v5515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:57 smithi096 ceph-mon[101353]: pgmap v5515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:25:58 smithi159 ceph-mon[69013]: pgmap v5516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:25:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:25:58 smithi096 ceph-mon[101353]: pgmap v5516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:00.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 -- 172.21.15.96:0/2096167355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 msgr2=0x7fb2980f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 --2- 172.21.15.96:0/2096167355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb2980f6b30 secure :-1 s=READY pgs=2826 cs=0 l=1 rev1=1 rx=0x7fb28c004660 tx=0x7fb28c009b30).stop 2022-02-02T21:26:00.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 -- 172.21.15.96:0/2096167355 shutdown_connections 2022-02-02T21:26:00.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 --2- 172.21.15.96:0/2096167355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb2980f6b30 unknown :-1 s=CLOSED pgs=2826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 --2- 172.21.15.96:0/2096167355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 0x7fb2980f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 -- 172.21.15.96:0/2096167355 >> 172.21.15.96:0/2096167355 conn(0x7fb2980f0b90 msgr2=0x7fb2980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:00.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 -- 172.21.15.96:0/2096167355 shutdown_connections 2022-02-02T21:26:00.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.511+0000 7fb29cb10700 1 -- 172.21.15.96:0/2096167355 wait complete. 2022-02-02T21:26:00.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 Processor -- start 2022-02-02T21:26:00.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 -- start start 2022-02-02T21:26:00.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 0x7fb298109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980603e0 con 0x7fb2980f66d0 2022-02-02T21:26:00.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb29cb10700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298060520 con 0x7fb2980f5430 2022-02-02T21:26:00.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb296ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:00.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb296ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42748/0 (socket says 172.21.15.96:42748) 2022-02-02T21:26:00.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.512+0000 7fb296ffd700 1 -- 172.21.15.96:0/248793852 learned_addr learned my addr 172.21.15.96:0/248793852 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:00.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb2977fe700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 0x7fb298109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:00.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb296ffd700 1 -- 172.21.15.96:0/248793852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 msgr2=0x7fb298109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb296ffd700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 0x7fb298109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb296ffd700 1 -- 172.21.15.96:0/248793852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c005040 con 0x7fb2980f66d0 2022-02-02T21:26:00.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb296ffd700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 secure :-1 s=READY pgs=2827 cs=0 l=1 rev1=1 rx=0x7fb28c009990 tx=0x7fb28c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:00.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c018070 con 0x7fb2980f66d0 2022-02-02T21:26:00.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29810c470 con 0x7fb2980f66d0 2022-02-02T21:26:00.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb28c007ba0 con 0x7fb2980f66d0 2022-02-02T21:26:00.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c01c3c0 con 0x7fb2980f66d0 2022-02-02T21:26:00.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.513+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29810c9d0 con 0x7fb2980f66d0 2022-02-02T21:26:00.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.514+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298045ad0 con 0x7fb2980f66d0 2022-02-02T21:26:00.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.515+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb28c01d420 con 0x7fb2980f66d0 2022-02-02T21:26:00.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.515+0000 7fb27ffff700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 0x7fb2800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.515+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb28c0836b0 con 0x7fb2980f66d0 2022-02-02T21:26:00.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.515+0000 7fb2977fe700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 0x7fb2800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:00.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.516+0000 7fb2977fe700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 0x7fb2800672e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fb298060060 tx=0x7fb28800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:00.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.519+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb28c051810 con 0x7fb2980f66d0 2022-02-02T21:26:00.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.699+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2980fdd00 con 0x7fb280064e20 2022-02-02T21:26:00.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.700+0000 7fb27ffff700 1 -- 172.21.15.96:0/248793852 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb2980fdd00 con 0x7fb280064e20 2022-02-02T21:26:00.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 msgr2=0x7fb2800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 0x7fb2800672e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fb298060060 tx=0x7fb28800b040).stop 2022-02-02T21:26:00.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 msgr2=0x7fb29810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 secure :-1 s=READY pgs=2827 cs=0 l=1 rev1=1 rx=0x7fb28c009990 tx=0x7fb28c009b30).stop 2022-02-02T21:26:00.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 shutdown_connections 2022-02-02T21:26:00.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb280064e20 0x7fb2800672e0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2980f5430 0x7fb298109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 --2- 172.21.15.96:0/248793852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2980f66d0 0x7fb29810bf20 unknown :-1 s=CLOSED pgs=2827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 >> 172.21.15.96:0/248793852 conn(0x7fb2980f0b90 msgr2=0x7fb2980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:00.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 shutdown_connections 2022-02-02T21:26:00.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.702+0000 7fb29cb10700 1 -- 172.21.15.96:0/248793852 wait complete. 2022-02-02T21:26:00.712 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:26:00.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- 172.21.15.96:0/1794911460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f9b80 msgr2=0x7f76100f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1794911460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f9b80 0x7f76100f9fe0 secure :-1 s=READY pgs=2828 cs=0 l=1 rev1=1 rx=0x7f75f8004660 tx=0x7f75f8009b30).stop 2022-02-02T21:26:00.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- 172.21.15.96:0/1794911460 shutdown_connections 2022-02-02T21:26:00.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1794911460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f9b80 0x7f76100f9fe0 unknown :-1 s=CLOSED pgs=2828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1794911460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76100f88e0 0x7f76100f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- 172.21.15.96:0/1794911460 >> 172.21.15.96:0/1794911460 conn(0x7f76100f40e0 msgr2=0x7f76100f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- 172.21.15.96:0/1794911460 shutdown_connections 2022-02-02T21:26:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- 172.21.15.96:0/1794911460 wait complete. 2022-02-02T21:26:00.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 Processor -- start 2022-02-02T21:26:00.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.801+0000 7f7614ce5700 1 -- start start 2022-02-02T21:26:00.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76100f9b80 0x7f761006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761006cdb0 con 0x7f76100f88e0 2022-02-02T21:26:00.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761006cef0 con 0x7f76100f9b80 2022-02-02T21:26:00.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:00.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42756/0 (socket says 172.21.15.96:42756) 2022-02-02T21:26:00.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 -- 172.21.15.96:0/1526383407 learned_addr learned my addr 172.21.15.96:0/1526383407 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:00.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 -- 172.21.15.96:0/1526383407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76100f9b80 msgr2=0x7f761006c7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T21:26:00.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76100f9b80 0x7f761006c7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:26:00.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 -- 172.21.15.96:0/1526383407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f8005040 con 0x7f76100f88e0 2022-02-02T21:26:00.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f760e59c700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 secure :-1 s=READY pgs=2829 cs=0 l=1 rev1=1 rx=0x7f7608002700 tx=0x7f7608009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:00.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7608009320 con 0x7f76100f88e0 2022-02-02T21:26:00.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f760800f040 con 0x7f76100f88e0 2022-02-02T21:26:00.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761006d860 con 0x7f76100f88e0 2022-02-02T21:26:00.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7608014900 con 0x7f76100f88e0 2022-02-02T21:26:00.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.802+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761006de20 con 0x7f76100f88e0 2022-02-02T21:26:00.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.803+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f4004fa0 con 0x7f76100f88e0 2022-02-02T21:26:00.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.804+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7608014a60 con 0x7f76100f88e0 2022-02-02T21:26:00.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.804+0000 7f7606ffd700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 0x7f75fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:00.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.804+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7608081c00 con 0x7f76100f88e0 2022-02-02T21:26:00.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.804+0000 7f760dd9b700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 0x7f75fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:00.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.805+0000 7f760dd9b700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 0x7f75fc067290 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f75f8004e30 tx=0x7f75f8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:00.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.808+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7608087020 con 0x7f76100f88e0 2022-02-02T21:26:00.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.979+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75f4000bc0 con 0x7f75fc064dd0 2022-02-02T21:26:00.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.988+0000 7f7606ffd700 1 -- 172.21.15.96:0/1526383407 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f75f4000bc0 con 0x7f75fc064dd0 2022-02-02T21:26:00.989 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:26:00.990 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:26:00.990 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:26:00.990 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:26:00.991 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:26:00.991 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:26:00.991 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:26:00.992 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:26:00.992 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:26:00.992 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:26:00.993 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:26:00.993 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:26:00.993 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:26:00.994 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:26:00.994 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:26:00.994 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:26:00.995 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:26:00.995 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:26:00.995 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (2h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:26:00.996 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:26:00.996 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:26:00.996 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:26:00.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 msgr2=0x7f75fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 0x7f75fc067290 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f75f8004e30 tx=0x7f75f8009b30).stop 2022-02-02T21:26:00.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 msgr2=0x7f761006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:00.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 secure :-1 s=READY pgs=2829 cs=0 l=1 rev1=1 rx=0x7f7608002700 tx=0x7f7608009d80).stop 2022-02-02T21:26:00.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 shutdown_connections 2022-02-02T21:26:00.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f75fc064dd0 0x7f75fc067290 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:00.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76100f88e0 0x7f761006c2c0 unknown :-1 s=CLOSED pgs=2829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 --2- 172.21.15.96:0/1526383407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76100f9b80 0x7f761006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:26:01.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 >> 172.21.15.96:0/1526383407 conn(0x7f76100f40e0 msgr2=0x7f76100fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:01.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 shutdown_connections 2022-02-02T21:26:01.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:00.991+0000 7f7614ce5700 1 -- 172.21.15.96:0/1526383407 wait complete. 2022-02-02T21:26:01.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 -- 172.21.15.96:0/1380632264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 msgr2=0x7f437c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 --2- 172.21.15.96:0/1380632264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c0f6cc0 secure :-1 s=READY pgs=2830 cs=0 l=1 rev1=1 rx=0x7f436c004660 tx=0x7f436c009b30).stop 2022-02-02T21:26:01.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 -- 172.21.15.96:0/1380632264 shutdown_connections 2022-02-02T21:26:01.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 --2- 172.21.15.96:0/1380632264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c0f6cc0 unknown :-1 s=CLOSED pgs=2830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 --2- 172.21.15.96:0/1380632264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 -- 172.21.15.96:0/1380632264 >> 172.21.15.96:0/1380632264 conn(0x7f437c0f0d40 msgr2=0x7f437c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:01.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 -- 172.21.15.96:0/1380632264 shutdown_connections 2022-02-02T21:26:01.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.088+0000 7f4380c4a700 1 -- 172.21.15.96:0/1380632264 wait complete. 2022-02-02T21:26:01.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 Processor -- start 2022-02-02T21:26:01.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 -- start start 2022-02-02T21:26:01.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c060310 con 0x7f437c0f6860 2022-02-02T21:26:01.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4380c4a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c060450 con 0x7f437c0f55c0 2022-02-02T21:26:01.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4379d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4379d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42768/0 (socket says 172.21.15.96:42768) 2022-02-02T21:26:01.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f4379d9b700 1 -- 172.21.15.96:0/2970702016 learned_addr learned my addr 172.21.15.96:0/2970702016 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:01.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.089+0000 7f437a59c700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4379d9b700 1 -- 172.21.15.96:0/2970702016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 msgr2=0x7f437c10bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4379d9b700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c10bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4379d9b700 1 -- 172.21.15.96:0/2970702016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c005040 con 0x7f437c0f6860 2022-02-02T21:26:01.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f437a59c700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:26:01.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4379d9b700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 secure :-1 s=READY pgs=2831 cs=0 l=1 rev1=1 rx=0x7f436c009990 tx=0x7f436c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:01.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436c018070 con 0x7f437c0f6860 2022-02-02T21:26:01.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c10e970 con 0x7f437c0f6860 2022-02-02T21:26:01.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f436c007ba0 con 0x7f437c0f6860 2022-02-02T21:26:01.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436c01c3c0 con 0x7f437c0f6860 2022-02-02T21:26:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.090+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c10ed90 con 0x7f437c0f6860 2022-02-02T21:26:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.091+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c045ad0 con 0x7f437c0f6860 2022-02-02T21:26:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.091+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f436c01d420 con 0x7f437c0f6860 2022-02-02T21:26:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.092+0000 7f436affd700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 0x7f4364067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.092+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f436c0835e0 con 0x7f437c0f6860 2022-02-02T21:26:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.092+0000 7f437a59c700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 0x7f4364067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.092+0000 7f437a59c700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 0x7f4364067290 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f437c0600a0 tx=0x7f437000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.096+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f436c051680 con 0x7f437c0f6860 2022-02-02T21:26:01.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.326+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f437c027a00 con 0x7f437c0f6860 2022-02-02T21:26:01.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.327+0000 7f436affd700 1 -- 172.21.15.96:0/2970702016 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f436c054ca0 con 0x7f437c0f6860 2022-02-02T21:26:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:26:01.328 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:26:01.329 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:26:01.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:01.329 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:26:01.330 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:26:01.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:01.330 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:26:01.331 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:26:01.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:01.331 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:26:01.332 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:26:01.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:01.333 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:26:01.333 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:26:01.334 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:26:01.335 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:26:01.335 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:26:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.328+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 msgr2=0x7f4364067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.328+0000 7f4380c4a700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 0x7f4364067290 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f437c0600a0 tx=0x7f437000b040).stop 2022-02-02T21:26:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 msgr2=0x7f437c10e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 secure :-1 s=READY pgs=2831 cs=0 l=1 rev1=1 rx=0x7f436c009990 tx=0x7f436c009b30).stop 2022-02-02T21:26:01.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 shutdown_connections 2022-02-02T21:26:01.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4364064dd0 0x7f4364067290 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f437c0f55c0 0x7f437c10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 --2- 172.21.15.96:0/2970702016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f437c0f6860 0x7f437c10e480 unknown :-1 s=CLOSED pgs=2831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 >> 172.21.15.96:0/2970702016 conn(0x7f437c0f0d40 msgr2=0x7f437c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:01.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 shutdown_connections 2022-02-02T21:26:01.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.329+0000 7f4380c4a700 1 -- 172.21.15.96:0/2970702016 wait complete. 2022-02-02T21:26:01.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 -- 172.21.15.96:0/503482788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 msgr2=0x7fcf2c0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 --2- 172.21.15.96:0/503482788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c0f7dd0 secure :-1 s=READY pgs=2832 cs=0 l=1 rev1=1 rx=0x7fcf18004660 tx=0x7fcf18009b30).stop 2022-02-02T21:26:01.427 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:01 smithi096 ceph-mon[101353]: pgmap v5517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 -- 172.21.15.96:0/503482788 shutdown_connections 2022-02-02T21:26:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 --2- 172.21.15.96:0/503482788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c0f7dd0 unknown :-1 s=CLOSED pgs=2832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 --2- 172.21.15.96:0/503482788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 0x7fcf2c0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 -- 172.21.15.96:0/503482788 >> 172.21.15.96:0/503482788 conn(0x7fcf2c0f1e50 msgr2=0x7fcf2c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:01.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 -- 172.21.15.96:0/503482788 shutdown_connections 2022-02-02T21:26:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.426+0000 7fcf32d57700 1 -- 172.21.15.96:0/503482788 wait complete. 2022-02-02T21:26:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 Processor -- start 2022-02-02T21:26:01.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 -- start start 2022-02-02T21:26:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 0x7fcf2c106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1079f0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf32d57700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c107b30 con 0x7fcf2c0f66d0 2022-02-02T21:26:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf2bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf2bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42778/0 (socket says 172.21.15.96:42778) 2022-02-02T21:26:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf2bfff700 1 -- 172.21.15.96:0/3105144767 learned_addr learned my addr 172.21.15.96:0/3105144767 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.427+0000 7fcf30af3700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 0x7fcf2c106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf2bfff700 1 -- 172.21.15.96:0/3105144767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 msgr2=0x7fcf2c106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf2bfff700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 0x7fcf2c106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf2bfff700 1 -- 172.21.15.96:0/3105144767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18005040 con 0x7fcf2c0f7970 2022-02-02T21:26:01.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf2bfff700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 secure :-1 s=READY pgs=2833 cs=0 l=1 rev1=1 rx=0x7fcf18009990 tx=0x7fcf18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:01.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf18018070 con 0x7fcf2c0f7970 2022-02-02T21:26:01.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c108470 con 0x7fcf2c0f7970 2022-02-02T21:26:01.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf18007ba0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1801c620 con 0x7fcf2c0f7970 2022-02-02T21:26:01.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.428+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c1089d0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.429+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c045ad0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.429+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf1801c8e0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.430+0000 7fcf297fa700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 0x7fcf1c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:01.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.430+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf180838e0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.430+0000 7fcf30af3700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 0x7fcf1c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:01.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.430+0000 7fcf30af3700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 0x7fcf1c067290 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fcf2c0f77d0 tx=0x7fcf20009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:01.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.434+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf180555d0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:01 smithi159 ceph-mon[69013]: pgmap v5517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:01.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.635+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf2c027a00 con 0x7fcf2c0f7970 2022-02-02T21:26:01.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.635+0000 7fcf297fa700 1 -- 172.21.15.96:0/3105144767 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcf180551c0 con 0x7fcf2c0f7970 2022-02-02T21:26:01.637 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:26:01.637 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:26:01.638 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:26:01.638 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:26:01.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:01.639 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:26:01.639 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:26:01.640 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:26:01.640 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:26:01.641 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:26:01.641 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:26:01.641 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:26:01.642 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:26:01.642 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:26:01.643 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:26:01.643 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:26:01.643 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:26:01.644 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:26:01.644 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:26:01.645 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:26:01.645 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:26:01.646 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:26:01.646 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:26:01.646 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:26:01.647 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:26:01.647 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:26:01.648 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:26:01.648 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:26:01.648 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:26:01.649 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:26:01.649 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:26:01.649 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:26:01.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:01.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:01.650 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:26:01.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:01.651 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:01.651 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:01.652 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:01.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.638+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 msgr2=0x7fcf1c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.638+0000 7fcf32d57700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 0x7fcf1c067290 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fcf2c0f77d0 tx=0x7fcf20009040).stop 2022-02-02T21:26:01.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.638+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 msgr2=0x7fcf2c107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:01.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.638+0000 7fcf32d57700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 secure :-1 s=READY pgs=2833 cs=0 l=1 rev1=1 rx=0x7fcf18009990 tx=0x7fcf18009b30).stop 2022-02-02T21:26:01.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 shutdown_connections 2022-02-02T21:26:01.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf1c064dd0 0x7fcf1c067290 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf2c0f66d0 0x7fcf2c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 --2- 172.21.15.96:0/3105144767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0f7970 0x7fcf2c107440 unknown :-1 s=CLOSED pgs=2833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:01.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 >> 172.21.15.96:0/3105144767 conn(0x7fcf2c0f1e50 msgr2=0x7fcf2c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 shutdown_connections 2022-02-02T21:26:01.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:01.639+0000 7fcf32d57700 1 -- 172.21.15.96:0/3105144767 wait complete. 2022-02-02T21:26:01.659 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:26:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:02 smithi159 ceph-mon[69013]: from='client.39762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:02 smithi159 ceph-mon[69013]: from='client.39766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2970702016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:26:02.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3105144767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:26:02.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:02 smithi096 ceph-mon[101353]: from='client.39762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:02.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:02 smithi096 ceph-mon[101353]: from='client.39766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2970702016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:26:02.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3105144767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:26:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:03 smithi159 ceph-mon[69013]: pgmap v5518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:03 smithi096 ceph-mon[101353]: pgmap v5518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:05 smithi159 ceph-mon[69013]: pgmap v5519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:05 smithi096 ceph-mon[101353]: pgmap v5519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:07 smithi159 ceph-mon[69013]: pgmap v5520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:07 smithi096 ceph-mon[101353]: pgmap v5520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:08 smithi159 ceph-mon[69013]: pgmap v5521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:08 smithi096 ceph-mon[101353]: pgmap v5521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:11 smithi159 ceph-mon[69013]: pgmap v5522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:11 smithi096 ceph-mon[101353]: pgmap v5522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:13.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:13 smithi159 ceph-mon[69013]: pgmap v5523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:13 smithi096 ceph-mon[101353]: pgmap v5523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:15 smithi159 ceph-mon[69013]: pgmap v5524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:15 smithi096 ceph-mon[101353]: pgmap v5524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:17 smithi159 ceph-mon[69013]: pgmap v5525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:17 smithi096 ceph-mon[101353]: pgmap v5525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:18 smithi159 ceph-mon[69013]: pgmap v5526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:18 smithi096 ceph-mon[101353]: pgmap v5526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:21 smithi159 ceph-mon[69013]: pgmap v5527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:21 smithi096 ceph-mon[101353]: pgmap v5527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:23 smithi159 ceph-mon[69013]: pgmap v5528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:23 smithi096 ceph-mon[101353]: pgmap v5528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:25 smithi159 ceph-mon[69013]: pgmap v5529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:25 smithi096 ceph-mon[101353]: pgmap v5529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:27 smithi159 ceph-mon[69013]: pgmap v5530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:27 smithi096 ceph-mon[101353]: pgmap v5530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:26:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:26:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:28 smithi096 ceph-mon[101353]: pgmap v5531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:26:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:26:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:28 smithi159 ceph-mon[69013]: pgmap v5531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:31 smithi159 ceph-mon[69013]: pgmap v5532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:31 smithi096 ceph-mon[101353]: pgmap v5532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:31.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 -- 172.21.15.96:0/2749886975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f66e0 msgr2=0x7fc2e00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:31.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/2749886975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f66e0 0x7fc2e00f6b00 secure :-1 s=READY pgs=2834 cs=0 l=1 rev1=1 rx=0x7fc2c8004660 tx=0x7fc2c8009b30).stop 2022-02-02T21:26:31.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 -- 172.21.15.96:0/2749886975 shutdown_connections 2022-02-02T21:26:31.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/2749886975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f7980 0x7fc2e00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/2749886975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f66e0 0x7fc2e00f6b00 unknown :-1 s=CLOSED pgs=2834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 -- 172.21.15.96:0/2749886975 >> 172.21.15.96:0/2749886975 conn(0x7fc2e00f1e40 msgr2=0x7fc2e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:31.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 -- 172.21.15.96:0/2749886975 shutdown_connections 2022-02-02T21:26:31.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.748+0000 7fc2e48b3700 1 -- 172.21.15.96:0/2749886975 wait complete. 2022-02-02T21:26:31.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 Processor -- start 2022-02-02T21:26:31.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 -- start start 2022-02-02T21:26:31.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f66e0 0x7fc2e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:31.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:31.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e006a380 con 0x7fc2e00f7980 2022-02-02T21:26:31.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2e48b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e006a4c0 con 0x7fc2e00f66e0 2022-02-02T21:26:31.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:31.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42802/0 (socket says 172.21.15.96:42802) 2022-02-02T21:26:31.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 -- 172.21.15.96:0/3077648454 learned_addr learned my addr 172.21.15.96:0/3077648454 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:31.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2de59c700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f66e0 0x7fc2e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:31.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 -- 172.21.15.96:0/3077648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f66e0 msgr2=0x7fc2e006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:31.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f66e0 0x7fc2e006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.749+0000 7fc2ddd9b700 1 -- 172.21.15.96:0/3077648454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8005040 con 0x7fc2e00f7980 2022-02-02T21:26:31.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2ddd9b700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 secure :-1 s=READY pgs=2835 cs=0 l=1 rev1=1 rx=0x7fc2d00026d0 tx=0x7fc2d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:31.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d00079c0 con 0x7fc2e00f7980 2022-02-02T21:26:31.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e006a7a0 con 0x7fc2e00f7980 2022-02-02T21:26:31.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2d000f040 con 0x7fc2e00f7980 2022-02-02T21:26:31.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d00148b0 con 0x7fc2e00f7980 2022-02-02T21:26:31.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.750+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e010efe0 con 0x7fc2e00f7980 2022-02-02T21:26:31.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.751+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0045ad0 con 0x7fc2e00f7980 2022-02-02T21:26:31.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.751+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2d0007b20 con 0x7fc2e00f7980 2022-02-02T21:26:31.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.752+0000 7fc2d6ffd700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:31.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.752+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2d00819e0 con 0x7fc2e00f7980 2022-02-02T21:26:31.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.752+0000 7fc2de59c700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:31.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.752+0000 7fc2de59c700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7fc2c8013690 tx=0x7fc2c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:31.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.756+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2d004fae0 con 0x7fc2e00f7980 2022-02-02T21:26:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.933+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2e00fefb0 con 0x7fc2cc064dd0 2022-02-02T21:26:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.935+0000 7fc2d6ffd700 1 -- 172.21.15.96:0/3077648454 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc2e00fefb0 con 0x7fc2cc064dd0 2022-02-02T21:26:31.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 msgr2=0x7fc2cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:31.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7fc2c8013690 tx=0x7fc2c8009b30).stop 2022-02-02T21:26:31.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 msgr2=0x7fc2e0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:31.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 secure :-1 s=READY pgs=2835 cs=0 l=1 rev1=1 rx=0x7fc2d00026d0 tx=0x7fc2d0009de0).stop 2022-02-02T21:26:31.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 shutdown_connections 2022-02-02T21:26:31.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2cc064dd0 0x7fc2cc067290 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e00f66e0 0x7fc2e006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 --2- 172.21.15.96:0/3077648454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e00f7980 0x7fc2e0069e20 unknown :-1 s=CLOSED pgs=2835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.936+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 >> 172.21.15.96:0/3077648454 conn(0x7fc2e00f1e40 msgr2=0x7fc2e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.937+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 shutdown_connections 2022-02-02T21:26:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:31.937+0000 7fc2e48b3700 1 -- 172.21.15.96:0/3077648454 wait complete. 2022-02-02T21:26:31.947 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:26:32.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 -- 172.21.15.96:0/2209178514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f77d0 msgr2=0x7fe7f00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/2209178514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f77d0 0x7fe7f00f7c30 secure :-1 s=READY pgs=2836 cs=0 l=1 rev1=1 rx=0x7fe7e4004660 tx=0x7fe7e4009b30).stop 2022-02-02T21:26:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 -- 172.21.15.96:0/2209178514 shutdown_connections 2022-02-02T21:26:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/2209178514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f77d0 0x7fe7f00f7c30 unknown :-1 s=CLOSED pgs=2836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/2209178514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f6530 0x7fe7f00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 -- 172.21.15.96:0/2209178514 >> 172.21.15.96:0/2209178514 conn(0x7fe7f00f1c90 msgr2=0x7fe7f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.033+0000 7fe7f50a7700 1 -- 172.21.15.96:0/2209178514 shutdown_connections 2022-02-02T21:26:32.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.034+0000 7fe7f50a7700 1 -- 172.21.15.96:0/2209178514 wait complete. 2022-02-02T21:26:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.034+0000 7fe7f50a7700 1 Processor -- start 2022-02-02T21:26:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7f50a7700 1 -- start start 2022-02-02T21:26:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7f50a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7f50a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f77d0 0x7fe7f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7f50a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006a380 con 0x7fe7f00f6530 2022-02-02T21:26:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7f50a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006a4c0 con 0x7fe7f00f77d0 2022-02-02T21:26:32.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42808/0 (socket says 172.21.15.96:42808) 2022-02-02T21:26:32.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 -- 172.21.15.96:0/1268086429 learned_addr learned my addr 172.21.15.96:0/1268086429 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:32.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 -- 172.21.15.96:0/1268086429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f77d0 msgr2=0x7fe7f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f77d0 0x7fe7f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:26:32.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.035+0000 7fe7effff700 1 -- 172.21.15.96:0/1268086429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4005040 con 0x7fe7f00f6530 2022-02-02T21:26:32.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7effff700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 secure :-1 s=READY pgs=2837 cs=0 l=1 rev1=1 rx=0x7fe7e0002700 tx=0x7fe7e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0009320 con 0x7fe7f00f6530 2022-02-02T21:26:32.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7e000f040 con 0x7fe7f00f6530 2022-02-02T21:26:32.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0014900 con 0x7fe7f00f6530 2022-02-02T21:26:32.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f006a7a0 con 0x7fe7f00f6530 2022-02-02T21:26:32.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.036+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f010ed50 con 0x7fe7f00f6530 2022-02-02T21:26:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.037+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f0045ad0 con 0x7fe7f00f6530 2022-02-02T21:26:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.037+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7e0009480 con 0x7fe7f00f6530 2022-02-02T21:26:32.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.038+0000 7fe7ecff9700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 0x7fe7d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.038+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe7e0081ff0 con 0x7fe7f00f6530 2022-02-02T21:26:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.038+0000 7fe7ef7fe700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 0x7fe7d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.038+0000 7fe7ef7fe700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 0x7fe7d80672e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7fe7e4004e30 tx=0x7fe7e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.041+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7e00501a0 con 0x7fe7f00f6530 2022-02-02T21:26:32.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.214+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7f0057f10 con 0x7fe7d8064e20 2022-02-02T21:26:32.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.223+0000 7fe7ecff9700 1 -- 172.21.15.96:0/1268086429 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe7f0057f10 con 0x7fe7d8064e20 2022-02-02T21:26:32.224 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:26:32.224 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:26:32.225 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:26:32.225 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:26:32.226 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:26:32.226 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:26:32.226 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:26:32.227 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:26:32.227 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:26:32.227 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:26:32.228 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:26:32.228 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:26:32.228 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:26:32.229 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:26:32.229 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:26:32.229 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:26:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:26:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:26:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:26:32.231 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (2h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:26:32.231 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:26:32.231 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:26:32.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 msgr2=0x7fe7d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 0x7fe7d80672e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7fe7e4004e30 tx=0x7fe7e4009b30).stop 2022-02-02T21:26:32.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 msgr2=0x7fe7f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 secure :-1 s=READY pgs=2837 cs=0 l=1 rev1=1 rx=0x7fe7e0002700 tx=0x7fe7e0009d80).stop 2022-02-02T21:26:32.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 shutdown_connections 2022-02-02T21:26:32.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe7d8064e20 0x7fe7d80672e0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7f00f6530 0x7fe7f006b9a0 unknown :-1 s=CLOSED pgs=2837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 --2- 172.21.15.96:0/1268086429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7f00f77d0 0x7fe7f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:26:32.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 >> 172.21.15.96:0/1268086429 conn(0x7fe7f00f1c90 msgr2=0x7fe7f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 shutdown_connections 2022-02-02T21:26:32.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.225+0000 7fe7f50a7700 1 -- 172.21.15.96:0/1268086429 wait complete. 2022-02-02T21:26:32.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 -- 172.21.15.96:0/3338013583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f7770 msgr2=0x7f0f580f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3338013583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f7770 0x7f0f580f7bd0 secure :-1 s=READY pgs=2838 cs=0 l=1 rev1=1 rx=0x7f0f48004660 tx=0x7f0f48009b30).stop 2022-02-02T21:26:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 -- 172.21.15.96:0/3338013583 shutdown_connections 2022-02-02T21:26:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3338013583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f7770 0x7f0f580f7bd0 unknown :-1 s=CLOSED pgs=2838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3338013583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f64d0 0x7f0f580f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:26:32.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.321+0000 7f0f5d601700 1 -- 172.21.15.96:0/3338013583 >> 172.21.15.96:0/3338013583 conn(0x7f0f580f1c30 msgr2=0x7f0f580f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.322+0000 7f0f5d601700 1 -- 172.21.15.96:0/3338013583 shutdown_connections 2022-02-02T21:26:32.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.322+0000 7f0f5d601700 1 -- 172.21.15.96:0/3338013583 wait complete. 2022-02-02T21:26:32.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.322+0000 7f0f5d601700 1 Processor -- start 2022-02-02T21:26:32.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.322+0000 7f0f5d601700 1 -- start start 2022-02-02T21:26:32.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 0x7f0f58107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581078f0 con 0x7f0f580f64d0 2022-02-02T21:26:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58108070 con 0x7f0f580f7770 2022-02-02T21:26:32.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42818/0 (socket says 172.21.15.96:42818) 2022-02-02T21:26:32.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 -- 172.21.15.96:0/3355343871 learned_addr learned my addr 172.21.15.96:0/3355343871 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f567fc700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 0x7f0f58107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 -- 172.21.15.96:0/3355343871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 msgr2=0x7f0f58107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 0x7f0f58107260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 -- 172.21.15.96:0/3355343871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48005040 con 0x7f0f580f64d0 2022-02-02T21:26:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f567fc700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 0x7f0f58107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:26:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f56ffd700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 secure :-1 s=READY pgs=2839 cs=0 l=1 rev1=1 rx=0x7f0f400093c0 tx=0x7f0f40006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f40013640 con 0x7f0f580f64d0 2022-02-02T21:26:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f581082f0 con 0x7f0f580f64d0 2022-02-02T21:26:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f40009e70 con 0x7f0f580f64d0 2022-02-02T21:26:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4000db10 con 0x7f0f580f64d0 2022-02-02T21:26:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.323+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f581088b0 con 0x7f0f580f64d0 2022-02-02T21:26:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.324+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58045ad0 con 0x7f0f580f64d0 2022-02-02T21:26:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.325+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f4001a060 con 0x7f0f580f64d0 2022-02-02T21:26:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.325+0000 7f0f4f7fe700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 0x7f0f440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.325+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0f40081bc0 con 0x7f0f580f64d0 2022-02-02T21:26:32.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.325+0000 7f0f567fc700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 0x7f0f440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.326+0000 7f0f567fc700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 0x7f0f440672e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f0f48009da0 tx=0x7f0f48009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.329+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f4004fc00 con 0x7f0f580f64d0 2022-02-02T21:26:32.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.559+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f580fedd0 con 0x7f0f580f64d0 2022-02-02T21:26:32.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.559+0000 7f0f4f7fe700 1 -- 172.21.15.96:0/3355343871 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0f400182e0 con 0x7f0f580f64d0 2022-02-02T21:26:32.560 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:26:32.561 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:26:32.562 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:26:32.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:32.562 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:26:32.563 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:26:32.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:32.563 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:26:32.564 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:26:32.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:32.564 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:26:32.565 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:26:32.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:26:32.565 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:26:32.566 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:26:32.566 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:26:32.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:26:32.567 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:26:32.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 msgr2=0x7f0f440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 0x7f0f440672e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f0f48009da0 tx=0x7f0f48009b30).stop 2022-02-02T21:26:32.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 msgr2=0x7f0f58106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 secure :-1 s=READY pgs=2839 cs=0 l=1 rev1=1 rx=0x7f0f400093c0 tx=0x7f0f40006eb0).stop 2022-02-02T21:26:32.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 shutdown_connections 2022-02-02T21:26:32.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f44064e20 0x7f0f440672e0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f580f64d0 0x7f0f58106d70 unknown :-1 s=CLOSED pgs=2839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 --2- 172.21.15.96:0/3355343871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f580f7770 0x7f0f58107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 >> 172.21.15.96:0/3355343871 conn(0x7f0f580f1c30 msgr2=0x7f0f580fb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 shutdown_connections 2022-02-02T21:26:32.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.561+0000 7f0f5d601700 1 -- 172.21.15.96:0/3355343871 wait complete. 2022-02-02T21:26:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- 172.21.15.96:0/1237759748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f7980 msgr2=0x7fd9040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 --2- 172.21.15.96:0/1237759748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f7980 0x7fd9040f7de0 secure :-1 s=READY pgs=2840 cs=0 l=1 rev1=1 rx=0x7fd8f4004660 tx=0x7fd8f4009b30).stop 2022-02-02T21:26:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- 172.21.15.96:0/1237759748 shutdown_connections 2022-02-02T21:26:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 --2- 172.21.15.96:0/1237759748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f7980 0x7fd9040f7de0 unknown :-1 s=CLOSED pgs=2840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 --2- 172.21.15.96:0/1237759748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f66e0 0x7fd9040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- 172.21.15.96:0/1237759748 >> 172.21.15.96:0/1237759748 conn(0x7fd9040f1e40 msgr2=0x7fd9040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- 172.21.15.96:0/1237759748 shutdown_connections 2022-02-02T21:26:32.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- 172.21.15.96:0/1237759748 wait complete. 2022-02-02T21:26:32.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 Processor -- start 2022-02-02T21:26:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.659+0000 7fd90be4e700 1 -- start start 2022-02-02T21:26:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd90be4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd90be4e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f7980 0x7fd904107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd90be4e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904107a00 con 0x7fd9040f66e0 2022-02-02T21:26:32.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd90be4e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904107b40 con 0x7fd9040f7980 2022-02-02T21:26:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42828/0 (socket says 172.21.15.96:42828) 2022-02-02T21:26:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 -- 172.21.15.96:0/3849519245 learned_addr learned my addr 172.21.15.96:0/3849519245 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:26:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd9093e9700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f7980 0x7fd904107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 -- 172.21.15.96:0/3849519245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f7980 msgr2=0x7fd904107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f7980 0x7fd904107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 -- 172.21.15.96:0/3849519245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4005040 con 0x7fd9040f66e0 2022-02-02T21:26:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd909bea700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 secure :-1 s=READY pgs=2841 cs=0 l=1 rev1=1 rx=0x7fd90000c530 tx=0x7fd900007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.660+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90000f650 con 0x7fd9040f66e0 2022-02-02T21:26:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.661+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd90000fc60 con 0x7fd9040f66e0 2022-02-02T21:26:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.661+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9041084e0 con 0x7fd9040f66e0 2022-02-02T21:26:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.661+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd900012cb0 con 0x7fd9040f66e0 2022-02-02T21:26:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.661+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd904108aa0 con 0x7fd9040f66e0 2022-02-02T21:26:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.662+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904045ad0 con 0x7fd9040f66e0 2022-02-02T21:26:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.662+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd900019030 con 0x7fd9040f66e0 2022-02-02T21:26:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.662+0000 7fd8fa7fc700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 0x7fd8f006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:26:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.663+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd900081650 con 0x7fd9040f66e0 2022-02-02T21:26:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.663+0000 7fd9093e9700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 0x7fd8f006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:26:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.663+0000 7fd9093e9700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 0x7fd8f006b6a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fd8f4004630 tx=0x7fd8f4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:26:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.667+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd900053230 con 0x7fd9040f66e0 2022-02-02T21:26:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.869+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9040fefa0 con 0x7fd9040f66e0 2022-02-02T21:26:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.869+0000 7fd8fa7fc700 1 -- 172.21.15.96:0/3849519245 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd900017070 con 0x7fd9040f66e0 2022-02-02T21:26:32.872 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:26:32.873 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:26:32.873 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:26:32.874 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:26:32.874 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:32.875 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:26:32.876 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:26:32.876 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:26:32.877 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:26:32.877 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:26:32.878 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:26:32.879 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:26:32.879 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:26:32.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:26:32.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:26:32.881 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:26:32.881 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:26:32.881 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:26:32.882 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:26:32.882 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:26:32.882 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:26:32.883 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:26:32.883 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:26:32.883 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:26:32.884 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:26:32.884 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:26:32.884 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:26:32.885 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:26:32.885 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:26:32.885 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:26:32.886 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:26:32.886 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:26:32.886 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:32.887 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:32.887 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:26:32.887 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:26:32.888 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:32.888 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:32.888 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:26:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 msgr2=0x7fd8f006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 0x7fd8f006b6a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fd8f4004630 tx=0x7fd8f4009b30).stop 2022-02-02T21:26:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 msgr2=0x7fd904106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:26:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 secure :-1 s=READY pgs=2841 cs=0 l=1 rev1=1 rx=0x7fd90000c530 tx=0x7fd900007e10).stop 2022-02-02T21:26:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 shutdown_connections 2022-02-02T21:26:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8f00691e0 0x7fd8f006b6a0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9040f66e0 0x7fd904106f60 unknown :-1 s=CLOSED pgs=2841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 --2- 172.21.15.96:0/3849519245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9040f7980 0x7fd904107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:26:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 >> 172.21.15.96:0/3849519245 conn(0x7fd9040f1e40 msgr2=0x7fd9040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:26:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 shutdown_connections 2022-02-02T21:26:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:26:32.871+0000 7fd90be4e700 1 -- 172.21.15.96:0/3849519245 wait complete. 2022-02-02T21:26:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:26:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:33 smithi159 ceph-mon[69013]: from='client.39778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:33 smithi159 ceph-mon[69013]: pgmap v5533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:33 smithi159 ceph-mon[69013]: from='client.39782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3355343871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:26:33.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3849519245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:26:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:33 smithi096 ceph-mon[101353]: from='client.39778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:33.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:33 smithi096 ceph-mon[101353]: pgmap v5533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:33 smithi096 ceph-mon[101353]: from='client.39782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:26:33.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3355343871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:26:33.558 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3849519245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:26:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:35 smithi159 ceph-mon[69013]: pgmap v5534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:35 smithi096 ceph-mon[101353]: pgmap v5534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:37 smithi159 ceph-mon[69013]: pgmap v5535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:37 smithi096 ceph-mon[101353]: pgmap v5535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:38 smithi159 ceph-mon[69013]: pgmap v5536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:38 smithi096 ceph-mon[101353]: pgmap v5536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:41 smithi159 ceph-mon[69013]: pgmap v5537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:41 smithi096 ceph-mon[101353]: pgmap v5537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:43 smithi159 ceph-mon[69013]: pgmap v5538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:43 smithi096 ceph-mon[101353]: pgmap v5538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:45 smithi159 ceph-mon[69013]: pgmap v5539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:45 smithi096 ceph-mon[101353]: pgmap v5539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:47 smithi159 ceph-mon[69013]: pgmap v5540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:47 smithi096 ceph-mon[101353]: pgmap v5540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:48 smithi096 ceph-mon[101353]: pgmap v5541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:48 smithi159 ceph-mon[69013]: pgmap v5541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:51 smithi159 ceph-mon[69013]: pgmap v5542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:51 smithi096 ceph-mon[101353]: pgmap v5542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:53 smithi159 ceph-mon[69013]: pgmap v5543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:53 smithi096 ceph-mon[101353]: pgmap v5543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:55 smithi159 ceph-mon[69013]: pgmap v5544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:55 smithi096 ceph-mon[101353]: pgmap v5544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:57 smithi159 ceph-mon[69013]: pgmap v5545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:57 smithi096 ceph-mon[101353]: pgmap v5545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:26:58 smithi096 ceph-mon[101353]: pgmap v5546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:26:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:26:58 smithi159 ceph-mon[69013]: pgmap v5546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:01 smithi159 ceph-mon[69013]: pgmap v5547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:01 smithi096 ceph-mon[101353]: pgmap v5547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:02.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 -- 172.21.15.96:0/3497891856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 msgr2=0x7f1c740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:02.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3497891856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f59e0 secure :-1 s=READY pgs=2842 cs=0 l=1 rev1=1 rx=0x7f1c64004660 tx=0x7f1c64009b30).stop 2022-02-02T21:27:02.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 -- 172.21.15.96:0/3497891856 shutdown_connections 2022-02-02T21:27:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3497891856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 0x7f1c740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3497891856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f59e0 unknown :-1 s=CLOSED pgs=2842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.980+0000 7f1c7a190700 1 -- 172.21.15.96:0/3497891856 >> 172.21.15.96:0/3497891856 conn(0x7f1c740f0d40 msgr2=0x7f1c740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.981+0000 7f1c7a190700 1 -- 172.21.15.96:0/3497891856 shutdown_connections 2022-02-02T21:27:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.981+0000 7f1c7a190700 1 -- 172.21.15.96:0/3497891856 wait complete. 2022-02-02T21:27:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.981+0000 7f1c7a190700 1 Processor -- start 2022-02-02T21:27:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.981+0000 7f1c7a190700 1 -- start start 2022-02-02T21:27:02.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:02.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 0x7f1c740f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:02.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740f8100 con 0x7f1c740f55c0 2022-02-02T21:27:02.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740f8240 con 0x7f1c740f6860 2022-02-02T21:27:02.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42852/0 (socket says 172.21.15.96:42852) 2022-02-02T21:27:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 -- 172.21.15.96:0/3413311020 learned_addr learned my addr 172.21.15.96:0/3413311020 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 0x7f1c740f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 -- 172.21.15.96:0/3413311020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 msgr2=0x7f1c740f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 0x7f1c740f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 -- 172.21.15.96:0/3413311020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64005040 con 0x7f1c740f55c0 2022-02-02T21:27:02.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c737fe700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 secure :-1 s=READY pgs=2843 cs=0 l=1 rev1=1 rx=0x7f1c64013a70 tx=0x7f1c64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:02.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c64018070 con 0x7f1c740f55c0 2022-02-02T21:27:02.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c740f84c0 con 0x7f1c740f55c0 2022-02-02T21:27:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c640097d0 con 0x7f1c740f55c0 2022-02-02T21:27:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6401c3c0 con 0x7f1c740f55c0 2022-02-02T21:27:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.982+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c740f8a20 con 0x7f1c740f55c0 2022-02-02T21:27:02.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.983+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c74045ad0 con 0x7f1c740f55c0 2022-02-02T21:27:02.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.984+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c64007ba0 con 0x7f1c740f55c0 2022-02-02T21:27:02.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.984+0000 7f1c5bfff700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:02.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.984+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c64083800 con 0x7f1c740f55c0 2022-02-02T21:27:02.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.984+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:02.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.985+0000 7f1c72ffd700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f1c68004b00 tx=0x7f1c6800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:02.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:02.989+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c64051900 con 0x7f1c740f55c0 2022-02-02T21:27:03.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.165+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c740faca0 con 0x7f1c5c064dd0 2022-02-02T21:27:03.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.166+0000 7f1c5bfff700 1 -- 172.21.15.96:0/3413311020 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1c740faca0 con 0x7f1c5c064dd0 2022-02-02T21:27:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 msgr2=0x7f1c5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f1c68004b00 tx=0x7f1c6800b040).stop 2022-02-02T21:27:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 msgr2=0x7f1c740f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 secure :-1 s=READY pgs=2843 cs=0 l=1 rev1=1 rx=0x7f1c64013a70 tx=0x7f1c64009b30).stop 2022-02-02T21:27:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 shutdown_connections 2022-02-02T21:27:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c5c064dd0 0x7f1c5c067290 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c740f55c0 0x7f1c740f9720 unknown :-1 s=CLOSED pgs=2843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 --2- 172.21.15.96:0/3413311020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c740f6860 0x7f1c740f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 >> 172.21.15.96:0/3413311020 conn(0x7f1c740f0d40 msgr2=0x7f1c7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 shutdown_connections 2022-02-02T21:27:03.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.168+0000 7f1c7a190700 1 -- 172.21.15.96:0/3413311020 wait complete. 2022-02-02T21:27:03.179 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:27:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:03 smithi096 ceph-mon[101353]: pgmap v5548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:03.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.268+0000 7f79f2e3e700 1 -- 172.21.15.96:0/1597670546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f7980 msgr2=0x7f79ec0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.268+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/1597670546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f7980 0x7f79ec0f7de0 secure :-1 s=READY pgs=2844 cs=0 l=1 rev1=1 rx=0x7f79d8004660 tx=0x7f79d8009b30).stop 2022-02-02T21:27:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 -- 172.21.15.96:0/1597670546 shutdown_connections 2022-02-02T21:27:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/1597670546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f7980 0x7f79ec0f7de0 unknown :-1 s=CLOSED pgs=2844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/1597670546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f66e0 0x7f79ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 -- 172.21.15.96:0/1597670546 >> 172.21.15.96:0/1597670546 conn(0x7f79ec0f1e40 msgr2=0x7f79ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 -- 172.21.15.96:0/1597670546 shutdown_connections 2022-02-02T21:27:03.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 -- 172.21.15.96:0/1597670546 wait complete. 2022-02-02T21:27:03.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 Processor -- start 2022-02-02T21:27:03.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.269+0000 7f79f2e3e700 1 -- start start 2022-02-02T21:27:03.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 0x7f79ec107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec1079b0 con 0x7f79ec0f66e0 2022-02-02T21:27:03.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec107af0 con 0x7f79ec0f7980 2022-02-02T21:27:03.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42862/0 (socket says 172.21.15.96:42862) 2022-02-02T21:27:03.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 -- 172.21.15.96:0/2347994506 learned_addr learned my addr 172.21.15.96:0/2347994506 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:03.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79ebfff700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 0x7f79ec107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 -- 172.21.15.96:0/2347994506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 msgr2=0x7f79ec107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 0x7f79ec107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 -- 172.21.15.96:0/2347994506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8005040 con 0x7f79ec0f66e0 2022-02-02T21:27:03.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79ebfff700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 0x7f79ec107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:27:03.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f0bda700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 secure :-1 s=READY pgs=2845 cs=0 l=1 rev1=1 rx=0x7f79e000e7c0 tx=0x7f79e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e00092e0 con 0x7f79ec0f66e0 2022-02-02T21:27:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79e000f040 con 0x7f79ec0f66e0 2022-02-02T21:27:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e0014750 con 0x7f79ec0f66e0 2022-02-02T21:27:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec108490 con 0x7f79ec0f66e0 2022-02-02T21:27:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.270+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec108a50 con 0x7f79ec0f66e0 2022-02-02T21:27:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.272+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec045ad0 con 0x7f79ec0f66e0 2022-02-02T21:27:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.272+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f79e001b030 con 0x7f79ec0f66e0 2022-02-02T21:27:03.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.272+0000 7f79e97fa700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 0x7f79dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.272+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f79e00819f0 con 0x7f79ec0f66e0 2022-02-02T21:27:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.272+0000 7f79ebfff700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 0x7f79dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.273+0000 7f79ebfff700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 0x7f79dc067290 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f79d8004d80 tx=0x7f79d800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.276+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79e0083e60 con 0x7f79ec0f66e0 2022-02-02T21:27:03.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.448+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79ec108cc0 con 0x7f79dc064dd0 2022-02-02T21:27:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.457+0000 7f79e97fa700 1 -- 172.21.15.96:0/2347994506 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f79ec108cc0 con 0x7f79dc064dd0 2022-02-02T21:27:03.459 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:27:03.459 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:27:03.459 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:27:03.460 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:27:03.460 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:27:03.460 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:27:03.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:27:03.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:27:03.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:27:03.462 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:27:03.462 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:27:03.462 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:27:03.463 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:27:03.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:27:03.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:27:03.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:27:03.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:27:03.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:27:03.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:27:03.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:27:03.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (2h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:27:03.466 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:27:03.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:03 smithi159 ceph-mon[69013]: pgmap v5548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 msgr2=0x7f79dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 0x7f79dc067290 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f79d8004d80 tx=0x7f79d800b040).stop 2022-02-02T21:27:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 msgr2=0x7f79ec106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 secure :-1 s=READY pgs=2845 cs=0 l=1 rev1=1 rx=0x7f79e000e7c0 tx=0x7f79e000b040).stop 2022-02-02T21:27:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 shutdown_connections 2022-02-02T21:27:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79dc064dd0 0x7f79dc067290 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79ec0f66e0 0x7f79ec106f10 unknown :-1 s=CLOSED pgs=2845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 --2- 172.21.15.96:0/2347994506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79ec0f7980 0x7f79ec107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 >> 172.21.15.96:0/2347994506 conn(0x7f79ec0f1e40 msgr2=0x7f79ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 shutdown_connections 2022-02-02T21:27:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.459+0000 7f79f2e3e700 1 -- 172.21.15.96:0/2347994506 wait complete. 2022-02-02T21:27:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 -- 172.21.15.96:0/238525096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 msgr2=0x7f3afc0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 --2- 172.21.15.96:0/238525096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc0f7000 secure :-1 s=READY pgs=2846 cs=0 l=1 rev1=1 rx=0x7f3af8004660 tx=0x7f3af8009b30).stop 2022-02-02T21:27:03.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 -- 172.21.15.96:0/238525096 shutdown_connections 2022-02-02T21:27:03.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 --2- 172.21.15.96:0/238525096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 0x7f3afc0f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 --2- 172.21.15.96:0/238525096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc0f7000 unknown :-1 s=CLOSED pgs=2846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.555+0000 7f3b0336c700 1 -- 172.21.15.96:0/238525096 >> 172.21.15.96:0/238525096 conn(0x7f3afc0f04c0 msgr2=0x7f3afc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.556+0000 7f3b0336c700 1 -- 172.21.15.96:0/238525096 shutdown_connections 2022-02-02T21:27:03.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.556+0000 7f3b0336c700 1 -- 172.21.15.96:0/238525096 wait complete. 2022-02-02T21:27:03.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.556+0000 7f3b0336c700 1 Processor -- start 2022-02-02T21:27:03.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.556+0000 7f3b0336c700 1 -- start start 2022-02-02T21:27:03.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.556+0000 7f3b0336c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 0x7f3afc105f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b0336c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b0336c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1069c0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b0336c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc106b00 con 0x7f3afc0f5930 2022-02-02T21:27:03.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42872/0 (socket says 172.21.15.96:42872) 2022-02-02T21:27:03.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 -- 172.21.15.96:0/556361287 learned_addr learned my addr 172.21.15.96:0/556361287 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:03.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b01108700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 0x7f3afc105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 -- 172.21.15.96:0/556361287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 msgr2=0x7f3afc105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 0x7f3afc105f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 -- 172.21.15.96:0/556361287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8005040 con 0x7f3afc0f6be0 2022-02-02T21:27:03.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b00907700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 secure :-1 s=READY pgs=2847 cs=0 l=1 rev1=1 rx=0x7f3aec002700 tx=0x7f3aec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aec0079c0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc1074a0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3aec00f040 con 0x7f3afc0f6be0 2022-02-02T21:27:03.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.557+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aec014860 con 0x7f3afc0f6be0 2022-02-02T21:27:03.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.558+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc107a60 con 0x7f3afc0f6be0 2022-02-02T21:27:03.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.558+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc045ad0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.559+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3aec01b060 con 0x7f3afc0f6be0 2022-02-02T21:27:03.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.559+0000 7f3af1ffb700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 0x7f3ae8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.560+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3aec0819a0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.560+0000 7f3b01108700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 0x7f3ae8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.560+0000 7f3b01108700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 0x7f3ae8067290 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3af8004630 tx=0x7f3af8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.564+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3aec053410 con 0x7f3afc0f6be0 2022-02-02T21:27:03.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.792+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3afc0ff890 con 0x7f3afc0f6be0 2022-02-02T21:27:03.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.793+0000 7f3af1ffb700 1 -- 172.21.15.96:0/556361287 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3aec0192e0 con 0x7f3afc0f6be0 2022-02-02T21:27:03.796 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:27:03.796 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:27:03.797 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:27:03.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:03.797 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:27:03.798 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:27:03.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:03.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:27:03.799 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:27:03.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:03.799 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:27:03.800 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:27:03.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:03.800 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:27:03.801 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:27:03.801 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:27:03.801 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:27:03.802 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:27:03.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 msgr2=0x7f3ae8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 0x7f3ae8067290 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3af8004630 tx=0x7f3af8009b30).stop 2022-02-02T21:27:03.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 msgr2=0x7f3afc106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 secure :-1 s=READY pgs=2847 cs=0 l=1 rev1=1 rx=0x7f3aec002700 tx=0x7f3aec009d80).stop 2022-02-02T21:27:03.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 shutdown_connections 2022-02-02T21:27:03.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3ae8064dd0 0x7f3ae8067290 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3afc0f5930 0x7f3afc105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 --2- 172.21.15.96:0/556361287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0f6be0 0x7f3afc106410 unknown :-1 s=CLOSED pgs=2847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 >> 172.21.15.96:0/556361287 conn(0x7f3afc0f04c0 msgr2=0x7f3afc0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 shutdown_connections 2022-02-02T21:27:03.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.795+0000 7f3b0336c700 1 -- 172.21.15.96:0/556361287 wait complete. 2022-02-02T21:27:03.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 -- 172.21.15.96:0/1002675411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f55d0 msgr2=0x7f93c80f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/1002675411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f55d0 0x7f93c80f59f0 secure :-1 s=READY pgs=2848 cs=0 l=1 rev1=1 rx=0x7f93bc004660 tx=0x7f93bc009b30).stop 2022-02-02T21:27:03.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 -- 172.21.15.96:0/1002675411 shutdown_connections 2022-02-02T21:27:03.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/1002675411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f6870 0x7f93c80f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/1002675411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f55d0 0x7f93c80f59f0 unknown :-1 s=CLOSED pgs=2848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 -- 172.21.15.96:0/1002675411 >> 172.21.15.96:0/1002675411 conn(0x7f93c80f0d70 msgr2=0x7f93c80f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:03.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.893+0000 7f93cdcc7700 1 -- 172.21.15.96:0/1002675411 shutdown_connections 2022-02-02T21:27:03.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 -- 172.21.15.96:0/1002675411 wait complete. 2022-02-02T21:27:03.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 Processor -- start 2022-02-02T21:27:03.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 -- start start 2022-02-02T21:27:03.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f55d0 0x7f93c8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8107a00 con 0x7f93c80f6870 2022-02-02T21:27:03.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.895+0000 7f93cdcc7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8107b40 con 0x7f93c80f55d0 2022-02-02T21:27:03.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42882/0 (socket says 172.21.15.96:42882) 2022-02-02T21:27:03.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 -- 172.21.15.96:0/3070126680 learned_addr learned my addr 172.21.15.96:0/3070126680 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:03.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c77fe700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f55d0 0x7f93c8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 -- 172.21.15.96:0/3070126680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f55d0 msgr2=0x7f93c8106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:03.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f55d0 0x7f93c8106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:03.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 -- 172.21.15.96:0/3070126680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc005040 con 0x7f93c80f6870 2022-02-02T21:27:03.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93c6ffd700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 secure :-1 s=READY pgs=2849 cs=0 l=1 rev1=1 rx=0x7f93b800c510 tx=0x7f93b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b800f650 con 0x7f93c80f6870 2022-02-02T21:27:03.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c81084e0 con 0x7f93c80f6870 2022-02-02T21:27:03.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93b800fc60 con 0x7f93c80f6870 2022-02-02T21:27:03.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b8012c50 con 0x7f93c80f6870 2022-02-02T21:27:03.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.896+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c8108aa0 con 0x7f93c80f6870 2022-02-02T21:27:03.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.897+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c8045ad0 con 0x7f93c80f6870 2022-02-02T21:27:03.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.898+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93b8010070 con 0x7f93c80f6870 2022-02-02T21:27:03.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.898+0000 7f93affff700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 0x7f93b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.898+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93b8081780 con 0x7f93c80f6870 2022-02-02T21:27:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.898+0000 7f93c77fe700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 0x7f93b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:03.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.899+0000 7f93c77fe700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 0x7f93b0067290 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f93bc004630 tx=0x7f93bc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:03.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:03.902+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93b80532b0 con 0x7f93c80f6870 2022-02-02T21:27:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.102+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93c810d580 con 0x7f93c80f6870 2022-02-02T21:27:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.102+0000 7f93affff700 1 -- 172.21.15.96:0/3070126680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f93b8052ea0 con 0x7f93c80f6870 2022-02-02T21:27:04.105 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:27:04.105 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:27:04.106 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:27:04.106 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:27:04.106 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:04.107 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:27:04.107 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:27:04.107 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:27:04.108 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:27:04.108 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:27:04.108 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:27:04.109 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:27:04.109 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:27:04.109 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:27:04.110 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:27:04.110 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:27:04.110 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:27:04.111 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:27:04.111 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:27:04.111 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:27:04.112 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:27:04.112 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:27:04.113 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:27:04.113 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:27:04.113 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:27:04.114 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:27:04.114 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:27:04.114 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:27:04.115 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:27:04.115 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:27:04.116 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:27:04.116 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:27:04.116 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:04.117 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:04.117 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:27:04.117 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:04.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:04.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:04.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 msgr2=0x7f93b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 0x7f93b0067290 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f93bc004630 tx=0x7f93bc009b30).stop 2022-02-02T21:27:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 msgr2=0x7f93c8107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 secure :-1 s=READY pgs=2849 cs=0 l=1 rev1=1 rx=0x7f93b800c510 tx=0x7f93b8007e00).stop 2022-02-02T21:27:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 shutdown_connections 2022-02-02T21:27:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b0064dd0 0x7f93b0067290 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c80f55d0 0x7f93c8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:04.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 --2- 172.21.15.96:0/3070126680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93c80f6870 0x7f93c8107450 unknown :-1 s=CLOSED pgs=2849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 >> 172.21.15.96:0/3070126680 conn(0x7f93c80f0d70 msgr2=0x7f93c805ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 shutdown_connections 2022-02-02T21:27:04.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:04.104+0000 7f93cdcc7700 1 -- 172.21.15.96:0/3070126680 wait complete. 2022-02-02T21:27:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:27:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:04 smithi159 ceph-mon[69013]: from='client.39794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/556361287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:27:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3070126680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:27:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:04 smithi096 ceph-mon[101353]: from='client.39794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/556361287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:27:04.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3070126680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:27:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:05 smithi159 ceph-mon[69013]: from='client.39798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:05.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:05 smithi159 ceph-mon[69013]: pgmap v5549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:05 smithi096 ceph-mon[101353]: from='client.39798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:05 smithi096 ceph-mon[101353]: pgmap v5549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:07 smithi159 ceph-mon[69013]: pgmap v5550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:07 smithi096 ceph-mon[101353]: pgmap v5550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:08 smithi096 ceph-mon[101353]: pgmap v5551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:08 smithi159 ceph-mon[69013]: pgmap v5551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:11 smithi159 ceph-mon[69013]: pgmap v5552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:11 smithi096 ceph-mon[101353]: pgmap v5552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:13 smithi159 ceph-mon[69013]: pgmap v5553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:13 smithi096 ceph-mon[101353]: pgmap v5553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:15 smithi159 ceph-mon[69013]: pgmap v5554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:15 smithi096 ceph-mon[101353]: pgmap v5554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:17 smithi159 ceph-mon[69013]: pgmap v5555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:17 smithi096 ceph-mon[101353]: pgmap v5555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:18 smithi096 ceph-mon[101353]: pgmap v5556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:18 smithi159 ceph-mon[69013]: pgmap v5556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:21 smithi159 ceph-mon[69013]: pgmap v5557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:21 smithi096 ceph-mon[101353]: pgmap v5557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:23 smithi159 ceph-mon[69013]: pgmap v5558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:23 smithi096 ceph-mon[101353]: pgmap v5558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:25 smithi159 ceph-mon[69013]: pgmap v5559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:25 smithi096 ceph-mon[101353]: pgmap v5559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:27 smithi159 ceph-mon[69013]: pgmap v5560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:27 smithi096 ceph-mon[101353]: pgmap v5560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:27:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:27:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:28 smithi096 ceph-mon[101353]: pgmap v5561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:27:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:27:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:28 smithi159 ceph-mon[69013]: pgmap v5561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:31 smithi159 ceph-mon[69013]: pgmap v5562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:31 smithi096 ceph-mon[101353]: pgmap v5562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:33 smithi159 ceph-mon[69013]: pgmap v5563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:33 smithi096 ceph-mon[101353]: pgmap v5563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:34.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 -- 172.21.15.96:0/2274574162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 msgr2=0x7f221c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 --2- 172.21.15.96:0/2274574162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c0f6cc0 secure :-1 s=READY pgs=2850 cs=0 l=1 rev1=1 rx=0x7f2204004660 tx=0x7f2204009b30).stop 2022-02-02T21:27:34.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 -- 172.21.15.96:0/2274574162 shutdown_connections 2022-02-02T21:27:34.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 --2- 172.21.15.96:0/2274574162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c0f6cc0 unknown :-1 s=CLOSED pgs=2850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 --2- 172.21.15.96:0/2274574162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 0x7f221c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 -- 172.21.15.96:0/2274574162 >> 172.21.15.96:0/2274574162 conn(0x7f221c0f0d40 msgr2=0x7f221c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:34.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 -- 172.21.15.96:0/2274574162 shutdown_connections 2022-02-02T21:27:34.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.218+0000 7f2222ee0700 1 -- 172.21.15.96:0/2274574162 wait complete. 2022-02-02T21:27:34.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 Processor -- start 2022-02-02T21:27:34.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 -- start start 2022-02-02T21:27:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 0x7f221c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1069b0 con 0x7f221c0f6860 2022-02-02T21:27:34.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.219+0000 7f2222ee0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1071c0 con 0x7f221c0f55c0 2022-02-02T21:27:34.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42902/0 (socket says 172.21.15.96:42902) 2022-02-02T21:27:34.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 -- 172.21.15.96:0/526714278 learned_addr learned my addr 172.21.15.96:0/526714278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:34.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f2220c7c700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 0x7f221c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 -- 172.21.15.96:0/526714278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 msgr2=0x7f221c105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 0x7f221c105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 -- 172.21.15.96:0/526714278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204005040 con 0x7f221c0f6860 2022-02-02T21:27:34.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f221bfff700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 secure :-1 s=READY pgs=2851 cs=0 l=1 rev1=1 rx=0x7f2204009990 tx=0x7f2204009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2204018070 con 0x7f221c0f6860 2022-02-02T21:27:34.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2204007ba0 con 0x7f221c0f6860 2022-02-02T21:27:34.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c1073e0 con 0x7f221c0f6860 2022-02-02T21:27:34.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f220401c3c0 con 0x7f221c0f6860 2022-02-02T21:27:34.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.220+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c107940 con 0x7f221c0f6860 2022-02-02T21:27:34.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.221+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c0f49b0 con 0x7f221c0f6860 2022-02-02T21:27:34.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.222+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f220401d420 con 0x7f221c0f6860 2022-02-02T21:27:34.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.222+0000 7f22197fa700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 0x7f2208067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.222+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22040836b0 con 0x7f221c0f6860 2022-02-02T21:27:34.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.222+0000 7f2220c7c700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 0x7f2208067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.223+0000 7f2220c7c700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 0x7f2208067290 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f221c105c30 tx=0x7f2214009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.226+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2204051810 con 0x7f221c0f6860 2022-02-02T21:27:34.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.404+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f221c0fdef0 con 0x7f2208064dd0 2022-02-02T21:27:34.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.405+0000 7f22197fa700 1 -- 172.21.15.96:0/526714278 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f221c0fdef0 con 0x7f2208064dd0 2022-02-02T21:27:34.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 msgr2=0x7f2208067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 0x7f2208067290 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f221c105c30 tx=0x7f2214009040).stop 2022-02-02T21:27:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 msgr2=0x7f221c1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 secure :-1 s=READY pgs=2851 cs=0 l=1 rev1=1 rx=0x7f2204009990 tx=0x7f2204009b30).stop 2022-02-02T21:27:34.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 shutdown_connections 2022-02-02T21:27:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2208064dd0 0x7f2208067290 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f221c0f55c0 0x7f221c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 --2- 172.21.15.96:0/526714278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f221c0f6860 0x7f221c1063b0 unknown :-1 s=CLOSED pgs=2851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 >> 172.21.15.96:0/526714278 conn(0x7f221c0f0d40 msgr2=0x7f221c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:34.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 shutdown_connections 2022-02-02T21:27:34.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.407+0000 7f2222ee0700 1 -- 172.21.15.96:0/526714278 wait complete. 2022-02-02T21:27:34.417 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:27:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 -- 172.21.15.96:0/2257446165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 msgr2=0x7f55c80fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 --2- 172.21.15.96:0/2257446165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80fbc70 secure :-1 s=READY pgs=2852 cs=0 l=1 rev1=1 rx=0x7f55c4004660 tx=0x7f55c4009b30).stop 2022-02-02T21:27:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 -- 172.21.15.96:0/2257446165 shutdown_connections 2022-02-02T21:27:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 --2- 172.21.15.96:0/2257446165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80fbc70 unknown :-1 s=CLOSED pgs=2852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 --2- 172.21.15.96:0/2257446165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 -- 172.21.15.96:0/2257446165 >> 172.21.15.96:0/2257446165 conn(0x7f55c80f0d40 msgr2=0x7f55c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:34.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 -- 172.21.15.96:0/2257446165 shutdown_connections 2022-02-02T21:27:34.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.506+0000 7f55d0140700 1 -- 172.21.15.96:0/2257446165 wait complete. 2022-02-02T21:27:34.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 Processor -- start 2022-02-02T21:27:34.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 -- start start 2022-02-02T21:27:34.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80f5760 con 0x7f55c80f9880 2022-02-02T21:27:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55d0140700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80f58a0 con 0x7f55c80602b0 2022-02-02T21:27:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55cd6db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55cd6db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42910/0 (socket says 172.21.15.96:42910) 2022-02-02T21:27:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55cd6db700 1 -- 172.21.15.96:0/1140547032 learned_addr learned my addr 172.21.15.96:0/1140547032 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.507+0000 7f55cdedc700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55cd6db700 1 -- 172.21.15.96:0/1140547032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 msgr2=0x7f55c80f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55cd6db700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55cd6db700 1 -- 172.21.15.96:0/1140547032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4005040 con 0x7f55c80f9880 2022-02-02T21:27:34.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55cdedc700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:27:34.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55cd6db700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 secure :-1 s=READY pgs=2853 cs=0 l=1 rev1=1 rx=0x7f55c4004f60 tx=0x7f55c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c4018070 con 0x7f55c80f9880 2022-02-02T21:27:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55c4007ba0 con 0x7f55c80f9880 2022-02-02T21:27:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80f5b20 con 0x7f55c80f9880 2022-02-02T21:27:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c80f6080 con 0x7f55c80f9880 2022-02-02T21:27:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.508+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c401c620 con 0x7f55c80f9880 2022-02-02T21:27:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.509+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b0004fa0 con 0x7f55c80f9880 2022-02-02T21:27:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.509+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55c401d420 con 0x7f55c80f9880 2022-02-02T21:27:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.510+0000 7f55be7fc700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 0x7f55b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.510+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55c40837d0 con 0x7f55c80f9880 2022-02-02T21:27:34.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.510+0000 7f55cdedc700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 0x7f55b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.510+0000 7f55cdedc700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 0x7f55b4067290 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f55b80041d0 tx=0x7f55b8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.514+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55c40518d0 con 0x7f55c80f9880 2022-02-02T21:27:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.686+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55b0000bc0 con 0x7f55b4064dd0 2022-02-02T21:27:34.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.696+0000 7f55be7fc700 1 -- 172.21.15.96:0/1140547032 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f55b0000bc0 con 0x7f55b4064dd0 2022-02-02T21:27:34.696 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:27:34.697 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:27:34.697 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:27:34.697 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:27:34.698 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:27:34.698 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:27:34.699 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:27:34.699 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:27:34.699 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:27:34.700 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:27:34.700 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:27:34.700 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:27:34.701 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:27:34.701 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:27:34.701 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:27:34.702 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:27:34.702 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:27:34.703 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:27:34.703 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:27:34.703 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:27:34.704 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:27:34.704 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:27:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 msgr2=0x7f55b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 0x7f55b4067290 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f55b80041d0 tx=0x7f55b8009040).stop 2022-02-02T21:27:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 msgr2=0x7f55c80f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 secure :-1 s=READY pgs=2853 cs=0 l=1 rev1=1 rx=0x7f55c4004f60 tx=0x7f55c4009b30).stop 2022-02-02T21:27:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 shutdown_connections 2022-02-02T21:27:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064dd0 0x7f55b4067290 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80602b0 0x7f55c80f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 --2- 172.21.15.96:0/1140547032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f9880 0x7f55c80f5200 unknown :-1 s=CLOSED pgs=2853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 >> 172.21.15.96:0/1140547032 conn(0x7f55c80f0d40 msgr2=0x7f55c80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:34.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 shutdown_connections 2022-02-02T21:27:34.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.698+0000 7f55d0140700 1 -- 172.21.15.96:0/1140547032 wait complete. 2022-02-02T21:27:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 -- 172.21.15.96:0/3128937224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f55c0 msgr2=0x7f26e80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3128937224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f55c0 0x7f26e80f59e0 secure :-1 s=READY pgs=2854 cs=0 l=1 rev1=1 rx=0x7f26dc004660 tx=0x7f26dc009b30).stop 2022-02-02T21:27:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 -- 172.21.15.96:0/3128937224 shutdown_connections 2022-02-02T21:27:34.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3128937224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f6860 0x7f26e80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3128937224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f55c0 0x7f26e80f59e0 unknown :-1 s=CLOSED pgs=2854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 -- 172.21.15.96:0/3128937224 >> 172.21.15.96:0/3128937224 conn(0x7f26e80f0d40 msgr2=0x7f26e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 -- 172.21.15.96:0/3128937224 shutdown_connections 2022-02-02T21:27:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.795+0000 7f26eea6f700 1 -- 172.21.15.96:0/3128937224 wait complete. 2022-02-02T21:27:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 Processor -- start 2022-02-02T21:27:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 -- start start 2022-02-02T21:27:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f55c0 0x7f26e8107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80603e0 con 0x7f26e80f6860 2022-02-02T21:27:34.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.796+0000 7f26eea6f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8060520 con 0x7f26e80f55c0 2022-02-02T21:27:34.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42920/0 (socket says 172.21.15.96:42920) 2022-02-02T21:27:34.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 -- 172.21.15.96:0/3726985268 learned_addr learned my addr 172.21.15.96:0/3726985268 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:34.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26ec80b700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f55c0 0x7f26e8107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 -- 172.21.15.96:0/3726985268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f55c0 msgr2=0x7f26e8107a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:34.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f55c0 0x7f26e8107a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:34.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 -- 172.21.15.96:0/3726985268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc005040 con 0x7f26e80f6860 2022-02-02T21:27:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e7fff700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 secure :-1 s=READY pgs=2855 cs=0 l=1 rev1=1 rx=0x7f26d400c790 tx=0x7f26d4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d400e680 con 0x7f26e80f6860 2022-02-02T21:27:34.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26d400ec90 con 0x7f26e80f6860 2022-02-02T21:27:34.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d4013d60 con 0x7f26e80f6860 2022-02-02T21:27:34.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e810a510 con 0x7f26e80f6860 2022-02-02T21:27:34.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.797+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e810aa80 con 0x7f26e80f6860 2022-02-02T21:27:34.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.799+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26d401a060 con 0x7f26e80f6860 2022-02-02T21:27:34.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.799+0000 7f26e57fa700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 0x7f26d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.799+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26d4081c90 con 0x7f26e80f6860 2022-02-02T21:27:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.799+0000 7f26ec80b700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 0x7f26d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.799+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e80f49b0 con 0x7f26e80f6860 2022-02-02T21:27:34.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.800+0000 7f26ec80b700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 0x7f26d8067290 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f26dc004e30 tx=0x7f26dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:34.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:34.804+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26d4018020 con 0x7f26e80f6860 2022-02-02T21:27:35.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.033+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26e80fdf00 con 0x7f26e80f6860 2022-02-02T21:27:35.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.034+0000 7f26e57fa700 1 -- 172.21.15.96:0/3726985268 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f26d4018070 con 0x7f26e80f6860 2022-02-02T21:27:35.035 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:27:35.036 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:27:35.036 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:27:35.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:35.037 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:27:35.037 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:27:35.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:35.038 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:27:35.038 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:27:35.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:35.039 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:27:35.039 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:27:35.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:27:35.040 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:27:35.040 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:27:35.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:27:35.041 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:27:35.041 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:27:35.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 msgr2=0x7f26d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 0x7f26d8067290 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f26dc004e30 tx=0x7f26dc009b30).stop 2022-02-02T21:27:35.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 msgr2=0x7f26e8109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 secure :-1 s=READY pgs=2855 cs=0 l=1 rev1=1 rx=0x7f26d400c790 tx=0x7f26d4007d70).stop 2022-02-02T21:27:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 shutdown_connections 2022-02-02T21:27:35.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26d8064dd0 0x7f26d8067290 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e80f55c0 0x7f26e8107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 --2- 172.21.15.96:0/3726985268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26e80f6860 0x7f26e8109f60 unknown :-1 s=CLOSED pgs=2855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 >> 172.21.15.96:0/3726985268 conn(0x7f26e80f0d40 msgr2=0x7f26e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:35.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 shutdown_connections 2022-02-02T21:27:35.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.036+0000 7f26eea6f700 1 -- 172.21.15.96:0/3726985268 wait complete. 2022-02-02T21:27:35.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.133+0000 7fa8636b9700 1 -- 172.21.15.96:0/2600540464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 msgr2=0x7fa85c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.133+0000 7fa8636b9700 1 --2- 172.21.15.96:0/2600540464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c0f6cc0 secure :-1 s=READY pgs=2856 cs=0 l=1 rev1=1 rx=0x7fa858004660 tx=0x7fa858009b30).stop 2022-02-02T21:27:35.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- 172.21.15.96:0/2600540464 shutdown_connections 2022-02-02T21:27:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 --2- 172.21.15.96:0/2600540464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c0f6cc0 unknown :-1 s=CLOSED pgs=2856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 --2- 172.21.15.96:0/2600540464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 0x7fa85c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- 172.21.15.96:0/2600540464 >> 172.21.15.96:0/2600540464 conn(0x7fa85c0f0d40 msgr2=0x7fa85c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- 172.21.15.96:0/2600540464 shutdown_connections 2022-02-02T21:27:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- 172.21.15.96:0/2600540464 wait complete. 2022-02-02T21:27:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 Processor -- start 2022-02-02T21:27:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- start start 2022-02-02T21:27:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 0x7fa85c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c107a10 con 0x7fa85c0f6860 2022-02-02T21:27:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.134+0000 7fa8636b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c107b50 con 0x7fa85c0f55c0 2022-02-02T21:27:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42930/0 (socket says 172.21.15.96:42930) 2022-02-02T21:27:35.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 -- 172.21.15.96:0/3491567876 learned_addr learned my addr 172.21.15.96:0/3491567876 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:27:35.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa861455700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 0x7fa85c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 -- 172.21.15.96:0/3491567876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 msgr2=0x7fa85c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 0x7fa85c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 -- 172.21.15.96:0/3491567876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858005040 con 0x7fa85c0f6860 2022-02-02T21:27:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa860c54700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 rx=0x7fa858009990 tx=0x7fa858009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa858018070 con 0x7fa85c0f6860 2022-02-02T21:27:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa858007ba0 con 0x7fa85c0f6860 2022-02-02T21:27:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c108490 con 0x7fa85c0f6860 2022-02-02T21:27:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa85801c3c0 con 0x7fa85c0f6860 2022-02-02T21:27:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.135+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c1089f0 con 0x7fa85c0f6860 2022-02-02T21:27:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.136+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c045ad0 con 0x7fa85c0f6860 2022-02-02T21:27:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.137+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa85801d420 con 0x7fa85c0f6860 2022-02-02T21:27:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.137+0000 7fa851ffb700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 0x7fa848067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:27:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.137+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8580836b0 con 0x7fa85c0f6860 2022-02-02T21:27:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.137+0000 7fa861455700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 0x7fa848067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:27:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.138+0000 7fa861455700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 0x7fa848067290 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fa85c0f66c0 tx=0x7fa84c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:27:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.141+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa858055240 con 0x7fa85c0f6860 2022-02-02T21:27:35.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.343+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa85c1090f0 con 0x7fa85c0f6860 2022-02-02T21:27:35.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.344+0000 7fa851ffb700 1 -- 172.21.15.96:0/3491567876 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa858054e30 con 0x7fa85c0f6860 2022-02-02T21:27:35.345 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:27:35.345 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:27:35.345 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:27:35.346 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:27:35.346 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:35.347 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:27:35.347 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:27:35.347 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:27:35.348 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:27:35.348 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:27:35.348 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:27:35.349 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:27:35.349 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:27:35.349 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:27:35.350 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:27:35.350 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:27:35.350 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:27:35.351 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:27:35.351 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:27:35.352 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:27:35.352 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:27:35.352 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:27:35.353 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:27:35.353 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:27:35.353 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:27:35.354 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:27:35.354 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:27:35.354 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:27:35.355 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:27:35.355 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:27:35.355 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:27:35.356 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:27:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:35.357 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:27:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:27:35.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:35.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:35.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:27:35.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 msgr2=0x7fa848067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 0x7fa848067290 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fa85c0f66c0 tx=0x7fa84c00b040).stop 2022-02-02T21:27:35.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 msgr2=0x7fa85c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:27:35.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 rx=0x7fa858009990 tx=0x7fa858009b30).stop 2022-02-02T21:27:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 shutdown_connections 2022-02-02T21:27:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa848064dd0 0x7fa848067290 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa85c0f55c0 0x7fa85c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 --2- 172.21.15.96:0/3491567876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa85c0f6860 0x7fa85c107460 unknown :-1 s=CLOSED pgs=2857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:27:35.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.346+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 >> 172.21.15.96:0/3491567876 conn(0x7fa85c0f0d40 msgr2=0x7fa85c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:27:35.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.347+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 shutdown_connections 2022-02-02T21:27:35.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:27:35.347+0000 7fa8636b9700 1 -- 172.21.15.96:0/3491567876 wait complete. 2022-02-02T21:27:35.364 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:27:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:35 smithi159 ceph-mon[69013]: pgmap v5564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3726985268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:27:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:35 smithi096 ceph-mon[101353]: pgmap v5564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3726985268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:27:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:36 smithi159 ceph-mon[69013]: from='client.39810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:36 smithi159 ceph-mon[69013]: from='client.39814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:36.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3491567876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:27:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:36 smithi096 ceph-mon[101353]: from='client.39810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:36 smithi096 ceph-mon[101353]: from='client.39814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:27:36.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3491567876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:27:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:37 smithi159 ceph-mon[69013]: pgmap v5565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:37 smithi096 ceph-mon[101353]: pgmap v5565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:38 smithi096 ceph-mon[101353]: pgmap v5566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:38 smithi159 ceph-mon[69013]: pgmap v5566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:41 smithi159 ceph-mon[69013]: pgmap v5567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:41 smithi096 ceph-mon[101353]: pgmap v5567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:43 smithi159 ceph-mon[69013]: pgmap v5568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:43 smithi096 ceph-mon[101353]: pgmap v5568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:45 smithi159 ceph-mon[69013]: pgmap v5569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:45 smithi096 ceph-mon[101353]: pgmap v5569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:47 smithi159 ceph-mon[69013]: pgmap v5570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:47 smithi096 ceph-mon[101353]: pgmap v5570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:48 smithi096 ceph-mon[101353]: pgmap v5571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:48 smithi159 ceph-mon[69013]: pgmap v5571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:51 smithi159 ceph-mon[69013]: pgmap v5572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:51.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:51 smithi096 ceph-mon[101353]: pgmap v5572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:53 smithi159 ceph-mon[69013]: pgmap v5573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:53 smithi096 ceph-mon[101353]: pgmap v5573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:55 smithi159 ceph-mon[69013]: pgmap v5574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:55 smithi096 ceph-mon[101353]: pgmap v5574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:57 smithi159 ceph-mon[69013]: pgmap v5575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:57 smithi096 ceph-mon[101353]: pgmap v5575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:27:58 smithi096 ceph-mon[101353]: pgmap v5576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:27:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:27:58 smithi159 ceph-mon[69013]: pgmap v5576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:01 smithi159 ceph-mon[69013]: pgmap v5577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:01 smithi096 ceph-mon[101353]: pgmap v5577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:03 smithi159 ceph-mon[69013]: pgmap v5578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:03 smithi096 ceph-mon[101353]: pgmap v5578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 -- 172.21.15.96:0/118415721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 msgr2=0x7f94cc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 --2- 172.21.15.96:0/118415721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc0f59e0 secure :-1 s=READY pgs=2858 cs=0 l=1 rev1=1 rx=0x7f94bc004660 tx=0x7f94bc009b30).stop 2022-02-02T21:28:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 -- 172.21.15.96:0/118415721 shutdown_connections 2022-02-02T21:28:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 --2- 172.21.15.96:0/118415721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 --2- 172.21.15.96:0/118415721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc0f59e0 unknown :-1 s=CLOSED pgs=2858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 -- 172.21.15.96:0/118415721 >> 172.21.15.96:0/118415721 conn(0x7f94cc0f0d40 msgr2=0x7f94cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:05.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 -- 172.21.15.96:0/118415721 shutdown_connections 2022-02-02T21:28:05.458 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:05 smithi096 ceph-mon[101353]: pgmap v5579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.454+0000 7f94d3694700 1 -- 172.21.15.96:0/118415721 wait complete. 2022-02-02T21:28:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 Processor -- start 2022-02-02T21:28:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 -- start start 2022-02-02T21:28:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0602d0 0x7f94cc10c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc10c870 con 0x7f94cc0f6860 2022-02-02T21:28:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d3694700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc10c9b0 con 0x7f94cc0602d0 2022-02-02T21:28:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42946/0 (socket says 172.21.15.96:42946) 2022-02-02T21:28:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 -- 172.21.15.96:0/421535957 learned_addr learned my addr 172.21.15.96:0/421535957 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:05.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d0c2f700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0602d0 0x7f94cc10c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:05.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 -- 172.21.15.96:0/421535957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0602d0 msgr2=0x7f94cc10c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0602d0 0x7f94cc10c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.455+0000 7f94d1430700 1 -- 172.21.15.96:0/421535957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc005040 con 0x7f94cc0f6860 2022-02-02T21:28:05.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94d1430700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 secure :-1 s=READY pgs=2859 cs=0 l=1 rev1=1 rx=0x7f94bc000c00 tx=0x7f94bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:05.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc019070 con 0x7f94cc0f6860 2022-02-02T21:28:05.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94bc0097d0 con 0x7f94cc0f6860 2022-02-02T21:28:05.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc10cc30 con 0x7f94cc0f6860 2022-02-02T21:28:05.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc014590 con 0x7f94cc0f6860 2022-02-02T21:28:05.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.456+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc10d0b0 con 0x7f94cc0f6860 2022-02-02T21:28:05.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.457+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc045ad0 con 0x7f94cc0f6860 2022-02-02T21:28:05.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.457+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f94bc014800 con 0x7f94cc0f6860 2022-02-02T21:28:05.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.458+0000 7f94c1ffb700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.458+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f94bc082e00 con 0x7f94cc0f6860 2022-02-02T21:28:05.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.458+0000 7f94d0c2f700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:05.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.458+0000 7f94d0c2f700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f94c8004a70 tx=0x7f94c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:05.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.462+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f94bc050fb0 con 0x7f94cc0f6860 2022-02-02T21:28:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:05 smithi159 ceph-mon[69013]: pgmap v5579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.639+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94cc057f10 con 0x7f94b8064dd0 2022-02-02T21:28:05.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.640+0000 7f94c1ffb700 1 -- 172.21.15.96:0/421535957 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f94cc057f10 con 0x7f94b8064dd0 2022-02-02T21:28:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 msgr2=0x7f94b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f94c8004a70 tx=0x7f94c8009040).stop 2022-02-02T21:28:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 msgr2=0x7f94cc109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 secure :-1 s=READY pgs=2859 cs=0 l=1 rev1=1 rx=0x7f94bc000c00 tx=0x7f94bc009b30).stop 2022-02-02T21:28:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 shutdown_connections 2022-02-02T21:28:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f6860 0x7f94cc109e10 unknown :-1 s=CLOSED pgs=2859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 --2- 172.21.15.96:0/421535957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0602d0 0x7f94cc10c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.642+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 >> 172.21.15.96:0/421535957 conn(0x7f94cc0f0d40 msgr2=0x7f94cc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:05.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.643+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 shutdown_connections 2022-02-02T21:28:05.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.643+0000 7f94d3694700 1 -- 172.21.15.96:0/421535957 wait complete. 2022-02-02T21:28:05.652 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:28:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.739+0000 7f52ec6bf700 1 -- 172.21.15.96:0/3033186225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 msgr2=0x7f52e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.739+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/3033186225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e40f59e0 secure :-1 s=READY pgs=2860 cs=0 l=1 rev1=1 rx=0x7f52e0004660 tx=0x7f52e0009b30).stop 2022-02-02T21:28:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 -- 172.21.15.96:0/3033186225 shutdown_connections 2022-02-02T21:28:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/3033186225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e40f6860 0x7f52e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/3033186225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e40f59e0 unknown :-1 s=CLOSED pgs=2860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 -- 172.21.15.96:0/3033186225 >> 172.21.15.96:0/3033186225 conn(0x7f52e40f0d40 msgr2=0x7f52e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 -- 172.21.15.96:0/3033186225 shutdown_connections 2022-02-02T21:28:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 -- 172.21.15.96:0/3033186225 wait complete. 2022-02-02T21:28:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 Processor -- start 2022-02-02T21:28:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.740+0000 7f52ec6bf700 1 -- start start 2022-02-02T21:28:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ec6bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ec6bf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e40f6860 0x7f52e410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ec6bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40603c0 con 0x7f52e40f55c0 2022-02-02T21:28:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ec6bf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4060500 con 0x7f52e40f6860 2022-02-02T21:28:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42954/0 (socket says 172.21.15.96:42954) 2022-02-02T21:28:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 -- 172.21.15.96:0/1040631323 learned_addr learned my addr 172.21.15.96:0/1040631323 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 -- 172.21.15.96:0/1040631323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e40f6860 msgr2=0x7f52e410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e40f6860 0x7f52e410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:28:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 -- 172.21.15.96:0/1040631323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0005040 con 0x7f52e40f55c0 2022-02-02T21:28:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52ea45b700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 secure :-1 s=READY pgs=2861 cs=0 l=1 rev1=1 rx=0x7f52e0004f60 tx=0x7f52e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.741+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e0018070 con 0x7f52e40f55c0 2022-02-02T21:28:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.742+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52e0007ba0 con 0x7f52e40f55c0 2022-02-02T21:28:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.742+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e410c6e0 con 0x7f52e40f55c0 2022-02-02T21:28:05.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.742+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e001c620 con 0x7f52e40f55c0 2022-02-02T21:28:05.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.742+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e410cc10 con 0x7f52e40f55c0 2022-02-02T21:28:05.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.743+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e40f49b0 con 0x7f52e40f55c0 2022-02-02T21:28:05.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.743+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52e001c8e0 con 0x7f52e40f55c0 2022-02-02T21:28:05.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.744+0000 7f52daffd700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 0x7f52d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:05.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.744+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52e0083a30 con 0x7f52e40f55c0 2022-02-02T21:28:05.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.744+0000 7f52e9c5a700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 0x7f52d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:05.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.744+0000 7f52e9c5a700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 0x7f52d0067290 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f52d40047d0 tx=0x7f52d4007a40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:05.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.748+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52e0051b30 con 0x7f52e40f55c0 2022-02-02T21:28:05.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.919+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52e4057f10 con 0x7f52d0064dd0 2022-02-02T21:28:05.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.928+0000 7f52daffd700 1 -- 172.21.15.96:0/1040631323 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f52e4057f10 con 0x7f52d0064dd0 2022-02-02T21:28:05.932 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:28:05.933 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:28:05.933 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:28:05.933 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:28:05.934 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:28:05.934 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:28:05.934 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:28:05.935 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:28:05.935 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:28:05.935 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:28:05.936 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:28:05.936 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:28:05.936 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:28:05.937 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:28:05.937 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:28:05.937 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:28:05.938 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:28:05.938 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:28:05.938 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:28:05.939 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:28:05.939 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:28:05.939 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:28:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 msgr2=0x7f52d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 0x7f52d0067290 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f52d40047d0 tx=0x7f52d4007a40).stop 2022-02-02T21:28:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 msgr2=0x7f52e4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 secure :-1 s=READY pgs=2861 cs=0 l=1 rev1=1 rx=0x7f52e0004f60 tx=0x7f52e0009b30).stop 2022-02-02T21:28:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 shutdown_connections 2022-02-02T21:28:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d0064dd0 0x7f52d0067290 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52e40f55c0 0x7f52e4109c90 unknown :-1 s=CLOSED pgs=2861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 --2- 172.21.15.96:0/1040631323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e40f6860 0x7f52e410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:28:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 >> 172.21.15.96:0/1040631323 conn(0x7f52e40f0d40 msgr2=0x7f52e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 shutdown_connections 2022-02-02T21:28:05.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:05.930+0000 7f52ec6bf700 1 -- 172.21.15.96:0/1040631323 wait complete. 2022-02-02T21:28:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 -- 172.21.15.96:0/2922498212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 msgr2=0x7fd79c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 --2- 172.21.15.96:0/2922498212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c0f5850 secure :-1 s=READY pgs=2862 cs=0 l=1 rev1=1 rx=0x7fd790004660 tx=0x7fd790009b30).stop 2022-02-02T21:28:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 -- 172.21.15.96:0/2922498212 shutdown_connections 2022-02-02T21:28:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 --2- 172.21.15.96:0/2922498212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 0x7fd79c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 --2- 172.21.15.96:0/2922498212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c0f5850 unknown :-1 s=CLOSED pgs=2862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 -- 172.21.15.96:0/2922498212 >> 172.21.15.96:0/2922498212 conn(0x7fd79c0f0b90 msgr2=0x7fd79c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.026+0000 7fd7a2608700 1 -- 172.21.15.96:0/2922498212 shutdown_connections 2022-02-02T21:28:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.027+0000 7fd7a2608700 1 -- 172.21.15.96:0/2922498212 wait complete. 2022-02-02T21:28:06.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.027+0000 7fd7a2608700 1 Processor -- start 2022-02-02T21:28:06.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a2608700 1 -- start start 2022-02-02T21:28:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a2608700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a2608700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 0x7fd79c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a2608700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0603e0 con 0x7fd79c0f5430 2022-02-02T21:28:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a2608700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c060520 con 0x7fd79c0f66d0 2022-02-02T21:28:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42964/0 (socket says 172.21.15.96:42964) 2022-02-02T21:28:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 -- 172.21.15.96:0/1049677589 learned_addr learned my addr 172.21.15.96:0/1049677589 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a0e05700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 0x7fd79c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 -- 172.21.15.96:0/1049677589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 msgr2=0x7fd79c10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 0x7fd79c10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.028+0000 7fd7a1606700 1 -- 172.21.15.96:0/1049677589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790005040 con 0x7fd79c0f5430 2022-02-02T21:28:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd7a1606700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 secure :-1 s=READY pgs=2863 cs=0 l=1 rev1=1 rx=0x7fd790013a70 tx=0x7fd790009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd790018070 con 0x7fd79c0f5430 2022-02-02T21:28:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c10c4e0 con 0x7fd79c0f5430 2022-02-02T21:28:06.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd7900097d0 con 0x7fd79c0f5430 2022-02-02T21:28:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79001de80 con 0x7fd79c0f5430 2022-02-02T21:28:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.029+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c10ca40 con 0x7fd79c0f5430 2022-02-02T21:28:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.030+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c045ad0 con 0x7fd79c0f5430 2022-02-02T21:28:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.031+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd790007ba0 con 0x7fd79c0f5430 2022-02-02T21:28:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.031+0000 7fd78dffb700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 0x7fd7880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.031+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7900835a0 con 0x7fd79c0f5430 2022-02-02T21:28:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.031+0000 7fd7a0e05700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 0x7fd7880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.032+0000 7fd7a0e05700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 0x7fd7880672e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fd798004c40 tx=0x7fd79800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.035+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd790051760 con 0x7fd79c0f5430 2022-02-02T21:28:06.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.265+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd79c027a00 con 0x7fd79c0f5430 2022-02-02T21:28:06.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.265+0000 7fd78dffb700 1 -- 172.21.15.96:0/1049677589 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd790054d80 con 0x7fd79c0f5430 2022-02-02T21:28:06.266 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:28:06.267 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:28:06.267 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:28:06.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:06.268 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:28:06.268 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:28:06.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:06.269 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:28:06.269 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:28:06.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:06.270 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:28:06.270 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:28:06.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:06.271 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:28:06.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:28:06.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:28:06.272 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:28:06.272 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:28:06.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 msgr2=0x7fd7880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 0x7fd7880672e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fd798004c40 tx=0x7fd79800b040).stop 2022-02-02T21:28:06.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 msgr2=0x7fd79c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 secure :-1 s=READY pgs=2863 cs=0 l=1 rev1=1 rx=0x7fd790013a70 tx=0x7fd790009b30).stop 2022-02-02T21:28:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 shutdown_connections 2022-02-02T21:28:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd788064e20 0x7fd7880672e0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd79c0f5430 0x7fd79c109a90 unknown :-1 s=CLOSED pgs=2863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 --2- 172.21.15.96:0/1049677589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd79c0f66d0 0x7fd79c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.267+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 >> 172.21.15.96:0/1049677589 conn(0x7fd79c0f0b90 msgr2=0x7fd79c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:06.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.268+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 shutdown_connections 2022-02-02T21:28:06.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.268+0000 7fd7a2608700 1 -- 172.21.15.96:0/1049677589 wait complete. 2022-02-02T21:28:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3077855786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f7980 msgr2=0x7f8d940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3077855786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f7980 0x7f8d940f7de0 secure :-1 s=READY pgs=2864 cs=0 l=1 rev1=1 rx=0x7f8d90004660 tx=0x7f8d90009b30).stop 2022-02-02T21:28:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3077855786 shutdown_connections 2022-02-02T21:28:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3077855786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f7980 0x7f8d940f7de0 unknown :-1 s=CLOSED pgs=2864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3077855786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f66e0 0x7f8d940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:28:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.365+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3077855786 >> 172.21.15.96:0/3077855786 conn(0x7f8d940f1e40 msgr2=0x7f8d940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3077855786 shutdown_connections 2022-02-02T21:28:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3077855786 wait complete. 2022-02-02T21:28:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 Processor -- start 2022-02-02T21:28:06.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 -- start start 2022-02-02T21:28:06.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f7980 0x7f8d94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9406a410 con 0x7f8d940f66e0 2022-02-02T21:28:06.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.366+0000 7f8d9b33a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9406a550 con 0x7f8d940f7980 2022-02-02T21:28:06.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42974/0 (socket says 172.21.15.96:42974) 2022-02-02T21:28:06.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 -- 172.21.15.96:0/3352522596 learned_addr learned my addr 172.21.15.96:0/3352522596 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:06.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d988d5700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f7980 0x7f8d94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 -- 172.21.15.96:0/3352522596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f7980 msgr2=0x7f8d94069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f7980 0x7f8d94069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 -- 172.21.15.96:0/3352522596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90005040 con 0x7f8d940f66e0 2022-02-02T21:28:06.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d990d6700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 secure :-1 s=READY pgs=2865 cs=0 l=1 rev1=1 rx=0x7f8d880093f0 tx=0x7f8d88006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:06.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d88009ea0 con 0x7f8d940f66e0 2022-02-02T21:28:06.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d88013af0 con 0x7f8d940f66e0 2022-02-02T21:28:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9406a830 con 0x7f8d940f66e0 2022-02-02T21:28:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d8800db10 con 0x7f8d940f66e0 2022-02-02T21:28:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.367+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9410efe0 con 0x7f8d940f66e0 2022-02-02T21:28:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.368+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d94045ad0 con 0x7f8d940f66e0 2022-02-02T21:28:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.369+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d8801a060 con 0x7f8d940f66e0 2022-02-02T21:28:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.369+0000 7f8d85ffb700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 0x7f8d80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.369+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d88081ab0 con 0x7f8d940f66e0 2022-02-02T21:28:06.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.369+0000 7f8d988d5700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 0x7f8d80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.369+0000 7f8d988d5700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 0x7f8d80067290 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f8d90004e30 tx=0x7f8d90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:06.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.373+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d8804fbb0 con 0x7f8d940f66e0 2022-02-02T21:28:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.573+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8d94027a00 con 0x7f8d940f66e0 2022-02-02T21:28:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.573+0000 7f8d85ffb700 1 -- 172.21.15.96:0/3352522596 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8d88018070 con 0x7f8d940f66e0 2022-02-02T21:28:06.575 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:28:06.575 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:28:06.576 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:28:06.576 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:28:06.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:06.577 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:28:06.578 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:28:06.578 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:28:06.578 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:28:06.579 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:28:06.579 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:28:06.579 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:28:06.580 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:28:06.580 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:28:06.580 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:28:06.581 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:28:06.581 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:28:06.581 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:28:06.582 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:28:06.582 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:28:06.583 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:28:06.583 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:28:06.584 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:28:06.584 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:28:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:28:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:28:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:28:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:28:06.586 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:28:06.586 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:28:06.587 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:28:06.587 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:28:06.587 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:06.588 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:06.588 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:28:06.588 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:06.589 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:06.589 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:06.590 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 msgr2=0x7f8d80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 0x7f8d80067290 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f8d90004e30 tx=0x7f8d90009b30).stop 2022-02-02T21:28:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 msgr2=0x7f8d9406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 secure :-1 s=READY pgs=2865 cs=0 l=1 rev1=1 rx=0x7f8d880093f0 tx=0x7f8d88006ec0).stop 2022-02-02T21:28:06.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 shutdown_connections 2022-02-02T21:28:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d80064dd0 0x7f8d80067290 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d940f66e0 0x7f8d9406b9a0 unknown :-1 s=CLOSED pgs=2865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 --2- 172.21.15.96:0/3352522596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d940f7980 0x7f8d94069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 >> 172.21.15.96:0/3352522596 conn(0x7f8d940f1e40 msgr2=0x7f8d940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:06.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 shutdown_connections 2022-02-02T21:28:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:06.575+0000 7f8d9b33a700 1 -- 172.21.15.96:0/3352522596 wait complete. 2022-02-02T21:28:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:28:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:07 smithi159 ceph-mon[69013]: from='client.39826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:07 smithi159 ceph-mon[69013]: from='client.39830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:07 smithi159 ceph-mon[69013]: pgmap v5580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1049677589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:28:07.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3352522596' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:28:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:07 smithi096 ceph-mon[101353]: from='client.39826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:07 smithi096 ceph-mon[101353]: from='client.39830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:07.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:07 smithi096 ceph-mon[101353]: pgmap v5580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:07.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1049677589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:28:07.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3352522596' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:28:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:08 smithi096 ceph-mon[101353]: pgmap v5581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:08 smithi159 ceph-mon[69013]: pgmap v5581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:11 smithi159 ceph-mon[69013]: pgmap v5582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:11 smithi096 ceph-mon[101353]: pgmap v5582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:13 smithi159 ceph-mon[69013]: pgmap v5583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:13 smithi096 ceph-mon[101353]: pgmap v5583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:15 smithi159 ceph-mon[69013]: pgmap v5584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:15 smithi096 ceph-mon[101353]: pgmap v5584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:17 smithi159 ceph-mon[69013]: pgmap v5585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:17 smithi096 ceph-mon[101353]: pgmap v5585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:18 smithi096 ceph-mon[101353]: pgmap v5586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:18 smithi159 ceph-mon[69013]: pgmap v5586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:21 smithi159 ceph-mon[69013]: pgmap v5587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:21 smithi096 ceph-mon[101353]: pgmap v5587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:23 smithi159 ceph-mon[69013]: pgmap v5588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:23 smithi096 ceph-mon[101353]: pgmap v5588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:25 smithi159 ceph-mon[69013]: pgmap v5589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:25 smithi096 ceph-mon[101353]: pgmap v5589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:27 smithi159 ceph-mon[69013]: pgmap v5590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:27 smithi096 ceph-mon[101353]: pgmap v5590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:28:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:28:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:28 smithi096 ceph-mon[101353]: pgmap v5591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:28:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:28:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:28 smithi159 ceph-mon[69013]: pgmap v5591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:31 smithi159 ceph-mon[69013]: pgmap v5592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:31 smithi096 ceph-mon[101353]: pgmap v5592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:33 smithi159 ceph-mon[69013]: pgmap v5593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:33 smithi096 ceph-mon[101353]: pgmap v5593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:35 smithi159 ceph-mon[69013]: pgmap v5594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:35 smithi096 ceph-mon[101353]: pgmap v5594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:36.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 -- 172.21.15.96:0/1034958709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 msgr2=0x7f33000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 --2- 172.21.15.96:0/1034958709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f33000f6b00 secure :-1 s=READY pgs=2866 cs=0 l=1 rev1=1 rx=0x7f32f0004660 tx=0x7f32f0009b30).stop 2022-02-02T21:28:36.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 -- 172.21.15.96:0/1034958709 shutdown_connections 2022-02-02T21:28:36.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 --2- 172.21.15.96:0/1034958709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 0x7f33000f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 --2- 172.21.15.96:0/1034958709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f33000f6b00 unknown :-1 s=CLOSED pgs=2866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 -- 172.21.15.96:0/1034958709 >> 172.21.15.96:0/1034958709 conn(0x7f33000f1e40 msgr2=0x7f33000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:36.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 -- 172.21.15.96:0/1034958709 shutdown_connections 2022-02-02T21:28:36.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.687+0000 7f3308286700 1 -- 172.21.15.96:0/1034958709 wait complete. 2022-02-02T21:28:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 Processor -- start 2022-02-02T21:28:36.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 -- start start 2022-02-02T21:28:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 0x7f33001074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300107a50 con 0x7f33000f66e0 2022-02-02T21:28:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.688+0000 7f3308286700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300107b90 con 0x7f33000f7980 2022-02-02T21:28:36.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42996/0 (socket says 172.21.15.96:42996) 2022-02-02T21:28:36.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 -- 172.21.15.96:0/512966641 learned_addr learned my addr 172.21.15.96:0/512966641 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:36.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3305821700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 0x7f33001074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 -- 172.21.15.96:0/512966641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 msgr2=0x7f33001074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 0x7f33001074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 -- 172.21.15.96:0/512966641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0005040 con 0x7f33000f66e0 2022-02-02T21:28:36.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3306022700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 secure :-1 s=READY pgs=2867 cs=0 l=1 rev1=1 rx=0x7f32f0013a70 tx=0x7f32f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:36.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f0018070 con 0x7f33000f66e0 2022-02-02T21:28:36.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33001084d0 con 0x7f33000f66e0 2022-02-02T21:28:36.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32f00097d0 con 0x7f33000f66e0 2022-02-02T21:28:36.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f001c3c0 con 0x7f33000f66e0 2022-02-02T21:28:36.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.689+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3300108a30 con 0x7f33000f66e0 2022-02-02T21:28:36.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.690+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300045ad0 con 0x7f33000f66e0 2022-02-02T21:28:36.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.691+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f32f0007ba0 con 0x7f33000f66e0 2022-02-02T21:28:36.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.691+0000 7f32f6ffd700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 0x7f32ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.691+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f32f0083730 con 0x7f33000f66e0 2022-02-02T21:28:36.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.691+0000 7f3305821700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 0x7f32ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.692+0000 7f3305821700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 0x7f32ec067290 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f32fc004a70 tx=0x7f32fc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:36.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.696+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32f0055320 con 0x7f33000f66e0 2022-02-02T21:28:36.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.871+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33000ff010 con 0x7f32ec064dd0 2022-02-02T21:28:36.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.873+0000 7f32f6ffd700 1 -- 172.21.15.96:0/512966641 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f33000ff010 con 0x7f32ec064dd0 2022-02-02T21:28:36.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.874+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 msgr2=0x7f32ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.874+0000 7f3308286700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 0x7f32ec067290 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f32fc004a70 tx=0x7f32fc00b040).stop 2022-02-02T21:28:36.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.874+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 msgr2=0x7f3300106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.874+0000 7f3308286700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 secure :-1 s=READY pgs=2867 cs=0 l=1 rev1=1 rx=0x7f32f0013a70 tx=0x7f32f0009b30).stop 2022-02-02T21:28:36.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 shutdown_connections 2022-02-02T21:28:36.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32ec064dd0 0x7f32ec067290 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33000f66e0 0x7f3300106fb0 unknown :-1 s=CLOSED pgs=2867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 --2- 172.21.15.96:0/512966641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33000f7980 0x7f33001074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 >> 172.21.15.96:0/512966641 conn(0x7f33000f1e40 msgr2=0x7f33000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:36.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 shutdown_connections 2022-02-02T21:28:36.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.875+0000 7f3308286700 1 -- 172.21.15.96:0/512966641 wait complete. 2022-02-02T21:28:36.885 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:28:36.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 -- 172.21.15.96:0/3957182679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 msgr2=0x7f74dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 --2- 172.21.15.96:0/3957182679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc0f6b00 secure :-1 s=READY pgs=2868 cs=0 l=1 rev1=1 rx=0x7f74d0004660 tx=0x7f74d0009b30).stop 2022-02-02T21:28:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 -- 172.21.15.96:0/3957182679 shutdown_connections 2022-02-02T21:28:36.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 --2- 172.21.15.96:0/3957182679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 --2- 172.21.15.96:0/3957182679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc0f6b00 unknown :-1 s=CLOSED pgs=2868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 -- 172.21.15.96:0/3957182679 >> 172.21.15.96:0/3957182679 conn(0x7f74dc0f1e40 msgr2=0x7f74dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 -- 172.21.15.96:0/3957182679 shutdown_connections 2022-02-02T21:28:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.972+0000 7f74e0bec700 1 -- 172.21.15.96:0/3957182679 wait complete. 2022-02-02T21:28:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 Processor -- start 2022-02-02T21:28:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 -- start start 2022-02-02T21:28:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc06a380 con 0x7f74dc0f66e0 2022-02-02T21:28:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74e0bec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc06a4c0 con 0x7f74dc0f7980 2022-02-02T21:28:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43006/0 (socket says 172.21.15.96:43006) 2022-02-02T21:28:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 -- 172.21.15.96:0/130383605 learned_addr learned my addr 172.21.15.96:0/130383605 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74d9d9b700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 -- 172.21.15.96:0/130383605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 msgr2=0x7f74dc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:36.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74da59c700 1 -- 172.21.15.96:0/130383605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0005040 con 0x7f74dc0f66e0 2022-02-02T21:28:36.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.973+0000 7f74d9d9b700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:28:36.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74da59c700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 secure :-1 s=READY pgs=2869 cs=0 l=1 rev1=1 rx=0x7f74d0004f60 tx=0x7f74d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:36.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d0018070 con 0x7f74dc0f66e0 2022-02-02T21:28:36.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f74d0007ba0 con 0x7f74dc0f66e0 2022-02-02T21:28:36.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc06a740 con 0x7f74dc0f66e0 2022-02-02T21:28:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d001c620 con 0x7f74dc0f66e0 2022-02-02T21:28:36.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.974+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc06aca0 con 0x7f74dc0f66e0 2022-02-02T21:28:36.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.975+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc045ad0 con 0x7f74dc0f66e0 2022-02-02T21:28:36.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.975+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f74d001d420 con 0x7f74dc0f66e0 2022-02-02T21:28:36.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.976+0000 7f74caffd700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 0x7f74c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:36.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.976+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f74d0083890 con 0x7f74dc0f66e0 2022-02-02T21:28:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.976+0000 7f74d9d9b700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 0x7f74c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.976+0000 7f74d9d9b700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 0x7f74c4067290 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f74cc0041d0 tx=0x7f74cc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:36.980+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f74d0051a50 con 0x7f74dc0f66e0 2022-02-02T21:28:37.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.153+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74dc0fefb0 con 0x7f74c4064dd0 2022-02-02T21:28:37.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.162+0000 7f74caffd700 1 -- 172.21.15.96:0/130383605 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f74dc0fefb0 con 0x7f74c4064dd0 2022-02-02T21:28:37.164 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:28:37.164 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:28:37.164 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:28:37.165 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:28:37.165 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:28:37.165 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:28:37.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:28:37.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:28:37.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:28:37.167 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:28:37.167 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:28:37.168 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:28:37.168 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:28:37.168 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:28:37.168 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:28:37.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:28:37.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:28:37.169 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:28:37.170 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:28:37.170 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:28:37.170 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:28:37.171 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:28:37.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 msgr2=0x7f74c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 0x7f74c4067290 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f74cc0041d0 tx=0x7f74cc009040).stop 2022-02-02T21:28:37.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 msgr2=0x7f74dc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 secure :-1 s=READY pgs=2869 cs=0 l=1 rev1=1 rx=0x7f74d0004f60 tx=0x7f74d0009b30).stop 2022-02-02T21:28:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 shutdown_connections 2022-02-02T21:28:37.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f74c4064dd0 0x7f74c4067290 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74dc0f66e0 0x7f74dc06b9a0 unknown :-1 s=CLOSED pgs=2869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 --2- 172.21.15.96:0/130383605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74dc0f7980 0x7f74dc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 >> 172.21.15.96:0/130383605 conn(0x7f74dc0f1e40 msgr2=0x7f74dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:37.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 shutdown_connections 2022-02-02T21:28:37.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.164+0000 7f74e0bec700 1 -- 172.21.15.96:0/130383605 wait complete. 2022-02-02T21:28:37.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:37 smithi096 ceph-mon[101353]: pgmap v5595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 -- 172.21.15.96:0/2900826982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 msgr2=0x7f9c7c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 --2- 172.21.15.96:0/2900826982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c0f7de0 secure :-1 s=READY pgs=2870 cs=0 l=1 rev1=1 rx=0x7f9c70004660 tx=0x7f9c70009b30).stop 2022-02-02T21:28:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 -- 172.21.15.96:0/2900826982 shutdown_connections 2022-02-02T21:28:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 --2- 172.21.15.96:0/2900826982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c0f7de0 unknown :-1 s=CLOSED pgs=2870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 --2- 172.21.15.96:0/2900826982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 0x7f9c7c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 -- 172.21.15.96:0/2900826982 >> 172.21.15.96:0/2900826982 conn(0x7f9c7c0f1e40 msgr2=0x7f9c7c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.261+0000 7f9c82272700 1 -- 172.21.15.96:0/2900826982 shutdown_connections 2022-02-02T21:28:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.262+0000 7f9c82272700 1 -- 172.21.15.96:0/2900826982 wait complete. 2022-02-02T21:28:37.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.262+0000 7f9c82272700 1 Processor -- start 2022-02-02T21:28:37.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.262+0000 7f9c82272700 1 -- start start 2022-02-02T21:28:37.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c82272700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 0x7f9c7c109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c82272700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c82272700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c109c30 con 0x7f9c7c0f7980 2022-02-02T21:28:37.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c82272700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c109d70 con 0x7f9c7c0f66e0 2022-02-02T21:28:37.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43018/0 (socket says 172.21.15.96:43018) 2022-02-02T21:28:37.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 -- 172.21.15.96:0/3441063144 learned_addr learned my addr 172.21.15.96:0/3441063144 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:37.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7bfff700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 0x7f9c7c109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 -- 172.21.15.96:0/3441063144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 msgr2=0x7f9c7c109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 0x7f9c7c109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 -- 172.21.15.96:0/3441063144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70005040 con 0x7f9c7c0f7980 2022-02-02T21:28:37.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c7b7fe700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 secure :-1 s=READY pgs=2871 cs=0 l=1 rev1=1 rx=0x7f9c70009990 tx=0x7f9c70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:37.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c70018070 con 0x7f9c7c0f7980 2022-02-02T21:28:37.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.263+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c10a6b0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.264+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c10ac10 con 0x7f9c7c0f7980 2022-02-02T21:28:37.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.264+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c70007ca0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7001c620 con 0x7f9c7c0f7980 2022-02-02T21:28:37.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c7001c890 con 0x7f9c7c0f7980 2022-02-02T21:28:37.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c045ad0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c78ff9700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 0x7f9c64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9c700846c0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.265+0000 7f9c7bfff700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 0x7f9c64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.266+0000 7f9c7bfff700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 0x7f9c64067290 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f9c6c007fd0 tx=0x7f9c6c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:37.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.270+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c700562b0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.498+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c7c0fef70 con 0x7f9c7c0f7980 2022-02-02T21:28:37.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.499+0000 7f9c78ff9700 1 -- 172.21.15.96:0/3441063144 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9c70055ea0 con 0x7f9c7c0f7980 2022-02-02T21:28:37.501 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:28:37.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:28:37.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:28:37.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:37.502 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:28:37.503 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:28:37.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:37.503 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:28:37.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:28:37.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:37.504 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:28:37.505 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:28:37.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:28:37.505 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:28:37.506 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:28:37.506 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:28:37.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:28:37.507 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:28:37.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.500+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 msgr2=0x7f9c64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.500+0000 7f9c82272700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 0x7f9c64067290 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f9c6c007fd0 tx=0x7f9c6c009040).stop 2022-02-02T21:28:37.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.500+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 msgr2=0x7f9c7c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.500+0000 7f9c82272700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 secure :-1 s=READY pgs=2871 cs=0 l=1 rev1=1 rx=0x7f9c70009990 tx=0x7f9c70009b30).stop 2022-02-02T21:28:37.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 shutdown_connections 2022-02-02T21:28:37.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c64064dd0 0x7f9c64067290 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c0f66e0 0x7f9c7c109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 --2- 172.21.15.96:0/3441063144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c7c0f7980 0x7f9c7c109680 unknown :-1 s=CLOSED pgs=2871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 >> 172.21.15.96:0/3441063144 conn(0x7f9c7c0f1e40 msgr2=0x7f9c7c0f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:37.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 shutdown_connections 2022-02-02T21:28:37.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.501+0000 7f9c82272700 1 -- 172.21.15.96:0/3441063144 wait complete. 2022-02-02T21:28:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:37 smithi159 ceph-mon[69013]: pgmap v5595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:37.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 -- 172.21.15.96:0/1725005815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f5430 msgr2=0x7f1adc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 --2- 172.21.15.96:0/1725005815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f5430 0x7f1adc0f5850 secure :-1 s=READY pgs=2872 cs=0 l=1 rev1=1 rx=0x7f1ad0004660 tx=0x7f1ad0009b30).stop 2022-02-02T21:28:37.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 -- 172.21.15.96:0/1725005815 shutdown_connections 2022-02-02T21:28:37.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 --2- 172.21.15.96:0/1725005815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f66d0 0x7f1adc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 --2- 172.21.15.96:0/1725005815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f5430 0x7f1adc0f5850 unknown :-1 s=CLOSED pgs=2872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.599+0000 7f1adbfff700 1 -- 172.21.15.96:0/1725005815 >> 172.21.15.96:0/1725005815 conn(0x7f1adc0f0b90 msgr2=0x7f1adc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:37.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.600+0000 7f1adbfff700 1 -- 172.21.15.96:0/1725005815 shutdown_connections 2022-02-02T21:28:37.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.600+0000 7f1adbfff700 1 -- 172.21.15.96:0/1725005815 wait complete. 2022-02-02T21:28:37.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.600+0000 7f1adbfff700 1 Processor -- start 2022-02-02T21:28:37.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.600+0000 7f1adbfff700 1 -- start start 2022-02-02T21:28:37.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1adbfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f5430 0x7f1adc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1adbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1adbfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1067d0 con 0x7f1adc0f66d0 2022-02-02T21:28:37.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1adbfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc106fd0 con 0x7f1adc0f5430 2022-02-02T21:28:37.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43028/0 (socket says 172.21.15.96:43028) 2022-02-02T21:28:37.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 -- 172.21.15.96:0/686598496 learned_addr learned my addr 172.21.15.96:0/686598496 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:28:37.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1adaffd700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f5430 0x7f1adc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 -- 172.21.15.96:0/686598496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f5430 msgr2=0x7f1adc105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f5430 0x7f1adc105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 -- 172.21.15.96:0/686598496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0005040 con 0x7f1adc0f66d0 2022-02-02T21:28:37.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ada7fc700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 secure :-1 s=READY pgs=2873 cs=0 l=1 rev1=1 rx=0x7f1acc0026d0 tx=0x7f1acc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:37.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1acc0079c0 con 0x7f1adc0f66d0 2022-02-02T21:28:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.601+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1acc00f040 con 0x7f1adc0f66d0 2022-02-02T21:28:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.602+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc107250 con 0x7f1adc0f66d0 2022-02-02T21:28:37.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.602+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1acc0148b0 con 0x7f1adc0f66d0 2022-02-02T21:28:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.602+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc1077c0 con 0x7f1adc0f66d0 2022-02-02T21:28:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.602+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc059100 con 0x7f1adc0f66d0 2022-02-02T21:28:37.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.603+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1acc007b20 con 0x7f1adc0f66d0 2022-02-02T21:28:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.603+0000 7f1ac37fe700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 0x7f1ac40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:28:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.603+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1acc0819e0 con 0x7f1adc0f66d0 2022-02-02T21:28:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.603+0000 7f1adaffd700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 0x7f1ac40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:28:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.604+0000 7f1adaffd700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 0x7f1ac40672e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f1ad0004630 tx=0x7f1ad0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:28:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.608+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1acc053510 con 0x7f1adc0f66d0 2022-02-02T21:28:37.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.809+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1adc0ff600 con 0x7f1adc0f66d0 2022-02-02T21:28:37.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.809+0000 7f1ac37fe700 1 -- 172.21.15.96:0/686598496 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1acc053100 con 0x7f1adc0f66d0 2022-02-02T21:28:37.811 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:28:37.812 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:28:37.812 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:28:37.812 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:28:37.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:37.813 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:28:37.813 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:28:37.814 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:28:37.814 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:28:37.814 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:28:37.815 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:28:37.815 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:28:37.815 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:28:37.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:28:37.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:28:37.816 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:28:37.817 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:28:37.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:28:37.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:28:37.818 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:28:37.818 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:28:37.818 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:28:37.819 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:28:37.819 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:28:37.819 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:28:37.820 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:28:37.820 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:28:37.820 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:28:37.821 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:28:37.821 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:28:37.821 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:28:37.822 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:28:37.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:37.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:37.823 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:28:37.823 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:28:37.823 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:37.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:37.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:28:37.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 msgr2=0x7f1ac40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 0x7f1ac40672e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f1ad0004630 tx=0x7f1ad0009b30).stop 2022-02-02T21:28:37.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 msgr2=0x7f1adc106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:28:37.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 secure :-1 s=READY pgs=2873 cs=0 l=1 rev1=1 rx=0x7f1acc0026d0 tx=0x7f1acc009de0).stop 2022-02-02T21:28:37.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 shutdown_connections 2022-02-02T21:28:37.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac4064e20 0x7f1ac40672e0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1adc0f5430 0x7f1adc105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 --2- 172.21.15.96:0/686598496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1adc0f66d0 0x7f1adc106220 unknown :-1 s=CLOSED pgs=2873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:28:37.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 >> 172.21.15.96:0/686598496 conn(0x7f1adc0f0b90 msgr2=0x7f1adc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:28:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 shutdown_connections 2022-02-02T21:28:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:28:37.811+0000 7f1adbfff700 1 -- 172.21.15.96:0/686598496 wait complete. 2022-02-02T21:28:37.829 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:28:38.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:38 smithi159 ceph-mon[69013]: from='client.39842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:38.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:38 smithi159 ceph-mon[69013]: from='client.39846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3441063144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:28:38.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/686598496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:28:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:38 smithi096 ceph-mon[101353]: from='client.39842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:38.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:38 smithi096 ceph-mon[101353]: from='client.39846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:28:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3441063144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:28:38.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/686598496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:28:39.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:39 smithi159 ceph-mon[69013]: pgmap v5596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:39.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:39 smithi096 ceph-mon[101353]: pgmap v5596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:41 smithi159 ceph-mon[69013]: pgmap v5597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:41 smithi096 ceph-mon[101353]: pgmap v5597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:43 smithi159 ceph-mon[69013]: pgmap v5598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:43 smithi096 ceph-mon[101353]: pgmap v5598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:45 smithi159 ceph-mon[69013]: pgmap v5599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:45 smithi096 ceph-mon[101353]: pgmap v5599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:47 smithi159 ceph-mon[69013]: pgmap v5600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:47 smithi096 ceph-mon[101353]: pgmap v5600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:48.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:48 smithi096 ceph-mon[101353]: pgmap v5601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:48 smithi159 ceph-mon[69013]: pgmap v5601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:51 smithi159 ceph-mon[69013]: pgmap v5602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:51 smithi096 ceph-mon[101353]: pgmap v5602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:53 smithi159 ceph-mon[69013]: pgmap v5603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:53 smithi096 ceph-mon[101353]: pgmap v5603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:55 smithi159 ceph-mon[69013]: pgmap v5604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:55 smithi096 ceph-mon[101353]: pgmap v5604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:57 smithi159 ceph-mon[69013]: pgmap v5605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:57 smithi096 ceph-mon[101353]: pgmap v5605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:28:58 smithi096 ceph-mon[101353]: pgmap v5606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:28:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:28:58 smithi159 ceph-mon[69013]: pgmap v5606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:01 smithi159 ceph-mon[69013]: pgmap v5607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:01 smithi096 ceph-mon[101353]: pgmap v5607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:03 smithi159 ceph-mon[69013]: pgmap v5608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:03 smithi096 ceph-mon[101353]: pgmap v5608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:05 smithi159 ceph-mon[69013]: pgmap v5609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:05 smithi096 ceph-mon[101353]: pgmap v5609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:07 smithi159 ceph-mon[69013]: pgmap v5610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:07 smithi096 ceph-mon[101353]: pgmap v5610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:07.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 -- 172.21.15.96:0/77622879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 msgr2=0x7f978c0f9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:07.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 --2- 172.21.15.96:0/77622879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c0f9f90 secure :-1 s=READY pgs=2874 cs=0 l=1 rev1=1 rx=0x7f977c004660 tx=0x7f977c009b30).stop 2022-02-02T21:29:07.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 -- 172.21.15.96:0/77622879 shutdown_connections 2022-02-02T21:29:07.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 --2- 172.21.15.96:0/77622879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c0f9f90 unknown :-1 s=CLOSED pgs=2874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:07.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 --2- 172.21.15.96:0/77622879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 0x7f978c0f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:07.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 -- 172.21.15.96:0/77622879 >> 172.21.15.96:0/77622879 conn(0x7f978c0f40e0 msgr2=0x7f978c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:07.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 -- 172.21.15.96:0/77622879 shutdown_connections 2022-02-02T21:29:07.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.921+0000 7f9791449700 1 -- 172.21.15.96:0/77622879 wait complete. 2022-02-02T21:29:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 Processor -- start 2022-02-02T21:29:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 -- start start 2022-02-02T21:29:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 0x7f978c109080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c109b20 con 0x7f978c0f9b30 2022-02-02T21:29:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f9791449700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c109c60 con 0x7f978c0f8890 2022-02-02T21:29:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f978a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f978a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43050/0 (socket says 172.21.15.96:43050) 2022-02-02T21:29:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f978a7fc700 1 -- 172.21.15.96:0/4034767436 learned_addr learned my addr 172.21.15.96:0/4034767436 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.922+0000 7f978affd700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 0x7f978c109080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f978a7fc700 1 -- 172.21.15.96:0/4034767436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 msgr2=0x7f978c109080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f978a7fc700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 0x7f978c109080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f978a7fc700 1 -- 172.21.15.96:0/4034767436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c005040 con 0x7f978c0f9b30 2022-02-02T21:29:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f978a7fc700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 secure :-1 s=READY pgs=2875 cs=0 l=1 rev1=1 rx=0x7f977c009990 tx=0x7f977c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977c018070 con 0x7f978c0f9b30 2022-02-02T21:29:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c10a5a0 con 0x7f978c0f9b30 2022-02-02T21:29:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f977c007ba0 con 0x7f978c0f9b30 2022-02-02T21:29:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977c01c3c0 con 0x7f978c0f9b30 2022-02-02T21:29:07.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.923+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c10ab00 con 0x7f978c0f9b30 2022-02-02T21:29:07.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.924+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c045ad0 con 0x7f978c0f9b30 2022-02-02T21:29:07.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.925+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f977c01d420 con 0x7f978c0f9b30 2022-02-02T21:29:07.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.925+0000 7f97837fe700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 0x7f97780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.925+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f977c0836b0 con 0x7f978c0f9b30 2022-02-02T21:29:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.925+0000 7f978affd700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 0x7f97780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.925+0000 7f978affd700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 0x7f97780672e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f978c0f9990 tx=0x7f977400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:07.929+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f977c055240 con 0x7f978c0f9b30 2022-02-02T21:29:08.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.108+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f978c101160 con 0x7f9778064e20 2022-02-02T21:29:08.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.109+0000 7f97837fe700 1 -- 172.21.15.96:0/4034767436 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f978c101160 con 0x7f9778064e20 2022-02-02T21:29:08.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 msgr2=0x7f97780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 0x7f97780672e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f978c0f9990 tx=0x7f977400b040).stop 2022-02-02T21:29:08.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 msgr2=0x7f978c109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 secure :-1 s=READY pgs=2875 cs=0 l=1 rev1=1 rx=0x7f977c009990 tx=0x7f977c009b30).stop 2022-02-02T21:29:08.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 shutdown_connections 2022-02-02T21:29:08.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9778064e20 0x7f97780672e0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f978c0f8890 0x7f978c109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 --2- 172.21.15.96:0/4034767436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978c0f9b30 0x7f978c109570 unknown :-1 s=CLOSED pgs=2875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 >> 172.21.15.96:0/4034767436 conn(0x7f978c0f40e0 msgr2=0x7f978c0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 shutdown_connections 2022-02-02T21:29:08.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.111+0000 7f9791449700 1 -- 172.21.15.96:0/4034767436 wait complete. 2022-02-02T21:29:08.122 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:29:08.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 -- 172.21.15.96:0/231379636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 msgr2=0x7fda380f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 --2- 172.21.15.96:0/231379636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda380f6b30 secure :-1 s=READY pgs=2876 cs=0 l=1 rev1=1 rx=0x7fda2c004660 tx=0x7fda2c009b30).stop 2022-02-02T21:29:08.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 -- 172.21.15.96:0/231379636 shutdown_connections 2022-02-02T21:29:08.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 --2- 172.21.15.96:0/231379636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda380f6b30 unknown :-1 s=CLOSED pgs=2876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 --2- 172.21.15.96:0/231379636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda380f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:29:08.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 -- 172.21.15.96:0/231379636 >> 172.21.15.96:0/231379636 conn(0x7fda380f0b90 msgr2=0x7fda380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 -- 172.21.15.96:0/231379636 shutdown_connections 2022-02-02T21:29:08.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.208+0000 7fda3d228700 1 -- 172.21.15.96:0/231379636 wait complete. 2022-02-02T21:29:08.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 Processor -- start 2022-02-02T21:29:08.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 -- start start 2022-02-02T21:29:08.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda38108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38109ac0 con 0x7fda380f66d0 2022-02-02T21:29:08.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.209+0000 7fda3d228700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3810a370 con 0x7fda380f5430 2022-02-02T21:29:08.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43058/0 (socket says 172.21.15.96:43058) 2022-02-02T21:29:08.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 -- 172.21.15.96:0/4075792678 learned_addr learned my addr 172.21.15.96:0/4075792678 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda37fff700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda38108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 -- 172.21.15.96:0/4075792678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 msgr2=0x7fda38108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda38108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 -- 172.21.15.96:0/4075792678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c005040 con 0x7fda380f66d0 2022-02-02T21:29:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda37fff700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda38108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:29:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda377fe700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 secure :-1 s=READY pgs=2877 cs=0 l=1 rev1=1 rx=0x7fda2c009990 tx=0x7fda2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c018070 con 0x7fda380f66d0 2022-02-02T21:29:08.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3810a5f0 con 0x7fda380f66d0 2022-02-02T21:29:08.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda2c007ca0 con 0x7fda380f66d0 2022-02-02T21:29:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c01c620 con 0x7fda380f66d0 2022-02-02T21:29:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.210+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3810ab50 con 0x7fda380f66d0 2022-02-02T21:29:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.212+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38059100 con 0x7fda380f66d0 2022-02-02T21:29:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.212+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda2c01d960 con 0x7fda380f66d0 2022-02-02T21:29:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.212+0000 7fda34ff9700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 0x7fda200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.213+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fda2c0837d0 con 0x7fda380f66d0 2022-02-02T21:29:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.213+0000 7fda37fff700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 0x7fda200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.213+0000 7fda37fff700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 0x7fda200672e0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fda380f6530 tx=0x7fda28008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.217+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda2c055470 con 0x7fda380f66d0 2022-02-02T21:29:08.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.387+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda380fa910 con 0x7fda20064e20 2022-02-02T21:29:08.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.396+0000 7fda34ff9700 1 -- 172.21.15.96:0/4075792678 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fda380fa910 con 0x7fda20064e20 2022-02-02T21:29:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:29:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:29:08.400 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:29:08.400 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:29:08.400 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:29:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:29:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:29:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:29:08.402 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:29:08.402 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:29:08.402 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:29:08.403 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:29:08.403 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:29:08.403 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:29:08.404 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:29:08.404 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:29:08.405 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:29:08.405 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:29:08.405 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:29:08.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:29:08.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:29:08.406 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:29:08.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 msgr2=0x7fda200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 0x7fda200672e0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fda380f6530 tx=0x7fda28008040).stop 2022-02-02T21:29:08.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 msgr2=0x7fda38109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 secure :-1 s=READY pgs=2877 cs=0 l=1 rev1=1 rx=0x7fda2c009990 tx=0x7fda2c009b30).stop 2022-02-02T21:29:08.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 shutdown_connections 2022-02-02T21:29:08.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fda20064e20 0x7fda200672e0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda380f5430 0x7fda38108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 --2- 172.21.15.96:0/4075792678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda380f66d0 0x7fda38109480 unknown :-1 s=CLOSED pgs=2877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 >> 172.21.15.96:0/4075792678 conn(0x7fda380f0b90 msgr2=0x7fda3805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 shutdown_connections 2022-02-02T21:29:08.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.398+0000 7fda3d228700 1 -- 172.21.15.96:0/4075792678 wait complete. 2022-02-02T21:29:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 -- 172.21.15.96:0/2226165417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 msgr2=0x7fb0580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 --2- 172.21.15.96:0/2226165417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb0580f59e0 secure :-1 s=READY pgs=2878 cs=0 l=1 rev1=1 rx=0x7fb04c004660 tx=0x7fb04c009b30).stop 2022-02-02T21:29:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 -- 172.21.15.96:0/2226165417 shutdown_connections 2022-02-02T21:29:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 --2- 172.21.15.96:0/2226165417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 0x7fb0580f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 --2- 172.21.15.96:0/2226165417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb0580f59e0 unknown :-1 s=CLOSED pgs=2878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 -- 172.21.15.96:0/2226165417 >> 172.21.15.96:0/2226165417 conn(0x7fb0580f0de0 msgr2=0x7fb0580f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 -- 172.21.15.96:0/2226165417 shutdown_connections 2022-02-02T21:29:08.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.495+0000 7fb05d291700 1 -- 172.21.15.96:0/2226165417 wait complete. 2022-02-02T21:29:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 Processor -- start 2022-02-02T21:29:08.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 -- start start 2022-02-02T21:29:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 0x7fb05810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058060540 con 0x7fb0580f55c0 2022-02-02T21:29:08.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb05d291700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058060680 con 0x7fb0580f5ed0 2022-02-02T21:29:08.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43068/0 (socket says 172.21.15.96:43068) 2022-02-02T21:29:08.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 -- 172.21.15.96:0/1273996812 learned_addr learned my addr 172.21.15.96:0/1273996812 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:08.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb0567fc700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 0x7fb05810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 -- 172.21.15.96:0/1273996812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 msgr2=0x7fb05810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 0x7fb05810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 -- 172.21.15.96:0/1273996812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c005040 con 0x7fb0580f55c0 2022-02-02T21:29:08.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.496+0000 7fb056ffd700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 secure :-1 s=READY pgs=2879 cs=0 l=1 rev1=1 rx=0x7fb04c009990 tx=0x7fb04c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.497+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04c018070 con 0x7fb0580f55c0 2022-02-02T21:29:08.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.497+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb04c007ba0 con 0x7fb0580f55c0 2022-02-02T21:29:08.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.497+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05810c6c0 con 0x7fb0580f55c0 2022-02-02T21:29:08.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.497+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04c01c3c0 con 0x7fb0580f55c0 2022-02-02T21:29:08.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.497+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05810cc20 con 0x7fb0580f55c0 2022-02-02T21:29:08.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.498+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb058045ad0 con 0x7fb0580f55c0 2022-02-02T21:29:08.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.498+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb04c01d420 con 0x7fb0580f55c0 2022-02-02T21:29:08.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.499+0000 7fb03f7fe700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 0x7fb040067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.499+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb04c083630 con 0x7fb0580f55c0 2022-02-02T21:29:08.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.499+0000 7fb0567fc700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 0x7fb040067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.499+0000 7fb0567fc700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 0x7fb040067290 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7fb048004c40 tx=0x7fb04800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.503+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb04c051730 con 0x7fb0580f55c0 2022-02-02T21:29:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.735+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0580fde50 con 0x7fb0580f55c0 2022-02-02T21:29:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.736+0000 7fb03f7fe700 1 -- 172.21.15.96:0/1273996812 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb04c054d50 con 0x7fb0580f55c0 2022-02-02T21:29:08.738 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:29:08.739 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:29:08.739 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:29:08.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:08.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:29:08.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:29:08.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:08.741 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:29:08.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:29:08.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:08.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:29:08.742 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:29:08.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:08.743 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:29:08.743 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:29:08.743 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:29:08.744 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:29:08.744 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:29:08.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 msgr2=0x7fb040067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 0x7fb040067290 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7fb048004c40 tx=0x7fb04800b040).stop 2022-02-02T21:29:08.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 msgr2=0x7fb058109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 secure :-1 s=READY pgs=2879 cs=0 l=1 rev1=1 rx=0x7fb04c009990 tx=0x7fb04c009b30).stop 2022-02-02T21:29:08.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 shutdown_connections 2022-02-02T21:29:08.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb040064dd0 0x7fb040067290 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0580f55c0 0x7fb058109c70 unknown :-1 s=CLOSED pgs=2879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 --2- 172.21.15.96:0/1273996812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580f5ed0 0x7fb05810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 >> 172.21.15.96:0/1273996812 conn(0x7fb0580f0de0 msgr2=0x7fb0580fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 shutdown_connections 2022-02-02T21:29:08.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.738+0000 7fb05d291700 1 -- 172.21.15.96:0/1273996812 wait complete. 2022-02-02T21:29:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:08 smithi096 ceph-mon[101353]: from='client.39858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:08 smithi096 ceph-mon[101353]: pgmap v5611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 -- 172.21.15.96:0/151015470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 msgr2=0x7fd4f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/151015470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f00f59e0 secure :-1 s=READY pgs=2880 cs=0 l=1 rev1=1 rx=0x7fd4e80099e0 tx=0x7fd4e8004d10).stop 2022-02-02T21:29:08.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 -- 172.21.15.96:0/151015470 shutdown_connections 2022-02-02T21:29:08.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/151015470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/151015470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f00f59e0 unknown :-1 s=CLOSED pgs=2880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 -- 172.21.15.96:0/151015470 >> 172.21.15.96:0/151015470 conn(0x7fd4f00f0d40 msgr2=0x7fd4f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:08.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 -- 172.21.15.96:0/151015470 shutdown_connections 2022-02-02T21:29:08.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.836+0000 7fd4f7f62700 1 -- 172.21.15.96:0/151015470 wait complete. 2022-02-02T21:29:08.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 Processor -- start 2022-02-02T21:29:08.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 -- start start 2022-02-02T21:29:08.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f010c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00603e0 con 0x7fd4f00f55c0 2022-02-02T21:29:08.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f7f62700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0060520 con 0x7fd4f00f6860 2022-02-02T21:29:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43078/0 (socket says 172.21.15.96:43078) 2022-02-02T21:29:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 -- 172.21.15.96:0/236607723 learned_addr learned my addr 172.21.15.96:0/236607723 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f54fd700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f010c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 -- 172.21.15.96:0/236607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 msgr2=0x7fd4f010c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f010c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:08.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 -- 172.21.15.96:0/236607723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8009640 con 0x7fd4f00f55c0 2022-02-02T21:29:08.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f54fd700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f010c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:29:08.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.837+0000 7fd4f5cfe700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 secure :-1 s=READY pgs=2881 cs=0 l=1 rev1=1 rx=0x7fd4e800c010 tx=0x7fd4e8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.838+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e800e070 con 0x7fd4f00f55c0 2022-02-02T21:29:08.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.838+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd4e8007dc0 con 0x7fd4f00f55c0 2022-02-02T21:29:08.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.838+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f010c740 con 0x7fd4f00f55c0 2022-02-02T21:29:08.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.838+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e8018070 con 0x7fd4f00f55c0 2022-02-02T21:29:08.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.838+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f010cc20 con 0x7fd4f00f55c0 2022-02-02T21:29:08.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.839+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f0045ad0 con 0x7fd4f00f55c0 2022-02-02T21:29:08.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.840+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd4e8024060 con 0x7fd4f00f55c0 2022-02-02T21:29:08.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.841+0000 7fd4ee7fc700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 0x7fd4d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:08.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.841+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd4e8083530 con 0x7fd4f00f55c0 2022-02-02T21:29:08.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.841+0000 7fd4f54fd700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 0x7fd4d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:08.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.841+0000 7fd4f54fd700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 0x7fd4d8067290 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fd4e4009740 tx=0x7fd4e4009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:08.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:08.844+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd4e80515f0 con 0x7fd4f00f55c0 2022-02-02T21:29:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:08 smithi159 ceph-mon[69013]: from='client.39858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:08 smithi159 ceph-mon[69013]: pgmap v5611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:09.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.046+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4f00fde80 con 0x7fd4f00f55c0 2022-02-02T21:29:09.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.047+0000 7fd4ee7fc700 1 -- 172.21.15.96:0/236607723 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd4e8022720 con 0x7fd4f00f55c0 2022-02-02T21:29:09.049 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:29:09.049 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:29:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:29:09.050 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:29:09.050 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:29:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:29:09.051 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:29:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:29:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:29:09.052 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:29:09.053 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:29:09.053 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:29:09.053 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:29:09.054 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:29:09.054 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:29:09.055 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:29:09.055 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:29:09.056 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:29:09.057 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:29:09.057 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:29:09.058 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:29:09.059 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:29:09.060 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:29:09.060 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:29:09.061 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:29:09.061 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:29:09.062 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:29:09.062 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:29:09.063 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:29:09.064 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:29:09.064 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:29:09.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:09.066 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:09.066 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:29:09.067 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:09.067 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:09.068 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:09.069 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:09.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 msgr2=0x7fd4d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 0x7fd4d8067290 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fd4e4009740 tx=0x7fd4e4009be0).stop 2022-02-02T21:29:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 msgr2=0x7fd4f0109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 secure :-1 s=READY pgs=2881 cs=0 l=1 rev1=1 rx=0x7fd4e800c010 tx=0x7fd4e8004d10).stop 2022-02-02T21:29:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 shutdown_connections 2022-02-02T21:29:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4d8064dd0 0x7fd4d8067290 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f00f55c0 0x7fd4f0109cf0 unknown :-1 s=CLOSED pgs=2881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 --2- 172.21.15.96:0/236607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f00f6860 0x7fd4f010c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:09.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 >> 172.21.15.96:0/236607723 conn(0x7fd4f00f0d40 msgr2=0x7fd4f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:09.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 shutdown_connections 2022-02-02T21:29:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:09.050+0000 7fd4f7f62700 1 -- 172.21.15.96:0/236607723 wait complete. 2022-02-02T21:29:09.077 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:29:09.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:09 smithi096 ceph-mon[101353]: from='client.39862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:09.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1273996812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:29:09.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/236607723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:29:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:09 smithi159 ceph-mon[69013]: from='client.39862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1273996812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:29:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/236607723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:29:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:10 smithi159 ceph-mon[69013]: pgmap v5612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:10 smithi096 ceph-mon[101353]: pgmap v5612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:13 smithi159 ceph-mon[69013]: pgmap v5613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:13 smithi096 ceph-mon[101353]: pgmap v5613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:15 smithi159 ceph-mon[69013]: pgmap v5614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:15 smithi096 ceph-mon[101353]: pgmap v5614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:17 smithi159 ceph-mon[69013]: pgmap v5615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:17 smithi096 ceph-mon[101353]: pgmap v5615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:18 smithi159 ceph-mon[69013]: pgmap v5616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:18 smithi096 ceph-mon[101353]: pgmap v5616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:21 smithi159 ceph-mon[69013]: pgmap v5617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:21 smithi096 ceph-mon[101353]: pgmap v5617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:23 smithi159 ceph-mon[69013]: pgmap v5618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:23 smithi096 ceph-mon[101353]: pgmap v5618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:25 smithi159 ceph-mon[69013]: pgmap v5619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:25 smithi096 ceph-mon[101353]: pgmap v5619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:27 smithi159 ceph-mon[69013]: pgmap v5620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:27 smithi096 ceph-mon[101353]: pgmap v5620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:29:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:29:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:28 smithi159 ceph-mon[69013]: pgmap v5621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:29:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:29:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:28 smithi096 ceph-mon[101353]: pgmap v5621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:31 smithi159 ceph-mon[69013]: pgmap v5622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:31 smithi096 ceph-mon[101353]: pgmap v5622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:33 smithi159 ceph-mon[69013]: pgmap v5623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:33 smithi096 ceph-mon[101353]: pgmap v5623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:35 smithi159 ceph-mon[69013]: pgmap v5624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:35 smithi096 ceph-mon[101353]: pgmap v5624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:37 smithi159 ceph-mon[69013]: pgmap v5625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:37 smithi096 ceph-mon[101353]: pgmap v5625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:38 smithi159 ceph-mon[69013]: pgmap v5626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:38 smithi096 ceph-mon[101353]: pgmap v5626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:39.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 -- 172.21.15.96:0/2598296744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 msgr2=0x7f89140fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 --2- 172.21.15.96:0/2598296744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f89140fbc90 secure :-1 s=READY pgs=2882 cs=0 l=1 rev1=1 rx=0x7f8904004660 tx=0x7f8904009b30).stop 2022-02-02T21:29:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 -- 172.21.15.96:0/2598296744 shutdown_connections 2022-02-02T21:29:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 --2- 172.21.15.96:0/2598296744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f89140fbc90 unknown :-1 s=CLOSED pgs=2882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 --2- 172.21.15.96:0/2598296744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f89140f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 -- 172.21.15.96:0/2598296744 >> 172.21.15.96:0/2598296744 conn(0x7f89140f0d70 msgr2=0x7f89140f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 -- 172.21.15.96:0/2598296744 shutdown_connections 2022-02-02T21:29:39.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.158+0000 7f891883b700 1 -- 172.21.15.96:0/2598296744 wait complete. 2022-02-02T21:29:39.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 Processor -- start 2022-02-02T21:29:39.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 -- start start 2022-02-02T21:29:39.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f8914106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141079e0 con 0x7f89140f9840 2022-02-02T21:29:39.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f891883b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8914107b20 con 0x7f8914060350 2022-02-02T21:29:39.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f8911d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f8911d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43100/0 (socket says 172.21.15.96:43100) 2022-02-02T21:29:39.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.159+0000 7f8911d9b700 1 -- 172.21.15.96:0/4026089115 learned_addr learned my addr 172.21.15.96:0/4026089115 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:39.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f891259c700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f8914106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8911d9b700 1 -- 172.21.15.96:0/4026089115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 msgr2=0x7f8914106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8911d9b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f8914106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8911d9b700 1 -- 172.21.15.96:0/4026089115 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904005040 con 0x7f89140f9840 2022-02-02T21:29:39.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f891259c700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f8914106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:29:39.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8911d9b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 secure :-1 s=READY pgs=2883 cs=0 l=1 rev1=1 rx=0x7f8904013a70 tx=0x7f8904009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8904018070 con 0x7f89140f9840 2022-02-02T21:29:39.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8904007ba0 con 0x7f89140f9840 2022-02-02T21:29:39.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f890401c3c0 con 0x7f89140f9840 2022-02-02T21:29:39.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8914108460 con 0x7f89140f9840 2022-02-02T21:29:39.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.160+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89141089c0 con 0x7f89140f9840 2022-02-02T21:29:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.161+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914045ad0 con 0x7f89140f9840 2022-02-02T21:29:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.162+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f890401d420 con 0x7f89140f9840 2022-02-02T21:29:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.162+0000 7f8902ffd700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 0x7f88fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.162+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8904083830 con 0x7f89140f9840 2022-02-02T21:29:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.162+0000 7f891259c700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 0x7f88fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.162+0000 7f891259c700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 0x7f88fc067290 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f8908009fd0 tx=0x7f890800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.166+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8904055420 con 0x7f89140f9840 2022-02-02T21:29:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.347+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8914108be0 con 0x7f88fc064dd0 2022-02-02T21:29:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.348+0000 7f8902ffd700 1 -- 172.21.15.96:0/4026089115 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8914108be0 con 0x7f88fc064dd0 2022-02-02T21:29:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 msgr2=0x7f88fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 0x7f88fc067290 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f8908009fd0 tx=0x7f890800b040).stop 2022-02-02T21:29:39.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 msgr2=0x7f8914107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 secure :-1 s=READY pgs=2883 cs=0 l=1 rev1=1 rx=0x7f8904013a70 tx=0x7f8904009b30).stop 2022-02-02T21:29:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 shutdown_connections 2022-02-02T21:29:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88fc064dd0 0x7f88fc067290 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8914060350 0x7f8914106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 --2- 172.21.15.96:0/4026089115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140f9840 0x7f8914107430 unknown :-1 s=CLOSED pgs=2883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 >> 172.21.15.96:0/4026089115 conn(0x7f89140f0d70 msgr2=0x7f89140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 shutdown_connections 2022-02-02T21:29:39.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.350+0000 7f891883b700 1 -- 172.21.15.96:0/4026089115 wait complete. 2022-02-02T21:29:39.360 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:29:39.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 -- 172.21.15.96:0/3764373867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f55c0 msgr2=0x7fb8840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3764373867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f55c0 0x7fb8840f59e0 secure :-1 s=READY pgs=2884 cs=0 l=1 rev1=1 rx=0x7fb878004660 tx=0x7fb878009b30).stop 2022-02-02T21:29:39.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 -- 172.21.15.96:0/3764373867 shutdown_connections 2022-02-02T21:29:39.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3764373867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f6860 0x7fb8840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3764373867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f55c0 0x7fb8840f59e0 unknown :-1 s=CLOSED pgs=2884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 -- 172.21.15.96:0/3764373867 >> 172.21.15.96:0/3764373867 conn(0x7fb8840f0d40 msgr2=0x7fb8840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 -- 172.21.15.96:0/3764373867 shutdown_connections 2022-02-02T21:29:39.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 -- 172.21.15.96:0/3764373867 wait complete. 2022-02-02T21:29:39.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.448+0000 7fb888a3b700 1 Processor -- start 2022-02-02T21:29:39.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb888a3b700 1 -- start start 2022-02-02T21:29:39.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb888a3b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f55c0 0x7fb884109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb888a3b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb888a3b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8840603c0 con 0x7fb8840f6860 2022-02-02T21:29:39.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb888a3b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884060500 con 0x7fb8840f55c0 2022-02-02T21:29:39.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43110/0 (socket says 172.21.15.96:43110) 2022-02-02T21:29:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 -- 172.21.15.96:0/3419342835 learned_addr learned my addr 172.21.15.96:0/3419342835 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb88259c700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f55c0 0x7fb884109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 -- 172.21.15.96:0/3419342835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f55c0 msgr2=0x7fb884109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f55c0 0x7fb884109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 -- 172.21.15.96:0/3419342835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878005040 con 0x7fb8840f6860 2022-02-02T21:29:39.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.449+0000 7fb881d9b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 secure :-1 s=READY pgs=2885 cs=0 l=1 rev1=1 rx=0x7fb8740026d0 tx=0x7fb874009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.450+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8740079c0 con 0x7fb8840f6860 2022-02-02T21:29:39.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.450+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88410c740 con 0x7fb8840f6860 2022-02-02T21:29:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.450+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88410ccd0 con 0x7fb8840f6860 2022-02-02T21:29:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.450+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb87400f040 con 0x7fb8840f6860 2022-02-02T21:29:39.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.450+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8740148b0 con 0x7fb8840f6860 2022-02-02T21:29:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.451+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb868004fa0 con 0x7fb8840f6860 2022-02-02T21:29:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.451+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb874014a10 con 0x7fb8840f6860 2022-02-02T21:29:39.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.451+0000 7fb872ffd700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 0x7fb86c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.451+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb8740818a0 con 0x7fb8840f6860 2022-02-02T21:29:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.452+0000 7fb88259c700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 0x7fb86c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.452+0000 7fb88259c700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 0x7fb86c067290 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fb878013690 tx=0x7fb878009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.456+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb87404f9a0 con 0x7fb8840f6860 2022-02-02T21:29:39.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.628+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb868000bc0 con 0x7fb86c064dd0 2022-02-02T21:29:39.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.638+0000 7fb872ffd700 1 -- 172.21.15.96:0/3419342835 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb868000bc0 con 0x7fb86c064dd0 2022-02-02T21:29:39.638 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:29:39.639 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:29:39.639 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:29:39.639 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:29:39.640 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:29:39.640 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:29:39.640 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:29:39.641 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:29:39.641 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:29:39.641 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:29:39.642 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:29:39.642 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:29:39.643 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:29:39.643 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:29:39.643 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:29:39.644 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:29:39.644 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:29:39.644 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:29:39.645 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:29:39.645 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:29:39.645 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:29:39.646 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:29:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 msgr2=0x7fb86c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 0x7fb86c067290 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fb878013690 tx=0x7fb878009b30).stop 2022-02-02T21:29:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 msgr2=0x7fb88410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 secure :-1 s=READY pgs=2885 cs=0 l=1 rev1=1 rx=0x7fb8740026d0 tx=0x7fb874009de0).stop 2022-02-02T21:29:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 shutdown_connections 2022-02-02T21:29:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb86c064dd0 0x7fb86c067290 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8840f55c0 0x7fb884109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 --2- 172.21.15.96:0/3419342835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8840f6860 0x7fb88410c190 unknown :-1 s=CLOSED pgs=2885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 >> 172.21.15.96:0/3419342835 conn(0x7fb8840f0d40 msgr2=0x7fb8840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 shutdown_connections 2022-02-02T21:29:39.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.639+0000 7fb888a3b700 1 -- 172.21.15.96:0/3419342835 wait complete. 2022-02-02T21:29:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 -- 172.21.15.96:0/593781955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 msgr2=0x7faedc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 --2- 172.21.15.96:0/593781955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc0f7c30 secure :-1 s=READY pgs=2886 cs=0 l=1 rev1=1 rx=0x7faecc004660 tx=0x7faecc009b30).stop 2022-02-02T21:29:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 -- 172.21.15.96:0/593781955 shutdown_connections 2022-02-02T21:29:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 --2- 172.21.15.96:0/593781955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc0f7c30 unknown :-1 s=CLOSED pgs=2886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 --2- 172.21.15.96:0/593781955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.735+0000 7faee27ec700 1 -- 172.21.15.96:0/593781955 >> 172.21.15.96:0/593781955 conn(0x7faedc0f1c90 msgr2=0x7faedc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.736+0000 7faee27ec700 1 -- 172.21.15.96:0/593781955 shutdown_connections 2022-02-02T21:29:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.736+0000 7faee27ec700 1 -- 172.21.15.96:0/593781955 wait complete. 2022-02-02T21:29:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 Processor -- start 2022-02-02T21:29:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 -- start start 2022-02-02T21:29:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc107830 con 0x7faedc0f77d0 2022-02-02T21:29:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee27ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc108040 con 0x7faedc0f6530 2022-02-02T21:29:39.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee0fe9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee17ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee0fe9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43120/0 (socket says 172.21.15.96:43120) 2022-02-02T21:29:39.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee0fe9700 1 -- 172.21.15.96:0/1275484088 learned_addr learned my addr 172.21.15.96:0/1275484088 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:39.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee0fe9700 1 -- 172.21.15.96:0/1275484088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 msgr2=0x7faedc106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.737+0000 7faee0fe9700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faee0fe9700 1 -- 172.21.15.96:0/1275484088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc005040 con 0x7faedc0f77d0 2022-02-02T21:29:39.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faee17ea700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:29:39.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faee0fe9700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 secure :-1 s=READY pgs=2887 cs=0 l=1 rev1=1 rx=0x7faecc000c00 tx=0x7faecc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faecc019070 con 0x7faedc0f77d0 2022-02-02T21:29:39.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc108260 con 0x7faedc0f77d0 2022-02-02T21:29:39.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faecc007e70 con 0x7faedc0f77d0 2022-02-02T21:29:39.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faecc014ce0 con 0x7faedc0f77d0 2022-02-02T21:29:39.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.738+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc1087c0 con 0x7faedc0f77d0 2022-02-02T21:29:39.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.739+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc059100 con 0x7faedc0f77d0 2022-02-02T21:29:39.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.740+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faecc025070 con 0x7faedc0f77d0 2022-02-02T21:29:39.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.740+0000 7faed1ffb700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 0x7faec80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.740+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faecc0829e0 con 0x7faedc0f77d0 2022-02-02T21:29:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.740+0000 7faee17ea700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 0x7faec80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.741+0000 7faee17ea700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 0x7faec80672e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7faedc106ab0 tx=0x7faed800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:39.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.744+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faecc050ae0 con 0x7faedc0f77d0 2022-02-02T21:29:39.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.973+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faedc0fedf0 con 0x7faedc0f77d0 2022-02-02T21:29:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.973+0000 7faed1ffb700 1 -- 172.21.15.96:0/1275484088 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faecc023070 con 0x7faedc0f77d0 2022-02-02T21:29:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:29:39.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:29:39.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:29:39.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:39.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:29:39.976 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:29:39.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:39.977 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:29:39.977 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:29:39.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:39.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:29:39.978 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:29:39.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:29:39.979 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:29:39.979 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:29:39.980 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:29:39.980 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:29:39.981 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:29:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 msgr2=0x7faec80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 0x7faec80672e0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7faedc106ab0 tx=0x7faed800b040).stop 2022-02-02T21:29:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 msgr2=0x7faedc107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 secure :-1 s=READY pgs=2887 cs=0 l=1 rev1=1 rx=0x7faecc000c00 tx=0x7faecc00b040).stop 2022-02-02T21:29:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 shutdown_connections 2022-02-02T21:29:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faec8064e20 0x7faec80672e0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faedc0f6530 0x7faedc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 --2- 172.21.15.96:0/1275484088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faedc0f77d0 0x7faedc107230 unknown :-1 s=CLOSED pgs=2887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 >> 172.21.15.96:0/1275484088 conn(0x7faedc0f1c90 msgr2=0x7faedc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 shutdown_connections 2022-02-02T21:29:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:39.976+0000 7faee27ec700 1 -- 172.21.15.96:0/1275484088 wait complete. 2022-02-02T21:29:40.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/367348797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 msgr2=0x7fd5d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:40.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/367348797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d40f6cc0 secure :-1 s=READY pgs=2888 cs=0 l=1 rev1=1 rx=0x7fd5d0004660 tx=0x7fd5d0009b30).stop 2022-02-02T21:29:40.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/367348797 shutdown_connections 2022-02-02T21:29:40.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/367348797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f6860 0x7fd5d40f6cc0 unknown :-1 s=CLOSED pgs=2888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/367348797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f55c0 0x7fd5d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/367348797 >> 172.21.15.96:0/367348797 conn(0x7fd5d40f0d40 msgr2=0x7fd5d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:40.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/367348797 shutdown_connections 2022-02-02T21:29:40.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.073+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/367348797 wait complete. 2022-02-02T21:29:40.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 Processor -- start 2022-02-02T21:29:40.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 -- start start 2022-02-02T21:29:40.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:40.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:40.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d40603e0 con 0x7fd5d40f55c0 2022-02-02T21:29:40.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5dbe4c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4060520 con 0x7fd5d40f6860 2022-02-02T21:29:40.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5d9be8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:40.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5d9be8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43128/0 (socket says 172.21.15.96:43128) 2022-02-02T21:29:40.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5d9be8700 1 -- 172.21.15.96:0/675802285 learned_addr learned my addr 172.21.15.96:0/675802285 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:29:40.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.074+0000 7fd5d93e7700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:40.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5d9be8700 1 -- 172.21.15.96:0/675802285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f6860 msgr2=0x7fd5d410c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:40.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5d9be8700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5d9be8700 1 -- 172.21.15.96:0/675802285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0005040 con 0x7fd5d40f55c0 2022-02-02T21:29:40.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5d9be8700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 secure :-1 s=READY pgs=2889 cs=0 l=1 rev1=1 rx=0x7fd5c8002700 tx=0x7fd5c8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:40.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c8009320 con 0x7fd5d40f55c0 2022-02-02T21:29:40.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d410c710 con 0x7fd5d40f55c0 2022-02-02T21:29:40.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5c800f040 con 0x7fd5d40f55c0 2022-02-02T21:29:40.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c8014780 con 0x7fd5d40f55c0 2022-02-02T21:29:40.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.075+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d410ccd0 con 0x7fd5d40f55c0 2022-02-02T21:29:40.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.076+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d4045ad0 con 0x7fd5d40f55c0 2022-02-02T21:29:40.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.076+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd5c8009480 con 0x7fd5d40f55c0 2022-02-02T21:29:40.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.077+0000 7fd5c67fc700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:29:40.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.077+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd5c8082090 con 0x7fd5d40f55c0 2022-02-02T21:29:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.077+0000 7fd5d93e7700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:29:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.077+0000 7fd5d93e7700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fd5d0004630 tx=0x7fd5d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:29:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.081+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5c8050130 con 0x7fd5d40f55c0 2022-02-02T21:29:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.280+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5d40fdeb0 con 0x7fd5d40f55c0 2022-02-02T21:29:40.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1275484088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:29:40.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.280+0000 7fd5c67fc700 1 -- 172.21.15.96:0/675802285 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd5c8053750 con 0x7fd5d40f55c0 2022-02-02T21:29:40.283 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:29:40.283 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:29:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:29:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:29:40.284 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:29:40.285 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:29:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:29:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:29:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:29:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:29:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:29:40.287 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:29:40.288 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:29:40.288 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:29:40.289 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:29:40.289 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:29:40.289 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:29:40.290 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:29:40.290 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:29:40.291 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:29:40.291 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:29:40.291 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:29:40.292 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:29:40.292 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:29:40.292 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:29:40.293 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:29:40.293 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:29:40.293 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:29:40.294 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:29:40.294 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:29:40.294 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:29:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:40.295 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:29:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:29:40.296 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:40.297 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:40.297 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:29:40.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 msgr2=0x7fd5c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:40.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fd5d0004630 tx=0x7fd5d0009b30).stop 2022-02-02T21:29:40.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 msgr2=0x7fd5d4109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:29:40.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 secure :-1 s=READY pgs=2889 cs=0 l=1 rev1=1 rx=0x7fd5c8002700 tx=0x7fd5c8009d60).stop 2022-02-02T21:29:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 shutdown_connections 2022-02-02T21:29:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5c0064dd0 0x7fd5c0067290 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5d40f55c0 0x7fd5d4109c60 unknown :-1 s=CLOSED pgs=2889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 --2- 172.21.15.96:0/675802285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5d40f6860 0x7fd5d410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:29:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 >> 172.21.15.96:0/675802285 conn(0x7fd5d40f0d40 msgr2=0x7fd5d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:29:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 shutdown_connections 2022-02-02T21:29:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:29:40.282+0000 7fd5dbe4c700 1 -- 172.21.15.96:0/675802285 wait complete. 2022-02-02T21:29:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:29:40.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1275484088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:29:41.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:41 smithi096 ceph-mon[101353]: from='client.39874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:41 smithi096 ceph-mon[101353]: from='client.39878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:41 smithi096 ceph-mon[101353]: pgmap v5627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:41.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/675802285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:29:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:41 smithi159 ceph-mon[69013]: from='client.39874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:41 smithi159 ceph-mon[69013]: from='client.39878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:29:41.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:41 smithi159 ceph-mon[69013]: pgmap v5627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:41.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/675802285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:29:43.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:43 smithi159 ceph-mon[69013]: pgmap v5628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:43 smithi096 ceph-mon[101353]: pgmap v5628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:45 smithi159 ceph-mon[69013]: pgmap v5629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:45 smithi096 ceph-mon[101353]: pgmap v5629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:47 smithi159 ceph-mon[69013]: pgmap v5630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:47 smithi096 ceph-mon[101353]: pgmap v5630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:48 smithi159 ceph-mon[69013]: pgmap v5631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:48 smithi096 ceph-mon[101353]: pgmap v5631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:51 smithi159 ceph-mon[69013]: pgmap v5632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:51 smithi096 ceph-mon[101353]: pgmap v5632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:53.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:53 smithi159 ceph-mon[69013]: pgmap v5633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:53 smithi096 ceph-mon[101353]: pgmap v5633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:55 smithi159 ceph-mon[69013]: pgmap v5634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:55 smithi096 ceph-mon[101353]: pgmap v5634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:57 smithi159 ceph-mon[69013]: pgmap v5635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:57 smithi096 ceph-mon[101353]: pgmap v5635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:29:58 smithi159 ceph-mon[69013]: pgmap v5636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:29:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:29:58 smithi096 ceph-mon[101353]: pgmap v5636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:30:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:30:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:01 smithi159 ceph-mon[69013]: pgmap v5637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:01 smithi096 ceph-mon[101353]: pgmap v5637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:03 smithi159 ceph-mon[69013]: pgmap v5638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:03 smithi096 ceph-mon[101353]: pgmap v5638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:05 smithi159 ceph-mon[69013]: pgmap v5639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:05 smithi096 ceph-mon[101353]: pgmap v5639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:07 smithi159 ceph-mon[69013]: pgmap v5640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:07 smithi096 ceph-mon[101353]: pgmap v5640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:08 smithi159 ceph-mon[69013]: pgmap v5641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:08 smithi096 ceph-mon[101353]: pgmap v5641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:10.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 -- 172.21.15.96:0/13986676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f6860 msgr2=0x7ff2500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 --2- 172.21.15.96:0/13986676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f6860 0x7ff2500f6cc0 secure :-1 s=READY pgs=2890 cs=0 l=1 rev1=1 rx=0x7ff244004660 tx=0x7ff244009b30).stop 2022-02-02T21:30:10.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 -- 172.21.15.96:0/13986676 shutdown_connections 2022-02-02T21:30:10.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 --2- 172.21.15.96:0/13986676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f6860 0x7ff2500f6cc0 unknown :-1 s=CLOSED pgs=2890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 --2- 172.21.15.96:0/13986676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f55c0 0x7ff2500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 -- 172.21.15.96:0/13986676 >> 172.21.15.96:0/13986676 conn(0x7ff2500f0d40 msgr2=0x7ff2500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:10.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 -- 172.21.15.96:0/13986676 shutdown_connections 2022-02-02T21:30:10.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 -- 172.21.15.96:0/13986676 wait complete. 2022-02-02T21:30:10.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.393+0000 7ff2569a5700 1 Processor -- start 2022-02-02T21:30:10.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff2569a5700 1 -- start start 2022-02-02T21:30:10.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff2569a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff2569a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f6860 0x7ff25010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff2569a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500603e0 con 0x7ff2500f55c0 2022-02-02T21:30:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff2569a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250060520 con 0x7ff2500f6860 2022-02-02T21:30:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43146/0 (socket says 172.21.15.96:43146) 2022-02-02T21:30:10.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 -- 172.21.15.96:0/2822237829 learned_addr learned my addr 172.21.15.96:0/2822237829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24f7fe700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f6860 0x7ff25010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 -- 172.21.15.96:0/2822237829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f6860 msgr2=0x7ff25010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f6860 0x7ff25010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.394+0000 7ff24ffff700 1 -- 172.21.15.96:0/2822237829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244005040 con 0x7ff2500f55c0 2022-02-02T21:30:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff24ffff700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 secure :-1 s=READY pgs=2891 cs=0 l=1 rev1=1 rx=0x7ff240002700 tx=0x7ff240009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2400079c0 con 0x7ff2500f55c0 2022-02-02T21:30:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25010c700 con 0x7ff2500f55c0 2022-02-02T21:30:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff24000f040 con 0x7ff2500f55c0 2022-02-02T21:30:10.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff240014860 con 0x7ff2500f55c0 2022-02-02T21:30:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.395+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25010ccc0 con 0x7ff2500f55c0 2022-02-02T21:30:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.396+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250045ad0 con 0x7ff2500f55c0 2022-02-02T21:30:10.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.396+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff24001b060 con 0x7ff2500f55c0 2022-02-02T21:30:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.397+0000 7ff24cff9700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 0x7ff238067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.397+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff240081810 con 0x7ff2500f55c0 2022-02-02T21:30:10.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.397+0000 7ff24f7fe700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 0x7ff238067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.397+0000 7ff24f7fe700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 0x7ff238067290 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7ff244004630 tx=0x7ff244009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.401+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff24004f910 con 0x7ff2500f55c0 2022-02-02T21:30:10.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.580+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2500fdec0 con 0x7ff238064dd0 2022-02-02T21:30:10.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.581+0000 7ff24cff9700 1 -- 172.21.15.96:0/2822237829 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff2500fdec0 con 0x7ff238064dd0 2022-02-02T21:30:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 msgr2=0x7ff238067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 0x7ff238067290 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7ff244004630 tx=0x7ff244009b30).stop 2022-02-02T21:30:10.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 msgr2=0x7ff250109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 secure :-1 s=READY pgs=2891 cs=0 l=1 rev1=1 rx=0x7ff240002700 tx=0x7ff240009d80).stop 2022-02-02T21:30:10.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 shutdown_connections 2022-02-02T21:30:10.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff238064dd0 0x7ff238067290 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2500f55c0 0x7ff250109c50 unknown :-1 s=CLOSED pgs=2891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 --2- 172.21.15.96:0/2822237829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2500f6860 0x7ff25010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 >> 172.21.15.96:0/2822237829 conn(0x7ff2500f0d40 msgr2=0x7ff2500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:10.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 shutdown_connections 2022-02-02T21:30:10.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.583+0000 7ff2569a5700 1 -- 172.21.15.96:0/2822237829 wait complete. 2022-02-02T21:30:10.593 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:30:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/3077796527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f6860 msgr2=0x7f5a9c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/3077796527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c0f6cc0 secure :-1 s=READY pgs=2892 cs=0 l=1 rev1=1 rx=0x7f5a88004660 tx=0x7f5a88009b30).stop 2022-02-02T21:30:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/3077796527 shutdown_connections 2022-02-02T21:30:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/3077796527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c0f6cc0 unknown :-1 s=CLOSED pgs=2892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/3077796527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/3077796527 >> 172.21.15.96:0/3077796527 conn(0x7f5a9c0f0d40 msgr2=0x7f5a9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/3077796527 shutdown_connections 2022-02-02T21:30:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.681+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/3077796527 wait complete. 2022-02-02T21:30:10.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 Processor -- start 2022-02-02T21:30:10.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 -- start start 2022-02-02T21:30:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0603e0 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa2cdb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c060520 con 0x7f5a9c0f6860 2022-02-02T21:30:10.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43156/0 (socket says 172.21.15.96:43156) 2022-02-02T21:30:10.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 -- 172.21.15.96:0/312141108 learned_addr learned my addr 172.21.15.96:0/312141108 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:10.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5a9bfff700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 -- 172.21.15.96:0/312141108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f6860 msgr2=0x7f5a9c10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c10c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.682+0000 7f5aa0a77700 1 -- 172.21.15.96:0/312141108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88005040 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5aa0a77700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 secure :-1 s=READY pgs=2893 cs=0 l=1 rev1=1 rx=0x7f5a9000c790 tx=0x7f5a90007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a90013630 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c10c700 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a90012860 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a90002780 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.683+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c10ccc0 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.684+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c045ad0 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.684+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a90010070 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.685+0000 7f5a997fa700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 0x7f5a8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.685+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a90081b30 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.685+0000 7f5a9bfff700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 0x7f5a8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.685+0000 7f5a9bfff700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 0x7f5a8c067290 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f5a88004630 tx=0x7f5a88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.689+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a9004fbd0 con 0x7f5a9c0f55c0 2022-02-02T21:30:10.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.861+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a9c0fde90 con 0x7f5a8c064dd0 2022-02-02T21:30:10.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.870+0000 7f5a997fa700 1 -- 172.21.15.96:0/312141108 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5a9c0fde90 con 0x7f5a8c064dd0 2022-02-02T21:30:10.871 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:30:10.871 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:30:10.872 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:30:10.872 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:30:10.872 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:30:10.873 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:30:10.873 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:30:10.873 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:30:10.874 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:30:10.874 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:30:10.874 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:30:10.875 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:30:10.875 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:30:10.875 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:30:10.876 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:30:10.876 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:30:10.876 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:30:10.877 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:30:10.877 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:30:10.877 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:30:10.878 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:30:10.878 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:30:10.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 msgr2=0x7f5a8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 0x7f5a8c067290 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f5a88004630 tx=0x7f5a88009b30).stop 2022-02-02T21:30:10.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 msgr2=0x7f5a9c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 secure :-1 s=READY pgs=2893 cs=0 l=1 rev1=1 rx=0x7f5a9000c790 tx=0x7f5a90007d90).stop 2022-02-02T21:30:10.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 shutdown_connections 2022-02-02T21:30:10.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064dd0 0x7f5a8c067290 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f55c0 0x7f5a9c109c50 unknown :-1 s=CLOSED pgs=2893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 --2- 172.21.15.96:0/312141108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f6860 0x7f5a9c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.872+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 >> 172.21.15.96:0/312141108 conn(0x7f5a9c0f0d40 msgr2=0x7f5a9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:10.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.873+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 shutdown_connections 2022-02-02T21:30:10.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.873+0000 7f5aa2cdb700 1 -- 172.21.15.96:0/312141108 wait complete. 2022-02-02T21:30:10.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 -- 172.21.15.96:0/2723481483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 msgr2=0x7f92e00fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/2723481483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e00fbca0 secure :-1 s=READY pgs=2894 cs=0 l=1 rev1=1 rx=0x7f92d0004660 tx=0x7f92d0009b30).stop 2022-02-02T21:30:10.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 -- 172.21.15.96:0/2723481483 shutdown_connections 2022-02-02T21:30:10.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/2723481483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e00fbca0 unknown :-1 s=CLOSED pgs=2894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/2723481483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 0x7f92e00f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 -- 172.21.15.96:0/2723481483 >> 172.21.15.96:0/2723481483 conn(0x7f92e00f0d40 msgr2=0x7f92e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:10.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 -- 172.21.15.96:0/2723481483 shutdown_connections 2022-02-02T21:30:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.968+0000 7f92e4c2a700 1 -- 172.21.15.96:0/2723481483 wait complete. 2022-02-02T21:30:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 Processor -- start 2022-02-02T21:30:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 -- start start 2022-02-02T21:30:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 0x7f92e0104d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0105800 con 0x7f92e00f9870 2022-02-02T21:30:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92e4c2a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0105940 con 0x7f92e0060370 2022-02-02T21:30:10.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43168/0 (socket says 172.21.15.96:43168) 2022-02-02T21:30:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.969+0000 7f92ddd9b700 1 -- 172.21.15.96:0/879564918 learned_addr learned my addr 172.21.15.96:0/879564918 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:10.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92de59c700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 0x7f92e0104d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92ddd9b700 1 -- 172.21.15.96:0/879564918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 msgr2=0x7f92e0104d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:10.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92ddd9b700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 0x7f92e0104d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:10.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92ddd9b700 1 -- 172.21.15.96:0/879564918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0005040 con 0x7f92e00f9870 2022-02-02T21:30:10.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92ddd9b700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 secure :-1 s=READY pgs=2895 cs=0 l=1 rev1=1 rx=0x7f92d0000c00 tx=0x7f92d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d0018070 con 0x7f92e00f9870 2022-02-02T21:30:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f92d00097d0 con 0x7f92e00f9870 2022-02-02T21:30:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e010b4b0 con 0x7f92e00f9870 2022-02-02T21:30:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e010ba10 con 0x7f92e00f9870 2022-02-02T21:30:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.970+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d001de40 con 0x7f92e00f9870 2022-02-02T21:30:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.971+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4004fa0 con 0x7f92e00f9870 2022-02-02T21:30:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.972+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f92d0007ba0 con 0x7f92e00f9870 2022-02-02T21:30:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.973+0000 7f92d6ffd700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 0x7f92cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.973+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f92d0083570 con 0x7f92e00f9870 2022-02-02T21:30:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.973+0000 7f92de59c700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 0x7f92cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.973+0000 7f92de59c700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 0x7f92cc067290 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f92e0104aa0 tx=0x7f92c800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:10.977+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f92d0051730 con 0x7f92e00f9870 2022-02-02T21:30:11.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.208+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92c4005e80 con 0x7f92e00f9870 2022-02-02T21:30:11.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.208+0000 7f92d6ffd700 1 -- 172.21.15.96:0/879564918 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f92d0054d50 con 0x7f92e00f9870 2022-02-02T21:30:11.211 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:30:11.211 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:30:11.211 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:30:11.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:11.212 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:30:11.212 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:30:11.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:11.213 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:30:11.213 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:30:11.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:11.214 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:30:11.214 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:30:11.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:11.215 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:30:11.215 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:30:11.216 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:30:11.216 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:30:11.216 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:30:11.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 msgr2=0x7f92cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 0x7f92cc067290 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f92e0104aa0 tx=0x7f92c800b040).stop 2022-02-02T21:30:11.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 msgr2=0x7f92e0105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 secure :-1 s=READY pgs=2895 cs=0 l=1 rev1=1 rx=0x7f92d0000c00 tx=0x7f92d0009b30).stop 2022-02-02T21:30:11.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 shutdown_connections 2022-02-02T21:30:11.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f92cc064dd0 0x7f92cc067290 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92e0060370 0x7f92e0104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 --2- 172.21.15.96:0/879564918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92e00f9870 0x7f92e0105200 unknown :-1 s=CLOSED pgs=2895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 >> 172.21.15.96:0/879564918 conn(0x7f92e00f0d40 msgr2=0x7f92e00f5230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:11.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 shutdown_connections 2022-02-02T21:30:11.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.210+0000 7f92e4c2a700 1 -- 172.21.15.96:0/879564918 wait complete. 2022-02-02T21:30:11.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 -- 172.21.15.96:0/3393094696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 msgr2=0x7f74780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3393094696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f74780f59e0 secure :-1 s=READY pgs=2896 cs=0 l=1 rev1=1 rx=0x7f7468004660 tx=0x7f7468009b30).stop 2022-02-02T21:30:11.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 -- 172.21.15.96:0/3393094696 shutdown_connections 2022-02-02T21:30:11.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3393094696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 0x7f74780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3393094696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f74780f59e0 unknown :-1 s=CLOSED pgs=2896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 -- 172.21.15.96:0/3393094696 >> 172.21.15.96:0/3393094696 conn(0x7f74780f0d40 msgr2=0x7f74780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:11.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 -- 172.21.15.96:0/3393094696 shutdown_connections 2022-02-02T21:30:11.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 -- 172.21.15.96:0/3393094696 wait complete. 2022-02-02T21:30:11.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:11 smithi159 ceph-mon[69013]: pgmap v5642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:11.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/879564918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:30:11.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.309+0000 7f747e3ae700 1 Processor -- start 2022-02-02T21:30:11.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f747e3ae700 1 -- start start 2022-02-02T21:30:11.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f747e3ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:11.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f747e3ae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 0x7f747810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:11.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f747e3ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780603c0 con 0x7f74780f55c0 2022-02-02T21:30:11.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f747e3ae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478060500 con 0x7f74780f6860 2022-02-02T21:30:11.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:11.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43174/0 (socket says 172.21.15.96:43174) 2022-02-02T21:30:11.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 -- 172.21.15.96:0/3742038262 learned_addr learned my addr 172.21.15.96:0/3742038262 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:11.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f74777fe700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 0x7f747810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:11.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 -- 172.21.15.96:0/3742038262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 msgr2=0x7f747810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 0x7f747810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.310+0000 7f7477fff700 1 -- 172.21.15.96:0/3742038262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468005040 con 0x7f74780f55c0 2022-02-02T21:30:11.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f7477fff700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 secure :-1 s=READY pgs=2897 cs=0 l=1 rev1=1 rx=0x7f7468013a70 tx=0x7f7468009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:11.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7468018070 con 0x7f74780f55c0 2022-02-02T21:30:11.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f74680097d0 con 0x7f74780f55c0 2022-02-02T21:30:11.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747810c6e0 con 0x7f74780f55c0 2022-02-02T21:30:11.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746801de80 con 0x7f74780f55c0 2022-02-02T21:30:11.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.311+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747810cc10 con 0x7f74780f55c0 2022-02-02T21:30:11.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.312+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7478045ad0 con 0x7f74780f55c0 2022-02-02T21:30:11.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.312+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7468007ba0 con 0x7f74780f55c0 2022-02-02T21:30:11.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.313+0000 7f7474ff9700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 0x7f7464067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:11.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.313+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7468083640 con 0x7f74780f55c0 2022-02-02T21:30:11.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.313+0000 7f74777fe700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 0x7f7464067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:11.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.313+0000 7f74777fe700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 0x7f7464067290 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f7460004c40 tx=0x7f746000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:11.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.317+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7468051740 con 0x7f74780f55c0 2022-02-02T21:30:11.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.520+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74780fdf00 con 0x7f74780f55c0 2022-02-02T21:30:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:11 smithi096 ceph-mon[101353]: pgmap v5642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:11.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/879564918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:30:11.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.520+0000 7f7474ff9700 1 -- 172.21.15.96:0/3742038262 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7468054d60 con 0x7f74780f55c0 2022-02-02T21:30:11.804 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:30:11.804 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:30:11.804 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:30:11.805 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:30:11.805 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:11.805 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:30:11.806 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:30:11.806 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:30:11.808 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:30:11.809 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:30:11.809 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:30:11.809 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:30:11.810 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:30:11.810 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:30:11.811 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:30:11.811 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:30:11.812 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:30:11.812 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:30:11.812 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:30:11.813 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:30:11.813 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:30:11.813 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:30:11.814 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:30:11.814 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:30:11.814 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:30:11.815 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:30:11.815 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:30:11.815 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:30:11.816 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:30:11.816 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:30:11.816 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:30:11.817 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:30:11.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:11.817 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:11.818 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:30:11.818 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:11.818 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:11.819 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:11.819 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:11.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 msgr2=0x7f7464067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 0x7f7464067290 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f7460004c40 tx=0x7f746000b040).stop 2022-02-02T21:30:11.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 msgr2=0x7f7478109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:11.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 secure :-1 s=READY pgs=2897 cs=0 l=1 rev1=1 rx=0x7f7468013a70 tx=0x7f7468009b30).stop 2022-02-02T21:30:11.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 shutdown_connections 2022-02-02T21:30:11.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7464064dd0 0x7f7464067290 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74780f55c0 0x7f7478109c90 unknown :-1 s=CLOSED pgs=2897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 --2- 172.21.15.96:0/3742038262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74780f6860 0x7f747810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:11.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 >> 172.21.15.96:0/3742038262 conn(0x7f74780f0d40 msgr2=0x7f74780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:11.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 shutdown_connections 2022-02-02T21:30:11.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:11.523+0000 7f747e3ae700 1 -- 172.21.15.96:0/3742038262 wait complete. 2022-02-02T21:30:11.824 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:30:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:12 smithi159 ceph-mon[69013]: from='client.39890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:12 smithi159 ceph-mon[69013]: from='client.39894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3742038262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:30:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:12 smithi096 ceph-mon[101353]: from='client.39890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:12 smithi096 ceph-mon[101353]: from='client.39894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:12.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3742038262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:30:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:13 smithi159 ceph-mon[69013]: pgmap v5643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:13 smithi096 ceph-mon[101353]: pgmap v5643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:15 smithi159 ceph-mon[69013]: pgmap v5644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:15 smithi096 ceph-mon[101353]: pgmap v5644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:17 smithi159 ceph-mon[69013]: pgmap v5645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:17 smithi096 ceph-mon[101353]: pgmap v5645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:18 smithi159 ceph-mon[69013]: pgmap v5646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:18 smithi096 ceph-mon[101353]: pgmap v5646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:21 smithi159 ceph-mon[69013]: pgmap v5647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:21 smithi096 ceph-mon[101353]: pgmap v5647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:23.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:23 smithi159 ceph-mon[69013]: pgmap v5648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:23 smithi096 ceph-mon[101353]: pgmap v5648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:25 smithi159 ceph-mon[69013]: pgmap v5649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:25 smithi096 ceph-mon[101353]: pgmap v5649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:27 smithi159 ceph-mon[69013]: pgmap v5650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:27 smithi096 ceph-mon[101353]: pgmap v5650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:30:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:30:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:28 smithi159 ceph-mon[69013]: pgmap v5651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:30:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:30:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:28 smithi096 ceph-mon[101353]: pgmap v5651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:31 smithi159 ceph-mon[69013]: pgmap v5652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:31 smithi096 ceph-mon[101353]: pgmap v5652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:33 smithi159 ceph-mon[69013]: pgmap v5653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:33 smithi096 ceph-mon[101353]: pgmap v5653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:35 smithi159 ceph-mon[69013]: pgmap v5654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:35 smithi096 ceph-mon[101353]: pgmap v5654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:37 smithi159 ceph-mon[69013]: pgmap v5655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:37 smithi096 ceph-mon[101353]: pgmap v5655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:38 smithi159 ceph-mon[69013]: pgmap v5656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:38 smithi096 ceph-mon[101353]: pgmap v5656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:41 smithi159 ceph-mon[69013]: pgmap v5657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:41 smithi096 ceph-mon[101353]: pgmap v5657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:41.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 -- 172.21.15.96:0/1365988700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 msgr2=0x7f02a00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 --2- 172.21.15.96:0/1365988700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a00f59e0 secure :-1 s=READY pgs=2898 cs=0 l=1 rev1=1 rx=0x7f0294004660 tx=0x7f0294009b30).stop 2022-02-02T21:30:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 -- 172.21.15.96:0/1365988700 shutdown_connections 2022-02-02T21:30:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 --2- 172.21.15.96:0/1365988700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 0x7f02a00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 --2- 172.21.15.96:0/1365988700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a00f59e0 unknown :-1 s=CLOSED pgs=2898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 -- 172.21.15.96:0/1365988700 >> 172.21.15.96:0/1365988700 conn(0x7f02a00f0d40 msgr2=0x7f02a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 -- 172.21.15.96:0/1365988700 shutdown_connections 2022-02-02T21:30:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.632+0000 7f02a75c3700 1 -- 172.21.15.96:0/1365988700 wait complete. 2022-02-02T21:30:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 Processor -- start 2022-02-02T21:30:41.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 -- start start 2022-02-02T21:30:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 0x7f02a0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0106910 con 0x7f02a00f55c0 2022-02-02T21:30:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a75c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0106a50 con 0x7f02a00f6860 2022-02-02T21:30:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43194/0 (socket says 172.21.15.96:43194) 2022-02-02T21:30:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 -- 172.21.15.96:0/573515454 learned_addr learned my addr 172.21.15.96:0/573515454 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a4b5e700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 0x7f02a0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 -- 172.21.15.96:0/573515454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 msgr2=0x7f02a0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 0x7f02a0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.633+0000 7f02a535f700 1 -- 172.21.15.96:0/573515454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294005040 con 0x7f02a00f55c0 2022-02-02T21:30:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f02a535f700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 secure :-1 s=READY pgs=2899 cs=0 l=1 rev1=1 rx=0x7f0294004f60 tx=0x7f0294009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0294018070 con 0x7f02a00f55c0 2022-02-02T21:30:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0107390 con 0x7f02a00f55c0 2022-02-02T21:30:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0294009770 con 0x7f02a00f55c0 2022-02-02T21:30:41.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029401c3c0 con 0x7f02a00f55c0 2022-02-02T21:30:41.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.634+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a01078f0 con 0x7f02a00f55c0 2022-02-02T21:30:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.635+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a0045ad0 con 0x7f02a00f55c0 2022-02-02T21:30:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.635+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f029401d420 con 0x7f02a00f55c0 2022-02-02T21:30:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.636+0000 7f0291ffb700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 0x7f028c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.636+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0294083880 con 0x7f02a00f55c0 2022-02-02T21:30:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.636+0000 7f02a4b5e700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 0x7f028c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.636+0000 7f02a4b5e700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 0x7f028c067290 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f029c007fd0 tx=0x7f029c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:41.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.640+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0294055470 con 0x7f02a00f55c0 2022-02-02T21:30:41.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.816+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02a00fddf0 con 0x7f028c064dd0 2022-02-02T21:30:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.817+0000 7f0291ffb700 1 -- 172.21.15.96:0/573515454 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02a00fddf0 con 0x7f028c064dd0 2022-02-02T21:30:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 msgr2=0x7f028c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 0x7f028c067290 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f029c007fd0 tx=0x7f029c009040).stop 2022-02-02T21:30:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 msgr2=0x7f02a0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 secure :-1 s=READY pgs=2899 cs=0 l=1 rev1=1 rx=0x7f0294004f60 tx=0x7f0294009b30).stop 2022-02-02T21:30:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 shutdown_connections 2022-02-02T21:30:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f028c064dd0 0x7f028c067290 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02a00f55c0 0x7f02a0105e70 unknown :-1 s=CLOSED pgs=2899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 --2- 172.21.15.96:0/573515454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02a00f6860 0x7f02a0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 >> 172.21.15.96:0/573515454 conn(0x7f02a00f0d40 msgr2=0x7f02a00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:41.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 shutdown_connections 2022-02-02T21:30:41.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.819+0000 7f02a75c3700 1 -- 172.21.15.96:0/573515454 wait complete. 2022-02-02T21:30:41.830 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:30:41.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 -- 172.21.15.96:0/4189627831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 msgr2=0x7f8d8c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/4189627831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c0f6b00 secure :-1 s=READY pgs=2900 cs=0 l=1 rev1=1 rx=0x7f8d88004660 tx=0x7f8d88009b30).stop 2022-02-02T21:30:41.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 -- 172.21.15.96:0/4189627831 shutdown_connections 2022-02-02T21:30:41.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/4189627831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/4189627831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c0f6b00 unknown :-1 s=CLOSED pgs=2900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.915+0000 7f8d93cc1700 1 -- 172.21.15.96:0/4189627831 >> 172.21.15.96:0/4189627831 conn(0x7f8d8c0f1e40 msgr2=0x7f8d8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:41.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 -- 172.21.15.96:0/4189627831 shutdown_connections 2022-02-02T21:30:41.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 -- 172.21.15.96:0/4189627831 wait complete. 2022-02-02T21:30:41.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 Processor -- start 2022-02-02T21:30:41.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 -- start start 2022-02-02T21:30:41.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c06a380 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d93cc1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c06a4c0 con 0x7f8d8c0f7980 2022-02-02T21:30:41.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.916+0000 7f8d91a5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43202/0 (socket says 172.21.15.96:43202) 2022-02-02T21:30:41.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 -- 172.21.15.96:0/2662416594 learned_addr learned my addr 172.21.15.96:0/2662416594 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:41.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d9125c700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 -- 172.21.15.96:0/2662416594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 msgr2=0x7f8d8c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:41.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:41.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 -- 172.21.15.96:0/2662416594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88005040 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d9125c700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:30:41.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d91a5d700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 secure :-1 s=READY pgs=2901 cs=0 l=1 rev1=1 rx=0x7f8d88004f60 tx=0x7f8d88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:41.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d88018070 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c06a740 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d88007ba0 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d8801c620 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.917+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c06aca0 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.918+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c045ad0 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.919+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d8801c8e0 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.919+0000 7f8d827fc700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 0x7f8d78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:41.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.919+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d88083960 con 0x7f8d8c0f66e0 2022-02-02T21:30:41.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.919+0000 7f8d9125c700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 0x7f8d78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:41.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.919+0000 7f8d9125c700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 0x7f8d78067290 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f8d7c0041d0 tx=0x7f8d7c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:41.923+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d88051a60 con 0x7f8d8c0f66e0 2022-02-02T21:30:42.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.094+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d8c057f10 con 0x7f8d78064dd0 2022-02-02T21:30:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.103+0000 7f8d827fc700 1 -- 172.21.15.96:0/2662416594 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8d8c057f10 con 0x7f8d78064dd0 2022-02-02T21:30:42.323 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:30:42.323 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:30:42.323 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:30:42.324 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:30:42.324 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:30:42.324 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:30:42.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:30:42.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:30:42.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:30:42.326 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:30:42.326 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:30:42.326 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:30:42.327 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:30:42.327 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:30:42.328 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:30:42.328 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:30:42.328 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:30:42.328 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:30:42.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:30:42.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:30:42.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:30:42.330 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:30:42.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 msgr2=0x7f8d78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 0x7f8d78067290 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f8d7c0041d0 tx=0x7f8d7c009040).stop 2022-02-02T21:30:42.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 msgr2=0x7f8d8c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 secure :-1 s=READY pgs=2901 cs=0 l=1 rev1=1 rx=0x7f8d88004f60 tx=0x7f8d88009b30).stop 2022-02-02T21:30:42.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 shutdown_connections 2022-02-02T21:30:42.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d78064dd0 0x7f8d78067290 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c0f66e0 0x7f8d8c06b9a0 unknown :-1 s=CLOSED pgs=2901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 --2- 172.21.15.96:0/2662416594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0f7980 0x7f8d8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 >> 172.21.15.96:0/2662416594 conn(0x7f8d8c0f1e40 msgr2=0x7f8d8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:42.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 shutdown_connections 2022-02-02T21:30:42.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.105+0000 7f8d93cc1700 1 -- 172.21.15.96:0/2662416594 wait complete. 2022-02-02T21:30:42.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 -- 172.21.15.96:0/1743127373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 msgr2=0x7fce180f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 --2- 172.21.15.96:0/1743127373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce180f5850 secure :-1 s=READY pgs=2902 cs=0 l=1 rev1=1 rx=0x7fce0c004660 tx=0x7fce0c009b30).stop 2022-02-02T21:30:42.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 -- 172.21.15.96:0/1743127373 shutdown_connections 2022-02-02T21:30:42.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 --2- 172.21.15.96:0/1743127373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 0x7fce180f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 --2- 172.21.15.96:0/1743127373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce180f5850 unknown :-1 s=CLOSED pgs=2902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 -- 172.21.15.96:0/1743127373 >> 172.21.15.96:0/1743127373 conn(0x7fce180f0b90 msgr2=0x7fce180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:42.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 -- 172.21.15.96:0/1743127373 shutdown_connections 2022-02-02T21:30:42.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.202+0000 7fce1d917700 1 -- 172.21.15.96:0/1743127373 wait complete. 2022-02-02T21:30:42.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 Processor -- start 2022-02-02T21:30:42.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 -- start start 2022-02-02T21:30:42.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 0x7fce1810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180603e0 con 0x7fce180f5430 2022-02-02T21:30:42.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1d917700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce18060520 con 0x7fce180f66d0 2022-02-02T21:30:42.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1c915700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1c915700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43212/0 (socket says 172.21.15.96:43212) 2022-02-02T21:30:42.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.203+0000 7fce1c915700 1 -- 172.21.15.96:0/28796926 learned_addr learned my addr 172.21.15.96:0/28796926 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:42.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce17fff700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 0x7fce1810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1c915700 1 -- 172.21.15.96:0/28796926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 msgr2=0x7fce1810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1c915700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 0x7fce1810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1c915700 1 -- 172.21.15.96:0/28796926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c005040 con 0x7fce180f5430 2022-02-02T21:30:42.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1c915700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 secure :-1 s=READY pgs=2903 cs=0 l=1 rev1=1 rx=0x7fce0c004f60 tx=0x7fce0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:42.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce0c018070 con 0x7fce180f5430 2022-02-02T21:30:42.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce0c007ba0 con 0x7fce180f5430 2022-02-02T21:30:42.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1810c4e0 con 0x7fce180f5430 2022-02-02T21:30:42.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1810ca40 con 0x7fce180f5430 2022-02-02T21:30:42.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.204+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce0c01c620 con 0x7fce180f5430 2022-02-02T21:30:42.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.205+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf8004fa0 con 0x7fce180f5430 2022-02-02T21:30:42.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.206+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce0c01d420 con 0x7fce180f5430 2022-02-02T21:30:42.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.206+0000 7fce157fa700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 0x7fce080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.206+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce0c083800 con 0x7fce180f5430 2022-02-02T21:30:42.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.206+0000 7fce17fff700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 0x7fce080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.206+0000 7fce17fff700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 0x7fce080672e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fce040041d0 tx=0x7fce04009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:42.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.210+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce0c051900 con 0x7fce180f5430 2022-02-02T21:30:42.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.442+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcdf8005e80 con 0x7fce180f5430 2022-02-02T21:30:42.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.442+0000 7fce157fa700 1 -- 172.21.15.96:0/28796926 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fce0c054f20 con 0x7fce180f5430 2022-02-02T21:30:42.444 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:30:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:30:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:30:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:30:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:30:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:30:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:30:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:30:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:30:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:30:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:30:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:30:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:30:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:30:42.451 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:30:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 msgr2=0x7fce080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 0x7fce080672e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fce040041d0 tx=0x7fce04009040).stop 2022-02-02T21:30:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 msgr2=0x7fce18109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 secure :-1 s=READY pgs=2903 cs=0 l=1 rev1=1 rx=0x7fce0c004f60 tx=0x7fce0c009b30).stop 2022-02-02T21:30:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 shutdown_connections 2022-02-02T21:30:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce08064e20 0x7fce080672e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce180f5430 0x7fce18109a90 unknown :-1 s=CLOSED pgs=2903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 --2- 172.21.15.96:0/28796926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce180f66d0 0x7fce1810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 >> 172.21.15.96:0/28796926 conn(0x7fce180f0b90 msgr2=0x7fce180fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 shutdown_connections 2022-02-02T21:30:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.444+0000 7fce1d917700 1 -- 172.21.15.96:0/28796926 wait complete. 2022-02-02T21:30:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/3173435546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 msgr2=0x7f0a440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/3173435546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a440f59e0 secure :-1 s=READY pgs=2904 cs=0 l=1 rev1=1 rx=0x7f0a34004660 tx=0x7f0a34009b30).stop 2022-02-02T21:30:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/3173435546 shutdown_connections 2022-02-02T21:30:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/3173435546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 0x7f0a440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/3173435546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a440f59e0 unknown :-1 s=CLOSED pgs=2904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.541+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/3173435546 >> 172.21.15.96:0/3173435546 conn(0x7f0a440f0d40 msgr2=0x7f0a440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.542+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/3173435546 shutdown_connections 2022-02-02T21:30:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.542+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/3173435546 wait complete. 2022-02-02T21:30:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.542+0000 7f0a4a3fd700 1 Processor -- start 2022-02-02T21:30:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.542+0000 7f0a4a3fd700 1 -- start start 2022-02-02T21:30:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 0x7f0a4410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440603c0 con 0x7f0a440f55c0 2022-02-02T21:30:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44060500 con 0x7f0a440f6860 2022-02-02T21:30:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43222/0 (socket says 172.21.15.96:43222) 2022-02-02T21:30:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 -- 172.21.15.96:0/1860625694 learned_addr learned my addr 172.21.15.96:0/1860625694 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:30:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a437fe700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 0x7f0a4410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 -- 172.21.15.96:0/1860625694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 msgr2=0x7f0a4410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 0x7f0a4410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 -- 172.21.15.96:0/1860625694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34005040 con 0x7f0a440f55c0 2022-02-02T21:30:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a43fff700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 rx=0x7f0a34013a70 tx=0x7f0a34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a34018070 con 0x7f0a440f55c0 2022-02-02T21:30:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4410c6e0 con 0x7f0a440f55c0 2022-02-02T21:30:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a340097d0 con 0x7f0a440f55c0 2022-02-02T21:30:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3401de80 con 0x7f0a440f55c0 2022-02-02T21:30:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.543+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4410cc10 con 0x7f0a440f55c0 2022-02-02T21:30:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.544+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24004fa0 con 0x7f0a440f55c0 2022-02-02T21:30:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.545+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a34007ba0 con 0x7f0a440f55c0 2022-02-02T21:30:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.545+0000 7f0a40ff9700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 0x7f0a2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:30:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.545+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a340834b0 con 0x7f0a440f55c0 2022-02-02T21:30:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.545+0000 7f0a437fe700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 0x7f0a2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:30:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.545+0000 7f0a437fe700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 0x7f0a2c067290 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f0a38004c40 tx=0x7f0a3800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:30:42.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.549+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a340515b0 con 0x7f0a440f55c0 2022-02-02T21:30:42.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.751+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a24005e80 con 0x7f0a440f55c0 2022-02-02T21:30:42.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.751+0000 7f0a40ff9700 1 -- 172.21.15.96:0/1860625694 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0a34054bd0 con 0x7f0a440f55c0 2022-02-02T21:30:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:30:42.755 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:30:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:30:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:30:42.757 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:30:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:30:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:30:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:30:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:30:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:30:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:30:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:30:42.760 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:30:42.760 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:30:42.761 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:30:42.762 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:30:42.762 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:30:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:30:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:30:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:30:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:30:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:30:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:30:42.765 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:30:42.765 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:30:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:30:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:30:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:30:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:30:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:30:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:30:42.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:42.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:42.768 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:30:42.769 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:30:42.769 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:42.769 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:42.770 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:30:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 msgr2=0x7f0a2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 0x7f0a2c067290 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f0a38004c40 tx=0x7f0a3800b040).stop 2022-02-02T21:30:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 msgr2=0x7f0a44109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:30:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 rx=0x7f0a34013a70 tx=0x7f0a34009b30).stop 2022-02-02T21:30:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 shutdown_connections 2022-02-02T21:30:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a2c064dd0 0x7f0a2c067290 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a440f55c0 0x7f0a44109c90 unknown :-1 s=CLOSED pgs=2905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 --2- 172.21.15.96:0/1860625694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a440f6860 0x7f0a4410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:30:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.753+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 >> 172.21.15.96:0/1860625694 conn(0x7f0a440f0d40 msgr2=0x7f0a440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:30:42.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.754+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 shutdown_connections 2022-02-02T21:30:42.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:30:42.754+0000 7f0a4a3fd700 1 -- 172.21.15.96:0/1860625694 wait complete. 2022-02-02T21:30:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:30:43.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:43 smithi159 ceph-mon[69013]: from='client.39906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:43.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:43 smithi159 ceph-mon[69013]: from='client.39910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:43.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:43 smithi159 ceph-mon[69013]: pgmap v5658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:43.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/28796926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:30:43.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1860625694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:30:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:43 smithi096 ceph-mon[101353]: from='client.39906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:43 smithi096 ceph-mon[101353]: from='client.39910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:30:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:43 smithi096 ceph-mon[101353]: pgmap v5658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/28796926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:30:43.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1860625694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:30:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:45 smithi159 ceph-mon[69013]: pgmap v5659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:45 smithi096 ceph-mon[101353]: pgmap v5659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:47 smithi159 ceph-mon[69013]: pgmap v5660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:47 smithi096 ceph-mon[101353]: pgmap v5660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:48 smithi159 ceph-mon[69013]: pgmap v5661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:48 smithi096 ceph-mon[101353]: pgmap v5661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:51 smithi159 ceph-mon[69013]: pgmap v5662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:51 smithi096 ceph-mon[101353]: pgmap v5662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:53.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:53 smithi159 ceph-mon[69013]: pgmap v5663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:53 smithi096 ceph-mon[101353]: pgmap v5663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:55 smithi159 ceph-mon[69013]: pgmap v5664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:55 smithi096 ceph-mon[101353]: pgmap v5664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:57 smithi159 ceph-mon[69013]: pgmap v5665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:57 smithi096 ceph-mon[101353]: pgmap v5665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:30:58 smithi159 ceph-mon[69013]: pgmap v5666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:30:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:30:58 smithi096 ceph-mon[101353]: pgmap v5666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:01 smithi159 ceph-mon[69013]: pgmap v5667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:01 smithi096 ceph-mon[101353]: pgmap v5667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:03 smithi159 ceph-mon[69013]: pgmap v5668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:03 smithi096 ceph-mon[101353]: pgmap v5668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:05 smithi159 ceph-mon[69013]: pgmap v5669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:05 smithi096 ceph-mon[101353]: pgmap v5669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:07 smithi159 ceph-mon[69013]: pgmap v5670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:07 smithi096 ceph-mon[101353]: pgmap v5670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:08 smithi159 ceph-mon[69013]: pgmap v5671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:08 smithi096 ceph-mon[101353]: pgmap v5671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:11 smithi159 ceph-mon[69013]: pgmap v5672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:11 smithi096 ceph-mon[101353]: pgmap v5672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.865+0000 7f84d9052700 1 -- 172.21.15.96:0/3490952075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f55c0 msgr2=0x7f84d40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:12.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.865+0000 7f84d9052700 1 --2- 172.21.15.96:0/3490952075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f55c0 0x7f84d40f59e0 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 rx=0x7f84c4004660 tx=0x7f84c4009b30).stop 2022-02-02T21:31:12.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.865+0000 7f84d9052700 1 -- 172.21.15.96:0/3490952075 shutdown_connections 2022-02-02T21:31:12.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 --2- 172.21.15.96:0/3490952075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f6860 0x7f84d40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:12.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 --2- 172.21.15.96:0/3490952075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f55c0 0x7f84d40f59e0 unknown :-1 s=CLOSED pgs=2906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:12.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 -- 172.21.15.96:0/3490952075 >> 172.21.15.96:0/3490952075 conn(0x7f84d40f0d40 msgr2=0x7f84d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:12.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 -- 172.21.15.96:0/3490952075 shutdown_connections 2022-02-02T21:31:12.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 -- 172.21.15.96:0/3490952075 wait complete. 2022-02-02T21:31:12.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.866+0000 7f84d9052700 1 Processor -- start 2022-02-02T21:31:12.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d9052700 1 -- start start 2022-02-02T21:31:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d9052700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f55c0 0x7f84d4109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d9052700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d9052700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4109ba0 con 0x7f84d40f6860 2022-02-02T21:31:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d9052700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4109ce0 con 0x7f84d40f55c0 2022-02-02T21:31:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43244/0 (socket says 172.21.15.96:43244) 2022-02-02T21:31:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 -- 172.21.15.96:0/2284310510 learned_addr learned my addr 172.21.15.96:0/2284310510 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f55c0 0x7f84d4109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:12.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 -- 172.21.15.96:0/2284310510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f55c0 msgr2=0x7f84d4109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:12.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f55c0 0x7f84d4109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:12.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.867+0000 7f84d259c700 1 -- 172.21.15.96:0/2284310510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4005040 con 0x7f84d40f6860 2022-02-02T21:31:12.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84d259c700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 secure :-1 s=READY pgs=2907 cs=0 l=1 rev1=1 rx=0x7f84c800e7f0 tx=0x7f84c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:12.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c80092e0 con 0x7f84d40f6860 2022-02-02T21:31:12.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84c800f040 con 0x7f84d40f6860 2022-02-02T21:31:12.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d410a680 con 0x7f84d40f6860 2022-02-02T21:31:12.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c8014750 con 0x7f84d40f6860 2022-02-02T21:31:12.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.868+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d410ac40 con 0x7f84d40f6860 2022-02-02T21:31:12.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.869+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4045ad0 con 0x7f84d40f6860 2022-02-02T21:31:12.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.869+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84c801b030 con 0x7f84d40f6860 2022-02-02T21:31:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.870+0000 7f84bb7fe700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 0x7f84bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.870+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84c8081780 con 0x7f84d40f6860 2022-02-02T21:31:12.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.870+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 0x7f84bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.870+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 0x7f84bc067290 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f84c4004d80 tx=0x7f84c4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:12.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:12.874+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84c8053360 con 0x7f84d40f6860 2022-02-02T21:31:13.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.052+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84d40faaa0 con 0x7f84bc064dd0 2022-02-02T21:31:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.053+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2284310510 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f84d40faaa0 con 0x7f84bc064dd0 2022-02-02T21:31:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 msgr2=0x7f84bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 0x7f84bc067290 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f84c4004d80 tx=0x7f84c4016040).stop 2022-02-02T21:31:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 msgr2=0x7f84d41095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 secure :-1 s=READY pgs=2907 cs=0 l=1 rev1=1 rx=0x7f84c800e7f0 tx=0x7f84c800b040).stop 2022-02-02T21:31:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 shutdown_connections 2022-02-02T21:31:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84bc064dd0 0x7f84bc067290 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d40f55c0 0x7f84d4109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 --2- 172.21.15.96:0/2284310510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40f6860 0x7f84d41095f0 unknown :-1 s=CLOSED pgs=2907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 >> 172.21.15.96:0/2284310510 conn(0x7f84d40f0d40 msgr2=0x7f84d405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 shutdown_connections 2022-02-02T21:31:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.055+0000 7f84d9052700 1 -- 172.21.15.96:0/2284310510 wait complete. 2022-02-02T21:31:13.065 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:31:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 -- 172.21.15.96:0/2827630445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f77d0 msgr2=0x7f0e800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 --2- 172.21.15.96:0/2827630445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f77d0 0x7f0e800f7c30 secure :-1 s=READY pgs=2908 cs=0 l=1 rev1=1 rx=0x7f0e70004660 tx=0x7f0e70009b30).stop 2022-02-02T21:31:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 -- 172.21.15.96:0/2827630445 shutdown_connections 2022-02-02T21:31:13.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 --2- 172.21.15.96:0/2827630445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f77d0 0x7f0e800f7c30 unknown :-1 s=CLOSED pgs=2908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 --2- 172.21.15.96:0/2827630445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f6530 0x7f0e800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 -- 172.21.15.96:0/2827630445 >> 172.21.15.96:0/2827630445 conn(0x7f0e800f1c90 msgr2=0x7f0e800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 -- 172.21.15.96:0/2827630445 shutdown_connections 2022-02-02T21:31:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 -- 172.21.15.96:0/2827630445 wait complete. 2022-02-02T21:31:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.153+0000 7f0e84845700 1 Processor -- start 2022-02-02T21:31:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e84845700 1 -- start start 2022-02-02T21:31:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e84845700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e84845700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f77d0 0x7f0e80104f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e84845700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80105580 con 0x7f0e800f6530 2022-02-02T21:31:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e84845700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e801056c0 con 0x7f0e800f77d0 2022-02-02T21:31:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43252/0 (socket says 172.21.15.96:43252) 2022-02-02T21:31:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 -- 172.21.15.96:0/2477064251 learned_addr learned my addr 172.21.15.96:0/2477064251 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:13.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7effd700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f77d0 0x7f0e80104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 -- 172.21.15.96:0/2477064251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f77d0 msgr2=0x7f0e80104f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f77d0 0x7f0e80104f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 -- 172.21.15.96:0/2477064251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70005040 con 0x7f0e800f6530 2022-02-02T21:31:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e7f7fe700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 secure :-1 s=READY pgs=2909 cs=0 l=1 rev1=1 rx=0x7f0e7400e7c0 tx=0x7f0e7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.154+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e740092e0 con 0x7f0e800f6530 2022-02-02T21:31:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.155+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e7400f040 con 0x7f0e800f6530 2022-02-02T21:31:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.155+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e80106030 con 0x7f0e800f6530 2022-02-02T21:31:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.155+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e74014750 con 0x7f0e800f6530 2022-02-02T21:31:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.155+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e801065f0 con 0x7f0e800f6530 2022-02-02T21:31:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.155+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80045ad0 con 0x7f0e800f6530 2022-02-02T21:31:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.156+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e7401b030 con 0x7f0e800f6530 2022-02-02T21:31:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.156+0000 7f0e67fff700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 0x7f0e680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.156+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e74081b10 con 0x7f0e800f6530 2022-02-02T21:31:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.156+0000 7f0e7effd700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 0x7f0e680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.157+0000 7f0e7effd700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 0x7f0e680672e0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f0e70004d80 tx=0x7f0e7000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.160+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e7404fc10 con 0x7f0e800f6530 2022-02-02T21:31:13.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.333+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e8010b120 con 0x7f0e68064e20 2022-02-02T21:31:13.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.343+0000 7f0e67fff700 1 -- 172.21.15.96:0/2477064251 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0e8010b120 con 0x7f0e68064e20 2022-02-02T21:31:13.346 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:31:13.347 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:31:13.347 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:31:13.348 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:31:13.349 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:31:13.349 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:31:13.350 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:31:13.351 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:31:13.351 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:31:13.353 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:31:13.353 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:31:13.354 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:31:13.354 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:31:13.355 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:31:13.356 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:31:13.356 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:31:13.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:31:13.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:31:13.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:31:13.358 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:31:13.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:31:13.361 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:31:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 msgr2=0x7f0e680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 0x7f0e680672e0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f0e70004d80 tx=0x7f0e7000b040).stop 2022-02-02T21:31:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 msgr2=0x7f0e80104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 secure :-1 s=READY pgs=2909 cs=0 l=1 rev1=1 rx=0x7f0e7400e7c0 tx=0x7f0e7400b040).stop 2022-02-02T21:31:13.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 shutdown_connections 2022-02-02T21:31:13.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e68064e20 0x7f0e680672e0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e800f6530 0x7f0e80104a90 unknown :-1 s=CLOSED pgs=2909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 --2- 172.21.15.96:0/2477064251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e800f77d0 0x7f0e80104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 >> 172.21.15.96:0/2477064251 conn(0x7f0e800f1c90 msgr2=0x7f0e8006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 shutdown_connections 2022-02-02T21:31:13.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.345+0000 7f0e84845700 1 -- 172.21.15.96:0/2477064251 wait complete. 2022-02-02T21:31:13.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 -- 172.21.15.96:0/28095461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f77d0 msgr2=0x7f3bd40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/28095461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f77d0 0x7f3bd40f7c30 secure :-1 s=READY pgs=2910 cs=0 l=1 rev1=1 rx=0x7f3bc0004660 tx=0x7f3bc0009b30).stop 2022-02-02T21:31:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 -- 172.21.15.96:0/28095461 shutdown_connections 2022-02-02T21:31:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/28095461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f77d0 0x7f3bd40f7c30 unknown :-1 s=CLOSED pgs=2910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/28095461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd40f6530 0x7f3bd40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 -- 172.21.15.96:0/28095461 >> 172.21.15.96:0/28095461 conn(0x7f3bd40f1c90 msgr2=0x7f3bd40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.445 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:13 smithi096 ceph-mon[101353]: pgmap v5673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.441+0000 7f3bd9aef700 1 -- 172.21.15.96:0/28095461 shutdown_connections 2022-02-02T21:31:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.442+0000 7f3bd9aef700 1 -- 172.21.15.96:0/28095461 wait complete. 2022-02-02T21:31:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.442+0000 7f3bd9aef700 1 Processor -- start 2022-02-02T21:31:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.442+0000 7f3bd9aef700 1 -- start start 2022-02-02T21:31:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4107390 0x7f3bd4108280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4107860 con 0x7f3bd40f6530 2022-02-02T21:31:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd41079a0 con 0x7f3bd4107390 2022-02-02T21:31:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43262/0 (socket says 172.21.15.96:43262) 2022-02-02T21:31:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 -- 172.21.15.96:0/2277782418 learned_addr learned my addr 172.21.15.96:0/2277782418 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd3fff700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4107390 0x7f3bd4108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 -- 172.21.15.96:0/2277782418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4107390 msgr2=0x7f3bd4108280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4107390 0x7f3bd4108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 -- 172.21.15.96:0/2277782418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0005040 con 0x7f3bd40f6530 2022-02-02T21:31:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd8aed700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 secure :-1 s=READY pgs=2911 cs=0 l=1 rev1=1 rx=0x7f3bc8002700 tx=0x7f3bc8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc8009320 con 0x7f3bd40f6530 2022-02-02T21:31:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3bc800f040 con 0x7f3bd40f6530 2022-02-02T21:31:13.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd4108830 con 0x7f3bd40f6530 2022-02-02T21:31:13.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc8014900 con 0x7f3bd40f6530 2022-02-02T21:31:13.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.443+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd4108df0 con 0x7f3bd40f6530 2022-02-02T21:31:13.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.445+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4004fa0 con 0x7f3bd40f6530 2022-02-02T21:31:13.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.445+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3bc8009480 con 0x7f3bd40f6530 2022-02-02T21:31:13.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.445+0000 7f3bd17fa700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 0x7f3bc40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.446+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3bc8081d60 con 0x7f3bd40f6530 2022-02-02T21:31:13.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.446+0000 7f3bd3fff700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 0x7f3bc40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.446+0000 7f3bd3fff700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 0x7f3bc40672e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f3bc0004e30 tx=0x7f3bc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.450+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3bc8086070 con 0x7f3bd40f6530 2022-02-02T21:31:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:13 smithi159 ceph-mon[69013]: pgmap v5673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.681+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bb4005e80 con 0x7f3bd40f6530 2022-02-02T21:31:13.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.681+0000 7f3bd17fa700 1 -- 172.21.15.96:0/2277782418 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3bc8053660 con 0x7f3bd40f6530 2022-02-02T21:31:13.683 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:31:13.683 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:31:13.684 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:31:13.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:13.684 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:31:13.685 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:31:13.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:13.685 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:31:13.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:31:13.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:13.686 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:31:13.687 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:31:13.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:13.688 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:31:13.688 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:31:13.689 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:31:13.689 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:31:13.689 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:31:13.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 msgr2=0x7f3bc40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 0x7f3bc40672e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f3bc0004e30 tx=0x7f3bc0009b30).stop 2022-02-02T21:31:13.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 msgr2=0x7f3bd4106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 secure :-1 s=READY pgs=2911 cs=0 l=1 rev1=1 rx=0x7f3bc8002700 tx=0x7f3bc8009d80).stop 2022-02-02T21:31:13.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 shutdown_connections 2022-02-02T21:31:13.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3bc4064e20 0x7f3bc40672e0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bd40f6530 0x7f3bd4106ea0 unknown :-1 s=CLOSED pgs=2911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 --2- 172.21.15.96:0/2277782418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4107390 0x7f3bd4108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 >> 172.21.15.96:0/2277782418 conn(0x7f3bd40f1c90 msgr2=0x7f3bd40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 shutdown_connections 2022-02-02T21:31:13.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.683+0000 7f3bd9aef700 1 -- 172.21.15.96:0/2277782418 wait complete. 2022-02-02T21:31:13.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 -- 172.21.15.96:0/603962362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 msgr2=0x7f69080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 --2- 172.21.15.96:0/603962362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f69080f7c30 secure :-1 s=READY pgs=2912 cs=0 l=1 rev1=1 rx=0x7f6904004660 tx=0x7f6904009b30).stop 2022-02-02T21:31:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 -- 172.21.15.96:0/603962362 shutdown_connections 2022-02-02T21:31:13.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 --2- 172.21.15.96:0/603962362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f69080f7c30 unknown :-1 s=CLOSED pgs=2912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 --2- 172.21.15.96:0/603962362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f69080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 -- 172.21.15.96:0/603962362 >> 172.21.15.96:0/603962362 conn(0x7f69080f1c90 msgr2=0x7f69080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.780+0000 7f690ee83700 1 -- 172.21.15.96:0/603962362 shutdown_connections 2022-02-02T21:31:13.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.781+0000 7f690ee83700 1 -- 172.21.15.96:0/603962362 wait complete. 2022-02-02T21:31:13.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 Processor -- start 2022-02-02T21:31:13.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 -- start start 2022-02-02T21:31:13.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f690806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690810a940 con 0x7f69080f77d0 2022-02-02T21:31:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690ee83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690810aa80 con 0x7f69080f6530 2022-02-02T21:31:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43274/0 (socket says 172.21.15.96:43274) 2022-02-02T21:31:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 -- 172.21.15.96:0/1334602363 learned_addr learned my addr 172.21.15.96:0/1334602363 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690de81700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f690806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 -- 172.21.15.96:0/1334602363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 msgr2=0x7f690806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f690806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 -- 172.21.15.96:0/1334602363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904005040 con 0x7f69080f77d0 2022-02-02T21:31:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690de81700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f690806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:31:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.782+0000 7f690d680700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 secure :-1 s=READY pgs=2913 cs=0 l=1 rev1=1 rx=0x7f6904009990 tx=0x7f6904009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.783+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6904018070 con 0x7f69080f77d0 2022-02-02T21:31:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.783+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6904007ba0 con 0x7f69080f77d0 2022-02-02T21:31:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.783+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690806a370 con 0x7f69080f77d0 2022-02-02T21:31:13.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.783+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690401c3c0 con 0x7f69080f77d0 2022-02-02T21:31:13.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.783+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690806a8d0 con 0x7f69080f77d0 2022-02-02T21:31:13.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.784+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6908045ad0 con 0x7f69080f77d0 2022-02-02T21:31:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.784+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f690401d420 con 0x7f69080f77d0 2022-02-02T21:31:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.785+0000 7f68fe7fc700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 0x7f68f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.785+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6904083760 con 0x7f69080f77d0 2022-02-02T21:31:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.785+0000 7f690de81700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 0x7f68f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.785+0000 7f690de81700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 0x7f68f40672e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f68f8009fd0 tx=0x7f68f800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:13.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.789+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6904051800 con 0x7f69080f77d0 2022-02-02T21:31:13.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.990+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6908027aa0 con 0x7f69080f77d0 2022-02-02T21:31:13.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.990+0000 7f68fe7fc700 1 -- 172.21.15.96:0/1334602363 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6904054e20 con 0x7f69080f77d0 2022-02-02T21:31:13.992 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:31:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:31:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:31:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:31:13.994 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:31:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:31:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:31:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:31:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:31:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:31:14.000 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:31:14.001 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:31:14.002 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:31:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:31:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:31:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:31:14.004 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:31:14.004 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:31:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:31:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:31:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:31:14.006 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:31:14.006 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:31:14.006 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:31:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:31:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:31:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:31:14.008 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:31:14.008 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:31:14.008 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:31:14.009 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:31:14.009 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:14.009 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:14.010 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:31:14.010 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:14.010 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:14.011 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:14.011 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:14.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 msgr2=0x7f68f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:14.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 0x7f68f40672e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f68f8009fd0 tx=0x7f68f800b040).stop 2022-02-02T21:31:14.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 msgr2=0x7f6908069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:14.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 secure :-1 s=READY pgs=2913 cs=0 l=1 rev1=1 rx=0x7f6904009990 tx=0x7f6904009b30).stop 2022-02-02T21:31:14.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 shutdown_connections 2022-02-02T21:31:14.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68f4064e20 0x7f68f40672e0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:14.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080f6530 0x7f690806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:14.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 --2- 172.21.15.96:0/1334602363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69080f77d0 0x7f6908069e20 unknown :-1 s=CLOSED pgs=2913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:14.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 >> 172.21.15.96:0/1334602363 conn(0x7f69080f1c90 msgr2=0x7f69080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:14.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 shutdown_connections 2022-02-02T21:31:14.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:13.992+0000 7f690ee83700 1 -- 172.21.15.96:0/1334602363 wait complete. 2022-02-02T21:31:14.017 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:31:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:14 smithi159 ceph-mon[69013]: from='client.39922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2277782418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:31:14.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1334602363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:31:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:14 smithi096 ceph-mon[101353]: from='client.39922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2277782418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:31:14.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1334602363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:31:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:15 smithi159 ceph-mon[69013]: from='client.39926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:15 smithi159 ceph-mon[69013]: pgmap v5674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:15 smithi096 ceph-mon[101353]: from='client.39926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:15 smithi096 ceph-mon[101353]: pgmap v5674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:17 smithi159 ceph-mon[69013]: pgmap v5675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:17 smithi096 ceph-mon[101353]: pgmap v5675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:18 smithi159 ceph-mon[69013]: pgmap v5676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:18 smithi096 ceph-mon[101353]: pgmap v5676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:21 smithi159 ceph-mon[69013]: pgmap v5677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:21 smithi096 ceph-mon[101353]: pgmap v5677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:23.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:23 smithi159 ceph-mon[69013]: pgmap v5678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:23 smithi096 ceph-mon[101353]: pgmap v5678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:25 smithi159 ceph-mon[69013]: pgmap v5679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:25 smithi096 ceph-mon[101353]: pgmap v5679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:27 smithi159 ceph-mon[69013]: pgmap v5680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:27 smithi096 ceph-mon[101353]: pgmap v5680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:31:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:31:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:28 smithi159 ceph-mon[69013]: pgmap v5681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:31:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:31:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:28 smithi096 ceph-mon[101353]: pgmap v5681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:31 smithi159 ceph-mon[69013]: pgmap v5682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:31 smithi096 ceph-mon[101353]: pgmap v5682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:33 smithi159 ceph-mon[69013]: pgmap v5683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:33 smithi096 ceph-mon[101353]: pgmap v5683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:35 smithi159 ceph-mon[69013]: pgmap v5684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:35 smithi096 ceph-mon[101353]: pgmap v5684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:37 smithi159 ceph-mon[69013]: pgmap v5685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:37 smithi096 ceph-mon[101353]: pgmap v5685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:38 smithi159 ceph-mon[69013]: pgmap v5686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:38 smithi096 ceph-mon[101353]: pgmap v5686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:41 smithi159 ceph-mon[69013]: pgmap v5687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:41 smithi096 ceph-mon[101353]: pgmap v5687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:43.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:43 smithi159 ceph-mon[69013]: pgmap v5688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:43 smithi096 ceph-mon[101353]: pgmap v5688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 -- 172.21.15.96:0/306413428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f53e0 msgr2=0x7f5b380f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 --2- 172.21.15.96:0/306413428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f53e0 0x7f5b380f7d20 secure :-1 s=READY pgs=2914 cs=0 l=1 rev1=1 rx=0x7f5b28004660 tx=0x7f5b28009b30).stop 2022-02-02T21:31:44.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 -- 172.21.15.96:0/306413428 shutdown_connections 2022-02-02T21:31:44.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 --2- 172.21.15.96:0/306413428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f53e0 0x7f5b380f7d20 unknown :-1 s=CLOSED pgs=2914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 --2- 172.21.15.96:0/306413428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f4a40 0x7f5b380f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 -- 172.21.15.96:0/306413428 >> 172.21.15.96:0/306413428 conn(0x7f5b380f04c0 msgr2=0x7f5b380f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 -- 172.21.15.96:0/306413428 shutdown_connections 2022-02-02T21:31:44.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.103+0000 7f5b3db67700 1 -- 172.21.15.96:0/306413428 wait complete. 2022-02-02T21:31:44.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 Processor -- start 2022-02-02T21:31:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 -- start start 2022-02-02T21:31:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f53e0 0x7f5b38107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38107c20 con 0x7f5b380f4a40 2022-02-02T21:31:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b3db67700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38107d60 con 0x7f5b380f53e0 2022-02-02T21:31:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43290/0 (socket says 172.21.15.96:43290) 2022-02-02T21:31:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.104+0000 7f5b377fe700 1 -- 172.21.15.96:0/2600168929 learned_addr learned my addr 172.21.15.96:0/2600168929 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b36ffd700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f53e0 0x7f5b38107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b377fe700 1 -- 172.21.15.96:0/2600168929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f53e0 msgr2=0x7f5b38107670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b377fe700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f53e0 0x7f5b38107670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b377fe700 1 -- 172.21.15.96:0/2600168929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28005040 con 0x7f5b380f4a40 2022-02-02T21:31:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b377fe700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 rx=0x7f5b200026d0 tx=0x7f5b20009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b200079c0 con 0x7f5b380f4a40 2022-02-02T21:31:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b2000f040 con 0x7f5b380f4a40 2022-02-02T21:31:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b38108700 con 0x7f5b380f4a40 2022-02-02T21:31:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b200148b0 con 0x7f5b380f4a40 2022-02-02T21:31:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.105+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b38108cc0 con 0x7f5b380f4a40 2022-02-02T21:31:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.106+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38045ad0 con 0x7f5b380f4a40 2022-02-02T21:31:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.107+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b20007b20 con 0x7f5b380f4a40 2022-02-02T21:31:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.107+0000 7f5b2ffff700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 0x7f5b24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.107+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5b20081900 con 0x7f5b380f4a40 2022-02-02T21:31:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.107+0000 7f5b36ffd700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 0x7f5b24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.107+0000 7f5b36ffd700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 0x7f5b24067290 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f5b28004630 tx=0x7f5b28009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.111+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b20053430 con 0x7f5b380f4a40 2022-02-02T21:31:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.290+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b380ff0f0 con 0x7f5b24064dd0 2022-02-02T21:31:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.292+0000 7f5b2ffff700 1 -- 172.21.15.96:0/2600168929 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5b380ff0f0 con 0x7f5b24064dd0 2022-02-02T21:31:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 msgr2=0x7f5b24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 0x7f5b24067290 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f5b28004630 tx=0x7f5b28009b30).stop 2022-02-02T21:31:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 msgr2=0x7f5b38107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 rx=0x7f5b200026d0 tx=0x7f5b20009de0).stop 2022-02-02T21:31:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 shutdown_connections 2022-02-02T21:31:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b24064dd0 0x7f5b24067290 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b380f4a40 0x7f5b38107180 unknown :-1 s=CLOSED pgs=2915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 --2- 172.21.15.96:0/2600168929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b380f53e0 0x7f5b38107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.293+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 >> 172.21.15.96:0/2600168929 conn(0x7f5b380f04c0 msgr2=0x7f5b380fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.294+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 shutdown_connections 2022-02-02T21:31:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.294+0000 7f5b3db67700 1 -- 172.21.15.96:0/2600168929 wait complete. 2022-02-02T21:31:44.759 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:31:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 -- 172.21.15.96:0/796706207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f66d0 msgr2=0x7fa3640f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 --2- 172.21.15.96:0/796706207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f66d0 0x7fa3640f6b30 secure :-1 s=READY pgs=2916 cs=0 l=1 rev1=1 rx=0x7fa358004660 tx=0x7fa358009b30).stop 2022-02-02T21:31:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 -- 172.21.15.96:0/796706207 shutdown_connections 2022-02-02T21:31:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 --2- 172.21.15.96:0/796706207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f66d0 0x7fa3640f6b30 unknown :-1 s=CLOSED pgs=2916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 --2- 172.21.15.96:0/796706207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f5430 0x7fa3640f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.392+0000 7fa368aad700 1 -- 172.21.15.96:0/796706207 >> 172.21.15.96:0/796706207 conn(0x7fa3640f0b90 msgr2=0x7fa3640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.393+0000 7fa368aad700 1 -- 172.21.15.96:0/796706207 shutdown_connections 2022-02-02T21:31:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.393+0000 7fa368aad700 1 -- 172.21.15.96:0/796706207 wait complete. 2022-02-02T21:31:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.393+0000 7fa368aad700 1 Processor -- start 2022-02-02T21:31:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.393+0000 7fa368aad700 1 -- start start 2022-02-02T21:31:44.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa368aad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa368aad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f66d0 0x7fa36410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa368aad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364060400 con 0x7fa3640f5430 2022-02-02T21:31:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa368aad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364060540 con 0x7fa3640f66d0 2022-02-02T21:31:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43300/0 (socket says 172.21.15.96:43300) 2022-02-02T21:31:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 -- 172.21.15.96:0/1554364119 learned_addr learned my addr 172.21.15.96:0/1554364119 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa362ffd700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f66d0 0x7fa36410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 -- 172.21.15.96:0/1554364119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f66d0 msgr2=0x7fa36410bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f66d0 0x7fa36410bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 -- 172.21.15.96:0/1554364119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358005040 con 0x7fa3640f5430 2022-02-02T21:31:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa3637fe700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 secure :-1 s=READY pgs=2917 cs=0 l=1 rev1=1 rx=0x7fa354002700 tx=0x7fa354009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.394+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3540079c0 con 0x7fa3640f5430 2022-02-02T21:31:44.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.395+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36410c4f0 con 0x7fa3640f5430 2022-02-02T21:31:44.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.395+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa35400f040 con 0x7fa3640f5430 2022-02-02T21:31:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.395+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa354014860 con 0x7fa3640f5430 2022-02-02T21:31:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.395+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36410ca80 con 0x7fa3640f5430 2022-02-02T21:31:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.396+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa364059100 con 0x7fa3640f5430 2022-02-02T21:31:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.396+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa35401b060 con 0x7fa3640f5430 2022-02-02T21:31:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.396+0000 7fa34bfff700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.396+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa354081900 con 0x7fa3640f5430 2022-02-02T21:31:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.396+0000 7fa362ffd700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.397+0000 7fa362ffd700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fa358004630 tx=0x7fa358009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.400+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa35404fa00 con 0x7fa3640f5430 2022-02-02T21:31:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.573+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa364057f10 con 0x7fa34c064e20 2022-02-02T21:31:44.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.582+0000 7fa34bfff700 1 -- 172.21.15.96:0/1554364119 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa364057f10 con 0x7fa34c064e20 2022-02-02T21:31:44.776 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:31:44.776 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:31:44.777 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:31:44.777 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:31:44.777 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:31:44.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:31:44.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:31:44.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:31:44.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:31:44.779 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:31:44.779 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:31:44.780 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:31:44.780 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:31:44.780 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:31:44.781 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:31:44.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:31:44.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:31:44.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:31:44.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:31:44.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:31:44.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:31:44.783 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:31:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 msgr2=0x7fa34c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fa358004630 tx=0x7fa358009b30).stop 2022-02-02T21:31:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 msgr2=0x7fa364109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 secure :-1 s=READY pgs=2917 cs=0 l=1 rev1=1 rx=0x7fa354002700 tx=0x7fa354009d80).stop 2022-02-02T21:31:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 shutdown_connections 2022-02-02T21:31:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa34c064e20 0x7fa34c0672e0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3640f5430 0x7fa364109a40 unknown :-1 s=CLOSED pgs=2917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 --2- 172.21.15.96:0/1554364119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3640f66d0 0x7fa36410bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 >> 172.21.15.96:0/1554364119 conn(0x7fa3640f0b90 msgr2=0x7fa3640fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 shutdown_connections 2022-02-02T21:31:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.584+0000 7fa368aad700 1 -- 172.21.15.96:0/1554364119 wait complete. 2022-02-02T21:31:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 -- 172.21.15.96:0/3584101774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 msgr2=0x7fa08c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 --2- 172.21.15.96:0/3584101774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c0f7c30 secure :-1 s=READY pgs=2918 cs=0 l=1 rev1=1 rx=0x7fa07c004660 tx=0x7fa07c009b30).stop 2022-02-02T21:31:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 -- 172.21.15.96:0/3584101774 shutdown_connections 2022-02-02T21:31:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 --2- 172.21.15.96:0/3584101774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c0f7c30 unknown :-1 s=CLOSED pgs=2918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 --2- 172.21.15.96:0/3584101774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 0x7fa08c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:31:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 -- 172.21.15.96:0/3584101774 >> 172.21.15.96:0/3584101774 conn(0x7fa08c0f1c90 msgr2=0x7fa08c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.680+0000 7fa09300f700 1 -- 172.21.15.96:0/3584101774 shutdown_connections 2022-02-02T21:31:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 -- 172.21.15.96:0/3584101774 wait complete. 2022-02-02T21:31:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 Processor -- start 2022-02-02T21:31:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 -- start start 2022-02-02T21:31:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 0x7fa08c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.681+0000 7fa09300f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c107980 con 0x7fa08c0f77d0 2022-02-02T21:31:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09300f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c108100 con 0x7fa08c0f6530 2022-02-02T21:31:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43310/0 (socket says 172.21.15.96:43310) 2022-02-02T21:31:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 -- 172.21.15.96:0/454943388 learned_addr learned my addr 172.21.15.96:0/454943388 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09200d700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 0x7fa08c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 -- 172.21.15.96:0/454943388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 msgr2=0x7fa08c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 0x7fa08c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 -- 172.21.15.96:0/454943388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c005040 con 0x7fa08c0f77d0 2022-02-02T21:31:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09180c700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 rx=0x7fa07c009990 tx=0x7fa07c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c018070 con 0x7fa08c0f77d0 2022-02-02T21:31:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa07c007ba0 con 0x7fa08c0f77d0 2022-02-02T21:31:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c108320 con 0x7fa08c0f77d0 2022-02-02T21:31:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c01c620 con 0x7fa08c0f77d0 2022-02-02T21:31:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.682+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c108880 con 0x7fa08c0f77d0 2022-02-02T21:31:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.684+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c045ad0 con 0x7fa08c0f77d0 2022-02-02T21:31:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.684+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa07c01d420 con 0x7fa08c0f77d0 2022-02-02T21:31:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.684+0000 7fa082ffd700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 0x7fa0780673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:44.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.684+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa07c083690 con 0x7fa08c0f77d0 2022-02-02T21:31:44.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.684+0000 7fa09200d700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 0x7fa0780673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.685+0000 7fa09200d700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 0x7fa0780673b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fa08c106b70 tx=0x7fa088008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.689+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa07c051810 con 0x7fa08c0f77d0 2022-02-02T21:31:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.918+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa08c027a00 con 0x7fa08c0f77d0 2022-02-02T21:31:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.918+0000 7fa082ffd700 1 -- 172.21.15.96:0/454943388 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa07c054e30 con 0x7fa08c0f77d0 2022-02-02T21:31:44.919 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:31:44.920 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:31:44.920 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:31:44.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:44.921 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:31:44.921 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:31:44.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:44.922 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:31:44.922 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:31:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:31:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:31:44.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:31:44.924 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:31:44.924 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:31:44.925 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:31:44.925 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:31:44.926 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:31:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 msgr2=0x7fa0780673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 0x7fa0780673b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fa08c106b70 tx=0x7fa088008040).stop 2022-02-02T21:31:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 msgr2=0x7fa08c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:44.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 rx=0x7fa07c009990 tx=0x7fa07c009b30).stop 2022-02-02T21:31:44.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 shutdown_connections 2022-02-02T21:31:44.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa078064ef0 0x7fa0780673b0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa08c0f6530 0x7fa08c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 --2- 172.21.15.96:0/454943388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa08c0f77d0 0x7fa08c1072f0 unknown :-1 s=CLOSED pgs=2919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 >> 172.21.15.96:0/454943388 conn(0x7fa08c0f1c90 msgr2=0x7fa08c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:44.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 shutdown_connections 2022-02-02T21:31:44.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:44.920+0000 7fa09300f700 1 -- 172.21.15.96:0/454943388 wait complete. 2022-02-02T21:31:45.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 -- 172.21.15.96:0/3670139274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 msgr2=0x7fac6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:45.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 --2- 172.21.15.96:0/3670139274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c0f6cc0 secure :-1 s=READY pgs=2920 cs=0 l=1 rev1=1 rx=0x7fac5c004660 tx=0x7fac5c009b30).stop 2022-02-02T21:31:45.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 -- 172.21.15.96:0/3670139274 shutdown_connections 2022-02-02T21:31:45.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 --2- 172.21.15.96:0/3670139274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c0f6cc0 unknown :-1 s=CLOSED pgs=2920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 --2- 172.21.15.96:0/3670139274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.016+0000 7fac70c83700 1 -- 172.21.15.96:0/3670139274 >> 172.21.15.96:0/3670139274 conn(0x7fac6c0f0d40 msgr2=0x7fac6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.017+0000 7fac70c83700 1 -- 172.21.15.96:0/3670139274 shutdown_connections 2022-02-02T21:31:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.017+0000 7fac70c83700 1 -- 172.21.15.96:0/3670139274 wait complete. 2022-02-02T21:31:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.017+0000 7fac70c83700 1 Processor -- start 2022-02-02T21:31:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.017+0000 7fac70c83700 1 -- start start 2022-02-02T21:31:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.017+0000 7fac70c83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac70c83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac70c83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0603c0 con 0x7fac6c0f6860 2022-02-02T21:31:45.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac70c83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c060500 con 0x7fac6c0f55c0 2022-02-02T21:31:45.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43318/0 (socket says 172.21.15.96:43318) 2022-02-02T21:31:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 -- 172.21.15.96:0/142689072 learned_addr learned my addr 172.21.15.96:0/142689072 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:31:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac6a59c700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 -- 172.21.15.96:0/142689072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 msgr2=0x7fac6c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 -- 172.21.15.96:0/142689072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c005040 con 0x7fac6c0f6860 2022-02-02T21:31:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac6a59c700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:31:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac69d9b700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 rx=0x7fac5c009990 tx=0x7fac5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5c018070 con 0x7fac6c0f6860 2022-02-02T21:31:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac5c007ca0 con 0x7fac6c0f6860 2022-02-02T21:31:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c10c6c0 con 0x7fac6c0f6860 2022-02-02T21:31:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5c01c620 con 0x7fac6c0f6860 2022-02-02T21:31:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.018+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c10cbf0 con 0x7fac6c0f6860 2022-02-02T21:31:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.019+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0f49b0 con 0x7fac6c0f6860 2022-02-02T21:31:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.020+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fac5c01d960 con 0x7fac6c0f6860 2022-02-02T21:31:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.020+0000 7fac5affd700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 0x7fac54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:31:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.020+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fac5c0837e0 con 0x7fac6c0f6860 2022-02-02T21:31:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.020+0000 7fac6a59c700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 0x7fac54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:31:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.021+0000 7fac6a59c700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 0x7fac54067290 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fac60007fd0 tx=0x7fac60009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:31:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.024+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fac5c0519a0 con 0x7fac6c0f6860 2022-02-02T21:31:45.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.223+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac6c045ad0 con 0x7fac6c0f6860 2022-02-02T21:31:45.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.223+0000 7fac5affd700 1 -- 172.21.15.96:0/142689072 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fac5c054fc0 con 0x7fac6c0f6860 2022-02-02T21:31:45.224 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:31:45.225 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:31:45.225 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:31:45.226 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:31:45.226 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:45.226 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:31:45.227 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:31:45.227 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:31:45.227 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:31:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:31:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:31:45.228 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:31:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:31:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:31:45.229 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:31:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:31:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:31:45.230 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:31:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:31:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:31:45.231 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:31:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:31:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:31:45.232 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:31:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:31:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:31:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:31:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:31:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:31:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:31:45.235 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:31:45.235 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:31:45.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:45.236 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:45.236 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:31:45.236 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:31:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:31:45.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 msgr2=0x7fac54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:45.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 0x7fac54067290 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fac60007fd0 tx=0x7fac60009040).stop 2022-02-02T21:31:45.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 msgr2=0x7fac6c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:31:45.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 rx=0x7fac5c009990 tx=0x7fac5c009b30).stop 2022-02-02T21:31:45.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 shutdown_connections 2022-02-02T21:31:45.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fac54064dd0 0x7fac54067290 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac6c0f55c0 0x7fac6c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 --2- 172.21.15.96:0/142689072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac6c0f6860 0x7fac6c10c170 unknown :-1 s=CLOSED pgs=2921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:31:45.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 >> 172.21.15.96:0/142689072 conn(0x7fac6c0f0d40 msgr2=0x7fac6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:31:45.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 shutdown_connections 2022-02-02T21:31:45.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:31:45.225+0000 7fac70c83700 1 -- 172.21.15.96:0/142689072 wait complete. 2022-02-02T21:31:45.243 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:31:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:45 smithi096 ceph-mon[101353]: pgmap v5689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:45 smithi096 ceph-mon[101353]: from='client.39938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/454943388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:31:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/142689072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:31:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:45 smithi159 ceph-mon[69013]: pgmap v5689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:45 smithi159 ceph-mon[69013]: from='client.39938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/454943388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:31:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/142689072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:31:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:46 smithi159 ceph-mon[69013]: from='client.39942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:46 smithi096 ceph-mon[101353]: from='client.39942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:31:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:47 smithi159 ceph-mon[69013]: pgmap v5690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:47 smithi096 ceph-mon[101353]: pgmap v5690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:48 smithi159 ceph-mon[69013]: pgmap v5691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:48 smithi096 ceph-mon[101353]: pgmap v5691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:51 smithi159 ceph-mon[69013]: pgmap v5692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:51 smithi096 ceph-mon[101353]: pgmap v5692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:53.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:53 smithi159 ceph-mon[69013]: pgmap v5693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:53 smithi096 ceph-mon[101353]: pgmap v5693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:55 smithi159 ceph-mon[69013]: pgmap v5694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:55 smithi096 ceph-mon[101353]: pgmap v5694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:57 smithi159 ceph-mon[69013]: pgmap v5695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:57 smithi096 ceph-mon[101353]: pgmap v5695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:31:58 smithi159 ceph-mon[69013]: pgmap v5696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:31:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:31:58 smithi096 ceph-mon[101353]: pgmap v5696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:01 smithi159 ceph-mon[69013]: pgmap v5697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:01 smithi096 ceph-mon[101353]: pgmap v5697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:03 smithi159 ceph-mon[69013]: pgmap v5698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:03 smithi096 ceph-mon[101353]: pgmap v5698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:05 smithi159 ceph-mon[69013]: pgmap v5699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:05 smithi096 ceph-mon[101353]: pgmap v5699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:07 smithi159 ceph-mon[69013]: pgmap v5700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:07 smithi096 ceph-mon[101353]: pgmap v5700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:08 smithi159 ceph-mon[69013]: pgmap v5701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:08 smithi096 ceph-mon[101353]: pgmap v5701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:11 smithi159 ceph-mon[69013]: pgmap v5702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:11 smithi096 ceph-mon[101353]: pgmap v5702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:13 smithi159 ceph-mon[69013]: pgmap v5703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:13 smithi096 ceph-mon[101353]: pgmap v5703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:15.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 -- 172.21.15.96:0/1269210901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66e0 msgr2=0x7f165c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 --2- 172.21.15.96:0/1269210901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66e0 0x7f165c0f6b00 secure :-1 s=READY pgs=2922 cs=0 l=1 rev1=1 rx=0x7f1650004660 tx=0x7f1650009b30).stop 2022-02-02T21:32:15.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 -- 172.21.15.96:0/1269210901 shutdown_connections 2022-02-02T21:32:15.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 --2- 172.21.15.96:0/1269210901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f7980 0x7f165c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 --2- 172.21.15.96:0/1269210901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f66e0 0x7f165c0f6b00 unknown :-1 s=CLOSED pgs=2922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 -- 172.21.15.96:0/1269210901 >> 172.21.15.96:0/1269210901 conn(0x7f165c0f1e40 msgr2=0x7f165c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:15.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 -- 172.21.15.96:0/1269210901 shutdown_connections 2022-02-02T21:32:15.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.338+0000 7f1661b8b700 1 -- 172.21.15.96:0/1269210901 wait complete. 2022-02-02T21:32:15.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 Processor -- start 2022-02-02T21:32:15.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 -- start start 2022-02-02T21:32:15.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f66e0 0x7f165c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c107a50 con 0x7f165c0f7980 2022-02-02T21:32:15.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f1661b8b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c107b90 con 0x7f165c0f66e0 2022-02-02T21:32:15.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f165affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f165affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43338/0 (socket says 172.21.15.96:43338) 2022-02-02T21:32:15.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f165affd700 1 -- 172.21.15.96:0/2063053691 learned_addr learned my addr 172.21.15.96:0/2063053691 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:15.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.339+0000 7f165b7fe700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f66e0 0x7f165c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f165affd700 1 -- 172.21.15.96:0/2063053691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f66e0 msgr2=0x7f165c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f165affd700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f66e0 0x7f165c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f165affd700 1 -- 172.21.15.96:0/2063053691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650005040 con 0x7f165c0f7980 2022-02-02T21:32:15.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f165affd700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 secure :-1 s=READY pgs=2923 cs=0 l=1 rev1=1 rx=0x7f164c00c530 tx=0x7f164c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f164c00f650 con 0x7f165c0f7980 2022-02-02T21:32:15.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f164c00fc60 con 0x7f165c0f7980 2022-02-02T21:32:15.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c108530 con 0x7f165c0f7980 2022-02-02T21:32:15.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f164c012c20 con 0x7f165c0f7980 2022-02-02T21:32:15.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.340+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c108af0 con 0x7f165c0f7980 2022-02-02T21:32:15.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.341+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c045ad0 con 0x7f165c0f7980 2022-02-02T21:32:15.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.342+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f164c010070 con 0x7f165c0f7980 2022-02-02T21:32:15.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.342+0000 7f1643fff700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.342+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f164c0816b0 con 0x7f165c0f7980 2022-02-02T21:32:15.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.342+0000 7f165b7fe700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.342+0000 7f165b7fe700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f1650004630 tx=0x7f1650009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.346+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f164c0531e0 con 0x7f165c0f7980 2022-02-02T21:32:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:15 smithi159 ceph-mon[69013]: pgmap v5704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:15.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.526+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f165c108d10 con 0x7f1644064dd0 2022-02-02T21:32:15.526 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:15 smithi096 ceph-mon[101353]: pgmap v5704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.527+0000 7f1643fff700 1 -- 172.21.15.96:0/2063053691 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f165c108d10 con 0x7f1644064dd0 2022-02-02T21:32:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 msgr2=0x7f1644067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f1650004630 tx=0x7f1650009b30).stop 2022-02-02T21:32:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 msgr2=0x7f165c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 secure :-1 s=READY pgs=2923 cs=0 l=1 rev1=1 rx=0x7f164c00c530 tx=0x7f164c007e20).stop 2022-02-02T21:32:15.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 shutdown_connections 2022-02-02T21:32:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0f66e0 0x7f165c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 --2- 172.21.15.96:0/2063053691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f165c0f7980 0x7f165c1074a0 unknown :-1 s=CLOSED pgs=2923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 >> 172.21.15.96:0/2063053691 conn(0x7f165c0f1e40 msgr2=0x7f165c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 shutdown_connections 2022-02-02T21:32:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.529+0000 7f1661b8b700 1 -- 172.21.15.96:0/2063053691 wait complete. 2022-02-02T21:32:15.539 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:32:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 -- 172.21.15.96:0/1868975532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f64c0 msgr2=0x7f22d00f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 --2- 172.21.15.96:0/1868975532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f64c0 0x7f22d00f6940 secure :-1 s=READY pgs=2924 cs=0 l=1 rev1=1 rx=0x7f22c0004660 tx=0x7f22c0009b30).stop 2022-02-02T21:32:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 -- 172.21.15.96:0/1868975532 shutdown_connections 2022-02-02T21:32:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 --2- 172.21.15.96:0/1868975532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f64c0 0x7f22d00f6940 unknown :-1 s=CLOSED pgs=2924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 --2- 172.21.15.96:0/1868975532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f5bb0 0x7f22d00f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 -- 172.21.15.96:0/1868975532 >> 172.21.15.96:0/1868975532 conn(0x7f22d00f0540 msgr2=0x7f22d00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:15.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 -- 172.21.15.96:0/1868975532 shutdown_connections 2022-02-02T21:32:15.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.626+0000 7f22d578b700 1 -- 172.21.15.96:0/1868975532 wait complete. 2022-02-02T21:32:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 Processor -- start 2022-02-02T21:32:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 -- start start 2022-02-02T21:32:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f64c0 0x7f22d0107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d01079f0 con 0x7f22d00f5bb0 2022-02-02T21:32:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22d578b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0107b30 con 0x7f22d00f64c0 2022-02-02T21:32:15.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43346/0 (socket says 172.21.15.96:43346) 2022-02-02T21:32:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 -- 172.21.15.96:0/496166942 learned_addr learned my addr 172.21.15.96:0/496166942 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ce7fc700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f64c0 0x7f22d0107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 -- 172.21.15.96:0/496166942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f64c0 msgr2=0x7f22d0107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f64c0 0x7f22d0107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.627+0000 7f22ceffd700 1 -- 172.21.15.96:0/496166942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0005040 con 0x7f22d00f5bb0 2022-02-02T21:32:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22ceffd700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 secure :-1 s=READY pgs=2925 cs=0 l=1 rev1=1 rx=0x7f22c4002700 tx=0x7f22c4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c40079c0 con 0x7f22d00f5bb0 2022-02-02T21:32:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d01084d0 con 0x7f22d00f5bb0 2022-02-02T21:32:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22c400f040 con 0x7f22d00f5bb0 2022-02-02T21:32:15.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c4014860 con 0x7f22d00f5bb0 2022-02-02T21:32:15.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.628+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d0108a90 con 0x7f22d00f5bb0 2022-02-02T21:32:15.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.629+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d0045ad0 con 0x7f22d00f5bb0 2022-02-02T21:32:15.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.629+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22c401b060 con 0x7f22d00f5bb0 2022-02-02T21:32:15.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.629+0000 7f22b77fe700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.629+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22c40818e0 con 0x7f22d00f5bb0 2022-02-02T21:32:15.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.629+0000 7f22ce7fc700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.630+0000 7f22ce7fc700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 0x7f22b8067290 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f22c0004630 tx=0x7f22c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.634+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22c4053410 con 0x7f22d00f5bb0 2022-02-02T21:32:15.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.805+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f22d00fae40 con 0x7f22b8064dd0 2022-02-02T21:32:15.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.815+0000 7f22b77fe700 1 -- 172.21.15.96:0/496166942 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f22d00fae40 con 0x7f22b8064dd0 2022-02-02T21:32:15.816 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:32:15.816 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:32:15.816 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:32:15.817 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:32:15.817 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:32:15.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:32:15.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:32:15.818 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:32:15.819 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:32:15.820 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:32:15.821 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:32:15.821 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:32:15.821 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:32:15.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:32:15.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:32:15.829 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:32:15.830 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:32:15.830 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:32:15.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:32:15.833 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:32:15.833 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:32:15.834 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:32:15.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 msgr2=0x7f22b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 0x7f22b8067290 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f22c0004630 tx=0x7f22c0009b30).stop 2022-02-02T21:32:15.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 msgr2=0x7f22d0106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 secure :-1 s=READY pgs=2925 cs=0 l=1 rev1=1 rx=0x7f22c4002700 tx=0x7f22c4009d80).stop 2022-02-02T21:32:15.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 shutdown_connections 2022-02-02T21:32:15.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d00f5bb0 0x7f22d0106f50 unknown :-1 s=CLOSED pgs=2925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 --2- 172.21.15.96:0/496166942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d00f64c0 0x7f22d0107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 >> 172.21.15.96:0/496166942 conn(0x7f22d00f0540 msgr2=0x7f22d00f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:15.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 shutdown_connections 2022-02-02T21:32:15.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.817+0000 7f22d578b700 1 -- 172.21.15.96:0/496166942 wait complete. 2022-02-02T21:32:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 -- 172.21.15.96:0/2246794176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f66e0 msgr2=0x7f1cac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 --2- 172.21.15.96:0/2246794176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f66e0 0x7f1cac0f6b00 secure :-1 s=READY pgs=2926 cs=0 l=1 rev1=1 rx=0x7f1c9c004660 tx=0x7f1c9c009b30).stop 2022-02-02T21:32:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 -- 172.21.15.96:0/2246794176 shutdown_connections 2022-02-02T21:32:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 --2- 172.21.15.96:0/2246794176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f7980 0x7f1cac0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:32:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 --2- 172.21.15.96:0/2246794176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f66e0 0x7f1cac0f6b00 unknown :-1 s=CLOSED pgs=2926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 -- 172.21.15.96:0/2246794176 >> 172.21.15.96:0/2246794176 conn(0x7f1cac0f1e40 msgr2=0x7f1cac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 -- 172.21.15.96:0/2246794176 shutdown_connections 2022-02-02T21:32:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.913+0000 7f1cb348c700 1 -- 172.21.15.96:0/2246794176 wait complete. 2022-02-02T21:32:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 Processor -- start 2022-02-02T21:32:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 -- start start 2022-02-02T21:32:15.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f66e0 0x7f1cac106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac107ae0 con 0x7f1cac0f7980 2022-02-02T21:32:15.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb348c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac108390 con 0x7f1cac0f66e0 2022-02-02T21:32:15.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb0a27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb0a27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43358/0 (socket says 172.21.15.96:43358) 2022-02-02T21:32:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.914+0000 7f1cb0a27700 1 -- 172.21.15.96:0/4237343738 learned_addr learned my addr 172.21.15.96:0/4237343738 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb1228700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f66e0 0x7f1cac106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb0a27700 1 -- 172.21.15.96:0/4237343738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f66e0 msgr2=0x7f1cac106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb0a27700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f66e0 0x7f1cac106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb0a27700 1 -- 172.21.15.96:0/4237343738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c005040 con 0x7f1cac0f7980 2022-02-02T21:32:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb0a27700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 secure :-1 s=READY pgs=2927 cs=0 l=1 rev1=1 rx=0x7f1ca800b410 tx=0x7f1ca8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca80125f0 con 0x7f1cac0f7980 2022-02-02T21:32:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ca800be30 con 0x7f1cac0f7980 2022-02-02T21:32:15.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac108670 con 0x7f1cac0f7980 2022-02-02T21:32:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca8002a70 con 0x7f1cac0f7980 2022-02-02T21:32:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.915+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac108c30 con 0x7f1cac0f7980 2022-02-02T21:32:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.916+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac0f5ad0 con 0x7f1cac0f7980 2022-02-02T21:32:15.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.917+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ca800f030 con 0x7f1cac0f7980 2022-02-02T21:32:15.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.917+0000 7f1ca1ffb700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:15.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.917+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ca8081e80 con 0x7f1cac0f7980 2022-02-02T21:32:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.917+0000 7f1cb1228700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.917+0000 7f1cb1228700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f1c9c004630 tx=0x7f1c9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:15.921+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ca80539b0 con 0x7f1cac0f7980 2022-02-02T21:32:16.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.154+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1cac0fef20 con 0x7f1cac0f7980 2022-02-02T21:32:16.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.154+0000 7f1ca1ffb700 1 -- 172.21.15.96:0/4237343738 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1ca80535a0 con 0x7f1cac0f7980 2022-02-02T21:32:16.155 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:32:16.155 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:32:16.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:32:16.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:16.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:32:16.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:32:16.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:16.157 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:32:16.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:32:16.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:16.158 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:32:16.159 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:32:16.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:16.159 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:32:16.160 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:32:16.160 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:32:16.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:32:16.161 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:32:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 msgr2=0x7f1c98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f1c9c004630 tx=0x7f1c9c009b30).stop 2022-02-02T21:32:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 msgr2=0x7f1cac1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 secure :-1 s=READY pgs=2927 cs=0 l=1 rev1=1 rx=0x7f1ca800b410 tx=0x7f1ca8006ef0).stop 2022-02-02T21:32:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 shutdown_connections 2022-02-02T21:32:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0f66e0 0x7f1cac106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 --2- 172.21.15.96:0/4237343738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0f7980 0x7f1cac1074a0 unknown :-1 s=CLOSED pgs=2927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 >> 172.21.15.96:0/4237343738 conn(0x7f1cac0f1e40 msgr2=0x7f1cac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 shutdown_connections 2022-02-02T21:32:16.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.156+0000 7f1cb348c700 1 -- 172.21.15.96:0/4237343738 wait complete. 2022-02-02T21:32:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 -- 172.21.15.96:0/313081168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f5340 msgr2=0x7fddf40f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:16.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 --2- 172.21.15.96:0/313081168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f5340 0x7fddf40f7ac0 secure :-1 s=READY pgs=2928 cs=0 l=1 rev1=1 rx=0x7fddf0004660 tx=0x7fddf0009b30).stop 2022-02-02T21:32:16.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 -- 172.21.15.96:0/313081168 shutdown_connections 2022-02-02T21:32:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 --2- 172.21.15.96:0/313081168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f5340 0x7fddf40f7ac0 unknown :-1 s=CLOSED pgs=2928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 --2- 172.21.15.96:0/313081168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f49a0 0x7fddf40f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 -- 172.21.15.96:0/313081168 >> 172.21.15.96:0/313081168 conn(0x7fddf40f04c0 msgr2=0x7fddf40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:16.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 -- 172.21.15.96:0/313081168 shutdown_connections 2022-02-02T21:32:16.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.254+0000 7fddfc41d700 1 -- 172.21.15.96:0/313081168 wait complete. 2022-02-02T21:32:16.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 Processor -- start 2022-02-02T21:32:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 -- start start 2022-02-02T21:32:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f5340 0x7fddf4107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4107af0 con 0x7fddf40f49a0 2022-02-02T21:32:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfc41d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4107c30 con 0x7fddf40f5340 2022-02-02T21:32:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43364/0 (socket says 172.21.15.96:43364) 2022-02-02T21:32:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 -- 172.21.15.96:0/89787829 learned_addr learned my addr 172.21.15.96:0/89787829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 -- 172.21.15.96:0/89787829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f5340 msgr2=0x7fddf4107540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T21:32:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f5340 0x7fddf4107540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:32:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 -- 172.21.15.96:0/89787829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0005040 con 0x7fddf40f49a0 2022-02-02T21:32:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fddfa1b9700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 secure :-1 s=READY pgs=2929 cs=0 l=1 rev1=1 rx=0x7fdde800c530 tx=0x7fdde8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.255+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde800f650 con 0x7fddf40f49a0 2022-02-02T21:32:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.256+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf41085d0 con 0x7fddf40f49a0 2022-02-02T21:32:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.256+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdde800fc60 con 0x7fddf40f49a0 2022-02-02T21:32:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.256+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde8012d20 con 0x7fddf40f49a0 2022-02-02T21:32:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.256+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4108b90 con 0x7fddf40f49a0 2022-02-02T21:32:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.257+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf4045ad0 con 0x7fddf40f49a0 2022-02-02T21:32:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.257+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdde8019030 con 0x7fddf40f49a0 2022-02-02T21:32:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.257+0000 7fdde6ffd700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 0x7fdde0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.257+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdde80816b0 con 0x7fddf40f49a0 2022-02-02T21:32:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.257+0000 7fddf99b8700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 0x7fdde0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.258+0000 7fddf99b8700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 0x7fdde0067290 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7fddf0000c00 tx=0x7fddf0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:16.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.262+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdde8053230 con 0x7fddf40f49a0 2022-02-02T21:32:16.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.464+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fddf40ff040 con 0x7fddf40f49a0 2022-02-02T21:32:16.465 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4237343738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:32:16.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.464+0000 7fdde6ffd700 1 -- 172.21.15.96:0/89787829 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdde8052e20 con 0x7fddf40f49a0 2022-02-02T21:32:16.466 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:32:16.467 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:32:16.467 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:32:16.467 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:32:16.468 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:16.468 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:32:16.468 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:32:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:32:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:32:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:32:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:32:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:32:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:32:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:32:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:32:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:32:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:32:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:32:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:32:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:32:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:32:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:32:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:32:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:32:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:32:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:32:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:32:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:32:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:32:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:32:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:32:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:32:16.477 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:16.478 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:16.478 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:32:16.478 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:16.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:16.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:16.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:16.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.466+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 msgr2=0x7fdde0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:16.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.466+0000 7fddfc41d700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 0x7fdde0067290 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7fddf0000c00 tx=0x7fddf0009b30).stop 2022-02-02T21:32:16.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.466+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 msgr2=0x7fddf4107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:16.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.466+0000 7fddfc41d700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 secure :-1 s=READY pgs=2929 cs=0 l=1 rev1=1 rx=0x7fdde800c530 tx=0x7fdde8007e10).stop 2022-02-02T21:32:16.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 shutdown_connections 2022-02-02T21:32:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdde0064dd0 0x7fdde0067290 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40f49a0 0x7fddf4107050 unknown :-1 s=CLOSED pgs=2929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 --2- 172.21.15.96:0/89787829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf40f5340 0x7fddf4107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:32:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 >> 172.21.15.96:0/89787829 conn(0x7fddf40f04c0 msgr2=0x7fddf40fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 shutdown_connections 2022-02-02T21:32:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:16.467+0000 7fddfc41d700 1 -- 172.21.15.96:0/89787829 wait complete. 2022-02-02T21:32:16.485 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:32:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4237343738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:32:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:17 smithi159 ceph-mon[69013]: from='client.39954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:17 smithi159 ceph-mon[69013]: from='client.39958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:17 smithi159 ceph-mon[69013]: pgmap v5705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/89787829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:32:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:17 smithi096 ceph-mon[101353]: from='client.39954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:17 smithi096 ceph-mon[101353]: from='client.39958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:17 smithi096 ceph-mon[101353]: pgmap v5705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:17.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/89787829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:32:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:18 smithi159 ceph-mon[69013]: pgmap v5706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:18 smithi096 ceph-mon[101353]: pgmap v5706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:21 smithi159 ceph-mon[69013]: pgmap v5707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:21 smithi096 ceph-mon[101353]: pgmap v5707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:23.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:23 smithi159 ceph-mon[69013]: pgmap v5708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:23 smithi096 ceph-mon[101353]: pgmap v5708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:25 smithi159 ceph-mon[69013]: pgmap v5709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:25 smithi096 ceph-mon[101353]: pgmap v5709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:27 smithi159 ceph-mon[69013]: pgmap v5710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:27 smithi096 ceph-mon[101353]: pgmap v5710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:32:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:32:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:28 smithi159 ceph-mon[69013]: pgmap v5711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:32:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:32:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:28 smithi096 ceph-mon[101353]: pgmap v5711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:31 smithi159 ceph-mon[69013]: pgmap v5712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:31 smithi096 ceph-mon[101353]: pgmap v5712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:33 smithi159 ceph-mon[69013]: pgmap v5713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:33 smithi096 ceph-mon[101353]: pgmap v5713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:35 smithi159 ceph-mon[69013]: pgmap v5714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:35 smithi096 ceph-mon[101353]: pgmap v5714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:37.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:37 smithi159 ceph-mon[69013]: pgmap v5715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:37 smithi096 ceph-mon[101353]: pgmap v5715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:38 smithi159 ceph-mon[69013]: pgmap v5716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:38 smithi096 ceph-mon[101353]: pgmap v5716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:41 smithi159 ceph-mon[69013]: pgmap v5717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:41 smithi096 ceph-mon[101353]: pgmap v5717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:43.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:43 smithi159 ceph-mon[69013]: pgmap v5718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:43 smithi096 ceph-mon[101353]: pgmap v5718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:45 smithi159 ceph-mon[69013]: pgmap v5719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:45 smithi096 ceph-mon[101353]: pgmap v5719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:46.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.576+0000 7f501ac8a700 1 -- 172.21.15.96:0/821410139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f5430 msgr2=0x7f50140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.576+0000 7f501ac8a700 1 --2- 172.21.15.96:0/821410139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f5430 0x7f50140f5850 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 rx=0x7f5010004660 tx=0x7f5010009b30).stop 2022-02-02T21:32:46.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 -- 172.21.15.96:0/821410139 shutdown_connections 2022-02-02T21:32:46.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 --2- 172.21.15.96:0/821410139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f66d0 0x7f50140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 --2- 172.21.15.96:0/821410139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f5430 0x7f50140f5850 unknown :-1 s=CLOSED pgs=2930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 -- 172.21.15.96:0/821410139 >> 172.21.15.96:0/821410139 conn(0x7f50140f0b90 msgr2=0x7f50140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:46.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 -- 172.21.15.96:0/821410139 shutdown_connections 2022-02-02T21:32:46.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 -- 172.21.15.96:0/821410139 wait complete. 2022-02-02T21:32:46.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.577+0000 7f501ac8a700 1 Processor -- start 2022-02-02T21:32:46.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f501ac8a700 1 -- start start 2022-02-02T21:32:46.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f501ac8a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f5430 0x7f50140f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f501ac8a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f501ac8a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50140f7f70 con 0x7f50140f66d0 2022-02-02T21:32:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f501ac8a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50140f80b0 con 0x7f50140f5430 2022-02-02T21:32:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43386/0 (socket says 172.21.15.96:43386) 2022-02-02T21:32:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 -- 172.21.15.96:0/4150901484 learned_addr learned my addr 172.21.15.96:0/4150901484 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019c88700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f5430 0x7f50140f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 -- 172.21.15.96:0/4150901484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f5430 msgr2=0x7f50140f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f5430 0x7f50140f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 -- 172.21.15.96:0/4150901484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010005040 con 0x7f50140f66d0 2022-02-02T21:32:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.578+0000 7f5019487700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 secure :-1 s=READY pgs=2931 cs=0 l=1 rev1=1 rx=0x7f50040026d0 tx=0x7f5004009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.579+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50040079c0 con 0x7f50140f66d0 2022-02-02T21:32:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.579+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50140f8390 con 0x7f50140f66d0 2022-02-02T21:32:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.579+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f500400f040 con 0x7f50140f66d0 2022-02-02T21:32:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.579+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50040148b0 con 0x7f50140f66d0 2022-02-02T21:32:46.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.579+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501410edd0 con 0x7f50140f66d0 2022-02-02T21:32:46.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.580+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5014045ad0 con 0x7f50140f66d0 2022-02-02T21:32:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.580+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5004007b20 con 0x7f50140f66d0 2022-02-02T21:32:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.581+0000 7f500a7fc700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 0x7f50000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.581+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50040819e0 con 0x7f50140f66d0 2022-02-02T21:32:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.581+0000 7f5019c88700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 0x7f50000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.581+0000 7f5019c88700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 0x7f50000672e0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f5010013690 tx=0x7f5010009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.585+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f500404fae0 con 0x7f50140f66d0 2022-02-02T21:32:46.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.770+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50140fab10 con 0x7f5000064e20 2022-02-02T21:32:46.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.771+0000 7f500a7fc700 1 -- 172.21.15.96:0/4150901484 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f50140fab10 con 0x7f5000064e20 2022-02-02T21:32:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 msgr2=0x7f50000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 0x7f50000672e0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f5010013690 tx=0x7f5010009b30).stop 2022-02-02T21:32:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 msgr2=0x7f50140f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 secure :-1 s=READY pgs=2931 cs=0 l=1 rev1=1 rx=0x7f50040026d0 tx=0x7f5004009de0).stop 2022-02-02T21:32:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 shutdown_connections 2022-02-02T21:32:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5000064e20 0x7f50000672e0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50140f5430 0x7f50140f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 --2- 172.21.15.96:0/4150901484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50140f66d0 0x7f50140f7a10 unknown :-1 s=CLOSED pgs=2931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 >> 172.21.15.96:0/4150901484 conn(0x7f50140f0b90 msgr2=0x7f501405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 shutdown_connections 2022-02-02T21:32:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.773+0000 7f501ac8a700 1 -- 172.21.15.96:0/4150901484 wait complete. 2022-02-02T21:32:46.783 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:32:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 -- 172.21.15.96:0/2847861661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d0060270 msgr2=0x7f31d00f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/2847861661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d0060270 0x7f31d00f9340 secure :-1 s=READY pgs=2932 cs=0 l=1 rev1=1 rx=0x7f31c4004660 tx=0x7f31c4009b30).stop 2022-02-02T21:32:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 -- 172.21.15.96:0/2847861661 shutdown_connections 2022-02-02T21:32:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/2847861661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d00f9830 0x7f31d00fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/2847861661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d0060270 0x7f31d00f9340 unknown :-1 s=CLOSED pgs=2932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 -- 172.21.15.96:0/2847861661 >> 172.21.15.96:0/2847861661 conn(0x7f31d00f0d40 msgr2=0x7f31d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.870+0000 7f31d6cdb700 1 -- 172.21.15.96:0/2847861661 shutdown_connections 2022-02-02T21:32:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.871+0000 7f31d6cdb700 1 -- 172.21.15.96:0/2847861661 wait complete. 2022-02-02T21:32:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.871+0000 7f31d6cdb700 1 Processor -- start 2022-02-02T21:32:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.871+0000 7f31d6cdb700 1 -- start start 2022-02-02T21:32:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d6cdb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 0x7f31d0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d6cdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d6cdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0107a00 con 0x7f31d00f9830 2022-02-02T21:32:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d6cdb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0107b40 con 0x7f31d0060270 2022-02-02T21:32:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43402/0 (socket says 172.21.15.96:43402) 2022-02-02T21:32:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 -- 172.21.15.96:0/844295140 learned_addr learned my addr 172.21.15.96:0/844295140 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d4a77700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 0x7f31d0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 -- 172.21.15.96:0/844295140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 msgr2=0x7f31d0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 0x7f31d0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 -- 172.21.15.96:0/844295140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4005040 con 0x7f31d00f9830 2022-02-02T21:32:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31d4a77700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 0x7f31d0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:32:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cffff700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 secure :-1 s=READY pgs=2933 cs=0 l=1 rev1=1 rx=0x7f31bc00c510 tx=0x7f31bc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31bc00f650 con 0x7f31d00f9830 2022-02-02T21:32:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f31bc00fc60 con 0x7f31d00f9830 2022-02-02T21:32:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.872+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31bc012cd0 con 0x7f31d00f9830 2022-02-02T21:32:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.873+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d01084e0 con 0x7f31d00f9830 2022-02-02T21:32:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.873+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d0108a50 con 0x7f31d00f9830 2022-02-02T21:32:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.874+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d0045ad0 con 0x7f31d00f9830 2022-02-02T21:32:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.874+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f31bc010070 con 0x7f31d00f9830 2022-02-02T21:32:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.874+0000 7f31cd7fa700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 0x7f31c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.875+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f31bc081760 con 0x7f31d00f9830 2022-02-02T21:32:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.875+0000 7f31d4a77700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 0x7f31c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.875+0000 7f31d4a77700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 0x7f31c0067290 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f31c4009da0 tx=0x7f31c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:46.879+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f31bc053290 con 0x7f31d00f9830 2022-02-02T21:32:47.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.051+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31d0108cc0 con 0x7f31c0064dd0 2022-02-02T21:32:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.060+0000 7f31cd7fa700 1 -- 172.21.15.96:0/844295140 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f31d0108cc0 con 0x7f31c0064dd0 2022-02-02T21:32:47.062 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:32:47.062 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:32:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:32:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:32:47.063 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:32:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:32:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:32:47.064 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:32:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:32:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:32:47.065 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:32:47.066 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:32:47.066 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:32:47.066 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:32:47.067 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:32:47.067 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:32:47.067 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:32:47.068 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:32:47.068 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:32:47.068 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:32:47.069 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:32:47.069 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:32:47.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 msgr2=0x7f31c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 0x7f31c0067290 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f31c4009da0 tx=0x7f31c4009b30).stop 2022-02-02T21:32:47.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 msgr2=0x7f31d0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 secure :-1 s=READY pgs=2933 cs=0 l=1 rev1=1 rx=0x7f31bc00c510 tx=0x7f31bc007df0).stop 2022-02-02T21:32:47.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 shutdown_connections 2022-02-02T21:32:47.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f31c0064dd0 0x7f31c0067290 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0060270 0x7f31d0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 --2- 172.21.15.96:0/844295140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31d00f9830 0x7f31d0107450 unknown :-1 s=CLOSED pgs=2933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 >> 172.21.15.96:0/844295140 conn(0x7f31d00f0d40 msgr2=0x7f31d00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:47.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 shutdown_connections 2022-02-02T21:32:47.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.062+0000 7f31d6cdb700 1 -- 172.21.15.96:0/844295140 wait complete. 2022-02-02T21:32:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 -- 172.21.15.96:0/2643617650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 msgr2=0x7feef80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 --2- 172.21.15.96:0/2643617650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef80f6b40 secure :-1 s=READY pgs=2934 cs=0 l=1 rev1=1 rx=0x7feeec004660 tx=0x7feeec009b30).stop 2022-02-02T21:32:47.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 -- 172.21.15.96:0/2643617650 shutdown_connections 2022-02-02T21:32:47.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 --2- 172.21.15.96:0/2643617650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef80f6b40 unknown :-1 s=CLOSED pgs=2934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 --2- 172.21.15.96:0/2643617650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 0x7feef80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.157+0000 7feefc886700 1 -- 172.21.15.96:0/2643617650 >> 172.21.15.96:0/2643617650 conn(0x7feef80f0ba0 msgr2=0x7feef80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.159+0000 7feefc886700 1 -- 172.21.15.96:0/2643617650 shutdown_connections 2022-02-02T21:32:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.159+0000 7feefc886700 1 -- 172.21.15.96:0/2643617650 wait complete. 2022-02-02T21:32:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.159+0000 7feefc886700 1 Processor -- start 2022-02-02T21:32:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.159+0000 7feefc886700 1 -- start start 2022-02-02T21:32:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feefc886700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 0x7feef8109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feefc886700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feefc886700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80603e0 con 0x7feef80f66e0 2022-02-02T21:32:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feefc886700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8060520 con 0x7feef80f5440 2022-02-02T21:32:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43410/0 (socket says 172.21.15.96:43410) 2022-02-02T21:32:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 -- 172.21.15.96:0/239077221 learned_addr learned my addr 172.21.15.96:0/239077221 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef6d9d700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 0x7feef8109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 -- 172.21.15.96:0/239077221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 msgr2=0x7feef8109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 0x7feef8109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 -- 172.21.15.96:0/239077221 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec005040 con 0x7feef80f66e0 2022-02-02T21:32:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feef659c700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 secure :-1 s=READY pgs=2935 cs=0 l=1 rev1=1 rx=0x7feeec009990 tx=0x7feeec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec018070 con 0x7feef80f66e0 2022-02-02T21:32:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef810c4e0 con 0x7feef80f66e0 2022-02-02T21:32:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feeec007ba0 con 0x7feef80f66e0 2022-02-02T21:32:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.160+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec01c3c0 con 0x7feef80f66e0 2022-02-02T21:32:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.161+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef810ca40 con 0x7feef80f66e0 2022-02-02T21:32:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.162+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8045ad0 con 0x7feef80f66e0 2022-02-02T21:32:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.162+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feeec01d420 con 0x7feef80f66e0 2022-02-02T21:32:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.162+0000 7feedf7fe700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 0x7feee00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.162+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feeec0836c0 con 0x7feef80f66e0 2022-02-02T21:32:47.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.162+0000 7feef6d9d700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 0x7feee00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.163+0000 7feef6d9d700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 0x7feee00672e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7feef8060060 tx=0x7feee800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:47.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.167+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feeec0517c0 con 0x7feef80f66e0 2022-02-02T21:32:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.399+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feef8027a00 con 0x7feef80f66e0 2022-02-02T21:32:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.399+0000 7feedf7fe700 1 -- 172.21.15.96:0/239077221 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7feeec054de0 con 0x7feef80f66e0 2022-02-02T21:32:47.401 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:32:47.402 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:32:47.402 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:32:47.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:47.403 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:32:47.403 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:32:47.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:32:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:32:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:47.404 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:32:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:32:47.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:32:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:32:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:32:47.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:32:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:32:47.407 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:32:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 msgr2=0x7feee00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 0x7feee00672e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7feef8060060 tx=0x7feee800b040).stop 2022-02-02T21:32:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 msgr2=0x7feef810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 secure :-1 s=READY pgs=2935 cs=0 l=1 rev1=1 rx=0x7feeec009990 tx=0x7feeec009b30).stop 2022-02-02T21:32:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 shutdown_connections 2022-02-02T21:32:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feee0064e20 0x7feee00672e0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feef80f5440 0x7feef8109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 --2- 172.21.15.96:0/239077221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef80f66e0 0x7feef810bf90 unknown :-1 s=CLOSED pgs=2935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 >> 172.21.15.96:0/239077221 conn(0x7feef80f0ba0 msgr2=0x7feef80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 shutdown_connections 2022-02-02T21:32:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.401+0000 7feefc886700 1 -- 172.21.15.96:0/239077221 wait complete. 2022-02-02T21:32:47.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 -- 172.21.15.96:0/2963127707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f7980 msgr2=0x7f49600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 --2- 172.21.15.96:0/2963127707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f7980 0x7f49600f7de0 secure :-1 s=READY pgs=2936 cs=0 l=1 rev1=1 rx=0x7f4950004660 tx=0x7f4950009b30).stop 2022-02-02T21:32:47.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 -- 172.21.15.96:0/2963127707 shutdown_connections 2022-02-02T21:32:47.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 --2- 172.21.15.96:0/2963127707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f7980 0x7f49600f7de0 unknown :-1 s=CLOSED pgs=2936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 --2- 172.21.15.96:0/2963127707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f66e0 0x7f49600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 -- 172.21.15.96:0/2963127707 >> 172.21.15.96:0/2963127707 conn(0x7f49600f1e40 msgr2=0x7f49600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:47.503 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:47 smithi096 ceph-mon[101353]: pgmap v5720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:47.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 -- 172.21.15.96:0/2963127707 shutdown_connections 2022-02-02T21:32:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.499+0000 7f4965bfe700 1 -- 172.21.15.96:0/2963127707 wait complete. 2022-02-02T21:32:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 Processor -- start 2022-02-02T21:32:47.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 -- start start 2022-02-02T21:32:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f7980 0x7f4960069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496006a380 con 0x7f49600f66e0 2022-02-02T21:32:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f4965bfe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496006a4c0 con 0x7f49600f7980 2022-02-02T21:32:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43418/0 (socket says 172.21.15.96:43418) 2022-02-02T21:32:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.500+0000 7f495f7fe700 1 -- 172.21.15.96:0/775761658 learned_addr learned my addr 172.21.15.96:0/775761658 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:32:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f495effd700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f7980 0x7f4960069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f495f7fe700 1 -- 172.21.15.96:0/775761658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f7980 msgr2=0x7f4960069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f495f7fe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f7980 0x7f4960069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f495f7fe700 1 -- 172.21.15.96:0/775761658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950005040 con 0x7f49600f66e0 2022-02-02T21:32:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f495f7fe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 rx=0x7f4954002700 tx=0x7f4954009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49540079c0 con 0x7f49600f66e0 2022-02-02T21:32:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496006a7a0 con 0x7f49600f66e0 2022-02-02T21:32:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f495400f040 con 0x7f49600f66e0 2022-02-02T21:32:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4954014860 con 0x7f49600f66e0 2022-02-02T21:32:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.501+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496010ef90 con 0x7f49600f66e0 2022-02-02T21:32:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.502+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4960045ad0 con 0x7f49600f66e0 2022-02-02T21:32:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.503+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f495401b060 con 0x7f49600f66e0 2022-02-02T21:32:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.503+0000 7f4947fff700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 0x7f4948067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:32:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.503+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49540818e0 con 0x7f49600f66e0 2022-02-02T21:32:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.503+0000 7f495effd700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 0x7f4948067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:32:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.504+0000 7f495effd700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 0x7f4948067290 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f4950004630 tx=0x7f4950009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:32:47.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.507+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f495404f9e0 con 0x7f49600f66e0 2022-02-02T21:32:47.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:47 smithi159 ceph-mon[69013]: pgmap v5720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.706+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49600fefe0 con 0x7f49600f66e0 2022-02-02T21:32:47.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.706+0000 7f4947fff700 1 -- 172.21.15.96:0/775761658 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4954019070 con 0x7f49600f66e0 2022-02-02T21:32:47.708 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:32:47.709 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:32:47.709 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:32:47.709 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:32:47.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:47.710 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:32:47.710 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:32:47.711 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:32:47.711 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:32:47.711 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:32:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:32:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:32:47.712 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:32:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:32:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:32:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:32:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:32:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:32:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:32:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:32:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:32:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:32:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:32:47.716 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:32:47.717 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:32:47.717 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:32:47.717 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:32:47.718 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:32:47.718 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:32:47.718 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:32:47.719 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:32:47.719 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:32:47.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:47.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:47.720 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:32:47.720 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:32:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:32:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 msgr2=0x7f4948067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 0x7f4948067290 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f4950004630 tx=0x7f4950009b30).stop 2022-02-02T21:32:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 msgr2=0x7f496006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:32:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 rx=0x7f4954002700 tx=0x7f4954009d80).stop 2022-02-02T21:32:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 shutdown_connections 2022-02-02T21:32:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4948064dd0 0x7f4948067290 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600f66e0 0x7f496006b9a0 unknown :-1 s=CLOSED pgs=2937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 --2- 172.21.15.96:0/775761658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600f7980 0x7f4960069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:32:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 >> 172.21.15.96:0/775761658 conn(0x7f49600f1e40 msgr2=0x7f49600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:32:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 shutdown_connections 2022-02-02T21:32:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:32:47.708+0000 7f4965bfe700 1 -- 172.21.15.96:0/775761658 wait complete. 2022-02-02T21:32:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:32:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:48 smithi159 ceph-mon[69013]: from='client.39970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:48 smithi159 ceph-mon[69013]: from='client.39974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/239077221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:32:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/775761658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:32:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:48 smithi096 ceph-mon[101353]: from='client.39970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:48 smithi096 ceph-mon[101353]: from='client.39974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:32:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/239077221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:32:48.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/775761658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:32:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:49 smithi159 ceph-mon[69013]: pgmap v5721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:49.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:49 smithi096 ceph-mon[101353]: pgmap v5721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:51.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:51 smithi096 ceph-mon[101353]: pgmap v5722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:51 smithi159 ceph-mon[69013]: pgmap v5722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:53 smithi096 ceph-mon[101353]: pgmap v5723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:53 smithi159 ceph-mon[69013]: pgmap v5723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:55 smithi096 ceph-mon[101353]: pgmap v5724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:55 smithi159 ceph-mon[69013]: pgmap v5724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:57 smithi096 ceph-mon[101353]: pgmap v5725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:57 smithi159 ceph-mon[69013]: pgmap v5725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:32:58 smithi159 ceph-mon[69013]: pgmap v5726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:32:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:32:58 smithi096 ceph-mon[101353]: pgmap v5726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:01 smithi159 ceph-mon[69013]: pgmap v5727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:01 smithi096 ceph-mon[101353]: pgmap v5727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:03 smithi159 ceph-mon[69013]: pgmap v5728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:03 smithi096 ceph-mon[101353]: pgmap v5728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:05 smithi096 ceph-mon[101353]: pgmap v5729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:05 smithi159 ceph-mon[69013]: pgmap v5729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:07 smithi096 ceph-mon[101353]: pgmap v5730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:07 smithi159 ceph-mon[69013]: pgmap v5730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:08 smithi159 ceph-mon[69013]: pgmap v5731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:08 smithi096 ceph-mon[101353]: pgmap v5731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:11 smithi159 ceph-mon[69013]: pgmap v5732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:11 smithi096 ceph-mon[101353]: pgmap v5732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:13 smithi159 ceph-mon[69013]: pgmap v5733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:13 smithi096 ceph-mon[101353]: pgmap v5733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:15 smithi096 ceph-mon[101353]: pgmap v5734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:15 smithi159 ceph-mon[69013]: pgmap v5734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:17 smithi096 ceph-mon[101353]: pgmap v5735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:17 smithi159 ceph-mon[69013]: pgmap v5735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 -- 172.21.15.96:0/4227341084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f7960 msgr2=0x7fac080f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 --2- 172.21.15.96:0/4227341084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f7960 0x7fac080f7dc0 secure :-1 s=READY pgs=2938 cs=0 l=1 rev1=1 rx=0x7fabf8004660 tx=0x7fabf8009b30).stop 2022-02-02T21:33:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 -- 172.21.15.96:0/4227341084 shutdown_connections 2022-02-02T21:33:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 --2- 172.21.15.96:0/4227341084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f7960 0x7fac080f7dc0 unknown :-1 s=CLOSED pgs=2938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 --2- 172.21.15.96:0/4227341084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f66c0 0x7fac080f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 -- 172.21.15.96:0/4227341084 >> 172.21.15.96:0/4227341084 conn(0x7fac080f1e20 msgr2=0x7fac080f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 -- 172.21.15.96:0/4227341084 shutdown_connections 2022-02-02T21:33:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.820+0000 7fac0d65e700 1 -- 172.21.15.96:0/4227341084 wait complete. 2022-02-02T21:33:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 Processor -- start 2022-02-02T21:33:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 -- start start 2022-02-02T21:33:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f7960 0x7fac08107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081079e0 con 0x7fac080f66c0 2022-02-02T21:33:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac0d65e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08107b20 con 0x7fac080f7960 2022-02-02T21:33:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43436/0 (socket says 172.21.15.96:43436) 2022-02-02T21:33:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 -- 172.21.15.96:0/3845232339 learned_addr learned my addr 172.21.15.96:0/3845232339 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac067fc700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f7960 0x7fac08107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 -- 172.21.15.96:0/3845232339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f7960 msgr2=0x7fac08107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f7960 0x7fac08107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 -- 172.21.15.96:0/3845232339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8005040 con 0x7fac080f66c0 2022-02-02T21:33:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.821+0000 7fac06ffd700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 rx=0x7fabfc00c790 tx=0x7fabfc007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.822+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc013630 con 0x7fac080f66c0 2022-02-02T21:33:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.822+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac081084c0 con 0x7fac080f66c0 2022-02-02T21:33:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.822+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fabfc012860 con 0x7fac080f66c0 2022-02-02T21:33:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.822+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc002780 con 0x7fac080f66c0 2022-02-02T21:33:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.822+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08108a80 con 0x7fac080f66c0 2022-02-02T21:33:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.823+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac08045ad0 con 0x7fac080f66c0 2022-02-02T21:33:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.823+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fabfc010070 con 0x7fac080f66c0 2022-02-02T21:33:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.824+0000 7fabef7fe700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.824+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fabfc081b30 con 0x7fac080f66c0 2022-02-02T21:33:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.824+0000 7fac067fc700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.824+0000 7fac067fc700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fabf8004630 tx=0x7fabf8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:17.828+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fabfc053600 con 0x7fac080f66c0 2022-02-02T21:33:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.007+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac080fefc0 con 0x7fabf0064dd0 2022-02-02T21:33:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.008+0000 7fabef7fe700 1 -- 172.21.15.96:0/3845232339 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fac080fefc0 con 0x7fabf0064dd0 2022-02-02T21:33:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 msgr2=0x7fabf0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fabf8004630 tx=0x7fabf8009b30).stop 2022-02-02T21:33:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 msgr2=0x7fac08106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 rx=0x7fabfc00c790 tx=0x7fabfc007d90).stop 2022-02-02T21:33:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 shutdown_connections 2022-02-02T21:33:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac080f66c0 0x7fac08106f40 unknown :-1 s=CLOSED pgs=2939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 --2- 172.21.15.96:0/3845232339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac080f7960 0x7fac08107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 >> 172.21.15.96:0/3845232339 conn(0x7fac080f1e20 msgr2=0x7fac080fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 shutdown_connections 2022-02-02T21:33:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.010+0000 7fac0d65e700 1 -- 172.21.15.96:0/3845232339 wait complete. 2022-02-02T21:33:18.020 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:33:18.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2427084014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f6860 msgr2=0x7ff6a80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2427084014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f6860 0x7ff6a80f6cc0 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 rx=0x7ff690004660 tx=0x7ff690009b30).stop 2022-02-02T21:33:18.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2427084014 shutdown_connections 2022-02-02T21:33:18.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2427084014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f6860 0x7ff6a80f6cc0 unknown :-1 s=CLOSED pgs=2940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2427084014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f55c0 0x7ff6a80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:33:18.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2427084014 >> 172.21.15.96:0/2427084014 conn(0x7ff6a80f0d40 msgr2=0x7ff6a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2427084014 shutdown_connections 2022-02-02T21:33:18.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.108+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2427084014 wait complete. 2022-02-02T21:33:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.109+0000 7ff6adb4b700 1 Processor -- start 2022-02-02T21:33:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.109+0000 7ff6adb4b700 1 -- start start 2022-02-02T21:33:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6adb4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6adb4b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f6860 0x7ff6a810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6adb4b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8060470 con 0x7ff6a80f55c0 2022-02-02T21:33:18.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6adb4b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80605b0 con 0x7ff6a80f6860 2022-02-02T21:33:18.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43446/0 (socket says 172.21.15.96:43446) 2022-02-02T21:33:18.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 -- 172.21.15.96:0/2798599366 learned_addr learned my addr 172.21.15.96:0/2798599366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a6ffd700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f6860 0x7ff6a810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 -- 172.21.15.96:0/2798599366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f6860 msgr2=0x7ff6a810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f6860 0x7ff6a810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 -- 172.21.15.96:0/2798599366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690005040 con 0x7ff6a80f55c0 2022-02-02T21:33:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff6a77fe700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 secure :-1 s=READY pgs=2941 cs=0 l=1 rev1=1 rx=0x7ff6980093f0 tx=0x7ff698006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.110+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff698013640 con 0x7ff6a80f55c0 2022-02-02T21:33:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.111+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff698013c50 con 0x7ff6a80f55c0 2022-02-02T21:33:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.111+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a810c810 con 0x7ff6a80f55c0 2022-02-02T21:33:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.111+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff698012c70 con 0x7ff6a80f55c0 2022-02-02T21:33:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.111+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a810cda0 con 0x7ff6a80f55c0 2022-02-02T21:33:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.112+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff69801a060 con 0x7ff6a80f55c0 2022-02-02T21:33:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.112+0000 7ff69ffff700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 0x7ff694067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.112+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff698081a70 con 0x7ff6a80f55c0 2022-02-02T21:33:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.112+0000 7ff6a6ffd700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 0x7ff694067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.113+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80f49b0 con 0x7ff6a80f55c0 2022-02-02T21:33:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.113+0000 7ff6a6ffd700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 0x7ff694067290 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7ff690004630 tx=0x7ff690009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.117+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff69804fb70 con 0x7ff6a80f55c0 2022-02-02T21:33:18.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.293+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a80fde80 con 0x7ff694064dd0 2022-02-02T21:33:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.302+0000 7ff69ffff700 1 -- 172.21.15.96:0/2798599366 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff6a80fde80 con 0x7ff694064dd0 2022-02-02T21:33:18.303 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:33:18.304 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:33:18.304 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:33:18.305 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:33:18.306 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:33:18.307 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:33:18.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:33:18.308 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:33:18.309 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:33:18.310 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:33:18.310 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:33:18.311 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:33:18.311 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:33:18.312 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:33:18.313 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:33:18.313 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:33:18.314 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:33:18.314 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:33:18.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:33:18.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:33:18.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:33:18.316 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:33:18.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 msgr2=0x7ff694067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 0x7ff694067290 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7ff690004630 tx=0x7ff690009b30).stop 2022-02-02T21:33:18.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 msgr2=0x7ff6a8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 secure :-1 s=READY pgs=2941 cs=0 l=1 rev1=1 rx=0x7ff6980093f0 tx=0x7ff698006ec0).stop 2022-02-02T21:33:18.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 shutdown_connections 2022-02-02T21:33:18.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff694064dd0 0x7ff694067290 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6a80f55c0 0x7ff6a8109cb0 unknown :-1 s=CLOSED pgs=2941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 --2- 172.21.15.96:0/2798599366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a80f6860 0x7ff6a810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 >> 172.21.15.96:0/2798599366 conn(0x7ff6a80f0d40 msgr2=0x7ff6a80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 shutdown_connections 2022-02-02T21:33:18.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.304+0000 7ff6adb4b700 1 -- 172.21.15.96:0/2798599366 wait complete. 2022-02-02T21:33:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1208290510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f55c0 msgr2=0x7fb69c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1208290510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f59e0 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 rx=0x7fb690004660 tx=0x7fb690009b30).stop 2022-02-02T21:33:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1208290510 shutdown_connections 2022-02-02T21:33:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1208290510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1208290510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f59e0 unknown :-1 s=CLOSED pgs=2942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1208290510 >> 172.21.15.96:0/1208290510 conn(0x7fb69c0f0d40 msgr2=0x7fb69c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1208290510 shutdown_connections 2022-02-02T21:33:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.401+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1208290510 wait complete. 2022-02-02T21:33:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 Processor -- start 2022-02-02T21:33:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 -- start start 2022-02-02T21:33:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c0f8100 con 0x7fb69c0f6860 2022-02-02T21:33:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a2ead700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c0f8240 con 0x7fb69c0f55c0 2022-02-02T21:33:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb69bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb69bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43458/0 (socket says 172.21.15.96:43458) 2022-02-02T21:33:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb69bfff700 1 -- 172.21.15.96:0/1197646899 learned_addr learned my addr 172.21.15.96:0/1197646899 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:18.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.402+0000 7fb6a0c49700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb69bfff700 1 -- 172.21.15.96:0/1197646899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f55c0 msgr2=0x7fb69c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb69bfff700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb69bfff700 1 -- 172.21.15.96:0/1197646899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690005040 con 0x7fb69c0f6860 2022-02-02T21:33:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb69bfff700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 rx=0x7fb68800c530 tx=0x7fb688007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb68800f650 con 0x7fb69c0f6860 2022-02-02T21:33:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb68800fc60 con 0x7fb69c0f6860 2022-02-02T21:33:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688012c20 con 0x7fb69c0f6860 2022-02-02T21:33:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c0f8520 con 0x7fb69c0f6860 2022-02-02T21:33:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.403+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c10efa0 con 0x7fb69c0f6860 2022-02-02T21:33:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb688010070 con 0x7fb69c0f6860 2022-02-02T21:33:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c045ad0 con 0x7fb69c0f6860 2022-02-02T21:33:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6997fa700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 0x7fb68c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb688081670 con 0x7fb69c0f6860 2022-02-02T21:33:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6a0c49700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 0x7fb68c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.405+0000 7fb6a0c49700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 0x7fb68c067290 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fb690013690 tx=0x7fb690009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.409+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb6880477d0 con 0x7fb69c0f6860 2022-02-02T21:33:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.642+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb69c0f86b0 con 0x7fb69c0f6860 2022-02-02T21:33:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.643+0000 7fb6997fa700 1 -- 172.21.15.96:0/1197646899 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb69c0f86b0 con 0x7fb69c0f6860 2022-02-02T21:33:18.644 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:33:18.645 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:33:18.645 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:33:18.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:18.646 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:33:18.646 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:33:18.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:18.647 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:33:18.647 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:33:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:33:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:33:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:33:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:33:18.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:33:18.654 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:33:18.654 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:33:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 msgr2=0x7fb68c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 0x7fb68c067290 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fb690013690 tx=0x7fb690009b30).stop 2022-02-02T21:33:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 msgr2=0x7fb69c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 rx=0x7fb68800c530 tx=0x7fb688007e20).stop 2022-02-02T21:33:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 shutdown_connections 2022-02-02T21:33:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb68c064dd0 0x7fb68c067290 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb69c0f55c0 0x7fb69c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 --2- 172.21.15.96:0/1197646899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c0f6860 0x7fb69c0f7ba0 unknown :-1 s=CLOSED pgs=2943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.644+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 >> 172.21.15.96:0/1197646899 conn(0x7fb69c0f0d40 msgr2=0x7fb69c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.645+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 shutdown_connections 2022-02-02T21:33:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.645+0000 7fb6a2ead700 1 -- 172.21.15.96:0/1197646899 wait complete. 2022-02-02T21:33:18.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 -- 172.21.15.96:0/517141337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 msgr2=0x7fce7c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 --2- 172.21.15.96:0/517141337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c0f5860 secure :-1 s=READY pgs=2944 cs=0 l=1 rev1=1 rx=0x7fce6c004660 tx=0x7fce6c009b30).stop 2022-02-02T21:33:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 -- 172.21.15.96:0/517141337 shutdown_connections 2022-02-02T21:33:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 --2- 172.21.15.96:0/517141337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 --2- 172.21.15.96:0/517141337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c0f5860 unknown :-1 s=CLOSED pgs=2944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 -- 172.21.15.96:0/517141337 >> 172.21.15.96:0/517141337 conn(0x7fce7c0f0ba0 msgr2=0x7fce7c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.742+0000 7fce7b59e700 1 -- 172.21.15.96:0/517141337 shutdown_connections 2022-02-02T21:33:18.745 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:18 smithi096 ceph-mon[101353]: from='client.39986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:18.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:18 smithi096 ceph-mon[101353]: pgmap v5736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:18.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:18 smithi096 ceph-mon[101353]: from='client.39990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.743+0000 7fce7b59e700 1 -- 172.21.15.96:0/517141337 wait complete. 2022-02-02T21:33:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.743+0000 7fce7b59e700 1 Processor -- start 2022-02-02T21:33:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.743+0000 7fce7b59e700 1 -- start start 2022-02-02T21:33:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.743+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0603c0 con 0x7fce7c0f5440 2022-02-02T21:33:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c060500 con 0x7fce7c0f66e0 2022-02-02T21:33:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43466/0 (socket says 172.21.15.96:43466) 2022-02-02T21:33:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 -- 172.21.15.96:0/494297971 learned_addr learned my addr 172.21.15.96:0/494297971 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce79d9b700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 -- 172.21.15.96:0/494297971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 msgr2=0x7fce7c10bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c10bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 -- 172.21.15.96:0/494297971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c005040 con 0x7fce7c0f5440 2022-02-02T21:33:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7a59c700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 rx=0x7fce6c004ee0 tx=0x7fce6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6c007ba0 con 0x7fce7c0f5440 2022-02-02T21:33:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1058a0 con 0x7fce7c0f5440 2022-02-02T21:33:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce6c0097d0 con 0x7fce7c0f5440 2022-02-02T21:33:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.744+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6c0226a0 con 0x7fce7c0f5440 2022-02-02T21:33:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.745+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c105e00 con 0x7fce7c0f5440 2022-02-02T21:33:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.745+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c045ad0 con 0x7fce7c0f5440 2022-02-02T21:33:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.746+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce6c029060 con 0x7fce7c0f5440 2022-02-02T21:33:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.746+0000 7fce6affd700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 0x7fce640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.746+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce6c087440 con 0x7fce7c0f5440 2022-02-02T21:33:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.746+0000 7fce79d9b700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 0x7fce640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.747+0000 7fce79d9b700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 0x7fce640672e0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fce70004c40 tx=0x7fce7000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.751+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce6c055600 con 0x7fce7c0f5440 2022-02-02T21:33:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.952+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce7c0fdcd0 con 0x7fce7c0f5440 2022-02-02T21:33:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.952+0000 7fce6affd700 1 -- 172.21.15.96:0/494297971 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fce6c027720 con 0x7fce7c0f5440 2022-02-02T21:33:18.953 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:33:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:33:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:33:18.954 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:33:18.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:18.955 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:33:18.955 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:33:18.956 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:33:18.956 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:33:18.956 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:33:18.957 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:33:18.957 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:33:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:33:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:33:18.958 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:33:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:33:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:33:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:33:18.960 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:33:18.960 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:33:18.960 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:33:18.961 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:33:18.961 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:33:18.961 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:33:18.962 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:33:18.962 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:33:18.962 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:33:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:33:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:33:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:33:18.964 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:33:18.964 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:33:18.965 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:18.965 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:18.965 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:33:18.966 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:18.966 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:18.967 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:18.967 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 msgr2=0x7fce640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 0x7fce640672e0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fce70004c40 tx=0x7fce7000b040).stop 2022-02-02T21:33:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 msgr2=0x7fce7c109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 rx=0x7fce6c004ee0 tx=0x7fce6c009b30).stop 2022-02-02T21:33:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 shutdown_connections 2022-02-02T21:33:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce64064e20 0x7fce640672e0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce7c0f5440 0x7fce7c109ac0 unknown :-1 s=CLOSED pgs=2945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 --2- 172.21.15.96:0/494297971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce7c0f66e0 0x7fce7c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 >> 172.21.15.96:0/494297971 conn(0x7fce7c0f0ba0 msgr2=0x7fce7c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 shutdown_connections 2022-02-02T21:33:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:18.954+0000 7fce7b59e700 1 -- 172.21.15.96:0/494297971 wait complete. 2022-02-02T21:33:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:33:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:18 smithi159 ceph-mon[69013]: from='client.39986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:18 smithi159 ceph-mon[69013]: pgmap v5736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:19.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:18 smithi159 ceph-mon[69013]: from='client.39990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:20.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1197646899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:33:20.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/494297971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:33:20.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1197646899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:33:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/494297971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:33:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:20 smithi159 ceph-mon[69013]: pgmap v5737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:20 smithi096 ceph-mon[101353]: pgmap v5737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:23 smithi096 ceph-mon[101353]: pgmap v5738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:23 smithi159 ceph-mon[69013]: pgmap v5738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:25 smithi096 ceph-mon[101353]: pgmap v5739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:25 smithi159 ceph-mon[69013]: pgmap v5739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:27 smithi096 ceph-mon[101353]: pgmap v5740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:27 smithi159 ceph-mon[69013]: pgmap v5740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:33:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:33:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:28 smithi159 ceph-mon[69013]: pgmap v5741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:33:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:33:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:28 smithi096 ceph-mon[101353]: pgmap v5741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:31 smithi096 ceph-mon[101353]: pgmap v5742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:31 smithi159 ceph-mon[69013]: pgmap v5742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:33 smithi096 ceph-mon[101353]: pgmap v5743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:33 smithi159 ceph-mon[69013]: pgmap v5743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:35 smithi096 ceph-mon[101353]: pgmap v5744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:35 smithi159 ceph-mon[69013]: pgmap v5744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:37 smithi096 ceph-mon[101353]: pgmap v5745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:37 smithi159 ceph-mon[69013]: pgmap v5745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:38 smithi159 ceph-mon[69013]: pgmap v5746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:38 smithi096 ceph-mon[101353]: pgmap v5746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:41 smithi096 ceph-mon[101353]: pgmap v5747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:41 smithi159 ceph-mon[69013]: pgmap v5747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:43 smithi096 ceph-mon[101353]: pgmap v5748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:43.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:43 smithi159 ceph-mon[69013]: pgmap v5748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:45.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:45 smithi096 ceph-mon[101353]: pgmap v5749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:45 smithi159 ceph-mon[69013]: pgmap v5749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:47 smithi096 ceph-mon[101353]: pgmap v5750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:47 smithi159 ceph-mon[69013]: pgmap v5750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:48 smithi159 ceph-mon[69013]: pgmap v5751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:48 smithi096 ceph-mon[101353]: pgmap v5751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 -- 172.21.15.96:0/1523711981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f7980 msgr2=0x7fd0700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 --2- 172.21.15.96:0/1523711981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f7980 0x7fd0700f7de0 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 rx=0x7fd06c004660 tx=0x7fd06c009b30).stop 2022-02-02T21:33:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 -- 172.21.15.96:0/1523711981 shutdown_connections 2022-02-02T21:33:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 --2- 172.21.15.96:0/1523711981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f7980 0x7fd0700f7de0 unknown :-1 s=CLOSED pgs=2946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 --2- 172.21.15.96:0/1523711981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f66e0 0x7fd0700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:33:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 -- 172.21.15.96:0/1523711981 >> 172.21.15.96:0/1523711981 conn(0x7fd0700f1e40 msgr2=0x7fd0700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 -- 172.21.15.96:0/1523711981 shutdown_connections 2022-02-02T21:33:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.064+0000 7fd07740c700 1 -- 172.21.15.96:0/1523711981 wait complete. 2022-02-02T21:33:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 Processor -- start 2022-02-02T21:33:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 -- start start 2022-02-02T21:33:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f7980 0x7fd070069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07006a410 con 0x7fd0700f66e0 2022-02-02T21:33:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd07740c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07006a550 con 0x7fd0700f7980 2022-02-02T21:33:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd0751a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd0751a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43486/0 (socket says 172.21.15.96:43486) 2022-02-02T21:33:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd0751a8700 1 -- 172.21.15.96:0/52138341 learned_addr learned my addr 172.21.15.96:0/52138341 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.065+0000 7fd0749a7700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f7980 0x7fd070069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd0751a8700 1 -- 172.21.15.96:0/52138341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f7980 msgr2=0x7fd070069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd0751a8700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f7980 0x7fd070069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd0751a8700 1 -- 172.21.15.96:0/52138341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c005040 con 0x7fd0700f66e0 2022-02-02T21:33:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd0751a8700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 secure :-1 s=READY pgs=2947 cs=0 l=1 rev1=1 rx=0x7fd0600093f0 tx=0x7fd060006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd060009ea0 con 0x7fd0700f66e0 2022-02-02T21:33:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07006a830 con 0x7fd0700f66e0 2022-02-02T21:33:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd060013af0 con 0x7fd0700f66e0 2022-02-02T21:33:49.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06000db10 con 0x7fd0700f66e0 2022-02-02T21:33:49.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.066+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07010efe0 con 0x7fd0700f66e0 2022-02-02T21:33:49.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.067+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd070045ad0 con 0x7fd0700f66e0 2022-02-02T21:33:49.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.067+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd06001a060 con 0x7fd0700f66e0 2022-02-02T21:33:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.068+0000 7fd065ffb700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 0x7fd05c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.068+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd0600819e0 con 0x7fd0700f66e0 2022-02-02T21:33:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.068+0000 7fd0749a7700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 0x7fd05c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.068+0000 7fd0749a7700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 0x7fd05c067270 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fd06c004e30 tx=0x7fd06c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.072+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd06004fc30 con 0x7fd0700f66e0 2022-02-02T21:33:49.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.250+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd070057f10 con 0x7fd05c064db0 2022-02-02T21:33:49.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.252+0000 7fd065ffb700 1 -- 172.21.15.96:0/52138341 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd070057f10 con 0x7fd05c064db0 2022-02-02T21:33:49.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 msgr2=0x7fd05c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 0x7fd05c067270 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fd06c004e30 tx=0x7fd06c009b30).stop 2022-02-02T21:33:49.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 msgr2=0x7fd07006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 secure :-1 s=READY pgs=2947 cs=0 l=1 rev1=1 rx=0x7fd0600093f0 tx=0x7fd060006ec0).stop 2022-02-02T21:33:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 shutdown_connections 2022-02-02T21:33:49.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd05c064db0 0x7fd05c067270 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0700f66e0 0x7fd07006b9a0 unknown :-1 s=CLOSED pgs=2947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 --2- 172.21.15.96:0/52138341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0700f7980 0x7fd070069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.253+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 >> 172.21.15.96:0/52138341 conn(0x7fd0700f1e40 msgr2=0x7fd0700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.254+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 shutdown_connections 2022-02-02T21:33:49.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.254+0000 7fd07740c700 1 -- 172.21.15.96:0/52138341 wait complete. 2022-02-02T21:33:49.263 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:33:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 -- 172.21.15.96:0/1748282746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 msgr2=0x7f49580f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 --2- 172.21.15.96:0/1748282746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f6b30 secure :-1 s=READY pgs=2948 cs=0 l=1 rev1=1 rx=0x7f4948004660 tx=0x7f4948009b30).stop 2022-02-02T21:33:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 -- 172.21.15.96:0/1748282746 shutdown_connections 2022-02-02T21:33:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 --2- 172.21.15.96:0/1748282746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f6b30 unknown :-1 s=CLOSED pgs=2948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 --2- 172.21.15.96:0/1748282746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 0x7f49580f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.351+0000 7f495ed62700 1 -- 172.21.15.96:0/1748282746 >> 172.21.15.96:0/1748282746 conn(0x7f49580f0b90 msgr2=0x7f49580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 -- 172.21.15.96:0/1748282746 shutdown_connections 2022-02-02T21:33:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 -- 172.21.15.96:0/1748282746 wait complete. 2022-02-02T21:33:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 Processor -- start 2022-02-02T21:33:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 -- start start 2022-02-02T21:33:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 0x7f49580f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580f8790 con 0x7f49580f66d0 2022-02-02T21:33:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.352+0000 7f495ed62700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580f88d0 con 0x7f49580f5430 2022-02-02T21:33:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43498/0 (socket says 172.21.15.96:43498) 2022-02-02T21:33:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 -- 172.21.15.96:0/2674191833 learned_addr learned my addr 172.21.15.96:0/2674191833 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495dd60700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 0x7f49580f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 -- 172.21.15.96:0/2674191833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 msgr2=0x7f49580f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 0x7f49580f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 -- 172.21.15.96:0/2674191833 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948005040 con 0x7f49580f66d0 2022-02-02T21:33:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495d55f700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 rx=0x7f4948009990 tx=0x7f4948009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4948018070 con 0x7f49580f66d0 2022-02-02T21:33:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4948007ba0 con 0x7f49580f66d0 2022-02-02T21:33:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49580f8b50 con 0x7f49580f66d0 2022-02-02T21:33:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494801c3c0 con 0x7f49580f66d0 2022-02-02T21:33:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.353+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49580f90b0 con 0x7f49580f66d0 2022-02-02T21:33:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.355+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958045ad0 con 0x7f49580f66d0 2022-02-02T21:33:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.355+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f494801d420 con 0x7f49580f66d0 2022-02-02T21:33:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.355+0000 7f494e7fc700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 0x7f49440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.355+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4948082d00 con 0x7f49580f66d0 2022-02-02T21:33:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.355+0000 7f495dd60700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 0x7f49440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.356+0000 7f495dd60700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 0x7f49440672e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f49580f9b40 tx=0x7f495400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.360+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4948050d10 con 0x7f49580f66d0 2022-02-02T21:33:49.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.532+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f495805fd30 con 0x7f4944064e20 2022-02-02T21:33:49.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.541+0000 7f494e7fc700 1 -- 172.21.15.96:0/2674191833 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f495805fd30 con 0x7f4944064e20 2022-02-02T21:33:49.542 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:33:49.543 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:33:49.543 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:33:49.543 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:33:49.544 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:33:49.544 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:33:49.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:33:49.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:33:49.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:33:49.546 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:33:49.546 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:33:49.547 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:33:49.547 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:33:49.547 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:33:49.548 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:33:49.548 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:33:49.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:33:49.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:33:49.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:33:49.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:33:49.550 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:33:49.550 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:33:49.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 msgr2=0x7f49440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 0x7f49440672e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f49580f9b40 tx=0x7f495400b040).stop 2022-02-02T21:33:49.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 msgr2=0x7f49580f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 rx=0x7f4948009990 tx=0x7f4948009b30).stop 2022-02-02T21:33:49.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 shutdown_connections 2022-02-02T21:33:49.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4944064e20 0x7f49440672e0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49580f5430 0x7f49580f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 --2- 172.21.15.96:0/2674191833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49580f66d0 0x7f49580f8230 unknown :-1 s=CLOSED pgs=2949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 >> 172.21.15.96:0/2674191833 conn(0x7f49580f0b90 msgr2=0x7f495805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 shutdown_connections 2022-02-02T21:33:49.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.543+0000 7f495ed62700 1 -- 172.21.15.96:0/2674191833 wait complete. 2022-02-02T21:33:49.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.639+0000 7f655e385700 1 -- 172.21.15.96:0/1036356791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f5970 msgr2=0x7f65580f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 --2- 172.21.15.96:0/1036356791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f5970 0x7f65580f5df0 secure :-1 s=READY pgs=2950 cs=0 l=1 rev1=1 rx=0x7f6540004660 tx=0x7f6540009b30).stop 2022-02-02T21:33:49.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 -- 172.21.15.96:0/1036356791 shutdown_connections 2022-02-02T21:33:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 --2- 172.21.15.96:0/1036356791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f5970 0x7f65580f5df0 unknown :-1 s=CLOSED pgs=2950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 --2- 172.21.15.96:0/1036356791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f6c60 0x7f65580f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 -- 172.21.15.96:0/1036356791 >> 172.21.15.96:0/1036356791 conn(0x7f65580f04c0 msgr2=0x7f65580f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 -- 172.21.15.96:0/1036356791 shutdown_connections 2022-02-02T21:33:49.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 -- 172.21.15.96:0/1036356791 wait complete. 2022-02-02T21:33:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 Processor -- start 2022-02-02T21:33:49.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.640+0000 7f655e385700 1 -- start start 2022-02-02T21:33:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f5970 0x7f6558106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65581079a0 con 0x7f65580f6c60 2022-02-02T21:33:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6558107ae0 con 0x7f65580f5970 2022-02-02T21:33:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43508/0 (socket says 172.21.15.96:43508) 2022-02-02T21:33:49.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 -- 172.21.15.96:0/465918894 learned_addr learned my addr 172.21.15.96:0/465918894 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:49.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f6557fff700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f5970 0x7f6558106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 -- 172.21.15.96:0/465918894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f5970 msgr2=0x7f6558106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f5970 0x7f6558106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 -- 172.21.15.96:0/465918894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540005040 con 0x7f65580f6c60 2022-02-02T21:33:49.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f65577fe700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 rx=0x7f6540009990 tx=0x7f6540009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6540018070 con 0x7f65580f6c60 2022-02-02T21:33:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6540007ba0 con 0x7f65580f6c60 2022-02-02T21:33:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6558108420 con 0x7f65580f6c60 2022-02-02T21:33:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f654001c3c0 con 0x7f65580f6c60 2022-02-02T21:33:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.641+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6558108980 con 0x7f65580f6c60 2022-02-02T21:33:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.642+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6558045ad0 con 0x7f65580f6c60 2022-02-02T21:33:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.643+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f654001d420 con 0x7f65580f6c60 2022-02-02T21:33:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.643+0000 7f6554ff9700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.643+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6540083760 con 0x7f65580f6c60 2022-02-02T21:33:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.643+0000 7f6557fff700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.643+0000 7f6557fff700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 0x7f6544067290 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f65480096c0 tx=0x7f6548009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.647+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6540055230 con 0x7f65580f6c60 2022-02-02T21:33:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.880+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6558109020 con 0x7f65580f6c60 2022-02-02T21:33:49.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:49 smithi096 ceph-mon[101353]: from='client.40002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.880+0000 7f6554ff9700 1 -- 172.21.15.96:0/465918894 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6540054e20 con 0x7f65580f6c60 2022-02-02T21:33:49.882 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:33:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:33:49.882 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:33:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:33:49.883 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:33:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:33:49.884 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:33:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:33:49.885 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:33:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:33:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:33:49.886 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:33:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:33:49.887 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:33:49.887 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:33:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 msgr2=0x7f6544067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 0x7f6544067290 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f65480096c0 tx=0x7f6548009be0).stop 2022-02-02T21:33:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 msgr2=0x7f65581073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 rx=0x7f6540009990 tx=0x7f6540009b30).stop 2022-02-02T21:33:49.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 shutdown_connections 2022-02-02T21:33:49.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580f5970 0x7f6558106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 --2- 172.21.15.96:0/465918894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65580f6c60 0x7f65581073f0 unknown :-1 s=CLOSED pgs=2951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 >> 172.21.15.96:0/465918894 conn(0x7f65580f04c0 msgr2=0x7f65580f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 shutdown_connections 2022-02-02T21:33:49.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.882+0000 7f655e385700 1 -- 172.21.15.96:0/465918894 wait complete. 2022-02-02T21:33:49.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- 172.21.15.96:0/3222727439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 msgr2=0x7fe9200fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 --2- 172.21.15.96:0/3222727439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe9200fbb70 secure :-1 s=READY pgs=2952 cs=0 l=1 rev1=1 rx=0x7fe90c004660 tx=0x7fe90c009b30).stop 2022-02-02T21:33:49.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- 172.21.15.96:0/3222727439 shutdown_connections 2022-02-02T21:33:49.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 --2- 172.21.15.96:0/3222727439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe9200fbb70 unknown :-1 s=CLOSED pgs=2952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 --2- 172.21.15.96:0/3222727439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe9200f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- 172.21.15.96:0/3222727439 >> 172.21.15.96:0/3222727439 conn(0x7fe9200f0320 msgr2=0x7fe9200f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:49.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- 172.21.15.96:0/3222727439 shutdown_connections 2022-02-02T21:33:49.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- 172.21.15.96:0/3222727439 wait complete. 2022-02-02T21:33:49.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 Processor -- start 2022-02-02T21:33:49.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.980+0000 7fe9258ec700 1 -- start start 2022-02-02T21:33:49.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe920106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920107870 con 0x7fe9200f5260 2022-02-02T21:33:49.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201080b0 con 0x7fe9200f48c0 2022-02-02T21:33:49.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43518/0 (socket says 172.21.15.96:43518) 2022-02-02T21:33:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 -- 172.21.15.96:0/1820049764 learned_addr learned my addr 172.21.15.96:0/1820049764 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:33:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9248ea700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe920106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 -- 172.21.15.96:0/1820049764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 msgr2=0x7fe920106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe920106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 -- 172.21.15.96:0/1820049764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c005040 con 0x7fe9200f5260 2022-02-02T21:33:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9248ea700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe920106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:33:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91ffff700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 secure :-1 s=READY pgs=2953 cs=0 l=1 rev1=1 rx=0x7fe90c013a70 tx=0x7fe90c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90c018070 con 0x7fe9200f5260 2022-02-02T21:33:49.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe90c0097d0 con 0x7fe9200f5260 2022-02-02T21:33:49.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe920108330 con 0x7fe9200f5260 2022-02-02T21:33:49.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90c01c3c0 con 0x7fe9200f5260 2022-02-02T21:33:49.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.981+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe920108810 con 0x7fe9200f5260 2022-02-02T21:33:49.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.982+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920059100 con 0x7fe9200f5260 2022-02-02T21:33:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.983+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe90c007ba0 con 0x7fe9200f5260 2022-02-02T21:33:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.983+0000 7fe91d7fa700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 0x7fe9100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:33:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.983+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe90c083800 con 0x7fe9200f5260 2022-02-02T21:33:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.983+0000 7fe9248ea700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 0x7fe9100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:33:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.984+0000 7fe9248ea700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 0x7fe9100672e0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fe920107b40 tx=0x7fe91400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:33:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:49.987+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe90c051900 con 0x7fe9200f5260 2022-02-02T21:33:50.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:49 smithi159 ceph-mon[69013]: from='client.40002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:50.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.187+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9200008d0 con 0x7fe9200f5260 2022-02-02T21:33:50.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.187+0000 7fe91d7fa700 1 -- 172.21.15.96:0/1820049764 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe90c054f20 con 0x7fe9200f5260 2022-02-02T21:33:50.188 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:33:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:33:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:33:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:33:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:50.190 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:33:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:33:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:33:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:33:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:33:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:33:50.192 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:33:50.193 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:33:50.193 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:33:50.193 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:33:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:33:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:33:50.194 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:33:50.195 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:33:50.195 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:33:50.196 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:33:50.196 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:33:50.196 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:33:50.197 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:33:50.197 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:33:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:33:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:33:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:33:50.199 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:33:50.199 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:33:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:33:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:33:50.200 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:50.201 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:50.201 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:33:50.202 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:33:50.202 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:50.202 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:50.203 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:33:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 msgr2=0x7fe9100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 0x7fe9100672e0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fe920107b40 tx=0x7fe91400b040).stop 2022-02-02T21:33:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 msgr2=0x7fe920107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:33:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 secure :-1 s=READY pgs=2953 cs=0 l=1 rev1=1 rx=0x7fe90c013a70 tx=0x7fe90c009b30).stop 2022-02-02T21:33:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 shutdown_connections 2022-02-02T21:33:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe910064e20 0x7fe9100672e0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9200f48c0 0x7fe920106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 --2- 172.21.15.96:0/1820049764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9200f5260 0x7fe920107270 unknown :-1 s=CLOSED pgs=2953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:33:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 >> 172.21.15.96:0/1820049764 conn(0x7fe9200f0320 msgr2=0x7fe9200f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:33:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.190+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 shutdown_connections 2022-02-02T21:33:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:33:50.191+0000 7fe9258ec700 1 -- 172.21.15.96:0/1820049764 wait complete. 2022-02-02T21:33:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:33:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:50 smithi159 ceph-mon[69013]: from='client.40006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/465918894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:33:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1820049764' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:33:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:50 smithi159 ceph-mon[69013]: pgmap v5752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:50 smithi096 ceph-mon[101353]: from='client.40006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:33:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/465918894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:33:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1820049764' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:33:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:50 smithi096 ceph-mon[101353]: pgmap v5752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:53 smithi096 ceph-mon[101353]: pgmap v5753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:53 smithi159 ceph-mon[69013]: pgmap v5753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:55 smithi096 ceph-mon[101353]: pgmap v5754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:55 smithi159 ceph-mon[69013]: pgmap v5754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:57 smithi096 ceph-mon[101353]: pgmap v5755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:57 smithi159 ceph-mon[69013]: pgmap v5755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:33:58 smithi159 ceph-mon[69013]: pgmap v5756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:33:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:33:58 smithi096 ceph-mon[101353]: pgmap v5756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:01 smithi096 ceph-mon[101353]: pgmap v5757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:01 smithi159 ceph-mon[69013]: pgmap v5757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:03 smithi096 ceph-mon[101353]: pgmap v5758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:03 smithi159 ceph-mon[69013]: pgmap v5758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:05 smithi096 ceph-mon[101353]: pgmap v5759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:05 smithi159 ceph-mon[69013]: pgmap v5759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:07 smithi096 ceph-mon[101353]: pgmap v5760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:07 smithi159 ceph-mon[69013]: pgmap v5760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:08 smithi159 ceph-mon[69013]: pgmap v5761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:08 smithi096 ceph-mon[101353]: pgmap v5761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:11 smithi096 ceph-mon[101353]: pgmap v5762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:11.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:11 smithi159 ceph-mon[69013]: pgmap v5762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:13 smithi096 ceph-mon[101353]: pgmap v5763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:13 smithi159 ceph-mon[69013]: pgmap v5763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:15 smithi096 ceph-mon[101353]: pgmap v5764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:15 smithi159 ceph-mon[69013]: pgmap v5764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:17 smithi096 ceph-mon[101353]: pgmap v5765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:17 smithi159 ceph-mon[69013]: pgmap v5765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:18 smithi159 ceph-mon[69013]: pgmap v5766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:18 smithi096 ceph-mon[101353]: pgmap v5766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:20.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 -- 172.21.15.96:0/2004205407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f6860 msgr2=0x7f69ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 --2- 172.21.15.96:0/2004205407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f6860 0x7f69ec0f6cc0 secure :-1 s=READY pgs=2954 cs=0 l=1 rev1=1 rx=0x7f69dc004660 tx=0x7f69dc009b30).stop 2022-02-02T21:34:20.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 -- 172.21.15.96:0/2004205407 shutdown_connections 2022-02-02T21:34:20.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 --2- 172.21.15.96:0/2004205407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f6860 0x7f69ec0f6cc0 unknown :-1 s=CLOSED pgs=2954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 --2- 172.21.15.96:0/2004205407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f55c0 0x7f69ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 -- 172.21.15.96:0/2004205407 >> 172.21.15.96:0/2004205407 conn(0x7f69ec0f0d40 msgr2=0x7f69ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 -- 172.21.15.96:0/2004205407 shutdown_connections 2022-02-02T21:34:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.300+0000 7f69f1194700 1 -- 172.21.15.96:0/2004205407 wait complete. 2022-02-02T21:34:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 Processor -- start 2022-02-02T21:34:20.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 -- start start 2022-02-02T21:34:20.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f6860 0x7f69ec10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0602b0 con 0x7f69ec0f55c0 2022-02-02T21:34:20.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69f1194700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0603f0 con 0x7f69ec0f6860 2022-02-02T21:34:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.301+0000 7f69ead9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43536/0 (socket says 172.21.15.96:43536) 2022-02-02T21:34:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 -- 172.21.15.96:0/3795958179 learned_addr learned my addr 172.21.15.96:0/3795958179 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ea59c700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f6860 0x7f69ec10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 -- 172.21.15.96:0/3795958179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f6860 msgr2=0x7f69ec10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f6860 0x7f69ec10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 -- 172.21.15.96:0/3795958179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc005040 con 0x7f69ec0f55c0 2022-02-02T21:34:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69ead9d700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 secure :-1 s=READY pgs=2955 cs=0 l=1 rev1=1 rx=0x7f69e0002700 tx=0x7f69e0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e00079c0 con 0x7f69ec0f55c0 2022-02-02T21:34:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec10e9d0 con 0x7f69ec0f55c0 2022-02-02T21:34:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69e000f040 con 0x7f69ec0f55c0 2022-02-02T21:34:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e0014850 con 0x7f69ec0f55c0 2022-02-02T21:34:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.302+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec10ee50 con 0x7f69ec0f55c0 2022-02-02T21:34:20.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.303+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec045ad0 con 0x7f69ec0f55c0 2022-02-02T21:34:20.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.304+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f69e001b060 con 0x7f69ec0f55c0 2022-02-02T21:34:20.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.304+0000 7f69d37fe700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 0x7f69d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.304+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f69e0081910 con 0x7f69ec0f55c0 2022-02-02T21:34:20.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.304+0000 7f69ea59c700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 0x7f69d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.305+0000 7f69ea59c700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 0x7f69d4067290 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f69dc004630 tx=0x7f69dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.308+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69e004fa10 con 0x7f69ec0f55c0 2022-02-02T21:34:20.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.487+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69ec057f10 con 0x7f69d4064dd0 2022-02-02T21:34:20.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.489+0000 7f69d37fe700 1 -- 172.21.15.96:0/3795958179 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f69ec057f10 con 0x7f69d4064dd0 2022-02-02T21:34:20.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 msgr2=0x7f69d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 0x7f69d4067290 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f69dc004630 tx=0x7f69dc009b30).stop 2022-02-02T21:34:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 msgr2=0x7f69ec10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 secure :-1 s=READY pgs=2955 cs=0 l=1 rev1=1 rx=0x7f69e0002700 tx=0x7f69e0009e00).stop 2022-02-02T21:34:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 shutdown_connections 2022-02-02T21:34:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f69d4064dd0 0x7f69d4067290 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69ec0f55c0 0x7f69ec10bfe0 unknown :-1 s=CLOSED pgs=2955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 --2- 172.21.15.96:0/3795958179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0f6860 0x7f69ec10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.490+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 >> 172.21.15.96:0/3795958179 conn(0x7f69ec0f0d40 msgr2=0x7f69ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.491+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 shutdown_connections 2022-02-02T21:34:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.491+0000 7f69f1194700 1 -- 172.21.15.96:0/3795958179 wait complete. 2022-02-02T21:34:20.501 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:34:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 -- 172.21.15.96:0/3046433781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 msgr2=0x7f0fa00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/3046433781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f6cc0 secure :-1 s=READY pgs=2956 cs=0 l=1 rev1=1 rx=0x7f0f94004660 tx=0x7f0f94009b30).stop 2022-02-02T21:34:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 -- 172.21.15.96:0/3046433781 shutdown_connections 2022-02-02T21:34:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/3046433781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f6cc0 unknown :-1 s=CLOSED pgs=2956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/3046433781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 0x7f0fa00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 -- 172.21.15.96:0/3046433781 >> 172.21.15.96:0/3046433781 conn(0x7f0fa00f0d40 msgr2=0x7f0fa00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:20.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 -- 172.21.15.96:0/3046433781 shutdown_connections 2022-02-02T21:34:20.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 -- 172.21.15.96:0/3046433781 wait complete. 2022-02-02T21:34:20.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.589+0000 7f0fa65eb700 1 Processor -- start 2022-02-02T21:34:20.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 -- start start 2022-02-02T21:34:20.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 0x7f0fa00f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00f8920 con 0x7f0fa00f6860 2022-02-02T21:34:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00f8a60 con 0x7f0fa00f55c0 2022-02-02T21:34:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43546/0 (socket says 172.21.15.96:43546) 2022-02-02T21:34:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 -- 172.21.15.96:0/653390076 learned_addr learned my addr 172.21.15.96:0/653390076 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9ffff700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 0x7f0fa00f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 -- 172.21.15.96:0/653390076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 msgr2=0x7f0fa00f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 0x7f0fa00f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 -- 172.21.15.96:0/653390076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94005040 con 0x7f0fa00f6860 2022-02-02T21:34:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9f7fe700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 secure :-1 s=READY pgs=2957 cs=0 l=1 rev1=1 rx=0x7f0f94009990 tx=0x7f0f94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f94018070 con 0x7f0fa00f6860 2022-02-02T21:34:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa00f8ce0 con 0x7f0fa00f6860 2022-02-02T21:34:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f94007ba0 con 0x7f0fa00f6860 2022-02-02T21:34:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.590+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9401c620 con 0x7f0fa00f6860 2022-02-02T21:34:20.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.591+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa00f9240 con 0x7f0fa00f6860 2022-02-02T21:34:20.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.592+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa0045ad0 con 0x7f0fa00f6860 2022-02-02T21:34:20.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.592+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f9401c8e0 con 0x7f0fa00f6860 2022-02-02T21:34:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.592+0000 7f0f9cff9700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 0x7f0f88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.592+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0f940838b0 con 0x7f0fa00f6860 2022-02-02T21:34:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.592+0000 7f0f9ffff700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 0x7f0f88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.593+0000 7f0f9ffff700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 0x7f0f88067290 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f0fa00f9cd0 tx=0x7f0f90009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.597+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f94051b50 con 0x7f0fa00f6860 2022-02-02T21:34:20.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.767+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fa005fd30 con 0x7f0f88064dd0 2022-02-02T21:34:20.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.776+0000 7f0f9cff9700 1 -- 172.21.15.96:0/653390076 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0fa005fd30 con 0x7f0f88064dd0 2022-02-02T21:34:20.777 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:34:20.778 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:34:20.778 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:34:20.778 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:34:20.779 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:34:20.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:34:20.779 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:34:20.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:34:20.780 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:34:20.780 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:34:20.781 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:34:20.781 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:34:20.781 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:34:20.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:34:20.782 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:34:20.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:34:20.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:34:20.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:34:20.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:34:20.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:34:20.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:34:20.785 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:34:20.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 msgr2=0x7f0f88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 0x7f0f88067290 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f0fa00f9cd0 tx=0x7f0f90009040).stop 2022-02-02T21:34:20.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 msgr2=0x7f0fa00f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 secure :-1 s=READY pgs=2957 cs=0 l=1 rev1=1 rx=0x7f0f94009990 tx=0x7f0f94009b30).stop 2022-02-02T21:34:20.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 shutdown_connections 2022-02-02T21:34:20.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f88064dd0 0x7f0f88067290 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa00f55c0 0x7f0fa00f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 --2- 172.21.15.96:0/653390076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0fa00f6860 0x7f0fa00f83c0 unknown :-1 s=CLOSED pgs=2957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 >> 172.21.15.96:0/653390076 conn(0x7f0fa00f0d40 msgr2=0x7f0fa005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 shutdown_connections 2022-02-02T21:34:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.778+0000 7f0fa65eb700 1 -- 172.21.15.96:0/653390076 wait complete. 2022-02-02T21:34:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 -- 172.21.15.96:0/1146176235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 msgr2=0x7ffa840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/1146176235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840f59e0 secure :-1 s=READY pgs=2958 cs=0 l=1 rev1=1 rx=0x7ffa78004660 tx=0x7ffa78009b30).stop 2022-02-02T21:34:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 -- 172.21.15.96:0/1146176235 shutdown_connections 2022-02-02T21:34:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/1146176235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/1146176235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840f59e0 unknown :-1 s=CLOSED pgs=2958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 -- 172.21.15.96:0/1146176235 >> 172.21.15.96:0/1146176235 conn(0x7ffa840f0d40 msgr2=0x7ffa840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:20.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 -- 172.21.15.96:0/1146176235 shutdown_connections 2022-02-02T21:34:20.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.874+0000 7ffa88f0e700 1 -- 172.21.15.96:0/1146176235 wait complete. 2022-02-02T21:34:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 Processor -- start 2022-02-02T21:34:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 -- start start 2022-02-02T21:34:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840ff4b0 con 0x7ffa840f55c0 2022-02-02T21:34:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa88f0e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840ff5f0 con 0x7ffa840f6860 2022-02-02T21:34:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa8259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:47660/0 (socket says 172.21.15.96:47660) 2022-02-02T21:34:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa8259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43554/0 (socket says 172.21.15.96:43554) 2022-02-02T21:34:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 -- 172.21.15.96:0/2207197821 learned_addr learned my addr 172.21.15.96:0/2207197821 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 -- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 msgr2=0x7ffa840fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa81d9b700 1 -- 172.21.15.96:0/2207197821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78005040 con 0x7ffa840f6860 2022-02-02T21:34:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.875+0000 7ffa8259c700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:34:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa81d9b700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffa7400c790 tx=0x7ffa74007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa74002590 con 0x7ffa840f6860 2022-02-02T21:34:20.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840fff60 con 0x7ffa840f6860 2022-02-02T21:34:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa74002ba0 con 0x7ffa840f6860 2022-02-02T21:34:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa74013d90 con 0x7ffa840f6860 2022-02-02T21:34:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.876+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84100520 con 0x7ffa840f6860 2022-02-02T21:34:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.877+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa84045ad0 con 0x7ffa840f6860 2022-02-02T21:34:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.877+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa7401a060 con 0x7ffa840f6860 2022-02-02T21:34:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.878+0000 7ffa72ffd700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 0x7ffa6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.878+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa74081cc0 con 0x7ffa840f6860 2022-02-02T21:34:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.878+0000 7ffa8259c700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 0x7ffa6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.878+0000 7ffa8259c700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 0x7ffa6c067290 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7ffa78013690 tx=0x7ffa78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:20.882+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa7404fd60 con 0x7ffa840f6860 2022-02-02T21:34:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.111+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa84100b60 con 0x7ffa840f6860 2022-02-02T21:34:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.112+0000 7ffa72ffd700 1 -- 172.21.15.96:0/2207197821 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ffa74053380 con 0x7ffa840f6860 2022-02-02T21:34:21.113 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:34:21.114 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:34:21.114 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:34:21.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:21.115 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:34:21.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:34:21.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:21.116 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:34:21.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:34:21.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:21.117 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:34:21.117 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:34:21.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:21.118 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:34:21.118 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:34:21.118 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:34:21.119 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:34:21.119 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:34:21.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 msgr2=0x7ffa6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 0x7ffa6c067290 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7ffa78013690 tx=0x7ffa78009b30).stop 2022-02-02T21:34:21.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 msgr2=0x7ffa840feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffa7400c790 tx=0x7ffa74007d70).stop 2022-02-02T21:34:21.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 shutdown_connections 2022-02-02T21:34:21.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa6c064dd0 0x7ffa6c067290 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa840f55c0 0x7ffa840fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 --2- 172.21.15.96:0/2207197821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa840f6860 0x7ffa840feeb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 >> 172.21.15.96:0/2207197821 conn(0x7ffa840f0d40 msgr2=0x7ffa8405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:21.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 shutdown_connections 2022-02-02T21:34:21.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.115+0000 7ffa88f0e700 1 -- 172.21.15.96:0/2207197821 wait complete. 2022-02-02T21:34:21.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 -- 172.21.15.96:0/1076749893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f6550 msgr2=0x7fb51c0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 --2- 172.21.15.96:0/1076749893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f6550 0x7fb51c0f69b0 secure :-1 s=READY pgs=2959 cs=0 l=1 rev1=1 rx=0x7fb518004660 tx=0x7fb518009b30).stop 2022-02-02T21:34:21.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 -- 172.21.15.96:0/1076749893 shutdown_connections 2022-02-02T21:34:21.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 --2- 172.21.15.96:0/1076749893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f6550 0x7fb51c0f69b0 unknown :-1 s=CLOSED pgs=2959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 --2- 172.21.15.96:0/1076749893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c0f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 -- 172.21.15.96:0/1076749893 >> 172.21.15.96:0/1076749893 conn(0x7fb51c0f04c0 msgr2=0x7fb51c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:21.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 -- 172.21.15.96:0/1076749893 shutdown_connections 2022-02-02T21:34:21.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.210+0000 7fb523609700 1 -- 172.21.15.96:0/1076749893 wait complete. 2022-02-02T21:34:21.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 Processor -- start 2022-02-02T21:34:21.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 -- start start 2022-02-02T21:34:21.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:21.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 0x7fb51c10c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0f5680 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb523609700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0f57c0 con 0x7fb51c0f6550 2022-02-02T21:34:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb5213a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb5213a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43564/0 (socket says 172.21.15.96:43564) 2022-02-02T21:34:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.211+0000 7fb5213a5700 1 -- 172.21.15.96:0/2293785770 learned_addr learned my addr 172.21.15.96:0/2293785770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb520ba4700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 0x7fb51c10c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb5213a5700 1 -- 172.21.15.96:0/2293785770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 msgr2=0x7fb51c10c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb5213a5700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 0x7fb51c10c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb5213a5700 1 -- 172.21.15.96:0/2293785770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518005040 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb520ba4700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 0x7fb51c10c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:34:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb5213a5700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 secure :-1 s=READY pgs=2960 cs=0 l=1 rev1=1 rx=0x7fb50c00c510 tx=0x7fb50c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50c00f650 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c10c7c0 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb50c00fc60 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50c012cb0 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.212+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c10cd50 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.213+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51c0f4150 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.214+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb50c010070 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.214+0000 7fb511ffb700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 0x7fb508067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.215+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb50c081400 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.215+0000 7fb520ba4700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 0x7fb508067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:21.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.215+0000 7fb520ba4700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 0x7fb508067290 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fb518004e30 tx=0x7fb518009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:21.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.219+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb50c04f5b0 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.422+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb51c0fdf00 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.423+0000 7fb511ffb700 1 -- 172.21.15.96:0/2293785770 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb50c017720 con 0x7fb51c0f5bb0 2022-02-02T21:34:21.425 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:34:21.425 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:34:21.426 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:34:21.426 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:34:21.426 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:21.427 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:34:21.427 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:34:21.427 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:34:21.428 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:34:21.428 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:34:21.428 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:34:21.429 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:34:21.429 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:34:21.429 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:34:21.430 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:34:21.430 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:34:21.430 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:34:21.431 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:34:21.431 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:34:21.432 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:34:21.432 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:34:21.432 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:34:21.433 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:34:21.434 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:34:21.434 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:34:21.435 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:34:21.435 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:34:21.435 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:34:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:34:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:34:21.436 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:34:21.437 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:34:21.437 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:21.437 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:34:21.438 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:21.438 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:21.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:21.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 msgr2=0x7fb508067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 0x7fb508067290 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fb518004e30 tx=0x7fb518009b30).stop 2022-02-02T21:34:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 msgr2=0x7fb51c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 secure :-1 s=READY pgs=2960 cs=0 l=1 rev1=1 rx=0x7fb50c00c510 tx=0x7fb50c007df0).stop 2022-02-02T21:34:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 shutdown_connections 2022-02-02T21:34:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb508064dd0 0x7fb508067290 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb51c0f5bb0 0x7fb51c109d10 unknown :-1 s=CLOSED pgs=2960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 --2- 172.21.15.96:0/2293785770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb51c0f6550 0x7fb51c10c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:21.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 >> 172.21.15.96:0/2293785770 conn(0x7fb51c0f04c0 msgr2=0x7fb51c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:21.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 shutdown_connections 2022-02-02T21:34:21.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:21.425+0000 7fb523609700 1 -- 172.21.15.96:0/2293785770 wait complete. 2022-02-02T21:34:21.444 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:34:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:21 smithi096 ceph-mon[101353]: pgmap v5767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2207197821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:34:21.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:21 smithi159 ceph-mon[69013]: pgmap v5767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:21.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2207197821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:34:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:22 smithi096 ceph-mon[101353]: from='client.40018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:22.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:22 smithi096 ceph-mon[101353]: from='client.40022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:22.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2293785770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:34:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:22 smithi159 ceph-mon[69013]: from='client.40018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:22 smithi159 ceph-mon[69013]: from='client.40022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2293785770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:34:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:23 smithi096 ceph-mon[101353]: pgmap v5768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:23 smithi159 ceph-mon[69013]: pgmap v5768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:25 smithi096 ceph-mon[101353]: pgmap v5769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:25 smithi159 ceph-mon[69013]: pgmap v5769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:27 smithi096 ceph-mon[101353]: pgmap v5770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:27 smithi159 ceph-mon[69013]: pgmap v5770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:34:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:34:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:28 smithi159 ceph-mon[69013]: pgmap v5771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:34:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:34:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:28 smithi096 ceph-mon[101353]: pgmap v5771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:31 smithi096 ceph-mon[101353]: pgmap v5772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:31 smithi159 ceph-mon[69013]: pgmap v5772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:33 smithi096 ceph-mon[101353]: pgmap v5773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:33 smithi159 ceph-mon[69013]: pgmap v5773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:35 smithi096 ceph-mon[101353]: pgmap v5774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:35 smithi159 ceph-mon[69013]: pgmap v5774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:37.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:37 smithi096 ceph-mon[101353]: pgmap v5775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:37 smithi159 ceph-mon[69013]: pgmap v5775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:38 smithi159 ceph-mon[69013]: pgmap v5776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:38 smithi096 ceph-mon[101353]: pgmap v5776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:41 smithi096 ceph-mon[101353]: pgmap v5777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:41 smithi159 ceph-mon[69013]: pgmap v5777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:43 smithi096 ceph-mon[101353]: pgmap v5778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:43.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:43 smithi159 ceph-mon[69013]: pgmap v5778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:45 smithi096 ceph-mon[101353]: pgmap v5779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:45 smithi159 ceph-mon[69013]: pgmap v5779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:47 smithi096 ceph-mon[101353]: pgmap v5780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:47 smithi159 ceph-mon[69013]: pgmap v5780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:48 smithi159 ceph-mon[69013]: pgmap v5781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:48 smithi096 ceph-mon[101353]: pgmap v5781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:51.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 -- 172.21.15.96:0/1486082946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f7980 msgr2=0x7f89b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 --2- 172.21.15.96:0/1486082946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f7980 0x7f89b40f7de0 secure :-1 s=READY pgs=2961 cs=0 l=1 rev1=1 rx=0x7f89a0004660 tx=0x7f89a0009b30).stop 2022-02-02T21:34:51.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 -- 172.21.15.96:0/1486082946 shutdown_connections 2022-02-02T21:34:51.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 --2- 172.21.15.96:0/1486082946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f7980 0x7f89b40f7de0 unknown :-1 s=CLOSED pgs=2961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 --2- 172.21.15.96:0/1486082946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f66e0 0x7f89b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:34:51.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 -- 172.21.15.96:0/1486082946 >> 172.21.15.96:0/1486082946 conn(0x7f89b40f1e40 msgr2=0x7f89b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 -- 172.21.15.96:0/1486082946 shutdown_connections 2022-02-02T21:34:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.534+0000 7f89bb238700 1 -- 172.21.15.96:0/1486082946 wait complete. 2022-02-02T21:34:51.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.535+0000 7f89bb238700 1 Processor -- start 2022-02-02T21:34:51.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.535+0000 7f89bb238700 1 -- start start 2022-02-02T21:34:51.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.535+0000 7f89bb238700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.535+0000 7f89bb238700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f7980 0x7f89b41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89bb238700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4107ae0 con 0x7f89b40f66e0 2022-02-02T21:34:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89bb238700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4108390 con 0x7f89b40f7980 2022-02-02T21:34:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43582/0 (socket says 172.21.15.96:43582) 2022-02-02T21:34:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 -- 172.21.15.96:0/3623325108 learned_addr learned my addr 172.21.15.96:0/3623325108 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b3fff700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f7980 0x7f89b41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 -- 172.21.15.96:0/3623325108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f7980 msgr2=0x7f89b41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f7980 0x7f89b41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 -- 172.21.15.96:0/3623325108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0005040 con 0x7f89b40f66e0 2022-02-02T21:34:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b8fd4700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 secure :-1 s=READY pgs=2962 cs=0 l=1 rev1=1 rx=0x7f89a80093f0 tx=0x7f89a8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a8013640 con 0x7f89b40f66e0 2022-02-02T21:34:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b4108670 con 0x7f89b40f66e0 2022-02-02T21:34:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89a8013c50 con 0x7f89b40f66e0 2022-02-02T21:34:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a8012c70 con 0x7f89b40f66e0 2022-02-02T21:34:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.536+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b4108c30 con 0x7f89b40f66e0 2022-02-02T21:34:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.538+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b40f5ad0 con 0x7f89b40f66e0 2022-02-02T21:34:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.538+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f89a801a060 con 0x7f89b40f66e0 2022-02-02T21:34:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.538+0000 7f89b17fa700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 0x7f89a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.539+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f89a8081a50 con 0x7f89b40f66e0 2022-02-02T21:34:51.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.539+0000 7f89b3fff700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 0x7f89a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.539+0000 7f89b3fff700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 0x7f89a4067290 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f89a0004630 tx=0x7f89a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:51.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.543+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f89a8053520 con 0x7f89b40f66e0 2022-02-02T21:34:51.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:51 smithi096 ceph-mon[101353]: pgmap v5782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:51.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.722+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89b40fefb0 con 0x7f89a4064dd0 2022-02-02T21:34:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.723+0000 7f89b17fa700 1 -- 172.21.15.96:0/3623325108 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f89b40fefb0 con 0x7f89a4064dd0 2022-02-02T21:34:51.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 msgr2=0x7f89a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 0x7f89a4067290 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f89a0004630 tx=0x7f89a0009b30).stop 2022-02-02T21:34:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 msgr2=0x7f89b4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 secure :-1 s=READY pgs=2962 cs=0 l=1 rev1=1 rx=0x7f89a80093f0 tx=0x7f89a8006ec0).stop 2022-02-02T21:34:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 shutdown_connections 2022-02-02T21:34:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89a4064dd0 0x7f89a4067290 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89b40f66e0 0x7f89b4106fb0 unknown :-1 s=CLOSED pgs=2962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 --2- 172.21.15.96:0/3623325108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b40f7980 0x7f89b41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 >> 172.21.15.96:0/3623325108 conn(0x7f89b40f1e40 msgr2=0x7f89b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:51.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 shutdown_connections 2022-02-02T21:34:51.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.725+0000 7f89bb238700 1 -- 172.21.15.96:0/3623325108 wait complete. 2022-02-02T21:34:51.735 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:34:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:51 smithi159 ceph-mon[69013]: pgmap v5782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:51.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 -- 172.21.15.96:0/3738958677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f7980 msgr2=0x7fb9b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/3738958677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f7980 0x7fb9b00f7de0 secure :-1 s=READY pgs=2963 cs=0 l=1 rev1=1 rx=0x7fb9a4004660 tx=0x7fb9a4009b30).stop 2022-02-02T21:34:51.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 -- 172.21.15.96:0/3738958677 shutdown_connections 2022-02-02T21:34:51.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/3738958677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f7980 0x7fb9b00f7de0 unknown :-1 s=CLOSED pgs=2963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/3738958677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f66e0 0x7fb9b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 -- 172.21.15.96:0/3738958677 >> 172.21.15.96:0/3738958677 conn(0x7fb9b00f1e40 msgr2=0x7fb9b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:51.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 -- 172.21.15.96:0/3738958677 shutdown_connections 2022-02-02T21:34:51.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.822+0000 7fb9b5f74700 1 -- 172.21.15.96:0/3738958677 wait complete. 2022-02-02T21:34:51.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 Processor -- start 2022-02-02T21:34:51.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 -- start start 2022-02-02T21:34:51.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f7980 0x7fb9b0105230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0105830 con 0x7fb9b00f66e0 2022-02-02T21:34:51.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9b5f74700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0105970 con 0x7fb9b00f7980 2022-02-02T21:34:51.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43592/0 (socket says 172.21.15.96:43592) 2022-02-02T21:34:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9af7fe700 1 -- 172.21.15.96:0/1163257980 learned_addr learned my addr 172.21.15.96:0/1163257980 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.823+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f7980 0x7fb9b0105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9af7fe700 1 -- 172.21.15.96:0/1163257980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f7980 msgr2=0x7fb9b0105230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9af7fe700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f7980 0x7fb9b0105230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9af7fe700 1 -- 172.21.15.96:0/1163257980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b00f66e0 2022-02-02T21:34:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9af7fe700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 secure :-1 s=READY pgs=2964 cs=0 l=1 rev1=1 rx=0x7fb9a000c790 tx=0x7fb9a0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a0013630 con 0x7fb9b00f66e0 2022-02-02T21:34:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9a0012860 con 0x7fb9b00f66e0 2022-02-02T21:34:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b010b540 con 0x7fb9b00f66e0 2022-02-02T21:34:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a0002780 con 0x7fb9b00f66e0 2022-02-02T21:34:51.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.824+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b010bb00 con 0x7fb9b00f66e0 2022-02-02T21:34:51.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.825+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0045ad0 con 0x7fb9b00f66e0 2022-02-02T21:34:51.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.826+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9a0010070 con 0x7fb9b00f66e0 2022-02-02T21:34:51.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.826+0000 7fb997fff700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 0x7fb998067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:51.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.826+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9a0081bc0 con 0x7fb9b00f66e0 2022-02-02T21:34:51.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.826+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 0x7fb998067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.827+0000 7fb9aeffd700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 0x7fb998067290 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fb9a4004630 tx=0x7fb9a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:51.830+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9a004fc00 con 0x7fb9b00f66e0 2022-02-02T21:34:52.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.002+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b0106170 con 0x7fb998064dd0 2022-02-02T21:34:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.012+0000 7fb997fff700 1 -- 172.21.15.96:0/1163257980 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb9b0106170 con 0x7fb998064dd0 2022-02-02T21:34:52.014 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:34:52.014 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:34:52.015 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:34:52.015 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:34:52.015 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:34:52.016 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:34:52.016 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:34:52.017 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:34:52.017 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:34:52.017 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:34:52.018 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:34:52.018 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:34:52.019 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:34:52.019 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:34:52.019 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:34:52.020 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:34:52.020 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:34:52.020 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:34:52.021 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:34:52.021 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:34:52.021 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:34:52.022 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:34:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 msgr2=0x7fb998067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 0x7fb998067290 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fb9a4004630 tx=0x7fb9a4009b30).stop 2022-02-02T21:34:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 msgr2=0x7fb9b0104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 secure :-1 s=READY pgs=2964 cs=0 l=1 rev1=1 rx=0x7fb9a000c790 tx=0x7fb9a0007d90).stop 2022-02-02T21:34:52.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 shutdown_connections 2022-02-02T21:34:52.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb998064dd0 0x7fb998067290 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b00f66e0 0x7fb9b0104d40 unknown :-1 s=CLOSED pgs=2964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 --2- 172.21.15.96:0/1163257980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b00f7980 0x7fb9b0105230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.014+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 >> 172.21.15.96:0/1163257980 conn(0x7fb9b00f1e40 msgr2=0x7fb9b006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.015+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 shutdown_connections 2022-02-02T21:34:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.015+0000 7fb9b5f74700 1 -- 172.21.15.96:0/1163257980 wait complete. 2022-02-02T21:34:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 -- 172.21.15.96:0/1950673552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c0f9830 msgr2=0x7f780c0fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 --2- 172.21.15.96:0/1950673552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c0f9830 0x7f780c0fbc80 secure :-1 s=READY pgs=2965 cs=0 l=1 rev1=1 rx=0x7f7808004660 tx=0x7f7808009b30).stop 2022-02-02T21:34:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 -- 172.21.15.96:0/1950673552 shutdown_connections 2022-02-02T21:34:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 --2- 172.21.15.96:0/1950673552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c0f9830 0x7f780c0fbc80 unknown :-1 s=CLOSED pgs=2965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 --2- 172.21.15.96:0/1950673552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c060270 0x7f780c0f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 -- 172.21.15.96:0/1950673552 >> 172.21.15.96:0/1950673552 conn(0x7f780c0f0d40 msgr2=0x7f780c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 -- 172.21.15.96:0/1950673552 shutdown_connections 2022-02-02T21:34:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 -- 172.21.15.96:0/1950673552 wait complete. 2022-02-02T21:34:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.111+0000 7f781462c700 1 Processor -- start 2022-02-02T21:34:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 -- start start 2022-02-02T21:34:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c0f9830 0x7f780c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1079e0 con 0x7f780c060270 2022-02-02T21:34:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c107b20 con 0x7f780c0f9830 2022-02-02T21:34:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43602/0 (socket says 172.21.15.96:43602) 2022-02-02T21:34:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 -- 172.21.15.96:0/954838576 learned_addr learned my addr 172.21.15.96:0/954838576 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f7811bc7700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c0f9830 0x7f780c107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 -- 172.21.15.96:0/954838576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c0f9830 msgr2=0x7f780c107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c0f9830 0x7f780c107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 -- 172.21.15.96:0/954838576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808005040 con 0x7f780c060270 2022-02-02T21:34:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f78123c8700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 secure :-1 s=READY pgs=2966 cs=0 l=1 rev1=1 rx=0x7f77fc004ae0 tx=0x7f77fc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77fc00a590 con 0x7f780c060270 2022-02-02T21:34:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77fc00aba0 con 0x7f780c060270 2022-02-02T21:34:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c1084c0 con 0x7f780c060270 2022-02-02T21:34:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.112+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77fc00fb70 con 0x7f780c060270 2022-02-02T21:34:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.113+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c108a80 con 0x7f780c060270 2022-02-02T21:34:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.114+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c045ad0 con 0x7f780c060270 2022-02-02T21:34:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.114+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77fc021070 con 0x7f780c060270 2022-02-02T21:34:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.114+0000 7f7802ffd700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 0x7f77f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.114+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77fc085c40 con 0x7f780c060270 2022-02-02T21:34:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.114+0000 7f7811bc7700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 0x7f77f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.115+0000 7f7811bc7700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 0x7f77f8067290 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f7808004630 tx=0x7f7808009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.118+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77fc057770 con 0x7f780c060270 2022-02-02T21:34:52.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.350+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f780c027a00 con 0x7f780c060270 2022-02-02T21:34:52.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.350+0000 7f7802ffd700 1 -- 172.21.15.96:0/954838576 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f77fc01f020 con 0x7f780c060270 2022-02-02T21:34:52.353 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:34:52.354 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:34:52.354 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:34:52.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:52.355 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:34:52.355 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:34:52.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:52.356 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:34:52.357 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:34:52.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:52.357 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:34:52.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:34:52.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:34:52.359 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:34:52.359 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:34:52.359 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:34:52.360 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:34:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:34:52.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 msgr2=0x7f77f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 0x7f77f8067290 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f7808004630 tx=0x7f7808009b30).stop 2022-02-02T21:34:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 msgr2=0x7f780c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 secure :-1 s=READY pgs=2966 cs=0 l=1 rev1=1 rx=0x7f77fc004ae0 tx=0x7f77fc007d70).stop 2022-02-02T21:34:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 shutdown_connections 2022-02-02T21:34:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77f8064dd0 0x7f77f8067290 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780c060270 0x7f780c106f40 unknown :-1 s=CLOSED pgs=2966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 --2- 172.21.15.96:0/954838576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f780c0f9830 0x7f780c107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 >> 172.21.15.96:0/954838576 conn(0x7f780c0f0d40 msgr2=0x7f780c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:52.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 shutdown_connections 2022-02-02T21:34:52.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.353+0000 7f781462c700 1 -- 172.21.15.96:0/954838576 wait complete. 2022-02-02T21:34:52.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 -- 172.21.15.96:0/2313140205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f66e0 msgr2=0x7ff8d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/2313140205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f66e0 0x7ff8d00f6b00 secure :-1 s=READY pgs=2967 cs=0 l=1 rev1=1 rx=0x7ff8c4004660 tx=0x7ff8c4009b30).stop 2022-02-02T21:34:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 -- 172.21.15.96:0/2313140205 shutdown_connections 2022-02-02T21:34:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/2313140205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f7980 0x7ff8d00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/2313140205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f66e0 0x7ff8d00f6b00 unknown :-1 s=CLOSED pgs=2967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 -- 172.21.15.96:0/2313140205 >> 172.21.15.96:0/2313140205 conn(0x7ff8d00f1e40 msgr2=0x7ff8d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 -- 172.21.15.96:0/2313140205 shutdown_connections 2022-02-02T21:34:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.450+0000 7ff8d51f4700 1 -- 172.21.15.96:0/2313140205 wait complete. 2022-02-02T21:34:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 Processor -- start 2022-02-02T21:34:52.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 -- start start 2022-02-02T21:34:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f66e0 0x7ff8d0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0107a50 con 0x7ff8d00f7980 2022-02-02T21:34:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8d51f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0107b90 con 0x7ff8d00f66e0 2022-02-02T21:34:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43614/0 (socket says 172.21.15.96:43614) 2022-02-02T21:34:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 -- 172.21.15.96:0/3467099999 learned_addr learned my addr 172.21.15.96:0/3467099999 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:34:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ced9d700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f66e0 0x7ff8d0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 -- 172.21.15.96:0/3467099999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f66e0 msgr2=0x7ff8d0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f66e0 0x7ff8d0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 -- 172.21.15.96:0/3467099999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4005040 con 0x7ff8d00f7980 2022-02-02T21:34:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.451+0000 7ff8ce59c700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 rx=0x7ff8c00026d0 tx=0x7ff8c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.452+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c00079c0 con 0x7ff8d00f7980 2022-02-02T21:34:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.452+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8c000f040 con 0x7ff8d00f7980 2022-02-02T21:34:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.452+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0108530 con 0x7ff8d00f7980 2022-02-02T21:34:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.452+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c00148b0 con 0x7ff8d00f7980 2022-02-02T21:34:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.452+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0108af0 con 0x7ff8d00f7980 2022-02-02T21:34:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.453+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d0045ad0 con 0x7ff8d00f7980 2022-02-02T21:34:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.453+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff8c0007b20 con 0x7ff8d00f7980 2022-02-02T21:34:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.453+0000 7ff8b77fe700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 0x7ff8b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:34:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.453+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff8c0081900 con 0x7ff8d00f7980 2022-02-02T21:34:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.453+0000 7ff8ced9d700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 0x7ff8b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:34:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.454+0000 7ff8ced9d700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 0x7ff8b8067290 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7ff8c4004630 tx=0x7ff8c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:34:52.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.458+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff8c0053430 con 0x7ff8d00f7980 2022-02-02T21:34:52.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.660+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8d0027a00 con 0x7ff8d00f7980 2022-02-02T21:34:52.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.660+0000 7ff8b77fe700 1 -- 172.21.15.96:0/3467099999 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff8c0053020 con 0x7ff8d00f7980 2022-02-02T21:34:52.662 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:34:52.663 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:34:52.663 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:34:52.663 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:34:52.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:52.664 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:34:52.664 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:34:52.665 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:34:52.665 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:34:52.665 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:34:52.666 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:34:52.666 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:34:52.666 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:34:52.667 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:34:52.667 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:34:52.668 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:34:52.668 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:34:52.668 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:34:52.669 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:34:52.669 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:34:52.669 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:34:52.670 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:34:52.670 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:34:52.670 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:34:52.671 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:34:52.671 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:34:52.671 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:34:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:34:52.672 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:34:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:34:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:34:52.673 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:34:52.674 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:52.674 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:52.674 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:34:52.675 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:34:52.675 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:34:52.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 msgr2=0x7ff8b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 0x7ff8b8067290 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7ff8c4004630 tx=0x7ff8c4009b30).stop 2022-02-02T21:34:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 msgr2=0x7ff8d01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:34:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 rx=0x7ff8c00026d0 tx=0x7ff8c0009de0).stop 2022-02-02T21:34:52.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 shutdown_connections 2022-02-02T21:34:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8b8064dd0 0x7ff8b8067290 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8d00f66e0 0x7ff8d0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 --2- 172.21.15.96:0/3467099999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8d00f7980 0x7ff8d01074a0 unknown :-1 s=CLOSED pgs=2968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:34:52.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 >> 172.21.15.96:0/3467099999 conn(0x7ff8d00f1e40 msgr2=0x7ff8d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:34:52.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 shutdown_connections 2022-02-02T21:34:52.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:34:52.663+0000 7ff8d51f4700 1 -- 172.21.15.96:0/3467099999 wait complete. 2022-02-02T21:34:52.681 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:34:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:53 smithi096 ceph-mon[101353]: from='client.40034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:53 smithi096 ceph-mon[101353]: from='client.40038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:53 smithi096 ceph-mon[101353]: pgmap v5783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:53.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/954838576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:34:53.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3467099999' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:34:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:53 smithi159 ceph-mon[69013]: from='client.40034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:53 smithi159 ceph-mon[69013]: from='client.40038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:34:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:53 smithi159 ceph-mon[69013]: pgmap v5783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/954838576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:34:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3467099999' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:34:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:55 smithi096 ceph-mon[101353]: pgmap v5784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:55 smithi159 ceph-mon[69013]: pgmap v5784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:57.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:57 smithi159 ceph-mon[69013]: pgmap v5785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:57.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:57 smithi096 ceph-mon[101353]: pgmap v5785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:34:58 smithi159 ceph-mon[69013]: pgmap v5786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:34:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:34:58 smithi096 ceph-mon[101353]: pgmap v5786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:01 smithi096 ceph-mon[101353]: pgmap v5787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:01 smithi159 ceph-mon[69013]: pgmap v5787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:03 smithi096 ceph-mon[101353]: pgmap v5788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:03 smithi159 ceph-mon[69013]: pgmap v5788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:05 smithi159 ceph-mon[69013]: pgmap v5789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:05 smithi096 ceph-mon[101353]: pgmap v5789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:07 smithi159 ceph-mon[69013]: pgmap v5790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:07 smithi096 ceph-mon[101353]: pgmap v5790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:08 smithi159 ceph-mon[69013]: pgmap v5791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:08 smithi096 ceph-mon[101353]: pgmap v5791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:11 smithi096 ceph-mon[101353]: pgmap v5792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:11.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:11 smithi159 ceph-mon[69013]: pgmap v5792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:13 smithi096 ceph-mon[101353]: pgmap v5793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:13 smithi159 ceph-mon[69013]: pgmap v5793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:15 smithi159 ceph-mon[69013]: pgmap v5794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:15 smithi096 ceph-mon[101353]: pgmap v5794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:17 smithi159 ceph-mon[69013]: pgmap v5795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:17.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:17 smithi096 ceph-mon[101353]: pgmap v5795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:18 smithi159 ceph-mon[69013]: pgmap v5796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:18 smithi096 ceph-mon[101353]: pgmap v5796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:21.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:21 smithi159 ceph-mon[69013]: pgmap v5797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:21.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:21 smithi096 ceph-mon[101353]: pgmap v5797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2356707440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 msgr2=0x7f5cb00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:22.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2356707440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f7ac0 secure :-1 s=READY pgs=2969 cs=0 l=1 rev1=1 rx=0x7f5cac004660 tx=0x7f5cac009b30).stop 2022-02-02T21:35:22.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2356707440 shutdown_connections 2022-02-02T21:35:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2356707440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f7ac0 unknown :-1 s=CLOSED pgs=2969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2356707440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:35:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2356707440 >> 172.21.15.96:0/2356707440 conn(0x7f5cb00f04c0 msgr2=0x7f5cb00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2356707440 shutdown_connections 2022-02-02T21:35:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.774+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2356707440 wait complete. 2022-02-02T21:35:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 Processor -- start 2022-02-02T21:35:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 -- start start 2022-02-02T21:35:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00f5fc0 con 0x7f5cb00f5340 2022-02-02T21:35:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb76b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00f6100 con 0x7f5cb00f49a0 2022-02-02T21:35:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:22.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43632/0 (socket says 172.21.15.96:43632) 2022-02-02T21:35:22.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 -- 172.21.15.96:0/2692549298 learned_addr learned my addr 172.21.15.96:0/2692549298 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:22.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 -- 172.21.15.96:0/2692549298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 msgr2=0x7f5cb00f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:22.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb5452700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:22.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:22.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.775+0000 7f5cb4c51700 1 -- 172.21.15.96:0/2692549298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac005040 con 0x7f5cb00f5340 2022-02-02T21:35:22.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5cb5452700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:35:22.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5cb4c51700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 secure :-1 s=READY pgs=2970 cs=0 l=1 rev1=1 rx=0x7f5cac004f60 tx=0x7f5cac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:22.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cac018070 con 0x7f5cb00f5340 2022-02-02T21:35:22.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb00f6380 con 0x7f5cb00f5340 2022-02-02T21:35:22.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cac007ba0 con 0x7f5cb00f5340 2022-02-02T21:35:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cac01c620 con 0x7f5cb00f5340 2022-02-02T21:35:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.776+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb010f000 con 0x7f5cb00f5340 2022-02-02T21:35:22.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.777+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb0045ad0 con 0x7f5cb00f5340 2022-02-02T21:35:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.777+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cac01c8e0 con 0x7f5cb00f5340 2022-02-02T21:35:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.778+0000 7f5ca5ffb700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 0x7f5c9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.778+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5cac083940 con 0x7f5cb00f5340 2022-02-02T21:35:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.778+0000 7f5cb5452700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 0x7f5c9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.778+0000 7f5cb5452700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 0x7f5c9c067290 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f5cb00f72e0 tx=0x7f5ca0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.782+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cac051a40 con 0x7f5cb00f5340 2022-02-02T21:35:22.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.962+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb00ff070 con 0x7f5c9c064dd0 2022-02-02T21:35:22.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.963+0000 7f5ca5ffb700 1 -- 172.21.15.96:0/2692549298 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5cb00ff070 con 0x7f5c9c064dd0 2022-02-02T21:35:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 msgr2=0x7f5c9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 0x7f5c9c067290 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f5cb00f72e0 tx=0x7f5ca0008040).stop 2022-02-02T21:35:22.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 msgr2=0x7f5cb00f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 secure :-1 s=READY pgs=2970 cs=0 l=1 rev1=1 rx=0x7f5cac004f60 tx=0x7f5cac009b30).stop 2022-02-02T21:35:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 shutdown_connections 2022-02-02T21:35:22.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c9c064dd0 0x7f5c9c067290 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb00f49a0 0x7f5cb00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:22.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 --2- 172.21.15.96:0/2692549298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cb00f5340 0x7f5cb00f59d0 unknown :-1 s=CLOSED pgs=2970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 >> 172.21.15.96:0/2692549298 conn(0x7f5cb00f04c0 msgr2=0x7f5cb00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 shutdown_connections 2022-02-02T21:35:22.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:22.965+0000 7f5cb76b6700 1 -- 172.21.15.96:0/2692549298 wait complete. 2022-02-02T21:35:22.974 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:35:23.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 -- 172.21.15.96:0/2586747237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 msgr2=0x7f45580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 --2- 172.21.15.96:0/2586747237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f45580f59e0 secure :-1 s=READY pgs=2971 cs=0 l=1 rev1=1 rx=0x7f454c004660 tx=0x7f454c009b30).stop 2022-02-02T21:35:23.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 -- 172.21.15.96:0/2586747237 shutdown_connections 2022-02-02T21:35:23.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 --2- 172.21.15.96:0/2586747237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f45580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 --2- 172.21.15.96:0/2586747237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f45580f59e0 unknown :-1 s=CLOSED pgs=2971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 -- 172.21.15.96:0/2586747237 >> 172.21.15.96:0/2586747237 conn(0x7f45580f0d40 msgr2=0x7f45580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 -- 172.21.15.96:0/2586747237 shutdown_connections 2022-02-02T21:35:23.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.063+0000 7f455d3b5700 1 -- 172.21.15.96:0/2586747237 wait complete. 2022-02-02T21:35:23.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 Processor -- start 2022-02-02T21:35:23.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 -- start start 2022-02-02T21:35:23.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f455810e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580602b0 con 0x7f45580f55c0 2022-02-02T21:35:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f455d3b5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580603f0 con 0x7f45580f6860 2022-02-02T21:35:23.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43638/0 (socket says 172.21.15.96:43638) 2022-02-02T21:35:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 -- 172.21.15.96:0/4068286996 learned_addr learned my addr 172.21.15.96:0/4068286996 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:23.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f45567fc700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f455810e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 -- 172.21.15.96:0/4068286996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 msgr2=0x7f455810e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f455810e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f4556ffd700 1 -- 172.21.15.96:0/4068286996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c005040 con 0x7f45580f55c0 2022-02-02T21:35:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.064+0000 7f45567fc700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f455810e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:35:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f4556ffd700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 secure :-1 s=READY pgs=2972 cs=0 l=1 rev1=1 rx=0x7f454c004f60 tx=0x7f454c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c018070 con 0x7f45580f55c0 2022-02-02T21:35:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455810eab0 con 0x7f45580f55c0 2022-02-02T21:35:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455810ee80 con 0x7f45580f55c0 2022-02-02T21:35:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f454c007ba0 con 0x7f45580f55c0 2022-02-02T21:35:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.065+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c01c620 con 0x7f45580f55c0 2022-02-02T21:35:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.066+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4538004fa0 con 0x7f45580f55c0 2022-02-02T21:35:23.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.066+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f454c01d420 con 0x7f45580f55c0 2022-02-02T21:35:23.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.067+0000 7f453f7fe700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 0x7f4540067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.067+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f454c083c60 con 0x7f45580f55c0 2022-02-02T21:35:23.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.067+0000 7f45567fc700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 0x7f4540067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.067+0000 7f45567fc700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 0x7f4540067290 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f45480041d0 tx=0x7f4548009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.070+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f454c051ea0 con 0x7f45580f55c0 2022-02-02T21:35:23.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.242+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4538000bc0 con 0x7f4540064dd0 2022-02-02T21:35:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.252+0000 7f453f7fe700 1 -- 172.21.15.96:0/4068286996 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4538000bc0 con 0x7f4540064dd0 2022-02-02T21:35:23.252 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:35:23.253 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:35:23.253 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:35:23.253 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:35:23.254 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:35:23.254 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:35:23.254 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:35:23.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:35:23.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:35:23.255 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:35:23.256 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:35:23.256 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:35:23.256 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:35:23.257 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:35:23.257 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:35:23.257 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:35:23.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:35:23.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:35:23.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:35:23.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:35:23.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:35:23.259 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:35:23.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 msgr2=0x7f4540067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 0x7f4540067290 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f45480041d0 tx=0x7f4548009040).stop 2022-02-02T21:35:23.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 msgr2=0x7f455810c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 secure :-1 s=READY pgs=2972 cs=0 l=1 rev1=1 rx=0x7f454c004f60 tx=0x7f454c009b30).stop 2022-02-02T21:35:23.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 shutdown_connections 2022-02-02T21:35:23.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4540064dd0 0x7f4540067290 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45580f55c0 0x7f455810c0c0 unknown :-1 s=CLOSED pgs=2972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 --2- 172.21.15.96:0/4068286996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45580f6860 0x7f455810e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.253+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 >> 172.21.15.96:0/4068286996 conn(0x7f45580f0d40 msgr2=0x7f45580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.254+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 shutdown_connections 2022-02-02T21:35:23.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.254+0000 7f455d3b5700 1 -- 172.21.15.96:0/4068286996 wait complete. 2022-02-02T21:35:23.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 -- 172.21.15.96:0/3884688726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 msgr2=0x7f7dc40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/3884688726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc40f6b00 secure :-1 s=READY pgs=2973 cs=0 l=1 rev1=1 rx=0x7f7dc0004660 tx=0x7f7dc0009b30).stop 2022-02-02T21:35:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 -- 172.21.15.96:0/3884688726 shutdown_connections 2022-02-02T21:35:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/3884688726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/3884688726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc40f6b00 unknown :-1 s=CLOSED pgs=2973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 -- 172.21.15.96:0/3884688726 >> 172.21.15.96:0/3884688726 conn(0x7f7dc40f1e40 msgr2=0x7f7dc40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.355 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:23 smithi096 ceph-mon[101353]: pgmap v5798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:23.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 -- 172.21.15.96:0/3884688726 shutdown_connections 2022-02-02T21:35:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.352+0000 7f7dcbab0700 1 -- 172.21.15.96:0/3884688726 wait complete. 2022-02-02T21:35:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 Processor -- start 2022-02-02T21:35:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 -- start start 2022-02-02T21:35:23.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4107a10 con 0x7f7dc40f7980 2022-02-02T21:35:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.353+0000 7f7dcbab0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4107b50 con 0x7f7dc40f66e0 2022-02-02T21:35:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43650/0 (socket says 172.21.15.96:43650) 2022-02-02T21:35:23.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 -- 172.21.15.96:0/2892570273 learned_addr learned my addr 172.21.15.96:0/2892570273 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:23.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc984c700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 -- 172.21.15.96:0/2892570273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f66e0 msgr2=0x7f7dc4106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 -- 172.21.15.96:0/2892570273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0005040 con 0x7f7dc40f7980 2022-02-02T21:35:23.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dc904b700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 rx=0x7f7db400c530 tx=0x7f7db4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db400f650 con 0x7f7dc40f7980 2022-02-02T21:35:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc41084f0 con 0x7f7dc40f7980 2022-02-02T21:35:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7db400fc60 con 0x7f7dc40f7980 2022-02-02T21:35:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db4012cd0 con 0x7f7dc40f7980 2022-02-02T21:35:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.354+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4108ab0 con 0x7f7dc40f7980 2022-02-02T21:35:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.355+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4045ad0 con 0x7f7dc40f7980 2022-02-02T21:35:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.356+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7db4010070 con 0x7f7dc40f7980 2022-02-02T21:35:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.356+0000 7f7dba7fc700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 0x7f7db0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.356+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7db40817b0 con 0x7f7dc40f7980 2022-02-02T21:35:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.356+0000 7f7dc984c700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 0x7f7db0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.357+0000 7f7dc984c700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 0x7f7db0067290 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f7dc0004e30 tx=0x7f7dc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.360+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7db40532e0 con 0x7f7dc40f7980 2022-02-02T21:35:23.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.593+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7dc4027a00 con 0x7f7dc40f7980 2022-02-02T21:35:23.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.593+0000 7f7dba7fc700 1 -- 172.21.15.96:0/2892570273 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7db4052ed0 con 0x7f7dc40f7980 2022-02-02T21:35:23.594 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:35:23.595 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:35:23.595 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:35:23.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:23.596 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:35:23.596 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:35:23.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:23.597 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:35:23.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:35:23.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:23.598 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:35:23.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:35:23.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:23.599 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:35:23.599 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:35:23.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:35:23.600 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:35:23.600 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:35:23.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 msgr2=0x7f7db0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 0x7f7db0067290 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f7dc0004e30 tx=0x7f7dc0009b30).stop 2022-02-02T21:35:23.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 msgr2=0x7f7dc4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 rx=0x7f7db400c530 tx=0x7f7db4007e20).stop 2022-02-02T21:35:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 shutdown_connections 2022-02-02T21:35:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7db0064dd0 0x7f7db0067290 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 --2- 172.21.15.96:0/2892570273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f7980 0x7f7dc4107460 unknown :-1 s=CLOSED pgs=2974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 >> 172.21.15.96:0/2892570273 conn(0x7f7dc40f1e40 msgr2=0x7f7dc40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 shutdown_connections 2022-02-02T21:35:23.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.595+0000 7f7dcbab0700 1 -- 172.21.15.96:0/2892570273 wait complete. 2022-02-02T21:35:23.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2970430354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 msgr2=0x7f1b1c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2970430354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c0f6b00 secure :-1 s=READY pgs=2975 cs=0 l=1 rev1=1 rx=0x7f1b10004660 tx=0x7f1b10009b30).stop 2022-02-02T21:35:23.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2970430354 shutdown_connections 2022-02-02T21:35:23.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2970430354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 0x7f1b1c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2970430354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c0f6b00 unknown :-1 s=CLOSED pgs=2975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2970430354 >> 172.21.15.96:0/2970430354 conn(0x7f1b1c0f1e40 msgr2=0x7f1b1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2970430354 shutdown_connections 2022-02-02T21:35:23.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.693+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2970430354 wait complete. 2022-02-02T21:35:23.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 Processor -- start 2022-02-02T21:35:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 -- start start 2022-02-02T21:35:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 0x7f1b1c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c107a50 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b22ec4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c107b90 con 0x7f1b1c0f7980 2022-02-02T21:35:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b20c60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b20c60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43656/0 (socket says 172.21.15.96:43656) 2022-02-02T21:35:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.694+0000 7f1b20c60700 1 -- 172.21.15.96:0/2487740997 learned_addr learned my addr 172.21.15.96:0/2487740997 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b1bfff700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 0x7f1b1c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b20c60700 1 -- 172.21.15.96:0/2487740997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 msgr2=0x7f1b1c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b20c60700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 0x7f1b1c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b20c60700 1 -- 172.21.15.96:0/2487740997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10005040 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b20c60700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 secure :-1 s=READY pgs=2976 cs=0 l=1 rev1=1 rx=0x7f1b10013a70 tx=0x7f1b10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b10018070 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c1084d0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b100097d0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b1001c3c0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.695+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c108a30 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.697+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c045ad0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.697+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b10007ba0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.698+0000 7f1b197fa700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 0x7f1b0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:23.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.698+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b10083210 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.698+0000 7f1b1bfff700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 0x7f1b0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:23.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.698+0000 7f1b1bfff700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 0x7f1b0c067290 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f1b080096c0 tx=0x7f1b08009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:23.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.702+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b10054e00 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:23 smithi159 ceph-mon[69013]: pgmap v5798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:23.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.902+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b1c0fef70 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.903+0000 7f1b197fa700 1 -- 172.21.15.96:0/2487740997 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1b100549f0 con 0x7f1b1c0f66e0 2022-02-02T21:35:23.904 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:35:23.904 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:35:23.904 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:35:23.905 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:35:23.905 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:23.905 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:35:23.906 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:35:23.906 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:35:23.906 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:35:23.907 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:35:23.907 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:35:23.907 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:35:23.908 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:35:23.908 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:35:23.908 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:35:23.909 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:35:23.909 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:35:23.910 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:35:23.910 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:35:23.910 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:35:23.911 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:35:23.911 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:35:23.911 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:35:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:35:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:35:23.912 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:35:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:35:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:35:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:35:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:35:23.914 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:35:23.915 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:35:23.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:23.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:23.916 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:35:23.916 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:23.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:23.917 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:23.917 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 msgr2=0x7f1b0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 0x7f1b0c067290 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f1b080096c0 tx=0x7f1b08009be0).stop 2022-02-02T21:35:23.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 msgr2=0x7f1b1c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:23.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 secure :-1 s=READY pgs=2976 cs=0 l=1 rev1=1 rx=0x7f1b10013a70 tx=0x7f1b10009b30).stop 2022-02-02T21:35:23.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 shutdown_connections 2022-02-02T21:35:23.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b0c064dd0 0x7f1b0c067290 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b1c0f66e0 0x7f1b1c106fb0 unknown :-1 s=CLOSED pgs=2976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 --2- 172.21.15.96:0/2487740997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b1c0f7980 0x7f1b1c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 >> 172.21.15.96:0/2487740997 conn(0x7f1b1c0f1e40 msgr2=0x7f1b1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 shutdown_connections 2022-02-02T21:35:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:23.906+0000 7f1b22ec4700 1 -- 172.21.15.96:0/2487740997 wait complete. 2022-02-02T21:35:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:35:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:24 smithi159 ceph-mon[69013]: from='client.40050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:24 smithi159 ceph-mon[69013]: from='client.40054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2892570273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:35:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2487740997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:35:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:24 smithi096 ceph-mon[101353]: from='client.40050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:24.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:24 smithi096 ceph-mon[101353]: from='client.40054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:24.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2892570273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:35:24.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2487740997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:35:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:25 smithi159 ceph-mon[69013]: pgmap v5799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:25 smithi096 ceph-mon[101353]: pgmap v5799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:27 smithi159 ceph-mon[69013]: pgmap v5800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:27 smithi096 ceph-mon[101353]: pgmap v5800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:35:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:35:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:28 smithi159 ceph-mon[69013]: pgmap v5801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:35:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:35:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:28 smithi096 ceph-mon[101353]: pgmap v5801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:31 smithi159 ceph-mon[69013]: pgmap v5802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:31.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:31 smithi096 ceph-mon[101353]: pgmap v5802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:33 smithi096 ceph-mon[101353]: pgmap v5803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:33 smithi159 ceph-mon[69013]: pgmap v5803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:35 smithi159 ceph-mon[69013]: pgmap v5804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:35.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:35 smithi096 ceph-mon[101353]: pgmap v5804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:37 smithi159 ceph-mon[69013]: pgmap v5805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:37 smithi096 ceph-mon[101353]: pgmap v5805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:38 smithi159 ceph-mon[69013]: pgmap v5806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:38 smithi096 ceph-mon[101353]: pgmap v5806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:41 smithi159 ceph-mon[69013]: pgmap v5807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:41 smithi096 ceph-mon[101353]: pgmap v5807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:42.145 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-02-02T21:35:42.158 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-02-02T21:35:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:43 smithi096 ceph-mon[101353]: pgmap v5808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:43.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:43 smithi159 ceph-mon[69013]: pgmap v5808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:45 smithi159 ceph-mon[69013]: pgmap v5809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:45 smithi096 ceph-mon[101353]: pgmap v5809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:47 smithi159 ceph-mon[69013]: pgmap v5810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:47 smithi096 ceph-mon[101353]: pgmap v5810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:48 smithi159 ceph-mon[69013]: pgmap v5811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:48 smithi096 ceph-mon[101353]: pgmap v5811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:51 smithi159 ceph-mon[69013]: pgmap v5812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:51.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:51 smithi096 ceph-mon[101353]: pgmap v5812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:53 smithi096 ceph-mon[101353]: pgmap v5813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:53 smithi159 ceph-mon[69013]: pgmap v5813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:54.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 -- 172.21.15.96:0/331936154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f7980 msgr2=0x7fde840f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 --2- 172.21.15.96:0/331936154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f7980 0x7fde840f7de0 secure :-1 s=READY pgs=2977 cs=0 l=1 rev1=1 rx=0x7fde74004660 tx=0x7fde74009b30).stop 2022-02-02T21:35:54.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 -- 172.21.15.96:0/331936154 shutdown_connections 2022-02-02T21:35:54.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 --2- 172.21.15.96:0/331936154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f7980 0x7fde840f7de0 unknown :-1 s=CLOSED pgs=2977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 --2- 172.21.15.96:0/331936154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f66e0 0x7fde840f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:35:54.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 -- 172.21.15.96:0/331936154 >> 172.21.15.96:0/331936154 conn(0x7fde840f1e40 msgr2=0x7fde840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 -- 172.21.15.96:0/331936154 shutdown_connections 2022-02-02T21:35:54.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.016+0000 7fde88f6f700 1 -- 172.21.15.96:0/331936154 wait complete. 2022-02-02T21:35:54.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 Processor -- start 2022-02-02T21:35:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 -- start start 2022-02-02T21:35:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 0x7fde841074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84107ae0 con 0x7fde840f66e0 2022-02-02T21:35:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde88f6f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84108390 con 0x7fde840f7980 2022-02-02T21:35:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde8259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde8259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43674/0 (socket says 172.21.15.96:43674) 2022-02-02T21:35:54.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.017+0000 7fde8259c700 1 -- 172.21.15.96:0/655109302 learned_addr learned my addr 172.21.15.96:0/655109302 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:54.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde81d9b700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 0x7fde841074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde8259c700 1 -- 172.21.15.96:0/655109302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 msgr2=0x7fde841074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde8259c700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 0x7fde841074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde8259c700 1 -- 172.21.15.96:0/655109302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74005040 con 0x7fde840f66e0 2022-02-02T21:35:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde81d9b700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 0x7fde841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:35:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde8259c700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 rx=0x7fde780093f0 tx=0x7fde78006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde78009ea0 con 0x7fde840f66e0 2022-02-02T21:35:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde84108670 con 0x7fde840f66e0 2022-02-02T21:35:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde78013af0 con 0x7fde840f66e0 2022-02-02T21:35:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7800db10 con 0x7fde840f66e0 2022-02-02T21:35:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.018+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde84108c30 con 0x7fde840f66e0 2022-02-02T21:35:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.019+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde840f5ad0 con 0x7fde840f66e0 2022-02-02T21:35:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.020+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde7801a060 con 0x7fde840f66e0 2022-02-02T21:35:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.020+0000 7fde72ffd700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 0x7fde6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.020+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde78081aa0 con 0x7fde840f66e0 2022-02-02T21:35:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.020+0000 7fde81d9b700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 0x7fde6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.020+0000 7fde81d9b700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 0x7fde6c067290 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fde74009da0 tx=0x7fde74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.024+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde780535d0 con 0x7fde840f66e0 2022-02-02T21:35:54.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.202+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde840ff030 con 0x7fde6c064dd0 2022-02-02T21:35:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.203+0000 7fde72ffd700 1 -- 172.21.15.96:0/655109302 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fde840ff030 con 0x7fde6c064dd0 2022-02-02T21:35:54.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 msgr2=0x7fde6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 0x7fde6c067290 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fde74009da0 tx=0x7fde74009b30).stop 2022-02-02T21:35:54.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 msgr2=0x7fde84106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 rx=0x7fde780093f0 tx=0x7fde78006ec0).stop 2022-02-02T21:35:54.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 shutdown_connections 2022-02-02T21:35:54.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde6c064dd0 0x7fde6c067290 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde840f66e0 0x7fde84106fb0 unknown :-1 s=CLOSED pgs=2978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 --2- 172.21.15.96:0/655109302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde840f7980 0x7fde841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 >> 172.21.15.96:0/655109302 conn(0x7fde840f1e40 msgr2=0x7fde840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 shutdown_connections 2022-02-02T21:35:54.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.205+0000 7fde88f6f700 1 -- 172.21.15.96:0/655109302 wait complete. 2022-02-02T21:35:54.215 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:35:54.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 -- 172.21.15.96:0/880237797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 msgr2=0x7fdc500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/880237797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc500f6cc0 secure :-1 s=READY pgs=2979 cs=0 l=1 rev1=1 rx=0x7fdc3c004660 tx=0x7fdc3c009b30).stop 2022-02-02T21:35:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 -- 172.21.15.96:0/880237797 shutdown_connections 2022-02-02T21:35:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/880237797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc500f6cc0 unknown :-1 s=CLOSED pgs=2979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/880237797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 -- 172.21.15.96:0/880237797 >> 172.21.15.96:0/880237797 conn(0x7fdc500f0d40 msgr2=0x7fdc500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 -- 172.21.15.96:0/880237797 shutdown_connections 2022-02-02T21:35:54.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.303+0000 7fdc56bb1700 1 -- 172.21.15.96:0/880237797 wait complete. 2022-02-02T21:35:54.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 Processor -- start 2022-02-02T21:35:54.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 -- start start 2022-02-02T21:35:54.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc50109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500603e0 con 0x7fdc500f6860 2022-02-02T21:35:54.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc56bb1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50060520 con 0x7fdc500f55c0 2022-02-02T21:35:54.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43686/0 (socket says 172.21.15.96:43686) 2022-02-02T21:35:54.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 -- 172.21.15.96:0/832283208 learned_addr learned my addr 172.21.15.96:0/832283208 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:54.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc5494d700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc50109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 -- 172.21.15.96:0/832283208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 msgr2=0x7fdc50109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc50109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc4ffff700 1 -- 172.21.15.96:0/832283208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c005040 con 0x7fdc500f6860 2022-02-02T21:35:54.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.304+0000 7fdc5494d700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc50109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:35:54.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc4ffff700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 secure :-1 s=READY pgs=2980 cs=0 l=1 rev1=1 rx=0x7fdc3c009990 tx=0x7fdc3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc3c018070 con 0x7fdc500f6860 2022-02-02T21:35:54.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5010c6a0 con 0x7fdc500f6860 2022-02-02T21:35:54.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc3c007ca0 con 0x7fdc500f6860 2022-02-02T21:35:54.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc3c01c620 con 0x7fdc500f6860 2022-02-02T21:35:54.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.305+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5010cc00 con 0x7fdc500f6860 2022-02-02T21:35:54.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.306+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc50045ad0 con 0x7fdc500f6860 2022-02-02T21:35:54.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.306+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc3c01d960 con 0x7fdc500f6860 2022-02-02T21:35:54.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.306+0000 7fdc4d7fa700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 0x7fdc40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.307+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc3c0837d0 con 0x7fdc500f6860 2022-02-02T21:35:54.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.307+0000 7fdc5494d700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 0x7fdc40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.307+0000 7fdc5494d700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 0x7fdc40067290 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fdc50060060 tx=0x7fdc44009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.311+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc3c051a40 con 0x7fdc500f6860 2022-02-02T21:35:54.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.484+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc500fde90 con 0x7fdc40064dd0 2022-02-02T21:35:54.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.494+0000 7fdc4d7fa700 1 -- 172.21.15.96:0/832283208 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdc500fde90 con 0x7fdc40064dd0 2022-02-02T21:35:54.495 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:35:54.495 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:35:54.495 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:35:54.496 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:35:54.496 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:35:54.496 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:35:54.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:35:54.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:35:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:35:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:35:54.498 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:35:54.499 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:35:54.499 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:35:54.499 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:35:54.500 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:35:54.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:35:54.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:35:54.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:35:54.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:35:54.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:35:54.502 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:35:54.502 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:35:54.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 msgr2=0x7fdc40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 0x7fdc40067290 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fdc50060060 tx=0x7fdc44009040).stop 2022-02-02T21:35:54.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 msgr2=0x7fdc5010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 secure :-1 s=READY pgs=2980 cs=0 l=1 rev1=1 rx=0x7fdc3c009990 tx=0x7fdc3c009b30).stop 2022-02-02T21:35:54.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 shutdown_connections 2022-02-02T21:35:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc40064dd0 0x7fdc40067290 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc500f55c0 0x7fdc50109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 --2- 172.21.15.96:0/832283208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc500f6860 0x7fdc5010c150 unknown :-1 s=CLOSED pgs=2980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 >> 172.21.15.96:0/832283208 conn(0x7fdc500f0d40 msgr2=0x7fdc500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 shutdown_connections 2022-02-02T21:35:54.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.496+0000 7fdc56bb1700 1 -- 172.21.15.96:0/832283208 wait complete. 2022-02-02T21:35:54.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 -- 172.21.15.96:0/1989194280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f6860 msgr2=0x7f4e9c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 --2- 172.21.15.96:0/1989194280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c0f6cc0 secure :-1 s=READY pgs=2981 cs=0 l=1 rev1=1 rx=0x7f4e8c004660 tx=0x7f4e8c009b30).stop 2022-02-02T21:35:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 -- 172.21.15.96:0/1989194280 shutdown_connections 2022-02-02T21:35:54.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 --2- 172.21.15.96:0/1989194280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c0f6cc0 unknown :-1 s=CLOSED pgs=2981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 --2- 172.21.15.96:0/1989194280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 -- 172.21.15.96:0/1989194280 >> 172.21.15.96:0/1989194280 conn(0x7f4e9c0f0d40 msgr2=0x7f4e9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 -- 172.21.15.96:0/1989194280 shutdown_connections 2022-02-02T21:35:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 -- 172.21.15.96:0/1989194280 wait complete. 2022-02-02T21:35:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.594+0000 7f4ea1092700 1 Processor -- start 2022-02-02T21:35:54.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4ea1092700 1 -- start start 2022-02-02T21:35:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4ea1092700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4ea1092700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4ea1092700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0602b0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4ea1092700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0603f0 con 0x7f4e9c0f6860 2022-02-02T21:35:54.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43694/0 (socket says 172.21.15.96:43694) 2022-02-02T21:35:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 -- 172.21.15.96:0/674922353 learned_addr learned my addr 172.21.15.96:0/674922353 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:54.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9a59c700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 -- 172.21.15.96:0/674922353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f6860 msgr2=0x7f4e9c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 -- 172.21.15.96:0/674922353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c005040 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e9ad9d700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 secure :-1 s=READY pgs=2982 cs=0 l=1 rev1=1 rx=0x7f4e90002700 tx=0x7f4e90009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.595+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e900079c0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.596+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e9000f040 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.596+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c10ea60 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.596+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e90014860 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.596+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c10eee0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.597+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c045ad0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.597+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4e9001b060 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.597+0000 7f4e837fe700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 0x7f4e84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.597+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4e900818f0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.597+0000 7f4e9a59c700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 0x7f4e84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.598+0000 7f4e9a59c700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 0x7f4e84067290 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f4e8c004630 tx=0x7f4e8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.602+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4e9004f9f0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.831+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e9c0586e0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.831+0000 7f4e837fe700 1 -- 172.21.15.96:0/674922353 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4e900192e0 con 0x7f4e9c0f55c0 2022-02-02T21:35:54.832 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:35:54.832 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:35:54.833 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:35:54.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:54.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:35:54.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:35:54.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:54.834 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:35:54.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:35:54.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:54.835 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:35:54.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:35:54.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:35:54.836 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:35:54.837 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:35:54.837 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:35:54.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:35:54.838 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:35:54.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.833+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 msgr2=0x7f4e84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.833+0000 7f4ea1092700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 0x7f4e84067290 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f4e8c004630 tx=0x7f4e8c009b30).stop 2022-02-02T21:35:54.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.833+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 msgr2=0x7f4e9c10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.833+0000 7f4ea1092700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 secure :-1 s=READY pgs=2982 cs=0 l=1 rev1=1 rx=0x7f4e90002700 tx=0x7f4e90009d80).stop 2022-02-02T21:35:54.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 shutdown_connections 2022-02-02T21:35:54.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e84064dd0 0x7f4e84067290 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0f55c0 0x7f4e9c10c070 unknown :-1 s=CLOSED pgs=2982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 --2- 172.21.15.96:0/674922353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e9c0f6860 0x7f4e9c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 >> 172.21.15.96:0/674922353 conn(0x7f4e9c0f0d40 msgr2=0x7f4e9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 shutdown_connections 2022-02-02T21:35:54.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.834+0000 7f4ea1092700 1 -- 172.21.15.96:0/674922353 wait complete. 2022-02-02T21:35:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 -- 172.21.15.96:0/934516916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f6870 msgr2=0x7fab780f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 --2- 172.21.15.96:0/934516916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f6870 0x7fab780f6cd0 secure :-1 s=READY pgs=2983 cs=0 l=1 rev1=1 rx=0x7fab74004660 tx=0x7fab74009b30).stop 2022-02-02T21:35:54.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 -- 172.21.15.96:0/934516916 shutdown_connections 2022-02-02T21:35:54.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 --2- 172.21.15.96:0/934516916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f6870 0x7fab780f6cd0 unknown :-1 s=CLOSED pgs=2983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 --2- 172.21.15.96:0/934516916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780f55d0 0x7fab780f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:35:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 -- 172.21.15.96:0/934516916 >> 172.21.15.96:0/934516916 conn(0x7fab780f0d70 msgr2=0x7fab780f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:54.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.931+0000 7fab7fb18700 1 -- 172.21.15.96:0/934516916 shutdown_connections 2022-02-02T21:35:54.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.932+0000 7fab7fb18700 1 -- 172.21.15.96:0/934516916 wait complete. 2022-02-02T21:35:54.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.932+0000 7fab7fb18700 1 Processor -- start 2022-02-02T21:35:54.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.932+0000 7fab7fb18700 1 -- start start 2022-02-02T21:35:54.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.932+0000 7fab7fb18700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.932+0000 7fab7fb18700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780603b0 0x7fab7810c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7fb18700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7810c910 con 0x7fab780f55d0 2022-02-02T21:35:54.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7fb18700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7810ca50 con 0x7fab780603b0 2022-02-02T21:35:54.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43702/0 (socket says 172.21.15.96:43702) 2022-02-02T21:35:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 -- 172.21.15.96:0/1310911857 learned_addr learned my addr 172.21.15.96:0/1310911857 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:35:54.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d0b3700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780603b0 0x7fab7810c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 -- 172.21.15.96:0/1310911857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780603b0 msgr2=0x7fab7810c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:54.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780603b0 0x7fab7810c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:54.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 -- 172.21.15.96:0/1310911857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74005040 con 0x7fab780f55d0 2022-02-02T21:35:54.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7d8b4700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 secure :-1 s=READY pgs=2984 cs=0 l=1 rev1=1 rx=0x7fab680093f0 tx=0x7fab68006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab68013640 con 0x7fab780f55d0 2022-02-02T21:35:54.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab68013c50 con 0x7fab780f55d0 2022-02-02T21:35:54.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab68012c70 con 0x7fab780f55d0 2022-02-02T21:35:54.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.933+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7810cd30 con 0x7fab780f55d0 2022-02-02T21:35:54.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.934+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7810d290 con 0x7fab780f55d0 2022-02-02T21:35:54.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.934+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78045ad0 con 0x7fab780f55d0 2022-02-02T21:35:54.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.935+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fab6800f070 con 0x7fab780f55d0 2022-02-02T21:35:54.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.935+0000 7fab6e7fc700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 0x7fab64067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:35:54.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.936+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fab680820c0 con 0x7fab780f55d0 2022-02-02T21:35:54.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.936+0000 7fab7d0b3700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 0x7fab64067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:35:54.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.936+0000 7fab7d0b3700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 0x7fab64067270 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7fab74000c00 tx=0x7fab74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:35:54.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:54.939+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fab680487d0 con 0x7fab780f55d0 2022-02-02T21:35:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.140+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab78027a00 con 0x7fab780f55d0 2022-02-02T21:35:55.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.141+0000 7fab6e7fc700 1 -- 172.21.15.96:0/1310911857 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fab68053b90 con 0x7fab780f55d0 2022-02-02T21:35:55.142 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:35:55.142 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:35:55.142 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:35:55.143 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:35:55.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:55.144 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:35:55.144 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:35:55.144 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:35:55.145 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:35:55.145 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:35:55.145 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:35:55.146 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:35:55.146 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:35:55.146 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:35:55.147 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:35:55.147 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:35:55.147 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:35:55.148 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:35:55.148 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:35:55.148 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:35:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:35:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:35:55.149 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:35:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:35:55.150 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:35:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:35:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:35:55.151 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:35:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:35:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:35:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:35:55.153 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:35:55.153 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:55.153 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:55.154 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:35:55.154 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:35:55.154 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:55.155 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:55.155 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:35:55.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 msgr2=0x7fab64067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:55.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 0x7fab64067270 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7fab74000c00 tx=0x7fab74009b30).stop 2022-02-02T21:35:55.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 msgr2=0x7fab78109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:35:55.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 secure :-1 s=READY pgs=2984 cs=0 l=1 rev1=1 rx=0x7fab680093f0 tx=0x7fab68006ec0).stop 2022-02-02T21:35:55.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 shutdown_connections 2022-02-02T21:35:55.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab64064db0 0x7fab64067270 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:55.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab780f55d0 0x7fab78109e20 unknown :-1 s=CLOSED pgs=2984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:55.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 --2- 172.21.15.96:0/1310911857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab780603b0 0x7fab7810c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:35:55.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.142+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 >> 172.21.15.96:0/1310911857 conn(0x7fab780f0d70 msgr2=0x7fab780fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:35:55.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.143+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 shutdown_connections 2022-02-02T21:35:55.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:35:55.143+0000 7fab7fb18700 1 -- 172.21.15.96:0/1310911857 wait complete. 2022-02-02T21:35:55.162 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:35:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:55 smithi159 ceph-mon[69013]: from='client.40066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:55.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:55 smithi159 ceph-mon[69013]: pgmap v5814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:55.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/674922353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:35:55.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1310911857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:35:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:55 smithi096 ceph-mon[101353]: from='client.40066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:55 smithi096 ceph-mon[101353]: pgmap v5814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/674922353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:35:55.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1310911857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:35:56.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:56 smithi159 ceph-mon[69013]: from='client.40070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:56 smithi096 ceph-mon[101353]: from='client.40070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:35:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:57 smithi159 ceph-mon[69013]: pgmap v5815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:57.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:57 smithi096 ceph-mon[101353]: pgmap v5815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:35:58 smithi159 ceph-mon[69013]: pgmap v5816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:35:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:35:58 smithi096 ceph-mon[101353]: pgmap v5816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:01 smithi159 ceph-mon[69013]: pgmap v5817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:01.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:01 smithi096 ceph-mon[101353]: pgmap v5817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:03 smithi096 ceph-mon[101353]: pgmap v5818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:03 smithi159 ceph-mon[69013]: pgmap v5818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:05 smithi159 ceph-mon[69013]: pgmap v5819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:05 smithi096 ceph-mon[101353]: pgmap v5819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:07 smithi159 ceph-mon[69013]: pgmap v5820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:07 smithi096 ceph-mon[101353]: pgmap v5820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:08 smithi159 ceph-mon[69013]: pgmap v5821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:08 smithi096 ceph-mon[101353]: pgmap v5821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:11.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:11 smithi159 ceph-mon[69013]: pgmap v5822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:11 smithi096 ceph-mon[101353]: pgmap v5822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:13.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:13 smithi096 ceph-mon[101353]: pgmap v5823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:13.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:13 smithi159 ceph-mon[69013]: pgmap v5823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:15.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:15 smithi159 ceph-mon[69013]: pgmap v5824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:15 smithi096 ceph-mon[101353]: pgmap v5824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:17 smithi159 ceph-mon[69013]: pgmap v5825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:17.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:17 smithi096 ceph-mon[101353]: pgmap v5825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:18 smithi159 ceph-mon[69013]: pgmap v5826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:18 smithi096 ceph-mon[101353]: pgmap v5826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:21 smithi159 ceph-mon[69013]: pgmap v5827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:21.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:21 smithi096 ceph-mon[101353]: pgmap v5827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:23 smithi096 ceph-mon[101353]: pgmap v5828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:23 smithi159 ceph-mon[69013]: pgmap v5828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:25.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- 172.21.15.96:0/2772174958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 msgr2=0x7f52b40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 --2- 172.21.15.96:0/2772174958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b40f6b00 secure :-1 s=READY pgs=2985 cs=0 l=1 rev1=1 rx=0x7f52a4004660 tx=0x7f52a4009b30).stop 2022-02-02T21:36:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- 172.21.15.96:0/2772174958 shutdown_connections 2022-02-02T21:36:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 --2- 172.21.15.96:0/2772174958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 0x7f52b40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 --2- 172.21.15.96:0/2772174958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b40f6b00 unknown :-1 s=CLOSED pgs=2985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- 172.21.15.96:0/2772174958 >> 172.21.15.96:0/2772174958 conn(0x7f52b40f1e40 msgr2=0x7f52b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- 172.21.15.96:0/2772174958 shutdown_connections 2022-02-02T21:36:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- 172.21.15.96:0/2772174958 wait complete. 2022-02-02T21:36:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 Processor -- start 2022-02-02T21:36:25.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.252+0000 7f52ba946700 1 -- start start 2022-02-02T21:36:25.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52ba946700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52ba946700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 0x7f52b41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52ba946700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4107a50 con 0x7f52b40f66e0 2022-02-02T21:36:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52ba946700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4107b90 con 0x7f52b40f7980 2022-02-02T21:36:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43722/0 (socket says 172.21.15.96:43722) 2022-02-02T21:36:25.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 -- 172.21.15.96:0/1641836046 learned_addr learned my addr 172.21.15.96:0/1641836046 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:25.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52abfff700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 0x7f52b41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 -- 172.21.15.96:0/1641836046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 msgr2=0x7f52b41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 0x7f52b41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 -- 172.21.15.96:0/1641836046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4005040 con 0x7f52b40f66e0 2022-02-02T21:36:25.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.253+0000 7f52b3fff700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 secure :-1 s=READY pgs=2986 cs=0 l=1 rev1=1 rx=0x7f52a4000c00 tx=0x7f52a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.254+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a4018070 con 0x7f52b40f66e0 2022-02-02T21:36:25.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.254+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52a4007cf0 con 0x7f52b40f66e0 2022-02-02T21:36:25.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.254+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b41084d0 con 0x7f52b40f66e0 2022-02-02T21:36:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.254+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a401c3c0 con 0x7f52b40f66e0 2022-02-02T21:36:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.254+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b4108a30 con 0x7f52b40f66e0 2022-02-02T21:36:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.255+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b4045ad0 con 0x7f52b40f66e0 2022-02-02T21:36:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.255+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52a401d420 con 0x7f52b40f66e0 2022-02-02T21:36:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.256+0000 7f52b17fa700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 0x7f52a0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.256+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52a40838f0 con 0x7f52b40f66e0 2022-02-02T21:36:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.256+0000 7f52abfff700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 0x7f52a0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.256+0000 7f52abfff700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 0x7f52a0067270 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f529c0041d0 tx=0x7f529c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.260+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52a4055420 con 0x7f52b40f66e0 2022-02-02T21:36:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.441+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52b40ff020 con 0x7f52a0064db0 2022-02-02T21:36:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.442+0000 7f52b17fa700 1 -- 172.21.15.96:0/1641836046 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f52b40ff020 con 0x7f52a0064db0 2022-02-02T21:36:25.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 msgr2=0x7f52a0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 0x7f52a0067270 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f529c0041d0 tx=0x7f529c009040).stop 2022-02-02T21:36:25.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 msgr2=0x7f52b4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 secure :-1 s=READY pgs=2986 cs=0 l=1 rev1=1 rx=0x7f52a4000c00 tx=0x7f52a4009b30).stop 2022-02-02T21:36:25.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 shutdown_connections 2022-02-02T21:36:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a0064db0 0x7f52a0067270 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b40f66e0 0x7f52b4106fb0 unknown :-1 s=CLOSED pgs=2986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 --2- 172.21.15.96:0/1641836046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b40f7980 0x7f52b41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 >> 172.21.15.96:0/1641836046 conn(0x7f52b40f1e40 msgr2=0x7f52b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 shutdown_connections 2022-02-02T21:36:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.444+0000 7f52ba946700 1 -- 172.21.15.96:0/1641836046 wait complete. 2022-02-02T21:36:25.455 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:36:25.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.541+0000 7f747a530700 1 -- 172.21.15.96:0/2919904848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f7980 msgr2=0x7f74740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.541+0000 7f747a530700 1 --2- 172.21.15.96:0/2919904848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f7980 0x7f74740f7de0 secure :-1 s=READY pgs=2987 cs=0 l=1 rev1=1 rx=0x7f7464004660 tx=0x7f7464009b30).stop 2022-02-02T21:36:25.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 -- 172.21.15.96:0/2919904848 shutdown_connections 2022-02-02T21:36:25.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 --2- 172.21.15.96:0/2919904848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f7980 0x7f74740f7de0 unknown :-1 s=CLOSED pgs=2987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 --2- 172.21.15.96:0/2919904848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f66e0 0x7f74740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 -- 172.21.15.96:0/2919904848 >> 172.21.15.96:0/2919904848 conn(0x7f74740f1e40 msgr2=0x7f74740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:25.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:25 smithi096 ceph-mon[101353]: pgmap v5829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:25.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 -- 172.21.15.96:0/2919904848 shutdown_connections 2022-02-02T21:36:25.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 -- 172.21.15.96:0/2919904848 wait complete. 2022-02-02T21:36:25.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.542+0000 7f747a530700 1 Processor -- start 2022-02-02T21:36:25.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f747a530700 1 -- start start 2022-02-02T21:36:25.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f747a530700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f747a530700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f7980 0x7f7474107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f747a530700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474107a00 con 0x7f74740f66e0 2022-02-02T21:36:25.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f747a530700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474107b40 con 0x7f74740f7980 2022-02-02T21:36:25.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43732/0 (socket says 172.21.15.96:43732) 2022-02-02T21:36:25.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 -- 172.21.15.96:0/3495384259 learned_addr learned my addr 172.21.15.96:0/3495384259 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:25.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f74737fe700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f7980 0x7f7474107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 -- 172.21.15.96:0/3495384259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f7980 msgr2=0x7f7474107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f7980 0x7f7474107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.543+0000 7f7473fff700 1 -- 172.21.15.96:0/3495384259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464005040 con 0x7f74740f66e0 2022-02-02T21:36:25.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f7473fff700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 rx=0x7f746800c530 tx=0x7f7468007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746800f650 con 0x7f74740f66e0 2022-02-02T21:36:25.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74741084e0 con 0x7f74740f66e0 2022-02-02T21:36:25.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f746800fc60 con 0x7f74740f66e0 2022-02-02T21:36:25.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7468012d20 con 0x7f74740f66e0 2022-02-02T21:36:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.544+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7474108aa0 con 0x7f74740f66e0 2022-02-02T21:36:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.545+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474045ad0 con 0x7f74740f66e0 2022-02-02T21:36:25.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.545+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7468019030 con 0x7f74740f66e0 2022-02-02T21:36:25.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.546+0000 7f7470ff9700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 0x7f745c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.546+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f74680816b0 con 0x7f74740f66e0 2022-02-02T21:36:25.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.546+0000 7f74737fe700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 0x7f745c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.546+0000 7f74737fe700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 0x7f745c067290 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f7464004e30 tx=0x7f7464009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.550+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7468053230 con 0x7f74740f66e0 2022-02-02T21:36:25.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.722+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7474108d20 con 0x7f745c064dd0 2022-02-02T21:36:25.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.731+0000 7f7470ff9700 1 -- 172.21.15.96:0/3495384259 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7474108d20 con 0x7f745c064dd0 2022-02-02T21:36:25.733 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:36:25.733 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:36:25.733 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:36:25.734 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:36:25.737 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:36:25.737 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:36:25.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:36:25.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:36:25.739 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:36:25.739 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:36:25.739 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:36:25.740 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:36:25.740 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:36:25.740 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:36:25.741 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:36:25.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:36:25.741 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:36:25.742 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:36:25.742 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:36:25.742 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:36:25.743 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:36:25.744 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:36:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 msgr2=0x7f745c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 0x7f745c067290 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f7464004e30 tx=0x7f7464009b30).stop 2022-02-02T21:36:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 msgr2=0x7f7474106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 rx=0x7f746800c530 tx=0x7f7468007e10).stop 2022-02-02T21:36:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 shutdown_connections 2022-02-02T21:36:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f745c064dd0 0x7f745c067290 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74740f66e0 0x7f7474106f60 unknown :-1 s=CLOSED pgs=2988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 --2- 172.21.15.96:0/3495384259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740f7980 0x7f7474107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 >> 172.21.15.96:0/3495384259 conn(0x7f74740f1e40 msgr2=0x7f74740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:25.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 shutdown_connections 2022-02-02T21:36:25.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.733+0000 7f747a530700 1 -- 172.21.15.96:0/3495384259 wait complete. 2022-02-02T21:36:25.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:25 smithi159 ceph-mon[69013]: pgmap v5829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:25.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 -- 172.21.15.96:0/4208844412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f66d0 msgr2=0x7f24f80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 --2- 172.21.15.96:0/4208844412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f66d0 0x7f24f80f6b30 secure :-1 s=READY pgs=2989 cs=0 l=1 rev1=1 rx=0x7f24ec004660 tx=0x7f24ec009b30).stop 2022-02-02T21:36:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 -- 172.21.15.96:0/4208844412 shutdown_connections 2022-02-02T21:36:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 --2- 172.21.15.96:0/4208844412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f66d0 0x7f24f80f6b30 unknown :-1 s=CLOSED pgs=2989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 --2- 172.21.15.96:0/4208844412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f5430 0x7f24f80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.829+0000 7f24f759e700 1 -- 172.21.15.96:0/4208844412 >> 172.21.15.96:0/4208844412 conn(0x7f24f80f0b90 msgr2=0x7f24f80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.830+0000 7f24f759e700 1 -- 172.21.15.96:0/4208844412 shutdown_connections 2022-02-02T21:36:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.830+0000 7f24f759e700 1 -- 172.21.15.96:0/4208844412 wait complete. 2022-02-02T21:36:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.830+0000 7f24f759e700 1 Processor -- start 2022-02-02T21:36:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.830+0000 7f24f759e700 1 -- start start 2022-02-02T21:36:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.830+0000 7f24f759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 0x7f24f81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8106760 con 0x7f24f80f5430 2022-02-02T21:36:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8106f60 con 0x7f24f80f66d0 2022-02-02T21:36:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43740/0 (socket says 172.21.15.96:43740) 2022-02-02T21:36:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 -- 172.21.15.96:0/1425811762 learned_addr learned my addr 172.21.15.96:0/1425811762 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f5d9b700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 0x7f24f81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 -- 172.21.15.96:0/1425811762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 msgr2=0x7f24f81061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 0x7f24f81061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 -- 172.21.15.96:0/1425811762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec005040 con 0x7f24f80f5430 2022-02-02T21:36:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f5d9b700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 0x7f24f81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:36:25.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f659c700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 secure :-1 s=READY pgs=2990 cs=0 l=1 rev1=1 rx=0x7f24e800f910 tx=0x7f24e8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e8009500 con 0x7f24f80f5430 2022-02-02T21:36:25.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24e8009660 con 0x7f24f80f5430 2022-02-02T21:36:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e800de20 con 0x7f24f80f5430 2022-02-02T21:36:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f81071e0 con 0x7f24f80f5430 2022-02-02T21:36:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.831+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f8107750 con 0x7f24f80f5430 2022-02-02T21:36:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.832+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8045ad0 con 0x7f24f80f5430 2022-02-02T21:36:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.833+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24e800e040 con 0x7f24f80f5430 2022-02-02T21:36:25.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.833+0000 7f24e6ffd700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 0x7f24e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:25.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.833+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f24e8084150 con 0x7f24f80f5430 2022-02-02T21:36:25.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.833+0000 7f24f5d9b700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 0x7f24e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:25.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.834+0000 7f24f5d9b700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 0x7f24e00672e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f24ec004630 tx=0x7f24ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:25.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:25.837+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24e8055c80 con 0x7f24f80f5430 2022-02-02T21:36:26.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.066+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24f80ff600 con 0x7f24f80f5430 2022-02-02T21:36:26.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.066+0000 7f24e6ffd700 1 -- 172.21.15.96:0/1425811762 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f24e8055870 con 0x7f24f80f5430 2022-02-02T21:36:26.068 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:36:26.069 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:36:26.069 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:36:26.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:26.070 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:36:26.070 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:36:26.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:26.071 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:36:26.071 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:36:26.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:26.072 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:36:26.072 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:36:26.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:26.073 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:36:26.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:36:26.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:36:26.074 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:36:26.074 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:36:26.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.068+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 msgr2=0x7f24e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 0x7f24e00672e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f24ec004630 tx=0x7f24ec009b30).stop 2022-02-02T21:36:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 msgr2=0x7f24f8105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 secure :-1 s=READY pgs=2990 cs=0 l=1 rev1=1 rx=0x7f24e800f910 tx=0x7f24e8009d80).stop 2022-02-02T21:36:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 shutdown_connections 2022-02-02T21:36:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24e0064e20 0x7f24e00672e0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24f80f5430 0x7f24f8105cc0 unknown :-1 s=CLOSED pgs=2990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 --2- 172.21.15.96:0/1425811762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24f80f66d0 0x7f24f81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 >> 172.21.15.96:0/1425811762 conn(0x7f24f80f0b90 msgr2=0x7f24f80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:26.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 shutdown_connections 2022-02-02T21:36:26.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.069+0000 7f24f759e700 1 -- 172.21.15.96:0/1425811762 wait complete. 2022-02-02T21:36:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3473256407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe680f5430 msgr2=0x7efe680f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3473256407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe680f5430 0x7efe680f5850 secure :-1 s=READY pgs=2991 cs=0 l=1 rev1=1 rx=0x7efe58004660 tx=0x7efe58009b30).stop 2022-02-02T21:36:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3473256407 shutdown_connections 2022-02-02T21:36:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3473256407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe680f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3473256407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe680f5430 0x7efe680f5850 unknown :-1 s=CLOSED pgs=2991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3473256407 >> 172.21.15.96:0/3473256407 conn(0x7efe680f0b90 msgr2=0x7efe680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:26.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3473256407 shutdown_connections 2022-02-02T21:36:26.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.166+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3473256407 wait complete. 2022-02-02T21:36:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.167+0000 7efe6cd5e700 1 Processor -- start 2022-02-02T21:36:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.167+0000 7efe6cd5e700 1 -- start start 2022-02-02T21:36:26.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe6cd5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe68109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:26.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe6cd5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:26.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe6cd5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6810c650 con 0x7efe68060310 2022-02-02T21:36:26.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe6cd5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6810c790 con 0x7efe680f66d0 2022-02-02T21:36:26.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:26.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43752/0 (socket says 172.21.15.96:43752) 2022-02-02T21:36:26.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 -- 172.21.15.96:0/3124110187 learned_addr learned my addr 172.21.15.96:0/3124110187 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:26.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe677fe700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe68109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:26.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 -- 172.21.15.96:0/3124110187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 msgr2=0x7efe68109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe68109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 -- 172.21.15.96:0/3124110187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58005040 con 0x7efe68060310 2022-02-02T21:36:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe677fe700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe68109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:36:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe66ffd700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 secure :-1 s=READY pgs=2992 cs=0 l=1 rev1=1 rx=0x7efe5c00c530 tx=0x7efe5c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.168+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5c00f650 con 0x7efe68060310 2022-02-02T21:36:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.169+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe5c00fc60 con 0x7efe68060310 2022-02-02T21:36:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.169+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6810ca70 con 0x7efe68060310 2022-02-02T21:36:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.169+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5c012cd0 con 0x7efe68060310 2022-02-02T21:36:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.169+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6810d000 con 0x7efe68060310 2022-02-02T21:36:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.170+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68045ad0 con 0x7efe68060310 2022-02-02T21:36:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.170+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe5c010070 con 0x7efe68060310 2022-02-02T21:36:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.171+0000 7efe4ffff700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 0x7efe500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.171+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efe5c081fe0 con 0x7efe68060310 2022-02-02T21:36:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.171+0000 7efe677fe700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 0x7efe500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.171+0000 7efe677fe700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 0x7efe500672e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7efe58009040 tx=0x7efe58009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.174+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe5c0500e0 con 0x7efe68060310 2022-02-02T21:36:26.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.379+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe68027a00 con 0x7efe68060310 2022-02-02T21:36:26.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.379+0000 7efe4ffff700 1 -- 172.21.15.96:0/3124110187 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efe5c020070 con 0x7efe68060310 2022-02-02T21:36:26.381 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:36:26.382 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:36:26.382 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:36:26.383 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:36:26.383 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:26.383 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:36:26.384 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:36:26.384 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:36:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:36:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:36:26.385 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:36:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:36:26.386 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:36:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:36:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:36:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:36:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:36:26.388 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:36:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:36:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:36:26.389 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:36:26.390 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:36:26.390 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:36:26.390 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:36:26.391 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:36:26.391 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:36:26.392 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:36:26.392 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:36:26.392 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:36:26.393 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:36:26.393 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:36:26.393 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:36:26.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:26.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:26.395 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:36:26.395 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:26.395 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:26.396 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:26.396 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 msgr2=0x7efe500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 0x7efe500672e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7efe58009040 tx=0x7efe58009b30).stop 2022-02-02T21:36:26.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 msgr2=0x7efe6810c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 secure :-1 s=READY pgs=2992 cs=0 l=1 rev1=1 rx=0x7efe5c00c530 tx=0x7efe5c007e20).stop 2022-02-02T21:36:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 shutdown_connections 2022-02-02T21:36:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe50064e20 0x7efe500672e0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe680f66d0 0x7efe68109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 --2- 172.21.15.96:0/3124110187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe68060310 0x7efe6810c0c0 unknown :-1 s=CLOSED pgs=2992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 >> 172.21.15.96:0/3124110187 conn(0x7efe680f0b90 msgr2=0x7efe680fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 shutdown_connections 2022-02-02T21:36:26.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:26.381+0000 7efe6cd5e700 1 -- 172.21.15.96:0/3124110187 wait complete. 2022-02-02T21:36:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:36:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1425811762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:36:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1425811762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:36:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:27 smithi159 ceph-mon[69013]: from='client.40082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:27 smithi159 ceph-mon[69013]: from='client.40086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:27 smithi159 ceph-mon[69013]: pgmap v5830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:27.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3124110187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:36:27.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:27 smithi096 ceph-mon[101353]: from='client.40082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:27.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:27 smithi096 ceph-mon[101353]: from='client.40086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:27.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:27 smithi096 ceph-mon[101353]: pgmap v5830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:27.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3124110187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:36:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:36:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:36:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:28 smithi159 ceph-mon[69013]: pgmap v5831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:36:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:36:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:28 smithi096 ceph-mon[101353]: pgmap v5831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:31 smithi159 ceph-mon[69013]: pgmap v5832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:31.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:31 smithi096 ceph-mon[101353]: pgmap v5832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:33 smithi096 ceph-mon[101353]: pgmap v5833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:33 smithi159 ceph-mon[69013]: pgmap v5833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:35 smithi159 ceph-mon[69013]: pgmap v5834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:35.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:35 smithi096 ceph-mon[101353]: pgmap v5834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:37 smithi159 ceph-mon[69013]: pgmap v5835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:37 smithi096 ceph-mon[101353]: pgmap v5835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:38 smithi159 ceph-mon[69013]: pgmap v5836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:38 smithi096 ceph-mon[101353]: pgmap v5836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:41 smithi159 ceph-mon[69013]: pgmap v5837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:41 smithi096 ceph-mon[101353]: pgmap v5837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:43 smithi096 ceph-mon[101353]: pgmap v5838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:43.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:43 smithi159 ceph-mon[69013]: pgmap v5838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:45 smithi159 ceph-mon[69013]: pgmap v5839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:45.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:45 smithi096 ceph-mon[101353]: pgmap v5839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:47 smithi159 ceph-mon[69013]: pgmap v5840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:47 smithi096 ceph-mon[101353]: pgmap v5840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:48 smithi159 ceph-mon[69013]: pgmap v5841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:48 smithi096 ceph-mon[101353]: pgmap v5841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:51 smithi159 ceph-mon[69013]: pgmap v5842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:51 smithi096 ceph-mon[101353]: pgmap v5842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:53 smithi096 ceph-mon[101353]: pgmap v5843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:53 smithi159 ceph-mon[69013]: pgmap v5843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:55 smithi159 ceph-mon[69013]: pgmap v5844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:55 smithi096 ceph-mon[101353]: pgmap v5844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:56.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 -- 172.21.15.96:0/2470850242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 msgr2=0x7fa2400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 --2- 172.21.15.96:0/2470850242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa2400f6b00 secure :-1 s=READY pgs=2993 cs=0 l=1 rev1=1 rx=0x7fa230004660 tx=0x7fa230009b30).stop 2022-02-02T21:36:56.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 -- 172.21.15.96:0/2470850242 shutdown_connections 2022-02-02T21:36:56.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 --2- 172.21.15.96:0/2470850242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 0x7fa2400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 --2- 172.21.15.96:0/2470850242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa2400f6b00 unknown :-1 s=CLOSED pgs=2993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 -- 172.21.15.96:0/2470850242 >> 172.21.15.96:0/2470850242 conn(0x7fa2400f1e40 msgr2=0x7fa2400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:56.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 -- 172.21.15.96:0/2470850242 shutdown_connections 2022-02-02T21:36:56.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.492+0000 7fa244bf1700 1 -- 172.21.15.96:0/2470850242 wait complete. 2022-02-02T21:36:56.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 Processor -- start 2022-02-02T21:36:56.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 -- start start 2022-02-02T21:36:56.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 0x7fa2401074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240107a50 con 0x7fa2400f66e0 2022-02-02T21:36:56.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa244bf1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240107b90 con 0x7fa2400f7980 2022-02-02T21:36:56.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa23e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa23e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43774/0 (socket says 172.21.15.96:43774) 2022-02-02T21:36:56.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.493+0000 7fa23e59c700 1 -- 172.21.15.96:0/3486678749 learned_addr learned my addr 172.21.15.96:0/3486678749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:56.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa23dd9b700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 0x7fa2401074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa23e59c700 1 -- 172.21.15.96:0/3486678749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 msgr2=0x7fa2401074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa23e59c700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 0x7fa2401074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa23e59c700 1 -- 172.21.15.96:0/3486678749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230005040 con 0x7fa2400f66e0 2022-02-02T21:36:56.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa23e59c700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 rx=0x7fa230013a70 tx=0x7fa230009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:56.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa230018070 con 0x7fa2400f66e0 2022-02-02T21:36:56.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2401084d0 con 0x7fa2400f66e0 2022-02-02T21:36:56.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2300097d0 con 0x7fa2400f66e0 2022-02-02T21:36:56.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23001de80 con 0x7fa2400f66e0 2022-02-02T21:36:56.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.494+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa240108a30 con 0x7fa2400f66e0 2022-02-02T21:36:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.495+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa240045ad0 con 0x7fa2400f66e0 2022-02-02T21:36:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.496+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa230007ba0 con 0x7fa2400f66e0 2022-02-02T21:36:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.496+0000 7fa22effd700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 0x7fa228067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.496+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa230083650 con 0x7fa2400f66e0 2022-02-02T21:36:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.496+0000 7fa23dd9b700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 0x7fa228067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.496+0000 7fa23dd9b700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 0x7fa228067290 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7fa234004c40 tx=0x7fa23400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:56.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.500+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa230055180 con 0x7fa2400f66e0 2022-02-02T21:36:56.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.683+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2400ff020 con 0x7fa228064dd0 2022-02-02T21:36:56.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.684+0000 7fa22effd700 1 -- 172.21.15.96:0/3486678749 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa2400ff020 con 0x7fa228064dd0 2022-02-02T21:36:56.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 msgr2=0x7fa228067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 0x7fa228067290 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7fa234004c40 tx=0x7fa23400b040).stop 2022-02-02T21:36:56.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 msgr2=0x7fa240106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 rx=0x7fa230013a70 tx=0x7fa230009b30).stop 2022-02-02T21:36:56.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 shutdown_connections 2022-02-02T21:36:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa228064dd0 0x7fa228067290 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2400f66e0 0x7fa240106fb0 unknown :-1 s=CLOSED pgs=2994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 --2- 172.21.15.96:0/3486678749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2400f7980 0x7fa2401074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 >> 172.21.15.96:0/3486678749 conn(0x7fa2400f1e40 msgr2=0x7fa2400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 shutdown_connections 2022-02-02T21:36:56.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.686+0000 7fa244bf1700 1 -- 172.21.15.96:0/3486678749 wait complete. 2022-02-02T21:36:56.695 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:36:56.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/1416793548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f66e0 msgr2=0x7fb3c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/1416793548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f66e0 0x7fb3c40f6b00 secure :-1 s=READY pgs=2995 cs=0 l=1 rev1=1 rx=0x7fb3b4004660 tx=0x7fb3b4009b30).stop 2022-02-02T21:36:56.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/1416793548 shutdown_connections 2022-02-02T21:36:56.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/1416793548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f7980 0x7fb3c40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/1416793548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f66e0 0x7fb3c40f6b00 unknown :-1 s=CLOSED pgs=2995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/1416793548 >> 172.21.15.96:0/1416793548 conn(0x7fb3c40f1e40 msgr2=0x7fb3c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/1416793548 shutdown_connections 2022-02-02T21:36:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/1416793548 wait complete. 2022-02-02T21:36:56.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.783+0000 7fb3ca6c6700 1 Processor -- start 2022-02-02T21:36:56.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3ca6c6700 1 -- start start 2022-02-02T21:36:56.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3ca6c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 0x7fb3c4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3ca6c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3ca6c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4107a50 con 0x7fb3c40f7980 2022-02-02T21:36:56.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3ca6c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4107b90 con 0x7fb3c40f66e0 2022-02-02T21:36:56.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43786/0 (socket says 172.21.15.96:43786) 2022-02-02T21:36:56.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 -- 172.21.15.96:0/4265556319 learned_addr learned my addr 172.21.15.96:0/4265556319 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:56.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c3fff700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 0x7fb3c4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 -- 172.21.15.96:0/4265556319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 msgr2=0x7fb3c4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 0x7fb3c4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 -- 172.21.15.96:0/4265556319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b4005040 con 0x7fb3c40f7980 2022-02-02T21:36:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c3fff700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 0x7fb3c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:36:56.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c37fe700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 secure :-1 s=READY pgs=2996 cs=0 l=1 rev1=1 rx=0x7fb3b800c530 tx=0x7fb3b8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.784+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b800f650 con 0x7fb3c40f7980 2022-02-02T21:36:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.785+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c4108530 con 0x7fb3c40f7980 2022-02-02T21:36:56.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.785+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3b800fc60 con 0x7fb3c40f7980 2022-02-02T21:36:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.785+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b8012cd0 con 0x7fb3c40f7980 2022-02-02T21:36:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.785+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c4108af0 con 0x7fb3c40f7980 2022-02-02T21:36:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.785+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c4045ad0 con 0x7fb3c40f7980 2022-02-02T21:36:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.786+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb3b8010070 con 0x7fb3c40f7980 2022-02-02T21:36:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.786+0000 7fb3c0ff9700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:56.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.786+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb3b80817b0 con 0x7fb3c40f7980 2022-02-02T21:36:56.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.787+0000 7fb3c3fff700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:56.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.787+0000 7fb3c3fff700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7fb3b4004e30 tx=0x7fb3b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:56.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.791+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb3b80532e0 con 0x7fb3c40f7980 2022-02-02T21:36:56.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.964+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3c40ff010 con 0x7fb3ac064dd0 2022-02-02T21:36:56.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.973+0000 7fb3c0ff9700 1 -- 172.21.15.96:0/4265556319 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb3c40ff010 con 0x7fb3ac064dd0 2022-02-02T21:36:56.975 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:36:56.975 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:36:56.975 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:36:56.976 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:36:56.976 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:36:56.977 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:36:56.977 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:36:56.977 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:36:56.978 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:36:56.978 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:36:56.979 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:36:56.979 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:36:56.980 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:36:56.980 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:36:56.981 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:36:56.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:36:56.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:36:56.982 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:36:56.983 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:36:56.983 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:36:56.983 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:36:56.984 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:36:56.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.974+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 msgr2=0x7fb3ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.974+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7fb3b4004e30 tx=0x7fb3b4009b30).stop 2022-02-02T21:36:56.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.974+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 msgr2=0x7fb3c41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:56.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.974+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 secure :-1 s=READY pgs=2996 cs=0 l=1 rev1=1 rx=0x7fb3b800c530 tx=0x7fb3b8007e20).stop 2022-02-02T21:36:56.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 shutdown_connections 2022-02-02T21:36:56.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb3ac064dd0 0x7fb3ac067290 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c40f66e0 0x7fb3c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 --2- 172.21.15.96:0/4265556319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3c40f7980 0x7fb3c41074a0 unknown :-1 s=CLOSED pgs=2996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:56.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 >> 172.21.15.96:0/4265556319 conn(0x7fb3c40f1e40 msgr2=0x7fb3c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:56.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 shutdown_connections 2022-02-02T21:36:56.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:56.975+0000 7fb3ca6c6700 1 -- 172.21.15.96:0/4265556319 wait complete. 2022-02-02T21:36:57.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- 172.21.15.96:0/647573347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f6860 msgr2=0x7f21d00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 --2- 172.21.15.96:0/647573347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f6860 0x7f21d00f6cc0 secure :-1 s=READY pgs=2997 cs=0 l=1 rev1=1 rx=0x7f21c0004660 tx=0x7f21c0009b30).stop 2022-02-02T21:36:57.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- 172.21.15.96:0/647573347 shutdown_connections 2022-02-02T21:36:57.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 --2- 172.21.15.96:0/647573347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f6860 0x7f21d00f6cc0 unknown :-1 s=CLOSED pgs=2997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 --2- 172.21.15.96:0/647573347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f55c0 0x7f21d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- 172.21.15.96:0/647573347 >> 172.21.15.96:0/647573347 conn(0x7f21d00f0d40 msgr2=0x7f21d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- 172.21.15.96:0/647573347 shutdown_connections 2022-02-02T21:36:57.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- 172.21.15.96:0/647573347 wait complete. 2022-02-02T21:36:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 Processor -- start 2022-02-02T21:36:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.071+0000 7f21d59c1700 1 -- start start 2022-02-02T21:36:57.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21d59c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21d59c1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f6860 0x7f21d010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21d59c1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00603e0 con 0x7f21d00f55c0 2022-02-02T21:36:57.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21d59c1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0060520 con 0x7f21d00f6860 2022-02-02T21:36:57.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43794/0 (socket says 172.21.15.96:43794) 2022-02-02T21:36:57.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 -- 172.21.15.96:0/1989378484 learned_addr learned my addr 172.21.15.96:0/1989378484 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ce7fc700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f6860 0x7f21d010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 -- 172.21.15.96:0/1989378484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f6860 msgr2=0x7f21d010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f6860 0x7f21d010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 -- 172.21.15.96:0/1989378484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21d00f55c0 2022-02-02T21:36:57.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21ceffd700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 secure :-1 s=READY pgs=2998 cs=0 l=1 rev1=1 rx=0x7f21c400c530 tx=0x7f21c4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c400f650 con 0x7f21d00f55c0 2022-02-02T21:36:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21c400fc60 con 0x7f21d00f55c0 2022-02-02T21:36:57.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.073+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d010c700 con 0x7f21d00f55c0 2022-02-02T21:36:57.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.072+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4012cb0 con 0x7f21d00f55c0 2022-02-02T21:36:57.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.073+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d010ccc0 con 0x7f21d00f55c0 2022-02-02T21:36:57.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.074+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0045ad0 con 0x7f21d00f55c0 2022-02-02T21:36:57.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.074+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21c4019030 con 0x7f21d00f55c0 2022-02-02T21:36:57.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.074+0000 7f21b77fe700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 0x7f21b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.075+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f21c4081580 con 0x7f21d00f55c0 2022-02-02T21:36:57.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.075+0000 7f21ce7fc700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 0x7f21b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.075+0000 7f21ce7fc700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 0x7f21b8067290 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f21c0004630 tx=0x7f21c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:57.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.079+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21c404f6d0 con 0x7f21d00f55c0 2022-02-02T21:36:57.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.322+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21d00fded0 con 0x7f21d00f55c0 2022-02-02T21:36:57.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.323+0000 7f21b77fe700 1 -- 172.21.15.96:0/1989378484 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f21c4052cf0 con 0x7f21d00f55c0 2022-02-02T21:36:57.325 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:36:57.326 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:36:57.326 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:36:57.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:57.327 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:36:57.327 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:36:57.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:57.328 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:36:57.328 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:36:57.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:57.329 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:36:57.329 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:36:57.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:36:57.330 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:36:57.330 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:36:57.330 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:36:57.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:36:57.331 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:36:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 msgr2=0x7f21b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 0x7f21b8067290 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f21c0004630 tx=0x7f21c0009b30).stop 2022-02-02T21:36:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 msgr2=0x7f21d0109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 secure :-1 s=READY pgs=2998 cs=0 l=1 rev1=1 rx=0x7f21c400c530 tx=0x7f21c4007e10).stop 2022-02-02T21:36:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 shutdown_connections 2022-02-02T21:36:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f21b8064dd0 0x7f21b8067290 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d00f55c0 0x7f21d0109c50 unknown :-1 s=CLOSED pgs=2998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 --2- 172.21.15.96:0/1989378484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d00f6860 0x7f21d010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 >> 172.21.15.96:0/1989378484 conn(0x7f21d00f0d40 msgr2=0x7f21d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 shutdown_connections 2022-02-02T21:36:57.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.325+0000 7f21d59c1700 1 -- 172.21.15.96:0/1989378484 wait complete. 2022-02-02T21:36:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 -- 172.21.15.96:0/1511151392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f5430 msgr2=0x7f84880f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 --2- 172.21.15.96:0/1511151392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f5430 0x7f84880f5850 secure :-1 s=READY pgs=2999 cs=0 l=1 rev1=1 rx=0x7f8478004660 tx=0x7f8478009b30).stop 2022-02-02T21:36:57.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 -- 172.21.15.96:0/1511151392 shutdown_connections 2022-02-02T21:36:57.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 --2- 172.21.15.96:0/1511151392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f66d0 0x7f84880f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 --2- 172.21.15.96:0/1511151392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f5430 0x7f84880f5850 unknown :-1 s=CLOSED pgs=2999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 -- 172.21.15.96:0/1511151392 >> 172.21.15.96:0/1511151392 conn(0x7f84880f0b90 msgr2=0x7f84880f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:57.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 -- 172.21.15.96:0/1511151392 shutdown_connections 2022-02-02T21:36:57.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.423+0000 7f848ce83700 1 -- 172.21.15.96:0/1511151392 wait complete. 2022-02-02T21:36:57.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.424+0000 7f848ce83700 1 Processor -- start 2022-02-02T21:36:57.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.424+0000 7f848ce83700 1 -- start start 2022-02-02T21:36:57.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.424+0000 7f848ce83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f5430 0x7f8488109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.424+0000 7f848ce83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.424+0000 7f848ce83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488060420 con 0x7f84880f66d0 2022-02-02T21:36:57.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f848ce83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488060560 con 0x7f84880f5430 2022-02-02T21:36:57.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43806/0 (socket says 172.21.15.96:43806) 2022-02-02T21:36:57.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 -- 172.21.15.96:0/1464643207 learned_addr learned my addr 172.21.15.96:0/1464643207 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:36:57.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f84877fe700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f5430 0x7f8488109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 -- 172.21.15.96:0/1464643207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f5430 msgr2=0x7f8488109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f5430 0x7f8488109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 -- 172.21.15.96:0/1464643207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478005040 con 0x7f84880f66d0 2022-02-02T21:36:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f8486ffd700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 secure :-1 s=READY pgs=3000 cs=0 l=1 rev1=1 rx=0x7f847c0026d0 tx=0x7f847c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:57.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847c0079c0 con 0x7f84880f66d0 2022-02-02T21:36:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848810c560 con 0x7f84880f66d0 2022-02-02T21:36:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f847c00f040 con 0x7f84880f66d0 2022-02-02T21:36:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847c0148b0 con 0x7f84880f66d0 2022-02-02T21:36:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.425+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848810caf0 con 0x7f84880f66d0 2022-02-02T21:36:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.426+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488059100 con 0x7f84880f66d0 2022-02-02T21:36:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.427+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f847c007b20 con 0x7f84880f66d0 2022-02-02T21:36:57.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.427+0000 7f846ffff700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 0x7f84700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:36:57.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.427+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f847c081990 con 0x7f84880f66d0 2022-02-02T21:36:57.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.427+0000 7f84877fe700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 0x7f84700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:36:57.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.427+0000 7f84877fe700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 0x7f84700672e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f8478013690 tx=0x7f8478009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:36:57.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.431+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f847c04fa90 con 0x7f84880f66d0 2022-02-02T21:36:57.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.631+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8488045ad0 con 0x7f84880f66d0 2022-02-02T21:36:57.633 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:57 smithi096 ceph-mon[101353]: pgmap v5845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:57.634 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1989378484' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:36:57.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.632+0000 7f846ffff700 1 -- 172.21.15.96:0/1464643207 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f847c0530b0 con 0x7f84880f66d0 2022-02-02T21:36:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:36:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:36:57.636 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:36:57.636 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:36:57.636 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:57.637 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:36:57.637 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:36:57.637 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:36:57.638 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:36:57.638 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:36:57.639 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:36:57.639 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:36:57.639 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:36:57.640 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:36:57.640 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:36:57.640 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:36:57.641 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:36:57.641 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:36:57.641 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:36:57.642 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:36:57.642 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:36:57.642 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:36:57.643 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:36:57.643 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:36:57.643 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:36:57.644 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:36:57.644 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:36:57.644 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:36:57.645 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:36:57.645 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:36:57.645 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:36:57.646 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:36:57.646 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:57.646 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:57.647 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:36:57.647 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:36:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:36:57.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.633+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 msgr2=0x7f84700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.633+0000 7f848ce83700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 0x7f84700672e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f8478013690 tx=0x7f8478009b30).stop 2022-02-02T21:36:57.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.633+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 msgr2=0x7f848810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:36:57.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.633+0000 7f848ce83700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 secure :-1 s=READY pgs=3000 cs=0 l=1 rev1=1 rx=0x7f847c0026d0 tx=0x7f847c009de0).stop 2022-02-02T21:36:57.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 shutdown_connections 2022-02-02T21:36:57.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8470064e20 0x7f84700672e0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84880f5430 0x7f8488109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 --2- 172.21.15.96:0/1464643207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84880f66d0 0x7f848810bf50 unknown :-1 s=CLOSED pgs=3000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:36:57.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 >> 172.21.15.96:0/1464643207 conn(0x7f84880f0b90 msgr2=0x7f84880fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:36:57.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 shutdown_connections 2022-02-02T21:36:57.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:36:57.634+0000 7f848ce83700 1 -- 172.21.15.96:0/1464643207 wait complete. 2022-02-02T21:36:57.653 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:36:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:57 smithi159 ceph-mon[69013]: pgmap v5845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1989378484' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:36:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:58 smithi159 ceph-mon[69013]: from='client.40098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:58 smithi159 ceph-mon[69013]: from='client.40102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:58.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1464643207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:36:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:58 smithi096 ceph-mon[101353]: from='client.40098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:58 smithi096 ceph-mon[101353]: from='client.40102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:36:58.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1464643207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:36:59.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:36:59 smithi159 ceph-mon[69013]: pgmap v5846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:36:59.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:36:59 smithi096 ceph-mon[101353]: pgmap v5846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:01 smithi159 ceph-mon[69013]: pgmap v5847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:01.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:01 smithi096 ceph-mon[101353]: pgmap v5847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:02 smithi159 ceph-mon[69013]: pgmap v5848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:02 smithi096 ceph-mon[101353]: pgmap v5848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:05.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:05 smithi159 ceph-mon[69013]: pgmap v5849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:05 smithi096 ceph-mon[101353]: pgmap v5849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:07 smithi159 ceph-mon[69013]: pgmap v5850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:07 smithi096 ceph-mon[101353]: pgmap v5850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:08 smithi159 ceph-mon[69013]: pgmap v5851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:08 smithi096 ceph-mon[101353]: pgmap v5851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:11.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:11 smithi159 ceph-mon[69013]: pgmap v5852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:11 smithi096 ceph-mon[101353]: pgmap v5852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:13 smithi096 ceph-mon[101353]: pgmap v5853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:13.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:13 smithi159 ceph-mon[69013]: pgmap v5853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:15 smithi159 ceph-mon[69013]: pgmap v5854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:15 smithi096 ceph-mon[101353]: pgmap v5854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:17 smithi159 ceph-mon[69013]: pgmap v5855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:17.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:17 smithi096 ceph-mon[101353]: pgmap v5855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:18 smithi159 ceph-mon[69013]: pgmap v5856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:18 smithi096 ceph-mon[101353]: pgmap v5856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:21.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:21 smithi159 ceph-mon[69013]: pgmap v5857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:21.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:21 smithi096 ceph-mon[101353]: pgmap v5857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:23 smithi096 ceph-mon[101353]: pgmap v5858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:23 smithi159 ceph-mon[69013]: pgmap v5858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:25 smithi159 ceph-mon[69013]: pgmap v5859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:25 smithi096 ceph-mon[101353]: pgmap v5859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 -- 172.21.15.96:0/481607831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806b9c0 msgr2=0x7f2238069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 --2- 172.21.15.96:0/481607831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806b9c0 0x7f2238069ec0 secure :-1 s=READY pgs=3001 cs=0 l=1 rev1=1 rx=0x7f2228004660 tx=0x7f2228009b30).stop 2022-02-02T21:37:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 -- 172.21.15.96:0/481607831 shutdown_connections 2022-02-02T21:37:27.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 --2- 172.21.15.96:0/481607831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806a3b0 0x7f223806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 --2- 172.21.15.96:0/481607831 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806b9c0 0x7f2238069ec0 unknown :-1 s=CLOSED pgs=3001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 -- 172.21.15.96:0/481607831 >> 172.21.15.96:0/481607831 conn(0x7f22380f1e40 msgr2=0x7f22380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:27.753 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:27 smithi096 ceph-mon[101353]: pgmap v5860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 -- 172.21.15.96:0/481607831 shutdown_connections 2022-02-02T21:37:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.750+0000 7f223f3ed700 1 -- 172.21.15.96:0/481607831 wait complete. 2022-02-02T21:37:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 Processor -- start 2022-02-02T21:37:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 -- start start 2022-02-02T21:37:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 0x7f223810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223810df80 con 0x7f223806a3b0 2022-02-02T21:37:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223f3ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223810e0c0 con 0x7f223806b9c0 2022-02-02T21:37:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43826/0 (socket says 172.21.15.96:43826) 2022-02-02T21:37:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 -- 172.21.15.96:0/1580401084 learned_addr learned my addr 172.21.15.96:0/1580401084 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223c988700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 0x7f223810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 -- 172.21.15.96:0/1580401084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 msgr2=0x7f223810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 0x7f223810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223d189700 1 -- 172.21.15.96:0/1580401084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228005040 con 0x7f223806a3b0 2022-02-02T21:37:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.751+0000 7f223c988700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 0x7f223810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:37:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f223d189700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 secure :-1 s=READY pgs=3002 cs=0 l=1 rev1=1 rx=0x7f2228009990 tx=0x7f2228009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2228018070 con 0x7f223806a3b0 2022-02-02T21:37:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223810ea00 con 0x7f223806a3b0 2022-02-02T21:37:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2228007ba0 con 0x7f223806a3b0 2022-02-02T21:37:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222801c3c0 con 0x7f223806a3b0 2022-02-02T21:37:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.752+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223810ef60 con 0x7f223806a3b0 2022-02-02T21:37:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.753+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2238045ad0 con 0x7f223806a3b0 2022-02-02T21:37:27.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.754+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f222801d420 con 0x7f223806a3b0 2022-02-02T21:37:27.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.754+0000 7f222dffb700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 0x7f2224067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:27.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.754+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2228083740 con 0x7f223806a3b0 2022-02-02T21:37:27.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.754+0000 7f223c988700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 0x7f2224067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:27.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.754+0000 7f223c988700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 0x7f2224067290 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f2234009740 tx=0x7f2234009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:27.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.758+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22280552d0 con 0x7f223806a3b0 2022-02-02T21:37:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:27 smithi159 ceph-mon[69013]: pgmap v5860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:27.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.936+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2238105610 con 0x7f2224064dd0 2022-02-02T21:37:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.937+0000 7f222dffb700 1 -- 172.21.15.96:0/1580401084 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2238105610 con 0x7f2224064dd0 2022-02-02T21:37:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 msgr2=0x7f2224067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 0x7f2224067290 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f2234009740 tx=0x7f2234009be0).stop 2022-02-02T21:37:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 msgr2=0x7f223810d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 secure :-1 s=READY pgs=3002 cs=0 l=1 rev1=1 rx=0x7f2228009990 tx=0x7f2228009b30).stop 2022-02-02T21:37:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 shutdown_connections 2022-02-02T21:37:27.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2224064dd0 0x7f2224067290 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223806a3b0 0x7f223810d4e0 unknown :-1 s=CLOSED pgs=3002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 --2- 172.21.15.96:0/1580401084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f223806b9c0 0x7f223810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:27.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 >> 172.21.15.96:0/1580401084 conn(0x7f22380f1e40 msgr2=0x7f22380f89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:27.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 shutdown_connections 2022-02-02T21:37:27.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:27.939+0000 7f223f3ed700 1 -- 172.21.15.96:0/1580401084 wait complete. 2022-02-02T21:37:27.950 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:37:28.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 -- 172.21.15.96:0/3895931747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 msgr2=0x7fce140f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 --2- 172.21.15.96:0/3895931747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce140f63e0 secure :-1 s=READY pgs=3003 cs=0 l=1 rev1=1 rx=0x7fce08004660 tx=0x7fce08009b30).stop 2022-02-02T21:37:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 -- 172.21.15.96:0/3895931747 shutdown_connections 2022-02-02T21:37:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 --2- 172.21.15.96:0/3895931747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce140f63e0 unknown :-1 s=CLOSED pgs=3003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 --2- 172.21.15.96:0/3895931747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 0x7fce140f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 -- 172.21.15.96:0/3895931747 >> 172.21.15.96:0/3895931747 conn(0x7fce140f04c0 msgr2=0x7fce140f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 -- 172.21.15.96:0/3895931747 shutdown_connections 2022-02-02T21:37:28.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.036+0000 7fce19ab2700 1 -- 172.21.15.96:0/3895931747 wait complete. 2022-02-02T21:37:28.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 Processor -- start 2022-02-02T21:37:28.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 -- start start 2022-02-02T21:37:28.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 0x7fce14109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140fbfd0 con 0x7fce140f5f60 2022-02-02T21:37:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.037+0000 7fce19ab2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140fc110 con 0x7fce140f4d60 2022-02-02T21:37:28.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43838/0 (socket says 172.21.15.96:43838) 2022-02-02T21:37:28.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 -- 172.21.15.96:0/1829889119 learned_addr learned my addr 172.21.15.96:0/1829889119 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:28.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce137fe700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 0x7fce14109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 -- 172.21.15.96:0/1829889119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 msgr2=0x7fce14109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 0x7fce14109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 -- 172.21.15.96:0/1829889119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08005040 con 0x7fce140f5f60 2022-02-02T21:37:28.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce12ffd700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 secure :-1 s=READY pgs=3004 cs=0 l=1 rev1=1 rx=0x7fce08009990 tx=0x7fce08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce08018070 con 0x7fce140f5f60 2022-02-02T21:37:28.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce08007ba0 con 0x7fce140f5f60 2022-02-02T21:37:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1410c730 con 0x7fce140f5f60 2022-02-02T21:37:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce0801c3c0 con 0x7fce140f5f60 2022-02-02T21:37:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.038+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1410cc60 con 0x7fce140f5f60 2022-02-02T21:37:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.039+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce14045ad0 con 0x7fce140f5f60 2022-02-02T21:37:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.040+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce0801d420 con 0x7fce140f5f60 2022-02-02T21:37:28.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.040+0000 7fcdfbfff700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 0x7fcdfc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.040+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce08083760 con 0x7fce140f5f60 2022-02-02T21:37:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.040+0000 7fce137fe700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 0x7fcdfc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.041+0000 7fce137fe700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 0x7fcdfc067290 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fce04007fd0 tx=0x7fce04009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.044+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce08051860 con 0x7fce140f5f60 2022-02-02T21:37:28.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.218+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce140fdee0 con 0x7fcdfc064dd0 2022-02-02T21:37:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.228+0000 7fcdfbfff700 1 -- 172.21.15.96:0/1829889119 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fce140fdee0 con 0x7fcdfc064dd0 2022-02-02T21:37:28.229 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:37:28.229 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:37:28.229 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:37:28.230 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:37:28.230 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:37:28.231 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:37:28.231 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:37:28.232 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:37:28.232 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:37:28.233 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:37:28.233 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:37:28.233 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:37:28.234 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:37:28.234 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:37:28.234 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:37:28.235 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:37:28.235 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:37:28.235 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:37:28.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:37:28.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:37:28.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:37:28.237 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:37:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.229+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 msgr2=0x7fcdfc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.229+0000 7fce19ab2700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 0x7fcdfc067290 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fce04007fd0 tx=0x7fce04009040).stop 2022-02-02T21:37:28.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.229+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 msgr2=0x7fce1410c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.229+0000 7fce19ab2700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 secure :-1 s=READY pgs=3004 cs=0 l=1 rev1=1 rx=0x7fce08009990 tx=0x7fce08009b30).stop 2022-02-02T21:37:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 shutdown_connections 2022-02-02T21:37:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcdfc064dd0 0x7fcdfc067290 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce140f4d60 0x7fce14109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 --2- 172.21.15.96:0/1829889119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce140f5f60 0x7fce1410c1e0 unknown :-1 s=CLOSED pgs=3004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 >> 172.21.15.96:0/1829889119 conn(0x7fce140f04c0 msgr2=0x7fce140f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 shutdown_connections 2022-02-02T21:37:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.230+0000 7fce19ab2700 1 -- 172.21.15.96:0/1829889119 wait complete. 2022-02-02T21:37:28.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 -- 172.21.15.96:0/2916319173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 msgr2=0x7fa8300f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 --2- 172.21.15.96:0/2916319173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300f6960 secure :-1 s=READY pgs=3005 cs=0 l=1 rev1=1 rx=0x7fa820004660 tx=0x7fa820009b30).stop 2022-02-02T21:37:28.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 -- 172.21.15.96:0/2916319173 shutdown_connections 2022-02-02T21:37:28.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 --2- 172.21.15.96:0/2916319173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300f6960 unknown :-1 s=CLOSED pgs=3005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 --2- 172.21.15.96:0/2916319173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 0x7fa8300f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 -- 172.21.15.96:0/2916319173 >> 172.21.15.96:0/2916319173 conn(0x7fa8300f0540 msgr2=0x7fa8300f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 -- 172.21.15.96:0/2916319173 shutdown_connections 2022-02-02T21:37:28.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.327+0000 7fa83548d700 1 -- 172.21.15.96:0/2916319173 wait complete. 2022-02-02T21:37:28.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 Processor -- start 2022-02-02T21:37:28.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 -- start start 2022-02-02T21:37:28.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 0x7fa8300f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300f56a0 con 0x7fa8300f64e0 2022-02-02T21:37:28.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa83548d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300f57e0 con 0x7fa8300f5bd0 2022-02-02T21:37:28.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43848/0 (socket says 172.21.15.96:43848) 2022-02-02T21:37:28.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 -- 172.21.15.96:0/2300818025 learned_addr learned my addr 172.21.15.96:0/2300818025 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:28.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82effd700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 0x7fa8300f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 -- 172.21.15.96:0/2300818025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 msgr2=0x7fa8300f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 0x7fa8300f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.328+0000 7fa82e7fc700 1 -- 172.21.15.96:0/2300818025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820005040 con 0x7fa8300f64e0 2022-02-02T21:37:28.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa82e7fc700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 secure :-1 s=READY pgs=3006 cs=0 l=1 rev1=1 rx=0x7fa820009990 tx=0x7fa820009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa820018070 con 0x7fa8300f64e0 2022-02-02T21:37:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa830068de0 con 0x7fa8300f64e0 2022-02-02T21:37:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa820007ba0 con 0x7fa8300f64e0 2022-02-02T21:37:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82001c3c0 con 0x7fa8300f64e0 2022-02-02T21:37:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.329+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa830069340 con 0x7fa8300f64e0 2022-02-02T21:37:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.330+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830045ad0 con 0x7fa8300f64e0 2022-02-02T21:37:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.330+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa82001d420 con 0x7fa8300f64e0 2022-02-02T21:37:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.331+0000 7fa8277fe700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 0x7fa81c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.331+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa820083740 con 0x7fa8300f64e0 2022-02-02T21:37:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.331+0000 7fa82effd700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 0x7fa81c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.331+0000 7fa82effd700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 0x7fa81c067290 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fa8300f4f40 tx=0x7fa818009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.335+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8200518a0 con 0x7fa8300f64e0 2022-02-02T21:37:28.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.567+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa830027a00 con 0x7fa8300f64e0 2022-02-02T21:37:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.568+0000 7fa8277fe700 1 -- 172.21.15.96:0/2300818025 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa820054ec0 con 0x7fa8300f64e0 2022-02-02T21:37:28.569 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:37:28.569 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:37:28.569 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:37:28.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:28.570 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:37:28.571 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:37:28.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:28.572 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:37:28.572 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:37:28.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:28.573 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:37:28.573 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:37:28.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:28.574 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:37:28.575 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:37:28.575 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:37:28.575 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:37:28.576 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:37:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 msgr2=0x7fa81c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 0x7fa81c067290 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fa8300f4f40 tx=0x7fa818009be0).stop 2022-02-02T21:37:28.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 msgr2=0x7fa8300688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 secure :-1 s=READY pgs=3006 cs=0 l=1 rev1=1 rx=0x7fa820009990 tx=0x7fa820009b30).stop 2022-02-02T21:37:28.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 shutdown_connections 2022-02-02T21:37:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa81c064dd0 0x7fa81c067290 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8300f5bd0 0x7fa8300f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 --2- 172.21.15.96:0/2300818025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8300f64e0 0x7fa8300688f0 unknown :-1 s=CLOSED pgs=3006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.569+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 >> 172.21.15.96:0/2300818025 conn(0x7fa8300f0540 msgr2=0x7fa8300fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.570+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 shutdown_connections 2022-02-02T21:37:28.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.570+0000 7fa83548d700 1 -- 172.21.15.96:0/2300818025 wait complete. 2022-02-02T21:37:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 -- 172.21.15.96:0/192619128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f6530 msgr2=0x7faadc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 --2- 172.21.15.96:0/192619128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f6530 0x7faadc0f6950 secure :-1 s=READY pgs=3007 cs=0 l=1 rev1=1 rx=0x7faacc004660 tx=0x7faacc009b30).stop 2022-02-02T21:37:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 -- 172.21.15.96:0/192619128 shutdown_connections 2022-02-02T21:37:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 --2- 172.21.15.96:0/192619128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f77d0 0x7faadc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 --2- 172.21.15.96:0/192619128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f6530 0x7faadc0f6950 unknown :-1 s=CLOSED pgs=3007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 -- 172.21.15.96:0/192619128 >> 172.21.15.96:0/192619128 conn(0x7faadc0f1c90 msgr2=0x7faadc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 -- 172.21.15.96:0/192619128 shutdown_connections 2022-02-02T21:37:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.669+0000 7faae0e44700 1 -- 172.21.15.96:0/192619128 wait complete. 2022-02-02T21:37:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 Processor -- start 2022-02-02T21:37:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 -- start start 2022-02-02T21:37:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f6530 0x7faadc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc06a380 con 0x7faadc0f77d0 2022-02-02T21:37:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faae0e44700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc06a4c0 con 0x7faadc0f6530 2022-02-02T21:37:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faadaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faadaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43858/0 (socket says 172.21.15.96:43858) 2022-02-02T21:37:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faadaffd700 1 -- 172.21.15.96:0/3687901862 learned_addr learned my addr 172.21.15.96:0/3687901862 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.670+0000 7faadb7fe700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f6530 0x7faadc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faadaffd700 1 -- 172.21.15.96:0/3687901862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f6530 msgr2=0x7faadc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faadaffd700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f6530 0x7faadc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faadaffd700 1 -- 172.21.15.96:0/3687901862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc005040 con 0x7faadc0f77d0 2022-02-02T21:37:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faadaffd700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 secure :-1 s=READY pgs=3008 cs=0 l=1 rev1=1 rx=0x7faad000e7f0 tx=0x7faad000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad00092e0 con 0x7faadc0f77d0 2022-02-02T21:37:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faad000f040 con 0x7faadc0f77d0 2022-02-02T21:37:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc06a7a0 con 0x7faadc0f77d0 2022-02-02T21:37:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad0014750 con 0x7faadc0f77d0 2022-02-02T21:37:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.671+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc10ed50 con 0x7faadc0f77d0 2022-02-02T21:37:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.672+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc045ad0 con 0x7faadc0f77d0 2022-02-02T21:37:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.672+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faad001b030 con 0x7faadc0f77d0 2022-02-02T21:37:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.673+0000 7faac3fff700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 0x7faac40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.673+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faad0081830 con 0x7faadc0f77d0 2022-02-02T21:37:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.673+0000 7faadb7fe700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 0x7faac40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.673+0000 7faadb7fe700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 0x7faac40672e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7faacc000c00 tx=0x7faacc016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:28.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.677+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faad004f9e0 con 0x7faadc0f77d0 2022-02-02T21:37:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.881+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faadc027a00 con 0x7faadc0f77d0 2022-02-02T21:37:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.881+0000 7faac3fff700 1 -- 172.21.15.96:0/3687901862 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7faad0053000 con 0x7faadc0f77d0 2022-02-02T21:37:28.883 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:37:28.884 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:37:28.884 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:37:28.885 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:37:28.886 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:37:28.886 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:37:28.887 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:37:28.888 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:37:28.888 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:37:28.889 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:37:28.889 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:37:28.889 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:37:28.890 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:37:28.890 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:37:28.891 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:37:28.891 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:37:28.892 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:37:28.893 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:37:28.893 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:37:28.894 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:37:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:37:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:37:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:37:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:37:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:37:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:37:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:37:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:37:28.898 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:37:28.899 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:37:28.899 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:37:28.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:37:28.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:37:28.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:37:28.901 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:37:28.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:37:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:37:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:37:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:37:28.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 msgr2=0x7faac40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 0x7faac40672e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7faacc000c00 tx=0x7faacc016040).stop 2022-02-02T21:37:28.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 msgr2=0x7faadc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:28.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 secure :-1 s=READY pgs=3008 cs=0 l=1 rev1=1 rx=0x7faad000e7f0 tx=0x7faad000b040).stop 2022-02-02T21:37:28.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 shutdown_connections 2022-02-02T21:37:28.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faac4064e20 0x7faac40672e0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faadc0f6530 0x7faadc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 --2- 172.21.15.96:0/3687901862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faadc0f77d0 0x7faadc069e20 unknown :-1 s=CLOSED pgs=3008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 >> 172.21.15.96:0/3687901862 conn(0x7faadc0f1c90 msgr2=0x7faadc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 shutdown_connections 2022-02-02T21:37:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:28.883+0000 7faae0e44700 1 -- 172.21.15.96:0/3687901862 wait complete. 2022-02-02T21:37:28.910 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:37:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:37:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:37:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: from='client.40114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:37:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: from='client.40118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:37:29.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: pgmap v5861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:29.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2300818025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:37:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:37:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:37:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: from='client.40114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:37:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: from='client.40118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:37:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: pgmap v5861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:29.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2300818025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:37:30.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3687901862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:37:30.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3687901862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:37:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:30 smithi159 ceph-mon[69013]: pgmap v5862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:30 smithi096 ceph-mon[101353]: pgmap v5862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:33 smithi096 ceph-mon[101353]: pgmap v5863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:33 smithi159 ceph-mon[69013]: pgmap v5863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:35.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:35 smithi159 ceph-mon[69013]: pgmap v5864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:35.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:35 smithi096 ceph-mon[101353]: pgmap v5864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:37 smithi159 ceph-mon[69013]: pgmap v5865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:37 smithi096 ceph-mon[101353]: pgmap v5865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:38 smithi159 ceph-mon[69013]: pgmap v5866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:38 smithi096 ceph-mon[101353]: pgmap v5866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:41 smithi159 ceph-mon[69013]: pgmap v5867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:41 smithi096 ceph-mon[101353]: pgmap v5867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:43 smithi096 ceph-mon[101353]: pgmap v5868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:43.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:43 smithi159 ceph-mon[69013]: pgmap v5868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:45 smithi159 ceph-mon[69013]: pgmap v5869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:45.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:45 smithi096 ceph-mon[101353]: pgmap v5869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:47 smithi159 ceph-mon[69013]: pgmap v5870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:47 smithi096 ceph-mon[101353]: pgmap v5870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:48 smithi159 ceph-mon[69013]: pgmap v5871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:48 smithi096 ceph-mon[101353]: pgmap v5871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:51 smithi159 ceph-mon[69013]: pgmap v5872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:51 smithi096 ceph-mon[101353]: pgmap v5872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:53 smithi096 ceph-mon[101353]: pgmap v5873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:53.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:53 smithi159 ceph-mon[69013]: pgmap v5873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:55 smithi159 ceph-mon[69013]: pgmap v5874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:55 smithi096 ceph-mon[101353]: pgmap v5874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:57 smithi159 ceph-mon[69013]: pgmap v5875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:57 smithi096 ceph-mon[101353]: pgmap v5875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:58.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 -- 172.21.15.96:0/2083158692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 msgr2=0x7f30480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:58.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 --2- 172.21.15.96:0/2083158692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f30480f6cc0 secure :-1 s=READY pgs=3009 cs=0 l=1 rev1=1 rx=0x7f3044004660 tx=0x7f3044009b30).stop 2022-02-02T21:37:58.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 -- 172.21.15.96:0/2083158692 shutdown_connections 2022-02-02T21:37:58.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 --2- 172.21.15.96:0/2083158692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f30480f6cc0 unknown :-1 s=CLOSED pgs=3009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:58.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 --2- 172.21.15.96:0/2083158692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 0x7f30480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:58.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.993+0000 7f304f880700 1 -- 172.21.15.96:0/2083158692 >> 172.21.15.96:0/2083158692 conn(0x7f30480f0d40 msgr2=0x7f30480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:58.996 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:58 smithi096 ceph-mon[101353]: pgmap v5876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:58.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 -- 172.21.15.96:0/2083158692 shutdown_connections 2022-02-02T21:37:58.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 -- 172.21.15.96:0/2083158692 wait complete. 2022-02-02T21:37:59.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 Processor -- start 2022-02-02T21:37:59.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 -- start start 2022-02-02T21:37:59.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 0x7f304810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480602d0 con 0x7f30480f6860 2022-02-02T21:37:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.994+0000 7f304f880700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3048060410 con 0x7f30480f55c0 2022-02-02T21:37:59.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43880/0 (socket says 172.21.15.96:43880) 2022-02-02T21:37:59.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 -- 172.21.15.96:0/937332248 learned_addr learned my addr 172.21.15.96:0/937332248 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:59.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304d61c700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 0x7f304810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 -- 172.21.15.96:0/937332248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 msgr2=0x7f304810c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 0x7f304810c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 -- 172.21.15.96:0/937332248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044005040 con 0x7f30480f6860 2022-02-02T21:37:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304ce1b700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 secure :-1 s=READY pgs=3010 cs=0 l=1 rev1=1 rx=0x7f3044009990 tx=0x7f3044009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3044018070 con 0x7f30480f6860 2022-02-02T21:37:59.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3044007ca0 con 0x7f30480f6860 2022-02-02T21:37:59.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304810ea40 con 0x7f30480f6860 2022-02-02T21:37:59.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.995+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304401c620 con 0x7f30480f6860 2022-02-02T21:37:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.996+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304810ee10 con 0x7f30480f6860 2022-02-02T21:37:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.997+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30480f49b0 con 0x7f30480f6860 2022-02-02T21:37:59.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.997+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f304401d960 con 0x7f30480f6860 2022-02-02T21:37:59.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.997+0000 7f303dffb700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 0x7f3034067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.997+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f30440837d0 con 0x7f30480f6860 2022-02-02T21:37:59.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.997+0000 7f304d61c700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 0x7f3034067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:58.998+0000 7f304d61c700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 0x7f3034067290 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f3048060060 tx=0x7f3038009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.002+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3044051a40 con 0x7f30480f6860 2022-02-02T21:37:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:58 smithi159 ceph-mon[69013]: pgmap v5876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:37:59.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.184+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30480fde70 con 0x7f3034064dd0 2022-02-02T21:37:59.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.185+0000 7f303dffb700 1 -- 172.21.15.96:0/937332248 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f30480fde70 con 0x7f3034064dd0 2022-02-02T21:37:59.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 msgr2=0x7f3034067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 0x7f3034067290 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f3048060060 tx=0x7f3038009040).stop 2022-02-02T21:37:59.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 msgr2=0x7f304810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 secure :-1 s=READY pgs=3010 cs=0 l=1 rev1=1 rx=0x7f3044009990 tx=0x7f3044009b30).stop 2022-02-02T21:37:59.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 shutdown_connections 2022-02-02T21:37:59.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3034064dd0 0x7f3034067290 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30480f55c0 0x7f304810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 --2- 172.21.15.96:0/937332248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30480f6860 0x7f304810e550 unknown :-1 s=CLOSED pgs=3010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 >> 172.21.15.96:0/937332248 conn(0x7f30480f0d40 msgr2=0x7f30480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 shutdown_connections 2022-02-02T21:37:59.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.187+0000 7f304f880700 1 -- 172.21.15.96:0/937332248 wait complete. 2022-02-02T21:37:59.197 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:37:59.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 -- 172.21.15.96:0/3372577330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f66d0 msgr2=0x7f04ec0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3372577330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f66d0 0x7f04ec0f6b30 secure :-1 s=READY pgs=3011 cs=0 l=1 rev1=1 rx=0x7f04e0004660 tx=0x7f04e0009b30).stop 2022-02-02T21:37:59.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 -- 172.21.15.96:0/3372577330 shutdown_connections 2022-02-02T21:37:59.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3372577330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f66d0 0x7f04ec0f6b30 unknown :-1 s=CLOSED pgs=3011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3372577330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f5430 0x7f04ec0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:37:59.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 -- 172.21.15.96:0/3372577330 >> 172.21.15.96:0/3372577330 conn(0x7f04ec0f0b90 msgr2=0x7f04ec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.284+0000 7f04eb59e700 1 -- 172.21.15.96:0/3372577330 shutdown_connections 2022-02-02T21:37:59.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 -- 172.21.15.96:0/3372577330 wait complete. 2022-02-02T21:37:59.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 Processor -- start 2022-02-02T21:37:59.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 -- start start 2022-02-02T21:37:59.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f66d0 0x7f04ec10e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec0602d0 con 0x7f04ec0f5430 2022-02-02T21:37:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04eb59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec060410 con 0x7f04ec0f66d0 2022-02-02T21:37:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.285+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43888/0 (socket says 172.21.15.96:43888) 2022-02-02T21:37:59.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 -- 172.21.15.96:0/3330971027 learned_addr learned my addr 172.21.15.96:0/3330971027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:59.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04e9d9b700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f66d0 0x7f04ec10e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 -- 172.21.15.96:0/3330971027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f66d0 msgr2=0x7f04ec10e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f66d0 0x7f04ec10e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 -- 172.21.15.96:0/3330971027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04ec0f5430 2022-02-02T21:37:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04ea59c700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 rx=0x7f04dc0093f0 tx=0x7f04dc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04dc009ea0 con 0x7f04ec0f5430 2022-02-02T21:37:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f04dc013af0 con 0x7f04ec0f5430 2022-02-02T21:37:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec10e880 con 0x7f04ec0f5430 2022-02-02T21:37:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04dc00db10 con 0x7f04ec0f5430 2022-02-02T21:37:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.286+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec10ed90 con 0x7f04ec0f5430 2022-02-02T21:37:59.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.287+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ec059100 con 0x7f04ec0f5430 2022-02-02T21:37:59.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.288+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f04dc01a060 con 0x7f04ec0f5430 2022-02-02T21:37:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.288+0000 7f04daffd700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 0x7f04d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.288+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f04dc081ab0 con 0x7f04ec0f5430 2022-02-02T21:37:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.288+0000 7f04e9d9b700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 0x7f04d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.288+0000 7f04e9d9b700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 0x7f04d40672e0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f04e0004e30 tx=0x7f04e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.292+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f04dc04fbb0 con 0x7f04ec0f5430 2022-02-02T21:37:59.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.468+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04ec0008d0 con 0x7f04d4064e20 2022-02-02T21:37:59.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.478+0000 7f04daffd700 1 -- 172.21.15.96:0/3330971027 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f04ec0008d0 con 0x7f04d4064e20 2022-02-02T21:37:59.478 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:37:59.479 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:37:59.480 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:37:59.480 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:37:59.480 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:37:59.481 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:37:59.481 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:37:59.481 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:37:59.482 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:37:59.482 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:37:59.482 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:37:59.483 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:37:59.483 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:37:59.483 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:37:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:37:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:37:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:37:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:37:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:37:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:37:59.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:37:59.486 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:37:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.479+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 msgr2=0x7f04d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.479+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 0x7f04d40672e0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f04e0004e30 tx=0x7f04e0009b30).stop 2022-02-02T21:37:59.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.479+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 msgr2=0x7f04ec10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.479+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 rx=0x7f04dc0093f0 tx=0x7f04dc006ec0).stop 2022-02-02T21:37:59.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.479+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 shutdown_connections 2022-02-02T21:37:59.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d4064e20 0x7f04d40672e0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04ec0f5430 0x7f04ec10be90 unknown :-1 s=CLOSED pgs=3012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 --2- 172.21.15.96:0/3330971027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04ec0f66d0 0x7f04ec10e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 >> 172.21.15.96:0/3330971027 conn(0x7f04ec0f0b90 msgr2=0x7f04ec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 shutdown_connections 2022-02-02T21:37:59.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.480+0000 7f04eb59e700 1 -- 172.21.15.96:0/3330971027 wait complete. 2022-02-02T21:37:59.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 -- 172.21.15.96:0/4036100024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 msgr2=0x7f01480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 --2- 172.21.15.96:0/4036100024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f01480f7c30 secure :-1 s=READY pgs=3013 cs=0 l=1 rev1=1 rx=0x7f013c004660 tx=0x7f013c009b30).stop 2022-02-02T21:37:59.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 -- 172.21.15.96:0/4036100024 shutdown_connections 2022-02-02T21:37:59.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 --2- 172.21.15.96:0/4036100024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f01480f7c30 unknown :-1 s=CLOSED pgs=3013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 --2- 172.21.15.96:0/4036100024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6530 0x7f01480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:37:59.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.576+0000 7f014759e700 1 -- 172.21.15.96:0/4036100024 >> 172.21.15.96:0/4036100024 conn(0x7f01480f1c90 msgr2=0x7f01480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 -- 172.21.15.96:0/4036100024 shutdown_connections 2022-02-02T21:37:59.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 -- 172.21.15.96:0/4036100024 wait complete. 2022-02-02T21:37:59.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 Processor -- start 2022-02-02T21:37:59.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 -- start start 2022-02-02T21:37:59.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6530 0x7f014806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806a410 con 0x7f01480f77d0 2022-02-02T21:37:59.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f014759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806a550 con 0x7f01480f6530 2022-02-02T21:37:59.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f0145d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f0145d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43900/0 (socket says 172.21.15.96:43900) 2022-02-02T21:37:59.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.577+0000 7f0145d9b700 1 -- 172.21.15.96:0/2273679 learned_addr learned my addr 172.21.15.96:0/2273679 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:59.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0145d9b700 1 -- 172.21.15.96:0/2273679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6530 msgr2=0x7f014806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0145d9b700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6530 0x7f014806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:37:59.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0145d9b700 1 -- 172.21.15.96:0/2273679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c005040 con 0x7f01480f77d0 2022-02-02T21:37:59.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0145d9b700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 rx=0x7f013c009990 tx=0x7f013c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f013c018070 con 0x7f01480f77d0 2022-02-02T21:37:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f013c007ca0 con 0x7f01480f77d0 2022-02-02T21:37:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f013c01c620 con 0x7f01480f77d0 2022-02-02T21:37:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014806a7d0 con 0x7f01480f77d0 2022-02-02T21:37:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.578+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014810edc0 con 0x7f01480f77d0 2022-02-02T21:37:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.579+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148045ad0 con 0x7f01480f77d0 2022-02-02T21:37:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.579+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f013c01d960 con 0x7f01480f77d0 2022-02-02T21:37:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.580+0000 7f0136ffd700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 0x7f01300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.580+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f013c083700 con 0x7f01480f77d0 2022-02-02T21:37:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.580+0000 7f014659c700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 0x7f01300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.580+0000 7f014659c700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 0x7f01300672e0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f014806b730 tx=0x7f0138006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.584+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f013c051800 con 0x7f01480f77d0 2022-02-02T21:37:59.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.813+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01480586e0 con 0x7f01480f77d0 2022-02-02T21:37:59.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.814+0000 7f0136ffd700 1 -- 172.21.15.96:0/2273679 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f013c054e20 con 0x7f01480f77d0 2022-02-02T21:37:59.815 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:37:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:37:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:37:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:37:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:37:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:37:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:37:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:37:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:37:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:37:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:37:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:37:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:37:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:37:59.821 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:37:59.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 msgr2=0x7f01300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 0x7f01300672e0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f014806b730 tx=0x7f0138006ab0).stop 2022-02-02T21:37:59.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 msgr2=0x7f0148069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 rx=0x7f013c009990 tx=0x7f013c009b30).stop 2022-02-02T21:37:59.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 shutdown_connections 2022-02-02T21:37:59.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0130064e20 0x7f01300672e0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6530 0x7f014806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:37:59.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 --2- 172.21.15.96:0/2273679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f77d0 0x7f0148069e20 unknown :-1 s=CLOSED pgs=3014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 >> 172.21.15.96:0/2273679 conn(0x7f01480f1c90 msgr2=0x7f01480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 shutdown_connections 2022-02-02T21:37:59.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.815+0000 7f014759e700 1 -- 172.21.15.96:0/2273679 wait complete. 2022-02-02T21:37:59.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 -- 172.21.15.96:0/3489659942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec0f9830 msgr2=0x7fc2ec0fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/3489659942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec0fbc80 secure :-1 s=READY pgs=3015 cs=0 l=1 rev1=1 rx=0x7fc2e8004660 tx=0x7fc2e8009b30).stop 2022-02-02T21:37:59.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 -- 172.21.15.96:0/3489659942 shutdown_connections 2022-02-02T21:37:59.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/3489659942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec0fbc80 unknown :-1 s=CLOSED pgs=3015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/3489659942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec060270 0x7fc2ec0f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:37:59.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 -- 172.21.15.96:0/3489659942 >> 172.21.15.96:0/3489659942 conn(0x7fc2ec0f0d40 msgr2=0x7fc2ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:37:59.916 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:37:59 smithi096 ceph-mon[101353]: from='client.40130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:37:59.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.913+0000 7fc2f37e4700 1 -- 172.21.15.96:0/3489659942 shutdown_connections 2022-02-02T21:37:59.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 -- 172.21.15.96:0/3489659942 wait complete. 2022-02-02T21:37:59.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 Processor -- start 2022-02-02T21:37:59.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 -- start start 2022-02-02T21:37:59.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec107a90 con 0x7fc2ec060270 2022-02-02T21:37:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.914+0000 7fc2f37e4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec108340 con 0x7fc2ec0f9830 2022-02-02T21:37:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43908/0 (socket says 172.21.15.96:43908) 2022-02-02T21:37:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 -- 172.21.15.96:0/1104563414 learned_addr learned my addr 172.21.15.96:0/1104563414 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:37:59.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f0d7f700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 -- 172.21.15.96:0/1104563414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 msgr2=0x7fc2ec107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:37:59.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:37:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 -- 172.21.15.96:0/1104563414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8005040 con 0x7fc2ec060270 2022-02-02T21:37:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f0d7f700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:37:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f1580700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 secure :-1 s=READY pgs=3016 cs=0 l=1 rev1=1 rx=0x7fc2dc00b410 tx=0x7fc2dc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc0125f0 con 0x7fc2ec060270 2022-02-02T21:37:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec108620 con 0x7fc2ec060270 2022-02-02T21:37:59.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2dc012c00 con 0x7fc2ec060270 2022-02-02T21:37:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.915+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc002ae0 con 0x7fc2ec060270 2022-02-02T21:37:59.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.916+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec108be0 con 0x7fc2ec060270 2022-02-02T21:37:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.917+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec0f49b0 con 0x7fc2ec060270 2022-02-02T21:37:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.917+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2dc00f030 con 0x7fc2ec060270 2022-02-02T21:37:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.917+0000 7fc2e1ffb700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:37:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.917+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2dc081f10 con 0x7fc2ec060270 2022-02-02T21:37:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.918+0000 7fc2f0d7f700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:37:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.918+0000 7fc2f0d7f700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 0x7fc2d8067290 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fc2e8009da0 tx=0x7fc2e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:37:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:37:59.922+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2dc053a40 con 0x7fc2ec060270 2022-02-02T21:38:00.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:37:59 smithi159 ceph-mon[69013]: from='client.40130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:00.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.120+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2ec0ff000 con 0x7fc2ec060270 2022-02-02T21:38:00.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.121+0000 7fc2e1ffb700 1 -- 172.21.15.96:0/1104563414 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc2dc053630 con 0x7fc2ec060270 2022-02-02T21:38:00.122 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:38:00.122 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:38:00.123 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:38:00.123 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:38:00.123 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:00.124 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:38:00.124 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:38:00.124 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:38:00.125 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:38:00.125 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:38:00.125 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:38:00.125 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:38:00.126 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:38:00.126 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:38:00.127 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:38:00.127 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:38:00.127 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:38:00.128 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:38:00.128 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:38:00.128 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:38:00.129 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:38:00.129 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:38:00.129 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:38:00.130 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:38:00.130 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:38:00.130 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:38:00.131 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:38:00.131 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:38:00.131 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:38:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:38:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:38:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:38:00.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:00.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:00.133 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:38:00.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:00.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:00.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:00.135 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:00.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 msgr2=0x7fc2d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:00.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 0x7fc2d8067290 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fc2e8009da0 tx=0x7fc2e8009b30).stop 2022-02-02T21:38:00.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 msgr2=0x7fc2ec106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:00.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 secure :-1 s=READY pgs=3016 cs=0 l=1 rev1=1 rx=0x7fc2dc00b410 tx=0x7fc2dc006ef0).stop 2022-02-02T21:38:00.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 shutdown_connections 2022-02-02T21:38:00.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:00.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ec060270 0x7fc2ec106f60 unknown :-1 s=CLOSED pgs=3016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:00.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 --2- 172.21.15.96:0/1104563414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2ec0f9830 0x7fc2ec107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:00.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 >> 172.21.15.96:0/1104563414 conn(0x7fc2ec0f0d40 msgr2=0x7fc2ec0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:00.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 shutdown_connections 2022-02-02T21:38:00.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:00.123+0000 7fc2f37e4700 1 -- 172.21.15.96:0/1104563414 wait complete. 2022-02-02T21:38:00.139 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:38:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:00 smithi159 ceph-mon[69013]: from='client.40134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2273679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:38:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1104563414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:38:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:00 smithi159 ceph-mon[69013]: pgmap v5877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:00 smithi096 ceph-mon[101353]: from='client.40134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2273679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:38:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1104563414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:38:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:00 smithi096 ceph-mon[101353]: pgmap v5877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:03 smithi096 ceph-mon[101353]: pgmap v5878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:03 smithi159 ceph-mon[69013]: pgmap v5878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:05 smithi159 ceph-mon[69013]: pgmap v5879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:05 smithi096 ceph-mon[101353]: pgmap v5879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:07 smithi159 ceph-mon[69013]: pgmap v5880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:07 smithi096 ceph-mon[101353]: pgmap v5880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:08 smithi159 ceph-mon[69013]: pgmap v5881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:08 smithi096 ceph-mon[101353]: pgmap v5881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:11.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:11 smithi159 ceph-mon[69013]: pgmap v5882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:11.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:11 smithi096 ceph-mon[101353]: pgmap v5882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:13 smithi096 ceph-mon[101353]: pgmap v5883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:13 smithi159 ceph-mon[69013]: pgmap v5883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:14 smithi159 ceph-mon[69013]: pgmap v5884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:14 smithi096 ceph-mon[101353]: pgmap v5884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:17 smithi159 ceph-mon[69013]: pgmap v5885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:17.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:17 smithi096 ceph-mon[101353]: pgmap v5885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:18 smithi159 ceph-mon[69013]: pgmap v5886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:18 smithi096 ceph-mon[101353]: pgmap v5886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:21.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:21 smithi159 ceph-mon[69013]: pgmap v5887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:21.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:21 smithi096 ceph-mon[101353]: pgmap v5887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:23 smithi096 ceph-mon[101353]: pgmap v5888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:23 smithi159 ceph-mon[69013]: pgmap v5888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:24 smithi159 ceph-mon[69013]: pgmap v5889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:24 smithi096 ceph-mon[101353]: pgmap v5889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:27.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:27 smithi159 ceph-mon[69013]: pgmap v5890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:27.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:27 smithi096 ceph-mon[101353]: pgmap v5890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:38:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:38:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:28 smithi159 ceph-mon[69013]: pgmap v5891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:38:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:38:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:28 smithi096 ceph-mon[101353]: pgmap v5891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:30.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 -- 172.21.15.96:0/532146431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f66e0 msgr2=0x7fb9880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 --2- 172.21.15.96:0/532146431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f66e0 0x7fb9880f6b00 secure :-1 s=READY pgs=3017 cs=0 l=1 rev1=1 rx=0x7fb978004660 tx=0x7fb978009b30).stop 2022-02-02T21:38:30.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 -- 172.21.15.96:0/532146431 shutdown_connections 2022-02-02T21:38:30.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 --2- 172.21.15.96:0/532146431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f7980 0x7fb9880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 --2- 172.21.15.96:0/532146431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f66e0 0x7fb9880f6b00 unknown :-1 s=CLOSED pgs=3017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 -- 172.21.15.96:0/532146431 >> 172.21.15.96:0/532146431 conn(0x7fb9880f1e40 msgr2=0x7fb9880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:30.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 -- 172.21.15.96:0/532146431 shutdown_connections 2022-02-02T21:38:30.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.231+0000 7fb98d023700 1 -- 172.21.15.96:0/532146431 wait complete. 2022-02-02T21:38:30.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.232+0000 7fb98d023700 1 Processor -- start 2022-02-02T21:38:30.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.232+0000 7fb98d023700 1 -- start start 2022-02-02T21:38:30.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98d023700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f66e0 0x7fb988106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98d023700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98d023700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988107a50 con 0x7fb9880f7980 2022-02-02T21:38:30.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98d023700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988107b90 con 0x7fb9880f66e0 2022-02-02T21:38:30.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43946/0 (socket says 172.21.15.96:43946) 2022-02-02T21:38:30.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 -- 172.21.15.96:0/3640170970 learned_addr learned my addr 172.21.15.96:0/3640170970 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:38:30.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb986d9d700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f66e0 0x7fb988106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 -- 172.21.15.96:0/3640170970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f66e0 msgr2=0x7fb988106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f66e0 0x7fb988106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 -- 172.21.15.96:0/3640170970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978005040 con 0x7fb9880f7980 2022-02-02T21:38:30.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98659c700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 secure :-1 s=READY pgs=3018 cs=0 l=1 rev1=1 rx=0x7fb97c0026d0 tx=0x7fb97c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97c0079c0 con 0x7fb9880f7980 2022-02-02T21:38:30.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988108530 con 0x7fb9880f7980 2022-02-02T21:38:30.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb97c00f040 con 0x7fb9880f7980 2022-02-02T21:38:30.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.233+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97c0148b0 con 0x7fb9880f7980 2022-02-02T21:38:30.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.234+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb988108af0 con 0x7fb9880f7980 2022-02-02T21:38:30.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.234+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb988045ad0 con 0x7fb9880f7980 2022-02-02T21:38:30.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.235+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb97c007b20 con 0x7fb9880f7980 2022-02-02T21:38:30.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.235+0000 7fb96f7fe700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 0x7fb970067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.235+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb97c0819e0 con 0x7fb9880f7980 2022-02-02T21:38:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.235+0000 7fb986d9d700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 0x7fb970067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.236+0000 7fb986d9d700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 0x7fb970067290 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fb978004630 tx=0x7fb978009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.239+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb97c053510 con 0x7fb9880f7980 2022-02-02T21:38:30.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.420+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb988108d70 con 0x7fb970064dd0 2022-02-02T21:38:30.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.422+0000 7fb96f7fe700 1 -- 172.21.15.96:0/3640170970 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb988108d70 con 0x7fb970064dd0 2022-02-02T21:38:30.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.423+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 msgr2=0x7fb970067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.423+0000 7fb98d023700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 0x7fb970067290 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fb978004630 tx=0x7fb978009b30).stop 2022-02-02T21:38:30.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.423+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 msgr2=0x7fb9881074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.423+0000 7fb98d023700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 secure :-1 s=READY pgs=3018 cs=0 l=1 rev1=1 rx=0x7fb97c0026d0 tx=0x7fb97c009de0).stop 2022-02-02T21:38:30.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 shutdown_connections 2022-02-02T21:38:30.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb970064dd0 0x7fb970067290 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9880f66e0 0x7fb988106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 --2- 172.21.15.96:0/3640170970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9880f7980 0x7fb9881074a0 unknown :-1 s=CLOSED pgs=3018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 >> 172.21.15.96:0/3640170970 conn(0x7fb9880f1e40 msgr2=0x7fb9880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:30.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 shutdown_connections 2022-02-02T21:38:30.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.424+0000 7fb98d023700 1 -- 172.21.15.96:0/3640170970 wait complete. 2022-02-02T21:38:30.434 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:38:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 -- 172.21.15.96:0/3696727472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f7980 msgr2=0x7f52600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 --2- 172.21.15.96:0/3696727472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f7980 0x7f52600f7de0 secure :-1 s=READY pgs=3019 cs=0 l=1 rev1=1 rx=0x7f5254004660 tx=0x7f5254009b30).stop 2022-02-02T21:38:30.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 -- 172.21.15.96:0/3696727472 shutdown_connections 2022-02-02T21:38:30.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 --2- 172.21.15.96:0/3696727472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f7980 0x7f52600f7de0 unknown :-1 s=CLOSED pgs=3019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 --2- 172.21.15.96:0/3696727472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f66e0 0x7f52600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:38:30.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 -- 172.21.15.96:0/3696727472 >> 172.21.15.96:0/3696727472 conn(0x7f52600f1e40 msgr2=0x7f52600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:30.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 -- 172.21.15.96:0/3696727472 shutdown_connections 2022-02-02T21:38:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 -- 172.21.15.96:0/3696727472 wait complete. 2022-02-02T21:38:30.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.521+0000 7f52667e7700 1 Processor -- start 2022-02-02T21:38:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f52667e7700 1 -- start start 2022-02-02T21:38:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f52667e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f52667e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 0x7f5260069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f52667e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526006a410 con 0x7f52600f66e0 2022-02-02T21:38:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f52667e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526006a550 con 0x7f52600f7980 2022-02-02T21:38:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43954/0 (socket says 172.21.15.96:43954) 2022-02-02T21:38:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 -- 172.21.15.96:0/2226038674 learned_addr learned my addr 172.21.15.96:0/2226038674 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:38:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525f7fe700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 0x7f5260069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 -- 172.21.15.96:0/2226038674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 msgr2=0x7f5260069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 0x7f5260069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525ffff700 1 -- 172.21.15.96:0/2226038674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5254005040 con 0x7f52600f66e0 2022-02-02T21:38:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.522+0000 7f525f7fe700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 0x7f5260069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:38:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f525ffff700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 secure :-1 s=READY pgs=3020 cs=0 l=1 rev1=1 rx=0x7f52500093f0 tx=0x7f5250006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5250009ea0 con 0x7f52600f66e0 2022-02-02T21:38:30.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5250013af0 con 0x7f52600f66e0 2022-02-02T21:38:30.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525000db10 con 0x7f52600f66e0 2022-02-02T21:38:30.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526006a830 con 0x7f52600f66e0 2022-02-02T21:38:30.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.523+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526010efe0 con 0x7f52600f66e0 2022-02-02T21:38:30.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.524+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260045ad0 con 0x7f52600f66e0 2022-02-02T21:38:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.524+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f525001a060 con 0x7f52600f66e0 2022-02-02T21:38:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.525+0000 7f525cff9700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 0x7f5248067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.525+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52500819c0 con 0x7f52600f66e0 2022-02-02T21:38:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.525+0000 7f525f7fe700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 0x7f5248067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.525+0000 7f525f7fe700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 0x7f5248067290 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f5254009da0 tx=0x7f5254009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.529+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f525004fac0 con 0x7f52600f66e0 2022-02-02T21:38:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.702+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5260057f10 con 0x7f5248064dd0 2022-02-02T21:38:30.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.712+0000 7f525cff9700 1 -- 172.21.15.96:0/2226038674 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5260057f10 con 0x7f5248064dd0 2022-02-02T21:38:30.714 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:38:30.715 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:38:30.716 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:38:30.716 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:38:30.716 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:38:30.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:38:30.717 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:38:30.718 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:38:30.718 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:38:30.718 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:38:30.719 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:38:30.719 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:38:30.719 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:38:30.720 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:38:30.720 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:38:30.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:38:30.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:38:30.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:38:30.721 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:38:30.722 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:38:30.722 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:38:30.722 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:38:30.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 msgr2=0x7f5248067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 0x7f5248067290 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f5254009da0 tx=0x7f5254009b30).stop 2022-02-02T21:38:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 msgr2=0x7f526006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 secure :-1 s=READY pgs=3020 cs=0 l=1 rev1=1 rx=0x7f52500093f0 tx=0x7f5250006ec0).stop 2022-02-02T21:38:30.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 shutdown_connections 2022-02-02T21:38:30.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5248064dd0 0x7f5248067290 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600f66e0 0x7f526006b9a0 unknown :-1 s=CLOSED pgs=3020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 --2- 172.21.15.96:0/2226038674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52600f7980 0x7f5260069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 >> 172.21.15.96:0/2226038674 conn(0x7f52600f1e40 msgr2=0x7f52600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:30.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 shutdown_connections 2022-02-02T21:38:30.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.714+0000 7f52667e7700 1 -- 172.21.15.96:0/2226038674 wait complete. 2022-02-02T21:38:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 -- 172.21.15.96:0/3639785194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 msgr2=0x7f4b6c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/3639785194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c0f6950 secure :-1 s=READY pgs=3021 cs=0 l=1 rev1=1 rx=0x7f4b60004660 tx=0x7f4b60009b30).stop 2022-02-02T21:38:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 -- 172.21.15.96:0/3639785194 shutdown_connections 2022-02-02T21:38:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/3639785194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 0x7f4b6c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/3639785194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c0f6950 unknown :-1 s=CLOSED pgs=3021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 -- 172.21.15.96:0/3639785194 >> 172.21.15.96:0/3639785194 conn(0x7f4b6c0f1c90 msgr2=0x7f4b6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:30.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.811+0000 7f4b71ad1700 1 -- 172.21.15.96:0/3639785194 shutdown_connections 2022-02-02T21:38:30.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 -- 172.21.15.96:0/3639785194 wait complete. 2022-02-02T21:38:30.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 Processor -- start 2022-02-02T21:38:30.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 -- start start 2022-02-02T21:38:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 0x7f4b6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c06a380 con 0x7f4b6c0f6530 2022-02-02T21:38:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b71ad1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c06a4c0 con 0x7f4b6c0f77d0 2022-02-02T21:38:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.812+0000 7f4b70acf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43964/0 (socket says 172.21.15.96:43964) 2022-02-02T21:38:30.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 -- 172.21.15.96:0/1550205905 learned_addr learned my addr 172.21.15.96:0/1550205905 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:38:30.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b6bfff700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 0x7f4b6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 -- 172.21.15.96:0/1550205905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 msgr2=0x7f4b6c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:30.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 0x7f4b6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:30.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 -- 172.21.15.96:0/1550205905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60005040 con 0x7f4b6c0f6530 2022-02-02T21:38:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b70acf700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 secure :-1 s=READY pgs=3022 cs=0 l=1 rev1=1 rx=0x7f4b60013a70 tx=0x7f4b60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b60018070 con 0x7f4b6c0f6530 2022-02-02T21:38:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c06a740 con 0x7f4b6c0f6530 2022-02-02T21:38:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b600097d0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6001c3c0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.813+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c06aca0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.814+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c045ad0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.815+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b60007ba0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.815+0000 7f4b697fa700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 0x7f4b5c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:30.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.815+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4b60083ad0 con 0x7f4b6c0f6530 2022-02-02T21:38:30.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.815+0000 7f4b6bfff700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 0x7f4b5c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:30.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.816+0000 7f4b6bfff700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 0x7f4b5c0672e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f4b58004b00 tx=0x7f4b5800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:30.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:30.819+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b60051bd0 con 0x7f4b6c0f6530 2022-02-02T21:38:31.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.050+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b6c027a00 con 0x7f4b6c0f6530 2022-02-02T21:38:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.051+0000 7f4b697fa700 1 -- 172.21.15.96:0/1550205905 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4b600551f0 con 0x7f4b6c0f6530 2022-02-02T21:38:31.053 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:38:31.053 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:38:31.054 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:38:31.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:38:31.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:38:31.055 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:38:31.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:38:31.056 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:38:31.056 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:38:31.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:38:31.058 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:38:31.058 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:38:31.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:38:31.059 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:38:31.060 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:38:31.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:38:31.061 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:38:31.062 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:38:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.052+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 msgr2=0x7f4b5c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.052+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 0x7f4b5c0672e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f4b58004b00 tx=0x7f4b5800b040).stop 2022-02-02T21:38:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.052+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 msgr2=0x7f4b6c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.052+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 secure :-1 s=READY pgs=3022 cs=0 l=1 rev1=1 rx=0x7f4b60013a70 tx=0x7f4b60009b30).stop 2022-02-02T21:38:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 shutdown_connections 2022-02-02T21:38:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b5c064e20 0x7f4b5c0672e0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b6c0f6530 0x7f4b6c06b9a0 unknown :-1 s=CLOSED pgs=3022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 --2- 172.21.15.96:0/1550205905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b6c0f77d0 0x7f4b6c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 >> 172.21.15.96:0/1550205905 conn(0x7f4b6c0f1c90 msgr2=0x7f4b6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 shutdown_connections 2022-02-02T21:38:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.053+0000 7f4b71ad1700 1 -- 172.21.15.96:0/1550205905 wait complete. 2022-02-02T21:38:31.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 -- 172.21.15.96:0/2804692410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 msgr2=0x7f941c0f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 --2- 172.21.15.96:0/2804692410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c0f59f0 secure :-1 s=READY pgs=3023 cs=0 l=1 rev1=1 rx=0x7f9410004660 tx=0x7f9410009b30).stop 2022-02-02T21:38:31.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 -- 172.21.15.96:0/2804692410 shutdown_connections 2022-02-02T21:38:31.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 --2- 172.21.15.96:0/2804692410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 0x7f941c0f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 --2- 172.21.15.96:0/2804692410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c0f59f0 unknown :-1 s=CLOSED pgs=3023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 -- 172.21.15.96:0/2804692410 >> 172.21.15.96:0/2804692410 conn(0x7f941c0f0d70 msgr2=0x7f941c0f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 -- 172.21.15.96:0/2804692410 shutdown_connections 2022-02-02T21:38:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.150+0000 7f9422174700 1 -- 172.21.15.96:0/2804692410 wait complete. 2022-02-02T21:38:31.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 Processor -- start 2022-02-02T21:38:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 -- start start 2022-02-02T21:38:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:31.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 0x7f941c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:31.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0604a0 con 0x7f941c0f55d0 2022-02-02T21:38:31.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f9422174700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0605e0 con 0x7f941c0f6870 2022-02-02T21:38:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43974/0 (socket says 172.21.15.96:43974) 2022-02-02T21:38:31.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f941b7fe700 1 -- 172.21.15.96:0/1775490046 learned_addr learned my addr 172.21.15.96:0/1775490046 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:38:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.151+0000 7f941affd700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 0x7f941c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f941b7fe700 1 -- 172.21.15.96:0/1775490046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 msgr2=0x7f941c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f941b7fe700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 0x7f941c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f941b7fe700 1 -- 172.21.15.96:0/1775490046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410005040 con 0x7f941c0f55d0 2022-02-02T21:38:31.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f941b7fe700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 secure :-1 s=READY pgs=3024 cs=0 l=1 rev1=1 rx=0x7f9410013a70 tx=0x7f9410009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:31.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9410018070 con 0x7f941c0f55d0 2022-02-02T21:38:31.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c10c6e0 con 0x7f941c0f55d0 2022-02-02T21:38:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c10cc10 con 0x7f941c0f55d0 2022-02-02T21:38:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94100097d0 con 0x7f941c0f55d0 2022-02-02T21:38:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.152+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941001de80 con 0x7f941c0f55d0 2022-02-02T21:38:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.153+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc004fa0 con 0x7f941c0f55d0 2022-02-02T21:38:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.154+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9410007ba0 con 0x7f941c0f55d0 2022-02-02T21:38:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.154+0000 7f9403fff700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 0x7f9404067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:38:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.154+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f94100834d0 con 0x7f941c0f55d0 2022-02-02T21:38:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.154+0000 7f941affd700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 0x7f9404067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:38:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.155+0000 7f941affd700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 0x7f9404067290 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f940c004c40 tx=0x7f940c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:38:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.159+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9410051690 con 0x7f941c0f55d0 2022-02-02T21:38:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.360+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93fc005e80 con 0x7f941c0f55d0 2022-02-02T21:38:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.360+0000 7f9403fff700 1 -- 172.21.15.96:0/1775490046 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9410054cb0 con 0x7f941c0f55d0 2022-02-02T21:38:31.362 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:38:31.363 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:38:31.363 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:38:31.363 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:38:31.364 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:31.364 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:38:31.364 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:38:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:38:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:38:31.366 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:38:31.366 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:38:31.366 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:38:31.367 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:38:31.368 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:38:31.368 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:38:31.369 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:38:31.369 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:38:31.370 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:38:31.370 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:38:31.371 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:38:31.371 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:38:31.371 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:38:31.372 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:38:31.373 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:38:31.374 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:38:31.374 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:38:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:38:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:38:31.376 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:38:31.377 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:38:31.378 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:38:31.378 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:38:31.379 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:31.379 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:31.380 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:38:31.380 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:38:31.381 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:31.381 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:31.382 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:38:31.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 msgr2=0x7f9404067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 0x7f9404067290 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f940c004c40 tx=0x7f940c00b040).stop 2022-02-02T21:38:31.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 msgr2=0x7f941c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:38:31.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 secure :-1 s=READY pgs=3024 cs=0 l=1 rev1=1 rx=0x7f9410013a70 tx=0x7f9410009b30).stop 2022-02-02T21:38:31.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 shutdown_connections 2022-02-02T21:38:31.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9404064dd0 0x7f9404067290 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f941c0f55d0 0x7f941c109c90 unknown :-1 s=CLOSED pgs=3024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 --2- 172.21.15.96:0/1775490046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c0f6870 0x7f941c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:38:31.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 >> 172.21.15.96:0/1775490046 conn(0x7f941c0f0d70 msgr2=0x7f941c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:38:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 shutdown_connections 2022-02-02T21:38:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:38:31.362+0000 7f9422174700 1 -- 172.21.15.96:0/1775490046 wait complete. 2022-02-02T21:38:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:38:31.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:31 smithi096 ceph-mon[101353]: pgmap v5892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:31.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1550205905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:38:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:31 smithi159 ceph-mon[69013]: pgmap v5892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:31.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1550205905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:38:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:32 smithi159 ceph-mon[69013]: from='client.40146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:32 smithi159 ceph-mon[69013]: from='client.40150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1775490046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:38:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:32 smithi096 ceph-mon[101353]: from='client.40146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:32 smithi096 ceph-mon[101353]: from='client.40150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:38:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1775490046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:38:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:33 smithi096 ceph-mon[101353]: pgmap v5893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:33 smithi159 ceph-mon[69013]: pgmap v5893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:34 smithi159 ceph-mon[69013]: pgmap v5894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:34 smithi096 ceph-mon[101353]: pgmap v5894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:37 smithi159 ceph-mon[69013]: pgmap v5895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:37 smithi096 ceph-mon[101353]: pgmap v5895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:38 smithi159 ceph-mon[69013]: pgmap v5896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:38 smithi096 ceph-mon[101353]: pgmap v5896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:41 smithi159 ceph-mon[69013]: pgmap v5897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:41 smithi096 ceph-mon[101353]: pgmap v5897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:42 smithi159 ceph-mon[69013]: pgmap v5898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:42 smithi096 ceph-mon[101353]: pgmap v5898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:45 smithi159 ceph-mon[69013]: pgmap v5899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:45 smithi096 ceph-mon[101353]: pgmap v5899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:46 smithi159 ceph-mon[69013]: pgmap v5900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:46 smithi096 ceph-mon[101353]: pgmap v5900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:48 smithi159 ceph-mon[69013]: pgmap v5901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:48 smithi096 ceph-mon[101353]: pgmap v5901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:50 smithi159 ceph-mon[69013]: pgmap v5902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:50.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:50 smithi096 ceph-mon[101353]: pgmap v5902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:52 smithi159 ceph-mon[69013]: pgmap v5903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:52 smithi096 ceph-mon[101353]: pgmap v5903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:54 smithi159 ceph-mon[69013]: pgmap v5904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:54 smithi096 ceph-mon[101353]: pgmap v5904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:56 smithi159 ceph-mon[69013]: pgmap v5905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:56 smithi096 ceph-mon[101353]: pgmap v5905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:38:58 smithi159 ceph-mon[69013]: pgmap v5906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:38:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:38:58 smithi096 ceph-mon[101353]: pgmap v5906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:00 smithi159 ceph-mon[69013]: pgmap v5907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:00 smithi096 ceph-mon[101353]: pgmap v5907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:01.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 -- 172.21.15.96:0/2076151191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 msgr2=0x7f12080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 --2- 172.21.15.96:0/2076151191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12080f6b00 secure :-1 s=READY pgs=3025 cs=0 l=1 rev1=1 rx=0x7f11f8004660 tx=0x7f11f8009b30).stop 2022-02-02T21:39:01.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 -- 172.21.15.96:0/2076151191 shutdown_connections 2022-02-02T21:39:01.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 --2- 172.21.15.96:0/2076151191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f12080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 --2- 172.21.15.96:0/2076151191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12080f6b00 unknown :-1 s=CLOSED pgs=3025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 -- 172.21.15.96:0/2076151191 >> 172.21.15.96:0/2076151191 conn(0x7f12080f1e40 msgr2=0x7f12080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:01.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 -- 172.21.15.96:0/2076151191 shutdown_connections 2022-02-02T21:39:01.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.473+0000 7f120ea22700 1 -- 172.21.15.96:0/2076151191 wait complete. 2022-02-02T21:39:01.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 Processor -- start 2022-02-02T21:39:01.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 -- start start 2022-02-02T21:39:01.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f1208109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208109c40 con 0x7f12080f66e0 2022-02-02T21:39:01.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f120ea22700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208109d80 con 0x7f12080f7980 2022-02-02T21:39:01.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f1207fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f1207fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43998/0 (socket says 172.21.15.96:43998) 2022-02-02T21:39:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.474+0000 7f1207fff700 1 -- 172.21.15.96:0/1046997759 learned_addr learned my addr 172.21.15.96:0/1046997759 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f12077fe700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f1208109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1207fff700 1 -- 172.21.15.96:0/1046997759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 msgr2=0x7f1208109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1207fff700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f1208109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1207fff700 1 -- 172.21.15.96:0/1046997759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8005040 con 0x7f12080f66e0 2022-02-02T21:39:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f12077fe700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f1208109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:39:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1207fff700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 secure :-1 s=READY pgs=3026 cs=0 l=1 rev1=1 rx=0x7f11f8004f60 tx=0x7f11f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f8018070 con 0x7f12080f66e0 2022-02-02T21:39:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120810a6c0 con 0x7f12080f66e0 2022-02-02T21:39:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11f8007ba0 con 0x7f12080f66e0 2022-02-02T21:39:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f801c620 con 0x7f12080f66e0 2022-02-02T21:39:01.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.475+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120810ac20 con 0x7f12080f66e0 2022-02-02T21:39:01.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.476+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1208045ad0 con 0x7f12080f66e0 2022-02-02T21:39:01.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.477+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11f801c8e0 con 0x7f12080f66e0 2022-02-02T21:39:01.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.477+0000 7f1204ff9700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.477+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f11f8083a00 con 0x7f12080f66e0 2022-02-02T21:39:01.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.477+0000 7f12077fe700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.478+0000 7f12077fe700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 0x7f11f0067290 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f11fc004a90 tx=0x7f11fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:01.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.482+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11f8055470 con 0x7f12080f66e0 2022-02-02T21:39:01.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.658+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12080008d0 con 0x7f11f0064dd0 2022-02-02T21:39:01.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.659+0000 7f1204ff9700 1 -- 172.21.15.96:0/1046997759 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f12080008d0 con 0x7f11f0064dd0 2022-02-02T21:39:01.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 msgr2=0x7f11f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 0x7f11f0067290 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f11fc004a90 tx=0x7f11fc009040).stop 2022-02-02T21:39:01.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 msgr2=0x7f12081091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 secure :-1 s=READY pgs=3026 cs=0 l=1 rev1=1 rx=0x7f11f8004f60 tx=0x7f11f8009b30).stop 2022-02-02T21:39:01.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 shutdown_connections 2022-02-02T21:39:01.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080f66e0 0x7f12081091a0 unknown :-1 s=CLOSED pgs=3026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 --2- 172.21.15.96:0/1046997759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12080f7980 0x7f1208109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 >> 172.21.15.96:0/1046997759 conn(0x7f12080f1e40 msgr2=0x7f120806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:01.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 shutdown_connections 2022-02-02T21:39:01.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.661+0000 7f120ea22700 1 -- 172.21.15.96:0/1046997759 wait complete. 2022-02-02T21:39:01.671 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:39:01.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 -- 172.21.15.96:0/3507340842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 msgr2=0x7fd9b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/3507340842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b40f59e0 secure :-1 s=READY pgs=3027 cs=0 l=1 rev1=1 rx=0x7fd9a8004660 tx=0x7fd9a8009b30).stop 2022-02-02T21:39:01.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 -- 172.21.15.96:0/3507340842 shutdown_connections 2022-02-02T21:39:01.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/3507340842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 0x7fd9b40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:39:01.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/3507340842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b40f59e0 unknown :-1 s=CLOSED pgs=3027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 -- 172.21.15.96:0/3507340842 >> 172.21.15.96:0/3507340842 conn(0x7fd9b40f0d40 msgr2=0x7fd9b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:01.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 -- 172.21.15.96:0/3507340842 shutdown_connections 2022-02-02T21:39:01.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 -- 172.21.15.96:0/3507340842 wait complete. 2022-02-02T21:39:01.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.760+0000 7fd9b9a50700 1 Processor -- start 2022-02-02T21:39:01.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b9a50700 1 -- start start 2022-02-02T21:39:01.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b9a50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b9a50700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 0x7fd9b410c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b9a50700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b4060470 con 0x7fd9b40f55c0 2022-02-02T21:39:01.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b9a50700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40605b0 con 0x7fd9b40f6860 2022-02-02T21:39:01.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44014/0 (socket says 172.21.15.96:44014) 2022-02-02T21:39:01.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 -- 172.21.15.96:0/2982284886 learned_addr learned my addr 172.21.15.96:0/2982284886 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:01.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b27fc700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 0x7fd9b410c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 -- 172.21.15.96:0/2982284886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 msgr2=0x7fd9b410c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 0x7fd9b410c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 -- 172.21.15.96:0/2982284886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8005040 con 0x7fd9b40f55c0 2022-02-02T21:39:01.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.761+0000 7fd9b2ffd700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 secure :-1 s=READY pgs=3028 cs=0 l=1 rev1=1 rx=0x7fd9a8004f60 tx=0x7fd9a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:01.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.762+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a8018070 con 0x7fd9b40f55c0 2022-02-02T21:39:01.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.762+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b410c7c0 con 0x7fd9b40f55c0 2022-02-02T21:39:01.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.762+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9a8009770 con 0x7fd9b40f55c0 2022-02-02T21:39:01.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.762+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a801c3c0 con 0x7fd9b40f55c0 2022-02-02T21:39:01.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.762+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b410ccf0 con 0x7fd9b40f55c0 2022-02-02T21:39:01.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.763+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b40f49b0 con 0x7fd9b40f55c0 2022-02-02T21:39:01.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.763+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9a801d420 con 0x7fd9b40f55c0 2022-02-02T21:39:01.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.763+0000 7fd99b7fe700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 0x7fd99c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:01.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.763+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd9a8083860 con 0x7fd9b40f55c0 2022-02-02T21:39:01.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.763+0000 7fd9b27fc700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 0x7fd99c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:01.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.764+0000 7fd9b27fc700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 0x7fd99c067290 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fd9a4006fd0 tx=0x7fd9a4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:01.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.768+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9a8051960 con 0x7fd9b40f55c0 2022-02-02T21:39:01.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.938+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9b40008d0 con 0x7fd99c064dd0 2022-02-02T21:39:01.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.948+0000 7fd99b7fe700 1 -- 172.21.15.96:0/2982284886 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd9b40008d0 con 0x7fd99c064dd0 2022-02-02T21:39:01.948 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:39:01.949 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:39:01.949 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:39:01.949 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:39:01.950 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:39:01.950 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:39:01.950 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:39:01.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:39:01.951 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:39:01.951 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:39:01.952 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:39:01.952 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:39:01.952 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:39:01.953 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:39:01.953 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:39:01.953 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:39:01.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:39:01.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:39:01.954 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:39:01.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:39:01.955 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:39:01.955 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:39:01.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 msgr2=0x7fd99c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 0x7fd99c067290 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fd9a4006fd0 tx=0x7fd9a4008040).stop 2022-02-02T21:39:01.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 msgr2=0x7fd9b4109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:01.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 secure :-1 s=READY pgs=3028 cs=0 l=1 rev1=1 rx=0x7fd9a8004f60 tx=0x7fd9a8009b30).stop 2022-02-02T21:39:01.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 shutdown_connections 2022-02-02T21:39:01.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd99c064dd0 0x7fd99c067290 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b40f55c0 0x7fd9b4109cc0 unknown :-1 s=CLOSED pgs=3028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 --2- 172.21.15.96:0/2982284886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9b40f6860 0x7fd9b410c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 >> 172.21.15.96:0/2982284886 conn(0x7fd9b40f0d40 msgr2=0x7fd9b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 shutdown_connections 2022-02-02T21:39:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:01.950+0000 7fd9b9a50700 1 -- 172.21.15.96:0/2982284886 wait complete. 2022-02-02T21:39:02.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 -- 172.21.15.96:0/3015481731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f5440 msgr2=0x7eff140f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 --2- 172.21.15.96:0/3015481731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f5440 0x7eff140f5860 secure :-1 s=READY pgs=3029 cs=0 l=1 rev1=1 rx=0x7eff08004660 tx=0x7eff08009b30).stop 2022-02-02T21:39:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 -- 172.21.15.96:0/3015481731 shutdown_connections 2022-02-02T21:39:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 --2- 172.21.15.96:0/3015481731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f66e0 0x7eff140f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 --2- 172.21.15.96:0/3015481731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f5440 0x7eff140f5860 unknown :-1 s=CLOSED pgs=3029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 -- 172.21.15.96:0/3015481731 >> 172.21.15.96:0/3015481731 conn(0x7eff140f0ba0 msgr2=0x7eff140f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:02.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 -- 172.21.15.96:0/3015481731 shutdown_connections 2022-02-02T21:39:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.046+0000 7eff1359e700 1 -- 172.21.15.96:0/3015481731 wait complete. 2022-02-02T21:39:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 Processor -- start 2022-02-02T21:39:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 -- start start 2022-02-02T21:39:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f5440 0x7eff14109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140603e0 con 0x7eff140f66e0 2022-02-02T21:39:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14060520 con 0x7eff140f5440 2022-02-02T21:39:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff11d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff11d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44026/0 (socket says 172.21.15.96:44026) 2022-02-02T21:39:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff11d9b700 1 -- 172.21.15.96:0/3417530567 learned_addr learned my addr 172.21.15.96:0/3417530567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.047+0000 7eff1259c700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f5440 0x7eff14109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff11d9b700 1 -- 172.21.15.96:0/3417530567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f5440 msgr2=0x7eff14109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff11d9b700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f5440 0x7eff14109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff11d9b700 1 -- 172.21.15.96:0/3417530567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08005040 con 0x7eff140f66e0 2022-02-02T21:39:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff11d9b700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 secure :-1 s=READY pgs=3030 cs=0 l=1 rev1=1 rx=0x7eff040026d0 tx=0x7eff04009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff040079c0 con 0x7eff140f66e0 2022-02-02T21:39:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff0400f040 con 0x7eff140f66e0 2022-02-02T21:39:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1410c550 con 0x7eff140f66e0 2022-02-02T21:39:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff040148b0 con 0x7eff140f66e0 2022-02-02T21:39:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.048+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410cb10 con 0x7eff140f66e0 2022-02-02T21:39:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.049+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14045ad0 con 0x7eff140f66e0 2022-02-02T21:39:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.050+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff04007b20 con 0x7eff140f66e0 2022-02-02T21:39:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.050+0000 7eff02ffd700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 0x7efefc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.050+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7eff04081990 con 0x7eff140f66e0 2022-02-02T21:39:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.050+0000 7eff1259c700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 0x7efefc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.051+0000 7eff1259c700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 0x7efefc0672e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7eff08013690 tx=0x7eff08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.054+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff0404fa90 con 0x7eff140f66e0 2022-02-02T21:39:02.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.283+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff1410c6e0 con 0x7eff140f66e0 2022-02-02T21:39:02.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.284+0000 7eff02ffd700 1 -- 172.21.15.96:0/3417530567 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7eff1410c6e0 con 0x7eff140f66e0 2022-02-02T21:39:02.285 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:39:02.285 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:39:02.285 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:39:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:39:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:39:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:39:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:39:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:39:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:39:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:39:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:39:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:39:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:39:02.290 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:39:02.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 msgr2=0x7efefc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 0x7efefc0672e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7eff08013690 tx=0x7eff08009b30).stop 2022-02-02T21:39:02.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 msgr2=0x7eff1410bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 secure :-1 s=READY pgs=3030 cs=0 l=1 rev1=1 rx=0x7eff040026d0 tx=0x7eff04009de0).stop 2022-02-02T21:39:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 shutdown_connections 2022-02-02T21:39:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064e20 0x7efefc0672e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f5440 0x7eff14109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 --2- 172.21.15.96:0/3417530567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1410bfa0 unknown :-1 s=CLOSED pgs=3030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 >> 172.21.15.96:0/3417530567 conn(0x7eff140f0ba0 msgr2=0x7eff140fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 shutdown_connections 2022-02-02T21:39:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.286+0000 7eff1359e700 1 -- 172.21.15.96:0/3417530567 wait complete. 2022-02-02T21:39:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- 172.21.15.96:0/3351405358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 msgr2=0x7f56800f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 --2- 172.21.15.96:0/3351405358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f56800f6960 secure :-1 s=READY pgs=3031 cs=0 l=1 rev1=1 rx=0x7f566c004660 tx=0x7f566c009b30).stop 2022-02-02T21:39:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- 172.21.15.96:0/3351405358 shutdown_connections 2022-02-02T21:39:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 --2- 172.21.15.96:0/3351405358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f56800f6960 unknown :-1 s=CLOSED pgs=3031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 --2- 172.21.15.96:0/3351405358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 0x7f56800f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- 172.21.15.96:0/3351405358 >> 172.21.15.96:0/3351405358 conn(0x7f56800f0540 msgr2=0x7f56800f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- 172.21.15.96:0/3351405358 shutdown_connections 2022-02-02T21:39:02.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- 172.21.15.96:0/3351405358 wait complete. 2022-02-02T21:39:02.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 Processor -- start 2022-02-02T21:39:02.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.386+0000 7f5686efc700 1 -- start start 2022-02-02T21:39:02.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5686efc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 0x7f5680109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5686efc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5686efc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800f56c0 con 0x7f56800f64e0 2022-02-02T21:39:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5686efc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800f5800 con 0x7f56800f5bd0 2022-02-02T21:39:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44036/0 (socket says 172.21.15.96:44036) 2022-02-02T21:39:02.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 -- 172.21.15.96:0/2299814795 learned_addr learned my addr 172.21.15.96:0/2299814795 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:02.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5684c98700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 0x7f5680109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 -- 172.21.15.96:0/2299814795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 msgr2=0x7f5680109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 0x7f5680109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 -- 172.21.15.96:0/2299814795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c005040 con 0x7f56800f64e0 2022-02-02T21:39:02.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567ffff700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 secure :-1 s=READY pgs=3032 cs=0 l=1 rev1=1 rx=0x7f566c009830 tx=0x7f566c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566c018070 con 0x7f56800f64e0 2022-02-02T21:39:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568010c680 con 0x7f56800f64e0 2022-02-02T21:39:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.387+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f566c007ba0 con 0x7f56800f64e0 2022-02-02T21:39:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.388+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566c01c3c0 con 0x7f56800f64e0 2022-02-02T21:39:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.388+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568010cbe0 con 0x7f56800f64e0 2022-02-02T21:39:02.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.388+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680045ad0 con 0x7f56800f64e0 2022-02-02T21:39:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.389+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f566c007d10 con 0x7f56800f64e0 2022-02-02T21:39:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.389+0000 7f567d7fa700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 0x7f5670067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:02.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.389+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f566c083640 con 0x7f56800f64e0 2022-02-02T21:39:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.389+0000 7f5684c98700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 0x7f5670067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:02.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.390+0000 7f5684c98700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 0x7f5670067270 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f56800f5340 tx=0x7f567400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:02.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.394+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f566c051800 con 0x7f56800f64e0 2022-02-02T21:39:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.594+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56800fde60 con 0x7f56800f64e0 2022-02-02T21:39:02.595 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3417530567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:39:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.595+0000 7f567d7fa700 1 -- 172.21.15.96:0/2299814795 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f566c054e20 con 0x7f56800f64e0 2022-02-02T21:39:02.597 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:39:02.597 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:39:02.597 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:39:02.598 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:39:02.598 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:02.598 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:39:02.599 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:39:02.599 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:39:02.599 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:39:02.600 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:39:02.600 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:39:02.600 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:39:02.601 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:39:02.601 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:39:02.601 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:39:02.602 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:39:02.602 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:39:02.602 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:39:02.603 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:39:02.603 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:39:02.603 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:39:02.604 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:39:02.604 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:39:02.604 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:39:02.605 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:39:02.605 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:39:02.605 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:39:02.606 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:39:02.606 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:39:02.606 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:39:02.607 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:39:02.607 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:39:02.607 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:02.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:02.608 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:39:02.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:02.609 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:02.609 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:02.610 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 msgr2=0x7f5670067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 0x7f5670067270 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f56800f5340 tx=0x7f567400b040).stop 2022-02-02T21:39:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 msgr2=0x7f568010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 secure :-1 s=READY pgs=3032 cs=0 l=1 rev1=1 rx=0x7f566c009830 tx=0x7f566c009b30).stop 2022-02-02T21:39:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 shutdown_connections 2022-02-02T21:39:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5670064db0 0x7f5670067270 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56800f5bd0 0x7f5680109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 --2- 172.21.15.96:0/2299814795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56800f64e0 0x7f568010c130 unknown :-1 s=CLOSED pgs=3032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 >> 172.21.15.96:0/2299814795 conn(0x7f56800f0540 msgr2=0x7f56800fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 shutdown_connections 2022-02-02T21:39:02.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:02.598+0000 7f5686efc700 1 -- 172.21.15.96:0/2299814795 wait complete. 2022-02-02T21:39:02.615 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:39:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3417530567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:39:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:03 smithi096 ceph-mon[101353]: from='client.40162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:03 smithi096 ceph-mon[101353]: from='client.40166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:03 smithi096 ceph-mon[101353]: pgmap v5908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:03.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2299814795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:39:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:03 smithi159 ceph-mon[69013]: from='client.40162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:03.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:03 smithi159 ceph-mon[69013]: from='client.40166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:03 smithi159 ceph-mon[69013]: pgmap v5908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:03.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2299814795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:39:05.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:05 smithi159 ceph-mon[69013]: pgmap v5909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:05.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:05 smithi096 ceph-mon[101353]: pgmap v5909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:07 smithi159 ceph-mon[69013]: pgmap v5910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:07 smithi096 ceph-mon[101353]: pgmap v5910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:08 smithi159 ceph-mon[69013]: pgmap v5911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:08 smithi096 ceph-mon[101353]: pgmap v5911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:10 smithi159 ceph-mon[69013]: pgmap v5912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:10.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:10 smithi096 ceph-mon[101353]: pgmap v5912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:12 smithi159 ceph-mon[69013]: pgmap v5913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:12 smithi096 ceph-mon[101353]: pgmap v5913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:14 smithi159 ceph-mon[69013]: pgmap v5914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:14 smithi096 ceph-mon[101353]: pgmap v5914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:16 smithi159 ceph-mon[69013]: pgmap v5915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:16 smithi096 ceph-mon[101353]: pgmap v5915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:18 smithi159 ceph-mon[69013]: pgmap v5916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:18 smithi096 ceph-mon[101353]: pgmap v5916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:20 smithi159 ceph-mon[69013]: pgmap v5917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:20 smithi096 ceph-mon[101353]: pgmap v5917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:22 smithi159 ceph-mon[69013]: pgmap v5918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:22 smithi096 ceph-mon[101353]: pgmap v5918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:24 smithi159 ceph-mon[69013]: pgmap v5919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:24 smithi096 ceph-mon[101353]: pgmap v5919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:26 smithi159 ceph-mon[69013]: pgmap v5920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:26.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:26 smithi096 ceph-mon[101353]: pgmap v5920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:39:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:39:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:28 smithi159 ceph-mon[69013]: pgmap v5921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:39:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:39:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:28 smithi096 ceph-mon[101353]: pgmap v5921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:30.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:30 smithi159 ceph-mon[69013]: pgmap v5922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:30 smithi096 ceph-mon[101353]: pgmap v5922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:32.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 -- 172.21.15.96:0/2699141597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f6860 msgr2=0x7f398c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:32.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 --2- 172.21.15.96:0/2699141597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f6860 0x7f398c0f6cc0 secure :-1 s=READY pgs=3033 cs=0 l=1 rev1=1 rx=0x7f397c004660 tx=0x7f397c009b30).stop 2022-02-02T21:39:32.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 -- 172.21.15.96:0/2699141597 shutdown_connections 2022-02-02T21:39:32.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 --2- 172.21.15.96:0/2699141597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f6860 0x7f398c0f6cc0 unknown :-1 s=CLOSED pgs=3033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 --2- 172.21.15.96:0/2699141597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f55c0 0x7f398c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 -- 172.21.15.96:0/2699141597 >> 172.21.15.96:0/2699141597 conn(0x7f398c0f0d40 msgr2=0x7f398c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:32.712 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:32 smithi096 ceph-mon[101353]: pgmap v5923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:32.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 -- 172.21.15.96:0/2699141597 shutdown_connections 2022-02-02T21:39:32.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.709+0000 7f39919bc700 1 -- 172.21.15.96:0/2699141597 wait complete. 2022-02-02T21:39:32.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 Processor -- start 2022-02-02T21:39:32.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 -- start start 2022-02-02T21:39:32.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:32.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f6860 0x7f398c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:32.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c109c20 con 0x7f398c0f55c0 2022-02-02T21:39:32.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f39919bc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c109d60 con 0x7f398c0f6860 2022-02-02T21:39:32.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:32.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44054/0 (socket says 172.21.15.96:44054) 2022-02-02T21:39:32.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 -- 172.21.15.96:0/3783789481 learned_addr learned my addr 172.21.15.96:0/3783789481 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:32.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398a7fc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f6860 0x7f398c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:32.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 -- 172.21.15.96:0/3783789481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f6860 msgr2=0x7f398c109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:32.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f6860 0x7f398c109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.710+0000 7f398affd700 1 -- 172.21.15.96:0/3783789481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c005040 con 0x7f398c0f55c0 2022-02-02T21:39:32.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f398affd700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 secure :-1 s=READY pgs=3034 cs=0 l=1 rev1=1 rx=0x7f3980002700 tx=0x7f3980009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:32.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39800079c0 con 0x7f398c0f55c0 2022-02-02T21:39:32.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f398000f040 con 0x7f398c0f55c0 2022-02-02T21:39:32.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c10a700 con 0x7f398c0f55c0 2022-02-02T21:39:32.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3980014860 con 0x7f398c0f55c0 2022-02-02T21:39:32.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.711+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c10acc0 con 0x7f398c0f55c0 2022-02-02T21:39:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.712+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c045ad0 con 0x7f398c0f55c0 2022-02-02T21:39:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.712+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f398001b060 con 0x7f398c0f55c0 2022-02-02T21:39:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.713+0000 7f39737fe700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 0x7f3974067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.713+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3980081900 con 0x7f398c0f55c0 2022-02-02T21:39:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.713+0000 7f398a7fc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 0x7f3974067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.713+0000 7f398a7fc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 0x7f3974067290 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f397c004630 tx=0x7f397c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:32.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.717+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3980053430 con 0x7f398c0f55c0 2022-02-02T21:39:32.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:32 smithi159 ceph-mon[69013]: pgmap v5923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.896+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f398c0faaa0 con 0x7f3974064dd0 2022-02-02T21:39:32.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.897+0000 7f39737fe700 1 -- 172.21.15.96:0/3783789481 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f398c0faaa0 con 0x7f3974064dd0 2022-02-02T21:39:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.898+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 msgr2=0x7f3974067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:32.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.898+0000 7f39919bc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 0x7f3974067290 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f397c004630 tx=0x7f397c009b30).stop 2022-02-02T21:39:32.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 msgr2=0x7f398c109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 secure :-1 s=READY pgs=3034 cs=0 l=1 rev1=1 rx=0x7f3980002700 tx=0x7f3980009d80).stop 2022-02-02T21:39:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 shutdown_connections 2022-02-02T21:39:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3974064dd0 0x7f3974067290 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f398c0f55c0 0x7f398c109180 unknown :-1 s=CLOSED pgs=3034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 --2- 172.21.15.96:0/3783789481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f398c0f6860 0x7f398c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 >> 172.21.15.96:0/3783789481 conn(0x7f398c0f0d40 msgr2=0x7f398c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:32.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 shutdown_connections 2022-02-02T21:39:32.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.899+0000 7f39919bc700 1 -- 172.21.15.96:0/3783789481 wait complete. 2022-02-02T21:39:32.908 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:39:32.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 -- 172.21.15.96:0/419585686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 msgr2=0x7fc1e806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/419585686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e806a7d0 secure :-1 s=READY pgs=3035 cs=0 l=1 rev1=1 rx=0x7fc1dc004660 tx=0x7fc1dc009b30).stop 2022-02-02T21:39:32.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 -- 172.21.15.96:0/419585686 shutdown_connections 2022-02-02T21:39:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/419585686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e806a7d0 unknown :-1 s=CLOSED pgs=3035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:32.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/419585686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 0x7fc1e8069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:39:32.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 -- 172.21.15.96:0/419585686 >> 172.21.15.96:0/419585686 conn(0x7fc1e80f1c90 msgr2=0x7fc1e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:32.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.996+0000 7fc1ed60d700 1 -- 172.21.15.96:0/419585686 shutdown_connections 2022-02-02T21:39:33.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 -- 172.21.15.96:0/419585686 wait complete. 2022-02-02T21:39:33.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 Processor -- start 2022-02-02T21:39:33.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 -- start start 2022-02-02T21:39:33.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 0x7fc1e8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8109ab0 con 0x7fc1e806a350 2022-02-02T21:39:33.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.998+0000 7fc1ed60d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e810a360 con 0x7fc1e806b960 2022-02-02T21:39:33.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44064/0 (socket says 172.21.15.96:44064) 2022-02-02T21:39:33.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 -- 172.21.15.96:0/3417304622 learned_addr learned my addr 172.21.15.96:0/3417304622 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:33.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e77fe700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 0x7fc1e8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 -- 172.21.15.96:0/3417304622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 msgr2=0x7fc1e8109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 0x7fc1e8109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 -- 172.21.15.96:0/3417304622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc005040 con 0x7fc1e806a350 2022-02-02T21:39:33.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e7fff700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 secure :-1 s=READY pgs=3036 cs=0 l=1 rev1=1 rx=0x7fc1d800b410 tx=0x7fc1d8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d80125f0 con 0x7fc1e806a350 2022-02-02T21:39:33.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e810a640 con 0x7fc1e806a350 2022-02-02T21:39:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1d800be30 con 0x7fc1e806a350 2022-02-02T21:39:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d8002a70 con 0x7fc1e806a350 2022-02-02T21:39:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:32.999+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e810ac00 con 0x7fc1e806a350 2022-02-02T21:39:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.000+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e8059100 con 0x7fc1e806a350 2022-02-02T21:39:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.001+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1d800f030 con 0x7fc1e806a350 2022-02-02T21:39:33.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.001+0000 7fc1e4ff9700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 0x7fc1d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.001+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1d8081e80 con 0x7fc1e806a350 2022-02-02T21:39:33.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.001+0000 7fc1e77fe700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 0x7fc1d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.001+0000 7fc1e77fe700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 0x7fc1d00672e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fc1dc004630 tx=0x7fc1dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.005+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1d80539b0 con 0x7fc1e806a350 2022-02-02T21:39:33.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.178+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e8100fd0 con 0x7fc1d0064e20 2022-02-02T21:39:33.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.188+0000 7fc1e4ff9700 1 -- 172.21.15.96:0/3417304622 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc1e8100fd0 con 0x7fc1d0064e20 2022-02-02T21:39:33.188 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:39:33.189 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:39:33.189 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:39:33.189 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:39:33.190 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:39:33.190 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:39:33.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:39:33.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:39:33.191 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:39:33.192 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:39:33.192 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:39:33.192 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:39:33.193 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:39:33.193 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:39:33.193 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:39:33.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:39:33.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:39:33.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:39:33.195 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:39:33.195 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:39:33.196 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:39:33.196 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:39:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 msgr2=0x7fc1d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 0x7fc1d00672e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fc1dc004630 tx=0x7fc1dc009b30).stop 2022-02-02T21:39:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 msgr2=0x7fc1e8108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 secure :-1 s=READY pgs=3036 cs=0 l=1 rev1=1 rx=0x7fc1d800b410 tx=0x7fc1d8006ef0).stop 2022-02-02T21:39:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 shutdown_connections 2022-02-02T21:39:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1d0064e20 0x7fc1d00672e0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1e806a350 0x7fc1e8108f80 unknown :-1 s=CLOSED pgs=3036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 --2- 172.21.15.96:0/3417304622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e806b960 0x7fc1e8109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 >> 172.21.15.96:0/3417304622 conn(0x7fc1e80f1c90 msgr2=0x7fc1e80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:33.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 shutdown_connections 2022-02-02T21:39:33.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.190+0000 7fc1ed60d700 1 -- 172.21.15.96:0/3417304622 wait complete. 2022-02-02T21:39:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.288+0000 7f360f551700 1 -- 172.21.15.96:0/57595205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 msgr2=0x7f36080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.288+0000 7f360f551700 1 --2- 172.21.15.96:0/57595205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f36080f6b30 secure :-1 s=READY pgs=3037 cs=0 l=1 rev1=1 rx=0x7f35f8004660 tx=0x7f35f8009b30).stop 2022-02-02T21:39:33.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- 172.21.15.96:0/57595205 shutdown_connections 2022-02-02T21:39:33.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 --2- 172.21.15.96:0/57595205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f36080f6b30 unknown :-1 s=CLOSED pgs=3037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 --2- 172.21.15.96:0/57595205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 0x7f36080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:39:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- 172.21.15.96:0/57595205 >> 172.21.15.96:0/57595205 conn(0x7f36080f0b90 msgr2=0x7f36080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- 172.21.15.96:0/57595205 shutdown_connections 2022-02-02T21:39:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- 172.21.15.96:0/57595205 wait complete. 2022-02-02T21:39:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 Processor -- start 2022-02-02T21:39:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- start start 2022-02-02T21:39:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 0x7f3608109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3608060470 con 0x7f36080f66d0 2022-02-02T21:39:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.289+0000 7f360f551700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080605b0 con 0x7f36080f5430 2022-02-02T21:39:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44076/0 (socket says 172.21.15.96:44076) 2022-02-02T21:39:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 -- 172.21.15.96:0/3501399277 learned_addr learned my addr 172.21.15.96:0/3501399277 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360e54f700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 0x7f3608109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 -- 172.21.15.96:0/3501399277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 msgr2=0x7f3608109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 0x7f3608109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 -- 172.21.15.96:0/3501399277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f8005040 con 0x7f36080f66d0 2022-02-02T21:39:33.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360dd4e700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 secure :-1 s=READY pgs=3038 cs=0 l=1 rev1=1 rx=0x7f35f8009990 tx=0x7f35f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f8018070 con 0x7f36080f66d0 2022-02-02T21:39:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360810c590 con 0x7f36080f66d0 2022-02-02T21:39:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f35f8007ca0 con 0x7f36080f66d0 2022-02-02T21:39:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f801c620 con 0x7f36080f66d0 2022-02-02T21:39:33.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.290+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360810cac0 con 0x7f36080f66d0 2022-02-02T21:39:33.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.292+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f35f801d960 con 0x7f36080f66d0 2022-02-02T21:39:33.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.292+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608059100 con 0x7f36080f66d0 2022-02-02T21:39:33.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.292+0000 7f35feffd700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 0x7f35f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.292+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f35f80837e0 con 0x7f36080f66d0 2022-02-02T21:39:33.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.292+0000 7f360e54f700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 0x7f35f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.293+0000 7f360e54f700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 0x7f35f40672e0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f3608060060 tx=0x7f3604008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.296+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f35f80519a0 con 0x7f36080f66d0 2022-02-02T21:39:33.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.527+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3608045ad0 con 0x7f36080f66d0 2022-02-02T21:39:33.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.528+0000 7f35feffd700 1 -- 172.21.15.96:0/3501399277 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f35f8054fc0 con 0x7f36080f66d0 2022-02-02T21:39:33.530 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:39:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:39:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:39:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:39:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:39:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:39:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:39:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:39:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:39:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:39:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:39:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:39:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:39:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:39:33.538 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:39:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 msgr2=0x7f35f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 0x7f35f40672e0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f3608060060 tx=0x7f3604008040).stop 2022-02-02T21:39:33.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 msgr2=0x7f360810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 secure :-1 s=READY pgs=3038 cs=0 l=1 rev1=1 rx=0x7f35f8009990 tx=0x7f35f8009b30).stop 2022-02-02T21:39:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 shutdown_connections 2022-02-02T21:39:33.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f35f4064e20 0x7f35f40672e0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36080f5430 0x7f3608109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 --2- 172.21.15.96:0/3501399277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36080f66d0 0x7f360810bf90 unknown :-1 s=CLOSED pgs=3038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 >> 172.21.15.96:0/3501399277 conn(0x7f36080f0b90 msgr2=0x7f36080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 shutdown_connections 2022-02-02T21:39:33.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.530+0000 7f360f551700 1 -- 172.21.15.96:0/3501399277 wait complete. 2022-02-02T21:39:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 -- 172.21.15.96:0/801220393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 msgr2=0x7fc59c0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/801220393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c0f69b0 secure :-1 s=READY pgs=3039 cs=0 l=1 rev1=1 rx=0x7fc588004660 tx=0x7fc588009b30).stop 2022-02-02T21:39:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 -- 172.21.15.96:0/801220393 shutdown_connections 2022-02-02T21:39:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/801220393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c0f69b0 unknown :-1 s=CLOSED pgs=3039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/801220393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 0x7fc59c0f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 -- 172.21.15.96:0/801220393 >> 172.21.15.96:0/801220393 conn(0x7fc59c0f04c0 msgr2=0x7fc59c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:33.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 -- 172.21.15.96:0/801220393 shutdown_connections 2022-02-02T21:39:33.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.627+0000 7fc5a2c59700 1 -- 172.21.15.96:0/801220393 wait complete. 2022-02-02T21:39:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.628+0000 7fc5a2c59700 1 Processor -- start 2022-02-02T21:39:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.628+0000 7fc5a2c59700 1 -- start start 2022-02-02T21:39:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 0x7fc59c105ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c106990 con 0x7fc59c0f6550 2022-02-02T21:39:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c106ad0 con 0x7fc59c0f5bb0 2022-02-02T21:39:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44086/0 (socket says 172.21.15.96:44086) 2022-02-02T21:39:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 -- 172.21.15.96:0/2008284143 learned_addr learned my addr 172.21.15.96:0/2008284143 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:39:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a09f5700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 0x7fc59c105ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 -- 172.21.15.96:0/2008284143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 msgr2=0x7fc59c105ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 0x7fc59c105ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 -- 172.21.15.96:0/2008284143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588005040 con 0x7fc59c0f6550 2022-02-02T21:39:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc59bfff700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 secure :-1 s=READY pgs=3040 cs=0 l=1 rev1=1 rx=0x7fc588009990 tx=0x7fc588009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc588018070 con 0x7fc59c0f6550 2022-02-02T21:39:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c107410 con 0x7fc59c0f6550 2022-02-02T21:39:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc588007ba0 con 0x7fc59c0f6550 2022-02-02T21:39:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58801c3c0 con 0x7fc59c0f6550 2022-02-02T21:39:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.629+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c107970 con 0x7fc59c0f6550 2022-02-02T21:39:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.630+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c045ad0 con 0x7fc59c0f6550 2022-02-02T21:39:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.631+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc58801d420 con 0x7fc59c0f6550 2022-02-02T21:39:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.631+0000 7fc5997fa700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 0x7fc58c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:39:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.631+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc588083770 con 0x7fc59c0f6550 2022-02-02T21:39:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.631+0000 7fc5a09f5700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 0x7fc58c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:39:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.631+0000 7fc5a09f5700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 0x7fc58c067290 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fc59c05eae0 tx=0x7fc59000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:39:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.635+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc588055360 con 0x7fc59c0f6550 2022-02-02T21:39:33.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:33 smithi159 ceph-mon[69013]: from='client.40178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:33 smithi159 ceph-mon[69013]: from='client.40182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:33.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3501399277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:39:33.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.835+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc59c0fddc0 con 0x7fc59c0f6550 2022-02-02T21:39:33.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.836+0000 7fc5997fa700 1 -- 172.21.15.96:0/2008284143 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc588054f50 con 0x7fc59c0f6550 2022-02-02T21:39:33.837 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:39:33.837 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:39:33.838 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:39:33.838 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:39:33.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:33.839 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:39:33.839 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:39:33.839 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:39:33.840 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:39:33.840 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:39:33.840 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:39:33.841 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:39:33.841 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:39:33.841 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:39:33.842 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:39:33.842 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:39:33.842 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:39:33.843 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:39:33.843 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:39:33.844 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:39:33.844 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:39:33.844 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:39:33.845 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:39:33.845 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:39:33.846 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:39:33.846 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:39:33.847 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:39:33.848 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:39:33.849 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:39:33.849 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:39:33.850 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:39:33.850 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:39:33.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:33.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:33.852 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:39:33.852 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:39:33.853 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:33.854 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:33.854 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:39:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 msgr2=0x7fc58c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 0x7fc58c067290 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fc59c05eae0 tx=0x7fc59000b040).stop 2022-02-02T21:39:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 msgr2=0x7fc59c1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:39:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 secure :-1 s=READY pgs=3040 cs=0 l=1 rev1=1 rx=0x7fc588009990 tx=0x7fc588009b30).stop 2022-02-02T21:39:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 shutdown_connections 2022-02-02T21:39:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc58c064dd0 0x7fc58c067290 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc59c0f5bb0 0x7fc59c105ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 --2- 172.21.15.96:0/2008284143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc59c0f6550 0x7fc59c1063e0 unknown :-1 s=CLOSED pgs=3040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:39:33.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 >> 172.21.15.96:0/2008284143 conn(0x7fc59c0f04c0 msgr2=0x7fc59c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:39:33.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 shutdown_connections 2022-02-02T21:39:33.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:39:33.838+0000 7fc5a2c59700 1 -- 172.21.15.96:0/2008284143 wait complete. 2022-02-02T21:39:33.862 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:39:34.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:33 smithi096 ceph-mon[101353]: from='client.40178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:34.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:33 smithi096 ceph-mon[101353]: from='client.40182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:39:34.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3501399277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:39:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2008284143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:39:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:34 smithi159 ceph-mon[69013]: pgmap v5924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2008284143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:39:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:34 smithi096 ceph-mon[101353]: pgmap v5924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:36 smithi159 ceph-mon[69013]: pgmap v5925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:36 smithi096 ceph-mon[101353]: pgmap v5925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:38 smithi159 ceph-mon[69013]: pgmap v5926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:38 smithi096 ceph-mon[101353]: pgmap v5926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:40 smithi159 ceph-mon[69013]: pgmap v5927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:40 smithi096 ceph-mon[101353]: pgmap v5927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:42 smithi159 ceph-mon[69013]: pgmap v5928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:42 smithi096 ceph-mon[101353]: pgmap v5928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:44 smithi159 ceph-mon[69013]: pgmap v5929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:44 smithi096 ceph-mon[101353]: pgmap v5929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:46 smithi159 ceph-mon[69013]: pgmap v5930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:46 smithi096 ceph-mon[101353]: pgmap v5930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:48 smithi159 ceph-mon[69013]: pgmap v5931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:48 smithi096 ceph-mon[101353]: pgmap v5931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:50 smithi159 ceph-mon[69013]: pgmap v5932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:50.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:50 smithi096 ceph-mon[101353]: pgmap v5932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:52 smithi159 ceph-mon[69013]: pgmap v5933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:52 smithi096 ceph-mon[101353]: pgmap v5933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:54 smithi159 ceph-mon[69013]: pgmap v5934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:54 smithi096 ceph-mon[101353]: pgmap v5934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:56 smithi159 ceph-mon[69013]: pgmap v5935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:56 smithi096 ceph-mon[101353]: pgmap v5935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:39:58 smithi159 ceph-mon[69013]: pgmap v5936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:39:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:39:58 smithi096 ceph-mon[101353]: pgmap v5936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:40:00.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:40:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:01 smithi159 ceph-mon[69013]: pgmap v5937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:01 smithi096 ceph-mon[101353]: pgmap v5937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:02 smithi159 ceph-mon[69013]: pgmap v5938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:02 smithi096 ceph-mon[101353]: pgmap v5938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:03.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 -- 172.21.15.96:0/470473974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f7980 msgr2=0x7f64540f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:03.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 --2- 172.21.15.96:0/470473974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f7980 0x7f64540f7de0 secure :-1 s=READY pgs=3041 cs=0 l=1 rev1=1 rx=0x7f6440004660 tx=0x7f6440009b30).stop 2022-02-02T21:40:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 -- 172.21.15.96:0/470473974 shutdown_connections 2022-02-02T21:40:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 --2- 172.21.15.96:0/470473974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f7980 0x7f64540f7de0 unknown :-1 s=CLOSED pgs=3041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:03.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 --2- 172.21.15.96:0/470473974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f66e0 0x7f64540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 -- 172.21.15.96:0/470473974 >> 172.21.15.96:0/470473974 conn(0x7f64540f1e40 msgr2=0x7f64540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 -- 172.21.15.96:0/470473974 shutdown_connections 2022-02-02T21:40:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.947+0000 7f645ad6a700 1 -- 172.21.15.96:0/470473974 wait complete. 2022-02-02T21:40:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 Processor -- start 2022-02-02T21:40:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 -- start start 2022-02-02T21:40:03.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:03.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f7980 0x7f6454069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:03.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645406a380 con 0x7f64540f66e0 2022-02-02T21:40:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.948+0000 7f645ad6a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645406a4c0 con 0x7f64540f7980 2022-02-02T21:40:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:03.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44104/0 (socket says 172.21.15.96:44104) 2022-02-02T21:40:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 -- 172.21.15.96:0/2523327120 learned_addr learned my addr 172.21.15.96:0/2523327120 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6453fff700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f7980 0x7f6454069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:03.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 -- 172.21.15.96:0/2523327120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f7980 msgr2=0x7f6454069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f7980 0x7f6454069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 -- 172.21.15.96:0/2523327120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440005040 con 0x7f64540f66e0 2022-02-02T21:40:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f6458b06700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 secure :-1 s=READY pgs=3042 cs=0 l=1 rev1=1 rx=0x7f644800c790 tx=0x7f6448007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6448013630 con 0x7f64540f66e0 2022-02-02T21:40:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6448012860 con 0x7f64540f66e0 2022-02-02T21:40:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645406a7a0 con 0x7f64540f66e0 2022-02-02T21:40:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6448002780 con 0x7f64540f66e0 2022-02-02T21:40:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.949+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645410ef90 con 0x7f64540f66e0 2022-02-02T21:40:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.950+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6454045ad0 con 0x7f64540f66e0 2022-02-02T21:40:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.951+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6448010070 con 0x7f64540f66e0 2022-02-02T21:40:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.951+0000 7f64517fa700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 0x7f6444067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.952+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6448081b00 con 0x7f64540f66e0 2022-02-02T21:40:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.952+0000 7f6453fff700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 0x7f6444067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.952+0000 7f6453fff700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 0x7f6444067290 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f6440004630 tx=0x7f6440009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:03.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:03.955+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f644804fc00 con 0x7f64540f66e0 2022-02-02T21:40:04.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.132+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64540fefe0 con 0x7f6444064dd0 2022-02-02T21:40:04.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.134+0000 7f64517fa700 1 -- 172.21.15.96:0/2523327120 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f64540fefe0 con 0x7f6444064dd0 2022-02-02T21:40:04.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.135+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 msgr2=0x7f6444067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.135+0000 7f645ad6a700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 0x7f6444067290 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f6440004630 tx=0x7f6440009b30).stop 2022-02-02T21:40:04.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.135+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 msgr2=0x7f645406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.135+0000 7f645ad6a700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 secure :-1 s=READY pgs=3042 cs=0 l=1 rev1=1 rx=0x7f644800c790 tx=0x7f6448007d90).stop 2022-02-02T21:40:04.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 shutdown_connections 2022-02-02T21:40:04.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6444064dd0 0x7f6444067290 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64540f66e0 0x7f645406b9a0 unknown :-1 s=CLOSED pgs=3042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 --2- 172.21.15.96:0/2523327120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64540f7980 0x7f6454069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 >> 172.21.15.96:0/2523327120 conn(0x7f64540f1e40 msgr2=0x7f64540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 shutdown_connections 2022-02-02T21:40:04.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.136+0000 7f645ad6a700 1 -- 172.21.15.96:0/2523327120 wait complete. 2022-02-02T21:40:04.146 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:40:04.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 -- 172.21.15.96:0/2812197009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f55c0 msgr2=0x7f40180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 --2- 172.21.15.96:0/2812197009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f55c0 0x7f40180f59e0 secure :-1 s=READY pgs=3043 cs=0 l=1 rev1=1 rx=0x7f4014004660 tx=0x7f4014009b30).stop 2022-02-02T21:40:04.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 -- 172.21.15.96:0/2812197009 shutdown_connections 2022-02-02T21:40:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 --2- 172.21.15.96:0/2812197009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f6860 0x7f40180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:40:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 --2- 172.21.15.96:0/2812197009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f55c0 0x7f40180f59e0 unknown :-1 s=CLOSED pgs=3043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.232+0000 7f401f945700 1 -- 172.21.15.96:0/2812197009 >> 172.21.15.96:0/2812197009 conn(0x7f40180f0d40 msgr2=0x7f40180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 -- 172.21.15.96:0/2812197009 shutdown_connections 2022-02-02T21:40:04.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 -- 172.21.15.96:0/2812197009 wait complete. 2022-02-02T21:40:04.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 Processor -- start 2022-02-02T21:40:04.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 -- start start 2022-02-02T21:40:04.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f55c0 0x7f4018109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018060450 con 0x7f40180f6860 2022-02-02T21:40:04.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401f945700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018060590 con 0x7f40180f55c0 2022-02-02T21:40:04.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.233+0000 7f401cee0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44116/0 (socket says 172.21.15.96:44116) 2022-02-02T21:40:04.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 -- 172.21.15.96:0/2892857529 learned_addr learned my addr 172.21.15.96:0/2892857529 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:04.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401d6e1700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f55c0 0x7f4018109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 -- 172.21.15.96:0/2892857529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f55c0 msgr2=0x7f4018109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f55c0 0x7f4018109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 -- 172.21.15.96:0/2892857529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014005040 con 0x7f40180f6860 2022-02-02T21:40:04.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401cee0700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 secure :-1 s=READY pgs=3044 cs=0 l=1 rev1=1 rx=0x7f400800b410 tx=0x7f4008006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40080125f0 con 0x7f40180f6860 2022-02-02T21:40:04.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4008012c00 con 0x7f40180f6860 2022-02-02T21:40:04.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401810c7f0 con 0x7f40180f6860 2022-02-02T21:40:04.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4008011d20 con 0x7f40180f6860 2022-02-02T21:40:04.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.234+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401810cdb0 con 0x7f40180f6860 2022-02-02T21:40:04.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.236+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4018045ad0 con 0x7f40180f6860 2022-02-02T21:40:04.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.236+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f400800f030 con 0x7f40180f6860 2022-02-02T21:40:04.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.236+0000 7f400dffb700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 0x7f4004067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.236+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4008081e30 con 0x7f40180f6860 2022-02-02T21:40:04.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.236+0000 7f401d6e1700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 0x7f4004067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.237+0000 7f401d6e1700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 0x7f4004067290 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f4014013690 tx=0x7f4014009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.240+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f400804ff30 con 0x7f40180f6860 2022-02-02T21:40:04.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.413+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40180fdfb0 con 0x7f4004064dd0 2022-02-02T21:40:04.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.422+0000 7f400dffb700 1 -- 172.21.15.96:0/2892857529 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4014019040 con 0x7f4004064dd0 2022-02-02T21:40:04.425 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:40:04.425 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:40:04.426 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:40:04.426 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:40:04.426 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:40:04.427 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:40:04.427 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:40:04.427 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:40:04.428 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:40:04.428 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:40:04.429 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:40:04.429 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:40:04.430 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:40:04.431 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:40:04.431 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:40:04.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:40:04.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:40:04.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:40:04.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:40:04.434 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:40:04.434 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:40:04.434 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:40:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 msgr2=0x7f4004067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 0x7f4004067290 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f4014013690 tx=0x7f4014009b30).stop 2022-02-02T21:40:04.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 msgr2=0x7f401810c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 secure :-1 s=READY pgs=3044 cs=0 l=1 rev1=1 rx=0x7f400800b410 tx=0x7f4008006ef0).stop 2022-02-02T21:40:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 shutdown_connections 2022-02-02T21:40:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4004064dd0 0x7f4004067290 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40180f55c0 0x7f4018109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.424+0000 7f401f945700 1 --2- 172.21.15.96:0/2892857529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40180f6860 0x7f401810c1e0 unknown :-1 s=CLOSED pgs=3044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.425+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 >> 172.21.15.96:0/2892857529 conn(0x7f40180f0d40 msgr2=0x7f40180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.425+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 shutdown_connections 2022-02-02T21:40:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.425+0000 7f401f945700 1 -- 172.21.15.96:0/2892857529 wait complete. 2022-02-02T21:40:04.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 -- 172.21.15.96:0/3842249331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f6a50 msgr2=0x7f01480f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 --2- 172.21.15.96:0/3842249331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f6a50 0x7f01480f6e70 secure :-1 s=READY pgs=3045 cs=0 l=1 rev1=1 rx=0x7f013c004660 tx=0x7f013c009b30).stop 2022-02-02T21:40:04.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 -- 172.21.15.96:0/3842249331 shutdown_connections 2022-02-02T21:40:04.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 --2- 172.21.15.96:0/3842249331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f73f0 0x7f01480f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 --2- 172.21.15.96:0/3842249331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f6a50 0x7f01480f6e70 unknown :-1 s=CLOSED pgs=3045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 -- 172.21.15.96:0/3842249331 >> 172.21.15.96:0/3842249331 conn(0x7f01480f0320 msgr2=0x7f01480f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:04 smithi096 ceph-mon[101353]: from='client.40194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:04.528 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:04 smithi096 ceph-mon[101353]: pgmap v5939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.521+0000 7f014da4d700 1 -- 172.21.15.96:0/3842249331 shutdown_connections 2022-02-02T21:40:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 -- 172.21.15.96:0/3842249331 wait complete. 2022-02-02T21:40:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 Processor -- start 2022-02-02T21:40:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 -- start start 2022-02-02T21:40:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6a50 0x7f0148109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480f5480 con 0x7f01480f73f0 2022-02-02T21:40:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.522+0000 7f014da4d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480f55c0 con 0x7f01480f6a50 2022-02-02T21:40:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44126/0 (socket says 172.21.15.96:44126) 2022-02-02T21:40:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 -- 172.21.15.96:0/1463476992 learned_addr learned my addr 172.21.15.96:0/1463476992 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f014ca4b700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6a50 0x7f0148109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 -- 172.21.15.96:0/1463476992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6a50 msgr2=0x7f0148109a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6a50 0x7f0148109a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 -- 172.21.15.96:0/1463476992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c005040 con 0x7f01480f73f0 2022-02-02T21:40:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f0147fff700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 rx=0x7f013400c530 tx=0x7f0134007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f013400f650 con 0x7f01480f73f0 2022-02-02T21:40:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014810c530 con 0x7f01480f73f0 2022-02-02T21:40:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f013400fc60 con 0x7f01480f73f0 2022-02-02T21:40:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0134012c20 con 0x7f01480f73f0 2022-02-02T21:40:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.523+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014810cac0 con 0x7f01480f73f0 2022-02-02T21:40:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.524+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148045ad0 con 0x7f01480f73f0 2022-02-02T21:40:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.525+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0134010070 con 0x7f01480f73f0 2022-02-02T21:40:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.525+0000 7f01457fa700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 0x7f01380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.525+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f01340816e0 con 0x7f01480f73f0 2022-02-02T21:40:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.525+0000 7f014ca4b700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 0x7f01380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.526+0000 7f014ca4b700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 0x7f01380672e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f013c013690 tx=0x7f013c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.530+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f013404f7e0 con 0x7f01480f73f0 2022-02-02T21:40:04.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.759+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0148027a00 con 0x7f01480f73f0 2022-02-02T21:40:04.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.760+0000 7f01457fa700 1 -- 172.21.15.96:0/1463476992 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0134052e00 con 0x7f01480f73f0 2022-02-02T21:40:04.762 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:40:04.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:40:04.763 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:40:04.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:04.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:40:04.764 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:40:04.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:04.764 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:40:04.765 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:40:04.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:04.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:40:04.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:40:04.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:04.766 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:40:04.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:40:04.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:40:04.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:40:04.768 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:40:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.761+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 msgr2=0x7f01380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.761+0000 7f014da4d700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 0x7f01380672e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f013c013690 tx=0x7f013c009b30).stop 2022-02-02T21:40:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.761+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 msgr2=0x7f014810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.761+0000 7f014da4d700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 rx=0x7f013400c530 tx=0x7f0134007e20).stop 2022-02-02T21:40:04.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 shutdown_connections 2022-02-02T21:40:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0138064e20 0x7f01380672e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01480f6a50 0x7f0148109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 --2- 172.21.15.96:0/1463476992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01480f73f0 0x7f014810bf80 unknown :-1 s=CLOSED pgs=3046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 >> 172.21.15.96:0/1463476992 conn(0x7f01480f0320 msgr2=0x7f01480fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 shutdown_connections 2022-02-02T21:40:04.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.762+0000 7f014da4d700 1 -- 172.21.15.96:0/1463476992 wait complete. 2022-02-02T21:40:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:04 smithi159 ceph-mon[69013]: from='client.40194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:04 smithi159 ceph-mon[69013]: pgmap v5939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:04.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 -- 172.21.15.96:0/2307395135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f77d0 msgr2=0x7f11140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 --2- 172.21.15.96:0/2307395135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f77d0 0x7f11140f7c30 secure :-1 s=READY pgs=3047 cs=0 l=1 rev1=1 rx=0x7f1104004660 tx=0x7f1104009b30).stop 2022-02-02T21:40:04.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 -- 172.21.15.96:0/2307395135 shutdown_connections 2022-02-02T21:40:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 --2- 172.21.15.96:0/2307395135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f77d0 0x7f11140f7c30 unknown :-1 s=CLOSED pgs=3047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 --2- 172.21.15.96:0/2307395135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f6530 0x7f11140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 -- 172.21.15.96:0/2307395135 >> 172.21.15.96:0/2307395135 conn(0x7f11140f1c90 msgr2=0x7f11140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 -- 172.21.15.96:0/2307395135 shutdown_connections 2022-02-02T21:40:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.859+0000 7f111a597700 1 -- 172.21.15.96:0/2307395135 wait complete. 2022-02-02T21:40:04.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 Processor -- start 2022-02-02T21:40:04.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 -- start start 2022-02-02T21:40:04.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 0x7f1114069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111406a380 con 0x7f11140f6530 2022-02-02T21:40:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f111a597700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111406a4c0 con 0x7f11140f77d0 2022-02-02T21:40:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1119595700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1119595700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44134/0 (socket says 172.21.15.96:44134) 2022-02-02T21:40:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1119595700 1 -- 172.21.15.96:0/2413105761 learned_addr learned my addr 172.21.15.96:0/2413105761 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:04.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1118d94700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 0x7f1114069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1119595700 1 -- 172.21.15.96:0/2413105761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 msgr2=0x7f1114069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:04.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.860+0000 7f1119595700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 0x7f1114069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:04.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1119595700 1 -- 172.21.15.96:0/2413105761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104005040 con 0x7f11140f6530 2022-02-02T21:40:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1118d94700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 0x7f1114069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:40:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1119595700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 rx=0x7f1110002700 tx=0x7f1110009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110009320 con 0x7f11140f6530 2022-02-02T21:40:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f111000f040 con 0x7f11140f6530 2022-02-02T21:40:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111406a7a0 con 0x7f11140f6530 2022-02-02T21:40:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110014900 con 0x7f11140f6530 2022-02-02T21:40:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.861+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111410ed50 con 0x7f11140f6530 2022-02-02T21:40:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.862+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114045ad0 con 0x7f11140f6530 2022-02-02T21:40:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.862+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1110009480 con 0x7f11140f6530 2022-02-02T21:40:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.863+0000 7f1109ffb700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 0x7f11000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.863+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1110081be0 con 0x7f11140f6530 2022-02-02T21:40:04.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.863+0000 7f1118d94700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 0x7f11000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.863+0000 7f1118d94700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 0x7f11000672e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f1104004630 tx=0x7f1104009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:04.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:04.867+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f111004fce0 con 0x7f11140f6530 2022-02-02T21:40:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.068+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11140fedf0 con 0x7f11140f6530 2022-02-02T21:40:05.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.069+0000 7f1109ffb700 1 -- 172.21.15.96:0/2413105761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1110053300 con 0x7f11140f6530 2022-02-02T21:40:05.072 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:40:05.073 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:40:05.073 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:40:05.074 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:40:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:05.075 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:40:05.076 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:40:05.076 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:40:05.076 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:40:05.077 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:40:05.077 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:40:05.078 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:40:05.078 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:40:05.078 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:40:05.079 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:40:05.079 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:40:05.079 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:40:05.080 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:40:05.080 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:40:05.080 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:40:05.081 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:40:05.081 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:40:05.082 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:40:05.082 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:40:05.082 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:40:05.083 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:40:05.083 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:40:05.083 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:40:05.084 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:40:05.084 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:40:05.084 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:40:05.085 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:40:05.085 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:05.085 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:05.086 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:40:05.086 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:05.086 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:05.087 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:05.087 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 msgr2=0x7f11000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:05.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 0x7f11000672e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f1104004630 tx=0x7f1104009b30).stop 2022-02-02T21:40:05.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 msgr2=0x7f111406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:05.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 rx=0x7f1110002700 tx=0x7f1110009d80).stop 2022-02-02T21:40:05.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 shutdown_connections 2022-02-02T21:40:05.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1100064e20 0x7f11000672e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:05.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140f6530 0x7f111406b9a0 unknown :-1 s=CLOSED pgs=3048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:05.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 --2- 172.21.15.96:0/2413105761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11140f77d0 0x7f1114069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:05.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 >> 172.21.15.96:0/2413105761 conn(0x7f11140f1c90 msgr2=0x7f11140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:05.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 shutdown_connections 2022-02-02T21:40:05.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:05.071+0000 7f111a597700 1 -- 172.21.15.96:0/2413105761 wait complete. 2022-02-02T21:40:05.092 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:40:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:05 smithi159 ceph-mon[69013]: from='client.40198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:05.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1463476992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:40:05.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2413105761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:40:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:05 smithi096 ceph-mon[101353]: from='client.40198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:05.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1463476992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:40:05.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2413105761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:40:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:06 smithi159 ceph-mon[69013]: pgmap v5940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:06 smithi096 ceph-mon[101353]: pgmap v5940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:08 smithi159 ceph-mon[69013]: pgmap v5941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:08 smithi096 ceph-mon[101353]: pgmap v5941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:10 smithi159 ceph-mon[69013]: pgmap v5942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:10.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:10 smithi096 ceph-mon[101353]: pgmap v5942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:12 smithi159 ceph-mon[69013]: pgmap v5943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:12 smithi096 ceph-mon[101353]: pgmap v5943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:14 smithi159 ceph-mon[69013]: pgmap v5944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:14 smithi096 ceph-mon[101353]: pgmap v5944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:16 smithi159 ceph-mon[69013]: pgmap v5945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:16 smithi096 ceph-mon[101353]: pgmap v5945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:18 smithi159 ceph-mon[69013]: pgmap v5946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:18 smithi096 ceph-mon[101353]: pgmap v5946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:20 smithi159 ceph-mon[69013]: pgmap v5947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:20 smithi096 ceph-mon[101353]: pgmap v5947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:22 smithi159 ceph-mon[69013]: pgmap v5948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:22 smithi096 ceph-mon[101353]: pgmap v5948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:24 smithi159 ceph-mon[69013]: pgmap v5949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:24 smithi096 ceph-mon[101353]: pgmap v5949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:26 smithi159 ceph-mon[69013]: pgmap v5950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:26 smithi096 ceph-mon[101353]: pgmap v5950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:40:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:40:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:40:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:40:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:28 smithi159 ceph-mon[69013]: pgmap v5951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:28 smithi096 ceph-mon[101353]: pgmap v5951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:30.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:30 smithi159 ceph-mon[69013]: pgmap v5952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:30 smithi096 ceph-mon[101353]: pgmap v5952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:32 smithi159 ceph-mon[69013]: pgmap v5953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:32 smithi096 ceph-mon[101353]: pgmap v5953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:34 smithi159 ceph-mon[69013]: pgmap v5954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:34 smithi096 ceph-mon[101353]: pgmap v5954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 -- 172.21.15.96:0/2122111844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f6860 msgr2=0x7f47e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 --2- 172.21.15.96:0/2122111844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f6860 0x7f47e40f6cc0 secure :-1 s=READY pgs=3049 cs=0 l=1 rev1=1 rx=0x7f47cc004660 tx=0x7f47cc009b30).stop 2022-02-02T21:40:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 -- 172.21.15.96:0/2122111844 shutdown_connections 2022-02-02T21:40:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 --2- 172.21.15.96:0/2122111844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f6860 0x7f47e40f6cc0 unknown :-1 s=CLOSED pgs=3049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 --2- 172.21.15.96:0/2122111844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f55c0 0x7f47e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.180+0000 7f47ea44b700 1 -- 172.21.15.96:0/2122111844 >> 172.21.15.96:0/2122111844 conn(0x7f47e40f0d40 msgr2=0x7f47e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:35.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.181+0000 7f47ea44b700 1 -- 172.21.15.96:0/2122111844 shutdown_connections 2022-02-02T21:40:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.181+0000 7f47ea44b700 1 -- 172.21.15.96:0/2122111844 wait complete. 2022-02-02T21:40:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.181+0000 7f47ea44b700 1 Processor -- start 2022-02-02T21:40:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.181+0000 7f47ea44b700 1 -- start start 2022-02-02T21:40:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47ea44b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47ea44b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f6860 0x7f47e4109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47ea44b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e4109bf0 con 0x7f47e40f55c0 2022-02-02T21:40:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47ea44b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e4109d30 con 0x7f47e40f6860 2022-02-02T21:40:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44154/0 (socket says 172.21.15.96:44154) 2022-02-02T21:40:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 -- 172.21.15.96:0/661119054 learned_addr learned my addr 172.21.15.96:0/661119054 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e37fe700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f6860 0x7f47e4109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 -- 172.21.15.96:0/661119054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f6860 msgr2=0x7f47e4109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f6860 0x7f47e4109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 -- 172.21.15.96:0/661119054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc005040 con 0x7f47e40f55c0 2022-02-02T21:40:35.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e3fff700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 secure :-1 s=READY pgs=3050 cs=0 l=1 rev1=1 rx=0x7f47d400c530 tx=0x7f47d4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d400f650 con 0x7f47e40f55c0 2022-02-02T21:40:35.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47d400fc60 con 0x7f47e40f55c0 2022-02-02T21:40:35.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e410a6d0 con 0x7f47e40f55c0 2022-02-02T21:40:35.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.182+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d4012cb0 con 0x7f47e40f55c0 2022-02-02T21:40:35.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.183+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e410ac90 con 0x7f47e40f55c0 2022-02-02T21:40:35.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.184+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e4045ad0 con 0x7f47e40f55c0 2022-02-02T21:40:35.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.184+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47d4019030 con 0x7f47e40f55c0 2022-02-02T21:40:35.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.184+0000 7f47e0ff9700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.185+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f47d4081660 con 0x7f47e40f55c0 2022-02-02T21:40:35.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.185+0000 7f47e37fe700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.185+0000 7f47e37fe700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f47cc004630 tx=0x7f47cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.189+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47d40531e0 con 0x7f47e40f55c0 2022-02-02T21:40:35.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.374+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e410af10 con 0x7f47d0064dd0 2022-02-02T21:40:35.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.375+0000 7f47e0ff9700 1 -- 172.21.15.96:0/661119054 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f47e410af10 con 0x7f47d0064dd0 2022-02-02T21:40:35.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 msgr2=0x7f47d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f47cc004630 tx=0x7f47cc009b30).stop 2022-02-02T21:40:35.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 msgr2=0x7f47e4109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 secure :-1 s=READY pgs=3050 cs=0 l=1 rev1=1 rx=0x7f47d400c530 tx=0x7f47d4007e10).stop 2022-02-02T21:40:35.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 shutdown_connections 2022-02-02T21:40:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d0064dd0 0x7f47d0067290 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47e40f55c0 0x7f47e4109150 unknown :-1 s=CLOSED pgs=3050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 --2- 172.21.15.96:0/661119054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e40f6860 0x7f47e4109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 >> 172.21.15.96:0/661119054 conn(0x7f47e40f0d40 msgr2=0x7f47e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 shutdown_connections 2022-02-02T21:40:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.377+0000 7f47ea44b700 1 -- 172.21.15.96:0/661119054 wait complete. 2022-02-02T21:40:35.388 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:40:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- 172.21.15.96:0/2402823508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 msgr2=0x7fc9040f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 --2- 172.21.15.96:0/2402823508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc9040f6960 secure :-1 s=READY pgs=3051 cs=0 l=1 rev1=1 rx=0x7fc900004660 tx=0x7fc900009b30).stop 2022-02-02T21:40:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- 172.21.15.96:0/2402823508 shutdown_connections 2022-02-02T21:40:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 --2- 172.21.15.96:0/2402823508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc9040f6960 unknown :-1 s=CLOSED pgs=3051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 --2- 172.21.15.96:0/2402823508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 0x7fc9040f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- 172.21.15.96:0/2402823508 >> 172.21.15.96:0/2402823508 conn(0x7fc9040f0540 msgr2=0x7fc9040f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- 172.21.15.96:0/2402823508 shutdown_connections 2022-02-02T21:40:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- 172.21.15.96:0/2402823508 wait complete. 2022-02-02T21:40:35.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 Processor -- start 2022-02-02T21:40:35.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.476+0000 7fc90c587700 1 -- start start 2022-02-02T21:40:35.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 0x7fc904106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9041079e0 con 0x7fc9040f64e0 2022-02-02T21:40:35.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc904107b20 con 0x7fc9040f5bd0 2022-02-02T21:40:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44166/0 (socket says 172.21.15.96:44166) 2022-02-02T21:40:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 -- 172.21.15.96:0/3020453075 learned_addr learned my addr 172.21.15.96:0/3020453075 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90a323700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 0x7fc904106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 -- 172.21.15.96:0/3020453075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 msgr2=0x7fc904106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 0x7fc904106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 -- 172.21.15.96:0/3020453075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900005040 con 0x7fc9040f64e0 2022-02-02T21:40:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc909b22700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 secure :-1 s=READY pgs=3052 cs=0 l=1 rev1=1 rx=0x7fc900009990 tx=0x7fc900009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc900018070 con 0x7fc9040f64e0 2022-02-02T21:40:35.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc900007ba0 con 0x7fc9040f64e0 2022-02-02T21:40:35.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc904108460 con 0x7fc9040f64e0 2022-02-02T21:40:35.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90001c3c0 con 0x7fc9040f64e0 2022-02-02T21:40:35.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.477+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9041089c0 con 0x7fc9040f64e0 2022-02-02T21:40:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.478+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc904045ad0 con 0x7fc9040f64e0 2022-02-02T21:40:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.479+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc90001d420 con 0x7fc9040f64e0 2022-02-02T21:40:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.479+0000 7fc8faffd700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.479+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc9000836b0 con 0x7fc9040f64e0 2022-02-02T21:40:35.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.479+0000 7fc90a323700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.480+0000 7fc90a323700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fc8f4004c40 tx=0x7fc8f400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.483+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc900055240 con 0x7fc9040f64e0 2022-02-02T21:40:35.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.655+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9040fae60 con 0x7fc8f0064dd0 2022-02-02T21:40:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.664+0000 7fc8faffd700 1 -- 172.21.15.96:0/3020453075 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc9040fae60 con 0x7fc8f0064dd0 2022-02-02T21:40:35.666 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:40:35.666 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:40:35.667 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:40:35.667 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:40:35.668 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:40:35.668 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:40:35.668 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:40:35.669 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:40:35.670 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:40:35.670 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:40:35.671 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:40:35.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:40:35.672 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:40:35.673 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:40:35.674 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:40:35.674 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:40:35.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:40:35.675 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:40:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:40:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:40:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:40:35.677 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:40:35.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 msgr2=0x7fc8f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fc8f4004c40 tx=0x7fc8f400b040).stop 2022-02-02T21:40:35.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 msgr2=0x7fc904107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 secure :-1 s=READY pgs=3052 cs=0 l=1 rev1=1 rx=0x7fc900009990 tx=0x7fc900009b30).stop 2022-02-02T21:40:35.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 shutdown_connections 2022-02-02T21:40:35.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8f0064dd0 0x7fc8f0067290 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9040f5bd0 0x7fc904106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 --2- 172.21.15.96:0/3020453075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9040f64e0 0x7fc904107430 unknown :-1 s=CLOSED pgs=3052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 >> 172.21.15.96:0/3020453075 conn(0x7fc9040f0540 msgr2=0x7fc9040f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 shutdown_connections 2022-02-02T21:40:35.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.666+0000 7fc90c587700 1 -- 172.21.15.96:0/3020453075 wait complete. 2022-02-02T21:40:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 -- 172.21.15.96:0/905094371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f5ed0 msgr2=0x7f7e780f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 --2- 172.21.15.96:0/905094371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f5ed0 0x7f7e780f6900 secure :-1 s=READY pgs=3053 cs=0 l=1 rev1=1 rx=0x7f7e68004660 tx=0x7f7e68009b30).stop 2022-02-02T21:40:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 -- 172.21.15.96:0/905094371 shutdown_connections 2022-02-02T21:40:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 --2- 172.21.15.96:0/905094371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f5ed0 0x7f7e780f6900 unknown :-1 s=CLOSED pgs=3053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 --2- 172.21.15.96:0/905094371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f55c0 0x7f7e780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 -- 172.21.15.96:0/905094371 >> 172.21.15.96:0/905094371 conn(0x7f7e780f0dc0 msgr2=0x7f7e780f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:35.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 -- 172.21.15.96:0/905094371 shutdown_connections 2022-02-02T21:40:35.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.763+0000 7f7e7d122700 1 -- 172.21.15.96:0/905094371 wait complete. 2022-02-02T21:40:35.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:35 smithi096 ceph-mon[101353]: from='client.40210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 Processor -- start 2022-02-02T21:40:35.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 -- start start 2022-02-02T21:40:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f5ed0 0x7f7e7810e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78060430 con 0x7f7e780f55c0 2022-02-02T21:40:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7d122700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78060570 con 0x7f7e780f5ed0 2022-02-02T21:40:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e76d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e76d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44174/0 (socket says 172.21.15.96:44174) 2022-02-02T21:40:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e76d9d700 1 -- 172.21.15.96:0/607166665 learned_addr learned my addr 172.21.15.96:0/607166665 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.764+0000 7f7e7659c700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f5ed0 0x7f7e7810e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e76d9d700 1 -- 172.21.15.96:0/607166665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f5ed0 msgr2=0x7f7e7810e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e76d9d700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f5ed0 0x7f7e7810e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e76d9d700 1 -- 172.21.15.96:0/607166665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68005040 con 0x7f7e780f55c0 2022-02-02T21:40:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e76d9d700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 secure :-1 s=READY pgs=3054 cs=0 l=1 rev1=1 rx=0x7f7e6c00e7f0 tx=0x7f7e6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e6c0092e0 con 0x7f7e780f55c0 2022-02-02T21:40:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e6c00f040 con 0x7f7e780f55c0 2022-02-02T21:40:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7810e9e0 con 0x7f7e780f55c0 2022-02-02T21:40:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e6c014750 con 0x7f7e780f55c0 2022-02-02T21:40:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.765+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7810ee60 con 0x7f7e780f55c0 2022-02-02T21:40:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.766+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e78045ad0 con 0x7f7e780f55c0 2022-02-02T21:40:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.766+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e6c01b030 con 0x7f7e780f55c0 2022-02-02T21:40:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.767+0000 7f7e5f7fe700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 0x7f7e60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.767+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7e6c081800 con 0x7f7e780f55c0 2022-02-02T21:40:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.767+0000 7f7e7659c700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 0x7f7e60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.767+0000 7f7e7659c700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 0x7f7e60067290 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f7e68004d80 tx=0x7f7e6800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:35.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:35 smithi159 ceph-mon[69013]: from='client.40210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:35.771+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e6c04f9b0 con 0x7f7e780f55c0 2022-02-02T21:40:36.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.001+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e780586e0 con 0x7f7e780f55c0 2022-02-02T21:40:36.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.001+0000 7f7e5f7fe700 1 -- 172.21.15.96:0/607166665 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7e6c052fd0 con 0x7f7e780f55c0 2022-02-02T21:40:36.003 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:40:36.003 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:40:36.004 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:40:36.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:36.005 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:40:36.005 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:40:36.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:36.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:40:36.006 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:40:36.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:36.007 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:40:36.007 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:40:36.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:40:36.008 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:40:36.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:40:36.009 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:40:36.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:40:36.010 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:40:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 msgr2=0x7f7e60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 0x7f7e60067290 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f7e68004d80 tx=0x7f7e6800b040).stop 2022-02-02T21:40:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 msgr2=0x7f7e7810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 secure :-1 s=READY pgs=3054 cs=0 l=1 rev1=1 rx=0x7f7e6c00e7f0 tx=0x7f7e6c00b040).stop 2022-02-02T21:40:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 shutdown_connections 2022-02-02T21:40:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e60064dd0 0x7f7e60067290 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e780f55c0 0x7f7e7810bff0 unknown :-1 s=CLOSED pgs=3054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 --2- 172.21.15.96:0/607166665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e780f5ed0 0x7f7e7810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 >> 172.21.15.96:0/607166665 conn(0x7f7e780f0dc0 msgr2=0x7f7e780fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 shutdown_connections 2022-02-02T21:40:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.003+0000 7f7e7d122700 1 -- 172.21.15.96:0/607166665 wait complete. 2022-02-02T21:40:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 -- 172.21.15.96:0/4173351673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 msgr2=0x7f49f40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 --2- 172.21.15.96:0/4173351673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f40f6b30 secure :-1 s=READY pgs=3055 cs=0 l=1 rev1=1 rx=0x7f49e4004660 tx=0x7f49e4009b30).stop 2022-02-02T21:40:36.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 -- 172.21.15.96:0/4173351673 shutdown_connections 2022-02-02T21:40:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 --2- 172.21.15.96:0/4173351673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f40f6b30 unknown :-1 s=CLOSED pgs=3055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 --2- 172.21.15.96:0/4173351673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 0x7f49f40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 -- 172.21.15.96:0/4173351673 >> 172.21.15.96:0/4173351673 conn(0x7f49f40f0b90 msgr2=0x7f49f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 -- 172.21.15.96:0/4173351673 shutdown_connections 2022-02-02T21:40:36.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.102+0000 7f49f359e700 1 -- 172.21.15.96:0/4173351673 wait complete. 2022-02-02T21:40:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 Processor -- start 2022-02-02T21:40:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 -- start start 2022-02-02T21:40:36.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 0x7f49f410be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40602b0 con 0x7f49f40f66d0 2022-02-02T21:40:36.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40603f0 con 0x7f49f40f5430 2022-02-02T21:40:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44186/0 (socket says 172.21.15.96:44186) 2022-02-02T21:40:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 -- 172.21.15.96:0/3097950587 learned_addr learned my addr 172.21.15.96:0/3097950587 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:40:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f259c700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 0x7f49f410be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 -- 172.21.15.96:0/3097950587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 msgr2=0x7f49f410be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 0x7f49f410be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 -- 172.21.15.96:0/3097950587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4005040 con 0x7f49f40f66d0 2022-02-02T21:40:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f1d9b700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 rx=0x7f49e4009990 tx=0x7f49e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e4018070 con 0x7f49f40f66d0 2022-02-02T21:40:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49e4007ca0 con 0x7f49f40f66d0 2022-02-02T21:40:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.103+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f410e830 con 0x7f49f40f66d0 2022-02-02T21:40:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.104+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e401c620 con 0x7f49f40f66d0 2022-02-02T21:40:36.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.104+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f410ec00 con 0x7f49f40f66d0 2022-02-02T21:40:36.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.104+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f4059100 con 0x7f49f40f66d0 2022-02-02T21:40:36.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.105+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f49e401d960 con 0x7f49f40f66d0 2022-02-02T21:40:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.105+0000 7f49eaffd700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 0x7f49e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:40:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.105+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49e40837d0 con 0x7f49f40f66d0 2022-02-02T21:40:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.105+0000 7f49f259c700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 0x7f49e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:40:36.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.106+0000 7f49f259c700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 0x7f49e00672e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f49f4060040 tx=0x7f49dc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:40:36.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.110+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49e4051a40 con 0x7f49f40f66d0 2022-02-02T21:40:36.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.311+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49f4045ad0 con 0x7f49f40f66d0 2022-02-02T21:40:36.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.311+0000 7f49eaffd700 1 -- 172.21.15.96:0/3097950587 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f49e4055060 con 0x7f49f40f66d0 2022-02-02T21:40:36.313 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:40:36.314 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:40:36.314 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:40:36.314 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:40:36.315 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:36.315 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:40:36.316 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:40:36.316 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:40:36.316 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:40:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:40:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:40:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:40:36.318 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:40:36.318 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:40:36.318 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:40:36.319 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:40:36.319 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:40:36.319 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:40:36.320 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:40:36.320 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:40:36.320 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:40:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:40:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:40:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:40:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:40:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:40:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:40:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:40:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:40:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:40:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:40:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:40:36.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:36.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:36.325 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:40:36.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:40:36.326 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:36.326 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:36.327 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:40:36.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 msgr2=0x7f49e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 0x7f49e00672e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f49f4060040 tx=0x7f49dc009040).stop 2022-02-02T21:40:36.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 msgr2=0x7f49f410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:40:36.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 rx=0x7f49e4009990 tx=0x7f49e4009b30).stop 2022-02-02T21:40:36.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 shutdown_connections 2022-02-02T21:40:36.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49e0064e20 0x7f49e00672e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f40f5430 0x7f49f410be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 --2- 172.21.15.96:0/3097950587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49f40f66d0 0x7f49f410e340 unknown :-1 s=CLOSED pgs=3056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:40:36.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 >> 172.21.15.96:0/3097950587 conn(0x7f49f40f0b90 msgr2=0x7f49f40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:40:36.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 shutdown_connections 2022-02-02T21:40:36.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:40:36.313+0000 7f49f359e700 1 -- 172.21.15.96:0/3097950587 wait complete. 2022-02-02T21:40:36.332 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:40:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:36 smithi159 ceph-mon[69013]: from='client.40214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/607166665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:40:36.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3097950587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:40:36.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:36 smithi159 ceph-mon[69013]: pgmap v5955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:36 smithi096 ceph-mon[101353]: from='client.40214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:40:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/607166665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:40:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3097950587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:40:36.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:36 smithi096 ceph-mon[101353]: pgmap v5955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:38 smithi159 ceph-mon[69013]: pgmap v5956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:38 smithi096 ceph-mon[101353]: pgmap v5956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:40 smithi159 ceph-mon[69013]: pgmap v5957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:40 smithi096 ceph-mon[101353]: pgmap v5957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:42 smithi159 ceph-mon[69013]: pgmap v5958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:42 smithi096 ceph-mon[101353]: pgmap v5958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:44 smithi159 ceph-mon[69013]: pgmap v5959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:44 smithi096 ceph-mon[101353]: pgmap v5959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:46 smithi159 ceph-mon[69013]: pgmap v5960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:46 smithi096 ceph-mon[101353]: pgmap v5960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:48 smithi159 ceph-mon[69013]: pgmap v5961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:48 smithi096 ceph-mon[101353]: pgmap v5961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:50 smithi159 ceph-mon[69013]: pgmap v5962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:50 smithi096 ceph-mon[101353]: pgmap v5962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:52 smithi159 ceph-mon[69013]: pgmap v5963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:52 smithi096 ceph-mon[101353]: pgmap v5963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:54 smithi159 ceph-mon[69013]: pgmap v5964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:54 smithi096 ceph-mon[101353]: pgmap v5964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:56 smithi159 ceph-mon[69013]: pgmap v5965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:56 smithi096 ceph-mon[101353]: pgmap v5965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:40:58 smithi159 ceph-mon[69013]: pgmap v5966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:40:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:40:58 smithi096 ceph-mon[101353]: pgmap v5966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:00 smithi159 ceph-mon[69013]: pgmap v5967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:00 smithi096 ceph-mon[101353]: pgmap v5967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:02 smithi159 ceph-mon[69013]: pgmap v5968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:02 smithi096 ceph-mon[101353]: pgmap v5968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:04 smithi159 ceph-mon[69013]: pgmap v5969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:04 smithi096 ceph-mon[101353]: pgmap v5969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/2407893031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f6860 msgr2=0x7f8d840f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/2407893031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f6860 0x7f8d840f6cc0 secure :-1 s=READY pgs=3057 cs=0 l=1 rev1=1 rx=0x7f8d74004660 tx=0x7f8d74009b30).stop 2022-02-02T21:41:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/2407893031 shutdown_connections 2022-02-02T21:41:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/2407893031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f6860 0x7f8d840f6cc0 unknown :-1 s=CLOSED pgs=3057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/2407893031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f55c0 0x7f8d840f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:41:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/2407893031 >> 172.21.15.96:0/2407893031 conn(0x7f8d840f0d40 msgr2=0x7f8d840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/2407893031 shutdown_connections 2022-02-02T21:41:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.425+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/2407893031 wait complete. 2022-02-02T21:41:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 Processor -- start 2022-02-02T21:41:06.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 -- start start 2022-02-02T21:41:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f6860 0x7f8d8410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84060470 con 0x7f8d840f55c0 2022-02-02T21:41:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d8a0ce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840605b0 con 0x7f8d840f6860 2022-02-02T21:41:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44204/0 (socket says 172.21.15.96:44204) 2022-02-02T21:41:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d837fe700 1 -- 172.21.15.96:0/4270742583 learned_addr learned my addr 172.21.15.96:0/4270742583 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.426+0000 7f8d82ffd700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f6860 0x7f8d8410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d837fe700 1 -- 172.21.15.96:0/4270742583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f6860 msgr2=0x7f8d8410c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d837fe700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f6860 0x7f8d8410c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d837fe700 1 -- 172.21.15.96:0/4270742583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74005040 con 0x7f8d840f55c0 2022-02-02T21:41:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d837fe700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 secure :-1 s=READY pgs=3058 cs=0 l=1 rev1=1 rx=0x7f8d780093f0 tx=0x7f8d78006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d78013640 con 0x7f8d840f55c0 2022-02-02T21:41:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8410c7c0 con 0x7f8d840f55c0 2022-02-02T21:41:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d78013c50 con 0x7f8d840f55c0 2022-02-02T21:41:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d78012c70 con 0x7f8d840f55c0 2022-02-02T21:41:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.427+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8410cd50 con 0x7f8d840f55c0 2022-02-02T21:41:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.428+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840f49b0 con 0x7f8d840f55c0 2022-02-02T21:41:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.428+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d7801a060 con 0x7f8d840f55c0 2022-02-02T21:41:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.429+0000 7f8d6bfff700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.429+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8d78081a50 con 0x7f8d840f55c0 2022-02-02T21:41:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.429+0000 7f8d82ffd700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.429+0000 7f8d82ffd700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 0x7f8d6c067290 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f8d74004630 tx=0x7f8d74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.433+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d7804faf0 con 0x7f8d840f55c0 2022-02-02T21:41:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.612+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d840fdf60 con 0x7f8d6c064dd0 2022-02-02T21:41:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.613+0000 7f8d6bfff700 1 -- 172.21.15.96:0/4270742583 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8d840fdf60 con 0x7f8d6c064dd0 2022-02-02T21:41:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 msgr2=0x7f8d6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 0x7f8d6c067290 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f8d74004630 tx=0x7f8d74009b30).stop 2022-02-02T21:41:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 msgr2=0x7f8d84109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 secure :-1 s=READY pgs=3058 cs=0 l=1 rev1=1 rx=0x7f8d780093f0 tx=0x7f8d78006ec0).stop 2022-02-02T21:41:06.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 shutdown_connections 2022-02-02T21:41:06.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d840f55c0 0x7f8d84109c60 unknown :-1 s=CLOSED pgs=3058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 --2- 172.21.15.96:0/4270742583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d840f6860 0x7f8d8410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 >> 172.21.15.96:0/4270742583 conn(0x7f8d840f0d40 msgr2=0x7f8d840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:06.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 shutdown_connections 2022-02-02T21:41:06.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.615+0000 7f8d8a0ce700 1 -- 172.21.15.96:0/4270742583 wait complete. 2022-02-02T21:41:06.625 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:41:06.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 -- 172.21.15.96:0/2677760646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f5430 msgr2=0x7f6db00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2677760646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f5430 0x7f6db00f5850 secure :-1 s=READY pgs=3059 cs=0 l=1 rev1=1 rx=0x7f6dac004660 tx=0x7f6dac009b30).stop 2022-02-02T21:41:06.719 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:06 smithi096 ceph-mon[101353]: pgmap v5970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 -- 172.21.15.96:0/2677760646 shutdown_connections 2022-02-02T21:41:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2677760646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f66d0 0x7f6db00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2677760646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f5430 0x7f6db00f5850 unknown :-1 s=CLOSED pgs=3059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 -- 172.21.15.96:0/2677760646 >> 172.21.15.96:0/2677760646 conn(0x7f6db00f0b90 msgr2=0x7f6db00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 -- 172.21.15.96:0/2677760646 shutdown_connections 2022-02-02T21:41:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.718+0000 7f6db66b8700 1 -- 172.21.15.96:0/2677760646 wait complete. 2022-02-02T21:41:06.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 Processor -- start 2022-02-02T21:41:06.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 -- start start 2022-02-02T21:41:06.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 0x7f6db01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0106760 con 0x7f6db00f66d0 2022-02-02T21:41:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db66b8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0106f60 con 0x7f6db00f5430 2022-02-02T21:41:06.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db56b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db56b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:48318/0 (socket says 172.21.15.96:48318) 2022-02-02T21:41:06.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.719+0000 7f6db56b6700 1 -- 172.21.15.96:0/2417974449 learned_addr learned my addr 172.21.15.96:0/2417974449 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:06.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db56b6700 1 -- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 msgr2=0x7f6db01061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db4eb5700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 0x7f6db01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db56b6700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 0x7f6db01061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db56b6700 1 -- 172.21.15.96:0/2417974449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac005040 con 0x7f6db00f5430 2022-02-02T21:41:06.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db4eb5700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 0x7f6db01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:41:06.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db56b6700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6dac013a70 tx=0x7f6dac009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:06.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dac018070 con 0x7f6db00f5430 2022-02-02T21:41:06.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01071e0 con 0x7f6db00f5430 2022-02-02T21:41:06.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6dac0097d0 con 0x7f6db00f5430 2022-02-02T21:41:06.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dac01c3c0 con 0x7f6db00f5430 2022-02-02T21:41:06.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.720+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db0107740 con 0x7f6db00f5430 2022-02-02T21:41:06.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.721+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0059100 con 0x7f6db00f5430 2022-02-02T21:41:06.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.722+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6dac007ba0 con 0x7f6db00f5430 2022-02-02T21:41:06.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.722+0000 7f6da5ffb700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 0x7f6d9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:06.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.722+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6dac083740 con 0x7f6db00f5430 2022-02-02T21:41:06.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.722+0000 7f6db4eb5700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 0x7f6d9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:06.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.722+0000 7f6db4eb5700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 0x7f6d9c0672e0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f6da0009fd0 tx=0x7f6da000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:06.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.726+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6dac055330 con 0x7f6db00f5430 2022-02-02T21:41:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:06 smithi159 ceph-mon[69013]: pgmap v5970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:06.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.897+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6db00fdc60 con 0x7f6d9c064e20 2022-02-02T21:41:06.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.906+0000 7f6da5ffb700 1 -- 172.21.15.96:0/2417974449 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6db00fdc60 con 0x7f6d9c064e20 2022-02-02T21:41:06.907 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:41:06.907 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:41:06.907 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:41:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:41:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:41:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:41:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:41:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:41:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:41:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:41:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:41:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:41:06.911 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:41:06.911 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:41:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:41:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:41:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:41:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:41:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:41:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:41:06.914 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:41:06.914 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:41:06.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 msgr2=0x7f6d9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 0x7f6d9c0672e0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f6da0009fd0 tx=0x7f6da000b040).stop 2022-02-02T21:41:06.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 msgr2=0x7f6db0105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:06.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6dac013a70 tx=0x7f6dac009b30).stop 2022-02-02T21:41:06.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 shutdown_connections 2022-02-02T21:41:06.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d9c064e20 0x7f6d9c0672e0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db00f5430 0x7f6db0105cc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 --2- 172.21.15.96:0/2417974449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6db00f66d0 0x7f6db01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 >> 172.21.15.96:0/2417974449 conn(0x7f6db00f0b90 msgr2=0x7f6db00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 shutdown_connections 2022-02-02T21:41:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:06.908+0000 7f6db66b8700 1 -- 172.21.15.96:0/2417974449 wait complete. 2022-02-02T21:41:07.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 -- 172.21.15.96:0/3135696058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f66d0 msgr2=0x7f59900f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 --2- 172.21.15.96:0/3135696058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f66d0 0x7f59900f6af0 secure :-1 s=READY pgs=3060 cs=0 l=1 rev1=1 rx=0x7f5980004660 tx=0x7f5980009b30).stop 2022-02-02T21:41:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 -- 172.21.15.96:0/3135696058 shutdown_connections 2022-02-02T21:41:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 --2- 172.21.15.96:0/3135696058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f7970 0x7f59900f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 --2- 172.21.15.96:0/3135696058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f66d0 0x7f59900f6af0 unknown :-1 s=CLOSED pgs=3060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 -- 172.21.15.96:0/3135696058 >> 172.21.15.96:0/3135696058 conn(0x7f59900f1e10 msgr2=0x7f59900f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 -- 172.21.15.96:0/3135696058 shutdown_connections 2022-02-02T21:41:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.005+0000 7f59984cf700 1 -- 172.21.15.96:0/3135696058 wait complete. 2022-02-02T21:41:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 Processor -- start 2022-02-02T21:41:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 -- start start 2022-02-02T21:41:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 0x7f599006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599006bbf0 con 0x7f59900f7970 2022-02-02T21:41:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f59984cf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599006bd30 con 0x7f59900f66d0 2022-02-02T21:41:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f5995a6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f5995a6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44226/0 (socket says 172.21.15.96:44226) 2022-02-02T21:41:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.006+0000 7f5995a6a700 1 -- 172.21.15.96:0/4030194947 learned_addr learned my addr 172.21.15.96:0/4030194947 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f599626b700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 0x7f599006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5995a6a700 1 -- 172.21.15.96:0/4030194947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 msgr2=0x7f599006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5995a6a700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 0x7f599006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5995a6a700 1 -- 172.21.15.96:0/4030194947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980005040 con 0x7f59900f7970 2022-02-02T21:41:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f599626b700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 0x7f599006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:41:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5995a6a700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 secure :-1 s=READY pgs=3061 cs=0 l=1 rev1=1 rx=0x7f598c0026d0 tx=0x7f598c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598c009320 con 0x7f59900f7970 2022-02-02T21:41:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599006a730 con 0x7f59900f7970 2022-02-02T21:41:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f598c00f040 con 0x7f59900f7970 2022-02-02T21:41:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599006aca0 con 0x7f59900f7970 2022-02-02T21:41:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.007+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598c0147e0 con 0x7f59900f7970 2022-02-02T21:41:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.009+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f598c009480 con 0x7f59900f7970 2022-02-02T21:41:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.009+0000 7f5986ffd700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 0x7f597c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.009+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59900f5ac0 con 0x7f59900f7970 2022-02-02T21:41:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.009+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f598c082090 con 0x7f59900f7970 2022-02-02T21:41:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.009+0000 7f599626b700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 0x7f597c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.010+0000 7f599626b700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 0x7f597c067290 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f5980004e30 tx=0x7f5980009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.014+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f598c050190 con 0x7f59900f7970 2022-02-02T21:41:07.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.249+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5990062ac0 con 0x7f59900f7970 2022-02-02T21:41:07.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.250+0000 7f5986ffd700 1 -- 172.21.15.96:0/4030194947 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f598c0537b0 con 0x7f59900f7970 2022-02-02T21:41:07.250 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:41:07.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:41:07.251 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:41:07.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:07.252 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:41:07.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:41:07.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:07.253 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:41:07.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:41:07.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:07.254 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:41:07.254 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:41:07.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:07.255 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:41:07.255 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:41:07.255 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:41:07.256 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:41:07.256 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:41:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.251+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 msgr2=0x7f597c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.251+0000 7f59984cf700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 0x7f597c067290 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f5980004e30 tx=0x7f5980009b30).stop 2022-02-02T21:41:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.251+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 msgr2=0x7f599006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.251+0000 7f59984cf700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 secure :-1 s=READY pgs=3061 cs=0 l=1 rev1=1 rx=0x7f598c0026d0 tx=0x7f598c009de0).stop 2022-02-02T21:41:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 shutdown_connections 2022-02-02T21:41:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f597c064dd0 0x7f597c067290 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59900f66d0 0x7f599006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 --2- 172.21.15.96:0/4030194947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59900f7970 0x7f599006a120 unknown :-1 s=CLOSED pgs=3061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 >> 172.21.15.96:0/4030194947 conn(0x7f59900f1e10 msgr2=0x7f59900fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 shutdown_connections 2022-02-02T21:41:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.252+0000 7f59984cf700 1 -- 172.21.15.96:0/4030194947 wait complete. 2022-02-02T21:41:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 -- 172.21.15.96:0/1160638047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 msgr2=0x7f16000f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 --2- 172.21.15.96:0/1160638047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f16000f9320 secure :-1 s=READY pgs=3062 cs=0 l=1 rev1=1 rx=0x7f15f0004660 tx=0x7f15f0009b30).stop 2022-02-02T21:41:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 -- 172.21.15.96:0/1160638047 shutdown_connections 2022-02-02T21:41:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 --2- 172.21.15.96:0/1160638047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 0x7f16000fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 --2- 172.21.15.96:0/1160638047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f16000f9320 unknown :-1 s=CLOSED pgs=3062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 -- 172.21.15.96:0/1160638047 >> 172.21.15.96:0/1160638047 conn(0x7f16000f0d20 msgr2=0x7f16000f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 -- 172.21.15.96:0/1160638047 shutdown_connections 2022-02-02T21:41:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.350+0000 7f1605b16700 1 -- 172.21.15.96:0/1160638047 wait complete. 2022-02-02T21:41:07.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 Processor -- start 2022-02-02T21:41:07.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 -- start start 2022-02-02T21:41:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 0x7f1600107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1600107a00 con 0x7f16000603f0 2022-02-02T21:41:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f1605b16700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1600107b40 con 0x7f16000f98a0 2022-02-02T21:41:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f15ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f15ff7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44234/0 (socket says 172.21.15.96:44234) 2022-02-02T21:41:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.351+0000 7f15ff7fe700 1 -- 172.21.15.96:0/1931008489 learned_addr learned my addr 172.21.15.96:0/1931008489 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15ff7fe700 1 -- 172.21.15.96:0/1931008489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 msgr2=0x7f1600107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15feffd700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 0x7f1600107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15ff7fe700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 0x7f1600107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15ff7fe700 1 -- 172.21.15.96:0/1931008489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0005040 con 0x7f16000603f0 2022-02-02T21:41:07.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15ff7fe700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 secure :-1 s=READY pgs=3063 cs=0 l=1 rev1=1 rx=0x7f15f0009990 tx=0x7f15f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f0018070 con 0x7f16000603f0 2022-02-02T21:41:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1600108480 con 0x7f16000603f0 2022-02-02T21:41:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f15f0007ba0 con 0x7f16000603f0 2022-02-02T21:41:07.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f001c3c0 con 0x7f16000603f0 2022-02-02T21:41:07.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.352+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16001089e0 con 0x7f16000603f0 2022-02-02T21:41:07.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.353+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1600045ad0 con 0x7f16000603f0 2022-02-02T21:41:07.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.353+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f15f001d420 con 0x7f16000603f0 2022-02-02T21:41:07.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.354+0000 7f15f7fff700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 0x7f15ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:07.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.354+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f15f0083760 con 0x7f16000603f0 2022-02-02T21:41:07.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.354+0000 7f15feffd700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 0x7f15ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:07.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.354+0000 7f15feffd700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 0x7f15ec067290 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f16000601c0 tx=0x7f15e800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:07.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.358+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f15f0055230 con 0x7f16000603f0 2022-02-02T21:41:07.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.558+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1600027a00 con 0x7f16000603f0 2022-02-02T21:41:07.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.558+0000 7f15f7fff700 1 -- 172.21.15.96:0/1931008489 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f15f0054e20 con 0x7f16000603f0 2022-02-02T21:41:07.559 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:41:07.560 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:41:07.560 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:41:07.561 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:41:07.561 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:07.561 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:41:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:41:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:41:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:41:07.563 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:41:07.563 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:41:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:41:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:41:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:41:07.565 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:41:07.565 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:41:07.566 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:41:07.566 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:41:07.566 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:41:07.567 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:41:07.567 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:41:07.567 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:41:07.568 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:41:07.568 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:41:07.568 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:41:07.569 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:41:07.569 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:41:07.569 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:41:07.570 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:41:07.570 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:41:07.571 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:41:07.571 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:41:07.571 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:07.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:07.572 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:41:07.572 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:07.573 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:07.573 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:07.573 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:07.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 msgr2=0x7f15ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 0x7f15ec067290 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f16000601c0 tx=0x7f15e800b040).stop 2022-02-02T21:41:07.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 msgr2=0x7f1600106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:07.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 secure :-1 s=READY pgs=3063 cs=0 l=1 rev1=1 rx=0x7f15f0009990 tx=0x7f15f0009b30).stop 2022-02-02T21:41:07.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 shutdown_connections 2022-02-02T21:41:07.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15ec064dd0 0x7f15ec067290 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16000603f0 0x7f1600106f60 unknown :-1 s=CLOSED pgs=3063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 --2- 172.21.15.96:0/1931008489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16000f98a0 0x7f1600107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.560+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 >> 172.21.15.96:0/1931008489 conn(0x7f16000f0d20 msgr2=0x7f16000f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.561+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 shutdown_connections 2022-02-02T21:41:07.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:07.561+0000 7f1605b16700 1 -- 172.21.15.96:0/1931008489 wait complete. 2022-02-02T21:41:07.581 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:41:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:07 smithi159 ceph-mon[69013]: from='client.40226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:07 smithi159 ceph-mon[69013]: from='client.48013 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:07.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4030194947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:41:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:07 smithi096 ceph-mon[101353]: from='client.40226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:07.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:07 smithi096 ceph-mon[101353]: from='client.48013 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:07.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4030194947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:41:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1931008489' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:41:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:08 smithi159 ceph-mon[69013]: pgmap v5971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1931008489' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:41:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:08 smithi096 ceph-mon[101353]: pgmap v5971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:10 smithi159 ceph-mon[69013]: pgmap v5972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:10 smithi096 ceph-mon[101353]: pgmap v5972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:12 smithi159 ceph-mon[69013]: pgmap v5973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:12 smithi096 ceph-mon[101353]: pgmap v5973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:14 smithi159 ceph-mon[69013]: pgmap v5974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:14 smithi096 ceph-mon[101353]: pgmap v5974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:16 smithi159 ceph-mon[69013]: pgmap v5975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:16 smithi096 ceph-mon[101353]: pgmap v5975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:18 smithi159 ceph-mon[69013]: pgmap v5976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:18 smithi096 ceph-mon[101353]: pgmap v5976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:20 smithi159 ceph-mon[69013]: pgmap v5977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:20 smithi096 ceph-mon[101353]: pgmap v5977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:22 smithi159 ceph-mon[69013]: pgmap v5978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:22 smithi096 ceph-mon[101353]: pgmap v5978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:24 smithi159 ceph-mon[69013]: pgmap v5979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:24 smithi096 ceph-mon[101353]: pgmap v5979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:26 smithi159 ceph-mon[69013]: pgmap v5980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:26 smithi096 ceph-mon[101353]: pgmap v5980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:41:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:41:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:41:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:41:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:28 smithi159 ceph-mon[69013]: pgmap v5981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:28 smithi096 ceph-mon[101353]: pgmap v5981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:30 smithi159 ceph-mon[69013]: pgmap v5982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:30.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:30 smithi096 ceph-mon[101353]: pgmap v5982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:32 smithi159 ceph-mon[69013]: pgmap v5983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:32 smithi096 ceph-mon[101353]: pgmap v5983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:34 smithi159 ceph-mon[69013]: pgmap v5984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:34 smithi096 ceph-mon[101353]: pgmap v5984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:36 smithi159 ceph-mon[69013]: pgmap v5985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:36 smithi096 ceph-mon[101353]: pgmap v5985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:37.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- 172.21.15.96:0/2345911040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f6860 msgr2=0x7fe5bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 --2- 172.21.15.96:0/2345911040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc0f6cc0 secure :-1 s=READY pgs=3064 cs=0 l=1 rev1=1 rx=0x7fe5a4004660 tx=0x7fe5a4009b30).stop 2022-02-02T21:41:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- 172.21.15.96:0/2345911040 shutdown_connections 2022-02-02T21:41:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 --2- 172.21.15.96:0/2345911040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc0f6cc0 unknown :-1 s=CLOSED pgs=3064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 --2- 172.21.15.96:0/2345911040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:41:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- 172.21.15.96:0/2345911040 >> 172.21.15.96:0/2345911040 conn(0x7fe5bc0f0d40 msgr2=0x7fe5bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- 172.21.15.96:0/2345911040 shutdown_connections 2022-02-02T21:41:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- 172.21.15.96:0/2345911040 wait complete. 2022-02-02T21:41:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 Processor -- start 2022-02-02T21:41:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.671+0000 7fe5c2942700 1 -- start start 2022-02-02T21:41:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5c2942700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5c2942700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5c2942700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0602b0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5c2942700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0603f0 con 0x7fe5bc0f6860 2022-02-02T21:41:37.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44252/0 (socket says 172.21.15.96:44252) 2022-02-02T21:41:37.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 -- 172.21.15.96:0/1425998419 learned_addr learned my addr 172.21.15.96:0/1425998419 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5b3fff700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 -- 172.21.15.96:0/1425998419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f6860 msgr2=0x7fe5bc10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc10e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 -- 172.21.15.96:0/1425998419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4005040 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.672+0000 7fe5bbfff700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 secure :-1 s=READY pgs=3065 cs=0 l=1 rev1=1 rx=0x7fe5ac0093f0 tx=0x7fe5ac006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:37.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.673+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac009ea0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.673+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc10eac0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.673+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe5ac013af0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.673+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac00db10 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.673+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc10efa0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.674+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc045ad0 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.674+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe5ac01a060 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.674+0000 7fe5b97fa700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 0x7fe5a8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.675+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5ac081a90 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.675+0000 7fe5b3fff700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 0x7fe5a8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.675+0000 7fe5b3fff700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 0x7fe5a8067270 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fe5a4004e30 tx=0x7fe5a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:37.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.679+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe5ac04fb90 con 0x7fe5bc0f55c0 2022-02-02T21:41:37.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.861+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5bc0fdf60 con 0x7fe5a8064db0 2022-02-02T21:41:37.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.862+0000 7fe5b97fa700 1 -- 172.21.15.96:0/1425998419 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe5bc0fdf60 con 0x7fe5a8064db0 2022-02-02T21:41:37.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 msgr2=0x7fe5a8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 0x7fe5a8067270 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fe5a4004e30 tx=0x7fe5a4009b30).stop 2022-02-02T21:41:37.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 msgr2=0x7fe5bc10c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 secure :-1 s=READY pgs=3065 cs=0 l=1 rev1=1 rx=0x7fe5ac0093f0 tx=0x7fe5ac006ec0).stop 2022-02-02T21:41:37.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 shutdown_connections 2022-02-02T21:41:37.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a8064db0 0x7fe5a8067270 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5bc0f55c0 0x7fe5bc10c0d0 unknown :-1 s=CLOSED pgs=3065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 --2- 172.21.15.96:0/1425998419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5bc0f6860 0x7fe5bc10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 >> 172.21.15.96:0/1425998419 conn(0x7fe5bc0f0d40 msgr2=0x7fe5bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:37.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 shutdown_connections 2022-02-02T21:41:37.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.864+0000 7fe5c2942700 1 -- 172.21.15.96:0/1425998419 wait complete. 2022-02-02T21:41:37.873 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:41:37.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 -- 172.21.15.96:0/3922038904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 msgr2=0x7f09ac0f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 --2- 172.21.15.96:0/3922038904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac0f9300 secure :-1 s=READY pgs=3066 cs=0 l=1 rev1=1 rx=0x7f099c004660 tx=0x7f099c009b30).stop 2022-02-02T21:41:37.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 -- 172.21.15.96:0/3922038904 shutdown_connections 2022-02-02T21:41:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 --2- 172.21.15.96:0/3922038904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 --2- 172.21.15.96:0/3922038904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac0f9300 unknown :-1 s=CLOSED pgs=3066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 -- 172.21.15.96:0/3922038904 >> 172.21.15.96:0/3922038904 conn(0x7f09ac0f0d40 msgr2=0x7f09ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 -- 172.21.15.96:0/3922038904 shutdown_connections 2022-02-02T21:41:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.961+0000 7f09b23f6700 1 -- 172.21.15.96:0/3922038904 wait complete. 2022-02-02T21:41:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 Processor -- start 2022-02-02T21:41:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 -- start start 2022-02-02T21:41:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac107a00 con 0x7f09ac0602b0 2022-02-02T21:41:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09b23f6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac107b40 con 0x7f09ac0f9880 2022-02-02T21:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44262/0 (socket says 172.21.15.96:44262) 2022-02-02T21:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.962+0000 7f09abfff700 1 -- 172.21.15.96:0/1494549204 learned_addr learned my addr 172.21.15.96:0/1494549204 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09ab7fe700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09abfff700 1 -- 172.21.15.96:0/1494549204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 msgr2=0x7f09ac107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09abfff700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09abfff700 1 -- 172.21.15.96:0/1494549204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c005040 con 0x7f09ac0602b0 2022-02-02T21:41:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09ab7fe700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:41:37.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09abfff700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 rx=0x7f099c009990 tx=0x7f099c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:37.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c018070 con 0x7f09ac0602b0 2022-02-02T21:41:37.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac108480 con 0x7f09ac0602b0 2022-02-02T21:41:37.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f099c007ca0 con 0x7f09ac0602b0 2022-02-02T21:41:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c01c620 con 0x7f09ac0602b0 2022-02-02T21:41:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.963+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac1089e0 con 0x7f09ac0602b0 2022-02-02T21:41:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.964+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac045ad0 con 0x7f09ac0602b0 2022-02-02T21:41:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.965+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f099c01d960 con 0x7f09ac0602b0 2022-02-02T21:41:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.965+0000 7f09a8ff9700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 0x7f099406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.965+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f099c083710 con 0x7f09ac0602b0 2022-02-02T21:41:37.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.965+0000 7f09ab7fe700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 0x7f099406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:37.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.965+0000 7f09ab7fe700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 0x7f099406b6a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f09a00041d0 tx=0x7f09a0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:37.969+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f099c055300 con 0x7f09ac0602b0 2022-02-02T21:41:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.142+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09ac0fef10 con 0x7f09940691e0 2022-02-02T21:41:38.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.151+0000 7f09a8ff9700 1 -- 172.21.15.96:0/1494549204 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f09ac0fef10 con 0x7f09940691e0 2022-02-02T21:41:38.151 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:41:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:41:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:41:38.153 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:41:38.153 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:41:38.153 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:41:38.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:41:38.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:41:38.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:41:38.155 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:41:38.155 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:41:38.155 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:41:38.156 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:41:38.156 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:41:38.157 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:41:38.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:41:38.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:41:38.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:41:38.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:41:38.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:41:38.159 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:41:38.159 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:41:38.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 msgr2=0x7f099406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 0x7f099406b6a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f09a00041d0 tx=0x7f09a0009040).stop 2022-02-02T21:41:38.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 msgr2=0x7f09ac106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 rx=0x7f099c009990 tx=0x7f099c009b30).stop 2022-02-02T21:41:38.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 shutdown_connections 2022-02-02T21:41:38.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09940691e0 0x7f099406b6a0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09ac0602b0 0x7f09ac106f60 unknown :-1 s=CLOSED pgs=3067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 --2- 172.21.15.96:0/1494549204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ac0f9880 0x7f09ac107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 >> 172.21.15.96:0/1494549204 conn(0x7f09ac0f0d40 msgr2=0x7f09ac0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:38.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 shutdown_connections 2022-02-02T21:41:38.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.153+0000 7f09b23f6700 1 -- 172.21.15.96:0/1494549204 wait complete. 2022-02-02T21:41:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.248+0000 7fe06145c700 1 -- 172.21.15.96:0/3164492119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f77d0 msgr2=0x7fe05c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.248+0000 7fe06145c700 1 --2- 172.21.15.96:0/3164492119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f77d0 0x7fe05c0f7c30 secure :-1 s=READY pgs=3068 cs=0 l=1 rev1=1 rx=0x7fe050004660 tx=0x7fe050009b30).stop 2022-02-02T21:41:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 -- 172.21.15.96:0/3164492119 shutdown_connections 2022-02-02T21:41:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 --2- 172.21.15.96:0/3164492119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f77d0 0x7fe05c0f7c30 unknown :-1 s=CLOSED pgs=3068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 --2- 172.21.15.96:0/3164492119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f6530 0x7fe05c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 -- 172.21.15.96:0/3164492119 >> 172.21.15.96:0/3164492119 conn(0x7fe05c0f1c90 msgr2=0x7fe05c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 -- 172.21.15.96:0/3164492119 shutdown_connections 2022-02-02T21:41:38.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 -- 172.21.15.96:0/3164492119 wait complete. 2022-02-02T21:41:38.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 Processor -- start 2022-02-02T21:41:38.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 -- start start 2022-02-02T21:41:38.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.249+0000 7fe06145c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe06145c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f77d0 0x7fe05c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe06145c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c06a380 con 0x7fe05c0f6530 2022-02-02T21:41:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe06145c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c06a4c0 con 0x7fe05c0f77d0 2022-02-02T21:41:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44270/0 (socket says 172.21.15.96:44270) 2022-02-02T21:41:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 -- 172.21.15.96:0/693295325 learned_addr learned my addr 172.21.15.96:0/693295325 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:38.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05b7fe700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f77d0 0x7fe05c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 -- 172.21.15.96:0/693295325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f77d0 msgr2=0x7fe05c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f77d0 0x7fe05c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 -- 172.21.15.96:0/693295325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050005040 con 0x7fe05c0f6530 2022-02-02T21:41:38.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe05bfff700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 secure :-1 s=READY pgs=3069 cs=0 l=1 rev1=1 rx=0x7fe04c00e7c0 tx=0x7fe04c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:38.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c0092e0 con 0x7fe05c0f6530 2022-02-02T21:41:38.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe04c00f040 con 0x7fe05c0f6530 2022-02-02T21:41:38.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c06a7a0 con 0x7fe05c0f6530 2022-02-02T21:41:38.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c014750 con 0x7fe05c0f6530 2022-02-02T21:41:38.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.250+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c10ed00 con 0x7fe05c0f6530 2022-02-02T21:41:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.252+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe04c01b030 con 0x7fe05c0f6530 2022-02-02T21:41:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.252+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c045ad0 con 0x7fe05c0f6530 2022-02-02T21:41:38.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.252+0000 7fe058ff9700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 0x7fe0440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.253+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe04c081b00 con 0x7fe05c0f6530 2022-02-02T21:41:38.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.253+0000 7fe05b7fe700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 0x7fe0440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.253+0000 7fe05b7fe700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 0x7fe0440672e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fe0500043d0 tx=0x7fe05000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:38.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.257+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe04c0095d0 con 0x7fe05c0f6530 2022-02-02T21:41:38.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.496+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe05c0fee00 con 0x7fe05c0f6530 2022-02-02T21:41:38.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.497+0000 7fe058ff9700 1 -- 172.21.15.96:0/693295325 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe04c0095d0 con 0x7fe05c0f6530 2022-02-02T21:41:38.497 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:41:38.498 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:41:38.498 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:41:38.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:38.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:41:38.499 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:41:38.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:38.500 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:41:38.500 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:41:38.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:38.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:41:38.501 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:41:38.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:41:38.502 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:41:38.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:41:38.503 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:41:38.504 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:41:38.504 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:41:38.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 msgr2=0x7fe0440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 0x7fe0440672e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fe0500043d0 tx=0x7fe05000b040).stop 2022-02-02T21:41:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 msgr2=0x7fe05c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 secure :-1 s=READY pgs=3069 cs=0 l=1 rev1=1 rx=0x7fe04c00e7c0 tx=0x7fe04c00b040).stop 2022-02-02T21:41:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 shutdown_connections 2022-02-02T21:41:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe044064e20 0x7fe0440672e0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05c0f6530 0x7fe05c06b9a0 unknown :-1 s=CLOSED pgs=3069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 --2- 172.21.15.96:0/693295325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe05c0f77d0 0x7fe05c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.498+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 >> 172.21.15.96:0/693295325 conn(0x7fe05c0f1c90 msgr2=0x7fe05c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:38.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.499+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 shutdown_connections 2022-02-02T21:41:38.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.499+0000 7fe06145c700 1 -- 172.21.15.96:0/693295325 wait complete. 2022-02-02T21:41:38.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 -- 172.21.15.96:0/2312205329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 msgr2=0x7f7de00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 --2- 172.21.15.96:0/2312205329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de00f6b00 secure :-1 s=READY pgs=3070 cs=0 l=1 rev1=1 rx=0x7f7dd0004660 tx=0x7f7dd0009b30).stop 2022-02-02T21:41:38.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 -- 172.21.15.96:0/2312205329 shutdown_connections 2022-02-02T21:41:38.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 --2- 172.21.15.96:0/2312205329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 --2- 172.21.15.96:0/2312205329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de00f6b00 unknown :-1 s=CLOSED pgs=3070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 -- 172.21.15.96:0/2312205329 >> 172.21.15.96:0/2312205329 conn(0x7f7de00f1e40 msgr2=0x7f7de00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:38.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 -- 172.21.15.96:0/2312205329 shutdown_connections 2022-02-02T21:41:38.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 -- 172.21.15.96:0/2312205329 wait complete. 2022-02-02T21:41:38.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.596+0000 7f7de750d700 1 Processor -- start 2022-02-02T21:41:38.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de750d700 1 -- start start 2022-02-02T21:41:38.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de750d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de750d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de750d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de006a380 con 0x7f7de00f66e0 2022-02-02T21:41:38.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de750d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de006a4c0 con 0x7f7de00f7980 2022-02-02T21:41:38.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44280/0 (socket says 172.21.15.96:44280) 2022-02-02T21:41:38.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 -- 172.21.15.96:0/190926684 learned_addr learned my addr 172.21.15.96:0/190926684 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:41:38.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de4aa8700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 -- 172.21.15.96:0/190926684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 msgr2=0x7f7de0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 -- 172.21.15.96:0/190926684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0005040 con 0x7f7de00f66e0 2022-02-02T21:41:38.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de4aa8700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:41:38.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7de52a9700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 secure :-1 s=READY pgs=3071 cs=0 l=1 rev1=1 rx=0x7f7dd0013a70 tx=0x7f7dd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:38.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd0018070 con 0x7f7de00f66e0 2022-02-02T21:41:38.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.597+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7dd00097d0 con 0x7f7de00f66e0 2022-02-02T21:41:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.598+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de006a740 con 0x7f7de00f66e0 2022-02-02T21:41:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.598+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd001c3c0 con 0x7f7de00f66e0 2022-02-02T21:41:38.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.598+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de006aca0 con 0x7f7de00f66e0 2022-02-02T21:41:38.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.599+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0045ad0 con 0x7f7de00f66e0 2022-02-02T21:41:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.599+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7dd0007ba0 con 0x7f7de00f66e0 2022-02-02T21:41:38.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.600+0000 7f7dd5ffb700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 0x7f7dcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:41:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.600+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7dd0083640 con 0x7f7de00f66e0 2022-02-02T21:41:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.600+0000 7f7de4aa8700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 0x7f7dcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:41:38.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.600+0000 7f7de4aa8700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 0x7f7dcc067290 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f7ddc004b90 tx=0x7f7ddc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:41:38.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.604+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7dd0051800 con 0x7f7de00f66e0 2022-02-02T21:41:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:38 smithi096 ceph-mon[101353]: from='client.40240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:38 smithi096 ceph-mon[101353]: from='client.40244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:38 smithi096 ceph-mon[101353]: pgmap v5986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/693295325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:41:38.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.810+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7de0027a00 con 0x7f7de00f66e0 2022-02-02T21:41:38.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.810+0000 7f7dd5ffb700 1 -- 172.21.15.96:0/190926684 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7dd0054e20 con 0x7f7de00f66e0 2022-02-02T21:41:38.811 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:41:38.811 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:41:38.811 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:41:38.812 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:41:38.812 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:38.813 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:41:38.813 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:41:38.813 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:41:38.814 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:41:38.814 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:41:38.814 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:41:38.815 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:41:38.815 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:41:38.815 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:41:38.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:41:38.816 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:41:38.816 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:41:38.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:41:38.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:41:38.817 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:41:38.818 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:41:38.818 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:41:38.818 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:41:38.819 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:41:38.819 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:41:38.819 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:41:38.820 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:41:38.820 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:41:38.820 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:41:38.821 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:41:38.821 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:41:38.821 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:41:38.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:38.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:38.823 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:41:38.823 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:41:38.823 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:38.823 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:38.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:41:38.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 msgr2=0x7f7dcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 0x7f7dcc067290 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f7ddc004b90 tx=0x7f7ddc00b040).stop 2022-02-02T21:41:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 msgr2=0x7f7de006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:41:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 secure :-1 s=READY pgs=3071 cs=0 l=1 rev1=1 rx=0x7f7dd0013a70 tx=0x7f7dd0009b30).stop 2022-02-02T21:41:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 shutdown_connections 2022-02-02T21:41:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dcc064dd0 0x7f7dcc067290 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de00f66e0 0x7f7de006b9a0 unknown :-1 s=CLOSED pgs=3071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 --2- 172.21.15.96:0/190926684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de00f7980 0x7f7de0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:41:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 >> 172.21.15.96:0/190926684 conn(0x7f7de00f1e40 msgr2=0x7f7de00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:41:38.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 shutdown_connections 2022-02-02T21:41:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:41:38.812+0000 7f7de750d700 1 -- 172.21.15.96:0/190926684 wait complete. 2022-02-02T21:41:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:41:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:38 smithi159 ceph-mon[69013]: from='client.40240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:38 smithi159 ceph-mon[69013]: from='client.40244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:41:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:38 smithi159 ceph-mon[69013]: pgmap v5986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/693295325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:41:40.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/190926684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:41:40.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/190926684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:41:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:40 smithi159 ceph-mon[69013]: pgmap v5987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:40 smithi096 ceph-mon[101353]: pgmap v5987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:42 smithi159 ceph-mon[69013]: pgmap v5988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:42 smithi096 ceph-mon[101353]: pgmap v5988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:44 smithi159 ceph-mon[69013]: pgmap v5989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:44 smithi096 ceph-mon[101353]: pgmap v5989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:46 smithi159 ceph-mon[69013]: pgmap v5990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:46 smithi096 ceph-mon[101353]: pgmap v5990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:48 smithi159 ceph-mon[69013]: pgmap v5991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:48 smithi096 ceph-mon[101353]: pgmap v5991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:50 smithi159 ceph-mon[69013]: pgmap v5992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:50 smithi096 ceph-mon[101353]: pgmap v5992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:52 smithi159 ceph-mon[69013]: pgmap v5993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:52 smithi096 ceph-mon[101353]: pgmap v5993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:54 smithi159 ceph-mon[69013]: pgmap v5994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:54 smithi096 ceph-mon[101353]: pgmap v5994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:56 smithi159 ceph-mon[69013]: pgmap v5995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:56 smithi096 ceph-mon[101353]: pgmap v5995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:41:58 smithi159 ceph-mon[69013]: pgmap v5996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:41:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:41:58 smithi096 ceph-mon[101353]: pgmap v5996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:00 smithi159 ceph-mon[69013]: pgmap v5997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:00 smithi096 ceph-mon[101353]: pgmap v5997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:02 smithi159 ceph-mon[69013]: pgmap v5998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:02 smithi096 ceph-mon[101353]: pgmap v5998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:04 smithi159 ceph-mon[69013]: pgmap v5999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:04 smithi096 ceph-mon[101353]: pgmap v5999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:06 smithi159 ceph-mon[69013]: pgmap v6000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:06 smithi096 ceph-mon[101353]: pgmap v6000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.917+0000 7f95796ff700 1 -- 172.21.15.96:0/220738158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f5460 msgr2=0x7f95740f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.917+0000 7f95796ff700 1 --2- 172.21.15.96:0/220738158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f5460 0x7f95740f5880 secure :-1 s=READY pgs=3072 cs=0 l=1 rev1=1 rx=0x7f9568004660 tx=0x7f9568009b30).stop 2022-02-02T21:42:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 -- 172.21.15.96:0/220738158 shutdown_connections 2022-02-02T21:42:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 --2- 172.21.15.96:0/220738158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f6700 0x7f95740f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:08.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 --2- 172.21.15.96:0/220738158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f5460 0x7f95740f5880 unknown :-1 s=CLOSED pgs=3072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:08.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 -- 172.21.15.96:0/220738158 >> 172.21.15.96:0/220738158 conn(0x7f95740f0bc0 msgr2=0x7f95740f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 -- 172.21.15.96:0/220738158 shutdown_connections 2022-02-02T21:42:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 -- 172.21.15.96:0/220738158 wait complete. 2022-02-02T21:42:08.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 Processor -- start 2022-02-02T21:42:08.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.918+0000 7f95796ff700 1 -- start start 2022-02-02T21:42:08.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f5460 0x7f9574109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:08.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:08.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740603e0 con 0x7f95740f6700 2022-02-02T21:42:08.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9574060520 con 0x7f95740f5460 2022-02-02T21:42:08.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:08.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44302/0 (socket says 172.21.15.96:44302) 2022-02-02T21:42:08.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 -- 172.21.15.96:0/1041781924 learned_addr learned my addr 172.21.15.96:0/1041781924 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:08.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f9572ffd700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f5460 0x7f9574109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:08.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 -- 172.21.15.96:0/1041781924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f5460 msgr2=0x7f9574109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:08.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f5460 0x7f9574109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:08.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 -- 172.21.15.96:0/1041781924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568005040 con 0x7f95740f6700 2022-02-02T21:42:08.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95727fc700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 secure :-1 s=READY pgs=3073 cs=0 l=1 rev1=1 rx=0x7f95640026d0 tx=0x7f9564009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:08.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95640079c0 con 0x7f95740f6700 2022-02-02T21:42:08.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f956400f040 con 0x7f95740f6700 2022-02-02T21:42:08.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957410c540 con 0x7f95740f6700 2022-02-02T21:42:08.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95640148b0 con 0x7f95740f6700 2022-02-02T21:42:08.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.919+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957410cb00 con 0x7f95740f6700 2022-02-02T21:42:08.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.921+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9574045ad0 con 0x7f95740f6700 2022-02-02T21:42:08.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.921+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9564007b20 con 0x7f95740f6700 2022-02-02T21:42:08.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.921+0000 7f955b7fe700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 0x7f955c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:08.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.921+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95640819e0 con 0x7f95740f6700 2022-02-02T21:42:08.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.921+0000 7f9572ffd700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 0x7f955c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:08.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.922+0000 7f9572ffd700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 0x7f955c0672e0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f9568013690 tx=0x7f9568009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:08.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:08.926+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f956404fae0 con 0x7f95740f6700 2022-02-02T21:42:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:08 smithi159 ceph-mon[69013]: pgmap v6001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:08 smithi096 ceph-mon[101353]: pgmap v6001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:09.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.104+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95740fdd90 con 0x7f955c064e20 2022-02-02T21:42:09.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.106+0000 7f955b7fe700 1 -- 172.21.15.96:0/1041781924 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f95740fdd90 con 0x7f955c064e20 2022-02-02T21:42:09.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 msgr2=0x7f955c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 0x7f955c0672e0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f9568013690 tx=0x7f9568009b30).stop 2022-02-02T21:42:09.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 msgr2=0x7f957410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 secure :-1 s=READY pgs=3073 cs=0 l=1 rev1=1 rx=0x7f95640026d0 tx=0x7f9564009de0).stop 2022-02-02T21:42:09.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 shutdown_connections 2022-02-02T21:42:09.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f955c064e20 0x7f955c0672e0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95740f5460 0x7f9574109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 --2- 172.21.15.96:0/1041781924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95740f6700 0x7f957410bf90 unknown :-1 s=CLOSED pgs=3073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.107+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 >> 172.21.15.96:0/1041781924 conn(0x7f95740f0bc0 msgr2=0x7f95740fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.108+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 shutdown_connections 2022-02-02T21:42:09.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.108+0000 7f95796ff700 1 -- 172.21.15.96:0/1041781924 wait complete. 2022-02-02T21:42:09.118 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:42:09.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- 172.21.15.96:0/232925828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 msgr2=0x7f6f7c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 --2- 172.21.15.96:0/232925828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c0f59e0 secure :-1 s=READY pgs=3074 cs=0 l=1 rev1=1 rx=0x7f6f70004660 tx=0x7f6f70009b30).stop 2022-02-02T21:42:09.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- 172.21.15.96:0/232925828 shutdown_connections 2022-02-02T21:42:09.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 --2- 172.21.15.96:0/232925828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 0x7f6f7c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 --2- 172.21.15.96:0/232925828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c0f59e0 unknown :-1 s=CLOSED pgs=3074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- 172.21.15.96:0/232925828 >> 172.21.15.96:0/232925828 conn(0x7f6f7c0f0d40 msgr2=0x7f6f7c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- 172.21.15.96:0/232925828 shutdown_connections 2022-02-02T21:42:09.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- 172.21.15.96:0/232925828 wait complete. 2022-02-02T21:42:09.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 Processor -- start 2022-02-02T21:42:09.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- start start 2022-02-02T21:42:09.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 0x7f6f7c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.205+0000 7f6f808af700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c106950 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f808af700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c107160 con 0x7f6f7c0f6860 2022-02-02T21:42:09.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44310/0 (socket says 172.21.15.96:44310) 2022-02-02T21:42:09.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 -- 172.21.15.96:0/3345520910 learned_addr learned my addr 172.21.15.96:0/3345520910 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:09.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f79d9b700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 0x7f6f7c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 -- 172.21.15.96:0/3345520910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 msgr2=0x7f6f7c106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 0x7f6f7c106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 -- 172.21.15.96:0/3345520910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70005040 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f7a59c700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 secure :-1 s=READY pgs=3075 cs=0 l=1 rev1=1 rx=0x7f6f70013a70 tx=0x7f6f70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f70018070 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c107380 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f700097d0 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7001de80 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.206+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c1078e0 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.207+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c0f49b0 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.208+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f70007ba0 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.208+0000 7f6f6affd700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.208+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f70083660 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.208+0000 7f6f79d9b700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.209+0000 7f6f79d9b700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f6f6c004ce0 tx=0x7f6f6c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.213+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f70051760 con 0x7f6f7c0f55c0 2022-02-02T21:42:09.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.383+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f7c0008d0 con 0x7f6f64064dd0 2022-02-02T21:42:09.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.393+0000 7f6f6affd700 1 -- 172.21.15.96:0/3345520910 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6f7c0008d0 con 0x7f6f64064dd0 2022-02-02T21:42:09.395 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:42:09.395 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:42:09.396 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:42:09.396 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:42:09.396 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:42:09.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:42:09.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:42:09.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:42:09.398 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:42:09.398 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:42:09.399 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:42:09.399 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:42:09.399 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:42:09.400 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:42:09.400 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:42:09.400 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:42:09.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:42:09.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:42:09.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:42:09.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:42:09.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:42:09.402 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:42:09.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 msgr2=0x7f6f64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f6f6c004ce0 tx=0x7f6f6c00b040).stop 2022-02-02T21:42:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 msgr2=0x7f6f7c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 secure :-1 s=READY pgs=3075 cs=0 l=1 rev1=1 rx=0x7f6f70013a70 tx=0x7f6f70009b30).stop 2022-02-02T21:42:09.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 shutdown_connections 2022-02-02T21:42:09.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f7c0f55c0 0x7f6f7c105e60 unknown :-1 s=CLOSED pgs=3075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 --2- 172.21.15.96:0/3345520910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f7c0f6860 0x7f6f7c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.395+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 >> 172.21.15.96:0/3345520910 conn(0x7f6f7c0f0d40 msgr2=0x7f6f7c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.396+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 shutdown_connections 2022-02-02T21:42:09.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.396+0000 7f6f808af700 1 -- 172.21.15.96:0/3345520910 wait complete. 2022-02-02T21:42:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 -- 172.21.15.96:0/914737251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f4ac0 msgr2=0x7f7eb00f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/914737251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb00f4ee0 secure :-1 s=READY pgs=3076 cs=0 l=1 rev1=1 rx=0x7f7ea4004660 tx=0x7f7ea4009b30).stop 2022-02-02T21:42:09.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 -- 172.21.15.96:0/914737251 shutdown_connections 2022-02-02T21:42:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/914737251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f53d0 0x7f7eb00f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/914737251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb00f4ee0 unknown :-1 s=CLOSED pgs=3076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 -- 172.21.15.96:0/914737251 >> 172.21.15.96:0/914737251 conn(0x7f7eb00f0540 msgr2=0x7f7eb00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 -- 172.21.15.96:0/914737251 shutdown_connections 2022-02-02T21:42:09.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.492+0000 7f7eb85c7700 1 -- 172.21.15.96:0/914737251 wait complete. 2022-02-02T21:42:09.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 Processor -- start 2022-02-02T21:42:09.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 -- start start 2022-02-02T21:42:09.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb01071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0107c50 con 0x7f7eb00f53d0 2022-02-02T21:42:09.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb85c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0107d90 con 0x7f7eb00f4ac0 2022-02-02T21:42:09.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44322/0 (socket says 172.21.15.96:44322) 2022-02-02T21:42:09.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 -- 172.21.15.96:0/3671339679 learned_addr learned my addr 172.21.15.96:0/3671339679 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:09.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb6363700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb01071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 -- 172.21.15.96:0/3671339679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f4ac0 msgr2=0x7f7eb01071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb01071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 -- 172.21.15.96:0/3671339679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4005040 con 0x7f7eb00f53d0 2022-02-02T21:42:09.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.493+0000 7f7eb5b62700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 secure :-1 s=READY pgs=3077 cs=0 l=1 rev1=1 rx=0x7f7eac00c790 tx=0x7f7eac007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.494+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eac002590 con 0x7f7eb00f53d0 2022-02-02T21:42:09.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.494+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7eac002ba0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.494+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0108730 con 0x7f7eb00f53d0 2022-02-02T21:42:09.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.494+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eac013d90 con 0x7f7eb00f53d0 2022-02-02T21:42:09.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.494+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0108cf0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.495+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb0045ad0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.495+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7eac01a060 con 0x7f7eb00f53d0 2022-02-02T21:42:09.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.495+0000 7f7ea2ffd700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 0x7f7e9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.495+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7eac081cf0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.496+0000 7f7eb6363700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 0x7f7e9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.496+0000 7f7eb6363700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 0x7f7e9c067290 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f7ea4004630 tx=0x7f7ea4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.500+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7eac0537c0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.728+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7eb005f560 con 0x7f7eb00f53d0 2022-02-02T21:42:09.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.728+0000 7f7ea2ffd700 1 -- 172.21.15.96:0/3671339679 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7eac0182e0 con 0x7f7eb00f53d0 2022-02-02T21:42:09.732 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:42:09.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:42:09.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:42:09.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:09.737 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:42:09.738 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:42:09.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:09.740 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:42:09.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:42:09.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:09.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:42:09.744 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:42:09.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:09.745 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:42:09.745 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:42:09.745 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:42:09.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:42:09.746 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:42:09.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 msgr2=0x7f7e9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 0x7f7e9c067290 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f7ea4004630 tx=0x7f7ea4009b30).stop 2022-02-02T21:42:09.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 msgr2=0x7f7eb01076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 secure :-1 s=READY pgs=3077 cs=0 l=1 rev1=1 rx=0x7f7eac00c790 tx=0x7f7eac007d70).stop 2022-02-02T21:42:09.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 shutdown_connections 2022-02-02T21:42:09.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e9c064dd0 0x7f7e9c067290 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7eb00f4ac0 0x7f7eb01071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 --2- 172.21.15.96:0/3671339679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7eb00f53d0 0x7f7eb01076a0 unknown :-1 s=CLOSED pgs=3077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 >> 172.21.15.96:0/3671339679 conn(0x7f7eb00f0540 msgr2=0x7f7eb00fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 shutdown_connections 2022-02-02T21:42:09.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.730+0000 7f7eb85c7700 1 -- 172.21.15.96:0/3671339679 wait complete. 2022-02-02T21:42:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 -- 172.21.15.96:0/2175479743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 msgr2=0x7f549c0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 --2- 172.21.15.96:0/2175479743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c0f7dd0 secure :-1 s=READY pgs=3078 cs=0 l=1 rev1=1 rx=0x7f5490004660 tx=0x7f5490009b30).stop 2022-02-02T21:42:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 -- 172.21.15.96:0/2175479743 shutdown_connections 2022-02-02T21:42:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 --2- 172.21.15.96:0/2175479743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c0f7dd0 unknown :-1 s=CLOSED pgs=3078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 --2- 172.21.15.96:0/2175479743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 -- 172.21.15.96:0/2175479743 >> 172.21.15.96:0/2175479743 conn(0x7f549c0f1e50 msgr2=0x7f549c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 -- 172.21.15.96:0/2175479743 shutdown_connections 2022-02-02T21:42:09.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.827+0000 7f54a163b700 1 -- 172.21.15.96:0/2175479743 wait complete. 2022-02-02T21:42:09.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 Processor -- start 2022-02-02T21:42:09.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 -- start start 2022-02-02T21:42:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c109bf0 con 0x7f549c0f7970 2022-02-02T21:42:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f54a163b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c109d30 con 0x7f549c0f66d0 2022-02-02T21:42:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.828+0000 7f549a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44332/0 (socket says 172.21.15.96:44332) 2022-02-02T21:42:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 -- 172.21.15.96:0/1250329111 learned_addr learned my addr 172.21.15.96:0/1250329111 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549affd700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 -- 172.21.15.96:0/1250329111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 msgr2=0x7f549c109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 -- 172.21.15.96:0/1250329111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490005040 con 0x7f549c0f7970 2022-02-02T21:42:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549affd700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:42:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f549a7fc700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 secure :-1 s=READY pgs=3079 cs=0 l=1 rev1=1 rx=0x7f5490009990 tx=0x7f5490009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490018070 con 0x7f549c0f7970 2022-02-02T21:42:09.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5490007ca0 con 0x7f549c0f7970 2022-02-02T21:42:09.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c10a670 con 0x7f549c0f7970 2022-02-02T21:42:09.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549001c620 con 0x7f549c0f7970 2022-02-02T21:42:09.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.829+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c10abd0 con 0x7f549c0f7970 2022-02-02T21:42:09.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.830+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c045ad0 con 0x7f549c0f7970 2022-02-02T21:42:09.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.831+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f549001d960 con 0x7f549c0f7970 2022-02-02T21:42:09.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.831+0000 7f54837fe700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 0x7f5484067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:09.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.831+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5490083970 con 0x7f549c0f7970 2022-02-02T21:42:09.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.831+0000 7f549affd700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 0x7f5484067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:09.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.832+0000 7f549affd700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 0x7f5484067290 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f549c0f77d0 tx=0x7f548c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:09.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:09.835+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f54900554a0 con 0x7f549c0f7970 2022-02-02T21:42:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:09 smithi159 ceph-mon[69013]: from='client.40256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:09 smithi159 ceph-mon[69013]: from='client.40260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:10.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.035+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f549c027a00 con 0x7f549c0f7970 2022-02-02T21:42:10.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:09 smithi096 ceph-mon[101353]: from='client.40256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:10.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:09 smithi096 ceph-mon[101353]: from='client.40260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:10.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.036+0000 7f54837fe700 1 -- 172.21.15.96:0/1250329111 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5490055090 con 0x7f549c0f7970 2022-02-02T21:42:10.038 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:42:10.038 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:42:10.039 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:42:10.039 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:42:10.039 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:10.040 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:42:10.040 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:42:10.041 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:42:10.041 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:42:10.041 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:42:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:42:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:42:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:42:10.043 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:42:10.043 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:42:10.043 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:42:10.044 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:42:10.044 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:42:10.044 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:42:10.045 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:42:10.045 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:42:10.045 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:42:10.046 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:42:10.047 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:42:10.048 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:42:10.048 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:42:10.049 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:42:10.049 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:42:10.050 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:42:10.051 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:42:10.051 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:42:10.052 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:42:10.052 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:10.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:10.053 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:42:10.054 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:10.054 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:10.055 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:10.056 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:10.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.037+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 msgr2=0x7f5484067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:10.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.037+0000 7f54a163b700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 0x7f5484067290 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f549c0f77d0 tx=0x7f548c009040).stop 2022-02-02T21:42:10.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.037+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 msgr2=0x7f549c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:10.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.037+0000 7f54a163b700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 secure :-1 s=READY pgs=3079 cs=0 l=1 rev1=1 rx=0x7f5490009990 tx=0x7f5490009b30).stop 2022-02-02T21:42:10.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 shutdown_connections 2022-02-02T21:42:10.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5484064dd0 0x7f5484067290 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:10.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f549c0f66d0 0x7f549c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:10.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 --2- 172.21.15.96:0/1250329111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f549c0f7970 0x7f549c109640 unknown :-1 s=CLOSED pgs=3079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:10.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 >> 172.21.15.96:0/1250329111 conn(0x7f549c0f1e50 msgr2=0x7f549c0f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:10.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 shutdown_connections 2022-02-02T21:42:10.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:10.038+0000 7f54a163b700 1 -- 172.21.15.96:0/1250329111 wait complete. 2022-02-02T21:42:10.061 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:42:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3671339679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:42:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1250329111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:42:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:10 smithi159 ceph-mon[69013]: pgmap v6002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3671339679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:42:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1250329111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:42:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:10 smithi096 ceph-mon[101353]: pgmap v6002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:12 smithi159 ceph-mon[69013]: pgmap v6003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:12 smithi096 ceph-mon[101353]: pgmap v6003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:14 smithi159 ceph-mon[69013]: pgmap v6004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:14 smithi096 ceph-mon[101353]: pgmap v6004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:16 smithi159 ceph-mon[69013]: pgmap v6005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:16 smithi096 ceph-mon[101353]: pgmap v6005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:18 smithi159 ceph-mon[69013]: pgmap v6006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:18 smithi096 ceph-mon[101353]: pgmap v6006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:20 smithi159 ceph-mon[69013]: pgmap v6007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:20 smithi096 ceph-mon[101353]: pgmap v6007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:22 smithi159 ceph-mon[69013]: pgmap v6008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:22 smithi096 ceph-mon[101353]: pgmap v6008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:24 smithi159 ceph-mon[69013]: pgmap v6009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:24 smithi096 ceph-mon[101353]: pgmap v6009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:26 smithi159 ceph-mon[69013]: pgmap v6010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:26 smithi096 ceph-mon[101353]: pgmap v6010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:42:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:42:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:42:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:42:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:28 smithi159 ceph-mon[69013]: pgmap v6011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:28 smithi096 ceph-mon[101353]: pgmap v6011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:30 smithi159 ceph-mon[69013]: pgmap v6012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:30 smithi096 ceph-mon[101353]: pgmap v6012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:32 smithi159 ceph-mon[69013]: pgmap v6013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:32 smithi096 ceph-mon[101353]: pgmap v6013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:34 smithi159 ceph-mon[69013]: pgmap v6014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:34 smithi096 ceph-mon[101353]: pgmap v6014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:36 smithi159 ceph-mon[69013]: pgmap v6015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:36 smithi096 ceph-mon[101353]: pgmap v6015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:38.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:38 smithi159 ceph-mon[69013]: pgmap v6016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:38 smithi096 ceph-mon[101353]: pgmap v6016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:40.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 -- 172.21.15.96:0/3878199795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 msgr2=0x7f3d6c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 --2- 172.21.15.96:0/3878199795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c0f59e0 secure :-1 s=READY pgs=3080 cs=0 l=1 rev1=1 rx=0x7f3d60004660 tx=0x7f3d60009b30).stop 2022-02-02T21:42:40.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 -- 172.21.15.96:0/3878199795 shutdown_connections 2022-02-02T21:42:40.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 --2- 172.21.15.96:0/3878199795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 --2- 172.21.15.96:0/3878199795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c0f59e0 unknown :-1 s=CLOSED pgs=3080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 -- 172.21.15.96:0/3878199795 >> 172.21.15.96:0/3878199795 conn(0x7f3d6c0f0d40 msgr2=0x7f3d6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 -- 172.21.15.96:0/3878199795 shutdown_connections 2022-02-02T21:42:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.149+0000 7f3d708ff700 1 -- 172.21.15.96:0/3878199795 wait complete. 2022-02-02T21:42:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 Processor -- start 2022-02-02T21:42:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 -- start start 2022-02-02T21:42:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c106950 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d708ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c107160 con 0x7f3d6c0f6860 2022-02-02T21:42:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44350/0 (socket says 172.21.15.96:44350) 2022-02-02T21:42:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 -- 172.21.15.96:0/2826709726 learned_addr learned my addr 172.21.15.96:0/2826709726 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d69d9b700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 -- 172.21.15.96:0/2826709726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 msgr2=0x7f3d6c106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 -- 172.21.15.96:0/2826709726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60005040 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.150+0000 7f3d6a59c700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 secure :-1 s=READY pgs=3081 cs=0 l=1 rev1=1 rx=0x7f3d60014040 tx=0x7f3d6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.151+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6001b070 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.151+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d60007e70 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.151+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c107380 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.151+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d60014d10 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.151+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c1078e0 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.152+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c0f49b0 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.152+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d60027070 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.152+0000 7f3d5affd700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 0x7f3d54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.153+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3d600846d0 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.153+0000 7f3d69d9b700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 0x7f3d54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.153+0000 7f3d69d9b700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 0x7f3d54067290 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f3d5c009fd0 tx=0x7f3d5c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.157+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d600527d0 con 0x7f3d6c0f55c0 2022-02-02T21:42:40.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.332+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d6c05f620 con 0x7f3d54064dd0 2022-02-02T21:42:40.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.334+0000 7f3d5affd700 1 -- 172.21.15.96:0/2826709726 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3d6c05f620 con 0x7f3d54064dd0 2022-02-02T21:42:40.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 msgr2=0x7f3d54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 0x7f3d54067290 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f3d5c009fd0 tx=0x7f3d5c00b040).stop 2022-02-02T21:42:40.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 msgr2=0x7f3d6c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 secure :-1 s=READY pgs=3081 cs=0 l=1 rev1=1 rx=0x7f3d60014040 tx=0x7f3d6000b040).stop 2022-02-02T21:42:40.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 shutdown_connections 2022-02-02T21:42:40.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d54064dd0 0x7f3d54067290 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c105e60 unknown :-1 s=CLOSED pgs=3081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 --2- 172.21.15.96:0/2826709726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 >> 172.21.15.96:0/2826709726 conn(0x7f3d6c0f0d40 msgr2=0x7f3d6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.335+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 shutdown_connections 2022-02-02T21:42:40.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.336+0000 7f3d708ff700 1 -- 172.21.15.96:0/2826709726 wait complete. 2022-02-02T21:42:40.345 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:42:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 -- 172.21.15.96:0/3608689013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 msgr2=0x7f7cb80f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 --2- 172.21.15.96:0/3608689013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb80f7b80 secure :-1 s=READY pgs=3082 cs=0 l=1 rev1=1 rx=0x7f7ca4004660 tx=0x7f7ca4009b30).stop 2022-02-02T21:42:40.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 -- 172.21.15.96:0/3608689013 shutdown_connections 2022-02-02T21:42:40.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 --2- 172.21.15.96:0/3608689013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb80f7b80 unknown :-1 s=CLOSED pgs=3082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 --2- 172.21.15.96:0/3608689013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb80f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 -- 172.21.15.96:0/3608689013 >> 172.21.15.96:0/3608689013 conn(0x7f7cb80f0320 msgr2=0x7f7cb80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 -- 172.21.15.96:0/3608689013 shutdown_connections 2022-02-02T21:42:40.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.433+0000 7f7cbd841700 1 -- 172.21.15.96:0/3608689013 wait complete. 2022-02-02T21:42:40.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 Processor -- start 2022-02-02T21:42:40.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 -- start start 2022-02-02T21:42:40.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb8106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8107980 con 0x7f7cb80f5240 2022-02-02T21:42:40.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.434+0000 7f7cbd841700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8107ac0 con 0x7f7cb80f48a0 2022-02-02T21:42:40.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44362/0 (socket says 172.21.15.96:44362) 2022-02-02T21:42:40.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 -- 172.21.15.96:0/172451951 learned_addr learned my addr 172.21.15.96:0/172451951 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:40.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cbc83f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb8106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 -- 172.21.15.96:0/172451951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 msgr2=0x7f7cb8106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb8106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 -- 172.21.15.96:0/172451951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4005040 con 0x7f7cb80f5240 2022-02-02T21:42:40.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cbc83f700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb8106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:42:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb7fff700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 secure :-1 s=READY pgs=3083 cs=0 l=1 rev1=1 rx=0x7f7ca4014040 tx=0x7f7ca400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca4019070 con 0x7f7cb80f5240 2022-02-02T21:42:40.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8108400 con 0x7f7cb80f5240 2022-02-02T21:42:40.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ca4007e70 con 0x7f7cb80f5240 2022-02-02T21:42:40.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca4014d10 con 0x7f7cb80f5240 2022-02-02T21:42:40.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.435+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8108960 con 0x7f7cb80f5240 2022-02-02T21:42:40.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.436+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb8045ad0 con 0x7f7cb80f5240 2022-02-02T21:42:40.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.437+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ca4025070 con 0x7f7cb80f5240 2022-02-02T21:42:40.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.437+0000 7f7cb57fa700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.437+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ca4082a40 con 0x7f7cb80f5240 2022-02-02T21:42:40.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.437+0000 7f7cbc83f700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.437+0000 7f7cbc83f700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f7cac009fd0 tx=0x7f7cac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.441+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ca4054570 con 0x7f7cb80f5240 2022-02-02T21:42:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.612+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cb80fef50 con 0x7f7ca8064e20 2022-02-02T21:42:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.622+0000 7f7cb57fa700 1 -- 172.21.15.96:0/172451951 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7cb80fef50 con 0x7f7ca8064e20 2022-02-02T21:42:40.623 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:42:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:42:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:42:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:42:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:42:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:42:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:42:40.626 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:42:40.626 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:42:40.626 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:42:40.627 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:42:40.627 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:42:40.627 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:42:40.628 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:42:40.628 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:42:40.628 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:42:40.629 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:42:40.629 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:42:40.630 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:42:40.630 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:42:40.630 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:42:40.631 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:42:40.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 msgr2=0x7f7ca80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f7cac009fd0 tx=0x7f7cac00b040).stop 2022-02-02T21:42:40.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 msgr2=0x7f7cb81073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 secure :-1 s=READY pgs=3083 cs=0 l=1 rev1=1 rx=0x7f7ca4014040 tx=0x7f7ca400b040).stop 2022-02-02T21:42:40.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 shutdown_connections 2022-02-02T21:42:40.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ca8064e20 0x7f7ca80672e0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb80f48a0 0x7f7cb8106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 --2- 172.21.15.96:0/172451951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cb80f5240 0x7f7cb81073d0 unknown :-1 s=CLOSED pgs=3083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.624+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 >> 172.21.15.96:0/172451951 conn(0x7f7cb80f0320 msgr2=0x7f7cb80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.625+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 shutdown_connections 2022-02-02T21:42:40.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.625+0000 7f7cbd841700 1 -- 172.21.15.96:0/172451951 wait complete. 2022-02-02T21:42:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 -- 172.21.15.96:0/3641996802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 msgr2=0x7f1e100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 --2- 172.21.15.96:0/3641996802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e100f6cc0 secure :-1 s=READY pgs=3084 cs=0 l=1 rev1=1 rx=0x7f1dfc004660 tx=0x7f1dfc009b30).stop 2022-02-02T21:42:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 -- 172.21.15.96:0/3641996802 shutdown_connections 2022-02-02T21:42:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 --2- 172.21.15.96:0/3641996802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e100f6cc0 unknown :-1 s=CLOSED pgs=3084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 --2- 172.21.15.96:0/3641996802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 0x7f1e100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 -- 172.21.15.96:0/3641996802 >> 172.21.15.96:0/3641996802 conn(0x7f1e100f0d40 msgr2=0x7f1e100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 -- 172.21.15.96:0/3641996802 shutdown_connections 2022-02-02T21:42:40.726 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:40 smithi096 ceph-mon[101353]: from='client.40272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:40.727 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:40 smithi096 ceph-mon[101353]: pgmap v6017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.721+0000 7f1e17037700 1 -- 172.21.15.96:0/3641996802 wait complete. 2022-02-02T21:42:40.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 Processor -- start 2022-02-02T21:42:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 -- start start 2022-02-02T21:42:40.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 0x7f1e10105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10106920 con 0x7f1e100f6860 2022-02-02T21:42:40.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e17037700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10107130 con 0x7f1e100f55c0 2022-02-02T21:42:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44372/0 (socket says 172.21.15.96:44372) 2022-02-02T21:42:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e0ffff700 1 -- 172.21.15.96:0/2258641614 learned_addr learned my addr 172.21.15.96:0/2258641614 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.722+0000 7f1e14dd3700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 0x7f1e10105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0ffff700 1 -- 172.21.15.96:0/2258641614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 msgr2=0x7f1e10105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0ffff700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 0x7f1e10105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0ffff700 1 -- 172.21.15.96:0/2258641614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc005040 con 0x7f1e100f6860 2022-02-02T21:42:40.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0ffff700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 secure :-1 s=READY pgs=3085 cs=0 l=1 rev1=1 rx=0x7f1dfc000c00 tx=0x7f1dfc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dfc019070 con 0x7f1e100f6860 2022-02-02T21:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1dfc007e70 con 0x7f1e100f6860 2022-02-02T21:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dfc014ce0 con 0x7f1e100f6860 2022-02-02T21:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e10107350 con 0x7f1e100f6860 2022-02-02T21:42:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.723+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e10107860 con 0x7f1e100f6860 2022-02-02T21:42:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.725+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e100f49b0 con 0x7f1e100f6860 2022-02-02T21:42:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.725+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1dfc025070 con 0x7f1e100f6860 2022-02-02T21:42:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.725+0000 7f1e0d7fa700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 0x7f1e00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.725+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1dfc0829a0 con 0x7f1e100f6860 2022-02-02T21:42:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.725+0000 7f1e14dd3700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 0x7f1e00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.726+0000 7f1e14dd3700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 0x7f1e00067290 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f1e10105ba0 tx=0x7f1e0400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.729+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1dfc050aa0 con 0x7f1e100f6860 2022-02-02T21:42:40.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:40 smithi159 ceph-mon[69013]: from='client.40272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:40.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:40 smithi159 ceph-mon[69013]: pgmap v6017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:40.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.962+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e100fdf10 con 0x7f1e100f6860 2022-02-02T21:42:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.962+0000 7f1e0d7fa700 1 -- 172.21.15.96:0/2258641614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1e100fdf10 con 0x7f1e100f6860 2022-02-02T21:42:40.964 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:42:40.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:42:40.965 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:42:40.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:40.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:42:40.966 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:42:40.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:40.967 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:42:40.967 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:42:40.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:40.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:42:40.968 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:42:40.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:42:40.969 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:42:40.969 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:42:40.969 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:42:40.970 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:42:40.970 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:42:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 msgr2=0x7f1e00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 0x7f1e00067290 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f1e10105ba0 tx=0x7f1e0400b040).stop 2022-02-02T21:42:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 msgr2=0x7f1e10106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 secure :-1 s=READY pgs=3085 cs=0 l=1 rev1=1 rx=0x7f1dfc000c00 tx=0x7f1dfc00b040).stop 2022-02-02T21:42:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 shutdown_connections 2022-02-02T21:42:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e00064dd0 0x7f1e00067290 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e100f55c0 0x7f1e10105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 --2- 172.21.15.96:0/2258641614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e100f6860 0x7f1e10106320 unknown :-1 s=CLOSED pgs=3085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 >> 172.21.15.96:0/2258641614 conn(0x7f1e100f0d40 msgr2=0x7f1e100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 shutdown_connections 2022-02-02T21:42:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:40.964+0000 7f1e17037700 1 -- 172.21.15.96:0/2258641614 wait complete. 2022-02-02T21:42:41.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 -- 172.21.15.96:0/3606833924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 msgr2=0x7f9d980f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 --2- 172.21.15.96:0/3606833924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d980f5850 secure :-1 s=READY pgs=3086 cs=0 l=1 rev1=1 rx=0x7f9d88004660 tx=0x7f9d88009b30).stop 2022-02-02T21:42:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 -- 172.21.15.96:0/3606833924 shutdown_connections 2022-02-02T21:42:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 --2- 172.21.15.96:0/3606833924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d980f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 --2- 172.21.15.96:0/3606833924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d980f5850 unknown :-1 s=CLOSED pgs=3086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 -- 172.21.15.96:0/3606833924 >> 172.21.15.96:0/3606833924 conn(0x7f9d980f0b90 msgr2=0x7f9d980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 -- 172.21.15.96:0/3606833924 shutdown_connections 2022-02-02T21:42:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.061+0000 7f9d9c929700 1 -- 172.21.15.96:0/3606833924 wait complete. 2022-02-02T21:42:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 Processor -- start 2022-02-02T21:42:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 -- start start 2022-02-02T21:42:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d9810bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98060420 con 0x7f9d980f5430 2022-02-02T21:42:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d9c929700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98060560 con 0x7f9d980f66d0 2022-02-02T21:42:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44380/0 (socket says 172.21.15.96:44380) 2022-02-02T21:42:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d977fe700 1 -- 172.21.15.96:0/779332486 learned_addr learned my addr 172.21.15.96:0/779332486 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:42:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.062+0000 7f9d96ffd700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d9810bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d977fe700 1 -- 172.21.15.96:0/779332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 msgr2=0x7f9d9810bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d977fe700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d9810bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d977fe700 1 -- 172.21.15.96:0/779332486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88005040 con 0x7f9d980f5430 2022-02-02T21:42:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d96ffd700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d9810bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:42:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d977fe700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 secure :-1 s=READY pgs=3087 cs=0 l=1 rev1=1 rx=0x7f9d88013a70 tx=0x7f9d88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d88018070 con 0x7f9d980f5430 2022-02-02T21:42:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9810c490 con 0x7f9d980f5430 2022-02-02T21:42:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d880097d0 con 0x7f9d980f5430 2022-02-02T21:42:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8801c3c0 con 0x7f9d980f5430 2022-02-02T21:42:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.063+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9810c9c0 con 0x7f9d980f5430 2022-02-02T21:42:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.064+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d98059100 con 0x7f9d980f5430 2022-02-02T21:42:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.064+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9d88007ba0 con 0x7f9d980f5430 2022-02-02T21:42:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.065+0000 7f9d7ffff700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 0x7f9d800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:42:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.065+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9d880836d0 con 0x7f9d980f5430 2022-02-02T21:42:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.065+0000 7f9d96ffd700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 0x7f9d800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:42:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.065+0000 7f9d96ffd700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 0x7f9d800672e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f9d8c009760 tx=0x7f9d8c009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:42:41.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.069+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9d88051890 con 0x7f9d980f5430 2022-02-02T21:42:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.268+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d980fdbf0 con 0x7f9d980f5430 2022-02-02T21:42:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.268+0000 7f9d7ffff700 1 -- 172.21.15.96:0/779332486 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9d88054eb0 con 0x7f9d980f5430 2022-02-02T21:42:41.270 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:42:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:42:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:42:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:42:41.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:41.272 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:42:41.272 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:42:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:42:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:42:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:42:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:42:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:42:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:42:41.275 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:42:41.275 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:42:41.276 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:42:41.276 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:42:41.277 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:42:41.277 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:42:41.277 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:42:41.278 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:42:41.278 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:42:41.279 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:42:41.279 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:42:41.279 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:42:41.279 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:42:41.280 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:42:41.280 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:42:41.280 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:42:41.281 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:42:41.281 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:42:41.281 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:42:41.282 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:41.282 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:41.283 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:42:41.283 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:42:41.283 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:41.284 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:41.284 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:42:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 msgr2=0x7f9d800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 0x7f9d800672e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f9d8c009760 tx=0x7f9d8c009c60).stop 2022-02-02T21:42:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 msgr2=0x7f9d981099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:42:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 secure :-1 s=READY pgs=3087 cs=0 l=1 rev1=1 rx=0x7f9d88013a70 tx=0x7f9d88009b30).stop 2022-02-02T21:42:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 shutdown_connections 2022-02-02T21:42:41.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9d80064e20 0x7f9d800672e0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d980f5430 0x7f9d981099e0 unknown :-1 s=CLOSED pgs=3087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 --2- 172.21.15.96:0/779332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d980f66d0 0x7f9d9810bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:42:41.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 >> 172.21.15.96:0/779332486 conn(0x7f9d980f0b90 msgr2=0x7f9d980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:42:41.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 shutdown_connections 2022-02-02T21:42:41.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:42:41.270+0000 7f9d9c929700 1 -- 172.21.15.96:0/779332486 wait complete. 2022-02-02T21:42:41.289 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:42:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:41 smithi159 ceph-mon[69013]: from='client.40276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2258641614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:42:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/779332486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:42:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:41 smithi096 ceph-mon[101353]: from='client.40276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:42:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2258641614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:42:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/779332486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:42:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:42 smithi159 ceph-mon[69013]: pgmap v6018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:42 smithi096 ceph-mon[101353]: pgmap v6018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:44 smithi159 ceph-mon[69013]: pgmap v6019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:44 smithi096 ceph-mon[101353]: pgmap v6019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:46 smithi159 ceph-mon[69013]: pgmap v6020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:46 smithi096 ceph-mon[101353]: pgmap v6020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:48 smithi159 ceph-mon[69013]: pgmap v6021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:48 smithi096 ceph-mon[101353]: pgmap v6021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:50 smithi159 ceph-mon[69013]: pgmap v6022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:50 smithi096 ceph-mon[101353]: pgmap v6022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:52 smithi159 ceph-mon[69013]: pgmap v6023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:52 smithi096 ceph-mon[101353]: pgmap v6023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:54 smithi159 ceph-mon[69013]: pgmap v6024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:54 smithi096 ceph-mon[101353]: pgmap v6024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:56 smithi159 ceph-mon[69013]: pgmap v6025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:56 smithi096 ceph-mon[101353]: pgmap v6025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:42:58 smithi159 ceph-mon[69013]: pgmap v6026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:42:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:42:58 smithi096 ceph-mon[101353]: pgmap v6026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:00 smithi159 ceph-mon[69013]: pgmap v6027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:00 smithi096 ceph-mon[101353]: pgmap v6027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:02 smithi159 ceph-mon[69013]: pgmap v6028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:02 smithi096 ceph-mon[101353]: pgmap v6028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:04 smithi159 ceph-mon[69013]: pgmap v6029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:04 smithi096 ceph-mon[101353]: pgmap v6029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:06 smithi159 ceph-mon[69013]: pgmap v6030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:06 smithi096 ceph-mon[101353]: pgmap v6030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:08 smithi159 ceph-mon[69013]: pgmap v6031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:08 smithi096 ceph-mon[101353]: pgmap v6031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:10 smithi159 ceph-mon[69013]: pgmap v6032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:10 smithi096 ceph-mon[101353]: pgmap v6032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:11.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- 172.21.15.96:0/1243868974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 msgr2=0x7fd4fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1243868974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc0f59e0 secure :-1 s=READY pgs=3088 cs=0 l=1 rev1=1 rx=0x7fd4f8004660 tx=0x7fd4f8009b30).stop 2022-02-02T21:43:11.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- 172.21.15.96:0/1243868974 shutdown_connections 2022-02-02T21:43:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1243868974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:43:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1243868974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc0f59e0 unknown :-1 s=CLOSED pgs=3088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- 172.21.15.96:0/1243868974 >> 172.21.15.96:0/1243868974 conn(0x7fd4fc0f0d40 msgr2=0x7fd4fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:11.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- 172.21.15.96:0/1243868974 shutdown_connections 2022-02-02T21:43:11.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- 172.21.15.96:0/1243868974 wait complete. 2022-02-02T21:43:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 Processor -- start 2022-02-02T21:43:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.383+0000 7fd5040ff700 1 -- start start 2022-02-02T21:43:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc060470 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0605b0 con 0x7fd4fc0f6860 2022-02-02T21:43:11.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44400/0 (socket says 172.21.15.96:44400) 2022-02-02T21:43:11.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 -- 172.21.15.96:0/1242186477 learned_addr learned my addr 172.21.15.96:0/1242186477 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:11.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd50169a700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 -- 172.21.15.96:0/1242186477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 msgr2=0x7fd4fc10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 -- 172.21.15.96:0/1242186477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8005040 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd50169a700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:43:11.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd501e9b700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 secure :-1 s=READY pgs=3089 cs=0 l=1 rev1=1 rx=0x7fd4f8004f60 tx=0x7fd4f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8018070 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc10c7c0 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd4f8007ba0 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f801c620 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.384+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc10ccf0 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.385+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc045ad0 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.386+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd4f801c8e0 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.386+0000 7fd4f27fc700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 0x7fd4e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.387+0000 7fd50169a700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 0x7fd4e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.387+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd4f8083960 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.387+0000 7fd50169a700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 0x7fd4e8067290 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fd4ec00b830 tx=0x7fd4ec008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.391+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd4f8051b20 con 0x7fd4fc0f55c0 2022-02-02T21:43:11.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.566+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4fc0fdf40 con 0x7fd4e8064dd0 2022-02-02T21:43:11.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.568+0000 7fd4f27fc700 1 -- 172.21.15.96:0/1242186477 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd4fc0fdf40 con 0x7fd4e8064dd0 2022-02-02T21:43:11.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.569+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 msgr2=0x7fd4e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.569+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 0x7fd4e8067290 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fd4ec00b830 tx=0x7fd4ec008040).stop 2022-02-02T21:43:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.569+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 msgr2=0x7fd4fc109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.569+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 secure :-1 s=READY pgs=3089 cs=0 l=1 rev1=1 rx=0x7fd4f8004f60 tx=0x7fd4f8009b30).stop 2022-02-02T21:43:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 shutdown_connections 2022-02-02T21:43:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd4e8064dd0 0x7fd4e8067290 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4fc0f55c0 0x7fd4fc109cc0 unknown :-1 s=CLOSED pgs=3089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 --2- 172.21.15.96:0/1242186477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4fc0f6860 0x7fd4fc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 >> 172.21.15.96:0/1242186477 conn(0x7fd4fc0f0d40 msgr2=0x7fd4fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 shutdown_connections 2022-02-02T21:43:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.570+0000 7fd5040ff700 1 -- 172.21.15.96:0/1242186477 wait complete. 2022-02-02T21:43:11.579 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:43:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 -- 172.21.15.96:0/4192937251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 msgr2=0x7f1e940f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 --2- 172.21.15.96:0/4192937251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e940f6b00 secure :-1 s=READY pgs=3090 cs=0 l=1 rev1=1 rx=0x7f1e84004660 tx=0x7f1e84009b30).stop 2022-02-02T21:43:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 -- 172.21.15.96:0/4192937251 shutdown_connections 2022-02-02T21:43:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 --2- 172.21.15.96:0/4192937251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 0x7f1e940f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 --2- 172.21.15.96:0/4192937251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e940f6b00 unknown :-1 s=CLOSED pgs=3090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 -- 172.21.15.96:0/4192937251 >> 172.21.15.96:0/4192937251 conn(0x7f1e940f1e40 msgr2=0x7f1e940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 -- 172.21.15.96:0/4192937251 shutdown_connections 2022-02-02T21:43:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.668+0000 7f1e98a39700 1 -- 172.21.15.96:0/4192937251 wait complete. 2022-02-02T21:43:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 Processor -- start 2022-02-02T21:43:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 -- start start 2022-02-02T21:43:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 0x7f1e941074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94107a50 con 0x7f1e940f66e0 2022-02-02T21:43:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e98a39700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94107b90 con 0x7f1e940f7980 2022-02-02T21:43:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44410/0 (socket says 172.21.15.96:44410) 2022-02-02T21:43:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 -- 172.21.15.96:0/3125458809 learned_addr learned my addr 172.21.15.96:0/3125458809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e91d9b700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 0x7f1e941074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 -- 172.21.15.96:0/3125458809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 msgr2=0x7f1e941074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 0x7f1e941074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.669+0000 7f1e9259c700 1 -- 172.21.15.96:0/3125458809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84005040 con 0x7f1e940f66e0 2022-02-02T21:43:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e9259c700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 secure :-1 s=READY pgs=3091 cs=0 l=1 rev1=1 rx=0x7f1e84009830 tx=0x7f1e84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e84018070 con 0x7f1e940f66e0 2022-02-02T21:43:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e84007ba0 con 0x7f1e940f66e0 2022-02-02T21:43:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941084d0 con 0x7f1e940f66e0 2022-02-02T21:43:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8401de60 con 0x7f1e940f66e0 2022-02-02T21:43:11.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.670+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e94108a30 con 0x7f1e940f66e0 2022-02-02T21:43:11.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.671+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94045ad0 con 0x7f1e940f66e0 2022-02-02T21:43:11.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.671+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e84007d10 con 0x7f1e940f66e0 2022-02-02T21:43:11.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.671+0000 7f1e8affd700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 0x7f1e80067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.672+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1e84083590 con 0x7f1e940f66e0 2022-02-02T21:43:11.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.672+0000 7f1e91d9b700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 0x7f1e80067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.672+0000 7f1e91d9b700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 0x7f1e80067270 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f1e7c004c40 tx=0x7f1e7c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.676+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e84055060 con 0x7f1e940f66e0 2022-02-02T21:43:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.849+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e940fefb0 con 0x7f1e80064db0 2022-02-02T21:43:11.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.859+0000 7f1e8affd700 1 -- 172.21.15.96:0/3125458809 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1e940fefb0 con 0x7f1e80064db0 2022-02-02T21:43:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:43:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:43:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:43:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:43:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:43:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:43:11.862 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:43:11.862 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:43:11.862 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:43:11.863 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:43:11.863 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:43:11.864 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:43:11.864 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:43:11.864 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:43:11.865 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:43:11.865 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:43:11.865 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:43:11.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:43:11.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:43:11.866 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:43:11.867 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:43:11.867 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:43:11.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.861+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 msgr2=0x7f1e80067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.861+0000 7f1e98a39700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 0x7f1e80067270 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f1e7c004c40 tx=0x7f1e7c00b040).stop 2022-02-02T21:43:11.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.861+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 msgr2=0x7f1e94106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.861+0000 7f1e98a39700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 secure :-1 s=READY pgs=3091 cs=0 l=1 rev1=1 rx=0x7f1e84009830 tx=0x7f1e84009b30).stop 2022-02-02T21:43:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 shutdown_connections 2022-02-02T21:43:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e80064db0 0x7f1e80067270 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f66e0 0x7f1e94106fb0 unknown :-1 s=CLOSED pgs=3091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 --2- 172.21.15.96:0/3125458809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f7980 0x7f1e941074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 >> 172.21.15.96:0/3125458809 conn(0x7f1e940f1e40 msgr2=0x7f1e940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 shutdown_connections 2022-02-02T21:43:11.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.862+0000 7f1e98a39700 1 -- 172.21.15.96:0/3125458809 wait complete. 2022-02-02T21:43:11.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 -- 172.21.15.96:0/202241253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f7980 msgr2=0x7f19780f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 --2- 172.21.15.96:0/202241253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f7980 0x7f19780f7de0 secure :-1 s=READY pgs=3092 cs=0 l=1 rev1=1 rx=0x7f196c004660 tx=0x7f196c009b30).stop 2022-02-02T21:43:11.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 -- 172.21.15.96:0/202241253 shutdown_connections 2022-02-02T21:43:11.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 --2- 172.21.15.96:0/202241253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f7980 0x7f19780f7de0 unknown :-1 s=CLOSED pgs=3092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 --2- 172.21.15.96:0/202241253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f66e0 0x7f19780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 -- 172.21.15.96:0/202241253 >> 172.21.15.96:0/202241253 conn(0x7f19780f1e40 msgr2=0x7f19780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:11.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.958+0000 7f197e760700 1 -- 172.21.15.96:0/202241253 shutdown_connections 2022-02-02T21:43:11.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.959+0000 7f197e760700 1 -- 172.21.15.96:0/202241253 wait complete. 2022-02-02T21:43:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.959+0000 7f197e760700 1 Processor -- start 2022-02-02T21:43:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.959+0000 7f197e760700 1 -- start start 2022-02-02T21:43:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f7980 0x7f197810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197810dfc0 con 0x7f19780f66e0 2022-02-02T21:43:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197810e100 con 0x7f19780f7980 2022-02-02T21:43:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44418/0 (socket says 172.21.15.96:44418) 2022-02-02T21:43:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 -- 172.21.15.96:0/2121175680 learned_addr learned my addr 172.21.15.96:0/2121175680 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f19777fe700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f7980 0x7f197810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 -- 172.21.15.96:0/2121175680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f7980 msgr2=0x7f197810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f7980 0x7f197810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 -- 172.21.15.96:0/2121175680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c005040 con 0x7f19780f66e0 2022-02-02T21:43:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1977fff700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 secure :-1 s=READY pgs=3093 cs=0 l=1 rev1=1 rx=0x7f1968002700 tx=0x7f1968009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1968009320 con 0x7f19780f66e0 2022-02-02T21:43:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197810eaa0 con 0x7f19780f66e0 2022-02-02T21:43:11.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f196800f040 con 0x7f19780f66e0 2022-02-02T21:43:11.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19680148e0 con 0x7f19780f66e0 2022-02-02T21:43:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.960+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197810f060 con 0x7f19780f66e0 2022-02-02T21:43:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.961+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1978045ad0 con 0x7f19780f66e0 2022-02-02T21:43:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.962+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1968009480 con 0x7f19780f66e0 2022-02-02T21:43:11.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.962+0000 7f1974ff9700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 0x7f1960067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:11.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.963+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1968081d90 con 0x7f19780f66e0 2022-02-02T21:43:11.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.963+0000 7f19777fe700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 0x7f1960067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:11.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.963+0000 7f19777fe700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 0x7f1960067290 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f196c004630 tx=0x7f196c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:11.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:11.967+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19680538c0 con 0x7f19780f66e0 2022-02-02T21:43:12.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.196+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19780ff020 con 0x7f19780f66e0 2022-02-02T21:43:12.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.197+0000 7f1974ff9700 1 -- 172.21.15.96:0/2121175680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f19680534b0 con 0x7f19780f66e0 2022-02-02T21:43:12.198 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:43:12.198 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:43:12.198 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:43:12.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:12.199 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:43:12.199 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:43:12.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:12.200 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:43:12.200 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:43:12.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:12.201 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:43:12.201 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:43:12.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:12.202 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:43:12.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:43:12.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:43:12.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:43:12.204 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:43:12.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 msgr2=0x7f1960067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 0x7f1960067290 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f196c004630 tx=0x7f196c009b30).stop 2022-02-02T21:43:12.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 msgr2=0x7f197810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 secure :-1 s=READY pgs=3093 cs=0 l=1 rev1=1 rx=0x7f1968002700 tx=0x7f1968009e00).stop 2022-02-02T21:43:12.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 shutdown_connections 2022-02-02T21:43:12.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1960064dd0 0x7f1960067290 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19780f66e0 0x7f197810d520 unknown :-1 s=CLOSED pgs=3093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 --2- 172.21.15.96:0/2121175680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19780f7980 0x7f197810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 >> 172.21.15.96:0/2121175680 conn(0x7f19780f1e40 msgr2=0x7f197806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:12.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 shutdown_connections 2022-02-02T21:43:12.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.199+0000 7f197e760700 1 -- 172.21.15.96:0/2121175680 wait complete. 2022-02-02T21:43:12.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 -- 172.21.15.96:0/894786566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 msgr2=0x7f89fc0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 --2- 172.21.15.96:0/894786566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc0f7ac0 secure :-1 s=READY pgs=3094 cs=0 l=1 rev1=1 rx=0x7f89f0004660 tx=0x7f89f0009b30).stop 2022-02-02T21:43:12.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 -- 172.21.15.96:0/894786566 shutdown_connections 2022-02-02T21:43:12.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 --2- 172.21.15.96:0/894786566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc0f7ac0 unknown :-1 s=CLOSED pgs=3094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 --2- 172.21.15.96:0/894786566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 0x7f89fc0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 -- 172.21.15.96:0/894786566 >> 172.21.15.96:0/894786566 conn(0x7f89fc0f04c0 msgr2=0x7f89fc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:12.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 -- 172.21.15.96:0/894786566 shutdown_connections 2022-02-02T21:43:12.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.298+0000 7f8a028e0700 1 -- 172.21.15.96:0/894786566 wait complete. 2022-02-02T21:43:12.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 Processor -- start 2022-02-02T21:43:12.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 -- start start 2022-02-02T21:43:12.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 0x7f89fc107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:12.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc107af0 con 0x7f89fc0f5340 2022-02-02T21:43:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f8a028e0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc107c30 con 0x7f89fc0f49a0 2022-02-02T21:43:12.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f89fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f89fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44428/0 (socket says 172.21.15.96:44428) 2022-02-02T21:43:12.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f89fb7fe700 1 -- 172.21.15.96:0/400632028 learned_addr learned my addr 172.21.15.96:0/400632028 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:12.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.299+0000 7f89fbfff700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 0x7f89fc107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:12.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89fb7fe700 1 -- 172.21.15.96:0/400632028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 msgr2=0x7f89fc107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89fb7fe700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 0x7f89fc107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89fb7fe700 1 -- 172.21.15.96:0/400632028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0005040 con 0x7f89fc0f5340 2022-02-02T21:43:12.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89fb7fe700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 secure :-1 s=READY pgs=3095 cs=0 l=1 rev1=1 rx=0x7f89f00043a0 tx=0x7f89f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:12.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f0018070 con 0x7f89fc0f5340 2022-02-02T21:43:12.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc108570 con 0x7f89fc0f5340 2022-02-02T21:43:12.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc108ad0 con 0x7f89fc0f5340 2022-02-02T21:43:12.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89f0007ba0 con 0x7f89fc0f5340 2022-02-02T21:43:12.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.300+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f001de30 con 0x7f89fc0f5340 2022-02-02T21:43:12.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.301+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc004fa0 con 0x7f89fc0f5340 2022-02-02T21:43:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.302+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f89f001d420 con 0x7f89fc0f5340 2022-02-02T21:43:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.302+0000 7f89f8ff9700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 0x7f89e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:12.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.302+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f89f00834d0 con 0x7f89fc0f5340 2022-02-02T21:43:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.302+0000 7f89fbfff700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 0x7f89e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.302+0000 7f89fbfff700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 0x7f89e4067290 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f89fc05eb60 tx=0x7f89ec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:12.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.306+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f89f00550c0 con 0x7f89fc0f5340 2022-02-02T21:43:12.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.508+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89dc005e80 con 0x7f89fc0f5340 2022-02-02T21:43:12.509 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2121175680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:43:12.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.508+0000 7f89f8ff9700 1 -- 172.21.15.96:0/400632028 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f89f0054cb0 con 0x7f89fc0f5340 2022-02-02T21:43:12.510 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:43:12.510 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:43:12.511 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:43:12.511 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:43:12.511 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:12.512 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:43:12.512 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:43:12.512 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:43:12.513 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:43:12.513 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:43:12.513 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:43:12.514 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:43:12.514 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:43:12.514 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:43:12.515 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:43:12.515 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:43:12.516 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:43:12.516 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:43:12.517 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:43:12.517 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:43:12.517 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:43:12.518 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:43:12.518 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:43:12.518 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:43:12.519 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:43:12.519 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:43:12.520 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:43:12.520 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:43:12.520 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:43:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:43:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:43:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:43:12.522 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:12.522 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:12.522 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:43:12.523 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:12.523 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:12.523 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:12.524 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:12.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2121175680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:43:12.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.510+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 msgr2=0x7f89e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.510+0000 7f8a028e0700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 0x7f89e4067290 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f89fc05eb60 tx=0x7f89ec00b040).stop 2022-02-02T21:43:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.510+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 msgr2=0x7f89fc107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.510+0000 7f8a028e0700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 secure :-1 s=READY pgs=3095 cs=0 l=1 rev1=1 rx=0x7f89f00043a0 tx=0x7f89f0009b30).stop 2022-02-02T21:43:12.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 shutdown_connections 2022-02-02T21:43:12.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f89e4064dd0 0x7f89e4067290 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89fc0f49a0 0x7f89fc107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 --2- 172.21.15.96:0/400632028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89fc0f5340 0x7f89fc107540 unknown :-1 s=CLOSED pgs=3095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:12.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 >> 172.21.15.96:0/400632028 conn(0x7f89fc0f04c0 msgr2=0x7f89fc0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:12.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 shutdown_connections 2022-02-02T21:43:12.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:12.511+0000 7f8a028e0700 1 -- 172.21.15.96:0/400632028 wait complete. 2022-02-02T21:43:12.530 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:43:13.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:13 smithi159 ceph-mon[69013]: from='client.40288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:13.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:13 smithi159 ceph-mon[69013]: from='client.40292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:13.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:13 smithi159 ceph-mon[69013]: pgmap v6033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:13.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/400632028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:43:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:13 smithi096 ceph-mon[101353]: from='client.40288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:13 smithi096 ceph-mon[101353]: from='client.40292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:13 smithi096 ceph-mon[101353]: pgmap v6033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:13.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/400632028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:43:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:14 smithi159 ceph-mon[69013]: pgmap v6034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:14 smithi096 ceph-mon[101353]: pgmap v6034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:16 smithi159 ceph-mon[69013]: pgmap v6035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:16 smithi096 ceph-mon[101353]: pgmap v6035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:18 smithi159 ceph-mon[69013]: pgmap v6036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:19.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:18 smithi096 ceph-mon[101353]: pgmap v6036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:20 smithi159 ceph-mon[69013]: pgmap v6037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:20 smithi096 ceph-mon[101353]: pgmap v6037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:22 smithi159 ceph-mon[69013]: pgmap v6038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:22 smithi096 ceph-mon[101353]: pgmap v6038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:24 smithi159 ceph-mon[69013]: pgmap v6039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:24 smithi096 ceph-mon[101353]: pgmap v6039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:26 smithi159 ceph-mon[69013]: pgmap v6040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:26 smithi096 ceph-mon[101353]: pgmap v6040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:43:28.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:43:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:43:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:43:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:28 smithi159 ceph-mon[69013]: pgmap v6041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:28 smithi096 ceph-mon[101353]: pgmap v6041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:30 smithi159 ceph-mon[69013]: pgmap v6042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:30 smithi096 ceph-mon[101353]: pgmap v6042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:32 smithi159 ceph-mon[69013]: pgmap v6043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:32 smithi096 ceph-mon[101353]: pgmap v6043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:34 smithi159 ceph-mon[69013]: pgmap v6044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:34 smithi096 ceph-mon[101353]: pgmap v6044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:36 smithi159 ceph-mon[69013]: pgmap v6045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:36 smithi096 ceph-mon[101353]: pgmap v6045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:38 smithi159 ceph-mon[69013]: pgmap v6046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:38 smithi096 ceph-mon[101353]: pgmap v6046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:40 smithi159 ceph-mon[69013]: pgmap v6047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:40 smithi096 ceph-mon[101353]: pgmap v6047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:42.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.620+0000 7f80ae6be700 1 -- 172.21.15.96:0/2764718974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 msgr2=0x7f80a80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.620+0000 7f80ae6be700 1 --2- 172.21.15.96:0/2764718974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f6b30 secure :-1 s=READY pgs=3096 cs=0 l=1 rev1=1 rx=0x7f8098004660 tx=0x7f8098009b30).stop 2022-02-02T21:43:42.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 -- 172.21.15.96:0/2764718974 shutdown_connections 2022-02-02T21:43:42.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 --2- 172.21.15.96:0/2764718974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f6b30 unknown :-1 s=CLOSED pgs=3096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 --2- 172.21.15.96:0/2764718974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 0x7f80a80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 -- 172.21.15.96:0/2764718974 >> 172.21.15.96:0/2764718974 conn(0x7f80a80f0b90 msgr2=0x7f80a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:42.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 -- 172.21.15.96:0/2764718974 shutdown_connections 2022-02-02T21:43:42.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.621+0000 7f80ae6be700 1 -- 172.21.15.96:0/2764718974 wait complete. 2022-02-02T21:43:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 Processor -- start 2022-02-02T21:43:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 -- start start 2022-02-02T21:43:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 0x7f80a80f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80f8790 con 0x7f80a80f66d0 2022-02-02T21:43:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ae6be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80f88d0 con 0x7f80a80f5430 2022-02-02T21:43:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44444/0 (socket says 172.21.15.96:44444) 2022-02-02T21:43:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 -- 172.21.15.96:0/1324527228 learned_addr learned my addr 172.21.15.96:0/1324527228 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80ad6bc700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 0x7f80a80f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 -- 172.21.15.96:0/1324527228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 msgr2=0x7f80a80f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 0x7f80a80f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 -- 172.21.15.96:0/1324527228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098005040 con 0x7f80a80f66d0 2022-02-02T21:43:42.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.622+0000 7f80acebb700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 secure :-1 s=READY pgs=3097 cs=0 l=1 rev1=1 rx=0x7f8098009830 tx=0x7f8098009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:42.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.623+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8098018070 con 0x7f80a80f66d0 2022-02-02T21:43:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.623+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a80f8b50 con 0x7f80a80f66d0 2022-02-02T21:43:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.623+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8098007ba0 con 0x7f80a80f66d0 2022-02-02T21:43:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.623+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809801c3c0 con 0x7f80a80f66d0 2022-02-02T21:43:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.623+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a80f90b0 con 0x7f80a80f66d0 2022-02-02T21:43:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.624+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8045ad0 con 0x7f80a80f66d0 2022-02-02T21:43:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.624+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8098007d10 con 0x7f80a80f66d0 2022-02-02T21:43:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.625+0000 7f809dffb700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 0x7f80940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.625+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8098083640 con 0x7f80a80f66d0 2022-02-02T21:43:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.625+0000 7f80ad6bc700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 0x7f80940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.625+0000 7f80ad6bc700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 0x7f80940672e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f80a80f9b40 tx=0x7f80a400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:42.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.629+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8098051800 con 0x7f80a80f66d0 2022-02-02T21:43:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:42 smithi159 ceph-mon[69013]: pgmap v6048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:42 smithi096 ceph-mon[101353]: pgmap v6048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:42.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.809+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80a805fd30 con 0x7f8094064e20 2022-02-02T21:43:42.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.810+0000 7f809dffb700 1 -- 172.21.15.96:0/1324527228 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f80a805fd30 con 0x7f8094064e20 2022-02-02T21:43:42.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 msgr2=0x7f80940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 0x7f80940672e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f80a80f9b40 tx=0x7f80a400b040).stop 2022-02-02T21:43:42.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 msgr2=0x7f80a80f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 secure :-1 s=READY pgs=3097 cs=0 l=1 rev1=1 rx=0x7f8098009830 tx=0x7f8098009b30).stop 2022-02-02T21:43:42.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 shutdown_connections 2022-02-02T21:43:42.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8094064e20 0x7f80940672e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f5430 0x7f80a80f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 --2- 172.21.15.96:0/1324527228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f66d0 0x7f80a80f8230 unknown :-1 s=CLOSED pgs=3097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 >> 172.21.15.96:0/1324527228 conn(0x7f80a80f0b90 msgr2=0x7f80a805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:42.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 shutdown_connections 2022-02-02T21:43:42.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.812+0000 7f80ae6be700 1 -- 172.21.15.96:0/1324527228 wait complete. 2022-02-02T21:43:42.821 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:43:42.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- 172.21.15.96:0/291176890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f55c0 msgr2=0x7f4b8c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/291176890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c0f59e0 secure :-1 s=READY pgs=3098 cs=0 l=1 rev1=1 rx=0x7f4b80004660 tx=0x7f4b80009b30).stop 2022-02-02T21:43:42.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- 172.21.15.96:0/291176890 shutdown_connections 2022-02-02T21:43:42.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/291176890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/291176890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c0f59e0 unknown :-1 s=CLOSED pgs=3098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- 172.21.15.96:0/291176890 >> 172.21.15.96:0/291176890 conn(0x7f4b8c0f0d40 msgr2=0x7f4b8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:42.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- 172.21.15.96:0/291176890 shutdown_connections 2022-02-02T21:43:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- 172.21.15.96:0/291176890 wait complete. 2022-02-02T21:43:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 Processor -- start 2022-02-02T21:43:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.910+0000 7f4b92e4a700 1 -- start start 2022-02-02T21:43:42.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b92e4a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b92e4a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b92e4a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c109c10 con 0x7f4b8c0f6860 2022-02-02T21:43:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b92e4a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c109d50 con 0x7f4b8c0f55c0 2022-02-02T21:43:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44454/0 (socket says 172.21.15.96:44454) 2022-02-02T21:43:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 -- 172.21.15.96:0/2589270938 learned_addr learned my addr 172.21.15.96:0/2589270938 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b90be6700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 -- 172.21.15.96:0/2589270938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 msgr2=0x7f4b8c109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:42.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:42.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 -- 172.21.15.96:0/2589270938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80005040 con 0x7f4b8c0f6860 2022-02-02T21:43:42.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b90be6700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:43:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.911+0000 7f4b8bfff700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 secure :-1 s=READY pgs=3099 cs=0 l=1 rev1=1 rx=0x7f4b780026d0 tx=0x7f4b78009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.912+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b78009320 con 0x7f4b8c0f6860 2022-02-02T21:43:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.912+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c10a6f0 con 0x7f4b8c0f6860 2022-02-02T21:43:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.912+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b7800f040 con 0x7f4b8c0f6860 2022-02-02T21:43:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.912+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b780147e0 con 0x7f4b8c0f6860 2022-02-02T21:43:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.912+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c10acb0 con 0x7f4b8c0f6860 2022-02-02T21:43:42.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.913+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c045ad0 con 0x7f4b8c0f6860 2022-02-02T21:43:42.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.913+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b78009480 con 0x7f4b8c0f6860 2022-02-02T21:43:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.913+0000 7f4b897fa700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 0x7f4b7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.913+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4b78082160 con 0x7f4b8c0f6860 2022-02-02T21:43:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.913+0000 7f4b90be6700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 0x7f4b7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.914+0000 7f4b90be6700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 0x7f4b7c067290 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f4b80005010 tx=0x7f4b80009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:42.918+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b78053c90 con 0x7f4b8c0f6860 2022-02-02T21:43:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.087+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b8c101200 con 0x7f4b7c064dd0 2022-02-02T21:43:43.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.097+0000 7f4b897fa700 1 -- 172.21.15.96:0/2589270938 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4b8c101200 con 0x7f4b7c064dd0 2022-02-02T21:43:43.098 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:43:43.098 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:43:43.098 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:43:43.099 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:43:43.099 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:43:43.099 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:43:43.100 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:43:43.100 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:43:43.101 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:43:43.101 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:43:43.101 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:43:43.102 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:43:43.102 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:43:43.102 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:43:43.103 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:43:43.103 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:43:43.103 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:43:43.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:43:43.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:43:43.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:43:43.105 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:43:43.105 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:43:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 msgr2=0x7f4b7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 0x7f4b7c067290 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f4b80005010 tx=0x7f4b80009b30).stop 2022-02-02T21:43:43.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 msgr2=0x7f4b8c109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 secure :-1 s=READY pgs=3099 cs=0 l=1 rev1=1 rx=0x7f4b780026d0 tx=0x7f4b78009de0).stop 2022-02-02T21:43:43.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 shutdown_connections 2022-02-02T21:43:43.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b7c064dd0 0x7f4b7c067290 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b8c0f55c0 0x7f4b8c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 --2- 172.21.15.96:0/2589270938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8c0f6860 0x7f4b8c109660 unknown :-1 s=CLOSED pgs=3099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 >> 172.21.15.96:0/2589270938 conn(0x7f4b8c0f0d40 msgr2=0x7f4b8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:43.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 shutdown_connections 2022-02-02T21:43:43.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.099+0000 7f4b92e4a700 1 -- 172.21.15.96:0/2589270938 wait complete. 2022-02-02T21:43:43.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/980633576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 msgr2=0x7fe8ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/980633576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac0f59e0 secure :-1 s=READY pgs=3100 cs=0 l=1 rev1=1 rx=0x7fe89c004660 tx=0x7fe89c009b30).stop 2022-02-02T21:43:43.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/980633576 shutdown_connections 2022-02-02T21:43:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/980633576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 0x7fe8ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/980633576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac0f59e0 unknown :-1 s=CLOSED pgs=3100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/980633576 >> 172.21.15.96:0/980633576 conn(0x7fe8ac0f0d40 msgr2=0x7fe8ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/980633576 shutdown_connections 2022-02-02T21:43:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.196+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/980633576 wait complete. 2022-02-02T21:43:43.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 Processor -- start 2022-02-02T21:43:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 -- start start 2022-02-02T21:43:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 0x7fe8ac109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac109c00 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b3a3c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac109d40 con 0x7fe8ac0f6860 2022-02-02T21:43:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44462/0 (socket says 172.21.15.96:44462) 2022-02-02T21:43:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 -- 172.21.15.96:0/2895451567 learned_addr learned my addr 172.21.15.96:0/2895451567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b0fd7700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 0x7fe8ac109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 -- 172.21.15.96:0/2895451567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 msgr2=0x7fe8ac109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 0x7fe8ac109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.197+0000 7fe8b17d8700 1 -- 172.21.15.96:0/2895451567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c005040 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8b17d8700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 secure :-1 s=READY pgs=3101 cs=0 l=1 rev1=1 rx=0x7fe89c004f60 tx=0x7fe89c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:43.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c018070 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac10a680 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe89c009770 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c01c3c0 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.198+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac10abe0 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.199+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac045ad0 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.199+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe89c01d420 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.200+0000 7fe8a1ffb700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 0x7fe898067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.200+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe89c083880 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.200+0000 7fe8b0fd7700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 0x7fe898067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.200+0000 7fe8b0fd7700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 0x7fe898067290 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7fe8a80041d0 tx=0x7fe8a8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:43.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.204+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe89c055470 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.436+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe8ac0fdf00 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.436+0000 7fe8a1ffb700 1 -- 172.21.15.96:0/2895451567 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe89c055060 con 0x7fe8ac0f55c0 2022-02-02T21:43:43.437 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:43:43.438 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:43:43.438 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:43:43.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:43.439 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:43:43.439 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:43:43.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:43.440 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:43:43.440 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:43:43.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:43.441 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:43:43.441 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:43:43.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:43:43.442 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:43:43.442 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:43:43.442 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:43:43.443 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:43:43.443 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:43:43.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.438+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 msgr2=0x7fe898067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.438+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 0x7fe898067290 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7fe8a80041d0 tx=0x7fe8a8009040).stop 2022-02-02T21:43:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.438+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 msgr2=0x7fe8ac109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.438+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 secure :-1 s=READY pgs=3101 cs=0 l=1 rev1=1 rx=0x7fe89c004f60 tx=0x7fe89c009b30).stop 2022-02-02T21:43:43.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 shutdown_connections 2022-02-02T21:43:43.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe898064dd0 0x7fe898067290 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac109160 unknown :-1 s=CLOSED pgs=3101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 --2- 172.21.15.96:0/2895451567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ac0f6860 0x7fe8ac109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 >> 172.21.15.96:0/2895451567 conn(0x7fe8ac0f0d40 msgr2=0x7fe8ac05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:43.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 shutdown_connections 2022-02-02T21:43:43.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.439+0000 7fe8b3a3c700 1 -- 172.21.15.96:0/2895451567 wait complete. 2022-02-02T21:43:43.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 -- 172.21.15.96:0/3668851544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 msgr2=0x7f80400f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 --2- 172.21.15.96:0/3668851544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f80400f6b60 secure :-1 s=READY pgs=3102 cs=0 l=1 rev1=1 rx=0x7f8030004660 tx=0x7f8030009b30).stop 2022-02-02T21:43:43.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 -- 172.21.15.96:0/3668851544 shutdown_connections 2022-02-02T21:43:43.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 --2- 172.21.15.96:0/3668851544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f80400f6b60 unknown :-1 s=CLOSED pgs=3102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 --2- 172.21.15.96:0/3668851544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 0x7f80400f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 -- 172.21.15.96:0/3668851544 >> 172.21.15.96:0/3668851544 conn(0x7f80400f0bc0 msgr2=0x7f80400f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:43.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 -- 172.21.15.96:0/3668851544 shutdown_connections 2022-02-02T21:43:43.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.536+0000 7f8045691700 1 -- 172.21.15.96:0/3668851544 wait complete. 2022-02-02T21:43:43.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 Processor -- start 2022-02-02T21:43:43.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 -- start start 2022-02-02T21:43:43.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 0x7f8040105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80401067d0 con 0x7f80400f6700 2022-02-02T21:43:43.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f8045691700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040106fd0 con 0x7f80400f5460 2022-02-02T21:43:43.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44474/0 (socket says 172.21.15.96:44474) 2022-02-02T21:43:43.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 -- 172.21.15.96:0/665964135 learned_addr learned my addr 172.21.15.96:0/665964135 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:43:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803effd700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 0x7f8040105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 -- 172.21.15.96:0/665964135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 msgr2=0x7f8040105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 0x7f8040105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 -- 172.21.15.96:0/665964135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030005040 con 0x7f80400f6700 2022-02-02T21:43:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.537+0000 7f803e7fc700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 secure :-1 s=READY pgs=3103 cs=0 l=1 rev1=1 rx=0x7f8030009990 tx=0x7f8030009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.538+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803001a070 con 0x7f80400f6700 2022-02-02T21:43:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.538+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040107250 con 0x7f80400f6700 2022-02-02T21:43:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.538+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8030012a80 con 0x7f80400f6700 2022-02-02T21:43:43.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.538+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803001f9a0 con 0x7f80400f6700 2022-02-02T21:43:43.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.538+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80401077b0 con 0x7f80400f6700 2022-02-02T21:43:43.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.539+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8040059100 con 0x7f80400f6700 2022-02-02T21:43:43.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.540+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8030012bf0 con 0x7f80400f6700 2022-02-02T21:43:43.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.540+0000 7f80277fe700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:43:43.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.540+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f80300861d0 con 0x7f80400f6700 2022-02-02T21:43:43.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.540+0000 7f803effd700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:43:43.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.540+0000 7f803effd700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f80400f6560 tx=0x7f8034009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:43:43.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.544+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8030057d00 con 0x7f80400f6700 2022-02-02T21:43:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.743+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8040045ad0 con 0x7f80400f6700 2022-02-02T21:43:43.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.743+0000 7f80277fe700 1 -- 172.21.15.96:0/665964135 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f80300578f0 con 0x7f80400f6700 2022-02-02T21:43:43.744 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:43:43.744 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:43:43.745 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:43:43.745 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:43:43.745 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:43.746 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:43:43.746 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:43:43.746 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:43:43.747 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:43:43.747 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:43:43.747 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:43:43.748 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:43:43.749 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:43:43.749 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:43:43.749 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:43:43.750 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:43:43.750 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:43:43.750 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:43:43.751 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:43:43.751 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:43:43.751 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:43:43.752 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:43:43.752 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:43:43.752 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:43:43.753 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:43:43.753 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:43:43.753 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:43:43.754 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:43:43.754 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:43:43.755 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:43:43.755 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:43:43.755 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:43:43.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:43.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:43.756 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:43:43.757 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:43:43.757 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:43.758 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:43.758 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:43:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 msgr2=0x7f80280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f80400f6560 tx=0x7f8034009040).stop 2022-02-02T21:43:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 msgr2=0x7f8040106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:43:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 secure :-1 s=READY pgs=3103 cs=0 l=1 rev1=1 rx=0x7f8030009990 tx=0x7f8030009b30).stop 2022-02-02T21:43:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 shutdown_connections 2022-02-02T21:43:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80400f5460 0x7f8040105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 --2- 172.21.15.96:0/665964135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80400f6700 0x7f8040106220 unknown :-1 s=CLOSED pgs=3103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:43:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 >> 172.21.15.96:0/665964135 conn(0x7f80400f0bc0 msgr2=0x7f80400fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:43:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 shutdown_connections 2022-02-02T21:43:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:43:43.746+0000 7f8045691700 1 -- 172.21.15.96:0/665964135 wait complete. 2022-02-02T21:43:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:43:44.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:43 smithi159 ceph-mon[69013]: from='client.40304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:44.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:43 smithi159 ceph-mon[69013]: from='client.40308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:44.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2895451567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:43:44.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:43 smithi096 ceph-mon[101353]: from='client.40304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:44.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:43 smithi096 ceph-mon[101353]: from='client.40308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:43:44.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2895451567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:43:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/665964135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:43:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:44 smithi159 ceph-mon[69013]: pgmap v6049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/665964135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:43:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:44 smithi096 ceph-mon[101353]: pgmap v6049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:46 smithi159 ceph-mon[69013]: pgmap v6050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:46 smithi096 ceph-mon[101353]: pgmap v6050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:48 smithi159 ceph-mon[69013]: pgmap v6051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:48 smithi096 ceph-mon[101353]: pgmap v6051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:50 smithi159 ceph-mon[69013]: pgmap v6052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:50 smithi096 ceph-mon[101353]: pgmap v6052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:52 smithi159 ceph-mon[69013]: pgmap v6053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:52 smithi096 ceph-mon[101353]: pgmap v6053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:54 smithi159 ceph-mon[69013]: pgmap v6054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:54 smithi096 ceph-mon[101353]: pgmap v6054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:56 smithi159 ceph-mon[69013]: pgmap v6055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:56 smithi096 ceph-mon[101353]: pgmap v6055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:43:58 smithi159 ceph-mon[69013]: pgmap v6056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:43:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:43:58 smithi096 ceph-mon[101353]: pgmap v6056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:00 smithi159 ceph-mon[69013]: pgmap v6057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:00 smithi096 ceph-mon[101353]: pgmap v6057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:02 smithi159 ceph-mon[69013]: pgmap v6058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:02 smithi096 ceph-mon[101353]: pgmap v6058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:04 smithi159 ceph-mon[69013]: pgmap v6059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:04 smithi096 ceph-mon[101353]: pgmap v6059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:06 smithi159 ceph-mon[69013]: pgmap v6060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:06 smithi096 ceph-mon[101353]: pgmap v6060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:08 smithi159 ceph-mon[69013]: pgmap v6061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:08 smithi096 ceph-mon[101353]: pgmap v6061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:10 smithi159 ceph-mon[69013]: pgmap v6062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:10 smithi096 ceph-mon[101353]: pgmap v6062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:12 smithi159 ceph-mon[69013]: pgmap v6063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:12 smithi096 ceph-mon[101353]: pgmap v6063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:13.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 -- 172.21.15.96:0/3030315042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 msgr2=0x7fba3c0fab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:13.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 --2- 172.21.15.96:0/3030315042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c0fab80 secure :-1 s=READY pgs=3104 cs=0 l=1 rev1=1 rx=0x7fba2c004660 tx=0x7fba2c009b30).stop 2022-02-02T21:44:13.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 -- 172.21.15.96:0/3030315042 shutdown_connections 2022-02-02T21:44:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 --2- 172.21.15.96:0/3030315042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c0fab80 unknown :-1 s=CLOSED pgs=3104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 --2- 172.21.15.96:0/3030315042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 0x7fba3c0f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 -- 172.21.15.96:0/3030315042 >> 172.21.15.96:0/3030315042 conn(0x7fba3c0f0080 msgr2=0x7fba3c0f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:13.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 -- 172.21.15.96:0/3030315042 shutdown_connections 2022-02-02T21:44:13.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.855+0000 7fba41459700 1 -- 172.21.15.96:0/3030315042 wait complete. 2022-02-02T21:44:13.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 Processor -- start 2022-02-02T21:44:13.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 -- start start 2022-02-02T21:44:13.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 0x7fba3c105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:13.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:13.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c106940 con 0x7fba3c0f86f0 2022-02-02T21:44:13.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.856+0000 7fba41459700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c107140 con 0x7fba3c0f5d80 2022-02-02T21:44:13.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:13.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44492/0 (socket says 172.21.15.96:44492) 2022-02-02T21:44:13.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 -- 172.21.15.96:0/1472123412 learned_addr learned my addr 172.21.15.96:0/1472123412 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:13.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3affd700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 0x7fba3c105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:13.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 -- 172.21.15.96:0/1472123412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 msgr2=0x7fba3c105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:13.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 0x7fba3c105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:13.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 -- 172.21.15.96:0/1472123412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c005040 con 0x7fba3c0f86f0 2022-02-02T21:44:13.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba3a7fc700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 secure :-1 s=READY pgs=3105 cs=0 l=1 rev1=1 rx=0x7fba2c009990 tx=0x7fba2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:13.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2c018070 con 0x7fba3c0f86f0 2022-02-02T21:44:13.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba2c007ba0 con 0x7fba3c0f86f0 2022-02-02T21:44:13.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2c01c620 con 0x7fba3c0f86f0 2022-02-02T21:44:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c1073c0 con 0x7fba3c0f86f0 2022-02-02T21:44:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.857+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c107920 con 0x7fba3c0f86f0 2022-02-02T21:44:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.859+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c0f3cf0 con 0x7fba3c0f86f0 2022-02-02T21:44:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.859+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba2c01c8e0 con 0x7fba3c0f86f0 2022-02-02T21:44:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.859+0000 7fba337fe700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 0x7fba28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.859+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba2c083850 con 0x7fba3c0f86f0 2022-02-02T21:44:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.859+0000 7fba3affd700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 0x7fba28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.860+0000 7fba3affd700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 0x7fba28067290 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fba240041d0 tx=0x7fba24009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:13.864+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba2c055380 con 0x7fba3c0f86f0 2022-02-02T21:44:14.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.040+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba3c0fdd90 con 0x7fba28064dd0 2022-02-02T21:44:14.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.041+0000 7fba337fe700 1 -- 172.21.15.96:0/1472123412 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fba3c0fdd90 con 0x7fba28064dd0 2022-02-02T21:44:14.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 msgr2=0x7fba28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 0x7fba28067290 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fba240041d0 tx=0x7fba24009040).stop 2022-02-02T21:44:14.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 msgr2=0x7fba3c106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 secure :-1 s=READY pgs=3105 cs=0 l=1 rev1=1 rx=0x7fba2c009990 tx=0x7fba2c009b30).stop 2022-02-02T21:44:14.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 shutdown_connections 2022-02-02T21:44:14.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba28064dd0 0x7fba28067290 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba3c0f5d80 0x7fba3c105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 --2- 172.21.15.96:0/1472123412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba3c0f86f0 0x7fba3c106390 unknown :-1 s=CLOSED pgs=3105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 >> 172.21.15.96:0/1472123412 conn(0x7fba3c0f0080 msgr2=0x7fba3c0f2470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 shutdown_connections 2022-02-02T21:44:14.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.043+0000 7fba41459700 1 -- 172.21.15.96:0/1472123412 wait complete. 2022-02-02T21:44:14.053 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:44:14.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.140+0000 7efd2959f700 1 -- 172.21.15.96:0/2147703878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f66e0 msgr2=0x7efd240f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 --2- 172.21.15.96:0/2147703878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f66e0 0x7efd240f6b40 secure :-1 s=READY pgs=3106 cs=0 l=1 rev1=1 rx=0x7efd14004660 tx=0x7efd14009b30).stop 2022-02-02T21:44:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 -- 172.21.15.96:0/2147703878 shutdown_connections 2022-02-02T21:44:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 --2- 172.21.15.96:0/2147703878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f66e0 0x7efd240f6b40 unknown :-1 s=CLOSED pgs=3106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 --2- 172.21.15.96:0/2147703878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f5440 0x7efd240f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 -- 172.21.15.96:0/2147703878 >> 172.21.15.96:0/2147703878 conn(0x7efd240f0ba0 msgr2=0x7efd240f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 -- 172.21.15.96:0/2147703878 shutdown_connections 2022-02-02T21:44:14.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 -- 172.21.15.96:0/2147703878 wait complete. 2022-02-02T21:44:14.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 Processor -- start 2022-02-02T21:44:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.141+0000 7efd2959f700 1 -- start start 2022-02-02T21:44:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd2959f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd2959f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 0x7efd2410bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd2959f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd240603e0 con 0x7efd240f5440 2022-02-02T21:44:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd2959f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24060520 con 0x7efd240f66e0 2022-02-02T21:44:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44500/0 (socket says 172.21.15.96:44500) 2022-02-02T21:44:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 -- 172.21.15.96:0/3575257696 learned_addr learned my addr 172.21.15.96:0/3575257696 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd237fe700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 0x7efd2410bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 -- 172.21.15.96:0/3575257696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 msgr2=0x7efd2410bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 0x7efd2410bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 -- 172.21.15.96:0/3575257696 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14005040 con 0x7efd240f5440 2022-02-02T21:44:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd237fe700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 0x7efd2410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:44:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd23fff700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 secure :-1 s=READY pgs=3107 cs=0 l=1 rev1=1 rx=0x7efd1800c530 tx=0x7efd18007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd1800f650 con 0x7efd240f5440 2022-02-02T21:44:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2410c4e0 con 0x7efd240f5440 2022-02-02T21:44:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd1800fc60 con 0x7efd240f5440 2022-02-02T21:44:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.142+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd18012d20 con 0x7efd240f5440 2022-02-02T21:44:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.143+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2410caa0 con 0x7efd240f5440 2022-02-02T21:44:14.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.143+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd24045ad0 con 0x7efd240f5440 2022-02-02T21:44:14.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.144+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd18019030 con 0x7efd240f5440 2022-02-02T21:44:14.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.144+0000 7efd20ff9700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 0x7efd0c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.145+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efd180816b0 con 0x7efd240f5440 2022-02-02T21:44:14.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.145+0000 7efd237fe700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 0x7efd0c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.145+0000 7efd237fe700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 0x7efd0c0672e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7efd14009da0 tx=0x7efd14009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.149+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd1804f800 con 0x7efd240f5440 2022-02-02T21:44:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.321+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd24057f10 con 0x7efd0c064e20 2022-02-02T21:44:14.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.330+0000 7efd20ff9700 1 -- 172.21.15.96:0/3575257696 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efd24057f10 con 0x7efd0c064e20 2022-02-02T21:44:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:44:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:44:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:44:14.333 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:44:14.333 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:44:14.333 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:44:14.334 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:44:14.334 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:44:14.334 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:44:14.335 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:44:14.335 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:44:14.336 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:44:14.336 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:44:14.336 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:44:14.337 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:44:14.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:44:14.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:44:14.338 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:44:14.338 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:44:14.338 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:44:14.339 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:44:14.339 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:44:14.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 msgr2=0x7efd0c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 0x7efd0c0672e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7efd14009da0 tx=0x7efd14009b30).stop 2022-02-02T21:44:14.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 msgr2=0x7efd24109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 secure :-1 s=READY pgs=3107 cs=0 l=1 rev1=1 rx=0x7efd1800c530 tx=0x7efd18007e10).stop 2022-02-02T21:44:14.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 shutdown_connections 2022-02-02T21:44:14.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efd0c064e20 0x7efd0c0672e0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd240f5440 0x7efd24109a30 unknown :-1 s=CLOSED pgs=3107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 --2- 172.21.15.96:0/3575257696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd240f66e0 0x7efd2410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 >> 172.21.15.96:0/3575257696 conn(0x7efd240f0ba0 msgr2=0x7efd240fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 shutdown_connections 2022-02-02T21:44:14.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.332+0000 7efd2959f700 1 -- 172.21.15.96:0/3575257696 wait complete. 2022-02-02T21:44:14.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 -- 172.21.15.96:0/4136864880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f6860 msgr2=0x7fc9b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/4136864880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f6860 0x7fc9b00f6cc0 secure :-1 s=READY pgs=3108 cs=0 l=1 rev1=1 rx=0x7fc9a4004660 tx=0x7fc9a4009b30).stop 2022-02-02T21:44:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 -- 172.21.15.96:0/4136864880 shutdown_connections 2022-02-02T21:44:14.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/4136864880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f6860 0x7fc9b00f6cc0 unknown :-1 s=CLOSED pgs=3108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/4136864880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f55c0 0x7fc9b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 -- 172.21.15.96:0/4136864880 >> 172.21.15.96:0/4136864880 conn(0x7fc9b00f0d40 msgr2=0x7fc9b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 -- 172.21.15.96:0/4136864880 shutdown_connections 2022-02-02T21:44:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.429+0000 7fc9b5edc700 1 -- 172.21.15.96:0/4136864880 wait complete. 2022-02-02T21:44:14.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 Processor -- start 2022-02-02T21:44:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 -- start start 2022-02-02T21:44:14.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 0x7fc9b01063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b01069c0 con 0x7fc9b00f55c0 2022-02-02T21:44:14.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9b5edc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b01071d0 con 0x7fc9b00f6860 2022-02-02T21:44:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44510/0 (socket says 172.21.15.96:44510) 2022-02-02T21:44:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.430+0000 7fc9af7fe700 1 -- 172.21.15.96:0/2090928057 learned_addr learned my addr 172.21.15.96:0/2090928057 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9aeffd700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 0x7fc9b01063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9af7fe700 1 -- 172.21.15.96:0/2090928057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 msgr2=0x7fc9b01063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9af7fe700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 0x7fc9b01063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9af7fe700 1 -- 172.21.15.96:0/2090928057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4005040 con 0x7fc9b00f55c0 2022-02-02T21:44:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9aeffd700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 0x7fc9b01063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:44:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9af7fe700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 secure :-1 s=READY pgs=3109 cs=0 l=1 rev1=1 rx=0x7fc9a000e9a0 tx=0x7fc9a0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a000c9b0 con 0x7fc9b00f55c0 2022-02-02T21:44:14.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b01073f0 con 0x7fc9b00f55c0 2022-02-02T21:44:14.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc9a0011470 con 0x7fc9b00f55c0 2022-02-02T21:44:14.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a0010610 con 0x7fc9b00f55c0 2022-02-02T21:44:14.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.431+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b0107980 con 0x7fc9b00f55c0 2022-02-02T21:44:14.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.432+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b00f49b0 con 0x7fc9b00f55c0 2022-02-02T21:44:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.433+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc9a000cb10 con 0x7fc9b00f55c0 2022-02-02T21:44:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.433+0000 7fc997fff700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 0x7fc998067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.433+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc9a0084a00 con 0x7fc9b00f55c0 2022-02-02T21:44:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.433+0000 7fc9aeffd700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 0x7fc998067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.433+0000 7fc9aeffd700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 0x7fc998067230 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fc9a4004e30 tx=0x7fc9a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.437+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc9a0052b00 con 0x7fc9b00f55c0 2022-02-02T21:44:14.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.668+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9b00ff790 con 0x7fc9b00f55c0 2022-02-02T21:44:14.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.668+0000 7fc997fff700 1 -- 172.21.15.96:0/2090928057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc9a0056120 con 0x7fc9b00f55c0 2022-02-02T21:44:14.670 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:44:14.671 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:44:14.671 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:44:14.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:14.672 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:44:14.672 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:44:14.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:14.673 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:44:14.673 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:44:14.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:14.674 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:44:14.674 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:44:14.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:14.675 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:44:14.675 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:44:14.675 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:44:14.676 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:44:14.676 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:44:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 msgr2=0x7fc998067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 0x7fc998067230 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fc9a4004e30 tx=0x7fc9a4009b30).stop 2022-02-02T21:44:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 msgr2=0x7fc9b0105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 secure :-1 s=READY pgs=3109 cs=0 l=1 rev1=1 rx=0x7fc9a000e9a0 tx=0x7fc9a0007e20).stop 2022-02-02T21:44:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 shutdown_connections 2022-02-02T21:44:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc998064d70 0x7fc998067230 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9b00f55c0 0x7fc9b0105ed0 unknown :-1 s=CLOSED pgs=3109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 --2- 172.21.15.96:0/2090928057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b00f6860 0x7fc9b01063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 >> 172.21.15.96:0/2090928057 conn(0x7fc9b00f0d40 msgr2=0x7fc9b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 shutdown_connections 2022-02-02T21:44:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.670+0000 7fc9b5edc700 1 -- 172.21.15.96:0/2090928057 wait complete. 2022-02-02T21:44:14.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- 172.21.15.96:0/3311416542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 msgr2=0x7f871c0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 --2- 172.21.15.96:0/3311416542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c0f5df0 secure :-1 s=READY pgs=3110 cs=0 l=1 rev1=1 rx=0x7f8718004660 tx=0x7f8718009b30).stop 2022-02-02T21:44:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- 172.21.15.96:0/3311416542 shutdown_connections 2022-02-02T21:44:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 --2- 172.21.15.96:0/3311416542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c0f5df0 unknown :-1 s=CLOSED pgs=3110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 --2- 172.21.15.96:0/3311416542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 0x7f871c0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- 172.21.15.96:0/3311416542 >> 172.21.15.96:0/3311416542 conn(0x7f871c0f04c0 msgr2=0x7f871c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:14 smithi096 ceph-mon[101353]: from='client.40320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:14.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:14 smithi096 ceph-mon[101353]: from='client.40324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:14.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:14 smithi096 ceph-mon[101353]: pgmap v6064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:14.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- 172.21.15.96:0/3311416542 shutdown_connections 2022-02-02T21:44:14.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- 172.21.15.96:0/3311416542 wait complete. 2022-02-02T21:44:14.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 Processor -- start 2022-02-02T21:44:14.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.768+0000 7f8723883700 1 -- start start 2022-02-02T21:44:14.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8723883700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8723883700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 0x7f871c106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8723883700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c106900 con 0x7f871c0f5970 2022-02-02T21:44:14.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8723883700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c107110 con 0x7f871c0f6c60 2022-02-02T21:44:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44518/0 (socket says 172.21.15.96:44518) 2022-02-02T21:44:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 -- 172.21.15.96:0/1350041663 learned_addr learned my addr 172.21.15.96:0/1350041663 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8720e1e700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 0x7f871c106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 -- 172.21.15.96:0/1350041663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 msgr2=0x7f871c106300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 0x7f871c106300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 -- 172.21.15.96:0/1350041663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718005040 con 0x7f871c0f5970 2022-02-02T21:44:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f872161f700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 secure :-1 s=READY pgs=3111 cs=0 l=1 rev1=1 rx=0x7f870c010a00 tx=0x7f870c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c0094c0 con 0x7f871c0f5970 2022-02-02T21:44:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c107330 con 0x7f871c0f5970 2022-02-02T21:44:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f870c009620 con 0x7f871c0f5970 2022-02-02T21:44:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.769+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c007e50 con 0x7f871c0f5970 2022-02-02T21:44:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.770+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c1078c0 con 0x7f871c0f5970 2022-02-02T21:44:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.771+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0f4150 con 0x7f871c0f5970 2022-02-02T21:44:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.771+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f870c022070 con 0x7f871c0f5970 2022-02-02T21:44:14.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.771+0000 7f8711ffb700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 0x7f8708067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:14.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.771+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f870c0843a0 con 0x7f871c0f5970 2022-02-02T21:44:14.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.771+0000 7f8720e1e700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 0x7f8708067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:14.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.772+0000 7f8720e1e700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 0x7f8708067230 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f8718004d80 tx=0x7f871800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:14.785 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:14 smithi159 ceph-mon[69013]: from='client.40320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:14.785 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:14 smithi159 ceph-mon[69013]: from='client.40324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:14.785 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:14 smithi159 ceph-mon[69013]: pgmap v6064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:14.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.776+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f870c0524a0 con 0x7f871c0f5970 2022-02-02T21:44:14.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.978+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f871c0ff850 con 0x7f871c0f5970 2022-02-02T21:44:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.978+0000 7f8711ffb700 1 -- 172.21.15.96:0/1350041663 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f870c055ac0 con 0x7f871c0f5970 2022-02-02T21:44:14.980 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:44:14.981 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:44:14.981 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:44:14.982 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:44:14.982 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:14.982 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:44:14.983 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:44:14.983 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:44:14.983 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:44:14.984 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:44:14.984 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:44:14.984 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:44:14.985 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:44:14.985 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:44:14.985 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:44:14.986 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:44:14.986 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:44:14.986 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:44:14.987 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:44:14.987 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:44:14.987 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:44:14.988 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:44:14.988 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:44:14.988 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:44:14.989 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:44:14.989 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:44:14.989 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:44:14.990 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:44:14.990 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:44:14.990 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:44:14.991 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:44:14.991 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:44:14.991 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:14.992 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:14.992 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:44:14.992 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:14.992 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:14.993 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:14.993 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:14.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 msgr2=0x7f8708067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 0x7f8708067230 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f8718004d80 tx=0x7f871800b040).stop 2022-02-02T21:44:14.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 msgr2=0x7f871c105e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 secure :-1 s=READY pgs=3111 cs=0 l=1 rev1=1 rx=0x7f870c010a00 tx=0x7f870c00b040).stop 2022-02-02T21:44:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 shutdown_connections 2022-02-02T21:44:14.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8708064d70 0x7f8708067230 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871c0f5970 0x7f871c105e10 unknown :-1 s=CLOSED pgs=3111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 --2- 172.21.15.96:0/1350041663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f871c0f6c60 0x7f871c106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:14.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 >> 172.21.15.96:0/1350041663 conn(0x7f871c0f04c0 msgr2=0x7f871c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 shutdown_connections 2022-02-02T21:44:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:14.980+0000 7f8723883700 1 -- 172.21.15.96:0/1350041663 wait complete. 2022-02-02T21:44:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:44:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2090928057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:44:15.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1350041663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:44:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2090928057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:44:15.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1350041663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:44:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:16 smithi159 ceph-mon[69013]: pgmap v6065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:16 smithi096 ceph-mon[101353]: pgmap v6065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:18 smithi159 ceph-mon[69013]: pgmap v6066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:18 smithi096 ceph-mon[101353]: pgmap v6066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:20 smithi159 ceph-mon[69013]: pgmap v6067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:20 smithi096 ceph-mon[101353]: pgmap v6067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:22 smithi159 ceph-mon[69013]: pgmap v6068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:22 smithi096 ceph-mon[101353]: pgmap v6068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:24 smithi159 ceph-mon[69013]: pgmap v6069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:24 smithi096 ceph-mon[101353]: pgmap v6069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:26 smithi159 ceph-mon[69013]: pgmap v6070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:26 smithi096 ceph-mon[101353]: pgmap v6070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:44:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:44:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:44:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:44:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:28 smithi159 ceph-mon[69013]: pgmap v6071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:29.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:28 smithi096 ceph-mon[101353]: pgmap v6071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:30 smithi159 ceph-mon[69013]: pgmap v6072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:30 smithi096 ceph-mon[101353]: pgmap v6072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:32 smithi159 ceph-mon[69013]: pgmap v6073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:32 smithi096 ceph-mon[101353]: pgmap v6073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:34 smithi159 ceph-mon[69013]: pgmap v6074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:34 smithi096 ceph-mon[101353]: pgmap v6074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:36 smithi159 ceph-mon[69013]: pgmap v6075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:36 smithi096 ceph-mon[101353]: pgmap v6075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:38 smithi159 ceph-mon[69013]: pgmap v6076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:38 smithi096 ceph-mon[101353]: pgmap v6076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:40 smithi159 ceph-mon[69013]: pgmap v6077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:40 smithi096 ceph-mon[101353]: pgmap v6077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:42 smithi159 ceph-mon[69013]: pgmap v6078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:42 smithi096 ceph-mon[101353]: pgmap v6078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:44 smithi159 ceph-mon[69013]: pgmap v6079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:44 smithi096 ceph-mon[101353]: pgmap v6079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 -- 172.21.15.96:0/831298217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 msgr2=0x7fed180f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 --2- 172.21.15.96:0/831298217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed180f6b00 secure :-1 s=READY pgs=3112 cs=0 l=1 rev1=1 rx=0x7fed08004660 tx=0x7fed08009b30).stop 2022-02-02T21:44:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 -- 172.21.15.96:0/831298217 shutdown_connections 2022-02-02T21:44:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 --2- 172.21.15.96:0/831298217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 0x7fed180f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 --2- 172.21.15.96:0/831298217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed180f6b00 unknown :-1 s=CLOSED pgs=3112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 -- 172.21.15.96:0/831298217 >> 172.21.15.96:0/831298217 conn(0x7fed180f1e40 msgr2=0x7fed180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 -- 172.21.15.96:0/831298217 shutdown_connections 2022-02-02T21:44:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.091+0000 7fed201a2700 1 -- 172.21.15.96:0/831298217 wait complete. 2022-02-02T21:44:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 Processor -- start 2022-02-02T21:44:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 -- start start 2022-02-02T21:44:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 0x7fed18069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1806a380 con 0x7fed180f66e0 2022-02-02T21:44:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed201a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1806a4c0 con 0x7fed180f7980 2022-02-02T21:44:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44534/0 (socket says 172.21.15.96:44534) 2022-02-02T21:44:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 -- 172.21.15.96:0/2831274747 learned_addr learned my addr 172.21.15.96:0/2831274747 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1d73d700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 0x7fed18069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 -- 172.21.15.96:0/2831274747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 msgr2=0x7fed18069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 0x7fed18069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 -- 172.21.15.96:0/2831274747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08005040 con 0x7fed180f66e0 2022-02-02T21:44:45.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.092+0000 7fed1df3e700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 secure :-1 s=READY pgs=3113 cs=0 l=1 rev1=1 rx=0x7fed08009830 tx=0x7fed08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.093+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed08018070 con 0x7fed180f66e0 2022-02-02T21:44:45.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.093+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1806a740 con 0x7fed180f66e0 2022-02-02T21:44:45.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.093+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1806aca0 con 0x7fed180f66e0 2022-02-02T21:44:45.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.093+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed08007ba0 con 0x7fed180f66e0 2022-02-02T21:44:45.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.093+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0801de60 con 0x7fed180f66e0 2022-02-02T21:44:45.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.094+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed00004fa0 con 0x7fed180f66e0 2022-02-02T21:44:45.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.094+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed08007d10 con 0x7fed180f66e0 2022-02-02T21:44:45.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.095+0000 7fed0e7fc700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 0x7fed04067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.095+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed080835a0 con 0x7fed180f66e0 2022-02-02T21:44:45.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.095+0000 7fed1d73d700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 0x7fed04067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.095+0000 7fed1d73d700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 0x7fed04067270 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fed14004e20 tx=0x7fed1400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.099+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed08051700 con 0x7fed180f66e0 2022-02-02T21:44:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.277+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed00000bc0 con 0x7fed04064db0 2022-02-02T21:44:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.278+0000 7fed0e7fc700 1 -- 172.21.15.96:0/2831274747 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fed00000bc0 con 0x7fed04064db0 2022-02-02T21:44:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.279+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 msgr2=0x7fed04067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.279+0000 7fed201a2700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 0x7fed04067270 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fed14004e20 tx=0x7fed1400b040).stop 2022-02-02T21:44:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.279+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 msgr2=0x7fed1806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.279+0000 7fed201a2700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 secure :-1 s=READY pgs=3113 cs=0 l=1 rev1=1 rx=0x7fed08009830 tx=0x7fed08009b30).stop 2022-02-02T21:44:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 shutdown_connections 2022-02-02T21:44:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed04064db0 0x7fed04067270 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed180f66e0 0x7fed1806b9a0 unknown :-1 s=CLOSED pgs=3113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 --2- 172.21.15.96:0/2831274747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed180f7980 0x7fed18069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 >> 172.21.15.96:0/2831274747 conn(0x7fed180f1e40 msgr2=0x7fed180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 shutdown_connections 2022-02-02T21:44:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.280+0000 7fed201a2700 1 -- 172.21.15.96:0/2831274747 wait complete. 2022-02-02T21:44:45.289 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:44:45.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 -- 172.21.15.96:0/4058749474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 msgr2=0x7f199c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 --2- 172.21.15.96:0/4058749474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c0f59e0 secure :-1 s=READY pgs=3114 cs=0 l=1 rev1=1 rx=0x7f1998004660 tx=0x7f1998009b30).stop 2022-02-02T21:44:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 -- 172.21.15.96:0/4058749474 shutdown_connections 2022-02-02T21:44:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 --2- 172.21.15.96:0/4058749474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 --2- 172.21.15.96:0/4058749474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c0f59e0 unknown :-1 s=CLOSED pgs=3114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 -- 172.21.15.96:0/4058749474 >> 172.21.15.96:0/4058749474 conn(0x7f199c0f0d40 msgr2=0x7f199c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 -- 172.21.15.96:0/4058749474 shutdown_connections 2022-02-02T21:44:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.377+0000 7f19a44dc700 1 -- 172.21.15.96:0/4058749474 wait complete. 2022-02-02T21:44:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 Processor -- start 2022-02-02T21:44:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 -- start start 2022-02-02T21:44:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0603e0 con 0x7f199c0f55c0 2022-02-02T21:44:45.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a44dc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c060520 con 0x7f199c0f6860 2022-02-02T21:44:45.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a2278700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a2278700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44542/0 (socket says 172.21.15.96:44542) 2022-02-02T21:44:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.378+0000 7f19a2278700 1 -- 172.21.15.96:0/2074145069 learned_addr learned my addr 172.21.15.96:0/2074145069 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a1a77700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a2278700 1 -- 172.21.15.96:0/2074145069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 msgr2=0x7f199c10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a2278700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a2278700 1 -- 172.21.15.96:0/2074145069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998005040 con 0x7f199c0f55c0 2022-02-02T21:44:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a1a77700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:44:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a2278700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 secure :-1 s=READY pgs=3115 cs=0 l=1 rev1=1 rx=0x7f1998004f60 tx=0x7f1998009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1998018070 con 0x7f199c0f55c0 2022-02-02T21:44:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1998007ba0 con 0x7f199c0f55c0 2022-02-02T21:44:45.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c10c700 con 0x7f199c0f55c0 2022-02-02T21:44:45.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.379+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c10cc60 con 0x7f199c0f55c0 2022-02-02T21:44:45.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.380+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f199801c620 con 0x7f199c0f55c0 2022-02-02T21:44:45.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.380+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984004fa0 con 0x7f199c0f55c0 2022-02-02T21:44:45.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.381+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f199801c8e0 con 0x7f199c0f55c0 2022-02-02T21:44:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.381+0000 7f1992ffd700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 0x7f1988067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.381+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19980838e0 con 0x7f199c0f55c0 2022-02-02T21:44:45.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.381+0000 7f19a1a77700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 0x7f1988067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.382+0000 7f19a1a77700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 0x7f1988067290 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f198c0041d0 tx=0x7f198c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.385+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1998051ba0 con 0x7f199c0f55c0 2022-02-02T21:44:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.559+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1984000bc0 con 0x7f1988064dd0 2022-02-02T21:44:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.568+0000 7f1992ffd700 1 -- 172.21.15.96:0/2074145069 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1984000bc0 con 0x7f1988064dd0 2022-02-02T21:44:45.568 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:44:45.569 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:44:45.569 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:44:45.569 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:44:45.570 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:44:45.570 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:44:45.570 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:44:45.571 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:44:45.571 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:44:45.571 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:44:45.572 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:44:45.572 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:44:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:44:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:44:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:44:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:44:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:44:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:44:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:44:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:44:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:44:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:44:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 msgr2=0x7f1988067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 0x7f1988067290 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f198c0041d0 tx=0x7f198c009040).stop 2022-02-02T21:44:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 msgr2=0x7f199c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 secure :-1 s=READY pgs=3115 cs=0 l=1 rev1=1 rx=0x7f1998004f60 tx=0x7f1998009b30).stop 2022-02-02T21:44:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 shutdown_connections 2022-02-02T21:44:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1988064dd0 0x7f1988067290 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c0f55c0 0x7f199c109cb0 unknown :-1 s=CLOSED pgs=3115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 --2- 172.21.15.96:0/2074145069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f199c0f6860 0x7f199c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 >> 172.21.15.96:0/2074145069 conn(0x7f199c0f0d40 msgr2=0x7f199c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 shutdown_connections 2022-02-02T21:44:45.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.570+0000 7f19a44dc700 1 -- 172.21.15.96:0/2074145069 wait complete. 2022-02-02T21:44:45.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 -- 172.21.15.96:0/3272175311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 msgr2=0x7ff0880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/3272175311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff0880f7de0 secure :-1 s=READY pgs=3116 cs=0 l=1 rev1=1 rx=0x7ff078004660 tx=0x7ff078009b30).stop 2022-02-02T21:44:45.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 -- 172.21.15.96:0/3272175311 shutdown_connections 2022-02-02T21:44:45.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/3272175311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff0880f7de0 unknown :-1 s=CLOSED pgs=3116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/3272175311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 0x7ff0880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 -- 172.21.15.96:0/3272175311 >> 172.21.15.96:0/3272175311 conn(0x7ff0880f1e40 msgr2=0x7ff0880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.666+0000 7ff08dd6c700 1 -- 172.21.15.96:0/3272175311 shutdown_connections 2022-02-02T21:44:45.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:45 smithi096 ceph-mon[101353]: from='client.40336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 -- 172.21.15.96:0/3272175311 wait complete. 2022-02-02T21:44:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 Processor -- start 2022-02-02T21:44:45.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 -- start start 2022-02-02T21:44:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 0x7ff08806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806a380 con 0x7ff0880f7980 2022-02-02T21:44:45.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.667+0000 7ff08dd6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806a4c0 con 0x7ff0880f66e0 2022-02-02T21:44:45.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44554/0 (socket says 172.21.15.96:44554) 2022-02-02T21:44:45.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 -- 172.21.15.96:0/1889725680 learned_addr learned my addr 172.21.15.96:0/1889725680 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:45.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff0877fe700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 0x7ff08806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 -- 172.21.15.96:0/1889725680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 msgr2=0x7ff08806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 0x7ff08806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 -- 172.21.15.96:0/1889725680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078005040 con 0x7ff0880f7980 2022-02-02T21:44:45.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff086ffd700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 secure :-1 s=READY pgs=3117 cs=0 l=1 rev1=1 rx=0x7ff078009990 tx=0x7ff078009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078018070 con 0x7ff0880f7980 2022-02-02T21:44:45.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08806a740 con 0x7ff0880f7980 2022-02-02T21:44:45.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff078007ba0 con 0x7ff0880f7980 2022-02-02T21:44:45.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07801c3c0 con 0x7ff0880f7980 2022-02-02T21:44:45.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.668+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08806aca0 con 0x7ff0880f7980 2022-02-02T21:44:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.669+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff068004fa0 con 0x7ff0880f7980 2022-02-02T21:44:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.670+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff07801d420 con 0x7ff0880f7980 2022-02-02T21:44:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.670+0000 7ff06ffff700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 0x7ff070067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.670+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff078083520 con 0x7ff0880f7980 2022-02-02T21:44:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.670+0000 7ff0877fe700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 0x7ff070067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.671+0000 7ff0877fe700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 0x7ff070067290 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7ff08806b730 tx=0x7ff07c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:45.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.674+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff078051620 con 0x7ff0880f7980 2022-02-02T21:44:45.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:45 smithi159 ceph-mon[69013]: from='client.40336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:45.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.906+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff068005e80 con 0x7ff0880f7980 2022-02-02T21:44:45.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.906+0000 7ff06ffff700 1 -- 172.21.15.96:0/1889725680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff078054c40 con 0x7ff0880f7980 2022-02-02T21:44:45.907 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:44:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:44:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:44:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:44:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:44:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:44:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:44:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:44:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:44:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:44:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:44:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:44:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:44:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:44:45.913 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:44:45.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 msgr2=0x7ff070067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 0x7ff070067290 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7ff08806b730 tx=0x7ff07c00b040).stop 2022-02-02T21:44:45.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 msgr2=0x7ff088069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 secure :-1 s=READY pgs=3117 cs=0 l=1 rev1=1 rx=0x7ff078009990 tx=0x7ff078009b30).stop 2022-02-02T21:44:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 shutdown_connections 2022-02-02T21:44:45.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff070064dd0 0x7ff070067290 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0880f66e0 0x7ff08806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 --2- 172.21.15.96:0/1889725680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0880f7980 0x7ff088069e20 unknown :-1 s=CLOSED pgs=3117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:45.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 >> 172.21.15.96:0/1889725680 conn(0x7ff0880f1e40 msgr2=0x7ff0880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:45.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 shutdown_connections 2022-02-02T21:44:45.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:45.908+0000 7ff08dd6c700 1 -- 172.21.15.96:0/1889725680 wait complete. 2022-02-02T21:44:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 -- 172.21.15.96:0/1160912967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f7ba0 msgr2=0x7fa3a00f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1160912967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a00f7fc0 secure :-1 s=READY pgs=3118 cs=0 l=1 rev1=1 rx=0x7fa390004660 tx=0x7fa390009b30).stop 2022-02-02T21:44:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 -- 172.21.15.96:0/1160912967 shutdown_connections 2022-02-02T21:44:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1160912967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f8540 0x7fa3a00f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1160912967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a00f7fc0 unknown :-1 s=CLOSED pgs=3118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 -- 172.21.15.96:0/1160912967 >> 172.21.15.96:0/1160912967 conn(0x7fa3a00f0320 msgr2=0x7fa3a00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:46.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 -- 172.21.15.96:0/1160912967 shutdown_connections 2022-02-02T21:44:46.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.006+0000 7fa3a552b700 1 -- 172.21.15.96:0/1160912967 wait complete. 2022-02-02T21:44:46.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 Processor -- start 2022-02-02T21:44:46.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 -- start start 2022-02-02T21:44:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a0106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0107900 con 0x7fa3a00f8540 2022-02-02T21:44:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.007+0000 7fa3a552b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0108110 con 0x7fa3a00f7ba0 2022-02-02T21:44:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44562/0 (socket says 172.21.15.96:44562) 2022-02-02T21:44:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 -- 172.21.15.96:0/1438769122 learned_addr learned my addr 172.21.15.96:0/1438769122 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:44:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39ffff700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a0106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 -- 172.21.15.96:0/1438769122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f7ba0 msgr2=0x7fa3a0106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a0106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 -- 172.21.15.96:0/1438769122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390005040 con 0x7fa3a00f8540 2022-02-02T21:44:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39f7fe700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 secure :-1 s=READY pgs=3119 cs=0 l=1 rev1=1 rx=0x7fa3940026d0 tx=0x7fa394009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:46.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3940079c0 con 0x7fa3a00f8540 2022-02-02T21:44:46.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa39400f040 con 0x7fa3a00f8540 2022-02-02T21:44:46.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0108390 con 0x7fa3a00f8540 2022-02-02T21:44:46.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3940148b0 con 0x7fa3a00f8540 2022-02-02T21:44:46.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.008+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a0108950 con 0x7fa3a00f8540 2022-02-02T21:44:46.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.009+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0059100 con 0x7fa3a00f8540 2022-02-02T21:44:46.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.011+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa394007b20 con 0x7fa3a00f8540 2022-02-02T21:44:46.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.011+0000 7fa39cff9700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 0x7fa3880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:44:46.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.012+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa394081df0 con 0x7fa3a00f8540 2022-02-02T21:44:46.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.012+0000 7fa39ffff700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 0x7fa3880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:44:46.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.012+0000 7fa39ffff700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 0x7fa3880672e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fa390013690 tx=0x7fa390009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:44:46.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.015+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa39404fef0 con 0x7fa3a00f8540 2022-02-02T21:44:46.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.218+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa3a00fed70 con 0x7fa3a00f8540 2022-02-02T21:44:46.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.218+0000 7fa39cff9700 1 -- 172.21.15.96:0/1438769122 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa394053510 con 0x7fa3a00f8540 2022-02-02T21:44:46.219 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:44:46.220 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:44:46.220 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:44:46.221 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:44:46.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:46.222 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:44:46.222 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:44:46.222 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:44:46.223 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:44:46.224 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:44:46.224 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:44:46.225 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:44:46.225 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:44:46.226 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:44:46.226 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:44:46.226 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:44:46.227 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:44:46.227 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:44:46.228 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:44:46.228 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:44:46.229 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:44:46.229 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:44:46.229 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:44:46.230 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:44:46.230 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:44:46.230 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:44:46.231 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:44:46.231 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:44:46.231 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:44:46.232 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:44:46.232 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:44:46.232 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:44:46.233 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:46.233 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:46.233 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:44:46.234 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:44:46.234 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:46.234 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:46.235 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:44:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.221+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 msgr2=0x7fa3880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.221+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 0x7fa3880672e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fa390013690 tx=0x7fa390009b30).stop 2022-02-02T21:44:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.221+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 msgr2=0x7fa3a0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:44:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.221+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 secure :-1 s=READY pgs=3119 cs=0 l=1 rev1=1 rx=0x7fa3940026d0 tx=0x7fa394009de0).stop 2022-02-02T21:44:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 shutdown_connections 2022-02-02T21:44:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa388064e20 0x7fa3880672e0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3a00f7ba0 0x7fa3a0106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 --2- 172.21.15.96:0/1438769122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3a00f8540 0x7fa3a0107300 unknown :-1 s=CLOSED pgs=3119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:44:46.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 >> 172.21.15.96:0/1438769122 conn(0x7fa3a00f0320 msgr2=0x7fa3a00fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:44:46.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 shutdown_connections 2022-02-02T21:44:46.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:44:46.222+0000 7fa3a552b700 1 -- 172.21.15.96:0/1438769122 wait complete. 2022-02-02T21:44:46.240 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:44:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:46 smithi159 ceph-mon[69013]: from='client.40340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1889725680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:44:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1438769122' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:44:46.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:46 smithi159 ceph-mon[69013]: pgmap v6080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:46 smithi096 ceph-mon[101353]: from='client.40340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:44:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1889725680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:44:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1438769122' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:44:46.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:46 smithi096 ceph-mon[101353]: pgmap v6080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:48 smithi159 ceph-mon[69013]: pgmap v6081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:48 smithi096 ceph-mon[101353]: pgmap v6081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:50 smithi159 ceph-mon[69013]: pgmap v6082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:50 smithi096 ceph-mon[101353]: pgmap v6082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:52 smithi159 ceph-mon[69013]: pgmap v6083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:52 smithi096 ceph-mon[101353]: pgmap v6083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:54 smithi159 ceph-mon[69013]: pgmap v6084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:54 smithi096 ceph-mon[101353]: pgmap v6084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:56 smithi159 ceph-mon[69013]: pgmap v6085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:56 smithi096 ceph-mon[101353]: pgmap v6085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:44:58 smithi159 ceph-mon[69013]: pgmap v6086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:44:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:44:58 smithi096 ceph-mon[101353]: pgmap v6086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:00 smithi159 ceph-mon[69013]: pgmap v6087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:00 smithi096 ceph-mon[101353]: pgmap v6087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:02 smithi159 ceph-mon[69013]: pgmap v6088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:02 smithi096 ceph-mon[101353]: pgmap v6088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:04 smithi159 ceph-mon[69013]: pgmap v6089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:04 smithi096 ceph-mon[101353]: pgmap v6089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:06 smithi159 ceph-mon[69013]: pgmap v6090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:06 smithi096 ceph-mon[101353]: pgmap v6090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:08 smithi159 ceph-mon[69013]: pgmap v6091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:08 smithi096 ceph-mon[101353]: pgmap v6091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:10 smithi159 ceph-mon[69013]: pgmap v6092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:10 smithi096 ceph-mon[101353]: pgmap v6092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:12 smithi159 ceph-mon[69013]: pgmap v6093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:12 smithi096 ceph-mon[101353]: pgmap v6093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:14 smithi159 ceph-mon[69013]: pgmap v6094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:14 smithi096 ceph-mon[101353]: pgmap v6094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:16.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 -- 172.21.15.96:0/3094413569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 msgr2=0x7f227c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 --2- 172.21.15.96:0/3094413569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c0f7de0 secure :-1 s=READY pgs=3120 cs=0 l=1 rev1=1 rx=0x7f226c004660 tx=0x7f226c009b30).stop 2022-02-02T21:45:16.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 -- 172.21.15.96:0/3094413569 shutdown_connections 2022-02-02T21:45:16.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 --2- 172.21.15.96:0/3094413569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c0f7de0 unknown :-1 s=CLOSED pgs=3120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 --2- 172.21.15.96:0/3094413569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 0x7f227c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 -- 172.21.15.96:0/3094413569 >> 172.21.15.96:0/3094413569 conn(0x7f227c0f1e40 msgr2=0x7f227c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:16.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 -- 172.21.15.96:0/3094413569 shutdown_connections 2022-02-02T21:45:16.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.332+0000 7f22813cd700 1 -- 172.21.15.96:0/3094413569 wait complete. 2022-02-02T21:45:16.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 Processor -- start 2022-02-02T21:45:16.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 -- start start 2022-02-02T21:45:16.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 0x7f227c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c06a380 con 0x7f227c0f7980 2022-02-02T21:45:16.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f22813cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c06a4c0 con 0x7f227c0f66e0 2022-02-02T21:45:16.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f227a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f227a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44580/0 (socket says 172.21.15.96:44580) 2022-02-02T21:45:16.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f227a7fc700 1 -- 172.21.15.96:0/1067877357 learned_addr learned my addr 172.21.15.96:0/1067877357 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:16.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.333+0000 7f227affd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 0x7f227c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f227a7fc700 1 -- 172.21.15.96:0/1067877357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 msgr2=0x7f227c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f227a7fc700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 0x7f227c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f227a7fc700 1 -- 172.21.15.96:0/1067877357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c005040 con 0x7f227c0f7980 2022-02-02T21:45:16.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f227a7fc700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 secure :-1 s=READY pgs=3121 cs=0 l=1 rev1=1 rx=0x7f226c009990 tx=0x7f226c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c018070 con 0x7f227c0f7980 2022-02-02T21:45:16.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c06a740 con 0x7f227c0f7980 2022-02-02T21:45:16.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f226c007ba0 con 0x7f227c0f7980 2022-02-02T21:45:16.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c01c3c0 con 0x7f227c0f7980 2022-02-02T21:45:16.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.334+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c06aca0 con 0x7f227c0f7980 2022-02-02T21:45:16.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.335+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c045ad0 con 0x7f227c0f7980 2022-02-02T21:45:16.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.335+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f226c01d420 con 0x7f227c0f7980 2022-02-02T21:45:16.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.336+0000 7f22637fe700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 0x7f2264067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.336+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f226c0836b0 con 0x7f227c0f7980 2022-02-02T21:45:16.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.336+0000 7f227affd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 0x7f2264067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.336+0000 7f227affd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 0x7f2264067290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f227c06b730 tx=0x7f227000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.340+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f226c051810 con 0x7f227c0f7980 2022-02-02T21:45:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.522+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f227c057f10 con 0x7f2264064dd0 2022-02-02T21:45:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.523+0000 7f22637fe700 1 -- 172.21.15.96:0/1067877357 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f227c057f10 con 0x7f2264064dd0 2022-02-02T21:45:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 msgr2=0x7f2264067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 0x7f2264067290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f227c06b730 tx=0x7f227000b040).stop 2022-02-02T21:45:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 msgr2=0x7f227c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 secure :-1 s=READY pgs=3121 cs=0 l=1 rev1=1 rx=0x7f226c009990 tx=0x7f226c009b30).stop 2022-02-02T21:45:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 shutdown_connections 2022-02-02T21:45:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2264064dd0 0x7f2264067290 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f227c0f66e0 0x7f227c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 --2- 172.21.15.96:0/1067877357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f227c0f7980 0x7f227c069e20 unknown :-1 s=CLOSED pgs=3121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 >> 172.21.15.96:0/1067877357 conn(0x7f227c0f1e40 msgr2=0x7f227c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 shutdown_connections 2022-02-02T21:45:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.525+0000 7f22813cd700 1 -- 172.21.15.96:0/1067877357 wait complete. 2022-02-02T21:45:16.535 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:45:16.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- 172.21.15.96:0/1480605472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 msgr2=0x7f46700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 --2- 172.21.15.96:0/1480605472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f46700f7de0 secure :-1 s=READY pgs=3122 cs=0 l=1 rev1=1 rx=0x7f4660004660 tx=0x7f4660009b30).stop 2022-02-02T21:45:16.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- 172.21.15.96:0/1480605472 shutdown_connections 2022-02-02T21:45:16.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 --2- 172.21.15.96:0/1480605472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f46700f7de0 unknown :-1 s=CLOSED pgs=3122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 --2- 172.21.15.96:0/1480605472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 0x7f46700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- 172.21.15.96:0/1480605472 >> 172.21.15.96:0/1480605472 conn(0x7f46700f1e40 msgr2=0x7f46700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:16.627 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:16 smithi096 ceph-mon[101353]: pgmap v6095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:16.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- 172.21.15.96:0/1480605472 shutdown_connections 2022-02-02T21:45:16.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- 172.21.15.96:0/1480605472 wait complete. 2022-02-02T21:45:16.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 Processor -- start 2022-02-02T21:45:16.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.624+0000 7f467822d700 1 -- start start 2022-02-02T21:45:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 0x7f4670106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46701079b0 con 0x7f46700f7980 2022-02-02T21:45:16.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4670107af0 con 0x7f46700f66e0 2022-02-02T21:45:16.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44590/0 (socket says 172.21.15.96:44590) 2022-02-02T21:45:16.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 -- 172.21.15.96:0/339809291 learned_addr learned my addr 172.21.15.96:0/339809291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f4675fc9700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 0x7f4670106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 -- 172.21.15.96:0/339809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 msgr2=0x7f4670106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 0x7f4670106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 -- 172.21.15.96:0/339809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660005040 con 0x7f46700f7980 2022-02-02T21:45:16.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46757c8700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 secure :-1 s=READY pgs=3123 cs=0 l=1 rev1=1 rx=0x7f4660009990 tx=0x7f4660009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f466001c070 con 0x7f46700f7980 2022-02-02T21:45:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4670108430 con 0x7f46700f7980 2022-02-02T21:45:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4660009630 con 0x7f46700f7980 2022-02-02T21:45:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4660021820 con 0x7f46700f7980 2022-02-02T21:45:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.625+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4670108990 con 0x7f46700f7980 2022-02-02T21:45:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.626+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4670045ad0 con 0x7f46700f7980 2022-02-02T21:45:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.627+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4660012b80 con 0x7f46700f7980 2022-02-02T21:45:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.627+0000 7f46667fc700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 0x7f465c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.628+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4660087c30 con 0x7f46700f7980 2022-02-02T21:45:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.628+0000 7f4675fc9700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 0x7f465c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.628+0000 7f4675fc9700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 0x7f465c067290 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f46700f77e0 tx=0x7f466c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.632+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46600596a0 con 0x7f46700f7980 2022-02-02T21:45:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:16 smithi159 ceph-mon[69013]: pgmap v6095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:16.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.808+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4670108bb0 con 0x7f465c064dd0 2022-02-02T21:45:16.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.817+0000 7f46667fc700 1 -- 172.21.15.96:0/339809291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4670108bb0 con 0x7f465c064dd0 2022-02-02T21:45:16.818 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:45:16.818 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:45:16.818 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:45:16.819 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:45:16.819 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:45:16.820 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:45:16.820 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:45:16.820 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:45:16.820 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:45:16.821 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:45:16.821 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:45:16.821 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:45:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:45:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:45:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:45:16.823 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:45:16.823 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:45:16.823 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:45:16.824 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:45:16.824 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:45:16.824 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:45:16.825 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:45:16.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 msgr2=0x7f465c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 0x7f465c067290 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f46700f77e0 tx=0x7f466c00b040).stop 2022-02-02T21:45:16.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 msgr2=0x7f4670107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 secure :-1 s=READY pgs=3123 cs=0 l=1 rev1=1 rx=0x7f4660009990 tx=0x7f4660009b30).stop 2022-02-02T21:45:16.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 shutdown_connections 2022-02-02T21:45:16.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f465c064dd0 0x7f465c067290 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46700f66e0 0x7f4670106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 --2- 172.21.15.96:0/339809291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46700f7980 0x7f4670107400 unknown :-1 s=CLOSED pgs=3123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.819+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 >> 172.21.15.96:0/339809291 conn(0x7f46700f1e40 msgr2=0x7f46700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:16.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.820+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 shutdown_connections 2022-02-02T21:45:16.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.820+0000 7f467822d700 1 -- 172.21.15.96:0/339809291 wait complete. 2022-02-02T21:45:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 -- 172.21.15.96:0/380458526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 msgr2=0x7f46ec0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 --2- 172.21.15.96:0/380458526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec0f7dc0 secure :-1 s=READY pgs=3124 cs=0 l=1 rev1=1 rx=0x7f46e0004660 tx=0x7f46e0009b30).stop 2022-02-02T21:45:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 -- 172.21.15.96:0/380458526 shutdown_connections 2022-02-02T21:45:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 --2- 172.21.15.96:0/380458526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec0f7dc0 unknown :-1 s=CLOSED pgs=3124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 --2- 172.21.15.96:0/380458526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 0x7f46ec0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 -- 172.21.15.96:0/380458526 >> 172.21.15.96:0/380458526 conn(0x7f46ec0f1e20 msgr2=0x7f46ec0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 -- 172.21.15.96:0/380458526 shutdown_connections 2022-02-02T21:45:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.916+0000 7f46f14a0700 1 -- 172.21.15.96:0/380458526 wait complete. 2022-02-02T21:45:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 Processor -- start 2022-02-02T21:45:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 -- start start 2022-02-02T21:45:16.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 0x7f46ec106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec1079f0 con 0x7f46ec0f7960 2022-02-02T21:45:16.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.917+0000 7f46f14a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec107b30 con 0x7f46ec0f66c0 2022-02-02T21:45:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44604/0 (socket says 172.21.15.96:44604) 2022-02-02T21:45:16.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 -- 172.21.15.96:0/1259382108 learned_addr learned my addr 172.21.15.96:0/1259382108 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:16.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 -- 172.21.15.96:0/1259382108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 msgr2=0x7f46ec106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:16.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46eaffd700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 0x7f46ec106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 0x7f46ec106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 -- 172.21.15.96:0/1259382108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0005040 con 0x7f46ec0f7960 2022-02-02T21:45:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46ea7fc700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 secure :-1 s=READY pgs=3125 cs=0 l=1 rev1=1 rx=0x7f46e0009990 tx=0x7f46e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46e0018070 con 0x7f46ec0f7960 2022-02-02T21:45:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec108470 con 0x7f46ec0f7960 2022-02-02T21:45:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46e0007ca0 con 0x7f46ec0f7960 2022-02-02T21:45:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46e001c620 con 0x7f46ec0f7960 2022-02-02T21:45:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.918+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec1089d0 con 0x7f46ec0f7960 2022-02-02T21:45:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.920+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec045ad0 con 0x7f46ec0f7960 2022-02-02T21:45:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.920+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f46e001d960 con 0x7f46ec0f7960 2022-02-02T21:45:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.920+0000 7f46d37fe700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 0x7f46d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.920+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f46e00837e0 con 0x7f46ec0f7960 2022-02-02T21:45:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.920+0000 7f46eaffd700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 0x7f46d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.921+0000 7f46eaffd700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 0x7f46d4067290 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f46ec0f77c0 tx=0x7f46dc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:16.925+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f46e00553d0 con 0x7f46ec0f7960 2022-02-02T21:45:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.154+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46ec027a00 con 0x7f46ec0f7960 2022-02-02T21:45:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.154+0000 7f46d37fe700 1 -- 172.21.15.96:0/1259382108 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f46e0054fc0 con 0x7f46ec0f7960 2022-02-02T21:45:17.155 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:45:17.155 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:45:17.156 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:45:17.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:17.156 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:45:17.157 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:45:17.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:17.157 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:45:17.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:45:17.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:17.158 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:45:17.159 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:45:17.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:17.160 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:45:17.160 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:45:17.160 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:45:17.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:45:17.161 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:45:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.156+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 msgr2=0x7f46d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.156+0000 7f46f14a0700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 0x7f46d4067290 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f46ec0f77c0 tx=0x7f46dc009040).stop 2022-02-02T21:45:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.156+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 msgr2=0x7f46ec107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.156+0000 7f46f14a0700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 secure :-1 s=READY pgs=3125 cs=0 l=1 rev1=1 rx=0x7f46e0009990 tx=0x7f46e0009b30).stop 2022-02-02T21:45:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 shutdown_connections 2022-02-02T21:45:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f46d4064dd0 0x7f46d4067290 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46ec0f66c0 0x7f46ec106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 --2- 172.21.15.96:0/1259382108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46ec0f7960 0x7f46ec107440 unknown :-1 s=CLOSED pgs=3125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 >> 172.21.15.96:0/1259382108 conn(0x7f46ec0f1e20 msgr2=0x7f46ec0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 shutdown_connections 2022-02-02T21:45:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.157+0000 7f46f14a0700 1 -- 172.21.15.96:0/1259382108 wait complete. 2022-02-02T21:45:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 -- 172.21.15.96:0/2366672611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 msgr2=0x7fb3080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 --2- 172.21.15.96:0/2366672611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb3080f59e0 secure :-1 s=READY pgs=3126 cs=0 l=1 rev1=1 rx=0x7fb2f8004660 tx=0x7fb2f8009b30).stop 2022-02-02T21:45:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 -- 172.21.15.96:0/2366672611 shutdown_connections 2022-02-02T21:45:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 --2- 172.21.15.96:0/2366672611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 0x7fb3080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:45:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 --2- 172.21.15.96:0/2366672611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb3080f59e0 unknown :-1 s=CLOSED pgs=3126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 -- 172.21.15.96:0/2366672611 >> 172.21.15.96:0/2366672611 conn(0x7fb3080f0d40 msgr2=0x7fb3080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 -- 172.21.15.96:0/2366672611 shutdown_connections 2022-02-02T21:45:17.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.254+0000 7fb30e046700 1 -- 172.21.15.96:0/2366672611 wait complete. 2022-02-02T21:45:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 Processor -- start 2022-02-02T21:45:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 -- start start 2022-02-02T21:45:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 0x7fb3081074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308107af0 con 0x7fb3080f55c0 2022-02-02T21:45:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb30e046700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081083a0 con 0x7fb3080f6860 2022-02-02T21:45:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb3077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb3077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44610/0 (socket says 172.21.15.96:44610) 2022-02-02T21:45:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.255+0000 7fb3077fe700 1 -- 172.21.15.96:0/448313664 learned_addr learned my addr 172.21.15.96:0/448313664 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb306ffd700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 0x7fb3081074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb3077fe700 1 -- 172.21.15.96:0/448313664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 msgr2=0x7fb3081074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb3077fe700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 0x7fb3081074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb3077fe700 1 -- 172.21.15.96:0/448313664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8005040 con 0x7fb3080f55c0 2022-02-02T21:45:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb3077fe700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 secure :-1 s=READY pgs=3127 cs=0 l=1 rev1=1 rx=0x7fb2f8004f60 tx=0x7fb2f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f8018070 con 0x7fb3080f55c0 2022-02-02T21:45:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb308108620 con 0x7fb3080f55c0 2022-02-02T21:45:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2f8007ba0 con 0x7fb3080f55c0 2022-02-02T21:45:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f801c620 con 0x7fb3080f55c0 2022-02-02T21:45:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.256+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308108b80 con 0x7fb3080f55c0 2022-02-02T21:45:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.257+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3080f49b0 con 0x7fb3080f55c0 2022-02-02T21:45:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.258+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2f801c8e0 con 0x7fb3080f55c0 2022-02-02T21:45:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.259+0000 7fb2effff700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 0x7fb2f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:17.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.259+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb2f8083e90 con 0x7fb3080f55c0 2022-02-02T21:45:17.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.259+0000 7fb306ffd700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 0x7fb2f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.259+0000 7fb306ffd700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 0x7fb2f0067290 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fb2fc00b790 tx=0x7fb2fc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.262+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2f8055940 con 0x7fb3080f55c0 2022-02-02T21:45:17.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.462+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb308045ad0 con 0x7fb3080f55c0 2022-02-02T21:45:17.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.462+0000 7fb2effff700 1 -- 172.21.15.96:0/448313664 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb2f8055530 con 0x7fb3080f55c0 2022-02-02T21:45:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:45:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:45:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:45:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:45:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:45:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:45:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:45:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:45:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:45:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:45:17.468 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:45:17.468 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:45:17.468 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:45:17.469 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:45:17.469 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:45:17.469 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:45:17.470 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:45:17.470 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:45:17.471 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:45:17.471 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:45:17.471 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:45:17.472 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:45:17.472 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:45:17.472 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:45:17.473 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:45:17.474 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:45:17.475 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:45:17.475 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:45:17.475 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:45:17.476 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:45:17.476 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:45:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:17.478 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:45:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:17.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:17.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:17.480 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:17.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 msgr2=0x7fb2f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 0x7fb2f0067290 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fb2fc00b790 tx=0x7fb2fc008040).stop 2022-02-02T21:45:17.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 msgr2=0x7fb308106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:17.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 secure :-1 s=READY pgs=3127 cs=0 l=1 rev1=1 rx=0x7fb2f8004f60 tx=0x7fb2f8009b30).stop 2022-02-02T21:45:17.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 shutdown_connections 2022-02-02T21:45:17.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb2f0064dd0 0x7fb2f0067290 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3080f55c0 0x7fb308106fc0 unknown :-1 s=CLOSED pgs=3127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 --2- 172.21.15.96:0/448313664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3080f6860 0x7fb3081074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:17.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 >> 172.21.15.96:0/448313664 conn(0x7fb3080f0d40 msgr2=0x7fb3080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:17.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 shutdown_connections 2022-02-02T21:45:17.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:17.464+0000 7fb30e046700 1 -- 172.21.15.96:0/448313664 wait complete. 2022-02-02T21:45:17.486 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:45:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:17 smithi096 ceph-mon[101353]: from='client.40352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:17 smithi096 ceph-mon[101353]: from='client.40356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:17.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1259382108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:45:17.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/448313664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:45:17.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:17 smithi159 ceph-mon[69013]: from='client.40352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:17 smithi159 ceph-mon[69013]: from='client.40356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:17.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1259382108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:45:17.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/448313664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:45:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:18 smithi159 ceph-mon[69013]: pgmap v6096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:18 smithi096 ceph-mon[101353]: pgmap v6096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:20 smithi159 ceph-mon[69013]: pgmap v6097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:20 smithi096 ceph-mon[101353]: pgmap v6097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:22 smithi159 ceph-mon[69013]: pgmap v6098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:22 smithi096 ceph-mon[101353]: pgmap v6098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:24 smithi159 ceph-mon[69013]: pgmap v6099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:24 smithi096 ceph-mon[101353]: pgmap v6099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:26 smithi159 ceph-mon[69013]: pgmap v6100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:26 smithi096 ceph-mon[101353]: pgmap v6100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:45:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:45:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:45:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:45:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:28 smithi096 ceph-mon[101353]: pgmap v6101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:29.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:28 smithi159 ceph-mon[69013]: pgmap v6101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:30 smithi159 ceph-mon[69013]: pgmap v6102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:30 smithi096 ceph-mon[101353]: pgmap v6102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:32 smithi159 ceph-mon[69013]: pgmap v6103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:32 smithi096 ceph-mon[101353]: pgmap v6103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:34 smithi159 ceph-mon[69013]: pgmap v6104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:34 smithi096 ceph-mon[101353]: pgmap v6104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:36 smithi159 ceph-mon[69013]: pgmap v6105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:36 smithi096 ceph-mon[101353]: pgmap v6105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:38 smithi096 ceph-mon[101353]: pgmap v6106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:39.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:38 smithi159 ceph-mon[69013]: pgmap v6106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:40 smithi159 ceph-mon[69013]: pgmap v6107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:40 smithi096 ceph-mon[101353]: pgmap v6107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:42.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:42 smithi159 ceph-mon[69013]: pgmap v6108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:42 smithi096 ceph-mon[101353]: pgmap v6108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:44 smithi159 ceph-mon[69013]: pgmap v6109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:44 smithi096 ceph-mon[101353]: pgmap v6109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:46 smithi159 ceph-mon[69013]: pgmap v6110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:46 smithi096 ceph-mon[101353]: pgmap v6110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:47.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 -- 172.21.15.96:0/4265889502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 msgr2=0x7f20140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 --2- 172.21.15.96:0/4265889502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f20140f5850 secure :-1 s=READY pgs=3128 cs=0 l=1 rev1=1 rx=0x7f1ffc004660 tx=0x7f1ffc009b30).stop 2022-02-02T21:45:47.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 -- 172.21.15.96:0/4265889502 shutdown_connections 2022-02-02T21:45:47.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 --2- 172.21.15.96:0/4265889502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f20140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 --2- 172.21.15.96:0/4265889502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f20140f5850 unknown :-1 s=CLOSED pgs=3128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 -- 172.21.15.96:0/4265889502 >> 172.21.15.96:0/4265889502 conn(0x7f20140f0b90 msgr2=0x7f20140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:47.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 -- 172.21.15.96:0/4265889502 shutdown_connections 2022-02-02T21:45:47.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 -- 172.21.15.96:0/4265889502 wait complete. 2022-02-02T21:45:47.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.573+0000 7f2018b46700 1 Processor -- start 2022-02-02T21:45:47.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2018b46700 1 -- start start 2022-02-02T21:45:47.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2018b46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2018b46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f201410bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2018b46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140603c0 con 0x7f20140f5430 2022-02-02T21:45:47.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2018b46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014060500 con 0x7f20140f66d0 2022-02-02T21:45:47.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44628/0 (socket says 172.21.15.96:44628) 2022-02-02T21:45:47.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 -- 172.21.15.96:0/484632770 learned_addr learned my addr 172.21.15.96:0/484632770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:47.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2012ffd700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f201410bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 -- 172.21.15.96:0/484632770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 msgr2=0x7f201410bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f201410bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 -- 172.21.15.96:0/484632770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc005040 con 0x7f20140f5430 2022-02-02T21:45:47.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f2012ffd700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f201410bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:45:47.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.574+0000 7f20137fe700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 secure :-1 s=READY pgs=3129 cs=0 l=1 rev1=1 rx=0x7f1ffc004f60 tx=0x7f1ffc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:47.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.575+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ffc018070 con 0x7f20140f5430 2022-02-02T21:45:47.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.575+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201410c540 con 0x7f20140f5430 2022-02-02T21:45:47.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.575+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ffc007ba0 con 0x7f20140f5430 2022-02-02T21:45:47.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.575+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ffc01c620 con 0x7f20140f5430 2022-02-02T21:45:47.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.575+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201410ca70 con 0x7f20140f5430 2022-02-02T21:45:47.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.576+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014045ad0 con 0x7f20140f5430 2022-02-02T21:45:47.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.576+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ffc01c8e0 con 0x7f20140f5430 2022-02-02T21:45:47.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.577+0000 7f200bfff700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 0x7f20000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.577+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ffc083970 con 0x7f20140f5430 2022-02-02T21:45:47.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.577+0000 7f2012ffd700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 0x7f20000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.577+0000 7f2012ffd700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 0x7f20000672e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f20040041d0 tx=0x7f2004009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:47.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.581+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ffc051b30 con 0x7f20140f5430 2022-02-02T21:45:47.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.761+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2014057f10 con 0x7f2000064e20 2022-02-02T21:45:47.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.762+0000 7f200bfff700 1 -- 172.21.15.96:0/484632770 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2014057f10 con 0x7f2000064e20 2022-02-02T21:45:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 msgr2=0x7f20000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 0x7f20000672e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f20040041d0 tx=0x7f2004009040).stop 2022-02-02T21:45:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 msgr2=0x7f2014109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 secure :-1 s=READY pgs=3129 cs=0 l=1 rev1=1 rx=0x7f1ffc004f60 tx=0x7f1ffc009b30).stop 2022-02-02T21:45:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 shutdown_connections 2022-02-02T21:45:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2000064e20 0x7f20000672e0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20140f5430 0x7f2014109af0 unknown :-1 s=CLOSED pgs=3129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 --2- 172.21.15.96:0/484632770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20140f66d0 0x7f201410bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 >> 172.21.15.96:0/484632770 conn(0x7f20140f0b90 msgr2=0x7f20140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 shutdown_connections 2022-02-02T21:45:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.764+0000 7f2018b46700 1 -- 172.21.15.96:0/484632770 wait complete. 2022-02-02T21:45:47.775 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:45:47.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 -- 172.21.15.96:0/3935692418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f66e0 msgr2=0x7fb60c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 --2- 172.21.15.96:0/3935692418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f66e0 0x7fb60c0f6b00 secure :-1 s=READY pgs=3130 cs=0 l=1 rev1=1 rx=0x7fb5fc004660 tx=0x7fb5fc009b30).stop 2022-02-02T21:45:47.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 -- 172.21.15.96:0/3935692418 shutdown_connections 2022-02-02T21:45:47.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 --2- 172.21.15.96:0/3935692418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f7980 0x7fb60c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:45:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 --2- 172.21.15.96:0/3935692418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f66e0 0x7fb60c0f6b00 unknown :-1 s=CLOSED pgs=3130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 -- 172.21.15.96:0/3935692418 >> 172.21.15.96:0/3935692418 conn(0x7fb60c0f1e40 msgr2=0x7fb60c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 -- 172.21.15.96:0/3935692418 shutdown_connections 2022-02-02T21:45:47.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.862+0000 7fb614195700 1 -- 172.21.15.96:0/3935692418 wait complete. 2022-02-02T21:45:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 Processor -- start 2022-02-02T21:45:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 -- start start 2022-02-02T21:45:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f66e0 0x7fb60c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c06a410 con 0x7fb60c0f7980 2022-02-02T21:45:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb614195700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c06a550 con 0x7fb60c0f66e0 2022-02-02T21:45:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb611730700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb611730700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44640/0 (socket says 172.21.15.96:44640) 2022-02-02T21:45:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb611730700 1 -- 172.21.15.96:0/1161827535 learned_addr learned my addr 172.21.15.96:0/1161827535 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb611f31700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f66e0 0x7fb60c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.863+0000 7fb611730700 1 -- 172.21.15.96:0/1161827535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f66e0 msgr2=0x7fb60c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:47.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb611730700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f66e0 0x7fb60c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:47.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb611730700 1 -- 172.21.15.96:0/1161827535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc005040 con 0x7fb60c0f7980 2022-02-02T21:45:47.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb611730700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 secure :-1 s=READY pgs=3131 cs=0 l=1 rev1=1 rx=0x7fb60800b410 tx=0x7fb608006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:47.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6080125f0 con 0x7fb60c0f7980 2022-02-02T21:45:47.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb60800be30 con 0x7fb60c0f7980 2022-02-02T21:45:47.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c06a830 con 0x7fb60c0f7980 2022-02-02T21:45:47.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb608002a70 con 0x7fb60c0f7980 2022-02-02T21:45:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.864+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c10efe0 con 0x7fb60c0f7980 2022-02-02T21:45:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.865+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c045ad0 con 0x7fb60c0f7980 2022-02-02T21:45:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.866+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb60800f030 con 0x7fb60c0f7980 2022-02-02T21:45:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.866+0000 7fb6027fc700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 0x7fb5f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.866+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb608081db0 con 0x7fb60c0f7980 2022-02-02T21:45:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.866+0000 7fb611f31700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 0x7fb5f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.866+0000 7fb611f31700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 0x7fb5f8067290 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7fb5fc013690 tx=0x7fb5fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:47.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:47.870+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb60804feb0 con 0x7fb60c0f7980 2022-02-02T21:45:48.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.042+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb60c0ff030 con 0x7fb5f8064dd0 2022-02-02T21:45:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.052+0000 7fb6027fc700 1 -- 172.21.15.96:0/1161827535 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb60c0ff030 con 0x7fb5f8064dd0 2022-02-02T21:45:48.053 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:45:48.053 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 2h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:45:48.054 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 2h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:45:48.054 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:45:48.054 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 2h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:45:48.055 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 2h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:45:48.055 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 2h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:45:48.055 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:45:48.056 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:45:48.056 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 2h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:45:48.057 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:45:48.057 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 2h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:45:48.057 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:45:48.058 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 2h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:45:48.058 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:45:48.058 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 2h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:45:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 2h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:45:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 2h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:45:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:45:48.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:45:48.060 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:45:48.060 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 2h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:45:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 msgr2=0x7fb5f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 0x7fb5f8067290 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7fb5fc013690 tx=0x7fb5fc009b30).stop 2022-02-02T21:45:48.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 msgr2=0x7fb60c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 secure :-1 s=READY pgs=3131 cs=0 l=1 rev1=1 rx=0x7fb60800b410 tx=0x7fb608006ef0).stop 2022-02-02T21:45:48.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 shutdown_connections 2022-02-02T21:45:48.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5f8064dd0 0x7fb5f8067290 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb60c0f66e0 0x7fb60c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 --2- 172.21.15.96:0/1161827535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb60c0f7980 0x7fb60c069e20 unknown :-1 s=CLOSED pgs=3131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.053+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 >> 172.21.15.96:0/1161827535 conn(0x7fb60c0f1e40 msgr2=0x7fb60c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:48.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.054+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 shutdown_connections 2022-02-02T21:45:48.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.054+0000 7fb614195700 1 -- 172.21.15.96:0/1161827535 wait complete. 2022-02-02T21:45:48.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 -- 172.21.15.96:0/1093678601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f77e0 msgr2=0x7f35280f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 --2- 172.21.15.96:0/1093678601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f77e0 0x7f35280f7c40 secure :-1 s=READY pgs=3132 cs=0 l=1 rev1=1 rx=0x7f351c004660 tx=0x7f351c009b30).stop 2022-02-02T21:45:48.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 -- 172.21.15.96:0/1093678601 shutdown_connections 2022-02-02T21:45:48.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 --2- 172.21.15.96:0/1093678601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f77e0 0x7f35280f7c40 unknown :-1 s=CLOSED pgs=3132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 --2- 172.21.15.96:0/1093678601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f6540 0x7f35280f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 -- 172.21.15.96:0/1093678601 >> 172.21.15.96:0/1093678601 conn(0x7f35280f1ca0 msgr2=0x7f35280f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 -- 172.21.15.96:0/1093678601 shutdown_connections 2022-02-02T21:45:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.149+0000 7f352d5e1700 1 -- 172.21.15.96:0/1093678601 wait complete. 2022-02-02T21:45:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 Processor -- start 2022-02-02T21:45:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 -- start start 2022-02-02T21:45:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f77e0 0x7f3528069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352806a380 con 0x7f35280f6540 2022-02-02T21:45:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.150+0000 7f352d5e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352806a4c0 con 0x7f35280f77e0 2022-02-02T21:45:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44648/0 (socket says 172.21.15.96:44648) 2022-02-02T21:45:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 -- 172.21.15.96:0/376255351 learned_addr learned my addr 172.21.15.96:0/376255351 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f35267fc700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f77e0 0x7f3528069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 -- 172.21.15.96:0/376255351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f77e0 msgr2=0x7f3528069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f77e0 0x7f3528069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 -- 172.21.15.96:0/376255351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c005040 con 0x7f35280f6540 2022-02-02T21:45:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f3526ffd700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 secure :-1 s=READY pgs=3133 cs=0 l=1 rev1=1 rx=0x7f3518002700 tx=0x7f3518009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:48.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35180079c0 con 0x7f35280f6540 2022-02-02T21:45:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f351800f040 con 0x7f35280f6540 2022-02-02T21:45:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352806a7a0 con 0x7f35280f6540 2022-02-02T21:45:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3518014850 con 0x7f35280f6540 2022-02-02T21:45:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.151+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352810ed10 con 0x7f35280f6540 2022-02-02T21:45:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.152+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3528045ad0 con 0x7f35280f6540 2022-02-02T21:45:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.153+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f351801b060 con 0x7f35280f6540 2022-02-02T21:45:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.153+0000 7f350f7fe700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 0x7f35100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.153+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3518081860 con 0x7f35280f6540 2022-02-02T21:45:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.154+0000 7f35267fc700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 0x7f35100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.154+0000 7f35267fc700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 0x7f35100672e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f351c004630 tx=0x7f351c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:48.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.158+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f351804f960 con 0x7f35280f6540 2022-02-02T21:45:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.386+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f352806a930 con 0x7f35280f6540 2022-02-02T21:45:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.387+0000 7f350f7fe700 1 -- 172.21.15.96:0/376255351 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f352806a930 con 0x7f35280f6540 2022-02-02T21:45:48.389 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:45:48.389 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:45:48.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:45:48.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:48.390 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:45:48.390 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:45:48.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:48.391 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:45:48.392 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:45:48.392 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:48.393 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:45:48.393 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:45:48.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:45:48.394 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:45:48.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:45:48.395 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:45:48.395 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:45:48.395 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:45:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 msgr2=0x7f35100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 0x7f35100672e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f351c004630 tx=0x7f351c009b30).stop 2022-02-02T21:45:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 msgr2=0x7f352806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 secure :-1 s=READY pgs=3133 cs=0 l=1 rev1=1 rx=0x7f3518002700 tx=0x7f3518009e00).stop 2022-02-02T21:45:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 shutdown_connections 2022-02-02T21:45:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3510064e20 0x7f35100672e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35280f6540 0x7f352806b9a0 unknown :-1 s=CLOSED pgs=3133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 --2- 172.21.15.96:0/376255351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35280f77e0 0x7f3528069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 >> 172.21.15.96:0/376255351 conn(0x7f35280f1ca0 msgr2=0x7f35280fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 shutdown_connections 2022-02-02T21:45:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.388+0000 7f352d5e1700 1 -- 172.21.15.96:0/376255351 wait complete. 2022-02-02T21:45:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.485+0000 7f1ce359e700 1 -- 172.21.15.96:0/2581716219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 msgr2=0x7f1ce40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.485+0000 7f1ce359e700 1 --2- 172.21.15.96:0/2581716219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce40f6b30 secure :-1 s=READY pgs=3134 cs=0 l=1 rev1=1 rx=0x7f1cd8004660 tx=0x7f1cd8009b30).stop 2022-02-02T21:45:48.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- 172.21.15.96:0/2581716219 shutdown_connections 2022-02-02T21:45:48.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 --2- 172.21.15.96:0/2581716219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce40f6b30 unknown :-1 s=CLOSED pgs=3134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 --2- 172.21.15.96:0/2581716219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- 172.21.15.96:0/2581716219 >> 172.21.15.96:0/2581716219 conn(0x7f1ce40f0b90 msgr2=0x7f1ce40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:48.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- 172.21.15.96:0/2581716219 shutdown_connections 2022-02-02T21:45:48.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- 172.21.15.96:0/2581716219 wait complete. 2022-02-02T21:45:48.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 Processor -- start 2022-02-02T21:45:48.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- start start 2022-02-02T21:45:48.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce4106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4107830 con 0x7f1ce40f66d0 2022-02-02T21:45:48.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.486+0000 7f1ce359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4108040 con 0x7f1ce40f5430 2022-02-02T21:45:48.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce4106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44660/0 (socket says 172.21.15.96:44660) 2022-02-02T21:45:48.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce4106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:48762/0 (socket says 172.21.15.96:48762) 2022-02-02T21:45:48.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 -- 172.21.15.96:0/1970498239 learned_addr learned my addr 172.21.15.96:0/1970498239 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:45:48.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 -- 172.21.15.96:0/1970498239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 msgr2=0x7f1ce4106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce4106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 -- 172.21.15.96:0/1970498239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8005040 con 0x7f1ce40f66d0 2022-02-02T21:45:48.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.487+0000 7f1ce1d9b700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 secure :-1 s=READY pgs=3135 cs=0 l=1 rev1=1 rx=0x7f1cd8000c00 tx=0x7f1cd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.488+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd8019070 con 0x7f1ce40f66d0 2022-02-02T21:45:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.488+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce4108260 con 0x7f1ce40f66d0 2022-02-02T21:45:48.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.488+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1cd8007e70 con 0x7f1ce40f66d0 2022-02-02T21:45:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.488+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd8014ce0 con 0x7f1ce40f66d0 2022-02-02T21:45:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.488+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce41087c0 con 0x7f1ce40f66d0 2022-02-02T21:45:48.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.489+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce4059100 con 0x7f1ce40f66d0 2022-02-02T21:45:48.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.489+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1cd8025070 con 0x7f1ce40f66d0 2022-02-02T21:45:48.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.489+0000 7f1cd2ffd700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 0x7f1ccc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:45:48.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.490+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1cd8082910 con 0x7f1ce40f66d0 2022-02-02T21:45:48.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.490+0000 7f1ce259c700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 0x7f1ccc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:45:48.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.490+0000 7f1ce259c700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 0x7f1ccc0672e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f1ce4106ab0 tx=0x7f1cd400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:45:48.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.495+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1cd8050a10 con 0x7f1ce40f66d0 2022-02-02T21:45:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.696+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ce40fee80 con 0x7f1ce40f66d0 2022-02-02T21:45:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.697+0000 7f1cd2ffd700 1 -- 172.21.15.96:0/1970498239 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1ce40fee80 con 0x7f1ce40f66d0 2022-02-02T21:45:48.699 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:45:48.699 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:45:48.699 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:45:48.700 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:45:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:48.701 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:45:48.701 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:45:48.701 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:45:48.702 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:45:48.702 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:45:48.703 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:45:48.703 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:45:48.703 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:45:48.704 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:45:48.704 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:45:48.704 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:45:48.705 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:45:48.705 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:45:48.705 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:45:48.706 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:45:48.706 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:45:48.706 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:45:48.707 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:45:48.707 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:45:48.707 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:45:48.708 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:45:48.708 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:45:48.708 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:45:48.709 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:45:48.709 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:45:48.709 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:45:48.710 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:45:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:48.711 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:45:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:45:48.712 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:48.713 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:48.713 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:45:48.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 msgr2=0x7f1ccc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 0x7f1ccc0672e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f1ce4106ab0 tx=0x7f1cd400b040).stop 2022-02-02T21:45:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 msgr2=0x7f1ce4107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:45:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 secure :-1 s=READY pgs=3135 cs=0 l=1 rev1=1 rx=0x7f1cd8000c00 tx=0x7f1cd800b040).stop 2022-02-02T21:45:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 shutdown_connections 2022-02-02T21:45:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ccc064e20 0x7f1ccc0672e0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce40f5430 0x7f1ce4106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 --2- 172.21.15.96:0/1970498239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce40f66d0 0x7f1ce4107230 unknown :-1 s=CLOSED pgs=3135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:45:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 >> 172.21.15.96:0/1970498239 conn(0x7f1ce40f0b90 msgr2=0x7f1ce40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:45:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 shutdown_connections 2022-02-02T21:45:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:45:48.700+0000 7f1ce359e700 1 -- 172.21.15.96:0/1970498239 wait complete. 2022-02-02T21:45:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:45:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:48 smithi096 ceph-mon[101353]: from='client.40368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:48 smithi096 ceph-mon[101353]: from='client.40372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/376255351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:45:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:48 smithi096 ceph-mon[101353]: pgmap v6111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:49.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1970498239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:45:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:48 smithi159 ceph-mon[69013]: from='client.40368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:48 smithi159 ceph-mon[69013]: from='client.40372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:45:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/376255351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:45:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:48 smithi159 ceph-mon[69013]: pgmap v6111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:49.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1970498239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:45:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:50 smithi159 ceph-mon[69013]: pgmap v6112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:50 smithi096 ceph-mon[101353]: pgmap v6112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:52 smithi159 ceph-mon[69013]: pgmap v6113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:52 smithi096 ceph-mon[101353]: pgmap v6113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:54 smithi159 ceph-mon[69013]: pgmap v6114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:54 smithi096 ceph-mon[101353]: pgmap v6114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:56 smithi159 ceph-mon[69013]: pgmap v6115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:56 smithi096 ceph-mon[101353]: pgmap v6115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:45:58 smithi096 ceph-mon[101353]: pgmap v6116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:45:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:45:58 smithi159 ceph-mon[69013]: pgmap v6116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:00 smithi159 ceph-mon[69013]: pgmap v6117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:00 smithi096 ceph-mon[101353]: pgmap v6117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:02 smithi159 ceph-mon[69013]: pgmap v6118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:02 smithi096 ceph-mon[101353]: pgmap v6118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:04 smithi159 ceph-mon[69013]: pgmap v6119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:04 smithi096 ceph-mon[101353]: pgmap v6119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:06 smithi159 ceph-mon[69013]: pgmap v6120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:06 smithi096 ceph-mon[101353]: pgmap v6120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:08 smithi096 ceph-mon[101353]: pgmap v6121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:08 smithi159 ceph-mon[69013]: pgmap v6121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:10 smithi159 ceph-mon[69013]: pgmap v6122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:10 smithi096 ceph-mon[101353]: pgmap v6122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:12 smithi159 ceph-mon[69013]: pgmap v6123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:12 smithi096 ceph-mon[101353]: pgmap v6123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:14 smithi159 ceph-mon[69013]: pgmap v6124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:14 smithi096 ceph-mon[101353]: pgmap v6124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:16 smithi159 ceph-mon[69013]: pgmap v6125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:16 smithi096 ceph-mon[101353]: pgmap v6125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 -- 172.21.15.96:0/3006728242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 msgr2=0x7f1ea40f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 --2- 172.21.15.96:0/3006728242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea40f6fe0 secure :-1 s=READY pgs=3136 cs=0 l=1 rev1=1 rx=0x7f1e94004660 tx=0x7f1e94009b30).stop 2022-02-02T21:46:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 -- 172.21.15.96:0/3006728242 shutdown_connections 2022-02-02T21:46:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 --2- 172.21.15.96:0/3006728242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 0x7f1ea40f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:46:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 --2- 172.21.15.96:0/3006728242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea40f6fe0 unknown :-1 s=CLOSED pgs=3136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 -- 172.21.15.96:0/3006728242 >> 172.21.15.96:0/3006728242 conn(0x7f1ea40f04c0 msgr2=0x7f1ea40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 -- 172.21.15.96:0/3006728242 shutdown_connections 2022-02-02T21:46:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.811+0000 7f1eab769700 1 -- 172.21.15.96:0/3006728242 wait complete. 2022-02-02T21:46:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 Processor -- start 2022-02-02T21:46:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 -- start start 2022-02-02T21:46:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 0x7f1ea410c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40f56f0 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.812+0000 7f1eab769700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40f5830 con 0x7f1ea40f7560 2022-02-02T21:46:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:18.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44676/0 (socket says 172.21.15.96:44676) 2022-02-02T21:46:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 -- 172.21.15.96:0/1535957634 learned_addr learned my addr 172.21.15.96:0/1535957634 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea8d04700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 0x7f1ea410c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:18.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 -- 172.21.15.96:0/1535957634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 msgr2=0x7f1ea410c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:18.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 0x7f1ea410c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:18.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 -- 172.21.15.96:0/1535957634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94005040 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1ea9505700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 secure :-1 s=READY pgs=3137 cs=0 l=1 rev1=1 rx=0x7f1e94009d80 tx=0x7f1e94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e94018070 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea410c890 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e94007ba0 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e9401c620 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.813+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea410cdc0 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.814+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea40f4150 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.815+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e9401d420 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.815+0000 7f1e99ffb700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 0x7f1e90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.815+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1e940838a0 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.815+0000 7f1ea8d04700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 0x7f1e90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.816+0000 7f1ea8d04700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 0x7f1e90067290 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f1ea40f79a0 tx=0x7f1ea0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.820+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e94051940 con 0x7f1ea40f6bc0 2022-02-02T21:46:18.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:18.999+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ea40fdfa0 con 0x7f1e90064dd0 2022-02-02T21:46:19.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.000+0000 7f1e99ffb700 1 -- 172.21.15.96:0/1535957634 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1ea40fdfa0 con 0x7f1e90064dd0 2022-02-02T21:46:19.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 msgr2=0x7f1e90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 0x7f1e90067290 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f1ea40f79a0 tx=0x7f1ea0008040).stop 2022-02-02T21:46:19.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 msgr2=0x7f1ea4109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 secure :-1 s=READY pgs=3137 cs=0 l=1 rev1=1 rx=0x7f1e94009d80 tx=0x7f1e94009b30).stop 2022-02-02T21:46:19.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 shutdown_connections 2022-02-02T21:46:19.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e90064dd0 0x7f1e90067290 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea40f6bc0 0x7f1ea4109d90 unknown :-1 s=CLOSED pgs=3137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 --2- 172.21.15.96:0/1535957634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea40f7560 0x7f1ea410c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 >> 172.21.15.96:0/1535957634 conn(0x7f1ea40f04c0 msgr2=0x7f1ea40fa410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 shutdown_connections 2022-02-02T21:46:19.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.002+0000 7f1eab769700 1 -- 172.21.15.96:0/1535957634 wait complete. 2022-02-02T21:46:19.012 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:46:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:18 smithi096 ceph-mon[101353]: pgmap v6126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.099+0000 7feaeffff700 1 -- 172.21.15.96:0/850525821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 msgr2=0x7feaf00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.099+0000 7feaeffff700 1 --2- 172.21.15.96:0/850525821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf00f7c30 secure :-1 s=READY pgs=3138 cs=0 l=1 rev1=1 rx=0x7feae0004660 tx=0x7feae0009b30).stop 2022-02-02T21:46:19.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 -- 172.21.15.96:0/850525821 shutdown_connections 2022-02-02T21:46:19.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 --2- 172.21.15.96:0/850525821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf00f7c30 unknown :-1 s=CLOSED pgs=3138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 --2- 172.21.15.96:0/850525821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 -- 172.21.15.96:0/850525821 >> 172.21.15.96:0/850525821 conn(0x7feaf00f1c90 msgr2=0x7feaf00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 -- 172.21.15.96:0/850525821 shutdown_connections 2022-02-02T21:46:19.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 -- 172.21.15.96:0/850525821 wait complete. 2022-02-02T21:46:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.100+0000 7feaeffff700 1 Processor -- start 2022-02-02T21:46:19.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeffff700 1 -- start start 2022-02-02T21:46:19.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf006a380 con 0x7feaf00f77d0 2022-02-02T21:46:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf006a4c0 con 0x7feaf00f6530 2022-02-02T21:46:19.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44688/0 (socket says 172.21.15.96:44688) 2022-02-02T21:46:19.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 -- 172.21.15.96:0/3222706197 learned_addr learned my addr 172.21.15.96:0/3222706197 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:19.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeeffd700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 -- 172.21.15.96:0/3222706197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 msgr2=0x7feaf006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 -- 172.21.15.96:0/3222706197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0005040 con 0x7feaf00f77d0 2022-02-02T21:46:19.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaeeffd700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:46:19.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7feaee7fc700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 secure :-1 s=READY pgs=3139 cs=0 l=1 rev1=1 rx=0x7feae0009990 tx=0x7feae0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.101+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae0018070 con 0x7feaf00f77d0 2022-02-02T21:46:19.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.102+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf006a740 con 0x7feaf00f77d0 2022-02-02T21:46:19.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.102+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feae0007ca0 con 0x7feaf00f77d0 2022-02-02T21:46:19.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.102+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae001c620 con 0x7feaf00f77d0 2022-02-02T21:46:19.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.102+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf006aca0 con 0x7feaf00f77d0 2022-02-02T21:46:19.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.103+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf0045ad0 con 0x7feaf00f77d0 2022-02-02T21:46:19.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.103+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feae001d960 con 0x7feaf00f77d0 2022-02-02T21:46:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.103+0000 7fead77fe700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 0x7fead80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.103+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feae00837e0 con 0x7feaf00f77d0 2022-02-02T21:46:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.103+0000 7feaeeffd700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 0x7fead80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.104+0000 7feaeeffd700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 0x7fead80672e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7feae4007fd0 tx=0x7feae4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.107+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feae00519a0 con 0x7feaf00f77d0 2022-02-02T21:46:19.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:18 smithi159 ceph-mon[69013]: pgmap v6126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:19.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.279+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feaf0057f10 con 0x7fead8064e20 2022-02-02T21:46:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.289+0000 7fead77fe700 1 -- 172.21.15.96:0/3222706197 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7feaf0057f10 con 0x7fead8064e20 2022-02-02T21:46:19.291 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:46:19.291 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:46:19.291 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:46:19.292 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:46:19.292 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:46:19.292 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:46:19.293 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:46:19.293 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:46:19.293 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:46:19.294 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:46:19.294 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:46:19.294 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:46:19.295 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:46:19.295 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:46:19.295 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:46:19.296 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:46:19.296 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:46:19.297 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:46:19.297 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:46:19.297 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:46:19.298 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:46:19.298 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:46:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.290+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 msgr2=0x7fead80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 0x7fead80672e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7feae4007fd0 tx=0x7feae4009040).stop 2022-02-02T21:46:19.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 msgr2=0x7feaf0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 secure :-1 s=READY pgs=3139 cs=0 l=1 rev1=1 rx=0x7feae0009990 tx=0x7feae0009b30).stop 2022-02-02T21:46:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 shutdown_connections 2022-02-02T21:46:19.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fead8064e20 0x7fead80672e0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6530 0x7feaf006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 --2- 172.21.15.96:0/3222706197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f77d0 0x7feaf0069e20 unknown :-1 s=CLOSED pgs=3139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 >> 172.21.15.96:0/3222706197 conn(0x7feaf00f1c90 msgr2=0x7feaf00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 shutdown_connections 2022-02-02T21:46:19.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.291+0000 7feaeffff700 1 -- 172.21.15.96:0/3222706197 wait complete. 2022-02-02T21:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 -- 172.21.15.96:0/2117989045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 msgr2=0x7f7d640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/2117989045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d640f59e0 secure :-1 s=READY pgs=3140 cs=0 l=1 rev1=1 rx=0x7f7d54004660 tx=0x7f7d54009b30).stop 2022-02-02T21:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 -- 172.21.15.96:0/2117989045 shutdown_connections 2022-02-02T21:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/2117989045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 0x7f7d640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/2117989045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d640f59e0 unknown :-1 s=CLOSED pgs=3140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 -- 172.21.15.96:0/2117989045 >> 172.21.15.96:0/2117989045 conn(0x7f7d640f0d40 msgr2=0x7f7d640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 -- 172.21.15.96:0/2117989045 shutdown_connections 2022-02-02T21:46:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.388+0000 7f7d6c63f700 1 -- 172.21.15.96:0/2117989045 wait complete. 2022-02-02T21:46:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 Processor -- start 2022-02-02T21:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 -- start start 2022-02-02T21:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 0x7f7d64107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64107a10 con 0x7f7d640f55c0 2022-02-02T21:46:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6c63f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64107b50 con 0x7f7d640f6860 2022-02-02T21:46:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44696/0 (socket says 172.21.15.96:44696) 2022-02-02T21:46:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 -- 172.21.15.96:0/3608572595 learned_addr learned my addr 172.21.15.96:0/3608572595 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:19.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d69bda700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 0x7f7d64107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 -- 172.21.15.96:0/3608572595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 msgr2=0x7f7d64107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 0x7f7d64107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 -- 172.21.15.96:0/3608572595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54005040 con 0x7f7d640f55c0 2022-02-02T21:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.389+0000 7f7d6a3db700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 secure :-1 s=READY pgs=3141 cs=0 l=1 rev1=1 rx=0x7f7d54013a70 tx=0x7f7d54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.390+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d54018070 con 0x7f7d640f55c0 2022-02-02T21:46:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.390+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d64108490 con 0x7f7d640f55c0 2022-02-02T21:46:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.390+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d540097d0 con 0x7f7d640f55c0 2022-02-02T21:46:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.390+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d5401de80 con 0x7f7d640f55c0 2022-02-02T21:46:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.390+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d641089f0 con 0x7f7d640f55c0 2022-02-02T21:46:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.391+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d64045ad0 con 0x7f7d640f55c0 2022-02-02T21:46:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.391+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d54007ba0 con 0x7f7d640f55c0 2022-02-02T21:46:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.392+0000 7f7d5affd700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 0x7f7d50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.392+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7d54083660 con 0x7f7d640f55c0 2022-02-02T21:46:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.392+0000 7f7d69bda700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 0x7f7d50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.392+0000 7f7d69bda700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 0x7f7d50067290 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f7d60004c40 tx=0x7f7d6000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.396+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d54055190 con 0x7f7d640f55c0 2022-02-02T21:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.624+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d641091b0 con 0x7f7d640f55c0 2022-02-02T21:46:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.625+0000 7f7d5affd700 1 -- 172.21.15.96:0/3608572595 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7d54054d80 con 0x7f7d640f55c0 2022-02-02T21:46:19.626 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:46:19.627 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:46:19.627 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:46:19.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:19.628 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:46:19.628 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:46:19.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:19.629 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:46:19.629 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:46:19.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:19.630 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:46:19.630 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:46:19.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:19.631 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:46:19.632 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:46:19.632 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:46:19.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:46:19.633 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:46:19.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.626+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 msgr2=0x7f7d50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.626+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 0x7f7d50067290 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f7d60004c40 tx=0x7f7d6000b040).stop 2022-02-02T21:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.626+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 msgr2=0x7f7d64106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 secure :-1 s=READY pgs=3141 cs=0 l=1 rev1=1 rx=0x7f7d54013a70 tx=0x7f7d54009b30).stop 2022-02-02T21:46:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 shutdown_connections 2022-02-02T21:46:19.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d50064dd0 0x7f7d50067290 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d640f55c0 0x7f7d64106f70 unknown :-1 s=CLOSED pgs=3141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 --2- 172.21.15.96:0/3608572595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d640f6860 0x7f7d64107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 >> 172.21.15.96:0/3608572595 conn(0x7f7d640f0d40 msgr2=0x7f7d6405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 shutdown_connections 2022-02-02T21:46:19.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.627+0000 7f7d6c63f700 1 -- 172.21.15.96:0/3608572595 wait complete. 2022-02-02T21:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 -- 172.21.15.96:0/1474194925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f55c0 msgr2=0x7f757c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 --2- 172.21.15.96:0/1474194925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f55c0 0x7f757c0f59e0 secure :-1 s=READY pgs=3142 cs=0 l=1 rev1=1 rx=0x7f7564004660 tx=0x7f7564009b30).stop 2022-02-02T21:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 -- 172.21.15.96:0/1474194925 shutdown_connections 2022-02-02T21:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 --2- 172.21.15.96:0/1474194925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f6860 0x7f757c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 --2- 172.21.15.96:0/1474194925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f55c0 0x7f757c0f59e0 unknown :-1 s=CLOSED pgs=3142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 -- 172.21.15.96:0/1474194925 >> 172.21.15.96:0/1474194925 conn(0x7f757c0f0d40 msgr2=0x7f757c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 -- 172.21.15.96:0/1474194925 shutdown_connections 2022-02-02T21:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.724+0000 7f7580f94700 1 -- 172.21.15.96:0/1474194925 wait complete. 2022-02-02T21:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 Processor -- start 2022-02-02T21:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 -- start start 2022-02-02T21:46:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f55c0 0x7f757c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c106950 con 0x7f757c0f6860 2022-02-02T21:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7580f94700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c107160 con 0x7f757c0f55c0 2022-02-02T21:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44708/0 (socket says 172.21.15.96:44708) 2022-02-02T21:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 -- 172.21.15.96:0/1305200699 learned_addr learned my addr 172.21.15.96:0/1305200699 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f757a59c700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f55c0 0x7f757c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 -- 172.21.15.96:0/1305200699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f55c0 msgr2=0x7f757c105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f55c0 0x7f757c105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 -- 172.21.15.96:0/1305200699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564005040 con 0x7f757c0f6860 2022-02-02T21:46:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.725+0000 7f7579d9b700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 secure :-1 s=READY pgs=3143 cs=0 l=1 rev1=1 rx=0x7f756c002700 tx=0x7f756c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.726+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756c009320 con 0x7f757c0f6860 2022-02-02T21:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.726+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f756c00f040 con 0x7f757c0f6860 2022-02-02T21:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.726+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756c014820 con 0x7f757c0f6860 2022-02-02T21:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.726+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c1073e0 con 0x7f757c0f6860 2022-02-02T21:46:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.726+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c1079a0 con 0x7f757c0f6860 2022-02-02T21:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.727+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c0f49b0 con 0x7f757c0f6860 2022-02-02T21:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.728+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f756c009480 con 0x7f757c0f6860 2022-02-02T21:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.728+0000 7f7572ffd700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 0x7f7568067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.728+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f756c081d10 con 0x7f757c0f6860 2022-02-02T21:46:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.728+0000 7f757a59c700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 0x7f7568067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.728+0000 7f757a59c700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 0x7f7568067290 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f7564004e30 tx=0x7f7564009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.732+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f756c04fe10 con 0x7f757c0f6860 2022-02-02T21:46:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.934+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f757c0fdf10 con 0x7f757c0f6860 2022-02-02T21:46:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.934+0000 7f7572ffd700 1 -- 172.21.15.96:0/1305200699 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f757c0fdf10 con 0x7f757c0f6860 2022-02-02T21:46:19.936 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:46:19.937 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:46:19.937 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:46:19.937 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:46:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:19.939 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:46:19.939 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:46:19.939 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:46:19.940 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:46:19.940 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:46:19.940 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:46:19.941 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:46:19.942 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:46:19.943 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:46:19.943 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:46:19.944 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:46:19.944 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:46:19.944 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:46:19.945 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:46:19.945 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:46:19.945 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:46:19.946 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:46:19.946 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:46:19.947 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:46:19.947 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:46:19.947 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:46:19.948 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:46:19.948 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:46:19.948 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:46:19.948 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:46:19.949 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:46:19.949 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:46:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:19.950 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:46:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:19.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.936+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 msgr2=0x7f7568067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.936+0000 7f7580f94700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 0x7f7568067290 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f7564004e30 tx=0x7f7564009b30).stop 2022-02-02T21:46:19.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.936+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 msgr2=0x7f757c106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:19.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 secure :-1 s=READY pgs=3143 cs=0 l=1 rev1=1 rx=0x7f756c002700 tx=0x7f756c009e00).stop 2022-02-02T21:46:19.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 shutdown_connections 2022-02-02T21:46:19.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7568064dd0 0x7f7568067290 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f757c0f55c0 0x7f757c105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 --2- 172.21.15.96:0/1305200699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f757c0f6860 0x7f757c106350 unknown :-1 s=CLOSED pgs=3143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:19.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 >> 172.21.15.96:0/1305200699 conn(0x7f757c0f0d40 msgr2=0x7f757c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:19.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 shutdown_connections 2022-02-02T21:46:19.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:19.937+0000 7f7580f94700 1 -- 172.21.15.96:0/1305200699 wait complete. 2022-02-02T21:46:19.957 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:46:20.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:19 smithi096 ceph-mon[101353]: from='client.40384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:19 smithi096 ceph-mon[101353]: from='client.40388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3608572595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:46:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:19 smithi159 ceph-mon[69013]: from='client.40384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:19 smithi159 ceph-mon[69013]: from='client.40388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3608572595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:46:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1305200699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:46:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:20 smithi096 ceph-mon[101353]: pgmap v6127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:21.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1305200699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:46:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:20 smithi159 ceph-mon[69013]: pgmap v6127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:22 smithi159 ceph-mon[69013]: pgmap v6128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:22 smithi096 ceph-mon[101353]: pgmap v6128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:24 smithi159 ceph-mon[69013]: pgmap v6129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:24 smithi096 ceph-mon[101353]: pgmap v6129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:26 smithi159 ceph-mon[69013]: pgmap v6130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:26 smithi096 ceph-mon[101353]: pgmap v6130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:46:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:46:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:46:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:46:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:28 smithi096 ceph-mon[101353]: pgmap v6131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:29.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:28 smithi159 ceph-mon[69013]: pgmap v6131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:30 smithi159 ceph-mon[69013]: pgmap v6132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:30 smithi096 ceph-mon[101353]: pgmap v6132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:32 smithi159 ceph-mon[69013]: pgmap v6133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:32 smithi096 ceph-mon[101353]: pgmap v6133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:34 smithi159 ceph-mon[69013]: pgmap v6134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:34 smithi096 ceph-mon[101353]: pgmap v6134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:36 smithi159 ceph-mon[69013]: pgmap v6135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:36 smithi096 ceph-mon[101353]: pgmap v6135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:38 smithi096 ceph-mon[101353]: pgmap v6136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:39.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:38 smithi159 ceph-mon[69013]: pgmap v6136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:40 smithi159 ceph-mon[69013]: pgmap v6137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:40 smithi096 ceph-mon[101353]: pgmap v6137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:42 smithi159 ceph-mon[69013]: pgmap v6138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:42 smithi096 ceph-mon[101353]: pgmap v6138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:44 smithi159 ceph-mon[69013]: pgmap v6139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:44 smithi096 ceph-mon[101353]: pgmap v6139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:46 smithi159 ceph-mon[69013]: pgmap v6140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:46 smithi096 ceph-mon[101353]: pgmap v6140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:48 smithi096 ceph-mon[101353]: pgmap v6141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:49.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:48 smithi159 ceph-mon[69013]: pgmap v6141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:50.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 -- 172.21.15.96:0/4245141389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f5430 msgr2=0x7f38b40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 --2- 172.21.15.96:0/4245141389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f5430 0x7f38b40f5850 secure :-1 s=READY pgs=3144 cs=0 l=1 rev1=1 rx=0x7f38ac0099e0 tx=0x7f38ac004d10).stop 2022-02-02T21:46:50.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 -- 172.21.15.96:0/4245141389 shutdown_connections 2022-02-02T21:46:50.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 --2- 172.21.15.96:0/4245141389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f66d0 0x7f38b40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 --2- 172.21.15.96:0/4245141389 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f5430 0x7f38b40f5850 unknown :-1 s=CLOSED pgs=3144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 -- 172.21.15.96:0/4245141389 >> 172.21.15.96:0/4245141389 conn(0x7f38b40f0b90 msgr2=0x7f38b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 -- 172.21.15.96:0/4245141389 shutdown_connections 2022-02-02T21:46:50.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 -- 172.21.15.96:0/4245141389 wait complete. 2022-02-02T21:46:50.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.048+0000 7f38b3fff700 1 Processor -- start 2022-02-02T21:46:50.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b3fff700 1 -- start start 2022-02-02T21:46:50.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f5430 0x7f38b4109b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b3fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40603e0 con 0x7f38b40f66d0 2022-02-02T21:46:50.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4060520 con 0x7f38b40f5430 2022-02-02T21:46:50.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44732/0 (socket says 172.21.15.96:44732) 2022-02-02T21:46:50.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 -- 172.21.15.96:0/3719441512 learned_addr learned my addr 172.21.15.96:0/3719441512 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:50.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b2ffd700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f5430 0x7f38b4109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 -- 172.21.15.96:0/3719441512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f5430 msgr2=0x7f38b4109b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f5430 0x7f38b4109b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 -- 172.21.15.96:0/3719441512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009640 con 0x7f38b40f66d0 2022-02-02T21:46:50.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.049+0000 7f38b27fc700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 secure :-1 s=READY pgs=3145 cs=0 l=1 rev1=1 rx=0x7f389c0026d0 tx=0x7f389c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.050+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389c0079c0 con 0x7f38b40f66d0 2022-02-02T21:46:50.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.050+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b410c640 con 0x7f38b40f66d0 2022-02-02T21:46:50.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.050+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f389c00f040 con 0x7f38b40f66d0 2022-02-02T21:46:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.050+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389c0148b0 con 0x7f38b40f66d0 2022-02-02T21:46:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.050+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b410cb80 con 0x7f38b40f66d0 2022-02-02T21:46:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.051+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b4045ad0 con 0x7f38b40f66d0 2022-02-02T21:46:50.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.051+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f389c007b20 con 0x7f38b40f66d0 2022-02-02T21:46:50.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.052+0000 7f38ab7fe700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 0x7f38a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.052+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f389c0819e0 con 0x7f38b40f66d0 2022-02-02T21:46:50.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.052+0000 7f38b2ffd700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 0x7f38a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.052+0000 7f38b2ffd700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 0x7f38a00672e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f38ac0099b0 tx=0x7f38ac004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.056+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f389c04fae0 con 0x7f38b40f66d0 2022-02-02T21:46:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.233+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38b40fdd30 con 0x7f38a0064e20 2022-02-02T21:46:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.235+0000 7f38ab7fe700 1 -- 172.21.15.96:0/3719441512 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f38b40fdd30 con 0x7f38a0064e20 2022-02-02T21:46:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.236+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 msgr2=0x7f38a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.236+0000 7f38b3fff700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 0x7f38a00672e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f38ac0099b0 tx=0x7f38ac004d10).stop 2022-02-02T21:46:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.236+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 msgr2=0x7f38b410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.236+0000 7f38b3fff700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 secure :-1 s=READY pgs=3145 cs=0 l=1 rev1=1 rx=0x7f389c0026d0 tx=0x7f389c009de0).stop 2022-02-02T21:46:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.236+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 shutdown_connections 2022-02-02T21:46:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38a0064e20 0x7f38a00672e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38b40f5430 0x7f38b4109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 --2- 172.21.15.96:0/3719441512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b40f66d0 0x7f38b410c090 unknown :-1 s=CLOSED pgs=3145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 >> 172.21.15.96:0/3719441512 conn(0x7f38b40f0b90 msgr2=0x7f38b40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 shutdown_connections 2022-02-02T21:46:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.237+0000 7f38b3fff700 1 -- 172.21.15.96:0/3719441512 wait complete. 2022-02-02T21:46:50.246 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:46:50.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 -- 172.21.15.96:0/4172660128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f55c0 msgr2=0x7fb2080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 --2- 172.21.15.96:0/4172660128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f55c0 0x7fb2080f59e0 secure :-1 s=READY pgs=3146 cs=0 l=1 rev1=1 rx=0x7fb1fc004660 tx=0x7fb1fc009b30).stop 2022-02-02T21:46:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 -- 172.21.15.96:0/4172660128 shutdown_connections 2022-02-02T21:46:50.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 --2- 172.21.15.96:0/4172660128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f6860 0x7fb2080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 --2- 172.21.15.96:0/4172660128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f55c0 0x7fb2080f59e0 unknown :-1 s=CLOSED pgs=3146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 -- 172.21.15.96:0/4172660128 >> 172.21.15.96:0/4172660128 conn(0x7fb2080f0d40 msgr2=0x7fb2080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 -- 172.21.15.96:0/4172660128 shutdown_connections 2022-02-02T21:46:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 -- 172.21.15.96:0/4172660128 wait complete. 2022-02-02T21:46:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.334+0000 7fb20f4be700 1 Processor -- start 2022-02-02T21:46:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 -- start start 2022-02-02T21:46:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 0x7fb208106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208107a10 con 0x7fb2080f6860 2022-02-02T21:46:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208107b50 con 0x7fb2080f55c0 2022-02-02T21:46:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44742/0 (socket says 172.21.15.96:44742) 2022-02-02T21:46:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 -- 172.21.15.96:0/297579674 learned_addr learned my addr 172.21.15.96:0/297579674 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20d25a700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 0x7fb208106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 -- 172.21.15.96:0/297579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 msgr2=0x7fb208106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 0x7fb208106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 -- 172.21.15.96:0/297579674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc005040 con 0x7fb2080f6860 2022-02-02T21:46:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20d25a700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 0x7fb208106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:46:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20ca59700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 secure :-1 s=READY pgs=3147 cs=0 l=1 rev1=1 rx=0x7fb20400c530 tx=0x7fb204007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb20400f650 con 0x7fb2080f6860 2022-02-02T21:46:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb20400fc60 con 0x7fb2080f6860 2022-02-02T21:46:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb204012cd0 con 0x7fb2080f6860 2022-02-02T21:46:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.335+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2081084f0 con 0x7fb2080f6860 2022-02-02T21:46:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.336+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb208108ab0 con 0x7fb2080f6860 2022-02-02T21:46:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.337+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb208045ad0 con 0x7fb2080f6860 2022-02-02T21:46:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.337+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb204010070 con 0x7fb2080f6860 2022-02-02T21:46:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.337+0000 7fb1f9ffb700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 0x7fb1f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.337+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb2040816c0 con 0x7fb2080f6860 2022-02-02T21:46:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.337+0000 7fb20d25a700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 0x7fb1f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.338+0000 7fb20d25a700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 0x7fb1f4067290 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7fb1fc004e30 tx=0x7fb1fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.341+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2040477d0 con 0x7fb2080f6860 2022-02-02T21:46:50.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.517+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2080faca0 con 0x7fb1f4064dd0 2022-02-02T21:46:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.526+0000 7fb1f9ffb700 1 -- 172.21.15.96:0/297579674 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb2080faca0 con 0x7fb1f4064dd0 2022-02-02T21:46:50.527 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:46:50.527 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:46:50.527 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:46:50.528 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:46:50.528 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:46:50.528 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:46:50.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:46:50.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:46:50.529 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:46:50.530 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:46:50.530 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:46:50.530 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:46:50.531 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:46:50.531 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:46:50.531 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:46:50.532 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:46:50.532 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:46:50.532 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:46:50.533 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:46:50.533 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:46:50.533 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:46:50.534 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:46:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 msgr2=0x7fb1f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 0x7fb1f4067290 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7fb1fc004e30 tx=0x7fb1fc009b30).stop 2022-02-02T21:46:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 msgr2=0x7fb208107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 secure :-1 s=READY pgs=3147 cs=0 l=1 rev1=1 rx=0x7fb20400c530 tx=0x7fb204007e20).stop 2022-02-02T21:46:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 shutdown_connections 2022-02-02T21:46:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb1f4064dd0 0x7fb1f4067290 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2080f55c0 0x7fb208106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 --2- 172.21.15.96:0/297579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2080f6860 0x7fb208107460 unknown :-1 s=CLOSED pgs=3147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 >> 172.21.15.96:0/297579674 conn(0x7fb2080f0d40 msgr2=0x7fb20805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 shutdown_connections 2022-02-02T21:46:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.528+0000 7fb20f4be700 1 -- 172.21.15.96:0/297579674 wait complete. 2022-02-02T21:46:50.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- 172.21.15.96:0/1442340837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 msgr2=0x7f89300f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 --2- 172.21.15.96:0/1442340837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 0x7f89300f5850 secure :-1 s=READY pgs=3148 cs=0 l=1 rev1=1 rx=0x7f8924004660 tx=0x7f8924009b30).stop 2022-02-02T21:46:50.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- 172.21.15.96:0/1442340837 shutdown_connections 2022-02-02T21:46:50.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 --2- 172.21.15.96:0/1442340837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f89300f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:46:50.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 --2- 172.21.15.96:0/1442340837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 0x7f89300f5850 unknown :-1 s=CLOSED pgs=3148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- 172.21.15.96:0/1442340837 >> 172.21.15.96:0/1442340837 conn(0x7f89300f0b90 msgr2=0x7f89300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- 172.21.15.96:0/1442340837 shutdown_connections 2022-02-02T21:46:50.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- 172.21.15.96:0/1442340837 wait complete. 2022-02-02T21:46:50.628 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:50 smithi096 ceph-mon[101353]: from='client.40400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:50.629 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:50 smithi096 ceph-mon[101353]: pgmap v6142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:50.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 Processor -- start 2022-02-02T21:46:50.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.625+0000 7f8935d07700 1 -- start start 2022-02-02T21:46:50.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f8935d07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 0x7f8930109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f8935d07700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f8935d07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930060470 con 0x7f89300f5430 2022-02-02T21:46:50.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f8935d07700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300605b0 con 0x7f89300f66d0 2022-02-02T21:46:50.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f892ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f892ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:48856/0 (socket says 172.21.15.96:48856) 2022-02-02T21:46:50.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.626+0000 7f892ffff700 1 -- 172.21.15.96:0/693222697 learned_addr learned my addr 172.21.15.96:0/693222697 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:50.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892ffff700 1 -- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 msgr2=0x7f8930109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892ffff700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 0x7f8930109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:46:50.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892ffff700 1 -- 172.21.15.96:0/693222697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924005040 con 0x7f89300f66d0 2022-02-02T21:46:50.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892ffff700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f891c00b410 tx=0x7f891c006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f891c0125f0 con 0x7f89300f66d0 2022-02-02T21:46:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f891c012c00 con 0x7f89300f66d0 2022-02-02T21:46:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f891c002ae0 con 0x7f89300f66d0 2022-02-02T21:46:50.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893010c610 con 0x7f89300f66d0 2022-02-02T21:46:50.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.627+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893010cba0 con 0x7f89300f66d0 2022-02-02T21:46:50.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.628+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8930059100 con 0x7f89300f66d0 2022-02-02T21:46:50.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.628+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f891c00f030 con 0x7f89300f66d0 2022-02-02T21:46:50.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.629+0000 7f892d7fa700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 0x7f89200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.629+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f891c081f90 con 0x7f89300f66d0 2022-02-02T21:46:50.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.629+0000 7f8934d05700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 0x7f89200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.629+0000 7f8934d05700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 0x7f89200672e0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f8924004e30 tx=0x7f8924009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.633+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f891c0b07d0 con 0x7f89300f66d0 2022-02-02T21:46:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:50 smithi159 ceph-mon[69013]: from='client.40400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:50 smithi159 ceph-mon[69013]: pgmap v6142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:50.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.864+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8930045ad0 con 0x7f89300f66d0 2022-02-02T21:46:50.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.865+0000 7f892d7fa700 1 -- 172.21.15.96:0/693222697 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f891c050010 con 0x7f89300f66d0 2022-02-02T21:46:50.865 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:46:50.865 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:46:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:46:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:50.866 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:46:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:50.868 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:46:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:46:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:46:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:46:50.869 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:46:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:46:50.870 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:46:50.870 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:46:50.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.866+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 msgr2=0x7f89200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.866+0000 7f8935d07700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 0x7f89200672e0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f8924004e30 tx=0x7f8924009b30).stop 2022-02-02T21:46:50.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.866+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 msgr2=0x7f893010bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.866+0000 7f8935d07700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f891c00b410 tx=0x7f891c006ef0).stop 2022-02-02T21:46:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 shutdown_connections 2022-02-02T21:46:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8920064e20 0x7f89200672e0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89300f5430 0x7f8930109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:46:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 --2- 172.21.15.96:0/693222697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89300f66d0 0x7f893010bfb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 >> 172.21.15.96:0/693222697 conn(0x7f89300f0b90 msgr2=0x7f89300fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 shutdown_connections 2022-02-02T21:46:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.867+0000 7f8935d07700 1 -- 172.21.15.96:0/693222697 wait complete. 2022-02-02T21:46:50.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 -- 172.21.15.96:0/3185443225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 msgr2=0x7f7aa40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 --2- 172.21.15.96:0/3185443225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa40f6950 secure :-1 s=READY pgs=3149 cs=0 l=1 rev1=1 rx=0x7f7a94004660 tx=0x7f7a94009b30).stop 2022-02-02T21:46:50.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 -- 172.21.15.96:0/3185443225 shutdown_connections 2022-02-02T21:46:50.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 --2- 172.21.15.96:0/3185443225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 0x7f7aa40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 --2- 172.21.15.96:0/3185443225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa40f6950 unknown :-1 s=CLOSED pgs=3149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 -- 172.21.15.96:0/3185443225 >> 172.21.15.96:0/3185443225 conn(0x7f7aa40f1c90 msgr2=0x7f7aa40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:50.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 -- 172.21.15.96:0/3185443225 shutdown_connections 2022-02-02T21:46:50.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.964+0000 7f7aa8954700 1 -- 172.21.15.96:0/3185443225 wait complete. 2022-02-02T21:46:50.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 Processor -- start 2022-02-02T21:46:50.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 -- start start 2022-02-02T21:46:50.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 0x7f7aa4109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4109a30 con 0x7f7aa40f6530 2022-02-02T21:46:50.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa8954700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4109b70 con 0x7f7aa40f77d0 2022-02-02T21:46:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44760/0 (socket says 172.21.15.96:44760) 2022-02-02T21:46:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.965+0000 7f7aa37fe700 1 -- 172.21.15.96:0/2299683272 learned_addr learned my addr 172.21.15.96:0/2299683272 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:46:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa2ffd700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 0x7f7aa4109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa37fe700 1 -- 172.21.15.96:0/2299683272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 msgr2=0x7f7aa4109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa37fe700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 0x7f7aa4109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa37fe700 1 -- 172.21.15.96:0/2299683272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94005040 con 0x7f7aa40f6530 2022-02-02T21:46:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa37fe700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 secure :-1 s=READY pgs=3150 cs=0 l=1 rev1=1 rx=0x7f7a94013a70 tx=0x7f7a94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a94018070 con 0x7f7aa40f6530 2022-02-02T21:46:50.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa410a4b0 con 0x7f7aa40f6530 2022-02-02T21:46:50.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a940097d0 con 0x7f7aa40f6530 2022-02-02T21:46:50.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9401c3c0 con 0x7f7aa40f6530 2022-02-02T21:46:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.966+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa410aa10 con 0x7f7aa40f6530 2022-02-02T21:46:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.967+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4045ad0 con 0x7f7aa40f6530 2022-02-02T21:46:50.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.968+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a94007ba0 con 0x7f7aa40f6530 2022-02-02T21:46:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.968+0000 7f7a8bfff700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 0x7f7a8c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:46:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.968+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a94083740 con 0x7f7aa40f6530 2022-02-02T21:46:50.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.968+0000 7f7aa2ffd700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 0x7f7a8c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:46:50.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.969+0000 7f7aa2ffd700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 0x7f7a8c0672e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f7a980096c0 tx=0x7f7a98009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:46:50.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:50.972+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a94055330 con 0x7f7aa40f6530 2022-02-02T21:46:51.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.170+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7aa40fed90 con 0x7f7aa40f6530 2022-02-02T21:46:51.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.170+0000 7f7a8bfff700 1 -- 172.21.15.96:0/2299683272 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7a94054f20 con 0x7f7aa40f6530 2022-02-02T21:46:51.171 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:46:51.171 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:46:51.172 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:46:51.172 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:46:51.172 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:51.173 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:46:51.173 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:46:51.173 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:46:51.174 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:46:51.174 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:46:51.174 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:46:51.175 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:46:51.175 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:46:51.175 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:46:51.176 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:46:51.176 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:46:51.176 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:46:51.177 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:46:51.177 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:46:51.177 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:46:51.178 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:46:51.178 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:46:51.178 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:46:51.179 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:46:51.179 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:46:51.179 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:46:51.180 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:46:51.180 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:46:51.180 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:46:51.181 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:46:51.181 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:46:51.181 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:46:51.182 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:51.182 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:51.182 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:46:51.183 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:46:51.183 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:51.183 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:51.184 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:46:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 msgr2=0x7f7a8c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:51.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 0x7f7a8c0672e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f7a980096c0 tx=0x7f7a98009be0).stop 2022-02-02T21:46:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 msgr2=0x7f7aa4108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:46:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 secure :-1 s=READY pgs=3150 cs=0 l=1 rev1=1 rx=0x7f7a94013a70 tx=0x7f7a94009b30).stop 2022-02-02T21:46:51.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 shutdown_connections 2022-02-02T21:46:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064e20 0x7f7a8c0672e0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa40f6530 0x7f7aa4108f90 unknown :-1 s=CLOSED pgs=3150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:51.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 --2- 172.21.15.96:0/2299683272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa40f77d0 0x7f7aa4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:46:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 >> 172.21.15.96:0/2299683272 conn(0x7f7aa40f1c90 msgr2=0x7f7aa406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:46:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 shutdown_connections 2022-02-02T21:46:51.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:46:51.172+0000 7f7aa8954700 1 -- 172.21.15.96:0/2299683272 wait complete. 2022-02-02T21:46:51.189 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:46:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:51 smithi159 ceph-mon[69013]: from='client.40404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/693222697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:46:51.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2299683272' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:46:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:51 smithi096 ceph-mon[101353]: from='client.40404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:46:51.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/693222697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:46:51.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2299683272' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:46:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:52 smithi159 ceph-mon[69013]: pgmap v6143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:52 smithi096 ceph-mon[101353]: pgmap v6143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:54 smithi159 ceph-mon[69013]: pgmap v6144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:54 smithi096 ceph-mon[101353]: pgmap v6144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:56 smithi159 ceph-mon[69013]: pgmap v6145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:56 smithi096 ceph-mon[101353]: pgmap v6145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:46:58 smithi096 ceph-mon[101353]: pgmap v6146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:46:59.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:46:58 smithi159 ceph-mon[69013]: pgmap v6146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:00 smithi159 ceph-mon[69013]: pgmap v6147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:00 smithi096 ceph-mon[101353]: pgmap v6147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:04.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:03 smithi096 ceph-mon[101353]: pgmap v6148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:04.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:03 smithi159 ceph-mon[69013]: pgmap v6148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:06.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:05 smithi096 ceph-mon[101353]: pgmap v6149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:06.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:05 smithi159 ceph-mon[69013]: pgmap v6149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:08.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:07 smithi096 ceph-mon[101353]: pgmap v6150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:07 smithi159 ceph-mon[69013]: pgmap v6150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:10.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:09 smithi096 ceph-mon[101353]: pgmap v6151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:09 smithi159 ceph-mon[69013]: pgmap v6151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:12.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:11 smithi096 ceph-mon[101353]: pgmap v6152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:11 smithi159 ceph-mon[69013]: pgmap v6152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:14.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:13 smithi159 ceph-mon[69013]: pgmap v6153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:13 smithi096 ceph-mon[101353]: pgmap v6153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:15 smithi159 ceph-mon[69013]: pgmap v6154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:15 smithi096 ceph-mon[101353]: pgmap v6154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:18.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:17 smithi159 ceph-mon[69013]: pgmap v6155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:17 smithi096 ceph-mon[101353]: pgmap v6155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:19 smithi159 ceph-mon[69013]: pgmap v6156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:19 smithi096 ceph-mon[101353]: pgmap v6156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.282+0000 7f3f24c28700 1 -- 172.21.15.96:0/3875769226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 msgr2=0x7f3f200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.282+0000 7f3f24c28700 1 --2- 172.21.15.96:0/3875769226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f200f6b30 secure :-1 s=READY pgs=3151 cs=0 l=1 rev1=1 rx=0x7f3f14004660 tx=0x7f3f14009b30).stop 2022-02-02T21:47:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 -- 172.21.15.96:0/3875769226 shutdown_connections 2022-02-02T21:47:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 --2- 172.21.15.96:0/3875769226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f200f6b30 unknown :-1 s=CLOSED pgs=3151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 --2- 172.21.15.96:0/3875769226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 -- 172.21.15.96:0/3875769226 >> 172.21.15.96:0/3875769226 conn(0x7f3f200f0b90 msgr2=0x7f3f200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 -- 172.21.15.96:0/3875769226 shutdown_connections 2022-02-02T21:47:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 -- 172.21.15.96:0/3875769226 wait complete. 2022-02-02T21:47:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 Processor -- start 2022-02-02T21:47:21.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.283+0000 7f3f24c28700 1 -- start start 2022-02-02T21:47:21.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f24c28700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f20108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f24c28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f24c28700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201099e0 con 0x7f3f200f66d0 2022-02-02T21:47:21.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f24c28700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20109b20 con 0x7f3f200f5430 2022-02-02T21:47:21.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44780/0 (socket says 172.21.15.96:44780) 2022-02-02T21:47:21.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 -- 172.21.15.96:0/974240334 learned_addr learned my addr 172.21.15.96:0/974240334 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:21.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f20108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 -- 172.21.15.96:0/974240334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 msgr2=0x7f3f20108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f20108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 -- 172.21.15.96:0/974240334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14005040 con 0x7f3f200f66d0 2022-02-02T21:47:21.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f20108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:47:21.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f1effd700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 secure :-1 s=READY pgs=3152 cs=0 l=1 rev1=1 rx=0x7f3f14009990 tx=0x7f3f14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f14018070 con 0x7f3f200f66d0 2022-02-02T21:47:21.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.284+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2010a460 con 0x7f3f200f66d0 2022-02-02T21:47:21.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.285+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f14007ca0 con 0x7f3f200f66d0 2022-02-02T21:47:21.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.285+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1401c620 con 0x7f3f200f66d0 2022-02-02T21:47:21.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.285+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2010a9c0 con 0x7f3f200f66d0 2022-02-02T21:47:21.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.286+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20045ad0 con 0x7f3f200f66d0 2022-02-02T21:47:21.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.286+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f1401d960 con 0x7f3f200f66d0 2022-02-02T21:47:21.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.287+0000 7f3f07fff700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 0x7f3f080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.287+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f140837d0 con 0x7f3f200f66d0 2022-02-02T21:47:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.287+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 0x7f3f080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.287+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 0x7f3f080672e0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f3f200f6530 tx=0x7f3f10009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.291+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f14055470 con 0x7f3f200f66d0 2022-02-02T21:47:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.468+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f200fa910 con 0x7f3f08064e20 2022-02-02T21:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.469+0000 7f3f07fff700 1 -- 172.21.15.96:0/974240334 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3f200fa910 con 0x7f3f08064e20 2022-02-02T21:47:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 msgr2=0x7f3f080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 0x7f3f080672e0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f3f200f6530 tx=0x7f3f10009040).stop 2022-02-02T21:47:21.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 msgr2=0x7f3f20109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 secure :-1 s=READY pgs=3152 cs=0 l=1 rev1=1 rx=0x7f3f14009990 tx=0x7f3f14009b30).stop 2022-02-02T21:47:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 shutdown_connections 2022-02-02T21:47:21.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064e20 0x7f3f080672e0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f5430 0x7f3f20108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 --2- 172.21.15.96:0/974240334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f66d0 0x7f3f20109430 unknown :-1 s=CLOSED pgs=3152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 >> 172.21.15.96:0/974240334 conn(0x7f3f200f0b90 msgr2=0x7f3f2005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:21.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 shutdown_connections 2022-02-02T21:47:21.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.471+0000 7f3f24c28700 1 -- 172.21.15.96:0/974240334 wait complete. 2022-02-02T21:47:21.480 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:47:21.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 -- 172.21.15.96:0/319325137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 msgr2=0x7f2a880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 --2- 172.21.15.96:0/319325137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a880f6950 secure :-1 s=READY pgs=3153 cs=0 l=1 rev1=1 rx=0x7f2a78004660 tx=0x7f2a78009b30).stop 2022-02-02T21:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 -- 172.21.15.96:0/319325137 shutdown_connections 2022-02-02T21:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 --2- 172.21.15.96:0/319325137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 0x7f2a880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 --2- 172.21.15.96:0/319325137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a880f6950 unknown :-1 s=CLOSED pgs=3153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 -- 172.21.15.96:0/319325137 >> 172.21.15.96:0/319325137 conn(0x7f2a880f1c90 msgr2=0x7f2a880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 -- 172.21.15.96:0/319325137 shutdown_connections 2022-02-02T21:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.568+0000 7f2a8f050700 1 -- 172.21.15.96:0/319325137 wait complete. 2022-02-02T21:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 Processor -- start 2022-02-02T21:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 -- start start 2022-02-02T21:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 0x7f2a881072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881078f0 con 0x7f2a880f6530 2022-02-02T21:47:21.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8f050700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88108100 con 0x7f2a880f77d0 2022-02-02T21:47:21.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44788/0 (socket says 172.21.15.96:44788) 2022-02-02T21:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 -- 172.21.15.96:0/584658450 learned_addr learned my addr 172.21.15.96:0/584658450 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8d84d700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 0x7f2a881072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 -- 172.21.15.96:0/584658450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 msgr2=0x7f2a881072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 0x7f2a881072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.569+0000 7f2a8e04e700 1 -- 172.21.15.96:0/584658450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78005040 con 0x7f2a880f6530 2022-02-02T21:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a8e04e700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 secure :-1 s=READY pgs=3154 cs=0 l=1 rev1=1 rx=0x7f2a78013a70 tx=0x7f2a78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a78018070 con 0x7f2a880f6530 2022-02-02T21:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a88108320 con 0x7f2a880f6530 2022-02-02T21:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a780097d0 con 0x7f2a880f6530 2022-02-02T21:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7801de80 con 0x7f2a880f6530 2022-02-02T21:47:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.570+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a88108880 con 0x7f2a880f6530 2022-02-02T21:47:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.571+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88059100 con 0x7f2a880f6530 2022-02-02T21:47:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.572+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a78007ba0 con 0x7f2a880f6530 2022-02-02T21:47:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.572+0000 7f2a7effd700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 0x7f2a740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.572+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2a78083d50 con 0x7f2a880f6530 2022-02-02T21:47:21.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.572+0000 7f2a8d84d700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 0x7f2a740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.573+0000 7f2a8d84d700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 0x7f2a740672e0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f2a84004c40 tx=0x7f2a8400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.576+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a78051e30 con 0x7f2a880f6530 2022-02-02T21:47:21.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.747+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a880fee00 con 0x7f2a74064e20 2022-02-02T21:47:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.757+0000 7f2a7effd700 1 -- 172.21.15.96:0/584658450 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2a880fee00 con 0x7f2a74064e20 2022-02-02T21:47:21.757 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:47:21.757 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:47:21.758 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:47:21.758 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 2h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:47:21.758 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:47:21.759 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:47:21.759 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:47:21.759 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 2h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:47:21.760 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 2h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:47:21.760 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:47:21.760 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 2h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:47:21.761 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:47:21.761 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 2h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:47:21.761 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:47:21.762 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 2h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:47:21.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:47:21.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:47:21.763 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:47:21.763 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 2h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:47:21.764 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 2h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:47:21.764 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 2h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:47:21.765 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:47:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 msgr2=0x7f2a740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 0x7f2a740672e0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f2a84004c40 tx=0x7f2a8400b040).stop 2022-02-02T21:47:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 msgr2=0x7f2a88106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 secure :-1 s=READY pgs=3154 cs=0 l=1 rev1=1 rx=0x7f2a78013a70 tx=0x7f2a78009b30).stop 2022-02-02T21:47:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 shutdown_connections 2022-02-02T21:47:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a74064e20 0x7f2a740672e0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a880f6530 0x7f2a88106e00 unknown :-1 s=CLOSED pgs=3154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 --2- 172.21.15.96:0/584658450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a880f77d0 0x7f2a881072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.758+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 >> 172.21.15.96:0/584658450 conn(0x7f2a880f1c90 msgr2=0x7f2a880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:21.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.759+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 shutdown_connections 2022-02-02T21:47:21.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.759+0000 7f2a8f050700 1 -- 172.21.15.96:0/584658450 wait complete. 2022-02-02T21:47:21.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 -- 172.21.15.96:0/1567470357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 msgr2=0x7f9f840f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1567470357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f840f7fe0 secure :-1 s=READY pgs=3155 cs=0 l=1 rev1=1 rx=0x7f9f6c004660 tx=0x7f9f6c009b30).stop 2022-02-02T21:47:21.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 -- 172.21.15.96:0/1567470357 shutdown_connections 2022-02-02T21:47:21.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1567470357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f840f7fe0 unknown :-1 s=CLOSED pgs=3155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1567470357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 0x7f9f840f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 -- 172.21.15.96:0/1567470357 >> 172.21.15.96:0/1567470357 conn(0x7f9f840f2020 msgr2=0x7f9f840f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:21.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 -- 172.21.15.96:0/1567470357 shutdown_connections 2022-02-02T21:47:21.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 -- 172.21.15.96:0/1567470357 wait complete. 2022-02-02T21:47:21.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.857+0000 7f9f8a060700 1 Processor -- start 2022-02-02T21:47:21.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f8a060700 1 -- start start 2022-02-02T21:47:21.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f8a060700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 0x7f9f8406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f8a060700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f8a060700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8406a380 con 0x7f9f840f7b80 2022-02-02T21:47:21.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f8a060700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8406a4c0 con 0x7f9f840f68e0 2022-02-02T21:47:21.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44800/0 (socket says 172.21.15.96:44800) 2022-02-02T21:47:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 -- 172.21.15.96:0/1858288022 learned_addr learned my addr 172.21.15.96:0/1858288022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f837fe700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 0x7f9f8406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 -- 172.21.15.96:0/1858288022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 msgr2=0x7f9f8406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:21.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 0x7f9f8406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:21.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 -- 172.21.15.96:0/1858288022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c005040 con 0x7f9f840f7b80 2022-02-02T21:47:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.858+0000 7f9f82ffd700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 secure :-1 s=READY pgs=3156 cs=0 l=1 rev1=1 rx=0x7f9f6c009990 tx=0x7f9f6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.859+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6c018070 con 0x7f9f840f7b80 2022-02-02T21:47:21.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.859+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8406a740 con 0x7f9f840f7b80 2022-02-02T21:47:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.859+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f6c007ba0 con 0x7f9f840f7b80 2022-02-02T21:47:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.859+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6c01c3c0 con 0x7f9f840f7b80 2022-02-02T21:47:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.859+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8406aca0 con 0x7f9f840f7b80 2022-02-02T21:47:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.860+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84045ad0 con 0x7f9f840f7b80 2022-02-02T21:47:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.860+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f6c01d420 con 0x7f9f840f7b80 2022-02-02T21:47:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.860+0000 7f9f7bfff700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 0x7f9f70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.861+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f6c0836a0 con 0x7f9f840f7b80 2022-02-02T21:47:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.861+0000 7f9f837fe700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 0x7f9f70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.861+0000 7f9f837fe700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 0x7f9f70067290 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f9f8406b730 tx=0x7f9f7400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:21.865+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f6c051860 con 0x7f9f840f7b80 2022-02-02T21:47:22.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.095+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f840612d0 con 0x7f9f840f7b80 2022-02-02T21:47:22.096 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:21 smithi096 ceph-mon[101353]: pgmap v6157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:22.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.096+0000 7f9f7bfff700 1 -- 172.21.15.96:0/1858288022 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9f6c054e80 con 0x7f9f840f7b80 2022-02-02T21:47:22.097 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:47:22.098 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:47:22.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:47:22.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:22.099 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:47:22.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:47:22.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:22.100 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:47:22.100 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:47:22.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:22.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:47:22.101 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:47:22.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:22.102 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:47:22.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:47:22.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:47:22.103 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:47:22.103 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:47:22.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 msgr2=0x7f9f70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 0x7f9f70067290 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f9f8406b730 tx=0x7f9f7400b040).stop 2022-02-02T21:47:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 msgr2=0x7f9f84069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 secure :-1 s=READY pgs=3156 cs=0 l=1 rev1=1 rx=0x7f9f6c009990 tx=0x7f9f6c009b30).stop 2022-02-02T21:47:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 shutdown_connections 2022-02-02T21:47:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f70064dd0 0x7f9f70067290 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f840f68e0 0x7f9f8406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 --2- 172.21.15.96:0/1858288022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f840f7b80 0x7f9f84069e20 unknown :-1 s=CLOSED pgs=3156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 >> 172.21.15.96:0/1858288022 conn(0x7f9f840f2020 msgr2=0x7f9f840fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.098+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 shutdown_connections 2022-02-02T21:47:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.099+0000 7f9f8a060700 1 -- 172.21.15.96:0/1858288022 wait complete. 2022-02-02T21:47:22.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- 172.21.15.96:0/218822352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f7980 msgr2=0x7f12000f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 --2- 172.21.15.96:0/218822352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f7980 0x7f12000f7de0 secure :-1 s=READY pgs=3157 cs=0 l=1 rev1=1 rx=0x7f11fc004660 tx=0x7f11fc009b30).stop 2022-02-02T21:47:22.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- 172.21.15.96:0/218822352 shutdown_connections 2022-02-02T21:47:22.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 --2- 172.21.15.96:0/218822352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f7980 0x7f12000f7de0 unknown :-1 s=CLOSED pgs=3157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 --2- 172.21.15.96:0/218822352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f66e0 0x7f12000f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- 172.21.15.96:0/218822352 >> 172.21.15.96:0/218822352 conn(0x7f12000f1e40 msgr2=0x7f12000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- 172.21.15.96:0/218822352 shutdown_connections 2022-02-02T21:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- 172.21.15.96:0/218822352 wait complete. 2022-02-02T21:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 Processor -- start 2022-02-02T21:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.196+0000 7f120804d700 1 -- start start 2022-02-02T21:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f120804d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f120804d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 0x7f1200107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f120804d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200107a00 con 0x7f12000f66e0 2022-02-02T21:47:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f120804d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200107b40 con 0x7f12000f7980 2022-02-02T21:47:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:22.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44808/0 (socket says 172.21.15.96:44808) 2022-02-02T21:47:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 -- 172.21.15.96:0/2738523408 learned_addr learned my addr 172.21.15.96:0/2738523408 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f12055e8700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 0x7f1200107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:22.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 -- 172.21.15.96:0/2738523408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 msgr2=0x7f1200107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 0x7f1200107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 -- 172.21.15.96:0/2738523408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc005040 con 0x7f12000f66e0 2022-02-02T21:47:22.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f12055e8700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 0x7f1200107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:47:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f1205de9700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 secure :-1 s=READY pgs=3158 cs=0 l=1 rev1=1 rx=0x7f11f000c530 tx=0x7f11f0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f000f650 con 0x7f12000f66e0 2022-02-02T21:47:22.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11f000fc60 con 0x7f12000f66e0 2022-02-02T21:47:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12001084e0 con 0x7f12000f66e0 2022-02-02T21:47:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.197+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f0012d20 con 0x7f12000f66e0 2022-02-02T21:47:22.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.198+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200108aa0 con 0x7f12000f66e0 2022-02-02T21:47:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.198+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200045ad0 con 0x7f12000f66e0 2022-02-02T21:47:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.199+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11f0019030 con 0x7f12000f66e0 2022-02-02T21:47:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.199+0000 7f11f67fc700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 0x7f11ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:22.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.199+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f11f00816b0 con 0x7f12000f66e0 2022-02-02T21:47:22.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.199+0000 7f12055e8700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 0x7f11ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:22.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.200+0000 7f12055e8700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 0x7f11ec067290 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f11fc004e30 tx=0x7f11fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:22.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.204+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11f00487d0 con 0x7f12000f66e0 2022-02-02T21:47:22.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:21 smithi159 ceph-mon[69013]: pgmap v6157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:22.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.406+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1200108d70 con 0x7f12000f66e0 2022-02-02T21:47:22.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.407+0000 7f11f67fc700 1 -- 172.21.15.96:0/2738523408 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f11f00532f0 con 0x7f12000f66e0 2022-02-02T21:47:22.408 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:47:22.408 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:47:22.408 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:47:22.409 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:47:22.409 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:22.409 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:47:22.410 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:47:22.410 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:47:22.410 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:47:22.411 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:47:22.411 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:47:22.411 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:47:22.412 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:47:22.412 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:47:22.412 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:47:22.413 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:47:22.413 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:47:22.413 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:47:22.414 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:47:22.414 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:47:22.414 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:47:22.415 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:47:22.415 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:47:22.416 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:47:22.416 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:47:22.416 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:47:22.416 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:47:22.417 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:47:22.417 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:47:22.417 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:47:22.418 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:47:22.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:47:22.418 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:22.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:22.419 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:47:22.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:22.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:22.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:22.420 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:22.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 msgr2=0x7f11ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 0x7f11ec067290 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f11fc004e30 tx=0x7f11fc009b30).stop 2022-02-02T21:47:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 msgr2=0x7f1200106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:22.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 secure :-1 s=READY pgs=3158 cs=0 l=1 rev1=1 rx=0x7f11f000c530 tx=0x7f11f0007e10).stop 2022-02-02T21:47:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 shutdown_connections 2022-02-02T21:47:22.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11ec064dd0 0x7f11ec067290 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=CLOSED pgs=3158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 --2- 172.21.15.96:0/2738523408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12000f7980 0x7f1200107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:22.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 >> 172.21.15.96:0/2738523408 conn(0x7f12000f1e40 msgr2=0x7f12000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 shutdown_connections 2022-02-02T21:47:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:22.409+0000 7f120804d700 1 -- 172.21.15.96:0/2738523408 wait complete. 2022-02-02T21:47:22.425 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:47:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:22 smithi096 ceph-mon[101353]: from='client.40414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:22 smithi096 ceph-mon[101353]: from='client.40418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1858288022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:47:23.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2738523408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:47:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:22 smithi159 ceph-mon[69013]: from='client.40414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:22 smithi159 ceph-mon[69013]: from='client.40418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1858288022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:47:23.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2738523408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:47:24.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:23 smithi159 ceph-mon[69013]: pgmap v6158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:23 smithi096 ceph-mon[101353]: pgmap v6158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:26.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:25 smithi159 ceph-mon[69013]: pgmap v6159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:25 smithi096 ceph-mon[101353]: pgmap v6159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:27 smithi159 ceph-mon[69013]: pgmap v6160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:47:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:47:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:27 smithi096 ceph-mon[101353]: pgmap v6160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:47:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:47:30.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:29 smithi159 ceph-mon[69013]: pgmap v6161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:29 smithi096 ceph-mon[101353]: pgmap v6161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:32.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:31 smithi159 ceph-mon[69013]: pgmap v6162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:31 smithi096 ceph-mon[101353]: pgmap v6162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:34.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:33 smithi159 ceph-mon[69013]: pgmap v6163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:34.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:33 smithi096 ceph-mon[101353]: pgmap v6163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:35 smithi159 ceph-mon[69013]: pgmap v6164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:35 smithi096 ceph-mon[101353]: pgmap v6164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:38.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:37 smithi159 ceph-mon[69013]: pgmap v6165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:37 smithi096 ceph-mon[101353]: pgmap v6165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:39 smithi159 ceph-mon[69013]: pgmap v6166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:39 smithi096 ceph-mon[101353]: pgmap v6166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:42.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:41 smithi159 ceph-mon[69013]: pgmap v6167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:42.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:41 smithi096 ceph-mon[101353]: pgmap v6167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:44.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:43 smithi159 ceph-mon[69013]: pgmap v6168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:44.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:43 smithi096 ceph-mon[101353]: pgmap v6168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:46.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:45 smithi159 ceph-mon[69013]: pgmap v6169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:46.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:45 smithi096 ceph-mon[101353]: pgmap v6169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:48.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:47 smithi159 ceph-mon[69013]: pgmap v6170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:47 smithi096 ceph-mon[101353]: pgmap v6170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:50.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:49 smithi159 ceph-mon[69013]: pgmap v6171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:49 smithi096 ceph-mon[101353]: pgmap v6171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:52.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:51 smithi159 ceph-mon[69013]: pgmap v6172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:52.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:51 smithi096 ceph-mon[101353]: pgmap v6172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 -- 172.21.15.96:0/3410619768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc060290 msgr2=0x7f0bbc0f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 --2- 172.21.15.96:0/3410619768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f9320 secure :-1 s=READY pgs=3159 cs=0 l=1 rev1=1 rx=0x7f0bb0004660 tx=0x7f0bb0009b30).stop 2022-02-02T21:47:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 -- 172.21.15.96:0/3410619768 shutdown_connections 2022-02-02T21:47:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 --2- 172.21.15.96:0/3410619768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 --2- 172.21.15.96:0/3410619768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f9320 unknown :-1 s=CLOSED pgs=3159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 -- 172.21.15.96:0/3410619768 >> 172.21.15.96:0/3410619768 conn(0x7f0bbc0f0d40 msgr2=0x7f0bbc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:52.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 -- 172.21.15.96:0/3410619768 shutdown_connections 2022-02-02T21:47:52.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.518+0000 7f0bc446e700 1 -- 172.21.15.96:0/3410619768 wait complete. 2022-02-02T21:47:52.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 Processor -- start 2022-02-02T21:47:52.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 -- start start 2022-02-02T21:47:52.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0f5780 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc446e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0f58c0 con 0x7f0bbc060290 2022-02-02T21:47:52.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44828/0 (socket says 172.21.15.96:44828) 2022-02-02T21:47:52.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 -- 172.21.15.96:0/855891652 learned_addr learned my addr 172.21.15.96:0/855891652 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:52.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc220a700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 -- 172.21.15.96:0/855891652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc060290 msgr2=0x7f0bbc0f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.519+0000 7f0bc1a09700 1 -- 172.21.15.96:0/855891652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0005040 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0bc1a09700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 secure :-1 s=READY pgs=3160 cs=0 l=1 rev1=1 rx=0x7f0bb80026d0 tx=0x7f0bb8009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:52.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb80079c0 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0bb800f040 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb8014840 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0f5ba0 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.520+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc10ef70 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.521+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc045ad0 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.521+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0bb801b060 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.522+0000 7f0baeffd700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 0x7f0ba8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.522+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0bb8081920 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.522+0000 7f0bc220a700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 0x7f0ba8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.522+0000 7f0bc220a700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 0x7f0ba8067290 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f0bb0004630 tx=0x7f0bb0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.526+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0bb804fa20 con 0x7f0bbc0f98a0 2022-02-02T21:47:52.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.704+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bbc0ff050 con 0x7f0ba8064dd0 2022-02-02T21:47:52.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.705+0000 7f0baeffd700 1 -- 172.21.15.96:0/855891652 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0bb0019040 con 0x7f0ba8064dd0 2022-02-02T21:47:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 msgr2=0x7f0ba8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 0x7f0ba8067290 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f0bb0004630 tx=0x7f0bb0009b30).stop 2022-02-02T21:47:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 msgr2=0x7f0bbc0f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 secure :-1 s=READY pgs=3160 cs=0 l=1 rev1=1 rx=0x7f0bb80026d0 tx=0x7f0bb8009dc0).stop 2022-02-02T21:47:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 shutdown_connections 2022-02-02T21:47:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ba8064dd0 0x7f0ba8067290 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bbc060290 0x7f0bbc0f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 --2- 172.21.15.96:0/855891652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bbc0f98a0 0x7f0bbc0f5220 unknown :-1 s=CLOSED pgs=3160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 >> 172.21.15.96:0/855891652 conn(0x7f0bbc0f0d40 msgr2=0x7f0bbc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 shutdown_connections 2022-02-02T21:47:52.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.707+0000 7f0bc446e700 1 -- 172.21.15.96:0/855891652 wait complete. 2022-02-02T21:47:52.718 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.804+0000 7fecbdd34700 1 -- 172.21.15.96:0/2961045997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 msgr2=0x7fecb80f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.804+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2961045997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb80f7010 secure :-1 s=READY pgs=3161 cs=0 l=1 rev1=1 rx=0x7feca8004660 tx=0x7feca8009b30).stop 2022-02-02T21:47:52.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- 172.21.15.96:0/2961045997 shutdown_connections 2022-02-02T21:47:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2961045997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 0x7fecb80f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2961045997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb80f7010 unknown :-1 s=CLOSED pgs=3161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- 172.21.15.96:0/2961045997 >> 172.21.15.96:0/2961045997 conn(0x7fecb80f04c0 msgr2=0x7fecb80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- 172.21.15.96:0/2961045997 shutdown_connections 2022-02-02T21:47:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- 172.21.15.96:0/2961045997 wait complete. 2022-02-02T21:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 Processor -- start 2022-02-02T21:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- start start 2022-02-02T21:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 0x7fecb8106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.805+0000 7fecbdd34700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8106910 con 0x7fecb80f6bf0 2022-02-02T21:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecbdd34700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8106a50 con 0x7fecb80f7590 2022-02-02T21:47:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44836/0 (socket says 172.21.15.96:44836) 2022-02-02T21:47:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 -- 172.21.15.96:0/2966043402 learned_addr learned my addr 172.21.15.96:0/2966043402 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb6ffd700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 0x7fecb8106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 -- 172.21.15.96:0/2966043402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 msgr2=0x7fecb8106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:52.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 0x7fecb8106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 -- 172.21.15.96:0/2966043402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8005040 con 0x7fecb80f6bf0 2022-02-02T21:47:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecb77fe700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 secure :-1 s=READY pgs=3162 cs=0 l=1 rev1=1 rx=0x7feca8014040 tx=0x7feca800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca8019070 con 0x7fecb80f6bf0 2022-02-02T21:47:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feca8007e70 con 0x7fecb80f6bf0 2022-02-02T21:47:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb8107390 con 0x7fecb80f6bf0 2022-02-02T21:47:52.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca8014d50 con 0x7fecb80f6bf0 2022-02-02T21:47:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.806+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb81078f0 con 0x7fecb80f6bf0 2022-02-02T21:47:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.807+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb8045ad0 con 0x7fecb80f6bf0 2022-02-02T21:47:52.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.808+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feca8025070 con 0x7fecb80f6bf0 2022-02-02T21:47:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.808+0000 7fec9ffff700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 0x7feca0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.808+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feca8082a60 con 0x7fecb80f6bf0 2022-02-02T21:47:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.808+0000 7fecb6ffd700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 0x7feca0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.809+0000 7fecb6ffd700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 0x7feca0067290 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fecac009da0 tx=0x7fecac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:52.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.812+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feca8054650 con 0x7fecb80f6bf0 2022-02-02T21:47:52.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.989+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fecb81080e0 con 0x7feca0064dd0 2022-02-02T21:47:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.998+0000 7fec9ffff700 1 -- 172.21.15.96:0/2966043402 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fecac007b20 con 0x7feca0064dd0 2022-02-02T21:47:52.999 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:47:53.000 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:47:53.000 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:47:53.000 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:47:53.001 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:47:53.001 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:47:53.001 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:47:53.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:47:53.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:47:53.002 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:47:53.003 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:47:53.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:47:53.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:47:53.004 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:47:53.004 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:47:53.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:47:53.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:47:53.005 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:47:53.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:47:53.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:47:53.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:47:53.007 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:47:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.999+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 msgr2=0x7feca0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:52.999+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 0x7feca0067290 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fecac009da0 tx=0x7fecac00b040).stop 2022-02-02T21:47:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 msgr2=0x7fecb8105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 secure :-1 s=READY pgs=3162 cs=0 l=1 rev1=1 rx=0x7feca8014040 tx=0x7feca800b040).stop 2022-02-02T21:47:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 shutdown_connections 2022-02-02T21:47:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feca0064dd0 0x7feca0067290 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fecb80f6bf0 0x7fecb8105e70 unknown :-1 s=CLOSED pgs=3162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 --2- 172.21.15.96:0/2966043402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb80f7590 0x7fecb8106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 >> 172.21.15.96:0/2966043402 conn(0x7fecb80f04c0 msgr2=0x7fecb80fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 shutdown_connections 2022-02-02T21:47:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.000+0000 7fecbdd34700 1 -- 172.21.15.96:0/2966043402 wait complete. 2022-02-02T21:47:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 -- 172.21.15.96:0/4001402700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 msgr2=0x7f444c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 --2- 172.21.15.96:0/4001402700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c0f6b00 secure :-1 s=READY pgs=3163 cs=0 l=1 rev1=1 rx=0x7f443c004660 tx=0x7f443c009b30).stop 2022-02-02T21:47:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 -- 172.21.15.96:0/4001402700 shutdown_connections 2022-02-02T21:47:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 --2- 172.21.15.96:0/4001402700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 0x7f444c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 --2- 172.21.15.96:0/4001402700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c0f6b00 unknown :-1 s=CLOSED pgs=3163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 -- 172.21.15.96:0/4001402700 >> 172.21.15.96:0/4001402700 conn(0x7f444c0f1e40 msgr2=0x7f444c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.096+0000 7f4451be4700 1 -- 172.21.15.96:0/4001402700 shutdown_connections 2022-02-02T21:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.097+0000 7f4451be4700 1 -- 172.21.15.96:0/4001402700 wait complete. 2022-02-02T21:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.097+0000 7f4451be4700 1 Processor -- start 2022-02-02T21:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f4451be4700 1 -- start start 2022-02-02T21:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f4451be4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f4451be4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 0x7f444c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f4451be4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c06a380 con 0x7f444c0f66e0 2022-02-02T21:47:53.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f4451be4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c06a4c0 con 0x7f444c0f7980 2022-02-02T21:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44846/0 (socket says 172.21.15.96:44846) 2022-02-02T21:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 -- 172.21.15.96:0/4274473939 learned_addr learned my addr 172.21.15.96:0/4274473939 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:53.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444affd700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 0x7f444c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 -- 172.21.15.96:0/4274473939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 msgr2=0x7f444c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 0x7f444c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 -- 172.21.15.96:0/4274473939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c005040 con 0x7f444c0f66e0 2022-02-02T21:47:53.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.098+0000 7f444b7fe700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 secure :-1 s=READY pgs=3164 cs=0 l=1 rev1=1 rx=0x7f443c004f60 tx=0x7f443c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:53.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.099+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f443c018070 con 0x7f444c0f66e0 2022-02-02T21:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.099+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c06a740 con 0x7f444c0f66e0 2022-02-02T21:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.099+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f443c007ba0 con 0x7f444c0f66e0 2022-02-02T21:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.099+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f443c01c620 con 0x7f444c0f66e0 2022-02-02T21:47:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.099+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c06aca0 con 0x7f444c0f66e0 2022-02-02T21:47:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.100+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c045ad0 con 0x7f444c0f66e0 2022-02-02T21:47:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.100+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f443c01c8e0 con 0x7f444c0f66e0 2022-02-02T21:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.100+0000 7f4433fff700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 0x7f4434067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.101+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f443c083960 con 0x7f444c0f66e0 2022-02-02T21:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.101+0000 7f444affd700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 0x7f4434067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.101+0000 7f444affd700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 0x7f4434067290 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f44400041d0 tx=0x7f4440009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.105+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f443c051a60 con 0x7f444c0f66e0 2022-02-02T21:47:53.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.337+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f444c0586e0 con 0x7f444c0f66e0 2022-02-02T21:47:53.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.338+0000 7f4433fff700 1 -- 172.21.15.96:0/4274473939 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f443c055080 con 0x7f444c0f66e0 2022-02-02T21:47:53.340 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:47:53.340 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:47:53.341 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:47:53.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:53.341 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:47:53.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:47:53.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:53.342 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:47:53.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:47:53.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:53.343 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:47:53.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:47:53.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:47:53.344 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:47:53.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:47:53.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:47:53.345 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:47:53.346 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:47:53.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 msgr2=0x7f4434067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 0x7f4434067290 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f44400041d0 tx=0x7f4440009040).stop 2022-02-02T21:47:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 msgr2=0x7f444c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 secure :-1 s=READY pgs=3164 cs=0 l=1 rev1=1 rx=0x7f443c004f60 tx=0x7f443c009b30).stop 2022-02-02T21:47:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 shutdown_connections 2022-02-02T21:47:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4434064dd0 0x7f4434067290 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f444c0f66e0 0x7f444c06b9a0 unknown :-1 s=CLOSED pgs=3164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 --2- 172.21.15.96:0/4274473939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f444c0f7980 0x7f444c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 >> 172.21.15.96:0/4274473939 conn(0x7f444c0f1e40 msgr2=0x7f444c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 shutdown_connections 2022-02-02T21:47:53.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.340+0000 7f4451be4700 1 -- 172.21.15.96:0/4274473939 wait complete. 2022-02-02T21:47:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 -- 172.21.15.96:0/1655075861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 msgr2=0x7f98400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 --2- 172.21.15.96:0/1655075861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f98400f6cc0 secure :-1 s=READY pgs=3165 cs=0 l=1 rev1=1 rx=0x7f983c004660 tx=0x7f983c009b30).stop 2022-02-02T21:47:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 -- 172.21.15.96:0/1655075861 shutdown_connections 2022-02-02T21:47:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 --2- 172.21.15.96:0/1655075861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f98400f6cc0 unknown :-1 s=CLOSED pgs=3165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 --2- 172.21.15.96:0/1655075861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 0x7f98400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:47:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 -- 172.21.15.96:0/1655075861 >> 172.21.15.96:0/1655075861 conn(0x7f98400f0d40 msgr2=0x7f98400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.438+0000 7f98477ea700 1 -- 172.21.15.96:0/1655075861 shutdown_connections 2022-02-02T21:47:53.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.439+0000 7f98477ea700 1 -- 172.21.15.96:0/1655075861 wait complete. 2022-02-02T21:47:53.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.439+0000 7f98477ea700 1 Processor -- start 2022-02-02T21:47:53.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.439+0000 7f98477ea700 1 -- start start 2022-02-02T21:47:53.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f98477ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 0x7f984010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f98477ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f98477ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400602b0 con 0x7f98400f6860 2022-02-02T21:47:53.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f98477ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400603f0 con 0x7f98400f55c0 2022-02-02T21:47:53.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44858/0 (socket says 172.21.15.96:44858) 2022-02-02T21:47:53.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 -- 172.21.15.96:0/1496616549 learned_addr learned my addr 172.21.15.96:0/1496616549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:47:53.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9845586700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 0x7f984010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 -- 172.21.15.96:0/1496616549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 msgr2=0x7f984010c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 0x7f984010c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 -- 172.21.15.96:0/1496616549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c005040 con 0x7f98400f6860 2022-02-02T21:47:53.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9844d85700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 secure :-1 s=READY pgs=3166 cs=0 l=1 rev1=1 rx=0x7f983c009990 tx=0x7f983c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:53.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983c018070 con 0x7f98400f6860 2022-02-02T21:47:53.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f983c007ca0 con 0x7f98400f6860 2022-02-02T21:47:53.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.440+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984010eac0 con 0x7f98400f6860 2022-02-02T21:47:53.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.441+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983c01c620 con 0x7f98400f6860 2022-02-02T21:47:53.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.441+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984010eee0 con 0x7f98400f6860 2022-02-02T21:47:53.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.442+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9840045ad0 con 0x7f98400f6860 2022-02-02T21:47:53.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.442+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f983c01d960 con 0x7f98400f6860 2022-02-02T21:47:53.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.443+0000 7f9831ffb700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 0x7f982c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:47:53.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.443+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f983c083710 con 0x7f98400f6860 2022-02-02T21:47:53.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.443+0000 7f9845586700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 0x7f982c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:47:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.443+0000 7f9845586700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 0x7f982c067290 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f9840060040 tx=0x7f9834008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:47:53.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.447+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f983c0518d0 con 0x7f98400f6860 2022-02-02T21:47:53.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.648+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9840027a00 con 0x7f98400f6860 2022-02-02T21:47:53.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.649+0000 7f9831ffb700 1 -- 172.21.15.96:0/1496616549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f983c054ef0 con 0x7f98400f6860 2022-02-02T21:47:53.651 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:47:53.652 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:47:53.652 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:47:53.653 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:47:53.653 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:53.653 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:47:53.654 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:47:53.654 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:47:53.654 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:47:53.655 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:47:53.655 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:47:53.656 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:47:53.656 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:47:53.657 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:47:53.657 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:47:53.657 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:47:53.658 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:47:53.658 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:47:53.658 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:47:53.659 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:47:53.659 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:47:53.660 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:47:53.660 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:47:53.660 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:47:53.661 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:47:53.661 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:47:53.661 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:47:53.662 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:47:53.662 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:47:53.663 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:47:53.663 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:47:53.664 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:47:53.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:53.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:53.665 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:47:53.665 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:47:53.665 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:53.666 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:53.666 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:47:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 msgr2=0x7f982c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 0x7f982c067290 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f9840060040 tx=0x7f9834008040).stop 2022-02-02T21:47:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 msgr2=0x7f984010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:47:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 secure :-1 s=READY pgs=3166 cs=0 l=1 rev1=1 rx=0x7f983c009990 tx=0x7f983c009b30).stop 2022-02-02T21:47:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 shutdown_connections 2022-02-02T21:47:53.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f982c064dd0 0x7f982c067290 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400f55c0 0x7f984010c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 --2- 172.21.15.96:0/1496616549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98400f6860 0x7f984010e5d0 unknown :-1 s=CLOSED pgs=3166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:47:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 >> 172.21.15.96:0/1496616549 conn(0x7f98400f0d40 msgr2=0x7f98400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:47:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 shutdown_connections 2022-02-02T21:47:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:47:53.651+0000 7f98477ea700 1 -- 172.21.15.96:0/1496616549 wait complete. 2022-02-02T21:47:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:47:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:53 smithi159 ceph-mon[69013]: pgmap v6173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:53 smithi159 ceph-mon[69013]: from='client.40430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:53 smithi159 ceph-mon[69013]: from='client.40434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4274473939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:47:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1496616549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:47:54.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:53 smithi096 ceph-mon[101353]: pgmap v6173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:54.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:53 smithi096 ceph-mon[101353]: from='client.40430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:54.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:53 smithi096 ceph-mon[101353]: from='client.40434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:47:54.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4274473939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:47:54.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1496616549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:47:56.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:55 smithi159 ceph-mon[69013]: pgmap v6174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:56.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:55 smithi096 ceph-mon[101353]: pgmap v6174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:58.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:57 smithi159 ceph-mon[69013]: pgmap v6175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:47:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:57 smithi096 ceph-mon[101353]: pgmap v6175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:00.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:47:59 smithi159 ceph-mon[69013]: pgmap v6176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:47:59 smithi096 ceph-mon[101353]: pgmap v6176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:02.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:01 smithi159 ceph-mon[69013]: pgmap v6177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:01 smithi096 ceph-mon[101353]: pgmap v6177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:04.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:03 smithi159 ceph-mon[69013]: pgmap v6178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:03 smithi096 ceph-mon[101353]: pgmap v6178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:05 smithi159 ceph-mon[69013]: pgmap v6179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:05 smithi096 ceph-mon[101353]: pgmap v6179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:07 smithi159 ceph-mon[69013]: pgmap v6180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:07 smithi096 ceph-mon[101353]: pgmap v6180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:09 smithi159 ceph-mon[69013]: pgmap v6181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:09 smithi096 ceph-mon[101353]: pgmap v6181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:11 smithi159 ceph-mon[69013]: pgmap v6182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:11 smithi096 ceph-mon[101353]: pgmap v6182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:14.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:13 smithi159 ceph-mon[69013]: pgmap v6183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:13 smithi096 ceph-mon[101353]: pgmap v6183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:15 smithi159 ceph-mon[69013]: pgmap v6184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:15 smithi096 ceph-mon[101353]: pgmap v6184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:18.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:17 smithi159 ceph-mon[69013]: pgmap v6185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:17 smithi096 ceph-mon[101353]: pgmap v6185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:20.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:19 smithi159 ceph-mon[69013]: pgmap v6186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:19 smithi096 ceph-mon[101353]: pgmap v6186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:22.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:21 smithi159 ceph-mon[69013]: pgmap v6187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:21 smithi096 ceph-mon[101353]: pgmap v6187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 -- 172.21.15.96:0/2939923088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 msgr2=0x7f9edc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/2939923088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc0f59e0 secure :-1 s=READY pgs=3167 cs=0 l=1 rev1=1 rx=0x7f9ed0004660 tx=0x7f9ed0009b30).stop 2022-02-02T21:48:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 -- 172.21.15.96:0/2939923088 shutdown_connections 2022-02-02T21:48:23.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/2939923088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 0x7f9edc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/2939923088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc0f59e0 unknown :-1 s=CLOSED pgs=3167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 -- 172.21.15.96:0/2939923088 >> 172.21.15.96:0/2939923088 conn(0x7f9edc0f0d40 msgr2=0x7f9edc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:23.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 -- 172.21.15.96:0/2939923088 shutdown_connections 2022-02-02T21:48:23.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 -- 172.21.15.96:0/2939923088 wait complete. 2022-02-02T21:48:23.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.763+0000 7f9ee1a77700 1 Processor -- start 2022-02-02T21:48:23.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9ee1a77700 1 -- start start 2022-02-02T21:48:23.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9ee1a77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:23.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9ee1a77700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 0x7f9edc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:23.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9ee1a77700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0603e0 con 0x7f9edc0f55c0 2022-02-02T21:48:23.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9ee1a77700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc060520 con 0x7f9edc0f6860 2022-02-02T21:48:23.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:23.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44874/0 (socket says 172.21.15.96:44874) 2022-02-02T21:48:23.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 -- 172.21.15.96:0/3967733249 learned_addr learned my addr 172.21.15.96:0/3967733249 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:23.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edaffd700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 0x7f9edc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:23.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 -- 172.21.15.96:0/3967733249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 msgr2=0x7f9edc10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:23.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 0x7f9edc10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 -- 172.21.15.96:0/3967733249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0005040 con 0x7f9edc0f55c0 2022-02-02T21:48:23.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.764+0000 7f9edb7fe700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 secure :-1 s=READY pgs=3168 cs=0 l=1 rev1=1 rx=0x7f9ed0004f60 tx=0x7f9ed0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:23.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.765+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed0018070 con 0x7f9edc0f55c0 2022-02-02T21:48:23.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.765+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ed0009770 con 0x7f9edc0f55c0 2022-02-02T21:48:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.765+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc10c6c0 con 0x7f9edc0f55c0 2022-02-02T21:48:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.765+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed001c3c0 con 0x7f9edc0f55c0 2022-02-02T21:48:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.765+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc10cc20 con 0x7f9edc0f55c0 2022-02-02T21:48:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.766+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc045ad0 con 0x7f9edc0f55c0 2022-02-02T21:48:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.766+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ed001d420 con 0x7f9edc0f55c0 2022-02-02T21:48:23.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.767+0000 7f9ec3fff700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 0x7f9ec4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:23.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.767+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ed0083880 con 0x7f9edc0f55c0 2022-02-02T21:48:23.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.767+0000 7f9edaffd700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 0x7f9ec4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.767+0000 7f9edaffd700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 0x7f9ec4067290 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f9ecc0041d0 tx=0x7f9ecc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.771+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ed0051a40 con 0x7f9edc0f55c0 2022-02-02T21:48:23.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.948+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9edc0fdec0 con 0x7f9ec4064dd0 2022-02-02T21:48:23.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.949+0000 7f9ec3fff700 1 -- 172.21.15.96:0/3967733249 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9edc0fdec0 con 0x7f9ec4064dd0 2022-02-02T21:48:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 msgr2=0x7f9ec4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 0x7f9ec4067290 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f9ecc0041d0 tx=0x7f9ecc009040).stop 2022-02-02T21:48:23.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 msgr2=0x7f9edc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 secure :-1 s=READY pgs=3168 cs=0 l=1 rev1=1 rx=0x7f9ed0004f60 tx=0x7f9ed0009b30).stop 2022-02-02T21:48:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 shutdown_connections 2022-02-02T21:48:23.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec4064dd0 0x7f9ec4067290 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9edc0f55c0 0x7f9edc109c70 unknown :-1 s=CLOSED pgs=3168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 --2- 172.21.15.96:0/3967733249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9edc0f6860 0x7f9edc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:23.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.951+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 >> 172.21.15.96:0/3967733249 conn(0x7f9edc0f0d40 msgr2=0x7f9edc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.952+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 shutdown_connections 2022-02-02T21:48:23.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:23.952+0000 7f9ee1a77700 1 -- 172.21.15.96:0/3967733249 wait complete. 2022-02-02T21:48:23.961 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:48:24.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1481898203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f6860 msgr2=0x7fdf080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1481898203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f6860 0x7fdf080f6cc0 secure :-1 s=READY pgs=3169 cs=0 l=1 rev1=1 rx=0x7fdef8004660 tx=0x7fdef8009b30).stop 2022-02-02T21:48:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1481898203 shutdown_connections 2022-02-02T21:48:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1481898203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f6860 0x7fdf080f6cc0 unknown :-1 s=CLOSED pgs=3169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1481898203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f55c0 0x7fdf080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:48:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1481898203 >> 172.21.15.96:0/1481898203 conn(0x7fdf080f0d40 msgr2=0x7fdf080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.051 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:23 smithi096 ceph-mon[101353]: pgmap v6188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1481898203 shutdown_connections 2022-02-02T21:48:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.048+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1481898203 wait complete. 2022-02-02T21:48:24.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 Processor -- start 2022-02-02T21:48:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 -- start start 2022-02-02T21:48:24.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 0x7fdf0810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08060470 con 0x7fdf080f55c0 2022-02-02T21:48:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.049+0000 7fdf0dbec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080605b0 con 0x7fdf080f6860 2022-02-02T21:48:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44884/0 (socket says 172.21.15.96:44884) 2022-02-02T21:48:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 -- 172.21.15.96:0/1822823861 learned_addr learned my addr 172.21.15.96:0/1822823861 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf06ffd700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 0x7fdf0810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 -- 172.21.15.96:0/1822823861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 msgr2=0x7fdf0810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 0x7fdf0810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 -- 172.21.15.96:0/1822823861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8005040 con 0x7fdf080f55c0 2022-02-02T21:48:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf06ffd700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 0x7fdf0810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:48:24.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf077fe700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 secure :-1 s=READY pgs=3170 cs=0 l=1 rev1=1 rx=0x7fdef00093f0 tx=0x7fdef0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef0009ea0 con 0x7fdf080f55c0 2022-02-02T21:48:24.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdef0013af0 con 0x7fdf080f55c0 2022-02-02T21:48:24.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef000db10 con 0x7fdf080f55c0 2022-02-02T21:48:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0810c810 con 0x7fdf080f55c0 2022-02-02T21:48:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.050+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0810cda0 con 0x7fdf080f55c0 2022-02-02T21:48:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.051+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08045ad0 con 0x7fdf080f55c0 2022-02-02T21:48:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.052+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdef001a060 con 0x7fdf080f55c0 2022-02-02T21:48:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.052+0000 7fdefffff700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 0x7fdef4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.052+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdef00819b0 con 0x7fdf080f55c0 2022-02-02T21:48:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.052+0000 7fdf06ffd700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 0x7fdef4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.053+0000 7fdf06ffd700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 0x7fdef4067290 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fdef8004e30 tx=0x7fdef8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.057+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdef004fab0 con 0x7fdf080f55c0 2022-02-02T21:48:24.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.227+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf08057f10 con 0x7fdef4064dd0 2022-02-02T21:48:24.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.236+0000 7fdefffff700 1 -- 172.21.15.96:0/1822823861 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdf08057f10 con 0x7fdef4064dd0 2022-02-02T21:48:24.238 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:48:24.238 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:48:24.238 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:48:24.239 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:48:24.239 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:48:24.240 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:48:24.240 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:48:24.240 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:48:24.241 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:48:24.241 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:48:24.241 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:48:24.242 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:48:24.242 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:48:24.242 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:48:24.243 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:48:24.243 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:48:24.243 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:48:24.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:48:24.244 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:48:24.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:48:24.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:48:24.245 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:48:24.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 msgr2=0x7fdef4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 0x7fdef4067290 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fdef8004e30 tx=0x7fdef8009b30).stop 2022-02-02T21:48:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 msgr2=0x7fdf08109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 secure :-1 s=READY pgs=3170 cs=0 l=1 rev1=1 rx=0x7fdef00093f0 tx=0x7fdef0006ec0).stop 2022-02-02T21:48:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 shutdown_connections 2022-02-02T21:48:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdef4064dd0 0x7fdef4067290 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf080f55c0 0x7fdf08109cb0 unknown :-1 s=CLOSED pgs=3170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 --2- 172.21.15.96:0/1822823861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf080f6860 0x7fdf0810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 >> 172.21.15.96:0/1822823861 conn(0x7fdf080f0d40 msgr2=0x7fdf080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 shutdown_connections 2022-02-02T21:48:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.238+0000 7fdf0dbec700 1 -- 172.21.15.96:0/1822823861 wait complete. 2022-02-02T21:48:24.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:23 smithi159 ceph-mon[69013]: pgmap v6188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- 172.21.15.96:0/347951652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f66e0 msgr2=0x7faac00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 --2- 172.21.15.96:0/347951652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f66e0 0x7faac00f6b00 secure :-1 s=READY pgs=3171 cs=0 l=1 rev1=1 rx=0x7faab0004660 tx=0x7faab0009b30).stop 2022-02-02T21:48:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- 172.21.15.96:0/347951652 shutdown_connections 2022-02-02T21:48:24.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 --2- 172.21.15.96:0/347951652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f7980 0x7faac00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 --2- 172.21.15.96:0/347951652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f66e0 0x7faac00f6b00 unknown :-1 s=CLOSED pgs=3171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- 172.21.15.96:0/347951652 >> 172.21.15.96:0/347951652 conn(0x7faac00f1e40 msgr2=0x7faac00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- 172.21.15.96:0/347951652 shutdown_connections 2022-02-02T21:48:24.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- 172.21.15.96:0/347951652 wait complete. 2022-02-02T21:48:24.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 Processor -- start 2022-02-02T21:48:24.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- start start 2022-02-02T21:48:24.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f66e0 0x7faac0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0107a50 con 0x7faac00f7980 2022-02-02T21:48:24.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.336+0000 7faac769e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0107b90 con 0x7faac00f66e0 2022-02-02T21:48:24.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44896/0 (socket says 172.21.15.96:44896) 2022-02-02T21:48:24.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 -- 172.21.15.96:0/1206243412 learned_addr learned my addr 172.21.15.96:0/1206243412 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:24.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac543a700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f66e0 0x7faac0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 -- 172.21.15.96:0/1206243412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f66e0 msgr2=0x7faac0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f66e0 0x7faac0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 -- 172.21.15.96:0/1206243412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0005040 con 0x7faac00f7980 2022-02-02T21:48:24.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac4c39700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 secure :-1 s=READY pgs=3172 cs=0 l=1 rev1=1 rx=0x7faabc0026d0 tx=0x7faabc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc009320 con 0x7faac00f7980 2022-02-02T21:48:24.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faabc00f040 con 0x7faac00f7980 2022-02-02T21:48:24.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac0108530 con 0x7faac00f7980 2022-02-02T21:48:24.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc0147e0 con 0x7faac00f7980 2022-02-02T21:48:24.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.337+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac0108af0 con 0x7faac00f7980 2022-02-02T21:48:24.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.338+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0045ad0 con 0x7faac00f7980 2022-02-02T21:48:24.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.339+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faabc009480 con 0x7faac00f7980 2022-02-02T21:48:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.339+0000 7faab5ffb700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 0x7faaac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.339+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faabc082090 con 0x7faac00f7980 2022-02-02T21:48:24.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.339+0000 7faac543a700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 0x7faaac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.340+0000 7faac543a700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 0x7faaac067290 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7faab0004630 tx=0x7faab0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.343+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faabc053bc0 con 0x7faac00f7980 2022-02-02T21:48:24.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.572+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faac0027a00 con 0x7faac00f7980 2022-02-02T21:48:24.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.572+0000 7faab5ffb700 1 -- 172.21.15.96:0/1206243412 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faabc0537b0 con 0x7faac00f7980 2022-02-02T21:48:24.574 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:48:24.574 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:48:24.575 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:48:24.575 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:24.575 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:48:24.576 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:48:24.576 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:24.576 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:48:24.577 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:48:24.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:24.577 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:48:24.578 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:48:24.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:24.578 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:48:24.579 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:48:24.579 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:48:24.579 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:48:24.580 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:48:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 msgr2=0x7faaac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 0x7faaac067290 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7faab0004630 tx=0x7faab0009b30).stop 2022-02-02T21:48:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 msgr2=0x7faac01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 secure :-1 s=READY pgs=3172 cs=0 l=1 rev1=1 rx=0x7faabc0026d0 tx=0x7faabc009de0).stop 2022-02-02T21:48:24.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 shutdown_connections 2022-02-02T21:48:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faaac064dd0 0x7faaac067290 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac00f66e0 0x7faac0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 --2- 172.21.15.96:0/1206243412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faac00f7980 0x7faac01074a0 unknown :-1 s=CLOSED pgs=3172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 >> 172.21.15.96:0/1206243412 conn(0x7faac00f1e40 msgr2=0x7faac00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 shutdown_connections 2022-02-02T21:48:24.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.574+0000 7faac769e700 1 -- 172.21.15.96:0/1206243412 wait complete. 2022-02-02T21:48:24.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.671+0000 7f9c7918d700 1 -- 172.21.15.96:0/143494621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f6860 msgr2=0x7f9c740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.671+0000 7f9c7918d700 1 --2- 172.21.15.96:0/143494621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f6860 0x7f9c740f6cc0 secure :-1 s=READY pgs=3173 cs=0 l=1 rev1=1 rx=0x7f9c64004660 tx=0x7f9c64009b30).stop 2022-02-02T21:48:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 -- 172.21.15.96:0/143494621 shutdown_connections 2022-02-02T21:48:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 --2- 172.21.15.96:0/143494621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f6860 0x7f9c740f6cc0 unknown :-1 s=CLOSED pgs=3173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 --2- 172.21.15.96:0/143494621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f55c0 0x7f9c740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 -- 172.21.15.96:0/143494621 >> 172.21.15.96:0/143494621 conn(0x7f9c740f0d40 msgr2=0x7f9c740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 -- 172.21.15.96:0/143494621 shutdown_connections 2022-02-02T21:48:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 -- 172.21.15.96:0/143494621 wait complete. 2022-02-02T21:48:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 Processor -- start 2022-02-02T21:48:24.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.672+0000 7f9c7918d700 1 -- start start 2022-02-02T21:48:24.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7918d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7918d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f6860 0x7f9c74107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7918d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74107a10 con 0x7f9c740f55c0 2022-02-02T21:48:24.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7918d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74107b50 con 0x7f9c740f6860 2022-02-02T21:48:24.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44904/0 (socket says 172.21.15.96:44904) 2022-02-02T21:48:24.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 -- 172.21.15.96:0/4294708199 learned_addr learned my addr 172.21.15.96:0/4294708199 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:24.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7259c700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f6860 0x7f9c74107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 -- 172.21.15.96:0/4294708199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f6860 msgr2=0x7f9c74107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f6860 0x7f9c74107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 -- 172.21.15.96:0/4294708199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64005040 con 0x7f9c740f55c0 2022-02-02T21:48:24.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c72d9d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 secure :-1 s=READY pgs=3174 cs=0 l=1 rev1=1 rx=0x7f9c6800c530 tx=0x7f9c68007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c6800f650 con 0x7f9c740f55c0 2022-02-02T21:48:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c741084f0 con 0x7f9c740f55c0 2022-02-02T21:48:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c6800fc60 con 0x7f9c740f55c0 2022-02-02T21:48:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.673+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c68012d20 con 0x7f9c740f55c0 2022-02-02T21:48:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.674+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74108ab0 con 0x7f9c740f55c0 2022-02-02T21:48:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.675+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74045ad0 con 0x7f9c740f55c0 2022-02-02T21:48:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.675+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c68019030 con 0x7f9c740f55c0 2022-02-02T21:48:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.675+0000 7f9c5b7fe700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 0x7f9c5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.675+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9c680816b0 con 0x7f9c740f55c0 2022-02-02T21:48:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.675+0000 7f9c7259c700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 0x7f9c5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.676+0000 7f9c7259c700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 0x7f9c5c067290 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f9c64004e30 tx=0x7f9c64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.680+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c68053230 con 0x7f9c740f55c0 2022-02-02T21:48:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.881+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c7410d590 con 0x7f9c740f55c0 2022-02-02T21:48:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.882+0000 7f9c5b7fe700 1 -- 172.21.15.96:0/4294708199 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9c68052e20 con 0x7f9c740f55c0 2022-02-02T21:48:24.884 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:48:24.884 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:48:24.884 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:48:24.885 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:48:24.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:24.886 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:48:24.886 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:48:24.886 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:48:24.887 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:48:24.887 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:48:24.887 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:48:24.888 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:48:24.888 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:48:24.888 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:48:24.889 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:48:24.889 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:48:24.889 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:48:24.890 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:48:24.890 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:48:24.890 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:48:24.891 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:48:24.891 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:48:24.892 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:48:24.892 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:48:24.892 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:48:24.893 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:48:24.893 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:48:24.893 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:48:24.894 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:48:24.894 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:48:24.895 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:48:24.895 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:48:24.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:24.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:24.896 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:48:24.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:24.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:24.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:24.898 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 msgr2=0x7f9c5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 0x7f9c5c067290 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f9c64004e30 tx=0x7f9c64009b30).stop 2022-02-02T21:48:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 msgr2=0x7f9c74106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:24.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 secure :-1 s=READY pgs=3174 cs=0 l=1 rev1=1 rx=0x7f9c6800c530 tx=0x7f9c68007e10).stop 2022-02-02T21:48:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 shutdown_connections 2022-02-02T21:48:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9c5c064dd0 0x7f9c5c067290 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c740f55c0 0x7f9c74106f70 unknown :-1 s=CLOSED pgs=3174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 --2- 172.21.15.96:0/4294708199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c740f6860 0x7f9c74107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.883+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 >> 172.21.15.96:0/4294708199 conn(0x7f9c740f0d40 msgr2=0x7f9c7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:24.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.884+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 shutdown_connections 2022-02-02T21:48:24.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:24.884+0000 7f9c7918d700 1 -- 172.21.15.96:0/4294708199 wait complete. 2022-02-02T21:48:24.903 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:48:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:24 smithi159 ceph-mon[69013]: from='client.40446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:25.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:24 smithi159 ceph-mon[69013]: from='client.40450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:25.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1206243412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:48:25.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4294708199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:48:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:24 smithi096 ceph-mon[101353]: from='client.40446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:24 smithi096 ceph-mon[101353]: from='client.40450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1206243412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:48:25.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4294708199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:48:26.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:25 smithi159 ceph-mon[69013]: pgmap v6189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:25 smithi096 ceph-mon[101353]: pgmap v6189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:27 smithi159 ceph-mon[69013]: pgmap v6190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:48:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:48:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:27 smithi096 ceph-mon[101353]: pgmap v6190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:48:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:48:30.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:29 smithi159 ceph-mon[69013]: pgmap v6191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:29 smithi096 ceph-mon[101353]: pgmap v6191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:32.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:31 smithi159 ceph-mon[69013]: pgmap v6192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:32.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:31 smithi096 ceph-mon[101353]: pgmap v6192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:34.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:33 smithi159 ceph-mon[69013]: pgmap v6193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:34.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:33 smithi096 ceph-mon[101353]: pgmap v6193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:35 smithi159 ceph-mon[69013]: pgmap v6194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:35 smithi096 ceph-mon[101353]: pgmap v6194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:38.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:37 smithi159 ceph-mon[69013]: pgmap v6195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:37 smithi096 ceph-mon[101353]: pgmap v6195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:39 smithi159 ceph-mon[69013]: pgmap v6196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:39 smithi096 ceph-mon[101353]: pgmap v6196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:42.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:41 smithi159 ceph-mon[69013]: pgmap v6197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:42.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:41 smithi096 ceph-mon[101353]: pgmap v6197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:44.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:43 smithi159 ceph-mon[69013]: pgmap v6198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:44.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:43 smithi096 ceph-mon[101353]: pgmap v6198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:46.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:45 smithi159 ceph-mon[69013]: pgmap v6199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:46.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:45 smithi096 ceph-mon[101353]: pgmap v6199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:48.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:47 smithi159 ceph-mon[69013]: pgmap v6200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:47 smithi096 ceph-mon[101353]: pgmap v6200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:50.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:49 smithi159 ceph-mon[69013]: pgmap v6201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:49 smithi096 ceph-mon[101353]: pgmap v6201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:52.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:51 smithi159 ceph-mon[69013]: pgmap v6202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:52.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:51 smithi096 ceph-mon[101353]: pgmap v6202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:53 smithi159 ceph-mon[69013]: pgmap v6203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:54.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:53 smithi096 ceph-mon[101353]: pgmap v6203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:54.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 -- 172.21.15.96:0/2703551780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f6860 msgr2=0x7fb8c40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:54.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 --2- 172.21.15.96:0/2703551780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f6860 0x7fb8c40f6cc0 secure :-1 s=READY pgs=3175 cs=0 l=1 rev1=1 rx=0x7fb8b4004660 tx=0x7fb8b4009b30).stop 2022-02-02T21:48:54.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 -- 172.21.15.96:0/2703551780 shutdown_connections 2022-02-02T21:48:54.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 --2- 172.21.15.96:0/2703551780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f6860 0x7fb8c40f6cc0 unknown :-1 s=CLOSED pgs=3175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:54.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 --2- 172.21.15.96:0/2703551780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f55c0 0x7fb8c40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:48:54.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 -- 172.21.15.96:0/2703551780 >> 172.21.15.96:0/2703551780 conn(0x7fb8c40f0d40 msgr2=0x7fb8c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:54.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 -- 172.21.15.96:0/2703551780 shutdown_connections 2022-02-02T21:48:54.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.995+0000 7fb8c9413700 1 -- 172.21.15.96:0/2703551780 wait complete. 2022-02-02T21:48:55.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 Processor -- start 2022-02-02T21:48:55.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 -- start start 2022-02-02T21:48:55.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f6860 0x7fb8c410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4060470 con 0x7fb8c40f55c0 2022-02-02T21:48:55.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c9413700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40605b0 con 0x7fb8c40f6860 2022-02-02T21:48:55.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44922/0 (socket says 172.21.15.96:44922) 2022-02-02T21:48:55.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c2ffd700 1 -- 172.21.15.96:0/567415981 learned_addr learned my addr 172.21.15.96:0/567415981 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:55.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.996+0000 7fb8c27fc700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f6860 0x7fb8c410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c2ffd700 1 -- 172.21.15.96:0/567415981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f6860 msgr2=0x7fb8c410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c2ffd700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f6860 0x7fb8c410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c2ffd700 1 -- 172.21.15.96:0/567415981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4005040 con 0x7fb8c40f55c0 2022-02-02T21:48:55.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c2ffd700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 secure :-1 s=READY pgs=3176 cs=0 l=1 rev1=1 rx=0x7fb8b80093f0 tx=0x7fb8b8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b8013640 con 0x7fb8c40f55c0 2022-02-02T21:48:55.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c410c810 con 0x7fb8c40f55c0 2022-02-02T21:48:55.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8b8013c50 con 0x7fb8c40f55c0 2022-02-02T21:48:55.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b8012c70 con 0x7fb8c40f55c0 2022-02-02T21:48:55.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.997+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c410cda0 con 0x7fb8c40f55c0 2022-02-02T21:48:55.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.998+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c4045ad0 con 0x7fb8c40f55c0 2022-02-02T21:48:55.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.999+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb8b801a060 con 0x7fb8c40f55c0 2022-02-02T21:48:55.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.999+0000 7fb8ab7fe700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 0x7fb8ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.999+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb8b8081a50 con 0x7fb8c40f55c0 2022-02-02T21:48:55.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:54.999+0000 7fb8c27fc700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 0x7fb8ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.000+0000 7fb8c27fc700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 0x7fb8ac067290 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fb8b4004630 tx=0x7fb8b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.003+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb8b804faf0 con 0x7fb8c40f55c0 2022-02-02T21:48:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.182+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c4057f10 con 0x7fb8ac064dd0 2022-02-02T21:48:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.183+0000 7fb8ab7fe700 1 -- 172.21.15.96:0/567415981 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb8c4057f10 con 0x7fb8ac064dd0 2022-02-02T21:48:55.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 msgr2=0x7fb8ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 0x7fb8ac067290 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fb8b4004630 tx=0x7fb8b4009b30).stop 2022-02-02T21:48:55.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 msgr2=0x7fb8c4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 secure :-1 s=READY pgs=3176 cs=0 l=1 rev1=1 rx=0x7fb8b80093f0 tx=0x7fb8b8006ec0).stop 2022-02-02T21:48:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 shutdown_connections 2022-02-02T21:48:55.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb8ac064dd0 0x7fb8ac067290 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8c40f55c0 0x7fb8c4109cb0 unknown :-1 s=CLOSED pgs=3176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 --2- 172.21.15.96:0/567415981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c40f6860 0x7fb8c410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 >> 172.21.15.96:0/567415981 conn(0x7fb8c40f0d40 msgr2=0x7fb8c40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 shutdown_connections 2022-02-02T21:48:55.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.185+0000 7fb8c9413700 1 -- 172.21.15.96:0/567415981 wait complete. 2022-02-02T21:48:55.195 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:48:55.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/174919586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 msgr2=0x7fa4a80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/174919586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a80f6b30 secure :-1 s=READY pgs=3177 cs=0 l=1 rev1=1 rx=0x7fa498004660 tx=0x7fa498009b30).stop 2022-02-02T21:48:55.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/174919586 shutdown_connections 2022-02-02T21:48:55.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/174919586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a80f6b30 unknown :-1 s=CLOSED pgs=3177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/174919586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 0x7fa4a80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/174919586 >> 172.21.15.96:0/174919586 conn(0x7fa4a80f0b90 msgr2=0x7fa4a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/174919586 shutdown_connections 2022-02-02T21:48:55.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/174919586 wait complete. 2022-02-02T21:48:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 Processor -- start 2022-02-02T21:48:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.284+0000 7fa4ae2e5700 1 -- start start 2022-02-02T21:48:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ae2e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 0x7fa4a8109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ae2e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ae2e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80603e0 con 0x7fa4a80f66d0 2022-02-02T21:48:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ae2e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8060520 con 0x7fa4a80f5430 2022-02-02T21:48:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44934/0 (socket says 172.21.15.96:44934) 2022-02-02T21:48:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 -- 172.21.15.96:0/724354674 learned_addr learned my addr 172.21.15.96:0/724354674 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ad2e3700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 0x7fa4a8109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 -- 172.21.15.96:0/724354674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 msgr2=0x7fa4a8109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 0x7fa4a8109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 -- 172.21.15.96:0/724354674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498005040 con 0x7fa4a80f66d0 2022-02-02T21:48:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4acae2700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 secure :-1 s=READY pgs=3178 cs=0 l=1 rev1=1 rx=0x7fa498009990 tx=0x7fa498009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa498018070 con 0x7fa4a80f66d0 2022-02-02T21:48:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa498007ba0 con 0x7fa4a80f66d0 2022-02-02T21:48:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49801c3c0 con 0x7fa4a80f66d0 2022-02-02T21:48:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.285+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a810c470 con 0x7fa4a80f66d0 2022-02-02T21:48:55.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.286+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8105a40 con 0x7fa4a80f66d0 2022-02-02T21:48:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.287+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8045ad0 con 0x7fa4a80f66d0 2022-02-02T21:48:55.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.287+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa49801d420 con 0x7fa4a80f66d0 2022-02-02T21:48:55.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.288+0000 7fa49dffb700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 0x7fa4940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.288+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa498083810 con 0x7fa4a80f66d0 2022-02-02T21:48:55.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.288+0000 7fa4ad2e3700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 0x7fa4940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.288+0000 7fa4ad2e3700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 0x7fa4940672e0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fa4a8060060 tx=0x7fa4a4009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.291+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa498051a10 con 0x7fa4a80f66d0 2022-02-02T21:48:55.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.468+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a8057f10 con 0x7fa494064e20 2022-02-02T21:48:55.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.478+0000 7fa49dffb700 1 -- 172.21.15.96:0/724354674 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa4a8057f10 con 0x7fa494064e20 2022-02-02T21:48:55.478 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:48:55.478 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:48:55.479 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:48:55.479 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:48:55.479 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:48:55.480 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:48:55.480 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:48:55.480 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:48:55.481 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:48:55.481 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:48:55.481 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:48:55.482 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:48:55.482 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:48:55.482 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:48:55.483 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:48:55.483 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:48:55.483 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:48:55.484 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:48:55.484 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:48:55.484 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:48:55.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:48:55.485 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:48:55.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 msgr2=0x7fa4940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 0x7fa4940672e0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fa4a8060060 tx=0x7fa4a4009c00).stop 2022-02-02T21:48:55.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 msgr2=0x7fa4a810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 secure :-1 s=READY pgs=3178 cs=0 l=1 rev1=1 rx=0x7fa498009990 tx=0x7fa498009b30).stop 2022-02-02T21:48:55.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 shutdown_connections 2022-02-02T21:48:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa494064e20 0x7fa4940672e0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4a80f5430 0x7fa4a8109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 --2- 172.21.15.96:0/724354674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a80f66d0 0x7fa4a810bf20 unknown :-1 s=CLOSED pgs=3178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 >> 172.21.15.96:0/724354674 conn(0x7fa4a80f0b90 msgr2=0x7fa4a80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 shutdown_connections 2022-02-02T21:48:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.480+0000 7fa4ae2e5700 1 -- 172.21.15.96:0/724354674 wait complete. 2022-02-02T21:48:55.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 -- 172.21.15.96:0/2790667292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 msgr2=0x7f01680f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 --2- 172.21.15.96:0/2790667292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f01680f5a00 secure :-1 s=READY pgs=3179 cs=0 l=1 rev1=1 rx=0x7f0158004660 tx=0x7f0158009b30).stop 2022-02-02T21:48:55.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 -- 172.21.15.96:0/2790667292 shutdown_connections 2022-02-02T21:48:55.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 --2- 172.21.15.96:0/2790667292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 0x7f01680f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 --2- 172.21.15.96:0/2790667292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f01680f5a00 unknown :-1 s=CLOSED pgs=3179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 -- 172.21.15.96:0/2790667292 >> 172.21.15.96:0/2790667292 conn(0x7f01680f0d40 msgr2=0x7f01680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 -- 172.21.15.96:0/2790667292 shutdown_connections 2022-02-02T21:48:55.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.577+0000 7f016f2c7700 1 -- 172.21.15.96:0/2790667292 wait complete. 2022-02-02T21:48:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 Processor -- start 2022-02-02T21:48:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 -- start start 2022-02-02T21:48:55.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 0x7f016810c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680604e0 con 0x7f01680f55e0 2022-02-02T21:48:55.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016f2c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168060620 con 0x7f01680f6880 2022-02-02T21:48:55.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44942/0 (socket says 172.21.15.96:44942) 2022-02-02T21:48:55.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 -- 172.21.15.96:0/1717106952 learned_addr learned my addr 172.21.15.96:0/1717106952 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:55.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016c862700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 0x7f016810c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 -- 172.21.15.96:0/1717106952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 msgr2=0x7f016810c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 0x7f016810c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.578+0000 7f016d063700 1 -- 172.21.15.96:0/1717106952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158005040 con 0x7f01680f55e0 2022-02-02T21:48:55.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f016d063700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 secure :-1 s=READY pgs=3180 cs=0 l=1 rev1=1 rx=0x7f0158013a70 tx=0x7f0158009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0158018070 con 0x7f01680f55e0 2022-02-02T21:48:55.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016810c720 con 0x7f01680f55e0 2022-02-02T21:48:55.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f01580097d0 con 0x7f01680f55e0 2022-02-02T21:48:55.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f015801c3c0 con 0x7f01680f55e0 2022-02-02T21:48:55.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.579+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016810cc50 con 0x7f01680f55e0 2022-02-02T21:48:55.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.580+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01680f49d0 con 0x7f01680f55e0 2022-02-02T21:48:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.580+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0158007ba0 con 0x7f01680f55e0 2022-02-02T21:48:55.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.581+0000 7f015dffb700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.581+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f01580836d0 con 0x7f01680f55e0 2022-02-02T21:48:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.581+0000 7f016c862700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.581+0000 7f016c862700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0164004a70 tx=0x7f016400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.585+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0158051890 con 0x7f01680f55e0 2022-02-02T21:48:55.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.814+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01680fdee0 con 0x7f01680f55e0 2022-02-02T21:48:55.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.815+0000 7f015dffb700 1 -- 172.21.15.96:0/1717106952 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0158054eb0 con 0x7f01680f55e0 2022-02-02T21:48:55.815 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:48:55.816 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:48:55.816 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:48:55.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:55.817 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:48:55.817 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:48:55.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:55.818 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:48:55.818 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:48:55.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:55.819 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:48:55.819 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:48:55.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:48:55.820 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:48:55.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:48:55.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:48:55.821 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:48:55.821 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:48:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 msgr2=0x7f0154067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0164004a70 tx=0x7f016400b040).stop 2022-02-02T21:48:55.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 msgr2=0x7f0168109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 secure :-1 s=READY pgs=3180 cs=0 l=1 rev1=1 rx=0x7f0158013a70 tx=0x7f0158009b30).stop 2022-02-02T21:48:55.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 shutdown_connections 2022-02-02T21:48:55.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0154064dd0 0x7f0154067290 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01680f55e0 0x7f0168109cd0 unknown :-1 s=CLOSED pgs=3180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 --2- 172.21.15.96:0/1717106952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01680f6880 0x7f016810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 >> 172.21.15.96:0/1717106952 conn(0x7f01680f0d40 msgr2=0x7f01680fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 shutdown_connections 2022-02-02T21:48:55.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.816+0000 7f016f2c7700 1 -- 172.21.15.96:0/1717106952 wait complete. 2022-02-02T21:48:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 -- 172.21.15.96:0/3333889429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f5ef0 msgr2=0x7f3e4c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/3333889429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f6920 secure :-1 s=READY pgs=3181 cs=0 l=1 rev1=1 rx=0x7f3e3c004660 tx=0x7f3e3c009b30).stop 2022-02-02T21:48:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 -- 172.21.15.96:0/3333889429 shutdown_connections 2022-02-02T21:48:55.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/3333889429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f6920 unknown :-1 s=CLOSED pgs=3181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/3333889429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 -- 172.21.15.96:0/3333889429 >> 172.21.15.96:0/3333889429 conn(0x7f3e4c0f0de0 msgr2=0x7f3e4c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:55.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 -- 172.21.15.96:0/3333889429 shutdown_connections 2022-02-02T21:48:55.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.914+0000 7f3e50dd6700 1 -- 172.21.15.96:0/3333889429 wait complete. 2022-02-02T21:48:55.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 Processor -- start 2022-02-02T21:48:55.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 -- start start 2022-02-02T21:48:55.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0f81c0 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e50dd6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0f8300 con 0x7f3e4c0f5ef0 2022-02-02T21:48:55.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44952/0 (socket says 172.21.15.96:44952) 2022-02-02T21:48:55.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e4a59c700 1 -- 172.21.15.96:0/1778289384 learned_addr learned my addr 172.21.15.96:0/1778289384 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:48:55.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.915+0000 7f3e49d9b700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e4a59c700 1 -- 172.21.15.96:0/1778289384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f5ef0 msgr2=0x7f3e4c0f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:55.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e4a59c700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:55.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e4a59c700 1 -- 172.21.15.96:0/1778289384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c005040 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e4a59c700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 secure :-1 s=READY pgs=3182 cs=0 l=1 rev1=1 rx=0x7f3e400026d0 tx=0x7f3e40009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e40009320 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e4000f040 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.916+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e400147e0 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.919+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0f85e0 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.919+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c10ef90 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.920+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c045ad0 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.920+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e40009480 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.921+0000 7f3e3affd700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 0x7f3e34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:48:55.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.921+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3e40081c90 con 0x7f3e4c0f55e0 2022-02-02T21:48:55.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.921+0000 7f3e49d9b700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 0x7f3e34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:48:55.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.921+0000 7f3e49d9b700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 0x7f3e34067290 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f3e3c004630 tx=0x7f3e3c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:48:55.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:55.925+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e4004fd90 con 0x7f3e4c0f55e0 2022-02-02T21:48:56.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.122+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3e4c10f540 con 0x7f3e4c0f55e0 2022-02-02T21:48:56.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.123+0000 7f3e3affd700 1 -- 172.21.15.96:0/1778289384 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3e400533b0 con 0x7f3e4c0f55e0 2022-02-02T21:48:56.123 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:48:56.124 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:48:56.124 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:48:56.124 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:48:56.125 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:56.125 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:48:56.125 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:48:56.126 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:48:56.126 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:48:56.126 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:48:56.127 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:48:56.127 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:48:56.127 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:48:56.128 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:48:56.128 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:48:56.128 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:48:56.129 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:48:56.129 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:48:56.129 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:48:56.130 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:48:56.130 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:48:56.131 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:48:56.131 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:48:56.131 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:48:56.132 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:48:56.132 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:48:56.132 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:48:56.133 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:48:56.133 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:48:56.133 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:48:56.134 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:48:56.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:48:56.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:56.135 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:56.135 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:48:56.135 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:48:56.136 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:56.136 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:56.136 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:48:56.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 msgr2=0x7f3e34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:56.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 0x7f3e34067290 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f3e3c004630 tx=0x7f3e3c009b30).stop 2022-02-02T21:48:56.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 msgr2=0x7f3e4c0f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:48:56.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 secure :-1 s=READY pgs=3182 cs=0 l=1 rev1=1 rx=0x7f3e400026d0 tx=0x7f3e40009de0).stop 2022-02-02T21:48:56.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 shutdown_connections 2022-02-02T21:48:56.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e34064dd0 0x7f3e34067290 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:56.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e4c0f55e0 0x7f3e4c0f97e0 unknown :-1 s=CLOSED pgs=3182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:56.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 --2- 172.21.15.96:0/1778289384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e4c0f5ef0 0x7f3e4c0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:48:56.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.124+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 >> 172.21.15.96:0/1778289384 conn(0x7f3e4c0f0de0 msgr2=0x7f3e4c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:48:56.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.125+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 shutdown_connections 2022-02-02T21:48:56.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:48:56.125+0000 7f3e50dd6700 1 -- 172.21.15.96:0/1778289384 wait complete. 2022-02-02T21:48:56.142 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:48:56.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:55 smithi159 ceph-mon[69013]: pgmap v6204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:56.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:55 smithi159 ceph-mon[69013]: from='client.40462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:56.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1717106952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:48:56.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:55 smithi096 ceph-mon[101353]: pgmap v6204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:56.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:55 smithi096 ceph-mon[101353]: from='client.40462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:56.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1717106952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:48:57.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:56 smithi159 ceph-mon[69013]: from='client.40466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1778289384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:48:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:56 smithi096 ceph-mon[101353]: from='client.40466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:48:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1778289384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:48:58.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:57 smithi159 ceph-mon[69013]: pgmap v6205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:48:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:57 smithi096 ceph-mon[101353]: pgmap v6205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:00.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:48:59 smithi159 ceph-mon[69013]: pgmap v6206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:48:59 smithi096 ceph-mon[101353]: pgmap v6206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:02.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:02 smithi159 ceph-mon[69013]: pgmap v6207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:01 smithi096 ceph-mon[101353]: pgmap v6207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:04.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:04 smithi159 ceph-mon[69013]: pgmap v6208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:04 smithi096 ceph-mon[101353]: pgmap v6208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:06 smithi159 ceph-mon[69013]: pgmap v6209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:06 smithi096 ceph-mon[101353]: pgmap v6209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:08.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:08 smithi159 ceph-mon[69013]: pgmap v6210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:08 smithi096 ceph-mon[101353]: pgmap v6210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:10 smithi159 ceph-mon[69013]: pgmap v6211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:10 smithi096 ceph-mon[101353]: pgmap v6211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:12 smithi159 ceph-mon[69013]: pgmap v6212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:12 smithi096 ceph-mon[101353]: pgmap v6212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:14 smithi096 ceph-mon[101353]: pgmap v6213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:14 smithi159 ceph-mon[69013]: pgmap v6213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:16 smithi096 ceph-mon[101353]: pgmap v6214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:16 smithi159 ceph-mon[69013]: pgmap v6214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:18 smithi096 ceph-mon[101353]: pgmap v6215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:18 smithi159 ceph-mon[69013]: pgmap v6215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:20 smithi096 ceph-mon[101353]: pgmap v6216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:20 smithi159 ceph-mon[69013]: pgmap v6216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:22 smithi096 ceph-mon[101353]: pgmap v6217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:22.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:22 smithi159 ceph-mon[69013]: pgmap v6217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:24 smithi096 ceph-mon[101353]: pgmap v6218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:24 smithi159 ceph-mon[69013]: pgmap v6218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:26.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 -- 172.21.15.96:0/332672590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 msgr2=0x7f9b080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 --2- 172.21.15.96:0/332672590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b080f6b30 secure :-1 s=READY pgs=3183 cs=0 l=1 rev1=1 rx=0x7f9af4004660 tx=0x7f9af4009b30).stop 2022-02-02T21:49:26.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 -- 172.21.15.96:0/332672590 shutdown_connections 2022-02-02T21:49:26.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 --2- 172.21.15.96:0/332672590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b080f6b30 unknown :-1 s=CLOSED pgs=3183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 --2- 172.21.15.96:0/332672590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 0x7f9b080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 -- 172.21.15.96:0/332672590 >> 172.21.15.96:0/332672590 conn(0x7f9b080f0b90 msgr2=0x7f9b080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:26.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 -- 172.21.15.96:0/332672590 shutdown_connections 2022-02-02T21:49:26.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.235+0000 7f9b0df34700 1 -- 172.21.15.96:0/332672590 wait complete. 2022-02-02T21:49:26.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 Processor -- start 2022-02-02T21:49:26.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 -- start start 2022-02-02T21:49:26.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 0x7f9b08105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08106760 con 0x7f9b080f66d0 2022-02-02T21:49:26.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0df34700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08106f60 con 0x7f9b080f5430 2022-02-02T21:49:26.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b07fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44972/0 (socket says 172.21.15.96:44972) 2022-02-02T21:49:26.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b07fff700 1 -- 172.21.15.96:0/4238986003 learned_addr learned my addr 172.21.15.96:0/4238986003 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:26.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.236+0000 7f9b0cf32700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 0x7f9b08105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b07fff700 1 -- 172.21.15.96:0/4238986003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 msgr2=0x7f9b08105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b07fff700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 0x7f9b08105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b07fff700 1 -- 172.21.15.96:0/4238986003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4005040 con 0x7f9b080f66d0 2022-02-02T21:49:26.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b07fff700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 secure :-1 s=READY pgs=3184 cs=0 l=1 rev1=1 rx=0x7f9af4009990 tx=0x7f9af4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af4018070 con 0x7f9b080f66d0 2022-02-02T21:49:26.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b081071e0 con 0x7f9b080f66d0 2022-02-02T21:49:26.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9af4007ba0 con 0x7f9b080f66d0 2022-02-02T21:49:26.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af401c3c0 con 0x7f9b080f66d0 2022-02-02T21:49:26.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.237+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b08107740 con 0x7f9b080f66d0 2022-02-02T21:49:26.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.238+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b08045ad0 con 0x7f9b080f66d0 2022-02-02T21:49:26.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.238+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9af401d420 con 0x7f9b080f66d0 2022-02-02T21:49:26.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.239+0000 7f9b057fa700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 0x7f9af80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.239+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9af4083680 con 0x7f9b080f66d0 2022-02-02T21:49:26.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.239+0000 7f9b0cf32700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 0x7f9af80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.239+0000 7f9b0cf32700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 0x7f9af80672e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f9b080f6530 tx=0x7f9afc009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.243+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9af4055150 con 0x7f9b080f66d0 2022-02-02T21:49:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:26 smithi096 ceph-mon[101353]: pgmap v6219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:26.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.425+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b0805f620 con 0x7f9af8064e20 2022-02-02T21:49:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.427+0000 7f9b057fa700 1 -- 172.21.15.96:0/4238986003 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9b0805f620 con 0x7f9af8064e20 2022-02-02T21:49:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.428+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 msgr2=0x7f9af80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.428+0000 7f9b0df34700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 0x7f9af80672e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f9b080f6530 tx=0x7f9afc009c00).stop 2022-02-02T21:49:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.428+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 msgr2=0x7f9b081061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 secure :-1 s=READY pgs=3184 cs=0 l=1 rev1=1 rx=0x7f9af4009990 tx=0x7f9af4009b30).stop 2022-02-02T21:49:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 shutdown_connections 2022-02-02T21:49:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af8064e20 0x7f9af80672e0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b080f5430 0x7f9b08105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 --2- 172.21.15.96:0/4238986003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b080f66d0 0x7f9b081061b0 unknown :-1 s=CLOSED pgs=3184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 >> 172.21.15.96:0/4238986003 conn(0x7f9b080f0b90 msgr2=0x7f9b080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 shutdown_connections 2022-02-02T21:49:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.429+0000 7f9b0df34700 1 -- 172.21.15.96:0/4238986003 wait complete. 2022-02-02T21:49:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:49:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:26 smithi159 ceph-mon[69013]: pgmap v6219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3828844988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f51a0 msgr2=0x7fa2d40f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3828844988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f51a0 0x7fa2d40f7920 secure :-1 s=READY pgs=3185 cs=0 l=1 rev1=1 rx=0x7fa2c4004660 tx=0x7fa2c4009b30).stop 2022-02-02T21:49:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3828844988 shutdown_connections 2022-02-02T21:49:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3828844988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f51a0 0x7fa2d40f7920 unknown :-1 s=CLOSED pgs=3185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3828844988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f4800 0x7fa2d40f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3828844988 >> 172.21.15.96:0/3828844988 conn(0x7fa2d40f0320 msgr2=0x7fa2d40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3828844988 shutdown_connections 2022-02-02T21:49:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3828844988 wait complete. 2022-02-02T21:49:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 Processor -- start 2022-02-02T21:49:26.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 -- start start 2022-02-02T21:49:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.527+0000 7fa2dafe4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2dafe4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f51a0 0x7fa2d4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2dafe4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4107870 con 0x7fa2d40f4800 2022-02-02T21:49:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2dafe4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4108080 con 0x7fa2d40f51a0 2022-02-02T21:49:26.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44978/0 (socket says 172.21.15.96:44978) 2022-02-02T21:49:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 -- 172.21.15.96:0/3753233534 learned_addr learned my addr 172.21.15.96:0/3753233534 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d97e1700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f51a0 0x7fa2d4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 -- 172.21.15.96:0/3753233534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f51a0 msgr2=0x7fa2d4107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f51a0 0x7fa2d4107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 -- 172.21.15.96:0/3753233534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4005040 con 0x7fa2d40f4800 2022-02-02T21:49:26.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2d9fe2700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 secure :-1 s=READY pgs=3186 cs=0 l=1 rev1=1 rx=0x7fa2d000e7c0 tx=0x7fa2d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d00092e0 con 0x7fa2d40f4800 2022-02-02T21:49:26.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4108300 con 0x7fa2d40f4800 2022-02-02T21:49:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2d000f040 con 0x7fa2d40f4800 2022-02-02T21:49:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d0014750 con 0x7fa2d40f4800 2022-02-02T21:49:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.528+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41088c0 con 0x7fa2d40f4800 2022-02-02T21:49:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.529+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4059100 con 0x7fa2d40f4800 2022-02-02T21:49:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.530+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2d001b030 con 0x7fa2d40f4800 2022-02-02T21:49:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.530+0000 7fa2ca7fc700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 0x7fa2c00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.530+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa2d0081890 con 0x7fa2d40f4800 2022-02-02T21:49:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.530+0000 7fa2d97e1700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 0x7fa2c00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.530+0000 7fa2d97e1700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 0x7fa2c00672e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fa2c4005010 tx=0x7fa2c400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.534+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2d004fa40 con 0x7fa2d40f4800 2022-02-02T21:49:26.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.710+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2d40fed90 con 0x7fa2c0064e20 2022-02-02T21:49:26.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.720+0000 7fa2ca7fc700 1 -- 172.21.15.96:0/3753233534 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa2d40fed90 con 0x7fa2c0064e20 2022-02-02T21:49:26.720 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:49:26.721 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:49:26.721 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:49:26.721 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:49:26.722 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:49:26.722 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:49:26.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:49:26.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:49:26.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:49:26.724 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:49:26.724 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:49:26.724 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:49:26.725 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:49:26.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:49:26.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:49:26.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:49:26.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:49:26.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:49:26.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:49:26.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:49:26.728 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:49:26.728 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:49:26.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 msgr2=0x7fa2c00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 0x7fa2c00672e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fa2c4005010 tx=0x7fa2c400b040).stop 2022-02-02T21:49:26.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 msgr2=0x7fa2d4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 secure :-1 s=READY pgs=3186 cs=0 l=1 rev1=1 rx=0x7fa2d000e7c0 tx=0x7fa2d000b040).stop 2022-02-02T21:49:26.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 shutdown_connections 2022-02-02T21:49:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa2c0064e20 0x7fa2c00672e0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2d40f4800 0x7fa2d4106d80 unknown :-1 s=CLOSED pgs=3186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 --2- 172.21.15.96:0/3753233534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d40f51a0 0x7fa2d4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 >> 172.21.15.96:0/3753233534 conn(0x7fa2d40f0320 msgr2=0x7fa2d40fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 shutdown_connections 2022-02-02T21:49:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.722+0000 7fa2dafe4700 1 -- 172.21.15.96:0/3753233534 wait complete. 2022-02-02T21:49:26.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 -- 172.21.15.96:0/2009998331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 msgr2=0x7efca80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 --2- 172.21.15.96:0/2009998331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca80f59e0 secure :-1 s=READY pgs=3187 cs=0 l=1 rev1=1 rx=0x7efc9c004660 tx=0x7efc9c009b30).stop 2022-02-02T21:49:26.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 -- 172.21.15.96:0/2009998331 shutdown_connections 2022-02-02T21:49:26.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 --2- 172.21.15.96:0/2009998331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 --2- 172.21.15.96:0/2009998331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca80f59e0 unknown :-1 s=CLOSED pgs=3187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 -- 172.21.15.96:0/2009998331 >> 172.21.15.96:0/2009998331 conn(0x7efca80f0d40 msgr2=0x7efca80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:26.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 -- 172.21.15.96:0/2009998331 shutdown_connections 2022-02-02T21:49:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.819+0000 7efcad143700 1 -- 172.21.15.96:0/2009998331 wait complete. 2022-02-02T21:49:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 Processor -- start 2022-02-02T21:49:26.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 -- start start 2022-02-02T21:49:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca8106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8106910 con 0x7efca80f55c0 2022-02-02T21:49:26.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efcad143700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8106a50 con 0x7efca80f6860 2022-02-02T21:49:26.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44988/0 (socket says 172.21.15.96:44988) 2022-02-02T21:49:26.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 -- 172.21.15.96:0/4251080077 learned_addr learned my addr 172.21.15.96:0/4251080077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:26.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca659c700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca8106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 -- 172.21.15.96:0/4251080077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 msgr2=0x7efca8106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca8106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca6d9d700 1 -- 172.21.15.96:0/4251080077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c005040 con 0x7efca80f55c0 2022-02-02T21:49:26.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.820+0000 7efca659c700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca8106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:49:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efca6d9d700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 secure :-1 s=READY pgs=3188 cs=0 l=1 rev1=1 rx=0x7efc9c004f60 tx=0x7efc9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c018070 con 0x7efca80f55c0 2022-02-02T21:49:26.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc9c007ba0 con 0x7efca80f55c0 2022-02-02T21:49:26.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8107390 con 0x7efca80f55c0 2022-02-02T21:49:26.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c01c620 con 0x7efca80f55c0 2022-02-02T21:49:26.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.821+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca81078f0 con 0x7efca80f55c0 2022-02-02T21:49:26.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.822+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8045ad0 con 0x7efca80f55c0 2022-02-02T21:49:26.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.822+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efc9c01c8e0 con 0x7efca80f55c0 2022-02-02T21:49:26.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.823+0000 7efc8f7fe700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:26.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.823+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efc9c083940 con 0x7efca80f55c0 2022-02-02T21:49:26.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.823+0000 7efca659c700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:26.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.823+0000 7efca659c700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7efc980041d0 tx=0x7efc98009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:26.827+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efc9c055470 con 0x7efca80f55c0 2022-02-02T21:49:27.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.057+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efca80fde50 con 0x7efca80f55c0 2022-02-02T21:49:27.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.058+0000 7efc8f7fe700 1 -- 172.21.15.96:0/4251080077 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7efc9c055060 con 0x7efca80f55c0 2022-02-02T21:49:27.058 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:49:27.059 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:49:27.059 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:49:27.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:27.060 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:49:27.060 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:49:27.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:27.061 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:49:27.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:49:27.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:27.062 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:49:27.062 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:49:27.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:27.063 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:49:27.063 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:49:27.064 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:49:27.064 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:49:27.064 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:49:27.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 msgr2=0x7efc90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7efc980041d0 tx=0x7efc98009040).stop 2022-02-02T21:49:27.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 msgr2=0x7efca8105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 secure :-1 s=READY pgs=3188 cs=0 l=1 rev1=1 rx=0x7efc9c004f60 tx=0x7efc9c009b30).stop 2022-02-02T21:49:27.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 shutdown_connections 2022-02-02T21:49:27.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc90064dd0 0x7efc90067290 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efca80f55c0 0x7efca8105e70 unknown :-1 s=CLOSED pgs=3188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 --2- 172.21.15.96:0/4251080077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efca80f6860 0x7efca8106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 >> 172.21.15.96:0/4251080077 conn(0x7efca80f0d40 msgr2=0x7efca80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:27.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.059+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 shutdown_connections 2022-02-02T21:49:27.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.060+0000 7efcad143700 1 -- 172.21.15.96:0/4251080077 wait complete. 2022-02-02T21:49:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 -- 172.21.15.96:0/1432953159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f66e0 msgr2=0x7f4a000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 --2- 172.21.15.96:0/1432953159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f66e0 0x7f4a000f6b00 secure :-1 s=READY pgs=3189 cs=0 l=1 rev1=1 rx=0x7f49f0004660 tx=0x7f49f0009b30).stop 2022-02-02T21:49:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 -- 172.21.15.96:0/1432953159 shutdown_connections 2022-02-02T21:49:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 --2- 172.21.15.96:0/1432953159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f7980 0x7f4a000f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 --2- 172.21.15.96:0/1432953159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f66e0 0x7f4a000f6b00 unknown :-1 s=CLOSED pgs=3189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 -- 172.21.15.96:0/1432953159 >> 172.21.15.96:0/1432953159 conn(0x7f4a000f1e40 msgr2=0x7f4a000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 -- 172.21.15.96:0/1432953159 shutdown_connections 2022-02-02T21:49:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.157+0000 7f4a0759e700 1 -- 172.21.15.96:0/1432953159 wait complete. 2022-02-02T21:49:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 Processor -- start 2022-02-02T21:49:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 -- start start 2022-02-02T21:49:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f66e0 0x7f4a00106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00107a50 con 0x7f4a000f7980 2022-02-02T21:49:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00107b90 con 0x7f4a000f66e0 2022-02-02T21:49:27.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:27.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45000/0 (socket says 172.21.15.96:45000) 2022-02-02T21:49:27.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 -- 172.21.15.96:0/2281713932 learned_addr learned my addr 172.21.15.96:0/2281713932 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:27.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a0533a700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f66e0 0x7f4a00106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:27.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 -- 172.21.15.96:0/2281713932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f66e0 msgr2=0x7f4a00106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f66e0 0x7f4a00106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.158+0000 7f4a04b39700 1 -- 172.21.15.96:0/2281713932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f0005040 con 0x7f4a000f7980 2022-02-02T21:49:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f4a04b39700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 secure :-1 s=READY pgs=3190 cs=0 l=1 rev1=1 rx=0x7f49fc00c530 tx=0x7f49fc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc00f650 con 0x7f4a000f7980 2022-02-02T21:49:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a00108530 con 0x7f4a000f7980 2022-02-02T21:49:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49fc00fc60 con 0x7f4a000f7980 2022-02-02T21:49:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc012cd0 con 0x7f4a000f7980 2022-02-02T21:49:27.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.159+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a00108af0 con 0x7f4a000f7980 2022-02-02T21:49:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.160+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a00045ad0 con 0x7f4a000f7980 2022-02-02T21:49:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.160+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f49fc010070 con 0x7f4a000f7980 2022-02-02T21:49:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.161+0000 7f49f5ffb700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 0x7f49ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.161+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49fc0817b0 con 0x7f4a000f7980 2022-02-02T21:49:27.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.161+0000 7f4a0533a700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 0x7f49ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:27.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.161+0000 7f4a0533a700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 0x7f49ec067290 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f49f0004e30 tx=0x7f49f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:27.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.165+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49fc0532e0 con 0x7f4a000f7980 2022-02-02T21:49:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:27 smithi096 ceph-mon[101353]: from='client.40478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:27.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.368+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a00027a00 con 0x7f4a000f7980 2022-02-02T21:49:27.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.368+0000 7f49f5ffb700 1 -- 172.21.15.96:0/2281713932 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f49fc052ed0 con 0x7f4a000f7980 2022-02-02T21:49:27.370 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:49:27.370 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:49:27.371 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:49:27.371 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:49:27.372 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:27.372 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:49:27.373 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:49:27.373 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:49:27.374 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:49:27.374 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:49:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:49:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:49:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:49:27.376 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:49:27.376 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:49:27.376 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:49:27.377 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:49:27.378 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:49:27.378 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:49:27.379 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:49:27.379 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:49:27.379 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:49:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:49:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:49:27.381 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:49:27.381 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:49:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:49:27.383 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:49:27.383 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:49:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:49:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:49:27.385 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:49:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:27.387 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:49:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:27.388 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:27.389 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:27.389 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:27.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 msgr2=0x7f49ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 0x7f49ec067290 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f49f0004e30 tx=0x7f49f0009b30).stop 2022-02-02T21:49:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 msgr2=0x7f4a001074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 secure :-1 s=READY pgs=3190 cs=0 l=1 rev1=1 rx=0x7f49fc00c530 tx=0x7f49fc007e20).stop 2022-02-02T21:49:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 shutdown_connections 2022-02-02T21:49:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49ec064dd0 0x7f49ec067290 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a000f66e0 0x7f4a00106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 --2- 172.21.15.96:0/2281713932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a000f7980 0x7f4a001074a0 unknown :-1 s=CLOSED pgs=3190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:27.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 >> 172.21.15.96:0/2281713932 conn(0x7f4a000f1e40 msgr2=0x7f4a000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:27.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 shutdown_connections 2022-02-02T21:49:27.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:27.371+0000 7f4a0759e700 1 -- 172.21.15.96:0/2281713932 wait complete. 2022-02-02T21:49:27.398 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:49:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:27 smithi159 ceph-mon[69013]: from='client.40478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: pgmap v6220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: from='client.40482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4251080077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:49:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2281713932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:49:28.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:49:28.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:49:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: pgmap v6220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: from='client.40482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4251080077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:49:28.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2281713932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:49:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:49:28.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:49:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:30 smithi159 ceph-mon[69013]: pgmap v6221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:30 smithi096 ceph-mon[101353]: pgmap v6221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:32.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:32 smithi159 ceph-mon[69013]: pgmap v6222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:32 smithi096 ceph-mon[101353]: pgmap v6222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:34 smithi159 ceph-mon[69013]: pgmap v6223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:34 smithi096 ceph-mon[101353]: pgmap v6223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:36 smithi159 ceph-mon[69013]: pgmap v6224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:36 smithi096 ceph-mon[101353]: pgmap v6224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:38 smithi159 ceph-mon[69013]: pgmap v6225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:38 smithi096 ceph-mon[101353]: pgmap v6225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:40 smithi159 ceph-mon[69013]: pgmap v6226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:40 smithi096 ceph-mon[101353]: pgmap v6226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:42 smithi159 ceph-mon[69013]: pgmap v6227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:42 smithi096 ceph-mon[101353]: pgmap v6227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:44 smithi159 ceph-mon[69013]: pgmap v6228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:44 smithi096 ceph-mon[101353]: pgmap v6228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:46 smithi159 ceph-mon[69013]: pgmap v6229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:46 smithi096 ceph-mon[101353]: pgmap v6229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:48 smithi159 ceph-mon[69013]: pgmap v6230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:48 smithi096 ceph-mon[101353]: pgmap v6230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:50 smithi159 ceph-mon[69013]: pgmap v6231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:50 smithi096 ceph-mon[101353]: pgmap v6231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:52.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:52 smithi159 ceph-mon[69013]: pgmap v6232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:52 smithi096 ceph-mon[101353]: pgmap v6232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:54 smithi159 ceph-mon[69013]: pgmap v6233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:54 smithi096 ceph-mon[101353]: pgmap v6233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:56 smithi159 ceph-mon[69013]: pgmap v6234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:56 smithi096 ceph-mon[101353]: pgmap v6234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:57.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 -- 172.21.15.96:0/3893209100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00f96f0 msgr2=0x7faeb00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 --2- 172.21.15.96:0/3893209100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00f96f0 0x7faeb00fbae0 secure :-1 s=READY pgs=3191 cs=0 l=1 rev1=1 rx=0x7fae98004660 tx=0x7fae98009b30).stop 2022-02-02T21:49:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 -- 172.21.15.96:0/3893209100 shutdown_connections 2022-02-02T21:49:57.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 --2- 172.21.15.96:0/3893209100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00f96f0 0x7faeb00fbae0 unknown :-1 s=CLOSED pgs=3191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 --2- 172.21.15.96:0/3893209100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00602b0 0x7faeb00f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 -- 172.21.15.96:0/3893209100 >> 172.21.15.96:0/3893209100 conn(0x7faeb00f0b90 msgr2=0x7faeb00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:57.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 -- 172.21.15.96:0/3893209100 shutdown_connections 2022-02-02T21:49:57.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.480+0000 7faeb53ad700 1 -- 172.21.15.96:0/3893209100 wait complete. 2022-02-02T21:49:57.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 Processor -- start 2022-02-02T21:49:57.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 -- start start 2022-02-02T21:49:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 0x7faeb0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0107870 con 0x7faeb00602b0 2022-02-02T21:49:57.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeb53ad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01080b0 con 0x7faeb00f96f0 2022-02-02T21:49:57.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeaffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.481+0000 7faeaffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45016/0 (socket says 172.21.15.96:45016) 2022-02-02T21:49:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaffff700 1 -- 172.21.15.96:0/2911373747 learned_addr learned my addr 172.21.15.96:0/2911373747 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaf7fe700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 0x7faeb0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaffff700 1 -- 172.21.15.96:0/2911373747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 msgr2=0x7faeb0107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaffff700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 0x7faeb0107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaffff700 1 -- 172.21.15.96:0/2911373747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98005040 con 0x7faeb00602b0 2022-02-02T21:49:57.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaf7fe700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 0x7faeb0107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:49:57.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeaffff700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 secure :-1 s=READY pgs=3192 cs=0 l=1 rev1=1 rx=0x7faea000c530 tx=0x7faea0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:57.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea000f650 con 0x7faeb00602b0 2022-02-02T21:49:57.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faea000fc60 con 0x7faeb00602b0 2022-02-02T21:49:57.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0108390 con 0x7faeb00602b0 2022-02-02T21:49:57.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea0012cd0 con 0x7faeb00602b0 2022-02-02T21:49:57.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.482+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb01088d0 con 0x7faeb00602b0 2022-02-02T21:49:57.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.483+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb0059100 con 0x7faeb00602b0 2022-02-02T21:49:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.484+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faea0010070 con 0x7faeb00602b0 2022-02-02T21:49:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.484+0000 7faeacff9700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 0x7fae9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.484+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faea00817c0 con 0x7faeb00602b0 2022-02-02T21:49:57.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.484+0000 7faeaf7fe700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 0x7fae9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.485+0000 7faeaf7fe700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 0x7fae9c0672e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7fae98004630 tx=0x7fae98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:57.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.489+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faea004f8c0 con 0x7faeb00602b0 2022-02-02T21:49:57.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.665+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faeb00fee00 con 0x7fae9c064e20 2022-02-02T21:49:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.667+0000 7faeacff9700 1 -- 172.21.15.96:0/2911373747 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faeb00fee00 con 0x7fae9c064e20 2022-02-02T21:49:57.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 msgr2=0x7fae9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 0x7fae9c0672e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7fae98004630 tx=0x7fae98009b30).stop 2022-02-02T21:49:57.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 msgr2=0x7faeb0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 secure :-1 s=READY pgs=3192 cs=0 l=1 rev1=1 rx=0x7faea000c530 tx=0x7faea0007e20).stop 2022-02-02T21:49:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 shutdown_connections 2022-02-02T21:49:57.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae9c064e20 0x7fae9c0672e0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeb00602b0 0x7faeb0106d80 unknown :-1 s=CLOSED pgs=3192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 --2- 172.21.15.96:0/2911373747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeb00f96f0 0x7faeb0107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.668+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 >> 172.21.15.96:0/2911373747 conn(0x7faeb00f0b90 msgr2=0x7faeb00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:57.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.669+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 shutdown_connections 2022-02-02T21:49:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.669+0000 7faeb53ad700 1 -- 172.21.15.96:0/2911373747 wait complete. 2022-02-02T21:49:57.679 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:49:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 -- 172.21.15.96:0/3826519075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 msgr2=0x7f94700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 --2- 172.21.15.96:0/3826519075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f94700f6950 secure :-1 s=READY pgs=3193 cs=0 l=1 rev1=1 rx=0x7f9460004660 tx=0x7f9460009b30).stop 2022-02-02T21:49:57.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 -- 172.21.15.96:0/3826519075 shutdown_connections 2022-02-02T21:49:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 --2- 172.21.15.96:0/3826519075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 0x7f94700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 --2- 172.21.15.96:0/3826519075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f94700f6950 unknown :-1 s=CLOSED pgs=3193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.766+0000 7f947613e700 1 -- 172.21.15.96:0/3826519075 >> 172.21.15.96:0/3826519075 conn(0x7f94700f1c90 msgr2=0x7f94700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:57.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 -- 172.21.15.96:0/3826519075 shutdown_connections 2022-02-02T21:49:57.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 -- 172.21.15.96:0/3826519075 wait complete. 2022-02-02T21:49:57.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 Processor -- start 2022-02-02T21:49:57.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 -- start start 2022-02-02T21:49:57.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 0x7f94701072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94701078f0 con 0x7f94700f6530 2022-02-02T21:49:57.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.767+0000 7f947613e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470108100 con 0x7f94700f77d0 2022-02-02T21:49:57.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45026/0 (socket says 172.21.15.96:45026) 2022-02-02T21:49:57.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 -- 172.21.15.96:0/1076341567 learned_addr learned my addr 172.21.15.96:0/1076341567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947493b700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 0x7f94701072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 -- 172.21.15.96:0/1076341567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 msgr2=0x7f94701072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 0x7f94701072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 -- 172.21.15.96:0/1076341567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005040 con 0x7f94700f6530 2022-02-02T21:49:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947513c700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 secure :-1 s=READY pgs=3194 cs=0 l=1 rev1=1 rx=0x7f9460013a70 tx=0x7f9460009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9460018070 con 0x7f94700f6530 2022-02-02T21:49:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94600097d0 con 0x7f94700f6530 2022-02-02T21:49:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470108320 con 0x7f94700f6530 2022-02-02T21:49:57.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f946001c3c0 con 0x7f94700f6530 2022-02-02T21:49:57.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.768+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470108880 con 0x7f94700f6530 2022-02-02T21:49:57.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.770+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f946001d420 con 0x7f94700f6530 2022-02-02T21:49:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.770+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470059100 con 0x7f94700f6530 2022-02-02T21:49:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.770+0000 7f9465ffb700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 0x7f945c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.770+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9460083710 con 0x7f94700f6530 2022-02-02T21:49:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.771+0000 7f947493b700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 0x7f945c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.771+0000 7f947493b700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 0x7f945c0672e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f946c0096c0 tx=0x7f946c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.775+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9460051980 con 0x7f94700f6530 2022-02-02T21:49:57.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.947+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94700fed60 con 0x7f945c064e20 2022-02-02T21:49:57.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.956+0000 7f9465ffb700 1 -- 172.21.15.96:0/1076341567 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f94700fed60 con 0x7f945c064e20 2022-02-02T21:49:57.958 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:49:57.958 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:49:57.958 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:49:57.959 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:49:57.959 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:49:57.959 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:49:57.960 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:49:57.960 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:49:57.960 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:49:57.961 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:49:57.961 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:49:57.961 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:49:57.962 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:49:57.962 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:49:57.962 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:49:57.963 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:49:57.963 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:49:57.963 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:49:57.964 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:49:57.964 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:49:57.964 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:49:57.965 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:49:57.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 msgr2=0x7f945c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 0x7f945c0672e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f946c0096c0 tx=0x7f946c009be0).stop 2022-02-02T21:49:57.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 msgr2=0x7f9470106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:57.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 secure :-1 s=READY pgs=3194 cs=0 l=1 rev1=1 rx=0x7f9460013a70 tx=0x7f9460009b30).stop 2022-02-02T21:49:57.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 shutdown_connections 2022-02-02T21:49:57.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f945c064e20 0x7f945c0672e0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94700f6530 0x7f9470106e00 unknown :-1 s=CLOSED pgs=3194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 --2- 172.21.15.96:0/1076341567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700f77d0 0x7f94701072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:57.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 >> 172.21.15.96:0/1076341567 conn(0x7f94700f1c90 msgr2=0x7f94700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:57.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 shutdown_connections 2022-02-02T21:49:57.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:57.958+0000 7f947613e700 1 -- 172.21.15.96:0/1076341567 wait complete. 2022-02-02T21:49:58.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 -- 172.21.15.96:0/388989159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f6700 msgr2=0x7f89a40f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 --2- 172.21.15.96:0/388989159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f6700 0x7f89a40f6b60 secure :-1 s=READY pgs=3195 cs=0 l=1 rev1=1 rx=0x7f8998004660 tx=0x7f8998009b30).stop 2022-02-02T21:49:58.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 -- 172.21.15.96:0/388989159 shutdown_connections 2022-02-02T21:49:58.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 --2- 172.21.15.96:0/388989159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f6700 0x7f89a40f6b60 unknown :-1 s=CLOSED pgs=3195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 --2- 172.21.15.96:0/388989159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f5460 0x7f89a40f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.054+0000 7f89a936e700 1 -- 172.21.15.96:0/388989159 >> 172.21.15.96:0/388989159 conn(0x7f89a40f0bc0 msgr2=0x7f89a40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:58.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.055+0000 7f89a936e700 1 -- 172.21.15.96:0/388989159 shutdown_connections 2022-02-02T21:49:58.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.055+0000 7f89a936e700 1 -- 172.21.15.96:0/388989159 wait complete. 2022-02-02T21:49:58.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.055+0000 7f89a936e700 1 Processor -- start 2022-02-02T21:49:58.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a936e700 1 -- start start 2022-02-02T21:49:58.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a936e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a936e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f6700 0x7f89a410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a936e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4060420 con 0x7f89a40f5460 2022-02-02T21:49:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a936e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4060560 con 0x7f89a40f6700 2022-02-02T21:49:58.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45036/0 (socket says 172.21.15.96:45036) 2022-02-02T21:49:58.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 -- 172.21.15.96:0/635742494 learned_addr learned my addr 172.21.15.96:0/635742494 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:58.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a27fc700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f6700 0x7f89a410bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 -- 172.21.15.96:0/635742494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f6700 msgr2=0x7f89a410bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f6700 0x7f89a410bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 -- 172.21.15.96:0/635742494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998005040 con 0x7f89a40f5460 2022-02-02T21:49:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.056+0000 7f89a2ffd700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 secure :-1 s=READY pgs=3196 cs=0 l=1 rev1=1 rx=0x7f899400c530 tx=0x7f8994007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.057+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f899400f650 con 0x7f89a40f5460 2022-02-02T21:49:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.057+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f899400fc60 con 0x7f89a40f5460 2022-02-02T21:49:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.057+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8994012cb0 con 0x7f89a40f5460 2022-02-02T21:49:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.057+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a410c560 con 0x7f89a40f5460 2022-02-02T21:49:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.057+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a410caf0 con 0x7f89a40f5460 2022-02-02T21:49:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.058+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a4059100 con 0x7f89a40f5460 2022-02-02T21:49:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.058+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8994019030 con 0x7f89a40f5460 2022-02-02T21:49:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.059+0000 7f898b7fe700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 0x7f898c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.059+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8994081600 con 0x7f89a40f5460 2022-02-02T21:49:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.059+0000 7f89a27fc700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 0x7f898c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.059+0000 7f89a27fc700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 0x7f898c0672e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f8998004630 tx=0x7f8998009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.063+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f899404f750 con 0x7f89a40f5460 2022-02-02T21:49:58.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.294+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89a40fdcf0 con 0x7f89a40f5460 2022-02-02T21:49:58.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.294+0000 7f898b7fe700 1 -- 172.21.15.96:0/635742494 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8994052d70 con 0x7f89a40f5460 2022-02-02T21:49:58.300 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:49:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:49:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:49:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:49:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:49:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:49:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:49:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:49:58.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:49:58.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:49:58.307 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:49:58.307 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:49:58.308 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:49:58.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:49:58.309 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:49:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 msgr2=0x7f898c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 0x7f898c0672e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f8998004630 tx=0x7f8998009b30).stop 2022-02-02T21:49:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 msgr2=0x7f89a4109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 secure :-1 s=READY pgs=3196 cs=0 l=1 rev1=1 rx=0x7f899400c530 tx=0x7f8994007e10).stop 2022-02-02T21:49:58.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 shutdown_connections 2022-02-02T21:49:58.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f898c064e20 0x7f898c0672e0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a40f5460 0x7f89a4109a50 unknown :-1 s=CLOSED pgs=3196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 --2- 172.21.15.96:0/635742494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89a40f6700 0x7f89a410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 >> 172.21.15.96:0/635742494 conn(0x7f89a40f0bc0 msgr2=0x7f89a40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:58.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 shutdown_connections 2022-02-02T21:49:58.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.296+0000 7f89a936e700 1 -- 172.21.15.96:0/635742494 wait complete. 2022-02-02T21:49:58.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 -- 172.21.15.96:0/573150706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f55e0 msgr2=0x7f26040f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 --2- 172.21.15.96:0/573150706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f55e0 0x7f26040f5a00 secure :-1 s=READY pgs=3197 cs=0 l=1 rev1=1 rx=0x7f25ec004660 tx=0x7f25ec009b30).stop 2022-02-02T21:49:58.397 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:58 smithi096 ceph-mon[101353]: pgmap v6235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:58.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 -- 172.21.15.96:0/573150706 shutdown_connections 2022-02-02T21:49:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 --2- 172.21.15.96:0/573150706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f5ef0 0x7f26040f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 --2- 172.21.15.96:0/573150706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f55e0 0x7f26040f5a00 unknown :-1 s=CLOSED pgs=3197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 -- 172.21.15.96:0/573150706 >> 172.21.15.96:0/573150706 conn(0x7f26040f0de0 msgr2=0x7f26040f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 -- 172.21.15.96:0/573150706 shutdown_connections 2022-02-02T21:49:58.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 -- 172.21.15.96:0/573150706 wait complete. 2022-02-02T21:49:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.394+0000 7f2609cb6700 1 Processor -- start 2022-02-02T21:49:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2609cb6700 1 -- start start 2022-02-02T21:49:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2609cb6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f55e0 0x7f2604106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2609cb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2609cb6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604107a00 con 0x7f26040f5ef0 2022-02-02T21:49:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2609cb6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604107b40 con 0x7f26040f55e0 2022-02-02T21:49:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45048/0 (socket says 172.21.15.96:45048) 2022-02-02T21:49:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 -- 172.21.15.96:0/729733917 learned_addr learned my addr 172.21.15.96:0/729733917 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:49:58.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f26037fe700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f55e0 0x7f2604106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 -- 172.21.15.96:0/729733917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f55e0 msgr2=0x7f2604106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f55e0 0x7f2604106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 -- 172.21.15.96:0/729733917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec005040 con 0x7f26040f5ef0 2022-02-02T21:49:58.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.395+0000 7f2602ffd700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 secure :-1 s=READY pgs=3198 cs=0 l=1 rev1=1 rx=0x7f25f400c530 tx=0x7f25f4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:58.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.396+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f400f650 con 0x7f26040f5ef0 2022-02-02T21:49:58.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.396+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26041084e0 con 0x7f26040f5ef0 2022-02-02T21:49:58.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.396+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25f400fc60 con 0x7f26040f5ef0 2022-02-02T21:49:58.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.396+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f4012c20 con 0x7f26040f5ef0 2022-02-02T21:49:58.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.396+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2604108aa0 con 0x7f26040f5ef0 2022-02-02T21:49:58.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.397+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f25f4010070 con 0x7f26040f5ef0 2022-02-02T21:49:58.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.397+0000 7f25fbfff700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 0x7f25f006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:49:58.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.397+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f25f4081710 con 0x7f26040f5ef0 2022-02-02T21:49:58.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.398+0000 7f26037fe700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 0x7f25f006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:49:58.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.398+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2604045ad0 con 0x7f26040f5ef0 2022-02-02T21:49:58.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.398+0000 7f26037fe700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 0x7f25f006b6a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f25ec004630 tx=0x7f25ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:49:58.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.402+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f25f4053240 con 0x7f26040f5ef0 2022-02-02T21:49:58.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:58 smithi159 ceph-mon[69013]: pgmap v6235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:49:58.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.607+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f26041090e0 con 0x7f26040f5ef0 2022-02-02T21:49:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.608+0000 7f25fbfff700 1 -- 172.21.15.96:0/729733917 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f25f4052e30 con 0x7f26040f5ef0 2022-02-02T21:49:58.610 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:49:58.610 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:49:58.611 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:49:58.611 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:49:58.612 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:58.612 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:49:58.612 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:49:58.613 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:49:58.613 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:49:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:49:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:49:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:49:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:49:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:49:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:49:58.616 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:49:58.616 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:49:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:49:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:49:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:49:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:49:58.618 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:49:58.618 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:49:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:49:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:49:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:49:58.620 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:49:58.620 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:49:58.620 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:49:58.621 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:49:58.621 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:49:58.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:49:58.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:58.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:58.623 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:49:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:49:58.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:58.624 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:58.624 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:49:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 msgr2=0x7f25f006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 0x7f25f006b6a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f25ec004630 tx=0x7f25ec009b30).stop 2022-02-02T21:49:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 msgr2=0x7f2604107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:49:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 secure :-1 s=READY pgs=3198 cs=0 l=1 rev1=1 rx=0x7f25f400c530 tx=0x7f25f4007e20).stop 2022-02-02T21:49:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 shutdown_connections 2022-02-02T21:49:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f25f00691e0 0x7f25f006b6a0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26040f55e0 0x7f2604106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 --2- 172.21.15.96:0/729733917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26040f5ef0 0x7f2604107450 unknown :-1 s=CLOSED pgs=3198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:49:58.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.609+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 >> 172.21.15.96:0/729733917 conn(0x7f26040f0de0 msgr2=0x7f260405ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:49:58.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.610+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 shutdown_connections 2022-02-02T21:49:58.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:49:58.610+0000 7f2609cb6700 1 -- 172.21.15.96:0/729733917 wait complete. 2022-02-02T21:49:58.629 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:49:59.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:59 smithi159 ceph-mon[69013]: from='client.40494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:59 smithi159 ceph-mon[69013]: from='client.40498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/635742494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:49:59.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:49:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/729733917' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:49:59.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:59 smithi096 ceph-mon[101353]: from='client.40494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:59.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:59 smithi096 ceph-mon[101353]: from='client.40498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:49:59.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/635742494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:49:59.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:49:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/729733917' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:50:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:00 smithi159 ceph-mon[69013]: pgmap v6236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:50:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:00 smithi096 ceph-mon[101353]: pgmap v6236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:00.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T21:50:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:02 smithi159 ceph-mon[69013]: pgmap v6237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:02 smithi096 ceph-mon[101353]: pgmap v6237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:04 smithi159 ceph-mon[69013]: pgmap v6238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:04 smithi096 ceph-mon[101353]: pgmap v6238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:06 smithi159 ceph-mon[69013]: pgmap v6239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:06 smithi096 ceph-mon[101353]: pgmap v6239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:08 smithi159 ceph-mon[69013]: pgmap v6240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:08 smithi096 ceph-mon[101353]: pgmap v6240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:10 smithi159 ceph-mon[69013]: pgmap v6241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:10 smithi096 ceph-mon[101353]: pgmap v6241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:12 smithi159 ceph-mon[69013]: pgmap v6242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:12 smithi096 ceph-mon[101353]: pgmap v6242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:14 smithi159 ceph-mon[69013]: pgmap v6243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:14 smithi096 ceph-mon[101353]: pgmap v6243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:16 smithi159 ceph-mon[69013]: pgmap v6244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:16 smithi096 ceph-mon[101353]: pgmap v6244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:18 smithi159 ceph-mon[69013]: pgmap v6245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:18 smithi096 ceph-mon[101353]: pgmap v6245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:20 smithi159 ceph-mon[69013]: pgmap v6246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:20 smithi096 ceph-mon[101353]: pgmap v6246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:22 smithi159 ceph-mon[69013]: pgmap v6247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:22 smithi096 ceph-mon[101353]: pgmap v6247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:24 smithi159 ceph-mon[69013]: pgmap v6248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:24 smithi096 ceph-mon[101353]: pgmap v6248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:26 smithi159 ceph-mon[69013]: pgmap v6249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:26 smithi096 ceph-mon[101353]: pgmap v6249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:28 smithi159 ceph-mon[69013]: pgmap v6250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:50:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:50:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:28 smithi096 ceph-mon[101353]: pgmap v6250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:50:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:50:28.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 -- 172.21.15.96:0/3707897334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 msgr2=0x7f06100f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:28.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 --2- 172.21.15.96:0/3707897334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06100f4ea0 secure :-1 s=READY pgs=3199 cs=0 l=1 rev1=1 rx=0x7f06000099e0 tx=0x7f0600004d10).stop 2022-02-02T21:50:28.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 -- 172.21.15.96:0/3707897334 shutdown_connections 2022-02-02T21:50:28.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 --2- 172.21.15.96:0/3707897334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 0x7f06100fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 --2- 172.21.15.96:0/3707897334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06100f4ea0 unknown :-1 s=CLOSED pgs=3199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 -- 172.21.15.96:0/3707897334 >> 172.21.15.96:0/3707897334 conn(0x7f06100f04c0 msgr2=0x7f06100f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 -- 172.21.15.96:0/3707897334 shutdown_connections 2022-02-02T21:50:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.720+0000 7f06161f3700 1 -- 172.21.15.96:0/3707897334 wait complete. 2022-02-02T21:50:28.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 Processor -- start 2022-02-02T21:50:28.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 -- start start 2022-02-02T21:50:28.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:28.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 0x7f06101075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:28.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610107b90 con 0x7f06100f4a80 2022-02-02T21:50:28.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.721+0000 7f06161f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610107cd0 con 0x7f06100f5420 2022-02-02T21:50:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45064/0 (socket says 172.21.15.96:45064) 2022-02-02T21:50:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 -- 172.21.15.96:0/358890710 learned_addr learned my addr 172.21.15.96:0/358890710 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:50:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060effd700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 0x7f06101075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 -- 172.21.15.96:0/358890710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 msgr2=0x7f06101075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 0x7f06101075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 -- 172.21.15.96:0/358890710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009640 con 0x7f06100f4a80 2022-02-02T21:50:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f060f7fe700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 secure :-1 s=READY pgs=3200 cs=0 l=1 rev1=1 rx=0x7f06000078d0 tx=0x7f0600004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:28.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060000e030 con 0x7f06100f4a80 2022-02-02T21:50:28.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0610108610 con 0x7f06100f4a80 2022-02-02T21:50:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0600007d70 con 0x7f06100f4a80 2022-02-02T21:50:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0600018070 con 0x7f06100f4a80 2022-02-02T21:50:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.722+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0610108af0 con 0x7f06100f4a80 2022-02-02T21:50:28.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.723+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610045ad0 con 0x7f06100f4a80 2022-02-02T21:50:28.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.724+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f060001da40 con 0x7f06100f4a80 2022-02-02T21:50:28.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.724+0000 7f0607fff700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 0x7f05fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.724+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0600083860 con 0x7f06100f4a80 2022-02-02T21:50:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.724+0000 7f060effd700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 0x7f05fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.725+0000 7f060effd700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 0x7f05fc067290 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f05f80041d0 tx=0x7f05f8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:28.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.728+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0600055330 con 0x7f06100f4a80 2022-02-02T21:50:28.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.908+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0610100ec0 con 0x7f05fc064dd0 2022-02-02T21:50:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.909+0000 7f0607fff700 1 -- 172.21.15.96:0/358890710 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0610100ec0 con 0x7f05fc064dd0 2022-02-02T21:50:28.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.910+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 msgr2=0x7f05fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:28.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.910+0000 7f06161f3700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 0x7f05fc067290 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f05f80041d0 tx=0x7f05f8009040).stop 2022-02-02T21:50:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.910+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 msgr2=0x7f06101070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.910+0000 7f06161f3700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 secure :-1 s=READY pgs=3200 cs=0 l=1 rev1=1 rx=0x7f06000078d0 tx=0x7f0600004d10).stop 2022-02-02T21:50:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 shutdown_connections 2022-02-02T21:50:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f05fc064dd0 0x7f05fc067290 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06100f4a80 0x7f06101070f0 unknown :-1 s=CLOSED pgs=3200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 --2- 172.21.15.96:0/358890710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06100f5420 0x7f06101075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 >> 172.21.15.96:0/358890710 conn(0x7f06100f04c0 msgr2=0x7f06100f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:28.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 shutdown_connections 2022-02-02T21:50:28.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:28.911+0000 7f06161f3700 1 -- 172.21.15.96:0/358890710 wait complete. 2022-02-02T21:50:28.920 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:50:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.007+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2085512553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 msgr2=0x7ff8ec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.007+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2085512553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec0f6b00 secure :-1 s=READY pgs=3201 cs=0 l=1 rev1=1 rx=0x7ff8e8004660 tx=0x7ff8e8009b30).stop 2022-02-02T21:50:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2085512553 shutdown_connections 2022-02-02T21:50:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2085512553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 0x7ff8ec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2085512553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec0f6b00 unknown :-1 s=CLOSED pgs=3201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2085512553 >> 172.21.15.96:0/2085512553 conn(0x7ff8ec0f1e40 msgr2=0x7ff8ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2085512553 shutdown_connections 2022-02-02T21:50:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2085512553 wait complete. 2022-02-02T21:50:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.008+0000 7ff8f41cd700 1 Processor -- start 2022-02-02T21:50:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f41cd700 1 -- start start 2022-02-02T21:50:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f41cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f41cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 0x7ff8ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f41cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec06a380 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f41cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec06a4c0 con 0x7ff8ec0f7980 2022-02-02T21:50:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45074/0 (socket says 172.21.15.96:45074) 2022-02-02T21:50:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 -- 172.21.15.96:0/2233685083 learned_addr learned my addr 172.21.15.96:0/2233685083 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:50:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1768700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 0x7ff8ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 -- 172.21.15.96:0/2233685083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 msgr2=0x7ff8ec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 0x7ff8ec069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 -- 172.21.15.96:0/2233685083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8005040 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.009+0000 7ff8f1f69700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 secure :-1 s=READY pgs=3202 cs=0 l=1 rev1=1 rx=0x7ff8e8004f60 tx=0x7ff8e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.010+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8e8018070 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.010+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec06a740 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.010+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8e8009770 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.010+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8e801c3c0 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.010+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec06aca0 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.011+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d4004fa0 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.011+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff8e801d420 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.012+0000 7ff8e27fc700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 0x7ff8d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.012+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff8e80837d0 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.012+0000 7ff8f1768700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 0x7ff8d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.012+0000 7ff8f1768700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 0x7ff8d8067290 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7ff8dc0041d0 tx=0x7ff8dc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.016+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff8e8051990 con 0x7ff8ec0f66e0 2022-02-02T21:50:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.189+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d4000bc0 con 0x7ff8d8064dd0 2022-02-02T21:50:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.199+0000 7ff8e27fc700 1 -- 172.21.15.96:0/2233685083 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff8d4000bc0 con 0x7ff8d8064dd0 2022-02-02T21:50:29.201 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:50:29.201 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:50:29.201 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:50:29.202 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:50:29.202 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:50:29.203 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:50:29.203 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:50:29.203 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:50:29.204 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:50:29.204 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:50:29.204 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:50:29.205 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:50:29.205 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:50:29.205 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:50:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:50:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:50:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:50:29.207 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:50:29.207 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:50:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:50:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:50:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:50:29.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 msgr2=0x7ff8d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 0x7ff8d8067290 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7ff8dc0041d0 tx=0x7ff8dc009040).stop 2022-02-02T21:50:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 msgr2=0x7ff8ec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 secure :-1 s=READY pgs=3202 cs=0 l=1 rev1=1 rx=0x7ff8e8004f60 tx=0x7ff8e8009b30).stop 2022-02-02T21:50:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 shutdown_connections 2022-02-02T21:50:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff8d8064dd0 0x7ff8d8067290 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ec0f66e0 0x7ff8ec06b9a0 unknown :-1 s=CLOSED pgs=3202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 --2- 172.21.15.96:0/2233685083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ec0f7980 0x7ff8ec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 >> 172.21.15.96:0/2233685083 conn(0x7ff8ec0f1e40 msgr2=0x7ff8ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 shutdown_connections 2022-02-02T21:50:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.201+0000 7ff8f41cd700 1 -- 172.21.15.96:0/2233685083 wait complete. 2022-02-02T21:50:29.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 -- 172.21.15.96:0/2264722578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f6860 msgr2=0x7fd1380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/2264722578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f6860 0x7fd1380f6cc0 secure :-1 s=READY pgs=3203 cs=0 l=1 rev1=1 rx=0x7fd134004660 tx=0x7fd134009b30).stop 2022-02-02T21:50:29.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 -- 172.21.15.96:0/2264722578 shutdown_connections 2022-02-02T21:50:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/2264722578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f6860 0x7fd1380f6cc0 unknown :-1 s=CLOSED pgs=3203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/2264722578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f55c0 0x7fd1380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:50:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 -- 172.21.15.96:0/2264722578 >> 172.21.15.96:0/2264722578 conn(0x7fd1380f0d40 msgr2=0x7fd1380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 -- 172.21.15.96:0/2264722578 shutdown_connections 2022-02-02T21:50:29.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.297+0000 7fd13fc2a700 1 -- 172.21.15.96:0/2264722578 wait complete. 2022-02-02T21:50:29.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 Processor -- start 2022-02-02T21:50:29.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 -- start start 2022-02-02T21:50:29.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd1380f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13810aca0 con 0x7fd1380f55c0 2022-02-02T21:50:29.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13fc2a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13810ade0 con 0x7fd1380f6860 2022-02-02T21:50:29.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13d1c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13d1c5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:49190/0 (socket says 172.21.15.96:49190) 2022-02-02T21:50:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13d1c5700 1 -- 172.21.15.96:0/3647338499 learned_addr learned my addr 172.21.15.96:0/3647338499 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:50:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.298+0000 7fd13d1c5700 1 -- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 msgr2=0x7fd1380f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd13d1c5700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd1380f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:50:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd13d1c5700 1 -- 172.21.15.96:0/3647338499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134005040 con 0x7fd1380f6860 2022-02-02T21:50:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd13d1c5700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd134009990 tx=0x7fd134009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd134018070 con 0x7fd1380f6860 2022-02-02T21:50:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd134007ca0 con 0x7fd1380f6860 2022-02-02T21:50:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380f8180 con 0x7fd1380f6860 2022-02-02T21:50:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13401c620 con 0x7fd1380f6860 2022-02-02T21:50:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.299+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380f86e0 con 0x7fd1380f6860 2022-02-02T21:50:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.300+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138045ad0 con 0x7fd1380f6860 2022-02-02T21:50:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.300+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd13401d960 con 0x7fd1380f6860 2022-02-02T21:50:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.301+0000 7fd12a7fc700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.301+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1340837e0 con 0x7fd1380f6860 2022-02-02T21:50:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.301+0000 7fd13d9c6700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.302+0000 7fd13d9c6700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fd1380f94b0 tx=0x7fd12c006ab0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.305+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1340519a0 con 0x7fd1380f6860 2022-02-02T21:50:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.538+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd138113bc0 con 0x7fd1380f6860 2022-02-02T21:50:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.539+0000 7fd12a7fc700 1 -- 172.21.15.96:0/3647338499 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd134054fc0 con 0x7fd1380f6860 2022-02-02T21:50:29.540 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:50:29.540 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:50:29.540 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:50:29.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:50:29.541 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:50:29.542 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:50:29.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:50:29.542 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:50:29.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:50:29.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:50:29.544 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:50:29.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:50:29.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:50:29.545 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:50:29.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:50:29.546 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:50:29.546 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:50:29.547 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:50:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 msgr2=0x7fd124067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fd1380f94b0 tx=0x7fd12c006ab0).stop 2022-02-02T21:50:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 msgr2=0x7fd1380f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd134009990 tx=0x7fd134009b30).stop 2022-02-02T21:50:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 shutdown_connections 2022-02-02T21:50:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd124064dd0 0x7fd124067290 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1380f55c0 0x7fd1380f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:50:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 --2- 172.21.15.96:0/3647338499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1380f6860 0x7fd1380f7ba0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 >> 172.21.15.96:0/3647338499 conn(0x7fd1380f0d40 msgr2=0x7fd13805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 shutdown_connections 2022-02-02T21:50:29.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.541+0000 7fd13fc2a700 1 -- 172.21.15.96:0/3647338499 wait complete. 2022-02-02T21:50:29.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.639+0000 7f83b8f39700 1 -- 172.21.15.96:0/2133026149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f7980 msgr2=0x7f83b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 --2- 172.21.15.96:0/2133026149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f7980 0x7f83b40f7de0 secure :-1 s=READY pgs=3204 cs=0 l=1 rev1=1 rx=0x7f83a8004660 tx=0x7f83a8009b30).stop 2022-02-02T21:50:29.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 -- 172.21.15.96:0/2133026149 shutdown_connections 2022-02-02T21:50:29.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 --2- 172.21.15.96:0/2133026149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f7980 0x7f83b40f7de0 unknown :-1 s=CLOSED pgs=3204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 --2- 172.21.15.96:0/2133026149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f66e0 0x7f83b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 -- 172.21.15.96:0/2133026149 >> 172.21.15.96:0/2133026149 conn(0x7f83b40f1e40 msgr2=0x7f83b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 -- 172.21.15.96:0/2133026149 shutdown_connections 2022-02-02T21:50:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 -- 172.21.15.96:0/2133026149 wait complete. 2022-02-02T21:50:29.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 Processor -- start 2022-02-02T21:50:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.640+0000 7f83b8f39700 1 -- start start 2022-02-02T21:50:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f7980 0x7f83b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b406a380 con 0x7f83b40f66e0 2022-02-02T21:50:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b406a4c0 con 0x7f83b40f7980 2022-02-02T21:50:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45094/0 (socket says 172.21.15.96:45094) 2022-02-02T21:50:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 -- 172.21.15.96:0/583915225 learned_addr learned my addr 172.21.15.96:0/583915225 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:50:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b1d9b700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f7980 0x7f83b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 -- 172.21.15.96:0/583915225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f7980 msgr2=0x7f83b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f7980 0x7f83b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 -- 172.21.15.96:0/583915225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8005040 con 0x7f83b40f66e0 2022-02-02T21:50:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b259c700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 secure :-1 s=READY pgs=3205 cs=0 l=1 rev1=1 rx=0x7f83a400c790 tx=0x7f83a4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a400e680 con 0x7f83b40f66e0 2022-02-02T21:50:29.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83a400ec90 con 0x7f83b40f66e0 2022-02-02T21:50:29.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b406a7a0 con 0x7f83b40f66e0 2022-02-02T21:50:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a4012d00 con 0x7f83b40f66e0 2022-02-02T21:50:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.641+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b410ef90 con 0x7f83b40f66e0 2022-02-02T21:50:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.642+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4045ad0 con 0x7f83b40f66e0 2022-02-02T21:50:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.643+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83a4010070 con 0x7f83b40f66e0 2022-02-02T21:50:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.643+0000 7f83a2ffd700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 0x7f839c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.643+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83a4081b30 con 0x7f83b40f66e0 2022-02-02T21:50:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.643+0000 7f83b1d9b700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 0x7f839c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.644+0000 7f83b1d9b700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 0x7f839c067290 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f83a8004e30 tx=0x7f83a8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.648+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83a404fc30 con 0x7f83b40f66e0 2022-02-02T21:50:29.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.848+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83b40fef70 con 0x7f83b40f66e0 2022-02-02T21:50:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.849+0000 7f83a2ffd700 1 -- 172.21.15.96:0/583915225 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f83a4053250 con 0x7f83b40f66e0 2022-02-02T21:50:29.849 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:50:29.850 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:50:29.850 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:50:29.850 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:50:29.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:50:29.851 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:50:29.851 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:50:29.852 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:50:29.852 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:50:29.852 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:50:29.853 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:50:29.853 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:50:29.853 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:50:29.854 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:50:29.854 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:50:29.854 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:50:29.855 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:50:29.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:50:29.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:50:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:50:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:50:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:50:29.857 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:50:29.857 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:50:29.857 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:50:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:50:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:50:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:50:29.859 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:50:29.859 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:50:29.860 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:50:29.860 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:50:29.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:50:29.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:50:29.861 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:50:29.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:50:29.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:50:29.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:50:29.863 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:50:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 msgr2=0x7f839c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 0x7f839c067290 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f83a8004e30 tx=0x7f83a8009b30).stop 2022-02-02T21:50:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 msgr2=0x7f83b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 secure :-1 s=READY pgs=3205 cs=0 l=1 rev1=1 rx=0x7f83a400c790 tx=0x7f83a4007d90).stop 2022-02-02T21:50:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 shutdown_connections 2022-02-02T21:50:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f839c064dd0 0x7f839c067290 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83b40f66e0 0x7f83b406b9a0 unknown :-1 s=CLOSED pgs=3205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 --2- 172.21.15.96:0/583915225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83b40f7980 0x7f83b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.850+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 >> 172.21.15.96:0/583915225 conn(0x7f83b40f1e40 msgr2=0x7f83b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.851+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 shutdown_connections 2022-02-02T21:50:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:29.851+0000 7f83b8f39700 1 -- 172.21.15.96:0/583915225 wait complete. 2022-02-02T21:50:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:50:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:30 smithi159 ceph-mon[69013]: pgmap v6251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:30 smithi159 ceph-mon[69013]: from='client.40510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:50:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:30 smithi159 ceph-mon[69013]: from='client.40514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:50:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3647338499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:50:30.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/583915225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:50:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:30 smithi096 ceph-mon[101353]: pgmap v6251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:30 smithi096 ceph-mon[101353]: from='client.40510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:50:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:30 smithi096 ceph-mon[101353]: from='client.40514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:50:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3647338499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:50:30.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/583915225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:50:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:32 smithi159 ceph-mon[69013]: pgmap v6252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:32 smithi096 ceph-mon[101353]: pgmap v6252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:34 smithi159 ceph-mon[69013]: pgmap v6253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:34 smithi096 ceph-mon[101353]: pgmap v6253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:36 smithi159 ceph-mon[69013]: pgmap v6254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:36 smithi096 ceph-mon[101353]: pgmap v6254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:38.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:38 smithi159 ceph-mon[69013]: pgmap v6255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:38 smithi096 ceph-mon[101353]: pgmap v6255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:40.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:40 smithi159 ceph-mon[69013]: pgmap v6256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:40 smithi096 ceph-mon[101353]: pgmap v6256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:42.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:42 smithi159 ceph-mon[69013]: pgmap v6257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:42 smithi096 ceph-mon[101353]: pgmap v6257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:44 smithi159 ceph-mon[69013]: pgmap v6258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:44 smithi096 ceph-mon[101353]: pgmap v6258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:46 smithi159 ceph-mon[69013]: pgmap v6259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:46 smithi096 ceph-mon[101353]: pgmap v6259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:48 smithi159 ceph-mon[69013]: pgmap v6260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:48 smithi096 ceph-mon[101353]: pgmap v6260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:50 smithi159 ceph-mon[69013]: pgmap v6261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:50 smithi096 ceph-mon[101353]: pgmap v6261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:52 smithi159 ceph-mon[69013]: pgmap v6262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:52 smithi096 ceph-mon[101353]: pgmap v6262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:54 smithi159 ceph-mon[69013]: pgmap v6263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:54 smithi096 ceph-mon[101353]: pgmap v6263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:56 smithi159 ceph-mon[69013]: pgmap v6264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:56 smithi096 ceph-mon[101353]: pgmap v6264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:50:58 smithi159 ceph-mon[69013]: pgmap v6265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:50:58 smithi096 ceph-mon[101353]: pgmap v6265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:50:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 -- 172.21.15.96:0/3629773968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 msgr2=0x7f0ce00f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 --2- 172.21.15.96:0/3629773968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce00f9340 secure :-1 s=READY pgs=3206 cs=0 l=1 rev1=1 rx=0x7f0cd0004660 tx=0x7f0cd0009b30).stop 2022-02-02T21:50:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 -- 172.21.15.96:0/3629773968 shutdown_connections 2022-02-02T21:50:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 --2- 172.21.15.96:0/3629773968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 0x7f0ce00fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 --2- 172.21.15.96:0/3629773968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce00f9340 unknown :-1 s=CLOSED pgs=3206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:59.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 -- 172.21.15.96:0/3629773968 >> 172.21.15.96:0/3629773968 conn(0x7f0ce00f0d40 msgr2=0x7f0ce00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:50:59.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 -- 172.21.15.96:0/3629773968 shutdown_connections 2022-02-02T21:50:59.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.961+0000 7f0ce8054700 1 -- 172.21.15.96:0/3629773968 wait complete. 2022-02-02T21:50:59.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 Processor -- start 2022-02-02T21:50:59.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 -- start start 2022-02-02T21:50:59.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:59.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 0x7f0ce0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:59.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0107a00 con 0x7f0ce0060270 2022-02-02T21:50:59.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce8054700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0107b40 con 0x7f0ce00f9830 2022-02-02T21:50:59.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce5df0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:59.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce5df0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45112/0 (socket says 172.21.15.96:45112) 2022-02-02T21:50:59.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce5df0700 1 -- 172.21.15.96:0/2163181149 learned_addr learned my addr 172.21.15.96:0/2163181149 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:50:59.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.962+0000 7f0ce55ef700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 0x7f0ce0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:59.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce5df0700 1 -- 172.21.15.96:0/2163181149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 msgr2=0x7f0ce0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:50:59.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce5df0700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 0x7f0ce0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:50:59.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce5df0700 1 -- 172.21.15.96:0/2163181149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0005040 con 0x7f0ce0060270 2022-02-02T21:50:59.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce5df0700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 secure :-1 s=READY pgs=3207 cs=0 l=1 rev1=1 rx=0x7f0cd0009990 tx=0x7f0cd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:59.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd0018070 con 0x7f0ce0060270 2022-02-02T21:50:59.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cd0007ba0 con 0x7f0ce0060270 2022-02-02T21:50:59.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce0108480 con 0x7f0ce0060270 2022-02-02T21:50:59.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd001c3c0 con 0x7f0ce0060270 2022-02-02T21:50:59.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.963+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce01089e0 con 0x7f0ce0060270 2022-02-02T21:50:59.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.964+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0045ad0 con 0x7f0ce0060270 2022-02-02T21:50:59.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.964+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0cd001d420 con 0x7f0ce0060270 2022-02-02T21:50:59.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.965+0000 7f0cd67fc700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 0x7f0ccc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:50:59.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.965+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0cd00837d0 con 0x7f0ce0060270 2022-02-02T21:50:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.965+0000 7f0ce55ef700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 0x7f0ccc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:50:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.965+0000 7f0ce55ef700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 0x7f0ccc067290 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f0ce0060040 tx=0x7f0cdc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:50:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:50:59.969+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0cd00553c0 con 0x7f0ce0060270 2022-02-02T21:51:00.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.147+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ce00ff030 con 0x7f0ccc064dd0 2022-02-02T21:51:00.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.149+0000 7f0cd67fc700 1 -- 172.21.15.96:0/2163181149 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0ce00ff030 con 0x7f0ccc064dd0 2022-02-02T21:51:00.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 msgr2=0x7f0ccc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 0x7f0ccc067290 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f0ce0060040 tx=0x7f0cdc00b040).stop 2022-02-02T21:51:00.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 msgr2=0x7f0ce0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 secure :-1 s=READY pgs=3207 cs=0 l=1 rev1=1 rx=0x7f0cd0009990 tx=0x7f0cd0009b30).stop 2022-02-02T21:51:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 shutdown_connections 2022-02-02T21:51:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ccc064dd0 0x7f0ccc067290 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce0060270 0x7f0ce0106f60 unknown :-1 s=CLOSED pgs=3207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 --2- 172.21.15.96:0/2163181149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce00f9830 0x7f0ce0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 >> 172.21.15.96:0/2163181149 conn(0x7f0ce00f0d40 msgr2=0x7f0ce00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.150+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 shutdown_connections 2022-02-02T21:51:00.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.151+0000 7f0ce8054700 1 -- 172.21.15.96:0/2163181149 wait complete. 2022-02-02T21:51:00.302 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:51:00.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.248+0000 7fb619679700 1 -- 172.21.15.96:0/2340673983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6140f9690 msgr2=0x7fb6140fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.248+0000 7fb619679700 1 --2- 172.21.15.96:0/2340673983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6140f9690 0x7fb6140fbae0 secure :-1 s=READY pgs=3208 cs=0 l=1 rev1=1 rx=0x7fb5fc004660 tx=0x7fb5fc009b30).stop 2022-02-02T21:51:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 -- 172.21.15.96:0/2340673983 shutdown_connections 2022-02-02T21:51:00.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 --2- 172.21.15.96:0/2340673983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6140f9690 0x7fb6140fbae0 unknown :-1 s=CLOSED pgs=3208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 --2- 172.21.15.96:0/2340673983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb614060310 0x7fb6140f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 -- 172.21.15.96:0/2340673983 >> 172.21.15.96:0/2340673983 conn(0x7fb6140f0b90 msgr2=0x7fb6140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:00 smithi096 ceph-mon[101353]: pgmap v6266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:00.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 -- 172.21.15.96:0/2340673983 shutdown_connections 2022-02-02T21:51:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 -- 172.21.15.96:0/2340673983 wait complete. 2022-02-02T21:51:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 Processor -- start 2022-02-02T21:51:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.249+0000 7fb619679700 1 -- start start 2022-02-02T21:51:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb619679700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb619679700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 0x7fb614107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb619679700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb614107890 con 0x7fb614060310 2022-02-02T21:51:00.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb619679700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141080d0 con 0x7fb6140f9690 2022-02-02T21:51:00.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45122/0 (socket says 172.21.15.96:45122) 2022-02-02T21:51:00.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 -- 172.21.15.96:0/3317035017 learned_addr learned my addr 172.21.15.96:0/3317035017 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:00.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb6137fe700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 0x7fb614107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 -- 172.21.15.96:0/3317035017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 msgr2=0x7fb614107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 0x7fb614107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 -- 172.21.15.96:0/3317035017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc005040 con 0x7fb614060310 2022-02-02T21:51:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb6137fe700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 0x7fb614107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:51:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb613fff700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 secure :-1 s=READY pgs=3209 cs=0 l=1 rev1=1 rx=0x7fb60400c530 tx=0x7fb604007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60400f650 con 0x7fb614060310 2022-02-02T21:51:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb60400fc60 con 0x7fb614060310 2022-02-02T21:51:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb604012cd0 con 0x7fb614060310 2022-02-02T21:51:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.250+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6141083b0 con 0x7fb614060310 2022-02-02T21:51:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.251+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6141088f0 con 0x7fb614060310 2022-02-02T21:51:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.252+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb614059100 con 0x7fb614060310 2022-02-02T21:51:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.252+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb604010070 con 0x7fb614060310 2022-02-02T21:51:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.252+0000 7fb610ff9700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 0x7fb6000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.252+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb6040817b0 con 0x7fb614060310 2022-02-02T21:51:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.252+0000 7fb6137fe700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 0x7fb6000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.253+0000 7fb6137fe700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 0x7fb6000672e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fb5fc004e30 tx=0x7fb5fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.257+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb60404f8b0 con 0x7fb614060310 2022-02-02T21:51:00.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.428+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6140fee60 con 0x7fb600064e20 2022-02-02T21:51:00.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.437+0000 7fb610ff9700 1 -- 172.21.15.96:0/3317035017 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb6140fee60 con 0x7fb600064e20 2022-02-02T21:51:00.438 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:51:00.438 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:51:00.439 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:51:00.439 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:51:00.439 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:51:00.440 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:51:00.440 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:51:00.440 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:51:00.441 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:51:00.441 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:51:00.441 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:51:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:51:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:51:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:51:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:51:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:51:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:51:00.444 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:51:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:51:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:51:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:51:00.446 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:51:00.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 msgr2=0x7fb6000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 0x7fb6000672e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fb5fc004e30 tx=0x7fb5fc009b30).stop 2022-02-02T21:51:00.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 msgr2=0x7fb614106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 secure :-1 s=READY pgs=3209 cs=0 l=1 rev1=1 rx=0x7fb60400c530 tx=0x7fb604007e20).stop 2022-02-02T21:51:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 shutdown_connections 2022-02-02T21:51:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb600064e20 0x7fb6000672e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb614060310 0x7fb614106da0 unknown :-1 s=CLOSED pgs=3209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 --2- 172.21.15.96:0/3317035017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6140f9690 0x7fb614107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 >> 172.21.15.96:0/3317035017 conn(0x7fb6140f0b90 msgr2=0x7fb6140f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 shutdown_connections 2022-02-02T21:51:00.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.439+0000 7fb619679700 1 -- 172.21.15.96:0/3317035017 wait complete. 2022-02-02T21:51:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:00 smithi159 ceph-mon[69013]: pgmap v6266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:00.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 -- 172.21.15.96:0/2255698822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 msgr2=0x7f85c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 --2- 172.21.15.96:0/2255698822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c40f59e0 secure :-1 s=READY pgs=3210 cs=0 l=1 rev1=1 rx=0x7f85bc004660 tx=0x7f85bc009b30).stop 2022-02-02T21:51:00.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 -- 172.21.15.96:0/2255698822 shutdown_connections 2022-02-02T21:51:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 --2- 172.21.15.96:0/2255698822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 0x7f85c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:51:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 --2- 172.21.15.96:0/2255698822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c40f59e0 unknown :-1 s=CLOSED pgs=3210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 -- 172.21.15.96:0/2255698822 >> 172.21.15.96:0/2255698822 conn(0x7f85c40f0d40 msgr2=0x7f85c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 -- 172.21.15.96:0/2255698822 shutdown_connections 2022-02-02T21:51:00.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.536+0000 7f85c9892700 1 -- 172.21.15.96:0/2255698822 wait complete. 2022-02-02T21:51:00.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 Processor -- start 2022-02-02T21:51:00.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 -- start start 2022-02-02T21:51:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 0x7f85c4107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4107ac0 con 0x7f85c40f55c0 2022-02-02T21:51:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c9892700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4108370 con 0x7f85c40f6860 2022-02-02T21:51:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45132/0 (socket says 172.21.15.96:45132) 2022-02-02T21:51:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 -- 172.21.15.96:0/4091924741 learned_addr learned my addr 172.21.15.96:0/4091924741 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c27fc700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 0x7f85c4107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 -- 172.21.15.96:0/4091924741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 msgr2=0x7f85c4107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 0x7f85c4107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.537+0000 7f85c2ffd700 1 -- 172.21.15.96:0/4091924741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc005040 con 0x7f85c40f55c0 2022-02-02T21:51:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85c2ffd700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 secure :-1 s=READY pgs=3211 cs=0 l=1 rev1=1 rx=0x7f85bc004f60 tx=0x7f85bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85bc018070 con 0x7f85c40f55c0 2022-02-02T21:51:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85bc009770 con 0x7f85c40f55c0 2022-02-02T21:51:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85bc01c3c0 con 0x7f85c40f55c0 2022-02-02T21:51:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c41085f0 con 0x7f85c40f55c0 2022-02-02T21:51:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.538+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4108b50 con 0x7f85c40f55c0 2022-02-02T21:51:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.539+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c40f49b0 con 0x7f85c40f55c0 2022-02-02T21:51:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.539+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85bc01d420 con 0x7f85c40f55c0 2022-02-02T21:51:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.540+0000 7f85bb7fe700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 0x7f85b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.540+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85bc083880 con 0x7f85c40f55c0 2022-02-02T21:51:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.540+0000 7f85c27fc700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 0x7f85b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.540+0000 7f85c27fc700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 0x7f85b0067290 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f85ac006fd0 tx=0x7f85ac008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.544+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85bc055470 con 0x7f85c40f55c0 2022-02-02T21:51:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.774+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85c4045ad0 con 0x7f85c40f55c0 2022-02-02T21:51:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.775+0000 7f85bb7fe700 1 -- 172.21.15.96:0/4091924741 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f85bc055060 con 0x7f85c40f55c0 2022-02-02T21:51:00.776 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:51:00.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:51:00.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:51:00.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:00.778 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:51:00.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:51:00.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:00.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:51:00.779 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:51:00.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:00.780 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:51:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:51:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:51:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:51:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:51:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:51:00.783 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:51:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 msgr2=0x7f85b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 0x7f85b0067290 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f85ac006fd0 tx=0x7f85ac008040).stop 2022-02-02T21:51:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 msgr2=0x7f85c4106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 secure :-1 s=READY pgs=3211 cs=0 l=1 rev1=1 rx=0x7f85bc004f60 tx=0x7f85bc009b30).stop 2022-02-02T21:51:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 shutdown_connections 2022-02-02T21:51:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85b0064dd0 0x7f85b0067290 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f55c0 0x7f85c4106f90 unknown :-1 s=CLOSED pgs=3211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 --2- 172.21.15.96:0/4091924741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f6860 0x7f85c4107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.776+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 >> 172.21.15.96:0/4091924741 conn(0x7f85c40f0d40 msgr2=0x7f85c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.777+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 shutdown_connections 2022-02-02T21:51:00.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.777+0000 7f85c9892700 1 -- 172.21.15.96:0/4091924741 wait complete. 2022-02-02T21:51:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- 172.21.15.96:0/4061764089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 msgr2=0x7fa8a80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 --2- 172.21.15.96:0/4061764089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80fbae0 secure :-1 s=READY pgs=3212 cs=0 l=1 rev1=1 rx=0x7fa890004660 tx=0x7fa890009b30).stop 2022-02-02T21:51:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- 172.21.15.96:0/4061764089 shutdown_connections 2022-02-02T21:51:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 --2- 172.21.15.96:0/4061764089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80fbae0 unknown :-1 s=CLOSED pgs=3212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 --2- 172.21.15.96:0/4061764089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 0x7fa8a80f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- 172.21.15.96:0/4061764089 >> 172.21.15.96:0/4061764089 conn(0x7fa8a80f0b90 msgr2=0x7fa8a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- 172.21.15.96:0/4061764089 shutdown_connections 2022-02-02T21:51:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- 172.21.15.96:0/4061764089 wait complete. 2022-02-02T21:51:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 Processor -- start 2022-02-02T21:51:00.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 -- start start 2022-02-02T21:51:00.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 0x7fa8a80f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.875+0000 7fa8acbbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8acbbe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80f55d0 con 0x7fa8a80f96f0 2022-02-02T21:51:00.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8acbbe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80f5710 con 0x7fa8a80602b0 2022-02-02T21:51:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45144/0 (socket says 172.21.15.96:45144) 2022-02-02T21:51:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 -- 172.21.15.96:0/3897641560 learned_addr learned my addr 172.21.15.96:0/3897641560 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8a77fe700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 0x7fa8a80f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 -- 172.21.15.96:0/3897641560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 msgr2=0x7fa8a80f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 0x7fa8a80f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 -- 172.21.15.96:0/3897641560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890005040 con 0x7fa8a80f96f0 2022-02-02T21:51:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa89ffff700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 rx=0x7fa890014040 tx=0x7fa89000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa890019070 con 0x7fa8a80f96f0 2022-02-02T21:51:00.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa890007e70 con 0x7fa8a80f96f0 2022-02-02T21:51:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8acbbe700 1 -- 172.21.15.96:0/3897641560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a80f5990 con 0x7fa8a80f96f0 2022-02-02T21:51:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa890014d10 con 0x7fa8a80f96f0 2022-02-02T21:51:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.876+0000 7fa8acbbe700 1 -- 172.21.15.96:0/3897641560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a80f5ef0 con 0x7fa8a80f96f0 2022-02-02T21:51:00.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.877+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa880004fa0 con 0x7fa8a80f96f0 2022-02-02T21:51:00.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.878+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa890025070 con 0x7fa8a80f96f0 2022-02-02T21:51:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.878+0000 7fa8a4ff9700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 0x7fa8940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:00.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.878+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa890082a20 con 0x7fa8a80f96f0 2022-02-02T21:51:00.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.878+0000 7fa8a77fe700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 0x7fa8940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:00.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.879+0000 7fa8a77fe700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 0x7fa8940672e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7fa8a80f6980 tx=0x7fa89800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:00.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:00.882+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa890050b20 con 0x7fa8a80f96f0 2022-02-02T21:51:01.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.085+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa880005e80 con 0x7fa8a80f96f0 2022-02-02T21:51:01.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.085+0000 7fa8a4ff9700 1 -- 172.21.15.96:0/3897641560 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa890023020 con 0x7fa8a80f96f0 2022-02-02T21:51:01.086 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:51:01.087 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:51:01.087 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:51:01.087 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:51:01.088 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:01.088 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:51:01.088 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:51:01.089 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:51:01.089 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:51:01.090 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:51:01.090 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:51:01.090 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:51:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:51:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:51:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:51:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:51:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:51:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:51:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:51:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:51:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:51:01.094 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:51:01.094 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:51:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:51:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:51:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:51:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:51:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:51:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:51:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:51:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:51:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:51:01.098 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:01.098 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:01.099 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:51:01.099 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:01.099 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:01.100 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:01.100 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:01.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 msgr2=0x7fa8940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 0x7fa8940672e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7fa8a80f6980 tx=0x7fa89800b040).stop 2022-02-02T21:51:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 msgr2=0x7fa8a80f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 rx=0x7fa890014040 tx=0x7fa89000b040).stop 2022-02-02T21:51:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 shutdown_connections 2022-02-02T21:51:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa894064e20 0x7fa8940672e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8a80602b0 0x7fa8a80f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 --2- 172.21.15.96:0/3897641560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a80f96f0 0x7fa8a80f5070 unknown :-1 s=CLOSED pgs=3213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 >> 172.21.15.96:0/3897641560 conn(0x7fa8a80f0b90 msgr2=0x7fa8a80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 shutdown_connections 2022-02-02T21:51:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:01.087+0000 7fa89dffb700 1 -- 172.21.15.96:0/3897641560 wait complete. 2022-02-02T21:51:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:51:01.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:01 smithi159 ceph-mon[69013]: from='client.40524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:01 smithi159 ceph-mon[69013]: from='client.40528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4091924741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:51:01.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3897641560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:51:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:01 smithi096 ceph-mon[101353]: from='client.40524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:01 smithi096 ceph-mon[101353]: from='client.40528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4091924741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:51:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3897641560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:51:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:02 smithi159 ceph-mon[69013]: pgmap v6267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:02 smithi096 ceph-mon[101353]: pgmap v6267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:04 smithi159 ceph-mon[69013]: pgmap v6268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:04 smithi096 ceph-mon[101353]: pgmap v6268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:06 smithi159 ceph-mon[69013]: pgmap v6269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:06.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:06 smithi096 ceph-mon[101353]: pgmap v6269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:08 smithi159 ceph-mon[69013]: pgmap v6270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:08 smithi096 ceph-mon[101353]: pgmap v6270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:10 smithi159 ceph-mon[69013]: pgmap v6271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:10.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:10 smithi096 ceph-mon[101353]: pgmap v6271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:12 smithi159 ceph-mon[69013]: pgmap v6272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:12 smithi096 ceph-mon[101353]: pgmap v6272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:14 smithi159 ceph-mon[69013]: pgmap v6273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:14 smithi096 ceph-mon[101353]: pgmap v6273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:16 smithi159 ceph-mon[69013]: pgmap v6274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:16 smithi096 ceph-mon[101353]: pgmap v6274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:18 smithi159 ceph-mon[69013]: pgmap v6275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:18 smithi096 ceph-mon[101353]: pgmap v6275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:20.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:20 smithi159 ceph-mon[69013]: pgmap v6276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:20 smithi096 ceph-mon[101353]: pgmap v6276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:22 smithi159 ceph-mon[69013]: pgmap v6277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:22 smithi096 ceph-mon[101353]: pgmap v6277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:24 smithi159 ceph-mon[69013]: pgmap v6278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:24 smithi096 ceph-mon[101353]: pgmap v6278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:26 smithi159 ceph-mon[69013]: pgmap v6279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:26 smithi096 ceph-mon[101353]: pgmap v6279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:28 smithi159 ceph-mon[69013]: pgmap v6280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:51:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:51:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:28 smithi096 ceph-mon[101353]: pgmap v6280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:51:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:51:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:30 smithi159 ceph-mon[69013]: pgmap v6281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:30 smithi096 ceph-mon[101353]: pgmap v6281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:31.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 -- 172.21.15.96:0/2599296505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 msgr2=0x7f40fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 --2- 172.21.15.96:0/2599296505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc0f6cc0 secure :-1 s=READY pgs=3214 cs=0 l=1 rev1=1 rx=0x7f40e8004660 tx=0x7f40e8009b30).stop 2022-02-02T21:51:31.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 -- 172.21.15.96:0/2599296505 shutdown_connections 2022-02-02T21:51:31.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 --2- 172.21.15.96:0/2599296505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc0f6cc0 unknown :-1 s=CLOSED pgs=3214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 --2- 172.21.15.96:0/2599296505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 0x7f40fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 -- 172.21.15.96:0/2599296505 >> 172.21.15.96:0/2599296505 conn(0x7f40fc0f0d40 msgr2=0x7f40fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 -- 172.21.15.96:0/2599296505 shutdown_connections 2022-02-02T21:51:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.196+0000 7f4102c0b700 1 -- 172.21.15.96:0/2599296505 wait complete. 2022-02-02T21:51:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 Processor -- start 2022-02-02T21:51:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 -- start start 2022-02-02T21:51:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 0x7f40fc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1069b0 con 0x7f40fc0f6860 2022-02-02T21:51:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.197+0000 7f4102c0b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1071c0 con 0x7f40fc0f55c0 2022-02-02T21:51:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45162/0 (socket says 172.21.15.96:45162) 2022-02-02T21:51:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 -- 172.21.15.96:0/3451686681 learned_addr learned my addr 172.21.15.96:0/3451686681 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f41009a7700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 0x7f40fc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 -- 172.21.15.96:0/3451686681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 msgr2=0x7f40fc105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 0x7f40fc105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 -- 172.21.15.96:0/3451686681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8005040 con 0x7f40fc0f6860 2022-02-02T21:51:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40fbfff700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 rx=0x7f40e8009990 tx=0x7f40e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40e801a070 con 0x7f40fc0f6860 2022-02-02T21:51:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc1073e0 con 0x7f40fc0f6860 2022-02-02T21:51:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40e8012a80 con 0x7f40fc0f6860 2022-02-02T21:51:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40e801f870 con 0x7f40fc0f6860 2022-02-02T21:51:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.198+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc107940 con 0x7f40fc0f6860 2022-02-02T21:51:31.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.199+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc0f49b0 con 0x7f40fc0f6860 2022-02-02T21:51:31.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.200+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40e8012bf0 con 0x7f40fc0f6860 2022-02-02T21:51:31.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.200+0000 7f40f97fa700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 0x7f40ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.200+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f40e8085c50 con 0x7f40fc0f6860 2022-02-02T21:51:31.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.200+0000 7f41009a7700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 0x7f40ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.201+0000 7f41009a7700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 0x7f40ec067290 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f40fc105c30 tx=0x7f40f0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.205+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40e8053e10 con 0x7f40fc0f6860 2022-02-02T21:51:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.386+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40fc05f620 con 0x7f40ec064dd0 2022-02-02T21:51:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.387+0000 7f40f97fa700 1 -- 172.21.15.96:0/3451686681 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f40fc05f620 con 0x7f40ec064dd0 2022-02-02T21:51:31.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 msgr2=0x7f40ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 0x7f40ec067290 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f40fc105c30 tx=0x7f40f0009040).stop 2022-02-02T21:51:31.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 msgr2=0x7f40fc1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 rx=0x7f40e8009990 tx=0x7f40e8009b30).stop 2022-02-02T21:51:31.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 shutdown_connections 2022-02-02T21:51:31.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40ec064dd0 0x7f40ec067290 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40fc0f55c0 0x7f40fc105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 --2- 172.21.15.96:0/3451686681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40fc0f6860 0x7f40fc1063b0 unknown :-1 s=CLOSED pgs=3215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 >> 172.21.15.96:0/3451686681 conn(0x7f40fc0f0d40 msgr2=0x7f40fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 shutdown_connections 2022-02-02T21:51:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.389+0000 7f4102c0b700 1 -- 172.21.15.96:0/3451686681 wait complete. 2022-02-02T21:51:31.400 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:51:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- 172.21.15.96:0/4113973072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f5bb0 msgr2=0x7f9fa00f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 --2- 172.21.15.96:0/4113973072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa00f5fd0 secure :-1 s=READY pgs=3216 cs=0 l=1 rev1=1 rx=0x7f9f90004660 tx=0x7f9f90009b30).stop 2022-02-02T21:51:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- 172.21.15.96:0/4113973072 shutdown_connections 2022-02-02T21:51:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 --2- 172.21.15.96:0/4113973072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f6550 0x7f9fa00f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:51:31.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 --2- 172.21.15.96:0/4113973072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa00f5fd0 unknown :-1 s=CLOSED pgs=3216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- 172.21.15.96:0/4113973072 >> 172.21.15.96:0/4113973072 conn(0x7f9fa00f04c0 msgr2=0x7f9fa00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:31.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- 172.21.15.96:0/4113973072 shutdown_connections 2022-02-02T21:51:31.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- 172.21.15.96:0/4113973072 wait complete. 2022-02-02T21:51:31.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 Processor -- start 2022-02-02T21:51:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.487+0000 7f9fa63db700 1 -- start start 2022-02-02T21:51:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9fa63db700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa0109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9fa63db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9fa63db700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00f5710 con 0x7f9fa00f6550 2022-02-02T21:51:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9fa63db700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00f5850 con 0x7f9fa00f5bb0 2022-02-02T21:51:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45172/0 (socket says 172.21.15.96:45172) 2022-02-02T21:51:31.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 -- 172.21.15.96:0/3227639501 learned_addr learned my addr 172.21.15.96:0/3227639501 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:31.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9ffff700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa0109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 -- 172.21.15.96:0/3227639501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f5bb0 msgr2=0x7f9fa0109d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa0109d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 -- 172.21.15.96:0/3227639501 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90005040 con 0x7f9fa00f6550 2022-02-02T21:51:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9f7fe700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 rx=0x7f9f9400b410 tx=0x7f9f94006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.488+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f940125f0 con 0x7f9fa00f6550 2022-02-02T21:51:31.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.489+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa010c820 con 0x7f9fa00f6550 2022-02-02T21:51:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.489+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f94012c00 con 0x7f9fa00f6550 2022-02-02T21:51:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.489+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f94011d20 con 0x7f9fa00f6550 2022-02-02T21:51:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.489+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa010cde0 con 0x7f9fa00f6550 2022-02-02T21:51:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.490+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0045ad0 con 0x7f9fa00f6550 2022-02-02T21:51:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.490+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f9400f030 con 0x7f9fa00f6550 2022-02-02T21:51:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.490+0000 7f9f9cff9700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 0x7f9f88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.490+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f94081e90 con 0x7f9fa00f6550 2022-02-02T21:51:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.490+0000 7f9f9ffff700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 0x7f9f88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.491+0000 7f9f9ffff700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 0x7f9f88067290 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f9f90004630 tx=0x7f9f90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.495+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f9404ff90 con 0x7f9fa00f6550 2022-02-02T21:51:31.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.667+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa00fdf90 con 0x7f9f88064dd0 2022-02-02T21:51:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.676+0000 7f9f9cff9700 1 -- 172.21.15.96:0/3227639501 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9fa00fdf90 con 0x7f9f88064dd0 2022-02-02T21:51:31.678 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:51:31.679 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:51:31.679 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:51:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:51:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:51:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:51:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:51:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:51:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:51:31.682 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:51:31.682 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:51:31.682 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:51:31.683 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:51:31.683 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:51:31.683 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:51:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:51:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:51:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:51:31.685 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:51:31.685 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:51:31.686 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:51:31.686 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:51:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.678+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 msgr2=0x7f9f88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.678+0000 7f9fa63db700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 0x7f9f88067290 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f9f90004630 tx=0x7f9f90009b30).stop 2022-02-02T21:51:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.678+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 msgr2=0x7f9fa010c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.678+0000 7f9fa63db700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 rx=0x7f9f9400b410 tx=0x7f9f94006ef0).stop 2022-02-02T21:51:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 shutdown_connections 2022-02-02T21:51:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f88064dd0 0x7f9f88067290 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa00f5bb0 0x7f9fa0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 --2- 172.21.15.96:0/3227639501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fa00f6550 0x7f9fa010c210 unknown :-1 s=CLOSED pgs=3217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 >> 172.21.15.96:0/3227639501 conn(0x7f9fa00f04c0 msgr2=0x7f9fa00fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 shutdown_connections 2022-02-02T21:51:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.679+0000 7f9fa63db700 1 -- 172.21.15.96:0/3227639501 wait complete. 2022-02-02T21:51:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/136561145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f77d0 msgr2=0x7f4c780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/136561145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f77d0 0x7f4c780f7c30 secure :-1 s=READY pgs=3218 cs=0 l=1 rev1=1 rx=0x7f4c64004660 tx=0x7f4c64009b30).stop 2022-02-02T21:51:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/136561145 shutdown_connections 2022-02-02T21:51:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/136561145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f77d0 0x7f4c780f7c30 unknown :-1 s=CLOSED pgs=3218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/136561145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f6530 0x7f4c780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/136561145 >> 172.21.15.96:0/136561145 conn(0x7f4c780f1c90 msgr2=0x7f4c780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/136561145 shutdown_connections 2022-02-02T21:51:31.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/136561145 wait complete. 2022-02-02T21:51:31.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 Processor -- start 2022-02-02T21:51:31.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.776+0000 7f4c7dbc3700 1 -- start start 2022-02-02T21:51:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7dbc3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7dbc3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f77d0 0x7f4c78107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7dbc3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78107880 con 0x7f4c780f6530 2022-02-02T21:51:31.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7dbc3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78108090 con 0x7f4c780f77d0 2022-02-02T21:51:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45186/0 (socket says 172.21.15.96:45186) 2022-02-02T21:51:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 -- 172.21.15.96:0/2601552600 learned_addr learned my addr 172.21.15.96:0/2601552600 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c77fff700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f77d0 0x7f4c78107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 -- 172.21.15.96:0/2601552600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f77d0 msgr2=0x7f4c78107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f77d0 0x7f4c78107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 -- 172.21.15.96:0/2601552600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64005040 con 0x7f4c780f6530 2022-02-02T21:51:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.777+0000 7f4c7cbc1700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 secure :-1 s=READY pgs=3219 cs=0 l=1 rev1=1 rx=0x7f4c6c00c530 tx=0x7f4c6c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.778+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c00f650 con 0x7f4c780f6530 2022-02-02T21:51:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.778+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c78108310 con 0x7f4c780f6530 2022-02-02T21:51:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.778+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c6c00fc60 con 0x7f4c780f6530 2022-02-02T21:51:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.778+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c012d20 con 0x7f4c780f6530 2022-02-02T21:51:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.778+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c781088d0 con 0x7f4c780f6530 2022-02-02T21:51:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.779+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c78059100 con 0x7f4c780f6530 2022-02-02T21:51:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.779+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c6c019030 con 0x7f4c780f6530 2022-02-02T21:51:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.780+0000 7f4c757fa700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 0x7f4c680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.780+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4c6c0816b0 con 0x7f4c780f6530 2022-02-02T21:51:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.780+0000 7f4c77fff700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 0x7f4c680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.780+0000 7f4c77fff700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 0x7f4c680672e0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f4c64004e30 tx=0x7f4c64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:31.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:31.784+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c6c04f800 con 0x7f4c780f6530 2022-02-02T21:51:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.012+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c780fedc0 con 0x7f4c780f6530 2022-02-02T21:51:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.012+0000 7f4c757fa700 1 -- 172.21.15.96:0/2601552600 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4c6c052e20 con 0x7f4c780f6530 2022-02-02T21:51:32.015 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:51:32.016 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:51:32.016 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:51:32.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:32.017 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:51:32.017 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:51:32.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:32.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:51:32.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:51:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:51:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:51:32.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:51:32.020 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:51:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:51:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:51:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:51:32.022 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:51:32.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 msgr2=0x7f4c680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 0x7f4c680672e0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f4c64004e30 tx=0x7f4c64009b30).stop 2022-02-02T21:51:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 msgr2=0x7f4c78106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 secure :-1 s=READY pgs=3219 cs=0 l=1 rev1=1 rx=0x7f4c6c00c530 tx=0x7f4c6c007e10).stop 2022-02-02T21:51:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 shutdown_connections 2022-02-02T21:51:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c68064e20 0x7f4c680672e0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c780f6530 0x7f4c78106d90 unknown :-1 s=CLOSED pgs=3219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 --2- 172.21.15.96:0/2601552600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c780f77d0 0x7f4c78107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.014+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 >> 172.21.15.96:0/2601552600 conn(0x7f4c780f1c90 msgr2=0x7f4c780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.015+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 shutdown_connections 2022-02-02T21:51:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.015+0000 7f4c7dbc3700 1 -- 172.21.15.96:0/2601552600 wait complete. 2022-02-02T21:51:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 -- 172.21.15.96:0/1512560813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f5430 msgr2=0x7f261c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 --2- 172.21.15.96:0/1512560813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f5430 0x7f261c0f5850 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 rx=0x7f2618004660 tx=0x7f2618009b30).stop 2022-02-02T21:51:32.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 -- 172.21.15.96:0/1512560813 shutdown_connections 2022-02-02T21:51:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 --2- 172.21.15.96:0/1512560813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f66d0 0x7f261c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 --2- 172.21.15.96:0/1512560813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f5430 0x7f261c0f5850 unknown :-1 s=CLOSED pgs=3220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.112+0000 7f2622f19700 1 -- 172.21.15.96:0/1512560813 >> 172.21.15.96:0/1512560813 conn(0x7f261c0f0b90 msgr2=0x7f261c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 -- 172.21.15.96:0/1512560813 shutdown_connections 2022-02-02T21:51:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 -- 172.21.15.96:0/1512560813 wait complete. 2022-02-02T21:51:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 Processor -- start 2022-02-02T21:51:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 -- start start 2022-02-02T21:51:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 0x7f261c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0603c0 con 0x7f261c0f66d0 2022-02-02T21:51:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2622f19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c060500 con 0x7f261c0f5430 2022-02-02T21:51:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2621716700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2621716700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45198/0 (socket says 172.21.15.96:45198) 2022-02-02T21:51:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.113+0000 7f2621716700 1 -- 172.21.15.96:0/4011439098 learned_addr learned my addr 172.21.15.96:0/4011439098 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:51:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621f17700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 0x7f261c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621716700 1 -- 172.21.15.96:0/4011439098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 msgr2=0x7f261c109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621716700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 0x7f261c109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621716700 1 -- 172.21.15.96:0/4011439098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618005040 con 0x7f261c0f66d0 2022-02-02T21:51:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621f17700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 0x7f261c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:51:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2621716700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 rx=0x7f260c0026d0 tx=0x7f260c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c009320 con 0x7f261c0f66d0 2022-02-02T21:51:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f260c00f040 con 0x7f261c0f66d0 2022-02-02T21:51:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c10c560 con 0x7f261c0f66d0 2022-02-02T21:51:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c0147e0 con 0x7f261c0f66d0 2022-02-02T21:51:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.114+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c10caf0 con 0x7f261c0f66d0 2022-02-02T21:51:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.115+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c059100 con 0x7f261c0f66d0 2022-02-02T21:51:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.116+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f260c009480 con 0x7f261c0f66d0 2022-02-02T21:51:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.116+0000 7f26127fc700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 0x7f26080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:51:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.116+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f260c082120 con 0x7f261c0f66d0 2022-02-02T21:51:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.116+0000 7f2621f17700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 0x7f26080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:51:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.116+0000 7f2621f17700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 0x7f26080672e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f2618004e30 tx=0x7f2618009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:51:32.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.121+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f260c050220 con 0x7f261c0f66d0 2022-02-02T21:51:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.322+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f261c045ad0 con 0x7f261c0f66d0 2022-02-02T21:51:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.322+0000 7f26127fc700 1 -- 172.21.15.96:0/4011439098 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f260c053840 con 0x7f261c0f66d0 2022-02-02T21:51:32.324 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:51:32.324 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:51:32.324 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:51:32.325 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:51:32.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:32.325 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:51:32.326 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:51:32.326 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:51:32.326 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:51:32.327 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:51:32.327 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:51:32.327 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:51:32.328 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:51:32.328 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:51:32.328 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:51:32.329 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:51:32.329 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:51:32.329 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:51:32.330 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:51:32.330 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:51:32.330 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:51:32.331 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:51:32.331 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:51:32.331 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:51:32.332 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:51:32.332 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:51:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:51:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:51:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:51:32.334 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:51:32.334 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:51:32.334 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:51:32.335 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:32.335 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:32.335 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:51:32.336 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:51:32.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:32.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:32.337 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:51:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 msgr2=0x7f26080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 0x7f26080672e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f2618004e30 tx=0x7f2618009b30).stop 2022-02-02T21:51:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 msgr2=0x7f261c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:51:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 rx=0x7f260c0026d0 tx=0x7f260c009de0).stop 2022-02-02T21:51:32.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 shutdown_connections 2022-02-02T21:51:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2608064e20 0x7f26080672e0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f261c0f5430 0x7f261c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 --2- 172.21.15.96:0/4011439098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261c0f66d0 0x7f261c10bfb0 unknown :-1 s=CLOSED pgs=3221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:51:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 >> 172.21.15.96:0/4011439098 conn(0x7f261c0f0b90 msgr2=0x7f261c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:51:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 shutdown_connections 2022-02-02T21:51:32.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:51:32.324+0000 7f2622f19700 1 -- 172.21.15.96:0/4011439098 wait complete. 2022-02-02T21:51:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:51:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:32 smithi159 ceph-mon[69013]: pgmap v6282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:32.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:32 smithi159 ceph-mon[69013]: from='client.40540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:32.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2601552600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:51:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:32 smithi096 ceph-mon[101353]: pgmap v6282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:32 smithi096 ceph-mon[101353]: from='client.40540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2601552600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:51:33.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:33 smithi159 ceph-mon[69013]: from='client.40544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4011439098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:51:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:33 smithi096 ceph-mon[101353]: from='client.40544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:51:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4011439098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:51:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:34 smithi096 ceph-mon[101353]: pgmap v6283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:34 smithi159 ceph-mon[69013]: pgmap v6283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:36 smithi096 ceph-mon[101353]: pgmap v6284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:36 smithi159 ceph-mon[69013]: pgmap v6284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:38 smithi096 ceph-mon[101353]: pgmap v6285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:38 smithi159 ceph-mon[69013]: pgmap v6285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:40 smithi096 ceph-mon[101353]: pgmap v6286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:40 smithi159 ceph-mon[69013]: pgmap v6286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:42 smithi096 ceph-mon[101353]: pgmap v6287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:42 smithi159 ceph-mon[69013]: pgmap v6287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:44 smithi096 ceph-mon[101353]: pgmap v6288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:44 smithi159 ceph-mon[69013]: pgmap v6288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:46 smithi096 ceph-mon[101353]: pgmap v6289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:46 smithi159 ceph-mon[69013]: pgmap v6289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:48 smithi096 ceph-mon[101353]: pgmap v6290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:48 smithi159 ceph-mon[69013]: pgmap v6290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:50 smithi096 ceph-mon[101353]: pgmap v6291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:50 smithi159 ceph-mon[69013]: pgmap v6291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:52 smithi159 ceph-mon[69013]: pgmap v6292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:52 smithi096 ceph-mon[101353]: pgmap v6292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:54 smithi159 ceph-mon[69013]: pgmap v6293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:54 smithi096 ceph-mon[101353]: pgmap v6293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:56 smithi159 ceph-mon[69013]: pgmap v6294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:56 smithi096 ceph-mon[101353]: pgmap v6294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:58.779 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:51:58 smithi159 ceph-mon[69013]: pgmap v6295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:51:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:51:58 smithi096 ceph-mon[101353]: pgmap v6295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:00 smithi159 ceph-mon[69013]: pgmap v6296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:00 smithi096 ceph-mon[101353]: pgmap v6296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.432+0000 7f1af94d8700 1 -- 172.21.15.96:0/4282512216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f6700 msgr2=0x7f1af40f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.432+0000 7f1af94d8700 1 --2- 172.21.15.96:0/4282512216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f6700 0x7f1af40f6b60 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 rx=0x7f1ae4004660 tx=0x7f1ae4009b30).stop 2022-02-02T21:52:02.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 -- 172.21.15.96:0/4282512216 shutdown_connections 2022-02-02T21:52:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 --2- 172.21.15.96:0/4282512216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f6700 0x7f1af40f6b60 unknown :-1 s=CLOSED pgs=3222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 --2- 172.21.15.96:0/4282512216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f5460 0x7f1af40f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 -- 172.21.15.96:0/4282512216 >> 172.21.15.96:0/4282512216 conn(0x7f1af40f0bc0 msgr2=0x7f1af40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 -- 172.21.15.96:0/4282512216 shutdown_connections 2022-02-02T21:52:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 -- 172.21.15.96:0/4282512216 wait complete. 2022-02-02T21:52:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 Processor -- start 2022-02-02T21:52:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.433+0000 7f1af94d8700 1 -- start start 2022-02-02T21:52:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af94d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af94d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 0x7f1af4109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af94d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af41099d0 con 0x7f1af40f5460 2022-02-02T21:52:02.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af94d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4109b10 con 0x7f1af40f6700 2022-02-02T21:52:02.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45212/0 (socket says 172.21.15.96:45212) 2022-02-02T21:52:02.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 -- 172.21.15.96:0/3142170562 learned_addr learned my addr 172.21.15.96:0/3142170562 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:02.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af27fc700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 0x7f1af4109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 -- 172.21.15.96:0/3142170562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 msgr2=0x7f1af4109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 0x7f1af4109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 -- 172.21.15.96:0/3142170562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4005040 con 0x7f1af40f5460 2022-02-02T21:52:02.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af27fc700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 0x7f1af4109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:52:02.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1af2ffd700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 secure :-1 s=READY pgs=3223 cs=0 l=1 rev1=1 rx=0x7f1ae800c530 tx=0x7f1ae8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:02.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ae800f650 con 0x7f1af40f5460 2022-02-02T21:52:02.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ae800fc60 con 0x7f1af40f5460 2022-02-02T21:52:02.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.434+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ae8012d20 con 0x7f1af40f5460 2022-02-02T21:52:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.435+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af410a4b0 con 0x7f1af40f5460 2022-02-02T21:52:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.435+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af410aa20 con 0x7f1af40f5460 2022-02-02T21:52:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.435+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af4045ad0 con 0x7f1af40f5460 2022-02-02T21:52:02.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.436+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ae8019030 con 0x7f1af40f5460 2022-02-02T21:52:02.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.436+0000 7f1adb7fe700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 0x7f1adc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.436+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ae80816b0 con 0x7f1af40f5460 2022-02-02T21:52:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.436+0000 7f1af27fc700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 0x7f1adc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.437+0000 7f1af27fc700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 0x7f1adc0672e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f1ae4009da0 tx=0x7f1ae4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.441+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ae8053230 con 0x7f1af40f5460 2022-02-02T21:52:02.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.619+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1af40fa940 con 0x7f1adc064e20 2022-02-02T21:52:02.621 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:02 smithi096 ceph-mon[101353]: pgmap v6297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.620+0000 7f1adb7fe700 1 -- 172.21.15.96:0/3142170562 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1af40fa940 con 0x7f1adc064e20 2022-02-02T21:52:02.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 msgr2=0x7f1adc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 0x7f1adc0672e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f1ae4009da0 tx=0x7f1ae4009b30).stop 2022-02-02T21:52:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 msgr2=0x7f1af4108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 secure :-1 s=READY pgs=3223 cs=0 l=1 rev1=1 rx=0x7f1ae800c530 tx=0x7f1ae8007e10).stop 2022-02-02T21:52:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 shutdown_connections 2022-02-02T21:52:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1adc064e20 0x7f1adc0672e0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40f5460 0x7f1af4108f30 unknown :-1 s=CLOSED pgs=3223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 --2- 172.21.15.96:0/3142170562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af40f6700 0x7f1af4109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 >> 172.21.15.96:0/3142170562 conn(0x7f1af40f0bc0 msgr2=0x7f1af405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 shutdown_connections 2022-02-02T21:52:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.622+0000 7f1af94d8700 1 -- 172.21.15.96:0/3142170562 wait complete. 2022-02-02T21:52:02.633 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:52:02.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 -- 172.21.15.96:0/3539796328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 msgr2=0x7f3f1c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 --2- 172.21.15.96:0/3539796328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c0f6b30 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 rx=0x7f3f10004660 tx=0x7f3f10009b30).stop 2022-02-02T21:52:02.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 -- 172.21.15.96:0/3539796328 shutdown_connections 2022-02-02T21:52:02.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 --2- 172.21.15.96:0/3539796328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c0f6b30 unknown :-1 s=CLOSED pgs=3224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 --2- 172.21.15.96:0/3539796328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 0x7f3f1c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 -- 172.21.15.96:0/3539796328 >> 172.21.15.96:0/3539796328 conn(0x7f3f1c0f0b90 msgr2=0x7f3f1c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.719+0000 7f3f20b10700 1 -- 172.21.15.96:0/3539796328 shutdown_connections 2022-02-02T21:52:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 -- 172.21.15.96:0/3539796328 wait complete. 2022-02-02T21:52:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 Processor -- start 2022-02-02T21:52:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 -- start start 2022-02-02T21:52:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 0x7f3f1c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c107870 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.720+0000 7f3f20b10700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1080b0 con 0x7f3f1c0f5430 2022-02-02T21:52:02.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45224/0 (socket says 172.21.15.96:45224) 2022-02-02T21:52:02.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 -- 172.21.15.96:0/2020632151 learned_addr learned my addr 172.21.15.96:0/2020632151 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:02.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1b7fe700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 0x7f3f1c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 -- 172.21.15.96:0/2020632151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 msgr2=0x7f3f1c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 0x7f3f1c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 -- 172.21.15.96:0/2020632151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10005040 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f1affd700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 rx=0x7f3f10009990 tx=0x7f3f10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f10018070 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f10007ba0 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c108330 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1001c3c0 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.721+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c108810 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.722+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c059100 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.722+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f1001d420 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.723+0000 7f3f03fff700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.723+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f100836a0 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.723+0000 7f3f1b7fe700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.723+0000 7f3f1b7fe700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 0x7f3f040672e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f3f1c107b40 tx=0x7f3f0c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.727+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f10051860 con 0x7f3f1c0f66d0 2022-02-02T21:52:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:02 smithi159 ceph-mon[69013]: pgmap v6297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:02.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.900+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f1c0fab10 con 0x7f3f04064e20 2022-02-02T21:52:02.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.910+0000 7f3f03fff700 1 -- 172.21.15.96:0/2020632151 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3f1c0fab10 con 0x7f3f04064e20 2022-02-02T21:52:02.912 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:52:02.912 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:52:02.913 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:52:02.913 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:52:02.913 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:52:02.914 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:52:02.914 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:52:02.915 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:52:02.915 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:52:02.917 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:52:02.918 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:52:02.918 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:52:02.919 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:52:02.919 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:52:02.919 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:52:02.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:52:02.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:52:02.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:52:02.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:52:02.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:52:02.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:52:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:52:02.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 msgr2=0x7f3f040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 0x7f3f040672e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f3f1c107b40 tx=0x7f3f0c00b040).stop 2022-02-02T21:52:02.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 msgr2=0x7f3f1c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:02.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 rx=0x7f3f10009990 tx=0x7f3f10009b30).stop 2022-02-02T21:52:02.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 shutdown_connections 2022-02-02T21:52:02.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f1c0f5430 0x7f3f1c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 --2- 172.21.15.96:0/2020632151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c0f66d0 0x7f3f1c107270 unknown :-1 s=CLOSED pgs=3225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.912+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 >> 172.21.15.96:0/2020632151 conn(0x7f3f1c0f0b90 msgr2=0x7f3f1c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.913+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 shutdown_connections 2022-02-02T21:52:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:02.913+0000 7f3f20b10700 1 -- 172.21.15.96:0/2020632151 wait complete. 2022-02-02T21:52:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 -- 172.21.15.96:0/3899713475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f68e0 msgr2=0x7fb5440f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 --2- 172.21.15.96:0/3899713475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f68e0 0x7fb5440f6d00 secure :-1 s=READY pgs=3226 cs=0 l=1 rev1=1 rx=0x7fb540004660 tx=0x7fb540009b30).stop 2022-02-02T21:52:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 -- 172.21.15.96:0/3899713475 shutdown_connections 2022-02-02T21:52:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 --2- 172.21.15.96:0/3899713475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f7b80 0x7fb5440f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:52:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 --2- 172.21.15.96:0/3899713475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f68e0 0x7fb5440f6d00 unknown :-1 s=CLOSED pgs=3226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 -- 172.21.15.96:0/3899713475 >> 172.21.15.96:0/3899713475 conn(0x7fb5440f2020 msgr2=0x7fb5440f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 -- 172.21.15.96:0/3899713475 shutdown_connections 2022-02-02T21:52:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.009+0000 7fb54b45f700 1 -- 172.21.15.96:0/3899713475 wait complete. 2022-02-02T21:52:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 Processor -- start 2022-02-02T21:52:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 -- start start 2022-02-02T21:52:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f68e0 0x7fb54406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54406a410 con 0x7fb5440f7b80 2022-02-02T21:52:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb54b45f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54406a550 con 0x7fb5440f68e0 2022-02-02T21:52:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb5489fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb5489fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45234/0 (socket says 172.21.15.96:45234) 2022-02-02T21:52:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.010+0000 7fb5489fa700 1 -- 172.21.15.96:0/1028369120 learned_addr learned my addr 172.21.15.96:0/1028369120 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb5491fb700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f68e0 0x7fb54406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb5489fa700 1 -- 172.21.15.96:0/1028369120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f68e0 msgr2=0x7fb54406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb5489fa700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f68e0 0x7fb54406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb5489fa700 1 -- 172.21.15.96:0/1028369120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540005040 con 0x7fb5440f7b80 2022-02-02T21:52:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb5489fa700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 rx=0x7fb53400b410 tx=0x7fb534006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5340125f0 con 0x7fb5440f7b80 2022-02-02T21:52:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb534012c00 con 0x7fb5440f7b80 2022-02-02T21:52:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54406a830 con 0x7fb5440f7b80 2022-02-02T21:52:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb534002ae0 con 0x7fb5440f7b80 2022-02-02T21:52:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.011+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54410f1b0 con 0x7fb5440f7b80 2022-02-02T21:52:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.012+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb544045ad0 con 0x7fb5440f7b80 2022-02-02T21:52:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.013+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb53400f030 con 0x7fb5440f7b80 2022-02-02T21:52:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.013+0000 7fb539ffb700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 0x7fb530067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.013+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb534081f10 con 0x7fb5440f7b80 2022-02-02T21:52:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.013+0000 7fb5491fb700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 0x7fb530067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.013+0000 7fb5491fb700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 0x7fb530067290 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7fb540004e30 tx=0x7fb540009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.017+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb534050010 con 0x7fb5440f7b80 2022-02-02T21:52:03.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.249+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5440612d0 con 0x7fb5440f7b80 2022-02-02T21:52:03.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.249+0000 7fb539ffb700 1 -- 172.21.15.96:0/1028369120 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb534053630 con 0x7fb5440f7b80 2022-02-02T21:52:03.251 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:52:03.251 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:52:03.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:52:03.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:03.252 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:52:03.253 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:52:03.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:03.253 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:52:03.254 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:52:03.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:03.255 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:52:03.255 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:52:03.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:03.256 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:52:03.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:52:03.256 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:52:03.257 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:52:03.257 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:52:03.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 msgr2=0x7fb530067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 0x7fb530067290 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7fb540004e30 tx=0x7fb540009b30).stop 2022-02-02T21:52:03.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 msgr2=0x7fb544069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 rx=0x7fb53400b410 tx=0x7fb534006ef0).stop 2022-02-02T21:52:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 shutdown_connections 2022-02-02T21:52:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb530064dd0 0x7fb530067290 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5440f68e0 0x7fb54406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 --2- 172.21.15.96:0/1028369120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5440f7b80 0x7fb544069e20 unknown :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 >> 172.21.15.96:0/1028369120 conn(0x7fb5440f2020 msgr2=0x7fb5440fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:03.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 shutdown_connections 2022-02-02T21:52:03.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.251+0000 7fb54b45f700 1 -- 172.21.15.96:0/1028369120 wait complete. 2022-02-02T21:52:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 -- 172.21.15.96:0/1045284648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f7980 msgr2=0x7f9cd00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1045284648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f7980 0x7f9cd00f7de0 secure :-1 s=READY pgs=3228 cs=0 l=1 rev1=1 rx=0x7f9cc4004660 tx=0x7f9cc4009b30).stop 2022-02-02T21:52:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 -- 172.21.15.96:0/1045284648 shutdown_connections 2022-02-02T21:52:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1045284648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f7980 0x7f9cd00f7de0 unknown :-1 s=CLOSED pgs=3228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1045284648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f66e0 0x7f9cd00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 -- 172.21.15.96:0/1045284648 >> 172.21.15.96:0/1045284648 conn(0x7f9cd00f1e40 msgr2=0x7f9cd00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 -- 172.21.15.96:0/1045284648 shutdown_connections 2022-02-02T21:52:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.350+0000 7f9cd6382700 1 -- 172.21.15.96:0/1045284648 wait complete. 2022-02-02T21:52:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 Processor -- start 2022-02-02T21:52:03.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 -- start start 2022-02-02T21:52:03.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 0x7f9cd0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0107a00 con 0x7f9cd00f66e0 2022-02-02T21:52:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9cd6382700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0107b40 con 0x7f9cd00f7980 2022-02-02T21:52:03.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45242/0 (socket says 172.21.15.96:45242) 2022-02-02T21:52:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 -- 172.21.15.96:0/1463528739 learned_addr learned my addr 172.21.15.96:0/1463528739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccf7fe700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 0x7f9cd0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 -- 172.21.15.96:0/1463528739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 msgr2=0x7f9cd0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 0x7f9cd0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccffff700 1 -- 172.21.15.96:0/1463528739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4005040 con 0x7f9cd00f66e0 2022-02-02T21:52:03.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.351+0000 7f9ccf7fe700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 0x7f9cd0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:52:03.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9ccffff700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 rx=0x7f9cc0002700 tx=0x7f9cc0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:03.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc0009320 con 0x7f9cd00f66e0 2022-02-02T21:52:03.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd01084e0 con 0x7f9cd00f66e0 2022-02-02T21:52:03.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9cc000f040 con 0x7f9cd00f66e0 2022-02-02T21:52:03.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc0014900 con 0x7f9cd00f66e0 2022-02-02T21:52:03.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.352+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd0108aa0 con 0x7f9cd00f66e0 2022-02-02T21:52:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.353+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0045ad0 con 0x7f9cd00f66e0 2022-02-02T21:52:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.353+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9cc0009480 con 0x7f9cd00f66e0 2022-02-02T21:52:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.354+0000 7f9cccff9700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 0x7f9cb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.354+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9cc0081d80 con 0x7f9cd00f66e0 2022-02-02T21:52:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.354+0000 7f9ccf7fe700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 0x7f9cb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.354+0000 7f9ccf7fe700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 0x7f9cb8067290 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7f9cc4004630 tx=0x7f9cc4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.358+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9cc00538b0 con 0x7f9cd00f66e0 2022-02-02T21:52:03.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.561+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9cd00ff020 con 0x7f9cd00f66e0 2022-02-02T21:52:03.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.561+0000 7f9cccff9700 1 -- 172.21.15.96:0/1463528739 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9cc00534a0 con 0x7f9cd00f66e0 2022-02-02T21:52:03.563 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:52:03.563 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:52:03.564 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:52:03.564 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:52:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:03.565 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:52:03.565 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:52:03.565 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:52:03.566 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:52:03.566 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:52:03.566 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:52:03.567 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:52:03.567 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:52:03.567 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:52:03.568 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:52:03.568 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:52:03.568 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:52:03.569 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:52:03.569 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:52:03.569 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:52:03.570 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:52:03.570 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:52:03.570 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:52:03.571 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:52:03.571 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:52:03.571 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:52:03.572 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:52:03.572 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:52:03.573 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:52:03.573 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:52:03.573 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:52:03.574 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:52:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:03.575 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:52:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:03.575 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:03.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:03.576 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 msgr2=0x7f9cb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 0x7f9cb8067290 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7f9cc4004630 tx=0x7f9cc4009b30).stop 2022-02-02T21:52:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 msgr2=0x7f9cd0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:03.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 rx=0x7f9cc0002700 tx=0x7f9cc0009d80).stop 2022-02-02T21:52:03.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 shutdown_connections 2022-02-02T21:52:03.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9cb8064dd0 0x7f9cb8067290 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cd00f66e0 0x7f9cd0106f60 unknown :-1 s=CLOSED pgs=3229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 --2- 172.21.15.96:0/1463528739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd00f7980 0x7f9cd0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 >> 172.21.15.96:0/1463528739 conn(0x7f9cd00f1e40 msgr2=0x7f9cd00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 shutdown_connections 2022-02-02T21:52:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:03.563+0000 7f9cd6382700 1 -- 172.21.15.96:0/1463528739 wait complete. 2022-02-02T21:52:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:52:04.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:03 smithi159 ceph-mon[69013]: pgmap v6298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:04.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:03 smithi159 ceph-mon[69013]: from='client.40556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:04.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:03 smithi159 ceph-mon[69013]: from='client.40560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:04.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1028369120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:52:04.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1463528739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:52:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:03 smithi096 ceph-mon[101353]: pgmap v6298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:03 smithi096 ceph-mon[101353]: from='client.40556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:04.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:03 smithi096 ceph-mon[101353]: from='client.40560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1028369120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:52:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1463528739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:52:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:05 smithi159 ceph-mon[69013]: pgmap v6299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:05 smithi096 ceph-mon[101353]: pgmap v6299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:07 smithi159 ceph-mon[69013]: pgmap v6300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:07 smithi096 ceph-mon[101353]: pgmap v6300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:09 smithi159 ceph-mon[69013]: pgmap v6301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:09 smithi096 ceph-mon[101353]: pgmap v6301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:11 smithi159 ceph-mon[69013]: pgmap v6302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:11 smithi096 ceph-mon[101353]: pgmap v6302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:13 smithi159 ceph-mon[69013]: pgmap v6303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:13 smithi096 ceph-mon[101353]: pgmap v6303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:15 smithi159 ceph-mon[69013]: pgmap v6304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:15 smithi096 ceph-mon[101353]: pgmap v6304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:18.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:17 smithi159 ceph-mon[69013]: pgmap v6305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:17 smithi096 ceph-mon[101353]: pgmap v6305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:19 smithi159 ceph-mon[69013]: pgmap v6306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:19 smithi096 ceph-mon[101353]: pgmap v6306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:22.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:21 smithi159 ceph-mon[69013]: pgmap v6307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:21 smithi096 ceph-mon[101353]: pgmap v6307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:24.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:23 smithi159 ceph-mon[69013]: pgmap v6308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:23 smithi096 ceph-mon[101353]: pgmap v6308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:26.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:25 smithi159 ceph-mon[69013]: pgmap v6309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:26.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:25 smithi096 ceph-mon[101353]: pgmap v6309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:27 smithi159 ceph-mon[69013]: pgmap v6310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:52:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:52:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:27 smithi096 ceph-mon[101353]: pgmap v6310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:52:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:52:30.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:29 smithi159 ceph-mon[69013]: pgmap v6311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:29 smithi096 ceph-mon[101353]: pgmap v6311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:32.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:31 smithi159 ceph-mon[69013]: pgmap v6312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:31 smithi096 ceph-mon[101353]: pgmap v6312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:33.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- 172.21.15.96:0/787299234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f66d0 msgr2=0x7fd8900f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 --2- 172.21.15.96:0/787299234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f66d0 0x7fd8900f6b30 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 rx=0x7fd880004660 tx=0x7fd880009b30).stop 2022-02-02T21:52:33.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- 172.21.15.96:0/787299234 shutdown_connections 2022-02-02T21:52:33.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 --2- 172.21.15.96:0/787299234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f66d0 0x7fd8900f6b30 unknown :-1 s=CLOSED pgs=3230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 --2- 172.21.15.96:0/787299234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f5430 0x7fd8900f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- 172.21.15.96:0/787299234 >> 172.21.15.96:0/787299234 conn(0x7fd8900f0b90 msgr2=0x7fd8900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:33.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- 172.21.15.96:0/787299234 shutdown_connections 2022-02-02T21:52:33.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- 172.21.15.96:0/787299234 wait complete. 2022-02-02T21:52:33.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 Processor -- start 2022-02-02T21:52:33.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.674+0000 7fd89730e700 1 -- start start 2022-02-02T21:52:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89730e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89730e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 0x7fd890107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89730e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890107890 con 0x7fd8900f5430 2022-02-02T21:52:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89730e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901080d0 con 0x7fd8900f66d0 2022-02-02T21:52:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45258/0 (socket says 172.21.15.96:45258) 2022-02-02T21:52:33.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 -- 172.21.15.96:0/3323453583 learned_addr learned my addr 172.21.15.96:0/3323453583 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:33.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd895b0b700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 0x7fd890107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 -- 172.21.15.96:0/3323453583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 msgr2=0x7fd890107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 0x7fd890107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 -- 172.21.15.96:0/3323453583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880005040 con 0x7fd8900f5430 2022-02-02T21:52:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd895b0b700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 0x7fd890107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:52:33.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd89630c700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 rx=0x7fd88c002700 tx=0x7fd88c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:33.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c009320 con 0x7fd8900f5430 2022-02-02T21:52:33.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.675+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd88c00f040 con 0x7fd8900f5430 2022-02-02T21:52:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.676+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8901083b0 con 0x7fd8900f5430 2022-02-02T21:52:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.676+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c014780 con 0x7fd8900f5430 2022-02-02T21:52:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.676+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8901088f0 con 0x7fd8900f5430 2022-02-02T21:52:33.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.676+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd890059100 con 0x7fd8900f5430 2022-02-02T21:52:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.677+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd88c009480 con 0x7fd8900f5430 2022-02-02T21:52:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.677+0000 7fd886ffd700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 0x7fd87c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.677+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd88c081fc0 con 0x7fd8900f5430 2022-02-02T21:52:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.677+0000 7fd895b0b700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 0x7fd87c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.678+0000 7fd895b0b700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 0x7fd87c0672e0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fd880009da0 tx=0x7fd880009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.682+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd88c050060 con 0x7fd8900f5430 2022-02-02T21:52:33.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.861+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8900fab10 con 0x7fd87c064e20 2022-02-02T21:52:33.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.863+0000 7fd886ffd700 1 -- 172.21.15.96:0/3323453583 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd8900fab10 con 0x7fd87c064e20 2022-02-02T21:52:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.864+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 msgr2=0x7fd87c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.864+0000 7fd89730e700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 0x7fd87c0672e0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fd880009da0 tx=0x7fd880009b30).stop 2022-02-02T21:52:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.864+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 msgr2=0x7fd890106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.864+0000 7fd89730e700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 rx=0x7fd88c002700 tx=0x7fd88c009d60).stop 2022-02-02T21:52:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 shutdown_connections 2022-02-02T21:52:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd87c064e20 0x7fd87c0672e0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8900f5430 0x7fd890106da0 unknown :-1 s=CLOSED pgs=3231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 --2- 172.21.15.96:0/3323453583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8900f66d0 0x7fd890107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 >> 172.21.15.96:0/3323453583 conn(0x7fd8900f0b90 msgr2=0x7fd89005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 shutdown_connections 2022-02-02T21:52:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.865+0000 7fd89730e700 1 -- 172.21.15.96:0/3323453583 wait complete. 2022-02-02T21:52:33.874 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:52:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 -- 172.21.15.96:0/1477293067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 msgr2=0x7f5c100f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 --2- 172.21.15.96:0/1477293067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c100f5c10 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 rx=0x7f5c04004660 tx=0x7f5c04009b30).stop 2022-02-02T21:52:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 -- 172.21.15.96:0/1477293067 shutdown_connections 2022-02-02T21:52:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 --2- 172.21.15.96:0/1477293067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c100f5c10 unknown :-1 s=CLOSED pgs=3232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 --2- 172.21.15.96:0/1477293067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 0x7f5c100f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:52:33.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 -- 172.21.15.96:0/1477293067 >> 172.21.15.96:0/1477293067 conn(0x7f5c100f0320 msgr2=0x7f5c100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:33.966 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:33 smithi096 ceph-mon[101353]: pgmap v6313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 -- 172.21.15.96:0/1477293067 shutdown_connections 2022-02-02T21:52:33.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.963+0000 7f5c14a32700 1 -- 172.21.15.96:0/1477293067 wait complete. 2022-02-02T21:52:33.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 Processor -- start 2022-02-02T21:52:33.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 -- start start 2022-02-02T21:52:33.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 0x7f5c10106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c101068d0 con 0x7f5c100f5790 2022-02-02T21:52:33.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c14a32700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10107050 con 0x7f5c100f6a40 2022-02-02T21:52:33.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45268/0 (socket says 172.21.15.96:45268) 2022-02-02T21:52:33.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c0ed9d700 1 -- 172.21.15.96:0/3639983257 learned_addr learned my addr 172.21.15.96:0/3639983257 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:33.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.964+0000 7f5c0e59c700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 0x7f5c10106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c0ed9d700 1 -- 172.21.15.96:0/3639983257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 msgr2=0x7f5c10106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:33.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c0ed9d700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 0x7f5c10106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:33.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c0ed9d700 1 -- 172.21.15.96:0/3639983257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04005040 con 0x7f5c100f5790 2022-02-02T21:52:33.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c0ed9d700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 rx=0x7f5c0000f700 tx=0x7f5c00006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c00012070 con 0x7f5c100f5790 2022-02-02T21:52:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c101072d0 con 0x7f5c100f5790 2022-02-02T21:52:33.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c0000d2e0 con 0x7f5c100f5790 2022-02-02T21:52:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c000179f0 con 0x7f5c100f5790 2022-02-02T21:52:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.965+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c10107890 con 0x7f5c100f5790 2022-02-02T21:52:33.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.966+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf0004fa0 con 0x7f5c100f5790 2022-02-02T21:52:33.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.966+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c00017cd0 con 0x7f5c100f5790 2022-02-02T21:52:33.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.967+0000 7f5bf77fe700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 0x7f5bf80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.967+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5c00085cc0 con 0x7f5c100f5790 2022-02-02T21:52:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.967+0000 7f5c0e59c700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 0x7f5bf80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.967+0000 7f5c0e59c700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 0x7f5bf80672e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f5c04004630 tx=0x7f5c04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:33.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:33.971+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c00054db0 con 0x7f5c100f5790 2022-02-02T21:52:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.142+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf0000bc0 con 0x7f5bf8064e20 2022-02-02T21:52:34.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.152+0000 7f5bf77fe700 1 -- 172.21.15.96:0/3639983257 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5bf0000bc0 con 0x7f5bf8064e20 2022-02-02T21:52:34.152 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:52:34.152 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:52:34.153 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:52:34.153 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:52:34.153 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:52:34.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:52:34.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:52:34.154 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:52:34.155 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:52:34.155 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:52:34.155 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:52:34.156 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:52:34.156 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:52:34.156 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:52:34.157 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:52:34.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:52:34.157 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:52:34.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:52:34.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:52:34.158 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:52:34.159 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:52:34.159 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:52:34.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.153+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 msgr2=0x7f5bf80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.153+0000 7f5c14a32700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 0x7f5bf80672e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f5c04004630 tx=0x7f5c04009b30).stop 2022-02-02T21:52:34.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.153+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 msgr2=0x7f5c10105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.153+0000 7f5c14a32700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 rx=0x7f5c0000f700 tx=0x7f5c00006f50).stop 2022-02-02T21:52:34.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 shutdown_connections 2022-02-02T21:52:34.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5bf8064e20 0x7f5bf80672e0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c100f5790 0x7f5c10105d50 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 --2- 172.21.15.96:0/3639983257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c100f6a40 0x7f5c10106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 >> 172.21.15.96:0/3639983257 conn(0x7f5c100f0320 msgr2=0x7f5c100fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 shutdown_connections 2022-02-02T21:52:34.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.154+0000 7f5c14a32700 1 -- 172.21.15.96:0/3639983257 wait complete. 2022-02-02T21:52:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 -- 172.21.15.96:0/3186024820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f6530 msgr2=0x7f30a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 --2- 172.21.15.96:0/3186024820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f6530 0x7f30a00f6950 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 rx=0x7f3094004660 tx=0x7f3094009b30).stop 2022-02-02T21:52:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 -- 172.21.15.96:0/3186024820 shutdown_connections 2022-02-02T21:52:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 --2- 172.21.15.96:0/3186024820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f77d0 0x7f30a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 --2- 172.21.15.96:0/3186024820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f6530 0x7f30a00f6950 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.249+0000 7f30a4a89700 1 -- 172.21.15.96:0/3186024820 >> 172.21.15.96:0/3186024820 conn(0x7f30a00f1c90 msgr2=0x7f30a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.250+0000 7f30a4a89700 1 -- 172.21.15.96:0/3186024820 shutdown_connections 2022-02-02T21:52:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.250+0000 7f30a4a89700 1 -- 172.21.15.96:0/3186024820 wait complete. 2022-02-02T21:52:34.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.250+0000 7f30a4a89700 1 Processor -- start 2022-02-02T21:52:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f30a4a89700 1 -- start start 2022-02-02T21:52:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f30a4a89700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f6530 0x7f30a0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f30a4a89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f30a4a89700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01078f0 con 0x7f30a00f77d0 2022-02-02T21:52:34.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f30a4a89700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0108100 con 0x7f30a00f6530 2022-02-02T21:52:34.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45280/0 (socket says 172.21.15.96:45280) 2022-02-02T21:52:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 -- 172.21.15.96:0/747830027 learned_addr learned my addr 172.21.15.96:0/747830027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:34.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309f7fe700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f6530 0x7f30a0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 -- 172.21.15.96:0/747830027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f6530 msgr2=0x7f30a0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f6530 0x7f30a0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 -- 172.21.15.96:0/747830027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094005040 con 0x7f30a00f77d0 2022-02-02T21:52:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.251+0000 7f309effd700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 rx=0x7f309000c530 tx=0x7f3090007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.252+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309000f650 con 0x7f30a00f77d0 2022-02-02T21:52:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.252+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a0108380 con 0x7f30a00f77d0 2022-02-02T21:52:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.252+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f309000fc60 con 0x7f30a00f77d0 2022-02-02T21:52:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.252+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3090012c20 con 0x7f30a00f77d0 2022-02-02T21:52:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.252+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a0108940 con 0x7f30a00f77d0 2022-02-02T21:52:34.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.253+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3090010070 con 0x7f30a00f77d0 2022-02-02T21:52:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.253+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a0059100 con 0x7f30a00f77d0 2022-02-02T21:52:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.253+0000 7f3087fff700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 0x7f30880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.253+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3090081710 con 0x7f30a00f77d0 2022-02-02T21:52:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.254+0000 7f309f7fe700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 0x7f30880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.254+0000 7f309f7fe700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 0x7f30880672e0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f3094013690 tx=0x7f3094009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.258+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f309004f810 con 0x7f30a00f77d0 2022-02-02T21:52:34.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:33 smithi159 ceph-mon[69013]: pgmap v6313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.489+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30a00fedf0 con 0x7f30a00f77d0 2022-02-02T21:52:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.489+0000 7f3087fff700 1 -- 172.21.15.96:0/747830027 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3090052e30 con 0x7f30a00f77d0 2022-02-02T21:52:34.490 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:52:34.490 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:52:34.491 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:52:34.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:34.491 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:52:34.492 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:52:34.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:34.492 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:52:34.493 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:52:34.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:34.493 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:52:34.494 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:52:34.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:52:34.494 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:52:34.495 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:52:34.495 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:52:34.495 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:52:34.496 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:52:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 msgr2=0x7f30880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 0x7f30880672e0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f3094013690 tx=0x7f3094009b30).stop 2022-02-02T21:52:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 msgr2=0x7f30a01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 rx=0x7f309000c530 tx=0x7f3090007e20).stop 2022-02-02T21:52:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 shutdown_connections 2022-02-02T21:52:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3088064e20 0x7f30880672e0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30a00f6530 0x7f30a0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 --2- 172.21.15.96:0/747830027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30a00f77d0 0x7f30a01072f0 unknown :-1 s=CLOSED pgs=3235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 >> 172.21.15.96:0/747830027 conn(0x7f30a00f1c90 msgr2=0x7f30a00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 shutdown_connections 2022-02-02T21:52:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.491+0000 7f30a4a89700 1 -- 172.21.15.96:0/747830027 wait complete. 2022-02-02T21:52:34.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 -- 172.21.15.96:0/1501268587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f55c0 msgr2=0x7f23900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 --2- 172.21.15.96:0/1501268587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f55c0 0x7f23900f59e0 secure :-1 s=READY pgs=3236 cs=0 l=1 rev1=1 rx=0x7f2380004660 tx=0x7f2380009b30).stop 2022-02-02T21:52:34.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 -- 172.21.15.96:0/1501268587 shutdown_connections 2022-02-02T21:52:34.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 --2- 172.21.15.96:0/1501268587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f6860 0x7f23900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:52:34.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 --2- 172.21.15.96:0/1501268587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f55c0 0x7f23900f59e0 unknown :-1 s=CLOSED pgs=3236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 -- 172.21.15.96:0/1501268587 >> 172.21.15.96:0/1501268587 conn(0x7f23900f0d40 msgr2=0x7f23900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:34.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 -- 172.21.15.96:0/1501268587 shutdown_connections 2022-02-02T21:52:34.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.590+0000 7f23975ba700 1 -- 172.21.15.96:0/1501268587 wait complete. 2022-02-02T21:52:34.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 Processor -- start 2022-02-02T21:52:34.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 -- start start 2022-02-02T21:52:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f55c0 0x7f2390109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390060450 con 0x7f23900f6860 2022-02-02T21:52:34.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f23975ba700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390060590 con 0x7f23900f55c0 2022-02-02T21:52:34.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45290/0 (socket says 172.21.15.96:45290) 2022-02-02T21:52:34.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 -- 172.21.15.96:0/149805739 learned_addr learned my addr 172.21.15.96:0/149805739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:52:34.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2395356700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f55c0 0x7f2390109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 -- 172.21.15.96:0/149805739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f55c0 msgr2=0x7f2390109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f55c0 0x7f2390109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 -- 172.21.15.96:0/149805739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380005040 con 0x7f23900f6860 2022-02-02T21:52:34.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.591+0000 7f2394b55700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 rx=0x7f238c00b410 tx=0x7f238c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:34.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.592+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238c0125f0 con 0x7f23900f6860 2022-02-02T21:52:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.592+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239010c7f0 con 0x7f23900f6860 2022-02-02T21:52:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.592+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f238c012c00 con 0x7f23900f6860 2022-02-02T21:52:34.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.592+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238c011d20 con 0x7f23900f6860 2022-02-02T21:52:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.592+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239010cdb0 con 0x7f23900f6860 2022-02-02T21:52:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.593+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370004fa0 con 0x7f23900f6860 2022-02-02T21:52:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.593+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f238c00f030 con 0x7f23900f6860 2022-02-02T21:52:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.593+0000 7f2385ffb700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 0x7f237c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:52:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.593+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f238c081d70 con 0x7f23900f6860 2022-02-02T21:52:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.593+0000 7f2395356700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 0x7f237c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:52:34.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.594+0000 7f2395356700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 0x7f237c067290 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f2380013690 tx=0x7f2380009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:52:34.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.598+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f238c0538a0 con 0x7f23900f6860 2022-02-02T21:52:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.798+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2370005e80 con 0x7f23900f6860 2022-02-02T21:52:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.798+0000 7f2385ffb700 1 -- 172.21.15.96:0/149805739 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f238c053490 con 0x7f23900f6860 2022-02-02T21:52:34.799 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:52:34.799 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:52:34.800 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:52:34.800 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:52:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:34.801 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:52:34.801 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:52:34.802 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:52:34.802 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:52:34.802 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:52:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:52:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:52:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:52:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:52:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:52:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:52:34.805 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:52:34.805 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:52:34.805 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:52:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:52:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:52:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:52:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:52:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:52:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:52:34.808 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:52:34.808 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:52:34.808 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:52:34.809 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:52:34.809 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:52:34.809 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:52:34.810 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:52:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:34.811 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:52:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:52:34.811 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:34.812 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:34.813 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:52:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 msgr2=0x7f237c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 0x7f237c067290 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f2380013690 tx=0x7f2380009b30).stop 2022-02-02T21:52:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 msgr2=0x7f239010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:52:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 rx=0x7f238c00b410 tx=0x7f238c006ef0).stop 2022-02-02T21:52:34.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 shutdown_connections 2022-02-02T21:52:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f237c064dd0 0x7f237c067290 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900f55c0 0x7f2390109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 --2- 172.21.15.96:0/149805739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23900f6860 0x7f239010c1e0 unknown :-1 s=CLOSED pgs=3237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:52:34.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 >> 172.21.15.96:0/149805739 conn(0x7f23900f0d40 msgr2=0x7f23900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:52:34.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 shutdown_connections 2022-02-02T21:52:34.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:52:34.800+0000 7f23975ba700 1 -- 172.21.15.96:0/149805739 wait complete. 2022-02-02T21:52:34.818 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:52:35.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:34 smithi159 ceph-mon[69013]: from='client.40572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:34 smithi159 ceph-mon[69013]: from='client.40576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/747830027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:52:35.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/149805739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:52:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:34 smithi096 ceph-mon[101353]: from='client.40572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:34 smithi096 ceph-mon[101353]: from='client.40576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:52:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/747830027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:52:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/149805739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:52:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:35 smithi159 ceph-mon[69013]: pgmap v6314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:35 smithi096 ceph-mon[101353]: pgmap v6314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:38.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:37 smithi159 ceph-mon[69013]: pgmap v6315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:37 smithi096 ceph-mon[101353]: pgmap v6315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:39 smithi159 ceph-mon[69013]: pgmap v6316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:39 smithi096 ceph-mon[101353]: pgmap v6316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:42.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:41 smithi159 ceph-mon[69013]: pgmap v6317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:42.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:41 smithi096 ceph-mon[101353]: pgmap v6317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:44.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:43 smithi159 ceph-mon[69013]: pgmap v6318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:44.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:43 smithi096 ceph-mon[101353]: pgmap v6318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:46.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:45 smithi159 ceph-mon[69013]: pgmap v6319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:46.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:45 smithi096 ceph-mon[101353]: pgmap v6319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:48.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:47 smithi159 ceph-mon[69013]: pgmap v6320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:47 smithi096 ceph-mon[101353]: pgmap v6320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:50.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:49 smithi159 ceph-mon[69013]: pgmap v6321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:49 smithi096 ceph-mon[101353]: pgmap v6321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:52.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:51 smithi159 ceph-mon[69013]: pgmap v6322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:52.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:51 smithi096 ceph-mon[101353]: pgmap v6322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:53 smithi159 ceph-mon[69013]: pgmap v6323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:54.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:53 smithi096 ceph-mon[101353]: pgmap v6323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:56.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:55 smithi159 ceph-mon[69013]: pgmap v6324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:56.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:55 smithi096 ceph-mon[101353]: pgmap v6324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:58.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:57 smithi159 ceph-mon[69013]: pgmap v6325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:52:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:57 smithi096 ceph-mon[101353]: pgmap v6325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:00.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:52:59 smithi159 ceph-mon[69013]: pgmap v6326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:52:59 smithi096 ceph-mon[101353]: pgmap v6326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:02.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:01 smithi159 ceph-mon[69013]: pgmap v6327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:01 smithi096 ceph-mon[101353]: pgmap v6327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:04.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:03 smithi159 ceph-mon[69013]: pgmap v6328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:04.334 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:03 smithi096 ceph-mon[101353]: pgmap v6328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:04.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 -- 172.21.15.96:0/1990716167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f6860 msgr2=0x7fa8b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/1990716167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f6860 0x7fa8b80f6cc0 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 rx=0x7fa8b4004660 tx=0x7fa8b4009b30).stop 2022-02-02T21:53:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 -- 172.21.15.96:0/1990716167 shutdown_connections 2022-02-02T21:53:04.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/1990716167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f6860 0x7fa8b80f6cc0 unknown :-1 s=CLOSED pgs=3238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:04.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/1990716167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f55c0 0x7fa8b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:04.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 -- 172.21.15.96:0/1990716167 >> 172.21.15.96:0/1990716167 conn(0x7fa8b80f0d40 msgr2=0x7fa8b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 -- 172.21.15.96:0/1990716167 shutdown_connections 2022-02-02T21:53:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.911+0000 7fa8c04f0700 1 -- 172.21.15.96:0/1990716167 wait complete. 2022-02-02T21:53:04.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 Processor -- start 2022-02-02T21:53:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 -- start start 2022-02-02T21:53:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:04.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f6860 0x7fa8b810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:04.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80603e0 con 0x7fa8b80f55c0 2022-02-02T21:53:04.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8c04f0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8060520 con 0x7fa8b80f6860 2022-02-02T21:53:04.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8be28c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:04.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.912+0000 7fa8be28c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45306/0 (socket says 172.21.15.96:45306) 2022-02-02T21:53:04.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8be28c700 1 -- 172.21.15.96:0/3217103610 learned_addr learned my addr 172.21.15.96:0/3217103610 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:04.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8be28c700 1 -- 172.21.15.96:0/3217103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f6860 msgr2=0x7fa8b810c150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T21:53:04.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8be28c700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f6860 0x7fa8b810c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:04.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8be28c700 1 -- 172.21.15.96:0/3217103610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4005040 con 0x7fa8b80f55c0 2022-02-02T21:53:04.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8be28c700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 rx=0x7fa8a800c530 tx=0x7fa8a8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:04.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a800f650 con 0x7fa8b80f55c0 2022-02-02T21:53:04.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa8a800fc60 con 0x7fa8b80f55c0 2022-02-02T21:53:04.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b810c700 con 0x7fa8b80f55c0 2022-02-02T21:53:04.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a8012d20 con 0x7fa8b80f55c0 2022-02-02T21:53:04.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.913+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b810ccc0 con 0x7fa8b80f55c0 2022-02-02T21:53:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.914+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b8045ad0 con 0x7fa8b80f55c0 2022-02-02T21:53:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.915+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa8a8019030 con 0x7fa8b80f55c0 2022-02-02T21:53:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.915+0000 7fa8aeffd700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 0x7fa8a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.916+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8a80816b0 con 0x7fa8b80f55c0 2022-02-02T21:53:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.916+0000 7fa8bda8b700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 0x7fa8a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.916+0000 7fa8bda8b700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 0x7fa8a4067290 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7fa8b4004e30 tx=0x7fa8b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:04.920+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8a804f800 con 0x7fa8b80f55c0 2022-02-02T21:53:05.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.101+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8b8057f10 con 0x7fa8a4064dd0 2022-02-02T21:53:05.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.102+0000 7fa8aeffd700 1 -- 172.21.15.96:0/3217103610 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa8b8057f10 con 0x7fa8a4064dd0 2022-02-02T21:53:05.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 msgr2=0x7fa8a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 0x7fa8a4067290 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7fa8b4004e30 tx=0x7fa8b4009b30).stop 2022-02-02T21:53:05.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 msgr2=0x7fa8b8109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 rx=0x7fa8a800c530 tx=0x7fa8a8007e10).stop 2022-02-02T21:53:05.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 shutdown_connections 2022-02-02T21:53:05.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a4064dd0 0x7fa8a4067290 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b80f55c0 0x7fa8b8109c50 unknown :-1 s=CLOSED pgs=3239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 --2- 172.21.15.96:0/3217103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b80f6860 0x7fa8b810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 >> 172.21.15.96:0/3217103610 conn(0x7fa8b80f0d40 msgr2=0x7fa8b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 shutdown_connections 2022-02-02T21:53:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.104+0000 7fa8c04f0700 1 -- 172.21.15.96:0/3217103610 wait complete. 2022-02-02T21:53:05.113 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:53:05.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 -- 172.21.15.96:0/3779900347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f9b80 msgr2=0x7fd3780f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 --2- 172.21.15.96:0/3779900347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f9b80 0x7fd3780f9fe0 secure :-1 s=READY pgs=3240 cs=0 l=1 rev1=1 rx=0x7fd368004660 tx=0x7fd368009b30).stop 2022-02-02T21:53:05.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 -- 172.21.15.96:0/3779900347 shutdown_connections 2022-02-02T21:53:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 --2- 172.21.15.96:0/3779900347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f9b80 0x7fd3780f9fe0 unknown :-1 s=CLOSED pgs=3240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 --2- 172.21.15.96:0/3779900347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f88e0 0x7fd3780f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 -- 172.21.15.96:0/3779900347 >> 172.21.15.96:0/3779900347 conn(0x7fd3780f40e0 msgr2=0x7fd3780f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 -- 172.21.15.96:0/3779900347 shutdown_connections 2022-02-02T21:53:05.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 -- 172.21.15.96:0/3779900347 wait complete. 2022-02-02T21:53:05.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.202+0000 7fd37e783700 1 Processor -- start 2022-02-02T21:53:05.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd37e783700 1 -- start start 2022-02-02T21:53:05.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd37e783700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd37e783700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f9b80 0x7fd378109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd37e783700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378109c00 con 0x7fd3780f88e0 2022-02-02T21:53:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd37e783700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378109d40 con 0x7fd3780f9b80 2022-02-02T21:53:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45316/0 (socket says 172.21.15.96:45316) 2022-02-02T21:53:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 -- 172.21.15.96:0/485273474 learned_addr learned my addr 172.21.15.96:0/485273474 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd3777fe700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f9b80 0x7fd378109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 -- 172.21.15.96:0/485273474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f9b80 msgr2=0x7fd378109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f9b80 0x7fd378109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.203+0000 7fd377fff700 1 -- 172.21.15.96:0/485273474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368005040 con 0x7fd3780f88e0 2022-02-02T21:53:05.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd377fff700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 rx=0x7fd36c002700 tx=0x7fd36c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c0079c0 con 0x7fd3780f88e0 2022-02-02T21:53:05.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37810a6e0 con 0x7fd3780f88e0 2022-02-02T21:53:05.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd36c00f040 con 0x7fd3780f88e0 2022-02-02T21:53:05.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c014860 con 0x7fd3780f88e0 2022-02-02T21:53:05.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.204+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37810aca0 con 0x7fd3780f88e0 2022-02-02T21:53:05.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.205+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd378045ad0 con 0x7fd3780f88e0 2022-02-02T21:53:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.205+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd36c01b060 con 0x7fd3780f88e0 2022-02-02T21:53:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.206+0000 7fd374ff9700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 0x7fd360067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.206+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd36c081810 con 0x7fd3780f88e0 2022-02-02T21:53:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.206+0000 7fd3777fe700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 0x7fd360067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.206+0000 7fd3777fe700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 0x7fd360067290 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7fd368004630 tx=0x7fd368009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.210+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd36c053340 con 0x7fd3780f88e0 2022-02-02T21:53:05.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.385+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd378101210 con 0x7fd360064dd0 2022-02-02T21:53:05.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.394+0000 7fd374ff9700 1 -- 172.21.15.96:0/485273474 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd378101210 con 0x7fd360064dd0 2022-02-02T21:53:05.395 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:53:05.395 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:53:05.395 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:53:05.396 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:53:05.396 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:53:05.396 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:53:05.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:53:05.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:53:05.397 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:53:05.398 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:53:05.398 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:53:05.398 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:53:05.399 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:53:05.399 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:53:05.399 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:53:05.400 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:53:05.400 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:53:05.400 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:53:05.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:53:05.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:53:05.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:53:05.402 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:53:05.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 msgr2=0x7fd360067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 0x7fd360067290 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7fd368004630 tx=0x7fd368009b30).stop 2022-02-02T21:53:05.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 msgr2=0x7fd378109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 rx=0x7fd36c002700 tx=0x7fd36c009d80).stop 2022-02-02T21:53:05.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 shutdown_connections 2022-02-02T21:53:05.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd360064dd0 0x7fd360067290 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3780f88e0 0x7fd378109160 unknown :-1 s=CLOSED pgs=3241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 --2- 172.21.15.96:0/485273474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3780f9b80 0x7fd378109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 >> 172.21.15.96:0/485273474 conn(0x7fd3780f40e0 msgr2=0x7fd3780fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 shutdown_connections 2022-02-02T21:53:05.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.396+0000 7fd37e783700 1 -- 172.21.15.96:0/485273474 wait complete. 2022-02-02T21:53:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 -- 172.21.15.96:0/464547488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f55c0 msgr2=0x7feaf00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 --2- 172.21.15.96:0/464547488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f55c0 0x7feaf00f59e0 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 rx=0x7feae0004660 tx=0x7feae0009b30).stop 2022-02-02T21:53:05.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 -- 172.21.15.96:0/464547488 shutdown_connections 2022-02-02T21:53:05.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 --2- 172.21.15.96:0/464547488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f6860 0x7feaf00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 --2- 172.21.15.96:0/464547488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f55c0 0x7feaf00f59e0 unknown :-1 s=CLOSED pgs=3242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 -- 172.21.15.96:0/464547488 >> 172.21.15.96:0/464547488 conn(0x7feaf00f0d40 msgr2=0x7feaf00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 -- 172.21.15.96:0/464547488 shutdown_connections 2022-02-02T21:53:05.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.493+0000 7feaf6969700 1 -- 172.21.15.96:0/464547488 wait complete. 2022-02-02T21:53:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 Processor -- start 2022-02-02T21:53:05.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 -- start start 2022-02-02T21:53:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f6860 0x7feaf010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0060420 con 0x7feaf00f6860 2022-02-02T21:53:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaf6969700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0060560 con 0x7feaf00f55c0 2022-02-02T21:53:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaeffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaeffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:49430/0 (socket says 172.21.15.96:49430) 2022-02-02T21:53:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.494+0000 7feaeffff700 1 -- 172.21.15.96:0/3793870944 learned_addr learned my addr 172.21.15.96:0/3793870944 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaef7fe700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f6860 0x7feaf010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaeffff700 1 -- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f6860 msgr2=0x7feaf010c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaeffff700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f6860 0x7feaf010c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaeffff700 1 -- 172.21.15.96:0/3793870944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0005040 con 0x7feaf00f55c0 2022-02-02T21:53:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaeffff700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feae0013a70 tx=0x7feae0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae0018070 con 0x7feaf00f55c0 2022-02-02T21:53:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf010c6e0 con 0x7feaf00f55c0 2022-02-02T21:53:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feae00097d0 con 0x7feaf00f55c0 2022-02-02T21:53:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae001c3c0 con 0x7feaf00f55c0 2022-02-02T21:53:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.495+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf010cc10 con 0x7feaf00f55c0 2022-02-02T21:53:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.496+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf0045ad0 con 0x7feaf00f55c0 2022-02-02T21:53:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.497+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feae0007ba0 con 0x7feaf00f55c0 2022-02-02T21:53:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.497+0000 7feaecff9700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 0x7feadc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.497+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feae0083720 con 0x7feaf00f55c0 2022-02-02T21:53:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.497+0000 7feaef7fe700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 0x7feadc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.497+0000 7feaef7fe700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 0x7feadc067290 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7fead80096c0 tx=0x7fead8009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.501+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feae0051820 con 0x7feaf00f55c0 2022-02-02T21:53:05.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.733+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feaf00fde50 con 0x7feaf00f55c0 2022-02-02T21:53:05.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.733+0000 7feaecff9700 1 -- 172.21.15.96:0/3793870944 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7feae0051030 con 0x7feaf00f55c0 2022-02-02T21:53:05.734 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:53:05.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:53:05.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:53:05.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:05.735 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:53:05.736 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:53:05.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:05.736 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:53:05.737 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:53:05.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:05.737 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:53:05.738 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:53:05.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:05.739 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:53:05.739 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:53:05.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:53:05.740 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:53:05.740 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:53:05.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 msgr2=0x7feadc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 0x7feadc067290 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7fead80096c0 tx=0x7fead8009be0).stop 2022-02-02T21:53:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 msgr2=0x7feaf0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feae0013a70 tx=0x7feae0009b30).stop 2022-02-02T21:53:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 shutdown_connections 2022-02-02T21:53:05.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feadc064dd0 0x7feadc067290 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaf00f55c0 0x7feaf0109c30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 --2- 172.21.15.96:0/3793870944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf00f6860 0x7feaf010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 >> 172.21.15.96:0/3793870944 conn(0x7feaf00f0d40 msgr2=0x7feaf00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 shutdown_connections 2022-02-02T21:53:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.735+0000 7feaf6969700 1 -- 172.21.15.96:0/3793870944 wait complete. 2022-02-02T21:53:05.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 -- 172.21.15.96:0/1388239277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f55c0 msgr2=0x7f50800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 --2- 172.21.15.96:0/1388239277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f55c0 0x7f50800f59e0 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 rx=0x7f5074004660 tx=0x7f5074009b30).stop 2022-02-02T21:53:05.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 -- 172.21.15.96:0/1388239277 shutdown_connections 2022-02-02T21:53:05.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 --2- 172.21.15.96:0/1388239277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f6860 0x7f50800f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:05.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 --2- 172.21.15.96:0/1388239277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f55c0 0x7f50800f59e0 unknown :-1 s=CLOSED pgs=3243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 -- 172.21.15.96:0/1388239277 >> 172.21.15.96:0/1388239277 conn(0x7f50800f0d40 msgr2=0x7f50800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:05.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 -- 172.21.15.96:0/1388239277 shutdown_connections 2022-02-02T21:53:05.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.833+0000 7f5084bb5700 1 -- 172.21.15.96:0/1388239277 wait complete. 2022-02-02T21:53:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 Processor -- start 2022-02-02T21:53:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 -- start start 2022-02-02T21:53:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f55c0 0x7f5080109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080060450 con 0x7f50800f6860 2022-02-02T21:53:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f5084bb5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080060590 con 0x7f50800f55c0 2022-02-02T21:53:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45338/0 (socket says 172.21.15.96:45338) 2022-02-02T21:53:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f55c0 0x7f5080109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 -- 172.21.15.96:0/2965539809 learned_addr learned my addr 172.21.15.96:0/2965539809 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 -- 172.21.15.96:0/2965539809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f55c0 msgr2=0x7f5080109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f55c0 0x7f5080109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.834+0000 7f507dd9b700 1 -- 172.21.15.96:0/2965539809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074005040 con 0x7f50800f6860 2022-02-02T21:53:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f507dd9b700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 rx=0x7f507000b410 tx=0x7f5070006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50700125f0 con 0x7f50800f6860 2022-02-02T21:53:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5070012c00 con 0x7f50800f6860 2022-02-02T21:53:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508010c7f0 con 0x7f50800f6860 2022-02-02T21:53:05.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5070011d20 con 0x7f50800f6860 2022-02-02T21:53:05.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.835+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508010cdb0 con 0x7f50800f6860 2022-02-02T21:53:05.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.836+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5080045ad0 con 0x7f50800f6860 2022-02-02T21:53:05.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.836+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f507000f030 con 0x7f50800f6860 2022-02-02T21:53:05.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.837+0000 7f506effd700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 0x7f5068067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.837+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50700821e0 con 0x7f50800f6860 2022-02-02T21:53:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.837+0000 7f507e59c700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 0x7f5068067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.837+0000 7f507e59c700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 0x7f5068067290 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f5074013690 tx=0x7f5074009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:05.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:05.840+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50700503a0 con 0x7f50800f6860 2022-02-02T21:53:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.042+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50800fdf40 con 0x7f50800f6860 2022-02-02T21:53:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.042+0000 7f506effd700 1 -- 172.21.15.96:0/2965539809 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f50700539c0 con 0x7f50800f6860 2022-02-02T21:53:06.043 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:53:06.043 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:53:06.043 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:53:06.044 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:53:06.044 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:06.045 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:53:06.045 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:53:06.045 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:53:06.046 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:53:06.046 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:53:06.046 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:53:06.047 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:53:06.047 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:53:06.047 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:53:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:53:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:53:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:53:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:53:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:53:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:53:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:53:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:53:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:53:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:53:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:53:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:53:06.052 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:53:06.052 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:53:06.052 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:53:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:53:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:53:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:53:06.054 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:06.054 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:06.054 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:53:06.055 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:06.055 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:06.055 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:06.056 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:06.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 msgr2=0x7f5068067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:06.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 0x7f5068067290 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f5074013690 tx=0x7f5074009b30).stop 2022-02-02T21:53:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 msgr2=0x7f508010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 rx=0x7f507000b410 tx=0x7f5070006ef0).stop 2022-02-02T21:53:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 shutdown_connections 2022-02-02T21:53:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5068064dd0 0x7f5068067290 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50800f55c0 0x7f5080109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:06.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 --2- 172.21.15.96:0/2965539809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50800f6860 0x7f508010c1e0 unknown :-1 s=CLOSED pgs=3244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:06.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 >> 172.21.15.96:0/2965539809 conn(0x7f50800f0d40 msgr2=0x7f50800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:06.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 shutdown_connections 2022-02-02T21:53:06.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:06.044+0000 7f5084bb5700 1 -- 172.21.15.96:0/2965539809 wait complete. 2022-02-02T21:53:06.061 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:53:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:05 smithi159 ceph-mon[69013]: pgmap v6329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:06.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:05 smithi159 ceph-mon[69013]: from='client.40588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:06.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:05 smithi159 ceph-mon[69013]: from='client.40592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3793870944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:53:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:05 smithi096 ceph-mon[101353]: pgmap v6329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:06.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:05 smithi096 ceph-mon[101353]: from='client.40588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:06.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:05 smithi096 ceph-mon[101353]: from='client.40592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:06.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3793870944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:53:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2965539809' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:53:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2965539809' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:53:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:07 smithi159 ceph-mon[69013]: pgmap v6330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:08.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:07 smithi096 ceph-mon[101353]: pgmap v6330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:09 smithi159 ceph-mon[69013]: pgmap v6331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:09 smithi096 ceph-mon[101353]: pgmap v6331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:11 smithi159 ceph-mon[69013]: pgmap v6332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:11 smithi096 ceph-mon[101353]: pgmap v6332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:14.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:13 smithi159 ceph-mon[69013]: pgmap v6333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:13 smithi096 ceph-mon[101353]: pgmap v6333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:15 smithi159 ceph-mon[69013]: pgmap v6334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:15 smithi096 ceph-mon[101353]: pgmap v6334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:18.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:17 smithi159 ceph-mon[69013]: pgmap v6335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:17 smithi096 ceph-mon[101353]: pgmap v6335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:20.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:19 smithi159 ceph-mon[69013]: pgmap v6336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:19 smithi096 ceph-mon[101353]: pgmap v6336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:22.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:21 smithi159 ceph-mon[69013]: pgmap v6337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:21 smithi096 ceph-mon[101353]: pgmap v6337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:24.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:23 smithi159 ceph-mon[69013]: pgmap v6338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:23 smithi096 ceph-mon[101353]: pgmap v6338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:26.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:25 smithi159 ceph-mon[69013]: pgmap v6339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:25 smithi096 ceph-mon[101353]: pgmap v6339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:28 smithi159 ceph-mon[69013]: pgmap v6340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:53:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:53:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:28 smithi096 ceph-mon[101353]: pgmap v6340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:53:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:53:30.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:30 smithi159 ceph-mon[69013]: pgmap v6341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:30 smithi096 ceph-mon[101353]: pgmap v6341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:32.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:32 smithi159 ceph-mon[69013]: pgmap v6342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:32 smithi096 ceph-mon[101353]: pgmap v6342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:34.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:34 smithi159 ceph-mon[69013]: pgmap v6343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:34.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:34 smithi096 ceph-mon[101353]: pgmap v6343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:36.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 -- 172.21.15.96:0/1069940031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 msgr2=0x7f99c40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/1069940031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c40f7de0 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 rx=0x7f99c0004660 tx=0x7f99c0009b30).stop 2022-02-02T21:53:36.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 -- 172.21.15.96:0/1069940031 shutdown_connections 2022-02-02T21:53:36.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/1069940031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c40f7de0 unknown :-1 s=CLOSED pgs=3245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/1069940031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 0x7f99c40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 -- 172.21.15.96:0/1069940031 >> 172.21.15.96:0/1069940031 conn(0x7f99c40f1e40 msgr2=0x7f99c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 -- 172.21.15.96:0/1069940031 shutdown_connections 2022-02-02T21:53:36.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.153+0000 7f99cc3eb700 1 -- 172.21.15.96:0/1069940031 wait complete. 2022-02-02T21:53:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 Processor -- start 2022-02-02T21:53:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 -- start start 2022-02-02T21:53:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 0x7f99c4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4107a00 con 0x7f99c40f7980 2022-02-02T21:53:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99cc3eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4107b40 con 0x7f99c40f66e0 2022-02-02T21:53:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99c9986700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99c9986700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45370/0 (socket says 172.21.15.96:45370) 2022-02-02T21:53:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.154+0000 7f99c9986700 1 -- 172.21.15.96:0/3262111428 learned_addr learned my addr 172.21.15.96:0/3262111428 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99ca187700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 0x7f99c4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99c9986700 1 -- 172.21.15.96:0/3262111428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 msgr2=0x7f99c4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99c9986700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 0x7f99c4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99c9986700 1 -- 172.21.15.96:0/3262111428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0005040 con 0x7f99c40f7980 2022-02-02T21:53:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99c9986700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 rx=0x7f99c0009990 tx=0x7f99c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c0018070 con 0x7f99c40f7980 2022-02-02T21:53:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99c0007ba0 con 0x7f99c40f7980 2022-02-02T21:53:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c4108480 con 0x7f99c40f7980 2022-02-02T21:53:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c001c620 con 0x7f99c40f7980 2022-02-02T21:53:36.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.155+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c41089e0 con 0x7f99c40f7980 2022-02-02T21:53:36.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.156+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c4045ad0 con 0x7f99c40f7980 2022-02-02T21:53:36.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.157+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99c001c8e0 con 0x7f99c40f7980 2022-02-02T21:53:36.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.157+0000 7f99baffd700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 0x7f99b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.157+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99c0083850 con 0x7f99c40f7980 2022-02-02T21:53:36.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.157+0000 7f99ca187700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 0x7f99b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.157+0000 7f99ca187700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 0x7f99b0067290 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f99c40f77e0 tx=0x7f99b4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.162+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99c0055380 con 0x7f99c40f7980 2022-02-02T21:53:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:36 smithi159 ceph-mon[69013]: pgmap v6344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:36 smithi096 ceph-mon[101353]: pgmap v6344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.341+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99c40ff010 con 0x7f99b0064dd0 2022-02-02T21:53:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.343+0000 7f99baffd700 1 -- 172.21.15.96:0/3262111428 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f99c40ff010 con 0x7f99b0064dd0 2022-02-02T21:53:36.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 msgr2=0x7f99b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 0x7f99b0067290 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f99c40f77e0 tx=0x7f99b4009040).stop 2022-02-02T21:53:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 msgr2=0x7f99c4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 rx=0x7f99c0009990 tx=0x7f99c0009b30).stop 2022-02-02T21:53:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 shutdown_connections 2022-02-02T21:53:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f99b0064dd0 0x7f99b0067290 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99c40f66e0 0x7f99c4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.344+0000 7f99cc3eb700 1 --2- 172.21.15.96:0/3262111428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99c40f7980 0x7f99c4107450 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.345+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 >> 172.21.15.96:0/3262111428 conn(0x7f99c40f1e40 msgr2=0x7f99c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.345+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 shutdown_connections 2022-02-02T21:53:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.345+0000 7f99cc3eb700 1 -- 172.21.15.96:0/3262111428 wait complete. 2022-02-02T21:53:36.355 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:53:36.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 -- 172.21.15.96:0/2069565748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f66d0 msgr2=0x7faff00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 --2- 172.21.15.96:0/2069565748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f66d0 0x7faff00f6b30 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 rx=0x7fafe4004660 tx=0x7fafe4009b30).stop 2022-02-02T21:53:36.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 -- 172.21.15.96:0/2069565748 shutdown_connections 2022-02-02T21:53:36.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 --2- 172.21.15.96:0/2069565748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f66d0 0x7faff00f6b30 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 --2- 172.21.15.96:0/2069565748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f5430 0x7faff00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 -- 172.21.15.96:0/2069565748 >> 172.21.15.96:0/2069565748 conn(0x7faff00f0b90 msgr2=0x7faff00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 -- 172.21.15.96:0/2069565748 shutdown_connections 2022-02-02T21:53:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.441+0000 7fafef59e700 1 -- 172.21.15.96:0/2069565748 wait complete. 2022-02-02T21:53:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 Processor -- start 2022-02-02T21:53:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 -- start start 2022-02-02T21:53:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 0x7faff010e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00602b0 con 0x7faff00f5430 2022-02-02T21:53:36.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafef59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00603f0 con 0x7faff00f66d0 2022-02-02T21:53:36.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45378/0 (socket says 172.21.15.96:45378) 2022-02-02T21:53:36.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.442+0000 7fafee59c700 1 -- 172.21.15.96:0/3290176214 learned_addr learned my addr 172.21.15.96:0/3290176214 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:36.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafedd9b700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 0x7faff010e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafee59c700 1 -- 172.21.15.96:0/3290176214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 msgr2=0x7faff010e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafee59c700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 0x7faff010e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafee59c700 1 -- 172.21.15.96:0/3290176214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4005040 con 0x7faff00f5430 2022-02-02T21:53:36.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafedd9b700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 0x7faff010e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:53:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafee59c700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 rx=0x7fafe00093f0 tx=0x7fafe0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe0009ea0 con 0x7faff00f5430 2022-02-02T21:53:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff010e8a0 con 0x7faff00f5430 2022-02-02T21:53:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafe0013af0 con 0x7faff00f5430 2022-02-02T21:53:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe000db10 con 0x7faff00f5430 2022-02-02T21:53:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.443+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff010ed80 con 0x7faff00f5430 2022-02-02T21:53:36.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.444+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff0045ad0 con 0x7faff00f5430 2022-02-02T21:53:36.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.444+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fafe001a060 con 0x7faff00f5430 2022-02-02T21:53:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.445+0000 7fafdeffd700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 0x7fafd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.445+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fafe0081a90 con 0x7faff00f5430 2022-02-02T21:53:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.445+0000 7fafedd9b700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 0x7fafd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.445+0000 7fafedd9b700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 0x7fafd80672e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7fafe4009da0 tx=0x7fafe4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.449+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fafe004fb90 con 0x7faff00f5430 2022-02-02T21:53:36.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.621+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faff0057f10 con 0x7fafd8064e20 2022-02-02T21:53:36.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.630+0000 7fafdeffd700 1 -- 172.21.15.96:0/3290176214 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faff0057f10 con 0x7fafd8064e20 2022-02-02T21:53:36.632 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:53:36.632 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:53:36.633 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:53:36.633 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:53:36.633 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:53:36.634 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:53:36.634 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:53:36.634 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:53:36.635 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:53:36.635 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:53:36.635 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:53:36.636 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:53:36.636 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:53:36.636 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:53:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:53:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:53:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:53:36.638 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:53:36.639 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:53:36.639 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:53:36.640 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:53:36.640 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:53:36.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 msgr2=0x7fafd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 0x7fafd80672e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7fafe4009da0 tx=0x7fafe4009b30).stop 2022-02-02T21:53:36.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 msgr2=0x7faff010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 rx=0x7fafe00093f0 tx=0x7fafe0006ec0).stop 2022-02-02T21:53:36.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 shutdown_connections 2022-02-02T21:53:36.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fafd8064e20 0x7fafd80672e0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff00f5430 0x7faff010beb0 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 --2- 172.21.15.96:0/3290176214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faff00f66d0 0x7faff010e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 >> 172.21.15.96:0/3290176214 conn(0x7faff00f0b90 msgr2=0x7faff00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 shutdown_connections 2022-02-02T21:53:36.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.633+0000 7fafef59e700 1 -- 172.21.15.96:0/3290176214 wait complete. 2022-02-02T21:53:36.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 -- 172.21.15.96:0/2786687421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f55c0 msgr2=0x7f6c140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 --2- 172.21.15.96:0/2786687421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f55c0 0x7f6c140f59e0 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 rx=0x7f6bfc004660 tx=0x7f6bfc009b30).stop 2022-02-02T21:53:36.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 -- 172.21.15.96:0/2786687421 shutdown_connections 2022-02-02T21:53:36.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 --2- 172.21.15.96:0/2786687421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f6860 0x7f6c140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 --2- 172.21.15.96:0/2786687421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f55c0 0x7f6c140f59e0 unknown :-1 s=CLOSED pgs=3249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 -- 172.21.15.96:0/2786687421 >> 172.21.15.96:0/2786687421 conn(0x7f6c140f0d40 msgr2=0x7f6c140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 -- 172.21.15.96:0/2786687421 shutdown_connections 2022-02-02T21:53:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.731+0000 7f6c1914f700 1 -- 172.21.15.96:0/2786687421 wait complete. 2022-02-02T21:53:36.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 Processor -- start 2022-02-02T21:53:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 -- start start 2022-02-02T21:53:36.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f55c0 0x7f6c14109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140603c0 con 0x7f6c140f6860 2022-02-02T21:53:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1914f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c14060500 con 0x7f6c140f55c0 2022-02-02T21:53:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45388/0 (socket says 172.21.15.96:45388) 2022-02-02T21:53:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 -- 172.21.15.96:0/470536974 learned_addr learned my addr 172.21.15.96:0/470536974 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c12d9d700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f55c0 0x7f6c14109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 -- 172.21.15.96:0/470536974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f55c0 msgr2=0x7f6c14109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f55c0 0x7f6c14109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 -- 172.21.15.96:0/470536974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc005040 con 0x7f6c140f6860 2022-02-02T21:53:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.732+0000 7f6c1259c700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 rx=0x7f6c040026d0 tx=0x7f6c04009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.733+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c040079c0 con 0x7f6c140f6860 2022-02-02T21:53:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.733+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1410c740 con 0x7f6c140f6860 2022-02-02T21:53:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.733+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c0400f040 con 0x7f6c140f6860 2022-02-02T21:53:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.733+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c040148b0 con 0x7f6c140f6860 2022-02-02T21:53:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.733+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1410ccd0 con 0x7f6c140f6860 2022-02-02T21:53:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.734+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c140f49b0 con 0x7f6c140f6860 2022-02-02T21:53:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.734+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c04007b20 con 0x7f6c140f6860 2022-02-02T21:53:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.735+0000 7f6c0b7fe700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 0x7f6c00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.735+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6c04081990 con 0x7f6c140f6860 2022-02-02T21:53:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.735+0000 7f6c12d9d700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 0x7f6c00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.735+0000 7f6c12d9d700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 0x7f6c00067290 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f6bfc013690 tx=0x7f6bfc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:36.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.739+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c0404fa90 con 0x7f6c140f6860 2022-02-02T21:53:36.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.968+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c14045ad0 con 0x7f6c140f6860 2022-02-02T21:53:36.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.969+0000 7f6c0b7fe700 1 -- 172.21.15.96:0/470536974 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6c040530b0 con 0x7f6c140f6860 2022-02-02T21:53:36.970 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:53:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:53:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:53:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:53:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:53:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:53:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:53:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:53:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:53:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:53:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:53:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:53:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:53:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:53:36.976 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:53:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 msgr2=0x7f6c00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 0x7f6c00067290 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f6bfc013690 tx=0x7f6bfc009b30).stop 2022-02-02T21:53:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 msgr2=0x7f6c1410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:36.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 rx=0x7f6c040026d0 tx=0x7f6c04009de0).stop 2022-02-02T21:53:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 shutdown_connections 2022-02-02T21:53:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c00064dd0 0x7f6c00067290 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c140f55c0 0x7f6c14109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 --2- 172.21.15.96:0/470536974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c140f6860 0x7f6c1410c190 unknown :-1 s=CLOSED pgs=3250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 >> 172.21.15.96:0/470536974 conn(0x7f6c140f0d40 msgr2=0x7f6c140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:36.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 shutdown_connections 2022-02-02T21:53:36.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:36.971+0000 7f6c1914f700 1 -- 172.21.15.96:0/470536974 wait complete. 2022-02-02T21:53:37.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.069+0000 7faafa05b700 1 -- 172.21.15.96:0/3954836417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 msgr2=0x7faaf40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:37.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.069+0000 7faafa05b700 1 --2- 172.21.15.96:0/3954836417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf40f6950 secure :-1 s=READY pgs=3251 cs=0 l=1 rev1=1 rx=0x7faaf0004660 tx=0x7faaf0009b30).stop 2022-02-02T21:53:37.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- 172.21.15.96:0/3954836417 shutdown_connections 2022-02-02T21:53:37.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 --2- 172.21.15.96:0/3954836417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf40f77d0 0x7faaf40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:37.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 --2- 172.21.15.96:0/3954836417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf40f6950 unknown :-1 s=CLOSED pgs=3251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:37.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- 172.21.15.96:0/3954836417 >> 172.21.15.96:0/3954836417 conn(0x7faaf40f1c90 msgr2=0x7faaf40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:37.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- 172.21.15.96:0/3954836417 shutdown_connections 2022-02-02T21:53:37.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- 172.21.15.96:0/3954836417 wait complete. 2022-02-02T21:53:37.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 Processor -- start 2022-02-02T21:53:37.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- start start 2022-02-02T21:53:37.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:37.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf40f77d0 0x7faaf4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:37.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4107880 con 0x7faaf40f6530 2022-02-02T21:53:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.070+0000 7faafa05b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4108090 con 0x7faaf40f77d0 2022-02-02T21:53:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45396/0 (socket says 172.21.15.96:45396) 2022-02-02T21:53:37.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 -- 172.21.15.96:0/109721829 learned_addr learned my addr 172.21.15.96:0/109721829 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:53:37.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 -- 172.21.15.96:0/109721829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf40f77d0 msgr2=0x7faaf4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf40f77d0 0x7faaf4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 -- 172.21.15.96:0/109721829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf0005040 con 0x7faaf40f6530 2022-02-02T21:53:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faaf9059700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 rx=0x7faaf0013a70 tx=0x7faaf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf0018070 con 0x7faaf40f6530 2022-02-02T21:53:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf41082b0 con 0x7faaf40f6530 2022-02-02T21:53:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faaf00097d0 con 0x7faaf40f6530 2022-02-02T21:53:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf001c3c0 con 0x7faaf40f6530 2022-02-02T21:53:37.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.071+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4108810 con 0x7faaf40f6530 2022-02-02T21:53:37.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.072+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4059100 con 0x7faaf40f6530 2022-02-02T21:53:37.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.073+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faaf0007ba0 con 0x7faaf40f6530 2022-02-02T21:53:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.073+0000 7faae9ffb700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:53:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.073+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faaf0083740 con 0x7faaf40f6530 2022-02-02T21:53:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.073+0000 7faaf8858700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:53:37.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.074+0000 7faaf8858700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7faae4009880 tx=0x7faae4009a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:53:37.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.078+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faaf0051900 con 0x7faaf40f6530 2022-02-02T21:53:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:37 smithi159 ceph-mon[69013]: from='client.40604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/470536974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:53:37.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.281+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaf40fecf0 con 0x7faaf40f6530 2022-02-02T21:53:37.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:37 smithi096 ceph-mon[101353]: from='client.40604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:37.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/470536974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:53:37.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.282+0000 7faae9ffb700 1 -- 172.21.15.96:0/109721829 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7faaf0054f20 con 0x7faaf40f6530 2022-02-02T21:53:37.285 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:53:37.285 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:53:37.286 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:53:37.286 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:53:37.287 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:37.287 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:53:37.287 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:53:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:53:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:53:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:53:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:53:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:53:37.290 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:53:37.290 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:53:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:53:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:53:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:53:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:53:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:53:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:53:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:53:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:53:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:53:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:53:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:53:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:53:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:53:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:53:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:53:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:53:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:53:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:53:37.297 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:37.297 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:37.297 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:53:37.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:53:37.298 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:37.298 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:37.299 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:53:37.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 msgr2=0x7faae00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:37.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7faae4009880 tx=0x7faae4009a60).stop 2022-02-02T21:53:37.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 msgr2=0x7faaf4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:53:37.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 rx=0x7faaf0013a70 tx=0x7faaf0009b30).stop 2022-02-02T21:53:37.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 shutdown_connections 2022-02-02T21:53:37.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faae0064e20 0x7faae00672e0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:37.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaf40f6530 0x7faaf4106d90 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:53:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 --2- 172.21.15.96:0/109721829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf40f77d0 0x7faaf4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:53:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 >> 172.21.15.96:0/109721829 conn(0x7faaf40f1c90 msgr2=0x7faaf40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:53:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 shutdown_connections 2022-02-02T21:53:37.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:53:37.284+0000 7faafa05b700 1 -- 172.21.15.96:0/109721829 wait complete. 2022-02-02T21:53:37.304 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:53:38.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:38 smithi159 ceph-mon[69013]: pgmap v6345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:38.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:38 smithi159 ceph-mon[69013]: from='client.40608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:38.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/109721829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:53:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:38 smithi096 ceph-mon[101353]: pgmap v6345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:38 smithi096 ceph-mon[101353]: from='client.40608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:53:38.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/109721829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:53:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:40 smithi159 ceph-mon[69013]: pgmap v6346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:40 smithi096 ceph-mon[101353]: pgmap v6346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:42.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:42 smithi159 ceph-mon[69013]: pgmap v6347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:42.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:42 smithi096 ceph-mon[101353]: pgmap v6347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:44.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:44 smithi096 ceph-mon[101353]: pgmap v6348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:44 smithi159 ceph-mon[69013]: pgmap v6348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:46.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:46 smithi096 ceph-mon[101353]: pgmap v6349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:46 smithi159 ceph-mon[69013]: pgmap v6349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:48 smithi096 ceph-mon[101353]: pgmap v6350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:48 smithi159 ceph-mon[69013]: pgmap v6350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:50 smithi096 ceph-mon[101353]: pgmap v6351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:50 smithi159 ceph-mon[69013]: pgmap v6351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:52.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:52 smithi096 ceph-mon[101353]: pgmap v6352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:52 smithi159 ceph-mon[69013]: pgmap v6352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:54.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:54 smithi096 ceph-mon[101353]: pgmap v6353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:54 smithi159 ceph-mon[69013]: pgmap v6353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:56.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:56 smithi096 ceph-mon[101353]: pgmap v6354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:56 smithi159 ceph-mon[69013]: pgmap v6354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:53:58 smithi096 ceph-mon[101353]: pgmap v6355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:53:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:53:58 smithi159 ceph-mon[69013]: pgmap v6355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:00 smithi096 ceph-mon[101353]: pgmap v6356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:00 smithi159 ceph-mon[69013]: pgmap v6356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:02 smithi096 ceph-mon[101353]: pgmap v6357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:02 smithi159 ceph-mon[69013]: pgmap v6357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:04 smithi159 ceph-mon[69013]: pgmap v6358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:04 smithi096 ceph-mon[101353]: pgmap v6358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:06 smithi159 ceph-mon[69013]: pgmap v6359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:06 smithi096 ceph-mon[101353]: pgmap v6359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:07.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.394+0000 7fe2f6913700 1 -- 172.21.15.96:0/2144652092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 msgr2=0x7fe2f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.394+0000 7fe2f6913700 1 --2- 172.21.15.96:0/2144652092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f00f7de0 secure :-1 s=READY pgs=3253 cs=0 l=1 rev1=1 rx=0x7fe2e4004660 tx=0x7fe2e4009b30).stop 2022-02-02T21:54:07.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 -- 172.21.15.96:0/2144652092 shutdown_connections 2022-02-02T21:54:07.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 --2- 172.21.15.96:0/2144652092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f00f7de0 unknown :-1 s=CLOSED pgs=3253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 --2- 172.21.15.96:0/2144652092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 0x7fe2f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 -- 172.21.15.96:0/2144652092 >> 172.21.15.96:0/2144652092 conn(0x7fe2f00f1e40 msgr2=0x7fe2f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:07.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 -- 172.21.15.96:0/2144652092 shutdown_connections 2022-02-02T21:54:07.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 -- 172.21.15.96:0/2144652092 wait complete. 2022-02-02T21:54:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 Processor -- start 2022-02-02T21:54:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.395+0000 7fe2f6913700 1 -- start start 2022-02-02T21:54:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2f6913700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 0x7fe2f0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2f6913700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2f6913700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0107a00 con 0x7fe2f00f7980 2022-02-02T21:54:07.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2f6913700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0107b40 con 0x7fe2f00f66e0 2022-02-02T21:54:07.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45420/0 (socket says 172.21.15.96:45420) 2022-02-02T21:54:07.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 -- 172.21.15.96:0/3661665950 learned_addr learned my addr 172.21.15.96:0/3661665950 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:07.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2effff700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 0x7fe2f0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 -- 172.21.15.96:0/3661665950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 msgr2=0x7fe2f0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 0x7fe2f0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 -- 172.21.15.96:0/3661665950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4005040 con 0x7fe2f00f7980 2022-02-02T21:54:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ef7fe700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 rx=0x7fe2e4009990 tx=0x7fe2e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.396+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e4018070 con 0x7fe2f00f7980 2022-02-02T21:54:07.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.397+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f0108480 con 0x7fe2f00f7980 2022-02-02T21:54:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.397+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2e4007ca0 con 0x7fe2f00f7980 2022-02-02T21:54:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.397+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e401c620 con 0x7fe2f00f7980 2022-02-02T21:54:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.397+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f01089e0 con 0x7fe2f00f7980 2022-02-02T21:54:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.398+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0045ad0 con 0x7fe2f00f7980 2022-02-02T21:54:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.398+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2e401d960 con 0x7fe2f00f7980 2022-02-02T21:54:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.398+0000 7fe2ecff9700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 0x7fe2d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.399+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2e4083710 con 0x7fe2f00f7980 2022-02-02T21:54:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.399+0000 7fe2effff700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 0x7fe2d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.399+0000 7fe2effff700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 0x7fe2d8067290 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7fe2f00f77e0 tx=0x7fe2e0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.403+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2e4055300 con 0x7fe2f00f7980 2022-02-02T21:54:07.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.582+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2f00fefb0 con 0x7fe2d8064dd0 2022-02-02T21:54:07.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.583+0000 7fe2ecff9700 1 -- 172.21.15.96:0/3661665950 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe2f00fefb0 con 0x7fe2d8064dd0 2022-02-02T21:54:07.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 msgr2=0x7fe2d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 0x7fe2d8067290 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7fe2f00f77e0 tx=0x7fe2e0009040).stop 2022-02-02T21:54:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 msgr2=0x7fe2f0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 rx=0x7fe2e4009990 tx=0x7fe2e4009b30).stop 2022-02-02T21:54:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 shutdown_connections 2022-02-02T21:54:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2d8064dd0 0x7fe2d8067290 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2f00f66e0 0x7fe2f0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 --2- 172.21.15.96:0/3661665950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2f00f7980 0x7fe2f0107450 unknown :-1 s=CLOSED pgs=3254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 >> 172.21.15.96:0/3661665950 conn(0x7fe2f00f1e40 msgr2=0x7fe2f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 shutdown_connections 2022-02-02T21:54:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.585+0000 7fe2f6913700 1 -- 172.21.15.96:0/3661665950 wait complete. 2022-02-02T21:54:07.595 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:54:07.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3820504225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f66d0 msgr2=0x7f0f840f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3820504225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f66d0 0x7f0f840f6af0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 rx=0x7f0f74004660 tx=0x7f0f74009b30).stop 2022-02-02T21:54:07.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3820504225 shutdown_connections 2022-02-02T21:54:07.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3820504225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f7970 0x7f0f840f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:54:07.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3820504225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f66d0 0x7f0f840f6af0 unknown :-1 s=CLOSED pgs=3255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3820504225 >> 172.21.15.96:0/3820504225 conn(0x7f0f840f1e10 msgr2=0x7f0f840f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:07.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3820504225 shutdown_connections 2022-02-02T21:54:07.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.682+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3820504225 wait complete. 2022-02-02T21:54:07.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 Processor -- start 2022-02-02T21:54:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 -- start start 2022-02-02T21:54:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f66d0 0x7f0f84106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84107ab0 con 0x7f0f840f7970 2022-02-02T21:54:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f8bd38700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84108360 con 0x7f0f840f66d0 2022-02-02T21:54:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45430/0 (socket says 172.21.15.96:45430) 2022-02-02T21:54:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 -- 172.21.15.96:0/3413153536 learned_addr learned my addr 172.21.15.96:0/3413153536 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f89ad4700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f66d0 0x7f0f84106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 -- 172.21.15.96:0/3413153536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f66d0 msgr2=0x7f0f84106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f66d0 0x7f0f84106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.683+0000 7f0f892d3700 1 -- 172.21.15.96:0/3413153536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74005040 con 0x7f0f840f7970 2022-02-02T21:54:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f892d3700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 rx=0x7f0f8000b410 tx=0x7f0f80006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f800125f0 con 0x7f0f840f7970 2022-02-02T21:54:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f80012c00 con 0x7f0f840f7970 2022-02-02T21:54:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84108640 con 0x7f0f840f7970 2022-02-02T21:54:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f80002ae0 con 0x7f0f840f7970 2022-02-02T21:54:07.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.684+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84108c00 con 0x7f0f840f7970 2022-02-02T21:54:07.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.685+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f840f5ac0 con 0x7f0f840f7970 2022-02-02T21:54:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.685+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f8000f030 con 0x7f0f840f7970 2022-02-02T21:54:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.686+0000 7f0f7a7fc700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 0x7f0f70067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.686+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0f80081f10 con 0x7f0f840f7970 2022-02-02T21:54:07.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.686+0000 7f0f89ad4700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 0x7f0f70067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.686+0000 7f0f89ad4700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 0x7f0f70067270 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f0f74013690 tx=0x7f0f74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.690+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f80053a40 con 0x7f0f840f7970 2022-02-02T21:54:07.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.862+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f840fef10 con 0x7f0f70064db0 2022-02-02T21:54:07.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.871+0000 7f0f7a7fc700 1 -- 172.21.15.96:0/3413153536 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0f840fef10 con 0x7f0f70064db0 2022-02-02T21:54:07.872 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:54:07.873 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:54:07.873 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:54:07.873 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:54:07.874 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:54:07.874 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:54:07.874 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:54:07.875 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:54:07.875 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:54:07.875 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:54:07.876 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:54:07.876 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:54:07.876 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:54:07.877 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:54:07.877 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:54:07.877 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:54:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:54:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:54:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:54:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:54:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:54:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:54:07.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 msgr2=0x7f0f70067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 0x7f0f70067270 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f0f74013690 tx=0x7f0f74009b30).stop 2022-02-02T21:54:07.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 msgr2=0x7f0f84107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 rx=0x7f0f8000b410 tx=0x7f0f80006ef0).stop 2022-02-02T21:54:07.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 shutdown_connections 2022-02-02T21:54:07.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f70064db0 0x7f0f70067270 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f840f66d0 0x7f0f84106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 --2- 172.21.15.96:0/3413153536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f840f7970 0x7f0f84107470 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 >> 172.21.15.96:0/3413153536 conn(0x7f0f840f1e10 msgr2=0x7f0f840fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:07.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 shutdown_connections 2022-02-02T21:54:07.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.874+0000 7f0f8bd38700 1 -- 172.21.15.96:0/3413153536 wait complete. 2022-02-02T21:54:07.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 -- 172.21.15.96:0/3224475330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f55c0 msgr2=0x7f90680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 --2- 172.21.15.96:0/3224475330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f55c0 0x7f90680f59e0 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 rx=0x7f9058004660 tx=0x7f9058009b30).stop 2022-02-02T21:54:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 -- 172.21.15.96:0/3224475330 shutdown_connections 2022-02-02T21:54:07.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 --2- 172.21.15.96:0/3224475330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f6860 0x7f90680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 --2- 172.21.15.96:0/3224475330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f55c0 0x7f90680f59e0 unknown :-1 s=CLOSED pgs=3257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 -- 172.21.15.96:0/3224475330 >> 172.21.15.96:0/3224475330 conn(0x7f90680f0d40 msgr2=0x7f90680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:07.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 -- 172.21.15.96:0/3224475330 shutdown_connections 2022-02-02T21:54:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.970+0000 7f906f791700 1 -- 172.21.15.96:0/3224475330 wait complete. 2022-02-02T21:54:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 Processor -- start 2022-02-02T21:54:07.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 -- start start 2022-02-02T21:54:07.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f55c0 0x7f906810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680602b0 con 0x7f90680f6860 2022-02-02T21:54:07.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906f791700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680603f0 con 0x7f90680f55c0 2022-02-02T21:54:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906cd2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906cd2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45440/0 (socket says 172.21.15.96:45440) 2022-02-02T21:54:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906cd2c700 1 -- 172.21.15.96:0/2688208549 learned_addr learned my addr 172.21.15.96:0/2688208549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.971+0000 7f906d52d700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f55c0 0x7f906810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906cd2c700 1 -- 172.21.15.96:0/2688208549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f55c0 msgr2=0x7f906810c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906cd2c700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f55c0 0x7f906810c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906cd2c700 1 -- 172.21.15.96:0/2688208549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058005040 con 0x7f90680f6860 2022-02-02T21:54:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906cd2c700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 secure :-1 s=READY pgs=3258 cs=0 l=1 rev1=1 rx=0x7f90640026d0 tx=0x7f9064009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90640079c0 con 0x7f90680f6860 2022-02-02T21:54:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906810ea80 con 0x7f90680f6860 2022-02-02T21:54:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f906400f040 con 0x7f90680f6860 2022-02-02T21:54:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90640148b0 con 0x7f90680f6860 2022-02-02T21:54:07.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.972+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906810ef00 con 0x7f90680f6860 2022-02-02T21:54:07.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.973+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9068045ad0 con 0x7f90680f6860 2022-02-02T21:54:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.974+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9064007b20 con 0x7f90680f6860 2022-02-02T21:54:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.974+0000 7f905dffb700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 0x7f9054067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.974+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9064081990 con 0x7f90680f6860 2022-02-02T21:54:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.974+0000 7f906d52d700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 0x7f9054067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:07.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.975+0000 7f906d52d700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 0x7f9054067290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f9058013690 tx=0x7f9058009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:07.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:07.978+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f906404fa90 con 0x7f90680f6860 2022-02-02T21:54:08.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.213+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9068027a00 con 0x7f90680f6860 2022-02-02T21:54:08.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.213+0000 7f905dffb700 1 -- 172.21.15.96:0/2688208549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f90640530b0 con 0x7f90680f6860 2022-02-02T21:54:08.216 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:54:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:54:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:54:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:54:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:54:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:54:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:54:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:54:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:54:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:54:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:54:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:54:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:54:08.222 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:54:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 msgr2=0x7f9054067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 0x7f9054067290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f9058013690 tx=0x7f9058009b30).stop 2022-02-02T21:54:08.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 msgr2=0x7f906810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 secure :-1 s=READY pgs=3258 cs=0 l=1 rev1=1 rx=0x7f90640026d0 tx=0x7f9064009de0).stop 2022-02-02T21:54:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 shutdown_connections 2022-02-02T21:54:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9054064dd0 0x7f9054067290 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90680f55c0 0x7f906810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 --2- 172.21.15.96:0/2688208549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90680f6860 0x7f906810e590 unknown :-1 s=CLOSED pgs=3258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 >> 172.21.15.96:0/2688208549 conn(0x7f90680f0d40 msgr2=0x7f90680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 shutdown_connections 2022-02-02T21:54:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.215+0000 7f906f791700 1 -- 172.21.15.96:0/2688208549 wait complete. 2022-02-02T21:54:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:08 smithi096 ceph-mon[101353]: pgmap v6360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:08.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 -- 172.21.15.96:0/4099624651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 msgr2=0x7fa8b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/4099624651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b00f6cc0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 rx=0x7fa89c004660 tx=0x7fa89c009b30).stop 2022-02-02T21:54:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 -- 172.21.15.96:0/4099624651 shutdown_connections 2022-02-02T21:54:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/4099624651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b00f6cc0 unknown :-1 s=CLOSED pgs=3259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/4099624651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 -- 172.21.15.96:0/4099624651 >> 172.21.15.96:0/4099624651 conn(0x7fa8b00f0d40 msgr2=0x7fa8b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:08.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 -- 172.21.15.96:0/4099624651 shutdown_connections 2022-02-02T21:54:08.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.313+0000 7fa8b6d59700 1 -- 172.21.15.96:0/4099624651 wait complete. 2022-02-02T21:54:08.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 Processor -- start 2022-02-02T21:54:08.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 -- start start 2022-02-02T21:54:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b0109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0109c00 con 0x7fa8b00f6860 2022-02-02T21:54:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b6d59700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0109d40 con 0x7fa8b00f55c0 2022-02-02T21:54:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45450/0 (socket says 172.21.15.96:45450) 2022-02-02T21:54:08.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 -- 172.21.15.96:0/446398494 learned_addr learned my addr 172.21.15.96:0/446398494 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:08.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b4af5700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b0109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 -- 172.21.15.96:0/446398494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 msgr2=0x7fa8b0109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b0109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8affff700 1 -- 172.21.15.96:0/446398494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c005040 con 0x7fa8b00f6860 2022-02-02T21:54:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.314+0000 7fa8b4af5700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:54:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8affff700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 rx=0x7fa89c009990 tx=0x7fa89c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c018070 con 0x7fa8b00f6860 2022-02-02T21:54:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b010a680 con 0x7fa8b00f6860 2022-02-02T21:54:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa89c007ca0 con 0x7fa8b00f6860 2022-02-02T21:54:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b010abe0 con 0x7fa8b00f6860 2022-02-02T21:54:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.315+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c01c620 con 0x7fa8b00f6860 2022-02-02T21:54:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.316+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0045ad0 con 0x7fa8b00f6860 2022-02-02T21:54:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.316+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa89c01d960 con 0x7fa8b00f6860 2022-02-02T21:54:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.317+0000 7fa8ad7fa700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.317+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa89c0837d0 con 0x7fa8b00f6860 2022-02-02T21:54:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.317+0000 7fa8b4af5700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:08.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.317+0000 7fa8b4af5700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fa8b00f66c0 tx=0x7fa8a4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:08.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.321+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa89c055470 con 0x7fa8b00f6860 2022-02-02T21:54:08.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.521+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa8b010f780 con 0x7fa8b00f6860 2022-02-02T21:54:08.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.522+0000 7fa8ad7fa700 1 -- 172.21.15.96:0/446398494 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa89c055060 con 0x7fa8b00f6860 2022-02-02T21:54:08.523 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:54:08.524 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:54:08.524 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:54:08.524 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:54:08.525 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:08.525 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:54:08.526 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:54:08.526 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:54:08.526 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:54:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:54:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:54:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:54:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:54:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:54:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:54:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:54:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:54:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:54:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:54:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:54:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:54:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:54:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:54:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:54:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:54:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:54:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:54:08.533 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:54:08.533 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:54:08.533 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:54:08.534 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:54:08.534 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:54:08.534 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:08.535 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:08.535 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:54:08.535 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:08.536 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:08.536 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:08.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:08.538 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:08 smithi159 ceph-mon[69013]: pgmap v6360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:08.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.523+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 msgr2=0x7fa8a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.523+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fa8b00f66c0 tx=0x7fa8a4009040).stop 2022-02-02T21:54:08.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.523+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 msgr2=0x7fa8b0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:08.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.523+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 rx=0x7fa89c009990 tx=0x7fa89c009b30).stop 2022-02-02T21:54:08.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 shutdown_connections 2022-02-02T21:54:08.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8a0064dd0 0x7fa8a0067290 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8b00f55c0 0x7fa8b0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 --2- 172.21.15.96:0/446398494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8b00f6860 0x7fa8b0109650 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 >> 172.21.15.96:0/446398494 conn(0x7fa8b00f0d40 msgr2=0x7fa8b005fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 shutdown_connections 2022-02-02T21:54:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:08.524+0000 7fa8b6d59700 1 -- 172.21.15.96:0/446398494 wait complete. 2022-02-02T21:54:08.543 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:54:09.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:09 smithi159 ceph-mon[69013]: from='client.40620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:09 smithi159 ceph-mon[69013]: from='client.40624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2688208549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:54:09.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/446398494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:54:09.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:09 smithi096 ceph-mon[101353]: from='client.40620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:09.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:09 smithi096 ceph-mon[101353]: from='client.40624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:09.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2688208549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:54:09.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/446398494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:54:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:10 smithi159 ceph-mon[69013]: pgmap v6361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:10 smithi096 ceph-mon[101353]: pgmap v6361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:12 smithi159 ceph-mon[69013]: pgmap v6362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:12 smithi096 ceph-mon[101353]: pgmap v6362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:14 smithi159 ceph-mon[69013]: pgmap v6363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:14 smithi096 ceph-mon[101353]: pgmap v6363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:16 smithi159 ceph-mon[69013]: pgmap v6364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:16 smithi096 ceph-mon[101353]: pgmap v6364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:18 smithi159 ceph-mon[69013]: pgmap v6365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:18 smithi096 ceph-mon[101353]: pgmap v6365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:20 smithi159 ceph-mon[69013]: pgmap v6366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:20 smithi096 ceph-mon[101353]: pgmap v6366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:22 smithi159 ceph-mon[69013]: pgmap v6367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:22.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:22 smithi096 ceph-mon[101353]: pgmap v6367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:24 smithi159 ceph-mon[69013]: pgmap v6368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:24 smithi096 ceph-mon[101353]: pgmap v6368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:26 smithi159 ceph-mon[69013]: pgmap v6369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:26 smithi096 ceph-mon[101353]: pgmap v6369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:28 smithi159 ceph-mon[69013]: pgmap v6370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:54:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:54:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:28 smithi096 ceph-mon[101353]: pgmap v6370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:54:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:54:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:30 smithi159 ceph-mon[69013]: pgmap v6371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:30 smithi096 ceph-mon[101353]: pgmap v6371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:32 smithi159 ceph-mon[69013]: pgmap v6372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:32 smithi096 ceph-mon[101353]: pgmap v6372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:34 smithi159 ceph-mon[69013]: pgmap v6373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:34 smithi096 ceph-mon[101353]: pgmap v6373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:36 smithi159 ceph-mon[69013]: pgmap v6374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:36 smithi096 ceph-mon[101353]: pgmap v6374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:38.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:38 smithi159 ceph-mon[69013]: pgmap v6375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:38 smithi096 ceph-mon[101353]: pgmap v6375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:38.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 -- 172.21.15.96:0/828225210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 msgr2=0x7f18840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 --2- 172.21.15.96:0/828225210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f18840f59e0 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 rx=0x7f1874004660 tx=0x7f1874009b30).stop 2022-02-02T21:54:38.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 -- 172.21.15.96:0/828225210 shutdown_connections 2022-02-02T21:54:38.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 --2- 172.21.15.96:0/828225210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 0x7f18840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 --2- 172.21.15.96:0/828225210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f18840f59e0 unknown :-1 s=CLOSED pgs=3261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 -- 172.21.15.96:0/828225210 >> 172.21.15.96:0/828225210 conn(0x7f18840f0d40 msgr2=0x7f18840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 -- 172.21.15.96:0/828225210 shutdown_connections 2022-02-02T21:54:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.636+0000 7f188c703700 1 -- 172.21.15.96:0/828225210 wait complete. 2022-02-02T21:54:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 Processor -- start 2022-02-02T21:54:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 -- start start 2022-02-02T21:54:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 0x7f1884107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884107a10 con 0x7f18840f55c0 2022-02-02T21:54:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188c703700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884107b50 con 0x7f18840f6860 2022-02-02T21:54:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188a49f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188a49f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45466/0 (socket says 172.21.15.96:45466) 2022-02-02T21:54:38.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.637+0000 7f188a49f700 1 -- 172.21.15.96:0/2450039208 learned_addr learned my addr 172.21.15.96:0/2450039208 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:38.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f1889c9e700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 0x7f1884107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188a49f700 1 -- 172.21.15.96:0/2450039208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 msgr2=0x7f1884107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188a49f700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 0x7f1884107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188a49f700 1 -- 172.21.15.96:0/2450039208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874005040 con 0x7f18840f55c0 2022-02-02T21:54:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188a49f700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 rx=0x7f1874013a70 tx=0x7f1874009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1874018070 con 0x7f18840f55c0 2022-02-02T21:54:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18740097d0 con 0x7f18840f55c0 2022-02-02T21:54:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1884108490 con 0x7f18840f55c0 2022-02-02T21:54:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187401de80 con 0x7f18840f55c0 2022-02-02T21:54:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.638+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18841089f0 con 0x7f18840f55c0 2022-02-02T21:54:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.639+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1884045ad0 con 0x7f18840f55c0 2022-02-02T21:54:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.640+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1874007ba0 con 0x7f18840f55c0 2022-02-02T21:54:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.640+0000 7f187affd700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 0x7f1870067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.640+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1874083660 con 0x7f18840f55c0 2022-02-02T21:54:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.640+0000 7f1889c9e700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 0x7f1870067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.640+0000 7f1889c9e700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 0x7f1870067290 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f1880004c40 tx=0x7f188000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.644+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1874055190 con 0x7f18840f55c0 2022-02-02T21:54:38.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.825+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f188405fd30 con 0x7f1870064dd0 2022-02-02T21:54:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.827+0000 7f187affd700 1 -- 172.21.15.96:0/2450039208 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f188405fd30 con 0x7f1870064dd0 2022-02-02T21:54:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.828+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 msgr2=0x7f1870067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.828+0000 7f188c703700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 0x7f1870067290 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f1880004c40 tx=0x7f188000b040).stop 2022-02-02T21:54:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.828+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 msgr2=0x7f1884106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.828+0000 7f188c703700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 rx=0x7f1874013a70 tx=0x7f1874009b30).stop 2022-02-02T21:54:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 shutdown_connections 2022-02-02T21:54:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1870064dd0 0x7f1870067290 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18840f55c0 0x7f1884106f70 unknown :-1 s=CLOSED pgs=3262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 --2- 172.21.15.96:0/2450039208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18840f6860 0x7f1884107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 >> 172.21.15.96:0/2450039208 conn(0x7f18840f0d40 msgr2=0x7f188405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 shutdown_connections 2022-02-02T21:54:38.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.829+0000 7f188c703700 1 -- 172.21.15.96:0/2450039208 wait complete. 2022-02-02T21:54:38.838 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:54:38.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 -- 172.21.15.96:0/3164108565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f55d0 msgr2=0x7fa8d40f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/3164108565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f59f0 secure :-1 s=READY pgs=3263 cs=0 l=1 rev1=1 rx=0x7fa8c4004660 tx=0x7fa8c4009b30).stop 2022-02-02T21:54:38.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 -- 172.21.15.96:0/3164108565 shutdown_connections 2022-02-02T21:54:38.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/3164108565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/3164108565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f59f0 unknown :-1 s=CLOSED pgs=3263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 -- 172.21.15.96:0/3164108565 >> 172.21.15.96:0/3164108565 conn(0x7fa8d40f0d70 msgr2=0x7fa8d40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:38.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 -- 172.21.15.96:0/3164108565 shutdown_connections 2022-02-02T21:54:38.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.926+0000 7fa8dbab6700 1 -- 172.21.15.96:0/3164108565 wait complete. 2022-02-02T21:54:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 Processor -- start 2022-02-02T21:54:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 -- start start 2022-02-02T21:54:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d410abc0 con 0x7fa8d40f6870 2022-02-02T21:54:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.927+0000 7fa8dbab6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d410ad00 con 0x7fa8d40f55d0 2022-02-02T21:54:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9852700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45478/0 (socket says 172.21.15.96:45478) 2022-02-02T21:54:38.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 -- 172.21.15.96:0/2830087968 learned_addr learned my addr 172.21.15.96:0/2830087968 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 -- 172.21.15.96:0/2830087968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f55d0 msgr2=0x7fa8d40f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 -- 172.21.15.96:0/2830087968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4005040 con 0x7fa8d40f6870 2022-02-02T21:54:38.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8d9051700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 rx=0x7fa8d00026d0 tx=0x7fa8d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:38.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d00079c0 con 0x7fa8d40f6870 2022-02-02T21:54:38.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa8d000f040 con 0x7fa8d40f6870 2022-02-02T21:54:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.928+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d00148b0 con 0x7fa8d40f6870 2022-02-02T21:54:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.929+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40f8160 con 0x7fa8d40f6870 2022-02-02T21:54:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.929+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40f86d0 con 0x7fa8d40f6870 2022-02-02T21:54:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.930+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4045ad0 con 0x7fa8d40f6870 2022-02-02T21:54:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.930+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa8d0007b20 con 0x7fa8d40f6870 2022-02-02T21:54:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.931+0000 7fa8ca7fc700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 0x7fa8c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.931+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa8d00819e0 con 0x7fa8d40f6870 2022-02-02T21:54:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.931+0000 7fa8d9852700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 0x7fa8c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.931+0000 7fa8d9852700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 0x7fa8c0067290 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fa8c4013690 tx=0x7fa8c4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:38.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:38.935+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa8d004fae0 con 0x7fa8d40f6870 2022-02-02T21:54:39.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.108+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d40facb0 con 0x7fa8c0064dd0 2022-02-02T21:54:39.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.118+0000 7fa8ca7fc700 1 -- 172.21.15.96:0/2830087968 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa8d40facb0 con 0x7fa8c0064dd0 2022-02-02T21:54:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:54:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:54:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:54:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:54:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:54:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:54:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:54:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:54:39.122 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:54:39.122 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:54:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:54:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:54:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:54:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:54:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:54:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:54:39.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:54:39.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:54:39.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:54:39.126 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:54:39.126 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:54:39.126 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:54:39.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 msgr2=0x7fa8c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 0x7fa8c0067290 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fa8c4013690 tx=0x7fa8c4009b30).stop 2022-02-02T21:54:39.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 msgr2=0x7fa8d40f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 rx=0x7fa8d00026d0 tx=0x7fa8d0009de0).stop 2022-02-02T21:54:39.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 shutdown_connections 2022-02-02T21:54:39.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa8c0064dd0 0x7fa8c0067290 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8d40f55d0 0x7fa8d40f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 --2- 172.21.15.96:0/2830087968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8d40f6870 0x7fa8d40f7bb0 unknown :-1 s=CLOSED pgs=3264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 >> 172.21.15.96:0/2830087968 conn(0x7fa8d40f0d70 msgr2=0x7fa8d405ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:39.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 shutdown_connections 2022-02-02T21:54:39.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.120+0000 7fa8dbab6700 1 -- 172.21.15.96:0/2830087968 wait complete. 2022-02-02T21:54:39.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 -- 172.21.15.96:0/2488257176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740f9830 msgr2=0x7fd3740fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 --2- 172.21.15.96:0/2488257176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740f9830 0x7fd3740fbc80 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 rx=0x7fd368004660 tx=0x7fd368009b30).stop 2022-02-02T21:54:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 -- 172.21.15.96:0/2488257176 shutdown_connections 2022-02-02T21:54:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 --2- 172.21.15.96:0/2488257176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740f9830 0x7fd3740fbc80 unknown :-1 s=CLOSED pgs=3265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 --2- 172.21.15.96:0/2488257176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740603f0 0x7fd3740f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 -- 172.21.15.96:0/2488257176 >> 172.21.15.96:0/2488257176 conn(0x7fd3740f0d70 msgr2=0x7fd3740f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.216+0000 7fd3795c6700 1 -- 172.21.15.96:0/2488257176 shutdown_connections 2022-02-02T21:54:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 -- 172.21.15.96:0/2488257176 wait complete. 2022-02-02T21:54:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 Processor -- start 2022-02-02T21:54:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 -- start start 2022-02-02T21:54:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740f9830 0x7fd3740691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740697f0 con 0x7fd3740603f0 2022-02-02T21:54:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.217+0000 7fd3795c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd374110b10 con 0x7fd3740f9830 2022-02-02T21:54:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45486/0 (socket says 172.21.15.96:45486) 2022-02-02T21:54:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 -- 172.21.15.96:0/1209014527 learned_addr learned my addr 172.21.15.96:0/1209014527 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd3727fc700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740f9830 0x7fd3740691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 -- 172.21.15.96:0/1209014527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740f9830 msgr2=0x7fd3740691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740f9830 0x7fd3740691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 -- 172.21.15.96:0/1209014527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368005040 con 0x7fd3740603f0 2022-02-02T21:54:39.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd372ffd700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 secure :-1 s=READY pgs=3266 cs=0 l=1 rev1=1 rx=0x7fd3640026d0 tx=0x7fd364009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:39.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3640079c0 con 0x7fd3740603f0 2022-02-02T21:54:39.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd374110df0 con 0x7fd3740603f0 2022-02-02T21:54:39.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3741113b0 con 0x7fd3740603f0 2022-02-02T21:54:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd36400f040 con 0x7fd3740603f0 2022-02-02T21:54:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.218+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3640148b0 con 0x7fd3740603f0 2022-02-02T21:54:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.219+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd354004fa0 con 0x7fd3740603f0 2022-02-02T21:54:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.220+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd364014a10 con 0x7fd3740603f0 2022-02-02T21:54:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.220+0000 7fd35b7fe700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 0x7fd35c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.220+0000 7fd3727fc700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 0x7fd35c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.220+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd364081940 con 0x7fd3740603f0 2022-02-02T21:54:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.221+0000 7fd3727fc700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 0x7fd35c067290 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7fd374110750 tx=0x7fd368009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.225+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3640533b0 con 0x7fd3740603f0 2022-02-02T21:54:39.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.454+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd354005e80 con 0x7fd3740603f0 2022-02-02T21:54:39.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.454+0000 7fd35b7fe700 1 -- 172.21.15.96:0/1209014527 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd364052fa0 con 0x7fd3740603f0 2022-02-02T21:54:39.455 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:54:39.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:54:39.456 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:54:39.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:39.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:54:39.457 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:54:39.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:39.457 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:54:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:54:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:54:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:54:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:54:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:54:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:54:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:54:39.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:54:39.461 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:54:39.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 msgr2=0x7fd35c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 0x7fd35c067290 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7fd374110750 tx=0x7fd368009b30).stop 2022-02-02T21:54:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 msgr2=0x7fd374068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 secure :-1 s=READY pgs=3266 cs=0 l=1 rev1=1 rx=0x7fd3640026d0 tx=0x7fd364009de0).stop 2022-02-02T21:54:39.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 shutdown_connections 2022-02-02T21:54:39.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd35c064dd0 0x7fd35c067290 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3740603f0 0x7fd374068d00 unknown :-1 s=CLOSED pgs=3266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 --2- 172.21.15.96:0/1209014527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3740f9830 0x7fd3740691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 >> 172.21.15.96:0/1209014527 conn(0x7fd3740f0d70 msgr2=0x7fd3740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 shutdown_connections 2022-02-02T21:54:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.456+0000 7fd3795c6700 1 -- 172.21.15.96:0/1209014527 wait complete. 2022-02-02T21:54:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 -- 172.21.15.96:0/1587335383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 msgr2=0x7f8ed00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/1587335383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed00f6b40 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 rx=0x7f8ec0004660 tx=0x7f8ec0009b30).stop 2022-02-02T21:54:39.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 -- 172.21.15.96:0/1587335383 shutdown_connections 2022-02-02T21:54:39.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/1587335383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed00f6b40 unknown :-1 s=CLOSED pgs=3267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/1587335383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 0x7f8ed00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 -- 172.21.15.96:0/1587335383 >> 172.21.15.96:0/1587335383 conn(0x7f8ed00f0ba0 msgr2=0x7f8ed00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 -- 172.21.15.96:0/1587335383 shutdown_connections 2022-02-02T21:54:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.553+0000 7f8ecf59e700 1 -- 172.21.15.96:0/1587335383 wait complete. 2022-02-02T21:54:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 Processor -- start 2022-02-02T21:54:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 -- start start 2022-02-02T21:54:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 0x7f8ed0109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00603e0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecf59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0060520 con 0x7f8ed00f5440 2022-02-02T21:54:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45498/0 (socket says 172.21.15.96:45498) 2022-02-02T21:54:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 -- 172.21.15.96:0/2541893453 learned_addr learned my addr 172.21.15.96:0/2541893453 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:54:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ece59c700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 0x7f8ed0109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 -- 172.21.15.96:0/2541893453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 msgr2=0x7f8ed0109a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 0x7f8ed0109a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.554+0000 7f8ecdd9b700 1 -- 172.21.15.96:0/2541893453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0005040 con 0x7f8ed00f66e0 2022-02-02T21:54:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ecdd9b700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 rx=0x7f8ec0009990 tx=0x7f8ec0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec0018070 con 0x7f8ed00f66e0 2022-02-02T21:54:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ec0007ba0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed010c480 con 0x7f8ed00f66e0 2022-02-02T21:54:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec001c620 con 0x7f8ed00f66e0 2022-02-02T21:54:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.555+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed010c9e0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.556+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed0045ad0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.556+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ec001c8e0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.557+0000 7f8ebeffd700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 0x7f8eb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:54:39.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.557+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8ec0083890 con 0x7f8ed00f66e0 2022-02-02T21:54:39.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.557+0000 7f8ece59c700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 0x7f8eb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:54:39.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.557+0000 7f8ece59c700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 0x7f8eb80672e0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f8ed0060060 tx=0x7f8ec4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:54:39.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.561+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ec0051990 con 0x7f8ed00f66e0 2022-02-02T21:54:39.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.761+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ed0027a00 con 0x7f8ed00f66e0 2022-02-02T21:54:39.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.762+0000 7f8ebeffd700 1 -- 172.21.15.96:0/2541893453 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8ec0054fb0 con 0x7f8ed00f66e0 2022-02-02T21:54:39.764 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:54:39.764 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:54:39.764 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:39.766 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:54:39.766 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:54:39.768 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:54:39.768 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:54:39.769 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:54:39.769 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:54:39.769 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:54:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:54:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:54:39.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:54:39.771 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:54:39.771 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:54:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:54:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:54:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:54:39.773 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:54:39.773 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:54:39.774 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:54:39.774 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:54:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:54:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:54:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:54:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:54:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:54:39.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:39.777 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:39.777 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:54:39.778 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:54:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:39.779 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:54:39.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 msgr2=0x7f8eb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 0x7f8eb80672e0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f8ed0060060 tx=0x7f8ec4009040).stop 2022-02-02T21:54:39.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 msgr2=0x7f8ed010bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:54:39.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 rx=0x7f8ec0009990 tx=0x7f8ec0009b30).stop 2022-02-02T21:54:39.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 shutdown_connections 2022-02-02T21:54:39.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8eb8064e20 0x7f8eb80672e0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ed00f5440 0x7f8ed0109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 --2- 172.21.15.96:0/2541893453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed00f66e0 0x7f8ed010bf30 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:54:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 >> 172.21.15.96:0/2541893453 conn(0x7f8ed00f0ba0 msgr2=0x7f8ed00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:54:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 shutdown_connections 2022-02-02T21:54:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:54:39.764+0000 7f8ecf59e700 1 -- 172.21.15.96:0/2541893453 wait complete. 2022-02-02T21:54:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:54:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:40 smithi159 ceph-mon[69013]: pgmap v6376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:40.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:40 smithi159 ceph-mon[69013]: from='client.40636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:40.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:40 smithi159 ceph-mon[69013]: from='client.40640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1209014527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:54:40.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2541893453' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:40 smithi096 ceph-mon[101353]: pgmap v6376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:40 smithi096 ceph-mon[101353]: from='client.40636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:40 smithi096 ceph-mon[101353]: from='client.40640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1209014527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2541893453' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:54:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:42 smithi159 ceph-mon[69013]: pgmap v6377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:42 smithi096 ceph-mon[101353]: pgmap v6377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:44 smithi159 ceph-mon[69013]: pgmap v6378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:44 smithi096 ceph-mon[101353]: pgmap v6378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:46 smithi159 ceph-mon[69013]: pgmap v6379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:46 smithi096 ceph-mon[101353]: pgmap v6379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:48 smithi159 ceph-mon[69013]: pgmap v6380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:48 smithi096 ceph-mon[101353]: pgmap v6380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:50 smithi159 ceph-mon[69013]: pgmap v6381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:50 smithi096 ceph-mon[101353]: pgmap v6381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:52 smithi159 ceph-mon[69013]: pgmap v6382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:52 smithi096 ceph-mon[101353]: pgmap v6382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:54 smithi159 ceph-mon[69013]: pgmap v6383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:54 smithi096 ceph-mon[101353]: pgmap v6383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:56 smithi159 ceph-mon[69013]: pgmap v6384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:56 smithi096 ceph-mon[101353]: pgmap v6384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:54:58 smithi159 ceph-mon[69013]: pgmap v6385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:54:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:54:58 smithi096 ceph-mon[101353]: pgmap v6385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:00 smithi159 ceph-mon[69013]: pgmap v6386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:00 smithi096 ceph-mon[101353]: pgmap v6386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:02 smithi159 ceph-mon[69013]: pgmap v6387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:02 smithi096 ceph-mon[101353]: pgmap v6387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:04 smithi159 ceph-mon[69013]: pgmap v6388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:04 smithi096 ceph-mon[101353]: pgmap v6388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:06 smithi159 ceph-mon[69013]: pgmap v6389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:06 smithi096 ceph-mon[101353]: pgmap v6389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:08 smithi159 ceph-mon[69013]: pgmap v6390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:08 smithi096 ceph-mon[101353]: pgmap v6390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:09.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/108905364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 msgr2=0x7f3aa00fb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:09.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/108905364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa00fb7c0 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 rx=0x7f3a94004660 tx=0x7f3a94009b30).stop 2022-02-02T21:55:09.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/108905364 shutdown_connections 2022-02-02T21:55:09.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/108905364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 0x7f3aa00fe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:09.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/108905364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa00fb7c0 unknown :-1 s=CLOSED pgs=3269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:09.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/108905364 >> 172.21.15.96:0/108905364 conn(0x7f3aa00f0de0 msgr2=0x7f3aa00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:09.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/108905364 shutdown_connections 2022-02-02T21:55:09.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.874+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/108905364 wait complete. 2022-02-02T21:55:09.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 Processor -- start 2022-02-02T21:55:09.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 -- start start 2022-02-02T21:55:09.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:09.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 0x7f3aa0109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:09.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0109c40 con 0x7f3aa0060330 2022-02-02T21:55:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.875+0000 7f3aa6ea1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0109d80 con 0x7f3aa00fbcb0 2022-02-02T21:55:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45514/0 (socket says 172.21.15.96:45514) 2022-02-02T21:55:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 -- 172.21.15.96:0/3414443889 learned_addr learned my addr 172.21.15.96:0/3414443889 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3a9ffff700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 0x7f3aa0109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:09.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 -- 172.21.15.96:0/3414443889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 msgr2=0x7f3aa0109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:09.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 0x7f3aa0109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 -- 172.21.15.96:0/3414443889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94005040 con 0x7f3aa0060330 2022-02-02T21:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa4c3d700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 rx=0x7f3a94013a70 tx=0x7f3a94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a94018070 con 0x7f3aa0060330 2022-02-02T21:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a940097d0 con 0x7f3aa0060330 2022-02-02T21:55:09.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa010a6c0 con 0x7f3aa0060330 2022-02-02T21:55:09.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a9401c3c0 con 0x7f3aa0060330 2022-02-02T21:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.876+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa010ac20 con 0x7f3aa0060330 2022-02-02T21:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.877+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa0045ad0 con 0x7f3aa0060330 2022-02-02T21:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.878+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a94007ba0 con 0x7f3aa0060330 2022-02-02T21:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.878+0000 7f3a9d7fa700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 0x7f3a90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.878+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3a940836e0 con 0x7f3aa0060330 2022-02-02T21:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.878+0000 7f3a9ffff700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 0x7f3a90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.879+0000 7f3a9ffff700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 0x7f3a90067290 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f3a8c0096c0 tx=0x7f3a8c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:09.883+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a940552d0 con 0x7f3aa0060330 2022-02-02T21:55:10.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.060+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3aa01011f0 con 0x7f3a90064dd0 2022-02-02T21:55:10.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.062+0000 7f3a9d7fa700 1 -- 172.21.15.96:0/3414443889 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3aa01011f0 con 0x7f3a90064dd0 2022-02-02T21:55:10.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 msgr2=0x7f3a90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 0x7f3a90067290 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f3a8c0096c0 tx=0x7f3a8c009be0).stop 2022-02-02T21:55:10.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 msgr2=0x7f3aa01091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 rx=0x7f3a94013a70 tx=0x7f3a94009b30).stop 2022-02-02T21:55:10.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 shutdown_connections 2022-02-02T21:55:10.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a90064dd0 0x7f3a90067290 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3aa0060330 0x7f3aa01091a0 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.063+0000 7f3aa6ea1700 1 --2- 172.21.15.96:0/3414443889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa00fbcb0 0x7f3aa0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.064+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 >> 172.21.15.96:0/3414443889 conn(0x7f3aa00f0de0 msgr2=0x7f3aa00f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.064+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 shutdown_connections 2022-02-02T21:55:10.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.064+0000 7f3aa6ea1700 1 -- 172.21.15.96:0/3414443889 wait complete. 2022-02-02T21:55:10.073 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:55:10.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 -- 172.21.15.96:0/236861764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f4bc0 msgr2=0x7f0f600f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 --2- 172.21.15.96:0/236861764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f4bc0 0x7f0f600f4fe0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 rx=0x7f0f54004660 tx=0x7f0f54009b30).stop 2022-02-02T21:55:10.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 -- 172.21.15.96:0/236861764 shutdown_connections 2022-02-02T21:55:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 --2- 172.21.15.96:0/236861764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f5e60 0x7f0f600f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 --2- 172.21.15.96:0/236861764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f4bc0 0x7f0f600f4fe0 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 -- 172.21.15.96:0/236861764 >> 172.21.15.96:0/236861764 conn(0x7f0f600f0320 msgr2=0x7f0f600f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 -- 172.21.15.96:0/236861764 shutdown_connections 2022-02-02T21:55:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.162+0000 7f0f65d22700 1 -- 172.21.15.96:0/236861764 wait complete. 2022-02-02T21:55:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 Processor -- start 2022-02-02T21:55:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 -- start start 2022-02-02T21:55:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f4bc0 0x7f0f60106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60107880 con 0x7f0f600f5e60 2022-02-02T21:55:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f65d22700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601080c0 con 0x7f0f600f4bc0 2022-02-02T21:55:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f5ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f5ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45524/0 (socket says 172.21.15.96:45524) 2022-02-02T21:55:10.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f5ffff700 1 -- 172.21.15.96:0/1985197058 learned_addr learned my addr 172.21.15.96:0/1985197058 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.163+0000 7f0f64d20700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f4bc0 0x7f0f60106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5ffff700 1 -- 172.21.15.96:0/1985197058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f4bc0 msgr2=0x7f0f60106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5ffff700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f4bc0 0x7f0f60106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5ffff700 1 -- 172.21.15.96:0/1985197058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54005040 con 0x7f0f600f5e60 2022-02-02T21:55:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5ffff700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 rx=0x7f0f4c0048a0 tx=0x7f0f4c00c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c00f040 con 0x7f0f600f5e60 2022-02-02T21:55:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f601083a0 con 0x7f0f600f5e60 2022-02-02T21:55:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f4c00fb10 con 0x7f0f600f5e60 2022-02-02T21:55:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c015a40 con 0x7f0f600f5e60 2022-02-02T21:55:10.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.164+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f601088e0 con 0x7f0f600f5e60 2022-02-02T21:55:10.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.165+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f60059100 con 0x7f0f600f5e60 2022-02-02T21:55:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.165+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f4c01c060 con 0x7f0f600f5e60 2022-02-02T21:55:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.166+0000 7f0f5d7fa700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 0x7f0f500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.166+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0f4c081b20 con 0x7f0f600f5e60 2022-02-02T21:55:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.166+0000 7f0f64d20700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 0x7f0f500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.166+0000 7f0f64d20700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 0x7f0f500672e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f0f54013690 tx=0x7f0f54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.170+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f4c04fc20 con 0x7f0f600f5e60 2022-02-02T21:55:10.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.344+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f60108b60 con 0x7f0f50064e20 2022-02-02T21:55:10.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.353+0000 7f0f5d7fa700 1 -- 172.21.15.96:0/1985197058 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0f60108b60 con 0x7f0f50064e20 2022-02-02T21:55:10.353 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:55:10.354 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:55:10.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:55:10.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:55:10.355 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:55:10.355 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:55:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:55:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:55:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:55:10.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:55:10.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:55:10.357 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:55:10.358 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:55:10.358 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:55:10.358 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:55:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:55:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:55:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:55:10.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:55:10.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:55:10.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:55:10.361 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:55:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 msgr2=0x7f0f500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 0x7f0f500672e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f0f54013690 tx=0x7f0f54009b30).stop 2022-02-02T21:55:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 msgr2=0x7f0f60107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 rx=0x7f0f4c0048a0 tx=0x7f0f4c00c040).stop 2022-02-02T21:55:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 shutdown_connections 2022-02-02T21:55:10.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0f50064e20 0x7f0f500672e0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f600f4bc0 0x7f0f60106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 --2- 172.21.15.96:0/1985197058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f600f5e60 0x7f0f60107280 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 >> 172.21.15.96:0/1985197058 conn(0x7f0f600f0320 msgr2=0x7f0f600f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 shutdown_connections 2022-02-02T21:55:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.355+0000 7f0f65d22700 1 -- 172.21.15.96:0/1985197058 wait complete. 2022-02-02T21:55:10.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 -- 172.21.15.96:0/1564407060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 msgr2=0x7f20800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 --2- 172.21.15.96:0/1564407060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f20800f7c30 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 rx=0x7f206c004660 tx=0x7f206c009b30).stop 2022-02-02T21:55:10.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 -- 172.21.15.96:0/1564407060 shutdown_connections 2022-02-02T21:55:10.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 --2- 172.21.15.96:0/1564407060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f20800f7c30 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 --2- 172.21.15.96:0/1564407060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 0x7f20800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.451+0000 7f20858da700 1 -- 172.21.15.96:0/1564407060 >> 172.21.15.96:0/1564407060 conn(0x7f20800f1c90 msgr2=0x7f20800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.452+0000 7f20858da700 1 -- 172.21.15.96:0/1564407060 shutdown_connections 2022-02-02T21:55:10.454 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:10 smithi096 ceph-mon[101353]: pgmap v6391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:10.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.454+0000 7f20858da700 1 -- 172.21.15.96:0/1564407060 wait complete. 2022-02-02T21:55:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 Processor -- start 2022-02-02T21:55:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 -- start start 2022-02-02T21:55:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 0x7f208006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208006a380 con 0x7f20800f77d0 2022-02-02T21:55:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20858da700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208006a4c0 con 0x7f20800f6530 2022-02-02T21:55:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45534/0 (socket says 172.21.15.96:45534) 2022-02-02T21:55:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 -- 172.21.15.96:0/79478733 learned_addr learned my addr 172.21.15.96:0/79478733 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f20848d8700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 0x7f208006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 -- 172.21.15.96:0/79478733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 msgr2=0x7f208006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 0x7f208006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.455+0000 7f207ffff700 1 -- 172.21.15.96:0/79478733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c005040 con 0x7f20800f77d0 2022-02-02T21:55:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f207ffff700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 rx=0x7f206c009990 tx=0x7f206c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c018070 con 0x7f20800f77d0 2022-02-02T21:55:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208006a740 con 0x7f20800f77d0 2022-02-02T21:55:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f206c007ba0 con 0x7f20800f77d0 2022-02-02T21:55:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c01c3c0 con 0x7f20800f77d0 2022-02-02T21:55:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.456+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208006aca0 con 0x7f20800f77d0 2022-02-02T21:55:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.457+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2080045ad0 con 0x7f20800f77d0 2022-02-02T21:55:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.457+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f206c01d420 con 0x7f20800f77d0 2022-02-02T21:55:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.458+0000 7f207d7fa700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 0x7f2070067320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.458+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f206c083820 con 0x7f20800f77d0 2022-02-02T21:55:10.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.458+0000 7f20848d8700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 0x7f2070067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.458+0000 7f20848d8700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 0x7f2070067320 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f208006b730 tx=0x7f2074009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.462+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f206c051800 con 0x7f20800f77d0 2022-02-02T21:55:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:10 smithi159 ceph-mon[69013]: pgmap v6391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:10.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.692+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2080027a00 con 0x7f20800f77d0 2022-02-02T21:55:10.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.692+0000 7f207d7fa700 1 -- 172.21.15.96:0/79478733 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f206c054e20 con 0x7f20800f77d0 2022-02-02T21:55:10.693 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:55:10.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:55:10.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:55:10.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:55:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:55:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:10.696 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:55:10.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:55:10.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:55:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:55:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:55:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:55:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:55:10.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:55:10.699 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:55:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 msgr2=0x7f2070067320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 0x7f2070067320 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f208006b730 tx=0x7f2074009c00).stop 2022-02-02T21:55:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 msgr2=0x7f2080069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 rx=0x7f206c009990 tx=0x7f206c009b30).stop 2022-02-02T21:55:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 shutdown_connections 2022-02-02T21:55:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2070064e60 0x7f2070067320 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20800f6530 0x7f208006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 --2- 172.21.15.96:0/79478733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20800f77d0 0x7f2080069e20 unknown :-1 s=CLOSED pgs=3274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 >> 172.21.15.96:0/79478733 conn(0x7f20800f1c90 msgr2=0x7f20800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 shutdown_connections 2022-02-02T21:55:10.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.695+0000 7f20858da700 1 -- 172.21.15.96:0/79478733 wait complete. 2022-02-02T21:55:10.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 -- 172.21.15.96:0/1464971755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f6860 msgr2=0x7f4dd00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 --2- 172.21.15.96:0/1464971755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f6cc0 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 rx=0x7f4dc0004660 tx=0x7f4dc0009b30).stop 2022-02-02T21:55:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 -- 172.21.15.96:0/1464971755 shutdown_connections 2022-02-02T21:55:10.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 --2- 172.21.15.96:0/1464971755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f6cc0 unknown :-1 s=CLOSED pgs=3275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 --2- 172.21.15.96:0/1464971755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:55:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.792+0000 7f4dd49db700 1 -- 172.21.15.96:0/1464971755 >> 172.21.15.96:0/1464971755 conn(0x7f4dd00f0d40 msgr2=0x7f4dd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.793+0000 7f4dd49db700 1 -- 172.21.15.96:0/1464971755 shutdown_connections 2022-02-02T21:55:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.793+0000 7f4dd49db700 1 -- 172.21.15.96:0/1464971755 wait complete. 2022-02-02T21:55:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 Processor -- start 2022-02-02T21:55:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 -- start start 2022-02-02T21:55:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00f8190 con 0x7f4dd00f55c0 2022-02-02T21:55:10.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dd49db700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00f82d0 con 0x7f4dd00f6860 2022-02-02T21:55:10.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45542/0 (socket says 172.21.15.96:45542) 2022-02-02T21:55:10.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dce59c700 1 -- 172.21.15.96:0/2436043205 learned_addr learned my addr 172.21.15.96:0/2436043205 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.794+0000 7f4dcdd9b700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dcdd9b700 1 -- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 msgr2=0x7f4dd00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dcdd9b700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dcdd9b700 1 -- 172.21.15.96:0/2436043205 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0005040 con 0x7f4dd00f6860 2022-02-02T21:55:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dcdd9b700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f7ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4dc0000c00 tx=0x7f4dc0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc0018070 con 0x7f4dd00f6860 2022-02-02T21:55:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd00f8550 con 0x7f4dd00f6860 2022-02-02T21:55:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4dc0007ba0 con 0x7f4dd00f6860 2022-02-02T21:55:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc001c3c0 con 0x7f4dd00f6860 2022-02-02T21:55:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.795+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd010efb0 con 0x7f4dd00f6860 2022-02-02T21:55:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.796+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd0045ad0 con 0x7f4dd00f6860 2022-02-02T21:55:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.797+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4dc001d420 con 0x7f4dd00f6860 2022-02-02T21:55:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.797+0000 7f4dbeffd700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 0x7f4db8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.797+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4dc00837b0 con 0x7f4dd00f6860 2022-02-02T21:55:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.797+0000 7f4dce59c700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 0x7f4db8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.798+0000 7f4dce59c700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 0x7f4db8067290 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f4dd00f94b0 tx=0x7f4dc4006ec0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:10.802+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4dc00518b0 con 0x7f4dd00f6860 2022-02-02T21:55:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.003+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4dd00fde20 con 0x7f4dd00f6860 2022-02-02T21:55:11.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.004+0000 7f4dbeffd700 1 -- 172.21.15.96:0/2436043205 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4dc0054ed0 con 0x7f4dd00f6860 2022-02-02T21:55:11.004 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:55:11.005 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:55:11.005 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:55:11.006 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:55:11.006 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:11.006 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:55:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:55:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:55:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:55:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:55:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:55:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:55:11.009 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:55:11.009 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:55:11.009 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:55:11.010 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:55:11.010 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:55:11.010 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:55:11.011 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:55:11.011 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:55:11.011 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:55:11.012 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:55:11.012 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:55:11.012 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:55:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:55:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:55:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:55:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:55:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:55:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:55:11.015 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:55:11.015 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:55:11.015 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:11.016 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:11.016 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:55:11.016 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:11.016 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:11.017 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:11.017 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:11.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 msgr2=0x7f4db8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:11.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 0x7f4db8067290 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f4dd00f94b0 tx=0x7f4dc4006ec0).stop 2022-02-02T21:55:11.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 msgr2=0x7f4dd00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:11.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f7ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4dc0000c00 tx=0x7f4dc0009b30).stop 2022-02-02T21:55:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 shutdown_connections 2022-02-02T21:55:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4db8064dd0 0x7f4db8067290 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4dd00f55c0 0x7f4dd00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 --2- 172.21.15.96:0/2436043205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dd00f6860 0x7f4dd00f7ba0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 >> 172.21.15.96:0/2436043205 conn(0x7f4dd00f0d40 msgr2=0x7f4dd005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 shutdown_connections 2022-02-02T21:55:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:11.006+0000 7f4dd49db700 1 -- 172.21.15.96:0/2436043205 wait complete. 2022-02-02T21:55:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:55:11.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:11 smithi159 ceph-mon[69013]: from='client.40652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:11 smithi159 ceph-mon[69013]: from='client.40656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/79478733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:55:11.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2436043205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:55:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:11 smithi096 ceph-mon[101353]: from='client.40652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:11 smithi096 ceph-mon[101353]: from='client.40656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/79478733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:55:11.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2436043205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:55:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:12 smithi159 ceph-mon[69013]: pgmap v6392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:12 smithi096 ceph-mon[101353]: pgmap v6392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:14 smithi159 ceph-mon[69013]: pgmap v6393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:14 smithi096 ceph-mon[101353]: pgmap v6393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:16 smithi159 ceph-mon[69013]: pgmap v6394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:16 smithi096 ceph-mon[101353]: pgmap v6394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:18 smithi159 ceph-mon[69013]: pgmap v6395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:18 smithi096 ceph-mon[101353]: pgmap v6395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:20 smithi159 ceph-mon[69013]: pgmap v6396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:20 smithi096 ceph-mon[101353]: pgmap v6396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:22 smithi159 ceph-mon[69013]: pgmap v6397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:22 smithi096 ceph-mon[101353]: pgmap v6397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:24 smithi159 ceph-mon[69013]: pgmap v6398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:24 smithi096 ceph-mon[101353]: pgmap v6398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:26 smithi159 ceph-mon[69013]: pgmap v6399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:26 smithi096 ceph-mon[101353]: pgmap v6399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:28 smithi159 ceph-mon[69013]: pgmap v6400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:55:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:55:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:28 smithi096 ceph-mon[101353]: pgmap v6400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:55:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:55:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:30 smithi159 ceph-mon[69013]: pgmap v6401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:30 smithi096 ceph-mon[101353]: pgmap v6401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:32 smithi159 ceph-mon[69013]: pgmap v6402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:32 smithi096 ceph-mon[101353]: pgmap v6402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:34 smithi159 ceph-mon[69013]: pgmap v6403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:34 smithi096 ceph-mon[101353]: pgmap v6403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:36 smithi159 ceph-mon[69013]: pgmap v6404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:36 smithi096 ceph-mon[101353]: pgmap v6404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:38 smithi159 ceph-mon[69013]: pgmap v6405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:38 smithi096 ceph-mon[101353]: pgmap v6405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:40 smithi159 ceph-mon[69013]: pgmap v6406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:40 smithi096 ceph-mon[101353]: pgmap v6406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:41.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 -- 172.21.15.96:0/893369230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 msgr2=0x7f3e280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 --2- 172.21.15.96:0/893369230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e280f6b00 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 rx=0x7f3e1c004660 tx=0x7f3e1c009b30).stop 2022-02-02T21:55:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 -- 172.21.15.96:0/893369230 shutdown_connections 2022-02-02T21:55:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 --2- 172.21.15.96:0/893369230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 0x7f3e280f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 --2- 172.21.15.96:0/893369230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e280f6b00 unknown :-1 s=CLOSED pgs=3276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 -- 172.21.15.96:0/893369230 >> 172.21.15.96:0/893369230 conn(0x7f3e280f1f00 msgr2=0x7f3e280f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 -- 172.21.15.96:0/893369230 shutdown_connections 2022-02-02T21:55:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.115+0000 7f3e2e026700 1 -- 172.21.15.96:0/893369230 wait complete. 2022-02-02T21:55:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 Processor -- start 2022-02-02T21:55:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 -- start start 2022-02-02T21:55:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 0x7f3e28107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28107a00 con 0x7f3e280f66e0 2022-02-02T21:55:41.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.116+0000 7f3e2e026700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28107b40 con 0x7f3e280f6ff0 2022-02-02T21:55:41.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45560/0 (socket says 172.21.15.96:45560) 2022-02-02T21:55:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 -- 172.21.15.96:0/2400185399 learned_addr learned my addr 172.21.15.96:0/2400185399 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 0x7f3e28107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 -- 172.21.15.96:0/2400185399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 msgr2=0x7f3e28107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 0x7f3e28107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 -- 172.21.15.96:0/2400185399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c005040 con 0x7f3e280f66e0 2022-02-02T21:55:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e277fe700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 secure :-1 s=READY pgs=3277 cs=0 l=1 rev1=1 rx=0x7f3e1c009990 tx=0x7f3e1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1c018070 con 0x7f3e280f66e0 2022-02-02T21:55:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e1c007ba0 con 0x7f3e280f66e0 2022-02-02T21:55:41.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e28108480 con 0x7f3e280f66e0 2022-02-02T21:55:41.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1c01c620 con 0x7f3e280f66e0 2022-02-02T21:55:41.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.117+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e281089e0 con 0x7f3e280f66e0 2022-02-02T21:55:41.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.118+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28045ad0 con 0x7f3e280f66e0 2022-02-02T21:55:41.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.119+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e1c01c8e0 con 0x7f3e280f66e0 2022-02-02T21:55:41.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.119+0000 7f3e0ffff700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 0x7f3e10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.119+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3e1c083890 con 0x7f3e280f66e0 2022-02-02T21:55:41.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.119+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 0x7f3e10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.120+0000 7f3e26ffd700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 0x7f3e10067290 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f3e18007fd0 tx=0x7f3e18009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.123+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e1c0553c0 con 0x7f3e280f66e0 2022-02-02T21:55:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.302+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e280fefe0 con 0x7f3e10064dd0 2022-02-02T21:55:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.303+0000 7f3e0ffff700 1 -- 172.21.15.96:0/2400185399 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3e280fefe0 con 0x7f3e10064dd0 2022-02-02T21:55:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 msgr2=0x7f3e10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 0x7f3e10067290 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f3e18007fd0 tx=0x7f3e18009040).stop 2022-02-02T21:55:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 msgr2=0x7f3e28106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 secure :-1 s=READY pgs=3277 cs=0 l=1 rev1=1 rx=0x7f3e1c009990 tx=0x7f3e1c009b30).stop 2022-02-02T21:55:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 shutdown_connections 2022-02-02T21:55:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3e10064dd0 0x7f3e10067290 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e280f66e0 0x7f3e28106f60 unknown :-1 s=CLOSED pgs=3277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 --2- 172.21.15.96:0/2400185399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e280f6ff0 0x7f3e28107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 >> 172.21.15.96:0/2400185399 conn(0x7f3e280f1f00 msgr2=0x7f3e280fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.305+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 shutdown_connections 2022-02-02T21:55:41.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.306+0000 7f3e2e026700 1 -- 172.21.15.96:0/2400185399 wait complete. 2022-02-02T21:55:41.316 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:55:41.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 -- 172.21.15.96:0/3900160902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 msgr2=0x7f2c200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 --2- 172.21.15.96:0/3900160902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c200f6b30 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 rx=0x7f2c14004660 tx=0x7f2c14009b30).stop 2022-02-02T21:55:41.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 -- 172.21.15.96:0/3900160902 shutdown_connections 2022-02-02T21:55:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 --2- 172.21.15.96:0/3900160902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c200f6b30 unknown :-1 s=CLOSED pgs=3278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 --2- 172.21.15.96:0/3900160902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 0x7f2c200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 -- 172.21.15.96:0/3900160902 >> 172.21.15.96:0/3900160902 conn(0x7f2c200f0b90 msgr2=0x7f2c200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 -- 172.21.15.96:0/3900160902 shutdown_connections 2022-02-02T21:55:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.403+0000 7f2c251aa700 1 -- 172.21.15.96:0/3900160902 wait complete. 2022-02-02T21:55:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 Processor -- start 2022-02-02T21:55:41.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 -- start start 2022-02-02T21:55:41.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 0x7f2c20105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20106760 con 0x7f2c200f66d0 2022-02-02T21:55:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c251aa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20106f60 con 0x7f2c200f5430 2022-02-02T21:55:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.404+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45570/0 (socket says 172.21.15.96:45570) 2022-02-02T21:55:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 -- 172.21.15.96:0/4082189345 learned_addr learned my addr 172.21.15.96:0/4082189345 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:41.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1ffff700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 0x7f2c20105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 -- 172.21.15.96:0/4082189345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 msgr2=0x7f2c20105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 0x7f2c20105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 -- 172.21.15.96:0/4082189345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14005040 con 0x7f2c200f66d0 2022-02-02T21:55:41.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1f7fe700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 rx=0x7f2c14009990 tx=0x7f2c14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1401a070 con 0x7f2c200f66d0 2022-02-02T21:55:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c201071e0 con 0x7f2c200f66d0 2022-02-02T21:55:41.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c14012a80 con 0x7f2c200f66d0 2022-02-02T21:55:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1401f9a0 con 0x7f2c200f66d0 2022-02-02T21:55:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.405+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c20107740 con 0x7f2c200f66d0 2022-02-02T21:55:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.406+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20059100 con 0x7f2c200f66d0 2022-02-02T21:55:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.407+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c14012bf0 con 0x7f2c200f66d0 2022-02-02T21:55:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.407+0000 7f2c1cff9700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 0x7f2c080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.407+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c14085d00 con 0x7f2c200f66d0 2022-02-02T21:55:41.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.407+0000 7f2c1ffff700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 0x7f2c080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.408+0000 7f2c1ffff700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 0x7f2c080672e0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f2c200f6530 tx=0x7f2c10009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.412+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c14089030 con 0x7f2c200f66d0 2022-02-02T21:55:41.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.583+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c2005f620 con 0x7f2c08064e20 2022-02-02T21:55:41.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.593+0000 7f2c1cff9700 1 -- 172.21.15.96:0/4082189345 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2c2005f620 con 0x7f2c08064e20 2022-02-02T21:55:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:55:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:55:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:55:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:55:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:55:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:55:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:55:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:55:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:55:41.597 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:55:41.597 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:55:41.598 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:55:41.598 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:55:41.598 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:55:41.599 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:55:41.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:55:41.599 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:55:41.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:55:41.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:55:41.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:55:41.601 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:55:41.601 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:55:41.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.594+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 msgr2=0x7f2c080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.594+0000 7f2c251aa700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 0x7f2c080672e0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f2c200f6530 tx=0x7f2c10009040).stop 2022-02-02T21:55:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.594+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 msgr2=0x7f2c201061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.594+0000 7f2c251aa700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 rx=0x7f2c14009990 tx=0x7f2c14009b30).stop 2022-02-02T21:55:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 shutdown_connections 2022-02-02T21:55:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c08064e20 0x7f2c080672e0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c200f5430 0x7f2c20105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 --2- 172.21.15.96:0/4082189345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c200f66d0 0x7f2c201061b0 unknown :-1 s=CLOSED pgs=3279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 >> 172.21.15.96:0/4082189345 conn(0x7f2c200f0b90 msgr2=0x7f2c200fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 shutdown_connections 2022-02-02T21:55:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.595+0000 7f2c251aa700 1 -- 172.21.15.96:0/4082189345 wait complete. 2022-02-02T21:55:41.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 -- 172.21.15.96:0/409107679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 msgr2=0x7f41200f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 --2- 172.21.15.96:0/409107679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f41200f6b00 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 rx=0x7f4110004660 tx=0x7f4110009b30).stop 2022-02-02T21:55:41.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 -- 172.21.15.96:0/409107679 shutdown_connections 2022-02-02T21:55:41.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 --2- 172.21.15.96:0/409107679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41200f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 --2- 172.21.15.96:0/409107679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f41200f6b00 unknown :-1 s=CLOSED pgs=3280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 -- 172.21.15.96:0/409107679 >> 172.21.15.96:0/409107679 conn(0x7f41200f1e40 msgr2=0x7f41200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 -- 172.21.15.96:0/409107679 shutdown_connections 2022-02-02T21:55:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.692+0000 7f4128740700 1 -- 172.21.15.96:0/409107679 wait complete. 2022-02-02T21:55:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 Processor -- start 2022-02-02T21:55:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 -- start start 2022-02-02T21:55:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41201074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120107a50 con 0x7f41200f66e0 2022-02-02T21:55:41.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4128740700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120107b90 con 0x7f41200f7980 2022-02-02T21:55:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f41264dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f41264dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45578/0 (socket says 172.21.15.96:45578) 2022-02-02T21:55:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f41264dc700 1 -- 172.21.15.96:0/4035980870 learned_addr learned my addr 172.21.15.96:0/4035980870 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.693+0000 7f4125cdb700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41201074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f41264dc700 1 -- 172.21.15.96:0/4035980870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 msgr2=0x7f41201074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f41264dc700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41201074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f41264dc700 1 -- 172.21.15.96:0/4035980870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110005040 con 0x7f41200f66e0 2022-02-02T21:55:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4125cdb700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41201074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:55:41.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f41264dc700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 rx=0x7f4110004f60 tx=0x7f4110009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4110018070 con 0x7f41200f66e0 2022-02-02T21:55:41.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4110007ba0 con 0x7f41200f66e0 2022-02-02T21:55:41.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411001c620 con 0x7f41200f66e0 2022-02-02T21:55:41.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41201084d0 con 0x7f41200f66e0 2022-02-02T21:55:41.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.694+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4120108a30 con 0x7f41200f66e0 2022-02-02T21:55:41.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.695+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4120045ad0 con 0x7f41200f66e0 2022-02-02T21:55:41.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.696+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f411001d420 con 0x7f41200f66e0 2022-02-02T21:55:41.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.696+0000 7f4116ffd700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 0x7f410c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:41.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.696+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f41100838a0 con 0x7f41200f66e0 2022-02-02T21:55:41.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.696+0000 7f4125cdb700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 0x7f410c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:41.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.696+0000 7f4125cdb700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 0x7f410c067290 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f411c004a90 tx=0x7f411c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:41.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.700+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f41100553d0 con 0x7f41200f66e0 2022-02-02T21:55:41.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.930+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4120027a00 con 0x7f41200f66e0 2022-02-02T21:55:41.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.930+0000 7f4116ffd700 1 -- 172.21.15.96:0/4035980870 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4110054fc0 con 0x7f41200f66e0 2022-02-02T21:55:41.932 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:55:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:55:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:55:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:41.934 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:55:41.934 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:55:41.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:41.935 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:55:41.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:55:41.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:41.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:55:41.936 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:55:41.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:55:41.937 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:55:41.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:55:41.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:55:41.938 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:55:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:55:41.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 msgr2=0x7f410c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 0x7f410c067290 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f411c004a90 tx=0x7f411c009040).stop 2022-02-02T21:55:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 msgr2=0x7f4120106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 rx=0x7f4110004f60 tx=0x7f4110009b30).stop 2022-02-02T21:55:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 shutdown_connections 2022-02-02T21:55:41.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f410c064dd0 0x7f410c067290 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41200f66e0 0x7f4120106fb0 unknown :-1 s=CLOSED pgs=3281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 --2- 172.21.15.96:0/4035980870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41200f7980 0x7f41201074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.932+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 >> 172.21.15.96:0/4035980870 conn(0x7f41200f1e40 msgr2=0x7f41200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.933+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 shutdown_connections 2022-02-02T21:55:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:41.933+0000 7f4128740700 1 -- 172.21.15.96:0/4035980870 wait complete. 2022-02-02T21:55:42.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 -- 172.21.15.96:0/231893067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f7980 msgr2=0x7fa68c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:42.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 --2- 172.21.15.96:0/231893067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f7980 0x7fa68c0f7de0 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 rx=0x7fa688004660 tx=0x7fa688009b30).stop 2022-02-02T21:55:42.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 -- 172.21.15.96:0/231893067 shutdown_connections 2022-02-02T21:55:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 --2- 172.21.15.96:0/231893067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f7980 0x7fa68c0f7de0 unknown :-1 s=CLOSED pgs=3282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 --2- 172.21.15.96:0/231893067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f66e0 0x7fa68c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:55:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 -- 172.21.15.96:0/231893067 >> 172.21.15.96:0/231893067 conn(0x7fa68c0f1e40 msgr2=0x7fa68c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.030+0000 7fa693ef4700 1 -- 172.21.15.96:0/231893067 shutdown_connections 2022-02-02T21:55:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 -- 172.21.15.96:0/231893067 wait complete. 2022-02-02T21:55:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 Processor -- start 2022-02-02T21:55:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 -- start start 2022-02-02T21:55:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f7980 0x7fa68c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c107ae0 con 0x7fa68c0f66e0 2022-02-02T21:55:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa693ef4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c108390 con 0x7fa68c0f7980 2022-02-02T21:55:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa691c90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa691c90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45588/0 (socket says 172.21.15.96:45588) 2022-02-02T21:55:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.031+0000 7fa691c90700 1 -- 172.21.15.96:0/3924102927 learned_addr learned my addr 172.21.15.96:0/3924102927 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:55:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa69148f700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f7980 0x7fa68c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa691c90700 1 -- 172.21.15.96:0/3924102927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f7980 msgr2=0x7fa68c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa691c90700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f7980 0x7fa68c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa691c90700 1 -- 172.21.15.96:0/3924102927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688005040 con 0x7fa68c0f66e0 2022-02-02T21:55:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa691c90700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 rx=0x7fa67c0093f0 tx=0x7fa67c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c013640 con 0x7fa68c0f66e0 2022-02-02T21:55:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa67c013c50 con 0x7fa68c0f66e0 2022-02-02T21:55:42.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c108670 con 0x7fa68c0f66e0 2022-02-02T21:55:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c012c70 con 0x7fa68c0f66e0 2022-02-02T21:55:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.032+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c108c30 con 0x7fa68c0f66e0 2022-02-02T21:55:42.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.033+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c0f5ad0 con 0x7fa68c0f66e0 2022-02-02T21:55:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.034+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa67c01a060 con 0x7fa68c0f66e0 2022-02-02T21:55:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.034+0000 7fa6827fc700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 0x7fa678067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:55:42.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.034+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa67c081e60 con 0x7fa68c0f66e0 2022-02-02T21:55:42.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.034+0000 7fa69148f700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 0x7fa678067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:55:42.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.035+0000 7fa69148f700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 0x7fa678067290 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fa688004630 tx=0x7fa688009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:55:42.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.038+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa67c053930 con 0x7fa68c0f66e0 2022-02-02T21:55:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.238+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa68c045ad0 con 0x7fa68c0f66e0 2022-02-02T21:55:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.238+0000 7fa6827fc700 1 -- 172.21.15.96:0/3924102927 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa67c053520 con 0x7fa68c0f66e0 2022-02-02T21:55:42.240 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:55:42.240 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:55:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:55:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:55:42.241 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:42.242 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:55:42.242 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:55:42.242 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:55:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:55:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:55:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:55:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:55:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:55:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:55:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:55:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:55:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:55:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:55:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:55:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:55:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:55:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:55:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:55:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:55:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:55:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:55:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:55:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:55:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:55:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:55:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:55:42.251 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:55:42.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:42.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:42.252 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:55:42.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:55:42.252 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:42.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:42.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:55:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 msgr2=0x7fa678067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 0x7fa678067290 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fa688004630 tx=0x7fa688009b30).stop 2022-02-02T21:55:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 msgr2=0x7fa68c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:55:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 rx=0x7fa67c0093f0 tx=0x7fa67c006ec0).stop 2022-02-02T21:55:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 shutdown_connections 2022-02-02T21:55:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa678064dd0 0x7fa678067290 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa68c0f66e0 0x7fa68c106fb0 unknown :-1 s=CLOSED pgs=3283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 --2- 172.21.15.96:0/3924102927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa68c0f7980 0x7fa68c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:55:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 >> 172.21.15.96:0/3924102927 conn(0x7fa68c0f1e40 msgr2=0x7fa68c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:55:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 shutdown_connections 2022-02-02T21:55:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:55:42.240+0000 7fa693ef4700 1 -- 172.21.15.96:0/3924102927 wait complete. 2022-02-02T21:55:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:55:42.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:42 smithi096 ceph-mon[101353]: pgmap v6407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:42.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:42 smithi096 ceph-mon[101353]: from='client.40668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:42.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4035980870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:55:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:42 smithi159 ceph-mon[69013]: pgmap v6407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:42.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:42 smithi159 ceph-mon[69013]: from='client.40668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:42.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4035980870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:55:43.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:43 smithi159 ceph-mon[69013]: from='client.40672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:43.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3924102927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:55:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:43 smithi096 ceph-mon[101353]: from='client.40672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:55:43.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3924102927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:55:44.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:44 smithi159 ceph-mon[69013]: pgmap v6408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:44 smithi096 ceph-mon[101353]: pgmap v6408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:46 smithi159 ceph-mon[69013]: pgmap v6409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:46 smithi096 ceph-mon[101353]: pgmap v6409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:48 smithi159 ceph-mon[69013]: pgmap v6410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:48 smithi096 ceph-mon[101353]: pgmap v6410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:50 smithi159 ceph-mon[69013]: pgmap v6411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:50 smithi096 ceph-mon[101353]: pgmap v6411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:52 smithi159 ceph-mon[69013]: pgmap v6412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:52 smithi096 ceph-mon[101353]: pgmap v6412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:54 smithi159 ceph-mon[69013]: pgmap v6413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:54 smithi096 ceph-mon[101353]: pgmap v6413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:56 smithi159 ceph-mon[69013]: pgmap v6414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:56 smithi096 ceph-mon[101353]: pgmap v6414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:55:58 smithi159 ceph-mon[69013]: pgmap v6415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:55:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:55:58 smithi096 ceph-mon[101353]: pgmap v6415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:00 smithi159 ceph-mon[69013]: pgmap v6416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:00 smithi096 ceph-mon[101353]: pgmap v6416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:02 smithi159 ceph-mon[69013]: pgmap v6417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:02 smithi096 ceph-mon[101353]: pgmap v6417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:04 smithi159 ceph-mon[69013]: pgmap v6418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:04 smithi096 ceph-mon[101353]: pgmap v6418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:06 smithi159 ceph-mon[69013]: pgmap v6419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:06 smithi096 ceph-mon[101353]: pgmap v6419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:08 smithi159 ceph-mon[69013]: pgmap v6420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:08 smithi096 ceph-mon[101353]: pgmap v6420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:10 smithi159 ceph-mon[69013]: pgmap v6421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:10 smithi096 ceph-mon[101353]: pgmap v6421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 -- 172.21.15.96:0/162187745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79240f9850 msgr2=0x7f79240fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 --2- 172.21.15.96:0/162187745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79240f9850 0x7f79240fbc80 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 rx=0x7f7914004660 tx=0x7f7914009b30).stop 2022-02-02T21:56:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 -- 172.21.15.96:0/162187745 shutdown_connections 2022-02-02T21:56:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 --2- 172.21.15.96:0/162187745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79240f9850 0x7f79240fbc80 unknown :-1 s=CLOSED pgs=3284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 --2- 172.21.15.96:0/162187745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7924060250 0x7f79240f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:56:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.361+0000 7f7928dd7700 1 -- 172.21.15.96:0/162187745 >> 172.21.15.96:0/162187745 conn(0x7f79240f0d40 msgr2=0x7f79240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:12.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 -- 172.21.15.96:0/162187745 shutdown_connections 2022-02-02T21:56:12.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 -- 172.21.15.96:0/162187745 wait complete. 2022-02-02T21:56:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 Processor -- start 2022-02-02T21:56:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 -- start start 2022-02-02T21:56:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79240f9850 0x7f79241074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924107ae0 con 0x7f7924060250 2022-02-02T21:56:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.362+0000 7f7928dd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924108390 con 0x7f79240f9850 2022-02-02T21:56:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45610/0 (socket says 172.21.15.96:45610) 2022-02-02T21:56:12.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 -- 172.21.15.96:0/1675520198 learned_addr learned my addr 172.21.15.96:0/1675520198 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:12.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7921d9b700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79240f9850 0x7f79241074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 -- 172.21.15.96:0/1675520198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79240f9850 msgr2=0x7f79241074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79240f9850 0x7f79241074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 -- 172.21.15.96:0/1675520198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914005040 con 0x7f7924060250 2022-02-02T21:56:12.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f792259c700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 rx=0x7f791800b410 tx=0x7f7918006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79180125f0 con 0x7f7924060250 2022-02-02T21:56:12.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7918012c00 con 0x7f7924060250 2022-02-02T21:56:12.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7924108670 con 0x7f7924060250 2022-02-02T21:56:12.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7918002ae0 con 0x7f7924060250 2022-02-02T21:56:12.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.363+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7924108c30 con 0x7f7924060250 2022-02-02T21:56:12.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.364+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79240f49b0 con 0x7f7924060250 2022-02-02T21:56:12.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.365+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f791800f030 con 0x7f7924060250 2022-02-02T21:56:12.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.365+0000 7f7912ffd700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 0x7f790c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.365+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7918081eb0 con 0x7f7924060250 2022-02-02T21:56:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.365+0000 7f7921d9b700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 0x7f790c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.366+0000 7f7921d9b700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 0x7f790c067290 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f7914009da0 tx=0x7f7914009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.369+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79180539e0 con 0x7f7924060250 2022-02-02T21:56:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:12 smithi159 ceph-mon[69013]: pgmap v6422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:12.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.547+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79240ff000 con 0x7f790c064dd0 2022-02-02T21:56:12.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:12 smithi096 ceph-mon[101353]: pgmap v6422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:12.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.548+0000 7f7912ffd700 1 -- 172.21.15.96:0/1675520198 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f79240ff000 con 0x7f790c064dd0 2022-02-02T21:56:12.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 msgr2=0x7f790c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 0x7f790c067290 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f7914009da0 tx=0x7f7914009b30).stop 2022-02-02T21:56:12.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 msgr2=0x7f7924106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 rx=0x7f791800b410 tx=0x7f7918006ef0).stop 2022-02-02T21:56:12.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 shutdown_connections 2022-02-02T21:56:12.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f790c064dd0 0x7f790c067290 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7924060250 0x7f7924106fb0 unknown :-1 s=CLOSED pgs=3285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 --2- 172.21.15.96:0/1675520198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79240f9850 0x7f79241074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.550+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 >> 172.21.15.96:0/1675520198 conn(0x7f79240f0d40 msgr2=0x7f79240f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:12.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.551+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 shutdown_connections 2022-02-02T21:56:12.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.551+0000 7f7928dd7700 1 -- 172.21.15.96:0/1675520198 wait complete. 2022-02-02T21:56:12.560 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:56:12.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 -- 172.21.15.96:0/3916706855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f66d0 msgr2=0x7f85c40f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 --2- 172.21.15.96:0/3916706855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f66d0 0x7f85c40f6af0 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 rx=0x7f85b8004660 tx=0x7f85b8009b30).stop 2022-02-02T21:56:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 -- 172.21.15.96:0/3916706855 shutdown_connections 2022-02-02T21:56:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 --2- 172.21.15.96:0/3916706855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f7970 0x7f85c40f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:56:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 --2- 172.21.15.96:0/3916706855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f66d0 0x7f85c40f6af0 unknown :-1 s=CLOSED pgs=3286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 -- 172.21.15.96:0/3916706855 >> 172.21.15.96:0/3916706855 conn(0x7f85c40f1e50 msgr2=0x7f85c40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 -- 172.21.15.96:0/3916706855 shutdown_connections 2022-02-02T21:56:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.649+0000 7f85ca496700 1 -- 172.21.15.96:0/3916706855 wait complete. 2022-02-02T21:56:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 Processor -- start 2022-02-02T21:56:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 -- start start 2022-02-02T21:56:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f66d0 0x7f85c4106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4107ac0 con 0x7f85c40f7970 2022-02-02T21:56:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85ca496700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4108370 con 0x7f85c40f66d0 2022-02-02T21:56:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45622/0 (socket says 172.21.15.96:45622) 2022-02-02T21:56:12.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 -- 172.21.15.96:0/1726816834 learned_addr learned my addr 172.21.15.96:0/1726816834 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c3fff700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f66d0 0x7f85c4106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 -- 172.21.15.96:0/1726816834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f66d0 msgr2=0x7f85c4106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f66d0 0x7f85c4106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.650+0000 7f85c37fe700 1 -- 172.21.15.96:0/1726816834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8005040 con 0x7f85c40f7970 2022-02-02T21:56:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85c37fe700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 rx=0x7f85b400b410 tx=0x7f85b4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b40125f0 con 0x7f85c40f7970 2022-02-02T21:56:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85b400be30 con 0x7f85c40f7970 2022-02-02T21:56:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4108650 con 0x7f85c40f7970 2022-02-02T21:56:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b4002a70 con 0x7f85c40f7970 2022-02-02T21:56:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.651+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4108c10 con 0x7f85c40f7970 2022-02-02T21:56:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.652+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c40f5ac0 con 0x7f85c40f7970 2022-02-02T21:56:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.652+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85b400f030 con 0x7f85c40f7970 2022-02-02T21:56:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.652+0000 7f85c0ff9700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 0x7f85ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.653+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85b4081e60 con 0x7f85c40f7970 2022-02-02T21:56:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.653+0000 7f85c3fff700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 0x7f85ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.653+0000 7f85c3fff700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 0x7f85ac067290 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f85b8004630 tx=0x7f85b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.657+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85b4053990 con 0x7f85c40f7970 2022-02-02T21:56:12.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.830+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c40fef80 con 0x7f85ac064dd0 2022-02-02T21:56:12.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.840+0000 7f85c0ff9700 1 -- 172.21.15.96:0/1726816834 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f85c40fef80 con 0x7f85ac064dd0 2022-02-02T21:56:12.841 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:56:12.841 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:56:12.841 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:56:12.842 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:56:12.842 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:56:12.842 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:56:12.843 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:56:12.843 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:56:12.843 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:56:12.844 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:56:12.844 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:56:12.844 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:56:12.845 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:56:12.845 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:56:12.845 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:56:12.846 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:56:12.846 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:56:12.846 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:56:12.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:56:12.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:56:12.847 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:56:12.848 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:56:12.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 msgr2=0x7f85ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 0x7f85ac067290 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f85b8004630 tx=0x7f85b8009b30).stop 2022-02-02T21:56:12.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 msgr2=0x7f85c4107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 rx=0x7f85b400b410 tx=0x7f85b4006ef0).stop 2022-02-02T21:56:12.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 shutdown_connections 2022-02-02T21:56:12.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85ac064dd0 0x7f85ac067290 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85c40f66d0 0x7f85c4106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 --2- 172.21.15.96:0/1726816834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c40f7970 0x7f85c4107480 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 >> 172.21.15.96:0/1726816834 conn(0x7f85c40f1e50 msgr2=0x7f85c40fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:12.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 shutdown_connections 2022-02-02T21:56:12.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.842+0000 7f85ca496700 1 -- 172.21.15.96:0/1726816834 wait complete. 2022-02-02T21:56:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 -- 172.21.15.96:0/597341884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 msgr2=0x7f00cc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 --2- 172.21.15.96:0/597341884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc0f6b00 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 rx=0x7f00bc004660 tx=0x7f00bc009b30).stop 2022-02-02T21:56:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 -- 172.21.15.96:0/597341884 shutdown_connections 2022-02-02T21:56:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 --2- 172.21.15.96:0/597341884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 0x7f00cc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 --2- 172.21.15.96:0/597341884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc0f6b00 unknown :-1 s=CLOSED pgs=3288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.939+0000 7f00d433c700 1 -- 172.21.15.96:0/597341884 >> 172.21.15.96:0/597341884 conn(0x7f00cc0f1e40 msgr2=0x7f00cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 -- 172.21.15.96:0/597341884 shutdown_connections 2022-02-02T21:56:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 -- 172.21.15.96:0/597341884 wait complete. 2022-02-02T21:56:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 Processor -- start 2022-02-02T21:56:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 -- start start 2022-02-02T21:56:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 0x7f00cc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc107a50 con 0x7f00cc0f66e0 2022-02-02T21:56:12.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d433c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc107b90 con 0x7f00cc0f7980 2022-02-02T21:56:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d20d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d20d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45630/0 (socket says 172.21.15.96:45630) 2022-02-02T21:56:12.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.940+0000 7f00d20d8700 1 -- 172.21.15.96:0/1362736164 learned_addr learned my addr 172.21.15.96:0/1362736164 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d18d7700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 0x7f00cc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d20d8700 1 -- 172.21.15.96:0/1362736164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 msgr2=0x7f00cc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d20d8700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 0x7f00cc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d20d8700 1 -- 172.21.15.96:0/1362736164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc005040 con 0x7f00cc0f66e0 2022-02-02T21:56:12.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d20d8700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 rx=0x7f00bc000c00 tx=0x7f00bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00bc018070 con 0x7f00cc0f66e0 2022-02-02T21:56:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00bc007d70 con 0x7f00cc0f66e0 2022-02-02T21:56:12.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc1084d0 con 0x7f00cc0f66e0 2022-02-02T21:56:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00bc01c620 con 0x7f00cc0f66e0 2022-02-02T21:56:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.941+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc108a30 con 0x7f00cc0f66e0 2022-02-02T21:56:12.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.942+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc045ad0 con 0x7f00cc0f66e0 2022-02-02T21:56:12.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.943+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f00bc01c860 con 0x7f00cc0f66e0 2022-02-02T21:56:12.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.943+0000 7f00c2ffd700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 0x7f00b8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:12.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.943+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f00bc083c30 con 0x7f00cc0f66e0 2022-02-02T21:56:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.943+0000 7f00d18d7700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 0x7f00b8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:12.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.944+0000 7f00d18d7700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 0x7f00b8067270 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f00c80049e0 tx=0x7f00c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:12.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:12.947+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00bc055760 con 0x7f00cc0f66e0 2022-02-02T21:56:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.176+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00cc027a00 con 0x7f00cc0f66e0 2022-02-02T21:56:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.177+0000 7f00c2ffd700 1 -- 172.21.15.96:0/1362736164 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f00bc055350 con 0x7f00cc0f66e0 2022-02-02T21:56:13.177 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:56:13.178 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:56:13.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:56:13.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:13.179 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:56:13.179 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:56:13.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:13.180 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:56:13.180 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:56:13.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:13.181 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:56:13.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:56:13.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:13.182 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:56:13.182 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:56:13.183 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:56:13.183 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:56:13.183 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:56:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 msgr2=0x7f00b8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 0x7f00b8067270 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f00c80049e0 tx=0x7f00c8009040).stop 2022-02-02T21:56:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 msgr2=0x7f00cc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 rx=0x7f00bc000c00 tx=0x7f00bc009b30).stop 2022-02-02T21:56:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 shutdown_connections 2022-02-02T21:56:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f00b8064db0 0x7f00b8067270 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00cc0f66e0 0x7f00cc106fb0 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 --2- 172.21.15.96:0/1362736164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc0f7980 0x7f00cc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 >> 172.21.15.96:0/1362736164 conn(0x7f00cc0f1e40 msgr2=0x7f00cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:13.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 shutdown_connections 2022-02-02T21:56:13.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.179+0000 7f00d433c700 1 -- 172.21.15.96:0/1362736164 wait complete. 2022-02-02T21:56:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 -- 172.21.15.96:0/805843019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f7980 msgr2=0x7feecc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 --2- 172.21.15.96:0/805843019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f7980 0x7feecc0f7de0 secure :-1 s=READY pgs=3290 cs=0 l=1 rev1=1 rx=0x7feec0004660 tx=0x7feec0009b30).stop 2022-02-02T21:56:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 -- 172.21.15.96:0/805843019 shutdown_connections 2022-02-02T21:56:13.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 --2- 172.21.15.96:0/805843019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f7980 0x7feecc0f7de0 unknown :-1 s=CLOSED pgs=3290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 --2- 172.21.15.96:0/805843019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f66e0 0x7feecc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 -- 172.21.15.96:0/805843019 >> 172.21.15.96:0/805843019 conn(0x7feecc0f1e40 msgr2=0x7feecc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 -- 172.21.15.96:0/805843019 shutdown_connections 2022-02-02T21:56:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.279+0000 7feed1e89700 1 -- 172.21.15.96:0/805843019 wait complete. 2022-02-02T21:56:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 Processor -- start 2022-02-02T21:56:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 -- start start 2022-02-02T21:56:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f7980 0x7feecc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc06a380 con 0x7feecc0f66e0 2022-02-02T21:56:13.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feed1e89700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc06a4c0 con 0x7feecc0f7980 2022-02-02T21:56:13.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:13.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45640/0 (socket says 172.21.15.96:45640) 2022-02-02T21:56:13.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 -- 172.21.15.96:0/2350502697 learned_addr learned my addr 172.21.15.96:0/2350502697 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:13.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecaffd700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f7980 0x7feecc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:13.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 -- 172.21.15.96:0/2350502697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f7980 msgr2=0x7feecc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f7980 0x7feecc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.280+0000 7feecb7fe700 1 -- 172.21.15.96:0/2350502697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0005040 con 0x7feecc0f66e0 2022-02-02T21:56:13.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feecb7fe700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 rx=0x7feebc00c530 tx=0x7feebc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:13.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feebc00f650 con 0x7feecc0f66e0 2022-02-02T21:56:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc06a7a0 con 0x7feecc0f66e0 2022-02-02T21:56:13.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feebc00fc60 con 0x7feecc0f66e0 2022-02-02T21:56:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc10ef90 con 0x7feecc0f66e0 2022-02-02T21:56:13.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.281+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feebc012cb0 con 0x7feecc0f66e0 2022-02-02T21:56:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.282+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc045ad0 con 0x7feecc0f66e0 2022-02-02T21:56:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.282+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feebc019030 con 0x7feecc0f66e0 2022-02-02T21:56:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.283+0000 7feeb3fff700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:13.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.283+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feebc081640 con 0x7feecc0f66e0 2022-02-02T21:56:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.283+0000 7feecaffd700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:13.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.283+0000 7feecaffd700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7feec0004630 tx=0x7feec0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:13.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.287+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feebc04f790 con 0x7feecc0f66e0 2022-02-02T21:56:13.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.489+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feecc0fef70 con 0x7feecc0f66e0 2022-02-02T21:56:13.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.490+0000 7feeb3fff700 1 -- 172.21.15.96:0/2350502697 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7feebc052db0 con 0x7feecc0f66e0 2022-02-02T21:56:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:56:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:56:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:56:13.492 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:56:13.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:13.492 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:56:13.493 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:56:13.493 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:56:13.493 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:56:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:56:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:56:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:56:13.495 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:56:13.495 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:56:13.495 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:56:13.496 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:56:13.496 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:56:13.496 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:56:13.497 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:56:13.497 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:56:13.497 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:56:13.498 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:56:13.498 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:56:13.499 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:56:13.499 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:56:13.499 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:56:13.500 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:56:13.500 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:56:13.500 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:56:13.501 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:56:13.501 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:56:13.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:56:13.502 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:13.502 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:13.502 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:56:13.503 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:13.503 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:13.503 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:13.504 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:13.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 msgr2=0x7feeb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7feec0004630 tx=0x7feec0009b30).stop 2022-02-02T21:56:13.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 msgr2=0x7feecc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:13.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 rx=0x7feebc00c530 tx=0x7feebc007e10).stop 2022-02-02T21:56:13.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 shutdown_connections 2022-02-02T21:56:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feeb4064dd0 0x7feeb4067290 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0f66e0 0x7feecc06b9a0 unknown :-1 s=CLOSED pgs=3291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 --2- 172.21.15.96:0/2350502697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feecc0f7980 0x7feecc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 >> 172.21.15.96:0/2350502697 conn(0x7feecc0f1e40 msgr2=0x7feecc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 shutdown_connections 2022-02-02T21:56:13.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:13.493+0000 7feed1e89700 1 -- 172.21.15.96:0/2350502697 wait complete. 2022-02-02T21:56:13.509 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:56:14.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:13 smithi159 ceph-mon[69013]: from='client.40684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:13 smithi159 ceph-mon[69013]: pgmap v6423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:13 smithi159 ceph-mon[69013]: from='client.40688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1362736164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:56:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2350502697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:56:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:13 smithi096 ceph-mon[101353]: from='client.40684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:13 smithi096 ceph-mon[101353]: pgmap v6423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:13 smithi096 ceph-mon[101353]: from='client.40688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1362736164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:56:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2350502697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:56:16.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:15 smithi159 ceph-mon[69013]: pgmap v6424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:15 smithi096 ceph-mon[101353]: pgmap v6424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:18.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:17 smithi159 ceph-mon[69013]: pgmap v6425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:17 smithi096 ceph-mon[101353]: pgmap v6425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:20.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:19 smithi159 ceph-mon[69013]: pgmap v6426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:19 smithi096 ceph-mon[101353]: pgmap v6426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:22.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:21 smithi159 ceph-mon[69013]: pgmap v6427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:21 smithi096 ceph-mon[101353]: pgmap v6427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:24.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:23 smithi159 ceph-mon[69013]: pgmap v6428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:23 smithi096 ceph-mon[101353]: pgmap v6428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:26.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:25 smithi159 ceph-mon[69013]: pgmap v6429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:25 smithi096 ceph-mon[101353]: pgmap v6429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:27 smithi159 ceph-mon[69013]: pgmap v6430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:56:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:56:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:27 smithi096 ceph-mon[101353]: pgmap v6430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:56:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:56:30.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:29 smithi159 ceph-mon[69013]: pgmap v6431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:29 smithi096 ceph-mon[101353]: pgmap v6431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:32.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:31 smithi159 ceph-mon[69013]: pgmap v6432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:31 smithi096 ceph-mon[101353]: pgmap v6432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:34.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:33 smithi159 ceph-mon[69013]: pgmap v6433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:34.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:33 smithi096 ceph-mon[101353]: pgmap v6433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:35 smithi159 ceph-mon[69013]: pgmap v6434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:35 smithi096 ceph-mon[101353]: pgmap v6434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:38.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:37 smithi159 ceph-mon[69013]: pgmap v6435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:38.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:37 smithi096 ceph-mon[101353]: pgmap v6435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:39 smithi159 ceph-mon[69013]: pgmap v6436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:39 smithi096 ceph-mon[101353]: pgmap v6436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:42.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:41 smithi159 ceph-mon[69013]: pgmap v6437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:42.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:41 smithi096 ceph-mon[101353]: pgmap v6437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2296944125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 msgr2=0x7f8ff40fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2296944125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff40fdfc0 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 rx=0x7f8fe4004660 tx=0x7f8fe4009b30).stop 2022-02-02T21:56:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2296944125 shutdown_connections 2022-02-02T21:56:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2296944125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff40fdfc0 unknown :-1 s=CLOSED pgs=3292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2296944125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 0x7f8ff40fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:56:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2296944125 >> 172.21.15.96:0/2296944125 conn(0x7f8ff40f0d40 msgr2=0x7f8ff40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2296944125 shutdown_connections 2022-02-02T21:56:43.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.604+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2296944125 wait complete. 2022-02-02T21:56:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 Processor -- start 2022-02-02T21:56:43.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 -- start start 2022-02-02T21:56:43.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 0x7f8ff4109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4109cb0 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.605+0000 7f8ff94b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff410a560 con 0x7f8ff40602d0 2022-02-02T21:56:43.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45664/0 (socket says 172.21.15.96:45664) 2022-02-02T21:56:43.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 -- 172.21.15.96:0/2889173875 learned_addr learned my addr 172.21.15.96:0/2889173875 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff2ffd700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 0x7f8ff4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 -- 172.21.15.96:0/2889173875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 msgr2=0x7f8ff4109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 0x7f8ff4109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 -- 172.21.15.96:0/2889173875 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4005040 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff27fc700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 rx=0x7f8fe4000c00 tx=0x7f8fe4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4018070 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8fe4007d70 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff410a7e0 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe401c620 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.606+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff410ad40 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.607+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff40f49b0 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.608+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8fe401c860 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.608+0000 7f8fdb7fe700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 0x7f8fdc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.608+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8fe40838f0 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.608+0000 7f8ff2ffd700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 0x7f8fdc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.609+0000 7f8ff2ffd700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 0x7f8fdc067270 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f8fe800b790 tx=0x7f8fe8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:43.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.612+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8fe4055420 con 0x7f8ff40fbbd0 2022-02-02T21:56:43.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.790+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ff4101100 con 0x7f8fdc064db0 2022-02-02T21:56:43.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.792+0000 7f8fdb7fe700 1 -- 172.21.15.96:0/2889173875 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8ff4101100 con 0x7f8fdc064db0 2022-02-02T21:56:43.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 msgr2=0x7f8fdc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 0x7f8fdc067270 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f8fe800b790 tx=0x7f8fe8008040).stop 2022-02-02T21:56:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 msgr2=0x7f8ff4109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 rx=0x7f8fe4000c00 tx=0x7f8fe4009b30).stop 2022-02-02T21:56:43.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 shutdown_connections 2022-02-02T21:56:43.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fdc064db0 0x7f8fdc067270 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ff40602d0 0x7f8ff4109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.793+0000 7f8ff94b9700 1 --2- 172.21.15.96:0/2889173875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff40fbbd0 0x7f8ff4109670 unknown :-1 s=CLOSED pgs=3293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.794+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 >> 172.21.15.96:0/2889173875 conn(0x7f8ff40f0d40 msgr2=0x7f8ff40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.794+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 shutdown_connections 2022-02-02T21:56:43.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.794+0000 7f8ff94b9700 1 -- 172.21.15.96:0/2889173875 wait complete. 2022-02-02T21:56:43.803 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:56:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 -- 172.21.15.96:0/3850830082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 msgr2=0x7f7cac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 --2- 172.21.15.96:0/3850830082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac0f6cc0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 rx=0x7f7c9c004660 tx=0x7f7c9c009b30).stop 2022-02-02T21:56:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 -- 172.21.15.96:0/3850830082 shutdown_connections 2022-02-02T21:56:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 --2- 172.21.15.96:0/3850830082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac0f6cc0 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 --2- 172.21.15.96:0/3850830082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 -- 172.21.15.96:0/3850830082 >> 172.21.15.96:0/3850830082 conn(0x7f7cac0f0d40 msgr2=0x7f7cac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 -- 172.21.15.96:0/3850830082 shutdown_connections 2022-02-02T21:56:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.891+0000 7f7cb2864700 1 -- 172.21.15.96:0/3850830082 wait complete. 2022-02-02T21:56:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 Processor -- start 2022-02-02T21:56:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 -- start start 2022-02-02T21:56:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0602b0 con 0x7f7cac0f6860 2022-02-02T21:56:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cb2864700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0603f0 con 0x7f7cac0f55c0 2022-02-02T21:56:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:49776/0 (socket says 172.21.15.96:49776) 2022-02-02T21:56:43.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.892+0000 7f7cabfff700 1 -- 172.21.15.96:0/1108697872 learned_addr learned my addr 172.21.15.96:0/1108697872 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cab7fe700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cabfff700 1 -- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 msgr2=0x7f7cac10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:43.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cabfff700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cabfff700 1 -- 172.21.15.96:0/1108697872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c005040 con 0x7f7cac0f55c0 2022-02-02T21:56:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cab7fe700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:56:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cabfff700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7ca000c790 tx=0x7f7ca0007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca000e680 con 0x7f7cac0f55c0 2022-02-02T21:56:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac10ea60 con 0x7f7cac0f55c0 2022-02-02T21:56:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ca000ec90 con 0x7f7cac0f55c0 2022-02-02T21:56:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac10eee0 con 0x7f7cac0f55c0 2022-02-02T21:56:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.893+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca0012d00 con 0x7f7cac0f55c0 2022-02-02T21:56:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.894+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac045ad0 con 0x7f7cac0f55c0 2022-02-02T21:56:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.895+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ca0010070 con 0x7f7cac0f55c0 2022-02-02T21:56:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.895+0000 7f7ca8ff9700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 0x7f7c94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.895+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ca0081e00 con 0x7f7cac0f55c0 2022-02-02T21:56:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.895+0000 7f7cab7fe700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 0x7f7c94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.895+0000 7f7cab7fe700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 0x7f7c94067290 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f7c9c004e30 tx=0x7f7c9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:43.899+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ca004ff80 con 0x7f7cac0f55c0 2022-02-02T21:56:44.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.073+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cac0fdf00 con 0x7f7c94064dd0 2022-02-02T21:56:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.083+0000 7f7ca8ff9700 1 -- 172.21.15.96:0/1108697872 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7cac0fdf00 con 0x7f7c94064dd0 2022-02-02T21:56:44.083 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:56:44.083 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:56:44.084 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:56:44.084 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:56:44.084 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:56:44.085 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:56:44.085 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:56:44.085 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:56:44.086 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:56:44.086 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:56:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:56:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:56:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:56:44.088 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:56:44.088 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:56:44.088 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:56:44.089 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:56:44.089 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:56:44.089 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:56:44.090 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:56:44.090 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:56:44.091 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:56:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 msgr2=0x7f7c94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 0x7f7c94067290 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f7c9c004e30 tx=0x7f7c9c009b30).stop 2022-02-02T21:56:44.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 msgr2=0x7f7cac10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7ca000c790 tx=0x7f7ca0007d90).stop 2022-02-02T21:56:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 shutdown_connections 2022-02-02T21:56:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c94064dd0 0x7f7c94067290 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cac0f55c0 0x7f7cac10c070 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 --2- 172.21.15.96:0/1108697872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7cac0f6860 0x7f7cac10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 >> 172.21.15.96:0/1108697872 conn(0x7f7cac0f0d40 msgr2=0x7f7cac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 shutdown_connections 2022-02-02T21:56:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.085+0000 7f7cb2864700 1 -- 172.21.15.96:0/1108697872 wait complete. 2022-02-02T21:56:44.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/1133302310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 msgr2=0x7f9b740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/1133302310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b740f6cc0 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 rx=0x7f9b70004660 tx=0x7f9b70009b30).stop 2022-02-02T21:56:44.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/1133302310 shutdown_connections 2022-02-02T21:56:44.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/1133302310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f6860 0x7f9b740f6cc0 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/1133302310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f55c0 0x7f9b740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:56:44.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/1133302310 >> 172.21.15.96:0/1133302310 conn(0x7f9b740f0d40 msgr2=0x7f9b740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:44.184 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:43 smithi096 ceph-mon[101353]: pgmap v6438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:44.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/1133302310 shutdown_connections 2022-02-02T21:56:44.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.182+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/1133302310 wait complete. 2022-02-02T21:56:44.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 Processor -- start 2022-02-02T21:56:44.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 -- start start 2022-02-02T21:56:44.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b7410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74060470 con 0x7f9b740f55c0 2022-02-02T21:56:44.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b7b7a4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740605b0 con 0x7f9b740f6860 2022-02-02T21:56:44.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45682/0 (socket says 172.21.15.96:45682) 2022-02-02T21:56:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 -- 172.21.15.96:0/3871243385 learned_addr learned my addr 172.21.15.96:0/3871243385 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b78d3f700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b7410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 -- 172.21.15.96:0/3871243385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 msgr2=0x7f9b7410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b7410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.183+0000 7f9b79540700 1 -- 172.21.15.96:0/3871243385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70005040 con 0x7f9b740f55c0 2022-02-02T21:56:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b79540700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 rx=0x7f9b640093f0 tx=0x7f9b64006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:44.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b64009ea0 con 0x7f9b740f55c0 2022-02-02T21:56:44.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b64013af0 con 0x7f9b740f55c0 2022-02-02T21:56:44.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6400db10 con 0x7f9b740f55c0 2022-02-02T21:56:44.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7410c810 con 0x7f9b740f55c0 2022-02-02T21:56:44.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b78d3f700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b7410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:56:44.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.184+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7410cd50 con 0x7f9b740f55c0 2022-02-02T21:56:44.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.185+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74045ad0 con 0x7f9b740f55c0 2022-02-02T21:56:44.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.186+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b6401a060 con 0x7f9b740f55c0 2022-02-02T21:56:44.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.186+0000 7f9b69ffb700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.186+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b64081a90 con 0x7f9b740f55c0 2022-02-02T21:56:44.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.186+0000 7f9b78d3f700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.187+0000 7f9b78d3f700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f9b70004e30 tx=0x7f9b70009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:44.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.190+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b6404fb90 con 0x7f9b740f55c0 2022-02-02T21:56:44.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:43 smithi159 ceph-mon[69013]: pgmap v6438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:44.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.423+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b74027a00 con 0x7f9b740f55c0 2022-02-02T21:56:44.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.423+0000 7f9b69ffb700 1 -- 172.21.15.96:0/3871243385 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9b640531b0 con 0x7f9b740f55c0 2022-02-02T21:56:44.424 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:56:44.424 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:56:44.425 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:56:44.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:44.425 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:56:44.426 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:56:44.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:44.427 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:56:44.427 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:56:44.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:44.428 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:56:44.428 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:56:44.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:56:44.429 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:56:44.429 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:56:44.429 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:56:44.430 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:56:44.430 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:56:44.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 msgr2=0x7f9b60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f9b70004e30 tx=0x7f9b70009b30).stop 2022-02-02T21:56:44.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 msgr2=0x7f9b74109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 rx=0x7f9b640093f0 tx=0x7f9b64006ec0).stop 2022-02-02T21:56:44.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 shutdown_connections 2022-02-02T21:56:44.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b60064dd0 0x7f9b60067290 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b740f55c0 0x7f9b74109cb0 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 --2- 172.21.15.96:0/3871243385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b740f6860 0x7f9b7410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 >> 172.21.15.96:0/3871243385 conn(0x7f9b740f0d40 msgr2=0x7f9b740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:44.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 shutdown_connections 2022-02-02T21:56:44.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.425+0000 7f9b7b7a4700 1 -- 172.21.15.96:0/3871243385 wait complete. 2022-02-02T21:56:44.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- 172.21.15.96:0/3851076949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 msgr2=0x7fc85c0f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 --2- 172.21.15.96:0/3851076949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c0f6fd0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 rx=0x7fc850004660 tx=0x7fc850009b30).stop 2022-02-02T21:56:44.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- 172.21.15.96:0/3851076949 shutdown_connections 2022-02-02T21:56:44.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 --2- 172.21.15.96:0/3851076949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 0x7fc85c0f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 --2- 172.21.15.96:0/3851076949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c0f6fd0 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- 172.21.15.96:0/3851076949 >> 172.21.15.96:0/3851076949 conn(0x7fc85c0f04c0 msgr2=0x7fc85c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:44.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- 172.21.15.96:0/3851076949 shutdown_connections 2022-02-02T21:56:44.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- 172.21.15.96:0/3851076949 wait complete. 2022-02-02T21:56:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 Processor -- start 2022-02-02T21:56:44.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.523+0000 7fc862bc8700 1 -- start start 2022-02-02T21:56:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc862bc8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 0x7fc85c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc862bc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc862bc8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0f5560 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc862bc8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0f56a0 con 0x7fc85c0f58b0 2022-02-02T21:56:44.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45694/0 (socket says 172.21.15.96:45694) 2022-02-02T21:56:44.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 -- 172.21.15.96:0/1770791955 learned_addr learned my addr 172.21.15.96:0/1770791955 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:56:44.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc860964700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 0x7fc85c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 -- 172.21.15.96:0/1770791955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 msgr2=0x7fc85c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 0x7fc85c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 -- 172.21.15.96:0/1770791955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850005040 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc85bfff700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 rx=0x7fc848002700 tx=0x7fc848009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:44.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8480079c0 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.524+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc84800f040 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.525+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c10c740 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.525+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc848014860 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.525+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c10cd00 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.526+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc84801b060 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.526+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c045ad0 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.526+0000 7fc8597fa700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:56:44.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.526+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc8480818e0 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.526+0000 7fc860964700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:56:44.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.527+0000 7fc860964700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fc850013690 tx=0x7fc850009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:56:44.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.531+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc84804f9e0 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.733+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc85c027a00 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.734+0000 7fc8597fa700 1 -- 172.21.15.96:0/1770791955 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc848019070 con 0x7fc85c0f6bb0 2022-02-02T21:56:44.735 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:56:44.735 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:56:44.735 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:56:44.736 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:56:44.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:44.736 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:56:44.737 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:56:44.737 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:56:44.737 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:56:44.738 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:56:44.738 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:56:44.738 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:56:44.739 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:56:44.739 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:56:44.740 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:56:44.740 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:56:44.740 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:56:44.742 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:56:44.743 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:56:44.743 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:56:44.743 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:56:44.744 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:56:44.744 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:56:44.744 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:56:44.745 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:56:44.745 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:56:44.745 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:56:44.746 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:56:44.746 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:56:44.746 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:56:44.747 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:56:44.747 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:56:44.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:44.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:44.748 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:56:44.749 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:56:44.749 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:44.749 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:44.750 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:56:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.735+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 msgr2=0x7fc84c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.735+0000 7fc862bc8700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fc850013690 tx=0x7fc850009b30).stop 2022-02-02T21:56:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.735+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 msgr2=0x7fc85c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:56:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.735+0000 7fc862bc8700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 rx=0x7fc848002700 tx=0x7fc848009d80).stop 2022-02-02T21:56:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 shutdown_connections 2022-02-02T21:56:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc84c064dd0 0x7fc84c067290 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0f58b0 0x7fc85c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 --2- 172.21.15.96:0/1770791955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc85c0f6bb0 0x7fc85c10c190 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:56:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 >> 172.21.15.96:0/1770791955 conn(0x7fc85c0f04c0 msgr2=0x7fc85c0fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:56:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 shutdown_connections 2022-02-02T21:56:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:56:44.736+0000 7fc862bc8700 1 -- 172.21.15.96:0/1770791955 wait complete. 2022-02-02T21:56:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:56:45.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:44 smithi159 ceph-mon[69013]: from='client.40700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:44 smithi159 ceph-mon[69013]: from='client.48319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3871243385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:56:45.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1770791955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:56:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:44 smithi096 ceph-mon[101353]: from='client.40700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:44 smithi096 ceph-mon[101353]: from='client.48319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:56:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3871243385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:56:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1770791955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:56:46.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:45 smithi159 ceph-mon[69013]: pgmap v6439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:46.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:45 smithi096 ceph-mon[101353]: pgmap v6439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:48.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:47 smithi159 ceph-mon[69013]: pgmap v6440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:47 smithi096 ceph-mon[101353]: pgmap v6440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:50.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:49 smithi159 ceph-mon[69013]: pgmap v6441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:49 smithi096 ceph-mon[101353]: pgmap v6441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:52.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:51 smithi159 ceph-mon[69013]: pgmap v6442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:52.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:51 smithi096 ceph-mon[101353]: pgmap v6442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:53 smithi159 ceph-mon[69013]: pgmap v6443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:54.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:53 smithi096 ceph-mon[101353]: pgmap v6443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:56.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:55 smithi159 ceph-mon[69013]: pgmap v6444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:56.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:55 smithi096 ceph-mon[101353]: pgmap v6444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:58.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:57 smithi159 ceph-mon[69013]: pgmap v6445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:56:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:57 smithi096 ceph-mon[101353]: pgmap v6445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:00.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:56:59 smithi159 ceph-mon[69013]: pgmap v6446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:56:59 smithi096 ceph-mon[101353]: pgmap v6446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:02.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:01 smithi159 ceph-mon[69013]: pgmap v6447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:01 smithi096 ceph-mon[101353]: pgmap v6447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:04.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:04 smithi159 ceph-mon[69013]: pgmap v6448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:04.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:04 smithi096 ceph-mon[101353]: pgmap v6448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:06 smithi159 ceph-mon[69013]: pgmap v6449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:06 smithi096 ceph-mon[101353]: pgmap v6449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:08 smithi159 ceph-mon[69013]: pgmap v6450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:08 smithi096 ceph-mon[101353]: pgmap v6450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:10.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:10 smithi159 ceph-mon[69013]: pgmap v6451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:10 smithi096 ceph-mon[101353]: pgmap v6451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:12 smithi159 ceph-mon[69013]: pgmap v6452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:12 smithi096 ceph-mon[101353]: pgmap v6452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:14.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:14 smithi159 ceph-mon[69013]: pgmap v6453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:14 smithi096 ceph-mon[101353]: pgmap v6453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:14.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.845+0000 7fd8cc305700 1 -- 172.21.15.96:0/1379923182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40f9880 msgr2=0x7fd8c40fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:14.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.845+0000 7fd8cc305700 1 --2- 172.21.15.96:0/1379923182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40f9880 0x7fd8c40fbc70 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 rx=0x7fd8b4004660 tx=0x7fd8b4009b30).stop 2022-02-02T21:57:14.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- 172.21.15.96:0/1379923182 shutdown_connections 2022-02-02T21:57:14.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 --2- 172.21.15.96:0/1379923182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40f9880 0x7fd8c40fbc70 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:14.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 --2- 172.21.15.96:0/1379923182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40602b0 0x7fd8c40f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:14.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- 172.21.15.96:0/1379923182 >> 172.21.15.96:0/1379923182 conn(0x7fd8c40f0d40 msgr2=0x7fd8c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:14.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- 172.21.15.96:0/1379923182 shutdown_connections 2022-02-02T21:57:14.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- 172.21.15.96:0/1379923182 wait complete. 2022-02-02T21:57:14.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 Processor -- start 2022-02-02T21:57:14.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- start start 2022-02-02T21:57:14.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:14.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40f9880 0x7fd8c4107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41079d0 con 0x7fd8c40602b0 2022-02-02T21:57:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8cc305700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4107b10 con 0x7fd8c40f9880 2022-02-02T21:57:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.846+0000 7fd8ca0a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45714/0 (socket says 172.21.15.96:45714) 2022-02-02T21:57:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 -- 172.21.15.96:0/2063798291 learned_addr learned my addr 172.21.15.96:0/2063798291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8c98a0700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40f9880 0x7fd8c4107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:14.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 -- 172.21.15.96:0/2063798291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40f9880 msgr2=0x7fd8c4107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:14.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40f9880 0x7fd8c4107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:14.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 -- 172.21.15.96:0/2063798291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4005040 con 0x7fd8c40602b0 2022-02-02T21:57:14.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8ca0a1700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 rx=0x7fd8c00026d0 tx=0x7fd8c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:14.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c00079c0 con 0x7fd8c40602b0 2022-02-02T21:57:14.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c41084b0 con 0x7fd8c40602b0 2022-02-02T21:57:14.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8c000f040 con 0x7fd8c40602b0 2022-02-02T21:57:14.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c00148b0 con 0x7fd8c40602b0 2022-02-02T21:57:14.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.847+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c4108a70 con 0x7fd8c40602b0 2022-02-02T21:57:14.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.848+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c4045ad0 con 0x7fd8c40602b0 2022-02-02T21:57:14.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.849+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8c0007b20 con 0x7fd8c40602b0 2022-02-02T21:57:14.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.849+0000 7fd8baffd700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:14.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.849+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8c00819e0 con 0x7fd8c40602b0 2022-02-02T21:57:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.849+0000 7fd8c98a0700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.850+0000 7fd8c98a0700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 0x7fd8b0067290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fd8b4004630 tx=0x7fd8b4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:14.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:14.855+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8c0053510 con 0x7fd8c40602b0 2022-02-02T21:57:15.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.032+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c40ff030 con 0x7fd8b0064dd0 2022-02-02T21:57:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.033+0000 7fd8baffd700 1 -- 172.21.15.96:0/2063798291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd8b4019040 con 0x7fd8b0064dd0 2022-02-02T21:57:15.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 msgr2=0x7fd8b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 0x7fd8b0067290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fd8b4004630 tx=0x7fd8b4009b30).stop 2022-02-02T21:57:15.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 msgr2=0x7fd8c4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 rx=0x7fd8c00026d0 tx=0x7fd8c0009de0).stop 2022-02-02T21:57:15.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 shutdown_connections 2022-02-02T21:57:15.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8c40602b0 0x7fd8c4106f30 unknown :-1 s=CLOSED pgs=3300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 --2- 172.21.15.96:0/2063798291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c40f9880 0x7fd8c4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 >> 172.21.15.96:0/2063798291 conn(0x7fd8c40f0d40 msgr2=0x7fd8c40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 shutdown_connections 2022-02-02T21:57:15.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.035+0000 7fd8cc305700 1 -- 172.21.15.96:0/2063798291 wait complete. 2022-02-02T21:57:15.045 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:57:15.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/4013685866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f55e0 msgr2=0x7ff4e00f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/4013685866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00f5a00 secure :-1 s=READY pgs=3301 cs=0 l=1 rev1=1 rx=0x7ff4d80099e0 tx=0x7ff4d8004d10).stop 2022-02-02T21:57:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/4013685866 shutdown_connections 2022-02-02T21:57:15.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/4013685866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/4013685866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00f5a00 unknown :-1 s=CLOSED pgs=3301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/4013685866 >> 172.21.15.96:0/4013685866 conn(0x7ff4e00f0de0 msgr2=0x7ff4e00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/4013685866 shutdown_connections 2022-02-02T21:57:15.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/4013685866 wait complete. 2022-02-02T21:57:15.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.134+0000 7ff4e6cc8700 1 Processor -- start 2022-02-02T21:57:15.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e6cc8700 1 -- start start 2022-02-02T21:57:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e6cc8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e6cc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e6cc8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00f89e0 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e6cc8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00f8b20 con 0x7ff4e00f55e0 2022-02-02T21:57:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45726/0 (socket says 172.21.15.96:45726) 2022-02-02T21:57:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4dffff700 1 -- 172.21.15.96:0/3021406673 learned_addr learned my addr 172.21.15.96:0/3021406673 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4e4a64700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4dffff700 1 -- 172.21.15.96:0/3021406673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f55e0 msgr2=0x7ff4e00fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.135+0000 7ff4dffff700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4dffff700 1 -- 172.21.15.96:0/3021406673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8009640 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4dffff700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 rx=0x7ff4d000c510 tx=0x7ff4d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d000f650 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4d000fc60 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e00f8e00 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d0012c50 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.136+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e010f0e0 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.137+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e00f4a70 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.138+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4d0010070 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.138+0000 7ff4dd7fa700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 0x7ff4cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.138+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4d0081f80 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.138+0000 7ff4e4a64700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 0x7ff4cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.139+0000 7ff4e4a64700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 0x7ff4cc067290 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7ff4d800b730 tx=0x7ff4d8004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.143+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4d0050080 con 0x7ff4e00f5ef0 2022-02-02T21:57:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.313+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4e005fe50 con 0x7ff4cc064dd0 2022-02-02T21:57:15.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.322+0000 7ff4dd7fa700 1 -- 172.21.15.96:0/3021406673 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4e005fe50 con 0x7ff4cc064dd0 2022-02-02T21:57:15.323 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:57:15.324 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:57:15.324 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:57:15.324 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:57:15.325 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:57:15.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:57:15.325 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:57:15.326 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:57:15.326 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:57:15.327 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:57:15.327 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:57:15.327 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:57:15.328 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:57:15.328 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:57:15.328 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:57:15.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:57:15.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:57:15.329 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:57:15.330 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:57:15.330 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:57:15.330 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:57:15.331 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:57:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 msgr2=0x7ff4cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 0x7ff4cc067290 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7ff4d800b730 tx=0x7ff4d8004d10).stop 2022-02-02T21:57:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 msgr2=0x7ff4e00f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 rx=0x7ff4d000c510 tx=0x7ff4d0007e00).stop 2022-02-02T21:57:15.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 shutdown_connections 2022-02-02T21:57:15.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff4cc064dd0 0x7ff4cc067290 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4e00f55e0 0x7ff4e00fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 --2- 172.21.15.96:0/3021406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e00f5ef0 0x7ff4e00f8480 unknown :-1 s=CLOSED pgs=3302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 >> 172.21.15.96:0/3021406673 conn(0x7ff4e00f0de0 msgr2=0x7ff4e005f740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 shutdown_connections 2022-02-02T21:57:15.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.324+0000 7ff4e6cc8700 1 -- 172.21.15.96:0/3021406673 wait complete. 2022-02-02T21:57:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 -- 172.21.15.96:0/2933098308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 msgr2=0x7f2ab40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/2933098308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab40f59e0 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 rx=0x7f2aa4004660 tx=0x7f2aa4009b30).stop 2022-02-02T21:57:15.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 -- 172.21.15.96:0/2933098308 shutdown_connections 2022-02-02T21:57:15.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/2933098308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:57:15.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/2933098308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab40f59e0 unknown :-1 s=CLOSED pgs=3303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 -- 172.21.15.96:0/2933098308 >> 172.21.15.96:0/2933098308 conn(0x7f2ab40f0d40 msgr2=0x7f2ab40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 -- 172.21.15.96:0/2933098308 shutdown_connections 2022-02-02T21:57:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.421+0000 7f2ab9bde700 1 -- 172.21.15.96:0/2933098308 wait complete. 2022-02-02T21:57:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 Processor -- start 2022-02-02T21:57:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 -- start start 2022-02-02T21:57:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab41063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41069f0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab9bde700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41072a0 con 0x7f2ab40f6860 2022-02-02T21:57:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45734/0 (socket says 172.21.15.96:45734) 2022-02-02T21:57:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.422+0000 7f2ab37fe700 1 -- 172.21.15.96:0/3676421090 learned_addr learned my addr 172.21.15.96:0/3676421090 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab2ffd700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab41063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab37fe700 1 -- 172.21.15.96:0/3676421090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 msgr2=0x7f2ab41063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab37fe700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab41063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab37fe700 1 -- 172.21.15.96:0/3676421090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4005040 con 0x7f2ab40f55c0 2022-02-02T21:57:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab2ffd700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab41063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T21:57:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab37fe700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 secure :-1 s=READY pgs=3304 cs=0 l=1 rev1=1 rx=0x7f2aa4009d30 tx=0x7f2aa4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa401c070 con 0x7f2ab40f55c0 2022-02-02T21:57:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2aa40097d0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4107520 con 0x7f2ab40f55c0 2022-02-02T21:57:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa40218d0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.423+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab4107a80 con 0x7f2ab40f55c0 2022-02-02T21:57:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.424+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab40f49b0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.425+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2aa40125d0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.425+0000 7f2a9bfff700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 0x7f2a9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.425+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2aa4087cb0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.425+0000 7f2ab2ffd700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 0x7f2a9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.426+0000 7f2ab2ffd700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 0x7f2a9c067290 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f2aa800a7e0 tx=0x7f2aa8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.430+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2aa40597e0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.660+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ab40ff810 con 0x7f2ab40f55c0 2022-02-02T21:57:15.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.661+0000 7f2a9bfff700 1 -- 172.21.15.96:0/3676421090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2aa40593d0 con 0x7f2ab40f55c0 2022-02-02T21:57:15.661 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:57:15.662 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:57:15.662 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:57:15.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:15.663 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:57:15.663 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:57:15.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:15.664 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:57:15.664 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:57:15.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:15.665 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:57:15.665 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:57:15.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:15.666 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:57:15.666 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:57:15.667 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:57:15.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:57:15.667 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:57:15.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 msgr2=0x7f2a9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 0x7f2a9c067290 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f2aa800a7e0 tx=0x7f2aa8008040).stop 2022-02-02T21:57:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 msgr2=0x7f2ab4105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 secure :-1 s=READY pgs=3304 cs=0 l=1 rev1=1 rx=0x7f2aa4009d30 tx=0x7f2aa4009b30).stop 2022-02-02T21:57:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 shutdown_connections 2022-02-02T21:57:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a9c064dd0 0x7f2a9c067290 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40f55c0 0x7f2ab4105ec0 unknown :-1 s=CLOSED pgs=3304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 --2- 172.21.15.96:0/3676421090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab40f6860 0x7f2ab41063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 >> 172.21.15.96:0/3676421090 conn(0x7f2ab40f0d40 msgr2=0x7f2ab40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 shutdown_connections 2022-02-02T21:57:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.663+0000 7f2ab9bde700 1 -- 172.21.15.96:0/3676421090 wait complete. 2022-02-02T21:57:15.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 -- 172.21.15.96:0/3153043948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f6860 msgr2=0x7ffa800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 --2- 172.21.15.96:0/3153043948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f6860 0x7ffa800f6cc0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 rx=0x7ffa70004660 tx=0x7ffa70009b30).stop 2022-02-02T21:57:15.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 -- 172.21.15.96:0/3153043948 shutdown_connections 2022-02-02T21:57:15.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 --2- 172.21.15.96:0/3153043948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f6860 0x7ffa800f6cc0 unknown :-1 s=CLOSED pgs=3305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 --2- 172.21.15.96:0/3153043948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f55c0 0x7ffa800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:57:15.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 -- 172.21.15.96:0/3153043948 >> 172.21.15.96:0/3153043948 conn(0x7ffa800f0d20 msgr2=0x7ffa800f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 -- 172.21.15.96:0/3153043948 shutdown_connections 2022-02-02T21:57:15.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.760+0000 7ffa856c7700 1 -- 172.21.15.96:0/3153043948 wait complete. 2022-02-02T21:57:15.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 Processor -- start 2022-02-02T21:57:15.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 -- start start 2022-02-02T21:57:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f6860 0x7ffa80109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80109cd0 con 0x7ffa800f55c0 2022-02-02T21:57:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa856c7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8010a580 con 0x7ffa800f6860 2022-02-02T21:57:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45744/0 (socket says 172.21.15.96:45744) 2022-02-02T21:57:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa7effd700 1 -- 172.21.15.96:0/4105948039 learned_addr learned my addr 172.21.15.96:0/4105948039 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.761+0000 7ffa7e7fc700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f6860 0x7ffa80109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa7effd700 1 -- 172.21.15.96:0/4105948039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f6860 msgr2=0x7ffa80109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa7effd700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f6860 0x7ffa80109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa7effd700 1 -- 172.21.15.96:0/4105948039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70005040 con 0x7ffa800f55c0 2022-02-02T21:57:15.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa7effd700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 rx=0x7ffa740093f0 tx=0x7ffa74006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa74013640 con 0x7ffa800f55c0 2022-02-02T21:57:15.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8010a860 con 0x7ffa800f55c0 2022-02-02T21:57:15.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa74013c50 con 0x7ffa800f55c0 2022-02-02T21:57:15.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa74012c70 con 0x7ffa800f55c0 2022-02-02T21:57:15.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.762+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8010ae20 con 0x7ffa800f55c0 2022-02-02T21:57:15.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.763+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa800f49b0 con 0x7ffa800f55c0 2022-02-02T21:57:15.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.763+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa7401a060 con 0x7ffa800f55c0 2022-02-02T21:57:15.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.764+0000 7ffa677fe700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 0x7ffa68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.764+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa74081a50 con 0x7ffa800f55c0 2022-02-02T21:57:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.764+0000 7ffa7e7fc700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 0x7ffa68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.764+0000 7ffa7e7fc700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 0x7ffa68067290 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7ffa70004630 tx=0x7ffa70009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.768+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa74053520 con 0x7ffa800f55c0 2022-02-02T21:57:15.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.968+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa800fde20 con 0x7ffa800f55c0 2022-02-02T21:57:15.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.969+0000 7ffa677fe700 1 -- 172.21.15.96:0/4105948039 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ffa74018720 con 0x7ffa800f55c0 2022-02-02T21:57:15.969 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:57:15.970 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:57:15.970 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:57:15.970 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:57:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:15.971 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:57:15.972 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:57:15.972 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:57:15.972 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:57:15.973 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:57:15.973 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:57:15.973 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:57:15.973 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:57:15.974 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:57:15.974 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:57:15.975 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:57:15.975 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:57:15.975 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:57:15.976 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:57:15.976 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:57:15.976 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:57:15.977 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:57:15.977 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:57:15.977 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:57:15.977 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:57:15.978 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:57:15.978 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:57:15.978 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:57:15.979 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:57:15.979 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:57:15.980 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:57:15.980 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:57:15.980 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:15.981 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:15.981 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:57:15.981 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:15.981 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:15.982 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:15.982 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:15.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.970+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 msgr2=0x7ffa68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.970+0000 7ffa856c7700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 0x7ffa68067290 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7ffa70004630 tx=0x7ffa70009b30).stop 2022-02-02T21:57:15.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.970+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 msgr2=0x7ffa801091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:15.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.970+0000 7ffa856c7700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 rx=0x7ffa740093f0 tx=0x7ffa74006ec0).stop 2022-02-02T21:57:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.970+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 shutdown_connections 2022-02-02T21:57:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa68064dd0 0x7ffa68067290 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa800f55c0 0x7ffa801091a0 unknown :-1 s=CLOSED pgs=3306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 --2- 172.21.15.96:0/4105948039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa800f6860 0x7ffa80109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 >> 172.21.15.96:0/4105948039 conn(0x7ffa800f0d20 msgr2=0x7ffa8005ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:15.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 shutdown_connections 2022-02-02T21:57:15.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:15.971+0000 7ffa856c7700 1 -- 172.21.15.96:0/4105948039 wait complete. 2022-02-02T21:57:15.987 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:57:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:16 smithi096 ceph-mon[101353]: pgmap v6454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:16.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:16 smithi096 ceph-mon[101353]: from='client.40716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:16.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:16 smithi096 ceph-mon[101353]: from='client.40720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:16.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3676421090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:57:16.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4105948039' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:57:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:16 smithi159 ceph-mon[69013]: pgmap v6454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:16 smithi159 ceph-mon[69013]: from='client.40716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:16 smithi159 ceph-mon[69013]: from='client.40720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3676421090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:57:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4105948039' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:57:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:18 smithi096 ceph-mon[101353]: pgmap v6455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:18 smithi159 ceph-mon[69013]: pgmap v6455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:20 smithi096 ceph-mon[101353]: pgmap v6456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:20 smithi159 ceph-mon[69013]: pgmap v6456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:22 smithi096 ceph-mon[101353]: pgmap v6457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:22 smithi159 ceph-mon[69013]: pgmap v6457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:24 smithi096 ceph-mon[101353]: pgmap v6458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:24 smithi159 ceph-mon[69013]: pgmap v6458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:26 smithi096 ceph-mon[101353]: pgmap v6459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:26 smithi159 ceph-mon[69013]: pgmap v6459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:28 smithi096 ceph-mon[101353]: pgmap v6460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:57:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:57:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:28 smithi159 ceph-mon[69013]: pgmap v6460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:57:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:57:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:30 smithi096 ceph-mon[101353]: pgmap v6461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:30 smithi159 ceph-mon[69013]: pgmap v6461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:32 smithi096 ceph-mon[101353]: pgmap v6462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:32 smithi159 ceph-mon[69013]: pgmap v6462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:34 smithi159 ceph-mon[69013]: pgmap v6463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:34 smithi096 ceph-mon[101353]: pgmap v6463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:36 smithi159 ceph-mon[69013]: pgmap v6464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:36 smithi096 ceph-mon[101353]: pgmap v6464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:38.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:38 smithi159 ceph-mon[69013]: pgmap v6465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:38 smithi096 ceph-mon[101353]: pgmap v6465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:40 smithi159 ceph-mon[69013]: pgmap v6466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:40 smithi096 ceph-mon[101353]: pgmap v6466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:42 smithi159 ceph-mon[69013]: pgmap v6467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:42 smithi096 ceph-mon[101353]: pgmap v6467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:44 smithi159 ceph-mon[69013]: pgmap v6468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:44 smithi096 ceph-mon[101353]: pgmap v6468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:46.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 -- 172.21.15.96:0/3459969394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f6a10 msgr2=0x7f29000f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3459969394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f6a10 0x7f29000f6e30 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 rx=0x7f28f0004660 tx=0x7f28f0009b30).stop 2022-02-02T21:57:46.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 -- 172.21.15.96:0/3459969394 shutdown_connections 2022-02-02T21:57:46.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3459969394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f5710 0x7f29000f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3459969394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f6a10 0x7f29000f6e30 unknown :-1 s=CLOSED pgs=3307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 -- 172.21.15.96:0/3459969394 >> 172.21.15.96:0/3459969394 conn(0x7f29000f0320 msgr2=0x7f29000f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 -- 172.21.15.96:0/3459969394 shutdown_connections 2022-02-02T21:57:46.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.080+0000 7f28ff59e700 1 -- 172.21.15.96:0/3459969394 wait complete. 2022-02-02T21:57:46.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 Processor -- start 2022-02-02T21:57:46.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 -- start start 2022-02-02T21:57:46.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f6a10 0x7f290010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000f53a0 con 0x7f29000f5710 2022-02-02T21:57:46.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28ff59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000f54e0 con 0x7f29000f6a10 2022-02-02T21:57:46.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45766/0 (socket says 172.21.15.96:45766) 2022-02-02T21:57:46.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 -- 172.21.15.96:0/3684872729 learned_addr learned my addr 172.21.15.96:0/3684872729 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:46.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fdd9b700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f6a10 0x7f290010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 -- 172.21.15.96:0/3684872729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f6a10 msgr2=0x7f290010bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f6a10 0x7f290010bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.081+0000 7f28fe59c700 1 -- 172.21.15.96:0/3684872729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0005040 con 0x7f29000f5710 2022-02-02T21:57:46.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28fe59c700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 rx=0x7f28f0013a70 tx=0x7f28f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f0018070 con 0x7f29000f5710 2022-02-02T21:57:46.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290010c510 con 0x7f29000f5710 2022-02-02T21:57:46.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28f00097d0 con 0x7f29000f5710 2022-02-02T21:57:46.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f001de80 con 0x7f29000f5710 2022-02-02T21:57:46.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.082+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290010ca40 con 0x7f29000f5710 2022-02-02T21:57:46.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.083+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900059100 con 0x7f29000f5710 2022-02-02T21:57:46.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.083+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f28f0007ba0 con 0x7f29000f5710 2022-02-02T21:57:46.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.084+0000 7f28eeffd700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 0x7f28e80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.084+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f28f0083650 con 0x7f29000f5710 2022-02-02T21:57:46.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.084+0000 7f28fdd9b700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 0x7f28e80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.084+0000 7f28fdd9b700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 0x7f28e80672e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f29000f67e0 tx=0x7f28f400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.088+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f28f0051750 con 0x7f29000f5710 2022-02-02T21:57:46.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.265+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29000fdde0 con 0x7f28e8064e20 2022-02-02T21:57:46.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.266+0000 7f28eeffd700 1 -- 172.21.15.96:0/3684872729 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f28f400f040 con 0x7f28e8064e20 2022-02-02T21:57:46.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 msgr2=0x7f28e80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 0x7f28e80672e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f29000f67e0 tx=0x7f28f400b040).stop 2022-02-02T21:57:46.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 msgr2=0x7f2900109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 rx=0x7f28f0013a70 tx=0x7f28f0009b30).stop 2022-02-02T21:57:46.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 shutdown_connections 2022-02-02T21:57:46.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e8064e20 0x7f28e80672e0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29000f5710 0x7f2900109ac0 unknown :-1 s=CLOSED pgs=3308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 --2- 172.21.15.96:0/3684872729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29000f6a10 0x7f290010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 >> 172.21.15.96:0/3684872729 conn(0x7f29000f0320 msgr2=0x7f29000fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 shutdown_connections 2022-02-02T21:57:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.268+0000 7f28ff59e700 1 -- 172.21.15.96:0/3684872729 wait complete. 2022-02-02T21:57:46.278 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:57:46.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 -- 172.21.15.96:0/687340174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 msgr2=0x7fec440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 --2- 172.21.15.96:0/687340174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec440f6cc0 secure :-1 s=READY pgs=3309 cs=0 l=1 rev1=1 rx=0x7fec34004660 tx=0x7fec34009b30).stop 2022-02-02T21:57:46.366 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:46 smithi096 ceph-mon[101353]: pgmap v6469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:46.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 -- 172.21.15.96:0/687340174 shutdown_connections 2022-02-02T21:57:46.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 --2- 172.21.15.96:0/687340174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec440f6cc0 unknown :-1 s=CLOSED pgs=3309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 --2- 172.21.15.96:0/687340174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 0x7fec440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 -- 172.21.15.96:0/687340174 >> 172.21.15.96:0/687340174 conn(0x7fec440f0d40 msgr2=0x7fec440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 -- 172.21.15.96:0/687340174 shutdown_connections 2022-02-02T21:57:46.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 -- 172.21.15.96:0/687340174 wait complete. 2022-02-02T21:57:46.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.365+0000 7fec49825700 1 Processor -- start 2022-02-02T21:57:46.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 -- start start 2022-02-02T21:57:46.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 0x7fec44109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440603c0 con 0x7fec440f6860 2022-02-02T21:57:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44060500 con 0x7fec440f55c0 2022-02-02T21:57:46.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45778/0 (socket says 172.21.15.96:45778) 2022-02-02T21:57:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 -- 172.21.15.96:0/77316904 learned_addr learned my addr 172.21.15.96:0/77316904 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:46.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec42ffd700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 0x7fec44109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 -- 172.21.15.96:0/77316904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 msgr2=0x7fec44109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 0x7fec44109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 -- 172.21.15.96:0/77316904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34005040 con 0x7fec440f6860 2022-02-02T21:57:46.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec427fc700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 secure :-1 s=READY pgs=3310 cs=0 l=1 rev1=1 rx=0x7fec34009990 tx=0x7fec34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec34018070 con 0x7fec440f6860 2022-02-02T21:57:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4410c6c0 con 0x7fec440f6860 2022-02-02T21:57:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.366+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec34007ba0 con 0x7fec440f6860 2022-02-02T21:57:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.367+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3401c3c0 con 0x7fec440f6860 2022-02-02T21:57:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.367+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4410cbf0 con 0x7fec440f6860 2022-02-02T21:57:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.367+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec440f49b0 con 0x7fec440f6860 2022-02-02T21:57:46.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.368+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec3401d420 con 0x7fec440f6860 2022-02-02T21:57:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.368+0000 7fec3b7fe700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 0x7fec30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.368+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec34083720 con 0x7fec440f6860 2022-02-02T21:57:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.368+0000 7fec42ffd700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 0x7fec30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.369+0000 7fec42ffd700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 0x7fec30067290 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fec44060040 tx=0x7fec2c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.373+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec34051880 con 0x7fec440f6860 2022-02-02T21:57:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:46 smithi159 ceph-mon[69013]: pgmap v6469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:46.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.545+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec440fdf00 con 0x7fec30064dd0 2022-02-02T21:57:46.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.554+0000 7fec3b7fe700 1 -- 172.21.15.96:0/77316904 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fec440fdf00 con 0x7fec30064dd0 2022-02-02T21:57:46.555 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:57:46.555 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:57:46.556 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:57:46.556 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:57:46.557 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:57:46.557 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:57:46.557 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:57:46.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:57:46.558 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:57:46.558 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:57:46.559 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:57:46.559 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:57:46.559 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:57:46.560 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:57:46.560 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:57:46.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:57:46.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:57:46.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:57:46.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:57:46.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:57:46.562 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:57:46.562 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:57:46.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 msgr2=0x7fec30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 0x7fec30067290 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fec44060040 tx=0x7fec2c009c00).stop 2022-02-02T21:57:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 msgr2=0x7fec4410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 secure :-1 s=READY pgs=3310 cs=0 l=1 rev1=1 rx=0x7fec34009990 tx=0x7fec34009b30).stop 2022-02-02T21:57:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 shutdown_connections 2022-02-02T21:57:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec30064dd0 0x7fec30067290 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec440f55c0 0x7fec44109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 --2- 172.21.15.96:0/77316904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec440f6860 0x7fec4410c170 unknown :-1 s=CLOSED pgs=3310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 >> 172.21.15.96:0/77316904 conn(0x7fec440f0d40 msgr2=0x7fec440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 shutdown_connections 2022-02-02T21:57:46.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.556+0000 7fec49825700 1 -- 172.21.15.96:0/77316904 wait complete. 2022-02-02T21:57:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 -- 172.21.15.96:0/1512252004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 msgr2=0x7fcb480f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/1512252004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb480f8140 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 rx=0x7fcb3c004660 tx=0x7fcb3c009b30).stop 2022-02-02T21:57:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 -- 172.21.15.96:0/1512252004 shutdown_connections 2022-02-02T21:57:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/1512252004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 0x7fcb480f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/1512252004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb480f8140 unknown :-1 s=CLOSED pgs=3311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.654+0000 7fcb4eee3700 1 -- 172.21.15.96:0/1512252004 >> 172.21.15.96:0/1512252004 conn(0x7fcb480f04c0 msgr2=0x7fcb480f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.656+0000 7fcb4eee3700 1 -- 172.21.15.96:0/1512252004 shutdown_connections 2022-02-02T21:57:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.656+0000 7fcb4eee3700 1 -- 172.21.15.96:0/1512252004 wait complete. 2022-02-02T21:57:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.656+0000 7fcb4eee3700 1 Processor -- start 2022-02-02T21:57:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.656+0000 7fcb4eee3700 1 -- start start 2022-02-02T21:57:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4eee3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4eee3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 0x7fcb48107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4eee3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48107a10 con 0x7fcb480f7d20 2022-02-02T21:57:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4eee3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48107b50 con 0x7fcb480f86c0 2022-02-02T21:57:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45786/0 (socket says 172.21.15.96:45786) 2022-02-02T21:57:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 -- 172.21.15.96:0/808661182 learned_addr learned my addr 172.21.15.96:0/808661182 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:46.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb47fff700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 0x7fcb48107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 -- 172.21.15.96:0/808661182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 msgr2=0x7fcb48107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 0x7fcb48107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 -- 172.21.15.96:0/808661182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34005040 con 0x7fcb480f7d20 2022-02-02T21:57:46.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.657+0000 7fcb4cc7f700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 secure :-1 s=READY pgs=3312 cs=0 l=1 rev1=1 rx=0x7fcb3c002040 tx=0x7fcb3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c019070 con 0x7fcb480f7d20 2022-02-02T21:57:46.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb3c007e40 con 0x7fcb480f7d20 2022-02-02T21:57:46.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c005040 con 0x7fcb480f7d20 2022-02-02T21:57:46.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c014c60 con 0x7fcb480f7d20 2022-02-02T21:57:46.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb48108860 con 0x7fcb480f7d20 2022-02-02T21:57:46.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.658+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb48045ad0 con 0x7fcb480f7d20 2022-02-02T21:57:46.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.659+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb3c025070 con 0x7fcb480f7d20 2022-02-02T21:57:46.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.659+0000 7fcb457fa700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 0x7fcb38067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:46.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.659+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb3c082980 con 0x7fcb480f7d20 2022-02-02T21:57:46.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.659+0000 7fcb47fff700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 0x7fcb38067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:46.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.660+0000 7fcb47fff700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 0x7fcb38067290 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fcb34009da0 tx=0x7fcb34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:46.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.664+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb3c054450 con 0x7fcb480f7d20 2022-02-02T21:57:46.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.898+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb480feea0 con 0x7fcb480f7d20 2022-02-02T21:57:46.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.898+0000 7fcb457fa700 1 -- 172.21.15.96:0/808661182 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcb3c004490 con 0x7fcb480f7d20 2022-02-02T21:57:46.900 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:57:46.900 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:57:46.901 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:57:46.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:46.901 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:57:46.902 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:57:46.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:46.902 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:57:46.903 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:57:46.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:46.903 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:57:46.904 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:57:46.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:57:46.904 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:57:46.905 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:57:46.905 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:57:46.905 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:57:46.906 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:57:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 msgr2=0x7fcb38067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 0x7fcb38067290 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fcb34009da0 tx=0x7fcb34009b30).stop 2022-02-02T21:57:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 msgr2=0x7fcb48106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 secure :-1 s=READY pgs=3312 cs=0 l=1 rev1=1 rx=0x7fcb3c002040 tx=0x7fcb3c00b040).stop 2022-02-02T21:57:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 shutdown_connections 2022-02-02T21:57:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb38064dd0 0x7fcb38067290 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb480f7d20 0x7fcb48106f70 unknown :-1 s=CLOSED pgs=3312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.900+0000 7fcb4eee3700 1 --2- 172.21.15.96:0/808661182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb480f86c0 0x7fcb48107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.901+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 >> 172.21.15.96:0/808661182 conn(0x7fcb480f04c0 msgr2=0x7fcb480fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.901+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 shutdown_connections 2022-02-02T21:57:46.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.901+0000 7fcb4eee3700 1 -- 172.21.15.96:0/808661182 wait complete. 2022-02-02T21:57:46.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/3936125160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 msgr2=0x7fdd580f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:46.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/3936125160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd580f6b00 secure :-1 s=READY pgs=3313 cs=0 l=1 rev1=1 rx=0x7fdd4c004660 tx=0x7fdd4c009b30).stop 2022-02-02T21:57:47.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/3936125160 shutdown_connections 2022-02-02T21:57:47.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/3936125160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd580f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/3936125160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd580f6b00 unknown :-1 s=CLOSED pgs=3313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.997+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/3936125160 >> 172.21.15.96:0/3936125160 conn(0x7fdd580f1e40 msgr2=0x7fdd580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:47.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.998+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/3936125160 shutdown_connections 2022-02-02T21:57:47.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.998+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/3936125160 wait complete. 2022-02-02T21:57:47.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.998+0000 7fdd5e8f2700 1 Processor -- start 2022-02-02T21:57:47.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd5e8f2700 1 -- start start 2022-02-02T21:57:47.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd5e8f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:47.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd5e8f2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd581074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:47.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd5e8f2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58107a50 con 0x7fdd580f66e0 2022-02-02T21:57:47.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd5e8f2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58107b90 con 0x7fdd580f7980 2022-02-02T21:57:47.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:47.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45802/0 (socket says 172.21.15.96:45802) 2022-02-02T21:57:47.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 -- 172.21.15.96:0/1591914497 learned_addr learned my addr 172.21.15.96:0/1591914497 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:57:47.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd577fe700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd581074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 -- 172.21.15.96:0/1591914497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 msgr2=0x7fdd581074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd581074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 -- 172.21.15.96:0/1591914497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c005040 con 0x7fdd580f66e0 2022-02-02T21:57:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd577fe700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd581074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:57:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:46.999+0000 7fdd57fff700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 rx=0x7fdd4c004f60 tx=0x7fdd4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:47.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.000+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd4c018070 con 0x7fdd580f66e0 2022-02-02T21:57:47.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.000+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd581084d0 con 0x7fdd580f66e0 2022-02-02T21:57:47.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.000+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd4c007ba0 con 0x7fdd580f66e0 2022-02-02T21:57:47.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.000+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd4c01c620 con 0x7fdd580f66e0 2022-02-02T21:57:47.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.000+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd58108a30 con 0x7fdd580f66e0 2022-02-02T21:57:47.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.001+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd58045ad0 con 0x7fdd580f66e0 2022-02-02T21:57:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.001+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdd4c01c890 con 0x7fdd580f66e0 2022-02-02T21:57:47.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.002+0000 7fdd54ff9700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 0x7fdd40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:57:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.002+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdd4c0838a0 con 0x7fdd580f66e0 2022-02-02T21:57:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.002+0000 7fdd577fe700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 0x7fdd40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:57:47.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.002+0000 7fdd577fe700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 0x7fdd40067290 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fdd48004a90 tx=0x7fdd48009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:57:47.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.006+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdd4c0553d0 con 0x7fdd580f66e0 2022-02-02T21:57:47.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.221+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd58027a00 con 0x7fdd580f66e0 2022-02-02T21:57:47.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.222+0000 7fdd54ff9700 1 -- 172.21.15.96:0/1591914497 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdd4c054fc0 con 0x7fdd580f66e0 2022-02-02T21:57:47.223 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:57:47.224 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:57:47.224 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:57:47.224 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:57:47.225 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:47.225 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:57:47.225 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:57:47.226 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:57:47.226 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:57:47.226 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:57:47.227 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:57:47.227 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:57:47.227 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:57:47.228 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:57:47.228 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:57:47.229 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:57:47.229 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:57:47.229 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:57:47.230 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:57:47.230 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:57:47.230 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:57:47.231 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:57:47.231 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:57:47.231 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:57:47.232 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:57:47.232 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:57:47.232 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:57:47.233 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:57:47.233 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:57:47.233 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:57:47.234 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:57:47.234 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:57:47.234 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:47.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:47.235 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:57:47.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:57:47.236 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:47.236 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:47.236 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:57:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 msgr2=0x7fdd40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:47.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 0x7fdd40067290 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fdd48004a90 tx=0x7fdd48009040).stop 2022-02-02T21:57:47.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 msgr2=0x7fdd58106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:57:47.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 rx=0x7fdd4c004f60 tx=0x7fdd4c009b30).stop 2022-02-02T21:57:47.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 shutdown_connections 2022-02-02T21:57:47.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd40064dd0 0x7fdd40067290 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580f66e0 0x7fdd58106fb0 unknown :-1 s=CLOSED pgs=3314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 --2- 172.21.15.96:0/1591914497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd580f7980 0x7fdd581074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:57:47.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.223+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 >> 172.21.15.96:0/1591914497 conn(0x7fdd580f1e40 msgr2=0x7fdd580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:57:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.224+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 shutdown_connections 2022-02-02T21:57:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:57:47.224+0000 7fdd5e8f2700 1 -- 172.21.15.96:0/1591914497 wait complete. 2022-02-02T21:57:47.241 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:57:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:47 smithi096 ceph-mon[101353]: from='client.40732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:47 smithi096 ceph-mon[101353]: from='client.40736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/808661182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:57:47.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:47 smithi159 ceph-mon[69013]: from='client.40732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:47 smithi159 ceph-mon[69013]: from='client.40736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:57:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/808661182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:57:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:48 smithi159 ceph-mon[69013]: pgmap v6470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1591914497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:57:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:48 smithi096 ceph-mon[101353]: pgmap v6470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1591914497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:57:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:50 smithi159 ceph-mon[69013]: pgmap v6471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:50 smithi096 ceph-mon[101353]: pgmap v6471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:52 smithi159 ceph-mon[69013]: pgmap v6472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:52 smithi096 ceph-mon[101353]: pgmap v6472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:54 smithi159 ceph-mon[69013]: pgmap v6473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:54 smithi096 ceph-mon[101353]: pgmap v6473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:56 smithi159 ceph-mon[69013]: pgmap v6474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:56 smithi096 ceph-mon[101353]: pgmap v6474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:57:58 smithi159 ceph-mon[69013]: pgmap v6475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:57:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:57:58 smithi096 ceph-mon[101353]: pgmap v6475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:00 smithi159 ceph-mon[69013]: pgmap v6476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:00 smithi096 ceph-mon[101353]: pgmap v6476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:02 smithi159 ceph-mon[69013]: pgmap v6477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:02 smithi096 ceph-mon[101353]: pgmap v6477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:04 smithi159 ceph-mon[69013]: pgmap v6478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:04 smithi096 ceph-mon[101353]: pgmap v6478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:06 smithi159 ceph-mon[69013]: pgmap v6479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:06 smithi096 ceph-mon[101353]: pgmap v6479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:08 smithi159 ceph-mon[69013]: pgmap v6480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:08 smithi096 ceph-mon[101353]: pgmap v6480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:10 smithi159 ceph-mon[69013]: pgmap v6481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:10 smithi096 ceph-mon[101353]: pgmap v6481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:12 smithi159 ceph-mon[69013]: pgmap v6482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:12 smithi096 ceph-mon[101353]: pgmap v6482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:14 smithi159 ceph-mon[69013]: pgmap v6483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:14 smithi096 ceph-mon[101353]: pgmap v6483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:16 smithi159 ceph-mon[69013]: pgmap v6484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:16 smithi096 ceph-mon[101353]: pgmap v6484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.334+0000 7f1260875700 1 -- 172.21.15.96:0/4076841178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 msgr2=0x7f125c0f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.334+0000 7f1260875700 1 --2- 172.21.15.96:0/4076841178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c0f7010 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 rx=0x7f124c004660 tx=0x7f124c009b30).stop 2022-02-02T21:58:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 -- 172.21.15.96:0/4076841178 shutdown_connections 2022-02-02T21:58:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 --2- 172.21.15.96:0/4076841178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c0f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 --2- 172.21.15.96:0/4076841178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c0f7010 unknown :-1 s=CLOSED pgs=3315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 -- 172.21.15.96:0/4076841178 >> 172.21.15.96:0/4076841178 conn(0x7f125c0f04c0 msgr2=0x7f125c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 -- 172.21.15.96:0/4076841178 shutdown_connections 2022-02-02T21:58:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.335+0000 7f1260875700 1 -- 172.21.15.96:0/4076841178 wait complete. 2022-02-02T21:58:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 Processor -- start 2022-02-02T21:58:17.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 -- start start 2022-02-02T21:58:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c107ad0 con 0x7f125c0f6bf0 2022-02-02T21:58:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1260875700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c107c10 con 0x7f125c0f7590 2022-02-02T21:58:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f125a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f125a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45820/0 (socket says 172.21.15.96:45820) 2022-02-02T21:58:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f125a59c700 1 -- 172.21.15.96:0/3808358127 learned_addr learned my addr 172.21.15.96:0/3808358127 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f1259d9b700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.336+0000 7f125a59c700 1 -- 172.21.15.96:0/3808358127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 msgr2=0x7f125c107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f125a59c700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f125a59c700 1 -- 172.21.15.96:0/3808358127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c005040 con 0x7f125c0f6bf0 2022-02-02T21:58:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f1259d9b700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:58:17.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f125a59c700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 rx=0x7f124c009d80 tx=0x7f124c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c018070 con 0x7f125c0f6bf0 2022-02-02T21:58:17.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f124c007ba0 con 0x7f125c0f6bf0 2022-02-02T21:58:17.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c108550 con 0x7f125c0f6bf0 2022-02-02T21:58:17.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c01c620 con 0x7f125c0f6bf0 2022-02-02T21:58:17.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.337+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c108ab0 con 0x7f125c0f6bf0 2022-02-02T21:58:17.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.338+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c045ad0 con 0x7f125c0f6bf0 2022-02-02T21:58:17.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.338+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f124c01d420 con 0x7f125c0f6bf0 2022-02-02T21:58:17.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.339+0000 7f124affd700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 0x7f1244067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.339+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f124c0837c0 con 0x7f125c0f6bf0 2022-02-02T21:58:17.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.339+0000 7f1259d9b700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 0x7f1244067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.339+0000 7f1259d9b700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 0x7f1244067290 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f1250004a90 tx=0x7f1250009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.343+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f124c055350 con 0x7f125c0f6bf0 2022-02-02T21:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.526+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f125c0f4f90 con 0x7f1244064dd0 2022-02-02T21:58:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.527+0000 7f124affd700 1 -- 172.21.15.96:0/3808358127 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f125c0f4f90 con 0x7f1244064dd0 2022-02-02T21:58:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 msgr2=0x7f1244067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 0x7f1244067290 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f1250004a90 tx=0x7f1250009040).stop 2022-02-02T21:58:17.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 msgr2=0x7f125c107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 rx=0x7f124c009d80 tx=0x7f124c009b30).stop 2022-02-02T21:58:17.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 shutdown_connections 2022-02-02T21:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1244064dd0 0x7f1244067290 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f125c0f6bf0 0x7f125c107030 unknown :-1 s=CLOSED pgs=3316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 --2- 172.21.15.96:0/3808358127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125c0f7590 0x7f125c107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 >> 172.21.15.96:0/3808358127 conn(0x7f125c0f04c0 msgr2=0x7f125c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:17.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 shutdown_connections 2022-02-02T21:58:17.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.529+0000 7f1260875700 1 -- 172.21.15.96:0/3808358127 wait complete. 2022-02-02T21:58:17.538 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:58:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 -- 172.21.15.96:0/744887232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 msgr2=0x7f96e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 --2- 172.21.15.96:0/744887232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e40f6cc0 secure :-1 s=READY pgs=3317 cs=0 l=1 rev1=1 rx=0x7f96d8004660 tx=0x7f96d8009b30).stop 2022-02-02T21:58:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 -- 172.21.15.96:0/744887232 shutdown_connections 2022-02-02T21:58:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 --2- 172.21.15.96:0/744887232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e40f6cc0 unknown :-1 s=CLOSED pgs=3317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 --2- 172.21.15.96:0/744887232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 -- 172.21.15.96:0/744887232 >> 172.21.15.96:0/744887232 conn(0x7f96e40f0d40 msgr2=0x7f96e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 -- 172.21.15.96:0/744887232 shutdown_connections 2022-02-02T21:58:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.626+0000 7f96e8e06700 1 -- 172.21.15.96:0/744887232 wait complete. 2022-02-02T21:58:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 Processor -- start 2022-02-02T21:58:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 -- start start 2022-02-02T21:58:17.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40603c0 con 0x7f96e40f6860 2022-02-02T21:58:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e8e06700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4060500 con 0x7f96e40f55c0 2022-02-02T21:58:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:49934/0 (socket says 172.21.15.96:49934) 2022-02-02T21:58:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e259c700 1 -- 172.21.15.96:0/2959819256 learned_addr learned my addr 172.21.15.96:0/2959819256 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.627+0000 7f96e1d9b700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e1d9b700 1 -- 172.21.15.96:0/2959819256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 msgr2=0x7f96e4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e1d9b700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e1d9b700 1 -- 172.21.15.96:0/2959819256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8005040 con 0x7f96e40f6860 2022-02-02T21:58:17.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e1d9b700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c170 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 rx=0x7f96d8000c00 tx=0x7f96d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d8018070 con 0x7f96e40f6860 2022-02-02T21:58:17.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f96d80097d0 con 0x7f96e40f6860 2022-02-02T21:58:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e8e06700 1 -- 172.21.15.96:0/2959819256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e410c6c0 con 0x7f96e40f6860 2022-02-02T21:58:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d801ddb0 con 0x7f96e40f6860 2022-02-02T21:58:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.628+0000 7f96e8e06700 1 -- 172.21.15.96:0/2959819256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e410cbf0 con 0x7f96e40f6860 2022-02-02T21:58:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.629+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc004fa0 con 0x7f96e40f6860 2022-02-02T21:58:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.629+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f96d8007ca0 con 0x7f96e40f6860 2022-02-02T21:58:17.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.630+0000 7f96d2ffd700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.630+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f96d8083640 con 0x7f96e40f6860 2022-02-02T21:58:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.630+0000 7f96e259c700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.630+0000 7f96e259c700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f96e4060040 tx=0x7f96d400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.634+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f96d80518f0 con 0x7f96e40f6860 2022-02-02T21:58:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.806+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f96bc000bc0 con 0x7f96cc064dd0 2022-02-02T21:58:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.816+0000 7f96d2ffd700 1 -- 172.21.15.96:0/2959819256 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f96bc000bc0 con 0x7f96cc064dd0 2022-02-02T21:58:17.816 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:58:17.817 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:58:17.817 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:58:17.818 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:58:17.818 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:58:17.819 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:58:17.819 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:58:17.819 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:58:17.820 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:58:17.820 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:58:17.821 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:58:17.822 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:58:17.823 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:58:17.823 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:58:17.824 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:58:17.824 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:58:17.824 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:58:17.825 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:58:17.825 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:58:17.825 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:58:17.826 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:58:17.826 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:58:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 msgr2=0x7f96cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f96e4060040 tx=0x7f96d400b040).stop 2022-02-02T21:58:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 msgr2=0x7f96e410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c170 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 rx=0x7f96d8000c00 tx=0x7f96d8009b30).stop 2022-02-02T21:58:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 shutdown_connections 2022-02-02T21:58:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96cc064dd0 0x7f96cc067290 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96e40f55c0 0x7f96e4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 --2- 172.21.15.96:0/2959819256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40f6860 0x7f96e410c170 unknown :-1 s=CLOSED pgs=3318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 >> 172.21.15.96:0/2959819256 conn(0x7f96e40f0d40 msgr2=0x7f96e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 shutdown_connections 2022-02-02T21:58:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.818+0000 7f96d0ff9700 1 -- 172.21.15.96:0/2959819256 wait complete. 2022-02-02T21:58:17.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 -- 172.21.15.96:0/2096596502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f7980 msgr2=0x7fed740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 --2- 172.21.15.96:0/2096596502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f7980 0x7fed740f7de0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 rx=0x7fed68004660 tx=0x7fed68009b30).stop 2022-02-02T21:58:17.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 -- 172.21.15.96:0/2096596502 shutdown_connections 2022-02-02T21:58:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 --2- 172.21.15.96:0/2096596502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f7980 0x7fed740f7de0 unknown :-1 s=CLOSED pgs=3319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 --2- 172.21.15.96:0/2096596502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f66e0 0x7fed740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 -- 172.21.15.96:0/2096596502 >> 172.21.15.96:0/2096596502 conn(0x7fed740f1e40 msgr2=0x7fed740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 -- 172.21.15.96:0/2096596502 shutdown_connections 2022-02-02T21:58:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.915+0000 7fed7a10c700 1 -- 172.21.15.96:0/2096596502 wait complete. 2022-02-02T21:58:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 Processor -- start 2022-02-02T21:58:17.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 -- start start 2022-02-02T21:58:17.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f7980 0x7fed74107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74107a00 con 0x7fed740f66e0 2022-02-02T21:58:17.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.916+0000 7fed7a10c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74107b40 con 0x7fed740f7980 2022-02-02T21:58:17.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45840/0 (socket says 172.21.15.96:45840) 2022-02-02T21:58:17.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 -- 172.21.15.96:0/304844113 learned_addr learned my addr 172.21.15.96:0/304844113 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:17.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed72ffd700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f7980 0x7fed74107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 -- 172.21.15.96:0/304844113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f7980 msgr2=0x7fed74107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:17.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f7980 0x7fed74107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:17.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 -- 172.21.15.96:0/304844113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed68005040 con 0x7fed740f66e0 2022-02-02T21:58:17.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed737fe700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 rx=0x7fed6400c790 tx=0x7fed64007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6400e680 con 0x7fed740f66e0 2022-02-02T21:58:17.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed741084e0 con 0x7fed740f66e0 2022-02-02T21:58:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed6400ec90 con 0x7fed740f66e0 2022-02-02T21:58:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed64012d00 con 0x7fed740f66e0 2022-02-02T21:58:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.917+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74108aa0 con 0x7fed740f66e0 2022-02-02T21:58:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.918+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74045ad0 con 0x7fed740f66e0 2022-02-02T21:58:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.919+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed64010070 con 0x7fed740f66e0 2022-02-02T21:58:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.919+0000 7fed5bfff700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 0x7fed5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.919+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fed64081b50 con 0x7fed740f66e0 2022-02-02T21:58:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.919+0000 7fed72ffd700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 0x7fed5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.920+0000 7fed72ffd700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 0x7fed5c067290 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fed68004e30 tx=0x7fed68009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:17.924+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed64053680 con 0x7fed740f66e0 2022-02-02T21:58:18.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.155+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed740feea0 con 0x7fed740f66e0 2022-02-02T21:58:18.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.156+0000 7fed5bfff700 1 -- 172.21.15.96:0/304844113 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fed64053270 con 0x7fed740f66e0 2022-02-02T21:58:18.157 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:58:18.157 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:58:18.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:58:18.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:18.158 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:58:18.159 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:58:18.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:18.159 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:58:18.160 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:58:18.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:18.161 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:58:18.161 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:58:18.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:18.162 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:58:18.162 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:58:18.163 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:58:18.163 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:58:18.163 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:58:18.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 msgr2=0x7fed5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 0x7fed5c067290 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fed68004e30 tx=0x7fed68009b30).stop 2022-02-02T21:58:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 msgr2=0x7fed74106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 rx=0x7fed6400c790 tx=0x7fed64007d90).stop 2022-02-02T21:58:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 shutdown_connections 2022-02-02T21:58:18.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fed5c064dd0 0x7fed5c067290 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed740f66e0 0x7fed74106f60 unknown :-1 s=CLOSED pgs=3320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 --2- 172.21.15.96:0/304844113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed740f7980 0x7fed74107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 >> 172.21.15.96:0/304844113 conn(0x7fed740f1e40 msgr2=0x7fed740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 shutdown_connections 2022-02-02T21:58:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.158+0000 7fed7a10c700 1 -- 172.21.15.96:0/304844113 wait complete. 2022-02-02T21:58:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 -- 172.21.15.96:0/3314370846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f6860 msgr2=0x7f2f180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 --2- 172.21.15.96:0/3314370846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f6860 0x7f2f180f6cc0 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 rx=0x7f2f08004660 tx=0x7f2f08009b30).stop 2022-02-02T21:58:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 -- 172.21.15.96:0/3314370846 shutdown_connections 2022-02-02T21:58:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 --2- 172.21.15.96:0/3314370846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f6860 0x7f2f180f6cc0 unknown :-1 s=CLOSED pgs=3321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 --2- 172.21.15.96:0/3314370846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f55c0 0x7f2f180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:58:18.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 -- 172.21.15.96:0/3314370846 >> 172.21.15.96:0/3314370846 conn(0x7f2f180f0d40 msgr2=0x7f2f180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:18.258 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:18 smithi096 ceph-mon[101353]: pgmap v6485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:18.259 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:18 smithi096 ceph-mon[101353]: from='client.40748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 -- 172.21.15.96:0/3314370846 shutdown_connections 2022-02-02T21:58:18.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.256+0000 7f2f1d360700 1 -- 172.21.15.96:0/3314370846 wait complete. 2022-02-02T21:58:18.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 Processor -- start 2022-02-02T21:58:18.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 -- start start 2022-02-02T21:58:18.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:18.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f6860 0x7f2f1810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:18.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18060470 con 0x7f2f180f55c0 2022-02-02T21:58:18.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f1d360700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180605b0 con 0x7f2f180f6860 2022-02-02T21:58:18.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f16ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:18.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f16ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45850/0 (socket says 172.21.15.96:45850) 2022-02-02T21:58:18.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f16ffd700 1 -- 172.21.15.96:0/1452595734 learned_addr learned my addr 172.21.15.96:0/1452595734 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:18.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.257+0000 7f2f167fc700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f6860 0x7f2f1810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:18.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f16ffd700 1 -- 172.21.15.96:0/1452595734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f6860 msgr2=0x7f2f1810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f16ffd700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f6860 0x7f2f1810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f16ffd700 1 -- 172.21.15.96:0/1452595734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08005040 con 0x7f2f180f55c0 2022-02-02T21:58:18.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f16ffd700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 rx=0x7f2f0c0093f0 tx=0x7f2f0c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:18.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0c013640 con 0x7f2f180f55c0 2022-02-02T21:58:18.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f0c013c50 con 0x7f2f180f55c0 2022-02-02T21:58:18.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1810c810 con 0x7f2f180f55c0 2022-02-02T21:58:18.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0c012c70 con 0x7f2f180f55c0 2022-02-02T21:58:18.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.258+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1810cda0 con 0x7f2f180f55c0 2022-02-02T21:58:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.259+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f180f49b0 con 0x7f2f180f55c0 2022-02-02T21:58:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.259+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f0c01a060 con 0x7f2f180f55c0 2022-02-02T21:58:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.260+0000 7f2eff7fe700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 0x7f2f00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:18.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.260+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2f0c081a30 con 0x7f2f180f55c0 2022-02-02T21:58:18.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.260+0000 7f2f167fc700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 0x7f2f00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:18.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.260+0000 7f2f167fc700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 0x7f2f00067290 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f2f08004630 tx=0x7f2f08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:18.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.264+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f0c04fad0 con 0x7f2f180f55c0 2022-02-02T21:58:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.467+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f18045ad0 con 0x7f2f180f55c0 2022-02-02T21:58:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.467+0000 7f2eff7fe700 1 -- 172.21.15.96:0/1452595734 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2f0c018720 con 0x7f2f180f55c0 2022-02-02T21:58:18.468 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:58:18.468 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:58:18.469 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:58:18.469 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:58:18.469 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:18.470 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:58:18.470 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:58:18.470 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:58:18.471 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:58:18.471 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:58:18.471 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:58:18.472 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:58:18.472 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:58:18.472 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:58:18.473 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:58:18.473 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:58:18.473 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:58:18.474 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:58:18.474 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:58:18.474 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:58:18.475 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:58:18.475 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:58:18.475 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:58:18.476 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:58:18.476 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:58:18.476 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:58:18.477 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:58:18.477 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:58:18.477 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:58:18.478 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:58:18.478 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:58:18.478 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:58:18.479 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:18.479 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:18.479 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:58:18.480 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:18.480 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:18.480 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:18.481 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:18.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 msgr2=0x7f2f00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 0x7f2f00067290 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f2f08004630 tx=0x7f2f08009b30).stop 2022-02-02T21:58:18.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 msgr2=0x7f2f18109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:18.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 rx=0x7f2f0c0093f0 tx=0x7f2f0c006ec0).stop 2022-02-02T21:58:18.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 shutdown_connections 2022-02-02T21:58:18.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f00064dd0 0x7f2f00067290 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180f55c0 0x7f2f18109cb0 unknown :-1 s=CLOSED pgs=3322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 --2- 172.21.15.96:0/1452595734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f180f6860 0x7f2f1810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 >> 172.21.15.96:0/1452595734 conn(0x7f2f180f0d40 msgr2=0x7f2f180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 shutdown_connections 2022-02-02T21:58:18.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:18.469+0000 7f2f1d360700 1 -- 172.21.15.96:0/1452595734 wait complete. 2022-02-02T21:58:18.486 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:58:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:18 smithi159 ceph-mon[69013]: pgmap v6485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:18 smithi159 ceph-mon[69013]: from='client.40748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:19.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:19 smithi159 ceph-mon[69013]: from='client.40752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/304844113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:58:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1452595734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:58:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:19 smithi096 ceph-mon[101353]: from='client.40752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/304844113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:58:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1452595734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:58:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:20 smithi159 ceph-mon[69013]: pgmap v6486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:20 smithi096 ceph-mon[101353]: pgmap v6486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:22 smithi159 ceph-mon[69013]: pgmap v6487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:22 smithi096 ceph-mon[101353]: pgmap v6487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:24 smithi159 ceph-mon[69013]: pgmap v6488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:24 smithi096 ceph-mon[101353]: pgmap v6488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:26 smithi159 ceph-mon[69013]: pgmap v6489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:26.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:26 smithi096 ceph-mon[101353]: pgmap v6489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:28 smithi159 ceph-mon[69013]: pgmap v6490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:58:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:58:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:28 smithi096 ceph-mon[101353]: pgmap v6490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:58:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:58:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:30 smithi159 ceph-mon[69013]: pgmap v6491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:30 smithi096 ceph-mon[101353]: pgmap v6491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:32 smithi159 ceph-mon[69013]: pgmap v6492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:32 smithi096 ceph-mon[101353]: pgmap v6492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:34 smithi159 ceph-mon[69013]: pgmap v6493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:34 smithi096 ceph-mon[101353]: pgmap v6493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:36 smithi159 ceph-mon[69013]: pgmap v6494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:36 smithi096 ceph-mon[101353]: pgmap v6494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:38 smithi159 ceph-mon[69013]: pgmap v6495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:38 smithi096 ceph-mon[101353]: pgmap v6495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:40.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:40 smithi159 ceph-mon[69013]: pgmap v6496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:40 smithi096 ceph-mon[101353]: pgmap v6496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:42 smithi159 ceph-mon[69013]: pgmap v6497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:42 smithi096 ceph-mon[101353]: pgmap v6497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:44 smithi159 ceph-mon[69013]: pgmap v6498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:44 smithi096 ceph-mon[101353]: pgmap v6498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:46 smithi159 ceph-mon[69013]: pgmap v6499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:46 smithi096 ceph-mon[101353]: pgmap v6499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:48 smithi159 ceph-mon[69013]: pgmap v6500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:48 smithi096 ceph-mon[101353]: pgmap v6500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:48.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 -- 172.21.15.96:0/1056938854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f5ed0 msgr2=0x7f92300f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 --2- 172.21.15.96:0/1056938854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f5ed0 0x7f92300f6900 secure :-1 s=READY pgs=3323 cs=0 l=1 rev1=1 rx=0x7f9218004660 tx=0x7f9218009b30).stop 2022-02-02T21:58:48.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 -- 172.21.15.96:0/1056938854 shutdown_connections 2022-02-02T21:58:48.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 --2- 172.21.15.96:0/1056938854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f5ed0 0x7f92300f6900 unknown :-1 s=CLOSED pgs=3323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 --2- 172.21.15.96:0/1056938854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f55c0 0x7f92300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 -- 172.21.15.96:0/1056938854 >> 172.21.15.96:0/1056938854 conn(0x7f92300f0de0 msgr2=0x7f92300f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:48.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 -- 172.21.15.96:0/1056938854 shutdown_connections 2022-02-02T21:58:48.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.580+0000 7f923557c700 1 -- 172.21.15.96:0/1056938854 wait complete. 2022-02-02T21:58:48.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 Processor -- start 2022-02-02T21:58:48.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 -- start start 2022-02-02T21:58:48.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f5ed0 0x7f9230106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9230106910 con 0x7f92300f55c0 2022-02-02T21:58:48.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f923557c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9230106a50 con 0x7f92300f5ed0 2022-02-02T21:58:48.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f922effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f922effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45868/0 (socket says 172.21.15.96:45868) 2022-02-02T21:58:48.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f922effd700 1 -- 172.21.15.96:0/3830009720 learned_addr learned my addr 172.21.15.96:0/3830009720 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:48.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.581+0000 7f92267fc700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f5ed0 0x7f9230106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f922effd700 1 -- 172.21.15.96:0/3830009720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f5ed0 msgr2=0x7f9230106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f922effd700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f5ed0 0x7f9230106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f922effd700 1 -- 172.21.15.96:0/3830009720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218005040 con 0x7f92300f55c0 2022-02-02T21:58:48.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f922effd700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 rx=0x7f922000c530 tx=0x7f9220007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:48.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922000f650 con 0x7f92300f55c0 2022-02-02T21:58:48.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92301073f0 con 0x7f92300f55c0 2022-02-02T21:58:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f922000fc60 con 0x7f92300f55c0 2022-02-02T21:58:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9220012cd0 con 0x7f92300f55c0 2022-02-02T21:58:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.582+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92301079b0 con 0x7f92300f55c0 2022-02-02T21:58:48.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.583+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9230045ad0 con 0x7f92300f55c0 2022-02-02T21:58:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.584+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9220010070 con 0x7f92300f55c0 2022-02-02T21:58:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.584+0000 7f9227fff700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.584+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f92200817b0 con 0x7f92300f55c0 2022-02-02T21:58:48.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.584+0000 7f92267fc700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.584+0000 7f92267fc700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f9218004e30 tx=0x7f9218009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:48.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.588+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f92200532e0 con 0x7f92300f55c0 2022-02-02T21:58:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.767+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9230107bd0 con 0x7f921c064dd0 2022-02-02T21:58:48.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.768+0000 7f9227fff700 1 -- 172.21.15.96:0/3830009720 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9230107bd0 con 0x7f921c064dd0 2022-02-02T21:58:48.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 msgr2=0x7f921c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f9218004e30 tx=0x7f9218009b30).stop 2022-02-02T21:58:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 msgr2=0x7f9230105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 rx=0x7f922000c530 tx=0x7f9220007e20).stop 2022-02-02T21:58:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 shutdown_connections 2022-02-02T21:58:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f921c064dd0 0x7f921c067290 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92300f55c0 0x7f9230105e70 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 --2- 172.21.15.96:0/3830009720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92300f5ed0 0x7f9230106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 >> 172.21.15.96:0/3830009720 conn(0x7f92300f0de0 msgr2=0x7f92300fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 shutdown_connections 2022-02-02T21:58:48.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.770+0000 7f923557c700 1 -- 172.21.15.96:0/3830009720 wait complete. 2022-02-02T21:58:48.780 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:58:48.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 -- 172.21.15.96:0/1480225304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f5430 msgr2=0x7f1d6c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/1480225304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c0f5850 secure :-1 s=READY pgs=3325 cs=0 l=1 rev1=1 rx=0x7f1d5c004660 tx=0x7f1d5c009b30).stop 2022-02-02T21:58:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 -- 172.21.15.96:0/1480225304 shutdown_connections 2022-02-02T21:58:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/1480225304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:58:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/1480225304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c0f5850 unknown :-1 s=CLOSED pgs=3325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.868+0000 7f1d6bfff700 1 -- 172.21.15.96:0/1480225304 >> 172.21.15.96:0/1480225304 conn(0x7f1d6c0f0b90 msgr2=0x7f1d6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.869+0000 7f1d6bfff700 1 -- 172.21.15.96:0/1480225304 shutdown_connections 2022-02-02T21:58:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.869+0000 7f1d6bfff700 1 -- 172.21.15.96:0/1480225304 wait complete. 2022-02-02T21:58:48.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.869+0000 7f1d6bfff700 1 Processor -- start 2022-02-02T21:58:48.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.869+0000 7f1d6bfff700 1 -- start start 2022-02-02T21:58:48.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c060450 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c060590 con 0x7f1d6c0f5430 2022-02-02T21:58:48.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45880/0 (socket says 172.21.15.96:45880) 2022-02-02T21:58:48.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 -- 172.21.15.96:0/3185459218 learned_addr learned my addr 172.21.15.96:0/3185459218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:48.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6affd700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 -- 172.21.15.96:0/3185459218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f5430 msgr2=0x7f1d6c109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:48.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:48.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 -- 172.21.15.96:0/3185459218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c005040 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.870+0000 7f1d6a7fc700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 rx=0x7f1d6000b410 tx=0x7f1d60006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:48.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.871+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d600125f0 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.871+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d60012c00 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.871+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d60011d20 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.871+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c10c5e0 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.871+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c10cba0 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.872+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c045ad0 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.872+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1d6000f030 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.873+0000 7f1d537fe700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 0x7f1d540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:48.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.873+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1d60081df0 con 0x7f1d6c0f66d0 2022-02-02T21:58:48.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.873+0000 7f1d6affd700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 0x7f1d540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:48.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.873+0000 7f1d6affd700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 0x7f1d540672e0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f1d5c013690 tx=0x7f1d5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:48.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:48.877+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1d6004fef0 con 0x7f1d6c0f66d0 2022-02-02T21:58:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.048+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d6c0fde20 con 0x7f1d54064e20 2022-02-02T21:58:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.058+0000 7f1d537fe700 1 -- 172.21.15.96:0/3185459218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1d5c019040 con 0x7f1d54064e20 2022-02-02T21:58:49.058 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:58:49.058 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:58:49.059 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:58:49.059 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:58:49.059 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:58:49.060 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:58:49.060 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:58:49.060 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:58:49.061 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:58:49.061 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:58:49.061 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:58:49.062 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:58:49.062 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:58:49.062 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:58:49.063 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:58:49.063 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:58:49.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:58:49.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:58:49.064 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:58:49.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:58:49.065 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:58:49.065 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:58:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 msgr2=0x7f1d540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 0x7f1d540672e0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f1d5c013690 tx=0x7f1d5c009b30).stop 2022-02-02T21:58:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 msgr2=0x7f1d6c10bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 rx=0x7f1d6000b410 tx=0x7f1d60006ef0).stop 2022-02-02T21:58:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 shutdown_connections 2022-02-02T21:58:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d54064e20 0x7f1d540672e0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d6c0f5430 0x7f1d6c109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.059+0000 7f1d6bfff700 1 --2- 172.21.15.96:0/3185459218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d6c0f66d0 0x7f1d6c10bfd0 unknown :-1 s=CLOSED pgs=3326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.060+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 >> 172.21.15.96:0/3185459218 conn(0x7f1d6c0f0b90 msgr2=0x7f1d6c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.060+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 shutdown_connections 2022-02-02T21:58:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.060+0000 7f1d6bfff700 1 -- 172.21.15.96:0/3185459218 wait complete. 2022-02-02T21:58:49.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 -- 172.21.15.96:0/279503114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f6530 msgr2=0x7f630c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 --2- 172.21.15.96:0/279503114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f6530 0x7f630c0f6950 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 rx=0x7f62fc004660 tx=0x7f62fc009b30).stop 2022-02-02T21:58:49.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 -- 172.21.15.96:0/279503114 shutdown_connections 2022-02-02T21:58:49.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 --2- 172.21.15.96:0/279503114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f77d0 0x7f630c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:58:49.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 --2- 172.21.15.96:0/279503114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f6530 0x7f630c0f6950 unknown :-1 s=CLOSED pgs=3327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 -- 172.21.15.96:0/279503114 >> 172.21.15.96:0/279503114 conn(0x7f630c0f1c90 msgr2=0x7f630c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:49.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 -- 172.21.15.96:0/279503114 shutdown_connections 2022-02-02T21:58:49.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.155+0000 7f63113d8700 1 -- 172.21.15.96:0/279503114 wait complete. 2022-02-02T21:58:49.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 Processor -- start 2022-02-02T21:58:49.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 -- start start 2022-02-02T21:58:49.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 0x7f630c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c06a410 con 0x7f630c0f77d0 2022-02-02T21:58:49.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f63113d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c06a550 con 0x7f630c0f6530 2022-02-02T21:58:49.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.156+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45890/0 (socket says 172.21.15.96:45890) 2022-02-02T21:58:49.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 -- 172.21.15.96:0/4192815543 learned_addr learned my addr 172.21.15.96:0/4192815543 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:49.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630bfff700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 0x7f630c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 -- 172.21.15.96:0/4192815543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 msgr2=0x7f630c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 0x7f630c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 -- 172.21.15.96:0/4192815543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc005040 con 0x7f630c0f77d0 2022-02-02T21:58:49.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630bfff700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 0x7f630c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T21:58:49.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f630b7fe700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 rx=0x7f630000b410 tx=0x7f6300006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:49.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63000125f0 con 0x7f630c0f77d0 2022-02-02T21:58:49.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f630000be30 con 0x7f630c0f77d0 2022-02-02T21:58:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6300002a70 con 0x7f630c0f77d0 2022-02-02T21:58:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c06a830 con 0x7f630c0f77d0 2022-02-02T21:58:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.157+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c10ede0 con 0x7f630c0f77d0 2022-02-02T21:58:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.158+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c045ad0 con 0x7f630c0f77d0 2022-02-02T21:58:49.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.159+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f630000f030 con 0x7f630c0f77d0 2022-02-02T21:58:49.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.159+0000 7f6308ff9700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 0x7f62f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.159+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6300081e70 con 0x7f630c0f77d0 2022-02-02T21:58:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.159+0000 7f630bfff700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 0x7f62f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.160+0000 7f630bfff700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 0x7f62f40672e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f62fc013690 tx=0x7f62fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:49.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.163+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f630004ff70 con 0x7f630c0f77d0 2022-02-02T21:58:49.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.393+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f630c027a00 con 0x7f630c0f77d0 2022-02-02T21:58:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.394+0000 7f6308ff9700 1 -- 172.21.15.96:0/4192815543 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6300053590 con 0x7f630c0f77d0 2022-02-02T21:58:49.394 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:58:49.395 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:58:49.395 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:58:49.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:49.396 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:58:49.396 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:58:49.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:49.397 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:58:49.397 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:58:49.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:49.398 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:58:49.398 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:58:49.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:58:49.399 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:58:49.399 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:58:49.400 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:58:49.400 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:58:49.400 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:58:49.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.395+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 msgr2=0x7f62f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.395+0000 7f63113d8700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 0x7f62f40672e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f62fc013690 tx=0x7f62fc009b30).stop 2022-02-02T21:58:49.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 msgr2=0x7f630c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 rx=0x7f630000b410 tx=0x7f6300006ef0).stop 2022-02-02T21:58:49.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 shutdown_connections 2022-02-02T21:58:49.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62f4064e20 0x7f62f40672e0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f630c0f6530 0x7f630c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 --2- 172.21.15.96:0/4192815543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f630c0f77d0 0x7f630c069e20 unknown :-1 s=CLOSED pgs=3328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 >> 172.21.15.96:0/4192815543 conn(0x7f630c0f1c90 msgr2=0x7f630c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:49.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 shutdown_connections 2022-02-02T21:58:49.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.396+0000 7f63113d8700 1 -- 172.21.15.96:0/4192815543 wait complete. 2022-02-02T21:58:49.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/826422014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 msgr2=0x7f6f780f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/826422014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f780f9140 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 rx=0x7f6f68004660 tx=0x7f6f68009b30).stop 2022-02-02T21:58:49.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/826422014 shutdown_connections 2022-02-02T21:58:49.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/826422014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 0x7f6f780fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/826422014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f780f9140 unknown :-1 s=CLOSED pgs=3329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.493+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/826422014 >> 172.21.15.96:0/826422014 conn(0x7f6f780f0bc0 msgr2=0x7f6f780f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:49.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.494+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/826422014 shutdown_connections 2022-02-02T21:58:49.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.494+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/826422014 wait complete. 2022-02-02T21:58:49.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 Processor -- start 2022-02-02T21:58:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 -- start start 2022-02-02T21:58:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 0x7f6f781072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781078c0 con 0x7f6f78060310 2022-02-02T21:58:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f7d7d6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78108100 con 0x7f6f780f96c0 2022-02-02T21:58:49.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45898/0 (socket says 172.21.15.96:45898) 2022-02-02T21:58:49.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1912811575 learned_addr learned my addr 172.21.15.96:0/1912811575 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:58:49.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.495+0000 7f6f767fc700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 0x7f6f781072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1912811575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 msgr2=0x7f6f781072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f76ffd700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 0x7f6f781072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f76ffd700 1 -- 172.21.15.96:0/1912811575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68005040 con 0x7f6f78060310 2022-02-02T21:58:49.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f76ffd700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 rx=0x7f6f68009990 tx=0x7f6f68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:49.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f68018070 con 0x7f6f78060310 2022-02-02T21:58:49.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78108380 con 0x7f6f78060310 2022-02-02T21:58:49.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f68007ca0 con 0x7f6f78060310 2022-02-02T21:58:49.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6801c620 con 0x7f6f78060310 2022-02-02T21:58:49.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.496+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f78108860 con 0x7f6f78060310 2022-02-02T21:58:49.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.497+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f6801d960 con 0x7f6f78060310 2022-02-02T21:58:49.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.498+0000 7f6f5f7fe700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 0x7f6f600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:58:49.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.498+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78059100 con 0x7f6f78060310 2022-02-02T21:58:49.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.498+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f680837d0 con 0x7f6f78060310 2022-02-02T21:58:49.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.498+0000 7f6f767fc700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 0x7f6f600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:58:49.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.498+0000 7f6f767fc700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 0x7f6f600672e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f6f78106b60 tx=0x7f6f6c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:58:49.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.502+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f68051a40 con 0x7f6f78060310 2022-02-02T21:58:49.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.701+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f780fed40 con 0x7f6f78060310 2022-02-02T21:58:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.702+0000 7f6f5f7fe700 1 -- 172.21.15.96:0/1912811575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6f68055060 con 0x7f6f78060310 2022-02-02T21:58:49.703 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:58:49.703 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:58:49.703 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:58:49.704 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:58:49.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:49.704 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:58:49.705 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:58:49.705 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:58:49.705 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:58:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:58:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:58:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:58:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:58:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:58:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:58:49.708 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:58:49.708 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:58:49.708 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:58:49.709 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:58:49.709 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:58:49.709 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:58:49.710 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:58:49.710 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:58:49.711 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:58:49.711 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:58:49.711 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:58:49.712 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:58:49.712 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:58:49.712 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:58:49.713 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:58:49.713 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:58:49.714 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:58:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:49.714 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:49.715 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:58:49.715 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:58:49.715 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:49.716 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:49.716 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:58:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 msgr2=0x7f6f600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 0x7f6f600672e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f6f78106b60 tx=0x7f6f6c009040).stop 2022-02-02T21:58:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 msgr2=0x7f6f78106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:58:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 rx=0x7f6f68009990 tx=0x7f6f68009b30).stop 2022-02-02T21:58:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 shutdown_connections 2022-02-02T21:58:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f60064e20 0x7f6f600672e0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f78060310 0x7f6f78106dd0 unknown :-1 s=CLOSED pgs=3330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 --2- 172.21.15.96:0/1912811575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f96c0 0x7f6f781072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:58:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 >> 172.21.15.96:0/1912811575 conn(0x7f6f780f0bc0 msgr2=0x7f6f780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:58:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 shutdown_connections 2022-02-02T21:58:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:58:49.705+0000 7f6f7d7d6700 1 -- 172.21.15.96:0/1912811575 wait complete. 2022-02-02T21:58:49.722 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:58:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:50 smithi159 ceph-mon[69013]: pgmap v6501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:50 smithi159 ceph-mon[69013]: from='client.40764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:50 smithi159 ceph-mon[69013]: from='client.40768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4192815543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:58:50.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1912811575' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:58:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:50 smithi096 ceph-mon[101353]: pgmap v6501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:50 smithi096 ceph-mon[101353]: from='client.40764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:50 smithi096 ceph-mon[101353]: from='client.40768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:58:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4192815543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:58:50.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1912811575' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:58:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:52 smithi159 ceph-mon[69013]: pgmap v6502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:52 smithi096 ceph-mon[101353]: pgmap v6502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:54 smithi159 ceph-mon[69013]: pgmap v6503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:54 smithi096 ceph-mon[101353]: pgmap v6503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:56 smithi159 ceph-mon[69013]: pgmap v6504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:56 smithi096 ceph-mon[101353]: pgmap v6504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:58:58 smithi159 ceph-mon[69013]: pgmap v6505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:58:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:58:58 smithi096 ceph-mon[101353]: pgmap v6505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:00 smithi159 ceph-mon[69013]: pgmap v6506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:00 smithi096 ceph-mon[101353]: pgmap v6506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:02 smithi159 ceph-mon[69013]: pgmap v6507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:02 smithi096 ceph-mon[101353]: pgmap v6507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:04 smithi159 ceph-mon[69013]: pgmap v6508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:04 smithi096 ceph-mon[101353]: pgmap v6508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:06 smithi159 ceph-mon[69013]: pgmap v6509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:06 smithi096 ceph-mon[101353]: pgmap v6509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:08 smithi159 ceph-mon[69013]: pgmap v6510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:08 smithi096 ceph-mon[101353]: pgmap v6510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:10 smithi159 ceph-mon[69013]: pgmap v6511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:10 smithi096 ceph-mon[101353]: pgmap v6511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:12 smithi159 ceph-mon[69013]: pgmap v6512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:12 smithi096 ceph-mon[101353]: pgmap v6512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:14 smithi159 ceph-mon[69013]: pgmap v6513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:14 smithi096 ceph-mon[101353]: pgmap v6513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:16 smithi159 ceph-mon[69013]: pgmap v6514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:16 smithi096 ceph-mon[101353]: pgmap v6514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:18 smithi159 ceph-mon[69013]: pgmap v6515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:18 smithi096 ceph-mon[101353]: pgmap v6515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:19.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 -- 172.21.15.96:0/2412725567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f5430 msgr2=0x7f322c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:19.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 --2- 172.21.15.96:0/2412725567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f5430 0x7f322c0f5850 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 rx=0x7f321c004660 tx=0x7f321c009b30).stop 2022-02-02T21:59:19.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 -- 172.21.15.96:0/2412725567 shutdown_connections 2022-02-02T21:59:19.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 --2- 172.21.15.96:0/2412725567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f66d0 0x7f322c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:59:19.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 --2- 172.21.15.96:0/2412725567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f5430 0x7f322c0f5850 unknown :-1 s=CLOSED pgs=3331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:19.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.814+0000 7f322b59e700 1 -- 172.21.15.96:0/2412725567 >> 172.21.15.96:0/2412725567 conn(0x7f322c0f0b90 msgr2=0x7f322c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:19.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 -- 172.21.15.96:0/2412725567 shutdown_connections 2022-02-02T21:59:19.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 -- 172.21.15.96:0/2412725567 wait complete. 2022-02-02T21:59:19.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 Processor -- start 2022-02-02T21:59:19.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 -- start start 2022-02-02T21:59:19.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f5430 0x7f322c108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:19.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:19.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c109ac0 con 0x7f322c0f66d0 2022-02-02T21:59:19.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.815+0000 7f322b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c10a370 con 0x7f322c0f5430 2022-02-02T21:59:19.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:19.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45916/0 (socket says 172.21.15.96:45916) 2022-02-02T21:59:19.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 -- 172.21.15.96:0/2089052849 learned_addr learned my addr 172.21.15.96:0/2089052849 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:19.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f322a59c700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f5430 0x7f322c108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:19.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 -- 172.21.15.96:0/2089052849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f5430 msgr2=0x7f322c108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:19.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f5430 0x7f322c108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:19.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 -- 172.21.15.96:0/2089052849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c005040 con 0x7f322c0f66d0 2022-02-02T21:59:19.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f3229d9b700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 rx=0x7f322000b410 tx=0x7f3220006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:19.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32200125f0 con 0x7f322c0f66d0 2022-02-02T21:59:19.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3220012c00 con 0x7f322c0f66d0 2022-02-02T21:59:19.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c10a650 con 0x7f322c0f66d0 2022-02-02T21:59:19.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3220002ae0 con 0x7f322c0f66d0 2022-02-02T21:59:19.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.816+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c10ac10 con 0x7f322c0f66d0 2022-02-02T21:59:19.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.817+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c059100 con 0x7f322c0f66d0 2022-02-02T21:59:19.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.818+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f322000f030 con 0x7f322c0f66d0 2022-02-02T21:59:19.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.818+0000 7f321affd700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 0x7f32140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:19.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.818+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3220081e70 con 0x7f322c0f66d0 2022-02-02T21:59:19.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.818+0000 7f322a59c700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 0x7f32140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:19.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.819+0000 7f322a59c700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 0x7f32140672e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f321c004e30 tx=0x7f321c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:19.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:19.823+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32200539a0 con 0x7f322c0f66d0 2022-02-02T21:59:20.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.003+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f322c0fa910 con 0x7f3214064e20 2022-02-02T21:59:20.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.005+0000 7f321affd700 1 -- 172.21.15.96:0/2089052849 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f322c0fa910 con 0x7f3214064e20 2022-02-02T21:59:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 msgr2=0x7f32140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 0x7f32140672e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f321c004e30 tx=0x7f321c009b30).stop 2022-02-02T21:59:20.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 msgr2=0x7f322c109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 rx=0x7f322000b410 tx=0x7f3220006ef0).stop 2022-02-02T21:59:20.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 shutdown_connections 2022-02-02T21:59:20.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3214064e20 0x7f32140672e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322c0f5430 0x7f322c108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 --2- 172.21.15.96:0/2089052849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0f66d0 0x7f322c109480 unknown :-1 s=CLOSED pgs=3332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.006+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 >> 172.21.15.96:0/2089052849 conn(0x7f322c0f0b90 msgr2=0x7f322c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.007+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 shutdown_connections 2022-02-02T21:59:20.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.007+0000 7f322b59e700 1 -- 172.21.15.96:0/2089052849 wait complete. 2022-02-02T21:59:20.017 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:59:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 -- 172.21.15.96:0/963235187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f7980 msgr2=0x7f2b780f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/963235187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f7980 0x7f2b780f7de0 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 rx=0x7f2b64004660 tx=0x7f2b64009b30).stop 2022-02-02T21:59:20.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 -- 172.21.15.96:0/963235187 shutdown_connections 2022-02-02T21:59:20.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/963235187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f7980 0x7f2b780f7de0 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/963235187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f66e0 0x7f2b780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:59:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 -- 172.21.15.96:0/963235187 >> 172.21.15.96:0/963235187 conn(0x7f2b780f1e40 msgr2=0x7f2b780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 -- 172.21.15.96:0/963235187 shutdown_connections 2022-02-02T21:59:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.104+0000 7f2b7ef43700 1 -- 172.21.15.96:0/963235187 wait complete. 2022-02-02T21:59:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 Processor -- start 2022-02-02T21:59:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 -- start start 2022-02-02T21:59:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 0x7f2b78069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7806a410 con 0x7f2b780f66e0 2022-02-02T21:59:20.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ef43700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7806a550 con 0x7f2b780f7980 2022-02-02T21:59:20.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ccdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ccdf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45924/0 (socket says 172.21.15.96:45924) 2022-02-02T21:59:20.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.105+0000 7f2b7ccdf700 1 -- 172.21.15.96:0/2672014202 learned_addr learned my addr 172.21.15.96:0/2672014202 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:20.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b77fff700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 0x7f2b78069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ccdf700 1 -- 172.21.15.96:0/2672014202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 msgr2=0x7f2b78069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ccdf700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 0x7f2b78069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ccdf700 1 -- 172.21.15.96:0/2672014202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64005040 con 0x7f2b780f66e0 2022-02-02T21:59:20.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b77fff700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 0x7f2b78069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T21:59:20.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ccdf700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 rx=0x7f2b6c0093f0 tx=0x7f2b6c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c009ea0 con 0x7f2b780f66e0 2022-02-02T21:59:20.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b6c013af0 con 0x7f2b780f66e0 2022-02-02T21:59:20.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c00db10 con 0x7f2b780f66e0 2022-02-02T21:59:20.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7806a830 con 0x7f2b780f66e0 2022-02-02T21:59:20.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.106+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7810efe0 con 0x7f2b780f66e0 2022-02-02T21:59:20.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.107+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b78045ad0 con 0x7f2b780f66e0 2022-02-02T21:59:20.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.108+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b6c01a060 con 0x7f2b780f66e0 2022-02-02T21:59:20.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.108+0000 7f2b757fa700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 0x7f2b68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.108+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2b6c081b80 con 0x7f2b780f66e0 2022-02-02T21:59:20.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.108+0000 7f2b77fff700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 0x7f2b68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.109+0000 7f2b77fff700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 0x7f2b68067290 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f2b64004e30 tx=0x7f2b64009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.112+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b6c04fbc0 con 0x7f2b780f66e0 2022-02-02T21:59:20.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.286+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b780ff080 con 0x7f2b68064dd0 2022-02-02T21:59:20.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.295+0000 7f2b757fa700 1 -- 172.21.15.96:0/2672014202 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2b780ff080 con 0x7f2b68064dd0 2022-02-02T21:59:20.297 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:59:20.297 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:59:20.298 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:59:20.298 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:59:20.299 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:59:20.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:59:20.299 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:59:20.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:59:20.300 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:59:20.301 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:59:20.301 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:59:20.302 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:59:20.302 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:59:20.303 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:59:20.303 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:59:20.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:59:20.304 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:59:20.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:59:20.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:59:20.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:59:20.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:59:20.306 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:59:20.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 msgr2=0x7f2b68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 0x7f2b68067290 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f2b64004e30 tx=0x7f2b64009b30).stop 2022-02-02T21:59:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 msgr2=0x7f2b7806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 rx=0x7f2b6c0093f0 tx=0x7f2b6c006ec0).stop 2022-02-02T21:59:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 shutdown_connections 2022-02-02T21:59:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b68064dd0 0x7f2b68067290 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b780f66e0 0x7f2b7806b9a0 unknown :-1 s=CLOSED pgs=3334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 --2- 172.21.15.96:0/2672014202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b780f7980 0x7f2b78069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 >> 172.21.15.96:0/2672014202 conn(0x7f2b780f1e40 msgr2=0x7f2b780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 shutdown_connections 2022-02-02T21:59:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.297+0000 7f2b7ef43700 1 -- 172.21.15.96:0/2672014202 wait complete. 2022-02-02T21:59:20.396 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:20 smithi096 ceph-mon[101353]: pgmap v6516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:20.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 -- 172.21.15.96:0/686157670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 msgr2=0x7fec300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 --2- 172.21.15.96:0/686157670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec300f6cc0 secure :-1 s=READY pgs=3335 cs=0 l=1 rev1=1 rx=0x7fec24004660 tx=0x7fec24009b30).stop 2022-02-02T21:59:20.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 -- 172.21.15.96:0/686157670 shutdown_connections 2022-02-02T21:59:20.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 --2- 172.21.15.96:0/686157670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec300f6cc0 unknown :-1 s=CLOSED pgs=3335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 --2- 172.21.15.96:0/686157670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 0x7fec300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 -- 172.21.15.96:0/686157670 >> 172.21.15.96:0/686157670 conn(0x7fec300f0d20 msgr2=0x7fec300f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 -- 172.21.15.96:0/686157670 shutdown_connections 2022-02-02T21:59:20.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.394+0000 7fec354f4700 1 -- 172.21.15.96:0/686157670 wait complete. 2022-02-02T21:59:20.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 Processor -- start 2022-02-02T21:59:20.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 -- start start 2022-02-02T21:59:20.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 0x7fec30109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30060540 con 0x7fec300f6860 2022-02-02T21:59:20.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec354f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30060680 con 0x7fec300f55c0 2022-02-02T21:59:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.395+0000 7fec2e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45936/0 (socket says 172.21.15.96:45936) 2022-02-02T21:59:20.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 -- 172.21.15.96:0/1265192992 learned_addr learned my addr 172.21.15.96:0/1265192992 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:20.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2effd700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 0x7fec30109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 -- 172.21.15.96:0/1265192992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 msgr2=0x7fec30109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 0x7fec30109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 -- 172.21.15.96:0/1265192992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24005040 con 0x7fec300f6860 2022-02-02T21:59:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec2e7fc700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 rx=0x7fec24009990 tx=0x7fec24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec24018070 con 0x7fec300f6860 2022-02-02T21:59:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3010c6a0 con 0x7fec300f6860 2022-02-02T21:59:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec24007ba0 con 0x7fec300f6860 2022-02-02T21:59:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3010cbd0 con 0x7fec300f6860 2022-02-02T21:59:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.396+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec2401dd00 con 0x7fec300f6860 2022-02-02T21:59:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.397+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec30045ad0 con 0x7fec300f6860 2022-02-02T21:59:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.398+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec2401d420 con 0x7fec300f6860 2022-02-02T21:59:20.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.398+0000 7fec177fe700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 0x7fec18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.398+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec240834c0 con 0x7fec300f6860 2022-02-02T21:59:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.398+0000 7fec2effd700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 0x7fec18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.399+0000 7fec2effd700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 0x7fec18067290 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fec300601c0 tx=0x7fec2000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.402+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec24051620 con 0x7fec300f6860 2022-02-02T21:59:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:20 smithi159 ceph-mon[69013]: pgmap v6516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:20.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.632+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec300fde20 con 0x7fec300f6860 2022-02-02T21:59:20.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.633+0000 7fec177fe700 1 -- 172.21.15.96:0/1265192992 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fec2401de60 con 0x7fec300f6860 2022-02-02T21:59:20.634 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:59:20.635 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:59:20.635 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:59:20.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:20.636 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:59:20.636 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:59:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:59:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:59:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:59:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:59:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:59:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:59:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:59:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:59:20.641 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:59:20.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 msgr2=0x7fec18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 0x7fec18067290 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fec300601c0 tx=0x7fec2000b040).stop 2022-02-02T21:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 msgr2=0x7fec3010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 rx=0x7fec24009990 tx=0x7fec24009b30).stop 2022-02-02T21:59:20.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 shutdown_connections 2022-02-02T21:59:20.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec18064dd0 0x7fec18067290 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.634+0000 7fec354f4700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec300f55c0 0x7fec30109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.635+0000 7fec354f4700 1 --2- 172.21.15.96:0/1265192992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec300f6860 0x7fec3010c150 unknown :-1 s=CLOSED pgs=3336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.635+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 >> 172.21.15.96:0/1265192992 conn(0x7fec300f0d20 msgr2=0x7fec300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.635+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 shutdown_connections 2022-02-02T21:59:20.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.635+0000 7fec354f4700 1 -- 172.21.15.96:0/1265192992 wait complete. 2022-02-02T21:59:20.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 -- 172.21.15.96:0/1892835540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f7980 msgr2=0x7f3f8c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 --2- 172.21.15.96:0/1892835540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f7980 0x7f3f8c0f7de0 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 rx=0x7f3f88004660 tx=0x7f3f88009b30).stop 2022-02-02T21:59:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 -- 172.21.15.96:0/1892835540 shutdown_connections 2022-02-02T21:59:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 --2- 172.21.15.96:0/1892835540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f7980 0x7f3f8c0f7de0 unknown :-1 s=CLOSED pgs=3337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 --2- 172.21.15.96:0/1892835540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 -- 172.21.15.96:0/1892835540 >> 172.21.15.96:0/1892835540 conn(0x7f3f8c0f1e40 msgr2=0x7f3f8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.732+0000 7f3f9461d700 1 -- 172.21.15.96:0/1892835540 shutdown_connections 2022-02-02T21:59:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 -- 172.21.15.96:0/1892835540 wait complete. 2022-02-02T21:59:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 Processor -- start 2022-02-02T21:59:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 -- start start 2022-02-02T21:59:20.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0f7980 0x7f3f8c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1079e0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f9461d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c107b20 con 0x7f3f8c0f7980 2022-02-02T21:59:20.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f923b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f923b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45944/0 (socket says 172.21.15.96:45944) 2022-02-02T21:59:20.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.734+0000 7f3f923b9700 1 -- 172.21.15.96:0/3334395854 learned_addr learned my addr 172.21.15.96:0/3334395854 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:20.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f923b9700 1 -- 172.21.15.96:0/3334395854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0f7980 msgr2=0x7f3f8c107430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T21:59:20.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f923b9700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0f7980 0x7f3f8c107430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:59:20.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f923b9700 1 -- 172.21.15.96:0/3334395854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88005040 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f923b9700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 secure :-1 s=READY pgs=3338 cs=0 l=1 rev1=1 rx=0x7f3f80002700 tx=0x7f3f80009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f80009320 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f8000f040 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c1084c0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f800148c0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.735+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c108a80 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.736+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c045ad0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.736+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f80009480 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.737+0000 7f3f7effd700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 0x7f3f78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:20.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.737+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f80081cb0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.737+0000 7f3f91bb8700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 0x7f3f78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:20.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.737+0000 7f3f91bb8700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 0x7f3f78067290 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f3f88004e30 tx=0x7f3f88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:20.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.741+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f800537e0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.944+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f8c0ff020 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.945+0000 7f3f7effd700 1 -- 172.21.15.96:0/3334395854 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3f800533d0 con 0x7f3f8c0f66e0 2022-02-02T21:59:20.946 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:59:20.947 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:59:20.947 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:59:20.948 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:59:20.948 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:20.948 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:59:20.949 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:59:20.949 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:59:20.949 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:59:20.950 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:59:20.950 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:59:20.950 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:59:20.951 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:59:20.951 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:59:20.951 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:59:20.952 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:59:20.952 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:59:20.952 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:59:20.953 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:59:20.953 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:59:20.954 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:59:20.954 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:59:20.954 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:59:20.955 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:59:20.955 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:59:20.955 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:59:20.956 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:59:20.956 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:59:20.956 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:59:20.957 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:59:20.957 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:59:20.957 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:59:20.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:20.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:20.958 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:59:20.959 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:20.959 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:20.959 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:20.960 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:20.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 msgr2=0x7f3f78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 0x7f3f78067290 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f3f88004e30 tx=0x7f3f88009b30).stop 2022-02-02T21:59:20.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 msgr2=0x7f3f8c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:20.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 secure :-1 s=READY pgs=3338 cs=0 l=1 rev1=1 rx=0x7f3f80002700 tx=0x7f3f80009d80).stop 2022-02-02T21:59:20.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 shutdown_connections 2022-02-02T21:59:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f78064dd0 0x7f3f78067290 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f8c0f66e0 0x7f3f8c106f40 unknown :-1 s=CLOSED pgs=3338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 --2- 172.21.15.96:0/3334395854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0f7980 0x7f3f8c107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T21:59:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 >> 172.21.15.96:0/3334395854 conn(0x7f3f8c0f1e40 msgr2=0x7f3f8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 shutdown_connections 2022-02-02T21:59:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:20.947+0000 7f3f9461d700 1 -- 172.21.15.96:0/3334395854 wait complete. 2022-02-02T21:59:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:59:21.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:21 smithi159 ceph-mon[69013]: from='client.40780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:21 smithi159 ceph-mon[69013]: from='client.40784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1265192992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:59:21.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3334395854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:59:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:21 smithi096 ceph-mon[101353]: from='client.40780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:21 smithi096 ceph-mon[101353]: from='client.40784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:21.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1265192992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:59:21.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3334395854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:59:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:22 smithi159 ceph-mon[69013]: pgmap v6517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:22 smithi096 ceph-mon[101353]: pgmap v6517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:24 smithi159 ceph-mon[69013]: pgmap v6518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:24 smithi096 ceph-mon[101353]: pgmap v6518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:26 smithi159 ceph-mon[69013]: pgmap v6519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:26 smithi096 ceph-mon[101353]: pgmap v6519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:28 smithi159 ceph-mon[69013]: pgmap v6520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:59:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:59:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:28 smithi096 ceph-mon[101353]: pgmap v6520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T21:59:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T21:59:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:30 smithi159 ceph-mon[69013]: pgmap v6521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:30 smithi096 ceph-mon[101353]: pgmap v6521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:32 smithi159 ceph-mon[69013]: pgmap v6522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:32 smithi096 ceph-mon[101353]: pgmap v6522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:34 smithi096 ceph-mon[101353]: pgmap v6523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:34 smithi159 ceph-mon[69013]: pgmap v6523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:36.557 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:36 smithi096 ceph-mon[101353]: pgmap v6524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:36 smithi159 ceph-mon[69013]: pgmap v6524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:38 smithi096 ceph-mon[101353]: pgmap v6525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:38 smithi159 ceph-mon[69013]: pgmap v6525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:40 smithi096 ceph-mon[101353]: pgmap v6526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:40 smithi159 ceph-mon[69013]: pgmap v6526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:42 smithi096 ceph-mon[101353]: pgmap v6527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:42 smithi159 ceph-mon[69013]: pgmap v6527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:44 smithi096 ceph-mon[101353]: pgmap v6528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:44 smithi159 ceph-mon[69013]: pgmap v6528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:46 smithi096 ceph-mon[101353]: pgmap v6529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:46 smithi159 ceph-mon[69013]: pgmap v6529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:48 smithi096 ceph-mon[101353]: pgmap v6530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:48 smithi159 ceph-mon[69013]: pgmap v6530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:50.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:50 smithi096 ceph-mon[101353]: pgmap v6531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:50 smithi159 ceph-mon[69013]: pgmap v6531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:51.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 -- 172.21.15.96:0/2191826093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 msgr2=0x7f26b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/2191826093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b00f6cc0 secure :-1 s=READY pgs=3339 cs=0 l=1 rev1=1 rx=0x7f26ac004660 tx=0x7f26ac009b30).stop 2022-02-02T21:59:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 -- 172.21.15.96:0/2191826093 shutdown_connections 2022-02-02T21:59:51.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/2191826093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b00f6cc0 unknown :-1 s=CLOSED pgs=3339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/2191826093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 0x7f26b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T21:59:51.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 -- 172.21.15.96:0/2191826093 >> 172.21.15.96:0/2191826093 conn(0x7f26b00f0d40 msgr2=0x7f26b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 -- 172.21.15.96:0/2191826093 shutdown_connections 2022-02-02T21:59:51.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.058+0000 7f26b7d2a700 1 -- 172.21.15.96:0/2191826093 wait complete. 2022-02-02T21:59:51.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 Processor -- start 2022-02-02T21:59:51.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 -- start start 2022-02-02T21:59:51.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 0x7f26b0109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b0060450 con 0x7f26b00f6860 2022-02-02T21:59:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b7d2a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b0060590 con 0x7f26b00f55c0 2022-02-02T21:59:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b52c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b52c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45962/0 (socket says 172.21.15.96:45962) 2022-02-02T21:59:51.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b52c5700 1 -- 172.21.15.96:0/274547027 learned_addr learned my addr 172.21.15.96:0/274547027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:51.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.059+0000 7f26b5ac6700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 0x7f26b0109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b52c5700 1 -- 172.21.15.96:0/274547027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 msgr2=0x7f26b0109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b52c5700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 0x7f26b0109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b52c5700 1 -- 172.21.15.96:0/274547027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac005040 con 0x7f26b00f6860 2022-02-02T21:59:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b52c5700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 rx=0x7f26ac009990 tx=0x7f26ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26ac018070 con 0x7f26b00f6860 2022-02-02T21:59:51.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26ac007ba0 con 0x7f26b00f6860 2022-02-02T21:59:51.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b010c780 con 0x7f26b00f6860 2022-02-02T21:59:51.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26ac01c620 con 0x7f26b00f6860 2022-02-02T21:59:51.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.060+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b010cce0 con 0x7f26b00f6860 2022-02-02T21:59:51.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.061+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b0045ad0 con 0x7f26b00f6860 2022-02-02T21:59:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.062+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26ac01c890 con 0x7f26b00f6860 2022-02-02T21:59:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.062+0000 7f26a67fc700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 0x7f269c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.062+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26ac0837d0 con 0x7f26b00f6860 2022-02-02T21:59:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.062+0000 7f26b5ac6700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 0x7f269c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.062+0000 7f26b5ac6700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 0x7f269c067290 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f26b0060040 tx=0x7f26a0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.066+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26ac0518d0 con 0x7f26b00f6860 2022-02-02T21:59:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.247+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26b00fdf90 con 0x7f269c064dd0 2022-02-02T21:59:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.248+0000 7f26a67fc700 1 -- 172.21.15.96:0/274547027 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f26b00fdf90 con 0x7f269c064dd0 2022-02-02T21:59:51.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 msgr2=0x7f269c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 0x7f269c067290 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f26b0060040 tx=0x7f26a0008040).stop 2022-02-02T21:59:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 msgr2=0x7f26b010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 rx=0x7f26ac009990 tx=0x7f26ac009b30).stop 2022-02-02T21:59:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 shutdown_connections 2022-02-02T21:59:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f269c064dd0 0x7f269c067290 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26b00f55c0 0x7f26b0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 --2- 172.21.15.96:0/274547027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26b00f6860 0x7f26b010c1d0 unknown :-1 s=CLOSED pgs=3340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 >> 172.21.15.96:0/274547027 conn(0x7f26b00f0d40 msgr2=0x7f26b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 shutdown_connections 2022-02-02T21:59:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.250+0000 7f26b7d2a700 1 -- 172.21.15.96:0/274547027 wait complete. 2022-02-02T21:59:51.261 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T21:59:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 -- 172.21.15.96:0/157103601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f66e0 msgr2=0x7efef40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 --2- 172.21.15.96:0/157103601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f66e0 0x7efef40f6b40 secure :-1 s=READY pgs=3341 cs=0 l=1 rev1=1 rx=0x7efee4004660 tx=0x7efee4009b30).stop 2022-02-02T21:59:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 -- 172.21.15.96:0/157103601 shutdown_connections 2022-02-02T21:59:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 --2- 172.21.15.96:0/157103601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f66e0 0x7efef40f6b40 unknown :-1 s=CLOSED pgs=3341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 --2- 172.21.15.96:0/157103601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f5440 0x7efef40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.348+0000 7efefa397700 1 -- 172.21.15.96:0/157103601 >> 172.21.15.96:0/157103601 conn(0x7efef40f0ba0 msgr2=0x7efef40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 -- 172.21.15.96:0/157103601 shutdown_connections 2022-02-02T21:59:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 -- 172.21.15.96:0/157103601 wait complete. 2022-02-02T21:59:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 Processor -- start 2022-02-02T21:59:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 -- start start 2022-02-02T21:59:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f66e0 0x7efef410be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40603e0 con 0x7efef40f5440 2022-02-02T21:59:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efefa397700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4060520 con 0x7efef40f66e0 2022-02-02T21:59:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.349+0000 7efef9395700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45970/0 (socket says 172.21.15.96:45970) 2022-02-02T21:59:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 -- 172.21.15.96:0/587505007 learned_addr learned my addr 172.21.15.96:0/587505007 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef8b94700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f66e0 0x7efef410be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 -- 172.21.15.96:0/587505007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f66e0 msgr2=0x7efef410be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f66e0 0x7efef410be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 -- 172.21.15.96:0/587505007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4005040 con 0x7efef40f5440 2022-02-02T21:59:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efef9395700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 rx=0x7efef000e7c0 tx=0x7efef000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef00092e0 con 0x7efef40f5440 2022-02-02T21:59:51.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef410c430 con 0x7efef40f5440 2022-02-02T21:59:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efef000f040 con 0x7efef40f5440 2022-02-02T21:59:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.350+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef00147e0 con 0x7efef40f5440 2022-02-02T21:59:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.351+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef410c9f0 con 0x7efef40f5440 2022-02-02T21:59:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.352+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efef001b030 con 0x7efef40f5440 2022-02-02T21:59:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.352+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef4045ad0 con 0x7efef40f5440 2022-02-02T21:59:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.352+0000 7efee9ffb700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 0x7efee00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.352+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efef0081600 con 0x7efef40f5440 2022-02-02T21:59:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.352+0000 7efef8b94700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 0x7efee00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.353+0000 7efef8b94700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 0x7efee00672e0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7efee4005010 tx=0x7efee4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.357+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efef004f670 con 0x7efef40f5440 2022-02-02T21:59:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.528+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efef4057f10 con 0x7efee0064e20 2022-02-02T21:59:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.537+0000 7efee9ffb700 1 -- 172.21.15.96:0/587505007 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efef4057f10 con 0x7efee0064e20 2022-02-02T21:59:51.538 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T21:59:51.539 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T21:59:51.539 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T21:59:51.540 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T21:59:51.540 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T21:59:51.540 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T21:59:51.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T21:59:51.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T21:59:51.541 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T21:59:51.542 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T21:59:51.542 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T21:59:51.542 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T21:59:51.543 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T21:59:51.543 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T21:59:51.543 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T21:59:51.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T21:59:51.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T21:59:51.544 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T21:59:51.545 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T21:59:51.545 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T21:59:51.545 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T21:59:51.546 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T21:59:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 msgr2=0x7efee00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 0x7efee00672e0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7efee4005010 tx=0x7efee4016040).stop 2022-02-02T21:59:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 msgr2=0x7efef4109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 rx=0x7efef000e7c0 tx=0x7efef000b040).stop 2022-02-02T21:59:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 shutdown_connections 2022-02-02T21:59:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efee0064e20 0x7efee00672e0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efef40f5440 0x7efef4109980 unknown :-1 s=CLOSED pgs=3342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 --2- 172.21.15.96:0/587505007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efef40f66e0 0x7efef410be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 >> 172.21.15.96:0/587505007 conn(0x7efef40f0ba0 msgr2=0x7efef40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 shutdown_connections 2022-02-02T21:59:51.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.539+0000 7efefa397700 1 -- 172.21.15.96:0/587505007 wait complete. 2022-02-02T21:59:51.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/3317529302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f7980 msgr2=0x7f1cb00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/3317529302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f7980 0x7f1cb00f7de0 secure :-1 s=READY pgs=3343 cs=0 l=1 rev1=1 rx=0x7f1ca0004660 tx=0x7f1ca0009b30).stop 2022-02-02T21:59:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/3317529302 shutdown_connections 2022-02-02T21:59:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/3317529302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f7980 0x7f1cb00f7de0 unknown :-1 s=CLOSED pgs=3343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/3317529302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f66e0 0x7f1cb00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/3317529302 >> 172.21.15.96:0/3317529302 conn(0x7f1cb00f1e40 msgr2=0x7f1cb00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/3317529302 shutdown_connections 2022-02-02T21:59:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/3317529302 wait complete. 2022-02-02T21:59:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.636+0000 7f1cb4a9d700 1 Processor -- start 2022-02-02T21:59:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cb4a9d700 1 -- start start 2022-02-02T21:59:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cb4a9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cb4a9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f7980 0x7f1cb0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cb4a9d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0107a00 con 0x7f1cb00f66e0 2022-02-02T21:59:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cb4a9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0107b40 con 0x7f1cb00f7980 2022-02-02T21:59:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45980/0 (socket says 172.21.15.96:45980) 2022-02-02T21:59:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 -- 172.21.15.96:0/2328583335 learned_addr learned my addr 172.21.15.96:0/2328583335 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cadd9b700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f7980 0x7f1cb0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 -- 172.21.15.96:0/2328583335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f7980 msgr2=0x7f1cb0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f7980 0x7f1cb0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 -- 172.21.15.96:0/2328583335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0005040 con 0x7f1cb00f66e0 2022-02-02T21:59:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.637+0000 7f1cae59c700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 rx=0x7f1ca4002700 tx=0x7f1ca4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.638+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca40079c0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.638+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb01084e0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.638+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ca400f040 con 0x7f1cb00f66e0 2022-02-02T21:59:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.638+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4014860 con 0x7f1cb00f66e0 2022-02-02T21:59:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.638+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0108aa0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.639+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb0045ad0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.639+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ca401b060 con 0x7f1cb00f66e0 2022-02-02T21:59:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.640+0000 7f1c9effd700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.640+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ca40818e0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.644+0000 7f1cadd9b700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.644+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ca4053410 con 0x7f1cb00f66e0 2022-02-02T21:59:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.644+0000 7f1cadd9b700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f1ca0004630 tx=0x7f1ca0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.875+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1cb00ff020 con 0x7f1cb00f66e0 2022-02-02T21:59:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.876+0000 7f1c9effd700 1 -- 172.21.15.96:0/2328583335 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1ca40192e0 con 0x7f1cb00f66e0 2022-02-02T21:59:51.878 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T21:59:51.878 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T21:59:51.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:59:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T21:59:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T21:59:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T21:59:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T21:59:51.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:51.881 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T21:59:51.882 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T21:59:51.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T21:59:51.882 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T21:59:51.883 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T21:59:51.883 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T21:59:51.883 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T21:59:51.884 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T21:59:51.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 msgr2=0x7f1c98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f1ca0004630 tx=0x7f1ca0009b30).stop 2022-02-02T21:59:51.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 msgr2=0x7f1cb0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 rx=0x7f1ca4002700 tx=0x7f1ca4009d80).stop 2022-02-02T21:59:51.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 shutdown_connections 2022-02-02T21:59:51.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c98064dd0 0x7f1c98067290 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cb00f66e0 0x7f1cb0106f60 unknown :-1 s=CLOSED pgs=3344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 --2- 172.21.15.96:0/2328583335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cb00f7980 0x7f1cb0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 >> 172.21.15.96:0/2328583335 conn(0x7f1cb00f1e40 msgr2=0x7f1cb00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 shutdown_connections 2022-02-02T21:59:51.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.878+0000 7f1cb4a9d700 1 -- 172.21.15.96:0/2328583335 wait complete. 2022-02-02T21:59:51.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 -- 172.21.15.96:0/1234544024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f6c60 msgr2=0x7f970c0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 --2- 172.21.15.96:0/1234544024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f6c60 0x7f970c0f7080 secure :-1 s=READY pgs=3345 cs=0 l=1 rev1=1 rx=0x7f9700004660 tx=0x7f9700009b30).stop 2022-02-02T21:59:51.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 -- 172.21.15.96:0/1234544024 shutdown_connections 2022-02-02T21:59:51.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 --2- 172.21.15.96:0/1234544024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f5970 0x7f970c0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 --2- 172.21.15.96:0/1234544024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f6c60 0x7f970c0f7080 unknown :-1 s=CLOSED pgs=3345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 -- 172.21.15.96:0/1234544024 >> 172.21.15.96:0/1234544024 conn(0x7f970c0f04c0 msgr2=0x7f970c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:51.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 -- 172.21.15.96:0/1234544024 shutdown_connections 2022-02-02T21:59:51.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.975+0000 7f97136b3700 1 -- 172.21.15.96:0/1234544024 wait complete. 2022-02-02T21:59:51.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 Processor -- start 2022-02-02T21:59:51.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 -- start start 2022-02-02T21:59:51.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f6c60 0x7f970c10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0f5620 con 0x7f970c0f5970 2022-02-02T21:59:51.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f97136b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0f5760 con 0x7f970c0f6c60 2022-02-02T21:59:51.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45990/0 (socket says 172.21.15.96:45990) 2022-02-02T21:59:51.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 -- 172.21.15.96:0/944889207 learned_addr learned my addr 172.21.15.96:0/944889207 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T21:59:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f9710c4e700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f6c60 0x7f970c10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 -- 172.21.15.96:0/944889207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f6c60 msgr2=0x7f970c10c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f6c60 0x7f970c10c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.976+0000 7f971144f700 1 -- 172.21.15.96:0/944889207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700005040 con 0x7f970c0f5970 2022-02-02T21:59:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f971144f700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 secure :-1 s=READY pgs=3346 cs=0 l=1 rev1=1 rx=0x7f9700009990 tx=0x7f9700009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9700018070 con 0x7f970c0f5970 2022-02-02T21:59:51.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9700007ba0 con 0x7f970c0f5970 2022-02-02T21:59:51.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f970001c3c0 con 0x7f970c0f5970 2022-02-02T21:59:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c10c660 con 0x7f970c0f5970 2022-02-02T21:59:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.977+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c10cb70 con 0x7f970c0f5970 2022-02-02T21:59:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.978+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c045ad0 con 0x7f970c0f5970 2022-02-02T21:59:51.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.978+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f970001d420 con 0x7f970c0f5970 2022-02-02T21:59:51.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.979+0000 7f96fdffb700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 0x7f96f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T21:59:51.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.979+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f97000836a0 con 0x7f970c0f5970 2022-02-02T21:59:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.979+0000 7f9710c4e700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 0x7f96f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T21:59:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.979+0000 7f9710c4e700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 0x7f96f8067290 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f9708004c40 tx=0x7f970800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T21:59:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:51.983+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9700051860 con 0x7f970c0f5970 2022-02-02T21:59:52.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.182+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f970c0fdf80 con 0x7f970c0f5970 2022-02-02T21:59:52.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.183+0000 7f96fdffb700 1 -- 172.21.15.96:0/944889207 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9700054e80 con 0x7f970c0f5970 2022-02-02T21:59:52.185 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T21:59:52.185 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T21:59:52.185 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:59:52.186 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T21:59:52.186 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:52.186 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T21:59:52.187 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T21:59:52.187 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T21:59:52.187 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T21:59:52.188 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T21:59:52.188 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T21:59:52.188 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T21:59:52.189 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T21:59:52.189 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T21:59:52.189 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T21:59:52.190 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T21:59:52.190 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T21:59:52.190 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T21:59:52.191 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T21:59:52.191 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T21:59:52.191 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T21:59:52.192 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T21:59:52.192 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T21:59:52.192 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T21:59:52.193 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T21:59:52.193 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T21:59:52.193 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T21:59:52.194 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T21:59:52.194 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T21:59:52.194 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T21:59:52.195 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T21:59:52.195 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T21:59:52.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:52.196 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:52.196 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T21:59:52.196 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T21:59:52.197 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:52.197 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:52.197 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T21:59:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 msgr2=0x7f96f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 0x7f96f8067290 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f9708004c40 tx=0x7f970800b040).stop 2022-02-02T21:59:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 msgr2=0x7f970c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T21:59:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 secure :-1 s=READY pgs=3346 cs=0 l=1 rev1=1 rx=0x7f9700009990 tx=0x7f9700009b30).stop 2022-02-02T21:59:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 shutdown_connections 2022-02-02T21:59:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f8064dd0 0x7f96f8067290 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5970 0x7f970c109c10 unknown :-1 s=CLOSED pgs=3346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 --2- 172.21.15.96:0/944889207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f6c60 0x7f970c10c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T21:59:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 >> 172.21.15.96:0/944889207 conn(0x7f970c0f04c0 msgr2=0x7f970c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T21:59:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 shutdown_connections 2022-02-02T21:59:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T21:59:52.185+0000 7f97136b3700 1 -- 172.21.15.96:0/944889207 wait complete. 2022-02-02T21:59:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T21:59:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:52 smithi159 ceph-mon[69013]: pgmap v6532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:52 smithi159 ceph-mon[69013]: from='client.40796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:52 smithi159 ceph-mon[69013]: from='client.40800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:52.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2328583335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:59:52.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/944889207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:59:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:52 smithi096 ceph-mon[101353]: pgmap v6532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:52 smithi096 ceph-mon[101353]: from='client.40796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:52 smithi096 ceph-mon[101353]: from='client.40800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T21:59:52.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2328583335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T21:59:52.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/944889207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T21:59:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:54 smithi159 ceph-mon[69013]: pgmap v6533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:54 smithi096 ceph-mon[101353]: pgmap v6533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:56 smithi159 ceph-mon[69013]: pgmap v6534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:56 smithi096 ceph-mon[101353]: pgmap v6534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 21:59:58 smithi159 ceph-mon[69013]: pgmap v6535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T21:59:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 21:59:58 smithi096 ceph-mon[101353]: pgmap v6535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:00 smithi159 ceph-mon[69013]: pgmap v6536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:00:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:00 smithi096 ceph-mon[101353]: pgmap v6536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:00:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:02 smithi159 ceph-mon[69013]: pgmap v6537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:02 smithi096 ceph-mon[101353]: pgmap v6537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:04 smithi159 ceph-mon[69013]: pgmap v6538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:04 smithi096 ceph-mon[101353]: pgmap v6538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:06 smithi159 ceph-mon[69013]: pgmap v6539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:06 smithi096 ceph-mon[101353]: pgmap v6539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:08 smithi159 ceph-mon[69013]: pgmap v6540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:08 smithi096 ceph-mon[101353]: pgmap v6540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:10 smithi159 ceph-mon[69013]: pgmap v6541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:10 smithi096 ceph-mon[101353]: pgmap v6541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:12 smithi159 ceph-mon[69013]: pgmap v6542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:12 smithi096 ceph-mon[101353]: pgmap v6542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:14 smithi159 ceph-mon[69013]: pgmap v6543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:14 smithi096 ceph-mon[101353]: pgmap v6543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:16 smithi159 ceph-mon[69013]: pgmap v6544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:16 smithi096 ceph-mon[101353]: pgmap v6544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:18 smithi159 ceph-mon[69013]: pgmap v6545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:18 smithi096 ceph-mon[101353]: pgmap v6545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:20 smithi159 ceph-mon[69013]: pgmap v6546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:20 smithi096 ceph-mon[101353]: pgmap v6546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:22.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 -- 172.21.15.96:0/640804313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 msgr2=0x7f1d280f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 --2- 172.21.15.96:0/640804313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d280f63e0 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 rx=0x7f1d14004660 tx=0x7f1d14009b30).stop 2022-02-02T22:00:22.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 -- 172.21.15.96:0/640804313 shutdown_connections 2022-02-02T22:00:22.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 --2- 172.21.15.96:0/640804313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d280f63e0 unknown :-1 s=CLOSED pgs=3347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 --2- 172.21.15.96:0/640804313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 0x7f1d280f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:00:22.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 -- 172.21.15.96:0/640804313 >> 172.21.15.96:0/640804313 conn(0x7f1d280f04c0 msgr2=0x7f1d280f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:22.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 -- 172.21.15.96:0/640804313 shutdown_connections 2022-02-02T22:00:22.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 -- 172.21.15.96:0/640804313 wait complete. 2022-02-02T22:00:22.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.297+0000 7f1d2f061700 1 Processor -- start 2022-02-02T22:00:22.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2f061700 1 -- start start 2022-02-02T22:00:22.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2f061700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 0x7f1d28106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2f061700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2f061700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28107a80 con 0x7f1d280f5f60 2022-02-02T22:00:22.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2f061700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28108330 con 0x7f1d280f4d60 2022-02-02T22:00:22.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46010/0 (socket says 172.21.15.96:46010) 2022-02-02T22:00:22.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 -- 172.21.15.96:0/1358770023 learned_addr learned my addr 172.21.15.96:0/1358770023 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:22.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d2cdfd700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 0x7f1d28106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 -- 172.21.15.96:0/1358770023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 msgr2=0x7f1d28106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 0x7f1d28106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.298+0000 7f1d27fff700 1 -- 172.21.15.96:0/1358770023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14005040 con 0x7f1d280f5f60 2022-02-02T22:00:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d27fff700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 rx=0x7f1d14009990 tx=0x7f1d14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d14018070 con 0x7f1d280f5f60 2022-02-02T22:00:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d14007ba0 con 0x7f1d280f5f60 2022-02-02T22:00:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d281085b0 con 0x7f1d280f5f60 2022-02-02T22:00:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1401c620 con 0x7f1d280f5f60 2022-02-02T22:00:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.299+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d28108b10 con 0x7f1d280f5f60 2022-02-02T22:00:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.300+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d280f4150 con 0x7f1d280f5f60 2022-02-02T22:00:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.300+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1d1401c890 con 0x7f1d280f5f60 2022-02-02T22:00:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.301+0000 7f1d257fa700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 0x7f1d18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.301+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1d140837c0 con 0x7f1d280f5f60 2022-02-02T22:00:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.301+0000 7f1d2cdfd700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 0x7f1d18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.301+0000 7f1d2cdfd700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 0x7f1d18067290 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f1d1c006fd0 tx=0x7f1d1c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.305+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1d140552f0 con 0x7f1d280f5f60 2022-02-02T22:00:22.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.484+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d280fd630 con 0x7f1d18064dd0 2022-02-02T22:00:22.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.485+0000 7f1d257fa700 1 -- 172.21.15.96:0/1358770023 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1d280fd630 con 0x7f1d18064dd0 2022-02-02T22:00:22.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 msgr2=0x7f1d18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 0x7f1d18067290 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f1d1c006fd0 tx=0x7f1d1c008040).stop 2022-02-02T22:00:22.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 msgr2=0x7f1d28107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 rx=0x7f1d14009990 tx=0x7f1d14009b30).stop 2022-02-02T22:00:22.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 shutdown_connections 2022-02-02T22:00:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d18064dd0 0x7f1d18067290 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d280f4d60 0x7f1d28106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 --2- 172.21.15.96:0/1358770023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d280f5f60 0x7f1d28107440 unknown :-1 s=CLOSED pgs=3348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 >> 172.21.15.96:0/1358770023 conn(0x7f1d280f04c0 msgr2=0x7f1d280fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 shutdown_connections 2022-02-02T22:00:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.487+0000 7f1d2f061700 1 -- 172.21.15.96:0/1358770023 wait complete. 2022-02-02T22:00:22.497 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:00:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:22 smithi096 ceph-mon[101353]: pgmap v6547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:22.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 -- 172.21.15.96:0/2647818474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f5bb0 msgr2=0x7ff1d80f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 --2- 172.21.15.96:0/2647818474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d80f5fd0 secure :-1 s=READY pgs=3349 cs=0 l=1 rev1=1 rx=0x7ff1cc004660 tx=0x7ff1cc009b30).stop 2022-02-02T22:00:22.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 -- 172.21.15.96:0/2647818474 shutdown_connections 2022-02-02T22:00:22.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 --2- 172.21.15.96:0/2647818474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f6550 0x7ff1d80f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:00:22.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 --2- 172.21.15.96:0/2647818474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d80f5fd0 unknown :-1 s=CLOSED pgs=3349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 -- 172.21.15.96:0/2647818474 >> 172.21.15.96:0/2647818474 conn(0x7ff1d80f04c0 msgr2=0x7ff1d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:22.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 -- 172.21.15.96:0/2647818474 shutdown_connections 2022-02-02T22:00:22.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.585+0000 7ff1deb84700 1 -- 172.21.15.96:0/2647818474 wait complete. 2022-02-02T22:00:22.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 Processor -- start 2022-02-02T22:00:22.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 -- start start 2022-02-02T22:00:22.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d8105f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d8106a80 con 0x7ff1d80f6550 2022-02-02T22:00:22.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1deb84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d8107330 con 0x7ff1d80f5bb0 2022-02-02T22:00:22.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46018/0 (socket says 172.21.15.96:46018) 2022-02-02T22:00:22.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1d7fff700 1 -- 172.21.15.96:0/3910282282 learned_addr learned my addr 172.21.15.96:0/3910282282 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:22.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.586+0000 7ff1dc920700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d8105f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d7fff700 1 -- 172.21.15.96:0/3910282282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f5bb0 msgr2=0x7ff1d8105f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d7fff700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d8105f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d7fff700 1 -- 172.21.15.96:0/3910282282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc005040 con 0x7ff1d80f6550 2022-02-02T22:00:22.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d7fff700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 secure :-1 s=READY pgs=3350 cs=0 l=1 rev1=1 rx=0x7ff1c400b410 tx=0x7ff1c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1c40125f0 con 0x7ff1d80f6550 2022-02-02T22:00:22.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff1c400be30 con 0x7ff1d80f6550 2022-02-02T22:00:22.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d8107610 con 0x7ff1d80f6550 2022-02-02T22:00:22.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1c4002a70 con 0x7ff1d80f6550 2022-02-02T22:00:22.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.587+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d8107bd0 con 0x7ff1d80f6550 2022-02-02T22:00:22.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.588+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d80f4150 con 0x7ff1d80f6550 2022-02-02T22:00:22.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.588+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff1c400f030 con 0x7ff1d80f6550 2022-02-02T22:00:22.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.589+0000 7ff1d57fa700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 0x7ff1c806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.589+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff1c4081dd0 con 0x7ff1d80f6550 2022-02-02T22:00:22.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.589+0000 7ff1dc920700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 0x7ff1c806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.589+0000 7ff1dc920700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 0x7ff1c806b6a0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff1cc004580 tx=0x7ff1cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.593+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff1c40539e0 con 0x7ff1d80f6550 2022-02-02T22:00:22.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.766+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1d80f48e0 con 0x7ff1c80691e0 2022-02-02T22:00:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:22 smithi159 ceph-mon[69013]: pgmap v6547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:22.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.775+0000 7ff1d57fa700 1 -- 172.21.15.96:0/3910282282 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff1d80f48e0 con 0x7ff1c80691e0 2022-02-02T22:00:22.775 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:00:22.776 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:00:22.776 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:00:22.776 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:00:22.777 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:00:22.777 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:00:22.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:00:22.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:00:22.778 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:00:22.779 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:00:22.779 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:00:22.780 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:00:22.780 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:00:22.780 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:00:22.781 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:00:22.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:00:22.781 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:00:22.782 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:00:22.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:00:22.783 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:00:22.784 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:00:22.784 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:00:22.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 msgr2=0x7ff1c806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 0x7ff1c806b6a0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff1cc004580 tx=0x7ff1cc009b30).stop 2022-02-02T22:00:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 msgr2=0x7ff1d8106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 secure :-1 s=READY pgs=3350 cs=0 l=1 rev1=1 rx=0x7ff1c400b410 tx=0x7ff1c4006ef0).stop 2022-02-02T22:00:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 shutdown_connections 2022-02-02T22:00:22.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff1c80691e0 0x7ff1c806b6a0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1d80f5bb0 0x7ff1d8105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 --2- 172.21.15.96:0/3910282282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d80f6550 0x7ff1d8106440 unknown :-1 s=CLOSED pgs=3350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 >> 172.21.15.96:0/3910282282 conn(0x7ff1d80f04c0 msgr2=0x7ff1d80fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:22.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 shutdown_connections 2022-02-02T22:00:22.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.777+0000 7ff1deb84700 1 -- 172.21.15.96:0/3910282282 wait complete. 2022-02-02T22:00:22.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 -- 172.21.15.96:0/3477802490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 msgr2=0x7f39780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 --2- 172.21.15.96:0/3477802490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f39780f6b00 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 rx=0x7f3968004660 tx=0x7f3968009b30).stop 2022-02-02T22:00:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 -- 172.21.15.96:0/3477802490 shutdown_connections 2022-02-02T22:00:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 --2- 172.21.15.96:0/3477802490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39780f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 --2- 172.21.15.96:0/3477802490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f39780f6b00 unknown :-1 s=CLOSED pgs=3351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 -- 172.21.15.96:0/3477802490 >> 172.21.15.96:0/3477802490 conn(0x7f39780f1f00 msgr2=0x7f39780f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 -- 172.21.15.96:0/3477802490 shutdown_connections 2022-02-02T22:00:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.874+0000 7f397d527700 1 -- 172.21.15.96:0/3477802490 wait complete. 2022-02-02T22:00:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 Processor -- start 2022-02-02T22:00:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 -- start start 2022-02-02T22:00:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39781073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39781079a0 con 0x7f39780f66e0 2022-02-02T22:00:22.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.875+0000 7f397d527700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978107ae0 con 0x7f39780f6ff0 2022-02-02T22:00:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46026/0 (socket says 172.21.15.96:46026) 2022-02-02T22:00:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 -- 172.21.15.96:0/3549917160 learned_addr learned my addr 172.21.15.96:0/3549917160 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f39767fc700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39781073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 -- 172.21.15.96:0/3549917160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 msgr2=0x7f39781073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39781073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 -- 172.21.15.96:0/3549917160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968005040 con 0x7f39780f66e0 2022-02-02T22:00:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f39767fc700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39781073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:00:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f3976ffd700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 rx=0x7f3968009990 tx=0x7f3968009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3968018070 con 0x7f39780f66e0 2022-02-02T22:00:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f397d527700 1 -- 172.21.15.96:0/3549917160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3978108420 con 0x7f39780f66e0 2022-02-02T22:00:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3968007ba0 con 0x7f39780f66e0 2022-02-02T22:00:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396801c3c0 con 0x7f39780f66e0 2022-02-02T22:00:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.876+0000 7f397d527700 1 -- 172.21.15.96:0/3549917160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3978108980 con 0x7f39780f66e0 2022-02-02T22:00:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.878+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3950004fa0 con 0x7f39780f66e0 2022-02-02T22:00:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.878+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f396801d420 con 0x7f39780f66e0 2022-02-02T22:00:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.879+0000 7f395f7fe700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.879+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3968083600 con 0x7f39780f66e0 2022-02-02T22:00:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.879+0000 7f39767fc700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.879+0000 7f39767fc700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f396c009880 tx=0x7f396c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:22.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:22.883+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39680551f0 con 0x7f39780f66e0 2022-02-02T22:00:23.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.113+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3950005e80 con 0x7f39780f66e0 2022-02-02T22:00:23.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.114+0000 7f395f7fe700 1 -- 172.21.15.96:0/3549917160 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3968054de0 con 0x7f39780f66e0 2022-02-02T22:00:23.114 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:00:23.115 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:00:23.115 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:00:23.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:23.116 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:00:23.116 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:00:23.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:23.117 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:00:23.117 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:00:23.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:23.118 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:00:23.119 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:00:23.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:23.119 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:00:23.120 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:00:23.120 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:00:23.120 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:00:23.121 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:00:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.115+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 msgr2=0x7f3960067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f396c009880 tx=0x7f396c00b040).stop 2022-02-02T22:00:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 msgr2=0x7f3978106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 rx=0x7f3968009990 tx=0x7f3968009b30).stop 2022-02-02T22:00:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 shutdown_connections 2022-02-02T22:00:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3960064dd0 0x7f3960067290 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39780f66e0 0x7f3978106f00 unknown :-1 s=CLOSED pgs=3352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 --2- 172.21.15.96:0/3549917160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39780f6ff0 0x7f39781073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 >> 172.21.15.96:0/3549917160 conn(0x7f39780f1f00 msgr2=0x7f39780fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 shutdown_connections 2022-02-02T22:00:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.116+0000 7f395d7fa700 1 -- 172.21.15.96:0/3549917160 wait complete. 2022-02-02T22:00:23.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 -- 172.21.15.96:0/2141140249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f6860 msgr2=0x7f8cd40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/2141140249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f6860 0x7f8cd40f6cc0 secure :-1 s=READY pgs=3353 cs=0 l=1 rev1=1 rx=0x7f8cd0004660 tx=0x7f8cd0009b30).stop 2022-02-02T22:00:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 -- 172.21.15.96:0/2141140249 shutdown_connections 2022-02-02T22:00:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/2141140249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f6860 0x7f8cd40f6cc0 unknown :-1 s=CLOSED pgs=3353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/2141140249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f55c0 0x7f8cd40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 -- 172.21.15.96:0/2141140249 >> 172.21.15.96:0/2141140249 conn(0x7f8cd40f0d40 msgr2=0x7f8cd40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:23.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 -- 172.21.15.96:0/2141140249 shutdown_connections 2022-02-02T22:00:23.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.212+0000 7f8cdbacc700 1 -- 172.21.15.96:0/2141140249 wait complete. 2022-02-02T22:00:23.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 Processor -- start 2022-02-02T22:00:23.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 -- start start 2022-02-02T22:00:23.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:23.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f6860 0x7f8cd410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:23.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40603e0 con 0x7f8cd40f55c0 2022-02-02T22:00:23.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cdbacc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4060520 con 0x7f8cd40f6860 2022-02-02T22:00:23.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cd9868700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:23.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cd9868700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46036/0 (socket says 172.21.15.96:46036) 2022-02-02T22:00:23.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cd9868700 1 -- 172.21.15.96:0/808138552 learned_addr learned my addr 172.21.15.96:0/808138552 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:23.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.213+0000 7f8cd9067700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f6860 0x7f8cd410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:23.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cd9868700 1 -- 172.21.15.96:0/808138552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f6860 msgr2=0x7f8cd410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cd9868700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f6860 0x7f8cd410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cd9868700 1 -- 172.21.15.96:0/808138552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0005040 con 0x7f8cd40f55c0 2022-02-02T22:00:23.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cd9868700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 rx=0x7f8cc400c530 tx=0x7f8cc4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:23.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc400f650 con 0x7f8cd40f55c0 2022-02-02T22:00:23.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8cc400fc60 con 0x7f8cd40f55c0 2022-02-02T22:00:23.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd410c700 con 0x7f8cd40f55c0 2022-02-02T22:00:23.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc4012cb0 con 0x7f8cd40f55c0 2022-02-02T22:00:23.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.214+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd410ccc0 con 0x7f8cd40f55c0 2022-02-02T22:00:23.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.215+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4045ad0 con 0x7f8cd40f55c0 2022-02-02T22:00:23.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.215+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8cc4019030 con 0x7f8cd40f55c0 2022-02-02T22:00:23.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.216+0000 7f8cca7fc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:23.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.216+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8cc4081630 con 0x7f8cd40f55c0 2022-02-02T22:00:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.216+0000 7f8cd9067700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.216+0000 7f8cd9067700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f8cd0004630 tx=0x7f8cd0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.220+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8cc404f7e0 con 0x7f8cd40f55c0 2022-02-02T22:00:23.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.427+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8cd4027a00 con 0x7f8cd40f55c0 2022-02-02T22:00:23.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.427+0000 7f8cca7fc700 1 -- 172.21.15.96:0/808138552 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8cc4017070 con 0x7f8cd40f55c0 2022-02-02T22:00:23.429 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:00:23.430 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:00:23.430 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:00:23.431 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:00:23.431 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:23.432 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:00:23.433 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:00:23.433 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:00:23.434 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:00:23.434 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:00:23.434 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:00:23.435 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:00:23.435 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:00:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:00:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:00:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:00:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:00:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:00:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:00:23.438 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:00:23.438 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:00:23.438 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:00:23.439 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:00:23.439 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:00:23.440 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:00:23.440 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:00:23.441 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:00:23.441 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:00:23.442 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:00:23.442 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:00:23.442 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:00:23.443 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:00:23.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:23.444 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:23.444 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:00:23.445 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:23.445 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:23.445 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:23.446 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:23.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 msgr2=0x7f8cc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f8cd0004630 tx=0x7f8cd0009b30).stop 2022-02-02T22:00:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 msgr2=0x7f8cd4109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 rx=0x7f8cc400c530 tx=0x7f8cc4007e10).stop 2022-02-02T22:00:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 shutdown_connections 2022-02-02T22:00:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8cc0064dd0 0x7f8cc0067290 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8cd40f55c0 0x7f8cd4109c50 unknown :-1 s=CLOSED pgs=3354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 --2- 172.21.15.96:0/808138552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd40f6860 0x7f8cd410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 >> 172.21.15.96:0/808138552 conn(0x7f8cd40f0d40 msgr2=0x7f8cd40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 shutdown_connections 2022-02-02T22:00:23.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:23.429+0000 7f8cdbacc700 1 -- 172.21.15.96:0/808138552 wait complete. 2022-02-02T22:00:23.452 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:00:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:23 smithi096 ceph-mon[101353]: from='client.40812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3549917160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:00:23.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:23 smithi159 ceph-mon[69013]: from='client.40812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:23.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3549917160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:00:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:24 smithi159 ceph-mon[69013]: pgmap v6548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:24 smithi159 ceph-mon[69013]: from='client.40816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/808138552' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:00:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:24 smithi096 ceph-mon[101353]: pgmap v6548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:24 smithi096 ceph-mon[101353]: from='client.40816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/808138552' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:00:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:26 smithi159 ceph-mon[69013]: pgmap v6549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:26 smithi096 ceph-mon[101353]: pgmap v6549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:28 smithi159 ceph-mon[69013]: pgmap v6550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:00:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:00:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:28 smithi096 ceph-mon[101353]: pgmap v6550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:00:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:00:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:30 smithi159 ceph-mon[69013]: pgmap v6551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:30 smithi096 ceph-mon[101353]: pgmap v6551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:32 smithi159 ceph-mon[69013]: pgmap v6552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:32 smithi096 ceph-mon[101353]: pgmap v6552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:34 smithi159 ceph-mon[69013]: pgmap v6553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:34 smithi096 ceph-mon[101353]: pgmap v6553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:36 smithi159 ceph-mon[69013]: pgmap v6554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:36 smithi096 ceph-mon[101353]: pgmap v6554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:38 smithi159 ceph-mon[69013]: pgmap v6555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:38 smithi096 ceph-mon[101353]: pgmap v6555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:40 smithi159 ceph-mon[69013]: pgmap v6556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:40 smithi096 ceph-mon[101353]: pgmap v6556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:42 smithi159 ceph-mon[69013]: pgmap v6557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:42 smithi096 ceph-mon[101353]: pgmap v6557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:44 smithi159 ceph-mon[69013]: pgmap v6558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:44 smithi096 ceph-mon[101353]: pgmap v6558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:46 smithi159 ceph-mon[69013]: pgmap v6559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:46 smithi096 ceph-mon[101353]: pgmap v6559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:48 smithi159 ceph-mon[69013]: pgmap v6560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:48 smithi096 ceph-mon[101353]: pgmap v6560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:50 smithi159 ceph-mon[69013]: pgmap v6561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:50.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:50 smithi096 ceph-mon[101353]: pgmap v6561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:52 smithi159 ceph-mon[69013]: pgmap v6562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:52 smithi096 ceph-mon[101353]: pgmap v6562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 -- 172.21.15.96:0/3549342760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f6860 msgr2=0x7f2ca80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 --2- 172.21.15.96:0/3549342760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f6860 0x7f2ca80f6cc0 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 rx=0x7f2c98004660 tx=0x7f2c98009b30).stop 2022-02-02T22:00:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 -- 172.21.15.96:0/3549342760 shutdown_connections 2022-02-02T22:00:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 --2- 172.21.15.96:0/3549342760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f6860 0x7f2ca80f6cc0 unknown :-1 s=CLOSED pgs=3355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 --2- 172.21.15.96:0/3549342760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f55c0 0x7f2ca80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 -- 172.21.15.96:0/3549342760 >> 172.21.15.96:0/3549342760 conn(0x7f2ca80f0d40 msgr2=0x7f2ca80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:53.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 -- 172.21.15.96:0/3549342760 shutdown_connections 2022-02-02T22:00:53.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.538+0000 7f2cae454700 1 -- 172.21.15.96:0/3549342760 wait complete. 2022-02-02T22:00:53.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 Processor -- start 2022-02-02T22:00:53.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 -- start start 2022-02-02T22:00:53.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 0x7f2ca8068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8060510 con 0x7f2ca80f55c0 2022-02-02T22:00:53.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2cae454700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8068e00 con 0x7f2ca80f6860 2022-02-02T22:00:53.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46052/0 (socket says 172.21.15.96:46052) 2022-02-02T22:00:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2ca7fff700 1 -- 172.21.15.96:0/3041542643 learned_addr learned my addr 172.21.15.96:0/3041542643 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:53.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.539+0000 7f2ca77fe700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 0x7f2ca8068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca7fff700 1 -- 172.21.15.96:0/3041542643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 msgr2=0x7f2ca8068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca7fff700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 0x7f2ca8068910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca7fff700 1 -- 172.21.15.96:0/3041542643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98005040 con 0x7f2ca80f55c0 2022-02-02T22:00:53.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca77fe700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 0x7f2ca8068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:00:53.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca7fff700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 rx=0x7f2c9c00c530 tx=0x7f2c9c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:53.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9c00f650 con 0x7f2ca80f55c0 2022-02-02T22:00:53.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80690e0 con 0x7f2ca80f55c0 2022-02-02T22:00:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c9c00fc60 con 0x7f2ca80f55c0 2022-02-02T22:00:53.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9c012d20 con 0x7f2ca80f55c0 2022-02-02T22:00:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.540+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca80696a0 con 0x7f2ca80f55c0 2022-02-02T22:00:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.541+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca80f49b0 con 0x7f2ca80f55c0 2022-02-02T22:00:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.541+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c9c019030 con 0x7f2ca80f55c0 2022-02-02T22:00:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.542+0000 7f2ca4ff9700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 0x7f2c90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.542+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c9c081770 con 0x7f2ca80f55c0 2022-02-02T22:00:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.542+0000 7f2ca77fe700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 0x7f2c90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.542+0000 7f2ca77fe700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 0x7f2c90067290 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f2c98004e30 tx=0x7f2c98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.546+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c9c04f800 con 0x7f2ca80f55c0 2022-02-02T22:00:53.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.727+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ca80008d0 con 0x7f2c90064dd0 2022-02-02T22:00:53.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.729+0000 7f2ca4ff9700 1 -- 172.21.15.96:0/3041542643 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2ca80008d0 con 0x7f2c90064dd0 2022-02-02T22:00:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.730+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 msgr2=0x7f2c90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.730+0000 7f2cae454700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 0x7f2c90067290 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f2c98004e30 tx=0x7f2c98009b30).stop 2022-02-02T22:00:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.730+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 msgr2=0x7f2ca805ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.730+0000 7f2cae454700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 rx=0x7f2c9c00c530 tx=0x7f2c9c007e10).stop 2022-02-02T22:00:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 shutdown_connections 2022-02-02T22:00:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c90064dd0 0x7f2c90067290 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ca80f55c0 0x7f2ca805ff10 unknown :-1 s=CLOSED pgs=3356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 --2- 172.21.15.96:0/3041542643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca80f6860 0x7f2ca8068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 >> 172.21.15.96:0/3041542643 conn(0x7f2ca80f0d40 msgr2=0x7f2ca80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:53.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 shutdown_connections 2022-02-02T22:00:53.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.731+0000 7f2cae454700 1 -- 172.21.15.96:0/3041542643 wait complete. 2022-02-02T22:00:53.740 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:00:53.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 -- 172.21.15.96:0/2597679907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 msgr2=0x7f0e080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 --2- 172.21.15.96:0/2597679907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e080f6cc0 secure :-1 s=READY pgs=3357 cs=0 l=1 rev1=1 rx=0x7f0e04004660 tx=0x7f0e04009b30).stop 2022-02-02T22:00:53.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 -- 172.21.15.96:0/2597679907 shutdown_connections 2022-02-02T22:00:53.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 --2- 172.21.15.96:0/2597679907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e080f6cc0 unknown :-1 s=CLOSED pgs=3357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 --2- 172.21.15.96:0/2597679907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 0x7f0e080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 -- 172.21.15.96:0/2597679907 >> 172.21.15.96:0/2597679907 conn(0x7f0e080f0d40 msgr2=0x7f0e080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:53.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 -- 172.21.15.96:0/2597679907 shutdown_connections 2022-02-02T22:00:53.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.828+0000 7f0e102cd700 1 -- 172.21.15.96:0/2597679907 wait complete. 2022-02-02T22:00:53.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 Processor -- start 2022-02-02T22:00:53.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 -- start start 2022-02-02T22:00:53.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 0x7f0e08106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08107a10 con 0x7f0e080f6860 2022-02-02T22:00:53.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e102cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08107b50 con 0x7f0e080f55c0 2022-02-02T22:00:53.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46064/0 (socket says 172.21.15.96:46064) 2022-02-02T22:00:53.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 -- 172.21.15.96:0/1619673222 learned_addr learned my addr 172.21.15.96:0/1619673222 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:53.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0e069700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 0x7f0e08106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 -- 172.21.15.96:0/1619673222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 msgr2=0x7f0e08106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:53.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 0x7f0e08106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:53.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 -- 172.21.15.96:0/1619673222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04005040 con 0x7f0e080f6860 2022-02-02T22:00:53.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.829+0000 7f0e0d868700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 rx=0x7f0e04009990 tx=0x7f0e04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:53.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.830+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e04018070 con 0x7f0e080f6860 2022-02-02T22:00:53.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.830+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e04007ca0 con 0x7f0e080f6860 2022-02-02T22:00:53.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.830+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0401c620 con 0x7f0e080f6860 2022-02-02T22:00:53.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.830+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e08108490 con 0x7f0e080f6860 2022-02-02T22:00:53.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.830+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e081089a0 con 0x7f0e080f6860 2022-02-02T22:00:53.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.831+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e08045ad0 con 0x7f0e080f6860 2022-02-02T22:00:53.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.831+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e0401d960 con 0x7f0e080f6860 2022-02-02T22:00:53.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.831+0000 7f0dfeffd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 0x7f0df4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:53.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.831+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e040837e0 con 0x7f0e080f6860 2022-02-02T22:00:53.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.832+0000 7f0e0e069700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 0x7f0df4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:53.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.832+0000 7f0e0e069700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 0x7f0df4067290 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f0e080f66c0 tx=0x7f0df8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:53.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:53.836+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e040553d0 con 0x7f0e080f6860 2022-02-02T22:00:54.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.008+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e080faca0 con 0x7f0df4064dd0 2022-02-02T22:00:54.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.018+0000 7f0dfeffd700 1 -- 172.21.15.96:0/1619673222 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0e080faca0 con 0x7f0df4064dd0 2022-02-02T22:00:54.018 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:00:54.018 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:00:54.019 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:00:54.019 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:00:54.019 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:00:54.020 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:00:54.020 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:00:54.020 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:00:54.021 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:00:54.021 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:00:54.021 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:00:54.022 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:00:54.022 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:00:54.022 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:00:54.023 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:00:54.023 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:00:54.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:00:54.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:00:54.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:00:54.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:00:54.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:00:54.025 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:00:54.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 msgr2=0x7f0df4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 0x7f0df4067290 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f0e080f66c0 tx=0x7f0df8009040).stop 2022-02-02T22:00:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 msgr2=0x7f0e08107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 rx=0x7f0e04009990 tx=0x7f0e04009b30).stop 2022-02-02T22:00:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 shutdown_connections 2022-02-02T22:00:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0df4064dd0 0x7f0df4067290 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e080f55c0 0x7f0e08106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 --2- 172.21.15.96:0/1619673222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e080f6860 0x7f0e08107460 unknown :-1 s=CLOSED pgs=3358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.020+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 >> 172.21.15.96:0/1619673222 conn(0x7f0e080f0d40 msgr2=0x7f0e0805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.021+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 shutdown_connections 2022-02-02T22:00:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.021+0000 7f0e102cd700 1 -- 172.21.15.96:0/1619673222 wait complete. 2022-02-02T22:00:54.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 -- 172.21.15.96:0/2075408031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 msgr2=0x7f54700f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 --2- 172.21.15.96:0/2075408031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f54700f6cc0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 rx=0x7f545c004660 tx=0x7f545c009b30).stop 2022-02-02T22:00:54.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 -- 172.21.15.96:0/2075408031 shutdown_connections 2022-02-02T22:00:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 --2- 172.21.15.96:0/2075408031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f54700f6cc0 unknown :-1 s=CLOSED pgs=3359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 --2- 172.21.15.96:0/2075408031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 0x7f54700f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 -- 172.21.15.96:0/2075408031 >> 172.21.15.96:0/2075408031 conn(0x7f54700f0d40 msgr2=0x7f54700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 -- 172.21.15.96:0/2075408031 shutdown_connections 2022-02-02T22:00:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.117+0000 7f5476b1f700 1 -- 172.21.15.96:0/2075408031 wait complete. 2022-02-02T22:00:54.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 Processor -- start 2022-02-02T22:00:54.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 -- start start 2022-02-02T22:00:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 0x7f547010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700602b0 con 0x7f54700f6860 2022-02-02T22:00:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f5476b1f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700603f0 con 0x7f54700f55c0 2022-02-02T22:00:54.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f546ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f546ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46074/0 (socket says 172.21.15.96:46074) 2022-02-02T22:00:54.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f546ffff700 1 -- 172.21.15.96:0/3469978543 learned_addr learned my addr 172.21.15.96:0/3469978543 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:54.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.118+0000 7f54748bb700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 0x7f547010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546ffff700 1 -- 172.21.15.96:0/3469978543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 msgr2=0x7f547010c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546ffff700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 0x7f547010c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546ffff700 1 -- 172.21.15.96:0/3469978543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f54700f6860 2022-02-02T22:00:54.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546ffff700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 rx=0x7f545c009990 tx=0x7f545c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:54.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c018070 con 0x7f54700f6860 2022-02-02T22:00:54.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547010ea60 con 0x7f54700f6860 2022-02-02T22:00:54.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f545c007ba0 con 0x7f54700f6860 2022-02-02T22:00:54.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c01c3c0 con 0x7f54700f6860 2022-02-02T22:00:54.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.119+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547010ee30 con 0x7f54700f6860 2022-02-02T22:00:54.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.120+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5470045ad0 con 0x7f54700f6860 2022-02-02T22:00:54.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.120+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f545c01d420 con 0x7f54700f6860 2022-02-02T22:00:54.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.121+0000 7f546d7fa700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 0x7f5460067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.121+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f545c0836c0 con 0x7f54700f6860 2022-02-02T22:00:54.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.121+0000 7f54748bb700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 0x7f5460067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.121+0000 7f54748bb700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 0x7f5460067290 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f5470060040 tx=0x7f546400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:54.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.125+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f545c0517c0 con 0x7f54700f6860 2022-02-02T22:00:54.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.356+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5470027a00 con 0x7f54700f6860 2022-02-02T22:00:54.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.357+0000 7f546d7fa700 1 -- 172.21.15.96:0/3469978543 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f545c054de0 con 0x7f54700f6860 2022-02-02T22:00:54.358 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:00:54.358 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:00:54.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:00:54.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:54.359 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:00:54.359 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:00:54.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:54.360 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:00:54.360 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:00:54.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:54.361 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:00:54.361 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:00:54.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:00:54.362 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:00:54.362 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:00:54.363 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:00:54.363 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:00:54.363 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:00:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 msgr2=0x7f5460067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 0x7f5460067290 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f5470060040 tx=0x7f546400b040).stop 2022-02-02T22:00:54.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 msgr2=0x7f547010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 rx=0x7f545c009990 tx=0x7f545c009b30).stop 2022-02-02T22:00:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 shutdown_connections 2022-02-02T22:00:54.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5460064dd0 0x7f5460067290 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54700f55c0 0x7f547010c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 --2- 172.21.15.96:0/3469978543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54700f6860 0x7f547010e570 unknown :-1 s=CLOSED pgs=3360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 >> 172.21.15.96:0/3469978543 conn(0x7f54700f0d40 msgr2=0x7f54700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 shutdown_connections 2022-02-02T22:00:54.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.359+0000 7f5476b1f700 1 -- 172.21.15.96:0/3469978543 wait complete. 2022-02-02T22:00:54.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.457+0000 7f9c15a83700 1 -- 172.21.15.96:0/4182124561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c100f66e0 msgr2=0x7f9c100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.457+0000 7f9c15a83700 1 --2- 172.21.15.96:0/4182124561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c100f66e0 0x7f9c100f6b00 secure :-1 s=READY pgs=3361 cs=0 l=1 rev1=1 rx=0x7f9c04004660 tx=0x7f9c04009b30).stop 2022-02-02T22:00:54.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 -- 172.21.15.96:0/4182124561 shutdown_connections 2022-02-02T22:00:54.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 --2- 172.21.15.96:0/4182124561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 0x7f9c100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 --2- 172.21.15.96:0/4182124561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c100f66e0 0x7f9c100f6b00 unknown :-1 s=CLOSED pgs=3361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 -- 172.21.15.96:0/4182124561 >> 172.21.15.96:0/4182124561 conn(0x7f9c100f1e40 msgr2=0x7f9c100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 -- 172.21.15.96:0/4182124561 shutdown_connections 2022-02-02T22:00:54.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 -- 172.21.15.96:0/4182124561 wait complete. 2022-02-02T22:00:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 Processor -- start 2022-02-02T22:00:54.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.458+0000 7f9c15a83700 1 -- start start 2022-02-02T22:00:54.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 0x7f9c101070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10107ab0 con 0x7f9c101075e0 2022-02-02T22:00:54.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10107bf0 con 0x7f9c100f7980 2022-02-02T22:00:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46084/0 (socket says 172.21.15.96:46084) 2022-02-02T22:00:54.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 -- 172.21.15.96:0/134235655 learned_addr learned my addr 172.21.15.96:0/134235655 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:00:54.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0f7fe700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 0x7f9c101070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 -- 172.21.15.96:0/134235655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 msgr2=0x7f9c101070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 0x7f9c101070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 -- 172.21.15.96:0/134235655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04005040 con 0x7f9c101075e0 2022-02-02T22:00:54.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c0effd700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 rx=0x7f9c000026d0 tx=0x7f9c00009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:54.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c000079c0 con 0x7f9c101075e0 2022-02-02T22:00:54.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c10108a80 con 0x7f9c101075e0 2022-02-02T22:00:54.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c0000f040 con 0x7f9c101075e0 2022-02-02T22:00:54.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c000148b0 con 0x7f9c101075e0 2022-02-02T22:00:54.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.459+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c10109040 con 0x7f9c101075e0 2022-02-02T22:00:54.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.460+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c101092c0 con 0x7f9c101075e0 2022-02-02T22:00:54.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.461+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c00007b20 con 0x7f9c101075e0 2022-02-02T22:00:54.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.461+0000 7f9bf7fff700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 0x7f9bf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:00:54.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.461+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9c000819e0 con 0x7f9c101075e0 2022-02-02T22:00:54.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.461+0000 7f9c0f7fe700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 0x7f9bf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:00:54.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.462+0000 7f9c0f7fe700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 0x7f9bf8067290 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f9c04009040 tx=0x7f9c04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:00:54.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.465+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c00053510 con 0x7f9c101075e0 2022-02-02T22:00:54.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.665+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c10045ad0 con 0x7f9c101075e0 2022-02-02T22:00:54.665 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:54 smithi096 ceph-mon[101353]: pgmap v6563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:54.666 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3469978543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:00:54.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.665+0000 7f9bf7fff700 1 -- 172.21.15.96:0/134235655 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9c00053100 con 0x7f9c101075e0 2022-02-02T22:00:54.667 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:00:54.668 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:00:54.668 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:00:54.668 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:00:54.669 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:54.669 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:00:54.669 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:00:54.670 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:00:54.670 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:00:54.670 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:00:54.671 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:00:54.671 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:00:54.672 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:00:54.672 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:00:54.672 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:00:54.673 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:00:54.673 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:00:54.673 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:00:54.674 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:00:54.674 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:00:54.674 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:00:54.675 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:00:54.675 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:00:54.675 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:00:54.676 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:00:54.676 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:00:54.676 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:00:54.677 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:00:54.677 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:00:54.678 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:00:54.678 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:00:54.678 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:00:54.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:54.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:54.679 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:00:54.680 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:00:54.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:54.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:54.681 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:00:54.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.667+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 msgr2=0x7f9bf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.667+0000 7f9c15a83700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 0x7f9bf8067290 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f9c04009040 tx=0x7f9c04009b30).stop 2022-02-02T22:00:54.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.667+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 msgr2=0x7f9c101084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:00:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.667+0000 7f9c15a83700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 rx=0x7f9c000026d0 tx=0x7f9c00009de0).stop 2022-02-02T22:00:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 shutdown_connections 2022-02-02T22:00:54.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9bf8064dd0 0x7f9bf8067290 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c100f7980 0x7f9c101070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 --2- 172.21.15.96:0/134235655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c101075e0 0x7f9c101084d0 unknown :-1 s=CLOSED pgs=3362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:00:54.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 >> 172.21.15.96:0/134235655 conn(0x7f9c100f1e40 msgr2=0x7f9c100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:00:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 shutdown_connections 2022-02-02T22:00:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:00:54.668+0000 7f9c15a83700 1 -- 172.21.15.96:0/134235655 wait complete. 2022-02-02T22:00:54.686 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:00:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:54 smithi159 ceph-mon[69013]: pgmap v6563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3469978543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:00:55.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:55 smithi159 ceph-mon[69013]: from='client.40828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:55 smithi159 ceph-mon[69013]: from='client.40832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:55.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/134235655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:00:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:55 smithi096 ceph-mon[101353]: from='client.40828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:55 smithi096 ceph-mon[101353]: from='client.40832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:00:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/134235655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:00:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:56 smithi159 ceph-mon[69013]: pgmap v6564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:56 smithi096 ceph-mon[101353]: pgmap v6564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:00:58 smithi159 ceph-mon[69013]: pgmap v6565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:00:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:00:58 smithi096 ceph-mon[101353]: pgmap v6565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:00 smithi159 ceph-mon[69013]: pgmap v6566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:00 smithi096 ceph-mon[101353]: pgmap v6566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:02 smithi159 ceph-mon[69013]: pgmap v6567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:02 smithi096 ceph-mon[101353]: pgmap v6567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:04 smithi159 ceph-mon[69013]: pgmap v6568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:04 smithi096 ceph-mon[101353]: pgmap v6568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:06 smithi159 ceph-mon[69013]: pgmap v6569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:06 smithi096 ceph-mon[101353]: pgmap v6569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:08 smithi159 ceph-mon[69013]: pgmap v6570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:08 smithi096 ceph-mon[101353]: pgmap v6570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:10 smithi159 ceph-mon[69013]: pgmap v6571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:10 smithi096 ceph-mon[101353]: pgmap v6571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:12 smithi159 ceph-mon[69013]: pgmap v6572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:12 smithi096 ceph-mon[101353]: pgmap v6572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:14 smithi159 ceph-mon[69013]: pgmap v6573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:14 smithi096 ceph-mon[101353]: pgmap v6573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:16 smithi159 ceph-mon[69013]: pgmap v6574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:16 smithi096 ceph-mon[101353]: pgmap v6574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:18 smithi159 ceph-mon[69013]: pgmap v6575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:18.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:18 smithi096 ceph-mon[101353]: pgmap v6575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:20 smithi159 ceph-mon[69013]: pgmap v6576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:20 smithi096 ceph-mon[101353]: pgmap v6576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:22 smithi159 ceph-mon[69013]: pgmap v6577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:22 smithi096 ceph-mon[101353]: pgmap v6577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:24 smithi159 ceph-mon[69013]: pgmap v6578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:24.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:24 smithi096 ceph-mon[101353]: pgmap v6578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:24.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 -- 172.21.15.96:0/4185972444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f66e0 msgr2=0x7f3cec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:24.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 --2- 172.21.15.96:0/4185972444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f66e0 0x7f3cec0f6b00 secure :-1 s=READY pgs=3363 cs=0 l=1 rev1=1 rx=0x7f3cdc004660 tx=0x7f3cdc009b30).stop 2022-02-02T22:01:24.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 -- 172.21.15.96:0/4185972444 shutdown_connections 2022-02-02T22:01:24.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 --2- 172.21.15.96:0/4185972444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f7980 0x7f3cec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 --2- 172.21.15.96:0/4185972444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f66e0 0x7f3cec0f6b00 unknown :-1 s=CLOSED pgs=3363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 -- 172.21.15.96:0/4185972444 >> 172.21.15.96:0/4185972444 conn(0x7f3cec0f1e40 msgr2=0x7f3cec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:24.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 -- 172.21.15.96:0/4185972444 shutdown_connections 2022-02-02T22:01:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.777+0000 7f3cf25de700 1 -- 172.21.15.96:0/4185972444 wait complete. 2022-02-02T22:01:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 Processor -- start 2022-02-02T22:01:24.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 -- start start 2022-02-02T22:01:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f66e0 0x7f3cec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:24.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec06a380 con 0x7f3cec0f7980 2022-02-02T22:01:24.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.778+0000 7f3cf25de700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec06a4c0 con 0x7f3cec0f66e0 2022-02-02T22:01:24.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:24.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46102/0 (socket says 172.21.15.96:46102) 2022-02-02T22:01:24.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 -- 172.21.15.96:0/484750188 learned_addr learned my addr 172.21.15.96:0/484750188 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:24.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3cebfff700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f66e0 0x7f3cec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:24.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 -- 172.21.15.96:0/484750188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f66e0 msgr2=0x7f3cec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:24.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f66e0 0x7f3cec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 -- 172.21.15.96:0/484750188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc005040 con 0x7f3cec0f7980 2022-02-02T22:01:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ceb7fe700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 secure :-1 s=READY pgs=3364 cs=0 l=1 rev1=1 rx=0x7f3cd40026d0 tx=0x7f3cd4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:24.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd40079c0 con 0x7f3cec0f7980 2022-02-02T22:01:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3cd400f040 con 0x7f3cec0f7980 2022-02-02T22:01:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec06a7a0 con 0x7f3cec0f7980 2022-02-02T22:01:24.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd40148b0 con 0x7f3cec0f7980 2022-02-02T22:01:24.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.779+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec10efe0 con 0x7f3cec0f7980 2022-02-02T22:01:24.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.780+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec045ad0 con 0x7f3cec0f7980 2022-02-02T22:01:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.781+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3cd4007b20 con 0x7f3cec0f7980 2022-02-02T22:01:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.781+0000 7f3ce8ff9700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 0x7f3cd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.781+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3cd40819e0 con 0x7f3cec0f7980 2022-02-02T22:01:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.781+0000 7f3cebfff700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 0x7f3cd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.782+0000 7f3cebfff700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 0x7f3cd8067290 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3cdc013690 tx=0x7f3cdc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:24.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.786+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3cd404fae0 con 0x7f3cec0f7980 2022-02-02T22:01:24.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.964+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cec0fefb0 con 0x7f3cd8064dd0 2022-02-02T22:01:24.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.966+0000 7f3ce8ff9700 1 -- 172.21.15.96:0/484750188 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3cec0fefb0 con 0x7f3cd8064dd0 2022-02-02T22:01:24.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.967+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 msgr2=0x7f3cd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.967+0000 7f3cf25de700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 0x7f3cd8067290 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3cdc013690 tx=0x7f3cdc009b30).stop 2022-02-02T22:01:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.967+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 msgr2=0x7f3cec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:24.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.967+0000 7f3cf25de700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 secure :-1 s=READY pgs=3364 cs=0 l=1 rev1=1 rx=0x7f3cd40026d0 tx=0x7f3cd4009de0).stop 2022-02-02T22:01:24.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 shutdown_connections 2022-02-02T22:01:24.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3cd8064dd0 0x7f3cd8067290 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec0f66e0 0x7f3cec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 --2- 172.21.15.96:0/484750188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cec0f7980 0x7f3cec069e20 unknown :-1 s=CLOSED pgs=3364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:24.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 >> 172.21.15.96:0/484750188 conn(0x7f3cec0f1e40 msgr2=0x7f3cec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 shutdown_connections 2022-02-02T22:01:24.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:24.968+0000 7f3cf25de700 1 -- 172.21.15.96:0/484750188 wait complete. 2022-02-02T22:01:24.978 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:01:25.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- 172.21.15.96:0/2629587436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 msgr2=0x7f45f00f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/2629587436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f00f6ac0 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 rx=0x7f45e4004660 tx=0x7f45e4009b30).stop 2022-02-02T22:01:25.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- 172.21.15.96:0/2629587436 shutdown_connections 2022-02-02T22:01:25.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/2629587436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 0x7f45f00f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:01:25.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/2629587436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f00f6ac0 unknown :-1 s=CLOSED pgs=3365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- 172.21.15.96:0/2629587436 >> 172.21.15.96:0/2629587436 conn(0x7f45f00f1e00 msgr2=0x7f45f00f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- 172.21.15.96:0/2629587436 shutdown_connections 2022-02-02T22:01:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- 172.21.15.96:0/2629587436 wait complete. 2022-02-02T22:01:25.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 Processor -- start 2022-02-02T22:01:25.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.065+0000 7f45f6c1c700 1 -- start start 2022-02-02T22:01:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f6c1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f6c1c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 0x7f45f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f6c1c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f006a410 con 0x7f45f00f66a0 2022-02-02T22:01:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f6c1c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f006a550 con 0x7f45f00f7940 2022-02-02T22:01:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46110/0 (socket says 172.21.15.96:46110) 2022-02-02T22:01:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 -- 172.21.15.96:0/1185358039 learned_addr learned my addr 172.21.15.96:0/1185358039 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45effff700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 0x7f45f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 -- 172.21.15.96:0/1185358039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 msgr2=0x7f45f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 0x7f45f0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 -- 172.21.15.96:0/1185358039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4005040 con 0x7f45f00f66a0 2022-02-02T22:01:25.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.066+0000 7f45f49b8700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 rx=0x7f45e4004f60 tx=0x7f45e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.067+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e4018070 con 0x7f45f00f66a0 2022-02-02T22:01:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.067+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f006a7d0 con 0x7f45f00f66a0 2022-02-02T22:01:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.067+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f45e4007ba0 con 0x7f45f00f66a0 2022-02-02T22:01:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.067+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e401c620 con 0x7f45f00f66a0 2022-02-02T22:01:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.067+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f010ef30 con 0x7f45f00f66a0 2022-02-02T22:01:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.068+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0045ad0 con 0x7f45f00f66a0 2022-02-02T22:01:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.068+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f45e401c8e0 con 0x7f45f00f66a0 2022-02-02T22:01:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.068+0000 7f45ed7fa700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 0x7f45e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.069+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f45e4083960 con 0x7f45f00f66a0 2022-02-02T22:01:25.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.069+0000 7f45effff700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 0x7f45e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.069+0000 7f45effff700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 0x7f45e00672e0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f45dc00b830 tx=0x7f45dc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.073+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f45e4051a60 con 0x7f45f00f66a0 2022-02-02T22:01:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.250+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f45f00feff0 con 0x7f45e0064e20 2022-02-02T22:01:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.259+0000 7f45ed7fa700 1 -- 172.21.15.96:0/1185358039 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f45f00feff0 con 0x7f45e0064e20 2022-02-02T22:01:25.260 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:01:25.260 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:01:25.261 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:01:25.261 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:01:25.261 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:01:25.262 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:01:25.262 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:01:25.263 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:01:25.263 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:01:25.263 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:01:25.264 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:01:25.264 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:01:25.264 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:01:25.265 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:01:25.265 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:01:25.265 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:01:25.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:01:25.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:01:25.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:01:25.267 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:01:25.267 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:01:25.267 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:01:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 msgr2=0x7f45e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 0x7f45e00672e0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f45dc00b830 tx=0x7f45dc008040).stop 2022-02-02T22:01:25.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 msgr2=0x7f45f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 rx=0x7f45e4004f60 tx=0x7f45e4009b30).stop 2022-02-02T22:01:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 shutdown_connections 2022-02-02T22:01:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f45e0064e20 0x7f45e00672e0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45f00f66a0 0x7f45f006b9a0 unknown :-1 s=CLOSED pgs=3366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 --2- 172.21.15.96:0/1185358039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45f00f7940 0x7f45f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 >> 172.21.15.96:0/1185358039 conn(0x7f45f00f1e00 msgr2=0x7f45f00fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 shutdown_connections 2022-02-02T22:01:25.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.262+0000 7f45f6c1c700 1 -- 172.21.15.96:0/1185358039 wait complete. 2022-02-02T22:01:25.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 -- 172.21.15.96:0/2892714554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f5400 msgr2=0x7f73800fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 --2- 172.21.15.96:0/2892714554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f5400 0x7f73800fbd10 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 rx=0x7f7374004660 tx=0x7f7374009b30).stop 2022-02-02T22:01:25.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 -- 172.21.15.96:0/2892714554 shutdown_connections 2022-02-02T22:01:25.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 --2- 172.21.15.96:0/2892714554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f5400 0x7f73800fbd10 unknown :-1 s=CLOSED pgs=3367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 --2- 172.21.15.96:0/2892714554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f4a60 0x7f73800f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 -- 172.21.15.96:0/2892714554 >> 172.21.15.96:0/2892714554 conn(0x7f73800f04c0 msgr2=0x7f73800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 -- 172.21.15.96:0/2892714554 shutdown_connections 2022-02-02T22:01:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.358+0000 7f7384dd1700 1 -- 172.21.15.96:0/2892714554 wait complete. 2022-02-02T22:01:25.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 Processor -- start 2022-02-02T22:01:25.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 -- start start 2022-02-02T22:01:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 0x7f73800f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800f8b90 con 0x7f73800f4a60 2022-02-02T22:01:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f7384dd1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800f8cd0 con 0x7f73800f5400 2022-02-02T22:01:25.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f737e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f737e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46120/0 (socket says 172.21.15.96:46120) 2022-02-02T22:01:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f737e59c700 1 -- 172.21.15.96:0/80269982 learned_addr learned my addr 172.21.15.96:0/80269982 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.359+0000 7f737dd9b700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 0x7f73800f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f737e59c700 1 -- 172.21.15.96:0/80269982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 msgr2=0x7f73800f8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f737e59c700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 0x7f73800f8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f737e59c700 1 -- 172.21.15.96:0/80269982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374005040 con 0x7f73800f4a60 2022-02-02T22:01:25.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f737dd9b700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 0x7f73800f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:01:25.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f737e59c700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 secure :-1 s=READY pgs=3368 cs=0 l=1 rev1=1 rx=0x7f737000c790 tx=0x7f7370007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737000e680 con 0x7f73800f4a60 2022-02-02T22:01:25.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f737000ec90 con 0x7f73800f4a60 2022-02-02T22:01:25.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7370013d60 con 0x7f73800f4a60 2022-02-02T22:01:25.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73800f9640 con 0x7f73800f4a60 2022-02-02T22:01:25.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.360+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73800f9bb0 con 0x7f73800f4a60 2022-02-02T22:01:25.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.361+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380045ad0 con 0x7f73800f4a60 2022-02-02T22:01:25.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.362+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7370010070 con 0x7f73800f4a60 2022-02-02T22:01:25.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.362+0000 7f736effd700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 0x7f7368067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.362+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7370081f00 con 0x7f73800f4a60 2022-02-02T22:01:25.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.362+0000 7f737dd9b700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 0x7f7368067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.363+0000 7f737dd9b700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 0x7f7368067290 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f7374004e30 tx=0x7f7374009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.366+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7370050000 con 0x7f73800f4a60 2022-02-02T22:01:25.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.597+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f73800fef50 con 0x7f73800f4a60 2022-02-02T22:01:25.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.597+0000 7f736effd700 1 -- 172.21.15.96:0/80269982 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7370053620 con 0x7f73800f4a60 2022-02-02T22:01:25.599 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:01:25.599 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:01:25.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:01:25.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:25.600 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:01:25.601 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:01:25.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:25.601 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:01:25.602 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:01:25.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:25.602 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:01:25.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:01:25.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:25.603 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:01:25.604 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:01:25.604 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:01:25.604 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:01:25.605 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:01:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 msgr2=0x7f7368067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 0x7f7368067290 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f7374004e30 tx=0x7f7374009b30).stop 2022-02-02T22:01:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 msgr2=0x7f73800f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 secure :-1 s=READY pgs=3368 cs=0 l=1 rev1=1 rx=0x7f737000c790 tx=0x7f7370007d70).stop 2022-02-02T22:01:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 shutdown_connections 2022-02-02T22:01:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7368064dd0 0x7f7368067290 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73800f4a60 0x7f73800f80a0 unknown :-1 s=CLOSED pgs=3368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 --2- 172.21.15.96:0/80269982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73800f5400 0x7f73800f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 >> 172.21.15.96:0/80269982 conn(0x7f73800f04c0 msgr2=0x7f73800f61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 shutdown_connections 2022-02-02T22:01:25.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.599+0000 7f7384dd1700 1 -- 172.21.15.96:0/80269982 wait complete. 2022-02-02T22:01:25.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 -- 172.21.15.96:0/267036820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f55c0 msgr2=0x7f17d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 --2- 172.21.15.96:0/267036820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f55c0 0x7f17d00f59e0 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 rx=0x7f17cc004660 tx=0x7f17cc009b30).stop 2022-02-02T22:01:25.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 -- 172.21.15.96:0/267036820 shutdown_connections 2022-02-02T22:01:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 --2- 172.21.15.96:0/267036820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f6860 0x7f17d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 --2- 172.21.15.96:0/267036820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f55c0 0x7f17d00f59e0 unknown :-1 s=CLOSED pgs=3369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.696+0000 7f17d8575700 1 -- 172.21.15.96:0/267036820 >> 172.21.15.96:0/267036820 conn(0x7f17d00f0d40 msgr2=0x7f17d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 -- 172.21.15.96:0/267036820 shutdown_connections 2022-02-02T22:01:25.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 -- 172.21.15.96:0/267036820 wait complete. 2022-02-02T22:01:25.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 Processor -- start 2022-02-02T22:01:25.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 -- start start 2022-02-02T22:01:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f55c0 0x7f17d0109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00603c0 con 0x7f17d00f6860 2022-02-02T22:01:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d8575700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0060500 con 0x7f17d00f55c0 2022-02-02T22:01:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d5b10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d5b10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46130/0 (socket says 172.21.15.96:46130) 2022-02-02T22:01:25.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.697+0000 7f17d5b10700 1 -- 172.21.15.96:0/1842506339 learned_addr learned my addr 172.21.15.96:0/1842506339 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:25.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d6311700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f55c0 0x7f17d0109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d5b10700 1 -- 172.21.15.96:0/1842506339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f55c0 msgr2=0x7f17d0109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d5b10700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f55c0 0x7f17d0109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d5b10700 1 -- 172.21.15.96:0/1842506339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc005040 con 0x7f17d00f6860 2022-02-02T22:01:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d5b10700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 rx=0x7f17c0002700 tx=0x7f17c0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17c0009320 con 0x7f17d00f6860 2022-02-02T22:01:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d010c6c0 con 0x7f17d00f6860 2022-02-02T22:01:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f17c000f040 con 0x7f17d00f6860 2022-02-02T22:01:25.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17c0014820 con 0x7f17d00f6860 2022-02-02T22:01:25.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.698+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d010cc50 con 0x7f17d00f6860 2022-02-02T22:01:25.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.699+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d00f49b0 con 0x7f17d00f6860 2022-02-02T22:01:25.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.700+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f17c0009480 con 0x7f17d00f6860 2022-02-02T22:01:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.700+0000 7f17c6ffd700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 0x7f17bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.700+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f17c0081cd0 con 0x7f17d00f6860 2022-02-02T22:01:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.700+0000 7f17d6311700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 0x7f17bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:25.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.701+0000 7f17d6311700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 0x7f17bc067290 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f17cc004e30 tx=0x7f17cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:25.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.704+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f17c004fd70 con 0x7f17d00f6860 2022-02-02T22:01:25.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.906+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17d00fdf10 con 0x7f17d00f6860 2022-02-02T22:01:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.906+0000 7f17c6ffd700 1 -- 172.21.15.96:0/1842506339 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f17d00fdf10 con 0x7f17d00f6860 2022-02-02T22:01:25.908 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:01:25.908 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:01:25.908 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:01:25.909 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:01:25.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:25.909 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:01:25.910 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:01:25.910 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:01:25.910 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:01:25.911 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:01:25.911 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:01:25.911 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:01:25.912 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:01:25.912 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:01:25.912 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:01:25.913 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:01:25.913 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:01:25.914 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:01:25.914 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:01:25.915 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:01:25.916 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:01:25.917 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:01:25.917 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:01:25.918 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:01:25.918 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:01:25.918 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:01:25.919 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:01:25.919 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:01:25.919 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:01:25.920 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:01:25.920 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:01:25.920 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:01:25.921 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:25.921 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:25.921 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:01:25.922 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:25.922 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:25.922 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:25.923 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:25.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 msgr2=0x7f17bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 0x7f17bc067290 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f17cc004e30 tx=0x7f17cc009b30).stop 2022-02-02T22:01:25.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 msgr2=0x7f17d010c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:25.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 rx=0x7f17c0002700 tx=0x7f17c0009e00).stop 2022-02-02T22:01:25.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 shutdown_connections 2022-02-02T22:01:25.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f17bc064dd0 0x7f17bc067290 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17d00f55c0 0x7f17d0109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 --2- 172.21.15.96:0/1842506339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17d00f6860 0x7f17d010c110 unknown :-1 s=CLOSED pgs=3370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 >> 172.21.15.96:0/1842506339 conn(0x7f17d00f0d40 msgr2=0x7f17d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 shutdown_connections 2022-02-02T22:01:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:25.909+0000 7f17d8575700 1 -- 172.21.15.96:0/1842506339 wait complete. 2022-02-02T22:01:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:01:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:26 smithi159 ceph-mon[69013]: pgmap v6579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:26 smithi159 ceph-mon[69013]: from='client.40844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:26 smithi159 ceph-mon[69013]: from='client.40848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/80269982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:01:26.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1842506339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:01:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:26 smithi096 ceph-mon[101353]: pgmap v6579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:26.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:26 smithi096 ceph-mon[101353]: from='client.40844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:26 smithi096 ceph-mon[101353]: from='client.40848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:26.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/80269982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:01:26.807 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1842506339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:01:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:28 smithi159 ceph-mon[69013]: pgmap v6580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:01:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:01:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:28 smithi096 ceph-mon[101353]: pgmap v6580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:01:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:01:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:30 smithi159 ceph-mon[69013]: pgmap v6581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:30 smithi096 ceph-mon[101353]: pgmap v6581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:32 smithi159 ceph-mon[69013]: pgmap v6582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:32 smithi096 ceph-mon[101353]: pgmap v6582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:34 smithi159 ceph-mon[69013]: pgmap v6583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:34 smithi096 ceph-mon[101353]: pgmap v6583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:36 smithi159 ceph-mon[69013]: pgmap v6584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:36 smithi096 ceph-mon[101353]: pgmap v6584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:38 smithi159 ceph-mon[69013]: pgmap v6585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:38 smithi096 ceph-mon[101353]: pgmap v6585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:40 smithi159 ceph-mon[69013]: pgmap v6586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:40 smithi096 ceph-mon[101353]: pgmap v6586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:42 smithi159 ceph-mon[69013]: pgmap v6587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:42 smithi096 ceph-mon[101353]: pgmap v6587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:44 smithi159 ceph-mon[69013]: pgmap v6588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:44 smithi096 ceph-mon[101353]: pgmap v6588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:46 smithi159 ceph-mon[69013]: pgmap v6589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:46 smithi096 ceph-mon[101353]: pgmap v6589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:48 smithi159 ceph-mon[69013]: pgmap v6590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:48 smithi096 ceph-mon[101353]: pgmap v6590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:50 smithi159 ceph-mon[69013]: pgmap v6591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:50 smithi096 ceph-mon[101353]: pgmap v6591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:52 smithi159 ceph-mon[69013]: pgmap v6592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:52 smithi096 ceph-mon[101353]: pgmap v6592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:54 smithi159 ceph-mon[69013]: pgmap v6593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:54 smithi096 ceph-mon[101353]: pgmap v6593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:56.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.019+0000 7ffad082a700 1 -- 172.21.15.96:0/2590552112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f6860 msgr2=0x7ffacc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.019+0000 7ffad082a700 1 --2- 172.21.15.96:0/2590552112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f6860 0x7ffacc0f6cc0 secure :-1 s=READY pgs=3371 cs=0 l=1 rev1=1 rx=0x7ffabc004660 tx=0x7ffabc009b30).stop 2022-02-02T22:01:56.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.019+0000 7ffad082a700 1 -- 172.21.15.96:0/2590552112 shutdown_connections 2022-02-02T22:01:56.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.019+0000 7ffad082a700 1 --2- 172.21.15.96:0/2590552112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f6860 0x7ffacc0f6cc0 unknown :-1 s=CLOSED pgs=3371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.019+0000 7ffad082a700 1 --2- 172.21.15.96:0/2590552112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f55c0 0x7ffacc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- 172.21.15.96:0/2590552112 >> 172.21.15.96:0/2590552112 conn(0x7ffacc0f0d40 msgr2=0x7ffacc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- 172.21.15.96:0/2590552112 shutdown_connections 2022-02-02T22:01:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- 172.21.15.96:0/2590552112 wait complete. 2022-02-02T22:01:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 Processor -- start 2022-02-02T22:01:56.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- start start 2022-02-02T22:01:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f6860 0x7ffacc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1069b0 con 0x7ffacc0f55c0 2022-02-02T22:01:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffad082a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1071c0 con 0x7ffacc0f6860 2022-02-02T22:01:56.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.020+0000 7ffaca59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46146/0 (socket says 172.21.15.96:46146) 2022-02-02T22:01:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 -- 172.21.15.96:0/1491922564 learned_addr learned my addr 172.21.15.96:0/1491922564 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:56.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffac9d9b700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f6860 0x7ffacc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 -- 172.21.15.96:0/1491922564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f6860 msgr2=0x7ffacc1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f6860 0x7ffacc1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 -- 172.21.15.96:0/1491922564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc005040 con 0x7ffacc0f55c0 2022-02-02T22:01:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffaca59c700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 secure :-1 s=READY pgs=3372 cs=0 l=1 rev1=1 rx=0x7ffab4002700 tx=0x7ffab4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab40079c0 con 0x7ffacc0f55c0 2022-02-02T22:01:56.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffab400f040 con 0x7ffacc0f55c0 2022-02-02T22:01:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc107440 con 0x7ffacc0f55c0 2022-02-02T22:01:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab4014860 con 0x7ffacc0f55c0 2022-02-02T22:01:56.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.021+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc107a00 con 0x7ffacc0f55c0 2022-02-02T22:01:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.022+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc0f49b0 con 0x7ffacc0f55c0 2022-02-02T22:01:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.023+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffab401b060 con 0x7ffacc0f55c0 2022-02-02T22:01:56.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.023+0000 7ffac2ffd700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 0x7ffab8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.023+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffab40818c0 con 0x7ffacc0f55c0 2022-02-02T22:01:56.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.023+0000 7ffac9d9b700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 0x7ffab8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.024+0000 7ffac9d9b700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 0x7ffab8067270 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7ffabc004e30 tx=0x7ffabc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.027+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffab404f9c0 con 0x7ffacc0f55c0 2022-02-02T22:01:56.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.203+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffacc0008d0 con 0x7ffab8064db0 2022-02-02T22:01:56.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.204+0000 7ffac2ffd700 1 -- 172.21.15.96:0/1491922564 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffacc0008d0 con 0x7ffab8064db0 2022-02-02T22:01:56.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 msgr2=0x7ffab8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 0x7ffab8067270 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7ffabc004e30 tx=0x7ffabc009b30).stop 2022-02-02T22:01:56.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 msgr2=0x7ffacc105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 secure :-1 s=READY pgs=3372 cs=0 l=1 rev1=1 rx=0x7ffab4002700 tx=0x7ffab4009d80).stop 2022-02-02T22:01:56.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 shutdown_connections 2022-02-02T22:01:56.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffab8064db0 0x7ffab8067270 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffacc0f55c0 0x7ffacc105ec0 unknown :-1 s=CLOSED pgs=3372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 --2- 172.21.15.96:0/1491922564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffacc0f6860 0x7ffacc1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 >> 172.21.15.96:0/1491922564 conn(0x7ffacc0f0d40 msgr2=0x7ffacc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 shutdown_connections 2022-02-02T22:01:56.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.206+0000 7ffad082a700 1 -- 172.21.15.96:0/1491922564 wait complete. 2022-02-02T22:01:56.216 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:01:56.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 -- 172.21.15.96:0/2321581946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f66e0 msgr2=0x7f6f780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 --2- 172.21.15.96:0/2321581946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f66e0 0x7f6f780f6b00 secure :-1 s=READY pgs=3373 cs=0 l=1 rev1=1 rx=0x7f6f68004660 tx=0x7f6f68009b30).stop 2022-02-02T22:01:56.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 -- 172.21.15.96:0/2321581946 shutdown_connections 2022-02-02T22:01:56.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 --2- 172.21.15.96:0/2321581946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f7980 0x7f6f780f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 --2- 172.21.15.96:0/2321581946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f66e0 0x7f6f780f6b00 unknown :-1 s=CLOSED pgs=3373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 -- 172.21.15.96:0/2321581946 >> 172.21.15.96:0/2321581946 conn(0x7f6f780f1e40 msgr2=0x7f6f780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 -- 172.21.15.96:0/2321581946 shutdown_connections 2022-02-02T22:01:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.304+0000 7f6f8073f700 1 -- 172.21.15.96:0/2321581946 wait complete. 2022-02-02T22:01:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 Processor -- start 2022-02-02T22:01:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 -- start start 2022-02-02T22:01:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f66e0 0x7f6f7806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806a380 con 0x7f6f780f7980 2022-02-02T22:01:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f8073f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806a4c0 con 0x7f6f780f66e0 2022-02-02T22:01:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f7dcda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f7dcda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46158/0 (socket says 172.21.15.96:46158) 2022-02-02T22:01:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f7dcda700 1 -- 172.21.15.96:0/3765503080 learned_addr learned my addr 172.21.15.96:0/3765503080 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:56.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f7e4db700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f66e0 0x7f6f7806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.305+0000 7f6f7dcda700 1 -- 172.21.15.96:0/3765503080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f66e0 msgr2=0x7f6f7806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f7dcda700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f66e0 0x7f6f7806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f7dcda700 1 -- 172.21.15.96:0/3765503080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68005040 con 0x7f6f780f7980 2022-02-02T22:01:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f7dcda700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 rx=0x7f6f7400c790 tx=0x7f6f74007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f74002590 con 0x7f6f780f7980 2022-02-02T22:01:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f74002ba0 con 0x7f6f780f7980 2022-02-02T22:01:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7806a7a0 con 0x7f6f780f7980 2022-02-02T22:01:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f74013d90 con 0x7f6f780f7980 2022-02-02T22:01:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.306+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7810efe0 con 0x7f6f780f7980 2022-02-02T22:01:56.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.307+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78045ad0 con 0x7f6f780f7980 2022-02-02T22:01:56.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.307+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f7401a060 con 0x7f6f780f7980 2022-02-02T22:01:56.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.308+0000 7f6f6effd700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.308+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f74081cf0 con 0x7f6f780f7980 2022-02-02T22:01:56.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.308+0000 7f6f7e4db700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.308+0000 7f6f7e4db700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f6f68013690 tx=0x7f6f68009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.312+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f7404fd90 con 0x7f6f780f7980 2022-02-02T22:01:56.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.484+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f78057f10 con 0x7f6f64064dd0 2022-02-02T22:01:56.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.493+0000 7f6f6effd700 1 -- 172.21.15.96:0/3765503080 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6f78057f10 con 0x7f6f64064dd0 2022-02-02T22:01:56.494 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:01:56.494 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:01:56.494 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:01:56.495 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:01:56.495 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:01:56.495 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:01:56.496 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:01:56.496 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:01:56.497 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:01:56.497 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:01:56.497 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:01:56.498 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:01:56.498 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:01:56.498 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:01:56.499 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:01:56.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:01:56.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:01:56.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:01:56.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:01:56.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:01:56.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:01:56.501 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:01:56.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 msgr2=0x7f6f64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f6f68013690 tx=0x7f6f68009b30).stop 2022-02-02T22:01:56.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 msgr2=0x7f6f78069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 rx=0x7f6f7400c790 tx=0x7f6f74007d70).stop 2022-02-02T22:01:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 shutdown_connections 2022-02-02T22:01:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6f64064dd0 0x7f6f64067290 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f780f66e0 0x7f6f7806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 --2- 172.21.15.96:0/3765503080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f780f7980 0x7f6f78069e20 unknown :-1 s=CLOSED pgs=3374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.495+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 >> 172.21.15.96:0/3765503080 conn(0x7f6f780f1e40 msgr2=0x7f6f780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.496+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 shutdown_connections 2022-02-02T22:01:56.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.496+0000 7f6f8073f700 1 -- 172.21.15.96:0/3765503080 wait complete. 2022-02-02T22:01:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:56 smithi096 ceph-mon[101353]: pgmap v6594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 -- 172.21.15.96:0/240102092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f66e0 msgr2=0x7f9cbc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 --2- 172.21.15.96:0/240102092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc0f6b00 secure :-1 s=READY pgs=3375 cs=0 l=1 rev1=1 rx=0x7f9cac004660 tx=0x7f9cac009b30).stop 2022-02-02T22:01:56.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 -- 172.21.15.96:0/240102092 shutdown_connections 2022-02-02T22:01:56.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 --2- 172.21.15.96:0/240102092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:01:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 --2- 172.21.15.96:0/240102092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc0f6b00 unknown :-1 s=CLOSED pgs=3375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 -- 172.21.15.96:0/240102092 >> 172.21.15.96:0/240102092 conn(0x7f9cbc0f1e40 msgr2=0x7f9cbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 -- 172.21.15.96:0/240102092 shutdown_connections 2022-02-02T22:01:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.592+0000 7f9cc294c700 1 -- 172.21.15.96:0/240102092 wait complete. 2022-02-02T22:01:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 Processor -- start 2022-02-02T22:01:56.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 -- start start 2022-02-02T22:01:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06a410 con 0x7f9cbc0f7980 2022-02-02T22:01:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cc294c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06a550 con 0x7f9cbc0f66e0 2022-02-02T22:01:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cbb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cbb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46168/0 (socket says 172.21.15.96:46168) 2022-02-02T22:01:56.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cbbfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.593+0000 7f9cbb7fe700 1 -- 172.21.15.96:0/1781887858 learned_addr learned my addr 172.21.15.96:0/1781887858 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:56.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cbb7fe700 1 -- 172.21.15.96:0/1781887858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 msgr2=0x7f9cbc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cbb7fe700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cbb7fe700 1 -- 172.21.15.96:0/1781887858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac005040 con 0x7f9cbc0f7980 2022-02-02T22:01:56.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cbbfff700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:01:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cbb7fe700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 rx=0x7f9cb000b410 tx=0x7f9cb0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb00125f0 con 0x7f9cbc0f7980 2022-02-02T22:01:56.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc06a830 con 0x7f9cbc0f7980 2022-02-02T22:01:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9cb000be30 con 0x7f9cbc0f7980 2022-02-02T22:01:56.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb0002a70 con 0x7f9cbc0f7980 2022-02-02T22:01:56.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.594+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc10efe0 con 0x7f9cbc0f7980 2022-02-02T22:01:56.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.595+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc045ad0 con 0x7f9cbc0f7980 2022-02-02T22:01:56.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.595+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9cb000f030 con 0x7f9cbc0f7980 2022-02-02T22:01:56.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.596+0000 7f9cb8ff9700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 0x7f9ca4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.596+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9cb0081e70 con 0x7f9cbc0f7980 2022-02-02T22:01:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.596+0000 7f9cbbfff700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 0x7f9ca4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.596+0000 7f9cbbfff700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 0x7f9ca4067290 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f9cac013690 tx=0x7f9cac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.600+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9cb004ff70 con 0x7f9cbc0f7980 2022-02-02T22:01:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:56 smithi159 ceph-mon[69013]: pgmap v6594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:56.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.834+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9cbc027a00 con 0x7f9cbc0f7980 2022-02-02T22:01:56.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.835+0000 7f9cb8ff9700 1 -- 172.21.15.96:0/1781887858 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9cb0053590 con 0x7f9cbc0f7980 2022-02-02T22:01:56.836 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:01:56.836 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:01:56.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:01:56.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:56.838 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:01:56.838 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:01:56.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:56.839 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:01:56.839 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:01:56.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:56.840 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:01:56.840 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:01:56.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:01:56.841 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:01:56.841 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:01:56.841 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:01:56.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:01:56.842 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:01:56.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 msgr2=0x7f9ca4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 0x7f9ca4067290 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f9cac013690 tx=0x7f9cac009b30).stop 2022-02-02T22:01:56.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 msgr2=0x7f9cbc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 rx=0x7f9cb000b410 tx=0x7f9cb0006ef0).stop 2022-02-02T22:01:56.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 shutdown_connections 2022-02-02T22:01:56.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ca4064dd0 0x7f9ca4067290 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cbc0f66e0 0x7f9cbc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 --2- 172.21.15.96:0/1781887858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9cbc0f7980 0x7f9cbc069e20 unknown :-1 s=CLOSED pgs=3376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 >> 172.21.15.96:0/1781887858 conn(0x7f9cbc0f1e40 msgr2=0x7f9cbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 shutdown_connections 2022-02-02T22:01:56.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.837+0000 7f9cc294c700 1 -- 172.21.15.96:0/1781887858 wait complete. 2022-02-02T22:01:56.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 -- 172.21.15.96:0/4146025008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f6860 msgr2=0x7f76ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 --2- 172.21.15.96:0/4146025008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f6860 0x7f76ec0f6cc0 secure :-1 s=READY pgs=3377 cs=0 l=1 rev1=1 rx=0x7f76d8004660 tx=0x7f76d8009b30).stop 2022-02-02T22:01:56.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 -- 172.21.15.96:0/4146025008 shutdown_connections 2022-02-02T22:01:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 --2- 172.21.15.96:0/4146025008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f6860 0x7f76ec0f6cc0 unknown :-1 s=CLOSED pgs=3377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 --2- 172.21.15.96:0/4146025008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f55c0 0x7f76ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 -- 172.21.15.96:0/4146025008 >> 172.21.15.96:0/4146025008 conn(0x7f76ec0f0d40 msgr2=0x7f76ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 -- 172.21.15.96:0/4146025008 shutdown_connections 2022-02-02T22:01:56.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.934+0000 7f76f30a0700 1 -- 172.21.15.96:0/4146025008 wait complete. 2022-02-02T22:01:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.935+0000 7f76f30a0700 1 Processor -- start 2022-02-02T22:01:56.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.935+0000 7f76f30a0700 1 -- start start 2022-02-02T22:01:56.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f6860 0x7f76ec10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0603e0 con 0x7f76ec0f55c0 2022-02-02T22:01:56.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec060520 con 0x7f76ec0f6860 2022-02-02T22:01:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46176/0 (socket says 172.21.15.96:46176) 2022-02-02T22:01:56.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 -- 172.21.15.96:0/1426842641 learned_addr learned my addr 172.21.15.96:0/1426842641 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:01:56.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76ebfff700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f6860 0x7f76ec10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 -- 172.21.15.96:0/1426842641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f6860 msgr2=0x7f76ec10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:56.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f6860 0x7f76ec10c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 -- 172.21.15.96:0/1426842641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005040 con 0x7f76ec0f55c0 2022-02-02T22:01:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f0e3c700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 rx=0x7f76e0002700 tx=0x7f76e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e0009320 con 0x7f76ec0f55c0 2022-02-02T22:01:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76e000f040 con 0x7f76ec0f55c0 2022-02-02T22:01:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec10c700 con 0x7f76ec0f55c0 2022-02-02T22:01:56.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e0014900 con 0x7f76ec0f55c0 2022-02-02T22:01:56.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.936+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec10ccc0 con 0x7f76ec0f55c0 2022-02-02T22:01:56.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.937+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec045ad0 con 0x7f76ec0f55c0 2022-02-02T22:01:56.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.938+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f76e0009480 con 0x7f76ec0f55c0 2022-02-02T22:01:56.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.939+0000 7f76e97fa700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 0x7f76dc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:01:56.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.939+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f76e0081be0 con 0x7f76ec0f55c0 2022-02-02T22:01:56.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.939+0000 7f76ebfff700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 0x7f76dc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:01:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.939+0000 7f76ebfff700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 0x7f76dc067270 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f76d8004e30 tx=0x7f76d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:01:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:56.943+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76e004fce0 con 0x7f76ec0f55c0 2022-02-02T22:01:57.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.143+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76ec027a00 con 0x7f76ec0f55c0 2022-02-02T22:01:57.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.143+0000 7f76e97fa700 1 -- 172.21.15.96:0/1426842641 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f76e0053300 con 0x7f76ec0f55c0 2022-02-02T22:01:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:01:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:01:57.145 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:01:57.145 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:01:57.145 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:57.146 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:01:57.146 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:01:57.146 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:01:57.147 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:01:57.147 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:01:57.147 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:01:57.148 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:01:57.148 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:01:57.148 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:01:57.149 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:01:57.149 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:01:57.149 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:01:57.150 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:01:57.150 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:01:57.150 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:01:57.151 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:01:57.151 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:01:57.152 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:01:57.152 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:01:57.153 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:01:57.153 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:01:57.153 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:01:57.154 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:01:57.154 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:01:57.154 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:01:57.155 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:01:57.155 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:01:57.155 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:57.156 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:01:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:01:57.157 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:57.157 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:57.158 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:01:57.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 msgr2=0x7f76dc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:57.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 0x7f76dc067270 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f76d8004e30 tx=0x7f76d8009b30).stop 2022-02-02T22:01:57.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 msgr2=0x7f76ec109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:01:57.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 rx=0x7f76e0002700 tx=0x7f76e0009d80).stop 2022-02-02T22:01:57.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 shutdown_connections 2022-02-02T22:01:57.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f76dc064db0 0x7f76dc067270 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:57.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ec0f55c0 0x7f76ec109c50 unknown :-1 s=CLOSED pgs=3378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:57.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 --2- 172.21.15.96:0/1426842641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76ec0f6860 0x7f76ec10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:01:57.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 >> 172.21.15.96:0/1426842641 conn(0x7f76ec0f0d40 msgr2=0x7f76ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:01:57.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 shutdown_connections 2022-02-02T22:01:57.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:01:57.145+0000 7f76f30a0700 1 -- 172.21.15.96:0/1426842641 wait complete. 2022-02-02T22:01:57.165 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:01:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:57 smithi159 ceph-mon[69013]: from='client.40860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:57.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:57 smithi159 ceph-mon[69013]: from='client.40864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:57.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1781887858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:01:57.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:57 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1426842641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:01:57.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:57 smithi096 ceph-mon[101353]: from='client.40860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:57.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:57 smithi096 ceph-mon[101353]: from='client.40864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:01:57.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1781887858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:01:57.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:57 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1426842641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:01:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:01:58 smithi159 ceph-mon[69013]: pgmap v6595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:01:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:01:58 smithi096 ceph-mon[101353]: pgmap v6595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:00 smithi096 ceph-mon[101353]: pgmap v6596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:00 smithi159 ceph-mon[69013]: pgmap v6596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:02 smithi096 ceph-mon[101353]: pgmap v6597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:02 smithi159 ceph-mon[69013]: pgmap v6597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:04 smithi096 ceph-mon[101353]: pgmap v6598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:04 smithi159 ceph-mon[69013]: pgmap v6598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:06 smithi096 ceph-mon[101353]: pgmap v6599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:06 smithi159 ceph-mon[69013]: pgmap v6599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:08 smithi096 ceph-mon[101353]: pgmap v6600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:08 smithi159 ceph-mon[69013]: pgmap v6600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:10 smithi096 ceph-mon[101353]: pgmap v6601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:10 smithi159 ceph-mon[69013]: pgmap v6601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:12 smithi096 ceph-mon[101353]: pgmap v6602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:12 smithi159 ceph-mon[69013]: pgmap v6602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:14 smithi096 ceph-mon[101353]: pgmap v6603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:14 smithi159 ceph-mon[69013]: pgmap v6603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:16 smithi096 ceph-mon[101353]: pgmap v6604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:16 smithi159 ceph-mon[69013]: pgmap v6604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:18 smithi096 ceph-mon[101353]: pgmap v6605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:18 smithi159 ceph-mon[69013]: pgmap v6605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:20 smithi096 ceph-mon[101353]: pgmap v6606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:20 smithi159 ceph-mon[69013]: pgmap v6606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:22 smithi159 ceph-mon[69013]: pgmap v6607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:22 smithi096 ceph-mon[101353]: pgmap v6607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:24 smithi159 ceph-mon[69013]: pgmap v6608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:24 smithi096 ceph-mon[101353]: pgmap v6608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:26 smithi159 ceph-mon[69013]: pgmap v6609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:26 smithi096 ceph-mon[101353]: pgmap v6609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:27.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 -- 172.21.15.96:0/3473479723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 msgr2=0x7fa5800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 --2- 172.21.15.96:0/3473479723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa5800f7de0 secure :-1 s=READY pgs=3379 cs=0 l=1 rev1=1 rx=0x7fa568004660 tx=0x7fa568009b30).stop 2022-02-02T22:02:27.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 -- 172.21.15.96:0/3473479723 shutdown_connections 2022-02-02T22:02:27.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 --2- 172.21.15.96:0/3473479723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa5800f7de0 unknown :-1 s=CLOSED pgs=3379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 --2- 172.21.15.96:0/3473479723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 0x7fa5800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 -- 172.21.15.96:0/3473479723 >> 172.21.15.96:0/3473479723 conn(0x7fa5800f1e40 msgr2=0x7fa5800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:27.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 -- 172.21.15.96:0/3473479723 shutdown_connections 2022-02-02T22:02:27.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.255+0000 7fa584bce700 1 -- 172.21.15.96:0/3473479723 wait complete. 2022-02-02T22:02:27.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 Processor -- start 2022-02-02T22:02:27.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 -- start start 2022-02-02T22:02:27.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 0x7fa580106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580107a00 con 0x7fa5800f7980 2022-02-02T22:02:27.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa584bce700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580107b40 con 0x7fa5800f66e0 2022-02-02T22:02:27.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46196/0 (socket says 172.21.15.96:46196) 2022-02-02T22:02:27.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 -- 172.21.15.96:0/4179201845 learned_addr learned my addr 172.21.15.96:0/4179201845 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:27.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57e59c700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 0x7fa580106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 -- 172.21.15.96:0/4179201845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 msgr2=0x7fa580106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 0x7fa580106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 -- 172.21.15.96:0/4179201845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568005040 con 0x7fa5800f7980 2022-02-02T22:02:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.256+0000 7fa57dd9b700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 rx=0x7fa568009990 tx=0x7fa568009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.257+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa568018070 con 0x7fa5800f7980 2022-02-02T22:02:27.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.257+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa568007ba0 con 0x7fa5800f7980 2022-02-02T22:02:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.257+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa56801c3c0 con 0x7fa5800f7980 2022-02-02T22:02:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.257+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580108480 con 0x7fa5800f7980 2022-02-02T22:02:27.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.257+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5801089e0 con 0x7fa5800f7980 2022-02-02T22:02:27.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.258+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580045ad0 con 0x7fa5800f7980 2022-02-02T22:02:27.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.258+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa56801d420 con 0x7fa5800f7980 2022-02-02T22:02:27.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.259+0000 7fa576ffd700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 0x7fa56c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.259+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa568083740 con 0x7fa5800f7980 2022-02-02T22:02:27.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.259+0000 7fa57e59c700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 0x7fa56c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.259+0000 7fa57e59c700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 0x7fa56c067290 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fa5800f77e0 tx=0x7fa570009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.263+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa5680552d0 con 0x7fa5800f7980 2022-02-02T22:02:27.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.444+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa580108c00 con 0x7fa56c064dd0 2022-02-02T22:02:27.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.445+0000 7fa576ffd700 1 -- 172.21.15.96:0/4179201845 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa580108c00 con 0x7fa56c064dd0 2022-02-02T22:02:27.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.446+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 msgr2=0x7fa56c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.446+0000 7fa584bce700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 0x7fa56c067290 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fa5800f77e0 tx=0x7fa570009c00).stop 2022-02-02T22:02:27.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 msgr2=0x7fa580107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 rx=0x7fa568009990 tx=0x7fa568009b30).stop 2022-02-02T22:02:27.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 shutdown_connections 2022-02-02T22:02:27.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa56c064dd0 0x7fa56c067290 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5800f66e0 0x7fa580106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 --2- 172.21.15.96:0/4179201845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5800f7980 0x7fa580107450 unknown :-1 s=CLOSED pgs=3380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 >> 172.21.15.96:0/4179201845 conn(0x7fa5800f1e40 msgr2=0x7fa5800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:27.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 shutdown_connections 2022-02-02T22:02:27.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.447+0000 7fa584bce700 1 -- 172.21.15.96:0/4179201845 wait complete. 2022-02-02T22:02:27.456 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:02:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 -- 172.21.15.96:0/2791894287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 msgr2=0x7f27140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 --2- 172.21.15.96:0/2791894287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f27140f5850 secure :-1 s=READY pgs=3381 cs=0 l=1 rev1=1 rx=0x7f26fc0099e0 tx=0x7f26fc004d10).stop 2022-02-02T22:02:27.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 -- 172.21.15.96:0/2791894287 shutdown_connections 2022-02-02T22:02:27.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 --2- 172.21.15.96:0/2791894287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f27140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:02:27.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 --2- 172.21.15.96:0/2791894287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f27140f5850 unknown :-1 s=CLOSED pgs=3381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.544+0000 7f2718dc7700 1 -- 172.21.15.96:0/2791894287 >> 172.21.15.96:0/2791894287 conn(0x7f27140f0b90 msgr2=0x7f27140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:27.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.545+0000 7f2718dc7700 1 -- 172.21.15.96:0/2791894287 shutdown_connections 2022-02-02T22:02:27.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.545+0000 7f2718dc7700 1 -- 172.21.15.96:0/2791894287 wait complete. 2022-02-02T22:02:27.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.545+0000 7f2718dc7700 1 Processor -- start 2022-02-02T22:02:27.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.545+0000 7f2718dc7700 1 -- start start 2022-02-02T22:02:27.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2718dc7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2718dc7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f271410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2718dc7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140604b0 con 0x7f27140f5430 2022-02-02T22:02:27.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2718dc7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140605f0 con 0x7f27140f66d0 2022-02-02T22:02:27.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46204/0 (socket says 172.21.15.96:46204) 2022-02-02T22:02:27.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 -- 172.21.15.96:0/4238854223 learned_addr learned my addr 172.21.15.96:0/4238854223 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:27.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2712ffd700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f271410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 -- 172.21.15.96:0/4238854223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 msgr2=0x7f271410c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f271410c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 -- 172.21.15.96:0/4238854223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009640 con 0x7f27140f5430 2022-02-02T22:02:27.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f2712ffd700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f271410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:02:27.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f27137fe700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 secure :-1 s=READY pgs=3382 cs=0 l=1 rev1=1 rx=0x7f26fc00c010 tx=0x7f26fc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.546+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26fc00e070 con 0x7f27140f5430 2022-02-02T22:02:27.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.547+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271410c6e0 con 0x7f27140f5430 2022-02-02T22:02:27.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.547+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26fc007dc0 con 0x7f27140f5430 2022-02-02T22:02:27.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.547+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26fc018070 con 0x7f27140f5430 2022-02-02T22:02:27.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.547+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271410cbc0 con 0x7f27140f5430 2022-02-02T22:02:27.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.548+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714045ad0 con 0x7f27140f5430 2022-02-02T22:02:27.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.548+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26fc024060 con 0x7f27140f5430 2022-02-02T22:02:27.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.548+0000 7f270bfff700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 0x7f27000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.549+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26fc0834e0 con 0x7f27140f5430 2022-02-02T22:02:27.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.549+0000 7f2712ffd700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 0x7f27000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.549+0000 7f2712ffd700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 0x7f27000672e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f270400a7e0 tx=0x7f2704008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.553+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26fc0516a0 con 0x7f27140f5430 2022-02-02T22:02:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.726+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2714057f10 con 0x7f2700064e20 2022-02-02T22:02:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.736+0000 7f270bfff700 1 -- 172.21.15.96:0/4238854223 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2714057f10 con 0x7f2700064e20 2022-02-02T22:02:27.736 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:02:27.737 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:02:27.737 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:02:27.737 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:02:27.738 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:02:27.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:02:27.738 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:02:27.739 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:02:27.739 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:02:27.740 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:02:27.740 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:02:27.740 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:02:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:02:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:02:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:02:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:02:27.743 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:02:27.743 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:02:27.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:02:27.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:02:27.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:02:27.745 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:02:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 msgr2=0x7f27000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 0x7f27000672e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f270400a7e0 tx=0x7f2704008040).stop 2022-02-02T22:02:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 msgr2=0x7f2714109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 secure :-1 s=READY pgs=3382 cs=0 l=1 rev1=1 rx=0x7f26fc00c010 tx=0x7f26fc004d10).stop 2022-02-02T22:02:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 shutdown_connections 2022-02-02T22:02:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2700064e20 0x7f27000672e0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27140f5430 0x7f2714109be0 unknown :-1 s=CLOSED pgs=3382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 --2- 172.21.15.96:0/4238854223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27140f66d0 0x7f271410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 >> 172.21.15.96:0/4238854223 conn(0x7f27140f0b90 msgr2=0x7f27140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 shutdown_connections 2022-02-02T22:02:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.738+0000 7f2718dc7700 1 -- 172.21.15.96:0/4238854223 wait complete. 2022-02-02T22:02:27.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 -- 172.21.15.96:0/3933956098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f6860 msgr2=0x7f22b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 --2- 172.21.15.96:0/3933956098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f6860 0x7f22b40f6cc0 secure :-1 s=READY pgs=3383 cs=0 l=1 rev1=1 rx=0x7f22a0004660 tx=0x7f22a0009b30).stop 2022-02-02T22:02:27.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 -- 172.21.15.96:0/3933956098 shutdown_connections 2022-02-02T22:02:27.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 --2- 172.21.15.96:0/3933956098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f6860 0x7f22b40f6cc0 unknown :-1 s=CLOSED pgs=3383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 --2- 172.21.15.96:0/3933956098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f55c0 0x7f22b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:02:27.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 -- 172.21.15.96:0/3933956098 >> 172.21.15.96:0/3933956098 conn(0x7f22b40f0d40 msgr2=0x7f22b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:27.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 -- 172.21.15.96:0/3933956098 shutdown_connections 2022-02-02T22:02:27.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.835+0000 7f22bafc9700 1 -- 172.21.15.96:0/3933956098 wait complete. 2022-02-02T22:02:27.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 Processor -- start 2022-02-02T22:02:27.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 -- start start 2022-02-02T22:02:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f6860 0x7f22b410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40604b0 con 0x7f22b40f55c0 2022-02-02T22:02:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22bafc9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40605f0 con 0x7f22b40f6860 2022-02-02T22:02:27.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22b8d65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22b8d65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46214/0 (socket says 172.21.15.96:46214) 2022-02-02T22:02:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.836+0000 7f22b8d65700 1 -- 172.21.15.96:0/1280600069 learned_addr learned my addr 172.21.15.96:0/1280600069 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b8d65700 1 -- 172.21.15.96:0/1280600069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f6860 msgr2=0x7f22b410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b3fff700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f6860 0x7f22b410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b8d65700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f6860 0x7f22b410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b8d65700 1 -- 172.21.15.96:0/1280600069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0005040 con 0x7f22b40f55c0 2022-02-02T22:02:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b8d65700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 rx=0x7f22a80093f0 tx=0x7f22a8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a8009ea0 con 0x7f22b40f55c0 2022-02-02T22:02:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22a8013af0 con 0x7f22b40f55c0 2022-02-02T22:02:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b410c7d0 con 0x7f22b40f55c0 2022-02-02T22:02:27.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a800db10 con 0x7f22b40f55c0 2022-02-02T22:02:27.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.837+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b410cd90 con 0x7f22b40f55c0 2022-02-02T22:02:27.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.838+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4045ad0 con 0x7f22b40f55c0 2022-02-02T22:02:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.839+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22a801a060 con 0x7f22b40f55c0 2022-02-02T22:02:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.840+0000 7f22b17fa700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 0x7f22a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.840+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22a8081ee0 con 0x7f22b40f55c0 2022-02-02T22:02:27.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.840+0000 7f22b3fff700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 0x7f22a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:27.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.840+0000 7f22b3fff700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 0x7f22a4067290 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f22a0009da0 tx=0x7f22a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:27.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:27.843+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22a804ffe0 con 0x7f22b40f55c0 2022-02-02T22:02:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.075+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22b40586e0 con 0x7f22b40f55c0 2022-02-02T22:02:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.076+0000 7f22b17fa700 1 -- 172.21.15.96:0/1280600069 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f22a8018070 con 0x7f22b40f55c0 2022-02-02T22:02:28.076 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:02:28.077 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:02:28.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:02:28.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:28.078 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:02:28.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:02:28.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:28.086 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:02:28.087 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:02:28.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:28.088 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:02:28.088 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:02:28.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:28.089 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:02:28.089 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:02:28.089 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:02:28.090 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:02:28.090 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:02:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.077+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 msgr2=0x7f22a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.077+0000 7f22bafc9700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 0x7f22a4067290 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f22a0009da0 tx=0x7f22a0009b30).stop 2022-02-02T22:02:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.077+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 msgr2=0x7f22b4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.077+0000 7f22bafc9700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 rx=0x7f22a80093f0 tx=0x7f22a8006ec0).stop 2022-02-02T22:02:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 shutdown_connections 2022-02-02T22:02:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22a4064dd0 0x7f22a4067290 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22b40f55c0 0x7f22b4109c70 unknown :-1 s=CLOSED pgs=3384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 --2- 172.21.15.96:0/1280600069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b40f6860 0x7f22b410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 >> 172.21.15.96:0/1280600069 conn(0x7f22b40f0d40 msgr2=0x7f22b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 shutdown_connections 2022-02-02T22:02:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.078+0000 7f22bafc9700 1 -- 172.21.15.96:0/1280600069 wait complete. 2022-02-02T22:02:28.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 -- 172.21.15.96:0/1703475820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 msgr2=0x7f4df80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 --2- 172.21.15.96:0/1703475820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df80f7de0 secure :-1 s=READY pgs=3385 cs=0 l=1 rev1=1 rx=0x7f4df4004660 tx=0x7f4df4009b30).stop 2022-02-02T22:02:28.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 -- 172.21.15.96:0/1703475820 shutdown_connections 2022-02-02T22:02:28.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 --2- 172.21.15.96:0/1703475820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df80f7de0 unknown :-1 s=CLOSED pgs=3385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 --2- 172.21.15.96:0/1703475820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 0x7f4df80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:02:28.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 -- 172.21.15.96:0/1703475820 >> 172.21.15.96:0/1703475820 conn(0x7f4df80f1e40 msgr2=0x7f4df80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:28.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 -- 172.21.15.96:0/1703475820 shutdown_connections 2022-02-02T22:02:28.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.175+0000 7f4e0029f700 1 -- 172.21.15.96:0/1703475820 wait complete. 2022-02-02T22:02:28.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 Processor -- start 2022-02-02T22:02:28.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 -- start start 2022-02-02T22:02:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 0x7f4df8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:28.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8107ae0 con 0x7f4df80f7980 2022-02-02T22:02:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4e0029f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8108390 con 0x7f4df80f66e0 2022-02-02T22:02:28.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46226/0 (socket says 172.21.15.96:46226) 2022-02-02T22:02:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 -- 172.21.15.96:0/2052980312 learned_addr learned my addr 172.21.15.96:0/2052980312 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfe03b700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 0x7f4df8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:28.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 -- 172.21.15.96:0/2052980312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 msgr2=0x7f4df8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 0x7f4df8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.176+0000 7f4dfd83a700 1 -- 172.21.15.96:0/2052980312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4005040 con 0x7f4df80f7980 2022-02-02T22:02:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4dfd83a700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 rx=0x7f4df4009990 tx=0x7f4df4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df4018070 con 0x7f4df80f7980 2022-02-02T22:02:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df8108610 con 0x7f4df80f7980 2022-02-02T22:02:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4df4007ca0 con 0x7f4df80f7980 2022-02-02T22:02:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df401c620 con 0x7f4df80f7980 2022-02-02T22:02:28.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.177+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df8108b70 con 0x7f4df80f7980 2022-02-02T22:02:28.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.178+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df80f5ad0 con 0x7f4df80f7980 2022-02-02T22:02:28.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.178+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4df401d960 con 0x7f4df80f7980 2022-02-02T22:02:28.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.179+0000 7f4deeffd700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 0x7f4de4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:28.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.179+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4df40837e0 con 0x7f4df80f7980 2022-02-02T22:02:28.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.179+0000 7f4dfe03b700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 0x7f4de4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:28.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.179+0000 7f4dfe03b700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 0x7f4de4067290 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f4df80f77e0 tx=0x7f4de8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:28.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.183+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4df40553d0 con 0x7f4df80f7980 2022-02-02T22:02:28.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.382+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4df80fef40 con 0x7f4df80f7980 2022-02-02T22:02:28.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.383+0000 7f4deeffd700 1 -- 172.21.15.96:0/2052980312 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4df4054fc0 con 0x7f4df80f7980 2022-02-02T22:02:28.383 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:02:28.384 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:02:28.384 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:02:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:02:28.385 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:02:28.385 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:02:28.386 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:02:28.386 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:02:28.387 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:02:28.387 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:02:28.387 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:02:28.388 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:02:28.388 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:02:28.388 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:02:28.389 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:02:28.390 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:02:28.390 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:02:28.390 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:02:28.391 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:02:28.391 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:02:28.391 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:02:28.392 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:02:28.392 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:02:28.392 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:02:28.393 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:02:28.393 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:02:28.394 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:02:28.394 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:02:28.394 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:02:28.395 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:02:28.395 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:02:28.395 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:28.396 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:28.396 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:02:28.396 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:28.397 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:28.397 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:28.397 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 msgr2=0x7f4de4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 0x7f4de4067290 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f4df80f77e0 tx=0x7f4de8008040).stop 2022-02-02T22:02:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 msgr2=0x7f4df81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 rx=0x7f4df4009990 tx=0x7f4df4009b30).stop 2022-02-02T22:02:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 shutdown_connections 2022-02-02T22:02:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4de4064dd0 0x7f4de4067290 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4df80f66e0 0x7f4df8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 --2- 172.21.15.96:0/2052980312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df80f7980 0x7f4df81074a0 unknown :-1 s=CLOSED pgs=3386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:28.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 >> 172.21.15.96:0/2052980312 conn(0x7f4df80f1e40 msgr2=0x7f4df80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:28.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 shutdown_connections 2022-02-02T22:02:28.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:28.385+0000 7f4e0029f700 1 -- 172.21.15.96:0/2052980312 wait complete. 2022-02-02T22:02:28.403 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:02:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: pgmap v6610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: from='client.40876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:02:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:02:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:02:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1280600069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:02:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2052980312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:02:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: pgmap v6610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: from='client.40876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:02:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:02:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:02:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1280600069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:02:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2052980312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:02:30.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:29 smithi159 ceph-mon[69013]: from='client.40880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:02:30.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:29 smithi096 ceph-mon[101353]: from='client.40880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:02:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:30 smithi159 ceph-mon[69013]: pgmap v6611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:30 smithi096 ceph-mon[101353]: pgmap v6611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:32 smithi159 ceph-mon[69013]: pgmap v6612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:32 smithi096 ceph-mon[101353]: pgmap v6612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:34 smithi159 ceph-mon[69013]: pgmap v6613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:34 smithi096 ceph-mon[101353]: pgmap v6613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:36 smithi159 ceph-mon[69013]: pgmap v6614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:36 smithi096 ceph-mon[101353]: pgmap v6614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:38 smithi159 ceph-mon[69013]: pgmap v6615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:38 smithi096 ceph-mon[101353]: pgmap v6615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:40 smithi159 ceph-mon[69013]: pgmap v6616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:40 smithi096 ceph-mon[101353]: pgmap v6616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:42 smithi159 ceph-mon[69013]: pgmap v6617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:42 smithi096 ceph-mon[101353]: pgmap v6617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:44 smithi159 ceph-mon[69013]: pgmap v6618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:44 smithi096 ceph-mon[101353]: pgmap v6618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:47.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:46 smithi159 ceph-mon[69013]: pgmap v6619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:46 smithi096 ceph-mon[101353]: pgmap v6619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:48 smithi159 ceph-mon[69013]: pgmap v6620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:48 smithi096 ceph-mon[101353]: pgmap v6620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:50 smithi159 ceph-mon[69013]: pgmap v6621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:50 smithi096 ceph-mon[101353]: pgmap v6621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:52 smithi159 ceph-mon[69013]: pgmap v6622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:52 smithi096 ceph-mon[101353]: pgmap v6622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:54 smithi159 ceph-mon[69013]: pgmap v6623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:54 smithi096 ceph-mon[101353]: pgmap v6623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:56 smithi159 ceph-mon[69013]: pgmap v6624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:56 smithi096 ceph-mon[101353]: pgmap v6624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:58.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 -- 172.21.15.96:0/1158019697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 msgr2=0x7fe9480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 --2- 172.21.15.96:0/1158019697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9480f6cc0 secure :-1 s=READY pgs=3387 cs=0 l=1 rev1=1 rx=0x7fe944004660 tx=0x7fe944009b30).stop 2022-02-02T22:02:58.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 -- 172.21.15.96:0/1158019697 shutdown_connections 2022-02-02T22:02:58.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 --2- 172.21.15.96:0/1158019697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9480f6cc0 unknown :-1 s=CLOSED pgs=3387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 --2- 172.21.15.96:0/1158019697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 0x7fe9480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 -- 172.21.15.96:0/1158019697 >> 172.21.15.96:0/1158019697 conn(0x7fe9480f0d40 msgr2=0x7fe9480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 -- 172.21.15.96:0/1158019697 shutdown_connections 2022-02-02T22:02:58.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.494+0000 7fe950501700 1 -- 172.21.15.96:0/1158019697 wait complete. 2022-02-02T22:02:58.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 Processor -- start 2022-02-02T22:02:58.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 -- start start 2022-02-02T22:02:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 0x7fe948105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9481069b0 con 0x7fe9480f6860 2022-02-02T22:02:58.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe950501700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9481071c0 con 0x7fe9480f55c0 2022-02-02T22:02:58.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46244/0 (socket says 172.21.15.96:46244) 2022-02-02T22:02:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 -- 172.21.15.96:0/1511455975 learned_addr learned my addr 172.21.15.96:0/1511455975 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94e29d700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 0x7fe948105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 -- 172.21.15.96:0/1511455975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 msgr2=0x7fe948105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 0x7fe948105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.495+0000 7fe94da9c700 1 -- 172.21.15.96:0/1511455975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944005040 con 0x7fe9480f6860 2022-02-02T22:02:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe94da9c700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 secure :-1 s=READY pgs=3388 cs=0 l=1 rev1=1 rx=0x7fe944009990 tx=0x7fe944009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe944018070 con 0x7fe9480f6860 2022-02-02T22:02:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948107360 con 0x7fe9480f6860 2022-02-02T22:02:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe944007ba0 con 0x7fe9480f6860 2022-02-02T22:02:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe94401c3c0 con 0x7fe9480f6860 2022-02-02T22:02:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.496+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9481078c0 con 0x7fe9480f6860 2022-02-02T22:02:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.497+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe948045ad0 con 0x7fe9480f6860 2022-02-02T22:02:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.497+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe94401d420 con 0x7fe9480f6860 2022-02-02T22:02:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.498+0000 7fe93effd700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 0x7fe934067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.498+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe9440836e0 con 0x7fe9480f6860 2022-02-02T22:02:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.498+0000 7fe94e29d700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 0x7fe934067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.498+0000 7fe94e29d700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 0x7fe934067280 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fe948105c30 tx=0x7fe93800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.503+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe944051780 con 0x7fe9480f6860 2022-02-02T22:02:58.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.682+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9480ff7e0 con 0x7fe934064dc0 2022-02-02T22:02:58.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.684+0000 7fe93effd700 1 -- 172.21.15.96:0/1511455975 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe9480ff7e0 con 0x7fe934064dc0 2022-02-02T22:02:58.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 msgr2=0x7fe934067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 0x7fe934067280 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fe948105c30 tx=0x7fe93800b040).stop 2022-02-02T22:02:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 msgr2=0x7fe9481063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 secure :-1 s=READY pgs=3388 cs=0 l=1 rev1=1 rx=0x7fe944009990 tx=0x7fe944009b30).stop 2022-02-02T22:02:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 shutdown_connections 2022-02-02T22:02:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe934064dc0 0x7fe934067280 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9480f55c0 0x7fe948105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 --2- 172.21.15.96:0/1511455975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9480f6860 0x7fe9481063b0 unknown :-1 s=CLOSED pgs=3388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.685+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 >> 172.21.15.96:0/1511455975 conn(0x7fe9480f0d40 msgr2=0x7fe9480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:58.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.686+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 shutdown_connections 2022-02-02T22:02:58.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.686+0000 7fe950501700 1 -- 172.21.15.96:0/1511455975 wait complete. 2022-02-02T22:02:58.695 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:02:58.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 -- 172.21.15.96:0/1421661311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 msgr2=0x7f928c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 --2- 172.21.15.96:0/1421661311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c0f6950 secure :-1 s=READY pgs=3389 cs=0 l=1 rev1=1 rx=0x7f92840099e0 tx=0x7f9284004d10).stop 2022-02-02T22:02:58.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 -- 172.21.15.96:0/1421661311 shutdown_connections 2022-02-02T22:02:58.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 --2- 172.21.15.96:0/1421661311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 --2- 172.21.15.96:0/1421661311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c0f6950 unknown :-1 s=CLOSED pgs=3389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 -- 172.21.15.96:0/1421661311 >> 172.21.15.96:0/1421661311 conn(0x7f928c0f1c90 msgr2=0x7f928c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:58.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.783+0000 7f928b59e700 1 -- 172.21.15.96:0/1421661311 shutdown_connections 2022-02-02T22:02:58.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:58 smithi096 ceph-mon[101353]: pgmap v6625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:58.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 -- 172.21.15.96:0/1421661311 wait complete. 2022-02-02T22:02:58.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 Processor -- start 2022-02-02T22:02:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 -- start start 2022-02-02T22:02:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06a380 con 0x7f928c0f6530 2022-02-02T22:02:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.785+0000 7f928b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06a4c0 con 0x7f928c0f77d0 2022-02-02T22:02:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46252/0 (socket says 172.21.15.96:46252) 2022-02-02T22:02:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 -- 172.21.15.96:0/2870741393 learned_addr learned my addr 172.21.15.96:0/2870741393 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f9289d9b700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 -- 172.21.15.96:0/2870741393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 msgr2=0x7f928c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 -- 172.21.15.96:0/2870741393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009640 con 0x7f928c0f6530 2022-02-02T22:02:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928a59c700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 secure :-1 s=READY pgs=3390 cs=0 l=1 rev1=1 rx=0x7f928400c010 tx=0x7f9284004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928400e070 con 0x7f928c0f6530 2022-02-02T22:02:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9284007d10 con 0x7f928c0f6530 2022-02-02T22:02:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c06a740 con 0x7f928c0f6530 2022-02-02T22:02:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9284018070 con 0x7f928c0f6530 2022-02-02T22:02:58.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.786+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c06ac20 con 0x7f928c0f6530 2022-02-02T22:02:58.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.787+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c045ad0 con 0x7f928c0f6530 2022-02-02T22:02:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.788+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9284024060 con 0x7f928c0f6530 2022-02-02T22:02:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.788+0000 7f927affd700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.788+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9284083630 con 0x7f928c0f6530 2022-02-02T22:02:58.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.788+0000 7f9289d9b700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:58.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.789+0000 7f9289d9b700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f9280007fd0 tx=0x7f9280009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:58.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.792+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9284051730 con 0x7f928c0f6530 2022-02-02T22:02:58.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.965+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f928c0fed60 con 0x7f9274064e20 2022-02-02T22:02:58.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.974+0000 7f927affd700 1 -- 172.21.15.96:0/2870741393 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f928c0fed60 con 0x7f9274064e20 2022-02-02T22:02:58.974 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:02:58.975 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:02:58.975 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:02:58.975 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:02:58.976 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:02:58.976 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:02:58.976 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:02:58.977 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:02:58.977 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:02:58.977 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:02:58.977 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:02:58.978 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:02:58.978 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:02:58.979 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:02:58.979 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:02:58.979 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:02:58.980 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:02:58.980 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:02:58.980 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:02:58.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:02:58.981 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:02:58.981 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:02:58.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 msgr2=0x7f92740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f9280007fd0 tx=0x7f9280009040).stop 2022-02-02T22:02:58.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 msgr2=0x7f928c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:58.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 secure :-1 s=READY pgs=3390 cs=0 l=1 rev1=1 rx=0x7f928400c010 tx=0x7f9284004d10).stop 2022-02-02T22:02:58.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 shutdown_connections 2022-02-02T22:02:58.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9274064e20 0x7f92740672e0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f928c0f6530 0x7f928c06b9a0 unknown :-1 s=CLOSED pgs=3390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 --2- 172.21.15.96:0/2870741393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0f77d0 0x7f928c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:58.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 >> 172.21.15.96:0/2870741393 conn(0x7f928c0f1c90 msgr2=0x7f928c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:58.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 shutdown_connections 2022-02-02T22:02:58.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:58.976+0000 7f928b59e700 1 -- 172.21.15.96:0/2870741393 wait complete. 2022-02-02T22:02:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:58 smithi159 ceph-mon[69013]: pgmap v6625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:02:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 -- 172.21.15.96:0/3076426753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f55c0 msgr2=0x7fdc900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 --2- 172.21.15.96:0/3076426753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f55c0 0x7fdc900f59e0 secure :-1 s=READY pgs=3391 cs=0 l=1 rev1=1 rx=0x7fdc880099e0 tx=0x7fdc88004d10).stop 2022-02-02T22:02:59.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 -- 172.21.15.96:0/3076426753 shutdown_connections 2022-02-02T22:02:59.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 --2- 172.21.15.96:0/3076426753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f6860 0x7fdc900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 --2- 172.21.15.96:0/3076426753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f55c0 0x7fdc900f59e0 unknown :-1 s=CLOSED pgs=3391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 -- 172.21.15.96:0/3076426753 >> 172.21.15.96:0/3076426753 conn(0x7fdc900f0d40 msgr2=0x7fdc900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 -- 172.21.15.96:0/3076426753 shutdown_connections 2022-02-02T22:02:59.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.072+0000 7fdc95437700 1 -- 172.21.15.96:0/3076426753 wait complete. 2022-02-02T22:02:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 Processor -- start 2022-02-02T22:02:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 -- start start 2022-02-02T22:02:59.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 0x7fdc90109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90109d30 con 0x7fdc900f6860 2022-02-02T22:02:59.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc95437700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90109e70 con 0x7fdc900f55c0 2022-02-02T22:02:59.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc8e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc8e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46264/0 (socket says 172.21.15.96:46264) 2022-02-02T22:02:59.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc8e7fc700 1 -- 172.21.15.96:0/3286736132 learned_addr learned my addr 172.21.15.96:0/3286736132 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:59.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.073+0000 7fdc8effd700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 0x7fdc90109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc8e7fc700 1 -- 172.21.15.96:0/3286736132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 msgr2=0x7fdc90109290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc8e7fc700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 0x7fdc90109290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc8e7fc700 1 -- 172.21.15.96:0/3286736132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009640 con 0x7fdc900f6860 2022-02-02T22:02:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc8effd700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 0x7fdc90109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:02:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc8e7fc700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 rx=0x7fdc8400c530 tx=0x7fdc84007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8400f650 con 0x7fdc900f6860 2022-02-02T22:02:59.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9010a810 con 0x7fdc900f6860 2022-02-02T22:02:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc8400fc60 con 0x7fdc900f6860 2022-02-02T22:02:59.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc84012cd0 con 0x7fdc900f6860 2022-02-02T22:02:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.074+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9010ad50 con 0x7fdc900f6860 2022-02-02T22:02:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.075+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc90045ad0 con 0x7fdc900f6860 2022-02-02T22:02:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.075+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc84010070 con 0x7fdc900f6860 2022-02-02T22:02:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.076+0000 7fdc777fe700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 0x7fdc78067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.076+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc840817b0 con 0x7fdc900f6860 2022-02-02T22:02:59.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.076+0000 7fdc8effd700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 0x7fdc78067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.076+0000 7fdc8effd700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 0x7fdc78067270 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fdc88009f50 tx=0x7fdc88004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:59.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.080+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc840532e0 con 0x7fdc900f6860 2022-02-02T22:02:59.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.312+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc90027a00 con 0x7fdc900f6860 2022-02-02T22:02:59.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.312+0000 7fdc777fe700 1 -- 172.21.15.96:0/3286736132 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdc84052ed0 con 0x7fdc900f6860 2022-02-02T22:02:59.313 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:02:59.313 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:02:59.314 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:02:59.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:59.315 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:02:59.315 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:02:59.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:59.316 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:02:59.316 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:02:59.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:59.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:02:59.317 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:02:59.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:02:59.318 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:02:59.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:02:59.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:02:59.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:02:59.319 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:02:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 msgr2=0x7fdc78067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 0x7fdc78067270 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fdc88009f50 tx=0x7fdc88004d10).stop 2022-02-02T22:02:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 msgr2=0x7fdc90109780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 rx=0x7fdc8400c530 tx=0x7fdc84007e20).stop 2022-02-02T22:02:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 shutdown_connections 2022-02-02T22:02:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdc78064db0 0x7fdc78067270 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc900f55c0 0x7fdc90109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 --2- 172.21.15.96:0/3286736132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc900f6860 0x7fdc90109780 unknown :-1 s=CLOSED pgs=3392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 >> 172.21.15.96:0/3286736132 conn(0x7fdc900f0d40 msgr2=0x7fdc900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 shutdown_connections 2022-02-02T22:02:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.314+0000 7fdc95437700 1 -- 172.21.15.96:0/3286736132 wait complete. 2022-02-02T22:02:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 -- 172.21.15.96:0/1757251645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f7980 msgr2=0x7f919c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 --2- 172.21.15.96:0/1757251645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f7980 0x7f919c0f7de0 secure :-1 s=READY pgs=3393 cs=0 l=1 rev1=1 rx=0x7f918c004660 tx=0x7f918c009b30).stop 2022-02-02T22:02:59.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 -- 172.21.15.96:0/1757251645 shutdown_connections 2022-02-02T22:02:59.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 --2- 172.21.15.96:0/1757251645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f7980 0x7f919c0f7de0 unknown :-1 s=CLOSED pgs=3393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 --2- 172.21.15.96:0/1757251645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f66e0 0x7f919c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:02:59.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 -- 172.21.15.96:0/1757251645 >> 172.21.15.96:0/1757251645 conn(0x7f919c0f1e40 msgr2=0x7f919c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:59.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 -- 172.21.15.96:0/1757251645 shutdown_connections 2022-02-02T22:02:59.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.414+0000 7f91a221b700 1 -- 172.21.15.96:0/1757251645 wait complete. 2022-02-02T22:02:59.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.415+0000 7f91a221b700 1 Processor -- start 2022-02-02T22:02:59.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.415+0000 7f91a221b700 1 -- start start 2022-02-02T22:02:59.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.415+0000 7f91a221b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.415+0000 7f91a221b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f7980 0x7f919c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f91a221b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c06a410 con 0x7f919c0f66e0 2022-02-02T22:02:59.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f91a221b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c06a550 con 0x7f919c0f7980 2022-02-02T22:02:59.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46272/0 (socket says 172.21.15.96:46272) 2022-02-02T22:02:59.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 -- 172.21.15.96:0/233517158 learned_addr learned my addr 172.21.15.96:0/233517158 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:02:59.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919affd700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f7980 0x7f919c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 -- 172.21.15.96:0/233517158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f7980 msgr2=0x7f919c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f7980 0x7f919c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 -- 172.21.15.96:0/233517158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c005040 con 0x7f919c0f66e0 2022-02-02T22:02:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f919b7fe700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 rx=0x7f91900093f0 tx=0x7f9190006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9190013640 con 0x7f919c0f66e0 2022-02-02T22:02:59.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9190013c50 con 0x7f919c0f66e0 2022-02-02T22:02:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c06a830 con 0x7f919c0f66e0 2022-02-02T22:02:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.416+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c10efe0 con 0x7f919c0f66e0 2022-02-02T22:02:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.417+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9190012c70 con 0x7f919c0f66e0 2022-02-02T22:02:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.417+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c004fa0 con 0x7f919c0f66e0 2022-02-02T22:02:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.418+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f919001a060 con 0x7f919c0f66e0 2022-02-02T22:02:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.418+0000 7f9183fff700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 0x7f9184067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:02:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.418+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9190081990 con 0x7f919c0f66e0 2022-02-02T22:02:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.418+0000 7f919affd700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 0x7f9184067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:02:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.419+0000 7f919affd700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 0x7f9184067290 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f918c004630 tx=0x7f918c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:02:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.422+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f919004fa30 con 0x7f919c0f66e0 2022-02-02T22:02:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.626+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f917c005e80 con 0x7f919c0f66e0 2022-02-02T22:02:59.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.627+0000 7f9183fff700 1 -- 172.21.15.96:0/233517158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9190053050 con 0x7f919c0f66e0 2022-02-02T22:02:59.628 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:02:59.628 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:02:59.629 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:02:59.629 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:02:59.630 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:59.630 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:02:59.630 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:02:59.631 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:02:59.631 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:02:59.631 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:02:59.632 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:02:59.632 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:02:59.633 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:02:59.633 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:02:59.633 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:02:59.634 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:02:59.634 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:02:59.634 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:02:59.635 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:02:59.635 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:02:59.635 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:02:59.636 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:02:59.636 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:02:59.637 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:02:59.637 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:02:59.637 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:02:59.638 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:02:59.638 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:02:59.639 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:02:59.639 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:02:59.639 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:02:59.640 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:02:59.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:59.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:59.641 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:02:59.641 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:02:59.641 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:59.642 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:59.642 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:02:59.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 msgr2=0x7f9184067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 0x7f9184067290 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f918c004630 tx=0x7f918c009b30).stop 2022-02-02T22:02:59.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 msgr2=0x7f919c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:02:59.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 rx=0x7f91900093f0 tx=0x7f9190006ec0).stop 2022-02-02T22:02:59.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 shutdown_connections 2022-02-02T22:02:59.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9184064dd0 0x7f9184067290 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f919c0f66e0 0x7f919c06b9a0 unknown :-1 s=CLOSED pgs=3394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 --2- 172.21.15.96:0/233517158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f919c0f7980 0x7f919c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:02:59.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 >> 172.21.15.96:0/233517158 conn(0x7f919c0f1e40 msgr2=0x7f919c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:02:59.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 shutdown_connections 2022-02-02T22:02:59.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:02:59.629+0000 7f91a221b700 1 -- 172.21.15.96:0/233517158 wait complete. 2022-02-02T22:02:59.647 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:02:59.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:02:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3286736132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:03:00.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:02:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3286736132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:03:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:00 smithi159 ceph-mon[69013]: from='client.40892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:00 smithi159 ceph-mon[69013]: pgmap v6626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:00 smithi159 ceph-mon[69013]: from='client.40896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/233517158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:03:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:00 smithi096 ceph-mon[101353]: from='client.40892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:00 smithi096 ceph-mon[101353]: pgmap v6626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:00 smithi096 ceph-mon[101353]: from='client.40896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/233517158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:03:02.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:01 smithi159 ceph-mon[69013]: pgmap v6627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:02.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:01 smithi096 ceph-mon[101353]: pgmap v6627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:04.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:04 smithi159 ceph-mon[69013]: pgmap v6628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:04 smithi096 ceph-mon[101353]: pgmap v6628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:06.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:06 smithi159 ceph-mon[69013]: pgmap v6629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:06.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:06 smithi096 ceph-mon[101353]: pgmap v6629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:08.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:08 smithi159 ceph-mon[69013]: pgmap v6630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:08 smithi096 ceph-mon[101353]: pgmap v6630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:10.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:10 smithi159 ceph-mon[69013]: pgmap v6631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:10.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:10 smithi096 ceph-mon[101353]: pgmap v6631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:12.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:12 smithi159 ceph-mon[69013]: pgmap v6632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:12 smithi096 ceph-mon[101353]: pgmap v6632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:14 smithi159 ceph-mon[69013]: pgmap v6633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:14 smithi096 ceph-mon[101353]: pgmap v6633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:16 smithi159 ceph-mon[69013]: pgmap v6634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:16.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:16 smithi096 ceph-mon[101353]: pgmap v6634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:18.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:18 smithi159 ceph-mon[69013]: pgmap v6635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:18 smithi096 ceph-mon[101353]: pgmap v6635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:20.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:20 smithi096 ceph-mon[101353]: pgmap v6636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:20 smithi159 ceph-mon[69013]: pgmap v6636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:22 smithi096 ceph-mon[101353]: pgmap v6637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:22 smithi159 ceph-mon[69013]: pgmap v6637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:24 smithi096 ceph-mon[101353]: pgmap v6638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:24 smithi159 ceph-mon[69013]: pgmap v6638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:26.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:26 smithi096 ceph-mon[101353]: pgmap v6639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:26 smithi159 ceph-mon[69013]: pgmap v6639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:28 smithi096 ceph-mon[101353]: pgmap v6640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:03:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:03:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:28 smithi159 ceph-mon[69013]: pgmap v6640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:03:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:03:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 -- 172.21.15.96:0/845130813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f77d0 msgr2=0x7fb2180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/845130813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f77d0 0x7fb2180f7c30 secure :-1 s=READY pgs=3395 cs=0 l=1 rev1=1 rx=0x7fb200004660 tx=0x7fb200009b30).stop 2022-02-02T22:03:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 -- 172.21.15.96:0/845130813 shutdown_connections 2022-02-02T22:03:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/845130813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f77d0 0x7fb2180f7c30 unknown :-1 s=CLOSED pgs=3395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/845130813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f6530 0x7fb2180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:03:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 -- 172.21.15.96:0/845130813 >> 172.21.15.96:0/845130813 conn(0x7fb2180f1c90 msgr2=0x7fb2180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 -- 172.21.15.96:0/845130813 shutdown_connections 2022-02-02T22:03:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.738+0000 7fb21ca3f700 1 -- 172.21.15.96:0/845130813 wait complete. 2022-02-02T22:03:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 Processor -- start 2022-02-02T22:03:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 -- start start 2022-02-02T22:03:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f77d0 0x7fb218069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21806a410 con 0x7fb2180f6530 2022-02-02T22:03:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb21ca3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21806a550 con 0x7fb2180f77d0 2022-02-02T22:03:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb2177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb2177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46294/0 (socket says 172.21.15.96:46294) 2022-02-02T22:03:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb2177fe700 1 -- 172.21.15.96:0/3072933549 learned_addr learned my addr 172.21.15.96:0/3072933549 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:03:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.739+0000 7fb216ffd700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f77d0 0x7fb218069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb2177fe700 1 -- 172.21.15.96:0/3072933549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f77d0 msgr2=0x7fb218069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb2177fe700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f77d0 0x7fb218069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb2177fe700 1 -- 172.21.15.96:0/3072933549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200005040 con 0x7fb2180f6530 2022-02-02T22:03:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb2177fe700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 rx=0x7fb2100093f0 tx=0x7fb210006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb210013640 con 0x7fb2180f6530 2022-02-02T22:03:29.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21806a830 con 0x7fb2180f6530 2022-02-02T22:03:29.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb210013c50 con 0x7fb2180f6530 2022-02-02T22:03:29.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb210012c70 con 0x7fb2180f6530 2022-02-02T22:03:29.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.740+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21810edc0 con 0x7fb2180f6530 2022-02-02T22:03:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.741+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb218045ad0 con 0x7fb2180f6530 2022-02-02T22:03:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.741+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb21001a060 con 0x7fb2180f6530 2022-02-02T22:03:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.742+0000 7fb20ffff700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 0x7fb2040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.742+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb210081900 con 0x7fb2180f6530 2022-02-02T22:03:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.742+0000 7fb216ffd700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 0x7fb2040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.742+0000 7fb216ffd700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 0x7fb2040672e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7fb200004630 tx=0x7fb200009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.746+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb21004f9a0 con 0x7fb2180f6530 2022-02-02T22:03:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.924+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb218057f10 con 0x7fb204064e20 2022-02-02T22:03:29.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.925+0000 7fb20ffff700 1 -- 172.21.15.96:0/3072933549 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb218057f10 con 0x7fb204064e20 2022-02-02T22:03:29.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 msgr2=0x7fb2040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:29.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 0x7fb2040672e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7fb200004630 tx=0x7fb200009b30).stop 2022-02-02T22:03:29.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 msgr2=0x7fb21806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:29.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 rx=0x7fb2100093f0 tx=0x7fb210006ec0).stop 2022-02-02T22:03:29.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 shutdown_connections 2022-02-02T22:03:29.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb204064e20 0x7fb2040672e0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:29.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2180f6530 0x7fb21806b9a0 unknown :-1 s=CLOSED pgs=3396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 --2- 172.21.15.96:0/3072933549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2180f77d0 0x7fb218069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 >> 172.21.15.96:0/3072933549 conn(0x7fb2180f1c90 msgr2=0x7fb2180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:29.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 shutdown_connections 2022-02-02T22:03:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:29.927+0000 7fb21ca3f700 1 -- 172.21.15.96:0/3072933549 wait complete. 2022-02-02T22:03:29.937 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:03:30.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 -- 172.21.15.96:0/250158250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f66e0 msgr2=0x7f37680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 --2- 172.21.15.96:0/250158250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f66e0 0x7f37680f6b00 secure :-1 s=READY pgs=3397 cs=0 l=1 rev1=1 rx=0x7f375c004660 tx=0x7f375c009b30).stop 2022-02-02T22:03:30.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 -- 172.21.15.96:0/250158250 shutdown_connections 2022-02-02T22:03:30.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 --2- 172.21.15.96:0/250158250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f7980 0x7f37680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 --2- 172.21.15.96:0/250158250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f66e0 0x7f37680f6b00 unknown :-1 s=CLOSED pgs=3397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 -- 172.21.15.96:0/250158250 >> 172.21.15.96:0/250158250 conn(0x7f37680f1e40 msgr2=0x7f37680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 -- 172.21.15.96:0/250158250 shutdown_connections 2022-02-02T22:03:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.024+0000 7f376cefe700 1 -- 172.21.15.96:0/250158250 wait complete. 2022-02-02T22:03:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 Processor -- start 2022-02-02T22:03:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 -- start start 2022-02-02T22:03:30.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f66e0 0x7f3768106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768107a50 con 0x7f37680f7980 2022-02-02T22:03:30.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376cefe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768107b90 con 0x7f37680f66e0 2022-02-02T22:03:30.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46306/0 (socket says 172.21.15.96:46306) 2022-02-02T22:03:30.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 -- 172.21.15.96:0/3296263824 learned_addr learned my addr 172.21.15.96:0/3296263824 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:03:30.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f376659c700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f66e0 0x7f3768106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 -- 172.21.15.96:0/3296263824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f66e0 msgr2=0x7f3768106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f66e0 0x7f3768106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.025+0000 7f3765d9b700 1 -- 172.21.15.96:0/3296263824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c005040 con 0x7f37680f7980 2022-02-02T22:03:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f3765d9b700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 rx=0x7f375800c790 tx=0x7f3758007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3758002590 con 0x7f37680f7980 2022-02-02T22:03:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3758002ba0 con 0x7f37680f7980 2022-02-02T22:03:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3758013d90 con 0x7f37680f7980 2022-02-02T22:03:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3768108530 con 0x7f37680f7980 2022-02-02T22:03:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.026+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3768108af0 con 0x7f37680f7980 2022-02-02T22:03:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.027+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768045ad0 con 0x7f37680f7980 2022-02-02T22:03:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.027+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f375801a060 con 0x7f37680f7980 2022-02-02T22:03:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.027+0000 7f3756ffd700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 0x7f3750067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.028+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3758081c00 con 0x7f37680f7980 2022-02-02T22:03:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.028+0000 7f376659c700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 0x7f3750067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.028+0000 7f376659c700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 0x7f3750067290 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f375c004630 tx=0x7f375c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.032+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3758087020 con 0x7f37680f7980 2022-02-02T22:03:30.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.209+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37680ff010 con 0x7f3750064dd0 2022-02-02T22:03:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.218+0000 7f3756ffd700 1 -- 172.21.15.96:0/3296263824 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f37680ff010 con 0x7f3750064dd0 2022-02-02T22:03:30.219 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:03:30.219 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:03:30.220 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:03:30.220 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:03:30.220 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:03:30.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:03:30.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:03:30.221 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:03:30.222 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:03:30.222 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:03:30.222 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:03:30.223 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:03:30.223 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:03:30.224 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:03:30.224 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:03:30.224 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:03:30.225 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:03:30.225 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:03:30.225 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:03:30.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:03:30.226 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:03:30.226 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:03:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 msgr2=0x7f3750067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 0x7f3750067290 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f375c004630 tx=0x7f375c009b30).stop 2022-02-02T22:03:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 msgr2=0x7f37681074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 rx=0x7f375800c790 tx=0x7f3758007d70).stop 2022-02-02T22:03:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 shutdown_connections 2022-02-02T22:03:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3750064dd0 0x7f3750067290 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37680f66e0 0x7f3768106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 --2- 172.21.15.96:0/3296263824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680f7980 0x7f37681074a0 unknown :-1 s=CLOSED pgs=3398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 >> 172.21.15.96:0/3296263824 conn(0x7f37680f1e40 msgr2=0x7f37680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 shutdown_connections 2022-02-02T22:03:30.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.220+0000 7f376cefe700 1 -- 172.21.15.96:0/3296263824 wait complete. 2022-02-02T22:03:30.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:30 smithi096 ceph-mon[101353]: pgmap v6641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 -- 172.21.15.96:0/2261126936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f77d0 msgr2=0x7f33580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 --2- 172.21.15.96:0/2261126936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f77d0 0x7f33580f7c30 secure :-1 s=READY pgs=3399 cs=0 l=1 rev1=1 rx=0x7f334c004660 tx=0x7f334c009b30).stop 2022-02-02T22:03:30.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 -- 172.21.15.96:0/2261126936 shutdown_connections 2022-02-02T22:03:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 --2- 172.21.15.96:0/2261126936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f77d0 0x7f33580f7c30 unknown :-1 s=CLOSED pgs=3399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 --2- 172.21.15.96:0/2261126936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f6530 0x7f33580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.315+0000 7f335ca32700 1 -- 172.21.15.96:0/2261126936 >> 172.21.15.96:0/2261126936 conn(0x7f33580f1c90 msgr2=0x7f33580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.316+0000 7f335ca32700 1 -- 172.21.15.96:0/2261126936 shutdown_connections 2022-02-02T22:03:30.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.316+0000 7f335ca32700 1 -- 172.21.15.96:0/2261126936 wait complete. 2022-02-02T22:03:30.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.316+0000 7f335ca32700 1 Processor -- start 2022-02-02T22:03:30.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.316+0000 7f335ca32700 1 -- start start 2022-02-02T22:03:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f335ca32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f335ca32700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 0x7f3358107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f335ca32700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3358107880 con 0x7f33580f6530 2022-02-02T22:03:30.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f335ca32700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3358108090 con 0x7f33580f77d0 2022-02-02T22:03:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46314/0 (socket says 172.21.15.96:46314) 2022-02-02T22:03:30.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 -- 172.21.15.96:0/3101170523 learned_addr learned my addr 172.21.15.96:0/3101170523 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:03:30.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f3356ffd700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 0x7f3358107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 -- 172.21.15.96:0/3101170523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 msgr2=0x7f3358107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 0x7f3358107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 -- 172.21.15.96:0/3101170523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c005040 con 0x7f33580f6530 2022-02-02T22:03:30.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f3356ffd700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 0x7f3358107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:03:30.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f33577fe700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 rx=0x7f3348002700 tx=0x7f3348009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.317+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3348009320 con 0x7f33580f6530 2022-02-02T22:03:30.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.318+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f334800f040 con 0x7f33580f6530 2022-02-02T22:03:30.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.318+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3348014900 con 0x7f33580f6530 2022-02-02T22:03:30.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.318+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3358108310 con 0x7f33580f6530 2022-02-02T22:03:30.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.318+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3358108880 con 0x7f33580f6530 2022-02-02T22:03:30.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.319+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3358059100 con 0x7f33580f6530 2022-02-02T22:03:30.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.319+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f33480077b0 con 0x7f33580f6530 2022-02-02T22:03:30.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.319+0000 7f333ffff700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 0x7f33400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.320+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3348081c90 con 0x7f33580f6530 2022-02-02T22:03:30.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.320+0000 7f3356ffd700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 0x7f33400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.320+0000 7f3356ffd700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 0x7f33400672e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f334c009da0 tx=0x7f334c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.324+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f334804fd90 con 0x7f33580f6530 2022-02-02T22:03:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:30 smithi159 ceph-mon[69013]: pgmap v6641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:30.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.553+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33580fecf0 con 0x7f33580f6530 2022-02-02T22:03:30.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.553+0000 7f333ffff700 1 -- 172.21.15.96:0/3101170523 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f33480533b0 con 0x7f33580f6530 2022-02-02T22:03:30.555 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:03:30.556 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:03:30.556 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:03:30.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:03:30.557 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:03:30.557 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:03:30.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:03:30.558 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:03:30.558 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:03:30.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:03:30.559 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:03:30.559 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:03:30.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:03:30.560 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:03:30.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:03:30.561 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:03:30.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:03:30.562 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:03:30.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 msgr2=0x7f33400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 0x7f33400672e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f334c009da0 tx=0x7f334c009b30).stop 2022-02-02T22:03:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 msgr2=0x7f3358106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 rx=0x7f3348002700 tx=0x7f3348009d80).stop 2022-02-02T22:03:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 shutdown_connections 2022-02-02T22:03:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3340064e20 0x7f33400672e0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33580f6530 0x7f3358106d90 unknown :-1 s=CLOSED pgs=3400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 --2- 172.21.15.96:0/3101170523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33580f77d0 0x7f3358107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 >> 172.21.15.96:0/3101170523 conn(0x7f33580f1c90 msgr2=0x7f33580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 shutdown_connections 2022-02-02T22:03:30.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.555+0000 7f335ca32700 1 -- 172.21.15.96:0/3101170523 wait complete. 2022-02-02T22:03:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 -- 172.21.15.96:0/2434779587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 msgr2=0x7f15800f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 --2- 172.21.15.96:0/2434779587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f15800f5850 secure :-1 s=READY pgs=3401 cs=0 l=1 rev1=1 rx=0x7f1570004660 tx=0x7f1570009b30).stop 2022-02-02T22:03:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 -- 172.21.15.96:0/2434779587 shutdown_connections 2022-02-02T22:03:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 --2- 172.21.15.96:0/2434779587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 0x7f15800f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 --2- 172.21.15.96:0/2434779587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f15800f5850 unknown :-1 s=CLOSED pgs=3401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 -- 172.21.15.96:0/2434779587 >> 172.21.15.96:0/2434779587 conn(0x7f15800f0b90 msgr2=0x7f15800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.652+0000 7f15857d1700 1 -- 172.21.15.96:0/2434779587 shutdown_connections 2022-02-02T22:03:30.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.653+0000 7f15857d1700 1 -- 172.21.15.96:0/2434779587 wait complete. 2022-02-02T22:03:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.653+0000 7f15857d1700 1 Processor -- start 2022-02-02T22:03:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.653+0000 7f15857d1700 1 -- start start 2022-02-02T22:03:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f15857d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f15857d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 0x7f158010d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f15857d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158010de40 con 0x7f15800f5430 2022-02-02T22:03:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f15857d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158010df80 con 0x7f15800f66d0 2022-02-02T22:03:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46322/0 (socket says 172.21.15.96:46322) 2022-02-02T22:03:30.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 -- 172.21.15.96:0/3860776803 learned_addr learned my addr 172.21.15.96:0/3860776803 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:03:30.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157f7fe700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 0x7f158010d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 -- 172.21.15.96:0/3860776803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 msgr2=0x7f158010d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 0x7f158010d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 -- 172.21.15.96:0/3860776803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570005040 con 0x7f15800f5430 2022-02-02T22:03:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157ffff700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 secure :-1 s=READY pgs=3402 cs=0 l=1 rev1=1 rx=0x7f1570004f60 tx=0x7f1570009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.654+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1570018070 con 0x7f15800f5430 2022-02-02T22:03:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.655+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1570007ba0 con 0x7f15800f5430 2022-02-02T22:03:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.655+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157001c620 con 0x7f15800f5430 2022-02-02T22:03:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.655+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158010e8c0 con 0x7f15800f5430 2022-02-02T22:03:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.655+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158010eda0 con 0x7f15800f5430 2022-02-02T22:03:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.656+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580045ad0 con 0x7f15800f5430 2022-02-02T22:03:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.657+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f157001d420 con 0x7f15800f5430 2022-02-02T22:03:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.658+0000 7f157cff9700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 0x7f15680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:03:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.658+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1570083600 con 0x7f15800f5430 2022-02-02T22:03:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.658+0000 7f157f7fe700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 0x7f15680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:03:30.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.658+0000 7f157f7fe700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 0x7f15680672e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f1574007fd0 tx=0x7f1574009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:03:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.662+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1570055130 con 0x7f15800f5430 2022-02-02T22:03:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.864+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f158010f570 con 0x7f15800f5430 2022-02-02T22:03:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.864+0000 7f157cff9700 1 -- 172.21.15.96:0/3860776803 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1570054d20 con 0x7f15800f5430 2022-02-02T22:03:30.866 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:03:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:03:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:03:30.868 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:03:30.868 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:03:30.869 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:03:30.869 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:03:30.870 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:03:30.870 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:03:30.871 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:03:30.871 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:03:30.871 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:03:30.872 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:03:30.872 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:03:30.872 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:03:30.873 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:03:30.873 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:03:30.874 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:03:30.874 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:03:30.874 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:03:30.875 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:03:30.875 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:03:30.875 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:03:30.876 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:03:30.876 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:03:30.877 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:03:30.877 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:03:30.877 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:03:30.878 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:03:30.878 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:03:30.878 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:03:30.879 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:03:30.879 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:03:30.880 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:03:30.880 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:03:30.880 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:03:30.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:03:30.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:03:30.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:03:30.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 msgr2=0x7f15680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 0x7f15680672e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f1574007fd0 tx=0x7f1574009040).stop 2022-02-02T22:03:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 msgr2=0x7f158010d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:03:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 secure :-1 s=READY pgs=3402 cs=0 l=1 rev1=1 rx=0x7f1570004f60 tx=0x7f1570009b30).stop 2022-02-02T22:03:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 shutdown_connections 2022-02-02T22:03:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1568064e20 0x7f15680672e0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15800f5430 0x7f158010d3a0 unknown :-1 s=CLOSED pgs=3402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 --2- 172.21.15.96:0/3860776803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15800f66d0 0x7f158010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:03:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 >> 172.21.15.96:0/3860776803 conn(0x7f15800f0b90 msgr2=0x7f158005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:03:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 shutdown_connections 2022-02-02T22:03:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:03:30.866+0000 7f15857d1700 1 -- 172.21.15.96:0/3860776803 wait complete. 2022-02-02T22:03:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:03:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:31 smithi096 ceph-mon[101353]: from='client.40908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:31 smithi096 ceph-mon[101353]: from='client.40912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3101170523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:03:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3860776803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:03:31.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:31 smithi159 ceph-mon[69013]: from='client.40908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:31 smithi159 ceph-mon[69013]: from='client.40912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:03:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3101170523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:03:31.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3860776803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:03:32.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:32 smithi096 ceph-mon[101353]: pgmap v6642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:32 smithi159 ceph-mon[69013]: pgmap v6642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:34.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:34 smithi096 ceph-mon[101353]: pgmap v6643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:34 smithi159 ceph-mon[69013]: pgmap v6643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:36 smithi096 ceph-mon[101353]: pgmap v6644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:36.573 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:36 smithi159 ceph-mon[69013]: pgmap v6644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:38 smithi159 ceph-mon[69013]: pgmap v6645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:38 smithi096 ceph-mon[101353]: pgmap v6645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:40 smithi159 ceph-mon[69013]: pgmap v6646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:40 smithi096 ceph-mon[101353]: pgmap v6646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:42.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:42 smithi159 ceph-mon[69013]: pgmap v6647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:42 smithi096 ceph-mon[101353]: pgmap v6647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:44.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:44 smithi159 ceph-mon[69013]: pgmap v6648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:44 smithi096 ceph-mon[101353]: pgmap v6648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:46 smithi159 ceph-mon[69013]: pgmap v6649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:46 smithi096 ceph-mon[101353]: pgmap v6649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:48 smithi159 ceph-mon[69013]: pgmap v6650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:48 smithi096 ceph-mon[101353]: pgmap v6650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:50 smithi159 ceph-mon[69013]: pgmap v6651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:50 smithi096 ceph-mon[101353]: pgmap v6651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:52 smithi159 ceph-mon[69013]: pgmap v6652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:52 smithi096 ceph-mon[101353]: pgmap v6652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:54 smithi159 ceph-mon[69013]: pgmap v6653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:54 smithi096 ceph-mon[101353]: pgmap v6653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:56 smithi159 ceph-mon[69013]: pgmap v6654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:56 smithi096 ceph-mon[101353]: pgmap v6654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:58.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:03:58 smithi159 ceph-mon[69013]: pgmap v6655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:03:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:03:58 smithi096 ceph-mon[101353]: pgmap v6655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:00 smithi159 ceph-mon[69013]: pgmap v6656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:00 smithi096 ceph-mon[101353]: pgmap v6656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:00.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 -- 172.21.15.96:0/1367439119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 msgr2=0x7fb2740fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 --2- 172.21.15.96:0/1367439119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740fbc90 secure :-1 s=READY pgs=3403 cs=0 l=1 rev1=1 rx=0x7fb270004660 tx=0x7fb270009b30).stop 2022-02-02T22:04:00.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 -- 172.21.15.96:0/1367439119 shutdown_connections 2022-02-02T22:04:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 --2- 172.21.15.96:0/1367439119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740fbc90 unknown :-1 s=CLOSED pgs=3403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 --2- 172.21.15.96:0/1367439119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 0x7fb2740f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:00.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 -- 172.21.15.96:0/1367439119 >> 172.21.15.96:0/1367439119 conn(0x7fb2740f0d40 msgr2=0x7fb2740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:00.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 -- 172.21.15.96:0/1367439119 shutdown_connections 2022-02-02T22:04:00.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.978+0000 7fb27c428700 1 -- 172.21.15.96:0/1367439119 wait complete. 2022-02-02T22:04:00.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 Processor -- start 2022-02-02T22:04:00.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 -- start start 2022-02-02T22:04:00.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 0x7fb2740f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740f5780 con 0x7fb2740f98a0 2022-02-02T22:04:00.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27c428700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740f58c0 con 0x7fb2740603d0 2022-02-02T22:04:00.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:00.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46340/0 (socket says 172.21.15.96:46340) 2022-02-02T22:04:00.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 -- 172.21.15.96:0/582436646 learned_addr learned my addr 172.21.15.96:0/582436646 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:00.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb27a1c4700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 0x7fb2740f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:00.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 -- 172.21.15.96:0/582436646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 msgr2=0x7fb2740f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:00.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 0x7fb2740f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:00.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.979+0000 7fb2799c3700 1 -- 172.21.15.96:0/582436646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270005040 con 0x7fb2740f98a0 2022-02-02T22:04:00.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb2799c3700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 secure :-1 s=READY pgs=3404 cs=0 l=1 rev1=1 rx=0x7fb270004f60 tx=0x7fb270009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:00.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb270018070 con 0x7fb2740f98a0 2022-02-02T22:04:00.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2740f5b40 con 0x7fb2740f98a0 2022-02-02T22:04:00.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb270009770 con 0x7fb2740f98a0 2022-02-02T22:04:00.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27001c3c0 con 0x7fb2740f98a0 2022-02-02T22:04:00.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.980+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2740f60a0 con 0x7fb2740f98a0 2022-02-02T22:04:00.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.981+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb274045ad0 con 0x7fb2740f98a0 2022-02-02T22:04:00.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.981+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb27001d420 con 0x7fb2740f98a0 2022-02-02T22:04:00.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.982+0000 7fb26affd700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 0x7fb260067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:00.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.982+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb270083840 con 0x7fb2740f98a0 2022-02-02T22:04:00.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.982+0000 7fb27a1c4700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 0x7fb260067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:00.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.982+0000 7fb27a1c4700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 0x7fb260067290 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fb2640041d0 tx=0x7fb264009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:00.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:00.986+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb270051a00 con 0x7fb2740f98a0 2022-02-02T22:04:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.164+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb274057f10 con 0x7fb260064dd0 2022-02-02T22:04:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.166+0000 7fb26affd700 1 -- 172.21.15.96:0/582436646 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb274057f10 con 0x7fb260064dd0 2022-02-02T22:04:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 msgr2=0x7fb260067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 0x7fb260067290 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fb2640041d0 tx=0x7fb264009040).stop 2022-02-02T22:04:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 msgr2=0x7fb2740f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 secure :-1 s=READY pgs=3404 cs=0 l=1 rev1=1 rx=0x7fb270004f60 tx=0x7fb270009b30).stop 2022-02-02T22:04:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 shutdown_connections 2022-02-02T22:04:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb260064dd0 0x7fb260067290 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2740603d0 0x7fb2740f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 --2- 172.21.15.96:0/582436646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740f98a0 0x7fb2740f5220 unknown :-1 s=CLOSED pgs=3404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 >> 172.21.15.96:0/582436646 conn(0x7fb2740f0d40 msgr2=0x7fb2740f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:01.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 shutdown_connections 2022-02-02T22:04:01.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.168+0000 7fb27c428700 1 -- 172.21.15.96:0/582436646 wait complete. 2022-02-02T22:04:01.177 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:04:01.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 -- 172.21.15.96:0/2899923651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 msgr2=0x7f70200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 --2- 172.21.15.96:0/2899923651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f70200f59e0 secure :-1 s=READY pgs=3405 cs=0 l=1 rev1=1 rx=0x7f701c004660 tx=0x7f701c009b30).stop 2022-02-02T22:04:01.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 -- 172.21.15.96:0/2899923651 shutdown_connections 2022-02-02T22:04:01.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 --2- 172.21.15.96:0/2899923651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 0x7f70200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:04:01.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 --2- 172.21.15.96:0/2899923651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f70200f59e0 unknown :-1 s=CLOSED pgs=3405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 -- 172.21.15.96:0/2899923651 >> 172.21.15.96:0/2899923651 conn(0x7f70200f0d40 msgr2=0x7f70200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:01.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 -- 172.21.15.96:0/2899923651 shutdown_connections 2022-02-02T22:04:01.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.265+0000 7f70278d1700 1 -- 172.21.15.96:0/2899923651 wait complete. 2022-02-02T22:04:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 Processor -- start 2022-02-02T22:04:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 -- start start 2022-02-02T22:04:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 0x7f7020107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020107a90 con 0x7f70200f55c0 2022-02-02T22:04:01.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f70278d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020108340 con 0x7f70200f6860 2022-02-02T22:04:01.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46348/0 (socket says 172.21.15.96:46348) 2022-02-02T22:04:01.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 -- 172.21.15.96:0/260318306 learned_addr learned my addr 172.21.15.96:0/260318306 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:01.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f7024e6c700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 0x7f7020107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 -- 172.21.15.96:0/260318306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 msgr2=0x7f7020107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 0x7f7020107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.266+0000 7f702566d700 1 -- 172.21.15.96:0/260318306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c005040 con 0x7f70200f55c0 2022-02-02T22:04:01.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f702566d700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 secure :-1 s=READY pgs=3406 cs=0 l=1 rev1=1 rx=0x7f701c004f60 tx=0x7f701c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:01.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c018070 con 0x7f70200f55c0 2022-02-02T22:04:01.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f701c007ba0 con 0x7f70200f55c0 2022-02-02T22:04:01.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70201085c0 con 0x7f70200f55c0 2022-02-02T22:04:01.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c01c620 con 0x7f70200f55c0 2022-02-02T22:04:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.267+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020108b20 con 0x7f70200f55c0 2022-02-02T22:04:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.268+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70200f49b0 con 0x7f70200f55c0 2022-02-02T22:04:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.268+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f701c01c8e0 con 0x7f70200f55c0 2022-02-02T22:04:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.269+0000 7f7015ffb700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 0x7f700c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.269+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f701c083940 con 0x7f70200f55c0 2022-02-02T22:04:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.269+0000 7f7024e6c700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 0x7f700c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.269+0000 7f7024e6c700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 0x7f700c067290 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7f701000b790 tx=0x7f7010008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.273+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f701c055470 con 0x7f70200f55c0 2022-02-02T22:04:01.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.444+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f70200faca0 con 0x7f700c064dd0 2022-02-02T22:04:01.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.454+0000 7f7015ffb700 1 -- 172.21.15.96:0/260318306 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f70200faca0 con 0x7f700c064dd0 2022-02-02T22:04:01.454 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:04:01.454 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:04:01.455 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:04:01.455 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:04:01.455 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:04:01.456 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:04:01.456 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:04:01.456 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:04:01.457 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:04:01.457 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:04:01.457 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:04:01.458 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:04:01.458 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:04:01.459 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:04:01.459 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:04:01.459 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:04:01.460 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:04:01.460 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:04:01.460 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:04:01.461 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:04:01.461 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:04:01.461 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:04:01.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 msgr2=0x7f700c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 0x7f700c067290 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7f701000b790 tx=0x7f7010008040).stop 2022-02-02T22:04:01.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 msgr2=0x7f7020106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 secure :-1 s=READY pgs=3406 cs=0 l=1 rev1=1 rx=0x7f701c004f60 tx=0x7f701c009b30).stop 2022-02-02T22:04:01.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 shutdown_connections 2022-02-02T22:04:01.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f700c064dd0 0x7f700c067290 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70200f55c0 0x7f7020106f60 unknown :-1 s=CLOSED pgs=3406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 --2- 172.21.15.96:0/260318306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70200f6860 0x7f7020107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 >> 172.21.15.96:0/260318306 conn(0x7f70200f0d40 msgr2=0x7f702005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:01.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.456+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 shutdown_connections 2022-02-02T22:04:01.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.457+0000 7f70278d1700 1 -- 172.21.15.96:0/260318306 wait complete. 2022-02-02T22:04:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 -- 172.21.15.96:0/4182318623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f66e0 msgr2=0x7f54340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 --2- 172.21.15.96:0/4182318623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f66e0 0x7f54340f6b00 secure :-1 s=READY pgs=3407 cs=0 l=1 rev1=1 rx=0x7f5430004660 tx=0x7f5430009b30).stop 2022-02-02T22:04:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 -- 172.21.15.96:0/4182318623 shutdown_connections 2022-02-02T22:04:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 --2- 172.21.15.96:0/4182318623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f7980 0x7f54340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 --2- 172.21.15.96:0/4182318623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f66e0 0x7f54340f6b00 unknown :-1 s=CLOSED pgs=3407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.552+0000 7f543b499700 1 -- 172.21.15.96:0/4182318623 >> 172.21.15.96:0/4182318623 conn(0x7f54340f1e40 msgr2=0x7f54340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:01.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 -- 172.21.15.96:0/4182318623 shutdown_connections 2022-02-02T22:04:01.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 -- 172.21.15.96:0/4182318623 wait complete. 2022-02-02T22:04:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 Processor -- start 2022-02-02T22:04:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 -- start start 2022-02-02T22:04:01.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f66e0 0x7f5434106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434107a50 con 0x7f54340f7980 2022-02-02T22:04:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.553+0000 7f543b499700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434107b90 con 0x7f54340f66e0 2022-02-02T22:04:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46360/0 (socket says 172.21.15.96:46360) 2022-02-02T22:04:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 -- 172.21.15.96:0/2979390345 learned_addr learned my addr 172.21.15.96:0/2979390345 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5439235700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f66e0 0x7f5434106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 -- 172.21.15.96:0/2979390345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f66e0 msgr2=0x7f5434106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f66e0 0x7f5434106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 -- 172.21.15.96:0/2979390345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430005040 con 0x7f54340f7980 2022-02-02T22:04:01.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5438a34700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 secure :-1 s=READY pgs=3408 cs=0 l=1 rev1=1 rx=0x7f54280026d0 tx=0x7f5428009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5428009320 con 0x7f54340f7980 2022-02-02T22:04:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f542800f040 con 0x7f54340f7980 2022-02-02T22:04:01.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5434108530 con 0x7f54340f7980 2022-02-02T22:04:01.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54280147e0 con 0x7f54340f7980 2022-02-02T22:04:01.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.554+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5434108af0 con 0x7f54340f7980 2022-02-02T22:04:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.556+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5434045ad0 con 0x7f54340f7980 2022-02-02T22:04:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.556+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5428009480 con 0x7f54340f7980 2022-02-02T22:04:01.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.556+0000 7f5425ffb700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.556+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5428082090 con 0x7f54340f7980 2022-02-02T22:04:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.556+0000 7f5439235700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:01.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.557+0000 7f5439235700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 0x7f5420067290 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f5430004630 tx=0x7f5430009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:01.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.560+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5428053bc0 con 0x7f54340f7980 2022-02-02T22:04:01.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.790+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5434027a00 con 0x7f54340f7980 2022-02-02T22:04:01.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.790+0000 7f5425ffb700 1 -- 172.21.15.96:0/2979390345 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f54280537b0 con 0x7f54340f7980 2022-02-02T22:04:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:04:01.791 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:04:01.792 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:04:01.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:01.792 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:04:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:04:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:04:01.794 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:04:01.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:01.794 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:04:01.795 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:04:01.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:01.795 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:04:01.796 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:04:01.796 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:04:01.796 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:04:01.797 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:04:01.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 msgr2=0x7f5420067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 0x7f5420067290 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f5430004630 tx=0x7f5430009b30).stop 2022-02-02T22:04:01.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 msgr2=0x7f54341074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:01.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 secure :-1 s=READY pgs=3408 cs=0 l=1 rev1=1 rx=0x7f54280026d0 tx=0x7f5428009de0).stop 2022-02-02T22:04:01.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 shutdown_connections 2022-02-02T22:04:01.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54340f66e0 0x7f5434106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 --2- 172.21.15.96:0/2979390345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54340f7980 0x7f54341074a0 unknown :-1 s=CLOSED pgs=3408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:01.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 >> 172.21.15.96:0/2979390345 conn(0x7f54340f1e40 msgr2=0x7f54340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:01.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 shutdown_connections 2022-02-02T22:04:01.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.792+0000 7f543b499700 1 -- 172.21.15.96:0/2979390345 wait complete. 2022-02-02T22:04:01.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 -- 172.21.15.96:0/3283297957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f66d0 msgr2=0x7f998c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:02.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 --2- 172.21.15.96:0/3283297957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f66d0 0x7f998c0f6b30 secure :-1 s=READY pgs=3409 cs=0 l=1 rev1=1 rx=0x7f997c004660 tx=0x7f997c009b30).stop 2022-02-02T22:04:02.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 -- 172.21.15.96:0/3283297957 shutdown_connections 2022-02-02T22:04:02.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 --2- 172.21.15.96:0/3283297957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f66d0 0x7f998c0f6b30 unknown :-1 s=CLOSED pgs=3409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:02.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 --2- 172.21.15.96:0/3283297957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998c0f5430 0x7f998c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:04:02.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 -- 172.21.15.96:0/3283297957 >> 172.21.15.96:0/3283297957 conn(0x7f998c0f0b90 msgr2=0x7f998c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:02.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 -- 172.21.15.96:0/3283297957 shutdown_connections 2022-02-02T22:04:02.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.890+0000 7f9992a9f700 1 -- 172.21.15.96:0/3283297957 wait complete. 2022-02-02T22:04:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 Processor -- start 2022-02-02T22:04:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 -- start start 2022-02-02T22:04:02.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998c0f66d0 0x7f998c106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c106860 con 0x7f998c0f5430 2022-02-02T22:04:02.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.891+0000 7f9992a9f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c106fd0 con 0x7f998c0f66d0 2022-02-02T22:04:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46374/0 (socket says 172.21.15.96:46374) 2022-02-02T22:04:02.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 -- 172.21.15.96:0/1323787896 learned_addr learned my addr 172.21.15.96:0/1323787896 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 -- 172.21.15.96:0/1323787896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998c0f66d0 msgr2=0x7f998c106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998c0f66d0 0x7f998c106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:04:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 -- 172.21.15.96:0/1323787896 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c005040 con 0x7f998c0f5430 2022-02-02T22:04:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9991a9d700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 rx=0x7f998800d9a0 tx=0x7f9988006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998800eb00 con 0x7f998c0f5430 2022-02-02T22:04:02.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9988012070 con 0x7f998c0f5430 2022-02-02T22:04:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c1072b0 con 0x7f998c0f5430 2022-02-02T22:04:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9988015330 con 0x7f998c0f5430 2022-02-02T22:04:02.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.892+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c107870 con 0x7f998c0f5430 2022-02-02T22:04:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.893+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c045ad0 con 0x7f998c0f5430 2022-02-02T22:04:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.894+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f998801e070 con 0x7f998c0f5430 2022-02-02T22:04:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.894+0000 7f99827fc700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 0x7f99780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.894+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9988083cc0 con 0x7f998c0f5430 2022-02-02T22:04:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.894+0000 7f999129c700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 0x7f99780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.894+0000 7f999129c700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 0x7f99780672e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f997c004e30 tx=0x7f997c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:01.898+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99880557f0 con 0x7f998c0f5430 2022-02-02T22:04:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.102+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f998c0ff7a0 con 0x7f998c0f5430 2022-02-02T22:04:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.102+0000 7f99827fc700 1 -- 172.21.15.96:0/1323787896 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f99880553e0 con 0x7f998c0f5430 2022-02-02T22:04:02.115 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:04:02.115 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:04:02.116 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:04:02.116 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:04:02.116 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:02.117 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:04:02.117 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:04:02.117 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:04:02.118 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:04:02.118 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:04:02.118 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:04:02.119 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:04:02.119 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:04:02.119 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:04:02.120 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:04:02.120 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:04:02.120 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:04:02.121 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:04:02.121 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:04:02.121 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:04:02.122 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:04:02.122 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:04:02.122 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:04:02.123 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:04:02.123 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:04:02.123 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:04:02.124 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:04:02.124 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:04:02.124 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:04:02.125 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:04:02.125 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:04:02.125 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:04:02.126 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:02.126 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:02.126 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:04:02.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:02.127 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:02.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:02.128 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:02.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 msgr2=0x7f99780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:02.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 0x7f99780672e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f997c004e30 tx=0x7f997c009b30).stop 2022-02-02T22:04:02.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 msgr2=0x7f998c105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:02.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 rx=0x7f998800d9a0 tx=0x7f9988006f50).stop 2022-02-02T22:04:02.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 shutdown_connections 2022-02-02T22:04:02.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9978064e20 0x7f99780672e0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:02.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f998c0f5430 0x7f998c105d30 unknown :-1 s=CLOSED pgs=3410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:02.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 --2- 172.21.15.96:0/1323787896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998c0f66d0 0x7f998c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:04:02.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 >> 172.21.15.96:0/1323787896 conn(0x7f998c0f0b90 msgr2=0x7f998c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:02.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 shutdown_connections 2022-02-02T22:04:02.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:02.104+0000 7f9992a9f700 1 -- 172.21.15.96:0/1323787896 wait complete. 2022-02-02T22:04:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:04:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:02 smithi096 ceph-mon[101353]: pgmap v6657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:02.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:02 smithi096 ceph-mon[101353]: from='client.40924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:02.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:02 smithi096 ceph-mon[101353]: from='client.40928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:02.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2979390345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:04:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:02 smithi159 ceph-mon[69013]: pgmap v6657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:02 smithi159 ceph-mon[69013]: from='client.40924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:02.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:02 smithi159 ceph-mon[69013]: from='client.40928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:02.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2979390345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:04:03.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1323787896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:04:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1323787896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:04:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:04 smithi159 ceph-mon[69013]: pgmap v6658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:04 smithi096 ceph-mon[101353]: pgmap v6658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:06 smithi159 ceph-mon[69013]: pgmap v6659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:06 smithi096 ceph-mon[101353]: pgmap v6659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:08.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:08 smithi159 ceph-mon[69013]: pgmap v6660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:08 smithi096 ceph-mon[101353]: pgmap v6660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:10.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:10 smithi159 ceph-mon[69013]: pgmap v6661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:10 smithi096 ceph-mon[101353]: pgmap v6661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:12 smithi159 ceph-mon[69013]: pgmap v6662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:12.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:12 smithi096 ceph-mon[101353]: pgmap v6662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:14.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:14 smithi159 ceph-mon[69013]: pgmap v6663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:14 smithi096 ceph-mon[101353]: pgmap v6663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:16 smithi159 ceph-mon[69013]: pgmap v6664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:16 smithi096 ceph-mon[101353]: pgmap v6664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:18.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:18 smithi159 ceph-mon[69013]: pgmap v6665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:18.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:18 smithi096 ceph-mon[101353]: pgmap v6665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:20 smithi159 ceph-mon[69013]: pgmap v6666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:20 smithi096 ceph-mon[101353]: pgmap v6666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:22.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:22 smithi159 ceph-mon[69013]: pgmap v6667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:22 smithi096 ceph-mon[101353]: pgmap v6667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:24 smithi159 ceph-mon[69013]: pgmap v6668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:24 smithi096 ceph-mon[101353]: pgmap v6668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:26 smithi159 ceph-mon[69013]: pgmap v6669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:26 smithi096 ceph-mon[101353]: pgmap v6669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:28 smithi159 ceph-mon[69013]: pgmap v6670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:04:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:04:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:28 smithi096 ceph-mon[101353]: pgmap v6670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:04:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:04:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:30 smithi159 ceph-mon[69013]: pgmap v6671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:30 smithi096 ceph-mon[101353]: pgmap v6671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:32.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 -- 172.21.15.96:0/682514576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f66d0 msgr2=0x7f91940f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 --2- 172.21.15.96:0/682514576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f66d0 0x7f91940f6b30 secure :-1 s=READY pgs=3411 cs=0 l=1 rev1=1 rx=0x7f9184004660 tx=0x7f9184009b30).stop 2022-02-02T22:04:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 -- 172.21.15.96:0/682514576 shutdown_connections 2022-02-02T22:04:32.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 --2- 172.21.15.96:0/682514576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f66d0 0x7f91940f6b30 unknown :-1 s=CLOSED pgs=3411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 --2- 172.21.15.96:0/682514576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f5430 0x7f91940f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 -- 172.21.15.96:0/682514576 >> 172.21.15.96:0/682514576 conn(0x7f91940f0b90 msgr2=0x7f91940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 -- 172.21.15.96:0/682514576 shutdown_connections 2022-02-02T22:04:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.216+0000 7f919adef700 1 -- 172.21.15.96:0/682514576 wait complete. 2022-02-02T22:04:32.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 Processor -- start 2022-02-02T22:04:32.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 -- start start 2022-02-02T22:04:32.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f66d0 0x7f919410bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194060420 con 0x7f91940f5430 2022-02-02T22:04:32.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f919adef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194060560 con 0x7f91940f66d0 2022-02-02T22:04:32.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f9199ded700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f9199ded700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46394/0 (socket says 172.21.15.96:46394) 2022-02-02T22:04:32.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f9199ded700 1 -- 172.21.15.96:0/2045380659 learned_addr learned my addr 172.21.15.96:0/2045380659 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:32.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.217+0000 7f91995ec700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f66d0 0x7f919410bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f9199ded700 1 -- 172.21.15.96:0/2045380659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f66d0 msgr2=0x7f919410bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f9199ded700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f66d0 0x7f919410bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f9199ded700 1 -- 172.21.15.96:0/2045380659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184005040 con 0x7f91940f5430 2022-02-02T22:04:32.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f9199ded700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 secure :-1 s=READY pgs=3412 cs=0 l=1 rev1=1 rx=0x7f919000c510 tx=0x7f9190007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919000f650 con 0x7f91940f5430 2022-02-02T22:04:32.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f919000fc60 con 0x7f91940f5430 2022-02-02T22:04:32.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919410c520 con 0x7f91940f5430 2022-02-02T22:04:32.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9190012cb0 con 0x7f91940f5430 2022-02-02T22:04:32.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.218+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919410cab0 con 0x7f91940f5430 2022-02-02T22:04:32.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.219+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9194059100 con 0x7f91940f5430 2022-02-02T22:04:32.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.220+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9190010070 con 0x7f91940f5430 2022-02-02T22:04:32.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.220+0000 7f918a7fc700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 0x7f91800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.220+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9190081400 con 0x7f91940f5430 2022-02-02T22:04:32.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.220+0000 7f91995ec700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 0x7f91800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.220+0000 7f91995ec700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 0x7f91800672e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f9184004e30 tx=0x7f9184009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.224+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f919004f5b0 con 0x7f91940f5430 2022-02-02T22:04:32.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.402+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91940fddc0 con 0x7f9180064e20 2022-02-02T22:04:32.403 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:32 smithi096 ceph-mon[101353]: pgmap v6672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:32.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.403+0000 7f918a7fc700 1 -- 172.21.15.96:0/2045380659 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9184019040 con 0x7f9180064e20 2022-02-02T22:04:32.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 msgr2=0x7f91800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 0x7f91800672e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f9184004e30 tx=0x7f9184009b30).stop 2022-02-02T22:04:32.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 msgr2=0x7f9194109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 secure :-1 s=READY pgs=3412 cs=0 l=1 rev1=1 rx=0x7f919000c510 tx=0x7f9190007df0).stop 2022-02-02T22:04:32.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 shutdown_connections 2022-02-02T22:04:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9180064e20 0x7f91800672e0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91940f5430 0x7f9194109a10 unknown :-1 s=CLOSED pgs=3412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 --2- 172.21.15.96:0/2045380659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91940f66d0 0x7f919410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 >> 172.21.15.96:0/2045380659 conn(0x7f91940f0b90 msgr2=0x7f91940fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 shutdown_connections 2022-02-02T22:04:32.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.405+0000 7f919adef700 1 -- 172.21.15.96:0/2045380659 wait complete. 2022-02-02T22:04:32.415 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:04:32.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- 172.21.15.96:0/1634969573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f7980 msgr2=0x7faccc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 --2- 172.21.15.96:0/1634969573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f7980 0x7faccc0f7de0 secure :-1 s=READY pgs=3413 cs=0 l=1 rev1=1 rx=0x7facc8004660 tx=0x7facc8009b30).stop 2022-02-02T22:04:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- 172.21.15.96:0/1634969573 shutdown_connections 2022-02-02T22:04:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 --2- 172.21.15.96:0/1634969573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f7980 0x7faccc0f7de0 unknown :-1 s=CLOSED pgs=3413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 --2- 172.21.15.96:0/1634969573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f66e0 0x7faccc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- 172.21.15.96:0/1634969573 >> 172.21.15.96:0/1634969573 conn(0x7faccc0f1e40 msgr2=0x7faccc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- 172.21.15.96:0/1634969573 shutdown_connections 2022-02-02T22:04:32.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- 172.21.15.96:0/1634969573 wait complete. 2022-02-02T22:04:32.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 Processor -- start 2022-02-02T22:04:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.502+0000 7facd43c3700 1 -- start start 2022-02-02T22:04:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f7980 0x7faccc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc06a380 con 0x7faccc0f66e0 2022-02-02T22:04:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc06a4c0 con 0x7faccc0f7980 2022-02-02T22:04:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46404/0 (socket says 172.21.15.96:46404) 2022-02-02T22:04:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 -- 172.21.15.96:0/1543879535 learned_addr learned my addr 172.21.15.96:0/1543879535 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd195e700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f7980 0x7faccc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 -- 172.21.15.96:0/1543879535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f7980 msgr2=0x7faccc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f7980 0x7faccc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 -- 172.21.15.96:0/1543879535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8005040 con 0x7faccc0f66e0 2022-02-02T22:04:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd215f700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 secure :-1 s=READY pgs=3414 cs=0 l=1 rev1=1 rx=0x7facbc002700 tx=0x7facbc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facbc009320 con 0x7faccc0f66e0 2022-02-02T22:04:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7facbc00f040 con 0x7faccc0f66e0 2022-02-02T22:04:32.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc06a7a0 con 0x7faccc0f66e0 2022-02-02T22:04:32.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facbc014900 con 0x7faccc0f66e0 2022-02-02T22:04:32.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.503+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc10ef90 con 0x7faccc0f66e0 2022-02-02T22:04:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.504+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc045ad0 con 0x7faccc0f66e0 2022-02-02T22:04:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.505+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7facbc009480 con 0x7faccc0f66e0 2022-02-02T22:04:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.505+0000 7facc2ffd700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 0x7facb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.505+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7facbc081cc0 con 0x7faccc0f66e0 2022-02-02T22:04:32.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.505+0000 7facd195e700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 0x7facb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.506+0000 7facd195e700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 0x7facb8067290 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7facc8004630 tx=0x7facc8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.509+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7facbc04fe80 con 0x7faccc0f66e0 2022-02-02T22:04:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:32 smithi159 ceph-mon[69013]: pgmap v6672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.681+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faccc057f10 con 0x7facb8064dd0 2022-02-02T22:04:32.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.690+0000 7facc2ffd700 1 -- 172.21.15.96:0/1543879535 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faccc057f10 con 0x7facb8064dd0 2022-02-02T22:04:32.690 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:04:32.691 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:04:32.691 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:04:32.692 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:04:32.692 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:04:32.692 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:04:32.693 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:04:32.693 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:04:32.693 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:04:32.694 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:04:32.694 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:04:32.694 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:04:32.695 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:04:32.695 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:04:32.695 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:04:32.696 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:04:32.696 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:04:32.696 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:04:32.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:04:32.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:04:32.697 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:04:32.698 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:04:32.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 msgr2=0x7facb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 0x7facb8067290 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7facc8004630 tx=0x7facc8009b30).stop 2022-02-02T22:04:32.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 msgr2=0x7faccc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 secure :-1 s=READY pgs=3414 cs=0 l=1 rev1=1 rx=0x7facbc002700 tx=0x7facbc009d80).stop 2022-02-02T22:04:32.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 shutdown_connections 2022-02-02T22:04:32.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7facb8064dd0 0x7facb8067290 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faccc0f66e0 0x7faccc06b9a0 unknown :-1 s=CLOSED pgs=3414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 --2- 172.21.15.96:0/1543879535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faccc0f7980 0x7faccc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.692+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 >> 172.21.15.96:0/1543879535 conn(0x7faccc0f1e40 msgr2=0x7faccc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:32.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.693+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 shutdown_connections 2022-02-02T22:04:32.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.693+0000 7facd43c3700 1 -- 172.21.15.96:0/1543879535 wait complete. 2022-02-02T22:04:32.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 -- 172.21.15.96:0/4022766616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f6860 msgr2=0x7fe1040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 --2- 172.21.15.96:0/4022766616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f6860 0x7fe1040f6cc0 secure :-1 s=READY pgs=3415 cs=0 l=1 rev1=1 rx=0x7fe0f0004660 tx=0x7fe0f0009b30).stop 2022-02-02T22:04:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 -- 172.21.15.96:0/4022766616 shutdown_connections 2022-02-02T22:04:32.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 --2- 172.21.15.96:0/4022766616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f6860 0x7fe1040f6cc0 unknown :-1 s=CLOSED pgs=3415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 --2- 172.21.15.96:0/4022766616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f55c0 0x7fe1040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 -- 172.21.15.96:0/4022766616 >> 172.21.15.96:0/4022766616 conn(0x7fe1040f0d40 msgr2=0x7fe1040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:32.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 -- 172.21.15.96:0/4022766616 shutdown_connections 2022-02-02T22:04:32.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.789+0000 7fe10afd0700 1 -- 172.21.15.96:0/4022766616 wait complete. 2022-02-02T22:04:32.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 Processor -- start 2022-02-02T22:04:32.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 -- start start 2022-02-02T22:04:32.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 0x7fe10410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040603e0 con 0x7fe1040f55c0 2022-02-02T22:04:32.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe10afd0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe104060520 con 0x7fe1040f6860 2022-02-02T22:04:32.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46414/0 (socket says 172.21.15.96:46414) 2022-02-02T22:04:32.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 -- 172.21.15.96:0/2047112264 learned_addr learned my addr 172.21.15.96:0/2047112264 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:32.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe103fff700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 0x7fe10410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 -- 172.21.15.96:0/2047112264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 msgr2=0x7fe10410c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:32.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 0x7fe10410c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:32.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe108d6c700 1 -- 172.21.15.96:0/2047112264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f0005040 con 0x7fe1040f55c0 2022-02-02T22:04:32.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.790+0000 7fe103fff700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 0x7fe10410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:04:32.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe108d6c700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 secure :-1 s=READY pgs=3416 cs=0 l=1 rev1=1 rx=0x7fe0f800e7c0 tx=0x7fe0f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0f80092e0 con 0x7fe1040f55c0 2022-02-02T22:04:32.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0f800f040 con 0x7fe1040f55c0 2022-02-02T22:04:32.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0f8014750 con 0x7fe1040f55c0 2022-02-02T22:04:32.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10410c670 con 0x7fe1040f55c0 2022-02-02T22:04:32.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.791+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10410cc30 con 0x7fe1040f55c0 2022-02-02T22:04:32.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.792+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe104045ad0 con 0x7fe1040f55c0 2022-02-02T22:04:32.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.792+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0f801b030 con 0x7fe1040f55c0 2022-02-02T22:04:32.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.793+0000 7fe1017fa700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 0x7fe0f40672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:32.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.793+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0f8081bd0 con 0x7fe1040f55c0 2022-02-02T22:04:32.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.793+0000 7fe103fff700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 0x7fe0f40672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:32.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.793+0000 7fe103fff700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 0x7fe0f40672d0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7fe0f0004d80 tx=0x7fe0f000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:32.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:32.797+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0f804fc10 con 0x7fe1040f55c0 2022-02-02T22:04:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.031+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1040fde80 con 0x7fe1040f55c0 2022-02-02T22:04:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.032+0000 7fe1017fa700 1 -- 172.21.15.96:0/2047112264 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe0f80192e0 con 0x7fe1040f55c0 2022-02-02T22:04:33.035 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:04:33.035 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:04:33.036 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:04:33.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:33.036 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:04:33.037 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:04:33.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:33.037 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:04:33.038 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:04:33.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:33.038 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:04:33.039 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:04:33.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:04:33.039 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:04:33.040 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:04:33.040 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:04:33.040 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:04:33.041 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:04:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 msgr2=0x7fe0f40672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 0x7fe0f40672d0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7fe0f0004d80 tx=0x7fe0f000b040).stop 2022-02-02T22:04:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 msgr2=0x7fe104109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 secure :-1 s=READY pgs=3416 cs=0 l=1 rev1=1 rx=0x7fe0f800e7c0 tx=0x7fe0f800b040).stop 2022-02-02T22:04:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 shutdown_connections 2022-02-02T22:04:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0f4064e10 0x7fe0f40672d0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1040f55c0 0x7fe104109bc0 unknown :-1 s=CLOSED pgs=3416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 --2- 172.21.15.96:0/2047112264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1040f6860 0x7fe10410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 >> 172.21.15.96:0/2047112264 conn(0x7fe1040f0d40 msgr2=0x7fe1040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 shutdown_connections 2022-02-02T22:04:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.034+0000 7fe10afd0700 1 -- 172.21.15.96:0/2047112264 wait complete. 2022-02-02T22:04:33.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 -- 172.21.15.96:0/3692779058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 msgr2=0x7f4c700f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 --2- 172.21.15.96:0/3692779058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c700f6b00 secure :-1 s=READY pgs=3417 cs=0 l=1 rev1=1 rx=0x7f4c60004660 tx=0x7f4c60009b30).stop 2022-02-02T22:04:33.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 -- 172.21.15.96:0/3692779058 shutdown_connections 2022-02-02T22:04:33.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 --2- 172.21.15.96:0/3692779058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c700f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:04:33.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 --2- 172.21.15.96:0/3692779058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c700f6b00 unknown :-1 s=CLOSED pgs=3417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 -- 172.21.15.96:0/3692779058 >> 172.21.15.96:0/3692779058 conn(0x7f4c700f1e40 msgr2=0x7f4c700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:33.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.131+0000 7f4c7523c700 1 -- 172.21.15.96:0/3692779058 shutdown_connections 2022-02-02T22:04:33.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 -- 172.21.15.96:0/3692779058 wait complete. 2022-02-02T22:04:33.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 Processor -- start 2022-02-02T22:04:33.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 -- start start 2022-02-02T22:04:33.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:33.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c701074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:33.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70107ae0 con 0x7f4c700f66e0 2022-02-02T22:04:33.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c7523c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70108390 con 0x7f4c700f7980 2022-02-02T22:04:33.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.132+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:33.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46424/0 (socket says 172.21.15.96:46424) 2022-02-02T22:04:33.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 -- 172.21.15.96:0/4237207857 learned_addr learned my addr 172.21.15.96:0/4237207857 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:04:33.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 -- 172.21.15.96:0/4237207857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 msgr2=0x7f4c701074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6e59c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c701074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:33.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c701074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 -- 172.21.15.96:0/4237207857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60005040 con 0x7f4c700f66e0 2022-02-02T22:04:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6e59c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c701074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:04:33.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c6ed9d700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 secure :-1 s=READY pgs=3418 cs=0 l=1 rev1=1 rx=0x7f4c60004f60 tx=0x7f4c60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c60018070 con 0x7f4c700f66e0 2022-02-02T22:04:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c70108610 con 0x7f4c700f66e0 2022-02-02T22:04:33.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c60007ba0 con 0x7f4c700f66e0 2022-02-02T22:04:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6001c620 con 0x7f4c700f66e0 2022-02-02T22:04:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.133+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c70108b70 con 0x7f4c700f66e0 2022-02-02T22:04:33.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.134+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700f5ad0 con 0x7f4c700f66e0 2022-02-02T22:04:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.134+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c6001c8e0 con 0x7f4c700f66e0 2022-02-02T22:04:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.135+0000 7f4c577fe700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 0x7f4c58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:04:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.135+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4c60083940 con 0x7f4c700f66e0 2022-02-02T22:04:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.135+0000 7f4c6e59c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 0x7f4c58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:04:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.135+0000 7f4c6e59c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 0x7f4c58067290 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f4c6400a7e0 tx=0x7f4c64008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:04:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.139+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c60055470 con 0x7f4c700f66e0 2022-02-02T22:04:33.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:33 smithi096 ceph-mon[101353]: from='client.40940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:33.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2047112264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:04:33.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.342+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4c700fef70 con 0x7f4c700f66e0 2022-02-02T22:04:33.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.343+0000 7f4c577fe700 1 -- 172.21.15.96:0/4237207857 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4c60055060 con 0x7f4c700f66e0 2022-02-02T22:04:33.344 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:04:33.344 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:04:33.344 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:04:33.345 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:04:33.345 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:33.346 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:04:33.346 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:04:33.346 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:04:33.347 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:04:33.347 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:04:33.347 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:04:33.348 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:04:33.348 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:04:33.348 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:04:33.349 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:04:33.350 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:04:33.350 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:04:33.350 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:04:33.351 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:04:33.351 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:04:33.352 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:04:33.352 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:04:33.352 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:04:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:04:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:04:33.354 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:04:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:04:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:04:33.355 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:04:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:04:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:04:33.356 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:04:33.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:33.358 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:33.358 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:04:33.359 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:04:33.359 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:33.360 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:33.360 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:04:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 msgr2=0x7f4c58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 0x7f4c58067290 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f4c6400a7e0 tx=0x7f4c64008040).stop 2022-02-02T22:04:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 msgr2=0x7f4c70106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:04:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 secure :-1 s=READY pgs=3418 cs=0 l=1 rev1=1 rx=0x7f4c60004f60 tx=0x7f4c60009b30).stop 2022-02-02T22:04:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 shutdown_connections 2022-02-02T22:04:33.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4c58064dd0 0x7f4c58067290 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c700f66e0 0x7f4c70106fb0 unknown :-1 s=CLOSED pgs=3418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 --2- 172.21.15.96:0/4237207857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c700f7980 0x7f4c701074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:04:33.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 >> 172.21.15.96:0/4237207857 conn(0x7f4c700f1e40 msgr2=0x7f4c700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:04:33.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 shutdown_connections 2022-02-02T22:04:33.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:04:33.345+0000 7f4c7523c700 1 -- 172.21.15.96:0/4237207857 wait complete. 2022-02-02T22:04:33.367 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:04:33.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:33 smithi159 ceph-mon[69013]: from='client.40940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2047112264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:04:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:34 smithi159 ceph-mon[69013]: from='client.40944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:34 smithi159 ceph-mon[69013]: pgmap v6673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:34.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4237207857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:04:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:34 smithi096 ceph-mon[101353]: from='client.40944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:04:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:34 smithi096 ceph-mon[101353]: pgmap v6673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4237207857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:04:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:36 smithi159 ceph-mon[69013]: pgmap v6674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:36 smithi096 ceph-mon[101353]: pgmap v6674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:38 smithi159 ceph-mon[69013]: pgmap v6675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:38 smithi096 ceph-mon[101353]: pgmap v6675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:40 smithi159 ceph-mon[69013]: pgmap v6676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:40 smithi096 ceph-mon[101353]: pgmap v6676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:42 smithi159 ceph-mon[69013]: pgmap v6677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:42 smithi096 ceph-mon[101353]: pgmap v6677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:44 smithi159 ceph-mon[69013]: pgmap v6678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:44 smithi096 ceph-mon[101353]: pgmap v6678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:46 smithi159 ceph-mon[69013]: pgmap v6679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:46 smithi096 ceph-mon[101353]: pgmap v6679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:48 smithi159 ceph-mon[69013]: pgmap v6680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:48 smithi096 ceph-mon[101353]: pgmap v6680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:50 smithi159 ceph-mon[69013]: pgmap v6681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:50 smithi096 ceph-mon[101353]: pgmap v6681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:52 smithi159 ceph-mon[69013]: pgmap v6682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:52 smithi096 ceph-mon[101353]: pgmap v6682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:54 smithi159 ceph-mon[69013]: pgmap v6683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:54 smithi096 ceph-mon[101353]: pgmap v6683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:56 smithi159 ceph-mon[69013]: pgmap v6684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:56 smithi096 ceph-mon[101353]: pgmap v6684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:04:58 smithi159 ceph-mon[69013]: pgmap v6685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:04:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:04:58 smithi096 ceph-mon[101353]: pgmap v6685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:00 smithi159 ceph-mon[69013]: pgmap v6686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:00 smithi096 ceph-mon[101353]: pgmap v6686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:02 smithi159 ceph-mon[69013]: pgmap v6687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:02 smithi096 ceph-mon[101353]: pgmap v6687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 -- 172.21.15.96:0/3559403893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 msgr2=0x7f02800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 --2- 172.21.15.96:0/3559403893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f02800f7de0 secure :-1 s=READY pgs=3419 cs=0 l=1 rev1=1 rx=0x7f0270004660 tx=0x7f0270009b30).stop 2022-02-02T22:05:03.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 -- 172.21.15.96:0/3559403893 shutdown_connections 2022-02-02T22:05:03.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 --2- 172.21.15.96:0/3559403893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f02800f7de0 unknown :-1 s=CLOSED pgs=3419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 --2- 172.21.15.96:0/3559403893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f02800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:05:03.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 -- 172.21.15.96:0/3559403893 >> 172.21.15.96:0/3559403893 conn(0x7f02800f1e40 msgr2=0x7f02800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.450+0000 7f0285f19700 1 -- 172.21.15.96:0/3559403893 shutdown_connections 2022-02-02T22:05:03.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 -- 172.21.15.96:0/3559403893 wait complete. 2022-02-02T22:05:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 Processor -- start 2022-02-02T22:05:03.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 -- start start 2022-02-02T22:05:03.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f028006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028006a410 con 0x7f02800f7980 2022-02-02T22:05:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.451+0000 7f0285f19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028006a550 con 0x7f02800f66e0 2022-02-02T22:05:03.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46446/0 (socket says 172.21.15.96:46446) 2022-02-02T22:05:03.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 -- 172.21.15.96:0/2369282900 learned_addr learned my addr 172.21.15.96:0/2369282900 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:03.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 -- 172.21.15.96:0/2369282900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 msgr2=0x7f028006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027f7fe700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f028006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f028006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 -- 172.21.15.96:0/2369282900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270005040 con 0x7f02800f7980 2022-02-02T22:05:03.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027f7fe700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f028006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:05:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f027effd700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 secure :-1 s=READY pgs=3420 cs=0 l=1 rev1=1 rx=0x7f0270009990 tx=0x7f0270009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0270018070 con 0x7f02800f7980 2022-02-02T22:05:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028006a7d0 con 0x7f02800f7980 2022-02-02T22:05:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0270007ca0 con 0x7f02800f7980 2022-02-02T22:05:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027001c620 con 0x7f02800f7980 2022-02-02T22:05:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.452+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028010efe0 con 0x7f02800f7980 2022-02-02T22:05:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.453+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0280045ad0 con 0x7f02800f7980 2022-02-02T22:05:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.454+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f027001d960 con 0x7f02800f7980 2022-02-02T22:05:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.454+0000 7f0267fff700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 0x7f0268067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.454+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02700837e0 con 0x7f02800f7980 2022-02-02T22:05:03.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.454+0000 7f027f7fe700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 0x7f0268067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.455+0000 7f027f7fe700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 0x7f0268067290 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f028006b730 tx=0x7f0274008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.459+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02700519a0 con 0x7f02800f7980 2022-02-02T22:05:03.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.637+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02800ff050 con 0x7f0268064dd0 2022-02-02T22:05:03.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.639+0000 7f0267fff700 1 -- 172.21.15.96:0/2369282900 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02800ff050 con 0x7f0268064dd0 2022-02-02T22:05:03.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 msgr2=0x7f0268067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 0x7f0268067290 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f028006b730 tx=0x7f0274008040).stop 2022-02-02T22:05:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 msgr2=0x7f0280069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 secure :-1 s=READY pgs=3420 cs=0 l=1 rev1=1 rx=0x7f0270009990 tx=0x7f0270009b30).stop 2022-02-02T22:05:03.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 shutdown_connections 2022-02-02T22:05:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0268064dd0 0x7f0268067290 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02800f66e0 0x7f028006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 --2- 172.21.15.96:0/2369282900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02800f7980 0x7f0280069e20 unknown :-1 s=CLOSED pgs=3420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.640+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 >> 172.21.15.96:0/2369282900 conn(0x7f02800f1e40 msgr2=0x7f02800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:03.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.641+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 shutdown_connections 2022-02-02T22:05:03.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.641+0000 7f0285f19700 1 -- 172.21.15.96:0/2369282900 wait complete. 2022-02-02T22:05:03.651 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:05:03.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 -- 172.21.15.96:0/2209045569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f6bf0 msgr2=0x7fa2700f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 --2- 172.21.15.96:0/2209045569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f6bf0 0x7fa2700f7010 secure :-1 s=READY pgs=3421 cs=0 l=1 rev1=1 rx=0x7fa264004660 tx=0x7fa264009b30).stop 2022-02-02T22:05:03.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 -- 172.21.15.96:0/2209045569 shutdown_connections 2022-02-02T22:05:03.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 --2- 172.21.15.96:0/2209045569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f7590 0x7fa2700f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 --2- 172.21.15.96:0/2209045569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f6bf0 0x7fa2700f7010 unknown :-1 s=CLOSED pgs=3421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 -- 172.21.15.96:0/2209045569 >> 172.21.15.96:0/2209045569 conn(0x7fa2700f04c0 msgr2=0x7fa2700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:03.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 -- 172.21.15.96:0/2209045569 shutdown_connections 2022-02-02T22:05:03.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.738+0000 7fa2748ef700 1 -- 172.21.15.96:0/2209045569 wait complete. 2022-02-02T22:05:03.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 Processor -- start 2022-02-02T22:05:03.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 -- start start 2022-02-02T22:05:03.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f6bf0 0x7fa270105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270106960 con 0x7fa2700f7590 2022-02-02T22:05:03.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa2748ef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270106aa0 con 0x7fa2700f6bf0 2022-02-02T22:05:03.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa26dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa26dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46456/0 (socket says 172.21.15.96:46456) 2022-02-02T22:05:03.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.739+0000 7fa26dd9b700 1 -- 172.21.15.96:0/262454472 learned_addr learned my addr 172.21.15.96:0/262454472 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:03.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa26e59c700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f6bf0 0x7fa270105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa26dd9b700 1 -- 172.21.15.96:0/262454472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f6bf0 msgr2=0x7fa270105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa26dd9b700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f6bf0 0x7fa270105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa26dd9b700 1 -- 172.21.15.96:0/262454472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264005040 con 0x7fa2700f7590 2022-02-02T22:05:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa26dd9b700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 secure :-1 s=READY pgs=3422 cs=0 l=1 rev1=1 rx=0x7fa2600026d0 tx=0x7fa260009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa260009320 con 0x7fa2700f7590 2022-02-02T22:05:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa270107440 con 0x7fa2700f7590 2022-02-02T22:05:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa26000f040 con 0x7fa2700f7590 2022-02-02T22:05:03.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2600147e0 con 0x7fa2700f7590 2022-02-02T22:05:03.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.740+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa270107a00 con 0x7fa2700f7590 2022-02-02T22:05:03.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.741+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa270045ad0 con 0x7fa2700f7590 2022-02-02T22:05:03.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.741+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa260009480 con 0x7fa2700f7590 2022-02-02T22:05:03.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.742+0000 7fa25effd700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 0x7fa258067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:03.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.742+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa260082120 con 0x7fa2700f7590 2022-02-02T22:05:03.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.742+0000 7fa26e59c700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 0x7fa258067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:03.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.742+0000 7fa26e59c700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 0x7fa258067290 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fa264004630 tx=0x7fa264009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.746+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa260053c50 con 0x7fa2700f7590 2022-02-02T22:05:03.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.918+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2700ff830 con 0x7fa258064dd0 2022-02-02T22:05:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.928+0000 7fa25effd700 1 -- 172.21.15.96:0/262454472 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa2700ff830 con 0x7fa258064dd0 2022-02-02T22:05:03.930 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:05:03.931 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:05:03.931 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:05:03.932 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:05:03.932 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:05:03.933 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:05:03.934 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:05:03.934 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:05:03.935 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:05:03.935 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:05:03.936 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:05:03.937 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:05:03.937 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:05:03.938 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:05:03.939 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:05:03.939 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:05:03.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:05:03.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:05:03.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:05:03.941 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:05:03.941 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:05:03.941 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:05:03.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 msgr2=0x7fa258067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 0x7fa258067290 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7fa264004630 tx=0x7fa264009b30).stop 2022-02-02T22:05:03.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 msgr2=0x7fa2701063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:03.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 secure :-1 s=READY pgs=3422 cs=0 l=1 rev1=1 rx=0x7fa2600026d0 tx=0x7fa260009de0).stop 2022-02-02T22:05:03.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 shutdown_connections 2022-02-02T22:05:03.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa258064dd0 0x7fa258067290 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2700f6bf0 0x7fa270105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 --2- 172.21.15.96:0/262454472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2700f7590 0x7fa2701063b0 unknown :-1 s=CLOSED pgs=3422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:03.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.930+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 >> 172.21.15.96:0/262454472 conn(0x7fa2700f04c0 msgr2=0x7fa2700fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:03.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.931+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 shutdown_connections 2022-02-02T22:05:03.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:03.931+0000 7fa2748ef700 1 -- 172.21.15.96:0/262454472 wait complete. 2022-02-02T22:05:04.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.026+0000 7fc72209b700 1 -- 172.21.15.96:0/1112998085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 msgr2=0x7fc71c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.026+0000 7fc72209b700 1 --2- 172.21.15.96:0/1112998085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f5850 secure :-1 s=READY pgs=3423 cs=0 l=1 rev1=1 rx=0x7fc718004660 tx=0x7fc718009b30).stop 2022-02-02T22:05:04.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- 172.21.15.96:0/1112998085 shutdown_connections 2022-02-02T22:05:04.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 --2- 172.21.15.96:0/1112998085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 --2- 172.21.15.96:0/1112998085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f5850 unknown :-1 s=CLOSED pgs=3423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- 172.21.15.96:0/1112998085 >> 172.21.15.96:0/1112998085 conn(0x7fc71c0f0b90 msgr2=0x7fc71c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:04.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- 172.21.15.96:0/1112998085 shutdown_connections 2022-02-02T22:05:04.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- 172.21.15.96:0/1112998085 wait complete. 2022-02-02T22:05:04.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 Processor -- start 2022-02-02T22:05:04.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- start start 2022-02-02T22:05:04.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0f7f70 con 0x7fc71c0f5430 2022-02-02T22:05:04.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc72209b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0f80b0 con 0x7fc71c0f66d0 2022-02-02T22:05:04.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.027+0000 7fc721099700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46464/0 (socket says 172.21.15.96:46464) 2022-02-02T22:05:04.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 -- 172.21.15.96:0/3856903808 learned_addr learned my addr 172.21.15.96:0/3856903808 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:04.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc720898700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 -- 172.21.15.96:0/3856903808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 msgr2=0x7fc71c0f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 -- 172.21.15.96:0/3856903808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718005040 con 0x7fc71c0f5430 2022-02-02T22:05:04.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc720898700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:05:04.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc721099700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 secure :-1 s=READY pgs=3424 cs=0 l=1 rev1=1 rx=0x7fc718013a70 tx=0x7fc718009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:04.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc718018070 con 0x7fc71c0f5430 2022-02-02T22:05:04.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7180097d0 con 0x7fc71c0f5430 2022-02-02T22:05:04.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71801c3c0 con 0x7fc71c0f5430 2022-02-02T22:05:04.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c0f8330 con 0x7fc71c0f5430 2022-02-02T22:05:04.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.028+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c0f8890 con 0x7fc71c0f5430 2022-02-02T22:05:04.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.029+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c045ad0 con 0x7fc71c0f5430 2022-02-02T22:05:04.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.030+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc718007ba0 con 0x7fc71c0f5430 2022-02-02T22:05:04.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.030+0000 7fc711ffb700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 0x7fc7080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.030+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc718083730 con 0x7fc71c0f5430 2022-02-02T22:05:04.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.030+0000 7fc720898700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 0x7fc7080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.031+0000 7fc720898700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 0x7fc7080672e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7fc70c009780 tx=0x7fc70c009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:04.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.034+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7180518f0 con 0x7fc71c0f5430 2022-02-02T22:05:04.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.267+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc71c10f490 con 0x7fc71c0f5430 2022-02-02T22:05:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.267+0000 7fc711ffb700 1 -- 172.21.15.96:0/3856903808 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc718054f10 con 0x7fc71c0f5430 2022-02-02T22:05:04.268 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:05:04.269 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:05:04.269 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:05:04.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:04.270 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:05:04.270 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:05:04.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:04.271 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:05:04.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:05:04.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:04.272 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:05:04.272 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:05:04.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:04.273 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:05:04.273 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:05:04.274 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:05:04.274 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:05:04.274 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:05:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 msgr2=0x7fc7080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 0x7fc7080672e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7fc70c009780 tx=0x7fc70c009c80).stop 2022-02-02T22:05:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 msgr2=0x7fc71c0f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 secure :-1 s=READY pgs=3424 cs=0 l=1 rev1=1 rx=0x7fc718013a70 tx=0x7fc718009b30).stop 2022-02-02T22:05:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 shutdown_connections 2022-02-02T22:05:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc708064e20 0x7fc7080672e0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc71c0f5430 0x7fc71c0f9590 unknown :-1 s=CLOSED pgs=3424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 --2- 172.21.15.96:0/3856903808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c0f66d0 0x7fc71c0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 >> 172.21.15.96:0/3856903808 conn(0x7fc71c0f0b90 msgr2=0x7fc71c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 shutdown_connections 2022-02-02T22:05:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.269+0000 7fc72209b700 1 -- 172.21.15.96:0/3856903808 wait complete. 2022-02-02T22:05:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- 172.21.15.96:0/1404688850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 msgr2=0x7fe7500f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 --2- 172.21.15.96:0/1404688850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe7500f6940 secure :-1 s=READY pgs=3425 cs=0 l=1 rev1=1 rx=0x7fe744004660 tx=0x7fe744009b30).stop 2022-02-02T22:05:04.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- 172.21.15.96:0/1404688850 shutdown_connections 2022-02-02T22:05:04.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 --2- 172.21.15.96:0/1404688850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe7500f6940 unknown :-1 s=CLOSED pgs=3425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 --2- 172.21.15.96:0/1404688850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 0x7fe7500f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- 172.21.15.96:0/1404688850 >> 172.21.15.96:0/1404688850 conn(0x7fe7500f0540 msgr2=0x7fe7500f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- 172.21.15.96:0/1404688850 shutdown_connections 2022-02-02T22:05:04.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- 172.21.15.96:0/1404688850 wait complete. 2022-02-02T22:05:04.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 Processor -- start 2022-02-02T22:05:04.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.366+0000 7fe75740c700 1 -- start start 2022-02-02T22:05:04.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe75740c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 0x7fe750105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe75740c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe75740c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750106920 con 0x7fe7500f64c0 2022-02-02T22:05:04.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe75740c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750107130 con 0x7fe7500f5bb0 2022-02-02T22:05:04.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46476/0 (socket says 172.21.15.96:46476) 2022-02-02T22:05:04.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 -- 172.21.15.96:0/1094242110 learned_addr learned my addr 172.21.15.96:0/1094242110 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:04.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7551a8700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 0x7fe750105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 -- 172.21.15.96:0/1094242110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 msgr2=0x7fe750105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 0x7fe750105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 -- 172.21.15.96:0/1094242110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744005040 con 0x7fe7500f64c0 2022-02-02T22:05:04.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe7549a7700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 secure :-1 s=READY pgs=3426 cs=0 l=1 rev1=1 rx=0x7fe744000c00 tx=0x7fe74400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:04.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe744019070 con 0x7fe7500f64c0 2022-02-02T22:05:04.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe744007e70 con 0x7fe7500f64c0 2022-02-02T22:05:04.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe750107350 con 0x7fe7500f64c0 2022-02-02T22:05:04.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.367+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe744014ce0 con 0x7fe7500f64c0 2022-02-02T22:05:04.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.368+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7501078b0 con 0x7fe7500f64c0 2022-02-02T22:05:04.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.369+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7500f41d0 con 0x7fe7500f64c0 2022-02-02T22:05:04.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.369+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe744025070 con 0x7fe7500f64c0 2022-02-02T22:05:04.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.369+0000 7fe74dffb700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 0x7fe738067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.369+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe7440829a0 con 0x7fe7500f64c0 2022-02-02T22:05:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.369+0000 7fe7551a8700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 0x7fe738067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.370+0000 7fe7551a8700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 0x7fe738067290 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fe750105ba0 tx=0x7fe74800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.374+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe744050aa0 con 0x7fe7500f64c0 2022-02-02T22:05:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:04 smithi159 ceph-mon[69013]: pgmap v6688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:04 smithi096 ceph-mon[101353]: pgmap v6688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:04.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.577+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7500fdf20 con 0x7fe7500f64c0 2022-02-02T22:05:04.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.577+0000 7fe74dffb700 1 -- 172.21.15.96:0/1094242110 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe7500fdf20 con 0x7fe7500f64c0 2022-02-02T22:05:04.579 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:05:04.579 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:05:04.580 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:05:04.580 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:05:04.580 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:04.581 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:05:04.581 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:05:04.581 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:05:04.582 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:05:04.582 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:05:04.582 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:05:04.583 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:05:04.583 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:05:04.583 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:05:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:05:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:05:04.584 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:05:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:05:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:05:04.585 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:05:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:05:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:05:04.586 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:05:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:05:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:05:04.587 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:05:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:05:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:05:04.588 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:05:04.589 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:05:04.589 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:05:04.589 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:05:04.590 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:04.590 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:04.590 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:05:04.591 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:04.591 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:04.591 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:04.592 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:04.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 msgr2=0x7fe738067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 0x7fe738067290 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fe750105ba0 tx=0x7fe74800b040).stop 2022-02-02T22:05:04.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 msgr2=0x7fe750106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:04.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 secure :-1 s=READY pgs=3426 cs=0 l=1 rev1=1 rx=0x7fe744000c00 tx=0x7fe74400b040).stop 2022-02-02T22:05:04.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 shutdown_connections 2022-02-02T22:05:04.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe738064dd0 0x7fe738067290 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7500f5bb0 0x7fe750105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 --2- 172.21.15.96:0/1094242110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7500f64c0 0x7fe750106320 unknown :-1 s=CLOSED pgs=3426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:04.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 >> 172.21.15.96:0/1094242110 conn(0x7fe7500f0540 msgr2=0x7fe7500fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:04.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 shutdown_connections 2022-02-02T22:05:04.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:04.579+0000 7fe75740c700 1 -- 172.21.15.96:0/1094242110 wait complete. 2022-02-02T22:05:04.596 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:05:05.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:05 smithi159 ceph-mon[69013]: from='client.40956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:05 smithi159 ceph-mon[69013]: from='client.40960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3856903808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:05:05.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1094242110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:05:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:05 smithi096 ceph-mon[101353]: from='client.40956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:05 smithi096 ceph-mon[101353]: from='client.40960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3856903808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:05:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1094242110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:05:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:06 smithi159 ceph-mon[69013]: pgmap v6689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:06 smithi096 ceph-mon[101353]: pgmap v6689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:08 smithi159 ceph-mon[69013]: pgmap v6690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:08 smithi096 ceph-mon[101353]: pgmap v6690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:10 smithi159 ceph-mon[69013]: pgmap v6691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:10 smithi096 ceph-mon[101353]: pgmap v6691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:12 smithi159 ceph-mon[69013]: pgmap v6692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:12 smithi096 ceph-mon[101353]: pgmap v6692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:14 smithi159 ceph-mon[69013]: pgmap v6693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:14 smithi096 ceph-mon[101353]: pgmap v6693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:16 smithi159 ceph-mon[69013]: pgmap v6694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:16 smithi096 ceph-mon[101353]: pgmap v6694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:18 smithi159 ceph-mon[69013]: pgmap v6695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:18 smithi096 ceph-mon[101353]: pgmap v6695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:20.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:20 smithi159 ceph-mon[69013]: pgmap v6696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:20 smithi096 ceph-mon[101353]: pgmap v6696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:22 smithi159 ceph-mon[69013]: pgmap v6697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:22 smithi096 ceph-mon[101353]: pgmap v6697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:24 smithi159 ceph-mon[69013]: pgmap v6698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:24 smithi096 ceph-mon[101353]: pgmap v6698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:26 smithi159 ceph-mon[69013]: pgmap v6699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:26 smithi096 ceph-mon[101353]: pgmap v6699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:28 smithi159 ceph-mon[69013]: pgmap v6700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:05:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:05:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:28 smithi096 ceph-mon[101353]: pgmap v6700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:05:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:05:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:30 smithi159 ceph-mon[69013]: pgmap v6701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:30 smithi096 ceph-mon[101353]: pgmap v6701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:32 smithi159 ceph-mon[69013]: pgmap v6702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:32 smithi096 ceph-mon[101353]: pgmap v6702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:34 smithi159 ceph-mon[69013]: pgmap v6703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:34 smithi096 ceph-mon[101353]: pgmap v6703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:34.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2380306366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f55c0 msgr2=0x7f7bd80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2380306366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f55c0 0x7f7bd80f59e0 secure :-1 s=READY pgs=3427 cs=0 l=1 rev1=1 rx=0x7f7bc8004660 tx=0x7f7bc8009b30).stop 2022-02-02T22:05:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2380306366 shutdown_connections 2022-02-02T22:05:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2380306366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2380306366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f55c0 0x7f7bd80f59e0 unknown :-1 s=CLOSED pgs=3427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2380306366 >> 172.21.15.96:0/2380306366 conn(0x7f7bd80f0de0 msgr2=0x7f7bd80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2380306366 shutdown_connections 2022-02-02T22:05:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.690+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2380306366 wait complete. 2022-02-02T22:05:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 Processor -- start 2022-02-02T22:05:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 -- start start 2022-02-02T22:05:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8060540 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bdcb37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8060680 con 0x7f7bd80f55c0 2022-02-02T22:05:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bd5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bd5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46494/0 (socket says 172.21.15.96:46494) 2022-02-02T22:05:34.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bd5d9b700 1 -- 172.21.15.96:0/2872265224 learned_addr learned my addr 172.21.15.96:0/2872265224 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.691+0000 7f7bd659c700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bd5d9b700 1 -- 172.21.15.96:0/2872265224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f55c0 msgr2=0x7f7bd8109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bd5d9b700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bd5d9b700 1 -- 172.21.15.96:0/2872265224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8005040 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bd5d9b700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 rx=0x7f7bcc0026d0 tx=0x7f7bcc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc0079c0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bcc00f040 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd810c720 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc0148b0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.692+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd810cce0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.693+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd8045ad0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.694+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7bcc007b20 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.694+0000 7f7bc6ffd700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 0x7f7bc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.694+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7bcc0819e0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.694+0000 7f7bd659c700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 0x7f7bc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.695+0000 7f7bd659c700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 0x7f7bc0067290 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f7bc8004630 tx=0x7f7bc8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.698+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7bcc04fae0 con 0x7f7bd80f5ed0 2022-02-02T22:05:34.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.877+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd80fdf20 con 0x7f7bc0064dd0 2022-02-02T22:05:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.879+0000 7f7bc6ffd700 1 -- 172.21.15.96:0/2872265224 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7bd80fdf20 con 0x7f7bc0064dd0 2022-02-02T22:05:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 msgr2=0x7f7bc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 0x7f7bc0067290 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f7bc8004630 tx=0x7f7bc8009b30).stop 2022-02-02T22:05:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 msgr2=0x7f7bd810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 rx=0x7f7bcc0026d0 tx=0x7f7bcc009de0).stop 2022-02-02T22:05:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 shutdown_connections 2022-02-02T22:05:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7bc0064dd0 0x7f7bc0067290 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 --2- 172.21.15.96:0/2872265224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bd80f5ed0 0x7f7bd810c170 unknown :-1 s=CLOSED pgs=3428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.880+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 >> 172.21.15.96:0/2872265224 conn(0x7f7bd80f0de0 msgr2=0x7f7bd80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.881+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 shutdown_connections 2022-02-02T22:05:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.881+0000 7f7bdcb37700 1 -- 172.21.15.96:0/2872265224 wait complete. 2022-02-02T22:05:34.891 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:05:34.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 -- 172.21.15.96:0/1166476097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f58b0 msgr2=0x7f9dd80f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/1166476097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f58b0 0x7f9dd80f5d30 secure :-1 s=READY pgs=3429 cs=0 l=1 rev1=1 rx=0x7f9dd4004660 tx=0x7f9dd4009b30).stop 2022-02-02T22:05:34.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 -- 172.21.15.96:0/1166476097 shutdown_connections 2022-02-02T22:05:34.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/1166476097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f58b0 0x7f9dd80f5d30 unknown :-1 s=CLOSED pgs=3429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/1166476097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd80f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 -- 172.21.15.96:0/1166476097 >> 172.21.15.96:0/1166476097 conn(0x7f9dd80f04c0 msgr2=0x7f9dd80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:34.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 -- 172.21.15.96:0/1166476097 shutdown_connections 2022-02-02T22:05:34.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.978+0000 7f9ddff8f700 1 -- 172.21.15.96:0/1166476097 wait complete. 2022-02-02T22:05:34.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 Processor -- start 2022-02-02T22:05:34.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 -- start start 2022-02-02T22:05:34.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f58b0 0x7f9dd810c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80f5450 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddff8f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80f5590 con 0x7f9dd80f58b0 2022-02-02T22:05:34.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46504/0 (socket says 172.21.15.96:46504) 2022-02-02T22:05:34.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 -- 172.21.15.96:0/705369409 learned_addr learned my addr 172.21.15.96:0/705369409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:34.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9dddd2b700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f58b0 0x7f9dd810c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 -- 172.21.15.96:0/705369409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f58b0 msgr2=0x7f9dd810c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:34.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f58b0 0x7f9dd810c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:34.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 -- 172.21.15.96:0/705369409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4005040 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.979+0000 7f9ddd52a700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 secure :-1 s=READY pgs=3430 cs=0 l=1 rev1=1 rx=0x7f9dd4009d80 tx=0x7f9dd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.980+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd4018070 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.980+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9dd4007ba0 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.980+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd401c620 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.980+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd810ea90 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.980+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd810ee60 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.981+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8045ad0 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.982+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9dd401d420 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.982+0000 7f9dca7fc700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 0x7f9dc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.982+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9dd4083b50 con 0x7f9dd80f6bb0 2022-02-02T22:05:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.982+0000 7f9dddd2b700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 0x7f9dc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.982+0000 7f9dddd2b700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 0x7f9dc4067290 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f9dd80f51e0 tx=0x7f9dcc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:34.986+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9dd4083e60 con 0x7f9dd80f6bb0 2022-02-02T22:05:35.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.159+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dd8057f10 con 0x7f9dc4064dd0 2022-02-02T22:05:35.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.169+0000 7f9dca7fc700 1 -- 172.21.15.96:0/705369409 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9dd8057f10 con 0x7f9dc4064dd0 2022-02-02T22:05:35.170 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:05:35.170 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:05:35.170 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:05:35.171 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:05:35.171 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:05:35.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:05:35.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:05:35.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:05:35.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:05:35.173 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:05:35.173 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:05:35.173 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:05:35.174 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:05:35.174 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:05:35.175 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:05:35.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:05:35.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:05:35.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:05:35.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:05:35.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:05:35.177 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:05:35.177 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:05:35.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 msgr2=0x7f9dc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 0x7f9dc4067290 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f9dd80f51e0 tx=0x7f9dcc009040).stop 2022-02-02T22:05:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 msgr2=0x7f9dd810e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 secure :-1 s=READY pgs=3430 cs=0 l=1 rev1=1 rx=0x7f9dd4009d80 tx=0x7f9dd4009b30).stop 2022-02-02T22:05:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 shutdown_connections 2022-02-02T22:05:35.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9dc4064dd0 0x7f9dc4067290 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd80f58b0 0x7f9dd810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 --2- 172.21.15.96:0/705369409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dd80f6bb0 0x7f9dd810e5a0 unknown :-1 s=CLOSED pgs=3430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.170+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 >> 172.21.15.96:0/705369409 conn(0x7f9dd80f04c0 msgr2=0x7f9dd80fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.171+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 shutdown_connections 2022-02-02T22:05:35.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.171+0000 7f9ddff8f700 1 -- 172.21.15.96:0/705369409 wait complete. 2022-02-02T22:05:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 -- 172.21.15.96:0/2013003406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f55c0 msgr2=0x7fba580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 --2- 172.21.15.96:0/2013003406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f55c0 0x7fba580f59e0 secure :-1 s=READY pgs=3431 cs=0 l=1 rev1=1 rx=0x7fba48004660 tx=0x7fba48009b30).stop 2022-02-02T22:05:35.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 -- 172.21.15.96:0/2013003406 shutdown_connections 2022-02-02T22:05:35.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 --2- 172.21.15.96:0/2013003406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f6860 0x7fba580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:05:35.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 --2- 172.21.15.96:0/2013003406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f55c0 0x7fba580f59e0 unknown :-1 s=CLOSED pgs=3431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 -- 172.21.15.96:0/2013003406 >> 172.21.15.96:0/2013003406 conn(0x7fba580f0d40 msgr2=0x7fba580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:35.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 -- 172.21.15.96:0/2013003406 shutdown_connections 2022-02-02T22:05:35.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.267+0000 7fba5f87c700 1 -- 172.21.15.96:0/2013003406 wait complete. 2022-02-02T22:05:35.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 Processor -- start 2022-02-02T22:05:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 -- start start 2022-02-02T22:05:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f55c0 0x7fba58109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58060450 con 0x7fba580f6860 2022-02-02T22:05:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5f87c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58060590 con 0x7fba580f55c0 2022-02-02T22:05:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5ce17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5ce17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46514/0 (socket says 172.21.15.96:46514) 2022-02-02T22:05:35.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.268+0000 7fba5ce17700 1 -- 172.21.15.96:0/32424366 learned_addr learned my addr 172.21.15.96:0/32424366 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5d618700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f55c0 0x7fba58109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5ce17700 1 -- 172.21.15.96:0/32424366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f55c0 msgr2=0x7fba58109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5ce17700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f55c0 0x7fba58109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5ce17700 1 -- 172.21.15.96:0/32424366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48005040 con 0x7fba580f6860 2022-02-02T22:05:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5ce17700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 rx=0x7fba5400b410 tx=0x7fba54006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba540125f0 con 0x7fba580f6860 2022-02-02T22:05:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5810c7f0 con 0x7fba580f6860 2022-02-02T22:05:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba54012c00 con 0x7fba580f6860 2022-02-02T22:05:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba54011d20 con 0x7fba580f6860 2022-02-02T22:05:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.269+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5810cdb0 con 0x7fba580f6860 2022-02-02T22:05:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.271+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba58045ad0 con 0x7fba580f6860 2022-02-02T22:05:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.271+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba5400f030 con 0x7fba580f6860 2022-02-02T22:05:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.271+0000 7fba4dffb700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 0x7fba44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.271+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba54081e20 con 0x7fba580f6860 2022-02-02T22:05:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.272+0000 7fba5d618700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 0x7fba44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.272+0000 7fba5d618700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 0x7fba44067290 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7fba48013690 tx=0x7fba48009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.275+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba5404ff20 con 0x7fba580f6860 2022-02-02T22:05:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.507+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba58027a00 con 0x7fba580f6860 2022-02-02T22:05:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.507+0000 7fba4dffb700 1 -- 172.21.15.96:0/32424366 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fba54053540 con 0x7fba580f6860 2022-02-02T22:05:35.509 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:05:35.509 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:05:35.510 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:05:35.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:35.510 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:05:35.511 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:05:35.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:35.512 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:05:35.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:05:35.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:35.513 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:05:35.513 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:05:35.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:05:35.514 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:05:35.514 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:05:35.514 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:05:35.515 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:05:35.515 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:05:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 msgr2=0x7fba44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 0x7fba44067290 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7fba48013690 tx=0x7fba48009b30).stop 2022-02-02T22:05:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 msgr2=0x7fba5810c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 rx=0x7fba5400b410 tx=0x7fba54006ef0).stop 2022-02-02T22:05:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 shutdown_connections 2022-02-02T22:05:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba44064dd0 0x7fba44067290 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba580f55c0 0x7fba58109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 --2- 172.21.15.96:0/32424366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba580f6860 0x7fba5810c1e0 unknown :-1 s=CLOSED pgs=3432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 >> 172.21.15.96:0/32424366 conn(0x7fba580f0d40 msgr2=0x7fba580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:35.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 shutdown_connections 2022-02-02T22:05:35.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.509+0000 7fba5f87c700 1 -- 172.21.15.96:0/32424366 wait complete. 2022-02-02T22:05:35.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 -- 172.21.15.96:0/1145854620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 msgr2=0x7f550c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 --2- 172.21.15.96:0/1145854620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c0f59e0 secure :-1 s=READY pgs=3433 cs=0 l=1 rev1=1 rx=0x7f5508004660 tx=0x7f5508009b30).stop 2022-02-02T22:05:35.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 -- 172.21.15.96:0/1145854620 shutdown_connections 2022-02-02T22:05:35.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 --2- 172.21.15.96:0/1145854620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 0x7f550c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 --2- 172.21.15.96:0/1145854620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c0f59e0 unknown :-1 s=CLOSED pgs=3433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 -- 172.21.15.96:0/1145854620 >> 172.21.15.96:0/1145854620 conn(0x7f550c0f0d40 msgr2=0x7f550c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:35.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 -- 172.21.15.96:0/1145854620 shutdown_connections 2022-02-02T22:05:35.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.607+0000 7f5513562700 1 -- 172.21.15.96:0/1145854620 wait complete. 2022-02-02T22:05:35.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 Processor -- start 2022-02-02T22:05:35.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 -- start start 2022-02-02T22:05:35.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 0x7f550c1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1069c0 con 0x7f550c0f55c0 2022-02-02T22:05:35.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f5513562700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1071d0 con 0x7f550c0f6860 2022-02-02T22:05:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f55112fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f55112fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46520/0 (socket says 172.21.15.96:46520) 2022-02-02T22:05:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.608+0000 7f55112fe700 1 -- 172.21.15.96:0/3389077188 learned_addr learned my addr 172.21.15.96:0/3389077188 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:05:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5510afd700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 0x7f550c1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f55112fe700 1 -- 172.21.15.96:0/3389077188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 msgr2=0x7f550c1063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f55112fe700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 0x7f550c1063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f55112fe700 1 -- 172.21.15.96:0/3389077188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508005040 con 0x7f550c0f55c0 2022-02-02T22:05:35.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f55112fe700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 secure :-1 s=READY pgs=3434 cs=0 l=1 rev1=1 rx=0x7f5508014040 tx=0x7f550800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:35.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5508019070 con 0x7f550c0f55c0 2022-02-02T22:05:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5508007e70 con 0x7f550c0f55c0 2022-02-02T22:05:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c1073f0 con 0x7f550c0f55c0 2022-02-02T22:05:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5508014d10 con 0x7f550c0f55c0 2022-02-02T22:05:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.609+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c107950 con 0x7f550c0f55c0 2022-02-02T22:05:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.610+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c0f49b0 con 0x7f550c0f55c0 2022-02-02T22:05:35.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.611+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5508025070 con 0x7f550c0f55c0 2022-02-02T22:05:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.611+0000 7f5501ffb700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 0x7f54f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:05:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.611+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5508082940 con 0x7f550c0f55c0 2022-02-02T22:05:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.611+0000 7f5510afd700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 0x7f54f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:05:35.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.612+0000 7f5510afd700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 0x7f54f8067290 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f54fc009fd0 tx=0x7f54fc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:05:35.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.615+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5508050a40 con 0x7f550c0f55c0 2022-02-02T22:05:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.817+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f550c045ad0 con 0x7f550c0f55c0 2022-02-02T22:05:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.817+0000 7f5501ffb700 1 -- 172.21.15.96:0/3389077188 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5508023070 con 0x7f550c0f55c0 2022-02-02T22:05:35.819 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:05:35.819 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:05:35.820 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:05:35.820 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:05:35.821 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:35.821 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:05:35.821 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:05:35.822 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:05:35.822 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:05:35.822 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:05:35.823 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:05:35.823 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:05:35.823 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:05:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:05:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:05:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:05:35.825 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:05:35.825 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:05:35.825 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:05:35.826 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:05:35.826 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:05:35.826 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:05:35.827 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:05:35.827 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:05:35.828 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:05:35.828 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:05:35.828 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:05:35.829 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:05:35.829 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:05:35.829 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:05:35.830 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:05:35.830 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:05:35.830 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:35.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:35.831 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:05:35.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:05:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:35.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:05:35.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 msgr2=0x7f54f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 0x7f54f8067290 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f54fc009fd0 tx=0x7f54fc00b040).stop 2022-02-02T22:05:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 msgr2=0x7f550c105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:05:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 secure :-1 s=READY pgs=3434 cs=0 l=1 rev1=1 rx=0x7f5508014040 tx=0x7f550800b040).stop 2022-02-02T22:05:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 shutdown_connections 2022-02-02T22:05:35.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f54f8064dd0 0x7f54f8067290 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f550c0f55c0 0x7f550c105ed0 unknown :-1 s=CLOSED pgs=3434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 --2- 172.21.15.96:0/3389077188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f550c0f6860 0x7f550c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:05:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 >> 172.21.15.96:0/3389077188 conn(0x7f550c0f0d40 msgr2=0x7f550c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:05:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 shutdown_connections 2022-02-02T22:05:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:05:35.819+0000 7f5513562700 1 -- 172.21.15.96:0/3389077188 wait complete. 2022-02-02T22:05:35.838 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:05:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:36 smithi159 ceph-mon[69013]: pgmap v6704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:36 smithi159 ceph-mon[69013]: from='client.40972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:36 smithi159 ceph-mon[69013]: from='client.40976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/32424366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:05:36.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3389077188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:05:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:36 smithi096 ceph-mon[101353]: pgmap v6704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:36 smithi096 ceph-mon[101353]: from='client.40972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:36 smithi096 ceph-mon[101353]: from='client.40976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:05:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/32424366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:05:36.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3389077188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:05:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:38 smithi159 ceph-mon[69013]: pgmap v6705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:38 smithi096 ceph-mon[101353]: pgmap v6705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:40 smithi159 ceph-mon[69013]: pgmap v6706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:40 smithi096 ceph-mon[101353]: pgmap v6706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:42 smithi159 ceph-mon[69013]: pgmap v6707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:42 smithi096 ceph-mon[101353]: pgmap v6707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:44 smithi159 ceph-mon[69013]: pgmap v6708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:44 smithi096 ceph-mon[101353]: pgmap v6708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:46 smithi159 ceph-mon[69013]: pgmap v6709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:46 smithi096 ceph-mon[101353]: pgmap v6709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:48 smithi096 ceph-mon[101353]: pgmap v6710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:48 smithi159 ceph-mon[69013]: pgmap v6710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:50 smithi096 ceph-mon[101353]: pgmap v6711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:50 smithi159 ceph-mon[69013]: pgmap v6711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:52 smithi096 ceph-mon[101353]: pgmap v6712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:52 smithi159 ceph-mon[69013]: pgmap v6712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:54 smithi096 ceph-mon[101353]: pgmap v6713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:54 smithi159 ceph-mon[69013]: pgmap v6713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:56 smithi096 ceph-mon[101353]: pgmap v6714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:56 smithi159 ceph-mon[69013]: pgmap v6714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:05:58 smithi096 ceph-mon[101353]: pgmap v6715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:05:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:05:58 smithi159 ceph-mon[69013]: pgmap v6715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:00 smithi096 ceph-mon[101353]: pgmap v6716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:00 smithi159 ceph-mon[69013]: pgmap v6716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:02 smithi096 ceph-mon[101353]: pgmap v6717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:02 smithi159 ceph-mon[69013]: pgmap v6717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:04.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:04 smithi096 ceph-mon[101353]: pgmap v6718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:04 smithi159 ceph-mon[69013]: pgmap v6718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:05.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 -- 172.21.15.96:0/1887246512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 msgr2=0x7f96780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:05.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 --2- 172.21.15.96:0/1887246512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f96780f6b00 secure :-1 s=READY pgs=3435 cs=0 l=1 rev1=1 rx=0x7f966c004660 tx=0x7f966c009b30).stop 2022-02-02T22:06:05.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 -- 172.21.15.96:0/1887246512 shutdown_connections 2022-02-02T22:06:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 --2- 172.21.15.96:0/1887246512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 0x7f96780f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 --2- 172.21.15.96:0/1887246512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f96780f6b00 unknown :-1 s=CLOSED pgs=3435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:05.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 -- 172.21.15.96:0/1887246512 >> 172.21.15.96:0/1887246512 conn(0x7f96780f1e40 msgr2=0x7f96780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 -- 172.21.15.96:0/1887246512 shutdown_connections 2022-02-02T22:06:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.930+0000 7f967ed3e700 1 -- 172.21.15.96:0/1887246512 wait complete. 2022-02-02T22:06:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.931+0000 7f967ed3e700 1 Processor -- start 2022-02-02T22:06:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.931+0000 7f967ed3e700 1 -- start start 2022-02-02T22:06:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.931+0000 7f967ed3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967ed3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 0x7f96781074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967ed3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9678107a50 con 0x7f96780f66e0 2022-02-02T22:06:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967ed3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9678107b90 con 0x7f96780f7980 2022-02-02T22:06:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46538/0 (socket says 172.21.15.96:46538) 2022-02-02T22:06:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 -- 172.21.15.96:0/2539910797 learned_addr learned my addr 172.21.15.96:0/2539910797 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f9677fff700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 0x7f96781074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 -- 172.21.15.96:0/2539910797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 msgr2=0x7f96781074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 0x7f96781074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 -- 172.21.15.96:0/2539910797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c005040 con 0x7f96780f66e0 2022-02-02T22:06:05.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967cada700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 secure :-1 s=READY pgs=3436 cs=0 l=1 rev1=1 rx=0x7f966c013a70 tx=0x7f966c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f966c018070 con 0x7f96780f66e0 2022-02-02T22:06:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f966c0097d0 con 0x7f96780f66e0 2022-02-02T22:06:05.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96781084d0 con 0x7f96780f66e0 2022-02-02T22:06:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.932+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f966c01de80 con 0x7f96780f66e0 2022-02-02T22:06:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.933+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9678108a30 con 0x7f96780f66e0 2022-02-02T22:06:05.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.933+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9678045ad0 con 0x7f96780f66e0 2022-02-02T22:06:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.934+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f966c007ba0 con 0x7f96780f66e0 2022-02-02T22:06:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.934+0000 7f96757fa700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 0x7f9668067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:05.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.934+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f966c083660 con 0x7f96780f66e0 2022-02-02T22:06:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.935+0000 7f9677fff700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 0x7f9668067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.935+0000 7f9677fff700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 0x7f9668067290 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f9664004c40 tx=0x7f966400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:05.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:05.939+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f966c055190 con 0x7f96780f66e0 2022-02-02T22:06:06.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.116+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96780fefe0 con 0x7f9668064dd0 2022-02-02T22:06:06.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.117+0000 7f96757fa700 1 -- 172.21.15.96:0/2539910797 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f96780fefe0 con 0x7f9668064dd0 2022-02-02T22:06:06.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 msgr2=0x7f9668067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 0x7f9668067290 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f9664004c40 tx=0x7f966400b040).stop 2022-02-02T22:06:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 msgr2=0x7f9678106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 secure :-1 s=READY pgs=3436 cs=0 l=1 rev1=1 rx=0x7f966c013a70 tx=0x7f966c009b30).stop 2022-02-02T22:06:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 shutdown_connections 2022-02-02T22:06:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9668064dd0 0x7f9668067290 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96780f66e0 0x7f9678106fb0 unknown :-1 s=CLOSED pgs=3436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 --2- 172.21.15.96:0/2539910797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96780f7980 0x7f96781074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.119+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 >> 172.21.15.96:0/2539910797 conn(0x7f96780f1e40 msgr2=0x7f96780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.120+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 shutdown_connections 2022-02-02T22:06:06.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.120+0000 7f967ed3e700 1 -- 172.21.15.96:0/2539910797 wait complete. 2022-02-02T22:06:06.129 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:06:06.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 -- 172.21.15.96:0/1122197288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 msgr2=0x7fee100f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 --2- 172.21.15.96:0/1122197288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee100f5c50 secure :-1 s=READY pgs=3437 cs=0 l=1 rev1=1 rx=0x7fedfc004660 tx=0x7fedfc009b30).stop 2022-02-02T22:06:06.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 -- 172.21.15.96:0/1122197288 shutdown_connections 2022-02-02T22:06:06.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 --2- 172.21.15.96:0/1122197288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee100f5c50 unknown :-1 s=CLOSED pgs=3437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 --2- 172.21.15.96:0/1122197288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f6ac0 0x7fee100f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:06:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 -- 172.21.15.96:0/1122197288 >> 172.21.15.96:0/1122197288 conn(0x7fee100f0320 msgr2=0x7fee100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.217+0000 7fee15f2c700 1 -- 172.21.15.96:0/1122197288 shutdown_connections 2022-02-02T22:06:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 -- 172.21.15.96:0/1122197288 wait complete. 2022-02-02T22:06:06.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 Processor -- start 2022-02-02T22:06:06.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 -- start start 2022-02-02T22:06:06.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f6ac0 0x7fee1010e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100f5350 con 0x7fee100f57d0 2022-02-02T22:06:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.218+0000 7fee15f2c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100f5490 con 0x7fee100f6ac0 2022-02-02T22:06:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46548/0 (socket says 172.21.15.96:46548) 2022-02-02T22:06:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 -- 172.21.15.96:0/2263391838 learned_addr learned my addr 172.21.15.96:0/2263391838 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:06.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 -- 172.21.15.96:0/2263391838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f6ac0 msgr2=0x7fee1010e370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T22:06:06.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f6ac0 0x7fee1010e370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:06:06.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 -- 172.21.15.96:0/2263391838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc005040 con 0x7fee100f57d0 2022-02-02T22:06:06.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee14f2a700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 secure :-1 s=READY pgs=3438 cs=0 l=1 rev1=1 rx=0x7fee0400b410 tx=0x7fee04006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee040125f0 con 0x7fee100f57d0 2022-02-02T22:06:06.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1010e860 con 0x7fee100f57d0 2022-02-02T22:06:06.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee04012c00 con 0x7fee100f57d0 2022-02-02T22:06:06.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee04002ae0 con 0x7fee100f57d0 2022-02-02T22:06:06.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.219+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1010ed40 con 0x7fee100f57d0 2022-02-02T22:06:06.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.220+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10059100 con 0x7fee100f57d0 2022-02-02T22:06:06.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.221+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee0400f030 con 0x7fee100f57d0 2022-02-02T22:06:06.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.221+0000 7fee0d7fa700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 0x7fee000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.221+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fee04081f40 con 0x7fee100f57d0 2022-02-02T22:06:06.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.221+0000 7fee0ffff700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 0x7fee000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.221+0000 7fee0ffff700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 0x7fee000672e0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fedfc004e30 tx=0x7fedfc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.225+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee040b07d0 con 0x7fee100f57d0 2022-02-02T22:06:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.399+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee100008d0 con 0x7fee00064e20 2022-02-02T22:06:06.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.409+0000 7fee0d7fa700 1 -- 172.21.15.96:0/2263391838 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fee100008d0 con 0x7fee00064e20 2022-02-02T22:06:06.409 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:06:06.409 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:06:06.409 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:06:06.410 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:06:06.410 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:06:06.410 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:06:06.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:06:06.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:06:06.411 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:06:06.412 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:06:06.412 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:06:06.412 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:06:06.413 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:06:06.413 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:06:06.413 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:06:06.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:06:06.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:06:06.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:06:06.415 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:06:06.415 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:06:06.415 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:06:06.416 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:06:06.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 msgr2=0x7fee000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 0x7fee000672e0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fedfc004e30 tx=0x7fedfc009b30).stop 2022-02-02T22:06:06.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 msgr2=0x7fee1010be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 secure :-1 s=READY pgs=3438 cs=0 l=1 rev1=1 rx=0x7fee0400b410 tx=0x7fee04006ef0).stop 2022-02-02T22:06:06.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 shutdown_connections 2022-02-02T22:06:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee00064e20 0x7fee000672e0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee100f57d0 0x7fee1010be70 unknown :-1 s=CLOSED pgs=3438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 --2- 172.21.15.96:0/2263391838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee100f6ac0 0x7fee1010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:06:06.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 >> 172.21.15.96:0/2263391838 conn(0x7fee100f0320 msgr2=0x7fee100fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 shutdown_connections 2022-02-02T22:06:06.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.411+0000 7fee15f2c700 1 -- 172.21.15.96:0/2263391838 wait complete. 2022-02-02T22:06:06.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 -- 172.21.15.96:0/528023693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f6530 msgr2=0x7f8aec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/528023693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f6530 0x7f8aec0f6950 secure :-1 s=READY pgs=3439 cs=0 l=1 rev1=1 rx=0x7f8ae0004660 tx=0x7f8ae0009b30).stop 2022-02-02T22:06:06.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 -- 172.21.15.96:0/528023693 shutdown_connections 2022-02-02T22:06:06.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/528023693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f77d0 0x7f8aec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/528023693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f6530 0x7f8aec0f6950 unknown :-1 s=CLOSED pgs=3439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 -- 172.21.15.96:0/528023693 >> 172.21.15.96:0/528023693 conn(0x7f8aec0f1c90 msgr2=0x7f8aec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 -- 172.21.15.96:0/528023693 shutdown_connections 2022-02-02T22:06:06.511 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:06 smithi096 ceph-mon[101353]: pgmap v6719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.508+0000 7f8af1c2e700 1 -- 172.21.15.96:0/528023693 wait complete. 2022-02-02T22:06:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 Processor -- start 2022-02-02T22:06:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 -- start start 2022-02-02T22:06:06.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6530 0x7f8aec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec06a380 con 0x7f8aec0f77d0 2022-02-02T22:06:06.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.509+0000 7f8af1c2e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec06a4c0 con 0x7f8aec0f6530 2022-02-02T22:06:06.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46560/0 (socket says 172.21.15.96:46560) 2022-02-02T22:06:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 -- 172.21.15.96:0/2404801786 learned_addr learned my addr 172.21.15.96:0/2404801786 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8af0c2c700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6530 0x7f8aec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 -- 172.21.15.96:0/2404801786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6530 msgr2=0x7f8aec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6530 0x7f8aec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 -- 172.21.15.96:0/2404801786 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0005040 con 0x7f8aec0f77d0 2022-02-02T22:06:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8aebfff700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 secure :-1 s=READY pgs=3440 cs=0 l=1 rev1=1 rx=0x7f8ad800c530 tx=0x7f8ad8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad800f650 con 0x7f8aec0f77d0 2022-02-02T22:06:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec06a7a0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ad800fc60 con 0x7f8aec0f77d0 2022-02-02T22:06:06.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad8012c20 con 0x7f8aec0f77d0 2022-02-02T22:06:06.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.510+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec10edc0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.512+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec045ad0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.512+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ad8010070 con 0x7f8aec0f77d0 2022-02-02T22:06:06.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.512+0000 7f8ae97fa700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 0x7f8adc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.513+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8ad80816a0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.513+0000 7f8af0c2c700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 0x7f8adc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.513+0000 7f8af0c2c700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 0x7f8adc0672e0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f8ae0013690 tx=0x7f8ae0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.517+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ad804f6b0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.753+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8aec027a00 con 0x7f8aec0f77d0 2022-02-02T22:06:06.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.754+0000 7f8ae97fa700 1 -- 172.21.15.96:0/2404801786 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8ad8052cd0 con 0x7f8aec0f77d0 2022-02-02T22:06:06.754 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:06:06.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:06:06.755 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:06:06.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:06.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:06:06.756 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:06:06.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:06.757 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:06:06.757 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:06:06.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:06.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:06:06.758 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:06:06.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:06.759 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:06:06.759 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:06:06.759 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:06:06.760 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:06:06.760 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:06:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 msgr2=0x7f8adc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 0x7f8adc0672e0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f8ae0013690 tx=0x7f8ae0009b30).stop 2022-02-02T22:06:06.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 msgr2=0x7f8aec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 secure :-1 s=READY pgs=3440 cs=0 l=1 rev1=1 rx=0x7f8ad800c530 tx=0x7f8ad8007e20).stop 2022-02-02T22:06:06.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 shutdown_connections 2022-02-02T22:06:06.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8adc064e20 0x7f8adc0672e0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec0f6530 0x7f8aec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 --2- 172.21.15.96:0/2404801786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aec0f77d0 0x7f8aec069e20 unknown :-1 s=CLOSED pgs=3440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 >> 172.21.15.96:0/2404801786 conn(0x7f8aec0f1c90 msgr2=0x7f8aec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 shutdown_connections 2022-02-02T22:06:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.756+0000 7f8af1c2e700 1 -- 172.21.15.96:0/2404801786 wait complete. 2022-02-02T22:06:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:06 smithi159 ceph-mon[69013]: pgmap v6719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 -- 172.21.15.96:0/2086003641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f53e0 msgr2=0x7ff0840f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 --2- 172.21.15.96:0/2086003641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f53e0 0x7ff0840f7d20 secure :-1 s=READY pgs=3441 cs=0 l=1 rev1=1 rx=0x7ff074004660 tx=0x7ff074009b30).stop 2022-02-02T22:06:06.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 -- 172.21.15.96:0/2086003641 shutdown_connections 2022-02-02T22:06:06.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 --2- 172.21.15.96:0/2086003641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f53e0 0x7ff0840f7d20 unknown :-1 s=CLOSED pgs=3441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 --2- 172.21.15.96:0/2086003641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f4a40 0x7ff0840f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 -- 172.21.15.96:0/2086003641 >> 172.21.15.96:0/2086003641 conn(0x7ff0840f04c0 msgr2=0x7ff0840f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 -- 172.21.15.96:0/2086003641 shutdown_connections 2022-02-02T22:06:06.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.855+0000 7ff089922700 1 -- 172.21.15.96:0/2086003641 wait complete. 2022-02-02T22:06:06.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 Processor -- start 2022-02-02T22:06:06.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 -- start start 2022-02-02T22:06:06.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f53e0 0x7ff0840f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840f6010 con 0x7ff0840f4a40 2022-02-02T22:06:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff089922700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840f6150 con 0x7ff0840f53e0 2022-02-02T22:06:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff082ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff082ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46566/0 (socket says 172.21.15.96:46566) 2022-02-02T22:06:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.856+0000 7ff082ffd700 1 -- 172.21.15.96:0/2031860725 learned_addr learned my addr 172.21.15.96:0/2031860725 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff0827fc700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f53e0 0x7ff0840f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff082ffd700 1 -- 172.21.15.96:0/2031860725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f53e0 msgr2=0x7ff0840f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff082ffd700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f53e0 0x7ff0840f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff082ffd700 1 -- 172.21.15.96:0/2031860725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074005040 con 0x7ff0840f4a40 2022-02-02T22:06:06.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff082ffd700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 secure :-1 s=READY pgs=3442 cs=0 l=1 rev1=1 rx=0x7ff07800c790 tx=0x7ff078007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078002590 con 0x7ff0840f4a40 2022-02-02T22:06:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff078002ba0 con 0x7ff0840f4a40 2022-02-02T22:06:06.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840f6430 con 0x7ff0840f4a40 2022-02-02T22:06:06.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078013d90 con 0x7ff0840f4a40 2022-02-02T22:06:06.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.857+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08410f1b0 con 0x7ff0840f4a40 2022-02-02T22:06:06.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.858+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084045ad0 con 0x7ff0840f4a40 2022-02-02T22:06:06.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.859+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff07801a060 con 0x7ff0840f4a40 2022-02-02T22:06:06.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.859+0000 7ff06b7fe700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 0x7ff06c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:06.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.859+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff078081cc0 con 0x7ff0840f4a40 2022-02-02T22:06:06.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.859+0000 7ff0827fc700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 0x7ff06c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:06.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.859+0000 7ff0827fc700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 0x7ff06c067290 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7ff074004630 tx=0x7ff074009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:06.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:06.863+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff07804fd60 con 0x7ff0840f4a40 2022-02-02T22:06:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.064+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff084027b40 con 0x7ff0840f4a40 2022-02-02T22:06:07.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.065+0000 7ff06b7fe700 1 -- 172.21.15.96:0/2031860725 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff084027b40 con 0x7ff0840f4a40 2022-02-02T22:06:07.066 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:06:07.066 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:06:07.067 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:06:07.067 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:06:07.067 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:07.068 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:06:07.068 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:06:07.068 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:06:07.069 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:06:07.069 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:06:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:06:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:06:07.070 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:06:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:06:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:06:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:06:07.072 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:06:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:06:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:06:07.074 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:06:07.074 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:06:07.075 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:06:07.075 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:06:07.075 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:06:07.076 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:06:07.076 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:06:07.077 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:06:07.077 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:06:07.077 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:06:07.078 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:06:07.078 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:06:07.078 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:06:07.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:07.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:07.079 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:06:07.080 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:07.080 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:07.080 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:07.081 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:07.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.066+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 msgr2=0x7ff06c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:07.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.066+0000 7ff089922700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 0x7ff06c067290 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7ff074004630 tx=0x7ff074009b30).stop 2022-02-02T22:06:07.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.066+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 msgr2=0x7ff0840f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:07.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.066+0000 7ff089922700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 secure :-1 s=READY pgs=3442 cs=0 l=1 rev1=1 rx=0x7ff07800c790 tx=0x7ff078007d70).stop 2022-02-02T22:06:07.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 shutdown_connections 2022-02-02T22:06:07.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff06c064dd0 0x7ff06c067290 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:07.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0840f4a40 0x7ff0840f7630 unknown :-1 s=CLOSED pgs=3442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:07.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 --2- 172.21.15.96:0/2031860725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0840f53e0 0x7ff0840f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:07.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 >> 172.21.15.96:0/2031860725 conn(0x7ff0840f04c0 msgr2=0x7ff0840fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:07.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 shutdown_connections 2022-02-02T22:06:07.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:07.067+0000 7ff089922700 1 -- 172.21.15.96:0/2031860725 wait complete. 2022-02-02T22:06:07.086 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:06:07.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:07 smithi159 ceph-mon[69013]: from='client.40988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:07 smithi159 ceph-mon[69013]: from='client.40992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:07.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2404801786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:06:07.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2031860725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:06:07.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:07 smithi096 ceph-mon[101353]: from='client.40988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:07.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:07 smithi096 ceph-mon[101353]: from='client.40992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:07.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2404801786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:06:07.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2031860725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:06:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:08 smithi159 ceph-mon[69013]: pgmap v6720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:08 smithi096 ceph-mon[101353]: pgmap v6720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:10 smithi159 ceph-mon[69013]: pgmap v6721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:10 smithi096 ceph-mon[101353]: pgmap v6721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:12 smithi159 ceph-mon[69013]: pgmap v6722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:12 smithi096 ceph-mon[101353]: pgmap v6722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:14 smithi159 ceph-mon[69013]: pgmap v6723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:14 smithi096 ceph-mon[101353]: pgmap v6723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:16 smithi159 ceph-mon[69013]: pgmap v6724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:16 smithi096 ceph-mon[101353]: pgmap v6724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:18 smithi159 ceph-mon[69013]: pgmap v6725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:18 smithi096 ceph-mon[101353]: pgmap v6725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:20 smithi159 ceph-mon[69013]: pgmap v6726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:20 smithi096 ceph-mon[101353]: pgmap v6726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:22 smithi159 ceph-mon[69013]: pgmap v6727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:22 smithi096 ceph-mon[101353]: pgmap v6727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:24 smithi159 ceph-mon[69013]: pgmap v6728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:24 smithi096 ceph-mon[101353]: pgmap v6728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:26 smithi159 ceph-mon[69013]: pgmap v6729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:26 smithi096 ceph-mon[101353]: pgmap v6729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:28 smithi159 ceph-mon[69013]: pgmap v6730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:06:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:06:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:28 smithi096 ceph-mon[101353]: pgmap v6730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:06:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:06:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:30 smithi159 ceph-mon[69013]: pgmap v6731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:30 smithi096 ceph-mon[101353]: pgmap v6731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:32 smithi159 ceph-mon[69013]: pgmap v6732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:32 smithi096 ceph-mon[101353]: pgmap v6732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:34 smithi159 ceph-mon[69013]: pgmap v6733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:34 smithi096 ceph-mon[101353]: pgmap v6733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:36 smithi159 ceph-mon[69013]: pgmap v6734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:36 smithi096 ceph-mon[101353]: pgmap v6734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:37.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.176+0000 7fb535c98700 1 -- 172.21.15.96:0/596827548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 msgr2=0x7fb5300f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.176+0000 7fb535c98700 1 --2- 172.21.15.96:0/596827548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb5300f6b30 secure :-1 s=READY pgs=3443 cs=0 l=1 rev1=1 rx=0x7fb51c004660 tx=0x7fb51c009b30).stop 2022-02-02T22:06:37.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.176+0000 7fb535c98700 1 -- 172.21.15.96:0/596827548 shutdown_connections 2022-02-02T22:06:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.176+0000 7fb535c98700 1 --2- 172.21.15.96:0/596827548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb5300f6b30 unknown :-1 s=CLOSED pgs=3443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.176+0000 7fb535c98700 1 --2- 172.21.15.96:0/596827548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 0x7fb5300f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.177+0000 7fb535c98700 1 -- 172.21.15.96:0/596827548 >> 172.21.15.96:0/596827548 conn(0x7fb5300f0b90 msgr2=0x7fb5300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.177+0000 7fb535c98700 1 -- 172.21.15.96:0/596827548 shutdown_connections 2022-02-02T22:06:37.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.177+0000 7fb535c98700 1 -- 172.21.15.96:0/596827548 wait complete. 2022-02-02T22:06:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.177+0000 7fb535c98700 1 Processor -- start 2022-02-02T22:06:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.177+0000 7fb535c98700 1 -- start start 2022-02-02T22:06:37.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb535c98700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 0x7fb530109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb535c98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb535c98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300603e0 con 0x7fb5300f66d0 2022-02-02T22:06:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb535c98700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530060520 con 0x7fb5300f5430 2022-02-02T22:06:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46586/0 (socket says 172.21.15.96:46586) 2022-02-02T22:06:37.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 -- 172.21.15.96:0/2507787878 learned_addr learned my addr 172.21.15.96:0/2507787878 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:37.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb534c96700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 0x7fb530109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 -- 172.21.15.96:0/2507787878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 msgr2=0x7fb530109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 0x7fb530109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 -- 172.21.15.96:0/2507787878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c005040 con 0x7fb5300f66d0 2022-02-02T22:06:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52ffff700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 rx=0x7fb51c009990 tx=0x7fb51c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c018070 con 0x7fb5300f66d0 2022-02-02T22:06:37.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb51c007ba0 con 0x7fb5300f66d0 2022-02-02T22:06:37.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.178+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53010c470 con 0x7fb5300f66d0 2022-02-02T22:06:37.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.179+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53010c9d0 con 0x7fb5300f66d0 2022-02-02T22:06:37.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.179+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c01c3c0 con 0x7fb5300f66d0 2022-02-02T22:06:37.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.180+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb530045ad0 con 0x7fb5300f66d0 2022-02-02T22:06:37.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.180+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb51c01d420 con 0x7fb5300f66d0 2022-02-02T22:06:37.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.181+0000 7fb52d7fa700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 0x7fb5200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.181+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb51c083630 con 0x7fb5300f66d0 2022-02-02T22:06:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.181+0000 7fb534c96700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 0x7fb5200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.181+0000 7fb534c96700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 0x7fb5200672e0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fb530060060 tx=0x7fb52400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.185+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb51c051730 con 0x7fb5300f66d0 2022-02-02T22:06:37.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.364+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5300fdd30 con 0x7fb520064e20 2022-02-02T22:06:37.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.365+0000 7fb52d7fa700 1 -- 172.21.15.96:0/2507787878 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb5300fdd30 con 0x7fb520064e20 2022-02-02T22:06:37.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 msgr2=0x7fb5200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 0x7fb5200672e0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7fb530060060 tx=0x7fb52400b040).stop 2022-02-02T22:06:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 msgr2=0x7fb53010bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 rx=0x7fb51c009990 tx=0x7fb51c009b30).stop 2022-02-02T22:06:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 shutdown_connections 2022-02-02T22:06:37.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb520064e20 0x7fb5200672e0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5300f5430 0x7fb530109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 --2- 172.21.15.96:0/2507787878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5300f66d0 0x7fb53010bf20 unknown :-1 s=CLOSED pgs=3444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.367+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 >> 172.21.15.96:0/2507787878 conn(0x7fb5300f0b90 msgr2=0x7fb5300fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.368+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 shutdown_connections 2022-02-02T22:06:37.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.368+0000 7fb535c98700 1 -- 172.21.15.96:0/2507787878 wait complete. 2022-02-02T22:06:37.377 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:06:37.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- 172.21.15.96:0/1682797859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f55c0 msgr2=0x7f47ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 --2- 172.21.15.96:0/1682797859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f59e0 secure :-1 s=READY pgs=3445 cs=0 l=1 rev1=1 rx=0x7f47dc004660 tx=0x7f47dc009b30).stop 2022-02-02T22:06:37.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- 172.21.15.96:0/1682797859 shutdown_connections 2022-02-02T22:06:37.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 --2- 172.21.15.96:0/1682797859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 --2- 172.21.15.96:0/1682797859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f59e0 unknown :-1 s=CLOSED pgs=3445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- 172.21.15.96:0/1682797859 >> 172.21.15.96:0/1682797859 conn(0x7f47ec0f0d40 msgr2=0x7f47ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- 172.21.15.96:0/1682797859 shutdown_connections 2022-02-02T22:06:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- 172.21.15.96:0/1682797859 wait complete. 2022-02-02T22:06:37.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 Processor -- start 2022-02-02T22:06:37.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 -- start start 2022-02-02T22:06:37.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.465+0000 7f47f3894700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f3894700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0f8100 con 0x7f47ec0f6860 2022-02-02T22:06:37.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f3894700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0f8240 con 0x7f47ec0f55c0 2022-02-02T22:06:37.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46596/0 (socket says 172.21.15.96:46596) 2022-02-02T22:06:37.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 -- 172.21.15.96:0/3995033806 learned_addr learned my addr 172.21.15.96:0/3995033806 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:37.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f1630700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 -- 172.21.15.96:0/3995033806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f55c0 msgr2=0x7f47ec0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 -- 172.21.15.96:0/3995033806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc005040 con 0x7f47ec0f6860 2022-02-02T22:06:37.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f0e2f700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 rx=0x7f47e800c530 tx=0x7f47e8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e800f650 con 0x7f47ec0f6860 2022-02-02T22:06:37.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0f8520 con 0x7f47ec0f6860 2022-02-02T22:06:37.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47e800fc60 con 0x7f47ec0f6860 2022-02-02T22:06:37.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.466+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e8012cd0 con 0x7f47ec0f6860 2022-02-02T22:06:37.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.467+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec10efa0 con 0x7f47ec0f6860 2022-02-02T22:06:37.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.468+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec045ad0 con 0x7f47ec0f6860 2022-02-02T22:06:37.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.469+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47e8010070 con 0x7f47ec0f6860 2022-02-02T22:06:37.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.469+0000 7f47e1ffb700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 0x7f47d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.469+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f47e8081ee0 con 0x7f47ec0f6860 2022-02-02T22:06:37.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.469+0000 7f47f1630700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 0x7f47d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.469+0000 7f47f1630700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 0x7f47d8067290 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f47dc004e30 tx=0x7f47dc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.473+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47e8050060 con 0x7f47ec0f6860 2022-02-02T22:06:37.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.647+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47ec0faca0 con 0x7f47d8064dd0 2022-02-02T22:06:37.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.656+0000 7f47e1ffb700 1 -- 172.21.15.96:0/3995033806 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f47ec0faca0 con 0x7f47d8064dd0 2022-02-02T22:06:37.657 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:06:37.657 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:06:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:06:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:06:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:06:37.659 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:06:37.659 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:06:37.659 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:06:37.660 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:06:37.660 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:06:37.660 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:06:37.661 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:06:37.661 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:06:37.661 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:06:37.662 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:06:37.662 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:06:37.662 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:06:37.663 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:06:37.663 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:06:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:06:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:06:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:06:37.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 msgr2=0x7f47d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 0x7f47d8067290 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f47dc004e30 tx=0x7f47dc009b30).stop 2022-02-02T22:06:37.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 msgr2=0x7f47ec0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 rx=0x7f47e800c530 tx=0x7f47e8007e20).stop 2022-02-02T22:06:37.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 shutdown_connections 2022-02-02T22:06:37.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47d8064dd0 0x7f47d8067290 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47ec0f55c0 0x7f47ec0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 --2- 172.21.15.96:0/3995033806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47ec0f6860 0x7f47ec0f7ba0 unknown :-1 s=CLOSED pgs=3446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 >> 172.21.15.96:0/3995033806 conn(0x7f47ec0f0d40 msgr2=0x7f47ec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:37.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.658+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 shutdown_connections 2022-02-02T22:06:37.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.659+0000 7f47f3894700 1 -- 172.21.15.96:0/3995033806 wait complete. 2022-02-02T22:06:37.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 -- 172.21.15.96:0/3625523068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 msgr2=0x7f78200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 --2- 172.21.15.96:0/3625523068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f78200f6cc0 secure :-1 s=READY pgs=3447 cs=0 l=1 rev1=1 rx=0x7f7810004660 tx=0x7f7810009b30).stop 2022-02-02T22:06:37.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 -- 172.21.15.96:0/3625523068 shutdown_connections 2022-02-02T22:06:37.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 --2- 172.21.15.96:0/3625523068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f78200f6cc0 unknown :-1 s=CLOSED pgs=3447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 --2- 172.21.15.96:0/3625523068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 0x7f78200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 -- 172.21.15.96:0/3625523068 >> 172.21.15.96:0/3625523068 conn(0x7f78200f0d40 msgr2=0x7f78200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:37.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 -- 172.21.15.96:0/3625523068 shutdown_connections 2022-02-02T22:06:37.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.756+0000 7f7825774700 1 -- 172.21.15.96:0/3625523068 wait complete. 2022-02-02T22:06:37.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 Processor -- start 2022-02-02T22:06:37.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 -- start start 2022-02-02T22:06:37.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 0x7f7820109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200603c0 con 0x7f78200f6860 2022-02-02T22:06:37.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f7825774700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820060500 con 0x7f78200f55c0 2022-02-02T22:06:37.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46606/0 (socket says 172.21.15.96:46606) 2022-02-02T22:06:37.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 -- 172.21.15.96:0/736996751 learned_addr learned my addr 172.21.15.96:0/736996751 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:37.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781effd700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 0x7f7820109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 -- 172.21.15.96:0/736996751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 msgr2=0x7f7820109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:37.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 0x7f7820109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:37.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.757+0000 7f781e7fc700 1 -- 172.21.15.96:0/736996751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810005040 con 0x7f78200f6860 2022-02-02T22:06:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f781e7fc700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 secure :-1 s=READY pgs=3448 cs=0 l=1 rev1=1 rx=0x7f7810009990 tx=0x7f7810009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7810018070 con 0x7f78200f6860 2022-02-02T22:06:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7810007ba0 con 0x7f78200f6860 2022-02-02T22:06:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782010c6c0 con 0x7f78200f6860 2022-02-02T22:06:37.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782010cbf0 con 0x7f78200f6860 2022-02-02T22:06:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.758+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781001c620 con 0x7f78200f6860 2022-02-02T22:06:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.759+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800004fa0 con 0x7f78200f6860 2022-02-02T22:06:37.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.760+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f781001c8e0 con 0x7f78200f6860 2022-02-02T22:06:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.760+0000 7f78077fe700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 0x7f780806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.760+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7810083b10 con 0x7f78200f6860 2022-02-02T22:06:37.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.760+0000 7f781effd700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 0x7f780806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:37.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.761+0000 7f781effd700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 0x7f780806b6a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f7820060040 tx=0x7f7814009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.764+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7810051af0 con 0x7f78200f6860 2022-02-02T22:06:37.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.996+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7800005940 con 0x7f78200f6860 2022-02-02T22:06:37.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.996+0000 7f78077fe700 1 -- 172.21.15.96:0/736996751 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7810055110 con 0x7f78200f6860 2022-02-02T22:06:37.997 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:06:37.997 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:06:37.998 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:06:37.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:37.998 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:06:37.999 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:06:37.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:37.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:06:38.000 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:06:38.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:38.000 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:06:38.001 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:06:38.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:06:38.001 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:06:38.002 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:06:38.002 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:06:38.002 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:06:38.003 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:06:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 msgr2=0x7f780806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 0x7f780806b6a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f7820060040 tx=0x7f7814009040).stop 2022-02-02T22:06:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 msgr2=0x7f782010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 secure :-1 s=READY pgs=3448 cs=0 l=1 rev1=1 rx=0x7f7810009990 tx=0x7f7810009b30).stop 2022-02-02T22:06:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 shutdown_connections 2022-02-02T22:06:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78080691e0 0x7f780806b6a0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78200f55c0 0x7f7820109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 --2- 172.21.15.96:0/736996751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78200f6860 0x7f782010c170 unknown :-1 s=CLOSED pgs=3448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 >> 172.21.15.96:0/736996751 conn(0x7f78200f0d40 msgr2=0x7f78200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:38.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 shutdown_connections 2022-02-02T22:06:38.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:37.998+0000 7f7825774700 1 -- 172.21.15.96:0/736996751 wait complete. 2022-02-02T22:06:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 -- 172.21.15.96:0/213521468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f77d0 msgr2=0x7f6dbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 --2- 172.21.15.96:0/213521468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f77d0 0x7f6dbc0f7c30 secure :-1 s=READY pgs=3449 cs=0 l=1 rev1=1 rx=0x7f6dac004660 tx=0x7f6dac009b30).stop 2022-02-02T22:06:38.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 -- 172.21.15.96:0/213521468 shutdown_connections 2022-02-02T22:06:38.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 --2- 172.21.15.96:0/213521468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f77d0 0x7f6dbc0f7c30 unknown :-1 s=CLOSED pgs=3449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 --2- 172.21.15.96:0/213521468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 -- 172.21.15.96:0/213521468 >> 172.21.15.96:0/213521468 conn(0x7f6dbc0f1c90 msgr2=0x7f6dbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:38.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.097+0000 7f6dc2043700 1 -- 172.21.15.96:0/213521468 shutdown_connections 2022-02-02T22:06:38.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 -- 172.21.15.96:0/213521468 wait complete. 2022-02-02T22:06:38.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 Processor -- start 2022-02-02T22:06:38.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 -- start start 2022-02-02T22:06:38.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:38.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 0x7f6dbc1082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1078c0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc2043700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc107a00 con 0x7f6dbc1073f0 2022-02-02T22:06:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc1041700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:38.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc1041700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46614/0 (socket says 172.21.15.96:46614) 2022-02-02T22:06:38.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.098+0000 7f6dc1041700 1 -- 172.21.15.96:0/3867247160 learned_addr learned my addr 172.21.15.96:0/3867247160 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:06:38.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc0840700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 0x7f6dbc1082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:38.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc1041700 1 -- 172.21.15.96:0/3867247160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 msgr2=0x7f6dbc1082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc1041700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 0x7f6dbc1082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc1041700 1 -- 172.21.15.96:0/3867247160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac005040 con 0x7f6dbc0f6530 2022-02-02T22:06:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc0840700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 0x7f6dbc1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:06:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc1041700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 secure :-1 s=READY pgs=3450 cs=0 l=1 rev1=1 rx=0x7f6db8002700 tx=0x7f6db8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:38.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db8009320 con 0x7f6dbc0f6530 2022-02-02T22:06:38.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6db800f040 con 0x7f6dbc0f6530 2022-02-02T22:06:38.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc108890 con 0x7f6dbc0f6530 2022-02-02T22:06:38.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db8014900 con 0x7f6dbc0f6530 2022-02-02T22:06:38.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.099+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc108e50 con 0x7f6dbc0f6530 2022-02-02T22:06:38.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.100+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc1090d0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.100+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6db8009480 con 0x7f6dbc0f6530 2022-02-02T22:06:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.101+0000 7f6db1ffb700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 0x7f6da80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:06:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.101+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6db8081cc0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.101+0000 7f6dc0840700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 0x7f6da80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:06:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.101+0000 7f6dc0840700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 0x7f6da80672e0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f6dac000c00 tx=0x7f6dac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:06:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.105+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6db80538b0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.304+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6dbc0fecf0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.304+0000 7f6db1ffb700 1 -- 172.21.15.96:0/3867247160 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6db80534a0 con 0x7f6dbc0f6530 2022-02-02T22:06:38.305 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:06:38.305 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:06:38.306 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:06:38.306 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:06:38.306 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:06:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:06:38.307 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:06:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:06:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:06:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:06:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:06:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:06:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:06:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:06:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:06:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:06:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:06:38.311 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:06:38.312 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:06:38.312 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:06:38.312 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:06:38.313 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:06:38.313 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:06:38.313 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:06:38.314 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:06:38.314 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:06:38.314 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:06:38.315 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:06:38.315 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:06:38.315 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:06:38.316 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:06:38.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:38.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:38.317 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:06:38.317 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:06:38.318 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:38.318 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:38.318 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:06:38.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 msgr2=0x7f6da80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 0x7f6da80672e0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f6dac000c00 tx=0x7f6dac009b30).stop 2022-02-02T22:06:38.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 msgr2=0x7f6dbc106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:06:38.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 secure :-1 s=READY pgs=3450 cs=0 l=1 rev1=1 rx=0x7f6db8002700 tx=0x7f6db8009d80).stop 2022-02-02T22:06:38.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 shutdown_connections 2022-02-02T22:06:38.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6da8064e20 0x7f6da80672e0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dbc0f6530 0x7f6dbc106f00 unknown :-1 s=CLOSED pgs=3450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 --2- 172.21.15.96:0/3867247160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dbc1073f0 0x7f6dbc1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:06:38.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 >> 172.21.15.96:0/3867247160 conn(0x7f6dbc0f1c90 msgr2=0x7f6dbc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:06:38.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 shutdown_connections 2022-02-02T22:06:38.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:06:38.306+0000 7f6dc2043700 1 -- 172.21.15.96:0/3867247160 wait complete. 2022-02-02T22:06:38.324 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:06:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:38 smithi159 ceph-mon[69013]: pgmap v6735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:38 smithi159 ceph-mon[69013]: from='client.41004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:38 smithi159 ceph-mon[69013]: from='client.41008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/736996751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:06:38.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3867247160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:06:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:38 smithi096 ceph-mon[101353]: pgmap v6735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:38 smithi096 ceph-mon[101353]: from='client.41004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:38 smithi096 ceph-mon[101353]: from='client.41008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:06:38.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/736996751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:06:38.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3867247160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:06:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:40 smithi159 ceph-mon[69013]: pgmap v6736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:40 smithi096 ceph-mon[101353]: pgmap v6736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:42 smithi159 ceph-mon[69013]: pgmap v6737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:42 smithi096 ceph-mon[101353]: pgmap v6737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:44 smithi159 ceph-mon[69013]: pgmap v6738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:44 smithi096 ceph-mon[101353]: pgmap v6738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:46 smithi159 ceph-mon[69013]: pgmap v6739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:46 smithi096 ceph-mon[101353]: pgmap v6739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:48 smithi159 ceph-mon[69013]: pgmap v6740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:48 smithi096 ceph-mon[101353]: pgmap v6740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:50 smithi159 ceph-mon[69013]: pgmap v6741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:50 smithi096 ceph-mon[101353]: pgmap v6741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:52 smithi159 ceph-mon[69013]: pgmap v6742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:52 smithi096 ceph-mon[101353]: pgmap v6742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:54 smithi159 ceph-mon[69013]: pgmap v6743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:54 smithi096 ceph-mon[101353]: pgmap v6743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:56 smithi159 ceph-mon[69013]: pgmap v6744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:56 smithi096 ceph-mon[101353]: pgmap v6744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:06:58 smithi159 ceph-mon[69013]: pgmap v6745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:06:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:06:58 smithi096 ceph-mon[101353]: pgmap v6745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:00 smithi159 ceph-mon[69013]: pgmap v6746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:00 smithi096 ceph-mon[101353]: pgmap v6746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:02 smithi159 ceph-mon[69013]: pgmap v6747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:02 smithi096 ceph-mon[101353]: pgmap v6747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:04 smithi159 ceph-mon[69013]: pgmap v6748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:04 smithi096 ceph-mon[101353]: pgmap v6748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:06 smithi159 ceph-mon[69013]: pgmap v6749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:06 smithi096 ceph-mon[101353]: pgmap v6749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:08.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 -- 172.21.15.96:0/354595041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f55c0 msgr2=0x7f0d100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 --2- 172.21.15.96:0/354595041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f55c0 0x7f0d100f59e0 secure :-1 s=READY pgs=3451 cs=0 l=1 rev1=1 rx=0x7f0d0c004660 tx=0x7f0d0c009b30).stop 2022-02-02T22:07:08.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 -- 172.21.15.96:0/354595041 shutdown_connections 2022-02-02T22:07:08.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 --2- 172.21.15.96:0/354595041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f6860 0x7f0d100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 --2- 172.21.15.96:0/354595041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f55c0 0x7f0d100f59e0 unknown :-1 s=CLOSED pgs=3451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 -- 172.21.15.96:0/354595041 >> 172.21.15.96:0/354595041 conn(0x7f0d100f0d40 msgr2=0x7f0d100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:08.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 -- 172.21.15.96:0/354595041 shutdown_connections 2022-02-02T22:07:08.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.418+0000 7f0d17463700 1 -- 172.21.15.96:0/354595041 wait complete. 2022-02-02T22:07:08.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 Processor -- start 2022-02-02T22:07:08.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 -- start start 2022-02-02T22:07:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f55c0 0x7f0d100f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100f8100 con 0x7f0d100f6860 2022-02-02T22:07:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d17463700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100f8240 con 0x7f0d100f55c0 2022-02-02T22:07:08.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46638/0 (socket says 172.21.15.96:46638) 2022-02-02T22:07:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 -- 172.21.15.96:0/3433224517 learned_addr learned my addr 172.21.15.96:0/3433224517 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:08.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d151ff700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f55c0 0x7f0d100f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 -- 172.21.15.96:0/3433224517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f55c0 msgr2=0x7f0d100f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f55c0 0x7f0d100f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.419+0000 7f0d149fe700 1 -- 172.21.15.96:0/3433224517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c005040 con 0x7f0d100f6860 2022-02-02T22:07:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d149fe700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 secure :-1 s=READY pgs=3452 cs=0 l=1 rev1=1 rx=0x7f0d0000c530 tx=0x7f0d00007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:08.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d0000f650 con 0x7f0d100f6860 2022-02-02T22:07:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d0000fc60 con 0x7f0d100f6860 2022-02-02T22:07:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d100f8520 con 0x7f0d100f6860 2022-02-02T22:07:08.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d00012c20 con 0x7f0d100f6860 2022-02-02T22:07:08.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.420+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1010efa0 con 0x7f0d100f6860 2022-02-02T22:07:08.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.421+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10045ad0 con 0x7f0d100f6860 2022-02-02T22:07:08.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.422+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d00010070 con 0x7f0d100f6860 2022-02-02T22:07:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.422+0000 7f0d05ffb700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 0x7f0cfc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.422+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0d00081640 con 0x7f0d100f6860 2022-02-02T22:07:08.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.422+0000 7f0d151ff700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 0x7f0cfc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.423+0000 7f0d151ff700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 0x7f0cfc067290 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f0d0c013690 tx=0x7f0d0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.426+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d000477d0 con 0x7f0d100f6860 2022-02-02T22:07:08.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.605+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d100faca0 con 0x7f0cfc064dd0 2022-02-02T22:07:08.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.606+0000 7f0d05ffb700 1 -- 172.21.15.96:0/3433224517 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0d100faca0 con 0x7f0cfc064dd0 2022-02-02T22:07:08.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 msgr2=0x7f0cfc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 0x7f0cfc067290 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f0d0c013690 tx=0x7f0d0c009b30).stop 2022-02-02T22:07:08.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 msgr2=0x7f0d100f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 secure :-1 s=READY pgs=3452 cs=0 l=1 rev1=1 rx=0x7f0d0000c530 tx=0x7f0d00007e20).stop 2022-02-02T22:07:08.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 shutdown_connections 2022-02-02T22:07:08.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cfc064dd0 0x7f0cfc067290 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100f55c0 0x7f0d100f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 --2- 172.21.15.96:0/3433224517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d100f6860 0x7f0d100f7ba0 unknown :-1 s=CLOSED pgs=3452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 >> 172.21.15.96:0/3433224517 conn(0x7f0d100f0d40 msgr2=0x7f0d1005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 shutdown_connections 2022-02-02T22:07:08.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.608+0000 7f0d17463700 1 -- 172.21.15.96:0/3433224517 wait complete. 2022-02-02T22:07:08.619 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:07:08.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 -- 172.21.15.96:0/4263219280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f6870 msgr2=0x7f2c740f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 --2- 172.21.15.96:0/4263219280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f6870 0x7f2c740f6cd0 secure :-1 s=READY pgs=3453 cs=0 l=1 rev1=1 rx=0x7f2c64004660 tx=0x7f2c64009b30).stop 2022-02-02T22:07:08.708 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:08 smithi096 ceph-mon[101353]: pgmap v6750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 -- 172.21.15.96:0/4263219280 shutdown_connections 2022-02-02T22:07:08.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 --2- 172.21.15.96:0/4263219280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f6870 0x7f2c740f6cd0 unknown :-1 s=CLOSED pgs=3453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 --2- 172.21.15.96:0/4263219280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f55d0 0x7f2c740f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 -- 172.21.15.96:0/4263219280 >> 172.21.15.96:0/4263219280 conn(0x7f2c740f0d70 msgr2=0x7f2c740f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 -- 172.21.15.96:0/4263219280 shutdown_connections 2022-02-02T22:07:08.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.706+0000 7f2c79497700 1 -- 172.21.15.96:0/4263219280 wait complete. 2022-02-02T22:07:08.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 Processor -- start 2022-02-02T22:07:08.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 -- start start 2022-02-02T22:07:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 0x7f2c7410c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740604c0 con 0x7f2c740f55d0 2022-02-02T22:07:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c79497700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74060600 con 0x7f2c740f6870 2022-02-02T22:07:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46646/0 (socket says 172.21.15.96:46646) 2022-02-02T22:07:08.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 -- 172.21.15.96:0/2975685650 learned_addr learned my addr 172.21.15.96:0/2975685650 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:08.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c727fc700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 0x7f2c7410c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 -- 172.21.15.96:0/2975685650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 msgr2=0x7f2c7410c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 0x7f2c7410c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.707+0000 7f2c72ffd700 1 -- 172.21.15.96:0/2975685650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64005040 con 0x7f2c740f55d0 2022-02-02T22:07:08.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c727fc700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 0x7f2c7410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:07:08.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c72ffd700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 secure :-1 s=READY pgs=3454 cs=0 l=1 rev1=1 rx=0x7f2c6800e7c0 tx=0x7f2c6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:08.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c680092e0 con 0x7f2c740f55d0 2022-02-02T22:07:08.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7410c650 con 0x7f2c740f55d0 2022-02-02T22:07:08.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c6800f040 con 0x7f2c740f55d0 2022-02-02T22:07:08.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c68014750 con 0x7f2c740f55d0 2022-02-02T22:07:08.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.708+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7410cc10 con 0x7f2c740f55d0 2022-02-02T22:07:08.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.709+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74045ad0 con 0x7f2c740f55d0 2022-02-02T22:07:08.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.709+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c6801b030 con 0x7f2c740f55d0 2022-02-02T22:07:08.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.710+0000 7f2c5b7fe700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 0x7f2c5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:08.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.710+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c68081b10 con 0x7f2c740f55d0 2022-02-02T22:07:08.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.710+0000 7f2c727fc700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 0x7f2c5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:08.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.710+0000 7f2c727fc700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 0x7f2c5c067290 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f2c64004d80 tx=0x7f2c6400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:08.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.714+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c6804fc10 con 0x7f2c740f55d0 2022-02-02T22:07:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:08 smithi159 ceph-mon[69013]: pgmap v6750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:08.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.886+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c740fdf00 con 0x7f2c5c064dd0 2022-02-02T22:07:08.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.895+0000 7f2c5b7fe700 1 -- 172.21.15.96:0/2975685650 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2c740fdf00 con 0x7f2c5c064dd0 2022-02-02T22:07:08.896 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:07:08.897 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:07:08.897 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:07:08.898 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:07:08.898 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:07:08.898 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:07:08.899 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:07:08.899 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:07:08.899 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:07:08.900 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:07:08.900 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:07:08.901 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:07:08.901 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:07:08.901 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:07:08.902 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:07:08.902 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:07:08.903 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:07:08.903 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:07:08.903 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:07:08.904 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:07:08.904 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:07:08.904 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:07:08.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 msgr2=0x7f2c5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 0x7f2c5c067290 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f2c64004d80 tx=0x7f2c6400b040).stop 2022-02-02T22:07:08.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 msgr2=0x7f2c74109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 secure :-1 s=READY pgs=3454 cs=0 l=1 rev1=1 rx=0x7f2c6800e7c0 tx=0x7f2c6800b040).stop 2022-02-02T22:07:08.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 shutdown_connections 2022-02-02T22:07:08.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c5c064dd0 0x7f2c5c067290 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c740f55d0 0x7f2c74109ba0 unknown :-1 s=CLOSED pgs=3454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 --2- 172.21.15.96:0/2975685650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c740f6870 0x7f2c7410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 >> 172.21.15.96:0/2975685650 conn(0x7f2c740f0d70 msgr2=0x7f2c740fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:08.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 shutdown_connections 2022-02-02T22:07:08.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.897+0000 7f2c79497700 1 -- 172.21.15.96:0/2975685650 wait complete. 2022-02-02T22:07:08.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 -- 172.21.15.96:0/1626333286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 msgr2=0x7f62cc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:08.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 --2- 172.21.15.96:0/1626333286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc0f6cc0 secure :-1 s=READY pgs=3455 cs=0 l=1 rev1=1 rx=0x7f62bc004660 tx=0x7f62bc009b30).stop 2022-02-02T22:07:08.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 -- 172.21.15.96:0/1626333286 shutdown_connections 2022-02-02T22:07:08.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 --2- 172.21.15.96:0/1626333286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc0f6cc0 unknown :-1 s=CLOSED pgs=3455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:08.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 --2- 172.21.15.96:0/1626333286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 0x7f62cc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:07:08.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.993+0000 7f62d262a700 1 -- 172.21.15.96:0/1626333286 >> 172.21.15.96:0/1626333286 conn(0x7f62cc0f0d40 msgr2=0x7f62cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:08.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.994+0000 7f62d262a700 1 -- 172.21.15.96:0/1626333286 shutdown_connections 2022-02-02T22:07:08.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.994+0000 7f62d262a700 1 -- 172.21.15.96:0/1626333286 wait complete. 2022-02-02T22:07:09.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.994+0000 7f62d262a700 1 Processor -- start 2022-02-02T22:07:09.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.994+0000 7f62d262a700 1 -- start start 2022-02-02T22:07:09.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62d262a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 0x7f62cc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62d262a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62d262a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0604b0 con 0x7f62cc0f6860 2022-02-02T22:07:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62d262a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0605f0 con 0x7f62cc0f55c0 2022-02-02T22:07:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46658/0 (socket says 172.21.15.96:46658) 2022-02-02T22:07:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 -- 172.21.15.96:0/2786834960 learned_addr learned my addr 172.21.15.96:0/2786834960 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cbfff700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 0x7f62cc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 -- 172.21.15.96:0/2786834960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 msgr2=0x7f62cc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 0x7f62cc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 -- 172.21.15.96:0/2786834960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc005040 con 0x7f62cc0f6860 2022-02-02T22:07:09.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.995+0000 7f62cb7fe700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 secure :-1 s=READY pgs=3456 cs=0 l=1 rev1=1 rx=0x7f62bc009990 tx=0x7f62bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:09.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.996+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc018070 con 0x7f62cc0f6860 2022-02-02T22:07:09.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.996+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc10c770 con 0x7f62cc0f6860 2022-02-02T22:07:09.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.996+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62bc007ba0 con 0x7f62cc0f6860 2022-02-02T22:07:09.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.996+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc01c620 con 0x7f62cc0f6860 2022-02-02T22:07:09.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.996+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc10ccd0 con 0x7f62cc0f6860 2022-02-02T22:07:09.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.997+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc045ad0 con 0x7f62cc0f6860 2022-02-02T22:07:09.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.997+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f62bc01c8e0 con 0x7f62cc0f6860 2022-02-02T22:07:09.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.998+0000 7f62c8ff9700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 0x7f62b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.998+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f62bc083890 con 0x7f62cc0f6860 2022-02-02T22:07:09.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.998+0000 7f62cbfff700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 0x7f62b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:08.998+0000 7f62cbfff700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 0x7f62b4067290 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f62cc0600a0 tx=0x7f62c0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.002+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f62bc051990 con 0x7f62cc0f6860 2022-02-02T22:07:09.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.231+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62cc027a00 con 0x7f62cc0f6860 2022-02-02T22:07:09.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.232+0000 7f62c8ff9700 1 -- 172.21.15.96:0/2786834960 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f62bc054fb0 con 0x7f62cc0f6860 2022-02-02T22:07:09.234 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:07:09.234 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:07:09.234 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:07:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:07:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:07:09.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:09.236 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:07:09.236 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:07:09.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:09.237 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:07:09.238 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:07:09.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:09.238 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:07:09.239 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:07:09.239 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:07:09.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:07:09.240 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:07:09.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 msgr2=0x7f62b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 0x7f62b4067290 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f62cc0600a0 tx=0x7f62c0008040).stop 2022-02-02T22:07:09.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 msgr2=0x7f62cc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 secure :-1 s=READY pgs=3456 cs=0 l=1 rev1=1 rx=0x7f62bc009990 tx=0x7f62bc009b30).stop 2022-02-02T22:07:09.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 shutdown_connections 2022-02-02T22:07:09.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f62b4064dd0 0x7f62b4067290 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc0f55c0 0x7f62cc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 --2- 172.21.15.96:0/2786834960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62cc0f6860 0x7f62cc10c170 unknown :-1 s=CLOSED pgs=3456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 >> 172.21.15.96:0/2786834960 conn(0x7f62cc0f0d40 msgr2=0x7f62cc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:09.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 shutdown_connections 2022-02-02T22:07:09.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.234+0000 7f62d262a700 1 -- 172.21.15.96:0/2786834960 wait complete. 2022-02-02T22:07:09.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 -- 172.21.15.96:0/3613609558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 msgr2=0x7fa6500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 --2- 172.21.15.96:0/3613609558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa6500f5850 secure :-1 s=READY pgs=3457 cs=0 l=1 rev1=1 rx=0x7fa640004660 tx=0x7fa640009b30).stop 2022-02-02T22:07:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 -- 172.21.15.96:0/3613609558 shutdown_connections 2022-02-02T22:07:09.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 --2- 172.21.15.96:0/3613609558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa6500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:07:09.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 --2- 172.21.15.96:0/3613609558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa6500f5850 unknown :-1 s=CLOSED pgs=3457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 -- 172.21.15.96:0/3613609558 >> 172.21.15.96:0/3613609558 conn(0x7fa6500f0b90 msgr2=0x7fa6500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:09.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 -- 172.21.15.96:0/3613609558 shutdown_connections 2022-02-02T22:07:09.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.331+0000 7fa654bb5700 1 -- 172.21.15.96:0/3613609558 wait complete. 2022-02-02T22:07:09.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 Processor -- start 2022-02-02T22:07:09.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 -- start start 2022-02-02T22:07:09.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa65010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa650060470 con 0x7fa6500f5430 2022-02-02T22:07:09.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa654bb5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500605b0 con 0x7fa6500f66d0 2022-02-02T22:07:09.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa64f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa64f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46666/0 (socket says 172.21.15.96:46666) 2022-02-02T22:07:09.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.332+0000 7fa64f7fe700 1 -- 172.21.15.96:0/579727074 learned_addr learned my addr 172.21.15.96:0/579727074 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:09.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64effd700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa65010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64f7fe700 1 -- 172.21.15.96:0/579727074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 msgr2=0x7fa65010bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64f7fe700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa65010bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64f7fe700 1 -- 172.21.15.96:0/579727074 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640005040 con 0x7fa6500f5430 2022-02-02T22:07:09.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64effd700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa65010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:07:09.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa64f7fe700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 secure :-1 s=READY pgs=3458 cs=0 l=1 rev1=1 rx=0x7fa640004f60 tx=0x7fa640009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:09.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa640018070 con 0x7fa6500f5430 2022-02-02T22:07:09.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa640007ba0 con 0x7fa6500f5430 2022-02-02T22:07:09.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65010c5b0 con 0x7fa6500f5430 2022-02-02T22:07:09.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64001c620 con 0x7fa6500f5430 2022-02-02T22:07:09.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.333+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65010cae0 con 0x7fa6500f5430 2022-02-02T22:07:09.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.334+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa650059100 con 0x7fa6500f5430 2022-02-02T22:07:09.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.334+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa64001c8e0 con 0x7fa6500f5430 2022-02-02T22:07:09.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.335+0000 7fa637fff700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 0x7fa6380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:09.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.335+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa640083970 con 0x7fa6500f5430 2022-02-02T22:07:09.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.335+0000 7fa64effd700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 0x7fa6380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:09.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.335+0000 7fa64effd700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 0x7fa6380672e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7fa64400a7e0 tx=0x7fa644008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:09.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.339+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa640051b30 con 0x7fa6500f5430 2022-02-02T22:07:09.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.540+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa6500fdd80 con 0x7fa6500f5430 2022-02-02T22:07:09.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.540+0000 7fa637fff700 1 -- 172.21.15.96:0/579727074 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa640055150 con 0x7fa6500f5430 2022-02-02T22:07:09.542 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:07:09.542 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:07:09.543 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:07:09.543 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:07:09.543 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:09.544 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:07:09.544 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:07:09.545 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:07:09.545 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:07:09.545 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:07:09.546 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:07:09.546 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:07:09.547 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:07:09.547 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:07:09.547 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:07:09.548 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:07:09.548 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:07:09.548 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:07:09.549 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:07:09.549 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:07:09.549 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:07:09.550 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:07:09.550 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:07:09.550 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:07:09.551 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:07:09.551 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:07:09.551 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:07:09.552 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:07:09.552 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:07:09.552 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:07:09.553 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:07:09.553 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:07:09.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:09.554 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:09.554 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:07:09.554 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:09.555 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:09.555 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:09.555 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:09.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 msgr2=0x7fa6380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 0x7fa6380672e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7fa64400a7e0 tx=0x7fa644008040).stop 2022-02-02T22:07:09.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 msgr2=0x7fa650109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:09.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 secure :-1 s=READY pgs=3458 cs=0 l=1 rev1=1 rx=0x7fa640004f60 tx=0x7fa640009b30).stop 2022-02-02T22:07:09.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 shutdown_connections 2022-02-02T22:07:09.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa638064e20 0x7fa6380672e0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6500f5430 0x7fa650109ab0 unknown :-1 s=CLOSED pgs=3458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 --2- 172.21.15.96:0/579727074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6500f66d0 0x7fa65010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.543+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 >> 172.21.15.96:0/579727074 conn(0x7fa6500f0b90 msgr2=0x7fa6500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.544+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 shutdown_connections 2022-02-02T22:07:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:09.544+0000 7fa654bb5700 1 -- 172.21.15.96:0/579727074 wait complete. 2022-02-02T22:07:09.561 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:07:09.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:09 smithi159 ceph-mon[69013]: from='client.41020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:09.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2786834960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:07:09.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:09 smithi096 ceph-mon[101353]: from='client.41020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:09.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2786834960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:07:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:10 smithi159 ceph-mon[69013]: pgmap v6751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:10 smithi159 ceph-mon[69013]: from='client.41024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:10.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/579727074' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:07:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:10 smithi096 ceph-mon[101353]: pgmap v6751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:10.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:10 smithi096 ceph-mon[101353]: from='client.41024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:10.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/579727074' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:07:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:12 smithi159 ceph-mon[69013]: pgmap v6752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:12 smithi096 ceph-mon[101353]: pgmap v6752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:14 smithi159 ceph-mon[69013]: pgmap v6753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:14 smithi096 ceph-mon[101353]: pgmap v6753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:16 smithi159 ceph-mon[69013]: pgmap v6754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:16 smithi096 ceph-mon[101353]: pgmap v6754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:18 smithi159 ceph-mon[69013]: pgmap v6755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:18 smithi096 ceph-mon[101353]: pgmap v6755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:20 smithi159 ceph-mon[69013]: pgmap v6756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:20 smithi096 ceph-mon[101353]: pgmap v6756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:22 smithi159 ceph-mon[69013]: pgmap v6757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:22 smithi096 ceph-mon[101353]: pgmap v6757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:24 smithi159 ceph-mon[69013]: pgmap v6758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:24 smithi096 ceph-mon[101353]: pgmap v6758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:26 smithi159 ceph-mon[69013]: pgmap v6759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:26 smithi096 ceph-mon[101353]: pgmap v6759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:28 smithi159 ceph-mon[69013]: pgmap v6760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:07:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:07:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:28 smithi096 ceph-mon[101353]: pgmap v6760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:07:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:07:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:30 smithi159 ceph-mon[69013]: pgmap v6761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:30 smithi096 ceph-mon[101353]: pgmap v6761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:32 smithi159 ceph-mon[69013]: pgmap v6762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:32 smithi096 ceph-mon[101353]: pgmap v6762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:34 smithi159 ceph-mon[69013]: pgmap v6763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:34 smithi096 ceph-mon[101353]: pgmap v6763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:36 smithi159 ceph-mon[69013]: pgmap v6764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:36 smithi096 ceph-mon[101353]: pgmap v6764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:38 smithi159 ceph-mon[69013]: pgmap v6765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:38 smithi096 ceph-mon[101353]: pgmap v6765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:39.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 -- 172.21.15.96:0/1983002756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 msgr2=0x7f77200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 --2- 172.21.15.96:0/1983002756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f77200f59e0 secure :-1 s=READY pgs=3459 cs=0 l=1 rev1=1 rx=0x7f7714004660 tx=0x7f7714009b30).stop 2022-02-02T22:07:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 -- 172.21.15.96:0/1983002756 shutdown_connections 2022-02-02T22:07:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 --2- 172.21.15.96:0/1983002756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 0x7f77200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 --2- 172.21.15.96:0/1983002756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f77200f59e0 unknown :-1 s=CLOSED pgs=3459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 -- 172.21.15.96:0/1983002756 >> 172.21.15.96:0/1983002756 conn(0x7f77200f0d40 msgr2=0x7f77200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 -- 172.21.15.96:0/1983002756 shutdown_connections 2022-02-02T22:07:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.655+0000 7f7727a73700 1 -- 172.21.15.96:0/1983002756 wait complete. 2022-02-02T22:07:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 Processor -- start 2022-02-02T22:07:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 -- start start 2022-02-02T22:07:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 0x7f7720109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7720109c00 con 0x7f77200f55c0 2022-02-02T22:07:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f7727a73700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7720109d40 con 0x7f77200f6860 2022-02-02T22:07:39.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f772580f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f772580f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46684/0 (socket says 172.21.15.96:46684) 2022-02-02T22:07:39.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f772580f700 1 -- 172.21.15.96:0/1728650556 learned_addr learned my addr 172.21.15.96:0/1728650556 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:39.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.656+0000 7f772500e700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 0x7f7720109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f772580f700 1 -- 172.21.15.96:0/1728650556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 msgr2=0x7f7720109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f772580f700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 0x7f7720109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f772580f700 1 -- 172.21.15.96:0/1728650556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714005040 con 0x7f77200f55c0 2022-02-02T22:07:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f772580f700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 secure :-1 s=READY pgs=3460 cs=0 l=1 rev1=1 rx=0x7f7714013a70 tx=0x7f7714009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:39.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7714018070 con 0x7f77200f55c0 2022-02-02T22:07:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772010a680 con 0x7f77200f55c0 2022-02-02T22:07:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77140097d0 con 0x7f77200f55c0 2022-02-02T22:07:39.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771401de80 con 0x7f77200f55c0 2022-02-02T22:07:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.657+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772010abe0 con 0x7f77200f55c0 2022-02-02T22:07:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.658+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7720045ad0 con 0x7f77200f55c0 2022-02-02T22:07:39.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.658+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7714007ba0 con 0x7f77200f55c0 2022-02-02T22:07:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.659+0000 7f77127fc700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 0x7f770c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.659+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7714083660 con 0x7f77200f55c0 2022-02-02T22:07:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.659+0000 7f772500e700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 0x7f770c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.659+0000 7f772500e700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 0x7f770c067290 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f771c004c40 tx=0x7f771c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:39.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.663+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7714055190 con 0x7f77200f55c0 2022-02-02T22:07:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.841+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77200faaa0 con 0x7f770c064dd0 2022-02-02T22:07:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.842+0000 7f77127fc700 1 -- 172.21.15.96:0/1728650556 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f77200faaa0 con 0x7f770c064dd0 2022-02-02T22:07:39.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 msgr2=0x7f770c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 0x7f770c067290 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f771c004c40 tx=0x7f771c00b040).stop 2022-02-02T22:07:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 msgr2=0x7f7720109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 secure :-1 s=READY pgs=3460 cs=0 l=1 rev1=1 rx=0x7f7714013a70 tx=0x7f7714009b30).stop 2022-02-02T22:07:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 shutdown_connections 2022-02-02T22:07:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f770c064dd0 0x7f770c067290 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77200f55c0 0x7f7720109160 unknown :-1 s=CLOSED pgs=3460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 --2- 172.21.15.96:0/1728650556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77200f6860 0x7f7720109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 >> 172.21.15.96:0/1728650556 conn(0x7f77200f0d40 msgr2=0x7f772005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:39.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 shutdown_connections 2022-02-02T22:07:39.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.844+0000 7f7727a73700 1 -- 172.21.15.96:0/1728650556 wait complete. 2022-02-02T22:07:39.854 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:07:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 -- 172.21.15.96:0/449955271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f5440 msgr2=0x7f1c680f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 --2- 172.21.15.96:0/449955271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f5440 0x7f1c680f5860 secure :-1 s=READY pgs=3461 cs=0 l=1 rev1=1 rx=0x7f1c5c004660 tx=0x7f1c5c009b30).stop 2022-02-02T22:07:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 -- 172.21.15.96:0/449955271 shutdown_connections 2022-02-02T22:07:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 --2- 172.21.15.96:0/449955271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f66e0 0x7f1c680f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 --2- 172.21.15.96:0/449955271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f5440 0x7f1c680f5860 unknown :-1 s=CLOSED pgs=3461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 -- 172.21.15.96:0/449955271 >> 172.21.15.96:0/449955271 conn(0x7f1c680f0ba0 msgr2=0x7f1c680f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 -- 172.21.15.96:0/449955271 shutdown_connections 2022-02-02T22:07:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.942+0000 7f1c6759e700 1 -- 172.21.15.96:0/449955271 wait complete. 2022-02-02T22:07:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 Processor -- start 2022-02-02T22:07:39.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 -- start start 2022-02-02T22:07:39.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f5440 0x7f1c68105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c681067e0 con 0x7f1c680f66e0 2022-02-02T22:07:39.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c6759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68106fe0 con 0x7f1c680f5440 2022-02-02T22:07:39.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c65d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c65d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46696/0 (socket says 172.21.15.96:46696) 2022-02-02T22:07:39.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.943+0000 7f1c65d9b700 1 -- 172.21.15.96:0/441629910 learned_addr learned my addr 172.21.15.96:0/441629910 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:39.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c6659c700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f5440 0x7f1c68105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c65d9b700 1 -- 172.21.15.96:0/441629910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f5440 msgr2=0x7f1c68105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:39.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c65d9b700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f5440 0x7f1c68105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:39.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c65d9b700 1 -- 172.21.15.96:0/441629910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c005040 con 0x7f1c680f66e0 2022-02-02T22:07:39.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c65d9b700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 secure :-1 s=READY pgs=3462 cs=0 l=1 rev1=1 rx=0x7f1c5800c530 tx=0x7f1c58007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:39.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5800f650 con 0x7f1c680f66e0 2022-02-02T22:07:39.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c681072c0 con 0x7f1c680f66e0 2022-02-02T22:07:39.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c5800fc60 con 0x7f1c680f66e0 2022-02-02T22:07:39.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c58012cd0 con 0x7f1c680f66e0 2022-02-02T22:07:39.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.944+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68107880 con 0x7f1c680f66e0 2022-02-02T22:07:39.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.945+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68059100 con 0x7f1c680f66e0 2022-02-02T22:07:39.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.945+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c58010070 con 0x7f1c680f66e0 2022-02-02T22:07:39.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.946+0000 7f1c56ffd700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 0x7f1c500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:39.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.946+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c58081770 con 0x7f1c680f66e0 2022-02-02T22:07:39.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.946+0000 7f1c6659c700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 0x7f1c500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:39.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.946+0000 7f1c6659c700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 0x7f1c500672e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f1c5c009da0 tx=0x7f1c5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:39.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:39.950+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c580532a0 con 0x7f1c680f66e0 2022-02-02T22:07:40.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.123+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c680fdc70 con 0x7f1c50064e20 2022-02-02T22:07:40.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.132+0000 7f1c56ffd700 1 -- 172.21.15.96:0/441629910 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1c680fdc70 con 0x7f1c50064e20 2022-02-02T22:07:40.132 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:07:40.133 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:07:40.133 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:07:40.134 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:07:40.134 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:07:40.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:07:40.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:07:40.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:07:40.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:07:40.136 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:07:40.136 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:07:40.136 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:07:40.137 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:07:40.137 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:07:40.137 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:07:40.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:07:40.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:07:40.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:07:40.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:07:40.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:07:40.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:07:40.139 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:07:40.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 msgr2=0x7f1c500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 0x7f1c500672e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f1c5c009da0 tx=0x7f1c5c009b30).stop 2022-02-02T22:07:40.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 msgr2=0x7f1c68106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 secure :-1 s=READY pgs=3462 cs=0 l=1 rev1=1 rx=0x7f1c5800c530 tx=0x7f1c58007e20).stop 2022-02-02T22:07:40.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 shutdown_connections 2022-02-02T22:07:40.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c50064e20 0x7f1c500672e0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c680f5440 0x7f1c68105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 --2- 172.21.15.96:0/441629910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c680f66e0 0x7f1c68106230 unknown :-1 s=CLOSED pgs=3462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.134+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 >> 172.21.15.96:0/441629910 conn(0x7f1c680f0ba0 msgr2=0x7f1c680fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:40.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.135+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 shutdown_connections 2022-02-02T22:07:40.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.135+0000 7f1c6759e700 1 -- 172.21.15.96:0/441629910 wait complete. 2022-02-02T22:07:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 -- 172.21.15.96:0/3784153172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f66d0 msgr2=0x7f69b40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 --2- 172.21.15.96:0/3784153172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f66d0 0x7f69b40f6b30 secure :-1 s=READY pgs=3463 cs=0 l=1 rev1=1 rx=0x7f69a4004660 tx=0x7f69a4009b30).stop 2022-02-02T22:07:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 -- 172.21.15.96:0/3784153172 shutdown_connections 2022-02-02T22:07:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 --2- 172.21.15.96:0/3784153172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f66d0 0x7f69b40f6b30 unknown :-1 s=CLOSED pgs=3463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 --2- 172.21.15.96:0/3784153172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f5430 0x7f69b40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:07:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 -- 172.21.15.96:0/3784153172 >> 172.21.15.96:0/3784153172 conn(0x7f69b40f0b90 msgr2=0x7f69b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.231+0000 7f69b359e700 1 -- 172.21.15.96:0/3784153172 shutdown_connections 2022-02-02T22:07:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 -- 172.21.15.96:0/3784153172 wait complete. 2022-02-02T22:07:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 Processor -- start 2022-02-02T22:07:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 -- start start 2022-02-02T22:07:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 0x7f69b4069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40697a0 con 0x7f69b40f5430 2022-02-02T22:07:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b410f870 con 0x7f69b40f66d0 2022-02-02T22:07:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46702/0 (socket says 172.21.15.96:46702) 2022-02-02T22:07:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.232+0000 7f69b259c700 1 -- 172.21.15.96:0/1545274296 learned_addr learned my addr 172.21.15.96:0/1545274296 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b1d9b700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 0x7f69b4069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b259c700 1 -- 172.21.15.96:0/1545274296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 msgr2=0x7f69b4069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b259c700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 0x7f69b4069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b259c700 1 -- 172.21.15.96:0/1545274296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4005040 con 0x7f69b40f5430 2022-02-02T22:07:40.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b1d9b700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 0x7f69b4069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:07:40.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b259c700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 secure :-1 s=READY pgs=3464 cs=0 l=1 rev1=1 rx=0x7f69a80093f0 tx=0x7f69a8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:40.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a8009ea0 con 0x7f69b40f5430 2022-02-02T22:07:40.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b410fb50 con 0x7f69b40f5430 2022-02-02T22:07:40.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69a8013af0 con 0x7f69b40f5430 2022-02-02T22:07:40.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a800db10 con 0x7f69b40f5430 2022-02-02T22:07:40.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.233+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b4110110 con 0x7f69b40f5430 2022-02-02T22:07:40.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f69a801a060 con 0x7f69b40f5430 2022-02-02T22:07:40.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b4059100 con 0x7f69b40f5430 2022-02-02T22:07:40.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69a2ffd700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 0x7f699c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f69a8081aa0 con 0x7f69b40f5430 2022-02-02T22:07:40.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69b1d9b700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 0x7f699c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.235+0000 7f69b1d9b700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 0x7f699c0694f0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f69a4009da0 tx=0x7f69a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:40.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.240+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69a804fba0 con 0x7f69b40f5430 2022-02-02T22:07:40.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.471+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69b4062670 con 0x7f69b40f5430 2022-02-02T22:07:40.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.471+0000 7f69a2ffd700 1 -- 172.21.15.96:0/1545274296 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f69a8018070 con 0x7f69b40f5430 2022-02-02T22:07:40.472 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:07:40.472 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:07:40.472 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:07:40.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:40.473 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:07:40.473 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:07:40.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:40.474 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:07:40.474 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:07:40.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:40.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:07:40.475 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:07:40.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:07:40.476 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:07:40.476 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:07:40.477 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:07:40.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:07:40.477 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:07:40.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 msgr2=0x7f699c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 0x7f699c0694f0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f69a4009da0 tx=0x7f69a4009b30).stop 2022-02-02T22:07:40.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 msgr2=0x7f69b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 secure :-1 s=READY pgs=3464 cs=0 l=1 rev1=1 rx=0x7f69a80093f0 tx=0x7f69a8006ec0).stop 2022-02-02T22:07:40.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 shutdown_connections 2022-02-02T22:07:40.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f699c067030 0x7f699c0694f0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b40f5430 0x7f69b4068c20 unknown :-1 s=CLOSED pgs=3464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 --2- 172.21.15.96:0/1545274296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b40f66d0 0x7f69b4069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 >> 172.21.15.96:0/1545274296 conn(0x7f69b40f0b90 msgr2=0x7f69b40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:40.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 shutdown_connections 2022-02-02T22:07:40.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.473+0000 7f69b359e700 1 -- 172.21.15.96:0/1545274296 wait complete. 2022-02-02T22:07:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:40 smithi096 ceph-mon[101353]: pgmap v6766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:40.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 -- 172.21.15.96:0/2616979419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 msgr2=0x7f621c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 --2- 172.21.15.96:0/2616979419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c0f6b30 secure :-1 s=READY pgs=3465 cs=0 l=1 rev1=1 rx=0x7f6210004660 tx=0x7f6210009b30).stop 2022-02-02T22:07:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 -- 172.21.15.96:0/2616979419 shutdown_connections 2022-02-02T22:07:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 --2- 172.21.15.96:0/2616979419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c0f6b30 unknown :-1 s=CLOSED pgs=3465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 --2- 172.21.15.96:0/2616979419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 0x7f621c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 -- 172.21.15.96:0/2616979419 >> 172.21.15.96:0/2616979419 conn(0x7f621c0f0b90 msgr2=0x7f621c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 -- 172.21.15.96:0/2616979419 shutdown_connections 2022-02-02T22:07:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.571+0000 7f6222b50700 1 -- 172.21.15.96:0/2616979419 wait complete. 2022-02-02T22:07:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 Processor -- start 2022-02-02T22:07:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 -- start start 2022-02-02T22:07:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 0x7f621c1099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c060420 con 0x7f621c0f66d0 2022-02-02T22:07:40.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.572+0000 7f6222b50700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c060560 con 0x7f621c0f5430 2022-02-02T22:07:40.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46714/0 (socket says 172.21.15.96:46714) 2022-02-02T22:07:40.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 -- 172.21.15.96:0/8594228 learned_addr learned my addr 172.21.15.96:0/8594228 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:07:40.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f6221b4e700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 0x7f621c1099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 -- 172.21.15.96:0/8594228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 msgr2=0x7f621c1099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 0x7f621c1099e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 -- 172.21.15.96:0/8594228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210005040 con 0x7f621c0f66d0 2022-02-02T22:07:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f622134d700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 secure :-1 s=READY pgs=3466 cs=0 l=1 rev1=1 rx=0x7f6210009830 tx=0x7f6210009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210018070 con 0x7f621c0f66d0 2022-02-02T22:07:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c10c490 con 0x7f621c0f66d0 2022-02-02T22:07:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6210007ba0 con 0x7f621c0f66d0 2022-02-02T22:07:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621001c3c0 con 0x7f621c0f66d0 2022-02-02T22:07:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.573+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c10c9c0 con 0x7f621c0f66d0 2022-02-02T22:07:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.574+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c059100 con 0x7f621c0f66d0 2022-02-02T22:07:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.575+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6210007d10 con 0x7f621c0f66d0 2022-02-02T22:07:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.575+0000 7f620e7fc700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 0x7f62080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:07:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.575+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f62100835f0 con 0x7f621c0f66d0 2022-02-02T22:07:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.575+0000 7f6221b4e700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 0x7f62080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:07:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.575+0000 7f6221b4e700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 0x7f62080672e0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f621c0600a0 tx=0x7f621800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:07:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.579+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f62100516f0 con 0x7f621c0f66d0 2022-02-02T22:07:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:40 smithi159 ceph-mon[69013]: pgmap v6766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:40.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.782+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f621c0fdbf0 con 0x7f621c0f66d0 2022-02-02T22:07:40.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.783+0000 7f620e7fc700 1 -- 172.21.15.96:0/8594228 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6210054d10 con 0x7f621c0f66d0 2022-02-02T22:07:40.783 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:07:40.784 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:07:40.784 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:07:40.784 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:07:40.785 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:40.785 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:07:40.786 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:07:40.786 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:07:40.786 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:07:40.787 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:07:40.787 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:07:40.787 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:07:40.788 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:07:40.788 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:07:40.788 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:07:40.789 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:07:40.789 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:07:40.789 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:07:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:07:40.790 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:07:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:07:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:07:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:07:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:07:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:07:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:07:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:07:40.793 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:07:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:07:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:07:40.794 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:07:40.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:07:40.795 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:40.795 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:40.796 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:07:40.796 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:07:40.796 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:40.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:40.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:07:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 msgr2=0x7f62080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 0x7f62080672e0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f621c0600a0 tx=0x7f621800b040).stop 2022-02-02T22:07:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 msgr2=0x7f621c10bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:07:40.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 secure :-1 s=READY pgs=3466 cs=0 l=1 rev1=1 rx=0x7f6210009830 tx=0x7f6210009b30).stop 2022-02-02T22:07:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 shutdown_connections 2022-02-02T22:07:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6208064e20 0x7f62080672e0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f621c0f5430 0x7f621c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 --2- 172.21.15.96:0/8594228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f621c0f66d0 0x7f621c10bee0 unknown :-1 s=CLOSED pgs=3466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:07:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 >> 172.21.15.96:0/8594228 conn(0x7f621c0f0b90 msgr2=0x7f621c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:07:40.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 shutdown_connections 2022-02-02T22:07:40.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:07:40.785+0000 7f6222b50700 1 -- 172.21.15.96:0/8594228 wait complete. 2022-02-02T22:07:40.802 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:07:41.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:41 smithi159 ceph-mon[69013]: from='client.41036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:41 smithi159 ceph-mon[69013]: from='client.41040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:41.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1545274296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:07:41.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/8594228' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:07:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:41 smithi096 ceph-mon[101353]: from='client.41036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:41 smithi096 ceph-mon[101353]: from='client.41040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:07:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1545274296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:07:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/8594228' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:07:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:42 smithi159 ceph-mon[69013]: pgmap v6767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:42 smithi096 ceph-mon[101353]: pgmap v6767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:44 smithi159 ceph-mon[69013]: pgmap v6768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:44 smithi096 ceph-mon[101353]: pgmap v6768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:46 smithi159 ceph-mon[69013]: pgmap v6769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:46 smithi096 ceph-mon[101353]: pgmap v6769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:48 smithi159 ceph-mon[69013]: pgmap v6770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:48 smithi096 ceph-mon[101353]: pgmap v6770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:50 smithi159 ceph-mon[69013]: pgmap v6771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:50 smithi096 ceph-mon[101353]: pgmap v6771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:52 smithi159 ceph-mon[69013]: pgmap v6772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:52 smithi096 ceph-mon[101353]: pgmap v6772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:54 smithi159 ceph-mon[69013]: pgmap v6773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:54 smithi096 ceph-mon[101353]: pgmap v6773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:56 smithi159 ceph-mon[69013]: pgmap v6774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:56 smithi096 ceph-mon[101353]: pgmap v6774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:07:58 smithi159 ceph-mon[69013]: pgmap v6775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:07:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:07:58 smithi096 ceph-mon[101353]: pgmap v6775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:00 smithi159 ceph-mon[69013]: pgmap v6776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:00 smithi096 ceph-mon[101353]: pgmap v6776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:02 smithi159 ceph-mon[69013]: pgmap v6777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:02 smithi096 ceph-mon[101353]: pgmap v6777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:04 smithi159 ceph-mon[69013]: pgmap v6778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:04 smithi096 ceph-mon[101353]: pgmap v6778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:06 smithi159 ceph-mon[69013]: pgmap v6779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:06 smithi096 ceph-mon[101353]: pgmap v6779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:08 smithi159 ceph-mon[69013]: pgmap v6780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:08 smithi096 ceph-mon[101353]: pgmap v6780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:10 smithi096 ceph-mon[101353]: pgmap v6781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 -- 172.21.15.96:0/2499138559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f66e0 msgr2=0x7f8aac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/2499138559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f66e0 0x7f8aac0f6b00 secure :-1 s=READY pgs=3467 cs=0 l=1 rev1=1 rx=0x7f8a94004660 tx=0x7f8a94009b30).stop 2022-02-02T22:08:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 -- 172.21.15.96:0/2499138559 shutdown_connections 2022-02-02T22:08:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/2499138559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/2499138559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f66e0 0x7f8aac0f6b00 unknown :-1 s=CLOSED pgs=3467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 -- 172.21.15.96:0/2499138559 >> 172.21.15.96:0/2499138559 conn(0x7f8aac0f1f00 msgr2=0x7f8aac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 -- 172.21.15.96:0/2499138559 shutdown_connections 2022-02-02T22:08:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.894+0000 7f8ab17f4700 1 -- 172.21.15.96:0/2499138559 wait complete. 2022-02-02T22:08:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 Processor -- start 2022-02-02T22:08:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 -- start start 2022-02-02T22:08:10.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f66e0 0x7f8aac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:10.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:10.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac06a380 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.895+0000 7f8ab17f4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac06a4c0 con 0x7f8aac0f66e0 2022-02-02T22:08:10.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:10.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46732/0 (socket says 172.21.15.96:46732) 2022-02-02T22:08:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 -- 172.21.15.96:0/3327728050 learned_addr learned my addr 172.21.15.96:0/3327728050 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaaffd700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f66e0 0x7f8aac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:10.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 -- 172.21.15.96:0/3327728050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f66e0 msgr2=0x7f8aac06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f66e0 0x7f8aac06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 -- 172.21.15.96:0/3327728050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94005040 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aaa7fc700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 secure :-1 s=READY pgs=3468 cs=0 l=1 rev1=1 rx=0x7f8a9c0026d0 tx=0x7f8a9c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9c0079c0 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac06a7a0 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a9c00f040 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac10ef90 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.896+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9c0148b0 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.897+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a90004fa0 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.898+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a9c007b20 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.898+0000 7f8aa37fe700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 0x7f8a98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.898+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a9c081960 con 0x7f8aac0f6ff0 2022-02-02T22:08:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.898+0000 7f8aaaffd700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 0x7f8a98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:10.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.899+0000 7f8aaaffd700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 0x7f8a98067290 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f8a94004630 tx=0x7f8a94009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:10.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:10.903+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a9c04fa60 con 0x7f8aac0f6ff0 2022-02-02T22:08:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:10 smithi159 ceph-mon[69013]: pgmap v6781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:11.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.078+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a90000bc0 con 0x7f8a98064dd0 2022-02-02T22:08:11.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.079+0000 7f8aa37fe700 1 -- 172.21.15.96:0/3327728050 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8a90000bc0 con 0x7f8a98064dd0 2022-02-02T22:08:11.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 msgr2=0x7f8a98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 0x7f8a98067290 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f8a94004630 tx=0x7f8a94009b30).stop 2022-02-02T22:08:11.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 msgr2=0x7f8aac069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 secure :-1 s=READY pgs=3468 cs=0 l=1 rev1=1 rx=0x7f8a9c0026d0 tx=0x7f8a9c009de0).stop 2022-02-02T22:08:11.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 shutdown_connections 2022-02-02T22:08:11.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a98064dd0 0x7f8a98067290 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0f66e0 0x7f8aac06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 --2- 172.21.15.96:0/3327728050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aac0f6ff0 0x7f8aac069e20 unknown :-1 s=CLOSED pgs=3468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 >> 172.21.15.96:0/3327728050 conn(0x7f8aac0f1f00 msgr2=0x7f8aac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 shutdown_connections 2022-02-02T22:08:11.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.081+0000 7f8ab17f4700 1 -- 172.21.15.96:0/3327728050 wait complete. 2022-02-02T22:08:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:08:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 -- 172.21.15.96:0/435764610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f6860 msgr2=0x7f8e540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/435764610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f6860 0x7f8e540f6cc0 secure :-1 s=READY pgs=3469 cs=0 l=1 rev1=1 rx=0x7f8e44004660 tx=0x7f8e44009b30).stop 2022-02-02T22:08:11.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 -- 172.21.15.96:0/435764610 shutdown_connections 2022-02-02T22:08:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/435764610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f6860 0x7f8e540f6cc0 unknown :-1 s=CLOSED pgs=3469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/435764610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f55c0 0x7f8e540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 -- 172.21.15.96:0/435764610 >> 172.21.15.96:0/435764610 conn(0x7f8e540f0d40 msgr2=0x7f8e540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 -- 172.21.15.96:0/435764610 shutdown_connections 2022-02-02T22:08:11.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.178+0000 7f8e58c0d700 1 -- 172.21.15.96:0/435764610 wait complete. 2022-02-02T22:08:11.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 Processor -- start 2022-02-02T22:08:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 -- start start 2022-02-02T22:08:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f6860 0x7f8e54106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54106920 con 0x7f8e540f55c0 2022-02-02T22:08:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e58c0d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54107130 con 0x7f8e540f6860 2022-02-02T22:08:11.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46740/0 (socket says 172.21.15.96:46740) 2022-02-02T22:08:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e5259c700 1 -- 172.21.15.96:0/3736181530 learned_addr learned my addr 172.21.15.96:0/3736181530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:11.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e51d9b700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f6860 0x7f8e54106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.179+0000 7f8e5259c700 1 -- 172.21.15.96:0/3736181530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f6860 msgr2=0x7f8e54106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e5259c700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f6860 0x7f8e54106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e5259c700 1 -- 172.21.15.96:0/3736181530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44005040 con 0x7f8e540f55c0 2022-02-02T22:08:11.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e5259c700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 secure :-1 s=READY pgs=3470 cs=0 l=1 rev1=1 rx=0x7f8e3c00e7c0 tx=0x7f8e3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c0092e0 con 0x7f8e540f55c0 2022-02-02T22:08:11.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e3c00f040 con 0x7f8e540f55c0 2022-02-02T22:08:11.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e541073b0 con 0x7f8e540f55c0 2022-02-02T22:08:11.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c0147e0 con 0x7f8e540f55c0 2022-02-02T22:08:11.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.180+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e54107970 con 0x7f8e540f55c0 2022-02-02T22:08:11.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.181+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e540f49b0 con 0x7f8e540f55c0 2022-02-02T22:08:11.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.181+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8e3c01b030 con 0x7f8e540f55c0 2022-02-02T22:08:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.182+0000 7f8e4affd700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.182+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8e3c0819b0 con 0x7f8e540f55c0 2022-02-02T22:08:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.182+0000 7f8e51d9b700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.182+0000 7f8e51d9b700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 0x7f8e40067290 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f8e44005010 tx=0x7f8e44016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.186+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8e3c04fab0 con 0x7f8e540f55c0 2022-02-02T22:08:11.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.359+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e540008d0 con 0x7f8e40064dd0 2022-02-02T22:08:11.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.368+0000 7f8e4affd700 1 -- 172.21.15.96:0/3736181530 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8e540008d0 con 0x7f8e40064dd0 2022-02-02T22:08:11.368 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:08:11.369 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:08:11.369 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:08:11.369 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:08:11.370 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:08:11.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:08:11.370 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:08:11.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:08:11.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:08:11.371 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:08:11.372 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:08:11.372 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:08:11.372 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:08:11.373 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:08:11.373 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:08:11.373 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:08:11.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:08:11.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:08:11.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:08:11.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:08:11.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:08:11.376 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:08:11.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 msgr2=0x7f8e40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 0x7f8e40067290 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f8e44005010 tx=0x7f8e44016040).stop 2022-02-02T22:08:11.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 msgr2=0x7f8e54105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 secure :-1 s=READY pgs=3470 cs=0 l=1 rev1=1 rx=0x7f8e3c00e7c0 tx=0x7f8e3c00b040).stop 2022-02-02T22:08:11.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 shutdown_connections 2022-02-02T22:08:11.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e540f55c0 0x7f8e54105e30 unknown :-1 s=CLOSED pgs=3470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 --2- 172.21.15.96:0/3736181530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e540f6860 0x7f8e54106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 >> 172.21.15.96:0/3736181530 conn(0x7f8e540f0d40 msgr2=0x7f8e540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 shutdown_connections 2022-02-02T22:08:11.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.370+0000 7f8e58c0d700 1 -- 172.21.15.96:0/3736181530 wait complete. 2022-02-02T22:08:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 -- 172.21.15.96:0/2561736779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 msgr2=0x7f4f900f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2561736779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f900f7080 secure :-1 s=READY pgs=3471 cs=0 l=1 rev1=1 rx=0x7f4f84004660 tx=0x7f4f84009b30).stop 2022-02-02T22:08:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 -- 172.21.15.96:0/2561736779 shutdown_connections 2022-02-02T22:08:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2561736779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 0x7f4f900f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2561736779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f900f7080 unknown :-1 s=CLOSED pgs=3471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 -- 172.21.15.96:0/2561736779 >> 172.21.15.96:0/2561736779 conn(0x7f4f900f04c0 msgr2=0x7f4f900f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 -- 172.21.15.96:0/2561736779 shutdown_connections 2022-02-02T22:08:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.468+0000 7f4f9562b700 1 -- 172.21.15.96:0/2561736779 wait complete. 2022-02-02T22:08:11.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 Processor -- start 2022-02-02T22:08:11.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 -- start start 2022-02-02T22:08:11.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 0x7f4f90109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900f5620 con 0x7f4f900f6c60 2022-02-02T22:08:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f9562b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900f5760 con 0x7f4f900f5970 2022-02-02T22:08:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f8e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f8e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46752/0 (socket says 172.21.15.96:46752) 2022-02-02T22:08:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f8e7fc700 1 -- 172.21.15.96:0/2642090050 learned_addr learned my addr 172.21.15.96:0/2642090050 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.469+0000 7f4f8effd700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 0x7f4f90109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f8e7fc700 1 -- 172.21.15.96:0/2642090050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 msgr2=0x7f4f90109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f8e7fc700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 0x7f4f90109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f8e7fc700 1 -- 172.21.15.96:0/2642090050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84005040 con 0x7f4f900f6c60 2022-02-02T22:08:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f8e7fc700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 secure :-1 s=READY pgs=3472 cs=0 l=1 rev1=1 rx=0x7f4f80002700 tx=0x7f4f80009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f80009320 con 0x7f4f900f6c60 2022-02-02T22:08:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f8000f040 con 0x7f4f900f6c60 2022-02-02T22:08:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9010c6e0 con 0x7f4f900f6c60 2022-02-02T22:08:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f80014870 con 0x7f4f900f6c60 2022-02-02T22:08:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.470+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9010cca0 con 0x7f4f900f6c60 2022-02-02T22:08:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.471+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90045ad0 con 0x7f4f900f6c60 2022-02-02T22:08:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.472+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f80009480 con 0x7f4f900f6c60 2022-02-02T22:08:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.472+0000 7f4f777fe700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.472+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4f80081680 con 0x7f4f900f6c60 2022-02-02T22:08:11.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.472+0000 7f4f8effd700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.473+0000 7f4f8effd700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f4f84004630 tx=0x7f4f84009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.476+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f8004f6f0 con 0x7f4f900f6c60 2022-02-02T22:08:11.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.706+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f90027a00 con 0x7f4f900f6c60 2022-02-02T22:08:11.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.706+0000 7f4f777fe700 1 -- 172.21.15.96:0/2642090050 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4f80052d10 con 0x7f4f900f6c60 2022-02-02T22:08:11.708 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:08:11.709 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:08:11.709 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:08:11.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:11.711 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:08:11.711 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:08:11.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:11.712 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:08:11.712 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:08:11.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:11.713 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:08:11.713 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:08:11.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:11.714 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:08:11.714 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:08:11.715 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:08:11.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:08:11.715 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:08:11.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 msgr2=0x7f4f78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f4f84004630 tx=0x7f4f84009b30).stop 2022-02-02T22:08:11.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 msgr2=0x7f4f9010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 secure :-1 s=READY pgs=3472 cs=0 l=1 rev1=1 rx=0x7f4f80002700 tx=0x7f4f80009e00).stop 2022-02-02T22:08:11.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 shutdown_connections 2022-02-02T22:08:11.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4f78064dd0 0x7f4f78067290 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f900f5970 0x7f4f90109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 --2- 172.21.15.96:0/2642090050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f900f6c60 0x7f4f9010c130 unknown :-1 s=CLOSED pgs=3472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 >> 172.21.15.96:0/2642090050 conn(0x7f4f900f04c0 msgr2=0x7f4f900fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 shutdown_connections 2022-02-02T22:08:11.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.708+0000 7f4f9562b700 1 -- 172.21.15.96:0/2642090050 wait complete. 2022-02-02T22:08:11.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 -- 172.21.15.96:0/3989183188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 msgr2=0x7f6d2c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 --2- 172.21.15.96:0/3989183188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c0f6cc0 secure :-1 s=READY pgs=3473 cs=0 l=1 rev1=1 rx=0x7f6d1c004660 tx=0x7f6d1c009b30).stop 2022-02-02T22:08:11.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 -- 172.21.15.96:0/3989183188 shutdown_connections 2022-02-02T22:08:11.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 --2- 172.21.15.96:0/3989183188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c0f6cc0 unknown :-1 s=CLOSED pgs=3473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 --2- 172.21.15.96:0/3989183188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 -- 172.21.15.96:0/3989183188 >> 172.21.15.96:0/3989183188 conn(0x7f6d2c0f0d40 msgr2=0x7f6d2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 -- 172.21.15.96:0/3989183188 shutdown_connections 2022-02-02T22:08:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.805+0000 7f6d333d9700 1 -- 172.21.15.96:0/3989183188 wait complete. 2022-02-02T22:08:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 Processor -- start 2022-02-02T22:08:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 -- start start 2022-02-02T22:08:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c107a10 con 0x7f6d2c0f6860 2022-02-02T22:08:11.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d333d9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c107b50 con 0x7f6d2c0f55c0 2022-02-02T22:08:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46762/0 (socket says 172.21.15.96:46762) 2022-02-02T22:08:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 -- 172.21.15.96:0/2188086615 learned_addr learned my addr 172.21.15.96:0/2188086615 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d31175700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 -- 172.21.15.96:0/2188086615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 msgr2=0x7f6d2c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 -- 172.21.15.96:0/2188086615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c005040 con 0x7f6d2c0f6860 2022-02-02T22:08:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d31175700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:08:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d30974700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 secure :-1 s=READY pgs=3474 cs=0 l=1 rev1=1 rx=0x7f6d1c009990 tx=0x7f6d1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.806+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c018070 con 0x7f6d2c0f6860 2022-02-02T22:08:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.807+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c108490 con 0x7f6d2c0f6860 2022-02-02T22:08:11.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.807+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d1c007ca0 con 0x7f6d2c0f6860 2022-02-02T22:08:11.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.807+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c01c620 con 0x7f6d2c0f6860 2022-02-02T22:08:11.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.807+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c1089f0 con 0x7f6d2c0f6860 2022-02-02T22:08:11.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.808+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c045ad0 con 0x7f6d2c0f6860 2022-02-02T22:08:11.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.808+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d1c01d420 con 0x7f6d2c0f6860 2022-02-02T22:08:11.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.808+0000 7f6d21ffb700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 0x7f6d18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:11.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.809+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6d1c083810 con 0x7f6d2c0f6860 2022-02-02T22:08:11.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.809+0000 7f6d31175700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 0x7f6d18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:11.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.809+0000 7f6d31175700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 0x7f6d18067290 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f6d2c0f66c0 tx=0x7f6d28009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:11.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:11.813+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d1c055400 con 0x7f6d2c0f6860 2022-02-02T22:08:12.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.011+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6d2c1090f0 con 0x7f6d2c0f6860 2022-02-02T22:08:12.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.012+0000 7f6d21ffb700 1 -- 172.21.15.96:0/2188086615 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6d1c054ff0 con 0x7f6d2c0f6860 2022-02-02T22:08:12.012 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:08:12.013 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:08:12.013 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:08:12.014 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:08:12.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:12.014 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:08:12.015 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:08:12.015 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:08:12.015 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:08:12.016 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:08:12.016 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:08:12.016 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:08:12.017 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:08:12.017 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:08:12.017 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:08:12.018 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:08:12.018 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:08:12.018 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:08:12.019 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:08:12.019 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:08:12.019 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:08:12.020 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:08:12.020 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:08:12.020 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:08:12.021 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:08:12.021 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:08:12.021 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:08:12.022 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:08:12.022 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:08:12.023 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:08:12.023 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:08:12.023 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:08:12.024 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:12.024 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:12.024 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:08:12.025 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:12.025 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:12.026 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:12.026 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:12.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 msgr2=0x7f6d18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:12.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 0x7f6d18067290 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f6d2c0f66c0 tx=0x7f6d28009040).stop 2022-02-02T22:08:12.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 msgr2=0x7f6d2c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:12.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 secure :-1 s=READY pgs=3474 cs=0 l=1 rev1=1 rx=0x7f6d1c009990 tx=0x7f6d1c009b30).stop 2022-02-02T22:08:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 shutdown_connections 2022-02-02T22:08:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d18064dd0 0x7f6d18067290 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d2c0f55c0 0x7f6d2c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:12.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 --2- 172.21.15.96:0/2188086615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d2c0f6860 0x7f6d2c107460 unknown :-1 s=CLOSED pgs=3474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 >> 172.21.15.96:0/2188086615 conn(0x7f6d2c0f0d40 msgr2=0x7f6d2c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 shutdown_connections 2022-02-02T22:08:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:12.014+0000 7f6d333d9700 1 -- 172.21.15.96:0/2188086615 wait complete. 2022-02-02T22:08:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:08:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:12 smithi096 ceph-mon[101353]: pgmap v6782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:12 smithi096 ceph-mon[101353]: from='client.41052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:12 smithi096 ceph-mon[101353]: from='client.41056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:12.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2642090050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:08:12.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2188086615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:08:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:12 smithi159 ceph-mon[69013]: pgmap v6782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:12 smithi159 ceph-mon[69013]: from='client.41052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:12 smithi159 ceph-mon[69013]: from='client.41056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:13.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2642090050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:08:13.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2188086615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:08:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:14 smithi096 ceph-mon[101353]: pgmap v6783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:14 smithi159 ceph-mon[69013]: pgmap v6783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:16 smithi096 ceph-mon[101353]: pgmap v6784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:16 smithi159 ceph-mon[69013]: pgmap v6784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:18 smithi096 ceph-mon[101353]: pgmap v6785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:18 smithi159 ceph-mon[69013]: pgmap v6785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:20 smithi096 ceph-mon[101353]: pgmap v6786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:20 smithi159 ceph-mon[69013]: pgmap v6786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:22 smithi096 ceph-mon[101353]: pgmap v6787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:22 smithi159 ceph-mon[69013]: pgmap v6787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:24 smithi096 ceph-mon[101353]: pgmap v6788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:24 smithi159 ceph-mon[69013]: pgmap v6788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:26 smithi096 ceph-mon[101353]: pgmap v6789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:26 smithi159 ceph-mon[69013]: pgmap v6789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:28 smithi096 ceph-mon[101353]: pgmap v6790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:08:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:08:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:28 smithi159 ceph-mon[69013]: pgmap v6790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:08:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:08:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:30 smithi159 ceph-mon[69013]: pgmap v6791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:30 smithi096 ceph-mon[101353]: pgmap v6791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:32 smithi159 ceph-mon[69013]: pgmap v6792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:32 smithi096 ceph-mon[101353]: pgmap v6792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:34 smithi159 ceph-mon[69013]: pgmap v6793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:34 smithi096 ceph-mon[101353]: pgmap v6793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:36 smithi159 ceph-mon[69013]: pgmap v6794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:36 smithi096 ceph-mon[101353]: pgmap v6794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:38 smithi159 ceph-mon[69013]: pgmap v6795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:38 smithi096 ceph-mon[101353]: pgmap v6795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:40 smithi159 ceph-mon[69013]: pgmap v6796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:40 smithi096 ceph-mon[101353]: pgmap v6796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 -- 172.21.15.96:0/2816349494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 msgr2=0x7ff7340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 --2- 172.21.15.96:0/2816349494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff7340f6b00 secure :-1 s=READY pgs=3475 cs=0 l=1 rev1=1 rx=0x7ff724004660 tx=0x7ff724009b30).stop 2022-02-02T22:08:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 -- 172.21.15.96:0/2816349494 shutdown_connections 2022-02-02T22:08:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 --2- 172.21.15.96:0/2816349494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 0x7ff7340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 --2- 172.21.15.96:0/2816349494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff7340f6b00 unknown :-1 s=CLOSED pgs=3475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.123+0000 7ff739f7f700 1 -- 172.21.15.96:0/2816349494 >> 172.21.15.96:0/2816349494 conn(0x7ff7340f1e40 msgr2=0x7ff7340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.124+0000 7ff739f7f700 1 -- 172.21.15.96:0/2816349494 shutdown_connections 2022-02-02T22:08:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.124+0000 7ff739f7f700 1 -- 172.21.15.96:0/2816349494 wait complete. 2022-02-02T22:08:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.124+0000 7ff739f7f700 1 Processor -- start 2022-02-02T22:08:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.124+0000 7ff739f7f700 1 -- start start 2022-02-02T22:08:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 0x7ff7341074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734107a50 con 0x7ff7340f66e0 2022-02-02T22:08:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734107b90 con 0x7ff7340f7980 2022-02-02T22:08:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46788/0 (socket says 172.21.15.96:46788) 2022-02-02T22:08:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 -- 172.21.15.96:0/1060017191 learned_addr learned my addr 172.21.15.96:0/1060017191 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff732ffd700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 0x7ff7341074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 -- 172.21.15.96:0/1060017191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 msgr2=0x7ff7341074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 0x7ff7341074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 -- 172.21.15.96:0/1060017191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724005040 con 0x7ff7340f66e0 2022-02-02T22:08:42.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff7337fe700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 secure :-1 s=READY pgs=3476 cs=0 l=1 rev1=1 rx=0x7ff724013a70 tx=0x7ff724009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff724018070 con 0x7ff7340f66e0 2022-02-02T22:08:42.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7240097d0 con 0x7ff7340f66e0 2022-02-02T22:08:42.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7341084d0 con 0x7ff7340f66e0 2022-02-02T22:08:42.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72401de80 con 0x7ff7340f66e0 2022-02-02T22:08:42.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.125+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff734108a30 con 0x7ff7340f66e0 2022-02-02T22:08:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.126+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff734045ad0 con 0x7ff7340f66e0 2022-02-02T22:08:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.127+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff724007ba0 con 0x7ff7340f66e0 2022-02-02T22:08:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.127+0000 7ff71bfff700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 0x7ff71c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.127+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff724083650 con 0x7ff7340f66e0 2022-02-02T22:08:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.127+0000 7ff732ffd700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 0x7ff71c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.128+0000 7ff732ffd700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 0x7ff71c067290 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7ff728004c40 tx=0x7ff72800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.132+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff724055180 con 0x7ff7340f66e0 2022-02-02T22:08:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.309+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7340fefb0 con 0x7ff71c064dd0 2022-02-02T22:08:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.310+0000 7ff71bfff700 1 -- 172.21.15.96:0/1060017191 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff7340fefb0 con 0x7ff71c064dd0 2022-02-02T22:08:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 msgr2=0x7ff71c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 0x7ff71c067290 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7ff728004c40 tx=0x7ff72800b040).stop 2022-02-02T22:08:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 msgr2=0x7ff734106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 secure :-1 s=READY pgs=3476 cs=0 l=1 rev1=1 rx=0x7ff724013a70 tx=0x7ff724009b30).stop 2022-02-02T22:08:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 shutdown_connections 2022-02-02T22:08:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff71c064dd0 0x7ff71c067290 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7340f66e0 0x7ff734106fb0 unknown :-1 s=CLOSED pgs=3476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 --2- 172.21.15.96:0/1060017191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7340f7980 0x7ff7341074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 >> 172.21.15.96:0/1060017191 conn(0x7ff7340f1e40 msgr2=0x7ff7340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 shutdown_connections 2022-02-02T22:08:42.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.312+0000 7ff739f7f700 1 -- 172.21.15.96:0/1060017191 wait complete. 2022-02-02T22:08:42.321 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:08:42.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 -- 172.21.15.96:0/1928386966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 msgr2=0x7effa00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 --2- 172.21.15.96:0/1928386966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa00f6b30 secure :-1 s=READY pgs=3477 cs=0 l=1 rev1=1 rx=0x7eff9c004660 tx=0x7eff9c009b30).stop 2022-02-02T22:08:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 -- 172.21.15.96:0/1928386966 shutdown_connections 2022-02-02T22:08:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 --2- 172.21.15.96:0/1928386966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa00f6b30 unknown :-1 s=CLOSED pgs=3477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 --2- 172.21.15.96:0/1928386966 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 0x7effa00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 -- 172.21.15.96:0/1928386966 >> 172.21.15.96:0/1928386966 conn(0x7effa00f0b90 msgr2=0x7effa00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 -- 172.21.15.96:0/1928386966 shutdown_connections 2022-02-02T22:08:42.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.409+0000 7effa694b700 1 -- 172.21.15.96:0/1928386966 wait complete. 2022-02-02T22:08:42.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 Processor -- start 2022-02-02T22:08:42.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 -- start start 2022-02-02T22:08:42.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 0x7effa0105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0106760 con 0x7effa00f66d0 2022-02-02T22:08:42.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa694b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0106f60 con 0x7effa00f5430 2022-02-02T22:08:42.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa5148700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa5148700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46800/0 (socket says 172.21.15.96:46800) 2022-02-02T22:08:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.410+0000 7effa5148700 1 -- 172.21.15.96:0/2636037587 learned_addr learned my addr 172.21.15.96:0/2636037587 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa5949700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 0x7effa0105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa5148700 1 -- 172.21.15.96:0/2636037587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 msgr2=0x7effa0105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa5148700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 0x7effa0105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa5148700 1 -- 172.21.15.96:0/2636037587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c005040 con 0x7effa00f66d0 2022-02-02T22:08:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa5148700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 secure :-1 s=READY pgs=3478 cs=0 l=1 rev1=1 rx=0x7eff9c009990 tx=0x7eff9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff9c018070 con 0x7effa00f66d0 2022-02-02T22:08:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff9c007ca0 con 0x7effa00f66d0 2022-02-02T22:08:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff9c01c620 con 0x7effa00f66d0 2022-02-02T22:08:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa01071e0 con 0x7effa00f66d0 2022-02-02T22:08:42.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.411+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa01076c0 con 0x7effa00f66d0 2022-02-02T22:08:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.412+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0045ad0 con 0x7effa00f66d0 2022-02-02T22:08:42.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.413+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff9c01d960 con 0x7effa00f66d0 2022-02-02T22:08:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.413+0000 7eff967fc700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 0x7eff8c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.413+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7eff9c083700 con 0x7effa00f66d0 2022-02-02T22:08:42.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.413+0000 7effa5949700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 0x7eff8c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.413+0000 7effa5949700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 0x7eff8c0672e0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7effa00f6530 tx=0x7eff90009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.417+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff9c055230 con 0x7effa00f66d0 2022-02-02T22:08:42.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.591+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effa005f620 con 0x7eff8c064e20 2022-02-02T22:08:42.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.600+0000 7eff967fc700 1 -- 172.21.15.96:0/2636037587 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7effa005f620 con 0x7eff8c064e20 2022-02-02T22:08:42.600 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:08:42.600 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:08:42.601 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:08:42.601 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:08:42.601 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:08:42.602 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:08:42.602 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:08:42.603 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:08:42.603 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:08:42.603 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:08:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:08:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:08:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:08:42.605 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:08:42.605 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:08:42.605 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:08:42.606 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:08:42.606 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:08:42.606 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:08:42.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:08:42.607 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:08:42.607 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:08:42.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 msgr2=0x7eff8c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 0x7eff8c0672e0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7effa00f6530 tx=0x7eff90009040).stop 2022-02-02T22:08:42.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 msgr2=0x7effa01061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 secure :-1 s=READY pgs=3478 cs=0 l=1 rev1=1 rx=0x7eff9c009990 tx=0x7eff9c009b30).stop 2022-02-02T22:08:42.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 shutdown_connections 2022-02-02T22:08:42.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff8c064e20 0x7eff8c0672e0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa00f5430 0x7effa0105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 --2- 172.21.15.96:0/2636037587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effa00f66d0 0x7effa01061b0 unknown :-1 s=CLOSED pgs=3478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 >> 172.21.15.96:0/2636037587 conn(0x7effa00f0b90 msgr2=0x7effa00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 shutdown_connections 2022-02-02T22:08:42.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.602+0000 7effa694b700 1 -- 172.21.15.96:0/2636037587 wait complete. 2022-02-02T22:08:42.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 -- 172.21.15.96:0/146957024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 msgr2=0x7fc8f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 --2- 172.21.15.96:0/146957024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f00f6950 secure :-1 s=READY pgs=3479 cs=0 l=1 rev1=1 rx=0x7fc8ec004660 tx=0x7fc8ec009b30).stop 2022-02-02T22:08:42.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 -- 172.21.15.96:0/146957024 shutdown_connections 2022-02-02T22:08:42.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 --2- 172.21.15.96:0/146957024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 0x7fc8f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 --2- 172.21.15.96:0/146957024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f00f6950 unknown :-1 s=CLOSED pgs=3479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.701 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:42 smithi096 ceph-mon[101353]: pgmap v6797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.698+0000 7fc8f670b700 1 -- 172.21.15.96:0/146957024 >> 172.21.15.96:0/146957024 conn(0x7fc8f00f1c90 msgr2=0x7fc8f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 -- 172.21.15.96:0/146957024 shutdown_connections 2022-02-02T22:08:42.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 -- 172.21.15.96:0/146957024 wait complete. 2022-02-02T22:08:42.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 Processor -- start 2022-02-02T22:08:42.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 -- start start 2022-02-02T22:08:42.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 0x7fc8f0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0107880 con 0x7fc8f00f6530 2022-02-02T22:08:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.699+0000 7fc8f670b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0108090 con 0x7fc8f00f77d0 2022-02-02T22:08:42.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46808/0 (socket says 172.21.15.96:46808) 2022-02-02T22:08:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 -- 172.21.15.96:0/1482443661 learned_addr learned my addr 172.21.15.96:0/1482443661 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f4f08700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 0x7fc8f0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 -- 172.21.15.96:0/1482443661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 msgr2=0x7fc8f0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 0x7fc8f0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 -- 172.21.15.96:0/1482443661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec005040 con 0x7fc8f00f6530 2022-02-02T22:08:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f5709700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 secure :-1 s=READY pgs=3480 cs=0 l=1 rev1=1 rx=0x7fc8ec013a70 tx=0x7fc8ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec018070 con 0x7fc8f00f6530 2022-02-02T22:08:42.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc8ec0097d0 con 0x7fc8f00f6530 2022-02-02T22:08:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f01082b0 con 0x7fc8f00f6530 2022-02-02T22:08:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec01de80 con 0x7fc8f00f6530 2022-02-02T22:08:42.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.700+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f0108810 con 0x7fc8f00f6530 2022-02-02T22:08:42.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.701+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f0059100 con 0x7fc8f00f6530 2022-02-02T22:08:42.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.703+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc8ec007ba0 con 0x7fc8f00f6530 2022-02-02T22:08:42.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.704+0000 7fc8e5ffb700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 0x7fc8dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:42.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.704+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc8ec083c90 con 0x7fc8f00f6530 2022-02-02T22:08:42.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.704+0000 7fc8f4f08700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 0x7fc8dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:42.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.704+0000 7fc8f4f08700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 0x7fc8dc0672e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7fc8e0004ce0 tx=0x7fc8e000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:42.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.707+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8ec051e30 con 0x7fc8f00f6530 2022-02-02T22:08:42.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.939+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8f0045b00 con 0x7fc8f00f6530 2022-02-02T22:08:42.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.939+0000 7fc8e5ffb700 1 -- 172.21.15.96:0/1482443661 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc8ec055450 con 0x7fc8f00f6530 2022-02-02T22:08:42.940 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:08:42.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:08:42.941 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:08:42.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:42.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:08:42.942 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:08:42.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:42.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:08:42.943 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:08:42.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:42.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:08:42.944 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:08:42.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:08:42.945 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:08:42.945 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:08:42.945 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:08:42.946 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:08:42.946 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:08:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 msgr2=0x7fc8dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 0x7fc8dc0672e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7fc8e0004ce0 tx=0x7fc8e000b040).stop 2022-02-02T22:08:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 msgr2=0x7fc8f0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 secure :-1 s=READY pgs=3480 cs=0 l=1 rev1=1 rx=0x7fc8ec013a70 tx=0x7fc8ec009b30).stop 2022-02-02T22:08:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 shutdown_connections 2022-02-02T22:08:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc8dc064e20 0x7fc8dc0672e0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8f00f6530 0x7fc8f0106d90 unknown :-1 s=CLOSED pgs=3480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 --2- 172.21.15.96:0/1482443661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f00f77d0 0x7fc8f0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:42.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 >> 172.21.15.96:0/1482443661 conn(0x7fc8f00f1c90 msgr2=0x7fc8f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:42.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 shutdown_connections 2022-02-02T22:08:42.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:42.941+0000 7fc8f670b700 1 -- 172.21.15.96:0/1482443661 wait complete. 2022-02-02T22:08:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:42 smithi159 ceph-mon[69013]: pgmap v6797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:43.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 -- 172.21.15.96:0/2102854010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f4a60 msgr2=0x7eff980f4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:43.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/2102854010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f4a60 0x7eff980f4e80 secure :-1 s=READY pgs=3481 cs=0 l=1 rev1=1 rx=0x7eff88004660 tx=0x7eff88009b30).stop 2022-02-02T22:08:43.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 -- 172.21.15.96:0/2102854010 shutdown_connections 2022-02-02T22:08:43.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/2102854010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f5400 0x7eff980fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:08:43.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/2102854010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f4a60 0x7eff980f4e80 unknown :-1 s=CLOSED pgs=3481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:43.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 -- 172.21.15.96:0/2102854010 >> 172.21.15.96:0/2102854010 conn(0x7eff980f04c0 msgr2=0x7eff980f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:43.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 -- 172.21.15.96:0/2102854010 shutdown_connections 2022-02-02T22:08:43.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.038+0000 7eff9d9f0700 1 -- 172.21.15.96:0/2102854010 wait complete. 2022-02-02T22:08:43.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 Processor -- start 2022-02-02T22:08:43.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 -- start start 2022-02-02T22:08:43.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f4a60 0x7eff98106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:43.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:43.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff98107a80 con 0x7eff980f5400 2022-02-02T22:08:43.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff9d9f0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff98108330 con 0x7eff980f4a60 2022-02-02T22:08:43.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff967fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:43.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff967fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46820/0 (socket says 172.21.15.96:46820) 2022-02-02T22:08:43.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.039+0000 7eff967fc700 1 -- 172.21.15.96:0/904279154 learned_addr learned my addr 172.21.15.96:0/904279154 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:08:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff96ffd700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f4a60 0x7eff98106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff967fc700 1 -- 172.21.15.96:0/904279154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f4a60 msgr2=0x7eff98106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:43.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff967fc700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f4a60 0x7eff98106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff967fc700 1 -- 172.21.15.96:0/904279154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88005040 con 0x7eff980f5400 2022-02-02T22:08:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff967fc700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 secure :-1 s=READY pgs=3482 cs=0 l=1 rev1=1 rx=0x7eff8c0093f0 tx=0x7eff8c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:43.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff8c013640 con 0x7eff980f5400 2022-02-02T22:08:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff8c013c50 con 0x7eff980f5400 2022-02-02T22:08:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98108610 con 0x7eff980f5400 2022-02-02T22:08:43.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff8c012c70 con 0x7eff980f5400 2022-02-02T22:08:43.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.040+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff98108bd0 con 0x7eff980f5400 2022-02-02T22:08:43.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.041+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff980f4150 con 0x7eff980f5400 2022-02-02T22:08:43.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.042+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff8c01a060 con 0x7eff980f5400 2022-02-02T22:08:43.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.042+0000 7eff7f7fe700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 0x7eff80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:08:43.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.043+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7eff8c081d60 con 0x7eff980f5400 2022-02-02T22:08:43.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.043+0000 7eff96ffd700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 0x7eff80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:08:43.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.043+0000 7eff96ffd700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 0x7eff80067290 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7eff88004630 tx=0x7eff88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:08:43.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.046+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff8c0539c0 con 0x7eff980f5400 2022-02-02T22:08:43.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.250+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff98045ad0 con 0x7eff980f5400 2022-02-02T22:08:43.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.250+0000 7eff7f7fe700 1 -- 172.21.15.96:0/904279154 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7eff8c018020 con 0x7eff980f5400 2022-02-02T22:08:43.251 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:08:43.252 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:08:43.252 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:08:43.252 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:08:43.253 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:43.253 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:08:43.253 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:08:43.254 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:08:43.254 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:08:43.254 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:08:43.255 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:08:43.256 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:08:43.256 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:08:43.257 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:08:43.257 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:08:43.257 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:08:43.258 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:08:43.258 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:08:43.258 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:08:43.259 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:08:43.259 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:08:43.259 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:08:43.260 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:08:43.260 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:08:43.261 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:08:43.261 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:08:43.261 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:08:43.262 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:08:43.262 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:08:43.263 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:08:43.263 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:08:43.263 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:08:43.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:43.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:43.265 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:08:43.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:08:43.265 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:43.266 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:43.266 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:08:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 msgr2=0x7eff80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 0x7eff80067290 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7eff88004630 tx=0x7eff88009b30).stop 2022-02-02T22:08:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 msgr2=0x7eff98107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:08:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 secure :-1 s=READY pgs=3482 cs=0 l=1 rev1=1 rx=0x7eff8c0093f0 tx=0x7eff8c006ec0).stop 2022-02-02T22:08:43.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 shutdown_connections 2022-02-02T22:08:43.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff80064dd0 0x7eff80067290 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:43.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff980f4a60 0x7eff98106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 --2- 172.21.15.96:0/904279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff980f5400 0x7eff98107440 unknown :-1 s=CLOSED pgs=3482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:08:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 >> 172.21.15.96:0/904279154 conn(0x7eff980f04c0 msgr2=0x7eff980f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:08:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.252+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 shutdown_connections 2022-02-02T22:08:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:08:43.253+0000 7eff9d9f0700 1 -- 172.21.15.96:0/904279154 wait complete. 2022-02-02T22:08:43.272 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:08:43.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:43 smithi159 ceph-mon[69013]: from='client.41068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:43.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:43 smithi159 ceph-mon[69013]: from='client.41072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:43.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1482443661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:08:43.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/904279154' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:08:44.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:43 smithi096 ceph-mon[101353]: from='client.41068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:44.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:43 smithi096 ceph-mon[101353]: from='client.41072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:08:44.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1482443661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:08:44.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/904279154' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:08:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:44 smithi159 ceph-mon[69013]: pgmap v6798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:44 smithi096 ceph-mon[101353]: pgmap v6798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:46 smithi159 ceph-mon[69013]: pgmap v6799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:46 smithi096 ceph-mon[101353]: pgmap v6799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:48 smithi159 ceph-mon[69013]: pgmap v6800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:48 smithi096 ceph-mon[101353]: pgmap v6800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:50 smithi159 ceph-mon[69013]: pgmap v6801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:50 smithi096 ceph-mon[101353]: pgmap v6801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:52 smithi159 ceph-mon[69013]: pgmap v6802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:52 smithi096 ceph-mon[101353]: pgmap v6802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:54 smithi159 ceph-mon[69013]: pgmap v6803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:54 smithi096 ceph-mon[101353]: pgmap v6803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:56 smithi159 ceph-mon[69013]: pgmap v6804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:56 smithi096 ceph-mon[101353]: pgmap v6804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:08:58 smithi159 ceph-mon[69013]: pgmap v6805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:08:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:08:58 smithi096 ceph-mon[101353]: pgmap v6805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:00 smithi159 ceph-mon[69013]: pgmap v6806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:00 smithi096 ceph-mon[101353]: pgmap v6806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:02 smithi159 ceph-mon[69013]: pgmap v6807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:02 smithi096 ceph-mon[101353]: pgmap v6807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:04 smithi159 ceph-mon[69013]: pgmap v6808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:04 smithi096 ceph-mon[101353]: pgmap v6808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:06 smithi159 ceph-mon[69013]: pgmap v6809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:06 smithi096 ceph-mon[101353]: pgmap v6809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:08 smithi159 ceph-mon[69013]: pgmap v6810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:08 smithi096 ceph-mon[101353]: pgmap v6810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:10 smithi159 ceph-mon[69013]: pgmap v6811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:10 smithi096 ceph-mon[101353]: pgmap v6811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:12 smithi159 ceph-mon[69013]: pgmap v6812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:12 smithi096 ceph-mon[101353]: pgmap v6812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 -- 172.21.15.96:0/2605170733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 msgr2=0x7f24080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 --2- 172.21.15.96:0/2605170733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f24080f6cc0 secure :-1 s=READY pgs=3483 cs=0 l=1 rev1=1 rx=0x7f2404004660 tx=0x7f2404009b30).stop 2022-02-02T22:09:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 -- 172.21.15.96:0/2605170733 shutdown_connections 2022-02-02T22:09:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 --2- 172.21.15.96:0/2605170733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f24080f6cc0 unknown :-1 s=CLOSED pgs=3483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 --2- 172.21.15.96:0/2605170733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 0x7f24080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 -- 172.21.15.96:0/2605170733 >> 172.21.15.96:0/2605170733 conn(0x7f24080f0d40 msgr2=0x7f24080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 -- 172.21.15.96:0/2605170733 shutdown_connections 2022-02-02T22:09:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.361+0000 7f241007e700 1 -- 172.21.15.96:0/2605170733 wait complete. 2022-02-02T22:09:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 Processor -- start 2022-02-02T22:09:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 -- start start 2022-02-02T22:09:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 0x7f2408106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408107a10 con 0x7f24080f6860 2022-02-02T22:09:13.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f241007e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408107b50 con 0x7f24080f55c0 2022-02-02T22:09:13.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46840/0 (socket says 172.21.15.96:46840) 2022-02-02T22:09:13.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 -- 172.21.15.96:0/3752633303 learned_addr learned my addr 172.21.15.96:0/3752633303 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:13.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240de1a700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 0x7f2408106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 -- 172.21.15.96:0/3752633303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 msgr2=0x7f2408106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 0x7f2408106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 -- 172.21.15.96:0/3752633303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404005040 con 0x7f24080f6860 2022-02-02T22:09:13.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.362+0000 7f240d619700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 secure :-1 s=READY pgs=3484 cs=0 l=1 rev1=1 rx=0x7f2404009990 tx=0x7f2404009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.363+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2404018070 con 0x7f24080f6860 2022-02-02T22:09:13.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.363+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2404007ba0 con 0x7f24080f6860 2022-02-02T22:09:13.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.363+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2408108490 con 0x7f24080f6860 2022-02-02T22:09:13.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.363+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240401c3c0 con 0x7f24080f6860 2022-02-02T22:09:13.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.363+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24081089f0 con 0x7f24080f6860 2022-02-02T22:09:13.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.364+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2408045ad0 con 0x7f24080f6860 2022-02-02T22:09:13.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.364+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f240401d420 con 0x7f24080f6860 2022-02-02T22:09:13.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.365+0000 7f23fe7fc700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 0x7f23f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.365+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f24040835e0 con 0x7f24080f6860 2022-02-02T22:09:13.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.365+0000 7f240de1a700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 0x7f23f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.365+0000 7f240de1a700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 0x7f23f4067290 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f24080f66c0 tx=0x7f23f800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.369+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24040550b0 con 0x7f24080f6860 2022-02-02T22:09:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.549+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f240805fd30 con 0x7f23f4064dd0 2022-02-02T22:09:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.550+0000 7f23fe7fc700 1 -- 172.21.15.96:0/3752633303 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f240805fd30 con 0x7f23f4064dd0 2022-02-02T22:09:13.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.551+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 msgr2=0x7f23f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.551+0000 7f241007e700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 0x7f23f4067290 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f24080f66c0 tx=0x7f23f800b040).stop 2022-02-02T22:09:13.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.551+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 msgr2=0x7f2408107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.551+0000 7f241007e700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 secure :-1 s=READY pgs=3484 cs=0 l=1 rev1=1 rx=0x7f2404009990 tx=0x7f2404009b30).stop 2022-02-02T22:09:13.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.551+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 shutdown_connections 2022-02-02T22:09:13.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f23f4064dd0 0x7f23f4067290 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24080f55c0 0x7f2408106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 --2- 172.21.15.96:0/3752633303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080f6860 0x7f2408107460 unknown :-1 s=CLOSED pgs=3484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 >> 172.21.15.96:0/3752633303 conn(0x7f24080f0d40 msgr2=0x7f240805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:13.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 shutdown_connections 2022-02-02T22:09:13.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.552+0000 7f241007e700 1 -- 172.21.15.96:0/3752633303 wait complete. 2022-02-02T22:09:13.562 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:09:13.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.649+0000 7f39d05ea700 1 -- 172.21.15.96:0/1221811698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 msgr2=0x7f39c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.649+0000 7f39d05ea700 1 --2- 172.21.15.96:0/1221811698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c80f59e0 secure :-1 s=READY pgs=3485 cs=0 l=1 rev1=1 rx=0x7f39c4004660 tx=0x7f39c4009b30).stop 2022-02-02T22:09:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- 172.21.15.96:0/1221811698 shutdown_connections 2022-02-02T22:09:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 --2- 172.21.15.96:0/1221811698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 --2- 172.21.15.96:0/1221811698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c80f59e0 unknown :-1 s=CLOSED pgs=3485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- 172.21.15.96:0/1221811698 >> 172.21.15.96:0/1221811698 conn(0x7f39c80f0d40 msgr2=0x7f39c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:13.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- 172.21.15.96:0/1221811698 shutdown_connections 2022-02-02T22:09:13.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- 172.21.15.96:0/1221811698 wait complete. 2022-02-02T22:09:13.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 Processor -- start 2022-02-02T22:09:13.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- start start 2022-02-02T22:09:13.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80603e0 con 0x7f39c80f55c0 2022-02-02T22:09:13.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39d05ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8060520 con 0x7f39c80f6860 2022-02-02T22:09:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39ce386700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39ce386700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46848/0 (socket says 172.21.15.96:46848) 2022-02-02T22:09:13.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.650+0000 7f39ce386700 1 -- 172.21.15.96:0/896127950 learned_addr learned my addr 172.21.15.96:0/896127950 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39cdb85700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39ce386700 1 -- 172.21.15.96:0/896127950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 msgr2=0x7f39c810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39ce386700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39ce386700 1 -- 172.21.15.96:0/896127950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4005040 con 0x7f39c80f55c0 2022-02-02T22:09:13.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39cdb85700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:09:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39ce386700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 secure :-1 s=READY pgs=3486 cs=0 l=1 rev1=1 rx=0x7f39c4013a70 tx=0x7f39c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4018070 con 0x7f39c80f55c0 2022-02-02T22:09:13.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39c40097d0 con 0x7f39c80f55c0 2022-02-02T22:09:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c401c3c0 con 0x7f39c80f55c0 2022-02-02T22:09:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c810c6c0 con 0x7f39c80f55c0 2022-02-02T22:09:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.651+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c810cc20 con 0x7f39c80f55c0 2022-02-02T22:09:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.652+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c8045ad0 con 0x7f39c80f55c0 2022-02-02T22:09:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.653+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f39c4007ba0 con 0x7f39c80f55c0 2022-02-02T22:09:13.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.653+0000 7f39beffd700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 0x7f39b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.653+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f39c4083730 con 0x7f39c80f55c0 2022-02-02T22:09:13.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.653+0000 7f39cdb85700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 0x7f39b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.653+0000 7f39cdb85700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 0x7f39b4067290 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f39b8009fd0 tx=0x7f39b800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.657+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f39c40518f0 con 0x7f39c80f55c0 2022-02-02T22:09:13.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.828+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39c80fdf00 con 0x7f39b4064dd0 2022-02-02T22:09:13.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.837+0000 7f39beffd700 1 -- 172.21.15.96:0/896127950 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f39c80fdf00 con 0x7f39b4064dd0 2022-02-02T22:09:13.838 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:09:13.839 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:09:13.839 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:09:13.839 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:09:13.840 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:09:13.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:09:13.840 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:09:13.841 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:09:13.841 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:09:13.842 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:09:13.842 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:09:13.842 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:09:13.843 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:09:13.843 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:09:13.843 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:09:13.844 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:09:13.844 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:09:13.844 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:09:13.845 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:09:13.845 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:09:13.845 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:09:13.846 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:09:13.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 msgr2=0x7f39b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 0x7f39b4067290 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f39b8009fd0 tx=0x7f39b800b040).stop 2022-02-02T22:09:13.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 msgr2=0x7f39c8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 secure :-1 s=READY pgs=3486 cs=0 l=1 rev1=1 rx=0x7f39c4013a70 tx=0x7f39c4009b30).stop 2022-02-02T22:09:13.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 shutdown_connections 2022-02-02T22:09:13.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f39b4064dd0 0x7f39b4067290 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39c80f55c0 0x7f39c8109c70 unknown :-1 s=CLOSED pgs=3486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 --2- 172.21.15.96:0/896127950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39c80f6860 0x7f39c810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 >> 172.21.15.96:0/896127950 conn(0x7f39c80f0d40 msgr2=0x7f39c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:13.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 shutdown_connections 2022-02-02T22:09:13.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.839+0000 7f39d05ea700 1 -- 172.21.15.96:0/896127950 wait complete. 2022-02-02T22:09:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.935+0000 7ffa9300c700 1 -- 172.21.15.96:0/2679687329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f77d0 msgr2=0x7ffa8c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.935+0000 7ffa9300c700 1 --2- 172.21.15.96:0/2679687329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c0f7c30 secure :-1 s=READY pgs=3487 cs=0 l=1 rev1=1 rx=0x7ffa7c004660 tx=0x7ffa7c009b30).stop 2022-02-02T22:09:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- 172.21.15.96:0/2679687329 shutdown_connections 2022-02-02T22:09:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 --2- 172.21.15.96:0/2679687329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c0f7c30 unknown :-1 s=CLOSED pgs=3487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 --2- 172.21.15.96:0/2679687329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- 172.21.15.96:0/2679687329 >> 172.21.15.96:0/2679687329 conn(0x7ffa8c0f1c90 msgr2=0x7ffa8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- 172.21.15.96:0/2679687329 shutdown_connections 2022-02-02T22:09:13.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- 172.21.15.96:0/2679687329 wait complete. 2022-02-02T22:09:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 Processor -- start 2022-02-02T22:09:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- start start 2022-02-02T22:09:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c107880 con 0x7ffa8c0f6530 2022-02-02T22:09:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9300c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c108090 con 0x7ffa8c0f77d0 2022-02-02T22:09:13.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9200a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9200a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46858/0 (socket says 172.21.15.96:46858) 2022-02-02T22:09:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.936+0000 7ffa9200a700 1 -- 172.21.15.96:0/690965222 learned_addr learned my addr 172.21.15.96:0/690965222 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa91809700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9200a700 1 -- 172.21.15.96:0/690965222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 msgr2=0x7ffa8c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9200a700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9200a700 1 -- 172.21.15.96:0/690965222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c005040 con 0x7ffa8c0f6530 2022-02-02T22:09:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa91809700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:09:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9200a700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 secure :-1 s=READY pgs=3488 cs=0 l=1 rev1=1 rx=0x7ffa8800c530 tx=0x7ffa88007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8800f650 con 0x7ffa8c0f6530 2022-02-02T22:09:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c108310 con 0x7ffa8c0f6530 2022-02-02T22:09:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa8800fc60 con 0x7ffa8c0f6530 2022-02-02T22:09:13.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa88012d20 con 0x7ffa8c0f6530 2022-02-02T22:09:13.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.937+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c1088d0 con 0x7ffa8c0f6530 2022-02-02T22:09:13.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.938+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c059100 con 0x7ffa8c0f6530 2022-02-02T22:09:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.939+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa88019030 con 0x7ffa8c0f6530 2022-02-02T22:09:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.939+0000 7ffa82ffd700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 0x7ffa780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.939+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa88081a00 con 0x7ffa8c0f6530 2022-02-02T22:09:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.939+0000 7ffa91809700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 0x7ffa780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.939+0000 7ffa91809700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 0x7ffa780672e0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7ffa7c009da0 tx=0x7ffa7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:13.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:13.943+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa8804faa0 con 0x7ffa8c0f6530 2022-02-02T22:09:14.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.176+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa8c0008d0 con 0x7ffa8c0f6530 2022-02-02T22:09:14.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.176+0000 7ffa82ffd700 1 -- 172.21.15.96:0/690965222 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ffa880530c0 con 0x7ffa8c0f6530 2022-02-02T22:09:14.178 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:09:14.178 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:09:14.178 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:09:14.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:14.179 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:09:14.180 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:09:14.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:14.180 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:09:14.181 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:09:14.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:14.181 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:09:14.182 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:09:14.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:14.182 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:09:14.183 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:09:14.183 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:09:14.183 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:09:14.184 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:09:14.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 msgr2=0x7ffa780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 0x7ffa780672e0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7ffa7c009da0 tx=0x7ffa7c009b30).stop 2022-02-02T22:09:14.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 msgr2=0x7ffa8c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 secure :-1 s=READY pgs=3488 cs=0 l=1 rev1=1 rx=0x7ffa8800c530 tx=0x7ffa88007e10).stop 2022-02-02T22:09:14.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 shutdown_connections 2022-02-02T22:09:14.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffa78064e20 0x7ffa780672e0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c106d90 unknown :-1 s=CLOSED pgs=3488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.178+0000 7ffa9300c700 1 --2- 172.21.15.96:0/690965222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.179+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 >> 172.21.15.96:0/690965222 conn(0x7ffa8c0f1c90 msgr2=0x7ffa8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:14.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.179+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 shutdown_connections 2022-02-02T22:09:14.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.179+0000 7ffa9300c700 1 -- 172.21.15.96:0/690965222 wait complete. 2022-02-02T22:09:14.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 -- 172.21.15.96:0/1599210986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 msgr2=0x7f8c0c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 --2- 172.21.15.96:0/1599210986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c0f5860 secure :-1 s=READY pgs=3489 cs=0 l=1 rev1=1 rx=0x7f8c08004660 tx=0x7f8c08009b30).stop 2022-02-02T22:09:14.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 -- 172.21.15.96:0/1599210986 shutdown_connections 2022-02-02T22:09:14.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 --2- 172.21.15.96:0/1599210986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 0x7f8c0c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 --2- 172.21.15.96:0/1599210986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c0f5860 unknown :-1 s=CLOSED pgs=3489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 -- 172.21.15.96:0/1599210986 >> 172.21.15.96:0/1599210986 conn(0x7f8c0c0f0ba0 msgr2=0x7f8c0c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:14.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.275+0000 7f8c12335700 1 -- 172.21.15.96:0/1599210986 shutdown_connections 2022-02-02T22:09:14.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 -- 172.21.15.96:0/1599210986 wait complete. 2022-02-02T22:09:14.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 Processor -- start 2022-02-02T22:09:14.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 -- start start 2022-02-02T22:09:14.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:14.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 0x7f8c0c10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:14.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0603e0 con 0x7f8c0c0f5440 2022-02-02T22:09:14.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c12335700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c060520 con 0x7f8c0c0f66e0 2022-02-02T22:09:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c11333700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c11333700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46868/0 (socket says 172.21.15.96:46868) 2022-02-02T22:09:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.276+0000 7f8c11333700 1 -- 172.21.15.96:0/96914904 learned_addr learned my addr 172.21.15.96:0/96914904 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c10b32700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 0x7f8c0c10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c11333700 1 -- 172.21.15.96:0/96914904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 msgr2=0x7f8c0c10bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c11333700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 0x7f8c0c10bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c11333700 1 -- 172.21.15.96:0/96914904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08005040 con 0x7f8c0c0f5440 2022-02-02T22:09:14.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c11333700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 secure :-1 s=READY pgs=3490 cs=0 l=1 rev1=1 rx=0x7f8c08004f60 tx=0x7f8c08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:14.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c08018070 con 0x7f8c0c0f5440 2022-02-02T22:09:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c08007ba0 con 0x7f8c0c0f5440 2022-02-02T22:09:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c10c4f0 con 0x7f8c0c0f5440 2022-02-02T22:09:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0801c620 con 0x7f8c0c0f5440 2022-02-02T22:09:14.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.277+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c10ca50 con 0x7f8c0c0f5440 2022-02-02T22:09:14.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.278+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c045ad0 con 0x7f8c0c0f5440 2022-02-02T22:09:14.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.279+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c0801c8e0 con 0x7f8c0c0f5440 2022-02-02T22:09:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.279+0000 7f8c01ffb700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 0x7f8bf80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:14.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.279+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c08083940 con 0x7f8c0c0f5440 2022-02-02T22:09:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.279+0000 7f8c10b32700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 0x7f8bf80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.280+0000 7f8c10b32700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 0x7f8bf80672e0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f8bfc0041d0 tx=0x7f8bfc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.283+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c08051a40 con 0x7f8c0c0f5440 2022-02-02T22:09:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.486+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8c0c0fdc00 con 0x7f8c0c0f5440 2022-02-02T22:09:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.486+0000 7f8c01ffb700 1 -- 172.21.15.96:0/96914904 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8c08055060 con 0x7f8c0c0f5440 2022-02-02T22:09:14.488 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:09:14.488 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:09:14.489 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:09:14.489 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:09:14.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:14.490 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:09:14.490 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:09:14.491 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:09:14.491 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:09:14.491 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:09:14.492 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:09:14.492 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:09:14.492 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:09:14.493 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:09:14.493 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:09:14.493 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:09:14.494 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:09:14.494 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:09:14.494 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:09:14.495 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:09:14.495 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:09:14.495 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:09:14.496 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:09:14.496 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:09:14.496 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:09:14.497 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:09:14.497 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:09:14.497 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:09:14.498 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:09:14.498 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:09:14.498 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:09:14.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:09:14.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:14.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:14.500 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:09:14.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:14.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:14.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:14.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:14.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 msgr2=0x7f8bf80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 0x7f8bf80672e0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f8bfc0041d0 tx=0x7f8bfc009040).stop 2022-02-02T22:09:14.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 msgr2=0x7f8c0c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:14.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 secure :-1 s=READY pgs=3490 cs=0 l=1 rev1=1 rx=0x7f8c08004f60 tx=0x7f8c08009b30).stop 2022-02-02T22:09:14.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 shutdown_connections 2022-02-02T22:09:14.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8bf8064e20 0x7f8bf80672e0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c0c0f5440 0x7f8c0c109aa0 unknown :-1 s=CLOSED pgs=3490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 --2- 172.21.15.96:0/96914904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0f66e0 0x7f8c0c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:14.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.488+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 >> 172.21.15.96:0/96914904 conn(0x7f8c0c0f0ba0 msgr2=0x7f8c0c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:14.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.489+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 shutdown_connections 2022-02-02T22:09:14.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:14.489+0000 7f8c12335700 1 -- 172.21.15.96:0/96914904 wait complete. 2022-02-02T22:09:14.506 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:09:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:14 smithi096 ceph-mon[101353]: pgmap v6813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:14 smithi096 ceph-mon[101353]: from='client.41084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/690965222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:09:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/96914904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:09:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:14 smithi159 ceph-mon[69013]: pgmap v6813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:14 smithi159 ceph-mon[69013]: from='client.41084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/690965222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:09:15.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/96914904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:09:16.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:15 smithi159 ceph-mon[69013]: from='client.41088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:16.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:15 smithi096 ceph-mon[101353]: from='client.41088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:16 smithi159 ceph-mon[69013]: pgmap v6814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:16 smithi096 ceph-mon[101353]: pgmap v6814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:18 smithi159 ceph-mon[69013]: pgmap v6815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:18 smithi096 ceph-mon[101353]: pgmap v6815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:20 smithi159 ceph-mon[69013]: pgmap v6816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:20 smithi096 ceph-mon[101353]: pgmap v6816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:22 smithi159 ceph-mon[69013]: pgmap v6817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:22 smithi096 ceph-mon[101353]: pgmap v6817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:24 smithi159 ceph-mon[69013]: pgmap v6818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:24 smithi096 ceph-mon[101353]: pgmap v6818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:26 smithi159 ceph-mon[69013]: pgmap v6819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:26 smithi096 ceph-mon[101353]: pgmap v6819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:28 smithi159 ceph-mon[69013]: pgmap v6820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:09:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:09:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:28 smithi096 ceph-mon[101353]: pgmap v6820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:09:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:09:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:30 smithi159 ceph-mon[69013]: pgmap v6821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:30 smithi096 ceph-mon[101353]: pgmap v6821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:32 smithi159 ceph-mon[69013]: pgmap v6822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:32 smithi096 ceph-mon[101353]: pgmap v6822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:34 smithi159 ceph-mon[69013]: pgmap v6823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:34 smithi096 ceph-mon[101353]: pgmap v6823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:36 smithi159 ceph-mon[69013]: pgmap v6824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:36 smithi096 ceph-mon[101353]: pgmap v6824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:38 smithi159 ceph-mon[69013]: pgmap v6825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:38 smithi096 ceph-mon[101353]: pgmap v6825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:40 smithi159 ceph-mon[69013]: pgmap v6826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:40 smithi096 ceph-mon[101353]: pgmap v6826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:42 smithi159 ceph-mon[69013]: pgmap v6827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:42 smithi096 ceph-mon[101353]: pgmap v6827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:44.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.599+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/233802060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 msgr2=0x7f6b740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.599+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/233802060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b740f6b00 secure :-1 s=READY pgs=3491 cs=0 l=1 rev1=1 rx=0x7f6b70004660 tx=0x7f6b70009b30).stop 2022-02-02T22:09:44.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/233802060 shutdown_connections 2022-02-02T22:09:44.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/233802060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/233802060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b740f6b00 unknown :-1 s=CLOSED pgs=3491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/233802060 >> 172.21.15.96:0/233802060 conn(0x7f6b740f1e40 msgr2=0x7f6b740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:44.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/233802060 shutdown_connections 2022-02-02T22:09:44.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/233802060 wait complete. 2022-02-02T22:09:44.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 Processor -- start 2022-02-02T22:09:44.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- start start 2022-02-02T22:09:44.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b741074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74107a50 con 0x7f6b740f66e0 2022-02-02T22:09:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.600+0000 7f6b7b6e6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74107b90 con 0x7f6b740f7980 2022-02-02T22:09:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46888/0 (socket says 172.21.15.96:46888) 2022-02-02T22:09:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 -- 172.21.15.96:0/2834913081 learned_addr learned my addr 172.21.15.96:0/2834913081 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b78c81700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b741074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 -- 172.21.15.96:0/2834913081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 msgr2=0x7f6b741074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b741074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 -- 172.21.15.96:0/2834913081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70005040 con 0x7f6b740f66e0 2022-02-02T22:09:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b78c81700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b741074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:09:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b79482700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 secure :-1 s=READY pgs=3492 cs=0 l=1 rev1=1 rx=0x7f6b70013a70 tx=0x7f6b70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b70018070 con 0x7f6b740f66e0 2022-02-02T22:09:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b741084d0 con 0x7f6b740f66e0 2022-02-02T22:09:44.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b700097d0 con 0x7f6b740f66e0 2022-02-02T22:09:44.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.601+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7001c3c0 con 0x7f6b740f66e0 2022-02-02T22:09:44.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.602+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b74108a30 con 0x7f6b740f66e0 2022-02-02T22:09:44.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.603+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b74045ad0 con 0x7f6b740f66e0 2022-02-02T22:09:44.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.603+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b70007ba0 con 0x7f6b740f66e0 2022-02-02T22:09:44.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.604+0000 7f6b69ffb700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 0x7f6b60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.604+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6b70083730 con 0x7f6b740f66e0 2022-02-02T22:09:44.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.604+0000 7f6b78c81700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 0x7f6b60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.604+0000 7f6b78c81700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 0x7f6b60067290 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f6b64009740 tx=0x7f6b64009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.608+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b70055320 con 0x7f6b740f66e0 2022-02-02T22:09:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.786+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b740ff020 con 0x7f6b60064dd0 2022-02-02T22:09:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.787+0000 7f6b69ffb700 1 -- 172.21.15.96:0/2834913081 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6b740ff020 con 0x7f6b60064dd0 2022-02-02T22:09:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 msgr2=0x7f6b60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 0x7f6b60067290 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f6b64009740 tx=0x7f6b64009be0).stop 2022-02-02T22:09:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 msgr2=0x7f6b74106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 secure :-1 s=READY pgs=3492 cs=0 l=1 rev1=1 rx=0x7f6b70013a70 tx=0x7f6b70009b30).stop 2022-02-02T22:09:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 shutdown_connections 2022-02-02T22:09:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6b60064dd0 0x7f6b60067290 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b740f66e0 0x7f6b74106fb0 unknown :-1 s=CLOSED pgs=3492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 --2- 172.21.15.96:0/2834913081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b740f7980 0x7f6b741074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 >> 172.21.15.96:0/2834913081 conn(0x7f6b740f1e40 msgr2=0x7f6b740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 shutdown_connections 2022-02-02T22:09:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.789+0000 7f6b7b6e6700 1 -- 172.21.15.96:0/2834913081 wait complete. 2022-02-02T22:09:44.799 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:09:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2868573157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 msgr2=0x7ff6e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2868573157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f6cc0 secure :-1 s=READY pgs=3493 cs=0 l=1 rev1=1 rx=0x7ff6e0004660 tx=0x7ff6e0009b30).stop 2022-02-02T22:09:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2868573157 shutdown_connections 2022-02-02T22:09:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2868573157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f6cc0 unknown :-1 s=CLOSED pgs=3493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2868573157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 0x7ff6e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2868573157 >> 172.21.15.96:0/2868573157 conn(0x7ff6e40f0d40 msgr2=0x7ff6e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:44.890 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:44 smithi096 ceph-mon[101353]: pgmap v6828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.887+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2868573157 shutdown_connections 2022-02-02T22:09:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2868573157 wait complete. 2022-02-02T22:09:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 Processor -- start 2022-02-02T22:09:44.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 -- start start 2022-02-02T22:09:44.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 0x7ff6e40f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40f8920 con 0x7ff6e40f6860 2022-02-02T22:09:44.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.888+0000 7ff6eb6d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40f8a60 con 0x7ff6e40f55c0 2022-02-02T22:09:44.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46900/0 (socket says 172.21.15.96:46900) 2022-02-02T22:09:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 -- 172.21.15.96:0/2723423027 learned_addr learned my addr 172.21.15.96:0/2723423027 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e9473700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 0x7ff6e40f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 -- 172.21.15.96:0/2723423027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 msgr2=0x7ff6e40f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 0x7ff6e40f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 -- 172.21.15.96:0/2723423027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0005040 con 0x7ff6e40f6860 2022-02-02T22:09:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6e8c72700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 secure :-1 s=READY pgs=3494 cs=0 l=1 rev1=1 rx=0x7ff6e0009990 tx=0x7ff6e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e0018070 con 0x7ff6e40f6860 2022-02-02T22:09:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6e0007ba0 con 0x7ff6e40f6860 2022-02-02T22:09:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e001c620 con 0x7ff6e40f6860 2022-02-02T22:09:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.889+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e40f8ce0 con 0x7ff6e40f6860 2022-02-02T22:09:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.890+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e40f91f0 con 0x7ff6e40f6860 2022-02-02T22:09:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.891+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff6e001c8e0 con 0x7ff6e40f6860 2022-02-02T22:09:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.891+0000 7ff6d9ffb700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 0x7ff6d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.891+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff6e0083850 con 0x7ff6e40f6860 2022-02-02T22:09:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.891+0000 7ff6e9473700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 0x7ff6d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:44.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.892+0000 7ff6e9473700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 0x7ff6d0067290 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7ff6e40f9cd0 tx=0x7ff6d4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:44.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.892+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e4045ad0 con 0x7ff6e40f6860 2022-02-02T22:09:44.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:44.896+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff6e0051950 con 0x7ff6e40f6860 2022-02-02T22:09:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:44 smithi159 ceph-mon[69013]: pgmap v6828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:45.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.066+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e405fd30 con 0x7ff6d0064dd0 2022-02-02T22:09:45.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.076+0000 7ff6d9ffb700 1 -- 172.21.15.96:0/2723423027 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff6e405fd30 con 0x7ff6d0064dd0 2022-02-02T22:09:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:09:45.076 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:09:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:09:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:09:45.077 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:09:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:09:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:09:45.078 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:09:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:09:45.079 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:09:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:09:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:09:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:09:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:09:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:09:45.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:09:45.082 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:09:45.082 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:09:45.082 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:09:45.083 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:09:45.083 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:09:45.083 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:09:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 msgr2=0x7ff6d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 0x7ff6d0067290 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7ff6e40f9cd0 tx=0x7ff6d4009040).stop 2022-02-02T22:09:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 msgr2=0x7ff6e40f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 secure :-1 s=READY pgs=3494 cs=0 l=1 rev1=1 rx=0x7ff6e0009990 tx=0x7ff6e0009b30).stop 2022-02-02T22:09:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 shutdown_connections 2022-02-02T22:09:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff6d0064dd0 0x7ff6d0067290 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e40f55c0 0x7ff6e40f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 --2- 172.21.15.96:0/2723423027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6e40f6860 0x7ff6e40f83c0 unknown :-1 s=CLOSED pgs=3494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 >> 172.21.15.96:0/2723423027 conn(0x7ff6e40f0d40 msgr2=0x7ff6e405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 shutdown_connections 2022-02-02T22:09:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.078+0000 7ff6eb6d7700 1 -- 172.21.15.96:0/2723423027 wait complete. 2022-02-02T22:09:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1268182140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 msgr2=0x7f2cdc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1268182140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc0f59e0 secure :-1 s=READY pgs=3495 cs=0 l=1 rev1=1 rx=0x7f2cd0004660 tx=0x7f2cd0009b30).stop 2022-02-02T22:09:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1268182140 shutdown_connections 2022-02-02T22:09:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1268182140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1268182140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc0f59e0 unknown :-1 s=CLOSED pgs=3495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1268182140 >> 172.21.15.96:0/1268182140 conn(0x7f2cdc0f0d40 msgr2=0x7f2cdc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:45.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1268182140 shutdown_connections 2022-02-02T22:09:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1268182140 wait complete. 2022-02-02T22:09:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.174+0000 7f2ce21b6700 1 Processor -- start 2022-02-02T22:09:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2ce21b6700 1 -- start start 2022-02-02T22:09:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2ce21b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2ce21b6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2ce21b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc106910 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2ce21b6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc106a50 con 0x7f2cdc0f6860 2022-02-02T22:09:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2cdb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2cdb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46908/0 (socket says 172.21.15.96:46908) 2022-02-02T22:09:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2cdb7fe700 1 -- 172.21.15.96:0/1727675298 learned_addr learned my addr 172.21.15.96:0/1727675298 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.175+0000 7f2cdaffd700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cdb7fe700 1 -- 172.21.15.96:0/1727675298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 msgr2=0x7f2cdc106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cdb7fe700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cdb7fe700 1 -- 172.21.15.96:0/1727675298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0005040 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cdaffd700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:09:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cdb7fe700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 secure :-1 s=READY pgs=3496 cs=0 l=1 rev1=1 rx=0x7f2cd0013a70 tx=0x7f2cd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd0018070 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc107390 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc1078f0 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2cd00097d0 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.176+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd001c3c0 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.177+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc004fa0 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.177+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2cd001c630 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.178+0000 7f2cc3fff700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 0x7f2cc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.178+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2cd0083540 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.178+0000 7f2cdaffd700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 0x7f2cc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.178+0000 7f2cdaffd700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 0x7f2cc4067290 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f2ccc009740 tx=0x7f2ccc009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.182+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2cd0055150 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.411+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2cbc005e80 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.412+0000 7f2cc3fff700 1 -- 172.21.15.96:0/1727675298 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2cd0054d40 con 0x7f2cdc0f55c0 2022-02-02T22:09:45.413 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:09:45.414 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:09:45.414 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:09:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:09:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:09:45.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:45.416 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:09:45.417 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:09:45.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:45.417 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:09:45.418 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:09:45.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:09:45.418 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:09:45.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:09:45.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:09:45.419 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:09:45.420 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:09:45.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 msgr2=0x7f2cc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 0x7f2cc4067290 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f2ccc009740 tx=0x7f2ccc009be0).stop 2022-02-02T22:09:45.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 msgr2=0x7f2cdc105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 secure :-1 s=READY pgs=3496 cs=0 l=1 rev1=1 rx=0x7f2cd0013a70 tx=0x7f2cd0009b30).stop 2022-02-02T22:09:45.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 shutdown_connections 2022-02-02T22:09:45.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2cc4064dd0 0x7f2cc4067290 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cdc0f55c0 0x7f2cdc105e70 unknown :-1 s=CLOSED pgs=3496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 --2- 172.21.15.96:0/1727675298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cdc0f6860 0x7f2cdc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.414+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 >> 172.21.15.96:0/1727675298 conn(0x7f2cdc0f0d40 msgr2=0x7f2cdc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:45.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.415+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 shutdown_connections 2022-02-02T22:09:45.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.415+0000 7f2ce21b6700 1 -- 172.21.15.96:0/1727675298 wait complete. 2022-02-02T22:09:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- 172.21.15.96:0/2789240312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f7980 msgr2=0x7f553c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 --2- 172.21.15.96:0/2789240312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f7980 0x7f553c0f7de0 secure :-1 s=READY pgs=3497 cs=0 l=1 rev1=1 rx=0x7f552c004660 tx=0x7f552c009b30).stop 2022-02-02T22:09:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- 172.21.15.96:0/2789240312 shutdown_connections 2022-02-02T22:09:45.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 --2- 172.21.15.96:0/2789240312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f7980 0x7f553c0f7de0 unknown :-1 s=CLOSED pgs=3497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 --2- 172.21.15.96:0/2789240312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f66e0 0x7f553c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- 172.21.15.96:0/2789240312 >> 172.21.15.96:0/2789240312 conn(0x7f553c0f1e40 msgr2=0x7f553c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- 172.21.15.96:0/2789240312 shutdown_connections 2022-02-02T22:09:45.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- 172.21.15.96:0/2789240312 wait complete. 2022-02-02T22:09:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 Processor -- start 2022-02-02T22:09:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.512+0000 7f55432ac700 1 -- start start 2022-02-02T22:09:45.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f55432ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f55432ac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f7980 0x7f553c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f55432ac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c107a00 con 0x7f553c0f66e0 2022-02-02T22:09:45.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f55432ac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c107b40 con 0x7f553c0f7980 2022-02-02T22:09:45.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46918/0 (socket says 172.21.15.96:46918) 2022-02-02T22:09:45.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 -- 172.21.15.96:0/775926736 learned_addr learned my addr 172.21.15.96:0/775926736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:09:45.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5540847700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f7980 0x7f553c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 -- 172.21.15.96:0/775926736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f7980 msgr2=0x7f553c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f7980 0x7f553c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 -- 172.21.15.96:0/775926736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c005040 con 0x7f553c0f66e0 2022-02-02T22:09:45.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.513+0000 7f5541048700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 secure :-1 s=READY pgs=3498 cs=0 l=1 rev1=1 rx=0x7f553800c530 tx=0x7f5538007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:45.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.514+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553800f650 con 0x7f553c0f66e0 2022-02-02T22:09:45.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.514+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c1084e0 con 0x7f553c0f66e0 2022-02-02T22:09:45.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.514+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f553800fc60 con 0x7f553c0f66e0 2022-02-02T22:09:45.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.514+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5538012d20 con 0x7f553c0f66e0 2022-02-02T22:09:45.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.514+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c108aa0 con 0x7f553c0f66e0 2022-02-02T22:09:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.515+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5538019030 con 0x7f553c0f66e0 2022-02-02T22:09:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.515+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c045ad0 con 0x7f553c0f66e0 2022-02-02T22:09:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.515+0000 7f5531ffb700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 0x7f5528067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:09:45.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.515+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55380816c0 con 0x7f553c0f66e0 2022-02-02T22:09:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.516+0000 7f5540847700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 0x7f5528067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:09:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.516+0000 7f5540847700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 0x7f5528067290 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f552c004e30 tx=0x7f552c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:09:45.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.520+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5538053380 con 0x7f553c0f66e0 2022-02-02T22:09:45.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.724+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f553c0ff020 con 0x7f553c0f66e0 2022-02-02T22:09:45.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.724+0000 7f5531ffb700 1 -- 172.21.15.96:0/775926736 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5538017720 con 0x7f553c0f66e0 2022-02-02T22:09:45.725 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:09:45.726 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:09:45.726 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:09:45.726 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:09:45.727 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:45.727 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:09:45.727 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:09:45.728 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:09:45.728 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:09:45.728 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:09:45.729 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:09:45.729 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:09:45.729 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:09:45.730 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:09:45.730 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:09:45.731 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:09:45.731 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:09:45.731 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:09:45.732 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:09:45.732 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:09:45.732 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:09:45.733 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:09:45.733 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:09:45.734 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:09:45.734 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:09:45.734 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:09:45.735 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:09:45.735 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:09:45.735 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:09:45.736 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:09:45.736 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:09:45.736 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:09:45.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:45.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:45.737 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:09:45.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:09:45.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:45.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:45.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:09:45.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 msgr2=0x7f5528067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 0x7f5528067290 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f552c004e30 tx=0x7f552c009b30).stop 2022-02-02T22:09:45.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 msgr2=0x7f553c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:09:45.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 secure :-1 s=READY pgs=3498 cs=0 l=1 rev1=1 rx=0x7f553800c530 tx=0x7f5538007e10).stop 2022-02-02T22:09:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 shutdown_connections 2022-02-02T22:09:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5528064dd0 0x7f5528067290 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f553c0f66e0 0x7f553c106f60 unknown :-1 s=CLOSED pgs=3498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 --2- 172.21.15.96:0/775926736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f553c0f7980 0x7f553c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:09:45.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.726+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 >> 172.21.15.96:0/775926736 conn(0x7f553c0f1e40 msgr2=0x7f553c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:09:45.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.727+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 shutdown_connections 2022-02-02T22:09:45.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:09:45.727+0000 7f55432ac700 1 -- 172.21.15.96:0/775926736 wait complete. 2022-02-02T22:09:45.744 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:09:45.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1727675298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:09:46.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1727675298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:09:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:46 smithi159 ceph-mon[69013]: from='client.41100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:46 smithi159 ceph-mon[69013]: pgmap v6829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:46 smithi159 ceph-mon[69013]: from='client.41104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:47.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/775926736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:09:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:46 smithi096 ceph-mon[101353]: from='client.41100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:46 smithi096 ceph-mon[101353]: pgmap v6829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:46 smithi096 ceph-mon[101353]: from='client.41104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:09:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/775926736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:09:48.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:47 smithi159 ceph-mon[69013]: pgmap v6830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:48.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:47 smithi096 ceph-mon[101353]: pgmap v6830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:50 smithi159 ceph-mon[69013]: pgmap v6831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:50 smithi096 ceph-mon[101353]: pgmap v6831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:52 smithi159 ceph-mon[69013]: pgmap v6832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:52 smithi096 ceph-mon[101353]: pgmap v6832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:54 smithi159 ceph-mon[69013]: pgmap v6833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:54 smithi096 ceph-mon[101353]: pgmap v6833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:56 smithi159 ceph-mon[69013]: pgmap v6834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:56 smithi096 ceph-mon[101353]: pgmap v6834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:09:58 smithi159 ceph-mon[69013]: pgmap v6835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:09:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:09:58 smithi096 ceph-mon[101353]: pgmap v6835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:00 smithi159 ceph-mon[69013]: pgmap v6836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:10:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:00 smithi096 ceph-mon[101353]: pgmap v6836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:10:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:02 smithi159 ceph-mon[69013]: pgmap v6837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:02 smithi096 ceph-mon[101353]: pgmap v6837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:04 smithi159 ceph-mon[69013]: pgmap v6838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:04 smithi096 ceph-mon[101353]: pgmap v6838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:06 smithi159 ceph-mon[69013]: pgmap v6839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:06 smithi096 ceph-mon[101353]: pgmap v6839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:08 smithi159 ceph-mon[69013]: pgmap v6840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:08 smithi096 ceph-mon[101353]: pgmap v6840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:10 smithi159 ceph-mon[69013]: pgmap v6841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:10 smithi096 ceph-mon[101353]: pgmap v6841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:12.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:12 smithi159 ceph-mon[69013]: pgmap v6842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:12 smithi096 ceph-mon[101353]: pgmap v6842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:14 smithi159 ceph-mon[69013]: pgmap v6843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:14 smithi096 ceph-mon[101353]: pgmap v6843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:15.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- 172.21.15.96:0/3810131784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 msgr2=0x7f526c0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:15.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 --2- 172.21.15.96:0/3810131784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c0f6ce0 secure :-1 s=READY pgs=3499 cs=0 l=1 rev1=1 rx=0x7f525c004660 tx=0x7f525c009b30).stop 2022-02-02T22:10:15.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- 172.21.15.96:0/3810131784 shutdown_connections 2022-02-02T22:10:15.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 --2- 172.21.15.96:0/3810131784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c0f6ce0 unknown :-1 s=CLOSED pgs=3499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:15.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 --2- 172.21.15.96:0/3810131784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:15.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- 172.21.15.96:0/3810131784 >> 172.21.15.96:0/3810131784 conn(0x7f526c0f0d40 msgr2=0x7f526c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- 172.21.15.96:0/3810131784 shutdown_connections 2022-02-02T22:10:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- 172.21.15.96:0/3810131784 wait complete. 2022-02-02T22:10:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 Processor -- start 2022-02-02T22:10:15.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.837+0000 7f527160a700 1 -- start start 2022-02-02T22:10:15.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f527160a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:15.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f527160a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:15.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f527160a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c107a10 con 0x7f526c0f6880 2022-02-02T22:10:15.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f527160a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c107b50 con 0x7f526c0f55e0 2022-02-02T22:10:15.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:15.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46940/0 (socket says 172.21.15.96:46940) 2022-02-02T22:10:15.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 -- 172.21.15.96:0/2025502724 learned_addr learned my addr 172.21.15.96:0/2025502724 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:15.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526affd700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:15.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 -- 172.21.15.96:0/2025502724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 msgr2=0x7f526c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:15.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:15.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 -- 172.21.15.96:0/2025502724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c005040 con 0x7f526c0f6880 2022-02-02T22:10:15.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526affd700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:10:15.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f526a7fc700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 secure :-1 s=READY pgs=3500 cs=0 l=1 rev1=1 rx=0x7f525c009990 tx=0x7f525c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:15.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.838+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525c018070 con 0x7f526c0f6880 2022-02-02T22:10:15.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.839+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f525c007ba0 con 0x7f526c0f6880 2022-02-02T22:10:15.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.839+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c108490 con 0x7f526c0f6880 2022-02-02T22:10:15.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.839+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c1089f0 con 0x7f526c0f6880 2022-02-02T22:10:15.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.839+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525c01c3c0 con 0x7f526c0f6880 2022-02-02T22:10:15.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.840+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c004fa0 con 0x7f526c0f6880 2022-02-02T22:10:15.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.840+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f525c01d420 con 0x7f526c0f6880 2022-02-02T22:10:15.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.840+0000 7f52537fe700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 0x7f5254067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:15.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.841+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f525c083690 con 0x7f526c0f6880 2022-02-02T22:10:15.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.841+0000 7f526affd700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 0x7f5254067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:15.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.841+0000 7f526affd700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 0x7f5254067290 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f526c0f66e0 tx=0x7f5260009c40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:15.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:15.845+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f525c055160 con 0x7f526c0f6880 2022-02-02T22:10:16.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.022+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f524c000bc0 con 0x7f5254064dd0 2022-02-02T22:10:16.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.024+0000 7f52537fe700 1 -- 172.21.15.96:0/2025502724 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f524c000bc0 con 0x7f5254064dd0 2022-02-02T22:10:16.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 msgr2=0x7f5254067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 0x7f5254067290 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f526c0f66e0 tx=0x7f5260009c40).stop 2022-02-02T22:10:16.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 msgr2=0x7f526c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 secure :-1 s=READY pgs=3500 cs=0 l=1 rev1=1 rx=0x7f525c009990 tx=0x7f525c009b30).stop 2022-02-02T22:10:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 shutdown_connections 2022-02-02T22:10:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5254064dd0 0x7f5254067290 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.025+0000 7f527160a700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f526c0f55e0 0x7f526c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.026+0000 7f527160a700 1 --2- 172.21.15.96:0/2025502724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526c0f6880 0x7f526c107460 unknown :-1 s=CLOSED pgs=3500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.026+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 >> 172.21.15.96:0/2025502724 conn(0x7f526c0f0d40 msgr2=0x7f526c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.026+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 shutdown_connections 2022-02-02T22:10:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.026+0000 7f527160a700 1 -- 172.21.15.96:0/2025502724 wait complete. 2022-02-02T22:10:16.035 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:10:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 -- 172.21.15.96:0/2564541804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5970 msgr2=0x7f30f00f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 --2- 172.21.15.96:0/2564541804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5970 0x7f30f00f5df0 secure :-1 s=READY pgs=3501 cs=0 l=1 rev1=1 rx=0x7f30ec004660 tx=0x7f30ec009b30).stop 2022-02-02T22:10:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 -- 172.21.15.96:0/2564541804 shutdown_connections 2022-02-02T22:10:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 --2- 172.21.15.96:0/2564541804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f5970 0x7f30f00f5df0 unknown :-1 s=CLOSED pgs=3501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 --2- 172.21.15.96:0/2564541804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 -- 172.21.15.96:0/2564541804 >> 172.21.15.96:0/2564541804 conn(0x7f30f00f04c0 msgr2=0x7f30f00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.123+0000 7f30f80c2700 1 -- 172.21.15.96:0/2564541804 shutdown_connections 2022-02-02T22:10:16.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 -- 172.21.15.96:0/2564541804 wait complete. 2022-02-02T22:10:16.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 Processor -- start 2022-02-02T22:10:16.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 -- start start 2022-02-02T22:10:16.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5970 0x7f30f00f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00f8220 con 0x7f30f00f6c60 2022-02-02T22:10:16.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f80c2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00f8360 con 0x7f30f00f5970 2022-02-02T22:10:16.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f565d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f565d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46950/0 (socket says 172.21.15.96:46950) 2022-02-02T22:10:16.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f565d700 1 -- 172.21.15.96:0/4184366146 learned_addr learned my addr 172.21.15.96:0/4184366146 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.124+0000 7f30f5e5e700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5970 0x7f30f00f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f565d700 1 -- 172.21.15.96:0/4184366146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5970 msgr2=0x7f30f00f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f565d700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5970 0x7f30f00f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f565d700 1 -- 172.21.15.96:0/4184366146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec005040 con 0x7f30f00f6c60 2022-02-02T22:10:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f565d700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 secure :-1 s=READY pgs=3502 cs=0 l=1 rev1=1 rx=0x7f30ec009990 tx=0x7f30ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30ec018070 con 0x7f30f00f6c60 2022-02-02T22:10:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30ec007ba0 con 0x7f30f00f6c60 2022-02-02T22:10:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00f85e0 con 0x7f30f00f6c60 2022-02-02T22:10:16.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30ec01c3c0 con 0x7f30f00f6c60 2022-02-02T22:10:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.125+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00f8b40 con 0x7f30f00f6c60 2022-02-02T22:10:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.126+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0045ad0 con 0x7f30f00f6c60 2022-02-02T22:10:16.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.127+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f30ec01d420 con 0x7f30f00f6c60 2022-02-02T22:10:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.127+0000 7f30e27fc700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 0x7f30dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.127+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f30ec0837a0 con 0x7f30f00f6c60 2022-02-02T22:10:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.127+0000 7f30f5e5e700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 0x7f30dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.128+0000 7f30f5e5e700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 0x7f30dc067290 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f30e40041d0 tx=0x7f30e4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.131+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f30ec0518a0 con 0x7f30f00f6c60 2022-02-02T22:10:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.303+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f00fadc0 con 0x7f30dc064dd0 2022-02-02T22:10:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.313+0000 7f30e27fc700 1 -- 172.21.15.96:0/4184366146 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f30f00fadc0 con 0x7f30dc064dd0 2022-02-02T22:10:16.313 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:10:16.313 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:10:16.313 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:10:16.314 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:10:16.314 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:10:16.314 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:10:16.315 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:10:16.315 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:10:16.315 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:10:16.316 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:10:16.316 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:10:16.317 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:10:16.317 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:10:16.317 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:10:16.318 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:10:16.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:10:16.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:10:16.319 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:10:16.319 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:10:16.319 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:10:16.320 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:10:16.320 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:10:16.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 msgr2=0x7f30dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 0x7f30dc067290 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f30e40041d0 tx=0x7f30e4009040).stop 2022-02-02T22:10:16.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 msgr2=0x7f30f00f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 secure :-1 s=READY pgs=3502 cs=0 l=1 rev1=1 rx=0x7f30ec009990 tx=0x7f30ec009b30).stop 2022-02-02T22:10:16.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 shutdown_connections 2022-02-02T22:10:16.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f30dc064dd0 0x7f30dc067290 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30f00f5970 0x7f30f00f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 --2- 172.21.15.96:0/4184366146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f00f6c60 0x7f30f00f7cc0 unknown :-1 s=CLOSED pgs=3502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.314+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 >> 172.21.15.96:0/4184366146 conn(0x7f30f00f04c0 msgr2=0x7f30f00f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.315+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 shutdown_connections 2022-02-02T22:10:16.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.315+0000 7f30f80c2700 1 -- 172.21.15.96:0/4184366146 wait complete. 2022-02-02T22:10:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 -- 172.21.15.96:0/1734793951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 msgr2=0x7fadf00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/1734793951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf00f59e0 secure :-1 s=READY pgs=3503 cs=0 l=1 rev1=1 rx=0x7fade0004660 tx=0x7fade0009b30).stop 2022-02-02T22:10:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 -- 172.21.15.96:0/1734793951 shutdown_connections 2022-02-02T22:10:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/1734793951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 0x7fadf00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/1734793951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf00f59e0 unknown :-1 s=CLOSED pgs=3503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 -- 172.21.15.96:0/1734793951 >> 172.21.15.96:0/1734793951 conn(0x7fadf00f0d40 msgr2=0x7fadf00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.414 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:16 smithi096 ceph-mon[101353]: pgmap v6844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.411+0000 7fadf5ce9700 1 -- 172.21.15.96:0/1734793951 shutdown_connections 2022-02-02T22:10:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.412+0000 7fadf5ce9700 1 -- 172.21.15.96:0/1734793951 wait complete. 2022-02-02T22:10:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.412+0000 7fadf5ce9700 1 Processor -- start 2022-02-02T22:10:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.412+0000 7fadf5ce9700 1 -- start start 2022-02-02T22:10:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadf5ce9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadf5ce9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 0x7fadf0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadf5ce9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0106910 con 0x7fadf00f55c0 2022-02-02T22:10:16.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadf5ce9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0106a50 con 0x7fadf00f6860 2022-02-02T22:10:16.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46958/0 (socket says 172.21.15.96:46958) 2022-02-02T22:10:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 -- 172.21.15.96:0/4242764428 learned_addr learned my addr 172.21.15.96:0/4242764428 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadeeffd700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 0x7fadf0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 -- 172.21.15.96:0/4242764428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 msgr2=0x7fadf0106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 0x7fadf0106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 -- 172.21.15.96:0/4242764428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0005040 con 0x7fadf00f55c0 2022-02-02T22:10:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadef7fe700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 secure :-1 s=READY pgs=3504 cs=0 l=1 rev1=1 rx=0x7fade0013a70 tx=0x7fade0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade0018070 con 0x7fadf00f55c0 2022-02-02T22:10:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fade00097d0 con 0x7fadf00f55c0 2022-02-02T22:10:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf0107390 con 0x7fadf00f55c0 2022-02-02T22:10:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.413+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade001de30 con 0x7fadf00f55c0 2022-02-02T22:10:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.414+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf01078f0 con 0x7fadf00f55c0 2022-02-02T22:10:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.415+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fade0007ba0 con 0x7fadf00f55c0 2022-02-02T22:10:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.415+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0045ad0 con 0x7fadf00f55c0 2022-02-02T22:10:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.415+0000 7fadd7fff700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 0x7fadd8067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.415+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fade0083550 con 0x7fadf00f55c0 2022-02-02T22:10:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.415+0000 7fadeeffd700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 0x7fadd8067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.416+0000 7fadeeffd700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 0x7fadd8067360 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fade4004c40 tx=0x7fade400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.420+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fade0051710 con 0x7fadf00f55c0 2022-02-02T22:10:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:16 smithi159 ceph-mon[69013]: pgmap v6844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.651+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fadf00fde90 con 0x7fadf00f55c0 2022-02-02T22:10:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.652+0000 7fadd7fff700 1 -- 172.21.15.96:0/4242764428 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fade0054d30 con 0x7fadf00f55c0 2022-02-02T22:10:16.653 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:10:16.653 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:10:16.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:10:16.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:16.655 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:10:16.655 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:10:16.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:16.656 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:10:16.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:10:16.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:16.657 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:10:16.658 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:10:16.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:16.658 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:10:16.659 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:10:16.659 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:10:16.659 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:10:16.660 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:10:16.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.654+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 msgr2=0x7fadd8067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.654+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 0x7fadd8067360 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fade4004c40 tx=0x7fade400b040).stop 2022-02-02T22:10:16.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.654+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 msgr2=0x7fadf0105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.654+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 secure :-1 s=READY pgs=3504 cs=0 l=1 rev1=1 rx=0x7fade0013a70 tx=0x7fade0009b30).stop 2022-02-02T22:10:16.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 shutdown_connections 2022-02-02T22:10:16.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fadd8064ea0 0x7fadd8067360 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf00f55c0 0x7fadf0105e70 unknown :-1 s=CLOSED pgs=3504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 --2- 172.21.15.96:0/4242764428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadf00f6860 0x7fadf0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 >> 172.21.15.96:0/4242764428 conn(0x7fadf00f0d40 msgr2=0x7fadf00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 shutdown_connections 2022-02-02T22:10:16.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.655+0000 7fadf5ce9700 1 -- 172.21.15.96:0/4242764428 wait complete. 2022-02-02T22:10:16.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 -- 172.21.15.96:0/3123455900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f7980 msgr2=0x7fd7900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 --2- 172.21.15.96:0/3123455900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f7980 0x7fd7900f7de0 secure :-1 s=READY pgs=3505 cs=0 l=1 rev1=1 rx=0x7fd780004660 tx=0x7fd780009b30).stop 2022-02-02T22:10:16.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 -- 172.21.15.96:0/3123455900 shutdown_connections 2022-02-02T22:10:16.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 --2- 172.21.15.96:0/3123455900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f7980 0x7fd7900f7de0 unknown :-1 s=CLOSED pgs=3505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 --2- 172.21.15.96:0/3123455900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f66e0 0x7fd7900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:10:16.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 -- 172.21.15.96:0/3123455900 >> 172.21.15.96:0/3123455900 conn(0x7fd7900f1e40 msgr2=0x7fd7900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 -- 172.21.15.96:0/3123455900 shutdown_connections 2022-02-02T22:10:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.754+0000 7fd795ada700 1 -- 172.21.15.96:0/3123455900 wait complete. 2022-02-02T22:10:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 Processor -- start 2022-02-02T22:10:16.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 -- start start 2022-02-02T22:10:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f7980 0x7fd790069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79006a410 con 0x7fd7900f66e0 2022-02-02T22:10:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd795ada700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79006a550 con 0x7fd7900f7980 2022-02-02T22:10:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd78f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd78f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46966/0 (socket says 172.21.15.96:46966) 2022-02-02T22:10:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd78f7fe700 1 -- 172.21.15.96:0/1305511565 learned_addr learned my addr 172.21.15.96:0/1305511565 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.755+0000 7fd78effd700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f7980 0x7fd790069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd78f7fe700 1 -- 172.21.15.96:0/1305511565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f7980 msgr2=0x7fd790069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd78f7fe700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f7980 0x7fd790069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd78f7fe700 1 -- 172.21.15.96:0/1305511565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780005040 con 0x7fd7900f66e0 2022-02-02T22:10:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd78f7fe700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 secure :-1 s=READY pgs=3506 cs=0 l=1 rev1=1 rx=0x7fd7840093f0 tx=0x7fd784006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd784013640 con 0x7fd7900f66e0 2022-02-02T22:10:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd784013c50 con 0x7fd7900f66e0 2022-02-02T22:10:16.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79006a830 con 0x7fd7900f66e0 2022-02-02T22:10:16.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd784012c70 con 0x7fd7900f66e0 2022-02-02T22:10:16.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.756+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79010efe0 con 0x7fd7900f66e0 2022-02-02T22:10:16.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.757+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770004fa0 con 0x7fd7900f66e0 2022-02-02T22:10:16.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.757+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd78401a060 con 0x7fd7900f66e0 2022-02-02T22:10:16.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.758+0000 7fd777fff700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 0x7fd778067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.758+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7840818e0 con 0x7fd7900f66e0 2022-02-02T22:10:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.758+0000 7fd78effd700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 0x7fd778067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.758+0000 7fd78effd700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 0x7fd778067290 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fd780004630 tx=0x7fd780009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.762+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd78404fac0 con 0x7fd7900f66e0 2022-02-02T22:10:16.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.965+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd770005e80 con 0x7fd7900f66e0 2022-02-02T22:10:16.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.966+0000 7fd777fff700 1 -- 172.21.15.96:0/1305511565 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd784018720 con 0x7fd7900f66e0 2022-02-02T22:10:16.966 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:10:16.967 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:10:16.967 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:10:16.967 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:10:16.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:16.968 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:10:16.968 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:10:16.969 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:10:16.969 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:10:16.970 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:10:16.970 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:10:16.970 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:10:16.971 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:10:16.971 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:10:16.971 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:10:16.972 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:10:16.972 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:10:16.972 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:10:16.973 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:10:16.973 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:10:16.973 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:10:16.974 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:10:16.974 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:10:16.975 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:10:16.975 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:10:16.976 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:10:16.976 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:10:16.976 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:10:16.977 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:10:16.977 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:10:16.977 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:10:16.978 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:10:16.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:16.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:16.979 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:10:16.979 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:16.979 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:16.980 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:16.980 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.967+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 msgr2=0x7fd778067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.967+0000 7fd795ada700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 0x7fd778067290 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fd780004630 tx=0x7fd780009b30).stop 2022-02-02T22:10:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.967+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 msgr2=0x7fd79006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.967+0000 7fd795ada700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 secure :-1 s=READY pgs=3506 cs=0 l=1 rev1=1 rx=0x7fd7840093f0 tx=0x7fd784006ec0).stop 2022-02-02T22:10:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 shutdown_connections 2022-02-02T22:10:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd778064dd0 0x7fd778067290 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7900f66e0 0x7fd79006b9a0 unknown :-1 s=CLOSED pgs=3506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 --2- 172.21.15.96:0/1305511565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7900f7980 0x7fd790069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:16.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 >> 172.21.15.96:0/1305511565 conn(0x7fd7900f1e40 msgr2=0x7fd7900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:16.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 shutdown_connections 2022-02-02T22:10:16.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:16.968+0000 7fd795ada700 1 -- 172.21.15.96:0/1305511565 wait complete. 2022-02-02T22:10:16.985 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:10:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:17 smithi159 ceph-mon[69013]: from='client.41116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:17 smithi159 ceph-mon[69013]: from='client.41120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4242764428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:10:17.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1305511565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:10:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:17 smithi096 ceph-mon[101353]: from='client.41116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:17 smithi096 ceph-mon[101353]: from='client.41120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4242764428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:10:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1305511565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:10:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:18 smithi159 ceph-mon[69013]: pgmap v6845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:18 smithi096 ceph-mon[101353]: pgmap v6845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:20 smithi159 ceph-mon[69013]: pgmap v6846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:20 smithi096 ceph-mon[101353]: pgmap v6846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:22 smithi159 ceph-mon[69013]: pgmap v6847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:22 smithi096 ceph-mon[101353]: pgmap v6847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:24 smithi159 ceph-mon[69013]: pgmap v6848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:24 smithi096 ceph-mon[101353]: pgmap v6848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:26 smithi159 ceph-mon[69013]: pgmap v6849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:26 smithi096 ceph-mon[101353]: pgmap v6849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:28 smithi159 ceph-mon[69013]: pgmap v6850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:10:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:10:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:28 smithi096 ceph-mon[101353]: pgmap v6850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:10:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:10:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:30 smithi159 ceph-mon[69013]: pgmap v6851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:30 smithi096 ceph-mon[101353]: pgmap v6851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:32 smithi159 ceph-mon[69013]: pgmap v6852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:32 smithi096 ceph-mon[101353]: pgmap v6852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:34 smithi159 ceph-mon[69013]: pgmap v6853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:34 smithi096 ceph-mon[101353]: pgmap v6853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:36 smithi159 ceph-mon[69013]: pgmap v6854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:36 smithi096 ceph-mon[101353]: pgmap v6854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:38 smithi159 ceph-mon[69013]: pgmap v6855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:38 smithi096 ceph-mon[101353]: pgmap v6855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:40 smithi159 ceph-mon[69013]: pgmap v6856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:40 smithi096 ceph-mon[101353]: pgmap v6856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:42 smithi159 ceph-mon[69013]: pgmap v6857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:42 smithi096 ceph-mon[101353]: pgmap v6857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:44 smithi159 ceph-mon[69013]: pgmap v6858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:44 smithi096 ceph-mon[101353]: pgmap v6858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:46.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:46 smithi159 ceph-mon[69013]: pgmap v6859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:46.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:46 smithi096 ceph-mon[101353]: pgmap v6859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:47.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 -- 172.21.15.96:0/1236847237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 msgr2=0x7fd5800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 --2- 172.21.15.96:0/1236847237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd5800f7de0 secure :-1 s=READY pgs=3507 cs=0 l=1 rev1=1 rx=0x7fd57c004660 tx=0x7fd57c009b30).stop 2022-02-02T22:10:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 -- 172.21.15.96:0/1236847237 shutdown_connections 2022-02-02T22:10:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 --2- 172.21.15.96:0/1236847237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd5800f7de0 unknown :-1 s=CLOSED pgs=3507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 --2- 172.21.15.96:0/1236847237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 0x7fd5800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 -- 172.21.15.96:0/1236847237 >> 172.21.15.96:0/1236847237 conn(0x7fd5800f1e40 msgr2=0x7fd5800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 -- 172.21.15.96:0/1236847237 shutdown_connections 2022-02-02T22:10:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.077+0000 7fd587cd2700 1 -- 172.21.15.96:0/1236847237 wait complete. 2022-02-02T22:10:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 Processor -- start 2022-02-02T22:10:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 -- start start 2022-02-02T22:10:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 0x7fd58006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58006a380 con 0x7fd5800f7980 2022-02-02T22:10:47.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.078+0000 7fd587cd2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58006a4c0 con 0x7fd5800f66e0 2022-02-02T22:10:47.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46992/0 (socket says 172.21.15.96:46992) 2022-02-02T22:10:47.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 -- 172.21.15.96:0/3667393294 learned_addr learned my addr 172.21.15.96:0/3667393294 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:47.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd585a6e700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 0x7fd58006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 -- 172.21.15.96:0/3667393294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 msgr2=0x7fd58006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 0x7fd58006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 -- 172.21.15.96:0/3667393294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c005040 con 0x7fd5800f7980 2022-02-02T22:10:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd58526d700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 secure :-1 s=READY pgs=3508 cs=0 l=1 rev1=1 rx=0x7fd57c000c00 tx=0x7fd57c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57c019070 con 0x7fd5800f7980 2022-02-02T22:10:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58006a740 con 0x7fd5800f7980 2022-02-02T22:10:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58006aca0 con 0x7fd5800f7980 2022-02-02T22:10:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd57c007e70 con 0x7fd5800f7980 2022-02-02T22:10:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.079+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57c014cb0 con 0x7fd5800f7980 2022-02-02T22:10:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.080+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568004fa0 con 0x7fd5800f7980 2022-02-02T22:10:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.081+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd57c025070 con 0x7fd5800f7980 2022-02-02T22:10:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.081+0000 7fd5727fc700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 0x7fd56c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.081+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd57c0829d0 con 0x7fd5800f7980 2022-02-02T22:10:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.081+0000 7fd585a6e700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 0x7fd56c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.082+0000 7fd585a6e700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 0x7fd56c067290 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7fd58006b730 tx=0x7fd57400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.086+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd57c050ad0 con 0x7fd5800f7980 2022-02-02T22:10:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.263+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd568000bc0 con 0x7fd56c064dd0 2022-02-02T22:10:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.264+0000 7fd5727fc700 1 -- 172.21.15.96:0/3667393294 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd568000bc0 con 0x7fd56c064dd0 2022-02-02T22:10:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.266+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 msgr2=0x7fd56c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.266+0000 7fd587cd2700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 0x7fd56c067290 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7fd58006b730 tx=0x7fd57400b040).stop 2022-02-02T22:10:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.266+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 msgr2=0x7fd580069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.266+0000 7fd587cd2700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 secure :-1 s=READY pgs=3508 cs=0 l=1 rev1=1 rx=0x7fd57c000c00 tx=0x7fd57c00b040).stop 2022-02-02T22:10:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 shutdown_connections 2022-02-02T22:10:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd56c064dd0 0x7fd56c067290 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5800f66e0 0x7fd58006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 --2- 172.21.15.96:0/3667393294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5800f7980 0x7fd580069e20 unknown :-1 s=CLOSED pgs=3508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 >> 172.21.15.96:0/3667393294 conn(0x7fd5800f1e40 msgr2=0x7fd5800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 shutdown_connections 2022-02-02T22:10:47.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.267+0000 7fd587cd2700 1 -- 172.21.15.96:0/3667393294 wait complete. 2022-02-02T22:10:47.277 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:10:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.364+0000 7fcd26838700 1 -- 172.21.15.96:0/2659406697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 msgr2=0x7fcd200f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.364+0000 7fcd26838700 1 --2- 172.21.15.96:0/2659406697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd200f5a00 secure :-1 s=READY pgs=3509 cs=0 l=1 rev1=1 rx=0x7fcd14004660 tx=0x7fcd14009b30).stop 2022-02-02T22:10:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 -- 172.21.15.96:0/2659406697 shutdown_connections 2022-02-02T22:10:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 --2- 172.21.15.96:0/2659406697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd200f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 --2- 172.21.15.96:0/2659406697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd200f5a00 unknown :-1 s=CLOSED pgs=3509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 -- 172.21.15.96:0/2659406697 >> 172.21.15.96:0/2659406697 conn(0x7fcd200f0de0 msgr2=0x7fcd200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 -- 172.21.15.96:0/2659406697 shutdown_connections 2022-02-02T22:10:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 -- 172.21.15.96:0/2659406697 wait complete. 2022-02-02T22:10:47.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.365+0000 7fcd26838700 1 Processor -- start 2022-02-02T22:10:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd26838700 1 -- start start 2022-02-02T22:10:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd26838700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd26838700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd2010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd26838700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20060500 con 0x7fcd200f55e0 2022-02-02T22:10:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd26838700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20060640 con 0x7fcd200f5ef0 2022-02-02T22:10:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47000/0 (socket says 172.21.15.96:47000) 2022-02-02T22:10:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 -- 172.21.15.96:0/494824753 learned_addr learned my addr 172.21.15.96:0/494824753 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1f7fe700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd2010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 -- 172.21.15.96:0/494824753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 msgr2=0x7fcd2010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd2010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 -- 172.21.15.96:0/494824753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14005040 con 0x7fcd200f55e0 2022-02-02T22:10:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1f7fe700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd2010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:10:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.366+0000 7fcd1ffff700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 secure :-1 s=READY pgs=3510 cs=0 l=1 rev1=1 rx=0x7fcd14009990 tx=0x7fcd14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.367+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd14018070 con 0x7fcd200f55e0 2022-02-02T22:10:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.367+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2010c6e0 con 0x7fcd200f55e0 2022-02-02T22:10:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.367+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd14007ba0 con 0x7fcd200f55e0 2022-02-02T22:10:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.367+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1401c3c0 con 0x7fcd200f55e0 2022-02-02T22:10:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.367+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2010cc40 con 0x7fcd200f55e0 2022-02-02T22:10:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.368+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd1401d420 con 0x7fcd200f55e0 2022-02-02T22:10:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.368+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20045ad0 con 0x7fcd200f55e0 2022-02-02T22:10:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.368+0000 7fcd1cff9700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.369+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd14083300 con 0x7fcd200f55e0 2022-02-02T22:10:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.374+0000 7fcd1f7fe700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.374+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd14051360 con 0x7fcd200f55e0 2022-02-02T22:10:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.374+0000 7fcd1f7fe700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7fcd100102e0 tx=0x7fcd1000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.544+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd200fdf80 con 0x7fcd08064dd0 2022-02-02T22:10:47.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.553+0000 7fcd1cff9700 1 -- 172.21.15.96:0/494824753 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcd1000f040 con 0x7fcd08064dd0 2022-02-02T22:10:47.555 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:10:47.555 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:10:47.555 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:10:47.556 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:10:47.556 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:10:47.556 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:10:47.557 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:10:47.557 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:10:47.557 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:10:47.558 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:10:47.558 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:10:47.558 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:10:47.559 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:10:47.559 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:10:47.559 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:10:47.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:10:47.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:10:47.560 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:10:47.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:10:47.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:10:47.561 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:10:47.562 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:10:47.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 msgr2=0x7fcd08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7fcd100102e0 tx=0x7fcd1000b040).stop 2022-02-02T22:10:47.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 msgr2=0x7fcd20109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 secure :-1 s=READY pgs=3510 cs=0 l=1 rev1=1 rx=0x7fcd14009990 tx=0x7fcd14009b30).stop 2022-02-02T22:10:47.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 shutdown_connections 2022-02-02T22:10:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd08064dd0 0x7fcd08067290 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd200f55e0 0x7fcd20109c90 unknown :-1 s=CLOSED pgs=3510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 --2- 172.21.15.96:0/494824753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd200f5ef0 0x7fcd2010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 >> 172.21.15.96:0/494824753 conn(0x7fcd200f0de0 msgr2=0x7fcd200fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 shutdown_connections 2022-02-02T22:10:47.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.556+0000 7fcd26838700 1 -- 172.21.15.96:0/494824753 wait complete. 2022-02-02T22:10:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 -- 172.21.15.96:0/2579774561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 msgr2=0x7f80380f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 --2- 172.21.15.96:0/2579774561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f80380f6b40 secure :-1 s=READY pgs=3511 cs=0 l=1 rev1=1 rx=0x7f8024004660 tx=0x7f8024009b30).stop 2022-02-02T22:10:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 -- 172.21.15.96:0/2579774561 shutdown_connections 2022-02-02T22:10:47.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 --2- 172.21.15.96:0/2579774561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f80380f6b40 unknown :-1 s=CLOSED pgs=3511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 --2- 172.21.15.96:0/2579774561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 0x7f80380f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 -- 172.21.15.96:0/2579774561 >> 172.21.15.96:0/2579774561 conn(0x7f80380f0ba0 msgr2=0x7f80380f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.651+0000 7f803de84700 1 -- 172.21.15.96:0/2579774561 shutdown_connections 2022-02-02T22:10:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.652+0000 7f803de84700 1 -- 172.21.15.96:0/2579774561 wait complete. 2022-02-02T22:10:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.652+0000 7f803de84700 1 Processor -- start 2022-02-02T22:10:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.652+0000 7f803de84700 1 -- start start 2022-02-02T22:10:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f803de84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 0x7f8038105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f803de84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f803de84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80381067d0 con 0x7f80380f66e0 2022-02-02T22:10:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f803de84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038106fd0 con 0x7f80380f5440 2022-02-02T22:10:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47010/0 (socket says 172.21.15.96:47010) 2022-02-02T22:10:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 -- 172.21.15.96:0/141128643 learned_addr learned my addr 172.21.15.96:0/141128643 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f803ce82700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 0x7f8038105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 -- 172.21.15.96:0/141128643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 msgr2=0x7f8038105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 0x7f8038105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 -- 172.21.15.96:0/141128643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024005040 con 0x7f80380f66e0 2022-02-02T22:10:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.653+0000 7f8037fff700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 secure :-1 s=READY pgs=3512 cs=0 l=1 rev1=1 rx=0x7f8024009990 tx=0x7f8024009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.654+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8024018070 con 0x7f80380f66e0 2022-02-02T22:10:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.654+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8024007ba0 con 0x7f80380f66e0 2022-02-02T22:10:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.654+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038107250 con 0x7f80380f66e0 2022-02-02T22:10:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.654+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802401c3c0 con 0x7f80380f66e0 2022-02-02T22:10:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.654+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80381077b0 con 0x7f80380f66e0 2022-02-02T22:10:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.655+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8038059100 con 0x7f80380f66e0 2022-02-02T22:10:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.655+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f802401d420 con 0x7f80380f66e0 2022-02-02T22:10:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.656+0000 7f80357fa700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.656+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8024083680 con 0x7f80380f66e0 2022-02-02T22:10:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.656+0000 7f803ce82700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.656+0000 7f803ce82700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f80380f6540 tx=0x7f802c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.661+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8024055150 con 0x7f80380f66e0 2022-02-02T22:10:47.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.889+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80380008d0 con 0x7f80380f66e0 2022-02-02T22:10:47.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.889+0000 7f80357fa700 1 -- 172.21.15.96:0/141128643 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8024054d40 con 0x7f80380f66e0 2022-02-02T22:10:47.891 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:10:47.891 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:10:47.892 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:10:47.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:47.892 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:10:47.893 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:10:47.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:47.893 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:10:47.894 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:10:47.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:47.894 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:10:47.895 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:10:47.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:10:47.895 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:10:47.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:10:47.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:10:47.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:10:47.897 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:10:47.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 msgr2=0x7f80280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f80380f6540 tx=0x7f802c009c00).stop 2022-02-02T22:10:47.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 msgr2=0x7f8038106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 secure :-1 s=READY pgs=3512 cs=0 l=1 rev1=1 rx=0x7f8024009990 tx=0x7f8024009b30).stop 2022-02-02T22:10:47.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 shutdown_connections 2022-02-02T22:10:47.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8028064e20 0x7f80280672e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380f5440 0x7f8038105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 --2- 172.21.15.96:0/141128643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80380f66e0 0x7f8038106220 unknown :-1 s=CLOSED pgs=3512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 >> 172.21.15.96:0/141128643 conn(0x7f80380f0ba0 msgr2=0x7f80380fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 shutdown_connections 2022-02-02T22:10:47.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.891+0000 7f803de84700 1 -- 172.21.15.96:0/141128643 wait complete. 2022-02-02T22:10:47.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 -- 172.21.15.96:0/4159766933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 msgr2=0x7f6e980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 --2- 172.21.15.96:0/4159766933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e980f6950 secure :-1 s=READY pgs=3513 cs=0 l=1 rev1=1 rx=0x7f6e88004660 tx=0x7f6e88009b30).stop 2022-02-02T22:10:47.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 -- 172.21.15.96:0/4159766933 shutdown_connections 2022-02-02T22:10:47.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 --2- 172.21.15.96:0/4159766933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 0x7f6e980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 --2- 172.21.15.96:0/4159766933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e980f6950 unknown :-1 s=CLOSED pgs=3513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:47.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 -- 172.21.15.96:0/4159766933 >> 172.21.15.96:0/4159766933 conn(0x7f6e980f1c90 msgr2=0x7f6e980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:47.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.988+0000 7f6e97fff700 1 -- 172.21.15.96:0/4159766933 shutdown_connections 2022-02-02T22:10:47.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 -- 172.21.15.96:0/4159766933 wait complete. 2022-02-02T22:10:47.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 Processor -- start 2022-02-02T22:10:47.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 -- start start 2022-02-02T22:10:47.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 0x7f6e98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:47.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9810aa10 con 0x7f6e980f6530 2022-02-02T22:10:47.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.989+0000 7f6e97fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9810ab50 con 0x7f6e980f77d0 2022-02-02T22:10:47.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47018/0 (socket says 172.21.15.96:47018) 2022-02-02T22:10:47.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 -- 172.21.15.96:0/1381452409 learned_addr learned my addr 172.21.15.96:0/1381452409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:10:47.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e967fc700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 0x7f6e98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:47.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 -- 172.21.15.96:0/1381452409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 msgr2=0x7f6e98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:47.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 0x7f6e98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:48.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 -- 172.21.15.96:0/1381452409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88005040 con 0x7f6e980f6530 2022-02-02T22:10:48.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e96ffd700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 secure :-1 s=READY pgs=3514 cs=0 l=1 rev1=1 rx=0x7f6e88004f60 tx=0x7f6e88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:48.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e88018070 con 0x7f6e980f6530 2022-02-02T22:10:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e88009770 con 0x7f6e980f6530 2022-02-02T22:10:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9810add0 con 0x7f6e980f6530 2022-02-02T22:10:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e8801c3c0 con 0x7f6e980f6530 2022-02-02T22:10:48.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.990+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9810b330 con 0x7f6e980f6530 2022-02-02T22:10:48.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.992+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e98045ad0 con 0x7f6e980f6530 2022-02-02T22:10:48.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.992+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e8801d420 con 0x7f6e980f6530 2022-02-02T22:10:48.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.993+0000 7f6e7f7fe700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 0x7f6e800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:10:48.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.993+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6e88083880 con 0x7f6e980f6530 2022-02-02T22:10:48.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.993+0000 7f6e967fc700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 0x7f6e800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:10:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.993+0000 7f6e967fc700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 0x7f6e800672e0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f6e8c0041d0 tx=0x7f6e8c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:10:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:47.997+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e88051a40 con 0x7f6e980f6530 2022-02-02T22:10:48.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.204+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e9806ac30 con 0x7f6e980f6530 2022-02-02T22:10:48.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.204+0000 7f6e7f7fe700 1 -- 172.21.15.96:0/1381452409 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6e88055060 con 0x7f6e980f6530 2022-02-02T22:10:48.206 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:10:48.206 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:10:48.207 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:10:48.207 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:10:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:48.208 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:10:48.209 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:10:48.209 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:10:48.209 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:10:48.210 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:10:48.210 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:10:48.210 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:10:48.211 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:10:48.211 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:10:48.211 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:10:48.212 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:10:48.212 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:10:48.212 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:10:48.213 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:10:48.213 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:10:48.214 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:10:48.214 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:10:48.214 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:10:48.215 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:10:48.215 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:10:48.215 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:10:48.216 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:10:48.216 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:10:48.216 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:10:48.217 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:10:48.217 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:10:48.218 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:10:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:48.219 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:10:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:10:48.220 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:48.220 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:48.220 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:10:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 msgr2=0x7f6e800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:48.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 0x7f6e800672e0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f6e8c0041d0 tx=0x7f6e8c009040).stop 2022-02-02T22:10:48.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 msgr2=0x7f6e9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:10:48.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 secure :-1 s=READY pgs=3514 cs=0 l=1 rev1=1 rx=0x7f6e88004f60 tx=0x7f6e88009b30).stop 2022-02-02T22:10:48.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 shutdown_connections 2022-02-02T22:10:48.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e80064e20 0x7f6e800672e0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:48.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e980f6530 0x7f6e9806b9a0 unknown :-1 s=CLOSED pgs=3514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 --2- 172.21.15.96:0/1381452409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e980f77d0 0x7f6e98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:10:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 >> 172.21.15.96:0/1381452409 conn(0x7f6e980f1c90 msgr2=0x7f6e980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:10:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 shutdown_connections 2022-02-02T22:10:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:10:48.207+0000 7f6e97fff700 1 -- 172.21.15.96:0/1381452409 wait complete. 2022-02-02T22:10:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:10:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:48 smithi096 ceph-mon[101353]: pgmap v6860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:48.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:48 smithi096 ceph-mon[101353]: from='client.41132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:48 smithi096 ceph-mon[101353]: from='client.41136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:48.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/141128643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:10:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:48 smithi159 ceph-mon[69013]: pgmap v6860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:48 smithi159 ceph-mon[69013]: from='client.41132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:48 smithi159 ceph-mon[69013]: from='client.41136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:10:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/141128643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:10:49.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1381452409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:10:49.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1381452409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:10:50.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:50 smithi159 ceph-mon[69013]: pgmap v6861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:50 smithi096 ceph-mon[101353]: pgmap v6861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:52 smithi159 ceph-mon[69013]: pgmap v6862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:52 smithi096 ceph-mon[101353]: pgmap v6862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:54 smithi159 ceph-mon[69013]: pgmap v6863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:54 smithi096 ceph-mon[101353]: pgmap v6863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:56.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:56 smithi159 ceph-mon[69013]: pgmap v6864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:56 smithi096 ceph-mon[101353]: pgmap v6864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:10:58 smithi159 ceph-mon[69013]: pgmap v6865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:10:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:10:58 smithi096 ceph-mon[101353]: pgmap v6865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:00 smithi159 ceph-mon[69013]: pgmap v6866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:00 smithi096 ceph-mon[101353]: pgmap v6866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:02 smithi159 ceph-mon[69013]: pgmap v6867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:02.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:02 smithi096 ceph-mon[101353]: pgmap v6867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:04 smithi159 ceph-mon[69013]: pgmap v6868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:04 smithi096 ceph-mon[101353]: pgmap v6868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:06 smithi159 ceph-mon[69013]: pgmap v6869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:06 smithi096 ceph-mon[101353]: pgmap v6869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:08 smithi159 ceph-mon[69013]: pgmap v6870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:08 smithi096 ceph-mon[101353]: pgmap v6870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:10.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:10 smithi159 ceph-mon[69013]: pgmap v6871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:10 smithi096 ceph-mon[101353]: pgmap v6871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:12.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:12 smithi159 ceph-mon[69013]: pgmap v6872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:12 smithi096 ceph-mon[101353]: pgmap v6872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:14 smithi159 ceph-mon[69013]: pgmap v6873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:14 smithi096 ceph-mon[101353]: pgmap v6873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:16 smithi159 ceph-mon[69013]: pgmap v6874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:16 smithi096 ceph-mon[101353]: pgmap v6874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:18.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 -- 172.21.15.96:0/1459555383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f6860 msgr2=0x7faa180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 --2- 172.21.15.96:0/1459555383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f6860 0x7faa180f6cc0 secure :-1 s=READY pgs=3515 cs=0 l=1 rev1=1 rx=0x7faa14004660 tx=0x7faa14009b30).stop 2022-02-02T22:11:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 -- 172.21.15.96:0/1459555383 shutdown_connections 2022-02-02T22:11:18.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 --2- 172.21.15.96:0/1459555383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f6860 0x7faa180f6cc0 unknown :-1 s=CLOSED pgs=3515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 --2- 172.21.15.96:0/1459555383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f55c0 0x7faa180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 -- 172.21.15.96:0/1459555383 >> 172.21.15.96:0/1459555383 conn(0x7faa180f0d40 msgr2=0x7faa180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:18.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 -- 172.21.15.96:0/1459555383 shutdown_connections 2022-02-02T22:11:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.318+0000 7faa1ff22700 1 -- 172.21.15.96:0/1459555383 wait complete. 2022-02-02T22:11:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 Processor -- start 2022-02-02T22:11:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 -- start start 2022-02-02T22:11:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f6860 0x7faa1810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa180602d0 con 0x7faa180f55c0 2022-02-02T22:11:18.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1ff22700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa18060410 con 0x7faa180f6860 2022-02-02T22:11:18.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47038/0 (socket says 172.21.15.96:47038) 2022-02-02T22:11:18.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 -- 172.21.15.96:0/4031163758 learned_addr learned my addr 172.21.15.96:0/4031163758 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:18.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1d4bd700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f6860 0x7faa1810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 -- 172.21.15.96:0/4031163758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f6860 msgr2=0x7faa1810e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f6860 0x7faa1810e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.319+0000 7faa1dcbe700 1 -- 172.21.15.96:0/4031163758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14005040 con 0x7faa180f55c0 2022-02-02T22:11:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa1dcbe700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 secure :-1 s=READY pgs=3516 cs=0 l=1 rev1=1 rx=0x7faa08002700 tx=0x7faa08009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa080079c0 con 0x7faa180f55c0 2022-02-02T22:11:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa0800f040 con 0x7faa180f55c0 2022-02-02T22:11:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1810ea40 con 0x7faa180f55c0 2022-02-02T22:11:18.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa08014860 con 0x7faa180f55c0 2022-02-02T22:11:18.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.320+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1810eec0 con 0x7faa180f55c0 2022-02-02T22:11:18.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.321+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa18045ad0 con 0x7faa180f55c0 2022-02-02T22:11:18.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.322+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa0801b060 con 0x7faa180f55c0 2022-02-02T22:11:18.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.322+0000 7faa0e7fc700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 0x7faa04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.322+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa08081ac0 con 0x7faa180f55c0 2022-02-02T22:11:18.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.322+0000 7faa1d4bd700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 0x7faa04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.323+0000 7faa1d4bd700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 0x7faa04067290 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7faa14004630 tx=0x7faa14009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.326+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa0804fc40 con 0x7faa180f55c0 2022-02-02T22:11:18.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.504+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa18057f10 con 0x7faa04064dd0 2022-02-02T22:11:18.506 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:18 smithi096 ceph-mon[101353]: pgmap v6875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:18.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.505+0000 7faa0e7fc700 1 -- 172.21.15.96:0/4031163758 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faa18057f10 con 0x7faa04064dd0 2022-02-02T22:11:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 msgr2=0x7faa04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 0x7faa04067290 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7faa14004630 tx=0x7faa14009b30).stop 2022-02-02T22:11:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 msgr2=0x7faa1810c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 secure :-1 s=READY pgs=3516 cs=0 l=1 rev1=1 rx=0x7faa08002700 tx=0x7faa08009d80).stop 2022-02-02T22:11:18.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 shutdown_connections 2022-02-02T22:11:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa04064dd0 0x7faa04067290 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa180f55c0 0x7faa1810c050 unknown :-1 s=CLOSED pgs=3516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 --2- 172.21.15.96:0/4031163758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180f6860 0x7faa1810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 >> 172.21.15.96:0/4031163758 conn(0x7faa180f0d40 msgr2=0x7faa180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 shutdown_connections 2022-02-02T22:11:18.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.507+0000 7faa1ff22700 1 -- 172.21.15.96:0/4031163758 wait complete. 2022-02-02T22:11:18.517 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:11:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:18 smithi159 ceph-mon[69013]: pgmap v6875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:18.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 -- 172.21.15.96:0/1819595272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 msgr2=0x7f59300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 --2- 172.21.15.96:0/1819595272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f59300f6b00 secure :-1 s=READY pgs=3517 cs=0 l=1 rev1=1 rx=0x7f5920004660 tx=0x7f5920009b30).stop 2022-02-02T22:11:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 -- 172.21.15.96:0/1819595272 shutdown_connections 2022-02-02T22:11:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 --2- 172.21.15.96:0/1819595272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59300f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 --2- 172.21.15.96:0/1819595272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f59300f6b00 unknown :-1 s=CLOSED pgs=3517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 -- 172.21.15.96:0/1819595272 >> 172.21.15.96:0/1819595272 conn(0x7f59300f1e40 msgr2=0x7f59300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 -- 172.21.15.96:0/1819595272 shutdown_connections 2022-02-02T22:11:18.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 -- 172.21.15.96:0/1819595272 wait complete. 2022-02-02T22:11:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.605+0000 7f5937a1e700 1 Processor -- start 2022-02-02T22:11:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5937a1e700 1 -- start start 2022-02-02T22:11:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5937a1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5937a1e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59301074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5937a1e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930107a90 con 0x7f59300f66e0 2022-02-02T22:11:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5937a1e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930107bd0 con 0x7f59300f7980 2022-02-02T22:11:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47048/0 (socket says 172.21.15.96:47048) 2022-02-02T22:11:18.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 -- 172.21.15.96:0/2546152417 learned_addr learned my addr 172.21.15.96:0/2546152417 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:18.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5934fb9700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59301074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 -- 172.21.15.96:0/2546152417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 msgr2=0x7f59301074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59301074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 -- 172.21.15.96:0/2546152417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920005040 con 0x7f59300f66e0 2022-02-02T22:11:18.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f5934fb9700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59301074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:11:18.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.606+0000 7f59357ba700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 secure :-1 s=READY pgs=3518 cs=0 l=1 rev1=1 rx=0x7f5920000c00 tx=0x7f5920009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.607+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5920018070 con 0x7f59300f66e0 2022-02-02T22:11:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.607+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5920007d70 con 0x7f59300f66e0 2022-02-02T22:11:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.607+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930108510 con 0x7f59300f66e0 2022-02-02T22:11:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.607+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592001c620 con 0x7f59300f66e0 2022-02-02T22:11:18.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.607+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930108a70 con 0x7f59300f66e0 2022-02-02T22:11:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.608+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930045ad0 con 0x7f59300f66e0 2022-02-02T22:11:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.608+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f592001c860 con 0x7f59300f66e0 2022-02-02T22:11:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.609+0000 7f5925ffb700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 0x7f591c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.609+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f59200838f0 con 0x7f59300f66e0 2022-02-02T22:11:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.609+0000 7f5934fb9700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 0x7f591c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.609+0000 7f5934fb9700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 0x7f591c067270 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f592c0041d0 tx=0x7f592c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.613+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5920055420 con 0x7f59300f66e0 2022-02-02T22:11:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.786+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59300ff000 con 0x7f591c064db0 2022-02-02T22:11:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.795+0000 7f5925ffb700 1 -- 172.21.15.96:0/2546152417 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f59300ff000 con 0x7f591c064db0 2022-02-02T22:11:18.797 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:11:18.797 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:11:18.798 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:11:18.798 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:11:18.798 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:11:18.799 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:11:18.799 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:11:18.799 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:11:18.800 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:11:18.800 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:11:18.800 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:11:18.801 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:11:18.801 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:11:18.801 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:11:18.802 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:11:18.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:11:18.802 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:11:18.803 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:11:18.803 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:11:18.803 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:11:18.804 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:11:18.804 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:11:18.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 msgr2=0x7f591c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 0x7f591c067270 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f592c0041d0 tx=0x7f592c009040).stop 2022-02-02T22:11:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 msgr2=0x7f5930106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 secure :-1 s=READY pgs=3518 cs=0 l=1 rev1=1 rx=0x7f5920000c00 tx=0x7f5920009b30).stop 2022-02-02T22:11:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 shutdown_connections 2022-02-02T22:11:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f591c064db0 0x7f591c067270 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59300f66e0 0x7f5930106ff0 unknown :-1 s=CLOSED pgs=3518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 --2- 172.21.15.96:0/2546152417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59300f7980 0x7f59301074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 >> 172.21.15.96:0/2546152417 conn(0x7f59300f1e40 msgr2=0x7f59300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 shutdown_connections 2022-02-02T22:11:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.797+0000 7f5937a1e700 1 -- 172.21.15.96:0/2546152417 wait complete. 2022-02-02T22:11:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 -- 172.21.15.96:0/1268230756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f55c0 msgr2=0x7f736c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1268230756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f55c0 0x7f736c0f59e0 secure :-1 s=READY pgs=3519 cs=0 l=1 rev1=1 rx=0x7f7360004660 tx=0x7f7360009b30).stop 2022-02-02T22:11:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 -- 172.21.15.96:0/1268230756 shutdown_connections 2022-02-02T22:11:18.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1268230756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f6860 0x7f736c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1268230756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f55c0 0x7f736c0f59e0 unknown :-1 s=CLOSED pgs=3519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 -- 172.21.15.96:0/1268230756 >> 172.21.15.96:0/1268230756 conn(0x7f736c0f0d40 msgr2=0x7f736c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:18.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 -- 172.21.15.96:0/1268230756 shutdown_connections 2022-02-02T22:11:18.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.895+0000 7f7372b5d700 1 -- 172.21.15.96:0/1268230756 wait complete. 2022-02-02T22:11:18.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 Processor -- start 2022-02-02T22:11:18.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 -- start start 2022-02-02T22:11:18.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 0x7f736c10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0602b0 con 0x7f736c0f6860 2022-02-02T22:11:18.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f7372b5d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0603f0 con 0x7f736c0f55c0 2022-02-02T22:11:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47060/0 (socket says 172.21.15.96:47060) 2022-02-02T22:11:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 -- 172.21.15.96:0/1440855740 learned_addr learned my addr 172.21.15.96:0/1440855740 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f73708f9700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 0x7f736c10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 -- 172.21.15.96:0/1440855740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 msgr2=0x7f736c10c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 0x7f736c10c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f736bfff700 1 -- 172.21.15.96:0/1440855740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360005040 con 0x7f736c0f6860 2022-02-02T22:11:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.896+0000 7f73708f9700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 0x7f736c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:11:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f736bfff700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 secure :-1 s=READY pgs=3520 cs=0 l=1 rev1=1 rx=0x7f73580026d0 tx=0x7f7358009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7358009320 con 0x7f736c0f6860 2022-02-02T22:11:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f735800f040 con 0x7f736c0f6860 2022-02-02T22:11:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c10ea80 con 0x7f736c0f6860 2022-02-02T22:11:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73580147e0 con 0x7f736c0f6860 2022-02-02T22:11:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.897+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c10ef00 con 0x7f736c0f6860 2022-02-02T22:11:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.898+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c045ad0 con 0x7f736c0f6860 2022-02-02T22:11:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.899+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7358009480 con 0x7f736c0f6860 2022-02-02T22:11:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.899+0000 7f73697fa700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 0x7f735c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.899+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f73580821e0 con 0x7f736c0f6860 2022-02-02T22:11:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.899+0000 7f73708f9700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 0x7f735c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.899+0000 7f73708f9700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 0x7f735c067290 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f7360004e30 tx=0x7f7360009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:18.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:18.903+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7358050220 con 0x7f736c0f6860 2022-02-02T22:11:19.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.140+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f736c027a00 con 0x7f736c0f6860 2022-02-02T22:11:19.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.140+0000 7f73697fa700 1 -- 172.21.15.96:0/1440855740 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7358053840 con 0x7f736c0f6860 2022-02-02T22:11:19.142 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:11:19.142 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:11:19.143 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:11:19.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:19.143 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:11:19.144 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:11:19.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:19.144 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:11:19.145 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:11:19.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:19.145 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:11:19.146 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:11:19.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:19.146 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:11:19.147 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:11:19.147 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:11:19.147 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:11:19.148 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:11:19.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 msgr2=0x7f735c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 0x7f735c067290 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f7360004e30 tx=0x7f7360009b30).stop 2022-02-02T22:11:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 msgr2=0x7f736c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 secure :-1 s=READY pgs=3520 cs=0 l=1 rev1=1 rx=0x7f73580026d0 tx=0x7f7358009de0).stop 2022-02-02T22:11:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 shutdown_connections 2022-02-02T22:11:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f735c064dd0 0x7f735c067290 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f736c0f55c0 0x7f736c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 --2- 172.21.15.96:0/1440855740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f736c0f6860 0x7f736c10e590 unknown :-1 s=CLOSED pgs=3520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 >> 172.21.15.96:0/1440855740 conn(0x7f736c0f0d40 msgr2=0x7f736c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 shutdown_connections 2022-02-02T22:11:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.142+0000 7f7372b5d700 1 -- 172.21.15.96:0/1440855740 wait complete. 2022-02-02T22:11:19.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 -- 172.21.15.96:0/738837980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 msgr2=0x7f03600f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 --2- 172.21.15.96:0/738837980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03600f7080 secure :-1 s=READY pgs=3521 cs=0 l=1 rev1=1 rx=0x7f0354004660 tx=0x7f0354009b30).stop 2022-02-02T22:11:19.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 -- 172.21.15.96:0/738837980 shutdown_connections 2022-02-02T22:11:19.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 --2- 172.21.15.96:0/738837980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 0x7f03600f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:11:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 --2- 172.21.15.96:0/738837980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03600f7080 unknown :-1 s=CLOSED pgs=3521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 -- 172.21.15.96:0/738837980 >> 172.21.15.96:0/738837980 conn(0x7f03600f04c0 msgr2=0x7f03600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 -- 172.21.15.96:0/738837980 shutdown_connections 2022-02-02T22:11:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.239+0000 7f0366f4f700 1 -- 172.21.15.96:0/738837980 wait complete. 2022-02-02T22:11:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 Processor -- start 2022-02-02T22:11:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 -- start start 2022-02-02T22:11:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 0x7f0360105ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360106a10 con 0x7f03600f6c60 2022-02-02T22:11:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f0366f4f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601072c0 con 0x7f03600f5970 2022-02-02T22:11:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f035ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f035ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47070/0 (socket says 172.21.15.96:47070) 2022-02-02T22:11:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.240+0000 7f035ffff700 1 -- 172.21.15.96:0/2517328005 learned_addr learned my addr 172.21.15.96:0/2517328005 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f0364ceb700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 0x7f0360105ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:19.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035ffff700 1 -- 172.21.15.96:0/2517328005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 msgr2=0x7f0360105ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035ffff700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 0x7f0360105ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035ffff700 1 -- 172.21.15.96:0/2517328005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354005040 con 0x7f03600f6c60 2022-02-02T22:11:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035ffff700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 secure :-1 s=READY pgs=3522 cs=0 l=1 rev1=1 rx=0x7f034c00d770 tx=0x7f034c00da80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f034c00e9e0 con 0x7f03600f6c60 2022-02-02T22:11:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0360107540 con 0x7f03600f6c60 2022-02-02T22:11:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f034c012070 con 0x7f03600f6c60 2022-02-02T22:11:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f034c016e80 con 0x7f03600f6c60 2022-02-02T22:11:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.241+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0360107aa0 con 0x7f03600f6c60 2022-02-02T22:11:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.242+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360045ad0 con 0x7f03600f6c60 2022-02-02T22:11:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.243+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f034c01e070 con 0x7f03600f6c60 2022-02-02T22:11:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.243+0000 7f035d7fa700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 0x7f0350067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.243+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f034c083c50 con 0x7f03600f6c60 2022-02-02T22:11:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.243+0000 7f0364ceb700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 0x7f0350067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:19.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.244+0000 7f0364ceb700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 0x7f0350067290 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f0354004580 tx=0x7f0354009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:19.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.247+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f034c055720 con 0x7f03600f6c60 2022-02-02T22:11:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.448+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0360108140 con 0x7f03600f6c60 2022-02-02T22:11:19.449 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:19 smithi096 ceph-mon[101353]: from='client.41148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:19.450 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1440855740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:11:19.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.448+0000 7f035d7fa700 1 -- 172.21.15.96:0/2517328005 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f034c01c720 con 0x7f03600f6c60 2022-02-02T22:11:19.451 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:11:19.451 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:11:19.452 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:11:19.452 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:11:19.453 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:19.453 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:11:19.453 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:11:19.454 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:11:19.454 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:11:19.455 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:11:19.455 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:11:19.455 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:11:19.456 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:11:19.456 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:11:19.456 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:11:19.457 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:11:19.457 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:11:19.457 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:11:19.458 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:11:19.458 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:11:19.458 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:11:19.459 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:11:19.459 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:11:19.459 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:11:19.460 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:11:19.460 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:11:19.460 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:11:19.461 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:11:19.461 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:11:19.461 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:11:19.462 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:11:19.462 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:11:19.462 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:19.463 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:19.463 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:11:19.463 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:19.464 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:19.464 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:19.464 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:19.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 msgr2=0x7f0350067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 0x7f0350067290 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f0354004580 tx=0x7f0354009b30).stop 2022-02-02T22:11:19.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 msgr2=0x7f03601063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:19.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 secure :-1 s=READY pgs=3522 cs=0 l=1 rev1=1 rx=0x7f034c00d770 tx=0x7f034c00da80).stop 2022-02-02T22:11:19.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 shutdown_connections 2022-02-02T22:11:19.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0350064dd0 0x7f0350067290 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03600f5970 0x7f0360105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 --2- 172.21.15.96:0/2517328005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600f6c60 0x7f03601063d0 unknown :-1 s=CLOSED pgs=3522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:19.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.450+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 >> 172.21.15.96:0/2517328005 conn(0x7f03600f04c0 msgr2=0x7f03600fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:19.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.451+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 shutdown_connections 2022-02-02T22:11:19.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:19.451+0000 7f0366f4f700 1 -- 172.21.15.96:0/2517328005 wait complete. 2022-02-02T22:11:19.469 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:11:19.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:19 smithi159 ceph-mon[69013]: from='client.41148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1440855740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:11:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:20 smithi159 ceph-mon[69013]: from='client.41152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:20.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:20 smithi159 ceph-mon[69013]: pgmap v6876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:20.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2517328005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:11:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:20 smithi096 ceph-mon[101353]: from='client.41152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:20 smithi096 ceph-mon[101353]: pgmap v6876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2517328005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:11:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:22 smithi159 ceph-mon[69013]: pgmap v6877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:22 smithi096 ceph-mon[101353]: pgmap v6877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:24 smithi159 ceph-mon[69013]: pgmap v6878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:24 smithi096 ceph-mon[101353]: pgmap v6878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:26.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:26 smithi159 ceph-mon[69013]: pgmap v6879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:26 smithi096 ceph-mon[101353]: pgmap v6879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:28 smithi159 ceph-mon[69013]: pgmap v6880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:11:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:11:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:28 smithi096 ceph-mon[101353]: pgmap v6880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:11:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:11:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:30 smithi159 ceph-mon[69013]: pgmap v6881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:30 smithi096 ceph-mon[101353]: pgmap v6881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:32 smithi096 ceph-mon[101353]: pgmap v6882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:32 smithi159 ceph-mon[69013]: pgmap v6882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:34 smithi096 ceph-mon[101353]: pgmap v6883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:34 smithi159 ceph-mon[69013]: pgmap v6883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:36 smithi096 ceph-mon[101353]: pgmap v6884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:36 smithi159 ceph-mon[69013]: pgmap v6884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:38 smithi096 ceph-mon[101353]: pgmap v6885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:38 smithi159 ceph-mon[69013]: pgmap v6885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:40 smithi096 ceph-mon[101353]: pgmap v6886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:40 smithi159 ceph-mon[69013]: pgmap v6886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:42 smithi096 ceph-mon[101353]: pgmap v6887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:42 smithi159 ceph-mon[69013]: pgmap v6887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:44 smithi096 ceph-mon[101353]: pgmap v6888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:44 smithi159 ceph-mon[69013]: pgmap v6888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:46 smithi096 ceph-mon[101353]: pgmap v6889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:46 smithi159 ceph-mon[69013]: pgmap v6889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:48 smithi096 ceph-mon[101353]: pgmap v6890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:48 smithi159 ceph-mon[69013]: pgmap v6890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 -- 172.21.15.96:0/246820121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 msgr2=0x7f95400f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 --2- 172.21.15.96:0/246820121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400f5850 secure :-1 s=READY pgs=3523 cs=0 l=1 rev1=1 rx=0x7f9530004660 tx=0x7f9530009b30).stop 2022-02-02T22:11:49.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 -- 172.21.15.96:0/246820121 shutdown_connections 2022-02-02T22:11:49.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 --2- 172.21.15.96:0/246820121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 0x7f95400f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 --2- 172.21.15.96:0/246820121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400f5850 unknown :-1 s=CLOSED pgs=3523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.561+0000 7f953f59e700 1 -- 172.21.15.96:0/246820121 >> 172.21.15.96:0/246820121 conn(0x7f95400f0b90 msgr2=0x7f95400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 -- 172.21.15.96:0/246820121 shutdown_connections 2022-02-02T22:11:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 -- 172.21.15.96:0/246820121 wait complete. 2022-02-02T22:11:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 Processor -- start 2022-02-02T22:11:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 -- start start 2022-02-02T22:11:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 0x7f95400fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400fbf90 con 0x7f95400f5430 2022-02-02T22:11:49.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400fc0d0 con 0x7f95400f66d0 2022-02-02T22:11:49.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47086/0 (socket says 172.21.15.96:47086) 2022-02-02T22:11:49.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.562+0000 7f953e59c700 1 -- 172.21.15.96:0/3309726385 learned_addr learned my addr 172.21.15.96:0/3309726385 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:49.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 0x7f95400fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953e59c700 1 -- 172.21.15.96:0/3309726385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 msgr2=0x7f95400fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953e59c700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 0x7f95400fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953e59c700 1 -- 172.21.15.96:0/3309726385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530005040 con 0x7f95400f5430 2022-02-02T22:11:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953e59c700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x7f9530004f60 tx=0x7f9530009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9530018070 con 0x7f95400f5430 2022-02-02T22:11:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95400fc350 con 0x7f95400f5430 2022-02-02T22:11:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9530007ba0 con 0x7f95400f5430 2022-02-02T22:11:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953001c620 con 0x7f95400f5430 2022-02-02T22:11:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.563+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95400fc8b0 con 0x7f95400f5430 2022-02-02T22:11:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.564+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540045ad0 con 0x7f95400f5430 2022-02-02T22:11:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.565+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f953001d420 con 0x7f95400f5430 2022-02-02T22:11:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.565+0000 7f9536ffd700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 0x7f952c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.565+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95300838a0 con 0x7f95400f5430 2022-02-02T22:11:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.565+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 0x7f952c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.566+0000 7f953dd9b700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 0x7f952c0672e0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f9528004a70 tx=0x7f9528009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.570+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95300519a0 con 0x7f95400f5430 2022-02-02T22:11:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.746+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95400feec0 con 0x7f952c064e20 2022-02-02T22:11:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.747+0000 7f9536ffd700 1 -- 172.21.15.96:0/3309726385 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f95400feec0 con 0x7f952c064e20 2022-02-02T22:11:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 msgr2=0x7f952c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 0x7f952c0672e0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f9528004a70 tx=0x7f9528009040).stop 2022-02-02T22:11:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 msgr2=0x7f95400fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x7f9530004f60 tx=0x7f9530009b30).stop 2022-02-02T22:11:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 shutdown_connections 2022-02-02T22:11:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f952c064e20 0x7f952c0672e0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95400f5430 0x7f95400fd5b0 unknown :-1 s=CLOSED pgs=3524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 --2- 172.21.15.96:0/3309726385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95400f66d0 0x7f95400fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 >> 172.21.15.96:0/3309726385 conn(0x7f95400f0b90 msgr2=0x7f95400fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 shutdown_connections 2022-02-02T22:11:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.749+0000 7f953f59e700 1 -- 172.21.15.96:0/3309726385 wait complete. 2022-02-02T22:11:49.758 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:11:49.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 -- 172.21.15.96:0/3474955511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 msgr2=0x7f21ac0f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 --2- 172.21.15.96:0/3474955511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac0f9370 secure :-1 s=READY pgs=3525 cs=0 l=1 rev1=1 rx=0x7f219c004660 tx=0x7f219c009b30).stop 2022-02-02T22:11:49.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 -- 172.21.15.96:0/3474955511 shutdown_connections 2022-02-02T22:11:49.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 --2- 172.21.15.96:0/3474955511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac0fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 --2- 172.21.15.96:0/3474955511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac0f9370 unknown :-1 s=CLOSED pgs=3525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.846+0000 7f21b3468700 1 -- 172.21.15.96:0/3474955511 >> 172.21.15.96:0/3474955511 conn(0x7f21ac0f0d30 msgr2=0x7f21ac0f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:49.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.847+0000 7f21b3468700 1 -- 172.21.15.96:0/3474955511 shutdown_connections 2022-02-02T22:11:49.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.847+0000 7f21b3468700 1 -- 172.21.15.96:0/3474955511 wait complete. 2022-02-02T22:11:49.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.847+0000 7f21b3468700 1 Processor -- start 2022-02-02T22:11:49.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.847+0000 7f21b3468700 1 -- start start 2022-02-02T22:11:49.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b3468700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b3468700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b3468700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac107990 con 0x7f21ac060350 2022-02-02T22:11:49.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b3468700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac107ad0 con 0x7f21ac0f9860 2022-02-02T22:11:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47096/0 (socket says 172.21.15.96:47096) 2022-02-02T22:11:49.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 -- 172.21.15.96:0/2128909396 learned_addr learned my addr 172.21.15.96:0/2128909396 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:49.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 -- 172.21.15.96:0/2128909396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 msgr2=0x7f21ac1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:49.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b0a03700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:49.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 -- 172.21.15.96:0/2128909396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c005040 con 0x7f21ac060350 2022-02-02T22:11:49.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b0a03700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:11:49.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b1204700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 secure :-1 s=READY pgs=3526 cs=0 l=1 rev1=1 rx=0x7f219c009990 tx=0x7f219c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:49.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219c018070 con 0x7f21ac060350 2022-02-02T22:11:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac108410 con 0x7f21ac060350 2022-02-02T22:11:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f219c007ba0 con 0x7f21ac060350 2022-02-02T22:11:49.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.848+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219c01c3c0 con 0x7f21ac060350 2022-02-02T22:11:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.849+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac108970 con 0x7f21ac060350 2022-02-02T22:11:49.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.850+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac045ad0 con 0x7f21ac060350 2022-02-02T22:11:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.850+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f219c01d420 con 0x7f21ac060350 2022-02-02T22:11:49.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.850+0000 7f21a1ffb700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 0x7f2198067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.850+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f219c0836a0 con 0x7f21ac060350 2022-02-02T22:11:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.850+0000 7f21b0a03700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 0x7f2198067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:49.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.851+0000 7f21b0a03700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 0x7f2198067290 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f21a8009880 tx=0x7f21a800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:49.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:49.855+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f219c055170 con 0x7f21ac060350 2022-02-02T22:11:50.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.027+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ac0feff0 con 0x7f2198064dd0 2022-02-02T22:11:50.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.037+0000 7f21a1ffb700 1 -- 172.21.15.96:0/2128909396 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f21ac0feff0 con 0x7f2198064dd0 2022-02-02T22:11:50.038 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:11:50.039 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:11:50.039 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:11:50.040 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:11:50.040 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:11:50.040 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:11:50.041 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:11:50.041 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:11:50.041 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:11:50.042 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:11:50.042 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:11:50.042 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:11:50.043 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:11:50.043 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:11:50.044 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:11:50.044 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:11:50.044 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:11:50.044 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:11:50.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:11:50.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:11:50.046 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:11:50.046 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:11:50.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 msgr2=0x7f2198067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 0x7f2198067290 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f21a8009880 tx=0x7f21a800b040).stop 2022-02-02T22:11:50.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 msgr2=0x7f21ac106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 secure :-1 s=READY pgs=3526 cs=0 l=1 rev1=1 rx=0x7f219c009990 tx=0x7f219c009b30).stop 2022-02-02T22:11:50.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 shutdown_connections 2022-02-02T22:11:50.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2198064dd0 0x7f2198067290 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21ac060350 0x7f21ac106ef0 unknown :-1 s=CLOSED pgs=3526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 --2- 172.21.15.96:0/2128909396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21ac0f9860 0x7f21ac1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 >> 172.21.15.96:0/2128909396 conn(0x7f21ac0f0d30 msgr2=0x7f21ac0f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:50.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 shutdown_connections 2022-02-02T22:11:50.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.039+0000 7f21b3468700 1 -- 172.21.15.96:0/2128909396 wait complete. 2022-02-02T22:11:50.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- 172.21.15.96:0/4273375297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 msgr2=0x7fa6dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/4273375297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc0f6b00 secure :-1 s=READY pgs=3527 cs=0 l=1 rev1=1 rx=0x7fa6d0004660 tx=0x7fa6d0009b30).stop 2022-02-02T22:11:50.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- 172.21.15.96:0/4273375297 shutdown_connections 2022-02-02T22:11:50.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/4273375297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/4273375297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc0f6b00 unknown :-1 s=CLOSED pgs=3527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- 172.21.15.96:0/4273375297 >> 172.21.15.96:0/4273375297 conn(0x7fa6dc0f1e40 msgr2=0x7fa6dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:50.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- 172.21.15.96:0/4273375297 shutdown_connections 2022-02-02T22:11:50.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- 172.21.15.96:0/4273375297 wait complete. 2022-02-02T22:11:50.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 Processor -- start 2022-02-02T22:11:50.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.136+0000 7fa6e0b15700 1 -- start start 2022-02-02T22:11:50.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6e0b15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6e0b15700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6e0b15700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc107a50 con 0x7fa6dc0f66e0 2022-02-02T22:11:50.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6e0b15700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc107b90 con 0x7fa6dc0f7980 2022-02-02T22:11:50.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:51212/0 (socket says 172.21.15.96:51212) 2022-02-02T22:11:50.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 -- 172.21.15.96:0/1848432712 learned_addr learned my addr 172.21.15.96:0/1848432712 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6da59c700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 -- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 msgr2=0x7fa6dc106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 -- 172.21.15.96:0/1848432712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d0005040 con 0x7fa6dc0f7980 2022-02-02T22:11:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.137+0000 7fa6d9d9b700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa6cc0026d0 tx=0x7fa6cc009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.138+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc0079c0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.138+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc108530 con 0x7fa6dc0f7980 2022-02-02T22:11:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.138+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6dc0f7980 2022-02-02T22:11:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.138+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc0148b0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.138+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc108af0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.139+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc045ad0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.140+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa6cc007b20 con 0x7fa6dc0f7980 2022-02-02T22:11:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.140+0000 7fa6caffd700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 0x7fa6c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.140+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa6cc081990 con 0x7fa6dc0f7980 2022-02-02T22:11:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.140+0000 7fa6da59c700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 0x7fa6c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.140+0000 7fa6da59c700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 0x7fa6c4067290 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7fa6d0004630 tx=0x7fa6d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.144+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa6cc0534c0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.381+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6dc1086c0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.382+0000 7fa6caffd700 1 -- 172.21.15.96:0/1848432712 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa6dc1086c0 con 0x7fa6dc0f7980 2022-02-02T22:11:50.383 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:11:50.383 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:11:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:11:50.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:11:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:11:50.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:11:50.386 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:11:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:11:50.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:11:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:11:50.388 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:11:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:11:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:11:50.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:11:50.390 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:11:50.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.383+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 msgr2=0x7fa6c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.383+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 0x7fa6c4067290 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7fa6d0004630 tx=0x7fa6d0009b30).stop 2022-02-02T22:11:50.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 msgr2=0x7fa6dc1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa6cc0026d0 tx=0x7fa6cc009de0).stop 2022-02-02T22:11:50.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 shutdown_connections 2022-02-02T22:11:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa6c4064dd0 0x7fa6c4067290 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6dc0f66e0 0x7fa6dc106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 --2- 172.21.15.96:0/1848432712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0f7980 0x7fa6dc1074a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 >> 172.21.15.96:0/1848432712 conn(0x7fa6dc0f1e40 msgr2=0x7fa6dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:50.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 shutdown_connections 2022-02-02T22:11:50.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.384+0000 7fa6e0b15700 1 -- 172.21.15.96:0/1848432712 wait complete. 2022-02-02T22:11:50.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 -- 172.21.15.96:0/305929318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f7980 msgr2=0x7f2f200f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 --2- 172.21.15.96:0/305929318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f7980 0x7f2f200f7de0 secure :-1 s=READY pgs=3528 cs=0 l=1 rev1=1 rx=0x7f2f08004660 tx=0x7f2f08009b30).stop 2022-02-02T22:11:50.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 -- 172.21.15.96:0/305929318 shutdown_connections 2022-02-02T22:11:50.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 --2- 172.21.15.96:0/305929318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f7980 0x7f2f200f7de0 unknown :-1 s=CLOSED pgs=3528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 --2- 172.21.15.96:0/305929318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f66e0 0x7f2f200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 -- 172.21.15.96:0/305929318 >> 172.21.15.96:0/305929318 conn(0x7f2f200f1e40 msgr2=0x7f2f200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:50.483 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:50 smithi096 ceph-mon[101353]: pgmap v6891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:50.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 -- 172.21.15.96:0/305929318 shutdown_connections 2022-02-02T22:11:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.481+0000 7f2f266fa700 1 -- 172.21.15.96:0/305929318 wait complete. 2022-02-02T22:11:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 Processor -- start 2022-02-02T22:11:50.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 -- start start 2022-02-02T22:11:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f7980 0x7f2f20107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20107a00 con 0x7f2f200f66e0 2022-02-02T22:11:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f266fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20107b40 con 0x7f2f200f7980 2022-02-02T22:11:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47116/0 (socket says 172.21.15.96:47116) 2022-02-02T22:11:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f1ffff700 1 -- 172.21.15.96:0/2449616262 learned_addr learned my addr 172.21.15.96:0/2449616262 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:11:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.482+0000 7f2f1f7fe700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f7980 0x7f2f20107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1ffff700 1 -- 172.21.15.96:0/2449616262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f7980 msgr2=0x7f2f20107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1ffff700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f7980 0x7f2f20107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1ffff700 1 -- 172.21.15.96:0/2449616262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08005040 con 0x7f2f200f66e0 2022-02-02T22:11:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1ffff700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 secure :-1 s=READY pgs=3529 cs=0 l=1 rev1=1 rx=0x7f2f10002700 tx=0x7f2f10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f100079c0 con 0x7f2f200f66e0 2022-02-02T22:11:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f1000f040 con 0x7f2f200f66e0 2022-02-02T22:11:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f201084e0 con 0x7f2f200f66e0 2022-02-02T22:11:50.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f10014860 con 0x7f2f200f66e0 2022-02-02T22:11:50.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.483+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20108aa0 con 0x7f2f200f66e0 2022-02-02T22:11:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.484+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20045ad0 con 0x7f2f200f66e0 2022-02-02T22:11:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.484+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f1001b060 con 0x7f2f200f66e0 2022-02-02T22:11:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.485+0000 7f2f1cff9700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 0x7f2f0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:11:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.485+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2f10081900 con 0x7f2f200f66e0 2022-02-02T22:11:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.485+0000 7f2f1f7fe700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 0x7f2f0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:11:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.485+0000 7f2f1f7fe700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 0x7f2f0c067290 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f2f08004630 tx=0x7f2f08009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:11:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.489+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f10053430 con 0x7f2f200f66e0 2022-02-02T22:11:50.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.690+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f20027a00 con 0x7f2f200f66e0 2022-02-02T22:11:50.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.691+0000 7f2f1cff9700 1 -- 172.21.15.96:0/2449616262 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2f10019070 con 0x7f2f200f66e0 2022-02-02T22:11:50.691 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:11:50.692 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:11:50.692 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:11:50.693 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:11:50.693 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:50.693 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:11:50.694 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:11:50.694 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:11:50.694 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:11:50.695 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:11:50.695 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:11:50.695 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:11:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:11:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:11:50.697 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:11:50.697 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:11:50.698 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:11:50.698 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:11:50.698 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:11:50.699 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:11:50.699 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:11:50.699 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:11:50.700 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:11:50.700 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:11:50.700 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:11:50.701 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:11:50.701 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:11:50.701 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:11:50.702 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:11:50.702 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:11:50.703 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:11:50.703 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:11:50.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:50.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:50.704 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:11:50.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:11:50.705 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:50.705 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:50.706 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:11:50.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 msgr2=0x7f2f0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 0x7f2f0c067290 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f2f08004630 tx=0x7f2f08009b30).stop 2022-02-02T22:11:50.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 msgr2=0x7f2f20106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:11:50.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 secure :-1 s=READY pgs=3529 cs=0 l=1 rev1=1 rx=0x7f2f10002700 tx=0x7f2f10009d80).stop 2022-02-02T22:11:50.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 shutdown_connections 2022-02-02T22:11:50.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2f0c064dd0 0x7f2f0c067290 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f200f66e0 0x7f2f20106f60 unknown :-1 s=CLOSED pgs=3529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 --2- 172.21.15.96:0/2449616262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f200f7980 0x7f2f20107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:11:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.692+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 >> 172.21.15.96:0/2449616262 conn(0x7f2f200f1e40 msgr2=0x7f2f200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:11:50.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.693+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 shutdown_connections 2022-02-02T22:11:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:11:50.693+0000 7f2f266fa700 1 -- 172.21.15.96:0/2449616262 wait complete. 2022-02-02T22:11:50.711 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:11:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:50 smithi159 ceph-mon[69013]: pgmap v6891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:51.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:51 smithi159 ceph-mon[69013]: from='client.41164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:51 smithi159 ceph-mon[69013]: from='client.41168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1848432712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:11:51.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2449616262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:11:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:51 smithi096 ceph-mon[101353]: from='client.41164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:51 smithi096 ceph-mon[101353]: from='client.41168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:11:51.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1848432712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:11:51.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2449616262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:11:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:52 smithi159 ceph-mon[69013]: pgmap v6892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:52 smithi096 ceph-mon[101353]: pgmap v6892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:54 smithi159 ceph-mon[69013]: pgmap v6893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:54 smithi096 ceph-mon[101353]: pgmap v6893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:56 smithi159 ceph-mon[69013]: pgmap v6894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:56 smithi096 ceph-mon[101353]: pgmap v6894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:11:58 smithi159 ceph-mon[69013]: pgmap v6895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:11:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:11:58 smithi096 ceph-mon[101353]: pgmap v6895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:00 smithi159 ceph-mon[69013]: pgmap v6896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:00 smithi096 ceph-mon[101353]: pgmap v6896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:02 smithi159 ceph-mon[69013]: pgmap v6897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:02 smithi096 ceph-mon[101353]: pgmap v6897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:04 smithi159 ceph-mon[69013]: pgmap v6898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:04 smithi096 ceph-mon[101353]: pgmap v6898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:06 smithi159 ceph-mon[69013]: pgmap v6899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:06 smithi096 ceph-mon[101353]: pgmap v6899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:08 smithi159 ceph-mon[69013]: pgmap v6900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:08 smithi096 ceph-mon[101353]: pgmap v6900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:10 smithi159 ceph-mon[69013]: pgmap v6901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:10 smithi096 ceph-mon[101353]: pgmap v6901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:12 smithi159 ceph-mon[69013]: pgmap v6902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:12 smithi096 ceph-mon[101353]: pgmap v6902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:14 smithi159 ceph-mon[69013]: pgmap v6903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:14 smithi096 ceph-mon[101353]: pgmap v6903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:16 smithi159 ceph-mon[69013]: pgmap v6904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:16 smithi096 ceph-mon[101353]: pgmap v6904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:18 smithi159 ceph-mon[69013]: pgmap v6905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:18 smithi096 ceph-mon[101353]: pgmap v6905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:20 smithi159 ceph-mon[69013]: pgmap v6906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 -- 172.21.15.96:0/3130380747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 msgr2=0x7f143c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 --2- 172.21.15.96:0/3130380747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c0f5860 secure :-1 s=READY pgs=3530 cs=0 l=1 rev1=1 rx=0x7f142c004660 tx=0x7f142c009b30).stop 2022-02-02T22:12:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 -- 172.21.15.96:0/3130380747 shutdown_connections 2022-02-02T22:12:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 --2- 172.21.15.96:0/3130380747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 --2- 172.21.15.96:0/3130380747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c0f5860 unknown :-1 s=CLOSED pgs=3530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 -- 172.21.15.96:0/3130380747 >> 172.21.15.96:0/3130380747 conn(0x7f143c0f0ba0 msgr2=0x7f143c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:20.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 -- 172.21.15.96:0/3130380747 shutdown_connections 2022-02-02T22:12:20.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:20 smithi096 ceph-mon[101353]: pgmap v6906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:20.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.800+0000 7f1440b5b700 1 -- 172.21.15.96:0/3130380747 wait complete. 2022-02-02T22:12:20.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 Processor -- start 2022-02-02T22:12:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 -- start start 2022-02-02T22:12:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c1094f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c109aa0 con 0x7f143c0f5440 2022-02-02T22:12:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f1440b5b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c109be0 con 0x7f143c0f66e0 2022-02-02T22:12:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47134/0 (socket says 172.21.15.96:47134) 2022-02-02T22:12:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 -- 172.21.15.96:0/1852848735 learned_addr learned my addr 172.21.15.96:0/1852848735 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143affd700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c1094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 -- 172.21.15.96:0/1852848735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 msgr2=0x7f143c1094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c1094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.801+0000 7f143b7fe700 1 -- 172.21.15.96:0/1852848735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c005040 con 0x7f143c0f5440 2022-02-02T22:12:20.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f143affd700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c1094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:12:20.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f143b7fe700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 secure :-1 s=READY pgs=3531 cs=0 l=1 rev1=1 rx=0x7f142c004f60 tx=0x7f142c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:20.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142c018070 con 0x7f143c0f5440 2022-02-02T22:12:20.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c10a4d0 con 0x7f143c0f5440 2022-02-02T22:12:20.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f142c007ba0 con 0x7f143c0f5440 2022-02-02T22:12:20.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142c01c620 con 0x7f143c0f5440 2022-02-02T22:12:20.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.802+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c10aa30 con 0x7f143c0f5440 2022-02-02T22:12:20.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.803+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c045ad0 con 0x7f143c0f5440 2022-02-02T22:12:20.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.803+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f142c01c8e0 con 0x7f143c0f5440 2022-02-02T22:12:20.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.804+0000 7f1423fff700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:20.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.804+0000 7f143affd700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:20.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.804+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f142c083940 con 0x7f143c0f5440 2022-02-02T22:12:20.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.804+0000 7f143affd700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f1430004a90 tx=0x7f1430009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:20.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.808+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f142c055470 con 0x7f143c0f5440 2022-02-02T22:12:20.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.984+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f143c0fa920 con 0x7f1424064e20 2022-02-02T22:12:20.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.986+0000 7f1423fff700 1 -- 172.21.15.96:0/1852848735 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f143c0fa920 con 0x7f1424064e20 2022-02-02T22:12:20.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.987+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 msgr2=0x7f14240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.987+0000 7f1440b5b700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f1430004a90 tx=0x7f1430009040).stop 2022-02-02T22:12:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.987+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 msgr2=0x7f143c109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:20.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.987+0000 7f1440b5b700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 secure :-1 s=READY pgs=3531 cs=0 l=1 rev1=1 rx=0x7f142c004f60 tx=0x7f142c009b30).stop 2022-02-02T22:12:20.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 shutdown_connections 2022-02-02T22:12:20.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1424064e20 0x7f14240672e0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f143c0f5440 0x7f143c109000 unknown :-1 s=CLOSED pgs=3531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 --2- 172.21.15.96:0/1852848735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f143c0f66e0 0x7f143c1094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:20.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 >> 172.21.15.96:0/1852848735 conn(0x7f143c0f0ba0 msgr2=0x7f143c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:20.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 shutdown_connections 2022-02-02T22:12:20.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:20.988+0000 7f1440b5b700 1 -- 172.21.15.96:0/1852848735 wait complete. 2022-02-02T22:12:20.997 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:12:21.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 -- 172.21.15.96:0/2421589767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f6c60 msgr2=0x7fd00c0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 --2- 172.21.15.96:0/2421589767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f6c60 0x7fd00c0f7080 secure :-1 s=READY pgs=3532 cs=0 l=1 rev1=1 rx=0x7fcffc004660 tx=0x7fcffc009b30).stop 2022-02-02T22:12:21.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 -- 172.21.15.96:0/2421589767 shutdown_connections 2022-02-02T22:12:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 --2- 172.21.15.96:0/2421589767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f5970 0x7fd00c0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 --2- 172.21.15.96:0/2421589767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f6c60 0x7fd00c0f7080 unknown :-1 s=CLOSED pgs=3532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.085+0000 7fd013868700 1 -- 172.21.15.96:0/2421589767 >> 172.21.15.96:0/2421589767 conn(0x7fd00c0f04c0 msgr2=0x7fd00c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 -- 172.21.15.96:0/2421589767 shutdown_connections 2022-02-02T22:12:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 -- 172.21.15.96:0/2421589767 wait complete. 2022-02-02T22:12:21.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 Processor -- start 2022-02-02T22:12:21.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 -- start start 2022-02-02T22:12:21.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f6c60 0x7fd00c10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0f5620 con 0x7fd00c0f5970 2022-02-02T22:12:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.086+0000 7fd013868700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0f5760 con 0x7fd00c0f6c60 2022-02-02T22:12:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47144/0 (socket says 172.21.15.96:47144) 2022-02-02T22:12:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 -- 172.21.15.96:0/1303565102 learned_addr learned my addr 172.21.15.96:0/1303565102 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd010e03700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f6c60 0x7fd00c10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 -- 172.21.15.96:0/1303565102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f6c60 msgr2=0x7fd00c10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f6c60 0x7fd00c10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 -- 172.21.15.96:0/1303565102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc005040 con 0x7fd00c0f5970 2022-02-02T22:12:21.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd011604700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 secure :-1 s=READY pgs=3533 cs=0 l=1 rev1=1 rx=0x7fcffc009990 tx=0x7fcffc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcffc018070 con 0x7fd00c0f5970 2022-02-02T22:12:21.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c10c700 con 0x7fd00c0f5970 2022-02-02T22:12:21.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcffc007ba0 con 0x7fd00c0f5970 2022-02-02T22:12:21.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcffc01c3c0 con 0x7fd00c0f5970 2022-02-02T22:12:21.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.087+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c10cc60 con 0x7fd00c0f5970 2022-02-02T22:12:21.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.088+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c045ad0 con 0x7fd00c0f5970 2022-02-02T22:12:21.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.089+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcffc01d420 con 0x7fd00c0f5970 2022-02-02T22:12:21.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.089+0000 7fd001ffb700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 0x7fcff8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.089+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcffc083770 con 0x7fd00c0f5970 2022-02-02T22:12:21.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.089+0000 7fd010e03700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 0x7fcff8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.090+0000 7fd010e03700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 0x7fcff8067290 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fd0080041d0 tx=0x7fd008009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.094+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcffc051870 con 0x7fd00c0f5970 2022-02-02T22:12:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.265+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd00c0fdf20 con 0x7fcff8064dd0 2022-02-02T22:12:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.274+0000 7fd001ffb700 1 -- 172.21.15.96:0/1303565102 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd00c0fdf20 con 0x7fcff8064dd0 2022-02-02T22:12:21.274 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:12:21.274 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:12:21.275 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:12:21.275 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:12:21.276 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:12:21.276 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:12:21.276 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:12:21.277 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:12:21.277 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:12:21.278 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:12:21.278 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:12:21.279 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:12:21.279 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:12:21.280 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:12:21.280 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:12:21.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:12:21.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:12:21.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:12:21.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:12:21.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:12:21.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:12:21.283 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:12:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 msgr2=0x7fcff8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 0x7fcff8067290 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fd0080041d0 tx=0x7fd008009040).stop 2022-02-02T22:12:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 msgr2=0x7fd00c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 secure :-1 s=READY pgs=3533 cs=0 l=1 rev1=1 rx=0x7fcffc009990 tx=0x7fcffc009b30).stop 2022-02-02T22:12:21.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 shutdown_connections 2022-02-02T22:12:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcff8064dd0 0x7fcff8067290 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd00c0f5970 0x7fd00c109cb0 unknown :-1 s=CLOSED pgs=3533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 --2- 172.21.15.96:0/1303565102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd00c0f6c60 0x7fd00c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 >> 172.21.15.96:0/1303565102 conn(0x7fd00c0f04c0 msgr2=0x7fd00c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 shutdown_connections 2022-02-02T22:12:21.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.276+0000 7fd013868700 1 -- 172.21.15.96:0/1303565102 wait complete. 2022-02-02T22:12:21.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 -- 172.21.15.96:0/3435470290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 msgr2=0x7f42e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 --2- 172.21.15.96:0/3435470290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e40f59e0 secure :-1 s=READY pgs=3534 cs=0 l=1 rev1=1 rx=0x7f42d4004660 tx=0x7f42d4009b30).stop 2022-02-02T22:12:21.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 -- 172.21.15.96:0/3435470290 shutdown_connections 2022-02-02T22:12:21.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 --2- 172.21.15.96:0/3435470290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 0x7f42e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:12:21.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 --2- 172.21.15.96:0/3435470290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e40f59e0 unknown :-1 s=CLOSED pgs=3534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 -- 172.21.15.96:0/3435470290 >> 172.21.15.96:0/3435470290 conn(0x7f42e40f0d40 msgr2=0x7f42e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 -- 172.21.15.96:0/3435470290 shutdown_connections 2022-02-02T22:12:21.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 -- 172.21.15.96:0/3435470290 wait complete. 2022-02-02T22:12:21.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.373+0000 7f42ea435700 1 Processor -- start 2022-02-02T22:12:21.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42ea435700 1 -- start start 2022-02-02T22:12:21.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42ea435700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42ea435700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 0x7f42e410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42ea435700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40604b0 con 0x7f42e40f55c0 2022-02-02T22:12:21.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42ea435700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40605f0 con 0x7f42e40f6860 2022-02-02T22:12:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47152/0 (socket says 172.21.15.96:47152) 2022-02-02T22:12:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.374+0000 7f42e3fff700 1 -- 172.21.15.96:0/70511356 learned_addr learned my addr 172.21.15.96:0/70511356 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e37fe700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 0x7f42e410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e3fff700 1 -- 172.21.15.96:0/70511356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 msgr2=0x7f42e410c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e3fff700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 0x7f42e410c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e3fff700 1 -- 172.21.15.96:0/70511356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4005040 con 0x7f42e40f55c0 2022-02-02T22:12:21.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e3fff700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 secure :-1 s=READY pgs=3535 cs=0 l=1 rev1=1 rx=0x7f42d4004f60 tx=0x7f42d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d4018070 con 0x7f42e40f55c0 2022-02-02T22:12:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42d4007ba0 con 0x7f42e40f55c0 2022-02-02T22:12:21.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e410c780 con 0x7f42e40f55c0 2022-02-02T22:12:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d401c620 con 0x7f42e40f55c0 2022-02-02T22:12:21.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.375+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e410cce0 con 0x7f42e40f55c0 2022-02-02T22:12:21.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.376+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4045ad0 con 0x7f42e40f55c0 2022-02-02T22:12:21.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.377+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42d401c8e0 con 0x7f42e40f55c0 2022-02-02T22:12:21.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.377+0000 7f42e0ff9700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 0x7f42d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.377+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42d4083960 con 0x7f42e40f55c0 2022-02-02T22:12:21.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.377+0000 7f42e37fe700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 0x7f42d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.377+0000 7f42e37fe700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 0x7f42d0067290 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f42cc00b790 tx=0x7f42cc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.381+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42d4051a60 con 0x7f42e40f55c0 2022-02-02T22:12:21.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.611+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42e4027a00 con 0x7f42e40f55c0 2022-02-02T22:12:21.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.611+0000 7f42e0ff9700 1 -- 172.21.15.96:0/70511356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f42d4055080 con 0x7f42e40f55c0 2022-02-02T22:12:21.612 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:12:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:12:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:12:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:12:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:12:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:12:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:12:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:12:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:12:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:12:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:12:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:12:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:12:21.623 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:12:21.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 msgr2=0x7f42d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 0x7f42d0067290 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f42cc00b790 tx=0x7f42cc008040).stop 2022-02-02T22:12:21.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 msgr2=0x7f42e4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 secure :-1 s=READY pgs=3535 cs=0 l=1 rev1=1 rx=0x7f42d4004f60 tx=0x7f42d4009b30).stop 2022-02-02T22:12:21.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 shutdown_connections 2022-02-02T22:12:21.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f42d0064dd0 0x7f42d0067290 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40f55c0 0x7f42e4109c80 unknown :-1 s=CLOSED pgs=3535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 --2- 172.21.15.96:0/70511356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42e40f6860 0x7f42e410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 >> 172.21.15.96:0/70511356 conn(0x7f42e40f0d40 msgr2=0x7f42e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 shutdown_connections 2022-02-02T22:12:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.613+0000 7f42ea435700 1 -- 172.21.15.96:0/70511356 wait complete. 2022-02-02T22:12:21.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 -- 172.21.15.96:0/223914024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 msgr2=0x7f50440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 --2- 172.21.15.96:0/223914024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 0x7f50440f6b00 secure :-1 s=READY pgs=3536 cs=0 l=1 rev1=1 rx=0x7f5034004660 tx=0x7f5034009b30).stop 2022-02-02T22:12:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 -- 172.21.15.96:0/223914024 shutdown_connections 2022-02-02T22:12:21.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 --2- 172.21.15.96:0/223914024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f7980 0x7f50440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 --2- 172.21.15.96:0/223914024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f66e0 0x7f50440f6b00 unknown :-1 s=CLOSED pgs=3536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 -- 172.21.15.96:0/223914024 >> 172.21.15.96:0/223914024 conn(0x7f50440f1e40 msgr2=0x7f50440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 -- 172.21.15.96:0/223914024 shutdown_connections 2022-02-02T22:12:21.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.711+0000 7f504c798700 1 -- 172.21.15.96:0/223914024 wait complete. 2022-02-02T22:12:21.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 Processor -- start 2022-02-02T22:12:21.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 -- start start 2022-02-02T22:12:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f5044104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044105810 con 0x7f50440f7980 2022-02-02T22:12:21.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504c798700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044105950 con 0x7f50440f66e0 2022-02-02T22:12:21.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47164/0 (socket says 172.21.15.96:47164) 2022-02-02T22:12:21.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 -- 172.21.15.96:0/3061532618 learned_addr learned my addr 172.21.15.96:0/3061532618 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:21.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f504a534700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f5044104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 -- 172.21.15.96:0/3061532618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 msgr2=0x7f5044104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f5044104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 -- 172.21.15.96:0/3061532618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034005040 con 0x7f50440f7980 2022-02-02T22:12:21.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.712+0000 7f5049d33700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 secure :-1 s=READY pgs=3537 cs=0 l=1 rev1=1 rx=0x7f504000c530 tx=0x7f5040007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.714+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504000f650 con 0x7f50440f7980 2022-02-02T22:12:21.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.714+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f504000fc60 con 0x7f50440f7980 2022-02-02T22:12:21.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.714+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50441062e0 con 0x7f50440f7980 2022-02-02T22:12:21.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.714+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50441068a0 con 0x7f50440f7980 2022-02-02T22:12:21.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.715+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5040012cd0 con 0x7f50440f7980 2022-02-02T22:12:21.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.715+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5040010070 con 0x7f50440f7980 2022-02-02T22:12:21.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.715+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5044045ad0 con 0x7f50440f7980 2022-02-02T22:12:21.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.715+0000 7f503affd700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:21.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.716+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50400826c0 con 0x7f50440f7980 2022-02-02T22:12:21.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.716+0000 7f504a534700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:21.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.716+0000 7f504a534700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f5034004e30 tx=0x7f5034009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:21.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.720+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50400477d0 con 0x7f50440f7980 2022-02-02T22:12:21.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.922+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50440ff020 con 0x7f50440f7980 2022-02-02T22:12:21.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.922+0000 7f503affd700 1 -- 172.21.15.96:0/3061532618 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f50400507c0 con 0x7f50440f7980 2022-02-02T22:12:21.923 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:12:21.923 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:12:21.924 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:12:21.924 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:12:21.924 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:21.925 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:12:21.925 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:12:21.925 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:12:21.926 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:12:21.926 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:12:21.926 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:12:21.927 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:12:21.927 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:12:21.928 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:12:21.928 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:12:21.928 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:12:21.929 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:12:21.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:12:21.929 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:12:21.930 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:12:21.930 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:12:21.931 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:12:21.931 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:12:21.931 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:12:21.932 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:12:21.932 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:12:21.932 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:12:21.933 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:12:21.933 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:12:21.934 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:12:21.934 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:12:21.934 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:12:21.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:21.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:21.935 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:12:21.936 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:21.936 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:21.936 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:21.937 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 msgr2=0x7f5030067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f5034004e30 tx=0x7f5034009b30).stop 2022-02-02T22:12:21.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 msgr2=0x7f5044105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:21.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 secure :-1 s=READY pgs=3537 cs=0 l=1 rev1=1 rx=0x7f504000c530 tx=0x7f5040007e20).stop 2022-02-02T22:12:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 shutdown_connections 2022-02-02T22:12:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5030064dd0 0x7f5030067290 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50440f66e0 0x7f5044104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 --2- 172.21.15.96:0/3061532618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50440f7980 0x7f5044105210 unknown :-1 s=CLOSED pgs=3537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 >> 172.21.15.96:0/3061532618 conn(0x7f50440f1e40 msgr2=0x7f504406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 shutdown_connections 2022-02-02T22:12:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:21.924+0000 7f504c798700 1 -- 172.21.15.96:0/3061532618 wait complete. 2022-02-02T22:12:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:12:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:22 smithi159 ceph-mon[69013]: pgmap v6907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:22 smithi159 ceph-mon[69013]: from='client.41180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:22 smithi159 ceph-mon[69013]: from='client.41184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/70511356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:12:22.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:22 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3061532618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:12:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:22 smithi096 ceph-mon[101353]: pgmap v6907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:22 smithi096 ceph-mon[101353]: from='client.41180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:22 smithi096 ceph-mon[101353]: from='client.41184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:22.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/70511356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:12:22.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:22 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3061532618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:12:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:24 smithi159 ceph-mon[69013]: pgmap v6908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:24 smithi096 ceph-mon[101353]: pgmap v6908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:26 smithi159 ceph-mon[69013]: pgmap v6909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:26 smithi096 ceph-mon[101353]: pgmap v6909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:28 smithi159 ceph-mon[69013]: pgmap v6910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:12:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:12:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:28 smithi096 ceph-mon[101353]: pgmap v6910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:12:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:12:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:30 smithi159 ceph-mon[69013]: pgmap v6911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:30 smithi096 ceph-mon[101353]: pgmap v6911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:32 smithi159 ceph-mon[69013]: pgmap v6912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:32 smithi096 ceph-mon[101353]: pgmap v6912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:34 smithi159 ceph-mon[69013]: pgmap v6913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:34 smithi096 ceph-mon[101353]: pgmap v6913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:36 smithi159 ceph-mon[69013]: pgmap v6914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:36 smithi096 ceph-mon[101353]: pgmap v6914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:38 smithi159 ceph-mon[69013]: pgmap v6915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:38 smithi096 ceph-mon[101353]: pgmap v6915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:40 smithi159 ceph-mon[69013]: pgmap v6916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:40 smithi096 ceph-mon[101353]: pgmap v6916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:42 smithi159 ceph-mon[69013]: pgmap v6917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:42 smithi096 ceph-mon[101353]: pgmap v6917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:44 smithi159 ceph-mon[69013]: pgmap v6918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:44 smithi096 ceph-mon[101353]: pgmap v6918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:46 smithi159 ceph-mon[69013]: pgmap v6919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:46 smithi096 ceph-mon[101353]: pgmap v6919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:48 smithi159 ceph-mon[69013]: pgmap v6920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:48 smithi096 ceph-mon[101353]: pgmap v6920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:50 smithi159 ceph-mon[69013]: pgmap v6921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:50 smithi096 ceph-mon[101353]: pgmap v6921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 -- 172.21.15.96:0/2123960333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f6860 msgr2=0x7f22300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 --2- 172.21.15.96:0/2123960333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f6860 0x7f22300f6cc0 secure :-1 s=READY pgs=3538 cs=0 l=1 rev1=1 rx=0x7f222c004660 tx=0x7f222c009b30).stop 2022-02-02T22:12:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 -- 172.21.15.96:0/2123960333 shutdown_connections 2022-02-02T22:12:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 --2- 172.21.15.96:0/2123960333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f6860 0x7f22300f6cc0 unknown :-1 s=CLOSED pgs=3538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 --2- 172.21.15.96:0/2123960333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f55c0 0x7f22300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 -- 172.21.15.96:0/2123960333 >> 172.21.15.96:0/2123960333 conn(0x7f22300f0d40 msgr2=0x7f22300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 -- 172.21.15.96:0/2123960333 shutdown_connections 2022-02-02T22:12:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.033+0000 7f223866b700 1 -- 172.21.15.96:0/2123960333 wait complete. 2022-02-02T22:12:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 Processor -- start 2022-02-02T22:12:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 -- start start 2022-02-02T22:12:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f6860 0x7f223010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300602b0 con 0x7f22300f55c0 2022-02-02T22:12:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f223866b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300603f0 con 0x7f22300f6860 2022-02-02T22:12:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f2236407700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f2236407700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47182/0 (socket says 172.21.15.96:47182) 2022-02-02T22:12:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f2236407700 1 -- 172.21.15.96:0/3128234726 learned_addr learned my addr 172.21.15.96:0/3128234726 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.034+0000 7f2235c06700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f6860 0x7f223010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2236407700 1 -- 172.21.15.96:0/3128234726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f6860 msgr2=0x7f223010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2236407700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f6860 0x7f223010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2236407700 1 -- 172.21.15.96:0/3128234726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c005040 con 0x7f22300f55c0 2022-02-02T22:12:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2236407700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 secure :-1 s=READY pgs=3539 cs=0 l=1 rev1=1 rx=0x7f2224002700 tx=0x7f2224009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22240079c0 con 0x7f22300f55c0 2022-02-02T22:12:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f222400f040 con 0x7f22300f55c0 2022-02-02T22:12:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223010ea60 con 0x7f22300f55c0 2022-02-02T22:12:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2224014860 con 0x7f22300f55c0 2022-02-02T22:12:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.035+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223010eee0 con 0x7f22300f55c0 2022-02-02T22:12:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.036+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2230045ad0 con 0x7f22300f55c0 2022-02-02T22:12:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.037+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f222401b060 con 0x7f22300f55c0 2022-02-02T22:12:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.037+0000 7f2222ffd700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 0x7f221c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.037+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22240818f0 con 0x7f22300f55c0 2022-02-02T22:12:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.037+0000 7f2235c06700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 0x7f221c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.037+0000 7f2235c06700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 0x7f221c067290 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f222c004630 tx=0x7f222c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.041+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f222404f9f0 con 0x7f22300f55c0 2022-02-02T22:12:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.218+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2230057f10 con 0x7f221c064dd0 2022-02-02T22:12:52.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.219+0000 7f2222ffd700 1 -- 172.21.15.96:0/3128234726 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2230057f10 con 0x7f221c064dd0 2022-02-02T22:12:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.220+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 msgr2=0x7f221c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.220+0000 7f223866b700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 0x7f221c067290 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f222c004630 tx=0x7f222c009b30).stop 2022-02-02T22:12:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.220+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 msgr2=0x7f223010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.220+0000 7f223866b700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 secure :-1 s=READY pgs=3539 cs=0 l=1 rev1=1 rx=0x7f2224002700 tx=0x7f2224009d80).stop 2022-02-02T22:12:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 shutdown_connections 2022-02-02T22:12:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f221c064dd0 0x7f221c067290 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22300f55c0 0x7f223010c070 unknown :-1 s=CLOSED pgs=3539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 --2- 172.21.15.96:0/3128234726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22300f6860 0x7f223010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 >> 172.21.15.96:0/3128234726 conn(0x7f22300f0d40 msgr2=0x7f22300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 shutdown_connections 2022-02-02T22:12:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.221+0000 7f223866b700 1 -- 172.21.15.96:0/3128234726 wait complete. 2022-02-02T22:12:52.231 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:12:52.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/4265092014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 msgr2=0x7fcf440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/4265092014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf440f6950 secure :-1 s=READY pgs=3540 cs=0 l=1 rev1=1 rx=0x7fcf34004660 tx=0x7fcf34009b30).stop 2022-02-02T22:12:52.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/4265092014 shutdown_connections 2022-02-02T22:12:52.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/4265092014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/4265092014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf440f6950 unknown :-1 s=CLOSED pgs=3540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/4265092014 >> 172.21.15.96:0/4265092014 conn(0x7fcf440f1c90 msgr2=0x7fcf440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/4265092014 shutdown_connections 2022-02-02T22:12:52.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.318+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/4265092014 wait complete. 2022-02-02T22:12:52.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 Processor -- start 2022-02-02T22:12:52.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 -- start start 2022-02-02T22:12:52.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf44107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44107910 con 0x7fcf440f6530 2022-02-02T22:12:52.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4b1ea700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44108120 con 0x7fcf440f77d0 2022-02-02T22:12:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47192/0 (socket says 172.21.15.96:47192) 2022-02-02T22:12:52.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 -- 172.21.15.96:0/778826396 learned_addr learned my addr 172.21.15.96:0/778826396 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf499e7700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf44107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 -- 172.21.15.96:0/778826396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 msgr2=0x7fcf44107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf44107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 -- 172.21.15.96:0/778826396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34005040 con 0x7fcf440f6530 2022-02-02T22:12:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf499e7700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf44107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:12:52.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.319+0000 7fcf4a1e8700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 secure :-1 s=READY pgs=3541 cs=0 l=1 rev1=1 rx=0x7fcf34013a70 tx=0x7fcf34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.320+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf34018070 con 0x7fcf440f6530 2022-02-02T22:12:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.320+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf340097d0 con 0x7fcf440f6530 2022-02-02T22:12:52.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.320+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf44108340 con 0x7fcf440f6530 2022-02-02T22:12:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.320+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3401c3c0 con 0x7fcf440f6530 2022-02-02T22:12:52.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.320+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf441088a0 con 0x7fcf440f6530 2022-02-02T22:12:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.321+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44059100 con 0x7fcf440f6530 2022-02-02T22:12:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.321+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf34007ba0 con 0x7fcf440f6530 2022-02-02T22:12:52.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.321+0000 7fcf3affd700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 0x7fcf300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.322+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf34083740 con 0x7fcf440f6530 2022-02-02T22:12:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.322+0000 7fcf499e7700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 0x7fcf300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.322+0000 7fcf499e7700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 0x7fcf300672e0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7fcf40009740 tx=0x7fcf40009c20).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.326+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf34051900 con 0x7fcf440f6530 2022-02-02T22:12:52.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.500+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf440fed10 con 0x7fcf30064e20 2022-02-02T22:12:52.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.509+0000 7fcf3affd700 1 -- 172.21.15.96:0/778826396 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcf440fed10 con 0x7fcf30064e20 2022-02-02T22:12:52.511 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:12:52.511 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:12:52.511 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:12:52.512 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:12:52.512 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:12:52.512 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:12:52.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:12:52.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:12:52.513 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:12:52.514 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:12:52.514 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:12:52.514 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:12:52.515 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:12:52.515 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:12:52.515 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:12:52.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:12:52.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:12:52.516 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:12:52.517 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:12:52.517 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:12:52.517 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:12:52.518 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:12:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 msgr2=0x7fcf300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 0x7fcf300672e0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7fcf40009740 tx=0x7fcf40009c20).stop 2022-02-02T22:12:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 msgr2=0x7fcf44106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 secure :-1 s=READY pgs=3541 cs=0 l=1 rev1=1 rx=0x7fcf34013a70 tx=0x7fcf34009b30).stop 2022-02-02T22:12:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 shutdown_connections 2022-02-02T22:12:52.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf30064e20 0x7fcf300672e0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf440f6530 0x7fcf44106e20 unknown :-1 s=CLOSED pgs=3541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 --2- 172.21.15.96:0/778826396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf440f77d0 0x7fcf44107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 >> 172.21.15.96:0/778826396 conn(0x7fcf440f1c90 msgr2=0x7fcf440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.511+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 shutdown_connections 2022-02-02T22:12:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.512+0000 7fcf4b1ea700 1 -- 172.21.15.96:0/778826396 wait complete. 2022-02-02T22:12:52.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.607+0000 7fc837fff700 1 -- 172.21.15.96:0/3504630510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f6530 msgr2=0x7fc8380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.607+0000 7fc837fff700 1 --2- 172.21.15.96:0/3504630510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f6530 0x7fc8380f6950 secure :-1 s=READY pgs=3542 cs=0 l=1 rev1=1 rx=0x7fc8300099e0 tx=0x7fc830004d10).stop 2022-02-02T22:12:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 -- 172.21.15.96:0/3504630510 shutdown_connections 2022-02-02T22:12:52.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 --2- 172.21.15.96:0/3504630510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f77d0 0x7fc8380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 --2- 172.21.15.96:0/3504630510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f6530 0x7fc8380f6950 unknown :-1 s=CLOSED pgs=3542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 -- 172.21.15.96:0/3504630510 >> 172.21.15.96:0/3504630510 conn(0x7fc8380f1c90 msgr2=0x7fc8380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:52 smithi096 ceph-mon[101353]: pgmap v6922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:52.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 -- 172.21.15.96:0/3504630510 shutdown_connections 2022-02-02T22:12:52.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.608+0000 7fc837fff700 1 -- 172.21.15.96:0/3504630510 wait complete. 2022-02-02T22:12:52.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 Processor -- start 2022-02-02T22:12:52.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 -- start start 2022-02-02T22:12:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f6530 0x7fc83806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83806a380 con 0x7fc8380f77d0 2022-02-02T22:12:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc837fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83806a4c0 con 0x7fc8380f6530 2022-02-02T22:12:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc8367fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc8367fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47204/0 (socket says 172.21.15.96:47204) 2022-02-02T22:12:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.609+0000 7fc8367fc700 1 -- 172.21.15.96:0/2993283749 learned_addr learned my addr 172.21.15.96:0/2993283749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc836ffd700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f6530 0x7fc83806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc8367fc700 1 -- 172.21.15.96:0/2993283749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f6530 msgr2=0x7fc83806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc8367fc700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f6530 0x7fc83806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc8367fc700 1 -- 172.21.15.96:0/2993283749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009640 con 0x7fc8380f77d0 2022-02-02T22:12:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc8367fc700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 secure :-1 s=READY pgs=3543 cs=0 l=1 rev1=1 rx=0x7fc82c00c530 tx=0x7fc82c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc82c00f650 con 0x7fc8380f77d0 2022-02-02T22:12:52.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83806a7a0 con 0x7fc8380f77d0 2022-02-02T22:12:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc82c00fc60 con 0x7fc8380f77d0 2022-02-02T22:12:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc82c012c20 con 0x7fc8380f77d0 2022-02-02T22:12:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.610+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83810eec0 con 0x7fc8380f77d0 2022-02-02T22:12:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.611+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc838045ad0 con 0x7fc8380f77d0 2022-02-02T22:12:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.612+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc82c010070 con 0x7fc8380f77d0 2022-02-02T22:12:52.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.612+0000 7fc81f7fe700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 0x7fc8200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.612+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc82c081640 con 0x7fc8380f77d0 2022-02-02T22:12:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.612+0000 7fc836ffd700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 0x7fc8200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.612+0000 7fc836ffd700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 0x7fc8200672e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fc8300099b0 tx=0x7fc830004d10).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.616+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc82c0477d0 con 0x7fc8380f77d0 2022-02-02T22:12:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:52 smithi159 ceph-mon[69013]: pgmap v6922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:52.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.843+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc838027a00 con 0x7fc8380f77d0 2022-02-02T22:12:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.844+0000 7fc81f7fe700 1 -- 172.21.15.96:0/2993283749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc82c04f740 con 0x7fc8380f77d0 2022-02-02T22:12:52.845 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:12:52.846 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:12:52.846 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:12:52.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:52.847 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:12:52.847 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:12:52.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:52.848 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:12:52.848 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:12:52.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:52.849 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:12:52.849 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:12:52.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:12:52.850 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:12:52.850 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:12:52.851 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:12:52.851 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:12:52.851 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:12:52.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 msgr2=0x7fc8200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 0x7fc8200672e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fc8300099b0 tx=0x7fc830004d10).stop 2022-02-02T22:12:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 msgr2=0x7fc838069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 secure :-1 s=READY pgs=3543 cs=0 l=1 rev1=1 rx=0x7fc82c00c530 tx=0x7fc82c007e20).stop 2022-02-02T22:12:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 shutdown_connections 2022-02-02T22:12:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc820064e20 0x7fc8200672e0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8380f6530 0x7fc83806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 --2- 172.21.15.96:0/2993283749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8380f77d0 0x7fc838069e20 unknown :-1 s=CLOSED pgs=3543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 >> 172.21.15.96:0/2993283749 conn(0x7fc8380f1c90 msgr2=0x7fc8380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 shutdown_connections 2022-02-02T22:12:52.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.846+0000 7fc837fff700 1 -- 172.21.15.96:0/2993283749 wait complete. 2022-02-02T22:12:52.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 -- 172.21.15.96:0/588061678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 msgr2=0x7f53c80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 --2- 172.21.15.96:0/588061678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c80f5a00 secure :-1 s=READY pgs=3544 cs=0 l=1 rev1=1 rx=0x7f53bc004660 tx=0x7f53bc009b30).stop 2022-02-02T22:12:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 -- 172.21.15.96:0/588061678 shutdown_connections 2022-02-02T22:12:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 --2- 172.21.15.96:0/588061678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:12:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 --2- 172.21.15.96:0/588061678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c80f5a00 unknown :-1 s=CLOSED pgs=3544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 -- 172.21.15.96:0/588061678 >> 172.21.15.96:0/588061678 conn(0x7f53c80f0de0 msgr2=0x7f53c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 -- 172.21.15.96:0/588061678 shutdown_connections 2022-02-02T22:12:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.944+0000 7f53ced08700 1 -- 172.21.15.96:0/588061678 wait complete. 2022-02-02T22:12:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 Processor -- start 2022-02-02T22:12:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 -- start start 2022-02-02T22:12:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8060590 con 0x7f53c80f55e0 2022-02-02T22:12:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ced08700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80606d0 con 0x7f53c80f5ef0 2022-02-02T22:12:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ccaa4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ccaa4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47212/0 (socket says 172.21.15.96:47212) 2022-02-02T22:12:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.945+0000 7f53ccaa4700 1 -- 172.21.15.96:0/2404513096 learned_addr learned my addr 172.21.15.96:0/2404513096 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:12:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53c7fff700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ccaa4700 1 -- 172.21.15.96:0/2404513096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 msgr2=0x7f53c810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ccaa4700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ccaa4700 1 -- 172.21.15.96:0/2404513096 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc005040 con 0x7f53c80f55e0 2022-02-02T22:12:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53c7fff700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:12:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ccaa4700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 secure :-1 s=READY pgs=3545 cs=0 l=1 rev1=1 rx=0x7f53bc009990 tx=0x7f53bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53bc018070 con 0x7f53c80f55e0 2022-02-02T22:12:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f53bc007ca0 con 0x7f53c80f55e0 2022-02-02T22:12:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53bc01c620 con 0x7f53c80f55e0 2022-02-02T22:12:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c810c770 con 0x7f53c80f55e0 2022-02-02T22:12:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.946+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c810cca0 con 0x7f53c80f55e0 2022-02-02T22:12:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f53bc01d960 con 0x7f53c80f55e0 2022-02-02T22:12:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80f4a70 con 0x7f53c80f55e0 2022-02-02T22:12:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53c57fa700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 0x7f53b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:12:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f53bc0837d0 con 0x7f53c80f55e0 2022-02-02T22:12:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53c7fff700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 0x7f53b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:12:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.948+0000 7f53c7fff700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 0x7f53b8067290 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f53b400b830 tx=0x7f53b4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:12:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:52.952+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f53bc051a40 con 0x7f53c80f55e0 2022-02-02T22:12:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.155+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53c8045ad0 con 0x7f53c80f55e0 2022-02-02T22:12:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.156+0000 7f53c57fa700 1 -- 172.21.15.96:0/2404513096 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f53bc055060 con 0x7f53c80f55e0 2022-02-02T22:12:53.157 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:12:53.158 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:12:53.158 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:12:53.159 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:12:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:53.159 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:12:53.160 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:12:53.160 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:12:53.160 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:12:53.161 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:12:53.161 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:12:53.161 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:12:53.162 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:12:53.162 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:12:53.162 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:12:53.163 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:12:53.163 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:12:53.163 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:12:53.164 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:12:53.164 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:12:53.164 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:12:53.165 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:12:53.165 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:12:53.166 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:12:53.167 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:12:53.167 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:12:53.167 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:12:53.168 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:12:53.168 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:12:53.169 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:12:53.169 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:12:53.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:12:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:53.170 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:12:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:12:53.171 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:53.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:53.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:12:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 msgr2=0x7f53b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 0x7f53b8067290 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f53b400b830 tx=0x7f53b4008040).stop 2022-02-02T22:12:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 msgr2=0x7f53c8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:12:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 secure :-1 s=READY pgs=3545 cs=0 l=1 rev1=1 rx=0x7f53bc009990 tx=0x7f53bc009b30).stop 2022-02-02T22:12:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 shutdown_connections 2022-02-02T22:12:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f53b8064dd0 0x7f53b8067290 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53c80f55e0 0x7f53c8109c70 unknown :-1 s=CLOSED pgs=3545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 --2- 172.21.15.96:0/2404513096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53c80f5ef0 0x7f53c810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:12:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 >> 172.21.15.96:0/2404513096 conn(0x7f53c80f0de0 msgr2=0x7f53c80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:12:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 shutdown_connections 2022-02-02T22:12:53.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:12:53.158+0000 7f53ced08700 1 -- 172.21.15.96:0/2404513096 wait complete. 2022-02-02T22:12:53.177 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:12:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:53 smithi096 ceph-mon[101353]: from='client.41196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:53 smithi096 ceph-mon[101353]: from='client.41200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2993283749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:12:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:53 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2404513096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:12:53.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:53 smithi159 ceph-mon[69013]: from='client.41196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:53.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:53 smithi159 ceph-mon[69013]: from='client.41200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:12:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2993283749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:12:53.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:53 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2404513096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:12:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:54 smithi159 ceph-mon[69013]: pgmap v6923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:54 smithi096 ceph-mon[101353]: pgmap v6923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:56 smithi159 ceph-mon[69013]: pgmap v6924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:56 smithi096 ceph-mon[101353]: pgmap v6924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:12:58 smithi159 ceph-mon[69013]: pgmap v6925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:12:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:12:58 smithi096 ceph-mon[101353]: pgmap v6925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:00 smithi159 ceph-mon[69013]: pgmap v6926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:00 smithi096 ceph-mon[101353]: pgmap v6926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:02 smithi159 ceph-mon[69013]: pgmap v6927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:02 smithi096 ceph-mon[101353]: pgmap v6927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:04 smithi159 ceph-mon[69013]: pgmap v6928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:04 smithi096 ceph-mon[101353]: pgmap v6928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:06 smithi159 ceph-mon[69013]: pgmap v6929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:06 smithi096 ceph-mon[101353]: pgmap v6929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:08 smithi159 ceph-mon[69013]: pgmap v6930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:08 smithi096 ceph-mon[101353]: pgmap v6930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:10 smithi159 ceph-mon[69013]: pgmap v6931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:10 smithi096 ceph-mon[101353]: pgmap v6931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:12 smithi159 ceph-mon[69013]: pgmap v6932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:12 smithi096 ceph-mon[101353]: pgmap v6932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:14 smithi159 ceph-mon[69013]: pgmap v6933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:14 smithi096 ceph-mon[101353]: pgmap v6933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:16 smithi159 ceph-mon[69013]: pgmap v6934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:16 smithi096 ceph-mon[101353]: pgmap v6934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:18 smithi159 ceph-mon[69013]: pgmap v6935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:18 smithi096 ceph-mon[101353]: pgmap v6935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:20 smithi159 ceph-mon[69013]: pgmap v6936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:20 smithi096 ceph-mon[101353]: pgmap v6936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:22 smithi159 ceph-mon[69013]: pgmap v6937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:22 smithi096 ceph-mon[101353]: pgmap v6937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 -- 172.21.15.96:0/2559943042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f6860 msgr2=0x7f77e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 --2- 172.21.15.96:0/2559943042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f6860 0x7f77e40f6cc0 secure :-1 s=READY pgs=3546 cs=0 l=1 rev1=1 rx=0x7f77d8004660 tx=0x7f77d8009b30).stop 2022-02-02T22:13:23.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 -- 172.21.15.96:0/2559943042 shutdown_connections 2022-02-02T22:13:23.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 --2- 172.21.15.96:0/2559943042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f6860 0x7f77e40f6cc0 unknown :-1 s=CLOSED pgs=3546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 --2- 172.21.15.96:0/2559943042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f55c0 0x7f77e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:13:23.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 -- 172.21.15.96:0/2559943042 >> 172.21.15.96:0/2559943042 conn(0x7f77e40f0d40 msgr2=0x7f77e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:23.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 -- 172.21.15.96:0/2559943042 shutdown_connections 2022-02-02T22:13:23.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.269+0000 7f77ea545700 1 -- 172.21.15.96:0/2559943042 wait complete. 2022-02-02T22:13:23.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 Processor -- start 2022-02-02T22:13:23.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 -- start start 2022-02-02T22:13:23.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f6860 0x7f77e410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4060450 con 0x7f77e40f55c0 2022-02-02T22:13:23.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77ea545700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4060590 con 0x7f77e40f6860 2022-02-02T22:13:23.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47230/0 (socket says 172.21.15.96:47230) 2022-02-02T22:13:23.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 -- 172.21.15.96:0/1719490791 learned_addr learned my addr 172.21.15.96:0/1719490791 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:23.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e37fe700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f6860 0x7f77e410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 -- 172.21.15.96:0/1719490791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f6860 msgr2=0x7f77e410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f6860 0x7f77e410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.270+0000 7f77e3fff700 1 -- 172.21.15.96:0/1719490791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8005040 con 0x7f77e40f55c0 2022-02-02T22:13:23.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77e3fff700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 secure :-1 s=READY pgs=3547 cs=0 l=1 rev1=1 rx=0x7f77d40093f0 tx=0x7f77d4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d4013640 con 0x7f77e40f55c0 2022-02-02T22:13:23.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e410c7e0 con 0x7f77e40f55c0 2022-02-02T22:13:23.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e410cda0 con 0x7f77e40f55c0 2022-02-02T22:13:23.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77d4009e40 con 0x7f77e40f55c0 2022-02-02T22:13:23.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.271+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d400dbf0 con 0x7f77e40f55c0 2022-02-02T22:13:23.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.272+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e4045ad0 con 0x7f77e40f55c0 2022-02-02T22:13:23.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.273+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77d401a060 con 0x7f77e40f55c0 2022-02-02T22:13:23.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.273+0000 7f77e0ff9700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 0x7f77cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.273+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77d40819a0 con 0x7f77e40f55c0 2022-02-02T22:13:23.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.273+0000 7f77e37fe700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 0x7f77cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.274+0000 7f77e37fe700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 0x7f77cc067290 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f77d8004e30 tx=0x7f77d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.277+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77d404fa40 con 0x7f77e40f55c0 2022-02-02T22:13:23.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.457+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77e40fdf90 con 0x7f77cc064dd0 2022-02-02T22:13:23.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.459+0000 7f77e0ff9700 1 -- 172.21.15.96:0/1719490791 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f77e40fdf90 con 0x7f77cc064dd0 2022-02-02T22:13:23.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.460+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 msgr2=0x7f77cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.460+0000 7f77ea545700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 0x7f77cc067290 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f77d8004e30 tx=0x7f77d8009b30).stop 2022-02-02T22:13:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.460+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 msgr2=0x7f77e4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.460+0000 7f77ea545700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 secure :-1 s=READY pgs=3547 cs=0 l=1 rev1=1 rx=0x7f77d40093f0 tx=0x7f77d4006ec0).stop 2022-02-02T22:13:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 shutdown_connections 2022-02-02T22:13:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064dd0 0x7f77cc067290 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e40f55c0 0x7f77e4109cd0 unknown :-1 s=CLOSED pgs=3547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 --2- 172.21.15.96:0/1719490791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e40f6860 0x7f77e410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 >> 172.21.15.96:0/1719490791 conn(0x7f77e40f0d40 msgr2=0x7f77e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 shutdown_connections 2022-02-02T22:13:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.461+0000 7f77ea545700 1 -- 172.21.15.96:0/1719490791 wait complete. 2022-02-02T22:13:23.472 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:13:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 -- 172.21.15.96:0/2506088014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 msgr2=0x7f5a3c0f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2506088014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c0f6ee0 secure :-1 s=READY pgs=3548 cs=0 l=1 rev1=1 rx=0x7f5a2c004660 tx=0x7f5a2c009b30).stop 2022-02-02T22:13:23.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 -- 172.21.15.96:0/2506088014 shutdown_connections 2022-02-02T22:13:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2506088014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 0x7f5a3c0f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2506088014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c0f6ee0 unknown :-1 s=CLOSED pgs=3548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 -- 172.21.15.96:0/2506088014 >> 172.21.15.96:0/2506088014 conn(0x7f5a3c0f0320 msgr2=0x7f5a3c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:23.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.558+0000 7f5a40bae700 1 -- 172.21.15.96:0/2506088014 shutdown_connections 2022-02-02T22:13:23.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.559+0000 7f5a40bae700 1 -- 172.21.15.96:0/2506088014 wait complete. 2022-02-02T22:13:23.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.559+0000 7f5a40bae700 1 Processor -- start 2022-02-02T22:13:23.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.559+0000 7f5a40bae700 1 -- start start 2022-02-02T22:13:23.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a40bae700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 0x7f5a3c109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a40bae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a40bae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0f5480 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a40bae700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0f55c0 con 0x7f5a3c0f57d0 2022-02-02T22:13:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47242/0 (socket says 172.21.15.96:47242) 2022-02-02T22:13:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 -- 172.21.15.96:0/2100977068 learned_addr learned my addr 172.21.15.96:0/2100977068 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:23.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3b7fe700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 0x7f5a3c109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 -- 172.21.15.96:0/2100977068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 msgr2=0x7f5a3c109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 0x7f5a3c109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 -- 172.21.15.96:0/2100977068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c005040 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a3affd700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 secure :-1 s=READY pgs=3549 cs=0 l=1 rev1=1 rx=0x7f5a3000c530 tx=0x7f5a30007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3000f650 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a3000fc60 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c10c4b0 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.560+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a30012c20 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.561+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c10ca70 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.562+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c045ad0 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.562+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a30010070 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.562+0000 7f5a23fff700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 0x7f5a240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.562+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a30081710 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.562+0000 7f5a3b7fe700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 0x7f5a240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.563+0000 7f5a3b7fe700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 0x7f5a240672e0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f5a2c004630 tx=0x7f5a2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.566+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a3004f810 con 0x7f5a3c0f6ac0 2022-02-02T22:13:23.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.740+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a3c057f10 con 0x7f5a24064e20 2022-02-02T22:13:23.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.749+0000 7f5a23fff700 1 -- 172.21.15.96:0/2100977068 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5a3c057f10 con 0x7f5a24064e20 2022-02-02T22:13:23.751 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:13:23.751 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:13:23.751 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:13:23.752 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:13:23.752 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:13:23.752 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:13:23.753 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:13:23.753 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:13:23.753 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:13:23.754 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:13:23.754 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:13:23.755 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:13:23.755 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:13:23.755 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:13:23.756 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:13:23.756 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:13:23.756 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:13:23.757 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:13:23.757 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:13:23.757 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:13:23.758 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:13:23.758 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:13:23.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 msgr2=0x7f5a240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 0x7f5a240672e0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f5a2c004630 tx=0x7f5a2c009b30).stop 2022-02-02T22:13:23.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 msgr2=0x7f5a3c10bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 secure :-1 s=READY pgs=3549 cs=0 l=1 rev1=1 rx=0x7f5a3000c530 tx=0x7f5a30007e20).stop 2022-02-02T22:13:23.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 shutdown_connections 2022-02-02T22:13:23.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a24064e20 0x7f5a240672e0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a3c0f57d0 0x7f5a3c109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 --2- 172.21.15.96:0/2100977068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a3c0f6ac0 0x7f5a3c10bf00 unknown :-1 s=CLOSED pgs=3549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 >> 172.21.15.96:0/2100977068 conn(0x7f5a3c0f0320 msgr2=0x7f5a3c0fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:23.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 shutdown_connections 2022-02-02T22:13:23.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.751+0000 7f5a40bae700 1 -- 172.21.15.96:0/2100977068 wait complete. 2022-02-02T22:13:23.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 -- 172.21.15.96:0/585897039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 msgr2=0x7f15740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 --2- 172.21.15.96:0/585897039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f15740f7de0 secure :-1 s=READY pgs=3550 cs=0 l=1 rev1=1 rx=0x7f1564004660 tx=0x7f1564009b30).stop 2022-02-02T22:13:23.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 -- 172.21.15.96:0/585897039 shutdown_connections 2022-02-02T22:13:23.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 --2- 172.21.15.96:0/585897039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f15740f7de0 unknown :-1 s=CLOSED pgs=3550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 --2- 172.21.15.96:0/585897039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 0x7f15740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 -- 172.21.15.96:0/585897039 >> 172.21.15.96:0/585897039 conn(0x7f15740f1e40 msgr2=0x7f15740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.847+0000 7f1579a16700 1 -- 172.21.15.96:0/585897039 shutdown_connections 2022-02-02T22:13:23.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 -- 172.21.15.96:0/585897039 wait complete. 2022-02-02T22:13:23.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 Processor -- start 2022-02-02T22:13:23.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 -- start start 2022-02-02T22:13:23.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 0x7f1574106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574107a00 con 0x7f15740f7980 2022-02-02T22:13:23.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.848+0000 7f1579a16700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574107b40 con 0x7f15740f66e0 2022-02-02T22:13:23.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47252/0 (socket says 172.21.15.96:47252) 2022-02-02T22:13:23.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 -- 172.21.15.96:0/367446539 learned_addr learned my addr 172.21.15.96:0/367446539 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f1572ffd700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 0x7f1574106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 -- 172.21.15.96:0/367446539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 msgr2=0x7f1574106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 0x7f1574106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 -- 172.21.15.96:0/367446539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564005040 con 0x7f15740f7980 2022-02-02T22:13:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f15727fc700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 secure :-1 s=READY pgs=3551 cs=0 l=1 rev1=1 rx=0x7f1564009990 tx=0x7f1564009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564018070 con 0x7f15740f7980 2022-02-02T22:13:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574108480 con 0x7f15740f7980 2022-02-02T22:13:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1564007ca0 con 0x7f15740f7980 2022-02-02T22:13:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156401c620 con 0x7f15740f7980 2022-02-02T22:13:23.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.849+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15741089e0 con 0x7f15740f7980 2022-02-02T22:13:23.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.851+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1574045ad0 con 0x7f15740f7980 2022-02-02T22:13:23.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.851+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f156401d960 con 0x7f15740f7980 2022-02-02T22:13:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.851+0000 7f155b7fe700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 0x7f155c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.851+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f15640837d0 con 0x7f15740f7980 2022-02-02T22:13:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.851+0000 7f1572ffd700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 0x7f155c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.852+0000 7f1572ffd700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 0x7f155c067290 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f1568007fd0 tx=0x7f1568009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:23.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:23.856+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1564055470 con 0x7f15740f7980 2022-02-02T22:13:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.085+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1574027a00 con 0x7f15740f7980 2022-02-02T22:13:24.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.086+0000 7f155b7fe700 1 -- 172.21.15.96:0/367446539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1564055060 con 0x7f15740f7980 2022-02-02T22:13:24.088 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:13:24.088 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:13:24.088 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:13:24.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:24.089 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:13:24.089 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:13:24.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:24.090 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:13:24.091 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:13:24.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:24.091 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:13:24.092 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:13:24.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:24.092 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:13:24.093 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:13:24.093 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:13:24.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:13:24.094 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:13:24.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 msgr2=0x7f155c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 0x7f155c067290 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f1568007fd0 tx=0x7f1568009040).stop 2022-02-02T22:13:24.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 msgr2=0x7f1574107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 secure :-1 s=READY pgs=3551 cs=0 l=1 rev1=1 rx=0x7f1564009990 tx=0x7f1564009b30).stop 2022-02-02T22:13:24.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 shutdown_connections 2022-02-02T22:13:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f155c064dd0 0x7f155c067290 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15740f66e0 0x7f1574106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 --2- 172.21.15.96:0/367446539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15740f7980 0x7f1574107450 unknown :-1 s=CLOSED pgs=3551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 >> 172.21.15.96:0/367446539 conn(0x7f15740f1e40 msgr2=0x7f15740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:24.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 shutdown_connections 2022-02-02T22:13:24.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.088+0000 7f1579a16700 1 -- 172.21.15.96:0/367446539 wait complete. 2022-02-02T22:13:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 -- 172.21.15.96:0/960667254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 msgr2=0x7f67a80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 --2- 172.21.15.96:0/960667254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a80f6cc0 secure :-1 s=READY pgs=3552 cs=0 l=1 rev1=1 rx=0x7f67a4004660 tx=0x7f67a4009b30).stop 2022-02-02T22:13:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 -- 172.21.15.96:0/960667254 shutdown_connections 2022-02-02T22:13:24.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 --2- 172.21.15.96:0/960667254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a80f6cc0 unknown :-1 s=CLOSED pgs=3552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 --2- 172.21.15.96:0/960667254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 0x7f67a80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 -- 172.21.15.96:0/960667254 >> 172.21.15.96:0/960667254 conn(0x7f67a80f0d40 msgr2=0x7f67a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 -- 172.21.15.96:0/960667254 shutdown_connections 2022-02-02T22:13:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 -- 172.21.15.96:0/960667254 wait complete. 2022-02-02T22:13:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.185+0000 7f67b0099700 1 Processor -- start 2022-02-02T22:13:24.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67b0099700 1 -- start start 2022-02-02T22:13:24.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67b0099700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 0x7f67a8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:24.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67b0099700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:24.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67b0099700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a80603c0 con 0x7f67a80f6860 2022-02-02T22:13:24.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67b0099700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8060500 con 0x7f67a80f55c0 2022-02-02T22:13:24.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:24.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47262/0 (socket says 172.21.15.96:47262) 2022-02-02T22:13:24.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 -- 172.21.15.96:0/912325363 learned_addr learned my addr 172.21.15.96:0/912325363 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:24.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ade35700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 0x7f67a8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:24.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 -- 172.21.15.96:0/912325363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 msgr2=0x7f67a8109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 0x7f67a8109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 -- 172.21.15.96:0/912325363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4005040 con 0x7f67a80f6860 2022-02-02T22:13:24.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.186+0000 7f67ad634700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 secure :-1 s=READY pgs=3553 cs=0 l=1 rev1=1 rx=0x7f67a4009990 tx=0x7f67a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:24.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.187+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a4018070 con 0x7f67a80f6860 2022-02-02T22:13:24.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.187+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a810c6c0 con 0x7f67a80f6860 2022-02-02T22:13:24.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.187+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f67a4007ba0 con 0x7f67a80f6860 2022-02-02T22:13:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.187+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a401c3c0 con 0x7f67a80f6860 2022-02-02T22:13:24.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.187+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a810cbf0 con 0x7f67a80f6860 2022-02-02T22:13:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.188+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a8045ad0 con 0x7f67a80f6860 2022-02-02T22:13:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.188+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f67a401d420 con 0x7f67a80f6860 2022-02-02T22:13:24.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.189+0000 7f679e7fc700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 0x7f6794067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.189+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f67a40836c0 con 0x7f67a80f6860 2022-02-02T22:13:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.189+0000 7f67ade35700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 0x7f6794067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.189+0000 7f67ade35700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 0x7f6794067290 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f67a8060040 tx=0x7f679800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.193+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f67a4051820 con 0x7f67a80f6860 2022-02-02T22:13:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.393+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f67a8027a00 con 0x7f67a80f6860 2022-02-02T22:13:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.394+0000 7f679e7fc700 1 -- 172.21.15.96:0/912325363 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f67a4051070 con 0x7f67a80f6860 2022-02-02T22:13:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:13:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:13:24.396 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:13:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:13:24.397 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:24.397 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:13:24.398 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:13:24.398 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:13:24.399 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:13:24.399 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:13:24.399 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:13:24.400 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:13:24.400 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:13:24.400 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:13:24.401 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:13:24.401 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:13:24.401 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:13:24.402 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:13:24.402 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:13:24.402 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:13:24.403 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:13:24.403 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:13:24.403 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:13:24.404 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:13:24.404 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:13:24.404 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:13:24.405 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:13:24.405 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:13:24.405 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:13:24.406 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:13:24.406 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:13:24.407 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:13:24.407 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:24.407 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:24.408 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:13:24.408 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:24.408 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:24.409 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:24.409 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:24.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 msgr2=0x7f6794067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 0x7f6794067290 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f67a8060040 tx=0x7f679800b040).stop 2022-02-02T22:13:24.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 msgr2=0x7f67a810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:24.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 secure :-1 s=READY pgs=3553 cs=0 l=1 rev1=1 rx=0x7f67a4009990 tx=0x7f67a4009b30).stop 2022-02-02T22:13:24.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 shutdown_connections 2022-02-02T22:13:24.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6794064dd0 0x7f6794067290 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a80f55c0 0x7f67a8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 --2- 172.21.15.96:0/912325363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67a80f6860 0x7f67a810c170 unknown :-1 s=CLOSED pgs=3553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:24.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 >> 172.21.15.96:0/912325363 conn(0x7f67a80f0d40 msgr2=0x7f67a80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:24.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 shutdown_connections 2022-02-02T22:13:24.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:24.396+0000 7f67b0099700 1 -- 172.21.15.96:0/912325363 wait complete. 2022-02-02T22:13:24.414 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:13:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:24 smithi159 ceph-mon[69013]: pgmap v6938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:24 smithi159 ceph-mon[69013]: from='client.41212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/367446539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:13:24.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/912325363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:13:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:24 smithi096 ceph-mon[101353]: pgmap v6938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:24 smithi096 ceph-mon[101353]: from='client.41212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/367446539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:13:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/912325363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:13:25.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:25 smithi159 ceph-mon[69013]: from='client.41216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:25.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:25 smithi096 ceph-mon[101353]: from='client.41216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:26 smithi159 ceph-mon[69013]: pgmap v6939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:26 smithi096 ceph-mon[101353]: pgmap v6939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:28 smithi159 ceph-mon[69013]: pgmap v6940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:13:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:13:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:28 smithi096 ceph-mon[101353]: pgmap v6940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:13:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:13:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:30 smithi159 ceph-mon[69013]: pgmap v6941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:30 smithi096 ceph-mon[101353]: pgmap v6941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:32 smithi159 ceph-mon[69013]: pgmap v6942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:32 smithi096 ceph-mon[101353]: pgmap v6942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:34 smithi159 ceph-mon[69013]: pgmap v6943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:34 smithi096 ceph-mon[101353]: pgmap v6943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:36 smithi159 ceph-mon[69013]: pgmap v6944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:36 smithi096 ceph-mon[101353]: pgmap v6944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:38 smithi159 ceph-mon[69013]: pgmap v6945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:38 smithi096 ceph-mon[101353]: pgmap v6945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:40 smithi159 ceph-mon[69013]: pgmap v6946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:40 smithi096 ceph-mon[101353]: pgmap v6946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:42 smithi159 ceph-mon[69013]: pgmap v6947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:42 smithi096 ceph-mon[101353]: pgmap v6947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:44 smithi159 ceph-mon[69013]: pgmap v6948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:44 smithi096 ceph-mon[101353]: pgmap v6948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:46 smithi159 ceph-mon[69013]: pgmap v6949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:46 smithi096 ceph-mon[101353]: pgmap v6949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:48 smithi159 ceph-mon[69013]: pgmap v6950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:48 smithi096 ceph-mon[101353]: pgmap v6950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:50 smithi159 ceph-mon[69013]: pgmap v6951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:50 smithi096 ceph-mon[101353]: pgmap v6951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:52 smithi159 ceph-mon[69013]: pgmap v6952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:52 smithi096 ceph-mon[101353]: pgmap v6952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 -- 172.21.15.96:0/3449372279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 msgr2=0x7ff2ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/3449372279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec0f59e0 secure :-1 s=READY pgs=3554 cs=0 l=1 rev1=1 rx=0x7ff2d4004660 tx=0x7ff2d4009b30).stop 2022-02-02T22:13:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 -- 172.21.15.96:0/3449372279 shutdown_connections 2022-02-02T22:13:54.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/3449372279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/3449372279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec0f59e0 unknown :-1 s=CLOSED pgs=3554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 -- 172.21.15.96:0/3449372279 >> 172.21.15.96:0/3449372279 conn(0x7ff2ec0f0d40 msgr2=0x7ff2ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:54.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 -- 172.21.15.96:0/3449372279 shutdown_connections 2022-02-02T22:13:54.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.504+0000 7ff2f1edb700 1 -- 172.21.15.96:0/3449372279 wait complete. 2022-02-02T22:13:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 Processor -- start 2022-02-02T22:13:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 -- start start 2022-02-02T22:13:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec106910 con 0x7ff2ec0f6860 2022-02-02T22:13:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2f1edb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec106a50 con 0x7ff2ec0f55c0 2022-02-02T22:13:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47278/0 (socket says 172.21.15.96:47278) 2022-02-02T22:13:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 -- 172.21.15.96:0/476719377 learned_addr learned my addr 172.21.15.96:0/476719377 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eb7fe700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 -- 172.21.15.96:0/476719377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f55c0 msgr2=0x7ff2ec105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.505+0000 7ff2eaffd700 1 -- 172.21.15.96:0/476719377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4005040 con 0x7ff2ec0f6860 2022-02-02T22:13:54.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2eaffd700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 secure :-1 s=READY pgs=3555 cs=0 l=1 rev1=1 rx=0x7ff2dc0026d0 tx=0x7ff2dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:54.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2dc0079c0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec1073f0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec1079b0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2dc00f040 con 0x7ff2ec0f6860 2022-02-02T22:13:54.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.506+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2dc0148b0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.507+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0004fa0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.507+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff2dc014a10 con 0x7ff2ec0f6860 2022-02-02T22:13:54.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.508+0000 7ff2e3fff700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 0x7ff2d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.508+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff2dc0817a0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.508+0000 7ff2eb7fe700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 0x7ff2d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.508+0000 7ff2eb7fe700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 0x7ff2d8067290 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7ff2d4004630 tx=0x7ff2d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:54.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.512+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff2dc0532d0 con 0x7ff2ec0f6860 2022-02-02T22:13:54.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.691+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d0000bc0 con 0x7ff2d8064dd0 2022-02-02T22:13:54.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.692+0000 7ff2e3fff700 1 -- 172.21.15.96:0/476719377 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff2d0000bc0 con 0x7ff2d8064dd0 2022-02-02T22:13:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 msgr2=0x7ff2d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 0x7ff2d8067290 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7ff2d4004630 tx=0x7ff2d4009b30).stop 2022-02-02T22:13:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 msgr2=0x7ff2ec106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 secure :-1 s=READY pgs=3555 cs=0 l=1 rev1=1 rx=0x7ff2dc0026d0 tx=0x7ff2dc009de0).stop 2022-02-02T22:13:54.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 shutdown_connections 2022-02-02T22:13:54.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff2d8064dd0 0x7ff2d8067290 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0f55c0 0x7ff2ec105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 --2- 172.21.15.96:0/476719377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2ec0f6860 0x7ff2ec106360 unknown :-1 s=CLOSED pgs=3555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.693+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 >> 172.21.15.96:0/476719377 conn(0x7ff2ec0f0d40 msgr2=0x7ff2ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:54.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.694+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 shutdown_connections 2022-02-02T22:13:54.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.694+0000 7ff2f1edb700 1 -- 172.21.15.96:0/476719377 wait complete. 2022-02-02T22:13:54.703 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:13:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:54 smithi159 ceph-mon[69013]: pgmap v6953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:54.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 -- 172.21.15.96:0/1008409990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f66e0 msgr2=0x7f9dc80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/1008409990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f66e0 0x7f9dc80f6b00 secure :-1 s=READY pgs=3556 cs=0 l=1 rev1=1 rx=0x7f9db8004660 tx=0x7f9db8009b30).stop 2022-02-02T22:13:54.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 -- 172.21.15.96:0/1008409990 shutdown_connections 2022-02-02T22:13:54.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/1008409990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f7980 0x7f9dc80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/1008409990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f66e0 0x7f9dc80f6b00 unknown :-1 s=CLOSED pgs=3556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 -- 172.21.15.96:0/1008409990 >> 172.21.15.96:0/1008409990 conn(0x7f9dc80f1e40 msgr2=0x7f9dc80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:54.793 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:54 smithi096 ceph-mon[101353]: pgmap v6953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:54.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 -- 172.21.15.96:0/1008409990 shutdown_connections 2022-02-02T22:13:54.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.791+0000 7f9dcea0a700 1 -- 172.21.15.96:0/1008409990 wait complete. 2022-02-02T22:13:54.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 Processor -- start 2022-02-02T22:13:54.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 -- start start 2022-02-02T22:13:54.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f66e0 0x7f9dc806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc806a380 con 0x7f9dc80f7980 2022-02-02T22:13:54.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dcea0a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc806a4c0 con 0x7f9dc80f66e0 2022-02-02T22:13:54.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47286/0 (socket says 172.21.15.96:47286) 2022-02-02T22:13:54.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 -- 172.21.15.96:0/3908776139 learned_addr learned my addr 172.21.15.96:0/3908776139 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:54.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dc7fff700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f66e0 0x7f9dc806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 -- 172.21.15.96:0/3908776139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f66e0 msgr2=0x7f9dc806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f66e0 0x7f9dc806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.792+0000 7f9dbffff700 1 -- 172.21.15.96:0/3908776139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8005040 con 0x7f9dc80f7980 2022-02-02T22:13:54.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dbffff700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 secure :-1 s=READY pgs=3557 cs=0 l=1 rev1=1 rx=0x7f9db000e7f0 tx=0x7f9db000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:54.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db00092e0 con 0x7f9dc80f7980 2022-02-02T22:13:54.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc806a7a0 con 0x7f9dc80f7980 2022-02-02T22:13:54.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc810ef90 con 0x7f9dc80f7980 2022-02-02T22:13:54.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9db000f040 con 0x7f9dc80f7980 2022-02-02T22:13:54.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.793+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db0014750 con 0x7f9dc80f7980 2022-02-02T22:13:54.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.794+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac004fa0 con 0x7f9dc80f7980 2022-02-02T22:13:54.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.795+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9db001b030 con 0x7f9dc80f7980 2022-02-02T22:13:54.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.796+0000 7f9dc57fa700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 0x7f9db4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:54.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.796+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9db00817a0 con 0x7f9dc80f7980 2022-02-02T22:13:54.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.796+0000 7f9dc7fff700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 0x7f9db4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:54.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.796+0000 7f9dc7fff700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 0x7f9db4067290 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f9db8000c00 tx=0x7f9db800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:54.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.799+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9db004f950 con 0x7f9dc80f7980 2022-02-02T22:13:54.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.970+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dac000bc0 con 0x7f9db4064dd0 2022-02-02T22:13:54.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.979+0000 7f9dc57fa700 1 -- 172.21.15.96:0/3908776139 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9dac000bc0 con 0x7f9db4064dd0 2022-02-02T22:13:54.979 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:13:54.980 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:13:54.980 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:13:54.980 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:13:54.981 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:13:54.981 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:13:54.981 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:13:54.982 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:13:54.982 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:13:54.982 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 3h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:13:54.983 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:13:54.983 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 3h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:13:54.983 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:13:54.984 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:13:54.984 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:13:54.984 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:13:54.985 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:13:54.985 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:13:54.985 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:13:54.986 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:13:54.986 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:13:54.986 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:13:54.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 msgr2=0x7f9db4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 0x7f9db4067290 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f9db8000c00 tx=0x7f9db800b040).stop 2022-02-02T22:13:54.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 msgr2=0x7f9dc8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:54.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 secure :-1 s=READY pgs=3557 cs=0 l=1 rev1=1 rx=0x7f9db000e7f0 tx=0x7f9db000b040).stop 2022-02-02T22:13:54.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 shutdown_connections 2022-02-02T22:13:54.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9db4064dd0 0x7f9db4067290 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc80f66e0 0x7f9dc806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 --2- 172.21.15.96:0/3908776139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9dc80f7980 0x7f9dc8069e20 unknown :-1 s=CLOSED pgs=3557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 >> 172.21.15.96:0/3908776139 conn(0x7f9dc80f1e40 msgr2=0x7f9dc80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:54.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 shutdown_connections 2022-02-02T22:13:54.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:54.981+0000 7f9dcea0a700 1 -- 172.21.15.96:0/3908776139 wait complete. 2022-02-02T22:13:55.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.077+0000 7fe41f439700 1 -- 172.21.15.96:0/947908945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 msgr2=0x7fe4180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.077+0000 7fe41f439700 1 --2- 172.21.15.96:0/947908945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe4180f6950 secure :-1 s=READY pgs=3558 cs=0 l=1 rev1=1 rx=0x7fe408004660 tx=0x7fe408009b30).stop 2022-02-02T22:13:55.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 -- 172.21.15.96:0/947908945 shutdown_connections 2022-02-02T22:13:55.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 --2- 172.21.15.96:0/947908945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe4180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 --2- 172.21.15.96:0/947908945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe4180f6950 unknown :-1 s=CLOSED pgs=3558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 -- 172.21.15.96:0/947908945 >> 172.21.15.96:0/947908945 conn(0x7fe4180f1c90 msgr2=0x7fe4180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:55.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 -- 172.21.15.96:0/947908945 shutdown_connections 2022-02-02T22:13:55.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 -- 172.21.15.96:0/947908945 wait complete. 2022-02-02T22:13:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.078+0000 7fe41f439700 1 Processor -- start 2022-02-02T22:13:55.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 -- start start 2022-02-02T22:13:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe418069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41806a380 con 0x7fe4180f6530 2022-02-02T22:13:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41806a4c0 con 0x7fe4180f77d0 2022-02-02T22:13:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47292/0 (socket says 172.21.15.96:47292) 2022-02-02T22:13:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 -- 172.21.15.96:0/2142826047 learned_addr learned my addr 172.21.15.96:0/2142826047 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41dc36700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe418069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 -- 172.21.15.96:0/2142826047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 msgr2=0x7fe418069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe418069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 -- 172.21.15.96:0/2142826047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408005040 con 0x7fe4180f6530 2022-02-02T22:13:55.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41dc36700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe418069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:13:55.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41e437700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 secure :-1 s=READY pgs=3559 cs=0 l=1 rev1=1 rx=0x7fe408004f60 tx=0x7fe408009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:55.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe408018070 con 0x7fe4180f6530 2022-02-02T22:13:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41806a740 con 0x7fe4180f6530 2022-02-02T22:13:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.079+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe408007ba0 con 0x7fe4180f6530 2022-02-02T22:13:55.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.080+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40801c620 con 0x7fe4180f6530 2022-02-02T22:13:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.080+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41806aca0 con 0x7fe4180f6530 2022-02-02T22:13:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.080+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418045ad0 con 0x7fe4180f6530 2022-02-02T22:13:55.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.081+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe40801c8e0 con 0x7fe4180f6530 2022-02-02T22:13:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.081+0000 7fe40effd700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 0x7fe4040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.081+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe408083940 con 0x7fe4180f6530 2022-02-02T22:13:55.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.081+0000 7fe41dc36700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 0x7fe4040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.082+0000 7fe41dc36700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 0x7fe4040672e0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fe4140041d0 tx=0x7fe414009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:55.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.085+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe408051a40 con 0x7fe4180f6530 2022-02-02T22:13:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.316+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4180fed90 con 0x7fe4180f6530 2022-02-02T22:13:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.316+0000 7fe40effd700 1 -- 172.21.15.96:0/2142826047 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe408055060 con 0x7fe4180f6530 2022-02-02T22:13:55.317 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:13:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:13:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:13:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:13:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:13:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:13:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:13:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:13:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:13:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:13:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:13:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:13:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:13:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:13:55.323 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:13:55.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 msgr2=0x7fe4040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 0x7fe4040672e0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fe4140041d0 tx=0x7fe414009040).stop 2022-02-02T22:13:55.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 msgr2=0x7fe41806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 secure :-1 s=READY pgs=3559 cs=0 l=1 rev1=1 rx=0x7fe408004f60 tx=0x7fe408009b30).stop 2022-02-02T22:13:55.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 shutdown_connections 2022-02-02T22:13:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe404064e20 0x7fe4040672e0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4180f6530 0x7fe41806b9a0 unknown :-1 s=CLOSED pgs=3559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 --2- 172.21.15.96:0/2142826047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4180f77d0 0x7fe418069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 >> 172.21.15.96:0/2142826047 conn(0x7fe4180f1c90 msgr2=0x7fe4180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:55.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 shutdown_connections 2022-02-02T22:13:55.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.318+0000 7fe41f439700 1 -- 172.21.15.96:0/2142826047 wait complete. 2022-02-02T22:13:55.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 -- 172.21.15.96:0/166895633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 msgr2=0x7fd9140f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 --2- 172.21.15.96:0/166895633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f5a00 secure :-1 s=READY pgs=3560 cs=0 l=1 rev1=1 rx=0x7fd8fc004660 tx=0x7fd8fc009b30).stop 2022-02-02T22:13:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 -- 172.21.15.96:0/166895633 shutdown_connections 2022-02-02T22:13:55.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 --2- 172.21.15.96:0/166895633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 0x7fd9140f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 --2- 172.21.15.96:0/166895633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f5a00 unknown :-1 s=CLOSED pgs=3560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.416+0000 7fd91954e700 1 -- 172.21.15.96:0/166895633 >> 172.21.15.96:0/166895633 conn(0x7fd9140f0d40 msgr2=0x7fd9140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.417+0000 7fd91954e700 1 -- 172.21.15.96:0/166895633 shutdown_connections 2022-02-02T22:13:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.417+0000 7fd91954e700 1 -- 172.21.15.96:0/166895633 wait complete. 2022-02-02T22:13:55.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 Processor -- start 2022-02-02T22:13:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 -- start start 2022-02-02T22:13:55.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 0x7fd9140f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140f8120 con 0x7fd9140f55e0 2022-02-02T22:13:55.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd91954e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140f8260 con 0x7fd9140f6880 2022-02-02T22:13:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47300/0 (socket says 172.21.15.96:47300) 2022-02-02T22:13:55.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 -- 172.21.15.96:0/599347774 learned_addr learned my addr 172.21.15.96:0/599347774 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:13:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd9127fc700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 0x7fd9140f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 -- 172.21.15.96:0/599347774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 msgr2=0x7fd9140f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 0x7fd9140f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 -- 172.21.15.96:0/599347774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc005040 con 0x7fd9140f55e0 2022-02-02T22:13:55.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.418+0000 7fd912ffd700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 secure :-1 s=READY pgs=3561 cs=0 l=1 rev1=1 rx=0x7fd8fc004f60 tx=0x7fd8fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:55.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.419+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8fc018070 con 0x7fd9140f55e0 2022-02-02T22:13:55.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.419+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8fc009770 con 0x7fd9140f55e0 2022-02-02T22:13:55.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.419+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140f84e0 con 0x7fd9140f55e0 2022-02-02T22:13:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.419+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8fc01c3c0 con 0x7fd9140f55e0 2022-02-02T22:13:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.419+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9140f8a40 con 0x7fd9140f55e0 2022-02-02T22:13:55.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.420+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8fc01d420 con 0x7fd9140f55e0 2022-02-02T22:13:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.421+0000 7fd90b7fe700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 0x7fd900067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:13:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.421+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8fc083780 con 0x7fd9140f55e0 2022-02-02T22:13:55.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.421+0000 7fd9127fc700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 0x7fd900067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:13:55.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.421+0000 7fd9127fc700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 0x7fd900067290 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7fd9040041d0 tx=0x7fd904009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:13:55.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.421+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd914045ad0 con 0x7fd9140f55e0 2022-02-02T22:13:55.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.426+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8fc051880 con 0x7fd9140f55e0 2022-02-02T22:13:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.628+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd91410f5a0 con 0x7fd9140f55e0 2022-02-02T22:13:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.629+0000 7fd90b7fe700 1 -- 172.21.15.96:0/599347774 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd8fc054ea0 con 0x7fd9140f55e0 2022-02-02T22:13:55.630 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:13:55.630 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:13:55.630 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:13:55.631 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:13:55.631 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:55.631 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:13:55.632 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:13:55.632 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:13:55.632 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:13:55.633 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:13:55.633 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:13:55.633 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:13:55.634 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:13:55.634 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:13:55.635 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:13:55.635 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:13:55.635 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:13:55.636 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:13:55.636 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:13:55.636 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:13:55.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:13:55.637 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:13:55.637 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:13:55.638 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:13:55.638 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:13:55.638 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:13:55.639 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:13:55.639 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:13:55.639 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:13:55.640 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:13:55.640 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:13:55.640 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:13:55.641 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:55.641 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:55.641 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:13:55.642 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:13:55.642 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:55.642 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:55.643 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:13:55.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 msgr2=0x7fd900067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 0x7fd900067290 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7fd9040041d0 tx=0x7fd904009040).stop 2022-02-02T22:13:55.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 msgr2=0x7fd9140f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:13:55.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 secure :-1 s=READY pgs=3561 cs=0 l=1 rev1=1 rx=0x7fd8fc004f60 tx=0x7fd8fc009b30).stop 2022-02-02T22:13:55.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 shutdown_connections 2022-02-02T22:13:55.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd900064dd0 0x7fd900067290 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9140f55e0 0x7fd9140f9740 unknown :-1 s=CLOSED pgs=3561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 --2- 172.21.15.96:0/599347774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9140f6880 0x7fd9140f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:13:55.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 >> 172.21.15.96:0/599347774 conn(0x7fd9140f0d40 msgr2=0x7fd91405ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:13:55.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 shutdown_connections 2022-02-02T22:13:55.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:13:55.631+0000 7fd91954e700 1 -- 172.21.15.96:0/599347774 wait complete. 2022-02-02T22:13:55.648 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:13:55.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:55 smithi096 ceph-mon[101353]: from='client.41228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:55.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2142826047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:13:56.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:55 smithi159 ceph-mon[69013]: from='client.41228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:56.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2142826047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:13:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:56 smithi096 ceph-mon[101353]: pgmap v6954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:56 smithi096 ceph-mon[101353]: from='client.41232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/599347774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:13:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:56 smithi159 ceph-mon[69013]: pgmap v6954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:56 smithi159 ceph-mon[69013]: from='client.41232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:13:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/599347774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:13:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:13:58 smithi096 ceph-mon[101353]: pgmap v6955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:13:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:13:58 smithi159 ceph-mon[69013]: pgmap v6955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:00 smithi096 ceph-mon[101353]: pgmap v6956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:00 smithi159 ceph-mon[69013]: pgmap v6956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:02 smithi096 ceph-mon[101353]: pgmap v6957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:02 smithi159 ceph-mon[69013]: pgmap v6957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:04 smithi096 ceph-mon[101353]: pgmap v6958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:04 smithi159 ceph-mon[69013]: pgmap v6958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:06 smithi096 ceph-mon[101353]: pgmap v6959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:06 smithi159 ceph-mon[69013]: pgmap v6959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:08 smithi096 ceph-mon[101353]: pgmap v6960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:08 smithi159 ceph-mon[69013]: pgmap v6960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:10 smithi096 ceph-mon[101353]: pgmap v6961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:10 smithi159 ceph-mon[69013]: pgmap v6961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:12 smithi159 ceph-mon[69013]: pgmap v6962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:12 smithi096 ceph-mon[101353]: pgmap v6962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:14 smithi159 ceph-mon[69013]: pgmap v6963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:14 smithi096 ceph-mon[101353]: pgmap v6963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:16 smithi159 ceph-mon[69013]: pgmap v6964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:16 smithi096 ceph-mon[101353]: pgmap v6964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:18 smithi159 ceph-mon[69013]: pgmap v6965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:18 smithi096 ceph-mon[101353]: pgmap v6965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:20 smithi159 ceph-mon[69013]: pgmap v6966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:20 smithi096 ceph-mon[101353]: pgmap v6966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:22 smithi159 ceph-mon[69013]: pgmap v6967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:22 smithi096 ceph-mon[101353]: pgmap v6967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:24 smithi159 ceph-mon[69013]: pgmap v6968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:24 smithi096 ceph-mon[101353]: pgmap v6968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:25.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 -- 172.21.15.96:0/4211781345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 msgr2=0x7fe2000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:25.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 --2- 172.21.15.96:0/4211781345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe2000f59e0 secure :-1 s=READY pgs=3562 cs=0 l=1 rev1=1 rx=0x7fe1f0004660 tx=0x7fe1f0009b30).stop 2022-02-02T22:14:25.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 -- 172.21.15.96:0/4211781345 shutdown_connections 2022-02-02T22:14:25.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 --2- 172.21.15.96:0/4211781345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 0x7fe2000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 --2- 172.21.15.96:0/4211781345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe2000f59e0 unknown :-1 s=CLOSED pgs=3562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 -- 172.21.15.96:0/4211781345 >> 172.21.15.96:0/4211781345 conn(0x7fe2000f0d40 msgr2=0x7fe2000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:25.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 -- 172.21.15.96:0/4211781345 shutdown_connections 2022-02-02T22:14:25.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.737+0000 7fe207aad700 1 -- 172.21.15.96:0/4211781345 wait complete. 2022-02-02T22:14:25.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 Processor -- start 2022-02-02T22:14:25.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 -- start start 2022-02-02T22:14:25.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:25.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 0x7fe200106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:25.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe200106910 con 0x7fe2000f55c0 2022-02-02T22:14:25.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe207aad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe200106a50 con 0x7fe2000f6860 2022-02-02T22:14:25.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:25.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47318/0 (socket says 172.21.15.96:47318) 2022-02-02T22:14:25.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 -- 172.21.15.96:0/4111396419 learned_addr learned my addr 172.21.15.96:0/4111396419 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205048700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 0x7fe200106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 -- 172.21.15.96:0/4111396419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 msgr2=0x7fe200106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 0x7fe200106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 -- 172.21.15.96:0/4111396419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0005040 con 0x7fe2000f55c0 2022-02-02T22:14:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.738+0000 7fe205849700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 secure :-1 s=READY pgs=3563 cs=0 l=1 rev1=1 rx=0x7fe1f0009d30 tx=0x7fe1f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:25.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.739+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f001a070 con 0x7fe2000f55c0 2022-02-02T22:14:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.739+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200107390 con 0x7fe2000f55c0 2022-02-02T22:14:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.739+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe1f00097d0 con 0x7fe2000f55c0 2022-02-02T22:14:25.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.739+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f001f8d0 con 0x7fe2000f55c0 2022-02-02T22:14:25.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.739+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2001078f0 con 0x7fe2000f55c0 2022-02-02T22:14:25.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.740+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200045ad0 con 0x7fe2000f55c0 2022-02-02T22:14:25.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.740+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe1f00125d0 con 0x7fe2000f55c0 2022-02-02T22:14:25.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.741+0000 7fe1f67fc700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 0x7fe1ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:25.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.741+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe1f0085d70 con 0x7fe2000f55c0 2022-02-02T22:14:25.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.741+0000 7fe205048700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 0x7fe1ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:25.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.741+0000 7fe205048700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 0x7fe1ec067290 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fe1fc007fd0 tx=0x7fe1fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:25.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.745+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe1f00578a0 con 0x7fe2000f55c0 2022-02-02T22:14:25.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.924+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe20005f620 con 0x7fe1ec064dd0 2022-02-02T22:14:25.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.925+0000 7fe1f67fc700 1 -- 172.21.15.96:0/4111396419 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe20005f620 con 0x7fe1ec064dd0 2022-02-02T22:14:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 msgr2=0x7fe1ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 0x7fe1ec067290 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fe1fc007fd0 tx=0x7fe1fc009040).stop 2022-02-02T22:14:25.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 msgr2=0x7fe200105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 secure :-1 s=READY pgs=3563 cs=0 l=1 rev1=1 rx=0x7fe1f0009d30 tx=0x7fe1f0009b30).stop 2022-02-02T22:14:25.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 shutdown_connections 2022-02-02T22:14:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe1ec064dd0 0x7fe1ec067290 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000f55c0 0x7fe200105e70 unknown :-1 s=CLOSED pgs=3563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 --2- 172.21.15.96:0/4111396419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2000f6860 0x7fe200106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 >> 172.21.15.96:0/4111396419 conn(0x7fe2000f0d40 msgr2=0x7fe2000fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 shutdown_connections 2022-02-02T22:14:25.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:25.927+0000 7fe207aad700 1 -- 172.21.15.96:0/4111396419 wait complete. 2022-02-02T22:14:25.936 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:14:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 -- 172.21.15.96:0/2105825618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f66e0 msgr2=0x7f64f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/2105825618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f66e0 0x7f64f00f6b00 secure :-1 s=READY pgs=3564 cs=0 l=1 rev1=1 rx=0x7f64e0004660 tx=0x7f64e0009b30).stop 2022-02-02T22:14:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 -- 172.21.15.96:0/2105825618 shutdown_connections 2022-02-02T22:14:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/2105825618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f7980 0x7f64f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/2105825618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f66e0 0x7f64f00f6b00 unknown :-1 s=CLOSED pgs=3564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 -- 172.21.15.96:0/2105825618 >> 172.21.15.96:0/2105825618 conn(0x7f64f00f1e40 msgr2=0x7f64f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 -- 172.21.15.96:0/2105825618 shutdown_connections 2022-02-02T22:14:26.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.024+0000 7f64f7fcc700 1 -- 172.21.15.96:0/2105825618 wait complete. 2022-02-02T22:14:26.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 Processor -- start 2022-02-02T22:14:26.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 -- start start 2022-02-02T22:14:26.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f66e0 0x7f64f0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0107a50 con 0x7f64f00f7980 2022-02-02T22:14:26.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f7fcc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0107b90 con 0x7f64f00f66e0 2022-02-02T22:14:26.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5567700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5567700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47330/0 (socket says 172.21.15.96:47330) 2022-02-02T22:14:26.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5567700 1 -- 172.21.15.96:0/662775723 learned_addr learned my addr 172.21.15.96:0/662775723 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:26.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5d68700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f66e0 0x7f64f0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5567700 1 -- 172.21.15.96:0/662775723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f66e0 msgr2=0x7f64f0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.025+0000 7f64f5567700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f66e0 0x7f64f0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64f5567700 1 -- 172.21.15.96:0/662775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0005040 con 0x7f64f00f7980 2022-02-02T22:14:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64f5567700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 secure :-1 s=READY pgs=3565 cs=0 l=1 rev1=1 rx=0x7f64ec0026d0 tx=0x7f64ec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec0079c0 con 0x7f64f00f7980 2022-02-02T22:14:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64ec00f040 con 0x7f64f00f7980 2022-02-02T22:14:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0108530 con 0x7f64f00f7980 2022-02-02T22:14:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec0148b0 con 0x7f64f00f7980 2022-02-02T22:14:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.026+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0108af0 con 0x7f64f00f7980 2022-02-02T22:14:26.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.027+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f0045ad0 con 0x7f64f00f7980 2022-02-02T22:14:26.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.027+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f64ec007b20 con 0x7f64f00f7980 2022-02-02T22:14:26.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.027+0000 7f64e67fc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.028+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64ec081a00 con 0x7f64f00f7980 2022-02-02T22:14:26.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.028+0000 7f64f5d68700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.028+0000 7f64f5d68700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f64e0004630 tx=0x7f64e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.032+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f64ec0535e0 con 0x7f64f00f7980 2022-02-02T22:14:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.203+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f0108d40 con 0x7f64dc064dd0 2022-02-02T22:14:26.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.213+0000 7f64e67fc700 1 -- 172.21.15.96:0/662775723 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f64f0108d40 con 0x7f64dc064dd0 2022-02-02T22:14:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:14:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:14:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:14:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:14:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:14:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:14:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:14:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:14:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:14:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:14:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:14:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:14:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:14:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:14:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:14:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:14:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:14:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:14:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:14:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:14:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:14:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:14:26.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.214+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 msgr2=0x7f64dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.214+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f64e0004630 tx=0x7f64e0009b30).stop 2022-02-02T22:14:26.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 msgr2=0x7f64f01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 secure :-1 s=READY pgs=3565 cs=0 l=1 rev1=1 rx=0x7f64ec0026d0 tx=0x7f64ec009de0).stop 2022-02-02T22:14:26.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 shutdown_connections 2022-02-02T22:14:26.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64dc064dd0 0x7f64dc067290 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64f00f66e0 0x7f64f0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 --2- 172.21.15.96:0/662775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64f00f7980 0x7f64f01074a0 unknown :-1 s=CLOSED pgs=3565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 >> 172.21.15.96:0/662775723 conn(0x7f64f00f1e40 msgr2=0x7f64f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 shutdown_connections 2022-02-02T22:14:26.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.215+0000 7f64f7fcc700 1 -- 172.21.15.96:0/662775723 wait complete. 2022-02-02T22:14:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 -- 172.21.15.96:0/352521456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 msgr2=0x7f8f9c0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/352521456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c0f6b60 secure :-1 s=READY pgs=3566 cs=0 l=1 rev1=1 rx=0x7f8f90004660 tx=0x7f8f90009b30).stop 2022-02-02T22:14:26.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 -- 172.21.15.96:0/352521456 shutdown_connections 2022-02-02T22:14:26.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/352521456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c0f6b60 unknown :-1 s=CLOSED pgs=3566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/352521456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 0x7f8f9c0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 -- 172.21.15.96:0/352521456 >> 172.21.15.96:0/352521456 conn(0x7f8f9c0f0bc0 msgr2=0x7f8f9c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.312+0000 7f8fa13b2700 1 -- 172.21.15.96:0/352521456 shutdown_connections 2022-02-02T22:14:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 -- 172.21.15.96:0/352521456 wait complete. 2022-02-02T22:14:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 Processor -- start 2022-02-02T22:14:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 -- start start 2022-02-02T22:14:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 0x7f8f9c109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0603c0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.313+0000 7f8fa13b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c060500 con 0x7f8f9c0f5460 2022-02-02T22:14:26.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47340/0 (socket says 172.21.15.96:47340) 2022-02-02T22:14:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 -- 172.21.15.96:0/3930607155 learned_addr learned my addr 172.21.15.96:0/3930607155 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9affd700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 0x7f8f9c109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 -- 172.21.15.96:0/3930607155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 msgr2=0x7f8f9c109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 0x7f8f9c109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 -- 172.21.15.96:0/3930607155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90005040 con 0x7f8f9c0f6700 2022-02-02T22:14:26.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f9a7fc700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 secure :-1 s=READY pgs=3567 cs=0 l=1 rev1=1 rx=0x7f8f90009990 tx=0x7f8f90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f90018070 con 0x7f8f9c0f6700 2022-02-02T22:14:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c10c4c0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f90007ca0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9001c620 con 0x7f8f9c0f6700 2022-02-02T22:14:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.314+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c10c9f0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.315+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c059100 con 0x7f8f9c0f6700 2022-02-02T22:14:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.316+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f9001d960 con 0x7f8f9c0f6700 2022-02-02T22:14:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.316+0000 7f8f837fe700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 0x7f8f840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.316+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8f900837e0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.316+0000 7f8f9affd700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 0x7f8f840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.317+0000 7f8f9affd700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 0x7f8f840672e0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f8f9c060040 tx=0x7f8f8c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.320+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f900519a0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.551+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f9c045ad0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.551+0000 7f8f837fe700 1 -- 172.21.15.96:0/3930607155 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8f90054fc0 con 0x7f8f9c0f6700 2022-02-02T22:14:26.552 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:14:26.552 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:14:26.552 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:14:26.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:26.553 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:14:26.553 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:14:26.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:26.554 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:14:26.554 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:14:26.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:26.555 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:14:26.555 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:14:26.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:26.556 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:14:26.556 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:14:26.557 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:14:26.557 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:14:26.557 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:14:26.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 msgr2=0x7f8f840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 0x7f8f840672e0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f8f9c060040 tx=0x7f8f8c009040).stop 2022-02-02T22:14:26.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 msgr2=0x7f8f9c10bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 secure :-1 s=READY pgs=3567 cs=0 l=1 rev1=1 rx=0x7f8f90009990 tx=0x7f8f90009b30).stop 2022-02-02T22:14:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 shutdown_connections 2022-02-02T22:14:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8f84064e20 0x7f8f840672e0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f9c0f5460 0x7f8f9c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 --2- 172.21.15.96:0/3930607155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f9c0f6700 0x7f8f9c10bf70 unknown :-1 s=CLOSED pgs=3567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 >> 172.21.15.96:0/3930607155 conn(0x7f8f9c0f0bc0 msgr2=0x7f8f9c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 shutdown_connections 2022-02-02T22:14:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.553+0000 7f8fa13b2700 1 -- 172.21.15.96:0/3930607155 wait complete. 2022-02-02T22:14:26.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.652+0000 7fc2dcfef700 1 -- 172.21.15.96:0/3944762908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f5970 msgr2=0x7fc2d80f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.652+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/3944762908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f5970 0x7fc2d80f5df0 secure :-1 s=READY pgs=3568 cs=0 l=1 rev1=1 rx=0x7fc2c8004660 tx=0x7fc2c8009b30).stop 2022-02-02T22:14:26.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.656+0000 7fc2dcfef700 1 -- 172.21.15.96:0/3944762908 shutdown_connections 2022-02-02T22:14:26.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.656+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/3944762908 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f5970 0x7fc2d80f5df0 unknown :-1 s=CLOSED pgs=3568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.656+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/3944762908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f6c60 0x7fc2d80f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.656+0000 7fc2dcfef700 1 -- 172.21.15.96:0/3944762908 >> 172.21.15.96:0/3944762908 conn(0x7fc2d80f04c0 msgr2=0x7fc2d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.656+0000 7fc2dcfef700 1 -- 172.21.15.96:0/3944762908 shutdown_connections 2022-02-02T22:14:26.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.657+0000 7fc2dcfef700 1 -- 172.21.15.96:0/3944762908 wait complete. 2022-02-02T22:14:26.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.658+0000 7fc2dcfef700 1 Processor -- start 2022-02-02T22:14:26.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2dcfef700 1 -- start start 2022-02-02T22:14:26.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2dcfef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2dcfef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 0x7fc2d81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2dcfef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8107a50 con 0x7fc2d80f6c60 2022-02-02T22:14:26.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2dcfef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8107b90 con 0x7fc2d80f5970 2022-02-02T22:14:26.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2d659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2d659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:51452/0 (socket says 172.21.15.96:51452) 2022-02-02T22:14:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.659+0000 7fc2d659c700 1 -- 172.21.15.96:0/1703210002 learned_addr learned my addr 172.21.15.96:0/1703210002 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:26.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d5d9b700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 0x7fc2d81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d659c700 1 -- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 msgr2=0x7fc2d81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d659c700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 0x7fc2d81074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d659c700 1 -- 172.21.15.96:0/1703210002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8005040 con 0x7fc2d80f5970 2022-02-02T22:14:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d5d9b700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 0x7fc2d81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:14:26.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2d659c700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc2c000c530 tx=0x7fc2c0007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c000f650 con 0x7fc2d80f5970 2022-02-02T22:14:26.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2c000fc60 con 0x7fc2d80f5970 2022-02-02T22:14:26.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d8108530 con 0x7fc2d80f5970 2022-02-02T22:14:26.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c0012cd0 con 0x7fc2d80f5970 2022-02-02T22:14:26.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.660+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d8108af0 con 0x7fc2d80f5970 2022-02-02T22:14:26.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.661+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8045ad0 con 0x7fc2d80f5970 2022-02-02T22:14:26.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.662+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2c0010070 con 0x7fc2d80f5970 2022-02-02T22:14:26.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.662+0000 7fc2ceffd700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 0x7fc2c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:26.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.662+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2c00817a0 con 0x7fc2d80f5970 2022-02-02T22:14:26.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.662+0000 7fc2d5d9b700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 0x7fc2c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:26.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.663+0000 7fc2d5d9b700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 0x7fc2c4067290 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fc2c8009da0 tx=0x7fc2c8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:26.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.667+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2c00532d0 con 0x7fc2d80f5970 2022-02-02T22:14:26.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.868+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2d80ff0d0 con 0x7fc2d80f5970 2022-02-02T22:14:26.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:26 smithi096 ceph-mon[101353]: pgmap v6969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:26.869 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3930607155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:14:26.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.868+0000 7fc2ceffd700 1 -- 172.21.15.96:0/1703210002 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc2c0052ec0 con 0x7fc2d80f5970 2022-02-02T22:14:26.870 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:14:26.871 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:14:26.871 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:14:26.872 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:14:26.873 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:26.874 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:14:26.874 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:14:26.874 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:14:26.875 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:14:26.875 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:14:26.875 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:14:26.876 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:14:26.876 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:14:26.876 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:14:26.877 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:14:26.877 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:14:26.877 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:14:26.878 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:14:26.878 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:14:26.878 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:14:26.879 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:14:26.879 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:14:26.879 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:14:26.880 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:14:26.880 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:14:26.881 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:14:26.881 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:14:26.881 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:14:26.882 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:14:26.882 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:14:26.883 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:14:26.883 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:14:26.883 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:26.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:26.884 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:14:26.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:26.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:26.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:26.885 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:26.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 msgr2=0x7fc2c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 0x7fc2c4067290 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fc2c8009da0 tx=0x7fc2c8009b30).stop 2022-02-02T22:14:26.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 msgr2=0x7fc2d8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:26.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc2c000c530 tx=0x7fc2c0007e20).stop 2022-02-02T22:14:26.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 shutdown_connections 2022-02-02T22:14:26.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc2c4064dd0 0x7fc2c4067290 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2d80f5970 0x7fc2d8106fb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 --2- 172.21.15.96:0/1703210002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2d80f6c60 0x7fc2d81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:26.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.870+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 >> 172.21.15.96:0/1703210002 conn(0x7fc2d80f04c0 msgr2=0x7fc2d80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:26.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.871+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 shutdown_connections 2022-02-02T22:14:26.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:26.871+0000 7fc2dcfef700 1 -- 172.21.15.96:0/1703210002 wait complete. 2022-02-02T22:14:26.890 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:14:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:26 smithi159 ceph-mon[69013]: pgmap v6969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3930607155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:14:28.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:27 smithi159 ceph-mon[69013]: from='client.41244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:27 smithi159 ceph-mon[69013]: from='client.41248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1703210002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:14:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:27 smithi096 ceph-mon[101353]: from='client.41244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:27 smithi096 ceph-mon[101353]: from='client.41248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1703210002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:14:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:28 smithi159 ceph-mon[69013]: pgmap v6970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:14:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:14:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:28 smithi096 ceph-mon[101353]: pgmap v6970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:14:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:14:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:30 smithi159 ceph-mon[69013]: pgmap v6971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:30 smithi096 ceph-mon[101353]: pgmap v6971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:32 smithi159 ceph-mon[69013]: pgmap v6972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:32 smithi096 ceph-mon[101353]: pgmap v6972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:34 smithi159 ceph-mon[69013]: pgmap v6973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:34 smithi096 ceph-mon[101353]: pgmap v6973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:36 smithi159 ceph-mon[69013]: pgmap v6974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:36 smithi096 ceph-mon[101353]: pgmap v6974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:38 smithi159 ceph-mon[69013]: pgmap v6975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:38 smithi096 ceph-mon[101353]: pgmap v6975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:40 smithi159 ceph-mon[69013]: pgmap v6976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:40 smithi096 ceph-mon[101353]: pgmap v6976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:42 smithi159 ceph-mon[69013]: pgmap v6977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:42 smithi096 ceph-mon[101353]: pgmap v6977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:44 smithi159 ceph-mon[69013]: pgmap v6978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:44 smithi096 ceph-mon[101353]: pgmap v6978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:46 smithi159 ceph-mon[69013]: pgmap v6979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:46 smithi096 ceph-mon[101353]: pgmap v6979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:48 smithi159 ceph-mon[69013]: pgmap v6980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:48 smithi096 ceph-mon[101353]: pgmap v6980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:50 smithi159 ceph-mon[69013]: pgmap v6981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:50 smithi096 ceph-mon[101353]: pgmap v6981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:52 smithi159 ceph-mon[69013]: pgmap v6982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:52 smithi096 ceph-mon[101353]: pgmap v6982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:54 smithi159 ceph-mon[69013]: pgmap v6983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:54 smithi096 ceph-mon[101353]: pgmap v6983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:56.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 -- 172.21.15.96:0/259592663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f6860 msgr2=0x7feeb40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:56.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 --2- 172.21.15.96:0/259592663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f6860 0x7feeb40f6cc0 secure :-1 s=READY pgs=3569 cs=0 l=1 rev1=1 rx=0x7feea4004660 tx=0x7feea4009b30).stop 2022-02-02T22:14:56.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 -- 172.21.15.96:0/259592663 shutdown_connections 2022-02-02T22:14:56.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 --2- 172.21.15.96:0/259592663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f6860 0x7feeb40f6cc0 unknown :-1 s=CLOSED pgs=3569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:56.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 --2- 172.21.15.96:0/259592663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f55c0 0x7feeb40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:56.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 -- 172.21.15.96:0/259592663 >> 172.21.15.96:0/259592663 conn(0x7feeb40f0d40 msgr2=0x7feeb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:56.985 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:56 smithi096 ceph-mon[101353]: pgmap v6984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:56.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.981+0000 7feeb8de4700 1 -- 172.21.15.96:0/259592663 shutdown_connections 2022-02-02T22:14:56.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 -- 172.21.15.96:0/259592663 wait complete. 2022-02-02T22:14:56.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 Processor -- start 2022-02-02T22:14:56.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 -- start start 2022-02-02T22:14:56.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:56.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f6860 0x7feeb40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:56.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40f8100 con 0x7feeb40f55c0 2022-02-02T22:14:56.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb8de4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40f8240 con 0x7feeb40f6860 2022-02-02T22:14:56.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:56.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47366/0 (socket says 172.21.15.96:47366) 2022-02-02T22:14:56.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.982+0000 7feeb259c700 1 -- 172.21.15.96:0/2645591951 learned_addr learned my addr 172.21.15.96:0/2645591951 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:56.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb1d9b700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f6860 0x7feeb40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:56.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb259c700 1 -- 172.21.15.96:0/2645591951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f6860 msgr2=0x7feeb40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:56.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb259c700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f6860 0x7feeb40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:56.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb259c700 1 -- 172.21.15.96:0/2645591951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4005040 con 0x7feeb40f55c0 2022-02-02T22:14:56.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb259c700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 secure :-1 s=READY pgs=3570 cs=0 l=1 rev1=1 rx=0x7feea8002700 tx=0x7feea8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:56.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea80079c0 con 0x7feeb40f55c0 2022-02-02T22:14:56.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feea800f040 con 0x7feeb40f55c0 2022-02-02T22:14:56.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40f8520 con 0x7feeb40f55c0 2022-02-02T22:14:56.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea8014850 con 0x7feeb40f55c0 2022-02-02T22:14:56.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.983+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb410ef20 con 0x7feeb40f55c0 2022-02-02T22:14:56.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.984+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4045ad0 con 0x7feeb40f55c0 2022-02-02T22:14:56.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.985+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feea801b060 con 0x7feeb40f55c0 2022-02-02T22:14:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.985+0000 7feea2ffd700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 0x7fee9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.985+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feea80818b0 con 0x7feeb40f55c0 2022-02-02T22:14:56.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.985+0000 7feeb1d9b700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 0x7fee9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.986+0000 7feeb1d9b700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 0x7fee9c067290 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7feea4004630 tx=0x7feea4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:56.989+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feea804f9b0 con 0x7feeb40f55c0 2022-02-02T22:14:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:56 smithi159 ceph-mon[69013]: pgmap v6984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:57.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.170+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb40faca0 con 0x7fee9c064dd0 2022-02-02T22:14:57.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.171+0000 7feea2ffd700 1 -- 172.21.15.96:0/2645591951 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7feeb40faca0 con 0x7fee9c064dd0 2022-02-02T22:14:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 msgr2=0x7fee9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 0x7fee9c067290 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7feea4004630 tx=0x7feea4009b30).stop 2022-02-02T22:14:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 msgr2=0x7feeb40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 secure :-1 s=READY pgs=3570 cs=0 l=1 rev1=1 rx=0x7feea8002700 tx=0x7feea8009e00).stop 2022-02-02T22:14:57.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 shutdown_connections 2022-02-02T22:14:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee9c064dd0 0x7fee9c067290 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb40f55c0 0x7feeb40f9720 unknown :-1 s=CLOSED pgs=3570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 --2- 172.21.15.96:0/2645591951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb40f6860 0x7feeb40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 >> 172.21.15.96:0/2645591951 conn(0x7feeb40f0d40 msgr2=0x7feeb405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 shutdown_connections 2022-02-02T22:14:57.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.173+0000 7feeb8de4700 1 -- 172.21.15.96:0/2645591951 wait complete. 2022-02-02T22:14:57.184 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:14:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.270+0000 7effeb2b3700 1 -- 172.21.15.96:0/4111532770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f66d0 msgr2=0x7effe40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.270+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4111532770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f66d0 0x7effe40f6b30 secure :-1 s=READY pgs=3571 cs=0 l=1 rev1=1 rx=0x7effd4004660 tx=0x7effd4009b30).stop 2022-02-02T22:14:57.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 -- 172.21.15.96:0/4111532770 shutdown_connections 2022-02-02T22:14:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4111532770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f66d0 0x7effe40f6b30 unknown :-1 s=CLOSED pgs=3571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4111532770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f5430 0x7effe40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 -- 172.21.15.96:0/4111532770 >> 172.21.15.96:0/4111532770 conn(0x7effe40f0b90 msgr2=0x7effe40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 -- 172.21.15.96:0/4111532770 shutdown_connections 2022-02-02T22:14:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.271+0000 7effeb2b3700 1 -- 172.21.15.96:0/4111532770 wait complete. 2022-02-02T22:14:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 Processor -- start 2022-02-02T22:14:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 -- start start 2022-02-02T22:14:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f66d0 0x7effe41060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4106670 con 0x7effe40f5430 2022-02-02T22:14:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effeb2b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe41067b0 con 0x7effe40f66d0 2022-02-02T22:14:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47376/0 (socket says 172.21.15.96:47376) 2022-02-02T22:14:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 -- 172.21.15.96:0/4033463816 learned_addr learned my addr 172.21.15.96:0/4033463816 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effe9ab0700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f66d0 0x7effe41060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 -- 172.21.15.96:0/4033463816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f66d0 msgr2=0x7effe41060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f66d0 0x7effe41060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 -- 172.21.15.96:0/4033463816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4005040 con 0x7effe40f5430 2022-02-02T22:14:57.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.272+0000 7effea2b1700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 secure :-1 s=READY pgs=3572 cs=0 l=1 rev1=1 rx=0x7effe000e7c0 tx=0x7effe000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.273+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe00092e0 con 0x7effe40f5430 2022-02-02T22:14:57.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.273+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effe000f040 con 0x7effe40f5430 2022-02-02T22:14:57.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.273+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe00147e0 con 0x7effe40f5430 2022-02-02T22:14:57.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.273+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe4107150 con 0x7effe40f5430 2022-02-02T22:14:57.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.273+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe4107710 con 0x7effe40f5430 2022-02-02T22:14:57.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.274+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe4045ad0 con 0x7effe40f5430 2022-02-02T22:14:57.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.274+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7effe001b030 con 0x7effe40f5430 2022-02-02T22:14:57.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.274+0000 7effdaffd700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 0x7effd00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.274+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7effe0081910 con 0x7effe40f5430 2022-02-02T22:14:57.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.274+0000 7effe9ab0700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 0x7effd00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.275+0000 7effe9ab0700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 0x7effd00672e0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7effd4005010 tx=0x7effd4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.279+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7effe0053440 con 0x7effe40f5430 2022-02-02T22:14:57.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.456+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effe40fdd30 con 0x7effd0064e20 2022-02-02T22:14:57.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.466+0000 7effdaffd700 1 -- 172.21.15.96:0/4033463816 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7effe40fdd30 con 0x7effd0064e20 2022-02-02T22:14:57.468 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:14:57.468 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:14:57.468 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:14:57.469 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:14:57.469 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:14:57.469 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:14:57.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:14:57.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:14:57.470 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:14:57.471 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:14:57.471 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:14:57.471 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:14:57.472 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:14:57.472 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:14:57.472 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:14:57.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:14:57.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:14:57.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:14:57.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:14:57.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:14:57.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:14:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 msgr2=0x7effd00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 0x7effd00672e0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7effd4005010 tx=0x7effd4016040).stop 2022-02-02T22:14:57.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 msgr2=0x7effe4105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 secure :-1 s=READY pgs=3572 cs=0 l=1 rev1=1 rx=0x7effe000e7c0 tx=0x7effe000b040).stop 2022-02-02T22:14:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 shutdown_connections 2022-02-02T22:14:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effd0064e20 0x7effd00672e0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effe40f5430 0x7effe4105bd0 unknown :-1 s=CLOSED pgs=3572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 --2- 172.21.15.96:0/4033463816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe40f66d0 0x7effe41060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 >> 172.21.15.96:0/4033463816 conn(0x7effe40f0b90 msgr2=0x7effe40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 shutdown_connections 2022-02-02T22:14:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.468+0000 7effeb2b3700 1 -- 172.21.15.96:0/4033463816 wait complete. 2022-02-02T22:14:57.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1381901505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f66d0 msgr2=0x7fcf380f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1381901505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f66d0 0x7fcf380f6b30 secure :-1 s=READY pgs=3573 cs=0 l=1 rev1=1 rx=0x7fcf28004660 tx=0x7fcf28009b30).stop 2022-02-02T22:14:57.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1381901505 shutdown_connections 2022-02-02T22:14:57.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1381901505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f66d0 0x7fcf380f6b30 unknown :-1 s=CLOSED pgs=3573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1381901505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f5430 0x7fcf380f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.564+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1381901505 >> 172.21.15.96:0/1381901505 conn(0x7fcf380f0b90 msgr2=0x7fcf380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1381901505 shutdown_connections 2022-02-02T22:14:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1381901505 wait complete. 2022-02-02T22:14:57.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 Processor -- start 2022-02-02T22:14:57.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 -- start start 2022-02-02T22:14:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f66d0 0x7fcf38107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38107870 con 0x7fcf380f5430 2022-02-02T22:14:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3ef49700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381080b0 con 0x7fcf380f66d0 2022-02-02T22:14:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3df47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3df47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47386/0 (socket says 172.21.15.96:47386) 2022-02-02T22:14:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.565+0000 7fcf3df47700 1 -- 172.21.15.96:0/1861646230 learned_addr learned my addr 172.21.15.96:0/1861646230 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:57.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3d746700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f66d0 0x7fcf38107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3df47700 1 -- 172.21.15.96:0/1861646230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f66d0 msgr2=0x7fcf38107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3df47700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f66d0 0x7fcf38107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3df47700 1 -- 172.21.15.96:0/1861646230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28005040 con 0x7fcf380f5430 2022-02-02T22:14:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3df47700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 secure :-1 s=READY pgs=3574 cs=0 l=1 rev1=1 rx=0x7fcf3400c530 tx=0x7fcf34007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3400f650 con 0x7fcf380f5430 2022-02-02T22:14:57.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf3400fc60 con 0x7fcf380f5430 2022-02-02T22:14:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf34012d20 con 0x7fcf380f5430 2022-02-02T22:14:57.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf38108390 con 0x7fcf380f5430 2022-02-02T22:14:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.566+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf381088d0 con 0x7fcf380f5430 2022-02-02T22:14:57.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.567+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf38059100 con 0x7fcf380f5430 2022-02-02T22:14:57.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.567+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf34019030 con 0x7fcf380f5430 2022-02-02T22:14:57.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.568+0000 7fcf2e7fc700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 0x7fcf240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.568+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcf340816b0 con 0x7fcf380f5430 2022-02-02T22:14:57.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.568+0000 7fcf3d746700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 0x7fcf240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.568+0000 7fcf3d746700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 0x7fcf240672e0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fcf28004e30 tx=0x7fcf28009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.572+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf340487d0 con 0x7fcf380f5430 2022-02-02T22:14:57.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.801+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf3810d390 con 0x7fcf380f5430 2022-02-02T22:14:57.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.802+0000 7fcf2e7fc700 1 -- 172.21.15.96:0/1861646230 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcf3404f8c0 con 0x7fcf380f5430 2022-02-02T22:14:57.803 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:14:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:14:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:14:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:14:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:14:57.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:57.806 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:14:57.806 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:14:57.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:57.807 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:14:57.807 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:14:57.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:14:57.808 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:14:57.808 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:14:57.809 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:14:57.809 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:14:57.809 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:14:57.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 msgr2=0x7fcf240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 0x7fcf240672e0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fcf28004e30 tx=0x7fcf28009b30).stop 2022-02-02T22:14:57.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 msgr2=0x7fcf38106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 secure :-1 s=READY pgs=3574 cs=0 l=1 rev1=1 rx=0x7fcf3400c530 tx=0x7fcf34007e10).stop 2022-02-02T22:14:57.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 shutdown_connections 2022-02-02T22:14:57.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcf24064e20 0x7fcf240672e0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf380f5430 0x7fcf38106d80 unknown :-1 s=CLOSED pgs=3574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 --2- 172.21.15.96:0/1861646230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf380f66d0 0x7fcf38107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 >> 172.21.15.96:0/1861646230 conn(0x7fcf380f0b90 msgr2=0x7fcf3805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 shutdown_connections 2022-02-02T22:14:57.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.804+0000 7fcf3ef49700 1 -- 172.21.15.96:0/1861646230 wait complete. 2022-02-02T22:14:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.900+0000 7f52bd36b700 1 -- 172.21.15.96:0/2561678708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f7980 msgr2=0x7f52b80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.900+0000 7f52bd36b700 1 --2- 172.21.15.96:0/2561678708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f7980 0x7f52b80f7de0 secure :-1 s=READY pgs=3575 cs=0 l=1 rev1=1 rx=0x7f52a0004660 tx=0x7f52a0009b30).stop 2022-02-02T22:14:57.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 -- 172.21.15.96:0/2561678708 shutdown_connections 2022-02-02T22:14:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 --2- 172.21.15.96:0/2561678708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f7980 0x7f52b80f7de0 unknown :-1 s=CLOSED pgs=3575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 --2- 172.21.15.96:0/2561678708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b80f66e0 0x7f52b80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:57.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 -- 172.21.15.96:0/2561678708 >> 172.21.15.96:0/2561678708 conn(0x7f52b80f1e40 msgr2=0x7f52b80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:57.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 -- 172.21.15.96:0/2561678708 shutdown_connections 2022-02-02T22:14:57.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.901+0000 7f52bd36b700 1 -- 172.21.15.96:0/2561678708 wait complete. 2022-02-02T22:14:57.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 Processor -- start 2022-02-02T22:14:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 -- start start 2022-02-02T22:14:57.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b80f7980 0x7f52b8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8107a00 con 0x7f52b80f66e0 2022-02-02T22:14:57.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52bd36b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8107b40 con 0x7f52b80f7980 2022-02-02T22:14:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47396/0 (socket says 172.21.15.96:47396) 2022-02-02T22:14:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.902+0000 7f52b6ffd700 1 -- 172.21.15.96:0/444181003 learned_addr learned my addr 172.21.15.96:0/444181003 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:14:57.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52b6ffd700 1 -- 172.21.15.96:0/444181003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b80f7980 msgr2=0x7f52b8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:57.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52b6ffd700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b80f7980 0x7f52b8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:14:57.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52b6ffd700 1 -- 172.21.15.96:0/444181003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0005040 con 0x7f52b80f66e0 2022-02-02T22:14:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52b6ffd700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 secure :-1 s=READY pgs=3576 cs=0 l=1 rev1=1 rx=0x7f52b000c710 tx=0x7f52b0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b00106f0 con 0x7f52b80f66e0 2022-02-02T22:14:57.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52b0010d00 con 0x7f52b80f66e0 2022-02-02T22:14:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b0012d90 con 0x7f52b80f66e0 2022-02-02T22:14:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b81084e0 con 0x7f52b80f66e0 2022-02-02T22:14:57.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.903+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8108aa0 con 0x7f52b80f66e0 2022-02-02T22:14:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.904+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b8045ad0 con 0x7f52b80f66e0 2022-02-02T22:14:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.905+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52b0010070 con 0x7f52b80f66e0 2022-02-02T22:14:57.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.905+0000 7f52af7fe700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 0x7f52a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:14:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.905+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52b0081ea0 con 0x7f52b80f66e0 2022-02-02T22:14:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.906+0000 7f52b67fc700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 0x7f52a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:14:57.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.906+0000 7f52b67fc700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 0x7f52a4067290 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f52a0004e30 tx=0x7f52a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:14:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:57.910+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52b0053a90 con 0x7f52b80f66e0 2022-02-02T22:14:58.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.110+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f52b8108d70 con 0x7f52b80f66e0 2022-02-02T22:14:58.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.110+0000 7f52af7fe700 1 -- 172.21.15.96:0/444181003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f52b0053680 con 0x7f52b80f66e0 2022-02-02T22:14:58.112 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:14:58.113 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:14:58.113 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:14:58.113 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:14:58.114 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:58.114 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:14:58.114 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:14:58.115 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:14:58.115 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:14:58.116 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:14:58.116 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:14:58.116 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:14:58.117 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:14:58.117 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:14:58.118 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:14:58.118 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:14:58.118 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:14:58.119 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:14:58.119 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:14:58.119 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:14:58.120 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:14:58.120 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:14:58.120 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:14:58.121 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:14:58.121 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:14:58.121 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:14:58.122 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:14:58.122 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:14:58.122 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:14:58.123 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:14:58.123 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:14:58.123 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:14:58.124 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:58.124 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:58.124 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:14:58.125 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:14:58.125 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:58.125 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:58.126 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:14:58.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 msgr2=0x7f52a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:58.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 0x7f52a4067290 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f52a0004e30 tx=0x7f52a0009b30).stop 2022-02-02T22:14:58.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 msgr2=0x7f52b8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:14:58.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 secure :-1 s=READY pgs=3576 cs=0 l=1 rev1=1 rx=0x7f52b000c710 tx=0x7f52b0004d10).stop 2022-02-02T22:14:58.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 shutdown_connections 2022-02-02T22:14:58.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52a4064dd0 0x7f52a4067290 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:58.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52b80f66e0 0x7f52b8106f60 unknown :-1 s=CLOSED pgs=3576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:14:58.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 --2- 172.21.15.96:0/444181003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52b80f7980 0x7f52b8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:14:58.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 >> 172.21.15.96:0/444181003 conn(0x7f52b80f1e40 msgr2=0x7f52b80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:14:58.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 shutdown_connections 2022-02-02T22:14:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:14:58.112+0000 7f52bd36b700 1 -- 172.21.15.96:0/444181003 wait complete. 2022-02-02T22:14:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:14:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:58 smithi159 ceph-mon[69013]: pgmap v6985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:58 smithi159 ceph-mon[69013]: from='client.41258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:58 smithi159 ceph-mon[69013]: from='client.41262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1861646230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:14:59.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:14:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/444181003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:14:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:58 smithi096 ceph-mon[101353]: pgmap v6985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:14:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:58 smithi096 ceph-mon[101353]: from='client.41258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:59.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:58 smithi096 ceph-mon[101353]: from='client.41262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:14:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1861646230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:14:59.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:14:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/444181003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:15:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:00 smithi159 ceph-mon[69013]: pgmap v6986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:00 smithi096 ceph-mon[101353]: pgmap v6986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:02 smithi159 ceph-mon[69013]: pgmap v6987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:02 smithi096 ceph-mon[101353]: pgmap v6987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:04 smithi159 ceph-mon[69013]: pgmap v6988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:04 smithi096 ceph-mon[101353]: pgmap v6988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:06 smithi159 ceph-mon[69013]: pgmap v6989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:06 smithi096 ceph-mon[101353]: pgmap v6989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:08 smithi159 ceph-mon[69013]: pgmap v6990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:08 smithi096 ceph-mon[101353]: pgmap v6990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:10 smithi159 ceph-mon[69013]: pgmap v6991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:10 smithi096 ceph-mon[101353]: pgmap v6991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:12 smithi159 ceph-mon[69013]: pgmap v6992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:12 smithi096 ceph-mon[101353]: pgmap v6992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:14 smithi159 ceph-mon[69013]: pgmap v6993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:14 smithi096 ceph-mon[101353]: pgmap v6993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:16 smithi159 ceph-mon[69013]: pgmap v6994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:16 smithi096 ceph-mon[101353]: pgmap v6994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:18 smithi159 ceph-mon[69013]: pgmap v6995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:18 smithi096 ceph-mon[101353]: pgmap v6995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:20 smithi159 ceph-mon[69013]: pgmap v6996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:20 smithi096 ceph-mon[101353]: pgmap v6996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:22 smithi159 ceph-mon[69013]: pgmap v6997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:23.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:22 smithi096 ceph-mon[101353]: pgmap v6997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:24 smithi159 ceph-mon[69013]: pgmap v6998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:24 smithi096 ceph-mon[101353]: pgmap v6998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:26 smithi159 ceph-mon[69013]: pgmap v6999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:26 smithi096 ceph-mon[101353]: pgmap v6999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:28.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 -- 172.21.15.96:0/1911241263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f55c0 msgr2=0x7faee40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 --2- 172.21.15.96:0/1911241263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f55c0 0x7faee40f59e0 secure :-1 s=READY pgs=3577 cs=0 l=1 rev1=1 rx=0x7faed8004660 tx=0x7faed8009b30).stop 2022-02-02T22:15:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 -- 172.21.15.96:0/1911241263 shutdown_connections 2022-02-02T22:15:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 --2- 172.21.15.96:0/1911241263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f6860 0x7faee40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 --2- 172.21.15.96:0/1911241263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f55c0 0x7faee40f59e0 unknown :-1 s=CLOSED pgs=3577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 -- 172.21.15.96:0/1911241263 >> 172.21.15.96:0/1911241263 conn(0x7faee40f0d40 msgr2=0x7faee40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.224+0000 7faee885c700 1 -- 172.21.15.96:0/1911241263 shutdown_connections 2022-02-02T22:15:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 -- 172.21.15.96:0/1911241263 wait complete. 2022-02-02T22:15:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 Processor -- start 2022-02-02T22:15:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 -- start start 2022-02-02T22:15:28.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f55c0 0x7faee40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40f8100 con 0x7faee40f6860 2022-02-02T22:15:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee885c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40f8240 con 0x7faee40f55c0 2022-02-02T22:15:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47418/0 (socket says 172.21.15.96:47418) 2022-02-02T22:15:28.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee1d9b700 1 -- 172.21.15.96:0/1740206071 learned_addr learned my addr 172.21.15.96:0/1740206071 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:28.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.225+0000 7faee259c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f55c0 0x7faee40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee1d9b700 1 -- 172.21.15.96:0/1740206071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f55c0 msgr2=0x7faee40f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee1d9b700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f55c0 0x7faee40f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee1d9b700 1 -- 172.21.15.96:0/1740206071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8005040 con 0x7faee40f6860 2022-02-02T22:15:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee1d9b700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 secure :-1 s=READY pgs=3578 cs=0 l=1 rev1=1 rx=0x7faed40026d0 tx=0x7faed4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed40079c0 con 0x7faee40f6860 2022-02-02T22:15:28.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee40f8520 con 0x7faee40f6860 2022-02-02T22:15:28.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faed400f040 con 0x7faee40f6860 2022-02-02T22:15:28.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed40148b0 con 0x7faee40f6860 2022-02-02T22:15:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.226+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee410efa0 con 0x7faee40f6860 2022-02-02T22:15:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.227+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8004fa0 con 0x7faee40f6860 2022-02-02T22:15:28.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.228+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faed4014a10 con 0x7faee40f6860 2022-02-02T22:15:28.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.228+0000 7faed2ffd700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.228+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faed40818c0 con 0x7faee40f6860 2022-02-02T22:15:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.228+0000 7faee259c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.228+0000 7faee259c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7faed8013690 tx=0x7faed8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.232+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faed404fa70 con 0x7faee40f6860 2022-02-02T22:15:28.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.411+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faec8000bc0 con 0x7faecc064dd0 2022-02-02T22:15:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.412+0000 7faed2ffd700 1 -- 172.21.15.96:0/1740206071 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faec8000bc0 con 0x7faecc064dd0 2022-02-02T22:15:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 msgr2=0x7faecc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7faed8013690 tx=0x7faed8009b30).stop 2022-02-02T22:15:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 msgr2=0x7faee40f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 secure :-1 s=READY pgs=3578 cs=0 l=1 rev1=1 rx=0x7faed40026d0 tx=0x7faed4009de0).stop 2022-02-02T22:15:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 shutdown_connections 2022-02-02T22:15:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee40f55c0 0x7faee40f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 --2- 172.21.15.96:0/1740206071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee40f6860 0x7faee40f7ba0 unknown :-1 s=CLOSED pgs=3578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 >> 172.21.15.96:0/1740206071 conn(0x7faee40f0d40 msgr2=0x7faee405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 shutdown_connections 2022-02-02T22:15:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.414+0000 7faee885c700 1 -- 172.21.15.96:0/1740206071 wait complete. 2022-02-02T22:15:28.423 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:15:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 -- 172.21.15.96:0/2828616073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80f9690 msgr2=0x7effd80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 --2- 172.21.15.96:0/2828616073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80f9690 0x7effd80fbae0 secure :-1 s=READY pgs=3579 cs=0 l=1 rev1=1 rx=0x7effc8004660 tx=0x7effc8009b30).stop 2022-02-02T22:15:28.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 -- 172.21.15.96:0/2828616073 shutdown_connections 2022-02-02T22:15:28.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 --2- 172.21.15.96:0/2828616073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80f9690 0x7effd80fbae0 unknown :-1 s=CLOSED pgs=3579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 --2- 172.21.15.96:0/2828616073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd8060310 0x7effd80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:15:28.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 -- 172.21.15.96:0/2828616073 >> 172.21.15.96:0/2828616073 conn(0x7effd80f0b90 msgr2=0x7effd80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:28.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 -- 172.21.15.96:0/2828616073 shutdown_connections 2022-02-02T22:15:28.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.511+0000 7effdc944700 1 -- 172.21.15.96:0/2828616073 wait complete. 2022-02-02T22:15:28.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 Processor -- start 2022-02-02T22:15:28.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 -- start start 2022-02-02T22:15:28.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd80f9690 0x7effd81072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8107950 con 0x7effd8060310 2022-02-02T22:15:28.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effdc944700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8108100 con 0x7effd80f9690 2022-02-02T22:15:28.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effd6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effd6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47426/0 (socket says 172.21.15.96:47426) 2022-02-02T22:15:28.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effd6d9d700 1 -- 172.21.15.96:0/4162679431 learned_addr learned my addr 172.21.15.96:0/4162679431 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:28.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.512+0000 7effd659c700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd80f9690 0x7effd81072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effd6d9d700 1 -- 172.21.15.96:0/4162679431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd80f9690 msgr2=0x7effd81072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effd6d9d700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd80f9690 0x7effd81072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effd6d9d700 1 -- 172.21.15.96:0/4162679431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8005040 con 0x7effd8060310 2022-02-02T22:15:28.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effd6d9d700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 secure :-1 s=READY pgs=3580 cs=0 l=1 rev1=1 rx=0x7effcc00b490 tx=0x7effcc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc010950 con 0x7effd8060310 2022-02-02T22:15:28.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd81083e0 con 0x7effd8060310 2022-02-02T22:15:28.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effcc014070 con 0x7effd8060310 2022-02-02T22:15:28.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc017c70 con 0x7effd8060310 2022-02-02T22:15:28.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.513+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd81089a0 con 0x7effd8060310 2022-02-02T22:15:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.514+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd8059100 con 0x7effd8060310 2022-02-02T22:15:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.514+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7effcc020070 con 0x7effd8060310 2022-02-02T22:15:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.515+0000 7effbf7fe700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 0x7effc00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.515+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7effcc085770 con 0x7effd8060310 2022-02-02T22:15:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.515+0000 7effd659c700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 0x7effc00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.515+0000 7effd659c700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 0x7effc00672e0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7effd8106b60 tx=0x7effc8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.520+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7effcc053810 con 0x7effd8060310 2022-02-02T22:15:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.693+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effd80fee50 con 0x7effc0064e20 2022-02-02T22:15:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.703+0000 7effbf7fe700 1 -- 172.21.15.96:0/4162679431 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7effd80fee50 con 0x7effc0064e20 2022-02-02T22:15:28.703 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:15:28.703 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 3h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:15:28.704 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 3h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:15:28.704 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:15:28.704 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 3h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:15:28.705 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:15:28.705 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:15:28.705 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:15:28.706 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:15:28.706 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:15:28.707 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:15:28.707 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:15:28.707 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:15:28.708 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3h) 3h ago 3h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:15:28.708 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:15:28.708 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:15:28.709 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:15:28.709 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:15:28.709 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:15:28.710 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:15:28.710 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:15:28.710 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 3h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:15:28.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 msgr2=0x7effc00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 0x7effc00672e0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7effd8106b60 tx=0x7effc8009b30).stop 2022-02-02T22:15:28.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 msgr2=0x7effd8106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 secure :-1 s=READY pgs=3580 cs=0 l=1 rev1=1 rx=0x7effcc00b490 tx=0x7effcc006ef0).stop 2022-02-02T22:15:28.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 shutdown_connections 2022-02-02T22:15:28.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7effc0064e20 0x7effc00672e0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8060310 0x7effd8106dd0 unknown :-1 s=CLOSED pgs=3580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 --2- 172.21.15.96:0/4162679431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effd80f9690 0x7effd81072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.704+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 >> 172.21.15.96:0/4162679431 conn(0x7effd80f0b90 msgr2=0x7effd80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:28.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.705+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 shutdown_connections 2022-02-02T22:15:28.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.705+0000 7effdc944700 1 -- 172.21.15.96:0/4162679431 wait complete. 2022-02-02T22:15:28.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/1857725213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 msgr2=0x7f0cf40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/1857725213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf40f6b30 secure :-1 s=READY pgs=3581 cs=0 l=1 rev1=1 rx=0x7f0ce4004660 tx=0x7f0ce4009b30).stop 2022-02-02T22:15:28.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/1857725213 shutdown_connections 2022-02-02T22:15:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/1857725213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf40f6b30 unknown :-1 s=CLOSED pgs=3581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/1857725213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 0x7f0cf40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/1857725213 >> 172.21.15.96:0/1857725213 conn(0x7f0cf40f0b90 msgr2=0x7f0cf40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:28 smithi096 ceph-mon[101353]: pgmap v7000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:15:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:15:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.801+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/1857725213 shutdown_connections 2022-02-02T22:15:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/1857725213 wait complete. 2022-02-02T22:15:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 Processor -- start 2022-02-02T22:15:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 -- start start 2022-02-02T22:15:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 0x7f0cf4109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40603c0 con 0x7f0cf40f66d0 2022-02-02T22:15:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.802+0000 7f0cfaa5e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4060500 con 0x7f0cf40f5430 2022-02-02T22:15:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47438/0 (socket says 172.21.15.96:47438) 2022-02-02T22:15:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 -- 172.21.15.96:0/3832446342 learned_addr learned my addr 172.21.15.96:0/3832446342 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf9a5c700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 0x7f0cf4109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 -- 172.21.15.96:0/3832446342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 msgr2=0x7f0cf4109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 0x7f0cf4109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 -- 172.21.15.96:0/3832446342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4005040 con 0x7f0cf40f66d0 2022-02-02T22:15:28.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cf925b700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 secure :-1 s=READY pgs=3582 cs=0 l=1 rev1=1 rx=0x7f0ce4009990 tx=0x7f0ce4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce4018070 con 0x7f0cf40f66d0 2022-02-02T22:15:28.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ce4007ba0 con 0x7f0cf40f66d0 2022-02-02T22:15:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf410c490 con 0x7f0cf40f66d0 2022-02-02T22:15:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce401c620 con 0x7f0cf40f66d0 2022-02-02T22:15:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.803+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf410c9c0 con 0x7f0cf40f66d0 2022-02-02T22:15:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.804+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4059100 con 0x7f0cf40f66d0 2022-02-02T22:15:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.805+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ce401c8e0 con 0x7f0cf40f66d0 2022-02-02T22:15:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.805+0000 7f0cea7fc700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 0x7f0ce00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.805+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ce4083890 con 0x7f0cf40f66d0 2022-02-02T22:15:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.805+0000 7f0cf9a5c700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 0x7f0ce00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.806+0000 7f0cf9a5c700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 0x7f0ce00672e0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f0cf4060040 tx=0x7f0cf0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:28.809+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ce4051990 con 0x7f0cf40f66d0 2022-02-02T22:15:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:28 smithi159 ceph-mon[69013]: pgmap v7000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:15:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:15:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.042+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cf40fdcc0 con 0x7f0cf40f66d0 2022-02-02T22:15:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.043+0000 7f0cea7fc700 1 -- 172.21.15.96:0/3832446342 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0ce4054fb0 con 0x7f0cf40f66d0 2022-02-02T22:15:29.043 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:15:29.043 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:15:29.044 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:15:29.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:15:29.044 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:15:29.045 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:15:29.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:15:29.045 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:15:29.046 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:15:29.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:15:29.046 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:15:29.047 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:15:29.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:15:29.047 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:15:29.048 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:15:29.048 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:15:29.048 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:15:29.049 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:15:29.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 msgr2=0x7f0ce00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 0x7f0ce00672e0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f0cf4060040 tx=0x7f0cf0009040).stop 2022-02-02T22:15:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 msgr2=0x7f0cf410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 secure :-1 s=READY pgs=3582 cs=0 l=1 rev1=1 rx=0x7f0ce4009990 tx=0x7f0ce4009b30).stop 2022-02-02T22:15:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 shutdown_connections 2022-02-02T22:15:29.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ce0064e20 0x7f0ce00672e0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cf40f5430 0x7f0cf4109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 --2- 172.21.15.96:0/3832446342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cf40f66d0 0x7f0cf410bf40 unknown :-1 s=CLOSED pgs=3582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.044+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 >> 172.21.15.96:0/3832446342 conn(0x7f0cf40f0b90 msgr2=0x7f0cf40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.045+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 shutdown_connections 2022-02-02T22:15:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.045+0000 7f0cfaa5e700 1 -- 172.21.15.96:0/3832446342 wait complete. 2022-02-02T22:15:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 -- 172.21.15.96:0/1520802018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f66e0 msgr2=0x7f837c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 --2- 172.21.15.96:0/1520802018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f66e0 0x7f837c0f6b00 secure :-1 s=READY pgs=3583 cs=0 l=1 rev1=1 rx=0x7f836c004660 tx=0x7f836c009b30).stop 2022-02-02T22:15:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 -- 172.21.15.96:0/1520802018 shutdown_connections 2022-02-02T22:15:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 --2- 172.21.15.96:0/1520802018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f7980 0x7f837c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 --2- 172.21.15.96:0/1520802018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f66e0 0x7f837c0f6b00 unknown :-1 s=CLOSED pgs=3583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 -- 172.21.15.96:0/1520802018 >> 172.21.15.96:0/1520802018 conn(0x7f837c0f1e40 msgr2=0x7f837c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:29.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 -- 172.21.15.96:0/1520802018 shutdown_connections 2022-02-02T22:15:29.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.140+0000 7f8382a24700 1 -- 172.21.15.96:0/1520802018 wait complete. 2022-02-02T22:15:29.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 Processor -- start 2022-02-02T22:15:29.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 -- start start 2022-02-02T22:15:29.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f66e0 0x7f837c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:29.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:29.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c107a00 con 0x7f837c0f7980 2022-02-02T22:15:29.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f8382a24700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c107b40 con 0x7f837c0f66e0 2022-02-02T22:15:29.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:29.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47448/0 (socket says 172.21.15.96:47448) 2022-02-02T22:15:29.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f837b7fe700 1 -- 172.21.15.96:0/2536042457 learned_addr learned my addr 172.21.15.96:0/2536042457 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:29.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.141+0000 7f837bfff700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f66e0 0x7f837c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:29.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f837b7fe700 1 -- 172.21.15.96:0/2536042457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f66e0 msgr2=0x7f837c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f837b7fe700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f66e0 0x7f837c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f837b7fe700 1 -- 172.21.15.96:0/2536042457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c005040 con 0x7f837c0f7980 2022-02-02T22:15:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f837b7fe700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 secure :-1 s=READY pgs=3584 cs=0 l=1 rev1=1 rx=0x7f837000e7f0 tx=0x7f837000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83700092e0 con 0x7f837c0f7980 2022-02-02T22:15:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f837000f040 con 0x7f837c0f7980 2022-02-02T22:15:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c1084e0 con 0x7f837c0f7980 2022-02-02T22:15:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370014750 con 0x7f837c0f7980 2022-02-02T22:15:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.142+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c108aa0 con 0x7f837c0f7980 2022-02-02T22:15:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.143+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c045ad0 con 0x7f837c0f7980 2022-02-02T22:15:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.144+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f837001b030 con 0x7f837c0f7980 2022-02-02T22:15:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.144+0000 7f8378ff9700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 0x7f8364067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.144+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8370081730 con 0x7f837c0f7980 2022-02-02T22:15:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.144+0000 7f837bfff700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 0x7f8364067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:29.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.144+0000 7f837bfff700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 0x7f8364067290 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f836c004d80 tx=0x7f836c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:29.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.148+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8370053310 con 0x7f837c0f7980 2022-02-02T22:15:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.347+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f837c027a00 con 0x7f837c0f7980 2022-02-02T22:15:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.349+0000 7f8378ff9700 1 -- 172.21.15.96:0/2536042457 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8370019720 con 0x7f837c0f7980 2022-02-02T22:15:29.350 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:15:29.351 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:15:29.351 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:15:29.352 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:15:29.352 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:15:29.352 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:15:29.353 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:15:29.353 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:15:29.353 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:15:29.354 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:15:29.354 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:15:29.354 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:15:29.355 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:15:29.355 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:15:29.355 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:15:29.356 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:15:29.356 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:15:29.356 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:15:29.357 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:15:29.357 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:15:29.357 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:15:29.358 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:15:29.358 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:15:29.358 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:15:29.359 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:15:29.359 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:15:29.359 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:15:29.360 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:15:29.360 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:15:29.360 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:15:29.361 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:15:29.361 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:15:29.361 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:15:29.362 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:15:29.362 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:15:29.362 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:15:29.363 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:15:29.363 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:15:29.363 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:15:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 msgr2=0x7f8364067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 0x7f8364067290 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f836c004d80 tx=0x7f836c016040).stop 2022-02-02T22:15:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 msgr2=0x7f837c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 secure :-1 s=READY pgs=3584 cs=0 l=1 rev1=1 rx=0x7f837000e7f0 tx=0x7f837000b040).stop 2022-02-02T22:15:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 shutdown_connections 2022-02-02T22:15:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8364064dd0 0x7f8364067290 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f837c0f66e0 0x7f837c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 --2- 172.21.15.96:0/2536042457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f837c0f7980 0x7f837c107450 unknown :-1 s=CLOSED pgs=3584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 >> 172.21.15.96:0/2536042457 conn(0x7f837c0f1e40 msgr2=0x7f837c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 shutdown_connections 2022-02-02T22:15:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:29.351+0000 7f8382a24700 1 -- 172.21.15.96:0/2536042457 wait complete. 2022-02-02T22:15:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:15:30.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:29 smithi159 ceph-mon[69013]: from='client.41274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:15:30.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:29 smithi159 ceph-mon[69013]: from='client.41278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:15:30.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3832446342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:15:30.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2536042457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:15:30.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:29 smithi096 ceph-mon[101353]: from='client.41274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:15:30.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:29 smithi096 ceph-mon[101353]: from='client.41278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:15:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3832446342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:15:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2536042457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:15:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:30 smithi159 ceph-mon[69013]: pgmap v7001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:30 smithi096 ceph-mon[101353]: pgmap v7001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:32 smithi159 ceph-mon[69013]: pgmap v7002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:32 smithi096 ceph-mon[101353]: pgmap v7002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:34 smithi159 ceph-mon[69013]: pgmap v7003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:34 smithi096 ceph-mon[101353]: pgmap v7003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:36 smithi159 ceph-mon[69013]: pgmap v7004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:36 smithi096 ceph-mon[101353]: pgmap v7004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:38 smithi159 ceph-mon[69013]: pgmap v7005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:38 smithi096 ceph-mon[101353]: pgmap v7005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:40 smithi159 ceph-mon[69013]: pgmap v7006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:40 smithi096 ceph-mon[101353]: pgmap v7006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:42 smithi159 ceph-mon[69013]: pgmap v7007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:42 smithi096 ceph-mon[101353]: pgmap v7007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:44 smithi159 ceph-mon[69013]: pgmap v7008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:44 smithi096 ceph-mon[101353]: pgmap v7008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:46 smithi159 ceph-mon[69013]: pgmap v7009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:46 smithi096 ceph-mon[101353]: pgmap v7009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:48 smithi159 ceph-mon[69013]: pgmap v7010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:48 smithi096 ceph-mon[101353]: pgmap v7010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:50 smithi159 ceph-mon[69013]: pgmap v7011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:50 smithi096 ceph-mon[101353]: pgmap v7011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:52 smithi159 ceph-mon[69013]: pgmap v7012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:52 smithi096 ceph-mon[101353]: pgmap v7012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:54 smithi159 ceph-mon[69013]: pgmap v7013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:54 smithi096 ceph-mon[101353]: pgmap v7013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:56 smithi159 ceph-mon[69013]: pgmap v7014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:56 smithi096 ceph-mon[101353]: pgmap v7014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:15:58 smithi159 ceph-mon[69013]: pgmap v7015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:15:58 smithi096 ceph-mon[101353]: pgmap v7015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:15:59.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 -- 172.21.15.96:0/3575841722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 msgr2=0x7fbd000f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 --2- 172.21.15.96:0/3575841722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd000f7de0 secure :-1 s=READY pgs=3585 cs=0 l=1 rev1=1 rx=0x7fbcf0004660 tx=0x7fbcf0009b30).stop 2022-02-02T22:15:59.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 -- 172.21.15.96:0/3575841722 shutdown_connections 2022-02-02T22:15:59.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 --2- 172.21.15.96:0/3575841722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd000f7de0 unknown :-1 s=CLOSED pgs=3585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 --2- 172.21.15.96:0/3575841722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 0x7fbd000f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:15:59.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 -- 172.21.15.96:0/3575841722 >> 172.21.15.96:0/3575841722 conn(0x7fbd000f1e40 msgr2=0x7fbd000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:59.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 -- 172.21.15.96:0/3575841722 shutdown_connections 2022-02-02T22:15:59.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.458+0000 7fbd04980700 1 -- 172.21.15.96:0/3575841722 wait complete. 2022-02-02T22:15:59.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 Processor -- start 2022-02-02T22:15:59.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 -- start start 2022-02-02T22:15:59.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 0x7fbd00106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00107ab0 con 0x7fbd000f7980 2022-02-02T22:15:59.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbd04980700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00108360 con 0x7fbd000f66e0 2022-02-02T22:15:59.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbcfdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbcfdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47466/0 (socket says 172.21.15.96:47466) 2022-02-02T22:15:59.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbcfdd9b700 1 -- 172.21.15.96:0/4158860873 learned_addr learned my addr 172.21.15.96:0/4158860873 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:59.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.459+0000 7fbcfe59c700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 0x7fbd00106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcfdd9b700 1 -- 172.21.15.96:0/4158860873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 msgr2=0x7fbd00106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcfdd9b700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 0x7fbd00106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcfdd9b700 1 -- 172.21.15.96:0/4158860873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0005040 con 0x7fbd000f7980 2022-02-02T22:15:59.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcfdd9b700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 secure :-1 s=READY pgs=3586 cs=0 l=1 rev1=1 rx=0x7fbcf0009990 tx=0x7fbcf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:59.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf0018070 con 0x7fbd000f7980 2022-02-02T22:15:59.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd001085e0 con 0x7fbd000f7980 2022-02-02T22:15:59.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbcf0007ba0 con 0x7fbd000f7980 2022-02-02T22:15:59.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf001c620 con 0x7fbd000f7980 2022-02-02T22:15:59.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.460+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd00108b40 con 0x7fbd000f7980 2022-02-02T22:15:59.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.461+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd000f5ad0 con 0x7fbd000f7980 2022-02-02T22:15:59.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.461+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbcf001c8e0 con 0x7fbd000f7980 2022-02-02T22:15:59.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.462+0000 7fbcf6ffd700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 0x7fbcec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.462+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbcf0083850 con 0x7fbd000f7980 2022-02-02T22:15:59.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.462+0000 7fbcfe59c700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 0x7fbcec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.462+0000 7fbcfe59c700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 0x7fbcec067290 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fbce8006fd0 tx=0x7fbce8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:59.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.466+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbcf0055380 con 0x7fbd000f7980 2022-02-02T22:15:59.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.645+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd000fef40 con 0x7fbcec064dd0 2022-02-02T22:15:59.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.646+0000 7fbcf6ffd700 1 -- 172.21.15.96:0/4158860873 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbd000fef40 con 0x7fbcec064dd0 2022-02-02T22:15:59.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 msgr2=0x7fbcec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 0x7fbcec067290 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fbce8006fd0 tx=0x7fbce8008040).stop 2022-02-02T22:15:59.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 msgr2=0x7fbd00107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 secure :-1 s=READY pgs=3586 cs=0 l=1 rev1=1 rx=0x7fbcf0009990 tx=0x7fbcf0009b30).stop 2022-02-02T22:15:59.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 shutdown_connections 2022-02-02T22:15:59.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcec064dd0 0x7fbcec067290 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd000f66e0 0x7fbd00106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 --2- 172.21.15.96:0/4158860873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd000f7980 0x7fbd00107470 unknown :-1 s=CLOSED pgs=3586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 >> 172.21.15.96:0/4158860873 conn(0x7fbd000f1e40 msgr2=0x7fbd000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:59.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 shutdown_connections 2022-02-02T22:15:59.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.648+0000 7fbd04980700 1 -- 172.21.15.96:0/4158860873 wait complete. 2022-02-02T22:15:59.657 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:15:59.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 -- 172.21.15.96:0/4223946272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 msgr2=0x7f40740f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 --2- 172.21.15.96:0/4223946272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f40740f5860 secure :-1 s=READY pgs=3587 cs=0 l=1 rev1=1 rx=0x7f4064004660 tx=0x7f4064009b30).stop 2022-02-02T22:15:59.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 -- 172.21.15.96:0/4223946272 shutdown_connections 2022-02-02T22:15:59.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 --2- 172.21.15.96:0/4223946272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 0x7f40740f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 --2- 172.21.15.96:0/4223946272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f40740f5860 unknown :-1 s=CLOSED pgs=3587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 -- 172.21.15.96:0/4223946272 >> 172.21.15.96:0/4223946272 conn(0x7f40740f0ba0 msgr2=0x7f40740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:59.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 -- 172.21.15.96:0/4223946272 shutdown_connections 2022-02-02T22:15:59.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 -- 172.21.15.96:0/4223946272 wait complete. 2022-02-02T22:15:59.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.745+0000 7f407a904700 1 Processor -- start 2022-02-02T22:15:59.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f407a904700 1 -- start start 2022-02-02T22:15:59.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f407a904700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f407a904700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 0x7f407410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f407a904700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40740603c0 con 0x7f40740f5440 2022-02-02T22:15:59.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f407a904700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074060500 con 0x7f40740f66e0 2022-02-02T22:15:59.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47474/0 (socket says 172.21.15.96:47474) 2022-02-02T22:15:59.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 -- 172.21.15.96:0/3172715785 learned_addr learned my addr 172.21.15.96:0/3172715785 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:15:59.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079101700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 0x7f407410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 -- 172.21.15.96:0/3172715785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 msgr2=0x7f407410bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 0x7f407410bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 -- 172.21.15.96:0/3172715785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064005040 con 0x7f40740f5440 2022-02-02T22:15:59.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f4079902700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 secure :-1 s=READY pgs=3588 cs=0 l=1 rev1=1 rx=0x7f4064004f60 tx=0x7f4064009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:59.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.746+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4064018070 con 0x7f40740f5440 2022-02-02T22:15:59.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.747+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407410c510 con 0x7f40740f5440 2022-02-02T22:15:59.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.747+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4064007ba0 con 0x7f40740f5440 2022-02-02T22:15:59.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.747+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406401c620 con 0x7f40740f5440 2022-02-02T22:15:59.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.747+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407410ca40 con 0x7f40740f5440 2022-02-02T22:15:59.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.748+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4074059100 con 0x7f40740f5440 2022-02-02T22:15:59.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.748+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f406401c8e0 con 0x7f40740f5440 2022-02-02T22:15:59.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.749+0000 7f406a7fc700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:15:59.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.749+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4064083970 con 0x7f40740f5440 2022-02-02T22:15:59.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.749+0000 7f4079101700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:15:59.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.749+0000 7f4079101700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f4070007fd0 tx=0x7f4070009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:15:59.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.753+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4064051b30 con 0x7f40740f5440 2022-02-02T22:15:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.927+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40740fdd40 con 0x7f4060064e20 2022-02-02T22:15:59.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.936+0000 7f406a7fc700 1 -- 172.21.15.96:0/3172715785 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f40740fdd40 con 0x7f4060064e20 2022-02-02T22:15:59.936 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:15:59.937 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:15:59.937 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:15:59.937 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 3h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:15:59.938 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:15:59.938 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:15:59.938 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:15:59.939 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:15:59.939 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:15:59.940 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:15:59.940 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 3h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:15:59.940 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:15:59.941 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 3h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:15:59.941 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:15:59.941 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (3h) 3h ago 3h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:15:59.942 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:15:59.942 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:15:59.943 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:15:59.943 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:15:59.943 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:15:59.944 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:15:59.944 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:15:59.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 msgr2=0x7f40600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f4070007fd0 tx=0x7f4070009040).stop 2022-02-02T22:15:59.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 msgr2=0x7f4074109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:15:59.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 secure :-1 s=READY pgs=3588 cs=0 l=1 rev1=1 rx=0x7f4064004f60 tx=0x7f4064009b30).stop 2022-02-02T22:15:59.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 shutdown_connections 2022-02-02T22:15:59.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4060064e20 0x7f40600672e0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40740f5440 0x7f4074109ac0 unknown :-1 s=CLOSED pgs=3588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 --2- 172.21.15.96:0/3172715785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40740f66e0 0x7f407410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:15:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 >> 172.21.15.96:0/3172715785 conn(0x7f40740f0ba0 msgr2=0x7f40740fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:15:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 shutdown_connections 2022-02-02T22:15:59.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:15:59.938+0000 7f407a904700 1 -- 172.21.15.96:0/3172715785 wait complete. 2022-02-02T22:16:00.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 -- 172.21.15.96:0/498347257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 msgr2=0x7fec4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 --2- 172.21.15.96:0/498347257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c0f6cc0 secure :-1 s=READY pgs=3589 cs=0 l=1 rev1=1 rx=0x7fec3c004660 tx=0x7fec3c009b30).stop 2022-02-02T22:16:00.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 -- 172.21.15.96:0/498347257 shutdown_connections 2022-02-02T22:16:00.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 --2- 172.21.15.96:0/498347257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c0f6cc0 unknown :-1 s=CLOSED pgs=3589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 --2- 172.21.15.96:0/498347257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 0x7fec4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 -- 172.21.15.96:0/498347257 >> 172.21.15.96:0/498347257 conn(0x7fec4c0f0d40 msgr2=0x7fec4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:00.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 -- 172.21.15.96:0/498347257 shutdown_connections 2022-02-02T22:16:00.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.034+0000 7fec50850700 1 -- 172.21.15.96:0/498347257 wait complete. 2022-02-02T22:16:00.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 Processor -- start 2022-02-02T22:16:00.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 -- start start 2022-02-02T22:16:00.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 0x7fec4c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0603c0 con 0x7fec4c0f6860 2022-02-02T22:16:00.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.035+0000 7fec50850700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c060500 con 0x7fec4c0f55c0 2022-02-02T22:16:00.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47486/0 (socket says 172.21.15.96:47486) 2022-02-02T22:16:00.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 -- 172.21.15.96:0/288713741 learned_addr learned my addr 172.21.15.96:0/288713741 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:00.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec4a59c700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 0x7fec4c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 -- 172.21.15.96:0/288713741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 msgr2=0x7fec4c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 0x7fec4c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 -- 172.21.15.96:0/288713741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c005040 con 0x7fec4c0f6860 2022-02-02T22:16:00.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec49d9b700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 secure :-1 s=READY pgs=3590 cs=0 l=1 rev1=1 rx=0x7fec3c009990 tx=0x7fec3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:00.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3c018070 con 0x7fec4c0f6860 2022-02-02T22:16:00.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c10c6c0 con 0x7fec4c0f6860 2022-02-02T22:16:00.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec3c007ba0 con 0x7fec4c0f6860 2022-02-02T22:16:00.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3c01c3c0 con 0x7fec4c0f6860 2022-02-02T22:16:00.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.036+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c10cbf0 con 0x7fec4c0f6860 2022-02-02T22:16:00.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.037+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c045ad0 con 0x7fec4c0f6860 2022-02-02T22:16:00.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.038+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec3c01d420 con 0x7fec4c0f6860 2022-02-02T22:16:00.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.038+0000 7fec3affd700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 0x7fec34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.038+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec3c0836c0 con 0x7fec4c0f6860 2022-02-02T22:16:00.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.038+0000 7fec4a59c700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 0x7fec34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.039+0000 7fec4a59c700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 0x7fec34067290 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7fec4c060040 tx=0x7fec4000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:00.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.042+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec3c051820 con 0x7fec4c0f6860 2022-02-02T22:16:00.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.275+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec4c027a00 con 0x7fec4c0f6860 2022-02-02T22:16:00.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.276+0000 7fec3affd700 1 -- 172.21.15.96:0/288713741 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fec3c051020 con 0x7fec4c0f6860 2022-02-02T22:16:00.276 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:16:00.276 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:16:00.277 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:16:00.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:00.277 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:16:00.278 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:16:00.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:00.278 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:16:00.279 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:16:00.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:00.279 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:16:00.280 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:16:00.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:00.280 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:16:00.281 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:16:00.281 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:16:00.281 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:16:00.282 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:16:00.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 msgr2=0x7fec34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 0x7fec34067290 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7fec4c060040 tx=0x7fec4000b040).stop 2022-02-02T22:16:00.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 msgr2=0x7fec4c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 secure :-1 s=READY pgs=3590 cs=0 l=1 rev1=1 rx=0x7fec3c009990 tx=0x7fec3c009b30).stop 2022-02-02T22:16:00.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 shutdown_connections 2022-02-02T22:16:00.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec34064dd0 0x7fec34067290 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec4c0f55c0 0x7fec4c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 --2- 172.21.15.96:0/288713741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec4c0f6860 0x7fec4c10c170 unknown :-1 s=CLOSED pgs=3590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 >> 172.21.15.96:0/288713741 conn(0x7fec4c0f0d40 msgr2=0x7fec4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:00.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 shutdown_connections 2022-02-02T22:16:00.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.277+0000 7fec50850700 1 -- 172.21.15.96:0/288713741 wait complete. 2022-02-02T22:16:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 -- 172.21.15.96:0/3271066894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 msgr2=0x7f9e2c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/3271066894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c0f7c30 secure :-1 s=READY pgs=3591 cs=0 l=1 rev1=1 rx=0x7f9e1c004660 tx=0x7f9e1c009b30).stop 2022-02-02T22:16:00.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 -- 172.21.15.96:0/3271066894 shutdown_connections 2022-02-02T22:16:00.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/3271066894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c0f7c30 unknown :-1 s=CLOSED pgs=3591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/3271066894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 -- 172.21.15.96:0/3271066894 >> 172.21.15.96:0/3271066894 conn(0x7f9e2c0f1c90 msgr2=0x7f9e2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 -- 172.21.15.96:0/3271066894 shutdown_connections 2022-02-02T22:16:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.374+0000 7f9e2b59e700 1 -- 172.21.15.96:0/3271066894 wait complete. 2022-02-02T22:16:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 Processor -- start 2022-02-02T22:16:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 -- start start 2022-02-02T22:16:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c107880 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c108090 con 0x7f9e2c0f6530 2022-02-02T22:16:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47496/0 (socket says 172.21.15.96:47496) 2022-02-02T22:16:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 -- 172.21.15.96:0/1827864975 learned_addr learned my addr 172.21.15.96:0/1827864975 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2a59c700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 -- 172.21.15.96:0/1827864975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 msgr2=0x7f9e2c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e29d9b700 1 -- 172.21.15.96:0/1827864975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c005040 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.375+0000 7f9e2a59c700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:16:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e29d9b700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 secure :-1 s=READY pgs=3592 cs=0 l=1 rev1=1 rx=0x7f9e1c009990 tx=0x7f9e1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c018070 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e1c007ca0 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c1082b0 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c01c620 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.376+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c108810 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.377+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c059100 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.377+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e1c01d960 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.378+0000 7f9e1affd700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 0x7f9e140673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.378+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9e1c083660 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.378+0000 7f9e2a59c700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 0x7f9e140673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.378+0000 7f9e2a59c700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 0x7f9e140673b0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f9e20007fd0 tx=0x7f9e20009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.382+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e1c0517e0 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.583+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e2c0fee80 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.583+0000 7f9e1affd700 1 -- 172.21.15.96:0/1827864975 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9e2c0fee80 con 0x7f9e2c0f77d0 2022-02-02T22:16:00.585 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:16:00.586 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:16:00.586 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:16:00.587 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:16:00.587 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:00.588 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:16:00.589 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:16:00.589 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:16:00.589 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:16:00.590 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:16:00.590 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:16:00.590 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:16:00.591 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:16:00.591 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:16:00.592 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:16:00.592 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:16:00.592 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:16:00.593 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:16:00.593 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:16:00.594 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:16:00.594 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:16:00.594 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:16:00.595 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:16:00.595 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:16:00.595 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:16:00.596 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:16:00.596 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:16:00.596 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:16:00.597 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:16:00.597 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:16:00.597 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:16:00.598 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:16:00.598 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:00.598 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:00.599 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:16:00.599 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:00.599 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:00.600 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:00.600 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:00.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 msgr2=0x7f9e140673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 0x7f9e140673b0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f9e20007fd0 tx=0x7f9e20009040).stop 2022-02-02T22:16:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 msgr2=0x7f9e2c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 secure :-1 s=READY pgs=3592 cs=0 l=1 rev1=1 rx=0x7f9e1c009990 tx=0x7f9e1c009b30).stop 2022-02-02T22:16:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 shutdown_connections 2022-02-02T22:16:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9e14064ef0 0x7f9e140673b0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e2c0f6530 0x7f9e2c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 --2- 172.21.15.96:0/1827864975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2c0f77d0 0x7f9e2c107280 unknown :-1 s=CLOSED pgs=3592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:00.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 >> 172.21.15.96:0/1827864975 conn(0x7f9e2c0f1c90 msgr2=0x7f9e2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 shutdown_connections 2022-02-02T22:16:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:00.585+0000 7f9e2b59e700 1 -- 172.21.15.96:0/1827864975 wait complete. 2022-02-02T22:16:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:16:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:00 smithi159 ceph-mon[69013]: pgmap v7016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:00 smithi159 ceph-mon[69013]: from='client.41290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/288713741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:16:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1827864975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:16:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:00 smithi096 ceph-mon[101353]: pgmap v7016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:00 smithi096 ceph-mon[101353]: from='client.41290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/288713741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:16:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1827864975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:16:02.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:01 smithi159 ceph-mon[69013]: from='client.41294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:02.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:01 smithi096 ceph-mon[101353]: from='client.41294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:02 smithi159 ceph-mon[69013]: pgmap v7017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:02 smithi096 ceph-mon[101353]: pgmap v7017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:04 smithi159 ceph-mon[69013]: pgmap v7018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:04 smithi096 ceph-mon[101353]: pgmap v7018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:06 smithi159 ceph-mon[69013]: pgmap v7019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:06 smithi096 ceph-mon[101353]: pgmap v7019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:08 smithi159 ceph-mon[69013]: pgmap v7020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:08 smithi096 ceph-mon[101353]: pgmap v7020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:10 smithi159 ceph-mon[69013]: pgmap v7021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:10 smithi096 ceph-mon[101353]: pgmap v7021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:12 smithi159 ceph-mon[69013]: pgmap v7022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:12 smithi096 ceph-mon[101353]: pgmap v7022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:14.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:14 smithi159 ceph-mon[69013]: pgmap v7023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:14 smithi096 ceph-mon[101353]: pgmap v7023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:16.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:16 smithi159 ceph-mon[69013]: pgmap v7024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:16 smithi096 ceph-mon[101353]: pgmap v7024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:18.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:18 smithi159 ceph-mon[69013]: pgmap v7025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:18 smithi096 ceph-mon[101353]: pgmap v7025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:20.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:20 smithi159 ceph-mon[69013]: pgmap v7026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:20 smithi096 ceph-mon[101353]: pgmap v7026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:22.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:22 smithi159 ceph-mon[69013]: pgmap v7027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:22 smithi096 ceph-mon[101353]: pgmap v7027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:24.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:24 smithi159 ceph-mon[69013]: pgmap v7028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:24 smithi096 ceph-mon[101353]: pgmap v7028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:26.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:26 smithi159 ceph-mon[69013]: pgmap v7029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:26 smithi096 ceph-mon[101353]: pgmap v7029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:28.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:28 smithi159 ceph-mon[69013]: pgmap v7030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:16:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:16:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:28 smithi096 ceph-mon[101353]: pgmap v7030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:16:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:16:30.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:30 smithi159 ceph-mon[69013]: pgmap v7031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:30 smithi096 ceph-mon[101353]: pgmap v7031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:30.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 -- 172.21.15.96:0/3473451736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f6860 msgr2=0x7f47f00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 --2- 172.21.15.96:0/3473451736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f6860 0x7f47f00f6cc0 secure :-1 s=READY pgs=3593 cs=0 l=1 rev1=1 rx=0x7f47e0004660 tx=0x7f47e0009b30).stop 2022-02-02T22:16:30.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 -- 172.21.15.96:0/3473451736 shutdown_connections 2022-02-02T22:16:30.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 --2- 172.21.15.96:0/3473451736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f6860 0x7f47f00f6cc0 unknown :-1 s=CLOSED pgs=3593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 --2- 172.21.15.96:0/3473451736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f55c0 0x7f47f00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.695+0000 7f47f4bee700 1 -- 172.21.15.96:0/3473451736 >> 172.21.15.96:0/3473451736 conn(0x7f47f00f0d40 msgr2=0x7f47f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:30.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 -- 172.21.15.96:0/3473451736 shutdown_connections 2022-02-02T22:16:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 -- 172.21.15.96:0/3473451736 wait complete. 2022-02-02T22:16:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 Processor -- start 2022-02-02T22:16:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 -- start start 2022-02-02T22:16:30.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f6860 0x7f47f01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01069b0 con 0x7f47f00f55c0 2022-02-02T22:16:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.696+0000 7f47f4bee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01071c0 con 0x7f47f00f6860 2022-02-02T22:16:30.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47512/0 (socket says 172.21.15.96:47512) 2022-02-02T22:16:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 -- 172.21.15.96:0/2748814460 learned_addr learned my addr 172.21.15.96:0/2748814460 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47edd9b700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f6860 0x7f47f01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 -- 172.21.15.96:0/2748814460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f6860 msgr2=0x7f47f01063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f6860 0x7f47f01063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 -- 172.21.15.96:0/2748814460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0005040 con 0x7f47f00f55c0 2022-02-02T22:16:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47ee59c700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 secure :-1 s=READY pgs=3594 cs=0 l=1 rev1=1 rx=0x7f47d8002700 tx=0x7f47d8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d80079c0 con 0x7f47f00f55c0 2022-02-02T22:16:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47d800f040 con 0x7f47f00f55c0 2022-02-02T22:16:30.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f0107440 con 0x7f47f00f55c0 2022-02-02T22:16:30.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d8014860 con 0x7f47f00f55c0 2022-02-02T22:16:30.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.697+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f0107a00 con 0x7f47f00f55c0 2022-02-02T22:16:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.698+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f00f49b0 con 0x7f47f00f55c0 2022-02-02T22:16:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.699+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47d801b060 con 0x7f47f00f55c0 2022-02-02T22:16:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.699+0000 7f47e6ffd700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 0x7f47dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.699+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f47d80817f0 con 0x7f47f00f55c0 2022-02-02T22:16:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.699+0000 7f47edd9b700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 0x7f47dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.700+0000 7f47edd9b700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 0x7f47dc067290 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f47e0004630 tx=0x7f47e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:30.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.703+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47d804f8f0 con 0x7f47f00f55c0 2022-02-02T22:16:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.881+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47f00fde60 con 0x7f47dc064dd0 2022-02-02T22:16:30.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.882+0000 7f47e6ffd700 1 -- 172.21.15.96:0/2748814460 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f47f00fde60 con 0x7f47dc064dd0 2022-02-02T22:16:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.883+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 msgr2=0x7f47dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.883+0000 7f47f4bee700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 0x7f47dc067290 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f47e0004630 tx=0x7f47e0009b30).stop 2022-02-02T22:16:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.883+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 msgr2=0x7f47f0105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.883+0000 7f47f4bee700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 secure :-1 s=READY pgs=3594 cs=0 l=1 rev1=1 rx=0x7f47d8002700 tx=0x7f47d8009d80).stop 2022-02-02T22:16:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 shutdown_connections 2022-02-02T22:16:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f47dc064dd0 0x7f47dc067290 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47f00f55c0 0x7f47f0105ec0 unknown :-1 s=CLOSED pgs=3594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 --2- 172.21.15.96:0/2748814460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f00f6860 0x7f47f01063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 >> 172.21.15.96:0/2748814460 conn(0x7f47f00f0d40 msgr2=0x7f47f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:30.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 shutdown_connections 2022-02-02T22:16:30.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.884+0000 7f47f4bee700 1 -- 172.21.15.96:0/2748814460 wait complete. 2022-02-02T22:16:30.893 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:16:30.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 -- 172.21.15.96:0/2981047819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f6860 msgr2=0x7f82100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 --2- 172.21.15.96:0/2981047819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f6860 0x7f82100f6cc0 secure :-1 s=READY pgs=3595 cs=0 l=1 rev1=1 rx=0x7f8200004660 tx=0x7f8200009b30).stop 2022-02-02T22:16:30.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 -- 172.21.15.96:0/2981047819 shutdown_connections 2022-02-02T22:16:30.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 --2- 172.21.15.96:0/2981047819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f6860 0x7f82100f6cc0 unknown :-1 s=CLOSED pgs=3595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 --2- 172.21.15.96:0/2981047819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f55c0 0x7f82100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.981+0000 7f8214907700 1 -- 172.21.15.96:0/2981047819 >> 172.21.15.96:0/2981047819 conn(0x7f82100f0d40 msgr2=0x7f82100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:30.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 -- 172.21.15.96:0/2981047819 shutdown_connections 2022-02-02T22:16:30.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 -- 172.21.15.96:0/2981047819 wait complete. 2022-02-02T22:16:30.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 Processor -- start 2022-02-02T22:16:30.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 -- start start 2022-02-02T22:16:30.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.982+0000 7f8214907700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f6860 0x7f821010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8214907700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100603e0 con 0x7f82100f55c0 2022-02-02T22:16:30.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8214907700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210060520 con 0x7f82100f6860 2022-02-02T22:16:30.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47522/0 (socket says 172.21.15.96:47522) 2022-02-02T22:16:30.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 -- 172.21.15.96:0/1535834744 learned_addr learned my addr 172.21.15.96:0/1535834744 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:30.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820dd9b700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f6860 0x7f821010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 -- 172.21.15.96:0/1535834744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f6860 msgr2=0x7f821010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:30.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f6860 0x7f821010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:30.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 -- 172.21.15.96:0/1535834744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200005040 con 0x7f82100f55c0 2022-02-02T22:16:30.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f820e59c700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 secure :-1 s=READY pgs=3596 cs=0 l=1 rev1=1 rx=0x7f81f8002700 tx=0x7f81f8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:30.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f80079c0 con 0x7f82100f55c0 2022-02-02T22:16:30.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81f800f040 con 0x7f82100f55c0 2022-02-02T22:16:30.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821010c700 con 0x7f82100f55c0 2022-02-02T22:16:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f8014860 con 0x7f82100f55c0 2022-02-02T22:16:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.983+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821010ccc0 con 0x7f82100f55c0 2022-02-02T22:16:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.984+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8210045ad0 con 0x7f82100f55c0 2022-02-02T22:16:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.985+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f81f801b060 con 0x7f82100f55c0 2022-02-02T22:16:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.985+0000 7f8206ffd700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 0x7f81fc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:30.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.985+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f81f8081810 con 0x7f82100f55c0 2022-02-02T22:16:30.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.985+0000 7f820dd9b700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 0x7f81fc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:30.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.986+0000 7f820dd9b700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 0x7f81fc067270 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f8200004e30 tx=0x7f8200009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:30.989+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81f804f910 con 0x7f82100f55c0 2022-02-02T22:16:31.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.160+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82100fdf30 con 0x7f81fc064db0 2022-02-02T22:16:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.169+0000 7f8206ffd700 1 -- 172.21.15.96:0/1535834744 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8200019040 con 0x7f81fc064db0 2022-02-02T22:16:31.169 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:16:31.170 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:16:31.170 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:16:31.171 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:16:31.171 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:16:31.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:16:31.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:16:31.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:16:31.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:16:31.173 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:16:31.173 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:16:31.173 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:16:31.174 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:16:31.174 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:16:31.174 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:16:31.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 3h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:16:31.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:16:31.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:16:31.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:16:31.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:16:31.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:16:31.177 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:16:31.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 msgr2=0x7f81fc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 0x7f81fc067270 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f8200004e30 tx=0x7f8200009b30).stop 2022-02-02T22:16:31.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 msgr2=0x7f8210109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 secure :-1 s=READY pgs=3596 cs=0 l=1 rev1=1 rx=0x7f81f8002700 tx=0x7f81f8009d80).stop 2022-02-02T22:16:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 shutdown_connections 2022-02-02T22:16:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81fc064db0 0x7f81fc067270 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82100f55c0 0x7f8210109c50 unknown :-1 s=CLOSED pgs=3596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 --2- 172.21.15.96:0/1535834744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82100f6860 0x7f821010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 >> 172.21.15.96:0/1535834744 conn(0x7f82100f0d40 msgr2=0x7f82100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:31.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 shutdown_connections 2022-02-02T22:16:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.171+0000 7f8214907700 1 -- 172.21.15.96:0/1535834744 wait complete. 2022-02-02T22:16:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 -- 172.21.15.96:0/2493996029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f6530 msgr2=0x7f14400f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 --2- 172.21.15.96:0/2493996029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f6530 0x7f14400f6950 secure :-1 s=READY pgs=3597 cs=0 l=1 rev1=1 rx=0x7f1434004660 tx=0x7f1434009b30).stop 2022-02-02T22:16:31.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 -- 172.21.15.96:0/2493996029 shutdown_connections 2022-02-02T22:16:31.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 --2- 172.21.15.96:0/2493996029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f77d0 0x7f14400f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 --2- 172.21.15.96:0/2493996029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f6530 0x7f14400f6950 unknown :-1 s=CLOSED pgs=3597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 -- 172.21.15.96:0/2493996029 >> 172.21.15.96:0/2493996029 conn(0x7f14400f1c90 msgr2=0x7f14400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:31.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 -- 172.21.15.96:0/2493996029 shutdown_connections 2022-02-02T22:16:31.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 -- 172.21.15.96:0/2493996029 wait complete. 2022-02-02T22:16:31.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.268+0000 7f14450d3700 1 Processor -- start 2022-02-02T22:16:31.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f14450d3700 1 -- start start 2022-02-02T22:16:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f14450d3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f6530 0x7f144006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f14450d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f14450d3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144006a380 con 0x7f14400f77d0 2022-02-02T22:16:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f14450d3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144006a4c0 con 0x7f14400f6530 2022-02-02T22:16:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47532/0 (socket says 172.21.15.96:47532) 2022-02-02T22:16:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 -- 172.21.15.96:0/1147760843 learned_addr learned my addr 172.21.15.96:0/1147760843 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143ffff700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f6530 0x7f144006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 -- 172.21.15.96:0/1147760843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f6530 msgr2=0x7f144006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f6530 0x7f144006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.269+0000 7f143f7fe700 1 -- 172.21.15.96:0/1147760843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434005040 con 0x7f14400f77d0 2022-02-02T22:16:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f143f7fe700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 secure :-1 s=READY pgs=3598 cs=0 l=1 rev1=1 rx=0x7f14300026d0 tx=0x7f1430009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14300079c0 con 0x7f14400f77d0 2022-02-02T22:16:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144006a7a0 con 0x7f14400f77d0 2022-02-02T22:16:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f143000f040 con 0x7f14400f77d0 2022-02-02T22:16:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14300148b0 con 0x7f14400f77d0 2022-02-02T22:16:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.270+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144010edc0 con 0x7f14400f77d0 2022-02-02T22:16:31.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.271+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440045ad0 con 0x7f14400f77d0 2022-02-02T22:16:31.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.272+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1430007b20 con 0x7f14400f77d0 2022-02-02T22:16:31.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.272+0000 7f143cff9700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.273+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1430081df0 con 0x7f14400f77d0 2022-02-02T22:16:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.273+0000 7f143ffff700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.273+0000 7f143ffff700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f1434013690 tx=0x7f1434009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:31.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.276+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f143004fef0 con 0x7f14400f77d0 2022-02-02T22:16:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.504+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1440027a00 con 0x7f14400f77d0 2022-02-02T22:16:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.504+0000 7f143cff9700 1 -- 172.21.15.96:0/1147760843 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1430053510 con 0x7f14400f77d0 2022-02-02T22:16:31.505 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:16:31.505 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:16:31.505 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:16:31.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:31.506 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:16:31.507 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:16:31.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:31.507 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:16:31.508 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:16:31.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:31.508 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:16:31.509 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:16:31.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:16:31.509 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:16:31.510 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:16:31.510 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:16:31.510 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:16:31.511 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:16:31.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 msgr2=0x7f14280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f1434013690 tx=0x7f1434009b30).stop 2022-02-02T22:16:31.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 msgr2=0x7f1440069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 secure :-1 s=READY pgs=3598 cs=0 l=1 rev1=1 rx=0x7f14300026d0 tx=0x7f1430009de0).stop 2022-02-02T22:16:31.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 shutdown_connections 2022-02-02T22:16:31.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f6530 0x7f144006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 --2- 172.21.15.96:0/1147760843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f77d0 0x7f1440069e20 unknown :-1 s=CLOSED pgs=3598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.506+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 >> 172.21.15.96:0/1147760843 conn(0x7f14400f1c90 msgr2=0x7f14400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.507+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 shutdown_connections 2022-02-02T22:16:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.507+0000 7f14450d3700 1 -- 172.21.15.96:0/1147760843 wait complete. 2022-02-02T22:16:31.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 -- 172.21.15.96:0/2108099294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f55c0 msgr2=0x7f5a900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 --2- 172.21.15.96:0/2108099294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f55c0 0x7f5a900f59e0 secure :-1 s=READY pgs=3599 cs=0 l=1 rev1=1 rx=0x7f5a8c004660 tx=0x7f5a8c009b30).stop 2022-02-02T22:16:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 -- 172.21.15.96:0/2108099294 shutdown_connections 2022-02-02T22:16:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 --2- 172.21.15.96:0/2108099294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f6860 0x7f5a900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:16:31.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 --2- 172.21.15.96:0/2108099294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f55c0 0x7f5a900f59e0 unknown :-1 s=CLOSED pgs=3599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 -- 172.21.15.96:0/2108099294 >> 172.21.15.96:0/2108099294 conn(0x7f5a900f0d40 msgr2=0x7f5a900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 -- 172.21.15.96:0/2108099294 shutdown_connections 2022-02-02T22:16:31.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 -- 172.21.15.96:0/2108099294 wait complete. 2022-02-02T22:16:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.605+0000 7f5a97b85700 1 Processor -- start 2022-02-02T22:16:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 -- start start 2022-02-02T22:16:31.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 0x7f5a900f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a900f8190 con 0x7f5a900f6860 2022-02-02T22:16:31.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a900f82d0 con 0x7f5a900f55c0 2022-02-02T22:16:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47542/0 (socket says 172.21.15.96:47542) 2022-02-02T22:16:31.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 -- 172.21.15.96:0/3711625160 learned_addr learned my addr 172.21.15.96:0/3711625160 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:16:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95921700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 0x7f5a900f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 -- 172.21.15.96:0/3711625160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 msgr2=0x7f5a900f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 0x7f5a900f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 -- 172.21.15.96:0/3711625160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c005040 con 0x7f5a900f6860 2022-02-02T22:16:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95921700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 0x7f5a900f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:16:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a95120700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 secure :-1 s=READY pgs=3600 cs=0 l=1 rev1=1 rx=0x7f5a8000b410 tx=0x7f5a80006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:31.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a800125f0 con 0x7f5a900f6860 2022-02-02T22:16:31.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a80012c00 con 0x7f5a900f6860 2022-02-02T22:16:31.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a900f85b0 con 0x7f5a900f6860 2022-02-02T22:16:31.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.606+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a80002ae0 con 0x7f5a900f6860 2022-02-02T22:16:31.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.607+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9010efc0 con 0x7f5a900f6860 2022-02-02T22:16:31.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.607+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a90045ad0 con 0x7f5a900f6860 2022-02-02T22:16:31.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.608+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a8000f030 con 0x7f5a900f6860 2022-02-02T22:16:31.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.608+0000 7f5a867fc700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 0x7f5a7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:16:31.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.608+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a80081f10 con 0x7f5a900f6860 2022-02-02T22:16:31.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.608+0000 7f5a95921700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 0x7f5a7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:16:31.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.609+0000 7f5a95921700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 0x7f5a7c067290 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5a8c004e30 tx=0x7f5a8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:16:31.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.613+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a80050010 con 0x7f5a900f6860 2022-02-02T22:16:31.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.813+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a900fde00 con 0x7f5a900f6860 2022-02-02T22:16:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.814+0000 7f5a867fc700 1 -- 172.21.15.96:0/3711625160 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5a80053630 con 0x7f5a900f6860 2022-02-02T22:16:31.814 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:16:31.815 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:16:31.816 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:16:31.816 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:16:31.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:31.817 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:16:31.817 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:16:31.818 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:16:31.818 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:16:31.819 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:16:31.819 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:16:31.820 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:16:31.822 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:16:31.822 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:16:31.823 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:16:31.823 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:16:31.823 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:16:31.824 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:16:31.824 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:16:31.825 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:16:31.825 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:16:31.825 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:16:31.826 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:16:31.826 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:16:31.826 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:16:31.827 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:16:31.827 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:16:31.827 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:16:31.828 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:16:31.828 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:16:31.829 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:16:31.829 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:16:31.829 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:31.830 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:31.830 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:16:31.830 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:16:31.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:31.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:31.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:16:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 msgr2=0x7f5a7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 0x7f5a7c067290 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5a8c004e30 tx=0x7f5a8c009b30).stop 2022-02-02T22:16:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 msgr2=0x7f5a900f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:16:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 secure :-1 s=READY pgs=3600 cs=0 l=1 rev1=1 rx=0x7f5a8000b410 tx=0x7f5a80006ef0).stop 2022-02-02T22:16:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 shutdown_connections 2022-02-02T22:16:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a7c064dd0 0x7f5a7c067290 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a900f55c0 0x7f5a900f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 --2- 172.21.15.96:0/3711625160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a900f6860 0x7f5a900f7ba0 unknown :-1 s=CLOSED pgs=3600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:16:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.815+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 >> 172.21.15.96:0/3711625160 conn(0x7f5a900f0d40 msgr2=0x7f5a9005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:16:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.816+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 shutdown_connections 2022-02-02T22:16:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:16:31.816+0000 7f5a97b85700 1 -- 172.21.15.96:0/3711625160 wait complete. 2022-02-02T22:16:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:16:32.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:32 smithi159 ceph-mon[69013]: from='client.41306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:32.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:32 smithi159 ceph-mon[69013]: pgmap v7032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:32.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:32 smithi159 ceph-mon[69013]: from='client.41310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1147760843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:16:32.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:32 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3711625160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:16:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:32 smithi096 ceph-mon[101353]: from='client.41306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:32 smithi096 ceph-mon[101353]: pgmap v7032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:32 smithi096 ceph-mon[101353]: from='client.41310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:16:32.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1147760843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:16:32.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:32 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3711625160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:16:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:34 smithi159 ceph-mon[69013]: pgmap v7033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:34 smithi096 ceph-mon[101353]: pgmap v7033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:36.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:36 smithi159 ceph-mon[69013]: pgmap v7034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:36 smithi096 ceph-mon[101353]: pgmap v7034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:38 smithi159 ceph-mon[69013]: pgmap v7035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:38 smithi096 ceph-mon[101353]: pgmap v7035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:40.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:40 smithi159 ceph-mon[69013]: pgmap v7036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:40 smithi096 ceph-mon[101353]: pgmap v7036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:42.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:42 smithi159 ceph-mon[69013]: pgmap v7037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:42 smithi096 ceph-mon[101353]: pgmap v7037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:44.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:44 smithi159 ceph-mon[69013]: pgmap v7038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:44 smithi096 ceph-mon[101353]: pgmap v7038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:46.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:46 smithi159 ceph-mon[69013]: pgmap v7039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:46.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:46 smithi096 ceph-mon[101353]: pgmap v7039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:48.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:48 smithi159 ceph-mon[69013]: pgmap v7040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:48 smithi096 ceph-mon[101353]: pgmap v7040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:50.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:50 smithi159 ceph-mon[69013]: pgmap v7041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:50 smithi096 ceph-mon[101353]: pgmap v7041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:52.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:52 smithi159 ceph-mon[69013]: pgmap v7042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:52 smithi096 ceph-mon[101353]: pgmap v7042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:54.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:54 smithi159 ceph-mon[69013]: pgmap v7043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:54 smithi096 ceph-mon[101353]: pgmap v7043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:56.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:56 smithi159 ceph-mon[69013]: pgmap v7044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:56 smithi096 ceph-mon[101353]: pgmap v7044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:58.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:16:58 smithi159 ceph-mon[69013]: pgmap v7045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:16:58.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:16:58 smithi096 ceph-mon[101353]: pgmap v7045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:00.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:00 smithi159 ceph-mon[69013]: pgmap v7046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:00 smithi096 ceph-mon[101353]: pgmap v7046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:01.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- 172.21.15.96:0/3102309783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f5430 msgr2=0x7f8e240f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:01.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3102309783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f5430 0x7f8e240f5850 secure :-1 s=READY pgs=3601 cs=0 l=1 rev1=1 rx=0x7f8e14004660 tx=0x7f8e14009b30).stop 2022-02-02T22:17:01.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- 172.21.15.96:0/3102309783 shutdown_connections 2022-02-02T22:17:01.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3102309783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f66d0 0x7f8e240f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:01.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3102309783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f5430 0x7f8e240f5850 unknown :-1 s=CLOSED pgs=3601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- 172.21.15.96:0/3102309783 >> 172.21.15.96:0/3102309783 conn(0x7f8e240f0b90 msgr2=0x7f8e240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- 172.21.15.96:0/3102309783 shutdown_connections 2022-02-02T22:17:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- 172.21.15.96:0/3102309783 wait complete. 2022-02-02T22:17:01.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 Processor -- start 2022-02-02T22:17:01.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.925+0000 7f8e2359e700 1 -- start start 2022-02-02T22:17:01.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e2359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f5430 0x7f8e2410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:01.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e2359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:01.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e2359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240602b0 con 0x7f8e240f66d0 2022-02-02T22:17:01.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e2359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240603f0 con 0x7f8e240f5430 2022-02-02T22:17:01.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:01.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47568/0 (socket says 172.21.15.96:47568) 2022-02-02T22:17:01.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 -- 172.21.15.96:0/3958416591 learned_addr learned my addr 172.21.15.96:0/3958416591 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:01.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e2259c700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f5430 0x7f8e2410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:01.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 -- 172.21.15.96:0/3958416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f5430 msgr2=0x7f8e2410beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:01.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f5430 0x7f8e2410beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:01.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 -- 172.21.15.96:0/3958416591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14005040 con 0x7f8e240f66d0 2022-02-02T22:17:01.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e21d9b700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 secure :-1 s=READY pgs=3602 cs=0 l=1 rev1=1 rx=0x7f8e180026d0 tx=0x7f8e18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e18009320 con 0x7f8e240f66d0 2022-02-02T22:17:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.926+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e1800f040 con 0x7f8e240f66d0 2022-02-02T22:17:01.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.927+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2410e8a0 con 0x7f8e240f66d0 2022-02-02T22:17:01.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.927+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e180147e0 con 0x7f8e240f66d0 2022-02-02T22:17:01.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.927+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2410ed20 con 0x7f8e240f66d0 2022-02-02T22:17:01.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.928+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e24045ad0 con 0x7f8e240f66d0 2022-02-02T22:17:01.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.928+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8e18009480 con 0x7f8e240f66d0 2022-02-02T22:17:01.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.928+0000 7f8e12ffd700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 0x7f8e0c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:01.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.928+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8e18082140 con 0x7f8e240f66d0 2022-02-02T22:17:01.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.928+0000 7f8e2259c700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 0x7f8e0c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:01.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.929+0000 7f8e2259c700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 0x7f8e0c0672e0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f8e14004e30 tx=0x7f8e14009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:01.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:01.933+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8e18050240 con 0x7f8e240f66d0 2022-02-02T22:17:02.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.111+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e240fdd60 con 0x7f8e0c064e20 2022-02-02T22:17:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.112+0000 7f8e12ffd700 1 -- 172.21.15.96:0/3958416591 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8e240fdd60 con 0x7f8e0c064e20 2022-02-02T22:17:02.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 msgr2=0x7f8e0c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 0x7f8e0c0672e0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f8e14004e30 tx=0x7f8e14009b30).stop 2022-02-02T22:17:02.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 msgr2=0x7f8e2410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 secure :-1 s=READY pgs=3602 cs=0 l=1 rev1=1 rx=0x7f8e180026d0 tx=0x7f8e18009de0).stop 2022-02-02T22:17:02.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 shutdown_connections 2022-02-02T22:17:02.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8e0c064e20 0x7f8e0c0672e0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e240f5430 0x7f8e2410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 --2- 172.21.15.96:0/3958416591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e240f66d0 0x7f8e2410e3b0 unknown :-1 s=CLOSED pgs=3602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 >> 172.21.15.96:0/3958416591 conn(0x7f8e240f0b90 msgr2=0x7f8e240fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 shutdown_connections 2022-02-02T22:17:02.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.114+0000 7f8e2359e700 1 -- 172.21.15.96:0/3958416591 wait complete. 2022-02-02T22:17:02.124 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:17:02.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 -- 172.21.15.96:0/2888957454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f5430 msgr2=0x7f5a9c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/2888957454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f5430 0x7f5a9c0f5850 secure :-1 s=READY pgs=3603 cs=0 l=1 rev1=1 rx=0x7f5a90004660 tx=0x7f5a90009b30).stop 2022-02-02T22:17:02.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 -- 172.21.15.96:0/2888957454 shutdown_connections 2022-02-02T22:17:02.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/2888957454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 0x7f5a9c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/2888957454 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0f5430 0x7f5a9c0f5850 unknown :-1 s=CLOSED pgs=3603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 -- 172.21.15.96:0/2888957454 >> 172.21.15.96:0/2888957454 conn(0x7f5a9c0f0b90 msgr2=0x7f5a9c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.211+0000 7f5aa1e00700 1 -- 172.21.15.96:0/2888957454 shutdown_connections 2022-02-02T22:17:02.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.212+0000 7f5aa1e00700 1 -- 172.21.15.96:0/2888957454 wait complete. 2022-02-02T22:17:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.212+0000 7f5aa1e00700 1 Processor -- start 2022-02-02T22:17:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.212+0000 7f5aa1e00700 1 -- start start 2022-02-02T22:17:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 0x7f5a9c109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c10c660 con 0x7f5a9c0602b0 2022-02-02T22:17:02.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c10c7a0 con 0x7f5a9c0f66d0 2022-02-02T22:17:02.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47578/0 (socket says 172.21.15.96:47578) 2022-02-02T22:17:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 -- 172.21.15.96:0/1080899500 learned_addr learned my addr 172.21.15.96:0/1080899500 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa0dfe700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 0x7f5a9c109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 -- 172.21.15.96:0/1080899500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 msgr2=0x7f5a9c109c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 0x7f5a9c109c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 -- 172.21.15.96:0/1080899500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90005040 con 0x7f5a9c0602b0 2022-02-02T22:17:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a9bfff700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 secure :-1 s=READY pgs=3604 cs=0 l=1 rev1=1 rx=0x7f5a880026d0 tx=0x7f5a88009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a880079c0 con 0x7f5a9c0602b0 2022-02-02T22:17:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c10ca80 con 0x7f5a9c0602b0 2022-02-02T22:17:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a8800f040 con 0x7f5a9c0602b0 2022-02-02T22:17:02.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a880148b0 con 0x7f5a9c0602b0 2022-02-02T22:17:02.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.213+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c10d010 con 0x7f5a9c0602b0 2022-02-02T22:17:02.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.214+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c045ad0 con 0x7f5a9c0602b0 2022-02-02T22:17:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.215+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a88007b20 con 0x7f5a9c0602b0 2022-02-02T22:17:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.215+0000 7f5a997fa700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 0x7f5a8c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.215+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a880819c0 con 0x7f5a9c0602b0 2022-02-02T22:17:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.216+0000 7f5aa0dfe700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 0x7f5a8c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.216+0000 7f5aa0dfe700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 0x7f5a8c0672e0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f5a90009f50 tx=0x7f5a90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.220+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a8804fac0 con 0x7f5a9c0602b0 2022-02-02T22:17:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.396+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a9c057f10 con 0x7f5a8c064e20 2022-02-02T22:17:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.405+0000 7f5a997fa700 1 -- 172.21.15.96:0/1080899500 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5a9c057f10 con 0x7f5a8c064e20 2022-02-02T22:17:02.406 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:17:02.407 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:17:02.407 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:17:02.407 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:17:02.408 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:17:02.408 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:17:02.408 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:17:02.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:17:02.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:17:02.410 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:17:02.410 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:17:02.410 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:17:02.411 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:17:02.411 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:17:02.411 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:17:02.411 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:17:02.412 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 3h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:17:02.412 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 3h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:17:02.412 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:17:02.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:17:02.413 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:17:02.413 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:17:02.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 msgr2=0x7f5a8c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 0x7f5a8c0672e0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f5a90009f50 tx=0x7f5a90009b30).stop 2022-02-02T22:17:02.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 msgr2=0x7f5a9c10c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 secure :-1 s=READY pgs=3604 cs=0 l=1 rev1=1 rx=0x7f5a880026d0 tx=0x7f5a88009de0).stop 2022-02-02T22:17:02.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 shutdown_connections 2022-02-02T22:17:02.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a8c064e20 0x7f5a8c0672e0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a9c0f66d0 0x7f5a9c109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 --2- 172.21.15.96:0/1080899500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a9c0602b0 0x7f5a9c10c120 unknown :-1 s=CLOSED pgs=3604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 >> 172.21.15.96:0/1080899500 conn(0x7f5a9c0f0b90 msgr2=0x7f5a9c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 shutdown_connections 2022-02-02T22:17:02.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.407+0000 7f5aa1e00700 1 -- 172.21.15.96:0/1080899500 wait complete. 2022-02-02T22:17:02.505 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:02 smithi096 ceph-mon[101353]: pgmap v7047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:02.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- 172.21.15.96:0/286115381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f4800 msgr2=0x7fdce00f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 --2- 172.21.15.96:0/286115381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f4800 0x7fdce00f4c20 secure :-1 s=READY pgs=3605 cs=0 l=1 rev1=1 rx=0x7fdcd4004660 tx=0x7fdcd4009b30).stop 2022-02-02T22:17:02.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- 172.21.15.96:0/286115381 shutdown_connections 2022-02-02T22:17:02.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 --2- 172.21.15.96:0/286115381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f51a0 0x7fdce00f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 --2- 172.21.15.96:0/286115381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f4800 0x7fdce00f4c20 unknown :-1 s=CLOSED pgs=3605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- 172.21.15.96:0/286115381 >> 172.21.15.96:0/286115381 conn(0x7fdce00f0320 msgr2=0x7fdce00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- 172.21.15.96:0/286115381 shutdown_connections 2022-02-02T22:17:02.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- 172.21.15.96:0/286115381 wait complete. 2022-02-02T22:17:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 Processor -- start 2022-02-02T22:17:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.504+0000 7fdce583c700 1 -- start start 2022-02-02T22:17:02.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdce583c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f4800 0x7fdce00f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdce583c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdce583c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00f5d90 con 0x7fdce00f51a0 2022-02-02T22:17:02.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdce583c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00f5ed0 con 0x7fdce00f4800 2022-02-02T22:17:02.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47586/0 (socket says 172.21.15.96:47586) 2022-02-02T22:17:02.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 -- 172.21.15.96:0/1814649004 learned_addr learned my addr 172.21.15.96:0/1814649004 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:02.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdce483a700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f4800 0x7fdce00f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 -- 172.21.15.96:0/1814649004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f4800 msgr2=0x7fdce00f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f4800 0x7fdce00f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.505+0000 7fdcdffff700 1 -- 172.21.15.96:0/1814649004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4005040 con 0x7fdce00f51a0 2022-02-02T22:17:02.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdcdffff700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 rx=0x7fdccc00c510 tx=0x7fdccc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdccc00f650 con 0x7fdce00f51a0 2022-02-02T22:17:02.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdccc00fc60 con 0x7fdce00f51a0 2022-02-02T22:17:02.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce00f61b0 con 0x7fdce00f51a0 2022-02-02T22:17:02.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce010edd0 con 0x7fdce00f51a0 2022-02-02T22:17:02.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.506+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdccc012c20 con 0x7fdce00f51a0 2022-02-02T22:17:02.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.507+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc0004fa0 con 0x7fdce00f51a0 2022-02-02T22:17:02.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.507+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdccc010070 con 0x7fdce00f51a0 2022-02-02T22:17:02.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.508+0000 7fdcdd7fa700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 0x7fdcd00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.508+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdccc081660 con 0x7fdce00f51a0 2022-02-02T22:17:02.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.508+0000 7fdce483a700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 0x7fdcd00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.508+0000 7fdce483a700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 0x7fdcd00672e0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fdcd4013690 tx=0x7fdcd4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.512+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdccc04f760 con 0x7fdce00f51a0 2022-02-02T22:17:02.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:02 smithi159 ceph-mon[69013]: pgmap v7047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:02.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.742+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdcc0005e80 con 0x7fdce00f51a0 2022-02-02T22:17:02.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.743+0000 7fdcdd7fa700 1 -- 172.21.15.96:0/1814649004 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdccc052d80 con 0x7fdce00f51a0 2022-02-02T22:17:02.745 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:17:02.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:17:02.745 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:17:02.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:02.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:17:02.746 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:17:02.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:02.747 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:17:02.748 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:17:02.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:02.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:17:02.749 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:17:02.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:02.749 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:17:02.750 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:17:02.750 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:17:02.750 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:17:02.751 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:17:02.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 msgr2=0x7fdcd00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 0x7fdcd00672e0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fdcd4013690 tx=0x7fdcd4009b30).stop 2022-02-02T22:17:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 msgr2=0x7fdce00f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 rx=0x7fdccc00c510 tx=0x7fdccc007df0).stop 2022-02-02T22:17:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 shutdown_connections 2022-02-02T22:17:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdcd0064e20 0x7fdcd00672e0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce00f4800 0x7fdce00f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 --2- 172.21.15.96:0/1814649004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdce00f51a0 0x7fdce00f5830 unknown :-1 s=CLOSED pgs=3606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 >> 172.21.15.96:0/1814649004 conn(0x7fdce00f0320 msgr2=0x7fdce00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 shutdown_connections 2022-02-02T22:17:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.745+0000 7fdce583c700 1 -- 172.21.15.96:0/1814649004 wait complete. 2022-02-02T22:17:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 -- 172.21.15.96:0/2141905578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 msgr2=0x7f490c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 --2- 172.21.15.96:0/2141905578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c0f7de0 secure :-1 s=READY pgs=3607 cs=0 l=1 rev1=1 rx=0x7f48fc004660 tx=0x7f48fc009b30).stop 2022-02-02T22:17:02.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 -- 172.21.15.96:0/2141905578 shutdown_connections 2022-02-02T22:17:02.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 --2- 172.21.15.96:0/2141905578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c0f7de0 unknown :-1 s=CLOSED pgs=3607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 --2- 172.21.15.96:0/2141905578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 0x7f490c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 -- 172.21.15.96:0/2141905578 >> 172.21.15.96:0/2141905578 conn(0x7f490c0f1e40 msgr2=0x7f490c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:02.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 -- 172.21.15.96:0/2141905578 shutdown_connections 2022-02-02T22:17:02.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.844+0000 7f4914692700 1 -- 172.21.15.96:0/2141905578 wait complete. 2022-02-02T22:17:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 Processor -- start 2022-02-02T22:17:02.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 -- start start 2022-02-02T22:17:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 0x7f490c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c06a380 con 0x7f490c0f7980 2022-02-02T22:17:02.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4914692700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c06a4c0 con 0x7f490c0f66e0 2022-02-02T22:17:02.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47596/0 (socket says 172.21.15.96:47596) 2022-02-02T22:17:02.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 -- 172.21.15.96:0/90084879 learned_addr learned my addr 172.21.15.96:0/90084879 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:02.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f491242e700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 0x7f490c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 -- 172.21.15.96:0/90084879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 msgr2=0x7f490c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:02.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 0x7f490c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:02.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.845+0000 7f4911c2d700 1 -- 172.21.15.96:0/90084879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc005040 con 0x7f490c0f7980 2022-02-02T22:17:02.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4911c2d700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 secure :-1 s=READY pgs=3608 cs=0 l=1 rev1=1 rx=0x7f48fc009990 tx=0x7f48fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc018070 con 0x7f490c0f7980 2022-02-02T22:17:02.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f48fc007ca0 con 0x7f490c0f7980 2022-02-02T22:17:02.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c06a740 con 0x7f490c0f7980 2022-02-02T22:17:02.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc01c620 con 0x7f490c0f7980 2022-02-02T22:17:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.846+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c06aca0 con 0x7f490c0f7980 2022-02-02T22:17:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.847+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c045ad0 con 0x7f490c0f7980 2022-02-02T22:17:02.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.847+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f48fc01d960 con 0x7f490c0f7980 2022-02-02T22:17:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.847+0000 7f4902ffd700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 0x7f48f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:02.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.848+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f48fc0837d0 con 0x7f490c0f7980 2022-02-02T22:17:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.848+0000 7f491242e700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 0x7f48f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:02.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.848+0000 7f491242e700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 0x7f48f8067290 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f490c06b730 tx=0x7f4908009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:02.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:02.852+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f48fc051a40 con 0x7f490c0f7980 2022-02-02T22:17:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.054+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f490c027a00 con 0x7f490c0f7980 2022-02-02T22:17:03.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.055+0000 7f4902ffd700 1 -- 172.21.15.96:0/90084879 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f48fc055060 con 0x7f490c0f7980 2022-02-02T22:17:03.056 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:17:03.057 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:17:03.057 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:17:03.058 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:17:03.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:03.058 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:17:03.059 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:17:03.059 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:17:03.059 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:17:03.060 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:17:03.060 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:17:03.060 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:17:03.061 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:17:03.061 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:17:03.061 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:17:03.062 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:17:03.062 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:17:03.062 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:17:03.063 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:17:03.063 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:17:03.063 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:17:03.064 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:17:03.064 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:17:03.064 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:17:03.065 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:17:03.065 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:17:03.065 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:17:03.066 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:17:03.066 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:17:03.067 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:17:03.067 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:17:03.067 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:17:03.067 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:03.068 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:03.068 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:17:03.069 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:03.069 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:03.069 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:03.070 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 msgr2=0x7f48f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 0x7f48f8067290 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f490c06b730 tx=0x7f4908009040).stop 2022-02-02T22:17:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 msgr2=0x7f490c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 secure :-1 s=READY pgs=3608 cs=0 l=1 rev1=1 rx=0x7f48fc009990 tx=0x7f48fc009b30).stop 2022-02-02T22:17:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 shutdown_connections 2022-02-02T22:17:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48f8064dd0 0x7f48f8067290 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f490c0f66e0 0x7f490c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 --2- 172.21.15.96:0/90084879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f490c0f7980 0x7f490c069e20 unknown :-1 s=CLOSED pgs=3608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 >> 172.21.15.96:0/90084879 conn(0x7f490c0f1e40 msgr2=0x7f490c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 shutdown_connections 2022-02-02T22:17:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:03.057+0000 7f4914692700 1 -- 172.21.15.96:0/90084879 wait complete. 2022-02-02T22:17:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:17:03.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:03 smithi159 ceph-mon[69013]: from='client.41322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:03 smithi159 ceph-mon[69013]: from='client.41326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1814649004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:17:03.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:03 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/90084879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:17:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:03 smithi096 ceph-mon[101353]: from='client.41322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:03 smithi096 ceph-mon[101353]: from='client.41326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1814649004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:17:03.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:03 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/90084879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:17:04.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:04 smithi159 ceph-mon[69013]: pgmap v7048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:04.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:04 smithi096 ceph-mon[101353]: pgmap v7048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:06.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:06 smithi159 ceph-mon[69013]: pgmap v7049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:06 smithi096 ceph-mon[101353]: pgmap v7049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:08.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:08 smithi159 ceph-mon[69013]: pgmap v7050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:08.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:08 smithi096 ceph-mon[101353]: pgmap v7050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:10.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:10 smithi096 ceph-mon[101353]: pgmap v7051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:10 smithi159 ceph-mon[69013]: pgmap v7051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:12.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:12 smithi096 ceph-mon[101353]: pgmap v7052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:12 smithi159 ceph-mon[69013]: pgmap v7052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:14.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:14 smithi096 ceph-mon[101353]: pgmap v7053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:14 smithi159 ceph-mon[69013]: pgmap v7053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:16 smithi096 ceph-mon[101353]: pgmap v7054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:16 smithi159 ceph-mon[69013]: pgmap v7054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:18.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:18 smithi096 ceph-mon[101353]: pgmap v7055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:18 smithi159 ceph-mon[69013]: pgmap v7055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:20 smithi096 ceph-mon[101353]: pgmap v7056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:20 smithi159 ceph-mon[69013]: pgmap v7056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:22.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:22 smithi096 ceph-mon[101353]: pgmap v7057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:22 smithi159 ceph-mon[69013]: pgmap v7057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:24.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:24 smithi096 ceph-mon[101353]: pgmap v7058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:24 smithi159 ceph-mon[69013]: pgmap v7058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:26.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:26 smithi096 ceph-mon[101353]: pgmap v7059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:26 smithi159 ceph-mon[69013]: pgmap v7059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:28 smithi096 ceph-mon[101353]: pgmap v7060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:17:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:17:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:28 smithi159 ceph-mon[69013]: pgmap v7060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:17:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:17:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:30 smithi159 ceph-mon[69013]: pgmap v7061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:30 smithi096 ceph-mon[101353]: pgmap v7061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:32 smithi159 ceph-mon[69013]: pgmap v7062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:32 smithi096 ceph-mon[101353]: pgmap v7062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 -- 172.21.15.96:0/2265647043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 msgr2=0x7faee00f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 --2- 172.21.15.96:0/2265647043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee00f7080 secure :-1 s=READY pgs=3609 cs=0 l=1 rev1=1 rx=0x7faed8004660 tx=0x7faed8009b30).stop 2022-02-02T22:17:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 -- 172.21.15.96:0/2265647043 shutdown_connections 2022-02-02T22:17:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 --2- 172.21.15.96:0/2265647043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 0x7faee00f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:17:33.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 --2- 172.21.15.96:0/2265647043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee00f7080 unknown :-1 s=CLOSED pgs=3609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 -- 172.21.15.96:0/2265647043 >> 172.21.15.96:0/2265647043 conn(0x7faee00f04c0 msgr2=0x7faee00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 -- 172.21.15.96:0/2265647043 shutdown_connections 2022-02-02T22:17:33.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.168+0000 7faee59d0700 1 -- 172.21.15.96:0/2265647043 wait complete. 2022-02-02T22:17:33.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 Processor -- start 2022-02-02T22:17:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 -- start start 2022-02-02T22:17:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 0x7faee0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0106a30 con 0x7faee00f6c60 2022-02-02T22:17:33.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faee59d0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01071b0 con 0x7faee00f5970 2022-02-02T22:17:33.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.169+0000 7faede7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47614/0 (socket says 172.21.15.96:47614) 2022-02-02T22:17:33.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 -- 172.21.15.96:0/4261951223 learned_addr learned my addr 172.21.15.96:0/4261951223 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:33.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faedeffd700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 0x7faee0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 -- 172.21.15.96:0/4261951223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 msgr2=0x7faee0105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 0x7faee0105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 -- 172.21.15.96:0/4261951223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8005040 con 0x7faee00f6c60 2022-02-02T22:17:33.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faede7fc700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 secure :-1 s=READY pgs=3610 cs=0 l=1 rev1=1 rx=0x7faec800b410 tx=0x7faec8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec80125f0 con 0x7faee00f6c60 2022-02-02T22:17:33.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0107430 con 0x7faee00f6c60 2022-02-02T22:17:33.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faec800be30 con 0x7faee00f6c60 2022-02-02T22:17:33.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec8002a70 con 0x7faee00f6c60 2022-02-02T22:17:33.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.170+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01079f0 con 0x7faee00f6c60 2022-02-02T22:17:33.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.171+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee0045ad0 con 0x7faee00f6c60 2022-02-02T22:17:33.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.172+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faec800f030 con 0x7faee00f6c60 2022-02-02T22:17:33.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.172+0000 7faed77fe700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.172+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faec8081e80 con 0x7faee00f6c60 2022-02-02T22:17:33.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.172+0000 7faedeffd700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.172+0000 7faedeffd700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7faed8004630 tx=0x7faed8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.176+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faec804ff80 con 0x7faee00f6c60 2022-02-02T22:17:33.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.357+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faee0107c10 con 0x7faecc064dd0 2022-02-02T22:17:33.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.358+0000 7faed77fe700 1 -- 172.21.15.96:0/4261951223 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faee0107c10 con 0x7faecc064dd0 2022-02-02T22:17:33.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 msgr2=0x7faecc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7faed8004630 tx=0x7faed8009b30).stop 2022-02-02T22:17:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 msgr2=0x7faee01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 secure :-1 s=READY pgs=3610 cs=0 l=1 rev1=1 rx=0x7faec800b410 tx=0x7faec8006ef0).stop 2022-02-02T22:17:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 shutdown_connections 2022-02-02T22:17:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faecc064dd0 0x7faecc067290 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faee00f5970 0x7faee0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 --2- 172.21.15.96:0/4261951223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faee00f6c60 0x7faee01063a0 unknown :-1 s=CLOSED pgs=3610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 >> 172.21.15.96:0/4261951223 conn(0x7faee00f04c0 msgr2=0x7faee00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 shutdown_connections 2022-02-02T22:17:33.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.360+0000 7faee59d0700 1 -- 172.21.15.96:0/4261951223 wait complete. 2022-02-02T22:17:33.370 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:17:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.457+0000 7f106c22c700 1 -- 172.21.15.96:0/1957336828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f6860 msgr2=0x7f10640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.457+0000 7f106c22c700 1 --2- 172.21.15.96:0/1957336828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f6860 0x7f10640f6cc0 secure :-1 s=READY pgs=3611 cs=0 l=1 rev1=1 rx=0x7f1060004660 tx=0x7f1060009b30).stop 2022-02-02T22:17:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.457+0000 7f106c22c700 1 -- 172.21.15.96:0/1957336828 shutdown_connections 2022-02-02T22:17:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 --2- 172.21.15.96:0/1957336828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f6860 0x7f10640f6cc0 unknown :-1 s=CLOSED pgs=3611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 --2- 172.21.15.96:0/1957336828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10640f55c0 0x7f10640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- 172.21.15.96:0/1957336828 >> 172.21.15.96:0/1957336828 conn(0x7f10640f0d40 msgr2=0x7f10640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- 172.21.15.96:0/1957336828 shutdown_connections 2022-02-02T22:17:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- 172.21.15.96:0/1957336828 wait complete. 2022-02-02T22:17:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 Processor -- start 2022-02-02T22:17:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- start start 2022-02-02T22:17:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10640f6860 0x7f1064107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064107a10 con 0x7f10640f55c0 2022-02-02T22:17:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.458+0000 7f106c22c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064107b50 con 0x7f10640f6860 2022-02-02T22:17:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47622/0 (socket says 172.21.15.96:47622) 2022-02-02T22:17:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 -- 172.21.15.96:0/19523025 learned_addr learned my addr 172.21.15.96:0/19523025 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 -- 172.21.15.96:0/19523025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10640f6860 msgr2=0x7f1064107460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T22:17:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10640f6860 0x7f1064107460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:17:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 -- 172.21.15.96:0/19523025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060005040 con 0x7f10640f55c0 2022-02-02T22:17:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f1069fc8700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 secure :-1 s=READY pgs=3612 cs=0 l=1 rev1=1 rx=0x7f105400c790 tx=0x7f1054007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105400e680 con 0x7f10640f55c0 2022-02-02T22:17:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f105400ec90 con 0x7f10640f55c0 2022-02-02T22:17:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10641084f0 con 0x7f10640f55c0 2022-02-02T22:17:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1054012d00 con 0x7f10640f55c0 2022-02-02T22:17:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.459+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1064108ab0 con 0x7f10640f55c0 2022-02-02T22:17:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.460+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064045ad0 con 0x7f10640f55c0 2022-02-02T22:17:33.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.461+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1054010070 con 0x7f10640f55c0 2022-02-02T22:17:33.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.461+0000 7f105a7fc700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 0x7f1050067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.462+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1054081b50 con 0x7f10640f55c0 2022-02-02T22:17:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.462+0000 7f10697c7700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 0x7f1050067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.462+0000 7f10697c7700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 0x7f1050067290 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f1060004e30 tx=0x7f1060009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.466+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1054053680 con 0x7f10640f55c0 2022-02-02T22:17:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.640+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10640faca0 con 0x7f1050064dd0 2022-02-02T22:17:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.649+0000 7f105a7fc700 1 -- 172.21.15.96:0/19523025 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f10640faca0 con 0x7f1050064dd0 2022-02-02T22:17:33.649 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:17:33.650 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:17:33.650 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:17:33.651 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:17:33.651 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:17:33.651 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:17:33.652 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:17:33.652 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:17:33.652 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:17:33.653 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:17:33.653 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:17:33.653 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:17:33.654 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:17:33.654 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:17:33.654 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:17:33.655 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:17:33.655 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:17:33.655 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:17:33.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 3h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:17:33.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 3h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:17:33.657 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:17:33.657 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:17:33.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 msgr2=0x7f1050067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 0x7f1050067290 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f1060004e30 tx=0x7f1060009b30).stop 2022-02-02T22:17:33.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 msgr2=0x7f1064106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 secure :-1 s=READY pgs=3612 cs=0 l=1 rev1=1 rx=0x7f105400c790 tx=0x7f1054007d90).stop 2022-02-02T22:17:33.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 shutdown_connections 2022-02-02T22:17:33.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1050064dd0 0x7f1050067290 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10640f55c0 0x7f1064106f70 unknown :-1 s=CLOSED pgs=3612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 --2- 172.21.15.96:0/19523025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10640f6860 0x7f1064107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:17:33.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 >> 172.21.15.96:0/19523025 conn(0x7f10640f0d40 msgr2=0x7f106405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 shutdown_connections 2022-02-02T22:17:33.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.651+0000 7f106c22c700 1 -- 172.21.15.96:0/19523025 wait complete. 2022-02-02T22:17:33.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 -- 172.21.15.96:0/963933923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 msgr2=0x7ff1600f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 --2- 172.21.15.96:0/963933923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff1600f6810 secure :-1 s=READY pgs=3613 cs=0 l=1 rev1=1 rx=0x7ff154004660 tx=0x7ff154009b30).stop 2022-02-02T22:17:33.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 -- 172.21.15.96:0/963933923 shutdown_connections 2022-02-02T22:17:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 --2- 172.21.15.96:0/963933923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff1600f6810 unknown :-1 s=CLOSED pgs=3613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 --2- 172.21.15.96:0/963933923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 0x7ff1600f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 -- 172.21.15.96:0/963933923 >> 172.21.15.96:0/963933923 conn(0x7ff1600f0320 msgr2=0x7ff1600f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 -- 172.21.15.96:0/963933923 shutdown_connections 2022-02-02T22:17:33.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.747+0000 7ff165006700 1 -- 172.21.15.96:0/963933923 wait complete. 2022-02-02T22:17:33.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 Processor -- start 2022-02-02T22:17:33.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 -- start start 2022-02-02T22:17:33.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 0x7ff160109a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600f54e0 con 0x7ff1600f63b0 2022-02-02T22:17:33.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.748+0000 7ff165006700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600f5620 con 0x7ff1600f5a10 2022-02-02T22:17:33.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47634/0 (socket says 172.21.15.96:47634) 2022-02-02T22:17:33.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 -- 172.21.15.96:0/1996097697 learned_addr learned my addr 172.21.15.96:0/1996097697 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:33.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15ffff700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 0x7ff160109a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 -- 172.21.15.96:0/1996097697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 msgr2=0x7ff160109a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 0x7ff160109a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 -- 172.21.15.96:0/1996097697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154005040 con 0x7ff1600f63b0 2022-02-02T22:17:33.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15f7fe700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 secure :-1 s=READY pgs=3614 cs=0 l=1 rev1=1 rx=0x7ff154009990 tx=0x7ff154009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff154018070 con 0x7ff1600f63b0 2022-02-02T22:17:33.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff154007ca0 con 0x7ff1600f63b0 2022-02-02T22:17:33.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16010c4b0 con 0x7ff1600f63b0 2022-02-02T22:17:33.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff15401c620 con 0x7ff1600f63b0 2022-02-02T22:17:33.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.749+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16010c9e0 con 0x7ff1600f63b0 2022-02-02T22:17:33.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.750+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff160059100 con 0x7ff1600f63b0 2022-02-02T22:17:33.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.751+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff15401c890 con 0x7ff1600f63b0 2022-02-02T22:17:33.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.751+0000 7ff15cff9700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 0x7ff1480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:33.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.751+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff154083720 con 0x7ff1600f63b0 2022-02-02T22:17:33.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.751+0000 7ff15ffff700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 0x7ff1480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:33.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.752+0000 7ff15ffff700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 0x7ff1480672e0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7ff1600f5160 tx=0x7ff150009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:33.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.755+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff1540518e0 con 0x7ff1600f63b0 2022-02-02T22:17:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.986+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff160045ad0 con 0x7ff1600f63b0 2022-02-02T22:17:33.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.987+0000 7ff15cff9700 1 -- 172.21.15.96:0/1996097697 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff154054f00 con 0x7ff1600f63b0 2022-02-02T22:17:33.987 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:17:33.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:17:33.988 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:17:33.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:33.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:17:33.989 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:17:33.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:33.990 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:17:33.990 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:17:33.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:33.991 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:17:33.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:17:33.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:17:33.992 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:17:33.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:17:33.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:17:33.993 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:17:33.993 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:17:33.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 msgr2=0x7ff1480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 0x7ff1480672e0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7ff1600f5160 tx=0x7ff150009040).stop 2022-02-02T22:17:33.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 msgr2=0x7ff16010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:33.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 secure :-1 s=READY pgs=3614 cs=0 l=1 rev1=1 rx=0x7ff154009990 tx=0x7ff154009b30).stop 2022-02-02T22:17:33.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 shutdown_connections 2022-02-02T22:17:33.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff148064e20 0x7ff1480672e0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1600f5a10 0x7ff160109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 --2- 172.21.15.96:0/1996097697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1600f63b0 0x7ff16010bf60 unknown :-1 s=CLOSED pgs=3614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:33.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 >> 172.21.15.96:0/1996097697 conn(0x7ff1600f0320 msgr2=0x7ff1600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:33.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 shutdown_connections 2022-02-02T22:17:33.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:33.989+0000 7ff165006700 1 -- 172.21.15.96:0/1996097697 wait complete. 2022-02-02T22:17:34.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 -- 172.21.15.96:0/2437829599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 msgr2=0x7f94440f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 --2- 172.21.15.96:0/2437829599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f94440f6b30 secure :-1 s=READY pgs=3615 cs=0 l=1 rev1=1 rx=0x7f9438004660 tx=0x7f9438009b30).stop 2022-02-02T22:17:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 -- 172.21.15.96:0/2437829599 shutdown_connections 2022-02-02T22:17:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 --2- 172.21.15.96:0/2437829599 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f94440f6b30 unknown :-1 s=CLOSED pgs=3615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 --2- 172.21.15.96:0/2437829599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 0x7f94440f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 -- 172.21.15.96:0/2437829599 >> 172.21.15.96:0/2437829599 conn(0x7f94440f0b90 msgr2=0x7f94440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:34.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 -- 172.21.15.96:0/2437829599 shutdown_connections 2022-02-02T22:17:34.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.087+0000 7f944359e700 1 -- 172.21.15.96:0/2437829599 wait complete. 2022-02-02T22:17:34.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 Processor -- start 2022-02-02T22:17:34.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 -- start start 2022-02-02T22:17:34.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 0x7f9444108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:34.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:34.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441099e0 con 0x7f94440f66d0 2022-02-02T22:17:34.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9444109b20 con 0x7f94440f5430 2022-02-02T22:17:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47644/0 (socket says 172.21.15.96:47644) 2022-02-02T22:17:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f9441d9b700 1 -- 172.21.15.96:0/2737835106 learned_addr learned my addr 172.21.15.96:0/2737835106 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:17:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.088+0000 7f944259c700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 0x7f9444108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9441d9b700 1 -- 172.21.15.96:0/2737835106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 msgr2=0x7f9444108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9441d9b700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 0x7f9444108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9441d9b700 1 -- 172.21.15.96:0/2737835106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438005040 con 0x7f94440f66d0 2022-02-02T22:17:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9441d9b700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 secure :-1 s=READY pgs=3616 cs=0 l=1 rev1=1 rx=0x7f9438009990 tx=0x7f9438009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9438018070 con 0x7f94440f66d0 2022-02-02T22:17:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f944359e700 1 -- 172.21.15.96:0/2737835106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944410a460 con 0x7f94440f66d0 2022-02-02T22:17:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9438007ba0 con 0x7f94440f66d0 2022-02-02T22:17:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f944359e700 1 -- 172.21.15.96:0/2737835106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944410a9c0 con 0x7f94440f66d0 2022-02-02T22:17:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.089+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f943801c3c0 con 0x7f94440f66d0 2022-02-02T22:17:34.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.090+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9444045ad0 con 0x7f94440f66d0 2022-02-02T22:17:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.090+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f943801d420 con 0x7f94440f66d0 2022-02-02T22:17:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.091+0000 7f9432ffd700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 0x7f942c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:17:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.091+0000 7f944259c700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 0x7f942c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:17:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.091+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f94380836d0 con 0x7f94440f66d0 2022-02-02T22:17:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.091+0000 7f944259c700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 0x7f942c0672e0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f94440f6530 tx=0x7f943400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:17:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.095+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f94380552c0 con 0x7f94440f66d0 2022-02-02T22:17:34.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.298+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f944410b050 con 0x7f94440f66d0 2022-02-02T22:17:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.299+0000 7f9432ffd700 1 -- 172.21.15.96:0/2737835106 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9438054eb0 con 0x7f94440f66d0 2022-02-02T22:17:34.299 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:17:34.300 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:17:34.300 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:17:34.301 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:17:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:34.301 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:17:34.302 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:17:34.302 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:17:34.302 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:17:34.303 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:17:34.303 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:17:34.303 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:17:34.304 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:17:34.304 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:17:34.304 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:17:34.305 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:17:34.305 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:17:34.305 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:17:34.306 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:17:34.306 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:17:34.306 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:17:34.307 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:17:34.307 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:17:34.307 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:17:34.308 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:17:34.308 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:17:34.308 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:17:34.309 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:17:34.309 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:17:34.309 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:17:34.310 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:17:34.310 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:17:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:34.311 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:17:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:17:34.312 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:34.312 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:34.313 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:17:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 msgr2=0x7f942c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 0x7f942c0672e0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f94440f6530 tx=0x7f943400b040).stop 2022-02-02T22:17:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 msgr2=0x7f9444109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:17:34.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 secure :-1 s=READY pgs=3616 cs=0 l=1 rev1=1 rx=0x7f9438009990 tx=0x7f9438009b30).stop 2022-02-02T22:17:34.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 shutdown_connections 2022-02-02T22:17:34.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f942c064e20 0x7f942c0672e0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94440f5430 0x7f9444108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 --2- 172.21.15.96:0/2737835106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94440f66d0 0x7f9444109430 unknown :-1 s=CLOSED pgs=3616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:17:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 >> 172.21.15.96:0/2737835106 conn(0x7f94440f0b90 msgr2=0x7f944405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:17:34.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 shutdown_connections 2022-02-02T22:17:34.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:17:34.301+0000 7f9430ff9700 1 -- 172.21.15.96:0/2737835106 wait complete. 2022-02-02T22:17:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:17:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:34 smithi096 ceph-mon[101353]: pgmap v7063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:34 smithi096 ceph-mon[101353]: from='client.41338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:34 smithi096 ceph-mon[101353]: from='client.41342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:34.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1996097697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:17:34.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2737835106' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:17:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:34 smithi159 ceph-mon[69013]: pgmap v7063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:34 smithi159 ceph-mon[69013]: from='client.41338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:34 smithi159 ceph-mon[69013]: from='client.41342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:17:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1996097697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:17:34.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2737835106' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:17:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:36 smithi159 ceph-mon[69013]: pgmap v7064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:36 smithi096 ceph-mon[101353]: pgmap v7064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:38 smithi159 ceph-mon[69013]: pgmap v7065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:38 smithi096 ceph-mon[101353]: pgmap v7065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:40 smithi159 ceph-mon[69013]: pgmap v7066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:40 smithi096 ceph-mon[101353]: pgmap v7066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:42 smithi159 ceph-mon[69013]: pgmap v7067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:42 smithi096 ceph-mon[101353]: pgmap v7067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:44 smithi159 ceph-mon[69013]: pgmap v7068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:44 smithi096 ceph-mon[101353]: pgmap v7068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:46 smithi159 ceph-mon[69013]: pgmap v7069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:46 smithi096 ceph-mon[101353]: pgmap v7069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:48 smithi159 ceph-mon[69013]: pgmap v7070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:48 smithi096 ceph-mon[101353]: pgmap v7070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:50 smithi159 ceph-mon[69013]: pgmap v7071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:50 smithi096 ceph-mon[101353]: pgmap v7071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:52 smithi159 ceph-mon[69013]: pgmap v7072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:52 smithi096 ceph-mon[101353]: pgmap v7072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:54 smithi159 ceph-mon[69013]: pgmap v7073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:54 smithi096 ceph-mon[101353]: pgmap v7073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:56 smithi159 ceph-mon[69013]: pgmap v7074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:56 smithi096 ceph-mon[101353]: pgmap v7074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:17:58 smithi159 ceph-mon[69013]: pgmap v7075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:17:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:17:58 smithi096 ceph-mon[101353]: pgmap v7075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:00 smithi159 ceph-mon[69013]: pgmap v7076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:00 smithi096 ceph-mon[101353]: pgmap v7076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:02 smithi159 ceph-mon[69013]: pgmap v7077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:02 smithi096 ceph-mon[101353]: pgmap v7077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:04.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- 172.21.15.96:0/380861799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f66e0 msgr2=0x7f90700f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 --2- 172.21.15.96:0/380861799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f66e0 0x7f90700f6b00 secure :-1 s=READY pgs=3617 cs=0 l=1 rev1=1 rx=0x7f9060004660 tx=0x7f9060009b30).stop 2022-02-02T22:18:04.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- 172.21.15.96:0/380861799 shutdown_connections 2022-02-02T22:18:04.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 --2- 172.21.15.96:0/380861799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f7980 0x7f90700f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 --2- 172.21.15.96:0/380861799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f66e0 0x7f90700f6b00 unknown :-1 s=CLOSED pgs=3617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- 172.21.15.96:0/380861799 >> 172.21.15.96:0/380861799 conn(0x7f90700f1e40 msgr2=0x7f90700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:04.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- 172.21.15.96:0/380861799 shutdown_connections 2022-02-02T22:18:04.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- 172.21.15.96:0/380861799 wait complete. 2022-02-02T22:18:04.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 Processor -- start 2022-02-02T22:18:04.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.412+0000 7f9074c5c700 1 -- start start 2022-02-02T22:18:04.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9074c5c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f66e0 0x7f9070106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9074c5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9074c5c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070107a50 con 0x7f90700f7980 2022-02-02T22:18:04.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9074c5c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070107b90 con 0x7f90700f66e0 2022-02-02T22:18:04.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47662/0 (socket says 172.21.15.96:47662) 2022-02-02T22:18:04.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 -- 172.21.15.96:0/2053620657 learned_addr learned my addr 172.21.15.96:0/2053620657 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:04.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f906e59c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f66e0 0x7f9070106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 -- 172.21.15.96:0/2053620657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f66e0 msgr2=0x7f9070106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f66e0 0x7f9070106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 -- 172.21.15.96:0/2053620657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060005040 con 0x7f90700f7980 2022-02-02T22:18:04.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.413+0000 7f9067fff700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 secure :-1 s=READY pgs=3618 cs=0 l=1 rev1=1 rx=0x7f90580026d0 tx=0x7f9058009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.414+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90580079c0 con 0x7f90700f7980 2022-02-02T22:18:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.414+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f905800f040 con 0x7f90700f7980 2022-02-02T22:18:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.414+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9070108530 con 0x7f90700f7980 2022-02-02T22:18:04.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.414+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90580148b0 con 0x7f90700f7980 2022-02-02T22:18:04.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.414+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9070108af0 con 0x7f90700f7980 2022-02-02T22:18:04.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.415+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9070045ad0 con 0x7f90700f7980 2022-02-02T22:18:04.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.415+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9058007b20 con 0x7f90700f7980 2022-02-02T22:18:04.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.415+0000 7f9066ffd700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 0x7f905c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.416+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9058081900 con 0x7f90700f7980 2022-02-02T22:18:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.416+0000 7f906e59c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 0x7f905c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.416+0000 7f906e59c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 0x7f905c067290 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7f9060004630 tx=0x7f9060009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:04.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.420+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9058053430 con 0x7f90700f7980 2022-02-02T22:18:04.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.598+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9070108dc0 con 0x7f905c064dd0 2022-02-02T22:18:04.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.599+0000 7f9066ffd700 1 -- 172.21.15.96:0/2053620657 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9070108dc0 con 0x7f905c064dd0 2022-02-02T22:18:04.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.600+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 msgr2=0x7f905c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.600+0000 7f9074c5c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 0x7f905c067290 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7f9060004630 tx=0x7f9060009b30).stop 2022-02-02T22:18:04.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 msgr2=0x7f90701074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 secure :-1 s=READY pgs=3618 cs=0 l=1 rev1=1 rx=0x7f90580026d0 tx=0x7f9058009de0).stop 2022-02-02T22:18:04.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 shutdown_connections 2022-02-02T22:18:04.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f905c064dd0 0x7f905c067290 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90700f66e0 0x7f9070106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 --2- 172.21.15.96:0/2053620657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90700f7980 0x7f90701074a0 unknown :-1 s=CLOSED pgs=3618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 >> 172.21.15.96:0/2053620657 conn(0x7f90700f1e40 msgr2=0x7f90700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 shutdown_connections 2022-02-02T22:18:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.601+0000 7f9074c5c700 1 -- 172.21.15.96:0/2053620657 wait complete. 2022-02-02T22:18:04.610 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:18:04.611 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:04 smithi096 ceph-mon[101353]: pgmap v7078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:04.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 -- 172.21.15.96:0/2377111159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f6870 msgr2=0x7feaa00f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 --2- 172.21.15.96:0/2377111159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f6870 0x7feaa00f6cd0 secure :-1 s=READY pgs=3619 cs=0 l=1 rev1=1 rx=0x7fea90004660 tx=0x7fea90009b30).stop 2022-02-02T22:18:04.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 -- 172.21.15.96:0/2377111159 shutdown_connections 2022-02-02T22:18:04.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 --2- 172.21.15.96:0/2377111159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f6870 0x7feaa00f6cd0 unknown :-1 s=CLOSED pgs=3619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 --2- 172.21.15.96:0/2377111159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f55d0 0x7feaa00f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 -- 172.21.15.96:0/2377111159 >> 172.21.15.96:0/2377111159 conn(0x7feaa00f0d70 msgr2=0x7feaa00f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:04.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 -- 172.21.15.96:0/2377111159 shutdown_connections 2022-02-02T22:18:04.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 -- 172.21.15.96:0/2377111159 wait complete. 2022-02-02T22:18:04.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.699+0000 7feaa7627700 1 Processor -- start 2022-02-02T22:18:04.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 -- start start 2022-02-02T22:18:04.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f6870 0x7feaa010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00604c0 con 0x7feaa00f55d0 2022-02-02T22:18:04.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0060600 con 0x7feaa00f6870 2022-02-02T22:18:04.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47670/0 (socket says 172.21.15.96:47670) 2022-02-02T22:18:04.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 -- 172.21.15.96:0/3604321988 learned_addr learned my addr 172.21.15.96:0/3604321988 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:04.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa4bc2700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f6870 0x7feaa010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 -- 172.21.15.96:0/3604321988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f6870 msgr2=0x7feaa010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f6870 0x7feaa010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 -- 172.21.15.96:0/3604321988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90005040 con 0x7feaa00f55d0 2022-02-02T22:18:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa53c3700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 rx=0x7fea9c002700 tx=0x7fea9c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:04.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c009320 con 0x7feaa00f55d0 2022-02-02T22:18:04.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa010c740 con 0x7feaa00f55d0 2022-02-02T22:18:04.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.700+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea9c00f040 con 0x7feaa00f55d0 2022-02-02T22:18:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.701+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c014780 con 0x7feaa00f55d0 2022-02-02T22:18:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.701+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa010cd00 con 0x7feaa00f55d0 2022-02-02T22:18:04.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.702+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa0045ad0 con 0x7feaa00f55d0 2022-02-02T22:18:04.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.702+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fea9c009480 con 0x7feaa00f55d0 2022-02-02T22:18:04.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.703+0000 7fea95ffb700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 0x7fea8c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.703+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fea9c082090 con 0x7feaa00f55d0 2022-02-02T22:18:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.703+0000 7feaa4bc2700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 0x7fea8c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.703+0000 7feaa4bc2700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 0x7fea8c067270 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fea90000c00 tx=0x7fea90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.707+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fea9c050130 con 0x7feaa00f55d0 2022-02-02T22:18:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:04 smithi159 ceph-mon[69013]: pgmap v7078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.879+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa0057f10 con 0x7fea8c064db0 2022-02-02T22:18:04.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.888+0000 7fea95ffb700 1 -- 172.21.15.96:0/3604321988 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7feaa0057f10 con 0x7fea8c064db0 2022-02-02T22:18:04.889 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:18:04.890 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:18:04.890 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:18:04.890 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:18:04.891 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:18:04.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:18:04.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:18:04.892 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:18:04.892 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:18:04.892 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:18:04.893 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:18:04.893 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:18:04.893 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:18:04.894 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:18:04.894 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:18:04.894 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:18:04.895 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:18:04.895 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:18:04.896 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:18:04.896 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:18:04.896 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 3h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:18:04.897 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:18:04.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 msgr2=0x7fea8c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 0x7fea8c067270 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fea90000c00 tx=0x7fea90009b30).stop 2022-02-02T22:18:04.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 msgr2=0x7feaa0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 rx=0x7fea9c002700 tx=0x7fea9c009d60).stop 2022-02-02T22:18:04.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 shutdown_connections 2022-02-02T22:18:04.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fea8c064db0 0x7fea8c067270 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaa00f55d0 0x7feaa0109c90 unknown :-1 s=CLOSED pgs=3620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 --2- 172.21.15.96:0/3604321988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feaa00f6870 0x7feaa010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.890+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 >> 172.21.15.96:0/3604321988 conn(0x7feaa00f0d70 msgr2=0x7feaa00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:04.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.891+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 shutdown_connections 2022-02-02T22:18:04.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.891+0000 7feaa7627700 1 -- 172.21.15.96:0/3604321988 wait complete. 2022-02-02T22:18:04.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- 172.21.15.96:0/3925946257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f6860 msgr2=0x7f347c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 --2- 172.21.15.96:0/3925946257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f6860 0x7f347c0f6cc0 secure :-1 s=READY pgs=3621 cs=0 l=1 rev1=1 rx=0x7f3478004660 tx=0x7f3478009b30).stop 2022-02-02T22:18:04.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- 172.21.15.96:0/3925946257 shutdown_connections 2022-02-02T22:18:04.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 --2- 172.21.15.96:0/3925946257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f6860 0x7f347c0f6cc0 unknown :-1 s=CLOSED pgs=3621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 --2- 172.21.15.96:0/3925946257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f55c0 0x7f347c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- 172.21.15.96:0/3925946257 >> 172.21.15.96:0/3925946257 conn(0x7f347c0f0d40 msgr2=0x7f347c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:04.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- 172.21.15.96:0/3925946257 shutdown_connections 2022-02-02T22:18:04.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- 172.21.15.96:0/3925946257 wait complete. 2022-02-02T22:18:04.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 Processor -- start 2022-02-02T22:18:04.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.987+0000 7f348390f700 1 -- start start 2022-02-02T22:18:04.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f348390f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f348390f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 0x7f347c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:04.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f348390f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0f8100 con 0x7f347c0f55c0 2022-02-02T22:18:04.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f348390f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0f8240 con 0x7f347c0f6860 2022-02-02T22:18:04.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47680/0 (socket says 172.21.15.96:47680) 2022-02-02T22:18:04.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 -- 172.21.15.96:0/2997945471 learned_addr learned my addr 172.21.15.96:0/2997945471 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:04.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f3480eaa700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 0x7f347c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:04.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 -- 172.21.15.96:0/2997945471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 msgr2=0x7f347c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:04.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 0x7f347c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:04.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 -- 172.21.15.96:0/2997945471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478005040 con 0x7f347c0f55c0 2022-02-02T22:18:04.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f3480eaa700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 0x7f347c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:18:04.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f34816ab700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 rx=0x7f346c002700 tx=0x7f346c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:04.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346c009320 con 0x7f347c0f55c0 2022-02-02T22:18:04.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f346c00f040 con 0x7f347c0f55c0 2022-02-02T22:18:04.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346c014900 con 0x7f347c0f55c0 2022-02-02T22:18:04.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.988+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c0f8520 con 0x7f347c0f55c0 2022-02-02T22:18:04.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.989+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c10efa0 con 0x7f347c0f55c0 2022-02-02T22:18:05.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.990+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c045ad0 con 0x7f347c0f55c0 2022-02-02T22:18:05.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.990+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f346c009480 con 0x7f347c0f55c0 2022-02-02T22:18:05.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.990+0000 7f3471ffb700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:05.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.990+0000 7f3480eaa700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:05.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.990+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f346c081cc0 con 0x7f347c0f55c0 2022-02-02T22:18:05.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.991+0000 7f3480eaa700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f3478009da0 tx=0x7f3478009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:05.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:04.995+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f346c04fe80 con 0x7f347c0f55c0 2022-02-02T22:18:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.224+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f347c10f7c0 con 0x7f347c0f55c0 2022-02-02T22:18:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.225+0000 7f3471ffb700 1 -- 172.21.15.96:0/2997945471 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f346c0534a0 con 0x7f347c0f55c0 2022-02-02T22:18:05.226 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:18:05.226 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:18:05.227 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:18:05.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:05.227 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:18:05.228 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:18:05.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:05.228 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:18:05.229 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:18:05.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:05.229 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:18:05.229 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:18:05.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:05.230 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:18:05.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:18:05.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:18:05.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:18:05.231 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:18:05.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 msgr2=0x7f3468067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f3478009da0 tx=0x7f3478009b30).stop 2022-02-02T22:18:05.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 msgr2=0x7f347c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 rx=0x7f346c002700 tx=0x7f346c009d80).stop 2022-02-02T22:18:05.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 shutdown_connections 2022-02-02T22:18:05.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3468064dd0 0x7f3468067290 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f347c0f55c0 0x7f347c0f9720 unknown :-1 s=CLOSED pgs=3622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 --2- 172.21.15.96:0/2997945471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f347c0f6860 0x7f347c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 >> 172.21.15.96:0/2997945471 conn(0x7f347c0f0d40 msgr2=0x7f347c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:05.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 shutdown_connections 2022-02-02T22:18:05.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.227+0000 7f348390f700 1 -- 172.21.15.96:0/2997945471 wait complete. 2022-02-02T22:18:05.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.324+0000 7fb425b08700 1 -- 172.21.15.96:0/1316851629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 msgr2=0x7fb4200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.324+0000 7fb425b08700 1 --2- 172.21.15.96:0/1316851629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb4200f6b30 secure :-1 s=READY pgs=3623 cs=0 l=1 rev1=1 rx=0x7fb40c004660 tx=0x7fb40c009b30).stop 2022-02-02T22:18:05.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- 172.21.15.96:0/1316851629 shutdown_connections 2022-02-02T22:18:05.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 --2- 172.21.15.96:0/1316851629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb4200f6b30 unknown :-1 s=CLOSED pgs=3623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 --2- 172.21.15.96:0/1316851629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 0x7fb4200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- 172.21.15.96:0/1316851629 >> 172.21.15.96:0/1316851629 conn(0x7fb4200f0b90 msgr2=0x7fb4200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:05.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- 172.21.15.96:0/1316851629 shutdown_connections 2022-02-02T22:18:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- 172.21.15.96:0/1316851629 wait complete. 2022-02-02T22:18:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 Processor -- start 2022-02-02T22:18:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- start start 2022-02-02T22:18:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 0x7fb4201099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:05.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200603c0 con 0x7fb4200f66d0 2022-02-02T22:18:05.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.325+0000 7fb425b08700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420060500 con 0x7fb4200f5430 2022-02-02T22:18:05.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:05.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47692/0 (socket says 172.21.15.96:47692) 2022-02-02T22:18:05.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 -- 172.21.15.96:0/315214945 learned_addr learned my addr 172.21.15.96:0/315214945 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:05.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb424b06700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 0x7fb4201099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:05.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 -- 172.21.15.96:0/315214945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 msgr2=0x7fb4201099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 0x7fb4201099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 -- 172.21.15.96:0/315214945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c005040 con 0x7fb4200f66d0 2022-02-02T22:18:05.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41ffff700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 secure :-1 s=READY pgs=3624 cs=0 l=1 rev1=1 rx=0x7fb40c000c00 tx=0x7fb40c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:05.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40c019070 con 0x7fb4200f66d0 2022-02-02T22:18:05.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42010c440 con 0x7fb4200f66d0 2022-02-02T22:18:05.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42010c970 con 0x7fb4200f66d0 2022-02-02T22:18:05.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb40c007e70 con 0x7fb4200f66d0 2022-02-02T22:18:05.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.326+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40c014d90 con 0x7fb4200f66d0 2022-02-02T22:18:05.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.327+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb400004fa0 con 0x7fb4200f66d0 2022-02-02T22:18:05.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.328+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb40c025070 con 0x7fb4200f66d0 2022-02-02T22:18:05.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.328+0000 7fb41d7fa700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 0x7fb4100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:05.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.328+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb40c082990 con 0x7fb4200f66d0 2022-02-02T22:18:05.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.328+0000 7fb424b06700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 0x7fb4100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:05.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.329+0000 7fb424b06700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 0x7fb4100672e0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7fb420060040 tx=0x7fb41400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:05.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.332+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb40c050970 con 0x7fb4200f66d0 2022-02-02T22:18:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.535+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb400005e80 con 0x7fb4200f66d0 2022-02-02T22:18:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:05 smithi096 ceph-mon[101353]: from='client.41354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2997945471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:18:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.535+0000 7fb41d7fa700 1 -- 172.21.15.96:0/315214945 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb40c023720 con 0x7fb4200f66d0 2022-02-02T22:18:05.537 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:18:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:18:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:18:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:18:05.539 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:05.539 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:18:05.539 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:18:05.540 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:18:05.540 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:18:05.540 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:18:05.541 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:18:05.541 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:18:05.542 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:18:05.542 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:18:05.542 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:18:05.543 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:18:05.543 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:18:05.543 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:18:05.544 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:18:05.544 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:18:05.544 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:18:05.545 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:18:05.545 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:18:05.545 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:18:05.546 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:18:05.546 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:18:05.546 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:18:05.547 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:18:05.547 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:18:05.547 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:18:05.548 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:18:05.548 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:18:05.548 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:05.549 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:05.549 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:18:05.549 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:05.550 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:05.550 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:05.551 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:05.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 msgr2=0x7fb4100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 0x7fb4100672e0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7fb420060040 tx=0x7fb41400b040).stop 2022-02-02T22:18:05.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 msgr2=0x7fb42010bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 secure :-1 s=READY pgs=3624 cs=0 l=1 rev1=1 rx=0x7fb40c000c00 tx=0x7fb40c00b040).stop 2022-02-02T22:18:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 shutdown_connections 2022-02-02T22:18:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb410064e20 0x7fb4100672e0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4200f5430 0x7fb4201099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 --2- 172.21.15.96:0/315214945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4200f66d0 0x7fb42010bef0 unknown :-1 s=CLOSED pgs=3624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 >> 172.21.15.96:0/315214945 conn(0x7fb4200f0b90 msgr2=0x7fb4200fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 shutdown_connections 2022-02-02T22:18:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:05.537+0000 7fb425b08700 1 -- 172.21.15.96:0/315214945 wait complete. 2022-02-02T22:18:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:18:05.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:05 smithi159 ceph-mon[69013]: from='client.41354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:05.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2997945471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:18:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:06 smithi159 ceph-mon[69013]: from='client.41358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:06 smithi159 ceph-mon[69013]: pgmap v7079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/315214945' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:18:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:06 smithi096 ceph-mon[101353]: from='client.41358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:06 smithi096 ceph-mon[101353]: pgmap v7079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:06.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/315214945' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:18:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:08 smithi159 ceph-mon[69013]: pgmap v7080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:08 smithi096 ceph-mon[101353]: pgmap v7080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:10 smithi159 ceph-mon[69013]: pgmap v7081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:10 smithi096 ceph-mon[101353]: pgmap v7081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:12 smithi159 ceph-mon[69013]: pgmap v7082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:12 smithi096 ceph-mon[101353]: pgmap v7082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:14 smithi159 ceph-mon[69013]: pgmap v7083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:14 smithi096 ceph-mon[101353]: pgmap v7083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:16 smithi159 ceph-mon[69013]: pgmap v7084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:16 smithi096 ceph-mon[101353]: pgmap v7084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:18 smithi159 ceph-mon[69013]: pgmap v7085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:18 smithi096 ceph-mon[101353]: pgmap v7085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:20 smithi159 ceph-mon[69013]: pgmap v7086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:20 smithi096 ceph-mon[101353]: pgmap v7086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:22 smithi159 ceph-mon[69013]: pgmap v7087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:22 smithi096 ceph-mon[101353]: pgmap v7087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:24 smithi159 ceph-mon[69013]: pgmap v7088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:24 smithi096 ceph-mon[101353]: pgmap v7088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:26 smithi159 ceph-mon[69013]: pgmap v7089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:26 smithi096 ceph-mon[101353]: pgmap v7089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:28 smithi159 ceph-mon[69013]: pgmap v7090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:18:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:18:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:28 smithi096 ceph-mon[101353]: pgmap v7090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:18:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:18:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:30 smithi159 ceph-mon[69013]: pgmap v7091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:30 smithi096 ceph-mon[101353]: pgmap v7091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:32 smithi159 ceph-mon[69013]: pgmap v7092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:32 smithi096 ceph-mon[101353]: pgmap v7092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:34 smithi159 ceph-mon[69013]: pgmap v7093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:34 smithi096 ceph-mon[101353]: pgmap v7093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:35.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.647+0000 7fbccf41c700 1 -- 172.21.15.96:0/2325609713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f77d0 msgr2=0x7fbcc80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.647+0000 7fbccf41c700 1 --2- 172.21.15.96:0/2325609713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f77d0 0x7fbcc80f7c30 secure :-1 s=READY pgs=3625 cs=0 l=1 rev1=1 rx=0x7fbcb8004660 tx=0x7fbcb8009b30).stop 2022-02-02T22:18:35.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- 172.21.15.96:0/2325609713 shutdown_connections 2022-02-02T22:18:35.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 --2- 172.21.15.96:0/2325609713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f77d0 0x7fbcc80f7c30 unknown :-1 s=CLOSED pgs=3625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 --2- 172.21.15.96:0/2325609713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f6530 0x7fbcc80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- 172.21.15.96:0/2325609713 >> 172.21.15.96:0/2325609713 conn(0x7fbcc80f1c90 msgr2=0x7fbcc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:35.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- 172.21.15.96:0/2325609713 shutdown_connections 2022-02-02T22:18:35.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- 172.21.15.96:0/2325609713 wait complete. 2022-02-02T22:18:35.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 Processor -- start 2022-02-02T22:18:35.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- start start 2022-02-02T22:18:35.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f77d0 0x7fbcc8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc806a380 con 0x7fbcc80f6530 2022-02-02T22:18:35.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.648+0000 7fbccf41c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc806a4c0 con 0x7fbcc80f77d0 2022-02-02T22:18:35.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47708/0 (socket says 172.21.15.96:47708) 2022-02-02T22:18:35.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 -- 172.21.15.96:0/3511514589 learned_addr learned my addr 172.21.15.96:0/3511514589 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:35.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbccdc19700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f77d0 0x7fbcc8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 -- 172.21.15.96:0/3511514589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f77d0 msgr2=0x7fbcc8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f77d0 0x7fbcc8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 -- 172.21.15.96:0/3511514589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8005040 con 0x7fbcc80f6530 2022-02-02T22:18:35.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcce41a700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 secure :-1 s=READY pgs=3626 cs=0 l=1 rev1=1 rx=0x7fbcc4002700 tx=0x7fbcc4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:35.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc40079c0 con 0x7fbcc80f6530 2022-02-02T22:18:35.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc806a7a0 con 0x7fbcc80f6530 2022-02-02T22:18:35.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbcc400f040 con 0x7fbcc80f6530 2022-02-02T22:18:35.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc4014850 con 0x7fbcc80f6530 2022-02-02T22:18:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.649+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc810ed00 con 0x7fbcc80f6530 2022-02-02T22:18:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.650+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8045ad0 con 0x7fbcc80f6530 2022-02-02T22:18:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.651+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbcc401b060 con 0x7fbcc80f6530 2022-02-02T22:18:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.652+0000 7fbcbeffd700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 0x7fbcb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.652+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbcc4081b10 con 0x7fbcc80f6530 2022-02-02T22:18:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.652+0000 7fbccdc19700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 0x7fbcb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.652+0000 7fbccdc19700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 0x7fbcb40672e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fbcb8004e30 tx=0x7fbcb8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.656+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbcc404fc70 con 0x7fbcc80f6530 2022-02-02T22:18:35.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.836+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcc8057f10 con 0x7fbcb4064e20 2022-02-02T22:18:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.837+0000 7fbcbeffd700 1 -- 172.21.15.96:0/3511514589 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbcc8057f10 con 0x7fbcb4064e20 2022-02-02T22:18:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 msgr2=0x7fbcb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 0x7fbcb40672e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fbcb8004e30 tx=0x7fbcb8009b30).stop 2022-02-02T22:18:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 msgr2=0x7fbcc806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 secure :-1 s=READY pgs=3626 cs=0 l=1 rev1=1 rx=0x7fbcc4002700 tx=0x7fbcc4009e00).stop 2022-02-02T22:18:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 shutdown_connections 2022-02-02T22:18:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbcb4064e20 0x7fbcb40672e0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcc80f6530 0x7fbcc806b9a0 unknown :-1 s=CLOSED pgs=3626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 --2- 172.21.15.96:0/3511514589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc80f77d0 0x7fbcc8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 >> 172.21.15.96:0/3511514589 conn(0x7fbcc80f1c90 msgr2=0x7fbcc80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 shutdown_connections 2022-02-02T22:18:35.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.839+0000 7fbccf41c700 1 -- 172.21.15.96:0/3511514589 wait complete. 2022-02-02T22:18:35.849 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:18:35.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 -- 172.21.15.96:0/3537228841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 msgr2=0x7f11a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 --2- 172.21.15.96:0/3537228841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a80f7c30 secure :-1 s=READY pgs=3627 cs=0 l=1 rev1=1 rx=0x7f1198004660 tx=0x7f1198009b30).stop 2022-02-02T22:18:35.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 -- 172.21.15.96:0/3537228841 shutdown_connections 2022-02-02T22:18:35.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 --2- 172.21.15.96:0/3537228841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a80f7c30 unknown :-1 s=CLOSED pgs=3627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 --2- 172.21.15.96:0/3537228841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 0x7f11a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:18:35.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 -- 172.21.15.96:0/3537228841 >> 172.21.15.96:0/3537228841 conn(0x7f11a80f1c90 msgr2=0x7f11a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:35.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 -- 172.21.15.96:0/3537228841 shutdown_connections 2022-02-02T22:18:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.937+0000 7f11af56e700 1 -- 172.21.15.96:0/3537228841 wait complete. 2022-02-02T22:18:35.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 Processor -- start 2022-02-02T22:18:35.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 -- start start 2022-02-02T22:18:35.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 0x7f11a8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8107980 con 0x7f11a80f77d0 2022-02-02T22:18:35.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11af56e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8108100 con 0x7f11a80f6530 2022-02-02T22:18:35.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47720/0 (socket says 172.21.15.96:47720) 2022-02-02T22:18:35.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 -- 172.21.15.96:0/1701089892 learned_addr learned my addr 172.21.15.96:0/1701089892 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:35.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11ae56c700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 0x7f11a8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 -- 172.21.15.96:0/1701089892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 msgr2=0x7f11a8106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:35.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 0x7f11a8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:35.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.938+0000 7f11add6b700 1 -- 172.21.15.96:0/1701089892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198005040 con 0x7f11a80f77d0 2022-02-02T22:18:35.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f11add6b700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 secure :-1 s=READY pgs=3628 cs=0 l=1 rev1=1 rx=0x7f1198009990 tx=0x7f1198009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:35.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1198018070 con 0x7f11a80f77d0 2022-02-02T22:18:35.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a8108320 con 0x7f11a80f77d0 2022-02-02T22:18:35.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1198007ca0 con 0x7f11a80f77d0 2022-02-02T22:18:35.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119801c620 con 0x7f11a80f77d0 2022-02-02T22:18:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.939+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a8108880 con 0x7f11a80f77d0 2022-02-02T22:18:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.940+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a8045ad0 con 0x7f11a80f77d0 2022-02-02T22:18:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.941+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f119801d960 con 0x7f11a80f77d0 2022-02-02T22:18:35.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.941+0000 7f119effd700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 0x7f11940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:35.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.941+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1198083970 con 0x7f11a80f77d0 2022-02-02T22:18:35.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.941+0000 7f11ae56c700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 0x7f11940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:35.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.941+0000 7f11ae56c700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 0x7f11940672e0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f11a8106b70 tx=0x7f11a4008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:35.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:35.945+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1198051a70 con 0x7f11a80f77d0 2022-02-02T22:18:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.116+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a8108aa0 con 0x7f1194064e20 2022-02-02T22:18:36.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.125+0000 7f119effd700 1 -- 172.21.15.96:0/1701089892 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f11a8108aa0 con 0x7f1194064e20 2022-02-02T22:18:36.126 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:18:36.126 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:18:36.126 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:18:36.127 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:18:36.127 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:18:36.127 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:18:36.128 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:18:36.128 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:18:36.129 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:18:36.129 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:18:36.129 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:18:36.130 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:18:36.130 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:18:36.131 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:18:36.131 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:18:36.131 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:18:36.132 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:18:36.132 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:18:36.132 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:18:36.133 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:18:36.133 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:18:36.133 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:18:36.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 msgr2=0x7f11940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 0x7f11940672e0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f11a8106b70 tx=0x7f11a4008040).stop 2022-02-02T22:18:36.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 msgr2=0x7f11a81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 secure :-1 s=READY pgs=3628 cs=0 l=1 rev1=1 rx=0x7f1198009990 tx=0x7f1198009b30).stop 2022-02-02T22:18:36.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 shutdown_connections 2022-02-02T22:18:36.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1194064e20 0x7f11940672e0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a80f6530 0x7f11a8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 --2- 172.21.15.96:0/1701089892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a80f77d0 0x7f11a81072f0 unknown :-1 s=CLOSED pgs=3628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.127+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 >> 172.21.15.96:0/1701089892 conn(0x7f11a80f1c90 msgr2=0x7f11a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:36.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.128+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 shutdown_connections 2022-02-02T22:18:36.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.128+0000 7f11af56e700 1 -- 172.21.15.96:0/1701089892 wait complete. 2022-02-02T22:18:36.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.223+0000 7f78c087a700 1 -- 172.21.15.96:0/4103661964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 msgr2=0x7f78bc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.223+0000 7f78c087a700 1 --2- 172.21.15.96:0/4103661964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc0f6b30 secure :-1 s=READY pgs=3629 cs=0 l=1 rev1=1 rx=0x7f78ac004660 tx=0x7f78ac009b30).stop 2022-02-02T22:18:36.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 -- 172.21.15.96:0/4103661964 shutdown_connections 2022-02-02T22:18:36.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 --2- 172.21.15.96:0/4103661964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc0f6b30 unknown :-1 s=CLOSED pgs=3629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 --2- 172.21.15.96:0/4103661964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 0x7f78bc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:18:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 -- 172.21.15.96:0/4103661964 >> 172.21.15.96:0/4103661964 conn(0x7f78bc0f0b90 msgr2=0x7f78bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 -- 172.21.15.96:0/4103661964 shutdown_connections 2022-02-02T22:18:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 -- 172.21.15.96:0/4103661964 wait complete. 2022-02-02T22:18:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.224+0000 7f78c087a700 1 Processor -- start 2022-02-02T22:18:36.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78c087a700 1 -- start start 2022-02-02T22:18:36.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78c087a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 0x7f78bc109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78c087a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78c087a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc060470 con 0x7f78bc0f66d0 2022-02-02T22:18:36.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78c087a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0605b0 con 0x7f78bc0f5430 2022-02-02T22:18:36.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47730/0 (socket says 172.21.15.96:47730) 2022-02-02T22:18:36.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 -- 172.21.15.96:0/426244562 learned_addr learned my addr 172.21.15.96:0/426244562 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:36.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78bb7fe700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 0x7f78bc109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 -- 172.21.15.96:0/426244562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 msgr2=0x7f78bc109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 0x7f78bc109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 -- 172.21.15.96:0/426244562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac005040 con 0x7f78bc0f66d0 2022-02-02T22:18:36.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.225+0000 7f78baffd700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 secure :-1 s=READY pgs=3630 cs=0 l=1 rev1=1 rx=0x7f78ac009990 tx=0x7f78ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:36.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.226+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac018070 con 0x7f78bc0f66d0 2022-02-02T22:18:36.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.226+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc10c590 con 0x7f78bc0f66d0 2022-02-02T22:18:36.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.226+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f78ac007ba0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.226+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac01c620 con 0x7f78bc0f66d0 2022-02-02T22:18:36.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.226+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc10cac0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.227+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc045ad0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.228+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f78ac01c8e0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.228+0000 7f78a3fff700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 0x7f78a40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.228+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f78ac083aa0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.228+0000 7f78bb7fe700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 0x7f78a40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.229+0000 7f78bb7fe700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 0x7f78a40672e0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f78bc060060 tx=0x7f78b0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:36.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.232+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f78ac051ba0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.462+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78bc027a00 con 0x7f78bc0f66d0 2022-02-02T22:18:36.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.462+0000 7f78a3fff700 1 -- 172.21.15.96:0/426244562 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f78ac0551c0 con 0x7f78bc0f66d0 2022-02-02T22:18:36.463 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:18:36.463 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:18:36.463 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:18:36.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:36.464 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:18:36.464 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:18:36.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:36.465 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:18:36.465 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:18:36.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:36.466 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:18:36.466 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:18:36.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:18:36.467 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:18:36.467 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:18:36.468 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:18:36.468 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:18:36.468 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:18:36.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 msgr2=0x7f78a40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 0x7f78a40672e0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f78bc060060 tx=0x7f78b0008040).stop 2022-02-02T22:18:36.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 msgr2=0x7f78bc10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 secure :-1 s=READY pgs=3630 cs=0 l=1 rev1=1 rx=0x7f78ac009990 tx=0x7f78ac009b30).stop 2022-02-02T22:18:36.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 shutdown_connections 2022-02-02T22:18:36.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f78a4064e20 0x7f78a40672e0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0f5430 0x7f78bc109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 --2- 172.21.15.96:0/426244562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78bc0f66d0 0x7f78bc10bf90 unknown :-1 s=CLOSED pgs=3630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 >> 172.21.15.96:0/426244562 conn(0x7f78bc0f0b90 msgr2=0x7f78bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:36.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 shutdown_connections 2022-02-02T22:18:36.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.464+0000 7f78c087a700 1 -- 172.21.15.96:0/426244562 wait complete. 2022-02-02T22:18:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:36 smithi096 ceph-mon[101353]: pgmap v7094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:36.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 -- 172.21.15.96:0/3167034393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 msgr2=0x7fb0940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 --2- 172.21.15.96:0/3167034393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb0940f7de0 secure :-1 s=READY pgs=3631 cs=0 l=1 rev1=1 rx=0x7fb088004660 tx=0x7fb088009b30).stop 2022-02-02T22:18:36.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 -- 172.21.15.96:0/3167034393 shutdown_connections 2022-02-02T22:18:36.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 --2- 172.21.15.96:0/3167034393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb0940f7de0 unknown :-1 s=CLOSED pgs=3631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 --2- 172.21.15.96:0/3167034393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 0x7fb0940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.562+0000 7fb099b52700 1 -- 172.21.15.96:0/3167034393 >> 172.21.15.96:0/3167034393 conn(0x7fb0940f1e40 msgr2=0x7fb0940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:36.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 -- 172.21.15.96:0/3167034393 shutdown_connections 2022-02-02T22:18:36.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 -- 172.21.15.96:0/3167034393 wait complete. 2022-02-02T22:18:36.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 Processor -- start 2022-02-02T22:18:36.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 -- start start 2022-02-02T22:18:36.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 0x7fb094106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0941079b0 con 0x7fb0940f7980 2022-02-02T22:18:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.563+0000 7fb099b52700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094107af0 con 0x7fb0940f66e0 2022-02-02T22:18:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47740/0 (socket says 172.21.15.96:47740) 2022-02-02T22:18:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 -- 172.21.15.96:0/1366399248 learned_addr learned my addr 172.21.15.96:0/1366399248 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:18:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb0937fe700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 0x7fb094106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 -- 172.21.15.96:0/1366399248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 msgr2=0x7fb094106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 0x7fb094106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 -- 172.21.15.96:0/1366399248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088005040 con 0x7fb0940f7980 2022-02-02T22:18:36.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb092ffd700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 secure :-1 s=READY pgs=3632 cs=0 l=1 rev1=1 rx=0x7fb088000c00 tx=0x7fb08800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:36.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb088019070 con 0x7fb0940f7980 2022-02-02T22:18:36.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb094108430 con 0x7fb0940f7980 2022-02-02T22:18:36.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb088007e70 con 0x7fb0940f7980 2022-02-02T22:18:36.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb088014ce0 con 0x7fb0940f7980 2022-02-02T22:18:36.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.564+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb094108990 con 0x7fb0940f7980 2022-02-02T22:18:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.565+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb094045ad0 con 0x7fb0940f7980 2022-02-02T22:18:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.565+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb088025070 con 0x7fb0940f7980 2022-02-02T22:18:36.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.566+0000 7fb07bfff700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 0x7fb07c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:18:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.566+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb0880829e0 con 0x7fb0940f7980 2022-02-02T22:18:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.566+0000 7fb0937fe700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 0x7fb07c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:18:36.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.566+0000 7fb0937fe700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 0x7fb07c067290 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7fb084009fd0 tx=0x7fb08400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:18:36.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.570+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb088054510 con 0x7fb0940f7980 2022-02-02T22:18:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:36 smithi159 ceph-mon[69013]: pgmap v7094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:36.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.777+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb094027a00 con 0x7fb0940f7980 2022-02-02T22:18:36.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.778+0000 7fb07bfff700 1 -- 172.21.15.96:0/1366399248 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb088023020 con 0x7fb0940f7980 2022-02-02T22:18:36.778 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:18:36.778 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:18:36.779 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:18:36.779 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:18:36.780 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:36.780 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:18:36.780 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:18:36.781 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:18:36.781 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:18:36.781 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:18:36.782 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:18:36.782 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:18:36.782 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:18:36.783 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:18:36.783 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:18:36.783 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:18:36.784 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:18:36.784 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:18:36.784 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:18:36.785 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:18:36.785 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:18:36.785 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:18:36.786 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:18:36.786 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:18:36.787 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:18:36.787 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:18:36.787 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:18:36.788 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:18:36.788 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:18:36.788 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:18:36.789 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:18:36.789 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:18:36.789 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:36.790 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:36.790 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:18:36.790 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:18:36.791 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:36.791 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:36.791 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:18:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.779+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 msgr2=0x7fb07c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.779+0000 7fb099b52700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 0x7fb07c067290 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7fb084009fd0 tx=0x7fb08400b040).stop 2022-02-02T22:18:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.779+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 msgr2=0x7fb094107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:18:36.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.779+0000 7fb099b52700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 secure :-1 s=READY pgs=3632 cs=0 l=1 rev1=1 rx=0x7fb088000c00 tx=0x7fb08800b040).stop 2022-02-02T22:18:36.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.779+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 shutdown_connections 2022-02-02T22:18:36.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb07c064dd0 0x7fb07c067290 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0940f66e0 0x7fb094106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 --2- 172.21.15.96:0/1366399248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0940f7980 0x7fb094107400 unknown :-1 s=CLOSED pgs=3632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:18:36.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 >> 172.21.15.96:0/1366399248 conn(0x7fb0940f1e40 msgr2=0x7fb0940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:18:36.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 shutdown_connections 2022-02-02T22:18:36.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:18:36.780+0000 7fb099b52700 1 -- 172.21.15.96:0/1366399248 wait complete. 2022-02-02T22:18:36.796 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:18:37.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:37 smithi159 ceph-mon[69013]: from='client.41370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:37 smithi159 ceph-mon[69013]: from='client.41374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:37.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/426244562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:18:37.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1366399248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:18:37.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:37 smithi096 ceph-mon[101353]: from='client.41370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:37 smithi096 ceph-mon[101353]: from='client.41374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:18:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/426244562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:18:37.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1366399248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:18:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:38 smithi159 ceph-mon[69013]: pgmap v7095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:38 smithi096 ceph-mon[101353]: pgmap v7095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:40 smithi159 ceph-mon[69013]: pgmap v7096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:40 smithi096 ceph-mon[101353]: pgmap v7096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:42 smithi159 ceph-mon[69013]: pgmap v7097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:42 smithi096 ceph-mon[101353]: pgmap v7097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:44 smithi159 ceph-mon[69013]: pgmap v7098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:44 smithi096 ceph-mon[101353]: pgmap v7098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:46 smithi159 ceph-mon[69013]: pgmap v7099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:46 smithi096 ceph-mon[101353]: pgmap v7099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:48 smithi159 ceph-mon[69013]: pgmap v7100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:48 smithi096 ceph-mon[101353]: pgmap v7100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:50 smithi159 ceph-mon[69013]: pgmap v7101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:50 smithi096 ceph-mon[101353]: pgmap v7101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:52 smithi159 ceph-mon[69013]: pgmap v7102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:52 smithi096 ceph-mon[101353]: pgmap v7102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:54 smithi159 ceph-mon[69013]: pgmap v7103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:54 smithi096 ceph-mon[101353]: pgmap v7103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:56 smithi159 ceph-mon[69013]: pgmap v7104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:56 smithi096 ceph-mon[101353]: pgmap v7104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:18:58 smithi159 ceph-mon[69013]: pgmap v7105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:18:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:18:58 smithi096 ceph-mon[101353]: pgmap v7105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:00 smithi159 ceph-mon[69013]: pgmap v7106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:00 smithi096 ceph-mon[101353]: pgmap v7106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:02 smithi159 ceph-mon[69013]: pgmap v7107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:02 smithi096 ceph-mon[101353]: pgmap v7107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:04 smithi159 ceph-mon[69013]: pgmap v7108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:04 smithi096 ceph-mon[101353]: pgmap v7108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:06 smithi159 ceph-mon[69013]: pgmap v7109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:06 smithi096 ceph-mon[101353]: pgmap v7109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:06.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 -- 172.21.15.96:0/3853048965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 msgr2=0x7f0a880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:06.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/3853048965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a880f59e0 secure :-1 s=READY pgs=3633 cs=0 l=1 rev1=1 rx=0x7f0a84004660 tx=0x7f0a84009b30).stop 2022-02-02T22:19:06.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 -- 172.21.15.96:0/3853048965 shutdown_connections 2022-02-02T22:19:06.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/3853048965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 0x7f0a880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:06.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/3853048965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a880f59e0 unknown :-1 s=CLOSED pgs=3633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:06.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.889+0000 7f0a8faa0700 1 -- 172.21.15.96:0/3853048965 >> 172.21.15.96:0/3853048965 conn(0x7f0a880f0d40 msgr2=0x7f0a880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:06.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 -- 172.21.15.96:0/3853048965 shutdown_connections 2022-02-02T22:19:06.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 -- 172.21.15.96:0/3853048965 wait complete. 2022-02-02T22:19:06.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 Processor -- start 2022-02-02T22:19:06.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 -- start start 2022-02-02T22:19:06.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:06.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 0x7f0a88106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:06.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88106910 con 0x7f0a880f55c0 2022-02-02T22:19:06.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.890+0000 7f0a8faa0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88106a50 con 0x7f0a880f6860 2022-02-02T22:19:06.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:06.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47756/0 (socket says 172.21.15.96:47756) 2022-02-02T22:19:06.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 -- 172.21.15.96:0/784364838 learned_addr learned my addr 172.21.15.96:0/784364838 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:06.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d03b700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 0x7f0a88106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:06.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 -- 172.21.15.96:0/784364838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 msgr2=0x7f0a88106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:06.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 0x7f0a88106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:06.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 -- 172.21.15.96:0/784364838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84005040 con 0x7f0a880f55c0 2022-02-02T22:19:06.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8d83c700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 secure :-1 s=READY pgs=3634 cs=0 l=1 rev1=1 rx=0x7f0a84013a70 tx=0x7f0a84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:06.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a84018070 con 0x7f0a880f55c0 2022-02-02T22:19:06.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a88107390 con 0x7f0a880f55c0 2022-02-02T22:19:06.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a840097d0 con 0x7f0a880f55c0 2022-02-02T22:19:06.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a8401c3c0 con 0x7f0a880f55c0 2022-02-02T22:19:06.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.891+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a881078f0 con 0x7f0a880f55c0 2022-02-02T22:19:06.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.892+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a88045ad0 con 0x7f0a880f55c0 2022-02-02T22:19:06.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.893+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a84007ba0 con 0x7f0a880f55c0 2022-02-02T22:19:06.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.893+0000 7f0a7a7fc700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:06.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.893+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a84083640 con 0x7f0a880f55c0 2022-02-02T22:19:06.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.894+0000 7f0a8d03b700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:06.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.894+0000 7f0a8d03b700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f0a7c0096c0 tx=0x7f0a7c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:06.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:06.898+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a84055230 con 0x7f0a880f55c0 2022-02-02T22:19:07.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.076+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a880fdf00 con 0x7f0a74064dd0 2022-02-02T22:19:07.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.078+0000 7f0a7a7fc700 1 -- 172.21.15.96:0/784364838 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a880fdf00 con 0x7f0a74064dd0 2022-02-02T22:19:07.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 msgr2=0x7f0a74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f0a7c0096c0 tx=0x7f0a7c009be0).stop 2022-02-02T22:19:07.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 msgr2=0x7f0a88105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 secure :-1 s=READY pgs=3634 cs=0 l=1 rev1=1 rx=0x7f0a84013a70 tx=0x7f0a84009b30).stop 2022-02-02T22:19:07.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 shutdown_connections 2022-02-02T22:19:07.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a74064dd0 0x7f0a74067290 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a880f55c0 0x7f0a88105e70 unknown :-1 s=CLOSED pgs=3634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 --2- 172.21.15.96:0/784364838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a880f6860 0x7f0a88106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.079+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 >> 172.21.15.96:0/784364838 conn(0x7f0a880f0d40 msgr2=0x7f0a880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.080+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 shutdown_connections 2022-02-02T22:19:07.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.080+0000 7f0a8faa0700 1 -- 172.21.15.96:0/784364838 wait complete. 2022-02-02T22:19:07.090 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:19:07.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- 172.21.15.96:0/2012277848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 msgr2=0x7fb0680f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 --2- 172.21.15.96:0/2012277848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb0680f6ae0 secure :-1 s=READY pgs=3635 cs=0 l=1 rev1=1 rx=0x7fb05c004660 tx=0x7fb05c009b30).stop 2022-02-02T22:19:07.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- 172.21.15.96:0/2012277848 shutdown_connections 2022-02-02T22:19:07.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 --2- 172.21.15.96:0/2012277848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 0x7fb0680f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 --2- 172.21.15.96:0/2012277848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb0680f6ae0 unknown :-1 s=CLOSED pgs=3635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- 172.21.15.96:0/2012277848 >> 172.21.15.96:0/2012277848 conn(0x7fb0680f1e20 msgr2=0x7fb0680f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- 172.21.15.96:0/2012277848 shutdown_connections 2022-02-02T22:19:07.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- 172.21.15.96:0/2012277848 wait complete. 2022-02-02T22:19:07.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 Processor -- start 2022-02-02T22:19:07.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.177+0000 7fb06cb86700 1 -- start start 2022-02-02T22:19:07.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06cb86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06cb86700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 0x7fb068107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06cb86700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681079b0 con 0x7fb0680f66c0 2022-02-02T22:19:07.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06cb86700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068107af0 con 0x7fb0680f7960 2022-02-02T22:19:07.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47766/0 (socket says 172.21.15.96:47766) 2022-02-02T22:19:07.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 -- 172.21.15.96:0/226545769 learned_addr learned my addr 172.21.15.96:0/226545769 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:07.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb065d9b700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 0x7fb068107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 -- 172.21.15.96:0/226545769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 msgr2=0x7fb068107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 0x7fb068107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 -- 172.21.15.96:0/226545769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c005040 con 0x7fb0680f66c0 2022-02-02T22:19:07.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb06659c700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 secure :-1 s=READY pgs=3636 cs=0 l=1 rev1=1 rx=0x7fb05c014040 tx=0x7fb05c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.178+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c019070 con 0x7fb0680f66c0 2022-02-02T22:19:07.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.179+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb068108430 con 0x7fb0680f66c0 2022-02-02T22:19:07.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.179+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb05c007e70 con 0x7fb0680f66c0 2022-02-02T22:19:07.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.179+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c014d10 con 0x7fb0680f66c0 2022-02-02T22:19:07.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.179+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb068108990 con 0x7fb0680f66c0 2022-02-02T22:19:07.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.180+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb068045ad0 con 0x7fb0680f66c0 2022-02-02T22:19:07.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.180+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb05c025070 con 0x7fb0680f66c0 2022-02-02T22:19:07.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.180+0000 7fb056ffd700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 0x7fb050067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.180+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb05c082a40 con 0x7fb0680f66c0 2022-02-02T22:19:07.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.180+0000 7fb065d9b700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 0x7fb050067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.181+0000 7fb065d9b700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 0x7fb050067290 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fb058009fd0 tx=0x7fb05800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.184+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb05c054570 con 0x7fb0680f66c0 2022-02-02T22:19:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.358+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0680ff000 con 0x7fb050064dd0 2022-02-02T22:19:07.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.368+0000 7fb056ffd700 1 -- 172.21.15.96:0/226545769 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb0680ff000 con 0x7fb050064dd0 2022-02-02T22:19:07.369 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:19:07.369 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:19:07.370 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:19:07.370 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:19:07.370 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:19:07.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (3h) 3h ago 3h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:19:07.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 3h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:19:07.371 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (3h) 3h ago 3h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:19:07.372 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 3h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:19:07.372 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:19:07.372 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:19:07.373 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:19:07.373 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:19:07.373 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:19:07.374 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:19:07.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:19:07.374 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:19:07.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:19:07.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:19:07.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:19:07.376 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:19:07.376 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:19:07.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.369+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 msgr2=0x7fb050067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.369+0000 7fb06cb86700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 0x7fb050067290 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fb058009fd0 tx=0x7fb05800b040).stop 2022-02-02T22:19:07.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.369+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 msgr2=0x7fb068106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.369+0000 7fb06cb86700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 secure :-1 s=READY pgs=3636 cs=0 l=1 rev1=1 rx=0x7fb05c014040 tx=0x7fb05c00b040).stop 2022-02-02T22:19:07.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 shutdown_connections 2022-02-02T22:19:07.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb050064dd0 0x7fb050067290 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0680f66c0 0x7fb068106f10 unknown :-1 s=CLOSED pgs=3636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 --2- 172.21.15.96:0/226545769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0680f7960 0x7fb068107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 >> 172.21.15.96:0/226545769 conn(0x7fb0680f1e20 msgr2=0x7fb0680fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 shutdown_connections 2022-02-02T22:19:07.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.370+0000 7fb06cb86700 1 -- 172.21.15.96:0/226545769 wait complete. 2022-02-02T22:19:07.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 -- 172.21.15.96:0/2953317969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 msgr2=0x7fc7500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 --2- 172.21.15.96:0/2953317969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc7500f5850 secure :-1 s=READY pgs=3637 cs=0 l=1 rev1=1 rx=0x7fc744004660 tx=0x7fc744009b30).stop 2022-02-02T22:19:07.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 -- 172.21.15.96:0/2953317969 shutdown_connections 2022-02-02T22:19:07.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 --2- 172.21.15.96:0/2953317969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 0x7fc7500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 --2- 172.21.15.96:0/2953317969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc7500f5850 unknown :-1 s=CLOSED pgs=3637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 -- 172.21.15.96:0/2953317969 >> 172.21.15.96:0/2953317969 conn(0x7fc7500f0b90 msgr2=0x7fc7500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.467+0000 7fc755b75700 1 -- 172.21.15.96:0/2953317969 shutdown_connections 2022-02-02T22:19:07.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.468+0000 7fc755b75700 1 -- 172.21.15.96:0/2953317969 wait complete. 2022-02-02T22:19:07.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 Processor -- start 2022-02-02T22:19:07.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 -- start start 2022-02-02T22:19:07.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 0x7fc75010e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500602d0 con 0x7fc7500f5430 2022-02-02T22:19:07.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc755b75700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750060410 con 0x7fc7500f66d0 2022-02-02T22:19:07.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.469+0000 7fc754b73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47776/0 (socket says 172.21.15.96:47776) 2022-02-02T22:19:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 -- 172.21.15.96:0/4245562772 learned_addr learned my addr 172.21.15.96:0/4245562772 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc74ffff700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 0x7fc75010e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 -- 172.21.15.96:0/4245562772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 msgr2=0x7fc75010e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 0x7fc75010e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 -- 172.21.15.96:0/4245562772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744005040 con 0x7fc7500f5430 2022-02-02T22:19:07.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc754b73700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 secure :-1 s=READY pgs=3638 cs=0 l=1 rev1=1 rx=0x7fc744013a70 tx=0x7fc744009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744018070 con 0x7fc7500f5430 2022-02-02T22:19:07.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75010e880 con 0x7fc7500f5430 2022-02-02T22:19:07.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7440097d0 con 0x7fc7500f5430 2022-02-02T22:19:07.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc74401c3c0 con 0x7fc7500f5430 2022-02-02T22:19:07.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.470+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75010ec50 con 0x7fc7500f5430 2022-02-02T22:19:07.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.471+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750045ad0 con 0x7fc7500f5430 2022-02-02T22:19:07.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.472+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc744007ba0 con 0x7fc7500f5430 2022-02-02T22:19:07.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.472+0000 7fc74d7fa700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 0x7fc7400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.472+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc744083ad0 con 0x7fc7500f5430 2022-02-02T22:19:07.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.472+0000 7fc74ffff700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 0x7fc7400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.473+0000 7fc74ffff700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 0x7fc7400672e0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7fc73c004a70 tx=0x7fc73c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.478+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc744051bd0 con 0x7fc7500f5430 2022-02-02T22:19:07.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.705+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7500fdd70 con 0x7fc7500f5430 2022-02-02T22:19:07.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.706+0000 7fc74d7fa700 1 -- 172.21.15.96:0/4245562772 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc7440551f0 con 0x7fc7500f5430 2022-02-02T22:19:07.708 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:19:07.708 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:19:07.708 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:19:07.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:07.709 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:19:07.709 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:19:07.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:07.710 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:19:07.710 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:19:07.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:07.711 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:19:07.711 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:19:07.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:07.712 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:19:07.712 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:19:07.712 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:19:07.713 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:19:07.713 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:19:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 msgr2=0x7fc7400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 0x7fc7400672e0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7fc73c004a70 tx=0x7fc73c00b040).stop 2022-02-02T22:19:07.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 msgr2=0x7fc75010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 secure :-1 s=READY pgs=3638 cs=0 l=1 rev1=1 rx=0x7fc744013a70 tx=0x7fc744009b30).stop 2022-02-02T22:19:07.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 shutdown_connections 2022-02-02T22:19:07.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc740064e20 0x7fc7400672e0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7500f5430 0x7fc75010be90 unknown :-1 s=CLOSED pgs=3638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 --2- 172.21.15.96:0/4245562772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7500f66d0 0x7fc75010e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 >> 172.21.15.96:0/4245562772 conn(0x7fc7500f0b90 msgr2=0x7fc7500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 shutdown_connections 2022-02-02T22:19:07.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.708+0000 7fc755b75700 1 -- 172.21.15.96:0/4245562772 wait complete. 2022-02-02T22:19:07.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 -- 172.21.15.96:0/364103415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f6860 msgr2=0x7fa5940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 --2- 172.21.15.96:0/364103415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f6860 0x7fa5940f6cc0 secure :-1 s=READY pgs=3639 cs=0 l=1 rev1=1 rx=0x7fa588004660 tx=0x7fa588009b30).stop 2022-02-02T22:19:07.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 -- 172.21.15.96:0/364103415 shutdown_connections 2022-02-02T22:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 --2- 172.21.15.96:0/364103415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f6860 0x7fa5940f6cc0 unknown :-1 s=CLOSED pgs=3639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 --2- 172.21.15.96:0/364103415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f55c0 0x7fa5940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.805+0000 7fa59982e700 1 -- 172.21.15.96:0/364103415 >> 172.21.15.96:0/364103415 conn(0x7fa5940f0d40 msgr2=0x7fa5940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.806+0000 7fa59982e700 1 -- 172.21.15.96:0/364103415 shutdown_connections 2022-02-02T22:19:07.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.806+0000 7fa59982e700 1 -- 172.21.15.96:0/364103415 wait complete. 2022-02-02T22:19:07.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.806+0000 7fa59982e700 1 Processor -- start 2022-02-02T22:19:07.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.806+0000 7fa59982e700 1 -- start start 2022-02-02T22:19:07.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa59982e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa59982e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f6860 0x7fa594106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa59982e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594106920 con 0x7fa5940f55c0 2022-02-02T22:19:07.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa59982e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594107130 con 0x7fa5940f6860 2022-02-02T22:19:07.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47786/0 (socket says 172.21.15.96:47786) 2022-02-02T22:19:07.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 -- 172.21.15.96:0/2026333070 learned_addr learned my addr 172.21.15.96:0/2026333070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:07.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa5927fc700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f6860 0x7fa594106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 -- 172.21.15.96:0/2026333070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f6860 msgr2=0x7fa594106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:07.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f6860 0x7fa594106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:07.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 -- 172.21.15.96:0/2026333070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588005040 con 0x7fa5940f55c0 2022-02-02T22:19:07.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.807+0000 7fa592ffd700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 secure :-1 s=READY pgs=3640 cs=0 l=1 rev1=1 rx=0x7fa584002700 tx=0x7fa584009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.808+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5840079c0 con 0x7fa5940f55c0 2022-02-02T22:19:07.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.808+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5941073b0 con 0x7fa5940f55c0 2022-02-02T22:19:07.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.808+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa58400f040 con 0x7fa5940f55c0 2022-02-02T22:19:07.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.808+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594107970 con 0x7fa5940f55c0 2022-02-02T22:19:07.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.808+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa584014850 con 0x7fa5940f55c0 2022-02-02T22:19:07.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.809+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940f49b0 con 0x7fa5940f55c0 2022-02-02T22:19:07.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.809+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa58401b060 con 0x7fa5940f55c0 2022-02-02T22:19:07.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.809+0000 7fa57b7fe700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 0x7fa57c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:07.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.810+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa584081840 con 0x7fa5940f55c0 2022-02-02T22:19:07.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.810+0000 7fa5927fc700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 0x7fa57c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:07.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.810+0000 7fa5927fc700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 0x7fa57c067270 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7fa588004e30 tx=0x7fa588009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:07.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:07.814+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa58404f940 con 0x7fa5940f55c0 2022-02-02T22:19:08.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.016+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa594045ad0 con 0x7fa5940f55c0 2022-02-02T22:19:08.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.017+0000 7fa57b7fe700 1 -- 172.21.15.96:0/2026333070 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa584019720 con 0x7fa5940f55c0 2022-02-02T22:19:08.019 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:19:08.019 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:19:08.020 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:19:08.020 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:19:08.020 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:08.021 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:19:08.021 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:19:08.021 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:19:08.022 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:19:08.022 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:19:08.022 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:19:08.023 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:19:08.023 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:19:08.024 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:19:08.024 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:19:08.024 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:19:08.025 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:19:08.025 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:19:08.025 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:19:08.026 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:19:08.026 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:19:08.027 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:19:08.027 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:19:08.027 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:19:08.028 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:19:08.028 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:19:08.028 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:19:08.029 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:19:08.029 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:19:08.029 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:19:08.030 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:19:08.030 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:19:08.031 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:08.031 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:08.031 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:19:08.032 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:08.032 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:08.032 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:08.033 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:08.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 msgr2=0x7fa57c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:08.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 0x7fa57c067270 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7fa588004e30 tx=0x7fa588009b30).stop 2022-02-02T22:19:08.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 msgr2=0x7fa594105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:08.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 secure :-1 s=READY pgs=3640 cs=0 l=1 rev1=1 rx=0x7fa584002700 tx=0x7fa584009e00).stop 2022-02-02T22:19:08.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 shutdown_connections 2022-02-02T22:19:08.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa57c064db0 0x7fa57c067270 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:08.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5940f55c0 0x7fa594105e30 unknown :-1 s=CLOSED pgs=3640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:08.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 --2- 172.21.15.96:0/2026333070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5940f6860 0x7fa594106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:08.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 >> 172.21.15.96:0/2026333070 conn(0x7fa5940f0d40 msgr2=0x7fa5940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:08.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 shutdown_connections 2022-02-02T22:19:08.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:08.019+0000 7fa59982e700 1 -- 172.21.15.96:0/2026333070 wait complete. 2022-02-02T22:19:08.038 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:19:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:08 smithi159 ceph-mon[69013]: pgmap v7110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:08 smithi159 ceph-mon[69013]: from='client.41386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:08 smithi159 ceph-mon[69013]: from='client.41390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4245562772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:19:08.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2026333070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:19:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:08 smithi096 ceph-mon[101353]: pgmap v7110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:08 smithi096 ceph-mon[101353]: from='client.41386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:08 smithi096 ceph-mon[101353]: from='client.41390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4245562772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:19:08.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2026333070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:19:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:10 smithi159 ceph-mon[69013]: pgmap v7111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:10 smithi096 ceph-mon[101353]: pgmap v7111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:12 smithi159 ceph-mon[69013]: pgmap v7112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:12 smithi096 ceph-mon[101353]: pgmap v7112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:14 smithi159 ceph-mon[69013]: pgmap v7113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:14 smithi096 ceph-mon[101353]: pgmap v7113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:16 smithi159 ceph-mon[69013]: pgmap v7114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:16 smithi096 ceph-mon[101353]: pgmap v7114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:18 smithi159 ceph-mon[69013]: pgmap v7115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:18 smithi096 ceph-mon[101353]: pgmap v7115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:20 smithi159 ceph-mon[69013]: pgmap v7116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:20 smithi096 ceph-mon[101353]: pgmap v7116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:22 smithi159 ceph-mon[69013]: pgmap v7117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:22 smithi096 ceph-mon[101353]: pgmap v7117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:24 smithi159 ceph-mon[69013]: pgmap v7118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:24 smithi096 ceph-mon[101353]: pgmap v7118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:26 smithi159 ceph-mon[69013]: pgmap v7119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:26 smithi096 ceph-mon[101353]: pgmap v7119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:28 smithi159 ceph-mon[69013]: pgmap v7120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:19:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:19:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:28 smithi096 ceph-mon[101353]: pgmap v7120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:19:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:19:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:30 smithi159 ceph-mon[69013]: pgmap v7121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:30 smithi096 ceph-mon[101353]: pgmap v7121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:32 smithi159 ceph-mon[69013]: pgmap v7122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:32 smithi096 ceph-mon[101353]: pgmap v7122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:34.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:34 smithi159 ceph-mon[69013]: pgmap v7123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:34 smithi096 ceph-mon[101353]: pgmap v7123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:36 smithi159 ceph-mon[69013]: pgmap v7124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:36 smithi096 ceph-mon[101353]: pgmap v7124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:38.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 -- 172.21.15.96:0/2285152364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 msgr2=0x7f25240f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 --2- 172.21.15.96:0/2285152364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f25240f6cd0 secure :-1 s=READY pgs=3641 cs=0 l=1 rev1=1 rx=0x7f250c004660 tx=0x7f250c009b30).stop 2022-02-02T22:19:38.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 -- 172.21.15.96:0/2285152364 shutdown_connections 2022-02-02T22:19:38.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 --2- 172.21.15.96:0/2285152364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f25240f6cd0 unknown :-1 s=CLOSED pgs=3641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 --2- 172.21.15.96:0/2285152364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 0x7f25240f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 -- 172.21.15.96:0/2285152364 >> 172.21.15.96:0/2285152364 conn(0x7f25240f0d70 msgr2=0x7f25240f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 -- 172.21.15.96:0/2285152364 shutdown_connections 2022-02-02T22:19:38.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.131+0000 7f2529b47700 1 -- 172.21.15.96:0/2285152364 wait complete. 2022-02-02T22:19:38.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 Processor -- start 2022-02-02T22:19:38.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 -- start start 2022-02-02T22:19:38.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 0x7f2524109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2524060500 con 0x7f25240f6870 2022-02-02T22:19:38.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.132+0000 7f2529b47700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2524060640 con 0x7f25240f55d0 2022-02-02T22:19:38.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47804/0 (socket says 172.21.15.96:47804) 2022-02-02T22:19:38.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 -- 172.21.15.96:0/2239093544 learned_addr learned my addr 172.21.15.96:0/2239093544 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:38.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f25237fe700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 0x7f2524109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 -- 172.21.15.96:0/2239093544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 msgr2=0x7f2524109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 0x7f2524109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 -- 172.21.15.96:0/2239093544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c005040 con 0x7f25240f6870 2022-02-02T22:19:38.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f251bfff700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 rx=0x7f250c009da0 tx=0x7f250c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c018070 con 0x7f25240f6870 2022-02-02T22:19:38.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f250c007cf0 con 0x7f25240f6870 2022-02-02T22:19:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252410c680 con 0x7f25240f6870 2022-02-02T22:19:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c01c620 con 0x7f25240f6870 2022-02-02T22:19:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.133+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252410cbb0 con 0x7f25240f6870 2022-02-02T22:19:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.134+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2524045ad0 con 0x7f25240f6870 2022-02-02T22:19:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.135+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f250c01d420 con 0x7f25240f6870 2022-02-02T22:19:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.135+0000 7f2520ff9700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 0x7f2510067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.136+0000 7f25237fe700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 0x7f2510067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.136+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f250c083950 con 0x7f25240f6870 2022-02-02T22:19:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.136+0000 7f25237fe700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 0x7f2510067270 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f2524060180 tx=0x7f2514009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.140+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f250c051a50 con 0x7f25240f6870 2022-02-02T22:19:38.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.318+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25240fdea0 con 0x7f2510064db0 2022-02-02T22:19:38.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.319+0000 7f2520ff9700 1 -- 172.21.15.96:0/2239093544 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f25240fdea0 con 0x7f2510064db0 2022-02-02T22:19:38.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 msgr2=0x7f2510067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 0x7f2510067270 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f2524060180 tx=0x7f2514009040).stop 2022-02-02T22:19:38.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 msgr2=0x7f252410c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 rx=0x7f250c009da0 tx=0x7f250c009b30).stop 2022-02-02T22:19:38.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 shutdown_connections 2022-02-02T22:19:38.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2510064db0 0x7f2510067270 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25240f55d0 0x7f2524109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 --2- 172.21.15.96:0/2239093544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25240f6870 0x7f252410c130 unknown :-1 s=CLOSED pgs=3642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 >> 172.21.15.96:0/2239093544 conn(0x7f25240f0d70 msgr2=0x7f25240fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 shutdown_connections 2022-02-02T22:19:38.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.321+0000 7f2529b47700 1 -- 172.21.15.96:0/2239093544 wait complete. 2022-02-02T22:19:38.330 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:19:38.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.421+0000 7f53185d5700 1 -- 172.21.15.96:0/2544624757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f66e0 msgr2=0x7f53100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.421+0000 7f53185d5700 1 --2- 172.21.15.96:0/2544624757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f66e0 0x7f53100f6b00 secure :-1 s=READY pgs=3643 cs=0 l=1 rev1=1 rx=0x7f530c004660 tx=0x7f530c009b30).stop 2022-02-02T22:19:38.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 -- 172.21.15.96:0/2544624757 shutdown_connections 2022-02-02T22:19:38.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 --2- 172.21.15.96:0/2544624757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f7980 0x7f53100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 --2- 172.21.15.96:0/2544624757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f66e0 0x7f53100f6b00 unknown :-1 s=CLOSED pgs=3643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 -- 172.21.15.96:0/2544624757 >> 172.21.15.96:0/2544624757 conn(0x7f53100f1e40 msgr2=0x7f53100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 -- 172.21.15.96:0/2544624757 shutdown_connections 2022-02-02T22:19:38.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 -- 172.21.15.96:0/2544624757 wait complete. 2022-02-02T22:19:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 Processor -- start 2022-02-02T22:19:38.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.422+0000 7f53185d5700 1 -- start start 2022-02-02T22:19:38.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f53185d5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f66e0 0x7f53101091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f53185d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f53185d5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5310109c40 con 0x7f53100f7980 2022-02-02T22:19:38.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f53185d5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5310109d80 con 0x7f53100f66e0 2022-02-02T22:19:38.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47814/0 (socket says 172.21.15.96:47814) 2022-02-02T22:19:38.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 -- 172.21.15.96:0/239717523 learned_addr learned my addr 172.21.15.96:0/239717523 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:38.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5316371700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f66e0 0x7f53101091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 -- 172.21.15.96:0/239717523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f66e0 msgr2=0x7f53101091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f66e0 0x7f53101091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 -- 172.21.15.96:0/239717523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c005040 con 0x7f53100f7980 2022-02-02T22:19:38.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5315b70700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 secure :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 rx=0x7f530000c790 tx=0x7f5300007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.423+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5300002590 con 0x7f53100f7980 2022-02-02T22:19:38.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.424+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5300002ba0 con 0x7f53100f7980 2022-02-02T22:19:38.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.424+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531010a720 con 0x7f53100f7980 2022-02-02T22:19:38.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.424+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531010ace0 con 0x7f53100f7980 2022-02-02T22:19:38.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.424+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5300013d90 con 0x7f53100f7980 2022-02-02T22:19:38.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.425+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8004fa0 con 0x7f53100f7980 2022-02-02T22:19:38.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.425+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f530001a060 con 0x7f53100f7980 2022-02-02T22:19:38.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.425+0000 7f5306ffd700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 0x7f52fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.426+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5300081c20 con 0x7f53100f7980 2022-02-02T22:19:38.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.426+0000 7f5316371700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 0x7f52fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.426+0000 7f5316371700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 0x7f52fc067290 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f530c004630 tx=0x7f530c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.430+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f53000536f0 con 0x7f53100f7980 2022-02-02T22:19:38.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.603+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52f8000bc0 con 0x7f52fc064dd0 2022-02-02T22:19:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.612+0000 7f5306ffd700 1 -- 172.21.15.96:0/239717523 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f52f8000bc0 con 0x7f52fc064dd0 2022-02-02T22:19:38.613 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:19:38.614 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:19:38.614 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:19:38.615 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:19:38.615 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:19:38.615 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:19:38.616 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:19:38.616 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:19:38.616 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:19:38.617 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:19:38.617 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:19:38.617 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:19:38.618 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:19:38.618 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:19:38.618 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:19:38.619 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:19:38.619 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:19:38.619 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:19:38.620 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:19:38.620 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:19:38.620 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:19:38.620 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:19:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 msgr2=0x7f52fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 0x7f52fc067290 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f530c004630 tx=0x7f530c009b30).stop 2022-02-02T22:19:38.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 msgr2=0x7f5310109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 secure :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 rx=0x7f530000c790 tx=0x7f5300007d70).stop 2022-02-02T22:19:38.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 shutdown_connections 2022-02-02T22:19:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52fc064dd0 0x7f52fc067290 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53100f66e0 0x7f53101091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 --2- 172.21.15.96:0/239717523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53100f7980 0x7f5310109690 unknown :-1 s=CLOSED pgs=3644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 >> 172.21.15.96:0/239717523 conn(0x7f53100f1e40 msgr2=0x7f53100f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 shutdown_connections 2022-02-02T22:19:38.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.614+0000 7f53185d5700 1 -- 172.21.15.96:0/239717523 wait complete. 2022-02-02T22:19:38.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 -- 172.21.15.96:0/1210864030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 msgr2=0x7fa4380f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 --2- 172.21.15.96:0/1210864030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4380f7de0 secure :-1 s=READY pgs=3645 cs=0 l=1 rev1=1 rx=0x7fa424004660 tx=0x7fa424009b30).stop 2022-02-02T22:19:38.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 -- 172.21.15.96:0/1210864030 shutdown_connections 2022-02-02T22:19:38.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 --2- 172.21.15.96:0/1210864030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa4380f7de0 unknown :-1 s=CLOSED pgs=3645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 --2- 172.21.15.96:0/1210864030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa4380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 -- 172.21.15.96:0/1210864030 >> 172.21.15.96:0/1210864030 conn(0x7fa4380f1e40 msgr2=0x7fa4380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 -- 172.21.15.96:0/1210864030 shutdown_connections 2022-02-02T22:19:38.713 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:38 smithi096 ceph-mon[101353]: pgmap v7125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:38.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.710+0000 7fa43f08d700 1 -- 172.21.15.96:0/1210864030 wait complete. 2022-02-02T22:19:38.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 Processor -- start 2022-02-02T22:19:38.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 -- start start 2022-02-02T22:19:38.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438107a00 con 0x7fa4380f7980 2022-02-02T22:19:38.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.711+0000 7fa43f08d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438107b40 con 0x7fa4380f66e0 2022-02-02T22:19:38.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47824/0 (socket says 172.21.15.96:47824) 2022-02-02T22:19:38.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 -- 172.21.15.96:0/4174819608 learned_addr learned my addr 172.21.15.96:0/4174819608 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:38.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa43ce29700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 -- 172.21.15.96:0/4174819608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 msgr2=0x7fa438106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 -- 172.21.15.96:0/4174819608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424005040 con 0x7fa4380f7980 2022-02-02T22:19:38.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa437fff700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 secure :-1 s=READY pgs=3646 cs=0 l=1 rev1=1 rx=0x7fa424009990 tx=0x7fa424009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa424018070 con 0x7fa4380f7980 2022-02-02T22:19:38.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa424007ca0 con 0x7fa4380f7980 2022-02-02T22:19:38.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42401c620 con 0x7fa4380f7980 2022-02-02T22:19:38.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438108480 con 0x7fa4380f7980 2022-02-02T22:19:38.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.712+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4381089e0 con 0x7fa4380f7980 2022-02-02T22:19:38.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.714+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa438045ad0 con 0x7fa4380f7980 2022-02-02T22:19:38.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.714+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa42401d960 con 0x7fa4380f7980 2022-02-02T22:19:38.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.714+0000 7fa4357fa700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 0x7fa428067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:38.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.714+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa4240837d0 con 0x7fa4380f7980 2022-02-02T22:19:38.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.714+0000 7fa43ce29700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 0x7fa428067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:38.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.715+0000 7fa43ce29700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 0x7fa428067290 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7fa4380f77e0 tx=0x7fa42c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:38.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.719+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa424055470 con 0x7fa4380f7980 2022-02-02T22:19:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.948+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4380fef40 con 0x7fa4380f7980 2022-02-02T22:19:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.948+0000 7fa4357fa700 1 -- 172.21.15.96:0/4174819608 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa424055060 con 0x7fa4380f7980 2022-02-02T22:19:38.949 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:19:38.949 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:19:38.949 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:19:38.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:38.950 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:19:38.951 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:19:38.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:38.951 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:19:38.952 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:19:38.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:38.952 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:19:38.953 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:19:38.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:19:38.953 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:19:38.954 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:19:38.954 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:19:38.954 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:19:38.955 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:19:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 msgr2=0x7fa428067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 0x7fa428067290 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7fa4380f77e0 tx=0x7fa42c009040).stop 2022-02-02T22:19:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 msgr2=0x7fa438107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 secure :-1 s=READY pgs=3646 cs=0 l=1 rev1=1 rx=0x7fa424009990 tx=0x7fa424009b30).stop 2022-02-02T22:19:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 shutdown_connections 2022-02-02T22:19:38.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa428064dd0 0x7fa428067290 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4380f66e0 0x7fa438106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 --2- 172.21.15.96:0/4174819608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4380f7980 0x7fa438107450 unknown :-1 s=CLOSED pgs=3646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 >> 172.21.15.96:0/4174819608 conn(0x7fa4380f1e40 msgr2=0x7fa4380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 shutdown_connections 2022-02-02T22:19:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:38.950+0000 7fa43f08d700 1 -- 172.21.15.96:0/4174819608 wait complete. 2022-02-02T22:19:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:38 smithi159 ceph-mon[69013]: pgmap v7125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:39.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.047+0000 7f55bce5b700 1 -- 172.21.15.96:0/3946626672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 msgr2=0x7f55b80fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:39.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.047+0000 7f55bce5b700 1 --2- 172.21.15.96:0/3946626672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 0x7f55b80fbc70 secure :-1 s=READY pgs=3647 cs=0 l=1 rev1=1 rx=0x7f55ac004660 tx=0x7f55ac009b30).stop 2022-02-02T22:19:39.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- 172.21.15.96:0/3946626672 shutdown_connections 2022-02-02T22:19:39.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 --2- 172.21.15.96:0/3946626672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 0x7f55b80fbc70 unknown :-1 s=CLOSED pgs=3647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:39.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 --2- 172.21.15.96:0/3946626672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:39.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- 172.21.15.96:0/3946626672 >> 172.21.15.96:0/3946626672 conn(0x7f55b80f0d40 msgr2=0x7f55b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:39.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- 172.21.15.96:0/3946626672 shutdown_connections 2022-02-02T22:19:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- 172.21.15.96:0/3946626672 wait complete. 2022-02-02T22:19:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 Processor -- start 2022-02-02T22:19:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- start start 2022-02-02T22:19:39.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 0x7f55b80f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:39.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80f5740 con 0x7f55b80f9860 2022-02-02T22:19:39.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.048+0000 7f55bce5b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80f5880 con 0x7f55b80602d0 2022-02-02T22:19:39.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:39.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:51936/0 (socket says 172.21.15.96:51936) 2022-02-02T22:19:39.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 -- 172.21.15.96:0/1650154745 learned_addr learned my addr 172.21.15.96:0/1650154745 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:19:39.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 -- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 msgr2=0x7f55b80f51e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T22:19:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 0x7f55b80f51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:19:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 -- 172.21.15.96:0/1650154745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac005040 con 0x7f55b80602d0 2022-02-02T22:19:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55b659c700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f55a80026d0 tx=0x7f55a8009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:39.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a8009320 con 0x7f55b80602d0 2022-02-02T22:19:39.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b80f5b60 con 0x7f55b80602d0 2022-02-02T22:19:39.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b810ef70 con 0x7f55b80602d0 2022-02-02T22:19:39.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55a800f040 con 0x7f55b80602d0 2022-02-02T22:19:39.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.049+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a80145e0 con 0x7f55b80602d0 2022-02-02T22:19:39.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.050+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c004fa0 con 0x7f55b80602d0 2022-02-02T22:19:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.051+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55a8009480 con 0x7f55b80602d0 2022-02-02T22:19:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.051+0000 7f55a6ffd700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 0x7f55a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:19:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.051+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55a8081eb0 con 0x7f55b80602d0 2022-02-02T22:19:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.051+0000 7f55b5d9b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 0x7f55a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:19:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.052+0000 7f55b5d9b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 0x7f55a0067290 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f55ac004e30 tx=0x7f55ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:19:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.055+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55a804fef0 con 0x7f55b80602d0 2022-02-02T22:19:39.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.255+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f559c005940 con 0x7f55b80602d0 2022-02-02T22:19:39.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.255+0000 7f55a6ffd700 1 -- 172.21.15.96:0/1650154745 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f55a8053510 con 0x7f55b80602d0 2022-02-02T22:19:39.256 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:19:39.256 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:19:39.257 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:19:39.257 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:19:39.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:39.258 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:19:39.258 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:19:39.258 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:19:39.259 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:19:39.259 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:19:39.260 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:19:39.260 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:19:39.260 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:19:39.261 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:19:39.261 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:19:39.261 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:19:39.262 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:19:39.262 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:19:39.262 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:19:39.263 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:19:39.263 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:19:39.263 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:19:39.264 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:19:39.264 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:19:39.264 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:19:39.265 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:19:39.265 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:19:39.265 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:19:39.266 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:19:39.266 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:19:39.266 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:19:39.267 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:19:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:39.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:39.267 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:19:39.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:19:39.268 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:39.269 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:39.269 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:19:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.257+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 msgr2=0x7f55a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.257+0000 7f55bce5b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 0x7f55a0067290 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f55ac004e30 tx=0x7f55ac009b30).stop 2022-02-02T22:19:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.257+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 msgr2=0x7f55b80f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:19:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.257+0000 7f55bce5b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f55a80026d0 tx=0x7f55a8009de0).stop 2022-02-02T22:19:39.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 shutdown_connections 2022-02-02T22:19:39.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55a0064dd0 0x7f55a0067290 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:39.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55b80602d0 0x7f55b80f6d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:19:39.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 --2- 172.21.15.96:0/1650154745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b80f9860 0x7f55b80f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:19:39.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 >> 172.21.15.96:0/1650154745 conn(0x7f55b80f0d40 msgr2=0x7f55b80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:19:39.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 shutdown_connections 2022-02-02T22:19:39.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:19:39.258+0000 7f55bce5b700 1 -- 172.21.15.96:0/1650154745 wait complete. 2022-02-02T22:19:39.274 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:19:39.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:39 smithi096 ceph-mon[101353]: from='client.41402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:39.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:39 smithi096 ceph-mon[101353]: from='client.41406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:39.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4174819608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:19:39.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1650154745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:19:40.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:39 smithi159 ceph-mon[69013]: from='client.41402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:40.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:39 smithi159 ceph-mon[69013]: from='client.41406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:19:40.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4174819608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:19:40.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1650154745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:19:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:40 smithi096 ceph-mon[101353]: pgmap v7126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:40 smithi159 ceph-mon[69013]: pgmap v7126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:42 smithi096 ceph-mon[101353]: pgmap v7127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:42 smithi159 ceph-mon[69013]: pgmap v7127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:44 smithi096 ceph-mon[101353]: pgmap v7128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:44 smithi159 ceph-mon[69013]: pgmap v7128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:46 smithi096 ceph-mon[101353]: pgmap v7129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:46 smithi159 ceph-mon[69013]: pgmap v7129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:48 smithi096 ceph-mon[101353]: pgmap v7130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:48 smithi159 ceph-mon[69013]: pgmap v7130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:50 smithi096 ceph-mon[101353]: pgmap v7131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:50 smithi159 ceph-mon[69013]: pgmap v7131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:52 smithi096 ceph-mon[101353]: pgmap v7132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:52 smithi159 ceph-mon[69013]: pgmap v7132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:54 smithi159 ceph-mon[69013]: pgmap v7133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:54 smithi096 ceph-mon[101353]: pgmap v7133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:56 smithi159 ceph-mon[69013]: pgmap v7134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:56 smithi096 ceph-mon[101353]: pgmap v7134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:19:58 smithi159 ceph-mon[69013]: pgmap v7135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:19:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:19:58 smithi096 ceph-mon[101353]: pgmap v7135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:00 smithi159 ceph-mon[69013]: pgmap v7136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:20:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:00 smithi096 ceph-mon[101353]: pgmap v7136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:20:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:02 smithi159 ceph-mon[69013]: pgmap v7137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:02 smithi096 ceph-mon[101353]: pgmap v7137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:04 smithi159 ceph-mon[69013]: pgmap v7138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:04 smithi096 ceph-mon[101353]: pgmap v7138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:06 smithi159 ceph-mon[69013]: pgmap v7139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:06 smithi096 ceph-mon[101353]: pgmap v7139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:08 smithi159 ceph-mon[69013]: pgmap v7140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:08 smithi096 ceph-mon[101353]: pgmap v7140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:09.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 -- 172.21.15.96:0/2154805037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 msgr2=0x7f50d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 --2- 172.21.15.96:0/2154805037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d40f7de0 secure :-1 s=READY pgs=3648 cs=0 l=1 rev1=1 rx=0x7f50c0004660 tx=0x7f50c0009b30).stop 2022-02-02T22:20:09.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 -- 172.21.15.96:0/2154805037 shutdown_connections 2022-02-02T22:20:09.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 --2- 172.21.15.96:0/2154805037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d40f7de0 unknown :-1 s=CLOSED pgs=3648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 --2- 172.21.15.96:0/2154805037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 0x7f50d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:20:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 -- 172.21.15.96:0/2154805037 >> 172.21.15.96:0/2154805037 conn(0x7f50d40f1e40 msgr2=0x7f50d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:09.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 -- 172.21.15.96:0/2154805037 shutdown_connections 2022-02-02T22:20:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 -- 172.21.15.96:0/2154805037 wait complete. 2022-02-02T22:20:09.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.368+0000 7f50dad86700 1 Processor -- start 2022-02-02T22:20:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50dad86700 1 -- start start 2022-02-02T22:20:09.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50dad86700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 0x7f50d4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50dad86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50dad86700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4107ae0 con 0x7f50d40f7980 2022-02-02T22:20:09.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50dad86700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4108390 con 0x7f50d40f66e0 2022-02-02T22:20:09.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47850/0 (socket says 172.21.15.96:47850) 2022-02-02T22:20:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 -- 172.21.15.96:0/1441801171 learned_addr learned my addr 172.21.15.96:0/1441801171 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d8b22700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 0x7f50d4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 -- 172.21.15.96:0/1441801171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 msgr2=0x7f50d4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 0x7f50d4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.369+0000 7f50d3fff700 1 -- 172.21.15.96:0/1441801171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0005040 con 0x7f50d40f7980 2022-02-02T22:20:09.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50d3fff700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 secure :-1 s=READY pgs=3649 cs=0 l=1 rev1=1 rx=0x7f50c0009990 tx=0x7f50c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c0018070 con 0x7f50d40f7980 2022-02-02T22:20:09.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f50c0007ba0 con 0x7f50d40f7980 2022-02-02T22:20:09.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d4108610 con 0x7f50d40f7980 2022-02-02T22:20:09.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c001c620 con 0x7f50d40f7980 2022-02-02T22:20:09.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.370+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d4108b70 con 0x7f50d40f7980 2022-02-02T22:20:09.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.371+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d40f5ad0 con 0x7f50d40f7980 2022-02-02T22:20:09.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.371+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f50c001c8e0 con 0x7f50d40f7980 2022-02-02T22:20:09.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.372+0000 7f50d17fa700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 0x7f50c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.372+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f50c0083890 con 0x7f50d40f7980 2022-02-02T22:20:09.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.372+0000 7f50d8b22700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 0x7f50c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.372+0000 7f50d8b22700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 0x7f50c4067290 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f50c8006fd0 tx=0x7f50c8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.376+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50c00553c0 con 0x7f50d40f7980 2022-02-02T22:20:09.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.556+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d40fefb0 con 0x7f50c4064dd0 2022-02-02T22:20:09.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.557+0000 7f50d17fa700 1 -- 172.21.15.96:0/1441801171 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f50d40fefb0 con 0x7f50c4064dd0 2022-02-02T22:20:09.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 msgr2=0x7f50c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 0x7f50c4067290 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f50c8006fd0 tx=0x7f50c8008040).stop 2022-02-02T22:20:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 msgr2=0x7f50d41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 secure :-1 s=READY pgs=3649 cs=0 l=1 rev1=1 rx=0x7f50c0009990 tx=0x7f50c0009b30).stop 2022-02-02T22:20:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 shutdown_connections 2022-02-02T22:20:09.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f50c4064dd0 0x7f50c4067290 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d40f66e0 0x7f50d4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 --2- 172.21.15.96:0/1441801171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50d40f7980 0x7f50d41074a0 unknown :-1 s=CLOSED pgs=3649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 >> 172.21.15.96:0/1441801171 conn(0x7f50d40f1e40 msgr2=0x7f50d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:09.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 shutdown_connections 2022-02-02T22:20:09.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.559+0000 7f50dad86700 1 -- 172.21.15.96:0/1441801171 wait complete. 2022-02-02T22:20:09.568 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:20:09.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 -- 172.21.15.96:0/3639907498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 msgr2=0x7f13fc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 --2- 172.21.15.96:0/3639907498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc0f7de0 secure :-1 s=READY pgs=3650 cs=0 l=1 rev1=1 rx=0x7f13ec004660 tx=0x7f13ec009b30).stop 2022-02-02T22:20:09.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 -- 172.21.15.96:0/3639907498 shutdown_connections 2022-02-02T22:20:09.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 --2- 172.21.15.96:0/3639907498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc0f7de0 unknown :-1 s=CLOSED pgs=3650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 --2- 172.21.15.96:0/3639907498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 0x7f13fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 -- 172.21.15.96:0/3639907498 >> 172.21.15.96:0/3639907498 conn(0x7f13fc0f1e40 msgr2=0x7f13fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:09.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 -- 172.21.15.96:0/3639907498 shutdown_connections 2022-02-02T22:20:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.656+0000 7f1401051700 1 -- 172.21.15.96:0/3639907498 wait complete. 2022-02-02T22:20:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 Processor -- start 2022-02-02T22:20:09.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 -- start start 2022-02-02T22:20:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 0x7f13fc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc107a00 con 0x7f13fc0f7980 2022-02-02T22:20:09.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f1401051700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc107b40 con 0x7f13fc0f66e0 2022-02-02T22:20:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47860/0 (socket says 172.21.15.96:47860) 2022-02-02T22:20:09.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 -- 172.21.15.96:0/1067664469 learned_addr learned my addr 172.21.15.96:0/1067664469 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:09.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fad9d700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 0x7f13fc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 -- 172.21.15.96:0/1067664469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 msgr2=0x7f13fc106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 0x7f13fc106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.657+0000 7f13fa59c700 1 -- 172.21.15.96:0/1067664469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec005040 con 0x7f13fc0f7980 2022-02-02T22:20:09.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f13fa59c700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 secure :-1 s=READY pgs=3651 cs=0 l=1 rev1=1 rx=0x7f13ec009990 tx=0x7f13ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ec018070 con 0x7f13fc0f7980 2022-02-02T22:20:09.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc108480 con 0x7f13fc0f7980 2022-02-02T22:20:09.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13ec007ba0 con 0x7f13fc0f7980 2022-02-02T22:20:09.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ec01c620 con 0x7f13fc0f7980 2022-02-02T22:20:09.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.658+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc1089e0 con 0x7f13fc0f7980 2022-02-02T22:20:09.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.659+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc045ad0 con 0x7f13fc0f7980 2022-02-02T22:20:09.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.660+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f13ec01c8e0 con 0x7f13fc0f7980 2022-02-02T22:20:09.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.660+0000 7f13e37fe700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 0x7f13e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.660+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f13ec083bb0 con 0x7f13fc0f7980 2022-02-02T22:20:09.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.661+0000 7f13fad9d700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 0x7f13e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.661+0000 7f13fad9d700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 0x7f13e4067290 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f13fc0f77e0 tx=0x7f13f0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.664+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13ec055620 con 0x7f13fc0f7980 2022-02-02T22:20:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.836+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f13fc108c00 con 0x7f13e4064dd0 2022-02-02T22:20:09.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.846+0000 7f13e37fe700 1 -- 172.21.15.96:0/1067664469 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f13fc108c00 con 0x7f13e4064dd0 2022-02-02T22:20:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:20:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:20:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:20:09.847 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:20:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:20:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:20:09.848 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:20:09.849 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:20:09.849 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:20:09.849 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:20:09.850 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:20:09.850 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:20:09.851 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:20:09.851 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:20:09.851 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:20:09.852 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:20:09.852 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:20:09.852 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:20:09.853 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:20:09.853 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:20:09.853 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:20:09.854 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:20:09.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 msgr2=0x7f13e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 0x7f13e4067290 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f13fc0f77e0 tx=0x7f13f0009040).stop 2022-02-02T22:20:09.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 msgr2=0x7f13fc107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 secure :-1 s=READY pgs=3651 cs=0 l=1 rev1=1 rx=0x7f13ec009990 tx=0x7f13ec009b30).stop 2022-02-02T22:20:09.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 shutdown_connections 2022-02-02T22:20:09.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f13e4064dd0 0x7f13e4067290 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0f66e0 0x7f13fc106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 --2- 172.21.15.96:0/1067664469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13fc0f7980 0x7f13fc107450 unknown :-1 s=CLOSED pgs=3651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 >> 172.21.15.96:0/1067664469 conn(0x7f13fc0f1e40 msgr2=0x7f13fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:09.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 shutdown_connections 2022-02-02T22:20:09.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.848+0000 7f1401051700 1 -- 172.21.15.96:0/1067664469 wait complete. 2022-02-02T22:20:09.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 -- 172.21.15.96:0/2859611471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 msgr2=0x7f42680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 --2- 172.21.15.96:0/2859611471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f42680f6cc0 secure :-1 s=READY pgs=3652 cs=0 l=1 rev1=1 rx=0x7f4264004660 tx=0x7f4264009b30).stop 2022-02-02T22:20:09.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 -- 172.21.15.96:0/2859611471 shutdown_connections 2022-02-02T22:20:09.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 --2- 172.21.15.96:0/2859611471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f42680f6cc0 unknown :-1 s=CLOSED pgs=3652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 --2- 172.21.15.96:0/2859611471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 0x7f42680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 -- 172.21.15.96:0/2859611471 >> 172.21.15.96:0/2859611471 conn(0x7f42680f0d40 msgr2=0x7f42680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:09.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.944+0000 7f4270322700 1 -- 172.21.15.96:0/2859611471 shutdown_connections 2022-02-02T22:20:09.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.946+0000 7f4270322700 1 -- 172.21.15.96:0/2859611471 wait complete. 2022-02-02T22:20:09.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 Processor -- start 2022-02-02T22:20:09.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 -- start start 2022-02-02T22:20:09.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 0x7f426810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680602d0 con 0x7f42680f6860 2022-02-02T22:20:09.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f4270322700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268060410 con 0x7f42680f55c0 2022-02-02T22:20:09.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47870/0 (socket says 172.21.15.96:47870) 2022-02-02T22:20:09.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 -- 172.21.15.96:0/1514600804 learned_addr learned my addr 172.21.15.96:0/1514600804 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:09.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426e0be700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 0x7f426810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 -- 172.21.15.96:0/1514600804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 msgr2=0x7f426810c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 0x7f426810c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.947+0000 7f426d8bd700 1 -- 172.21.15.96:0/1514600804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264005040 con 0x7f42680f6860 2022-02-02T22:20:09.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f426d8bd700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 secure :-1 s=READY pgs=3653 cs=0 l=1 rev1=1 rx=0x7f4264009990 tx=0x7f4264009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4264018070 con 0x7f42680f6860 2022-02-02T22:20:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4264007ba0 con 0x7f42680f6860 2022-02-02T22:20:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426810ea40 con 0x7f42680f6860 2022-02-02T22:20:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426401c620 con 0x7f42680f6860 2022-02-02T22:20:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.948+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426810ee10 con 0x7f42680f6860 2022-02-02T22:20:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.949+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4268045ad0 con 0x7f42680f6860 2022-02-02T22:20:09.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.949+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f426401c8e0 con 0x7f42680f6860 2022-02-02T22:20:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.950+0000 7f425effd700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 0x7f4254067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:09.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.950+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4264083850 con 0x7f42680f6860 2022-02-02T22:20:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.950+0000 7f426e0be700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 0x7f4254067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.950+0000 7f426e0be700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 0x7f4254067290 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f4268060060 tx=0x7f4258009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:09.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:09.954+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4264051950 con 0x7f42680f6860 2022-02-02T22:20:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.181+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4268027a00 con 0x7f42680f6860 2022-02-02T22:20:10.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.182+0000 7f425effd700 1 -- 172.21.15.96:0/1514600804 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4264054f70 con 0x7f42680f6860 2022-02-02T22:20:10.182 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:20:10.182 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:20:10.183 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:20:10.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:10.183 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:20:10.184 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:20:10.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:10.184 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:20:10.185 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:20:10.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:10.185 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:20:10.186 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:20:10.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:10.186 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:20:10.187 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:20:10.187 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:20:10.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:20:10.188 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:20:10.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 msgr2=0x7f4254067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 0x7f4254067290 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f4268060060 tx=0x7f4258009040).stop 2022-02-02T22:20:10.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 msgr2=0x7f426810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 secure :-1 s=READY pgs=3653 cs=0 l=1 rev1=1 rx=0x7f4264009990 tx=0x7f4264009b30).stop 2022-02-02T22:20:10.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 shutdown_connections 2022-02-02T22:20:10.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4254064dd0 0x7f4254067290 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42680f55c0 0x7f426810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 --2- 172.21.15.96:0/1514600804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42680f6860 0x7f426810e550 unknown :-1 s=CLOSED pgs=3653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 >> 172.21.15.96:0/1514600804 conn(0x7f42680f0d40 msgr2=0x7f42680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:10.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.183+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 shutdown_connections 2022-02-02T22:20:10.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.184+0000 7f4270322700 1 -- 172.21.15.96:0/1514600804 wait complete. 2022-02-02T22:20:10.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 -- 172.21.15.96:0/2823103844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 msgr2=0x7f0a740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 --2- 172.21.15.96:0/2823103844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a740f6cc0 secure :-1 s=READY pgs=3654 cs=0 l=1 rev1=1 rx=0x7f0a70004660 tx=0x7f0a70009b30).stop 2022-02-02T22:20:10.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 -- 172.21.15.96:0/2823103844 shutdown_connections 2022-02-02T22:20:10.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 --2- 172.21.15.96:0/2823103844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a740f6cc0 unknown :-1 s=CLOSED pgs=3654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 --2- 172.21.15.96:0/2823103844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 -- 172.21.15.96:0/2823103844 >> 172.21.15.96:0/2823103844 conn(0x7f0a740f0d40 msgr2=0x7f0a740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:10.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 -- 172.21.15.96:0/2823103844 shutdown_connections 2022-02-02T22:20:10.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.280+0000 7f0a7b622700 1 -- 172.21.15.96:0/2823103844 wait complete. 2022-02-02T22:20:10.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 Processor -- start 2022-02-02T22:20:10.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 -- start start 2022-02-02T22:20:10.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a74106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:10.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:10.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74107a10 con 0x7f0a740f6860 2022-02-02T22:20:10.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a7b622700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74107b50 con 0x7f0a740f55c0 2022-02-02T22:20:10.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a78bbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a78bbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47880/0 (socket says 172.21.15.96:47880) 2022-02-02T22:20:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a78bbd700 1 -- 172.21.15.96:0/219096784 learned_addr learned my addr 172.21.15.96:0/219096784 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:10.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.281+0000 7f0a793be700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a74106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a78bbd700 1 -- 172.21.15.96:0/219096784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 msgr2=0x7f0a74106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a78bbd700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a74106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a78bbd700 1 -- 172.21.15.96:0/219096784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70005040 con 0x7f0a740f6860 2022-02-02T22:20:10.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a793be700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a74106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:20:10.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a78bbd700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 secure :-1 s=READY pgs=3655 cs=0 l=1 rev1=1 rx=0x7f0a70009990 tx=0x7f0a70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:10.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a70018070 con 0x7f0a740f6860 2022-02-02T22:20:10.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a70007ba0 con 0x7f0a740f6860 2022-02-02T22:20:10.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74108490 con 0x7f0a740f6860 2022-02-02T22:20:10.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7001c3c0 con 0x7f0a740f6860 2022-02-02T22:20:10.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.282+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a741089f0 con 0x7f0a740f6860 2022-02-02T22:20:10.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.283+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74045ad0 con 0x7f0a740f6860 2022-02-02T22:20:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.284+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a7001c630 con 0x7f0a740f6860 2022-02-02T22:20:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.284+0000 7f0a69ffb700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 0x7f0a60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.284+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a700837b0 con 0x7f0a740f6860 2022-02-02T22:20:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.284+0000 7f0a793be700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 0x7f0a60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.285+0000 7f0a793be700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 0x7f0a60067290 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f0a740f66c0 tx=0x7f0a64009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:10.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.288+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a70055220 con 0x7f0a740f6860 2022-02-02T22:20:10.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.487+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a74109140 con 0x7f0a740f6860 2022-02-02T22:20:10.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.487+0000 7f0a69ffb700 1 -- 172.21.15.96:0/219096784 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0a70054e10 con 0x7f0a740f6860 2022-02-02T22:20:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:20:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:20:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:20:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:20:10.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:20:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:20:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:20:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:20:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:20:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:20:10.492 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:20:10.492 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:20:10.492 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:20:10.493 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:20:10.493 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:20:10.494 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:20:10.494 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:20:10.494 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:20:10.495 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:20:10.495 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:20:10.495 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:20:10.496 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:20:10.496 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:20:10.496 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:20:10.497 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:20:10.497 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:20:10.497 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:20:10.498 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:20:10.498 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:20:10.498 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:20:10.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:20:10.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:10.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:10.500 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:20:10.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:10.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:10.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:10.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 msgr2=0x7f0a60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 0x7f0a60067290 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f0a740f66c0 tx=0x7f0a64009c00).stop 2022-02-02T22:20:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 msgr2=0x7f0a74107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 secure :-1 s=READY pgs=3655 cs=0 l=1 rev1=1 rx=0x7f0a70009990 tx=0x7f0a70009b30).stop 2022-02-02T22:20:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 shutdown_connections 2022-02-02T22:20:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a60064dd0 0x7f0a60067290 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a740f55c0 0x7f0a74106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 --2- 172.21.15.96:0/219096784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740f6860 0x7f0a74107460 unknown :-1 s=CLOSED pgs=3655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 >> 172.21.15.96:0/219096784 conn(0x7f0a740f0d40 msgr2=0x7f0a7405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 shutdown_connections 2022-02-02T22:20:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:10.489+0000 7f0a7b622700 1 -- 172.21.15.96:0/219096784 wait complete. 2022-02-02T22:20:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:20:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:10 smithi159 ceph-mon[69013]: pgmap v7141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:10 smithi159 ceph-mon[69013]: from='client.41416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1514600804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:20:11.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/219096784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:20:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:10 smithi096 ceph-mon[101353]: pgmap v7141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:10 smithi096 ceph-mon[101353]: from='client.41416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1514600804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:20:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/219096784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:20:12.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:11 smithi159 ceph-mon[69013]: from='client.41420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:12.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:11 smithi096 ceph-mon[101353]: from='client.41420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:12 smithi159 ceph-mon[69013]: pgmap v7142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:12 smithi096 ceph-mon[101353]: pgmap v7142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:14 smithi159 ceph-mon[69013]: pgmap v7143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:14 smithi096 ceph-mon[101353]: pgmap v7143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:16 smithi159 ceph-mon[69013]: pgmap v7144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:16 smithi096 ceph-mon[101353]: pgmap v7144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:18 smithi159 ceph-mon[69013]: pgmap v7145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:18 smithi096 ceph-mon[101353]: pgmap v7145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:20 smithi159 ceph-mon[69013]: pgmap v7146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:20 smithi096 ceph-mon[101353]: pgmap v7146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:22 smithi159 ceph-mon[69013]: pgmap v7147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:22 smithi096 ceph-mon[101353]: pgmap v7147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:24 smithi159 ceph-mon[69013]: pgmap v7148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:24 smithi096 ceph-mon[101353]: pgmap v7148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:26 smithi159 ceph-mon[69013]: pgmap v7149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:26 smithi096 ceph-mon[101353]: pgmap v7149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:28 smithi159 ceph-mon[69013]: pgmap v7150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:20:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:20:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:28 smithi096 ceph-mon[101353]: pgmap v7150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:20:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:20:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:30 smithi159 ceph-mon[69013]: pgmap v7151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:30 smithi096 ceph-mon[101353]: pgmap v7151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:32 smithi159 ceph-mon[69013]: pgmap v7152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:32 smithi096 ceph-mon[101353]: pgmap v7152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:34 smithi159 ceph-mon[69013]: pgmap v7153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:34 smithi096 ceph-mon[101353]: pgmap v7153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:36 smithi159 ceph-mon[69013]: pgmap v7154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:36 smithi096 ceph-mon[101353]: pgmap v7154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:38 smithi159 ceph-mon[69013]: pgmap v7155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:38 smithi096 ceph-mon[101353]: pgmap v7155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.598+0000 7fc33d4ab700 1 -- 172.21.15.96:0/693513100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 msgr2=0x7fc3380fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.598+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/693513100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc3380fbc80 secure :-1 s=READY pgs=3656 cs=0 l=1 rev1=1 rx=0x7fc320004660 tx=0x7fc320009b30).stop 2022-02-02T22:20:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- 172.21.15.96:0/693513100 shutdown_connections 2022-02-02T22:20:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/693513100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc3380fbc80 unknown :-1 s=CLOSED pgs=3656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/693513100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 0x7fc3380f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:20:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- 172.21.15.96:0/693513100 >> 172.21.15.96:0/693513100 conn(0x7fc3380f0de0 msgr2=0x7fc3380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- 172.21.15.96:0/693513100 shutdown_connections 2022-02-02T22:20:40.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- 172.21.15.96:0/693513100 wait complete. 2022-02-02T22:20:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 Processor -- start 2022-02-02T22:20:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- start start 2022-02-02T22:20:40.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 0x7fc338106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338107ac0 con 0x7fc3380f9890 2022-02-02T22:20:40.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.599+0000 7fc33d4ab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338108370 con 0x7fc338060370 2022-02-02T22:20:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47900/0 (socket says 172.21.15.96:47900) 2022-02-02T22:20:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 -- 172.21.15.96:0/3471130246 learned_addr learned my addr 172.21.15.96:0/3471130246 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc336ffd700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 0x7fc338106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 -- 172.21.15.96:0/3471130246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 msgr2=0x7fc338106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 0x7fc338106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 -- 172.21.15.96:0/3471130246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320005040 con 0x7fc3380f9890 2022-02-02T22:20:40.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32ffff700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 secure :-1 s=READY pgs=3657 cs=0 l=1 rev1=1 rx=0x7fc320009990 tx=0x7fc320009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc320018070 con 0x7fc3380f9890 2022-02-02T22:20:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.600+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc320007ca0 con 0x7fc3380f9890 2022-02-02T22:20:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.601+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3381085f0 con 0x7fc3380f9890 2022-02-02T22:20:40.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.601+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32001c620 con 0x7fc3380f9890 2022-02-02T22:20:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.601+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338108b50 con 0x7fc3380f9890 2022-02-02T22:20:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.602+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3380f4a50 con 0x7fc3380f9890 2022-02-02T22:20:40.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.603+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc32001d960 con 0x7fc3380f9890 2022-02-02T22:20:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.603+0000 7fc32f7fe700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 0x7fc324067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.603+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc3200835a0 con 0x7fc3380f9890 2022-02-02T22:20:40.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.603+0000 7fc336ffd700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 0x7fc324067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.604+0000 7fc336ffd700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 0x7fc324067290 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fc338060140 tx=0x7fc328008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:40.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.608+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3200550d0 con 0x7fc3380f9890 2022-02-02T22:20:40.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.786+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3380ff010 con 0x7fc324064dd0 2022-02-02T22:20:40.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.787+0000 7fc32f7fe700 1 -- 172.21.15.96:0/3471130246 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc3380ff010 con 0x7fc324064dd0 2022-02-02T22:20:40.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 msgr2=0x7fc324067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 0x7fc324067290 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fc338060140 tx=0x7fc328008040).stop 2022-02-02T22:20:40.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 msgr2=0x7fc338107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 secure :-1 s=READY pgs=3657 cs=0 l=1 rev1=1 rx=0x7fc320009990 tx=0x7fc320009b30).stop 2022-02-02T22:20:40.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 shutdown_connections 2022-02-02T22:20:40.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc324064dd0 0x7fc324067290 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc338060370 0x7fc338106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 --2- 172.21.15.96:0/3471130246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3380f9890 0x7fc338107480 unknown :-1 s=CLOSED pgs=3657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 >> 172.21.15.96:0/3471130246 conn(0x7fc3380f0de0 msgr2=0x7fc3380f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:40.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 shutdown_connections 2022-02-02T22:20:40.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.789+0000 7fc33d4ab700 1 -- 172.21.15.96:0/3471130246 wait complete. 2022-02-02T22:20:40.799 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:20:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- 172.21.15.96:0/203720111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f66e0 msgr2=0x7fcbcc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/203720111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc0f6b00 secure :-1 s=READY pgs=3658 cs=0 l=1 rev1=1 rx=0x7fcbc0004660 tx=0x7fcbc0009b30).stop 2022-02-02T22:20:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- 172.21.15.96:0/203720111 shutdown_connections 2022-02-02T22:20:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/203720111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/203720111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc0f6b00 unknown :-1 s=CLOSED pgs=3658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- 172.21.15.96:0/203720111 >> 172.21.15.96:0/203720111 conn(0x7fcbcc0f1e40 msgr2=0x7fcbcc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- 172.21.15.96:0/203720111 shutdown_connections 2022-02-02T22:20:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- 172.21.15.96:0/203720111 wait complete. 2022-02-02T22:20:40.892 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:40 smithi096 ceph-mon[101353]: pgmap v7156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 Processor -- start 2022-02-02T22:20:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 -- start start 2022-02-02T22:20:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.888+0000 7fcbd0a99700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbd0a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbd0a99700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc107a10 con 0x7fcbcc0f7980 2022-02-02T22:20:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbd0a99700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc107b50 con 0x7fcbcc0f66e0 2022-02-02T22:20:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47908/0 (socket says 172.21.15.96:47908) 2022-02-02T22:20:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 -- 172.21.15.96:0/4183008957 learned_addr learned my addr 172.21.15.96:0/4183008957 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbca59c700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 -- 172.21.15.96:0/4183008957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f66e0 msgr2=0x7fcbcc106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:40.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 -- 172.21.15.96:0/4183008957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0005040 con 0x7fcbcc0f7980 2022-02-02T22:20:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbc9d9b700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 secure :-1 s=READY pgs=3659 cs=0 l=1 rev1=1 rx=0x7fcbbc0026d0 tx=0x7fcbbc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbbc009320 con 0x7fcbcc0f7980 2022-02-02T22:20:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcbbc00f040 con 0x7fcbcc0f7980 2022-02-02T22:20:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc1084f0 con 0x7fcbcc0f7980 2022-02-02T22:20:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbbc0147e0 con 0x7fcbcc0f7980 2022-02-02T22:20:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.889+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc108ab0 con 0x7fcbcc0f7980 2022-02-02T22:20:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.890+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc045ad0 con 0x7fcbcc0f7980 2022-02-02T22:20:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.891+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcbbc009480 con 0x7fcbcc0f7980 2022-02-02T22:20:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.891+0000 7fcbbaffd700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 0x7fcbb4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.891+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcbbc082160 con 0x7fcbcc0f7980 2022-02-02T22:20:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.891+0000 7fcbca59c700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 0x7fcbb4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.892+0000 7fcbca59c700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 0x7fcbb4067270 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7fcbc0000c00 tx=0x7fcbc0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:40.895+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcbbc053c90 con 0x7fcbcc0f7980 2022-02-02T22:20:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:40 smithi159 ceph-mon[69013]: pgmap v7156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.068+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbcc108d90 con 0x7fcbb4064db0 2022-02-02T22:20:41.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.078+0000 7fcbbaffd700 1 -- 172.21.15.96:0/4183008957 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcbcc108d90 con 0x7fcbb4064db0 2022-02-02T22:20:41.079 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:20:41.079 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:20:41.079 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:20:41.080 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:20:41.080 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:20:41.080 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:20:41.081 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:20:41.081 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:20:41.081 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:20:41.082 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:20:41.082 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:20:41.083 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:20:41.083 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:20:41.083 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:20:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:20:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:20:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:20:41.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:20:41.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:20:41.085 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:20:41.086 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:20:41.086 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:20:41.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 msgr2=0x7fcbb4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 0x7fcbb4067270 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7fcbc0000c00 tx=0x7fcbc0009b30).stop 2022-02-02T22:20:41.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 msgr2=0x7fcbcc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 secure :-1 s=READY pgs=3659 cs=0 l=1 rev1=1 rx=0x7fcbbc0026d0 tx=0x7fcbbc009de0).stop 2022-02-02T22:20:41.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 shutdown_connections 2022-02-02T22:20:41.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcbb4064db0 0x7fcbb4067270 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0f66e0 0x7fcbcc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 --2- 172.21.15.96:0/4183008957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbcc0f7980 0x7fcbcc107460 unknown :-1 s=CLOSED pgs=3659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.079+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 >> 172.21.15.96:0/4183008957 conn(0x7fcbcc0f1e40 msgr2=0x7fcbcc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:41.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.080+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 shutdown_connections 2022-02-02T22:20:41.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.080+0000 7fcbd0a99700 1 -- 172.21.15.96:0/4183008957 wait complete. 2022-02-02T22:20:41.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 -- 172.21.15.96:0/4105315080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 msgr2=0x7f82080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 --2- 172.21.15.96:0/4105315080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f82080f6b00 secure :-1 s=READY pgs=3660 cs=0 l=1 rev1=1 rx=0x7f81f8004660 tx=0x7f81f8009b30).stop 2022-02-02T22:20:41.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 -- 172.21.15.96:0/4105315080 shutdown_connections 2022-02-02T22:20:41.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 --2- 172.21.15.96:0/4105315080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f82080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 --2- 172.21.15.96:0/4105315080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f82080f6b00 unknown :-1 s=CLOSED pgs=3660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 -- 172.21.15.96:0/4105315080 >> 172.21.15.96:0/4105315080 conn(0x7f82080f1e40 msgr2=0x7f82080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:41.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 -- 172.21.15.96:0/4105315080 shutdown_connections 2022-02-02T22:20:41.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.176+0000 7f820f8d1700 1 -- 172.21.15.96:0/4105315080 wait complete. 2022-02-02T22:20:41.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 Processor -- start 2022-02-02T22:20:41.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 -- start start 2022-02-02T22:20:41.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f820806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820806a380 con 0x7f82080f66e0 2022-02-02T22:20:41.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820f8d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820806a4c0 con 0x7f82080f7980 2022-02-02T22:20:41.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820ce6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820ce6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:52022/0 (socket says 172.21.15.96:52022) 2022-02-02T22:20:41.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.177+0000 7f820ce6c700 1 -- 172.21.15.96:0/3582571259 learned_addr learned my addr 172.21.15.96:0/3582571259 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:41.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820d66d700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f820806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820ce6c700 1 -- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 msgr2=0x7f820806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820ce6c700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f820806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820ce6c700 1 -- 172.21.15.96:0/3582571259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8005040 con 0x7f82080f7980 2022-02-02T22:20:41.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820d66d700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f820806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:20:41.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820ce6c700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f820400e7f0 tx=0x7f820400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:41.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82040092e0 con 0x7f82080f7980 2022-02-02T22:20:41.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820806a7a0 con 0x7f82080f7980 2022-02-02T22:20:41.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f820400f040 con 0x7f82080f7980 2022-02-02T22:20:41.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.178+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8204014750 con 0x7f82080f7980 2022-02-02T22:20:41.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.179+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820810ef90 con 0x7f82080f7980 2022-02-02T22:20:41.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.180+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8208045ad0 con 0x7f82080f7980 2022-02-02T22:20:41.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.180+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f820401b030 con 0x7f82080f7980 2022-02-02T22:20:41.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.180+0000 7f81fdffb700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 0x7f81f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.181+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f82040817d0 con 0x7f82080f7980 2022-02-02T22:20:41.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.181+0000 7f820d66d700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 0x7f81f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.181+0000 7f820d66d700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 0x7f81f4067290 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f81f8000c00 tx=0x7f81f8016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:41.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.185+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f820404f980 con 0x7f82080f7980 2022-02-02T22:20:41.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.416+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8208027a00 con 0x7f82080f7980 2022-02-02T22:20:41.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.416+0000 7f81fdffb700 1 -- 172.21.15.96:0/3582571259 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f82040192e0 con 0x7f82080f7980 2022-02-02T22:20:41.418 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:20:41.418 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:20:41.419 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:20:41.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:41.419 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:20:41.420 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:20:41.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:41.421 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:20:41.421 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:20:41.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:41.422 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:20:41.422 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:20:41.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:20:41.423 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:20:41.423 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:20:41.423 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:20:41.424 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:20:41.424 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:20:41.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 msgr2=0x7f81f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 0x7f81f4067290 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f81f8000c00 tx=0x7f81f8016040).stop 2022-02-02T22:20:41.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 msgr2=0x7f8208069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f820400e7f0 tx=0x7f820400b040).stop 2022-02-02T22:20:41.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 shutdown_connections 2022-02-02T22:20:41.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.418+0000 7f820f8d1700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f81f4064dd0 0x7f81f4067290 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.419+0000 7f820f8d1700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82080f66e0 0x7f820806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.419+0000 7f820f8d1700 1 --2- 172.21.15.96:0/3582571259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82080f7980 0x7f8208069e20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.419+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 >> 172.21.15.96:0/3582571259 conn(0x7f82080f1e40 msgr2=0x7f82080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:41.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.419+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 shutdown_connections 2022-02-02T22:20:41.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.419+0000 7f820f8d1700 1 -- 172.21.15.96:0/3582571259 wait complete. 2022-02-02T22:20:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/1878179114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 msgr2=0x7f7a180f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/1878179114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a180f6920 secure :-1 s=READY pgs=3661 cs=0 l=1 rev1=1 rx=0x7f7a0c004660 tx=0x7f7a0c009b30).stop 2022-02-02T22:20:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/1878179114 shutdown_connections 2022-02-02T22:20:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/1878179114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a180f6920 unknown :-1 s=CLOSED pgs=3661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/1878179114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 0x7f7a180f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/1878179114 >> 172.21.15.96:0/1878179114 conn(0x7f7a180f0de0 msgr2=0x7f7a180f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/1878179114 shutdown_connections 2022-02-02T22:20:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.516+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/1878179114 wait complete. 2022-02-02T22:20:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 Processor -- start 2022-02-02T22:20:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 -- start start 2022-02-02T22:20:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 0x7f7a18105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18106930 con 0x7f7a180f5ef0 2022-02-02T22:20:41.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a1d9dc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18106a70 con 0x7f7a180f55e0 2022-02-02T22:20:41.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47928/0 (socket says 172.21.15.96:47928) 2022-02-02T22:20:41.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a167fc700 1 -- 172.21.15.96:0/515121656 learned_addr learned my addr 172.21.15.96:0/515121656 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:20:41.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.517+0000 7f7a16ffd700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 0x7f7a18105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a167fc700 1 -- 172.21.15.96:0/515121656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 msgr2=0x7f7a18105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a167fc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 0x7f7a18105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a167fc700 1 -- 172.21.15.96:0/515121656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c005040 con 0x7f7a180f5ef0 2022-02-02T22:20:41.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a167fc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 secure :-1 s=READY pgs=3662 cs=0 l=1 rev1=1 rx=0x7f7a0c009990 tx=0x7f7a0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:41.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c018070 con 0x7f7a180f5ef0 2022-02-02T22:20:41.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a0c007ba0 con 0x7f7a180f5ef0 2022-02-02T22:20:41.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a181073b0 con 0x7f7a180f5ef0 2022-02-02T22:20:41.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c01c3c0 con 0x7f7a180f5ef0 2022-02-02T22:20:41.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.518+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a18107910 con 0x7f7a180f5ef0 2022-02-02T22:20:41.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.519+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a18045ad0 con 0x7f7a180f5ef0 2022-02-02T22:20:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.519+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a0c01d420 con 0x7f7a180f5ef0 2022-02-02T22:20:41.531 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.520+0000 7f79ff7fe700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 0x7f7a00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:20:41.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.520+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a0c0836a0 con 0x7f7a180f5ef0 2022-02-02T22:20:41.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.520+0000 7f7a16ffd700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 0x7f7a00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:20:41.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.520+0000 7f7a16ffd700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 0x7f7a00067290 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f7a08004c40 tx=0x7f7a0800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:20:41.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.524+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a0c055290 con 0x7f7a180f5ef0 2022-02-02T22:20:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.724+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7a18027a00 con 0x7f7a180f5ef0 2022-02-02T22:20:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.725+0000 7f79ff7fe700 1 -- 172.21.15.96:0/515121656 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7a0c054e80 con 0x7f7a180f5ef0 2022-02-02T22:20:41.726 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:20:41.727 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:20:41.727 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:20:41.728 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:20:41.728 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:41.728 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:20:41.729 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:20:41.729 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:20:41.729 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:20:41.730 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:20:41.730 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:20:41.730 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:20:41.731 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:20:41.731 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:20:41.731 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:20:41.732 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:20:41.732 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:20:41.732 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:20:41.733 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:20:41.733 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:20:41.733 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:20:41.734 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:20:41.734 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:20:41.734 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:20:41.735 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:20:41.735 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:20:41.735 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:20:41.736 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:20:41.736 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:20:41.736 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:20:41.737 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:20:41.737 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:20:41.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:41.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:41.738 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:20:41.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:20:41.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:41.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:41.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:20:41.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 msgr2=0x7f7a00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 0x7f7a00067290 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f7a08004c40 tx=0x7f7a0800b040).stop 2022-02-02T22:20:41.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 msgr2=0x7f7a18106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:20:41.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 secure :-1 s=READY pgs=3662 cs=0 l=1 rev1=1 rx=0x7f7a0c009990 tx=0x7f7a0c009b30).stop 2022-02-02T22:20:41.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 shutdown_connections 2022-02-02T22:20:41.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a00064dd0 0x7f7a00067290 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a180f55e0 0x7f7a18105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 --2- 172.21.15.96:0/515121656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a180f5ef0 0x7f7a18106380 unknown :-1 s=CLOSED pgs=3662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:20:41.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 >> 172.21.15.96:0/515121656 conn(0x7f7a180f0de0 msgr2=0x7f7a180fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:20:41.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.726+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 shutdown_connections 2022-02-02T22:20:41.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:20:41.727+0000 7f7a1d9dc700 1 -- 172.21.15.96:0/515121656 wait complete. 2022-02-02T22:20:41.744 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:20:41.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:41 smithi096 ceph-mon[101353]: from='client.41432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:41.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3582571259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:20:42.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:41 smithi159 ceph-mon[69013]: from='client.41432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:42.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3582571259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:20:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:42 smithi159 ceph-mon[69013]: pgmap v7157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:42 smithi159 ceph-mon[69013]: from='client.41436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/515121656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:20:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:42 smithi096 ceph-mon[101353]: pgmap v7157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:42 smithi096 ceph-mon[101353]: from='client.41436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:20:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/515121656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:20:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:44 smithi159 ceph-mon[69013]: pgmap v7158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:44 smithi096 ceph-mon[101353]: pgmap v7158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:46 smithi159 ceph-mon[69013]: pgmap v7159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:46 smithi096 ceph-mon[101353]: pgmap v7159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:48 smithi159 ceph-mon[69013]: pgmap v7160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:48 smithi096 ceph-mon[101353]: pgmap v7160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:50 smithi159 ceph-mon[69013]: pgmap v7161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:50 smithi096 ceph-mon[101353]: pgmap v7161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:52 smithi159 ceph-mon[69013]: pgmap v7162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:52 smithi096 ceph-mon[101353]: pgmap v7162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:54 smithi159 ceph-mon[69013]: pgmap v7163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:54 smithi096 ceph-mon[101353]: pgmap v7163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:56 smithi159 ceph-mon[69013]: pgmap v7164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:56 smithi096 ceph-mon[101353]: pgmap v7164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:20:58 smithi159 ceph-mon[69013]: pgmap v7165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:20:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:20:58 smithi096 ceph-mon[101353]: pgmap v7165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:00 smithi159 ceph-mon[69013]: pgmap v7166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:00 smithi096 ceph-mon[101353]: pgmap v7166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:02 smithi159 ceph-mon[69013]: pgmap v7167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:02 smithi096 ceph-mon[101353]: pgmap v7167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:04 smithi159 ceph-mon[69013]: pgmap v7168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:04 smithi096 ceph-mon[101353]: pgmap v7168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:06 smithi159 ceph-mon[69013]: pgmap v7169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:06 smithi096 ceph-mon[101353]: pgmap v7169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:08 smithi159 ceph-mon[69013]: pgmap v7170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:08 smithi096 ceph-mon[101353]: pgmap v7170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:10 smithi159 ceph-mon[69013]: pgmap v7171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:10 smithi096 ceph-mon[101353]: pgmap v7171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 -- 172.21.15.96:0/838568452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 msgr2=0x7f22d40f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:11.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 --2- 172.21.15.96:0/838568452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d40f9300 secure :-1 s=READY pgs=3663 cs=0 l=1 rev1=1 rx=0x7f22c8004660 tx=0x7f22c8009b30).stop 2022-02-02T22:21:11.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 -- 172.21.15.96:0/838568452 shutdown_connections 2022-02-02T22:21:11.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 --2- 172.21.15.96:0/838568452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 0x7f22d40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:11.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 --2- 172.21.15.96:0/838568452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d40f9300 unknown :-1 s=CLOSED pgs=3663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.836+0000 7f22dbb82700 1 -- 172.21.15.96:0/838568452 >> 172.21.15.96:0/838568452 conn(0x7f22d40f0d40 msgr2=0x7f22d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.837+0000 7f22dbb82700 1 -- 172.21.15.96:0/838568452 shutdown_connections 2022-02-02T22:21:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.837+0000 7f22dbb82700 1 -- 172.21.15.96:0/838568452 wait complete. 2022-02-02T22:21:11.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.837+0000 7f22dbb82700 1 Processor -- start 2022-02-02T22:21:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.837+0000 7f22dbb82700 1 -- start start 2022-02-02T22:21:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22dbb82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22dbb82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 0x7f22d4107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22dbb82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41079c0 con 0x7f22d40602b0 2022-02-02T22:21:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22dbb82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4107b00 con 0x7f22d40f9880 2022-02-02T22:21:11.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:11.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47944/0 (socket says 172.21.15.96:47944) 2022-02-02T22:21:11.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 -- 172.21.15.96:0/1766129913 learned_addr learned my addr 172.21.15.96:0/1766129913 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:11.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d911d700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 0x7f22d4107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:11.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 -- 172.21.15.96:0/1766129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 msgr2=0x7f22d4107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:11.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 0x7f22d4107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 -- 172.21.15.96:0/1766129913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8005040 con 0x7f22d40602b0 2022-02-02T22:21:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22d991e700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 secure :-1 s=READY pgs=3664 cs=0 l=1 rev1=1 rx=0x7f22c8009990 tx=0x7f22c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.838+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c8018070 con 0x7f22d40602b0 2022-02-02T22:21:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.839+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22c8007ba0 con 0x7f22d40602b0 2022-02-02T22:21:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.839+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c801c3c0 con 0x7f22d40602b0 2022-02-02T22:21:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.839+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d4108440 con 0x7f22d40602b0 2022-02-02T22:21:11.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.839+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d41089a0 con 0x7f22d40602b0 2022-02-02T22:21:11.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.839+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d4045ad0 con 0x7f22d40602b0 2022-02-02T22:21:11.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.840+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22c801d420 con 0x7f22d40602b0 2022-02-02T22:21:11.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.840+0000 7f22c67fc700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 0x7f22c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:11.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.841+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f22c80836a0 con 0x7f22d40602b0 2022-02-02T22:21:11.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.841+0000 7f22d911d700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 0x7f22c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:11.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.841+0000 7f22d911d700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 0x7f22c0067290 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f22d4060080 tx=0x7f22d000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:11.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:11.845+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22c8055290 con 0x7f22d40602b0 2022-02-02T22:21:12.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.024+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22d4108bc0 con 0x7f22c0064dd0 2022-02-02T22:21:12.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.025+0000 7f22c67fc700 1 -- 172.21.15.96:0/1766129913 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f22d4108bc0 con 0x7f22c0064dd0 2022-02-02T22:21:12.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 msgr2=0x7f22c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 0x7f22c0067290 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f22d4060080 tx=0x7f22d000b040).stop 2022-02-02T22:21:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 msgr2=0x7f22d4106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 secure :-1 s=READY pgs=3664 cs=0 l=1 rev1=1 rx=0x7f22c8009990 tx=0x7f22c8009b30).stop 2022-02-02T22:21:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 shutdown_connections 2022-02-02T22:21:12.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f22c0064dd0 0x7f22c0067290 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22d40602b0 0x7f22d4106f20 unknown :-1 s=CLOSED pgs=3664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 --2- 172.21.15.96:0/1766129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22d40f9880 0x7f22d4107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 >> 172.21.15.96:0/1766129913 conn(0x7f22d40f0d40 msgr2=0x7f22d40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 shutdown_connections 2022-02-02T22:21:12.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.027+0000 7f22dbb82700 1 -- 172.21.15.96:0/1766129913 wait complete. 2022-02-02T22:21:12.038 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:21:12.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.124+0000 7f7e314eb700 1 -- 172.21.15.96:0/4076131930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f6550 msgr2=0x7f7e2c0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.124+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4076131930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c0f69b0 secure :-1 s=READY pgs=3665 cs=0 l=1 rev1=1 rx=0x7f7e1c004660 tx=0x7f7e1c009b30).stop 2022-02-02T22:21:12.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 -- 172.21.15.96:0/4076131930 shutdown_connections 2022-02-02T22:21:12.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4076131930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c0f69b0 unknown :-1 s=CLOSED pgs=3665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4076131930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c0f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 -- 172.21.15.96:0/4076131930 >> 172.21.15.96:0/4076131930 conn(0x7f7e2c0f04c0 msgr2=0x7f7e2c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 -- 172.21.15.96:0/4076131930 shutdown_connections 2022-02-02T22:21:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 -- 172.21.15.96:0/4076131930 wait complete. 2022-02-02T22:21:12.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 Processor -- start 2022-02-02T22:21:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 -- start start 2022-02-02T22:21:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.125+0000 7f7e314eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e314eb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e314eb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c069810 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e314eb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c10fa40 con 0x7f7e2c0f6550 2022-02-02T22:21:12.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47952/0 (socket says 172.21.15.96:47952) 2022-02-02T22:21:12.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 -- 172.21.15.96:0/4175272724 learned_addr learned my addr 172.21.15.96:0/4175272724 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:12.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2a7fc700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 -- 172.21.15.96:0/4175272724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 msgr2=0x7f7e2c069210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c069210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 -- 172.21.15.96:0/4175272724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c005040 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2a7fc700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c069210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:21:12.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e2affd700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 secure :-1 s=READY pgs=3666 cs=0 l=1 rev1=1 rx=0x7f7e20002700 tx=0x7f7e20009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e20009320 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e2000f040 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.126+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c10fd20 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.127+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e20014900 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.127+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c1102e0 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.128+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e20009480 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.128+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c0f4150 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.128+0000 7f7e137fe700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 0x7f7e14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.128+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7e20081cc0 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.128+0000 7f7e2a7fc700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 0x7f7e14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.129+0000 7f7e2a7fc700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 0x7f7e14067290 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7e1c009da0 tx=0x7f7e1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.133+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e200538b0 con 0x7f7e2c0f5bb0 2022-02-02T22:21:12.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.305+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e2c0fde60 con 0x7f7e14064dd0 2022-02-02T22:21:12.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.314+0000 7f7e137fe700 1 -- 172.21.15.96:0/4175272724 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7e2c0fde60 con 0x7f7e14064dd0 2022-02-02T22:21:12.315 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:21:12.316 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:21:12.316 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:21:12.316 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:21:12.317 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:21:12.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:21:12.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:21:12.318 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:21:12.318 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:21:12.318 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:21:12.319 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:21:12.319 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:21:12.320 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:21:12.320 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:21:12.320 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:21:12.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:21:12.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:21:12.321 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:21:12.322 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:21:12.322 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:21:12.323 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:21:12.323 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:21:12.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 msgr2=0x7f7e14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 0x7f7e14067290 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7e1c009da0 tx=0x7f7e1c009b30).stop 2022-02-02T22:21:12.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 msgr2=0x7f7e2c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 secure :-1 s=READY pgs=3666 cs=0 l=1 rev1=1 rx=0x7f7e20002700 tx=0x7f7e20009d80).stop 2022-02-02T22:21:12.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 shutdown_connections 2022-02-02T22:21:12.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e14064dd0 0x7f7e14067290 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2c0f5bb0 0x7f7e2c068d20 unknown :-1 s=CLOSED pgs=3666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 --2- 172.21.15.96:0/4175272724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e2c0f6550 0x7f7e2c069210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 >> 172.21.15.96:0/4175272724 conn(0x7f7e2c0f04c0 msgr2=0x7f7e2c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 shutdown_connections 2022-02-02T22:21:12.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.316+0000 7f7e314eb700 1 -- 172.21.15.96:0/4175272724 wait complete. 2022-02-02T22:21:12.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- 172.21.15.96:0/2083018051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 msgr2=0x7f94cc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 --2- 172.21.15.96:0/2083018051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc0f59e0 secure :-1 s=READY pgs=3667 cs=0 l=1 rev1=1 rx=0x7f94bc004660 tx=0x7f94bc009b30).stop 2022-02-02T22:21:12.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- 172.21.15.96:0/2083018051 shutdown_connections 2022-02-02T22:21:12.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 --2- 172.21.15.96:0/2083018051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 --2- 172.21.15.96:0/2083018051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc0f59e0 unknown :-1 s=CLOSED pgs=3667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- 172.21.15.96:0/2083018051 >> 172.21.15.96:0/2083018051 conn(0x7f94cc0f0d40 msgr2=0x7f94cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- 172.21.15.96:0/2083018051 shutdown_connections 2022-02-02T22:21:12.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- 172.21.15.96:0/2083018051 wait complete. 2022-02-02T22:21:12.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 Processor -- start 2022-02-02T22:21:12.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- start start 2022-02-02T22:21:12.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc109c00 con 0x7f94cc0f55c0 2022-02-02T22:21:12.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.414+0000 7f94d43be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc109d40 con 0x7f94cc0f6860 2022-02-02T22:21:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47962/0 (socket says 172.21.15.96:47962) 2022-02-02T22:21:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 -- 172.21.15.96:0/638037138 learned_addr learned my addr 172.21.15.96:0/638037138 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:12.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d1959700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 -- 172.21.15.96:0/638037138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 msgr2=0x7f94cc109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 -- 172.21.15.96:0/638037138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc005040 con 0x7f94cc0f55c0 2022-02-02T22:21:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d1959700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:21:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d215a700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 secure :-1 s=READY pgs=3668 cs=0 l=1 rev1=1 rx=0x7f94bc004f60 tx=0x7f94bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc018070 con 0x7f94cc0f55c0 2022-02-02T22:21:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94bc007ba0 con 0x7f94cc0f55c0 2022-02-02T22:21:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc10a680 con 0x7f94cc0f55c0 2022-02-02T22:21:12.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc01c620 con 0x7f94cc0f55c0 2022-02-02T22:21:12.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.415+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc10abe0 con 0x7f94cc0f55c0 2022-02-02T22:21:12.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.416+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc045ad0 con 0x7f94cc0f55c0 2022-02-02T22:21:12.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.417+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f94bc01c8e0 con 0x7f94cc0f55c0 2022-02-02T22:21:12.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.417+0000 7f94c2ffd700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.417+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f94bc083940 con 0x7f94cc0f55c0 2022-02-02T22:21:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.417+0000 7f94d1959700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.418+0000 7f94d1959700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f94c80041d0 tx=0x7f94c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.421+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f94bc055470 con 0x7f94cc0f55c0 2022-02-02T22:21:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.651+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94cc10b360 con 0x7f94cc0f55c0 2022-02-02T22:21:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.651+0000 7f94c2ffd700 1 -- 172.21.15.96:0/638037138 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f94bc055060 con 0x7f94cc0f55c0 2022-02-02T22:21:12.653 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:21:12.653 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:21:12.654 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:21:12.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:12.654 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:21:12.655 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:21:12.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:12.656 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:21:12.656 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:21:12.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:12.657 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:21:12.657 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:21:12.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:12.658 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:21:12.658 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:21:12.658 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:21:12.659 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:21:12.659 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:21:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 msgr2=0x7f94b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f94c80041d0 tx=0x7f94c8009040).stop 2022-02-02T22:21:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 msgr2=0x7f94cc109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 secure :-1 s=READY pgs=3668 cs=0 l=1 rev1=1 rx=0x7f94bc004f60 tx=0x7f94bc009b30).stop 2022-02-02T22:21:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 shutdown_connections 2022-02-02T22:21:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f94b8064dd0 0x7f94b8067290 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94cc0f55c0 0x7f94cc109160 unknown :-1 s=CLOSED pgs=3668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 --2- 172.21.15.96:0/638037138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94cc0f6860 0x7f94cc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 >> 172.21.15.96:0/638037138 conn(0x7f94cc0f0d40 msgr2=0x7f94cc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 shutdown_connections 2022-02-02T22:21:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.653+0000 7f94d43be700 1 -- 172.21.15.96:0/638037138 wait complete. 2022-02-02T22:21:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 -- 172.21.15.96:0/1563447665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 msgr2=0x7f77e00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 --2- 172.21.15.96:0/1563447665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e00f5850 secure :-1 s=READY pgs=3669 cs=0 l=1 rev1=1 rx=0x7f77d0004660 tx=0x7f77d0009b30).stop 2022-02-02T22:21:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 -- 172.21.15.96:0/1563447665 shutdown_connections 2022-02-02T22:21:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 --2- 172.21.15.96:0/1563447665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 --2- 172.21.15.96:0/1563447665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e00f5850 unknown :-1 s=CLOSED pgs=3669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 -- 172.21.15.96:0/1563447665 >> 172.21.15.96:0/1563447665 conn(0x7f77e00f0b90 msgr2=0x7f77e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 -- 172.21.15.96:0/1563447665 shutdown_connections 2022-02-02T22:21:12.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.751+0000 7f77df59e700 1 -- 172.21.15.96:0/1563447665 wait complete. 2022-02-02T22:21:12.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 Processor -- start 2022-02-02T22:21:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 -- start start 2022-02-02T22:21:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00603e0 con 0x7f77e00f5430 2022-02-02T22:21:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77df59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0060520 con 0x7f77e00f66d0 2022-02-02T22:21:12.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47970/0 (socket says 172.21.15.96:47970) 2022-02-02T22:21:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.752+0000 7f77de59c700 1 -- 172.21.15.96:0/2343643729 learned_addr learned my addr 172.21.15.96:0/2343643729 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77ddd9b700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77de59c700 1 -- 172.21.15.96:0/2343643729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 msgr2=0x7f77e010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77de59c700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e010bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77de59c700 1 -- 172.21.15.96:0/2343643729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0005040 con 0x7f77e00f5430 2022-02-02T22:21:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77ddd9b700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:21:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77de59c700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 secure :-1 s=READY pgs=3670 cs=0 l=1 rev1=1 rx=0x7f77d0004f60 tx=0x7f77d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d0018070 con 0x7f77e00f5430 2022-02-02T22:21:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77d0007ba0 con 0x7f77e00f5430 2022-02-02T22:21:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d001c620 con 0x7f77e00f5430 2022-02-02T22:21:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e010c4e0 con 0x7f77e00f5430 2022-02-02T22:21:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.753+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e010ca40 con 0x7f77e00f5430 2022-02-02T22:21:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.754+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0045ad0 con 0x7f77e00f5430 2022-02-02T22:21:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.754+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77d001d420 con 0x7f77e00f5430 2022-02-02T22:21:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.755+0000 7f77d6ffd700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 0x7f77cc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:12.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.755+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77d00838a0 con 0x7f77e00f5430 2022-02-02T22:21:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.755+0000 7f77ddd9b700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 0x7f77cc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:12.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.755+0000 7f77ddd9b700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 0x7f77cc0672e0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7f77c8004a70 tx=0x7f77c8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:12.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.759+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77d00519a0 con 0x7f77e00f5430 2022-02-02T22:21:12.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.960+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77e00fdc90 con 0x7f77e00f5430 2022-02-02T22:21:12.962 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:12 smithi096 ceph-mon[101353]: pgmap v7172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:12.962 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/638037138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:21:12.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.961+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2343643729 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f77d0054fc0 con 0x7f77e00f5430 2022-02-02T22:21:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:21:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:21:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:21:12.965 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:21:12.965 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:12.966 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:21:12.966 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:21:12.967 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:21:12.967 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:21:12.967 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:21:12.968 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:21:12.968 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:21:12.968 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:21:12.969 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:21:12.969 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:21:12.969 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:21:12.970 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:21:12.970 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:21:12.971 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:21:12.971 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:21:12.971 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:21:12.972 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:21:12.972 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:21:12.973 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:21:12.973 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:21:12.973 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:21:12.974 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:21:12.974 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:21:12.974 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:21:12.975 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:21:12.975 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:21:12.975 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:21:12.976 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:12.976 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:12.977 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:21:12.977 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:12.977 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:12.978 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:12.978 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:12.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 msgr2=0x7f77cc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 0x7f77cc0672e0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7f77c8004a70 tx=0x7f77c8009040).stop 2022-02-02T22:21:12.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 msgr2=0x7f77e0109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:12.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 secure :-1 s=READY pgs=3670 cs=0 l=1 rev1=1 rx=0x7f77d0004f60 tx=0x7f77d0009b30).stop 2022-02-02T22:21:12.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 shutdown_connections 2022-02-02T22:21:12.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77cc064e20 0x7f77cc0672e0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00f5430 0x7f77e0109a90 unknown :-1 s=CLOSED pgs=3670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 --2- 172.21.15.96:0/2343643729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e00f66d0 0x7f77e010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:12.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 >> 172.21.15.96:0/2343643729 conn(0x7f77e00f0b90 msgr2=0x7f77e00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:12.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 shutdown_connections 2022-02-02T22:21:12.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:12.964+0000 7f77df59e700 1 -- 172.21.15.96:0/2343643729 wait complete. 2022-02-02T22:21:12.983 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:21:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:12 smithi159 ceph-mon[69013]: pgmap v7172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/638037138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:21:13.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:13 smithi159 ceph-mon[69013]: from='client.41448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:13 smithi159 ceph-mon[69013]: from='client.41452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:13.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2343643729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:21:14.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:13 smithi096 ceph-mon[101353]: from='client.41448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:14.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:13 smithi096 ceph-mon[101353]: from='client.41452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:14.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2343643729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:21:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:14 smithi159 ceph-mon[69013]: pgmap v7173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:14 smithi096 ceph-mon[101353]: pgmap v7173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:16 smithi159 ceph-mon[69013]: pgmap v7174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:16 smithi096 ceph-mon[101353]: pgmap v7174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:18 smithi159 ceph-mon[69013]: pgmap v7175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:18 smithi096 ceph-mon[101353]: pgmap v7175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:20 smithi159 ceph-mon[69013]: pgmap v7176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:20 smithi096 ceph-mon[101353]: pgmap v7176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:22 smithi159 ceph-mon[69013]: pgmap v7177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:22 smithi096 ceph-mon[101353]: pgmap v7177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:24 smithi159 ceph-mon[69013]: pgmap v7178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:24 smithi096 ceph-mon[101353]: pgmap v7178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:26 smithi159 ceph-mon[69013]: pgmap v7179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:26 smithi096 ceph-mon[101353]: pgmap v7179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:28 smithi159 ceph-mon[69013]: pgmap v7180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:21:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:21:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:28 smithi096 ceph-mon[101353]: pgmap v7180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:21:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:21:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:30 smithi159 ceph-mon[69013]: pgmap v7181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:30 smithi096 ceph-mon[101353]: pgmap v7181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:32 smithi159 ceph-mon[69013]: pgmap v7182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:32 smithi096 ceph-mon[101353]: pgmap v7182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:34 smithi159 ceph-mon[69013]: pgmap v7183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:34 smithi096 ceph-mon[101353]: pgmap v7183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:36 smithi159 ceph-mon[69013]: pgmap v7184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:36 smithi096 ceph-mon[101353]: pgmap v7184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:38 smithi159 ceph-mon[69013]: pgmap v7185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:38 smithi096 ceph-mon[101353]: pgmap v7185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:40 smithi159 ceph-mon[69013]: pgmap v7186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:40 smithi096 ceph-mon[101353]: pgmap v7186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:42 smithi159 ceph-mon[69013]: pgmap v7187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:42 smithi096 ceph-mon[101353]: pgmap v7187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:43.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 -- 172.21.15.96:0/1359554244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7970 msgr2=0x7f0a4c0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 --2- 172.21.15.96:0/1359554244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c0f7dd0 secure :-1 s=READY pgs=3671 cs=0 l=1 rev1=1 rx=0x7f0a48004660 tx=0x7f0a48009b30).stop 2022-02-02T22:21:43.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 -- 172.21.15.96:0/1359554244 shutdown_connections 2022-02-02T22:21:43.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 --2- 172.21.15.96:0/1359554244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c0f7dd0 unknown :-1 s=CLOSED pgs=3671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 --2- 172.21.15.96:0/1359554244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 -- 172.21.15.96:0/1359554244 >> 172.21.15.96:0/1359554244 conn(0x7f0a4c0f1e10 msgr2=0x7f0a4c0f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 -- 172.21.15.96:0/1359554244 shutdown_connections 2022-02-02T22:21:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 -- 172.21.15.96:0/1359554244 wait complete. 2022-02-02T22:21:43.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.076+0000 7f0a53f46700 1 Processor -- start 2022-02-02T22:21:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a53f46700 1 -- start start 2022-02-02T22:21:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a53f46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a53f46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a53f46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c06a380 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a53f46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c06a4c0 con 0x7f0a4c0f7970 2022-02-02T22:21:43.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47986/0 (socket says 172.21.15.96:47986) 2022-02-02T22:21:43.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 -- 172.21.15.96:0/146102289 learned_addr learned my addr 172.21.15.96:0/146102289 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:43.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a514e1700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 -- 172.21.15.96:0/146102289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7970 msgr2=0x7f0a4c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 -- 172.21.15.96:0/146102289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48005040 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.077+0000 7f0a51ce2700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 secure :-1 s=READY pgs=3672 cs=0 l=1 rev1=1 rx=0x7f0a3c00c530 tx=0x7f0a3c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.078+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3c00f650 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.078+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c06a7a0 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.078+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a3c00fc60 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.078+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3c012cb0 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.078+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c10ef80 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.079+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c045ad0 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.079+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a3c019030 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.079+0000 7f0a427fc700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 0x7f0a38067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.080+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a3c081630 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.080+0000 7f0a514e1700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 0x7f0a38067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.080+0000 7f0a514e1700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 0x7f0a38067290 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f0a48004630 tx=0x7f0a48009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.084+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a3c04f7e0 con 0x7f0a4c0f66d0 2022-02-02T22:21:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.265+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a4c0fefd0 con 0x7f0a38064dd0 2022-02-02T22:21:43.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.266+0000 7f0a427fc700 1 -- 172.21.15.96:0/146102289 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a4c0fefd0 con 0x7f0a38064dd0 2022-02-02T22:21:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 msgr2=0x7f0a38067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 0x7f0a38067290 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f0a48004630 tx=0x7f0a48009b30).stop 2022-02-02T22:21:43.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 msgr2=0x7f0a4c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 secure :-1 s=READY pgs=3672 cs=0 l=1 rev1=1 rx=0x7f0a3c00c530 tx=0x7f0a3c007e10).stop 2022-02-02T22:21:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 shutdown_connections 2022-02-02T22:21:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a38064dd0 0x7f0a38067290 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a4c0f66d0 0x7f0a4c06b9a0 unknown :-1 s=CLOSED pgs=3672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 --2- 172.21.15.96:0/146102289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a4c0f7970 0x7f0a4c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 >> 172.21.15.96:0/146102289 conn(0x7f0a4c0f1e10 msgr2=0x7f0a4c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 shutdown_connections 2022-02-02T22:21:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.268+0000 7f0a53f46700 1 -- 172.21.15.96:0/146102289 wait complete. 2022-02-02T22:21:43.278 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:21:43.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 -- 172.21.15.96:0/2177014490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 msgr2=0x7fdbac0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 --2- 172.21.15.96:0/2177014490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac0f6b30 secure :-1 s=READY pgs=3673 cs=0 l=1 rev1=1 rx=0x7fdba0004660 tx=0x7fdba0009b30).stop 2022-02-02T22:21:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 -- 172.21.15.96:0/2177014490 shutdown_connections 2022-02-02T22:21:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 --2- 172.21.15.96:0/2177014490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac0f6b30 unknown :-1 s=CLOSED pgs=3673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 --2- 172.21.15.96:0/2177014490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 0x7fdbac0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.366+0000 7fdbabfff700 1 -- 172.21.15.96:0/2177014490 >> 172.21.15.96:0/2177014490 conn(0x7fdbac0f0b90 msgr2=0x7fdbac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.367+0000 7fdbabfff700 1 -- 172.21.15.96:0/2177014490 shutdown_connections 2022-02-02T22:21:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.367+0000 7fdbabfff700 1 -- 172.21.15.96:0/2177014490 wait complete. 2022-02-02T22:21:43.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.367+0000 7fdbabfff700 1 Processor -- start 2022-02-02T22:21:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.367+0000 7fdbabfff700 1 -- start start 2022-02-02T22:21:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 0x7fdbac109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbabfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0603c0 con 0x7fdbac0f66d0 2022-02-02T22:21:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbabfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac060500 con 0x7fdbac0f5430 2022-02-02T22:21:43.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47998/0 (socket says 172.21.15.96:47998) 2022-02-02T22:21:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 -- 172.21.15.96:0/1826367607 learned_addr learned my addr 172.21.15.96:0/1826367607 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:43.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaaffd700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 0x7fdbac109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 -- 172.21.15.96:0/1826367607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 msgr2=0x7fdbac109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 0x7fdbac109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 -- 172.21.15.96:0/1826367607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdbac0f66d0 2022-02-02T22:21:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.368+0000 7fdbaa7fc700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 secure :-1 s=READY pgs=3674 cs=0 l=1 rev1=1 rx=0x7fdba0009990 tx=0x7fdba0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.369+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba0018070 con 0x7fdbac0f66d0 2022-02-02T22:21:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.369+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac10c490 con 0x7fdbac0f66d0 2022-02-02T22:21:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.369+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdba0007ba0 con 0x7fdbac0f66d0 2022-02-02T22:21:43.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.369+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba001c3c0 con 0x7fdbac0f66d0 2022-02-02T22:21:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.369+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac10c9c0 con 0x7fdbac0f66d0 2022-02-02T22:21:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.370+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac059100 con 0x7fdbac0f66d0 2022-02-02T22:21:43.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.370+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdba001d420 con 0x7fdbac0f66d0 2022-02-02T22:21:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.370+0000 7fdb937fe700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 0x7fdb940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.370+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdba00836a0 con 0x7fdbac0f66d0 2022-02-02T22:21:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.370+0000 7fdbaaffd700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 0x7fdb940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.371+0000 7fdbaaffd700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 0x7fdb940672e0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7fdbac060040 tx=0x7fdb9c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.375+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdba0051860 con 0x7fdbac0f66d0 2022-02-02T22:21:43.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.548+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbac0fdd70 con 0x7fdb94064e20 2022-02-02T22:21:43.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.557+0000 7fdb937fe700 1 -- 172.21.15.96:0/1826367607 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdbac0fdd70 con 0x7fdb94064e20 2022-02-02T22:21:43.557 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:21:43.558 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:21:43.558 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:21:43.558 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:21:43.559 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:21:43.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:21:43.559 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:21:43.560 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:21:43.560 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:21:43.560 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:21:43.561 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:21:43.561 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:21:43.562 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:21:43.562 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:21:43.562 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:21:43.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:21:43.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:21:43.563 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:21:43.564 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:21:43.564 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:21:43.564 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:21:43.565 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:21:43.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 msgr2=0x7fdb940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 0x7fdb940672e0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7fdbac060040 tx=0x7fdb9c00b040).stop 2022-02-02T22:21:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 msgr2=0x7fdbac10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 secure :-1 s=READY pgs=3674 cs=0 l=1 rev1=1 rx=0x7fdba0009990 tx=0x7fdba0009b30).stop 2022-02-02T22:21:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 shutdown_connections 2022-02-02T22:21:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdb94064e20 0x7fdb940672e0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0f5430 0x7fdbac109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 --2- 172.21.15.96:0/1826367607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbac0f66d0 0x7fdbac10bf40 unknown :-1 s=CLOSED pgs=3674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 >> 172.21.15.96:0/1826367607 conn(0x7fdbac0f0b90 msgr2=0x7fdbac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 shutdown_connections 2022-02-02T22:21:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.559+0000 7fdbabfff700 1 -- 172.21.15.96:0/1826367607 wait complete. 2022-02-02T22:21:43.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 -- 172.21.15.96:0/4144464112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f6810 msgr2=0x7f28500f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 --2- 172.21.15.96:0/4144464112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f6810 0x7f28500f6c70 secure :-1 s=READY pgs=3675 cs=0 l=1 rev1=1 rx=0x7f2844004660 tx=0x7f2844009b30).stop 2022-02-02T22:21:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 -- 172.21.15.96:0/4144464112 shutdown_connections 2022-02-02T22:21:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 --2- 172.21.15.96:0/4144464112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f6810 0x7f28500f6c70 unknown :-1 s=CLOSED pgs=3675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 --2- 172.21.15.96:0/4144464112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f5570 0x7f28500f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 -- 172.21.15.96:0/4144464112 >> 172.21.15.96:0/4144464112 conn(0x7f28500f0cd0 msgr2=0x7f28500f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 -- 172.21.15.96:0/4144464112 shutdown_connections 2022-02-02T22:21:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.655+0000 7f2855a9c700 1 -- 172.21.15.96:0/4144464112 wait complete. 2022-02-02T22:21:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 Processor -- start 2022-02-02T22:21:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 -- start start 2022-02-02T22:21:43.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f6810 0x7f2850106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850106920 con 0x7f28500f5570 2022-02-02T22:21:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f2855a9c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850107130 con 0x7f28500f6810 2022-02-02T22:21:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48006/0 (socket says 172.21.15.96:48006) 2022-02-02T22:21:43.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f284f7fe700 1 -- 172.21.15.96:0/3020857322 learned_addr learned my addr 172.21.15.96:0/3020857322 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:43.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.656+0000 7f284effd700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f6810 0x7f2850106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f284f7fe700 1 -- 172.21.15.96:0/3020857322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f6810 msgr2=0x7f2850106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f284f7fe700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f6810 0x7f2850106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f284f7fe700 1 -- 172.21.15.96:0/3020857322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844005040 con 0x7f28500f5570 2022-02-02T22:21:43.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f284f7fe700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 secure :-1 s=READY pgs=3676 cs=0 l=1 rev1=1 rx=0x7f284000f910 tx=0x7f2840009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2840009500 con 0x7f28500f5570 2022-02-02T22:21:43.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2840009660 con 0x7f28500f5570 2022-02-02T22:21:43.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284000dd30 con 0x7f28500f5570 2022-02-02T22:21:43.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2850107350 con 0x7f28500f5570 2022-02-02T22:21:43.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.657+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501078e0 con 0x7f28500f5570 2022-02-02T22:21:43.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.658+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28500f4960 con 0x7f28500f5570 2022-02-02T22:21:43.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.659+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f284000e040 con 0x7f28500f5570 2022-02-02T22:21:43.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.659+0000 7f2837fff700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 0x7f28380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:43.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.659+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2840084090 con 0x7f28500f5570 2022-02-02T22:21:43.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.659+0000 7f284effd700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 0x7f28380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:43.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.659+0000 7f284effd700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 0x7f28380672e0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f2844004e30 tx=0x7f2844009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:43.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.663+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2840052190 con 0x7f28500f5570 2022-02-02T22:21:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.894+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2850045b50 con 0x7f28500f5570 2022-02-02T22:21:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.894+0000 7f2837fff700 1 -- 172.21.15.96:0/3020857322 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2850045b50 con 0x7f28500f5570 2022-02-02T22:21:43.895 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:21:43.895 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:21:43.896 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:21:43.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:43.896 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:21:43.897 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:21:43.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:43.897 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:21:43.898 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:21:43.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:43.898 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:21:43.899 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:21:43.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:21:43.899 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:21:43.900 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:21:43.900 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:21:43.900 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:21:43.901 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:21:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 msgr2=0x7f28380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 0x7f28380672e0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f2844004e30 tx=0x7f2844009b30).stop 2022-02-02T22:21:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 msgr2=0x7f2850105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 secure :-1 s=READY pgs=3676 cs=0 l=1 rev1=1 rx=0x7f284000f910 tx=0x7f2840009d80).stop 2022-02-02T22:21:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 shutdown_connections 2022-02-02T22:21:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2838064e20 0x7f28380672e0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28500f5570 0x7f2850105e30 unknown :-1 s=CLOSED pgs=3676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 --2- 172.21.15.96:0/3020857322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28500f6810 0x7f2850106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.896+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 >> 172.21.15.96:0/3020857322 conn(0x7f28500f0cd0 msgr2=0x7f28500fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.897+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 shutdown_connections 2022-02-02T22:21:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.897+0000 7f2855a9c700 1 -- 172.21.15.96:0/3020857322 wait complete. 2022-02-02T22:21:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.993+0000 7f121ee84700 1 -- 172.21.15.96:0/675887289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f66e0 msgr2=0x7f12180f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:43.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.993+0000 7f121ee84700 1 --2- 172.21.15.96:0/675887289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f66e0 0x7f12180f6b00 secure :-1 s=READY pgs=3677 cs=0 l=1 rev1=1 rx=0x7f120c004660 tx=0x7f120c009b30).stop 2022-02-02T22:21:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 -- 172.21.15.96:0/675887289 shutdown_connections 2022-02-02T22:21:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 --2- 172.21.15.96:0/675887289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180f7980 0x7f12180f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 --2- 172.21.15.96:0/675887289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f66e0 0x7f12180f6b00 unknown :-1 s=CLOSED pgs=3677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 -- 172.21.15.96:0/675887289 >> 172.21.15.96:0/675887289 conn(0x7f12180f1e40 msgr2=0x7f12180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 -- 172.21.15.96:0/675887289 shutdown_connections 2022-02-02T22:21:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 -- 172.21.15.96:0/675887289 wait complete. 2022-02-02T22:21:43.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 Processor -- start 2022-02-02T22:21:43.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.994+0000 7f121ee84700 1 -- start start 2022-02-02T22:21:43.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f121ee84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180f66e0 0x7f121806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f121ee84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f121ee84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121806a380 con 0x7f12180f7980 2022-02-02T22:21:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f121ee84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121806a4c0 con 0x7f12180f66e0 2022-02-02T22:21:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48016/0 (socket says 172.21.15.96:48016) 2022-02-02T22:21:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 -- 172.21.15.96:0/3088710069 learned_addr learned my addr 172.21.15.96:0/3088710069 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:21:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 -- 172.21.15.96:0/3088710069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180f66e0 msgr2=0x7f121806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180f66e0 0x7f121806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:21:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 -- 172.21.15.96:0/3088710069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c005040 con 0x7f12180f7980 2022-02-02T22:21:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f1217fff700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 secure :-1 s=READY pgs=3678 cs=0 l=1 rev1=1 rx=0x7f12040026d0 tx=0x7f1204009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1204009320 con 0x7f12180f7980 2022-02-02T22:21:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.996+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f120400f040 con 0x7f12180f7980 2022-02-02T22:21:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.995+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121806a7a0 con 0x7f12180f7980 2022-02-02T22:21:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.996+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12040147a0 con 0x7f12180f7980 2022-02-02T22:21:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.996+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121810efe0 con 0x7f12180f7980 2022-02-02T22:21:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.997+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1218045ad0 con 0x7f12180f7980 2022-02-02T22:21:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.997+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1204009480 con 0x7f12180f7980 2022-02-02T22:21:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.997+0000 7f12157fa700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 0x7f1208067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:21:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.998+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1204082130 con 0x7f12180f7980 2022-02-02T22:21:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.998+0000 7f121cc20700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 0x7f1208067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:21:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:43.998+0000 7f121cc20700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 0x7f1208067290 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f120c004e30 tx=0x7f120c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:21:44.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.002+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1204050230 con 0x7f12180f7980 2022-02-02T22:21:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.203+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12180fefe0 con 0x7f12180f7980 2022-02-02T22:21:44.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.203+0000 7f12157fa700 1 -- 172.21.15.96:0/3088710069 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1204053850 con 0x7f12180f7980 2022-02-02T22:21:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:21:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:21:44.205 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:21:44.205 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:21:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:44.206 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:21:44.206 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:21:44.206 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:21:44.207 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:21:44.207 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:21:44.207 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:21:44.208 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:21:44.208 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:21:44.208 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:21:44.209 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:21:44.209 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:21:44.209 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:21:44.210 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:21:44.210 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:21:44.210 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:21:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:21:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:21:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:21:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:21:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:21:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:21:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:21:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:21:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:21:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:21:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:21:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:21:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:21:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:21:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:44.217 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:21:44.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 msgr2=0x7f1208067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:44.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 0x7f1208067290 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f120c004e30 tx=0x7f120c009b30).stop 2022-02-02T22:21:44.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 msgr2=0x7f1218069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:21:44.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 secure :-1 s=READY pgs=3678 cs=0 l=1 rev1=1 rx=0x7f12040026d0 tx=0x7f1204009de0).stop 2022-02-02T22:21:44.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 shutdown_connections 2022-02-02T22:21:44.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1208064dd0 0x7f1208067290 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:44.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180f66e0 0x7f121806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:21:44.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 --2- 172.21.15.96:0/3088710069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12180f7980 0x7f1218069e20 unknown :-1 s=CLOSED pgs=3678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:21:44.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 >> 172.21.15.96:0/3088710069 conn(0x7f12180f1e40 msgr2=0x7f12180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:21:44.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 shutdown_connections 2022-02-02T22:21:44.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:21:44.205+0000 7f121ee84700 1 -- 172.21.15.96:0/3088710069 wait complete. 2022-02-02T22:21:44.222 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:21:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:44 smithi159 ceph-mon[69013]: pgmap v7188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:44 smithi159 ceph-mon[69013]: from='client.41464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:44 smithi159 ceph-mon[69013]: from='client.41468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3020857322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:21:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3088710069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:21:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:44 smithi096 ceph-mon[101353]: pgmap v7188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:44 smithi096 ceph-mon[101353]: from='client.41464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:44 smithi096 ceph-mon[101353]: from='client.41468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:21:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3020857322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:21:45.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3088710069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:21:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:46 smithi159 ceph-mon[69013]: pgmap v7189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:46 smithi096 ceph-mon[101353]: pgmap v7189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:48 smithi159 ceph-mon[69013]: pgmap v7190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:48 smithi096 ceph-mon[101353]: pgmap v7190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:50 smithi159 ceph-mon[69013]: pgmap v7191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:50 smithi096 ceph-mon[101353]: pgmap v7191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:52 smithi159 ceph-mon[69013]: pgmap v7192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:52 smithi096 ceph-mon[101353]: pgmap v7192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:54 smithi159 ceph-mon[69013]: pgmap v7193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:54 smithi096 ceph-mon[101353]: pgmap v7193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:56 smithi159 ceph-mon[69013]: pgmap v7194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:56 smithi096 ceph-mon[101353]: pgmap v7194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:21:58 smithi159 ceph-mon[69013]: pgmap v7195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:21:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:21:58 smithi096 ceph-mon[101353]: pgmap v7195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:00 smithi096 ceph-mon[101353]: pgmap v7196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:01.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:00 smithi159 ceph-mon[69013]: pgmap v7196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:02 smithi096 ceph-mon[101353]: pgmap v7197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:02 smithi159 ceph-mon[69013]: pgmap v7197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:04 smithi096 ceph-mon[101353]: pgmap v7198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:05.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:04 smithi159 ceph-mon[69013]: pgmap v7198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:06 smithi096 ceph-mon[101353]: pgmap v7199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:07.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:06 smithi159 ceph-mon[69013]: pgmap v7199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:08 smithi096 ceph-mon[101353]: pgmap v7200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:09.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:08 smithi159 ceph-mon[69013]: pgmap v7200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:10 smithi096 ceph-mon[101353]: pgmap v7201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:11.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:10 smithi159 ceph-mon[69013]: pgmap v7201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:12 smithi096 ceph-mon[101353]: pgmap v7202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:13.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:12 smithi159 ceph-mon[69013]: pgmap v7202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:14.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 -- 172.21.15.96:0/1043466901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f66e0 msgr2=0x7f2c840f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 --2- 172.21.15.96:0/1043466901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f66e0 0x7f2c840f6b00 secure :-1 s=READY pgs=3679 cs=0 l=1 rev1=1 rx=0x7f2c78004660 tx=0x7f2c78009b30).stop 2022-02-02T22:22:14.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 -- 172.21.15.96:0/1043466901 shutdown_connections 2022-02-02T22:22:14.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 --2- 172.21.15.96:0/1043466901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f7980 0x7f2c840f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 --2- 172.21.15.96:0/1043466901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f66e0 0x7f2c840f6b00 unknown :-1 s=CLOSED pgs=3679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 -- 172.21.15.96:0/1043466901 >> 172.21.15.96:0/1043466901 conn(0x7f2c840f1e40 msgr2=0x7f2c840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 -- 172.21.15.96:0/1043466901 shutdown_connections 2022-02-02T22:22:14.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 -- 172.21.15.96:0/1043466901 wait complete. 2022-02-02T22:22:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.316+0000 7f2c8a523700 1 Processor -- start 2022-02-02T22:22:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c8a523700 1 -- start start 2022-02-02T22:22:14.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c8a523700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f66e0 0x7f2c8406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c8a523700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c8a523700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8406a380 con 0x7f2c840f7980 2022-02-02T22:22:14.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c8a523700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8406a4c0 con 0x7f2c840f66e0 2022-02-02T22:22:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48034/0 (socket says 172.21.15.96:48034) 2022-02-02T22:22:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 -- 172.21.15.96:0/3046736414 learned_addr learned my addr 172.21.15.96:0/3046736414 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c83fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f66e0 0x7f2c8406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 -- 172.21.15.96:0/3046736414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f66e0 msgr2=0x7f2c8406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f66e0 0x7f2c8406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 -- 172.21.15.96:0/3046736414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78005040 con 0x7f2c840f7980 2022-02-02T22:22:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.317+0000 7f2c837fe700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 secure :-1 s=READY pgs=3680 cs=0 l=1 rev1=1 rx=0x7f2c740026d0 tx=0x7f2c74009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.318+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c740079c0 con 0x7f2c840f7980 2022-02-02T22:22:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.318+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c7400f040 con 0x7f2c840f7980 2022-02-02T22:22:14.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.318+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8406a7a0 con 0x7f2c840f7980 2022-02-02T22:22:14.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.318+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c740148b0 con 0x7f2c840f7980 2022-02-02T22:22:14.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.318+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8410efe0 con 0x7f2c840f7980 2022-02-02T22:22:14.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.319+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c84045ad0 con 0x7f2c840f7980 2022-02-02T22:22:14.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.319+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c74007b20 con 0x7f2c840f7980 2022-02-02T22:22:14.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.320+0000 7f2c80ff9700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 0x7f2c6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.320+0000 7f2c83fff700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 0x7f2c6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.320+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c740818c0 con 0x7f2c840f7980 2022-02-02T22:22:14.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.320+0000 7f2c83fff700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 0x7f2c6c067290 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f2c78013690 tx=0x7f2c78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.324+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c7404f9c0 con 0x7f2c840f7980 2022-02-02T22:22:14.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.503+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c84057f10 con 0x7f2c6c064dd0 2022-02-02T22:22:14.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.504+0000 7f2c80ff9700 1 -- 172.21.15.96:0/3046736414 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2c84057f10 con 0x7f2c6c064dd0 2022-02-02T22:22:14.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 msgr2=0x7f2c6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 0x7f2c6c067290 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f2c78013690 tx=0x7f2c78009b30).stop 2022-02-02T22:22:14.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 msgr2=0x7f2c84069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 secure :-1 s=READY pgs=3680 cs=0 l=1 rev1=1 rx=0x7f2c740026d0 tx=0x7f2c74009de0).stop 2022-02-02T22:22:14.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 shutdown_connections 2022-02-02T22:22:14.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c6c064dd0 0x7f2c6c067290 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c840f66e0 0x7f2c8406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 --2- 172.21.15.96:0/3046736414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c840f7980 0x7f2c84069e20 unknown :-1 s=CLOSED pgs=3680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.506+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 >> 172.21.15.96:0/3046736414 conn(0x7f2c840f1e40 msgr2=0x7f2c840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:14.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.507+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 shutdown_connections 2022-02-02T22:22:14.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.507+0000 7f2c8a523700 1 -- 172.21.15.96:0/3046736414 wait complete. 2022-02-02T22:22:14.516 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:22:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 -- 172.21.15.96:0/928999823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 msgr2=0x7f65f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 --2- 172.21.15.96:0/928999823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f40f6b00 secure :-1 s=READY pgs=3681 cs=0 l=1 rev1=1 rx=0x7f65e8004660 tx=0x7f65e8009b30).stop 2022-02-02T22:22:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 -- 172.21.15.96:0/928999823 shutdown_connections 2022-02-02T22:22:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 --2- 172.21.15.96:0/928999823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 --2- 172.21.15.96:0/928999823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f40f6b00 unknown :-1 s=CLOSED pgs=3681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 -- 172.21.15.96:0/928999823 >> 172.21.15.96:0/928999823 conn(0x7f65f40f1e40 msgr2=0x7f65f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 -- 172.21.15.96:0/928999823 shutdown_connections 2022-02-02T22:22:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.604+0000 7f65f97e0700 1 -- 172.21.15.96:0/928999823 wait complete. 2022-02-02T22:22:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 Processor -- start 2022-02-02T22:22:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 -- start start 2022-02-02T22:22:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f406a380 con 0x7f65f40f66e0 2022-02-02T22:22:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f97e0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f406a4c0 con 0x7f65f40f7980 2022-02-02T22:22:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48042/0 (socket says 172.21.15.96:48042) 2022-02-02T22:22:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f2ffd700 1 -- 172.21.15.96:0/3911509445 learned_addr learned my addr 172.21.15.96:0/3911509445 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f27fc700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f2ffd700 1 -- 172.21.15.96:0/3911509445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 msgr2=0x7f65f4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.605+0000 7f65f2ffd700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65f2ffd700 1 -- 172.21.15.96:0/3911509445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8005040 con 0x7f65f40f66e0 2022-02-02T22:22:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65f27fc700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:22:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65f2ffd700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 secure :-1 s=READY pgs=3682 cs=0 l=1 rev1=1 rx=0x7f65e8013a70 tx=0x7f65e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e8018070 con 0x7f65f40f66e0 2022-02-02T22:22:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f406a740 con 0x7f65f40f66e0 2022-02-02T22:22:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65e80097d0 con 0x7f65f40f66e0 2022-02-02T22:22:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e801c3c0 con 0x7f65f40f66e0 2022-02-02T22:22:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.606+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f406aca0 con 0x7f65f40f66e0 2022-02-02T22:22:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.607+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d4004fa0 con 0x7f65f40f66e0 2022-02-02T22:22:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.608+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f65e8007ba0 con 0x7f65f40f66e0 2022-02-02T22:22:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.608+0000 7f65db7fe700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 0x7f65dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.608+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f65e8083a40 con 0x7f65f40f66e0 2022-02-02T22:22:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.608+0000 7f65f27fc700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 0x7f65dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.609+0000 7f65f27fc700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 0x7f65dc067290 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f65e4009780 tx=0x7f65e4009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.612+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65e8051b40 con 0x7f65f40f66e0 2022-02-02T22:22:14.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.784+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65d4000b90 con 0x7f65dc064dd0 2022-02-02T22:22:14.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.793+0000 7f65db7fe700 1 -- 172.21.15.96:0/3911509445 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f65d4000b90 con 0x7f65dc064dd0 2022-02-02T22:22:14.793 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:22:14.794 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:22:14.794 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:22:14.794 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:22:14.795 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:22:14.795 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:22:14.795 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:22:14.796 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:22:14.796 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:22:14.797 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (3h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:22:14.797 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:22:14.797 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:22:14.798 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:22:14.798 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:22:14.798 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:22:14.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:22:14.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:22:14.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:22:14.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:22:14.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:22:14.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:22:14.801 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:22:14.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.795+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 msgr2=0x7f65dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.795+0000 7f65f97e0700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 0x7f65dc067290 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f65e4009780 tx=0x7f65e4009c80).stop 2022-02-02T22:22:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.795+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 msgr2=0x7f65f406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.795+0000 7f65f97e0700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 secure :-1 s=READY pgs=3682 cs=0 l=1 rev1=1 rx=0x7f65e8013a70 tx=0x7f65e8009b30).stop 2022-02-02T22:22:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 shutdown_connections 2022-02-02T22:22:14.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65dc064dd0 0x7f65dc067290 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f40f66e0 0x7f65f406b9a0 unknown :-1 s=CLOSED pgs=3682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 --2- 172.21.15.96:0/3911509445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65f40f7980 0x7f65f4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 >> 172.21.15.96:0/3911509445 conn(0x7f65f40f1e40 msgr2=0x7f65f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:14.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 shutdown_connections 2022-02-02T22:22:14.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.796+0000 7f65f97e0700 1 -- 172.21.15.96:0/3911509445 wait complete. 2022-02-02T22:22:14.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 -- 172.21.15.96:0/599260422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f55c0 msgr2=0x7fb9fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 --2- 172.21.15.96:0/599260422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc0f59e0 secure :-1 s=READY pgs=3683 cs=0 l=1 rev1=1 rx=0x7fb9ec004660 tx=0x7fb9ec009b30).stop 2022-02-02T22:22:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 -- 172.21.15.96:0/599260422 shutdown_connections 2022-02-02T22:22:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 --2- 172.21.15.96:0/599260422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 --2- 172.21.15.96:0/599260422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc0f59e0 unknown :-1 s=CLOSED pgs=3683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 -- 172.21.15.96:0/599260422 >> 172.21.15.96:0/599260422 conn(0x7fb9fc0f0d40 msgr2=0x7fb9fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:14.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:14 smithi096 ceph-mon[101353]: pgmap v7203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.893+0000 7fba03bf0700 1 -- 172.21.15.96:0/599260422 shutdown_connections 2022-02-02T22:22:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.894+0000 7fba03bf0700 1 -- 172.21.15.96:0/599260422 wait complete. 2022-02-02T22:22:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.894+0000 7fba03bf0700 1 Processor -- start 2022-02-02T22:22:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba03bf0700 1 -- start start 2022-02-02T22:22:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba03bf0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba03bf0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba03bf0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc106910 con 0x7fb9fc0f6860 2022-02-02T22:22:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba03bf0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc106a50 con 0x7fb9fc0f55c0 2022-02-02T22:22:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48054/0 (socket says 172.21.15.96:48054) 2022-02-02T22:22:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 -- 172.21.15.96:0/1429294407 learned_addr learned my addr 172.21.15.96:0/1429294407 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0198c700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 -- 172.21.15.96:0/1429294407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 msgr2=0x7fb9fc105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 -- 172.21.15.96:0/1429294407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec005040 con 0x7fb9fc0f6860 2022-02-02T22:22:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0198c700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:22:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.895+0000 7fba0118b700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 secure :-1 s=READY pgs=3684 cs=0 l=1 rev1=1 rx=0x7fb9f800e9a0 tx=0x7fb9f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.896+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f800cb90 con 0x7fb9fc0f6860 2022-02-02T22:22:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.896+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc1073f0 con 0x7fb9fc0f6860 2022-02-02T22:22:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.896+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc1079b0 con 0x7fb9fc0f6860 2022-02-02T22:22:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.896+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9f800ccf0 con 0x7fb9fc0f6860 2022-02-02T22:22:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.896+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f80106c0 con 0x7fb9fc0f6860 2022-02-02T22:22:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.897+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9f8011470 con 0x7fb9fc0f6860 2022-02-02T22:22:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.897+0000 7fb9f27fc700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 0x7fb9e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.898+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc045ad0 con 0x7fb9fc0f6860 2022-02-02T22:22:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.898+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9f8084b70 con 0x7fb9fc0f6860 2022-02-02T22:22:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.898+0000 7fba0198c700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 0x7fb9e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.898+0000 7fba0198c700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 0x7fb9e8067290 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7fb9ec004e30 tx=0x7fb9ec009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:14.902+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9f80565e0 con 0x7fb9fc0f6860 2022-02-02T22:22:15.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.132+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9fc108040 con 0x7fb9fc0f6860 2022-02-02T22:22:15.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.133+0000 7fb9f27fc700 1 -- 172.21.15.96:0/1429294407 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb9f80561d0 con 0x7fb9fc0f6860 2022-02-02T22:22:15.133 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:22:15.134 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:22:15.134 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:22:15.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:15.135 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:22:15.135 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:22:15.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:15.136 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:22:15.136 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:22:15.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:15.137 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:22:15.137 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:22:15.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:15.138 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:22:15.138 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:22:15.139 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:22:15.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:22:15.139 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:22:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.134+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 msgr2=0x7fb9e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 0x7fb9e8067290 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7fb9ec004e30 tx=0x7fb9ec009b30).stop 2022-02-02T22:22:15.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 msgr2=0x7fb9fc106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 secure :-1 s=READY pgs=3684 cs=0 l=1 rev1=1 rx=0x7fb9f800e9a0 tx=0x7fb9f8007e00).stop 2022-02-02T22:22:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 shutdown_connections 2022-02-02T22:22:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9e8064dd0 0x7fb9e8067290 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9fc0f55c0 0x7fb9fc105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 --2- 172.21.15.96:0/1429294407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9fc0f6860 0x7fb9fc106360 unknown :-1 s=CLOSED pgs=3684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 >> 172.21.15.96:0/1429294407 conn(0x7fb9fc0f0d40 msgr2=0x7fb9fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 shutdown_connections 2022-02-02T22:22:15.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.135+0000 7fba03bf0700 1 -- 172.21.15.96:0/1429294407 wait complete. 2022-02-02T22:22:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 -- 172.21.15.96:0/3915713950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 msgr2=0x7fce480f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/3915713950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce480f6b30 secure :-1 s=READY pgs=3685 cs=0 l=1 rev1=1 rx=0x7fce44004660 tx=0x7fce44009b30).stop 2022-02-02T22:22:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 -- 172.21.15.96:0/3915713950 shutdown_connections 2022-02-02T22:22:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/3915713950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce480f6b30 unknown :-1 s=CLOSED pgs=3685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/3915713950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 0x7fce480f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 -- 172.21.15.96:0/3915713950 >> 172.21.15.96:0/3915713950 conn(0x7fce480f0b90 msgr2=0x7fce480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 -- 172.21.15.96:0/3915713950 shutdown_connections 2022-02-02T22:22:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.231+0000 7fce4f1c6700 1 -- 172.21.15.96:0/3915713950 wait complete. 2022-02-02T22:22:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 Processor -- start 2022-02-02T22:22:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 -- start start 2022-02-02T22:22:15.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 0x7fce48109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480603e0 con 0x7fce480f66d0 2022-02-02T22:22:15.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.232+0000 7fce4f1c6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48060520 con 0x7fce480f5430 2022-02-02T22:22:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:15.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48064/0 (socket says 172.21.15.96:48064) 2022-02-02T22:22:15.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 -- 172.21.15.96:0/1077344626 learned_addr learned my addr 172.21.15.96:0/1077344626 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:15.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4e1c4700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 0x7fce48109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:15.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 -- 172.21.15.96:0/1077344626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 msgr2=0x7fce48109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 0x7fce48109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 -- 172.21.15.96:0/1077344626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44005040 con 0x7fce480f66d0 2022-02-02T22:22:15.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4d9c3700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 secure :-1 s=READY pgs=3686 cs=0 l=1 rev1=1 rx=0x7fce44009990 tx=0x7fce44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:15.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce44018070 con 0x7fce480f66d0 2022-02-02T22:22:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce44007ba0 con 0x7fce480f66d0 2022-02-02T22:22:15.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4401c3c0 con 0x7fce480f66d0 2022-02-02T22:22:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4810c470 con 0x7fce480f66d0 2022-02-02T22:22:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.233+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4810c9d0 con 0x7fce480f66d0 2022-02-02T22:22:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.235+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48045ad0 con 0x7fce480f66d0 2022-02-02T22:22:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.235+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce4401d420 con 0x7fce480f66d0 2022-02-02T22:22:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.236+0000 7fce3affd700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 0x7fce340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.236+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce440836a0 con 0x7fce480f66d0 2022-02-02T22:22:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.236+0000 7fce4e1c4700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 0x7fce340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.236+0000 7fce4e1c4700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 0x7fce340672e0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7fce48060060 tx=0x7fce3c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.240+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce44051860 con 0x7fce480f66d0 2022-02-02T22:22:15.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:14 smithi159 ceph-mon[69013]: pgmap v7203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.443+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce480fdcf0 con 0x7fce480f66d0 2022-02-02T22:22:15.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.444+0000 7fce3affd700 1 -- 172.21.15.96:0/1077344626 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fce44054e80 con 0x7fce480f66d0 2022-02-02T22:22:15.444 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:22:15.445 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:22:15.445 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:22:15.445 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:22:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:15.446 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:22:15.446 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:22:15.447 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:22:15.447 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:22:15.447 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:22:15.448 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:22:15.448 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:22:15.448 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:22:15.449 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:22:15.449 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:22:15.449 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:22:15.450 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:22:15.450 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:22:15.450 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:22:15.451 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:22:15.451 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:22:15.451 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:22:15.452 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:22:15.452 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:22:15.452 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:22:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:22:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:22:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:22:15.454 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:22:15.454 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:22:15.454 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:22:15.455 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:22:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:15.456 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:22:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:15.456 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:15.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:15.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:15.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 msgr2=0x7fce340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 0x7fce340672e0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7fce48060060 tx=0x7fce3c00b040).stop 2022-02-02T22:22:15.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 msgr2=0x7fce4810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:15.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 secure :-1 s=READY pgs=3686 cs=0 l=1 rev1=1 rx=0x7fce44009990 tx=0x7fce44009b30).stop 2022-02-02T22:22:15.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 shutdown_connections 2022-02-02T22:22:15.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce34064e20 0x7fce340672e0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce480f5430 0x7fce48109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 --2- 172.21.15.96:0/1077344626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce480f66d0 0x7fce4810bf20 unknown :-1 s=CLOSED pgs=3686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:15.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 >> 172.21.15.96:0/1077344626 conn(0x7fce480f0b90 msgr2=0x7fce480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:15.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 shutdown_connections 2022-02-02T22:22:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:15.446+0000 7fce4f1c6700 1 -- 172.21.15.96:0/1077344626 wait complete. 2022-02-02T22:22:15.462 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:22:16.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:15 smithi096 ceph-mon[101353]: from='client.41480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:16.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:15 smithi096 ceph-mon[101353]: from='client.41484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:16.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1429294407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:22:16.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1077344626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:22:16.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:15 smithi159 ceph-mon[69013]: from='client.41480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:16.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:15 smithi159 ceph-mon[69013]: from='client.41484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:16.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1429294407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:22:16.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1077344626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:22:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:16 smithi096 ceph-mon[101353]: pgmap v7204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:17.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:16 smithi159 ceph-mon[69013]: pgmap v7204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:18 smithi159 ceph-mon[69013]: pgmap v7205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:18 smithi096 ceph-mon[101353]: pgmap v7205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:21.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:20 smithi159 ceph-mon[69013]: pgmap v7206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:20 smithi096 ceph-mon[101353]: pgmap v7206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:22 smithi096 ceph-mon[101353]: pgmap v7207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:22 smithi159 ceph-mon[69013]: pgmap v7207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:25.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:24 smithi159 ceph-mon[69013]: pgmap v7208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:24 smithi096 ceph-mon[101353]: pgmap v7208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:27.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:26 smithi159 ceph-mon[69013]: pgmap v7209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:26 smithi096 ceph-mon[101353]: pgmap v7209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:29.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:28 smithi159 ceph-mon[69013]: pgmap v7210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:22:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:22:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:28 smithi096 ceph-mon[101353]: pgmap v7210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:22:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:22:31.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:30 smithi159 ceph-mon[69013]: pgmap v7211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:30 smithi096 ceph-mon[101353]: pgmap v7211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:32 smithi096 ceph-mon[101353]: pgmap v7212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:33.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:32 smithi159 ceph-mon[69013]: pgmap v7212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:34.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:34 smithi159 ceph-mon[69013]: pgmap v7213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:34.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:34 smithi096 ceph-mon[101353]: pgmap v7213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:36.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:36 smithi159 ceph-mon[69013]: pgmap v7214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:36 smithi096 ceph-mon[101353]: pgmap v7214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:38 smithi159 ceph-mon[69013]: pgmap v7215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:38 smithi096 ceph-mon[101353]: pgmap v7215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:40 smithi096 ceph-mon[101353]: pgmap v7216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:40 smithi159 ceph-mon[69013]: pgmap v7216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:42.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:42 smithi096 ceph-mon[101353]: pgmap v7217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:42 smithi159 ceph-mon[69013]: pgmap v7217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:44.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:44 smithi096 ceph-mon[101353]: pgmap v7218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:44 smithi159 ceph-mon[69013]: pgmap v7218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 -- 172.21.15.96:0/3423939403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f66a0 msgr2=0x7fec6c0f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 --2- 172.21.15.96:0/3423939403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f66a0 0x7fec6c0f6ac0 secure :-1 s=READY pgs=3687 cs=0 l=1 rev1=1 rx=0x7fec5c004660 tx=0x7fec5c009b30).stop 2022-02-02T22:22:45.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 -- 172.21.15.96:0/3423939403 shutdown_connections 2022-02-02T22:22:45.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 --2- 172.21.15.96:0/3423939403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f7940 0x7fec6c0f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:22:45.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 --2- 172.21.15.96:0/3423939403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f66a0 0x7fec6c0f6ac0 unknown :-1 s=CLOSED pgs=3687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 -- 172.21.15.96:0/3423939403 >> 172.21.15.96:0/3423939403 conn(0x7fec6c0f1e00 msgr2=0x7fec6c0f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:45.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.555+0000 7fec743d8700 1 -- 172.21.15.96:0/3423939403 shutdown_connections 2022-02-02T22:22:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 -- 172.21.15.96:0/3423939403 wait complete. 2022-02-02T22:22:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 Processor -- start 2022-02-02T22:22:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 -- start start 2022-02-02T22:22:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 0x7fec6c106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c107a30 con 0x7fec6c0f7940 2022-02-02T22:22:45.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec743d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1082e0 con 0x7fec6c0f66a0 2022-02-02T22:22:45.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec71973700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec71973700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48084/0 (socket says 172.21.15.96:48084) 2022-02-02T22:22:45.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.556+0000 7fec71973700 1 -- 172.21.15.96:0/3590405826 learned_addr learned my addr 172.21.15.96:0/3590405826 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:45.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec72174700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 0x7fec6c106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec71973700 1 -- 172.21.15.96:0/3590405826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 msgr2=0x7fec6c106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec71973700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 0x7fec6c106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec71973700 1 -- 172.21.15.96:0/3590405826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c005040 con 0x7fec6c0f7940 2022-02-02T22:22:45.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec72174700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 0x7fec6c106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:22:45.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec71973700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 secure :-1 s=READY pgs=3688 cs=0 l=1 rev1=1 rx=0x7fec6800b410 tx=0x7fec68006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:45.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec680125f0 con 0x7fec6c0f7940 2022-02-02T22:22:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec68012c00 con 0x7fec6c0f7940 2022-02-02T22:22:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c1085c0 con 0x7fec6c0f7940 2022-02-02T22:22:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec68002ae0 con 0x7fec6c0f7940 2022-02-02T22:22:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.557+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c108b80 con 0x7fec6c0f7940 2022-02-02T22:22:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.558+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c0f5a90 con 0x7fec6c0f7940 2022-02-02T22:22:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.559+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec6800f030 con 0x7fec6c0f7940 2022-02-02T22:22:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.559+0000 7fec62ffd700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 0x7fec580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.559+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec68081f10 con 0x7fec6c0f7940 2022-02-02T22:22:45.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.559+0000 7fec72174700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 0x7fec580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.560+0000 7fec72174700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 0x7fec580672e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fec5c009da0 tx=0x7fec5c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.563+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec68053a40 con 0x7fec6c0f7940 2022-02-02T22:22:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.741+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec6c0fefc0 con 0x7fec58064e20 2022-02-02T22:22:45.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.743+0000 7fec62ffd700 1 -- 172.21.15.96:0/3590405826 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fec6c0fefc0 con 0x7fec58064e20 2022-02-02T22:22:45.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 msgr2=0x7fec580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 0x7fec580672e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7fec5c009da0 tx=0x7fec5c009b30).stop 2022-02-02T22:22:45.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 msgr2=0x7fec6c1073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 secure :-1 s=READY pgs=3688 cs=0 l=1 rev1=1 rx=0x7fec6800b410 tx=0x7fec68006ef0).stop 2022-02-02T22:22:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 shutdown_connections 2022-02-02T22:22:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec58064e20 0x7fec580672e0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0f66a0 0x7fec6c106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 --2- 172.21.15.96:0/3590405826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec6c0f7940 0x7fec6c1073f0 unknown :-1 s=CLOSED pgs=3688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.744+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 >> 172.21.15.96:0/3590405826 conn(0x7fec6c0f1e00 msgr2=0x7fec6c0fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.745+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 shutdown_connections 2022-02-02T22:22:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.745+0000 7fec743d8700 1 -- 172.21.15.96:0/3590405826 wait complete. 2022-02-02T22:22:45.755 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:22:45.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 -- 172.21.15.96:0/1149400674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f6530 msgr2=0x7fcb740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 --2- 172.21.15.96:0/1149400674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f6530 0x7fcb740f6950 secure :-1 s=READY pgs=3689 cs=0 l=1 rev1=1 rx=0x7fcb68004660 tx=0x7fcb68009b30).stop 2022-02-02T22:22:45.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 -- 172.21.15.96:0/1149400674 shutdown_connections 2022-02-02T22:22:45.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 --2- 172.21.15.96:0/1149400674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f77d0 0x7fcb740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 --2- 172.21.15.96:0/1149400674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f6530 0x7fcb740f6950 unknown :-1 s=CLOSED pgs=3689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 -- 172.21.15.96:0/1149400674 >> 172.21.15.96:0/1149400674 conn(0x7fcb740f1c90 msgr2=0x7fcb740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:45.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 -- 172.21.15.96:0/1149400674 shutdown_connections 2022-02-02T22:22:45.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.842+0000 7fcb78901700 1 -- 172.21.15.96:0/1149400674 wait complete. 2022-02-02T22:22:45.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 Processor -- start 2022-02-02T22:22:45.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 -- start start 2022-02-02T22:22:45.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f6530 0x7fcb7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7406a380 con 0x7fcb740f77d0 2022-02-02T22:22:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb78901700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7406a4c0 con 0x7fcb740f6530 2022-02-02T22:22:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.843+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48094/0 (socket says 172.21.15.96:48094) 2022-02-02T22:22:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 -- 172.21.15.96:0/2261096556 learned_addr learned my addr 172.21.15.96:0/2261096556 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb737fe700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f6530 0x7fcb7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 -- 172.21.15.96:0/2261096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f6530 msgr2=0x7fcb7406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:45.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f6530 0x7fcb7406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:45.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 -- 172.21.15.96:0/2261096556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68005040 con 0x7fcb740f77d0 2022-02-02T22:22:45.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb72ffd700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 secure :-1 s=READY pgs=3690 cs=0 l=1 rev1=1 rx=0x7fcb6400c790 tx=0x7fcb64007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:45.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb6400e680 con 0x7fcb740f77d0 2022-02-02T22:22:45.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7406a7a0 con 0x7fcb740f77d0 2022-02-02T22:22:45.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb6400ec90 con 0x7fcb740f77d0 2022-02-02T22:22:45.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb64013d60 con 0x7fcb740f77d0 2022-02-02T22:22:45.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.844+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7410edc0 con 0x7fcb740f77d0 2022-02-02T22:22:45.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.845+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74045ad0 con 0x7fcb740f77d0 2022-02-02T22:22:45.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.846+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb6401a060 con 0x7fcb740f77d0 2022-02-02T22:22:45.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.846+0000 7fcb5bfff700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 0x7fcb5c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:45.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.846+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb64081c90 con 0x7fcb740f77d0 2022-02-02T22:22:45.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.846+0000 7fcb737fe700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 0x7fcb5c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:45.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.847+0000 7fcb737fe700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 0x7fcb5c0672e0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7fcb68004e30 tx=0x7fcb68009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:45.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:45.850+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb6404fd90 con 0x7fcb740f77d0 2022-02-02T22:22:46.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.022+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb740fee00 con 0x7fcb5c064e20 2022-02-02T22:22:46.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.031+0000 7fcb5bfff700 1 -- 172.21.15.96:0/2261096556 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcb740fee00 con 0x7fcb5c064e20 2022-02-02T22:22:46.032 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:22:46.033 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:22:46.033 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:22:46.033 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:22:46.034 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:22:46.034 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:22:46.035 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:22:46.035 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:22:46.035 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:22:46.036 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:22:46.036 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (3h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:22:46.036 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:22:46.037 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:22:46.037 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:22:46.037 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:22:46.038 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:22:46.038 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:22:46.038 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:22:46.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:22:46.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:22:46.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:22:46.040 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:22:46.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 msgr2=0x7fcb5c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 0x7fcb5c0672e0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7fcb68004e30 tx=0x7fcb68009b30).stop 2022-02-02T22:22:46.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 msgr2=0x7fcb74069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 secure :-1 s=READY pgs=3690 cs=0 l=1 rev1=1 rx=0x7fcb6400c790 tx=0x7fcb64007d70).stop 2022-02-02T22:22:46.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 shutdown_connections 2022-02-02T22:22:46.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb5c064e20 0x7fcb5c0672e0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb740f6530 0x7fcb7406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 --2- 172.21.15.96:0/2261096556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb740f77d0 0x7fcb74069e20 unknown :-1 s=CLOSED pgs=3690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.033+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 >> 172.21.15.96:0/2261096556 conn(0x7fcb740f1c90 msgr2=0x7fcb740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:46.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.034+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 shutdown_connections 2022-02-02T22:22:46.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.034+0000 7fcb78901700 1 -- 172.21.15.96:0/2261096556 wait complete. 2022-02-02T22:22:46.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 -- 172.21.15.96:0/1572132357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 msgr2=0x7faa800f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 --2- 172.21.15.96:0/1572132357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa800f59b0 secure :-1 s=READY pgs=3691 cs=0 l=1 rev1=1 rx=0x7faa74004660 tx=0x7faa74009b30).stop 2022-02-02T22:22:46.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 -- 172.21.15.96:0/1572132357 shutdown_connections 2022-02-02T22:22:46.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 --2- 172.21.15.96:0/1572132357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa800f59b0 unknown :-1 s=CLOSED pgs=3691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 --2- 172.21.15.96:0/1572132357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 0x7faa800f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:22:46.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 -- 172.21.15.96:0/1572132357 >> 172.21.15.96:0/1572132357 conn(0x7faa800f04c0 msgr2=0x7faa800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 -- 172.21.15.96:0/1572132357 shutdown_connections 2022-02-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.130+0000 7faa85105700 1 -- 172.21.15.96:0/1572132357 wait complete. 2022-02-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 Processor -- start 2022-02-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 -- start start 2022-02-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 0x7faa80105f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80106a60 con 0x7faa800f7590 2022-02-02T22:22:46.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa85105700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80107310 con 0x7faa800f6bf0 2022-02-02T22:22:46.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa7e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa7e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48104/0 (socket says 172.21.15.96:48104) 2022-02-02T22:22:46.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.131+0000 7faa7e59c700 1 -- 172.21.15.96:0/3983549419 learned_addr learned my addr 172.21.15.96:0/3983549419 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:46.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa7ed9d700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 0x7faa80105f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa7e59c700 1 -- 172.21.15.96:0/3983549419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 msgr2=0x7faa80105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa7e59c700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 0x7faa80105f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa7e59c700 1 -- 172.21.15.96:0/3983549419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa74005040 con 0x7faa800f7590 2022-02-02T22:22:46.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa7e59c700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 secure :-1 s=READY pgs=3692 cs=0 l=1 rev1=1 rx=0x7faa74004e30 tx=0x7faa74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:46.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7401a070 con 0x7faa800f7590 2022-02-02T22:22:46.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa80107590 con 0x7faa800f7590 2022-02-02T22:22:46.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa7401fab0 con 0x7faa800f7590 2022-02-02T22:22:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7401e8a0 con 0x7faa800f7590 2022-02-02T22:22:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.132+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa80107af0 con 0x7faa800f7590 2022-02-02T22:22:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.133+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800f4150 con 0x7faa800f7590 2022-02-02T22:22:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.134+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa7401fc20 con 0x7faa800f7590 2022-02-02T22:22:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.135+0000 7faa677fe700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.135+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa740862f0 con 0x7faa800f7590 2022-02-02T22:22:46.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.135+0000 7faa7ed9d700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.135+0000 7faa7ed9d700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7faa8005eb40 tx=0x7faa70008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:46.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.138+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa74057e20 con 0x7faa800f7590 2022-02-02T22:22:46.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.369+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa80045ad0 con 0x7faa800f7590 2022-02-02T22:22:46.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.369+0000 7faa677fe700 1 -- 172.21.15.96:0/3983549419 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faa74057a10 con 0x7faa800f7590 2022-02-02T22:22:46.371 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:22:46.371 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:22:46.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:22:46.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:46.372 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:22:46.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:22:46.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:46.373 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:22:46.374 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:22:46.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:46.374 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:22:46.375 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:22:46.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:22:46.376 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:22:46.376 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:22:46.377 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:22:46.377 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:22:46.377 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:22:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 msgr2=0x7faa68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7faa8005eb40 tx=0x7faa70008040).stop 2022-02-02T22:22:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 msgr2=0x7faa80106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 secure :-1 s=READY pgs=3692 cs=0 l=1 rev1=1 rx=0x7faa74004e30 tx=0x7faa74009b30).stop 2022-02-02T22:22:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 shutdown_connections 2022-02-02T22:22:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa68064dd0 0x7faa68067290 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa800f6bf0 0x7faa80105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 --2- 172.21.15.96:0/3983549419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa800f7590 0x7faa80106420 unknown :-1 s=CLOSED pgs=3692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 >> 172.21.15.96:0/3983549419 conn(0x7faa800f04c0 msgr2=0x7faa800fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:46.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 shutdown_connections 2022-02-02T22:22:46.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.371+0000 7faa85105700 1 -- 172.21.15.96:0/3983549419 wait complete. 2022-02-02T22:22:46.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.468+0000 7fc39ca53700 1 -- 172.21.15.96:0/2746667824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f77d0 msgr2=0x7fc3980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.468+0000 7fc39ca53700 1 --2- 172.21.15.96:0/2746667824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f77d0 0x7fc3980f7c30 secure :-1 s=READY pgs=3693 cs=0 l=1 rev1=1 rx=0x7fc388004660 tx=0x7fc388009b30).stop 2022-02-02T22:22:46.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 -- 172.21.15.96:0/2746667824 shutdown_connections 2022-02-02T22:22:46.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 --2- 172.21.15.96:0/2746667824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f77d0 0x7fc3980f7c30 unknown :-1 s=CLOSED pgs=3693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 --2- 172.21.15.96:0/2746667824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f6530 0x7fc3980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 -- 172.21.15.96:0/2746667824 >> 172.21.15.96:0/2746667824 conn(0x7fc3980f1c90 msgr2=0x7fc3980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:46.472 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:46 smithi096 ceph-mon[101353]: pgmap v7219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:46.472 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:46 smithi096 ceph-mon[101353]: from='client.41496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:46.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 -- 172.21.15.96:0/2746667824 shutdown_connections 2022-02-02T22:22:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 -- 172.21.15.96:0/2746667824 wait complete. 2022-02-02T22:22:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.469+0000 7fc39ca53700 1 Processor -- start 2022-02-02T22:22:46.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc39ca53700 1 -- start start 2022-02-02T22:22:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc39ca53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc39ca53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f77d0 0x7fc398107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc39ca53700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398107880 con 0x7fc3980f6530 2022-02-02T22:22:46.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc39ca53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398108090 con 0x7fc3980f77d0 2022-02-02T22:22:46.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48110/0 (socket says 172.21.15.96:48110) 2022-02-02T22:22:46.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 -- 172.21.15.96:0/1203015183 learned_addr learned my addr 172.21.15.96:0/1203015183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:22:46.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc396ffd700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f77d0 0x7fc398107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 -- 172.21.15.96:0/1203015183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f77d0 msgr2=0x7fc398107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f77d0 0x7fc398107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.470+0000 7fc3977fe700 1 -- 172.21.15.96:0/1203015183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388005040 con 0x7fc3980f6530 2022-02-02T22:22:46.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc3977fe700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 secure :-1 s=READY pgs=3694 cs=0 l=1 rev1=1 rx=0x7fc38c00c530 tx=0x7fc38c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:46.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38c00f650 con 0x7fc3980f6530 2022-02-02T22:22:46.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc398108310 con 0x7fc3980f6530 2022-02-02T22:22:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3981088d0 con 0x7fc3980f6530 2022-02-02T22:22:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc38c00fc60 con 0x7fc3980f6530 2022-02-02T22:22:46.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.471+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38c012cb0 con 0x7fc3980f6530 2022-02-02T22:22:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.472+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc378004fa0 con 0x7fc3980f6530 2022-02-02T22:22:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.472+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc38c019030 con 0x7fc3980f6530 2022-02-02T22:22:46.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.473+0000 7fc37ffff700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 0x7fc3800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:22:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.473+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc38c081530 con 0x7fc3980f6530 2022-02-02T22:22:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.473+0000 7fc396ffd700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 0x7fc3800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:22:46.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.473+0000 7fc396ffd700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 0x7fc3800672e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7fc388004630 tx=0x7fc388009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:22:46.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.477+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc38c0487d0 con 0x7fc3980f6530 2022-02-02T22:22:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.684+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc378005e80 con 0x7fc3980f6530 2022-02-02T22:22:46.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.684+0000 7fc37ffff700 1 -- 172.21.15.96:0/1203015183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc38c017020 con 0x7fc3980f6530 2022-02-02T22:22:46.686 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:22:46.686 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:22:46.687 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:22:46.687 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:22:46.687 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:46.688 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:22:46.688 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:22:46.688 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:22:46.689 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:22:46.689 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:22:46.689 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:22:46.690 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:22:46.690 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:22:46.690 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:22:46.691 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:22:46.691 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:22:46.691 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:22:46.692 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:22:46.692 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:22:46.692 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:22:46.693 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:22:46.693 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:22:46.693 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:22:46.694 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:22:46.694 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:22:46.695 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:22:46.695 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:22:46.695 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:22:46.695 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:22:46.696 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:22:46.696 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:22:46.697 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:22:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:46.697 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:46.698 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:22:46.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:22:46.698 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:46.699 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:46.699 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:22:46.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 msgr2=0x7fc3800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 0x7fc3800672e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7fc388004630 tx=0x7fc388009b30).stop 2022-02-02T22:22:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 msgr2=0x7fc398106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:22:46.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 secure :-1 s=READY pgs=3694 cs=0 l=1 rev1=1 rx=0x7fc38c00c530 tx=0x7fc38c007e10).stop 2022-02-02T22:22:46.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 shutdown_connections 2022-02-02T22:22:46.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc380064e20 0x7fc3800672e0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980f6530 0x7fc398106d90 unknown :-1 s=CLOSED pgs=3694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 --2- 172.21.15.96:0/1203015183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3980f77d0 0x7fc398107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:22:46.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.687+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 >> 172.21.15.96:0/1203015183 conn(0x7fc3980f1c90 msgr2=0x7fc3980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:22:46.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.688+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 shutdown_connections 2022-02-02T22:22:46.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:22:46.688+0000 7fc39ca53700 1 -- 172.21.15.96:0/1203015183 wait complete. 2022-02-02T22:22:46.704 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:22:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:46 smithi159 ceph-mon[69013]: pgmap v7219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:46 smithi159 ceph-mon[69013]: from='client.41496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:47 smithi096 ceph-mon[101353]: from='client.41500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3983549419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:22:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1203015183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:22:47.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:47 smithi159 ceph-mon[69013]: from='client.41500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:22:47.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3983549419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:22:47.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1203015183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:22:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:48 smithi096 ceph-mon[101353]: pgmap v7220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:48 smithi159 ceph-mon[69013]: pgmap v7220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:50.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:50 smithi096 ceph-mon[101353]: pgmap v7221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:50 smithi159 ceph-mon[69013]: pgmap v7221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:52.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:52 smithi096 ceph-mon[101353]: pgmap v7222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:52 smithi159 ceph-mon[69013]: pgmap v7222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:54 smithi096 ceph-mon[101353]: pgmap v7223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:54 smithi159 ceph-mon[69013]: pgmap v7223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:56.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:56 smithi096 ceph-mon[101353]: pgmap v7224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:56 smithi159 ceph-mon[69013]: pgmap v7224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:22:58 smithi159 ceph-mon[69013]: pgmap v7225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:22:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:22:58 smithi096 ceph-mon[101353]: pgmap v7225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:00 smithi159 ceph-mon[69013]: pgmap v7226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:00 smithi096 ceph-mon[101353]: pgmap v7226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:02 smithi159 ceph-mon[69013]: pgmap v7227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:02 smithi096 ceph-mon[101353]: pgmap v7227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:04 smithi159 ceph-mon[69013]: pgmap v7228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:04 smithi096 ceph-mon[101353]: pgmap v7228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:06 smithi159 ceph-mon[69013]: pgmap v7229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:06 smithi096 ceph-mon[101353]: pgmap v7229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:08 smithi159 ceph-mon[69013]: pgmap v7230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:08 smithi096 ceph-mon[101353]: pgmap v7230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:10 smithi159 ceph-mon[69013]: pgmap v7231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:10 smithi096 ceph-mon[101353]: pgmap v7231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:12 smithi159 ceph-mon[69013]: pgmap v7232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:12 smithi096 ceph-mon[101353]: pgmap v7232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:14 smithi159 ceph-mon[69013]: pgmap v7233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:14 smithi096 ceph-mon[101353]: pgmap v7233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:16 smithi159 ceph-mon[69013]: pgmap v7234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:16.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 -- 172.21.15.96:0/3006771210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 msgr2=0x7f10180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:16.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 --2- 172.21.15.96:0/3006771210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f10180f6cc0 secure :-1 s=READY pgs=3695 cs=0 l=1 rev1=1 rx=0x7f1008004660 tx=0x7f1008009b30).stop 2022-02-02T22:23:16.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 -- 172.21.15.96:0/3006771210 shutdown_connections 2022-02-02T22:23:16.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 --2- 172.21.15.96:0/3006771210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f10180f6cc0 unknown :-1 s=CLOSED pgs=3695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 --2- 172.21.15.96:0/3006771210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 0x7f10180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 -- 172.21.15.96:0/3006771210 >> 172.21.15.96:0/3006771210 conn(0x7f10180f0d40 msgr2=0x7f10180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:16.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 -- 172.21.15.96:0/3006771210 shutdown_connections 2022-02-02T22:23:16.802 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:16 smithi096 ceph-mon[101353]: pgmap v7234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:16.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.798+0000 7f101d6d1700 1 -- 172.21.15.96:0/3006771210 wait complete. 2022-02-02T22:23:16.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 Processor -- start 2022-02-02T22:23:16.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 -- start start 2022-02-02T22:23:16.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 0x7f1018106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:16.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:16.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018107a10 con 0x7f10180f6860 2022-02-02T22:23:16.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f101d6d1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018107b50 con 0x7f10180f55c0 2022-02-02T22:23:16.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:16.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48130/0 (socket says 172.21.15.96:48130) 2022-02-02T22:23:16.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 -- 172.21.15.96:0/2669019682 learned_addr learned my addr 172.21.15.96:0/2669019682 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:16.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f1016ffd700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 0x7f1018106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:16.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 -- 172.21.15.96:0/2669019682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 msgr2=0x7f1018106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:16.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 0x7f1018106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.799+0000 7f10167fc700 1 -- 172.21.15.96:0/2669019682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008005040 con 0x7f10180f6860 2022-02-02T22:23:16.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f10167fc700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 secure :-1 s=READY pgs=3696 cs=0 l=1 rev1=1 rx=0x7f1008009990 tx=0x7f1008009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:16.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1008018070 con 0x7f10180f6860 2022-02-02T22:23:16.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1018108490 con 0x7f10180f6860 2022-02-02T22:23:16.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1008007ca0 con 0x7f10180f6860 2022-02-02T22:23:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100801c620 con 0x7f10180f6860 2022-02-02T22:23:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.800+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10181089f0 con 0x7f10180f6860 2022-02-02T22:23:16.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.801+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8004fa0 con 0x7f10180f6860 2022-02-02T22:23:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.802+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f100801c8e0 con 0x7f10180f6860 2022-02-02T22:23:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.802+0000 7f0fff7fe700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 0x7f1000067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:16.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.802+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f10080838b0 con 0x7f10180f6860 2022-02-02T22:23:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.802+0000 7f1016ffd700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 0x7f1000067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:16.813 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.802+0000 7f1016ffd700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 0x7f1000067290 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f10180f66c0 tx=0x7f100c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:16.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.806+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10080553e0 con 0x7f10180f6860 2022-02-02T22:23:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.986+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ff8000bc0 con 0x7f1000064dd0 2022-02-02T22:23:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.987+0000 7f0fff7fe700 1 -- 172.21.15.96:0/2669019682 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0ff8000bc0 con 0x7f1000064dd0 2022-02-02T22:23:16.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 msgr2=0x7f1000067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:16.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 0x7f1000067290 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f10180f66c0 tx=0x7f100c009040).stop 2022-02-02T22:23:16.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 msgr2=0x7f1018107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:16.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 secure :-1 s=READY pgs=3696 cs=0 l=1 rev1=1 rx=0x7f1008009990 tx=0x7f1008009b30).stop 2022-02-02T22:23:16.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 shutdown_connections 2022-02-02T22:23:16.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1000064dd0 0x7f1000067290 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10180f55c0 0x7f1018106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 --2- 172.21.15.96:0/2669019682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10180f6860 0x7f1018107460 unknown :-1 s=CLOSED pgs=3696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:16.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 >> 172.21.15.96:0/2669019682 conn(0x7f10180f0d40 msgr2=0x7f101805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 shutdown_connections 2022-02-02T22:23:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:16.989+0000 7f101d6d1700 1 -- 172.21.15.96:0/2669019682 wait complete. 2022-02-02T22:23:16.999 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:23:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- 172.21.15.96:0/1243085491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 msgr2=0x7f1de00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 --2- 172.21.15.96:0/1243085491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de00f6cc0 secure :-1 s=READY pgs=3697 cs=0 l=1 rev1=1 rx=0x7f1ddc004660 tx=0x7f1ddc009b30).stop 2022-02-02T22:23:17.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- 172.21.15.96:0/1243085491 shutdown_connections 2022-02-02T22:23:17.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 --2- 172.21.15.96:0/1243085491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de00f6cc0 unknown :-1 s=CLOSED pgs=3697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 --2- 172.21.15.96:0/1243085491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 0x7f1de00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- 172.21.15.96:0/1243085491 >> 172.21.15.96:0/1243085491 conn(0x7f1de00f0d40 msgr2=0x7f1de00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- 172.21.15.96:0/1243085491 shutdown_connections 2022-02-02T22:23:17.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- 172.21.15.96:0/1243085491 wait complete. 2022-02-02T22:23:17.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 Processor -- start 2022-02-02T22:23:17.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.088+0000 7f1de849f700 1 -- start start 2022-02-02T22:23:17.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 0x7f1de0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de01069b0 con 0x7f1de00f6860 2022-02-02T22:23:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de01071c0 con 0x7f1de00f55c0 2022-02-02T22:23:17.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48146/0 (socket says 172.21.15.96:48146) 2022-02-02T22:23:17.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 -- 172.21.15.96:0/879167231 learned_addr learned my addr 172.21.15.96:0/879167231 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:17.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de623b700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 0x7f1de0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 -- 172.21.15.96:0/879167231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 msgr2=0x7f1de0105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 0x7f1de0105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 -- 172.21.15.96:0/879167231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc005040 con 0x7f1de00f6860 2022-02-02T22:23:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de5a3a700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 secure :-1 s=READY pgs=3698 cs=0 l=1 rev1=1 rx=0x7f1ddc009990 tx=0x7f1ddc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc018070 con 0x7f1de00f6860 2022-02-02T22:23:17.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ddc007ba0 con 0x7f1de00f6860 2022-02-02T22:23:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc01c3c0 con 0x7f1de00f6860 2022-02-02T22:23:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de01073e0 con 0x7f1de00f6860 2022-02-02T22:23:17.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.089+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de0107940 con 0x7f1de00f6860 2022-02-02T22:23:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.090+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de00f49b0 con 0x7f1de00f6860 2022-02-02T22:23:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.091+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ddc01d420 con 0x7f1de00f6860 2022-02-02T22:23:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.091+0000 7f1dd6ffd700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.091+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ddc0836a0 con 0x7f1de00f6860 2022-02-02T22:23:17.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.091+0000 7f1de623b700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.092+0000 7f1de623b700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 0x7f1dcc067290 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f1de0105c30 tx=0x7f1dd000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.095+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ddc051860 con 0x7f1de00f6860 2022-02-02T22:23:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.270+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1de00fdf10 con 0x7f1dcc064dd0 2022-02-02T22:23:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.279+0000 7f1dd6ffd700 1 -- 172.21.15.96:0/879167231 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1de00fdf10 con 0x7f1dcc064dd0 2022-02-02T22:23:17.280 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:23:17.281 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:23:17.281 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:23:17.281 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:23:17.282 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:23:17.282 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:23:17.282 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:23:17.283 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:23:17.283 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (3h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:23:17.283 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:23:17.283 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:23:17.284 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:23:17.284 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (3h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:23:17.284 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:23:17.285 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:23:17.285 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:23:17.285 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:23:17.286 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:23:17.286 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:23:17.286 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:23:17.287 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:23:17.287 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:23:17.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 msgr2=0x7f1dcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 0x7f1dcc067290 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f1de0105c30 tx=0x7f1dd000b040).stop 2022-02-02T22:23:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 msgr2=0x7f1de01063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 secure :-1 s=READY pgs=3698 cs=0 l=1 rev1=1 rx=0x7f1ddc009990 tx=0x7f1ddc009b30).stop 2022-02-02T22:23:17.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 shutdown_connections 2022-02-02T22:23:17.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de00f55c0 0x7f1de0105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.281+0000 7f1de849f700 1 --2- 172.21.15.96:0/879167231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1de00f6860 0x7f1de01063b0 unknown :-1 s=CLOSED pgs=3698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.282+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 >> 172.21.15.96:0/879167231 conn(0x7f1de00f0d40 msgr2=0x7f1de00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.282+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 shutdown_connections 2022-02-02T22:23:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.282+0000 7f1de849f700 1 -- 172.21.15.96:0/879167231 wait complete. 2022-02-02T22:23:17.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 -- 172.21.15.96:0/1085248158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f6860 msgr2=0x7fe1340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/1085248158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f6860 0x7fe1340f6cc0 secure :-1 s=READY pgs=3699 cs=0 l=1 rev1=1 rx=0x7fe120004660 tx=0x7fe120009b30).stop 2022-02-02T22:23:17.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 -- 172.21.15.96:0/1085248158 shutdown_connections 2022-02-02T22:23:17.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/1085248158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f6860 0x7fe1340f6cc0 unknown :-1 s=CLOSED pgs=3699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/1085248158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f55c0 0x7fe1340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.379+0000 7fe13b0f9700 1 -- 172.21.15.96:0/1085248158 >> 172.21.15.96:0/1085248158 conn(0x7fe1340f0d40 msgr2=0x7fe1340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.380+0000 7fe13b0f9700 1 -- 172.21.15.96:0/1085248158 shutdown_connections 2022-02-02T22:23:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.380+0000 7fe13b0f9700 1 -- 172.21.15.96:0/1085248158 wait complete. 2022-02-02T22:23:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.380+0000 7fe13b0f9700 1 Processor -- start 2022-02-02T22:23:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe13b0f9700 1 -- start start 2022-02-02T22:23:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe13b0f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe13b0f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f6860 0x7fe13410c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe13b0f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134060420 con 0x7fe1340f55c0 2022-02-02T22:23:17.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe13b0f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134060560 con 0x7fe1340f6860 2022-02-02T22:23:17.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48154/0 (socket says 172.21.15.96:48154) 2022-02-02T22:23:17.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 -- 172.21.15.96:0/2715035957 learned_addr learned my addr 172.21.15.96:0/2715035957 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:17.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe133fff700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f6860 0x7fe13410c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 -- 172.21.15.96:0/2715035957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f6860 msgr2=0x7fe13410c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f6860 0x7fe13410c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.381+0000 7fe138e95700 1 -- 172.21.15.96:0/2715035957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120005040 con 0x7fe1340f55c0 2022-02-02T22:23:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe138e95700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 secure :-1 s=READY pgs=3700 cs=0 l=1 rev1=1 rx=0x7fe12800e7c0 tx=0x7fe12800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1280092e0 con 0x7fe1340f55c0 2022-02-02T22:23:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe12800f040 con 0x7fe1340f55c0 2022-02-02T22:23:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13410c690 con 0x7fe1340f55c0 2022-02-02T22:23:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13410cc20 con 0x7fe1340f55c0 2022-02-02T22:23:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.382+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1280147e0 con 0x7fe1340f55c0 2022-02-02T22:23:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.383+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1340f49b0 con 0x7fe1340f55c0 2022-02-02T22:23:17.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.383+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe12801b030 con 0x7fe1340f55c0 2022-02-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.384+0000 7fe1317fa700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 0x7fe124067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.384+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe128081910 con 0x7fe1340f55c0 2022-02-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.384+0000 7fe133fff700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 0x7fe124067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.384+0000 7fe133fff700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 0x7fe124067290 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7fe120005010 tx=0x7fe120016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.388+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe12804fa10 con 0x7fe1340f55c0 2022-02-02T22:23:17.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.617+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1340fdf10 con 0x7fe1340f55c0 2022-02-02T22:23:17.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.618+0000 7fe1317fa700 1 -- 172.21.15.96:0/2715035957 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe1280192e0 con 0x7fe1340f55c0 2022-02-02T22:23:17.619 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:23:17.620 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:23:17.620 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:23:17.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:17.621 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:23:17.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:23:17.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:17.622 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:23:17.622 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:23:17.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:17.623 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:23:17.623 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:23:17.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:17.624 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:23:17.624 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:23:17.625 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:23:17.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:23:17.625 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:23:17.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 msgr2=0x7fe124067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 0x7fe124067290 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7fe120005010 tx=0x7fe120016040).stop 2022-02-02T22:23:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 msgr2=0x7fe134109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 secure :-1 s=READY pgs=3700 cs=0 l=1 rev1=1 rx=0x7fe12800e7c0 tx=0x7fe12800b040).stop 2022-02-02T22:23:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 shutdown_connections 2022-02-02T22:23:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe124064dd0 0x7fe124067290 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340f55c0 0x7fe134109b80 unknown :-1 s=CLOSED pgs=3700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 --2- 172.21.15.96:0/2715035957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1340f6860 0x7fe13410c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 >> 172.21.15.96:0/2715035957 conn(0x7fe1340f0d40 msgr2=0x7fe1340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 shutdown_connections 2022-02-02T22:23:17.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.620+0000 7fe13b0f9700 1 -- 172.21.15.96:0/2715035957 wait complete. 2022-02-02T22:23:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 -- 172.21.15.96:0/2987399596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 msgr2=0x7efed40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 --2- 172.21.15.96:0/2987399596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed40f7c30 secure :-1 s=READY pgs=3701 cs=0 l=1 rev1=1 rx=0x7efec8004660 tx=0x7efec8009b30).stop 2022-02-02T22:23:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 -- 172.21.15.96:0/2987399596 shutdown_connections 2022-02-02T22:23:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 --2- 172.21.15.96:0/2987399596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed40f7c30 unknown :-1 s=CLOSED pgs=3701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 --2- 172.21.15.96:0/2987399596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 0x7efed40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 -- 172.21.15.96:0/2987399596 >> 172.21.15.96:0/2987399596 conn(0x7efed40f1c90 msgr2=0x7efed40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 -- 172.21.15.96:0/2987399596 shutdown_connections 2022-02-02T22:23:17.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.717+0000 7efed8b87700 1 -- 172.21.15.96:0/2987399596 wait complete. 2022-02-02T22:23:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 Processor -- start 2022-02-02T22:23:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 -- start start 2022-02-02T22:23:17.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 0x7efed4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4107880 con 0x7efed40f77d0 2022-02-02T22:23:17.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed8b87700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4108090 con 0x7efed40f6530 2022-02-02T22:23:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48166/0 (socket says 172.21.15.96:48166) 2022-02-02T22:23:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.718+0000 7efed2ffd700 1 -- 172.21.15.96:0/1609928669 learned_addr learned my addr 172.21.15.96:0/1609928669 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:17.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed37fe700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 0x7efed4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed2ffd700 1 -- 172.21.15.96:0/1609928669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 msgr2=0x7efed4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed2ffd700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 0x7efed4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed2ffd700 1 -- 172.21.15.96:0/1609928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8005040 con 0x7efed40f77d0 2022-02-02T22:23:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed2ffd700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 secure :-1 s=READY pgs=3702 cs=0 l=1 rev1=1 rx=0x7efec8009990 tx=0x7efec8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec8018070 con 0x7efed40f77d0 2022-02-02T22:23:17.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efec8007ca0 con 0x7efed40f77d0 2022-02-02T22:23:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed41082b0 con 0x7efed40f77d0 2022-02-02T22:23:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec801c620 con 0x7efed40f77d0 2022-02-02T22:23:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.719+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4108810 con 0x7efed40f77d0 2022-02-02T22:23:17.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.720+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed4059100 con 0x7efed40f77d0 2022-02-02T22:23:17.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.721+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efec801d960 con 0x7efed40f77d0 2022-02-02T22:23:17.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.721+0000 7efebbfff700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 0x7efebc0673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.721+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efec8083630 con 0x7efed40f77d0 2022-02-02T22:23:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.721+0000 7efed37fe700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 0x7efebc0673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.721+0000 7efed37fe700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 0x7efebc0673b0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7efed4106b00 tx=0x7efec4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.725+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efec80517b0 con 0x7efed40f77d0 2022-02-02T22:23:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.928+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efed40fede0 con 0x7efed40f77d0 2022-02-02T22:23:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.928+0000 7efebbfff700 1 -- 172.21.15.96:0/1609928669 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efec8054dd0 con 0x7efed40f77d0 2022-02-02T22:23:17.930 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:23:17.930 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:23:17.931 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:23:17.931 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:23:17.931 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:17.932 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:23:17.932 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:23:17.932 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:23:17.933 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:23:17.933 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:23:17.933 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:23:17.934 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:23:17.934 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:23:17.934 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:23:17.935 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:23:17.935 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:23:17.935 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:23:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:23:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:23:17.937 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:23:17.937 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:23:17.937 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:23:17.938 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:23:17.938 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:23:17.938 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:23:17.939 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:23:17.939 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:23:17.939 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:23:17.940 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:23:17.940 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:23:17.940 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:23:17.941 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:23:17.941 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:17.941 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:17.942 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:23:17.942 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:17.942 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:17.943 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:17.943 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:17.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 msgr2=0x7efebc0673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 0x7efebc0673b0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7efed4106b00 tx=0x7efec4009040).stop 2022-02-02T22:23:17.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 msgr2=0x7efed4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:17.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 secure :-1 s=READY pgs=3702 cs=0 l=1 rev1=1 rx=0x7efec8009990 tx=0x7efec8009b30).stop 2022-02-02T22:23:17.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 shutdown_connections 2022-02-02T22:23:17.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efebc064ef0 0x7efebc0673b0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efed40f6530 0x7efed4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 --2- 172.21.15.96:0/1609928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efed40f77d0 0x7efed4107280 unknown :-1 s=CLOSED pgs=3702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:17.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 >> 172.21.15.96:0/1609928669 conn(0x7efed40f1c90 msgr2=0x7efed40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:17.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 shutdown_connections 2022-02-02T22:23:17.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:17.930+0000 7efed8b87700 1 -- 172.21.15.96:0/1609928669 wait complete. 2022-02-02T22:23:17.948 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:23:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:18 smithi159 ceph-mon[69013]: from='client.41512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:18 smithi159 ceph-mon[69013]: pgmap v7235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:18 smithi159 ceph-mon[69013]: from='client.41516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2715035957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:23:18.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1609928669' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:23:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:18 smithi096 ceph-mon[101353]: from='client.41512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:18 smithi096 ceph-mon[101353]: pgmap v7235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:18 smithi096 ceph-mon[101353]: from='client.41516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2715035957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:23:18.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1609928669' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:23:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:20 smithi159 ceph-mon[69013]: pgmap v7236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:20 smithi096 ceph-mon[101353]: pgmap v7236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:22 smithi159 ceph-mon[69013]: pgmap v7237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:22 smithi096 ceph-mon[101353]: pgmap v7237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:24 smithi159 ceph-mon[69013]: pgmap v7238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:24 smithi096 ceph-mon[101353]: pgmap v7238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:26 smithi159 ceph-mon[69013]: pgmap v7239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:26 smithi096 ceph-mon[101353]: pgmap v7239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:28 smithi159 ceph-mon[69013]: pgmap v7240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:23:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:23:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:28 smithi096 ceph-mon[101353]: pgmap v7240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:23:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:23:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:30 smithi159 ceph-mon[69013]: pgmap v7241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:31.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:30 smithi096 ceph-mon[101353]: pgmap v7241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:32 smithi159 ceph-mon[69013]: pgmap v7242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:32 smithi096 ceph-mon[101353]: pgmap v7242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:34 smithi159 ceph-mon[69013]: pgmap v7243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:34 smithi096 ceph-mon[101353]: pgmap v7243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:36 smithi159 ceph-mon[69013]: pgmap v7244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:36 smithi096 ceph-mon[101353]: pgmap v7244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:38 smithi159 ceph-mon[69013]: pgmap v7245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:38 smithi096 ceph-mon[101353]: pgmap v7245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:40 smithi159 ceph-mon[69013]: pgmap v7246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:40 smithi096 ceph-mon[101353]: pgmap v7246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:42 smithi159 ceph-mon[69013]: pgmap v7247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:42 smithi096 ceph-mon[101353]: pgmap v7247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:44 smithi159 ceph-mon[69013]: pgmap v7248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:44 smithi096 ceph-mon[101353]: pgmap v7248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:46 smithi159 ceph-mon[69013]: pgmap v7249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:46 smithi096 ceph-mon[101353]: pgmap v7249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:48.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- 172.21.15.96:0/3891580697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f6860 msgr2=0x7fae840f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/3891580697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f6860 0x7fae840f6cc0 secure :-1 s=READY pgs=3703 cs=0 l=1 rev1=1 rx=0x7fae74004660 tx=0x7fae74009b30).stop 2022-02-02T22:23:48.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- 172.21.15.96:0/3891580697 shutdown_connections 2022-02-02T22:23:48.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/3891580697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f6860 0x7fae840f6cc0 unknown :-1 s=CLOSED pgs=3703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/3891580697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f55c0 0x7fae840f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:23:48.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- 172.21.15.96:0/3891580697 >> 172.21.15.96:0/3891580697 conn(0x7fae840f0d40 msgr2=0x7fae840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- 172.21.15.96:0/3891580697 shutdown_connections 2022-02-02T22:23:48.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- 172.21.15.96:0/3891580697 wait complete. 2022-02-02T22:23:48.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 Processor -- start 2022-02-02T22:23:48.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.041+0000 7fae8bcfc700 1 -- start start 2022-02-02T22:23:48.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae8bcfc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae8bcfc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f6860 0x7fae84107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae8bcfc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae84107ab0 con 0x7fae840f55c0 2022-02-02T22:23:48.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae8bcfc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae84108360 con 0x7fae840f6860 2022-02-02T22:23:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48194/0 (socket says 172.21.15.96:48194) 2022-02-02T22:23:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 -- 172.21.15.96:0/2920179194 learned_addr learned my addr 172.21.15.96:0/2920179194 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89297700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f6860 0x7fae84107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 -- 172.21.15.96:0/2920179194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f6860 msgr2=0x7fae84107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f6860 0x7fae84107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 -- 172.21.15.96:0/2920179194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74005040 con 0x7fae840f55c0 2022-02-02T22:23:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae89a98700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 secure :-1 s=READY pgs=3704 cs=0 l=1 rev1=1 rx=0x7fae800093f0 tx=0x7fae80006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae80009ea0 con 0x7fae840f55c0 2022-02-02T22:23:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fae80013af0 con 0x7fae840f55c0 2022-02-02T22:23:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae84108640 con 0x7fae840f55c0 2022-02-02T22:23:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.042+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8000db10 con 0x7fae840f55c0 2022-02-02T22:23:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.043+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae84108c00 con 0x7fae840f55c0 2022-02-02T22:23:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.043+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae840f49b0 con 0x7fae840f55c0 2022-02-02T22:23:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.044+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fae8001a060 con 0x7fae840f55c0 2022-02-02T22:23:48.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.044+0000 7fae7a7fc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 0x7fae70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.044+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fae800819d0 con 0x7fae840f55c0 2022-02-02T22:23:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.045+0000 7fae89297700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 0x7fae70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.045+0000 7fae89297700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 0x7fae70067290 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7fae74004e30 tx=0x7fae74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.049+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fae80053500 con 0x7fae840f55c0 2022-02-02T22:23:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.230+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae840faca0 con 0x7fae70064dd0 2022-02-02T22:23:48.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.232+0000 7fae7a7fc700 1 -- 172.21.15.96:0/2920179194 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fae840faca0 con 0x7fae70064dd0 2022-02-02T22:23:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 msgr2=0x7fae70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 0x7fae70067290 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7fae74004e30 tx=0x7fae74009b30).stop 2022-02-02T22:23:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 msgr2=0x7fae84106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 secure :-1 s=READY pgs=3704 cs=0 l=1 rev1=1 rx=0x7fae800093f0 tx=0x7fae80006ec0).stop 2022-02-02T22:23:48.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 shutdown_connections 2022-02-02T22:23:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fae70064dd0 0x7fae70067290 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae840f55c0 0x7fae84106f80 unknown :-1 s=CLOSED pgs=3704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 --2- 172.21.15.96:0/2920179194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae840f6860 0x7fae84107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 >> 172.21.15.96:0/2920179194 conn(0x7fae840f0d40 msgr2=0x7fae8405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.233+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 shutdown_connections 2022-02-02T22:23:48.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.234+0000 7fae8bcfc700 1 -- 172.21.15.96:0/2920179194 wait complete. 2022-02-02T22:23:48.243 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:23:48.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- 172.21.15.96:0/563704830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f77d0 msgr2=0x7fc81c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 --2- 172.21.15.96:0/563704830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f77d0 0x7fc81c0f7c30 secure :-1 s=READY pgs=3705 cs=0 l=1 rev1=1 rx=0x7fc80c004660 tx=0x7fc80c009b30).stop 2022-02-02T22:23:48.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- 172.21.15.96:0/563704830 shutdown_connections 2022-02-02T22:23:48.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 --2- 172.21.15.96:0/563704830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f77d0 0x7fc81c0f7c30 unknown :-1 s=CLOSED pgs=3705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 --2- 172.21.15.96:0/563704830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f6530 0x7fc81c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- 172.21.15.96:0/563704830 >> 172.21.15.96:0/563704830 conn(0x7fc81c0f1c90 msgr2=0x7fc81c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- 172.21.15.96:0/563704830 shutdown_connections 2022-02-02T22:23:48.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- 172.21.15.96:0/563704830 wait complete. 2022-02-02T22:23:48.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 Processor -- start 2022-02-02T22:23:48.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.333+0000 7fc8231f1700 1 -- start start 2022-02-02T22:23:48.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8231f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8231f1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f77d0 0x7fc81c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8231f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c107880 con 0x7fc81c0f6530 2022-02-02T22:23:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8231f1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c108090 con 0x7fc81c0f77d0 2022-02-02T22:23:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48204/0 (socket says 172.21.15.96:48204) 2022-02-02T22:23:48.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 -- 172.21.15.96:0/2999379203 learned_addr learned my addr 172.21.15.96:0/2999379203 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:48.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8219ee700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f77d0 0x7fc81c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 -- 172.21.15.96:0/2999379203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f77d0 msgr2=0x7fc81c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f77d0 0x7fc81c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 -- 172.21.15.96:0/2999379203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c005040 con 0x7fc81c0f6530 2022-02-02T22:23:48.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc8221ef700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 secure :-1 s=READY pgs=3706 cs=0 l=1 rev1=1 rx=0x7fc818002700 tx=0x7fc818009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8180079c0 con 0x7fc81c0f6530 2022-02-02T22:23:48.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.334+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc81800f040 con 0x7fc81c0f6530 2022-02-02T22:23:48.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.335+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c108310 con 0x7fc81c0f6530 2022-02-02T22:23:48.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.335+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc818014860 con 0x7fc81c0f6530 2022-02-02T22:23:48.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.335+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c1088d0 con 0x7fc81c0f6530 2022-02-02T22:23:48.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.335+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c059100 con 0x7fc81c0f6530 2022-02-02T22:23:48.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.336+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc81801b060 con 0x7fc81c0f6530 2022-02-02T22:23:48.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.336+0000 7fc812ffd700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 0x7fc8080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.336+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc818081810 con 0x7fc81c0f6530 2022-02-02T22:23:48.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.336+0000 7fc8219ee700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 0x7fc8080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.337+0000 7fc8219ee700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 0x7fc8080672e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fc80c004e30 tx=0x7fc80c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.341+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc81804f910 con 0x7fc81c0f6530 2022-02-02T22:23:48.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.514+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc81c0fedd0 con 0x7fc808064e20 2022-02-02T22:23:48.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.523+0000 7fc812ffd700 1 -- 172.21.15.96:0/2999379203 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc81c0fedd0 con 0x7fc808064e20 2022-02-02T22:23:48.523 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:23:48.524 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:23:48.524 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:23:48.524 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (3h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:23:48.525 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:23:48.525 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:23:48.525 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (3h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:23:48.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:23:48.526 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:23:48.527 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:23:48.527 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:23:48.527 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:23:48.528 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:23:48.528 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:23:48.528 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:23:48.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:23:48.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:23:48.529 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:23:48.530 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:23:48.530 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:23:48.531 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:23:48.531 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:23:48.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 msgr2=0x7fc8080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.532 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 0x7fc8080672e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fc80c004e30 tx=0x7fc80c009b30).stop 2022-02-02T22:23:48.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 msgr2=0x7fc81c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 secure :-1 s=READY pgs=3706 cs=0 l=1 rev1=1 rx=0x7fc818002700 tx=0x7fc818009d80).stop 2022-02-02T22:23:48.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 shutdown_connections 2022-02-02T22:23:48.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc808064e20 0x7fc8080672e0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc81c0f6530 0x7fc81c106d90 unknown :-1 s=CLOSED pgs=3706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 --2- 172.21.15.96:0/2999379203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc81c0f77d0 0x7fc81c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 >> 172.21.15.96:0/2999379203 conn(0x7fc81c0f1c90 msgr2=0x7fc81c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 shutdown_connections 2022-02-02T22:23:48.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.525+0000 7fc8231f1700 1 -- 172.21.15.96:0/2999379203 wait complete. 2022-02-02T22:23:48.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 -- 172.21.15.96:0/115664346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f4d60 msgr2=0x7f09a00f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 --2- 172.21.15.96:0/115664346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f4d60 0x7f09a00f5180 secure :-1 s=READY pgs=3707 cs=0 l=1 rev1=1 rx=0x7f0990004660 tx=0x7f0990009b30).stop 2022-02-02T22:23:48.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 -- 172.21.15.96:0/115664346 shutdown_connections 2022-02-02T22:23:48.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 --2- 172.21.15.96:0/115664346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f5f60 0x7f09a00f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 --2- 172.21.15.96:0/115664346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f4d60 0x7f09a00f5180 unknown :-1 s=CLOSED pgs=3707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 -- 172.21.15.96:0/115664346 >> 172.21.15.96:0/115664346 conn(0x7f09a00f04c0 msgr2=0x7f09a00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 -- 172.21.15.96:0/115664346 shutdown_connections 2022-02-02T22:23:48.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:48 smithi096 ceph-mon[101353]: pgmap v7250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:48.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 -- 172.21.15.96:0/115664346 wait complete. 2022-02-02T22:23:48.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.621+0000 7f09a68fd700 1 Processor -- start 2022-02-02T22:23:48.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f09a68fd700 1 -- start start 2022-02-02T22:23:48.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f09a68fd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 0x7f09a00f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f09a68fd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f09a68fd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00f7890 con 0x7f09a00f5f60 2022-02-02T22:23:48.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f09a68fd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00f79d0 con 0x7f09a00f4d60 2022-02-02T22:23:48.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48216/0 (socket says 172.21.15.96:48216) 2022-02-02T22:23:48.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 -- 172.21.15.96:0/3490433820 learned_addr learned my addr 172.21.15.96:0/3490433820 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:48.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099ffff700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 0x7f09a00f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 -- 172.21.15.96:0/3490433820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 msgr2=0x7f09a00f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 0x7f09a00f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 -- 172.21.15.96:0/3490433820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990005040 con 0x7f09a00f5f60 2022-02-02T22:23:48.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099ffff700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 0x7f09a00f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:23:48.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.622+0000 7f099f7fe700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 secure :-1 s=READY pgs=3708 cs=0 l=1 rev1=1 rx=0x7f098800c790 tx=0x7f0988007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.623+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098800e680 con 0x7f09a00f5f60 2022-02-02T22:23:48.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.623+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f098800ec90 con 0x7f09a00f5f60 2022-02-02T22:23:48.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.623+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00f7cb0 con 0x7f09a00f5f60 2022-02-02T22:23:48.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.623+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0988013d60 con 0x7f09a00f5f60 2022-02-02T22:23:48.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.623+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a010f030 con 0x7f09a00f5f60 2022-02-02T22:23:48.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.624+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0045ad0 con 0x7f09a00f5f60 2022-02-02T22:23:48.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.625+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f098801a060 con 0x7f09a00f5f60 2022-02-02T22:23:48.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.625+0000 7f099cff9700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 0x7f098c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.625+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0988081be0 con 0x7f09a00f5f60 2022-02-02T22:23:48.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.625+0000 7f099ffff700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 0x7f098c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.626+0000 7f099ffff700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 0x7f098c067290 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7f0990004e30 tx=0x7f0990009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.630+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f098804fc80 con 0x7f09a00f5f60 2022-02-02T22:23:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:48 smithi159 ceph-mon[69013]: pgmap v7250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:48.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.860+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09a00586e0 con 0x7f09a00f5f60 2022-02-02T22:23:48.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.861+0000 7f099cff9700 1 -- 172.21.15.96:0/3490433820 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f09880182e0 con 0x7f09a00f5f60 2022-02-02T22:23:48.861 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:23:48.862 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:23:48.862 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:23:48.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:48.863 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:23:48.863 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:23:48.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:48.864 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:23:48.864 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:23:48.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:48.865 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:23:48.865 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:23:48.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:23:48.866 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:23:48.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:23:48.867 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:23:48.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:23:48.868 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:23:48.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 msgr2=0x7f098c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 0x7f098c067290 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7f0990004e30 tx=0x7f0990009b30).stop 2022-02-02T22:23:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 msgr2=0x7f09a00f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 secure :-1 s=READY pgs=3708 cs=0 l=1 rev1=1 rx=0x7f098800c790 tx=0x7f0988007d70).stop 2022-02-02T22:23:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 shutdown_connections 2022-02-02T22:23:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f098c064dd0 0x7f098c067290 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09a00f4d60 0x7f09a00f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 --2- 172.21.15.96:0/3490433820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a00f5f60 0x7f09a00f7330 unknown :-1 s=CLOSED pgs=3708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.862+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 >> 172.21.15.96:0/3490433820 conn(0x7f09a00f04c0 msgr2=0x7f09a00fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.863+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 shutdown_connections 2022-02-02T22:23:48.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.863+0000 7f09a68fd700 1 -- 172.21.15.96:0/3490433820 wait complete. 2022-02-02T22:23:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 -- 172.21.15.96:0/3643839433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 msgr2=0x7f7dc40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/3643839433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc40f6b00 secure :-1 s=READY pgs=3709 cs=0 l=1 rev1=1 rx=0x7f7db8004660 tx=0x7f7db8009b30).stop 2022-02-02T22:23:48.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 -- 172.21.15.96:0/3643839433 shutdown_connections 2022-02-02T22:23:48.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/3643839433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/3643839433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc40f6b00 unknown :-1 s=CLOSED pgs=3709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 -- 172.21.15.96:0/3643839433 >> 172.21.15.96:0/3643839433 conn(0x7f7dc40f1e40 msgr2=0x7f7dc40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:48.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 -- 172.21.15.96:0/3643839433 shutdown_connections 2022-02-02T22:23:48.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.960+0000 7f7dc9c81700 1 -- 172.21.15.96:0/3643839433 wait complete. 2022-02-02T22:23:48.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 Processor -- start 2022-02-02T22:23:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 -- start start 2022-02-02T22:23:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4107a50 con 0x7f7dc40f66e0 2022-02-02T22:23:48.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.961+0000 7f7dc9c81700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4107b90 con 0x7f7dc40f7980 2022-02-02T22:23:48.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48224/0 (socket says 172.21.15.96:48224) 2022-02-02T22:23:48.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 -- 172.21.15.96:0/1046412188 learned_addr learned my addr 172.21.15.96:0/1046412188 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:23:48.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc2ffd700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 -- 172.21.15.96:0/1046412188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 msgr2=0x7f7dc41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 -- 172.21.15.96:0/1046412188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8005040 con 0x7f7dc40f66e0 2022-02-02T22:23:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc37fe700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 secure :-1 s=READY pgs=3710 cs=0 l=1 rev1=1 rx=0x7f7db8004f60 tx=0x7f7db8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db8018070 con 0x7f7dc40f66e0 2022-02-02T22:23:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7db8007ba0 con 0x7f7dc40f66e0 2022-02-02T22:23:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc41084d0 con 0x7f7dc40f66e0 2022-02-02T22:23:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db801c620 con 0x7f7dc40f66e0 2022-02-02T22:23:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.962+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4108a30 con 0x7f7dc40f66e0 2022-02-02T22:23:48.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.964+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4045ad0 con 0x7f7dc40f66e0 2022-02-02T22:23:48.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.964+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7db801d420 con 0x7f7dc40f66e0 2022-02-02T22:23:48.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.964+0000 7f7dabfff700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 0x7f7dac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:23:48.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.964+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7db8083960 con 0x7f7dc40f66e0 2022-02-02T22:23:48.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.964+0000 7f7dc2ffd700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 0x7f7dac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:23:48.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.965+0000 7f7dc2ffd700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 0x7f7dac067290 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f7db40041d0 tx=0x7f7db4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:23:48.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:48.968+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7db8055550 con 0x7f7dc40f66e0 2022-02-02T22:23:49.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.169+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7dc40fef40 con 0x7f7dc40f66e0 2022-02-02T22:23:49.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.170+0000 7f7dabfff700 1 -- 172.21.15.96:0/1046412188 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7db8055140 con 0x7f7dc40f66e0 2022-02-02T22:23:49.171 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:23:49.171 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:23:49.172 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:23:49.172 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:23:49.172 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:49.173 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:23:49.173 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:23:49.174 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:23:49.174 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:23:49.174 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:23:49.175 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:23:49.175 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:23:49.176 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:23:49.176 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:23:49.176 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:23:49.177 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:23:49.177 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:23:49.177 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:23:49.178 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:23:49.178 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:23:49.178 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:23:49.179 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:23:49.179 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:23:49.179 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:23:49.180 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:23:49.180 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:23:49.181 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:23:49.181 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:23:49.181 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:23:49.182 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:23:49.182 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:23:49.182 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:23:49.183 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:49.183 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:49.183 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:23:49.184 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:23:49.184 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:49.184 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:49.185 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:23:49.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.171+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 msgr2=0x7f7dac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:49.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.171+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 0x7f7dac067290 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f7db40041d0 tx=0x7f7db4009040).stop 2022-02-02T22:23:49.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.171+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 msgr2=0x7f7dc4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:23:49.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.171+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 secure :-1 s=READY pgs=3710 cs=0 l=1 rev1=1 rx=0x7f7db8004f60 tx=0x7f7db8009b30).stop 2022-02-02T22:23:49.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 shutdown_connections 2022-02-02T22:23:49.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dac064dd0 0x7f7dac067290 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:49.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dc40f66e0 0x7f7dc4106fb0 unknown :-1 s=CLOSED pgs=3710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:49.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 --2- 172.21.15.96:0/1046412188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc40f7980 0x7f7dc41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:23:49.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 >> 172.21.15.96:0/1046412188 conn(0x7f7dc40f1e40 msgr2=0x7f7dc40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:23:49.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 shutdown_connections 2022-02-02T22:23:49.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:23:49.172+0000 7f7dc9c81700 1 -- 172.21.15.96:0/1046412188 wait complete. 2022-02-02T22:23:49.190 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:23:49.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:49 smithi159 ceph-mon[69013]: from='client.41528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:49.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:49 smithi159 ceph-mon[69013]: from='client.41532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:49.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3490433820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:23:49.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1046412188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:23:49.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:49 smithi096 ceph-mon[101353]: from='client.41528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:49.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:49 smithi096 ceph-mon[101353]: from='client.41532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:23:49.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3490433820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:23:49.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1046412188' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:23:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:50 smithi159 ceph-mon[69013]: pgmap v7251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:50 smithi096 ceph-mon[101353]: pgmap v7251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:52 smithi159 ceph-mon[69013]: pgmap v7252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:52 smithi096 ceph-mon[101353]: pgmap v7252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:54 smithi159 ceph-mon[69013]: pgmap v7253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:54 smithi096 ceph-mon[101353]: pgmap v7253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:56 smithi159 ceph-mon[69013]: pgmap v7254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:56 smithi096 ceph-mon[101353]: pgmap v7254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:23:58 smithi159 ceph-mon[69013]: pgmap v7255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:23:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:23:58 smithi096 ceph-mon[101353]: pgmap v7255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:00 smithi159 ceph-mon[69013]: pgmap v7256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:00 smithi096 ceph-mon[101353]: pgmap v7256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:02 smithi159 ceph-mon[69013]: pgmap v7257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:02 smithi096 ceph-mon[101353]: pgmap v7257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:04 smithi159 ceph-mon[69013]: pgmap v7258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:04 smithi096 ceph-mon[101353]: pgmap v7258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:06.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:06 smithi159 ceph-mon[69013]: pgmap v7259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:06 smithi096 ceph-mon[101353]: pgmap v7259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:08.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:08 smithi159 ceph-mon[69013]: pgmap v7260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:08 smithi096 ceph-mon[101353]: pgmap v7260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:10 smithi159 ceph-mon[69013]: pgmap v7261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:10 smithi096 ceph-mon[101353]: pgmap v7261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:12 smithi159 ceph-mon[69013]: pgmap v7262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:12 smithi096 ceph-mon[101353]: pgmap v7262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:14 smithi159 ceph-mon[69013]: pgmap v7263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:14 smithi096 ceph-mon[101353]: pgmap v7263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:16 smithi159 ceph-mon[69013]: pgmap v7264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:16 smithi096 ceph-mon[101353]: pgmap v7264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:18 smithi159 ceph-mon[69013]: pgmap v7265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:18 smithi096 ceph-mon[101353]: pgmap v7265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:19.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.281+0000 7fc0e1031700 1 -- 172.21.15.96:0/4209668557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f6860 msgr2=0x7fc0dc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.281+0000 7fc0e1031700 1 --2- 172.21.15.96:0/4209668557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc0f6cc0 secure :-1 s=READY pgs=3711 cs=0 l=1 rev1=1 rx=0x7fc0cc004660 tx=0x7fc0cc009b30).stop 2022-02-02T22:24:19.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 -- 172.21.15.96:0/4209668557 shutdown_connections 2022-02-02T22:24:19.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 --2- 172.21.15.96:0/4209668557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc0f6cc0 unknown :-1 s=CLOSED pgs=3711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 --2- 172.21.15.96:0/4209668557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:24:19.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 -- 172.21.15.96:0/4209668557 >> 172.21.15.96:0/4209668557 conn(0x7fc0dc0f0d40 msgr2=0x7fc0dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:19.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 -- 172.21.15.96:0/4209668557 shutdown_connections 2022-02-02T22:24:19.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 -- 172.21.15.96:0/4209668557 wait complete. 2022-02-02T22:24:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 Processor -- start 2022-02-02T22:24:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.282+0000 7fc0e1031700 1 -- start start 2022-02-02T22:24:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0e1031700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0e1031700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0e1031700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0602b0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0e1031700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0603f0 con 0x7fc0dc0f6860 2022-02-02T22:24:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48248/0 (socket says 172.21.15.96:48248) 2022-02-02T22:24:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 -- 172.21.15.96:0/2221844686 learned_addr learned my addr 172.21.15.96:0/2221844686 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0da59c700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 -- 172.21.15.96:0/2221844686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f6860 msgr2=0x7fc0dc10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc10e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 -- 172.21.15.96:0/2221844686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc005040 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0dad9d700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 secure :-1 s=READY pgs=3712 cs=0 l=1 rev1=1 rx=0x7fc0d00093f0 tx=0x7fc0d0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d0009ea0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0d0013af0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc10eac0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.283+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d000db10 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.284+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc10efa0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.284+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc045ad0 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.285+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc0d001a060 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.285+0000 7fc0c37fe700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 0x7fc0c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.286+0000 7fc0da59c700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 0x7fc0c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.286+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc0d0081a90 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.286+0000 7fc0da59c700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 0x7fc0c4067290 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fc0cc004e30 tx=0x7fc0cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.290+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc0d004fb90 con 0x7fc0dc0f55c0 2022-02-02T22:24:19.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.469+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0dc057f10 con 0x7fc0c4064dd0 2022-02-02T22:24:19.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.470+0000 7fc0c37fe700 1 -- 172.21.15.96:0/2221844686 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc0dc057f10 con 0x7fc0c4064dd0 2022-02-02T22:24:19.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 msgr2=0x7fc0c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 0x7fc0c4067290 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fc0cc004e30 tx=0x7fc0cc009b30).stop 2022-02-02T22:24:19.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 msgr2=0x7fc0dc10c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 secure :-1 s=READY pgs=3712 cs=0 l=1 rev1=1 rx=0x7fc0d00093f0 tx=0x7fc0d0006ec0).stop 2022-02-02T22:24:19.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 shutdown_connections 2022-02-02T22:24:19.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc0c4064dd0 0x7fc0c4067290 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0dc0f55c0 0x7fc0dc10c0d0 unknown :-1 s=CLOSED pgs=3712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 --2- 172.21.15.96:0/2221844686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0dc0f6860 0x7fc0dc10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 >> 172.21.15.96:0/2221844686 conn(0x7fc0dc0f0d40 msgr2=0x7fc0dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:19.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 shutdown_connections 2022-02-02T22:24:19.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.472+0000 7fc0e1031700 1 -- 172.21.15.96:0/2221844686 wait complete. 2022-02-02T22:24:19.482 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:24:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 -- 172.21.15.96:0/97347161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 msgr2=0x7f40780f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 --2- 172.21.15.96:0/97347161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40780f6b30 secure :-1 s=READY pgs=3713 cs=0 l=1 rev1=1 rx=0x7f4068004660 tx=0x7f4068009b30).stop 2022-02-02T22:24:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 -- 172.21.15.96:0/97347161 shutdown_connections 2022-02-02T22:24:19.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 --2- 172.21.15.96:0/97347161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40780f6b30 unknown :-1 s=CLOSED pgs=3713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 --2- 172.21.15.96:0/97347161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 0x7f40780f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 -- 172.21.15.96:0/97347161 >> 172.21.15.96:0/97347161 conn(0x7f40780f0b90 msgr2=0x7f40780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 -- 172.21.15.96:0/97347161 shutdown_connections 2022-02-02T22:24:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.570+0000 7f407ebb6700 1 -- 172.21.15.96:0/97347161 wait complete. 2022-02-02T22:24:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 Processor -- start 2022-02-02T22:24:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 -- start start 2022-02-02T22:24:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 0x7f4078105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078106760 con 0x7f40780f66d0 2022-02-02T22:24:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407ebb6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078106f60 con 0x7f40780f5430 2022-02-02T22:24:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.571+0000 7f407d3b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48258/0 (socket says 172.21.15.96:48258) 2022-02-02T22:24:19.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 -- 172.21.15.96:0/2950003150 learned_addr learned my addr 172.21.15.96:0/2950003150 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:19.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407dbb4700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 0x7f4078105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 -- 172.21.15.96:0/2950003150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 msgr2=0x7f4078105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 0x7f4078105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 -- 172.21.15.96:0/2950003150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068005040 con 0x7f40780f66d0 2022-02-02T22:24:19.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407d3b3700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 secure :-1 s=READY pgs=3714 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4068018070 con 0x7f40780f66d0 2022-02-02T22:24:19.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4068007ba0 con 0x7f40780f66d0 2022-02-02T22:24:19.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40781071e0 con 0x7f40780f66d0 2022-02-02T22:24:19.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406801c3c0 con 0x7f40780f66d0 2022-02-02T22:24:19.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.572+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4078107740 con 0x7f40780f66d0 2022-02-02T22:24:19.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.573+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078059100 con 0x7f40780f66d0 2022-02-02T22:24:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.574+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f406801d420 con 0x7f40780f66d0 2022-02-02T22:24:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.574+0000 7f406e7fc700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.574+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4068083630 con 0x7f40780f66d0 2022-02-02T22:24:19.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.574+0000 7f407dbb4700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.574+0000 7f407dbb4700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f40780f6530 tx=0x7f407400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.578+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4068055160 con 0x7f40780f66d0 2022-02-02T22:24:19.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.753+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f407805f620 con 0x7f4064064e20 2022-02-02T22:24:19.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.763+0000 7f406e7fc700 1 -- 172.21.15.96:0/2950003150 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f407805f620 con 0x7f4064064e20 2022-02-02T22:24:19.763 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:24:19.763 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:24:19.764 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:24:19.764 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:24:19.764 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:24:19.765 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:24:19.765 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:24:19.765 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:24:19.766 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:24:19.766 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:24:19.767 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:24:19.767 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:24:19.767 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:24:19.768 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:24:19.768 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:24:19.768 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:24:19.769 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:24:19.769 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:24:19.769 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:24:19.770 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:24:19.770 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:24:19.771 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:24:19.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 msgr2=0x7f40640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f40780f6530 tx=0x7f407400b040).stop 2022-02-02T22:24:19.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 msgr2=0x7f40781061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 secure :-1 s=READY pgs=3714 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009b30).stop 2022-02-02T22:24:19.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 shutdown_connections 2022-02-02T22:24:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4064064e20 0x7f40640672e0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40780f5430 0x7f4078105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 --2- 172.21.15.96:0/2950003150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40780f66d0 0x7f40781061b0 unknown :-1 s=CLOSED pgs=3714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 >> 172.21.15.96:0/2950003150 conn(0x7f40780f0b90 msgr2=0x7f40780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:19.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 shutdown_connections 2022-02-02T22:24:19.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.765+0000 7f407ebb6700 1 -- 172.21.15.96:0/2950003150 wait complete. 2022-02-02T22:24:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 -- 172.21.15.96:0/319909079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f43e0 msgr2=0x7f1d2c0f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/319909079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c0f4800 secure :-1 s=READY pgs=3715 cs=0 l=1 rev1=1 rx=0x7f1d1c004660 tx=0x7f1d1c009b30).stop 2022-02-02T22:24:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 -- 172.21.15.96:0/319909079 shutdown_connections 2022-02-02T22:24:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/319909079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/319909079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c0f4800 unknown :-1 s=CLOSED pgs=3715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 -- 172.21.15.96:0/319909079 >> 172.21.15.96:0/319909079 conn(0x7f1d2c0f0080 msgr2=0x7f1d2c0f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 -- 172.21.15.96:0/319909079 shutdown_connections 2022-02-02T22:24:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.861+0000 7f1d31c5a700 1 -- 172.21.15.96:0/319909079 wait complete. 2022-02-02T22:24:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.862+0000 7f1d31c5a700 1 Processor -- start 2022-02-02T22:24:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.862+0000 7f1d31c5a700 1 -- start start 2022-02-02T22:24:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d31c5a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d31c5a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d31c5a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c1079e0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d31c5a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c107b20 con 0x7f1d2c0f43e0 2022-02-02T22:24:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48268/0 (socket says 172.21.15.96:48268) 2022-02-02T22:24:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 -- 172.21.15.96:0/4102689008 learned_addr learned my addr 172.21.15.96:0/4102689008 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2b7fe700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 -- 172.21.15.96:0/4102689008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f43e0 msgr2=0x7f1d2c106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 -- 172.21.15.96:0/4102689008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c005040 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.863+0000 7f1d2affd700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 secure :-1 s=READY pgs=3716 cs=0 l=1 rev1=1 rx=0x7f1d200026d0 tx=0x7f1d20009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.864+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d200079c0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.864+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d2000f040 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.864+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d200148b0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.864+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c1084c0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.864+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c108a80 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.865+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1d20014a30 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.865+0000 7f1d13fff700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 0x7f1d14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.865+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c045ad0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.866+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1d20081020 con 0x7f1d2c0f4cf0 2022-02-02T22:24:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.866+0000 7f1d2b7fe700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 0x7f1d14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.866+0000 7f1d2b7fe700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 0x7f1d14067290 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f1d1c004630 tx=0x7f1d1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:19.870+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1d20086060 con 0x7f1d2c0f4cf0 2022-02-02T22:24:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.098+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d2c108cd0 con 0x7f1d2c0f4cf0 2022-02-02T22:24:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.098+0000 7f1d13fff700 1 -- 172.21.15.96:0/4102689008 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1d20052c10 con 0x7f1d2c0f4cf0 2022-02-02T22:24:20.100 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:24:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:24:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:24:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:24:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:24:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:24:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:24:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:24:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:24:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:24:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:24:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:24:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:24:20.106 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:24:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 msgr2=0x7f1d14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 0x7f1d14067290 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f1d1c004630 tx=0x7f1d1c009b30).stop 2022-02-02T22:24:20.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 msgr2=0x7f1d2c107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 secure :-1 s=READY pgs=3716 cs=0 l=1 rev1=1 rx=0x7f1d200026d0 tx=0x7f1d20009de0).stop 2022-02-02T22:24:20.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 shutdown_connections 2022-02-02T22:24:20.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1d14064dd0 0x7f1d14067290 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2c0f43e0 0x7f1d2c106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 --2- 172.21.15.96:0/4102689008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d2c0f4cf0 0x7f1d2c107430 unknown :-1 s=CLOSED pgs=3716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 >> 172.21.15.96:0/4102689008 conn(0x7f1d2c0f0080 msgr2=0x7f1d2c0f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 shutdown_connections 2022-02-02T22:24:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.100+0000 7f1d31c5a700 1 -- 172.21.15.96:0/4102689008 wait complete. 2022-02-02T22:24:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 -- 172.21.15.96:0/1421247755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 msgr2=0x7f77600f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 --2- 172.21.15.96:0/1421247755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f5c50 secure :-1 s=READY pgs=3717 cs=0 l=1 rev1=1 rx=0x7f775c004660 tx=0x7f775c009b30).stop 2022-02-02T22:24:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 -- 172.21.15.96:0/1421247755 shutdown_connections 2022-02-02T22:24:20.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 --2- 172.21.15.96:0/1421247755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f5c50 unknown :-1 s=CLOSED pgs=3717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 --2- 172.21.15.96:0/1421247755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 -- 172.21.15.96:0/1421247755 >> 172.21.15.96:0/1421247755 conn(0x7f77600f0320 msgr2=0x7f77600f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.197+0000 7f77664e8700 1 -- 172.21.15.96:0/1421247755 shutdown_connections 2022-02-02T22:24:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.198+0000 7f77664e8700 1 -- 172.21.15.96:0/1421247755 wait complete. 2022-02-02T22:24:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.198+0000 7f77664e8700 1 Processor -- start 2022-02-02T22:24:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.198+0000 7f77664e8700 1 -- start start 2022-02-02T22:24:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77664e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77664e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77664e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776010a9a0 con 0x7f77600f57d0 2022-02-02T22:24:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77664e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776010aae0 con 0x7f77600f6ac0 2022-02-02T22:24:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:52382/0 (socket says 172.21.15.96:52382) 2022-02-02T22:24:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 -- 172.21.15.96:0/2271427892 learned_addr learned my addr 172.21.15.96:0/2271427892 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77654e6700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 -- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 msgr2=0x7f77600f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f7764ce5700 1 -- 172.21.15.96:0/2271427892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c005040 con 0x7f77600f6ac0 2022-02-02T22:24:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.199+0000 7f77654e6700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:24:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f7764ce5700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f775c009990 tx=0x7f775c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775c018070 con 0x7f77600f6ac0 2022-02-02T22:24:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600f8070 con 0x7f77600f6ac0 2022-02-02T22:24:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f775c007ca0 con 0x7f77600f6ac0 2022-02-02T22:24:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775c01c620 con 0x7f77600f6ac0 2022-02-02T22:24:20.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.200+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600f85d0 con 0x7f77600f6ac0 2022-02-02T22:24:20.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.201+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760045ad0 con 0x7f77600f6ac0 2022-02-02T22:24:20.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.201+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f775c01d960 con 0x7f77600f6ac0 2022-02-02T22:24:20.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.202+0000 7f7751ffb700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 0x7f774c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:20.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.202+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f775c0837d0 con 0x7f77600f6ac0 2022-02-02T22:24:20.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.202+0000 7f77654e6700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 0x7f774c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:20.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.202+0000 7f77654e6700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 0x7f774c0672e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7f77600f9430 tx=0x7f7754009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:20.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.206+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f775c051a40 con 0x7f77600f6ac0 2022-02-02T22:24:20.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.411+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77600fdda0 con 0x7f77600f6ac0 2022-02-02T22:24:20.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.411+0000 7f7751ffb700 1 -- 172.21.15.96:0/2271427892 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f775c055060 con 0x7f77600f6ac0 2022-02-02T22:24:20.412 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:24:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:24:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:24:20.414 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:24:20.414 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:20.414 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:24:20.415 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:24:20.415 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:24:20.415 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:24:20.416 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:24:20.416 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:24:20.417 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:24:20.417 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:24:20.417 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:24:20.418 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:24:20.418 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:24:20.419 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:24:20.419 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:24:20.419 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:24:20.420 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:24:20.420 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:24:20.420 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:24:20.421 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:24:20.421 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:24:20.422 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:24:20.422 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:24:20.423 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:24:20.423 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:24:20.423 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:24:20.424 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:24:20.424 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:24:20.424 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:24:20.425 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:20.425 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:20.425 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:24:20.425 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:20.426 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:20.426 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:20.426 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:20.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 msgr2=0x7f774c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 0x7f774c0672e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7f77600f9430 tx=0x7f7754009040).stop 2022-02-02T22:24:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 msgr2=0x7f77600f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f775c009990 tx=0x7f775c009b30).stop 2022-02-02T22:24:20.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 shutdown_connections 2022-02-02T22:24:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f774c064e20 0x7f774c0672e0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77600f57d0 0x7f77600f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 --2- 172.21.15.96:0/2271427892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77600f6ac0 0x7f77600f7b20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:20.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 >> 172.21.15.96:0/2271427892 conn(0x7f77600f0320 msgr2=0x7f77600f4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:20.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 shutdown_connections 2022-02-02T22:24:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:20.415+0000 7f77664e8700 1 -- 172.21.15.96:0/2271427892 wait complete. 2022-02-02T22:24:20.432 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:24:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:20 smithi096 ceph-mon[101353]: pgmap v7266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:20.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:20 smithi096 ceph-mon[101353]: from='client.41544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:20 smithi096 ceph-mon[101353]: from='client.41548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:20.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4102689008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:24:20.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2271427892' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:24:20.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:20 smithi159 ceph-mon[69013]: pgmap v7266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:20 smithi159 ceph-mon[69013]: from='client.41544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:20 smithi159 ceph-mon[69013]: from='client.41548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4102689008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:24:20.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2271427892' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:24:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:22 smithi159 ceph-mon[69013]: pgmap v7267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:22 smithi096 ceph-mon[101353]: pgmap v7267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:24 smithi159 ceph-mon[69013]: pgmap v7268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:24 smithi096 ceph-mon[101353]: pgmap v7268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:26.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:26 smithi159 ceph-mon[69013]: pgmap v7269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:26 smithi096 ceph-mon[101353]: pgmap v7269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:28 smithi159 ceph-mon[69013]: pgmap v7270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:24:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:24:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:28 smithi096 ceph-mon[101353]: pgmap v7270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:24:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:24:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:30 smithi159 ceph-mon[69013]: pgmap v7271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:30 smithi096 ceph-mon[101353]: pgmap v7271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:32.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:32 smithi159 ceph-mon[69013]: pgmap v7272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:32 smithi096 ceph-mon[101353]: pgmap v7272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:34.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:34 smithi159 ceph-mon[69013]: pgmap v7273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:34 smithi096 ceph-mon[101353]: pgmap v7273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:36 smithi159 ceph-mon[69013]: pgmap v7274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:36 smithi096 ceph-mon[101353]: pgmap v7274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:38 smithi159 ceph-mon[69013]: pgmap v7275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:38 smithi096 ceph-mon[101353]: pgmap v7275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:40 smithi159 ceph-mon[69013]: pgmap v7276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:40 smithi096 ceph-mon[101353]: pgmap v7276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:42 smithi159 ceph-mon[69013]: pgmap v7277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:42 smithi096 ceph-mon[101353]: pgmap v7277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:44 smithi159 ceph-mon[69013]: pgmap v7278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:44 smithi096 ceph-mon[101353]: pgmap v7278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:46 smithi159 ceph-mon[69013]: pgmap v7279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:46 smithi096 ceph-mon[101353]: pgmap v7279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:48 smithi159 ceph-mon[69013]: pgmap v7280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:48 smithi096 ceph-mon[101353]: pgmap v7280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 -- 172.21.15.96:0/724044995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 msgr2=0x7f3b3c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 --2- 172.21.15.96:0/724044995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c0f5a00 secure :-1 s=READY pgs=3718 cs=0 l=1 rev1=1 rx=0x7f3b2c004660 tx=0x7f3b2c009b30).stop 2022-02-02T22:24:50.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 -- 172.21.15.96:0/724044995 shutdown_connections 2022-02-02T22:24:50.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 --2- 172.21.15.96:0/724044995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 0x7f3b3c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 --2- 172.21.15.96:0/724044995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c0f5a00 unknown :-1 s=CLOSED pgs=3718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 -- 172.21.15.96:0/724044995 >> 172.21.15.96:0/724044995 conn(0x7f3b3c0f0de0 msgr2=0x7f3b3c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 -- 172.21.15.96:0/724044995 shutdown_connections 2022-02-02T22:24:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.526+0000 7f3b4116c700 1 -- 172.21.15.96:0/724044995 wait complete. 2022-02-02T22:24:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.527+0000 7f3b4116c700 1 Processor -- start 2022-02-02T22:24:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.527+0000 7f3b4116c700 1 -- start start 2022-02-02T22:24:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 0x7f3b3c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c060520 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c060660 con 0x7f3b3c0f5ef0 2022-02-02T22:24:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48296/0 (socket says 172.21.15.96:48296) 2022-02-02T22:24:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 -- 172.21.15.96:0/423149402 learned_addr learned my addr 172.21.15.96:0/423149402 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3a59c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 0x7f3b3c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 -- 172.21.15.96:0/423149402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 msgr2=0x7f3b3c10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 0x7f3b3c10c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 -- 172.21.15.96:0/423149402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c005040 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b3ad9d700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 secure :-1 s=READY pgs=3719 cs=0 l=1 rev1=1 rx=0x7f3b2c009990 tx=0x7f3b2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c018070 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c10c700 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b2c007ba0 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c01c3c0 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.528+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c10cc30 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.530+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c0f4a70 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.530+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b2c01d420 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.530+0000 7f3b237fe700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 0x7f3b24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.530+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3b2c083720 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.530+0000 7f3b3a59c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 0x7f3b24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.531+0000 7f3b3a59c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 0x7f3b24067290 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f3b300096c0 tx=0x7f3b30009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:50.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.535+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b2c051880 con 0x7f3b3c0f55e0 2022-02-02T22:24:50.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.713+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b3c0fdf40 con 0x7f3b24064dd0 2022-02-02T22:24:50.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.714+0000 7f3b237fe700 1 -- 172.21.15.96:0/423149402 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3b3c0fdf40 con 0x7f3b24064dd0 2022-02-02T22:24:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.715+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 msgr2=0x7f3b24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.715+0000 7f3b4116c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 0x7f3b24067290 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f3b300096c0 tx=0x7f3b30009be0).stop 2022-02-02T22:24:50.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 msgr2=0x7f3b3c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 secure :-1 s=READY pgs=3719 cs=0 l=1 rev1=1 rx=0x7f3b2c009990 tx=0x7f3b2c009b30).stop 2022-02-02T22:24:50.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 shutdown_connections 2022-02-02T22:24:50.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3b24064dd0 0x7f3b24067290 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b3c0f55e0 0x7f3b3c109c50 unknown :-1 s=CLOSED pgs=3719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 --2- 172.21.15.96:0/423149402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b3c0f5ef0 0x7f3b3c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 >> 172.21.15.96:0/423149402 conn(0x7f3b3c0f0de0 msgr2=0x7f3b3c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:50.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 shutdown_connections 2022-02-02T22:24:50.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.716+0000 7f3b4116c700 1 -- 172.21.15.96:0/423149402 wait complete. 2022-02-02T22:24:50.726 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:24:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:50 smithi159 ceph-mon[69013]: pgmap v7281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:50 smithi096 ceph-mon[101353]: pgmap v7281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 -- 172.21.15.96:0/2092282578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f7980 msgr2=0x7f02840f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 --2- 172.21.15.96:0/2092282578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f7980 0x7f02840f7de0 secure :-1 s=READY pgs=3720 cs=0 l=1 rev1=1 rx=0x7f0270004660 tx=0x7f0270009b30).stop 2022-02-02T22:24:50.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 -- 172.21.15.96:0/2092282578 shutdown_connections 2022-02-02T22:24:50.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 --2- 172.21.15.96:0/2092282578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f7980 0x7f02840f7de0 unknown :-1 s=CLOSED pgs=3720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 --2- 172.21.15.96:0/2092282578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f66e0 0x7f02840f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 -- 172.21.15.96:0/2092282578 >> 172.21.15.96:0/2092282578 conn(0x7f02840f1e40 msgr2=0x7f02840f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:50.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.813+0000 7f028ab17700 1 -- 172.21.15.96:0/2092282578 shutdown_connections 2022-02-02T22:24:50.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 -- 172.21.15.96:0/2092282578 wait complete. 2022-02-02T22:24:50.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 Processor -- start 2022-02-02T22:24:50.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 -- start start 2022-02-02T22:24:50.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f7980 0x7f0284069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028406a380 con 0x7f02840f66e0 2022-02-02T22:24:50.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f028ab17700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028406a4c0 con 0x7f02840f7980 2022-02-02T22:24:50.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.814+0000 7f02888b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48306/0 (socket says 172.21.15.96:48306) 2022-02-02T22:24:50.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 -- 172.21.15.96:0/4082660614 learned_addr learned my addr 172.21.15.96:0/4082660614 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:50.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f0283fff700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f7980 0x7f0284069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 -- 172.21.15.96:0/4082660614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f7980 msgr2=0x7f0284069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:50.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f7980 0x7f0284069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:50.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 -- 172.21.15.96:0/4082660614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270005040 con 0x7f02840f66e0 2022-02-02T22:24:50.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02888b3700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 secure :-1 s=READY pgs=3721 cs=0 l=1 rev1=1 rx=0x7f0278002700 tx=0x7f0278009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:50.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02780079c0 con 0x7f02840f66e0 2022-02-02T22:24:50.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f027800f040 con 0x7f02840f66e0 2022-02-02T22:24:50.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028406a7a0 con 0x7f02840f66e0 2022-02-02T22:24:50.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0278014860 con 0x7f02840f66e0 2022-02-02T22:24:50.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.815+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028410ef90 con 0x7f02840f66e0 2022-02-02T22:24:50.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.816+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284045ad0 con 0x7f02840f66e0 2022-02-02T22:24:50.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.817+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f027801b060 con 0x7f02840f66e0 2022-02-02T22:24:50.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.817+0000 7f02817fa700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 0x7f0274067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:50.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.817+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02780818e0 con 0x7f02840f66e0 2022-02-02T22:24:50.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.817+0000 7f0283fff700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 0x7f0274067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:50.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.817+0000 7f0283fff700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 0x7f0274067290 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f0270004630 tx=0x7f0270009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:50.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.821+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f027804f9e0 con 0x7f02840f66e0 2022-02-02T22:24:50.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:50.993+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0284057f10 con 0x7f0274064dd0 2022-02-02T22:24:51.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.003+0000 7f02817fa700 1 -- 172.21.15.96:0/4082660614 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0284057f10 con 0x7f0274064dd0 2022-02-02T22:24:51.004 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:24:51.005 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:24:51.005 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:24:51.005 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:24:51.006 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:24:51.006 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:24:51.006 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:24:51.007 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:24:51.007 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:24:51.007 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:24:51.008 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:24:51.008 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:24:51.009 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:24:51.009 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:24:51.009 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:24:51.010 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:24:51.010 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:24:51.010 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:24:51.011 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:24:51.011 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:24:51.012 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:24:51.012 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:24:51.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 msgr2=0x7f0274067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 0x7f0274067290 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f0270004630 tx=0x7f0270009b30).stop 2022-02-02T22:24:51.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 msgr2=0x7f028406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 secure :-1 s=READY pgs=3721 cs=0 l=1 rev1=1 rx=0x7f0278002700 tx=0x7f0278009d80).stop 2022-02-02T22:24:51.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 shutdown_connections 2022-02-02T22:24:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0274064dd0 0x7f0274067290 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02840f66e0 0x7f028406b9a0 unknown :-1 s=CLOSED pgs=3721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 --2- 172.21.15.96:0/4082660614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02840f7980 0x7f0284069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 >> 172.21.15.96:0/4082660614 conn(0x7f02840f1e40 msgr2=0x7f02840fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 shutdown_connections 2022-02-02T22:24:51.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.005+0000 7f028ab17700 1 -- 172.21.15.96:0/4082660614 wait complete. 2022-02-02T22:24:51.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 -- 172.21.15.96:0/171000368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 msgr2=0x7eff340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 --2- 172.21.15.96:0/171000368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff340f59e0 secure :-1 s=READY pgs=3722 cs=0 l=1 rev1=1 rx=0x7eff24004660 tx=0x7eff24009b30).stop 2022-02-02T22:24:51.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 -- 172.21.15.96:0/171000368 shutdown_connections 2022-02-02T22:24:51.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 --2- 172.21.15.96:0/171000368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 0x7eff340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 --2- 172.21.15.96:0/171000368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff340f59e0 unknown :-1 s=CLOSED pgs=3722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 -- 172.21.15.96:0/171000368 >> 172.21.15.96:0/171000368 conn(0x7eff340f0d40 msgr2=0x7eff340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:51.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 -- 172.21.15.96:0/171000368 shutdown_connections 2022-02-02T22:24:51.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.101+0000 7eff39a95700 1 -- 172.21.15.96:0/171000368 wait complete. 2022-02-02T22:24:51.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 Processor -- start 2022-02-02T22:24:51.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 -- start start 2022-02-02T22:24:51.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 0x7eff341051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff341057f0 con 0x7eff340f55c0 2022-02-02T22:24:51.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff39a95700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34105930 con 0x7eff340f6860 2022-02-02T22:24:51.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff337fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48316/0 (socket says 172.21.15.96:48316) 2022-02-02T22:24:51.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.102+0000 7eff337fe700 1 -- 172.21.15.96:0/768071906 learned_addr learned my addr 172.21.15.96:0/768071906 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:51.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff337fe700 1 -- 172.21.15.96:0/768071906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 msgr2=0x7eff341051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff32ffd700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 0x7eff341051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff337fe700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 0x7eff341051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff337fe700 1 -- 172.21.15.96:0/768071906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24005040 con 0x7eff340f55c0 2022-02-02T22:24:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff337fe700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 secure :-1 s=READY pgs=3723 cs=0 l=1 rev1=1 rx=0x7eff24004f60 tx=0x7eff24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:51.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff24018070 con 0x7eff340f55c0 2022-02-02T22:24:51.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff24007ba0 con 0x7eff340f55c0 2022-02-02T22:24:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff34106240 con 0x7eff340f55c0 2022-02-02T22:24:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff2401c620 con 0x7eff340f55c0 2022-02-02T22:24:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.103+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff341067a0 con 0x7eff340f55c0 2022-02-02T22:24:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.104+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff34045ad0 con 0x7eff340f55c0 2022-02-02T22:24:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.104+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff2401c8e0 con 0x7eff340f55c0 2022-02-02T22:24:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.105+0000 7eff1bfff700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 0x7eff1c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.105+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7eff24083980 con 0x7eff340f55c0 2022-02-02T22:24:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.105+0000 7eff32ffd700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 0x7eff1c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.105+0000 7eff32ffd700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 0x7eff1c067290 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7eff280041d0 tx=0x7eff28009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.109+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff24051a80 con 0x7eff340f55c0 2022-02-02T22:24:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.339+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff340fdd80 con 0x7eff340f55c0 2022-02-02T22:24:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.340+0000 7eff1bfff700 1 -- 172.21.15.96:0/768071906 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7eff240550a0 con 0x7eff340f55c0 2022-02-02T22:24:51.342 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:24:51.342 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:24:51.343 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:24:51.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:51.343 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:24:51.344 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:24:51.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:51.344 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:24:51.345 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:24:51.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:51.345 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:24:51.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:24:51.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:24:51.346 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:24:51.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:24:51.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:24:51.347 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:24:51.348 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:24:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 msgr2=0x7eff1c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 0x7eff1c067290 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7eff280041d0 tx=0x7eff28009040).stop 2022-02-02T22:24:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 msgr2=0x7eff34104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 secure :-1 s=READY pgs=3723 cs=0 l=1 rev1=1 rx=0x7eff24004f60 tx=0x7eff24009b30).stop 2022-02-02T22:24:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 shutdown_connections 2022-02-02T22:24:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7eff1c064dd0 0x7eff1c067290 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff340f55c0 0x7eff34104d00 unknown :-1 s=CLOSED pgs=3723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 --2- 172.21.15.96:0/768071906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff340f6860 0x7eff341051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 >> 172.21.15.96:0/768071906 conn(0x7eff340f0d40 msgr2=0x7eff3405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 shutdown_connections 2022-02-02T22:24:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.342+0000 7eff39a95700 1 -- 172.21.15.96:0/768071906 wait complete. 2022-02-02T22:24:51.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 -- 172.21.15.96:0/1541503209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f7980 msgr2=0x7f4a300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 --2- 172.21.15.96:0/1541503209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f7980 0x7f4a300f7de0 secure :-1 s=READY pgs=3724 cs=0 l=1 rev1=1 rx=0x7f4a20004660 tx=0x7f4a20009b30).stop 2022-02-02T22:24:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 -- 172.21.15.96:0/1541503209 shutdown_connections 2022-02-02T22:24:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 --2- 172.21.15.96:0/1541503209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f7980 0x7f4a300f7de0 unknown :-1 s=CLOSED pgs=3724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 --2- 172.21.15.96:0/1541503209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f66e0 0x7f4a300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:24:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 -- 172.21.15.96:0/1541503209 >> 172.21.15.96:0/1541503209 conn(0x7f4a300f1e40 msgr2=0x7f4a300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:51.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 -- 172.21.15.96:0/1541503209 shutdown_connections 2022-02-02T22:24:51.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.441+0000 7f4a34f15700 1 -- 172.21.15.96:0/1541503209 wait complete. 2022-02-02T22:24:51.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 Processor -- start 2022-02-02T22:24:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 -- start start 2022-02-02T22:24:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f7980 0x7f4a301074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30107ae0 con 0x7f4a300f66e0 2022-02-02T22:24:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a34f15700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30108390 con 0x7f4a300f7980 2022-02-02T22:24:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48324/0 (socket says 172.21.15.96:48324) 2022-02-02T22:24:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 -- 172.21.15.96:0/3365198817 learned_addr learned my addr 172.21.15.96:0/3365198817 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:24:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2dd9b700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f7980 0x7f4a301074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 -- 172.21.15.96:0/3365198817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f7980 msgr2=0x7f4a301074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f7980 0x7f4a301074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 -- 172.21.15.96:0/3365198817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20005040 con 0x7f4a300f66e0 2022-02-02T22:24:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.442+0000 7f4a2e59c700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 secure :-1 s=READY pgs=3725 cs=0 l=1 rev1=1 rx=0x7f4a240093f0 tx=0x7f4a24006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.443+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a24009ea0 con 0x7f4a300f66e0 2022-02-02T22:24:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.443+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a24013af0 con 0x7f4a300f66e0 2022-02-02T22:24:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.443+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a30108670 con 0x7f4a300f66e0 2022-02-02T22:24:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.443+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a2400db10 con 0x7f4a300f66e0 2022-02-02T22:24:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.443+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a30108c30 con 0x7f4a300f66e0 2022-02-02T22:24:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.444+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300f5ad0 con 0x7f4a300f66e0 2022-02-02T22:24:51.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.444+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a2401a060 con 0x7f4a300f66e0 2022-02-02T22:24:51.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.445+0000 7f4a1effd700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:24:51.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.445+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4a24081aa0 con 0x7f4a300f66e0 2022-02-02T22:24:51.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.445+0000 7f4a2dd9b700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:24:51.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.445+0000 7f4a2dd9b700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f4a20004e30 tx=0x7f4a20009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:24:51.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.449+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a240535d0 con 0x7f4a300f66e0 2022-02-02T22:24:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.651+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a30027a00 con 0x7f4a300f66e0 2022-02-02T22:24:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.651+0000 7f4a1effd700 1 -- 172.21.15.96:0/3365198817 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4a24018020 con 0x7f4a300f66e0 2022-02-02T22:24:51.653 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:24:51.654 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:24:51.654 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:24:51.654 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:24:51.655 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:51.655 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:24:51.655 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:24:51.656 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:24:51.656 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:24:51.656 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:24:51.657 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:24:51.657 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:24:51.657 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:24:51.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:24:51.658 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:24:51.658 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:24:51.659 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:24:51.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:24:51.659 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:24:51.660 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:24:51.660 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:24:51.660 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:24:51.661 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:24:51.661 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:24:51.661 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:24:51.662 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:24:51.662 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:24:51.663 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:24:51.663 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:24:51.663 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:24:51.664 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:24:51.664 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:24:51.664 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:51.665 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:51.665 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:24:51.665 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:24:51.666 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:51.666 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:51.666 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:24:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 msgr2=0x7f4a18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f4a20004e30 tx=0x7f4a20009b30).stop 2022-02-02T22:24:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 msgr2=0x7f4a30106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:24:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 secure :-1 s=READY pgs=3725 cs=0 l=1 rev1=1 rx=0x7f4a240093f0 tx=0x7f4a24006ec0).stop 2022-02-02T22:24:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 shutdown_connections 2022-02-02T22:24:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a18064dd0 0x7f4a18067290 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a300f66e0 0x7f4a30106fb0 unknown :-1 s=CLOSED pgs=3725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 --2- 172.21.15.96:0/3365198817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a300f7980 0x7f4a301074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:24:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 >> 172.21.15.96:0/3365198817 conn(0x7f4a300f1e40 msgr2=0x7f4a300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:24:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.653+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 shutdown_connections 2022-02-02T22:24:51.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:24:51.654+0000 7f4a34f15700 1 -- 172.21.15.96:0/3365198817 wait complete. 2022-02-02T22:24:51.671 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:24:51.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:51 smithi159 ceph-mon[69013]: from='client.41558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:51.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/768071906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:24:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:51 smithi096 ceph-mon[101353]: from='client.41558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:51.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/768071906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:24:52.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:52 smithi159 ceph-mon[69013]: from='client.41562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:52.825 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:52 smithi159 ceph-mon[69013]: pgmap v7282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:52.826 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3365198817' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:24:52.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:52 smithi096 ceph-mon[101353]: from='client.41562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:24:52.827 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:52 smithi096 ceph-mon[101353]: pgmap v7282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:52.828 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3365198817' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:24:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:54 smithi159 ceph-mon[69013]: pgmap v7283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:54 smithi096 ceph-mon[101353]: pgmap v7283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:56.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:56 smithi159 ceph-mon[69013]: pgmap v7284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:56 smithi096 ceph-mon[101353]: pgmap v7284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:58.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:24:58 smithi159 ceph-mon[69013]: pgmap v7285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:24:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:24:58 smithi096 ceph-mon[101353]: pgmap v7285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:00 smithi159 ceph-mon[69013]: pgmap v7286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:00 smithi096 ceph-mon[101353]: pgmap v7286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:02 smithi159 ceph-mon[69013]: pgmap v7287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:02 smithi096 ceph-mon[101353]: pgmap v7287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:04 smithi096 ceph-mon[101353]: pgmap v7288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:04 smithi159 ceph-mon[69013]: pgmap v7288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:06.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:06 smithi096 ceph-mon[101353]: pgmap v7289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:06 smithi159 ceph-mon[69013]: pgmap v7289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:08 smithi096 ceph-mon[101353]: pgmap v7290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:08 smithi159 ceph-mon[69013]: pgmap v7290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:10 smithi096 ceph-mon[101353]: pgmap v7291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:10 smithi159 ceph-mon[69013]: pgmap v7291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:12 smithi096 ceph-mon[101353]: pgmap v7292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:12 smithi159 ceph-mon[69013]: pgmap v7292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:14 smithi096 ceph-mon[101353]: pgmap v7293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:14 smithi159 ceph-mon[69013]: pgmap v7293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:16 smithi096 ceph-mon[101353]: pgmap v7294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:16 smithi159 ceph-mon[69013]: pgmap v7294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:18 smithi096 ceph-mon[101353]: pgmap v7295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:18 smithi159 ceph-mon[69013]: pgmap v7295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:20 smithi096 ceph-mon[101353]: pgmap v7296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:20 smithi159 ceph-mon[69013]: pgmap v7296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:21.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3452332676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f77d0 msgr2=0x7ff1940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:21.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3452332676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f77d0 0x7ff1940f7c30 secure :-1 s=READY pgs=3726 cs=0 l=1 rev1=1 rx=0x7ff190004660 tx=0x7ff190009b30).stop 2022-02-02T22:25:21.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3452332676 shutdown_connections 2022-02-02T22:25:21.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3452332676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f77d0 0x7ff1940f7c30 unknown :-1 s=CLOSED pgs=3726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:21.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3452332676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f6530 0x7ff1940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:21.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3452332676 >> 172.21.15.96:0/3452332676 conn(0x7ff1940f1c90 msgr2=0x7ff1940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:21.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3452332676 shutdown_connections 2022-02-02T22:25:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.761+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3452332676 wait complete. 2022-02-02T22:25:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 Processor -- start 2022-02-02T22:25:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 -- start start 2022-02-02T22:25:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f77d0 0x7ff1941072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194107980 con 0x7ff1940f6530 2022-02-02T22:25:21.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19a9a1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194108100 con 0x7ff1940f77d0 2022-02-02T22:25:21.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:21.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48344/0 (socket says 172.21.15.96:48344) 2022-02-02T22:25:21.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 -- 172.21.15.96:0/3140073387 learned_addr learned my addr 172.21.15.96:0/3140073387 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:21.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19919e700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f77d0 0x7ff1941072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:21.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 -- 172.21.15.96:0/3140073387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f77d0 msgr2=0x7ff1941072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:21.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f77d0 0x7ff1941072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:21.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 -- 172.21.15.96:0/3140073387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190005040 con 0x7ff1940f6530 2022-02-02T22:25:21.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.762+0000 7ff19999f700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 secure :-1 s=READY pgs=3727 cs=0 l=1 rev1=1 rx=0x7ff1880093f0 tx=0x7ff188006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:21.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.763+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff188013640 con 0x7ff1940f6530 2022-02-02T22:25:21.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.763+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff194108380 con 0x7ff1940f6530 2022-02-02T22:25:21.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.763+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff188013c50 con 0x7ff1940f6530 2022-02-02T22:25:21.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.763+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff188012c70 con 0x7ff1940f6530 2022-02-02T22:25:21.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.763+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff194108940 con 0x7ff1940f6530 2022-02-02T22:25:21.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.764+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c004fa0 con 0x7ff1940f6530 2022-02-02T22:25:21.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.764+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff18801a060 con 0x7ff1940f6530 2022-02-02T22:25:21.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.764+0000 7ff1867fc700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 0x7ff1800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.765+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff1880819b0 con 0x7ff1940f6530 2022-02-02T22:25:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.765+0000 7ff19919e700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 0x7ff1800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.765+0000 7ff19919e700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 0x7ff1800672e0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7ff190004630 tx=0x7ff190009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.769+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff18804fab0 con 0x7ff1940f6530 2022-02-02T22:25:21.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.948+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff17c000bc0 con 0x7ff180064e20 2022-02-02T22:25:21.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.949+0000 7ff1867fc700 1 -- 172.21.15.96:0/3140073387 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff17c000bc0 con 0x7ff180064e20 2022-02-02T22:25:21.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 msgr2=0x7ff1800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:21.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 0x7ff1800672e0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7ff190004630 tx=0x7ff190009b30).stop 2022-02-02T22:25:21.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 msgr2=0x7ff194106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:21.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 secure :-1 s=READY pgs=3727 cs=0 l=1 rev1=1 rx=0x7ff1880093f0 tx=0x7ff188006ec0).stop 2022-02-02T22:25:21.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 shutdown_connections 2022-02-02T22:25:21.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff180064e20 0x7ff1800672e0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:21.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1940f6530 0x7ff194106e00 unknown :-1 s=CLOSED pgs=3727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:21.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 --2- 172.21.15.96:0/3140073387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1940f77d0 0x7ff1941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:21.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 >> 172.21.15.96:0/3140073387 conn(0x7ff1940f1c90 msgr2=0x7ff1940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:21.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 shutdown_connections 2022-02-02T22:25:21.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:21.951+0000 7ff19a9a1700 1 -- 172.21.15.96:0/3140073387 wait complete. 2022-02-02T22:25:21.961 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:25:22.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 -- 172.21.15.96:0/1792117351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f6530 msgr2=0x7f7ac80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 --2- 172.21.15.96:0/1792117351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f6530 0x7f7ac80f6950 secure :-1 s=READY pgs=3728 cs=0 l=1 rev1=1 rx=0x7f7ab0004660 tx=0x7f7ab0009b30).stop 2022-02-02T22:25:22.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 -- 172.21.15.96:0/1792117351 shutdown_connections 2022-02-02T22:25:22.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 --2- 172.21.15.96:0/1792117351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f77d0 0x7f7ac80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 --2- 172.21.15.96:0/1792117351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f6530 0x7f7ac80f6950 unknown :-1 s=CLOSED pgs=3728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 -- 172.21.15.96:0/1792117351 >> 172.21.15.96:0/1792117351 conn(0x7f7ac80f1c90 msgr2=0x7f7ac80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 -- 172.21.15.96:0/1792117351 shutdown_connections 2022-02-02T22:25:22.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.048+0000 7f7ac759e700 1 -- 172.21.15.96:0/1792117351 wait complete. 2022-02-02T22:25:22.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 Processor -- start 2022-02-02T22:25:22.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 -- start start 2022-02-02T22:25:22.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 0x7f7ac806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac806a380 con 0x7f7ac80f77d0 2022-02-02T22:25:22.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac806a4c0 con 0x7f7ac80f6530 2022-02-02T22:25:22.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.049+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48356/0 (socket says 172.21.15.96:48356) 2022-02-02T22:25:22.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 -- 172.21.15.96:0/3968512586 learned_addr learned my addr 172.21.15.96:0/3968512586 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:22.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac659c700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 0x7f7ac806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 -- 172.21.15.96:0/3968512586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 msgr2=0x7f7ac806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 0x7f7ac806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 -- 172.21.15.96:0/3968512586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0005040 con 0x7f7ac80f77d0 2022-02-02T22:25:22.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac659c700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 0x7f7ac806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:25:22.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac5d9b700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 secure :-1 s=READY pgs=3729 cs=0 l=1 rev1=1 rx=0x7f7ab800c530 tx=0x7f7ab8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab800f650 con 0x7f7ac80f77d0 2022-02-02T22:25:22.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ab800fc60 con 0x7f7ac80f77d0 2022-02-02T22:25:22.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac806a7a0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab8012cd0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.050+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac810edc0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.051+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8045ad0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.052+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ab8010070 con 0x7f7ac80f77d0 2022-02-02T22:25:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.052+0000 7f7abeffd700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 0x7f7ab40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.052+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7ab80816c0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.052+0000 7f7ac659c700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 0x7f7ab40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.053+0000 7f7ac659c700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 0x7f7ab40672e0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f7ab0004e30 tx=0x7f7ab0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.056+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ab80477d0 con 0x7f7ac80f77d0 2022-02-02T22:25:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.231+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ac8057f10 con 0x7f7ab4064e20 2022-02-02T22:25:22.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.240+0000 7f7abeffd700 1 -- 172.21.15.96:0/3968512586 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ac8057f10 con 0x7f7ab4064e20 2022-02-02T22:25:22.240 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:25:22.241 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:25:22.241 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:25:22.242 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:25:22.242 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:25:22.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:25:22.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:25:22.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:25:22.243 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:25:22.244 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:25:22.244 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:25:22.244 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:25:22.245 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:25:22.245 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:25:22.245 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:25:22.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:25:22.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:25:22.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:25:22.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:25:22.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:25:22.248 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:25:22.248 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:25:22.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 msgr2=0x7f7ab40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 0x7f7ab40672e0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f7ab0004e30 tx=0x7f7ab0009b30).stop 2022-02-02T22:25:22.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 msgr2=0x7f7ac8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 secure :-1 s=READY pgs=3729 cs=0 l=1 rev1=1 rx=0x7f7ab800c530 tx=0x7f7ab8007e20).stop 2022-02-02T22:25:22.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 shutdown_connections 2022-02-02T22:25:22.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7ab4064e20 0x7f7ab40672e0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ac80f6530 0x7f7ac806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 --2- 172.21.15.96:0/3968512586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac80f77d0 0x7f7ac8069e20 unknown :-1 s=CLOSED pgs=3729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.242+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 >> 172.21.15.96:0/3968512586 conn(0x7f7ac80f1c90 msgr2=0x7f7ac80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.243+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 shutdown_connections 2022-02-02T22:25:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.243+0000 7f7ac759e700 1 -- 172.21.15.96:0/3968512586 wait complete. 2022-02-02T22:25:22.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- 172.21.15.96:0/3275864079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 msgr2=0x7f55c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/3275864079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c80f6950 secure :-1 s=READY pgs=3730 cs=0 l=1 rev1=1 rx=0x7f55c4004660 tx=0x7f55c4009b30).stop 2022-02-02T22:25:22.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- 172.21.15.96:0/3275864079 shutdown_connections 2022-02-02T22:25:22.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/3275864079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/3275864079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c80f6950 unknown :-1 s=CLOSED pgs=3730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- 172.21.15.96:0/3275864079 >> 172.21.15.96:0/3275864079 conn(0x7f55c80f1c90 msgr2=0x7f55c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- 172.21.15.96:0/3275864079 shutdown_connections 2022-02-02T22:25:22.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- 172.21.15.96:0/3275864079 wait complete. 2022-02-02T22:25:22.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 Processor -- start 2022-02-02T22:25:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.339+0000 7f55ce2f1700 1 -- start start 2022-02-02T22:25:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ce2f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ce2f1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ce2f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c81078f0 con 0x7f55c80f6530 2022-02-02T22:25:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ce2f1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8108100 con 0x7f55c80f77d0 2022-02-02T22:25:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48364/0 (socket says 172.21.15.96:48364) 2022-02-02T22:25:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 -- 172.21.15.96:0/1316654052 learned_addr learned my addr 172.21.15.96:0/1316654052 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ccaee700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 -- 172.21.15.96:0/1316654052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 msgr2=0x7f55c81072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c81072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 -- 172.21.15.96:0/1316654052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4005040 con 0x7f55c80f6530 2022-02-02T22:25:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ccaee700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:25:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55cd2ef700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 secure :-1 s=READY pgs=3731 cs=0 l=1 rev1=1 rx=0x7f55c4013a70 tx=0x7f55c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c4018070 con 0x7f55c80f6530 2022-02-02T22:25:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55c40097d0 con 0x7f55c80f6530 2022-02-02T22:25:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c401c3c0 con 0x7f55c80f6530 2022-02-02T22:25:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.340+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c8108320 con 0x7f55c80f6530 2022-02-02T22:25:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.341+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8108880 con 0x7f55c80f6530 2022-02-02T22:25:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.342+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8059100 con 0x7f55c80f6530 2022-02-02T22:25:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.342+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55c4007ba0 con 0x7f55c80f6530 2022-02-02T22:25:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.342+0000 7f55bdffb700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 0x7f55b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.343+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f55c4083730 con 0x7f55c80f6530 2022-02-02T22:25:22.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.343+0000 7f55ccaee700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 0x7f55b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.343+0000 7f55ccaee700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 0x7f55b40672e0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f55b8009740 tx=0x7f55b8009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.347+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55c40518f0 con 0x7f55c80f6530 2022-02-02T22:25:22.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.575+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55c80008d0 con 0x7f55c80f6530 2022-02-02T22:25:22.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.576+0000 7f55bdffb700 1 -- 172.21.15.96:0/1316654052 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f55c4054f10 con 0x7f55c80f6530 2022-02-02T22:25:22.577 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:25:22.577 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:25:22.578 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:25:22.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:22.578 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:25:22.579 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:25:22.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:22.580 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:25:22.580 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:25:22.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:22.581 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:25:22.581 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:25:22.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:22.582 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:25:22.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:25:22.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:25:22.583 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:25:22.583 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:25:22.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 msgr2=0x7f55b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 0x7f55b40672e0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f55b8009740 tx=0x7f55b8009be0).stop 2022-02-02T22:25:22.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 msgr2=0x7f55c8106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 secure :-1 s=READY pgs=3731 cs=0 l=1 rev1=1 rx=0x7f55c4013a70 tx=0x7f55c4009b30).stop 2022-02-02T22:25:22.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 shutdown_connections 2022-02-02T22:25:22.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f55b4064e20 0x7f55b40672e0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55c80f6530 0x7f55c8106e00 unknown :-1 s=CLOSED pgs=3731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 --2- 172.21.15.96:0/1316654052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55c80f77d0 0x7f55c81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 >> 172.21.15.96:0/1316654052 conn(0x7f55c80f1c90 msgr2=0x7f55c80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 shutdown_connections 2022-02-02T22:25:22.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.578+0000 7f55ce2f1700 1 -- 172.21.15.96:0/1316654052 wait complete. 2022-02-02T22:25:22.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.675+0000 7fb26339e700 1 -- 172.21.15.96:0/912374785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 msgr2=0x7fb25c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 --2- 172.21.15.96:0/912374785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c0f9110 secure :-1 s=READY pgs=3732 cs=0 l=1 rev1=1 rx=0x7fb258004660 tx=0x7fb258009b30).stop 2022-02-02T22:25:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 -- 172.21.15.96:0/912374785 shutdown_connections 2022-02-02T22:25:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 --2- 172.21.15.96:0/912374785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 0x7fb25c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 --2- 172.21.15.96:0/912374785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c0f9110 unknown :-1 s=CLOSED pgs=3732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 -- 172.21.15.96:0/912374785 >> 172.21.15.96:0/912374785 conn(0x7fb25c0f0b90 msgr2=0x7fb25c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.678 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:22 smithi096 ceph-mon[101353]: pgmap v7297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:22.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 -- 172.21.15.96:0/912374785 shutdown_connections 2022-02-02T22:25:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 -- 172.21.15.96:0/912374785 wait complete. 2022-02-02T22:25:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.676+0000 7fb26339e700 1 Processor -- start 2022-02-02T22:25:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26339e700 1 -- start start 2022-02-02T22:25:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26339e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26339e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 0x7fb25c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26339e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c107880 con 0x7fb25c060310 2022-02-02T22:25:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26339e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c1080c0 con 0x7fb25c0f9690 2022-02-02T22:25:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48374/0 (socket says 172.21.15.96:48374) 2022-02-02T22:25:22.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 -- 172.21.15.96:0/3445685965 learned_addr learned my addr 172.21.15.96:0/3445685965 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:22.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb261b9b700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 0x7fb25c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 -- 172.21.15.96:0/3445685965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 msgr2=0x7fb25c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 0x7fb25c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 -- 172.21.15.96:0/3445685965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258005040 con 0x7fb25c060310 2022-02-02T22:25:22.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.677+0000 7fb26239c700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 secure :-1 s=READY pgs=3733 cs=0 l=1 rev1=1 rx=0x7fb258009990 tx=0x7fb258009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.678+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb258018070 con 0x7fb25c060310 2022-02-02T22:25:22.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.678+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb258007ba0 con 0x7fb25c060310 2022-02-02T22:25:22.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.678+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c108340 con 0x7fb25c060310 2022-02-02T22:25:22.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.678+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb25801c3c0 con 0x7fb25c060310 2022-02-02T22:25:22.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.678+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c108820 con 0x7fb25c060310 2022-02-02T22:25:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.679+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c059100 con 0x7fb25c060310 2022-02-02T22:25:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.679+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb25801d420 con 0x7fb25c060310 2022-02-02T22:25:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.680+0000 7fb252ffd700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 0x7fb2480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.680+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb2580835e0 con 0x7fb25c060310 2022-02-02T22:25:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.680+0000 7fb261b9b700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 0x7fb2480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.680+0000 7fb261b9b700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 0x7fb2480672e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7fb25c106b20 tx=0x7fb24c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:22.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.684+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb258051680 con 0x7fb25c060310 2022-02-02T22:25:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.883+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb25c0fedb0 con 0x7fb25c060310 2022-02-02T22:25:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.884+0000 7fb252ffd700 1 -- 172.21.15.96:0/3445685965 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb258054ca0 con 0x7fb25c060310 2022-02-02T22:25:22.884 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:25:22.885 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:25:22.885 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:25:22.885 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:25:22.886 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:22.886 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:25:22.886 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:25:22.887 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:25:22.887 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:25:22.887 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:25:22.888 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:25:22.888 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:25:22.888 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:25:22.889 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:25:22.889 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:25:22.889 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:25:22.890 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:25:22.890 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:25:22.891 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:25:22.891 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:25:22.891 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:25:22.892 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:25:22.892 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:25:22.892 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:25:22.893 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:25:22.893 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:25:22.893 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:25:22.894 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:25:22.894 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:25:22.894 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:25:22.895 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:25:22.895 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:25:22.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:22.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:22.896 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:25:22.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:22.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:22.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:22.897 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 msgr2=0x7fb2480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 0x7fb2480672e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7fb25c106b20 tx=0x7fb24c00b040).stop 2022-02-02T22:25:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 msgr2=0x7fb25c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:22.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 secure :-1 s=READY pgs=3733 cs=0 l=1 rev1=1 rx=0x7fb258009990 tx=0x7fb258009b30).stop 2022-02-02T22:25:22.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 shutdown_connections 2022-02-02T22:25:22.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb248064e20 0x7fb2480672e0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb25c060310 0x7fb25c106d90 unknown :-1 s=CLOSED pgs=3733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 --2- 172.21.15.96:0/3445685965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb25c0f9690 0x7fb25c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:22.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 >> 172.21.15.96:0/3445685965 conn(0x7fb25c0f0b90 msgr2=0x7fb25c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.885+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 shutdown_connections 2022-02-02T22:25:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:22.886+0000 7fb26339e700 1 -- 172.21.15.96:0/3445685965 wait complete. 2022-02-02T22:25:22.902 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:25:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:22 smithi159 ceph-mon[69013]: pgmap v7297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:23.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:23 smithi159 ceph-mon[69013]: from='client.41574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:23.792 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:23 smithi159 ceph-mon[69013]: from='client.41578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:23.793 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1316654052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:25:23.793 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3445685965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:25:24.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:23 smithi096 ceph-mon[101353]: from='client.41574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:24.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:23 smithi096 ceph-mon[101353]: from='client.41578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:24.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1316654052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:25:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3445685965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:25:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:24 smithi159 ceph-mon[69013]: pgmap v7298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:24 smithi096 ceph-mon[101353]: pgmap v7298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:26 smithi159 ceph-mon[69013]: pgmap v7299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:26 smithi096 ceph-mon[101353]: pgmap v7299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:28 smithi159 ceph-mon[69013]: pgmap v7300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:25:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:25:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:28 smithi096 ceph-mon[101353]: pgmap v7300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:25:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:25:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:30 smithi159 ceph-mon[69013]: pgmap v7301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:30 smithi096 ceph-mon[101353]: pgmap v7301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:32 smithi159 ceph-mon[69013]: pgmap v7302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:32 smithi096 ceph-mon[101353]: pgmap v7302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:34 smithi159 ceph-mon[69013]: pgmap v7303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:34 smithi096 ceph-mon[101353]: pgmap v7303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:36 smithi159 ceph-mon[69013]: pgmap v7304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:36 smithi096 ceph-mon[101353]: pgmap v7304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:38 smithi159 ceph-mon[69013]: pgmap v7305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:38 smithi096 ceph-mon[101353]: pgmap v7305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:40 smithi159 ceph-mon[69013]: pgmap v7306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:40 smithi096 ceph-mon[101353]: pgmap v7306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:42 smithi159 ceph-mon[69013]: pgmap v7307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:42 smithi096 ceph-mon[101353]: pgmap v7307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:44 smithi159 ceph-mon[69013]: pgmap v7308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:44 smithi096 ceph-mon[101353]: pgmap v7308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:46 smithi159 ceph-mon[69013]: pgmap v7309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:46 smithi096 ceph-mon[101353]: pgmap v7309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:48 smithi159 ceph-mon[69013]: pgmap v7310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:48 smithi096 ceph-mon[101353]: pgmap v7310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:50 smithi159 ceph-mon[69013]: pgmap v7311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:50 smithi096 ceph-mon[101353]: pgmap v7311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/1734735135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f66e0 msgr2=0x7f5cdc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/1734735135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc0f6b00 secure :-1 s=READY pgs=3734 cs=0 l=1 rev1=1 rx=0x7f5cd0004660 tx=0x7f5cd0009b30).stop 2022-02-02T22:25:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/1734735135 shutdown_connections 2022-02-02T22:25:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/1734735135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/1734735135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc0f6b00 unknown :-1 s=CLOSED pgs=3734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.996+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/1734735135 >> 172.21.15.96:0/1734735135 conn(0x7f5cdc0f1e40 msgr2=0x7f5cdc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.997+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/1734735135 shutdown_connections 2022-02-02T22:25:53.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.997+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/1734735135 wait complete. 2022-02-02T22:25:53.000 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:52 smithi096 ceph-mon[101353]: pgmap v7312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:53.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.997+0000 7f5ce3ff3700 1 Processor -- start 2022-02-02T22:25:53.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.997+0000 7f5ce3ff3700 1 -- start start 2022-02-02T22:25:53.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc107a50 con 0x7f5cdc0f7980 2022-02-02T22:25:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc107b90 con 0x7f5cdc0f66e0 2022-02-02T22:25:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48396/0 (socket says 172.21.15.96:48396) 2022-02-02T22:25:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 -- 172.21.15.96:0/2251993616 learned_addr learned my addr 172.21.15.96:0/2251993616 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce1d8f700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 -- 172.21.15.96:0/2251993616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 msgr2=0x7f5cdc106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 -- 172.21.15.96:0/2251993616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0005040 con 0x7f5cdc0f7980 2022-02-02T22:25:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce158e700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 secure :-1 s=READY pgs=3735 cs=0 l=1 rev1=1 rx=0x7f5cd80026d0 tx=0x7f5cd8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd80079c0 con 0x7f5cdc0f7980 2022-02-02T22:25:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc108530 con 0x7f5cdc0f7980 2022-02-02T22:25:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cd800f040 con 0x7f5cdc0f7980 2022-02-02T22:25:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd80148b0 con 0x7f5cdc0f7980 2022-02-02T22:25:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:52.998+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc108af0 con 0x7f5cdc0f7980 2022-02-02T22:25:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.000+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc045ad0 con 0x7f5cdc0f7980 2022-02-02T22:25:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.000+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cd8007b20 con 0x7f5cdc0f7980 2022-02-02T22:25:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.000+0000 7f5cce7fc700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.000+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5cd8081990 con 0x7f5cdc0f7980 2022-02-02T22:25:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.000+0000 7f5ce1d8f700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.001+0000 7f5ce1d8f700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f5cd0004630 tx=0x7f5cd0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.005+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cd80534c0 con 0x7f5cdc0f7980 2022-02-02T22:25:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:52 smithi159 ceph-mon[69013]: pgmap v7312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:53.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.185+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cdc108d70 con 0x7f5cc8064dd0 2022-02-02T22:25:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.187+0000 7f5cce7fc700 1 -- 172.21.15.96:0/2251993616 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5cdc108d70 con 0x7f5cc8064dd0 2022-02-02T22:25:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 msgr2=0x7f5cc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f5cd0004630 tx=0x7f5cd0009b30).stop 2022-02-02T22:25:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 msgr2=0x7f5cdc1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 secure :-1 s=READY pgs=3735 cs=0 l=1 rev1=1 rx=0x7f5cd80026d0 tx=0x7f5cd8009de0).stop 2022-02-02T22:25:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 shutdown_connections 2022-02-02T22:25:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5cc8064dd0 0x7f5cc8067290 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cdc0f66e0 0x7f5cdc106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 --2- 172.21.15.96:0/2251993616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cdc0f7980 0x7f5cdc1074a0 unknown :-1 s=CLOSED pgs=3735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 >> 172.21.15.96:0/2251993616 conn(0x7f5cdc0f1e40 msgr2=0x7f5cdc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.188+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 shutdown_connections 2022-02-02T22:25:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.189+0000 7f5ce3ff3700 1 -- 172.21.15.96:0/2251993616 wait complete. 2022-02-02T22:25:53.198 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:25:53.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 -- 172.21.15.96:0/58323687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 msgr2=0x7fc0540f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 --2- 172.21.15.96:0/58323687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc0540f6b00 secure :-1 s=READY pgs=3736 cs=0 l=1 rev1=1 rx=0x7fc044004660 tx=0x7fc044009b30).stop 2022-02-02T22:25:53.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 -- 172.21.15.96:0/58323687 shutdown_connections 2022-02-02T22:25:53.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 --2- 172.21.15.96:0/58323687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0540f7980 0x7fc0540f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:53.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 --2- 172.21.15.96:0/58323687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc0540f6b00 unknown :-1 s=CLOSED pgs=3736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 -- 172.21.15.96:0/58323687 >> 172.21.15.96:0/58323687 conn(0x7fc0540f1e40 msgr2=0x7fc0540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 -- 172.21.15.96:0/58323687 shutdown_connections 2022-02-02T22:25:53.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.287+0000 7fc05921f700 1 -- 172.21.15.96:0/58323687 wait complete. 2022-02-02T22:25:53.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 Processor -- start 2022-02-02T22:25:53.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 -- start start 2022-02-02T22:25:53.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0540f7980 0x7fc0541074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054107ae0 con 0x7fc0540f66e0 2022-02-02T22:25:53.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc05921f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054108390 con 0x7fc0540f7980 2022-02-02T22:25:53.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc052d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc052d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48404/0 (socket says 172.21.15.96:48404) 2022-02-02T22:25:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.288+0000 7fc052d9d700 1 -- 172.21.15.96:0/3892323116 learned_addr learned my addr 172.21.15.96:0/3892323116 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:53.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc052d9d700 1 -- 172.21.15.96:0/3892323116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0540f7980 msgr2=0x7fc0541074a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T22:25:53.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc052d9d700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0540f7980 0x7fc0541074a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:53.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc052d9d700 1 -- 172.21.15.96:0/3892323116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044005040 con 0x7fc0540f66e0 2022-02-02T22:25:53.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc052d9d700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 secure :-1 s=READY pgs=3737 cs=0 l=1 rev1=1 rx=0x7fc044004f60 tx=0x7fc044009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc044018070 con 0x7fc0540f66e0 2022-02-02T22:25:53.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc044007ba0 con 0x7fc0540f66e0 2022-02-02T22:25:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc04401c620 con 0x7fc0540f66e0 2022-02-02T22:25:53.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054108610 con 0x7fc0540f66e0 2022-02-02T22:25:53.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.289+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc054108b70 con 0x7fc0540f66e0 2022-02-02T22:25:53.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.290+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0540f5ad0 con 0x7fc0540f66e0 2022-02-02T22:25:53.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.290+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc04401c8e0 con 0x7fc0540f66e0 2022-02-02T22:25:53.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.291+0000 7fc03b7fe700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 0x7fc03c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.291+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc044083960 con 0x7fc0540f66e0 2022-02-02T22:25:53.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.291+0000 7fc05259c700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 0x7fc03c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.291+0000 7fc05259c700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 0x7fc03c067290 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fc048009500 tx=0x7fc048006a30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.295+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc044055490 con 0x7fc0540f66e0 2022-02-02T22:25:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.471+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0540008d0 con 0x7fc03c064dd0 2022-02-02T22:25:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.480+0000 7fc03b7fe700 1 -- 172.21.15.96:0/3892323116 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc0540008d0 con 0x7fc03c064dd0 2022-02-02T22:25:53.480 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:25:53.480 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:25:53.481 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:25:53.481 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:25:53.481 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:25:53.482 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:25:53.482 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:25:53.482 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:25:53.483 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:25:53.483 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:25:53.483 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:25:53.484 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:25:53.484 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:25:53.484 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:25:53.485 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:25:53.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:25:53.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:25:53.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:25:53.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (3h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:25:53.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:25:53.487 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:25:53.487 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:25:53.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 msgr2=0x7fc03c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 0x7fc03c067290 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fc048009500 tx=0x7fc048006a30).stop 2022-02-02T22:25:53.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 msgr2=0x7fc054106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 secure :-1 s=READY pgs=3737 cs=0 l=1 rev1=1 rx=0x7fc044004f60 tx=0x7fc044009b30).stop 2022-02-02T22:25:53.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 shutdown_connections 2022-02-02T22:25:53.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc03c064dd0 0x7fc03c067290 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0540f66e0 0x7fc054106fb0 unknown :-1 s=CLOSED pgs=3737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 --2- 172.21.15.96:0/3892323116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0540f7980 0x7fc0541074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 >> 172.21.15.96:0/3892323116 conn(0x7fc0540f1e40 msgr2=0x7fc0540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 shutdown_connections 2022-02-02T22:25:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.482+0000 7fc05921f700 1 -- 172.21.15.96:0/3892323116 wait complete. 2022-02-02T22:25:53.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 -- 172.21.15.96:0/116904269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 msgr2=0x7f79940f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 --2- 172.21.15.96:0/116904269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f79940f6b00 secure :-1 s=READY pgs=3738 cs=0 l=1 rev1=1 rx=0x7f797c004660 tx=0x7f797c009b30).stop 2022-02-02T22:25:53.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 -- 172.21.15.96:0/116904269 shutdown_connections 2022-02-02T22:25:53.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 --2- 172.21.15.96:0/116904269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79940f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:53.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 --2- 172.21.15.96:0/116904269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f79940f6b00 unknown :-1 s=CLOSED pgs=3738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 -- 172.21.15.96:0/116904269 >> 172.21.15.96:0/116904269 conn(0x7f79940f1e40 msgr2=0x7f79940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 -- 172.21.15.96:0/116904269 shutdown_connections 2022-02-02T22:25:53.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.579+0000 7f799989b700 1 -- 172.21.15.96:0/116904269 wait complete. 2022-02-02T22:25:53.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 Processor -- start 2022-02-02T22:25:53.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 -- start start 2022-02-02T22:25:53.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79941074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994107ae0 con 0x7f79940f66e0 2022-02-02T22:25:53.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f799989b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994108390 con 0x7f79940f7980 2022-02-02T22:25:53.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48414/0 (socket says 172.21.15.96:48414) 2022-02-02T22:25:53.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.580+0000 7f7992ffd700 1 -- 172.21.15.96:0/2813392355 learned_addr learned my addr 172.21.15.96:0/2813392355 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:53.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f79927fc700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79941074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f7992ffd700 1 -- 172.21.15.96:0/2813392355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 msgr2=0x7f79941074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f7992ffd700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79941074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f7992ffd700 1 -- 172.21.15.96:0/2813392355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c005040 con 0x7f79940f66e0 2022-02-02T22:25:53.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f79927fc700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79941074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:25:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f7992ffd700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 secure :-1 s=READY pgs=3739 cs=0 l=1 rev1=1 rx=0x7f797c004f60 tx=0x7f797c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797c018070 con 0x7f79940f66e0 2022-02-02T22:25:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f797c007ba0 con 0x7f79940f66e0 2022-02-02T22:25:53.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797c01c620 con 0x7f79940f66e0 2022-02-02T22:25:53.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7994108610 con 0x7f79940f66e0 2022-02-02T22:25:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.581+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7994108b70 con 0x7f79940f66e0 2022-02-02T22:25:53.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.582+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79940f5ad0 con 0x7f79940f66e0 2022-02-02T22:25:53.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.583+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f797c01c8e0 con 0x7f79940f66e0 2022-02-02T22:25:53.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.583+0000 7f798b7fe700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 0x7f7980067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.583+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f797c083960 con 0x7f79940f66e0 2022-02-02T22:25:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.583+0000 7f79927fc700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 0x7f7980067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.583+0000 7f79927fc700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 0x7f7980067290 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f798400a7e0 tx=0x7f7984008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.587+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f797c055490 con 0x7f79940f66e0 2022-02-02T22:25:53.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.820+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f79940ff0b0 con 0x7f79940f66e0 2022-02-02T22:25:53.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.821+0000 7f798b7fe700 1 -- 172.21.15.96:0/2813392355 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f79940ff0b0 con 0x7f79940f66e0 2022-02-02T22:25:53.822 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:25:53.822 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:25:53.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:25:53.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:53.823 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:25:53.823 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:25:53.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:53.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:25:53.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:25:53.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:53.825 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:25:53.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:25:53.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:25:53.826 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:25:53.827 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:25:53.827 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:25:53.827 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:25:53.828 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:25:53.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 msgr2=0x7f7980067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 0x7f7980067290 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7f798400a7e0 tx=0x7f7984008040).stop 2022-02-02T22:25:53.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 msgr2=0x7f7994106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 secure :-1 s=READY pgs=3739 cs=0 l=1 rev1=1 rx=0x7f797c004f60 tx=0x7f797c009b30).stop 2022-02-02T22:25:53.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 shutdown_connections 2022-02-02T22:25:53.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7980064dd0 0x7f7980067290 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79940f66e0 0x7f7994106fb0 unknown :-1 s=CLOSED pgs=3739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 --2- 172.21.15.96:0/2813392355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79940f7980 0x7f79941074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 >> 172.21.15.96:0/2813392355 conn(0x7f79940f1e40 msgr2=0x7f79940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 shutdown_connections 2022-02-02T22:25:53.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.823+0000 7f799989b700 1 -- 172.21.15.96:0/2813392355 wait complete. 2022-02-02T22:25:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1713710032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 msgr2=0x7fcd980f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1713710032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd980f5850 secure :-1 s=READY pgs=3740 cs=0 l=1 rev1=1 rx=0x7fcd88004660 tx=0x7fcd88009b30).stop 2022-02-02T22:25:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1713710032 shutdown_connections 2022-02-02T22:25:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1713710032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 0x7fcd980f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:25:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1713710032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd980f5850 unknown :-1 s=CLOSED pgs=3740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1713710032 >> 172.21.15.96:0/1713710032 conn(0x7fcd980f0b90 msgr2=0x7fcd980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1713710032 shutdown_connections 2022-02-02T22:25:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.920+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1713710032 wait complete. 2022-02-02T22:25:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 Processor -- start 2022-02-02T22:25:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 -- start start 2022-02-02T22:25:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 0x7fcd9810e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980602b0 con 0x7fcd980f5430 2022-02-02T22:25:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd9ca3f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980603f0 con 0x7fcd980f66d0 2022-02-02T22:25:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48424/0 (socket says 172.21.15.96:48424) 2022-02-02T22:25:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.921+0000 7fcd977fe700 1 -- 172.21.15.96:0/1168533627 learned_addr learned my addr 172.21.15.96:0/1168533627 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:25:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd96ffd700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 0x7fcd9810e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd977fe700 1 -- 172.21.15.96:0/1168533627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 msgr2=0x7fcd9810e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd977fe700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 0x7fcd9810e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd977fe700 1 -- 172.21.15.96:0/1168533627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88005040 con 0x7fcd980f5430 2022-02-02T22:25:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd977fe700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 secure :-1 s=READY pgs=3741 cs=0 l=1 rev1=1 rx=0x7fcd88004f60 tx=0x7fcd88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd88018070 con 0x7fcd980f5430 2022-02-02T22:25:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9810e8c0 con 0x7fcd980f5430 2022-02-02T22:25:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd88007ba0 con 0x7fcd980f5430 2022-02-02T22:25:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8801c620 con 0x7fcd980f5430 2022-02-02T22:25:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.922+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9810ece0 con 0x7fcd980f5430 2022-02-02T22:25:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.923+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd98045ad0 con 0x7fcd980f5430 2022-02-02T22:25:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.924+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd8801c8e0 con 0x7fcd980f5430 2022-02-02T22:25:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.924+0000 7fcd7ffff700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 0x7fcd800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:25:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.924+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd88083940 con 0x7fcd980f5430 2022-02-02T22:25:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.924+0000 7fcd96ffd700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 0x7fcd800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:25:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.925+0000 7fcd96ffd700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 0x7fcd800672e0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7fcd8c00b790 tx=0x7fcd8c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:25:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:53.928+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd88051a40 con 0x7fcd980f5430 2022-02-02T22:25:54.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.129+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd98060580 con 0x7fcd980f5430 2022-02-02T22:25:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.129+0000 7fcd7ffff700 1 -- 172.21.15.96:0/1168533627 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcd88055060 con 0x7fcd980f5430 2022-02-02T22:25:54.130 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:25:54.131 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:25:54.131 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:25:54.131 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:25:54.132 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:54.132 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:25:54.132 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:25:54.133 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:25:54.133 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:25:54.133 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:25:54.134 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:25:54.134 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:25:54.134 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:25:54.135 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:25:54.135 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:25:54.135 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:25:54.136 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:25:54.136 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:25:54.136 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:25:54.137 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:25:54.137 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:25:54.137 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:25:54.138 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:25:54.138 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:25:54.138 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:25:54.139 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:25:54.139 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:25:54.139 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:25:54.140 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:25:54.140 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:25:54.141 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:25:54.141 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:25:54.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:54.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:54.142 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:25:54.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:25:54.143 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:54.143 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:54.143 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:25:54.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 msgr2=0x7fcd800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:54.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 0x7fcd800672e0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7fcd8c00b790 tx=0x7fcd8c008040).stop 2022-02-02T22:25:54.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 msgr2=0x7fcd9810bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:25:54.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 secure :-1 s=READY pgs=3741 cs=0 l=1 rev1=1 rx=0x7fcd88004f60 tx=0x7fcd88009b30).stop 2022-02-02T22:25:54.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 shutdown_connections 2022-02-02T22:25:54.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcd80064e20 0x7fcd800672e0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:54.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd980f5430 0x7fcd9810bed0 unknown :-1 s=CLOSED pgs=3741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:54.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 --2- 172.21.15.96:0/1168533627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd980f66d0 0x7fcd9810e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:25:54.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 >> 172.21.15.96:0/1168533627 conn(0x7fcd980f0b90 msgr2=0x7fcd980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:25:54.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 shutdown_connections 2022-02-02T22:25:54.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:25:54.131+0000 7fcd9ca3f700 1 -- 172.21.15.96:0/1168533627 wait complete. 2022-02-02T22:25:54.148 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:25:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:54 smithi159 ceph-mon[69013]: pgmap v7313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:54 smithi159 ceph-mon[69013]: from='client.41590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:54 smithi159 ceph-mon[69013]: from='client.41594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2813392355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:25:55.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1168533627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:25:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:54 smithi096 ceph-mon[101353]: pgmap v7313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:54 smithi096 ceph-mon[101353]: from='client.41590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:54 smithi096 ceph-mon[101353]: from='client.41594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:25:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2813392355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:25:55.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1168533627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:25:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:56 smithi159 ceph-mon[69013]: pgmap v7314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:56 smithi096 ceph-mon[101353]: pgmap v7314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:25:58 smithi159 ceph-mon[69013]: pgmap v7315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:25:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:25:58 smithi096 ceph-mon[101353]: pgmap v7315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:01.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:00 smithi159 ceph-mon[69013]: pgmap v7316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:00 smithi096 ceph-mon[101353]: pgmap v7316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:02 smithi159 ceph-mon[69013]: pgmap v7317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:02 smithi096 ceph-mon[101353]: pgmap v7317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:04 smithi159 ceph-mon[69013]: pgmap v7318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:04 smithi096 ceph-mon[101353]: pgmap v7318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:06 smithi159 ceph-mon[69013]: pgmap v7319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:06 smithi096 ceph-mon[101353]: pgmap v7319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:08 smithi159 ceph-mon[69013]: pgmap v7320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:08 smithi096 ceph-mon[101353]: pgmap v7320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:10 smithi159 ceph-mon[69013]: pgmap v7321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:10 smithi096 ceph-mon[101353]: pgmap v7321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:12 smithi159 ceph-mon[69013]: pgmap v7322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:12 smithi096 ceph-mon[101353]: pgmap v7322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:14 smithi159 ceph-mon[69013]: pgmap v7323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:14 smithi096 ceph-mon[101353]: pgmap v7323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:16 smithi159 ceph-mon[69013]: pgmap v7324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:16 smithi096 ceph-mon[101353]: pgmap v7324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:18 smithi159 ceph-mon[69013]: pgmap v7325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:18 smithi096 ceph-mon[101353]: pgmap v7325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:20 smithi159 ceph-mon[69013]: pgmap v7326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:20 smithi096 ceph-mon[101353]: pgmap v7326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:22 smithi159 ceph-mon[69013]: pgmap v7327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:22 smithi096 ceph-mon[101353]: pgmap v7327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:24.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 -- 172.21.15.96:0/2098565473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f7980 msgr2=0x7f16580f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 --2- 172.21.15.96:0/2098565473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f7980 0x7f16580f7de0 secure :-1 s=READY pgs=3742 cs=0 l=1 rev1=1 rx=0x7f1640004660 tx=0x7f1640009b30).stop 2022-02-02T22:26:24.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 -- 172.21.15.96:0/2098565473 shutdown_connections 2022-02-02T22:26:24.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 --2- 172.21.15.96:0/2098565473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f7980 0x7f16580f7de0 unknown :-1 s=CLOSED pgs=3742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 --2- 172.21.15.96:0/2098565473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f66e0 0x7f16580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 -- 172.21.15.96:0/2098565473 >> 172.21.15.96:0/2098565473 conn(0x7f16580f1e40 msgr2=0x7f16580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:24.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 -- 172.21.15.96:0/2098565473 shutdown_connections 2022-02-02T22:26:24.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.241+0000 7f165decc700 1 -- 172.21.15.96:0/2098565473 wait complete. 2022-02-02T22:26:24.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.242+0000 7f165decc700 1 Processor -- start 2022-02-02T22:26:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.242+0000 7f165decc700 1 -- start start 2022-02-02T22:26:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.242+0000 7f165decc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f165decc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f7980 0x7f1658107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f165decc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581079b0 con 0x7f16580f66e0 2022-02-02T22:26:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f165decc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658107af0 con 0x7f16580f7980 2022-02-02T22:26:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48442/0 (socket says 172.21.15.96:48442) 2022-02-02T22:26:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 -- 172.21.15.96:0/3951166707 learned_addr learned my addr 172.21.15.96:0/3951166707 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f1656ffd700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f7980 0x7f1658107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 -- 172.21.15.96:0/3951166707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f7980 msgr2=0x7f1658107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f7980 0x7f1658107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 -- 172.21.15.96:0/3951166707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640005040 con 0x7f16580f66e0 2022-02-02T22:26:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f16577fe700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 secure :-1 s=READY pgs=3743 cs=0 l=1 rev1=1 rx=0x7f164800e7c0 tx=0x7f164800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16480092e0 con 0x7f16580f66e0 2022-02-02T22:26:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f164800f040 con 0x7f16580f66e0 2022-02-02T22:26:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1658108490 con 0x7f16580f66e0 2022-02-02T22:26:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.243+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16480147e0 con 0x7f16580f66e0 2022-02-02T22:26:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.244+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1658108a50 con 0x7f16580f66e0 2022-02-02T22:26:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.244+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1658045ad0 con 0x7f16580f66e0 2022-02-02T22:26:24.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.245+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f164801b030 con 0x7f16580f66e0 2022-02-02T22:26:24.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.246+0000 7f164ffff700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.246+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1648081de0 con 0x7f16580f66e0 2022-02-02T22:26:24.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.246+0000 7f1656ffd700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.246+0000 7f1656ffd700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7f1640005010 tx=0x7f1640016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.250+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1648053910 con 0x7f16580f66e0 2022-02-02T22:26:24.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.427+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1658108d20 con 0x7f1644064dd0 2022-02-02T22:26:24.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.429+0000 7f164ffff700 1 -- 172.21.15.96:0/3951166707 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1658108d20 con 0x7f1644064dd0 2022-02-02T22:26:24.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 msgr2=0x7f1644067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7f1640005010 tx=0x7f1640016040).stop 2022-02-02T22:26:24.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 msgr2=0x7f1658106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 secure :-1 s=READY pgs=3743 cs=0 l=1 rev1=1 rx=0x7f164800e7c0 tx=0x7f164800b040).stop 2022-02-02T22:26:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 shutdown_connections 2022-02-02T22:26:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1644064dd0 0x7f1644067290 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16580f66e0 0x7f1658106f10 unknown :-1 s=CLOSED pgs=3743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 --2- 172.21.15.96:0/3951166707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16580f7980 0x7f1658107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.430+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 >> 172.21.15.96:0/3951166707 conn(0x7f16580f1e40 msgr2=0x7f16580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:24.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.431+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 shutdown_connections 2022-02-02T22:26:24.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.431+0000 7f165decc700 1 -- 172.21.15.96:0/3951166707 wait complete. 2022-02-02T22:26:24.440 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:26:24.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- 172.21.15.96:0/3508522860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 msgr2=0x7fec180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 --2- 172.21.15.96:0/3508522860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec180f7de0 secure :-1 s=READY pgs=3744 cs=0 l=1 rev1=1 rx=0x7fec08004660 tx=0x7fec08009b30).stop 2022-02-02T22:26:24.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- 172.21.15.96:0/3508522860 shutdown_connections 2022-02-02T22:26:24.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 --2- 172.21.15.96:0/3508522860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec180f7de0 unknown :-1 s=CLOSED pgs=3744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 --2- 172.21.15.96:0/3508522860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- 172.21.15.96:0/3508522860 >> 172.21.15.96:0/3508522860 conn(0x7fec180f1e40 msgr2=0x7fec180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:24.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- 172.21.15.96:0/3508522860 shutdown_connections 2022-02-02T22:26:24.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- 172.21.15.96:0/3508522860 wait complete. 2022-02-02T22:26:24.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 Processor -- start 2022-02-02T22:26:24.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.528+0000 7fec1d47a700 1 -- start start 2022-02-02T22:26:24.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec18106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18107a00 con 0x7fec180f7980 2022-02-02T22:26:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18107b40 con 0x7fec180f66e0 2022-02-02T22:26:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48454/0 (socket says 172.21.15.96:48454) 2022-02-02T22:26:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 -- 172.21.15.96:0/1604773547 learned_addr learned my addr 172.21.15.96:0/1604773547 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec16ffd700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec18106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 -- 172.21.15.96:0/1604773547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 msgr2=0x7fec18106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec18106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 -- 172.21.15.96:0/1604773547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08005040 con 0x7fec180f7980 2022-02-02T22:26:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec16ffd700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec18106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:26:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec167fc700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 secure :-1 s=READY pgs=3745 cs=0 l=1 rev1=1 rx=0x7fec08009990 tx=0x7fec08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec08018070 con 0x7fec180f7980 2022-02-02T22:26:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec18108480 con 0x7fec180f7980 2022-02-02T22:26:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec08007ca0 con 0x7fec180f7980 2022-02-02T22:26:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0801c620 con 0x7fec180f7980 2022-02-02T22:26:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.529+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec181089e0 con 0x7fec180f7980 2022-02-02T22:26:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.530+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec18045ad0 con 0x7fec180f7980 2022-02-02T22:26:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.531+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec0801d960 con 0x7fec180f7980 2022-02-02T22:26:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.532+0000 7febff7fe700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 0x7fec00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.532+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec08083980 con 0x7fec180f7980 2022-02-02T22:26:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.532+0000 7fec16ffd700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 0x7fec00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.532+0000 7fec16ffd700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 0x7fec00067290 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7fec180f77e0 tx=0x7fec0c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.535+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec08055430 con 0x7fec180f7980 2022-02-02T22:26:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.710+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec180ff010 con 0x7fec00064dd0 2022-02-02T22:26:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.719+0000 7febff7fe700 1 -- 172.21.15.96:0/1604773547 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fec180ff010 con 0x7fec00064dd0 2022-02-02T22:26:24.719 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:26:24.720 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:26:24.720 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:26:24.721 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:26:24.721 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:26:24.721 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:26:24.722 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:26:24.722 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:26:24.723 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:26:24.723 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:26:24.723 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:26:24.724 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:26:24.724 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:26:24.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:26:24.725 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:26:24.725 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:26:24.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:26:24.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:26:24.726 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:26:24.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (3h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:26:24.727 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:26:24.727 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:26:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 msgr2=0x7fec00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 0x7fec00067290 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7fec180f77e0 tx=0x7fec0c009040).stop 2022-02-02T22:26:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 msgr2=0x7fec18107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 secure :-1 s=READY pgs=3745 cs=0 l=1 rev1=1 rx=0x7fec08009990 tx=0x7fec08009b30).stop 2022-02-02T22:26:24.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 shutdown_connections 2022-02-02T22:26:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064dd0 0x7fec00067290 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec180f66e0 0x7fec18106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 --2- 172.21.15.96:0/1604773547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec180f7980 0x7fec18107450 unknown :-1 s=CLOSED pgs=3745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 >> 172.21.15.96:0/1604773547 conn(0x7fec180f1e40 msgr2=0x7fec180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 shutdown_connections 2022-02-02T22:26:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.721+0000 7fec1d47a700 1 -- 172.21.15.96:0/1604773547 wait complete. 2022-02-02T22:26:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:24 smithi096 ceph-mon[101353]: pgmap v7328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:24.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- 172.21.15.96:0/933855671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 msgr2=0x7f9b040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/933855671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b040f7de0 secure :-1 s=READY pgs=3746 cs=0 l=1 rev1=1 rx=0x7f9b00004660 tx=0x7f9b00009b30).stop 2022-02-02T22:26:24.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- 172.21.15.96:0/933855671 shutdown_connections 2022-02-02T22:26:24.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/933855671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b040f7de0 unknown :-1 s=CLOSED pgs=3746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/933855671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b040f66e0 0x7f9b040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:24.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- 172.21.15.96:0/933855671 >> 172.21.15.96:0/933855671 conn(0x7f9b040f1e40 msgr2=0x7f9b040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:24.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- 172.21.15.96:0/933855671 shutdown_connections 2022-02-02T22:26:24.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- 172.21.15.96:0/933855671 wait complete. 2022-02-02T22:26:24.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 Processor -- start 2022-02-02T22:26:24.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- start start 2022-02-02T22:26:24.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b040f66e0 0x7f9b04106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041079b0 con 0x7f9b040f7980 2022-02-02T22:26:24.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.819+0000 7f9b0ba85700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04107af0 con 0x7f9b040f66e0 2022-02-02T22:26:24.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48464/0 (socket says 172.21.15.96:48464) 2022-02-02T22:26:24.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 -- 172.21.15.96:0/1413910328 learned_addr learned my addr 172.21.15.96:0/1413910328 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:24.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 -- 172.21.15.96:0/1413910328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b040f66e0 msgr2=0x7f9b04106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:24.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b040f66e0 0x7f9b04106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:26:24.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 -- 172.21.15.96:0/1413910328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00005040 con 0x7f9b040f7980 2022-02-02T22:26:24.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b09020700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 secure :-1 s=READY pgs=3747 cs=0 l=1 rev1=1 rx=0x7f9b00009990 tx=0x7f9b00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b00018070 con 0x7f9b040f7980 2022-02-02T22:26:24.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b04108430 con 0x7f9b040f7980 2022-02-02T22:26:24.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b00007ba0 con 0x7f9b040f7980 2022-02-02T22:26:24.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b0001c3c0 con 0x7f9b040f7980 2022-02-02T22:26:24.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.820+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b04108990 con 0x7f9b040f7980 2022-02-02T22:26:24.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.821+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04045ad0 con 0x7f9b040f7980 2022-02-02T22:26:24.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.821+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b0001d420 con 0x7f9b040f7980 2022-02-02T22:26:24.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.822+0000 7f9afa7fc700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 0x7f9af0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:24.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.822+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b00083680 con 0x7f9b040f7980 2022-02-02T22:26:24.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.822+0000 7f9b09821700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 0x7f9af0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:24.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.822+0000 7f9b09821700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 0x7f9af0067290 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f9af4009880 tx=0x7f9af4009a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:24.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:24.826+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b00055150 con 0x7f9b040f7980 2022-02-02T22:26:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:24 smithi159 ceph-mon[69013]: pgmap v7328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:25.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.056+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b04108c00 con 0x7f9b040f7980 2022-02-02T22:26:25.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.056+0000 7f9afa7fc700 1 -- 172.21.15.96:0/1413910328 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9b00054d40 con 0x7f9b040f7980 2022-02-02T22:26:25.057 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:26:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:26:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:26:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:26:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:26:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:26:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:26:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:26:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:26:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:26:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:26:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:26:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:26:25.063 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:26:25.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 msgr2=0x7f9af0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:25.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 0x7f9af0067290 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f9af4009880 tx=0x7f9af4009a60).stop 2022-02-02T22:26:25.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 msgr2=0x7f9b04107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:25.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 secure :-1 s=READY pgs=3747 cs=0 l=1 rev1=1 rx=0x7f9b00009990 tx=0x7f9b00009b30).stop 2022-02-02T22:26:25.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 shutdown_connections 2022-02-02T22:26:25.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9af0064dd0 0x7f9af0067290 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b040f66e0 0x7f9b04106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:26:25.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 --2- 172.21.15.96:0/1413910328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b040f7980 0x7f9b04107400 unknown :-1 s=CLOSED pgs=3747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 >> 172.21.15.96:0/1413910328 conn(0x7f9b040f1e40 msgr2=0x7f9b040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:25.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 shutdown_connections 2022-02-02T22:26:25.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.058+0000 7f9b0ba85700 1 -- 172.21.15.96:0/1413910328 wait complete. 2022-02-02T22:26:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 -- 172.21.15.96:0/4223784789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 msgr2=0x7f1ba40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/4223784789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba40f59e0 secure :-1 s=READY pgs=3748 cs=0 l=1 rev1=1 rx=0x7f1b98004660 tx=0x7f1b98009b30).stop 2022-02-02T22:26:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 -- 172.21.15.96:0/4223784789 shutdown_connections 2022-02-02T22:26:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/4223784789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ba40f6860 0x7f1ba40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/4223784789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba40f59e0 unknown :-1 s=CLOSED pgs=3748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 -- 172.21.15.96:0/4223784789 >> 172.21.15.96:0/4223784789 conn(0x7f1ba40f0d40 msgr2=0x7f1ba40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 -- 172.21.15.96:0/4223784789 shutdown_connections 2022-02-02T22:26:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 -- 172.21.15.96:0/4223784789 wait complete. 2022-02-02T22:26:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.156+0000 7f1baa2d5700 1 Processor -- start 2022-02-02T22:26:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1baa2d5700 1 -- start start 2022-02-02T22:26:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1baa2d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1baa2d5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ba40f6860 0x7f1ba4109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1baa2d5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4109c20 con 0x7f1ba40f55c0 2022-02-02T22:26:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1baa2d5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4109d60 con 0x7f1ba40f6860 2022-02-02T22:26:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48470/0 (socket says 172.21.15.96:48470) 2022-02-02T22:26:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 -- 172.21.15.96:0/2283133525 learned_addr learned my addr 172.21.15.96:0/2283133525 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 -- 172.21.15.96:0/2283133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ba40f6860 msgr2=0x7f1ba4109670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T22:26:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ba40f6860 0x7f1ba4109670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:26:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 -- 172.21.15.96:0/2283133525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98005040 con 0x7f1ba40f55c0 2022-02-02T22:26:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.157+0000 7f1ba3fff700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 secure :-1 s=READY pgs=3749 cs=0 l=1 rev1=1 rx=0x7f1b98013a70 tx=0x7f1b98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.158+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b98018070 con 0x7f1ba40f55c0 2022-02-02T22:26:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.158+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b980097f0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.158+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9801c3c0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.158+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba410a6a0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.158+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba410ac00 con 0x7f1ba40f55c0 2022-02-02T22:26:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.159+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba4045ad0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.159+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b9801d420 con 0x7f1ba40f55c0 2022-02-02T22:26:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.160+0000 7f1ba0ff9700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 0x7f1b8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.160+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1b98083710 con 0x7f1ba40f55c0 2022-02-02T22:26:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.160+0000 7f1ba37fe700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 0x7f1b8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.160+0000 7f1ba37fe700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 0x7f1b8c067290 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f1b94004a10 tx=0x7f1b940099e0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.164+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b98055300 con 0x7f1ba40f55c0 2022-02-02T22:26:25.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.367+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ba410f7a0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.368+0000 7f1ba0ff9700 1 -- 172.21.15.96:0/2283133525 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1b98054ef0 con 0x7f1ba40f55c0 2022-02-02T22:26:25.368 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:26:25.369 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:26:25.369 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:26:25.370 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:26:25.370 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:25.370 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:26:25.371 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:26:25.371 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:26:25.372 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:26:25.372 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:26:25.373 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:26:25.373 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:26:25.374 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:26:25.374 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:26:25.374 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:26:25.375 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:26:25.375 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:26:25.375 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:26:25.376 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:26:25.376 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:26:25.376 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:26:25.377 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:26:25.377 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:26:25.377 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:26:25.378 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:26:25.378 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:26:25.378 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:26:25.379 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:26:25.379 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:26:25.379 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:26:25.380 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:26:25.380 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:26:25.380 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:25.381 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:25.381 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:26:25.381 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:25.382 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:25.382 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:25.383 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:25.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 msgr2=0x7f1b8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:25.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 0x7f1b8c067290 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f1b94004a10 tx=0x7f1b940099e0).stop 2022-02-02T22:26:25.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 msgr2=0x7f1ba4109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:25.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 secure :-1 s=READY pgs=3749 cs=0 l=1 rev1=1 rx=0x7f1b98013a70 tx=0x7f1b98009b30).stop 2022-02-02T22:26:25.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 shutdown_connections 2022-02-02T22:26:25.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1b8c064dd0 0x7f1b8c067290 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ba40f55c0 0x7f1ba4109180 unknown :-1 s=CLOSED pgs=3749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:25.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 --2- 172.21.15.96:0/2283133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ba40f6860 0x7f1ba4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:26:25.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 >> 172.21.15.96:0/2283133525 conn(0x7f1ba40f0d40 msgr2=0x7f1ba405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:25.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 shutdown_connections 2022-02-02T22:26:25.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:25.371+0000 7f1baa2d5700 1 -- 172.21.15.96:0/2283133525 wait complete. 2022-02-02T22:26:25.388 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:26:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:25 smithi159 ceph-mon[69013]: from='client.41606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:25 smithi159 ceph-mon[69013]: from='client.41610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1413910328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:26:26.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2283133525' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:26:26.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:25 smithi096 ceph-mon[101353]: from='client.41606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:26.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:25 smithi096 ceph-mon[101353]: from='client.41610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:26.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1413910328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:26:26.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2283133525' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:26:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:26 smithi159 ceph-mon[69013]: pgmap v7329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:26 smithi096 ceph-mon[101353]: pgmap v7329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:28 smithi159 ceph-mon[69013]: pgmap v7330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:26:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:26:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:28 smithi096 ceph-mon[101353]: pgmap v7330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:26:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:26:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:30 smithi159 ceph-mon[69013]: pgmap v7331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:30 smithi096 ceph-mon[101353]: pgmap v7331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:32 smithi159 ceph-mon[69013]: pgmap v7332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:32 smithi096 ceph-mon[101353]: pgmap v7332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:34 smithi159 ceph-mon[69013]: pgmap v7333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:34 smithi096 ceph-mon[101353]: pgmap v7333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:36 smithi159 ceph-mon[69013]: pgmap v7334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:36 smithi096 ceph-mon[101353]: pgmap v7334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:38 smithi159 ceph-mon[69013]: pgmap v7335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:38 smithi096 ceph-mon[101353]: pgmap v7335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:40 smithi159 ceph-mon[69013]: pgmap v7336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:40 smithi096 ceph-mon[101353]: pgmap v7336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:42 smithi159 ceph-mon[69013]: pgmap v7337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:42 smithi096 ceph-mon[101353]: pgmap v7337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:44 smithi159 ceph-mon[69013]: pgmap v7338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:44 smithi096 ceph-mon[101353]: pgmap v7338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:46 smithi159 ceph-mon[69013]: pgmap v7339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:46 smithi096 ceph-mon[101353]: pgmap v7339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:48 smithi159 ceph-mon[69013]: pgmap v7340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:48 smithi096 ceph-mon[101353]: pgmap v7340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:50 smithi159 ceph-mon[69013]: pgmap v7341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:50 smithi096 ceph-mon[101353]: pgmap v7341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:52 smithi159 ceph-mon[69013]: pgmap v7342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:52 smithi096 ceph-mon[101353]: pgmap v7342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:54 smithi159 ceph-mon[69013]: pgmap v7343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:54 smithi096 ceph-mon[101353]: pgmap v7343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:55.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 -- 172.21.15.96:0/1994247791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 msgr2=0x7f3a280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/1994247791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a280f7c30 secure :-1 s=READY pgs=3750 cs=0 l=1 rev1=1 rx=0x7f3a24004660 tx=0x7f3a24009b30).stop 2022-02-02T22:26:55.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 -- 172.21.15.96:0/1994247791 shutdown_connections 2022-02-02T22:26:55.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/1994247791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a280f7c30 unknown :-1 s=CLOSED pgs=3750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/1994247791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 0x7f3a280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 -- 172.21.15.96:0/1994247791 >> 172.21.15.96:0/1994247791 conn(0x7f3a280f1c90 msgr2=0x7f3a280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:55.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 -- 172.21.15.96:0/1994247791 shutdown_connections 2022-02-02T22:26:55.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.481+0000 7f3a2f05d700 1 -- 172.21.15.96:0/1994247791 wait complete. 2022-02-02T22:26:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 Processor -- start 2022-02-02T22:26:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 -- start start 2022-02-02T22:26:55.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 0x7f3a2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2810a9b0 con 0x7f3a280f77d0 2022-02-02T22:26:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2f05d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2810aaf0 con 0x7f3a280f6530 2022-02-02T22:26:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2d85a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2d85a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48492/0 (socket says 172.21.15.96:48492) 2022-02-02T22:26:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2d85a700 1 -- 172.21.15.96:0/834237964 learned_addr learned my addr 172.21.15.96:0/834237964 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.482+0000 7f3a2e05b700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 0x7f3a2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2d85a700 1 -- 172.21.15.96:0/834237964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 msgr2=0x7f3a2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2d85a700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 0x7f3a2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2d85a700 1 -- 172.21.15.96:0/834237964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24005040 con 0x7f3a280f77d0 2022-02-02T22:26:55.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2d85a700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 secure :-1 s=READY pgs=3751 cs=0 l=1 rev1=1 rx=0x7f3a24009990 tx=0x7f3a24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:55.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a24018070 con 0x7f3a280f77d0 2022-02-02T22:26:55.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2806a370 con 0x7f3a280f77d0 2022-02-02T22:26:55.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a24007ba0 con 0x7f3a280f77d0 2022-02-02T22:26:55.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2401c620 con 0x7f3a280f77d0 2022-02-02T22:26:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.483+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2806a8d0 con 0x7f3a280f77d0 2022-02-02T22:26:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.484+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a28045ad0 con 0x7f3a280f77d0 2022-02-02T22:26:55.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.484+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a2401c8e0 con 0x7f3a280f77d0 2022-02-02T22:26:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.485+0000 7f3a1affd700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 0x7f3a140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.485+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3a24083850 con 0x7f3a280f77d0 2022-02-02T22:26:55.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.485+0000 7f3a2e05b700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 0x7f3a140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.485+0000 7f3a2e05b700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 0x7f3a140672e0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f3a2806b730 tx=0x7f3a1c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:55.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.489+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a24051950 con 0x7f3a280f77d0 2022-02-02T22:26:55.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.668+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a28027aa0 con 0x7f3a14064e20 2022-02-02T22:26:55.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.669+0000 7f3a1affd700 1 -- 172.21.15.96:0/834237964 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3a28027aa0 con 0x7f3a14064e20 2022-02-02T22:26:55.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 msgr2=0x7f3a140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 0x7f3a140672e0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f3a2806b730 tx=0x7f3a1c009040).stop 2022-02-02T22:26:55.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 msgr2=0x7f3a28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 secure :-1 s=READY pgs=3751 cs=0 l=1 rev1=1 rx=0x7f3a24009990 tx=0x7f3a24009b30).stop 2022-02-02T22:26:55.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 shutdown_connections 2022-02-02T22:26:55.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a14064e20 0x7f3a140672e0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a280f6530 0x7f3a2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 --2- 172.21.15.96:0/834237964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a280f77d0 0x7f3a28069e20 unknown :-1 s=CLOSED pgs=3751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 >> 172.21.15.96:0/834237964 conn(0x7f3a280f1c90 msgr2=0x7f3a280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:55.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 shutdown_connections 2022-02-02T22:26:55.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.671+0000 7f3a2f05d700 1 -- 172.21.15.96:0/834237964 wait complete. 2022-02-02T22:26:55.682 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:26:55.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 -- 172.21.15.96:0/2960238566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f6520 msgr2=0x7f4bfc0f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/2960238566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc0f6940 secure :-1 s=READY pgs=3752 cs=0 l=1 rev1=1 rx=0x7f4bf0004660 tx=0x7f4bf0009b30).stop 2022-02-02T22:26:55.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 -- 172.21.15.96:0/2960238566 shutdown_connections 2022-02-02T22:26:55.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/2960238566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/2960238566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc0f6940 unknown :-1 s=CLOSED pgs=3752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 -- 172.21.15.96:0/2960238566 >> 172.21.15.96:0/2960238566 conn(0x7f4bfc0f1ca0 msgr2=0x7f4bfc0f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:55.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 -- 172.21.15.96:0/2960238566 shutdown_connections 2022-02-02T22:26:55.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 -- 172.21.15.96:0/2960238566 wait complete. 2022-02-02T22:26:55.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.770+0000 7f4c00bfd700 1 Processor -- start 2022-02-02T22:26:55.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4c00bfd700 1 -- start start 2022-02-02T22:26:55.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4c00bfd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4c00bfd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4c00bfd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc06a380 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4c00bfd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc06a4c0 con 0x7f4bfc0f6520 2022-02-02T22:26:55.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48502/0 (socket says 172.21.15.96:48502) 2022-02-02T22:26:55.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 -- 172.21.15.96:0/841277916 learned_addr learned my addr 172.21.15.96:0/841277916 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:55.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfb7fe700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 -- 172.21.15.96:0/841277916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f6520 msgr2=0x7f4bfc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.771+0000 7f4bfaffd700 1 -- 172.21.15.96:0/841277916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0005040 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4bfaffd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 secure :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 rx=0x7f4bec00e7f0 tx=0x7f4bec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:55.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec0092e0 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4bec00f040 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc06a7a0 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec014750 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.772+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc10ed40 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.773+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc045ad0 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.773+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4bec01b030 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.774+0000 7f4be3fff700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 0x7f4be40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:55.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.774+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4bec081730 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.774+0000 7f4bfb7fe700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 0x7f4be40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:55.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.774+0000 7f4bfb7fe700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 0x7f4be40672e0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f4bf0000c00 tx=0x7f4bf0016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:55.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.778+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4bec04f8e0 con 0x7f4bfc0f77c0 2022-02-02T22:26:55.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.950+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bfc0fedf0 con 0x7f4be4064e20 2022-02-02T22:26:55.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.960+0000 7f4be3fff700 1 -- 172.21.15.96:0/841277916 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4bfc0fedf0 con 0x7f4be4064e20 2022-02-02T22:26:55.961 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:26:55.961 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:26:55.962 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:26:55.962 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:26:55.962 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:26:55.963 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:26:55.963 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:26:55.964 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:26:55.964 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:26:55.964 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:26:55.965 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:26:55.965 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:26:55.965 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:26:55.966 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:26:55.966 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:26:55.966 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:26:55.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:26:55.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:26:55.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:26:55.968 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:26:55.968 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (3h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:26:55.968 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:26:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 msgr2=0x7f4be40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 0x7f4be40672e0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f4bf0000c00 tx=0x7f4bf0016040).stop 2022-02-02T22:26:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 msgr2=0x7f4bfc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 secure :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 rx=0x7f4bec00e7f0 tx=0x7f4bec00b040).stop 2022-02-02T22:26:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 shutdown_connections 2022-02-02T22:26:55.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4be4064e20 0x7f4be40672e0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bfc0f6520 0x7f4bfc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 --2- 172.21.15.96:0/841277916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bfc0f77c0 0x7f4bfc069e20 unknown :-1 s=CLOSED pgs=3753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:55.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 >> 172.21.15.96:0/841277916 conn(0x7f4bfc0f1ca0 msgr2=0x7f4bfc0fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:55.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 shutdown_connections 2022-02-02T22:26:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:55.962+0000 7f4c00bfd700 1 -- 172.21.15.96:0/841277916 wait complete. 2022-02-02T22:26:56.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.058+0000 7f5a17a87700 1 -- 172.21.15.96:0/1369943970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f74a0 msgr2=0x7f5a100f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.058+0000 7f5a17a87700 1 --2- 172.21.15.96:0/1369943970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f74a0 0x7f5a100f5930 secure :-1 s=READY pgs=3754 cs=0 l=1 rev1=1 rx=0x7f5a00004660 tx=0x7f5a00009b30).stop 2022-02-02T22:26:56.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.058+0000 7f5a17a87700 1 -- 172.21.15.96:0/1369943970 shutdown_connections 2022-02-02T22:26:56.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.058+0000 7f5a17a87700 1 --2- 172.21.15.96:0/1369943970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f74a0 0x7f5a100f5930 unknown :-1 s=CLOSED pgs=3754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 --2- 172.21.15.96:0/1369943970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f6b90 0x7f5a100f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- 172.21.15.96:0/1369943970 >> 172.21.15.96:0/1369943970 conn(0x7f5a100f0540 msgr2=0x7f5a100f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:56.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- 172.21.15.96:0/1369943970 shutdown_connections 2022-02-02T22:26:56.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- 172.21.15.96:0/1369943970 wait complete. 2022-02-02T22:26:56.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 Processor -- start 2022-02-02T22:26:56.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- start start 2022-02-02T22:26:56.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f74a0 0x7f5a101063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101069c0 con 0x7f5a100f6b90 2022-02-02T22:26:56.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a17a87700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101071d0 con 0x7f5a100f74a0 2022-02-02T22:26:56.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.059+0000 7f5a15823700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48510/0 (socket says 172.21.15.96:48510) 2022-02-02T22:26:56.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 -- 172.21.15.96:0/660052736 learned_addr learned my addr 172.21.15.96:0/660052736 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15022700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f74a0 0x7f5a101063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 -- 172.21.15.96:0/660052736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f74a0 msgr2=0x7f5a101063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f74a0 0x7f5a101063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 -- 172.21.15.96:0/660052736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00005040 con 0x7f5a100f6b90 2022-02-02T22:26:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a15823700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 secure :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 rx=0x7f5a0c002700 tx=0x7f5a0c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:56.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c0079c0 con 0x7f5a100f6b90 2022-02-02T22:26:56.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a101073d0 con 0x7f5a100f6b90 2022-02-02T22:26:56.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a0c00f040 con 0x7f5a100f6b90 2022-02-02T22:26:56.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c0148a0 con 0x7f5a100f6b90 2022-02-02T22:26:56.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.060+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10107990 con 0x7f5a100f6b90 2022-02-02T22:26:56.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.061+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a10045ad0 con 0x7f5a100f6b90 2022-02-02T22:26:56.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.062+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a0c01b060 con 0x7f5a100f6b90 2022-02-02T22:26:56.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.062+0000 7f5a067fc700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 0x7f59fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.062+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a0c081980 con 0x7f5a100f6b90 2022-02-02T22:26:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.062+0000 7f5a15022700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 0x7f59fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.062+0000 7f5a15022700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 0x7f59fc067290 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f5a00009da0 tx=0x7f5a00009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:56.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.066+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a0c04fa80 con 0x7f5a100f6b90 2022-02-02T22:26:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.298+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a100ff850 con 0x7f5a100f6b90 2022-02-02T22:26:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.298+0000 7f5a067fc700 1 -- 172.21.15.96:0/660052736 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5a0c0192e0 con 0x7f5a100f6b90 2022-02-02T22:26:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:26:56.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:26:56.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:26:56.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:56.302 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:26:56.302 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:26:56.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:56.303 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:26:56.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:26:56.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:56.304 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:26:56.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:26:56.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:26:56.305 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:26:56.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:26:56.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:26:56.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:26:56.307 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:26:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.300+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 msgr2=0x7f59fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.300+0000 7f5a17a87700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 0x7f59fc067290 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f5a00009da0 tx=0x7f5a00009b30).stop 2022-02-02T22:26:56.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.300+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 msgr2=0x7f5a10105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.300+0000 7f5a17a87700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 secure :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 rx=0x7f5a0c002700 tx=0x7f5a0c009d80).stop 2022-02-02T22:26:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 shutdown_connections 2022-02-02T22:26:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f59fc064dd0 0x7f59fc067290 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a100f6b90 0x7f5a10105ed0 unknown :-1 s=CLOSED pgs=3755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 --2- 172.21.15.96:0/660052736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a100f74a0 0x7f5a101063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 >> 172.21.15.96:0/660052736 conn(0x7f5a100f0540 msgr2=0x7f5a100fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 shutdown_connections 2022-02-02T22:26:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.301+0000 7f5a17a87700 1 -- 172.21.15.96:0/660052736 wait complete. 2022-02-02T22:26:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.402+0000 7f5dd4bee700 1 -- 172.21.15.96:0/2801284210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 msgr2=0x7f5dd00f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.402+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/2801284210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd00f7da0 secure :-1 s=READY pgs=3756 cs=0 l=1 rev1=1 rx=0x7f5dc4004660 tx=0x7f5dc4009b30).stop 2022-02-02T22:26:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- 172.21.15.96:0/2801284210 shutdown_connections 2022-02-02T22:26:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/2801284210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd00f7da0 unknown :-1 s=CLOSED pgs=3756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/2801284210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 0x7f5dd00f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- 172.21.15.96:0/2801284210 >> 172.21.15.96:0/2801284210 conn(0x7f5dd00f1e00 msgr2=0x7f5dd00f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- 172.21.15.96:0/2801284210 shutdown_connections 2022-02-02T22:26:56.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- 172.21.15.96:0/2801284210 wait complete. 2022-02-02T22:26:56.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 Processor -- start 2022-02-02T22:26:56.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- start start 2022-02-02T22:26:56.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 0x7f5dd01090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd0109b40 con 0x7f5dd00f7940 2022-02-02T22:26:56.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.403+0000 7f5dd4bee700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd0109c80 con 0x7f5dd00f66a0 2022-02-02T22:26:56.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48520/0 (socket says 172.21.15.96:48520) 2022-02-02T22:26:56.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 -- 172.21.15.96:0/3997499409 learned_addr learned my addr 172.21.15.96:0/3997499409 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:26:56.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dce59c700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 0x7f5dd01090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 -- 172.21.15.96:0/3997499409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 msgr2=0x7f5dd01090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 0x7f5dd01090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 -- 172.21.15.96:0/3997499409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4005040 con 0x7f5dd00f7940 2022-02-02T22:26:56.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dcdd9b700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 secure :-1 s=READY pgs=3757 cs=0 l=1 rev1=1 rx=0x7f5dc4009990 tx=0x7f5dc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:56.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4018070 con 0x7f5dd00f7940 2022-02-02T22:26:56.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd010a5c0 con 0x7f5dd00f7940 2022-02-02T22:26:56.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5dc4007ca0 con 0x7f5dd00f7940 2022-02-02T22:26:56.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc401c620 con 0x7f5dd00f7940 2022-02-02T22:26:56.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.404+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd010ab20 con 0x7f5dd00f7940 2022-02-02T22:26:56.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.405+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0045ad0 con 0x7f5dd00f7940 2022-02-02T22:26:56.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.406+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5dc401d960 con 0x7f5dd00f7940 2022-02-02T22:26:56.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.406+0000 7f5dbeffd700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 0x7f5db80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:26:56.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.406+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5dc4083700 con 0x7f5dd00f7940 2022-02-02T22:26:56.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.406+0000 7f5dce59c700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 0x7f5db80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:26:56.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.407+0000 7f5dce59c700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 0x7f5db80672e0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7f5dc0007fd0 tx=0x7f5dc0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:26:56.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.411+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5dc4055230 con 0x7f5dd00f7940 2022-02-02T22:26:56.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.609+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5dd0027a00 con 0x7f5dd00f7940 2022-02-02T22:26:56.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.610+0000 7f5dbeffd700 1 -- 172.21.15.96:0/3997499409 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f5dc4054e20 con 0x7f5dd00f7940 2022-02-02T22:26:56.611 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:26:56.612 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:26:56.612 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:26:56.612 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:26:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:56.613 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:26:56.613 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:26:56.614 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:26:56.614 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:26:56.614 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:26:56.615 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:26:56.615 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:26:56.615 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:26:56.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:26:56.616 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:26:56.616 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:26:56.617 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:26:56.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:26:56.617 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:26:56.618 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:26:56.618 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:26:56.618 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:26:56.619 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:26:56.619 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:26:56.619 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:26:56.620 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:26:56.620 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:26:56.620 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:26:56.621 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:26:56.621 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:26:56.621 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:26:56.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:26:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:56.623 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:26:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:26:56.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:56.624 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:56.624 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:26:56.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 msgr2=0x7f5db80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 0x7f5db80672e0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7f5dc0007fd0 tx=0x7f5dc0009040).stop 2022-02-02T22:26:56.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 msgr2=0x7f5dd0109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:26:56.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 secure :-1 s=READY pgs=3757 cs=0 l=1 rev1=1 rx=0x7f5dc4009990 tx=0x7f5dc4009b30).stop 2022-02-02T22:26:56.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 shutdown_connections 2022-02-02T22:26:56.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5db8064e20 0x7f5db80672e0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd00f66a0 0x7f5dd01090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 --2- 172.21.15.96:0/3997499409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dd00f7940 0x7f5dd0109590 unknown :-1 s=CLOSED pgs=3757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:26:56.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 >> 172.21.15.96:0/3997499409 conn(0x7f5dd00f1e00 msgr2=0x7f5dd006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:26:56.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 shutdown_connections 2022-02-02T22:26:56.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:26:56.611+0000 7f5dd4bee700 1 -- 172.21.15.96:0/3997499409 wait complete. 2022-02-02T22:26:56.629 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:26:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:56 smithi159 ceph-mon[69013]: pgmap v7344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:56 smithi159 ceph-mon[69013]: from='client.41622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/660052736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:26:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3997499409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:26:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:56 smithi096 ceph-mon[101353]: pgmap v7344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:56 smithi096 ceph-mon[101353]: from='client.41622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/660052736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:26:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3997499409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:26:58.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:57 smithi159 ceph-mon[69013]: from='client.41626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:58.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:57 smithi096 ceph-mon[101353]: from='client.41626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:26:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:26:58 smithi159 ceph-mon[69013]: pgmap v7345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:26:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:26:58 smithi096 ceph-mon[101353]: pgmap v7345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:00 smithi159 ceph-mon[69013]: pgmap v7346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:00 smithi096 ceph-mon[101353]: pgmap v7346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:02 smithi159 ceph-mon[69013]: pgmap v7347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:02 smithi096 ceph-mon[101353]: pgmap v7347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:04 smithi159 ceph-mon[69013]: pgmap v7348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:04 smithi096 ceph-mon[101353]: pgmap v7348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:07.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:06 smithi159 ceph-mon[69013]: pgmap v7349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:06 smithi096 ceph-mon[101353]: pgmap v7349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:08 smithi159 ceph-mon[69013]: pgmap v7350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:08 smithi096 ceph-mon[101353]: pgmap v7350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:10 smithi159 ceph-mon[69013]: pgmap v7351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:10 smithi096 ceph-mon[101353]: pgmap v7351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:12 smithi159 ceph-mon[69013]: pgmap v7352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:12 smithi096 ceph-mon[101353]: pgmap v7352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:14 smithi159 ceph-mon[69013]: pgmap v7353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:14 smithi096 ceph-mon[101353]: pgmap v7353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:17.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:16 smithi159 ceph-mon[69013]: pgmap v7354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:16 smithi096 ceph-mon[101353]: pgmap v7354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:18 smithi159 ceph-mon[69013]: pgmap v7355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:18 smithi096 ceph-mon[101353]: pgmap v7355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:20 smithi159 ceph-mon[69013]: pgmap v7356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:20 smithi096 ceph-mon[101353]: pgmap v7356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:22 smithi159 ceph-mon[69013]: pgmap v7357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:22 smithi096 ceph-mon[101353]: pgmap v7357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:24 smithi159 ceph-mon[69013]: pgmap v7358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:24 smithi096 ceph-mon[101353]: pgmap v7358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:26.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 -- 172.21.15.96:0/1793148862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f55c0 msgr2=0x7f5f1c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:26.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 --2- 172.21.15.96:0/1793148862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c0f59e0 secure :-1 s=READY pgs=3758 cs=0 l=1 rev1=1 rx=0x7f5f0c004660 tx=0x7f5f0c009b30).stop 2022-02-02T22:27:26.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 -- 172.21.15.96:0/1793148862 shutdown_connections 2022-02-02T22:27:26.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 --2- 172.21.15.96:0/1793148862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:27:26.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 --2- 172.21.15.96:0/1793148862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c0f59e0 unknown :-1 s=CLOSED pgs=3758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:26.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 -- 172.21.15.96:0/1793148862 >> 172.21.15.96:0/1793148862 conn(0x7f5f1c0f0d40 msgr2=0x7f5f1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 -- 172.21.15.96:0/1793148862 shutdown_connections 2022-02-02T22:27:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.726+0000 7f5f2252b700 1 -- 172.21.15.96:0/1793148862 wait complete. 2022-02-02T22:27:26.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 Processor -- start 2022-02-02T22:27:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 -- start start 2022-02-02T22:27:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:26.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c060450 con 0x7f5f1c0f6860 2022-02-02T22:27:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f2252b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c060590 con 0x7f5f1c0f55c0 2022-02-02T22:27:26.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f1b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f1b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48540/0 (socket says 172.21.15.96:48540) 2022-02-02T22:27:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f1b7fe700 1 -- 172.21.15.96:0/603630473 learned_addr learned my addr 172.21.15.96:0/603630473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:26.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.727+0000 7f5f1bfff700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f1b7fe700 1 -- 172.21.15.96:0/603630473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 msgr2=0x7f5f1c109ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f1b7fe700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c109ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:26.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f1b7fe700 1 -- 172.21.15.96:0/603630473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f1c0f6860 2022-02-02T22:27:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f1bfff700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:27:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f1b7fe700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 secure :-1 s=READY pgs=3759 cs=0 l=1 rev1=1 rx=0x7f5f1000b410 tx=0x7f5f10006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:26.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f100125f0 con 0x7f5f1c0f6860 2022-02-02T22:27:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c10c7f0 con 0x7f5f1c0f6860 2022-02-02T22:27:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f1000be80 con 0x7f5f1c0f6860 2022-02-02T22:27:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f10002ac0 con 0x7f5f1c0f6860 2022-02-02T22:27:26.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.728+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c10cdb0 con 0x7f5f1c0f6860 2022-02-02T22:27:26.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.729+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c045ad0 con 0x7f5f1c0f6860 2022-02-02T22:27:26.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.730+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f1000f030 con 0x7f5f1c0f6860 2022-02-02T22:27:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.730+0000 7f5f18ff9700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 0x7f5f04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.730+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f10081f80 con 0x7f5f1c0f6860 2022-02-02T22:27:26.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.730+0000 7f5f1bfff700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 0x7f5f04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.730+0000 7f5f1bfff700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 0x7f5f04067290 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7f5f0c004e30 tx=0x7f5f0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:26.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.734+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f10050080 con 0x7f5f1c0f6860 2022-02-02T22:27:26.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.920+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f1c0fde70 con 0x7f5f04064dd0 2022-02-02T22:27:26.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.921+0000 7f5f18ff9700 1 -- 172.21.15.96:0/603630473 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5f1c0fde70 con 0x7f5f04064dd0 2022-02-02T22:27:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 msgr2=0x7f5f04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 0x7f5f04067290 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7f5f0c004e30 tx=0x7f5f0c009b30).stop 2022-02-02T22:27:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 msgr2=0x7f5f1c10c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 secure :-1 s=READY pgs=3759 cs=0 l=1 rev1=1 rx=0x7f5f1000b410 tx=0x7f5f10006ef0).stop 2022-02-02T22:27:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 shutdown_connections 2022-02-02T22:27:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5f04064dd0 0x7f5f04067290 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0f55c0 0x7f5f1c109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 --2- 172.21.15.96:0/603630473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f1c0f6860 0x7f5f1c10c1e0 unknown :-1 s=CLOSED pgs=3759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 >> 172.21.15.96:0/603630473 conn(0x7f5f1c0f0d40 msgr2=0x7f5f1c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 shutdown_connections 2022-02-02T22:27:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:26.923+0000 7f5f2252b700 1 -- 172.21.15.96:0/603630473 wait complete. 2022-02-02T22:27:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:27:27.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 -- 172.21.15.96:0/3158916424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f66e0 msgr2=0x7fb4680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 --2- 172.21.15.96:0/3158916424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f66e0 0x7fb4680f6b00 secure :-1 s=READY pgs=3760 cs=0 l=1 rev1=1 rx=0x7fb458004660 tx=0x7fb458009b30).stop 2022-02-02T22:27:27.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 -- 172.21.15.96:0/3158916424 shutdown_connections 2022-02-02T22:27:27.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 --2- 172.21.15.96:0/3158916424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f6ff0 0x7fb4680f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 --2- 172.21.15.96:0/3158916424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f66e0 0x7fb4680f6b00 unknown :-1 s=CLOSED pgs=3760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 -- 172.21.15.96:0/3158916424 >> 172.21.15.96:0/3158916424 conn(0x7fb4680f1f00 msgr2=0x7fb4680f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:26 smithi096 ceph-mon[101353]: pgmap v7359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 -- 172.21.15.96:0/3158916424 shutdown_connections 2022-02-02T22:27:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.021+0000 7fb46fb82700 1 -- 172.21.15.96:0/3158916424 wait complete. 2022-02-02T22:27:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 Processor -- start 2022-02-02T22:27:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 -- start start 2022-02-02T22:27:27.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f66e0 0x7fb468106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb468107a00 con 0x7fb4680f6ff0 2022-02-02T22:27:27.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46fb82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb468107b40 con 0x7fb4680f66e0 2022-02-02T22:27:27.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46d91e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f66e0 0x7fb468106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46d11d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46d11d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48550/0 (socket says 172.21.15.96:48550) 2022-02-02T22:27:27.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.022+0000 7fb46d11d700 1 -- 172.21.15.96:0/2837429141 learned_addr learned my addr 172.21.15.96:0/2837429141 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46d11d700 1 -- 172.21.15.96:0/2837429141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f66e0 msgr2=0x7fb468106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46d11d700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f66e0 0x7fb468106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46d11d700 1 -- 172.21.15.96:0/2837429141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458005040 con 0x7fb4680f6ff0 2022-02-02T22:27:27.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46d11d700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 secure :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 rx=0x7fb46400c530 tx=0x7fb464007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb46400f650 con 0x7fb4680f6ff0 2022-02-02T22:27:27.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4681084e0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb468108aa0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb46400fc60 con 0x7fb4680f6ff0 2022-02-02T22:27:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.023+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb464012bd0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.024+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb450004fa0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.024+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb464010070 con 0x7fb4680f6ff0 2022-02-02T22:27:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.025+0000 7fb45e7fc700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.025+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb4640815a0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.025+0000 7fb46d91e700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.025+0000 7fb46d91e700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fb458004630 tx=0x7fb458009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.036 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:26 smithi159 ceph-mon[69013]: pgmap v7359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:27.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.029+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb4640477d0 con 0x7fb4680f6ff0 2022-02-02T22:27:27.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.206+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb450000bc0 con 0x7fb454064dd0 2022-02-02T22:27:27.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.215+0000 7fb45e7fc700 1 -- 172.21.15.96:0/2837429141 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb450000bc0 con 0x7fb454064dd0 2022-02-02T22:27:27.215 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:27:27.216 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:27:27.216 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:27:27.216 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:27:27.217 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:27:27.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:27:27.217 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:27:27.218 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:27:27.218 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:27:27.218 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:27:27.219 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:27:27.219 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:27:27.220 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:27:27.220 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:27:27.220 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:27:27.221 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:27:27.221 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:27:27.221 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:27:27.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:27:27.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:27:27.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:27:27.223 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:27:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 msgr2=0x7fb454067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fb458004630 tx=0x7fb458009b30).stop 2022-02-02T22:27:27.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 msgr2=0x7fb468107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 secure :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 rx=0x7fb46400c530 tx=0x7fb464007e20).stop 2022-02-02T22:27:27.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 shutdown_connections 2022-02-02T22:27:27.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f66e0 0x7fb468106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 --2- 172.21.15.96:0/2837429141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6ff0 0x7fb468107450 unknown :-1 s=CLOSED pgs=3761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 >> 172.21.15.96:0/2837429141 conn(0x7fb4680f1f00 msgr2=0x7fb4680fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 shutdown_connections 2022-02-02T22:27:27.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.217+0000 7fb46fb82700 1 -- 172.21.15.96:0/2837429141 wait complete. 2022-02-02T22:27:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 -- 172.21.15.96:0/2572432521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f4d60 msgr2=0x7f26d00f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 --2- 172.21.15.96:0/2572432521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f4d60 0x7f26d00f5180 secure :-1 s=READY pgs=3762 cs=0 l=1 rev1=1 rx=0x7f26b8004660 tx=0x7f26b8009b30).stop 2022-02-02T22:27:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 -- 172.21.15.96:0/2572432521 shutdown_connections 2022-02-02T22:27:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 --2- 172.21.15.96:0/2572432521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f5f60 0x7f26d00f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 --2- 172.21.15.96:0/2572432521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f4d60 0x7f26d00f5180 unknown :-1 s=CLOSED pgs=3762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 -- 172.21.15.96:0/2572432521 >> 172.21.15.96:0/2572432521 conn(0x7f26d00f04c0 msgr2=0x7f26d00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 -- 172.21.15.96:0/2572432521 shutdown_connections 2022-02-02T22:27:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.313+0000 7f26d60a9700 1 -- 172.21.15.96:0/2572432521 wait complete. 2022-02-02T22:27:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 Processor -- start 2022-02-02T22:27:27.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 -- start start 2022-02-02T22:27:27.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f4d60 0x7f26d0109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d00f7fb0 con 0x7f26d00f5f60 2022-02-02T22:27:27.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26d60a9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d00f80f0 con 0x7f26d00f4d60 2022-02-02T22:27:27.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48560/0 (socket says 172.21.15.96:48560) 2022-02-02T22:27:27.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.314+0000 7f26ceffd700 1 -- 172.21.15.96:0/3362850566 learned_addr learned my addr 172.21.15.96:0/3362850566 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:27.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26cf7fe700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f4d60 0x7f26d0109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26ceffd700 1 -- 172.21.15.96:0/3362850566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f4d60 msgr2=0x7f26d0109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26ceffd700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f4d60 0x7f26d0109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26ceffd700 1 -- 172.21.15.96:0/3362850566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8005040 con 0x7f26d00f5f60 2022-02-02T22:27:27.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26ceffd700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 secure :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 rx=0x7f26c000c530 tx=0x7f26c0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c000f650 con 0x7f26d00f5f60 2022-02-02T22:27:27.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d010c7b0 con 0x7f26d00f5f60 2022-02-02T22:27:27.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26c000fc60 con 0x7f26d00f5f60 2022-02-02T22:27:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c0012c20 con 0x7f26d00f5f60 2022-02-02T22:27:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.315+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d010cd40 con 0x7f26d00f5f60 2022-02-02T22:27:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.316+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d0045ad0 con 0x7f26d00f5f60 2022-02-02T22:27:27.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.317+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26c0010070 con 0x7f26d00f5f60 2022-02-02T22:27:27.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.317+0000 7f26c7fff700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 0x7f26bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.317+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26c0081710 con 0x7f26d00f5f60 2022-02-02T22:27:27.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.317+0000 7f26cf7fe700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 0x7f26bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.317+0000 7f26cf7fe700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 0x7f26bc067290 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7f26b8004580 tx=0x7f26b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.321+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26c004f810 con 0x7f26d00f5f60 2022-02-02T22:27:27.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.553+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26d00fd540 con 0x7f26d00f5f60 2022-02-02T22:27:27.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.554+0000 7f26c7fff700 1 -- 172.21.15.96:0/3362850566 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f26c0052e30 con 0x7f26d00f5f60 2022-02-02T22:27:27.554 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:27:27.555 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:27:27.555 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:27:27.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:27.556 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:27:27.556 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:27:27.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:27.557 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:27:27.557 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:27:27.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:27.558 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:27:27.558 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:27:27.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:27.559 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:27:27.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:27:27.560 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:27:27.560 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:27:27.561 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:27:27.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 msgr2=0x7f26bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 0x7f26bc067290 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7f26b8004580 tx=0x7f26b8009b30).stop 2022-02-02T22:27:27.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 msgr2=0x7f26d010c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 secure :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 rx=0x7f26c000c530 tx=0x7f26c0007e20).stop 2022-02-02T22:27:27.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 shutdown_connections 2022-02-02T22:27:27.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26bc064dd0 0x7f26bc067290 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26d00f4d60 0x7f26d0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 --2- 172.21.15.96:0/3362850566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26d00f5f60 0x7f26d010c200 unknown :-1 s=CLOSED pgs=3763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.555+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 >> 172.21.15.96:0/3362850566 conn(0x7f26d00f04c0 msgr2=0x7f26d00fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.556+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 shutdown_connections 2022-02-02T22:27:27.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.556+0000 7f26d60a9700 1 -- 172.21.15.96:0/3362850566 wait complete. 2022-02-02T22:27:27.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 -- 172.21.15.96:0/137128330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 msgr2=0x7fc5280f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 --2- 172.21.15.96:0/137128330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc5280f6ce0 secure :-1 s=READY pgs=3764 cs=0 l=1 rev1=1 rx=0x7fc518004660 tx=0x7fc518009b30).stop 2022-02-02T22:27:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 -- 172.21.15.96:0/137128330 shutdown_connections 2022-02-02T22:27:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 --2- 172.21.15.96:0/137128330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc5280f6ce0 unknown :-1 s=CLOSED pgs=3764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 --2- 172.21.15.96:0/137128330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc5280f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:27:27.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 -- 172.21.15.96:0/137128330 >> 172.21.15.96:0/137128330 conn(0x7fc5280f0d40 msgr2=0x7fc5280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 -- 172.21.15.96:0/137128330 shutdown_connections 2022-02-02T22:27:27.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.653+0000 7fc52daa0700 1 -- 172.21.15.96:0/137128330 wait complete. 2022-02-02T22:27:27.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 Processor -- start 2022-02-02T22:27:27.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 -- start start 2022-02-02T22:27:27.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc528104d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281058d0 con 0x7fc5280f6880 2022-02-02T22:27:27.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.654+0000 7fc52daa0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281061a0 con 0x7fc5280f55e0 2022-02-02T22:27:27.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48570/0 (socket says 172.21.15.96:48570) 2022-02-02T22:27:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 -- 172.21.15.96:0/892630830 learned_addr learned my addr 172.21.15.96:0/892630830 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:27.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc5277fe700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc528104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 -- 172.21.15.96:0/892630830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 msgr2=0x7fc528104d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc528104d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 -- 172.21.15.96:0/892630830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518005040 con 0x7fc5280f6880 2022-02-02T22:27:27.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc5277fe700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc528104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:27:27.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc526ffd700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 secure :-1 s=READY pgs=3765 cs=0 l=1 rev1=1 rx=0x7fc518009990 tx=0x7fc518009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc518018070 con 0x7fc5280f6880 2022-02-02T22:27:27.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc52daa0700 1 -- 172.21.15.96:0/892630830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc528106420 con 0x7fc5280f6880 2022-02-02T22:27:27.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc518007c70 con 0x7fc5280f6880 2022-02-02T22:27:27.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51801c620 con 0x7fc5280f6880 2022-02-02T22:27:27.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.655+0000 7fc52daa0700 1 -- 172.21.15.96:0/892630830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc528106980 con 0x7fc5280f6880 2022-02-02T22:27:27.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.657+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500004fa0 con 0x7fc5280f6880 2022-02-02T22:27:27.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.657+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc51801c8e0 con 0x7fc5280f6880 2022-02-02T22:27:27.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.657+0000 7fc50ffff700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 0x7fc510067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:27.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.658+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc518083810 con 0x7fc5280f6880 2022-02-02T22:27:27.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.658+0000 7fc5277fe700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 0x7fc510067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:27.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.658+0000 7fc5277fe700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 0x7fc510067290 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 rx=0x7fc528104b00 tx=0x7fc51c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:27.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.662+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc518051910 con 0x7fc5280f6880 2022-02-02T22:27:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.864+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc500005e80 con 0x7fc5280f6880 2022-02-02T22:27:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.864+0000 7fc50ffff700 1 -- 172.21.15.96:0/892630830 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc518054f30 con 0x7fc5280f6880 2022-02-02T22:27:27.865 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:27:27.865 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:27:27.865 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:27:27.866 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:27:27.866 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:27.866 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:27:27.867 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:27:27.867 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:27:27.867 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:27:27.868 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:27:27.868 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:27:27.868 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:27:27.869 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:27:27.869 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:27:27.869 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:27:27.870 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:27:27.870 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:27:27.870 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:27:27.871 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:27:27.871 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:27:27.871 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:27:27.872 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:27:27.872 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:27:27.872 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:27:27.873 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:27:27.873 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:27:27.874 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:27:27.874 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:27:27.874 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:27:27.875 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:27:27.875 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:27:27.875 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:27:27.876 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:27.876 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:27.876 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:27:27.876 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:27.877 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:27.877 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:27.877 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:27.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 msgr2=0x7fc510067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 0x7fc510067290 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 rx=0x7fc528104b00 tx=0x7fc51c008040).stop 2022-02-02T22:27:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 msgr2=0x7fc528105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 secure :-1 s=READY pgs=3765 cs=0 l=1 rev1=1 rx=0x7fc518009990 tx=0x7fc518009b30).stop 2022-02-02T22:27:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 shutdown_connections 2022-02-02T22:27:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc510064dd0 0x7fc510067290 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5280f55e0 0x7fc528104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 --2- 172.21.15.96:0/892630830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5280f6880 0x7fc528105240 unknown :-1 s=CLOSED pgs=3765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 >> 172.21.15.96:0/892630830 conn(0x7fc5280f0d40 msgr2=0x7fc52805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:27.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 shutdown_connections 2022-02-02T22:27:27.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:27.866+0000 7fc50dffb700 1 -- 172.21.15.96:0/892630830 wait complete. 2022-02-02T22:27:27.886 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:27:28.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3362850566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:27:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3362850566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:27:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: from='client.41638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:27:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: pgmap v7360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: from='client.41642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:27:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:27:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:27:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:28 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/892630830' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:27:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: from='client.41638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:27:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: pgmap v7360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: from='client.41642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:27:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:27:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:27:29.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:28 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/892630830' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:27:31.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:30 smithi159 ceph-mon[69013]: pgmap v7361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:30 smithi096 ceph-mon[101353]: pgmap v7361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:32 smithi096 ceph-mon[101353]: pgmap v7362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:33.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:32 smithi159 ceph-mon[69013]: pgmap v7362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:34 smithi096 ceph-mon[101353]: pgmap v7363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:35.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:34 smithi159 ceph-mon[69013]: pgmap v7363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:36 smithi096 ceph-mon[101353]: pgmap v7364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:37.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:36 smithi159 ceph-mon[69013]: pgmap v7364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:38 smithi096 ceph-mon[101353]: pgmap v7365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:38 smithi159 ceph-mon[69013]: pgmap v7365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:40 smithi096 ceph-mon[101353]: pgmap v7366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:40 smithi159 ceph-mon[69013]: pgmap v7366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:42 smithi096 ceph-mon[101353]: pgmap v7367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:43.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:42 smithi159 ceph-mon[69013]: pgmap v7367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:44 smithi096 ceph-mon[101353]: pgmap v7368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:44 smithi159 ceph-mon[69013]: pgmap v7368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:46 smithi096 ceph-mon[101353]: pgmap v7369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:47.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:46 smithi159 ceph-mon[69013]: pgmap v7369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:49.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:48 smithi159 ceph-mon[69013]: pgmap v7370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:48 smithi096 ceph-mon[101353]: pgmap v7370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:50 smithi159 ceph-mon[69013]: pgmap v7371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:50 smithi096 ceph-mon[101353]: pgmap v7371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:52 smithi096 ceph-mon[101353]: pgmap v7372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:53.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:52 smithi159 ceph-mon[69013]: pgmap v7372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:54 smithi159 ceph-mon[69013]: pgmap v7373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:54 smithi096 ceph-mon[101353]: pgmap v7373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:56 smithi159 ceph-mon[69013]: pgmap v7374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:57.390 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:56 smithi096 ceph-mon[101353]: pgmap v7374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:57.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.976+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2136781156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f77d0 msgr2=0x7f2a4c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:57.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.976+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2136781156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c0f7c30 secure :-1 s=READY pgs=3766 cs=0 l=1 rev1=1 rx=0x7f2a38004660 tx=0x7f2a38009b30).stop 2022-02-02T22:27:57.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.976+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2136781156 shutdown_connections 2022-02-02T22:27:57.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.976+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2136781156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c0f7c30 unknown :-1 s=CLOSED pgs=3766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:57.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.976+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2136781156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:57.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.977+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2136781156 >> 172.21.15.96:0/2136781156 conn(0x7f2a4c0f1c90 msgr2=0x7f2a4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:57.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.977+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2136781156 shutdown_connections 2022-02-02T22:27:57.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.977+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2136781156 wait complete. 2022-02-02T22:27:57.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.977+0000 7f2a51e4f700 1 Processor -- start 2022-02-02T22:27:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.977+0000 7f2a51e4f700 1 -- start start 2022-02-02T22:27:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a51e4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:57.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a51e4f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a51e4f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c107880 con 0x7f2a4c0f6530 2022-02-02T22:27:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a51e4f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c108090 con 0x7f2a4c0f77d0 2022-02-02T22:27:57.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:57.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48586/0 (socket says 172.21.15.96:48586) 2022-02-02T22:27:57.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 -- 172.21.15.96:0/2756515025 learned_addr learned my addr 172.21.15.96:0/2756515025 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:57.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a4bfff700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 -- 172.21.15.96:0/2756515025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f77d0 msgr2=0x7f2a4c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:57.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 -- 172.21.15.96:0/2756515025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38005040 con 0x7f2a4c0f6530 2022-02-02T22:27:57.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.978+0000 7f2a50e4d700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 secure :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 rx=0x7f2a40002700 tx=0x7f2a40009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:57.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.979+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a40009320 con 0x7f2a4c0f6530 2022-02-02T22:27:57.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.979+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a4000f040 con 0x7f2a4c0f6530 2022-02-02T22:27:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.979+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c108310 con 0x7f2a4c0f6530 2022-02-02T22:27:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.979+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a40014900 con 0x7f2a4c0f6530 2022-02-02T22:27:57.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.979+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c1088d0 con 0x7f2a4c0f6530 2022-02-02T22:27:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.980+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c059100 con 0x7f2a4c0f6530 2022-02-02T22:27:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.981+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a40009480 con 0x7f2a4c0f6530 2022-02-02T22:27:57.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.981+0000 7f2a497fa700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 0x7f2a3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:57.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.981+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2a40081c20 con 0x7f2a4c0f6530 2022-02-02T22:27:57.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.981+0000 7f2a4bfff700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 0x7f2a3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:57.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.982+0000 7f2a4bfff700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 0x7f2a3c0672e0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f2a38009da0 tx=0x7f2a38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:57.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:57.985+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a4004fd20 con 0x7f2a4c0f6530 2022-02-02T22:27:58.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.165+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a4c0fee00 con 0x7f2a3c064e20 2022-02-02T22:27:58.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.166+0000 7f2a497fa700 1 -- 172.21.15.96:0/2756515025 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2a4c0fee00 con 0x7f2a3c064e20 2022-02-02T22:27:58.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 msgr2=0x7f2a3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 0x7f2a3c0672e0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f2a38009da0 tx=0x7f2a38009b30).stop 2022-02-02T22:27:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 msgr2=0x7f2a4c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 secure :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 rx=0x7f2a40002700 tx=0x7f2a40009d80).stop 2022-02-02T22:27:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 shutdown_connections 2022-02-02T22:27:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a3c064e20 0x7f2a3c0672e0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4c0f6530 0x7f2a4c106d90 unknown :-1 s=CLOSED pgs=3767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 --2- 172.21.15.96:0/2756515025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a4c0f77d0 0x7f2a4c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 >> 172.21.15.96:0/2756515025 conn(0x7f2a4c0f1c90 msgr2=0x7f2a4c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 shutdown_connections 2022-02-02T22:27:58.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.168+0000 7f2a51e4f700 1 -- 172.21.15.96:0/2756515025 wait complete. 2022-02-02T22:27:58.178 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:27:58.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 -- 172.21.15.96:0/345845931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f7970 msgr2=0x7efe840f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/345845931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f7970 0x7efe840f7dd0 secure :-1 s=READY pgs=3768 cs=0 l=1 rev1=1 rx=0x7efe74004660 tx=0x7efe74009b30).stop 2022-02-02T22:27:58.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 -- 172.21.15.96:0/345845931 shutdown_connections 2022-02-02T22:27:58.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/345845931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f7970 0x7efe840f7dd0 unknown :-1 s=CLOSED pgs=3768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/345845931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f66d0 0x7efe840f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 -- 172.21.15.96:0/345845931 >> 172.21.15.96:0/345845931 conn(0x7efe840f1e10 msgr2=0x7efe840f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 -- 172.21.15.96:0/345845931 shutdown_connections 2022-02-02T22:27:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.265+0000 7efe8c5e7700 1 -- 172.21.15.96:0/345845931 wait complete. 2022-02-02T22:27:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 Processor -- start 2022-02-02T22:27:58.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 -- start start 2022-02-02T22:27:58.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f7970 0x7efe84107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe841079d0 con 0x7efe840f66d0 2022-02-02T22:27:58.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8c5e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84107b10 con 0x7efe840f7970 2022-02-02T22:27:58.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8a383700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8a383700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48596/0 (socket says 172.21.15.96:48596) 2022-02-02T22:27:58.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe8a383700 1 -- 172.21.15.96:0/1169566242 learned_addr learned my addr 172.21.15.96:0/1169566242 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:58.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.266+0000 7efe89b82700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f7970 0x7efe84107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8a383700 1 -- 172.21.15.96:0/1169566242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f7970 msgr2=0x7efe84107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8a383700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f7970 0x7efe84107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8a383700 1 -- 172.21.15.96:0/1169566242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74005040 con 0x7efe840f66d0 2022-02-02T22:27:58.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8a383700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 secure :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 rx=0x7efe80002700 tx=0x7efe80009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe800079c0 con 0x7efe840f66d0 2022-02-02T22:27:58.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe8000f040 con 0x7efe840f66d0 2022-02-02T22:27:58.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe841084b0 con 0x7efe840f66d0 2022-02-02T22:27:58.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe80014860 con 0x7efe840f66d0 2022-02-02T22:27:58.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.267+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84108a70 con 0x7efe840f66d0 2022-02-02T22:27:58.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.268+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe84045ad0 con 0x7efe840f66d0 2022-02-02T22:27:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.269+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe8001b060 con 0x7efe840f66d0 2022-02-02T22:27:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.269+0000 7efe7affd700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 0x7efe70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.269+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efe800818e0 con 0x7efe840f66d0 2022-02-02T22:27:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.269+0000 7efe89b82700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 0x7efe70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.269+0000 7efe89b82700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 0x7efe70067290 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7efe74004630 tx=0x7efe74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.273+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe80053410 con 0x7efe840f66d0 2022-02-02T22:27:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.448+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe84108cf0 con 0x7efe70064dd0 2022-02-02T22:27:58.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.457+0000 7efe7affd700 1 -- 172.21.15.96:0/1169566242 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efe84108cf0 con 0x7efe70064dd0 2022-02-02T22:27:58.459 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:27:58.459 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:27:58.460 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:27:58.460 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:27:58.460 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:27:58.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:27:58.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:27:58.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:27:58.461 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:27:58.462 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:27:58.462 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:27:58.462 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:27:58.463 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:27:58.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:27:58.463 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:27:58.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:27:58.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:27:58.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:27:58.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:27:58.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:27:58.465 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:27:58.466 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:27:58.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 msgr2=0x7efe70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 0x7efe70067290 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7efe74004630 tx=0x7efe74009b30).stop 2022-02-02T22:27:58.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 msgr2=0x7efe84106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 secure :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 rx=0x7efe80002700 tx=0x7efe80009d80).stop 2022-02-02T22:27:58.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 shutdown_connections 2022-02-02T22:27:58.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efe70064dd0 0x7efe70067290 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe840f66d0 0x7efe84106f30 unknown :-1 s=CLOSED pgs=3769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 --2- 172.21.15.96:0/1169566242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe840f7970 0x7efe84107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 >> 172.21.15.96:0/1169566242 conn(0x7efe840f1e10 msgr2=0x7efe840fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 shutdown_connections 2022-02-02T22:27:58.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.459+0000 7efe8c5e7700 1 -- 172.21.15.96:0/1169566242 wait complete. 2022-02-02T22:27:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 -- 172.21.15.96:0/2523108579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 msgr2=0x7f007c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 --2- 172.21.15.96:0/2523108579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c0f6cc0 secure :-1 s=READY pgs=3770 cs=0 l=1 rev1=1 rx=0x7f0070004660 tx=0x7f0070009b30).stop 2022-02-02T22:27:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 -- 172.21.15.96:0/2523108579 shutdown_connections 2022-02-02T22:27:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 --2- 172.21.15.96:0/2523108579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c0f6cc0 unknown :-1 s=CLOSED pgs=3770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 --2- 172.21.15.96:0/2523108579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 0x7f007c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 -- 172.21.15.96:0/2523108579 >> 172.21.15.96:0/2523108579 conn(0x7f007c0f0d40 msgr2=0x7f007c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.555+0000 7f00821aa700 1 -- 172.21.15.96:0/2523108579 shutdown_connections 2022-02-02T22:27:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.556+0000 7f00821aa700 1 -- 172.21.15.96:0/2523108579 wait complete. 2022-02-02T22:27:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.556+0000 7f00821aa700 1 Processor -- start 2022-02-02T22:27:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.556+0000 7f00821aa700 1 -- start start 2022-02-02T22:27:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f00821aa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 0x7f007c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f00821aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f00821aa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c107a10 con 0x7f007c0f6860 2022-02-02T22:27:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f00821aa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c107b50 con 0x7f007c0f55c0 2022-02-02T22:27:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48608/0 (socket says 172.21.15.96:48608) 2022-02-02T22:27:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 -- 172.21.15.96:0/2555232679 learned_addr learned my addr 172.21.15.96:0/2555232679 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007b7fe700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 0x7f007c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 -- 172.21.15.96:0/2555232679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 msgr2=0x7f007c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 0x7f007c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 -- 172.21.15.96:0/2555232679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070005040 con 0x7f007c0f6860 2022-02-02T22:27:58.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f007affd700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 secure :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 rx=0x7f0070009990 tx=0x7f0070009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0070018070 con 0x7f007c0f6860 2022-02-02T22:27:58.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0070007ba0 con 0x7f007c0f6860 2022-02-02T22:27:58.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.557+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c108490 con 0x7f007c0f6860 2022-02-02T22:27:58.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.558+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007001c620 con 0x7f007c0f6860 2022-02-02T22:27:58.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.558+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c1089f0 con 0x7f007c0f6860 2022-02-02T22:27:58.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.559+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c045ad0 con 0x7f007c0f6860 2022-02-02T22:27:58.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.559+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f007001c890 con 0x7f007c0f6860 2022-02-02T22:27:58.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.559+0000 7f0063fff700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.560+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f00700837b0 con 0x7f007c0f6860 2022-02-02T22:27:58.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.560+0000 7f007b7fe700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.560+0000 7f007b7fe700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f007c0f66c0 tx=0x7f006c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.564+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0070055390 con 0x7f007c0f6860 2022-02-02T22:27:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.796+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f007c10d590 con 0x7f007c0f6860 2022-02-02T22:27:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.796+0000 7f0063fff700 1 -- 172.21.15.96:0/2555232679 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0070054f80 con 0x7f007c0f6860 2022-02-02T22:27:58.797 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:27:58.797 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:27:58.797 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:27:58.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:58.798 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:27:58.798 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:27:58.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:58.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:27:58.799 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:27:58.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:58.800 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:27:58.800 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:27:58.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:27:58.801 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:27:58.801 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:27:58.801 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:27:58.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:27:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:27:58.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 msgr2=0x7f0064067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f007c0f66c0 tx=0x7f006c009040).stop 2022-02-02T22:27:58.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 msgr2=0x7f007c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 secure :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 rx=0x7f0070009990 tx=0x7f0070009b30).stop 2022-02-02T22:27:58.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 shutdown_connections 2022-02-02T22:27:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064dd0 0x7f0064067290 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f55c0 0x7f007c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 --2- 172.21.15.96:0/2555232679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f6860 0x7f007c107460 unknown :-1 s=CLOSED pgs=3771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 >> 172.21.15.96:0/2555232679 conn(0x7f007c0f0d40 msgr2=0x7f007c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 shutdown_connections 2022-02-02T22:27:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.798+0000 7f00821aa700 1 -- 172.21.15.96:0/2555232679 wait complete. 2022-02-02T22:27:58.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 -- 172.21.15.96:0/1742586013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 msgr2=0x7fc1840f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 --2- 172.21.15.96:0/1742586013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f7920 secure :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 rx=0x7fc180004660 tx=0x7fc180009b30).stop 2022-02-02T22:27:58.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 -- 172.21.15.96:0/1742586013 shutdown_connections 2022-02-02T22:27:58.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 --2- 172.21.15.96:0/1742586013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f7920 unknown :-1 s=CLOSED pgs=3772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 --2- 172.21.15.96:0/1742586013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 0x7fc1840f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 -- 172.21.15.96:0/1742586013 >> 172.21.15.96:0/1742586013 conn(0x7fc1840f0320 msgr2=0x7fc1840f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:58.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 -- 172.21.15.96:0/1742586013 shutdown_connections 2022-02-02T22:27:58.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.898+0000 7fc18a005700 1 -- 172.21.15.96:0/1742586013 wait complete. 2022-02-02T22:27:58.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 Processor -- start 2022-02-02T22:27:58.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 -- start start 2022-02-02T22:27:58.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 0x7fc1840f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840f5d90 con 0x7fc1840f51a0 2022-02-02T22:27:58.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc18a005700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840f5ed0 con 0x7fc1840f4800 2022-02-02T22:27:58.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc188802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc188802700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48618/0 (socket says 172.21.15.96:48618) 2022-02-02T22:27:58.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.899+0000 7fc188802700 1 -- 172.21.15.96:0/3522635712 learned_addr learned my addr 172.21.15.96:0/3522635712 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:27:58.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc189003700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 0x7fc1840f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc188802700 1 -- 172.21.15.96:0/3522635712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 msgr2=0x7fc1840f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:58.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc188802700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 0x7fc1840f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:58.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc188802700 1 -- 172.21.15.96:0/3522635712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180005040 con 0x7fc1840f51a0 2022-02-02T22:27:58.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc188802700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 secure :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 rx=0x7fc180013a70 tx=0x7fc180009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc180018070 con 0x7fc1840f51a0 2022-02-02T22:27:58.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1800097d0 con 0x7fc1840f51a0 2022-02-02T22:27:58.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840f6150 con 0x7fc1840f51a0 2022-02-02T22:27:58.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18001c3c0 con 0x7fc1840f51a0 2022-02-02T22:27:58.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.900+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1840f66b0 con 0x7fc1840f51a0 2022-02-02T22:27:58.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.901+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc184045ad0 con 0x7fc1840f51a0 2022-02-02T22:27:58.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.902+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc180007ba0 con 0x7fc1840f51a0 2022-02-02T22:27:58.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.902+0000 7fc179ffb700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 0x7fc1700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:27:58.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.902+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc180083ae0 con 0x7fc1840f51a0 2022-02-02T22:27:58.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.902+0000 7fc189003700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 0x7fc1700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:27:58.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.903+0000 7fc189003700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 0x7fc1700672e0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7fc1840f7140 tx=0x7fc17400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:27:58.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:58.906+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc180051ba0 con 0x7fc1840f51a0 2022-02-02T22:27:59.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.105+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc184027a00 con 0x7fc1840f51a0 2022-02-02T22:27:59.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:58 smithi096 ceph-mon[101353]: pgmap v7375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:59.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2555232679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:27:59.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.105+0000 7fc179ffb700 1 -- 172.21.15.96:0/3522635712 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc1800551c0 con 0x7fc1840f51a0 2022-02-02T22:27:59.107 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:27:59.108 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:27:59.108 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:27:59.108 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:27:59.109 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:59.109 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:27:59.109 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:27:59.110 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:27:59.110 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:27:59.110 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:27:59.111 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:27:59.111 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:27:59.111 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:27:59.112 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:27:59.112 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:27:59.113 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:27:59.113 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:27:59.113 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:27:59.114 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:27:59.114 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:27:59.114 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:27:59.115 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:27:59.115 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:27:59.115 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:27:59.116 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:27:59.116 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:27:59.116 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:27:59.117 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:27:59.117 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:27:59.117 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:27:59.118 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:27:59.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:27:59.118 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:59.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:59.119 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:27:59.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:27:59.120 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:59.120 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:59.120 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:27:59.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 msgr2=0x7fc1700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:59.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 0x7fc1700672e0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7fc1840f7140 tx=0x7fc17400b040).stop 2022-02-02T22:27:59.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 msgr2=0x7fc1840f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:27:59.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 secure :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 rx=0x7fc180013a70 tx=0x7fc180009b30).stop 2022-02-02T22:27:59.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 shutdown_connections 2022-02-02T22:27:59.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc170064e20 0x7fc1700672e0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:59.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1840f4800 0x7fc1840f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:59.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 --2- 172.21.15.96:0/3522635712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1840f51a0 0x7fc1840f5830 unknown :-1 s=CLOSED pgs=3773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:27:59.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 >> 172.21.15.96:0/3522635712 conn(0x7fc1840f0320 msgr2=0x7fc1840fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:27:59.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 shutdown_connections 2022-02-02T22:27:59.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:27:59.108+0000 7fc18a005700 1 -- 172.21.15.96:0/3522635712 wait complete. 2022-02-02T22:27:59.125 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:27:59.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:58 smithi159 ceph-mon[69013]: pgmap v7375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:27:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2555232679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:28:00.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:59 smithi159 ceph-mon[69013]: from='client.41654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:00.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:59 smithi159 ceph-mon[69013]: from='client.41658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:00.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:27:59 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3522635712' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:28:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:59 smithi096 ceph-mon[101353]: from='client.41654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:59 smithi096 ceph-mon[101353]: from='client.41658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:27:59 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3522635712' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:28:01.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:00 smithi159 ceph-mon[69013]: pgmap v7376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:00 smithi096 ceph-mon[101353]: pgmap v7376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:02 smithi096 ceph-mon[101353]: pgmap v7377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:02 smithi159 ceph-mon[69013]: pgmap v7377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:05.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:04 smithi159 ceph-mon[69013]: pgmap v7378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:04 smithi096 ceph-mon[101353]: pgmap v7378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:06 smithi159 ceph-mon[69013]: pgmap v7379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:06 smithi096 ceph-mon[101353]: pgmap v7379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:09.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:08 smithi159 ceph-mon[69013]: pgmap v7380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:08 smithi096 ceph-mon[101353]: pgmap v7380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:10 smithi159 ceph-mon[69013]: pgmap v7381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:10 smithi096 ceph-mon[101353]: pgmap v7381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:12 smithi096 ceph-mon[101353]: pgmap v7382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:13.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:12 smithi159 ceph-mon[69013]: pgmap v7382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:15.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:14 smithi159 ceph-mon[69013]: pgmap v7383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:14 smithi096 ceph-mon[101353]: pgmap v7383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:16 smithi159 ceph-mon[69013]: pgmap v7384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:16 smithi096 ceph-mon[101353]: pgmap v7384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:18 smithi159 ceph-mon[69013]: pgmap v7385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:18 smithi096 ceph-mon[101353]: pgmap v7385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:20 smithi159 ceph-mon[69013]: pgmap v7386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:20 smithi096 ceph-mon[101353]: pgmap v7386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:22 smithi096 ceph-mon[101353]: pgmap v7387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:22 smithi159 ceph-mon[69013]: pgmap v7387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:24 smithi159 ceph-mon[69013]: pgmap v7388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:24 smithi096 ceph-mon[101353]: pgmap v7388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:27.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:26 smithi159 ceph-mon[69013]: pgmap v7389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:26 smithi096 ceph-mon[101353]: pgmap v7389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:28:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:28:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:28:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:28:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.217+0000 7f95c4544700 1 -- 172.21.15.96:0/2711912744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f6860 msgr2=0x7f95bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.217+0000 7f95c4544700 1 --2- 172.21.15.96:0/2711912744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f6cc0 secure :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 rx=0x7f95ac004660 tx=0x7f95ac009b30).stop 2022-02-02T22:28:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- 172.21.15.96:0/2711912744 shutdown_connections 2022-02-02T22:28:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 --2- 172.21.15.96:0/2711912744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f6cc0 unknown :-1 s=CLOSED pgs=3774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 --2- 172.21.15.96:0/2711912744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- 172.21.15.96:0/2711912744 >> 172.21.15.96:0/2711912744 conn(0x7f95bc0f0d40 msgr2=0x7f95bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:29.221 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:28 smithi096 ceph-mon[101353]: pgmap v7390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- 172.21.15.96:0/2711912744 shutdown_connections 2022-02-02T22:28:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- 172.21.15.96:0/2711912744 wait complete. 2022-02-02T22:28:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 Processor -- start 2022-02-02T22:28:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- start start 2022-02-02T22:28:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0f8100 con 0x7f95bc0f55c0 2022-02-02T22:28:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.218+0000 7f95c4544700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0f8240 con 0x7f95bc0f6860 2022-02-02T22:28:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48634/0 (socket says 172.21.15.96:48634) 2022-02-02T22:28:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 -- 172.21.15.96:0/394548632 learned_addr learned my addr 172.21.15.96:0/394548632 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:28:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c1adf700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 -- 172.21.15.96:0/394548632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 msgr2=0x7f95bc0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 -- 172.21.15.96:0/394548632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac005040 con 0x7f95bc0f55c0 2022-02-02T22:28:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c1adf700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:28:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c22e0700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 secure :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 rx=0x7f95b800c530 tx=0x7f95b8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95b800f650 con 0x7f95bc0f55c0 2022-02-02T22:28:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0f8520 con 0x7f95bc0f55c0 2022-02-02T22:28:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95b800fc60 con 0x7f95bc0f55c0 2022-02-02T22:28:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95b8012d20 con 0x7f95bc0f55c0 2022-02-02T22:28:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.219+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc10efa0 con 0x7f95bc0f55c0 2022-02-02T22:28:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.220+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc045ad0 con 0x7f95bc0f55c0 2022-02-02T22:28:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.221+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f95b8019030 con 0x7f95bc0f55c0 2022-02-02T22:28:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.221+0000 7f95b2ffd700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 0x7f95a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.221+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95b8081770 con 0x7f95bc0f55c0 2022-02-02T22:28:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.221+0000 7f95c1adf700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 0x7f95a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.222+0000 7f95c1adf700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 0x7f95a8067290 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f95ac009da0 tx=0x7f95ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.226+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95b804f800 con 0x7f95bc0f55c0 2022-02-02T22:28:29.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:28 smithi159 ceph-mon[69013]: pgmap v7390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:29.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.404+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95bc0faca0 con 0x7f95a8064dd0 2022-02-02T22:28:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.405+0000 7f95b2ffd700 1 -- 172.21.15.96:0/394548632 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f95bc0faca0 con 0x7f95a8064dd0 2022-02-02T22:28:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 msgr2=0x7f95a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 0x7f95a8067290 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f95ac009da0 tx=0x7f95ac009b30).stop 2022-02-02T22:28:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 msgr2=0x7f95bc0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 secure :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 rx=0x7f95b800c530 tx=0x7f95b8007e10).stop 2022-02-02T22:28:29.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 shutdown_connections 2022-02-02T22:28:29.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f95a8064dd0 0x7f95a8067290 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95bc0f55c0 0x7f95bc0f9720 unknown :-1 s=CLOSED pgs=3775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 --2- 172.21.15.96:0/394548632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95bc0f6860 0x7f95bc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 >> 172.21.15.96:0/394548632 conn(0x7f95bc0f0d40 msgr2=0x7f95bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:29.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 shutdown_connections 2022-02-02T22:28:29.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.407+0000 7f95c4544700 1 -- 172.21.15.96:0/394548632 wait complete. 2022-02-02T22:28:29.418 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:28:29.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 -- 172.21.15.96:0/4157398012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 msgr2=0x7f058c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 --2- 172.21.15.96:0/4157398012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c0f7de0 secure :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 rx=0x7f057c004660 tx=0x7f057c009b30).stop 2022-02-02T22:28:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 -- 172.21.15.96:0/4157398012 shutdown_connections 2022-02-02T22:28:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 --2- 172.21.15.96:0/4157398012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c0f7de0 unknown :-1 s=CLOSED pgs=3776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 --2- 172.21.15.96:0/4157398012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 0x7f058c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 -- 172.21.15.96:0/4157398012 >> 172.21.15.96:0/4157398012 conn(0x7f058c0f1e40 msgr2=0x7f058c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 -- 172.21.15.96:0/4157398012 shutdown_connections 2022-02-02T22:28:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.505+0000 7f0591edf700 1 -- 172.21.15.96:0/4157398012 wait complete. 2022-02-02T22:28:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 Processor -- start 2022-02-02T22:28:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 -- start start 2022-02-02T22:28:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 0x7f058c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c107a00 con 0x7f058c0f7980 2022-02-02T22:28:29.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f0591edf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c107b40 con 0x7f058c0f66e0 2022-02-02T22:28:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f058affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f058affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48646/0 (socket says 172.21.15.96:48646) 2022-02-02T22:28:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f058affd700 1 -- 172.21.15.96:0/2803342415 learned_addr learned my addr 172.21.15.96:0/2803342415 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:28:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.506+0000 7f058b7fe700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 0x7f058c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f058affd700 1 -- 172.21.15.96:0/2803342415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 msgr2=0x7f058c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f058affd700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 0x7f058c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f058affd700 1 -- 172.21.15.96:0/2803342415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c005040 con 0x7f058c0f7980 2022-02-02T22:28:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f058affd700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 secure :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 rx=0x7f057c009990 tx=0x7f057c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057c018070 con 0x7f058c0f7980 2022-02-02T22:28:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c108480 con 0x7f058c0f7980 2022-02-02T22:28:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f057c007ba0 con 0x7f058c0f7980 2022-02-02T22:28:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057c01c3c0 con 0x7f058c0f7980 2022-02-02T22:28:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.507+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c1089e0 con 0x7f058c0f7980 2022-02-02T22:28:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.508+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c045ad0 con 0x7f058c0f7980 2022-02-02T22:28:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.509+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f057c01c680 con 0x7f058c0f7980 2022-02-02T22:28:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.509+0000 7f0573fff700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 0x7f0574067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.509+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f057c083700 con 0x7f058c0f7980 2022-02-02T22:28:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.509+0000 7f058b7fe700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 0x7f0574067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.510+0000 7f058b7fe700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 0x7f0574067290 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7f058c0f77e0 tx=0x7f0580011040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.513+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f057c055230 con 0x7f058c0f7980 2022-02-02T22:28:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.685+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f058c108c00 con 0x7f0574064dd0 2022-02-02T22:28:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.696+0000 7f0573fff700 1 -- 172.21.15.96:0/2803342415 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f058c108c00 con 0x7f0574064dd0 2022-02-02T22:28:29.696 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:28:29.697 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:28:29.697 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:28:29.697 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:28:29.698 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:28:29.698 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:28:29.698 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:28:29.699 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:28:29.699 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:28:29.700 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:28:29.700 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:28:29.700 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:28:29.701 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:28:29.701 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:28:29.701 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:28:29.702 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:28:29.702 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:28:29.702 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:28:29.703 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:28:29.703 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:28:29.704 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:28:29.704 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:28:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.696+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 msgr2=0x7f0574067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.696+0000 7f0591edf700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 0x7f0574067290 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7f058c0f77e0 tx=0x7f0580011040).stop 2022-02-02T22:28:29.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 msgr2=0x7f058c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 secure :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 rx=0x7f057c009990 tx=0x7f057c009b30).stop 2022-02-02T22:28:29.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 shutdown_connections 2022-02-02T22:28:29.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0574064dd0 0x7f0574067290 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f058c0f66e0 0x7f058c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 --2- 172.21.15.96:0/2803342415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058c0f7980 0x7f058c107450 unknown :-1 s=CLOSED pgs=3777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 >> 172.21.15.96:0/2803342415 conn(0x7f058c0f1e40 msgr2=0x7f058c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:29.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 shutdown_connections 2022-02-02T22:28:29.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.697+0000 7f0591edf700 1 -- 172.21.15.96:0/2803342415 wait complete. 2022-02-02T22:28:29.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 -- 172.21.15.96:0/1980951744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f6ff0 msgr2=0x7eff140f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 --2- 172.21.15.96:0/1980951744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f6ff0 0x7eff140f7a20 secure :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 rx=0x7eff04004660 tx=0x7eff04009b30).stop 2022-02-02T22:28:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 -- 172.21.15.96:0/1980951744 shutdown_connections 2022-02-02T22:28:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 --2- 172.21.15.96:0/1980951744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f6ff0 0x7eff140f7a20 unknown :-1 s=CLOSED pgs=3778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 --2- 172.21.15.96:0/1980951744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f66e0 0x7eff140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 -- 172.21.15.96:0/1980951744 >> 172.21.15.96:0/1980951744 conn(0x7eff140f1f00 msgr2=0x7eff140f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 -- 172.21.15.96:0/1980951744 shutdown_connections 2022-02-02T22:28:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.793+0000 7eff198b1700 1 -- 172.21.15.96:0/1980951744 wait complete. 2022-02-02T22:28:29.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 Processor -- start 2022-02-02T22:28:29.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 -- start start 2022-02-02T22:28:29.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 0x7eff14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1406a380 con 0x7eff140f66e0 2022-02-02T22:28:29.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff198b1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1406a4c0 con 0x7eff140f6ff0 2022-02-02T22:28:29.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48654/0 (socket says 172.21.15.96:48654) 2022-02-02T22:28:29.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.794+0000 7eff12ffd700 1 -- 172.21.15.96:0/509509949 learned_addr learned my addr 172.21.15.96:0/509509949 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:28:29.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff127fc700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 0x7eff14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff12ffd700 1 -- 172.21.15.96:0/509509949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 msgr2=0x7eff14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:29.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff12ffd700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 0x7eff14069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:29.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff12ffd700 1 -- 172.21.15.96:0/509509949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04005040 con 0x7eff140f66e0 2022-02-02T22:28:29.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff127fc700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 0x7eff14069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:28:29.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff12ffd700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 secure :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 rx=0x7eff080026d0 tx=0x7eff08009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff08009320 con 0x7eff140f66e0 2022-02-02T22:28:29.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1406a7a0 con 0x7eff140f66e0 2022-02-02T22:28:29.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff0800f040 con 0x7eff140f66e0 2022-02-02T22:28:29.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff080147e0 con 0x7eff140f66e0 2022-02-02T22:28:29.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.795+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410efa0 con 0x7eff140f66e0 2022-02-02T22:28:29.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.796+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef4004fa0 con 0x7eff140f66e0 2022-02-02T22:28:29.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.797+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff080077b0 con 0x7eff140f66e0 2022-02-02T22:28:29.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.797+0000 7efefb7fe700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 0x7efefc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:29.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.797+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7eff080820f0 con 0x7eff140f66e0 2022-02-02T22:28:29.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.797+0000 7eff127fc700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 0x7efefc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:29.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.797+0000 7eff127fc700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 0x7efefc067290 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7eff04004630 tx=0x7eff04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:29.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:29.802+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff080501f0 con 0x7eff140f66e0 2022-02-02T22:28:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.033+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efef4005e80 con 0x7eff140f66e0 2022-02-02T22:28:30.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.034+0000 7efefb7fe700 1 -- 172.21.15.96:0/509509949 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7eff08053810 con 0x7eff140f66e0 2022-02-02T22:28:30.034 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:28:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:28:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:28:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:28:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:28:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:28:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:28:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:28:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:28:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:28:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:28:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:28:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:28:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:28:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:28:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:28:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:28:30.040 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:28:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 msgr2=0x7efefc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 0x7efefc067290 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7eff04004630 tx=0x7eff04009b30).stop 2022-02-02T22:28:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 msgr2=0x7eff1406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 secure :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 rx=0x7eff080026d0 tx=0x7eff08009de0).stop 2022-02-02T22:28:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 shutdown_connections 2022-02-02T22:28:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efefc064dd0 0x7efefc067290 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff140f66e0 0x7eff1406b9a0 unknown :-1 s=CLOSED pgs=3779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 --2- 172.21.15.96:0/509509949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140f6ff0 0x7eff14069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 >> 172.21.15.96:0/509509949 conn(0x7eff140f1f00 msgr2=0x7eff140fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 shutdown_connections 2022-02-02T22:28:30.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.036+0000 7eff198b1700 1 -- 172.21.15.96:0/509509949 wait complete. 2022-02-02T22:28:30.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 -- 172.21.15.96:0/3510818882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 msgr2=0x7fb6040f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 --2- 172.21.15.96:0/3510818882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb6040f5850 secure :-1 s=READY pgs=3780 cs=0 l=1 rev1=1 rx=0x7fb5f4004660 tx=0x7fb5f4009b30).stop 2022-02-02T22:28:30.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 -- 172.21.15.96:0/3510818882 shutdown_connections 2022-02-02T22:28:30.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 --2- 172.21.15.96:0/3510818882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6040f66d0 0x7fb6040f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 --2- 172.21.15.96:0/3510818882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb6040f5850 unknown :-1 s=CLOSED pgs=3780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 -- 172.21.15.96:0/3510818882 >> 172.21.15.96:0/3510818882 conn(0x7fb6040f0b90 msgr2=0x7fb6040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:30.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 -- 172.21.15.96:0/3510818882 shutdown_connections 2022-02-02T22:28:30.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.134+0000 7fb6097a1700 1 -- 172.21.15.96:0/3510818882 wait complete. 2022-02-02T22:28:30.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 Processor -- start 2022-02-02T22:28:30.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 -- start start 2022-02-02T22:28:30.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:30.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6040f66d0 0x7fb604109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:30.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604109a40 con 0x7fb6040f5430 2022-02-02T22:28:30.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb6097a1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604109b80 con 0x7fb6040f66d0 2022-02-02T22:28:30.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb603fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:30.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb603fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48664/0 (socket says 172.21.15.96:48664) 2022-02-02T22:28:30.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.135+0000 7fb603fff700 1 -- 172.21.15.96:0/1474358268 learned_addr learned my addr 172.21.15.96:0/1474358268 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:28:30.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb603fff700 1 -- 172.21.15.96:0/1474358268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6040f66d0 msgr2=0x7fb604109490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb603fff700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6040f66d0 0x7fb604109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:28:30.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb603fff700 1 -- 172.21.15.96:0/1474358268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4005040 con 0x7fb6040f5430 2022-02-02T22:28:30.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb603fff700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 secure :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 rx=0x7fb5f4004f60 tx=0x7fb5f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:30.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f4018070 con 0x7fb6040f5430 2022-02-02T22:28:30.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60410a4c0 con 0x7fb6040f5430 2022-02-02T22:28:30.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb5f4007ba0 con 0x7fb6040f5430 2022-02-02T22:28:30.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f401c620 con 0x7fb6040f5430 2022-02-02T22:28:30.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.136+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60410aa20 con 0x7fb6040f5430 2022-02-02T22:28:30.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.137+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb604045ad0 con 0x7fb6040f5430 2022-02-02T22:28:30.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.138+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb5f401d420 con 0x7fb6040f5430 2022-02-02T22:28:30.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.138+0000 7fb600ff9700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 0x7fb5ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:28:30.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.138+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb5f4083890 con 0x7fb6040f5430 2022-02-02T22:28:30.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.138+0000 7fb6037fe700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 0x7fb5ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:28:30.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.138+0000 7fb6037fe700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 0x7fb5ec0672e0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7fb5f80047d0 tx=0x7fb5f8007a40).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:28:30.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.142+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb5f4055480 con 0x7fb6040f5430 2022-02-02T22:28:30.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.344+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb60410b0b0 con 0x7fb6040f5430 2022-02-02T22:28:30.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.344+0000 7fb600ff9700 1 -- 172.21.15.96:0/1474358268 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb5f4055070 con 0x7fb6040f5430 2022-02-02T22:28:30.345 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:28:30.345 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:28:30.346 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:28:30.346 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:28:30.347 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:28:30.347 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:28:30.347 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:28:30.348 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:28:30.348 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:28:30.348 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:28:30.349 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:28:30.349 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:28:30.349 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:28:30.350 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:28:30.350 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:28:30.350 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:28:30.351 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:28:30.351 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:28:30.351 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:28:30.352 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:28:30.352 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:28:30.352 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:28:30.353 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:28:30.353 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:28:30.353 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:28:30.354 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:28:30.354 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:28:30.354 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:28:30.355 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:28:30.355 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:28:30.355 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:28:30.356 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:28:30.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:28:30.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:28:30.357 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:28:30.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:28:30.357 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:28:30.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:28:30.358 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:28:30.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 msgr2=0x7fb5ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 0x7fb5ec0672e0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7fb5f80047d0 tx=0x7fb5f8007a40).stop 2022-02-02T22:28:30.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 msgr2=0x7fb604108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:28:30.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 secure :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 rx=0x7fb5f4004f60 tx=0x7fb5f4009b30).stop 2022-02-02T22:28:30.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 shutdown_connections 2022-02-02T22:28:30.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb5ec064e20 0x7fb5ec0672e0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6040f5430 0x7fb604108fa0 unknown :-1 s=CLOSED pgs=3781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:28:30.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 --2- 172.21.15.96:0/1474358268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6040f66d0 0x7fb604109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:28:30.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 >> 172.21.15.96:0/1474358268 conn(0x7fb6040f0b90 msgr2=0x7fb60405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:28:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.346+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 shutdown_connections 2022-02-02T22:28:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:28:30.347+0000 7fb6097a1700 1 -- 172.21.15.96:0/1474358268 wait complete. 2022-02-02T22:28:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:28:31.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:30 smithi159 ceph-mon[69013]: pgmap v7391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:30 smithi159 ceph-mon[69013]: from='client.41670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:30 smithi159 ceph-mon[69013]: from='client.41674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/509509949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:28:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:30 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1474358268' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:28:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:30 smithi096 ceph-mon[101353]: pgmap v7391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:30 smithi096 ceph-mon[101353]: from='client.41670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:30 smithi096 ceph-mon[101353]: from='client.41674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:28:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/509509949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:28:31.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:30 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1474358268' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:28:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:32 smithi096 ceph-mon[101353]: pgmap v7392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:33.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:32 smithi159 ceph-mon[69013]: pgmap v7392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:35.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:34 smithi159 ceph-mon[69013]: pgmap v7393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:34 smithi096 ceph-mon[101353]: pgmap v7393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:36.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:35 smithi159 ceph-mon[69013]: pgmap v7394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:36.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:35 smithi096 ceph-mon[101353]: pgmap v7394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:38.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:38 smithi159 ceph-mon[69013]: pgmap v7395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:38.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:38 smithi096 ceph-mon[101353]: pgmap v7395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:40.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:40 smithi159 ceph-mon[69013]: pgmap v7396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:40 smithi096 ceph-mon[101353]: pgmap v7396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:42 smithi159 ceph-mon[69013]: pgmap v7397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:42 smithi096 ceph-mon[101353]: pgmap v7397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:44 smithi159 ceph-mon[69013]: pgmap v7398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:44.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:44 smithi096 ceph-mon[101353]: pgmap v7398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:46.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:46 smithi159 ceph-mon[69013]: pgmap v7399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:46 smithi096 ceph-mon[101353]: pgmap v7399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:48.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:48 smithi159 ceph-mon[69013]: pgmap v7400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:48 smithi096 ceph-mon[101353]: pgmap v7400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:50.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:50 smithi159 ceph-mon[69013]: pgmap v7401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:50 smithi096 ceph-mon[101353]: pgmap v7401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:52 smithi159 ceph-mon[69013]: pgmap v7402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:52 smithi096 ceph-mon[101353]: pgmap v7402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:54 smithi159 ceph-mon[69013]: pgmap v7403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:54 smithi096 ceph-mon[101353]: pgmap v7403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:56 smithi159 ceph-mon[69013]: pgmap v7404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:56 smithi096 ceph-mon[101353]: pgmap v7404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:28:58 smithi159 ceph-mon[69013]: pgmap v7405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:28:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:28:58 smithi096 ceph-mon[101353]: pgmap v7405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:00.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 -- 172.21.15.96:0/3063253263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f55c0 msgr2=0x7f90340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3063253263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f55c0 0x7f90340f59e0 secure :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 rx=0x7f9024004660 tx=0x7f9024009b30).stop 2022-02-02T22:29:00.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 -- 172.21.15.96:0/3063253263 shutdown_connections 2022-02-02T22:29:00.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3063253263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f6860 0x7f90340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:29:00.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3063253263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f55c0 0x7f90340f59e0 unknown :-1 s=CLOSED pgs=3782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 -- 172.21.15.96:0/3063253263 >> 172.21.15.96:0/3063253263 conn(0x7f90340f0d40 msgr2=0x7f90340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:00.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 -- 172.21.15.96:0/3063253263 shutdown_connections 2022-02-02T22:29:00.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.456+0000 7f903b2ab700 1 -- 172.21.15.96:0/3063253263 wait complete. 2022-02-02T22:29:00.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 Processor -- start 2022-02-02T22:29:00.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 -- start start 2022-02-02T22:29:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f55c0 0x7f9034105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90341069f0 con 0x7f90340f6860 2022-02-02T22:29:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f903b2ab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90341072a0 con 0x7f90340f55c0 2022-02-02T22:29:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48684/0 (socket says 172.21.15.96:48684) 2022-02-02T22:29:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 -- 172.21.15.96:0/3049474083 learned_addr learned my addr 172.21.15.96:0/3049474083 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9039047700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f55c0 0x7f9034105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 -- 172.21.15.96:0/3049474083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f55c0 msgr2=0x7f9034105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f55c0 0x7f9034105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.457+0000 7f9038846700 1 -- 172.21.15.96:0/3049474083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024005040 con 0x7f90340f6860 2022-02-02T22:29:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f9038846700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 secure :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 rx=0x7f903000d770 tx=0x7f903000da80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903000e9e0 con 0x7f90340f6860 2022-02-02T22:29:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9030012070 con 0x7f90340f6860 2022-02-02T22:29:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9034107520 con 0x7f90340f6860 2022-02-02T22:29:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9030016e80 con 0x7f90340f6860 2022-02-02T22:29:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.458+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9034107a80 con 0x7f90340f6860 2022-02-02T22:29:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.459+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034045ad0 con 0x7f90340f6860 2022-02-02T22:29:00.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.459+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f903001e070 con 0x7f90340f6860 2022-02-02T22:29:00.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.460+0000 7f9029ffb700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 0x7f9020067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.460+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9030083b90 con 0x7f90340f6860 2022-02-02T22:29:00.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.460+0000 7f9039047700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 0x7f9020067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.460+0000 7f9039047700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 0x7f9020067290 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7f9024004630 tx=0x7f9024009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.464+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f90300556c0 con 0x7f90340f6860 2022-02-02T22:29:00.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.643+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90340ff920 con 0x7f9020064dd0 2022-02-02T22:29:00.645 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:00 smithi096 ceph-mon[101353]: pgmap v7406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:00.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.644+0000 7f9029ffb700 1 -- 172.21.15.96:0/3049474083 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f90340ff920 con 0x7f9020064dd0 2022-02-02T22:29:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 msgr2=0x7f9020067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 0x7f9020067290 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7f9024004630 tx=0x7f9024009b30).stop 2022-02-02T22:29:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 msgr2=0x7f90341063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 secure :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 rx=0x7f903000d770 tx=0x7f903000da80).stop 2022-02-02T22:29:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 shutdown_connections 2022-02-02T22:29:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9020064dd0 0x7f9020067290 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90340f55c0 0x7f9034105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 --2- 172.21.15.96:0/3049474083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90340f6860 0x7f90341063b0 unknown :-1 s=CLOSED pgs=3783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 >> 172.21.15.96:0/3049474083 conn(0x7f90340f0d40 msgr2=0x7f90340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 shutdown_connections 2022-02-02T22:29:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.646+0000 7f903b2ab700 1 -- 172.21.15.96:0/3049474083 wait complete. 2022-02-02T22:29:00.656 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:29:00.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 -- 172.21.15.96:0/3033160625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f6860 msgr2=0x7fd64c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 --2- 172.21.15.96:0/3033160625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f6860 0x7fd64c0f6cc0 secure :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 rx=0x7fd63c004660 tx=0x7fd63c009b30).stop 2022-02-02T22:29:00.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 -- 172.21.15.96:0/3033160625 shutdown_connections 2022-02-02T22:29:00.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 --2- 172.21.15.96:0/3033160625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f6860 0x7fd64c0f6cc0 unknown :-1 s=CLOSED pgs=3784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 --2- 172.21.15.96:0/3033160625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f55c0 0x7fd64c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 -- 172.21.15.96:0/3033160625 >> 172.21.15.96:0/3033160625 conn(0x7fd64c0f0d40 msgr2=0x7fd64c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 -- 172.21.15.96:0/3033160625 shutdown_connections 2022-02-02T22:29:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.744+0000 7fd650b30700 1 -- 172.21.15.96:0/3033160625 wait complete. 2022-02-02T22:29:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 Processor -- start 2022-02-02T22:29:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 -- start start 2022-02-02T22:29:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 0x7fd64c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0603c0 con 0x7fd64c0f55c0 2022-02-02T22:29:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd650b30700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c060500 con 0x7fd64c0f6860 2022-02-02T22:29:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48692/0 (socket says 172.21.15.96:48692) 2022-02-02T22:29:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 -- 172.21.15.96:0/1595760961 learned_addr learned my addr 172.21.15.96:0/1595760961 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:00.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd649d9b700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 0x7fd64c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 -- 172.21.15.96:0/1595760961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 msgr2=0x7fd64c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 0x7fd64c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd64a59c700 1 -- 172.21.15.96:0/1595760961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c005040 con 0x7fd64c0f55c0 2022-02-02T22:29:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.745+0000 7fd649d9b700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 0x7fd64c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:29:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd64a59c700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 secure :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 rx=0x7fd640002700 tx=0x7fd640009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd640009320 con 0x7fd64c0f55c0 2022-02-02T22:29:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c10c720 con 0x7fd64c0f55c0 2022-02-02T22:29:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd64000f040 con 0x7fd64c0f55c0 2022-02-02T22:29:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd640014900 con 0x7fd64c0f55c0 2022-02-02T22:29:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.746+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c10ccb0 con 0x7fd64c0f55c0 2022-02-02T22:29:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.747+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c0f49b0 con 0x7fd64c0f55c0 2022-02-02T22:29:00.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.747+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd640009480 con 0x7fd64c0f55c0 2022-02-02T22:29:00.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.747+0000 7fd63affd700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 0x7fd634067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:00.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.747+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd640081c20 con 0x7fd64c0f55c0 2022-02-02T22:29:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.747+0000 7fd649d9b700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 0x7fd634067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.748+0000 7fd649d9b700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 0x7fd634067290 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fd63c004630 tx=0x7fd63c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:00.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.752+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd64004fd00 con 0x7fd64c0f55c0 2022-02-02T22:29:00.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:00 smithi159 ceph-mon[69013]: pgmap v7406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:00.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.924+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd64c057f10 con 0x7fd634064dd0 2022-02-02T22:29:00.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.933+0000 7fd63affd700 1 -- 172.21.15.96:0/1595760961 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd64c057f10 con 0x7fd634064dd0 2022-02-02T22:29:00.934 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:29:00.935 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:29:00.935 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:29:00.935 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:29:00.936 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:29:00.936 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:29:00.936 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:29:00.937 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:29:00.937 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:29:00.937 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:29:00.938 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:29:00.938 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:29:00.938 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:29:00.939 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:29:00.939 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:29:00.939 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:29:00.939 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:29:00.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:29:00.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:29:00.940 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:29:00.941 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:29:00.941 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:29:00.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 msgr2=0x7fd634067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 0x7fd634067290 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fd63c004630 tx=0x7fd63c009b30).stop 2022-02-02T22:29:00.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 msgr2=0x7fd64c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:00.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 secure :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 rx=0x7fd640002700 tx=0x7fd640009d80).stop 2022-02-02T22:29:00.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 shutdown_connections 2022-02-02T22:29:00.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd634064dd0 0x7fd634067290 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd64c0f55c0 0x7fd64c109c70 unknown :-1 s=CLOSED pgs=3785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 --2- 172.21.15.96:0/1595760961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64c0f6860 0x7fd64c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 >> 172.21.15.96:0/1595760961 conn(0x7fd64c0f0d40 msgr2=0x7fd64c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 shutdown_connections 2022-02-02T22:29:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:00.936+0000 7fd650b30700 1 -- 172.21.15.96:0/1595760961 wait complete. 2022-02-02T22:29:01.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- 172.21.15.96:0/2237836739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 msgr2=0x7f970c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 --2- 172.21.15.96:0/2237836739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f5860 secure :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 rx=0x7f96fc004660 tx=0x7f96fc009b30).stop 2022-02-02T22:29:01.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- 172.21.15.96:0/2237836739 shutdown_connections 2022-02-02T22:29:01.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 --2- 172.21.15.96:0/2237836739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 0x7f970c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 --2- 172.21.15.96:0/2237836739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f5860 unknown :-1 s=CLOSED pgs=3786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- 172.21.15.96:0/2237836739 >> 172.21.15.96:0/2237836739 conn(0x7f970c0f0ba0 msgr2=0x7f970c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:01.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- 172.21.15.96:0/2237836739 shutdown_connections 2022-02-02T22:29:01.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- 172.21.15.96:0/2237836739 wait complete. 2022-02-02T22:29:01.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 Processor -- start 2022-02-02T22:29:01.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.032+0000 7f971085b700 1 -- start start 2022-02-02T22:29:01.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f971085b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f971085b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 0x7f970c0f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f971085b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0f7f80 con 0x7f970c0f5440 2022-02-02T22:29:01.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f971085b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0f80c0 con 0x7f970c0f66e0 2022-02-02T22:29:01.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48702/0 (socket says 172.21.15.96:48702) 2022-02-02T22:29:01.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 -- 172.21.15.96:0/2190184530 learned_addr learned my addr 172.21.15.96:0/2190184530 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:01.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970a59c700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 0x7f970c0f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 -- 172.21.15.96:0/2190184530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 msgr2=0x7f970c0f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 0x7f970c0f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 -- 172.21.15.96:0/2190184530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc005040 con 0x7f970c0f5440 2022-02-02T22:29:01.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f970ad9d700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 secure :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 rx=0x7f96fc013a70 tx=0x7f96fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:01.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc018070 con 0x7f970c0f5440 2022-02-02T22:29:01.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f96fc0097d0 con 0x7f970c0f5440 2022-02-02T22:29:01.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c0f8340 con 0x7f970c0f5440 2022-02-02T22:29:01.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.033+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc01de80 con 0x7f970c0f5440 2022-02-02T22:29:01.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.034+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c0f88a0 con 0x7f970c0f5440 2022-02-02T22:29:01.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.034+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c045ad0 con 0x7f970c0f5440 2022-02-02T22:29:01.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.035+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f96fc007ba0 con 0x7f970c0f5440 2022-02-02T22:29:01.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.035+0000 7f96f37fe700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 0x7f96f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.035+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f96fc083560 con 0x7f970c0f5440 2022-02-02T22:29:01.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.035+0000 7f970a59c700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 0x7f96f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.036+0000 7f970a59c700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 0x7f96f40672e0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f9700004e20 tx=0x7f970000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:01.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.039+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f96fc051660 con 0x7f970c0f5440 2022-02-02T22:29:01.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.268+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f970c10f4e0 con 0x7f970c0f5440 2022-02-02T22:29:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.269+0000 7f96f37fe700 1 -- 172.21.15.96:0/2190184530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f96fc054c80 con 0x7f970c0f5440 2022-02-02T22:29:01.271 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:29:01.271 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:29:01.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:29:01.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:01.272 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:29:01.272 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:29:01.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:01.273 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:29:01.273 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:29:01.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:01.274 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:29:01.274 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:29:01.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:01.275 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:29:01.275 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:29:01.276 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:29:01.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:29:01.277 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:29:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 msgr2=0x7f96f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 0x7f96f40672e0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f9700004e20 tx=0x7f970000b040).stop 2022-02-02T22:29:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 msgr2=0x7f970c0f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 secure :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 rx=0x7f96fc013a70 tx=0x7f96fc009b30).stop 2022-02-02T22:29:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 shutdown_connections 2022-02-02T22:29:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f96f4064e20 0x7f96f40672e0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f970c0f5440 0x7f970c0f95a0 unknown :-1 s=CLOSED pgs=3787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 --2- 172.21.15.96:0/2190184530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c0f66e0 0x7f970c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.271+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 >> 172.21.15.96:0/2190184530 conn(0x7f970c0f0ba0 msgr2=0x7f970c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.272+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 shutdown_connections 2022-02-02T22:29:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.272+0000 7f971085b700 1 -- 172.21.15.96:0/2190184530 wait complete. 2022-02-02T22:29:01.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 -- 172.21.15.96:0/1080367326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6530 msgr2=0x7f9a1c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 --2- 172.21.15.96:0/1080367326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c0f6950 secure :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 rx=0x7f9a04004660 tx=0x7f9a04009b30).stop 2022-02-02T22:29:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 -- 172.21.15.96:0/1080367326 shutdown_connections 2022-02-02T22:29:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 --2- 172.21.15.96:0/1080367326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 --2- 172.21.15.96:0/1080367326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c0f6950 unknown :-1 s=CLOSED pgs=3788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 -- 172.21.15.96:0/1080367326 >> 172.21.15.96:0/1080367326 conn(0x7f9a1c0f1c90 msgr2=0x7f9a1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 -- 172.21.15.96:0/1080367326 shutdown_connections 2022-02-02T22:29:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.368+0000 7f9a20f83700 1 -- 172.21.15.96:0/1080367326 wait complete. 2022-02-02T22:29:01.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 Processor -- start 2022-02-02T22:29:01.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 -- start start 2022-02-02T22:29:01.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c107870 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a20f83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c108080 con 0x7f9a1c0f6530 2022-02-02T22:29:01.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48714/0 (socket says 172.21.15.96:48714) 2022-02-02T22:29:01.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a1affd700 1 -- 172.21.15.96:0/4166130854 learned_addr learned my addr 172.21.15.96:0/4166130854 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:01.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.369+0000 7f9a1b7fe700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a1affd700 1 -- 172.21.15.96:0/4166130854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f6530 msgr2=0x7f9a1c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a1affd700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a1affd700 1 -- 172.21.15.96:0/4166130854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04005040 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a1affd700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 secure :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 rx=0x7f9a0c002700 tx=0x7f9a0c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:01.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a0c009320 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a0c00f040 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c108300 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a0c014870 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.370+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c1088c0 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.371+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c059100 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.371+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a0c009480 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.372+0000 7f9a13fff700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 0x7f9a080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.372+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a0c081d00 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.372+0000 7f9a1b7fe700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 0x7f9a080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:01.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.372+0000 7f9a1b7fe700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 0x7f9a080672e0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f9a04013690 tx=0x7f9a04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:01.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.376+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a0c085030 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:01 smithi096 ceph-mon[101353]: from='client.41686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:01.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2190184530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:29:01.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.577+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a1c0fee80 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.578+0000 7f9a13fff700 1 -- 172.21.15.96:0/4166130854 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9a1c0fee80 con 0x7f9a1c0f77d0 2022-02-02T22:29:01.580 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:29:01.580 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:29:01.580 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:29:01.581 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:29:01.581 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:01.581 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:29:01.582 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:29:01.582 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:29:01.583 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:29:01.583 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:29:01.583 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:29:01.584 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:29:01.584 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:29:01.584 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:29:01.585 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:29:01.585 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:29:01.586 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:29:01.586 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:29:01.586 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:29:01.587 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:29:01.587 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:29:01.587 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:29:01.588 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:29:01.588 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:29:01.588 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:29:01.589 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:29:01.589 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:29:01.589 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:29:01.590 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:29:01.590 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:29:01.590 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:29:01.591 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:29:01.591 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:01.591 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:01.592 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:29:01.592 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 msgr2=0x7f9a080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 0x7f9a080672e0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f9a04013690 tx=0x7f9a04009b30).stop 2022-02-02T22:29:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 msgr2=0x7f9a1c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 secure :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 rx=0x7f9a0c002700 tx=0x7f9a0c009e00).stop 2022-02-02T22:29:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 shutdown_connections 2022-02-02T22:29:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a08064e20 0x7f9a080672e0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1c0f6530 0x7f9a1c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 --2- 172.21.15.96:0/4166130854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a1c0f77d0 0x7f9a1c107270 unknown :-1 s=CLOSED pgs=3789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 >> 172.21.15.96:0/4166130854 conn(0x7f9a1c0f1c90 msgr2=0x7f9a1c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 shutdown_connections 2022-02-02T22:29:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:01.580+0000 7f9a20f83700 1 -- 172.21.15.96:0/4166130854 wait complete. 2022-02-02T22:29:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:29:01.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:01 smithi159 ceph-mon[69013]: from='client.41686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:01.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2190184530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:29:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:02 smithi159 ceph-mon[69013]: from='client.41690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:02 smithi159 ceph-mon[69013]: pgmap v7407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4166130854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:29:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:02 smithi096 ceph-mon[101353]: from='client.41690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:02 smithi096 ceph-mon[101353]: pgmap v7407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4166130854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:29:04.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:04 smithi159 ceph-mon[69013]: pgmap v7408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:04 smithi096 ceph-mon[101353]: pgmap v7408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:06 smithi159 ceph-mon[69013]: pgmap v7409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:06 smithi096 ceph-mon[101353]: pgmap v7409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:08 smithi159 ceph-mon[69013]: pgmap v7410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:08 smithi096 ceph-mon[101353]: pgmap v7410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:10.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:10 smithi159 ceph-mon[69013]: pgmap v7411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:10 smithi096 ceph-mon[101353]: pgmap v7411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:12 smithi159 ceph-mon[69013]: pgmap v7412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:12 smithi096 ceph-mon[101353]: pgmap v7412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:14 smithi159 ceph-mon[69013]: pgmap v7413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:14 smithi096 ceph-mon[101353]: pgmap v7413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:16.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:16 smithi159 ceph-mon[69013]: pgmap v7414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:16 smithi096 ceph-mon[101353]: pgmap v7414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:18.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:18 smithi159 ceph-mon[69013]: pgmap v7415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:18 smithi096 ceph-mon[101353]: pgmap v7415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:20 smithi159 ceph-mon[69013]: pgmap v7416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:20 smithi096 ceph-mon[101353]: pgmap v7416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:22 smithi159 ceph-mon[69013]: pgmap v7417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:22 smithi096 ceph-mon[101353]: pgmap v7417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:24 smithi159 ceph-mon[69013]: pgmap v7418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:24 smithi096 ceph-mon[101353]: pgmap v7418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:26 smithi159 ceph-mon[69013]: pgmap v7419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:26 smithi096 ceph-mon[101353]: pgmap v7419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:28.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:28 smithi159 ceph-mon[69013]: pgmap v7420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:29:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:29:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:28 smithi096 ceph-mon[101353]: pgmap v7420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:29:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:29:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:30 smithi159 ceph-mon[69013]: pgmap v7421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:30 smithi096 ceph-mon[101353]: pgmap v7421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 -- 172.21.15.96:0/1497084707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 msgr2=0x7fddb40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 --2- 172.21.15.96:0/1497084707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb40f6b00 secure :-1 s=READY pgs=3790 cs=0 l=1 rev1=1 rx=0x7fdda40099e0 tx=0x7fdda4004d10).stop 2022-02-02T22:29:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 -- 172.21.15.96:0/1497084707 shutdown_connections 2022-02-02T22:29:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 --2- 172.21.15.96:0/1497084707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:29:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 --2- 172.21.15.96:0/1497084707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb40f6b00 unknown :-1 s=CLOSED pgs=3790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 -- 172.21.15.96:0/1497084707 >> 172.21.15.96:0/1497084707 conn(0x7fddb40f1e40 msgr2=0x7fddb40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 -- 172.21.15.96:0/1497084707 shutdown_connections 2022-02-02T22:29:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.691+0000 7fddb9672700 1 -- 172.21.15.96:0/1497084707 wait complete. 2022-02-02T22:29:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 Processor -- start 2022-02-02T22:29:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 -- start start 2022-02-02T22:29:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb4107610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4107c50 con 0x7fddb40f66e0 2022-02-02T22:29:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb9672700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4108500 con 0x7fddb40f7980 2022-02-02T22:29:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48730/0 (socket says 172.21.15.96:48730) 2022-02-02T22:29:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb2ffd700 1 -- 172.21.15.96:0/413872557 learned_addr learned my addr 172.21.15.96:0/413872557 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.692+0000 7fddb27fc700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb4107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb2ffd700 1 -- 172.21.15.96:0/413872557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 msgr2=0x7fddb4107610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb2ffd700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb4107610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb2ffd700 1 -- 172.21.15.96:0/413872557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4009640 con 0x7fddb40f66e0 2022-02-02T22:29:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb27fc700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb4107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:29:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb2ffd700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 secure :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 rx=0x7fdda400c010 tx=0x7fdda4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda400e070 con 0x7fddb40f66e0 2022-02-02T22:29:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb4108780 con 0x7fddb40f66e0 2022-02-02T22:29:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdda4007dc0 con 0x7fddb40f66e0 2022-02-02T22:29:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda4018070 con 0x7fddb40f66e0 2022-02-02T22:29:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.693+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb4108c60 con 0x7fddb40f66e0 2022-02-02T22:29:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.694+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb40f5ad0 con 0x7fddb40f66e0 2022-02-02T22:29:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.695+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdda4024060 con 0x7fddb40f66e0 2022-02-02T22:29:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.695+0000 7fddab7fe700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 0x7fdda0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.695+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdda4083520 con 0x7fddb40f66e0 2022-02-02T22:29:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.695+0000 7fddb27fc700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 0x7fdda0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.695+0000 7fddb27fc700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 0x7fdda0067290 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 rx=0x7fdd9c00b830 tx=0x7fdd9c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:31.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.699+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdda4055050 con 0x7fddb40f66e0 2022-02-02T22:29:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.878+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddb40ff010 con 0x7fdda0064dd0 2022-02-02T22:29:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.879+0000 7fddab7fe700 1 -- 172.21.15.96:0/413872557 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fddb40ff010 con 0x7fdda0064dd0 2022-02-02T22:29:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 msgr2=0x7fdda0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 0x7fdda0067290 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 rx=0x7fdd9c00b830 tx=0x7fdd9c008040).stop 2022-02-02T22:29:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 msgr2=0x7fddb4107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 secure :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 rx=0x7fdda400c010 tx=0x7fdda4004d10).stop 2022-02-02T22:29:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 shutdown_connections 2022-02-02T22:29:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda0064dd0 0x7fdda0067290 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddb40f66e0 0x7fddb4107120 unknown :-1 s=CLOSED pgs=3791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 --2- 172.21.15.96:0/413872557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddb40f7980 0x7fddb4107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 >> 172.21.15.96:0/413872557 conn(0x7fddb40f1e40 msgr2=0x7fddb40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:31.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 shutdown_connections 2022-02-02T22:29:31.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.881+0000 7fddb9672700 1 -- 172.21.15.96:0/413872557 wait complete. 2022-02-02T22:29:31.891 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:29:31.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.979+0000 7f81692fc700 1 -- 172.21.15.96:0/2553984296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f66e0 msgr2=0x7f81640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.979+0000 7f81692fc700 1 --2- 172.21.15.96:0/2553984296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f66e0 0x7f81640f6b00 secure :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 rx=0x7f8158004660 tx=0x7f8158009b30).stop 2022-02-02T22:29:31.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.979+0000 7f81692fc700 1 -- 172.21.15.96:0/2553984296 shutdown_connections 2022-02-02T22:29:31.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 --2- 172.21.15.96:0/2553984296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f7980 0x7f81640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 --2- 172.21.15.96:0/2553984296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f66e0 0x7f81640f6b00 unknown :-1 s=CLOSED pgs=3792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 -- 172.21.15.96:0/2553984296 >> 172.21.15.96:0/2553984296 conn(0x7f81640f1e40 msgr2=0x7f81640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 -- 172.21.15.96:0/2553984296 shutdown_connections 2022-02-02T22:29:31.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 -- 172.21.15.96:0/2553984296 wait complete. 2022-02-02T22:29:31.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 Processor -- start 2022-02-02T22:29:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.980+0000 7f81692fc700 1 -- start start 2022-02-02T22:29:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81692fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81692fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 0x7f81641074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81692fc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164107a50 con 0x7f81640f7980 2022-02-02T22:29:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81692fc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164107b90 con 0x7f81640f66e0 2022-02-02T22:29:31.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:52848/0 (socket says 172.21.15.96:52848) 2022-02-02T22:29:31.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f8162ffd700 1 -- 172.21.15.96:0/1274143167 learned_addr learned my addr 172.21.15.96:0/1274143167 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:31.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81627fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 0x7f81641074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81627fc700 1 -- 172.21.15.96:0/1274143167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 msgr2=0x7f8164106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:31.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81627fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:31.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f81627fc700 1 -- 172.21.15.96:0/1274143167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158005040 con 0x7f81640f7980 2022-02-02T22:29:31.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.981+0000 7f8162ffd700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:29:31.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f81627fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 0x7f81641074a0 secure :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 rx=0x7f815400c470 tx=0x7f8154007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:31.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f815400f650 con 0x7f81640f7980 2022-02-02T22:29:31.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8164108530 con 0x7f81640f7980 2022-02-02T22:29:31.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f815400ce90 con 0x7f81640f7980 2022-02-02T22:29:31.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8154012b00 con 0x7f81640f7980 2022-02-02T22:29:31.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.982+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164108af0 con 0x7f81640f7980 2022-02-02T22:29:31.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.983+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8164045ad0 con 0x7f81640f7980 2022-02-02T22:29:31.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.983+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8154010070 con 0x7f81640f7980 2022-02-02T22:29:31.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.983+0000 7f814b7fe700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 0x7f814c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:31.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.984+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8154081610 con 0x7f81640f7980 2022-02-02T22:29:31.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.984+0000 7f8162ffd700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 0x7f814c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:31.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.984+0000 7f8162ffd700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 0x7f814c067290 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f8158004630 tx=0x7f8158009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:31.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:31.988+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8154053140 con 0x7f81640f7980 2022-02-02T22:29:32.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.159+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81640fefb0 con 0x7f814c064dd0 2022-02-02T22:29:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.169+0000 7f814b7fe700 1 -- 172.21.15.96:0/1274143167 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f81640fefb0 con 0x7f814c064dd0 2022-02-02T22:29:32.169 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:29:32.169 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:29:32.170 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:29:32.170 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:29:32.171 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:29:32.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:29:32.171 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:29:32.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:29:32.172 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:29:32.172 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:29:32.173 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:29:32.173 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:29:32.173 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:29:32.174 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:29:32.174 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:29:32.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:29:32.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:29:32.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:29:32.175 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:29:32.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:29:32.176 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:29:32.176 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:29:32.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 msgr2=0x7f814c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 0x7f814c067290 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f8158004630 tx=0x7f8158009b30).stop 2022-02-02T22:29:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 msgr2=0x7f81641074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 0x7f81641074a0 secure :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 rx=0x7f815400c470 tx=0x7f8154007d60).stop 2022-02-02T22:29:32.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 shutdown_connections 2022-02-02T22:29:32.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f814c064dd0 0x7f814c067290 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81640f66e0 0x7f8164106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 --2- 172.21.15.96:0/1274143167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81640f7980 0x7f81641074a0 unknown :-1 s=CLOSED pgs=3793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 >> 172.21.15.96:0/1274143167 conn(0x7f81640f1e40 msgr2=0x7f81640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:32.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 shutdown_connections 2022-02-02T22:29:32.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.171+0000 7f81692fc700 1 -- 172.21.15.96:0/1274143167 wait complete. 2022-02-02T22:29:32.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 -- 172.21.15.96:0/1750677306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 msgr2=0x7fe5640f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 --2- 172.21.15.96:0/1750677306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe5640f9110 secure :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 rx=0x7fe554004660 tx=0x7fe554009b30).stop 2022-02-02T22:29:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 -- 172.21.15.96:0/1750677306 shutdown_connections 2022-02-02T22:29:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 --2- 172.21.15.96:0/1750677306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe5640fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 --2- 172.21.15.96:0/1750677306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe5640f9110 unknown :-1 s=CLOSED pgs=3794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 -- 172.21.15.96:0/1750677306 >> 172.21.15.96:0/1750677306 conn(0x7fe5640f0b90 msgr2=0x7fe5640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 -- 172.21.15.96:0/1750677306 shutdown_connections 2022-02-02T22:29:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.267+0000 7fe563fff700 1 -- 172.21.15.96:0/1750677306 wait complete. 2022-02-02T22:29:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 Processor -- start 2022-02-02T22:29:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 -- start start 2022-02-02T22:29:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe564109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564109a10 con 0x7fe564060310 2022-02-02T22:29:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.268+0000 7fe563fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564109b50 con 0x7fe5640f9690 2022-02-02T22:29:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48754/0 (socket says 172.21.15.96:48754) 2022-02-02T22:29:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 -- 172.21.15.96:0/2799480211 learned_addr learned my addr 172.21.15.96:0/2799480211 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe5627fc700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe564109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 -- 172.21.15.96:0/2799480211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 msgr2=0x7fe564109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe564109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 -- 172.21.15.96:0/2799480211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554005040 con 0x7fe564060310 2022-02-02T22:29:32.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe5627fc700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe564109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:29:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe562ffd700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 secure :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 rx=0x7fe554009990 tx=0x7fe554009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe554018070 con 0x7fe564060310 2022-02-02T22:29:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe554007ba0 con 0x7fe564060310 2022-02-02T22:29:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56410a490 con 0x7fe564060310 2022-02-02T22:29:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55401c3c0 con 0x7fe564060310 2022-02-02T22:29:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.269+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56410a9f0 con 0x7fe564060310 2022-02-02T22:29:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.270+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe564045ad0 con 0x7fe564060310 2022-02-02T22:29:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.271+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe55401d420 con 0x7fe564060310 2022-02-02T22:29:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.272+0000 7fe54b7fe700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 0x7fe54c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.272+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe554083900 con 0x7fe564060310 2022-02-02T22:29:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.272+0000 7fe5627fc700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 0x7fe54c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.272+0000 7fe5627fc700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 0x7fe54c0672e0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 rx=0x7fe5640600e0 tx=0x7fe558009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:32.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.275+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe554055450 con 0x7fe564060310 2022-02-02T22:29:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.509+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe56410f590 con 0x7fe564060310 2022-02-02T22:29:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.510+0000 7fe54b7fe700 1 -- 172.21.15.96:0/2799480211 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe554055040 con 0x7fe564060310 2022-02-02T22:29:32.510 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:29:32.511 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:29:32.511 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:29:32.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:32.512 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:29:32.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:29:32.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:32.513 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:29:32.513 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:29:32.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:32.514 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:29:32.514 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:29:32.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:29:32.515 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:29:32.515 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:29:32.516 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:29:32.516 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:29:32.516 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:29:32.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 msgr2=0x7fe54c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 0x7fe54c0672e0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 rx=0x7fe5640600e0 tx=0x7fe558009be0).stop 2022-02-02T22:29:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 msgr2=0x7fe564108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 secure :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 rx=0x7fe554009990 tx=0x7fe554009b30).stop 2022-02-02T22:29:32.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 shutdown_connections 2022-02-02T22:29:32.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe54c064e20 0x7fe54c0672e0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe564060310 0x7fe564108f70 unknown :-1 s=CLOSED pgs=3795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 --2- 172.21.15.96:0/2799480211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5640f9690 0x7fe564109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 >> 172.21.15.96:0/2799480211 conn(0x7fe5640f0b90 msgr2=0x7fe5640f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 shutdown_connections 2022-02-02T22:29:32.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.512+0000 7fe563fff700 1 -- 172.21.15.96:0/2799480211 wait complete. 2022-02-02T22:29:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:32 smithi096 ceph-mon[101353]: pgmap v7422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:32.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:32 smithi096 ceph-mon[101353]: from='client.41702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:32.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 -- 172.21.15.96:0/3594162759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 msgr2=0x7fac040f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 --2- 172.21.15.96:0/3594162759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac040f9360 secure :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 rx=0x7fabec004660 tx=0x7fabec009b30).stop 2022-02-02T22:29:32.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 -- 172.21.15.96:0/3594162759 shutdown_connections 2022-02-02T22:29:32.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 --2- 172.21.15.96:0/3594162759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 0x7fac040fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 --2- 172.21.15.96:0/3594162759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac040f9360 unknown :-1 s=CLOSED pgs=3796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.610+0000 7fac0a496700 1 -- 172.21.15.96:0/3594162759 >> 172.21.15.96:0/3594162759 conn(0x7fac040f0d40 msgr2=0x7fac040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:32.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 -- 172.21.15.96:0/3594162759 shutdown_connections 2022-02-02T22:29:32.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 -- 172.21.15.96:0/3594162759 wait complete. 2022-02-02T22:29:32.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 Processor -- start 2022-02-02T22:29:32.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 -- start start 2022-02-02T22:29:32.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 0x7fac04107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04107a40 con 0x7fac04060390 2022-02-02T22:29:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.611+0000 7fac0a496700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04107b80 con 0x7fac040f9850 2022-02-02T22:29:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48764/0 (socket says 172.21.15.96:48764) 2022-02-02T22:29:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 -- 172.21.15.96:0/432728116 learned_addr learned my addr 172.21.15.96:0/432728116 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:29:32.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac037fe700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 0x7fac04107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 -- 172.21.15.96:0/432728116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 msgr2=0x7fac04107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 0x7fac04107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 -- 172.21.15.96:0/432728116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec005040 con 0x7fac04060390 2022-02-02T22:29:32.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac03fff700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 secure :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 rx=0x7fabec009990 tx=0x7fabec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:32.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabec018070 con 0x7fac04060390 2022-02-02T22:29:32.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fabec007ba0 con 0x7fac04060390 2022-02-02T22:29:32.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac041084c0 con 0x7fac04060390 2022-02-02T22:29:32.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabec01c3c0 con 0x7fac04060390 2022-02-02T22:29:32.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.612+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac04108a20 con 0x7fac04060390 2022-02-02T22:29:32.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.613+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04045ad0 con 0x7fac04060390 2022-02-02T22:29:32.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.614+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fabec01d420 con 0x7fac04060390 2022-02-02T22:29:32.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.614+0000 7fac00ff9700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:29:32.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.614+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fabec0837d0 con 0x7fac04060390 2022-02-02T22:29:32.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.614+0000 7fac037fe700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:29:32.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.615+0000 7fac037fe700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7fac04060160 tx=0x7fabf400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:29:32.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.618+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fabec0552a0 con 0x7fac04060390 2022-02-02T22:29:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:32 smithi159 ceph-mon[69013]: pgmap v7422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:32 smithi159 ceph-mon[69013]: from='client.41702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:32.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.819+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac040fefe0 con 0x7fac04060390 2022-02-02T22:29:32.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.819+0000 7fac00ff9700 1 -- 172.21.15.96:0/432728116 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fabec054e90 con 0x7fac04060390 2022-02-02T22:29:32.820 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:29:32.820 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:29:32.821 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:29:32.821 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:29:32.821 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:32.822 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:29:32.822 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:29:32.822 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:29:32.823 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:29:32.823 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:29:32.824 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:29:32.824 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:29:32.824 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:29:32.825 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:29:32.825 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:29:32.825 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:29:32.826 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:29:32.826 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:29:32.826 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:29:32.827 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:29:32.827 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:29:32.827 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:29:32.828 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:29:32.828 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:29:32.828 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:29:32.829 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:29:32.829 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:29:32.829 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:29:32.830 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:29:32.830 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:29:32.830 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:29:32.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:29:32.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:32.831 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:32.832 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:29:32.832 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:29:32.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:32.833 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:32.833 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:29:32.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 msgr2=0x7fabf0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7fac04060160 tx=0x7fabf400b040).stop 2022-02-02T22:29:32.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 msgr2=0x7fac04106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:29:32.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 secure :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 rx=0x7fabec009990 tx=0x7fabec009b30).stop 2022-02-02T22:29:32.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 shutdown_connections 2022-02-02T22:29:32.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fabf0064dd0 0x7fabf0067290 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac04060390 0x7fac04106fa0 unknown :-1 s=CLOSED pgs=3797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 --2- 172.21.15.96:0/432728116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040f9850 0x7fac04107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:29:32.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 >> 172.21.15.96:0/432728116 conn(0x7fac040f0d40 msgr2=0x7fac040f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:29:32.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 shutdown_connections 2022-02-02T22:29:32.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:29:32.821+0000 7fac0a496700 1 -- 172.21.15.96:0/432728116 wait complete. 2022-02-02T22:29:32.838 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:29:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:33 smithi096 ceph-mon[101353]: from='client.41706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2799480211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:29:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/432728116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:29:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:33 smithi159 ceph-mon[69013]: from='client.41706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:29:33.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2799480211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:29:33.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/432728116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:29:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:34 smithi159 ceph-mon[69013]: pgmap v7423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:34 smithi096 ceph-mon[101353]: pgmap v7423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:36 smithi159 ceph-mon[69013]: pgmap v7424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:36 smithi096 ceph-mon[101353]: pgmap v7424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:38.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:38 smithi159 ceph-mon[69013]: pgmap v7425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:38 smithi096 ceph-mon[101353]: pgmap v7425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:40 smithi159 ceph-mon[69013]: pgmap v7426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:40 smithi096 ceph-mon[101353]: pgmap v7426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:42 smithi159 ceph-mon[69013]: pgmap v7427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:42 smithi096 ceph-mon[101353]: pgmap v7427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:44.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:44 smithi159 ceph-mon[69013]: pgmap v7428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:44.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:44 smithi096 ceph-mon[101353]: pgmap v7428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:46 smithi159 ceph-mon[69013]: pgmap v7429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:46 smithi096 ceph-mon[101353]: pgmap v7429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:48 smithi159 ceph-mon[69013]: pgmap v7430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:48 smithi096 ceph-mon[101353]: pgmap v7430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:50 smithi159 ceph-mon[69013]: pgmap v7431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:50 smithi096 ceph-mon[101353]: pgmap v7431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:52 smithi159 ceph-mon[69013]: pgmap v7432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:52 smithi096 ceph-mon[101353]: pgmap v7432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:54.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:54 smithi159 ceph-mon[69013]: pgmap v7433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:54 smithi096 ceph-mon[101353]: pgmap v7433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:56 smithi159 ceph-mon[69013]: pgmap v7434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:56.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:56 smithi096 ceph-mon[101353]: pgmap v7434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:29:58 smithi159 ceph-mon[69013]: pgmap v7435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:29:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:29:58 smithi096 ceph-mon[101353]: pgmap v7435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:00 smithi159 ceph-mon[69013]: pgmap v7436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:00.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:30:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:00 smithi096 ceph-mon[101353]: pgmap v7436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:00.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:30:02.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:02 smithi159 ceph-mon[69013]: pgmap v7437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:02.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:02 smithi096 ceph-mon[101353]: pgmap v7437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- 172.21.15.96:0/2691756232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f6860 msgr2=0x7f96400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 --2- 172.21.15.96:0/2691756232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f6860 0x7f96400f6cc0 secure :-1 s=READY pgs=3798 cs=0 l=1 rev1=1 rx=0x7f963c004660 tx=0x7f963c009b30).stop 2022-02-02T22:30:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- 172.21.15.96:0/2691756232 shutdown_connections 2022-02-02T22:30:02.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 --2- 172.21.15.96:0/2691756232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f6860 0x7f96400f6cc0 unknown :-1 s=CLOSED pgs=3798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:02.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 --2- 172.21.15.96:0/2691756232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f55c0 0x7f96400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:02.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- 172.21.15.96:0/2691756232 >> 172.21.15.96:0/2691756232 conn(0x7f96400f0d40 msgr2=0x7f96400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:02.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- 172.21.15.96:0/2691756232 shutdown_connections 2022-02-02T22:30:02.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- 172.21.15.96:0/2691756232 wait complete. 2022-02-02T22:30:02.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 Processor -- start 2022-02-02T22:30:02.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.932+0000 7f96486be700 1 -- start start 2022-02-02T22:30:02.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f96486be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:02.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f96486be700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f6860 0x7f964010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:02.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f96486be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400603e0 con 0x7f96400f55c0 2022-02-02T22:30:02.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f96486be700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640060520 con 0x7f96400f6860 2022-02-02T22:30:02.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:02.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48782/0 (socket says 172.21.15.96:48782) 2022-02-02T22:30:02.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 -- 172.21.15.96:0/3043449650 learned_addr learned my addr 172.21.15.96:0/3043449650 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f9645c59700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f6860 0x7f964010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 -- 172.21.15.96:0/3043449650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f6860 msgr2=0x7f964010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f6860 0x7f964010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:02.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 -- 172.21.15.96:0/3043449650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c005040 con 0x7f96400f55c0 2022-02-02T22:30:02.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f964645a700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 secure :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 rx=0x7f9630002700 tx=0x7f9630009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:02.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96300079c0 con 0x7f96400f55c0 2022-02-02T22:30:02.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.933+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f963000f040 con 0x7f96400f55c0 2022-02-02T22:30:02.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.934+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964010c700 con 0x7f96400f55c0 2022-02-02T22:30:02.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.934+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9630014860 con 0x7f96400f55c0 2022-02-02T22:30:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.934+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964010ccc0 con 0x7f96400f55c0 2022-02-02T22:30:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.935+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9640045ad0 con 0x7f96400f55c0 2022-02-02T22:30:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.935+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f963001b060 con 0x7f96400f55c0 2022-02-02T22:30:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.935+0000 7f9636ffd700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 0x7f962c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.935+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9630081810 con 0x7f96400f55c0 2022-02-02T22:30:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.936+0000 7f9645c59700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 0x7f962c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.936+0000 7f9645c59700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 0x7f962c067270 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7f963c004e30 tx=0x7f963c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:02.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:02.940+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f963004f910 con 0x7f96400f55c0 2022-02-02T22:30:03.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.117+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96400fdec0 con 0x7f962c064db0 2022-02-02T22:30:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.118+0000 7f9636ffd700 1 -- 172.21.15.96:0/3043449650 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f96400fdec0 con 0x7f962c064db0 2022-02-02T22:30:03.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 msgr2=0x7f962c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 0x7f962c067270 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7f963c004e30 tx=0x7f963c009b30).stop 2022-02-02T22:30:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 msgr2=0x7f9640109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 secure :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 rx=0x7f9630002700 tx=0x7f9630009d80).stop 2022-02-02T22:30:03.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 shutdown_connections 2022-02-02T22:30:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f962c064db0 0x7f962c067270 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96400f55c0 0x7f9640109c50 unknown :-1 s=CLOSED pgs=3799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 --2- 172.21.15.96:0/3043449650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400f6860 0x7f964010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 >> 172.21.15.96:0/3043449650 conn(0x7f96400f0d40 msgr2=0x7f96400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 shutdown_connections 2022-02-02T22:30:03.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.120+0000 7f96486be700 1 -- 172.21.15.96:0/3043449650 wait complete. 2022-02-02T22:30:03.130 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:30:03.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 -- 172.21.15.96:0/1984986644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f68e0 msgr2=0x7f3c640f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/1984986644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f68e0 0x7f3c640f6d00 secure :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 rx=0x7f3c54004660 tx=0x7f3c54009b30).stop 2022-02-02T22:30:03.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 -- 172.21.15.96:0/1984986644 shutdown_connections 2022-02-02T22:30:03.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/1984986644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f7b80 0x7f3c640f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/1984986644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f68e0 0x7f3c640f6d00 unknown :-1 s=CLOSED pgs=3800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 -- 172.21.15.96:0/1984986644 >> 172.21.15.96:0/1984986644 conn(0x7f3c640f2020 msgr2=0x7f3c640f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 -- 172.21.15.96:0/1984986644 shutdown_connections 2022-02-02T22:30:03.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.218+0000 7f3c6a45e700 1 -- 172.21.15.96:0/1984986644 wait complete. 2022-02-02T22:30:03.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 Processor -- start 2022-02-02T22:30:03.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 -- start start 2022-02-02T22:30:03.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f68e0 0x7f3c6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6406a380 con 0x7f3c640f7b80 2022-02-02T22:30:03.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c6a45e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6406a4c0 con 0x7f3c640f68e0 2022-02-02T22:30:03.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48794/0 (socket says 172.21.15.96:48794) 2022-02-02T22:30:03.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c637fe700 1 -- 172.21.15.96:0/389225135 learned_addr learned my addr 172.21.15.96:0/389225135 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:03.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.219+0000 7f3c63fff700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f68e0 0x7f3c6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c637fe700 1 -- 172.21.15.96:0/389225135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f68e0 msgr2=0x7f3c6406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c637fe700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f68e0 0x7f3c6406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c637fe700 1 -- 172.21.15.96:0/389225135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54005040 con 0x7f3c640f7b80 2022-02-02T22:30:03.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c637fe700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 secure :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 rx=0x7f3c5800c530 tx=0x7f3c58007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5800f650 con 0x7f3c640f7b80 2022-02-02T22:30:03.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c5800fc60 con 0x7f3c640f7b80 2022-02-02T22:30:03.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6406a7a0 con 0x7f3c640f7b80 2022-02-02T22:30:03.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c58012cd0 con 0x7f3c640f7b80 2022-02-02T22:30:03.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.220+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6410f210 con 0x7f3c640f7b80 2022-02-02T22:30:03.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.221+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c64045ad0 con 0x7f3c640f7b80 2022-02-02T22:30:03.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.221+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c58010070 con 0x7f3c640f7b80 2022-02-02T22:30:03.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.222+0000 7f3c60ff9700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 0x7f3c4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.222+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3c580817b0 con 0x7f3c640f7b80 2022-02-02T22:30:03.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.222+0000 7f3c63fff700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 0x7f3c4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.222+0000 7f3c63fff700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 0x7f3c4c067290 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7f3c54004e30 tx=0x7f3c54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.226+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c5804f8b0 con 0x7f3c640f7b80 2022-02-02T22:30:03.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.402+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c640ff0a0 con 0x7f3c4c064dd0 2022-02-02T22:30:03.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.411+0000 7f3c60ff9700 1 -- 172.21.15.96:0/389225135 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3c640ff0a0 con 0x7f3c4c064dd0 2022-02-02T22:30:03.412 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:30:03.413 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:30:03.413 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:30:03.414 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:30:03.414 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:30:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:30:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:30:03.416 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:30:03.416 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:30:03.417 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:30:03.417 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:30:03.417 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:30:03.418 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:30:03.418 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:30:03.419 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:30:03.419 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:30:03.420 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:30:03.420 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:30:03.421 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:30:03.422 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:30:03.423 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:30:03.423 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:30:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 msgr2=0x7f3c4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 0x7f3c4c067290 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7f3c54004e30 tx=0x7f3c54009b30).stop 2022-02-02T22:30:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 msgr2=0x7f3c64069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 secure :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 rx=0x7f3c5800c530 tx=0x7f3c58007e20).stop 2022-02-02T22:30:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 shutdown_connections 2022-02-02T22:30:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c4c064dd0 0x7f3c4c067290 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c640f68e0 0x7f3c6406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 --2- 172.21.15.96:0/389225135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c640f7b80 0x7f3c64069e20 unknown :-1 s=CLOSED pgs=3801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 >> 172.21.15.96:0/389225135 conn(0x7f3c640f2020 msgr2=0x7f3c640fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 shutdown_connections 2022-02-02T22:30:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.413+0000 7f3c6a45e700 1 -- 172.21.15.96:0/389225135 wait complete. 2022-02-02T22:30:03.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 -- 172.21.15.96:0/963368301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 msgr2=0x7f38880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 --2- 172.21.15.96:0/963368301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f38880f6b00 secure :-1 s=READY pgs=3802 cs=0 l=1 rev1=1 rx=0x7f3878004660 tx=0x7f3878009b30).stop 2022-02-02T22:30:03.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 -- 172.21.15.96:0/963368301 shutdown_connections 2022-02-02T22:30:03.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 --2- 172.21.15.96:0/963368301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 0x7f38880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 --2- 172.21.15.96:0/963368301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f38880f6b00 unknown :-1 s=CLOSED pgs=3802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 -- 172.21.15.96:0/963368301 >> 172.21.15.96:0/963368301 conn(0x7f38880f1e40 msgr2=0x7f38880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 -- 172.21.15.96:0/963368301 shutdown_connections 2022-02-02T22:30:03.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.511+0000 7f38901e9700 1 -- 172.21.15.96:0/963368301 wait complete. 2022-02-02T22:30:03.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 Processor -- start 2022-02-02T22:30:03.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 -- start start 2022-02-02T22:30:03.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 0x7f3888069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388806a380 con 0x7f38880f66e0 2022-02-02T22:30:03.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.512+0000 7f38901e9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388806a4c0 con 0x7f38880f7980 2022-02-02T22:30:03.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48802/0 (socket says 172.21.15.96:48802) 2022-02-02T22:30:03.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 -- 172.21.15.96:0/1388815395 learned_addr learned my addr 172.21.15.96:0/1388815395 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:03.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388d784700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 0x7f3888069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 -- 172.21.15.96:0/1388815395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 msgr2=0x7f3888069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 0x7f3888069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 -- 172.21.15.96:0/1388815395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878005040 con 0x7f38880f66e0 2022-02-02T22:30:03.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f388df85700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 secure :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 rx=0x7f3878013a70 tx=0x7f3878009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3878018070 con 0x7f38880f66e0 2022-02-02T22:30:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388806a740 con 0x7f38880f66e0 2022-02-02T22:30:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38780097d0 con 0x7f38880f66e0 2022-02-02T22:30:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387801de80 con 0x7f38880f66e0 2022-02-02T22:30:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.513+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388806aca0 con 0x7f38880f66e0 2022-02-02T22:30:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.515+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3870004fa0 con 0x7f38880f66e0 2022-02-02T22:30:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.515+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3878007ba0 con 0x7f38880f66e0 2022-02-02T22:30:03.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.515+0000 7f387e7fc700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 0x7f3874067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.515+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f38780835a0 con 0x7f38880f66e0 2022-02-02T22:30:03.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.515+0000 7f388d784700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 0x7f3874067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.516+0000 7f388d784700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 0x7f3874067290 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 rx=0x7f3884004e20 tx=0x7f388400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.520+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f38780516a0 con 0x7f38880f66e0 2022-02-02T22:30:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.751+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3870005e80 con 0x7f38880f66e0 2022-02-02T22:30:03.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.752+0000 7f387e7fc700 1 -- 172.21.15.96:0/1388815395 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3878054cc0 con 0x7f38880f66e0 2022-02-02T22:30:03.753 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:30:03.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:30:03.755 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:30:03.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:03.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:30:03.757 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:30:03.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:03.758 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:30:03.759 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:30:03.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:03.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:30:03.761 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:30:03.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:03.762 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:30:03.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:30:03.763 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:30:03.763 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:30:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 msgr2=0x7f3874067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 0x7f3874067290 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 rx=0x7f3884004e20 tx=0x7f388400b040).stop 2022-02-02T22:30:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 msgr2=0x7f388806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 secure :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 rx=0x7f3878013a70 tx=0x7f3878009b30).stop 2022-02-02T22:30:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 shutdown_connections 2022-02-02T22:30:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3874064dd0 0x7f3874067290 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38880f66e0 0x7f388806b9a0 unknown :-1 s=CLOSED pgs=3803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 --2- 172.21.15.96:0/1388815395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38880f7980 0x7f3888069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 >> 172.21.15.96:0/1388815395 conn(0x7f38880f1e40 msgr2=0x7f38880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 shutdown_connections 2022-02-02T22:30:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.754+0000 7f38901e9700 1 -- 172.21.15.96:0/1388815395 wait complete. 2022-02-02T22:30:03.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 -- 172.21.15.96:0/370241579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 msgr2=0x7fe65c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 --2- 172.21.15.96:0/370241579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c0f5850 secure :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 rx=0x7fe644004660 tx=0x7fe644009b30).stop 2022-02-02T22:30:03.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 -- 172.21.15.96:0/370241579 shutdown_connections 2022-02-02T22:30:03.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 --2- 172.21.15.96:0/370241579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 0x7fe65c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 --2- 172.21.15.96:0/370241579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c0f5850 unknown :-1 s=CLOSED pgs=3804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 -- 172.21.15.96:0/370241579 >> 172.21.15.96:0/370241579 conn(0x7fe65c0f0b90 msgr2=0x7fe65c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:03.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 -- 172.21.15.96:0/370241579 shutdown_connections 2022-02-02T22:30:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.851+0000 7fe65b59e700 1 -- 172.21.15.96:0/370241579 wait complete. 2022-02-02T22:30:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 Processor -- start 2022-02-02T22:30:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 -- start start 2022-02-02T22:30:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 0x7fe65c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0603c0 con 0x7fe65c0f5430 2022-02-02T22:30:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c060500 con 0x7fe65c0f66d0 2022-02-02T22:30:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48812/0 (socket says 172.21.15.96:48812) 2022-02-02T22:30:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 -- 172.21.15.96:0/1648029770 learned_addr learned my addr 172.21.15.96:0/1648029770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe659d9b700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 0x7fe65c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 -- 172.21.15.96:0/1648029770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 msgr2=0x7fe65c10bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 0x7fe65c10bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.852+0000 7fe65a59c700 1 -- 172.21.15.96:0/1648029770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644005040 con 0x7fe65c0f5430 2022-02-02T22:30:03.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe65a59c700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 secure :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 rx=0x7fe644013a70 tx=0x7fe644009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe644018070 con 0x7fe65c0f5430 2022-02-02T22:30:03.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c10c490 con 0x7fe65c0f5430 2022-02-02T22:30:03.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe6440097d0 con 0x7fe65c0f5430 2022-02-02T22:30:03.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe64401c3c0 con 0x7fe65c0f5430 2022-02-02T22:30:03.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.853+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c10c9c0 con 0x7fe65c0f5430 2022-02-02T22:30:03.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.854+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c045ad0 con 0x7fe65c0f5430 2022-02-02T22:30:03.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.855+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe644007ba0 con 0x7fe65c0f5430 2022-02-02T22:30:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.855+0000 7fe652ffd700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 0x7fe6480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.855+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe644083ae0 con 0x7fe65c0f5430 2022-02-02T22:30:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.856+0000 7fe659d9b700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 0x7fe6480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.856+0000 7fe659d9b700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 0x7fe6480672e0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7fe64c009740 tx=0x7fe64c009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:03.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:03.859+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe644051be0 con 0x7fe65c0f5430 2022-02-02T22:30:04.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.061+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe65c0fdd70 con 0x7fe65c0f5430 2022-02-02T22:30:04.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.061+0000 7fe652ffd700 1 -- 172.21.15.96:0/1648029770 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe644055200 con 0x7fe65c0f5430 2022-02-02T22:30:04.062 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:30:04.063 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:30:04.063 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:30:04.063 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:30:04.064 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:04.064 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:30:04.064 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:30:04.065 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:30:04.065 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:30:04.065 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:30:04.066 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:30:04.066 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:30:04.066 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:30:04.067 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:30:04.067 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:30:04.067 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:30:04.068 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:30:04.068 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:30:04.069 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:30:04.069 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:30:04.069 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:30:04.070 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:30:04.070 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:30:04.070 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:30:04.071 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:30:04.071 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:30:04.071 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:30:04.072 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:30:04.072 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:30:04.072 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:30:04.073 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:30:04.073 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:30:04.073 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:04.074 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:04.074 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:30:04.074 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:04.075 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:04.075 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:04.075 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:04.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 msgr2=0x7fe6480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:04.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 0x7fe6480672e0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7fe64c009740 tx=0x7fe64c009c60).stop 2022-02-02T22:30:04.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 msgr2=0x7fe65c109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:04.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 secure :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 rx=0x7fe644013a70 tx=0x7fe644009b30).stop 2022-02-02T22:30:04.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 shutdown_connections 2022-02-02T22:30:04.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe648064e20 0x7fe6480672e0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:04.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0f5430 0x7fe65c109a40 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:04.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 --2- 172.21.15.96:0/1648029770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0f66d0 0x7fe65c10bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:04.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 >> 172.21.15.96:0/1648029770 conn(0x7fe65c0f0b90 msgr2=0x7fe65c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:04.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 shutdown_connections 2022-02-02T22:30:04.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:04.063+0000 7fe65b59e700 1 -- 172.21.15.96:0/1648029770 wait complete. 2022-02-02T22:30:04.081 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:30:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:04 smithi159 ceph-mon[69013]: from='client.41718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:04 smithi159 ceph-mon[69013]: pgmap v7438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:04 smithi159 ceph-mon[69013]: from='client.41722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1388815395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:30:04.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1648029770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:30:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:04 smithi096 ceph-mon[101353]: from='client.41718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:04 smithi096 ceph-mon[101353]: pgmap v7438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:04.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:04 smithi096 ceph-mon[101353]: from='client.41722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1388815395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:30:04.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1648029770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:30:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:06 smithi159 ceph-mon[69013]: pgmap v7439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:06 smithi096 ceph-mon[101353]: pgmap v7439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:08 smithi159 ceph-mon[69013]: pgmap v7440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:08 smithi096 ceph-mon[101353]: pgmap v7440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:10 smithi159 ceph-mon[69013]: pgmap v7441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:10 smithi096 ceph-mon[101353]: pgmap v7441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:12.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:12 smithi159 ceph-mon[69013]: pgmap v7442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:12 smithi096 ceph-mon[101353]: pgmap v7442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:14 smithi159 ceph-mon[69013]: pgmap v7443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:14 smithi096 ceph-mon[101353]: pgmap v7443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:16 smithi159 ceph-mon[69013]: pgmap v7444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:16 smithi096 ceph-mon[101353]: pgmap v7444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:18 smithi159 ceph-mon[69013]: pgmap v7445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:18 smithi096 ceph-mon[101353]: pgmap v7445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:20 smithi159 ceph-mon[69013]: pgmap v7446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:20 smithi096 ceph-mon[101353]: pgmap v7446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:22.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:22 smithi159 ceph-mon[69013]: pgmap v7447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:22 smithi096 ceph-mon[101353]: pgmap v7447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:24.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:24 smithi159 ceph-mon[69013]: pgmap v7448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:24 smithi096 ceph-mon[101353]: pgmap v7448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:26.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:26 smithi096 ceph-mon[101353]: pgmap v7449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:26 smithi159 ceph-mon[69013]: pgmap v7449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:28 smithi096 ceph-mon[101353]: pgmap v7450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:30:28.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:30:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:28 smithi159 ceph-mon[69013]: pgmap v7450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:30:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:30:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:30 smithi096 ceph-mon[101353]: pgmap v7451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:30 smithi159 ceph-mon[69013]: pgmap v7451: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:32 smithi096 ceph-mon[101353]: pgmap v7452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:33.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:32 smithi159 ceph-mon[69013]: pgmap v7452: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:34.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 -- 172.21.15.96:0/2443523240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f7980 msgr2=0x7f2d400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/2443523240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f7980 0x7f2d400f7de0 secure :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 rx=0x7f2d3c004660 tx=0x7f2d3c009b30).stop 2022-02-02T22:30:34.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 -- 172.21.15.96:0/2443523240 shutdown_connections 2022-02-02T22:30:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/2443523240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f7980 0x7f2d400f7de0 unknown :-1 s=CLOSED pgs=3806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/2443523240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f66e0 0x7f2d400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:30:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 -- 172.21.15.96:0/2443523240 >> 172.21.15.96:0/2443523240 conn(0x7f2d400f1e40 msgr2=0x7f2d400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 -- 172.21.15.96:0/2443523240 shutdown_connections 2022-02-02T22:30:34.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.173+0000 7f2d47eeb700 1 -- 172.21.15.96:0/2443523240 wait complete. 2022-02-02T22:30:34.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 Processor -- start 2022-02-02T22:30:34.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 -- start start 2022-02-02T22:30:34.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f7980 0x7f2d401074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40107ae0 con 0x7f2d400f66e0 2022-02-02T22:30:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d47eeb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40108390 con 0x7f2d400f7980 2022-02-02T22:30:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48830/0 (socket says 172.21.15.96:48830) 2022-02-02T22:30:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 -- 172.21.15.96:0/1015280865 learned_addr learned my addr 172.21.15.96:0/1015280865 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45486700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f7980 0x7f2d401074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 -- 172.21.15.96:0/1015280865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f7980 msgr2=0x7f2d401074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f7980 0x7f2d401074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.174+0000 7f2d45c87700 1 -- 172.21.15.96:0/1015280865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c005040 con 0x7f2d400f66e0 2022-02-02T22:30:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d45c87700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 secure :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 rx=0x7f2d340093f0 tx=0x7f2d34006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d34013640 con 0x7f2d400f66e0 2022-02-02T22:30:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d40108670 con 0x7f2d400f66e0 2022-02-02T22:30:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d34013c50 con 0x7f2d400f66e0 2022-02-02T22:30:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d34012c70 con 0x7f2d400f66e0 2022-02-02T22:30:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.175+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d40108c30 con 0x7f2d400f66e0 2022-02-02T22:30:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.176+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d400f5ad0 con 0x7f2d400f66e0 2022-02-02T22:30:34.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.176+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d3401a060 con 0x7f2d400f66e0 2022-02-02T22:30:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.177+0000 7f2d327fc700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 0x7f2d2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.177+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2d34081a50 con 0x7f2d400f66e0 2022-02-02T22:30:34.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.177+0000 7f2d45486700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 0x7f2d2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.177+0000 7f2d45486700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 0x7f2d2c067290 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 rx=0x7f2d3c004630 tx=0x7f2d3c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.181+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d34053520 con 0x7f2d400f66e0 2022-02-02T22:30:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.359+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d400fefb0 con 0x7f2d2c064dd0 2022-02-02T22:30:34.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.360+0000 7f2d327fc700 1 -- 172.21.15.96:0/1015280865 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2d400fefb0 con 0x7f2d2c064dd0 2022-02-02T22:30:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 msgr2=0x7f2d2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 0x7f2d2c067290 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 rx=0x7f2d3c004630 tx=0x7f2d3c009b30).stop 2022-02-02T22:30:34.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 msgr2=0x7f2d40106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 secure :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 rx=0x7f2d340093f0 tx=0x7f2d34006ec0).stop 2022-02-02T22:30:34.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 shutdown_connections 2022-02-02T22:30:34.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d2c064dd0 0x7f2d2c067290 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d400f66e0 0x7f2d40106fb0 unknown :-1 s=CLOSED pgs=3807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 --2- 172.21.15.96:0/1015280865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d400f7980 0x7f2d401074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 >> 172.21.15.96:0/1015280865 conn(0x7f2d400f1e40 msgr2=0x7f2d400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:34.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 shutdown_connections 2022-02-02T22:30:34.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.362+0000 7f2d47eeb700 1 -- 172.21.15.96:0/1015280865 wait complete. 2022-02-02T22:30:34.372 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:30:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 -- 172.21.15.96:0/3001189208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f77d0 msgr2=0x7fe0f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3001189208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f77d0 0x7fe0f40f7c30 secure :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 rx=0x7fe0e4004660 tx=0x7fe0e4009b30).stop 2022-02-02T22:30:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 -- 172.21.15.96:0/3001189208 shutdown_connections 2022-02-02T22:30:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3001189208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f77d0 0x7fe0f40f7c30 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3001189208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f6530 0x7fe0f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 -- 172.21.15.96:0/3001189208 >> 172.21.15.96:0/3001189208 conn(0x7fe0f40f1c90 msgr2=0x7fe0f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:34.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 -- 172.21.15.96:0/3001189208 shutdown_connections 2022-02-02T22:30:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.458+0000 7fe0faf84700 1 -- 172.21.15.96:0/3001189208 wait complete. 2022-02-02T22:30:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 Processor -- start 2022-02-02T22:30:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 -- start start 2022-02-02T22:30:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f77d0 0x7fe0f4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4107880 con 0x7fe0f40f6530 2022-02-02T22:30:34.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0faf84700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4108090 con 0x7fe0f40f77d0 2022-02-02T22:30:34.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0f9f82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0f9f82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48838/0 (socket says 172.21.15.96:48838) 2022-02-02T22:30:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0f9f82700 1 -- 172.21.15.96:0/3080037053 learned_addr learned my addr 172.21.15.96:0/3080037053 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.459+0000 7fe0f9781700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f77d0 0x7fe0f4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0f9f82700 1 -- 172.21.15.96:0/3080037053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f77d0 msgr2=0x7fe0f4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0f9f82700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f77d0 0x7fe0f4107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0f9f82700 1 -- 172.21.15.96:0/3080037053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4005040 con 0x7fe0f40f6530 2022-02-02T22:30:34.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0f9f82700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 secure :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 rx=0x7fe0f0002700 tx=0x7fe0f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0f00079c0 con 0x7fe0f40f6530 2022-02-02T22:30:34.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4108310 con 0x7fe0f40f6530 2022-02-02T22:30:34.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0f000f040 con 0x7fe0f40f6530 2022-02-02T22:30:34.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f41088d0 con 0x7fe0f40f6530 2022-02-02T22:30:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.460+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0f0014860 con 0x7fe0f40f6530 2022-02-02T22:30:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.461+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4059100 con 0x7fe0f40f6530 2022-02-02T22:30:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.461+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0f001b060 con 0x7fe0f40f6530 2022-02-02T22:30:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.462+0000 7fe0ea7fc700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 0x7fe0e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.462+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0f00817f0 con 0x7fe0f40f6530 2022-02-02T22:30:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.462+0000 7fe0f9781700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 0x7fe0e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.462+0000 7fe0f9781700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 0x7fe0e00672e0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7fe0e4004630 tx=0x7fe0e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.466+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0f004f8f0 con 0x7fe0f40f6530 2022-02-02T22:30:34.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.642+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f40fee00 con 0x7fe0e0064e20 2022-02-02T22:30:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.651+0000 7fe0ea7fc700 1 -- 172.21.15.96:0/3080037053 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe0f40fee00 con 0x7fe0e0064e20 2022-02-02T22:30:34.653 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:30:34.653 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:30:34.654 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:30:34.654 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:30:34.654 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:30:34.655 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:30:34.655 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:30:34.656 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:30:34.657 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:30:34.657 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:30:34.657 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:30:34.658 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:30:34.658 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:30:34.658 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:30:34.659 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:30:34.659 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:30:34.659 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:30:34.660 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:30:34.660 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:30:34.660 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:30:34.661 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:30:34.661 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:30:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 msgr2=0x7fe0e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 0x7fe0e00672e0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7fe0e4004630 tx=0x7fe0e4009b30).stop 2022-02-02T22:30:34.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 msgr2=0x7fe0f4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 secure :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 rx=0x7fe0f0002700 tx=0x7fe0f0009d80).stop 2022-02-02T22:30:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 shutdown_connections 2022-02-02T22:30:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e0064e20 0x7fe0e00672e0 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0f40f6530 0x7fe0f4106d90 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 --2- 172.21.15.96:0/3080037053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40f77d0 0x7fe0f4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.653+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 >> 172.21.15.96:0/3080037053 conn(0x7fe0f40f1c90 msgr2=0x7fe0f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:34.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.654+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 shutdown_connections 2022-02-02T22:30:34.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.654+0000 7fe0faf84700 1 -- 172.21.15.96:0/3080037053 wait complete. 2022-02-02T22:30:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 -- 172.21.15.96:0/1824524173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 msgr2=0x7f4ee40f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 --2- 172.21.15.96:0/1824524173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee40f7080 secure :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 rx=0x7f4ed4004660 tx=0x7f4ed4009b30).stop 2022-02-02T22:30:34.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 -- 172.21.15.96:0/1824524173 shutdown_connections 2022-02-02T22:30:34.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 --2- 172.21.15.96:0/1824524173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 0x7f4ee40f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 --2- 172.21.15.96:0/1824524173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee40f7080 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 -- 172.21.15.96:0/1824524173 >> 172.21.15.96:0/1824524173 conn(0x7f4ee40f04c0 msgr2=0x7f4ee40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:34.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.750+0000 7f4ee9468700 1 -- 172.21.15.96:0/1824524173 shutdown_connections 2022-02-02T22:30:34.755 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:34 smithi096 ceph-mon[101353]: pgmap v7453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:34.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.751+0000 7f4ee9468700 1 -- 172.21.15.96:0/1824524173 wait complete. 2022-02-02T22:30:34.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.751+0000 7f4ee9468700 1 Processor -- start 2022-02-02T22:30:34.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.751+0000 7f4ee9468700 1 -- start start 2022-02-02T22:30:34.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 0x7f4ee4109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4109bb0 con 0x7f4ee40f6c60 2022-02-02T22:30:34.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4109cf0 con 0x7f4ee40f5970 2022-02-02T22:30:34.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48850/0 (socket says 172.21.15.96:48850) 2022-02-02T22:30:34.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 -- 172.21.15.96:0/77821216 learned_addr learned my addr 172.21.15.96:0/77821216 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:34.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee2ffd700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 0x7f4ee4109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 -- 172.21.15.96:0/77821216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 msgr2=0x7f4ee4109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 0x7f4ee4109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:34.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 -- 172.21.15.96:0/77821216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4005040 con 0x7f4ee40f6c60 2022-02-02T22:30:34.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee27fc700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 secure :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 rx=0x7f4ed800c530 tx=0x7f4ed8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed800f650 con 0x7f4ee40f6c60 2022-02-02T22:30:34.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee410a690 con 0x7f4ee40f6c60 2022-02-02T22:30:34.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee410ac50 con 0x7f4ee40f6c60 2022-02-02T22:30:34.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ed800fc60 con 0x7f4ee40f6c60 2022-02-02T22:30:34.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.752+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed8012c20 con 0x7f4ee40f6c60 2022-02-02T22:30:34.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.753+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec4004fa0 con 0x7f4ee40f6c60 2022-02-02T22:30:34.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.754+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ed8010070 con 0x7f4ee40f6c60 2022-02-02T22:30:34.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.755+0000 7f4ecb7fe700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 0x7f4ecc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:34.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.755+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4ed80815a0 con 0x7f4ee40f6c60 2022-02-02T22:30:34.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.755+0000 7f4ee2ffd700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 0x7f4ecc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:34.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.755+0000 7f4ee2ffd700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 0x7f4ecc067290 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 rx=0x7f4ed4004630 tx=0x7f4ed4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.759+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ed80477d0 con 0x7f4ee40f6c60 2022-02-02T22:30:34.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.988+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ec4005e80 con 0x7f4ee40f6c60 2022-02-02T22:30:34.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.988+0000 7f4ecb7fe700 1 -- 172.21.15.96:0/77821216 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4ed80530d0 con 0x7f4ee40f6c60 2022-02-02T22:30:34.991 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:30:34.991 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:30:34.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:30:34.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:34.992 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:30:34.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:30:34.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:34.993 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:30:34.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:30:34.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:34.995 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:30:34.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:30:34.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:30:34.996 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:30:34.997 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:30:34.997 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:30:34.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:30:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:30:34.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 msgr2=0x7f4ecc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:34.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 0x7f4ecc067290 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 rx=0x7f4ed4004630 tx=0x7f4ed4009b30).stop 2022-02-02T22:30:34.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 msgr2=0x7f4ee4109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:35.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 secure :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 rx=0x7f4ed800c530 tx=0x7f4ed8007e20).stop 2022-02-02T22:30:35.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 shutdown_connections 2022-02-02T22:30:35.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ecc064dd0 0x7f4ecc067290 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee40f5970 0x7f4ee4109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 --2- 172.21.15.96:0/77821216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ee40f6c60 0x7f4ee4109600 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 >> 172.21.15.96:0/77821216 conn(0x7f4ee40f04c0 msgr2=0x7f4ee40f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:35.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 shutdown_connections 2022-02-02T22:30:35.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:34.990+0000 7f4ee9468700 1 -- 172.21.15.96:0/77821216 wait complete. 2022-02-02T22:30:35.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:34 smithi159 ceph-mon[69013]: pgmap v7453: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:35.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 -- 172.21.15.96:0/2663066965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 msgr2=0x7f08e80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:35.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 --2- 172.21.15.96:0/2663066965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80fbae0 secure :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 rx=0x7f08dc004660 tx=0x7f08dc009b30).stop 2022-02-02T22:30:35.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 -- 172.21.15.96:0/2663066965 shutdown_connections 2022-02-02T22:30:35.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 --2- 172.21.15.96:0/2663066965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80fbae0 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 --2- 172.21.15.96:0/2663066965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 0x7f08e80f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 -- 172.21.15.96:0/2663066965 >> 172.21.15.96:0/2663066965 conn(0x7f08e80f0b90 msgr2=0x7f08e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:35.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 -- 172.21.15.96:0/2663066965 shutdown_connections 2022-02-02T22:30:35.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.089+0000 7f08ed324700 1 -- 172.21.15.96:0/2663066965 wait complete. 2022-02-02T22:30:35.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 Processor -- start 2022-02-02T22:30:35.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 -- start start 2022-02-02T22:30:35.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 0x7f08e80f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:35.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:35.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80f55d0 con 0x7f08e80f96f0 2022-02-02T22:30:35.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08ed324700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80f5710 con 0x7f08e80602b0 2022-02-02T22:30:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08e77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08e77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48860/0 (socket says 172.21.15.96:48860) 2022-02-02T22:30:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.090+0000 7f08e77fe700 1 -- 172.21.15.96:0/3922458382 learned_addr learned my addr 172.21.15.96:0/3922458382 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:30:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e7fff700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 0x7f08e80f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e77fe700 1 -- 172.21.15.96:0/3922458382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 msgr2=0x7f08e80f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e77fe700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 0x7f08e80f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e77fe700 1 -- 172.21.15.96:0/3922458382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc005040 con 0x7f08e80f96f0 2022-02-02T22:30:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e77fe700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 secure :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 rx=0x7f08dc004f60 tx=0x7f08dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08dc018070 con 0x7f08e80f96f0 2022-02-02T22:30:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e80f5990 con 0x7f08e80f96f0 2022-02-02T22:30:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08dc007ba0 con 0x7f08e80f96f0 2022-02-02T22:30:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08dc01c620 con 0x7f08e80f96f0 2022-02-02T22:30:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.091+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80f5ef0 con 0x7f08e80f96f0 2022-02-02T22:30:35.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.092+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8045ad0 con 0x7f08e80f96f0 2022-02-02T22:30:35.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.092+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f08dc01d420 con 0x7f08e80f96f0 2022-02-02T22:30:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.093+0000 7f08e4ff9700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 0x7f08d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:30:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.093+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f08dc083970 con 0x7f08e80f96f0 2022-02-02T22:30:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.093+0000 7f08e7fff700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 0x7f08d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:30:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.093+0000 7f08e7fff700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 0x7f08d00672e0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 rx=0x7f08e80f6980 tx=0x7f08d8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:30:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.097+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08dc051b30 con 0x7f08e80f96f0 2022-02-02T22:30:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.297+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f08e8027a00 con 0x7f08e80f96f0 2022-02-02T22:30:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.298+0000 7f08e4ff9700 1 -- 172.21.15.96:0/3922458382 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f08dc055150 con 0x7f08e80f96f0 2022-02-02T22:30:35.300 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:30:35.301 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:30:35.301 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:30:35.302 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:30:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:35.302 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:30:35.303 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:30:35.303 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:30:35.303 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:30:35.304 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:30:35.304 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:30:35.305 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:30:35.305 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:30:35.305 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:30:35.306 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:30:35.306 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:30:35.306 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:30:35.307 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:30:35.307 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:30:35.307 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:30:35.308 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:30:35.308 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:30:35.308 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:30:35.309 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:30:35.309 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:30:35.309 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:30:35.310 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:30:35.310 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:30:35.311 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:30:35.311 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:30:35.311 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:30:35.312 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:30:35.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:35.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:35.313 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:30:35.313 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:30:35.314 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:35.314 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:35.314 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:30:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.299+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 msgr2=0x7f08d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.299+0000 7f08ed324700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 0x7f08d00672e0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 rx=0x7f08e80f6980 tx=0x7f08d8009040).stop 2022-02-02T22:30:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.299+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 msgr2=0x7f08e80f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:30:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.299+0000 7f08ed324700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 secure :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 rx=0x7f08dc004f60 tx=0x7f08dc009b30).stop 2022-02-02T22:30:35.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 shutdown_connections 2022-02-02T22:30:35.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08d0064e20 0x7f08d00672e0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e80602b0 0x7f08e80f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 --2- 172.21.15.96:0/3922458382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08e80f96f0 0x7f08e80f5070 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:30:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 >> 172.21.15.96:0/3922458382 conn(0x7f08e80f0b90 msgr2=0x7f08e80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:30:35.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 shutdown_connections 2022-02-02T22:30:35.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:30:35.300+0000 7f08ed324700 1 -- 172.21.15.96:0/3922458382 wait complete. 2022-02-02T22:30:35.320 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:30:35.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:35 smithi096 ceph-mon[101353]: from='client.41734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:35.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:35 smithi096 ceph-mon[101353]: from='client.41738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:35.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/77821216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:30:35.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3922458382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:30:36.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:35 smithi159 ceph-mon[69013]: from='client.41734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:36.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:35 smithi159 ceph-mon[69013]: from='client.41738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:30:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/77821216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:30:36.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3922458382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:30:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:36 smithi096 ceph-mon[101353]: pgmap v7454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:36 smithi159 ceph-mon[69013]: pgmap v7454: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:38 smithi096 ceph-mon[101353]: pgmap v7455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:38 smithi159 ceph-mon[69013]: pgmap v7455: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:40 smithi096 ceph-mon[101353]: pgmap v7456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:40 smithi159 ceph-mon[69013]: pgmap v7456: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:42 smithi096 ceph-mon[101353]: pgmap v7457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:42 smithi159 ceph-mon[69013]: pgmap v7457: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:44 smithi159 ceph-mon[69013]: pgmap v7458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:44 smithi096 ceph-mon[101353]: pgmap v7458: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:46 smithi159 ceph-mon[69013]: pgmap v7459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:46 smithi096 ceph-mon[101353]: pgmap v7459: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:48 smithi159 ceph-mon[69013]: pgmap v7460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:48 smithi096 ceph-mon[101353]: pgmap v7460: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:50 smithi159 ceph-mon[69013]: pgmap v7461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:50 smithi096 ceph-mon[101353]: pgmap v7461: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:52 smithi159 ceph-mon[69013]: pgmap v7462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:52 smithi096 ceph-mon[101353]: pgmap v7462: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:54 smithi159 ceph-mon[69013]: pgmap v7463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:54 smithi096 ceph-mon[101353]: pgmap v7463: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:56 smithi159 ceph-mon[69013]: pgmap v7464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:56 smithi096 ceph-mon[101353]: pgmap v7464: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:30:58 smithi159 ceph-mon[69013]: pgmap v7465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:30:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:30:58 smithi096 ceph-mon[101353]: pgmap v7465: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:00 smithi159 ceph-mon[69013]: pgmap v7466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:00 smithi096 ceph-mon[101353]: pgmap v7466: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:03.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:02 smithi159 ceph-mon[69013]: pgmap v7467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:02 smithi096 ceph-mon[101353]: pgmap v7467: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:04 smithi159 ceph-mon[69013]: pgmap v7468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:04 smithi096 ceph-mon[101353]: pgmap v7468: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:05.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 -- 172.21.15.96:0/280817568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 msgr2=0x7f2c940f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 --2- 172.21.15.96:0/280817568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c940f6ae0 secure :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 rx=0x7f2c84004660 tx=0x7f2c84009b30).stop 2022-02-02T22:31:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 -- 172.21.15.96:0/280817568 shutdown_connections 2022-02-02T22:31:05.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 --2- 172.21.15.96:0/280817568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c940f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 --2- 172.21.15.96:0/280817568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c940f6ae0 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 -- 172.21.15.96:0/280817568 >> 172.21.15.96:0/280817568 conn(0x7f2c940f1e20 msgr2=0x7f2c940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:05.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 -- 172.21.15.96:0/280817568 shutdown_connections 2022-02-02T22:31:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.415+0000 7f2c99860700 1 -- 172.21.15.96:0/280817568 wait complete. 2022-02-02T22:31:05.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 Processor -- start 2022-02-02T22:31:05.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 -- start start 2022-02-02T22:31:05.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c94107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.430 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94107a30 con 0x7f2c940f66c0 2022-02-02T22:31:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c99860700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94107b70 con 0x7f2c940f7960 2022-02-02T22:31:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48876/0 (socket says 172.21.15.96:48876) 2022-02-02T22:31:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.416+0000 7f2c92ffd700 1 -- 172.21.15.96:0/410298940 learned_addr learned my addr 172.21.15.96:0/410298940 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c927fc700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c94107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c92ffd700 1 -- 172.21.15.96:0/410298940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 msgr2=0x7f2c94107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c92ffd700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c94107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c92ffd700 1 -- 172.21.15.96:0/410298940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c84005040 con 0x7f2c940f66c0 2022-02-02T22:31:05.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c927fc700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c94107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:31:05.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c92ffd700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 secure :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 rx=0x7f2c84013a70 tx=0x7f2c84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:05.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c84018070 con 0x7f2c940f66c0 2022-02-02T22:31:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c840097d0 con 0x7f2c940f66c0 2022-02-02T22:31:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c941084b0 con 0x7f2c940f66c0 2022-02-02T22:31:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8401c3c0 con 0x7f2c940f66c0 2022-02-02T22:31:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.417+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94108a10 con 0x7f2c940f66c0 2022-02-02T22:31:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.418+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94045ad0 con 0x7f2c940f66c0 2022-02-02T22:31:05.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.419+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c84007ba0 con 0x7f2c940f66c0 2022-02-02T22:31:05.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.419+0000 7f2c7b7fe700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 0x7f2c7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.419+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c84083ad0 con 0x7f2c940f66c0 2022-02-02T22:31:05.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.419+0000 7f2c927fc700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 0x7f2c7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.420+0000 7f2c927fc700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 0x7f2c7c067290 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 rx=0x7f2c88009fd0 tx=0x7f2c8800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.423+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c84055600 con 0x7f2c940f66c0 2022-02-02T22:31:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.601+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c94108c30 con 0x7f2c7c064dd0 2022-02-02T22:31:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.603+0000 7f2c7b7fe700 1 -- 172.21.15.96:0/410298940 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2c94108c30 con 0x7f2c7c064dd0 2022-02-02T22:31:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.604+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 msgr2=0x7f2c7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.604+0000 7f2c99860700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 0x7f2c7c067290 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 rx=0x7f2c88009fd0 tx=0x7f2c8800b040).stop 2022-02-02T22:31:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.604+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 msgr2=0x7f2c94106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.604+0000 7f2c99860700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 secure :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 rx=0x7f2c84013a70 tx=0x7f2c84009b30).stop 2022-02-02T22:31:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 shutdown_connections 2022-02-02T22:31:05.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2c7c064dd0 0x7f2c7c067290 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c940f66c0 0x7f2c94106f90 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 --2- 172.21.15.96:0/410298940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c940f7960 0x7f2c94107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 >> 172.21.15.96:0/410298940 conn(0x7f2c940f1e20 msgr2=0x7f2c940fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:05.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 shutdown_connections 2022-02-02T22:31:05.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.605+0000 7f2c99860700 1 -- 172.21.15.96:0/410298940 wait complete. 2022-02-02T22:31:05.615 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:31:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 -- 172.21.15.96:0/2126390946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f6860 msgr2=0x7f3f200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/2126390946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f6860 0x7f3f200f6cc0 secure :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 rx=0x7f3f10004660 tx=0x7f3f10009b30).stop 2022-02-02T22:31:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 -- 172.21.15.96:0/2126390946 shutdown_connections 2022-02-02T22:31:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/2126390946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f6860 0x7f3f200f6cc0 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/2126390946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f55c0 0x7f3f200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 -- 172.21.15.96:0/2126390946 >> 172.21.15.96:0/2126390946 conn(0x7f3f200f0d40 msgr2=0x7f3f200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:05.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 -- 172.21.15.96:0/2126390946 shutdown_connections 2022-02-02T22:31:05.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.702+0000 7f3f25cc4700 1 -- 172.21.15.96:0/2126390946 wait complete. 2022-02-02T22:31:05.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 Processor -- start 2022-02-02T22:31:05.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 -- start start 2022-02-02T22:31:05.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 0x7f3f2010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200603c0 con 0x7f3f200f55c0 2022-02-02T22:31:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f25cc4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20060500 con 0x7f3f200f6860 2022-02-02T22:31:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48886/0 (socket says 172.21.15.96:48886) 2022-02-02T22:31:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 -- 172.21.15.96:0/1355055166 learned_addr learned my addr 172.21.15.96:0/1355055166 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1effd700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 0x7f3f2010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 -- 172.21.15.96:0/1355055166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 msgr2=0x7f3f2010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 0x7f3f2010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1f7fe700 1 -- 172.21.15.96:0/1355055166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10005040 con 0x7f3f200f55c0 2022-02-02T22:31:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.703+0000 7f3f1effd700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 0x7f3f2010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:31:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f1f7fe700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 secure :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 rx=0x7f3f1400c530 tx=0x7f3f14007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1400f650 con 0x7f3f200f55c0 2022-02-02T22:31:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2010c720 con 0x7f3f200f55c0 2022-02-02T22:31:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f1400fc60 con 0x7f3f200f55c0 2022-02-02T22:31:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f14012d20 con 0x7f3f200f55c0 2022-02-02T22:31:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.704+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2010ccb0 con 0x7f3f200f55c0 2022-02-02T22:31:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.705+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f14019030 con 0x7f3f200f55c0 2022-02-02T22:31:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.705+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f200f49b0 con 0x7f3f200f55c0 2022-02-02T22:31:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.706+0000 7f3f07fff700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 0x7f3f08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.706+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3f140816c0 con 0x7f3f200f55c0 2022-02-02T22:31:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.706+0000 7f3f1effd700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 0x7f3f08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.706+0000 7f3f1effd700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 0x7f3f08067290 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7f3f10004e30 tx=0x7f3f10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.710+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f1404f810 con 0x7f3f200f55c0 2022-02-02T22:31:05.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.882+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f20057f10 con 0x7f3f08064dd0 2022-02-02T22:31:05.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.892+0000 7f3f07fff700 1 -- 172.21.15.96:0/1355055166 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3f20057f10 con 0x7f3f08064dd0 2022-02-02T22:31:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:31:05.893 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:31:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:31:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:31:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:31:05.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:31:05.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:31:05.895 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:31:05.896 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:31:05.896 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:31:05.896 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:31:05.897 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:31:05.897 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:31:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:31:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:31:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:31:05.899 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:31:05.899 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:31:05.899 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:31:05.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:31:05.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:31:05.901 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:31:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 msgr2=0x7f3f08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 0x7f3f08067290 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7f3f10004e30 tx=0x7f3f10009b30).stop 2022-02-02T22:31:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 msgr2=0x7f3f20109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 secure :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 rx=0x7f3f1400c530 tx=0x7f3f14007e10).stop 2022-02-02T22:31:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 shutdown_connections 2022-02-02T22:31:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3f08064dd0 0x7f3f08067290 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f200f55c0 0x7f3f20109c70 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 --2- 172.21.15.96:0/1355055166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f200f6860 0x7f3f2010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 >> 172.21.15.96:0/1355055166 conn(0x7f3f200f0d40 msgr2=0x7f3f200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 shutdown_connections 2022-02-02T22:31:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.894+0000 7f3f25cc4700 1 -- 172.21.15.96:0/1355055166 wait complete. 2022-02-02T22:31:05.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 -- 172.21.15.96:0/2584980898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 msgr2=0x7fddbc0f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:05.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 --2- 172.21.15.96:0/2584980898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc0f8160 secure :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 rx=0x7fddac004660 tx=0x7fddac009b30).stop 2022-02-02T22:31:05.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 -- 172.21.15.96:0/2584980898 shutdown_connections 2022-02-02T22:31:05.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 --2- 172.21.15.96:0/2584980898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 0x7fddbc0f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 --2- 172.21.15.96:0/2584980898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc0f8160 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:05.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 -- 172.21.15.96:0/2584980898 >> 172.21.15.96:0/2584980898 conn(0x7fddbc0f04c0 msgr2=0x7fddbc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 -- 172.21.15.96:0/2584980898 shutdown_connections 2022-02-02T22:31:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.990+0000 7fddc159e700 1 -- 172.21.15.96:0/2584980898 wait complete. 2022-02-02T22:31:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 Processor -- start 2022-02-02T22:31:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 -- start start 2022-02-02T22:31:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 0x7fddbc1074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc107a80 con 0x7fddbc0f7d40 2022-02-02T22:31:05.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddc159e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc107bc0 con 0x7fddbc0f86e0 2022-02-02T22:31:05.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48894/0 (socket says 172.21.15.96:48894) 2022-02-02T22:31:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.991+0000 7fddbaffd700 1 -- 172.21.15.96:0/2173380303 learned_addr learned my addr 172.21.15.96:0/2173380303 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddba7fc700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 0x7fddbc1074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddbaffd700 1 -- 172.21.15.96:0/2173380303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 msgr2=0x7fddbc1074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddbaffd700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 0x7fddbc1074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddbaffd700 1 -- 172.21.15.96:0/2173380303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac005040 con 0x7fddbc0f7d40 2022-02-02T22:31:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddbaffd700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 secure :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 rx=0x7fddac004f60 tx=0x7fddac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac018070 con 0x7fddbc0f7d40 2022-02-02T22:31:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc108500 con 0x7fddbc0f7d40 2022-02-02T22:31:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fddac007ba0 con 0x7fddbc0f7d40 2022-02-02T22:31:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac01c620 con 0x7fddbc0f7d40 2022-02-02T22:31:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.992+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc108a60 con 0x7fddbc0f7d40 2022-02-02T22:31:06.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.993+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc045ad0 con 0x7fddbc0f7d40 2022-02-02T22:31:06.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.994+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fddac01c8e0 con 0x7fddbc0f7d40 2022-02-02T22:31:06.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.994+0000 7fdda37fe700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:06.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.994+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fddac083940 con 0x7fddbc0f7d40 2022-02-02T22:31:06.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.994+0000 7fddba7fc700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:06.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.995+0000 7fddba7fc700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 rx=0x7fddb00041d0 tx=0x7fddb0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:06.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:05.999+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fddac055470 con 0x7fddbc0f7d40 2022-02-02T22:31:06.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.228+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddbc027a00 con 0x7fddbc0f7d40 2022-02-02T22:31:06.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.228+0000 7fdda37fe700 1 -- 172.21.15.96:0/2173380303 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fddac055060 con 0x7fddbc0f7d40 2022-02-02T22:31:06.231 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:31:06.232 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:31:06.232 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:31:06.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:06.234 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:31:06.234 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:31:06.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:06.236 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:31:06.236 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:31:06.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:06.238 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:31:06.238 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:31:06.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:06.240 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:31:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:31:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:31:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:31:06.243 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:31:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 msgr2=0x7fdda4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 rx=0x7fddb00041d0 tx=0x7fddb0009040).stop 2022-02-02T22:31:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 msgr2=0x7fddbc106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 secure :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 rx=0x7fddac004f60 tx=0x7fddac009b30).stop 2022-02-02T22:31:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 shutdown_connections 2022-02-02T22:31:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdda4064dd0 0x7fdda4067290 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddbc0f7d40 0x7fddbc106fe0 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 --2- 172.21.15.96:0/2173380303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddbc0f86e0 0x7fddbc1074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 >> 172.21.15.96:0/2173380303 conn(0x7fddbc0f04c0 msgr2=0x7fddbc0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:06.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 shutdown_connections 2022-02-02T22:31:06.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.230+0000 7fddc159e700 1 -- 172.21.15.96:0/2173380303 wait complete. 2022-02-02T22:31:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 -- 172.21.15.96:0/3378657275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 msgr2=0x7f7e6c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3378657275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c0f6b00 secure :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 rx=0x7f7e5c004660 tx=0x7f7e5c009b30).stop 2022-02-02T22:31:06.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 -- 172.21.15.96:0/3378657275 shutdown_connections 2022-02-02T22:31:06.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3378657275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 0x7f7e6c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3378657275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c0f6b00 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 -- 172.21.15.96:0/3378657275 >> 172.21.15.96:0/3378657275 conn(0x7f7e6c0f1e40 msgr2=0x7f7e6c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 -- 172.21.15.96:0/3378657275 shutdown_connections 2022-02-02T22:31:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 -- 172.21.15.96:0/3378657275 wait complete. 2022-02-02T22:31:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.328+0000 7f7e73efd700 1 Processor -- start 2022-02-02T22:31:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 -- start start 2022-02-02T22:31:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 0x7f7e6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:06.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c06a380 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c06a4c0 con 0x7f7e6c0f7980 2022-02-02T22:31:06.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:06.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48902/0 (socket says 172.21.15.96:48902) 2022-02-02T22:31:06.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 -- 172.21.15.96:0/3379561012 learned_addr learned my addr 172.21.15.96:0/3379561012 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:06.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71498700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 0x7f7e6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:06.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 -- 172.21.15.96:0/3379561012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 msgr2=0x7f7e6c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 0x7f7e6c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 -- 172.21.15.96:0/3379561012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c005040 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e71c99700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 secure :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 rx=0x7f7e5c013a70 tx=0x7f7e5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:06.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5c018070 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c06a740 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e5c0097d0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.329+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5c01c3c0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.330+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c06aca0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.330+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c045ad0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.331+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7e5c007ba0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.331+0000 7f7e627fc700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 0x7f7e58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:06.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.331+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7e5c083730 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.331+0000 7f7e71498700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 0x7f7e58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:06.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.332+0000 7f7e71498700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 0x7f7e58067290 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7f7e68009760 tx=0x7f7e68009c60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:06.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.335+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7e5c0518f0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.537+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e6c0586e0 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.537+0000 7f7e627fc700 1 -- 172.21.15.96:0/3379561012 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7e5c054f10 con 0x7f7e6c0f66e0 2022-02-02T22:31:06.540 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:31:06.549 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:31:06.549 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:31:06.550 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:31:06.550 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:06.550 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:31:06.551 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:31:06.551 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:31:06.551 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:31:06.552 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:31:06.552 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:31:06.552 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:31:06.553 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:31:06.553 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:31:06.553 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:31:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:31:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:31:06.554 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:31:06.555 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:31:06.555 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:31:06.555 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:31:06.556 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:31:06.556 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:31:06.556 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:31:06.557 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:31:06.557 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:31:06.557 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:31:06.558 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:31:06.558 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:31:06.558 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:31:06.559 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:31:06.559 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:31:06.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:06.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:06.560 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:31:06.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:06.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:06.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:06.561 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:06.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 msgr2=0x7f7e58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 0x7f7e58067290 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7f7e68009760 tx=0x7f7e68009c60).stop 2022-02-02T22:31:06.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 msgr2=0x7f7e6c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:06.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 secure :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 rx=0x7f7e5c013a70 tx=0x7f7e5c009b30).stop 2022-02-02T22:31:06.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 shutdown_connections 2022-02-02T22:31:06.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7e58064dd0 0x7f7e58067290 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0f66e0 0x7f7e6c06b9a0 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 --2- 172.21.15.96:0/3379561012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e6c0f7980 0x7f7e6c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:06.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.539+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 >> 172.21.15.96:0/3379561012 conn(0x7f7e6c0f1e40 msgr2=0x7f7e6c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:06.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.540+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 shutdown_connections 2022-02-02T22:31:06.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:06.540+0000 7f7e73efd700 1 -- 172.21.15.96:0/3379561012 wait complete. 2022-02-02T22:31:06.566 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:31:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:06 smithi159 ceph-mon[69013]: pgmap v7469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:06 smithi159 ceph-mon[69013]: from='client.41750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:06 smithi159 ceph-mon[69013]: from='client.41754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2173380303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:31:07.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3379561012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:31:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:06 smithi096 ceph-mon[101353]: pgmap v7469: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:06 smithi096 ceph-mon[101353]: from='client.41750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:06 smithi096 ceph-mon[101353]: from='client.41754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:07.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2173380303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:31:07.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3379561012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:31:09.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:08 smithi159 ceph-mon[69013]: pgmap v7470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:08 smithi096 ceph-mon[101353]: pgmap v7470: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:11.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:10 smithi159 ceph-mon[69013]: pgmap v7471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:10 smithi096 ceph-mon[101353]: pgmap v7471: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:12 smithi159 ceph-mon[69013]: pgmap v7472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:12 smithi096 ceph-mon[101353]: pgmap v7472: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:14 smithi159 ceph-mon[69013]: pgmap v7473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:14 smithi096 ceph-mon[101353]: pgmap v7473: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:16 smithi159 ceph-mon[69013]: pgmap v7474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:16 smithi096 ceph-mon[101353]: pgmap v7474: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:18 smithi159 ceph-mon[69013]: pgmap v7475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:18 smithi096 ceph-mon[101353]: pgmap v7475: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:20 smithi159 ceph-mon[69013]: pgmap v7476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:20 smithi096 ceph-mon[101353]: pgmap v7476: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:22 smithi159 ceph-mon[69013]: pgmap v7477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:22 smithi096 ceph-mon[101353]: pgmap v7477: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:24 smithi159 ceph-mon[69013]: pgmap v7478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:24 smithi096 ceph-mon[101353]: pgmap v7478: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:26 smithi159 ceph-mon[69013]: pgmap v7479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:26 smithi096 ceph-mon[101353]: pgmap v7479: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:28 smithi159 ceph-mon[69013]: pgmap v7480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:31:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:31:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:28 smithi096 ceph-mon[101353]: pgmap v7480: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:31:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:31:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:30 smithi159 ceph-mon[69013]: pgmap v7481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:30 smithi096 ceph-mon[101353]: pgmap v7481: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:32 smithi159 ceph-mon[69013]: pgmap v7482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:32 smithi096 ceph-mon[101353]: pgmap v7482: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:34 smithi159 ceph-mon[69013]: pgmap v7483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:34 smithi096 ceph-mon[101353]: pgmap v7483: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:36.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.650+0000 7f34b87ef700 1 -- 172.21.15.96:0/876067672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f5f60 msgr2=0x7f34b00f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.650+0000 7f34b87ef700 1 --2- 172.21.15.96:0/876067672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f5f60 0x7f34b00f63e0 secure :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 rx=0x7f34a0004770 tx=0x7f34a000ac40).stop 2022-02-02T22:31:36.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- 172.21.15.96:0/876067672 shutdown_connections 2022-02-02T22:31:36.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 --2- 172.21.15.96:0/876067672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f5f60 0x7f34b00f63e0 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 --2- 172.21.15.96:0/876067672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f4d60 0x7f34b00f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- 172.21.15.96:0/876067672 >> 172.21.15.96:0/876067672 conn(0x7f34b00f04c0 msgr2=0x7f34b00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:36.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- 172.21.15.96:0/876067672 shutdown_connections 2022-02-02T22:31:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- 172.21.15.96:0/876067672 wait complete. 2022-02-02T22:31:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 Processor -- start 2022-02-02T22:31:36.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- start start 2022-02-02T22:31:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f5f60 0x7f34b00f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00f7890 con 0x7f34b00f4d60 2022-02-02T22:31:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.651+0000 7f34b87ef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00f79d0 con 0x7f34b00f5f60 2022-02-02T22:31:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48920/0 (socket says 172.21.15.96:48920) 2022-02-02T22:31:36.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 -- 172.21.15.96:0/2016077136 learned_addr learned my addr 172.21.15.96:0/2016077136 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b5d8a700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f5f60 0x7f34b00f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 -- 172.21.15.96:0/2016077136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f5f60 msgr2=0x7f34b00f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f5f60 0x7f34b00f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 -- 172.21.15.96:0/2016077136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0005040 con 0x7f34b00f4d60 2022-02-02T22:31:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34b658b700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 secure :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 rx=0x7f34ac00c510 tx=0x7f34ac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34ac00f650 con 0x7f34b00f4d60 2022-02-02T22:31:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f34ac00fc60 con 0x7f34b00f4d60 2022-02-02T22:31:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.652+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34ac012c50 con 0x7f34b00f4d60 2022-02-02T22:31:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.653+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00f7cb0 con 0x7f34b00f4d60 2022-02-02T22:31:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.653+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b010efa0 con 0x7f34b00f4d60 2022-02-02T22:31:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.655+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b00f4150 con 0x7f34b00f4d60 2022-02-02T22:31:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.656+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f34ac010070 con 0x7f34b00f4d60 2022-02-02T22:31:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.656+0000 7f34a6ffd700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 0x7f349c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.656+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f34ac081690 con 0x7f34b00f4d60 2022-02-02T22:31:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.656+0000 7f34b5d8a700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 0x7f349c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.657+0000 7f34b5d8a700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 0x7f349c067290 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 rx=0x7f34a0014450 tx=0x7f34a0016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.660+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f34ac0477d0 con 0x7f34b00f4d60 2022-02-02T22:31:36.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.839+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b00fa350 con 0x7f349c064dd0 2022-02-02T22:31:36.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.841+0000 7f34a6ffd700 1 -- 172.21.15.96:0/2016077136 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f34b00fa350 con 0x7f349c064dd0 2022-02-02T22:31:36.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.842+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 msgr2=0x7f349c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.842+0000 7f34b87ef700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 0x7f349c067290 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 rx=0x7f34a0014450 tx=0x7f34a0016040).stop 2022-02-02T22:31:36.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 msgr2=0x7f34b00f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 secure :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 rx=0x7f34ac00c510 tx=0x7f34ac007e00).stop 2022-02-02T22:31:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 shutdown_connections 2022-02-02T22:31:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f349c064dd0 0x7f349c067290 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34b00f4d60 0x7f34b00f8eb0 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 --2- 172.21.15.96:0/2016077136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34b00f5f60 0x7f34b00f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 >> 172.21.15.96:0/2016077136 conn(0x7f34b00f04c0 msgr2=0x7f34b00f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:36.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 shutdown_connections 2022-02-02T22:31:36.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.843+0000 7f34b87ef700 1 -- 172.21.15.96:0/2016077136 wait complete. 2022-02-02T22:31:36.852 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:31:36.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 -- 172.21.15.96:0/2926111179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f5430 msgr2=0x7f24bc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 --2- 172.21.15.96:0/2926111179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f5430 0x7f24bc0f5850 secure :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 rx=0x7f24ac004660 tx=0x7f24ac009b30).stop 2022-02-02T22:31:36.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 -- 172.21.15.96:0/2926111179 shutdown_connections 2022-02-02T22:31:36.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 --2- 172.21.15.96:0/2926111179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 --2- 172.21.15.96:0/2926111179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f5430 0x7f24bc0f5850 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 -- 172.21.15.96:0/2926111179 >> 172.21.15.96:0/2926111179 conn(0x7f24bc0f0b90 msgr2=0x7f24bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:36.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 -- 172.21.15.96:0/2926111179 shutdown_connections 2022-02-02T22:31:36.944 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:36 smithi096 ceph-mon[101353]: pgmap v7484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:36.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.941+0000 7f24c306f700 1 -- 172.21.15.96:0/2926111179 wait complete. 2022-02-02T22:31:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 Processor -- start 2022-02-02T22:31:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 -- start start 2022-02-02T22:31:36.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f5430 0x7f24bc0fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0fbf90 con 0x7f24bc0f66d0 2022-02-02T22:31:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c306f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0fc0d0 con 0x7f24bc0f5430 2022-02-02T22:31:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48932/0 (socket says 172.21.15.96:48932) 2022-02-02T22:31:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 -- 172.21.15.96:0/1831167291 learned_addr learned my addr 172.21.15.96:0/1831167291 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c206d700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f5430 0x7f24bc0fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 -- 172.21.15.96:0/1831167291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f5430 msgr2=0x7f24bc0fd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f5430 0x7f24bc0fd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.942+0000 7f24c186c700 1 -- 172.21.15.96:0/1831167291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac005040 con 0x7f24bc0f66d0 2022-02-02T22:31:36.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24c186c700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 secure :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 rx=0x7f24b800e7f0 tx=0x7f24b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b80092e0 con 0x7f24bc0f66d0 2022-02-02T22:31:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24b800f040 con 0x7f24bc0f66d0 2022-02-02T22:31:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc0fc3b0 con 0x7f24bc0f66d0 2022-02-02T22:31:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b8014750 con 0x7f24bc0f66d0 2022-02-02T22:31:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.943+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc10ed50 con 0x7f24bc0f66d0 2022-02-02T22:31:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.944+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24b801b030 con 0x7f24bc0f66d0 2022-02-02T22:31:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.944+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc045ad0 con 0x7f24bc0f66d0 2022-02-02T22:31:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.944+0000 7f24b2ffd700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 0x7f24a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:36.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.945+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f24b8081830 con 0x7f24bc0f66d0 2022-02-02T22:31:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.945+0000 7f24c206d700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 0x7f24a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.945+0000 7f24c206d700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 0x7f24a80672e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f24ac000c00 tx=0x7f24ac016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:36.949+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24b804f9e0 con 0x7f24bc0f66d0 2022-02-02T22:31:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:36 smithi159 ceph-mon[69013]: pgmap v7484: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:37.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.122+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24bc0fee00 con 0x7f24a8064e20 2022-02-02T22:31:37.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.132+0000 7f24b2ffd700 1 -- 172.21.15.96:0/1831167291 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f24bc0fee00 con 0x7f24a8064e20 2022-02-02T22:31:37.132 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:31:37.132 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:31:37.133 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:31:37.133 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:31:37.133 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:31:37.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:31:37.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:31:37.134 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:31:37.135 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:31:37.135 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:31:37.135 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:31:37.136 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:31:37.136 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:31:37.137 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:31:37.137 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:31:37.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:31:37.138 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:31:37.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:31:37.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:31:37.139 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:31:37.140 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:31:37.140 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:31:37.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.133+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 msgr2=0x7f24a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.133+0000 7f24c306f700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 0x7f24a80672e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f24ac000c00 tx=0x7f24ac016040).stop 2022-02-02T22:31:37.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.133+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 msgr2=0x7f24bc0fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.133+0000 7f24c306f700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 secure :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 rx=0x7f24b800e7f0 tx=0x7f24b800b040).stop 2022-02-02T22:31:37.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 shutdown_connections 2022-02-02T22:31:37.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f24a8064e20 0x7f24a80672e0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24bc0f5430 0x7f24bc0fd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 --2- 172.21.15.96:0/1831167291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24bc0f66d0 0x7f24bc0fba30 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 >> 172.21.15.96:0/1831167291 conn(0x7f24bc0f0b90 msgr2=0x7f24bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:37.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 shutdown_connections 2022-02-02T22:31:37.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.134+0000 7f24c306f700 1 -- 172.21.15.96:0/1831167291 wait complete. 2022-02-02T22:31:37.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- 172.21.15.96:0/3632593343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f77d0 msgr2=0x7f4b340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/3632593343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f77d0 0x7f4b340f7c30 secure :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 rx=0x7f4b20004660 tx=0x7f4b20009b30).stop 2022-02-02T22:31:37.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- 172.21.15.96:0/3632593343 shutdown_connections 2022-02-02T22:31:37.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/3632593343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f77d0 0x7f4b340f7c30 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/3632593343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f6530 0x7f4b340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- 172.21.15.96:0/3632593343 >> 172.21.15.96:0/3632593343 conn(0x7f4b340f1c90 msgr2=0x7f4b340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:37.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- 172.21.15.96:0/3632593343 shutdown_connections 2022-02-02T22:31:37.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- 172.21.15.96:0/3632593343 wait complete. 2022-02-02T22:31:37.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 Processor -- start 2022-02-02T22:31:37.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.231+0000 7f4b39c5f700 1 -- start start 2022-02-02T22:31:37.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b39c5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b39c5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 0x7f4b34107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b39c5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34107830 con 0x7f4b340f6530 2022-02-02T22:31:37.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b39c5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34108040 con 0x7f4b340f77d0 2022-02-02T22:31:37.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48940/0 (socket says 172.21.15.96:48940) 2022-02-02T22:31:37.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 -- 172.21.15.96:0/63113064 learned_addr learned my addr 172.21.15.96:0/63113064 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:37.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b33fff700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 0x7f4b34107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 -- 172.21.15.96:0/63113064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 msgr2=0x7f4b34107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 0x7f4b34107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 -- 172.21.15.96:0/63113064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20005040 con 0x7f4b340f6530 2022-02-02T22:31:37.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b33fff700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 0x7f4b34107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:31:37.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.232+0000 7f4b38c5d700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 secure :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 rx=0x7f4b28002700 tx=0x7f4b28009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:37.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.233+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b28009320 con 0x7f4b340f6530 2022-02-02T22:31:37.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.233+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b341082c0 con 0x7f4b340f6530 2022-02-02T22:31:37.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.233+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b2800f040 con 0x7f4b340f6530 2022-02-02T22:31:37.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.233+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b280148e0 con 0x7f4b340f6530 2022-02-02T22:31:37.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.233+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b34108880 con 0x7f4b340f6530 2022-02-02T22:31:37.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.234+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34059100 con 0x7f4b340f6530 2022-02-02T22:31:37.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.235+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b28009480 con 0x7f4b340f6530 2022-02-02T22:31:37.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.235+0000 7f4b317fa700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 0x7f4b240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.235+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4b28081e30 con 0x7f4b340f6530 2022-02-02T22:31:37.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.235+0000 7f4b33fff700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 0x7f4b240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.235+0000 7f4b33fff700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 0x7f4b240672e0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 rx=0x7f4b20004630 tx=0x7f4b20009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:37.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.239+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b2804fe70 con 0x7f4b340f6530 2022-02-02T22:31:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.473+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b340fee00 con 0x7f4b340f6530 2022-02-02T22:31:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.473+0000 7f4b317fa700 1 -- 172.21.15.96:0/63113064 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4b28053490 con 0x7f4b340f6530 2022-02-02T22:31:37.474 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:31:37.474 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:31:37.475 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:31:37.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:37.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:31:37.476 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:31:37.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:37.476 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:31:37.476 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:31:37.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:37.477 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:31:37.478 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:31:37.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:31:37.478 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:31:37.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:31:37.479 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:31:37.479 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:31:37.479 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:31:37.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 msgr2=0x7f4b240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 0x7f4b240672e0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 rx=0x7f4b20004630 tx=0x7f4b20009b30).stop 2022-02-02T22:31:37.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 msgr2=0x7f4b34106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 secure :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 rx=0x7f4b28002700 tx=0x7f4b28009e00).stop 2022-02-02T22:31:37.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 shutdown_connections 2022-02-02T22:31:37.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4b24064e20 0x7f4b240672e0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b340f6530 0x7f4b34106d40 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 --2- 172.21.15.96:0/63113064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b340f77d0 0x7f4b34107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 >> 172.21.15.96:0/63113064 conn(0x7f4b340f1c90 msgr2=0x7f4b340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:37.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 shutdown_connections 2022-02-02T22:31:37.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.475+0000 7f4b39c5f700 1 -- 172.21.15.96:0/63113064 wait complete. 2022-02-02T22:31:37.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2164855189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 msgr2=0x7fc1c00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2164855189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c00f7de0 secure :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 rx=0x7fc1bc004660 tx=0x7fc1bc009b30).stop 2022-02-02T22:31:37.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2164855189 shutdown_connections 2022-02-02T22:31:37.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2164855189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c00f7de0 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2164855189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 0x7fc1c00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2164855189 >> 172.21.15.96:0/2164855189 conn(0x7fc1c00f1e40 msgr2=0x7fc1c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:37.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2164855189 shutdown_connections 2022-02-02T22:31:37.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2164855189 wait complete. 2022-02-02T22:31:37.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 Processor -- start 2022-02-02T22:31:37.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.573+0000 7fc1c7ff5700 1 -- start start 2022-02-02T22:31:37.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c7ff5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 0x7fc1c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c7ff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c7ff5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c006a380 con 0x7fc1c00f7980 2022-02-02T22:31:37.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c7ff5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c006a4c0 con 0x7fc1c00f66e0 2022-02-02T22:31:37.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48952/0 (socket says 172.21.15.96:48952) 2022-02-02T22:31:37.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 -- 172.21.15.96:0/2268392603 learned_addr learned my addr 172.21.15.96:0/2268392603 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:31:37.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5d91700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 0x7fc1c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 -- 172.21.15.96:0/2268392603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 msgr2=0x7fc1c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 0x7fc1c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 -- 172.21.15.96:0/2268392603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc005040 con 0x7fc1c00f7980 2022-02-02T22:31:37.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c5590700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 secure :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 rx=0x7fc1bc009990 tx=0x7fc1bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:37.582 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1bc018070 con 0x7fc1c00f7980 2022-02-02T22:31:37.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1bc007ca0 con 0x7fc1c00f7980 2022-02-02T22:31:37.583 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c006a740 con 0x7fc1c00f7980 2022-02-02T22:31:37.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.574+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1bc01c620 con 0x7fc1c00f7980 2022-02-02T22:31:37.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.575+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c006aca0 con 0x7fc1c00f7980 2022-02-02T22:31:37.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.575+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c0045ad0 con 0x7fc1c00f7980 2022-02-02T22:31:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.576+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1bc01d960 con 0x7fc1c00f7980 2022-02-02T22:31:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.576+0000 7fc1b67fc700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 0x7fc1ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:31:37.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.576+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1bc0837e0 con 0x7fc1c00f7980 2022-02-02T22:31:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.576+0000 7fc1c5d91700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 0x7fc1ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:31:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.577+0000 7fc1c5d91700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 0x7fc1ac067290 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 rx=0x7fc1c006b730 tx=0x7fc1b0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:31:37.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.580+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1bc0519a0 con 0x7fc1c00f7980 2022-02-02T22:31:37.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.783+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc1c0027a00 con 0x7fc1c00f7980 2022-02-02T22:31:37.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.783+0000 7fc1b67fc700 1 -- 172.21.15.96:0/2268392603 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc1bc054fc0 con 0x7fc1c00f7980 2022-02-02T22:31:37.784 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:31:37.784 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:31:37.785 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:31:37.785 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:31:37.786 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:37.786 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:31:37.786 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:31:37.787 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:31:37.787 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:31:37.787 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:31:37.788 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:31:37.788 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:31:37.788 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:31:37.789 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:31:37.789 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:31:37.789 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:31:37.790 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:31:37.790 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:31:37.790 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:31:37.791 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:31:37.791 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:31:37.791 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:31:37.792 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:31:37.792 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:31:37.792 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:31:37.793 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:31:37.793 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:31:37.793 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:31:37.794 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:31:37.794 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:31:37.794 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:31:37.795 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:31:37.795 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:37.795 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:37.796 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:31:37.796 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:31:37.796 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:37.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:37.797 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:31:37.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 msgr2=0x7fc1ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 0x7fc1ac067290 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 rx=0x7fc1c006b730 tx=0x7fc1b0009040).stop 2022-02-02T22:31:37.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 msgr2=0x7fc1c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:31:37.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 secure :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 rx=0x7fc1bc009990 tx=0x7fc1bc009b30).stop 2022-02-02T22:31:37.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 shutdown_connections 2022-02-02T22:31:37.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc1ac064dd0 0x7fc1ac067290 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1c00f66e0 0x7fc1c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 --2- 172.21.15.96:0/2268392603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1c00f7980 0x7fc1c0069e20 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:31:37.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 >> 172.21.15.96:0/2268392603 conn(0x7fc1c00f1e40 msgr2=0x7fc1c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:31:37.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 shutdown_connections 2022-02-02T22:31:37.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:31:37.785+0000 7fc1c7ff5700 1 -- 172.21.15.96:0/2268392603 wait complete. 2022-02-02T22:31:37.802 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:31:38.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:37 smithi159 ceph-mon[69013]: from='client.41766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:38.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/63113064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:31:38.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:37 smithi096 ceph-mon[101353]: from='client.41766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:38.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/63113064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:31:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:38 smithi159 ceph-mon[69013]: from='client.41770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:38 smithi159 ceph-mon[69013]: pgmap v7485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:39.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2268392603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:31:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:38 smithi096 ceph-mon[101353]: from='client.41770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:31:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:38 smithi096 ceph-mon[101353]: pgmap v7485: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2268392603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:31:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:40 smithi159 ceph-mon[69013]: pgmap v7486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:40 smithi096 ceph-mon[101353]: pgmap v7486: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:42 smithi159 ceph-mon[69013]: pgmap v7487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:42 smithi096 ceph-mon[101353]: pgmap v7487: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:44 smithi159 ceph-mon[69013]: pgmap v7488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:44 smithi096 ceph-mon[101353]: pgmap v7488: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:46 smithi159 ceph-mon[69013]: pgmap v7489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:46 smithi096 ceph-mon[101353]: pgmap v7489: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:48 smithi159 ceph-mon[69013]: pgmap v7490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:48 smithi096 ceph-mon[101353]: pgmap v7490: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:51.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:50 smithi159 ceph-mon[69013]: pgmap v7491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:50 smithi096 ceph-mon[101353]: pgmap v7491: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:53.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:52 smithi159 ceph-mon[69013]: pgmap v7492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:52 smithi096 ceph-mon[101353]: pgmap v7492: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:55.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:54 smithi159 ceph-mon[69013]: pgmap v7493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:54 smithi096 ceph-mon[101353]: pgmap v7493: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:56 smithi159 ceph-mon[69013]: pgmap v7494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:56 smithi096 ceph-mon[101353]: pgmap v7494: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:31:58 smithi159 ceph-mon[69013]: pgmap v7495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:31:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:31:58 smithi096 ceph-mon[101353]: pgmap v7495: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:00 smithi159 ceph-mon[69013]: pgmap v7496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:00 smithi096 ceph-mon[101353]: pgmap v7496: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:02 smithi159 ceph-mon[69013]: pgmap v7497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:02 smithi096 ceph-mon[101353]: pgmap v7497: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:04 smithi159 ceph-mon[69013]: pgmap v7498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:04 smithi096 ceph-mon[101353]: pgmap v7498: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:06 smithi159 ceph-mon[69013]: pgmap v7499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:06 smithi096 ceph-mon[101353]: pgmap v7499: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 -- 172.21.15.96:0/2650645184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0f96f0 msgr2=0x7f740c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:07.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2650645184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0f96f0 0x7f740c0fbae0 secure :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 rx=0x7f73fc004660 tx=0x7f73fc009b30).stop 2022-02-02T22:32:07.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 -- 172.21.15.96:0/2650645184 shutdown_connections 2022-02-02T22:32:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2650645184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0f96f0 0x7f740c0fbae0 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2650645184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0602b0 0x7f740c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 -- 172.21.15.96:0/2650645184 >> 172.21.15.96:0/2650645184 conn(0x7f740c0f0b90 msgr2=0x7f740c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 -- 172.21.15.96:0/2650645184 shutdown_connections 2022-02-02T22:32:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 -- 172.21.15.96:0/2650645184 wait complete. 2022-02-02T22:32:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.896+0000 7f7410f3e700 1 Processor -- start 2022-02-02T22:32:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f7410f3e700 1 -- start start 2022-02-02T22:32:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f7410f3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:07.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f7410f3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 0x7f740c107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:07.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f7410f3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c107820 con 0x7f740c0602b0 2022-02-02T22:32:07.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f7410f3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c108030 con 0x7f740c0f96f0 2022-02-02T22:32:07.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:07.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48968/0 (socket says 172.21.15.96:48968) 2022-02-02T22:32:07.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 -- 172.21.15.96:0/2081716078 learned_addr learned my addr 172.21.15.96:0/2081716078 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:07.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740affd700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 0x7f740c107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:07.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 -- 172.21.15.96:0/2081716078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 msgr2=0x7f740c107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:07.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 0x7f740c107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:07.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 -- 172.21.15.96:0/2081716078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc005040 con 0x7f740c0602b0 2022-02-02T22:32:07.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740affd700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 0x7f740c107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:32:07.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.897+0000 7f740b7fe700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 secure :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 rx=0x7f7400002700 tx=0x7f7400009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:07.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.898+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7400009320 con 0x7f740c0602b0 2022-02-02T22:32:07.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.898+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f740000f040 con 0x7f740c0602b0 2022-02-02T22:32:07.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.898+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c1082b0 con 0x7f740c0602b0 2022-02-02T22:32:07.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.898+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7400014820 con 0x7f740c0602b0 2022-02-02T22:32:07.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.898+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c108870 con 0x7f740c0602b0 2022-02-02T22:32:07.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.899+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c059100 con 0x7f740c0602b0 2022-02-02T22:32:07.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.899+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7400009480 con 0x7f740c0602b0 2022-02-02T22:32:07.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.900+0000 7f73f3fff700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 0x7f73f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.900+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7400081dd0 con 0x7f740c0602b0 2022-02-02T22:32:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.900+0000 7f740affd700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 0x7f73f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.900+0000 7f740affd700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 0x7f73f40672e0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 rx=0x7f73fc005010 tx=0x7f73fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:07.904+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f740004fed0 con 0x7f740c0602b0 2022-02-02T22:32:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.084+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f740c0008d0 con 0x7f73f4064e20 2022-02-02T22:32:08.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.085+0000 7f73f3fff700 1 -- 172.21.15.96:0/2081716078 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f740c0008d0 con 0x7f73f4064e20 2022-02-02T22:32:08.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 msgr2=0x7f73f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 0x7f73f40672e0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 rx=0x7f73fc005010 tx=0x7f73fc009b30).stop 2022-02-02T22:32:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 msgr2=0x7f740c106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 secure :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 rx=0x7f7400002700 tx=0x7f7400009e00).stop 2022-02-02T22:32:08.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 shutdown_connections 2022-02-02T22:32:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f73f4064e20 0x7f73f40672e0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f740c0602b0 0x7f740c106d30 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 --2- 172.21.15.96:0/2081716078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c0f96f0 0x7f740c107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 >> 172.21.15.96:0/2081716078 conn(0x7f740c0f0b90 msgr2=0x7f740c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 shutdown_connections 2022-02-02T22:32:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.087+0000 7f7410f3e700 1 -- 172.21.15.96:0/2081716078 wait complete. 2022-02-02T22:32:08.097 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:32:08.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 -- 172.21.15.96:0/2652610091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 msgr2=0x7fd7140f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/2652610091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f6b30 secure :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 rx=0x7fd704004660 tx=0x7fd704009b30).stop 2022-02-02T22:32:08.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 -- 172.21.15.96:0/2652610091 shutdown_connections 2022-02-02T22:32:08.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/2652610091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f6b30 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/2652610091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 0x7fd7140f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 -- 172.21.15.96:0/2652610091 >> 172.21.15.96:0/2652610091 conn(0x7fd7140f0b90 msgr2=0x7fd7140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.185+0000 7fd71ac1f700 1 -- 172.21.15.96:0/2652610091 shutdown_connections 2022-02-02T22:32:08.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 -- 172.21.15.96:0/2652610091 wait complete. 2022-02-02T22:32:08.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 Processor -- start 2022-02-02T22:32:08.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 -- start start 2022-02-02T22:32:08.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 0x7fd7140f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140f7f70 con 0x7fd7140f66d0 2022-02-02T22:32:08.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71ac1f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140f80b0 con 0x7fd7140f5430 2022-02-02T22:32:08.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71941c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71941c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48980/0 (socket says 172.21.15.96:48980) 2022-02-02T22:32:08.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.186+0000 7fd71941c700 1 -- 172.21.15.96:0/4057405994 learned_addr learned my addr 172.21.15.96:0/4057405994 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:08.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd719c1d700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 0x7fd7140f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71941c700 1 -- 172.21.15.96:0/4057405994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 msgr2=0x7fd7140f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71941c700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 0x7fd7140f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71941c700 1 -- 172.21.15.96:0/4057405994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd7140f66d0 2022-02-02T22:32:08.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71941c700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 secure :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 rx=0x7fd704009990 tx=0x7fd704009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd704018070 con 0x7fd7140f66d0 2022-02-02T22:32:08.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7140f8330 con 0x7fd7140f66d0 2022-02-02T22:32:08.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd704007ca0 con 0x7fd7140f66d0 2022-02-02T22:32:08.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70401c620 con 0x7fd7140f66d0 2022-02-02T22:32:08.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.187+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140f8890 con 0x7fd7140f66d0 2022-02-02T22:32:08.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.188+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc004fa0 con 0x7fd7140f66d0 2022-02-02T22:32:08.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.188+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd70401c8e0 con 0x7fd7140f66d0 2022-02-02T22:32:08.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.189+0000 7fd70a7fc700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 0x7fd7000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.189+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7040836f0 con 0x7fd7140f66d0 2022-02-02T22:32:08.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.189+0000 7fd719c1d700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 0x7fd7000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.189+0000 7fd719c1d700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 0x7fd7000672e0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7fd7140f9320 tx=0x7fd710009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.193+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd7040517f0 con 0x7fd7140f66d0 2022-02-02T22:32:08.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.365+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6fc000bc0 con 0x7fd700064e20 2022-02-02T22:32:08.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.374+0000 7fd70a7fc700 1 -- 172.21.15.96:0/4057405994 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd6fc000bc0 con 0x7fd700064e20 2022-02-02T22:32:08.375 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:32:08.375 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:32:08.376 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:32:08.376 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:32:08.376 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:32:08.377 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:32:08.377 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:32:08.377 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:32:08.378 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:32:08.378 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:32:08.378 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:32:08.379 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:32:08.379 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:32:08.379 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:32:08.380 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:32:08.380 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:32:08.381 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:32:08.381 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:32:08.381 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:32:08.382 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:32:08.382 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:32:08.382 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:32:08.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 msgr2=0x7fd7000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 0x7fd7000672e0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7fd7140f9320 tx=0x7fd710009040).stop 2022-02-02T22:32:08.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 msgr2=0x7fd7140f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 secure :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 rx=0x7fd704009990 tx=0x7fd704009b30).stop 2022-02-02T22:32:08.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 shutdown_connections 2022-02-02T22:32:08.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd700064e20 0x7fd7000672e0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7140f5430 0x7fd7140f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 --2- 172.21.15.96:0/4057405994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7140f66d0 0x7fd7140f7a10 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 >> 172.21.15.96:0/4057405994 conn(0x7fd7140f0b90 msgr2=0x7fd71405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 shutdown_connections 2022-02-02T22:32:08.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.376+0000 7fd71ac1f700 1 -- 172.21.15.96:0/4057405994 wait complete. 2022-02-02T22:32:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 -- 172.21.15.96:0/18991123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f55c0 msgr2=0x7f93e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 --2- 172.21.15.96:0/18991123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f55c0 0x7f93e40f59e0 secure :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 rx=0x7f93d4004660 tx=0x7f93d4009b30).stop 2022-02-02T22:32:08.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 -- 172.21.15.96:0/18991123 shutdown_connections 2022-02-02T22:32:08.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 --2- 172.21.15.96:0/18991123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f6860 0x7f93e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 --2- 172.21.15.96:0/18991123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f55c0 0x7f93e40f59e0 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 -- 172.21.15.96:0/18991123 >> 172.21.15.96:0/18991123 conn(0x7f93e40f0d40 msgr2=0x7f93e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 -- 172.21.15.96:0/18991123 shutdown_connections 2022-02-02T22:32:08.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.473+0000 7f93eb39a700 1 -- 172.21.15.96:0/18991123 wait complete. 2022-02-02T22:32:08.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 Processor -- start 2022-02-02T22:32:08.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 -- start start 2022-02-02T22:32:08.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 0x7f93e4105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4106910 con 0x7f93e40f6860 2022-02-02T22:32:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93eb39a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4106a50 con 0x7f93e40f55c0 2022-02-02T22:32:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93e8935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93e8935700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48990/0 (socket says 172.21.15.96:48990) 2022-02-02T22:32:08.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93e8935700 1 -- 172.21.15.96:0/1745501794 learned_addr learned my addr 172.21.15.96:0/1745501794 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:08.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.474+0000 7f93e9136700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 0x7f93e4105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93e8935700 1 -- 172.21.15.96:0/1745501794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 msgr2=0x7f93e4105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93e8935700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 0x7f93e4105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93e8935700 1 -- 172.21.15.96:0/1745501794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4005040 con 0x7f93e40f6860 2022-02-02T22:32:08.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93e9136700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 0x7f93e4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:32:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93e8935700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 secure :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 rx=0x7f93e000f940 tx=0x7f93e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e000fee0 con 0x7f93e40f6860 2022-02-02T22:32:08.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93e0009500 con 0x7f93e40f6860 2022-02-02T22:32:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e41073f0 con 0x7f93e40f6860 2022-02-02T22:32:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e0012460 con 0x7f93e40f6860 2022-02-02T22:32:08.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.475+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41079b0 con 0x7f93e40f6860 2022-02-02T22:32:08.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.476+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4045ad0 con 0x7f93e40f6860 2022-02-02T22:32:08.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.477+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93e000e040 con 0x7f93e40f6860 2022-02-02T22:32:08.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.477+0000 7f93d9ffb700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 0x7f93d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.477+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93e0084510 con 0x7f93e40f6860 2022-02-02T22:32:08.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.477+0000 7f93e9136700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 0x7f93d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.477+0000 7f93e9136700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 0x7f93d0067290 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 rx=0x7f93d4005010 tx=0x7f93d4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.481+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93e0056040 con 0x7f93e40f6860 2022-02-02T22:32:08.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.714+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f93e4107ff0 con 0x7f93e40f6860 2022-02-02T22:32:08.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.715+0000 7f93d9ffb700 1 -- 172.21.15.96:0/1745501794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f93e0055c30 con 0x7f93e40f6860 2022-02-02T22:32:08.716 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:32:08.716 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:32:08.716 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:32:08.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:08.717 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:32:08.717 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:32:08.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:08.718 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:32:08.718 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:32:08.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:08.719 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:32:08.719 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:32:08.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:08.720 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:32:08.720 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:32:08.721 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:32:08.721 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:32:08.722 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:32:08.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 msgr2=0x7f93d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 0x7f93d0067290 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 rx=0x7f93d4005010 tx=0x7f93d4009b30).stop 2022-02-02T22:32:08.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 msgr2=0x7f93e4106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 secure :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 rx=0x7f93e000f940 tx=0x7f93e0009de0).stop 2022-02-02T22:32:08.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 shutdown_connections 2022-02-02T22:32:08.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93d0064dd0 0x7f93d0067290 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e40f55c0 0x7f93e4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 --2- 172.21.15.96:0/1745501794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93e40f6860 0x7f93e4106360 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 >> 172.21.15.96:0/1745501794 conn(0x7f93e40f0d40 msgr2=0x7f93e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 shutdown_connections 2022-02-02T22:32:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.717+0000 7f93eb39a700 1 -- 172.21.15.96:0/1745501794 wait complete. 2022-02-02T22:32:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:08 smithi096 ceph-mon[101353]: pgmap v7500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:08.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 -- 172.21.15.96:0/1386263919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f6860 msgr2=0x7f69240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1386263919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f6860 0x7f69240f6cc0 secure :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 rx=0x7f690c004660 tx=0x7f690c009b30).stop 2022-02-02T22:32:08.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 -- 172.21.15.96:0/1386263919 shutdown_connections 2022-02-02T22:32:08.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1386263919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f6860 0x7f69240f6cc0 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1386263919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f55c0 0x7f69240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 -- 172.21.15.96:0/1386263919 >> 172.21.15.96:0/1386263919 conn(0x7f69240f0d40 msgr2=0x7f69240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:08.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 -- 172.21.15.96:0/1386263919 shutdown_connections 2022-02-02T22:32:08.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 -- 172.21.15.96:0/1386263919 wait complete. 2022-02-02T22:32:08.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.816+0000 7f692a2b0700 1 Processor -- start 2022-02-02T22:32:08.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f692a2b0700 1 -- start start 2022-02-02T22:32:08.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f692a2b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f692a2b0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f6860 0x7f692410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f692a2b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240602b0 con 0x7f69240f55c0 2022-02-02T22:32:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f692a2b0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240603f0 con 0x7f69240f6860 2022-02-02T22:32:08.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48998/0 (socket says 172.21.15.96:48998) 2022-02-02T22:32:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 -- 172.21.15.96:0/1925280258 learned_addr learned my addr 172.21.15.96:0/1925280258 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:08.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f69237fe700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f6860 0x7f692410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 -- 172.21.15.96:0/1925280258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f6860 msgr2=0x7f692410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:08.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f6860 0x7f692410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:08.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 -- 172.21.15.96:0/1925280258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c005040 con 0x7f69240f55c0 2022-02-02T22:32:08.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6923fff700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 secure :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 rx=0x7f6914002700 tx=0x7f6914009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.817+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69140079c0 con 0x7f69240f55c0 2022-02-02T22:32:08.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.818+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692410ea60 con 0x7f69240f55c0 2022-02-02T22:32:08.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.818+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f691400f040 con 0x7f69240f55c0 2022-02-02T22:32:08.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.818+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6914014860 con 0x7f69240f55c0 2022-02-02T22:32:08.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.818+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692410eee0 con 0x7f69240f55c0 2022-02-02T22:32:08.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.819+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924045ad0 con 0x7f69240f55c0 2022-02-02T22:32:08.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.819+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f691401b060 con 0x7f69240f55c0 2022-02-02T22:32:08.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.819+0000 7f6920ff9700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:08.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.820+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6914081830 con 0x7f69240f55c0 2022-02-02T22:32:08.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.820+0000 7f69237fe700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:08.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.820+0000 7f69237fe700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7f690c004630 tx=0x7f690c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:08.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:08.824+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f691404f930 con 0x7f69240f55c0 2022-02-02T22:32:09.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.024+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f69240fde80 con 0x7f69240f55c0 2022-02-02T22:32:09.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.024+0000 7f6920ff9700 1 -- 172.21.15.96:0/1925280258 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6914019070 con 0x7f69240f55c0 2022-02-02T22:32:09.025 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:32:09.025 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:32:09.025 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:32:09.026 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:32:09.026 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:09.026 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:32:09.027 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:32:09.027 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:32:09.027 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:32:09.028 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:32:09.028 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:32:09.029 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:32:09.029 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:32:09.029 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:32:09.030 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:32:09.030 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:32:09.030 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:32:09.031 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:32:09.031 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:32:09.031 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:32:09.032 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:32:09.032 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:32:09.032 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:32:09.033 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:32:09.033 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:32:09.033 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:32:09.034 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:32:09.034 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:32:09.034 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:32:09.040 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:32:09.041 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:32:09.041 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:32:09.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:09.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:09.042 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:32:09.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:09.043 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:09.043 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:09.043 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:09.044 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:08 smithi159 ceph-mon[69013]: pgmap v7500: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:09.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 msgr2=0x7f6910067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:09.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7f690c004630 tx=0x7f690c009b30).stop 2022-02-02T22:32:09.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 msgr2=0x7f692410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:09.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 secure :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 rx=0x7f6914002700 tx=0x7f6914009d80).stop 2022-02-02T22:32:09.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 shutdown_connections 2022-02-02T22:32:09.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6910064dd0 0x7f6910067290 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:09.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69240f55c0 0x7f692410c070 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:09.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 --2- 172.21.15.96:0/1925280258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69240f6860 0x7f692410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:09.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 >> 172.21.15.96:0/1925280258 conn(0x7f69240f0d40 msgr2=0x7f69240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:09.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 shutdown_connections 2022-02-02T22:32:09.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:09.027+0000 7f692a2b0700 1 -- 172.21.15.96:0/1925280258 wait complete. 2022-02-02T22:32:09.049 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:32:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:09 smithi159 ceph-mon[69013]: from='client.41782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:09 smithi159 ceph-mon[69013]: from='client.41786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:10.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1745501794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:32:10.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:09 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1925280258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:32:10.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:09 smithi096 ceph-mon[101353]: from='client.41782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:10.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:09 smithi096 ceph-mon[101353]: from='client.41786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:10.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1745501794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:32:10.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:09 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1925280258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:32:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:10 smithi159 ceph-mon[69013]: pgmap v7501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:11.058 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:10 smithi096 ceph-mon[101353]: pgmap v7501: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:12 smithi159 ceph-mon[69013]: pgmap v7502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:12 smithi096 ceph-mon[101353]: pgmap v7502: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:14 smithi159 ceph-mon[69013]: pgmap v7503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:14 smithi096 ceph-mon[101353]: pgmap v7503: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:16 smithi159 ceph-mon[69013]: pgmap v7504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:16 smithi096 ceph-mon[101353]: pgmap v7504: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:18 smithi159 ceph-mon[69013]: pgmap v7505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:18 smithi096 ceph-mon[101353]: pgmap v7505: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:20 smithi159 ceph-mon[69013]: pgmap v7506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:20 smithi096 ceph-mon[101353]: pgmap v7506: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:22 smithi159 ceph-mon[69013]: pgmap v7507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:22 smithi096 ceph-mon[101353]: pgmap v7507: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:24 smithi159 ceph-mon[69013]: pgmap v7508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:24 smithi096 ceph-mon[101353]: pgmap v7508: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:26 smithi159 ceph-mon[69013]: pgmap v7509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:26 smithi096 ceph-mon[101353]: pgmap v7509: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:28 smithi159 ceph-mon[69013]: pgmap v7510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:32:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:32:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:28 smithi096 ceph-mon[101353]: pgmap v7510: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:32:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:32:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:30 smithi159 ceph-mon[69013]: pgmap v7511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:30 smithi096 ceph-mon[101353]: pgmap v7511: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:32 smithi159 ceph-mon[69013]: pgmap v7512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:33.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:32 smithi096 ceph-mon[101353]: pgmap v7512: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:34 smithi159 ceph-mon[69013]: pgmap v7513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:34 smithi096 ceph-mon[101353]: pgmap v7513: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:36 smithi159 ceph-mon[69013]: pgmap v7514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:36 smithi096 ceph-mon[101353]: pgmap v7514: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:38 smithi159 ceph-mon[69013]: pgmap v7515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:38 smithi096 ceph-mon[101353]: pgmap v7515: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:39.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 -- 172.21.15.96:0/253579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 msgr2=0x7f33700fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 --2- 172.21.15.96:0/253579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f33700fbca0 secure :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 rx=0x7f335c004660 tx=0x7f335c009b30).stop 2022-02-02T22:32:39.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 -- 172.21.15.96:0/253579674 shutdown_connections 2022-02-02T22:32:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 --2- 172.21.15.96:0/253579674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f33700fbca0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 --2- 172.21.15.96:0/253579674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 0x7f33700f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.136+0000 7f3376fd7700 1 -- 172.21.15.96:0/253579674 >> 172.21.15.96:0/253579674 conn(0x7f33700f0de0 msgr2=0x7f33700f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.137+0000 7f3376fd7700 1 -- 172.21.15.96:0/253579674 shutdown_connections 2022-02-02T22:32:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.137+0000 7f3376fd7700 1 -- 172.21.15.96:0/253579674 wait complete. 2022-02-02T22:32:39.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.137+0000 7f3376fd7700 1 Processor -- start 2022-02-02T22:32:39.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.137+0000 7f3376fd7700 1 -- start start 2022-02-02T22:32:39.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f3376fd7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 0x7f3370106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f3376fd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f3376fd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370107a10 con 0x7f33700f98b0 2022-02-02T22:32:39.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f3376fd7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370107b50 con 0x7f3370060330 2022-02-02T22:32:39.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49018/0 (socket says 172.21.15.96:49018) 2022-02-02T22:32:39.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 -- 172.21.15.96:0/3787454303 learned_addr learned my addr 172.21.15.96:0/3787454303 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:39.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f3374d73700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 0x7f3370106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 -- 172.21.15.96:0/3787454303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 msgr2=0x7f3370106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 0x7f3370106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 -- 172.21.15.96:0/3787454303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c005040 con 0x7f33700f98b0 2022-02-02T22:32:39.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.138+0000 7f336ffff700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 secure :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 rx=0x7f335c009990 tx=0x7f335c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.139+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c018070 con 0x7f33700f98b0 2022-02-02T22:32:39.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.139+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f335c007ba0 con 0x7f33700f98b0 2022-02-02T22:32:39.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.139+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370108490 con 0x7f33700f98b0 2022-02-02T22:32:39.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.139+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c01c3c0 con 0x7f33700f98b0 2022-02-02T22:32:39.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.139+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33701089f0 con 0x7f33700f98b0 2022-02-02T22:32:39.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.140+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3370045ad0 con 0x7f33700f98b0 2022-02-02T22:32:39.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.141+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f335c01d420 con 0x7f33700f98b0 2022-02-02T22:32:39.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.141+0000 7f336d7fa700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 0x7f3360067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.141+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f335c083900 con 0x7f33700f98b0 2022-02-02T22:32:39.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.141+0000 7f3374d73700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 0x7f3360067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.141+0000 7f3374d73700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 0x7f3360067290 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 rx=0x7f3370060100 tx=0x7f3364009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.145+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f335c055450 con 0x7f33700f98b0 2022-02-02T22:32:39.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.323+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3370108c10 con 0x7f3360064dd0 2022-02-02T22:32:39.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.324+0000 7f336d7fa700 1 -- 172.21.15.96:0/3787454303 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3370108c10 con 0x7f3360064dd0 2022-02-02T22:32:39.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 msgr2=0x7f3360067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 0x7f3360067290 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 rx=0x7f3370060100 tx=0x7f3364009c00).stop 2022-02-02T22:32:39.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 msgr2=0x7f3370107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 secure :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 rx=0x7f335c009990 tx=0x7f335c009b30).stop 2022-02-02T22:32:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 shutdown_connections 2022-02-02T22:32:39.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3360064dd0 0x7f3360067290 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3370060330 0x7f3370106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 --2- 172.21.15.96:0/3787454303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33700f98b0 0x7f3370107460 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 >> 172.21.15.96:0/3787454303 conn(0x7f33700f0de0 msgr2=0x7f33700f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 shutdown_connections 2022-02-02T22:32:39.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.326+0000 7f3376fd7700 1 -- 172.21.15.96:0/3787454303 wait complete. 2022-02-02T22:32:39.337 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:32:39.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/1585029973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f77d0 msgr2=0x7fd7c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/1585029973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f77d0 0x7fd7c00f7c30 secure :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 rx=0x7fd7ac004660 tx=0x7fd7ac009b30).stop 2022-02-02T22:32:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/1585029973 shutdown_connections 2022-02-02T22:32:39.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/1585029973 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f77d0 0x7fd7c00f7c30 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/1585029973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f6530 0x7fd7c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/1585029973 >> 172.21.15.96:0/1585029973 conn(0x7fd7c00f1c90 msgr2=0x7fd7c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/1585029973 shutdown_connections 2022-02-02T22:32:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.424+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/1585029973 wait complete. 2022-02-02T22:32:39.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 Processor -- start 2022-02-02T22:32:39.429 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 -- start start 2022-02-02T22:32:39.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f77d0 0x7fd7c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006a380 con 0x7fd7c00f6530 2022-02-02T22:32:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c5e5f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006a4c0 con 0x7fd7c00f77d0 2022-02-02T22:32:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c4e5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c4e5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49026/0 (socket says 172.21.15.96:49026) 2022-02-02T22:32:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7c4e5d700 1 -- 172.21.15.96:0/318284058 learned_addr learned my addr 172.21.15.96:0/318284058 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:39.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.425+0000 7fd7bffff700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f77d0 0x7fd7c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c4e5d700 1 -- 172.21.15.96:0/318284058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f77d0 msgr2=0x7fd7c0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c4e5d700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f77d0 0x7fd7c0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c4e5d700 1 -- 172.21.15.96:0/318284058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac005040 con 0x7fd7c00f6530 2022-02-02T22:32:39.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c4e5d700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 secure :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 rx=0x7fd7b4002700 tx=0x7fd7b4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b40079c0 con 0x7fd7c00f6530 2022-02-02T22:32:39.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c006a7a0 con 0x7fd7c00f6530 2022-02-02T22:32:39.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd7b400f040 con 0x7fd7c00f6530 2022-02-02T22:32:39.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b4014860 con 0x7fd7c00f6530 2022-02-02T22:32:39.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.426+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c010ed50 con 0x7fd7c00f6530 2022-02-02T22:32:39.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.427+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c0045ad0 con 0x7fd7c00f6530 2022-02-02T22:32:39.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.427+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd7b401b060 con 0x7fd7c00f6530 2022-02-02T22:32:39.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.428+0000 7fd7bd7fa700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.428+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7b40818e0 con 0x7fd7c00f6530 2022-02-02T22:32:39.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.428+0000 7fd7bffff700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.428+0000 7fd7bffff700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7fd7ac004630 tx=0x7fd7ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.432+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd7b404fac0 con 0x7fd7c00f6530 2022-02-02T22:32:39.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.605+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7c00fedd0 con 0x7fd7b0064e20 2022-02-02T22:32:39.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.614+0000 7fd7bd7fa700 1 -- 172.21.15.96:0/318284058 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd7c00fedd0 con 0x7fd7b0064e20 2022-02-02T22:32:39.615 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:32:39.616 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:32:39.616 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:32:39.616 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:32:39.617 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:32:39.617 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:32:39.617 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:32:39.618 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:32:39.618 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:32:39.618 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:32:39.619 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:32:39.619 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:32:39.619 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:32:39.620 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:32:39.620 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:32:39.620 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:32:39.621 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:32:39.621 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:32:39.621 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:32:39.622 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:32:39.622 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:32:39.623 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:32:39.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 msgr2=0x7fd7b00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7fd7ac004630 tx=0x7fd7ac009b30).stop 2022-02-02T22:32:39.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 msgr2=0x7fd7c006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 secure :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 rx=0x7fd7b4002700 tx=0x7fd7b4009d80).stop 2022-02-02T22:32:39.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 shutdown_connections 2022-02-02T22:32:39.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd7b0064e20 0x7fd7b00672e0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00f6530 0x7fd7c006b9a0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 --2- 172.21.15.96:0/318284058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c00f77d0 0x7fd7c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 >> 172.21.15.96:0/318284058 conn(0x7fd7c00f1c90 msgr2=0x7fd7c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 shutdown_connections 2022-02-02T22:32:39.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.616+0000 7fd7c5e5f700 1 -- 172.21.15.96:0/318284058 wait complete. 2022-02-02T22:32:39.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 -- 172.21.15.96:0/437392337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 msgr2=0x7f71c40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 --2- 172.21.15.96:0/437392337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c40f6cc0 secure :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 rx=0x7f71b8004660 tx=0x7f71b8009b30).stop 2022-02-02T22:32:39.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 -- 172.21.15.96:0/437392337 shutdown_connections 2022-02-02T22:32:39.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 --2- 172.21.15.96:0/437392337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c40f6cc0 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 --2- 172.21.15.96:0/437392337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 0x7f71c40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 -- 172.21.15.96:0/437392337 >> 172.21.15.96:0/437392337 conn(0x7f71c40f0d40 msgr2=0x7f71c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.712+0000 7f71ca75f700 1 -- 172.21.15.96:0/437392337 shutdown_connections 2022-02-02T22:32:39.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.713+0000 7f71ca75f700 1 -- 172.21.15.96:0/437392337 wait complete. 2022-02-02T22:32:39.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.713+0000 7f71ca75f700 1 Processor -- start 2022-02-02T22:32:39.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.713+0000 7f71ca75f700 1 -- start start 2022-02-02T22:32:39.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71ca75f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 0x7f71c4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71ca75f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71ca75f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40603e0 con 0x7f71c40f6860 2022-02-02T22:32:39.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71ca75f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4060520 con 0x7f71c40f55c0 2022-02-02T22:32:39.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49038/0 (socket says 172.21.15.96:49038) 2022-02-02T22:32:39.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 -- 172.21.15.96:0/2084557131 learned_addr learned my addr 172.21.15.96:0/2084557131 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:39.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c3fff700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 0x7f71c4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 -- 172.21.15.96:0/2084557131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 msgr2=0x7f71c4109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 0x7f71c4109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 -- 172.21.15.96:0/2084557131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8005040 con 0x7f71c40f6860 2022-02-02T22:32:39.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c37fe700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 secure :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 rx=0x7f71b8009990 tx=0x7f71b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.714+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b8018070 con 0x7f71c40f6860 2022-02-02T22:32:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.715+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c410c6a0 con 0x7f71c40f6860 2022-02-02T22:32:39.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.715+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71b8007ba0 con 0x7f71c40f6860 2022-02-02T22:32:39.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.715+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b801c3c0 con 0x7f71c40f6860 2022-02-02T22:32:39.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.715+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c410cc00 con 0x7f71c40f6860 2022-02-02T22:32:39.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.716+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4045ad0 con 0x7f71c40f6860 2022-02-02T22:32:39.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.717+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f71b801d420 con 0x7f71c40f6860 2022-02-02T22:32:39.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.717+0000 7f71c0ff9700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 0x7f71ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:39.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.717+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71b8083a20 con 0x7f71c40f6860 2022-02-02T22:32:39.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.717+0000 7f71c3fff700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 0x7f71ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:39.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.718+0000 7f71c3fff700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 0x7f71ac067290 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 rx=0x7f71c4060060 tx=0x7f71b400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:39.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.721+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71b8051a60 con 0x7f71c40f6860 2022-02-02T22:32:39.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.950+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71c4027a00 con 0x7f71c40f6860 2022-02-02T22:32:39.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.950+0000 7f71c0ff9700 1 -- 172.21.15.96:0/2084557131 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f71b8055080 con 0x7f71c40f6860 2022-02-02T22:32:39.952 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:32:39.953 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:32:39.953 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:32:39.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:39.954 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:32:39.954 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:32:39.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:39.955 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:32:39.955 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:32:39.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:39.956 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:32:39.956 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:32:39.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:32:39.957 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:32:39.957 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:32:39.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:32:39.958 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:32:39.958 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:32:39.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 msgr2=0x7f71ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 0x7f71ac067290 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 rx=0x7f71c4060060 tx=0x7f71b400b040).stop 2022-02-02T22:32:39.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 msgr2=0x7f71c410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:39.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 secure :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 rx=0x7f71b8009990 tx=0x7f71b8009b30).stop 2022-02-02T22:32:39.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 shutdown_connections 2022-02-02T22:32:39.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f71ac064dd0 0x7f71ac067290 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71c40f55c0 0x7f71c4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 --2- 172.21.15.96:0/2084557131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71c40f6860 0x7f71c410c150 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:39.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 >> 172.21.15.96:0/2084557131 conn(0x7f71c40f0d40 msgr2=0x7f71c40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:39.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 shutdown_connections 2022-02-02T22:32:39.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:39.952+0000 7f71ca75f700 1 -- 172.21.15.96:0/2084557131 wait complete. 2022-02-02T22:32:40.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 -- 172.21.15.96:0/4003292376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 msgr2=0x7fa91c0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 --2- 172.21.15.96:0/4003292376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c0f7080 secure :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 rx=0x7fa910004660 tx=0x7fa910009b30).stop 2022-02-02T22:32:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 -- 172.21.15.96:0/4003292376 shutdown_connections 2022-02-02T22:32:40.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 --2- 172.21.15.96:0/4003292376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 0x7fa91c0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:32:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 --2- 172.21.15.96:0/4003292376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c0f7080 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 -- 172.21.15.96:0/4003292376 >> 172.21.15.96:0/4003292376 conn(0x7fa91c0f04c0 msgr2=0x7fa91c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:40.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 -- 172.21.15.96:0/4003292376 shutdown_connections 2022-02-02T22:32:40.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.050+0000 7fa922b48700 1 -- 172.21.15.96:0/4003292376 wait complete. 2022-02-02T22:32:40.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 Processor -- start 2022-02-02T22:32:40.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 -- start start 2022-02-02T22:32:40.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 0x7fa91c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:40.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:40.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c1069f0 con 0x7fa91c0f6c60 2022-02-02T22:32:40.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa922b48700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c107160 con 0x7fa91c0f5970 2022-02-02T22:32:40.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:40.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49048/0 (socket says 172.21.15.96:49048) 2022-02-02T22:32:40.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa91bfff700 1 -- 172.21.15.96:0/112414073 learned_addr learned my addr 172.21.15.96:0/112414073 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:32:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.051+0000 7fa9208e4700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 0x7fa91c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa91bfff700 1 -- 172.21.15.96:0/112414073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 msgr2=0x7fa91c105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:40.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa91bfff700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 0x7fa91c105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa91bfff700 1 -- 172.21.15.96:0/112414073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910005040 con 0x7fa91c0f6c60 2022-02-02T22:32:40.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa91bfff700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 secure :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 rx=0x7fa90800b410 tx=0x7fa908006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:40.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9080125f0 con 0x7fa91c0f6c60 2022-02-02T22:32:40.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c107440 con 0x7fa91c0f6c60 2022-02-02T22:32:40.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.052+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c107a00 con 0x7fa91c0f6c60 2022-02-02T22:32:40.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.053+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa90800be30 con 0x7fa91c0f6c60 2022-02-02T22:32:40.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.053+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908002a70 con 0x7fa91c0f6c60 2022-02-02T22:32:40.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.053+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa90800f030 con 0x7fa91c0f6c60 2022-02-02T22:32:40.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.054+0000 7fa9197fa700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 0x7fa90c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:32:40.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.054+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c0f4150 con 0x7fa91c0f6c60 2022-02-02T22:32:40.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.054+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa908082da0 con 0x7fa91c0f6c60 2022-02-02T22:32:40.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.054+0000 7fa9208e4700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 0x7fa90c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:32:40.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.054+0000 7fa9208e4700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 0x7fa90c067290 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7fa910004630 tx=0x7fa910009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:32:40.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.059+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa908054970 con 0x7fa91c0f6c60 2022-02-02T22:32:40.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.259+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa91c0ff8d0 con 0x7fa91c0f6c60 2022-02-02T22:32:40.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.260+0000 7fa9197fa700 1 -- 172.21.15.96:0/112414073 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa908054560 con 0x7fa91c0f6c60 2022-02-02T22:32:40.363 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:32:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:32:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:32:40.364 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:32:40.365 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:32:40.365 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:32:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:32:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:32:40.366 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:32:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:32:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:32:40.367 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:32:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:32:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:32:40.368 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:32:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:32:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:32:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:32:40.370 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:32:40.370 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:32:40.371 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:32:40.371 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:32:40.371 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:32:40.372 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:32:40.372 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:32:40.372 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:32:40.372 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:32:40.373 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:32:40.373 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:32:40.373 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:32:40.374 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:32:40.374 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:40.374 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:40.375 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:32:40.375 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:32:40.375 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:40.376 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:40.376 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:32:40.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 msgr2=0x7fa90c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:40.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 0x7fa90c067290 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7fa910004630 tx=0x7fa910009b30).stop 2022-02-02T22:32:40.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 msgr2=0x7fa91c1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:32:40.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 secure :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 rx=0x7fa90800b410 tx=0x7fa908006ef0).stop 2022-02-02T22:32:40.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 shutdown_connections 2022-02-02T22:32:40.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa90c064dd0 0x7fa90c067290 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:40.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa91c0f5970 0x7fa91c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:40.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 --2- 172.21.15.96:0/112414073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0f6c60 0x7fa91c1063b0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:32:40.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 >> 172.21.15.96:0/112414073 conn(0x7fa91c0f04c0 msgr2=0x7fa91c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:32:40.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 shutdown_connections 2022-02-02T22:32:40.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:32:40.262+0000 7fa922b48700 1 -- 172.21.15.96:0/112414073 wait complete. 2022-02-02T22:32:40.381 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:32:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:40 smithi159 ceph-mon[69013]: pgmap v7516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:40 smithi159 ceph-mon[69013]: from='client.41798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:40 smithi159 ceph-mon[69013]: from='client.41802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2084557131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:32:41.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:40 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/112414073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:32:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:40 smithi096 ceph-mon[101353]: pgmap v7516: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:40 smithi096 ceph-mon[101353]: from='client.41798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:40 smithi096 ceph-mon[101353]: from='client.41802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:32:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2084557131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:32:41.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:40 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/112414073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:32:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:42 smithi159 ceph-mon[69013]: pgmap v7517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:42 smithi096 ceph-mon[101353]: pgmap v7517: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:44 smithi159 ceph-mon[69013]: pgmap v7518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:44 smithi096 ceph-mon[101353]: pgmap v7518: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:46 smithi159 ceph-mon[69013]: pgmap v7519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:46 smithi096 ceph-mon[101353]: pgmap v7519: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:48 smithi159 ceph-mon[69013]: pgmap v7520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:48 smithi096 ceph-mon[101353]: pgmap v7520: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:50 smithi096 ceph-mon[101353]: pgmap v7521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:50 smithi159 ceph-mon[69013]: pgmap v7521: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:52 smithi096 ceph-mon[101353]: pgmap v7522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:52 smithi159 ceph-mon[69013]: pgmap v7522: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:54 smithi096 ceph-mon[101353]: pgmap v7523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:54 smithi159 ceph-mon[69013]: pgmap v7523: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:56 smithi096 ceph-mon[101353]: pgmap v7524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:56 smithi159 ceph-mon[69013]: pgmap v7524: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:32:58 smithi096 ceph-mon[101353]: pgmap v7525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:32:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:32:58 smithi159 ceph-mon[69013]: pgmap v7525: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:00 smithi096 ceph-mon[101353]: pgmap v7526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:00 smithi159 ceph-mon[69013]: pgmap v7526: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:02 smithi096 ceph-mon[101353]: pgmap v7527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:02 smithi159 ceph-mon[69013]: pgmap v7527: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:04 smithi096 ceph-mon[101353]: pgmap v7528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:04 smithi159 ceph-mon[69013]: pgmap v7528: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:07.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:06 smithi096 ceph-mon[101353]: pgmap v7529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:07.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:06 smithi159 ceph-mon[69013]: pgmap v7529: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:09.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:08 smithi159 ceph-mon[69013]: pgmap v7530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:08 smithi096 ceph-mon[101353]: pgmap v7530: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:10.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 -- 172.21.15.96:0/2779783350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 msgr2=0x7f18f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 --2- 172.21.15.96:0/2779783350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f80f6cc0 secure :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 rx=0x7f18e4004660 tx=0x7f18e4009b30).stop 2022-02-02T22:33:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 -- 172.21.15.96:0/2779783350 shutdown_connections 2022-02-02T22:33:10.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 --2- 172.21.15.96:0/2779783350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f80f6cc0 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 --2- 172.21.15.96:0/2779783350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 0x7f18f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 -- 172.21.15.96:0/2779783350 >> 172.21.15.96:0/2779783350 conn(0x7f18f80f0d40 msgr2=0x7f18f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:10.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 -- 172.21.15.96:0/2779783350 shutdown_connections 2022-02-02T22:33:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.373+0000 7f18ff00d700 1 -- 172.21.15.96:0/2779783350 wait complete. 2022-02-02T22:33:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 Processor -- start 2022-02-02T22:33:10.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 -- start start 2022-02-02T22:33:10.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 0x7f18f8109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8109c20 con 0x7f18f80f6860 2022-02-02T22:33:10.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.374+0000 7f18ff00d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8109d60 con 0x7f18f80f55c0 2022-02-02T22:33:10.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49066/0 (socket says 172.21.15.96:49066) 2022-02-02T22:33:10.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 -- 172.21.15.96:0/1545014989 learned_addr learned my addr 172.21.15.96:0/1545014989 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:10.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18fcda9700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 0x7f18f8109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 -- 172.21.15.96:0/1545014989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 msgr2=0x7f18f8109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 0x7f18f8109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 -- 172.21.15.96:0/1545014989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4005040 con 0x7f18f80f6860 2022-02-02T22:33:10.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f7fff700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 secure :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 rx=0x7f18e4009990 tx=0x7f18e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e4018070 con 0x7f18f80f6860 2022-02-02T22:33:10.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f810a6a0 con 0x7f18f80f6860 2022-02-02T22:33:10.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18e4007ba0 con 0x7f18f80f6860 2022-02-02T22:33:10.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e401c3c0 con 0x7f18f80f6860 2022-02-02T22:33:10.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.375+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f810ac00 con 0x7f18f80f6860 2022-02-02T22:33:10.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.376+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8045ad0 con 0x7f18f80f6860 2022-02-02T22:33:10.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.377+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18e401d420 con 0x7f18f80f6860 2022-02-02T22:33:10.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.377+0000 7f18f57fa700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 0x7f18e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.377+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f18e40836a0 con 0x7f18f80f6860 2022-02-02T22:33:10.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.377+0000 7f18fcda9700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 0x7f18e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.378+0000 7f18fcda9700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 0x7f18e8067290 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 rx=0x7f18f80f66c0 tx=0x7f18ec00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.382+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18e4055290 con 0x7f18f80f6860 2022-02-02T22:33:10.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.560+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f80faaa0 con 0x7f18e8064dd0 2022-02-02T22:33:10.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.561+0000 7f18f57fa700 1 -- 172.21.15.96:0/1545014989 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f18f80faaa0 con 0x7f18e8064dd0 2022-02-02T22:33:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 msgr2=0x7f18e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 0x7f18e8067290 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 rx=0x7f18f80f66c0 tx=0x7f18ec00b040).stop 2022-02-02T22:33:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 msgr2=0x7f18f8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 secure :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 rx=0x7f18e4009990 tx=0x7f18e4009b30).stop 2022-02-02T22:33:10.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 shutdown_connections 2022-02-02T22:33:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f18e8064dd0 0x7f18e8067290 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18f80f55c0 0x7f18f8109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 --2- 172.21.15.96:0/1545014989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18f80f6860 0x7f18f8109670 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 >> 172.21.15.96:0/1545014989 conn(0x7f18f80f0d40 msgr2=0x7f18f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 shutdown_connections 2022-02-02T22:33:10.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.563+0000 7f18ff00d700 1 -- 172.21.15.96:0/1545014989 wait complete. 2022-02-02T22:33:10.572 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:33:10.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 -- 172.21.15.96:0/4240182002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f5430 msgr2=0x7fe5b80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 --2- 172.21.15.96:0/4240182002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f5430 0x7fe5b80f5850 secure :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 rx=0x7fe5ac004660 tx=0x7fe5ac009b30).stop 2022-02-02T22:33:10.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 -- 172.21.15.96:0/4240182002 shutdown_connections 2022-02-02T22:33:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 --2- 172.21.15.96:0/4240182002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f66d0 0x7fe5b80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 --2- 172.21.15.96:0/4240182002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f5430 0x7fe5b80f5850 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 -- 172.21.15.96:0/4240182002 >> 172.21.15.96:0/4240182002 conn(0x7fe5b80f0b90 msgr2=0x7fe5b80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:10.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.660+0000 7fe5b759e700 1 -- 172.21.15.96:0/4240182002 shutdown_connections 2022-02-02T22:33:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 -- 172.21.15.96:0/4240182002 wait complete. 2022-02-02T22:33:10.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 Processor -- start 2022-02-02T22:33:10.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 -- start start 2022-02-02T22:33:10.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 0x7fe5b8109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80603c0 con 0x7fe5b80f66d0 2022-02-02T22:33:10.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.663+0000 7fe5b759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8060500 con 0x7fe5b80f5430 2022-02-02T22:33:10.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49076/0 (socket says 172.21.15.96:49076) 2022-02-02T22:33:10.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 -- 172.21.15.96:0/1020339240 learned_addr learned my addr 172.21.15.96:0/1020339240 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:10.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b659c700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 0x7fe5b8109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 -- 172.21.15.96:0/1020339240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 msgr2=0x7fe5b8109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 0x7fe5b8109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 -- 172.21.15.96:0/1020339240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac005040 con 0x7fe5b80f66d0 2022-02-02T22:33:10.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b659c700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 0x7fe5b8109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:33:10.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b5d9b700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 secure :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 rx=0x7fe5a800c510 tx=0x7fe5a8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a800f650 con 0x7fe5b80f66d0 2022-02-02T22:33:10.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b810c5a0 con 0x7fe5b80f66d0 2022-02-02T22:33:10.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe5a800fc60 con 0x7fe5b80f66d0 2022-02-02T22:33:10.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a8012d00 con 0x7fe5b80f66d0 2022-02-02T22:33:10.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.664+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b810cb30 con 0x7fe5b80f66d0 2022-02-02T22:33:10.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.665+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b8059100 con 0x7fe5b80f66d0 2022-02-02T22:33:10.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.666+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe5a8010070 con 0x7fe5b80f66d0 2022-02-02T22:33:10.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.666+0000 7fe5a6ffd700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 0x7fe5a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.666+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5a8081820 con 0x7fe5b80f66d0 2022-02-02T22:33:10.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.666+0000 7fe5b659c700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 0x7fe5a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.666+0000 7fe5b659c700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 0x7fe5a00672e0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7fe5ac004e30 tx=0x7fe5ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.670+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe5a804f920 con 0x7fe5b80f66d0 2022-02-02T22:33:10.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.843+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5b80fdd80 con 0x7fe5a0064e20 2022-02-02T22:33:10.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.852+0000 7fe5a6ffd700 1 -- 172.21.15.96:0/1020339240 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe5b80fdd80 con 0x7fe5a0064e20 2022-02-02T22:33:10.854 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:33:10.854 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:33:10.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:33:10.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:33:10.856 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:33:10.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:33:10.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:33:10.857 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:33:10.857 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:33:10.857 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:33:10.858 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:33:10.858 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:33:10.858 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:33:10.859 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:33:10.920 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:33:10.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:33:10.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:33:10.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:33:10.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:33:10.922 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:33:10.922 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:33:10.923 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:33:10.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 msgr2=0x7fe5a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 0x7fe5a00672e0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7fe5ac004e30 tx=0x7fe5ac009b30).stop 2022-02-02T22:33:10.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 msgr2=0x7fe5b810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 secure :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 rx=0x7fe5a800c510 tx=0x7fe5a8007e00).stop 2022-02-02T22:33:10.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 shutdown_connections 2022-02-02T22:33:10.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe5a0064e20 0x7fe5a00672e0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5b80f5430 0x7fe5b8109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 --2- 172.21.15.96:0/1020339240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5b80f66d0 0x7fe5b810bff0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 >> 172.21.15.96:0/1020339240 conn(0x7fe5b80f0b90 msgr2=0x7fe5b80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 shutdown_connections 2022-02-02T22:33:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.854+0000 7fe5b759e700 1 -- 172.21.15.96:0/1020339240 wait complete. 2022-02-02T22:33:10.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 -- 172.21.15.96:0/2558098891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f6860 msgr2=0x7fe0140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 --2- 172.21.15.96:0/2558098891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f6860 0x7fe0140f6cc0 secure :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 rx=0x7fe004004660 tx=0x7fe004009b30).stop 2022-02-02T22:33:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 -- 172.21.15.96:0/2558098891 shutdown_connections 2022-02-02T22:33:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 --2- 172.21.15.96:0/2558098891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f6860 0x7fe0140f6cc0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 --2- 172.21.15.96:0/2558098891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f55c0 0x7fe0140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:33:10.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 -- 172.21.15.96:0/2558098891 >> 172.21.15.96:0/2558098891 conn(0x7fe0140f0d20 msgr2=0x7fe0140f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:10.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 -- 172.21.15.96:0/2558098891 shutdown_connections 2022-02-02T22:33:10.956 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:10 smithi096 ceph-mon[101353]: pgmap v7531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:10.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.952+0000 7fe019470700 1 -- 172.21.15.96:0/2558098891 wait complete. 2022-02-02T22:33:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 Processor -- start 2022-02-02T22:33:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 -- start start 2022-02-02T22:33:10.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f6860 0x7fe014109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014109cd0 con 0x7fe0140f55c0 2022-02-02T22:33:10.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe019470700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01410a580 con 0x7fe0140f6860 2022-02-02T22:33:10.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49084/0 (socket says 172.21.15.96:49084) 2022-02-02T22:33:10.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 -- 172.21.15.96:0/3165382779 learned_addr learned my addr 172.21.15.96:0/3165382779 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:10.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe0127fc700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f6860 0x7fe014109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 -- 172.21.15.96:0/3165382779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f6860 msgr2=0x7fe014109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:10.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f6860 0x7fe014109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:10.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.953+0000 7fe012ffd700 1 -- 172.21.15.96:0/3165382779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004005040 con 0x7fe0140f55c0 2022-02-02T22:33:10.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fe012ffd700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 secure :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 rx=0x7fe0080093f0 tx=0x7fe008006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe008009ea0 con 0x7fe0140f55c0 2022-02-02T22:33:10.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01410a860 con 0x7fe0140f55c0 2022-02-02T22:33:10.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01410ae20 con 0x7fe0140f55c0 2022-02-02T22:33:10.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe008013af0 con 0x7fe0140f55c0 2022-02-02T22:33:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.954+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00800db10 con 0x7fe0140f55c0 2022-02-02T22:33:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.955+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff4004fa0 con 0x7fe0140f55c0 2022-02-02T22:33:10.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.955+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe00801a060 con 0x7fe0140f55c0 2022-02-02T22:33:10.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.956+0000 7fdffb7fe700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 0x7fdffc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:10.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.956+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0080818f0 con 0x7fe0140f55c0 2022-02-02T22:33:10.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.956+0000 7fe0127fc700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 0x7fdffc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:10.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.956+0000 7fe0127fc700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 0x7fdffc067290 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 rx=0x7fe004004e30 tx=0x7fe004009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:10.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:10.960+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0080533c0 con 0x7fe0140f55c0 2022-02-02T22:33:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.190+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdff4005e80 con 0x7fe0140f55c0 2022-02-02T22:33:11.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.190+0000 7fdffb7fe700 1 -- 172.21.15.96:0/3165382779 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe008052fb0 con 0x7fe0140f55c0 2022-02-02T22:33:11.192 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:33:11.192 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:33:11.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:33:11.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:11.193 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:33:11.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:33:11.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:11.194 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:33:11.195 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:33:11.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:11.195 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:33:11.196 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:33:11.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:11.196 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:33:11.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:33:11.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:33:11.197 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:33:11.198 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:33:11.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 msgr2=0x7fdffc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 0x7fdffc067290 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 rx=0x7fe004004e30 tx=0x7fe004009b30).stop 2022-02-02T22:33:11.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 msgr2=0x7fe0141091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 secure :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 rx=0x7fe0080093f0 tx=0x7fe008006ec0).stop 2022-02-02T22:33:11.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 shutdown_connections 2022-02-02T22:33:11.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdffc064dd0 0x7fdffc067290 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0140f55c0 0x7fe0141091a0 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 --2- 172.21.15.96:0/3165382779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0140f6860 0x7fe014109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 >> 172.21.15.96:0/3165382779 conn(0x7fe0140f0d20 msgr2=0x7fe01405ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:11.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 shutdown_connections 2022-02-02T22:33:11.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.192+0000 7fe019470700 1 -- 172.21.15.96:0/3165382779 wait complete. 2022-02-02T22:33:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:10 smithi159 ceph-mon[69013]: pgmap v7531: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:11.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 -- 172.21.15.96:0/3269906817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 msgr2=0x7fb4680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 --2- 172.21.15.96:0/3269906817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4680f6cc0 secure :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 rx=0x7fb464004660 tx=0x7fb464009b30).stop 2022-02-02T22:33:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 -- 172.21.15.96:0/3269906817 shutdown_connections 2022-02-02T22:33:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 --2- 172.21.15.96:0/3269906817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4680f6cc0 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 --2- 172.21.15.96:0/3269906817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 0x7fb4680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 -- 172.21.15.96:0/3269906817 >> 172.21.15.96:0/3269906817 conn(0x7fb4680f0d40 msgr2=0x7fb4680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:11.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 -- 172.21.15.96:0/3269906817 shutdown_connections 2022-02-02T22:33:11.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.289+0000 7fb46f480700 1 -- 172.21.15.96:0/3269906817 wait complete. 2022-02-02T22:33:11.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 Processor -- start 2022-02-02T22:33:11.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 -- start start 2022-02-02T22:33:11.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 0x7fb468105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:11.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:11.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4681069b0 con 0x7fb4680f6860 2022-02-02T22:33:11.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46f480700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4681071c0 con 0x7fb4680f55c0 2022-02-02T22:33:11.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46ca1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:11.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46ca1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49094/0 (socket says 172.21.15.96:49094) 2022-02-02T22:33:11.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46ca1b700 1 -- 172.21.15.96:0/1445129194 learned_addr learned my addr 172.21.15.96:0/1445129194 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:11.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.290+0000 7fb46d21c700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 0x7fb468105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:11.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46ca1b700 1 -- 172.21.15.96:0/1445129194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 msgr2=0x7fb468105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46ca1b700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 0x7fb468105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46ca1b700 1 -- 172.21.15.96:0/1445129194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464005040 con 0x7fb4680f6860 2022-02-02T22:33:11.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46ca1b700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 secure :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 rx=0x7fb464009990 tx=0x7fb464009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:11.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb464018070 con 0x7fb4680f6860 2022-02-02T22:33:11.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4681073e0 con 0x7fb4680f6860 2022-02-02T22:33:11.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb464007ba0 con 0x7fb4680f6860 2022-02-02T22:33:11.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb46401c3c0 con 0x7fb4680f6860 2022-02-02T22:33:11.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.291+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb468107940 con 0x7fb4680f6860 2022-02-02T22:33:11.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb46401d420 con 0x7fb4680f6860 2022-02-02T22:33:11.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb459ffb700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:11.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb4640836a0 con 0x7fb4680f6860 2022-02-02T22:33:11.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4680f49b0 con 0x7fb4680f6860 2022-02-02T22:33:11.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb46d21c700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:11.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.293+0000 7fb46d21c700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x7fb468105c30 tx=0x7fb45c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:11.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.298+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb464051860 con 0x7fb4680f6860 2022-02-02T22:33:11.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.502+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4680fdec0 con 0x7fb4680f6860 2022-02-02T22:33:11.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.502+0000 7fb459ffb700 1 -- 172.21.15.96:0/1445129194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb464054e80 con 0x7fb4680f6860 2022-02-02T22:33:11.505 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:33:11.505 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:33:11.505 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:33:11.506 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:33:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:11.507 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:33:11.507 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:33:11.507 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:33:11.508 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:33:11.508 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:33:11.508 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:33:11.509 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:33:11.509 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:33:11.509 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:33:11.510 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:33:11.510 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:33:11.511 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:33:11.511 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:33:11.511 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:33:11.512 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:33:11.512 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:33:11.512 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:33:11.513 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:33:11.513 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:33:11.514 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:33:11.514 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:33:11.514 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:33:11.515 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:33:11.515 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:33:11.515 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:33:11.516 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:33:11.516 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:33:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:11.517 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:33:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:11.518 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:11.518 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:11.518 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:11.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.504+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 msgr2=0x7fb454067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.504+0000 7fb46f480700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x7fb468105c30 tx=0x7fb45c00b040).stop 2022-02-02T22:33:11.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.504+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 msgr2=0x7fb4681063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.504+0000 7fb46f480700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 secure :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 rx=0x7fb464009990 tx=0x7fb464009b30).stop 2022-02-02T22:33:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 shutdown_connections 2022-02-02T22:33:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb454064dd0 0x7fb454067290 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4680f55c0 0x7fb468105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 --2- 172.21.15.96:0/1445129194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4680f6860 0x7fb4681063b0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:11.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 >> 172.21.15.96:0/1445129194 conn(0x7fb4680f0d40 msgr2=0x7fb4680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:11.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 shutdown_connections 2022-02-02T22:33:11.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:11.505+0000 7fb46f480700 1 -- 172.21.15.96:0/1445129194 wait complete. 2022-02-02T22:33:11.523 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:33:12.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:11 smithi159 ceph-mon[69013]: from='client.41814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:12.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:11 smithi159 ceph-mon[69013]: from='client.41818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3165382779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:33:12.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1445129194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:33:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:11 smithi096 ceph-mon[101353]: from='client.41814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:12.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:11 smithi096 ceph-mon[101353]: from='client.41818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:12.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3165382779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:33:12.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1445129194' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:33:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:12 smithi096 ceph-mon[101353]: pgmap v7532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:12 smithi159 ceph-mon[69013]: pgmap v7532: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:14 smithi159 ceph-mon[69013]: pgmap v7533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:14 smithi096 ceph-mon[101353]: pgmap v7533: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:16 smithi159 ceph-mon[69013]: pgmap v7534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:16 smithi096 ceph-mon[101353]: pgmap v7534: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:18 smithi159 ceph-mon[69013]: pgmap v7535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:18 smithi096 ceph-mon[101353]: pgmap v7535: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:21.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:20 smithi159 ceph-mon[69013]: pgmap v7536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:20 smithi096 ceph-mon[101353]: pgmap v7536: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:22 smithi096 ceph-mon[101353]: pgmap v7537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:22 smithi159 ceph-mon[69013]: pgmap v7537: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:24 smithi159 ceph-mon[69013]: pgmap v7538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:24 smithi096 ceph-mon[101353]: pgmap v7538: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:26 smithi159 ceph-mon[69013]: pgmap v7539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:26 smithi096 ceph-mon[101353]: pgmap v7539: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:28 smithi159 ceph-mon[69013]: pgmap v7540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:33:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:33:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:28 smithi096 ceph-mon[101353]: pgmap v7540: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:33:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:33:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:30 smithi159 ceph-mon[69013]: pgmap v7541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:30 smithi096 ceph-mon[101353]: pgmap v7541: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:32 smithi096 ceph-mon[101353]: pgmap v7542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:32 smithi159 ceph-mon[69013]: pgmap v7542: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:34 smithi159 ceph-mon[69013]: pgmap v7543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:34 smithi096 ceph-mon[101353]: pgmap v7543: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:37.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:36 smithi159 ceph-mon[69013]: pgmap v7544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:36 smithi096 ceph-mon[101353]: pgmap v7544: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:38 smithi159 ceph-mon[69013]: pgmap v7545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:38 smithi096 ceph-mon[101353]: pgmap v7545: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:40 smithi159 ceph-mon[69013]: pgmap v7546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:40 smithi096 ceph-mon[101353]: pgmap v7546: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:41.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 -- 172.21.15.96:0/3026492147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 msgr2=0x7f4c140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 --2- 172.21.15.96:0/3026492147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c140f5850 secure :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 rx=0x7f4c08004660 tx=0x7f4c08009b30).stop 2022-02-02T22:33:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 -- 172.21.15.96:0/3026492147 shutdown_connections 2022-02-02T22:33:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 --2- 172.21.15.96:0/3026492147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 0x7f4c140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 --2- 172.21.15.96:0/3026492147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c140f5850 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 -- 172.21.15.96:0/3026492147 >> 172.21.15.96:0/3026492147 conn(0x7f4c140f0b90 msgr2=0x7f4c140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 -- 172.21.15.96:0/3026492147 shutdown_connections 2022-02-02T22:33:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.616+0000 7f4c13fff700 1 -- 172.21.15.96:0/3026492147 wait complete. 2022-02-02T22:33:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 Processor -- start 2022-02-02T22:33:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 -- start start 2022-02-02T22:33:41.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 0x7f4c1410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140603e0 con 0x7f4c140f5430 2022-02-02T22:33:41.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c13fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14060520 con 0x7f4c140f66d0 2022-02-02T22:33:41.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49110/0 (socket says 172.21.15.96:49110) 2022-02-02T22:33:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 -- 172.21.15.96:0/1262413077 learned_addr learned my addr 172.21.15.96:0/1262413077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:41.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c127fc700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 0x7f4c1410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 -- 172.21.15.96:0/1262413077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 msgr2=0x7f4c1410bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 0x7f4c1410bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 -- 172.21.15.96:0/1262413077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005040 con 0x7f4c140f5430 2022-02-02T22:33:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.617+0000 7f4c12ffd700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 secure :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 rx=0x7f4c08013a70 tx=0x7f4c08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.618+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c08018070 con 0x7f4c140f5430 2022-02-02T22:33:41.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.618+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c080097d0 con 0x7f4c140f5430 2022-02-02T22:33:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.618+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c0801de80 con 0x7f4c140f5430 2022-02-02T22:33:41.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.618+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1410c4e0 con 0x7f4c140f5430 2022-02-02T22:33:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.618+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1410ca40 con 0x7f4c140f5430 2022-02-02T22:33:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.619+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c14045ad0 con 0x7f4c140f5430 2022-02-02T22:33:41.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.619+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c08007ba0 con 0x7f4c140f5430 2022-02-02T22:33:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.620+0000 7f4bfb7fe700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 0x7f4bfc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.620+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4c08083660 con 0x7f4c140f5430 2022-02-02T22:33:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.620+0000 7f4c127fc700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 0x7f4bfc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.620+0000 7f4c127fc700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 0x7f4bfc0672e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 rx=0x7f4c04004c40 tx=0x7f4c0400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.624+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c08051760 con 0x7f4c140f5430 2022-02-02T22:33:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.803+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c140fdda0 con 0x7f4bfc064e20 2022-02-02T22:33:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.804+0000 7f4bfb7fe700 1 -- 172.21.15.96:0/1262413077 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4c0400f040 con 0x7f4bfc064e20 2022-02-02T22:33:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 msgr2=0x7f4bfc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 0x7f4bfc0672e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 rx=0x7f4c04004c40 tx=0x7f4c0400b040).stop 2022-02-02T22:33:41.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 msgr2=0x7f4c14109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 secure :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 rx=0x7f4c08013a70 tx=0x7f4c08009b30).stop 2022-02-02T22:33:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 shutdown_connections 2022-02-02T22:33:41.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bfc064e20 0x7f4bfc0672e0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c140f5430 0x7f4c14109a90 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 --2- 172.21.15.96:0/1262413077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c140f66d0 0x7f4c1410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 >> 172.21.15.96:0/1262413077 conn(0x7f4c140f0b90 msgr2=0x7f4c140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:41.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 shutdown_connections 2022-02-02T22:33:41.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.806+0000 7f4c13fff700 1 -- 172.21.15.96:0/1262413077 wait complete. 2022-02-02T22:33:41.816 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:33:41.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 -- 172.21.15.96:0/3296968289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f6530 msgr2=0x7f491c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 --2- 172.21.15.96:0/3296968289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f6530 0x7f491c0f6950 secure :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 rx=0x7f490c004660 tx=0x7f490c009b30).stop 2022-02-02T22:33:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 -- 172.21.15.96:0/3296968289 shutdown_connections 2022-02-02T22:33:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 --2- 172.21.15.96:0/3296968289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f77d0 0x7f491c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 --2- 172.21.15.96:0/3296968289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f6530 0x7f491c0f6950 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 -- 172.21.15.96:0/3296968289 >> 172.21.15.96:0/3296968289 conn(0x7f491c0f1c90 msgr2=0x7f491c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:41.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 -- 172.21.15.96:0/3296968289 shutdown_connections 2022-02-02T22:33:41.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.905+0000 7f491bfff700 1 -- 172.21.15.96:0/3296968289 wait complete. 2022-02-02T22:33:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.906+0000 7f491bfff700 1 Processor -- start 2022-02-02T22:33:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.906+0000 7f491bfff700 1 -- start start 2022-02-02T22:33:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 0x7f491c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491bfff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06a380 con 0x7f491c0f77d0 2022-02-02T22:33:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06a4c0 con 0x7f491c0f6530 2022-02-02T22:33:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49122/0 (socket says 172.21.15.96:49122) 2022-02-02T22:33:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 -- 172.21.15.96:0/2645291515 learned_addr learned my addr 172.21.15.96:0/2645291515 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491affd700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 0x7f491c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 -- 172.21.15.96:0/2645291515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 msgr2=0x7f491c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 0x7f491c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 -- 172.21.15.96:0/2645291515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c005040 con 0x7f491c0f77d0 2022-02-02T22:33:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491affd700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 0x7f491c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:33:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491a7fc700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 secure :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 rx=0x7f491000c790 tx=0x7f4910007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491000e680 con 0x7f491c0f77d0 2022-02-02T22:33:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c06a7a0 con 0x7f491c0f77d0 2022-02-02T22:33:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.907+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f491000ec90 con 0x7f491c0f77d0 2022-02-02T22:33:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.908+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4910013d60 con 0x7f491c0f77d0 2022-02-02T22:33:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.908+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c10edc0 con 0x7f491c0f77d0 2022-02-02T22:33:41.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.908+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c045ad0 con 0x7f491c0f77d0 2022-02-02T22:33:41.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.909+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f491001a060 con 0x7f491c0f77d0 2022-02-02T22:33:41.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.909+0000 7f49037fe700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 0x7f49040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:41.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.909+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4910081d50 con 0x7f491c0f77d0 2022-02-02T22:33:41.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.909+0000 7f491affd700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 0x7f49040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:41.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.910+0000 7f491affd700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 0x7f49040672e0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f490c004e30 tx=0x7f490c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:41.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:41.914+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f491004fd90 con 0x7f491c0f77d0 2022-02-02T22:33:42.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.086+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f491c057f10 con 0x7f4904064e20 2022-02-02T22:33:42.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.095+0000 7f49037fe700 1 -- 172.21.15.96:0/2645291515 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f491c057f10 con 0x7f4904064e20 2022-02-02T22:33:42.096 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:33:42.096 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:33:42.096 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:33:42.097 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:33:42.097 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:33:42.097 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:33:42.098 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:33:42.098 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:33:42.098 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:33:42.099 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:33:42.099 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:33:42.099 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:33:42.100 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:33:42.100 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:33:42.100 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:33:42.101 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:33:42.101 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:33:42.102 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:33:42.102 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:33:42.103 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:33:42.103 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:33:42.104 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:33:42.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 msgr2=0x7f49040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 0x7f49040672e0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f490c004e30 tx=0x7f490c009b30).stop 2022-02-02T22:33:42.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 msgr2=0x7f491c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 secure :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 rx=0x7f491000c790 tx=0x7f4910007d70).stop 2022-02-02T22:33:42.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 shutdown_connections 2022-02-02T22:33:42.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4904064e20 0x7f49040672e0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f491c0f6530 0x7f491c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 --2- 172.21.15.96:0/2645291515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f491c0f77d0 0x7f491c069e20 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.097+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 >> 172.21.15.96:0/2645291515 conn(0x7f491c0f1c90 msgr2=0x7f491c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:42.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.098+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 shutdown_connections 2022-02-02T22:33:42.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.098+0000 7f491bfff700 1 -- 172.21.15.96:0/2645291515 wait complete. 2022-02-02T22:33:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 -- 172.21.15.96:0/1876341351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 msgr2=0x7f3a5c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1876341351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c0f5860 secure :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 rx=0x7f3a4c004660 tx=0x7f3a4c009b30).stop 2022-02-02T22:33:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 -- 172.21.15.96:0/1876341351 shutdown_connections 2022-02-02T22:33:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1876341351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1876341351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c0f5860 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 -- 172.21.15.96:0/1876341351 >> 172.21.15.96:0/1876341351 conn(0x7f3a5c0f0ba0 msgr2=0x7f3a5c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:42.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.194+0000 7f3a6170e700 1 -- 172.21.15.96:0/1876341351 shutdown_connections 2022-02-02T22:33:42.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.195+0000 7f3a6170e700 1 -- 172.21.15.96:0/1876341351 wait complete. 2022-02-02T22:33:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.195+0000 7f3a6170e700 1 Processor -- start 2022-02-02T22:33:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a6170e700 1 -- start start 2022-02-02T22:33:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a6170e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a6170e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a6170e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0603e0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a6170e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c060520 con 0x7f3a5c0f66e0 2022-02-02T22:33:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49130/0 (socket says 172.21.15.96:49130) 2022-02-02T22:33:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 -- 172.21.15.96:0/1725294739 learned_addr learned my addr 172.21.15.96:0/1725294739 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5b7fe700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 -- 172.21.15.96:0/1725294739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 msgr2=0x7f3a5c10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 -- 172.21.15.96:0/1725294739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c005040 con 0x7f3a5c0f5440 2022-02-02T22:33:42.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.196+0000 7f3a5bfff700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 secure :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 rx=0x7f3a4c013a70 tx=0x7f3a4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:42.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4c018070 con 0x7f3a5c0f5440 2022-02-02T22:33:42.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c10c4e0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a4c0097d0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4c01de80 con 0x7f3a5c0f5440 2022-02-02T22:33:42.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c10ca40 con 0x7f3a5c0f5440 2022-02-02T22:33:42.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.197+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c045ad0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.199+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a4c007ba0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.199+0000 7f3a58ff9700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 0x7f3a440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.199+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3a4c083c30 con 0x7f3a5c0f5440 2022-02-02T22:33:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.199+0000 7f3a5b7fe700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 0x7f3a440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.200+0000 7f3a5b7fe700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 0x7f3a440672e0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 rx=0x7f3a50004c40 tx=0x7f3a5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:42.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.202+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a4c051df0 con 0x7f3a5c0f5440 2022-02-02T22:33:42.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.445+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a5c0fdd80 con 0x7f3a5c0f5440 2022-02-02T22:33:42.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.445+0000 7f3a58ff9700 1 -- 172.21.15.96:0/1725294739 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3a4c055410 con 0x7f3a5c0f5440 2022-02-02T22:33:42.446 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:33:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:33:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:33:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:33:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:33:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:33:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:33:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:33:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:33:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:33:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:33:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:33:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:33:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:33:42.452 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:33:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 msgr2=0x7f3a440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 0x7f3a440672e0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 rx=0x7f3a50004c40 tx=0x7f3a5000b040).stop 2022-02-02T22:33:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 msgr2=0x7f3a5c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 secure :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 rx=0x7f3a4c013a70 tx=0x7f3a4c009b30).stop 2022-02-02T22:33:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 shutdown_connections 2022-02-02T22:33:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3a44064e20 0x7f3a440672e0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a5c0f5440 0x7f3a5c109a90 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 --2- 172.21.15.96:0/1725294739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 >> 172.21.15.96:0/1725294739 conn(0x7f3a5c0f0ba0 msgr2=0x7f3a5c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:42.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 shutdown_connections 2022-02-02T22:33:42.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.448+0000 7f3a6170e700 1 -- 172.21.15.96:0/1725294739 wait complete. 2022-02-02T22:33:42.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/2839774070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 msgr2=0x7f7b280f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/2839774070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b280f7de0 secure :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 rx=0x7f7b14004660 tx=0x7f7b14009b30).stop 2022-02-02T22:33:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/2839774070 shutdown_connections 2022-02-02T22:33:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/2839774070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b280f7de0 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/2839774070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/2839774070 >> 172.21.15.96:0/2839774070 conn(0x7f7b280f1e40 msgr2=0x7f7b280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/2839774070 shutdown_connections 2022-02-02T22:33:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.546+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/2839774070 wait complete. 2022-02-02T22:33:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 Processor -- start 2022-02-02T22:33:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 -- start start 2022-02-02T22:33:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b28106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b281079b0 con 0x7f7b280f7980 2022-02-02T22:33:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2f1ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28107af0 con 0x7f7b280f66e0 2022-02-02T22:33:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49142/0 (socket says 172.21.15.96:49142) 2022-02-02T22:33:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 -- 172.21.15.96:0/1170327767 learned_addr learned my addr 172.21.15.96:0/1170327767 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:33:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b2cf89700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b28106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 -- 172.21.15.96:0/1170327767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 msgr2=0x7f7b28106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b28106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.547+0000 7f7b27fff700 1 -- 172.21.15.96:0/1170327767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14005040 con 0x7f7b280f7980 2022-02-02T22:33:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b27fff700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 secure :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 rx=0x7f7b14000c00 tx=0x7f7b1400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14019070 con 0x7f7b280f7980 2022-02-02T22:33:42.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28108430 con 0x7f7b280f7980 2022-02-02T22:33:42.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b14007e70 con 0x7f7b280f7980 2022-02-02T22:33:42.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14014ce0 con 0x7f7b280f7980 2022-02-02T22:33:42.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.548+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28108990 con 0x7f7b280f7980 2022-02-02T22:33:42.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.549+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b28045ad0 con 0x7f7b280f7980 2022-02-02T22:33:42.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.549+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b14025070 con 0x7f7b280f7980 2022-02-02T22:33:42.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.550+0000 7f7b257fa700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:33:42.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.550+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7b140829e0 con 0x7f7b280f7980 2022-02-02T22:33:42.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.550+0000 7f7b2cf89700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:33:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.550+0000 7f7b2cf89700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f7b1c009fd0 tx=0x7f7b1c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:33:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.554+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b14054510 con 0x7f7b280f7980 2022-02-02T22:33:42.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.755+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b28027a00 con 0x7f7b280f7980 2022-02-02T22:33:42.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.755+0000 7f7b257fa700 1 -- 172.21.15.96:0/1170327767 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7b14023020 con 0x7f7b280f7980 2022-02-02T22:33:42.756 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:33:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:33:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:33:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:33:42.758 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:33:42.758 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:33:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:33:42.759 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:33:42.760 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:33:42.760 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:33:42.760 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:33:42.761 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:33:42.761 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:33:42.762 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:33:42.762 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:33:42.762 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:33:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:33:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:33:42.763 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:33:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:33:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:33:42.764 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:33:42.765 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:33:42.765 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:33:42.765 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:33:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:33:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:33:42.766 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:33:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:33:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:33:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:33:42.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:42.768 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:42.768 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:33:42.769 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:33:42.769 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:42.770 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:42.770 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:33:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 msgr2=0x7f7b18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f7b1c009fd0 tx=0x7f7b1c00b040).stop 2022-02-02T22:33:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 msgr2=0x7f7b28107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:33:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 secure :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 rx=0x7f7b14000c00 tx=0x7f7b1400b040).stop 2022-02-02T22:33:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 shutdown_connections 2022-02-02T22:33:42.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7b18064dd0 0x7f7b18067290 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b280f66e0 0x7f7b28106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 --2- 172.21.15.96:0/1170327767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b280f7980 0x7f7b28107400 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:33:42.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 >> 172.21.15.96:0/1170327767 conn(0x7f7b280f1e40 msgr2=0x7f7b280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:33:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 shutdown_connections 2022-02-02T22:33:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:33:42.758+0000 7f7b2f1ed700 1 -- 172.21.15.96:0/1170327767 wait complete. 2022-02-02T22:33:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:33:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:42 smithi096 ceph-mon[101353]: pgmap v7547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:42 smithi096 ceph-mon[101353]: from='client.41830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:43.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1725294739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:33:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1170327767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:33:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:42 smithi159 ceph-mon[69013]: pgmap v7547: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:42 smithi159 ceph-mon[69013]: from='client.41830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1725294739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:33:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1170327767' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:33:44.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:43 smithi159 ceph-mon[69013]: from='client.41834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:44.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:43 smithi096 ceph-mon[101353]: from='client.41834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:33:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:44 smithi159 ceph-mon[69013]: pgmap v7548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:44 smithi096 ceph-mon[101353]: pgmap v7548: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:46 smithi159 ceph-mon[69013]: pgmap v7549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:46 smithi096 ceph-mon[101353]: pgmap v7549: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:48 smithi159 ceph-mon[69013]: pgmap v7550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:48 smithi096 ceph-mon[101353]: pgmap v7550: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:50 smithi159 ceph-mon[69013]: pgmap v7551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:50 smithi096 ceph-mon[101353]: pgmap v7551: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:52 smithi096 ceph-mon[101353]: pgmap v7552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:52 smithi159 ceph-mon[69013]: pgmap v7552: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:54 smithi159 ceph-mon[69013]: pgmap v7553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:54 smithi096 ceph-mon[101353]: pgmap v7553: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:56 smithi159 ceph-mon[69013]: pgmap v7554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:56 smithi096 ceph-mon[101353]: pgmap v7554: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:33:58 smithi159 ceph-mon[69013]: pgmap v7555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:33:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:33:58 smithi096 ceph-mon[101353]: pgmap v7555: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:00 smithi159 ceph-mon[69013]: pgmap v7556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:00 smithi096 ceph-mon[101353]: pgmap v7556: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:02 smithi096 ceph-mon[101353]: pgmap v7557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:02 smithi159 ceph-mon[69013]: pgmap v7557: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:04 smithi159 ceph-mon[69013]: pgmap v7558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:04 smithi096 ceph-mon[101353]: pgmap v7558: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:06 smithi159 ceph-mon[69013]: pgmap v7559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:06 smithi096 ceph-mon[101353]: pgmap v7559: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:09.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:08 smithi159 ceph-mon[69013]: pgmap v7560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:08 smithi096 ceph-mon[101353]: pgmap v7560: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:10 smithi159 ceph-mon[69013]: pgmap v7561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:10 smithi096 ceph-mon[101353]: pgmap v7561: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:12.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- 172.21.15.96:0/3743595012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f55c0 msgr2=0x7f17880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 --2- 172.21.15.96:0/3743595012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f55c0 0x7f17880f59e0 secure :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 rx=0x7f177c004660 tx=0x7f177c009b30).stop 2022-02-02T22:34:13.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- 172.21.15.96:0/3743595012 shutdown_connections 2022-02-02T22:34:13.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 --2- 172.21.15.96:0/3743595012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f6860 0x7f17880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 --2- 172.21.15.96:0/3743595012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f55c0 0x7f17880f59e0 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- 172.21.15.96:0/3743595012 >> 172.21.15.96:0/3743595012 conn(0x7f17880f0d40 msgr2=0x7f17880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- 172.21.15.96:0/3743595012 shutdown_connections 2022-02-02T22:34:13.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- 172.21.15.96:0/3743595012 wait complete. 2022-02-02T22:34:13.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 Processor -- start 2022-02-02T22:34:13.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.868+0000 7f178f155700 1 -- start start 2022-02-02T22:34:13.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f178f155700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f55c0 0x7f17880fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f178f155700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f178f155700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880ff4b0 con 0x7f17880f6860 2022-02-02T22:34:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f178f155700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880ff5f0 con 0x7f17880f55c0 2022-02-02T22:34:13.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49162/0 (socket says 172.21.15.96:49162) 2022-02-02T22:34:13.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 -- 172.21.15.96:0/258329680 learned_addr learned my addr 172.21.15.96:0/258329680 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:13.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f178cef1700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f55c0 0x7f17880fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 -- 172.21.15.96:0/258329680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f55c0 msgr2=0x7f17880fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f55c0 0x7f17880fe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 -- 172.21.15.96:0/258329680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c005040 con 0x7f17880f6860 2022-02-02T22:34:13.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.869+0000 7f1787fff700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 secure :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 rx=0x7f177400c790 tx=0x7f1774007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.870+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1774002590 con 0x7f17880f6860 2022-02-02T22:34:13.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.870+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17880fff60 con 0x7f17880f6860 2022-02-02T22:34:13.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.870+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1774002ba0 con 0x7f17880f6860 2022-02-02T22:34:13.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.870+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1774013d90 con 0x7f17880f6860 2022-02-02T22:34:13.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.870+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788100520 con 0x7f17880f6860 2022-02-02T22:34:13.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.871+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1788045ad0 con 0x7f17880f6860 2022-02-02T22:34:13.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.871+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f177401a060 con 0x7f17880f6860 2022-02-02T22:34:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.871+0000 7f17857fa700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 0x7f1778067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.872+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1774081cc0 con 0x7f17880f6860 2022-02-02T22:34:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.872+0000 7f178cef1700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 0x7f1778067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.872+0000 7f178cef1700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 0x7f1778067290 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 rx=0x7f177c013690 tx=0x7f177c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:12.876+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f177404fd60 con 0x7f17880f6860 2022-02-02T22:34:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.057+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17880faaa0 con 0x7f1778064dd0 2022-02-02T22:34:13.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.058+0000 7f17857fa700 1 -- 172.21.15.96:0/258329680 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f17880faaa0 con 0x7f1778064dd0 2022-02-02T22:34:13.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 msgr2=0x7f1778067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 0x7f1778067290 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 rx=0x7f177c013690 tx=0x7f177c009b30).stop 2022-02-02T22:34:13.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 msgr2=0x7f17880feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 secure :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 rx=0x7f177400c790 tx=0x7f1774007d70).stop 2022-02-02T22:34:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 shutdown_connections 2022-02-02T22:34:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1778064dd0 0x7f1778067290 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17880f55c0 0x7f17880fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 --2- 172.21.15.96:0/258329680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17880f6860 0x7f17880feeb0 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 >> 172.21.15.96:0/258329680 conn(0x7f17880f0d40 msgr2=0x7f178805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 shutdown_connections 2022-02-02T22:34:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.060+0000 7f178f155700 1 -- 172.21.15.96:0/258329680 wait complete. 2022-02-02T22:34:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:34:13.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 -- 172.21.15.96:0/3625380017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f66e0 msgr2=0x7f04e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/3625380017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f66e0 0x7f04e40f6b00 secure :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 rx=0x7f04e0004660 tx=0x7f04e0009b30).stop 2022-02-02T22:34:13.159 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 -- 172.21.15.96:0/3625380017 shutdown_connections 2022-02-02T22:34:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/3625380017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f7980 0x7f04e40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/3625380017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f66e0 0x7f04e40f6b00 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 -- 172.21.15.96:0/3625380017 >> 172.21.15.96:0/3625380017 conn(0x7f04e40f1e40 msgr2=0x7f04e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.161 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:12 smithi096 ceph-mon[101353]: pgmap v7562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 -- 172.21.15.96:0/3625380017 shutdown_connections 2022-02-02T22:34:13.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.158+0000 7f04eb3fa700 1 -- 172.21.15.96:0/3625380017 wait complete. 2022-02-02T22:34:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 Processor -- start 2022-02-02T22:34:13.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 -- start start 2022-02-02T22:34:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f66e0 0x7f04e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e406a380 con 0x7f04e40f7980 2022-02-02T22:34:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04eb3fa700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e406a4c0 con 0x7f04e40f66e0 2022-02-02T22:34:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49172/0 (socket says 172.21.15.96:49172) 2022-02-02T22:34:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 -- 172.21.15.96:0/1149940526 learned_addr learned my addr 172.21.15.96:0/1149940526 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e9196700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f66e0 0x7f04e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 -- 172.21.15.96:0/1149940526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f66e0 msgr2=0x7f04e406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f66e0 0x7f04e406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 -- 172.21.15.96:0/1149940526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04e40f7980 2022-02-02T22:34:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.159+0000 7f04e8995700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 secure :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 rx=0x7f04d80026d0 tx=0x7f04d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.160+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d80079c0 con 0x7f04e40f7980 2022-02-02T22:34:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.160+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e406a7a0 con 0x7f04e40f7980 2022-02-02T22:34:13.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.160+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f04d800f040 con 0x7f04e40f7980 2022-02-02T22:34:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.160+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d80148b0 con 0x7f04e40f7980 2022-02-02T22:34:13.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.160+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e410efe0 con 0x7f04e40f7980 2022-02-02T22:34:13.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.161+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e4045ad0 con 0x7f04e40f7980 2022-02-02T22:34:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.162+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f04d8007b20 con 0x7f04e40f7980 2022-02-02T22:34:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.162+0000 7f04d5ffb700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 0x7f04d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.162+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f04d8081df0 con 0x7f04e40f7980 2022-02-02T22:34:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.162+0000 7f04e9196700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 0x7f04d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.162+0000 7f04e9196700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 0x7f04d0067290 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 rx=0x7f04e0013690 tx=0x7f04e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.165+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f04d804fef0 con 0x7f04e40f7980 2022-02-02T22:34:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:12 smithi159 ceph-mon[69013]: pgmap v7562: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:13.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.339+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04e4057f10 con 0x7f04d0064dd0 2022-02-02T22:34:13.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.348+0000 7f04d5ffb700 1 -- 172.21.15.96:0/1149940526 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f04e4057f10 con 0x7f04d0064dd0 2022-02-02T22:34:13.348 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:34:13.349 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:34:13.349 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:34:13.349 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:34:13.350 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:34:13.350 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:34:13.350 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:34:13.351 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:34:13.351 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:34:13.351 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:34:13.352 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:34:13.352 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:34:13.352 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:34:13.353 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:34:13.353 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:34:13.353 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:34:13.354 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:34:13.354 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:34:13.354 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:34:13.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:34:13.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:34:13.356 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:34:13.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 msgr2=0x7f04d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 0x7f04d0067290 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 rx=0x7f04e0013690 tx=0x7f04e0009b30).stop 2022-02-02T22:34:13.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 msgr2=0x7f04e4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 secure :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 rx=0x7f04d80026d0 tx=0x7f04d8009de0).stop 2022-02-02T22:34:13.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 shutdown_connections 2022-02-02T22:34:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f04d0064dd0 0x7f04d0067290 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e40f66e0 0x7f04e406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 --2- 172.21.15.96:0/1149940526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40f7980 0x7f04e4069e20 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 >> 172.21.15.96:0/1149940526 conn(0x7f04e40f1e40 msgr2=0x7f04e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 shutdown_connections 2022-02-02T22:34:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.350+0000 7f04eb3fa700 1 -- 172.21.15.96:0/1149940526 wait complete. 2022-02-02T22:34:13.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 -- 172.21.15.96:0/3317052494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f6870 msgr2=0x7faa380f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 --2- 172.21.15.96:0/3317052494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f6870 0x7faa380f6cd0 secure :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 rx=0x7faa34004660 tx=0x7faa34009b30).stop 2022-02-02T22:34:13.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 -- 172.21.15.96:0/3317052494 shutdown_connections 2022-02-02T22:34:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 --2- 172.21.15.96:0/3317052494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f6870 0x7faa380f6cd0 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 --2- 172.21.15.96:0/3317052494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f55d0 0x7faa380f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.446+0000 7faa401f9700 1 -- 172.21.15.96:0/3317052494 >> 172.21.15.96:0/3317052494 conn(0x7faa380f0d70 msgr2=0x7faa380f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 -- 172.21.15.96:0/3317052494 shutdown_connections 2022-02-02T22:34:13.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 -- 172.21.15.96:0/3317052494 wait complete. 2022-02-02T22:34:13.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 Processor -- start 2022-02-02T22:34:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 -- start start 2022-02-02T22:34:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 0x7faa3810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380604a0 con 0x7faa380f55d0 2022-02-02T22:34:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa401f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380605e0 con 0x7faa380f6870 2022-02-02T22:34:13.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa3df95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa3df95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49180/0 (socket says 172.21.15.96:49180) 2022-02-02T22:34:13.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.447+0000 7faa3df95700 1 -- 172.21.15.96:0/2051916070 learned_addr learned my addr 172.21.15.96:0/2051916070 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:13.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3d794700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 0x7faa3810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3df95700 1 -- 172.21.15.96:0/2051916070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 msgr2=0x7faa3810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3df95700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 0x7faa3810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3df95700 1 -- 172.21.15.96:0/2051916070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34005040 con 0x7faa380f55d0 2022-02-02T22:34:13.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3d794700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 0x7faa3810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:34:13.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa3df95700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 secure :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 rx=0x7faa2800c530 tx=0x7faa28007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa2800f650 con 0x7faa380f55d0 2022-02-02T22:34:13.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa2800fc60 con 0x7faa380f55d0 2022-02-02T22:34:13.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3810c720 con 0x7faa380f55d0 2022-02-02T22:34:13.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa28012d20 con 0x7faa380f55d0 2022-02-02T22:34:13.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.448+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3810ccb0 con 0x7faa380f55d0 2022-02-02T22:34:13.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.449+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa380f49c0 con 0x7faa380f55d0 2022-02-02T22:34:13.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.450+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa28019030 con 0x7faa380f55d0 2022-02-02T22:34:13.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.450+0000 7faa2e7fc700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 0x7faa24067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.450+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa280816c0 con 0x7faa380f55d0 2022-02-02T22:34:13.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.452+0000 7faa3d794700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 0x7faa24067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.452+0000 7faa3d794700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 0x7faa24067290 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 rx=0x7faa34009da0 tx=0x7faa34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.456+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa2804f810 con 0x7faa380f55d0 2022-02-02T22:34:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.684+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa380fded0 con 0x7faa380f55d0 2022-02-02T22:34:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.685+0000 7faa2e7fc700 1 -- 172.21.15.96:0/2051916070 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faa28052e30 con 0x7faa380f55d0 2022-02-02T22:34:13.686 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:34:13.686 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:34:13.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:34:13.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:13.687 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:34:13.687 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:34:13.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:13.688 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:34:13.688 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:34:13.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:13.689 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:34:13.689 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:34:13.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:13.690 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:34:13.690 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:34:13.691 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:34:13.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:34:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:34:13.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 msgr2=0x7faa24067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 0x7faa24067290 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 rx=0x7faa34009da0 tx=0x7faa34009b30).stop 2022-02-02T22:34:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 msgr2=0x7faa38109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 secure :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 rx=0x7faa2800c530 tx=0x7faa28007e10).stop 2022-02-02T22:34:13.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 shutdown_connections 2022-02-02T22:34:13.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa24064dd0 0x7faa24067290 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa380f55d0 0x7faa38109c70 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 --2- 172.21.15.96:0/2051916070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa380f6870 0x7faa3810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 >> 172.21.15.96:0/2051916070 conn(0x7faa380f0d70 msgr2=0x7faa380fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 shutdown_connections 2022-02-02T22:34:13.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.687+0000 7faa401f9700 1 -- 172.21.15.96:0/2051916070 wait complete. 2022-02-02T22:34:13.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 -- 172.21.15.96:0/758295889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 msgr2=0x7fa0000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 --2- 172.21.15.96:0/758295889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 0x7fa0000f7c30 secure :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 rx=0x7f9ff4004660 tx=0x7f9ff4009b30).stop 2022-02-02T22:34:13.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 -- 172.21.15.96:0/758295889 shutdown_connections 2022-02-02T22:34:13.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 --2- 172.21.15.96:0/758295889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 0x7fa0000f7c30 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 --2- 172.21.15.96:0/758295889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa0000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:13.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 -- 172.21.15.96:0/758295889 >> 172.21.15.96:0/758295889 conn(0x7fa0000f1c90 msgr2=0x7fa0000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:13.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 -- 172.21.15.96:0/758295889 shutdown_connections 2022-02-02T22:34:13.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.784+0000 7fa005719700 1 -- 172.21.15.96:0/758295889 wait complete. 2022-02-02T22:34:13.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 Processor -- start 2022-02-02T22:34:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 -- start start 2022-02-02T22:34:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 0x7fa000069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00006a380 con 0x7fa0000f77d0 2022-02-02T22:34:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.785+0000 7fa005719700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00006a4c0 con 0x7fa0000f6530 2022-02-02T22:34:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:53294/0 (socket says 172.21.15.96:53294) 2022-02-02T22:34:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 -- 172.21.15.96:0/4232606382 learned_addr learned my addr 172.21.15.96:0/4232606382 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 -- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 msgr2=0x7fa000069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 0x7fa000069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:34:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 -- 172.21.15.96:0/4232606382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4005040 con 0x7fa0000f6530 2022-02-02T22:34:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffffff700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9ff0002700 tx=0x7f9ff0009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff0009320 con 0x7fa0000f6530 2022-02-02T22:34:13.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00006a7a0 con 0x7fa0000f6530 2022-02-02T22:34:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ff000f040 con 0x7fa0000f6530 2022-02-02T22:34:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff0014900 con 0x7fa0000f6530 2022-02-02T22:34:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.786+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00010ece0 con 0x7fa0000f6530 2022-02-02T22:34:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.787+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa000045ad0 con 0x7fa0000f6530 2022-02-02T22:34:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.788+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ff0009480 con 0x7fa0000f6530 2022-02-02T22:34:13.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.788+0000 7f9ffcff9700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 0x7f9fe80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:13.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.788+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ff0081d30 con 0x7fa0000f6530 2022-02-02T22:34:13.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.788+0000 7f9fff7fe700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 0x7f9fe80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:13.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.789+0000 7f9fff7fe700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 0x7f9fe80672e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f9ff4004e30 tx=0x7f9ff4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:13.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.793+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ff004fe30 con 0x7fa0000f6530 2022-02-02T22:34:13.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.993+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0000fecf0 con 0x7fa0000f6530 2022-02-02T22:34:13.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.994+0000 7f9ffcff9700 1 -- 172.21.15.96:0/4232606382 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9ff0053450 con 0x7fa0000f6530 2022-02-02T22:34:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:34:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:34:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:34:13.995 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:34:13.995 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:34:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:34:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:34:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:34:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:34:13.997 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:34:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:34:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:34:13.998 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:34:13.999 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:34:13.999 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:34:13.999 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:34:14.000 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:34:14.000 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:34:14.000 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:34:14.001 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:34:14.001 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:34:14.002 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:34:14.002 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:34:14.002 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:34:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:34:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:34:14.003 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:34:14.004 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:34:14.004 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:34:14.004 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:34:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:34:14.005 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:14.005 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:14.006 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:34:14.006 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:14.006 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 msgr2=0x7f9fe80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 0x7f9fe80672e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f9ff4004e30 tx=0x7f9ff4009b30).stop 2022-02-02T22:34:14.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 msgr2=0x7fa00006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:14.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9ff0002700 tx=0x7f9ff0009d80).stop 2022-02-02T22:34:14.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 shutdown_connections 2022-02-02T22:34:14.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9fe8064e20 0x7f9fe80672e0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:14.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0000f6530 0x7fa00006b9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:14.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 --2- 172.21.15.96:0/4232606382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000f77d0 0x7fa000069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:34:14.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.995+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 >> 172.21.15.96:0/4232606382 conn(0x7fa0000f1c90 msgr2=0x7fa0000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:14.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.996+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 shutdown_connections 2022-02-02T22:34:14.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:13.996+0000 7fa005719700 1 -- 172.21.15.96:0/4232606382 wait complete. 2022-02-02T22:34:14.012 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:34:14.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:14 smithi159 ceph-mon[69013]: from='client.41846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:14 smithi159 ceph-mon[69013]: pgmap v7563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:14.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:14 smithi159 ceph-mon[69013]: from='client.41850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2051916070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:34:14.776 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4232606382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:34:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:14 smithi096 ceph-mon[101353]: from='client.41846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:14 smithi096 ceph-mon[101353]: pgmap v7563: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:14.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:14 smithi096 ceph-mon[101353]: from='client.41850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2051916070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:34:14.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4232606382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:34:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:16 smithi159 ceph-mon[69013]: pgmap v7564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:16 smithi096 ceph-mon[101353]: pgmap v7564: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:18 smithi159 ceph-mon[69013]: pgmap v7565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:18 smithi096 ceph-mon[101353]: pgmap v7565: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:20.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:20 smithi159 ceph-mon[69013]: pgmap v7566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:20 smithi096 ceph-mon[101353]: pgmap v7566: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:22.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:22 smithi159 ceph-mon[69013]: pgmap v7567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:22 smithi096 ceph-mon[101353]: pgmap v7567: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:24.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:24 smithi159 ceph-mon[69013]: pgmap v7568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:24.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:24 smithi096 ceph-mon[101353]: pgmap v7568: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:26.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:26 smithi159 ceph-mon[69013]: pgmap v7569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:26 smithi096 ceph-mon[101353]: pgmap v7569: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:28 smithi159 ceph-mon[69013]: pgmap v7570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:28.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:34:28.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:34:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:28 smithi096 ceph-mon[101353]: pgmap v7570: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:34:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:34:30.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:30 smithi159 ceph-mon[69013]: pgmap v7571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:30 smithi096 ceph-mon[101353]: pgmap v7571: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:32 smithi159 ceph-mon[69013]: pgmap v7572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:32 smithi096 ceph-mon[101353]: pgmap v7572: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:34.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:34 smithi159 ceph-mon[69013]: pgmap v7573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:34 smithi096 ceph-mon[101353]: pgmap v7573: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:36.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:36 smithi159 ceph-mon[69013]: pgmap v7574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:36 smithi096 ceph-mon[101353]: pgmap v7574: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:38.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:38 smithi159 ceph-mon[69013]: pgmap v7575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:38.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:38 smithi096 ceph-mon[101353]: pgmap v7575: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:40.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:40 smithi159 ceph-mon[69013]: pgmap v7576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:40.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:40 smithi096 ceph-mon[101353]: pgmap v7576: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:42.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:42 smithi159 ceph-mon[69013]: pgmap v7577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:42.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:42 smithi096 ceph-mon[101353]: pgmap v7577: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:44.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 -- 172.21.15.96:0/4055158085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 msgr2=0x7f0a0c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 --2- 172.21.15.96:0/4055158085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c0f59e0 secure :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 rx=0x7f09fc004660 tx=0x7f09fc009b30).stop 2022-02-02T22:34:44.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 -- 172.21.15.96:0/4055158085 shutdown_connections 2022-02-02T22:34:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 --2- 172.21.15.96:0/4055158085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 0x7f0a0c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 --2- 172.21.15.96:0/4055158085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c0f59e0 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 -- 172.21.15.96:0/4055158085 >> 172.21.15.96:0/4055158085 conn(0x7f0a0c0f0d40 msgr2=0x7f0a0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 -- 172.21.15.96:0/4055158085 shutdown_connections 2022-02-02T22:34:44.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.105+0000 7f0a13b09700 1 -- 172.21.15.96:0/4055158085 wait complete. 2022-02-02T22:34:44.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 Processor -- start 2022-02-02T22:34:44.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 -- start start 2022-02-02T22:34:44.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 0x7f0a0c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c106910 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a13b09700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c106a50 con 0x7f0a0c0f6860 2022-02-02T22:34:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a118a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a118a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49208/0 (socket says 172.21.15.96:49208) 2022-02-02T22:34:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a118a5700 1 -- 172.21.15.96:0/742594811 learned_addr learned my addr 172.21.15.96:0/742594811 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.106+0000 7f0a110a4700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 0x7f0a0c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a118a5700 1 -- 172.21.15.96:0/742594811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 msgr2=0x7f0a0c106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a118a5700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 0x7f0a0c106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a118a5700 1 -- 172.21.15.96:0/742594811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc005040 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a118a5700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 secure :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 rx=0x7f09fc004f60 tx=0x7f09fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc018070 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09fc007ba0 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc01c620 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c107390 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.107+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c1078f0 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.108+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c045ad0 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.109+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09fc01c8e0 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.109+0000 7f0a027fc700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 0x7f09f80694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.109+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f09fc083960 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.109+0000 7f0a110a4700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 0x7f09f80694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.109+0000 7f0a110a4700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 0x7f09f80694a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 rx=0x7f0a080041d0 tx=0x7f0a08009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.113+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09fc055490 con 0x7f0a0c0f55c0 2022-02-02T22:34:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.291+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a0c05f620 con 0x7f09f8066fe0 2022-02-02T22:34:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.292+0000 7f0a027fc700 1 -- 172.21.15.96:0/742594811 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a0c05f620 con 0x7f09f8066fe0 2022-02-02T22:34:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.293+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 msgr2=0x7f09f80694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.293+0000 7f0a13b09700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 0x7f09f80694a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 rx=0x7f0a080041d0 tx=0x7f0a08009040).stop 2022-02-02T22:34:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.293+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 msgr2=0x7f0a0c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.293+0000 7f0a13b09700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 secure :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 rx=0x7f09fc004f60 tx=0x7f09fc009b30).stop 2022-02-02T22:34:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 shutdown_connections 2022-02-02T22:34:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f09f8066fe0 0x7f09f80694a0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a0c0f55c0 0x7f0a0c105e70 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 --2- 172.21.15.96:0/742594811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a0c0f6860 0x7f0a0c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 >> 172.21.15.96:0/742594811 conn(0x7f0a0c0f0d40 msgr2=0x7f0a0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 shutdown_connections 2022-02-02T22:34:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.294+0000 7f0a13b09700 1 -- 172.21.15.96:0/742594811 wait complete. 2022-02-02T22:34:44.304 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:34:44.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 -- 172.21.15.96:0/429761355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f5970 msgr2=0x7f146c0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 --2- 172.21.15.96:0/429761355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f5970 0x7f146c0f5df0 secure :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 rx=0x7f1460004660 tx=0x7f1460009b30).stop 2022-02-02T22:34:44.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 -- 172.21.15.96:0/429761355 shutdown_connections 2022-02-02T22:34:44.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 --2- 172.21.15.96:0/429761355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f5970 0x7f146c0f5df0 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 --2- 172.21.15.96:0/429761355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f6c60 0x7f146c0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 -- 172.21.15.96:0/429761355 >> 172.21.15.96:0/429761355 conn(0x7f146c0f04c0 msgr2=0x7f146c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 -- 172.21.15.96:0/429761355 shutdown_connections 2022-02-02T22:34:44.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.391+0000 7f14713bb700 1 -- 172.21.15.96:0/429761355 wait complete. 2022-02-02T22:34:44.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 Processor -- start 2022-02-02T22:34:44.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 -- start start 2022-02-02T22:34:44.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f5970 0x7f146c10c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0f54f0 con 0x7f146c0f6c60 2022-02-02T22:34:44.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f14713bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0f5630 con 0x7f146c0f5970 2022-02-02T22:34:44.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.392+0000 7f146a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49218/0 (socket says 172.21.15.96:49218) 2022-02-02T22:34:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 -- 172.21.15.96:0/3388980718 learned_addr learned my addr 172.21.15.96:0/3388980718 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146affd700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f5970 0x7f146c10c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 -- 172.21.15.96:0/3388980718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f5970 msgr2=0x7f146c10c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f5970 0x7f146c10c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 -- 172.21.15.96:0/3388980718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1460005040 con 0x7f146c0f6c60 2022-02-02T22:34:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f146a7fc700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 secure :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 rx=0x7f1460009990 tx=0x7f1460009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460018070 con 0x7f146c0f6c60 2022-02-02T22:34:44.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c10ea40 con 0x7f146c0f6c60 2022-02-02T22:34:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1460007ba0 con 0x7f146c0f6c60 2022-02-02T22:34:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146001c620 con 0x7f146c0f6c60 2022-02-02T22:34:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.393+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c10ee10 con 0x7f146c0f6c60 2022-02-02T22:34:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.394+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c0f4150 con 0x7f146c0f6c60 2022-02-02T22:34:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.395+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f146001c8e0 con 0x7f146c0f6c60 2022-02-02T22:34:44.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.395+0000 7f14537fe700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 0x7f1454067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.395+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1460083850 con 0x7f146c0f6c60 2022-02-02T22:34:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.395+0000 7f146affd700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 0x7f1454067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.396+0000 7f146affd700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 0x7f1454067290 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f145c007fd0 tx=0x7f145c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.400+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1460051950 con 0x7f146c0f6c60 2022-02-02T22:34:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.573+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f146c0fdf00 con 0x7f1454064dd0 2022-02-02T22:34:44.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.583+0000 7f14537fe700 1 -- 172.21.15.96:0/3388980718 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f146c0fdf00 con 0x7f1454064dd0 2022-02-02T22:34:44.584 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:34:44.585 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:34:44.585 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:34:44.585 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:34:44.586 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:34:44.586 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:34:44.587 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:34:44.587 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:34:44.587 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:34:44.588 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:34:44.588 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:34:44.589 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:34:44.589 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:34:44.589 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:34:44.590 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:34:44.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:34:44.590 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:34:44.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:34:44.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:34:44.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:34:44.592 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:34:44.592 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:34:44.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.584+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 msgr2=0x7f1454067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.584+0000 7f14713bb700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 0x7f1454067290 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f145c007fd0 tx=0x7f145c009040).stop 2022-02-02T22:34:44.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.584+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 msgr2=0x7f146c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.584+0000 7f14713bb700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 secure :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 rx=0x7f1460009990 tx=0x7f1460009b30).stop 2022-02-02T22:34:44.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 shutdown_connections 2022-02-02T22:34:44.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1454064dd0 0x7f1454067290 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c0f5970 0x7f146c10c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 --2- 172.21.15.96:0/3388980718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146c0f6c60 0x7f146c10e550 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 >> 172.21.15.96:0/3388980718 conn(0x7f146c0f04c0 msgr2=0x7f146c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 shutdown_connections 2022-02-02T22:34:44.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.585+0000 7f14713bb700 1 -- 172.21.15.96:0/3388980718 wait complete. 2022-02-02T22:34:44.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.680+0000 7fa47759e700 1 -- 172.21.15.96:0/2369730637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 msgr2=0x7fa4780f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.680+0000 7fa47759e700 1 --2- 172.21.15.96:0/2369730637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa4780f6b30 secure :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 rx=0x7fa46c004660 tx=0x7fa46c009b30).stop 2022-02-02T22:34:44.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.680+0000 7fa47759e700 1 -- 172.21.15.96:0/2369730637 shutdown_connections 2022-02-02T22:34:44.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 --2- 172.21.15.96:0/2369730637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f66d0 0x7fa4780f6b30 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 --2- 172.21.15.96:0/2369730637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f5430 0x7fa4780f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:34:44.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 -- 172.21.15.96:0/2369730637 >> 172.21.15.96:0/2369730637 conn(0x7fa4780f0b90 msgr2=0x7fa4780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.686 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:44 smithi096 ceph-mon[101353]: pgmap v7578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:44.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 -- 172.21.15.96:0/2369730637 shutdown_connections 2022-02-02T22:34:44.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 -- 172.21.15.96:0/2369730637 wait complete. 2022-02-02T22:34:44.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 Processor -- start 2022-02-02T22:34:44.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 -- start start 2022-02-02T22:34:44.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.681+0000 7fa47759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 0x7fa478106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478106860 con 0x7fa4780f5430 2022-02-02T22:34:44.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478106fd0 con 0x7fa4780f66d0 2022-02-02T22:34:44.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49226/0 (socket says 172.21.15.96:49226) 2022-02-02T22:34:44.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 -- 172.21.15.96:0/1948523192 learned_addr learned my addr 172.21.15.96:0/1948523192 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:44.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa475d9b700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 0x7fa478106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 -- 172.21.15.96:0/1948523192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 msgr2=0x7fa478106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 0x7fa478106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 -- 172.21.15.96:0/1948523192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c005040 con 0x7fa4780f5430 2022-02-02T22:34:44.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47659c700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 secure :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 rx=0x7fa4680093f0 tx=0x7fa468006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa468009ea0 con 0x7fa4780f5430 2022-02-02T22:34:44.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa468013af0 con 0x7fa4780f5430 2022-02-02T22:34:44.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4781072b0 con 0x7fa4780f5430 2022-02-02T22:34:44.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46800db10 con 0x7fa4780f5430 2022-02-02T22:34:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.682+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4781077f0 con 0x7fa4780f5430 2022-02-02T22:34:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.684+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478045ad0 con 0x7fa4780f5430 2022-02-02T22:34:44.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.684+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa46801a060 con 0x7fa4780f5430 2022-02-02T22:34:44.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.684+0000 7fa466ffd700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 0x7fa46006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:44.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.684+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa468081aa0 con 0x7fa4780f5430 2022-02-02T22:34:44.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.684+0000 7fa475d9b700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 0x7fa46006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:44.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.685+0000 7fa475d9b700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 0x7fa46006b6f0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 rx=0x7fa46c004e30 tx=0x7fa46c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:44.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.688+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa4680535d0 con 0x7fa4780f5430 2022-02-02T22:34:44.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:44 smithi159 ceph-mon[69013]: pgmap v7578: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.919+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4780ff740 con 0x7fa4780f5430 2022-02-02T22:34:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.919+0000 7fa466ffd700 1 -- 172.21.15.96:0/1948523192 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa468018070 con 0x7fa4780f5430 2022-02-02T22:34:44.921 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:34:44.921 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:34:44.922 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:34:44.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:44.922 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:34:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:34:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:44.923 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:34:44.924 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:34:44.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:44.926 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:34:44.926 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:34:44.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:34:44.927 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:34:44.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:34:44.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:34:44.928 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:34:44.928 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:34:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 msgr2=0x7fa46006b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 0x7fa46006b6f0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 rx=0x7fa46c004e30 tx=0x7fa46c009b30).stop 2022-02-02T22:34:44.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 msgr2=0x7fa478105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:44.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 secure :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 rx=0x7fa4680093f0 tx=0x7fa468006ec0).stop 2022-02-02T22:34:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 shutdown_connections 2022-02-02T22:34:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa460069230 0x7fa46006b6f0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4780f5430 0x7fa478105d30 unknown :-1 s=CLOSED pgs=3874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 --2- 172.21.15.96:0/1948523192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4780f66d0 0x7fa478106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 >> 172.21.15.96:0/1948523192 conn(0x7fa4780f0b90 msgr2=0x7fa4780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 shutdown_connections 2022-02-02T22:34:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:44.921+0000 7fa47759e700 1 -- 172.21.15.96:0/1948523192 wait complete. 2022-02-02T22:34:45.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 -- 172.21.15.96:0/898871223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f7980 msgr2=0x7f76600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:45.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 --2- 172.21.15.96:0/898871223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f7980 0x7f76600f7de0 secure :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 rx=0x7f7650004660 tx=0x7f7650009b30).stop 2022-02-02T22:34:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 -- 172.21.15.96:0/898871223 shutdown_connections 2022-02-02T22:34:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 --2- 172.21.15.96:0/898871223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f7980 0x7f76600f7de0 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 --2- 172.21.15.96:0/898871223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f66e0 0x7f76600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 -- 172.21.15.96:0/898871223 >> 172.21.15.96:0/898871223 conn(0x7f76600f1e40 msgr2=0x7f76600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 -- 172.21.15.96:0/898871223 shutdown_connections 2022-02-02T22:34:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.019+0000 7f7665fec700 1 -- 172.21.15.96:0/898871223 wait complete. 2022-02-02T22:34:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 Processor -- start 2022-02-02T22:34:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 -- start start 2022-02-02T22:34:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f7980 0x7f7660107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660107a00 con 0x7f76600f66e0 2022-02-02T22:34:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f7665fec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660107b40 con 0x7f76600f7980 2022-02-02T22:34:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f765f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f765f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49236/0 (socket says 172.21.15.96:49236) 2022-02-02T22:34:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f765f7fe700 1 -- 172.21.15.96:0/2298676127 learned_addr learned my addr 172.21.15.96:0/2298676127 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:34:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.020+0000 7f765effd700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f7980 0x7f7660107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f765f7fe700 1 -- 172.21.15.96:0/2298676127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f7980 msgr2=0x7f7660107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f765f7fe700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f7980 0x7f7660107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f765f7fe700 1 -- 172.21.15.96:0/2298676127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650005040 con 0x7f76600f66e0 2022-02-02T22:34:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f765f7fe700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 secure :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 rx=0x7f7648002700 tx=0x7f7648009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7648009320 con 0x7f76600f66e0 2022-02-02T22:34:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76601084e0 con 0x7f76600f66e0 2022-02-02T22:34:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f764800f040 con 0x7f76600f66e0 2022-02-02T22:34:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7648014900 con 0x7f76600f66e0 2022-02-02T22:34:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.021+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660108aa0 con 0x7f76600f66e0 2022-02-02T22:34:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.022+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660045ad0 con 0x7f76600f66e0 2022-02-02T22:34:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.022+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7648009480 con 0x7f76600f66e0 2022-02-02T22:34:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.023+0000 7f7657fff700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 0x7f764c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:34:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.023+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7648081cc0 con 0x7f76600f66e0 2022-02-02T22:34:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.023+0000 7f765effd700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 0x7f764c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:34:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.023+0000 7f765effd700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 0x7f764c067290 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 rx=0x7f7650004630 tx=0x7f7650009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:34:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.027+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76480538b0 con 0x7f76600f66e0 2022-02-02T22:34:45.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.231+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76600ff020 con 0x7f76600f66e0 2022-02-02T22:34:45.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.231+0000 7f7657fff700 1 -- 172.21.15.96:0/2298676127 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f76480534a0 con 0x7f76600f66e0 2022-02-02T22:34:45.233 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:34:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:34:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:34:45.234 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:34:45.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:45.235 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:34:45.235 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:34:45.236 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:34:45.236 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:34:45.236 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:34:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:34:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:34:45.237 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:34:45.238 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:34:45.238 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:34:45.239 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:34:45.239 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:34:45.240 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:34:45.240 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:34:45.240 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:34:45.241 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:34:45.241 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:34:45.241 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:34:45.242 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:34:45.242 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:34:45.242 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:34:45.243 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:34:45.243 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:34:45.243 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:34:45.244 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:34:45.244 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:34:45.245 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:34:45.245 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:45.245 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:45.246 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:34:45.246 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:34:45.246 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:45.247 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:45.247 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:34:45.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 msgr2=0x7f764c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:45.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 0x7f764c067290 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 rx=0x7f7650004630 tx=0x7f7650009b30).stop 2022-02-02T22:34:45.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 msgr2=0x7f7660106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:34:45.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 secure :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 rx=0x7f7648002700 tx=0x7f7648009d80).stop 2022-02-02T22:34:45.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 shutdown_connections 2022-02-02T22:34:45.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f764c064dd0 0x7f764c067290 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76600f66e0 0x7f7660106f60 unknown :-1 s=CLOSED pgs=3876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 --2- 172.21.15.96:0/2298676127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76600f7980 0x7f7660107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:34:45.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 >> 172.21.15.96:0/2298676127 conn(0x7f76600f1e40 msgr2=0x7f76600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:34:45.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 shutdown_connections 2022-02-02T22:34:45.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:34:45.233+0000 7f7665fec700 1 -- 172.21.15.96:0/2298676127 wait complete. 2022-02-02T22:34:45.253 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:34:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:45 smithi159 ceph-mon[69013]: from='client.41860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:45.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:45 smithi159 ceph-mon[69013]: from='client.41864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1948523192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:34:45.775 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2298676127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:34:45.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:45 smithi096 ceph-mon[101353]: from='client.41860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:45.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:45 smithi096 ceph-mon[101353]: from='client.41864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:34:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1948523192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:34:45.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2298676127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:34:46.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:46 smithi159 ceph-mon[69013]: pgmap v7579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:46.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:46 smithi096 ceph-mon[101353]: pgmap v7579: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:48.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:48 smithi159 ceph-mon[69013]: pgmap v7580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:48.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:48 smithi096 ceph-mon[101353]: pgmap v7580: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:50.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:50 smithi159 ceph-mon[69013]: pgmap v7581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:50.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:50 smithi096 ceph-mon[101353]: pgmap v7581: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:52.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:52 smithi159 ceph-mon[69013]: pgmap v7582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:52.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:52 smithi096 ceph-mon[101353]: pgmap v7582: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:54.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:54 smithi159 ceph-mon[69013]: pgmap v7583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:54.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:54 smithi096 ceph-mon[101353]: pgmap v7583: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:56.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:56 smithi159 ceph-mon[69013]: pgmap v7584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:56.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:56 smithi096 ceph-mon[101353]: pgmap v7584: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:58.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:34:58 smithi159 ceph-mon[69013]: pgmap v7585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:34:58.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:34:58 smithi096 ceph-mon[101353]: pgmap v7585: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:00.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:00 smithi159 ceph-mon[69013]: pgmap v7586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:00.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:00 smithi096 ceph-mon[101353]: pgmap v7586: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:02 smithi159 ceph-mon[69013]: pgmap v7587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:02 smithi096 ceph-mon[101353]: pgmap v7587: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:04 smithi159 ceph-mon[69013]: pgmap v7588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:04 smithi096 ceph-mon[101353]: pgmap v7588: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:06 smithi159 ceph-mon[69013]: pgmap v7589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:06 smithi096 ceph-mon[101353]: pgmap v7589: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:08 smithi159 ceph-mon[69013]: pgmap v7590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:08 smithi096 ceph-mon[101353]: pgmap v7590: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:10 smithi159 ceph-mon[69013]: pgmap v7591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:10 smithi096 ceph-mon[101353]: pgmap v7591: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:12 smithi096 ceph-mon[101353]: pgmap v7592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:12 smithi159 ceph-mon[69013]: pgmap v7592: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:14 smithi096 ceph-mon[101353]: pgmap v7593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:14 smithi159 ceph-mon[69013]: pgmap v7593: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:15.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 -- 172.21.15.96:0/3271681134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 msgr2=0x7f93480f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 --2- 172.21.15.96:0/3271681134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f93480f7a20 secure :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 rx=0x7f9330004660 tx=0x7f9330009b30).stop 2022-02-02T22:35:15.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 -- 172.21.15.96:0/3271681134 shutdown_connections 2022-02-02T22:35:15.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 --2- 172.21.15.96:0/3271681134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f93480f7a20 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 --2- 172.21.15.96:0/3271681134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 0x7f93480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 -- 172.21.15.96:0/3271681134 >> 172.21.15.96:0/3271681134 conn(0x7f93480f1f00 msgr2=0x7f93480f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:15.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 -- 172.21.15.96:0/3271681134 shutdown_connections 2022-02-02T22:35:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.345+0000 7f934dc56700 1 -- 172.21.15.96:0/3271681134 wait complete. 2022-02-02T22:35:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 Processor -- start 2022-02-02T22:35:15.618 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 -- start start 2022-02-02T22:35:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 0x7f9348106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348107a10 con 0x7f93480f6ff0 2022-02-02T22:35:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f934dc56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348107b50 con 0x7f93480f66e0 2022-02-02T22:35:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f933effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f933effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49256/0 (socket says 172.21.15.96:49256) 2022-02-02T22:35:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f933effd700 1 -- 172.21.15.96:0/994681054 learned_addr learned my addr 172.21.15.96:0/994681054 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:15.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.346+0000 7f93477fe700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 0x7f9348106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f933effd700 1 -- 172.21.15.96:0/994681054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 msgr2=0x7f9348106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f933effd700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 0x7f9348106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f933effd700 1 -- 172.21.15.96:0/994681054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330005040 con 0x7f93480f6ff0 2022-02-02T22:35:15.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f933effd700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 secure :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 rx=0x7f9330009990 tx=0x7f9330009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9330018070 con 0x7f93480f6ff0 2022-02-02T22:35:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9348108490 con 0x7f93480f6ff0 2022-02-02T22:35:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9330007ba0 con 0x7f93480f6ff0 2022-02-02T22:35:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933001c620 con 0x7f93480f6ff0 2022-02-02T22:35:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.347+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93481089f0 con 0x7f93480f6ff0 2022-02-02T22:35:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.348+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348045ad0 con 0x7f93480f6ff0 2022-02-02T22:35:15.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.349+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f933001c8e0 con 0x7f93480f6ff0 2022-02-02T22:35:15.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.349+0000 7f9344ff9700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.349+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9330083850 con 0x7f93480f6ff0 2022-02-02T22:35:15.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.349+0000 7f93477fe700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.349+0000 7f93477fe700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 rx=0x7f9338007fd0 tx=0x7f9338009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.353+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9330055380 con 0x7f93480f6ff0 2022-02-02T22:35:15.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.533+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93480fef40 con 0x7f9334064dd0 2022-02-02T22:35:15.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.534+0000 7f9344ff9700 1 -- 172.21.15.96:0/994681054 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f93480fef40 con 0x7f9334064dd0 2022-02-02T22:35:15.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 msgr2=0x7f9334067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 rx=0x7f9338007fd0 tx=0x7f9338009040).stop 2022-02-02T22:35:15.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 msgr2=0x7f9348107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 secure :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 rx=0x7f9330009990 tx=0x7f9330009b30).stop 2022-02-02T22:35:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 shutdown_connections 2022-02-02T22:35:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9334064dd0 0x7f9334067290 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480f66e0 0x7f9348106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 --2- 172.21.15.96:0/994681054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93480f6ff0 0x7f9348107460 unknown :-1 s=CLOSED pgs=3878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 >> 172.21.15.96:0/994681054 conn(0x7f93480f1f00 msgr2=0x7f93480fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:15.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 shutdown_connections 2022-02-02T22:35:15.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.536+0000 7f934dc56700 1 -- 172.21.15.96:0/994681054 wait complete. 2022-02-02T22:35:15.634 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:35:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 -- 172.21.15.96:0/1598747042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 msgr2=0x7f60940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 --2- 172.21.15.96:0/1598747042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f60940f6950 secure :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 rx=0x7f6088004660 tx=0x7f6088009b30).stop 2022-02-02T22:35:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 -- 172.21.15.96:0/1598747042 shutdown_connections 2022-02-02T22:35:15.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 --2- 172.21.15.96:0/1598747042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 0x7f60940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 --2- 172.21.15.96:0/1598747042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f60940f6950 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 -- 172.21.15.96:0/1598747042 >> 172.21.15.96:0/1598747042 conn(0x7f60940f1cd0 msgr2=0x7f60940f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:15.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 -- 172.21.15.96:0/1598747042 shutdown_connections 2022-02-02T22:35:15.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.635+0000 7f6099ec8700 1 -- 172.21.15.96:0/1598747042 wait complete. 2022-02-02T22:35:15.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.636+0000 7f6099ec8700 1 Processor -- start 2022-02-02T22:35:15.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.636+0000 7f6099ec8700 1 -- start start 2022-02-02T22:35:15.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6099ec8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6099ec8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 0x7f6094069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6099ec8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609406a380 con 0x7f60940f6530 2022-02-02T22:35:15.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6099ec8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609406a4c0 con 0x7f60940f77d0 2022-02-02T22:35:15.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49264/0 (socket says 172.21.15.96:49264) 2022-02-02T22:35:15.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 -- 172.21.15.96:0/3198739312 learned_addr learned my addr 172.21.15.96:0/3198739312 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:15.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6093fff700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 0x7f6094069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 -- 172.21.15.96:0/3198739312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 msgr2=0x7f6094069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 0x7f6094069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 -- 172.21.15.96:0/3198739312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088005040 con 0x7f60940f6530 2022-02-02T22:35:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6098ec6700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 secure :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 rx=0x7f6088004f60 tx=0x7f6088009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6088018070 con 0x7f60940f6530 2022-02-02T22:35:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6088009770 con 0x7f60940f6530 2022-02-02T22:35:15.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608801c3c0 con 0x7f60940f6530 2022-02-02T22:35:15.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.637+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609406a740 con 0x7f60940f6530 2022-02-02T22:35:15.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.638+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609406aca0 con 0x7f60940f6530 2022-02-02T22:35:15.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.638+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6094045ad0 con 0x7f60940f6530 2022-02-02T22:35:15.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.639+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f608801d420 con 0x7f60940f6530 2022-02-02T22:35:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.639+0000 7f60917fa700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 0x7f60840673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.639+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6088083840 con 0x7f60940f6530 2022-02-02T22:35:15.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.639+0000 7f6093fff700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 0x7f60840673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.640+0000 7f6093fff700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 0x7f60840673a0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7f6080007fd0 tx=0x7f6080009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.644+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6088051880 con 0x7f60940f6530 2022-02-02T22:35:15.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.819+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60940008d0 con 0x7f6084064ee0 2022-02-02T22:35:15.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.828+0000 7f60917fa700 1 -- 172.21.15.96:0/3198739312 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f60940008d0 con 0x7f6084064ee0 2022-02-02T22:35:15.828 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:35:15.829 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:35:15.830 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:35:15.830 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:35:15.830 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:35:15.831 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:35:15.831 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:35:15.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:35:15.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:35:15.833 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:35:15.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:35:15.834 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:35:15.835 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:35:15.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:35:15.836 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:35:15.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:35:15.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:35:15.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:35:15.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:35:15.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:35:15.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:35:15.838 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:35:15.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.829+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 msgr2=0x7f60840673a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.829+0000 7f6099ec8700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 0x7f60840673a0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7f6080007fd0 tx=0x7f6080009040).stop 2022-02-02T22:35:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.829+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 msgr2=0x7f609406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.829+0000 7f6099ec8700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 secure :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 rx=0x7f6088004f60 tx=0x7f6088009b30).stop 2022-02-02T22:35:15.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 shutdown_connections 2022-02-02T22:35:15.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6084064ee0 0x7f60840673a0 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60940f6530 0x7f609406b9a0 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 --2- 172.21.15.96:0/3198739312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60940f77d0 0x7f6094069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 >> 172.21.15.96:0/3198739312 conn(0x7f60940f1cd0 msgr2=0x7f60940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:15.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 shutdown_connections 2022-02-02T22:35:15.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.830+0000 7f6099ec8700 1 -- 172.21.15.96:0/3198739312 wait complete. 2022-02-02T22:35:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 -- 172.21.15.96:0/2403995793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 msgr2=0x7f5c6c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 --2- 172.21.15.96:0/2403995793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c0f59e0 secure :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 rx=0x7f5c60004660 tx=0x7f5c60009b30).stop 2022-02-02T22:35:15.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 -- 172.21.15.96:0/2403995793 shutdown_connections 2022-02-02T22:35:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 --2- 172.21.15.96:0/2403995793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:35:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 --2- 172.21.15.96:0/2403995793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c0f59e0 unknown :-1 s=CLOSED pgs=3881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 -- 172.21.15.96:0/2403995793 >> 172.21.15.96:0/2403995793 conn(0x7f5c6c0f0d40 msgr2=0x7f5c6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 -- 172.21.15.96:0/2403995793 shutdown_connections 2022-02-02T22:35:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.925+0000 7f5c7084e700 1 -- 172.21.15.96:0/2403995793 wait complete. 2022-02-02T22:35:15.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 Processor -- start 2022-02-02T22:35:15.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 -- start start 2022-02-02T22:35:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c060450 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c7084e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c060590 con 0x7f5c6c0f6860 2022-02-02T22:35:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c6a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49274/0 (socket says 172.21.15.96:49274) 2022-02-02T22:35:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.926+0000 7f5c6a59c700 1 -- 172.21.15.96:0/690528819 learned_addr learned my addr 172.21.15.96:0/690528819 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c69d9b700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c6a59c700 1 -- 172.21.15.96:0/690528819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 msgr2=0x7f5c6c10c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:15.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c6a59c700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c10c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:15.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c6a59c700 1 -- 172.21.15.96:0/690528819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60005040 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c6a59c700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 secure :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 rx=0x7f5c60009d30 tx=0x7f5c60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c6001c070 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c600097d0 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c600218b0 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c105ac0 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.927+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c106020 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.928+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c045ad0 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.929+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c600125d0 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.929+0000 7f5c5affd700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 0x7f5c54067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:15.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.929+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5c60087b50 con 0x7f5c6c0f55c0 2022-02-02T22:35:15.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.929+0000 7f5c69d9b700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 0x7f5c54067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:15.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.930+0000 7f5c69d9b700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 0x7f5c54067360 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 rx=0x7f5c5c00a6f0 tx=0x7f5c5c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:15.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:15.933+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c60055c70 con 0x7f5c6c0f55c0 2022-02-02T22:35:16.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.161+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c6c0fdf80 con 0x7f5c6c0f55c0 2022-02-02T22:35:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.161+0000 7f5c5affd700 1 -- 172.21.15.96:0/690528819 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5c60059290 con 0x7f5c6c0f55c0 2022-02-02T22:35:16.162 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:35:16.162 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:35:16.163 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:35:16.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:16.164 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:35:16.164 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:35:16.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:16.165 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:35:16.165 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:35:16.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:16.166 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:35:16.166 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:35:16.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:16.167 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:35:16.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:35:16.167 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:35:16.168 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:35:16.168 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:35:16.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 msgr2=0x7f5c54067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 0x7f5c54067360 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 rx=0x7f5c5c00a6f0 tx=0x7f5c5c008040).stop 2022-02-02T22:35:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 msgr2=0x7f5c6c109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 secure :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 rx=0x7f5c60009d30 tx=0x7f5c60009b30).stop 2022-02-02T22:35:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 shutdown_connections 2022-02-02T22:35:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c54064ea0 0x7f5c54067360 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0f55c0 0x7f5c6c109ce0 unknown :-1 s=CLOSED pgs=3882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 --2- 172.21.15.96:0/690528819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c6c0f6860 0x7f5c6c10c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 >> 172.21.15.96:0/690528819 conn(0x7f5c6c0f0d40 msgr2=0x7f5c6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:16.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.163+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 shutdown_connections 2022-02-02T22:35:16.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.164+0000 7f5c7084e700 1 -- 172.21.15.96:0/690528819 wait complete. 2022-02-02T22:35:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 -- 172.21.15.96:0/2445380510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f66e0 msgr2=0x7fd3800f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 --2- 172.21.15.96:0/2445380510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f66e0 0x7fd3800f6b00 secure :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 rx=0x7fd37c004660 tx=0x7fd37c009b30).stop 2022-02-02T22:35:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 -- 172.21.15.96:0/2445380510 shutdown_connections 2022-02-02T22:35:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 --2- 172.21.15.96:0/2445380510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f7980 0x7fd3800f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 --2- 172.21.15.96:0/2445380510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f66e0 0x7fd3800f6b00 unknown :-1 s=CLOSED pgs=3883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 -- 172.21.15.96:0/2445380510 >> 172.21.15.96:0/2445380510 conn(0x7fd3800f1e40 msgr2=0x7fd3800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.260+0000 7fd388276700 1 -- 172.21.15.96:0/2445380510 shutdown_connections 2022-02-02T22:35:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 -- 172.21.15.96:0/2445380510 wait complete. 2022-02-02T22:35:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 Processor -- start 2022-02-02T22:35:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 -- start start 2022-02-02T22:35:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 0x7fd38006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38006a380 con 0x7fd3800f7980 2022-02-02T22:35:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.261+0000 7fd388276700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38006a4c0 con 0x7fd3800f66e0 2022-02-02T22:35:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49286/0 (socket says 172.21.15.96:49286) 2022-02-02T22:35:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 -- 172.21.15.96:0/1844188988 learned_addr learned my addr 172.21.15.96:0/1844188988 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd386012700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 0x7fd38006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 -- 172.21.15.96:0/1844188988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 msgr2=0x7fd38006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 0x7fd38006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 -- 172.21.15.96:0/1844188988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c005040 con 0x7fd3800f7980 2022-02-02T22:35:16.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd386012700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 0x7fd38006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:35:16.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd385811700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 secure :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 rx=0x7fd37000c530 tx=0x7fd370007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:16.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37000f650 con 0x7fd3800f7980 2022-02-02T22:35:16.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38006a7a0 con 0x7fd3800f7980 2022-02-02T22:35:16.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd37000fc60 con 0x7fd3800f7980 2022-02-02T22:35:16.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd370012cd0 con 0x7fd3800f7980 2022-02-02T22:35:16.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.262+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38010efe0 con 0x7fd3800f7980 2022-02-02T22:35:16.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.264+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380045ad0 con 0x7fd3800f7980 2022-02-02T22:35:16.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.264+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd370010070 con 0x7fd3800f7980 2022-02-02T22:35:16.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.264+0000 7fd376ffd700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 0x7fd36c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:16.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.264+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd3700817b0 con 0x7fd3800f7980 2022-02-02T22:35:16.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.264+0000 7fd386012700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 0x7fd36c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:16.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.265+0000 7fd386012700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 0x7fd36c067290 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7fd37c004e30 tx=0x7fd37c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:16.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.268+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd37004f8b0 con 0x7fd3800f7980 2022-02-02T22:35:16.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.467+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3800fefa0 con 0x7fd3800f7980 2022-02-02T22:35:16.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.467+0000 7fd376ffd700 1 -- 172.21.15.96:0/1844188988 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd370052ed0 con 0x7fd3800f7980 2022-02-02T22:35:16.468 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:35:16.468 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:35:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:35:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:35:16.469 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:35:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:35:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:35:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:35:16.471 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:35:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:35:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:35:16.472 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:35:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:35:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:35:16.473 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:35:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:35:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:35:16.474 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:35:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:35:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:35:16.475 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:35:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:35:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:35:16.476 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:35:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:35:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:35:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:35:16.478 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:35:16.478 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:35:16.478 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:35:16.479 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:35:16.479 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:16.479 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:16.480 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:35:16.480 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:16.480 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:16.481 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:16.481 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:16.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 msgr2=0x7fd36c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 0x7fd36c067290 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7fd37c004e30 tx=0x7fd37c009b30).stop 2022-02-02T22:35:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 msgr2=0x7fd380069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 secure :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 rx=0x7fd37000c530 tx=0x7fd370007e20).stop 2022-02-02T22:35:16.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 shutdown_connections 2022-02-02T22:35:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064dd0 0x7fd36c067290 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f66e0 0x7fd38006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 --2- 172.21.15.96:0/1844188988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f7980 0x7fd380069e20 unknown :-1 s=CLOSED pgs=3884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:16.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 >> 172.21.15.96:0/1844188988 conn(0x7fd3800f1e40 msgr2=0x7fd3800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 shutdown_connections 2022-02-02T22:35:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:16.469+0000 7fd388276700 1 -- 172.21.15.96:0/1844188988 wait complete. 2022-02-02T22:35:16.486 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:35:16.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:16 smithi096 ceph-mon[101353]: pgmap v7594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:16 smithi096 ceph-mon[101353]: from='client.41876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:16 smithi096 ceph-mon[101353]: from='client.41880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/690528819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:35:16.806 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1844188988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:35:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:16 smithi159 ceph-mon[69013]: pgmap v7594: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:16 smithi159 ceph-mon[69013]: from='client.41876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:16 smithi159 ceph-mon[69013]: from='client.41880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/690528819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:35:17.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1844188988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:35:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:18 smithi096 ceph-mon[101353]: pgmap v7595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:19.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:18 smithi159 ceph-mon[69013]: pgmap v7595: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:20 smithi096 ceph-mon[101353]: pgmap v7596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:20 smithi159 ceph-mon[69013]: pgmap v7596: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:22 smithi096 ceph-mon[101353]: pgmap v7597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:22 smithi159 ceph-mon[69013]: pgmap v7597: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:24 smithi096 ceph-mon[101353]: pgmap v7598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:24 smithi159 ceph-mon[69013]: pgmap v7598: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:26 smithi096 ceph-mon[101353]: pgmap v7599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:26 smithi159 ceph-mon[69013]: pgmap v7599: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:28.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:28 smithi096 ceph-mon[101353]: pgmap v7600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:35:28.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:35:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:28 smithi159 ceph-mon[69013]: pgmap v7600: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:35:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:35:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:30 smithi096 ceph-mon[101353]: pgmap v7601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:30 smithi159 ceph-mon[69013]: pgmap v7601: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:32.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:32 smithi096 ceph-mon[101353]: pgmap v7602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:32 smithi159 ceph-mon[69013]: pgmap v7602: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:34 smithi159 ceph-mon[69013]: pgmap v7603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:34 smithi096 ceph-mon[101353]: pgmap v7603: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:36 smithi159 ceph-mon[69013]: pgmap v7604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:36 smithi096 ceph-mon[101353]: pgmap v7604: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:38 smithi159 ceph-mon[69013]: pgmap v7605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:38 smithi096 ceph-mon[101353]: pgmap v7605: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:40 smithi159 ceph-mon[69013]: pgmap v7606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:40 smithi096 ceph-mon[101353]: pgmap v7606: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:42 smithi159 ceph-mon[69013]: pgmap v7607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:42 smithi096 ceph-mon[101353]: pgmap v7607: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:44 smithi159 ceph-mon[69013]: pgmap v7608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:44 smithi096 ceph-mon[101353]: pgmap v7608: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:46.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- 172.21.15.96:0/1085896120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac0f9690 msgr2=0x7f4aac0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/1085896120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac0f9690 0x7f4aac0fbae0 secure :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 rx=0x7f4a9c004660 tx=0x7f4a9c009b30).stop 2022-02-02T22:35:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- 172.21.15.96:0/1085896120 shutdown_connections 2022-02-02T22:35:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/1085896120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac0f9690 0x7f4aac0fbae0 unknown :-1 s=CLOSED pgs=3885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/1085896120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac060310 0x7f4aac0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:35:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- 172.21.15.96:0/1085896120 >> 172.21.15.96:0/1085896120 conn(0x7f4aac0f0b90 msgr2=0x7f4aac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- 172.21.15.96:0/1085896120 shutdown_connections 2022-02-02T22:35:46.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- 172.21.15.96:0/1085896120 wait complete. 2022-02-02T22:35:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 Processor -- start 2022-02-02T22:35:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- start start 2022-02-02T22:35:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 0x7f4aac1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac107950 con 0x7f4aac060310 2022-02-02T22:35:46.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.582+0000 7f4ab22b9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac108100 con 0x7f4aac0f9690 2022-02-02T22:35:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49302/0 (socket says 172.21.15.96:49302) 2022-02-02T22:35:46.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 -- 172.21.15.96:0/239929379 learned_addr learned my addr 172.21.15.96:0/239929379 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:46.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab0ab6700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 0x7f4aac1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 -- 172.21.15.96:0/239929379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 msgr2=0x7f4aac1072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 0x7f4aac1072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 -- 172.21.15.96:0/239929379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c005040 con 0x7f4aac060310 2022-02-02T22:35:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab0ab6700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 0x7f4aac1072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:35:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab12b7700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 secure :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 rx=0x7f4aa800b410 tx=0x7f4aa8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa80125f0 con 0x7f4aac060310 2022-02-02T22:35:46.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4aa8012c00 con 0x7f4aac060310 2022-02-02T22:35:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac1083e0 con 0x7f4aac060310 2022-02-02T22:35:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.583+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa8002ae0 con 0x7f4aac060310 2022-02-02T22:35:46.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.584+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac1089a0 con 0x7f4aac060310 2022-02-02T22:35:46.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.585+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac059100 con 0x7f4aac060310 2022-02-02T22:35:46.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.585+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4aa800f030 con 0x7f4aac060310 2022-02-02T22:35:46.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.585+0000 7f4aa1ffb700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 0x7f4a980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.585+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4aa8081e40 con 0x7f4aac060310 2022-02-02T22:35:46.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.585+0000 7f4ab0ab6700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 0x7f4a980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.586+0000 7f4ab0ab6700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 0x7f4a980672e0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 rx=0x7f4a9c004e30 tx=0x7f4a9c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:46.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.590+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4aa804ff40 con 0x7f4aac060310 2022-02-02T22:35:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.773+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aac0008d0 con 0x7f4a98064e20 2022-02-02T22:35:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.774+0000 7f4aa1ffb700 1 -- 172.21.15.96:0/239929379 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4aac0008d0 con 0x7f4a98064e20 2022-02-02T22:35:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 msgr2=0x7f4a980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 0x7f4a980672e0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 rx=0x7f4a9c004e30 tx=0x7f4a9c009b30).stop 2022-02-02T22:35:46.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 msgr2=0x7f4aac106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 secure :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 rx=0x7f4aa800b410 tx=0x7f4aa8006ef0).stop 2022-02-02T22:35:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 shutdown_connections 2022-02-02T22:35:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4a98064e20 0x7f4a980672e0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aac060310 0x7f4aac106dd0 unknown :-1 s=CLOSED pgs=3886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 --2- 172.21.15.96:0/239929379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4aac0f9690 0x7f4aac1072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 >> 172.21.15.96:0/239929379 conn(0x7f4aac0f0b90 msgr2=0x7f4aac0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 shutdown_connections 2022-02-02T22:35:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.776+0000 7f4ab22b9700 1 -- 172.21.15.96:0/239929379 wait complete. 2022-02-02T22:35:46.785 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:35:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.873+0000 7f5880303700 1 -- 172.21.15.96:0/1525142090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f55c0 msgr2=0x7f58780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.873+0000 7f5880303700 1 --2- 172.21.15.96:0/1525142090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f55c0 0x7f58780f59e0 secure :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 rx=0x7f5874004660 tx=0x7f5874009b30).stop 2022-02-02T22:35:46.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 -- 172.21.15.96:0/1525142090 shutdown_connections 2022-02-02T22:35:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 --2- 172.21.15.96:0/1525142090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f6860 0x7f58780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 --2- 172.21.15.96:0/1525142090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f55c0 0x7f58780f59e0 unknown :-1 s=CLOSED pgs=3887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 -- 172.21.15.96:0/1525142090 >> 172.21.15.96:0/1525142090 conn(0x7f58780f0d40 msgr2=0x7f58780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 -- 172.21.15.96:0/1525142090 shutdown_connections 2022-02-02T22:35:46.880 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:46 smithi096 ceph-mon[101353]: pgmap v7609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.874+0000 7f5880303700 1 -- 172.21.15.96:0/1525142090 wait complete. 2022-02-02T22:35:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 Processor -- start 2022-02-02T22:35:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 -- start start 2022-02-02T22:35:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 0x7f5878104e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58781058f0 con 0x7f58780f6860 2022-02-02T22:35:46.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f5880303700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878106100 con 0x7f58780f55c0 2022-02-02T22:35:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49314/0 (socket says 172.21.15.96:49314) 2022-02-02T22:35:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 -- 172.21.15.96:0/1710354169 learned_addr learned my addr 172.21.15.96:0/1710354169 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587e09f700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 0x7f5878104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 -- 172.21.15.96:0/1710354169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 msgr2=0x7f5878104e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 0x7f5878104e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 -- 172.21.15.96:0/1710354169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874005040 con 0x7f58780f6860 2022-02-02T22:35:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587e09f700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 0x7f5878104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:35:46.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f587d89e700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 secure :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 rx=0x7f586800c530 tx=0x7f5868007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:46.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.875+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586800f650 con 0x7f58780f6860 2022-02-02T22:35:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.876+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f586800fc60 con 0x7f58780f6860 2022-02-02T22:35:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.876+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5878106380 con 0x7f58780f6860 2022-02-02T22:35:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.876+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5868012cd0 con 0x7f58780f6860 2022-02-02T22:35:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.876+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5878106940 con 0x7f58780f6860 2022-02-02T22:35:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.877+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58780f49b0 con 0x7f58780f6860 2022-02-02T22:35:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.877+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5868010070 con 0x7f58780f6860 2022-02-02T22:35:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.877+0000 7f586effd700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 0x7f58640694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.877+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f58680817b0 con 0x7f58780f6860 2022-02-02T22:35:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.877+0000 7f587e09f700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 0x7f58640694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:46.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.878+0000 7f587e09f700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 0x7f58640694a0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 rx=0x7f5874004e30 tx=0x7f5874009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:46.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:46.881+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f586804f8b0 con 0x7f58780f6860 2022-02-02T22:35:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:46 smithi159 ceph-mon[69013]: pgmap v7609: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.058+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58780fcdb0 con 0x7f5864066fe0 2022-02-02T22:35:47.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.067+0000 7f586effd700 1 -- 172.21.15.96:0/1710354169 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f58780fcdb0 con 0x7f5864066fe0 2022-02-02T22:35:47.067 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:35:47.068 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:35:47.068 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:35:47.069 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:35:47.069 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:35:47.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:35:47.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:35:47.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:35:47.070 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:35:47.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:35:47.071 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:35:47.071 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:35:47.072 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:35:47.072 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:35:47.073 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:35:47.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:35:47.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:35:47.074 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:35:47.074 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:35:47.074 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:35:47.075 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:35:47.075 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:35:47.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 msgr2=0x7f58640694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 0x7f58640694a0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 rx=0x7f5874004e30 tx=0x7f5874009b30).stop 2022-02-02T22:35:47.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 msgr2=0x7f58781052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 secure :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 rx=0x7f586800c530 tx=0x7f5868007e20).stop 2022-02-02T22:35:47.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 shutdown_connections 2022-02-02T22:35:47.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5864066fe0 0x7f58640694a0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780f55c0 0x7f5878104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 --2- 172.21.15.96:0/1710354169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58780f6860 0x7f58781052f0 unknown :-1 s=CLOSED pgs=3888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 >> 172.21.15.96:0/1710354169 conn(0x7f58780f0d40 msgr2=0x7f58780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:47.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 shutdown_connections 2022-02-02T22:35:47.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.069+0000 7f5880303700 1 -- 172.21.15.96:0/1710354169 wait complete. 2022-02-02T22:35:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 -- 172.21.15.96:0/884885603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 msgr2=0x7f5a500f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 --2- 172.21.15.96:0/884885603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a500f5a00 secure :-1 s=READY pgs=3889 cs=0 l=1 rev1=1 rx=0x7f5a40004660 tx=0x7f5a40009b30).stop 2022-02-02T22:35:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 -- 172.21.15.96:0/884885603 shutdown_connections 2022-02-02T22:35:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 --2- 172.21.15.96:0/884885603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 0x7f5a500f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 --2- 172.21.15.96:0/884885603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a500f5a00 unknown :-1 s=CLOSED pgs=3889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 -- 172.21.15.96:0/884885603 >> 172.21.15.96:0/884885603 conn(0x7f5a500f0de0 msgr2=0x7f5a500f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:47.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 -- 172.21.15.96:0/884885603 shutdown_connections 2022-02-02T22:35:47.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.166+0000 7f5a555f6700 1 -- 172.21.15.96:0/884885603 wait complete. 2022-02-02T22:35:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 Processor -- start 2022-02-02T22:35:47.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 -- start start 2022-02-02T22:35:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 0x7f5a50109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50109bf0 con 0x7f5a500f55e0 2022-02-02T22:35:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a555f6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50109d30 con 0x7f5a500f5ef0 2022-02-02T22:35:47.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a4effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a4effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49326/0 (socket says 172.21.15.96:49326) 2022-02-02T22:35:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a4effd700 1 -- 172.21.15.96:0/1298171133 learned_addr learned my addr 172.21.15.96:0/1298171133 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:47.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.167+0000 7f5a4e7fc700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 0x7f5a50109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:47.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a4effd700 1 -- 172.21.15.96:0/1298171133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 msgr2=0x7f5a50109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a4effd700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 0x7f5a50109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a4effd700 1 -- 172.21.15.96:0/1298171133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40005040 con 0x7f5a500f55e0 2022-02-02T22:35:47.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a4effd700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 secure :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 rx=0x7f5a40009990 tx=0x7f5a40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:47.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a40018070 con 0x7f5a500f55e0 2022-02-02T22:35:47.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5010a670 con 0x7f5a500f55e0 2022-02-02T22:35:47.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a40007ba0 con 0x7f5a500f55e0 2022-02-02T22:35:47.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4001c620 con 0x7f5a500f55e0 2022-02-02T22:35:47.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.168+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5010abd0 con 0x7f5a500f55e0 2022-02-02T22:35:47.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.169+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50045ad0 con 0x7f5a500f55e0 2022-02-02T22:35:47.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.169+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a4001c8e0 con 0x7f5a500f55e0 2022-02-02T22:35:47.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.170+0000 7f5a377fe700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 0x7f5a38067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.170+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a40083850 con 0x7f5a500f55e0 2022-02-02T22:35:47.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.170+0000 7f5a4e7fc700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 0x7f5a38067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:47.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.170+0000 7f5a4e7fc700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 0x7f5a38067290 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 rx=0x7f5a44007fd0 tx=0x7f5a44009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:47.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.174+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a40055380 con 0x7f5a500f55e0 2022-02-02T22:35:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.405+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a5010f770 con 0x7f5a500f55e0 2022-02-02T22:35:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.406+0000 7f5a377fe700 1 -- 172.21.15.96:0/1298171133 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5a40054f70 con 0x7f5a500f55e0 2022-02-02T22:35:47.407 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:35:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:35:47.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:35:47.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:47.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:35:47.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:35:47.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:47.409 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:35:47.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:35:47.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:47.411 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:35:47.411 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:35:47.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:35:47.412 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:35:47.412 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:35:47.412 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:35:47.413 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:35:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:35:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 msgr2=0x7f5a38067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 0x7f5a38067290 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 rx=0x7f5a44007fd0 tx=0x7f5a44009040).stop 2022-02-02T22:35:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 msgr2=0x7f5a50109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 secure :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 rx=0x7f5a40009990 tx=0x7f5a40009b30).stop 2022-02-02T22:35:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 shutdown_connections 2022-02-02T22:35:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a38064dd0 0x7f5a38067290 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a500f55e0 0x7f5a50109150 unknown :-1 s=CLOSED pgs=3890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 --2- 172.21.15.96:0/1298171133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a500f5ef0 0x7f5a50109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 >> 172.21.15.96:0/1298171133 conn(0x7f5a500f0de0 msgr2=0x7f5a5005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 shutdown_connections 2022-02-02T22:35:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.407+0000 7f5a555f6700 1 -- 172.21.15.96:0/1298171133 wait complete. 2022-02-02T22:35:47.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 -- 172.21.15.96:0/1616596513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f6860 msgr2=0x7f1c500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 --2- 172.21.15.96:0/1616596513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f6860 0x7f1c500f6cc0 secure :-1 s=READY pgs=3891 cs=0 l=1 rev1=1 rx=0x7f1c4c004660 tx=0x7f1c4c009b30).stop 2022-02-02T22:35:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 -- 172.21.15.96:0/1616596513 shutdown_connections 2022-02-02T22:35:47.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 --2- 172.21.15.96:0/1616596513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f6860 0x7f1c500f6cc0 unknown :-1 s=CLOSED pgs=3891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 --2- 172.21.15.96:0/1616596513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c500f55c0 0x7f1c500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 -- 172.21.15.96:0/1616596513 >> 172.21.15.96:0/1616596513 conn(0x7f1c500f0d40 msgr2=0x7f1c500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:47.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 -- 172.21.15.96:0/1616596513 shutdown_connections 2022-02-02T22:35:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.506+0000 7f1c58242700 1 -- 172.21.15.96:0/1616596513 wait complete. 2022-02-02T22:35:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 Processor -- start 2022-02-02T22:35:47.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 -- start start 2022-02-02T22:35:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c500f6860 0x7f1c5010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500603c0 con 0x7f1c500f55c0 2022-02-02T22:35:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c58242700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50060500 con 0x7f1c500f6860 2022-02-02T22:35:47.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c55fde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c55fde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49336/0 (socket says 172.21.15.96:49336) 2022-02-02T22:35:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.507+0000 7f1c55fde700 1 -- 172.21.15.96:0/3716547714 learned_addr learned my addr 172.21.15.96:0/3716547714 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:35:47.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c55fde700 1 -- 172.21.15.96:0/3716547714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c500f6860 msgr2=0x7f1c5010c170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T22:35:47.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c55fde700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c500f6860 0x7f1c5010c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:35:47.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c55fde700 1 -- 172.21.15.96:0/3716547714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c005040 con 0x7f1c500f55c0 2022-02-02T22:35:47.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c55fde700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 secure :-1 s=READY pgs=3892 cs=0 l=1 rev1=1 rx=0x7f1c40002700 tx=0x7f1c40009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c40009320 con 0x7f1c500f55c0 2022-02-02T22:35:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c4000f040 con 0x7f1c500f55c0 2022-02-02T22:35:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5010c720 con 0x7f1c500f55c0 2022-02-02T22:35:47.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c400148c0 con 0x7f1c500f55c0 2022-02-02T22:35:47.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.508+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5010ccb0 con 0x7f1c500f55c0 2022-02-02T22:35:47.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.509+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c500f49b0 con 0x7f1c500f55c0 2022-02-02T22:35:47.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.510+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c40009480 con 0x7f1c500f55c0 2022-02-02T22:35:47.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.510+0000 7f1c467fc700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 0x7f1c3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:35:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.510+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1c40081c30 con 0x7f1c500f55c0 2022-02-02T22:35:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.510+0000 7f1c557dd700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 0x7f1c3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:35:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.510+0000 7f1c557dd700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 0x7f1c3c067290 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 rx=0x7f1c4c004e30 tx=0x7f1c4c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:35:47.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.514+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c4004fd30 con 0x7f1c500f55c0 2022-02-02T22:35:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.716+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c50045ad0 con 0x7f1c500f55c0 2022-02-02T22:35:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.717+0000 7f1c467fc700 1 -- 172.21.15.96:0/3716547714 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1c40053350 con 0x7f1c500f55c0 2022-02-02T22:35:47.717 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:35:47.718 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:35:47.718 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:35:47.719 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:35:47.719 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:47.719 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:35:47.719 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:35:47.720 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:35:47.720 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:35:47.720 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:35:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:35:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:35:47.721 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:35:47.722 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:35:47.722 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:35:47.723 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:35:47.723 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:35:47.723 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:35:47.724 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:35:47.724 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:35:47.724 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:35:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:35:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:35:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:35:47.726 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:35:47.726 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:35:47.726 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:35:47.727 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:35:47.727 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:35:47.728 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:35:47.728 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:35:47.728 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:35:47.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:47.729 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:47.729 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:35:47.730 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:35:47.730 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:47.730 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:47.731 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:35:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 msgr2=0x7f1c3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 0x7f1c3c067290 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 rx=0x7f1c4c004e30 tx=0x7f1c4c009b30).stop 2022-02-02T22:35:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 msgr2=0x7f1c50109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:35:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 secure :-1 s=READY pgs=3892 cs=0 l=1 rev1=1 rx=0x7f1c40002700 tx=0x7f1c40009d80).stop 2022-02-02T22:35:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 shutdown_connections 2022-02-02T22:35:47.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1c3c064dd0 0x7f1c3c067290 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c500f55c0 0x7f1c50109c70 unknown :-1 s=CLOSED pgs=3892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:35:47.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 --2- 172.21.15.96:0/3716547714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c500f6860 0x7f1c5010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:35:47.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.718+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 >> 172.21.15.96:0/3716547714 conn(0x7f1c500f0d40 msgr2=0x7f1c500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:35:47.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.719+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 shutdown_connections 2022-02-02T22:35:47.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:35:47.719+0000 7f1c58242700 1 -- 172.21.15.96:0/3716547714 wait complete. 2022-02-02T22:35:47.736 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:35:47.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:47 smithi096 ceph-mon[101353]: from='client.41892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:47.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1298171133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:35:48.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:47 smithi159 ceph-mon[69013]: from='client.41892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:48.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1298171133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:35:49.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:48 smithi159 ceph-mon[69013]: from='client.41896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:48 smithi159 ceph-mon[69013]: pgmap v7610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3716547714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:35:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:48 smithi096 ceph-mon[101353]: from='client.41896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:35:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:48 smithi096 ceph-mon[101353]: pgmap v7610: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3716547714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:35:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:50 smithi159 ceph-mon[69013]: pgmap v7611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:50 smithi096 ceph-mon[101353]: pgmap v7611: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:52 smithi159 ceph-mon[69013]: pgmap v7612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:52 smithi096 ceph-mon[101353]: pgmap v7612: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:54 smithi159 ceph-mon[69013]: pgmap v7613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:54 smithi096 ceph-mon[101353]: pgmap v7613: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:56 smithi159 ceph-mon[69013]: pgmap v7614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:56 smithi096 ceph-mon[101353]: pgmap v7614: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:35:58 smithi159 ceph-mon[69013]: pgmap v7615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:35:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:35:58 smithi096 ceph-mon[101353]: pgmap v7615: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:00 smithi159 ceph-mon[69013]: pgmap v7616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:00 smithi096 ceph-mon[101353]: pgmap v7616: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:02 smithi159 ceph-mon[69013]: pgmap v7617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:02 smithi096 ceph-mon[101353]: pgmap v7617: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:04 smithi159 ceph-mon[69013]: pgmap v7618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:04 smithi096 ceph-mon[101353]: pgmap v7618: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:06 smithi159 ceph-mon[69013]: pgmap v7619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:06 smithi096 ceph-mon[101353]: pgmap v7619: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:08 smithi159 ceph-mon[69013]: pgmap v7620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:08 smithi096 ceph-mon[101353]: pgmap v7620: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:10 smithi159 ceph-mon[69013]: pgmap v7621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:10 smithi096 ceph-mon[101353]: pgmap v7621: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:12 smithi159 ceph-mon[69013]: pgmap v7622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:12 smithi096 ceph-mon[101353]: pgmap v7622: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:15.028 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:14 smithi159 ceph-mon[69013]: pgmap v7623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:14 smithi096 ceph-mon[101353]: pgmap v7623: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:16 smithi159 ceph-mon[69013]: pgmap v7624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:16 smithi096 ceph-mon[101353]: pgmap v7624: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 -- 172.21.15.96:0/1369327784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 msgr2=0x7f03fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:17.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 --2- 172.21.15.96:0/1369327784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc0f6cc0 secure :-1 s=READY pgs=3893 cs=0 l=1 rev1=1 rx=0x7f03f0004660 tx=0x7f03f0009b30).stop 2022-02-02T22:36:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 -- 172.21.15.96:0/1369327784 shutdown_connections 2022-02-02T22:36:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 --2- 172.21.15.96:0/1369327784 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc0f6cc0 unknown :-1 s=CLOSED pgs=3893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 --2- 172.21.15.96:0/1369327784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 0x7f03fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 -- 172.21.15.96:0/1369327784 >> 172.21.15.96:0/1369327784 conn(0x7f03fc0f0d40 msgr2=0x7f03fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 -- 172.21.15.96:0/1369327784 shutdown_connections 2022-02-02T22:36:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.829+0000 7f04033b5700 1 -- 172.21.15.96:0/1369327784 wait complete. 2022-02-02T22:36:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 Processor -- start 2022-02-02T22:36:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 -- start start 2022-02-02T22:36:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 0x7f03fc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0603c0 con 0x7f03fc0f6860 2022-02-02T22:36:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f04033b5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc060500 con 0x7f03fc0f55c0 2022-02-02T22:36:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49356/0 (socket says 172.21.15.96:49356) 2022-02-02T22:36:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 -- 172.21.15.96:0/2136973571 learned_addr learned my addr 172.21.15.96:0/2136973571 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0401151700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 0x7f03fc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 -- 172.21.15.96:0/2136973571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 msgr2=0x7f03fc109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 0x7f03fc109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:17.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.830+0000 7f0400950700 1 -- 172.21.15.96:0/2136973571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0005040 con 0x7f03fc0f6860 2022-02-02T22:36:17.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f0400950700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 secure :-1 s=READY pgs=3894 cs=0 l=1 rev1=1 rx=0x7f03f0009990 tx=0x7f03f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:17.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f0018070 con 0x7f03fc0f6860 2022-02-02T22:36:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc10c6d0 con 0x7f03fc0f6860 2022-02-02T22:36:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc10cc00 con 0x7f03fc0f6860 2022-02-02T22:36:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03f0007ba0 con 0x7f03fc0f6860 2022-02-02T22:36:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.831+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f001dcc0 con 0x7f03fc0f6860 2022-02-02T22:36:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.832+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc004fa0 con 0x7f03fc0f6860 2022-02-02T22:36:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.833+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03f001d420 con 0x7f03fc0f6860 2022-02-02T22:36:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.833+0000 7f03f9ffb700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 0x7f03e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.833+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f03f00832d0 con 0x7f03fc0f6860 2022-02-02T22:36:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.833+0000 7f0401151700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 0x7f03e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.833+0000 7f0401151700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 0x7f03e4067290 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 rx=0x7f03fc060040 tx=0x7f03f4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:17.837+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03f00513d0 con 0x7f03fc0f6860 2022-02-02T22:36:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.014+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03dc000bc0 con 0x7f03e4064dd0 2022-02-02T22:36:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.016+0000 7f03f9ffb700 1 -- 172.21.15.96:0/2136973571 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f03dc000bc0 con 0x7f03e4064dd0 2022-02-02T22:36:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 msgr2=0x7f03e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 0x7f03e4067290 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 rx=0x7f03fc060040 tx=0x7f03f4009040).stop 2022-02-02T22:36:18.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 msgr2=0x7f03fc10c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 secure :-1 s=READY pgs=3894 cs=0 l=1 rev1=1 rx=0x7f03f0009990 tx=0x7f03f0009b30).stop 2022-02-02T22:36:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 shutdown_connections 2022-02-02T22:36:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f03e4064dd0 0x7f03e4067290 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03fc0f55c0 0x7f03fc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 --2- 172.21.15.96:0/2136973571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03fc0f6860 0x7f03fc10c180 unknown :-1 s=CLOSED pgs=3894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.017+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 >> 172.21.15.96:0/2136973571 conn(0x7f03fc0f0d40 msgr2=0x7f03fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.018+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 shutdown_connections 2022-02-02T22:36:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.018+0000 7f04033b5700 1 -- 172.21.15.96:0/2136973571 wait complete. 2022-02-02T22:36:18.027 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:36:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 -- 172.21.15.96:0/796950049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f66e0 msgr2=0x7f19ec0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 --2- 172.21.15.96:0/796950049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f66e0 0x7f19ec0f6b40 secure :-1 s=READY pgs=3895 cs=0 l=1 rev1=1 rx=0x7f19e8004660 tx=0x7f19e8009b30).stop 2022-02-02T22:36:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 -- 172.21.15.96:0/796950049 shutdown_connections 2022-02-02T22:36:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 --2- 172.21.15.96:0/796950049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f66e0 0x7f19ec0f6b40 unknown :-1 s=CLOSED pgs=3895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 --2- 172.21.15.96:0/796950049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f5440 0x7f19ec0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 -- 172.21.15.96:0/796950049 >> 172.21.15.96:0/796950049 conn(0x7f19ec0f0ba0 msgr2=0x7f19ec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.115+0000 7f19f28a8700 1 -- 172.21.15.96:0/796950049 shutdown_connections 2022-02-02T22:36:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 -- 172.21.15.96:0/796950049 wait complete. 2022-02-02T22:36:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 Processor -- start 2022-02-02T22:36:18.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 -- start start 2022-02-02T22:36:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f66e0 0x7f19ec10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0603e0 con 0x7f19ec0f5440 2022-02-02T22:36:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f28a8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec060520 con 0x7f19ec0f66e0 2022-02-02T22:36:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f18a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.116+0000 7f19f18a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49364/0 (socket says 172.21.15.96:49364) 2022-02-02T22:36:18.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f18a6700 1 -- 172.21.15.96:0/1360539385 learned_addr learned my addr 172.21.15.96:0/1360539385 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:18.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f10a5700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f66e0 0x7f19ec10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f18a6700 1 -- 172.21.15.96:0/1360539385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f66e0 msgr2=0x7f19ec10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f18a6700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f66e0 0x7f19ec10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f18a6700 1 -- 172.21.15.96:0/1360539385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8005040 con 0x7f19ec0f5440 2022-02-02T22:36:18.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f18a6700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 secure :-1 s=READY pgs=3896 cs=0 l=1 rev1=1 rx=0x7f19dc002700 tx=0x7f19dc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc0079c0 con 0x7f19ec0f5440 2022-02-02T22:36:18.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec10c540 con 0x7f19ec0f5440 2022-02-02T22:36:18.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19dc00f040 con 0x7f19ec0f5440 2022-02-02T22:36:18.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc0147e0 con 0x7f19ec0f5440 2022-02-02T22:36:18.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.117+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec10cb00 con 0x7f19ec0f5440 2022-02-02T22:36:18.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.118+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec045ad0 con 0x7f19ec0f5440 2022-02-02T22:36:18.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.119+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19dc01b060 con 0x7f19ec0f5440 2022-02-02T22:36:18.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.119+0000 7f19e27fc700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 0x7f19d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.119+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19dc081870 con 0x7f19ec0f5440 2022-02-02T22:36:18.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.119+0000 7f19f10a5700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 0x7f19d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.119+0000 7f19f10a5700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 0x7f19d80672e0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7f19e8004630 tx=0x7f19e8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.123+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19dc04f910 con 0x7f19ec0f5440 2022-02-02T22:36:18.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.297+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19ec0fdd60 con 0x7f19d8064e20 2022-02-02T22:36:18.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.306+0000 7f19e27fc700 1 -- 172.21.15.96:0/1360539385 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f19ec0fdd60 con 0x7f19d8064e20 2022-02-02T22:36:18.307 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:36:18.307 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:36:18.307 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:36:18.308 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:36:18.309 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:36:18.309 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:36:18.310 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:36:18.310 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:36:18.311 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:36:18.311 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:36:18.312 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:36:18.312 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:36:18.313 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:36:18.313 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:36:18.314 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:36:18.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:36:18.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:36:18.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:36:18.316 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:36:18.317 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:36:18.317 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:36:18.318 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:36:18.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 msgr2=0x7f19d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 0x7f19d80672e0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7f19e8004630 tx=0x7f19e8009b30).stop 2022-02-02T22:36:18.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 msgr2=0x7f19ec109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 secure :-1 s=READY pgs=3896 cs=0 l=1 rev1=1 rx=0x7f19dc002700 tx=0x7f19dc009d60).stop 2022-02-02T22:36:18.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 shutdown_connections 2022-02-02T22:36:18.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19d8064e20 0x7f19d80672e0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19ec0f5440 0x7f19ec109a90 unknown :-1 s=CLOSED pgs=3896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 --2- 172.21.15.96:0/1360539385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19ec0f66e0 0x7f19ec10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 >> 172.21.15.96:0/1360539385 conn(0x7f19ec0f0ba0 msgr2=0x7f19ec0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 shutdown_connections 2022-02-02T22:36:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.308+0000 7f19f28a8700 1 -- 172.21.15.96:0/1360539385 wait complete. 2022-02-02T22:36:18.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 -- 172.21.15.96:0/1320044355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6880 msgr2=0x7fd8b00f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/1320044355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6880 0x7fd8b00f6ce0 secure :-1 s=READY pgs=3897 cs=0 l=1 rev1=1 rx=0x7fd8a4004660 tx=0x7fd8a4009b30).stop 2022-02-02T22:36:18.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 -- 172.21.15.96:0/1320044355 shutdown_connections 2022-02-02T22:36:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/1320044355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f6880 0x7fd8b00f6ce0 unknown :-1 s=CLOSED pgs=3897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/1320044355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f55e0 0x7fd8b00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 -- 172.21.15.96:0/1320044355 >> 172.21.15.96:0/1320044355 conn(0x7fd8b00f0d40 msgr2=0x7fd8b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 -- 172.21.15.96:0/1320044355 shutdown_connections 2022-02-02T22:36:18.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.405+0000 7fd8b59dc700 1 -- 172.21.15.96:0/1320044355 wait complete. 2022-02-02T22:36:18.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 Processor -- start 2022-02-02T22:36:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 -- start start 2022-02-02T22:36:18.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 0x7fd8b01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0109b90 con 0x7fd8b00f55e0 2022-02-02T22:36:18.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8b59dc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0109cd0 con 0x7fd8b00f6880 2022-02-02T22:36:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8aeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8aeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49374/0 (socket says 172.21.15.96:49374) 2022-02-02T22:36:18.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8aeffd700 1 -- 172.21.15.96:0/2992482407 learned_addr learned my addr 172.21.15.96:0/2992482407 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.406+0000 7fd8ae7fc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 0x7fd8b01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8aeffd700 1 -- 172.21.15.96:0/2992482407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 msgr2=0x7fd8b01095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8aeffd700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 0x7fd8b01095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8aeffd700 1 -- 172.21.15.96:0/2992482407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4005040 con 0x7fd8b00f55e0 2022-02-02T22:36:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8ae7fc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 0x7fd8b01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:36:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8aeffd700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 secure :-1 s=READY pgs=3898 cs=0 l=1 rev1=1 rx=0x7fd8a0002700 tx=0x7fd8a0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a0009320 con 0x7fd8b00f55e0 2022-02-02T22:36:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8a000f040 con 0x7fd8b00f55e0 2022-02-02T22:36:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.407+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a00148e0 con 0x7fd8b00f55e0 2022-02-02T22:36:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.408+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b010a670 con 0x7fd8b00f55e0 2022-02-02T22:36:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.408+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b010abe0 con 0x7fd8b00f55e0 2022-02-02T22:36:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.409+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0045ad0 con 0x7fd8b00f55e0 2022-02-02T22:36:18.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.409+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8a0009480 con 0x7fd8b00f55e0 2022-02-02T22:36:18.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.409+0000 7fd8977fe700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 0x7fd898067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.409+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd8a0081d90 con 0x7fd8b00f55e0 2022-02-02T22:36:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.409+0000 7fd8ae7fc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 0x7fd898067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.410+0000 7fd8ae7fc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 0x7fd898067290 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 rx=0x7fd8a4004630 tx=0x7fd8a4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.414+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8a00538c0 con 0x7fd8b00f55e0 2022-02-02T22:36:18.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.646+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd8b010f710 con 0x7fd8b00f55e0 2022-02-02T22:36:18.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.646+0000 7fd8977fe700 1 -- 172.21.15.96:0/2992482407 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd8a00534b0 con 0x7fd8b00f55e0 2022-02-02T22:36:18.647 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:36:18.647 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:36:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:36:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:18.649 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:36:18.649 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:36:18.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:36:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:36:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:36:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:36:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:36:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:36:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:36:18.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:36:18.653 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:36:18.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 msgr2=0x7fd898067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 0x7fd898067290 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 rx=0x7fd8a4004630 tx=0x7fd8a4009b30).stop 2022-02-02T22:36:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 msgr2=0x7fd8b01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 secure :-1 s=READY pgs=3898 cs=0 l=1 rev1=1 rx=0x7fd8a0002700 tx=0x7fd8a0009e00).stop 2022-02-02T22:36:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 shutdown_connections 2022-02-02T22:36:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd898064dd0 0x7fd898067290 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8b00f55e0 0x7fd8b01090f0 unknown :-1 s=CLOSED pgs=3898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 --2- 172.21.15.96:0/2992482407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b00f6880 0x7fd8b01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 >> 172.21.15.96:0/2992482407 conn(0x7fd8b00f0d40 msgr2=0x7fd8b005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 shutdown_connections 2022-02-02T22:36:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.648+0000 7fd8b59dc700 1 -- 172.21.15.96:0/2992482407 wait complete. 2022-02-02T22:36:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 -- 172.21.15.96:0/199094687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f55c0 msgr2=0x7f33540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 --2- 172.21.15.96:0/199094687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f55c0 0x7f33540f59e0 secure :-1 s=READY pgs=3899 cs=0 l=1 rev1=1 rx=0x7f3348004660 tx=0x7f3348009b30).stop 2022-02-02T22:36:18.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 -- 172.21.15.96:0/199094687 shutdown_connections 2022-02-02T22:36:18.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 --2- 172.21.15.96:0/199094687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f6860 0x7f33540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 --2- 172.21.15.96:0/199094687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f55c0 0x7f33540f59e0 unknown :-1 s=CLOSED pgs=3899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 -- 172.21.15.96:0/199094687 >> 172.21.15.96:0/199094687 conn(0x7f33540f0d40 msgr2=0x7f33540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 -- 172.21.15.96:0/199094687 shutdown_connections 2022-02-02T22:36:18.748 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:18 smithi096 ceph-mon[101353]: pgmap v7625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.745+0000 7f3359943700 1 -- 172.21.15.96:0/199094687 wait complete. 2022-02-02T22:36:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 Processor -- start 2022-02-02T22:36:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 -- start start 2022-02-02T22:36:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f55c0 0x7f33540f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540f8920 con 0x7f33540f6860 2022-02-02T22:36:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3359943700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540f8a60 con 0x7f33540f55c0 2022-02-02T22:36:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49386/0 (socket says 172.21.15.96:49386) 2022-02-02T22:36:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f3352ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f55c0 0x7f33540f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 -- 172.21.15.96:0/2925622141 learned_addr learned my addr 172.21.15.96:0/2925622141 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 -- 172.21.15.96:0/2925622141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f55c0 msgr2=0x7f33540f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f55c0 0x7f33540f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.746+0000 7f33527fc700 1 -- 172.21.15.96:0/2925622141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348005040 con 0x7f33540f6860 2022-02-02T22:36:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f33527fc700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 secure :-1 s=READY pgs=3900 cs=0 l=1 rev1=1 rx=0x7f33440026d0 tx=0x7f3344009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33440079c0 con 0x7f33540f6860 2022-02-02T22:36:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540f8d40 con 0x7f33540f6860 2022-02-02T22:36:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f334400f040 con 0x7f33540f6860 2022-02-02T22:36:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33440148b0 con 0x7f33540f6860 2022-02-02T22:36:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.747+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335410f000 con 0x7f33540f6860 2022-02-02T22:36:18.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.748+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3344007b20 con 0x7f33540f6860 2022-02-02T22:36:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.749+0000 7f333b7fe700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 0x7f333c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.749+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3344081a00 con 0x7f33540f6860 2022-02-02T22:36:18.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.749+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540f49b0 con 0x7f33540f6860 2022-02-02T22:36:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.749+0000 7f3352ffd700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 0x7f333c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:18.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.749+0000 7f3352ffd700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 0x7f333c067290 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7f3348013690 tx=0x7f3348009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.753+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f334404fbb0 con 0x7f33540f6860 2022-02-02T22:36:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.957+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3354045ad0 con 0x7f33540f6860 2022-02-02T22:36:18.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.958+0000 7f333b7fe700 1 -- 172.21.15.96:0/2925622141 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f33440531d0 con 0x7f33540f6860 2022-02-02T22:36:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:36:18.959 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:36:18.960 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:36:18.960 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:36:18.960 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:18.961 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:36:18.961 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:36:18.962 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:36:18.962 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:36:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:36:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:36:18.963 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:36:18.964 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:36:18.964 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:36:18.964 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:36:18.965 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:36:18.965 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:36:18.965 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:36:18.966 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:36:18.966 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:36:18.966 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:36:18.967 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:36:18.967 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:36:18.967 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:36:18.968 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:36:18.968 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:36:18.968 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:36:18.969 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:36:18.969 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:36:18.970 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:36:18.970 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:36:18.970 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:36:18.971 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:18.971 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:18.971 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:36:18.972 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:18.972 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:18.972 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:18.973 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.959+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 msgr2=0x7f333c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.959+0000 7f3359943700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 0x7f333c067290 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7f3348013690 tx=0x7f3348009b30).stop 2022-02-02T22:36:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 msgr2=0x7f33540f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 secure :-1 s=READY pgs=3900 cs=0 l=1 rev1=1 rx=0x7f33440026d0 tx=0x7f3344009de0).stop 2022-02-02T22:36:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 shutdown_connections 2022-02-02T22:36:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f333c064dd0 0x7f333c067290 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33540f55c0 0x7f33540f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 --2- 172.21.15.96:0/2925622141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540f6860 0x7f33540f83c0 unknown :-1 s=CLOSED pgs=3900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:18.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 >> 172.21.15.96:0/2925622141 conn(0x7f33540f0d40 msgr2=0x7f335405f720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:18.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 shutdown_connections 2022-02-02T22:36:18.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:18.960+0000 7f3359943700 1 -- 172.21.15.96:0/2925622141 wait complete. 2022-02-02T22:36:18.978 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:36:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:18 smithi159 ceph-mon[69013]: pgmap v7625: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:20.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:19 smithi159 ceph-mon[69013]: from='client.41908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:20.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:19 smithi159 ceph-mon[69013]: from='client.41912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:20.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2992482407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:36:20.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2925622141' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:36:20.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:19 smithi096 ceph-mon[101353]: from='client.41908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:19 smithi096 ceph-mon[101353]: from='client.41912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2992482407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:36:20.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2925622141' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:36:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:20 smithi159 ceph-mon[69013]: pgmap v7626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:20 smithi096 ceph-mon[101353]: pgmap v7626: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:22 smithi159 ceph-mon[69013]: pgmap v7627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:22 smithi096 ceph-mon[101353]: pgmap v7627: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:25.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:24 smithi159 ceph-mon[69013]: pgmap v7628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:24 smithi096 ceph-mon[101353]: pgmap v7628: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:26 smithi159 ceph-mon[69013]: pgmap v7629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:27.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:26 smithi096 ceph-mon[101353]: pgmap v7629: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:28 smithi159 ceph-mon[69013]: pgmap v7630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:36:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:36:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:28 smithi096 ceph-mon[101353]: pgmap v7630: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:36:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:36:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:30 smithi159 ceph-mon[69013]: pgmap v7631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:30 smithi096 ceph-mon[101353]: pgmap v7631: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:32 smithi159 ceph-mon[69013]: pgmap v7632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:32 smithi096 ceph-mon[101353]: pgmap v7632: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:34 smithi159 ceph-mon[69013]: pgmap v7633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:34 smithi096 ceph-mon[101353]: pgmap v7633: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:36 smithi159 ceph-mon[69013]: pgmap v7634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:36 smithi096 ceph-mon[101353]: pgmap v7634: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:38 smithi159 ceph-mon[69013]: pgmap v7635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:38 smithi096 ceph-mon[101353]: pgmap v7635: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:40 smithi159 ceph-mon[69013]: pgmap v7636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:40 smithi096 ceph-mon[101353]: pgmap v7636: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:42 smithi159 ceph-mon[69013]: pgmap v7637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:42 smithi096 ceph-mon[101353]: pgmap v7637: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:44 smithi159 ceph-mon[69013]: pgmap v7638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:44 smithi096 ceph-mon[101353]: pgmap v7638: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:46 smithi159 ceph-mon[69013]: pgmap v7639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:46 smithi096 ceph-mon[101353]: pgmap v7639: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:48 smithi159 ceph-mon[69013]: pgmap v7640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:48 smithi096 ceph-mon[101353]: pgmap v7640: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 -- 172.21.15.96:0/3439138603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940602b0 msgr2=0x7f1a940f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 --2- 172.21.15.96:0/3439138603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940602b0 0x7f1a940f9170 secure :-1 s=READY pgs=3901 cs=0 l=1 rev1=1 rx=0x7f1a88004660 tx=0x7f1a88009b30).stop 2022-02-02T22:36:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 -- 172.21.15.96:0/3439138603 shutdown_connections 2022-02-02T22:36:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 --2- 172.21.15.96:0/3439138603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940f96f0 0x7f1a940fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 --2- 172.21.15.96:0/3439138603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940602b0 0x7f1a940f9170 unknown :-1 s=CLOSED pgs=3901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 -- 172.21.15.96:0/3439138603 >> 172.21.15.96:0/3439138603 conn(0x7f1a940f0b90 msgr2=0x7f1a940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 -- 172.21.15.96:0/3439138603 shutdown_connections 2022-02-02T22:36:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 -- 172.21.15.96:0/3439138603 wait complete. 2022-02-02T22:36:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.070+0000 7f1a98d39700 1 Processor -- start 2022-02-02T22:36:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a98d39700 1 -- start start 2022-02-02T22:36:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a98d39700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940602b0 0x7f1a940f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a98d39700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a98d39700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940f55d0 con 0x7f1a940f96f0 2022-02-02T22:36:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a98d39700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940f5710 con 0x7f1a940602b0 2022-02-02T22:36:49.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49408/0 (socket says 172.21.15.96:49408) 2022-02-02T22:36:49.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 -- 172.21.15.96:0/4088710541 learned_addr learned my addr 172.21.15.96:0/4088710541 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a937fe700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940602b0 0x7f1a940f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 -- 172.21.15.96:0/4088710541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940602b0 msgr2=0x7f1a940f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940602b0 0x7f1a940f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 -- 172.21.15.96:0/4088710541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88005040 con 0x7f1a940f96f0 2022-02-02T22:36:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.071+0000 7f1a92ffd700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 secure :-1 s=READY pgs=3902 cs=0 l=1 rev1=1 rx=0x7f1a84002700 tx=0x7f1a84009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.072+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a840079c0 con 0x7f1a940f96f0 2022-02-02T22:36:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.072+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1a8400f040 con 0x7f1a940f96f0 2022-02-02T22:36:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.072+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940f59f0 con 0x7f1a940f96f0 2022-02-02T22:36:49.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.072+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a84014740 con 0x7f1a940f96f0 2022-02-02T22:36:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.072+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9410ed90 con 0x7f1a940f96f0 2022-02-02T22:36:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.073+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a94045ad0 con 0x7f1a940f96f0 2022-02-02T22:36:49.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.073+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1a8401b060 con 0x7f1a940f96f0 2022-02-02T22:36:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.074+0000 7f1a7bfff700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 0x7f1a7c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.074+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1a84081860 con 0x7f1a940f96f0 2022-02-02T22:36:49.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.074+0000 7f1a937fe700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 0x7f1a7c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.074+0000 7f1a937fe700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 0x7f1a7c0672e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 rx=0x7f1a88004630 tx=0x7f1a88009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.078+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1a8404f900 con 0x7f1a940f96f0 2022-02-02T22:36:49.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.258+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a940fee20 con 0x7f1a7c064e20 2022-02-02T22:36:49.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.259+0000 7f1a7bfff700 1 -- 172.21.15.96:0/4088710541 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1a940fee20 con 0x7f1a7c064e20 2022-02-02T22:36:49.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 msgr2=0x7f1a7c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 0x7f1a7c0672e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 rx=0x7f1a88004630 tx=0x7f1a88009b30).stop 2022-02-02T22:36:49.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 msgr2=0x7f1a940f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 secure :-1 s=READY pgs=3902 cs=0 l=1 rev1=1 rx=0x7f1a84002700 tx=0x7f1a84009d60).stop 2022-02-02T22:36:49.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 shutdown_connections 2022-02-02T22:36:49.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1a7c064e20 0x7f1a7c0672e0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a940602b0 0x7f1a940f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 --2- 172.21.15.96:0/4088710541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a940f96f0 0x7f1a940f5070 unknown :-1 s=CLOSED pgs=3902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 >> 172.21.15.96:0/4088710541 conn(0x7f1a940f0b90 msgr2=0x7f1a940f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 shutdown_connections 2022-02-02T22:36:49.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.261+0000 7f1a98d39700 1 -- 172.21.15.96:0/4088710541 wait complete. 2022-02-02T22:36:49.272 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:36:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 -- 172.21.15.96:0/3517392606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f7970 msgr2=0x7f723c0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 --2- 172.21.15.96:0/3517392606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f7970 0x7f723c0f7dd0 secure :-1 s=READY pgs=3903 cs=0 l=1 rev1=1 rx=0x7f7230004660 tx=0x7f7230009b30).stop 2022-02-02T22:36:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 -- 172.21.15.96:0/3517392606 shutdown_connections 2022-02-02T22:36:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 --2- 172.21.15.96:0/3517392606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f7970 0x7f723c0f7dd0 unknown :-1 s=CLOSED pgs=3903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 --2- 172.21.15.96:0/3517392606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f66d0 0x7f723c0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:36:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.359+0000 7f7242662700 1 -- 172.21.15.96:0/3517392606 >> 172.21.15.96:0/3517392606 conn(0x7f723c0f1e50 msgr2=0x7f723c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.360+0000 7f7242662700 1 -- 172.21.15.96:0/3517392606 shutdown_connections 2022-02-02T22:36:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.360+0000 7f7242662700 1 -- 172.21.15.96:0/3517392606 wait complete. 2022-02-02T22:36:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.360+0000 7f7242662700 1 Processor -- start 2022-02-02T22:36:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f7242662700 1 -- start start 2022-02-02T22:36:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f7242662700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f7242662700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 0x7f723c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f7242662700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c107aa0 con 0x7f723c0f66d0 2022-02-02T22:36:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f7242662700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c108350 con 0x7f723c0f7970 2022-02-02T22:36:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49416/0 (socket says 172.21.15.96:49416) 2022-02-02T22:36:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 -- 172.21.15.96:0/592262460 learned_addr learned my addr 172.21.15.96:0/592262460 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723b7fe700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 0x7f723c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 -- 172.21.15.96:0/592262460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 msgr2=0x7f723c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 0x7f723c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.361+0000 7f723bfff700 1 -- 172.21.15.96:0/592262460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230005040 con 0x7f723c0f66d0 2022-02-02T22:36:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f723b7fe700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 0x7f723c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:36:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f723bfff700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 secure :-1 s=READY pgs=3904 cs=0 l=1 rev1=1 rx=0x7f722c0093f0 tx=0x7f722c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722c009ea0 con 0x7f723c0f66d0 2022-02-02T22:36:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f722c013af0 con 0x7f723c0f66d0 2022-02-02T22:36:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c108630 con 0x7f723c0f66d0 2022-02-02T22:36:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722c00db10 con 0x7f723c0f66d0 2022-02-02T22:36:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.362+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c108bf0 con 0x7f723c0f66d0 2022-02-02T22:36:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.363+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c004fa0 con 0x7f723c0f66d0 2022-02-02T22:36:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.363+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f722c01a060 con 0x7f723c0f66d0 2022-02-02T22:36:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.364+0000 7f7238ff9700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 0x7f7224067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.364+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f722c0819e0 con 0x7f723c0f66d0 2022-02-02T22:36:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.364+0000 7f723b7fe700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 0x7f7224067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.364+0000 7f723b7fe700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 0x7f7224067290 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 rx=0x7f7230004e30 tx=0x7f7230009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.368+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f722c053510 con 0x7f723c0f66d0 2022-02-02T22:36:49.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.540+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f721c000bc0 con 0x7f7224064dd0 2022-02-02T22:36:49.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.549+0000 7f7238ff9700 1 -- 172.21.15.96:0/592262460 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f721c000bc0 con 0x7f7224064dd0 2022-02-02T22:36:49.550 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:36:49.551 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:36:49.551 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:36:49.551 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:36:49.552 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:36:49.552 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:36:49.552 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:36:49.553 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:36:49.553 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:36:49.553 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:36:49.554 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:36:49.554 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:36:49.554 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:36:49.555 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:36:49.555 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:36:49.556 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:36:49.556 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:36:49.557 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:36:49.557 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:36:49.557 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:36:49.558 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:36:49.558 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:36:49.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 msgr2=0x7f7224067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 0x7f7224067290 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 rx=0x7f7230004e30 tx=0x7f7230009b30).stop 2022-02-02T22:36:49.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 msgr2=0x7f723c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 secure :-1 s=READY pgs=3904 cs=0 l=1 rev1=1 rx=0x7f722c0093f0 tx=0x7f722c006ec0).stop 2022-02-02T22:36:49.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 shutdown_connections 2022-02-02T22:36:49.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7224064dd0 0x7f7224067290 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f723c0f66d0 0x7f723c106f70 unknown :-1 s=CLOSED pgs=3904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 --2- 172.21.15.96:0/592262460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f723c0f7970 0x7f723c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 >> 172.21.15.96:0/592262460 conn(0x7f723c0f1e50 msgr2=0x7f723c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 shutdown_connections 2022-02-02T22:36:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.551+0000 7f7242662700 1 -- 172.21.15.96:0/592262460 wait complete. 2022-02-02T22:36:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- 172.21.15.96:0/3989128247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 msgr2=0x7f8a3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 --2- 172.21.15.96:0/3989128247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c0f59e0 secure :-1 s=READY pgs=3905 cs=0 l=1 rev1=1 rx=0x7f8a30004660 tx=0x7f8a30009b30).stop 2022-02-02T22:36:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- 172.21.15.96:0/3989128247 shutdown_connections 2022-02-02T22:36:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 --2- 172.21.15.96:0/3989128247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 0x7f8a3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:36:49.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 --2- 172.21.15.96:0/3989128247 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c0f59e0 unknown :-1 s=CLOSED pgs=3905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- 172.21.15.96:0/3989128247 >> 172.21.15.96:0/3989128247 conn(0x7f8a3c0f0d40 msgr2=0x7f8a3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- 172.21.15.96:0/3989128247 shutdown_connections 2022-02-02T22:36:49.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- 172.21.15.96:0/3989128247 wait complete. 2022-02-02T22:36:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 Processor -- start 2022-02-02T22:36:49.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.647+0000 7f8a418af700 1 -- start start 2022-02-02T22:36:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a418af700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a418af700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 0x7f8a3c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a418af700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c107ac0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a418af700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c108370 con 0x7f8a3c0f6860 2022-02-02T22:36:49.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49426/0 (socket says 172.21.15.96:49426) 2022-02-02T22:36:49.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 -- 172.21.15.96:0/2281713911 learned_addr learned my addr 172.21.15.96:0/2281713911 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:49.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3a7fc700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 0x7f8a3c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 -- 172.21.15.96:0/2281713911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 msgr2=0x7f8a3c107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 0x7f8a3c107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 -- 172.21.15.96:0/2281713911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30005040 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.648+0000 7f8a3affd700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 secure :-1 s=READY pgs=3906 cs=0 l=1 rev1=1 rx=0x7f8a30004f60 tx=0x7f8a30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.649+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a30018070 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.649+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a30007ba0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.649+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3001c620 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.649+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c1085f0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.649+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c108ad0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.650+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c045ad0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.650+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a3001c8e0 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.651+0000 7f8a237fe700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 0x7f8a2406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.651+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a30083e10 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.651+0000 7f8a3a7fc700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 0x7f8a2406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.651+0000 7f8a3a7fc700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 0x7f8a2406b6a0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 rx=0x7f8a2c00b790 tx=0x7f8a2c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.654+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a30055940 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.885+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a3c109110 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.885+0000 7f8a237fe700 1 -- 172.21.15.96:0/2281713911 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8a30055530 con 0x7f8a3c0f55c0 2022-02-02T22:36:49.887 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:36:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:36:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:36:49.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:36:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:36:49.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:36:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:36:49.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:36:49.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:36:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:36:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:36:49.892 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:36:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:36:49.893 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:36:49.893 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:36:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 msgr2=0x7f8a2406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 0x7f8a2406b6a0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 rx=0x7f8a2c00b790 tx=0x7f8a2c008040).stop 2022-02-02T22:36:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 msgr2=0x7f8a3c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 secure :-1 s=READY pgs=3906 cs=0 l=1 rev1=1 rx=0x7f8a30004f60 tx=0x7f8a30009b30).stop 2022-02-02T22:36:49.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 shutdown_connections 2022-02-02T22:36:49.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a240691e0 0x7f8a2406b6a0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a3c0f55c0 0x7f8a3c106f90 unknown :-1 s=CLOSED pgs=3906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 --2- 172.21.15.96:0/2281713911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a3c0f6860 0x7f8a3c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.887+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 >> 172.21.15.96:0/2281713911 conn(0x7f8a3c0f0d40 msgr2=0x7f8a3c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.888+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 shutdown_connections 2022-02-02T22:36:49.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.888+0000 7f8a418af700 1 -- 172.21.15.96:0/2281713911 wait complete. 2022-02-02T22:36:49.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 -- 172.21.15.96:0/2656814492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f77d0 msgr2=0x7f7c740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 --2- 172.21.15.96:0/2656814492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f77d0 0x7f7c740f7c30 secure :-1 s=READY pgs=3907 cs=0 l=1 rev1=1 rx=0x7f7c60004660 tx=0x7f7c60009b30).stop 2022-02-02T22:36:49.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 -- 172.21.15.96:0/2656814492 shutdown_connections 2022-02-02T22:36:49.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 --2- 172.21.15.96:0/2656814492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f77d0 0x7f7c740f7c30 unknown :-1 s=CLOSED pgs=3907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 --2- 172.21.15.96:0/2656814492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f6530 0x7f7c740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 -- 172.21.15.96:0/2656814492 >> 172.21.15.96:0/2656814492 conn(0x7f7c740f1c90 msgr2=0x7f7c740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 -- 172.21.15.96:0/2656814492 shutdown_connections 2022-02-02T22:36:49.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.984+0000 7f7c79f21700 1 -- 172.21.15.96:0/2656814492 wait complete. 2022-02-02T22:36:49.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 Processor -- start 2022-02-02T22:36:49.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 -- start start 2022-02-02T22:36:49.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 0x7f7c74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7406a380 con 0x7f7c740f6530 2022-02-02T22:36:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.985+0000 7f7c79f21700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7406a4c0 con 0x7f7c740f77d0 2022-02-02T22:36:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49434/0 (socket says 172.21.15.96:49434) 2022-02-02T22:36:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 -- 172.21.15.96:0/1517114730 learned_addr learned my addr 172.21.15.96:0/1517114730 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:36:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c73fff700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 0x7f7c74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 -- 172.21.15.96:0/1517114730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 msgr2=0x7f7c74069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 0x7f7c74069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 -- 172.21.15.96:0/1517114730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60005040 con 0x7f7c740f6530 2022-02-02T22:36:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c73fff700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 0x7f7c74069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:36:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c78f1f700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 secure :-1 s=READY pgs=3908 cs=0 l=1 rev1=1 rx=0x7f7c6800c530 tx=0x7f7c68007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6800f650 con 0x7f7c740f6530 2022-02-02T22:36:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c6800fc60 con 0x7f7c740f6530 2022-02-02T22:36:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c68012d20 con 0x7f7c740f6530 2022-02-02T22:36:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.986+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7406a7a0 con 0x7f7c740f6530 2022-02-02T22:36:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.987+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7410ed50 con 0x7f7c740f6530 2022-02-02T22:36:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.988+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74045ad0 con 0x7f7c740f6530 2022-02-02T22:36:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.988+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c68019030 con 0x7f7c740f6530 2022-02-02T22:36:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.989+0000 7f7c717fa700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 0x7f7c640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:36:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.989+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7c68081710 con 0x7f7c740f6530 2022-02-02T22:36:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.989+0000 7f7c73fff700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 0x7f7c640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:36:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.989+0000 7f7c73fff700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 0x7f7c640672e0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f7c60009da0 tx=0x7f7c60009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:36:50.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:49.993+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c6804f860 con 0x7f7c740f6530 2022-02-02T22:36:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.194+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7c740fedc0 con 0x7f7c740f6530 2022-02-02T22:36:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.195+0000 7f7c717fa700 1 -- 172.21.15.96:0/1517114730 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7c68052e80 con 0x7f7c740f6530 2022-02-02T22:36:50.197 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:36:50.197 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:36:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:36:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:36:50.198 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:50.199 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:36:50.199 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:36:50.199 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:36:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:36:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:36:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:36:50.201 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:36:50.201 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:36:50.201 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:36:50.202 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:36:50.202 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:36:50.203 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:36:50.203 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:36:50.203 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:36:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:36:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:36:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:36:50.205 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:36:50.205 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:36:50.205 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:36:50.206 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:36:50.206 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:36:50.207 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:36:50.207 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:36:50.207 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:36:50.208 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:36:50.208 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:36:50.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:50.209 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:36:50.209 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:36:50.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:50.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:50.210 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:36:50.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 msgr2=0x7f7c640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:50.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 0x7f7c640672e0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f7c60009da0 tx=0x7f7c60009b30).stop 2022-02-02T22:36:50.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 msgr2=0x7f7c7406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:36:50.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 secure :-1 s=READY pgs=3908 cs=0 l=1 rev1=1 rx=0x7f7c6800c530 tx=0x7f7c68007e10).stop 2022-02-02T22:36:50.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 shutdown_connections 2022-02-02T22:36:50.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7c64064e20 0x7f7c640672e0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:50.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c740f6530 0x7f7c7406b9a0 unknown :-1 s=CLOSED pgs=3908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:50.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 --2- 172.21.15.96:0/1517114730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c740f77d0 0x7f7c74069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:36:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 >> 172.21.15.96:0/1517114730 conn(0x7f7c740f1c90 msgr2=0x7f7c740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:36:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 shutdown_connections 2022-02-02T22:36:50.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:36:50.197+0000 7f7c79f21700 1 -- 172.21.15.96:0/1517114730 wait complete. 2022-02-02T22:36:50.216 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:36:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:50 smithi159 ceph-mon[69013]: from='client.41924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:50 smithi159 ceph-mon[69013]: pgmap v7641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:50 smithi159 ceph-mon[69013]: from='client.41928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2281713911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:36:51.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:50 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1517114730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:36:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:50 smithi096 ceph-mon[101353]: from='client.41924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:50 smithi096 ceph-mon[101353]: pgmap v7641: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:50 smithi096 ceph-mon[101353]: from='client.41928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:36:51.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2281713911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:36:51.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:50 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1517114730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:36:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:52 smithi159 ceph-mon[69013]: pgmap v7642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:52 smithi096 ceph-mon[101353]: pgmap v7642: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:54 smithi159 ceph-mon[69013]: pgmap v7643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:54 smithi096 ceph-mon[101353]: pgmap v7643: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:57.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:56 smithi159 ceph-mon[69013]: pgmap v7644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:56 smithi096 ceph-mon[101353]: pgmap v7644: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:36:58 smithi159 ceph-mon[69013]: pgmap v7645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:36:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:36:58 smithi096 ceph-mon[101353]: pgmap v7645: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:00 smithi159 ceph-mon[69013]: pgmap v7646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:00 smithi096 ceph-mon[101353]: pgmap v7646: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:02 smithi159 ceph-mon[69013]: pgmap v7647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:02 smithi096 ceph-mon[101353]: pgmap v7647: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:05.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:04 smithi159 ceph-mon[69013]: pgmap v7648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:04 smithi096 ceph-mon[101353]: pgmap v7648: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:06 smithi159 ceph-mon[69013]: pgmap v7649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:06 smithi096 ceph-mon[101353]: pgmap v7649: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:08 smithi159 ceph-mon[69013]: pgmap v7650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:08 smithi096 ceph-mon[101353]: pgmap v7650: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:10 smithi159 ceph-mon[69013]: pgmap v7651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:10 smithi096 ceph-mon[101353]: pgmap v7651: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:12 smithi159 ceph-mon[69013]: pgmap v7652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:12 smithi096 ceph-mon[101353]: pgmap v7652: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:14 smithi159 ceph-mon[69013]: pgmap v7653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:14 smithi096 ceph-mon[101353]: pgmap v7653: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:16 smithi159 ceph-mon[69013]: pgmap v7654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:16 smithi096 ceph-mon[101353]: pgmap v7654: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:18 smithi159 ceph-mon[69013]: pgmap v7655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:18 smithi096 ceph-mon[101353]: pgmap v7655: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:20.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 -- 172.21.15.96:0/1047313405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 msgr2=0x7f9f8c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 --2- 172.21.15.96:0/1047313405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c0f5850 secure :-1 s=READY pgs=3909 cs=0 l=1 rev1=1 rx=0x7f9f7c004660 tx=0x7f9f7c009b30).stop 2022-02-02T22:37:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 -- 172.21.15.96:0/1047313405 shutdown_connections 2022-02-02T22:37:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 --2- 172.21.15.96:0/1047313405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 0x7f9f8c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 --2- 172.21.15.96:0/1047313405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c0f5850 unknown :-1 s=CLOSED pgs=3909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.308+0000 7f9f933e5700 1 -- 172.21.15.96:0/1047313405 >> 172.21.15.96:0/1047313405 conn(0x7f9f8c0f0b90 msgr2=0x7f9f8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.309+0000 7f9f933e5700 1 -- 172.21.15.96:0/1047313405 shutdown_connections 2022-02-02T22:37:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.309+0000 7f9f933e5700 1 -- 172.21.15.96:0/1047313405 wait complete. 2022-02-02T22:37:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.309+0000 7f9f933e5700 1 Processor -- start 2022-02-02T22:37:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.309+0000 7f9f933e5700 1 -- start start 2022-02-02T22:37:20.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f933e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f933e5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 0x7f9f8c106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f933e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1067d0 con 0x7f9f8c0f5430 2022-02-02T22:37:20.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f933e5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c106fd0 con 0x7f9f8c0f66d0 2022-02-02T22:37:20.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49452/0 (socket says 172.21.15.96:49452) 2022-02-02T22:37:20.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 -- 172.21.15.96:0/3344461748 learned_addr learned my addr 172.21.15.96:0/3344461748 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:20.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f91be2700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 0x7f9f8c106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 -- 172.21.15.96:0/3344461748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 msgr2=0x7f9f8c106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 0x7f9f8c106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 -- 172.21.15.96:0/3344461748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c005040 con 0x7f9f8c0f5430 2022-02-02T22:37:20.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f923e3700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 secure :-1 s=READY pgs=3910 cs=0 l=1 rev1=1 rx=0x7f9f7c004f60 tx=0x7f9f7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c018070 con 0x7f9f8c0f5430 2022-02-02T22:37:20.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f7c007ba0 con 0x7f9f8c0f5430 2022-02-02T22:37:20.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c01c620 con 0x7f9f8c0f5430 2022-02-02T22:37:20.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.310+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c107250 con 0x7f9f8c0f5430 2022-02-02T22:37:20.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.311+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c1077b0 con 0x7f9f8c0f5430 2022-02-02T22:37:20.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.311+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c059100 con 0x7f9f8c0f5430 2022-02-02T22:37:20.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.312+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f7c01c8e0 con 0x7f9f8c0f5430 2022-02-02T22:37:20.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.312+0000 7f9f82ffd700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 0x7f9f780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.312+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f7c083960 con 0x7f9f8c0f5430 2022-02-02T22:37:20.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.312+0000 7f9f91be2700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 0x7f9f780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.313+0000 7f9f91be2700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 0x7f9f780672e0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 rx=0x7f9f880041d0 tx=0x7f9f88009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.317+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f7c055490 con 0x7f9f8c0f5430 2022-02-02T22:37:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.496+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8c0fdcb0 con 0x7f9f78064e20 2022-02-02T22:37:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.497+0000 7f9f82ffd700 1 -- 172.21.15.96:0/3344461748 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9f8c0fdcb0 con 0x7f9f78064e20 2022-02-02T22:37:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.498+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 msgr2=0x7f9f780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.498+0000 7f9f933e5700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 0x7f9f780672e0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 rx=0x7f9f880041d0 tx=0x7f9f88009040).stop 2022-02-02T22:37:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 msgr2=0x7f9f8c105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 secure :-1 s=READY pgs=3910 cs=0 l=1 rev1=1 rx=0x7f9f7c004f60 tx=0x7f9f7c009b30).stop 2022-02-02T22:37:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 shutdown_connections 2022-02-02T22:37:20.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9f78064e20 0x7f9f780672e0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f8c0f5430 0x7f9f8c105d30 unknown :-1 s=CLOSED pgs=3910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 --2- 172.21.15.96:0/3344461748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f8c0f66d0 0x7f9f8c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 >> 172.21.15.96:0/3344461748 conn(0x7f9f8c0f0b90 msgr2=0x7f9f8c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:20.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 shutdown_connections 2022-02-02T22:37:20.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.499+0000 7f9f933e5700 1 -- 172.21.15.96:0/3344461748 wait complete. 2022-02-02T22:37:20.508 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:37:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 -- 172.21.15.96:0/1224578770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 msgr2=0x7f06740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1224578770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f06740f6b00 secure :-1 s=READY pgs=3911 cs=0 l=1 rev1=1 rx=0x7f0664004660 tx=0x7f0664009b30).stop 2022-02-02T22:37:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 -- 172.21.15.96:0/1224578770 shutdown_connections 2022-02-02T22:37:20.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1224578770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1224578770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f06740f6b00 unknown :-1 s=CLOSED pgs=3911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 -- 172.21.15.96:0/1224578770 >> 172.21.15.96:0/1224578770 conn(0x7f06740f1e40 msgr2=0x7f06740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 -- 172.21.15.96:0/1224578770 shutdown_connections 2022-02-02T22:37:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.595+0000 7f067a5c9700 1 -- 172.21.15.96:0/1224578770 wait complete. 2022-02-02T22:37:20.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 Processor -- start 2022-02-02T22:37:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 -- start start 2022-02-02T22:37:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f0674106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0674107a50 con 0x7f06740f66e0 2022-02-02T22:37:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f067a5c9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0674107b90 con 0x7f06740f7980 2022-02-02T22:37:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.596+0000 7f06737fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:53568/0 (socket says 172.21.15.96:53568) 2022-02-02T22:37:20.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 -- 172.21.15.96:0/1701304243 learned_addr learned my addr 172.21.15.96:0/1701304243 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:20.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f0673fff700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f0674106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 -- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 msgr2=0x7f0674106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f0674106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 -- 172.21.15.96:0/1701304243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664005040 con 0x7f06740f7980 2022-02-02T22:37:20.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f0673fff700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f0674106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:37:20.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f06737fe700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f066800c530 tx=0x7f0668007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066800f650 con 0x7f06740f7980 2022-02-02T22:37:20.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0674108530 con 0x7f06740f7980 2022-02-02T22:37:20.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f066800fc60 con 0x7f06740f7980 2022-02-02T22:37:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.597+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0668012cd0 con 0x7f06740f7980 2022-02-02T22:37:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.598+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0674108af0 con 0x7f06740f7980 2022-02-02T22:37:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.598+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674045ad0 con 0x7f06740f7980 2022-02-02T22:37:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.599+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0668010070 con 0x7f06740f7980 2022-02-02T22:37:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.599+0000 7f0670ff9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 0x7f065c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.599+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f06680817b0 con 0x7f06740f7980 2022-02-02T22:37:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.599+0000 7f0673fff700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 0x7f065c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.600+0000 7f0673fff700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 0x7f065c067290 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f0664004e30 tx=0x7f0664009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.604+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06680532e0 con 0x7f06740f7980 2022-02-02T22:37:20.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.779+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0674108d10 con 0x7f065c064dd0 2022-02-02T22:37:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.789+0000 7f0670ff9700 1 -- 172.21.15.96:0/1701304243 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0674108d10 con 0x7f065c064dd0 2022-02-02T22:37:20.789 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:37:20.790 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:37:20.790 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:37:20.790 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:37:20.791 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:37:20.791 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:37:20.792 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:37:20.792 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:37:20.792 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:37:20.793 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:37:20.793 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:37:20.793 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:37:20.794 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:37:20.794 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:37:20.794 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:37:20.795 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:37:20.795 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:37:20.795 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:37:20.796 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:37:20.796 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:37:20.796 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:37:20.797 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:37:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.790+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 msgr2=0x7f065c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.790+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 0x7f065c067290 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f0664004e30 tx=0x7f0664009b30).stop 2022-02-02T22:37:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.790+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 msgr2=0x7f06741074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.790+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f066800c530 tx=0x7f0668007e20).stop 2022-02-02T22:37:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 shutdown_connections 2022-02-02T22:37:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f065c064dd0 0x7f065c067290 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06740f66e0 0x7f0674106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 --2- 172.21.15.96:0/1701304243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06740f7980 0x7f06741074a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 >> 172.21.15.96:0/1701304243 conn(0x7f06740f1e40 msgr2=0x7f06740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:20.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 shutdown_connections 2022-02-02T22:37:20.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.791+0000 7f067a5c9700 1 -- 172.21.15.96:0/1701304243 wait complete. 2022-02-02T22:37:20.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 -- 172.21.15.96:0/354129424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c060310 msgr2=0x7f985c0f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 --2- 172.21.15.96:0/354129424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c060310 0x7f985c0f6f00 secure :-1 s=READY pgs=3912 cs=0 l=1 rev1=1 rx=0x7f9850004660 tx=0x7f9850009b30).stop 2022-02-02T22:37:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 -- 172.21.15.96:0/354129424 shutdown_connections 2022-02-02T22:37:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 --2- 172.21.15.96:0/354129424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c0f7480 0x7f985c0f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 --2- 172.21.15.96:0/354129424 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c060310 0x7f985c0f6f00 unknown :-1 s=CLOSED pgs=3912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.887+0000 7f9861dbf700 1 -- 172.21.15.96:0/354129424 >> 172.21.15.96:0/354129424 conn(0x7f985c0f0b90 msgr2=0x7f985c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:20.890 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:20 smithi096 ceph-mon[101353]: pgmap v7656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.888+0000 7f9861dbf700 1 -- 172.21.15.96:0/354129424 shutdown_connections 2022-02-02T22:37:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.890+0000 7f9861dbf700 1 -- 172.21.15.96:0/354129424 wait complete. 2022-02-02T22:37:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.890+0000 7f9861dbf700 1 Processor -- start 2022-02-02T22:37:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.890+0000 7f9861dbf700 1 -- start start 2022-02-02T22:37:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f9861dbf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c060310 0x7f985c10d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f9861dbf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f9861dbf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c10de00 con 0x7f985c0f7480 2022-02-02T22:37:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f9861dbf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c10df40 con 0x7f985c060310 2022-02-02T22:37:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f9860dbd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c060310 0x7f985c10d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49474/0 (socket says 172.21.15.96:49474) 2022-02-02T22:37:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 -- 172.21.15.96:0/2166920292 learned_addr learned my addr 172.21.15.96:0/2166920292 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 -- 172.21.15.96:0/2166920292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c060310 msgr2=0x7f985c10d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c060310 0x7f985c10d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 -- 172.21.15.96:0/2166920292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850005040 con 0x7f985c0f7480 2022-02-02T22:37:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.891+0000 7f985bfff700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 secure :-1 s=READY pgs=3913 cs=0 l=1 rev1=1 rx=0x7f98480026d0 tx=0x7f9848009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.892+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98480079c0 con 0x7f985c0f7480 2022-02-02T22:37:20.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.892+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c10e8e0 con 0x7f985c0f7480 2022-02-02T22:37:20.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.892+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f984800f040 con 0x7f985c0f7480 2022-02-02T22:37:20.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.892+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98480148b0 con 0x7f985c0f7480 2022-02-02T22:37:20.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.892+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c10eea0 con 0x7f985c0f7480 2022-02-02T22:37:20.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.893+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c045ad0 con 0x7f985c0f7480 2022-02-02T22:37:20.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.893+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9848007b20 con 0x7f985c0f7480 2022-02-02T22:37:20.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.894+0000 7f98597fa700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 0x7f984c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:20.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.894+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f98480819e0 con 0x7f985c0f7480 2022-02-02T22:37:20.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.894+0000 7f9860dbd700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 0x7f984c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:20.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.894+0000 7f9860dbd700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 0x7f984c0672e0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 rx=0x7f9850004630 tx=0x7f9850009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:20.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:20.898+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9848053510 con 0x7f985c0f7480 2022-02-02T22:37:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:20 smithi159 ceph-mon[69013]: pgmap v7656: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:21.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.130+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f985c027a00 con 0x7f985c0f7480 2022-02-02T22:37:21.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.131+0000 7f98597fa700 1 -- 172.21.15.96:0/2166920292 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9848053100 con 0x7f985c0f7480 2022-02-02T22:37:21.131 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:37:21.132 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:37:21.132 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:37:21.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:21.133 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:37:21.133 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:37:21.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:21.134 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:37:21.134 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:37:21.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:21.135 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:37:21.135 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:37:21.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:21.136 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:37:21.136 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:37:21.137 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:37:21.137 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:37:21.137 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:37:21.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 msgr2=0x7f984c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:21.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 0x7f984c0672e0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 rx=0x7f9850004630 tx=0x7f9850009b30).stop 2022-02-02T22:37:21.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 msgr2=0x7f985c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:21.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 secure :-1 s=READY pgs=3913 cs=0 l=1 rev1=1 rx=0x7f98480026d0 tx=0x7f9848009de0).stop 2022-02-02T22:37:21.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 shutdown_connections 2022-02-02T22:37:21.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f984c064e20 0x7f984c0672e0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c060310 0x7f985c10d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 --2- 172.21.15.96:0/2166920292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f985c0f7480 0x7f985c10d850 unknown :-1 s=CLOSED pgs=3913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 >> 172.21.15.96:0/2166920292 conn(0x7f985c0f0b90 msgr2=0x7f985c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:21.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 shutdown_connections 2022-02-02T22:37:21.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.133+0000 7f9861dbf700 1 -- 172.21.15.96:0/2166920292 wait complete. 2022-02-02T22:37:21.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 -- 172.21.15.96:0/3132948683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 msgr2=0x7fbb9806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 --2- 172.21.15.96:0/3132948683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb9806a7d0 secure :-1 s=READY pgs=3914 cs=0 l=1 rev1=1 rx=0x7fbb94004660 tx=0x7fbb94009b30).stop 2022-02-02T22:37:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 -- 172.21.15.96:0/3132948683 shutdown_connections 2022-02-02T22:37:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 --2- 172.21.15.96:0/3132948683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb9806a7d0 unknown :-1 s=CLOSED pgs=3914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 --2- 172.21.15.96:0/3132948683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb9806b960 0x7fbb98069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 -- 172.21.15.96:0/3132948683 >> 172.21.15.96:0/3132948683 conn(0x7fbb980f1e40 msgr2=0x7fbb980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.230+0000 7fbb9f655700 1 -- 172.21.15.96:0/3132948683 shutdown_connections 2022-02-02T22:37:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.232+0000 7fbb9f655700 1 -- 172.21.15.96:0/3132948683 wait complete. 2022-02-02T22:37:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.232+0000 7fbb9f655700 1 Processor -- start 2022-02-02T22:37:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.232+0000 7fbb9f655700 1 -- start start 2022-02-02T22:37:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.232+0000 7fbb9f655700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9f655700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb9806b960 0x7fbb98109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9f655700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98109be0 con 0x7fbb9806a350 2022-02-02T22:37:21.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9f655700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98109d20 con 0x7fbb9806b960 2022-02-02T22:37:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:21.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49482/0 (socket says 172.21.15.96:49482) 2022-02-02T22:37:21.241 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 -- 172.21.15.96:0/4281819213 learned_addr learned my addr 172.21.15.96:0/4281819213 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:21.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 -- 172.21.15.96:0/4281819213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb9806b960 msgr2=0x7fbb98109630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T22:37:21.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb9806b960 0x7fbb98109630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:37:21.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 -- 172.21.15.96:0/4281819213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94005040 con 0x7fbb9806a350 2022-02-02T22:37:21.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9d3f1700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 secure :-1 s=READY pgs=3915 cs=0 l=1 rev1=1 rx=0x7fbb8800c530 tx=0x7fbb88007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:21.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8800f650 con 0x7fbb9806a350 2022-02-02T22:37:21.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb8800fc60 con 0x7fbb9806a350 2022-02-02T22:37:21.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9810a6c0 con 0x7fbb9806a350 2022-02-02T22:37:21.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.233+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88012cd0 con 0x7fbb9806a350 2022-02-02T22:37:21.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.234+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9810ac80 con 0x7fbb9806a350 2022-02-02T22:37:21.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.235+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98045ad0 con 0x7fbb9806a350 2022-02-02T22:37:21.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.235+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb88010070 con 0x7fbb9806a350 2022-02-02T22:37:21.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.235+0000 7fbb8dffb700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 0x7fbb84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.236+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbb880817b0 con 0x7fbb9806a350 2022-02-02T22:37:21.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.236+0000 7fbb9cbf0700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 0x7fbb84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:21.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.236+0000 7fbb9cbf0700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 0x7fbb84067290 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 rx=0x7fbb94004e30 tx=0x7fbb94009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:21.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.240+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb880532e0 con 0x7fbb9806a350 2022-02-02T22:37:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.441+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb98101210 con 0x7fbb9806a350 2022-02-02T22:37:21.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.442+0000 7fbb8dffb700 1 -- 172.21.15.96:0/4281819213 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbb88052ed0 con 0x7fbb9806a350 2022-02-02T22:37:21.443 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:37:21.443 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:37:21.444 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:37:21.444 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:37:21.444 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:21.445 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:37:21.445 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:37:21.445 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:37:21.446 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:37:21.446 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:37:21.447 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:37:21.447 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:37:21.447 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:37:21.448 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:37:21.448 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:37:21.448 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:37:21.449 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:37:21.449 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:37:21.450 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:37:21.450 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:37:21.450 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:37:21.451 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:37:21.451 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:37:21.452 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:37:21.452 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:37:21.452 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:37:21.453 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:37:21.453 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:37:21.453 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:37:21.454 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:37:21.454 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:37:21.455 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:37:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:21.456 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:37:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:21.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:21.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:21.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 msgr2=0x7fbb84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:21.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 0x7fbb84067290 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 rx=0x7fbb94004e30 tx=0x7fbb94009b30).stop 2022-02-02T22:37:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 msgr2=0x7fbb98109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 secure :-1 s=READY pgs=3915 cs=0 l=1 rev1=1 rx=0x7fbb8800c530 tx=0x7fbb88007e20).stop 2022-02-02T22:37:21.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 shutdown_connections 2022-02-02T22:37:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb84064dd0 0x7fbb84067290 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb9806a350 0x7fbb98109140 unknown :-1 s=CLOSED pgs=3915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:21.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 --2- 172.21.15.96:0/4281819213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb9806b960 0x7fbb98109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:37:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 >> 172.21.15.96:0/4281819213 conn(0x7fbb980f1e40 msgr2=0x7fbb980fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 shutdown_connections 2022-02-02T22:37:21.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:21.444+0000 7fbb9f655700 1 -- 172.21.15.96:0/4281819213 wait complete. 2022-02-02T22:37:21.463 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:37:22.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:21 smithi159 ceph-mon[69013]: from='client.41940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:22.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:21 smithi159 ceph-mon[69013]: from='client.49127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2166920292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:37:22.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4281819213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:37:22.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:21 smithi096 ceph-mon[101353]: from='client.41940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:21 smithi096 ceph-mon[101353]: from='client.49127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:22.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2166920292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:37:22.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4281819213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:37:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:22 smithi159 ceph-mon[69013]: pgmap v7657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:22 smithi096 ceph-mon[101353]: pgmap v7657: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:24 smithi159 ceph-mon[69013]: pgmap v7658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:24 smithi096 ceph-mon[101353]: pgmap v7658: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:26 smithi159 ceph-mon[69013]: pgmap v7659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:26 smithi096 ceph-mon[101353]: pgmap v7659: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:28 smithi159 ceph-mon[69013]: pgmap v7660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:37:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:37:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:28 smithi096 ceph-mon[101353]: pgmap v7660: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:37:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:37:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:30 smithi159 ceph-mon[69013]: pgmap v7661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:30 smithi096 ceph-mon[101353]: pgmap v7661: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:32 smithi159 ceph-mon[69013]: pgmap v7662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:32 smithi096 ceph-mon[101353]: pgmap v7662: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:34 smithi159 ceph-mon[69013]: pgmap v7663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:34 smithi096 ceph-mon[101353]: pgmap v7663: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:36 smithi159 ceph-mon[69013]: pgmap v7664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:36 smithi096 ceph-mon[101353]: pgmap v7664: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:38 smithi159 ceph-mon[69013]: pgmap v7665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:38 smithi096 ceph-mon[101353]: pgmap v7665: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:40 smithi159 ceph-mon[69013]: pgmap v7666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:40 smithi096 ceph-mon[101353]: pgmap v7666: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:42 smithi159 ceph-mon[69013]: pgmap v7667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:42 smithi096 ceph-mon[101353]: pgmap v7667: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:44 smithi096 ceph-mon[101353]: pgmap v7668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:44 smithi159 ceph-mon[69013]: pgmap v7668: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:46 smithi096 ceph-mon[101353]: pgmap v7669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:47.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:46 smithi159 ceph-mon[69013]: pgmap v7669: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:48 smithi096 ceph-mon[101353]: pgmap v7670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:48 smithi159 ceph-mon[69013]: pgmap v7670: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:50 smithi096 ceph-mon[101353]: pgmap v7671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:50 smithi159 ceph-mon[69013]: pgmap v7671: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:51.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.553+0000 7fc5f04a2700 1 -- 172.21.15.96:0/101346537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 msgr2=0x7fc5e80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.553+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/101346537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e80f59e0 secure :-1 s=READY pgs=3916 cs=0 l=1 rev1=1 rx=0x7fc5e4004660 tx=0x7fc5e4009b30).stop 2022-02-02T22:37:51.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- 172.21.15.96:0/101346537 shutdown_connections 2022-02-02T22:37:51.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/101346537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/101346537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e80f59e0 unknown :-1 s=CLOSED pgs=3916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- 172.21.15.96:0/101346537 >> 172.21.15.96:0/101346537 conn(0x7fc5e80f0d40 msgr2=0x7fc5e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- 172.21.15.96:0/101346537 shutdown_connections 2022-02-02T22:37:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- 172.21.15.96:0/101346537 wait complete. 2022-02-02T22:37:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 Processor -- start 2022-02-02T22:37:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- start start 2022-02-02T22:37:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e81095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8109ba0 con 0x7fc5e80f55c0 2022-02-02T22:37:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5f04a2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8109ce0 con 0x7fc5e80f6860 2022-02-02T22:37:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.554+0000 7fc5ee23e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49500/0 (socket says 172.21.15.96:49500) 2022-02-02T22:37:51.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 -- 172.21.15.96:0/4123956030 learned_addr learned my addr 172.21.15.96:0/4123956030 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:51.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5eda3d700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e81095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 -- 172.21.15.96:0/4123956030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 msgr2=0x7fc5e81095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e81095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 -- 172.21.15.96:0/4123956030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e4005040 con 0x7fc5e80f55c0 2022-02-02T22:37:51.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5eda3d700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e81095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:37:51.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5ee23e700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 secure :-1 s=READY pgs=3917 cs=0 l=1 rev1=1 rx=0x7fc5e4014040 tx=0x7fc5e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:51.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e4019070 con 0x7fc5e80f55c0 2022-02-02T22:37:51.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5e4007e70 con 0x7fc5e80f55c0 2022-02-02T22:37:51.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e4014d50 con 0x7fc5e80f55c0 2022-02-02T22:37:51.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e810a620 con 0x7fc5e80f55c0 2022-02-02T22:37:51.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.555+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e810ab80 con 0x7fc5e80f55c0 2022-02-02T22:37:51.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.556+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e8045ad0 con 0x7fc5e80f55c0 2022-02-02T22:37:51.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.557+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc5e4025070 con 0x7fc5e80f55c0 2022-02-02T22:37:51.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.557+0000 7fc5deffd700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 0x7fc5d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.557+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc5e4082a60 con 0x7fc5e80f55c0 2022-02-02T22:37:51.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.557+0000 7fc5eda3d700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 0x7fc5d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.558+0000 7fc5eda3d700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 0x7fc5d4067290 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 rx=0x7fc5d8007fc0 tx=0x7fc5d800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:51.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.562+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc5e4054650 con 0x7fc5e80f55c0 2022-02-02T22:37:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.738+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e80faaa0 con 0x7fc5d4064dd0 2022-02-02T22:37:51.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.739+0000 7fc5deffd700 1 -- 172.21.15.96:0/4123956030 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5e80faaa0 con 0x7fc5d4064dd0 2022-02-02T22:37:51.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 msgr2=0x7fc5d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 0x7fc5d4067290 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 rx=0x7fc5d8007fc0 tx=0x7fc5d800b040).stop 2022-02-02T22:37:51.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 msgr2=0x7fc5e8109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 secure :-1 s=READY pgs=3917 cs=0 l=1 rev1=1 rx=0x7fc5e4014040 tx=0x7fc5e400b040).stop 2022-02-02T22:37:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 shutdown_connections 2022-02-02T22:37:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc5d4064dd0 0x7fc5d4067290 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5e80f55c0 0x7fc5e8109100 unknown :-1 s=CLOSED pgs=3917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 --2- 172.21.15.96:0/4123956030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e80f6860 0x7fc5e81095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 >> 172.21.15.96:0/4123956030 conn(0x7fc5e80f0d40 msgr2=0x7fc5e805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:51.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 shutdown_connections 2022-02-02T22:37:51.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.741+0000 7fc5f04a2700 1 -- 172.21.15.96:0/4123956030 wait complete. 2022-02-02T22:37:51.751 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:37:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- 172.21.15.96:0/2199461309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f5440 msgr2=0x7f2ba40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2199461309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f5440 0x7f2ba40f5860 secure :-1 s=READY pgs=3918 cs=0 l=1 rev1=1 rx=0x7f2b8c004660 tx=0x7f2b8c009b30).stop 2022-02-02T22:37:51.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- 172.21.15.96:0/2199461309 shutdown_connections 2022-02-02T22:37:51.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2199461309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f66e0 0x7f2ba40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:37:51.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2199461309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f5440 0x7f2ba40f5860 unknown :-1 s=CLOSED pgs=3918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- 172.21.15.96:0/2199461309 >> 172.21.15.96:0/2199461309 conn(0x7f2ba40f0ba0 msgr2=0x7f2ba40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:51.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- 172.21.15.96:0/2199461309 shutdown_connections 2022-02-02T22:37:51.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- 172.21.15.96:0/2199461309 wait complete. 2022-02-02T22:37:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 Processor -- start 2022-02-02T22:37:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.840+0000 7f2ba359e700 1 -- start start 2022-02-02T22:37:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f5440 0x7f2ba4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4060470 con 0x7f2ba40f66e0 2022-02-02T22:37:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40605b0 con 0x7f2ba40f5440 2022-02-02T22:37:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49512/0 (socket says 172.21.15.96:49512) 2022-02-02T22:37:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 -- 172.21.15.96:0/2290134659 learned_addr learned my addr 172.21.15.96:0/2290134659 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba259c700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f5440 0x7f2ba4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 -- 172.21.15.96:0/2290134659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f5440 msgr2=0x7f2ba4109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f5440 0x7f2ba4109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 -- 172.21.15.96:0/2290134659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c005040 con 0x7f2ba40f66e0 2022-02-02T22:37:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba1d9b700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 secure :-1 s=READY pgs=3919 cs=0 l=1 rev1=1 rx=0x7f2b9400b410 tx=0x7f2b94006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b940125f0 con 0x7f2ba40f66e0 2022-02-02T22:37:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b94012c00 con 0x7f2ba40f66e0 2022-02-02T22:37:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba410c610 con 0x7f2ba40f66e0 2022-02-02T22:37:51.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b94002ae0 con 0x7f2ba40f66e0 2022-02-02T22:37:51.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.841+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba410cba0 con 0x7f2ba40f66e0 2022-02-02T22:37:51.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.842+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba4059100 con 0x7f2ba40f66e0 2022-02-02T22:37:51.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.843+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b9400f030 con 0x7f2ba40f66e0 2022-02-02T22:37:51.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.843+0000 7f2b9affd700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 0x7f2b900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:51.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.843+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2b94081ea0 con 0x7f2ba40f66e0 2022-02-02T22:37:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.843+0000 7f2ba259c700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 0x7f2b900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.844+0000 7f2ba259c700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 0x7f2b900672e0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 rx=0x7f2b8c004e30 tx=0x7f2b8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:51.847+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b9404ffa0 con 0x7f2ba40f66e0 2022-02-02T22:37:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.018+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ba40fddc0 con 0x7f2b90064e20 2022-02-02T22:37:52.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.027+0000 7f2b9affd700 1 -- 172.21.15.96:0/2290134659 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2ba40fddc0 con 0x7f2b90064e20 2022-02-02T22:37:52.028 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:37:52.028 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:37:52.028 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:37:52.029 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:37:52.029 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:37:52.029 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:37:52.030 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:37:52.030 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:37:52.030 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:37:52.031 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:37:52.031 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:37:52.031 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:37:52.032 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:37:52.032 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:37:52.032 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:37:52.033 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:37:52.033 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:37:52.033 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:37:52.034 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:37:52.034 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:37:52.034 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:37:52.035 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:37:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 msgr2=0x7f2b900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 0x7f2b900672e0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 rx=0x7f2b8c004e30 tx=0x7f2b8c009b30).stop 2022-02-02T22:37:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 msgr2=0x7f2ba410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 secure :-1 s=READY pgs=3919 cs=0 l=1 rev1=1 rx=0x7f2b9400b410 tx=0x7f2b94006ef0).stop 2022-02-02T22:37:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 shutdown_connections 2022-02-02T22:37:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2b90064e20 0x7f2b900672e0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ba40f5440 0x7f2ba4109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 --2- 172.21.15.96:0/2290134659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ba40f66e0 0x7f2ba410bfb0 unknown :-1 s=CLOSED pgs=3919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 >> 172.21.15.96:0/2290134659 conn(0x7f2ba40f0ba0 msgr2=0x7f2ba40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 shutdown_connections 2022-02-02T22:37:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.029+0000 7f2ba359e700 1 -- 172.21.15.96:0/2290134659 wait complete. 2022-02-02T22:37:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 -- 172.21.15.96:0/2090210980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 msgr2=0x7f00a80f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 --2- 172.21.15.96:0/2090210980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a80f5880 secure :-1 s=READY pgs=3920 cs=0 l=1 rev1=1 rx=0x7f0098004660 tx=0x7f0098009b30).stop 2022-02-02T22:37:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 -- 172.21.15.96:0/2090210980 shutdown_connections 2022-02-02T22:37:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 --2- 172.21.15.96:0/2090210980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 0x7f00a80f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 --2- 172.21.15.96:0/2090210980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a80f5880 unknown :-1 s=CLOSED pgs=3920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.124+0000 7f00ad463700 1 -- 172.21.15.96:0/2090210980 >> 172.21.15.96:0/2090210980 conn(0x7f00a80f0bc0 msgr2=0x7f00a80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.125+0000 7f00ad463700 1 -- 172.21.15.96:0/2090210980 shutdown_connections 2022-02-02T22:37:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.125+0000 7f00ad463700 1 -- 172.21.15.96:0/2090210980 wait complete. 2022-02-02T22:37:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.125+0000 7f00ad463700 1 Processor -- start 2022-02-02T22:37:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.125+0000 7f00ad463700 1 -- start start 2022-02-02T22:37:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00ad463700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00ad463700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 0x7f00a8107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00ad463700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8107930 con 0x7f00a80f5460 2022-02-02T22:37:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00ad463700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8108140 con 0x7f00a80f6700 2022-02-02T22:37:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49520/0 (socket says 172.21.15.96:49520) 2022-02-02T22:37:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 -- 172.21.15.96:0/1208481990 learned_addr learned my addr 172.21.15.96:0/1208481990 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a67fc700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 0x7f00a8107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 -- 172.21.15.96:0/1208481990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 msgr2=0x7f00a8107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 0x7f00a8107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 -- 172.21.15.96:0/1208481990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098005040 con 0x7f00a80f5460 2022-02-02T22:37:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.126+0000 7f00a6ffd700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 secure :-1 s=READY pgs=3921 cs=0 l=1 rev1=1 rx=0x7f0098013a70 tx=0x7f0098009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.127+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0098018070 con 0x7f00a80f5460 2022-02-02T22:37:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.127+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a8108360 con 0x7f00a80f5460 2022-02-02T22:37:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.127+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00980097d0 con 0x7f00a80f5460 2022-02-02T22:37:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.127+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009801c3c0 con 0x7f00a80f5460 2022-02-02T22:37:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.127+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a81088c0 con 0x7f00a80f5460 2022-02-02T22:37:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.128+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a8059100 con 0x7f00a80f5460 2022-02-02T22:37:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.128+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0098007ba0 con 0x7f00a80f5460 2022-02-02T22:37:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.129+0000 7f008f7fe700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 0x7f00900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.129+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0098083740 con 0x7f00a80f5460 2022-02-02T22:37:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.129+0000 7f00a67fc700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 0x7f00900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.129+0000 7f00a67fc700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 0x7f00900672e0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 rx=0x7f009c0096c0 tx=0x7f009c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:52.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.133+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0098051900 con 0x7f00a80f5460 2022-02-02T22:37:52.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.364+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00a80fdd70 con 0x7f00a80f5460 2022-02-02T22:37:52.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.365+0000 7f008f7fe700 1 -- 172.21.15.96:0/1208481990 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0098054f20 con 0x7f00a80f5460 2022-02-02T22:37:52.366 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:37:52.366 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:37:52.366 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:37:52.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:52.367 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:37:52.367 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:37:52.368 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:52.368 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:37:52.368 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:37:52.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:52.369 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:37:52.369 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:37:52.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:37:52.370 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:37:52.370 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:37:52.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:37:52.371 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:37:52.371 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:37:52.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 msgr2=0x7f00900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 0x7f00900672e0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 rx=0x7f009c0096c0 tx=0x7f009c009be0).stop 2022-02-02T22:37:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 msgr2=0x7f00a8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 secure :-1 s=READY pgs=3921 cs=0 l=1 rev1=1 rx=0x7f0098013a70 tx=0x7f0098009b30).stop 2022-02-02T22:37:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 shutdown_connections 2022-02-02T22:37:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0090064e20 0x7f00900672e0 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00a80f5460 0x7f00a8106e40 unknown :-1 s=CLOSED pgs=3921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 --2- 172.21.15.96:0/1208481990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a80f6700 0x7f00a8107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 >> 172.21.15.96:0/1208481990 conn(0x7f00a80f0bc0 msgr2=0x7f00a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 shutdown_connections 2022-02-02T22:37:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.367+0000 7f00ad463700 1 -- 172.21.15.96:0/1208481990 wait complete. 2022-02-02T22:37:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 -- 172.21.15.96:0/1778430238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 msgr2=0x7f4e500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 --2- 172.21.15.96:0/1778430238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e500f6b00 secure :-1 s=READY pgs=3922 cs=0 l=1 rev1=1 rx=0x7f4e48004660 tx=0x7f4e48009b30).stop 2022-02-02T22:37:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 -- 172.21.15.96:0/1778430238 shutdown_connections 2022-02-02T22:37:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 --2- 172.21.15.96:0/1778430238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 0x7f4e500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:37:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 --2- 172.21.15.96:0/1778430238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e500f6b00 unknown :-1 s=CLOSED pgs=3922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 -- 172.21.15.96:0/1778430238 >> 172.21.15.96:0/1778430238 conn(0x7f4e500f1e40 msgr2=0x7f4e500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 -- 172.21.15.96:0/1778430238 shutdown_connections 2022-02-02T22:37:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 -- 172.21.15.96:0/1778430238 wait complete. 2022-02-02T22:37:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.464+0000 7f4e56029700 1 Processor -- start 2022-02-02T22:37:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e56029700 1 -- start start 2022-02-02T22:37:52.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e56029700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e56029700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 0x7f4e501074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e56029700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50107b00 con 0x7f4e500f66e0 2022-02-02T22:37:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e56029700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e501083b0 con 0x7f4e500f7980 2022-02-02T22:37:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49530/0 (socket says 172.21.15.96:49530) 2022-02-02T22:37:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 -- 172.21.15.96:0/3117604437 learned_addr learned my addr 172.21.15.96:0/3117604437 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:37:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4effd700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 0x7f4e501074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 -- 172.21.15.96:0/3117604437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 msgr2=0x7f4e501074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 0x7f4e501074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 -- 172.21.15.96:0/3117604437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48005040 con 0x7f4e500f66e0 2022-02-02T22:37:52.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.465+0000 7f4e4f7fe700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 secure :-1 s=READY pgs=3923 cs=0 l=1 rev1=1 rx=0x7f4e48009d30 tx=0x7f4e48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:52.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.466+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4801c070 con 0x7f4e500f66e0 2022-02-02T22:37:52.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.466+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e480097d0 con 0x7f4e500f66e0 2022-02-02T22:37:52.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.466+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e50108630 con 0x7f4e500f66e0 2022-02-02T22:37:52.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.466+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e480218d0 con 0x7f4e500f66e0 2022-02-02T22:37:52.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.466+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e50108b90 con 0x7f4e500f66e0 2022-02-02T22:37:52.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.467+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e500f5ad0 con 0x7f4e500f66e0 2022-02-02T22:37:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.468+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4e480125d0 con 0x7f4e500f66e0 2022-02-02T22:37:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.468+0000 7f4e47fff700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 0x7f4e3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:37:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.468+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4e48087dc0 con 0x7f4e500f66e0 2022-02-02T22:37:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.468+0000 7f4e4effd700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 0x7f4e3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:37:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.468+0000 7f4e4effd700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 0x7f4e3c067290 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7f4e3800b790 tx=0x7f4e38008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:37:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.472+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4e480598f0 con 0x7f4e500f66e0 2022-02-02T22:37:52.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.675+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e50045ad0 con 0x7f4e500f66e0 2022-02-02T22:37:52.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.675+0000 7f4e47fff700 1 -- 172.21.15.96:0/3117604437 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4e480594e0 con 0x7f4e500f66e0 2022-02-02T22:37:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:37:52.676 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:37:52.677 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:37:52.677 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:37:52.677 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:52.678 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:37:52.678 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:37:52.678 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:37:52.679 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:37:52.679 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:37:52.679 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:37:52.679 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:37:52.680 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:37:52.680 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:37:52.680 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:37:52.681 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:37:52.681 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:37:52.681 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:37:52.682 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:37:52.682 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:37:52.682 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:37:52.683 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:37:52.683 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:37:52.683 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:37:52.683 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:37:52.684 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:37:52.684 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:37:52.684 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:37:52.685 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:37:52.685 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:37:52.685 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:37:52.686 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:37:52.686 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:52.686 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:52.686 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:37:52.687 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:37:52.687 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:52.687 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:52.688 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:37:52.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 msgr2=0x7f4e3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 0x7f4e3c067290 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7f4e3800b790 tx=0x7f4e38008040).stop 2022-02-02T22:37:52.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 msgr2=0x7f4e50106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:37:52.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 secure :-1 s=READY pgs=3923 cs=0 l=1 rev1=1 rx=0x7f4e48009d30 tx=0x7f4e48009b30).stop 2022-02-02T22:37:52.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 shutdown_connections 2022-02-02T22:37:52.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4e3c064dd0 0x7f4e3c067290 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e500f66e0 0x7f4e50106fd0 unknown :-1 s=CLOSED pgs=3923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 --2- 172.21.15.96:0/3117604437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e500f7980 0x7f4e501074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:37:52.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 >> 172.21.15.96:0/3117604437 conn(0x7f4e500f1e40 msgr2=0x7f4e500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:37:52.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 shutdown_connections 2022-02-02T22:37:52.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:37:52.677+0000 7f4e56029700 1 -- 172.21.15.96:0/3117604437 wait complete. 2022-02-02T22:37:52.692 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:37:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:52 smithi096 ceph-mon[101353]: pgmap v7672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:52 smithi096 ceph-mon[101353]: from='client.41956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1208481990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:37:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3117604437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:37:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:52 smithi159 ceph-mon[69013]: pgmap v7672: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:52 smithi159 ceph-mon[69013]: from='client.41956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1208481990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:37:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3117604437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:37:54.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:53 smithi096 ceph-mon[101353]: from='client.41960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:53 smithi159 ceph-mon[69013]: from='client.41960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:37:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:54 smithi096 ceph-mon[101353]: pgmap v7673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:55.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:54 smithi159 ceph-mon[69013]: pgmap v7673: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:56 smithi096 ceph-mon[101353]: pgmap v7674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:57.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:56 smithi159 ceph-mon[69013]: pgmap v7674: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:37:58 smithi096 ceph-mon[101353]: pgmap v7675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:37:59.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:37:58 smithi159 ceph-mon[69013]: pgmap v7675: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:01.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:00 smithi159 ceph-mon[69013]: pgmap v7676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:00 smithi096 ceph-mon[101353]: pgmap v7676: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:02 smithi096 ceph-mon[101353]: pgmap v7677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:02 smithi159 ceph-mon[69013]: pgmap v7677: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:04 smithi159 ceph-mon[69013]: pgmap v7678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:04 smithi096 ceph-mon[101353]: pgmap v7678: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:07.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:06 smithi159 ceph-mon[69013]: pgmap v7679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:06 smithi096 ceph-mon[101353]: pgmap v7679: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:08 smithi159 ceph-mon[69013]: pgmap v7680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:08 smithi096 ceph-mon[101353]: pgmap v7680: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:10 smithi159 ceph-mon[69013]: pgmap v7681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:10 smithi096 ceph-mon[101353]: pgmap v7681: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:13.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:12 smithi096 ceph-mon[101353]: pgmap v7682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:12 smithi159 ceph-mon[69013]: pgmap v7682: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:14 smithi159 ceph-mon[69013]: pgmap v7683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:14 smithi096 ceph-mon[101353]: pgmap v7683: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:16 smithi159 ceph-mon[69013]: pgmap v7684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:16 smithi096 ceph-mon[101353]: pgmap v7684: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:18 smithi159 ceph-mon[69013]: pgmap v7685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:18 smithi096 ceph-mon[101353]: pgmap v7685: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:20 smithi159 ceph-mon[69013]: pgmap v7686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:20 smithi096 ceph-mon[101353]: pgmap v7686: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:22.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 -- 172.21.15.96:0/1701681873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f66e0 msgr2=0x7f64b80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 --2- 172.21.15.96:0/1701681873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f66e0 0x7f64b80f6b00 secure :-1 s=READY pgs=3924 cs=0 l=1 rev1=1 rx=0x7f64ac004660 tx=0x7f64ac009b30).stop 2022-02-02T22:38:22.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 -- 172.21.15.96:0/1701681873 shutdown_connections 2022-02-02T22:38:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 --2- 172.21.15.96:0/1701681873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f7980 0x7f64b80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 --2- 172.21.15.96:0/1701681873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f66e0 0x7f64b80f6b00 unknown :-1 s=CLOSED pgs=3924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 -- 172.21.15.96:0/1701681873 >> 172.21.15.96:0/1701681873 conn(0x7f64b80f1e40 msgr2=0x7f64b80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:22.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 -- 172.21.15.96:0/1701681873 shutdown_connections 2022-02-02T22:38:22.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.786+0000 7f64bca2b700 1 -- 172.21.15.96:0/1701681873 wait complete. 2022-02-02T22:38:22.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 Processor -- start 2022-02-02T22:38:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 -- start start 2022-02-02T22:38:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f66e0 0x7f64b8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8107a50 con 0x7f64b80f7980 2022-02-02T22:38:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64bca2b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8107b90 con 0x7f64b80f66e0 2022-02-02T22:38:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64b5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49550/0 (socket says 172.21.15.96:49550) 2022-02-02T22:38:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.787+0000 7f64b5d9b700 1 -- 172.21.15.96:0/2091293606 learned_addr learned my addr 172.21.15.96:0/2091293606 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64b659c700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f66e0 0x7f64b8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64b5d9b700 1 -- 172.21.15.96:0/2091293606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f66e0 msgr2=0x7f64b8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64b5d9b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f66e0 0x7f64b8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64b5d9b700 1 -- 172.21.15.96:0/2091293606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac005040 con 0x7f64b80f7980 2022-02-02T22:38:22.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64b5d9b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 secure :-1 s=READY pgs=3925 cs=0 l=1 rev1=1 rx=0x7f64a80026d0 tx=0x7f64a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:22.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a80079c0 con 0x7f64b80f7980 2022-02-02T22:38:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b8108530 con 0x7f64b80f7980 2022-02-02T22:38:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64a800f040 con 0x7f64b80f7980 2022-02-02T22:38:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a80148b0 con 0x7f64b80f7980 2022-02-02T22:38:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.788+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b8108af0 con 0x7f64b80f7980 2022-02-02T22:38:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.789+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b8045ad0 con 0x7f64b80f7980 2022-02-02T22:38:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.790+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f64a8007b20 con 0x7f64b80f7980 2022-02-02T22:38:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.790+0000 7f64a6ffd700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 0x7f64a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.790+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64a80819e0 con 0x7f64b80f7980 2022-02-02T22:38:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.790+0000 7f64b659c700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 0x7f64a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.790+0000 7f64b659c700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 0x7f64a0067290 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 rx=0x7f64ac004630 tx=0x7f64ac009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.794+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f64a8053510 con 0x7f64b80f7980 2022-02-02T22:38:22.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.977+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64b8108d70 con 0x7f64a0064dd0 2022-02-02T22:38:22.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.979+0000 7f64a6ffd700 1 -- 172.21.15.96:0/2091293606 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f64b8108d70 con 0x7f64a0064dd0 2022-02-02T22:38:22.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 msgr2=0x7f64a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:22.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 0x7f64a0067290 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 rx=0x7f64ac004630 tx=0x7f64ac009b30).stop 2022-02-02T22:38:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 msgr2=0x7f64b81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 secure :-1 s=READY pgs=3925 cs=0 l=1 rev1=1 rx=0x7f64a80026d0 tx=0x7f64a8009de0).stop 2022-02-02T22:38:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 shutdown_connections 2022-02-02T22:38:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f64a0064dd0 0x7f64a0067290 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80f66e0 0x7f64b8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 --2- 172.21.15.96:0/2091293606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64b80f7980 0x7f64b81074a0 unknown :-1 s=CLOSED pgs=3925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 >> 172.21.15.96:0/2091293606 conn(0x7f64b80f1e40 msgr2=0x7f64b80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.980+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 shutdown_connections 2022-02-02T22:38:22.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:22.981+0000 7f64bca2b700 1 -- 172.21.15.96:0/2091293606 wait complete. 2022-02-02T22:38:22.991 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:38:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:22 smithi096 ceph-mon[101353]: pgmap v7687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:23.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 -- 172.21.15.96:0/3471501468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f66e0 msgr2=0x7f007c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 --2- 172.21.15.96:0/3471501468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f66e0 0x7f007c0f6b40 secure :-1 s=READY pgs=3926 cs=0 l=1 rev1=1 rx=0x7f0070004660 tx=0x7f0070009b30).stop 2022-02-02T22:38:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 -- 172.21.15.96:0/3471501468 shutdown_connections 2022-02-02T22:38:23.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 --2- 172.21.15.96:0/3471501468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f66e0 0x7f007c0f6b40 unknown :-1 s=CLOSED pgs=3926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 --2- 172.21.15.96:0/3471501468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f5440 0x7f007c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:38:23.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 -- 172.21.15.96:0/3471501468 >> 172.21.15.96:0/3471501468 conn(0x7f007c0f0ba0 msgr2=0x7f007c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.078+0000 7f0081435700 1 -- 172.21.15.96:0/3471501468 shutdown_connections 2022-02-02T22:38:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.079+0000 7f0081435700 1 -- 172.21.15.96:0/3471501468 wait complete. 2022-02-02T22:38:23.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.079+0000 7f0081435700 1 Processor -- start 2022-02-02T22:38:23.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.079+0000 7f0081435700 1 -- start start 2022-02-02T22:38:23.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f66e0 0x7f007c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c060470 con 0x7f007c0f5440 2022-02-02T22:38:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0605b0 con 0x7f007c0f66e0 2022-02-02T22:38:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49558/0 (socket says 172.21.15.96:49558) 2022-02-02T22:38:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 -- 172.21.15.96:0/1109201231 learned_addr learned my addr 172.21.15.96:0/1109201231 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007b7fe700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f66e0 0x7f007c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 -- 172.21.15.96:0/1109201231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f66e0 msgr2=0x7f007c10bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f66e0 0x7f007c10bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 -- 172.21.15.96:0/1109201231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070005040 con 0x7f007c0f5440 2022-02-02T22:38:23.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f007bfff700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 secure :-1 s=READY pgs=3927 cs=0 l=1 rev1=1 rx=0x7f006c0093f0 tx=0x7f006c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c009ea0 con 0x7f007c0f5440 2022-02-02T22:38:23.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f006c013af0 con 0x7f007c0f5440 2022-02-02T22:38:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c10c5e0 con 0x7f007c0f5440 2022-02-02T22:38:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c00db10 con 0x7f007c0f5440 2022-02-02T22:38:23.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.080+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c10cb70 con 0x7f007c0f5440 2022-02-02T22:38:23.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.081+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c059100 con 0x7f007c0f5440 2022-02-02T22:38:23.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.082+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f006c01a060 con 0x7f007c0f5440 2022-02-02T22:38:23.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.082+0000 7f0078ff9700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 0x7f00640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.082+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f006c081a90 con 0x7f007c0f5440 2022-02-02T22:38:23.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.082+0000 7f007b7fe700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 0x7f00640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.083+0000 7f007b7fe700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 0x7f00640672e0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 rx=0x7f0070004e30 tx=0x7f0070009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.087+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f006c04fb90 con 0x7f007c0f5440 2022-02-02T22:38:23.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.264+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f007c0fdde0 con 0x7f0064064e20 2022-02-02T22:38:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:22 smithi159 ceph-mon[69013]: pgmap v7687: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:23.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.273+0000 7f0078ff9700 1 -- 172.21.15.96:0/1109201231 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f007c0fdde0 con 0x7f0064064e20 2022-02-02T22:38:23.275 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:38:23.275 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:38:23.276 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:38:23.276 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:38:23.276 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:38:23.277 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:38:23.277 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:38:23.277 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:38:23.278 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:38:23.278 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:38:23.279 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:38:23.279 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:38:23.280 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:38:23.280 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:38:23.281 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:38:23.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:38:23.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:38:23.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:38:23.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:38:23.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:38:23.283 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:38:23.283 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:38:23.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 msgr2=0x7f00640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 0x7f00640672e0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 rx=0x7f0070004e30 tx=0x7f0070009b30).stop 2022-02-02T22:38:23.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 msgr2=0x7f007c109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 secure :-1 s=READY pgs=3927 cs=0 l=1 rev1=1 rx=0x7f006c0093f0 tx=0x7f006c006ec0).stop 2022-02-02T22:38:23.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 shutdown_connections 2022-02-02T22:38:23.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0064064e20 0x7f00640672e0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f007c0f5440 0x7f007c109a80 unknown :-1 s=CLOSED pgs=3927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 --2- 172.21.15.96:0/1109201231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0f66e0 0x7f007c10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 >> 172.21.15.96:0/1109201231 conn(0x7f007c0f0ba0 msgr2=0x7f007c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 shutdown_connections 2022-02-02T22:38:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.275+0000 7f0081435700 1 -- 172.21.15.96:0/1109201231 wait complete. 2022-02-02T22:38:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 -- 172.21.15.96:0/1891231420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 msgr2=0x7f66000f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 --2- 172.21.15.96:0/1891231420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66000f6b30 secure :-1 s=READY pgs=3928 cs=0 l=1 rev1=1 rx=0x7f65f0004660 tx=0x7f65f0009b30).stop 2022-02-02T22:38:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 -- 172.21.15.96:0/1891231420 shutdown_connections 2022-02-02T22:38:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 --2- 172.21.15.96:0/1891231420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66000f6b30 unknown :-1 s=CLOSED pgs=3928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 --2- 172.21.15.96:0/1891231420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 0x7f66000f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.372+0000 7f6606c83700 1 -- 172.21.15.96:0/1891231420 >> 172.21.15.96:0/1891231420 conn(0x7f66000f0b90 msgr2=0x7f66000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 -- 172.21.15.96:0/1891231420 shutdown_connections 2022-02-02T22:38:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 -- 172.21.15.96:0/1891231420 wait complete. 2022-02-02T22:38:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 Processor -- start 2022-02-02T22:38:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 -- start start 2022-02-02T22:38:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 0x7f6600105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6600106760 con 0x7f66000f66d0 2022-02-02T22:38:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.373+0000 7f6606c83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6600106f60 con 0x7f66000f5430 2022-02-02T22:38:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49570/0 (socket says 172.21.15.96:49570) 2022-02-02T22:38:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 -- 172.21.15.96:0/2406020021 learned_addr learned my addr 172.21.15.96:0/2406020021 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:23.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605c81700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 0x7f6600105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 -- 172.21.15.96:0/2406020021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 msgr2=0x7f6600105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 0x7f6600105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 -- 172.21.15.96:0/2406020021 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0005040 con 0x7f66000f66d0 2022-02-02T22:38:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6605480700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 secure :-1 s=READY pgs=3929 cs=0 l=1 rev1=1 rx=0x7f65f0009990 tx=0x7f65f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f0018070 con 0x7f66000f66d0 2022-02-02T22:38:23.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65f0007ba0 con 0x7f66000f66d0 2022-02-02T22:38:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66001071e0 con 0x7f66000f66d0 2022-02-02T22:38:23.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.374+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f001dea0 con 0x7f66000f66d0 2022-02-02T22:38:23.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.375+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6600107740 con 0x7f66000f66d0 2022-02-02T22:38:23.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.375+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6600059100 con 0x7f66000f66d0 2022-02-02T22:38:23.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.376+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f65f001d420 con 0x7f66000f66d0 2022-02-02T22:38:23.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.376+0000 7f65f67fc700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 0x7f65ec06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.376+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f65f0083890 con 0x7f66000f66d0 2022-02-02T22:38:23.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.376+0000 7f6605c81700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 0x7f65ec06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.377+0000 7f6605c81700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 0x7f65ec06b6e0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 rx=0x7f66000f6530 tx=0x7f65fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.381+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65f0055480 con 0x7f66000f66d0 2022-02-02T22:38:23.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.613+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6600107d80 con 0x7f66000f66d0 2022-02-02T22:38:23.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.613+0000 7f65f67fc700 1 -- 172.21.15.96:0/2406020021 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f65f0055070 con 0x7f66000f66d0 2022-02-02T22:38:23.615 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:38:23.615 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:38:23.616 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:38:23.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:23.616 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:38:23.617 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:38:23.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:23.617 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:38:23.618 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:38:23.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:23.618 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:38:23.619 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:38:23.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:23.619 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:38:23.620 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:38:23.620 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:38:23.620 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:38:23.621 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:38:23.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 msgr2=0x7f65ec06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 0x7f65ec06b6e0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 rx=0x7f66000f6530 tx=0x7f65fc009040).stop 2022-02-02T22:38:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 msgr2=0x7f66001061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 secure :-1 s=READY pgs=3929 cs=0 l=1 rev1=1 rx=0x7f65f0009990 tx=0x7f65f0009b30).stop 2022-02-02T22:38:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 shutdown_connections 2022-02-02T22:38:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f65ec069220 0x7f65ec06b6e0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66000f5430 0x7f6600105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 --2- 172.21.15.96:0/2406020021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66000f66d0 0x7f66001061b0 unknown :-1 s=CLOSED pgs=3929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 >> 172.21.15.96:0/2406020021 conn(0x7f66000f0b90 msgr2=0x7f66000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 shutdown_connections 2022-02-02T22:38:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.615+0000 7f6606c83700 1 -- 172.21.15.96:0/2406020021 wait complete. 2022-02-02T22:38:23.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 -- 172.21.15.96:0/2953788031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f66d0 msgr2=0x7f49380f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 --2- 172.21.15.96:0/2953788031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f66d0 0x7f49380f6b30 secure :-1 s=READY pgs=3930 cs=0 l=1 rev1=1 rx=0x7f492c004660 tx=0x7f492c009b30).stop 2022-02-02T22:38:23.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 -- 172.21.15.96:0/2953788031 shutdown_connections 2022-02-02T22:38:23.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 --2- 172.21.15.96:0/2953788031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f66d0 0x7f49380f6b30 unknown :-1 s=CLOSED pgs=3930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 --2- 172.21.15.96:0/2953788031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f5430 0x7f49380f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.713+0000 7f493d2d8700 1 -- 172.21.15.96:0/2953788031 >> 172.21.15.96:0/2953788031 conn(0x7f49380f0b90 msgr2=0x7f49380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.714+0000 7f493d2d8700 1 -- 172.21.15.96:0/2953788031 shutdown_connections 2022-02-02T22:38:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.714+0000 7f493d2d8700 1 -- 172.21.15.96:0/2953788031 wait complete. 2022-02-02T22:38:23.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.714+0000 7f493d2d8700 1 Processor -- start 2022-02-02T22:38:23.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f493d2d8700 1 -- start start 2022-02-02T22:38:23.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f493d2d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f493d2d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 0x7f493810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f493d2d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380603c0 con 0x7f49380f5430 2022-02-02T22:38:23.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f493d2d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4938060500 con 0x7f49380f66d0 2022-02-02T22:38:23.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49578/0 (socket says 172.21.15.96:49578) 2022-02-02T22:38:23.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 -- 172.21.15.96:0/1224818465 learned_addr learned my addr 172.21.15.96:0/1224818465 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:23.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f49377fe700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 0x7f493810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 -- 172.21.15.96:0/1224818465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 msgr2=0x7f493810bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 0x7f493810bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f4937fff700 1 -- 172.21.15.96:0/1224818465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c005040 con 0x7f49380f5430 2022-02-02T22:38:23.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.715+0000 7f49377fe700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 0x7f493810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:38:23.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f4937fff700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 secure :-1 s=READY pgs=3931 cs=0 l=1 rev1=1 rx=0x7f4928002700 tx=0x7f4928009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4928009320 con 0x7f49380f5430 2022-02-02T22:38:23.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f492800f040 con 0x7f49380f5430 2022-02-02T22:38:23.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493810c4f0 con 0x7f49380f5430 2022-02-02T22:38:23.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4928014900 con 0x7f49380f5430 2022-02-02T22:38:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.716+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493810ca80 con 0x7f49380f5430 2022-02-02T22:38:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.717+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4938059100 con 0x7f49380f5430 2022-02-02T22:38:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.717+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4928009480 con 0x7f49380f5430 2022-02-02T22:38:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.718+0000 7f4934ff9700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 0x7f49200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.718+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4928081cc0 con 0x7f49380f5430 2022-02-02T22:38:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.718+0000 7f49377fe700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 0x7f49200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:23.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.718+0000 7f49377fe700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 0x7f49200672e0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 rx=0x7f492c009da0 tx=0x7f492c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:23.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.722+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f492804fe80 con 0x7f49380f5430 2022-02-02T22:38:23.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.923+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49380586e0 con 0x7f49380f5430 2022-02-02T22:38:23.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.924+0000 7f4934ff9700 1 -- 172.21.15.96:0/1224818465 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f49280534a0 con 0x7f49380f5430 2022-02-02T22:38:23.925 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:38:23.926 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:38:23.926 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:38:23.927 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:38:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:23.927 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:38:23.928 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:38:23.928 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:38:23.928 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:38:23.929 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:38:23.929 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:38:23.929 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:38:23.930 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:38:23.930 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:38:23.931 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:38:23.931 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:38:23.931 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:38:23.932 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:38:23.932 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:38:23.933 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:38:23.933 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:38:23.933 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:38:23.934 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:38:23.934 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:38:23.934 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:38:23.935 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:38:23.935 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:38:23.935 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:38:23.936 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:38:23.936 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:38:23.936 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:38:23.937 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:38:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:23.938 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:38:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:23.938 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:23.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:23.939 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:23.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 msgr2=0x7f49200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 0x7f49200672e0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 rx=0x7f492c009da0 tx=0x7f492c009b30).stop 2022-02-02T22:38:23.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 msgr2=0x7f4938109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 secure :-1 s=READY pgs=3931 cs=0 l=1 rev1=1 rx=0x7f4928002700 tx=0x7f4928009d80).stop 2022-02-02T22:38:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 shutdown_connections 2022-02-02T22:38:23.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4920064e20 0x7f49200672e0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49380f5430 0x7f4938109a40 unknown :-1 s=CLOSED pgs=3931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 --2- 172.21.15.96:0/1224818465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49380f66d0 0x7f493810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:23.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 >> 172.21.15.96:0/1224818465 conn(0x7f49380f0b90 msgr2=0x7f49380fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 shutdown_connections 2022-02-02T22:38:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:23.927+0000 7f493d2d8700 1 -- 172.21.15.96:0/1224818465 wait complete. 2022-02-02T22:38:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:38:24.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:23 smithi096 ceph-mon[101353]: from='client.41972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:24.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2406020021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:38:24.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:23 smithi159 ceph-mon[69013]: from='client.41972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:24.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2406020021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:38:25.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:24 smithi159 ceph-mon[69013]: from='client.41976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:24 smithi159 ceph-mon[69013]: pgmap v7688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1224818465' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:38:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:24 smithi096 ceph-mon[101353]: from='client.41976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:24 smithi096 ceph-mon[101353]: pgmap v7688: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:25.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1224818465' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:38:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:26 smithi159 ceph-mon[69013]: pgmap v7689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:26 smithi096 ceph-mon[101353]: pgmap v7689: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:28 smithi159 ceph-mon[69013]: pgmap v7690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:38:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:38:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:28 smithi096 ceph-mon[101353]: pgmap v7690: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:38:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:38:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:30 smithi159 ceph-mon[69013]: pgmap v7691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:30 smithi096 ceph-mon[101353]: pgmap v7691: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:33.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:32 smithi096 ceph-mon[101353]: pgmap v7692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:32 smithi159 ceph-mon[69013]: pgmap v7692: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:34 smithi159 ceph-mon[69013]: pgmap v7693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:34 smithi096 ceph-mon[101353]: pgmap v7693: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:36 smithi159 ceph-mon[69013]: pgmap v7694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:36 smithi096 ceph-mon[101353]: pgmap v7694: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:38 smithi159 ceph-mon[69013]: pgmap v7695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:38 smithi096 ceph-mon[101353]: pgmap v7695: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:41.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:40 smithi159 ceph-mon[69013]: pgmap v7696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:40 smithi096 ceph-mon[101353]: pgmap v7696: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:42 smithi096 ceph-mon[101353]: pgmap v7697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:42 smithi159 ceph-mon[69013]: pgmap v7697: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:44 smithi159 ceph-mon[69013]: pgmap v7698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:44 smithi096 ceph-mon[101353]: pgmap v7698: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:46 smithi159 ceph-mon[69013]: pgmap v7699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:46 smithi096 ceph-mon[101353]: pgmap v7699: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:48 smithi159 ceph-mon[69013]: pgmap v7700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:48 smithi096 ceph-mon[101353]: pgmap v7700: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:50 smithi159 ceph-mon[69013]: pgmap v7701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:50 smithi096 ceph-mon[101353]: pgmap v7701: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:52 smithi096 ceph-mon[101353]: pgmap v7702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:53.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:52 smithi159 ceph-mon[69013]: pgmap v7702: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.037+0000 7ff12b5f7700 1 -- 172.21.15.96:0/427871697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f66e0 msgr2=0x7ff1240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.037+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/427871697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f66e0 0x7ff1240f6b00 secure :-1 s=READY pgs=3932 cs=0 l=1 rev1=1 rx=0x7ff120004660 tx=0x7ff120009b30).stop 2022-02-02T22:38:54.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 -- 172.21.15.96:0/427871697 shutdown_connections 2022-02-02T22:38:54.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/427871697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f7980 0x7ff1240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/427871697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f66e0 0x7ff1240f6b00 unknown :-1 s=CLOSED pgs=3932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 -- 172.21.15.96:0/427871697 >> 172.21.15.96:0/427871697 conn(0x7ff1240f1e40 msgr2=0x7ff1240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 -- 172.21.15.96:0/427871697 shutdown_connections 2022-02-02T22:38:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 -- 172.21.15.96:0/427871697 wait complete. 2022-02-02T22:38:54.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 Processor -- start 2022-02-02T22:38:54.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.038+0000 7ff12b5f7700 1 -- start start 2022-02-02T22:38:54.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff12b5f7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f66e0 0x7ff124106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff12b5f7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff12b5f7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124107a50 con 0x7ff1240f7980 2022-02-02T22:38:54.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff12b5f7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124107b90 con 0x7ff1240f66e0 2022-02-02T22:38:54.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49612/0 (socket says 172.21.15.96:49612) 2022-02-02T22:38:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 -- 172.21.15.96:0/2398969278 learned_addr learned my addr 172.21.15.96:0/2398969278 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff129393700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f66e0 0x7ff124106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 -- 172.21.15.96:0/2398969278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f66e0 msgr2=0x7ff124106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f66e0 0x7ff124106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 -- 172.21.15.96:0/2398969278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120005040 con 0x7ff1240f7980 2022-02-02T22:38:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.039+0000 7ff128b92700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 secure :-1 s=READY pgs=3933 cs=0 l=1 rev1=1 rx=0x7ff1140026d0 tx=0x7ff114009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.040+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1140079c0 con 0x7ff1240f7980 2022-02-02T22:38:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.040+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff11400f040 con 0x7ff1240f7980 2022-02-02T22:38:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.040+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1140148b0 con 0x7ff1240f7980 2022-02-02T22:38:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.040+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff124108530 con 0x7ff1240f7980 2022-02-02T22:38:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.040+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff124108aa0 con 0x7ff1240f7980 2022-02-02T22:38:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.041+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124045ad0 con 0x7ff1240f7980 2022-02-02T22:38:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.041+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff114007b20 con 0x7ff1240f7980 2022-02-02T22:38:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.042+0000 7ff119ffb700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 0x7ff110067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.042+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff1140819e0 con 0x7ff1240f7980 2022-02-02T22:38:54.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.042+0000 7ff129393700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 0x7ff110067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.042+0000 7ff129393700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 0x7ff110067290 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7ff120004630 tx=0x7ff120009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.046+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff114053510 con 0x7ff1240f7980 2022-02-02T22:38:54.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.226+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff124108d70 con 0x7ff110064dd0 2022-02-02T22:38:54.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.227+0000 7ff119ffb700 1 -- 172.21.15.96:0/2398969278 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff124108d70 con 0x7ff110064dd0 2022-02-02T22:38:54.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 msgr2=0x7ff110067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 0x7ff110067290 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7ff120004630 tx=0x7ff120009b30).stop 2022-02-02T22:38:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 msgr2=0x7ff1241074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 secure :-1 s=READY pgs=3933 cs=0 l=1 rev1=1 rx=0x7ff1140026d0 tx=0x7ff114009de0).stop 2022-02-02T22:38:54.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 shutdown_connections 2022-02-02T22:38:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff110064dd0 0x7ff110067290 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1240f66e0 0x7ff124106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 --2- 172.21.15.96:0/2398969278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1240f7980 0x7ff1241074a0 unknown :-1 s=CLOSED pgs=3933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 >> 172.21.15.96:0/2398969278 conn(0x7ff1240f1e40 msgr2=0x7ff1240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 shutdown_connections 2022-02-02T22:38:54.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.229+0000 7ff12b5f7700 1 -- 172.21.15.96:0/2398969278 wait complete. 2022-02-02T22:38:54.239 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:38:54.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- 172.21.15.96:0/1717200527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f6860 msgr2=0x7f68f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 --2- 172.21.15.96:0/1717200527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f6860 0x7f68f40f6cc0 secure :-1 s=READY pgs=3934 cs=0 l=1 rev1=1 rx=0x7f68e4004660 tx=0x7f68e4009b30).stop 2022-02-02T22:38:54.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- 172.21.15.96:0/1717200527 shutdown_connections 2022-02-02T22:38:54.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 --2- 172.21.15.96:0/1717200527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f6860 0x7f68f40f6cc0 unknown :-1 s=CLOSED pgs=3934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 --2- 172.21.15.96:0/1717200527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68f40f55c0 0x7f68f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- 172.21.15.96:0/1717200527 >> 172.21.15.96:0/1717200527 conn(0x7f68f40f0d40 msgr2=0x7f68f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- 172.21.15.96:0/1717200527 shutdown_connections 2022-02-02T22:38:54.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- 172.21.15.96:0/1717200527 wait complete. 2022-02-02T22:38:54.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 Processor -- start 2022-02-02T22:38:54.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.326+0000 7f68f8a88700 1 -- start start 2022-02-02T22:38:54.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68f40f6860 0x7f68f4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4107a10 con 0x7f68f40f55c0 2022-02-02T22:38:54.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4107b50 con 0x7f68f40f6860 2022-02-02T22:38:54.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49618/0 (socket says 172.21.15.96:49618) 2022-02-02T22:38:54.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 -- 172.21.15.96:0/4077730738 learned_addr learned my addr 172.21.15.96:0/4077730738 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:54.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 -- 172.21.15.96:0/4077730738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68f40f6860 msgr2=0x7f68f4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68f40f6860 0x7f68f4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:38:54.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 -- 172.21.15.96:0/4077730738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4005040 con 0x7f68f40f55c0 2022-02-02T22:38:54.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f259c700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 secure :-1 s=READY pgs=3935 cs=0 l=1 rev1=1 rx=0x7f68e800c530 tx=0x7f68e8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e800f650 con 0x7f68f40f55c0 2022-02-02T22:38:54.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68e800fc60 con 0x7f68f40f55c0 2022-02-02T22:38:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f41084f0 con 0x7f68f40f55c0 2022-02-02T22:38:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.327+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f4108ab0 con 0x7f68f40f55c0 2022-02-02T22:38:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.328+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e8012d20 con 0x7f68f40f55c0 2022-02-02T22:38:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.328+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d8004fa0 con 0x7f68f40f55c0 2022-02-02T22:38:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.329+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68e8019030 con 0x7f68f40f55c0 2022-02-02T22:38:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.329+0000 7f68e2ffd700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.329+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68e8081680 con 0x7f68f40f55c0 2022-02-02T22:38:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.329+0000 7f68f1d9b700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.330+0000 7f68f1d9b700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 0x7f68dc067290 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 rx=0x7f68e4004e30 tx=0x7f68e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.334+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68e8053200 con 0x7f68f40f55c0 2022-02-02T22:38:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.505+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d80029f0 con 0x7f68dc064dd0 2022-02-02T22:38:54.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.514+0000 7f68e2ffd700 1 -- 172.21.15.96:0/4077730738 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f68d80029f0 con 0x7f68dc064dd0 2022-02-02T22:38:54.516 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:38:54.516 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:38:54.516 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:38:54.517 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:38:54.517 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:38:54.517 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:38:54.518 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:38:54.518 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:38:54.519 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:38:54.519 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:38:54.519 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:38:54.520 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:38:54.520 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:38:54.520 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:38:54.521 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:38:54.521 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:38:54.521 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:38:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:38:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:38:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:38:54.523 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:38:54.523 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:38:54.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 msgr2=0x7f68dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 0x7f68dc067290 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 rx=0x7f68e4004e30 tx=0x7f68e4009b30).stop 2022-02-02T22:38:54.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 msgr2=0x7f68f4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 secure :-1 s=READY pgs=3935 cs=0 l=1 rev1=1 rx=0x7f68e800c530 tx=0x7f68e8007e10).stop 2022-02-02T22:38:54.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 shutdown_connections 2022-02-02T22:38:54.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68f40f55c0 0x7f68f4106f70 unknown :-1 s=CLOSED pgs=3935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 --2- 172.21.15.96:0/4077730738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68f40f6860 0x7f68f4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:38:54.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 >> 172.21.15.96:0/4077730738 conn(0x7f68f40f0d40 msgr2=0x7f68f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 shutdown_connections 2022-02-02T22:38:54.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.516+0000 7f68f8a88700 1 -- 172.21.15.96:0/4077730738 wait complete. 2022-02-02T22:38:54.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 -- 172.21.15.96:0/2629937986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 msgr2=0x7f8fd80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/2629937986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd80f7c30 secure :-1 s=READY pgs=3936 cs=0 l=1 rev1=1 rx=0x7f8fc8004660 tx=0x7f8fc8009b30).stop 2022-02-02T22:38:54.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 -- 172.21.15.96:0/2629937986 shutdown_connections 2022-02-02T22:38:54.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/2629937986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd80f7c30 unknown :-1 s=CLOSED pgs=3936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/2629937986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:38:54.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.612+0000 7f8fd7fff700 1 -- 172.21.15.96:0/2629937986 >> 172.21.15.96:0/2629937986 conn(0x7f8fd80f1c90 msgr2=0x7f8fd80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 -- 172.21.15.96:0/2629937986 shutdown_connections 2022-02-02T22:38:54.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 -- 172.21.15.96:0/2629937986 wait complete. 2022-02-02T22:38:54.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 Processor -- start 2022-02-02T22:38:54.619 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 -- start start 2022-02-02T22:38:54.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.620 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.613+0000 7f8fd7fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8109ae0 con 0x7f8fd80f77d0 2022-02-02T22:38:54.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd810a390 con 0x7f8fd80f6530 2022-02-02T22:38:54.621 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49630/0 (socket says 172.21.15.96:49630) 2022-02-02T22:38:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 -- 172.21.15.96:0/4289965425 learned_addr learned my addr 172.21.15.96:0/4289965425 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd6ffd700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 -- 172.21.15.96:0/4289965425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 msgr2=0x7f8fd8108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd8108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 -- 172.21.15.96:0/4289965425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8005040 con 0x7f8fd80f77d0 2022-02-02T22:38:54.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd6ffd700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:38:54.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd67fc700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 secure :-1 s=READY pgs=3937 cs=0 l=1 rev1=1 rx=0x7f8fc8009990 tx=0x7f8fc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc8018070 con 0x7f8fd80f77d0 2022-02-02T22:38:54.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd810a610 con 0x7f8fd80f77d0 2022-02-02T22:38:54.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8fc8007ca0 con 0x7f8fd80f77d0 2022-02-02T22:38:54.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc801c620 con 0x7f8fd80f77d0 2022-02-02T22:38:54.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.614+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd810ab70 con 0x7f8fd80f77d0 2022-02-02T22:38:54.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.615+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8059100 con 0x7f8fd80f77d0 2022-02-02T22:38:54.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.617+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8fc801d960 con 0x7f8fd80f77d0 2022-02-02T22:38:54.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.617+0000 7f8fbf7fe700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 0x7f8fc00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.617+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8fc80837d0 con 0x7f8fd80f77d0 2022-02-02T22:38:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.617+0000 7f8fd6ffd700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 0x7f8fc00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.617+0000 7f8fd6ffd700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 0x7f8fc00672e0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 rx=0x7f8fd80f7630 tx=0x7f8fcc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.621+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8fc8055470 con 0x7f8fd80f77d0 2022-02-02T22:38:54.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.850+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8fd8045ad0 con 0x7f8fd80f77d0 2022-02-02T22:38:54.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.850+0000 7f8fbf7fe700 1 -- 172.21.15.96:0/4289965425 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f8fc8055060 con 0x7f8fd80f77d0 2022-02-02T22:38:54.852 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:38:54.853 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:38:54.853 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:38:54.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:54.853 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:38:54.854 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:38:54.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:54.854 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:38:54.855 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:38:54.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:54.856 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:38:54.856 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:38:54.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:38:54.857 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:38:54.857 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:38:54.857 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:38:54.857 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:38:54.858 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:38:54.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 msgr2=0x7f8fc00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 0x7f8fc00672e0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 rx=0x7f8fd80f7630 tx=0x7f8fcc008040).stop 2022-02-02T22:38:54.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 msgr2=0x7f8fd81094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 secure :-1 s=READY pgs=3937 cs=0 l=1 rev1=1 rx=0x7f8fc8009990 tx=0x7f8fc8009b30).stop 2022-02-02T22:38:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 shutdown_connections 2022-02-02T22:38:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8fc0064e20 0x7f8fc00672e0 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fd80f6530 0x7f8fd8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 --2- 172.21.15.96:0/4289965425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd80f77d0 0x7f8fd81094a0 unknown :-1 s=CLOSED pgs=3937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 >> 172.21.15.96:0/4289965425 conn(0x7f8fd80f1c90 msgr2=0x7f8fd806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 shutdown_connections 2022-02-02T22:38:54.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.852+0000 7f8fd7fff700 1 -- 172.21.15.96:0/4289965425 wait complete. 2022-02-02T22:38:54.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 -- 172.21.15.96:0/2410658517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f5430 msgr2=0x7f40a00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 --2- 172.21.15.96:0/2410658517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f5430 0x7f40a00f5850 secure :-1 s=READY pgs=3938 cs=0 l=1 rev1=1 rx=0x7f4090004660 tx=0x7f4090009b30).stop 2022-02-02T22:38:54.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 -- 172.21.15.96:0/2410658517 shutdown_connections 2022-02-02T22:38:54.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 --2- 172.21.15.96:0/2410658517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f66d0 0x7f40a00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:38:54.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 --2- 172.21.15.96:0/2410658517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f5430 0x7f40a00f5850 unknown :-1 s=CLOSED pgs=3938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 -- 172.21.15.96:0/2410658517 >> 172.21.15.96:0/2410658517 conn(0x7f40a00f0b90 msgr2=0x7f40a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:54.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 -- 172.21.15.96:0/2410658517 shutdown_connections 2022-02-02T22:38:54.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.953+0000 7f409ffff700 1 -- 172.21.15.96:0/2410658517 wait complete. 2022-02-02T22:38:54.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 Processor -- start 2022-02-02T22:38:54.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 -- start start 2022-02-02T22:38:54.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f5430 0x7f40a0108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0109ac0 con 0x7f40a00f66d0 2022-02-02T22:38:54.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a010a370 con 0x7f40a00f5430 2022-02-02T22:38:54.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49640/0 (socket says 172.21.15.96:49640) 2022-02-02T22:38:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.954+0000 7f409e7fc700 1 -- 172.21.15.96:0/4142013509 learned_addr learned my addr 172.21.15.96:0/4142013509 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:38:54.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409effd700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f5430 0x7f40a0108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409e7fc700 1 -- 172.21.15.96:0/4142013509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f5430 msgr2=0x7f40a0108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409e7fc700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f5430 0x7f40a0108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:54.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409e7fc700 1 -- 172.21.15.96:0/4142013509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a00f66d0 2022-02-02T22:38:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409e7fc700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 secure :-1 s=READY pgs=3939 cs=0 l=1 rev1=1 rx=0x7f409400b410 tx=0x7f4094006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40940125f0 con 0x7f40a00f66d0 2022-02-02T22:38:54.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f409400be30 con 0x7f40a00f66d0 2022-02-02T22:38:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a010a650 con 0x7f40a00f66d0 2022-02-02T22:38:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094002a70 con 0x7f40a00f66d0 2022-02-02T22:38:54.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.955+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a010ac10 con 0x7f40a00f66d0 2022-02-02T22:38:54.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.956+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0059100 con 0x7f40a00f66d0 2022-02-02T22:38:54.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.957+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f409400f030 con 0x7f40a00f66d0 2022-02-02T22:38:54.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.957+0000 7f40877fe700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 0x7f40880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:38:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.957+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4094081db0 con 0x7f40a00f66d0 2022-02-02T22:38:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.957+0000 7f409effd700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 0x7f40880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:38:54.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.957+0000 7f409effd700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 0x7f40880672e0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 rx=0x7f4090004630 tx=0x7f4090009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:38:54.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:54.961+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40940538e0 con 0x7f40a00f66d0 2022-02-02T22:38:55.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.163+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f40a0045ad0 con 0x7f40a00f66d0 2022-02-02T22:38:55.164 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:54 smithi096 ceph-mon[101353]: pgmap v7703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:55.165 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4289965425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:38:55.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.163+0000 7f40877fe700 1 -- 172.21.15.96:0/4142013509 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4094002ca0 con 0x7f40a00f66d0 2022-02-02T22:38:55.166 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:38:55.166 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:38:55.167 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:38:55.167 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:38:55.167 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:55.168 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:38:55.168 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:38:55.168 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:38:55.169 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:38:55.169 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:38:55.169 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:38:55.170 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:38:55.170 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:38:55.170 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:38:55.171 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:38:55.171 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:38:55.171 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:38:55.172 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:38:55.172 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:38:55.172 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:38:55.173 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:38:55.173 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:38:55.173 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:38:55.174 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:38:55.174 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:38:55.174 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:38:55.175 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:38:55.175 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:38:55.175 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:38:55.176 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:38:55.176 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:38:55.176 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:38:55.177 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:55.177 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:55.177 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:38:55.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:38:55.178 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:55.178 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:55.179 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:38:55.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 msgr2=0x7f40880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:55.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 0x7f40880672e0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 rx=0x7f4090004630 tx=0x7f4090009b30).stop 2022-02-02T22:38:55.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 msgr2=0x7f40a0109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:38:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 secure :-1 s=READY pgs=3939 cs=0 l=1 rev1=1 rx=0x7f409400b410 tx=0x7f4094006ef0).stop 2022-02-02T22:38:55.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 shutdown_connections 2022-02-02T22:38:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4088064e20 0x7f40880672e0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a00f5430 0x7f40a0108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:55.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 --2- 172.21.15.96:0/4142013509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00f66d0 0x7f40a0109480 unknown :-1 s=CLOSED pgs=3939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:38:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 >> 172.21.15.96:0/4142013509 conn(0x7f40a00f0b90 msgr2=0x7f40a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:38:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 shutdown_connections 2022-02-02T22:38:55.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:38:55.166+0000 7f409ffff700 1 -- 172.21.15.96:0/4142013509 wait complete. 2022-02-02T22:38:55.184 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:38:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:54 smithi159 ceph-mon[69013]: pgmap v7703: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:55.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4289965425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:38:56.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:55 smithi159 ceph-mon[69013]: from='client.41988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:56.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:55 smithi159 ceph-mon[69013]: from='client.41992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:56.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:55 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4142013509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:38:56.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:55 smithi096 ceph-mon[101353]: from='client.41988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:55 smithi096 ceph-mon[101353]: from='client.41992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:38:56.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:55 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4142013509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:38:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:56 smithi159 ceph-mon[69013]: pgmap v7704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:56 smithi096 ceph-mon[101353]: pgmap v7704: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:38:58 smithi159 ceph-mon[69013]: pgmap v7705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:38:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:38:58 smithi096 ceph-mon[101353]: pgmap v7705: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:00 smithi159 ceph-mon[69013]: pgmap v7706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:00 smithi096 ceph-mon[101353]: pgmap v7706: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:03.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:02 smithi096 ceph-mon[101353]: pgmap v7707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:02 smithi159 ceph-mon[69013]: pgmap v7707: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:04 smithi159 ceph-mon[69013]: pgmap v7708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:04 smithi096 ceph-mon[101353]: pgmap v7708: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:06 smithi159 ceph-mon[69013]: pgmap v7709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:07.380 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:06 smithi096 ceph-mon[101353]: pgmap v7709: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:08 smithi159 ceph-mon[69013]: pgmap v7710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:08 smithi096 ceph-mon[101353]: pgmap v7710: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:10 smithi159 ceph-mon[69013]: pgmap v7711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:10 smithi096 ceph-mon[101353]: pgmap v7711: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:12 smithi096 ceph-mon[101353]: pgmap v7712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:12 smithi159 ceph-mon[69013]: pgmap v7712: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:14 smithi159 ceph-mon[69013]: pgmap v7713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:14 smithi096 ceph-mon[101353]: pgmap v7713: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:16 smithi159 ceph-mon[69013]: pgmap v7714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:16 smithi096 ceph-mon[101353]: pgmap v7714: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:18 smithi159 ceph-mon[69013]: pgmap v7715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:18 smithi096 ceph-mon[101353]: pgmap v7715: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:20 smithi159 ceph-mon[69013]: pgmap v7716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:20 smithi096 ceph-mon[101353]: pgmap v7716: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:22 smithi096 ceph-mon[101353]: pgmap v7717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:22 smithi159 ceph-mon[69013]: pgmap v7717: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:24 smithi159 ceph-mon[69013]: pgmap v7718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:25.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 -- 172.21.15.96:0/2296984574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 msgr2=0x7f56180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2296984574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f56180f59e0 secure :-1 s=READY pgs=3940 cs=0 l=1 rev1=1 rx=0x7f560c004660 tx=0x7f560c009b30).stop 2022-02-02T22:39:25.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 -- 172.21.15.96:0/2296984574 shutdown_connections 2022-02-02T22:39:25.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2296984574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 0x7f56180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2296984574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f56180f59e0 unknown :-1 s=CLOSED pgs=3940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 -- 172.21.15.96:0/2296984574 >> 172.21.15.96:0/2296984574 conn(0x7f56180f0d40 msgr2=0x7f56180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:25.280 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:24 smithi096 ceph-mon[101353]: pgmap v7718: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:25.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 -- 172.21.15.96:0/2296984574 shutdown_connections 2022-02-02T22:39:25.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.278+0000 7f561fa2c700 1 -- 172.21.15.96:0/2296984574 wait complete. 2022-02-02T22:39:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 Processor -- start 2022-02-02T22:39:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 -- start start 2022-02-02T22:39:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 0x7f5618106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618106910 con 0x7f56180f55c0 2022-02-02T22:39:25.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561fa2c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618106a50 con 0x7f56180f6860 2022-02-02T22:39:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561d7c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561d7c8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49658/0 (socket says 172.21.15.96:49658) 2022-02-02T22:39:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561d7c8700 1 -- 172.21.15.96:0/2613346144 learned_addr learned my addr 172.21.15.96:0/2613346144 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.279+0000 7f561cfc7700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 0x7f5618106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561d7c8700 1 -- 172.21.15.96:0/2613346144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 msgr2=0x7f5618106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561d7c8700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 0x7f5618106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561d7c8700 1 -- 172.21.15.96:0/2613346144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c005040 con 0x7f56180f55c0 2022-02-02T22:39:25.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561d7c8700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 secure :-1 s=READY pgs=3941 cs=0 l=1 rev1=1 rx=0x7f560c013a70 tx=0x7f560c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.288 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560c018070 con 0x7f56180f55c0 2022-02-02T22:39:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5618107390 con 0x7f56180f55c0 2022-02-02T22:39:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f560c0097d0 con 0x7f56180f55c0 2022-02-02T22:39:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560c01de80 con 0x7f56180f55c0 2022-02-02T22:39:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.280+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56181078f0 con 0x7f56180f55c0 2022-02-02T22:39:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.281+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5618045ad0 con 0x7f56180f55c0 2022-02-02T22:39:25.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.282+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f560c01c4e0 con 0x7f56180f55c0 2022-02-02T22:39:25.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.282+0000 7f5609ffb700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.282+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f560c083650 con 0x7f56180f55c0 2022-02-02T22:39:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.282+0000 7f561cfc7700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.283+0000 7f561cfc7700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 rx=0x7f5614004c40 tx=0x7f561400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.287+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f560c055240 con 0x7f56180f55c0 2022-02-02T22:39:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.465+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56180fde90 con 0x7f5604064dd0 2022-02-02T22:39:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.466+0000 7f5609ffb700 1 -- 172.21.15.96:0/2613346144 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f56180fde90 con 0x7f5604064dd0 2022-02-02T22:39:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 msgr2=0x7f5604067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 rx=0x7f5614004c40 tx=0x7f561400b040).stop 2022-02-02T22:39:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 msgr2=0x7f5618105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 secure :-1 s=READY pgs=3941 cs=0 l=1 rev1=1 rx=0x7f560c013a70 tx=0x7f560c009b30).stop 2022-02-02T22:39:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 shutdown_connections 2022-02-02T22:39:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5604064dd0 0x7f5604067290 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56180f55c0 0x7f5618105e70 unknown :-1 s=CLOSED pgs=3941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 --2- 172.21.15.96:0/2613346144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56180f6860 0x7f5618106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 >> 172.21.15.96:0/2613346144 conn(0x7f56180f0d40 msgr2=0x7f56180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:25.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 shutdown_connections 2022-02-02T22:39:25.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.468+0000 7f561fa2c700 1 -- 172.21.15.96:0/2613346144 wait complete. 2022-02-02T22:39:25.477 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:39:25.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 -- 172.21.15.96:0/1825714866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 msgr2=0x7fe2c00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 --2- 172.21.15.96:0/1825714866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c00f5860 secure :-1 s=READY pgs=3942 cs=0 l=1 rev1=1 rx=0x7fe2b0004660 tx=0x7fe2b0009b30).stop 2022-02-02T22:39:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 -- 172.21.15.96:0/1825714866 shutdown_connections 2022-02-02T22:39:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 --2- 172.21.15.96:0/1825714866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 0x7fe2c00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:39:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 --2- 172.21.15.96:0/1825714866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c00f5860 unknown :-1 s=CLOSED pgs=3942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 -- 172.21.15.96:0/1825714866 >> 172.21.15.96:0/1825714866 conn(0x7fe2c00f0ba0 msgr2=0x7fe2c00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 -- 172.21.15.96:0/1825714866 shutdown_connections 2022-02-02T22:39:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.565+0000 7fe2c6187700 1 -- 172.21.15.96:0/1825714866 wait complete. 2022-02-02T22:39:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 Processor -- start 2022-02-02T22:39:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 -- start start 2022-02-02T22:39:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 0x7fe2c010e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00602d0 con 0x7fe2c00f5440 2022-02-02T22:39:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c6187700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0060410 con 0x7fe2c00f66e0 2022-02-02T22:39:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c5185700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c5185700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49668/0 (socket says 172.21.15.96:49668) 2022-02-02T22:39:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c5185700 1 -- 172.21.15.96:0/2729354352 learned_addr learned my addr 172.21.15.96:0/2729354352 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:25.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c4984700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 0x7fe2c010e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.566+0000 7fe2c5185700 1 -- 172.21.15.96:0/2729354352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 msgr2=0x7fe2c010e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2c5185700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 0x7fe2c010e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2c5185700 1 -- 172.21.15.96:0/2729354352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0005040 con 0x7fe2c00f5440 2022-02-02T22:39:25.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2c5185700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 secure :-1 s=READY pgs=3943 cs=0 l=1 rev1=1 rx=0x7fe2b0004f60 tx=0x7fe2b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2b0018070 con 0x7fe2c00f5440 2022-02-02T22:39:25.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c010e8a0 con 0x7fe2c00f5440 2022-02-02T22:39:25.576 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2b0009770 con 0x7fe2c00f5440 2022-02-02T22:39:25.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2b001c3c0 con 0x7fe2c00f5440 2022-02-02T22:39:25.577 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.567+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c010ecd0 con 0x7fe2c00f5440 2022-02-02T22:39:25.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.568+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c0045ad0 con 0x7fe2c00f5440 2022-02-02T22:39:25.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.568+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2b001d420 con 0x7fe2c00f5440 2022-02-02T22:39:25.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.569+0000 7fe2b5ffb700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 0x7fe2ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.569+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2b0083880 con 0x7fe2c00f5440 2022-02-02T22:39:25.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.569+0000 7fe2c4984700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 0x7fe2ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.569+0000 7fe2c4984700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 0x7fe2ac0672e0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7fe2bc006fd0 tx=0x7fe2bc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.573+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2b0051a40 con 0x7fe2c00f5440 2022-02-02T22:39:25.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.745+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2c00fde30 con 0x7fe2ac064e20 2022-02-02T22:39:25.754 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.754+0000 7fe2b5ffb700 1 -- 172.21.15.96:0/2729354352 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe2bc00b5d0 con 0x7fe2ac064e20 2022-02-02T22:39:25.755 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:39:25.755 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:39:25.756 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:39:25.756 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:39:25.756 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:39:25.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:39:25.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:39:25.757 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:39:25.758 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:39:25.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:39:25.758 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:39:25.759 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:39:25.759 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:39:25.759 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:39:25.760 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:39:25.760 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:39:25.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:39:25.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:39:25.761 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:39:25.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:39:25.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:39:25.762 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:39:25.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 msgr2=0x7fe2ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 0x7fe2ac0672e0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7fe2bc006fd0 tx=0x7fe2bc008040).stop 2022-02-02T22:39:25.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 msgr2=0x7fe2c010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 secure :-1 s=READY pgs=3943 cs=0 l=1 rev1=1 rx=0x7fe2b0004f60 tx=0x7fe2b0009b30).stop 2022-02-02T22:39:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 shutdown_connections 2022-02-02T22:39:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe2ac064e20 0x7fe2ac0672e0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c00f5440 0x7fe2c010beb0 unknown :-1 s=CLOSED pgs=3943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 --2- 172.21.15.96:0/2729354352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c00f66e0 0x7fe2c010e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 >> 172.21.15.96:0/2729354352 conn(0x7fe2c00f0ba0 msgr2=0x7fe2c00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 shutdown_connections 2022-02-02T22:39:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.756+0000 7fe2c6187700 1 -- 172.21.15.96:0/2729354352 wait complete. 2022-02-02T22:39:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.853+0000 7f80a759e700 1 -- 172.21.15.96:0/400813186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f6530 msgr2=0x7f80a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.853+0000 7f80a759e700 1 --2- 172.21.15.96:0/400813186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f6530 0x7f80a80f6950 secure :-1 s=READY pgs=3944 cs=0 l=1 rev1=1 rx=0x7f8098004660 tx=0x7f8098009b30).stop 2022-02-02T22:39:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.853+0000 7f80a759e700 1 -- 172.21.15.96:0/400813186 shutdown_connections 2022-02-02T22:39:25.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.853+0000 7f80a759e700 1 --2- 172.21.15.96:0/400813186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f77d0 0x7f80a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.853+0000 7f80a759e700 1 --2- 172.21.15.96:0/400813186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f6530 0x7f80a80f6950 unknown :-1 s=CLOSED pgs=3944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- 172.21.15.96:0/400813186 >> 172.21.15.96:0/400813186 conn(0x7f80a80f1c90 msgr2=0x7f80a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- 172.21.15.96:0/400813186 shutdown_connections 2022-02-02T22:39:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- 172.21.15.96:0/400813186 wait complete. 2022-02-02T22:39:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 Processor -- start 2022-02-02T22:39:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- start start 2022-02-02T22:39:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f6530 0x7f80a8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a81078f0 con 0x7f80a80f77d0 2022-02-02T22:39:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.854+0000 7f80a759e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8108100 con 0x7f80a80f6530 2022-02-02T22:39:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49680/0 (socket says 172.21.15.96:49680) 2022-02-02T22:39:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 -- 172.21.15.96:0/2631286436 learned_addr learned my addr 172.21.15.96:0/2631286436 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a659c700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f6530 0x7f80a8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 -- 172.21.15.96:0/2631286436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f6530 msgr2=0x7f80a8106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f6530 0x7f80a8106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 -- 172.21.15.96:0/2631286436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098005040 con 0x7f80a80f77d0 2022-02-02T22:39:25.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a5d9b700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 secure :-1 s=READY pgs=3945 cs=0 l=1 rev1=1 rx=0x7f809c00c530 tx=0x7f809c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c00f650 con 0x7f80a80f77d0 2022-02-02T22:39:25.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f809c00fc60 con 0x7f80a80f77d0 2022-02-02T22:39:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c012c20 con 0x7f80a80f77d0 2022-02-02T22:39:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a8108380 con 0x7f80a80f77d0 2022-02-02T22:39:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.855+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a81088f0 con 0x7f80a80f77d0 2022-02-02T22:39:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.856+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8059100 con 0x7f80a80f77d0 2022-02-02T22:39:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.857+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f809c010070 con 0x7f80a80f77d0 2022-02-02T22:39:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.857+0000 7f8096ffd700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 0x7f80900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.857+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f809c0816e0 con 0x7f80a80f77d0 2022-02-02T22:39:25.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.858+0000 7f80a659c700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 0x7f80900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.858+0000 7f80a659c700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 0x7f80900672e0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 rx=0x7f8098013690 tx=0x7f8098009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:25.869 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:25.863+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f809c04f7e0 con 0x7f80a80f77d0 2022-02-02T22:39:26.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.094+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80a80fede0 con 0x7f80a80f77d0 2022-02-02T22:39:26.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.094+0000 7f8096ffd700 1 -- 172.21.15.96:0/2631286436 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f809c052e00 con 0x7f80a80f77d0 2022-02-02T22:39:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:39:26.095 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:39:26.096 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:39:26.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:26.096 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:39:26.097 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:39:26.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:26.097 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:39:26.098 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:39:26.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:26.098 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:39:26.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:39:26.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:26.099 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:39:26.100 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:39:26.100 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:39:26.100 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:39:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:39:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 msgr2=0x7f80900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 0x7f80900672e0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 rx=0x7f8098013690 tx=0x7f8098009b30).stop 2022-02-02T22:39:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 msgr2=0x7f80a81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 secure :-1 s=READY pgs=3945 cs=0 l=1 rev1=1 rx=0x7f809c00c530 tx=0x7f809c007e20).stop 2022-02-02T22:39:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 shutdown_connections 2022-02-02T22:39:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8090064e20 0x7f80900672e0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80a80f6530 0x7f80a8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 --2- 172.21.15.96:0/2631286436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a80f77d0 0x7f80a81072f0 unknown :-1 s=CLOSED pgs=3945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 >> 172.21.15.96:0/2631286436 conn(0x7f80a80f1c90 msgr2=0x7f80a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 shutdown_connections 2022-02-02T22:39:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.096+0000 7f80a759e700 1 -- 172.21.15.96:0/2631286436 wait complete. 2022-02-02T22:39:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/516212596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f55c0 msgr2=0x7f0e280f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/516212596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f55c0 0x7f0e280f59e0 secure :-1 s=READY pgs=3946 cs=0 l=1 rev1=1 rx=0x7f0e10004660 tx=0x7f0e10009b30).stop 2022-02-02T22:39:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/516212596 shutdown_connections 2022-02-02T22:39:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/516212596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f6860 0x7f0e280f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:39:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/516212596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f55c0 0x7f0e280f59e0 unknown :-1 s=CLOSED pgs=3946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/516212596 >> 172.21.15.96:0/516212596 conn(0x7f0e280f0d40 msgr2=0x7f0e280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/516212596 shutdown_connections 2022-02-02T22:39:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.193+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/516212596 wait complete. 2022-02-02T22:39:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 Processor -- start 2022-02-02T22:39:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 -- start start 2022-02-02T22:39:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f55c0 0x7f0e28105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281069f0 con 0x7f0e280f6860 2022-02-02T22:39:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2ce9f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281072a0 con 0x7f0e280f55c0 2022-02-02T22:39:26.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:26.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e25d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49690/0 (socket says 172.21.15.96:49690) 2022-02-02T22:39:26.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e25d9b700 1 -- 172.21.15.96:0/2407901746 learned_addr learned my addr 172.21.15.96:0/2407901746 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.194+0000 7f0e2659c700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f55c0 0x7f0e28105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e25d9b700 1 -- 172.21.15.96:0/2407901746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f55c0 msgr2=0x7f0e28105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e25d9b700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f55c0 0x7f0e28105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e25d9b700 1 -- 172.21.15.96:0/2407901746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10005040 con 0x7f0e280f6860 2022-02-02T22:39:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e25d9b700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 secure :-1 s=READY pgs=3947 cs=0 l=1 rev1=1 rx=0x7f0e1800b410 tx=0x7f0e18006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e180125f0 con 0x7f0e280f6860 2022-02-02T22:39:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e1800be30 con 0x7f0e280f6860 2022-02-02T22:39:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e28107580 con 0x7f0e280f6860 2022-02-02T22:39:26.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e18002a70 con 0x7f0e280f6860 2022-02-02T22:39:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.195+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e28107b40 con 0x7f0e280f6860 2022-02-02T22:39:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.196+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e280f49b0 con 0x7f0e280f6860 2022-02-02T22:39:26.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.196+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e1800f030 con 0x7f0e280f6860 2022-02-02T22:39:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.197+0000 7f0e1effd700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 0x7f0e14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.197+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e18081e60 con 0x7f0e280f6860 2022-02-02T22:39:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.197+0000 7f0e2659c700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 0x7f0e14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.197+0000 7f0e2659c700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 0x7f0e14067290 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7f0e10004630 tx=0x7f0e10009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.201+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e18053990 con 0x7f0e280f6860 2022-02-02T22:39:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.403+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e280fde00 con 0x7f0e280f6860 2022-02-02T22:39:26.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.404+0000 7f0e1effd700 1 -- 172.21.15.96:0/2407901746 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0e18053580 con 0x7f0e280f6860 2022-02-02T22:39:26.405 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:39:26.405 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:39:26.405 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:39:26.406 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:39:26.406 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:26.407 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:39:26.407 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:39:26.407 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:39:26.408 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:39:26.408 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:39:26.408 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:39:26.409 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:39:26.409 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:39:26.409 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:39:26.410 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:39:26.410 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:39:26.411 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:39:26.411 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:39:26.411 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:39:26.412 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:39:26.412 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:39:26.412 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:39:26.413 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:39:26.413 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:39:26.413 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:39:26.414 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:39:26.414 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:39:26.415 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:39:26.415 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:39:26.415 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:39:26.416 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:39:26.416 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:39:26.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:26.417 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:26.417 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:39:26.417 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:26.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:26.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:26.418 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:26.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 msgr2=0x7f0e14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.420 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 0x7f0e14067290 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7f0e10004630 tx=0x7f0e10009b30).stop 2022-02-02T22:39:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 msgr2=0x7f0e281063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 secure :-1 s=READY pgs=3947 cs=0 l=1 rev1=1 rx=0x7f0e1800b410 tx=0x7f0e18006ef0).stop 2022-02-02T22:39:26.421 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 shutdown_connections 2022-02-02T22:39:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e14064dd0 0x7f0e14067290 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e280f55c0 0x7f0e28105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.422 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.405+0000 7f0e2ce9f700 1 --2- 172.21.15.96:0/2407901746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e280f6860 0x7f0e281063b0 unknown :-1 s=CLOSED pgs=3947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.406+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 >> 172.21.15.96:0/2407901746 conn(0x7f0e280f0d40 msgr2=0x7f0e280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.406+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 shutdown_connections 2022-02-02T22:39:26.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:26.406+0000 7f0e2ce9f700 1 -- 172.21.15.96:0/2407901746 wait complete. 2022-02-02T22:39:26.424 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:39:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:26 smithi159 ceph-mon[69013]: pgmap v7719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:26 smithi159 ceph-mon[69013]: from='client.42004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:26 smithi159 ceph-mon[69013]: from='client.42008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2631286436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:39:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:26 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2407901746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:39:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:26 smithi096 ceph-mon[101353]: pgmap v7719: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:26 smithi096 ceph-mon[101353]: from='client.42004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:26 smithi096 ceph-mon[101353]: from='client.42008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2631286436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:39:27.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:26 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2407901746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:39:28.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:39:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:39:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:39:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:39:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:28 smithi159 ceph-mon[69013]: pgmap v7720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:28 smithi096 ceph-mon[101353]: pgmap v7720: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:30 smithi159 ceph-mon[69013]: pgmap v7721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:30 smithi096 ceph-mon[101353]: pgmap v7721: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:32 smithi096 ceph-mon[101353]: pgmap v7722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:32 smithi159 ceph-mon[69013]: pgmap v7722: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:34 smithi159 ceph-mon[69013]: pgmap v7723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:34 smithi096 ceph-mon[101353]: pgmap v7723: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:36 smithi159 ceph-mon[69013]: pgmap v7724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:36 smithi096 ceph-mon[101353]: pgmap v7724: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:38 smithi159 ceph-mon[69013]: pgmap v7725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:38 smithi096 ceph-mon[101353]: pgmap v7725: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:40 smithi159 ceph-mon[69013]: pgmap v7726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:40 smithi096 ceph-mon[101353]: pgmap v7726: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:42 smithi159 ceph-mon[69013]: pgmap v7727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:43.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:42 smithi096 ceph-mon[101353]: pgmap v7727: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:44 smithi159 ceph-mon[69013]: pgmap v7728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:44 smithi096 ceph-mon[101353]: pgmap v7728: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:47.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:47 smithi159 ceph-mon[69013]: pgmap v7729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:47 smithi096 ceph-mon[101353]: pgmap v7729: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:49 smithi159 ceph-mon[69013]: pgmap v7730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:49 smithi096 ceph-mon[101353]: pgmap v7730: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:51 smithi159 ceph-mon[69013]: pgmap v7731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:51 smithi096 ceph-mon[101353]: pgmap v7731: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:53 smithi159 ceph-mon[69013]: pgmap v7732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:53.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:53 smithi096 ceph-mon[101353]: pgmap v7732: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:55 smithi159 ceph-mon[69013]: pgmap v7733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:55 smithi096 ceph-mon[101353]: pgmap v7733: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:56.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 -- 172.21.15.96:0/3210192789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 msgr2=0x7f7dfc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 --2- 172.21.15.96:0/3210192789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc0f6cc0 secure :-1 s=READY pgs=3948 cs=0 l=1 rev1=1 rx=0x7f7de8004660 tx=0x7f7de8009b30).stop 2022-02-02T22:39:56.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 -- 172.21.15.96:0/3210192789 shutdown_connections 2022-02-02T22:39:56.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 --2- 172.21.15.96:0/3210192789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc0f6cc0 unknown :-1 s=CLOSED pgs=3948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 --2- 172.21.15.96:0/3210192789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 0x7f7dfc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:39:56.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 -- 172.21.15.96:0/3210192789 >> 172.21.15.96:0/3210192789 conn(0x7f7dfc0f0d40 msgr2=0x7f7dfc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:56.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 -- 172.21.15.96:0/3210192789 shutdown_connections 2022-02-02T22:39:56.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.515+0000 7f7e030bf700 1 -- 172.21.15.96:0/3210192789 wait complete. 2022-02-02T22:39:56.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 Processor -- start 2022-02-02T22:39:56.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 -- start start 2022-02-02T22:39:56.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 0x7f7dfc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.522 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc0604b0 con 0x7f7dfc0f6860 2022-02-02T22:39:56.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7e030bf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc0605f0 con 0x7f7dfc0f55c0 2022-02-02T22:39:56.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.523 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49712/0 (socket says 172.21.15.96:49712) 2022-02-02T22:39:56.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.516+0000 7f7dfbfff700 1 -- 172.21.15.96:0/133235919 learned_addr learned my addr 172.21.15.96:0/133235919 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:56.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7e00e5b700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 0x7f7dfc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7dfbfff700 1 -- 172.21.15.96:0/133235919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 msgr2=0x7f7dfc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7dfbfff700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 0x7f7dfc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7dfbfff700 1 -- 172.21.15.96:0/133235919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8005040 con 0x7f7dfc0f6860 2022-02-02T22:39:56.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7dfbfff700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 secure :-1 s=READY pgs=3949 cs=0 l=1 rev1=1 rx=0x7f7de8009990 tx=0x7f7de8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:56.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de8018070 con 0x7f7dfc0f6860 2022-02-02T22:39:56.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7de8007ca0 con 0x7f7dfc0f6860 2022-02-02T22:39:56.526 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc10c770 con 0x7f7dfc0f6860 2022-02-02T22:39:56.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de801c620 con 0x7f7dfc0f6860 2022-02-02T22:39:56.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.517+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc10ccd0 con 0x7f7dfc0f6860 2022-02-02T22:39:56.527 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.518+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc004fa0 con 0x7f7dfc0f6860 2022-02-02T22:39:56.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.519+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7de801c8e0 con 0x7f7dfc0f6860 2022-02-02T22:39:56.528 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.519+0000 7f7df97fa700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 0x7f7dec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.519+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7de8083730 con 0x7f7dfc0f6860 2022-02-02T22:39:56.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.519+0000 7f7e00e5b700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 0x7f7dec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.529 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.519+0000 7f7e00e5b700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 0x7f7dec067290 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 rx=0x7f7dfc0600a0 tx=0x7f7df0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:56.530 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.523+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7de8051830 con 0x7f7dfc0f6860 2022-02-02T22:39:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.707+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ddc000bc0 con 0x7f7dec064dd0 2022-02-02T22:39:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.708+0000 7f7df97fa700 1 -- 172.21.15.96:0/133235919 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7ddc000bc0 con 0x7f7dec064dd0 2022-02-02T22:39:56.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 msgr2=0x7f7dec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 0x7f7dec067290 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 rx=0x7f7dfc0600a0 tx=0x7f7df0008040).stop 2022-02-02T22:39:56.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 msgr2=0x7f7dfc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 secure :-1 s=READY pgs=3949 cs=0 l=1 rev1=1 rx=0x7f7de8009990 tx=0x7f7de8009b30).stop 2022-02-02T22:39:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 shutdown_connections 2022-02-02T22:39:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7dec064dd0 0x7f7dec067290 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dfc0f55c0 0x7f7dfc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 --2- 172.21.15.96:0/133235919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7dfc0f6860 0x7f7dfc10c170 unknown :-1 s=CLOSED pgs=3949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 >> 172.21.15.96:0/133235919 conn(0x7f7dfc0f0d40 msgr2=0x7f7dfc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:56.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 shutdown_connections 2022-02-02T22:39:56.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.710+0000 7f7e030bf700 1 -- 172.21.15.96:0/133235919 wait complete. 2022-02-02T22:39:56.720 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:39:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 -- 172.21.15.96:0/1367536604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 msgr2=0x7f1f340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 --2- 172.21.15.96:0/1367536604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f340f6cc0 secure :-1 s=READY pgs=3950 cs=0 l=1 rev1=1 rx=0x7f1f28004660 tx=0x7f1f28009b30).stop 2022-02-02T22:39:56.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 -- 172.21.15.96:0/1367536604 shutdown_connections 2022-02-02T22:39:56.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 --2- 172.21.15.96:0/1367536604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f340f6cc0 unknown :-1 s=CLOSED pgs=3950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 --2- 172.21.15.96:0/1367536604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 -- 172.21.15.96:0/1367536604 >> 172.21.15.96:0/1367536604 conn(0x7f1f340f0d40 msgr2=0x7f1f340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:56.811 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 -- 172.21.15.96:0/1367536604 shutdown_connections 2022-02-02T22:39:56.812 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.809+0000 7f1f3928d700 1 -- 172.21.15.96:0/1367536604 wait complete. 2022-02-02T22:39:56.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 Processor -- start 2022-02-02T22:39:56.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 -- start start 2022-02-02T22:39:56.815 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f3410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340602b0 con 0x7f1f340f6860 2022-02-02T22:39:56.816 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f3928d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340603f0 con 0x7f1f340f55c0 2022-02-02T22:39:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49722/0 (socket says 172.21.15.96:49722) 2022-02-02T22:39:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f327fc700 1 -- 172.21.15.96:0/3223147381 learned_addr learned my addr 172.21.15.96:0/3223147381 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.810+0000 7f1f32ffd700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f3410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f327fc700 1 -- 172.21.15.96:0/3223147381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 msgr2=0x7f1f3410c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f327fc700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f3410c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:56.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f327fc700 1 -- 172.21.15.96:0/3223147381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f28005040 con 0x7f1f340f6860 2022-02-02T22:39:56.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f32ffd700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f3410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:39:56.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f327fc700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 secure :-1 s=READY pgs=3951 cs=0 l=1 rev1=1 rx=0x7f1f28009990 tx=0x7f1f28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:56.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f28018070 con 0x7f1f340f6860 2022-02-02T22:39:56.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3410ea60 con 0x7f1f340f6860 2022-02-02T22:39:56.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f28007ba0 con 0x7f1f340f6860 2022-02-02T22:39:56.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2801c3c0 con 0x7f1f340f6860 2022-02-02T22:39:56.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.811+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3410ee30 con 0x7f1f340f6860 2022-02-02T22:39:56.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.812+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f340f49b0 con 0x7f1f340f6860 2022-02-02T22:39:56.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.812+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f2801d420 con 0x7f1f340f6860 2022-02-02T22:39:56.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.813+0000 7f1f1b7fe700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 0x7f1f1c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.813+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1f28083740 con 0x7f1f340f6860 2022-02-02T22:39:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.813+0000 7f1f32ffd700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 0x7f1f1c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.813+0000 7f1f32ffd700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 0x7f1f1c067290 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 rx=0x7f1f24009fd0 tx=0x7f1f2400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.817+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f280517e0 con 0x7f1f340f6860 2022-02-02T22:39:56.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.990+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f340fddf0 con 0x7f1f1c064dd0 2022-02-02T22:39:57.000 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:56.999+0000 7f1f1b7fe700 1 -- 172.21.15.96:0/3223147381 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1f340fddf0 con 0x7f1f1c064dd0 2022-02-02T22:39:57.001 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:39:57.001 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:39:57.002 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:39:57.002 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:39:57.002 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:39:57.003 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:39:57.003 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:39:57.003 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:39:57.004 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:39:57.004 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:39:57.004 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:39:57.005 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:39:57.005 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:39:57.005 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:39:57.006 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:39:57.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:39:57.006 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:39:57.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:39:57.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:39:57.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:39:57.008 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:39:57.008 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:39:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 msgr2=0x7f1f1c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 0x7f1f1c067290 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 rx=0x7f1f24009fd0 tx=0x7f1f2400b040).stop 2022-02-02T22:39:57.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 msgr2=0x7f1f3410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 secure :-1 s=READY pgs=3951 cs=0 l=1 rev1=1 rx=0x7f1f28009990 tx=0x7f1f28009b30).stop 2022-02-02T22:39:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 shutdown_connections 2022-02-02T22:39:57.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f1c064dd0 0x7f1f1c067290 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f340f55c0 0x7f1f3410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 --2- 172.21.15.96:0/3223147381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f340f6860 0x7f1f3410e570 unknown :-1 s=CLOSED pgs=3951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 >> 172.21.15.96:0/3223147381 conn(0x7f1f340f0d40 msgr2=0x7f1f340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:57.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 shutdown_connections 2022-02-02T22:39:57.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.001+0000 7f1f3928d700 1 -- 172.21.15.96:0/3223147381 wait complete. 2022-02-02T22:39:57.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 -- 172.21.15.96:0/1152899086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 msgr2=0x7feb200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.098 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 --2- 172.21.15.96:0/1152899086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb200f6b30 secure :-1 s=READY pgs=3952 cs=0 l=1 rev1=1 rx=0x7feb14004660 tx=0x7feb14009b30).stop 2022-02-02T22:39:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 -- 172.21.15.96:0/1152899086 shutdown_connections 2022-02-02T22:39:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 --2- 172.21.15.96:0/1152899086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb200f6b30 unknown :-1 s=CLOSED pgs=3952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.099 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 --2- 172.21.15.96:0/1152899086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 0x7feb200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.097+0000 7feb1f59e700 1 -- 172.21.15.96:0/1152899086 >> 172.21.15.96:0/1152899086 conn(0x7feb200f0b90 msgr2=0x7feb200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:57.100 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:57 smithi096 ceph-mon[101353]: pgmap v7734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:57.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 -- 172.21.15.96:0/1152899086 shutdown_connections 2022-02-02T22:39:57.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 -- 172.21.15.96:0/1152899086 wait complete. 2022-02-02T22:39:57.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 Processor -- start 2022-02-02T22:39:57.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 -- start start 2022-02-02T22:39:57.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 0x7feb20108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb201099e0 con 0x7feb200f66d0 2022-02-02T22:39:57.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20109b20 con 0x7feb200f5430 2022-02-02T22:39:57.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49732/0 (socket says 172.21.15.96:49732) 2022-02-02T22:39:57.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.098+0000 7feb1dd9b700 1 -- 172.21.15.96:0/147260163 learned_addr learned my addr 172.21.15.96:0/147260163 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1e59c700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 0x7feb20108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1dd9b700 1 -- 172.21.15.96:0/147260163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 msgr2=0x7feb20108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1dd9b700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 0x7feb20108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1dd9b700 1 -- 172.21.15.96:0/147260163 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14005040 con 0x7feb200f66d0 2022-02-02T22:39:57.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1dd9b700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 secure :-1 s=READY pgs=3953 cs=0 l=1 rev1=1 rx=0x7feb14009830 tx=0x7feb14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:57.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb14018070 con 0x7feb200f66d0 2022-02-02T22:39:57.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2010a460 con 0x7feb200f66d0 2022-02-02T22:39:57.109 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb14007ba0 con 0x7feb200f66d0 2022-02-02T22:39:57.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1401c3c0 con 0x7feb200f66d0 2022-02-02T22:39:57.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.099+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2010a9c0 con 0x7feb200f66d0 2022-02-02T22:39:57.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.100+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb20045ad0 con 0x7feb200f66d0 2022-02-02T22:39:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.101+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb14007d10 con 0x7feb200f66d0 2022-02-02T22:39:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.101+0000 7feb0effd700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 0x7feb080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.101+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feb14083640 con 0x7feb200f66d0 2022-02-02T22:39:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.101+0000 7feb1e59c700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 0x7feb080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.102+0000 7feb1e59c700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 0x7feb080672e0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7feb200f6530 tx=0x7feb1000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:57.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.105+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb14055230 con 0x7feb200f66d0 2022-02-02T22:39:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:57 smithi159 ceph-mon[69013]: pgmap v7734: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:57.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.336+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb2010f560 con 0x7feb200f66d0 2022-02-02T22:39:57.337 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.336+0000 7feb0effd700 1 -- 172.21.15.96:0/147260163 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7feb14054e20 con 0x7feb200f66d0 2022-02-02T22:39:57.337 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:39:57.338 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:39:57.338 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:39:57.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:57.339 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:39:57.339 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:39:57.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:57.340 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:39:57.340 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:39:57.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:57.341 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:39:57.341 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:39:57.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:39:57.342 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:39:57.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:39:57.342 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:39:57.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:39:57.343 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:39:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 msgr2=0x7feb080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 0x7feb080672e0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7feb200f6530 tx=0x7feb1000b040).stop 2022-02-02T22:39:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 msgr2=0x7feb20109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 secure :-1 s=READY pgs=3953 cs=0 l=1 rev1=1 rx=0x7feb14009830 tx=0x7feb14009b30).stop 2022-02-02T22:39:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 shutdown_connections 2022-02-02T22:39:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7feb08064e20 0x7feb080672e0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb200f5430 0x7feb20108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 --2- 172.21.15.96:0/147260163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb200f66d0 0x7feb20109430 unknown :-1 s=CLOSED pgs=3953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 >> 172.21.15.96:0/147260163 conn(0x7feb200f0b90 msgr2=0x7feb2005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 shutdown_connections 2022-02-02T22:39:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.338+0000 7feb1f59e700 1 -- 172.21.15.96:0/147260163 wait complete. 2022-02-02T22:39:57.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 -- 172.21.15.96:0/3481536301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f55e0 msgr2=0x7f1eb80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/3481536301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f55e0 0x7f1eb80f5a00 secure :-1 s=READY pgs=3954 cs=0 l=1 rev1=1 rx=0x7f1eac004660 tx=0x7f1eac009b30).stop 2022-02-02T22:39:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 -- 172.21.15.96:0/3481536301 shutdown_connections 2022-02-02T22:39:57.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/3481536301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f5ef0 0x7f1eb80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/3481536301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f55e0 0x7f1eb80f5a00 unknown :-1 s=CLOSED pgs=3954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 -- 172.21.15.96:0/3481536301 >> 172.21.15.96:0/3481536301 conn(0x7f1eb80f0de0 msgr2=0x7f1eb80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:57.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 -- 172.21.15.96:0/3481536301 shutdown_connections 2022-02-02T22:39:57.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.436+0000 7f1ebd77a700 1 -- 172.21.15.96:0/3481536301 wait complete. 2022-02-02T22:39:57.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 Processor -- start 2022-02-02T22:39:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 -- start start 2022-02-02T22:39:57.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f5ef0 0x7f1eb810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80604e0 con 0x7f1eb80f5ef0 2022-02-02T22:39:57.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1ebd77a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8060620 con 0x7f1eb80f55e0 2022-02-02T22:39:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1eb6ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1eb6ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:53844/0 (socket says 172.21.15.96:53844) 2022-02-02T22:39:57.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.437+0000 7f1eb6ffd700 1 -- 172.21.15.96:0/1692290852 learned_addr learned my addr 172.21.15.96:0/1692290852 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:39:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1eb67fc700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f5ef0 0x7f1eb810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1eb6ffd700 1 -- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f5ef0 msgr2=0x7f1eb810c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1eb6ffd700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f5ef0 0x7f1eb810c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1eb6ffd700 1 -- 172.21.15.96:0/1692290852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac005040 con 0x7f1eb80f55e0 2022-02-02T22:39:57.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1eb6ffd700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1eac000c00 tx=0x7f1eac00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:57.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac019070 con 0x7f1eb80f55e0 2022-02-02T22:39:57.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb810c640 con 0x7f1eb80f55e0 2022-02-02T22:39:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1eac007e70 con 0x7f1eb80f55e0 2022-02-02T22:39:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac014ce0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.438+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb810cba0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.439+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8045ad0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.440+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1eac025070 con 0x7f1eb80f55e0 2022-02-02T22:39:57.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.440+0000 7f1e9f7fe700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 0x7f1ea0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:39:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.440+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1eac0829e0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.440+0000 7f1eb67fc700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 0x7f1ea0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:39:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.440+0000 7f1eb67fc700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 0x7f1ea0067290 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 rx=0x7f1ea8009fd0 tx=0x7f1ea800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:39:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.445+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1eac050ae0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.644+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1eb80fded0 con 0x7f1eb80f55e0 2022-02-02T22:39:57.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.645+0000 7f1e9f7fe700 1 -- 172.21.15.96:0/1692290852 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1eac023020 con 0x7f1eb80f55e0 2022-02-02T22:39:57.646 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:39:57.646 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:39:57.647 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:39:57.647 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:39:57.647 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:39:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:39:57.648 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:39:57.649 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:39:57.649 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:39:57.649 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:39:57.650 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:39:57.650 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:39:57.650 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:39:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:39:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:39:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:39:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:39:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:39:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:39:57.653 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:39:57.653 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:39:57.653 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:39:57.654 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:39:57.654 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:39:57.654 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:39:57.655 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:39:57.655 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:39:57.655 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:39:57.656 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:39:57.656 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:39:57.656 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:39:57.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:57.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:57.657 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:39:57.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:39:57.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:57.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:57.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:39:57.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 msgr2=0x7f1ea0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 0x7f1ea0067290 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 rx=0x7f1ea8009fd0 tx=0x7f1ea800b040).stop 2022-02-02T22:39:57.660 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 msgr2=0x7f1eb8109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:39:57.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1eac000c00 tx=0x7f1eac00b040).stop 2022-02-02T22:39:57.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 shutdown_connections 2022-02-02T22:39:57.661 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ea0064dd0 0x7f1ea0067290 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb80f55e0 0x7f1eb8109bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 --2- 172.21.15.96:0/1692290852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1eb80f5ef0 0x7f1eb810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:39:57.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 >> 172.21.15.96:0/1692290852 conn(0x7f1eb80f0de0 msgr2=0x7f1eb80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:39:57.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 shutdown_connections 2022-02-02T22:39:57.663 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:39:57.648+0000 7f1ebd77a700 1 -- 172.21.15.96:0/1692290852 wait complete. 2022-02-02T22:39:57.664 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:39:58.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:58 smithi159 ceph-mon[69013]: from='client.42020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:58.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:58 smithi159 ceph-mon[69013]: from='client.42024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:58.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/147260163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:39:58.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1692290852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:39:58.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:58 smithi096 ceph-mon[101353]: from='client.42020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:58 smithi096 ceph-mon[101353]: from='client.42024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:39:58.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/147260163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:39:58.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1692290852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:39:59.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:39:59 smithi159 ceph-mon[69013]: pgmap v7735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:39:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:39:59 smithi096 ceph-mon[101353]: pgmap v7735: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:00 smithi096 ceph-mon[101353]: pgmap v7736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:00.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:40:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:00 smithi159 ceph-mon[69013]: pgmap v7736: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:40:02.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:02 smithi159 ceph-mon[69013]: pgmap v7737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:02.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:02 smithi096 ceph-mon[101353]: pgmap v7737: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:04.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:04 smithi159 ceph-mon[69013]: pgmap v7738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:04.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:04 smithi096 ceph-mon[101353]: pgmap v7738: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:06.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:06 smithi159 ceph-mon[69013]: pgmap v7739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:06.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:06 smithi096 ceph-mon[101353]: pgmap v7739: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:08.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:08 smithi159 ceph-mon[69013]: pgmap v7740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:08.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:08 smithi096 ceph-mon[101353]: pgmap v7740: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:10.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:10 smithi159 ceph-mon[69013]: pgmap v7741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:10.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:10 smithi096 ceph-mon[101353]: pgmap v7741: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:12.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:12 smithi159 ceph-mon[69013]: pgmap v7742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:12.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:12 smithi096 ceph-mon[101353]: pgmap v7742: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:14.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:14 smithi159 ceph-mon[69013]: pgmap v7743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:14.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:14 smithi096 ceph-mon[101353]: pgmap v7743: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:16.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:16 smithi159 ceph-mon[69013]: pgmap v7744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:16.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:16 smithi096 ceph-mon[101353]: pgmap v7744: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:18.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:18 smithi159 ceph-mon[69013]: pgmap v7745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:18.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:18 smithi096 ceph-mon[101353]: pgmap v7745: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:20.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:20 smithi096 ceph-mon[101353]: pgmap v7746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:21.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:20 smithi159 ceph-mon[69013]: pgmap v7746: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:22.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:22 smithi096 ceph-mon[101353]: pgmap v7747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:22 smithi159 ceph-mon[69013]: pgmap v7747: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:24.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:24 smithi096 ceph-mon[101353]: pgmap v7748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:24 smithi159 ceph-mon[69013]: pgmap v7748: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:26 smithi096 ceph-mon[101353]: pgmap v7749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:27.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:26 smithi159 ceph-mon[69013]: pgmap v7749: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 -- 172.21.15.96:0/377077678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f55c0 msgr2=0x7f93fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 --2- 172.21.15.96:0/377077678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f59e0 secure :-1 s=READY pgs=3955 cs=0 l=1 rev1=1 rx=0x7f93f0004660 tx=0x7f93f0009b30).stop 2022-02-02T22:40:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 -- 172.21.15.96:0/377077678 shutdown_connections 2022-02-02T22:40:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 --2- 172.21.15.96:0/377077678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 --2- 172.21.15.96:0/377077678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f59e0 unknown :-1 s=CLOSED pgs=3955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.757+0000 7f940302e700 1 -- 172.21.15.96:0/377077678 >> 172.21.15.96:0/377077678 conn(0x7f93fc0f0d40 msgr2=0x7f93fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.758+0000 7f940302e700 1 -- 172.21.15.96:0/377077678 shutdown_connections 2022-02-02T22:40:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.758+0000 7f940302e700 1 -- 172.21.15.96:0/377077678 wait complete. 2022-02-02T22:40:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.758+0000 7f940302e700 1 Processor -- start 2022-02-02T22:40:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.758+0000 7f940302e700 1 -- start start 2022-02-02T22:40:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f940302e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f940302e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f940302e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0f8100 con 0x7f93fc0f6860 2022-02-02T22:40:27.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f940302e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0f8240 con 0x7f93fc0f55c0 2022-02-02T22:40:27.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:27.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49762/0 (socket says 172.21.15.96:49762) 2022-02-02T22:40:27.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 -- 172.21.15.96:0/3912053298 learned_addr learned my addr 172.21.15.96:0/3912053298 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:27.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f9400dca700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:27.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 -- 172.21.15.96:0/3912053298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f55c0 msgr2=0x7f93fc0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:27.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.768 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 -- 172.21.15.96:0/3912053298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0005040 con 0x7f93fc0f6860 2022-02-02T22:40:27.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93fbfff700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 secure :-1 s=READY pgs=3956 cs=0 l=1 rev1=1 rx=0x7f93e800c510 tx=0x7f93e8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:27.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e800f650 con 0x7f93fc0f6860 2022-02-02T22:40:27.769 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93e800fc60 con 0x7f93fc0f6860 2022-02-02T22:40:27.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e8012c50 con 0x7f93fc0f6860 2022-02-02T22:40:27.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.759+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc0f8520 con 0x7f93fc0f6860 2022-02-02T22:40:27.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.760+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc10eff0 con 0x7f93fc0f6860 2022-02-02T22:40:27.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.761+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc045ad0 con 0x7f93fc0f6860 2022-02-02T22:40:27.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.761+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93e8010070 con 0x7f93fc0f6860 2022-02-02T22:40:27.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.761+0000 7f93f97fa700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 0x7f93ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:27.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.762+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93e8081750 con 0x7f93fc0f6860 2022-02-02T22:40:27.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.762+0000 7f9400dca700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 0x7f93ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:27.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.762+0000 7f9400dca700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 0x7f93ec067290 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 rx=0x7f93f0013690 tx=0x7f93f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:27.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.766+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93e804f850 con 0x7f93fc0f6860 2022-02-02T22:40:27.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.947+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93fc0faca0 con 0x7f93ec064dd0 2022-02-02T22:40:27.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.948+0000 7f93f97fa700 1 -- 172.21.15.96:0/3912053298 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f93fc0faca0 con 0x7f93ec064dd0 2022-02-02T22:40:27.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 msgr2=0x7f93ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:27.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 0x7f93ec067290 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 rx=0x7f93f0013690 tx=0x7f93f0009b30).stop 2022-02-02T22:40:27.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 msgr2=0x7f93fc0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:27.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 secure :-1 s=READY pgs=3956 cs=0 l=1 rev1=1 rx=0x7f93e800c510 tx=0x7f93e8007e00).stop 2022-02-02T22:40:27.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 shutdown_connections 2022-02-02T22:40:27.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93ec064dd0 0x7f93ec067290 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc0f55c0 0x7f93fc0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 --2- 172.21.15.96:0/3912053298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93fc0f6860 0x7f93fc0f7ba0 unknown :-1 s=CLOSED pgs=3956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:27.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 >> 172.21.15.96:0/3912053298 conn(0x7f93fc0f0d40 msgr2=0x7f93fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:27.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 shutdown_connections 2022-02-02T22:40:27.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:27.950+0000 7f940302e700 1 -- 172.21.15.96:0/3912053298 wait complete. 2022-02-02T22:40:27.961 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:40:28.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 -- 172.21.15.96:0/1655841936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 msgr2=0x7f6d280f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.050 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 --2- 172.21.15.96:0/1655841936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d280f6b30 secure :-1 s=READY pgs=3957 cs=0 l=1 rev1=1 rx=0x7f6d1c004660 tx=0x7f6d1c009b30).stop 2022-02-02T22:40:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 -- 172.21.15.96:0/1655841936 shutdown_connections 2022-02-02T22:40:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 --2- 172.21.15.96:0/1655841936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d280f6b30 unknown :-1 s=CLOSED pgs=3957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.051 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 --2- 172.21.15.96:0/1655841936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 0x7f6d280f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 -- 172.21.15.96:0/1655841936 >> 172.21.15.96:0/1655841936 conn(0x7f6d280f0b90 msgr2=0x7f6d280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 -- 172.21.15.96:0/1655841936 shutdown_connections 2022-02-02T22:40:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.047+0000 7f6d27fff700 1 -- 172.21.15.96:0/1655841936 wait complete. 2022-02-02T22:40:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 Processor -- start 2022-02-02T22:40:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 -- start start 2022-02-02T22:40:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 0x7f6d28105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28106760 con 0x7f6d280f66d0 2022-02-02T22:40:28.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d27fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28106f60 con 0x7f6d280f5430 2022-02-02T22:40:28.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.048+0000 7f6d267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49772/0 (socket says 172.21.15.96:49772) 2022-02-02T22:40:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 -- 172.21.15.96:0/2670758941 learned_addr learned my addr 172.21.15.96:0/2670758941 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d26ffd700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 0x7f6d28105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 -- 172.21.15.96:0/2670758941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 msgr2=0x7f6d28105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 0x7f6d28105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 -- 172.21.15.96:0/2670758941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c005040 con 0x7f6d280f66d0 2022-02-02T22:40:28.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d267fc700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 secure :-1 s=READY pgs=3958 cs=0 l=1 rev1=1 rx=0x7f6d1c009990 tx=0x7f6d1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c018070 con 0x7f6d280f66d0 2022-02-02T22:40:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d281071e0 con 0x7f6d280f66d0 2022-02-02T22:40:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d1c007ba0 con 0x7f6d280f66d0 2022-02-02T22:40:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c01c3c0 con 0x7f6d280f66d0 2022-02-02T22:40:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.049+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d28107740 con 0x7f6d280f66d0 2022-02-02T22:40:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.050+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08004fa0 con 0x7f6d280f66d0 2022-02-02T22:40:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.051+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d1c01d420 con 0x7f6d280f66d0 2022-02-02T22:40:28.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.051+0000 7f6d0f7fe700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 0x7f6d100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.052+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6d1c083610 con 0x7f6d280f66d0 2022-02-02T22:40:28.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.052+0000 7f6d26ffd700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 0x7f6d100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.052+0000 7f6d26ffd700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 0x7f6d100672e0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f6d280f6530 tx=0x7f6d1800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.056+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d1c055140 con 0x7f6d280f66d0 2022-02-02T22:40:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.228+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d08000bc0 con 0x7f6d10064e20 2022-02-02T22:40:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.237+0000 7f6d0f7fe700 1 -- 172.21.15.96:0/2670758941 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6d08000bc0 con 0x7f6d10064e20 2022-02-02T22:40:28.239 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:40:28.239 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:40:28.240 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:40:28.240 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:40:28.241 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:40:28.241 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:40:28.241 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:40:28.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:40:28.242 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:40:28.243 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:40:28.243 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:40:28.243 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:40:28.244 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:40:28.244 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:40:28.244 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:40:28.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:40:28.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:40:28.245 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:40:28.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:40:28.246 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:40:28.247 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:40:28.247 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:40:28.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 msgr2=0x7f6d100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 0x7f6d100672e0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f6d280f6530 tx=0x7f6d1800b040).stop 2022-02-02T22:40:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 msgr2=0x7f6d281061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 secure :-1 s=READY pgs=3958 cs=0 l=1 rev1=1 rx=0x7f6d1c009990 tx=0x7f6d1c009b30).stop 2022-02-02T22:40:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 shutdown_connections 2022-02-02T22:40:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d10064e20 0x7f6d100672e0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d280f5430 0x7f6d28105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 --2- 172.21.15.96:0/2670758941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d280f66d0 0x7f6d281061b0 unknown :-1 s=CLOSED pgs=3958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.239+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 >> 172.21.15.96:0/2670758941 conn(0x7f6d280f0b90 msgr2=0x7f6d280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.240+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 shutdown_connections 2022-02-02T22:40:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.240+0000 7f6d27fff700 1 -- 172.21.15.96:0/2670758941 wait complete. 2022-02-02T22:40:28.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- 172.21.15.96:0/252527977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f5400 msgr2=0x7fa51c0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.340 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 --2- 172.21.15.96:0/252527977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f5400 0x7fa51c0fbd10 secure :-1 s=READY pgs=3959 cs=0 l=1 rev1=1 rx=0x7fa518004660 tx=0x7fa518009b30).stop 2022-02-02T22:40:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- 172.21.15.96:0/252527977 shutdown_connections 2022-02-02T22:40:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 --2- 172.21.15.96:0/252527977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f5400 0x7fa51c0fbd10 unknown :-1 s=CLOSED pgs=3959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.341 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 --2- 172.21.15.96:0/252527977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- 172.21.15.96:0/252527977 >> 172.21.15.96:0/252527977 conn(0x7fa51c0f04c0 msgr2=0x7fa51c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- 172.21.15.96:0/252527977 shutdown_connections 2022-02-02T22:40:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- 172.21.15.96:0/252527977 wait complete. 2022-02-02T22:40:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 Processor -- start 2022-02-02T22:40:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.337+0000 7fa523d56700 1 -- start start 2022-02-02T22:40:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f5400 0x7fa51c0f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0f6030 con 0x7fa51c0f4a60 2022-02-02T22:40:28.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0f6170 con 0x7fa51c0f5400 2022-02-02T22:40:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49780/0 (socket says 172.21.15.96:49780) 2022-02-02T22:40:28.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 -- 172.21.15.96:0/4108424623 learned_addr learned my addr 172.21.15.96:0/4108424623 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa5212f1700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f5400 0x7fa51c0f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 -- 172.21.15.96:0/4108424623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f5400 msgr2=0x7fa51c0f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f5400 0x7fa51c0f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 -- 172.21.15.96:0/4108424623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518005040 con 0x7fa51c0f4a60 2022-02-02T22:40:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa521af2700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 secure :-1 s=READY pgs=3960 cs=0 l=1 rev1=1 rx=0x7fa50c0026d0 tx=0x7fa50c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c009320 con 0x7fa51c0f4a60 2022-02-02T22:40:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa50c00f040 con 0x7fa51c0f4a60 2022-02-02T22:40:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0f6450 con 0x7fa51c0f4a60 2022-02-02T22:40:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c0147e0 con 0x7fa51c0f4a60 2022-02-02T22:40:28.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.338+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c10f020 con 0x7fa51c0f4a60 2022-02-02T22:40:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.339+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c045ad0 con 0x7fa51c0f4a60 2022-02-02T22:40:28.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.340+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa50c009480 con 0x7fa51c0f4a60 2022-02-02T22:40:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.340+0000 7fa5127fc700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 0x7fa508067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.340+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa50c082120 con 0x7fa51c0f4a60 2022-02-02T22:40:28.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.340+0000 7fa5212f1700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 0x7fa508067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.341+0000 7fa5212f1700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 0x7fa508067290 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 rx=0x7fa518004630 tx=0x7fa518009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.344+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa50c050220 con 0x7fa51c0f4a60 2022-02-02T22:40:28.580 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.579+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa51c0fefc0 con 0x7fa51c0f4a60 2022-02-02T22:40:28.581 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.580+0000 7fa5127fc700 1 -- 172.21.15.96:0/4108424623 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa50c053840 con 0x7fa51c0f4a60 2022-02-02T22:40:28.582 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:40:28.582 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:40:28.582 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:40:28.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:28.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:40:28.583 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:40:28.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:28.584 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:40:28.584 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:40:28.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:28.585 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:40:28.586 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:40:28.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:28.586 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:40:28.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:40:28.587 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:40:28.587 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:40:28.588 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:40:28.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.581+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 msgr2=0x7fa508067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.581+0000 7fa523d56700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 0x7fa508067290 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 rx=0x7fa518004630 tx=0x7fa518009b30).stop 2022-02-02T22:40:28.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.581+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 msgr2=0x7fa51c0f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.581+0000 7fa523d56700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 secure :-1 s=READY pgs=3960 cs=0 l=1 rev1=1 rx=0x7fa50c0026d0 tx=0x7fa50c009de0).stop 2022-02-02T22:40:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 shutdown_connections 2022-02-02T22:40:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa508064dd0 0x7fa508067290 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0f4a60 0x7fa51c0f7650 unknown :-1 s=CLOSED pgs=3960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 --2- 172.21.15.96:0/4108424623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa51c0f5400 0x7fa51c0f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 >> 172.21.15.96:0/4108424623 conn(0x7fa51c0f04c0 msgr2=0x7fa51c0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 shutdown_connections 2022-02-02T22:40:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.582+0000 7fa523d56700 1 -- 172.21.15.96:0/4108424623 wait complete. 2022-02-02T22:40:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- 172.21.15.96:0/3369554206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f7980 msgr2=0x7f8a740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/3369554206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f7980 0x7f8a740f7de0 secure :-1 s=READY pgs=3961 cs=0 l=1 rev1=1 rx=0x7f8a70004660 tx=0x7f8a70009b30).stop 2022-02-02T22:40:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- 172.21.15.96:0/3369554206 shutdown_connections 2022-02-02T22:40:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/3369554206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f7980 0x7f8a740f7de0 unknown :-1 s=CLOSED pgs=3961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/3369554206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f66e0 0x7f8a740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- 172.21.15.96:0/3369554206 >> 172.21.15.96:0/3369554206 conn(0x7f8a740f1e40 msgr2=0x7f8a740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- 172.21.15.96:0/3369554206 shutdown_connections 2022-02-02T22:40:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- 172.21.15.96:0/3369554206 wait complete. 2022-02-02T22:40:28.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:28 smithi096 ceph-mon[101353]: pgmap v7750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:28.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:40:28.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:40:28.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:28 smithi096 ceph-mon[101353]: from='client.42036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:40:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 Processor -- start 2022-02-02T22:40:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.679+0000 7f8a7c12d700 1 -- start start 2022-02-02T22:40:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a7c12d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a7c12d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f7980 0x7f8a74107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a7c12d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74107a00 con 0x7f8a740f66e0 2022-02-02T22:40:28.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a7c12d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74107b40 con 0x7f8a740f7980 2022-02-02T22:40:28.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49788/0 (socket says 172.21.15.96:49788) 2022-02-02T22:40:28.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 -- 172.21.15.96:0/2553405539 learned_addr learned my addr 172.21.15.96:0/2553405539 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:28.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a796c8700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f7980 0x7f8a74107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 -- 172.21.15.96:0/2553405539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f7980 msgr2=0x7f8a74107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f7980 0x7f8a74107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 -- 172.21.15.96:0/2553405539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70005040 con 0x7f8a740f66e0 2022-02-02T22:40:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a79ec9700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 secure :-1 s=READY pgs=3962 cs=0 l=1 rev1=1 rx=0x7f8a64002700 tx=0x7f8a64009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a640079c0 con 0x7f8a740f66e0 2022-02-02T22:40:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.680+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a741084e0 con 0x7f8a740f66e0 2022-02-02T22:40:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.681+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a6400f040 con 0x7f8a740f66e0 2022-02-02T22:40:28.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.681+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a64014860 con 0x7f8a740f66e0 2022-02-02T22:40:28.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.681+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a74108aa0 con 0x7f8a740f66e0 2022-02-02T22:40:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.682+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74045ad0 con 0x7f8a740f66e0 2022-02-02T22:40:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.682+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a6401b060 con 0x7f8a740f66e0 2022-02-02T22:40:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.682+0000 7f8a6a7fc700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 0x7f8a60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:28.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.682+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a640818e0 con 0x7f8a740f66e0 2022-02-02T22:40:28.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.682+0000 7f8a796c8700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 0x7f8a60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:28.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.683+0000 7f8a796c8700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 0x7f8a60067290 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f8a70004630 tx=0x7f8a70009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:28.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.687+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a64053410 con 0x7f8a740f66e0 2022-02-02T22:40:28.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.889+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8a740ff020 con 0x7f8a740f66e0 2022-02-02T22:40:28.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.889+0000 7f8a6a7fc700 1 -- 172.21.15.96:0/2553405539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8a64019070 con 0x7f8a740f66e0 2022-02-02T22:40:28.891 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:40:28.892 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:40:28.892 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:40:28.893 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:40:28.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:40:28.893 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:40:28.894 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:40:28.894 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:40:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:40:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:40:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:40:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:40:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:40:28.896 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:40:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:40:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:40:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:40:28.898 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:40:28.898 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:40:28.898 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:40:28.899 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:40:28.899 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:40:28.899 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:40:28.900 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:40:28.900 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:40:28.901 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:40:28.901 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:40:28.901 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:40:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:40:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:40:28.902 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:40:28.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:40:28.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:40:28.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:40:28.904 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:40:28.904 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:40:28.904 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:40:28.905 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:40:28.905 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:40:28.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 msgr2=0x7f8a60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 0x7f8a60067290 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f8a70004630 tx=0x7f8a70009b30).stop 2022-02-02T22:40:28.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 msgr2=0x7f8a74106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 secure :-1 s=READY pgs=3962 cs=0 l=1 rev1=1 rx=0x7f8a64002700 tx=0x7f8a64009d80).stop 2022-02-02T22:40:28.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 shutdown_connections 2022-02-02T22:40:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8a60064dd0 0x7f8a60067290 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a740f66e0 0x7f8a74106f60 unknown :-1 s=CLOSED pgs=3962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 --2- 172.21.15.96:0/2553405539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a740f7980 0x7f8a74107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:28.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 >> 172.21.15.96:0/2553405539 conn(0x7f8a740f1e40 msgr2=0x7f8a740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:28.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 shutdown_connections 2022-02-02T22:40:28.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:28.891+0000 7f8a7c12d700 1 -- 172.21.15.96:0/2553405539 wait complete. 2022-02-02T22:40:28.911 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:40:29.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:28 smithi159 ceph-mon[69013]: pgmap v7750: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:40:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:40:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:28 smithi159 ceph-mon[69013]: from='client.42036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:40:29.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:29 smithi096 ceph-mon[101353]: from='client.42040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:40:29.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4108424623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:40:29.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2553405539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:40:30.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:29 smithi159 ceph-mon[69013]: from='client.42040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:40:30.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4108424623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:40:30.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2553405539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:40:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:30 smithi096 ceph-mon[101353]: pgmap v7751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:30 smithi159 ceph-mon[69013]: pgmap v7751: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:32 smithi096 ceph-mon[101353]: pgmap v7752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:32 smithi159 ceph-mon[69013]: pgmap v7752: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:34.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:34 smithi096 ceph-mon[101353]: pgmap v7753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:34 smithi159 ceph-mon[69013]: pgmap v7753: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:36.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:36 smithi096 ceph-mon[101353]: pgmap v7754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:37.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:36 smithi159 ceph-mon[69013]: pgmap v7754: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:38 smithi159 ceph-mon[69013]: pgmap v7755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:38 smithi096 ceph-mon[101353]: pgmap v7755: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:40 smithi159 ceph-mon[69013]: pgmap v7756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:40 smithi096 ceph-mon[101353]: pgmap v7756: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:42 smithi159 ceph-mon[69013]: pgmap v7757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:42 smithi096 ceph-mon[101353]: pgmap v7757: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:45.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:44 smithi159 ceph-mon[69013]: pgmap v7758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:44 smithi096 ceph-mon[101353]: pgmap v7758: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:46 smithi159 ceph-mon[69013]: pgmap v7759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:46 smithi096 ceph-mon[101353]: pgmap v7759: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:48 smithi159 ceph-mon[69013]: pgmap v7760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:48 smithi096 ceph-mon[101353]: pgmap v7760: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:50 smithi159 ceph-mon[69013]: pgmap v7761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:50 smithi096 ceph-mon[101353]: pgmap v7761: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:52 smithi159 ceph-mon[69013]: pgmap v7762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:52 smithi096 ceph-mon[101353]: pgmap v7762: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:54 smithi159 ceph-mon[69013]: pgmap v7763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:54 smithi096 ceph-mon[101353]: pgmap v7763: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:56 smithi159 ceph-mon[69013]: pgmap v7764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:56 smithi096 ceph-mon[101353]: pgmap v7764: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:59.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.001+0000 7f5b50da5700 1 -- 172.21.15.96:0/3619035178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 msgr2=0x7f5b4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.001+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3619035178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c0f6cc0 secure :-1 s=READY pgs=3963 cs=0 l=1 rev1=1 rx=0x7f5b34004660 tx=0x7f5b34009b30).stop 2022-02-02T22:40:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 -- 172.21.15.96:0/3619035178 shutdown_connections 2022-02-02T22:40:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3619035178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c0f6cc0 unknown :-1 s=CLOSED pgs=3963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3619035178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 -- 172.21.15.96:0/3619035178 >> 172.21.15.96:0/3619035178 conn(0x7f5b4c0f0d40 msgr2=0x7f5b4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.005 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:40:58 smithi096 ceph-mon[101353]: pgmap v7765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:59.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 -- 172.21.15.96:0/3619035178 shutdown_connections 2022-02-02T22:40:59.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 -- 172.21.15.96:0/3619035178 wait complete. 2022-02-02T22:40:59.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 Processor -- start 2022-02-02T22:40:59.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.002+0000 7f5b50da5700 1 -- start start 2022-02-02T22:40:59.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c109c20 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c109d60 con 0x7f5b4c0f6860 2022-02-02T22:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49808/0 (socket says 172.21.15.96:49808) 2022-02-02T22:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 -- 172.21.15.96:0/3046446452 learned_addr learned my addr 172.21.15.96:0/3046446452 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b49d9b700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 -- 172.21.15.96:0/3046446452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 msgr2=0x7f5b4c109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 -- 172.21.15.96:0/3046446452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34005040 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b49d9b700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:40:59.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b4a59c700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 secure :-1 s=READY pgs=3964 cs=0 l=1 rev1=1 rx=0x7f5b3c00c790 tx=0x7f5b3c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c00e680 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b3c00ec90 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c10a700 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c012d00 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.003+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c10acc0 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.004+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c045ad0 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.005+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b3c010070 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.005+0000 7f5b42ffd700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 0x7f5b38067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.006+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5b3c081a50 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.006+0000 7f5b49d9b700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 0x7f5b38067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.006+0000 7f5b49d9b700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 0x7f5b38067290 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7f5b34004e30 tx=0x7f5b34009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.010+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b3c053520 con 0x7f5b4c0f55c0 2022-02-02T22:40:59.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:40:58 smithi159 ceph-mon[69013]: pgmap v7765: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:40:59.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.188+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b4c0faaa0 con 0x7f5b38064dd0 2022-02-02T22:40:59.190 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.189+0000 7f5b42ffd700 1 -- 172.21.15.96:0/3046446452 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5b4c0faaa0 con 0x7f5b38064dd0 2022-02-02T22:40:59.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 msgr2=0x7f5b38067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 0x7f5b38067290 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7f5b34004e30 tx=0x7f5b34009b30).stop 2022-02-02T22:40:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 msgr2=0x7f5b4c109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 secure :-1 s=READY pgs=3964 cs=0 l=1 rev1=1 rx=0x7f5b3c00c790 tx=0x7f5b3c007d90).stop 2022-02-02T22:40:59.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 shutdown_connections 2022-02-02T22:40:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5b38064dd0 0x7f5b38067290 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b4c0f55c0 0x7f5b4c109180 unknown :-1 s=CLOSED pgs=3964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 --2- 172.21.15.96:0/3046446452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c0f6860 0x7f5b4c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 >> 172.21.15.96:0/3046446452 conn(0x7f5b4c0f0d40 msgr2=0x7f5b4c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 shutdown_connections 2022-02-02T22:40:59.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.191+0000 7f5b50da5700 1 -- 172.21.15.96:0/3046446452 wait complete. 2022-02-02T22:40:59.202 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:40:59.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.288+0000 7f30b2b86700 1 -- 172.21.15.96:0/2666041940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 msgr2=0x7f30ac0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.288+0000 7f30b2b86700 1 --2- 172.21.15.96:0/2666041940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac0f7000 secure :-1 s=READY pgs=3965 cs=0 l=1 rev1=1 rx=0x7f30a0004660 tx=0x7f30a0009b30).stop 2022-02-02T22:40:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 -- 172.21.15.96:0/2666041940 shutdown_connections 2022-02-02T22:40:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 --2- 172.21.15.96:0/2666041940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 0x7f30ac0f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:40:59.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 --2- 172.21.15.96:0/2666041940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac0f7000 unknown :-1 s=CLOSED pgs=3965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 -- 172.21.15.96:0/2666041940 >> 172.21.15.96:0/2666041940 conn(0x7f30ac0f04c0 msgr2=0x7f30ac0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 -- 172.21.15.96:0/2666041940 shutdown_connections 2022-02-02T22:40:59.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 -- 172.21.15.96:0/2666041940 wait complete. 2022-02-02T22:40:59.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 Processor -- start 2022-02-02T22:40:59.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.289+0000 7f30b2b86700 1 -- start start 2022-02-02T22:40:59.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30b2b86700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 0x7f30ac109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30b2b86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30b2b86700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0f5670 con 0x7f30ac0f6be0 2022-02-02T22:40:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30b2b86700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0f57b0 con 0x7f30ac0f5930 2022-02-02T22:40:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49820/0 (socket says 172.21.15.96:49820) 2022-02-02T22:40:59.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 -- 172.21.15.96:0/1008049327 learned_addr learned my addr 172.21.15.96:0/1008049327 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:59.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30b0922700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 0x7f30ac109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 -- 172.21.15.96:0/1008049327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 msgr2=0x7f30ac109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 0x7f30ac109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 -- 172.21.15.96:0/1008049327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0005040 con 0x7f30ac0f6be0 2022-02-02T22:40:59.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30abfff700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 secure :-1 s=READY pgs=3966 cs=0 l=1 rev1=1 rx=0x7f30980093f0 tx=0x7f3098006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.290+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3098013640 con 0x7f30ac0f6be0 2022-02-02T22:40:59.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.291+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3098013c50 con 0x7f30ac0f6be0 2022-02-02T22:40:59.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.291+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac10c800 con 0x7f30ac0f6be0 2022-02-02T22:40:59.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.291+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3098012c70 con 0x7f30ac0f6be0 2022-02-02T22:40:59.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.291+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac10cd90 con 0x7f30ac0f6be0 2022-02-02T22:40:59.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.292+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac045ad0 con 0x7f30ac0f6be0 2022-02-02T22:40:59.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.292+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f309801a060 con 0x7f30ac0f6be0 2022-02-02T22:40:59.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.292+0000 7f30a97fa700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 0x7f309c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.293+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3098081af0 con 0x7f30ac0f6be0 2022-02-02T22:40:59.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.293+0000 7f30b0922700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 0x7f309c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.293+0000 7f30b0922700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 0x7f309c067290 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 rx=0x7f30a0013690 tx=0x7f30a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.297+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f309804fad0 con 0x7f30ac0f6be0 2022-02-02T22:40:59.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.473+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30ac057f10 con 0x7f309c064dd0 2022-02-02T22:40:59.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.483+0000 7f30a97fa700 1 -- 172.21.15.96:0/1008049327 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f30ac057f10 con 0x7f309c064dd0 2022-02-02T22:40:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:40:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:40:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:40:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:40:59.486 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:40:59.486 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:40:59.486 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:40:59.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:40:59.487 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:40:59.487 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:40:59.488 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:40:59.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:40:59.488 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:40:59.489 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:40:59.489 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:40:59.489 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:40:59.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:40:59.490 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:40:59.491 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:40:59.491 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:40:59.492 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:40:59.492 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:40:59.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.484+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 msgr2=0x7f309c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.484+0000 7f30b2b86700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 0x7f309c067290 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 rx=0x7f30a0013690 tx=0x7f30a0009b30).stop 2022-02-02T22:40:59.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.484+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 msgr2=0x7f30ac10c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.484+0000 7f30b2b86700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 secure :-1 s=READY pgs=3966 cs=0 l=1 rev1=1 rx=0x7f30980093f0 tx=0x7f3098006ec0).stop 2022-02-02T22:40:59.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 shutdown_connections 2022-02-02T22:40:59.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f309c064dd0 0x7f309c067290 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30ac0f5930 0x7f30ac109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 --2- 172.21.15.96:0/1008049327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30ac0f6be0 0x7f30ac10c1a0 unknown :-1 s=CLOSED pgs=3966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 >> 172.21.15.96:0/1008049327 conn(0x7f30ac0f04c0 msgr2=0x7f30ac0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 shutdown_connections 2022-02-02T22:40:59.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.485+0000 7f30b2b86700 1 -- 172.21.15.96:0/1008049327 wait complete. 2022-02-02T22:40:59.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 -- 172.21.15.96:0/27348936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 msgr2=0x7f0dd00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/27348936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd00f6b00 secure :-1 s=READY pgs=3967 cs=0 l=1 rev1=1 rx=0x7f0dc4004660 tx=0x7f0dc4009b30).stop 2022-02-02T22:40:59.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 -- 172.21.15.96:0/27348936 shutdown_connections 2022-02-02T22:40:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/27348936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 0x7f0dd00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:40:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/27348936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd00f6b00 unknown :-1 s=CLOSED pgs=3967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 -- 172.21.15.96:0/27348936 >> 172.21.15.96:0/27348936 conn(0x7f0dd00f1e40 msgr2=0x7f0dd00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 -- 172.21.15.96:0/27348936 shutdown_connections 2022-02-02T22:40:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.581+0000 7f0dd4c59700 1 -- 172.21.15.96:0/27348936 wait complete. 2022-02-02T22:40:59.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 Processor -- start 2022-02-02T22:40:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 -- start start 2022-02-02T22:40:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 0x7f0dd01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0107ae0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dd4c59700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0108390 con 0x7f0dd00f7980 2022-02-02T22:40:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49828/0 (socket says 172.21.15.96:49828) 2022-02-02T22:40:59.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 -- 172.21.15.96:0/609836147 learned_addr learned my addr 172.21.15.96:0/609836147 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dcdd9b700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 0x7f0dd01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 -- 172.21.15.96:0/609836147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 msgr2=0x7f0dd01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 0x7f0dd01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 -- 172.21.15.96:0/609836147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc4005040 con 0x7f0dd00f66e0 2022-02-02T22:40:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.582+0000 7f0dce59c700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 secure :-1 s=READY pgs=3968 cs=0 l=1 rev1=1 rx=0x7f0dc4004f60 tx=0x7f0dc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.583+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc4018070 con 0x7f0dd00f66e0 2022-02-02T22:40:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.583+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0dc4007ba0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.583+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd0108610 con 0x7f0dd00f66e0 2022-02-02T22:40:59.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.583+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc401c620 con 0x7f0dd00f66e0 2022-02-02T22:40:59.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.583+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd0108b70 con 0x7f0dd00f66e0 2022-02-02T22:40:59.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.584+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00f5ad0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.584+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0dc401d420 con 0x7f0dd00f66e0 2022-02-02T22:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.585+0000 7f0dbeffd700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 0x7f0db8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.585+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0dc4083d40 con 0x7f0dd00f66e0 2022-02-02T22:40:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.585+0000 7f0dcdd9b700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 0x7f0db8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.585+0000 7f0dcdd9b700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 0x7f0db8067290 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 rx=0x7f0dc000b790 tx=0x7f0dc0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.588+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0dc40558f0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.819+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0dd0045ad0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.819+0000 7f0dbeffd700 1 -- 172.21.15.96:0/609836147 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0dc40554e0 con 0x7f0dd00f66e0 2022-02-02T22:40:59.821 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:40:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:40:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:40:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:40:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:40:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:40:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:40:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:40:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:40:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:40:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:40:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:40:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:40:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:40:59.827 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:40:59.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 msgr2=0x7f0db8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 0x7f0db8067290 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 rx=0x7f0dc000b790 tx=0x7f0dc0008040).stop 2022-02-02T22:40:59.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 msgr2=0x7f0dd0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 secure :-1 s=READY pgs=3968 cs=0 l=1 rev1=1 rx=0x7f0dc4004f60 tx=0x7f0dc4009b30).stop 2022-02-02T22:40:59.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 shutdown_connections 2022-02-02T22:40:59.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0db8064dd0 0x7f0db8067290 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd00f66e0 0x7f0dd0106fb0 unknown :-1 s=CLOSED pgs=3968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 --2- 172.21.15.96:0/609836147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dd00f7980 0x7f0dd01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 >> 172.21.15.96:0/609836147 conn(0x7f0dd00f1e40 msgr2=0x7f0dd00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 shutdown_connections 2022-02-02T22:40:59.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.821+0000 7f0dd4c59700 1 -- 172.21.15.96:0/609836147 wait complete. 2022-02-02T22:40:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 -- 172.21.15.96:0/1430745719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f5ed0 msgr2=0x7f66f40f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 --2- 172.21.15.96:0/1430745719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f5ed0 0x7f66f40f6900 secure :-1 s=READY pgs=3969 cs=0 l=1 rev1=1 rx=0x7f66e4004660 tx=0x7f66e4009b30).stop 2022-02-02T22:40:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 -- 172.21.15.96:0/1430745719 shutdown_connections 2022-02-02T22:40:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 --2- 172.21.15.96:0/1430745719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f5ed0 0x7f66f40f6900 unknown :-1 s=CLOSED pgs=3969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 --2- 172.21.15.96:0/1430745719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f55c0 0x7f66f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:40:59.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 -- 172.21.15.96:0/1430745719 >> 172.21.15.96:0/1430745719 conn(0x7f66f40f0dc0 msgr2=0x7f66f40f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:40:59.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 -- 172.21.15.96:0/1430745719 shutdown_connections 2022-02-02T22:40:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.919+0000 7f66f984c700 1 -- 172.21.15.96:0/1430745719 wait complete. 2022-02-02T22:40:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 Processor -- start 2022-02-02T22:40:59.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 -- start start 2022-02-02T22:40:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 0x7f66f410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40605f0 con 0x7f66f40f55c0 2022-02-02T22:40:59.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f984c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4060730 con 0x7f66f40f5ed0 2022-02-02T22:40:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49838/0 (socket says 172.21.15.96:49838) 2022-02-02T22:40:59.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.920+0000 7f66f2ffd700 1 -- 172.21.15.96:0/3114984187 learned_addr learned my addr 172.21.15.96:0/3114984187 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:40:59.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f27fc700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 0x7f66f410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f2ffd700 1 -- 172.21.15.96:0/3114984187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 msgr2=0x7f66f410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:40:59.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f2ffd700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 0x7f66f410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:40:59.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f2ffd700 1 -- 172.21.15.96:0/3114984187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4005040 con 0x7f66f40f55c0 2022-02-02T22:40:59.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f27fc700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 0x7f66f410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:40:59.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f2ffd700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 secure :-1 s=READY pgs=3970 cs=0 l=1 rev1=1 rx=0x7f66dc00b410 tx=0x7f66dc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66dc0125f0 con 0x7f66f40f55c0 2022-02-02T22:40:59.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f66dc012c00 con 0x7f66f40f55c0 2022-02-02T22:40:59.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f410c7d0 con 0x7f66f40f55c0 2022-02-02T22:40:59.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f410cd60 con 0x7f66f40f55c0 2022-02-02T22:40:59.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.921+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66dc002ae0 con 0x7f66f40f55c0 2022-02-02T22:40:59.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.922+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8004fa0 con 0x7f66f40f55c0 2022-02-02T22:40:59.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.923+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f66dc00f030 con 0x7f66f40f55c0 2022-02-02T22:40:59.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.923+0000 7f66eb7fe700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 0x7f66e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:40:59.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.923+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f66dc082000 con 0x7f66f40f55c0 2022-02-02T22:40:59.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.923+0000 7f66f27fc700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 0x7f66e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:40:59.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.924+0000 7f66f27fc700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 0x7f66e0067290 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 rx=0x7f66e4004e30 tx=0x7f66e4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:40:59.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:40:59.928+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f66dc0b07d0 con 0x7f66f40f55c0 2022-02-02T22:41:00.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.129+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f66d8005e80 con 0x7f66f40f55c0 2022-02-02T22:41:00.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.129+0000 7f66eb7fe700 1 -- 172.21.15.96:0/3114984187 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f66dc050040 con 0x7f66f40f55c0 2022-02-02T22:41:00.131 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:41:00.131 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:41:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:41:00.132 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:41:00.132 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:00.133 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:41:00.133 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:41:00.133 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:41:00.134 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:41:00.134 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:41:00.135 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:41:00.135 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:41:00.135 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:41:00.136 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:41:00.136 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:41:00.136 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:41:00.137 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:41:00.137 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:41:00.137 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:41:00.138 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:41:00.138 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:41:00.138 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:41:00.139 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:41:00.139 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:41:00.139 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:41:00.140 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:41:00.140 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:41:00.140 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:41:00.141 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:41:00.141 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:41:00.142 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:41:00.142 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:41:00.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:00.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:00.144 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:41:00.144 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:00.144 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:00.145 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:00.145 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:00.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 msgr2=0x7f66e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:00.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 0x7f66e0067290 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 rx=0x7f66e4004e30 tx=0x7f66e4009b30).stop 2022-02-02T22:41:00.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 msgr2=0x7f66f4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:00.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 secure :-1 s=READY pgs=3970 cs=0 l=1 rev1=1 rx=0x7f66dc00b410 tx=0x7f66dc006ef0).stop 2022-02-02T22:41:00.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 shutdown_connections 2022-02-02T22:41:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f66e0064dd0 0x7f66e0067290 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66f40f55c0 0x7f66f4109c70 unknown :-1 s=CLOSED pgs=3970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 --2- 172.21.15.96:0/3114984187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f40f5ed0 0x7f66f410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:00.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 >> 172.21.15.96:0/3114984187 conn(0x7f66f40f0dc0 msgr2=0x7f66f40fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:00.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 shutdown_connections 2022-02-02T22:41:00.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:00.132+0000 7f66f984c700 1 -- 172.21.15.96:0/3114984187 wait complete. 2022-02-02T22:41:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:41:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:00 smithi159 ceph-mon[69013]: from='client.42052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:00 smithi159 ceph-mon[69013]: pgmap v7766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:00 smithi159 ceph-mon[69013]: from='client.42056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/609836147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:41:01.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3114984187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:41:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:00 smithi096 ceph-mon[101353]: from='client.42052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:00 smithi096 ceph-mon[101353]: pgmap v7766: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:00 smithi096 ceph-mon[101353]: from='client.42056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/609836147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:41:01.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3114984187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:41:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:02 smithi159 ceph-mon[69013]: pgmap v7767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:02 smithi096 ceph-mon[101353]: pgmap v7767: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:04 smithi159 ceph-mon[69013]: pgmap v7768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:04 smithi096 ceph-mon[101353]: pgmap v7768: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:06 smithi159 ceph-mon[69013]: pgmap v7769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:06 smithi096 ceph-mon[101353]: pgmap v7769: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:08 smithi159 ceph-mon[69013]: pgmap v7770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:08 smithi096 ceph-mon[101353]: pgmap v7770: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:10 smithi159 ceph-mon[69013]: pgmap v7771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:10 smithi096 ceph-mon[101353]: pgmap v7771: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:12 smithi159 ceph-mon[69013]: pgmap v7772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:12 smithi096 ceph-mon[101353]: pgmap v7772: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:14 smithi159 ceph-mon[69013]: pgmap v7773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:14 smithi096 ceph-mon[101353]: pgmap v7773: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:16 smithi159 ceph-mon[69013]: pgmap v7774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:16 smithi096 ceph-mon[101353]: pgmap v7774: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:18 smithi159 ceph-mon[69013]: pgmap v7775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:18 smithi096 ceph-mon[101353]: pgmap v7775: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:20 smithi159 ceph-mon[69013]: pgmap v7776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:20 smithi096 ceph-mon[101353]: pgmap v7776: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:23.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:22 smithi159 ceph-mon[69013]: pgmap v7777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:22 smithi096 ceph-mon[101353]: pgmap v7777: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:24 smithi159 ceph-mon[69013]: pgmap v7778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:24 smithi096 ceph-mon[101353]: pgmap v7778: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:26 smithi159 ceph-mon[69013]: pgmap v7779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:26 smithi096 ceph-mon[101353]: pgmap v7779: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:28 smithi159 ceph-mon[69013]: pgmap v7780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:41:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:41:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:28 smithi096 ceph-mon[101353]: pgmap v7780: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:41:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:41:30.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- 172.21.15.96:0/1700360186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 msgr2=0x7f23b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 --2- 172.21.15.96:0/1700360186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b00f6950 secure :-1 s=READY pgs=3971 cs=0 l=1 rev1=1 rx=0x7f23a0004660 tx=0x7f23a0009b30).stop 2022-02-02T22:41:30.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- 172.21.15.96:0/1700360186 shutdown_connections 2022-02-02T22:41:30.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 --2- 172.21.15.96:0/1700360186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 0x7f23b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 --2- 172.21.15.96:0/1700360186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b00f6950 unknown :-1 s=CLOSED pgs=3971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- 172.21.15.96:0/1700360186 >> 172.21.15.96:0/1700360186 conn(0x7f23b00f1c90 msgr2=0x7f23b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:30.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- 172.21.15.96:0/1700360186 shutdown_connections 2022-02-02T22:41:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- 172.21.15.96:0/1700360186 wait complete. 2022-02-02T22:41:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 Processor -- start 2022-02-02T22:41:30.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.244+0000 7f23b6420700 1 -- start start 2022-02-02T22:41:30.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b6420700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b6420700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 0x7f23b0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b6420700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0107880 con 0x7f23b00f6530 2022-02-02T22:41:30.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b6420700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0108090 con 0x7f23b00f77d0 2022-02-02T22:41:30.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49860/0 (socket says 172.21.15.96:49860) 2022-02-02T22:41:30.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 -- 172.21.15.96:0/2797227393 learned_addr learned my addr 172.21.15.96:0/2797227393 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:41:30.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b4c1d700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 0x7f23b0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 -- 172.21.15.96:0/2797227393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 msgr2=0x7f23b0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 0x7f23b0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 -- 172.21.15.96:0/2797227393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0005040 con 0x7f23b00f6530 2022-02-02T22:41:30.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b541e700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 secure :-1 s=READY pgs=3972 cs=0 l=1 rev1=1 rx=0x7f23a0013a70 tx=0x7f23a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a0018070 con 0x7f23b00f6530 2022-02-02T22:41:30.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23a00097d0 con 0x7f23b00f6530 2022-02-02T22:41:30.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.245+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b01082b0 con 0x7f23b00f6530 2022-02-02T22:41:30.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.246+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a001de80 con 0x7f23b00f6530 2022-02-02T22:41:30.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.246+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0108810 con 0x7f23b00f6530 2022-02-02T22:41:30.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.247+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b0059100 con 0x7f23b00f6530 2022-02-02T22:41:30.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.247+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f23a0007ba0 con 0x7f23b00f6530 2022-02-02T22:41:30.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.247+0000 7f23a5ffb700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 0x7f239c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.248+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f23a0083650 con 0x7f23b00f6530 2022-02-02T22:41:30.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.248+0000 7f23b4c1d700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 0x7f239c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.248+0000 7f23b4c1d700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 0x7f239c0672e0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 rx=0x7f23ac004ce0 tx=0x7f23ac00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.252+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f23a0051810 con 0x7f23b00f6530 2022-02-02T22:41:30.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.431+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23b00fed60 con 0x7f239c064e20 2022-02-02T22:41:30.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.432+0000 7f23a5ffb700 1 -- 172.21.15.96:0/2797227393 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f23b00fed60 con 0x7f239c064e20 2022-02-02T22:41:30.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 msgr2=0x7f239c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 0x7f239c0672e0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 rx=0x7f23ac004ce0 tx=0x7f23ac00b040).stop 2022-02-02T22:41:30.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 msgr2=0x7f23b0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 secure :-1 s=READY pgs=3972 cs=0 l=1 rev1=1 rx=0x7f23a0013a70 tx=0x7f23a0009b30).stop 2022-02-02T22:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 shutdown_connections 2022-02-02T22:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f239c064e20 0x7f239c0672e0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23b00f6530 0x7f23b0106d90 unknown :-1 s=CLOSED pgs=3972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 --2- 172.21.15.96:0/2797227393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23b00f77d0 0x7f23b0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 >> 172.21.15.96:0/2797227393 conn(0x7f23b00f1c90 msgr2=0x7f23b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 shutdown_connections 2022-02-02T22:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.434+0000 7f23b6420700 1 -- 172.21.15.96:0/2797227393 wait complete. 2022-02-02T22:41:30.443 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:41:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/3444140172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f7980 msgr2=0x7fd1d40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/3444140172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f7980 0x7fd1d40f7de0 secure :-1 s=READY pgs=3973 cs=0 l=1 rev1=1 rx=0x7fd1d0004660 tx=0x7fd1d0009b30).stop 2022-02-02T22:41:30.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/3444140172 shutdown_connections 2022-02-02T22:41:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/3444140172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f7980 0x7fd1d40f7de0 unknown :-1 s=CLOSED pgs=3973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/3444140172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f66e0 0x7fd1d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:41:30.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/3444140172 >> 172.21.15.96:0/3444140172 conn(0x7fd1d40f1e40 msgr2=0x7fd1d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:30.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/3444140172 shutdown_connections 2022-02-02T22:41:30.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.531+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/3444140172 wait complete. 2022-02-02T22:41:30.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 Processor -- start 2022-02-02T22:41:30.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 -- start start 2022-02-02T22:41:30.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f7980 0x7fd1d41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4107ae0 con 0x7fd1d40f66e0 2022-02-02T22:41:30.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1dbd7f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4108390 con 0x7fd1d40f7980 2022-02-02T22:41:30.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49870/0 (socket says 172.21.15.96:49870) 2022-02-02T22:41:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 -- 172.21.15.96:0/2358821010 learned_addr learned my addr 172.21.15.96:0/2358821010 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:41:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d931a700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f7980 0x7fd1d41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 -- 172.21.15.96:0/2358821010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f7980 msgr2=0x7fd1d41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f7980 0x7fd1d41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.532+0000 7fd1d9b1b700 1 -- 172.21.15.96:0/2358821010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0005040 con 0x7fd1d40f66e0 2022-02-02T22:41:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1d9b1b700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 secure :-1 s=READY pgs=3974 cs=0 l=1 rev1=1 rx=0x7fd1c40093f0 tx=0x7fd1c4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c4013640 con 0x7fd1d40f66e0 2022-02-02T22:41:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1c4013c50 con 0x7fd1d40f66e0 2022-02-02T22:41:30.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c4012c70 con 0x7fd1d40f66e0 2022-02-02T22:41:30.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d4108670 con 0x7fd1d40f66e0 2022-02-02T22:41:30.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.533+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d4108be0 con 0x7fd1d40f66e0 2022-02-02T22:41:30.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.534+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d40f5ad0 con 0x7fd1d40f66e0 2022-02-02T22:41:30.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.534+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd1c401a060 con 0x7fd1d40f66e0 2022-02-02T22:41:30.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.535+0000 7fd1ca7fc700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 0x7fd1c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.535+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd1c4081a50 con 0x7fd1d40f66e0 2022-02-02T22:41:30.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.535+0000 7fd1d931a700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 0x7fd1c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.535+0000 7fd1d931a700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 0x7fd1c0067290 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7fd1d0004630 tx=0x7fd1d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.539+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1c4053520 con 0x7fd1d40f66e0 2022-02-02T22:41:30.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.715+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1d40fefb0 con 0x7fd1c0064dd0 2022-02-02T22:41:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.724+0000 7fd1ca7fc700 1 -- 172.21.15.96:0/2358821010 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd1d40fefb0 con 0x7fd1c0064dd0 2022-02-02T22:41:30.724 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:41:30.725 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:41:30.725 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:41:30.726 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:41:30.726 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:41:30.726 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:41:30.727 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:41:30.727 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:41:30.727 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:41:30.728 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:41:30.728 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:41:30.728 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:41:30.729 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:41:30.729 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:41:30.729 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:41:30.730 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:41:30.730 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:41:30.730 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:41:30.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:41:30.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:41:30.731 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:41:30.732 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:41:30.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.725+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 msgr2=0x7fd1c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.725+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 0x7fd1c0067290 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7fd1d0004630 tx=0x7fd1d0009b30).stop 2022-02-02T22:41:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.725+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 msgr2=0x7fd1d4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.725+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 secure :-1 s=READY pgs=3974 cs=0 l=1 rev1=1 rx=0x7fd1c40093f0 tx=0x7fd1c4006ec0).stop 2022-02-02T22:41:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 shutdown_connections 2022-02-02T22:41:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd1c0064dd0 0x7fd1c0067290 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d40f66e0 0x7fd1d4106fb0 unknown :-1 s=CLOSED pgs=3974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 --2- 172.21.15.96:0/2358821010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40f7980 0x7fd1d41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 >> 172.21.15.96:0/2358821010 conn(0x7fd1d40f1e40 msgr2=0x7fd1d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 shutdown_connections 2022-02-02T22:41:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.726+0000 7fd1dbd7f700 1 -- 172.21.15.96:0/2358821010 wait complete. 2022-02-02T22:41:30.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:30 smithi096 ceph-mon[101353]: pgmap v7781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:30.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 -- 172.21.15.96:0/3480441615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f66e0 msgr2=0x7fa96c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3480441615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f66e0 0x7fa96c0f6b40 secure :-1 s=READY pgs=3975 cs=0 l=1 rev1=1 rx=0x7fa960004660 tx=0x7fa960009b30).stop 2022-02-02T22:41:30.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 -- 172.21.15.96:0/3480441615 shutdown_connections 2022-02-02T22:41:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3480441615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f66e0 0x7fa96c0f6b40 unknown :-1 s=CLOSED pgs=3975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3480441615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f5440 0x7fa96c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:41:30.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 -- 172.21.15.96:0/3480441615 >> 172.21.15.96:0/3480441615 conn(0x7fa96c0f0ba0 msgr2=0x7fa96c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 -- 172.21.15.96:0/3480441615 shutdown_connections 2022-02-02T22:41:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.822+0000 7fa96b59e700 1 -- 172.21.15.96:0/3480441615 wait complete. 2022-02-02T22:41:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 Processor -- start 2022-02-02T22:41:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 -- start start 2022-02-02T22:41:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f66e0 0x7fa96c106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c106850 con 0x7fa96c0f5440 2022-02-02T22:41:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c106fc0 con 0x7fa96c0f66e0 2022-02-02T22:41:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49880/0 (socket says 172.21.15.96:49880) 2022-02-02T22:41:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa96a59c700 1 -- 172.21.15.96:0/3326445650 learned_addr learned my addr 172.21.15.96:0/3326445650 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:41:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.823+0000 7fa969d9b700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f66e0 0x7fa96c106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96a59c700 1 -- 172.21.15.96:0/3326445650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f66e0 msgr2=0x7fa96c106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:30.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96a59c700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f66e0 0x7fa96c106210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:30.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96a59c700 1 -- 172.21.15.96:0/3326445650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960005040 con 0x7fa96c0f5440 2022-02-02T22:41:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96a59c700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 secure :-1 s=READY pgs=3976 cs=0 l=1 rev1=1 rx=0x7fa95c00b790 tx=0x7fa95c0092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa95c00d700 con 0x7fa96c0f5440 2022-02-02T22:41:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa95c00dd10 con 0x7fa96c0f5440 2022-02-02T22:41:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa95c010e60 con 0x7fa96c0f5440 2022-02-02T22:41:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c1072a0 con 0x7fa96c0f5440 2022-02-02T22:41:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.824+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c107860 con 0x7fa96c0f5440 2022-02-02T22:41:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.825+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c045ad0 con 0x7fa96c0f5440 2022-02-02T22:41:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.825+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa95c010670 con 0x7fa96c0f5440 2022-02-02T22:41:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.826+0000 7fa95affd700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 0x7fa9540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.826+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa95c081d20 con 0x7fa96c0f5440 2022-02-02T22:41:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.826+0000 7fa969d9b700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 0x7fa9540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.826+0000 7fa969d9b700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 0x7fa9540672e0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 rx=0x7fa960004e30 tx=0x7fa960009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:30.830+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa95c053850 con 0x7fa96c0f5440 2022-02-02T22:41:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:30 smithi159 ceph-mon[69013]: pgmap v7781: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.060+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa96c0ff6b0 con 0x7fa96c0f5440 2022-02-02T22:41:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.061+0000 7fa95affd700 1 -- 172.21.15.96:0/3326445650 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fa95c016070 con 0x7fa96c0f5440 2022-02-02T22:41:31.064 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:41:31.065 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:41:31.065 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:41:31.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:41:31.066 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:41:31.066 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:41:31.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:41:31.067 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:41:31.068 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:41:31.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:41:31.068 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:41:31.069 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:41:31.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:41:31.069 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:41:31.070 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:41:31.070 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:41:31.071 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:41:31.071 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:41:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 msgr2=0x7fa9540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 0x7fa9540672e0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 rx=0x7fa960004e30 tx=0x7fa960009b30).stop 2022-02-02T22:41:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 msgr2=0x7fa96c105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 secure :-1 s=READY pgs=3976 cs=0 l=1 rev1=1 rx=0x7fa95c00b790 tx=0x7fa95c0092b0).stop 2022-02-02T22:41:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 shutdown_connections 2022-02-02T22:41:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa954064e20 0x7fa9540672e0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa96c0f5440 0x7fa96c105d20 unknown :-1 s=CLOSED pgs=3976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 --2- 172.21.15.96:0/3326445650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa96c0f66e0 0x7fa96c106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.063+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 >> 172.21.15.96:0/3326445650 conn(0x7fa96c0f0ba0 msgr2=0x7fa96c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.064+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 shutdown_connections 2022-02-02T22:41:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.064+0000 7fa96b59e700 1 -- 172.21.15.96:0/3326445650 wait complete. 2022-02-02T22:41:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 -- 172.21.15.96:0/2810157060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 msgr2=0x7f93f40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 --2- 172.21.15.96:0/2810157060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f40f59e0 secure :-1 s=READY pgs=3977 cs=0 l=1 rev1=1 rx=0x7f93dc004660 tx=0x7f93dc009b30).stop 2022-02-02T22:41:31.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 -- 172.21.15.96:0/2810157060 shutdown_connections 2022-02-02T22:41:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 --2- 172.21.15.96:0/2810157060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 0x7f93f40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 --2- 172.21.15.96:0/2810157060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f40f59e0 unknown :-1 s=CLOSED pgs=3977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 -- 172.21.15.96:0/2810157060 >> 172.21.15.96:0/2810157060 conn(0x7f93f40f0d40 msgr2=0x7f93f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 -- 172.21.15.96:0/2810157060 shutdown_connections 2022-02-02T22:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.161+0000 7f93f89f3700 1 -- 172.21.15.96:0/2810157060 wait complete. 2022-02-02T22:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 Processor -- start 2022-02-02T22:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 -- start start 2022-02-02T22:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 0x7f93f4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4107a10 con 0x7f93f40f55c0 2022-02-02T22:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f89f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4107b50 con 0x7f93f40f6860 2022-02-02T22:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49890/0 (socket says 172.21.15.96:49890) 2022-02-02T22:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f259c700 1 -- 172.21.15.96:0/3629384491 learned_addr learned my addr 172.21.15.96:0/3629384491 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.162+0000 7f93f1d9b700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 0x7f93f4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f259c700 1 -- 172.21.15.96:0/3629384491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 msgr2=0x7f93f4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f259c700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 0x7f93f4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f259c700 1 -- 172.21.15.96:0/3629384491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc005040 con 0x7f93f40f55c0 2022-02-02T22:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f259c700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 secure :-1 s=READY pgs=3978 cs=0 l=1 rev1=1 rx=0x7f93dc013a70 tx=0x7f93dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:31.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc018070 con 0x7f93f40f55c0 2022-02-02T22:41:31.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93dc0097d0 con 0x7f93f40f55c0 2022-02-02T22:41:31.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4108490 con 0x7f93f40f55c0 2022-02-02T22:41:31.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc01de80 con 0x7f93f40f55c0 2022-02-02T22:41:31.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.163+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f41089f0 con 0x7f93f40f55c0 2022-02-02T22:41:31.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.164+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4045ad0 con 0x7f93f40f55c0 2022-02-02T22:41:31.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.164+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93dc007ba0 con 0x7f93f40f55c0 2022-02-02T22:41:31.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.165+0000 7f93eaffd700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 0x7f93e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:41:31.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.165+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93dc083560 con 0x7f93f40f55c0 2022-02-02T22:41:31.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.165+0000 7f93f1d9b700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 0x7f93e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:41:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.165+0000 7f93f1d9b700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 0x7f93e0067290 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f93e4004c40 tx=0x7f93e400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:41:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.170+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93dc055090 con 0x7f93f40f55c0 2022-02-02T22:41:31.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.369+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93f410d590 con 0x7f93f40f55c0 2022-02-02T22:41:31.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.369+0000 7f93eaffd700 1 -- 172.21.15.96:0/3629384491 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f93dc054c80 con 0x7f93f40f55c0 2022-02-02T22:41:31.371 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:41:31.371 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:41:31.372 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:41:31.372 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:41:31.372 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:31.373 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:41:31.373 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:41:31.373 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:41:31.374 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:41:31.374 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:41:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:41:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:41:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:41:31.376 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:41:31.376 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:41:31.376 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:41:31.377 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:41:31.377 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:41:31.377 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:41:31.378 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:41:31.378 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:41:31.378 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:41:31.379 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:41:31.379 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:41:31.379 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:41:31.380 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:41:31.380 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:41:31.381 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:41:31.381 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:41:31.381 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:41:31.382 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:41:31.382 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:41:31.383 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:31.383 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:31.383 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:41:31.384 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:41:31.384 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:31.384 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:31.385 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:41:31.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 msgr2=0x7f93e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 0x7f93e0067290 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f93e4004c40 tx=0x7f93e400b040).stop 2022-02-02T22:41:31.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 msgr2=0x7f93f4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:41:31.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 secure :-1 s=READY pgs=3978 cs=0 l=1 rev1=1 rx=0x7f93dc013a70 tx=0x7f93dc009b30).stop 2022-02-02T22:41:31.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 shutdown_connections 2022-02-02T22:41:31.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93e0064dd0 0x7f93e0067290 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93f40f55c0 0x7f93f4106f70 unknown :-1 s=CLOSED pgs=3978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 --2- 172.21.15.96:0/3629384491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f40f6860 0x7f93f4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:41:31.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 >> 172.21.15.96:0/3629384491 conn(0x7f93f40f0d40 msgr2=0x7f93f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:41:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 shutdown_connections 2022-02-02T22:41:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:41:31.371+0000 7f93f89f3700 1 -- 172.21.15.96:0/3629384491 wait complete. 2022-02-02T22:41:31.390 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:41:32.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:31 smithi159 ceph-mon[69013]: from='client.42068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:32.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:31 smithi159 ceph-mon[69013]: from='client.42072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:32.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3326445650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:41:32.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:31 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3629384491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:41:32.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:31 smithi096 ceph-mon[101353]: from='client.42068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:32.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:31 smithi096 ceph-mon[101353]: from='client.42072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:41:32.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3326445650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:41:32.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:31 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3629384491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:41:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:32 smithi159 ceph-mon[69013]: pgmap v7782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:32 smithi096 ceph-mon[101353]: pgmap v7782: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:34 smithi159 ceph-mon[69013]: pgmap v7783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:34 smithi096 ceph-mon[101353]: pgmap v7783: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:36 smithi159 ceph-mon[69013]: pgmap v7784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:36 smithi096 ceph-mon[101353]: pgmap v7784: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:38 smithi159 ceph-mon[69013]: pgmap v7785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:38 smithi096 ceph-mon[101353]: pgmap v7785: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:41.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:40 smithi159 ceph-mon[69013]: pgmap v7786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:40 smithi096 ceph-mon[101353]: pgmap v7786: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:42 smithi159 ceph-mon[69013]: pgmap v7787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:42 smithi096 ceph-mon[101353]: pgmap v7787: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:44 smithi159 ceph-mon[69013]: pgmap v7788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:44 smithi096 ceph-mon[101353]: pgmap v7788: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:46 smithi159 ceph-mon[69013]: pgmap v7789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:46 smithi096 ceph-mon[101353]: pgmap v7789: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:48 smithi159 ceph-mon[69013]: pgmap v7790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:48 smithi096 ceph-mon[101353]: pgmap v7790: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:50 smithi159 ceph-mon[69013]: pgmap v7791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:50 smithi096 ceph-mon[101353]: pgmap v7791: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:52 smithi159 ceph-mon[69013]: pgmap v7792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:52 smithi096 ceph-mon[101353]: pgmap v7792: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:54 smithi159 ceph-mon[69013]: pgmap v7793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:54 smithi096 ceph-mon[101353]: pgmap v7793: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:56 smithi159 ceph-mon[69013]: pgmap v7794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:56 smithi096 ceph-mon[101353]: pgmap v7794: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:41:58 smithi159 ceph-mon[69013]: pgmap v7795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:41:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:41:58 smithi096 ceph-mon[101353]: pgmap v7795: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:00 smithi159 ceph-mon[69013]: pgmap v7796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:00 smithi096 ceph-mon[101353]: pgmap v7796: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:01.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 -- 172.21.15.96:0/3834454575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f96f0 msgr2=0x7f428c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 --2- 172.21.15.96:0/3834454575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f96f0 0x7f428c0fbae0 secure :-1 s=READY pgs=3979 cs=0 l=1 rev1=1 rx=0x7f427c004660 tx=0x7f427c009b30).stop 2022-02-02T22:42:01.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 -- 172.21.15.96:0/3834454575 shutdown_connections 2022-02-02T22:42:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 --2- 172.21.15.96:0/3834454575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f96f0 0x7f428c0fbae0 unknown :-1 s=CLOSED pgs=3979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 --2- 172.21.15.96:0/3834454575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 0x7f428c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.484 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.481+0000 7f4292bda700 1 -- 172.21.15.96:0/3834454575 >> 172.21.15.96:0/3834454575 conn(0x7f428c0f0b90 msgr2=0x7f428c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:01.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 -- 172.21.15.96:0/3834454575 shutdown_connections 2022-02-02T22:42:01.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 -- 172.21.15.96:0/3834454575 wait complete. 2022-02-02T22:42:01.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 Processor -- start 2022-02-02T22:42:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 -- start start 2022-02-02T22:42:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 0x7f428c0f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0f59e0 con 0x7f428c0f5070 2022-02-02T22:42:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.482+0000 7f4292bda700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0f5b20 con 0x7f428c0602b0 2022-02-02T22:42:01.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49910/0 (socket says 172.21.15.96:49910) 2022-02-02T22:42:01.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 -- 172.21.15.96:0/2686532902 learned_addr learned my addr 172.21.15.96:0/2686532902 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:01.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 -- 172.21.15.96:0/2686532902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 msgr2=0x7f428c0f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f4291bd8700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 0x7f428c0f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 0x7f428c0f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 -- 172.21.15.96:0/2686532902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c005040 con 0x7f428c0f5070 2022-02-02T22:42:01.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42913d7700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 secure :-1 s=READY pgs=3980 cs=0 l=1 rev1=1 rx=0x7f427c000c00 tx=0x7f427c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:01.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427c019070 con 0x7f428c0f5070 2022-02-02T22:42:01.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c0f5d70 con 0x7f428c0f5070 2022-02-02T22:42:01.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f427c0097d0 con 0x7f428c0f5070 2022-02-02T22:42:01.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427c014590 con 0x7f428c0f5070 2022-02-02T22:42:01.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.483+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c10f170 con 0x7f428c0f5070 2022-02-02T22:42:01.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.484+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c045ad0 con 0x7f428c0f5070 2022-02-02T22:42:01.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.485+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f427c014800 con 0x7f428c0f5070 2022-02-02T22:42:01.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.485+0000 7f42827fc700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 0x7f42780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.485+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f427c082e10 con 0x7f428c0f5070 2022-02-02T22:42:01.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.485+0000 7f4291bd8700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 0x7f42780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.486+0000 7f4291bd8700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 0x7f42780672e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 rx=0x7f42880041d0 tx=0x7f4288009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:01.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.490+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f427c050f10 con 0x7f428c0f5070 2022-02-02T22:42:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.667+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f428c057f10 con 0x7f4278064e20 2022-02-02T22:42:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.668+0000 7f42827fc700 1 -- 172.21.15.96:0/2686532902 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f428c057f10 con 0x7f4278064e20 2022-02-02T22:42:01.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 msgr2=0x7f42780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 0x7f42780672e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 rx=0x7f42880041d0 tx=0x7f4288009040).stop 2022-02-02T22:42:01.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 msgr2=0x7f428c0f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 secure :-1 s=READY pgs=3980 cs=0 l=1 rev1=1 rx=0x7f427c000c00 tx=0x7f427c009b30).stop 2022-02-02T22:42:01.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 shutdown_connections 2022-02-02T22:42:01.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4278064e20 0x7f42780672e0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f428c0602b0 0x7f428c0f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 --2- 172.21.15.96:0/2686532902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f428c0f5070 0x7f428c0f54f0 unknown :-1 s=CLOSED pgs=3980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 >> 172.21.15.96:0/2686532902 conn(0x7f428c0f0b90 msgr2=0x7f428c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:01.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 shutdown_connections 2022-02-02T22:42:01.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.670+0000 7f4292bda700 1 -- 172.21.15.96:0/2686532902 wait complete. 2022-02-02T22:42:01.680 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:42:01.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 -- 172.21.15.96:0/2879989634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f55c0 msgr2=0x7fd9400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 --2- 172.21.15.96:0/2879989634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f55c0 0x7fd9400f59e0 secure :-1 s=READY pgs=3981 cs=0 l=1 rev1=1 rx=0x7fd934004660 tx=0x7fd934009b30).stop 2022-02-02T22:42:01.771 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 -- 172.21.15.96:0/2879989634 shutdown_connections 2022-02-02T22:42:01.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 --2- 172.21.15.96:0/2879989634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f6860 0x7fd9400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 --2- 172.21.15.96:0/2879989634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f55c0 0x7fd9400f59e0 unknown :-1 s=CLOSED pgs=3981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 -- 172.21.15.96:0/2879989634 >> 172.21.15.96:0/2879989634 conn(0x7fd9400f0d40 msgr2=0x7fd9400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:01.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 -- 172.21.15.96:0/2879989634 shutdown_connections 2022-02-02T22:42:01.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.768+0000 7fd947db8700 1 -- 172.21.15.96:0/2879989634 wait complete. 2022-02-02T22:42:01.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 Processor -- start 2022-02-02T22:42:01.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 -- start start 2022-02-02T22:42:01.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 0x7fd94010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400602b0 con 0x7fd9400f6860 2022-02-02T22:42:01.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd947db8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400603f0 con 0x7fd9400f55c0 2022-02-02T22:42:01.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd945353700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd945353700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49918/0 (socket says 172.21.15.96:49918) 2022-02-02T22:42:01.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.769+0000 7fd945353700 1 -- 172.21.15.96:0/1633961473 learned_addr learned my addr 172.21.15.96:0/1633961473 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:01.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945b54700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 0x7fd94010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945353700 1 -- 172.21.15.96:0/1633961473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 msgr2=0x7fd94010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945353700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 0x7fd94010c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945353700 1 -- 172.21.15.96:0/1633961473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934005040 con 0x7fd9400f6860 2022-02-02T22:42:01.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945b54700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 0x7fd94010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:42:01.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd945353700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 secure :-1 s=READY pgs=3982 cs=0 l=1 rev1=1 rx=0x7fd93c00c530 tx=0x7fd93c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:01.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c00f650 con 0x7fd9400f6860 2022-02-02T22:42:01.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd93c00fc60 con 0x7fd9400f6860 2022-02-02T22:42:01.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c012cd0 con 0x7fd9400f6860 2022-02-02T22:42:01.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94010ea80 con 0x7fd9400f6860 2022-02-02T22:42:01.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.770+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94010eea0 con 0x7fd9400f6860 2022-02-02T22:42:01.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.771+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd940045ad0 con 0x7fd9400f6860 2022-02-02T22:42:01.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.771+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd93c010070 con 0x7fd9400f6860 2022-02-02T22:42:01.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.772+0000 7fd9327fc700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 0x7fd92c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:01.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.772+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd93c0817d0 con 0x7fd9400f6860 2022-02-02T22:42:01.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.772+0000 7fd945b54700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 0x7fd92c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:01.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.772+0000 7fd945b54700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 0x7fd92c067290 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7fd934004e30 tx=0x7fd934009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:01.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.776+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd93c04f8d0 con 0x7fd9400f6860 2022-02-02T22:42:01.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.950+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9400fdef0 con 0x7fd92c064dd0 2022-02-02T22:42:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.960+0000 7fd9327fc700 1 -- 172.21.15.96:0/1633961473 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd9400fdef0 con 0x7fd92c064dd0 2022-02-02T22:42:01.960 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:42:01.961 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:42:01.961 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:42:01.961 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:42:01.962 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:42:01.962 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:42:01.962 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:42:01.963 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:42:01.963 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:42:01.963 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:42:01.964 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:42:01.964 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:42:01.964 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:42:01.965 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:42:01.965 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:42:01.965 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:42:01.966 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:42:01.966 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:42:01.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:42:01.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:42:01.967 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:42:01.968 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:42:01.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 msgr2=0x7fd92c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 0x7fd92c067290 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7fd934004e30 tx=0x7fd934009b30).stop 2022-02-02T22:42:01.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 msgr2=0x7fd94010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:01.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 secure :-1 s=READY pgs=3982 cs=0 l=1 rev1=1 rx=0x7fd93c00c530 tx=0x7fd93c007e20).stop 2022-02-02T22:42:01.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 shutdown_connections 2022-02-02T22:42:01.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd92c064dd0 0x7fd92c067290 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9400f55c0 0x7fd94010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 --2- 172.21.15.96:0/1633961473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9400f6860 0x7fd94010e590 unknown :-1 s=CLOSED pgs=3982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:01.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 >> 172.21.15.96:0/1633961473 conn(0x7fd9400f0d40 msgr2=0x7fd9400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:01.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 shutdown_connections 2022-02-02T22:42:01.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:01.962+0000 7fd947db8700 1 -- 172.21.15.96:0/1633961473 wait complete. 2022-02-02T22:42:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 -- 172.21.15.96:0/1808563704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f5ef0 msgr2=0x7f13540f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 --2- 172.21.15.96:0/1808563704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f5ef0 0x7f13540f6920 secure :-1 s=READY pgs=3983 cs=0 l=1 rev1=1 rx=0x7f1344004660 tx=0x7f1344009b30).stop 2022-02-02T22:42:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 -- 172.21.15.96:0/1808563704 shutdown_connections 2022-02-02T22:42:02.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 --2- 172.21.15.96:0/1808563704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f5ef0 0x7f13540f6920 unknown :-1 s=CLOSED pgs=3983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 --2- 172.21.15.96:0/1808563704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f55e0 0x7f13540f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 -- 172.21.15.96:0/1808563704 >> 172.21.15.96:0/1808563704 conn(0x7f13540f0de0 msgr2=0x7f13540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.058+0000 7f135b97a700 1 -- 172.21.15.96:0/1808563704 shutdown_connections 2022-02-02T22:42:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 -- 172.21.15.96:0/1808563704 wait complete. 2022-02-02T22:42:02.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 Processor -- start 2022-02-02T22:42:02.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 -- start start 2022-02-02T22:42:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f5ef0 0x7f1354106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354106950 con 0x7f13540f55e0 2022-02-02T22:42:02.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.059+0000 7f135b97a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354107160 con 0x7f13540f5ef0 2022-02-02T22:42:02.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49930/0 (socket says 172.21.15.96:49930) 2022-02-02T22:42:02.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 -- 172.21.15.96:0/1631984634 learned_addr learned my addr 172.21.15.96:0/1631984634 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:02.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1358f15700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f5ef0 0x7f1354106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 -- 172.21.15.96:0/1631984634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f5ef0 msgr2=0x7f1354106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f5ef0 0x7f1354106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 -- 172.21.15.96:0/1631984634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344005040 con 0x7f13540f55e0 2022-02-02T22:42:02.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1359716700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 secure :-1 s=READY pgs=3984 cs=0 l=1 rev1=1 rx=0x7f1350010a00 tx=0x7f135000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:02.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13500094c0 con 0x7f13540f55e0 2022-02-02T22:42:02.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1350009620 con 0x7f13540f55e0 2022-02-02T22:42:02.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1354107380 con 0x7f13540f55e0 2022-02-02T22:42:02.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1350007e50 con 0x7f13540f55e0 2022-02-02T22:42:02.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.060+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1354107910 con 0x7f13540f55e0 2022-02-02T22:42:02.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.061+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13540f4a70 con 0x7f13540f55e0 2022-02-02T22:42:02.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.062+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1350022070 con 0x7f13540f55e0 2022-02-02T22:42:02.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.062+0000 7f1349ffb700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 0x7f1340067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.062+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1350084280 con 0x7f13540f55e0 2022-02-02T22:42:02.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.062+0000 7f1358f15700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 0x7f1340067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.063+0000 7f1358f15700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 0x7f1340067290 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 rx=0x7f13440043d0 tx=0x7f134400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:02.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.066+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1350052380 con 0x7f13540f55e0 2022-02-02T22:42:02.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.299+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13540ff7e0 con 0x7f13540f55e0 2022-02-02T22:42:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.299+0000 7f1349ffb700 1 -- 172.21.15.96:0/1631984634 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f13500559a0 con 0x7f13540f55e0 2022-02-02T22:42:02.300 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:42:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:42:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:42:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:42:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:42:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:42:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:42:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:42:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:42:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:42:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:42:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:42:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:42:02.307 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:42:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.301+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 msgr2=0x7f1340067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.301+0000 7f135b97a700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 0x7f1340067290 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 rx=0x7f13440043d0 tx=0x7f134400b040).stop 2022-02-02T22:42:02.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.301+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 msgr2=0x7f1354105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.301+0000 7f135b97a700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 secure :-1 s=READY pgs=3984 cs=0 l=1 rev1=1 rx=0x7f1350010a00 tx=0x7f135000b040).stop 2022-02-02T22:42:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 shutdown_connections 2022-02-02T22:42:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1340064dd0 0x7f1340067290 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13540f55e0 0x7f1354105e60 unknown :-1 s=CLOSED pgs=3984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 --2- 172.21.15.96:0/1631984634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13540f5ef0 0x7f1354106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 >> 172.21.15.96:0/1631984634 conn(0x7f13540f0de0 msgr2=0x7f13540fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:02.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 shutdown_connections 2022-02-02T22:42:02.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.302+0000 7f135b97a700 1 -- 172.21.15.96:0/1631984634 wait complete. 2022-02-02T22:42:02.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 -- 172.21.15.96:0/1118795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f6860 msgr2=0x7fd4100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 --2- 172.21.15.96:0/1118795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f6860 0x7fd4100f6cc0 secure :-1 s=READY pgs=3985 cs=0 l=1 rev1=1 rx=0x7fd3fc004660 tx=0x7fd3fc009b30).stop 2022-02-02T22:42:02.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 -- 172.21.15.96:0/1118795921 shutdown_connections 2022-02-02T22:42:02.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 --2- 172.21.15.96:0/1118795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f6860 0x7fd4100f6cc0 unknown :-1 s=CLOSED pgs=3985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 --2- 172.21.15.96:0/1118795921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f55c0 0x7fd4100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 -- 172.21.15.96:0/1118795921 >> 172.21.15.96:0/1118795921 conn(0x7fd4100f0d40 msgr2=0x7fd4100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 -- 172.21.15.96:0/1118795921 shutdown_connections 2022-02-02T22:42:02.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.403+0000 7fd417053700 1 -- 172.21.15.96:0/1118795921 wait complete. 2022-02-02T22:42:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 Processor -- start 2022-02-02T22:42:02.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 -- start start 2022-02-02T22:42:02.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f6860 0x7fd4101063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101069b0 con 0x7fd4100f55c0 2022-02-02T22:42:02.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd417053700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101071c0 con 0x7fd4100f6860 2022-02-02T22:42:02.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49940/0 (socket says 172.21.15.96:49940) 2022-02-02T22:42:02.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 -- 172.21.15.96:0/3440459124 learned_addr learned my addr 172.21.15.96:0/3440459124 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:02.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd40ffff700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f6860 0x7fd4101063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 -- 172.21.15.96:0/3440459124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f6860 msgr2=0x7fd4101063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f6860 0x7fd4101063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.404+0000 7fd414def700 1 -- 172.21.15.96:0/3440459124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc005040 con 0x7fd4100f55c0 2022-02-02T22:42:02.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd414def700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 secure :-1 s=READY pgs=3986 cs=0 l=1 rev1=1 rx=0x7fd404002700 tx=0x7fd404009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:02.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd404009320 con 0x7fd4100f55c0 2022-02-02T22:42:02.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd40400f040 con 0x7fd4100f55c0 2022-02-02T22:42:02.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd404014900 con 0x7fd4100f55c0 2022-02-02T22:42:02.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd410107440 con 0x7fd4100f55c0 2022-02-02T22:42:02.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.405+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd410107a00 con 0x7fd4100f55c0 2022-02-02T22:42:02.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.406+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4100f49b0 con 0x7fd4100f55c0 2022-02-02T22:42:02.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.406+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd404009480 con 0x7fd4100f55c0 2022-02-02T22:42:02.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.407+0000 7fd40d7fa700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 0x7fd400067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:02.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.407+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd404081be0 con 0x7fd4100f55c0 2022-02-02T22:42:02.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.407+0000 7fd40ffff700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 0x7fd400067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:02.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.407+0000 7fd40ffff700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 0x7fd400067290 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 rx=0x7fd3fc009da0 tx=0x7fd3fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:02.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.411+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd40404fce0 con 0x7fd4100f55c0 2022-02-02T22:42:02.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.610+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4100fdf10 con 0x7fd4100f55c0 2022-02-02T22:42:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.611+0000 7fd40d7fa700 1 -- 172.21.15.96:0/3440459124 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd4100fdf10 con 0x7fd4100f55c0 2022-02-02T22:42:02.612 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:42:02.613 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:42:02.613 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:42:02.613 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:42:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:02.614 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:42:02.614 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:42:02.615 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:42:02.615 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:42:02.615 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:42:02.616 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:42:02.616 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:42:02.616 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:42:02.617 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:42:02.617 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:42:02.617 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:42:02.618 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:42:02.618 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:42:02.619 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:42:02.619 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:42:02.619 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:42:02.620 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:42:02.620 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:42:02.620 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:42:02.621 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:42:02.621 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:42:02.621 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:42:02.622 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:42:02.622 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:42:02.623 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:42:02.623 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:42:02.623 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:42:02.624 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:02.624 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:02.624 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:42:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:02.625 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:02.625 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:02.626 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:02.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 msgr2=0x7fd400067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 0x7fd400067290 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 rx=0x7fd3fc009da0 tx=0x7fd3fc009b30).stop 2022-02-02T22:42:02.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 msgr2=0x7fd410105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:02.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 secure :-1 s=READY pgs=3986 cs=0 l=1 rev1=1 rx=0x7fd404002700 tx=0x7fd404009d80).stop 2022-02-02T22:42:02.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 shutdown_connections 2022-02-02T22:42:02.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd400064dd0 0x7fd400067290 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4100f55c0 0x7fd410105ec0 unknown :-1 s=CLOSED pgs=3986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 --2- 172.21.15.96:0/3440459124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4100f6860 0x7fd4101063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:02.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 >> 172.21.15.96:0/3440459124 conn(0x7fd4100f0d40 msgr2=0x7fd4100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:02.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 shutdown_connections 2022-02-02T22:42:02.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:02.613+0000 7fd417053700 1 -- 172.21.15.96:0/3440459124 wait complete. 2022-02-02T22:42:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:42:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:02 smithi159 ceph-mon[69013]: pgmap v7797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:02 smithi159 ceph-mon[69013]: from='client.42084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:02 smithi159 ceph-mon[69013]: from='client.42088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1631984634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:42:03.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:02 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3440459124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:42:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:02 smithi096 ceph-mon[101353]: pgmap v7797: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:02 smithi096 ceph-mon[101353]: from='client.42084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:02 smithi096 ceph-mon[101353]: from='client.42088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1631984634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:42:03.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:02 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3440459124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:42:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:04 smithi159 ceph-mon[69013]: pgmap v7798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:04 smithi096 ceph-mon[101353]: pgmap v7798: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:06 smithi159 ceph-mon[69013]: pgmap v7799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:06 smithi096 ceph-mon[101353]: pgmap v7799: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:08 smithi159 ceph-mon[69013]: pgmap v7800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:08 smithi096 ceph-mon[101353]: pgmap v7800: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:10 smithi159 ceph-mon[69013]: pgmap v7801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:10 smithi096 ceph-mon[101353]: pgmap v7801: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:13.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:12 smithi159 ceph-mon[69013]: pgmap v7802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:12 smithi096 ceph-mon[101353]: pgmap v7802: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:14 smithi159 ceph-mon[69013]: pgmap v7803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:14 smithi096 ceph-mon[101353]: pgmap v7803: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:16 smithi159 ceph-mon[69013]: pgmap v7804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:16 smithi096 ceph-mon[101353]: pgmap v7804: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:18 smithi159 ceph-mon[69013]: pgmap v7805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:18 smithi096 ceph-mon[101353]: pgmap v7805: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:20 smithi159 ceph-mon[69013]: pgmap v7806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:20 smithi096 ceph-mon[101353]: pgmap v7806: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:22 smithi159 ceph-mon[69013]: pgmap v7807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:22 smithi096 ceph-mon[101353]: pgmap v7807: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:24 smithi159 ceph-mon[69013]: pgmap v7808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:24 smithi096 ceph-mon[101353]: pgmap v7808: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:26 smithi159 ceph-mon[69013]: pgmap v7809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:26 smithi096 ceph-mon[101353]: pgmap v7809: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:28 smithi159 ceph-mon[69013]: pgmap v7810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:42:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:42:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:28 smithi096 ceph-mon[101353]: pgmap v7810: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:42:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:42:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:30 smithi159 ceph-mon[69013]: pgmap v7811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:30 smithi096 ceph-mon[101353]: pgmap v7811: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:32.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 -- 172.21.15.96:0/2290413282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 msgr2=0x7f20940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 --2- 172.21.15.96:0/2290413282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f20940f59e0 secure :-1 s=READY pgs=3987 cs=0 l=1 rev1=1 rx=0x7f2088004660 tx=0x7f2088009b30).stop 2022-02-02T22:42:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 -- 172.21.15.96:0/2290413282 shutdown_connections 2022-02-02T22:42:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 --2- 172.21.15.96:0/2290413282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f20940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 --2- 172.21.15.96:0/2290413282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f20940f59e0 unknown :-1 s=CLOSED pgs=3987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:32.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 -- 172.21.15.96:0/2290413282 >> 172.21.15.96:0/2290413282 conn(0x7f20940f0d40 msgr2=0x7f20940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:32.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 -- 172.21.15.96:0/2290413282 shutdown_connections 2022-02-02T22:42:32.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.722+0000 7f2098ec6700 1 -- 172.21.15.96:0/2290413282 wait complete. 2022-02-02T22:42:32.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 Processor -- start 2022-02-02T22:42:32.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 -- start start 2022-02-02T22:42:32.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:32.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f209410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:32.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20940603e0 con 0x7f20940f55c0 2022-02-02T22:42:32.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2098ec6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094060520 con 0x7f20940f6860 2022-02-02T22:42:32.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f209259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:32.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f209259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49960/0 (socket says 172.21.15.96:49960) 2022-02-02T22:42:32.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f209259c700 1 -- 172.21.15.96:0/2945835543 learned_addr learned my addr 172.21.15.96:0/2945835543 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:32.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.723+0000 7f2091d9b700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f209410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:32.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f209259c700 1 -- 172.21.15.96:0/2945835543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 msgr2=0x7f209410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:32.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f209259c700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f209410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:32.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f209259c700 1 -- 172.21.15.96:0/2945835543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088005040 con 0x7f20940f55c0 2022-02-02T22:42:32.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2091d9b700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f209410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:42:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f209259c700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 secure :-1 s=READY pgs=3988 cs=0 l=1 rev1=1 rx=0x7f2088013a70 tx=0x7f2088009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2088018070 con 0x7f20940f55c0 2022-02-02T22:42:32.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20880097d0 con 0x7f20940f55c0 2022-02-02T22:42:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2098ec6700 1 -- 172.21.15.96:0/2945835543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209410c6c0 con 0x7f20940f55c0 2022-02-02T22:42:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208801c3c0 con 0x7f20940f55c0 2022-02-02T22:42:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.724+0000 7f2098ec6700 1 -- 172.21.15.96:0/2945835543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209410cc20 con 0x7f20940f55c0 2022-02-02T22:42:32.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.725+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c004fa0 con 0x7f20940f55c0 2022-02-02T22:42:32.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.725+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2088007ba0 con 0x7f20940f55c0 2022-02-02T22:42:32.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.726+0000 7f2082ffd700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 0x7f207c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:32.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.726+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f20880835a0 con 0x7f20940f55c0 2022-02-02T22:42:32.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.726+0000 7f2091d9b700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 0x7f207c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:32.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.726+0000 7f2091d9b700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 0x7f207c067290 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 rx=0x7f2084009740 tx=0x7f2084009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.730+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20880516a0 con 0x7f20940f55c0 2022-02-02T22:42:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.910+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f206c000bc0 con 0x7f207c064dd0 2022-02-02T22:42:33.055 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:32 smithi159 ceph-mon[69013]: pgmap v7812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.911+0000 7f2082ffd700 1 -- 172.21.15.96:0/2945835543 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f206c000bc0 con 0x7f207c064dd0 2022-02-02T22:42:33.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 msgr2=0x7f207c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 0x7f207c067290 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 rx=0x7f2084009740 tx=0x7f2084009be0).stop 2022-02-02T22:42:33.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 msgr2=0x7f2094109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 secure :-1 s=READY pgs=3988 cs=0 l=1 rev1=1 rx=0x7f2088013a70 tx=0x7f2088009b30).stop 2022-02-02T22:42:33.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 shutdown_connections 2022-02-02T22:42:33.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f207c064dd0 0x7f207c067290 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20940f55c0 0x7f2094109c70 unknown :-1 s=CLOSED pgs=3988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 --2- 172.21.15.96:0/2945835543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20940f6860 0x7f209410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 >> 172.21.15.96:0/2945835543 conn(0x7f20940f0d40 msgr2=0x7f20940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 shutdown_connections 2022-02-02T22:42:33.060 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:32.913+0000 7f2080ff9700 1 -- 172.21.15.96:0/2945835543 wait complete. 2022-02-02T22:42:33.061 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:42:33.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 -- 172.21.15.96:0/3373318077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 msgr2=0x7fd3640f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 --2- 172.21.15.96:0/3373318077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd3640f9110 secure :-1 s=READY pgs=3989 cs=0 l=1 rev1=1 rx=0x7fd360004660 tx=0x7fd360009b30).stop 2022-02-02T22:42:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 -- 172.21.15.96:0/3373318077 shutdown_connections 2022-02-02T22:42:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 --2- 172.21.15.96:0/3373318077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 0x7fd3640fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 --2- 172.21.15.96:0/3373318077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd3640f9110 unknown :-1 s=CLOSED pgs=3989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 -- 172.21.15.96:0/3373318077 >> 172.21.15.96:0/3373318077 conn(0x7fd3640f0b90 msgr2=0x7fd3640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.064 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:32 smithi096 ceph-mon[101353]: pgmap v7812: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.011+0000 7fd36acff700 1 -- 172.21.15.96:0/3373318077 shutdown_connections 2022-02-02T22:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 -- 172.21.15.96:0/3373318077 wait complete. 2022-02-02T22:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 Processor -- start 2022-02-02T22:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 -- start start 2022-02-02T22:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 0x7fd3641072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641078a0 con 0x7fd364060310 2022-02-02T22:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd36acff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641080e0 con 0x7fd3640f9690 2022-02-02T22:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd369cfd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd369cfd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49970/0 (socket says 172.21.15.96:49970) 2022-02-02T22:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.012+0000 7fd369cfd700 1 -- 172.21.15.96:0/222984124 learned_addr learned my addr 172.21.15.96:0/222984124 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd3694fc700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 0x7fd3641072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd369cfd700 1 -- 172.21.15.96:0/222984124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 msgr2=0x7fd3641072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd369cfd700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 0x7fd3641072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd369cfd700 1 -- 172.21.15.96:0/222984124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360005040 con 0x7fd364060310 2022-02-02T22:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd369cfd700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 secure :-1 s=READY pgs=3990 cs=0 l=1 rev1=1 rx=0x7fd360009990 tx=0x7fd360009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd360018070 con 0x7fd364060310 2022-02-02T22:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364108360 con 0x7fd364060310 2022-02-02T22:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd360007ba0 con 0x7fd364060310 2022-02-02T22:42:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36001c3c0 con 0x7fd364060310 2022-02-02T22:42:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.013+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364108840 con 0x7fd364060310 2022-02-02T22:42:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.014+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd364059100 con 0x7fd364060310 2022-02-02T22:42:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.015+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd36001d420 con 0x7fd364060310 2022-02-02T22:42:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.015+0000 7fd3567fc700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 0x7fd3500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.015+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd3600836b0 con 0x7fd364060310 2022-02-02T22:42:33.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.015+0000 7fd3694fc700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 0x7fd3500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.015+0000 7fd3694fc700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 0x7fd3500672e0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 rx=0x7fd364106b40 tx=0x7fd35800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.019+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd360051810 con 0x7fd364060310 2022-02-02T22:42:33.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.192+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3640feda0 con 0x7fd350064e20 2022-02-02T22:42:33.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.201+0000 7fd3567fc700 1 -- 172.21.15.96:0/222984124 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd3640feda0 con 0x7fd350064e20 2022-02-02T22:42:33.203 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:42:33.203 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:42:33.203 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:42:33.204 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:42:33.204 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:42:33.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:42:33.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:42:33.205 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:42:33.206 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:42:33.206 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:42:33.207 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:42:33.207 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:42:33.208 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:42:33.208 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:42:33.208 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:42:33.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:42:33.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:42:33.209 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:42:33.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:42:33.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:42:33.210 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:42:33.211 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:42:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 msgr2=0x7fd3500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 0x7fd3500672e0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 rx=0x7fd364106b40 tx=0x7fd35800b040).stop 2022-02-02T22:42:33.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 msgr2=0x7fd364106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 secure :-1 s=READY pgs=3990 cs=0 l=1 rev1=1 rx=0x7fd360009990 tx=0x7fd360009b30).stop 2022-02-02T22:42:33.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 shutdown_connections 2022-02-02T22:42:33.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd350064e20 0x7fd3500672e0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd364060310 0x7fd364106db0 unknown :-1 s=CLOSED pgs=3990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 --2- 172.21.15.96:0/222984124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3640f9690 0x7fd3641072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 >> 172.21.15.96:0/222984124 conn(0x7fd3640f0b90 msgr2=0x7fd3640f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 shutdown_connections 2022-02-02T22:42:33.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.203+0000 7fd36acff700 1 -- 172.21.15.96:0/222984124 wait complete. 2022-02-02T22:42:33.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/872246004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 msgr2=0x7f9ed00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/872246004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed00f5860 secure :-1 s=READY pgs=3991 cs=0 l=1 rev1=1 rx=0x7f9ec4004660 tx=0x7f9ec4009b30).stop 2022-02-02T22:42:33.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/872246004 shutdown_connections 2022-02-02T22:42:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/872246004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 0x7f9ed00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/872246004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed00f5860 unknown :-1 s=CLOSED pgs=3991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/872246004 >> 172.21.15.96:0/872246004 conn(0x7f9ed00f0ba0 msgr2=0x7f9ed00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.300+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/872246004 shutdown_connections 2022-02-02T22:42:33.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.301+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/872246004 wait complete. 2022-02-02T22:42:33.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.301+0000 7f9ed5a8f700 1 Processor -- start 2022-02-02T22:42:33.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.301+0000 7f9ed5a8f700 1 -- start start 2022-02-02T22:42:33.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.301+0000 7f9ed5a8f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed5a8f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 0x7f9ed0106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed5a8f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01067d0 con 0x7f9ed00f5440 2022-02-02T22:42:33.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed5a8f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0106fd0 con 0x7f9ed00f66e0 2022-02-02T22:42:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49980/0 (socket says 172.21.15.96:49980) 2022-02-02T22:42:33.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 -- 172.21.15.96:0/2855502611 learned_addr learned my addr 172.21.15.96:0/2855502611 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ecffff700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 0x7f9ed0106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 -- 172.21.15.96:0/2855502611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 msgr2=0x7f9ed0106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 0x7f9ed0106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 -- 172.21.15.96:0/2855502611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4005040 con 0x7f9ed00f5440 2022-02-02T22:42:33.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed4a8d700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 secure :-1 s=READY pgs=3992 cs=0 l=1 rev1=1 rx=0x7f9ec4009d30 tx=0x7f9ec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec401a070 con 0x7f9ed00f5440 2022-02-02T22:42:33.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ec40097d0 con 0x7f9ed00f5440 2022-02-02T22:42:33.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed0107250 con 0x7f9ed00f5440 2022-02-02T22:42:33.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.302+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec401f8d0 con 0x7f9ed00f5440 2022-02-02T22:42:33.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.303+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed01077b0 con 0x7f9ed00f5440 2022-02-02T22:42:33.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.304+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0059100 con 0x7f9ed00f5440 2022-02-02T22:42:33.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.304+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ec40125d0 con 0x7f9ed00f5440 2022-02-02T22:42:33.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.305+0000 7f9ecd7fa700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 0x7f9ec00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.305+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ec4085d70 con 0x7f9ed00f5440 2022-02-02T22:42:33.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.305+0000 7f9ecffff700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 0x7f9ec00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.305+0000 7f9ecffff700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 0x7f9ec00672e0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f9ebc0041d0 tx=0x7f9ebc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.309+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ec40578a0 con 0x7f9ed00f5440 2022-02-02T22:42:33.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.536+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ed00ff610 con 0x7f9ed00f5440 2022-02-02T22:42:33.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.537+0000 7f9ecd7fa700 1 -- 172.21.15.96:0/2855502611 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9ec4057490 con 0x7f9ed00f5440 2022-02-02T22:42:33.539 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:42:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:42:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:42:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:42:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:42:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:42:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:42:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:42:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:42:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:42:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:42:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:42:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:42:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:42:33.545 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:42:33.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 msgr2=0x7f9ec00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 0x7f9ec00672e0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f9ebc0041d0 tx=0x7f9ebc009040).stop 2022-02-02T22:42:33.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 msgr2=0x7f9ed0105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 secure :-1 s=READY pgs=3992 cs=0 l=1 rev1=1 rx=0x7f9ec4009d30 tx=0x7f9ec4009b30).stop 2022-02-02T22:42:33.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 shutdown_connections 2022-02-02T22:42:33.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ec0064e20 0x7f9ec00672e0 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed00f5440 0x7f9ed0105d30 unknown :-1 s=CLOSED pgs=3992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 --2- 172.21.15.96:0/2855502611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed00f66e0 0x7f9ed0106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 >> 172.21.15.96:0/2855502611 conn(0x7f9ed00f0ba0 msgr2=0x7f9ed00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 shutdown_connections 2022-02-02T22:42:33.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.539+0000 7f9ed5a8f700 1 -- 172.21.15.96:0/2855502611 wait complete. 2022-02-02T22:42:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 -- 172.21.15.96:0/4088969403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 msgr2=0x7fb8200f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 --2- 172.21.15.96:0/4088969403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb8200f7de0 secure :-1 s=READY pgs=3993 cs=0 l=1 rev1=1 rx=0x7fb81c004660 tx=0x7fb81c009b30).stop 2022-02-02T22:42:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 -- 172.21.15.96:0/4088969403 shutdown_connections 2022-02-02T22:42:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 --2- 172.21.15.96:0/4088969403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb8200f7de0 unknown :-1 s=CLOSED pgs=3993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 --2- 172.21.15.96:0/4088969403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb8200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 -- 172.21.15.96:0/4088969403 >> 172.21.15.96:0/4088969403 conn(0x7fb8200f1e40 msgr2=0x7fb8200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 -- 172.21.15.96:0/4088969403 shutdown_connections 2022-02-02T22:42:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.636+0000 7fb82862e700 1 -- 172.21.15.96:0/4088969403 wait complete. 2022-02-02T22:42:33.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 Processor -- start 2022-02-02T22:42:33.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 -- start start 2022-02-02T22:42:33.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb820104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820105830 con 0x7fb8200f7980 2022-02-02T22:42:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb82862e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820105970 con 0x7fb8200f66e0 2022-02-02T22:42:33.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb825bc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb825bc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49992/0 (socket says 172.21.15.96:49992) 2022-02-02T22:42:33.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb825bc9700 1 -- 172.21.15.96:0/4081409778 learned_addr learned my addr 172.21.15.96:0/4081409778 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:42:33.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.637+0000 7fb8263ca700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb820104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb825bc9700 1 -- 172.21.15.96:0/4081409778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 msgr2=0x7fb820104d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb825bc9700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb820104d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb825bc9700 1 -- 172.21.15.96:0/4081409778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c005040 con 0x7fb8200f7980 2022-02-02T22:42:33.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb8263ca700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb820104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:42:33.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb825bc9700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 secure :-1 s=READY pgs=3994 cs=0 l=1 rev1=1 rx=0x7fb81c009990 tx=0x7fb81c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c018070 con 0x7fb8200f7980 2022-02-02T22:42:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82010b4e0 con 0x7fb8200f7980 2022-02-02T22:42:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb81c007ba0 con 0x7fb8200f7980 2022-02-02T22:42:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82010ba40 con 0x7fb8200f7980 2022-02-02T22:42:33.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.638+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c01c3c0 con 0x7fb8200f7980 2022-02-02T22:42:33.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.639+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820045ad0 con 0x7fb8200f7980 2022-02-02T22:42:33.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.639+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb81c01d420 con 0x7fb8200f7980 2022-02-02T22:42:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.640+0000 7fb816ffd700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 0x7fb80c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:42:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.640+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb81c083710 con 0x7fb8200f7980 2022-02-02T22:42:33.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.640+0000 7fb8263ca700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 0x7fb80c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:42:33.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.640+0000 7fb8263ca700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 0x7fb80c067290 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 rx=0x7fb820104ad0 tx=0x7fb810009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:42:33.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.644+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb81c051870 con 0x7fb8200f7980 2022-02-02T22:42:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.846+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb82010c140 con 0x7fb8200f7980 2022-02-02T22:42:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.847+0000 7fb816ffd700 1 -- 172.21.15.96:0/4081409778 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb81c054e90 con 0x7fb8200f7980 2022-02-02T22:42:33.849 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:42:33.849 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:42:33.849 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:42:33.850 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:42:33.850 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:33.851 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:42:33.851 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:42:33.851 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:42:33.852 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:42:33.852 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:42:33.852 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:42:33.853 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:42:33.853 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:42:33.853 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:42:33.854 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:42:33.854 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:42:33.854 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:42:33.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:42:33.855 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:42:33.856 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:42:33.856 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:42:33.856 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:42:33.857 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:42:33.857 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:42:33.857 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:42:33.858 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:42:33.858 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:42:33.858 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:42:33.859 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:42:33.859 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:42:33.859 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:42:33.860 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:42:33.860 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:33.861 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:42:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:42:33.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:33.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:33.862 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:42:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 msgr2=0x7fb80c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 0x7fb80c067290 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 rx=0x7fb820104ad0 tx=0x7fb810009c00).stop 2022-02-02T22:42:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 msgr2=0x7fb820105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:42:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 secure :-1 s=READY pgs=3994 cs=0 l=1 rev1=1 rx=0x7fb81c009990 tx=0x7fb81c009b30).stop 2022-02-02T22:42:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 shutdown_connections 2022-02-02T22:42:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb80c064dd0 0x7fb80c067290 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8200f66e0 0x7fb820104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 --2- 172.21.15.96:0/4081409778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8200f7980 0x7fb820105230 unknown :-1 s=CLOSED pgs=3994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:42:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.848+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 >> 172.21.15.96:0/4081409778 conn(0x7fb8200f1e40 msgr2=0x7fb82006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:42:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.849+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 shutdown_connections 2022-02-02T22:42:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:42:33.849+0000 7fb82862e700 1 -- 172.21.15.96:0/4081409778 wait complete. 2022-02-02T22:42:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:42:34.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:33 smithi159 ceph-mon[69013]: from='client.42100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:34.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2855502611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:42:34.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:33 smithi096 ceph-mon[101353]: from='client.42100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:34.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2855502611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:42:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:34 smithi159 ceph-mon[69013]: from='client.42104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:34 smithi159 ceph-mon[69013]: pgmap v7813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:35.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:34 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4081409778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:42:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:34 smithi096 ceph-mon[101353]: from='client.42104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:42:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:34 smithi096 ceph-mon[101353]: pgmap v7813: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:34 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4081409778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:42:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:36 smithi159 ceph-mon[69013]: pgmap v7814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:36 smithi096 ceph-mon[101353]: pgmap v7814: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:39.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:38 smithi159 ceph-mon[69013]: pgmap v7815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:38 smithi096 ceph-mon[101353]: pgmap v7815: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:40 smithi159 ceph-mon[69013]: pgmap v7816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:40 smithi096 ceph-mon[101353]: pgmap v7816: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:42 smithi159 ceph-mon[69013]: pgmap v7817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:42 smithi096 ceph-mon[101353]: pgmap v7817: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:44 smithi096 ceph-mon[101353]: pgmap v7818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:44 smithi159 ceph-mon[69013]: pgmap v7818: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:46 smithi096 ceph-mon[101353]: pgmap v7819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:46 smithi159 ceph-mon[69013]: pgmap v7819: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:48 smithi096 ceph-mon[101353]: pgmap v7820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:48 smithi159 ceph-mon[69013]: pgmap v7820: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:50 smithi096 ceph-mon[101353]: pgmap v7821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:51.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:50 smithi159 ceph-mon[69013]: pgmap v7821: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:53.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:52 smithi096 ceph-mon[101353]: pgmap v7822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:52 smithi159 ceph-mon[69013]: pgmap v7822: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:54 smithi096 ceph-mon[101353]: pgmap v7823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:54 smithi159 ceph-mon[69013]: pgmap v7823: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:56 smithi096 ceph-mon[101353]: pgmap v7824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:56 smithi159 ceph-mon[69013]: pgmap v7824: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:42:58 smithi096 ceph-mon[101353]: pgmap v7825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:42:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:42:58 smithi159 ceph-mon[69013]: pgmap v7825: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:00 smithi096 ceph-mon[101353]: pgmap v7826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:01.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:00 smithi159 ceph-mon[69013]: pgmap v7826: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:02 smithi096 ceph-mon[101353]: pgmap v7827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:02 smithi159 ceph-mon[69013]: pgmap v7827: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:03.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.959+0000 7fc14e51e700 1 -- 172.21.15.96:0/3680151978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f5430 msgr2=0x7fc1480f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.959+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3680151978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f5430 0x7fc1480f5850 secure :-1 s=READY pgs=3995 cs=0 l=1 rev1=1 rx=0x7fc144004660 tx=0x7fc144009b30).stop 2022-02-02T22:43:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 -- 172.21.15.96:0/3680151978 shutdown_connections 2022-02-02T22:43:03.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3680151978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f66d0 0x7fc1480f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3680151978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f5430 0x7fc1480f5850 unknown :-1 s=CLOSED pgs=3995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 -- 172.21.15.96:0/3680151978 >> 172.21.15.96:0/3680151978 conn(0x7fc1480f0b90 msgr2=0x7fc1480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 -- 172.21.15.96:0/3680151978 shutdown_connections 2022-02-02T22:43:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 -- 172.21.15.96:0/3680151978 wait complete. 2022-02-02T22:43:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.960+0000 7fc14e51e700 1 Processor -- start 2022-02-02T22:43:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14e51e700 1 -- start start 2022-02-02T22:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14e51e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 0x7fc148109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14e51e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14e51e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480603e0 con 0x7fc1480f66d0 2022-02-02T22:43:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14e51e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148060520 con 0x7fc1480f5430 2022-02-02T22:43:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50010/0 (socket says 172.21.15.96:50010) 2022-02-02T22:43:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 -- 172.21.15.96:0/3713641331 learned_addr learned my addr 172.21.15.96:0/3713641331 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14d51c700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 0x7fc148109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 -- 172.21.15.96:0/3713641331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 msgr2=0x7fc148109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 0x7fc148109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 -- 172.21.15.96:0/3713641331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144005040 con 0x7fc1480f66d0 2022-02-02T22:43:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14d51c700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 0x7fc148109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:43:03.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.961+0000 7fc14cd1b700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 secure :-1 s=READY pgs=3996 cs=0 l=1 rev1=1 rx=0x7fc1380026d0 tx=0x7fc138009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:03.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.962+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc138009320 con 0x7fc1480f66d0 2022-02-02T22:43:03.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.962+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc13800f040 con 0x7fc1480f66d0 2022-02-02T22:43:03.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.962+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14810c540 con 0x7fc1480f66d0 2022-02-02T22:43:03.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.962+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1380147e0 con 0x7fc1480f66d0 2022-02-02T22:43:03.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.962+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14810cb00 con 0x7fc1480f66d0 2022-02-02T22:43:03.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.963+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc148045ad0 con 0x7fc1480f66d0 2022-02-02T22:43:03.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.963+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc138009480 con 0x7fc1480f66d0 2022-02-02T22:43:03.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.964+0000 7fc13dffb700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 0x7fc1340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:03.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.964+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc138082120 con 0x7fc1480f66d0 2022-02-02T22:43:03.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.964+0000 7fc14d51c700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 0x7fc1340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:03.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.965+0000 7fc14d51c700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 0x7fc1340672e0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 rx=0x7fc144004e30 tx=0x7fc144009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:03.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:03.968+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc138050220 con 0x7fc1480f66d0 2022-02-02T22:43:04.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.146+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc148057f10 con 0x7fc134064e20 2022-02-02T22:43:04.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.147+0000 7fc13dffb700 1 -- 172.21.15.96:0/3713641331 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc148057f10 con 0x7fc134064e20 2022-02-02T22:43:04.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 msgr2=0x7fc1340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 0x7fc1340672e0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 rx=0x7fc144004e30 tx=0x7fc144009b30).stop 2022-02-02T22:43:04.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 msgr2=0x7fc14810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 secure :-1 s=READY pgs=3996 cs=0 l=1 rev1=1 rx=0x7fc1380026d0 tx=0x7fc138009de0).stop 2022-02-02T22:43:04.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 shutdown_connections 2022-02-02T22:43:04.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc134064e20 0x7fc1340672e0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1480f5430 0x7fc148109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 --2- 172.21.15.96:0/3713641331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1480f66d0 0x7fc14810bf90 unknown :-1 s=CLOSED pgs=3996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 >> 172.21.15.96:0/3713641331 conn(0x7fc1480f0b90 msgr2=0x7fc1480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 shutdown_connections 2022-02-02T22:43:04.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.149+0000 7fc14e51e700 1 -- 172.21.15.96:0/3713641331 wait complete. 2022-02-02T22:43:04.158 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:43:04.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.245+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/2658532260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f7980 msgr2=0x7f7f480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.245+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/2658532260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f7980 0x7f7f480f7de0 secure :-1 s=READY pgs=3997 cs=0 l=1 rev1=1 rx=0x7f7f38004660 tx=0x7f7f38009b30).stop 2022-02-02T22:43:04.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/2658532260 shutdown_connections 2022-02-02T22:43:04.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/2658532260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f7980 0x7f7f480f7de0 unknown :-1 s=CLOSED pgs=3997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/2658532260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f66e0 0x7f7f480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:43:04.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/2658532260 >> 172.21.15.96:0/2658532260 conn(0x7f7f480f1e40 msgr2=0x7f7f480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/2658532260 shutdown_connections 2022-02-02T22:43:04.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.246+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/2658532260 wait complete. 2022-02-02T22:43:04.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 Processor -- start 2022-02-02T22:43:04.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 -- start start 2022-02-02T22:43:04.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 0x7f7f481074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48107ae0 con 0x7f7f480f66e0 2022-02-02T22:43:04.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4d0fb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48108390 con 0x7f7f480f7980 2022-02-02T22:43:04.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 0x7f7f481074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 0x7f7f481074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:54124/0 (socket says 172.21.15.96:54124) 2022-02-02T22:43:04.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50018/0 (socket says 172.21.15.96:50018) 2022-02-02T22:43:04.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.247+0000 7f7f4659c700 1 -- 172.21.15.96:0/3471136486 learned_addr learned my addr 172.21.15.96:0/3471136486 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:04.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f46d9d700 1 -- 172.21.15.96:0/3471136486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 msgr2=0x7f7f481074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f46d9d700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 0x7f7f481074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f46d9d700 1 -- 172.21.15.96:0/3471136486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38005040 con 0x7f7f480f66e0 2022-02-02T22:43:04.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f46d9d700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 secure :-1 s=READY pgs=3998 cs=0 l=1 rev1=1 rx=0x7f7f480f77e0 tx=0x7f7f30006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f30013640 con 0x7f7f480f66e0 2022-02-02T22:43:04.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f48108670 con 0x7f7f480f66e0 2022-02-02T22:43:04.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f30013c50 con 0x7f7f480f66e0 2022-02-02T22:43:04.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f30012be0 con 0x7f7f480f66e0 2022-02-02T22:43:04.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.248+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48108c30 con 0x7f7f480f66e0 2022-02-02T22:43:04.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.249+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f480f5ad0 con 0x7f7f480f66e0 2022-02-02T22:43:04.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.249+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7f3001a060 con 0x7f7f480f66e0 2022-02-02T22:43:04.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.250+0000 7f7f3f7fe700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 0x7f7f34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.250+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7f300819e0 con 0x7f7f480f66e0 2022-02-02T22:43:04.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.250+0000 7f7f4659c700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 0x7f7f34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.250+0000 7f7f4659c700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 0x7f7f34067290 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 rx=0x7f7f38004630 tx=0x7f7f38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.254+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7f300534b0 con 0x7f7f480f66e0 2022-02-02T22:43:04.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.425+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f480fefb0 con 0x7f7f34064dd0 2022-02-02T22:43:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.435+0000 7f7f3f7fe700 1 -- 172.21.15.96:0/3471136486 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7f480fefb0 con 0x7f7f34064dd0 2022-02-02T22:43:04.436 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:43:04.436 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:43:04.436 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:43:04.437 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:43:04.437 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:43:04.437 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:43:04.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:43:04.438 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:43:04.439 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:43:04.439 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:43:04.439 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:43:04.440 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:43:04.440 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:43:04.440 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:43:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:43:04.441 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:43:04.442 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:43:04.442 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:43:04.442 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:43:04.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:43:04.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:43:04.443 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.436+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 msgr2=0x7f7f34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.436+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 0x7f7f34067290 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 rx=0x7f7f38004630 tx=0x7f7f38009b30).stop 2022-02-02T22:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.436+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 msgr2=0x7f7f48106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 secure :-1 s=READY pgs=3998 cs=0 l=1 rev1=1 rx=0x7f7f480f77e0 tx=0x7f7f30006e30).stop 2022-02-02T22:43:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 shutdown_connections 2022-02-02T22:43:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7f34064dd0 0x7f7f34067290 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f480f66e0 0x7f7f48106fb0 unknown :-1 s=CLOSED pgs=3998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 --2- 172.21.15.96:0/3471136486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f480f7980 0x7f7f481074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 >> 172.21.15.96:0/3471136486 conn(0x7f7f480f1e40 msgr2=0x7f7f480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 shutdown_connections 2022-02-02T22:43:04.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.437+0000 7f7f4d0fb700 1 -- 172.21.15.96:0/3471136486 wait complete. 2022-02-02T22:43:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 -- 172.21.15.96:0/4263751878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f5bb0 msgr2=0x7f37700f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 --2- 172.21.15.96:0/4263751878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f5bb0 0x7f37700f5fd0 secure :-1 s=READY pgs=3999 cs=0 l=1 rev1=1 rx=0x7f3764004660 tx=0x7f3764009b30).stop 2022-02-02T22:43:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 -- 172.21.15.96:0/4263751878 shutdown_connections 2022-02-02T22:43:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 --2- 172.21.15.96:0/4263751878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f64c0 0x7f37700f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 --2- 172.21.15.96:0/4263751878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f5bb0 0x7f37700f5fd0 unknown :-1 s=CLOSED pgs=3999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 -- 172.21.15.96:0/4263751878 >> 172.21.15.96:0/4263751878 conn(0x7f37700f0540 msgr2=0x7f37700f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 -- 172.21.15.96:0/4263751878 shutdown_connections 2022-02-02T22:43:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 -- 172.21.15.96:0/4263751878 wait complete. 2022-02-02T22:43:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.533+0000 7f3775a1d700 1 Processor -- start 2022-02-02T22:43:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f3775a1d700 1 -- start start 2022-02-02T22:43:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f3775a1d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f5bb0 0x7f37700f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f3775a1d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f3775a1d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700f82a0 con 0x7f37700f64c0 2022-02-02T22:43:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f3775a1d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700f83e0 con 0x7f37700f5bb0 2022-02-02T22:43:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50030/0 (socket says 172.21.15.96:50030) 2022-02-02T22:43:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 -- 172.21.15.96:0/1006319734 learned_addr learned my addr 172.21.15.96:0/1006319734 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376effd700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f5bb0 0x7f37700f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 -- 172.21.15.96:0/1006319734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f5bb0 msgr2=0x7f37700f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f5bb0 0x7f37700f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 -- 172.21.15.96:0/1006319734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f37700f64c0 2022-02-02T22:43:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.534+0000 7f376e7fc700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 secure :-1 s=READY pgs=4000 cs=0 l=1 rev1=1 rx=0x7f376000c790 tx=0x7f3760007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.535+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376000e680 con 0x7f37700f64c0 2022-02-02T22:43:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.535+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37700f86c0 con 0x7f37700f64c0 2022-02-02T22:43:04.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.535+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f376000ec90 con 0x7f37700f64c0 2022-02-02T22:43:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.535+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3760013d60 con 0x7f37700f64c0 2022-02-02T22:43:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.535+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377010efb0 con 0x7f37700f64c0 2022-02-02T22:43:04.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.536+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3770045ad0 con 0x7f37700f64c0 2022-02-02T22:43:04.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.536+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f376001a060 con 0x7f37700f64c0 2022-02-02T22:43:04.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.537+0000 7f37577fe700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 0x7f3758067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.537+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3760081c90 con 0x7f37700f64c0 2022-02-02T22:43:04.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.537+0000 7f376effd700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 0x7f3758067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.537+0000 7f376effd700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 0x7f3758067290 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 rx=0x7f3764004e30 tx=0x7f3764009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.541+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f376004fd90 con 0x7f37700f64c0 2022-02-02T22:43:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.773+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f37700fdd90 con 0x7f37700f64c0 2022-02-02T22:43:04.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.773+0000 7f37577fe700 1 -- 172.21.15.96:0/1006319734 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3760018070 con 0x7f37700f64c0 2022-02-02T22:43:04.774 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:43:04.774 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:43:04.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:43:04.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:04.776 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:43:04.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:43:04.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:04.777 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:43:04.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:43:04.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:04.778 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:43:04.778 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:43:04.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:04.779 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:43:04.779 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:43:04.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:43:04.780 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:43:04.780 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:43:04.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 msgr2=0x7f3758067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 0x7f3758067290 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 rx=0x7f3764004e30 tx=0x7f3764009b30).stop 2022-02-02T22:43:04.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 msgr2=0x7f37700f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 secure :-1 s=READY pgs=4000 cs=0 l=1 rev1=1 rx=0x7f376000c790 tx=0x7f3760007d70).stop 2022-02-02T22:43:04.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 shutdown_connections 2022-02-02T22:43:04.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3758064dd0 0x7f3758067290 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37700f5bb0 0x7f37700f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 --2- 172.21.15.96:0/1006319734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37700f64c0 0x7f37700f7d40 unknown :-1 s=CLOSED pgs=4000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 >> 172.21.15.96:0/1006319734 conn(0x7f37700f0540 msgr2=0x7f37700f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.775+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 shutdown_connections 2022-02-02T22:43:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.776+0000 7f3775a1d700 1 -- 172.21.15.96:0/1006319734 wait complete. 2022-02-02T22:43:04.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 -- 172.21.15.96:0/3871803696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 msgr2=0x7f14580f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 --2- 172.21.15.96:0/3871803696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f14580f5860 secure :-1 s=READY pgs=4001 cs=0 l=1 rev1=1 rx=0x7f1454004660 tx=0x7f1454009b30).stop 2022-02-02T22:43:04.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 -- 172.21.15.96:0/3871803696 shutdown_connections 2022-02-02T22:43:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 --2- 172.21.15.96:0/3871803696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 0x7f14580f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 --2- 172.21.15.96:0/3871803696 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f14580f5860 unknown :-1 s=CLOSED pgs=4001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.873+0000 7f145e3f5700 1 -- 172.21.15.96:0/3871803696 >> 172.21.15.96:0/3871803696 conn(0x7f14580f0ba0 msgr2=0x7f14580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.874+0000 7f145e3f5700 1 -- 172.21.15.96:0/3871803696 shutdown_connections 2022-02-02T22:43:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.874+0000 7f145e3f5700 1 -- 172.21.15.96:0/3871803696 wait complete. 2022-02-02T22:43:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.874+0000 7f145e3f5700 1 Processor -- start 2022-02-02T22:43:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.874+0000 7f145e3f5700 1 -- start start 2022-02-02T22:43:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145e3f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145e3f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 0x7f1458106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145e3f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14581067e0 con 0x7f14580f5440 2022-02-02T22:43:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145e3f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458106fe0 con 0x7f14580f66e0 2022-02-02T22:43:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50038/0 (socket says 172.21.15.96:50038) 2022-02-02T22:43:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 -- 172.21.15.96:0/1317536992 learned_addr learned my addr 172.21.15.96:0/1317536992 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145cbf2700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 0x7f1458106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 -- 172.21.15.96:0/1317536992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 msgr2=0x7f1458106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 0x7f1458106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 -- 172.21.15.96:0/1317536992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454005040 con 0x7f14580f5440 2022-02-02T22:43:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145d3f3700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 secure :-1 s=READY pgs=4002 cs=0 l=1 rev1=1 rx=0x7f1454013a70 tx=0x7f1454009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1454018070 con 0x7f14580f5440 2022-02-02T22:43:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f14540097d0 con 0x7f14580f5440 2022-02-02T22:43:04.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458107260 con 0x7f14580f5440 2022-02-02T22:43:04.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.875+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145401c3c0 con 0x7f14580f5440 2022-02-02T22:43:04.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.876+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14581077c0 con 0x7f14580f5440 2022-02-02T22:43:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.877+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1454007ba0 con 0x7f14580f5440 2022-02-02T22:43:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.877+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1458059100 con 0x7f14580f5440 2022-02-02T22:43:04.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.877+0000 7f144dffb700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 0x7f14440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:04.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.877+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1454083800 con 0x7f14580f5440 2022-02-02T22:43:04.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.877+0000 7f145cbf2700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 0x7f14440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:04.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.878+0000 7f145cbf2700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 0x7f14440672e0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 rx=0x7f14480096c0 tx=0x7f1448009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:04.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:04.882+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1454055330 con 0x7f14580f5440 2022-02-02T22:43:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.082+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14580fdc50 con 0x7f14580f5440 2022-02-02T22:43:05.083 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:04 smithi096 ceph-mon[101353]: pgmap v7828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:05.084 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1006319734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:43:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.083+0000 7f144dffb700 1 -- 172.21.15.96:0/1317536992 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f1454054f20 con 0x7f14580f5440 2022-02-02T22:43:05.085 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:43:05.086 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:43:05.086 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:43:05.086 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:43:05.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:05.087 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:43:05.087 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:43:05.088 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:43:05.088 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:43:05.088 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:43:05.089 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:43:05.089 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:43:05.090 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:43:05.090 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:43:05.090 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:43:05.091 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:43:05.091 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:43:05.091 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:43:05.092 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:43:05.092 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:43:05.092 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:43:05.093 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:43:05.093 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:43:05.093 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:43:05.094 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:43:05.094 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:43:05.095 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:43:05.095 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:43:05.095 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:43:05.096 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:43:05.096 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:43:05.096 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:43:05.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:05.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:05.097 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:43:05.098 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:05.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:05.098 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:05.099 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:05.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 msgr2=0x7f14440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:05.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 0x7f14440672e0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 rx=0x7f14480096c0 tx=0x7f1448009be0).stop 2022-02-02T22:43:05.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 msgr2=0x7f1458105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:05.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 secure :-1 s=READY pgs=4002 cs=0 l=1 rev1=1 rx=0x7f1454013a70 tx=0x7f1454009b30).stop 2022-02-02T22:43:05.101 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 shutdown_connections 2022-02-02T22:43:05.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1444064e20 0x7f14440672e0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:05.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14580f5440 0x7f1458105d40 unknown :-1 s=CLOSED pgs=4002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:05.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 --2- 172.21.15.96:0/1317536992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14580f66e0 0x7f1458106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:05.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 >> 172.21.15.96:0/1317536992 conn(0x7f14580f0ba0 msgr2=0x7f14580fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:05.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 shutdown_connections 2022-02-02T22:43:05.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:05.085+0000 7f145e3f5700 1 -- 172.21.15.96:0/1317536992 wait complete. 2022-02-02T22:43:05.104 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:43:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:04 smithi159 ceph-mon[69013]: pgmap v7828: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1006319734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:43:06.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:05 smithi159 ceph-mon[69013]: from='client.42116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:06.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:05 smithi159 ceph-mon[69013]: from='client.42120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:06.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:05 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1317536992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:43:06.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:05 smithi096 ceph-mon[101353]: from='client.42116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:05 smithi096 ceph-mon[101353]: from='client.42120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:06.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:05 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1317536992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:43:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:06 smithi159 ceph-mon[69013]: pgmap v7829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:06 smithi096 ceph-mon[101353]: pgmap v7829: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:08 smithi159 ceph-mon[69013]: pgmap v7830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:08 smithi096 ceph-mon[101353]: pgmap v7830: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:10 smithi159 ceph-mon[69013]: pgmap v7831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:10 smithi096 ceph-mon[101353]: pgmap v7831: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:12 smithi096 ceph-mon[101353]: pgmap v7832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:12 smithi159 ceph-mon[69013]: pgmap v7832: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:14 smithi159 ceph-mon[69013]: pgmap v7833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:14 smithi096 ceph-mon[101353]: pgmap v7833: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:16 smithi159 ceph-mon[69013]: pgmap v7834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:16 smithi096 ceph-mon[101353]: pgmap v7834: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:18 smithi159 ceph-mon[69013]: pgmap v7835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:18 smithi096 ceph-mon[101353]: pgmap v7835: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:20 smithi159 ceph-mon[69013]: pgmap v7836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:20 smithi096 ceph-mon[101353]: pgmap v7836: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:22 smithi096 ceph-mon[101353]: pgmap v7837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:22 smithi159 ceph-mon[69013]: pgmap v7837: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:24 smithi159 ceph-mon[69013]: pgmap v7838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:24 smithi096 ceph-mon[101353]: pgmap v7838: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:26 smithi159 ceph-mon[69013]: pgmap v7839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:26 smithi096 ceph-mon[101353]: pgmap v7839: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:28 smithi159 ceph-mon[69013]: pgmap v7840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:43:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:43:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:28 smithi096 ceph-mon[101353]: pgmap v7840: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:43:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:43:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:30 smithi159 ceph-mon[69013]: pgmap v7841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:30 smithi096 ceph-mon[101353]: pgmap v7841: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:32 smithi096 ceph-mon[101353]: pgmap v7842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:32 smithi159 ceph-mon[69013]: pgmap v7842: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:35.195 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 -- 172.21.15.96:0/2964410154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f7980 msgr2=0x7fdc0c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 --2- 172.21.15.96:0/2964410154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f7980 0x7fdc0c0f7de0 secure :-1 s=READY pgs=4003 cs=0 l=1 rev1=1 rx=0x7fdc00004660 tx=0x7fdc00009b30).stop 2022-02-02T22:43:35.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 -- 172.21.15.96:0/2964410154 shutdown_connections 2022-02-02T22:43:35.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 --2- 172.21.15.96:0/2964410154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f7980 0x7fdc0c0f7de0 unknown :-1 s=CLOSED pgs=4003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.197 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 --2- 172.21.15.96:0/2964410154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 -- 172.21.15.96:0/2964410154 >> 172.21.15.96:0/2964410154 conn(0x7fdc0c0f1e40 msgr2=0x7fdc0c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:35.198 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:34 smithi096 ceph-mon[101353]: pgmap v7843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:35.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 -- 172.21.15.96:0/2964410154 shutdown_connections 2022-02-02T22:43:35.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.195+0000 7fdc1233b700 1 -- 172.21.15.96:0/2964410154 wait complete. 2022-02-02T22:43:35.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.196+0000 7fdc1233b700 1 Processor -- start 2022-02-02T22:43:35.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.196+0000 7fdc1233b700 1 -- start start 2022-02-02T22:43:35.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.196+0000 7fdc1233b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc1233b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c0f7980 0x7fdc0c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc1233b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c10abf0 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc1233b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c10ad30 con 0x7fdc0c0f7980 2022-02-02T22:43:35.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50056/0 (socket says 172.21.15.96:50056) 2022-02-02T22:43:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 -- 172.21.15.96:0/423737684 learned_addr learned my addr 172.21.15.96:0/423737684 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 -- 172.21.15.96:0/423737684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c0f7980 msgr2=0x7fdc0c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c0f7980 0x7fdc0c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:43:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 -- 172.21.15.96:0/423737684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00005040 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc0bfff700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 secure :-1 s=READY pgs=4004 cs=0 l=1 rev1=1 rx=0x7fdbfc00c530 tx=0x7fdbfc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc00f650 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c06a3d0 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdbfc00fc60 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c06a990 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.197+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc012ce0 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.198+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c045ad0 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.199+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdbfc019030 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.199+0000 7fdc08ff9700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 0x7fdbf4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.199+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdbfc0816e0 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.199+0000 7fdc0b7fe700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 0x7fdbf4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.200+0000 7fdc0b7fe700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 0x7fdbf4067290 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 rx=0x7fdc00004e30 tx=0x7fdc00009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.204+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdbfc04f810 con 0x7fdc0c0f66e0 2022-02-02T22:43:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:34 smithi159 ceph-mon[69013]: pgmap v7843: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.383+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc0c0fefb0 con 0x7fdbf4064dd0 2022-02-02T22:43:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.384+0000 7fdc08ff9700 1 -- 172.21.15.96:0/423737684 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdc0c0fefb0 con 0x7fdbf4064dd0 2022-02-02T22:43:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 msgr2=0x7fdbf4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 0x7fdbf4067290 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 rx=0x7fdc00004e30 tx=0x7fdc00009b30).stop 2022-02-02T22:43:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 msgr2=0x7fdc0c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 secure :-1 s=READY pgs=4004 cs=0 l=1 rev1=1 rx=0x7fdbfc00c530 tx=0x7fdbfc007e10).stop 2022-02-02T22:43:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 shutdown_connections 2022-02-02T22:43:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf4064dd0 0x7fdbf4067290 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0f66e0 0x7fdc0c06b9a0 unknown :-1 s=CLOSED pgs=4004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 --2- 172.21.15.96:0/423737684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c0f7980 0x7fdc0c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:43:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 >> 172.21.15.96:0/423737684 conn(0x7fdc0c0f1e40 msgr2=0x7fdc0c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 shutdown_connections 2022-02-02T22:43:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.386+0000 7fdc1233b700 1 -- 172.21.15.96:0/423737684 wait complete. 2022-02-02T22:43:35.395 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:43:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 -- 172.21.15.96:0/1689150779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f66e0 msgr2=0x7f38540f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 --2- 172.21.15.96:0/1689150779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f66e0 0x7f38540f6b00 secure :-1 s=READY pgs=4005 cs=0 l=1 rev1=1 rx=0x7f3844004660 tx=0x7f3844009b30).stop 2022-02-02T22:43:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 -- 172.21.15.96:0/1689150779 shutdown_connections 2022-02-02T22:43:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 --2- 172.21.15.96:0/1689150779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f7980 0x7f38540f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 --2- 172.21.15.96:0/1689150779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f66e0 0x7f38540f6b00 unknown :-1 s=CLOSED pgs=4005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 -- 172.21.15.96:0/1689150779 >> 172.21.15.96:0/1689150779 conn(0x7f38540f1e40 msgr2=0x7f38540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 -- 172.21.15.96:0/1689150779 shutdown_connections 2022-02-02T22:43:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.483+0000 7f3859218700 1 -- 172.21.15.96:0/1689150779 wait complete. 2022-02-02T22:43:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 Processor -- start 2022-02-02T22:43:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 -- start start 2022-02-02T22:43:35.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f66e0 0x7f385406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385406a380 con 0x7f38540f7980 2022-02-02T22:43:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3859218700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385406a4c0 con 0x7f38540f66e0 2022-02-02T22:43:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50068/0 (socket says 172.21.15.96:50068) 2022-02-02T22:43:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 -- 172.21.15.96:0/2294917924 learned_addr learned my addr 172.21.15.96:0/2294917924 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f3852d9d700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f66e0 0x7f385406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 -- 172.21.15.96:0/2294917924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f66e0 msgr2=0x7f385406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f66e0 0x7f385406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.484+0000 7f385259c700 1 -- 172.21.15.96:0/2294917924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844005040 con 0x7f38540f7980 2022-02-02T22:43:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f385259c700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 secure :-1 s=READY pgs=4006 cs=0 l=1 rev1=1 rx=0x7f38480026d0 tx=0x7f3848009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38480079c0 con 0x7f38540f7980 2022-02-02T22:43:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f384800f040 con 0x7f38540f7980 2022-02-02T22:43:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385406a7a0 con 0x7f38540f7980 2022-02-02T22:43:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38480148b0 con 0x7f38540f7980 2022-02-02T22:43:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.485+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385410efe0 con 0x7f38540f7980 2022-02-02T22:43:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.486+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3848007b20 con 0x7f38540f7980 2022-02-02T22:43:35.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.486+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854045ad0 con 0x7f38540f7980 2022-02-02T22:43:35.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.487+0000 7f383b7fe700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 0x7f383c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.487+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f38480818c0 con 0x7f38540f7980 2022-02-02T22:43:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.487+0000 7f3852d9d700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 0x7f383c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.487+0000 7f3852d9d700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 0x7f383c067290 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 rx=0x7f3844013690 tx=0x7f3844009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.491+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f384804f9c0 con 0x7f38540f7980 2022-02-02T22:43:35.662 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.662+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3854057f10 con 0x7f383c064dd0 2022-02-02T22:43:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.671+0000 7f383b7fe700 1 -- 172.21.15.96:0/2294917924 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3854057f10 con 0x7f383c064dd0 2022-02-02T22:43:35.671 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:43:35.672 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:43:35.672 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:43:35.673 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:43:35.673 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:43:35.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:43:35.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:43:35.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:43:35.674 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:43:35.675 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:43:35.675 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:43:35.675 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:43:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:43:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:43:35.676 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:43:35.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:43:35.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:43:35.677 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:43:35.678 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:43:35.678 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:43:35.679 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:43:35.679 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:43:35.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 msgr2=0x7f383c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 0x7f383c067290 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 rx=0x7f3844013690 tx=0x7f3844009b30).stop 2022-02-02T22:43:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 msgr2=0x7f3854069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 secure :-1 s=READY pgs=4006 cs=0 l=1 rev1=1 rx=0x7f38480026d0 tx=0x7f3848009de0).stop 2022-02-02T22:43:35.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 shutdown_connections 2022-02-02T22:43:35.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f383c064dd0 0x7f383c067290 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38540f66e0 0x7f385406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 --2- 172.21.15.96:0/2294917924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38540f7980 0x7f3854069e20 unknown :-1 s=CLOSED pgs=4006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 >> 172.21.15.96:0/2294917924 conn(0x7f38540f1e40 msgr2=0x7f38540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:35.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 shutdown_connections 2022-02-02T22:43:35.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.673+0000 7f3859218700 1 -- 172.21.15.96:0/2294917924 wait complete. 2022-02-02T22:43:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.769+0000 7fbb896c0700 1 -- 172.21.15.96:0/263093462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f5430 msgr2=0x7fbb840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.772 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.769+0000 7fbb896c0700 1 --2- 172.21.15.96:0/263093462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f5430 0x7fbb840f5850 secure :-1 s=READY pgs=4007 cs=0 l=1 rev1=1 rx=0x7fbb78004660 tx=0x7fbb78009b30).stop 2022-02-02T22:43:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 -- 172.21.15.96:0/263093462 shutdown_connections 2022-02-02T22:43:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 --2- 172.21.15.96:0/263093462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f66d0 0x7fbb840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 --2- 172.21.15.96:0/263093462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f5430 0x7fbb840f5850 unknown :-1 s=CLOSED pgs=4007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 -- 172.21.15.96:0/263093462 >> 172.21.15.96:0/263093462 conn(0x7fbb840f0b90 msgr2=0x7fbb840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 -- 172.21.15.96:0/263093462 shutdown_connections 2022-02-02T22:43:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 -- 172.21.15.96:0/263093462 wait complete. 2022-02-02T22:43:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 Processor -- start 2022-02-02T22:43:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.770+0000 7fbb896c0700 1 -- start start 2022-02-02T22:43:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb896c0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 0x7fbb84109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb896c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb896c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840603e0 con 0x7fbb840f66d0 2022-02-02T22:43:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb896c0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb84060520 con 0x7fbb840f5430 2022-02-02T22:43:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50076/0 (socket says 172.21.15.96:50076) 2022-02-02T22:43:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 -- 172.21.15.96:0/2789683357 learned_addr learned my addr 172.21.15.96:0/2789683357 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb83fff700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 0x7fbb84109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 -- 172.21.15.96:0/2789683357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 msgr2=0x7fbb84109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 0x7fbb84109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 -- 172.21.15.96:0/2789683357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78005040 con 0x7fbb840f66d0 2022-02-02T22:43:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb83fff700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 0x7fbb84109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:43:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb837fe700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 secure :-1 s=READY pgs=4008 cs=0 l=1 rev1=1 rx=0x7fbb7400c530 tx=0x7fbb74007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7400f650 con 0x7fbb840f66d0 2022-02-02T22:43:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb7400fc60 con 0x7fbb840f66d0 2022-02-02T22:43:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.771+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8410c540 con 0x7fbb840f66d0 2022-02-02T22:43:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.772+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8410cb00 con 0x7fbb840f66d0 2022-02-02T22:43:35.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.772+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb74012cd0 con 0x7fbb840f66d0 2022-02-02T22:43:35.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.773+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb64004fa0 con 0x7fbb840f66d0 2022-02-02T22:43:35.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.773+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb74010070 con 0x7fbb840f66d0 2022-02-02T22:43:35.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.773+0000 7fbb80ff9700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 0x7fbb6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:35.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.774+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbb740817e0 con 0x7fbb840f66d0 2022-02-02T22:43:35.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.774+0000 7fbb83fff700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 0x7fbb6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:35.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.774+0000 7fbb83fff700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 0x7fbb6c0672e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7fbb78004e30 tx=0x7fbb78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:35.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:35.778+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb7404f820 con 0x7fbb840f66d0 2022-02-02T22:43:36.008 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.008+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb64005e80 con 0x7fbb840f66d0 2022-02-02T22:43:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.009+0000 7fbb80ff9700 1 -- 172.21.15.96:0/2789683357 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbb7404f030 con 0x7fbb840f66d0 2022-02-02T22:43:36.009 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:43:36.010 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:43:36.010 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:43:36.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:36.011 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:43:36.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:43:36.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:36.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:43:36.012 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:43:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:43:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:43:36.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:43:36.014 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:43:36.015 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:43:36.015 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:43:36.015 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:43:36.016 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:43:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 msgr2=0x7fbb6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 0x7fbb6c0672e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7fbb78004e30 tx=0x7fbb78009b30).stop 2022-02-02T22:43:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 msgr2=0x7fbb8410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 secure :-1 s=READY pgs=4008 cs=0 l=1 rev1=1 rx=0x7fbb7400c530 tx=0x7fbb74007e20).stop 2022-02-02T22:43:36.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 shutdown_connections 2022-02-02T22:43:36.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbb6c064e20 0x7fbb6c0672e0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb840f5430 0x7fbb84109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 --2- 172.21.15.96:0/2789683357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb840f66d0 0x7fbb8410bf90 unknown :-1 s=CLOSED pgs=4008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.010+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 >> 172.21.15.96:0/2789683357 conn(0x7fbb840f0b90 msgr2=0x7fbb840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:36.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.011+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 shutdown_connections 2022-02-02T22:43:36.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.011+0000 7fbb896c0700 1 -- 172.21.15.96:0/2789683357 wait complete. 2022-02-02T22:43:36.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 -- 172.21.15.96:0/3327183882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 msgr2=0x7f2a3c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/3327183882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c0f6950 secure :-1 s=READY pgs=4009 cs=0 l=1 rev1=1 rx=0x7f2a2c004660 tx=0x7f2a2c009b30).stop 2022-02-02T22:43:36.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 -- 172.21.15.96:0/3327183882 shutdown_connections 2022-02-02T22:43:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/3327183882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/3327183882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c0f6950 unknown :-1 s=CLOSED pgs=4009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 -- 172.21.15.96:0/3327183882 >> 172.21.15.96:0/3327183882 conn(0x7f2a3c0f1c90 msgr2=0x7f2a3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 -- 172.21.15.96:0/3327183882 shutdown_connections 2022-02-02T22:43:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.108+0000 7f2a3b59e700 1 -- 172.21.15.96:0/3327183882 wait complete. 2022-02-02T22:43:36.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 Processor -- start 2022-02-02T22:43:36.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 -- start start 2022-02-02T22:43:36.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:36.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:36.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c06a380 con 0x7f2a3c0f6530 2022-02-02T22:43:36.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c06a4c0 con 0x7f2a3c0f77d0 2022-02-02T22:43:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50084/0 (socket says 172.21.15.96:50084) 2022-02-02T22:43:36.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 -- 172.21.15.96:0/1961294511 learned_addr learned my addr 172.21.15.96:0/1961294511 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:43:36.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a39d9b700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:36.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 -- 172.21.15.96:0/1961294511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 msgr2=0x7f2a3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a3a59c700 1 -- 172.21.15.96:0/1961294511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c005040 con 0x7f2a3c0f6530 2022-02-02T22:43:36.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.109+0000 7f2a39d9b700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:43:36.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a3a59c700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 secure :-1 s=READY pgs=4010 cs=0 l=1 rev1=1 rx=0x7f2a2c013a70 tx=0x7f2a2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:36.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c018070 con 0x7f2a3c0f6530 2022-02-02T22:43:36.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c06a740 con 0x7f2a3c0f6530 2022-02-02T22:43:36.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a2c0097d0 con 0x7f2a3c0f6530 2022-02-02T22:43:36.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c01c3c0 con 0x7f2a3c0f6530 2022-02-02T22:43:36.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.110+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c06aca0 con 0x7f2a3c0f6530 2022-02-02T22:43:36.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.111+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c045ad0 con 0x7f2a3c0f6530 2022-02-02T22:43:36.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.111+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a2c007ba0 con 0x7f2a3c0f6530 2022-02-02T22:43:36.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.112+0000 7f2a32ffd700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 0x7f2a280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:43:36.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.112+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2a2c083740 con 0x7f2a3c0f6530 2022-02-02T22:43:36.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.112+0000 7f2a39d9b700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 0x7f2a280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:43:36.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.112+0000 7f2a39d9b700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 0x7f2a280672e0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 rx=0x7f2a24009780 tx=0x7f2a24009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:43:36.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.116+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a2c051900 con 0x7f2a3c0f6530 2022-02-02T22:43:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.314+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a3c0fee00 con 0x7f2a3c0f6530 2022-02-02T22:43:36.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.315+0000 7f2a32ffd700 1 -- 172.21.15.96:0/1961294511 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2a2c054f20 con 0x7f2a3c0f6530 2022-02-02T22:43:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:43:36.317 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:43:36.318 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:43:36.318 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:43:36.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:36.320 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:43:36.320 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:43:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:43:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:43:36.321 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:43:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:43:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:43:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:43:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:43:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:43:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:43:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:43:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:43:36.325 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:43:36.325 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:43:36.325 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:43:36.326 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:43:36.326 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:43:36.326 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:43:36.327 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:43:36.327 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:43:36.327 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:43:36.328 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:43:36.328 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:43:36.328 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:43:36.329 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:43:36.329 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:43:36.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:36.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:36.330 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:43:36.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:43:36.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:36.331 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:36.332 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:43:36.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 msgr2=0x7f2a280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 0x7f2a280672e0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 rx=0x7f2a24009780 tx=0x7f2a24009c80).stop 2022-02-02T22:43:36.333 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 msgr2=0x7f2a3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:43:36.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 secure :-1 s=READY pgs=4010 cs=0 l=1 rev1=1 rx=0x7f2a2c013a70 tx=0x7f2a2c009b30).stop 2022-02-02T22:43:36.334 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 shutdown_connections 2022-02-02T22:43:36.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2a28064e20 0x7f2a280672e0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a3c0f6530 0x7f2a3c06b9a0 unknown :-1 s=CLOSED pgs=4010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.335 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 --2- 172.21.15.96:0/1961294511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0f77d0 0x7f2a3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:43:36.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 >> 172.21.15.96:0/1961294511 conn(0x7f2a3c0f1c90 msgr2=0x7f2a3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:43:36.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 shutdown_connections 2022-02-02T22:43:36.336 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:43:36.317+0000 7f2a3b59e700 1 -- 172.21.15.96:0/1961294511 wait complete. 2022-02-02T22:43:36.337 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:43:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:36 smithi159 ceph-mon[69013]: from='client.42132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:36 smithi159 ceph-mon[69013]: pgmap v7844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:36 smithi159 ceph-mon[69013]: from='client.42136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2789683357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:43:37.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:36 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1961294511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:43:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:36 smithi096 ceph-mon[101353]: from='client.42132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:36 smithi096 ceph-mon[101353]: pgmap v7844: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:36 smithi096 ceph-mon[101353]: from='client.42136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:43:37.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2789683357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:43:37.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:36 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1961294511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:43:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:38 smithi159 ceph-mon[69013]: pgmap v7845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:38 smithi096 ceph-mon[101353]: pgmap v7845: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:40 smithi159 ceph-mon[69013]: pgmap v7846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:40 smithi096 ceph-mon[101353]: pgmap v7846: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:42 smithi096 ceph-mon[101353]: pgmap v7847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:43.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:42 smithi159 ceph-mon[69013]: pgmap v7847: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:44 smithi159 ceph-mon[69013]: pgmap v7848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:44 smithi096 ceph-mon[101353]: pgmap v7848: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:46 smithi159 ceph-mon[69013]: pgmap v7849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:46 smithi096 ceph-mon[101353]: pgmap v7849: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:48 smithi159 ceph-mon[69013]: pgmap v7850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:48 smithi096 ceph-mon[101353]: pgmap v7850: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:50 smithi159 ceph-mon[69013]: pgmap v7851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:50 smithi096 ceph-mon[101353]: pgmap v7851: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:52 smithi096 ceph-mon[101353]: pgmap v7852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:53.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:52 smithi159 ceph-mon[69013]: pgmap v7852: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:54 smithi159 ceph-mon[69013]: pgmap v7853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:54 smithi096 ceph-mon[101353]: pgmap v7853: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:56 smithi159 ceph-mon[69013]: pgmap v7854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:56 smithi096 ceph-mon[101353]: pgmap v7854: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:43:58 smithi159 ceph-mon[69013]: pgmap v7855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:43:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:43:58 smithi096 ceph-mon[101353]: pgmap v7855: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:00 smithi159 ceph-mon[69013]: pgmap v7856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:00 smithi096 ceph-mon[101353]: pgmap v7856: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:02 smithi096 ceph-mon[101353]: pgmap v7857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:02 smithi159 ceph-mon[69013]: pgmap v7857: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:04 smithi159 ceph-mon[69013]: pgmap v7858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:04 smithi096 ceph-mon[101353]: pgmap v7858: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 -- 172.21.15.96:0/2117778182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f6530 msgr2=0x7f3c8c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/2117778182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c0f6950 secure :-1 s=READY pgs=4011 cs=0 l=1 rev1=1 rx=0x7f3c7c004660 tx=0x7f3c7c009b30).stop 2022-02-02T22:44:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 -- 172.21.15.96:0/2117778182 shutdown_connections 2022-02-02T22:44:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/2117778182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/2117778182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c0f6950 unknown :-1 s=CLOSED pgs=4011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 -- 172.21.15.96:0/2117778182 >> 172.21.15.96:0/2117778182 conn(0x7f3c8c0f1c90 msgr2=0x7f3c8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 -- 172.21.15.96:0/2117778182 shutdown_connections 2022-02-02T22:44:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.423+0000 7f3c90f7f700 1 -- 172.21.15.96:0/2117778182 wait complete. 2022-02-02T22:44:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 Processor -- start 2022-02-02T22:44:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 -- start start 2022-02-02T22:44:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c06a380 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.424+0000 7f3c90f7f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c06a4c0 con 0x7f3c8c0f6530 2022-02-02T22:44:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50102/0 (socket says 172.21.15.96:50102) 2022-02-02T22:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 -- 172.21.15.96:0/1701057016 learned_addr learned my addr 172.21.15.96:0/1701057016 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8b7fe700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 -- 172.21.15.96:0/1701057016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f6530 msgr2=0x7f3c8c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 -- 172.21.15.96:0/1701057016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c005040 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c8affd700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 secure :-1 s=READY pgs=4012 cs=0 l=1 rev1=1 rx=0x7f3c8000c530 tx=0x7f3c80007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8000f650 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c8000fc60 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c06a7a0 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c80012cd0 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.425+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c10edc0 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.426+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c045ad0 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.427+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c80010070 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.427+0000 7f3c73fff700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 0x7f3c740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.427+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3c80081870 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.427+0000 7f3c8b7fe700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 0x7f3c740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.428+0000 7f3c8b7fe700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 0x7f3c740672e0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f3c7c009da0 tx=0x7f3c7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:06.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.432+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c8004f8b0 con 0x7f3c8c0f77d0 2022-02-02T22:44:06.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.608+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c8c057f10 con 0x7f3c74064e20 2022-02-02T22:44:06.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.609+0000 7f3c73fff700 1 -- 172.21.15.96:0/1701057016 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3c8c057f10 con 0x7f3c74064e20 2022-02-02T22:44:06.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 msgr2=0x7f3c740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 0x7f3c740672e0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f3c7c009da0 tx=0x7f3c7c009b30).stop 2022-02-02T22:44:06.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 msgr2=0x7f3c8c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 secure :-1 s=READY pgs=4012 cs=0 l=1 rev1=1 rx=0x7f3c8000c530 tx=0x7f3c80007e20).stop 2022-02-02T22:44:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 shutdown_connections 2022-02-02T22:44:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3c74064e20 0x7f3c740672e0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c8c0f6530 0x7f3c8c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 --2- 172.21.15.96:0/1701057016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c8c0f77d0 0x7f3c8c069e20 unknown :-1 s=CLOSED pgs=4012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 >> 172.21.15.96:0/1701057016 conn(0x7f3c8c0f1c90 msgr2=0x7f3c8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 shutdown_connections 2022-02-02T22:44:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.611+0000 7f3c90f7f700 1 -- 172.21.15.96:0/1701057016 wait complete. 2022-02-02T22:44:06.621 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:44:06.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 -- 172.21.15.96:0/3952841823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f7980 msgr2=0x7f55a00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 --2- 172.21.15.96:0/3952841823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f7980 0x7f55a00f7de0 secure :-1 s=READY pgs=4013 cs=0 l=1 rev1=1 rx=0x7f5594004660 tx=0x7f5594009b30).stop 2022-02-02T22:44:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 -- 172.21.15.96:0/3952841823 shutdown_connections 2022-02-02T22:44:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 --2- 172.21.15.96:0/3952841823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f7980 0x7f55a00f7de0 unknown :-1 s=CLOSED pgs=4013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 --2- 172.21.15.96:0/3952841823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f66e0 0x7f55a00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 -- 172.21.15.96:0/3952841823 >> 172.21.15.96:0/3952841823 conn(0x7f55a00f1e40 msgr2=0x7f55a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:06.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 -- 172.21.15.96:0/3952841823 shutdown_connections 2022-02-02T22:44:06.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.712+0000 7f55a6a33700 1 -- 172.21.15.96:0/3952841823 wait complete. 2022-02-02T22:44:06.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 Processor -- start 2022-02-02T22:44:06.718 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 -- start start 2022-02-02T22:44:06.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f7980 0x7f55a0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006a380 con 0x7f55a00f66e0 2022-02-02T22:44:06.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.713+0000 7f55a6a33700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006a4c0 con 0x7f55a00f7980 2022-02-02T22:44:06.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50110/0 (socket says 172.21.15.96:50110) 2022-02-02T22:44:06.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 -- 172.21.15.96:0/1232195919 learned_addr learned my addr 172.21.15.96:0/1232195919 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:06.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559f7fe700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f7980 0x7f55a0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 -- 172.21.15.96:0/1232195919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f7980 msgr2=0x7f55a0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f7980 0x7f55a0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 -- 172.21.15.96:0/1232195919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594005040 con 0x7f55a00f66e0 2022-02-02T22:44:06.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559ffff700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 secure :-1 s=READY pgs=4014 cs=0 l=1 rev1=1 rx=0x7f5590002700 tx=0x7f5590009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5590009320 con 0x7f55a00f66e0 2022-02-02T22:44:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a006a7a0 con 0x7f55a00f66e0 2022-02-02T22:44:06.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f559000f040 con 0x7f55a00f66e0 2022-02-02T22:44:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5590014900 con 0x7f55a00f66e0 2022-02-02T22:44:06.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.714+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a010ef90 con 0x7f55a00f66e0 2022-02-02T22:44:06.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.715+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a0045ad0 con 0x7f55a00f66e0 2022-02-02T22:44:06.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.716+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5590009480 con 0x7f55a00f66e0 2022-02-02T22:44:06.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.716+0000 7f559cff9700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 0x7f5588067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.716+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5590081cc0 con 0x7f55a00f66e0 2022-02-02T22:44:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.716+0000 7f559f7fe700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 0x7f5588067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:06.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.717+0000 7f559f7fe700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 0x7f5588067290 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 rx=0x7f5594004630 tx=0x7f5594009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:06.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.721+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f559004fe80 con 0x7f55a00f66e0 2022-02-02T22:44:06.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.894+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a0057f10 con 0x7f5588064dd0 2022-02-02T22:44:06.904 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.904+0000 7f559cff9700 1 -- 172.21.15.96:0/1232195919 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f55a0057f10 con 0x7f5588064dd0 2022-02-02T22:44:06.905 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:44:06.906 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:44:06.906 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:44:06.907 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:44:06.907 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:44:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:44:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:44:06.908 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:44:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:44:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:44:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:44:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:44:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:44:06.910 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:44:06.911 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:44:06.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:44:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:44:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:44:06.912 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:44:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:44:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:44:06.913 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:44:06.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.905+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 msgr2=0x7f5588067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.905+0000 7f55a6a33700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 0x7f5588067290 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 rx=0x7f5594004630 tx=0x7f5594009b30).stop 2022-02-02T22:44:06.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.905+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 msgr2=0x7f55a006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:06.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.905+0000 7f55a6a33700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 secure :-1 s=READY pgs=4014 cs=0 l=1 rev1=1 rx=0x7f5590002700 tx=0x7f5590009d80).stop 2022-02-02T22:44:06.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 shutdown_connections 2022-02-02T22:44:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5588064dd0 0x7f5588067290 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55a00f66e0 0x7f55a006b9a0 unknown :-1 s=CLOSED pgs=4014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 --2- 172.21.15.96:0/1232195919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00f7980 0x7f55a0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:06.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 >> 172.21.15.96:0/1232195919 conn(0x7f55a00f1e40 msgr2=0x7f55a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:06.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 shutdown_connections 2022-02-02T22:44:06.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:06.906+0000 7f55a6a33700 1 -- 172.21.15.96:0/1232195919 wait complete. 2022-02-02T22:44:07.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 -- 172.21.15.96:0/1633111668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 msgr2=0x7f77440f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1633111668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f77440f7de0 secure :-1 s=READY pgs=4015 cs=0 l=1 rev1=1 rx=0x7f7738004660 tx=0x7f7738009b30).stop 2022-02-02T22:44:07.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 -- 172.21.15.96:0/1633111668 shutdown_connections 2022-02-02T22:44:07.004 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1633111668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f77440f7de0 unknown :-1 s=CLOSED pgs=4015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1633111668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 0x7f77440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.005 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 -- 172.21.15.96:0/1633111668 >> 172.21.15.96:0/1633111668 conn(0x7f77440f1e40 msgr2=0x7f77440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:07.006 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:06 smithi096 ceph-mon[101353]: pgmap v7859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 -- 172.21.15.96:0/1633111668 shutdown_connections 2022-02-02T22:44:07.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.003+0000 7f774a5e1700 1 -- 172.21.15.96:0/1633111668 wait complete. 2022-02-02T22:44:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 Processor -- start 2022-02-02T22:44:07.011 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 -- start start 2022-02-02T22:44:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 0x7f7744106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7744107a00 con 0x7f77440f7980 2022-02-02T22:44:07.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f774a5e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7744107b40 con 0x7f77440f66e0 2022-02-02T22:44:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.004+0000 7f77437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50122/0 (socket says 172.21.15.96:50122) 2022-02-02T22:44:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 -- 172.21.15.96:0/1124325624 learned_addr learned my addr 172.21.15.96:0/1124325624 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f7743fff700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 0x7f7744106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 -- 172.21.15.96:0/1124325624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 msgr2=0x7f7744106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 0x7f7744106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 -- 172.21.15.96:0/1124325624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738005040 con 0x7f77440f7980 2022-02-02T22:44:07.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f77437fe700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 secure :-1 s=READY pgs=4016 cs=0 l=1 rev1=1 rx=0x7f7738009990 tx=0x7f7738009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7738018070 con 0x7f77440f7980 2022-02-02T22:44:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7744108480 con 0x7f77440f7980 2022-02-02T22:44:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7738007ba0 con 0x7f77440f7980 2022-02-02T22:44:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773801c3c0 con 0x7f77440f7980 2022-02-02T22:44:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.005+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77441089e0 con 0x7f77440f7980 2022-02-02T22:44:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.006+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7744045ad0 con 0x7f77440f7980 2022-02-02T22:44:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.007+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f773801c680 con 0x7f77440f7980 2022-02-02T22:44:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.007+0000 7f7740ff9700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 0x7f772c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.007+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77380836d0 con 0x7f77440f7980 2022-02-02T22:44:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.007+0000 7f7743fff700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 0x7f772c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.007+0000 7f7743fff700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 0x7f772c067290 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7f77440f77e0 tx=0x7f773400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.011+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77380552c0 con 0x7f77440f7980 2022-02-02T22:44:07.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.242+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7744027a00 con 0x7f77440f7980 2022-02-02T22:44:07.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.243+0000 7f7740ff9700 1 -- 172.21.15.96:0/1124325624 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f7738054eb0 con 0x7f77440f7980 2022-02-02T22:44:07.244 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:44:07.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:44:07.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:44:07.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:07.245 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:44:07.246 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:44:07.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:07.246 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:44:07.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:44:07.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:07.247 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:44:07.248 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:44:07.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:07.248 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:44:07.249 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:44:07.249 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:44:07.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:44:07.250 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:44:07.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 msgr2=0x7f772c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 0x7f772c067290 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7f77440f77e0 tx=0x7f773400b040).stop 2022-02-02T22:44:07.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 msgr2=0x7f7744107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 secure :-1 s=READY pgs=4016 cs=0 l=1 rev1=1 rx=0x7f7738009990 tx=0x7f7738009b30).stop 2022-02-02T22:44:07.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 shutdown_connections 2022-02-02T22:44:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f772c064dd0 0x7f772c067290 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77440f66e0 0x7f7744106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 --2- 172.21.15.96:0/1124325624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77440f7980 0x7f7744107450 unknown :-1 s=CLOSED pgs=4016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 >> 172.21.15.96:0/1124325624 conn(0x7f77440f1e40 msgr2=0x7f77440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:07.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 shutdown_connections 2022-02-02T22:44:07.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.245+0000 7f774a5e1700 1 -- 172.21.15.96:0/1124325624 wait complete. 2022-02-02T22:44:07.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:06 smithi159 ceph-mon[69013]: pgmap v7859: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 -- 172.21.15.96:0/2206450979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f6860 msgr2=0x7fbbe80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 --2- 172.21.15.96:0/2206450979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f6860 0x7fbbe80f6cc0 secure :-1 s=READY pgs=4017 cs=0 l=1 rev1=1 rx=0x7fbbd8004660 tx=0x7fbbd8009b30).stop 2022-02-02T22:44:07.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 -- 172.21.15.96:0/2206450979 shutdown_connections 2022-02-02T22:44:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 --2- 172.21.15.96:0/2206450979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f6860 0x7fbbe80f6cc0 unknown :-1 s=CLOSED pgs=4017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 --2- 172.21.15.96:0/2206450979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f55c0 0x7fbbe80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:44:07.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 -- 172.21.15.96:0/2206450979 >> 172.21.15.96:0/2206450979 conn(0x7fbbe80f0d40 msgr2=0x7fbbe80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:07.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 -- 172.21.15.96:0/2206450979 shutdown_connections 2022-02-02T22:44:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.343+0000 7fbbed701700 1 -- 172.21.15.96:0/2206450979 wait complete. 2022-02-02T22:44:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 Processor -- start 2022-02-02T22:44:07.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 -- start start 2022-02-02T22:44:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f6860 0x7fbbe810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8060470 con 0x7fbbe80f55c0 2022-02-02T22:44:07.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.344+0000 7fbbed701700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80605b0 con 0x7fbbe80f6860 2022-02-02T22:44:07.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50130/0 (socket says 172.21.15.96:50130) 2022-02-02T22:44:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 -- 172.21.15.96:0/3351710148 learned_addr learned my addr 172.21.15.96:0/3351710148 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe67fc700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f6860 0x7fbbe810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 -- 172.21.15.96:0/3351710148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f6860 msgr2=0x7fbbe810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f6860 0x7fbbe810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 -- 172.21.15.96:0/3351710148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8005040 con 0x7fbbe80f55c0 2022-02-02T22:44:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbe6ffd700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 secure :-1 s=READY pgs=4018 cs=0 l=1 rev1=1 rx=0x7fbbdc0093f0 tx=0x7fbbdc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc009ea0 con 0x7fbbe80f55c0 2022-02-02T22:44:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbdc013af0 con 0x7fbbe80f55c0 2022-02-02T22:44:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe810c810 con 0x7fbbe80f55c0 2022-02-02T22:44:07.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc00db10 con 0x7fbbe80f55c0 2022-02-02T22:44:07.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.345+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe810cda0 con 0x7fbbe80f55c0 2022-02-02T22:44:07.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.346+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80f49b0 con 0x7fbbe80f55c0 2022-02-02T22:44:07.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.347+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbbdc01a060 con 0x7fbbe80f55c0 2022-02-02T22:44:07.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.347+0000 7fbbcf7fe700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 0x7fbbd0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:07.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.347+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbbdc081a90 con 0x7fbbe80f55c0 2022-02-02T22:44:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.347+0000 7fbbe67fc700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 0x7fbbd0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.347+0000 7fbbe67fc700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 0x7fbbd0067290 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 rx=0x7fbbd8004e30 tx=0x7fbbd8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.351+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbbdc04fb90 con 0x7fbbe80f55c0 2022-02-02T22:44:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.553+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbbe8045ad0 con 0x7fbbe80f55c0 2022-02-02T22:44:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.553+0000 7fbbcf7fe700 1 -- 172.21.15.96:0/3351710148 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbbdc018020 con 0x7fbbe80f55c0 2022-02-02T22:44:07.554 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:44:07.554 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:44:07.555 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:44:07.555 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:44:07.555 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:07.556 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:44:07.556 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:44:07.556 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:44:07.557 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:44:07.557 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:44:07.558 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:44:07.558 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:44:07.558 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:44:07.559 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:44:07.559 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:44:07.559 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:44:07.560 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:44:07.560 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:44:07.560 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:44:07.561 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:44:07.561 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:44:07.561 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:44:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:44:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:44:07.562 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:44:07.563 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:44:07.563 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:44:07.563 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:44:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:44:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:44:07.564 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:44:07.565 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:44:07.565 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:07.565 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:07.566 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:44:07.566 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:07.566 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:07.567 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:07.567 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 msgr2=0x7fbbd0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 0x7fbbd0067290 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 rx=0x7fbbd8004e30 tx=0x7fbbd8009b30).stop 2022-02-02T22:44:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 msgr2=0x7fbbe8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 secure :-1 s=READY pgs=4018 cs=0 l=1 rev1=1 rx=0x7fbbdc0093f0 tx=0x7fbbdc006ec0).stop 2022-02-02T22:44:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 shutdown_connections 2022-02-02T22:44:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbd0064dd0 0x7fbbd0067290 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe80f55c0 0x7fbbe8109cb0 unknown :-1 s=CLOSED pgs=4018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 --2- 172.21.15.96:0/3351710148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbe80f6860 0x7fbbe810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.556+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 >> 172.21.15.96:0/3351710148 conn(0x7fbbe80f0d40 msgr2=0x7fbbe80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.557+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 shutdown_connections 2022-02-02T22:44:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:07.557+0000 7fbbed701700 1 -- 172.21.15.96:0/3351710148 wait complete. 2022-02-02T22:44:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:44:08.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:07 smithi159 ceph-mon[69013]: from='client.42148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:08.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:07 smithi159 ceph-mon[69013]: from='client.42152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1124325624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:44:08.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:07 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3351710148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:44:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:07 smithi096 ceph-mon[101353]: from='client.42148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:08.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:07 smithi096 ceph-mon[101353]: from='client.42152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1124325624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:44:08.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:07 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3351710148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:44:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:08 smithi159 ceph-mon[69013]: pgmap v7860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:08 smithi096 ceph-mon[101353]: pgmap v7860: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:10 smithi159 ceph-mon[69013]: pgmap v7861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:10 smithi096 ceph-mon[101353]: pgmap v7861: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:12 smithi096 ceph-mon[101353]: pgmap v7862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:12 smithi159 ceph-mon[69013]: pgmap v7862: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:14 smithi159 ceph-mon[69013]: pgmap v7863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:14 smithi096 ceph-mon[101353]: pgmap v7863: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:16 smithi159 ceph-mon[69013]: pgmap v7864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:16 smithi096 ceph-mon[101353]: pgmap v7864: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:18 smithi159 ceph-mon[69013]: pgmap v7865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:18 smithi096 ceph-mon[101353]: pgmap v7865: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:20 smithi159 ceph-mon[69013]: pgmap v7866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:20 smithi096 ceph-mon[101353]: pgmap v7866: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:22 smithi096 ceph-mon[101353]: pgmap v7867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:22 smithi159 ceph-mon[69013]: pgmap v7867: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:24 smithi159 ceph-mon[69013]: pgmap v7868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:24 smithi096 ceph-mon[101353]: pgmap v7868: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:26 smithi159 ceph-mon[69013]: pgmap v7869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:26 smithi096 ceph-mon[101353]: pgmap v7869: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:44:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:44:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:44:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:44:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:28 smithi159 ceph-mon[69013]: pgmap v7870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:28 smithi096 ceph-mon[101353]: pgmap v7870: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:30 smithi159 ceph-mon[69013]: pgmap v7871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:30 smithi096 ceph-mon[101353]: pgmap v7871: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:32 smithi096 ceph-mon[101353]: pgmap v7872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:32 smithi159 ceph-mon[69013]: pgmap v7872: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:34 smithi159 ceph-mon[69013]: pgmap v7873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:34 smithi096 ceph-mon[101353]: pgmap v7873: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:36 smithi159 ceph-mon[69013]: pgmap v7874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:36 smithi096 ceph-mon[101353]: pgmap v7874: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:37.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.665+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3827883179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 msgr2=0x7fb9cc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.665+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3827883179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc0f6950 secure :-1 s=READY pgs=4019 cs=0 l=1 rev1=1 rx=0x7fb9c0004660 tx=0x7fb9c0009b30).stop 2022-02-02T22:44:37.668 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3827883179 shutdown_connections 2022-02-02T22:44:37.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3827883179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 0x7fb9cc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3827883179 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc0f6950 unknown :-1 s=CLOSED pgs=4019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3827883179 >> 172.21.15.96:0/3827883179 conn(0x7fb9cc0f1c90 msgr2=0x7fb9cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:37.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3827883179 shutdown_connections 2022-02-02T22:44:37.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3827883179 wait complete. 2022-02-02T22:44:37.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 Processor -- start 2022-02-02T22:44:37.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.666+0000 7fb9d1d42700 1 -- start start 2022-02-02T22:44:37.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d1d42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d1d42700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 0x7fb9cc1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d1d42700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc1078f0 con 0x7fb9cc0f6530 2022-02-02T22:44:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d1d42700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc108100 con 0x7fb9cc0f77d0 2022-02-02T22:44:37.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50148/0 (socket says 172.21.15.96:50148) 2022-02-02T22:44:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 -- 172.21.15.96:0/3229827856 learned_addr learned my addr 172.21.15.96:0/3229827856 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:37.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9cbfff700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 0x7fb9cc1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 -- 172.21.15.96:0/3229827856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 msgr2=0x7fb9cc1072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 0x7fb9cc1072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 -- 172.21.15.96:0/3229827856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0005040 con 0x7fb9cc0f6530 2022-02-02T22:44:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.667+0000 7fb9d0d40700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 secure :-1 s=READY pgs=4020 cs=0 l=1 rev1=1 rx=0x7fb9c0004f60 tx=0x7fb9c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.668+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c0018070 con 0x7fb9cc0f6530 2022-02-02T22:44:37.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.668+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9c0007ba0 con 0x7fb9cc0f6530 2022-02-02T22:44:37.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.668+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc108320 con 0x7fb9cc0f6530 2022-02-02T22:44:37.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.668+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c001c620 con 0x7fb9cc0f6530 2022-02-02T22:44:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.668+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc108880 con 0x7fb9cc0f6530 2022-02-02T22:44:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.669+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc059100 con 0x7fb9cc0f6530 2022-02-02T22:44:37.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.669+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9c001c8e0 con 0x7fb9cc0f6530 2022-02-02T22:44:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.670+0000 7fb9c97fa700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 0x7fb9bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.670+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9c0083960 con 0x7fb9cc0f6530 2022-02-02T22:44:37.680 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.670+0000 7fb9cbfff700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 0x7fb9bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.670+0000 7fb9cbfff700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 0x7fb9bc0672e0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 rx=0x7fb9b80041d0 tx=0x7fb9b8009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:37.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.674+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9c0051a60 con 0x7fb9cc0f6530 2022-02-02T22:44:37.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.853+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9cc0008d0 con 0x7fb9bc064e20 2022-02-02T22:44:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.854+0000 7fb9c97fa700 1 -- 172.21.15.96:0/3229827856 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb9cc0008d0 con 0x7fb9bc064e20 2022-02-02T22:44:37.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 msgr2=0x7fb9bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 0x7fb9bc0672e0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 rx=0x7fb9b80041d0 tx=0x7fb9b8009040).stop 2022-02-02T22:44:37.858 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 msgr2=0x7fb9cc106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 secure :-1 s=READY pgs=4020 cs=0 l=1 rev1=1 rx=0x7fb9c0004f60 tx=0x7fb9c0009b30).stop 2022-02-02T22:44:37.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 shutdown_connections 2022-02-02T22:44:37.859 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb9bc064e20 0x7fb9bc0672e0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9cc0f6530 0x7fb9cc106e00 unknown :-1 s=CLOSED pgs=4020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.856+0000 7fb9d1d42700 1 --2- 172.21.15.96:0/3229827856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9cc0f77d0 0x7fb9cc1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.860 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.857+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 >> 172.21.15.96:0/3229827856 conn(0x7fb9cc0f1c90 msgr2=0x7fb9cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:37.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.857+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 shutdown_connections 2022-02-02T22:44:37.861 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.857+0000 7fb9d1d42700 1 -- 172.21.15.96:0/3229827856 wait complete. 2022-02-02T22:44:37.867 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:44:37.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 -- 172.21.15.96:0/2620382518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 msgr2=0x7f84080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 --2- 172.21.15.96:0/2620382518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f84080f7de0 secure :-1 s=READY pgs=4021 cs=0 l=1 rev1=1 rx=0x7f83f8004660 tx=0x7f83f8009b30).stop 2022-02-02T22:44:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 -- 172.21.15.96:0/2620382518 shutdown_connections 2022-02-02T22:44:37.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 --2- 172.21.15.96:0/2620382518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f84080f7de0 unknown :-1 s=CLOSED pgs=4021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 --2- 172.21.15.96:0/2620382518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 0x7f84080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 -- 172.21.15.96:0/2620382518 >> 172.21.15.96:0/2620382518 conn(0x7f84080f1e40 msgr2=0x7f84080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:37.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 -- 172.21.15.96:0/2620382518 shutdown_connections 2022-02-02T22:44:37.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 -- 172.21.15.96:0/2620382518 wait complete. 2022-02-02T22:44:37.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.954+0000 7f840df21700 1 Processor -- start 2022-02-02T22:44:37.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f840df21700 1 -- start start 2022-02-02T22:44:37.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f840df21700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 0x7f8408106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f840df21700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f840df21700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081079b0 con 0x7f84080f7980 2022-02-02T22:44:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f840df21700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408107af0 con 0x7f84080f66e0 2022-02-02T22:44:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50160/0 (socket says 172.21.15.96:50160) 2022-02-02T22:44:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 -- 172.21.15.96:0/3758808091 learned_addr learned my addr 172.21.15.96:0/3758808091 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f84077fe700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 0x7f8408106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 -- 172.21.15.96:0/3758808091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 msgr2=0x7f8408106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 0x7f8408106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.955+0000 7f8406ffd700 1 -- 172.21.15.96:0/3758808091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8005040 con 0x7f84080f7980 2022-02-02T22:44:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f8406ffd700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 secure :-1 s=READY pgs=4022 cs=0 l=1 rev1=1 rx=0x7f83f8000c00 tx=0x7f83f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f8019070 con 0x7f84080f7980 2022-02-02T22:44:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8408108430 con 0x7f84080f7980 2022-02-02T22:44:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83f8007e70 con 0x7f84080f7980 2022-02-02T22:44:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f8014ce0 con 0x7f84080f7980 2022-02-02T22:44:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.956+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8408108990 con 0x7f84080f7980 2022-02-02T22:44:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.957+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8408045ad0 con 0x7f84080f7980 2022-02-02T22:44:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.957+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83f8025070 con 0x7f84080f7980 2022-02-02T22:44:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.958+0000 7f83effff700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 0x7f83f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.958+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83f80829a0 con 0x7f84080f7980 2022-02-02T22:44:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.958+0000 7f84077fe700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 0x7f83f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.958+0000 7f84077fe700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 0x7f83f0067290 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 rx=0x7f83fc009fd0 tx=0x7f83fc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:37.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:37.962+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83f80544d0 con 0x7f84080f7980 2022-02-02T22:44:38.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.135+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8408108bb0 con 0x7f83f0064dd0 2022-02-02T22:44:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.145+0000 7f83effff700 1 -- 172.21.15.96:0/3758808091 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8408108bb0 con 0x7f83f0064dd0 2022-02-02T22:44:38.146 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:44:38.146 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:44:38.147 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:44:38.147 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:44:38.147 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:44:38.148 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:44:38.148 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:44:38.148 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:44:38.149 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:44:38.149 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:44:38.149 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:44:38.150 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:44:38.150 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:44:38.150 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:44:38.151 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:44:38.151 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:44:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:44:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:44:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:44:38.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:44:38.153 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:44:38.153 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:44:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 msgr2=0x7f83f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 0x7f83f0067290 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 rx=0x7f83fc009fd0 tx=0x7f83fc00b040).stop 2022-02-02T22:44:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 msgr2=0x7f8408107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 secure :-1 s=READY pgs=4022 cs=0 l=1 rev1=1 rx=0x7f83f8000c00 tx=0x7f83f800b040).stop 2022-02-02T22:44:38.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 shutdown_connections 2022-02-02T22:44:38.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f0064dd0 0x7f83f0067290 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84080f66e0 0x7f8408106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 --2- 172.21.15.96:0/3758808091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84080f7980 0x7f8408107400 unknown :-1 s=CLOSED pgs=4022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 >> 172.21.15.96:0/3758808091 conn(0x7f84080f1e40 msgr2=0x7f84080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:38.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.146+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 shutdown_connections 2022-02-02T22:44:38.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.147+0000 7f840df21700 1 -- 172.21.15.96:0/3758808091 wait complete. 2022-02-02T22:44:38.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 -- 172.21.15.96:0/3468239873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 msgr2=0x7f88f00f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 --2- 172.21.15.96:0/3468239873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f00f7dd0 secure :-1 s=READY pgs=4023 cs=0 l=1 rev1=1 rx=0x7f88ec004660 tx=0x7f88ec009b30).stop 2022-02-02T22:44:38.244 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 -- 172.21.15.96:0/3468239873 shutdown_connections 2022-02-02T22:44:38.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 --2- 172.21.15.96:0/3468239873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f00f7dd0 unknown :-1 s=CLOSED pgs=4023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 --2- 172.21.15.96:0/3468239873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 0x7f88f00f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 -- 172.21.15.96:0/3468239873 >> 172.21.15.96:0/3468239873 conn(0x7f88f00f1e10 msgr2=0x7f88f00f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:38.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 -- 172.21.15.96:0/3468239873 shutdown_connections 2022-02-02T22:44:38.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.242+0000 7f88f8397700 1 -- 172.21.15.96:0/3468239873 wait complete. 2022-02-02T22:44:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 Processor -- start 2022-02-02T22:44:38.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 -- start start 2022-02-02T22:44:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 0x7f88f0106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.250 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01079f0 con 0x7f88f00f7970 2022-02-02T22:44:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f8397700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0107b30 con 0x7f88f00f66d0 2022-02-02T22:44:38.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f5932700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f5932700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50170/0 (socket says 172.21.15.96:50170) 2022-02-02T22:44:38.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f5932700 1 -- 172.21.15.96:0/2382314453 learned_addr learned my addr 172.21.15.96:0/2382314453 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:38.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.243+0000 7f88f6133700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 0x7f88f0106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f5932700 1 -- 172.21.15.96:0/2382314453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 msgr2=0x7f88f0106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f5932700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 0x7f88f0106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f5932700 1 -- 172.21.15.96:0/2382314453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec005040 con 0x7f88f00f7970 2022-02-02T22:44:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f5932700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 secure :-1 s=READY pgs=4024 cs=0 l=1 rev1=1 rx=0x7f88ec009990 tx=0x7f88ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ec018070 con 0x7f88f00f7970 2022-02-02T22:44:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88ec007ba0 con 0x7f88f00f7970 2022-02-02T22:44:38.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f0108470 con 0x7f88f00f7970 2022-02-02T22:44:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ec01c3c0 con 0x7f88f00f7970 2022-02-02T22:44:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.244+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f01089d0 con 0x7f88f00f7970 2022-02-02T22:44:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.245+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f88ec01d420 con 0x7f88f00f7970 2022-02-02T22:44:38.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.246+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0045ad0 con 0x7f88f00f7970 2022-02-02T22:44:38.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.246+0000 7f88e2ffd700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 0x7f88dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.246+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f88ec0836a0 con 0x7f88f00f7970 2022-02-02T22:44:38.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.246+0000 7f88f6133700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 0x7f88dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.246+0000 7f88f6133700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 0x7f88dc067290 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7f88f00f77d0 tx=0x7f88e400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.250+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f88ec055290 con 0x7f88f00f7970 2022-02-02T22:44:38.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.480+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88f0027a00 con 0x7f88f00f7970 2022-02-02T22:44:38.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.480+0000 7f88e2ffd700 1 -- 172.21.15.96:0/2382314453 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f88ec054e80 con 0x7f88f00f7970 2022-02-02T22:44:38.482 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:44:38.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:44:38.483 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:44:38.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:38.484 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:44:38.484 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:44:38.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:38.485 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:44:38.485 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:44:38.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:38.486 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:44:38.486 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:44:38.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:44:38.487 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:44:38.487 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:44:38.488 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:44:38.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:44:38.488 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:44:38.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 msgr2=0x7f88dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 0x7f88dc067290 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7f88f00f77d0 tx=0x7f88e400b040).stop 2022-02-02T22:44:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 msgr2=0x7f88f0107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 secure :-1 s=READY pgs=4024 cs=0 l=1 rev1=1 rx=0x7f88ec009990 tx=0x7f88ec009b30).stop 2022-02-02T22:44:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 shutdown_connections 2022-02-02T22:44:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f88dc064dd0 0x7f88dc067290 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88f00f66d0 0x7f88f0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 --2- 172.21.15.96:0/2382314453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88f00f7970 0x7f88f0107440 unknown :-1 s=CLOSED pgs=4024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 >> 172.21.15.96:0/2382314453 conn(0x7f88f00f1e10 msgr2=0x7f88f00fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:38.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 shutdown_connections 2022-02-02T22:44:38.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.483+0000 7f88f8397700 1 -- 172.21.15.96:0/2382314453 wait complete. 2022-02-02T22:44:38.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 -- 172.21.15.96:0/3825128611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f6860 msgr2=0x7f2da40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 --2- 172.21.15.96:0/3825128611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f6860 0x7f2da40f6cc0 secure :-1 s=READY pgs=4025 cs=0 l=1 rev1=1 rx=0x7f2da0004660 tx=0x7f2da0009b30).stop 2022-02-02T22:44:38.584 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 -- 172.21.15.96:0/3825128611 shutdown_connections 2022-02-02T22:44:38.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 --2- 172.21.15.96:0/3825128611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f6860 0x7f2da40f6cc0 unknown :-1 s=CLOSED pgs=4025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 --2- 172.21.15.96:0/3825128611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f55c0 0x7f2da40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.585 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 -- 172.21.15.96:0/3825128611 >> 172.21.15.96:0/3825128611 conn(0x7f2da40f0d40 msgr2=0x7f2da40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 -- 172.21.15.96:0/3825128611 shutdown_connections 2022-02-02T22:44:38.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.580+0000 7f2dac52a700 1 -- 172.21.15.96:0/3825128611 wait complete. 2022-02-02T22:44:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 Processor -- start 2022-02-02T22:44:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 -- start start 2022-02-02T22:44:38.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 0x7f2da410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da40603c0 con 0x7f2da40f55c0 2022-02-02T22:44:38.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2dac52a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4060500 con 0x7f2da40f6860 2022-02-02T22:44:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2daa2c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2daa2c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50176/0 (socket says 172.21.15.96:50176) 2022-02-02T22:44:38.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2daa2c6700 1 -- 172.21.15.96:0/2801268490 learned_addr learned my addr 172.21.15.96:0/2801268490 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:44:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.581+0000 7f2da9ac5700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 0x7f2da410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2daa2c6700 1 -- 172.21.15.96:0/2801268490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 msgr2=0x7f2da410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2daa2c6700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 0x7f2da410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2daa2c6700 1 -- 172.21.15.96:0/2801268490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0005040 con 0x7f2da40f55c0 2022-02-02T22:44:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2da9ac5700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 0x7f2da410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:44:38.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2daa2c6700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 secure :-1 s=READY pgs=4026 cs=0 l=1 rev1=1 rx=0x7f2d94002700 tx=0x7f2d94009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d94009320 con 0x7f2da40f55c0 2022-02-02T22:44:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d9400f040 con 0x7f2da40f55c0 2022-02-02T22:44:38.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da410c720 con 0x7f2da40f55c0 2022-02-02T22:44:38.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d94014900 con 0x7f2da40f55c0 2022-02-02T22:44:38.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.582+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da410ccb0 con 0x7f2da40f55c0 2022-02-02T22:44:38.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.583+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da4045ad0 con 0x7f2da40f55c0 2022-02-02T22:44:38.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.584+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d94009480 con 0x7f2da40f55c0 2022-02-02T22:44:38.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.584+0000 7f2d9affd700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 0x7f2d90067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:44:38.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.584+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2d94081de0 con 0x7f2da40f55c0 2022-02-02T22:44:38.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.584+0000 7f2da9ac5700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 0x7f2d90067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:44:38.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.585+0000 7f2da9ac5700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 0x7f2d90067270 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 rx=0x7f2da0004630 tx=0x7f2da0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:44:38.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.588+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d9404fee0 con 0x7f2da40f55c0 2022-02-02T22:44:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.789+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2da40586e0 con 0x7f2da40f55c0 2022-02-02T22:44:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.789+0000 7f2d9affd700 1 -- 172.21.15.96:0/2801268490 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f2d94053500 con 0x7f2da40f55c0 2022-02-02T22:44:38.791 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:44:38.792 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:44:38.792 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:44:38.792 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:44:38.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:38.793 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:44:38.793 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:44:38.794 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:44:38.794 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:44:38.794 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:44:38.795 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:44:38.795 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:44:38.796 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:44:38.796 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:44:38.796 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:44:38.797 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:44:38.797 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:44:38.797 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:44:38.798 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:44:38.798 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:44:38.798 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:44:38.799 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:44:38.799 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:44:38.799 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:44:38.800 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:44:38.800 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:44:38.800 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:44:38.801 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:44:38.801 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:44:38.801 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:44:38.802 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:44:38.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:44:38.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:38.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:38.803 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:44:38.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:44:38.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:38.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:38.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:44:38.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 msgr2=0x7f2d90067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 0x7f2d90067270 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 rx=0x7f2da0004630 tx=0x7f2da0009b30).stop 2022-02-02T22:44:38.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 msgr2=0x7f2da4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:44:38.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 secure :-1 s=READY pgs=4026 cs=0 l=1 rev1=1 rx=0x7f2d94002700 tx=0x7f2d94009d80).stop 2022-02-02T22:44:38.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 shutdown_connections 2022-02-02T22:44:38.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2d90064db0 0x7f2d90067270 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da40f55c0 0x7f2da4109c70 unknown :-1 s=CLOSED pgs=4026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 --2- 172.21.15.96:0/2801268490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da40f6860 0x7f2da410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:44:38.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.791+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 >> 172.21.15.96:0/2801268490 conn(0x7f2da40f0d40 msgr2=0x7f2da40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:44:38.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.792+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 shutdown_connections 2022-02-02T22:44:38.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:44:38.792+0000 7f2dac52a700 1 -- 172.21.15.96:0/2801268490 wait complete. 2022-02-02T22:44:38.810 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:44:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:38 smithi159 ceph-mon[69013]: pgmap v7875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:38 smithi159 ceph-mon[69013]: from='client.42164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:39.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2382314453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:44:39.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:38 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2801268490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:44:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:38 smithi096 ceph-mon[101353]: pgmap v7875: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:39.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:38 smithi096 ceph-mon[101353]: from='client.42164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:39.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2382314453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:44:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:38 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2801268490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:44:40.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:39 smithi159 ceph-mon[69013]: from='client.42168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:39 smithi096 ceph-mon[101353]: from='client.42168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:44:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:40 smithi159 ceph-mon[69013]: pgmap v7876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:40 smithi096 ceph-mon[101353]: pgmap v7876: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:42 smithi096 ceph-mon[101353]: pgmap v7877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:43.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:42 smithi159 ceph-mon[69013]: pgmap v7877: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:44 smithi159 ceph-mon[69013]: pgmap v7878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:44 smithi096 ceph-mon[101353]: pgmap v7878: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:46 smithi159 ceph-mon[69013]: pgmap v7879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:46 smithi096 ceph-mon[101353]: pgmap v7879: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:48 smithi159 ceph-mon[69013]: pgmap v7880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:48 smithi096 ceph-mon[101353]: pgmap v7880: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:50 smithi159 ceph-mon[69013]: pgmap v7881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:50 smithi096 ceph-mon[101353]: pgmap v7881: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:53 smithi159 ceph-mon[69013]: pgmap v7882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:53.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:53 smithi096 ceph-mon[101353]: pgmap v7882: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:55 smithi159 ceph-mon[69013]: pgmap v7883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:55 smithi096 ceph-mon[101353]: pgmap v7883: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:57 smithi159 ceph-mon[69013]: pgmap v7884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:57 smithi096 ceph-mon[101353]: pgmap v7884: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:44:59 smithi159 ceph-mon[69013]: pgmap v7885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:44:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:44:59 smithi096 ceph-mon[101353]: pgmap v7885: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:01 smithi159 ceph-mon[69013]: pgmap v7886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:01 smithi096 ceph-mon[101353]: pgmap v7886: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:03 smithi159 ceph-mon[69013]: pgmap v7887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:03.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:03 smithi096 ceph-mon[101353]: pgmap v7887: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:05 smithi159 ceph-mon[69013]: pgmap v7888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:05 smithi096 ceph-mon[101353]: pgmap v7888: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:07 smithi096 ceph-mon[101353]: pgmap v7889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:07 smithi159 ceph-mon[69013]: pgmap v7889: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:08.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 -- 172.21.15.96:0/79183652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f6860 msgr2=0x7fe07c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:08.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 --2- 172.21.15.96:0/79183652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f6860 0x7fe07c0f6cc0 secure :-1 s=READY pgs=4027 cs=0 l=1 rev1=1 rx=0x7fe06c004660 tx=0x7fe06c009b30).stop 2022-02-02T22:45:08.905 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 -- 172.21.15.96:0/79183652 shutdown_connections 2022-02-02T22:45:08.906 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 --2- 172.21.15.96:0/79183652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f6860 0x7fe07c0f6cc0 unknown :-1 s=CLOSED pgs=4027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:08.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 --2- 172.21.15.96:0/79183652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f55c0 0x7fe07c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:08.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.902+0000 7fe08380e700 1 -- 172.21.15.96:0/79183652 >> 172.21.15.96:0/79183652 conn(0x7fe07c0f0d40 msgr2=0x7fe07c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:08.907 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.903+0000 7fe08380e700 1 -- 172.21.15.96:0/79183652 shutdown_connections 2022-02-02T22:45:08.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.903+0000 7fe08380e700 1 -- 172.21.15.96:0/79183652 wait complete. 2022-02-02T22:45:08.908 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.903+0000 7fe08380e700 1 Processor -- start 2022-02-02T22:45:08.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.903+0000 7fe08380e700 1 -- start start 2022-02-02T22:45:08.909 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe08380e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:08.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe08380e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 0x7fe07c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:08.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe08380e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1069b0 con 0x7fe07c0f55c0 2022-02-02T22:45:08.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe08380e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1071c0 con 0x7fe07c0f6860 2022-02-02T22:45:08.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:08.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50194/0 (socket says 172.21.15.96:50194) 2022-02-02T22:45:08.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 -- 172.21.15.96:0/2895682969 learned_addr learned my addr 172.21.15.96:0/2895682969 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:08.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe080da9700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 0x7fe07c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:08.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 -- 172.21.15.96:0/2895682969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 msgr2=0x7fe07c1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:08.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 0x7fe07c1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:08.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 -- 172.21.15.96:0/2895682969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c005040 con 0x7fe07c0f55c0 2022-02-02T22:45:08.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe080da9700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 0x7fe07c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:45:08.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe0815aa700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 secure :-1 s=READY pgs=4028 cs=0 l=1 rev1=1 rx=0x7fe07800c530 tx=0x7fe078007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:08.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07800f650 con 0x7fe07c0f55c0 2022-02-02T22:45:08.914 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c107440 con 0x7fe07c0f55c0 2022-02-02T22:45:08.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe07800fc60 con 0x7fe07c0f55c0 2022-02-02T22:45:08.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.904+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe078012d20 con 0x7fe07c0f55c0 2022-02-02T22:45:08.915 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.905+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c107a00 con 0x7fe07c0f55c0 2022-02-02T22:45:08.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.906+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c0f49b0 con 0x7fe07c0f55c0 2022-02-02T22:45:08.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.906+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe078019030 con 0x7fe07c0f55c0 2022-02-02T22:45:08.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.906+0000 7fe071ffb700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 0x7fe068067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.906+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0780816b0 con 0x7fe07c0f55c0 2022-02-02T22:45:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.907+0000 7fe080da9700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 0x7fe068067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:08.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.907+0000 7fe080da9700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 0x7fe068067290 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7fe06c004e30 tx=0x7fe06c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:08.911+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe07804f940 con 0x7fe07c0f55c0 2022-02-02T22:45:09.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.090+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe07c0fde60 con 0x7fe068064dd0 2022-02-02T22:45:09.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.091+0000 7fe071ffb700 1 -- 172.21.15.96:0/2895682969 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe07c0fde60 con 0x7fe068064dd0 2022-02-02T22:45:09.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 msgr2=0x7fe068067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 0x7fe068067290 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7fe06c004e30 tx=0x7fe06c009b30).stop 2022-02-02T22:45:09.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 msgr2=0x7fe07c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.094 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 secure :-1 s=READY pgs=4028 cs=0 l=1 rev1=1 rx=0x7fe07800c530 tx=0x7fe078007e10).stop 2022-02-02T22:45:09.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 shutdown_connections 2022-02-02T22:45:09.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe068064dd0 0x7fe068067290 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.095 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe07c0f55c0 0x7fe07c105ec0 unknown :-1 s=CLOSED pgs=4028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 --2- 172.21.15.96:0/2895682969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe07c0f6860 0x7fe07c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.093+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 >> 172.21.15.96:0/2895682969 conn(0x7fe07c0f0d40 msgr2=0x7fe07c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.096 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.094+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 shutdown_connections 2022-02-02T22:45:09.097 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.094+0000 7fe08380e700 1 -- 172.21.15.96:0/2895682969 wait complete. 2022-02-02T22:45:09.103 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:45:09.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 -- 172.21.15.96:0/404096863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 msgr2=0x7f7a340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 --2- 172.21.15.96:0/404096863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a340f59e0 secure :-1 s=READY pgs=4029 cs=0 l=1 rev1=1 rx=0x7f7a24004660 tx=0x7f7a24009b30).stop 2022-02-02T22:45:09.192 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 -- 172.21.15.96:0/404096863 shutdown_connections 2022-02-02T22:45:09.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 --2- 172.21.15.96:0/404096863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 0x7f7a340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 --2- 172.21.15.96:0/404096863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a340f59e0 unknown :-1 s=CLOSED pgs=4029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.193 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 -- 172.21.15.96:0/404096863 >> 172.21.15.96:0/404096863 conn(0x7f7a340f0d40 msgr2=0x7f7a340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.194 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:09 smithi096 ceph-mon[101353]: pgmap v7890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:09.198 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 -- 172.21.15.96:0/404096863 shutdown_connections 2022-02-02T22:45:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.191+0000 7f7a3be80700 1 -- 172.21.15.96:0/404096863 wait complete. 2022-02-02T22:45:09.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 Processor -- start 2022-02-02T22:45:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 -- start start 2022-02-02T22:45:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 0x7f7a34106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34106910 con 0x7f7a340f55c0 2022-02-02T22:45:09.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3be80700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34106a50 con 0x7f7a340f6860 2022-02-02T22:45:09.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a39c1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a39c1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50204/0 (socket says 172.21.15.96:50204) 2022-02-02T22:45:09.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a39c1c700 1 -- 172.21.15.96:0/1785601022 learned_addr learned my addr 172.21.15.96:0/1785601022 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:09.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.192+0000 7f7a3941b700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 0x7f7a34106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a39c1c700 1 -- 172.21.15.96:0/1785601022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 msgr2=0x7f7a34106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a39c1c700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 0x7f7a34106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a39c1c700 1 -- 172.21.15.96:0/1785601022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24005040 con 0x7f7a340f55c0 2022-02-02T22:45:09.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a39c1c700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 secure :-1 s=READY pgs=4030 cs=0 l=1 rev1=1 rx=0x7f7a24013a70 tx=0x7f7a24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a24018070 con 0x7f7a340f55c0 2022-02-02T22:45:09.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a240097d0 con 0x7f7a340f55c0 2022-02-02T22:45:09.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34107390 con 0x7f7a340f55c0 2022-02-02T22:45:09.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2401de80 con 0x7f7a340f55c0 2022-02-02T22:45:09.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.193+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a341078f0 con 0x7f7a340f55c0 2022-02-02T22:45:09.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.194+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34045ad0 con 0x7f7a340f55c0 2022-02-02T22:45:09.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.194+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a24007ba0 con 0x7f7a340f55c0 2022-02-02T22:45:09.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.195+0000 7f7a2a7fc700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 0x7f7a20067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.195+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a24083660 con 0x7f7a340f55c0 2022-02-02T22:45:09.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.195+0000 7f7a3941b700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 0x7f7a20067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.195+0000 7f7a3941b700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 0x7f7a20067290 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 rx=0x7f7a30004c40 tx=0x7f7a3000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.199+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a24055190 con 0x7f7a340f55c0 2022-02-02T22:45:09.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.372+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a341080e0 con 0x7f7a20064dd0 2022-02-02T22:45:09.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.381+0000 7f7a2a7fc700 1 -- 172.21.15.96:0/1785601022 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7a3000f040 con 0x7f7a20064dd0 2022-02-02T22:45:09.381 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:45:09.382 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:45:09.382 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:45:09.383 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:45:09.383 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:45:09.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:45:09.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:45:09.384 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:45:09.385 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:45:09.385 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:45:09.385 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:45:09.386 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:45:09.386 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:45:09.386 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:45:09.387 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:45:09.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:45:09.387 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:45:09.388 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:45:09.388 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:45:09.388 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:45:09.389 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:45:09.389 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:45:09.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 msgr2=0x7f7a20067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 0x7f7a20067290 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 rx=0x7f7a30004c40 tx=0x7f7a3000b040).stop 2022-02-02T22:45:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 msgr2=0x7f7a34105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 secure :-1 s=READY pgs=4030 cs=0 l=1 rev1=1 rx=0x7f7a24013a70 tx=0x7f7a24009b30).stop 2022-02-02T22:45:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 shutdown_connections 2022-02-02T22:45:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a20064dd0 0x7f7a20067290 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a340f55c0 0x7f7a34105e70 unknown :-1 s=CLOSED pgs=4030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 --2- 172.21.15.96:0/1785601022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a340f6860 0x7f7a34106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 >> 172.21.15.96:0/1785601022 conn(0x7f7a340f0d40 msgr2=0x7f7a340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 shutdown_connections 2022-02-02T22:45:09.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.383+0000 7f7a3be80700 1 -- 172.21.15.96:0/1785601022 wait complete. 2022-02-02T22:45:09.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 -- 172.21.15.96:0/515178205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 msgr2=0x7f4a0c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 --2- 172.21.15.96:0/515178205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c0f59e0 secure :-1 s=READY pgs=4031 cs=0 l=1 rev1=1 rx=0x7f4a00004660 tx=0x7f4a00009b30).stop 2022-02-02T22:45:09.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 -- 172.21.15.96:0/515178205 shutdown_connections 2022-02-02T22:45:09.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 --2- 172.21.15.96:0/515178205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 --2- 172.21.15.96:0/515178205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c0f59e0 unknown :-1 s=CLOSED pgs=4031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 -- 172.21.15.96:0/515178205 >> 172.21.15.96:0/515178205 conn(0x7f4a0c0f0d40 msgr2=0x7f4a0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 -- 172.21.15.96:0/515178205 shutdown_connections 2022-02-02T22:45:09.482 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.479+0000 7f4a1290a700 1 -- 172.21.15.96:0/515178205 wait complete. 2022-02-02T22:45:09.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 Processor -- start 2022-02-02T22:45:09.485 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 -- start start 2022-02-02T22:45:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c106910 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a1290a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c106a50 con 0x7f4a0c0f6860 2022-02-02T22:45:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a0bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.487 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a0bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50214/0 (socket says 172.21.15.96:50214) 2022-02-02T22:45:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.480+0000 7f4a0bfff700 1 -- 172.21.15.96:0/3863016567 learned_addr learned my addr 172.21.15.96:0/3863016567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0b7fe700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0bfff700 1 -- 172.21.15.96:0/3863016567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 msgr2=0x7f4a0c106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0bfff700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0bfff700 1 -- 172.21.15.96:0/3863016567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00005040 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0b7fe700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:45:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a0bfff700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 secure :-1 s=READY pgs=4032 cs=0 l=1 rev1=1 rx=0x7f4a00004f60 tx=0x7f4a00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a00018070 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c107390 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a00007ba0 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0001c620 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.481+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c1078f0 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.482+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c045ad0 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.484+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a0001c8e0 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.484+0000 7f4a08ff9700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 0x7f49f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.493 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.484+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4a00083e10 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.484+0000 7f4a0b7fe700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 0x7f49f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.485+0000 7f4a0b7fe700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 0x7f49f4067290 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 rx=0x7f49fc0041d0 tx=0x7f49fc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.488+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a00055940 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:09 smithi159 ceph-mon[69013]: pgmap v7890: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:09.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.719+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a0c0fde50 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.720+0000 7f4a08ff9700 1 -- 172.21.15.96:0/3863016567 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f4a00055530 con 0x7f4a0c0f55c0 2022-02-02T22:45:09.721 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:45:09.721 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:45:09.722 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:45:09.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:09.722 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:45:09.723 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:45:09.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:09.723 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:45:09.724 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:45:09.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:09.724 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:45:09.725 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:45:09.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:09.725 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:45:09.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:45:09.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:45:09.726 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:45:09.727 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:45:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 msgr2=0x7f49f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 0x7f49f4067290 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 rx=0x7f49fc0041d0 tx=0x7f49fc009040).stop 2022-02-02T22:45:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 msgr2=0x7f4a0c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 secure :-1 s=READY pgs=4032 cs=0 l=1 rev1=1 rx=0x7f4a00004f60 tx=0x7f4a00009b30).stop 2022-02-02T22:45:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 shutdown_connections 2022-02-02T22:45:09.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f49f4064dd0 0x7f49f4067290 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a0c0f55c0 0x7f4a0c105e70 unknown :-1 s=CLOSED pgs=4032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 --2- 172.21.15.96:0/3863016567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a0c0f6860 0x7f4a0c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 >> 172.21.15.96:0/3863016567 conn(0x7f4a0c0f0d40 msgr2=0x7f4a0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 shutdown_connections 2022-02-02T22:45:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.722+0000 7f4a1290a700 1 -- 172.21.15.96:0/3863016567 wait complete. 2022-02-02T22:45:09.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 -- 172.21.15.96:0/1985822278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 msgr2=0x7f54140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 --2- 172.21.15.96:0/1985822278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f54140f59e0 secure :-1 s=READY pgs=4033 cs=0 l=1 rev1=1 rx=0x7f5404004660 tx=0x7f5404009b30).stop 2022-02-02T22:45:09.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 -- 172.21.15.96:0/1985822278 shutdown_connections 2022-02-02T22:45:09.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 --2- 172.21.15.96:0/1985822278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f54140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 --2- 172.21.15.96:0/1985822278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f54140f59e0 unknown :-1 s=CLOSED pgs=4033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 -- 172.21.15.96:0/1985822278 >> 172.21.15.96:0/1985822278 conn(0x7f54140f0d40 msgr2=0x7f54140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 -- 172.21.15.96:0/1985822278 shutdown_connections 2022-02-02T22:45:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.820+0000 7f541bd08700 1 -- 172.21.15.96:0/1985822278 wait complete. 2022-02-02T22:45:09.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 Processor -- start 2022-02-02T22:45:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 -- start start 2022-02-02T22:45:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f5414109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140603e0 con 0x7f54140f55c0 2022-02-02T22:45:09.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f541bd08700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5414060520 con 0x7f54140f6860 2022-02-02T22:45:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f54192a3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f54192a3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:54330/0 (socket says 172.21.15.96:54330) 2022-02-02T22:45:09.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f54192a3700 1 -- 172.21.15.96:0/1975947783 learned_addr learned my addr 172.21.15.96:0/1975947783 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.821+0000 7f5419aa4700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f5414109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f54192a3700 1 -- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 msgr2=0x7f5414109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:09.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f54192a3700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f5414109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:09.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f54192a3700 1 -- 172.21.15.96:0/1975947783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404005040 con 0x7f54140f6860 2022-02-02T22:45:09.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f54192a3700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f54100026d0 tx=0x7f5410009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5410009320 con 0x7f54140f6860 2022-02-02T22:45:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541410c720 con 0x7f54140f6860 2022-02-02T22:45:09.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f541000f040 con 0x7f54140f6860 2022-02-02T22:45:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54100147e0 con 0x7f54140f6860 2022-02-02T22:45:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.822+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541410cce0 con 0x7f54140f6860 2022-02-02T22:45:09.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.823+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5414045ad0 con 0x7f54140f6860 2022-02-02T22:45:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.824+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5410009480 con 0x7f54140f6860 2022-02-02T22:45:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.824+0000 7f540a7fc700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 0x7f5400067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:09.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.824+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5410082110 con 0x7f54140f6860 2022-02-02T22:45:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.824+0000 7f5419aa4700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 0x7f5400067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.824+0000 7f5419aa4700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 0x7f5400067290 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 rx=0x7f5404004e30 tx=0x7f5404009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:09.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:09.828+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5410050210 con 0x7f54140f6860 2022-02-02T22:45:10.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.027+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f541410c8b0 con 0x7f54140f6860 2022-02-02T22:45:10.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.027+0000 7f540a7fc700 1 -- 172.21.15.96:0/1975947783 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f541410c8b0 con 0x7f54140f6860 2022-02-02T22:45:10.028 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:45:10.029 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:45:10.029 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:45:10.029 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:45:10.030 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:10.030 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:45:10.031 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:45:10.031 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:45:10.031 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:45:10.032 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:45:10.032 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:45:10.033 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:45:10.033 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:45:10.034 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:45:10.034 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:45:10.035 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:45:10.035 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:45:10.035 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:45:10.036 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:45:10.036 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:45:10.036 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:45:10.037 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:45:10.037 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:45:10.037 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:45:10.038 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:45:10.038 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:45:10.038 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:45:10.039 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:45:10.039 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:45:10.039 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:45:10.040 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:45:10.040 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:45:10.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:10.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:10.041 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:45:10.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:10.042 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:10.043 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:10.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 msgr2=0x7f5400067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:10.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 0x7f5400067290 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 rx=0x7f5404004e30 tx=0x7f5404009b30).stop 2022-02-02T22:45:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 msgr2=0x7f541410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f54100026d0 tx=0x7f5410009de0).stop 2022-02-02T22:45:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 shutdown_connections 2022-02-02T22:45:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5400064dd0 0x7f5400067290 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54140f55c0 0x7f5414109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 --2- 172.21.15.96:0/1975947783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54140f6860 0x7f541410c170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 >> 172.21.15.96:0/1975947783 conn(0x7f54140f0d40 msgr2=0x7f54140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 shutdown_connections 2022-02-02T22:45:10.048 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:10.029+0000 7f541bd08700 1 -- 172.21.15.96:0/1975947783 wait complete. 2022-02-02T22:45:10.048 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:45:10.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3863016567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:45:10.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1975947783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:45:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3863016567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:45:10.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1975947783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:45:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:11 smithi096 ceph-mon[101353]: from='client.42180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:11 smithi096 ceph-mon[101353]: from='client.42184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:11 smithi096 ceph-mon[101353]: pgmap v7891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:11 smithi159 ceph-mon[69013]: from='client.42180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:11 smithi159 ceph-mon[69013]: from='client.42184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:11.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:11 smithi159 ceph-mon[69013]: pgmap v7891: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:13.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:13 smithi096 ceph-mon[101353]: pgmap v7892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:13 smithi159 ceph-mon[69013]: pgmap v7892: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:15 smithi096 ceph-mon[101353]: pgmap v7893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:15.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:15 smithi159 ceph-mon[69013]: pgmap v7893: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:17 smithi096 ceph-mon[101353]: pgmap v7894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:17 smithi159 ceph-mon[69013]: pgmap v7894: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:19 smithi159 ceph-mon[69013]: pgmap v7895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:19 smithi096 ceph-mon[101353]: pgmap v7895: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:21 smithi159 ceph-mon[69013]: pgmap v7896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:21 smithi096 ceph-mon[101353]: pgmap v7896: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:23 smithi159 ceph-mon[69013]: pgmap v7897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:23 smithi096 ceph-mon[101353]: pgmap v7897: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:25 smithi159 ceph-mon[69013]: pgmap v7898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:25 smithi096 ceph-mon[101353]: pgmap v7898: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:27 smithi159 ceph-mon[69013]: pgmap v7899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:27 smithi096 ceph-mon[101353]: pgmap v7899: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:45:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:45:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:45:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:45:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:29 smithi159 ceph-mon[69013]: pgmap v7900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:29.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:29 smithi096 ceph-mon[101353]: pgmap v7900: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:30 smithi159 ceph-mon[69013]: pgmap v7901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:30.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:30 smithi096 ceph-mon[101353]: pgmap v7901: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:32.774 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:32 smithi159 ceph-mon[69013]: pgmap v7902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:32.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:32 smithi096 ceph-mon[101353]: pgmap v7902: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:34 smithi159 ceph-mon[69013]: pgmap v7903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:34 smithi096 ceph-mon[101353]: pgmap v7903: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:36 smithi159 ceph-mon[69013]: pgmap v7904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:36 smithi096 ceph-mon[101353]: pgmap v7904: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:38 smithi159 ceph-mon[69013]: pgmap v7905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:38 smithi096 ceph-mon[101353]: pgmap v7905: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:40.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 -- 172.21.15.96:0/285157319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 msgr2=0x7f27bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 --2- 172.21.15.96:0/285157319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc0f6cc0 secure :-1 s=READY pgs=4034 cs=0 l=1 rev1=1 rx=0x7f27b8004660 tx=0x7f27b8009b30).stop 2022-02-02T22:45:40.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 -- 172.21.15.96:0/285157319 shutdown_connections 2022-02-02T22:45:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 --2- 172.21.15.96:0/285157319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc0f6cc0 unknown :-1 s=CLOSED pgs=4034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 --2- 172.21.15.96:0/285157319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:45:40.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 -- 172.21.15.96:0/285157319 >> 172.21.15.96:0/285157319 conn(0x7f27bc0f0d40 msgr2=0x7f27bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 -- 172.21.15.96:0/285157319 shutdown_connections 2022-02-02T22:45:40.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.139+0000 7f27c4617700 1 -- 172.21.15.96:0/285157319 wait complete. 2022-02-02T22:45:40.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 Processor -- start 2022-02-02T22:45:40.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 -- start start 2022-02-02T22:45:40.145 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0604b0 con 0x7f27bc0f6860 2022-02-02T22:45:40.146 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.140+0000 7f27c4617700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0605f0 con 0x7f27bc0f55c0 2022-02-02T22:45:40.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50244/0 (socket says 172.21.15.96:50244) 2022-02-02T22:45:40.147 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 -- 172.21.15.96:0/2407845136 learned_addr learned my addr 172.21.15.96:0/2407845136 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:40.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c23b3700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 -- 172.21.15.96:0/2407845136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 msgr2=0x7f27bc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 -- 172.21.15.96:0/2407845136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8005040 con 0x7f27bc0f6860 2022-02-02T22:45:40.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c23b3700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:45:40.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c1bb2700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 secure :-1 s=READY pgs=4035 cs=0 l=1 rev1=1 rx=0x7f27b8009990 tx=0x7f27b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b8018070 con 0x7f27bc0f6860 2022-02-02T22:45:40.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f27b8007ca0 con 0x7f27bc0f6860 2022-02-02T22:45:40.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc10c770 con 0x7f27bc0f6860 2022-02-02T22:45:40.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b801c620 con 0x7f27bc0f6860 2022-02-02T22:45:40.151 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.141+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc10ccd0 con 0x7f27bc0f6860 2022-02-02T22:45:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.142+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc045ad0 con 0x7f27bc0f6860 2022-02-02T22:45:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.143+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f27b801d960 con 0x7f27bc0f6860 2022-02-02T22:45:40.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.143+0000 7f27aeffd700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 0x7f27a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.143+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f27b80837e0 con 0x7f27bc0f6860 2022-02-02T22:45:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.143+0000 7f27c23b3700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 0x7f27a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.144+0000 7f27c23b3700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 0x7f27a8067290 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f27bc0600a0 tx=0x7f27b0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.147+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27b80519a0 con 0x7f27bc0f6860 2022-02-02T22:45:40.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.325+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27bc057f10 con 0x7f27a8064dd0 2022-02-02T22:45:40.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.326+0000 7f27aeffd700 1 -- 172.21.15.96:0/2407845136 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f27bc057f10 con 0x7f27a8064dd0 2022-02-02T22:45:40.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 msgr2=0x7f27a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 0x7f27a8067290 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f27bc0600a0 tx=0x7f27b0008040).stop 2022-02-02T22:45:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 msgr2=0x7f27bc10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 secure :-1 s=READY pgs=4035 cs=0 l=1 rev1=1 rx=0x7f27b8009990 tx=0x7f27b8009b30).stop 2022-02-02T22:45:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 shutdown_connections 2022-02-02T22:45:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f27a8064dd0 0x7f27a8067290 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc0f55c0 0x7f27bc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 --2- 172.21.15.96:0/2407845136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27bc0f6860 0x7f27bc10c170 unknown :-1 s=CLOSED pgs=4035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 >> 172.21.15.96:0/2407845136 conn(0x7f27bc0f0d40 msgr2=0x7f27bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 shutdown_connections 2022-02-02T22:45:40.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.328+0000 7f27c4617700 1 -- 172.21.15.96:0/2407845136 wait complete. 2022-02-02T22:45:40.338 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:45:40.425 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 -- 172.21.15.96:0/2927795414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f6530 msgr2=0x7f56580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 --2- 172.21.15.96:0/2927795414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f6530 0x7f56580f6950 secure :-1 s=READY pgs=4036 cs=0 l=1 rev1=1 rx=0x7f5654004660 tx=0x7f5654009b30).stop 2022-02-02T22:45:40.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 -- 172.21.15.96:0/2927795414 shutdown_connections 2022-02-02T22:45:40.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 --2- 172.21.15.96:0/2927795414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f77d0 0x7f56580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:45:40.427 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 --2- 172.21.15.96:0/2927795414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f6530 0x7f56580f6950 unknown :-1 s=CLOSED pgs=4036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.425+0000 7f565e443700 1 -- 172.21.15.96:0/2927795414 >> 172.21.15.96:0/2927795414 conn(0x7f56580f1c90 msgr2=0x7f56580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 -- 172.21.15.96:0/2927795414 shutdown_connections 2022-02-02T22:45:40.428 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 -- 172.21.15.96:0/2927795414 wait complete. 2022-02-02T22:45:40.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 Processor -- start 2022-02-02T22:45:40.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 -- start start 2022-02-02T22:45:40.431 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f6530 0x7f565806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565806a410 con 0x7f56580f77d0 2022-02-02T22:45:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.426+0000 7f565e443700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565806a550 con 0x7f56580f6530 2022-02-02T22:45:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50254/0 (socket says 172.21.15.96:50254) 2022-02-02T22:45:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 -- 172.21.15.96:0/3972403944 learned_addr learned my addr 172.21.15.96:0/3972403944 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565d441700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f6530 0x7f565806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 -- 172.21.15.96:0/3972403944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f6530 msgr2=0x7f565806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f6530 0x7f565806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 -- 172.21.15.96:0/3972403944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654005040 con 0x7f56580f77d0 2022-02-02T22:45:40.435 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565cc40700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 secure :-1 s=READY pgs=4037 cs=0 l=1 rev1=1 rx=0x7f564800b410 tx=0x7f5648006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56480125f0 con 0x7f56580f77d0 2022-02-02T22:45:40.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565806a830 con 0x7f56580f77d0 2022-02-02T22:45:40.436 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5648012c00 con 0x7f56580f77d0 2022-02-02T22:45:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.427+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5648002ae0 con 0x7f56580f77d0 2022-02-02T22:45:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.428+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565810ede0 con 0x7f56580f77d0 2022-02-02T22:45:40.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.428+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658045ad0 con 0x7f56580f77d0 2022-02-02T22:45:40.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.429+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5648012d70 con 0x7f56580f77d0 2022-02-02T22:45:40.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.430+0000 7f564dffb700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 0x7f56440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.430+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56480823a0 con 0x7f56580f77d0 2022-02-02T22:45:40.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.430+0000 7f565d441700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 0x7f56440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.430+0000 7f565d441700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 0x7f56440672e0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 rx=0x7f565806b730 tx=0x7f5654009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.440 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.433+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56480503e0 con 0x7f56580f77d0 2022-02-02T22:45:40.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.606+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56580fef20 con 0x7f5644064e20 2022-02-02T22:45:40.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.616+0000 7f564dffb700 1 -- 172.21.15.96:0/3972403944 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5654019040 con 0x7f5644064e20 2022-02-02T22:45:40.617 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:45:40.617 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 3h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:45:40.617 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 3h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:45:40.618 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:45:40.618 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 3h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:45:40.619 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 3h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:45:40.619 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 3h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:45:40.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:45:40.620 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:45:40.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 3h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:45:40.621 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:45:40.621 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 3h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:45:40.622 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:45:40.622 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 3h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:45:40.623 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:45:40.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 3h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:45:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 3h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:45:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 3h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:45:40.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:45:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:45:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:45:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 3h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:45:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.617+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 msgr2=0x7f56440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.617+0000 7f565e443700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 0x7f56440672e0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 rx=0x7f565806b730 tx=0x7f5654009b30).stop 2022-02-02T22:45:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.617+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 msgr2=0x7f5658069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.617+0000 7f565e443700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 secure :-1 s=READY pgs=4037 cs=0 l=1 rev1=1 rx=0x7f564800b410 tx=0x7f5648006ef0).stop 2022-02-02T22:45:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 shutdown_connections 2022-02-02T22:45:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5644064e20 0x7f56440672e0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56580f6530 0x7f565806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 --2- 172.21.15.96:0/3972403944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56580f77d0 0x7f5658069e20 unknown :-1 s=CLOSED pgs=4037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.630 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 >> 172.21.15.96:0/3972403944 conn(0x7f56580f1c90 msgr2=0x7f56580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 shutdown_connections 2022-02-02T22:45:40.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.618+0000 7f565e443700 1 -- 172.21.15.96:0/3972403944 wait complete. 2022-02-02T22:45:40.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 -- 172.21.15.96:0/3134422668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f6530 msgr2=0x7f00940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 --2- 172.21.15.96:0/3134422668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f6530 0x7f00940f6950 secure :-1 s=READY pgs=4038 cs=0 l=1 rev1=1 rx=0x7f0084004660 tx=0x7f0084009b30).stop 2022-02-02T22:45:40.714 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 -- 172.21.15.96:0/3134422668 shutdown_connections 2022-02-02T22:45:40.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 --2- 172.21.15.96:0/3134422668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f77d0 0x7f00940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 --2- 172.21.15.96:0/3134422668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f6530 0x7f00940f6950 unknown :-1 s=CLOSED pgs=4038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 -- 172.21.15.96:0/3134422668 >> 172.21.15.96:0/3134422668 conn(0x7f00940f1c90 msgr2=0x7f00940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.716 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:40 smithi096 ceph-mon[101353]: pgmap v7906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.713+0000 7f00988f9700 1 -- 172.21.15.96:0/3134422668 shutdown_connections 2022-02-02T22:45:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 -- 172.21.15.96:0/3134422668 wait complete. 2022-02-02T22:45:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 Processor -- start 2022-02-02T22:45:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 -- start start 2022-02-02T22:45:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 0x7f0094106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941078f0 con 0x7f00940f77d0 2022-02-02T22:45:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.715+0000 7f00988f9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094108100 con 0x7f00940f6530 2022-02-02T22:45:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50264/0 (socket says 172.21.15.96:50264) 2022-02-02T22:45:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 -- 172.21.15.96:0/2307014330 learned_addr learned my addr 172.21.15.96:0/2307014330 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f0092d9d700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 0x7f0094106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 -- 172.21.15.96:0/2307014330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 msgr2=0x7f0094106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 0x7f0094106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 -- 172.21.15.96:0/2307014330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084005040 con 0x7f00940f77d0 2022-02-02T22:45:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f0092d9d700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 0x7f0094106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:45:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f009259c700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 secure :-1 s=READY pgs=4039 cs=0 l=1 rev1=1 rx=0x7f00880026d0 tx=0x7f0088009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0088009320 con 0x7f00940f77d0 2022-02-02T22:45:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094108380 con 0x7f00940f77d0 2022-02-02T22:45:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f008800f040 con 0x7f00940f77d0 2022-02-02T22:45:40.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00880147e0 con 0x7f00940f77d0 2022-02-02T22:45:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.716+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094108860 con 0x7f00940f77d0 2022-02-02T22:45:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.717+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094045ad0 con 0x7f00940f77d0 2022-02-02T22:45:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.718+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0088009480 con 0x7f00940f77d0 2022-02-02T22:45:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.718+0000 7f007b7fe700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 0x7f007c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:40.727 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.718+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0088082110 con 0x7f00940f77d0 2022-02-02T22:45:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.718+0000 7f0092d9d700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 0x7f007c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:40.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.719+0000 7f0092d9d700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 0x7f007c0672e0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7f0084004e30 tx=0x7f0084009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:40.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.722+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0088050210 con 0x7f00940f77d0 2022-02-02T22:45:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.952+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00940fee70 con 0x7f00940f77d0 2022-02-02T22:45:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.953+0000 7f007b7fe700 1 -- 172.21.15.96:0/2307014330 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0088053830 con 0x7f00940f77d0 2022-02-02T22:45:40.954 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:45:40.955 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:45:40.955 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:45:40.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:40.956 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:45:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:45:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:40.958 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:45:40.958 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:45:40.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:40.959 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:45:40.959 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:45:40.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:45:40.960 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:45:40.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:45:40.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:45:40.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:45:40.962 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:45:40.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 msgr2=0x7f007c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 0x7f007c0672e0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7f0084004e30 tx=0x7f0084009b30).stop 2022-02-02T22:45:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 msgr2=0x7f00941072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:40.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 secure :-1 s=READY pgs=4039 cs=0 l=1 rev1=1 rx=0x7f00880026d0 tx=0x7f0088009de0).stop 2022-02-02T22:45:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 shutdown_connections 2022-02-02T22:45:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f007c064e20 0x7f007c0672e0 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00940f6530 0x7f0094106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 --2- 172.21.15.96:0/2307014330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00940f77d0 0x7f00941072f0 unknown :-1 s=CLOSED pgs=4039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 >> 172.21.15.96:0/2307014330 conn(0x7f00940f1c90 msgr2=0x7f00940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:40.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 shutdown_connections 2022-02-02T22:45:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:40.955+0000 7f00988f9700 1 -- 172.21.15.96:0/2307014330 wait complete. 2022-02-02T22:45:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:40 smithi159 ceph-mon[69013]: pgmap v7906: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 -- 172.21.15.96:0/470283823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f7980 msgr2=0x7fd5f80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 --2- 172.21.15.96:0/470283823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f7980 0x7fd5f80f7de0 secure :-1 s=READY pgs=4040 cs=0 l=1 rev1=1 rx=0x7fd5f4004660 tx=0x7fd5f4009b30).stop 2022-02-02T22:45:41.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 -- 172.21.15.96:0/470283823 shutdown_connections 2022-02-02T22:45:41.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 --2- 172.21.15.96:0/470283823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f7980 0x7fd5f80f7de0 unknown :-1 s=CLOSED pgs=4040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.054 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 --2- 172.21.15.96:0/470283823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f80f66e0 0x7fd5f80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 -- 172.21.15.96:0/470283823 >> 172.21.15.96:0/470283823 conn(0x7fd5f80f1e40 msgr2=0x7fd5f80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:41.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 -- 172.21.15.96:0/470283823 shutdown_connections 2022-02-02T22:45:41.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 -- 172.21.15.96:0/470283823 wait complete. 2022-02-02T22:45:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.052+0000 7fd5ff269700 1 Processor -- start 2022-02-02T22:45:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5ff269700 1 -- start start 2022-02-02T22:45:41.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5ff269700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5ff269700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 0x7fd5f8108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5ff269700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8107a70 con 0x7fd5f80f66e0 2022-02-02T22:45:41.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5ff269700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8107bb0 con 0x7fd5f81075a0 2022-02-02T22:45:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50272/0 (socket says 172.21.15.96:50272) 2022-02-02T22:45:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 -- 172.21.15.96:0/192879112 learned_addr learned my addr 172.21.15.96:0/192879112 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:45:41.059 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fc804700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 0x7fd5f8108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:41.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 -- 172.21.15.96:0/192879112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 msgr2=0x7fd5f8108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:41.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 0x7fd5f8108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fd005700 1 -- 172.21.15.96:0/192879112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4005040 con 0x7fd5f80f66e0 2022-02-02T22:45:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.053+0000 7fd5fc804700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 0x7fd5f8108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:45:41.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5fd005700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 secure :-1 s=READY pgs=4041 cs=0 l=1 rev1=1 rx=0x7fd5e8002700 tx=0x7fd5e8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e80079c0 con 0x7fd5f80f66e0 2022-02-02T22:45:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5e800f040 con 0x7fd5f80f66e0 2022-02-02T22:45:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f8108a40 con 0x7fd5f80f66e0 2022-02-02T22:45:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e8014850 con 0x7fd5f80f66e0 2022-02-02T22:45:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.054+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f8109000 con 0x7fd5f80f66e0 2022-02-02T22:45:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.055+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f8109280 con 0x7fd5f80f66e0 2022-02-02T22:45:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.056+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd5e801b060 con 0x7fd5f80f66e0 2022-02-02T22:45:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.056+0000 7fd5edffb700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 0x7fd5e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:45:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.056+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd5e8081b10 con 0x7fd5f80f66e0 2022-02-02T22:45:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.056+0000 7fd5fc804700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 0x7fd5e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:45:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.057+0000 7fd5fc804700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 0x7fd5e4067290 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 rx=0x7fd5f4000c00 tx=0x7fd5f4016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:45:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.060+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5e80536a0 con 0x7fd5f80f66e0 2022-02-02T22:45:41.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.261+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5f8027a00 con 0x7fd5f80f66e0 2022-02-02T22:45:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.262+0000 7fd5edffb700 1 -- 172.21.15.96:0/192879112 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd5e8019070 con 0x7fd5f80f66e0 2022-02-02T22:45:41.263 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:45:41.263 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:45:41.264 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:45:41.264 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:45:41.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:41.265 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:45:41.265 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:45:41.266 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:45:41.266 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:45:41.267 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:45:41.267 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:45:41.267 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:45:41.268 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:45:41.268 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:45:41.268 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:45:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:45:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:45:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:45:41.270 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:45:41.270 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:45:41.270 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:45:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:45:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:45:41.271 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:45:41.272 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:45:41.272 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:45:41.272 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:45:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:45:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:45:41.273 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:45:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:45:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:45:41.274 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:41.275 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:41.275 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:45:41.275 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:45:41.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:41.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:41.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:45:41.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 msgr2=0x7fd5e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:41.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 0x7fd5e4067290 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 rx=0x7fd5f4000c00 tx=0x7fd5f4016040).stop 2022-02-02T22:45:41.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 msgr2=0x7fd5f81070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:45:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 secure :-1 s=READY pgs=4041 cs=0 l=1 rev1=1 rx=0x7fd5e8002700 tx=0x7fd5e8009e00).stop 2022-02-02T22:45:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 shutdown_connections 2022-02-02T22:45:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd5e4064dd0 0x7fd5e4067290 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f80f66e0 0x7fd5f81070b0 unknown :-1 s=CLOSED pgs=4041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 --2- 172.21.15.96:0/192879112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5f81075a0 0x7fd5f8108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:45:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.263+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 >> 172.21.15.96:0/192879112 conn(0x7fd5f80f1e40 msgr2=0x7fd5f80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:45:41.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.264+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 shutdown_connections 2022-02-02T22:45:41.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:45:41.264+0000 7fd5ff269700 1 -- 172.21.15.96:0/192879112 wait complete. 2022-02-02T22:45:41.281 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:45:42.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:41 smithi159 ceph-mon[69013]: from='client.42196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:42.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:41 smithi159 ceph-mon[69013]: from='client.42200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:42.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2307014330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:45:42.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/192879112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:45:42.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:41 smithi096 ceph-mon[101353]: from='client.42196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:42.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:41 smithi096 ceph-mon[101353]: from='client.42200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:45:42.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2307014330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:45:42.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/192879112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:45:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:42 smithi159 ceph-mon[69013]: pgmap v7907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:42 smithi096 ceph-mon[101353]: pgmap v7907: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:44 smithi159 ceph-mon[69013]: pgmap v7908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:44 smithi096 ceph-mon[101353]: pgmap v7908: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:46 smithi159 ceph-mon[69013]: pgmap v7909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:46 smithi096 ceph-mon[101353]: pgmap v7909: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:48 smithi159 ceph-mon[69013]: pgmap v7910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:49.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:48 smithi096 ceph-mon[101353]: pgmap v7910: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:50 smithi159 ceph-mon[69013]: pgmap v7911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:50 smithi096 ceph-mon[101353]: pgmap v7911: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:52 smithi159 ceph-mon[69013]: pgmap v7912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:52 smithi096 ceph-mon[101353]: pgmap v7912: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:54 smithi159 ceph-mon[69013]: pgmap v7913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:54 smithi096 ceph-mon[101353]: pgmap v7913: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:56 smithi159 ceph-mon[69013]: pgmap v7914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:56 smithi096 ceph-mon[101353]: pgmap v7914: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:45:58 smithi159 ceph-mon[69013]: pgmap v7915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:45:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:45:58 smithi096 ceph-mon[101353]: pgmap v7915: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:00 smithi159 ceph-mon[69013]: pgmap v7916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:00 smithi096 ceph-mon[101353]: pgmap v7916: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:02 smithi159 ceph-mon[69013]: pgmap v7917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:02 smithi096 ceph-mon[101353]: pgmap v7917: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:04 smithi159 ceph-mon[69013]: pgmap v7918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:04 smithi096 ceph-mon[101353]: pgmap v7918: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:06 smithi159 ceph-mon[69013]: pgmap v7919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:06 smithi096 ceph-mon[101353]: pgmap v7919: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:08 smithi159 ceph-mon[69013]: pgmap v7920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:08 smithi096 ceph-mon[101353]: pgmap v7920: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:10 smithi159 ceph-mon[69013]: pgmap v7921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:10 smithi096 ceph-mon[101353]: pgmap v7921: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:11.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 -- 172.21.15.96:0/363396557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f66e0 msgr2=0x7f446c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 --2- 172.21.15.96:0/363396557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f66e0 0x7f446c0f6b00 secure :-1 s=READY pgs=4042 cs=0 l=1 rev1=1 rx=0x7f445c004660 tx=0x7f445c009b30).stop 2022-02-02T22:46:11.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 -- 172.21.15.96:0/363396557 shutdown_connections 2022-02-02T22:46:11.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 --2- 172.21.15.96:0/363396557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f7980 0x7f446c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 --2- 172.21.15.96:0/363396557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f66e0 0x7f446c0f6b00 unknown :-1 s=CLOSED pgs=4042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 -- 172.21.15.96:0/363396557 >> 172.21.15.96:0/363396557 conn(0x7f446c0f1e40 msgr2=0x7f446c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:11.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 -- 172.21.15.96:0/363396557 shutdown_connections 2022-02-02T22:46:11.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.374+0000 7f447476e700 1 -- 172.21.15.96:0/363396557 wait complete. 2022-02-02T22:46:11.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 Processor -- start 2022-02-02T22:46:11.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 -- start start 2022-02-02T22:46:11.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f66e0 0x7f446c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.381 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c107a90 con 0x7f446c0f7980 2022-02-02T22:46:11.382 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447476e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c107bd0 con 0x7f446c0f66e0 2022-02-02T22:46:11.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50290/0 (socket says 172.21.15.96:50290) 2022-02-02T22:46:11.383 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f447250a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f66e0 0x7f446c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 -- 172.21.15.96:0/1677067558 learned_addr learned my addr 172.21.15.96:0/1677067558 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:11.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 -- 172.21.15.96:0/1677067558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f66e0 msgr2=0x7f446c106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.384 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f66e0 0x7f446c106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 -- 172.21.15.96:0/1677067558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c005040 con 0x7f446c0f7980 2022-02-02T22:46:11.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.375+0000 7f4471d09700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 secure :-1 s=READY pgs=4043 cs=0 l=1 rev1=1 rx=0x7f446800c510 tx=0x7f4468007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.385 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.376+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f446800f650 con 0x7f446c0f7980 2022-02-02T22:46:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.376+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c108570 con 0x7f446c0f7980 2022-02-02T22:46:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.376+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f446800fc60 con 0x7f446c0f7980 2022-02-02T22:46:11.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.376+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4468012c50 con 0x7f446c0f7980 2022-02-02T22:46:11.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.376+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c108b30 con 0x7f446c0f7980 2022-02-02T22:46:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.377+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c045ad0 con 0x7f446c0f7980 2022-02-02T22:46:11.388 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.377+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4468010070 con 0x7f446c0f7980 2022-02-02T22:46:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.378+0000 7f4462ffd700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 0x7f4458067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.378+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4468081750 con 0x7f446c0f7980 2022-02-02T22:46:11.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.378+0000 7f447250a700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 0x7f4458067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.378+0000 7f447250a700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 0x7f4458067290 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 rx=0x7f445c004630 tx=0x7f445c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.382+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4468053280 con 0x7f446c0f7980 2022-02-02T22:46:11.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.562+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f446c0ff030 con 0x7f4458064dd0 2022-02-02T22:46:11.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.563+0000 7f4462ffd700 1 -- 172.21.15.96:0/1677067558 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f446c0ff030 con 0x7f4458064dd0 2022-02-02T22:46:11.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 msgr2=0x7f4458067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 0x7f4458067290 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 rx=0x7f445c004630 tx=0x7f445c009b30).stop 2022-02-02T22:46:11.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 msgr2=0x7f446c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 secure :-1 s=READY pgs=4043 cs=0 l=1 rev1=1 rx=0x7f446800c510 tx=0x7f4468007e00).stop 2022-02-02T22:46:11.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 shutdown_connections 2022-02-02T22:46:11.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4458064dd0 0x7f4458067290 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f446c0f66e0 0x7f446c106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 --2- 172.21.15.96:0/1677067558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f446c0f7980 0x7f446c1074e0 unknown :-1 s=CLOSED pgs=4043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 >> 172.21.15.96:0/1677067558 conn(0x7f446c0f1e40 msgr2=0x7f446c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:11.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 shutdown_connections 2022-02-02T22:46:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.565+0000 7f447476e700 1 -- 172.21.15.96:0/1677067558 wait complete. 2022-02-02T22:46:11.576 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:46:11.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 -- 172.21.15.96:0/235480688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 msgr2=0x7f4be00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 --2- 172.21.15.96:0/235480688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be00f5850 secure :-1 s=READY pgs=4044 cs=0 l=1 rev1=1 rx=0x7f4bd0004660 tx=0x7f4bd0009b30).stop 2022-02-02T22:46:11.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 -- 172.21.15.96:0/235480688 shutdown_connections 2022-02-02T22:46:11.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 --2- 172.21.15.96:0/235480688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 0x7f4be00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 --2- 172.21.15.96:0/235480688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be00f5850 unknown :-1 s=CLOSED pgs=4044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 -- 172.21.15.96:0/235480688 >> 172.21.15.96:0/235480688 conn(0x7f4be00f0b90 msgr2=0x7f4be00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:11.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.663+0000 7f4bdffff700 1 -- 172.21.15.96:0/235480688 shutdown_connections 2022-02-02T22:46:11.667 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.664+0000 7f4bdffff700 1 -- 172.21.15.96:0/235480688 wait complete. 2022-02-02T22:46:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.664+0000 7f4bdffff700 1 Processor -- start 2022-02-02T22:46:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.664+0000 7f4bdffff700 1 -- start start 2022-02-02T22:46:11.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 0x7f4be0106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdffff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01067d0 con 0x7f4be00f5430 2022-02-02T22:46:11.671 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0106fd0 con 0x7f4be00f66d0 2022-02-02T22:46:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50296/0 (socket says 172.21.15.96:50296) 2022-02-02T22:46:11.672 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 -- 172.21.15.96:0/3325321706 learned_addr learned my addr 172.21.15.96:0/3325321706 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bde7fc700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 0x7f4be0106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 -- 172.21.15.96:0/3325321706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 msgr2=0x7f4be0106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.673 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 0x7f4be0106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 -- 172.21.15.96:0/3325321706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0005040 con 0x7f4be00f5430 2022-02-02T22:46:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bdeffd700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 secure :-1 s=READY pgs=4045 cs=0 l=1 rev1=1 rx=0x7f4bd0013a70 tx=0x7f4bd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.665+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd0018070 con 0x7f4be00f5430 2022-02-02T22:46:11.675 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.666+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4bd00097d0 con 0x7f4be00f5430 2022-02-02T22:46:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.666+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0107250 con 0x7f4be00f5430 2022-02-02T22:46:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.666+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd001de80 con 0x7f4be00f5430 2022-02-02T22:46:11.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.666+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be0107680 con 0x7f4be00f5430 2022-02-02T22:46:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.667+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be0045ad0 con 0x7f4be00f5430 2022-02-02T22:46:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.667+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4bd0007ba0 con 0x7f4be00f5430 2022-02-02T22:46:11.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.667+0000 7f4bc77fe700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 0x7f4bc806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.667+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4bd0083650 con 0x7f4be00f5430 2022-02-02T22:46:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.668+0000 7f4bde7fc700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 0x7f4bc806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.678 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.668+0000 7f4bde7fc700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 0x7f4bc806b6f0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 rx=0x7f4bd4004c40 tx=0x7f4bd400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.672+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4bd0055180 con 0x7f4be00f5430 2022-02-02T22:46:11.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.843+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be00ff670 con 0x7f4bc8069230 2022-02-02T22:46:11.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.853+0000 7f4bc77fe700 1 -- 172.21.15.96:0/3325321706 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4be00ff670 con 0x7f4bc8069230 2022-02-02T22:46:11.854 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:46:11.855 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:46:11.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:46:11.855 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:46:11.856 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:46:11.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:46:11.856 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:46:11.857 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:46:11.857 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:46:11.857 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:46:11.858 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:46:11.858 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:46:11.858 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:46:11.859 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:46:11.859 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:46:11.859 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:46:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:46:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:46:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:46:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:46:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:46:11.862 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:46:11.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 msgr2=0x7f4bc806b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 0x7f4bc806b6f0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 rx=0x7f4bd4004c40 tx=0x7f4bd400b040).stop 2022-02-02T22:46:11.863 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 msgr2=0x7f4be0105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 secure :-1 s=READY pgs=4045 cs=0 l=1 rev1=1 rx=0x7f4bd0013a70 tx=0x7f4bd0009b30).stop 2022-02-02T22:46:11.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 shutdown_connections 2022-02-02T22:46:11.864 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4bc8069230 0x7f4bc806b6f0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4be00f5430 0x7f4be0105d30 unknown :-1 s=CLOSED pgs=4045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 --2- 172.21.15.96:0/3325321706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4be00f66d0 0x7f4be0106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 >> 172.21.15.96:0/3325321706 conn(0x7f4be00f0b90 msgr2=0x7f4be00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:11.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 shutdown_connections 2022-02-02T22:46:11.866 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.855+0000 7f4bdffff700 1 -- 172.21.15.96:0/3325321706 wait complete. 2022-02-02T22:46:11.951 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 -- 172.21.15.96:0/154538820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 msgr2=0x7fc9f00f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 --2- 172.21.15.96:0/154538820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f9170 secure :-1 s=READY pgs=4046 cs=0 l=1 rev1=1 rx=0x7fc9e0004660 tx=0x7fc9e0009b30).stop 2022-02-02T22:46:11.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 -- 172.21.15.96:0/154538820 shutdown_connections 2022-02-02T22:46:11.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 --2- 172.21.15.96:0/154538820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 0x7fc9f00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 --2- 172.21.15.96:0/154538820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f9170 unknown :-1 s=CLOSED pgs=4046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 -- 172.21.15.96:0/154538820 >> 172.21.15.96:0/154538820 conn(0x7fc9f00f0b90 msgr2=0x7fc9f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:11.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 -- 172.21.15.96:0/154538820 shutdown_connections 2022-02-02T22:46:11.955 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.950+0000 7fc9f4872700 1 -- 172.21.15.96:0/154538820 wait complete. 2022-02-02T22:46:11.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 Processor -- start 2022-02-02T22:46:11.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 -- start start 2022-02-02T22:46:11.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 0x7fc9f00f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00f55d0 con 0x7fc9f00602b0 2022-02-02T22:46:11.963 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.951+0000 7fc9f4872700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00f5710 con 0x7fc9f00f96f0 2022-02-02T22:46:11.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50306/0 (socket says 172.21.15.96:50306) 2022-02-02T22:46:11.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 -- 172.21.15.96:0/2265318349 learned_addr learned my addr 172.21.15.96:0/2265318349 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9ee59c700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 0x7fc9f00f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 -- 172.21.15.96:0/2265318349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 msgr2=0x7fc9f00f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:11.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 0x7fc9f00f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:11.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 -- 172.21.15.96:0/2265318349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0005040 con 0x7fc9f00602b0 2022-02-02T22:46:11.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9eed9d700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 secure :-1 s=READY pgs=4047 cs=0 l=1 rev1=1 rx=0x7fc9e0009990 tx=0x7fc9e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e0018070 con 0x7fc9f00602b0 2022-02-02T22:46:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc9e0007ba0 con 0x7fc9f00602b0 2022-02-02T22:46:11.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e001c3c0 con 0x7fc9f00602b0 2022-02-02T22:46:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f00f5990 con 0x7fc9f00602b0 2022-02-02T22:46:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.952+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00f5ea0 con 0x7fc9f00602b0 2022-02-02T22:46:11.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.953+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f0045ad0 con 0x7fc9f00602b0 2022-02-02T22:46:11.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.954+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc9e001d420 con 0x7fc9f00602b0 2022-02-02T22:46:11.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.954+0000 7fc9d77fe700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 0x7fc9d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:11.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.954+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc9e00836a0 con 0x7fc9f00602b0 2022-02-02T22:46:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.954+0000 7fc9ee59c700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 0x7fc9d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.955+0000 7fc9ee59c700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 0x7fc9d80672e0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 rx=0x7fc9f0060080 tx=0x7fc9e400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:11.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:11.958+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc9e0051860 con 0x7fc9f00602b0 2022-02-02T22:46:12.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.190+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9f00fee20 con 0x7fc9f00602b0 2022-02-02T22:46:12.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.190+0000 7fc9d77fe700 1 -- 172.21.15.96:0/2265318349 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc9e0054e80 con 0x7fc9f00602b0 2022-02-02T22:46:12.192 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:46:12.192 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:46:12.193 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:46:12.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:12.193 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:46:12.194 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:46:12.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:12.194 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:46:12.195 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:46:12.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:12.196 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:46:12.196 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:46:12.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:12.197 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:46:12.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:46:12.197 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:46:12.198 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:46:12.198 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:46:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 msgr2=0x7fc9d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.199 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 0x7fc9d80672e0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 rx=0x7fc9f0060080 tx=0x7fc9e400b040).stop 2022-02-02T22:46:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 msgr2=0x7fc9f00f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 secure :-1 s=READY pgs=4047 cs=0 l=1 rev1=1 rx=0x7fc9e0009990 tx=0x7fc9e0009b30).stop 2022-02-02T22:46:12.200 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 shutdown_connections 2022-02-02T22:46:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9d8064e20 0x7fc9d80672e0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f00602b0 0x7fc9f00f6bf0 unknown :-1 s=CLOSED pgs=4047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 --2- 172.21.15.96:0/2265318349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9f00f96f0 0x7fc9f00f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 >> 172.21.15.96:0/2265318349 conn(0x7fc9f00f0b90 msgr2=0x7fc9f00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 shutdown_connections 2022-02-02T22:46:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.192+0000 7fc9f4872700 1 -- 172.21.15.96:0/2265318349 wait complete. 2022-02-02T22:46:12.290 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 -- 172.21.15.96:0/3710143659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f66e0 msgr2=0x7f77980f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 --2- 172.21.15.96:0/3710143659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f66e0 0x7f77980f6b00 secure :-1 s=READY pgs=4048 cs=0 l=1 rev1=1 rx=0x7f778c004660 tx=0x7f778c009b30).stop 2022-02-02T22:46:12.291 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 -- 172.21.15.96:0/3710143659 shutdown_connections 2022-02-02T22:46:12.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 --2- 172.21.15.96:0/3710143659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f7980 0x7f77980f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 --2- 172.21.15.96:0/3710143659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f66e0 0x7f77980f6b00 unknown :-1 s=CLOSED pgs=4048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.292 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 -- 172.21.15.96:0/3710143659 >> 172.21.15.96:0/3710143659 conn(0x7f77980f1e40 msgr2=0x7f77980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:12.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.289+0000 7f779f059700 1 -- 172.21.15.96:0/3710143659 shutdown_connections 2022-02-02T22:46:12.293 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.290+0000 7f779f059700 1 -- 172.21.15.96:0/3710143659 wait complete. 2022-02-02T22:46:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.290+0000 7f779f059700 1 Processor -- start 2022-02-02T22:46:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.290+0000 7f779f059700 1 -- start start 2022-02-02T22:46:12.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f66e0 0x7f779806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:12.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779806a380 con 0x7f77980f7980 2022-02-02T22:46:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779806a4c0 con 0x7f77980f66e0 2022-02-02T22:46:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:12.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50316/0 (socket says 172.21.15.96:50316) 2022-02-02T22:46:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 -- 172.21.15.96:0/1023572866 learned_addr learned my addr 172.21.15.96:0/1023572866 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779cdf5700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f66e0 0x7f779806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:12.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 -- 172.21.15.96:0/1023572866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f66e0 msgr2=0x7f779806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f66e0 0x7f779806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 -- 172.21.15.96:0/1023572866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c005040 con 0x7f77980f7980 2022-02-02T22:46:12.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f7797fff700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 secure :-1 s=READY pgs=4049 cs=0 l=1 rev1=1 rx=0x7f77840026d0 tx=0x7f7784009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7784009320 con 0x7f77980f7980 2022-02-02T22:46:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f778400f040 con 0x7f77980f7980 2022-02-02T22:46:12.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779806a7a0 con 0x7f77980f7980 2022-02-02T22:46:12.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77840147e0 con 0x7f77980f7980 2022-02-02T22:46:12.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.291+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779810efa0 con 0x7f77980f7980 2022-02-02T22:46:12.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.293+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7784009480 con 0x7f77980f7980 2022-02-02T22:46:12.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.293+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7798045ad0 con 0x7f77980f7980 2022-02-02T22:46:12.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.293+0000 7f77957fa700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 0x7f7788067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:12.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.293+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7784082120 con 0x7f77980f7980 2022-02-02T22:46:12.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.293+0000 7f779cdf5700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 0x7f7788067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:12.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.294+0000 7f779cdf5700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 0x7f7788067270 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 rx=0x7f779806b730 tx=0x7f778c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:12.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.297+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7784050220 con 0x7f77980f7980 2022-02-02T22:46:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.515+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7798027a00 con 0x7f77980f7980 2022-02-02T22:46:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.516+0000 7f77957fa700 1 -- 172.21.15.96:0/1023572866 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7784053840 con 0x7f77980f7980 2022-02-02T22:46:12.518 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:46:12.519 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:46:12.519 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:46:12.519 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:46:12.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:12.520 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:46:12.520 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:46:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:46:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:46:12.521 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:46:12.522 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:46:12.522 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:46:12.522 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:46:12.523 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:46:12.523 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:46:12.523 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:46:12.524 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:46:12.524 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:46:12.524 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:46:12.525 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:46:12.525 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:46:12.525 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:46:12.526 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:46:12.526 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:46:12.527 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:46:12.527 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:46:12.527 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:46:12.528 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:46:12.528 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:46:12.529 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:46:12.529 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:46:12.529 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:46:12.530 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:12.530 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:12.530 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:46:12.531 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:12.531 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:12.531 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:12.532 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:12.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 msgr2=0x7f7788067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 0x7f7788067270 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 rx=0x7f779806b730 tx=0x7f778c009b30).stop 2022-02-02T22:46:12.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 msgr2=0x7f7798069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:12.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 secure :-1 s=READY pgs=4049 cs=0 l=1 rev1=1 rx=0x7f77840026d0 tx=0x7f7784009de0).stop 2022-02-02T22:46:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 shutdown_connections 2022-02-02T22:46:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7788064db0 0x7f7788067270 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.535 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77980f66e0 0x7f779806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 --2- 172.21.15.96:0/1023572866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77980f7980 0x7f7798069e20 unknown :-1 s=CLOSED pgs=4049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:12.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 >> 172.21.15.96:0/1023572866 conn(0x7f77980f1e40 msgr2=0x7f77980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:12.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 shutdown_connections 2022-02-02T22:46:12.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:12.518+0000 7f779f059700 1 -- 172.21.15.96:0/1023572866 wait complete. 2022-02-02T22:46:12.537 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:46:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:12 smithi159 ceph-mon[69013]: pgmap v7922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:12 smithi159 ceph-mon[69013]: from='client.42212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:12 smithi159 ceph-mon[69013]: from='client.42216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2265318349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:46:13.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:12 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1023572866' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:46:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:12 smithi096 ceph-mon[101353]: pgmap v7922: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:12 smithi096 ceph-mon[101353]: from='client.42212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:12 smithi096 ceph-mon[101353]: from='client.42216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2265318349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:46:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:12 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1023572866' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:46:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:14 smithi159 ceph-mon[69013]: pgmap v7923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:14 smithi096 ceph-mon[101353]: pgmap v7923: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:16 smithi159 ceph-mon[69013]: pgmap v7924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:17.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:16 smithi096 ceph-mon[101353]: pgmap v7924: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:18 smithi159 ceph-mon[69013]: pgmap v7925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:18 smithi096 ceph-mon[101353]: pgmap v7925: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:20 smithi159 ceph-mon[69013]: pgmap v7926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:20 smithi096 ceph-mon[101353]: pgmap v7926: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:22 smithi159 ceph-mon[69013]: pgmap v7927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:22 smithi096 ceph-mon[101353]: pgmap v7927: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:24 smithi159 ceph-mon[69013]: pgmap v7928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:24 smithi096 ceph-mon[101353]: pgmap v7928: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:26 smithi159 ceph-mon[69013]: pgmap v7929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:26 smithi096 ceph-mon[101353]: pgmap v7929: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:28 smithi159 ceph-mon[69013]: pgmap v7930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:46:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:46:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:28 smithi096 ceph-mon[101353]: pgmap v7930: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:46:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:46:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:30 smithi159 ceph-mon[69013]: pgmap v7931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:30 smithi096 ceph-mon[101353]: pgmap v7931: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:33.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:32 smithi159 ceph-mon[69013]: pgmap v7932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:32 smithi096 ceph-mon[101353]: pgmap v7932: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:34 smithi159 ceph-mon[69013]: pgmap v7933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:34 smithi096 ceph-mon[101353]: pgmap v7933: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:36 smithi159 ceph-mon[69013]: pgmap v7934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:36 smithi096 ceph-mon[101353]: pgmap v7934: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:38 smithi159 ceph-mon[69013]: pgmap v7935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:38 smithi096 ceph-mon[101353]: pgmap v7935: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:40 smithi159 ceph-mon[69013]: pgmap v7936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:40 smithi096 ceph-mon[101353]: pgmap v7936: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 -- 172.21.15.96:0/3104554837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 msgr2=0x7f207c0f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 --2- 172.21.15.96:0/3104554837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c0f63e0 secure :-1 s=READY pgs=4050 cs=0 l=1 rev1=1 rx=0x7f206c004660 tx=0x7f206c009b30).stop 2022-02-02T22:46:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 -- 172.21.15.96:0/3104554837 shutdown_connections 2022-02-02T22:46:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 --2- 172.21.15.96:0/3104554837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c0f63e0 unknown :-1 s=CLOSED pgs=4050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 --2- 172.21.15.96:0/3104554837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 0x7f207c0f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 -- 172.21.15.96:0/3104554837 >> 172.21.15.96:0/3104554837 conn(0x7f207c0f04c0 msgr2=0x7f207c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 -- 172.21.15.96:0/3104554837 shutdown_connections 2022-02-02T22:46:42.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.629+0000 7f20832e8700 1 -- 172.21.15.96:0/3104554837 wait complete. 2022-02-02T22:46:42.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 Processor -- start 2022-02-02T22:46:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 -- start start 2022-02-02T22:46:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 0x7f207c10c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0f7ea0 con 0x7f207c0f5f60 2022-02-02T22:46:42.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f20832e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0f7fe0 con 0x7f207c0f4d60 2022-02-02T22:46:42.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2080883700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2080883700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50334/0 (socket says 172.21.15.96:50334) 2022-02-02T22:46:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2080883700 1 -- 172.21.15.96:0/3375576545 learned_addr learned my addr 172.21.15.96:0/3375576545 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:42.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2081084700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 0x7f207c10c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2080883700 1 -- 172.21.15.96:0/3375576545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 msgr2=0x7f207c10c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.630+0000 7f2080883700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 0x7f207c10c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f2080883700 1 -- 172.21.15.96:0/3375576545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c005040 con 0x7f207c0f5f60 2022-02-02T22:46:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f2080883700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 secure :-1 s=READY pgs=4051 cs=0 l=1 rev1=1 rx=0x7f206c000c00 tx=0x7f206c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:42.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c019070 con 0x7f207c0f5f60 2022-02-02T22:46:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c10ea30 con 0x7f207c0f5f60 2022-02-02T22:46:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f206c007e40 con 0x7f207c0f5f60 2022-02-02T22:46:42.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c014cd0 con 0x7f207c0f5f60 2022-02-02T22:46:42.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.631+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c10ee00 con 0x7f207c0f5f60 2022-02-02T22:46:42.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.632+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c045ad0 con 0x7f207c0f5f60 2022-02-02T22:46:42.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.633+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f206c025070 con 0x7f207c0f5f60 2022-02-02T22:46:42.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.633+0000 7f2071ffb700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 0x7f2068067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.633+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f206c082c20 con 0x7f207c0f5f60 2022-02-02T22:46:42.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.633+0000 7f2081084700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 0x7f2068067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.633+0000 7f2081084700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 0x7f2068067290 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 rx=0x7f207c0f7c30 tx=0x7f207800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:42.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.637+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f206c050cc0 con 0x7f207c0f5f60 2022-02-02T22:46:42.818 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.817+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f207c0faa40 con 0x7f2068064dd0 2022-02-02T22:46:42.819 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.818+0000 7f2071ffb700 1 -- 172.21.15.96:0/3375576545 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f207c0faa40 con 0x7f2068064dd0 2022-02-02T22:46:42.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 msgr2=0x7f2068067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 0x7f2068067290 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 rx=0x7f207c0f7c30 tx=0x7f207800b040).stop 2022-02-02T22:46:42.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 msgr2=0x7f207c10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 secure :-1 s=READY pgs=4051 cs=0 l=1 rev1=1 rx=0x7f206c000c00 tx=0x7f206c00b040).stop 2022-02-02T22:46:42.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 shutdown_connections 2022-02-02T22:46:42.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2068064dd0 0x7f2068067290 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c0f4d60 0x7f207c10c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 --2- 172.21.15.96:0/3375576545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f207c0f5f60 0x7f207c10e540 unknown :-1 s=CLOSED pgs=4051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 >> 172.21.15.96:0/3375576545 conn(0x7f207c0f04c0 msgr2=0x7f207c0fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:42.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 shutdown_connections 2022-02-02T22:46:42.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.820+0000 7f20832e8700 1 -- 172.21.15.96:0/3375576545 wait complete. 2022-02-02T22:46:42.831 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:46:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 -- 172.21.15.96:0/2093870915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f66e0 msgr2=0x7fc62c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 --2- 172.21.15.96:0/2093870915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f66e0 0x7fc62c0f6b00 secure :-1 s=READY pgs=4052 cs=0 l=1 rev1=1 rx=0x7fc620004660 tx=0x7fc620009b30).stop 2022-02-02T22:46:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 -- 172.21.15.96:0/2093870915 shutdown_connections 2022-02-02T22:46:42.922 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 --2- 172.21.15.96:0/2093870915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f7980 0x7fc62c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 --2- 172.21.15.96:0/2093870915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f66e0 0x7fc62c0f6b00 unknown :-1 s=CLOSED pgs=4052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 -- 172.21.15.96:0/2093870915 >> 172.21.15.96:0/2093870915 conn(0x7fc62c0f1e40 msgr2=0x7fc62c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:42.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 -- 172.21.15.96:0/2093870915 shutdown_connections 2022-02-02T22:46:42.924 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:42 smithi096 ceph-mon[101353]: pgmap v7937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.919+0000 7fc630df4700 1 -- 172.21.15.96:0/2093870915 wait complete. 2022-02-02T22:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 Processor -- start 2022-02-02T22:46:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 -- start start 2022-02-02T22:46:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f66e0 0x7fc62c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c107a10 con 0x7fc62c0f7980 2022-02-02T22:46:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc630df4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c107b50 con 0x7fc62c0f66e0 2022-02-02T22:46:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc629d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc629d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50344/0 (socket says 172.21.15.96:50344) 2022-02-02T22:46:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc629d9b700 1 -- 172.21.15.96:0/207378350 learned_addr learned my addr 172.21.15.96:0/207378350 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc62a59c700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f66e0 0x7fc62c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc629d9b700 1 -- 172.21.15.96:0/207378350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f66e0 msgr2=0x7fc62c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.920+0000 7fc629d9b700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f66e0 0x7fc62c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc629d9b700 1 -- 172.21.15.96:0/207378350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620005040 con 0x7fc62c0f7980 2022-02-02T22:46:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc629d9b700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 secure :-1 s=READY pgs=4053 cs=0 l=1 rev1=1 rx=0x7fc61c0026d0 tx=0x7fc61c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c0079c0 con 0x7fc62c0f7980 2022-02-02T22:46:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c1084f0 con 0x7fc62c0f7980 2022-02-02T22:46:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc61c00f040 con 0x7fc62c0f7980 2022-02-02T22:46:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c0148b0 con 0x7fc62c0f7980 2022-02-02T22:46:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.921+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c108ab0 con 0x7fc62c0f7980 2022-02-02T22:46:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.922+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c045ad0 con 0x7fc62c0f7980 2022-02-02T22:46:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.922+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc61c007b20 con 0x7fc62c0f7980 2022-02-02T22:46:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.922+0000 7fc61affd700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 0x7fc614067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.923+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc61c0819e0 con 0x7fc62c0f7980 2022-02-02T22:46:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.923+0000 7fc62a59c700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 0x7fc614067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.923+0000 7fc62a59c700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 0x7fc614067290 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 rx=0x7fc620004630 tx=0x7fc620009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:42.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:42.927+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc61c053510 con 0x7fc62c0f7980 2022-02-02T22:46:43.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:42 smithi159 ceph-mon[69013]: pgmap v7937: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:43.100 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.100+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc62c108d30 con 0x7fc614064dd0 2022-02-02T22:46:43.110 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.109+0000 7fc61affd700 1 -- 172.21.15.96:0/207378350 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc62c108d30 con 0x7fc614064dd0 2022-02-02T22:46:43.110 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:46:43.111 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:46:43.111 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:46:43.111 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:46:43.112 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:46:43.112 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:46:43.112 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:46:43.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:46:43.113 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:46:43.113 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:46:43.114 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:46:43.114 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:46:43.114 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:46:43.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:46:43.115 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:46:43.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:46:43.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:46:43.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:46:43.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:46:43.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:46:43.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:46:43.117 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:46:43.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 msgr2=0x7fc614067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 0x7fc614067290 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 rx=0x7fc620004630 tx=0x7fc620009b30).stop 2022-02-02T22:46:43.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 msgr2=0x7fc62c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 secure :-1 s=READY pgs=4053 cs=0 l=1 rev1=1 rx=0x7fc61c0026d0 tx=0x7fc61c009de0).stop 2022-02-02T22:46:43.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 shutdown_connections 2022-02-02T22:46:43.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc614064dd0 0x7fc614067290 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc62c0f66e0 0x7fc62c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 --2- 172.21.15.96:0/207378350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc62c0f7980 0x7fc62c107460 unknown :-1 s=CLOSED pgs=4053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 >> 172.21.15.96:0/207378350 conn(0x7fc62c0f1e40 msgr2=0x7fc62c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 shutdown_connections 2022-02-02T22:46:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.111+0000 7fc630df4700 1 -- 172.21.15.96:0/207378350 wait complete. 2022-02-02T22:46:43.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/2917495627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 msgr2=0x7f1e940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/2917495627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e940f6cc0 secure :-1 s=READY pgs=4054 cs=0 l=1 rev1=1 rx=0x7f1e80004660 tx=0x7f1e80009b30).stop 2022-02-02T22:46:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/2917495627 shutdown_connections 2022-02-02T22:46:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/2917495627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e940f6cc0 unknown :-1 s=CLOSED pgs=4054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/2917495627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 0x7f1e940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/2917495627 >> 172.21.15.96:0/2917495627 conn(0x7f1e940f0d40 msgr2=0x7f1e940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:43.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/2917495627 shutdown_connections 2022-02-02T22:46:43.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/2917495627 wait complete. 2022-02-02T22:46:43.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.208+0000 7f1e9b1e9700 1 Processor -- start 2022-02-02T22:46:43.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e9b1e9700 1 -- start start 2022-02-02T22:46:43.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e9b1e9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 0x7f1e94105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e9b1e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e9b1e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941069b0 con 0x7f1e940f6860 2022-02-02T22:46:43.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e9b1e9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941071c0 con 0x7f1e940f55c0 2022-02-02T22:46:43.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50354/0 (socket says 172.21.15.96:50354) 2022-02-02T22:46:43.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 -- 172.21.15.96:0/207740265 learned_addr learned my addr 172.21.15.96:0/207740265 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:43.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e98f85700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 0x7f1e94105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 -- 172.21.15.96:0/207740265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 msgr2=0x7f1e94105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 0x7f1e94105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.209+0000 7f1e93fff700 1 -- 172.21.15.96:0/207740265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80005040 con 0x7f1e940f6860 2022-02-02T22:46:43.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e93fff700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 secure :-1 s=READY pgs=4055 cs=0 l=1 rev1=1 rx=0x7f1e80009990 tx=0x7f1e80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:43.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8001a070 con 0x7f1e940f6860 2022-02-02T22:46:43.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e80012a80 con 0x7f1e940f6860 2022-02-02T22:46:43.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941073e0 con 0x7f1e940f6860 2022-02-02T22:46:43.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8001f870 con 0x7f1e940f6860 2022-02-02T22:46:43.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.210+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e94107940 con 0x7f1e940f6860 2022-02-02T22:46:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.211+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940f49b0 con 0x7f1e940f6860 2022-02-02T22:46:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.211+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e80012bf0 con 0x7f1e940f6860 2022-02-02T22:46:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.212+0000 7f1e917fa700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 0x7f1e84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.212+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1e80085c50 con 0x7f1e940f6860 2022-02-02T22:46:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.212+0000 7f1e98f85700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 0x7f1e84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.212+0000 7f1e98f85700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 0x7f1e84067290 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 rx=0x7f1e94105c30 tx=0x7f1e88009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.217+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e80053e10 con 0x7f1e940f6860 2022-02-02T22:46:43.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.449+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e940ff790 con 0x7f1e940f6860 2022-02-02T22:46:43.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.449+0000 7f1e917fa700 1 -- 172.21.15.96:0/207740265 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f1e80057430 con 0x7f1e940f6860 2022-02-02T22:46:43.451 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:46:43.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:46:43.452 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:46:43.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:43.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:46:43.453 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:46:43.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:43.454 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:46:43.454 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:46:43.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:43.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:46:43.455 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:46:43.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:46:43.456 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:46:43.456 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:46:43.456 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:46:43.457 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:46:43.457 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:46:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 msgr2=0x7f1e84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 0x7f1e84067290 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 rx=0x7f1e94105c30 tx=0x7f1e88009040).stop 2022-02-02T22:46:43.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 msgr2=0x7f1e941063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 secure :-1 s=READY pgs=4055 cs=0 l=1 rev1=1 rx=0x7f1e80009990 tx=0x7f1e80009b30).stop 2022-02-02T22:46:43.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 shutdown_connections 2022-02-02T22:46:43.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1e84064dd0 0x7f1e84067290 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e940f55c0 0x7f1e94105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 --2- 172.21.15.96:0/207740265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e940f6860 0x7f1e941063b0 unknown :-1 s=CLOSED pgs=4055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 >> 172.21.15.96:0/207740265 conn(0x7f1e940f0d40 msgr2=0x7f1e940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:43.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 shutdown_connections 2022-02-02T22:46:43.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.451+0000 7f1e9b1e9700 1 -- 172.21.15.96:0/207740265 wait complete. 2022-02-02T22:46:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 -- 172.21.15.96:0/3645710702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 msgr2=0x7fbe4c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 --2- 172.21.15.96:0/3645710702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c0f5850 secure :-1 s=READY pgs=4056 cs=0 l=1 rev1=1 rx=0x7fbe48004660 tx=0x7fbe48009b30).stop 2022-02-02T22:46:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 -- 172.21.15.96:0/3645710702 shutdown_connections 2022-02-02T22:46:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 --2- 172.21.15.96:0/3645710702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 --2- 172.21.15.96:0/3645710702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c0f5850 unknown :-1 s=CLOSED pgs=4056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 -- 172.21.15.96:0/3645710702 >> 172.21.15.96:0/3645710702 conn(0x7fbe4c0f0b90 msgr2=0x7fbe4c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:43.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 -- 172.21.15.96:0/3645710702 shutdown_connections 2022-02-02T22:46:43.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.549+0000 7fbe5298c700 1 -- 172.21.15.96:0/3645710702 wait complete. 2022-02-02T22:46:43.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 Processor -- start 2022-02-02T22:46:43.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 -- start start 2022-02-02T22:46:43.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c060420 con 0x7fbe4c0f5430 2022-02-02T22:46:43.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5298c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c060560 con 0x7fbe4c0f66d0 2022-02-02T22:46:43.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5198a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5198a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50362/0 (socket says 172.21.15.96:50362) 2022-02-02T22:46:43.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.550+0000 7fbe5198a700 1 -- 172.21.15.96:0/77559077 learned_addr learned my addr 172.21.15.96:0/77559077 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:46:43.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe51189700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5198a700 1 -- 172.21.15.96:0/77559077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 msgr2=0x7fbe4c109d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5198a700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c109d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5198a700 1 -- 172.21.15.96:0/77559077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48005040 con 0x7fbe4c0f5430 2022-02-02T22:46:43.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe51189700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:46:43.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5198a700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 secure :-1 s=READY pgs=4057 cs=0 l=1 rev1=1 rx=0x7fbe48000c00 tx=0x7fbe48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:43.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe48018070 con 0x7fbe4c0f5430 2022-02-02T22:46:43.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c10a2f0 con 0x7fbe4c0f5430 2022-02-02T22:46:43.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe48007d70 con 0x7fbe4c0f5430 2022-02-02T22:46:43.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4801c620 con 0x7fbe4c0f5430 2022-02-02T22:46:43.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.551+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c10a850 con 0x7fbe4c0f5430 2022-02-02T22:46:43.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.552+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c045ad0 con 0x7fbe4c0f5430 2022-02-02T22:46:43.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.553+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe4801c860 con 0x7fbe4c0f5430 2022-02-02T22:46:43.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.553+0000 7fbe427fc700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 0x7fbe380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:46:43.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.554+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbe48083b70 con 0x7fbe4c0f5430 2022-02-02T22:46:43.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.554+0000 7fbe51189700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 0x7fbe380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:46:43.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.554+0000 7fbe51189700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 0x7fbe380672e0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 rx=0x7fbe3c0041d0 tx=0x7fbe3c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:46:43.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.557+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe48051d30 con 0x7fbe4c0f5430 2022-02-02T22:46:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.761+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe4c10bbf0 con 0x7fbe4c0f5430 2022-02-02T22:46:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.761+0000 7fbe427fc700 1 -- 172.21.15.96:0/77559077 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fbe48055350 con 0x7fbe4c0f5430 2022-02-02T22:46:43.763 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:46:43.763 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:46:43.764 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:46:43.764 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:46:43.764 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:43.765 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:46:43.765 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:46:43.765 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:46:43.766 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:46:43.766 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:46:43.767 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:46:43.767 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:46:43.767 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:46:43.768 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:46:43.768 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:46:43.768 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:46:43.769 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:46:43.769 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:46:43.769 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:46:43.769 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:46:43.770 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:46:43.770 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:46:43.771 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:46:43.771 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:46:43.771 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:46:43.772 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:46:43.772 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:46:43.772 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:46:43.773 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:46:43.773 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:46:43.773 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:46:43.774 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:46:43.774 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:43.774 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:43.775 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:46:43.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:46:43.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:43.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:43.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:46:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:43 smithi159 ceph-mon[69013]: from='client.42228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:43.777 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:43 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/207740265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:46:43.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 msgr2=0x7fbe380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 0x7fbe380672e0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 rx=0x7fbe3c0041d0 tx=0x7fbe3c009040).stop 2022-02-02T22:46:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 msgr2=0x7fbe4c107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:46:43.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 secure :-1 s=READY pgs=4057 cs=0 l=1 rev1=1 rx=0x7fbe48000c00 tx=0x7fbe48009b30).stop 2022-02-02T22:46:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 shutdown_connections 2022-02-02T22:46:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbe38064e20 0x7fbe380672e0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe4c0f5430 0x7fbe4c107840 unknown :-1 s=CLOSED pgs=4057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 --2- 172.21.15.96:0/77559077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe4c0f66d0 0x7fbe4c109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:46:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 >> 172.21.15.96:0/77559077 conn(0x7fbe4c0f0b90 msgr2=0x7fbe4c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:46:43.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 shutdown_connections 2022-02-02T22:46:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:46:43.764+0000 7fbe5298c700 1 -- 172.21.15.96:0/77559077 wait complete. 2022-02-02T22:46:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:46:43.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:43 smithi096 ceph-mon[101353]: from='client.42228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:43.805 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:43 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/207740265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:46:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:44 smithi159 ceph-mon[69013]: from='client.42232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:44 smithi159 ceph-mon[69013]: pgmap v7938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:45.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:44 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/77559077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:46:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:44 smithi096 ceph-mon[101353]: from='client.42232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:46:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:44 smithi096 ceph-mon[101353]: pgmap v7938: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:44 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/77559077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:46:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:46 smithi159 ceph-mon[69013]: pgmap v7939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:46 smithi096 ceph-mon[101353]: pgmap v7939: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:48 smithi159 ceph-mon[69013]: pgmap v7940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:48 smithi096 ceph-mon[101353]: pgmap v7940: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:50 smithi159 ceph-mon[69013]: pgmap v7941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:50 smithi096 ceph-mon[101353]: pgmap v7941: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:52 smithi159 ceph-mon[69013]: pgmap v7942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:52 smithi096 ceph-mon[101353]: pgmap v7942: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:54 smithi159 ceph-mon[69013]: pgmap v7943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:55.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:54 smithi096 ceph-mon[101353]: pgmap v7943: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:56 smithi159 ceph-mon[69013]: pgmap v7944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:56 smithi096 ceph-mon[101353]: pgmap v7944: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:46:58 smithi159 ceph-mon[69013]: pgmap v7945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:46:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:46:58 smithi096 ceph-mon[101353]: pgmap v7945: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:00 smithi159 ceph-mon[69013]: pgmap v7946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:01.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:00 smithi096 ceph-mon[101353]: pgmap v7946: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:02 smithi159 ceph-mon[69013]: pgmap v7947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:02 smithi096 ceph-mon[101353]: pgmap v7947: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:04 smithi159 ceph-mon[69013]: pgmap v7948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:04 smithi096 ceph-mon[101353]: pgmap v7948: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:06 smithi159 ceph-mon[69013]: pgmap v7949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:06 smithi096 ceph-mon[101353]: pgmap v7949: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:08 smithi159 ceph-mon[69013]: pgmap v7950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:08 smithi096 ceph-mon[101353]: pgmap v7950: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:10 smithi159 ceph-mon[69013]: pgmap v7951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:10 smithi096 ceph-mon[101353]: pgmap v7951: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:12 smithi159 ceph-mon[69013]: pgmap v7952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:12 smithi096 ceph-mon[101353]: pgmap v7952: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:13.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 -- 172.21.15.96:0/2358927341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f7980 msgr2=0x7f6c400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:13.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 --2- 172.21.15.96:0/2358927341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f7980 0x7f6c400f7de0 secure :-1 s=READY pgs=4058 cs=0 l=1 rev1=1 rx=0x7f6c30004660 tx=0x7f6c30009b30).stop 2022-02-02T22:47:13.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 -- 172.21.15.96:0/2358927341 shutdown_connections 2022-02-02T22:47:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 --2- 172.21.15.96:0/2358927341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f7980 0x7f6c400f7de0 unknown :-1 s=CLOSED pgs=4058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 --2- 172.21.15.96:0/2358927341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f66e0 0x7f6c400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.876+0000 7f6c44afb700 1 -- 172.21.15.96:0/2358927341 >> 172.21.15.96:0/2358927341 conn(0x7f6c400f1e40 msgr2=0x7f6c400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:13.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 -- 172.21.15.96:0/2358927341 shutdown_connections 2022-02-02T22:47:13.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 -- 172.21.15.96:0/2358927341 wait complete. 2022-02-02T22:47:13.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 Processor -- start 2022-02-02T22:47:13.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 -- start start 2022-02-02T22:47:13.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:13.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f7980 0x7f6c40069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:13.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4006a380 con 0x7f6c400f66e0 2022-02-02T22:47:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c44afb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4006a4c0 con 0x7f6c400f7980 2022-02-02T22:47:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c3e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.877+0000 7f6c3e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50384/0 (socket says 172.21.15.96:50384) 2022-02-02T22:47:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3e59c700 1 -- 172.21.15.96:0/3713204312 learned_addr learned my addr 172.21.15.96:0/3713204312 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:13.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3dd9b700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f7980 0x7f6c40069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3e59c700 1 -- 172.21.15.96:0/3713204312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f7980 msgr2=0x7f6c40069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3e59c700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f7980 0x7f6c40069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:13.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3e59c700 1 -- 172.21.15.96:0/3713204312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30005040 con 0x7f6c400f66e0 2022-02-02T22:47:13.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c3e59c700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 secure :-1 s=READY pgs=4059 cs=0 l=1 rev1=1 rx=0x7f6c34002700 tx=0x7f6c34009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:13.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c340079c0 con 0x7f6c400f66e0 2022-02-02T22:47:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4006a7a0 con 0x7f6c400f66e0 2022-02-02T22:47:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c3400f040 con 0x7f6c400f66e0 2022-02-02T22:47:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c34014860 con 0x7f6c400f66e0 2022-02-02T22:47:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.878+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4010ef90 con 0x7f6c400f66e0 2022-02-02T22:47:13.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.879+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40045ad0 con 0x7f6c400f66e0 2022-02-02T22:47:13.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.880+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c3401b060 con 0x7f6c400f66e0 2022-02-02T22:47:13.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.880+0000 7f6c2effd700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 0x7f6c28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:13.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.880+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6c340818e0 con 0x7f6c400f66e0 2022-02-02T22:47:13.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.880+0000 7f6c3dd9b700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 0x7f6c28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:13.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.880+0000 7f6c3dd9b700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 0x7f6c28067290 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f6c30004630 tx=0x7f6c30009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:13.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:13.884+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c3404f9e0 con 0x7f6c400f66e0 2022-02-02T22:47:14.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.063+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c400ff050 con 0x7f6c28064dd0 2022-02-02T22:47:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.064+0000 7f6c2effd700 1 -- 172.21.15.96:0/3713204312 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6c30019040 con 0x7f6c28064dd0 2022-02-02T22:47:14.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 msgr2=0x7f6c28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 0x7f6c28067290 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f6c30004630 tx=0x7f6c30009b30).stop 2022-02-02T22:47:14.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 msgr2=0x7f6c4006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 secure :-1 s=READY pgs=4059 cs=0 l=1 rev1=1 rx=0x7f6c34002700 tx=0x7f6c34009d80).stop 2022-02-02T22:47:14.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 shutdown_connections 2022-02-02T22:47:14.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c28064dd0 0x7f6c28067290 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c400f66e0 0x7f6c4006b9a0 unknown :-1 s=CLOSED pgs=4059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 --2- 172.21.15.96:0/3713204312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c400f7980 0x7f6c40069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 >> 172.21.15.96:0/3713204312 conn(0x7f6c400f1e40 msgr2=0x7f6c400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 shutdown_connections 2022-02-02T22:47:14.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.066+0000 7f6c44afb700 1 -- 172.21.15.96:0/3713204312 wait complete. 2022-02-02T22:47:14.075 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:47:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 -- 172.21.15.96:0/239965172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f66d0 msgr2=0x7f1f6c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 --2- 172.21.15.96:0/239965172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c0f6b30 secure :-1 s=READY pgs=4060 cs=0 l=1 rev1=1 rx=0x7f1f68004660 tx=0x7f1f68009b30).stop 2022-02-02T22:47:14.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 -- 172.21.15.96:0/239965172 shutdown_connections 2022-02-02T22:47:14.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 --2- 172.21.15.96:0/239965172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c0f6b30 unknown :-1 s=CLOSED pgs=4060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 --2- 172.21.15.96:0/239965172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f5430 0x7f1f6c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 -- 172.21.15.96:0/239965172 >> 172.21.15.96:0/239965172 conn(0x7f1f6c0f0b90 msgr2=0x7f1f6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 -- 172.21.15.96:0/239965172 shutdown_connections 2022-02-02T22:47:14.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.163+0000 7f1f7309d700 1 -- 172.21.15.96:0/239965172 wait complete. 2022-02-02T22:47:14.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 Processor -- start 2022-02-02T22:47:14.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 -- start start 2022-02-02T22:47:14.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f5430 0x7f1f6c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0603e0 con 0x7f1f6c0f5430 2022-02-02T22:47:14.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7309d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c060520 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.164+0000 7f1f7189a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:54498/0 (socket says 172.21.15.96:54498) 2022-02-02T22:47:14.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 -- 172.21.15.96:0/3325578896 learned_addr learned my addr 172.21.15.96:0/3325578896 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:14.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 -- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f5430 msgr2=0x7f1f6c109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f5430 0x7f1f6c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:47:14.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 -- 172.21.15.96:0/3325578896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68005040 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7189a700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1f68009990 tx=0x7f1f68009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68018070 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c10c470 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f68007ca0 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6801c620 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.165+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c10c9d0 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.166+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c045ad0 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.167+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f6801d960 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.167+0000 7f1f62ffd700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 0x7f1f580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.167+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1f680837d0 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.167+0000 7f1f7209b700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 0x7f1f580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.167+0000 7f1f7209b700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 0x7f1f580672e0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 rx=0x7f1f6c060060 tx=0x7f1f5c007a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.172+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f68051a40 con 0x7f1f6c0f66d0 2022-02-02T22:47:14.343 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.344+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f6c057f10 con 0x7f1f58064e20 2022-02-02T22:47:14.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.353+0000 7f1f62ffd700 1 -- 172.21.15.96:0/3325578896 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1f6c057f10 con 0x7f1f58064e20 2022-02-02T22:47:14.354 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:47:14.354 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:47:14.354 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:47:14.355 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 3h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:47:14.356 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:47:14.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:47:14.356 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:47:14.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 3h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:47:14.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 3h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:47:14.357 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:47:14.358 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 3h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:47:14.358 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:47:14.359 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 3h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:47:14.359 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:47:14.359 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 3h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:47:14.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:47:14.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:47:14.360 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:47:14.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 3h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:47:14.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 3h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:47:14.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 3h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:47:14.362 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:47:14.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 msgr2=0x7f1f580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 0x7f1f580672e0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 rx=0x7f1f6c060060 tx=0x7f1f5c007a60).stop 2022-02-02T22:47:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 msgr2=0x7f1f6c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1f68009990 tx=0x7f1f68009b30).stop 2022-02-02T22:47:14.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 shutdown_connections 2022-02-02T22:47:14.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1f58064e20 0x7f1f580672e0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0f5430 0x7f1f6c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:47:14.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 --2- 172.21.15.96:0/3325578896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c0f66d0 0x7f1f6c10bf20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 >> 172.21.15.96:0/3325578896 conn(0x7f1f6c0f0b90 msgr2=0x7f1f6c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 shutdown_connections 2022-02-02T22:47:14.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.355+0000 7f1f7309d700 1 -- 172.21.15.96:0/3325578896 wait complete. 2022-02-02T22:47:14.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 -- 172.21.15.96:0/2840708018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f66e0 msgr2=0x7f87c40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2840708018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f66e0 0x7f87c40f6b40 secure :-1 s=READY pgs=4061 cs=0 l=1 rev1=1 rx=0x7f87b8004660 tx=0x7f87b8009b30).stop 2022-02-02T22:47:14.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 -- 172.21.15.96:0/2840708018 shutdown_connections 2022-02-02T22:47:14.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2840708018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f66e0 0x7f87c40f6b40 unknown :-1 s=CLOSED pgs=4061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2840708018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f5440 0x7f87c40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 -- 172.21.15.96:0/2840708018 >> 172.21.15.96:0/2840708018 conn(0x7f87c40f0ba0 msgr2=0x7f87c40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.451+0000 7f87c3fff700 1 -- 172.21.15.96:0/2840708018 shutdown_connections 2022-02-02T22:47:14.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.452+0000 7f87c3fff700 1 -- 172.21.15.96:0/2840708018 wait complete. 2022-02-02T22:47:14.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.452+0000 7f87c3fff700 1 Processor -- start 2022-02-02T22:47:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.452+0000 7f87c3fff700 1 -- start start 2022-02-02T22:47:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 0x7f87c4106070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c3fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4106620 con 0x7f87c40f5440 2022-02-02T22:47:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4106760 con 0x7f87c40f66e0 2022-02-02T22:47:14.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50402/0 (socket says 172.21.15.96:50402) 2022-02-02T22:47:14.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 -- 172.21.15.96:0/2535067855 learned_addr learned my addr 172.21.15.96:0/2535067855 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:14.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c27fc700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 0x7f87c4106070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 -- 172.21.15.96:0/2535067855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 msgr2=0x7f87c4106070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 0x7f87c4106070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 -- 172.21.15.96:0/2535067855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8005040 con 0x7f87c40f5440 2022-02-02T22:47:14.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c27fc700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 0x7f87c4106070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:47:14.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c2ffd700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 secure :-1 s=READY pgs=4062 cs=0 l=1 rev1=1 rx=0x7f87b4002700 tx=0x7f87b4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b40079c0 con 0x7f87c40f5440 2022-02-02T22:47:14.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.453+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c4107100 con 0x7f87c40f5440 2022-02-02T22:47:14.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.454+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f87b400f040 con 0x7f87c40f5440 2022-02-02T22:47:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.454+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b4014850 con 0x7f87c40f5440 2022-02-02T22:47:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.454+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41076c0 con 0x7f87c40f5440 2022-02-02T22:47:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.455+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c4045ad0 con 0x7f87c40f5440 2022-02-02T22:47:14.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.455+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f87b401b060 con 0x7f87c40f5440 2022-02-02T22:47:14.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.455+0000 7f87ab7fe700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 0x7f87ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.455+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f87b4081990 con 0x7f87c40f5440 2022-02-02T22:47:14.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.455+0000 7f87c27fc700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 0x7f87ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.456+0000 7f87c27fc700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 0x7f87ac0672e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7f87b8005010 tx=0x7f87b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.460+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f87b4053610 con 0x7f87c40f5440 2022-02-02T22:47:14.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.690+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87c40fdd00 con 0x7f87c40f5440 2022-02-02T22:47:14.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.690+0000 7f87ab7fe700 1 -- 172.21.15.96:0/2535067855 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f87b40192e0 con 0x7f87c40f5440 2022-02-02T22:47:14.691 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:47:14.692 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:47:14.692 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:47:14.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:14.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:47:14.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:47:14.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:14.694 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:47:14.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:47:14.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:14.695 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:47:14.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:47:14.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:14.696 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:47:14.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:47:14.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:47:14.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:47:14.698 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:47:14.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 msgr2=0x7f87ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 0x7f87ac0672e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7f87b8005010 tx=0x7f87b8009b30).stop 2022-02-02T22:47:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 msgr2=0x7f87c4105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 secure :-1 s=READY pgs=4062 cs=0 l=1 rev1=1 rx=0x7f87b4002700 tx=0x7f87b4009e00).stop 2022-02-02T22:47:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 shutdown_connections 2022-02-02T22:47:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f87ac064e20 0x7f87ac0672e0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87c40f5440 0x7f87c4105b80 unknown :-1 s=CLOSED pgs=4062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 --2- 172.21.15.96:0/2535067855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c40f66e0 0x7f87c4106070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 >> 172.21.15.96:0/2535067855 conn(0x7f87c40f0ba0 msgr2=0x7f87c40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.692+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 shutdown_connections 2022-02-02T22:47:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.693+0000 7f87c3fff700 1 -- 172.21.15.96:0/2535067855 wait complete. 2022-02-02T22:47:14.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 -- 172.21.15.96:0/1633521836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f5bb0 msgr2=0x7ff93c0f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 --2- 172.21.15.96:0/1633521836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c0f5fd0 secure :-1 s=READY pgs=4063 cs=0 l=1 rev1=1 rx=0x7ff930004660 tx=0x7ff930009b30).stop 2022-02-02T22:47:14.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 -- 172.21.15.96:0/1633521836 shutdown_connections 2022-02-02T22:47:14.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 --2- 172.21.15.96:0/1633521836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f6550 0x7ff93c0f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 --2- 172.21.15.96:0/1633521836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c0f5fd0 unknown :-1 s=CLOSED pgs=4063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 -- 172.21.15.96:0/1633521836 >> 172.21.15.96:0/1633521836 conn(0x7ff93c0f04c0 msgr2=0x7ff93c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:14.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 -- 172.21.15.96:0/1633521836 shutdown_connections 2022-02-02T22:47:14.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.790+0000 7ff942e81700 1 -- 172.21.15.96:0/1633521836 wait complete. 2022-02-02T22:47:14.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 Processor -- start 2022-02-02T22:47:14.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 -- start start 2022-02-02T22:47:14.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c10c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0f5570 con 0x7ff93c0f6550 2022-02-02T22:47:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff942e81700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0f56b0 con 0x7ff93c0f5bb0 2022-02-02T22:47:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50410/0 (socket says 172.21.15.96:50410) 2022-02-02T22:47:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 -- 172.21.15.96:0/1486470119 learned_addr learned my addr 172.21.15.96:0/1486470119 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff940c1d700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c10c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 -- 172.21.15.96:0/1486470119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f5bb0 msgr2=0x7ff93c10c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:14.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c10c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.791+0000 7ff93bfff700 1 -- 172.21.15.96:0/1486470119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930005040 con 0x7ff93c0f6550 2022-02-02T22:47:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff93bfff700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 secure :-1 s=READY pgs=4064 cs=0 l=1 rev1=1 rx=0x7ff9280026d0 tx=0x7ff928009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9280079c0 con 0x7ff93c0f6550 2022-02-02T22:47:14.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff92800f040 con 0x7ff93c0f6550 2022-02-02T22:47:14.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c10eb50 con 0x7ff93c0f6550 2022-02-02T22:47:14.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9280148b0 con 0x7ff93c0f6550 2022-02-02T22:47:14.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.792+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c10efd0 con 0x7ff93c0f6550 2022-02-02T22:47:14.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.793+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c045ad0 con 0x7ff93c0f6550 2022-02-02T22:47:14.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.793+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff928007b20 con 0x7ff93c0f6550 2022-02-02T22:47:14.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.793+0000 7ff9397fa700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:14.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.794+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff9280818b0 con 0x7ff93c0f6550 2022-02-02T22:47:14.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.794+0000 7ff940c1d700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:14.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.794+0000 7ff940c1d700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 0x7ff92c067290 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 rx=0x7ff930004630 tx=0x7ff930009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:14.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.798+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff92804f9b0 con 0x7ff93c0f6550 2022-02-02T22:47:14.998 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.997+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff93c0f5840 con 0x7ff93c0f6550 2022-02-02T22:47:14.999 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:14 smithi096 ceph-mon[101353]: pgmap v7953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:15.000 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:14 smithi096 ceph-mon[101353]: from='client.42244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:15.000 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:14 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2535067855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:47:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:14.998+0000 7ff9397fa700 1 -- 172.21.15.96:0/1486470119 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff928052fd0 con 0x7ff93c0f6550 2022-02-02T22:47:15.002 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:47:15.002 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:47:15.002 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:47:15.003 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:47:15.003 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:15.003 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:47:15.004 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:47:15.004 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:47:15.005 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:47:15.005 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:47:15.005 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:47:15.006 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:47:15.006 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:47:15.007 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:47:15.007 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:47:15.008 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:47:15.008 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:47:15.008 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:47:15.009 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:47:15.009 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:47:15.010 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:47:15.010 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:47:15.011 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:47:15.011 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:47:15.011 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:47:15.012 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:47:15.012 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:47:15.012 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:47:15.013 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:47:15.013 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:47:15.013 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:47:15.014 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:47:15.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:15.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:15.015 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:47:15.015 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:15.015 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:15.016 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:15.016 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:15.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 msgr2=0x7ff92c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 0x7ff92c067290 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 rx=0x7ff930004630 tx=0x7ff930009b30).stop 2022-02-02T22:47:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 msgr2=0x7ff93c10e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:15.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 secure :-1 s=READY pgs=4064 cs=0 l=1 rev1=1 rx=0x7ff9280026d0 tx=0x7ff928009de0).stop 2022-02-02T22:47:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 shutdown_connections 2022-02-02T22:47:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93c0f5bb0 0x7ff93c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 --2- 172.21.15.96:0/1486470119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff93c0f6550 0x7ff93c10e660 unknown :-1 s=CLOSED pgs=4064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 >> 172.21.15.96:0/1486470119 conn(0x7ff93c0f04c0 msgr2=0x7ff93c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 shutdown_connections 2022-02-02T22:47:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:15.000+0000 7ff942e81700 1 -- 172.21.15.96:0/1486470119 wait complete. 2022-02-02T22:47:15.021 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:47:15.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:14 smithi159 ceph-mon[69013]: pgmap v7953: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:14 smithi159 ceph-mon[69013]: from='client.42244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:14 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2535067855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:47:16.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:15 smithi159 ceph-mon[69013]: from='client.49327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:16.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:15 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1486470119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:47:16.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:15 smithi096 ceph-mon[101353]: from='client.49327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:16.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:15 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1486470119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:47:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:16 smithi159 ceph-mon[69013]: pgmap v7954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:16 smithi096 ceph-mon[101353]: pgmap v7954: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:18 smithi159 ceph-mon[69013]: pgmap v7955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:18 smithi096 ceph-mon[101353]: pgmap v7955: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:20 smithi159 ceph-mon[69013]: pgmap v7956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:20 smithi096 ceph-mon[101353]: pgmap v7956: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:22 smithi159 ceph-mon[69013]: pgmap v7957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:22 smithi096 ceph-mon[101353]: pgmap v7957: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:24 smithi159 ceph-mon[69013]: pgmap v7958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:24 smithi096 ceph-mon[101353]: pgmap v7958: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:27.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:26 smithi159 ceph-mon[69013]: pgmap v7959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:26 smithi096 ceph-mon[101353]: pgmap v7959: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:28 smithi159 ceph-mon[69013]: pgmap v7960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:47:29.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:47:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:28 smithi096 ceph-mon[101353]: pgmap v7960: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:47:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:47:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:30 smithi159 ceph-mon[69013]: pgmap v7961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:30 smithi096 ceph-mon[101353]: pgmap v7961: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:32 smithi159 ceph-mon[69013]: pgmap v7962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:32 smithi096 ceph-mon[101353]: pgmap v7962: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:35.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:34 smithi096 ceph-mon[101353]: pgmap v7963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:34 smithi159 ceph-mon[69013]: pgmap v7963: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:37.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:36 smithi096 ceph-mon[101353]: pgmap v7964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:37.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:36 smithi159 ceph-mon[69013]: pgmap v7964: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:38 smithi096 ceph-mon[101353]: pgmap v7965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:38 smithi159 ceph-mon[69013]: pgmap v7965: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:40 smithi096 ceph-mon[101353]: pgmap v7966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:40 smithi159 ceph-mon[69013]: pgmap v7966: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:42 smithi096 ceph-mon[101353]: pgmap v7967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:42 smithi159 ceph-mon[69013]: pgmap v7967: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:44 smithi096 ceph-mon[101353]: pgmap v7968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:45.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 -- 172.21.15.96:0/643749522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 msgr2=0x7fec140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 --2- 172.21.15.96:0/643749522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f5850 secure :-1 s=READY pgs=4065 cs=0 l=1 rev1=1 rx=0x7fec040099e0 tx=0x7fec04004d10).stop 2022-02-02T22:47:45.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 -- 172.21.15.96:0/643749522 shutdown_connections 2022-02-02T22:47:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 --2- 172.21.15.96:0/643749522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 0x7fec140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:47:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 --2- 172.21.15.96:0/643749522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f5850 unknown :-1 s=CLOSED pgs=4065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 -- 172.21.15.96:0/643749522 >> 172.21.15.96:0/643749522 conn(0x7fec140f0b90 msgr2=0x7fec140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 -- 172.21.15.96:0/643749522 shutdown_connections 2022-02-02T22:47:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 -- 172.21.15.96:0/643749522 wait complete. 2022-02-02T22:47:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.111+0000 7fec18966700 1 Processor -- start 2022-02-02T22:47:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec18966700 1 -- start start 2022-02-02T22:47:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec18966700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec18966700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 0x7fec140f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec18966700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140f8000 con 0x7fec140f5430 2022-02-02T22:47:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec18966700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140f8140 con 0x7fec140f66d0 2022-02-02T22:47:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50426/0 (socket says 172.21.15.96:50426) 2022-02-02T22:47:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 -- 172.21.15.96:0/3590700230 learned_addr learned my addr 172.21.15.96:0/3590700230 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec12ffd700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 0x7fec140f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 -- 172.21.15.96:0/3590700230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 msgr2=0x7fec140f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 0x7fec140f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 -- 172.21.15.96:0/3590700230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009640 con 0x7fec140f5430 2022-02-02T22:47:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.112+0000 7fec137fe700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 secure :-1 s=READY pgs=4066 cs=0 l=1 rev1=1 rx=0x7fec0400c010 tx=0x7fec04004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.113+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0400e070 con 0x7fec140f5430 2022-02-02T22:47:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.113+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec140f83c0 con 0x7fec140f5430 2022-02-02T22:47:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.113+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec04007d10 con 0x7fec140f5430 2022-02-02T22:47:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.113+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec04018070 con 0x7fec140f5430 2022-02-02T22:47:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.113+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1410ef20 con 0x7fec140f5430 2022-02-02T22:47:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.114+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec14045ad0 con 0x7fec140f5430 2022-02-02T22:47:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.114+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec04024060 con 0x7fec140f5430 2022-02-02T22:47:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.115+0000 7fec0bfff700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 0x7fec000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.115+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fec040833c0 con 0x7fec140f5430 2022-02-02T22:47:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.115+0000 7fec12ffd700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 0x7fec000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.115+0000 7fec12ffd700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 0x7fec000672e0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7febfc006fd0 tx=0x7febfc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.119+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec040514c0 con 0x7fec140f5430 2022-02-02T22:47:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:44 smithi159 ceph-mon[69013]: pgmap v7968: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:45.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.297+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec140fab10 con 0x7fec00064e20 2022-02-02T22:47:45.298 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.298+0000 7fec0bfff700 1 -- 172.21.15.96:0/3590700230 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fec140fab10 con 0x7fec00064e20 2022-02-02T22:47:45.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 msgr2=0x7fec000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 0x7fec000672e0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7febfc006fd0 tx=0x7febfc008040).stop 2022-02-02T22:47:45.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 msgr2=0x7fec140f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 secure :-1 s=READY pgs=4066 cs=0 l=1 rev1=1 rx=0x7fec0400c010 tx=0x7fec04004d10).stop 2022-02-02T22:47:45.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 shutdown_connections 2022-02-02T22:47:45.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fec00064e20 0x7fec000672e0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec140f5430 0x7fec140f9590 unknown :-1 s=CLOSED pgs=4066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 --2- 172.21.15.96:0/3590700230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec140f66d0 0x7fec140f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 >> 172.21.15.96:0/3590700230 conn(0x7fec140f0b90 msgr2=0x7fec1405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 shutdown_connections 2022-02-02T22:47:45.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.300+0000 7fec18966700 1 -- 172.21.15.96:0/3590700230 wait complete. 2022-02-02T22:47:45.310 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:47:45.397 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 -- 172.21.15.96:0/4179203918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f5ed0 msgr2=0x7f50940f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 --2- 172.21.15.96:0/4179203918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f5ed0 0x7f50940f6900 secure :-1 s=READY pgs=4067 cs=0 l=1 rev1=1 rx=0x7f5084004660 tx=0x7f5084009b30).stop 2022-02-02T22:47:45.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 -- 172.21.15.96:0/4179203918 shutdown_connections 2022-02-02T22:47:45.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 --2- 172.21.15.96:0/4179203918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f5ed0 0x7f50940f6900 unknown :-1 s=CLOSED pgs=4067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 --2- 172.21.15.96:0/4179203918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f55c0 0x7f50940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 -- 172.21.15.96:0/4179203918 >> 172.21.15.96:0/4179203918 conn(0x7f50940f0de0 msgr2=0x7f50940f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 -- 172.21.15.96:0/4179203918 shutdown_connections 2022-02-02T22:47:45.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.397+0000 7f50995a0700 1 -- 172.21.15.96:0/4179203918 wait complete. 2022-02-02T22:47:45.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.398+0000 7f50995a0700 1 Processor -- start 2022-02-02T22:47:45.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.398+0000 7f50995a0700 1 -- start start 2022-02-02T22:47:45.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50995a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50995a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f5ed0 0x7f509410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50995a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094060480 con 0x7f50940f55c0 2022-02-02T22:47:45.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50995a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940605c0 con 0x7f50940f5ed0 2022-02-02T22:47:45.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50436/0 (socket says 172.21.15.96:50436) 2022-02-02T22:47:45.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 -- 172.21.15.96:0/4057563139 learned_addr learned my addr 172.21.15.96:0/4057563139 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:45.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50927fc700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f5ed0 0x7f509410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 -- 172.21.15.96:0/4057563139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f5ed0 msgr2=0x7f509410c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f5ed0 0x7f509410c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 -- 172.21.15.96:0/4057563139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084005040 con 0x7f50940f55c0 2022-02-02T22:47:45.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f5092ffd700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 secure :-1 s=READY pgs=4068 cs=0 l=1 rev1=1 rx=0x7f50880026d0 tx=0x7f5088009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50880079c0 con 0x7f50940f55c0 2022-02-02T22:47:45.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509410c6d0 con 0x7f50940f55c0 2022-02-02T22:47:45.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.399+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f508800f040 con 0x7f50940f55c0 2022-02-02T22:47:45.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.400+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50880148b0 con 0x7f50940f55c0 2022-02-02T22:47:45.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.400+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509410cc90 con 0x7f50940f55c0 2022-02-02T22:47:45.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.401+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5094045ad0 con 0x7f50940f55c0 2022-02-02T22:47:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.401+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5088007b20 con 0x7f50940f55c0 2022-02-02T22:47:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.401+0000 7f507b7fe700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 0x7f507c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.402+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5088081990 con 0x7f50940f55c0 2022-02-02T22:47:45.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.402+0000 7f50927fc700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 0x7f507c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.402+0000 7f50927fc700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 0x7f507c067270 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 rx=0x7f5084004e30 tx=0x7f5084009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.406+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f508804fa90 con 0x7f50940f55c0 2022-02-02T22:47:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.578+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50940fdef0 con 0x7f507c064db0 2022-02-02T22:47:45.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.588+0000 7f507b7fe700 1 -- 172.21.15.96:0/4057563139 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f50940fdef0 con 0x7f507c064db0 2022-02-02T22:47:45.588 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:47:45.589 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:47:45.589 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:47:45.590 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:47:45.590 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:47:45.590 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:47:45.591 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:47:45.591 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:47:45.591 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:47:45.592 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:47:45.592 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:47:45.593 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:47:45.593 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:47:45.593 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:47:45.594 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:47:45.594 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:47:45.594 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:47:45.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:47:45.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:47:45.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:47:45.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:47:45.596 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:47:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.589+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 msgr2=0x7f507c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.589+0000 7f50995a0700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 0x7f507c067270 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 rx=0x7f5084004e30 tx=0x7f5084009b30).stop 2022-02-02T22:47:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.589+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 msgr2=0x7f5094109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.589+0000 7f50995a0700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 secure :-1 s=READY pgs=4068 cs=0 l=1 rev1=1 rx=0x7f50880026d0 tx=0x7f5088009de0).stop 2022-02-02T22:47:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 shutdown_connections 2022-02-02T22:47:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f507c064db0 0x7f507c067270 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50940f55c0 0x7f5094109c20 unknown :-1 s=CLOSED pgs=4068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 --2- 172.21.15.96:0/4057563139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50940f5ed0 0x7f509410c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 >> 172.21.15.96:0/4057563139 conn(0x7f50940f0de0 msgr2=0x7f50940fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 shutdown_connections 2022-02-02T22:47:45.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.590+0000 7f50995a0700 1 -- 172.21.15.96:0/4057563139 wait complete. 2022-02-02T22:47:45.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 -- 172.21.15.96:0/144117045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f6550 msgr2=0x7ff5680f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/144117045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f6550 0x7ff5680f69b0 secure :-1 s=READY pgs=4069 cs=0 l=1 rev1=1 rx=0x7ff55c004660 tx=0x7ff55c009b30).stop 2022-02-02T22:47:45.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 -- 172.21.15.96:0/144117045 shutdown_connections 2022-02-02T22:47:45.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/144117045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f6550 0x7ff5680f69b0 unknown :-1 s=CLOSED pgs=4069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/144117045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f5bb0 0x7ff5680f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 -- 172.21.15.96:0/144117045 >> 172.21.15.96:0/144117045 conn(0x7ff5680f04c0 msgr2=0x7ff5680f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.686+0000 7ff56d9a0700 1 -- 172.21.15.96:0/144117045 shutdown_connections 2022-02-02T22:47:45.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 -- 172.21.15.96:0/144117045 wait complete. 2022-02-02T22:47:45.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 Processor -- start 2022-02-02T22:47:45.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 -- start start 2022-02-02T22:47:45.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f6550 0x7ff56810c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680f56a0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.687+0000 7ff56d9a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680f57e0 con 0x7ff5680f6550 2022-02-02T22:47:45.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50446/0 (socket says 172.21.15.96:50446) 2022-02-02T22:47:45.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 -- 172.21.15.96:0/951323431 learned_addr learned my addr 172.21.15.96:0/951323431 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:45.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff5667fc700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f6550 0x7ff56810c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 -- 172.21.15.96:0/951323431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f6550 msgr2=0x7ff56810c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f6550 0x7ff56810c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 -- 172.21.15.96:0/951323431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c005040 con 0x7ff5680f5bb0 2022-02-02T22:47:45.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff566ffd700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 secure :-1 s=READY pgs=4070 cs=0 l=1 rev1=1 rx=0x7ff558002700 tx=0x7ff558009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5580079c0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff55800f040 con 0x7ff5680f5bb0 2022-02-02T22:47:45.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56810c6f0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558014860 con 0x7ff5680f5bb0 2022-02-02T22:47:45.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.688+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56810ccb0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.690+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568045ad0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.690+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff55801b060 con 0x7ff5680f5bb0 2022-02-02T22:47:45.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.690+0000 7ff54f7fe700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 0x7ff55006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:45.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.691+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff558081800 con 0x7ff5680f5bb0 2022-02-02T22:47:45.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.691+0000 7ff5667fc700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 0x7ff55006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:45.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.691+0000 7ff5667fc700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 0x7ff55006b6a0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7ff55c004630 tx=0x7ff55c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:45.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.695+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff55804f900 con 0x7ff5680f5bb0 2022-02-02T22:47:45.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.927+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff568027a00 con 0x7ff5680f5bb0 2022-02-02T22:47:45.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.928+0000 7ff54f7fe700 1 -- 172.21.15.96:0/951323431 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7ff5580192e0 con 0x7ff5680f5bb0 2022-02-02T22:47:45.930 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:47:45.931 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:47:45.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:47:45.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:45.933 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:47:45.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:47:45.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:45.934 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:47:45.935 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:47:45.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:45.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:47:45.937 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:47:45.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:47:45.938 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:47:45.939 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:47:45.940 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:47:45.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:47:45.941 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:47:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.929+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 msgr2=0x7ff55006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.929+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 0x7ff55006b6a0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7ff55c004630 tx=0x7ff55c009b30).stop 2022-02-02T22:47:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 msgr2=0x7ff568109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 secure :-1 s=READY pgs=4070 cs=0 l=1 rev1=1 rx=0x7ff558002700 tx=0x7ff558009d80).stop 2022-02-02T22:47:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 shutdown_connections 2022-02-02T22:47:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff5500691e0 0x7ff55006b6a0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5680f5bb0 0x7ff568109c40 unknown :-1 s=CLOSED pgs=4070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 --2- 172.21.15.96:0/951323431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5680f6550 0x7ff56810c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:45.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 >> 172.21.15.96:0/951323431 conn(0x7ff5680f04c0 msgr2=0x7ff5680fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 shutdown_connections 2022-02-02T22:47:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:45.930+0000 7ff56d9a0700 1 -- 172.21.15.96:0/951323431 wait complete. 2022-02-02T22:47:46.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- 172.21.15.96:0/368661095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f66e0 msgr2=0x7f7aa00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:46.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 --2- 172.21.15.96:0/368661095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f66e0 0x7f7aa00f6b00 secure :-1 s=READY pgs=4071 cs=0 l=1 rev1=1 rx=0x7f7a90004660 tx=0x7f7a90009b30).stop 2022-02-02T22:47:46.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- 172.21.15.96:0/368661095 shutdown_connections 2022-02-02T22:47:46.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 --2- 172.21.15.96:0/368661095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f7980 0x7f7aa00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 --2- 172.21.15.96:0/368661095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f66e0 0x7f7aa00f6b00 unknown :-1 s=CLOSED pgs=4071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- 172.21.15.96:0/368661095 >> 172.21.15.96:0/368661095 conn(0x7f7aa00f1e40 msgr2=0x7f7aa00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:46.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- 172.21.15.96:0/368661095 shutdown_connections 2022-02-02T22:47:46.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- 172.21.15.96:0/368661095 wait complete. 2022-02-02T22:47:46.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 Processor -- start 2022-02-02T22:47:46.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.027+0000 7f7aa873e700 1 -- start start 2022-02-02T22:47:46.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa873e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f66e0 0x7f7aa006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:46.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa873e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:46.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa873e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa006a380 con 0x7f7aa00f7980 2022-02-02T22:47:46.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa873e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa006a4c0 con 0x7f7aa00f66e0 2022-02-02T22:47:46.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:46.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50458/0 (socket says 172.21.15.96:50458) 2022-02-02T22:47:46.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 -- 172.21.15.96:0/2007074344 learned_addr learned my addr 172.21.15.96:0/2007074344 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:47:46.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa64da700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f66e0 0x7f7aa006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:46.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 -- 172.21.15.96:0/2007074344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f66e0 msgr2=0x7f7aa006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:46.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f66e0 0x7f7aa006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 -- 172.21.15.96:0/2007074344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90005040 con 0x7f7aa00f7980 2022-02-02T22:47:46.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.028+0000 7f7aa5cd9700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 secure :-1 s=READY pgs=4072 cs=0 l=1 rev1=1 rx=0x7f7a9c0026d0 tx=0x7f7a9c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:46.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.029+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9c0079c0 con 0x7f7aa00f7980 2022-02-02T22:47:46.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.029+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa006a7a0 con 0x7f7aa00f7980 2022-02-02T22:47:46.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.029+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a9c00f040 con 0x7f7aa00f7980 2022-02-02T22:47:46.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.029+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9c0148b0 con 0x7f7aa00f7980 2022-02-02T22:47:46.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.029+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa010efe0 con 0x7f7aa00f7980 2022-02-02T22:47:46.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.030+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa0045ad0 con 0x7f7aa00f7980 2022-02-02T22:47:46.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.030+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a9c007b20 con 0x7f7aa00f7980 2022-02-02T22:47:46.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.030+0000 7f7a96ffd700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 0x7f7a8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:47:46.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.030+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7a9c0819e0 con 0x7f7aa00f7980 2022-02-02T22:47:46.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.030+0000 7f7aa64da700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 0x7f7a8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:47:46.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.031+0000 7f7aa64da700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 0x7f7a8c067290 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 rx=0x7f7a90013690 tx=0x7f7a90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:47:46.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.035+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a9c04fae0 con 0x7f7aa00f7980 2022-02-02T22:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.237+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7aa0027a00 con 0x7f7aa00f7980 2022-02-02T22:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.237+0000 7f7a96ffd700 1 -- 172.21.15.96:0/2007074344 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f7a9c053100 con 0x7f7aa00f7980 2022-02-02T22:47:46.238 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:47:46.239 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:47:46.239 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:47:46.239 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:47:46.240 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:46.240 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:47:46.241 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:47:46.241 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:47:46.241 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:47:46.242 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:47:46.242 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:47:46.243 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:47:46.243 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:47:46.245 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:47:46.245 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:47:46.246 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:47:46.246 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:47:46.247 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:47:46.247 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:47:46.247 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:47:46.248 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:47:46.248 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:47:46.249 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:47:46.249 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:47:46.250 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:47:46.250 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:47:46.250 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:47:46.251 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:47:46.251 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:47:46.255 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:47:46.256 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:47:46.256 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:47:46.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:46.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:46.257 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:47:46.258 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:47:46.258 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:46.258 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:46.259 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:47:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 msgr2=0x7f7a8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:46.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 0x7f7a8c067290 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 rx=0x7f7a90013690 tx=0x7f7a90009b30).stop 2022-02-02T22:47:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 msgr2=0x7f7aa0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:47:46.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 secure :-1 s=READY pgs=4072 cs=0 l=1 rev1=1 rx=0x7f7a9c0026d0 tx=0x7f7a9c009de0).stop 2022-02-02T22:47:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 shutdown_connections 2022-02-02T22:47:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7a8c064dd0 0x7f7a8c067290 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7aa00f66e0 0x7f7aa006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 --2- 172.21.15.96:0/2007074344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7aa00f7980 0x7f7aa0069e20 unknown :-1 s=CLOSED pgs=4072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:47:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 >> 172.21.15.96:0/2007074344 conn(0x7f7aa00f1e40 msgr2=0x7f7aa00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:47:46.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 shutdown_connections 2022-02-02T22:47:46.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:47:46.239+0000 7f7aa873e700 1 -- 172.21.15.96:0/2007074344 wait complete. 2022-02-02T22:47:46.264 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:47:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:46 smithi096 ceph-mon[101353]: from='client.42258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:46 smithi096 ceph-mon[101353]: pgmap v7969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:47.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:46 smithi096 ceph-mon[101353]: from='client.42262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/951323431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:47:47.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:46 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2007074344' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:47:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:46 smithi159 ceph-mon[69013]: from='client.42258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:46 smithi159 ceph-mon[69013]: pgmap v7969: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:46 smithi159 ceph-mon[69013]: from='client.42262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:47:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/951323431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:47:47.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:46 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2007074344' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:47:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:48 smithi096 ceph-mon[101353]: pgmap v7970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:48 smithi159 ceph-mon[69013]: pgmap v7970: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:50 smithi096 ceph-mon[101353]: pgmap v7971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:50 smithi159 ceph-mon[69013]: pgmap v7971: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:53.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:52 smithi096 ceph-mon[101353]: pgmap v7972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:52 smithi159 ceph-mon[69013]: pgmap v7972: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:54 smithi159 ceph-mon[69013]: pgmap v7973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:54 smithi096 ceph-mon[101353]: pgmap v7973: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:56 smithi159 ceph-mon[69013]: pgmap v7974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:56 smithi096 ceph-mon[101353]: pgmap v7974: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:47:58 smithi159 ceph-mon[69013]: pgmap v7975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:47:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:47:58 smithi096 ceph-mon[101353]: pgmap v7975: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:00 smithi159 ceph-mon[69013]: pgmap v7976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:00 smithi096 ceph-mon[101353]: pgmap v7976: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:02 smithi096 ceph-mon[101353]: pgmap v7977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:02 smithi159 ceph-mon[69013]: pgmap v7977: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:04 smithi159 ceph-mon[69013]: pgmap v7978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:04 smithi096 ceph-mon[101353]: pgmap v7978: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:06 smithi159 ceph-mon[69013]: pgmap v7979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:06 smithi096 ceph-mon[101353]: pgmap v7979: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:08 smithi159 ceph-mon[69013]: pgmap v7980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:08 smithi096 ceph-mon[101353]: pgmap v7980: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:11.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:10 smithi159 ceph-mon[69013]: pgmap v7981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:10 smithi096 ceph-mon[101353]: pgmap v7981: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:12 smithi096 ceph-mon[101353]: pgmap v7982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:12 smithi159 ceph-mon[69013]: pgmap v7982: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:14 smithi159 ceph-mon[69013]: pgmap v7983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:14 smithi096 ceph-mon[101353]: pgmap v7983: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.348+0000 7fbd5aa17700 1 -- 172.21.15.96:0/949323171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 msgr2=0x7fbd540f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.348+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/949323171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd540f63e0 secure :-1 s=READY pgs=4073 cs=0 l=1 rev1=1 rx=0x7fbd48004660 tx=0x7fbd48009b30).stop 2022-02-02T22:48:16.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 -- 172.21.15.96:0/949323171 shutdown_connections 2022-02-02T22:48:16.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/949323171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd540f63e0 unknown :-1 s=CLOSED pgs=4073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/949323171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 0x7fbd540f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 -- 172.21.15.96:0/949323171 >> 172.21.15.96:0/949323171 conn(0x7fbd540f04c0 msgr2=0x7fbd540f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:16.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 -- 172.21.15.96:0/949323171 shutdown_connections 2022-02-02T22:48:16.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 -- 172.21.15.96:0/949323171 wait complete. 2022-02-02T22:48:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 Processor -- start 2022-02-02T22:48:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.349+0000 7fbd5aa17700 1 -- start start 2022-02-02T22:48:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd5aa17700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 0x7fbd54106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd5aa17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd5aa17700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54107a10 con 0x7fbd540f5f60 2022-02-02T22:48:16.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd5aa17700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54107b50 con 0x7fbd540f4d60 2022-02-02T22:48:16.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50476/0 (socket says 172.21.15.96:50476) 2022-02-02T22:48:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 -- 172.21.15.96:0/4074545161 learned_addr learned my addr 172.21.15.96:0/4074545161 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd53fff700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 0x7fbd54106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 -- 172.21.15.96:0/4074545161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 msgr2=0x7fbd54106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 0x7fbd54106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 -- 172.21.15.96:0/4074545161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48005040 con 0x7fbd540f5f60 2022-02-02T22:48:16.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd537fe700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 secure :-1 s=READY pgs=4074 cs=0 l=1 rev1=1 rx=0x7fbd48009830 tx=0x7fbd48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd48018070 con 0x7fbd540f5f60 2022-02-02T22:48:16.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd48007ba0 con 0x7fbd540f5f60 2022-02-02T22:48:16.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd54108490 con 0x7fbd540f5f60 2022-02-02T22:48:16.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.350+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4801c3c0 con 0x7fbd540f5f60 2022-02-02T22:48:16.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.351+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd541089f0 con 0x7fbd540f5f60 2022-02-02T22:48:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.352+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd54045ad0 con 0x7fbd540f5f60 2022-02-02T22:48:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.352+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbd48007d10 con 0x7fbd540f5f60 2022-02-02T22:48:16.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.352+0000 7fbd50ff9700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 0x7fbd3c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.353+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbd48083620 con 0x7fbd540f5f60 2022-02-02T22:48:16.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.353+0000 7fbd53fff700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 0x7fbd3c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.353+0000 7fbd53fff700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 0x7fbd3c067270 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7fbd4400a7f0 tx=0x7fbd44009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.357+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbd48055210 con 0x7fbd540f5f60 2022-02-02T22:48:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.535+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd54108c10 con 0x7fbd3c064db0 2022-02-02T22:48:16.537 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.536+0000 7fbd50ff9700 1 -- 172.21.15.96:0/4074545161 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbd54108c10 con 0x7fbd3c064db0 2022-02-02T22:48:16.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 msgr2=0x7fbd3c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 0x7fbd3c067270 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7fbd4400a7f0 tx=0x7fbd44009040).stop 2022-02-02T22:48:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 msgr2=0x7fbd54107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 secure :-1 s=READY pgs=4074 cs=0 l=1 rev1=1 rx=0x7fbd48009830 tx=0x7fbd48009b30).stop 2022-02-02T22:48:16.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 shutdown_connections 2022-02-02T22:48:16.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbd3c064db0 0x7fbd3c067270 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd540f4d60 0x7fbd54106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 --2- 172.21.15.96:0/4074545161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd540f5f60 0x7fbd54107460 unknown :-1 s=CLOSED pgs=4074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 >> 172.21.15.96:0/4074545161 conn(0x7fbd540f04c0 msgr2=0x7fbd540f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:16.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 shutdown_connections 2022-02-02T22:48:16.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.538+0000 7fbd5aa17700 1 -- 172.21.15.96:0/4074545161 wait complete. 2022-02-02T22:48:16.549 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:48:16.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.635+0000 7f02bcccb700 1 -- 172.21.15.96:0/986861994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f77d0 msgr2=0x7f02b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.635+0000 7f02bcccb700 1 --2- 172.21.15.96:0/986861994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f77d0 0x7f02b80f7c30 secure :-1 s=READY pgs=4075 cs=0 l=1 rev1=1 rx=0x7f02a8004660 tx=0x7f02a8009b30).stop 2022-02-02T22:48:16.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 -- 172.21.15.96:0/986861994 shutdown_connections 2022-02-02T22:48:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 --2- 172.21.15.96:0/986861994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f77d0 0x7f02b80f7c30 unknown :-1 s=CLOSED pgs=4075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 --2- 172.21.15.96:0/986861994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f6530 0x7f02b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 -- 172.21.15.96:0/986861994 >> 172.21.15.96:0/986861994 conn(0x7f02b80f1c90 msgr2=0x7f02b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 -- 172.21.15.96:0/986861994 shutdown_connections 2022-02-02T22:48:16.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.636+0000 7f02bcccb700 1 -- 172.21.15.96:0/986861994 wait complete. 2022-02-02T22:48:16.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 Processor -- start 2022-02-02T22:48:16.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 -- start start 2022-02-02T22:48:16.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f77d0 0x7f02b8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8107880 con 0x7f02b80f6530 2022-02-02T22:48:16.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02bcccb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8108090 con 0x7f02b80f77d0 2022-02-02T22:48:16.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50484/0 (socket says 172.21.15.96:50484) 2022-02-02T22:48:16.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02b77fe700 1 -- 172.21.15.96:0/248106859 learned_addr learned my addr 172.21.15.96:0/248106859 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:16.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.637+0000 7f02b6ffd700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f77d0 0x7f02b8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02b77fe700 1 -- 172.21.15.96:0/248106859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f77d0 msgr2=0x7f02b8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02b77fe700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f77d0 0x7f02b8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02b77fe700 1 -- 172.21.15.96:0/248106859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8005040 con 0x7f02b80f6530 2022-02-02T22:48:16.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02b77fe700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 secure :-1 s=READY pgs=4076 cs=0 l=1 rev1=1 rx=0x7f02a0002700 tx=0x7f02a0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a0009320 con 0x7f02b80f6530 2022-02-02T22:48:16.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8108310 con 0x7f02b80f6530 2022-02-02T22:48:16.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02a000f040 con 0x7f02b80f6530 2022-02-02T22:48:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a0014900 con 0x7f02b80f6530 2022-02-02T22:48:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.638+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b81088d0 con 0x7f02b80f6530 2022-02-02T22:48:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.639+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8059100 con 0x7f02b80f6530 2022-02-02T22:48:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.640+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f02a0009480 con 0x7f02b80f6530 2022-02-02T22:48:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.640+0000 7f02affff700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 0x7f02a40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.640+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02a0081d80 con 0x7f02b80f6530 2022-02-02T22:48:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.640+0000 7f02b6ffd700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 0x7f02a40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.641+0000 7f02b6ffd700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 0x7f02a40672e0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 rx=0x7f02a8004630 tx=0x7f02a8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.644+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02a004fe80 con 0x7f02b80f6530 2022-02-02T22:48:16.820 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.819+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f02b80fee70 con 0x7f02a4064e20 2022-02-02T22:48:16.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.829+0000 7f02affff700 1 -- 172.21.15.96:0/248106859 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f02b80fee70 con 0x7f02a4064e20 2022-02-02T22:48:16.831 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:48:16.831 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:48:16.831 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:48:16.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:48:16.832 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:48:16.832 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:48:16.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:48:16.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:48:16.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:48:16.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:48:16.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:48:16.834 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:48:16.835 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:48:16.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:48:16.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:48:16.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:48:16.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:48:16.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:48:16.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:48:16.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:48:16.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:48:16.838 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:48:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 msgr2=0x7f02a40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 0x7f02a40672e0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 rx=0x7f02a8004630 tx=0x7f02a8009b30).stop 2022-02-02T22:48:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 msgr2=0x7f02b8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 secure :-1 s=READY pgs=4076 cs=0 l=1 rev1=1 rx=0x7f02a0002700 tx=0x7f02a0009d80).stop 2022-02-02T22:48:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 shutdown_connections 2022-02-02T22:48:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02a4064e20 0x7f02a40672e0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02b80f6530 0x7f02b8106d90 unknown :-1 s=CLOSED pgs=4076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 --2- 172.21.15.96:0/248106859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02b80f77d0 0x7f02b8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 >> 172.21.15.96:0/248106859 conn(0x7f02b80f1c90 msgr2=0x7f02b80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 shutdown_connections 2022-02-02T22:48:16.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.831+0000 7f02bcccb700 1 -- 172.21.15.96:0/248106859 wait complete. 2022-02-02T22:48:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- 172.21.15.96:0/4213800013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 msgr2=0x7fbff00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 --2- 172.21.15.96:0/4213800013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff00f6b00 secure :-1 s=READY pgs=4077 cs=0 l=1 rev1=1 rx=0x7fbfe0004660 tx=0x7fbfe0009b30).stop 2022-02-02T22:48:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- 172.21.15.96:0/4213800013 shutdown_connections 2022-02-02T22:48:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 --2- 172.21.15.96:0/4213800013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f7980 0x7fbff00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 --2- 172.21.15.96:0/4213800013 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f66e0 0x7fbff00f6b00 unknown :-1 s=CLOSED pgs=4077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- 172.21.15.96:0/4213800013 >> 172.21.15.96:0/4213800013 conn(0x7fbff00f1e40 msgr2=0x7fbff00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:16.932 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:16 smithi096 ceph-mon[101353]: pgmap v7984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:16.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- 172.21.15.96:0/4213800013 shutdown_connections 2022-02-02T22:48:16.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- 172.21.15.96:0/4213800013 wait complete. 2022-02-02T22:48:16.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 Processor -- start 2022-02-02T22:48:16.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.928+0000 7fbff6805700 1 -- start start 2022-02-02T22:48:16.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbff6805700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff0104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbff6805700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbff6805700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0105830 con 0x7fbff00f7980 2022-02-02T22:48:16.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbff6805700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0105970 con 0x7fbff00f66e0 2022-02-02T22:48:16.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50496/0 (socket says 172.21.15.96:50496) 2022-02-02T22:48:16.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 -- 172.21.15.96:0/952318009 learned_addr learned my addr 172.21.15.96:0/952318009 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:16.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfeffff700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff0104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 -- 172.21.15.96:0/952318009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 msgr2=0x7fbff0104d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:16.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff0104d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:16.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 -- 172.21.15.96:0/952318009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0005040 con 0x7fbff00f7980 2022-02-02T22:48:16.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfeffff700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff0104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:48:16.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfef7fe700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 secure :-1 s=READY pgs=4078 cs=0 l=1 rev1=1 rx=0x7fbfd800c790 tx=0x7fbfd8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.929+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd800e680 con 0x7fbff00f7980 2022-02-02T22:48:16.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.930+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfd800ec90 con 0x7fbff00f7980 2022-02-02T22:48:16.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.930+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff010b540 con 0x7fbff00f7980 2022-02-02T22:48:16.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.930+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd8013d60 con 0x7fbff00f7980 2022-02-02T22:48:16.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.930+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff010bb00 con 0x7fbff00f7980 2022-02-02T22:48:16.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.931+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff0045ad0 con 0x7fbff00f7980 2022-02-02T22:48:16.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.931+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbfd801a060 con 0x7fbff00f7980 2022-02-02T22:48:16.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.931+0000 7fbfecff9700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 0x7fbfdc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:16.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.932+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbfd8081c90 con 0x7fbff00f7980 2022-02-02T22:48:16.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.932+0000 7fbfeffff700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 0x7fbfdc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:16.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.932+0000 7fbfeffff700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 0x7fbfdc067290 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7fbfe0004e30 tx=0x7fbfe0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:16.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:16.936+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbfd804fd90 con 0x7fbff00f7980 2022-02-02T22:48:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.167+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbff010c140 con 0x7fbff00f7980 2022-02-02T22:48:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.168+0000 7fbfecff9700 1 -- 172.21.15.96:0/952318009 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbfd8018070 con 0x7fbff00f7980 2022-02-02T22:48:17.170 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:48:17.170 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:48:17.171 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:48:17.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:17.171 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:48:17.172 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:48:17.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:17.172 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:48:17.173 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:48:17.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:17.174 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:48:17.174 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:48:17.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:17.175 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:48:17.175 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:48:17.175 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:48:17.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:48:17.176 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:48:17.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 msgr2=0x7fbfdc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 0x7fbfdc067290 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7fbfe0004e30 tx=0x7fbfe0009b30).stop 2022-02-02T22:48:17.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 msgr2=0x7fbff0105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 secure :-1 s=READY pgs=4078 cs=0 l=1 rev1=1 rx=0x7fbfd800c790 tx=0x7fbfd8007d70).stop 2022-02-02T22:48:17.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 shutdown_connections 2022-02-02T22:48:17.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbfdc064dd0 0x7fbfdc067290 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbff00f66e0 0x7fbff0104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 --2- 172.21.15.96:0/952318009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbff00f7980 0x7fbff0105230 unknown :-1 s=CLOSED pgs=4078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 >> 172.21.15.96:0/952318009 conn(0x7fbff00f1e40 msgr2=0x7fbff006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:17.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 shutdown_connections 2022-02-02T22:48:17.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.170+0000 7fbff6805700 1 -- 172.21.15.96:0/952318009 wait complete. 2022-02-02T22:48:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 -- 172.21.15.96:0/4135098268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f49a0 msgr2=0x7fde880f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 --2- 172.21.15.96:0/4135098268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f49a0 0x7fde880f4dc0 secure :-1 s=READY pgs=4079 cs=0 l=1 rev1=1 rx=0x7fde78004660 tx=0x7fde78009b30).stop 2022-02-02T22:48:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 -- 172.21.15.96:0/4135098268 shutdown_connections 2022-02-02T22:48:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 --2- 172.21.15.96:0/4135098268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f5340 0x7fde880f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 --2- 172.21.15.96:0/4135098268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f49a0 0x7fde880f4dc0 unknown :-1 s=CLOSED pgs=4079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 -- 172.21.15.96:0/4135098268 >> 172.21.15.96:0/4135098268 conn(0x7fde880f04c0 msgr2=0x7fde880f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 -- 172.21.15.96:0/4135098268 shutdown_connections 2022-02-02T22:48:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.267+0000 7fde8e88a700 1 -- 172.21.15.96:0/4135098268 wait complete. 2022-02-02T22:48:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 Processor -- start 2022-02-02T22:48:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 -- start start 2022-02-02T22:48:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:16 smithi159 ceph-mon[69013]: pgmap v7984: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88107ae0 con 0x7fde880f5340 2022-02-02T22:48:17.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde8e88a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88107c20 con 0x7fde880f49a0 2022-02-02T22:48:17.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.268+0000 7fde877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:17.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde87fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:17.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde87fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:54612/0 (socket says 172.21.15.96:54612) 2022-02-02T22:48:17.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde87fff700 1 -- 172.21.15.96:0/3792851317 learned_addr learned my addr 172.21.15.96:0/3792851317 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde877fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50510/0 (socket says 172.21.15.96:50510) 2022-02-02T22:48:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde877fe700 1 -- 172.21.15.96:0/3792851317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 msgr2=0x7fde88107040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde877fe700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde877fe700 1 -- 172.21.15.96:0/3792851317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78005040 con 0x7fde880f5340 2022-02-02T22:48:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde87fff700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T22:48:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde877fe700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 secure :-1 s=READY pgs=4080 cs=0 l=1 rev1=1 rx=0x7fde7c0026d0 tx=0x7fde7c009cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7c0079c0 con 0x7fde880f5340 2022-02-02T22:48:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde881085c0 con 0x7fde880f5340 2022-02-02T22:48:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde7c00f040 con 0x7fde880f5340 2022-02-02T22:48:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7c014860 con 0x7fde880f5340 2022-02-02T22:48:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.269+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde88108b80 con 0x7fde880f5340 2022-02-02T22:48:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.271+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88045ad0 con 0x7fde880f5340 2022-02-02T22:48:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.271+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fde7c007b20 con 0x7fde880f5340 2022-02-02T22:48:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.271+0000 7fde84ff9700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 0x7fde70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.271+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde7c0818f0 con 0x7fde880f5340 2022-02-02T22:48:17.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.271+0000 7fde87fff700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 0x7fde70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:17.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.272+0000 7fde87fff700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 0x7fde70067290 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 rx=0x7fde78004e30 tx=0x7fde78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:17.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.275+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fde7c053420 con 0x7fde880f5340 2022-02-02T22:48:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.476+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde880fefb0 con 0x7fde880f5340 2022-02-02T22:48:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.476+0000 7fde84ff9700 1 -- 172.21.15.96:0/3792851317 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fde7c053010 con 0x7fde880f5340 2022-02-02T22:48:17.478 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:48:17.479 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:48:17.479 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:48:17.480 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:48:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:17.480 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:48:17.481 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:48:17.481 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:48:17.481 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:48:17.482 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:48:17.482 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:48:17.482 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:48:17.483 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:48:17.483 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:48:17.483 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:48:17.484 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:48:17.484 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:48:17.485 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:48:17.485 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:48:17.485 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:48:17.486 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:48:17.486 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:48:17.487 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:48:17.488 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:48:17.488 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:48:17.489 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:48:17.489 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:48:17.490 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:48:17.490 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:48:17.490 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:48:17.491 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:48:17.491 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:48:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:17.492 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:48:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:17.493 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:17.493 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:17.494 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:17.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 msgr2=0x7fde70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 0x7fde70067290 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 rx=0x7fde78004e30 tx=0x7fde78009b30).stop 2022-02-02T22:48:17.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 msgr2=0x7fde88107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:17.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 secure :-1 s=READY pgs=4080 cs=0 l=1 rev1=1 rx=0x7fde7c0026d0 tx=0x7fde7c009cc0).stop 2022-02-02T22:48:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 shutdown_connections 2022-02-02T22:48:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fde70064dd0 0x7fde70067290 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde880f49a0 0x7fde88107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 --2- 172.21.15.96:0/3792851317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde880f5340 0x7fde88107530 unknown :-1 s=CLOSED pgs=4080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 >> 172.21.15.96:0/3792851317 conn(0x7fde880f04c0 msgr2=0x7fde880fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 shutdown_connections 2022-02-02T22:48:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:17.478+0000 7fde8e88a700 1 -- 172.21.15.96:0/3792851317 wait complete. 2022-02-02T22:48:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:48:18.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:17 smithi159 ceph-mon[69013]: from='client.42274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:18.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:17 smithi159 ceph-mon[69013]: from='client.42278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/952318009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:48:18.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:17 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3792851317' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:48:18.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:17 smithi096 ceph-mon[101353]: from='client.42274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:17 smithi096 ceph-mon[101353]: from='client.42278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/952318009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:48:18.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:17 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3792851317' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:48:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:18 smithi159 ceph-mon[69013]: pgmap v7985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:18 smithi096 ceph-mon[101353]: pgmap v7985: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:20 smithi159 ceph-mon[69013]: pgmap v7986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:20 smithi096 ceph-mon[101353]: pgmap v7986: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:22 smithi096 ceph-mon[101353]: pgmap v7987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:22 smithi159 ceph-mon[69013]: pgmap v7987: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:24 smithi159 ceph-mon[69013]: pgmap v7988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:24 smithi096 ceph-mon[101353]: pgmap v7988: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:26 smithi159 ceph-mon[69013]: pgmap v7989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:26 smithi096 ceph-mon[101353]: pgmap v7989: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:28 smithi159 ceph-mon[69013]: pgmap v7990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:48:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:48:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:28 smithi096 ceph-mon[101353]: pgmap v7990: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:48:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:48:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:30 smithi159 ceph-mon[69013]: pgmap v7991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:30 smithi096 ceph-mon[101353]: pgmap v7991: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:32 smithi096 ceph-mon[101353]: pgmap v7992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:32 smithi159 ceph-mon[69013]: pgmap v7992: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:34 smithi159 ceph-mon[69013]: pgmap v7993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:34 smithi096 ceph-mon[101353]: pgmap v7993: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:36 smithi159 ceph-mon[69013]: pgmap v7994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:36 smithi096 ceph-mon[101353]: pgmap v7994: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:39.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:38 smithi159 ceph-mon[69013]: pgmap v7995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:38 smithi096 ceph-mon[101353]: pgmap v7995: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:40 smithi159 ceph-mon[69013]: pgmap v7996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:40 smithi096 ceph-mon[101353]: pgmap v7996: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:42 smithi096 ceph-mon[101353]: pgmap v7997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:42 smithi159 ceph-mon[69013]: pgmap v7997: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:44 smithi159 ceph-mon[69013]: pgmap v7998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:44 smithi096 ceph-mon[101353]: pgmap v7998: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:46 smithi159 ceph-mon[69013]: pgmap v7999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:46 smithi096 ceph-mon[101353]: pgmap v7999: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:47.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 -- 172.21.15.96:0/775598251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406a330 msgr2=0x7f0a1406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/775598251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406a330 0x7f0a1406a7b0 secure :-1 s=READY pgs=4081 cs=0 l=1 rev1=1 rx=0x7f0a00004660 tx=0x7f0a00009b30).stop 2022-02-02T22:48:47.588 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 -- 172.21.15.96:0/775598251 shutdown_connections 2022-02-02T22:48:47.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/775598251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406a330 0x7f0a1406a7b0 unknown :-1 s=CLOSED pgs=4081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/775598251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406b940 0x7f0a14069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:48:47.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 -- 172.21.15.96:0/775598251 >> 172.21.15.96:0/775598251 conn(0x7f0a140f1e40 msgr2=0x7f0a140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:47.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 -- 172.21.15.96:0/775598251 shutdown_connections 2022-02-02T22:48:47.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.586+0000 7f0a1af7a700 1 -- 172.21.15.96:0/775598251 wait complete. 2022-02-02T22:48:47.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.587+0000 7f0a1af7a700 1 Processor -- start 2022-02-02T22:48:47.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.587+0000 7f0a1af7a700 1 -- start start 2022-02-02T22:48:47.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.587+0000 7f0a1af7a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 0x7f0a14109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a1af7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a1af7a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14109cb0 con 0x7f0a1406b940 2022-02-02T22:48:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a1af7a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1410a560 con 0x7f0a1406a330 2022-02-02T22:48:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50528/0 (socket says 172.21.15.96:50528) 2022-02-02T22:48:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 -- 172.21.15.96:0/2575493979 learned_addr learned my addr 172.21.15.96:0/2575493979 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a18d16700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 0x7f0a14109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 -- 172.21.15.96:0/2575493979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 msgr2=0x7f0a14109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 0x7f0a14109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 -- 172.21.15.96:0/2575493979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00005040 con 0x7f0a1406b940 2022-02-02T22:48:47.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a18d16700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 0x7f0a14109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:48:47.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a13fff700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 secure :-1 s=READY pgs=4082 cs=0 l=1 rev1=1 rx=0x7f0a00009990 tx=0x7f0a00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:47.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a00018070 con 0x7f0a1406b940 2022-02-02T22:48:47.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a00007ca0 con 0x7f0a1406b940 2022-02-02T22:48:47.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.588+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0001c620 con 0x7f0a1406b940 2022-02-02T22:48:47.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.589+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1410a7e0 con 0x7f0a1406b940 2022-02-02T22:48:47.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.589+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1410ad40 con 0x7f0a1406b940 2022-02-02T22:48:47.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.589+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140f5ad0 con 0x7f0a1406b940 2022-02-02T22:48:47.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.590+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a0001d960 con 0x7f0a1406b940 2022-02-02T22:48:47.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.590+0000 7f0a117fa700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.591+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0a00083870 con 0x7f0a1406b940 2022-02-02T22:48:47.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.591+0000 7f0a18d16700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.591+0000 7f0a18d16700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 rx=0x7f0a0800b830 tx=0x7f0a08008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:47.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.594+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a00055420 con 0x7f0a1406b940 2022-02-02T22:48:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.773+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a141011f0 con 0x7f0a04064dd0 2022-02-02T22:48:47.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.774+0000 7f0a117fa700 1 -- 172.21.15.96:0/2575493979 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0a141011f0 con 0x7f0a04064dd0 2022-02-02T22:48:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 msgr2=0x7f0a04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 rx=0x7f0a0800b830 tx=0x7f0a08008040).stop 2022-02-02T22:48:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 msgr2=0x7f0a14109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 secure :-1 s=READY pgs=4082 cs=0 l=1 rev1=1 rx=0x7f0a00009990 tx=0x7f0a00009b30).stop 2022-02-02T22:48:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 shutdown_connections 2022-02-02T22:48:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0a04064dd0 0x7f0a04067290 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a1406a330 0x7f0a14109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 --2- 172.21.15.96:0/2575493979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1406b940 0x7f0a14109670 unknown :-1 s=CLOSED pgs=4082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 >> 172.21.15.96:0/2575493979 conn(0x7f0a140f1e40 msgr2=0x7f0a140fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:47.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 shutdown_connections 2022-02-02T22:48:47.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.776+0000 7f0a1af7a700 1 -- 172.21.15.96:0/2575493979 wait complete. 2022-02-02T22:48:47.786 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:48:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 -- 172.21.15.96:0/165854049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f7980 msgr2=0x7ffa100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 --2- 172.21.15.96:0/165854049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f7980 0x7ffa100f7de0 secure :-1 s=READY pgs=4083 cs=0 l=1 rev1=1 rx=0x7ffa0c004660 tx=0x7ffa0c009b30).stop 2022-02-02T22:48:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 -- 172.21.15.96:0/165854049 shutdown_connections 2022-02-02T22:48:47.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 --2- 172.21.15.96:0/165854049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f7980 0x7ffa100f7de0 unknown :-1 s=CLOSED pgs=4083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 --2- 172.21.15.96:0/165854049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa100f66e0 0x7ffa100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:48:47.878 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 -- 172.21.15.96:0/165854049 >> 172.21.15.96:0/165854049 conn(0x7ffa100f1e40 msgr2=0x7ffa100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:47.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 -- 172.21.15.96:0/165854049 shutdown_connections 2022-02-02T22:48:47.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.873+0000 7ffa1759a700 1 -- 172.21.15.96:0/165854049 wait complete. 2022-02-02T22:48:47.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 Processor -- start 2022-02-02T22:48:47.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 -- start start 2022-02-02T22:48:47.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 0x7ffa1006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1006a820 con 0x7ffa100f66e0 2022-02-02T22:48:47.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa1759a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1006a960 con 0x7ffa10069e20 2022-02-02T22:48:47.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa15336700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa15336700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50536/0 (socket says 172.21.15.96:50536) 2022-02-02T22:48:47.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa15336700 1 -- 172.21.15.96:0/2234695592 learned_addr learned my addr 172.21.15.96:0/2234695592 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:47.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.874+0000 7ffa14b35700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 0x7ffa1006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa15336700 1 -- 172.21.15.96:0/2234695592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 msgr2=0x7ffa1006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:47.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa15336700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 0x7ffa1006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:47.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa15336700 1 -- 172.21.15.96:0/2234695592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c005040 con 0x7ffa100f66e0 2022-02-02T22:48:47.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa14b35700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 0x7ffa1006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:48:47.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa15336700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 secure :-1 s=READY pgs=4084 cs=0 l=1 rev1=1 rx=0x7ffa040093f0 tx=0x7ffa04006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:47.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa04009ea0 con 0x7ffa100f66e0 2022-02-02T22:48:47.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1006ac10 con 0x7ffa100f66e0 2022-02-02T22:48:47.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa04013af0 con 0x7ffa100f66e0 2022-02-02T22:48:47.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa0400db10 con 0x7ffa100f66e0 2022-02-02T22:48:47.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.875+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1010f4e0 con 0x7ffa100f66e0 2022-02-02T22:48:47.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.876+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa100f5ad0 con 0x7ffa100f66e0 2022-02-02T22:48:47.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.877+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffa0401a060 con 0x7ffa100f66e0 2022-02-02T22:48:47.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.877+0000 7ffa01ffb700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 0x7ff9fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:47.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.877+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffa04081ad0 con 0x7ffa100f66e0 2022-02-02T22:48:47.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.877+0000 7ffa14b35700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 0x7ff9fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:47.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.877+0000 7ffa14b35700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 0x7ff9fc067290 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 rx=0x7ffa0c000c00 tx=0x7ffa0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:47.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:47.881+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffa0404fbd0 con 0x7ffa100f66e0 2022-02-02T22:48:48.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.055+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa100ff080 con 0x7ff9fc064dd0 2022-02-02T22:48:48.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.064+0000 7ffa01ffb700 1 -- 172.21.15.96:0/2234695592 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ffa100ff080 con 0x7ff9fc064dd0 2022-02-02T22:48:48.066 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:48:48.066 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:48:48.067 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:48:48.067 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:48:48.067 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:48:48.068 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:48:48.068 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:48:48.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:48:48.069 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:48:48.069 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:48:48.070 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:48:48.070 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:48:48.070 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:48:48.071 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:48:48.071 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:48:48.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:48:48.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:48:48.072 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:48:48.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:48:48.073 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:48:48.074 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:48:48.074 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:48:48.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 msgr2=0x7ff9fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 0x7ff9fc067290 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 rx=0x7ffa0c000c00 tx=0x7ffa0c009b30).stop 2022-02-02T22:48:48.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 msgr2=0x7ffa1006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 secure :-1 s=READY pgs=4084 cs=0 l=1 rev1=1 rx=0x7ffa040093f0 tx=0x7ffa04006ec0).stop 2022-02-02T22:48:48.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 shutdown_connections 2022-02-02T22:48:48.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9fc064dd0 0x7ff9fc067290 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa100f66e0 0x7ffa1006b9a0 unknown :-1 s=CLOSED pgs=4084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 --2- 172.21.15.96:0/2234695592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa10069e20 0x7ffa1006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.066+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 >> 172.21.15.96:0/2234695592 conn(0x7ffa100f1e40 msgr2=0x7ffa100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:48.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.067+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 shutdown_connections 2022-02-02T22:48:48.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.067+0000 7ffa1759a700 1 -- 172.21.15.96:0/2234695592 wait complete. 2022-02-02T22:48:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 -- 172.21.15.96:0/937824650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 msgr2=0x7f40cc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 --2- 172.21.15.96:0/937824650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc0f6b00 secure :-1 s=READY pgs=4085 cs=0 l=1 rev1=1 rx=0x7f40bc004660 tx=0x7f40bc009b30).stop 2022-02-02T22:48:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 -- 172.21.15.96:0/937824650 shutdown_connections 2022-02-02T22:48:48.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 --2- 172.21.15.96:0/937824650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:48:48.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 --2- 172.21.15.96:0/937824650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc0f6b00 unknown :-1 s=CLOSED pgs=4085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 -- 172.21.15.96:0/937824650 >> 172.21.15.96:0/937824650 conn(0x7f40cc0f1e40 msgr2=0x7f40cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 -- 172.21.15.96:0/937824650 shutdown_connections 2022-02-02T22:48:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.163+0000 7f40d4250700 1 -- 172.21.15.96:0/937824650 wait complete. 2022-02-02T22:48:48.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 Processor -- start 2022-02-02T22:48:48.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 -- start start 2022-02-02T22:48:48.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc06a410 con 0x7f40cc0f66e0 2022-02-02T22:48:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d4250700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc06a550 con 0x7f40cc0f7980 2022-02-02T22:48:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d1fec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d1fec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50546/0 (socket says 172.21.15.96:50546) 2022-02-02T22:48:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.164+0000 7f40d1fec700 1 -- 172.21.15.96:0/2778195985 learned_addr learned my addr 172.21.15.96:0/2778195985 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d17eb700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d1fec700 1 -- 172.21.15.96:0/2778195985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 msgr2=0x7f40cc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d1fec700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d1fec700 1 -- 172.21.15.96:0/2778195985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc005040 con 0x7f40cc0f66e0 2022-02-02T22:48:48.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d17eb700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:48:48.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d1fec700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 secure :-1 s=READY pgs=4086 cs=0 l=1 rev1=1 rx=0x7f40bc004f60 tx=0x7f40bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:48.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40bc018070 con 0x7f40cc0f66e0 2022-02-02T22:48:48.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40bc007ba0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc06a7d0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40bc01c620 con 0x7f40cc0f66e0 2022-02-02T22:48:48.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.165+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc10efe0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.166+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc045ad0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.167+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40bc01c8e0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.167+0000 7f40c27fc700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.167+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f40bc083960 con 0x7f40cc0f66e0 2022-02-02T22:48:48.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.167+0000 7f40d17eb700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.168+0000 7f40d17eb700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7f40c800b8d0 tx=0x7f40c8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:48.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.171+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40bc051a60 con 0x7f40cc0f66e0 2022-02-02T22:48:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.399+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40cc0fefc0 con 0x7f40cc0f66e0 2022-02-02T22:48:48.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.400+0000 7f40c27fc700 1 -- 172.21.15.96:0/2778195985 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f40bc055080 con 0x7f40cc0f66e0 2022-02-02T22:48:48.402 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:48:48.402 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:48:48.402 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:48:48.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:48.403 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:48:48.404 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:48:48.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:48.404 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:48:48.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:48:48.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:48.405 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:48:48.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:48:48.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:48:48.406 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:48:48.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:48:48.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:48:48.408 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:48:48.408 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:48:48.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 msgr2=0x7f40b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7f40c800b8d0 tx=0x7f40c8008040).stop 2022-02-02T22:48:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 msgr2=0x7f40cc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 secure :-1 s=READY pgs=4086 cs=0 l=1 rev1=1 rx=0x7f40bc004f60 tx=0x7f40bc009b30).stop 2022-02-02T22:48:48.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 shutdown_connections 2022-02-02T22:48:48.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f40b8064dd0 0x7f40b8067290 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0f66e0 0x7f40cc06b9a0 unknown :-1 s=CLOSED pgs=4086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 --2- 172.21.15.96:0/2778195985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40cc0f7980 0x7f40cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 >> 172.21.15.96:0/2778195985 conn(0x7f40cc0f1e40 msgr2=0x7f40cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:48.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 shutdown_connections 2022-02-02T22:48:48.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.402+0000 7f40d4250700 1 -- 172.21.15.96:0/2778195985 wait complete. 2022-02-02T22:48:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 -- 172.21.15.96:0/2529726350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f66e0 msgr2=0x7efc4c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 --2- 172.21.15.96:0/2529726350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f66e0 0x7efc4c0f6b00 secure :-1 s=READY pgs=4087 cs=0 l=1 rev1=1 rx=0x7efc40004660 tx=0x7efc40009b30).stop 2022-02-02T22:48:48.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 -- 172.21.15.96:0/2529726350 shutdown_connections 2022-02-02T22:48:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 --2- 172.21.15.96:0/2529726350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f7980 0x7efc4c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 --2- 172.21.15.96:0/2529726350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f66e0 0x7efc4c0f6b00 unknown :-1 s=CLOSED pgs=4087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 -- 172.21.15.96:0/2529726350 >> 172.21.15.96:0/2529726350 conn(0x7efc4c0f1e40 msgr2=0x7efc4c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 -- 172.21.15.96:0/2529726350 shutdown_connections 2022-02-02T22:48:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.500+0000 7efc52c69700 1 -- 172.21.15.96:0/2529726350 wait complete. 2022-02-02T22:48:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 Processor -- start 2022-02-02T22:48:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 -- start start 2022-02-02T22:48:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f66e0 0x7efc4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c06a380 con 0x7efc4c0f7980 2022-02-02T22:48:48.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.501+0000 7efc52c69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c06a4c0 con 0x7efc4c0f66e0 2022-02-02T22:48:48.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50558/0 (socket says 172.21.15.96:50558) 2022-02-02T22:48:48.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 -- 172.21.15.96:0/3725012490 learned_addr learned my addr 172.21.15.96:0/3725012490 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:48:48.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc50a05700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f66e0 0x7efc4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 -- 172.21.15.96:0/3725012490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f66e0 msgr2=0x7efc4c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f66e0 0x7efc4c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 -- 172.21.15.96:0/3725012490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40005040 con 0x7efc4c0f7980 2022-02-02T22:48:48.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc4bfff700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 secure :-1 s=READY pgs=4088 cs=0 l=1 rev1=1 rx=0x7efc380026d0 tx=0x7efc38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:48.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc380079c0 con 0x7efc4c0f7980 2022-02-02T22:48:48.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c06a7a0 con 0x7efc4c0f7980 2022-02-02T22:48:48.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc3800f040 con 0x7efc4c0f7980 2022-02-02T22:48:48.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc380148b0 con 0x7efc4c0f7980 2022-02-02T22:48:48.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.502+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c10efe0 con 0x7efc4c0f7980 2022-02-02T22:48:48.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.503+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c045ad0 con 0x7efc4c0f7980 2022-02-02T22:48:48.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.504+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efc38007b20 con 0x7efc4c0f7980 2022-02-02T22:48:48.519 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.504+0000 7efc497fa700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 0x7efc3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:48:48.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.504+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efc380819e0 con 0x7efc4c0f7980 2022-02-02T22:48:48.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.504+0000 7efc50a05700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 0x7efc3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:48:48.520 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.505+0000 7efc50a05700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 0x7efc3c067290 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 rx=0x7efc40013690 tx=0x7efc40009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:48:48.521 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.508+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efc3804fae0 con 0x7efc4c0f7980 2022-02-02T22:48:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.711+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc4c027a00 con 0x7efc4c0f7980 2022-02-02T22:48:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.711+0000 7efc497fa700 1 -- 172.21.15.96:0/3725012490 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7efc38053100 con 0x7efc4c0f7980 2022-02-02T22:48:48.714 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:48:48.715 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:48:48.716 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:48:48.716 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:48:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:48.717 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:48:48.718 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:48:48.719 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:48:48.720 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:48:48.720 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:48:48.721 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:48:48.722 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:48:48.722 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:48:48.723 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:48:48.724 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:48:48.724 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:48:48.725 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:48:48.725 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:48:48.726 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:48:48.727 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:48:48.727 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:48:48.728 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:48:48.729 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:48:48.729 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:48:48.730 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:48:48.730 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:48:48.731 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:48:48.732 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:48:48.732 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:48:48.733 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:48:48.733 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:48:48.734 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:48:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:48.736 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:48:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:48:48.737 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:48.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:48.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:48:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.713+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 msgr2=0x7efc3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.713+0000 7efc52c69700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 0x7efc3c067290 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 rx=0x7efc40013690 tx=0x7efc40009b30).stop 2022-02-02T22:48:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.713+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 msgr2=0x7efc4c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:48:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.713+0000 7efc52c69700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 secure :-1 s=READY pgs=4088 cs=0 l=1 rev1=1 rx=0x7efc380026d0 tx=0x7efc38009de0).stop 2022-02-02T22:48:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 shutdown_connections 2022-02-02T22:48:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efc3c064dd0 0x7efc3c067290 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc4c0f66e0 0x7efc4c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 --2- 172.21.15.96:0/3725012490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc4c0f7980 0x7efc4c069e20 unknown :-1 s=CLOSED pgs=4088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:48:48.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 >> 172.21.15.96:0/3725012490 conn(0x7efc4c0f1e40 msgr2=0x7efc4c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:48:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 shutdown_connections 2022-02-02T22:48:48.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:48:48.714+0000 7efc52c69700 1 -- 172.21.15.96:0/3725012490 wait complete. 2022-02-02T22:48:48.748 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:48:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:48 smithi159 ceph-mon[69013]: pgmap v8000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:48 smithi159 ceph-mon[69013]: from='client.42290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:48 smithi159 ceph-mon[69013]: from='client.42294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2778195985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:48:49.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3725012490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:48:49.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:48 smithi096 ceph-mon[101353]: pgmap v8000: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:49.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:48 smithi096 ceph-mon[101353]: from='client.42290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:48 smithi096 ceph-mon[101353]: from='client.42294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:48:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2778195985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:48:49.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3725012490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:48:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:50 smithi159 ceph-mon[69013]: pgmap v8001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:50 smithi096 ceph-mon[101353]: pgmap v8001: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:52 smithi096 ceph-mon[101353]: pgmap v8002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:52 smithi159 ceph-mon[69013]: pgmap v8002: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:54 smithi159 ceph-mon[69013]: pgmap v8003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:54 smithi096 ceph-mon[101353]: pgmap v8003: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:56 smithi159 ceph-mon[69013]: pgmap v8004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:56 smithi096 ceph-mon[101353]: pgmap v8004: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:48:58 smithi159 ceph-mon[69013]: pgmap v8005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:48:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:48:58 smithi096 ceph-mon[101353]: pgmap v8005: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:00 smithi159 ceph-mon[69013]: pgmap v8006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:00 smithi096 ceph-mon[101353]: pgmap v8006: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:02 smithi096 ceph-mon[101353]: pgmap v8007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:03.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:02 smithi159 ceph-mon[69013]: pgmap v8007: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:04 smithi159 ceph-mon[69013]: pgmap v8008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:04 smithi096 ceph-mon[101353]: pgmap v8008: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:06 smithi159 ceph-mon[69013]: pgmap v8009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:06 smithi096 ceph-mon[101353]: pgmap v8009: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:08 smithi159 ceph-mon[69013]: pgmap v8010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:08 smithi096 ceph-mon[101353]: pgmap v8010: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:10 smithi159 ceph-mon[69013]: pgmap v8011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:10 smithi096 ceph-mon[101353]: pgmap v8011: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:12 smithi096 ceph-mon[101353]: pgmap v8012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:12 smithi159 ceph-mon[69013]: pgmap v8012: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:14 smithi159 ceph-mon[69013]: pgmap v8013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:14 smithi096 ceph-mon[101353]: pgmap v8013: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:16 smithi159 ceph-mon[69013]: pgmap v8014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:17.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:16 smithi096 ceph-mon[101353]: pgmap v8014: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 -- 172.21.15.96:0/2610271633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 msgr2=0x7f93cc0f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 --2- 172.21.15.96:0/2610271633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc0f7c40 secure :-1 s=READY pgs=4089 cs=0 l=1 rev1=1 rx=0x7f93c0004660 tx=0x7f93c0009b30).stop 2022-02-02T22:49:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 -- 172.21.15.96:0/2610271633 shutdown_connections 2022-02-02T22:49:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 --2- 172.21.15.96:0/2610271633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc0f7c40 unknown :-1 s=CLOSED pgs=4089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 --2- 172.21.15.96:0/2610271633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 0x7f93cc0f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 -- 172.21.15.96:0/2610271633 >> 172.21.15.96:0/2610271633 conn(0x7f93cc0f1ca0 msgr2=0x7f93cc0f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 -- 172.21.15.96:0/2610271633 shutdown_connections 2022-02-02T22:49:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.825+0000 7f93d1996700 1 -- 172.21.15.96:0/2610271633 wait complete. 2022-02-02T22:49:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 Processor -- start 2022-02-02T22:49:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 -- start start 2022-02-02T22:49:18.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 0x7f93cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc06a380 con 0x7f93cc0f77e0 2022-02-02T22:49:18.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93d1996700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc06a4c0 con 0x7f93cc0f6540 2022-02-02T22:49:18.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.826+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:18.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50576/0 (socket says 172.21.15.96:50576) 2022-02-02T22:49:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 -- 172.21.15.96:0/2153291656 learned_addr learned my addr 172.21.15.96:0/2153291656 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93caffd700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 0x7f93cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 -- 172.21.15.96:0/2153291656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 msgr2=0x7f93cc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 0x7f93cc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 -- 172.21.15.96:0/2153291656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0005040 con 0x7f93cc0f77e0 2022-02-02T22:49:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93ca7fc700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 secure :-1 s=READY pgs=4090 cs=0 l=1 rev1=1 rx=0x7f93c0009990 tx=0x7f93c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:18.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c0018070 con 0x7f93cc0f77e0 2022-02-02T22:49:18.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f93c0007ca0 con 0x7f93cc0f77e0 2022-02-02T22:49:18.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc06a740 con 0x7f93cc0f77e0 2022-02-02T22:49:18.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c001c620 con 0x7f93cc0f77e0 2022-02-02T22:49:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.827+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc06aca0 con 0x7f93cc0f77e0 2022-02-02T22:49:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.828+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc045ad0 con 0x7f93cc0f77e0 2022-02-02T22:49:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.829+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f93c001d960 con 0x7f93cc0f77e0 2022-02-02T22:49:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.829+0000 7f93b37fe700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 0x7f93b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.829+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93c00837e0 con 0x7f93cc0f77e0 2022-02-02T22:49:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.829+0000 7f93caffd700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 0x7f93b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:18.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.830+0000 7f93caffd700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 0x7f93b40672e0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 rx=0x7f93cc06b730 tx=0x7f93bc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:18.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:18.833+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f93c00519a0 con 0x7f93cc0f77e0 2022-02-02T22:49:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.014+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93cc0feeb0 con 0x7f93b4064e20 2022-02-02T22:49:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.015+0000 7f93b37fe700 1 -- 172.21.15.96:0/2153291656 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f93bc004570 con 0x7f93b4064e20 2022-02-02T22:49:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 msgr2=0x7f93b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 0x7f93b40672e0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 rx=0x7f93cc06b730 tx=0x7f93bc009040).stop 2022-02-02T22:49:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 msgr2=0x7f93cc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 secure :-1 s=READY pgs=4090 cs=0 l=1 rev1=1 rx=0x7f93c0009990 tx=0x7f93c0009b30).stop 2022-02-02T22:49:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 shutdown_connections 2022-02-02T22:49:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f93b4064e20 0x7f93b40672e0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc0f6540 0x7f93cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 --2- 172.21.15.96:0/2153291656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc0f77e0 0x7f93cc069e20 unknown :-1 s=CLOSED pgs=4090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 >> 172.21.15.96:0/2153291656 conn(0x7f93cc0f1ca0 msgr2=0x7f93cc0fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 shutdown_connections 2022-02-02T22:49:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.017+0000 7f93d1996700 1 -- 172.21.15.96:0/2153291656 wait complete. 2022-02-02T22:49:19.027 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:49:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.113+0000 7f330e2bc700 1 -- 172.21.15.96:0/3021691005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f66e0 msgr2=0x7f33080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.113+0000 7f330e2bc700 1 --2- 172.21.15.96:0/3021691005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f66e0 0x7f33080f6b00 secure :-1 s=READY pgs=4091 cs=0 l=1 rev1=1 rx=0x7f32fc004660 tx=0x7f32fc009b30).stop 2022-02-02T22:49:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 -- 172.21.15.96:0/3021691005 shutdown_connections 2022-02-02T22:49:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 --2- 172.21.15.96:0/3021691005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f7980 0x7f33080f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 --2- 172.21.15.96:0/3021691005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f66e0 0x7f33080f6b00 unknown :-1 s=CLOSED pgs=4091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 -- 172.21.15.96:0/3021691005 >> 172.21.15.96:0/3021691005 conn(0x7f33080f1e40 msgr2=0x7f33080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:18 smithi096 ceph-mon[101353]: pgmap v8015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:19.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 -- 172.21.15.96:0/3021691005 shutdown_connections 2022-02-02T22:49:19.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 -- 172.21.15.96:0/3021691005 wait complete. 2022-02-02T22:49:19.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 Processor -- start 2022-02-02T22:49:19.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.114+0000 7f330e2bc700 1 -- start start 2022-02-02T22:49:19.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 0x7f330806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330806a380 con 0x7f33080f7980 2022-02-02T22:49:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330806a4c0 con 0x7f33080f66e0 2022-02-02T22:49:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50586/0 (socket says 172.21.15.96:50586) 2022-02-02T22:49:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 -- 172.21.15.96:0/2924907478 learned_addr learned my addr 172.21.15.96:0/2924907478 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f3307fff700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 0x7f330806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 -- 172.21.15.96:0/2924907478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 msgr2=0x7f330806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 0x7f330806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 -- 172.21.15.96:0/2924907478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc005040 con 0x7f33080f7980 2022-02-02T22:49:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f3307fff700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 0x7f330806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:49:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f33077fe700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 secure :-1 s=READY pgs=4092 cs=0 l=1 rev1=1 rx=0x7f32f80026d0 tx=0x7f32f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f8009320 con 0x7f33080f7980 2022-02-02T22:49:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330806a7a0 con 0x7f33080f7980 2022-02-02T22:49:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32f800f040 con 0x7f33080f7980 2022-02-02T22:49:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f80147e0 con 0x7f33080f7980 2022-02-02T22:49:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.115+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330810efe0 con 0x7f33080f7980 2022-02-02T22:49:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.116+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3308045ad0 con 0x7f33080f7980 2022-02-02T22:49:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.117+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f32f8009480 con 0x7f33080f7980 2022-02-02T22:49:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.117+0000 7f3304ff9700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 0x7f32f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.117+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f32f8082120 con 0x7f33080f7980 2022-02-02T22:49:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.117+0000 7f3307fff700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 0x7f32f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.118+0000 7f3307fff700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 0x7f32f0067290 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7f32fc004e30 tx=0x7f32fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.122+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32f8050220 con 0x7f33080f7980 2022-02-02T22:49:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:18 smithi159 ceph-mon[69013]: pgmap v8015: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:19.294 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.294+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f33080ff010 con 0x7f32f0064dd0 2022-02-02T22:49:19.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.303+0000 7f3304ff9700 1 -- 172.21.15.96:0/2924907478 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f33080ff010 con 0x7f32f0064dd0 2022-02-02T22:49:19.303 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:49:19.303 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:49:19.304 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:49:19.304 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:49:19.305 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:49:19.305 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:49:19.305 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:49:19.306 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:49:19.306 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:49:19.307 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:49:19.307 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:49:19.308 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:49:19.308 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:49:19.308 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:49:19.309 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:49:19.309 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:49:19.309 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:49:19.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:49:19.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:49:19.310 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:49:19.311 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:49:19.311 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:49:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.304+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 msgr2=0x7f32f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.304+0000 7f330e2bc700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 0x7f32f0067290 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7f32fc004e30 tx=0x7f32fc009b30).stop 2022-02-02T22:49:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.304+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 msgr2=0x7f3308069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.304+0000 7f330e2bc700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 secure :-1 s=READY pgs=4092 cs=0 l=1 rev1=1 rx=0x7f32f80026d0 tx=0x7f32f8009de0).stop 2022-02-02T22:49:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 shutdown_connections 2022-02-02T22:49:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32f0064dd0 0x7f32f0067290 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33080f66e0 0x7f330806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 --2- 172.21.15.96:0/2924907478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33080f7980 0x7f3308069e20 unknown :-1 s=CLOSED pgs=4092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 >> 172.21.15.96:0/2924907478 conn(0x7f33080f1e40 msgr2=0x7f33080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 shutdown_connections 2022-02-02T22:49:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.305+0000 7f330e2bc700 1 -- 172.21.15.96:0/2924907478 wait complete. 2022-02-02T22:49:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 -- 172.21.15.96:0/99134067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f7980 msgr2=0x7f5c2c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 --2- 172.21.15.96:0/99134067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c0f7de0 secure :-1 s=READY pgs=4093 cs=0 l=1 rev1=1 rx=0x7f5c1c004660 tx=0x7f5c1c009b30).stop 2022-02-02T22:49:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 -- 172.21.15.96:0/99134067 shutdown_connections 2022-02-02T22:49:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 --2- 172.21.15.96:0/99134067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c0f7de0 unknown :-1 s=CLOSED pgs=4093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 --2- 172.21.15.96:0/99134067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 -- 172.21.15.96:0/99134067 >> 172.21.15.96:0/99134067 conn(0x7f5c2c0f1e40 msgr2=0x7f5c2c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 -- 172.21.15.96:0/99134067 shutdown_connections 2022-02-02T22:49:19.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.400+0000 7f5c32221700 1 -- 172.21.15.96:0/99134067 wait complete. 2022-02-02T22:49:19.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 Processor -- start 2022-02-02T22:49:19.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 -- start start 2022-02-02T22:49:19.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c1079e0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c32221700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c107b20 con 0x7f5c2c0f7980 2022-02-02T22:49:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50592/0 (socket says 172.21.15.96:50592) 2022-02-02T22:49:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c2b7fe700 1 -- 172.21.15.96:0/123618824 learned_addr learned my addr 172.21.15.96:0/123618824 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.401+0000 7f5c2affd700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c2b7fe700 1 -- 172.21.15.96:0/123618824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f7980 msgr2=0x7f5c2c107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c2b7fe700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c2b7fe700 1 -- 172.21.15.96:0/123618824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c005040 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c2b7fe700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 secure :-1 s=READY pgs=4094 cs=0 l=1 rev1=1 rx=0x7f5c20002700 tx=0x7f5c20009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c200079c0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c2000f040 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c1084c0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.416 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c20014860 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.402+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c108a80 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.403+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c045ad0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.417 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.404+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c2001b060 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.404+0000 7f5c13fff700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 0x7f5c14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.404+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5c200818e0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.418 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.404+0000 7f5c2affd700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 0x7f5c14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.405+0000 7f5c2affd700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 0x7f5c14067290 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 rx=0x7f5c1c004630 tx=0x7f5c1c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.419 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.409+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c20053410 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.639+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c2c0ff020 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.639+0000 7f5c13fff700 1 -- 172.21.15.96:0/123618824 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5c200192e0 con 0x7f5c2c0f66e0 2022-02-02T22:49:19.641 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:49:19.642 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:49:19.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:49:19.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:19.643 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:49:19.643 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:49:19.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:19.644 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:49:19.644 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:49:19.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:19.645 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:49:19.645 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:49:19.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:19.646 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:49:19.646 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:49:19.647 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:49:19.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:49:19.647 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:49:19.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 msgr2=0x7f5c14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 0x7f5c14067290 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 rx=0x7f5c1c004630 tx=0x7f5c1c009b30).stop 2022-02-02T22:49:19.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 msgr2=0x7f5c2c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 secure :-1 s=READY pgs=4094 cs=0 l=1 rev1=1 rx=0x7f5c20002700 tx=0x7f5c20009d80).stop 2022-02-02T22:49:19.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 shutdown_connections 2022-02-02T22:49:19.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5c14064dd0 0x7f5c14067290 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c2c0f66e0 0x7f5c2c106f40 unknown :-1 s=CLOSED pgs=4094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 --2- 172.21.15.96:0/123618824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c2c0f7980 0x7f5c2c107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 >> 172.21.15.96:0/123618824 conn(0x7f5c2c0f1e40 msgr2=0x7f5c2c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.641+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 shutdown_connections 2022-02-02T22:49:19.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.642+0000 7f5c32221700 1 -- 172.21.15.96:0/123618824 wait complete. 2022-02-02T22:49:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 -- 172.21.15.96:0/1522817257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f6860 msgr2=0x7f06600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 --2- 172.21.15.96:0/1522817257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f6860 0x7f06600f6cc0 secure :-1 s=READY pgs=4095 cs=0 l=1 rev1=1 rx=0x7f065c004660 tx=0x7f065c009b30).stop 2022-02-02T22:49:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 -- 172.21.15.96:0/1522817257 shutdown_connections 2022-02-02T22:49:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 --2- 172.21.15.96:0/1522817257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f6860 0x7f06600f6cc0 unknown :-1 s=CLOSED pgs=4095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 --2- 172.21.15.96:0/1522817257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f55c0 0x7f06600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 -- 172.21.15.96:0/1522817257 >> 172.21.15.96:0/1522817257 conn(0x7f06600f0d40 msgr2=0x7f06600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 -- 172.21.15.96:0/1522817257 shutdown_connections 2022-02-02T22:49:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.738+0000 7f0667eab700 1 -- 172.21.15.96:0/1522817257 wait complete. 2022-02-02T22:49:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 Processor -- start 2022-02-02T22:49:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 -- start start 2022-02-02T22:49:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f6860 0x7f066010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600602b0 con 0x7f06600f55c0 2022-02-02T22:49:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0667eab700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600603f0 con 0x7f06600f6860 2022-02-02T22:49:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0665c47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0665c47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50602/0 (socket says 172.21.15.96:50602) 2022-02-02T22:49:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0665c47700 1 -- 172.21.15.96:0/2444037815 learned_addr learned my addr 172.21.15.96:0/2444037815 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.739+0000 7f0665446700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f6860 0x7f066010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0665c47700 1 -- 172.21.15.96:0/2444037815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f6860 msgr2=0x7f066010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0665c47700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f6860 0x7f066010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0665c47700 1 -- 172.21.15.96:0/2444037815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c005040 con 0x7f06600f55c0 2022-02-02T22:49:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0665c47700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 secure :-1 s=READY pgs=4096 cs=0 l=1 rev1=1 rx=0x7f065000c790 tx=0x7f0650007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0650013630 con 0x7f06600f55c0 2022-02-02T22:49:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0650012860 con 0x7f06600f55c0 2022-02-02T22:49:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0650002780 con 0x7f06600f55c0 2022-02-02T22:49:19.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066010ea60 con 0x7f06600f55c0 2022-02-02T22:49:19.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.740+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066010eee0 con 0x7f06600f55c0 2022-02-02T22:49:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.741+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660045ad0 con 0x7f06600f55c0 2022-02-02T22:49:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.742+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0650010070 con 0x7f06600f55c0 2022-02-02T22:49:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.742+0000 7f06567fc700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 0x7f064c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.742+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0650081b00 con 0x7f06600f55c0 2022-02-02T22:49:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.742+0000 7f0665446700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 0x7f064c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.743+0000 7f0665446700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 0x7f064c067290 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7f065c004630 tx=0x7f065c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.746+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f065004fba0 con 0x7f06600f55c0 2022-02-02T22:49:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.947+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06600fdec0 con 0x7f06600f55c0 2022-02-02T22:49:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.948+0000 7f06567fc700 1 -- 172.21.15.96:0/2444037815 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f06500531c0 con 0x7f06600f55c0 2022-02-02T22:49:19.949 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:49:19.949 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:49:19.949 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:49:19.950 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:49:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:19.950 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:49:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:49:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:49:19.951 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:49:19.952 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:49:19.952 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:49:19.952 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:49:19.953 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:49:19.953 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:49:19.954 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:49:19.954 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:49:19.954 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:49:19.955 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:49:19.955 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:49:19.955 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:49:19.956 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:49:19.956 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:49:19.956 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:49:19.957 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:49:19.959 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:49:19.959 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:49:19.959 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:49:19.960 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:49:19.960 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:49:19.960 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:49:19.961 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:49:19.961 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:49:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:19.962 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:49:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:19.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:19.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:19.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:19.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.950+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 msgr2=0x7f064c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.950+0000 7f0667eab700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 0x7f064c067290 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7f065c004630 tx=0x7f065c009b30).stop 2022-02-02T22:49:19.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.950+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 msgr2=0x7f066010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:19.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.950+0000 7f0667eab700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 secure :-1 s=READY pgs=4096 cs=0 l=1 rev1=1 rx=0x7f065000c790 tx=0x7f0650007d90).stop 2022-02-02T22:49:19.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 shutdown_connections 2022-02-02T22:49:19.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f064c064dd0 0x7f064c067290 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06600f55c0 0x7f066010c070 unknown :-1 s=CLOSED pgs=4096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 --2- 172.21.15.96:0/2444037815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06600f6860 0x7f066010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:19.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 >> 172.21.15.96:0/2444037815 conn(0x7f06600f0d40 msgr2=0x7f06600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:19.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 shutdown_connections 2022-02-02T22:49:19.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:19.951+0000 7f0667eab700 1 -- 172.21.15.96:0/2444037815 wait complete. 2022-02-02T22:49:19.970 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:49:20.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:19 smithi096 ceph-mon[101353]: from='client.42306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/123618824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:49:20.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2444037815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:49:20.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:19 smithi159 ceph-mon[69013]: from='client.42306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:20.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/123618824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:49:20.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2444037815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:49:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:20 smithi159 ceph-mon[69013]: from='client.42310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:20 smithi159 ceph-mon[69013]: pgmap v8016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:20 smithi096 ceph-mon[101353]: from='client.42310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:21.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:20 smithi096 ceph-mon[101353]: pgmap v8016: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:22 smithi096 ceph-mon[101353]: pgmap v8017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:22 smithi159 ceph-mon[69013]: pgmap v8017: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:24 smithi159 ceph-mon[69013]: pgmap v8018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:24 smithi096 ceph-mon[101353]: pgmap v8018: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:26 smithi159 ceph-mon[69013]: pgmap v8019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:26 smithi096 ceph-mon[101353]: pgmap v8019: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:49:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:49:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:49:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:49:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:28 smithi159 ceph-mon[69013]: pgmap v8020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:28 smithi096 ceph-mon[101353]: pgmap v8020: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:30 smithi159 ceph-mon[69013]: pgmap v8021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:30 smithi096 ceph-mon[101353]: pgmap v8021: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:33.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:32 smithi096 ceph-mon[101353]: pgmap v8022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:33.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:32 smithi159 ceph-mon[69013]: pgmap v8022: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:34 smithi159 ceph-mon[69013]: pgmap v8023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:34 smithi096 ceph-mon[101353]: pgmap v8023: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:36 smithi159 ceph-mon[69013]: pgmap v8024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:36 smithi096 ceph-mon[101353]: pgmap v8024: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:38 smithi159 ceph-mon[69013]: pgmap v8025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:38 smithi096 ceph-mon[101353]: pgmap v8025: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:40 smithi159 ceph-mon[69013]: pgmap v8026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:40 smithi096 ceph-mon[101353]: pgmap v8026: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:42 smithi159 ceph-mon[69013]: pgmap v8027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:43.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:42 smithi096 ceph-mon[101353]: pgmap v8027: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:45 smithi159 ceph-mon[69013]: pgmap v8028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:45 smithi096 ceph-mon[101353]: pgmap v8028: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:47 smithi159 ceph-mon[69013]: pgmap v8029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:47 smithi096 ceph-mon[101353]: pgmap v8029: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:49 smithi159 ceph-mon[69013]: pgmap v8030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:49 smithi096 ceph-mon[101353]: pgmap v8030: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 -- 172.21.15.96:0/1930717343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f6860 msgr2=0x7f48e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 --2- 172.21.15.96:0/1930717343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f6860 0x7f48e00f6cc0 secure :-1 s=READY pgs=4097 cs=0 l=1 rev1=1 rx=0x7f48d0004660 tx=0x7f48d0009b30).stop 2022-02-02T22:49:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 -- 172.21.15.96:0/1930717343 shutdown_connections 2022-02-02T22:49:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 --2- 172.21.15.96:0/1930717343 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f6860 0x7f48e00f6cc0 unknown :-1 s=CLOSED pgs=4097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 --2- 172.21.15.96:0/1930717343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f55c0 0x7f48e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 -- 172.21.15.96:0/1930717343 >> 172.21.15.96:0/1930717343 conn(0x7f48e00f0d40 msgr2=0x7f48e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 -- 172.21.15.96:0/1930717343 shutdown_connections 2022-02-02T22:49:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.062+0000 7f48e49d8700 1 -- 172.21.15.96:0/1930717343 wait complete. 2022-02-02T22:49:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 Processor -- start 2022-02-02T22:49:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 -- start start 2022-02-02T22:49:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f6860 0x7f48e0109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0109c00 con 0x7f48e00f55c0 2022-02-02T22:49:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48e49d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0109d40 con 0x7f48e00f6860 2022-02-02T22:49:50.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48de59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50620/0 (socket says 172.21.15.96:50620) 2022-02-02T22:49:50.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.063+0000 7f48de59c700 1 -- 172.21.15.96:0/3250952737 learned_addr learned my addr 172.21.15.96:0/3250952737 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:50.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48ddd9b700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f6860 0x7f48e0109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48de59c700 1 -- 172.21.15.96:0/3250952737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f6860 msgr2=0x7f48e0109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48de59c700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f6860 0x7f48e0109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48de59c700 1 -- 172.21.15.96:0/3250952737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0005040 con 0x7f48e00f55c0 2022-02-02T22:49:50.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48de59c700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 secure :-1 s=READY pgs=4098 cs=0 l=1 rev1=1 rx=0x7f48c8002700 tx=0x7f48c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c8009320 con 0x7f48e00f55c0 2022-02-02T22:49:50.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f48c800f040 con 0x7f48e00f55c0 2022-02-02T22:49:50.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e010a6e0 con 0x7f48e00f55c0 2022-02-02T22:49:50.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c8014900 con 0x7f48e00f55c0 2022-02-02T22:49:50.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.064+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e010aca0 con 0x7f48e00f55c0 2022-02-02T22:49:50.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.065+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0045ad0 con 0x7f48e00f55c0 2022-02-02T22:49:50.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.066+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f48c8009480 con 0x7f48e00f55c0 2022-02-02T22:49:50.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.066+0000 7f48d6ffd700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 0x7f48cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.066+0000 7f48ddd9b700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 0x7f48cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.066+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f48c8081cc0 con 0x7f48e00f55c0 2022-02-02T22:49:50.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.067+0000 7f48ddd9b700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 0x7f48cc067290 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 rx=0x7f48d0004630 tx=0x7f48d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.071+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f48c80538b0 con 0x7f48e00f55c0 2022-02-02T22:49:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.251+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e00faaa0 con 0x7f48cc064dd0 2022-02-02T22:49:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.252+0000 7f48d6ffd700 1 -- 172.21.15.96:0/3250952737 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f48e00faaa0 con 0x7f48cc064dd0 2022-02-02T22:49:50.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 msgr2=0x7f48cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 0x7f48cc067290 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 rx=0x7f48d0004630 tx=0x7f48d0009b30).stop 2022-02-02T22:49:50.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 msgr2=0x7f48e0109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 secure :-1 s=READY pgs=4098 cs=0 l=1 rev1=1 rx=0x7f48c8002700 tx=0x7f48c8009d80).stop 2022-02-02T22:49:50.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 shutdown_connections 2022-02-02T22:49:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f48cc064dd0 0x7f48cc067290 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48e00f55c0 0x7f48e0109160 unknown :-1 s=CLOSED pgs=4098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 --2- 172.21.15.96:0/3250952737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e00f6860 0x7f48e0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 >> 172.21.15.96:0/3250952737 conn(0x7f48e00f0d40 msgr2=0x7f48e005fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 shutdown_connections 2022-02-02T22:49:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.254+0000 7f48e49d8700 1 -- 172.21.15.96:0/3250952737 wait complete. 2022-02-02T22:49:50.263 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:49:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 -- 172.21.15.96:0/3228557743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 msgr2=0x7ff23c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 --2- 172.21.15.96:0/3228557743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c0f59e0 secure :-1 s=READY pgs=4099 cs=0 l=1 rev1=1 rx=0x7ff22c004660 tx=0x7ff22c009b30).stop 2022-02-02T22:49:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 -- 172.21.15.96:0/3228557743 shutdown_connections 2022-02-02T22:49:50.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 --2- 172.21.15.96:0/3228557743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 0x7ff23c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 --2- 172.21.15.96:0/3228557743 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c0f59e0 unknown :-1 s=CLOSED pgs=4099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.352+0000 7ff2409d2700 1 -- 172.21.15.96:0/3228557743 >> 172.21.15.96:0/3228557743 conn(0x7ff23c0f0d40 msgr2=0x7ff23c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.353+0000 7ff2409d2700 1 -- 172.21.15.96:0/3228557743 shutdown_connections 2022-02-02T22:49:50.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.353+0000 7ff2409d2700 1 -- 172.21.15.96:0/3228557743 wait complete. 2022-02-02T22:49:50.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.353+0000 7ff2409d2700 1 Processor -- start 2022-02-02T22:49:50.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.353+0000 7ff2409d2700 1 -- start start 2022-02-02T22:49:50.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.353+0000 7ff2409d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff2409d2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 0x7ff23c10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff2409d2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0603e0 con 0x7ff23c0f55c0 2022-02-02T22:49:50.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff2409d2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c060520 con 0x7ff23c0f6860 2022-02-02T22:49:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50630/0 (socket says 172.21.15.96:50630) 2022-02-02T22:49:50.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 -- 172.21.15.96:0/2246933126 learned_addr learned my addr 172.21.15.96:0/2246933126 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:50.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff239d9b700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 0x7ff23c10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 -- 172.21.15.96:0/2246933126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 msgr2=0x7ff23c10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 0x7ff23c10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 -- 172.21.15.96:0/2246933126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c005040 con 0x7ff23c0f55c0 2022-02-02T22:49:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff23a59c700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 secure :-1 s=READY pgs=4100 cs=0 l=1 rev1=1 rx=0x7ff22c013a70 tx=0x7ff22c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff22c018070 con 0x7ff23c0f55c0 2022-02-02T22:49:50.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff22c0097d0 con 0x7ff23c0f55c0 2022-02-02T22:49:50.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c10c700 con 0x7ff23c0f55c0 2022-02-02T22:49:50.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff22c01de80 con 0x7ff23c0f55c0 2022-02-02T22:49:50.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.354+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c10cc60 con 0x7ff23c0f55c0 2022-02-02T22:49:50.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.355+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c045ad0 con 0x7ff23c0f55c0 2022-02-02T22:49:50.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.356+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff22c007ba0 con 0x7ff23c0f55c0 2022-02-02T22:49:50.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.356+0000 7ff22affd700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 0x7ff224067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.356+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff22c083650 con 0x7ff23c0f55c0 2022-02-02T22:49:50.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.356+0000 7ff239d9b700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 0x7ff224067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.357+0000 7ff239d9b700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 0x7ff224067290 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7ff230004c40 tx=0x7ff23000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.361+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff22c051750 con 0x7ff23c0f55c0 2022-02-02T22:49:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.533+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff23c0fdef0 con 0x7ff224064dd0 2022-02-02T22:49:50.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.542+0000 7ff22affd700 1 -- 172.21.15.96:0/2246933126 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff23c0fdef0 con 0x7ff224064dd0 2022-02-02T22:49:50.543 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:49:50.543 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:49:50.543 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:49:50.544 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:49:50.544 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:49:50.544 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:49:50.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:49:50.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:49:50.545 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:49:50.546 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:49:50.546 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:49:50.546 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:49:50.547 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:49:50.547 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:49:50.548 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:49:50.548 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:49:50.548 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:49:50.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:49:50.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:49:50.549 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:49:50.550 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:49:50.550 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:49:50.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 msgr2=0x7ff224067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 0x7ff224067290 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7ff230004c40 tx=0x7ff23000b040).stop 2022-02-02T22:49:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 msgr2=0x7ff23c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 secure :-1 s=READY pgs=4100 cs=0 l=1 rev1=1 rx=0x7ff22c013a70 tx=0x7ff22c009b30).stop 2022-02-02T22:49:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 shutdown_connections 2022-02-02T22:49:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff224064dd0 0x7ff224067290 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c0f55c0 0x7ff23c109cb0 unknown :-1 s=CLOSED pgs=4100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 --2- 172.21.15.96:0/2246933126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff23c0f6860 0x7ff23c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 >> 172.21.15.96:0/2246933126 conn(0x7ff23c0f0d40 msgr2=0x7ff23c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 shutdown_connections 2022-02-02T22:49:50.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.544+0000 7ff2409d2700 1 -- 172.21.15.96:0/2246933126 wait complete. 2022-02-02T22:49:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.640+0000 7f95b689c700 1 -- 172.21.15.96:0/4277429975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 msgr2=0x7f95b00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 --2- 172.21.15.96:0/4277429975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b00f6b00 secure :-1 s=READY pgs=4101 cs=0 l=1 rev1=1 rx=0x7f95a4004660 tx=0x7f95a4009b30).stop 2022-02-02T22:49:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 -- 172.21.15.96:0/4277429975 shutdown_connections 2022-02-02T22:49:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 --2- 172.21.15.96:0/4277429975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 0x7f95b00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 --2- 172.21.15.96:0/4277429975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b00f6b00 unknown :-1 s=CLOSED pgs=4101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 -- 172.21.15.96:0/4277429975 >> 172.21.15.96:0/4277429975 conn(0x7f95b00f1e40 msgr2=0x7f95b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 -- 172.21.15.96:0/4277429975 shutdown_connections 2022-02-02T22:49:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 -- 172.21.15.96:0/4277429975 wait complete. 2022-02-02T22:49:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.641+0000 7f95b689c700 1 Processor -- start 2022-02-02T22:49:50.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95b689c700 1 -- start start 2022-02-02T22:49:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95b689c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95b689c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 0x7f95b01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95b689c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0107a50 con 0x7f95b00f66e0 2022-02-02T22:49:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95b689c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0107b90 con 0x7f95b00f7980 2022-02-02T22:49:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50640/0 (socket says 172.21.15.96:50640) 2022-02-02T22:49:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 -- 172.21.15.96:0/2394249672 learned_addr learned my addr 172.21.15.96:0/2394249672 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95af7fe700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 0x7f95b01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 -- 172.21.15.96:0/2394249672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 msgr2=0x7f95b01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 0x7f95b01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 -- 172.21.15.96:0/2394249672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4005040 con 0x7f95b00f66e0 2022-02-02T22:49:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.642+0000 7f95affff700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 secure :-1 s=READY pgs=4102 cs=0 l=1 rev1=1 rx=0x7f95a4013a70 tx=0x7f95a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.643+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a4018070 con 0x7f95b00f66e0 2022-02-02T22:49:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.643+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95a40097d0 con 0x7f95b00f66e0 2022-02-02T22:49:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.643+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b01084d0 con 0x7f95b00f66e0 2022-02-02T22:49:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.643+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95a401c3c0 con 0x7f95b00f66e0 2022-02-02T22:49:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.643+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b0108a30 con 0x7f95b00f66e0 2022-02-02T22:49:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.644+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0045ad0 con 0x7f95b00f66e0 2022-02-02T22:49:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.644+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f95a4007ba0 con 0x7f95b00f66e0 2022-02-02T22:49:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.645+0000 7f95acff9700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 0x7f9598067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.645+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95a4083730 con 0x7f95b00f66e0 2022-02-02T22:49:50.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.645+0000 7f95af7fe700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 0x7f9598067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.645+0000 7f95af7fe700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 0x7f9598067290 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 rx=0x7f95a00096c0 tx=0x7f95a0009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.649+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95a4055320 con 0x7f95b00f66e0 2022-02-02T22:49:50.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.879+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95b00fefb0 con 0x7f95b00f66e0 2022-02-02T22:49:50.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.879+0000 7f95acff9700 1 -- 172.21.15.96:0/2394249672 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f95a4054f10 con 0x7f95b00f66e0 2022-02-02T22:49:50.880 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:49:50.881 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:49:50.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:49:50.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:50.882 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:49:50.882 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:49:50.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:50.883 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:49:50.883 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:49:50.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:50.884 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:49:50.884 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:49:50.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:49:50.885 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:49:50.885 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:49:50.885 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:49:50.886 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:49:50.886 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:49:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 msgr2=0x7f9598067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 0x7f9598067290 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 rx=0x7f95a00096c0 tx=0x7f95a0009be0).stop 2022-02-02T22:49:50.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 msgr2=0x7f95b0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 secure :-1 s=READY pgs=4102 cs=0 l=1 rev1=1 rx=0x7f95a4013a70 tx=0x7f95a4009b30).stop 2022-02-02T22:49:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 shutdown_connections 2022-02-02T22:49:50.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9598064dd0 0x7f9598067290 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b00f66e0 0x7f95b0106fb0 unknown :-1 s=CLOSED pgs=4102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 --2- 172.21.15.96:0/2394249672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b00f7980 0x7f95b01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 >> 172.21.15.96:0/2394249672 conn(0x7f95b00f1e40 msgr2=0x7f95b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 shutdown_connections 2022-02-02T22:49:50.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.881+0000 7f95b689c700 1 -- 172.21.15.96:0/2394249672 wait complete. 2022-02-02T22:49:50.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 -- 172.21.15.96:0/2835726583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f5430 msgr2=0x7fa0380f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 --2- 172.21.15.96:0/2835726583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f5430 0x7fa0380f5850 secure :-1 s=READY pgs=4103 cs=0 l=1 rev1=1 rx=0x7fa020004660 tx=0x7fa020009b30).stop 2022-02-02T22:49:50.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 -- 172.21.15.96:0/2835726583 shutdown_connections 2022-02-02T22:49:50.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 --2- 172.21.15.96:0/2835726583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f66d0 0x7fa0380f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 --2- 172.21.15.96:0/2835726583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f5430 0x7fa0380f5850 unknown :-1 s=CLOSED pgs=4103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 -- 172.21.15.96:0/2835726583 >> 172.21.15.96:0/2835726583 conn(0x7fa0380f0b90 msgr2=0x7fa0380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:50.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 -- 172.21.15.96:0/2835726583 shutdown_connections 2022-02-02T22:49:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.979+0000 7fa037fff700 1 -- 172.21.15.96:0/2835726583 wait complete. 2022-02-02T22:49:50.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 Processor -- start 2022-02-02T22:49:50.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 -- start start 2022-02-02T22:49:50.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f5430 0x7fa038108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038109a40 con 0x7fa0380f66d0 2022-02-02T22:49:50.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa037fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038109b80 con 0x7fa0380f5430 2022-02-02T22:49:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa0367fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa0367fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50652/0 (socket says 172.21.15.96:50652) 2022-02-02T22:49:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa0367fc700 1 -- 172.21.15.96:0/2347365183 learned_addr learned my addr 172.21.15.96:0/2347365183 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:49:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.980+0000 7fa036ffd700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f5430 0x7fa038108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa0367fc700 1 -- 172.21.15.96:0/2347365183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f5430 msgr2=0x7fa038108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa0367fc700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f5430 0x7fa038108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa0367fc700 1 -- 172.21.15.96:0/2347365183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020005040 con 0x7fa0380f66d0 2022-02-02T22:49:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa0367fc700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 secure :-1 s=READY pgs=4104 cs=0 l=1 rev1=1 rx=0x7fa0280026d0 tx=0x7fa028009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0280079c0 con 0x7fa0380f66d0 2022-02-02T22:49:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03810a520 con 0x7fa0380f66d0 2022-02-02T22:49:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa02800f040 con 0x7fa0380f66d0 2022-02-02T22:49:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0280148b0 con 0x7fa0380f66d0 2022-02-02T22:49:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.981+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03810aae0 con 0x7fa0380f66d0 2022-02-02T22:49:50.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.982+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa038045ad0 con 0x7fa0380f66d0 2022-02-02T22:49:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.983+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa028007b20 con 0x7fa0380f66d0 2022-02-02T22:49:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.983+0000 7fa02f7fe700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 0x7fa0240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:49:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.983+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa0280819e0 con 0x7fa0380f66d0 2022-02-02T22:49:50.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.983+0000 7fa036ffd700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 0x7fa0240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:49:50.993 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.984+0000 7fa036ffd700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 0x7fa0240672e0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 rx=0x7fa020004630 tx=0x7fa020009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:49:50.994 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:50.987+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa028053510 con 0x7fa0380f66d0 2022-02-02T22:49:51.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.190+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa03810f5c0 con 0x7fa0380f66d0 2022-02-02T22:49:51.191 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.191+0000 7fa02f7fe700 1 -- 172.21.15.96:0/2347365183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa028053100 con 0x7fa0380f66d0 2022-02-02T22:49:51.192 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:49:51.192 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:49:51.193 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:49:51.193 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:49:51.194 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:51.194 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:49:51.194 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:49:51.195 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:49:51.195 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:49:51.195 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:49:51.196 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:49:51.196 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:49:51.197 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:49:51.197 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:49:51.197 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:49:51.198 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:49:51.198 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:49:51.198 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:49:51.199 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:49:51.199 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:49:51.199 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:49:51.200 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:49:51.201 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:49:51.201 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:49:51.201 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:49:51.202 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:49:51.202 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:49:51.202 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:49:51.203 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:49:51.203 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:49:51.203 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:49:51.204 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:49:51.204 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:51.204 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:51.205 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:49:51.205 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:49:51.206 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:51.206 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:51.206 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:49:51.207 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:51 smithi096 ceph-mon[101353]: pgmap v8031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:51.207 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2394249672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:49:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 msgr2=0x7fa0240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 0x7fa0240672e0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 rx=0x7fa020004630 tx=0x7fa020009b30).stop 2022-02-02T22:49:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 msgr2=0x7fa038109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:49:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 secure :-1 s=READY pgs=4104 cs=0 l=1 rev1=1 rx=0x7fa0280026d0 tx=0x7fa028009de0).stop 2022-02-02T22:49:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 shutdown_connections 2022-02-02T22:49:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa024064e20 0x7fa0240672e0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0380f5430 0x7fa038108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 --2- 172.21.15.96:0/2347365183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0380f66d0 0x7fa038109490 unknown :-1 s=CLOSED pgs=4104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:49:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.192+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 >> 172.21.15.96:0/2347365183 conn(0x7fa0380f0b90 msgr2=0x7fa03805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:49:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.193+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 shutdown_connections 2022-02-02T22:49:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:49:51.193+0000 7fa037fff700 1 -- 172.21.15.96:0/2347365183 wait complete. 2022-02-02T22:49:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:49:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:51 smithi159 ceph-mon[69013]: pgmap v8031: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2394249672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:49:52.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:52 smithi159 ceph-mon[69013]: from='client.42322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:52.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:52 smithi159 ceph-mon[69013]: from='client.42326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:52.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2347365183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:49:52.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:52 smithi096 ceph-mon[101353]: from='client.42322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:52.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:52 smithi096 ceph-mon[101353]: from='client.42326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:49:52.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2347365183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:49:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:53 smithi159 ceph-mon[69013]: pgmap v8032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:53.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:53 smithi096 ceph-mon[101353]: pgmap v8032: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:55 smithi159 ceph-mon[69013]: pgmap v8033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:55.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:55 smithi096 ceph-mon[101353]: pgmap v8033: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:57 smithi159 ceph-mon[69013]: pgmap v8034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:57 smithi096 ceph-mon[101353]: pgmap v8034: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:49:59 smithi096 ceph-mon[101353]: pgmap v8035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:49:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:49:59 smithi159 ceph-mon[69013]: pgmap v8035: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:00.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:50:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T22:50:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:01 smithi096 ceph-mon[101353]: pgmap v8036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:01 smithi159 ceph-mon[69013]: pgmap v8036: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:03.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:03 smithi096 ceph-mon[101353]: pgmap v8037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:03 smithi159 ceph-mon[69013]: pgmap v8037: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:05 smithi096 ceph-mon[101353]: pgmap v8038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:05 smithi159 ceph-mon[69013]: pgmap v8038: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:07.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:07 smithi096 ceph-mon[101353]: pgmap v8039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:07 smithi159 ceph-mon[69013]: pgmap v8039: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:09 smithi096 ceph-mon[101353]: pgmap v8040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:09 smithi159 ceph-mon[69013]: pgmap v8040: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:11 smithi096 ceph-mon[101353]: pgmap v8041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:11 smithi159 ceph-mon[69013]: pgmap v8041: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:13 smithi159 ceph-mon[69013]: pgmap v8042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:13 smithi096 ceph-mon[101353]: pgmap v8042: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:15 smithi159 ceph-mon[69013]: pgmap v8043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:15 smithi096 ceph-mon[101353]: pgmap v8043: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:17 smithi159 ceph-mon[69013]: pgmap v8044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:17 smithi096 ceph-mon[101353]: pgmap v8044: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:19 smithi159 ceph-mon[69013]: pgmap v8045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:19 smithi096 ceph-mon[101353]: pgmap v8045: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2311046204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 msgr2=0x7f77d80f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2311046204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d80f5880 secure :-1 s=READY pgs=4105 cs=0 l=1 rev1=1 rx=0x7f77c8004660 tx=0x7f77c8009b30).stop 2022-02-02T22:50:21.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2311046204 shutdown_connections 2022-02-02T22:50:21.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2311046204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 0x7f77d80f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2311046204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d80f5880 unknown :-1 s=CLOSED pgs=4105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.302+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2311046204 >> 172.21.15.96:0/2311046204 conn(0x7f77d80f0bc0 msgr2=0x7f77d80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2311046204 shutdown_connections 2022-02-02T22:50:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2311046204 wait complete. 2022-02-02T22:50:21.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 Processor -- start 2022-02-02T22:50:21.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 -- start start 2022-02-02T22:50:21.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.303+0000 7f77dd5cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 0x7f77d8105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77dd5cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8105660 con 0x7f77d80f5460 2022-02-02T22:50:21.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77dd5cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81057a0 con 0x7f77d80f6700 2022-02-02T22:50:21.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50668/0 (socket says 172.21.15.96:50668) 2022-02-02T22:50:21.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2725951211 learned_addr learned my addr 172.21.15.96:0/2725951211 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:21.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d67fc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 0x7f77d8105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2725951211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 msgr2=0x7f77d8105060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 0x7f77d8105060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 -- 172.21.15.96:0/2725951211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8005040 con 0x7f77d80f5460 2022-02-02T22:50:21.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77d6ffd700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 secure :-1 s=READY pgs=4106 cs=0 l=1 rev1=1 rx=0x7f77c8013a70 tx=0x7f77c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c8018070 con 0x7f77d80f5460 2022-02-02T22:50:21.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77c80097d0 con 0x7f77d80f5460 2022-02-02T22:50:21.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d81060b0 con 0x7f77d80f5460 2022-02-02T22:50:21.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c801de80 con 0x7f77d80f5460 2022-02-02T22:50:21.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.304+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d8106610 con 0x7f77d80f5460 2022-02-02T22:50:21.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.306+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8045ad0 con 0x7f77d80f5460 2022-02-02T22:50:21.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.306+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77c8007ba0 con 0x7f77d80f5460 2022-02-02T22:50:21.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.306+0000 7f77bf7fe700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 0x7f77c00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.306+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f77c8083650 con 0x7f77d80f5460 2022-02-02T22:50:21.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.306+0000 7f77d67fc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 0x7f77c00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.307+0000 7f77d67fc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 0x7f77c00672e0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 rx=0x7f77cc004c40 tx=0x7f77cc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.311+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77c8051750 con 0x7f77d80f5460 2022-02-02T22:50:21.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.490+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d80fddd0 con 0x7f77c0064e20 2022-02-02T22:50:21.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:21 smithi096 ceph-mon[101353]: pgmap v8046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:21.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.491+0000 7f77bf7fe700 1 -- 172.21.15.96:0/2725951211 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f77cc00f040 con 0x7f77c0064e20 2022-02-02T22:50:21.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 msgr2=0x7f77c00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 0x7f77c00672e0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 rx=0x7f77cc004c40 tx=0x7f77cc00b040).stop 2022-02-02T22:50:21.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 msgr2=0x7f77d8104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 secure :-1 s=READY pgs=4106 cs=0 l=1 rev1=1 rx=0x7f77c8013a70 tx=0x7f77c8009b30).stop 2022-02-02T22:50:21.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 shutdown_connections 2022-02-02T22:50:21.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f77c0064e20 0x7f77c00672e0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77d80f5460 0x7f77d8104b70 unknown :-1 s=CLOSED pgs=4106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 --2- 172.21.15.96:0/2725951211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d80f6700 0x7f77d8105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 >> 172.21.15.96:0/2725951211 conn(0x7f77d80f0bc0 msgr2=0x7f77d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:21.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 shutdown_connections 2022-02-02T22:50:21.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.493+0000 7f77dd5cc700 1 -- 172.21.15.96:0/2725951211 wait complete. 2022-02-02T22:50:21.503 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:50:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:21 smithi159 ceph-mon[69013]: pgmap v8046: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:21.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 -- 172.21.15.96:0/3023481506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 msgr2=0x7f42b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 --2- 172.21.15.96:0/3023481506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b00f7c30 secure :-1 s=READY pgs=4107 cs=0 l=1 rev1=1 rx=0x7f42a0004660 tx=0x7f42a0009b30).stop 2022-02-02T22:50:21.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 -- 172.21.15.96:0/3023481506 shutdown_connections 2022-02-02T22:50:21.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 --2- 172.21.15.96:0/3023481506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b00f7c30 unknown :-1 s=CLOSED pgs=4107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 --2- 172.21.15.96:0/3023481506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 0x7f42b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:50:21.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 -- 172.21.15.96:0/3023481506 >> 172.21.15.96:0/3023481506 conn(0x7f42b00f1c90 msgr2=0x7f42b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:21.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 -- 172.21.15.96:0/3023481506 shutdown_connections 2022-02-02T22:50:21.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.589+0000 7f42b6960700 1 -- 172.21.15.96:0/3023481506 wait complete. 2022-02-02T22:50:21.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 Processor -- start 2022-02-02T22:50:21.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 -- start start 2022-02-02T22:50:21.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 0x7f42b0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0107980 con 0x7f42b00f77d0 2022-02-02T22:50:21.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.590+0000 7f42b6960700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0108100 con 0x7f42b00f6530 2022-02-02T22:50:21.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50678/0 (socket says 172.21.15.96:50678) 2022-02-02T22:50:21.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 -- 172.21.15.96:0/2486301722 learned_addr learned my addr 172.21.15.96:0/2486301722 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:21.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b595e700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 0x7f42b0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 -- 172.21.15.96:0/2486301722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 msgr2=0x7f42b0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 0x7f42b0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 -- 172.21.15.96:0/2486301722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a0005040 con 0x7f42b00f77d0 2022-02-02T22:50:21.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b515d700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 secure :-1 s=READY pgs=4108 cs=0 l=1 rev1=1 rx=0x7f42a0009990 tx=0x7f42a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a0018070 con 0x7f42b00f77d0 2022-02-02T22:50:21.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b0108320 con 0x7f42b00f77d0 2022-02-02T22:50:21.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42a0007ca0 con 0x7f42b00f77d0 2022-02-02T22:50:21.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a001c620 con 0x7f42b00f77d0 2022-02-02T22:50:21.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.591+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b0108880 con 0x7f42b00f77d0 2022-02-02T22:50:21.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.592+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b0045ad0 con 0x7f42b00f77d0 2022-02-02T22:50:21.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.593+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f42a001d960 con 0x7f42b00f77d0 2022-02-02T22:50:21.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.593+0000 7f42a67fc700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 0x7f429c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.593+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42a00837d0 con 0x7f42b00f77d0 2022-02-02T22:50:21.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.593+0000 7f42b595e700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 0x7f429c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.593+0000 7f42b595e700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 0x7f429c0672e0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7f42b0106b70 tx=0x7f42ac008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.597+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f42a0051a40 con 0x7f42b00f77d0 2022-02-02T22:50:21.770 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.769+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42b0108b60 con 0x7f429c064e20 2022-02-02T22:50:21.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.779+0000 7f42a67fc700 1 -- 172.21.15.96:0/2486301722 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f42b0108b60 con 0x7f429c064e20 2022-02-02T22:50:21.780 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:50:21.781 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:50:21.781 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:50:21.781 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:50:21.782 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:50:21.782 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:50:21.783 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:50:21.783 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:50:21.783 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:50:21.784 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:50:21.784 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:50:21.784 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:50:21.785 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:50:21.785 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:50:21.785 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:50:21.786 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:50:21.786 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:50:21.786 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:50:21.787 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:50:21.787 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:50:21.788 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:50:21.788 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:50:21.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.780+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 msgr2=0x7f429c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 0x7f429c0672e0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7f42b0106b70 tx=0x7f42ac008040).stop 2022-02-02T22:50:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 msgr2=0x7f42b01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 secure :-1 s=READY pgs=4108 cs=0 l=1 rev1=1 rx=0x7f42a0009990 tx=0x7f42a0009b30).stop 2022-02-02T22:50:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 shutdown_connections 2022-02-02T22:50:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f429c064e20 0x7f429c0672e0 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42b00f6530 0x7f42b0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 --2- 172.21.15.96:0/2486301722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42b00f77d0 0x7f42b01072f0 unknown :-1 s=CLOSED pgs=4108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 >> 172.21.15.96:0/2486301722 conn(0x7f42b00f1c90 msgr2=0x7f42b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 shutdown_connections 2022-02-02T22:50:21.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.781+0000 7f42b6960700 1 -- 172.21.15.96:0/2486301722 wait complete. 2022-02-02T22:50:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 -- 172.21.15.96:0/1100799034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 msgr2=0x7f19e00f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 --2- 172.21.15.96:0/1100799034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e00f5df0 secure :-1 s=READY pgs=4109 cs=0 l=1 rev1=1 rx=0x7f19d0004660 tx=0x7f19d0009b30).stop 2022-02-02T22:50:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 -- 172.21.15.96:0/1100799034 shutdown_connections 2022-02-02T22:50:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 --2- 172.21.15.96:0/1100799034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e00f5df0 unknown :-1 s=CLOSED pgs=4109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 --2- 172.21.15.96:0/1100799034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 0x7f19e00f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.876+0000 7f19e7f78700 1 -- 172.21.15.96:0/1100799034 >> 172.21.15.96:0/1100799034 conn(0x7f19e00f04c0 msgr2=0x7f19e00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 -- 172.21.15.96:0/1100799034 shutdown_connections 2022-02-02T22:50:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 -- 172.21.15.96:0/1100799034 wait complete. 2022-02-02T22:50:21.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 Processor -- start 2022-02-02T22:50:21.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 -- start start 2022-02-02T22:50:21.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 0x7f19e010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00f5510 con 0x7f19e00f5970 2022-02-02T22:50:21.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e7f78700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00f5650 con 0x7f19e00f6c60 2022-02-02T22:50:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e5d14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e5d14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50684/0 (socket says 172.21.15.96:50684) 2022-02-02T22:50:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.877+0000 7f19e5d14700 1 -- 172.21.15.96:0/4250996980 learned_addr learned my addr 172.21.15.96:0/4250996980 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e5513700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 0x7f19e010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e5d14700 1 -- 172.21.15.96:0/4250996980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 msgr2=0x7f19e010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:21.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e5d14700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 0x7f19e010e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:21.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e5d14700 1 -- 172.21.15.96:0/4250996980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0005040 con 0x7f19e00f5970 2022-02-02T22:50:21.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e5d14700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 secure :-1 s=READY pgs=4110 cs=0 l=1 rev1=1 rx=0x7f19dc0026d0 tx=0x7f19dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc0079c0 con 0x7f19e00f5970 2022-02-02T22:50:21.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19dc00f040 con 0x7f19e00f5970 2022-02-02T22:50:21.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e010ea00 con 0x7f19e00f5970 2022-02-02T22:50:21.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc0148b0 con 0x7f19e00f5970 2022-02-02T22:50:21.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.878+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e010ee80 con 0x7f19e00f5970 2022-02-02T22:50:21.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.879+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e0045ad0 con 0x7f19e00f5970 2022-02-02T22:50:21.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.879+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19dc007b20 con 0x7f19e00f5970 2022-02-02T22:50:21.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.880+0000 7f19d67fc700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 0x7f19cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:21.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.880+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19dc081930 con 0x7f19e00f5970 2022-02-02T22:50:21.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.880+0000 7f19e5513700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 0x7f19cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:21.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.880+0000 7f19e5513700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 0x7f19cc067290 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 rx=0x7f19d0004630 tx=0x7f19d0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:21.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:21.884+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19dc04fa30 con 0x7f19e00f5970 2022-02-02T22:50:22.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.115+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19e00f57e0 con 0x7f19e00f5970 2022-02-02T22:50:22.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.116+0000 7f19d67fc700 1 -- 172.21.15.96:0/4250996980 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f19dc053050 con 0x7f19e00f5970 2022-02-02T22:50:22.118 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:50:22.118 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:50:22.118 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:50:22.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:22.119 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:50:22.119 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:50:22.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:22.120 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:50:22.120 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:50:22.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:22.121 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:50:22.121 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:50:22.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:22.122 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:50:22.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:50:22.122 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:50:22.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:50:22.123 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:50:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 msgr2=0x7f19cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 0x7f19cc067290 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 rx=0x7f19d0004630 tx=0x7f19d0009b30).stop 2022-02-02T22:50:22.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 msgr2=0x7f19e010c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 secure :-1 s=READY pgs=4110 cs=0 l=1 rev1=1 rx=0x7f19dc0026d0 tx=0x7f19dc009de0).stop 2022-02-02T22:50:22.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 shutdown_connections 2022-02-02T22:50:22.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f19cc064dd0 0x7f19cc067290 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19e00f5970 0x7f19e010c010 unknown :-1 s=CLOSED pgs=4110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 --2- 172.21.15.96:0/4250996980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e00f6c60 0x7f19e010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 >> 172.21.15.96:0/4250996980 conn(0x7f19e00f04c0 msgr2=0x7f19e00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:22.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 shutdown_connections 2022-02-02T22:50:22.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.118+0000 7f19e7f78700 1 -- 172.21.15.96:0/4250996980 wait complete. 2022-02-02T22:50:22.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.216+0000 7f423dce8700 1 -- 172.21.15.96:0/1544318305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 msgr2=0x7f42380fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.216+0000 7f423dce8700 1 --2- 172.21.15.96:0/1544318305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f42380fbc80 secure :-1 s=READY pgs=4111 cs=0 l=1 rev1=1 rx=0x7f4228004660 tx=0x7f4228009b30).stop 2022-02-02T22:50:22.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.216+0000 7f423dce8700 1 -- 172.21.15.96:0/1544318305 shutdown_connections 2022-02-02T22:50:22.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 --2- 172.21.15.96:0/1544318305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f42380fbc80 unknown :-1 s=CLOSED pgs=4111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 --2- 172.21.15.96:0/1544318305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 0x7f42380f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- 172.21.15.96:0/1544318305 >> 172.21.15.96:0/1544318305 conn(0x7f42380f0d40 msgr2=0x7f42380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- 172.21.15.96:0/1544318305 shutdown_connections 2022-02-02T22:50:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- 172.21.15.96:0/1544318305 wait complete. 2022-02-02T22:50:22.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 Processor -- start 2022-02-02T22:50:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- start start 2022-02-02T22:50:22.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 0x7f4238106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42381079e0 con 0x7f42380f9830 2022-02-02T22:50:22.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.217+0000 7f423dce8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238107b20 con 0x7f4238060270 2022-02-02T22:50:22.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:22.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50696/0 (socket says 172.21.15.96:50696) 2022-02-02T22:50:22.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 -- 172.21.15.96:0/4053548614 learned_addr learned my addr 172.21.15.96:0/4053548614 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:22.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f42377fe700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 0x7f4238106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:22.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 -- 172.21.15.96:0/4053548614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 msgr2=0x7f4238106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 0x7f4238106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 -- 172.21.15.96:0/4053548614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228005040 con 0x7f42380f9830 2022-02-02T22:50:22.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f4236ffd700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 secure :-1 s=READY pgs=4112 cs=0 l=1 rev1=1 rx=0x7f4228004f60 tx=0x7f4228009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:22.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4228018070 con 0x7f42380f9830 2022-02-02T22:50:22.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4228007c70 con 0x7f42380f9830 2022-02-02T22:50:22.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238108460 con 0x7f42380f9830 2022-02-02T22:50:22.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f422801c620 con 0x7f42380f9830 2022-02-02T22:50:22.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.218+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42381089c0 con 0x7f42380f9830 2022-02-02T22:50:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.219+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4238045ad0 con 0x7f42380f9830 2022-02-02T22:50:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.220+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f422801d420 con 0x7f42380f9830 2022-02-02T22:50:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.220+0000 7f422ffff700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 0x7f4224067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.220+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4228083960 con 0x7f42380f9830 2022-02-02T22:50:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.220+0000 7f42377fe700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 0x7f4224067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.220+0000 7f42377fe700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 0x7f4224067290 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7f42200041d0 tx=0x7f4220009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:22.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.224+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4228055490 con 0x7f42380f9830 2022-02-02T22:50:22.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.424+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4238027a00 con 0x7f42380f9830 2022-02-02T22:50:22.426 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.425+0000 7f422ffff700 1 -- 172.21.15.96:0/4053548614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4228055080 con 0x7f42380f9830 2022-02-02T22:50:22.427 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:50:22.427 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:50:22.428 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:50:22.428 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:50:22.429 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:22.429 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:50:22.429 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:50:22.430 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:50:22.430 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:50:22.430 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:50:22.431 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:50:22.431 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:50:22.431 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:50:22.432 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:50:22.432 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:50:22.433 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:50:22.433 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:50:22.434 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:50:22.434 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:50:22.434 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:50:22.435 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:50:22.435 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:50:22.435 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:50:22.436 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:50:22.436 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:50:22.436 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:50:22.437 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:50:22.437 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:50:22.437 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:50:22.438 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:50:22.438 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:50:22.439 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:50:22.439 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:22.439 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:22.440 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:50:22.440 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:22.440 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:22.441 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:22.441 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:22.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 msgr2=0x7f4224067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 0x7f4224067290 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7f42200041d0 tx=0x7f4220009040).stop 2022-02-02T22:50:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 msgr2=0x7f4238107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:22.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 secure :-1 s=READY pgs=4112 cs=0 l=1 rev1=1 rx=0x7f4228004f60 tx=0x7f4228009b30).stop 2022-02-02T22:50:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 shutdown_connections 2022-02-02T22:50:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4224064dd0 0x7f4224067290 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4238060270 0x7f4238106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 --2- 172.21.15.96:0/4053548614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42380f9830 0x7f4238107430 unknown :-1 s=CLOSED pgs=4112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 >> 172.21.15.96:0/4053548614 conn(0x7f42380f0d40 msgr2=0x7f42380f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 shutdown_connections 2022-02-02T22:50:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:22.427+0000 7f423dce8700 1 -- 172.21.15.96:0/4053548614 wait complete. 2022-02-02T22:50:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:50:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:23 smithi159 ceph-mon[69013]: from='client.42338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:23 smithi159 ceph-mon[69013]: pgmap v8047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:23 smithi159 ceph-mon[69013]: from='client.42342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4250996980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:50:23.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4053548614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:50:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:23 smithi096 ceph-mon[101353]: from='client.42338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:23 smithi096 ceph-mon[101353]: pgmap v8047: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:23 smithi096 ceph-mon[101353]: from='client.42342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4250996980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:50:23.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4053548614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:50:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:25 smithi159 ceph-mon[69013]: pgmap v8048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:25 smithi096 ceph-mon[101353]: pgmap v8048: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:27 smithi159 ceph-mon[69013]: pgmap v8049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:27.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:27 smithi096 ceph-mon[101353]: pgmap v8049: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:50:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:50:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:50:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:50:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:29 smithi159 ceph-mon[69013]: pgmap v8050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:29.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:29 smithi096 ceph-mon[101353]: pgmap v8050: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:31 smithi159 ceph-mon[69013]: pgmap v8051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:31 smithi096 ceph-mon[101353]: pgmap v8051: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:33.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:33 smithi159 ceph-mon[69013]: pgmap v8052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:33 smithi096 ceph-mon[101353]: pgmap v8052: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:35 smithi159 ceph-mon[69013]: pgmap v8053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:35 smithi096 ceph-mon[101353]: pgmap v8053: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:37 smithi159 ceph-mon[69013]: pgmap v8054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:37 smithi096 ceph-mon[101353]: pgmap v8054: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:39.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:39 smithi159 ceph-mon[69013]: pgmap v8055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:39.613 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:39 smithi096 ceph-mon[101353]: pgmap v8055: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:41 smithi159 ceph-mon[69013]: pgmap v8056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:41 smithi096 ceph-mon[101353]: pgmap v8056: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:43.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:43 smithi159 ceph-mon[69013]: pgmap v8057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:43 smithi096 ceph-mon[101353]: pgmap v8057: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:45 smithi159 ceph-mon[69013]: pgmap v8058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:45 smithi096 ceph-mon[101353]: pgmap v8058: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:47 smithi159 ceph-mon[69013]: pgmap v8059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:47.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:47 smithi096 ceph-mon[101353]: pgmap v8059: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:49 smithi159 ceph-mon[69013]: pgmap v8060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:49.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:49 smithi096 ceph-mon[101353]: pgmap v8060: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:51 smithi159 ceph-mon[69013]: pgmap v8061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:51 smithi096 ceph-mon[101353]: pgmap v8061: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:52.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 -- 172.21.15.96:0/3023663806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480602b0 msgr2=0x7f74480f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 --2- 172.21.15.96:0/3023663806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480602b0 0x7f74480f9170 secure :-1 s=READY pgs=4113 cs=0 l=1 rev1=1 rx=0x7f743c004660 tx=0x7f743c009b30).stop 2022-02-02T22:50:52.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 -- 172.21.15.96:0/3023663806 shutdown_connections 2022-02-02T22:50:52.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 --2- 172.21.15.96:0/3023663806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480f96f0 0x7f74480fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:50:52.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 --2- 172.21.15.96:0/3023663806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480602b0 0x7f74480f9170 unknown :-1 s=CLOSED pgs=4113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 -- 172.21.15.96:0/3023663806 >> 172.21.15.96:0/3023663806 conn(0x7f74480f0b90 msgr2=0x7f74480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:52.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 -- 172.21.15.96:0/3023663806 shutdown_connections 2022-02-02T22:50:52.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.539+0000 7f744cb7d700 1 -- 172.21.15.96:0/3023663806 wait complete. 2022-02-02T22:50:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 Processor -- start 2022-02-02T22:50:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 -- start start 2022-02-02T22:50:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480602b0 0x7f7448106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448107930 con 0x7f74480f96f0 2022-02-02T22:50:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f744cb7d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481080e0 con 0x7f74480602b0 2022-02-02T22:50:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.540+0000 7f7446ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50714/0 (socket says 172.21.15.96:50714) 2022-02-02T22:50:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 -- 172.21.15.96:0/113501355 learned_addr learned my addr 172.21.15.96:0/113501355 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f74477fe700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480602b0 0x7f7448106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 -- 172.21.15.96:0/113501355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480602b0 msgr2=0x7f7448106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480602b0 0x7f7448106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 -- 172.21.15.96:0/113501355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c005040 con 0x7f74480f96f0 2022-02-02T22:50:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f7446ffd700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 secure :-1 s=READY pgs=4114 cs=0 l=1 rev1=1 rx=0x7f74380093f0 tx=0x7f7438006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7438009ea0 con 0x7f74480f96f0 2022-02-02T22:50:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74481083c0 con 0x7f74480f96f0 2022-02-02T22:50:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7438013af0 con 0x7f74480f96f0 2022-02-02T22:50:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743800db10 con 0x7f74480f96f0 2022-02-02T22:50:52.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.541+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448108980 con 0x7f74480f96f0 2022-02-02T22:50:52.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.542+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7448059100 con 0x7f74480f96f0 2022-02-02T22:50:52.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.543+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f743801a060 con 0x7f74480f96f0 2022-02-02T22:50:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.543+0000 7f742ffff700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 0x7f74300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.543+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7438081b60 con 0x7f74480f96f0 2022-02-02T22:50:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.543+0000 7f74477fe700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 0x7f74300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.544+0000 7f74477fe700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 0x7f74300672e0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 rx=0x7f743c004e30 tx=0x7f743c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.548+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f743804fba0 con 0x7f74480f96f0 2022-02-02T22:50:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.726+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74480feea0 con 0x7f7430064e20 2022-02-02T22:50:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.727+0000 7f742ffff700 1 -- 172.21.15.96:0/113501355 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f74480feea0 con 0x7f7430064e20 2022-02-02T22:50:52.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.728+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 msgr2=0x7f74300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.728+0000 7f744cb7d700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 0x7f74300672e0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 rx=0x7f743c004e30 tx=0x7f743c009b30).stop 2022-02-02T22:50:52.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.728+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 msgr2=0x7f74481072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.728+0000 7f744cb7d700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 secure :-1 s=READY pgs=4114 cs=0 l=1 rev1=1 rx=0x7f74380093f0 tx=0x7f7438006ec0).stop 2022-02-02T22:50:52.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 shutdown_connections 2022-02-02T22:50:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7430064e20 0x7f74300672e0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74480602b0 0x7f7448106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 --2- 172.21.15.96:0/113501355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74480f96f0 0x7f74481072a0 unknown :-1 s=CLOSED pgs=4114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 >> 172.21.15.96:0/113501355 conn(0x7f74480f0b90 msgr2=0x7f74480f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 shutdown_connections 2022-02-02T22:50:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.729+0000 7f744cb7d700 1 -- 172.21.15.96:0/113501355 wait complete. 2022-02-02T22:50:52.738 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:50:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- 172.21.15.96:0/1643800747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f68e0 msgr2=0x7ff9e80f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1643800747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f68e0 0x7ff9e80f6d00 secure :-1 s=READY pgs=4115 cs=0 l=1 rev1=1 rx=0x7ff9d8004660 tx=0x7ff9d8009b30).stop 2022-02-02T22:50:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- 172.21.15.96:0/1643800747 shutdown_connections 2022-02-02T22:50:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1643800747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f7b80 0x7ff9e80f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1643800747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f68e0 0x7ff9e80f6d00 unknown :-1 s=CLOSED pgs=4115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- 172.21.15.96:0/1643800747 >> 172.21.15.96:0/1643800747 conn(0x7ff9e80f2020 msgr2=0x7ff9e80f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- 172.21.15.96:0/1643800747 shutdown_connections 2022-02-02T22:50:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- 172.21.15.96:0/1643800747 wait complete. 2022-02-02T22:50:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 Processor -- start 2022-02-02T22:50:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.828+0000 7ff9f045e700 1 -- start start 2022-02-02T22:50:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f68e0 0x7ff9e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e806a380 con 0x7ff9e80f7b80 2022-02-02T22:50:52.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e806a4c0 con 0x7ff9e80f68e0 2022-02-02T22:50:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50722/0 (socket says 172.21.15.96:50722) 2022-02-02T22:50:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 -- 172.21.15.96:0/1811921193 learned_addr learned my addr 172.21.15.96:0/1811921193 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:52.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ee1fa700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f68e0 0x7ff9e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 -- 172.21.15.96:0/1811921193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f68e0 msgr2=0x7ff9e806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:52.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f68e0 0x7ff9e806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 -- 172.21.15.96:0/1811921193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8005040 con 0x7ff9e80f7b80 2022-02-02T22:50:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9ed9f9700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 secure :-1 s=READY pgs=4116 cs=0 l=1 rev1=1 rx=0x7ff9e40026d0 tx=0x7ff9e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e4009320 con 0x7ff9e80f7b80 2022-02-02T22:50:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9e400f040 con 0x7ff9e80f7b80 2022-02-02T22:50:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e806a7a0 con 0x7ff9e80f7b80 2022-02-02T22:50:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e40147e0 con 0x7ff9e80f7b80 2022-02-02T22:50:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.829+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e810f210 con 0x7ff9e80f7b80 2022-02-02T22:50:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.830+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0004fa0 con 0x7ff9e80f7b80 2022-02-02T22:50:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.831+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9e4009480 con 0x7ff9e80f7b80 2022-02-02T22:50:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.831+0000 7ff9deffd700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 0x7ff9d4067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:52.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.831+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff9e4082060 con 0x7ff9e80f7b80 2022-02-02T22:50:52.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.831+0000 7ff9ee1fa700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 0x7ff9d4067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:52.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.832+0000 7ff9ee1fa700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 0x7ff9d4067350 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 rx=0x7ff9d8004e30 tx=0x7ff9d8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:52.835+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9e40500a0 con 0x7ff9e80f7b80 2022-02-02T22:50:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.006+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d0000bc0 con 0x7ff9d4064e90 2022-02-02T22:50:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.015+0000 7ff9deffd700 1 -- 172.21.15.96:0/1811921193 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff9d0000bc0 con 0x7ff9d4064e90 2022-02-02T22:50:53.016 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:50:53.016 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:50:53.017 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:50:53.017 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:50:53.018 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:50:53.018 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:50:53.018 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:50:53.019 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:50:53.020 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:50:53.020 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:50:53.021 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:50:53.021 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:50:53.022 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:50:53.022 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:50:53.023 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:50:53.023 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:50:53.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:50:53.024 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:50:53.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:50:53.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:50:53.025 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:50:53.026 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:50:53.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 msgr2=0x7ff9d4067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 0x7ff9d4067350 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 rx=0x7ff9d8004e30 tx=0x7ff9d8009b30).stop 2022-02-02T22:50:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 msgr2=0x7ff9e8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 secure :-1 s=READY pgs=4116 cs=0 l=1 rev1=1 rx=0x7ff9e40026d0 tx=0x7ff9e4009de0).stop 2022-02-02T22:50:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 shutdown_connections 2022-02-02T22:50:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9d4064e90 0x7ff9d4067350 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9e80f68e0 0x7ff9e806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 --2- 172.21.15.96:0/1811921193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e80f7b80 0x7ff9e8069e20 unknown :-1 s=CLOSED pgs=4116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 >> 172.21.15.96:0/1811921193 conn(0x7ff9e80f2020 msgr2=0x7ff9e80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:53.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 shutdown_connections 2022-02-02T22:50:53.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.017+0000 7ff9f045e700 1 -- 172.21.15.96:0/1811921193 wait complete. 2022-02-02T22:50:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 -- 172.21.15.96:0/2020156167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 msgr2=0x7f27780f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 --2- 172.21.15.96:0/2020156167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27780f6b30 secure :-1 s=READY pgs=4117 cs=0 l=1 rev1=1 rx=0x7f2768004660 tx=0x7f2768009b30).stop 2022-02-02T22:50:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 -- 172.21.15.96:0/2020156167 shutdown_connections 2022-02-02T22:50:53.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 --2- 172.21.15.96:0/2020156167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27780f6b30 unknown :-1 s=CLOSED pgs=4117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 --2- 172.21.15.96:0/2020156167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 0x7f27780f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.113+0000 7f277ca83700 1 -- 172.21.15.96:0/2020156167 >> 172.21.15.96:0/2020156167 conn(0x7f27780f0b90 msgr2=0x7f27780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.114+0000 7f277ca83700 1 -- 172.21.15.96:0/2020156167 shutdown_connections 2022-02-02T22:50:53.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.114+0000 7f277ca83700 1 -- 172.21.15.96:0/2020156167 wait complete. 2022-02-02T22:50:53.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.114+0000 7f277ca83700 1 Processor -- start 2022-02-02T22:50:53.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.114+0000 7f277ca83700 1 -- start start 2022-02-02T22:50:53.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f277ca83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 0x7f2778105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f277ca83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f277ca83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778106760 con 0x7f27780f66d0 2022-02-02T22:50:53.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f277ca83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778106f60 con 0x7f27780f5430 2022-02-02T22:50:53.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50732/0 (socket says 172.21.15.96:50732) 2022-02-02T22:50:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 -- 172.21.15.96:0/4116052749 learned_addr learned my addr 172.21.15.96:0/4116052749 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f27777fe700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 0x7f2778105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 -- 172.21.15.96:0/4116052749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 msgr2=0x7f2778105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 0x7f2778105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 -- 172.21.15.96:0/4116052749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768005040 con 0x7f27780f66d0 2022-02-02T22:50:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f2776ffd700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 secure :-1 s=READY pgs=4118 cs=0 l=1 rev1=1 rx=0x7f2768009990 tx=0x7f2768009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2768018070 con 0x7f27780f66d0 2022-02-02T22:50:53.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27781071e0 con 0x7f27780f66d0 2022-02-02T22:50:53.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2768007ca0 con 0x7f27780f66d0 2022-02-02T22:50:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.115+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276801c620 con 0x7f27780f66d0 2022-02-02T22:50:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.116+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2778107740 con 0x7f27780f66d0 2022-02-02T22:50:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.116+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778045ad0 con 0x7f27780f66d0 2022-02-02T22:50:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.117+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f276801d960 con 0x7f27780f66d0 2022-02-02T22:50:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.117+0000 7f275ffff700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 0x7f27600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.117+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f27680837e0 con 0x7f27780f66d0 2022-02-02T22:50:53.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.117+0000 7f27777fe700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 0x7f27600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.118+0000 7f27777fe700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 0x7f27600672e0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 rx=0x7f27780f6530 tx=0x7f276c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.122+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27680553d0 con 0x7f27780f66d0 2022-02-02T22:50:53.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.355+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27780ff600 con 0x7f27780f66d0 2022-02-02T22:50:53.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.356+0000 7f275ffff700 1 -- 172.21.15.96:0/4116052749 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2768054fc0 con 0x7f27780f66d0 2022-02-02T22:50:53.357 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:50:53.358 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:50:53.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:50:53.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:53.360 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:50:53.360 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:50:53.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:53.361 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:50:53.361 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:50:53.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:53.362 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:50:53.363 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:50:53.363 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:50:53.363 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:50:53.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:50:53.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:50:53.365 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:50:53.366 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:50:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 msgr2=0x7f27600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 0x7f27600672e0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 rx=0x7f27780f6530 tx=0x7f276c009040).stop 2022-02-02T22:50:53.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 msgr2=0x7f27781061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 secure :-1 s=READY pgs=4118 cs=0 l=1 rev1=1 rx=0x7f2768009990 tx=0x7f2768009b30).stop 2022-02-02T22:50:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 shutdown_connections 2022-02-02T22:50:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2760064e20 0x7f27600672e0 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27780f5430 0x7f2778105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 --2- 172.21.15.96:0/4116052749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27780f66d0 0x7f27781061b0 unknown :-1 s=CLOSED pgs=4118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 >> 172.21.15.96:0/4116052749 conn(0x7f27780f0b90 msgr2=0x7f27780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 shutdown_connections 2022-02-02T22:50:53.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.358+0000 7f277ca83700 1 -- 172.21.15.96:0/4116052749 wait complete. 2022-02-02T22:50:53.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 -- 172.21.15.96:0/2405575474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f66e0 msgr2=0x7fba140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 --2- 172.21.15.96:0/2405575474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f66e0 0x7fba140f6b00 secure :-1 s=READY pgs=4119 cs=0 l=1 rev1=1 rx=0x7fba04004660 tx=0x7fba04009b30).stop 2022-02-02T22:50:53.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 -- 172.21.15.96:0/2405575474 shutdown_connections 2022-02-02T22:50:53.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 --2- 172.21.15.96:0/2405575474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f7980 0x7fba140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:50:53.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 --2- 172.21.15.96:0/2405575474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f66e0 0x7fba140f6b00 unknown :-1 s=CLOSED pgs=4119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 -- 172.21.15.96:0/2405575474 >> 172.21.15.96:0/2405575474 conn(0x7fba140f1e40 msgr2=0x7fba140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:53.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 -- 172.21.15.96:0/2405575474 shutdown_connections 2022-02-02T22:50:53.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.455+0000 7fba1a521700 1 -- 172.21.15.96:0/2405575474 wait complete. 2022-02-02T22:50:53.459 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:53 smithi096 ceph-mon[101353]: pgmap v8062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:53.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 Processor -- start 2022-02-02T22:50:53.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 -- start start 2022-02-02T22:50:53.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f66e0 0x7fba1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406a410 con 0x7fba140f7980 2022-02-02T22:50:53.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba1a521700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406a550 con 0x7fba140f66e0 2022-02-02T22:50:53.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50740/0 (socket says 172.21.15.96:50740) 2022-02-02T22:50:53.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 -- 172.21.15.96:0/3403824144 learned_addr learned my addr 172.21.15.96:0/3403824144 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:50:53.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba13fff700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f66e0 0x7fba1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 -- 172.21.15.96:0/3403824144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f66e0 msgr2=0x7fba1406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f66e0 0x7fba1406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.456+0000 7fba137fe700 1 -- 172.21.15.96:0/3403824144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04005040 con 0x7fba140f7980 2022-02-02T22:50:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba137fe700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 secure :-1 s=READY pgs=4120 cs=0 l=1 rev1=1 rx=0x7fb9fc00b410 tx=0x7fb9fc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:53.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9fc0125f0 con 0x7fba140f7980 2022-02-02T22:50:53.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9fc00be30 con 0x7fba140f7980 2022-02-02T22:50:53.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1406a830 con 0x7fba140f7980 2022-02-02T22:50:53.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9fc002a70 con 0x7fba140f7980 2022-02-02T22:50:53.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.457+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1410efe0 con 0x7fba140f7980 2022-02-02T22:50:53.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.458+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14045ad0 con 0x7fba140f7980 2022-02-02T22:50:53.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.458+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb9fc00f030 con 0x7fba140f7980 2022-02-02T22:50:53.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.459+0000 7fba10ff9700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 0x7fba00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:50:53.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.459+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb9fc081dc0 con 0x7fba140f7980 2022-02-02T22:50:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.459+0000 7fba13fff700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 0x7fba00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:50:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.459+0000 7fba13fff700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 0x7fba00067290 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 rx=0x7fba04013690 tx=0x7fba04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:50:53.481 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:53 smithi159 ceph-mon[69013]: pgmap v8062: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.463+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb9fc04fec0 con 0x7fba140f7980 2022-02-02T22:50:53.665 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.665+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba14027a00 con 0x7fba140f7980 2022-02-02T22:50:53.666 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.665+0000 7fba10ff9700 1 -- 172.21.15.96:0/3403824144 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fb9fc0534e0 con 0x7fba140f7980 2022-02-02T22:50:53.667 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:50:53.667 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:50:53.667 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:50:53.668 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:50:53.668 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:53.668 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:50:53.669 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:50:53.669 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:50:53.670 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:50:53.670 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:50:53.671 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:50:53.671 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:50:53.672 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:50:53.672 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:50:53.672 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:50:53.672 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:50:53.673 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:50:53.673 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:50:53.673 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:50:53.674 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:50:53.674 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:50:53.674 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:50:53.675 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:50:53.675 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:50:53.675 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:50:53.676 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:50:53.676 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:50:53.676 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:50:53.677 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:50:53.677 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:50:53.677 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:50:53.678 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:50:53.678 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:53.678 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:53.679 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:50:53.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:50:53.679 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:53.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:53.680 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:50:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 msgr2=0x7fba00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 0x7fba00067290 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 rx=0x7fba04013690 tx=0x7fba04009b30).stop 2022-02-02T22:50:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 msgr2=0x7fba14069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:50:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 secure :-1 s=READY pgs=4120 cs=0 l=1 rev1=1 rx=0x7fb9fc00b410 tx=0x7fb9fc006ef0).stop 2022-02-02T22:50:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 shutdown_connections 2022-02-02T22:50:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fba00064dd0 0x7fba00067290 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba140f66e0 0x7fba1406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 --2- 172.21.15.96:0/3403824144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba140f7980 0x7fba14069e20 unknown :-1 s=CLOSED pgs=4120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:50:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 >> 172.21.15.96:0/3403824144 conn(0x7fba140f1e40 msgr2=0x7fba140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:50:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 shutdown_connections 2022-02-02T22:50:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:50:53.667+0000 7fba1a521700 1 -- 172.21.15.96:0/3403824144 wait complete. 2022-02-02T22:50:53.685 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:50:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:54 smithi159 ceph-mon[69013]: from='client.42354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:54.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:54 smithi159 ceph-mon[69013]: from='client.42358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4116052749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:50:54.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:54 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3403824144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:50:54.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:54 smithi096 ceph-mon[101353]: from='client.42354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:54 smithi096 ceph-mon[101353]: from='client.42358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:50:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4116052749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:50:54.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:54 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3403824144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:50:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:55 smithi159 ceph-mon[69013]: pgmap v8063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:55 smithi096 ceph-mon[101353]: pgmap v8063: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:57 smithi159 ceph-mon[69013]: pgmap v8064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:57 smithi096 ceph-mon[101353]: pgmap v8064: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:50:59 smithi159 ceph-mon[69013]: pgmap v8065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:50:59.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:50:59 smithi096 ceph-mon[101353]: pgmap v8065: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:00 smithi159 ceph-mon[69013]: pgmap v8066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:00 smithi096 ceph-mon[101353]: pgmap v8066: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:02 smithi159 ceph-mon[69013]: pgmap v8067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:02 smithi096 ceph-mon[101353]: pgmap v8067: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:04 smithi159 ceph-mon[69013]: pgmap v8068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:04 smithi096 ceph-mon[101353]: pgmap v8068: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:06 smithi159 ceph-mon[69013]: pgmap v8069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:06 smithi096 ceph-mon[101353]: pgmap v8069: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:08 smithi159 ceph-mon[69013]: pgmap v8070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:08 smithi096 ceph-mon[101353]: pgmap v8070: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:10 smithi159 ceph-mon[69013]: pgmap v8071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:10 smithi096 ceph-mon[101353]: pgmap v8071: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:12 smithi159 ceph-mon[69013]: pgmap v8072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:12 smithi096 ceph-mon[101353]: pgmap v8072: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:14 smithi159 ceph-mon[69013]: pgmap v8073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:14 smithi096 ceph-mon[101353]: pgmap v8073: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:16 smithi159 ceph-mon[69013]: pgmap v8074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:16 smithi096 ceph-mon[101353]: pgmap v8074: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:19.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:18 smithi159 ceph-mon[69013]: pgmap v8075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:18 smithi096 ceph-mon[101353]: pgmap v8075: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:21.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:20 smithi159 ceph-mon[69013]: pgmap v8076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:20 smithi096 ceph-mon[101353]: pgmap v8076: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:23.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:22 smithi159 ceph-mon[69013]: pgmap v8077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:23.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:22 smithi096 ceph-mon[101353]: pgmap v8077: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 -- 172.21.15.96:0/2081062322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f55c0 msgr2=0x7f34080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 --2- 172.21.15.96:0/2081062322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f55c0 0x7f34080f59e0 secure :-1 s=READY pgs=4121 cs=0 l=1 rev1=1 rx=0x7f33f0004660 tx=0x7f33f0009b30).stop 2022-02-02T22:51:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 -- 172.21.15.96:0/2081062322 shutdown_connections 2022-02-02T22:51:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 --2- 172.21.15.96:0/2081062322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f6860 0x7f34080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 --2- 172.21.15.96:0/2081062322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f55c0 0x7f34080f59e0 unknown :-1 s=CLOSED pgs=4121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 -- 172.21.15.96:0/2081062322 >> 172.21.15.96:0/2081062322 conn(0x7f34080f0d40 msgr2=0x7f34080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 -- 172.21.15.96:0/2081062322 shutdown_connections 2022-02-02T22:51:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.777+0000 7f340e504700 1 -- 172.21.15.96:0/2081062322 wait complete. 2022-02-02T22:51:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 Processor -- start 2022-02-02T22:51:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 -- start start 2022-02-02T22:51:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f55c0 0x7f3408105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408106910 con 0x7f34080f6860 2022-02-02T22:51:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f340e504700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408106a50 con 0x7f34080f55c0 2022-02-02T22:51:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f34077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f34077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50758/0 (socket says 172.21.15.96:50758) 2022-02-02T22:51:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f34077fe700 1 -- 172.21.15.96:0/1646477356 learned_addr learned my addr 172.21.15.96:0/1646477356 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.778+0000 7f3407fff700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f55c0 0x7f3408105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f34077fe700 1 -- 172.21.15.96:0/1646477356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f55c0 msgr2=0x7f3408105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f34077fe700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f55c0 0x7f3408105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f34077fe700 1 -- 172.21.15.96:0/1646477356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0005040 con 0x7f34080f6860 2022-02-02T22:51:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f34077fe700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 secure :-1 s=READY pgs=4122 cs=0 l=1 rev1=1 rx=0x7f33f800c530 tx=0x7f33f8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f800f650 con 0x7f34080f6860 2022-02-02T22:51:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34081073f0 con 0x7f34080f6860 2022-02-02T22:51:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33f800fc60 con 0x7f34080f6860 2022-02-02T22:51:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f8012c20 con 0x7f34080f6860 2022-02-02T22:51:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.779+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34081079b0 con 0x7f34080f6860 2022-02-02T22:51:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.780+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3408045ad0 con 0x7f34080f6860 2022-02-02T22:51:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.780+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f33f8010070 con 0x7f34080f6860 2022-02-02T22:51:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.781+0000 7f3404ff9700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 0x7f33f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.781+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f33f80816b0 con 0x7f34080f6860 2022-02-02T22:51:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.781+0000 7f3407fff700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 0x7f33f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.781+0000 7f3407fff700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 0x7f33f4067290 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 rx=0x7f33f0004630 tx=0x7f33f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.785+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f33f80531e0 con 0x7f34080f6860 2022-02-02T22:51:23.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.961+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3408107bd0 con 0x7f33f4064dd0 2022-02-02T22:51:23.962 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.963+0000 7f3404ff9700 1 -- 172.21.15.96:0/1646477356 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3408107bd0 con 0x7f33f4064dd0 2022-02-02T22:51:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.964+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 msgr2=0x7f33f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.964+0000 7f340e504700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 0x7f33f4067290 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 rx=0x7f33f0004630 tx=0x7f33f0009b30).stop 2022-02-02T22:51:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.964+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 msgr2=0x7f3408106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.964+0000 7f340e504700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 secure :-1 s=READY pgs=4122 cs=0 l=1 rev1=1 rx=0x7f33f800c530 tx=0x7f33f8007e20).stop 2022-02-02T22:51:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.964+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 shutdown_connections 2022-02-02T22:51:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f33f4064dd0 0x7f33f4067290 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34080f55c0 0x7f3408105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 --2- 172.21.15.96:0/1646477356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34080f6860 0x7f3408106360 unknown :-1 s=CLOSED pgs=4122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 >> 172.21.15.96:0/1646477356 conn(0x7f34080f0d40 msgr2=0x7f34080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:23.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 shutdown_connections 2022-02-02T22:51:23.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:23.965+0000 7f340e504700 1 -- 172.21.15.96:0/1646477356 wait complete. 2022-02-02T22:51:23.974 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:51:24.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- 172.21.15.96:0/1524159571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 msgr2=0x7fe9b00f7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 --2- 172.21.15.96:0/1524159571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b00f7d80 secure :-1 s=READY pgs=4123 cs=0 l=1 rev1=1 rx=0x7fe9a4004660 tx=0x7fe9a4009b30).stop 2022-02-02T22:51:24.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- 172.21.15.96:0/1524159571 shutdown_connections 2022-02-02T22:51:24.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 --2- 172.21.15.96:0/1524159571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b00f7d80 unknown :-1 s=CLOSED pgs=4123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 --2- 172.21.15.96:0/1524159571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 0x7fe9b00f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- 172.21.15.96:0/1524159571 >> 172.21.15.96:0/1524159571 conn(0x7fe9b00f1dc0 msgr2=0x7fe9b00f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- 172.21.15.96:0/1524159571 shutdown_connections 2022-02-02T22:51:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- 172.21.15.96:0/1524159571 wait complete. 2022-02-02T22:51:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 Processor -- start 2022-02-02T22:51:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.062+0000 7fe9b871e700 1 -- start start 2022-02-02T22:51:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b871e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 0x7fe9b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b871e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b871e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b006a380 con 0x7fe9b00f7920 2022-02-02T22:51:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b871e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b006a4c0 con 0x7fe9b00f6680 2022-02-02T22:51:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50768/0 (socket says 172.21.15.96:50768) 2022-02-02T22:51:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 -- 172.21.15.96:0/2552212793 learned_addr learned my addr 172.21.15.96:0/2552212793 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b64ba700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 0x7fe9b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 -- 172.21.15.96:0/2552212793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 msgr2=0x7fe9b006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 0x7fe9b006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 -- 172.21.15.96:0/2552212793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4005040 con 0x7fe9b00f7920 2022-02-02T22:51:24.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b5cb9700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 secure :-1 s=READY pgs=4124 cs=0 l=1 rev1=1 rx=0x7fe9a4009990 tx=0x7fe9a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a4018070 con 0x7fe9b00f7920 2022-02-02T22:51:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe9a4007ba0 con 0x7fe9b00f7920 2022-02-02T22:51:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b006a740 con 0x7fe9b00f7920 2022-02-02T22:51:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.063+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a401c3c0 con 0x7fe9b00f7920 2022-02-02T22:51:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.064+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b006aca0 con 0x7fe9b00f7920 2022-02-02T22:51:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.064+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0045ad0 con 0x7fe9b00f7920 2022-02-02T22:51:24.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.066+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe9a401d420 con 0x7fe9b00f7920 2022-02-02T22:51:24.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.066+0000 7fe9aeffd700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 0x7fe9980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.066+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe9a4083960 con 0x7fe9b00f7920 2022-02-02T22:51:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.066+0000 7fe9b64ba700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 0x7fe9980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.066+0000 7fe9b64ba700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 0x7fe9980672e0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 rx=0x7fe9b006b730 tx=0x7fe9a0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.069+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe9a4051a60 con 0x7fe9b00f7920 2022-02-02T22:51:24.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.243+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b00fefb0 con 0x7fe998064e20 2022-02-02T22:51:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.252+0000 7fe9aeffd700 1 -- 172.21.15.96:0/2552212793 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe9b00fefb0 con 0x7fe998064e20 2022-02-02T22:51:24.253 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:51:24.253 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:51:24.254 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:51:24.254 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:51:24.254 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:51:24.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:51:24.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:51:24.255 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:51:24.256 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:51:24.256 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:51:24.256 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:51:24.257 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:51:24.257 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:51:24.258 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:51:24.258 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:51:24.258 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:51:24.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:51:24.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:51:24.259 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:51:24.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:51:24.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:51:24.260 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:51:24.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 msgr2=0x7fe9980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 0x7fe9980672e0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 rx=0x7fe9b006b730 tx=0x7fe9a0009040).stop 2022-02-02T22:51:24.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 msgr2=0x7fe9b0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 secure :-1 s=READY pgs=4124 cs=0 l=1 rev1=1 rx=0x7fe9a4009990 tx=0x7fe9a4009b30).stop 2022-02-02T22:51:24.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 shutdown_connections 2022-02-02T22:51:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe998064e20 0x7fe9980672e0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9b00f6680 0x7fe9b006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 --2- 172.21.15.96:0/2552212793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9b00f7920 0x7fe9b0069e20 unknown :-1 s=CLOSED pgs=4124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 >> 172.21.15.96:0/2552212793 conn(0x7fe9b00f1dc0 msgr2=0x7fe9b00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 shutdown_connections 2022-02-02T22:51:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.254+0000 7fe9b871e700 1 -- 172.21.15.96:0/2552212793 wait complete. 2022-02-02T22:51:24.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- 172.21.15.96:0/2504234701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 msgr2=0x7fbbf00f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 --2- 172.21.15.96:0/2504234701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf00f6960 secure :-1 s=READY pgs=4125 cs=0 l=1 rev1=1 rx=0x7fbbe00099e0 tx=0x7fbbe0004d10).stop 2022-02-02T22:51:24.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- 172.21.15.96:0/2504234701 shutdown_connections 2022-02-02T22:51:24.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 --2- 172.21.15.96:0/2504234701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 0x7fbbf00f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 --2- 172.21.15.96:0/2504234701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf00f6960 unknown :-1 s=CLOSED pgs=4125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- 172.21.15.96:0/2504234701 >> 172.21.15.96:0/2504234701 conn(0x7fbbf00f1ca0 msgr2=0x7fbbf00f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- 172.21.15.96:0/2504234701 shutdown_connections 2022-02-02T22:51:24.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- 172.21.15.96:0/2504234701 wait complete. 2022-02-02T22:51:24.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 Processor -- start 2022-02-02T22:51:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.351+0000 7fbbf5658700 1 -- start start 2022-02-02T22:51:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbf5658700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbf5658700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 0x7fbbf01073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbf5658700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0107950 con 0x7fbbf00f6540 2022-02-02T22:51:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbf5658700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0107a90 con 0x7fbbf00f77e0 2022-02-02T22:51:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50776/0 (socket says 172.21.15.96:50776) 2022-02-02T22:51:24.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 -- 172.21.15.96:0/1647136849 learned_addr learned my addr 172.21.15.96:0/1647136849 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbee7fc700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 0x7fbbf01073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 -- 172.21.15.96:0/1647136849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 msgr2=0x7fbbf01073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 0x7fbbf01073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 -- 172.21.15.96:0/1647136849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0009640 con 0x7fbbf00f6540 2022-02-02T22:51:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbeeffd700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 secure :-1 s=READY pgs=4126 cs=0 l=1 rev1=1 rx=0x7fbbe000c010 tx=0x7fbbe0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe000e070 con 0x7fbbf00f6540 2022-02-02T22:51:24.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.352+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf01083d0 con 0x7fbbf00f6540 2022-02-02T22:51:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.353+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbe0007d10 con 0x7fbbf00f6540 2022-02-02T22:51:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.353+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf01088b0 con 0x7fbbf00f6540 2022-02-02T22:51:24.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.353+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe0018070 con 0x7fbbf00f6540 2022-02-02T22:51:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.353+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf0045ad0 con 0x7fbbf00f6540 2022-02-02T22:51:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.354+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbbe0024060 con 0x7fbbf00f6540 2022-02-02T22:51:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.355+0000 7fbbe77fe700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 0x7fbbdc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.355+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbbe0083230 con 0x7fbbf00f6540 2022-02-02T22:51:24.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.355+0000 7fbbee7fc700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 0x7fbbdc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.355+0000 7fbbee7fc700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 0x7fbbdc0672e0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 rx=0x7fbbd8004c40 tx=0x7fbbd800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.359+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbbe0054d60 con 0x7fbbf00f6540 2022-02-02T22:51:24.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.594+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbbf00feda0 con 0x7fbbf00f6540 2022-02-02T22:51:24.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.595+0000 7fbbe77fe700 1 -- 172.21.15.96:0/1647136849 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fbbe00222e0 con 0x7fbbf00f6540 2022-02-02T22:51:24.596 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:51:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:51:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:51:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:51:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:51:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:51:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:51:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:51:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:51:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:51:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:51:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:51:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:51:24.602 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:51:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.596+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 msgr2=0x7fbbdc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.596+0000 7fbbf5658700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 0x7fbbdc0672e0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 rx=0x7fbbd8004c40 tx=0x7fbbd800b040).stop 2022-02-02T22:51:24.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.596+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 msgr2=0x7fbbf0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.596+0000 7fbbf5658700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 secure :-1 s=READY pgs=4126 cs=0 l=1 rev1=1 rx=0x7fbbe000c010 tx=0x7fbbe0004d10).stop 2022-02-02T22:51:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 shutdown_connections 2022-02-02T22:51:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbbdc064e20 0x7fbbdc0672e0 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf00f6540 0x7fbbf0106eb0 unknown :-1 s=CLOSED pgs=4126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 --2- 172.21.15.96:0/1647136849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbf00f77e0 0x7fbbf01073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 >> 172.21.15.96:0/1647136849 conn(0x7fbbf00f1ca0 msgr2=0x7fbbf00fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 shutdown_connections 2022-02-02T22:51:24.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.597+0000 7fbbf5658700 1 -- 172.21.15.96:0/1647136849 wait complete. 2022-02-02T22:51:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 -- 172.21.15.96:0/2136546453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f66d0 msgr2=0x7f3d800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 --2- 172.21.15.96:0/2136546453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f66d0 0x7f3d800f6b30 secure :-1 s=READY pgs=4127 cs=0 l=1 rev1=1 rx=0x7f3d7c004660 tx=0x7f3d7c009b30).stop 2022-02-02T22:51:24.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 -- 172.21.15.96:0/2136546453 shutdown_connections 2022-02-02T22:51:24.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 --2- 172.21.15.96:0/2136546453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f66d0 0x7f3d800f6b30 unknown :-1 s=CLOSED pgs=4127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 --2- 172.21.15.96:0/2136546453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f5430 0x7f3d800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 -- 172.21.15.96:0/2136546453 >> 172.21.15.96:0/2136546453 conn(0x7f3d800f0b90 msgr2=0x7f3d800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 -- 172.21.15.96:0/2136546453 shutdown_connections 2022-02-02T22:51:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.695+0000 7f3d86d27700 1 -- 172.21.15.96:0/2136546453 wait complete. 2022-02-02T22:51:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 Processor -- start 2022-02-02T22:51:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 -- start start 2022-02-02T22:51:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 0x7f3d8010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800603e0 con 0x7f3d800f5430 2022-02-02T22:51:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d86d27700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80060520 con 0x7f3d800f66d0 2022-02-02T22:51:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50786/0 (socket says 172.21.15.96:50786) 2022-02-02T22:51:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 -- 172.21.15.96:0/3633675205 learned_addr learned my addr 172.21.15.96:0/3633675205 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85524700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 0x7f3d8010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 -- 172.21.15.96:0/3633675205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 msgr2=0x7f3d8010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 0x7f3d8010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85d25700 1 -- 172.21.15.96:0/3633675205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c005040 con 0x7f3d800f5430 2022-02-02T22:51:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.696+0000 7f3d85524700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 0x7f3d8010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:51:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d85d25700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 secure :-1 s=READY pgs=4128 cs=0 l=1 rev1=1 rx=0x7f3d7000c530 tx=0x7f3d70007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d7000f650 con 0x7f3d800f5430 2022-02-02T22:51:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d7000fc60 con 0x7f3d800f5430 2022-02-02T22:51:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8010c4d0 con 0x7f3d800f5430 2022-02-02T22:51:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d70012d20 con 0x7f3d800f5430 2022-02-02T22:51:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.697+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8010ca90 con 0x7f3d800f5430 2022-02-02T22:51:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.698+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80045ad0 con 0x7f3d800f5430 2022-02-02T22:51:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.698+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d70019030 con 0x7f3d800f5430 2022-02-02T22:51:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.699+0000 7f3d767fc700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 0x7f3d6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.699+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3d70081610 con 0x7f3d800f5430 2022-02-02T22:51:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.699+0000 7f3d85524700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 0x7f3d6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.699+0000 7f3d85524700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 0x7f3d6c0672e0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7f3d7c009da0 tx=0x7f3d7c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:24.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.703+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d7004f760 con 0x7f3d800f5430 2022-02-02T22:51:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.902+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3d8010c660 con 0x7f3d800f5430 2022-02-02T22:51:24.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.902+0000 7f3d767fc700 1 -- 172.21.15.96:0/3633675205 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3d8010c660 con 0x7f3d800f5430 2022-02-02T22:51:24.903 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:51:24.903 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:51:24.904 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:51:24.904 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:51:24.904 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:24.905 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:51:24.905 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:51:24.905 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:51:24.906 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:51:24.906 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:51:24.906 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:51:24.907 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:51:24.907 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:51:24.907 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:51:24.908 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:51:24.908 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:51:24.908 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:51:24.909 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:51:24.909 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:51:24.909 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:51:24.910 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:51:24.910 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:51:24.910 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:51:24.911 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:51:24.911 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:51:24.911 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:51:24.912 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:51:24.912 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:51:24.912 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:51:24.913 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:51:24.913 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:51:24.913 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:51:24.914 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:24.914 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:24.914 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:51:24.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:24.915 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:24.915 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:24.916 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 msgr2=0x7f3d6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 0x7f3d6c0672e0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7f3d7c009da0 tx=0x7f3d7c009b30).stop 2022-02-02T22:51:24.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 msgr2=0x7f3d80109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 secure :-1 s=READY pgs=4128 cs=0 l=1 rev1=1 rx=0x7f3d7000c530 tx=0x7f3d70007e10).stop 2022-02-02T22:51:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 shutdown_connections 2022-02-02T22:51:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d6c064e20 0x7f3d6c0672e0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d800f5430 0x7f3d80109a20 unknown :-1 s=CLOSED pgs=4128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 --2- 172.21.15.96:0/3633675205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d800f66d0 0x7f3d8010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 >> 172.21.15.96:0/3633675205 conn(0x7f3d800f0b90 msgr2=0x7f3d800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 shutdown_connections 2022-02-02T22:51:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:24.904+0000 7f3d86d27700 1 -- 172.21.15.96:0/3633675205 wait complete. 2022-02-02T22:51:24.920 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:51:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:24 smithi159 ceph-mon[69013]: pgmap v8078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:25.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:24 smithi159 ceph-mon[69013]: from='client.42370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:25.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:24 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1647136849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:51:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:24 smithi096 ceph-mon[101353]: pgmap v8078: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:24 smithi096 ceph-mon[101353]: from='client.42370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:25.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:24 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1647136849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:51:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:25 smithi159 ceph-mon[69013]: from='client.42374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:26.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:25 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3633675205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:51:26.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:25 smithi096 ceph-mon[101353]: from='client.42374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:26.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:25 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3633675205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:51:27.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:26 smithi159 ceph-mon[69013]: pgmap v8079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:26 smithi096 ceph-mon[101353]: pgmap v8079: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:28 smithi159 ceph-mon[69013]: pgmap v8080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:29.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:51:29.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:51:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:28 smithi096 ceph-mon[101353]: pgmap v8080: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:51:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:51:31.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:30 smithi159 ceph-mon[69013]: pgmap v8081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:30 smithi096 ceph-mon[101353]: pgmap v8081: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:32 smithi159 ceph-mon[69013]: pgmap v8082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:32 smithi096 ceph-mon[101353]: pgmap v8082: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:34 smithi159 ceph-mon[69013]: pgmap v8083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:34 smithi096 ceph-mon[101353]: pgmap v8083: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:36 smithi159 ceph-mon[69013]: pgmap v8084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:36 smithi096 ceph-mon[101353]: pgmap v8084: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:38 smithi159 ceph-mon[69013]: pgmap v8085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:38 smithi096 ceph-mon[101353]: pgmap v8085: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:40 smithi159 ceph-mon[69013]: pgmap v8086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:40 smithi096 ceph-mon[101353]: pgmap v8086: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:42 smithi159 ceph-mon[69013]: pgmap v8087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:42 smithi096 ceph-mon[101353]: pgmap v8087: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:44 smithi159 ceph-mon[69013]: pgmap v8088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:44 smithi096 ceph-mon[101353]: pgmap v8088: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:47.023 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:46 smithi159 ceph-mon[69013]: pgmap v8089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:46 smithi096 ceph-mon[101353]: pgmap v8089: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:48 smithi159 ceph-mon[69013]: pgmap v8090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:48 smithi096 ceph-mon[101353]: pgmap v8090: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:50 smithi159 ceph-mon[69013]: pgmap v8091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:50 smithi096 ceph-mon[101353]: pgmap v8091: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:52 smithi159 ceph-mon[69013]: pgmap v8092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:52 smithi096 ceph-mon[101353]: pgmap v8092: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:55.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 -- 172.21.15.96:0/2673680495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f6860 msgr2=0x7f0ea00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/2673680495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f6cc0 secure :-1 s=READY pgs=4129 cs=0 l=1 rev1=1 rx=0x7f0e90004660 tx=0x7f0e90009b30).stop 2022-02-02T22:51:55.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 -- 172.21.15.96:0/2673680495 shutdown_connections 2022-02-02T22:51:55.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/2673680495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f6cc0 unknown :-1 s=CLOSED pgs=4129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/2673680495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:51:55.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.015+0000 7f0ea4f71700 1 -- 172.21.15.96:0/2673680495 >> 172.21.15.96:0/2673680495 conn(0x7f0ea00f0d40 msgr2=0x7f0ea00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:54 smithi096 ceph-mon[101353]: pgmap v8093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:55.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 -- 172.21.15.96:0/2673680495 shutdown_connections 2022-02-02T22:51:55.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 -- 172.21.15.96:0/2673680495 wait complete. 2022-02-02T22:51:55.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 Processor -- start 2022-02-02T22:51:55.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 -- start start 2022-02-02T22:51:55.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00f8190 con 0x7f0ea00f55c0 2022-02-02T22:51:55.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.016+0000 7f0ea4f71700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00f82d0 con 0x7f0ea00f6860 2022-02-02T22:51:55.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50804/0 (socket says 172.21.15.96:50804) 2022-02-02T22:51:55.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 -- 172.21.15.96:0/628303072 learned_addr learned my addr 172.21.15.96:0/628303072 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:55.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9dd9b700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 -- 172.21.15.96:0/628303072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f6860 msgr2=0x7f0ea00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 -- 172.21.15.96:0/628303072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90005040 con 0x7f0ea00f55c0 2022-02-02T22:51:55.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e9e59c700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 secure :-1 s=READY pgs=4130 cs=0 l=1 rev1=1 rx=0x7f0e940093f0 tx=0x7f0e94006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e94013640 con 0x7f0ea00f55c0 2022-02-02T22:51:55.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea00f85b0 con 0x7f0ea00f55c0 2022-02-02T22:51:55.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.017+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea010efb0 con 0x7f0ea00f55c0 2022-02-02T22:51:55.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.018+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e94013c50 con 0x7f0ea00f55c0 2022-02-02T22:51:55.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.018+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e94012bb0 con 0x7f0ea00f55c0 2022-02-02T22:51:55.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.018+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84004fa0 con 0x7f0ea00f55c0 2022-02-02T22:51:55.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.019+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e9401a060 con 0x7f0ea00f55c0 2022-02-02T22:51:55.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.019+0000 7f0e8effd700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 0x7f0e88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.020+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e94081930 con 0x7f0ea00f55c0 2022-02-02T22:51:55.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.020+0000 7f0e9dd9b700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 0x7f0e88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.020+0000 7f0e9dd9b700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 0x7f0e88067290 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 rx=0x7f0e90004630 tx=0x7f0e90009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:54 smithi159 ceph-mon[69013]: pgmap v8093: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:55.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.024+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e9404fae0 con 0x7f0ea00f55c0 2022-02-02T22:51:55.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.203+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e84000bc0 con 0x7f0e88064dd0 2022-02-02T22:51:55.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.204+0000 7f0e8effd700 1 -- 172.21.15.96:0/628303072 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0e84000bc0 con 0x7f0e88064dd0 2022-02-02T22:51:55.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 msgr2=0x7f0e88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 0x7f0e88067290 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 rx=0x7f0e90004630 tx=0x7f0e90009b30).stop 2022-02-02T22:51:55.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 msgr2=0x7f0ea00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 secure :-1 s=READY pgs=4130 cs=0 l=1 rev1=1 rx=0x7f0e940093f0 tx=0x7f0e94006ec0).stop 2022-02-02T22:51:55.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 shutdown_connections 2022-02-02T22:51:55.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e88064dd0 0x7f0e88067290 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ea00f55c0 0x7f0ea00f9720 unknown :-1 s=CLOSED pgs=4130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 --2- 172.21.15.96:0/628303072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ea00f6860 0x7f0ea00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 >> 172.21.15.96:0/628303072 conn(0x7f0ea00f0d40 msgr2=0x7f0ea005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 shutdown_connections 2022-02-02T22:51:55.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.206+0000 7f0ea4f71700 1 -- 172.21.15.96:0/628303072 wait complete. 2022-02-02T22:51:55.215 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:51:55.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 -- 172.21.15.96:0/2661148068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 msgr2=0x7f79c80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 --2- 172.21.15.96:0/2661148068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c80f6b00 secure :-1 s=READY pgs=4131 cs=0 l=1 rev1=1 rx=0x7f79b8004660 tx=0x7f79b8009b30).stop 2022-02-02T22:51:55.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 -- 172.21.15.96:0/2661148068 shutdown_connections 2022-02-02T22:51:55.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 --2- 172.21.15.96:0/2661148068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 --2- 172.21.15.96:0/2661148068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c80f6b00 unknown :-1 s=CLOSED pgs=4131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.303+0000 7f79d04d8700 1 -- 172.21.15.96:0/2661148068 >> 172.21.15.96:0/2661148068 conn(0x7f79c80f1e40 msgr2=0x7f79c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 -- 172.21.15.96:0/2661148068 shutdown_connections 2022-02-02T22:51:55.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 -- 172.21.15.96:0/2661148068 wait complete. 2022-02-02T22:51:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 Processor -- start 2022-02-02T22:51:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 -- start start 2022-02-02T22:51:55.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c8107a50 con 0x7f79c80f66e0 2022-02-02T22:51:55.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.304+0000 7f79d04d8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c8107b90 con 0x7f79c80f7980 2022-02-02T22:51:55.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50814/0 (socket says 172.21.15.96:50814) 2022-02-02T22:51:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 -- 172.21.15.96:0/1661673402 learned_addr learned my addr 172.21.15.96:0/1661673402 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79cda73700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 -- 172.21.15.96:0/1661673402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 msgr2=0x7f79c81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c81074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 -- 172.21.15.96:0/1661673402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8005040 con 0x7f79c80f66e0 2022-02-02T22:51:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79cda73700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:51:55.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79ce274700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 secure :-1 s=READY pgs=4132 cs=0 l=1 rev1=1 rx=0x7f79b8004f60 tx=0x7f79b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b8018070 con 0x7f79c80f66e0 2022-02-02T22:51:55.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c81084d0 con 0x7f79c80f66e0 2022-02-02T22:51:55.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79b8007ba0 con 0x7f79c80f66e0 2022-02-02T22:51:55.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b801c620 con 0x7f79c80f66e0 2022-02-02T22:51:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.305+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c8108a30 con 0x7f79c80f66e0 2022-02-02T22:51:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.306+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c8045ad0 con 0x7f79c80f66e0 2022-02-02T22:51:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.307+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f79b801c8e0 con 0x7f79c80f66e0 2022-02-02T22:51:55.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.308+0000 7f79beffd700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 0x7f79b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.308+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f79b8083960 con 0x7f79c80f66e0 2022-02-02T22:51:55.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.308+0000 7f79cda73700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 0x7f79b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.308+0000 7f79cda73700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 0x7f79b4067290 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f79c40041d0 tx=0x7f79c4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.312+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79b8055490 con 0x7f79c80f66e0 2022-02-02T22:51:55.483 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.483+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c80ff020 con 0x7f79b4064dd0 2022-02-02T22:51:55.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.493+0000 7f79beffd700 1 -- 172.21.15.96:0/1661673402 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f79c80ff020 con 0x7f79b4064dd0 2022-02-02T22:51:55.493 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:51:55.493 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:51:55.494 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:51:55.494 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:51:55.494 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:51:55.495 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:51:55.495 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:51:55.495 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:51:55.496 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:51:55.496 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:51:55.496 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:51:55.497 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:51:55.497 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:51:55.497 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:51:55.498 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:51:55.498 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:51:55.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:51:55.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:51:55.499 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:51:55.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:51:55.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:51:55.500 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:51:55.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 msgr2=0x7f79b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 0x7f79b4067290 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f79c40041d0 tx=0x7f79c4009040).stop 2022-02-02T22:51:55.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 msgr2=0x7f79c8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 secure :-1 s=READY pgs=4132 cs=0 l=1 rev1=1 rx=0x7f79b8004f60 tx=0x7f79b8009b30).stop 2022-02-02T22:51:55.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 shutdown_connections 2022-02-02T22:51:55.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f79b4064dd0 0x7f79b4067290 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c80f66e0 0x7f79c8106fb0 unknown :-1 s=CLOSED pgs=4132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 --2- 172.21.15.96:0/1661673402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c80f7980 0x7f79c81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.494+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 >> 172.21.15.96:0/1661673402 conn(0x7f79c80f1e40 msgr2=0x7f79c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.495+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 shutdown_connections 2022-02-02T22:51:55.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.495+0000 7f79d04d8700 1 -- 172.21.15.96:0/1661673402 wait complete. 2022-02-02T22:51:55.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 -- 172.21.15.96:0/668061439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 msgr2=0x7fe26c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 --2- 172.21.15.96:0/668061439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c0f59e0 secure :-1 s=READY pgs=4133 cs=0 l=1 rev1=1 rx=0x7fe25c004660 tx=0x7fe25c009b30).stop 2022-02-02T22:51:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 -- 172.21.15.96:0/668061439 shutdown_connections 2022-02-02T22:51:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 --2- 172.21.15.96:0/668061439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 0x7fe26c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:51:55.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 --2- 172.21.15.96:0/668061439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c0f59e0 unknown :-1 s=CLOSED pgs=4133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 -- 172.21.15.96:0/668061439 >> 172.21.15.96:0/668061439 conn(0x7fe26c0f0d40 msgr2=0x7fe26c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 -- 172.21.15.96:0/668061439 shutdown_connections 2022-02-02T22:51:55.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 -- 172.21.15.96:0/668061439 wait complete. 2022-02-02T22:51:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.593+0000 7fe273e72700 1 Processor -- start 2022-02-02T22:51:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 -- start start 2022-02-02T22:51:55.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 0x7fe26c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0602b0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0603f0 con 0x7fe26c0f6860 2022-02-02T22:51:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50824/0 (socket says 172.21.15.96:50824) 2022-02-02T22:51:55.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 -- 172.21.15.96:0/656312493 learned_addr learned my addr 172.21.15.96:0/656312493 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe27140d700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 0x7fe26c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 -- 172.21.15.96:0/656312493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 msgr2=0x7fe26c10e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 0x7fe26c10e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 -- 172.21.15.96:0/656312493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c005040 con 0x7fe26c0f55c0 2022-02-02T22:51:55.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe271c0e700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 secure :-1 s=READY pgs=4134 cs=0 l=1 rev1=1 rx=0x7fe25c004f60 tx=0x7fe25c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c018070 con 0x7fe26c0f55c0 2022-02-02T22:51:55.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe25c007ba0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c10ead0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.594+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c01c620 con 0x7fe26c0f55c0 2022-02-02T22:51:55.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.595+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c10eef0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.595+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c045ad0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.596+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe25c01c8e0 con 0x7fe26c0f55c0 2022-02-02T22:51:55.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.596+0000 7fe2627fc700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.596+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe25c083960 con 0x7fe26c0f55c0 2022-02-02T22:51:55.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.596+0000 7fe27140d700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.597+0000 7fe27140d700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 0x7fe258067290 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 rx=0x7fe26800b790 tx=0x7fe268008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.600+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe25c051a60 con 0x7fe26c0f55c0 2022-02-02T22:51:55.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.829+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe26c027a00 con 0x7fe26c0f55c0 2022-02-02T22:51:55.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.830+0000 7fe2627fc700 1 -- 172.21.15.96:0/656312493 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fe25c055080 con 0x7fe26c0f55c0 2022-02-02T22:51:55.831 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:51:55.831 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:51:55.831 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:51:55.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:55.832 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:51:55.833 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:51:55.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:55.833 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:51:55.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:51:55.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:55.834 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:51:55.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:51:55.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:51:55.835 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:51:55.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:51:55.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:51:55.836 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:51:55.837 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:51:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 msgr2=0x7fe258067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 0x7fe258067290 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 rx=0x7fe26800b790 tx=0x7fe268008040).stop 2022-02-02T22:51:55.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 msgr2=0x7fe26c10c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 secure :-1 s=READY pgs=4134 cs=0 l=1 rev1=1 rx=0x7fe25c004f60 tx=0x7fe25c009b30).stop 2022-02-02T22:51:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 shutdown_connections 2022-02-02T22:51:55.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe26c0f55c0 0x7fe26c10c0e0 unknown :-1 s=CLOSED pgs=4134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 --2- 172.21.15.96:0/656312493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe26c0f6860 0x7fe26c10e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 >> 172.21.15.96:0/656312493 conn(0x7fe26c0f0d40 msgr2=0x7fe26c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 shutdown_connections 2022-02-02T22:51:55.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.832+0000 7fe273e72700 1 -- 172.21.15.96:0/656312493 wait complete. 2022-02-02T22:51:55.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 -- 172.21.15.96:0/615484495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f5430 msgr2=0x7fdc040f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 --2- 172.21.15.96:0/615484495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f5430 0x7fdc040f5850 secure :-1 s=READY pgs=4135 cs=0 l=1 rev1=1 rx=0x7fdbf4004660 tx=0x7fdbf4009b30).stop 2022-02-02T22:51:55.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 -- 172.21.15.96:0/615484495 shutdown_connections 2022-02-02T22:51:55.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 --2- 172.21.15.96:0/615484495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f66d0 0x7fdc040f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 --2- 172.21.15.96:0/615484495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f5430 0x7fdc040f5850 unknown :-1 s=CLOSED pgs=4135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.928+0000 7fdc0a370700 1 -- 172.21.15.96:0/615484495 >> 172.21.15.96:0/615484495 conn(0x7fdc040f0b90 msgr2=0x7fdc040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:55.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.929+0000 7fdc0a370700 1 -- 172.21.15.96:0/615484495 shutdown_connections 2022-02-02T22:51:55.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.929+0000 7fdc0a370700 1 -- 172.21.15.96:0/615484495 wait complete. 2022-02-02T22:51:55.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.929+0000 7fdc0a370700 1 Processor -- start 2022-02-02T22:51:55.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.929+0000 7fdc0a370700 1 -- start start 2022-02-02T22:51:55.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc0a370700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f5430 0x7fdc04109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc0a370700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc0a370700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040603e0 con 0x7fdc040f66d0 2022-02-02T22:51:55.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc0a370700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04060520 con 0x7fdc040f5430 2022-02-02T22:51:55.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50836/0 (socket says 172.21.15.96:50836) 2022-02-02T22:51:55.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 -- 172.21.15.96:0/1372911365 learned_addr learned my addr 172.21.15.96:0/1372911365 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:51:55.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc0936e700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f5430 0x7fdc04109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 -- 172.21.15.96:0/1372911365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f5430 msgr2=0x7fdc04109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:55.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f5430 0x7fdc04109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:55.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 -- 172.21.15.96:0/1372911365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4005040 con 0x7fdc040f66d0 2022-02-02T22:51:55.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.930+0000 7fdc08b6d700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 secure :-1 s=READY pgs=4136 cs=0 l=1 rev1=1 rx=0x7fdc000026d0 tx=0x7fdc00009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.931+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc000079c0 con 0x7fdc040f66d0 2022-02-02T22:51:55.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.931+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc0000f040 con 0x7fdc040f66d0 2022-02-02T22:51:55.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.931+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0410c540 con 0x7fdc040f66d0 2022-02-02T22:51:55.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.931+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc000148b0 con 0x7fdc040f66d0 2022-02-02T22:51:55.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.931+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0410cb00 con 0x7fdc040f66d0 2022-02-02T22:51:55.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.932+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04045ad0 con 0x7fdc040f66d0 2022-02-02T22:51:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.932+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdc00007b20 con 0x7fdc040f66d0 2022-02-02T22:51:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.932+0000 7fdbf9ffb700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 0x7fdbf00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:51:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.933+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdc000819e0 con 0x7fdc040f66d0 2022-02-02T22:51:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.933+0000 7fdc0936e700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 0x7fdbf00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:51:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.933+0000 7fdc0936e700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 0x7fdbf00672e0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7fdbf4013690 tx=0x7fdbf4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:51:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:55.937+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdc0004fae0 con 0x7fdc040f66d0 2022-02-02T22:51:56.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.139+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc04027a00 con 0x7fdc040f66d0 2022-02-02T22:51:56.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.139+0000 7fdbf9ffb700 1 -- 172.21.15.96:0/1372911365 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdc00053100 con 0x7fdc040f66d0 2022-02-02T22:51:56.140 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:51:56.140 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:51:56.141 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:51:56.141 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:51:56.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:56.142 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:51:56.142 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:51:56.142 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:51:56.143 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:51:56.143 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:51:56.143 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:51:56.144 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:51:56.144 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:51:56.144 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:51:56.145 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:51:56.145 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:51:56.145 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:51:56.146 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:51:56.146 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:51:56.146 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:51:56.147 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:51:56.147 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:51:56.147 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:51:56.148 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:51:56.148 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:51:56.148 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:51:56.149 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:51:56.149 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:51:56.149 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:51:56.150 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:51:56.150 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:51:56.151 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:51:56.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:56.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:56.152 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:51:56.152 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:51:56.152 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:56.153 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:56.153 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:51:56.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 msgr2=0x7fdbf00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 0x7fdbf00672e0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7fdbf4013690 tx=0x7fdbf4009b30).stop 2022-02-02T22:51:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 msgr2=0x7fdc0410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:51:56.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 secure :-1 s=READY pgs=4136 cs=0 l=1 rev1=1 rx=0x7fdc000026d0 tx=0x7fdc00009de0).stop 2022-02-02T22:51:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 shutdown_connections 2022-02-02T22:51:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdbf0064e20 0x7fdbf00672e0 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:56.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc040f5430 0x7fdc04109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:56.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 --2- 172.21.15.96:0/1372911365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc040f66d0 0x7fdc0410bf90 unknown :-1 s=CLOSED pgs=4136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:51:56.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 >> 172.21.15.96:0/1372911365 conn(0x7fdc040f0b90 msgr2=0x7fdc040fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:51:56.157 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 shutdown_connections 2022-02-02T22:51:56.158 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:51:56.141+0000 7fdc0a370700 1 -- 172.21.15.96:0/1372911365 wait complete. 2022-02-02T22:51:56.158 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:51:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:56 smithi159 ceph-mon[69013]: from='client.42386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:56 smithi159 ceph-mon[69013]: from='client.42390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:56 smithi159 ceph-mon[69013]: pgmap v8094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/656312493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:51:57.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:56 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1372911365' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:51:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:56 smithi096 ceph-mon[101353]: from='client.42386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:56 smithi096 ceph-mon[101353]: from='client.42390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:51:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:56 smithi096 ceph-mon[101353]: pgmap v8094: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:57.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/656312493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:51:57.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:56 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1372911365' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:51:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:51:58 smithi159 ceph-mon[69013]: pgmap v8095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:51:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:51:58 smithi096 ceph-mon[101353]: pgmap v8095: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:00 smithi159 ceph-mon[69013]: pgmap v8096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:00 smithi096 ceph-mon[101353]: pgmap v8096: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:02 smithi159 ceph-mon[69013]: pgmap v8097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:02 smithi096 ceph-mon[101353]: pgmap v8097: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:04 smithi159 ceph-mon[69013]: pgmap v8098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:04 smithi096 ceph-mon[101353]: pgmap v8098: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:06 smithi159 ceph-mon[69013]: pgmap v8099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:06 smithi096 ceph-mon[101353]: pgmap v8099: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:08 smithi159 ceph-mon[69013]: pgmap v8100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:08 smithi096 ceph-mon[101353]: pgmap v8100: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:11.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:10 smithi159 ceph-mon[69013]: pgmap v8101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:10 smithi096 ceph-mon[101353]: pgmap v8101: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:13.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:12 smithi159 ceph-mon[69013]: pgmap v8102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:13.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:12 smithi096 ceph-mon[101353]: pgmap v8102: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:15.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:14 smithi159 ceph-mon[69013]: pgmap v8103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:14 smithi096 ceph-mon[101353]: pgmap v8103: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:17.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:16 smithi159 ceph-mon[69013]: pgmap v8104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:16 smithi096 ceph-mon[101353]: pgmap v8104: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:19.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:18 smithi096 ceph-mon[101353]: pgmap v8105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:18 smithi159 ceph-mon[69013]: pgmap v8105: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:20 smithi096 ceph-mon[101353]: pgmap v8106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:21.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:20 smithi159 ceph-mon[69013]: pgmap v8106: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:22 smithi096 ceph-mon[101353]: pgmap v8107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:22 smithi159 ceph-mon[69013]: pgmap v8107: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:24 smithi096 ceph-mon[101353]: pgmap v8108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:24 smithi159 ceph-mon[69013]: pgmap v8108: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:26.251 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 -- 172.21.15.96:0/714868242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f6860 msgr2=0x7f6da40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 --2- 172.21.15.96:0/714868242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f6860 0x7f6da40f6cc0 secure :-1 s=READY pgs=4137 cs=0 l=1 rev1=1 rx=0x7f6d98004660 tx=0x7f6d98009b30).stop 2022-02-02T22:52:26.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 -- 172.21.15.96:0/714868242 shutdown_connections 2022-02-02T22:52:26.252 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 --2- 172.21.15.96:0/714868242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f6860 0x7f6da40f6cc0 unknown :-1 s=CLOSED pgs=4137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 --2- 172.21.15.96:0/714868242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f55c0 0x7f6da40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 -- 172.21.15.96:0/714868242 >> 172.21.15.96:0/714868242 conn(0x7f6da40f0d40 msgr2=0x7f6da40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:26.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 -- 172.21.15.96:0/714868242 shutdown_connections 2022-02-02T22:52:26.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.250+0000 7f6da9178700 1 -- 172.21.15.96:0/714868242 wait complete. 2022-02-02T22:52:26.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 Processor -- start 2022-02-02T22:52:26.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 -- start start 2022-02-02T22:52:26.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f6860 0x7f6da410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40603c0 con 0x7f6da40f55c0 2022-02-02T22:52:26.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da9178700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4060500 con 0x7f6da40f6860 2022-02-02T22:52:26.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50852/0 (socket says 172.21.15.96:50852) 2022-02-02T22:52:26.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 -- 172.21.15.96:0/1744178372 learned_addr learned my addr 172.21.15.96:0/1744178372 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:26.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da259c700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f6860 0x7f6da410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 -- 172.21.15.96:0/1744178372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f6860 msgr2=0x7f6da410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f6860 0x7f6da410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 -- 172.21.15.96:0/1744178372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98005040 con 0x7f6da40f55c0 2022-02-02T22:52:26.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.251+0000 7f6da2d9d700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 secure :-1 s=READY pgs=4138 cs=0 l=1 rev1=1 rx=0x7f6d9c00d7f0 tx=0x7f6d9c004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.252+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c00f490 con 0x7f6da40f55c0 2022-02-02T22:52:26.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.252+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da410c720 con 0x7f6da40f55c0 2022-02-02T22:52:26.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.252+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d9c00f040 con 0x7f6da40f55c0 2022-02-02T22:52:26.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.252+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c0139b0 con 0x7f6da40f55c0 2022-02-02T22:52:26.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.252+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da410ccb0 con 0x7f6da40f55c0 2022-02-02T22:52:26.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.253+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4045ad0 con 0x7f6da40f55c0 2022-02-02T22:52:26.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.253+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6d9c01a030 con 0x7f6da40f55c0 2022-02-02T22:52:26.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.254+0000 7f6d8b7fe700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.254+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6d9c081880 con 0x7f6da40f55c0 2022-02-02T22:52:26.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.254+0000 7f6da259c700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.254+0000 7f6da259c700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 rx=0x7f6d98004630 tx=0x7f6d98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.258+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6d9c04f980 con 0x7f6da40f55c0 2022-02-02T22:52:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.437+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6da40fdef0 con 0x7f6d8c064dd0 2022-02-02T22:52:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.438+0000 7f6d8b7fe700 1 -- 172.21.15.96:0/1744178372 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6da40fdef0 con 0x7f6d8c064dd0 2022-02-02T22:52:26.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 msgr2=0x7f6d8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 rx=0x7f6d98004630 tx=0x7f6d98009b30).stop 2022-02-02T22:52:26.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 msgr2=0x7f6da4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 secure :-1 s=READY pgs=4138 cs=0 l=1 rev1=1 rx=0x7f6d9c00d7f0 tx=0x7f6d9c004e80).stop 2022-02-02T22:52:26.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 shutdown_connections 2022-02-02T22:52:26.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6d8c064dd0 0x7f6d8c067290 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6da40f55c0 0x7f6da4109c70 unknown :-1 s=CLOSED pgs=4138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 --2- 172.21.15.96:0/1744178372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6da40f6860 0x7f6da410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 >> 172.21.15.96:0/1744178372 conn(0x7f6da40f0d40 msgr2=0x7f6da40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:26.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 shutdown_connections 2022-02-02T22:52:26.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.440+0000 7f6da9178700 1 -- 172.21.15.96:0/1744178372 wait complete. 2022-02-02T22:52:26.451 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:52:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1695193895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f66d0 msgr2=0x7f15c80f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1695193895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f66d0 0x7f15c80f6af0 secure :-1 s=READY pgs=4139 cs=0 l=1 rev1=1 rx=0x7f15b8004660 tx=0x7f15b8009b30).stop 2022-02-02T22:52:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1695193895 shutdown_connections 2022-02-02T22:52:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1695193895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f7970 0x7f15c80f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1695193895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f66d0 0x7f15c80f6af0 unknown :-1 s=CLOSED pgs=4139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1695193895 >> 172.21.15.96:0/1695193895 conn(0x7f15c80f1e50 msgr2=0x7f15c80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1695193895 shutdown_connections 2022-02-02T22:52:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.538+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1695193895 wait complete. 2022-02-02T22:52:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 Processor -- start 2022-02-02T22:52:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 -- start start 2022-02-02T22:52:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f66d0 0x7f15c8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8107a40 con 0x7f15c80f7970 2022-02-02T22:52:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.539+0000 7f15cd7a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8107b80 con 0x7f15c80f66d0 2022-02-02T22:52:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50864/0 (socket says 172.21.15.96:50864) 2022-02-02T22:52:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 -- 172.21.15.96:0/1890748751 learned_addr learned my addr 172.21.15.96:0/1890748751 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c6ffd700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f66d0 0x7f15c8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 -- 172.21.15.96:0/1890748751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f66d0 msgr2=0x7f15c8106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f66d0 0x7f15c8106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 -- 172.21.15.96:0/1890748751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8005040 con 0x7f15c80f7970 2022-02-02T22:52:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15c67fc700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 secure :-1 s=READY pgs=4140 cs=0 l=1 rev1=1 rx=0x7f15bc00c530 tx=0x7f15bc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15bc00f650 con 0x7f15c80f7970 2022-02-02T22:52:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c8108520 con 0x7f15c80f7970 2022-02-02T22:52:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f15bc00fc60 con 0x7f15c80f7970 2022-02-02T22:52:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15bc012c20 con 0x7f15c80f7970 2022-02-02T22:52:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.540+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c8108ae0 con 0x7f15c80f7970 2022-02-02T22:52:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.541+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c8045ad0 con 0x7f15c80f7970 2022-02-02T22:52:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.542+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f15bc010070 con 0x7f15c80f7970 2022-02-02T22:52:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.542+0000 7f15af7fe700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 0x7f15b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.542+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f15bc081770 con 0x7f15c80f7970 2022-02-02T22:52:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.542+0000 7f15c6ffd700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 0x7f15b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.543+0000 7f15c6ffd700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 0x7f15b0067290 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7f15b8004630 tx=0x7f15b8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.546+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f15bc0531e0 con 0x7f15c80f7970 2022-02-02T22:52:26.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.723+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15c8108d00 con 0x7f15b0064dd0 2022-02-02T22:52:26.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.733+0000 7f15af7fe700 1 -- 172.21.15.96:0/1890748751 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f15c8108d00 con 0x7f15b0064dd0 2022-02-02T22:52:26.738 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:52:26.738 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:52:26.739 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:52:26.739 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:52:26.739 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:52:26.740 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:52:26.740 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:52:26.740 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:52:26.741 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:52:26.741 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:52:26.741 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:52:26.742 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:52:26.742 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:52:26.743 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:52:26.743 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:52:26.743 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:52:26.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:52:26.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:52:26.744 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:52:26.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:52:26.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:52:26.745 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:52:26.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 msgr2=0x7f15b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 0x7f15b0067290 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7f15b8004630 tx=0x7f15b8009b30).stop 2022-02-02T22:52:26.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 msgr2=0x7f15c8107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 secure :-1 s=READY pgs=4140 cs=0 l=1 rev1=1 rx=0x7f15bc00c530 tx=0x7f15bc007e20).stop 2022-02-02T22:52:26.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 shutdown_connections 2022-02-02T22:52:26.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f15b0064dd0 0x7f15b0067290 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15c80f66d0 0x7f15c8106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 --2- 172.21.15.96:0/1890748751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c80f7970 0x7f15c8107490 unknown :-1 s=CLOSED pgs=4140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.735+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 >> 172.21.15.96:0/1890748751 conn(0x7f15c80f1e50 msgr2=0x7f15c80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:26.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.736+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 shutdown_connections 2022-02-02T22:52:26.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.736+0000 7f15cd7a7700 1 -- 172.21.15.96:0/1890748751 wait complete. 2022-02-02T22:52:26.804 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:26 smithi096 ceph-mon[101353]: pgmap v8109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 -- 172.21.15.96:0/961332772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f6870 msgr2=0x7fdd9c0f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 --2- 172.21.15.96:0/961332772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c0f6cd0 secure :-1 s=READY pgs=4141 cs=0 l=1 rev1=1 rx=0x7fdd8c004660 tx=0x7fdd8c009b30).stop 2022-02-02T22:52:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 -- 172.21.15.96:0/961332772 shutdown_connections 2022-02-02T22:52:26.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 --2- 172.21.15.96:0/961332772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c0f6cd0 unknown :-1 s=CLOSED pgs=4141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 --2- 172.21.15.96:0/961332772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c0f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 -- 172.21.15.96:0/961332772 >> 172.21.15.96:0/961332772 conn(0x7fdd9c0f0d70 msgr2=0x7fdd9c0f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:26.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 -- 172.21.15.96:0/961332772 shutdown_connections 2022-02-02T22:52:26.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.833+0000 7fdda1840700 1 -- 172.21.15.96:0/961332772 wait complete. 2022-02-02T22:52:26.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 Processor -- start 2022-02-02T22:52:26.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 -- start start 2022-02-02T22:52:26.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1079d0 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdda1840700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c107b10 con 0x7fdd9c0f6870 2022-02-02T22:52:26.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50872/0 (socket says 172.21.15.96:50872) 2022-02-02T22:52:26.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 -- 172.21.15.96:0/2817032827 learned_addr learned my addr 172.21.15.96:0/2817032827 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:26.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9a7fc700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 -- 172.21.15.96:0/2817032827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f6870 msgr2=0x7fdd9c107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:26.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:26.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 -- 172.21.15.96:0/2817032827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c005040 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.834+0000 7fdd9affd700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 secure :-1 s=READY pgs=4142 cs=0 l=1 rev1=1 rx=0x7fdd8400c790 tx=0x7fdd84007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.835+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd84013630 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.835+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c1084b0 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.835+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd84012860 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.835+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd84002780 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.835+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c108a70 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.836+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c045ad0 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.836+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdd84010070 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.836+0000 7fdd937fe700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 0x7fdd88067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:26.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.837+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdd84081b30 con 0x7fdd9c0f55d0 2022-02-02T22:52:26.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.837+0000 7fdd9a7fc700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 0x7fdd88067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.837+0000 7fdd9a7fc700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 0x7fdd88067290 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 rx=0x7fdd8c004630 tx=0x7fdd8c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:26.841+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdd84053600 con 0x7fdd9c0f55d0 2022-02-02T22:52:27.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.068+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd9c10d550 con 0x7fdd9c0f55d0 2022-02-02T22:52:27.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.069+0000 7fdd937fe700 1 -- 172.21.15.96:0/2817032827 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fdd840531f0 con 0x7fdd9c0f55d0 2022-02-02T22:52:27.071 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:52:27.071 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:52:27.072 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:52:27.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:27.072 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:52:27.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:52:27.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:27.073 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:52:27.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:52:27.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:27.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:52:27.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:52:27.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:27.075 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:52:27.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:52:27.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:52:27.076 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:52:27.077 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:52:27.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 msgr2=0x7fdd88067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 0x7fdd88067290 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 rx=0x7fdd8c004630 tx=0x7fdd8c009b30).stop 2022-02-02T22:52:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 msgr2=0x7fdd9c106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 secure :-1 s=READY pgs=4142 cs=0 l=1 rev1=1 rx=0x7fdd8400c790 tx=0x7fdd84007d90).stop 2022-02-02T22:52:27.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 shutdown_connections 2022-02-02T22:52:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdd88064dd0 0x7fdd88067290 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd9c0f55d0 0x7fdd9c106f30 unknown :-1 s=CLOSED pgs=4142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.070+0000 7fdda1840700 1 --2- 172.21.15.96:0/2817032827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0f6870 0x7fdd9c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.071+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 >> 172.21.15.96:0/2817032827 conn(0x7fdd9c0f0d70 msgr2=0x7fdd9c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:27.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.071+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 shutdown_connections 2022-02-02T22:52:27.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.071+0000 7fdda1840700 1 -- 172.21.15.96:0/2817032827 wait complete. 2022-02-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 -- 172.21.15.96:0/1208701060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 msgr2=0x7f98240f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 --2- 172.21.15.96:0/1208701060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f98240f5db0 secure :-1 s=READY pgs=4143 cs=0 l=1 rev1=1 rx=0x7f9820004660 tx=0x7f9820009b30).stop 2022-02-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 -- 172.21.15.96:0/1208701060 shutdown_connections 2022-02-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 --2- 172.21.15.96:0/1208701060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f98240f5db0 unknown :-1 s=CLOSED pgs=4143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 --2- 172.21.15.96:0/1208701060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 0x7f98240f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 -- 172.21.15.96:0/1208701060 >> 172.21.15.96:0/1208701060 conn(0x7f98240f04c0 msgr2=0x7f98240f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 -- 172.21.15.96:0/1208701060 shutdown_connections 2022-02-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.168+0000 7f982b278700 1 -- 172.21.15.96:0/1208701060 wait complete. 2022-02-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 Processor -- start 2022-02-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 -- start start 2022-02-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 0x7f982410c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240f55c0 con 0x7f98240f5930 2022-02-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f982b278700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240f5700 con 0x7f98240f6be0 2022-02-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50882/0 (socket says 172.21.15.96:50882) 2022-02-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 -- 172.21.15.96:0/2840530242 learned_addr learned my addr 172.21.15.96:0/2840530242 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9828813700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 0x7f982410c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 -- 172.21.15.96:0/2840530242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 msgr2=0x7f982410c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 0x7f982410c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 -- 172.21.15.96:0/2840530242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820005040 con 0x7f98240f5930 2022-02-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.169+0000 7f9829014700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 secure :-1 s=READY pgs=4144 cs=0 l=1 rev1=1 rx=0x7f981400c530 tx=0x7f9814007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.170+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981400f650 con 0x7f98240f5930 2022-02-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.170+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982410c7f0 con 0x7f98240f5930 2022-02-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.170+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f981400fc60 con 0x7f98240f5930 2022-02-02T22:52:27.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.170+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9814012d20 con 0x7f98240f5930 2022-02-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.170+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982410cd80 con 0x7f98240f5930 2022-02-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.171+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240f4150 con 0x7f98240f5930 2022-02-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.171+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9814019030 con 0x7f98240f5930 2022-02-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.172+0000 7f9819ffb700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 0x7f9810067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.172+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f98140816c0 con 0x7f98240f5930 2022-02-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.172+0000 7f9828813700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 0x7f9810067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.172+0000 7f9828813700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 0x7f9810067290 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f9820004e30 tx=0x7f9820009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.176+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f981404f810 con 0x7f98240f5930 2022-02-02T22:52:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:26 smithi159 ceph-mon[69013]: pgmap v8109: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:27.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.376+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98240586e0 con 0x7f98240f5930 2022-02-02T22:52:27.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.376+0000 7f9819ffb700 1 -- 172.21.15.96:0/2840530242 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9814052e30 con 0x7f98240f5930 2022-02-02T22:52:27.378 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:52:27.378 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:52:27.378 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:52:27.379 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:52:27.379 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:52:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:52:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:52:27.380 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:52:27.381 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:52:27.381 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:52:27.381 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:52:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:52:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:52:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:52:27.383 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:52:27.383 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:52:27.383 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:52:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:52:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:52:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:52:27.385 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:52:27.385 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:52:27.386 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:52:27.386 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:52:27.386 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:52:27.387 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:52:27.387 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:52:27.387 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:52:27.388 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:52:27.388 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:52:27.388 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:52:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:27.389 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:52:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:27.390 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:27.390 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:27.390 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 msgr2=0x7f9810067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 0x7f9810067290 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f9820004e30 tx=0x7f9820009b30).stop 2022-02-02T22:52:27.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 msgr2=0x7f9824109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 secure :-1 s=READY pgs=4144 cs=0 l=1 rev1=1 rx=0x7f981400c530 tx=0x7f9814007e10).stop 2022-02-02T22:52:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 shutdown_connections 2022-02-02T22:52:27.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9810064dd0 0x7f9810067290 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98240f5930 0x7f9824109d40 unknown :-1 s=CLOSED pgs=4144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 --2- 172.21.15.96:0/2840530242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98240f6be0 0x7f982410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:27.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 >> 172.21.15.96:0/2840530242 conn(0x7f98240f04c0 msgr2=0x7f98240fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 shutdown_connections 2022-02-02T22:52:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:27.378+0000 7f982b278700 1 -- 172.21.15.96:0/2840530242 wait complete. 2022-02-02T22:52:27.395 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:52:28.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:27 smithi096 ceph-mon[101353]: from='client.42402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:27 smithi096 ceph-mon[101353]: from='client.42406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:28.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2817032827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:52:28.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:27 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2840530242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:52:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:27 smithi159 ceph-mon[69013]: from='client.42402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:27 smithi159 ceph-mon[69013]: from='client.42406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2817032827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:52:28.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:27 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2840530242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:52:29.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:28 smithi096 ceph-mon[101353]: pgmap v8110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:52:29.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:52:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:28 smithi159 ceph-mon[69013]: pgmap v8110: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:52:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:52:31.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:30 smithi096 ceph-mon[101353]: pgmap v8111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:30 smithi159 ceph-mon[69013]: pgmap v8111: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:32 smithi096 ceph-mon[101353]: pgmap v8112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:32 smithi159 ceph-mon[69013]: pgmap v8112: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:35.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:34 smithi096 ceph-mon[101353]: pgmap v8113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:34 smithi159 ceph-mon[69013]: pgmap v8113: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:37.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:36 smithi096 ceph-mon[101353]: pgmap v8114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:36 smithi159 ceph-mon[69013]: pgmap v8114: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:38 smithi159 ceph-mon[69013]: pgmap v8115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:38 smithi096 ceph-mon[101353]: pgmap v8115: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:40 smithi159 ceph-mon[69013]: pgmap v8116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:40 smithi096 ceph-mon[101353]: pgmap v8116: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:42 smithi096 ceph-mon[101353]: pgmap v8117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:42 smithi159 ceph-mon[69013]: pgmap v8117: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:44 smithi159 ceph-mon[69013]: pgmap v8118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:44 smithi096 ceph-mon[101353]: pgmap v8118: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:46 smithi159 ceph-mon[69013]: pgmap v8119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:46 smithi096 ceph-mon[101353]: pgmap v8119: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:48 smithi159 ceph-mon[69013]: pgmap v8120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:48 smithi096 ceph-mon[101353]: pgmap v8120: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:50 smithi159 ceph-mon[69013]: pgmap v8121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:50 smithi096 ceph-mon[101353]: pgmap v8121: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:52 smithi096 ceph-mon[101353]: pgmap v8122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:52 smithi159 ceph-mon[69013]: pgmap v8122: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:55.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:54 smithi159 ceph-mon[69013]: pgmap v8123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:54 smithi096 ceph-mon[101353]: pgmap v8123: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:57.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:56 smithi159 ceph-mon[69013]: pgmap v8124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:56 smithi096 ceph-mon[101353]: pgmap v8124: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 -- 172.21.15.96:0/163258207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 msgr2=0x7faa240f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.488 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/163258207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa240f7de0 secure :-1 s=READY pgs=4145 cs=0 l=1 rev1=1 rx=0x7faa18004660 tx=0x7faa18009b30).stop 2022-02-02T22:52:57.489 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 -- 172.21.15.96:0/163258207 shutdown_connections 2022-02-02T22:52:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/163258207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa240f7de0 unknown :-1 s=CLOSED pgs=4145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/163258207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 0x7faa240f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 -- 172.21.15.96:0/163258207 >> 172.21.15.96:0/163258207 conn(0x7faa240f1e40 msgr2=0x7faa240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 -- 172.21.15.96:0/163258207 shutdown_connections 2022-02-02T22:52:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.487+0000 7faa2a2f5700 1 -- 172.21.15.96:0/163258207 wait complete. 2022-02-02T22:52:57.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 Processor -- start 2022-02-02T22:52:57.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 -- start start 2022-02-02T22:52:57.494 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 0x7faa2406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2406a380 con 0x7faa240f7980 2022-02-02T22:52:57.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa2a2f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2406a4c0 con 0x7faa240f66e0 2022-02-02T22:52:57.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50902/0 (socket says 172.21.15.96:50902) 2022-02-02T22:52:57.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.488+0000 7faa237fe700 1 -- 172.21.15.96:0/2745234095 learned_addr learned my addr 172.21.15.96:0/2745234095 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:57.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa23fff700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 0x7faa2406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa237fe700 1 -- 172.21.15.96:0/2745234095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 msgr2=0x7faa2406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa237fe700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 0x7faa2406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa237fe700 1 -- 172.21.15.96:0/2745234095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18005040 con 0x7faa240f7980 2022-02-02T22:52:57.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa237fe700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 secure :-1 s=READY pgs=4146 cs=0 l=1 rev1=1 rx=0x7faa18009990 tx=0x7faa18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:57.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa18018070 con 0x7faa240f7980 2022-02-02T22:52:57.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa18007ca0 con 0x7faa240f7980 2022-02-02T22:52:57.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2406a740 con 0x7faa240f7980 2022-02-02T22:52:57.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1801c620 con 0x7faa240f7980 2022-02-02T22:52:57.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.489+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2406aca0 con 0x7faa240f7980 2022-02-02T22:52:57.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.490+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa24045ad0 con 0x7faa240f7980 2022-02-02T22:52:57.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.491+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa1801d960 con 0x7faa240f7980 2022-02-02T22:52:57.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.491+0000 7faa20ff9700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 0x7faa0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.491+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa180837e0 con 0x7faa240f7980 2022-02-02T22:52:57.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.491+0000 7faa23fff700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 0x7faa0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.491+0000 7faa23fff700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 0x7faa0c067290 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 rx=0x7faa2406b730 tx=0x7faa14009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:57.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.495+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa180519a0 con 0x7faa240f7980 2022-02-02T22:52:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.673+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa240ff010 con 0x7faa0c064dd0 2022-02-02T22:52:57.674 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.675+0000 7faa20ff9700 1 -- 172.21.15.96:0/2745234095 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faa240ff010 con 0x7faa0c064dd0 2022-02-02T22:52:57.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.676+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 msgr2=0x7faa0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.763 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.676+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 0x7faa0c067290 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 rx=0x7faa2406b730 tx=0x7faa14009040).stop 2022-02-02T22:52:57.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.676+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 msgr2=0x7faa24069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.764 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.676+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 secure :-1 s=READY pgs=4146 cs=0 l=1 rev1=1 rx=0x7faa18009990 tx=0x7faa18009b30).stop 2022-02-02T22:52:57.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 shutdown_connections 2022-02-02T22:52:57.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faa0c064dd0 0x7faa0c067290 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.765 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa240f66e0 0x7faa2406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 --2- 172.21.15.96:0/2745234095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240f7980 0x7faa24069e20 unknown :-1 s=CLOSED pgs=4146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 >> 172.21.15.96:0/2745234095 conn(0x7faa240f1e40 msgr2=0x7faa240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:57.766 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 shutdown_connections 2022-02-02T22:52:57.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.677+0000 7faa2a2f5700 1 -- 172.21.15.96:0/2745234095 wait complete. 2022-02-02T22:52:57.767 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:52:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.774+0000 7fe428ca3700 1 -- 172.21.15.96:0/4004539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f77d0 msgr2=0x7fe4240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.776 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.774+0000 7fe428ca3700 1 --2- 172.21.15.96:0/4004539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f77d0 0x7fe4240f7c30 secure :-1 s=READY pgs=4147 cs=0 l=1 rev1=1 rx=0x7fe414004660 tx=0x7fe414009b30).stop 2022-02-02T22:52:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 -- 172.21.15.96:0/4004539 shutdown_connections 2022-02-02T22:52:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 --2- 172.21.15.96:0/4004539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f77d0 0x7fe4240f7c30 unknown :-1 s=CLOSED pgs=4147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.777 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 --2- 172.21.15.96:0/4004539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f6530 0x7fe4240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 -- 172.21.15.96:0/4004539 >> 172.21.15.96:0/4004539 conn(0x7fe4240f1c90 msgr2=0x7fe4240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 -- 172.21.15.96:0/4004539 shutdown_connections 2022-02-02T22:52:57.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 -- 172.21.15.96:0/4004539 wait complete. 2022-02-02T22:52:57.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 Processor -- start 2022-02-02T22:52:57.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.775+0000 7fe428ca3700 1 -- start start 2022-02-02T22:52:57.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe428ca3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe428ca3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f77d0 0x7fe424107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe428ca3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4241077f0 con 0x7fe4240f6530 2022-02-02T22:52:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe428ca3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424107ff0 con 0x7fe4240f77d0 2022-02-02T22:52:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50910/0 (socket says 172.21.15.96:50910) 2022-02-02T22:52:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 -- 172.21.15.96:0/1108752474 learned_addr learned my addr 172.21.15.96:0/1108752474 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe422ffd700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f77d0 0x7fe424107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 -- 172.21.15.96:0/1108752474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f77d0 msgr2=0x7fe424107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f77d0 0x7fe424107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 -- 172.21.15.96:0/1108752474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414005040 con 0x7fe4240f6530 2022-02-02T22:52:57.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe4237fe700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 secure :-1 s=READY pgs=4148 cs=0 l=1 rev1=1 rx=0x7fe41800c530 tx=0x7fe418007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:57.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41800f650 con 0x7fe4240f6530 2022-02-02T22:52:57.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4241082d0 con 0x7fe4240f6530 2022-02-02T22:52:57.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe41800fc60 con 0x7fe4240f6530 2022-02-02T22:52:57.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.776+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe418012d20 con 0x7fe4240f6530 2022-02-02T22:52:57.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.777+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe424108890 con 0x7fe4240f6530 2022-02-02T22:52:57.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.777+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe424059100 con 0x7fe4240f6530 2022-02-02T22:52:57.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.778+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe418019030 con 0x7fe4240f6530 2022-02-02T22:52:57.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.778+0000 7fe40bfff700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 0x7fe40c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:57.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.778+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe4180816b0 con 0x7fe4240f6530 2022-02-02T22:52:57.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.778+0000 7fe422ffd700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 0x7fe40c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:57.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.779+0000 7fe422ffd700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 0x7fe40c0672e0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7fe414004e30 tx=0x7fe414009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:57.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.782+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe418053230 con 0x7fe4240f6530 2022-02-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.956+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4240008d0 con 0x7fe40c064e20 2022-02-02T22:52:57.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.966+0000 7fe40bfff700 1 -- 172.21.15.96:0/1108752474 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe4240008d0 con 0x7fe40c064e20 2022-02-02T22:52:57.966 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:52:57.967 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:52:57.967 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:52:57.967 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:52:57.968 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:52:57.968 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:52:57.968 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:52:57.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:52:57.969 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:52:57.969 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:52:57.970 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:52:57.970 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:52:57.970 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:52:57.971 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:52:57.971 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:52:57.971 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:52:57.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:52:57.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:52:57.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:52:57.972 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:52:57.973 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:52:57.973 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:52:57.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.967+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 msgr2=0x7fe40c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.967+0000 7fe428ca3700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 0x7fe40c0672e0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7fe414004e30 tx=0x7fe414009b30).stop 2022-02-02T22:52:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.967+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 msgr2=0x7fe424106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.967+0000 7fe428ca3700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 secure :-1 s=READY pgs=4148 cs=0 l=1 rev1=1 rx=0x7fe41800c530 tx=0x7fe418007e10).stop 2022-02-02T22:52:57.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 shutdown_connections 2022-02-02T22:52:57.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe40c064e20 0x7fe40c0672e0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4240f6530 0x7fe424106d50 unknown :-1 s=CLOSED pgs=4148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 --2- 172.21.15.96:0/1108752474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4240f77d0 0x7fe424107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:57.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 >> 172.21.15.96:0/1108752474 conn(0x7fe4240f1c90 msgr2=0x7fe4240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:57.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 shutdown_connections 2022-02-02T22:52:57.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:57.968+0000 7fe428ca3700 1 -- 172.21.15.96:0/1108752474 wait complete. 2022-02-02T22:52:58.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 -- 172.21.15.96:0/281000714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 msgr2=0x7f51280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 --2- 172.21.15.96:0/281000714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f51280f6b00 secure :-1 s=READY pgs=4149 cs=0 l=1 rev1=1 rx=0x7f5118004660 tx=0x7f5118009b30).stop 2022-02-02T22:52:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 -- 172.21.15.96:0/281000714 shutdown_connections 2022-02-02T22:52:58.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 --2- 172.21.15.96:0/281000714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f51280f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:52:58.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 --2- 172.21.15.96:0/281000714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f51280f6b00 unknown :-1 s=CLOSED pgs=4149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 -- 172.21.15.96:0/281000714 >> 172.21.15.96:0/281000714 conn(0x7f51280f1f00 msgr2=0x7f51280f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:58.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 -- 172.21.15.96:0/281000714 shutdown_connections 2022-02-02T22:52:58.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.064+0000 7f512fdc8700 1 -- 172.21.15.96:0/281000714 wait complete. 2022-02-02T22:52:58.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 Processor -- start 2022-02-02T22:52:58.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 -- start start 2022-02-02T22:52:58.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f5128069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512806a410 con 0x7f51280f66e0 2022-02-02T22:52:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512fdc8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512806a550 con 0x7f51280f6ff0 2022-02-02T22:52:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50920/0 (socket says 172.21.15.96:50920) 2022-02-02T22:52:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 -- 172.21.15.96:0/592019193 learned_addr learned my addr 172.21.15.96:0/592019193 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512d363700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f5128069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 -- 172.21.15.96:0/592019193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 msgr2=0x7f5128069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f5128069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 -- 172.21.15.96:0/592019193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118005040 con 0x7f51280f66e0 2022-02-02T22:52:58.073 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512d363700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f5128069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:52:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.065+0000 7f512db64700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 secure :-1 s=READY pgs=4150 cs=0 l=1 rev1=1 rx=0x7f5118009990 tx=0x7f5118009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.066+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5118018070 con 0x7f51280f66e0 2022-02-02T22:52:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.066+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5118007ca0 con 0x7f51280f66e0 2022-02-02T22:52:58.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.066+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511801c620 con 0x7f51280f66e0 2022-02-02T22:52:58.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.066+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512806a7d0 con 0x7f51280f66e0 2022-02-02T22:52:58.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.066+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512810efb0 con 0x7f51280f66e0 2022-02-02T22:52:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.067+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128045ad0 con 0x7f51280f66e0 2022-02-02T22:52:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.067+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f511801d960 con 0x7f51280f66e0 2022-02-02T22:52:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.068+0000 7f511e7fc700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.068+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f51180837e0 con 0x7f51280f66e0 2022-02-02T22:52:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.068+0000 7f512d363700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.068+0000 7f512d363700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 rx=0x7f512400b8d0 tx=0x7f5124008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:58.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.072+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f51180519a0 con 0x7f51280f66e0 2022-02-02T22:52:58.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.302+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51280ff020 con 0x7f51280f66e0 2022-02-02T22:52:58.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.302+0000 7f511e7fc700 1 -- 172.21.15.96:0/592019193 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f5118054fc0 con 0x7f51280f66e0 2022-02-02T22:52:58.303 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:52:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:52:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:52:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:52:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:52:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:52:58.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:52:58.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:58.306 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:52:58.307 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:52:58.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:52:58.307 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:52:58.308 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:52:58.308 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:52:58.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:52:58.309 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:52:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 msgr2=0x7f5114067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 rx=0x7f512400b8d0 tx=0x7f5124008040).stop 2022-02-02T22:52:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 msgr2=0x7f512806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 secure :-1 s=READY pgs=4150 cs=0 l=1 rev1=1 rx=0x7f5118009990 tx=0x7f5118009b30).stop 2022-02-02T22:52:58.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 shutdown_connections 2022-02-02T22:52:58.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5114064dd0 0x7f5114067290 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51280f66e0 0x7f512806b9a0 unknown :-1 s=CLOSED pgs=4150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 --2- 172.21.15.96:0/592019193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51280f6ff0 0x7f5128069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 >> 172.21.15.96:0/592019193 conn(0x7f51280f1f00 msgr2=0x7f51280fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 shutdown_connections 2022-02-02T22:52:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.304+0000 7f512fdc8700 1 -- 172.21.15.96:0/592019193 wait complete. 2022-02-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 -- 172.21.15.96:0/415126929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f55e0 msgr2=0x7f83980f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 --2- 172.21.15.96:0/415126929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f55e0 0x7f83980f5a00 secure :-1 s=READY pgs=4151 cs=0 l=1 rev1=1 rx=0x7f838c004660 tx=0x7f838c009b30).stop 2022-02-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 -- 172.21.15.96:0/415126929 shutdown_connections 2022-02-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 --2- 172.21.15.96:0/415126929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f5ef0 0x7f83980f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 --2- 172.21.15.96:0/415126929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f55e0 0x7f83980f5a00 unknown :-1 s=CLOSED pgs=4151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 -- 172.21.15.96:0/415126929 >> 172.21.15.96:0/415126929 conn(0x7f83980f0de0 msgr2=0x7f83980f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 -- 172.21.15.96:0/415126929 shutdown_connections 2022-02-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 -- 172.21.15.96:0/415126929 wait complete. 2022-02-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.401+0000 7f839dcf6700 1 Processor -- start 2022-02-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f839dcf6700 1 -- start start 2022-02-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f839dcf6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f55e0 0x7f839810c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f839dcf6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f839dcf6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980603d0 con 0x7f83980f5ef0 2022-02-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f839dcf6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398060510 con 0x7f83980f55e0 2022-02-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50932/0 (socket says 172.21.15.96:50932) 2022-02-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 -- 172.21.15.96:0/3494430789 learned_addr learned my addr 172.21.15.96:0/3494430789 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f83977fe700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f55e0 0x7f839810c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 -- 172.21.15.96:0/3494430789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f55e0 msgr2=0x7f839810c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f55e0 0x7f839810c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.402+0000 7f8396ffd700 1 -- 172.21.15.96:0/3494430789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c005040 con 0x7f83980f5ef0 2022-02-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f8396ffd700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 secure :-1 s=READY pgs=4152 cs=0 l=1 rev1=1 rx=0x7f838800e7f0 tx=0x7f838800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83880092e0 con 0x7f83980f5ef0 2022-02-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839810ea00 con 0x7f83980f5ef0 2022-02-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f838800f040 con 0x7f83980f5ef0 2022-02-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8388014750 con 0x7f83980f5ef0 2022-02-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.403+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839810ee80 con 0x7f83980f5ef0 2022-02-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.404+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398045ad0 con 0x7f83980f5ef0 2022-02-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.404+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f838801b030 con 0x7f83980f5ef0 2022-02-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.405+0000 7f837ffff700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 0x7f8380067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.405+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83880817d0 con 0x7f83980f5ef0 2022-02-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.405+0000 7f83977fe700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 0x7f8380067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.405+0000 7f83977fe700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 0x7f8380067290 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f838c005010 tx=0x7f838c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.409+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f838804f980 con 0x7f83980f5ef0 2022-02-02T22:52:58.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.607+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83980fdf50 con 0x7f83980f5ef0 2022-02-02T22:52:58.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.608+0000 7f837ffff700 1 -- 172.21.15.96:0/3494430789 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8388019070 con 0x7f83980f5ef0 2022-02-02T22:52:58.609 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:52:58.609 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:52:58.610 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:52:58.610 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:52:58.610 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:58.611 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:52:58.611 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:52:58.611 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:52:58.612 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:52:58.612 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:52:58.612 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:52:58.613 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:52:58.613 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:52:58.613 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:52:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:52:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:52:58.614 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:52:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:52:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:52:58.615 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:52:58.616 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:52:58.616 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:52:58.616 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:52:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:52:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:52:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:52:58.618 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:52:58.618 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:52:58.618 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:52:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:52:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:52:58.619 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:52:58.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:58.620 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:58.620 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:52:58.621 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:52:58.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:58.621 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:58.622 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:52:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 msgr2=0x7f8380067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 0x7f8380067290 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f838c005010 tx=0x7f838c00b040).stop 2022-02-02T22:52:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 msgr2=0x7f839810e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:52:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 secure :-1 s=READY pgs=4152 cs=0 l=1 rev1=1 rx=0x7f838800e7f0 tx=0x7f838800b040).stop 2022-02-02T22:52:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 shutdown_connections 2022-02-02T22:52:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8380064dd0 0x7f8380067290 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83980f55e0 0x7f839810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.625 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 --2- 172.21.15.96:0/3494430789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83980f5ef0 0x7f839810e510 unknown :-1 s=CLOSED pgs=4152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:52:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 >> 172.21.15.96:0/3494430789 conn(0x7f83980f0de0 msgr2=0x7f83980fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:52:58.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 shutdown_connections 2022-02-02T22:52:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:52:58.610+0000 7f839dcf6700 1 -- 172.21.15.96:0/3494430789 wait complete. 2022-02-02T22:52:58.627 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:52:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:58 smithi159 ceph-mon[69013]: pgmap v8125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:58 smithi159 ceph-mon[69013]: from='client.42418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:58 smithi159 ceph-mon[69013]: from='client.42422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/592019193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:52:59.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:52:58 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3494430789' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:52:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:58 smithi096 ceph-mon[101353]: pgmap v8125: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:52:59.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:58 smithi096 ceph-mon[101353]: from='client.42418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:59.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:58 smithi096 ceph-mon[101353]: from='client.42422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:52:59.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/592019193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:52:59.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:52:58 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3494430789' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:53:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:00 smithi159 ceph-mon[69013]: pgmap v8126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:00 smithi096 ceph-mon[101353]: pgmap v8126: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:02 smithi096 ceph-mon[101353]: pgmap v8127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:02 smithi159 ceph-mon[69013]: pgmap v8127: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:04 smithi159 ceph-mon[69013]: pgmap v8128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:04 smithi096 ceph-mon[101353]: pgmap v8128: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:06 smithi159 ceph-mon[69013]: pgmap v8129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:06 smithi096 ceph-mon[101353]: pgmap v8129: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:08 smithi159 ceph-mon[69013]: pgmap v8130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:08 smithi096 ceph-mon[101353]: pgmap v8130: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:10 smithi159 ceph-mon[69013]: pgmap v8131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:10 smithi096 ceph-mon[101353]: pgmap v8131: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:12 smithi096 ceph-mon[101353]: pgmap v8132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:12 smithi159 ceph-mon[69013]: pgmap v8132: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:14 smithi159 ceph-mon[69013]: pgmap v8133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:14 smithi096 ceph-mon[101353]: pgmap v8133: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:16 smithi159 ceph-mon[69013]: pgmap v8134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:16 smithi096 ceph-mon[101353]: pgmap v8134: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:18 smithi159 ceph-mon[69013]: pgmap v8135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:18 smithi096 ceph-mon[101353]: pgmap v8135: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:20 smithi159 ceph-mon[69013]: pgmap v8136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:20 smithi096 ceph-mon[101353]: pgmap v8136: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:22 smithi096 ceph-mon[101353]: pgmap v8137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:22 smithi159 ceph-mon[69013]: pgmap v8137: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:24 smithi159 ceph-mon[69013]: pgmap v8138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:24 smithi096 ceph-mon[101353]: pgmap v8138: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:26 smithi159 ceph-mon[69013]: pgmap v8139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:26 smithi096 ceph-mon[101353]: pgmap v8139: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:28.722 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 -- 172.21.15.96:0/1514750758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f6860 msgr2=0x7f336c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 --2- 172.21.15.96:0/1514750758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f6860 0x7f336c0f6cc0 secure :-1 s=READY pgs=4153 cs=0 l=1 rev1=1 rx=0x7f335c004660 tx=0x7f335c009b30).stop 2022-02-02T22:53:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 -- 172.21.15.96:0/1514750758 shutdown_connections 2022-02-02T22:53:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 --2- 172.21.15.96:0/1514750758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f6860 0x7f336c0f6cc0 unknown :-1 s=CLOSED pgs=4153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 --2- 172.21.15.96:0/1514750758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f55c0 0x7f336c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 -- 172.21.15.96:0/1514750758 >> 172.21.15.96:0/1514750758 conn(0x7f336c0f0d40 msgr2=0x7f336c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:28.724 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 -- 172.21.15.96:0/1514750758 shutdown_connections 2022-02-02T22:53:28.725 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.722+0000 7f3372119700 1 -- 172.21.15.96:0/1514750758 wait complete. 2022-02-02T22:53:28.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 Processor -- start 2022-02-02T22:53:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 -- start start 2022-02-02T22:53:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f6860 0x7f336c106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c106920 con 0x7f336c0f55c0 2022-02-02T22:53:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f3372119700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c107130 con 0x7f336c0f6860 2022-02-02T22:53:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f336b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.723+0000 7f336b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50960/0 (socket says 172.21.15.96:50960) 2022-02-02T22:53:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336b7fe700 1 -- 172.21.15.96:0/2597770111 learned_addr learned my addr 172.21.15.96:0/2597770111 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:53:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336affd700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f6860 0x7f336c106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:28.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336b7fe700 1 -- 172.21.15.96:0/2597770111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f6860 msgr2=0x7f336c106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:28.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336b7fe700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f6860 0x7f336c106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336b7fe700 1 -- 172.21.15.96:0/2597770111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c005040 con 0x7f336c0f55c0 2022-02-02T22:53:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f336b7fe700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 secure :-1 s=READY pgs=4154 cs=0 l=1 rev1=1 rx=0x7f336000e7c0 tx=0x7f336000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:28.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33600092e0 con 0x7f336c0f55c0 2022-02-02T22:53:28.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c1073b0 con 0x7f336c0f55c0 2022-02-02T22:53:28.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f336000f040 con 0x7f336c0f55c0 2022-02-02T22:53:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33600147e0 con 0x7f336c0f55c0 2022-02-02T22:53:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.724+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c107970 con 0x7f336c0f55c0 2022-02-02T22:53:28.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.725+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c0f49b0 con 0x7f336c0f55c0 2022-02-02T22:53:28.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.726+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f336001b030 con 0x7f336c0f55c0 2022-02-02T22:53:28.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.726+0000 7f3353fff700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 0x7f3354067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:28.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.726+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3360081760 con 0x7f336c0f55c0 2022-02-02T22:53:28.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.726+0000 7f336affd700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 0x7f3354067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:28.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.727+0000 7f336affd700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 0x7f3354067290 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 rx=0x7f335c005010 tx=0x7f335c016040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:28.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.730+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f336004f910 con 0x7f336c0f55c0 2022-02-02T22:53:28.912 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.912+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f336c0ff800 con 0x7f3354064dd0 2022-02-02T22:53:28.913 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.913+0000 7f3353fff700 1 -- 172.21.15.96:0/2597770111 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f336c0ff800 con 0x7f3354064dd0 2022-02-02T22:53:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 msgr2=0x7f3354067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:28.916 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 0x7f3354067290 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 rx=0x7f335c005010 tx=0x7f335c016040).stop 2022-02-02T22:53:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 msgr2=0x7f336c105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:28.917 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 secure :-1 s=READY pgs=4154 cs=0 l=1 rev1=1 rx=0x7f336000e7c0 tx=0x7f336000b040).stop 2022-02-02T22:53:28.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 shutdown_connections 2022-02-02T22:53:28.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3354064dd0 0x7f3354067290 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.918 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f336c0f55c0 0x7f336c105e30 unknown :-1 s=CLOSED pgs=4154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 --2- 172.21.15.96:0/2597770111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f336c0f6860 0x7f336c106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:28.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 >> 172.21.15.96:0/2597770111 conn(0x7f336c0f0d40 msgr2=0x7f336c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:28.919 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 shutdown_connections 2022-02-02T22:53:28.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:28.916+0000 7f3372119700 1 -- 172.21.15.96:0/2597770111 wait complete. 2022-02-02T22:53:28.925 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:53:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 -- 172.21.15.96:0/949840177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f57d0 msgr2=0x7fab4c0f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 --2- 172.21.15.96:0/949840177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f57d0 0x7fab4c0f5c50 secure :-1 s=READY pgs=4155 cs=0 l=1 rev1=1 rx=0x7fab40004660 tx=0x7fab40009b30).stop 2022-02-02T22:53:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 -- 172.21.15.96:0/949840177 shutdown_connections 2022-02-02T22:53:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 --2- 172.21.15.96:0/949840177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f57d0 0x7fab4c0f5c50 unknown :-1 s=CLOSED pgs=4155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 --2- 172.21.15.96:0/949840177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c0f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 -- 172.21.15.96:0/949840177 >> 172.21.15.96:0/949840177 conn(0x7fab4c0f0320 msgr2=0x7fab4c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 -- 172.21.15.96:0/949840177 shutdown_connections 2022-02-02T22:53:29.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:28 smithi096 ceph-mon[101353]: pgmap v8140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:29.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:53:29.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:53:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.014+0000 7fab4b59e700 1 -- 172.21.15.96:0/949840177 wait complete. 2022-02-02T22:53:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 Processor -- start 2022-02-02T22:53:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 -- start start 2022-02-02T22:53:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f57d0 0x7fab4c1077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0f54c0 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0f5600 con 0x7fab4c0f57d0 2022-02-02T22:53:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50972/0 (socket says 172.21.15.96:50972) 2022-02-02T22:53:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 -- 172.21.15.96:0/2572354223 learned_addr learned my addr 172.21.15.96:0/2572354223 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:53:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab4a59c700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f57d0 0x7fab4c1077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 -- 172.21.15.96:0/2572354223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f57d0 msgr2=0x7fab4c1077d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f57d0 0x7fab4c1077d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.015+0000 7fab49d9b700 1 -- 172.21.15.96:0/2572354223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40005040 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab49d9b700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 secure :-1 s=READY pgs=4156 cs=0 l=1 rev1=1 rx=0x7fab40009990 tx=0x7fab40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab40018070 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c10a280 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab40007ba0 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4001c620 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.016+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c10a7e0 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.017+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c045ad0 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.017+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fab4001c8e0 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.018+0000 7fab3affd700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 0x7fab340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.018+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fab40083890 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.018+0000 7fab4a59c700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 0x7fab340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.018+0000 7fab4a59c700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 0x7fab340672e0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7fab3c0041d0 tx=0x7fab3c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.022+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fab40051990 con 0x7fab4c0f6ac0 2022-02-02T22:53:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.196+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab4c0ffb40 con 0x7fab34064e20 2022-02-02T22:53:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.205+0000 7fab3affd700 1 -- 172.21.15.96:0/2572354223 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fab4c0ffb40 con 0x7fab34064e20 2022-02-02T22:53:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:53:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:53:29.206 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:53:29.207 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:53:29.207 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:53:29.207 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:53:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:53:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:53:29.209 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:53:29.209 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:53:29.209 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:53:29.210 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:53:29.210 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:53:29.211 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:53:29.211 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:53:29.211 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:53:29.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:53:29.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:53:29.212 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:53:29.213 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:53:29.213 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:53:29.214 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:53:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 msgr2=0x7fab340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 0x7fab340672e0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7fab3c0041d0 tx=0x7fab3c009040).stop 2022-02-02T22:53:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 msgr2=0x7fab4c109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 secure :-1 s=READY pgs=4156 cs=0 l=1 rev1=1 rx=0x7fab40009990 tx=0x7fab40009b30).stop 2022-02-02T22:53:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 shutdown_connections 2022-02-02T22:53:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fab34064e20 0x7fab340672e0 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab4c0f57d0 0x7fab4c1077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 --2- 172.21.15.96:0/2572354223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab4c0f6ac0 0x7fab4c109cd0 unknown :-1 s=CLOSED pgs=4156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 >> 172.21.15.96:0/2572354223 conn(0x7fab4c0f0320 msgr2=0x7fab4c0fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 shutdown_connections 2022-02-02T22:53:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.207+0000 7fab4b59e700 1 -- 172.21.15.96:0/2572354223 wait complete. 2022-02-02T22:53:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:28 smithi159 ceph-mon[69013]: pgmap v8140: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:53:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:53:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 -- 172.21.15.96:0/3655344256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 msgr2=0x7f3d140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/3655344256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d140f59e0 secure :-1 s=READY pgs=4157 cs=0 l=1 rev1=1 rx=0x7f3d10004660 tx=0x7f3d10009b30).stop 2022-02-02T22:53:29.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 -- 172.21.15.96:0/3655344256 shutdown_connections 2022-02-02T22:53:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/3655344256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 0x7f3d140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/3655344256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d140f59e0 unknown :-1 s=CLOSED pgs=4157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 -- 172.21.15.96:0/3655344256 >> 172.21.15.96:0/3655344256 conn(0x7f3d140f0d40 msgr2=0x7f3d140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 -- 172.21.15.96:0/3655344256 shutdown_connections 2022-02-02T22:53:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.304+0000 7f3d1ba46700 1 -- 172.21.15.96:0/3655344256 wait complete. 2022-02-02T22:53:29.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 Processor -- start 2022-02-02T22:53:29.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 -- start start 2022-02-02T22:53:29.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 0x7f3d14107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14107a20 con 0x7f3d140f55c0 2022-02-02T22:53:29.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d1ba46700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14107b60 con 0x7f3d140f6860 2022-02-02T22:53:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50980/0 (socket says 172.21.15.96:50980) 2022-02-02T22:53:29.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 -- 172.21.15.96:0/46875390 learned_addr learned my addr 172.21.15.96:0/46875390 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:53:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d18fe1700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 0x7f3d14107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 -- 172.21.15.96:0/46875390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 msgr2=0x7f3d14107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 0x7f3d14107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 -- 172.21.15.96:0/46875390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10005040 con 0x7f3d140f55c0 2022-02-02T22:53:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.305+0000 7f3d197e2700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 secure :-1 s=READY pgs=4158 cs=0 l=1 rev1=1 rx=0x7f3d10004f60 tx=0x7f3d10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.306+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d10018070 con 0x7f3d140f55c0 2022-02-02T22:53:29.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.306+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d141084a0 con 0x7f3d140f55c0 2022-02-02T22:53:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.306+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d10009770 con 0x7f3d140f55c0 2022-02-02T22:53:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.306+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1001c3c0 con 0x7f3d140f55c0 2022-02-02T22:53:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.306+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d14108a00 con 0x7f3d140f55c0 2022-02-02T22:53:29.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.307+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d1001d420 con 0x7f3d140f55c0 2022-02-02T22:53:29.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.308+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d14045ad0 con 0x7f3d140f55c0 2022-02-02T22:53:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.308+0000 7f3d09ffb700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 0x7f3d00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.308+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3d10083780 con 0x7f3d140f55c0 2022-02-02T22:53:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.308+0000 7f3d18fe1700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 0x7f3d00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.308+0000 7f3d18fe1700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 0x7f3d00067290 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 rx=0x7f3d04007fd0 tx=0x7f3d04009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.312+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d100552b0 con 0x7f3d140f55c0 2022-02-02T22:53:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.545+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d140fef30 con 0x7f3d140f55c0 2022-02-02T22:53:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.546+0000 7f3d09ffb700 1 -- 172.21.15.96:0/46875390 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f3d10054ea0 con 0x7f3d140f55c0 2022-02-02T22:53:29.547 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:53:29.547 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:53:29.547 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:53:29.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:53:29.548 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:53:29.548 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:53:29.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:53:29.549 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:53:29.549 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:53:29.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:53:29.550 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:53:29.551 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:53:29.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:53:29.551 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:53:29.552 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:53:29.552 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:53:29.552 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:53:29.553 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:53:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 msgr2=0x7f3d00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 0x7f3d00067290 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 rx=0x7f3d04007fd0 tx=0x7f3d04009040).stop 2022-02-02T22:53:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 msgr2=0x7f3d14106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 secure :-1 s=READY pgs=4158 cs=0 l=1 rev1=1 rx=0x7f3d10004f60 tx=0x7f3d10009b30).stop 2022-02-02T22:53:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 shutdown_connections 2022-02-02T22:53:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3d00064dd0 0x7f3d00067290 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d140f55c0 0x7f3d14106f80 unknown :-1 s=CLOSED pgs=4158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 --2- 172.21.15.96:0/46875390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140f6860 0x7f3d14107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 >> 172.21.15.96:0/46875390 conn(0x7f3d140f0d40 msgr2=0x7f3d140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 shutdown_connections 2022-02-02T22:53:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.548+0000 7f3d1ba46700 1 -- 172.21.15.96:0/46875390 wait complete. 2022-02-02T22:53:29.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 -- 172.21.15.96:0/1837054167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 msgr2=0x7f6c640f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 --2- 172.21.15.96:0/1837054167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c640f5fd0 secure :-1 s=READY pgs=4159 cs=0 l=1 rev1=1 rx=0x7f6c60004660 tx=0x7f6c60009b30).stop 2022-02-02T22:53:29.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 -- 172.21.15.96:0/1837054167 shutdown_connections 2022-02-02T22:53:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 --2- 172.21.15.96:0/1837054167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 0x7f6c640f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 --2- 172.21.15.96:0/1837054167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c640f5fd0 unknown :-1 s=CLOSED pgs=4159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.645+0000 7f6c6c011700 1 -- 172.21.15.96:0/1837054167 >> 172.21.15.96:0/1837054167 conn(0x7f6c640f04c0 msgr2=0x7f6c640f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 -- 172.21.15.96:0/1837054167 shutdown_connections 2022-02-02T22:53:29.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 -- 172.21.15.96:0/1837054167 wait complete. 2022-02-02T22:53:29.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 Processor -- start 2022-02-02T22:53:29.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 -- start start 2022-02-02T22:53:29.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 0x7f6c64106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641069e0 con 0x7f6c640f5bb0 2022-02-02T22:53:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c6c011700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64106b20 con 0x7f6c640f6550 2022-02-02T22:53:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c69dad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c69dad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50990/0 (socket says 172.21.15.96:50990) 2022-02-02T22:53:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.646+0000 7f6c69dad700 1 -- 172.21.15.96:0/2486030741 learned_addr learned my addr 172.21.15.96:0/2486030741 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:53:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c695ac700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 0x7f6c64106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c69dad700 1 -- 172.21.15.96:0/2486030741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 msgr2=0x7f6c64106430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c69dad700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 0x7f6c64106430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c69dad700 1 -- 172.21.15.96:0/2486030741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60005040 con 0x7f6c640f5bb0 2022-02-02T22:53:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c69dad700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 secure :-1 s=READY pgs=4160 cs=0 l=1 rev1=1 rx=0x7f6c60009d80 tx=0x7f6c60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c60018070 con 0x7f6c640f5bb0 2022-02-02T22:53:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c60007ba0 con 0x7f6c640f5bb0 2022-02-02T22:53:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c64107460 con 0x7f6c640f5bb0 2022-02-02T22:53:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6001c620 con 0x7f6c640f5bb0 2022-02-02T22:53:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.647+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641079c0 con 0x7f6c640f5bb0 2022-02-02T22:53:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.648+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c64045ad0 con 0x7f6c640f5bb0 2022-02-02T22:53:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.648+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c6001d420 con 0x7f6c640f5bb0 2022-02-02T22:53:29.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.649+0000 7f6c5a7fc700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 0x7f6c50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:29.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.649+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6c60083880 con 0x7f6c640f5bb0 2022-02-02T22:53:29.658 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.649+0000 7f6c695ac700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 0x7f6c50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:29.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.649+0000 7f6c695ac700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 0x7f6c50067290 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7f6c540049e0 tx=0x7f6c54009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:29.659 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.653+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c60055410 con 0x7f6c640f5bb0 2022-02-02T22:53:29.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.854+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c64027a00 con 0x7f6c640f5bb0 2022-02-02T22:53:29.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.854+0000 7f6c5a7fc700 1 -- 172.21.15.96:0/2486030741 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6c60055000 con 0x7f6c640f5bb0 2022-02-02T22:53:29.855 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:53:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:53:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:53:29.856 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:53:29.857 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:53:29.857 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:53:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:53:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:53:29.858 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:53:29.859 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:53:29.859 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:53:29.859 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:53:29.860 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:53:29.860 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:53:29.861 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:53:29.861 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:53:29.861 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:53:29.862 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:53:29.862 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:53:29.862 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:53:29.863 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:53:29.863 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:53:29.863 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:53:29.864 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:53:29.864 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:53:29.864 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:53:29.865 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:53:29.865 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:53:29.865 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:53:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:53:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:53:29.867 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:53:29.867 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:53:29.867 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:53:29.868 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:53:29.868 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:53:29.868 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:53:29.868 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:53:29.869 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:53:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 msgr2=0x7f6c50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 0x7f6c50067290 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7f6c540049e0 tx=0x7f6c54009040).stop 2022-02-02T22:53:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 msgr2=0x7f6c64105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 secure :-1 s=READY pgs=4160 cs=0 l=1 rev1=1 rx=0x7f6c60009d80 tx=0x7f6c60009b30).stop 2022-02-02T22:53:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 shutdown_connections 2022-02-02T22:53:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6c50064dd0 0x7f6c50067290 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c640f5bb0 0x7f6c64105f40 unknown :-1 s=CLOSED pgs=4160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 --2- 172.21.15.96:0/2486030741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c640f6550 0x7f6c64106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 >> 172.21.15.96:0/2486030741 conn(0x7f6c640f04c0 msgr2=0x7f6c640fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 shutdown_connections 2022-02-02T22:53:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:29.856+0000 7f6c6c011700 1 -- 172.21.15.96:0/2486030741 wait complete. 2022-02-02T22:53:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:53:30.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:29 smithi096 ceph-mon[101353]: from='client.42434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:53:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/46875390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:53:30.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:29 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2486030741' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:53:30.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:29 smithi159 ceph-mon[69013]: from='client.42434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:53:30.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/46875390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:53:30.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:29 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2486030741' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:53:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:30 smithi159 ceph-mon[69013]: from='client.42438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:53:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:30 smithi159 ceph-mon[69013]: pgmap v8141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:30 smithi096 ceph-mon[101353]: from='client.42438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:53:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:30 smithi096 ceph-mon[101353]: pgmap v8141: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:32 smithi096 ceph-mon[101353]: pgmap v8142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:32 smithi159 ceph-mon[69013]: pgmap v8142: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:34 smithi159 ceph-mon[69013]: pgmap v8143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:34 smithi096 ceph-mon[101353]: pgmap v8143: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:36 smithi159 ceph-mon[69013]: pgmap v8144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:36 smithi096 ceph-mon[101353]: pgmap v8144: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:38 smithi159 ceph-mon[69013]: pgmap v8145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:38 smithi096 ceph-mon[101353]: pgmap v8145: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:40 smithi159 ceph-mon[69013]: pgmap v8146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:40 smithi096 ceph-mon[101353]: pgmap v8146: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:42 smithi096 ceph-mon[101353]: pgmap v8147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:42 smithi159 ceph-mon[69013]: pgmap v8147: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:44 smithi159 ceph-mon[69013]: pgmap v8148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:44 smithi096 ceph-mon[101353]: pgmap v8148: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:46 smithi159 ceph-mon[69013]: pgmap v8149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:46 smithi096 ceph-mon[101353]: pgmap v8149: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:48 smithi159 ceph-mon[69013]: pgmap v8150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:48 smithi096 ceph-mon[101353]: pgmap v8150: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:50 smithi159 ceph-mon[69013]: pgmap v8151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:50 smithi096 ceph-mon[101353]: pgmap v8151: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:52 smithi096 ceph-mon[101353]: pgmap v8152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:52 smithi159 ceph-mon[69013]: pgmap v8152: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:54 smithi159 ceph-mon[69013]: pgmap v8153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:54 smithi096 ceph-mon[101353]: pgmap v8153: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:56 smithi159 ceph-mon[69013]: pgmap v8154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:56 smithi096 ceph-mon[101353]: pgmap v8154: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:53:58 smithi159 ceph-mon[69013]: pgmap v8155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:59.327 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:53:58 smithi096 ceph-mon[101353]: pgmap v8155: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:53:59.966 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 -- 172.21.15.96:0/3308882989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f55c0 msgr2=0x7fe0fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:59.967 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 --2- 172.21.15.96:0/3308882989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc0f59e0 secure :-1 s=READY pgs=4161 cs=0 l=1 rev1=1 rx=0x7fe0f0004660 tx=0x7fe0f0009b30).stop 2022-02-02T22:53:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 -- 172.21.15.96:0/3308882989 shutdown_connections 2022-02-02T22:53:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 --2- 172.21.15.96:0/3308882989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:59.968 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 --2- 172.21.15.96:0/3308882989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc0f59e0 unknown :-1 s=CLOSED pgs=4161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 -- 172.21.15.96:0/3308882989 >> 172.21.15.96:0/3308882989 conn(0x7fe0fc0f0d40 msgr2=0x7fe0fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:53:59.969 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 -- 172.21.15.96:0/3308882989 shutdown_connections 2022-02-02T22:53:59.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 -- 172.21.15.96:0/3308882989 wait complete. 2022-02-02T22:53:59.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.964+0000 7fe101b47700 1 Processor -- start 2022-02-02T22:53:59.970 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe101b47700 1 -- start start 2022-02-02T22:53:59.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe101b47700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:59.971 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe101b47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:59.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe101b47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0603c0 con 0x7fe0fc0f6860 2022-02-02T22:53:59.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe101b47700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc060500 con 0x7fe0fc0f55c0 2022-02-02T22:53:59.972 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:59.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51012/0 (socket says 172.21.15.96:51012) 2022-02-02T22:53:59.973 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 -- 172.21.15.96:0/1593848667 learned_addr learned my addr 172.21.15.96:0/1593848667 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:53:59.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0fb7fe700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:59.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 -- 172.21.15.96:0/1593848667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f55c0 msgr2=0x7fe0fc109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:53:59.974 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:53:59.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.965+0000 7fe0faffd700 1 -- 172.21.15.96:0/1593848667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f0005040 con 0x7fe0fc0f6860 2022-02-02T22:53:59.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe0faffd700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 secure :-1 s=READY pgs=4162 cs=0 l=1 rev1=1 rx=0x7fe0ec00c530 tx=0x7fe0ec007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:59.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0ec00f650 con 0x7fe0fc0f6860 2022-02-02T22:53:59.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc10c740 con 0x7fe0fc0f6860 2022-02-02T22:53:59.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc10ccd0 con 0x7fe0fc0f6860 2022-02-02T22:53:59.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0ec00fc60 con 0x7fe0fc0f6860 2022-02-02T22:53:59.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.966+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0ec012c20 con 0x7fe0fc0f6860 2022-02-02T22:53:59.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.967+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc045ad0 con 0x7fe0fc0f6860 2022-02-02T22:53:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.967+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0ec010070 con 0x7fe0fc0f6860 2022-02-02T22:53:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.968+0000 7fe0e3fff700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 0x7fe0e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:53:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.968+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe0ec081660 con 0x7fe0fc0f6860 2022-02-02T22:53:59.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.968+0000 7fe0fb7fe700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 0x7fe0e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:53:59.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.968+0000 7fe0fb7fe700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 0x7fe0e4067290 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7fe0f0013690 tx=0x7fe0f0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:53:59.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:53:59.972+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0ec0477d0 con 0x7fe0fc0f6860 2022-02-02T22:54:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.149+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0fc0fdef0 con 0x7fe0e4064dd0 2022-02-02T22:54:00.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.150+0000 7fe0e3fff700 1 -- 172.21.15.96:0/1593848667 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe0fc0fdef0 con 0x7fe0e4064dd0 2022-02-02T22:54:00.152 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 msgr2=0x7fe0e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 0x7fe0e4067290 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7fe0f0013690 tx=0x7fe0f0009b30).stop 2022-02-02T22:54:00.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 msgr2=0x7fe0fc10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.153 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 secure :-1 s=READY pgs=4162 cs=0 l=1 rev1=1 rx=0x7fe0ec00c530 tx=0x7fe0ec007e20).stop 2022-02-02T22:54:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 shutdown_connections 2022-02-02T22:54:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe0e4064dd0 0x7fe0e4067290 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 --2- 172.21.15.96:0/1593848667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10c190 unknown :-1 s=CLOSED pgs=4162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 >> 172.21.15.96:0/1593848667 conn(0x7fe0fc0f0d40 msgr2=0x7fe0fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.155 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.152+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 shutdown_connections 2022-02-02T22:54:00.156 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.153+0000 7fe101b47700 1 -- 172.21.15.96:0/1593848667 wait complete. 2022-02-02T22:54:00.162 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:54:00.253 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 -- 172.21.15.96:0/2801040706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f5ef0 msgr2=0x7f9bb80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/2801040706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb80f6920 secure :-1 s=READY pgs=4163 cs=0 l=1 rev1=1 rx=0x7f9bb4004660 tx=0x7f9bb4009b30).stop 2022-02-02T22:54:00.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 -- 172.21.15.96:0/2801040706 shutdown_connections 2022-02-02T22:54:00.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/2801040706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb80f6920 unknown :-1 s=CLOSED pgs=4163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/2801040706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f55e0 0x7f9bb80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:54:00.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 -- 172.21.15.96:0/2801040706 >> 172.21.15.96:0/2801040706 conn(0x7f9bb80f0de0 msgr2=0x7f9bb80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 -- 172.21.15.96:0/2801040706 shutdown_connections 2022-02-02T22:54:00.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.251+0000 7f9bbfa88700 1 -- 172.21.15.96:0/2801040706 wait complete. 2022-02-02T22:54:00.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 Processor -- start 2022-02-02T22:54:00.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 -- start start 2022-02-02T22:54:00.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8060590 con 0x7f9bb80f55e0 2022-02-02T22:54:00.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbfa88700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80606d0 con 0x7f9bb80f5ef0 2022-02-02T22:54:00.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51020/0 (socket says 172.21.15.96:51020) 2022-02-02T22:54:00.259 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 -- 172.21.15.96:0/464608904 learned_addr learned my addr 172.21.15.96:0/464608904 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:00.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd023700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.260 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 -- 172.21.15.96:0/464608904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f5ef0 msgr2=0x7f9bb810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 -- 172.21.15.96:0/464608904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4005040 con 0x7f9bb80f55e0 2022-02-02T22:54:00.261 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.252+0000 7f9bbd824700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 secure :-1 s=READY pgs=4164 cs=0 l=1 rev1=1 rx=0x7f9ba800b410 tx=0x7f9ba8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.253+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba80125f0 con 0x7f9bb80f55e0 2022-02-02T22:54:00.262 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.253+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ba800be30 con 0x7f9bb80f55e0 2022-02-02T22:54:00.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.253+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb810c7f0 con 0x7f9bb80f55e0 2022-02-02T22:54:00.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.253+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba8002a70 con 0x7f9bb80f55e0 2022-02-02T22:54:00.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.253+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb810cd80 con 0x7f9bb80f55e0 2022-02-02T22:54:00.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.254+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80f4a70 con 0x7f9bb80f55e0 2022-02-02T22:54:00.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.254+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ba800f030 con 0x7f9bb80f55e0 2022-02-02T22:54:00.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.254+0000 7f9bae7fc700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 0x7f9ba4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.255+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9ba8081e80 con 0x7f9bb80f55e0 2022-02-02T22:54:00.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.255+0000 7f9bbd023700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 0x7f9ba4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.255+0000 7f9bbd023700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 0x7f9ba4067290 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 rx=0x7f9bb4004630 tx=0x7f9bb4009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.259+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ba804ff80 con 0x7f9bb80f55e0 2022-02-02T22:54:00.432 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.432+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bb80fdec0 con 0x7f9ba4064dd0 2022-02-02T22:54:00.441 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.441+0000 7f9bae7fc700 1 -- 172.21.15.96:0/464608904 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9bb80fdec0 con 0x7f9ba4064dd0 2022-02-02T22:54:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:54:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:54:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:54:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:54:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:54:00.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:54:00.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:54:00.444 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:54:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:54:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:54:00.445 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:54:00.446 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:54:00.446 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:54:00.446 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:54:00.447 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:54:00.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:54:00.447 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:54:00.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:54:00.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:54:00.448 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:54:00.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:54:00.449 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:54:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 msgr2=0x7f9ba4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 0x7f9ba4067290 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 rx=0x7f9bb4004630 tx=0x7f9bb4009b30).stop 2022-02-02T22:54:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 msgr2=0x7f9bb8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 secure :-1 s=READY pgs=4164 cs=0 l=1 rev1=1 rx=0x7f9ba800b410 tx=0x7f9ba8006ef0).stop 2022-02-02T22:54:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 shutdown_connections 2022-02-02T22:54:00.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9ba4064dd0 0x7f9ba4067290 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bb80f55e0 0x7f9bb8109c90 unknown :-1 s=CLOSED pgs=4164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 --2- 172.21.15.96:0/464608904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bb80f5ef0 0x7f9bb810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 >> 172.21.15.96:0/464608904 conn(0x7f9bb80f0de0 msgr2=0x7f9bb80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 shutdown_connections 2022-02-02T22:54:00.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.443+0000 7f9bbfa88700 1 -- 172.21.15.96:0/464608904 wait complete. 2022-02-02T22:54:00.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 -- 172.21.15.96:0/2596575974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 msgr2=0x7f6e880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/2596575974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e880f6b00 secure :-1 s=READY pgs=4165 cs=0 l=1 rev1=1 rx=0x7f6e70004660 tx=0x7f6e70009b30).stop 2022-02-02T22:54:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 -- 172.21.15.96:0/2596575974 shutdown_connections 2022-02-02T22:54:00.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/2596575974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 0x7f6e880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/2596575974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e880f6b00 unknown :-1 s=CLOSED pgs=4165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 -- 172.21.15.96:0/2596575974 >> 172.21.15.96:0/2596575974 conn(0x7f6e880f1e40 msgr2=0x7f6e880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 -- 172.21.15.96:0/2596575974 shutdown_connections 2022-02-02T22:54:00.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.539+0000 7f6e8ca82700 1 -- 172.21.15.96:0/2596575974 wait complete. 2022-02-02T22:54:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 Processor -- start 2022-02-02T22:54:00.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 -- start start 2022-02-02T22:54:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 0x7f6e88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8806a380 con 0x7f6e880f66e0 2022-02-02T22:54:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8ca82700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8806a4c0 con 0x7f6e880f7980 2022-02-02T22:54:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51028/0 (socket says 172.21.15.96:51028) 2022-02-02T22:54:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e8659c700 1 -- 172.21.15.96:0/1942442527 learned_addr learned my addr 172.21.15.96:0/1942442527 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.540+0000 7f6e85d9b700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 0x7f6e88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e8659c700 1 -- 172.21.15.96:0/1942442527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 msgr2=0x7f6e88069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e8659c700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 0x7f6e88069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e8659c700 1 -- 172.21.15.96:0/1942442527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70005040 con 0x7f6e880f66e0 2022-02-02T22:54:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e8659c700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 secure :-1 s=READY pgs=4166 cs=0 l=1 rev1=1 rx=0x7f6e70013a70 tx=0x7f6e70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e70018070 con 0x7f6e880f66e0 2022-02-02T22:54:00.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e700097d0 con 0x7f6e880f66e0 2022-02-02T22:54:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.541+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7001de80 con 0x7f6e880f66e0 2022-02-02T22:54:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.544+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8806a740 con 0x7f6e880f66e0 2022-02-02T22:54:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.544+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8806ac20 con 0x7f6e880f66e0 2022-02-02T22:54:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.545+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e88045ad0 con 0x7f6e880f66e0 2022-02-02T22:54:00.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.545+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e70023020 con 0x7f6e880f66e0 2022-02-02T22:54:00.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.545+0000 7f6e7effd700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 0x7f6e74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.545+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6e70083060 con 0x7f6e880f66e0 2022-02-02T22:54:00.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.545+0000 7f6e85d9b700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 0x7f6e74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.546+0000 7f6e85d9b700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 0x7f6e74067290 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 rx=0x7f6e78004e20 tx=0x7f6e7800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.550+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e700512d0 con 0x7f6e880f66e0 2022-02-02T22:54:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.778+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6e880586e0 con 0x7f6e880f66e0 2022-02-02T22:54:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.778+0000 7f6e7effd700 1 -- 172.21.15.96:0/1942442527 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f6e700548f0 con 0x7f6e880f66e0 2022-02-02T22:54:00.779 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:54:00.780 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:54:00.780 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:54:00.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:54:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:54:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:00.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:54:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:54:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:00.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:54:00.783 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:54:00.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:00.783 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:54:00.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:54:00.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:54:00.784 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:54:00.785 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:54:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 msgr2=0x7f6e74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 0x7f6e74067290 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 rx=0x7f6e78004e20 tx=0x7f6e7800b040).stop 2022-02-02T22:54:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 msgr2=0x7f6e8806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 secure :-1 s=READY pgs=4166 cs=0 l=1 rev1=1 rx=0x7f6e70013a70 tx=0x7f6e70009b30).stop 2022-02-02T22:54:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 shutdown_connections 2022-02-02T22:54:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6e74064dd0 0x7f6e74067290 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880f66e0 0x7f6e8806b9a0 unknown :-1 s=CLOSED pgs=4166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 --2- 172.21.15.96:0/1942442527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e880f7980 0x7f6e88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 >> 172.21.15.96:0/1942442527 conn(0x7f6e880f1e40 msgr2=0x7f6e880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 shutdown_connections 2022-02-02T22:54:00.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.780+0000 7f6e8ca82700 1 -- 172.21.15.96:0/1942442527 wait complete. 2022-02-02T22:54:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 -- 172.21.15.96:0/3959401456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 msgr2=0x7f4cfc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3959401456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc0f5850 secure :-1 s=READY pgs=4167 cs=0 l=1 rev1=1 rx=0x7f4cf8004660 tx=0x7f4cf8009b30).stop 2022-02-02T22:54:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 -- 172.21.15.96:0/3959401456 shutdown_connections 2022-02-02T22:54:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3959401456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:54:00.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3959401456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc0f5850 unknown :-1 s=CLOSED pgs=4167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 -- 172.21.15.96:0/3959401456 >> 172.21.15.96:0/3959401456 conn(0x7f4cfc0f0b90 msgr2=0x7f4cfc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 -- 172.21.15.96:0/3959401456 shutdown_connections 2022-02-02T22:54:00.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.878+0000 7f4d02a01700 1 -- 172.21.15.96:0/3959401456 wait complete. 2022-02-02T22:54:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 Processor -- start 2022-02-02T22:54:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 -- start start 2022-02-02T22:54:00.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc106880 con 0x7f4cfc0f5430 2022-02-02T22:54:00.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d02a01700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc106ff0 con 0x7f4cfc0f66d0 2022-02-02T22:54:00.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51038/0 (socket says 172.21.15.96:51038) 2022-02-02T22:54:00.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 -- 172.21.15.96:0/3325818950 learned_addr learned my addr 172.21.15.96:0/3325818950 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:00.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d011fe700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 -- 172.21.15.96:0/3325818950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 msgr2=0x7f4cfc106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 -- 172.21.15.96:0/3325818950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8005040 con 0x7f4cfc0f5430 2022-02-02T22:54:00.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d011fe700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:54:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.879+0000 7f4d019ff700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 secure :-1 s=READY pgs=4168 cs=0 l=1 rev1=1 rx=0x7f4cf8004f60 tx=0x7f4cf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.880+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf8018070 con 0x7f4cfc0f5430 2022-02-02T22:54:00.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.880+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cf8007ba0 con 0x7f4cfc0f5430 2022-02-02T22:54:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.880+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc107270 con 0x7f4cfc0f5430 2022-02-02T22:54:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.880+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf801c620 con 0x7f4cfc0f5430 2022-02-02T22:54:00.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.880+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc1077d0 con 0x7f4cfc0f5430 2022-02-02T22:54:00.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.881+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc045ad0 con 0x7f4cfc0f5430 2022-02-02T22:54:00.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.881+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cf801d420 con 0x7f4cfc0f5430 2022-02-02T22:54:00.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.881+0000 7f4cee7fc700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 0x7f4ce80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.881+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4cf80838a0 con 0x7f4cfc0f5430 2022-02-02T22:54:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.882+0000 7f4d011fe700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 0x7f4ce80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.882+0000 7f4d011fe700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 0x7f4ce80672e0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 rx=0x7f4cf000b830 tx=0x7f4cf0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:00.886+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cf80553d0 con 0x7f4cfc0f5430 2022-02-02T22:54:01.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.087+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4cfc0fdc70 con 0x7f4cfc0f5430 2022-02-02T22:54:01.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.088+0000 7f4cee7fc700 1 -- 172.21.15.96:0/3325818950 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f4cf8054fc0 con 0x7f4cfc0f5430 2022-02-02T22:54:01.088 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:54:01.089 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:54:01.089 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:54:01.090 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:54:01.090 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:01.090 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:54:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:54:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:54:01.091 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:54:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:54:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:54:01.092 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:54:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:54:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:54:01.093 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:54:01.094 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:54:01.094 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:54:01.094 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:54:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:54:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:54:01.095 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:54:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:54:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:54:01.096 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:54:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:54:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:54:01.097 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:54:01.098 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:54:01.098 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:54:01.098 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:54:01.099 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:54:01.099 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:54:01.099 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:01.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:01.100 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:54:01.100 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:01.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:01.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:01.101 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:01.102 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 msgr2=0x7f4ce80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 0x7f4ce80672e0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 rx=0x7f4cf000b830 tx=0x7f4cf0008040).stop 2022-02-02T22:54:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 msgr2=0x7f4cfc105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:01.103 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 secure :-1 s=READY pgs=4168 cs=0 l=1 rev1=1 rx=0x7f4cf8004f60 tx=0x7f4cf8009b30).stop 2022-02-02T22:54:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 shutdown_connections 2022-02-02T22:54:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4ce8064e20 0x7f4ce80672e0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:01.104 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cfc0f5430 0x7f4cfc105d50 unknown :-1 s=CLOSED pgs=4168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 --2- 172.21.15.96:0/3325818950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cfc0f66d0 0x7f4cfc106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.089+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 >> 172.21.15.96:0/3325818950 conn(0x7f4cfc0f0b90 msgr2=0x7f4cfc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:01.105 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.090+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 shutdown_connections 2022-02-02T22:54:01.106 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:01.090+0000 7f4d02a01700 1 -- 172.21.15.96:0/3325818950 wait complete. 2022-02-02T22:54:01.106 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:54:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:00 smithi159 ceph-mon[69013]: pgmap v8156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:00 smithi159 ceph-mon[69013]: from='client.42450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:01.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:00 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1942442527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:54:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:00 smithi096 ceph-mon[101353]: pgmap v8156: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:00 smithi096 ceph-mon[101353]: from='client.42450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:01.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:00 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1942442527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:54:02.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:01 smithi159 ceph-mon[69013]: from='client.42454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:02.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:01 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3325818950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:54:02.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:01 smithi096 ceph-mon[101353]: from='client.42454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:02.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:01 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3325818950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:54:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:02 smithi096 ceph-mon[101353]: pgmap v8157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:02 smithi159 ceph-mon[69013]: pgmap v8157: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:04 smithi159 ceph-mon[69013]: pgmap v8158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:04 smithi096 ceph-mon[101353]: pgmap v8158: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:06 smithi159 ceph-mon[69013]: pgmap v8159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:06 smithi096 ceph-mon[101353]: pgmap v8159: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:08 smithi159 ceph-mon[69013]: pgmap v8160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:08 smithi096 ceph-mon[101353]: pgmap v8160: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:10 smithi159 ceph-mon[69013]: pgmap v8161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:10 smithi096 ceph-mon[101353]: pgmap v8161: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:12 smithi096 ceph-mon[101353]: pgmap v8162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:12 smithi159 ceph-mon[69013]: pgmap v8162: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:14 smithi159 ceph-mon[69013]: pgmap v8163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:14 smithi096 ceph-mon[101353]: pgmap v8163: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:16 smithi159 ceph-mon[69013]: pgmap v8164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:16 smithi096 ceph-mon[101353]: pgmap v8164: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:18 smithi159 ceph-mon[69013]: pgmap v8165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:18 smithi096 ceph-mon[101353]: pgmap v8165: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:20 smithi159 ceph-mon[69013]: pgmap v8166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:20 smithi096 ceph-mon[101353]: pgmap v8166: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:22 smithi096 ceph-mon[101353]: pgmap v8167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:22 smithi159 ceph-mon[69013]: pgmap v8167: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:24 smithi159 ceph-mon[69013]: pgmap v8168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:24 smithi096 ceph-mon[101353]: pgmap v8168: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:26 smithi159 ceph-mon[69013]: pgmap v8169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:26 smithi096 ceph-mon[101353]: pgmap v8169: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:54:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:27 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:54:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:54:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:27 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:54:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:28 smithi159 ceph-mon[69013]: pgmap v8170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:28 smithi096 ceph-mon[101353]: pgmap v8170: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:31.201 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 -- 172.21.15.96:0/702831560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 msgr2=0x7f0cc80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/702831560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc80f6b30 secure :-1 s=READY pgs=4169 cs=0 l=1 rev1=1 rx=0x7f0cb8004660 tx=0x7f0cb8009b30).stop 2022-02-02T22:54:31.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 -- 172.21.15.96:0/702831560 shutdown_connections 2022-02-02T22:54:31.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/702831560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc80f6b30 unknown :-1 s=CLOSED pgs=4169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/702831560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 -- 172.21.15.96:0/702831560 >> 172.21.15.96:0/702831560 conn(0x7f0cc80f0b90 msgr2=0x7f0cc80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:31.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 -- 172.21.15.96:0/702831560 shutdown_connections 2022-02-02T22:54:31.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 -- 172.21.15.96:0/702831560 wait complete. 2022-02-02T22:54:31.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.199+0000 7f0ccd28a700 1 Processor -- start 2022-02-02T22:54:31.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0ccd28a700 1 -- start start 2022-02-02T22:54:31.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0ccd28a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0ccd28a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0ccd28a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80603e0 con 0x7f0cc80f66d0 2022-02-02T22:54:31.206 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0ccd28a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8060520 con 0x7f0cc80f5430 2022-02-02T22:54:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.207 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51058/0 (socket says 172.21.15.96:51058) 2022-02-02T22:54:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 -- 172.21.15.96:0/1641028237 learned_addr learned my addr 172.21.15.96:0/1641028237 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc7fff700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.208 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 -- 172.21.15.96:0/1641028237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 msgr2=0x7f0cc8109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.200+0000 7f0cc77fe700 1 -- 172.21.15.96:0/1641028237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8005040 con 0x7f0cc80f66d0 2022-02-02T22:54:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0cc77fe700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 secure :-1 s=READY pgs=4170 cs=0 l=1 rev1=1 rx=0x7f0cb8009990 tx=0x7f0cb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb8018070 con 0x7f0cc80f66d0 2022-02-02T22:54:31.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc810c470 con 0x7f0cc80f66d0 2022-02-02T22:54:31.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cb8007ba0 con 0x7f0cc80f66d0 2022-02-02T22:54:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb801c620 con 0x7f0cc80f66d0 2022-02-02T22:54:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.201+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc810c9d0 con 0x7f0cc80f66d0 2022-02-02T22:54:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.202+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8045ad0 con 0x7f0cc80f66d0 2022-02-02T22:54:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.202+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0cb801c8e0 con 0x7f0cc80f66d0 2022-02-02T22:54:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.203+0000 7f0cc4ff9700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 0x7f0cb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.203+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0cb8083850 con 0x7f0cc80f66d0 2022-02-02T22:54:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.203+0000 7f0cc7fff700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 0x7f0cb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.203+0000 7f0cc7fff700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 0x7f0cb00672e0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 rx=0x7f0cc8060060 tx=0x7f0cbc009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.207+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0cb8051950 con 0x7f0cc80f66d0 2022-02-02T22:54:31.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:30 smithi159 ceph-mon[69013]: pgmap v8171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:30 smithi096 ceph-mon[101353]: pgmap v8171: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:31.389 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.388+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cc80008d0 con 0x7f0cb0064e20 2022-02-02T22:54:31.390 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.389+0000 7f0cc4ff9700 1 -- 172.21.15.96:0/1641028237 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0cc80008d0 con 0x7f0cb0064e20 2022-02-02T22:54:31.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 msgr2=0x7f0cb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.392 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 0x7f0cb00672e0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 rx=0x7f0cc8060060 tx=0x7f0cbc009040).stop 2022-02-02T22:54:31.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 msgr2=0x7f0cc810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 secure :-1 s=READY pgs=4170 cs=0 l=1 rev1=1 rx=0x7f0cb8009990 tx=0x7f0cb8009b30).stop 2022-02-02T22:54:31.393 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 shutdown_connections 2022-02-02T22:54:31.394 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0cb0064e20 0x7f0cb00672e0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cc80f5430 0x7f0cc8109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.395 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 --2- 172.21.15.96:0/1641028237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cc80f66d0 0x7f0cc810bf20 unknown :-1 s=CLOSED pgs=4170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 >> 172.21.15.96:0/1641028237 conn(0x7f0cc80f0b90 msgr2=0x7f0cc80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 shutdown_connections 2022-02-02T22:54:31.396 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.391+0000 7f0ccd28a700 1 -- 172.21.15.96:0/1641028237 wait complete. 2022-02-02T22:54:31.402 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:54:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 -- 172.21.15.96:0/1960660174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 msgr2=0x7fa3500f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 --2- 172.21.15.96:0/1960660174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa3500f5df0 secure :-1 s=READY pgs=4171 cs=0 l=1 rev1=1 rx=0x7fa34c004660 tx=0x7fa34c009b30).stop 2022-02-02T22:54:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 -- 172.21.15.96:0/1960660174 shutdown_connections 2022-02-02T22:54:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 --2- 172.21.15.96:0/1960660174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa3500f5df0 unknown :-1 s=CLOSED pgs=4171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 --2- 172.21.15.96:0/1960660174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa3500f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 -- 172.21.15.96:0/1960660174 >> 172.21.15.96:0/1960660174 conn(0x7fa3500f04c0 msgr2=0x7fa3500f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 -- 172.21.15.96:0/1960660174 shutdown_connections 2022-02-02T22:54:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.489+0000 7fa35818d700 1 -- 172.21.15.96:0/1960660174 wait complete. 2022-02-02T22:54:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 Processor -- start 2022-02-02T22:54:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 -- start start 2022-02-02T22:54:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa35010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500f5620 con 0x7fa3500f5970 2022-02-02T22:54:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa35818d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500f5760 con 0x7fa3500f6c60 2022-02-02T22:54:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51066/0 (socket says 172.21.15.96:51066) 2022-02-02T22:54:31.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 -- 172.21.15.96:0/431649914 learned_addr learned my addr 172.21.15.96:0/431649914 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:31.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355728700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa35010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 -- 172.21.15.96:0/431649914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 msgr2=0x7fa35010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa35010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 -- 172.21.15.96:0/431649914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c005040 con 0x7fa3500f5970 2022-02-02T22:54:31.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355728700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa35010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:54:31.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.490+0000 7fa355f29700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 secure :-1 s=READY pgs=4172 cs=0 l=1 rev1=1 rx=0x7fa3400026d0 tx=0x7fa340009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.491+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa340009320 con 0x7fa3500f5970 2022-02-02T22:54:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.491+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa34000f040 con 0x7fa3500f5970 2022-02-02T22:54:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.491+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35010c780 con 0x7fa3500f5970 2022-02-02T22:54:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.491+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3400147e0 con 0x7fa3500f5970 2022-02-02T22:54:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.491+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35010cd40 con 0x7fa3500f5970 2022-02-02T22:54:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.492+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa350045ad0 con 0x7fa3500f5970 2022-02-02T22:54:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.492+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa340009480 con 0x7fa3500f5970 2022-02-02T22:54:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.493+0000 7fa3467fc700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 0x7fa33c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.493+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa340082070 con 0x7fa3500f5970 2022-02-02T22:54:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.493+0000 7fa355728700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 0x7fa33c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.493+0000 7fa355728700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 0x7fa33c067290 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 rx=0x7fa34c004630 tx=0x7fa34c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.497+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa340050170 con 0x7fa3500f5970 2022-02-02T22:54:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.669+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa350057f10 con 0x7fa33c064dd0 2022-02-02T22:54:31.679 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.678+0000 7fa3467fc700 1 -- 172.21.15.96:0/431649914 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa350057f10 con 0x7fa33c064dd0 2022-02-02T22:54:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:54:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:54:31.680 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:54:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:54:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:54:31.681 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:54:31.682 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:54:31.683 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:54:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:54:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:54:31.684 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:54:31.685 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:54:31.685 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:54:31.686 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:54:31.686 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:54:31.686 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:54:31.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:54:31.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:54:31.687 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:54:31.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:54:31.688 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:54:31.688 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:54:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.680+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 msgr2=0x7fa33c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.680+0000 7fa35818d700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 0x7fa33c067290 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 rx=0x7fa34c004630 tx=0x7fa34c009b30).stop 2022-02-02T22:54:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.680+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 msgr2=0x7fa350109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.680+0000 7fa35818d700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 secure :-1 s=READY pgs=4172 cs=0 l=1 rev1=1 rx=0x7fa3400026d0 tx=0x7fa340009de0).stop 2022-02-02T22:54:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 shutdown_connections 2022-02-02T22:54:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa33c064dd0 0x7fa33c067290 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3500f5970 0x7fa350109cd0 unknown :-1 s=CLOSED pgs=4172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 --2- 172.21.15.96:0/431649914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500f6c60 0x7fa35010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 >> 172.21.15.96:0/431649914 conn(0x7fa3500f04c0 msgr2=0x7fa3500fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 shutdown_connections 2022-02-02T22:54:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.681+0000 7fa35818d700 1 -- 172.21.15.96:0/431649914 wait complete. 2022-02-02T22:54:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 -- 172.21.15.96:0/3827806130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f66d0 msgr2=0x7faf500f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 --2- 172.21.15.96:0/3827806130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f66d0 0x7faf500f6b30 secure :-1 s=READY pgs=4173 cs=0 l=1 rev1=1 rx=0x7faf38004660 tx=0x7faf38009b30).stop 2022-02-02T22:54:31.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 -- 172.21.15.96:0/3827806130 shutdown_connections 2022-02-02T22:54:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 --2- 172.21.15.96:0/3827806130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f66d0 0x7faf500f6b30 unknown :-1 s=CLOSED pgs=4173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 --2- 172.21.15.96:0/3827806130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f5430 0x7faf500f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 -- 172.21.15.96:0/3827806130 >> 172.21.15.96:0/3827806130 conn(0x7faf500f0b90 msgr2=0x7faf500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 -- 172.21.15.96:0/3827806130 shutdown_connections 2022-02-02T22:54:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.778+0000 7faf553a0700 1 -- 172.21.15.96:0/3827806130 wait complete. 2022-02-02T22:54:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 Processor -- start 2022-02-02T22:54:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 -- start start 2022-02-02T22:54:31.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f66d0 0x7faf50107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50107890 con 0x7faf500f5430 2022-02-02T22:54:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf553a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf501080d0 con 0x7faf500f66d0 2022-02-02T22:54:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51076/0 (socket says 172.21.15.96:51076) 2022-02-02T22:54:31.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 -- 172.21.15.96:0/1795854311 learned_addr learned my addr 172.21.15.96:0/1795854311 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4f7fe700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f66d0 0x7faf50107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 -- 172.21.15.96:0/1795854311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f66d0 msgr2=0x7faf50107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f66d0 0x7faf50107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.779+0000 7faf4ffff700 1 -- 172.21.15.96:0/1795854311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38005040 con 0x7faf500f5430 2022-02-02T22:54:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf4ffff700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 secure :-1 s=READY pgs=4174 cs=0 l=1 rev1=1 rx=0x7faf4000c530 tx=0x7faf40007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4000f650 con 0x7faf500f5430 2022-02-02T22:54:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf4000fc60 con 0x7faf500f5430 2022-02-02T22:54:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf501083b0 con 0x7faf500f5430 2022-02-02T22:54:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf40012cb0 con 0x7faf500f5430 2022-02-02T22:54:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.780+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf501088f0 con 0x7faf500f5430 2022-02-02T22:54:31.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.781+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf50059100 con 0x7faf500f5430 2022-02-02T22:54:31.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.781+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf40019030 con 0x7faf500f5430 2022-02-02T22:54:31.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.782+0000 7faf4cff9700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 0x7faf3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:31.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.782+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faf40081530 con 0x7faf500f5430 2022-02-02T22:54:31.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.782+0000 7faf4f7fe700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 0x7faf3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:31.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.782+0000 7faf4f7fe700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 0x7faf3c0672e0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7faf38004630 tx=0x7faf38009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:31.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:31.786+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf400487d0 con 0x7faf500f5430 2022-02-02T22:54:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.016+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faf5010d410 con 0x7faf500f5430 2022-02-02T22:54:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.016+0000 7faf4cff9700 1 -- 172.21.15.96:0/1795854311 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7faf400172e0 con 0x7faf500f5430 2022-02-02T22:54:32.018 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:54:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:54:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:54:32.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:32.020 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:54:32.020 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:54:32.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:54:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:54:32.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:32.022 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:54:32.022 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:54:32.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:54:32.023 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:54:32.023 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:54:32.023 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:54:32.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:54:32.024 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:54:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 msgr2=0x7faf3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 0x7faf3c0672e0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7faf38004630 tx=0x7faf38009b30).stop 2022-02-02T22:54:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 msgr2=0x7faf50106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 secure :-1 s=READY pgs=4174 cs=0 l=1 rev1=1 rx=0x7faf4000c530 tx=0x7faf40007e10).stop 2022-02-02T22:54:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 shutdown_connections 2022-02-02T22:54:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7faf3c064e20 0x7faf3c0672e0 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf500f5430 0x7faf50106da0 unknown :-1 s=CLOSED pgs=4174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 --2- 172.21.15.96:0/1795854311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf500f66d0 0x7faf50107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 >> 172.21.15.96:0/1795854311 conn(0x7faf500f0b90 msgr2=0x7faf5005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:32.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 shutdown_connections 2022-02-02T22:54:32.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.019+0000 7faf553a0700 1 -- 172.21.15.96:0/1795854311 wait complete. 2022-02-02T22:54:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 -- 172.21.15.96:0/574960269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f6860 msgr2=0x7f922c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 --2- 172.21.15.96:0/574960269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f6860 0x7f922c0f6cc0 secure :-1 s=READY pgs=4175 cs=0 l=1 rev1=1 rx=0x7f9220004660 tx=0x7f9220009b30).stop 2022-02-02T22:54:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 -- 172.21.15.96:0/574960269 shutdown_connections 2022-02-02T22:54:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 --2- 172.21.15.96:0/574960269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f6860 0x7f922c0f6cc0 unknown :-1 s=CLOSED pgs=4175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 --2- 172.21.15.96:0/574960269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f55c0 0x7f922c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 -- 172.21.15.96:0/574960269 >> 172.21.15.96:0/574960269 conn(0x7f922c0f0d40 msgr2=0x7f922c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 -- 172.21.15.96:0/574960269 shutdown_connections 2022-02-02T22:54:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.116+0000 7f9231b19700 1 -- 172.21.15.96:0/574960269 wait complete. 2022-02-02T22:54:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 Processor -- start 2022-02-02T22:54:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 -- start start 2022-02-02T22:54:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:32.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 0x7f922c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0603e0 con 0x7f922c0f55c0 2022-02-02T22:54:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f9231b19700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c060520 con 0x7f922c0f6860 2022-02-02T22:54:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f922b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f922b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51090/0 (socket says 172.21.15.96:51090) 2022-02-02T22:54:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f922b7fe700 1 -- 172.21.15.96:0/3331783640 learned_addr learned my addr 172.21.15.96:0/3331783640 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:54:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.117+0000 7f922affd700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 0x7f922c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:32.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f922b7fe700 1 -- 172.21.15.96:0/3331783640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 msgr2=0x7f922c10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f922b7fe700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 0x7f922c10c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f922b7fe700 1 -- 172.21.15.96:0/3331783640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220005040 con 0x7f922c0f55c0 2022-02-02T22:54:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f922affd700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 0x7f922c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:54:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f922b7fe700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 secure :-1 s=READY pgs=4176 cs=0 l=1 rev1=1 rx=0x7f921c002700 tx=0x7f921c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921c009320 con 0x7f922c0f55c0 2022-02-02T22:54:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c10c700 con 0x7f922c0f55c0 2022-02-02T22:54:32.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f921c00f040 con 0x7f922c0f55c0 2022-02-02T22:54:32.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921c014900 con 0x7f922c0f55c0 2022-02-02T22:54:32.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.118+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c10ccc0 con 0x7f922c0f55c0 2022-02-02T22:54:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.119+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c045ad0 con 0x7f922c0f55c0 2022-02-02T22:54:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.119+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f921c009480 con 0x7f922c0f55c0 2022-02-02T22:54:32.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.120+0000 7f9213fff700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 0x7f9214067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:54:32.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.120+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f921c081d80 con 0x7f922c0f55c0 2022-02-02T22:54:32.132 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.120+0000 7f922affd700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 0x7f9214067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:54:32.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.120+0000 7f922affd700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 0x7f9214067290 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 rx=0x7f9220004630 tx=0x7f9220009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:54:32.133 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.124+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f921c04fe80 con 0x7f922c0f55c0 2022-02-02T22:54:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.330+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f922c0fde50 con 0x7f922c0f55c0 2022-02-02T22:54:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.331+0000 7f9213fff700 1 -- 172.21.15.96:0/3331783640 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f921c0534a0 con 0x7f922c0f55c0 2022-02-02T22:54:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:54:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:54:32.333 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:54:32.334 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:54:32.334 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:32.334 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:54:32.335 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:54:32.335 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:54:32.336 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:54:32.336 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:54:32.336 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:54:32.337 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:54:32.337 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:54:32.337 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:54:32.338 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:54:32.338 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:54:32.338 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:54:32.339 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:54:32.339 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:54:32.339 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:54:32.340 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:54:32.340 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:54:32.341 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:54:32.341 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:54:32.341 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:54:32.342 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:54:32.342 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:54:32.342 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:54:32.343 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:54:32.343 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:54:32.343 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:54:32.344 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:54:32.344 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:32.344 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:32.345 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:54:32.345 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:54:32.345 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:32.346 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:32.346 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:54:32.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 msgr2=0x7f9214067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 0x7f9214067290 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 rx=0x7f9220004630 tx=0x7f9220009b30).stop 2022-02-02T22:54:32.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 msgr2=0x7f922c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:54:32.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 secure :-1 s=READY pgs=4176 cs=0 l=1 rev1=1 rx=0x7f921c002700 tx=0x7f921c009d80).stop 2022-02-02T22:54:32.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 shutdown_connections 2022-02-02T22:54:32.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9214064dd0 0x7f9214067290 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f922c0f55c0 0x7f922c109c50 unknown :-1 s=CLOSED pgs=4176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 --2- 172.21.15.96:0/3331783640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f922c0f6860 0x7f922c10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:54:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 >> 172.21.15.96:0/3331783640 conn(0x7f922c0f0d40 msgr2=0x7f922c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:54:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 shutdown_connections 2022-02-02T22:54:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:54:32.334+0000 7f9231b19700 1 -- 172.21.15.96:0/3331783640 wait complete. 2022-02-02T22:54:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:54:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:33 smithi159 ceph-mon[69013]: from='client.42466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:33 smithi159 ceph-mon[69013]: pgmap v8172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:33 smithi159 ceph-mon[69013]: from='client.42470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1795854311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:54:33.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:33 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3331783640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:54:33.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:33 smithi096 ceph-mon[101353]: from='client.42466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:33.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:33 smithi096 ceph-mon[101353]: pgmap v8172: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:33.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:33 smithi096 ceph-mon[101353]: from='client.42470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:54:33.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1795854311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:54:33.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:33 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3331783640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:54:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:35 smithi159 ceph-mon[69013]: pgmap v8173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:35.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:35 smithi096 ceph-mon[101353]: pgmap v8173: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:37 smithi159 ceph-mon[69013]: pgmap v8174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:37 smithi096 ceph-mon[101353]: pgmap v8174: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:39 smithi159 ceph-mon[69013]: pgmap v8175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:39 smithi096 ceph-mon[101353]: pgmap v8175: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:41 smithi159 ceph-mon[69013]: pgmap v8176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:41 smithi096 ceph-mon[101353]: pgmap v8176: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:43 smithi159 ceph-mon[69013]: pgmap v8177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:43.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:43 smithi096 ceph-mon[101353]: pgmap v8177: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:45 smithi159 ceph-mon[69013]: pgmap v8178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:46.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:45 smithi096 ceph-mon[101353]: pgmap v8178: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:47 smithi159 ceph-mon[69013]: pgmap v8179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:47 smithi096 ceph-mon[101353]: pgmap v8179: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:49 smithi096 ceph-mon[101353]: pgmap v8180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:49 smithi159 ceph-mon[69013]: pgmap v8180: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:51 smithi096 ceph-mon[101353]: pgmap v8181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:51 smithi159 ceph-mon[69013]: pgmap v8181: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:53.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:53 smithi096 ceph-mon[101353]: pgmap v8182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:53 smithi159 ceph-mon[69013]: pgmap v8182: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:55 smithi096 ceph-mon[101353]: pgmap v8183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:55 smithi159 ceph-mon[69013]: pgmap v8183: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:57 smithi096 ceph-mon[101353]: pgmap v8184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:57 smithi159 ceph-mon[69013]: pgmap v8184: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:54:59 smithi096 ceph-mon[101353]: pgmap v8185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:54:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:54:59 smithi159 ceph-mon[69013]: pgmap v8185: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:01 smithi096 ceph-mon[101353]: pgmap v8186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:01 smithi159 ceph-mon[69013]: pgmap v8186: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:02.442 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 -- 172.21.15.96:0/1410239565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f6860 msgr2=0x7f02d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 --2- 172.21.15.96:0/1410239565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f6860 0x7f02d80f6cc0 secure :-1 s=READY pgs=4177 cs=0 l=1 rev1=1 rx=0x7f02c0004660 tx=0x7f02c0009b30).stop 2022-02-02T22:55:02.443 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 -- 172.21.15.96:0/1410239565 shutdown_connections 2022-02-02T22:55:02.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 --2- 172.21.15.96:0/1410239565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f6860 0x7f02d80f6cc0 unknown :-1 s=CLOSED pgs=4177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 --2- 172.21.15.96:0/1410239565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f55c0 0x7f02d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.444 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 -- 172.21.15.96:0/1410239565 >> 172.21.15.96:0/1410239565 conn(0x7f02d80f0d40 msgr2=0x7f02d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:02.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 -- 172.21.15.96:0/1410239565 shutdown_connections 2022-02-02T22:55:02.445 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.442+0000 7f02dda09700 1 -- 172.21.15.96:0/1410239565 wait complete. 2022-02-02T22:55:02.448 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 Processor -- start 2022-02-02T22:55:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 -- start start 2022-02-02T22:55:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f6860 0x7f02d8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8107a10 con 0x7f02d80f55c0 2022-02-02T22:55:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02dda09700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8107b50 con 0x7f02d80f6860 2022-02-02T22:55:02.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51106/0 (socket says 172.21.15.96:51106) 2022-02-02T22:55:02.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 -- 172.21.15.96:0/2948060965 learned_addr learned my addr 172.21.15.96:0/2948060965 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d67fc700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f6860 0x7f02d8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 -- 172.21.15.96:0/2948060965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f6860 msgr2=0x7f02d8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f6860 0x7f02d8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.443+0000 7f02d6ffd700 1 -- 172.21.15.96:0/2948060965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0005040 con 0x7f02d80f55c0 2022-02-02T22:55:02.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02d6ffd700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 secure :-1 s=READY pgs=4178 cs=0 l=1 rev1=1 rx=0x7f02c8002700 tx=0x7f02c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:02.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c80079c0 con 0x7f02d80f55c0 2022-02-02T22:55:02.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02c800f040 con 0x7f02d80f55c0 2022-02-02T22:55:02.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c8014860 con 0x7f02d80f55c0 2022-02-02T22:55:02.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d81084f0 con 0x7f02d80f55c0 2022-02-02T22:55:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.444+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8108ab0 con 0x7f02d80f55c0 2022-02-02T22:55:02.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.445+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d8045ad0 con 0x7f02d80f55c0 2022-02-02T22:55:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.445+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f02c801b060 con 0x7f02d80f55c0 2022-02-02T22:55:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.445+0000 7f02cf7fe700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 0x7f02c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.446+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f02c8081900 con 0x7f02d80f55c0 2022-02-02T22:55:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.446+0000 7f02d67fc700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 0x7f02c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.446+0000 7f02d67fc700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 0x7f02c4067290 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f02c0004630 tx=0x7f02c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:02.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.450+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f02c8053430 con 0x7f02d80f55c0 2022-02-02T22:55:02.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.629+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02d80faca0 con 0x7f02c4064dd0 2022-02-02T22:55:02.631 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.630+0000 7f02cf7fe700 1 -- 172.21.15.96:0/2948060965 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02d80faca0 con 0x7f02c4064dd0 2022-02-02T22:55:02.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 msgr2=0x7f02c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 0x7f02c4067290 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f02c0004630 tx=0x7f02c0009b30).stop 2022-02-02T22:55:02.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 msgr2=0x7f02d8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 secure :-1 s=READY pgs=4178 cs=0 l=1 rev1=1 rx=0x7f02c8002700 tx=0x7f02c8009d80).stop 2022-02-02T22:55:02.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 shutdown_connections 2022-02-02T22:55:02.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f02c4064dd0 0x7f02c4067290 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d80f55c0 0x7f02d8106f70 unknown :-1 s=CLOSED pgs=4178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 --2- 172.21.15.96:0/2948060965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d80f6860 0x7f02d8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.632+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 >> 172.21.15.96:0/2948060965 conn(0x7f02d80f0d40 msgr2=0x7f02d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.633+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 shutdown_connections 2022-02-02T22:55:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.633+0000 7f02dda09700 1 -- 172.21.15.96:0/2948060965 wait complete. 2022-02-02T22:55:02.643 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:55:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 -- 172.21.15.96:0/220680932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 msgr2=0x7f1ae00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/220680932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f7ac0 secure :-1 s=READY pgs=4179 cs=0 l=1 rev1=1 rx=0x7f1ad4004660 tx=0x7f1ad4009b30).stop 2022-02-02T22:55:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 -- 172.21.15.96:0/220680932 shutdown_connections 2022-02-02T22:55:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/220680932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f7ac0 unknown :-1 s=CLOSED pgs=4179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/220680932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 -- 172.21.15.96:0/220680932 >> 172.21.15.96:0/220680932 conn(0x7f1ae00f04c0 msgr2=0x7f1ae00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.730+0000 7f1ae58c9700 1 -- 172.21.15.96:0/220680932 shutdown_connections 2022-02-02T22:55:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.731+0000 7f1ae58c9700 1 -- 172.21.15.96:0/220680932 wait complete. 2022-02-02T22:55:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 Processor -- start 2022-02-02T22:55:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 -- start start 2022-02-02T22:55:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00f5f30 con 0x7f1ae00f5340 2022-02-02T22:55:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ae58c9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00f6070 con 0x7f1ae00f49a0 2022-02-02T22:55:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51118/0 (socket says 172.21.15.96:51118) 2022-02-02T22:55:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 -- 172.21.15.96:0/1987952076 learned_addr learned my addr 172.21.15.96:0/1987952076 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1adeffd700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 -- 172.21.15.96:0/1987952076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 msgr2=0x7f1ae00f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 -- 172.21.15.96:0/1987952076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4005040 con 0x7f1ae00f5340 2022-02-02T22:55:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1adeffd700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:55:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.732+0000 7f1ade7fc700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 secure :-1 s=READY pgs=4180 cs=0 l=1 rev1=1 rx=0x7f1ad4014040 tx=0x7f1ad400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.733+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad4019070 con 0x7f1ae00f5340 2022-02-02T22:55:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.733+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00f62f0 con 0x7f1ae00f5340 2022-02-02T22:55:02.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.733+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae00f6850 con 0x7f1ae00f5340 2022-02-02T22:55:02.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.733+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ad4007e70 con 0x7f1ae00f5340 2022-02-02T22:55:02.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.733+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad4014d50 con 0x7f1ae00f5340 2022-02-02T22:55:02.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.734+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0045ad0 con 0x7f1ae00f5340 2022-02-02T22:55:02.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.734+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ad4025070 con 0x7f1ae00f5340 2022-02-02T22:55:02.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.735+0000 7f1ac77fe700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 0x7f1ac8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:02.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.735+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1ad4082a30 con 0x7f1ae00f5340 2022-02-02T22:55:02.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.735+0000 7f1adeffd700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 0x7f1ac8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:02.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.735+0000 7f1adeffd700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 0x7f1ac8067290 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 rx=0x7f1ad0009da0 tx=0x7f1ad000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:02.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.739+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ad4050b30 con 0x7f1ae00f5340 2022-02-02T22:55:02.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.911+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae00fefd0 con 0x7f1ac8064dd0 2022-02-02T22:55:02.920 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.920+0000 7f1ac77fe700 1 -- 172.21.15.96:0/1987952076 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1ae00fefd0 con 0x7f1ac8064dd0 2022-02-02T22:55:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:55:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:55:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:55:02.923 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:55:02.923 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:55:02.923 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:55:02.924 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:55:02.924 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:55:02.924 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:55:02.925 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:55:02.925 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:55:02.926 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:55:02.926 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:55:02.927 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:55:02.927 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:55:02.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:55:02.928 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:55:02.928 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:55:02.929 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:55:02.929 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:55:02.929 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:55:02.930 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:55:02.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 msgr2=0x7f1ac8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 0x7f1ac8067290 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 rx=0x7f1ad0009da0 tx=0x7f1ad000b040).stop 2022-02-02T22:55:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 msgr2=0x7f1ae00f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 secure :-1 s=READY pgs=4180 cs=0 l=1 rev1=1 rx=0x7f1ad4014040 tx=0x7f1ad400b040).stop 2022-02-02T22:55:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 shutdown_connections 2022-02-02T22:55:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1ac8064dd0 0x7f1ac8067290 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ae00f49a0 0x7f1ae00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 --2- 172.21.15.96:0/1987952076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ae00f5340 0x7f1ae00f59d0 unknown :-1 s=CLOSED pgs=4180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 >> 172.21.15.96:0/1987952076 conn(0x7f1ae00f04c0 msgr2=0x7f1ae00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:02.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 shutdown_connections 2022-02-02T22:55:02.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:02.922+0000 7f1ae58c9700 1 -- 172.21.15.96:0/1987952076 wait complete. 2022-02-02T22:55:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 -- 172.21.15.96:0/2015789883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 msgr2=0x7feea80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 --2- 172.21.15.96:0/2015789883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea80f7c30 secure :-1 s=READY pgs=4181 cs=0 l=1 rev1=1 rx=0x7fee98004660 tx=0x7fee98009b30).stop 2022-02-02T22:55:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 -- 172.21.15.96:0/2015789883 shutdown_connections 2022-02-02T22:55:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 --2- 172.21.15.96:0/2015789883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea80f7c30 unknown :-1 s=CLOSED pgs=4181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 --2- 172.21.15.96:0/2015789883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.020+0000 7feeae63d700 1 -- 172.21.15.96:0/2015789883 >> 172.21.15.96:0/2015789883 conn(0x7feea80f1c90 msgr2=0x7feea80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.021+0000 7feeae63d700 1 -- 172.21.15.96:0/2015789883 shutdown_connections 2022-02-02T22:55:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.021+0000 7feeae63d700 1 -- 172.21.15.96:0/2015789883 wait complete. 2022-02-02T22:55:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.021+0000 7feeae63d700 1 Processor -- start 2022-02-02T22:55:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.021+0000 7feeae63d700 1 -- start start 2022-02-02T22:55:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeae63d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeae63d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeae63d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8107880 con 0x7feea80f77d0 2022-02-02T22:55:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeae63d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8108090 con 0x7feea80f6530 2022-02-02T22:55:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeace3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeace3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51128/0 (socket says 172.21.15.96:51128) 2022-02-02T22:55:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feeace3a700 1 -- 172.21.15.96:0/3768591931 learned_addr learned my addr 172.21.15.96:0/3768591931 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:03.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feead63b700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feead63b700 1 -- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 msgr2=0x7feea8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feead63b700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.022+0000 7feead63b700 1 -- 172.21.15.96:0/3768591931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98005040 con 0x7feea80f6530 2022-02-02T22:55:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7feead63b700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea8106d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feea40026d0 tx=0x7feea4009ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea40079c0 con 0x7feea80f6530 2022-02-02T22:55:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea81082b0 con 0x7feea80f6530 2022-02-02T22:55:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feea400f040 con 0x7feea80f6530 2022-02-02T22:55:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea40147a0 con 0x7feea80f6530 2022-02-02T22:55:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.023+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea8108840 con 0x7feea80f6530 2022-02-02T22:55:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.024+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea8045ad0 con 0x7feea80f6530 2022-02-02T22:55:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.025+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feea401b060 con 0x7feea80f6530 2022-02-02T22:55:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.025+0000 7fee9dffb700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 0x7fee940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.025+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7feea40817b0 con 0x7feea80f6530 2022-02-02T22:55:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.025+0000 7feeace3a700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 0x7fee940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.025+0000 7feeace3a700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 0x7fee940672e0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7fee98013690 tx=0x7fee98009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:03.045 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.030+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feea404f8b0 con 0x7feea80f6530 2022-02-02T22:55:03.263 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.263+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feea80fee70 con 0x7feea80f6530 2022-02-02T22:55:03.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.264+0000 7fee9dffb700 1 -- 172.21.15.96:0/3768591931 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7feea40192e0 con 0x7feea80f6530 2022-02-02T22:55:03.265 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:55:03.265 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:55:03.265 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:55:03.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:03.266 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:55:03.266 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:55:03.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:03.267 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:55:03.268 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:55:03.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:03.268 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:55:03.269 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:55:03.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:03.270 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:55:03.270 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:55:03.271 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:55:03.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:55:03.271 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:55:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 msgr2=0x7fee940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 0x7fee940672e0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7fee98013690 tx=0x7fee98009b30).stop 2022-02-02T22:55:03.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 msgr2=0x7feea8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea8106d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feea40026d0 tx=0x7feea4009ce0).stop 2022-02-02T22:55:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 shutdown_connections 2022-02-02T22:55:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fee94064e20 0x7fee940672e0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea80f6530 0x7feea8106d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 --2- 172.21.15.96:0/3768591931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feea80f77d0 0x7feea8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 >> 172.21.15.96:0/3768591931 conn(0x7feea80f1c90 msgr2=0x7feea80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:03.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 shutdown_connections 2022-02-02T22:55:03.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.266+0000 7feeae63d700 1 -- 172.21.15.96:0/3768591931 wait complete. 2022-02-02T22:55:03.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:03 smithi096 ceph-mon[101353]: pgmap v8187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 -- 172.21.15.96:0/1215983756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 msgr2=0x7f68d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 --2- 172.21.15.96:0/1215983756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d40f6cc0 secure :-1 s=READY pgs=4182 cs=0 l=1 rev1=1 rx=0x7f68d0004660 tx=0x7f68d0009b30).stop 2022-02-02T22:55:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 -- 172.21.15.96:0/1215983756 shutdown_connections 2022-02-02T22:55:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 --2- 172.21.15.96:0/1215983756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d40f6cc0 unknown :-1 s=CLOSED pgs=4182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 --2- 172.21.15.96:0/1215983756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 -- 172.21.15.96:0/1215983756 >> 172.21.15.96:0/1215983756 conn(0x7f68d40f0d40 msgr2=0x7f68d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 -- 172.21.15.96:0/1215983756 shutdown_connections 2022-02-02T22:55:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.364+0000 7f68db895700 1 -- 172.21.15.96:0/1215983756 wait complete. 2022-02-02T22:55:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 Processor -- start 2022-02-02T22:55:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 -- start start 2022-02-02T22:55:03.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d4105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41069b0 con 0x7f68d40f6860 2022-02-02T22:55:03.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68db895700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41071c0 con 0x7f68d40f55c0 2022-02-02T22:55:03.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68d8e30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68d8e30700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51138/0 (socket says 172.21.15.96:51138) 2022-02-02T22:55:03.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68d8e30700 1 -- 172.21.15.96:0/338941987 learned_addr learned my addr 172.21.15.96:0/338941987 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:03.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.365+0000 7f68d9631700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d4105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68d8e30700 1 -- 172.21.15.96:0/338941987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 msgr2=0x7f68d4105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68d8e30700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d4105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68d8e30700 1 -- 172.21.15.96:0/338941987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0005040 con 0x7f68d40f6860 2022-02-02T22:55:03.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68d9631700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:55:03.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68d8e30700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 secure :-1 s=READY pgs=4183 cs=0 l=1 rev1=1 rx=0x7f68d0009990 tx=0x7f68d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:03.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d0018070 con 0x7f68d40f6860 2022-02-02T22:55:03.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68d0007ba0 con 0x7f68d40f6860 2022-02-02T22:55:03.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d41073e0 con 0x7f68d40f6860 2022-02-02T22:55:03.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d001c3c0 con 0x7f68d40f6860 2022-02-02T22:55:03.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.366+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d4107940 con 0x7f68d40f6860 2022-02-02T22:55:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.367+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d40f49b0 con 0x7f68d40f6860 2022-02-02T22:55:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.368+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68d001d420 con 0x7f68d40f6860 2022-02-02T22:55:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.368+0000 7f68c9ffb700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 0x7f68c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:03.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.368+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f68d0083760 con 0x7f68d40f6860 2022-02-02T22:55:03.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.368+0000 7f68d9631700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 0x7f68c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:03.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.369+0000 7f68d9631700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 0x7f68c0067290 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 rx=0x7f68d4105c30 tx=0x7f68c4009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:03.380 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.372+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68d0051800 con 0x7f68d40f6860 2022-02-02T22:55:03.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:03 smithi159 ceph-mon[69013]: pgmap v8187: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:03.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.574+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f68d40fdf10 con 0x7f68d40f6860 2022-02-02T22:55:03.575 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.574+0000 7f68c9ffb700 1 -- 172.21.15.96:0/338941987 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f68d40fdf10 con 0x7f68d40f6860 2022-02-02T22:55:03.576 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:55:03.576 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:55:03.576 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:55:03.577 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:55:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:03.577 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:55:03.578 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:55:03.578 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:55:03.578 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:55:03.579 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:55:03.579 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:55:03.579 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:55:03.580 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:55:03.580 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:55:03.580 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:55:03.581 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:55:03.581 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:55:03.581 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:55:03.582 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:55:03.582 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:55:03.582 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:55:03.583 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:55:03.583 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:55:03.584 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:55:03.584 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:55:03.584 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:55:03.585 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:55:03.585 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:55:03.585 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:55:03.586 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:55:03.586 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:55:03.586 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:55:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:03.587 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:55:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:03.588 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:03.588 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:03.589 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 msgr2=0x7f68c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 0x7f68c0067290 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 rx=0x7f68d4105c30 tx=0x7f68c4009c00).stop 2022-02-02T22:55:03.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 msgr2=0x7f68d41063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:03.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 secure :-1 s=READY pgs=4183 cs=0 l=1 rev1=1 rx=0x7f68d0009990 tx=0x7f68d0009b30).stop 2022-02-02T22:55:03.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 shutdown_connections 2022-02-02T22:55:03.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f68c0064dd0 0x7f68c0067290 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68d40f55c0 0x7f68d4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 --2- 172.21.15.96:0/338941987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68d40f6860 0x7f68d41063b0 unknown :-1 s=CLOSED pgs=4183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 >> 172.21.15.96:0/338941987 conn(0x7f68d40f0d40 msgr2=0x7f68d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.576+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 shutdown_connections 2022-02-02T22:55:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:03.577+0000 7f68db895700 1 -- 172.21.15.96:0/338941987 wait complete. 2022-02-02T22:55:03.594 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:55:04.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:04 smithi096 ceph-mon[101353]: from='client.42482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:04.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:04 smithi096 ceph-mon[101353]: from='client.42486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:04.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3768591931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:55:04.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:04 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/338941987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:55:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:04 smithi159 ceph-mon[69013]: from='client.42482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:04.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:04 smithi159 ceph-mon[69013]: from='client.42486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3768591931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:55:04.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:04 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/338941987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:55:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:05 smithi096 ceph-mon[101353]: pgmap v8188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:05 smithi159 ceph-mon[69013]: pgmap v8188: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:07 smithi159 ceph-mon[69013]: pgmap v8189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:07 smithi096 ceph-mon[101353]: pgmap v8189: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:09 smithi159 ceph-mon[69013]: pgmap v8190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:09.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:09 smithi096 ceph-mon[101353]: pgmap v8190: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:11 smithi159 ceph-mon[69013]: pgmap v8191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:11 smithi096 ceph-mon[101353]: pgmap v8191: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:13 smithi159 ceph-mon[69013]: pgmap v8192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:13.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:13 smithi096 ceph-mon[101353]: pgmap v8192: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:15 smithi159 ceph-mon[69013]: pgmap v8193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:15 smithi096 ceph-mon[101353]: pgmap v8193: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:17 smithi159 ceph-mon[69013]: pgmap v8194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:17 smithi096 ceph-mon[101353]: pgmap v8194: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:19 smithi159 ceph-mon[69013]: pgmap v8195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:19 smithi096 ceph-mon[101353]: pgmap v8195: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:21 smithi159 ceph-mon[69013]: pgmap v8196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:21.576 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:21 smithi096 ceph-mon[101353]: pgmap v8196: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:23.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:23 smithi159 ceph-mon[69013]: pgmap v8197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:23.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:23 smithi096 ceph-mon[101353]: pgmap v8197: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:25 smithi159 ceph-mon[69013]: pgmap v8198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:25 smithi096 ceph-mon[101353]: pgmap v8198: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:27 smithi159 ceph-mon[69013]: pgmap v8199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:27.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:27 smithi096 ceph-mon[101353]: pgmap v8199: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:55:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:55:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:55:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:55:29.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:29 smithi159 ceph-mon[69013]: pgmap v8200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:29.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:29 smithi096 ceph-mon[101353]: pgmap v8200: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:31 smithi159 ceph-mon[69013]: pgmap v8201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:31 smithi096 ceph-mon[101353]: pgmap v8201: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:33.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:33 smithi159 ceph-mon[69013]: pgmap v8202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:33.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:33 smithi096 ceph-mon[101353]: pgmap v8202: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- 172.21.15.96:0/2907826255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 msgr2=0x7ff9bc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 --2- 172.21.15.96:0/2907826255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc0f5850 secure :-1 s=READY pgs=4184 cs=0 l=1 rev1=1 rx=0x7ff9b8004660 tx=0x7ff9b8009b30).stop 2022-02-02T22:55:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- 172.21.15.96:0/2907826255 shutdown_connections 2022-02-02T22:55:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 --2- 172.21.15.96:0/2907826255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 0x7ff9bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 --2- 172.21.15.96:0/2907826255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc0f5850 unknown :-1 s=CLOSED pgs=4184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- 172.21.15.96:0/2907826255 >> 172.21.15.96:0/2907826255 conn(0x7ff9bc0f0b90 msgr2=0x7ff9bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:33.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- 172.21.15.96:0/2907826255 shutdown_connections 2022-02-02T22:55:33.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- 172.21.15.96:0/2907826255 wait complete. 2022-02-02T22:55:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 Processor -- start 2022-02-02T22:55:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.687+0000 7ff9c2184700 1 -- start start 2022-02-02T22:55:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c2184700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c2184700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 0x7ff9bc107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c2184700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc107900 con 0x7ff9bc0f5430 2022-02-02T22:55:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c2184700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc108110 con 0x7ff9bc0f66d0 2022-02-02T22:55:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51156/0 (socket says 172.21.15.96:51156) 2022-02-02T22:55:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 -- 172.21.15.96:0/1589993949 learned_addr learned my addr 172.21.15.96:0/1589993949 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c0981700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 0x7ff9bc107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 -- 172.21.15.96:0/1589993949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 msgr2=0x7ff9bc107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 0x7ff9bc107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 -- 172.21.15.96:0/1589993949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8005040 con 0x7ff9bc0f5430 2022-02-02T22:55:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9c1182700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 secure :-1 s=READY pgs=4185 cs=0 l=1 rev1=1 rx=0x7ff9b8004f60 tx=0x7ff9b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.688+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b8018070 con 0x7ff9bc0f5430 2022-02-02T22:55:33.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.689+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc108330 con 0x7ff9bc0f5430 2022-02-02T22:55:33.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.689+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9b8007ba0 con 0x7ff9bc0f5430 2022-02-02T22:55:33.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.689+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b801c620 con 0x7ff9bc0f5430 2022-02-02T22:55:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.689+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc108890 con 0x7ff9bc0f5430 2022-02-02T22:55:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.690+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc059100 con 0x7ff9bc0f5430 2022-02-02T22:55:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.690+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9b801c8e0 con 0x7ff9bc0f5430 2022-02-02T22:55:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.691+0000 7ff9b1ffb700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 0x7ff9a80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.691+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff9b8083960 con 0x7ff9bc0f5430 2022-02-02T22:55:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.691+0000 7ff9c0981700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 0x7ff9a80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.691+0000 7ff9c0981700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 0x7ff9a80672e0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 rx=0x7ff9ac007fd0 tx=0x7ff9ac009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.695+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9b8051a60 con 0x7ff9bc0f5430 2022-02-02T22:55:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.875+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9bc0fdd60 con 0x7ff9a8064e20 2022-02-02T22:55:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.877+0000 7ff9b1ffb700 1 -- 172.21.15.96:0/1589993949 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff9bc0fdd60 con 0x7ff9a8064e20 2022-02-02T22:55:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 msgr2=0x7ff9a80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 0x7ff9a80672e0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 rx=0x7ff9ac007fd0 tx=0x7ff9ac009040).stop 2022-02-02T22:55:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 msgr2=0x7ff9bc106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 secure :-1 s=READY pgs=4185 cs=0 l=1 rev1=1 rx=0x7ff9b8004f60 tx=0x7ff9b8009b30).stop 2022-02-02T22:55:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 shutdown_connections 2022-02-02T22:55:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.878+0000 7ff9c2184700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9a8064e20 0x7ff9a80672e0 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.879+0000 7ff9c2184700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9bc0f5430 0x7ff9bc106e10 unknown :-1 s=CLOSED pgs=4185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.879+0000 7ff9c2184700 1 --2- 172.21.15.96:0/1589993949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0f66d0 0x7ff9bc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.879+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 >> 172.21.15.96:0/1589993949 conn(0x7ff9bc0f0b90 msgr2=0x7ff9bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.879+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 shutdown_connections 2022-02-02T22:55:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.879+0000 7ff9c2184700 1 -- 172.21.15.96:0/1589993949 wait complete. 2022-02-02T22:55:33.889 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:55:33.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 -- 172.21.15.96:0/537545584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 msgr2=0x7fd4640f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 --2- 172.21.15.96:0/537545584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd4640f5c50 secure :-1 s=READY pgs=4186 cs=0 l=1 rev1=1 rx=0x7fd454004660 tx=0x7fd454009b30).stop 2022-02-02T22:55:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 -- 172.21.15.96:0/537545584 shutdown_connections 2022-02-02T22:55:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 --2- 172.21.15.96:0/537545584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd4640f5c50 unknown :-1 s=CLOSED pgs=4186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 --2- 172.21.15.96:0/537545584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 0x7fd4640f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 -- 172.21.15.96:0/537545584 >> 172.21.15.96:0/537545584 conn(0x7fd4640f0320 msgr2=0x7fd4640f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:33.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.975+0000 7fd46a248700 1 -- 172.21.15.96:0/537545584 shutdown_connections 2022-02-02T22:55:33.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 -- 172.21.15.96:0/537545584 wait complete. 2022-02-02T22:55:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 Processor -- start 2022-02-02T22:55:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 -- start start 2022-02-02T22:55:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 0x7fd4641061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464106760 con 0x7fd4640f57d0 2022-02-02T22:55:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd46a248700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464106f60 con 0x7fd4640f6ac0 2022-02-02T22:55:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd469246700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd469246700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51164/0 (socket says 172.21.15.96:51164) 2022-02-02T22:55:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.976+0000 7fd469246700 1 -- 172.21.15.96:0/3514967049 learned_addr learned my addr 172.21.15.96:0/3514967049 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd468a45700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 0x7fd4641061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd469246700 1 -- 172.21.15.96:0/3514967049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 msgr2=0x7fd4641061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd469246700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 0x7fd4641061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd469246700 1 -- 172.21.15.96:0/3514967049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454005040 con 0x7fd4640f57d0 2022-02-02T22:55:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd469246700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 secure :-1 s=READY pgs=4187 cs=0 l=1 rev1=1 rx=0x7fd46000c530 tx=0x7fd460007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd46000f650 con 0x7fd4640f57d0 2022-02-02T22:55:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464107240 con 0x7fd4640f57d0 2022-02-02T22:55:33.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd46000fc60 con 0x7fd4640f57d0 2022-02-02T22:55:33.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460012cd0 con 0x7fd4640f57d0 2022-02-02T22:55:33.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.977+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464107800 con 0x7fd4640f57d0 2022-02-02T22:55:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.978+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464059100 con 0x7fd4640f57d0 2022-02-02T22:55:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.979+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd460010070 con 0x7fd4640f57d0 2022-02-02T22:55:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.979+0000 7fd459ffb700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 0x7fd4500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.979+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd4600816c0 con 0x7fd4640f57d0 2022-02-02T22:55:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.979+0000 7fd468a45700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 0x7fd4500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.979+0000 7fd468a45700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 0x7fd4500672e0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 rx=0x7fd454004e30 tx=0x7fd454009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:33.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:33.983+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd4600477d0 con 0x7fd4640f57d0 2022-02-02T22:55:34.154 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.154+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4640008d0 con 0x7fd450064e20 2022-02-02T22:55:34.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.163+0000 7fd459ffb700 1 -- 172.21.15.96:0/3514967049 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd4640008d0 con 0x7fd450064e20 2022-02-02T22:55:34.164 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:55:34.164 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:55:34.164 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:55:34.165 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:55:34.165 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:55:34.165 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:55:34.166 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:55:34.167 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:55:34.168 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:55:34.168 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:55:34.169 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:55:34.169 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:55:34.169 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:55:34.170 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:55:34.170 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:55:34.170 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:55:34.171 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:55:34.171 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:55:34.171 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:55:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:55:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:55:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:55:34.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 msgr2=0x7fd4500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 0x7fd4500672e0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 rx=0x7fd454004e30 tx=0x7fd454009b30).stop 2022-02-02T22:55:34.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 msgr2=0x7fd464105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 secure :-1 s=READY pgs=4187 cs=0 l=1 rev1=1 rx=0x7fd46000c530 tx=0x7fd460007e20).stop 2022-02-02T22:55:34.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 shutdown_connections 2022-02-02T22:55:34.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd450064e20 0x7fd4500672e0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4640f57d0 0x7fd464105cc0 unknown :-1 s=CLOSED pgs=4187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 --2- 172.21.15.96:0/3514967049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4640f6ac0 0x7fd4641061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 >> 172.21.15.96:0/3514967049 conn(0x7fd4640f0320 msgr2=0x7fd4640fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:34.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 shutdown_connections 2022-02-02T22:55:34.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.165+0000 7fd46a248700 1 -- 172.21.15.96:0/3514967049 wait complete. 2022-02-02T22:55:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 -- 172.21.15.96:0/4224380029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 msgr2=0x7fd0680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 --2- 172.21.15.96:0/4224380029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd0680f7de0 secure :-1 s=READY pgs=4188 cs=0 l=1 rev1=1 rx=0x7fd050004660 tx=0x7fd050009b30).stop 2022-02-02T22:55:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 -- 172.21.15.96:0/4224380029 shutdown_connections 2022-02-02T22:55:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 --2- 172.21.15.96:0/4224380029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd0680f7de0 unknown :-1 s=CLOSED pgs=4188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 --2- 172.21.15.96:0/4224380029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 0x7fd0680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:55:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 -- 172.21.15.96:0/4224380029 >> 172.21.15.96:0/4224380029 conn(0x7fd0680f1e40 msgr2=0x7fd0680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 -- 172.21.15.96:0/4224380029 shutdown_connections 2022-02-02T22:55:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.262+0000 7fd06cb20700 1 -- 172.21.15.96:0/4224380029 wait complete. 2022-02-02T22:55:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 Processor -- start 2022-02-02T22:55:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 -- start start 2022-02-02T22:55:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806a410 con 0x7fd0680f7980 2022-02-02T22:55:34.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06cb20700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806a550 con 0x7fd0680f66e0 2022-02-02T22:55:34.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd065d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd065d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51176/0 (socket says 172.21.15.96:51176) 2022-02-02T22:55:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd065d9b700 1 -- 172.21.15.96:0/655398056 learned_addr learned my addr 172.21.15.96:0/655398056 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:34.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.263+0000 7fd06659c700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd065d9b700 1 -- 172.21.15.96:0/655398056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 msgr2=0x7fd06806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd065d9b700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd065d9b700 1 -- 172.21.15.96:0/655398056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050005040 con 0x7fd0680f7980 2022-02-02T22:55:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd065d9b700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 secure :-1 s=READY pgs=4189 cs=0 l=1 rev1=1 rx=0x7fd050009990 tx=0x7fd050009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd050018070 con 0x7fd0680f7980 2022-02-02T22:55:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06806a7d0 con 0x7fd0680f7980 2022-02-02T22:55:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06810efe0 con 0x7fd0680f7980 2022-02-02T22:55:34.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd050004490 con 0x7fd0680f7980 2022-02-02T22:55:34.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.264+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05001c620 con 0x7fd0680f7980 2022-02-02T22:55:34.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.265+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c004fa0 con 0x7fd0680f7980 2022-02-02T22:55:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.265+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd050007ca0 con 0x7fd0680f7980 2022-02-02T22:55:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.266+0000 7fd05effd700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 0x7fd054067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.266+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd050083700 con 0x7fd0680f7980 2022-02-02T22:55:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.266+0000 7fd06659c700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 0x7fd054067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.266+0000 7fd06659c700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 0x7fd054067290 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 rx=0x7fd06806b730 tx=0x7fd058008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.270+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd050051800 con 0x7fd0680f7980 2022-02-02T22:55:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.500+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd04c005e80 con 0x7fd0680f7980 2022-02-02T22:55:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.501+0000 7fd05effd700 1 -- 172.21.15.96:0/655398056 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd050054e20 con 0x7fd0680f7980 2022-02-02T22:55:34.502 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:55:34.502 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:55:34.502 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:55:34.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:34.503 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:55:34.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:55:34.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:34.504 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:55:34.505 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:55:34.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:34.505 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:55:34.506 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:55:34.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:55:34.506 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:55:34.507 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:55:34.507 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:55:34.507 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:55:34.508 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:55:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 msgr2=0x7fd054067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 0x7fd054067290 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 rx=0x7fd06806b730 tx=0x7fd058008040).stop 2022-02-02T22:55:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 msgr2=0x7fd068069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 secure :-1 s=READY pgs=4189 cs=0 l=1 rev1=1 rx=0x7fd050009990 tx=0x7fd050009b30).stop 2022-02-02T22:55:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 shutdown_connections 2022-02-02T22:55:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd054064dd0 0x7fd054067290 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 --2- 172.21.15.96:0/655398056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0680f7980 0x7fd068069e20 unknown :-1 s=CLOSED pgs=4189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.503+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 >> 172.21.15.96:0/655398056 conn(0x7fd0680f1e40 msgr2=0x7fd0680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.504+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 shutdown_connections 2022-02-02T22:55:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.504+0000 7fd06cb20700 1 -- 172.21.15.96:0/655398056 wait complete. 2022-02-02T22:55:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- 172.21.15.96:0/2057705020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f77d0 msgr2=0x7f0b680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/2057705020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f77d0 0x7f0b680f7c30 secure :-1 s=READY pgs=4190 cs=0 l=1 rev1=1 rx=0x7f0b54004660 tx=0x7f0b54009b30).stop 2022-02-02T22:55:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- 172.21.15.96:0/2057705020 shutdown_connections 2022-02-02T22:55:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/2057705020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f77d0 0x7f0b680f7c30 unknown :-1 s=CLOSED pgs=4190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/2057705020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f6530 0x7f0b680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- 172.21.15.96:0/2057705020 >> 172.21.15.96:0/2057705020 conn(0x7f0b680f1c90 msgr2=0x7f0b680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:34.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- 172.21.15.96:0/2057705020 shutdown_connections 2022-02-02T22:55:34.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- 172.21.15.96:0/2057705020 wait complete. 2022-02-02T22:55:34.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 Processor -- start 2022-02-02T22:55:34.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.602+0000 7f0b6da9c700 1 -- start start 2022-02-02T22:55:34.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f77d0 0x7f0b68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6806a380 con 0x7f0b680f6530 2022-02-02T22:55:34.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6806a4c0 con 0x7f0b680f77d0 2022-02-02T22:55:34.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51184/0 (socket says 172.21.15.96:51184) 2022-02-02T22:55:34.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 -- 172.21.15.96:0/612800476 learned_addr learned my addr 172.21.15.96:0/612800476 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:55:34.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b67fff700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f77d0 0x7f0b68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 -- 172.21.15.96:0/612800476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f77d0 msgr2=0x7f0b68069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f77d0 0x7f0b68069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 -- 172.21.15.96:0/612800476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54005040 con 0x7f0b680f6530 2022-02-02T22:55:34.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6ca9a700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 secure :-1 s=READY pgs=4191 cs=0 l=1 rev1=1 rx=0x7f0b5c00c530 tx=0x7f0b5c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:34.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5c00f650 con 0x7f0b680f6530 2022-02-02T22:55:34.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0b5c00fc60 con 0x7f0b680f6530 2022-02-02T22:55:34.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6806a7a0 con 0x7f0b680f6530 2022-02-02T22:55:34.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5c012d20 con 0x7f0b680f6530 2022-02-02T22:55:34.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.603+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6810ece0 con 0x7f0b680f6530 2022-02-02T22:55:34.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.604+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b68045ad0 con 0x7f0b680f6530 2022-02-02T22:55:34.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.605+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0b5c019030 con 0x7f0b680f6530 2022-02-02T22:55:34.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.605+0000 7f0b657fa700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 0x7f0b580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:55:34.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.605+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0b5c0816b0 con 0x7f0b680f6530 2022-02-02T22:55:34.615 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.605+0000 7f0b67fff700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 0x7f0b580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:55:34.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.605+0000 7f0b67fff700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 0x7f0b580672e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 rx=0x7f0b54004e30 tx=0x7f0b54009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:55:34.616 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.609+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0b5c04f800 con 0x7f0b680f6530 2022-02-02T22:55:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.809+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0b680fee30 con 0x7f0b680f6530 2022-02-02T22:55:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.809+0000 7f0b657fa700 1 -- 172.21.15.96:0/612800476 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0b5c052e20 con 0x7f0b680f6530 2022-02-02T22:55:34.811 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:55:34.811 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:55:34.812 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:55:34.812 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:55:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:34.813 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:55:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:55:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:55:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:55:34.815 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:55:34.815 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:55:34.815 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:55:34.816 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:55:34.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:55:34.816 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:55:34.817 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:55:34.817 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:55:34.817 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:55:34.818 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:55:34.818 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:55:34.818 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:55:34.819 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:55:34.819 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:55:34.819 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:55:34.820 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:55:34.820 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:55:34.820 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:55:34.821 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:55:34.821 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:55:34.821 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:55:34.822 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:55:34.822 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:55:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:34.823 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:55:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:55:34.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:34.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:34.824 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:55:34.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 msgr2=0x7f0b580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 0x7f0b580672e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 rx=0x7f0b54004e30 tx=0x7f0b54009b30).stop 2022-02-02T22:55:34.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 msgr2=0x7f0b6806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:55:34.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 secure :-1 s=READY pgs=4191 cs=0 l=1 rev1=1 rx=0x7f0b5c00c530 tx=0x7f0b5c007e10).stop 2022-02-02T22:55:34.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 shutdown_connections 2022-02-02T22:55:34.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0b58064e20 0x7f0b580672e0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b680f6530 0x7f0b6806b9a0 unknown :-1 s=CLOSED pgs=4191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 --2- 172.21.15.96:0/612800476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b680f77d0 0x7f0b68069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:55:34.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 >> 172.21.15.96:0/612800476 conn(0x7f0b680f1c90 msgr2=0x7f0b680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:55:34.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.811+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 shutdown_connections 2022-02-02T22:55:34.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:55:34.812+0000 7f0b6da9c700 1 -- 172.21.15.96:0/612800476 wait complete. 2022-02-02T22:55:34.829 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:55:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:35 smithi159 ceph-mon[69013]: pgmap v8203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:35 smithi159 ceph-mon[69013]: from='client.42498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:35.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:35 smithi159 ceph-mon[69013]: from='client.42502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:35.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/655398056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:55:35.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:35 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/612800476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:55:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:35 smithi096 ceph-mon[101353]: pgmap v8203: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:35.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:35 smithi096 ceph-mon[101353]: from='client.42498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:35 smithi096 ceph-mon[101353]: from='client.42502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:55:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/655398056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:55:35.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:35 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/612800476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:55:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:37 smithi159 ceph-mon[69013]: pgmap v8204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:37 smithi096 ceph-mon[101353]: pgmap v8204: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:39.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:39 smithi159 ceph-mon[69013]: pgmap v8205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:39.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:39 smithi096 ceph-mon[101353]: pgmap v8205: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:41 smithi159 ceph-mon[69013]: pgmap v8206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:41.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:41 smithi096 ceph-mon[101353]: pgmap v8206: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:43 smithi159 ceph-mon[69013]: pgmap v8207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:43 smithi096 ceph-mon[101353]: pgmap v8207: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:45 smithi159 ceph-mon[69013]: pgmap v8208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:45 smithi096 ceph-mon[101353]: pgmap v8208: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:47 smithi159 ceph-mon[69013]: pgmap v8209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:47.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:47 smithi096 ceph-mon[101353]: pgmap v8209: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:49 smithi159 ceph-mon[69013]: pgmap v8210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:49.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:49 smithi096 ceph-mon[101353]: pgmap v8210: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:51 smithi159 ceph-mon[69013]: pgmap v8211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:51.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:51 smithi096 ceph-mon[101353]: pgmap v8211: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:53 smithi159 ceph-mon[69013]: pgmap v8212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:53 smithi096 ceph-mon[101353]: pgmap v8212: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:55.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:55 smithi159 ceph-mon[69013]: pgmap v8213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:55.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:55 smithi096 ceph-mon[101353]: pgmap v8213: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:57 smithi159 ceph-mon[69013]: pgmap v8214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:57.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:57 smithi096 ceph-mon[101353]: pgmap v8214: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:55:59 smithi159 ceph-mon[69013]: pgmap v8215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:55:59.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:55:59 smithi096 ceph-mon[101353]: pgmap v8215: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:01 smithi159 ceph-mon[69013]: pgmap v8216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:01 smithi096 ceph-mon[101353]: pgmap v8216: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:03 smithi159 ceph-mon[69013]: pgmap v8217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:03 smithi096 ceph-mon[101353]: pgmap v8217: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:04.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 -- 172.21.15.96:0/400915704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 msgr2=0x7f63180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:04.923 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 --2- 172.21.15.96:0/400915704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f63180f6cc0 secure :-1 s=READY pgs=4192 cs=0 l=1 rev1=1 rx=0x7f6308004660 tx=0x7f6308009b30).stop 2022-02-02T22:56:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 -- 172.21.15.96:0/400915704 shutdown_connections 2022-02-02T22:56:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 --2- 172.21.15.96:0/400915704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f63180f6cc0 unknown :-1 s=CLOSED pgs=4192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 --2- 172.21.15.96:0/400915704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 0x7f63180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.921+0000 7f631ce9d700 1 -- 172.21.15.96:0/400915704 >> 172.21.15.96:0/400915704 conn(0x7f63180f0d40 msgr2=0x7f63180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.922+0000 7f631ce9d700 1 -- 172.21.15.96:0/400915704 shutdown_connections 2022-02-02T22:56:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.922+0000 7f631ce9d700 1 -- 172.21.15.96:0/400915704 wait complete. 2022-02-02T22:56:04.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.922+0000 7f631ce9d700 1 Processor -- start 2022-02-02T22:56:04.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.922+0000 7f631ce9d700 1 -- start start 2022-02-02T22:56:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631ce9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 0x7f6318105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631ce9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631ce9d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6318106920 con 0x7f63180f6860 2022-02-02T22:56:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631ce9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6318107130 con 0x7f63180f55c0 2022-02-02T22:56:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51206/0 (socket says 172.21.15.96:51206) 2022-02-02T22:56:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 -- 172.21.15.96:0/248021621 learned_addr learned my addr 172.21.15.96:0/248021621 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631659c700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 0x7f6318105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 -- 172.21.15.96:0/248021621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 msgr2=0x7f6318105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 0x7f6318105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 -- 172.21.15.96:0/248021621 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308005040 con 0x7f63180f6860 2022-02-02T22:56:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f6315d9b700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 secure :-1 s=READY pgs=4193 cs=0 l=1 rev1=1 rx=0x7f6308009990 tx=0x7f6308009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:04.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6308018070 con 0x7f63180f6860 2022-02-02T22:56:04.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6308007ba0 con 0x7f63180f6860 2022-02-02T22:56:04.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.923+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6318107350 con 0x7f63180f6860 2022-02-02T22:56:04.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.924+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630801c3c0 con 0x7f63180f6860 2022-02-02T22:56:04.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.924+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63181078b0 con 0x7f63180f6860 2022-02-02T22:56:04.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.924+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63180f49b0 con 0x7f63180f6860 2022-02-02T22:56:04.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.925+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f630801d420 con 0x7f63180f6860 2022-02-02T22:56:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.925+0000 7f630effd700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 0x7f6304067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.925+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f63080836a0 con 0x7f63180f6860 2022-02-02T22:56:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.925+0000 7f631659c700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 0x7f6304067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.926+0000 7f631659c700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 0x7f6304067290 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f6318105ba0 tx=0x7f630000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:04.930+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6308051860 con 0x7f63180f6860 2022-02-02T22:56:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.106+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63180fde70 con 0x7f6304064dd0 2022-02-02T22:56:05.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.108+0000 7f630effd700 1 -- 172.21.15.96:0/248021621 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f63180fde70 con 0x7f6304064dd0 2022-02-02T22:56:05.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 msgr2=0x7f6304067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.111 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 0x7f6304067290 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f6318105ba0 tx=0x7f630000b040).stop 2022-02-02T22:56:05.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 msgr2=0x7f6318106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 secure :-1 s=READY pgs=4193 cs=0 l=1 rev1=1 rx=0x7f6308009990 tx=0x7f6308009b30).stop 2022-02-02T22:56:05.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 shutdown_connections 2022-02-02T22:56:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.109+0000 7f631ce9d700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6304064dd0 0x7f6304067290 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.110+0000 7f631ce9d700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63180f55c0 0x7f6318105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.110+0000 7f631ce9d700 1 --2- 172.21.15.96:0/248021621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63180f6860 0x7f6318106320 unknown :-1 s=CLOSED pgs=4193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.110+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 >> 172.21.15.96:0/248021621 conn(0x7f63180f0d40 msgr2=0x7f63180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.110+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 shutdown_connections 2022-02-02T22:56:05.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.110+0000 7f631ce9d700 1 -- 172.21.15.96:0/248021621 wait complete. 2022-02-02T22:56:05.122 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:56:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 -- 172.21.15.96:0/3655638090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f66e0 msgr2=0x7efdc80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.210 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 --2- 172.21.15.96:0/3655638090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f66e0 0x7efdc80f6b40 secure :-1 s=READY pgs=4194 cs=0 l=1 rev1=1 rx=0x7efdb8004660 tx=0x7efdb8009b30).stop 2022-02-02T22:56:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 -- 172.21.15.96:0/3655638090 shutdown_connections 2022-02-02T22:56:05.211 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 --2- 172.21.15.96:0/3655638090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f66e0 0x7efdc80f6b40 unknown :-1 s=CLOSED pgs=4194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 --2- 172.21.15.96:0/3655638090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f5440 0x7efdc80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.208+0000 7efdce105700 1 -- 172.21.15.96:0/3655638090 >> 172.21.15.96:0/3655638090 conn(0x7efdc80f0ba0 msgr2=0x7efdc80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.213 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:05 smithi096 ceph-mon[101353]: pgmap v8218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:05.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 -- 172.21.15.96:0/3655638090 shutdown_connections 2022-02-02T22:56:05.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 -- 172.21.15.96:0/3655638090 wait complete. 2022-02-02T22:56:05.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 Processor -- start 2022-02-02T22:56:05.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 -- start start 2022-02-02T22:56:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f66e0 0x7efdc810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80603e0 con 0x7efdc80f5440 2022-02-02T22:56:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdce105700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8060520 con 0x7efdc80f66e0 2022-02-02T22:56:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdcd103700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdcd103700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51214/0 (socket says 172.21.15.96:51214) 2022-02-02T22:56:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.209+0000 7efdcd103700 1 -- 172.21.15.96:0/1194151047 learned_addr learned my addr 172.21.15.96:0/1194151047 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdcc902700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f66e0 0x7efdc810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdcd103700 1 -- 172.21.15.96:0/1194151047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f66e0 msgr2=0x7efdc810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdcd103700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f66e0 0x7efdc810bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdcd103700 1 -- 172.21.15.96:0/1194151047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8005040 con 0x7efdc80f5440 2022-02-02T22:56:05.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdcd103700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 secure :-1 s=READY pgs=4195 cs=0 l=1 rev1=1 rx=0x7efdc4002700 tx=0x7efdc4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc40079c0 con 0x7efdc80f5440 2022-02-02T22:56:05.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc810c540 con 0x7efdc80f5440 2022-02-02T22:56:05.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efdc400f040 con 0x7efdc80f5440 2022-02-02T22:56:05.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc4014860 con 0x7efdc80f5440 2022-02-02T22:56:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.210+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc810cb00 con 0x7efdc80f5440 2022-02-02T22:56:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.211+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8045ad0 con 0x7efdc80f5440 2022-02-02T22:56:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.212+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efdc401b060 con 0x7efdc80f5440 2022-02-02T22:56:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.212+0000 7efdbdffb700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 0x7efdb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.212+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efdc40818e0 con 0x7efdc80f5440 2022-02-02T22:56:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.212+0000 7efdcc902700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 0x7efdb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.213+0000 7efdcc902700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 0x7efdb40672e0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 rx=0x7efdb8004630 tx=0x7efdb8009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.216+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efdc404f9e0 con 0x7efdc80f5440 2022-02-02T22:56:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.390+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc80fddb0 con 0x7efdb4064e20 2022-02-02T22:56:05.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.399+0000 7efdbdffb700 1 -- 172.21.15.96:0/1194151047 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efdb8019040 con 0x7efdb4064e20 2022-02-02T22:56:05.400 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:56:05.401 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:56:05.401 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:56:05.402 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:56:05.402 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:56:05.402 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:56:05.403 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:56:05.403 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:56:05.403 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:56:05.404 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:56:05.404 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:56:05.404 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:56:05.405 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:56:05.405 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:56:05.405 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:56:05.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:56:05.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:56:05.406 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:56:05.407 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:56:05.407 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:56:05.408 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:56:05.408 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:56:05.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 msgr2=0x7efdb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 0x7efdb40672e0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 rx=0x7efdb8004630 tx=0x7efdb8009b30).stop 2022-02-02T22:56:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 msgr2=0x7efdc8109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 secure :-1 s=READY pgs=4195 cs=0 l=1 rev1=1 rx=0x7efdc4002700 tx=0x7efdc4009d80).stop 2022-02-02T22:56:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 shutdown_connections 2022-02-02T22:56:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7efdb4064e20 0x7efdb40672e0 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc80f5440 0x7efdc8109a90 unknown :-1 s=CLOSED pgs=4195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 --2- 172.21.15.96:0/1194151047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdc80f66e0 0x7efdc810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 >> 172.21.15.96:0/1194151047 conn(0x7efdc80f0ba0 msgr2=0x7efdc80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 shutdown_connections 2022-02-02T22:56:05.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.401+0000 7efdce105700 1 -- 172.21.15.96:0/1194151047 wait complete. 2022-02-02T22:56:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 -- 172.21.15.96:0/3681595863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f55c0 msgr2=0x7f222c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 --2- 172.21.15.96:0/3681595863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f55c0 0x7f222c0f59e0 secure :-1 s=READY pgs=4196 cs=0 l=1 rev1=1 rx=0x7f221c004660 tx=0x7f221c009b30).stop 2022-02-02T22:56:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 -- 172.21.15.96:0/3681595863 shutdown_connections 2022-02-02T22:56:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 --2- 172.21.15.96:0/3681595863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f6860 0x7f222c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 --2- 172.21.15.96:0/3681595863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f55c0 0x7f222c0f59e0 unknown :-1 s=CLOSED pgs=4196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 -- 172.21.15.96:0/3681595863 >> 172.21.15.96:0/3681595863 conn(0x7f222c0f0d40 msgr2=0x7f222c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 -- 172.21.15.96:0/3681595863 shutdown_connections 2022-02-02T22:56:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.497+0000 7f2234705700 1 -- 172.21.15.96:0/3681595863 wait complete. 2022-02-02T22:56:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 Processor -- start 2022-02-02T22:56:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 -- start start 2022-02-02T22:56:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f55c0 0x7f222c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c107a10 con 0x7f222c0f6860 2022-02-02T22:56:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2234705700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c107b50 con 0x7f222c0f55c0 2022-02-02T22:56:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51224/0 (socket says 172.21.15.96:51224) 2022-02-02T22:56:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 -- 172.21.15.96:0/449197386 learned_addr learned my addr 172.21.15.96:0/449197386 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f22324a1700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f55c0 0x7f222c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 -- 172.21.15.96:0/449197386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f55c0 msgr2=0x7f222c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f55c0 0x7f222c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 -- 172.21.15.96:0/449197386 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c005040 con 0x7f222c0f6860 2022-02-02T22:56:05.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.498+0000 7f2231ca0700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 secure :-1 s=READY pgs=4197 cs=0 l=1 rev1=1 rx=0x7f22280026d0 tx=0x7f2228009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.499+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22280079c0 con 0x7f222c0f6860 2022-02-02T22:56:05.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.499+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f222800f040 con 0x7f222c0f6860 2022-02-02T22:56:05.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.499+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22280148b0 con 0x7f222c0f6860 2022-02-02T22:56:05.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.499+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c1084f0 con 0x7f222c0f6860 2022-02-02T22:56:05.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.499+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c108ab0 con 0x7f222c0f6860 2022-02-02T22:56:05.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.500+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c045ad0 con 0x7f222c0f6860 2022-02-02T22:56:05.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.501+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2228007b20 con 0x7f222c0f6860 2022-02-02T22:56:05.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.501+0000 7f2222ffd700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 0x7f2218067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.501+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2228081d90 con 0x7f222c0f6860 2022-02-02T22:56:05.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.501+0000 7f22324a1700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 0x7f2218067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.502+0000 7f22324a1700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 0x7f2218067290 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 rx=0x7f221c004630 tx=0x7f221c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.506+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2228053880 con 0x7f222c0f6860 2022-02-02T22:56:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:05 smithi159 ceph-mon[69013]: pgmap v8218: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:05.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.736+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f222c1091b0 con 0x7f222c0f6860 2022-02-02T22:56:05.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.736+0000 7f2222ffd700 1 -- 172.21.15.96:0/449197386 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f2228053470 con 0x7f222c0f6860 2022-02-02T22:56:05.739 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:56:05.739 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:56:05.740 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:56:05.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:05.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:56:05.741 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:56:05.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:05.742 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:56:05.742 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:56:05.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:05.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:56:05.743 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:56:05.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:05.744 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:56:05.744 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:56:05.745 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:56:05.745 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:56:05.745 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:56:05.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 msgr2=0x7f2218067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 0x7f2218067290 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 rx=0x7f221c004630 tx=0x7f221c009b30).stop 2022-02-02T22:56:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 msgr2=0x7f222c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 secure :-1 s=READY pgs=4197 cs=0 l=1 rev1=1 rx=0x7f22280026d0 tx=0x7f2228009de0).stop 2022-02-02T22:56:05.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 shutdown_connections 2022-02-02T22:56:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2218064dd0 0x7f2218067290 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222c0f55c0 0x7f222c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 --2- 172.21.15.96:0/449197386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222c0f6860 0x7f222c107460 unknown :-1 s=CLOSED pgs=4197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 >> 172.21.15.96:0/449197386 conn(0x7f222c0f0d40 msgr2=0x7f222c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 shutdown_connections 2022-02-02T22:56:05.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.739+0000 7f2234705700 1 -- 172.21.15.96:0/449197386 wait complete. 2022-02-02T22:56:05.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 -- 172.21.15.96:0/3481544698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 msgr2=0x7fcb200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/3481544698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb200f6950 secure :-1 s=READY pgs=4198 cs=0 l=1 rev1=1 rx=0x7fcb10004660 tx=0x7fcb10009b30).stop 2022-02-02T22:56:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 -- 172.21.15.96:0/3481544698 shutdown_connections 2022-02-02T22:56:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/3481544698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/3481544698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb200f6950 unknown :-1 s=CLOSED pgs=4198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 -- 172.21.15.96:0/3481544698 >> 172.21.15.96:0/3481544698 conn(0x7fcb200f1c90 msgr2=0x7fcb200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 -- 172.21.15.96:0/3481544698 shutdown_connections 2022-02-02T22:56:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.835+0000 7fcb26e3e700 1 -- 172.21.15.96:0/3481544698 wait complete. 2022-02-02T22:56:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 Processor -- start 2022-02-02T22:56:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 -- start start 2022-02-02T22:56:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb201072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb201078f0 con 0x7fcb200f6530 2022-02-02T22:56:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb26e3e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20108100 con 0x7fcb200f77d0 2022-02-02T22:56:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51232/0 (socket says 172.21.15.96:51232) 2022-02-02T22:56:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 -- 172.21.15.96:0/2531914367 learned_addr learned my addr 172.21.15.96:0/2531914367 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb2563b700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb201072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 -- 172.21.15.96:0/2531914367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 msgr2=0x7fcb201072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb201072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 -- 172.21.15.96:0/2531914367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10005040 con 0x7fcb200f6530 2022-02-02T22:56:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb2563b700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb201072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:56:05.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.836+0000 7fcb25e3c700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 secure :-1 s=READY pgs=4199 cs=0 l=1 rev1=1 rx=0x7fcb10000c00 tx=0x7fcb10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.837+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb10018070 con 0x7fcb200f6530 2022-02-02T22:56:05.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.837+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb20108320 con 0x7fcb200f6530 2022-02-02T22:56:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.837+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb10007d70 con 0x7fcb200f6530 2022-02-02T22:56:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.837+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1001c620 con 0x7fcb200f6530 2022-02-02T22:56:05.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.837+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20108880 con 0x7fcb200f6530 2022-02-02T22:56:05.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.838+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb20059100 con 0x7fcb200f6530 2022-02-02T22:56:05.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.838+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb1001c860 con 0x7fcb200f6530 2022-02-02T22:56:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.838+0000 7fcb167fc700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 0x7fcb0c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.839+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcb10083900 con 0x7fcb200f6530 2022-02-02T22:56:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.839+0000 7fcb2563b700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 0x7fcb0c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.839+0000 7fcb2563b700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 0x7fcb0c0672e0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 rx=0x7fcb1c0041d0 tx=0x7fcb1c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:05.843+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb10051ac0 con 0x7fcb200f6530 2022-02-02T22:56:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.043+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb200008d0 con 0x7fcb200f6530 2022-02-02T22:56:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.044+0000 7fcb167fc700 1 -- 172.21.15.96:0/2531914367 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcb100550e0 con 0x7fcb200f6530 2022-02-02T22:56:06.047 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:56:06.047 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:56:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:56:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:56:06.048 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:56:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:56:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:56:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:56:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:56:06.050 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:56:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:56:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:56:06.051 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:56:06.052 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:56:06.052 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:56:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:56:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:56:06.053 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:56:06.054 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:56:06.054 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:56:06.054 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:56:06.055 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:56:06.055 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:56:06.056 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:56:06.056 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:56:06.056 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:56:06.057 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:56:06.057 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:56:06.057 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:56:06.058 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:56:06.058 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:56:06.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:06.059 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:06.059 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:56:06.059 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:06.060 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:06.060 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:06.060 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 msgr2=0x7fcb0c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 0x7fcb0c0672e0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 rx=0x7fcb1c0041d0 tx=0x7fcb1c009040).stop 2022-02-02T22:56:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 msgr2=0x7fcb20106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 secure :-1 s=READY pgs=4199 cs=0 l=1 rev1=1 rx=0x7fcb10000c00 tx=0x7fcb10009b30).stop 2022-02-02T22:56:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 shutdown_connections 2022-02-02T22:56:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fcb0c064e20 0x7fcb0c0672e0 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb200f6530 0x7fcb20106e00 unknown :-1 s=CLOSED pgs=4199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 --2- 172.21.15.96:0/2531914367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb200f77d0 0x7fcb201072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:06.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 >> 172.21.15.96:0/2531914367 conn(0x7fcb200f1c90 msgr2=0x7fcb200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:06.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 shutdown_connections 2022-02-02T22:56:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:06.046+0000 7fcb26e3e700 1 -- 172.21.15.96:0/2531914367 wait complete. 2022-02-02T22:56:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:56:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:06 smithi159 ceph-mon[69013]: from='client.42514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:06.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/449197386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:56:06.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:06 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2531914367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:56:06.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:06 smithi096 ceph-mon[101353]: from='client.42514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/449197386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:56:06.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:06 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2531914367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:56:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:07 smithi159 ceph-mon[69013]: from='client.42518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:07 smithi159 ceph-mon[69013]: pgmap v8219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:07 smithi096 ceph-mon[101353]: from='client.42518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:07.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:07 smithi096 ceph-mon[101353]: pgmap v8219: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:09 smithi159 ceph-mon[69013]: pgmap v8220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:09.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:09 smithi096 ceph-mon[101353]: pgmap v8220: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:11 smithi159 ceph-mon[69013]: pgmap v8221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:11 smithi096 ceph-mon[101353]: pgmap v8221: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:13.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:13 smithi159 ceph-mon[69013]: pgmap v8222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:13 smithi096 ceph-mon[101353]: pgmap v8222: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:15 smithi159 ceph-mon[69013]: pgmap v8223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:15.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:15 smithi096 ceph-mon[101353]: pgmap v8223: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:17 smithi159 ceph-mon[69013]: pgmap v8224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:17 smithi096 ceph-mon[101353]: pgmap v8224: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:19 smithi159 ceph-mon[69013]: pgmap v8225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:19 smithi096 ceph-mon[101353]: pgmap v8225: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:21 smithi159 ceph-mon[69013]: pgmap v8226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:21 smithi096 ceph-mon[101353]: pgmap v8226: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:23 smithi159 ceph-mon[69013]: pgmap v8227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:23 smithi096 ceph-mon[101353]: pgmap v8227: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:25 smithi159 ceph-mon[69013]: pgmap v8228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:25 smithi096 ceph-mon[101353]: pgmap v8228: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:27 smithi159 ceph-mon[69013]: pgmap v8229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:27 smithi096 ceph-mon[101353]: pgmap v8229: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:28.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:56:28.662 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:56:28.664 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:56:28.664 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:56:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:29 smithi159 ceph-mon[69013]: pgmap v8230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:29.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:29 smithi096 ceph-mon[101353]: pgmap v8230: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:30.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:30 smithi159 ceph-mon[69013]: pgmap v8231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:30.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:30 smithi096 ceph-mon[101353]: pgmap v8231: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:33.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:32 smithi159 ceph-mon[69013]: pgmap v8232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:33.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:32 smithi096 ceph-mon[101353]: pgmap v8232: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:35.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:34 smithi159 ceph-mon[69013]: pgmap v8233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:35.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:34 smithi096 ceph-mon[101353]: pgmap v8233: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 -- 172.21.15.96:0/4290764545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 msgr2=0x7f11f40f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 --2- 172.21.15.96:0/4290764545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f4820 secure :-1 s=READY pgs=4200 cs=0 l=1 rev1=1 rx=0x7f11dc004660 tx=0x7f11dc009b30).stop 2022-02-02T22:56:36.160 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 -- 172.21.15.96:0/4290764545 shutdown_connections 2022-02-02T22:56:36.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 --2- 172.21.15.96:0/4290764545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f4820 unknown :-1 s=CLOSED pgs=4200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.161 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 --2- 172.21.15.96:0/4290764545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 0x7f11f40f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 -- 172.21.15.96:0/4290764545 >> 172.21.15.96:0/4290764545 conn(0x7f11f40f0540 msgr2=0x7f11f40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 -- 172.21.15.96:0/4290764545 shutdown_connections 2022-02-02T22:56:36.162 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.156+0000 7f11fa486700 1 -- 172.21.15.96:0/4290764545 wait complete. 2022-02-02T22:56:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 Processor -- start 2022-02-02T22:56:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 -- start start 2022-02-02T22:56:36.163 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 0x7f11f40f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40f5fb0 con 0x7f11f40f8610 2022-02-02T22:56:36.164 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11fa486700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40f60f0 con 0x7f11f40f7d00 2022-02-02T22:56:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51252/0 (socket says 172.21.15.96:51252) 2022-02-02T22:56:36.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 -- 172.21.15.96:0/3146769770 learned_addr learned my addr 172.21.15.96:0/3146769770 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11f3fff700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 0x7f11f40f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 -- 172.21.15.96:0/3146769770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 msgr2=0x7f11f40f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 0x7f11f40f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.157+0000 7f11ebfff700 1 -- 172.21.15.96:0/3146769770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc005040 con 0x7f11f40f8610 2022-02-02T22:56:36.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11ebfff700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 secure :-1 s=READY pgs=4201 cs=0 l=1 rev1=1 rx=0x7f11dc009990 tx=0x7f11dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11dc018070 con 0x7f11f40f8610 2022-02-02T22:56:36.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11dc007ca0 con 0x7f11f40f8610 2022-02-02T22:56:36.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40f6370 con 0x7f11f40f8610 2022-02-02T22:56:36.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11dc01c620 con 0x7f11f40f8610 2022-02-02T22:56:36.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.158+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f40f68d0 con 0x7f11f40f8610 2022-02-02T22:56:36.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.159+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d8004fa0 con 0x7f11f40f8610 2022-02-02T22:56:36.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.159+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11dc01c890 con 0x7f11f40f8610 2022-02-02T22:56:36.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.160+0000 7f11f17fa700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 0x7f11e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.160+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f11dc083750 con 0x7f11f40f8610 2022-02-02T22:56:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.160+0000 7f11f3fff700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 0x7f11e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.160+0000 7f11f3fff700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 0x7f11e0067290 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 rx=0x7f11e4007fd0 tx=0x7f11e4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.164+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11dc051910 con 0x7f11f40f8610 2022-02-02T22:56:36.344 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.343+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d8000bc0 con 0x7f11e0064dd0 2022-02-02T22:56:36.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.345+0000 7f11f17fa700 1 -- 172.21.15.96:0/3146769770 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f11d8000bc0 con 0x7f11e0064dd0 2022-02-02T22:56:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 msgr2=0x7f11e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 0x7f11e0067290 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 rx=0x7f11e4007fd0 tx=0x7f11e4009040).stop 2022-02-02T22:56:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 msgr2=0x7f11f40f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 secure :-1 s=READY pgs=4201 cs=0 l=1 rev1=1 rx=0x7f11dc009990 tx=0x7f11dc009b30).stop 2022-02-02T22:56:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 shutdown_connections 2022-02-02T22:56:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f11e0064dd0 0x7f11e0067290 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f40f7d00 0x7f11f40f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 --2- 172.21.15.96:0/3146769770 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11f40f8610 0x7f11f40f5a50 unknown :-1 s=CLOSED pgs=4201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 >> 172.21.15.96:0/3146769770 conn(0x7f11f40f0540 msgr2=0x7f11f40fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.346+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 shutdown_connections 2022-02-02T22:56:36.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.347+0000 7f11fa486700 1 -- 172.21.15.96:0/3146769770 wait complete. 2022-02-02T22:56:36.357 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:56:36.449 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 -- 172.21.15.96:0/1824958503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 msgr2=0x7f0ae00f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 --2- 172.21.15.96:0/1824958503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae00f6cd0 secure :-1 s=READY pgs=4202 cs=0 l=1 rev1=1 rx=0x7f0ad0004660 tx=0x7f0ad0009b30).stop 2022-02-02T22:56:36.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 -- 172.21.15.96:0/1824958503 shutdown_connections 2022-02-02T22:56:36.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 --2- 172.21.15.96:0/1824958503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae00f6cd0 unknown :-1 s=CLOSED pgs=4202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 --2- 172.21.15.96:0/1824958503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 0x7f0ae00f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.452 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 -- 172.21.15.96:0/1824958503 >> 172.21.15.96:0/1824958503 conn(0x7f0ae00f0d70 msgr2=0x7f0ae00f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 -- 172.21.15.96:0/1824958503 shutdown_connections 2022-02-02T22:56:36.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.444+0000 7f0ae5628700 1 -- 172.21.15.96:0/1824958503 wait complete. 2022-02-02T22:56:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 Processor -- start 2022-02-02T22:56:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 -- start start 2022-02-02T22:56:36.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 0x7f0ae0109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0060500 con 0x7f0ae00f6870 2022-02-02T22:56:36.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ae5628700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0060640 con 0x7f0ae00f55d0 2022-02-02T22:56:36.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.445+0000 7f0ade7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51262/0 (socket says 172.21.15.96:51262) 2022-02-02T22:56:36.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 -- 172.21.15.96:0/2449569891 learned_addr learned my addr 172.21.15.96:0/2449569891 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:36.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0adeffd700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 0x7f0ae0109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 -- 172.21.15.96:0/2449569891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 msgr2=0x7f0ae0109c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 0x7f0ae0109c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 -- 172.21.15.96:0/2449569891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0005040 con 0x7f0ae00f6870 2022-02-02T22:56:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ade7fc700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 secure :-1 s=READY pgs=4203 cs=0 l=1 rev1=1 rx=0x7f0ad0009990 tx=0x7f0ad0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad0018070 con 0x7f0ae00f6870 2022-02-02T22:56:36.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae010c690 con 0x7f0ae00f6870 2022-02-02T22:56:36.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ad0007ba0 con 0x7f0ae00f6870 2022-02-02T22:56:36.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad001c620 con 0x7f0ae00f6870 2022-02-02T22:56:36.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.446+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae010cbc0 con 0x7f0ae00f6870 2022-02-02T22:56:36.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.447+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00f49c0 con 0x7f0ae00f6870 2022-02-02T22:56:36.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.448+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ad001c8e0 con 0x7f0ae00f6870 2022-02-02T22:56:36.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.448+0000 7f0ac77fe700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 0x7f0ac8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.448+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0ad0083850 con 0x7f0ae00f6870 2022-02-02T22:56:36.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.448+0000 7f0adeffd700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 0x7f0ac8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.448+0000 7f0adeffd700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 0x7f0ac8067290 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7f0ae0060180 tx=0x7f0ad4009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.452+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ad0051950 con 0x7f0ae00f6870 2022-02-02T22:56:36.626 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.625+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ae00fded0 con 0x7f0ac8064dd0 2022-02-02T22:56:36.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.634+0000 7f0ac77fe700 1 -- 172.21.15.96:0/2449569891 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0ae00fded0 con 0x7f0ac8064dd0 2022-02-02T22:56:36.636 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:56:36.636 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:56:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:56:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:56:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:56:36.638 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:56:36.638 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:56:36.639 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:56:36.639 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:56:36.640 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:56:36.640 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:56:36.641 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:56:36.641 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:56:36.641 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:56:36.642 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:56:36.642 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:56:36.642 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:56:36.643 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:56:36.643 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:56:36.643 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:56:36.644 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:56:36.644 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:56:36.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 msgr2=0x7f0ac8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 0x7f0ac8067290 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7f0ae0060180 tx=0x7f0ad4009040).stop 2022-02-02T22:56:36.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 msgr2=0x7f0ae010c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 secure :-1 s=READY pgs=4203 cs=0 l=1 rev1=1 rx=0x7f0ad0009990 tx=0x7f0ad0009b30).stop 2022-02-02T22:56:36.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 shutdown_connections 2022-02-02T22:56:36.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0ac8064dd0 0x7f0ac8067290 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ae00f55d0 0x7f0ae0109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 --2- 172.21.15.96:0/2449569891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ae00f6870 0x7f0ae010c140 unknown :-1 s=CLOSED pgs=4203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 >> 172.21.15.96:0/2449569891 conn(0x7f0ae00f0d70 msgr2=0x7f0ae00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 shutdown_connections 2022-02-02T22:56:36.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.636+0000 7f0ae5628700 1 -- 172.21.15.96:0/2449569891 wait complete. 2022-02-02T22:56:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.736+0000 7fceca5a0700 1 -- 172.21.15.96:0/1963343998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40f66d0 msgr2=0x7fcec40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.736+0000 7fceca5a0700 1 --2- 172.21.15.96:0/1963343998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40f66d0 0x7fcec40f6b30 secure :-1 s=READY pgs=4204 cs=0 l=1 rev1=1 rx=0x7fcec0004660 tx=0x7fcec0009b30).stop 2022-02-02T22:56:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- 172.21.15.96:0/1963343998 shutdown_connections 2022-02-02T22:56:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 --2- 172.21.15.96:0/1963343998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40f66d0 0x7fcec40f6b30 unknown :-1 s=CLOSED pgs=4204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 --2- 172.21.15.96:0/1963343998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 0x7fcec40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- 172.21.15.96:0/1963343998 >> 172.21.15.96:0/1963343998 conn(0x7fcec40f0b90 msgr2=0x7fcec40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- 172.21.15.96:0/1963343998 shutdown_connections 2022-02-02T22:56:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- 172.21.15.96:0/1963343998 wait complete. 2022-02-02T22:56:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 Processor -- start 2022-02-02T22:56:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- start start 2022-02-02T22:56:36.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 0x7fcec4109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec410c640 con 0x7fcec40602b0 2022-02-02T22:56:36.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fceca5a0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec410c780 con 0x7fcec40f5430 2022-02-02T22:56:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.737+0000 7fcec8d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51272/0 (socket says 172.21.15.96:51272) 2022-02-02T22:56:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 -- 172.21.15.96:0/3982282607 learned_addr learned my addr 172.21.15.96:0/3982282607 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec959e700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 0x7fcec4109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 -- 172.21.15.96:0/3982282607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 msgr2=0x7fcec4109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 0x7fcec4109c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 -- 172.21.15.96:0/3982282607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0005040 con 0x7fcec40602b0 2022-02-02T22:56:36.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fcec8d9d700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 secure :-1 s=READY pgs=4205 cs=0 l=1 rev1=1 rx=0x7fcec0000c00 tx=0x7fcec0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec0019070 con 0x7fcec40602b0 2022-02-02T22:56:36.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcec00097d0 con 0x7fcec40602b0 2022-02-02T22:56:36.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec410ca00 con 0x7fcec40602b0 2022-02-02T22:56:36.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec0014480 con 0x7fcec40602b0 2022-02-02T22:56:36.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.738+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec410cf00 con 0x7fcec40602b0 2022-02-02T22:56:36.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.739+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec4045ad0 con 0x7fcec40602b0 2022-02-02T22:56:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.740+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcec0007bc0 con 0x7fcec40602b0 2022-02-02T22:56:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.740+0000 7fceb9ffb700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 0x7fceb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:36.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.740+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcec0083330 con 0x7fcec40602b0 2022-02-02T22:56:36.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.741+0000 7fcec959e700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 0x7fceb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:36.752 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.741+0000 7fcec959e700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 0x7fceb00672e0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 rx=0x7fcec4060040 tx=0x7fceb400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:36.753 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.744+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcec0051570 con 0x7fcec40602b0 2022-02-02T22:56:36.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.976+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcec4027a00 con 0x7fcec40602b0 2022-02-02T22:56:36.978 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:36 smithi096 ceph-mon[101353]: pgmap v8234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:36.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.977+0000 7fceb9ffb700 1 -- 172.21.15.96:0/3982282607 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fcec002b070 con 0x7fcec40602b0 2022-02-02T22:56:36.980 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:56:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:56:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:56:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:56:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:56:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:56:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:56:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:56:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:56:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:56:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:56:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:56:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:56:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:56:36.986 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:56:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 msgr2=0x7fceb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 0x7fceb00672e0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 rx=0x7fcec4060040 tx=0x7fceb400b040).stop 2022-02-02T22:56:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 msgr2=0x7fcec410c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 secure :-1 s=READY pgs=4205 cs=0 l=1 rev1=1 rx=0x7fcec0000c00 tx=0x7fcec0009b30).stop 2022-02-02T22:56:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 shutdown_connections 2022-02-02T22:56:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fceb0064e20 0x7fceb00672e0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcec40f5430 0x7fcec4109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 --2- 172.21.15.96:0/3982282607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcec40602b0 0x7fcec410c100 unknown :-1 s=CLOSED pgs=4205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:36.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 >> 172.21.15.96:0/3982282607 conn(0x7fcec40f0b90 msgr2=0x7fcec40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:36.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 shutdown_connections 2022-02-02T22:56:36.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:36.979+0000 7fceca5a0700 1 -- 172.21.15.96:0/3982282607 wait complete. 2022-02-02T22:56:37.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:36 smithi159 ceph-mon[69013]: pgmap v8234: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 -- 172.21.15.96:0/3551389628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 msgr2=0x7f32cc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/3551389628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc0f6cc0 secure :-1 s=READY pgs=4206 cs=0 l=1 rev1=1 rx=0x7f32bc004660 tx=0x7f32bc009b30).stop 2022-02-02T22:56:37.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 -- 172.21.15.96:0/3551389628 shutdown_connections 2022-02-02T22:56:37.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/3551389628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc0f6cc0 unknown :-1 s=CLOSED pgs=4206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/3551389628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 -- 172.21.15.96:0/3551389628 >> 172.21.15.96:0/3551389628 conn(0x7f32cc0f0d40 msgr2=0x7f32cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:37.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 -- 172.21.15.96:0/3551389628 shutdown_connections 2022-02-02T22:56:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 -- 172.21.15.96:0/3551389628 wait complete. 2022-02-02T22:56:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.077+0000 7f32d1b2c700 1 Processor -- start 2022-02-02T22:56:37.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32d1b2c700 1 -- start start 2022-02-02T22:56:37.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32d1b2c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:37.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32d1b2c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:37.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32d1b2c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1069b0 con 0x7f32cc0f6860 2022-02-02T22:56:37.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32d1b2c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1071c0 con 0x7f32cc0f55c0 2022-02-02T22:56:37.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51282/0 (socket says 172.21.15.96:51282) 2022-02-02T22:56:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 -- 172.21.15.96:0/1800070685 learned_addr learned my addr 172.21.15.96:0/1800070685 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:56:37.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32cb7fe700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:37.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 -- 172.21.15.96:0/1800070685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 msgr2=0x7f32cc105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:37.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32caffd700 1 -- 172.21.15.96:0/1800070685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc005040 con 0x7f32cc0f6860 2022-02-02T22:56:37.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.078+0000 7f32cb7fe700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:56:37.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32caffd700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 secure :-1 s=READY pgs=4207 cs=0 l=1 rev1=1 rx=0x7f32bc009990 tx=0x7f32bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:37.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32bc018070 con 0x7f32cc0f6860 2022-02-02T22:56:37.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32bc007ba0 con 0x7f32cc0f6860 2022-02-02T22:56:37.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32bc01c3c0 con 0x7f32cc0f6860 2022-02-02T22:56:37.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc1073e0 con 0x7f32cc0f6860 2022-02-02T22:56:37.090 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.079+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc107940 con 0x7f32cc0f6860 2022-02-02T22:56:37.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.080+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc0f49b0 con 0x7f32cc0f6860 2022-02-02T22:56:37.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.080+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f32bc01d420 con 0x7f32cc0f6860 2022-02-02T22:56:37.091 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.080+0000 7f32c3fff700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 0x7f32b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:56:37.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.081+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f32bc083690 con 0x7f32cc0f6860 2022-02-02T22:56:37.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.081+0000 7f32cb7fe700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 0x7f32b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:56:37.092 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.081+0000 7f32cb7fe700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 0x7f32b8067290 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 rx=0x7f32cc105c30 tx=0x7f32b4009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:56:37.093 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.085+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f32bc051850 con 0x7f32cc0f6860 2022-02-02T22:56:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.285+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32cc0ff790 con 0x7f32cc0f6860 2022-02-02T22:56:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.285+0000 7f32c3fff700 1 -- 172.21.15.96:0/1800070685 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f32bc054e70 con 0x7f32cc0f6860 2022-02-02T22:56:37.287 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:56:37.287 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:56:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:56:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:56:37.288 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:56:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:56:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:56:37.290 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:56:37.290 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:56:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:56:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:56:37.291 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:56:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:56:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:56:37.292 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:56:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:56:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:56:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:56:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:56:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:56:37.294 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:56:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:56:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:56:37.295 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:56:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:56:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:56:37.296 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:56:37.297 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:56:37.297 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:56:37.297 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:56:37.298 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:56:37.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:37.298 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:37.299 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:56:37.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:56:37.299 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:37.299 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:37.300 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:56:37.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 msgr2=0x7f32b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:37.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 0x7f32b8067290 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 rx=0x7f32cc105c30 tx=0x7f32b4009c00).stop 2022-02-02T22:56:37.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 msgr2=0x7f32cc1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:56:37.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 secure :-1 s=READY pgs=4207 cs=0 l=1 rev1=1 rx=0x7f32bc009990 tx=0x7f32bc009b30).stop 2022-02-02T22:56:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 shutdown_connections 2022-02-02T22:56:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f32b8064dd0 0x7f32b8067290 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32cc0f55c0 0x7f32cc105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 --2- 172.21.15.96:0/1800070685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32cc0f6860 0x7f32cc1063b0 unknown :-1 s=CLOSED pgs=4207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:56:37.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 >> 172.21.15.96:0/1800070685 conn(0x7f32cc0f0d40 msgr2=0x7f32cc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:56:37.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 shutdown_connections 2022-02-02T22:56:37.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:56:37.287+0000 7f32d1b2c700 1 -- 172.21.15.96:0/1800070685 wait complete. 2022-02-02T22:56:37.305 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:56:38.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:37 smithi159 ceph-mon[69013]: from='client.42530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:38.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:37 smithi159 ceph-mon[69013]: from='client.42534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3982282607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:56:38.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:37 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1800070685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:56:38.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:37 smithi096 ceph-mon[101353]: from='client.42530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:38.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:37 smithi096 ceph-mon[101353]: from='client.42534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:56:38.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3982282607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:56:38.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:37 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1800070685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:56:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:38 smithi159 ceph-mon[69013]: pgmap v8235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:39.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:38 smithi096 ceph-mon[101353]: pgmap v8235: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:41.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:40 smithi159 ceph-mon[69013]: pgmap v8236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:41.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:40 smithi096 ceph-mon[101353]: pgmap v8236: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:43.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:42 smithi159 ceph-mon[69013]: pgmap v8237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:42 smithi096 ceph-mon[101353]: pgmap v8237: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:45.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:44 smithi159 ceph-mon[69013]: pgmap v8238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:45.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:44 smithi096 ceph-mon[101353]: pgmap v8238: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:47.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:46 smithi159 ceph-mon[69013]: pgmap v8239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:46 smithi096 ceph-mon[101353]: pgmap v8239: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:49.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:48 smithi159 ceph-mon[69013]: pgmap v8240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:49.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:48 smithi096 ceph-mon[101353]: pgmap v8240: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:51.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:50 smithi159 ceph-mon[69013]: pgmap v8241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:51.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:50 smithi096 ceph-mon[101353]: pgmap v8241: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:53.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:52 smithi159 ceph-mon[69013]: pgmap v8242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:53.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:52 smithi096 ceph-mon[101353]: pgmap v8242: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:55.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:54 smithi159 ceph-mon[69013]: pgmap v8243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:55.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:54 smithi096 ceph-mon[101353]: pgmap v8243: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:57.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:56 smithi159 ceph-mon[69013]: pgmap v8244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:57.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:56 smithi096 ceph-mon[101353]: pgmap v8244: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:59.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:56:58 smithi159 ceph-mon[69013]: pgmap v8245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:56:59.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:56:58 smithi096 ceph-mon[101353]: pgmap v8245: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:01.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:00 smithi159 ceph-mon[69013]: pgmap v8246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:01.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:00 smithi096 ceph-mon[101353]: pgmap v8246: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:03.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:02 smithi159 ceph-mon[69013]: pgmap v8247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:03.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:02 smithi096 ceph-mon[101353]: pgmap v8247: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:05.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:04 smithi159 ceph-mon[69013]: pgmap v8248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:05.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:04 smithi096 ceph-mon[101353]: pgmap v8248: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:07.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:06 smithi159 ceph-mon[69013]: pgmap v8249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:07.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:06 smithi096 ceph-mon[101353]: pgmap v8249: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:07.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 -- 172.21.15.96:0/3650410977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 msgr2=0x7f38dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 --2- 172.21.15.96:0/3650410977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc0f59e0 secure :-1 s=READY pgs=4208 cs=0 l=1 rev1=1 rx=0x7f38c4004660 tx=0x7f38c4009b30).stop 2022-02-02T22:57:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 -- 172.21.15.96:0/3650410977 shutdown_connections 2022-02-02T22:57:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 --2- 172.21.15.96:0/3650410977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 0x7f38dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 --2- 172.21.15.96:0/3650410977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc0f59e0 unknown :-1 s=CLOSED pgs=4208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 -- 172.21.15.96:0/3650410977 >> 172.21.15.96:0/3650410977 conn(0x7f38dc0f0d20 msgr2=0x7f38dc0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.398+0000 7f38e1485700 1 -- 172.21.15.96:0/3650410977 shutdown_connections 2022-02-02T22:57:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.399+0000 7f38e1485700 1 -- 172.21.15.96:0/3650410977 wait complete. 2022-02-02T22:57:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.399+0000 7f38e1485700 1 Processor -- start 2022-02-02T22:57:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38e1485700 1 -- start start 2022-02-02T22:57:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38e1485700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38e1485700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 0x7f38dc107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38e1485700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc107ad0 con 0x7f38dc0f55c0 2022-02-02T22:57:07.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38e1485700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc108380 con 0x7f38dc0f6860 2022-02-02T22:57:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51302/0 (socket says 172.21.15.96:51302) 2022-02-02T22:57:07.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 -- 172.21.15.96:0/3002074218 learned_addr learned my addr 172.21.15.96:0/3002074218 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38da7fc700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 0x7f38dc107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 -- 172.21.15.96:0/3002074218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 msgr2=0x7f38dc107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 0x7f38dc107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 -- 172.21.15.96:0/3002074218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4005040 con 0x7f38dc0f55c0 2022-02-02T22:57:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.400+0000 7f38daffd700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 secure :-1 s=READY pgs=4209 cs=0 l=1 rev1=1 rx=0x7f38c4004f60 tx=0x7f38c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.401+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c4018070 con 0x7f38dc0f55c0 2022-02-02T22:57:07.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.401+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38c4007ba0 con 0x7f38dc0f55c0 2022-02-02T22:57:07.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.401+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc108600 con 0x7f38dc0f55c0 2022-02-02T22:57:07.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.401+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c401c620 con 0x7f38dc0f55c0 2022-02-02T22:57:07.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.401+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc108b60 con 0x7f38dc0f55c0 2022-02-02T22:57:07.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.402+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0f49b0 con 0x7f38dc0f55c0 2022-02-02T22:57:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.403+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f38c401c8e0 con 0x7f38dc0f55c0 2022-02-02T22:57:07.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.403+0000 7f38d37fe700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 0x7f38c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.403+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f38c4083e10 con 0x7f38dc0f55c0 2022-02-02T22:57:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.403+0000 7f38da7fc700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 0x7f38c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.404+0000 7f38da7fc700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 0x7f38c8067290 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 rx=0x7f38cc00b790 tx=0x7f38cc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.407+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f38c4055940 con 0x7f38dc0f55c0 2022-02-02T22:57:07.586 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.586+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38dc0faca0 con 0x7f38c8064dd0 2022-02-02T22:57:07.587 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.587+0000 7f38d37fe700 1 -- 172.21.15.96:0/3002074218 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f38dc0faca0 con 0x7f38c8064dd0 2022-02-02T22:57:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.588+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 msgr2=0x7f38c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.588+0000 7f38e1485700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 0x7f38c8067290 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 rx=0x7f38cc00b790 tx=0x7f38cc008040).stop 2022-02-02T22:57:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.588+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 msgr2=0x7f38dc106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.588+0000 7f38e1485700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 secure :-1 s=READY pgs=4209 cs=0 l=1 rev1=1 rx=0x7f38c4004f60 tx=0x7f38c4009b30).stop 2022-02-02T22:57:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 shutdown_connections 2022-02-02T22:57:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f38c8064dd0 0x7f38c8067290 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38dc0f55c0 0x7f38dc106fa0 unknown :-1 s=CLOSED pgs=4209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 --2- 172.21.15.96:0/3002074218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc0f6860 0x7f38dc107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 >> 172.21.15.96:0/3002074218 conn(0x7f38dc0f0d20 msgr2=0x7f38dc05ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 shutdown_connections 2022-02-02T22:57:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.589+0000 7f38e1485700 1 -- 172.21.15.96:0/3002074218 wait complete. 2022-02-02T22:57:07.598 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:57:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 -- 172.21.15.96:0/600682708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f55c0 msgr2=0x7fd7580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/600682708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f55c0 0x7fd7580f59e0 secure :-1 s=READY pgs=4210 cs=0 l=1 rev1=1 rx=0x7fd754004660 tx=0x7fd754009b30).stop 2022-02-02T22:57:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 -- 172.21.15.96:0/600682708 shutdown_connections 2022-02-02T22:57:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/600682708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f6860 0x7fd7580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:07.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/600682708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f55c0 0x7fd7580f59e0 unknown :-1 s=CLOSED pgs=4210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 -- 172.21.15.96:0/600682708 >> 172.21.15.96:0/600682708 conn(0x7fd7580f0d40 msgr2=0x7fd7580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 -- 172.21.15.96:0/600682708 shutdown_connections 2022-02-02T22:57:07.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.686+0000 7fd75ff7c700 1 -- 172.21.15.96:0/600682708 wait complete. 2022-02-02T22:57:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 Processor -- start 2022-02-02T22:57:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 -- start start 2022-02-02T22:57:07.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f55c0 0x7fd7580f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580f8190 con 0x7fd7580f6860 2022-02-02T22:57:07.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75ff7c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580f82d0 con 0x7fd7580f55c0 2022-02-02T22:57:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75d517700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75d517700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51314/0 (socket says 172.21.15.96:51314) 2022-02-02T22:57:07.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75d517700 1 -- 172.21.15.96:0/3921493715 learned_addr learned my addr 172.21.15.96:0/3921493715 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:07.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.687+0000 7fd75dd18700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f55c0 0x7fd7580f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75d517700 1 -- 172.21.15.96:0/3921493715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f55c0 msgr2=0x7fd7580f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75d517700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f55c0 0x7fd7580f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75d517700 1 -- 172.21.15.96:0/3921493715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754005040 con 0x7fd7580f6860 2022-02-02T22:57:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75d517700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 secure :-1 s=READY pgs=4211 cs=0 l=1 rev1=1 rx=0x7fd74800b410 tx=0x7fd748006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7480125f0 con 0x7fd7580f6860 2022-02-02T22:57:07.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd74800be30 con 0x7fd7580f6860 2022-02-02T22:57:07.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580f85b0 con 0x7fd7580f6860 2022-02-02T22:57:07.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd748002a70 con 0x7fd7580f6860 2022-02-02T22:57:07.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.688+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75810efc0 con 0x7fd7580f6860 2022-02-02T22:57:07.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.689+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd758045ad0 con 0x7fd7580f6860 2022-02-02T22:57:07.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.689+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd74800f030 con 0x7fd7580f6860 2022-02-02T22:57:07.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.690+0000 7fd74e7fc700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 0x7fd744067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.690+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd748081dc0 con 0x7fd7580f6860 2022-02-02T22:57:07.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.690+0000 7fd75dd18700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 0x7fd744067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.690+0000 7fd75dd18700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 0x7fd744067290 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7fd754013690 tx=0x7fd754009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.694+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd74804fec0 con 0x7fd7580f6860 2022-02-02T22:57:07.868 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.868+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7580faca0 con 0x7fd744064dd0 2022-02-02T22:57:07.877 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.877+0000 7fd74e7fc700 1 -- 172.21.15.96:0/3921493715 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd7580faca0 con 0x7fd744064dd0 2022-02-02T22:57:07.877 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:57:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:57:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:57:07.878 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:57:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:57:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:57:07.879 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:57:07.880 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:57:07.880 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:57:07.881 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:57:07.881 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:57:07.881 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:57:07.882 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:57:07.882 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:57:07.882 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:57:07.883 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:57:07.883 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:57:07.883 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:57:07.884 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:57:07.884 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:57:07.885 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:57:07.885 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:57:07.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 msgr2=0x7fd744067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 0x7fd744067290 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7fd754013690 tx=0x7fd754009b30).stop 2022-02-02T22:57:07.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 msgr2=0x7fd7580f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 secure :-1 s=READY pgs=4211 cs=0 l=1 rev1=1 rx=0x7fd74800b410 tx=0x7fd748006ef0).stop 2022-02-02T22:57:07.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 shutdown_connections 2022-02-02T22:57:07.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd744064dd0 0x7fd744067290 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580f55c0 0x7fd7580f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 --2- 172.21.15.96:0/3921493715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7580f6860 0x7fd7580f7ba0 unknown :-1 s=CLOSED pgs=4211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 >> 172.21.15.96:0/3921493715 conn(0x7fd7580f0d40 msgr2=0x7fd75805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 shutdown_connections 2022-02-02T22:57:07.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.879+0000 7fd75ff7c700 1 -- 172.21.15.96:0/3921493715 wait complete. 2022-02-02T22:57:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 -- 172.21.15.96:0/3318806311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 msgr2=0x7fada00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 --2- 172.21.15.96:0/3318806311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada00f7de0 secure :-1 s=READY pgs=4212 cs=0 l=1 rev1=1 rx=0x7fad88004660 tx=0x7fad88009b30).stop 2022-02-02T22:57:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 -- 172.21.15.96:0/3318806311 shutdown_connections 2022-02-02T22:57:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 --2- 172.21.15.96:0/3318806311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada00f7de0 unknown :-1 s=CLOSED pgs=4212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 --2- 172.21.15.96:0/3318806311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 -- 172.21.15.96:0/3318806311 >> 172.21.15.96:0/3318806311 conn(0x7fada00f1e40 msgr2=0x7fada00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 -- 172.21.15.96:0/3318806311 shutdown_connections 2022-02-02T22:57:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.976+0000 7fada6c62700 1 -- 172.21.15.96:0/3318806311 wait complete. 2022-02-02T22:57:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.977+0000 7fada6c62700 1 Processor -- start 2022-02-02T22:57:07.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.977+0000 7fada6c62700 1 -- start start 2022-02-02T22:57:07.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.977+0000 7fada6c62700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fada6c62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fada6c62700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0107a00 con 0x7fada00f7980 2022-02-02T22:57:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fada6c62700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0107b40 con 0x7fada00f66e0 2022-02-02T22:57:07.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51324/0 (socket says 172.21.15.96:51324) 2022-02-02T22:57:07.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 -- 172.21.15.96:0/1319427068 learned_addr learned my addr 172.21.15.96:0/1319427068 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:07.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 -- 172.21.15.96:0/1319427068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 msgr2=0x7fada0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:07.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:07.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 -- 172.21.15.96:0/1319427068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88005040 con 0x7fada00f7980 2022-02-02T22:57:07.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9ffff700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 secure :-1 s=READY pgs=4213 cs=0 l=1 rev1=1 rx=0x7fad88009990 tx=0x7fad88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad88018070 con 0x7fada00f7980 2022-02-02T22:57:07.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada0108480 con 0x7fada00f7980 2022-02-02T22:57:07.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad88007ca0 con 0x7fada00f7980 2022-02-02T22:57:07.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad8801c620 con 0x7fada00f7980 2022-02-02T22:57:07.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.978+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada01089e0 con 0x7fada00f7980 2022-02-02T22:57:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.979+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0045ad0 con 0x7fada00f7980 2022-02-02T22:57:07.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.980+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad8801d960 con 0x7fada00f7980 2022-02-02T22:57:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.980+0000 7fad9d7fa700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.981+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fad880837e0 con 0x7fada00f7980 2022-02-02T22:57:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.981+0000 7fada49fe700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.981+0000 7fada49fe700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 rx=0x7fada00f77e0 tx=0x7fad90007a60).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:07.991 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:07.985+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad880553d0 con 0x7fada00f7980 2022-02-02T22:57:08.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.215+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fada0108c00 con 0x7fada00f7980 2022-02-02T22:57:08.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.215+0000 7fad9d7fa700 1 -- 172.21.15.96:0/1319427068 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fad88054fc0 con 0x7fada00f7980 2022-02-02T22:57:08.216 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:57:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:57:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:57:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:57:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:57:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:57:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:57:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:57:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:57:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:57:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:57:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:57:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:57:08.223 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:57:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 msgr2=0x7fad8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 rx=0x7fada00f77e0 tx=0x7fad90007a60).stop 2022-02-02T22:57:08.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 msgr2=0x7fada0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 secure :-1 s=READY pgs=4213 cs=0 l=1 rev1=1 rx=0x7fad88009990 tx=0x7fad88009b30).stop 2022-02-02T22:57:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 shutdown_connections 2022-02-02T22:57:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fad8c064dd0 0x7fad8c067290 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fada00f66e0 0x7fada0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 --2- 172.21.15.96:0/1319427068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fada00f7980 0x7fada0107450 unknown :-1 s=CLOSED pgs=4213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 >> 172.21.15.96:0/1319427068 conn(0x7fada00f1e40 msgr2=0x7fada00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 shutdown_connections 2022-02-02T22:57:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.217+0000 7fada6c62700 1 -- 172.21.15.96:0/1319427068 wait complete. 2022-02-02T22:57:08.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- 172.21.15.96:0/1703166906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 msgr2=0x7fe2380fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 --2- 172.21.15.96:0/1703166906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe2380fbc70 secure :-1 s=READY pgs=4214 cs=0 l=1 rev1=1 rx=0x7fe224004660 tx=0x7fe224009b30).stop 2022-02-02T22:57:08.317 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- 172.21.15.96:0/1703166906 shutdown_connections 2022-02-02T22:57:08.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 --2- 172.21.15.96:0/1703166906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe2380fbc70 unknown :-1 s=CLOSED pgs=4214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 --2- 172.21.15.96:0/1703166906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2380602d0 0x7fe2380f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.318 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- 172.21.15.96:0/1703166906 >> 172.21.15.96:0/1703166906 conn(0x7fe2380f0d40 msgr2=0x7fe2380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:08.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- 172.21.15.96:0/1703166906 shutdown_connections 2022-02-02T22:57:08.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- 172.21.15.96:0/1703166906 wait complete. 2022-02-02T22:57:08.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 Processor -- start 2022-02-02T22:57:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.315+0000 7fe23eec9700 1 -- start start 2022-02-02T22:57:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2380602d0 0x7fe238106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:08.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2381079e0 con 0x7fe2380f9860 2022-02-02T22:57:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe238107b20 con 0x7fe2380602d0 2022-02-02T22:57:08.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:08.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51334/0 (socket says 172.21.15.96:51334) 2022-02-02T22:57:08.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 -- 172.21.15.96:0/3062243052 learned_addr learned my addr 172.21.15.96:0/3062243052 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:08.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 -- 172.21.15.96:0/3062243052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2380602d0 msgr2=0x7fe238106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2380602d0 0x7fe238106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 -- 172.21.15.96:0/3062243052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224005040 con 0x7fe2380f9860 2022-02-02T22:57:08.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe237fff700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 secure :-1 s=READY pgs=4215 cs=0 l=1 rev1=1 rx=0x7fe224004f60 tx=0x7fe224009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe224018070 con 0x7fe2380f9860 2022-02-02T22:57:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe238108460 con 0x7fe2380f9860 2022-02-02T22:57:08.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe224007ba0 con 0x7fe2380f9860 2022-02-02T22:57:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22401c620 con 0x7fe2380f9860 2022-02-02T22:57:08.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.316+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2381089c0 con 0x7fe2380f9860 2022-02-02T22:57:08.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.317+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238045ad0 con 0x7fe2380f9860 2022-02-02T22:57:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.318+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe22401c8e0 con 0x7fe2380f9860 2022-02-02T22:57:08.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.318+0000 7fe2357fa700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 0x7fe228067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:08.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.318+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe224083960 con 0x7fe2380f9860 2022-02-02T22:57:08.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.318+0000 7fe23cc65700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 0x7fe228067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:08.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.318+0000 7fe23cc65700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 0x7fe228067290 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 rx=0x7fe22c004870 tx=0x7fe22c0079c0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:08.329 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.322+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe224055490 con 0x7fe2380f9860 2022-02-02T22:57:08.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.524+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2380fef90 con 0x7fe2380f9860 2022-02-02T22:57:08.524 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.524+0000 7fe2357fa700 1 -- 172.21.15.96:0/3062243052 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe224055080 con 0x7fe2380f9860 2022-02-02T22:57:08.525 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:57:08.525 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:57:08.526 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:57:08.526 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:57:08.526 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:57:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:57:08.527 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:57:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:57:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:57:08.528 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:57:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:57:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:57:08.529 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:57:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:57:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:57:08.530 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:57:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:57:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:57:08.531 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:57:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:57:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:57:08.532 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:57:08.533 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:57:08.533 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:57:08.534 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:57:08.534 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:57:08.534 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:57:08.535 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:57:08.535 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:57:08.535 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:57:08.536 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:57:08.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:08.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:08.537 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:57:08.537 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:08.537 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:08.538 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:08.538 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:08.539 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 msgr2=0x7fe228067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 0x7fe228067290 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 rx=0x7fe22c004870 tx=0x7fe22c0079c0).stop 2022-02-02T22:57:08.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 msgr2=0x7fe238107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:08.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 secure :-1 s=READY pgs=4215 cs=0 l=1 rev1=1 rx=0x7fe224004f60 tx=0x7fe224009b30).stop 2022-02-02T22:57:08.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 shutdown_connections 2022-02-02T22:57:08.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe228064dd0 0x7fe228067290 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2380602d0 0x7fe238106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 --2- 172.21.15.96:0/3062243052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2380f9860 0x7fe238107430 unknown :-1 s=CLOSED pgs=4215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:08.542 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 >> 172.21.15.96:0/3062243052 conn(0x7fe2380f0d40 msgr2=0x7fe2380f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:08.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 shutdown_connections 2022-02-02T22:57:08.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:08.526+0000 7fe23eec9700 1 -- 172.21.15.96:0/3062243052 wait complete. 2022-02-02T22:57:08.544 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:57:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:08 smithi159 ceph-mon[69013]: from='client.42546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:09.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:08 smithi159 ceph-mon[69013]: pgmap v8250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:08 smithi159 ceph-mon[69013]: from='client.42550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1319427068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:57:09.025 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:08 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3062243052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:57:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:08 smithi096 ceph-mon[101353]: from='client.42546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:09.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:08 smithi096 ceph-mon[101353]: pgmap v8250: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:08 smithi096 ceph-mon[101353]: from='client.42550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:09.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1319427068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:57:09.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:08 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3062243052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:57:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:10 smithi096 ceph-mon[101353]: pgmap v8251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:10 smithi159 ceph-mon[69013]: pgmap v8251: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:13.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:12 smithi096 ceph-mon[101353]: pgmap v8252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:12 smithi159 ceph-mon[69013]: pgmap v8252: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:15.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:14 smithi096 ceph-mon[101353]: pgmap v8253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:14 smithi159 ceph-mon[69013]: pgmap v8253: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:17.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:16 smithi096 ceph-mon[101353]: pgmap v8254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:16 smithi159 ceph-mon[69013]: pgmap v8254: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:19.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:18 smithi096 ceph-mon[101353]: pgmap v8255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:18 smithi159 ceph-mon[69013]: pgmap v8255: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:20 smithi096 ceph-mon[101353]: pgmap v8256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:20 smithi159 ceph-mon[69013]: pgmap v8256: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:23.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:22 smithi096 ceph-mon[101353]: pgmap v8257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:22 smithi159 ceph-mon[69013]: pgmap v8257: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:25.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:24 smithi096 ceph-mon[101353]: pgmap v8258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:24 smithi159 ceph-mon[69013]: pgmap v8258: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:27.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:26 smithi096 ceph-mon[101353]: pgmap v8259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:26 smithi159 ceph-mon[69013]: pgmap v8259: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:28 smithi159 ceph-mon[69013]: pgmap v8260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:57:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:57:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:28 smithi096 ceph-mon[101353]: pgmap v8260: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:57:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:57:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:30 smithi159 ceph-mon[69013]: pgmap v8261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:30 smithi096 ceph-mon[101353]: pgmap v8261: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:32 smithi096 ceph-mon[101353]: pgmap v8262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:32 smithi159 ceph-mon[69013]: pgmap v8262: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:34 smithi159 ceph-mon[69013]: pgmap v8263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:34 smithi096 ceph-mon[101353]: pgmap v8263: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:37.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:36 smithi159 ceph-mon[69013]: pgmap v8264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:36 smithi096 ceph-mon[101353]: pgmap v8264: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:38.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.636+0000 7fbaba811700 1 -- 172.21.15.96:0/1324414700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 msgr2=0x7fbab40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.636+0000 7fbaba811700 1 --2- 172.21.15.96:0/1324414700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab40f5860 secure :-1 s=READY pgs=4216 cs=0 l=1 rev1=1 rx=0x7fbaa4004660 tx=0x7fbaa4009b30).stop 2022-02-02T22:57:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 -- 172.21.15.96:0/1324414700 shutdown_connections 2022-02-02T22:57:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 --2- 172.21.15.96:0/1324414700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 0x7fbab40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 --2- 172.21.15.96:0/1324414700 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab40f5860 unknown :-1 s=CLOSED pgs=4216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 -- 172.21.15.96:0/1324414700 >> 172.21.15.96:0/1324414700 conn(0x7fbab40f0ba0 msgr2=0x7fbab40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 -- 172.21.15.96:0/1324414700 shutdown_connections 2022-02-02T22:57:38.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.637+0000 7fbaba811700 1 -- 172.21.15.96:0/1324414700 wait complete. 2022-02-02T22:57:38.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 Processor -- start 2022-02-02T22:57:38.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 -- start start 2022-02-02T22:57:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 0x7fbab410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40603c0 con 0x7fbab40f5440 2022-02-02T22:57:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbaba811700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4060500 con 0x7fbab40f66e0 2022-02-02T22:57:38.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.638+0000 7fbab980f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51352/0 (socket says 172.21.15.96:51352) 2022-02-02T22:57:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 -- 172.21.15.96:0/1244240217 learned_addr learned my addr 172.21.15.96:0/1244240217 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab900e700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 0x7fbab410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 -- 172.21.15.96:0/1244240217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 msgr2=0x7fbab410bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 0x7fbab410bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 -- 172.21.15.96:0/1244240217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4005040 con 0x7fbab40f5440 2022-02-02T22:57:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbab980f700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 secure :-1 s=READY pgs=4217 cs=0 l=1 rev1=1 rx=0x7fbaa4000c00 tx=0x7fbaa4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa4018070 con 0x7fbab40f5440 2022-02-02T22:57:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbaa4007d70 con 0x7fbab40f5440 2022-02-02T22:57:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab410c510 con 0x7fbab40f5440 2022-02-02T22:57:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa401c620 con 0x7fbab40f5440 2022-02-02T22:57:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.639+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab410ca40 con 0x7fbab40f5440 2022-02-02T22:57:38.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.640+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab4045ad0 con 0x7fbab40f5440 2022-02-02T22:57:38.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.641+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbaa401c860 con 0x7fbab40f5440 2022-02-02T22:57:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.641+0000 7fbaaa7fc700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 0x7fbaa00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.641+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbaa4083900 con 0x7fbab40f5440 2022-02-02T22:57:38.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.641+0000 7fbab900e700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 0x7fbaa00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.642+0000 7fbab900e700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 0x7fbaa00672e0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7fbab0007fd0 tx=0x7fbab0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:38.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.646+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbaa4051a00 con 0x7fbab40f5440 2022-02-02T22:57:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.826+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab40fdd70 con 0x7fbaa0064e20 2022-02-02T22:57:38.827 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.827+0000 7fbaaa7fc700 1 -- 172.21.15.96:0/1244240217 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbab40fdd70 con 0x7fbaa0064e20 2022-02-02T22:57:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 msgr2=0x7fbaa00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 0x7fbaa00672e0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7fbab0007fd0 tx=0x7fbab0009040).stop 2022-02-02T22:57:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 msgr2=0x7fbab4109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 secure :-1 s=READY pgs=4217 cs=0 l=1 rev1=1 rx=0x7fbaa4000c00 tx=0x7fbaa4009b30).stop 2022-02-02T22:57:38.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 shutdown_connections 2022-02-02T22:57:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fbaa0064e20 0x7fbaa00672e0 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab40f5440 0x7fbab4109ac0 unknown :-1 s=CLOSED pgs=4217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 --2- 172.21.15.96:0/1244240217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbab40f66e0 0x7fbab410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 >> 172.21.15.96:0/1244240217 conn(0x7fbab40f0ba0 msgr2=0x7fbab40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:38.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 shutdown_connections 2022-02-02T22:57:38.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.829+0000 7fbaba811700 1 -- 172.21.15.96:0/1244240217 wait complete. 2022-02-02T22:57:38.839 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:57:38.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 -- 172.21.15.96:0/2746148638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f5ef0 msgr2=0x7f93940f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 --2- 172.21.15.96:0/2746148638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f5ef0 0x7f93940f6920 secure :-1 s=READY pgs=4218 cs=0 l=1 rev1=1 rx=0x7f9384004660 tx=0x7f9384009b30).stop 2022-02-02T22:57:38.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 -- 172.21.15.96:0/2746148638 shutdown_connections 2022-02-02T22:57:38.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 --2- 172.21.15.96:0/2746148638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f5ef0 0x7f93940f6920 unknown :-1 s=CLOSED pgs=4218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 --2- 172.21.15.96:0/2746148638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f55e0 0x7f93940f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 -- 172.21.15.96:0/2746148638 >> 172.21.15.96:0/2746148638 conn(0x7f93940f0de0 msgr2=0x7f93940f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:38.929 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:38 smithi096 ceph-mon[101353]: pgmap v8265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:38.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 -- 172.21.15.96:0/2746148638 shutdown_connections 2022-02-02T22:57:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.927+0000 7f93995ad700 1 -- 172.21.15.96:0/2746148638 wait complete. 2022-02-02T22:57:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 Processor -- start 2022-02-02T22:57:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 -- start start 2022-02-02T22:57:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f5ef0 0x7f939410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940604e0 con 0x7f93940f55e0 2022-02-02T22:57:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93995ad700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9394060620 con 0x7f93940f5ef0 2022-02-02T22:57:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51360/0 (socket says 172.21.15.96:51360) 2022-02-02T22:57:38.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 -- 172.21.15.96:0/4080715063 learned_addr learned my addr 172.21.15.96:0/4080715063 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:38.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f93927fc700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f5ef0 0x7f939410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 -- 172.21.15.96:0/4080715063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f5ef0 msgr2=0x7f939410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f5ef0 0x7f939410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.928+0000 7f9392ffd700 1 -- 172.21.15.96:0/4080715063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384005040 con 0x7f93940f55e0 2022-02-02T22:57:38.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f9392ffd700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 secure :-1 s=READY pgs=4219 cs=0 l=1 rev1=1 rx=0x7f93880026d0 tx=0x7f9388009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:38.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93880079c0 con 0x7f93940f55e0 2022-02-02T22:57:38.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f938800f040 con 0x7f93940f55e0 2022-02-02T22:57:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939410c760 con 0x7f93940f55e0 2022-02-02T22:57:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93880148b0 con 0x7f93940f55e0 2022-02-02T22:57:38.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.929+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939410ccf0 con 0x7f93940f55e0 2022-02-02T22:57:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.930+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9374004fa0 con 0x7f93940f55e0 2022-02-02T22:57:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.930+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9388014a10 con 0x7f93940f55e0 2022-02-02T22:57:38.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.930+0000 7f937b7fe700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 0x7f937c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.930+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f93880818c0 con 0x7f93940f55e0 2022-02-02T22:57:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.931+0000 7f93927fc700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 0x7f937c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:38.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.931+0000 7f93927fc700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 0x7f937c067290 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 rx=0x7f9384004630 tx=0x7f9384009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:38.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:38.935+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f938804f9c0 con 0x7f93940f55e0 2022-02-02T22:57:39.108 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.108+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9374000bc0 con 0x7f937c064dd0 2022-02-02T22:57:39.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.117+0000 7f937b7fe700 1 -- 172.21.15.96:0/4080715063 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9374000bc0 con 0x7f937c064dd0 2022-02-02T22:57:39.117 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:57:39.118 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:57:39.118 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:57:39.118 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:57:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:57:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:57:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:57:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:57:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:57:39.120 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:57:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:57:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:57:39.121 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:57:39.122 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:57:39.122 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:57:39.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:57:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:57:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:57:39.124 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:57:39.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 msgr2=0x7f937c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 0x7f937c067290 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 rx=0x7f9384004630 tx=0x7f9384009b30).stop 2022-02-02T22:57:39.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 msgr2=0x7f9394109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 secure :-1 s=READY pgs=4219 cs=0 l=1 rev1=1 rx=0x7f93880026d0 tx=0x7f9388009de0).stop 2022-02-02T22:57:39.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 shutdown_connections 2022-02-02T22:57:39.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f937c064dd0 0x7f937c067290 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93940f55e0 0x7f9394109cb0 unknown :-1 s=CLOSED pgs=4219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 --2- 172.21.15.96:0/4080715063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93940f5ef0 0x7f939410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.128 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 >> 172.21.15.96:0/4080715063 conn(0x7f93940f0de0 msgr2=0x7f93940fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:39.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 shutdown_connections 2022-02-02T22:57:39.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.119+0000 7f93995ad700 1 -- 172.21.15.96:0/4080715063 wait complete. 2022-02-02T22:57:39.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 -- 172.21.15.96:0/2294135646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f6880 msgr2=0x7fb83c0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 --2- 172.21.15.96:0/2294135646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f6ce0 secure :-1 s=READY pgs=4220 cs=0 l=1 rev1=1 rx=0x7fb828004660 tx=0x7fb828009b30).stop 2022-02-02T22:57:39.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 -- 172.21.15.96:0/2294135646 shutdown_connections 2022-02-02T22:57:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 --2- 172.21.15.96:0/2294135646 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f6ce0 unknown :-1 s=CLOSED pgs=4220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 --2- 172.21.15.96:0/2294135646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:57:39.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 -- 172.21.15.96:0/2294135646 >> 172.21.15.96:0/2294135646 conn(0x7fb83c0f0d40 msgr2=0x7fb83c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 -- 172.21.15.96:0/2294135646 shutdown_connections 2022-02-02T22:57:39.220 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.215+0000 7fb8430b7700 1 -- 172.21.15.96:0/2294135646 wait complete. 2022-02-02T22:57:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 Processor -- start 2022-02-02T22:57:39.221 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 -- start start 2022-02-02T22:57:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.222 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c10ac70 con 0x7fb83c0f55e0 2022-02-02T22:57:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb8430b7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c10adb0 con 0x7fb83c0f6880 2022-02-02T22:57:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb840e53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.223 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb840e53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51370/0 (socket says 172.21.15.96:51370) 2022-02-02T22:57:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb840e53700 1 -- 172.21.15.96:0/3577070895 learned_addr learned my addr 172.21.15.96:0/3577070895 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.216+0000 7fb83bfff700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb840e53700 1 -- 172.21.15.96:0/3577070895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f6880 msgr2=0x7fb83c0f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb840e53700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb840e53700 1 -- 172.21.15.96:0/3577070895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828005040 con 0x7fb83c0f55e0 2022-02-02T22:57:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb840e53700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 secure :-1 s=READY pgs=4221 cs=0 l=1 rev1=1 rx=0x7fb8300093f0 tx=0x7fb830006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:39.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb830013640 con 0x7fb83c0f55e0 2022-02-02T22:57:39.226 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c0f8200 con 0x7fb83c0f55e0 2022-02-02T22:57:39.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb830013c50 con 0x7fb83c0f55e0 2022-02-02T22:57:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb830012c70 con 0x7fb83c0f55e0 2022-02-02T22:57:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.217+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c0f87c0 con 0x7fb83c0f55e0 2022-02-02T22:57:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.218+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c0f49d0 con 0x7fb83c0f55e0 2022-02-02T22:57:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.219+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb83001a060 con 0x7fb83c0f55e0 2022-02-02T22:57:39.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.219+0000 7fb8397fa700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 0x7fb82c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.219+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb8300819a0 con 0x7fb83c0f55e0 2022-02-02T22:57:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.219+0000 7fb83bfff700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 0x7fb82c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.219+0000 7fb83bfff700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 0x7fb82c067290 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 rx=0x7fb828004630 tx=0x7fb828009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:39.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.223+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb83004fa40 con 0x7fb83c0f55e0 2022-02-02T22:57:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:38 smithi159 ceph-mon[69013]: pgmap v8265: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:39.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.457+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb83c113b90 con 0x7fb83c0f55e0 2022-02-02T22:57:39.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.457+0000 7fb8397fa700 1 -- 172.21.15.96:0/3577070895 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fb830053060 con 0x7fb83c0f55e0 2022-02-02T22:57:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:57:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:57:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:57:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:57:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:57:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:39.461 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:57:39.461 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:57:39.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:39.462 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:57:39.462 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:57:39.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:57:39.463 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:57:39.463 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:57:39.463 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:57:39.464 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:57:39.464 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:57:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 msgr2=0x7fb82c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 0x7fb82c067290 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 rx=0x7fb828004630 tx=0x7fb828009b30).stop 2022-02-02T22:57:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 msgr2=0x7fb83c0f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 secure :-1 s=READY pgs=4221 cs=0 l=1 rev1=1 rx=0x7fb8300093f0 tx=0x7fb830006ec0).stop 2022-02-02T22:57:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 shutdown_connections 2022-02-02T22:57:39.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fb82c064dd0 0x7fb82c067290 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb83c0f55e0 0x7fb83c0f9740 unknown :-1 s=CLOSED pgs=4221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 --2- 172.21.15.96:0/3577070895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb83c0f6880 0x7fb83c0f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 >> 172.21.15.96:0/3577070895 conn(0x7fb83c0f0d40 msgr2=0x7fb83c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:39.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 shutdown_connections 2022-02-02T22:57:39.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.459+0000 7fb8430b7700 1 -- 172.21.15.96:0/3577070895 wait complete. 2022-02-02T22:57:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 -- 172.21.15.96:0/1768067171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f6860 msgr2=0x7f0c400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 --2- 172.21.15.96:0/1768067171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f6860 0x7f0c400f6cc0 secure :-1 s=READY pgs=4222 cs=0 l=1 rev1=1 rx=0x7f0c2c004660 tx=0x7f0c2c009b30).stop 2022-02-02T22:57:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 -- 172.21.15.96:0/1768067171 shutdown_connections 2022-02-02T22:57:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 --2- 172.21.15.96:0/1768067171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f6860 0x7f0c400f6cc0 unknown :-1 s=CLOSED pgs=4222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 --2- 172.21.15.96:0/1768067171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f55c0 0x7f0c400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 -- 172.21.15.96:0/1768067171 >> 172.21.15.96:0/1768067171 conn(0x7f0c400f0d40 msgr2=0x7f0c400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 -- 172.21.15.96:0/1768067171 shutdown_connections 2022-02-02T22:57:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.558+0000 7f0c47220700 1 -- 172.21.15.96:0/1768067171 wait complete. 2022-02-02T22:57:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 Processor -- start 2022-02-02T22:57:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 -- start start 2022-02-02T22:57:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f6860 0x7f0c400f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400f8920 con 0x7f0c400f55c0 2022-02-02T22:57:39.566 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c47220700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400f8a60 con 0x7f0c400f6860 2022-02-02T22:57:39.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c44fbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.567 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c44fbc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51380/0 (socket says 172.21.15.96:51380) 2022-02-02T22:57:39.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.559+0000 7f0c44fbc700 1 -- 172.21.15.96:0/154266798 learned_addr learned my addr 172.21.15.96:0/154266798 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:57:39.568 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c3ffff700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f6860 0x7f0c400f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c44fbc700 1 -- 172.21.15.96:0/154266798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f6860 msgr2=0x7f0c400f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c44fbc700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f6860 0x7f0c400f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.569 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c44fbc700 1 -- 172.21.15.96:0/154266798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c005040 con 0x7f0c400f55c0 2022-02-02T22:57:39.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c44fbc700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 secure :-1 s=READY pgs=4223 cs=0 l=1 rev1=1 rx=0x7f0c34002700 tx=0x7f0c34009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:39.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c340079c0 con 0x7f0c400f55c0 2022-02-02T22:57:39.570 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c400f8d40 con 0x7f0c400f55c0 2022-02-02T22:57:39.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0c3400f040 con 0x7f0c400f55c0 2022-02-02T22:57:39.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c34014860 con 0x7f0c400f55c0 2022-02-02T22:57:39.571 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.560+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4010ef90 con 0x7f0c400f55c0 2022-02-02T22:57:39.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.561+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c40045ad0 con 0x7f0c400f55c0 2022-02-02T22:57:39.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.562+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0c3401b060 con 0x7f0c400f55c0 2022-02-02T22:57:39.572 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.562+0000 7f0c3d7fa700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 0x7f0c30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:57:39.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.562+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0c34081900 con 0x7f0c400f55c0 2022-02-02T22:57:39.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.562+0000 7f0c3ffff700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 0x7f0c30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:57:39.573 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.563+0000 7f0c3ffff700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 0x7f0c30067290 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 rx=0x7f0c2c004630 tx=0x7f0c2c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:57:39.574 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.566+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0c3404fa00 con 0x7f0c400f55c0 2022-02-02T22:57:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.766+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0c400fdd80 con 0x7f0c400f55c0 2022-02-02T22:57:39.767 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.767+0000 7f0c3d7fa700 1 -- 172.21.15.96:0/154266798 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f0c34019070 con 0x7f0c400f55c0 2022-02-02T22:57:39.768 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:57:39.768 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:57:39.768 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:57:39.769 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:57:39.769 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:39.769 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:57:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:57:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:57:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:57:39.771 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:57:39.771 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:57:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:57:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:57:39.772 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:57:39.773 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:57:39.773 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:57:39.773 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:57:39.774 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:57:39.774 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:57:39.774 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:57:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:57:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:57:39.775 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:57:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:57:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:57:39.776 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:57:39.777 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:57:39.777 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:57:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:57:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:57:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:57:39.779 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:57:39.779 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:39.779 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:39.780 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:57:39.780 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:57:39.780 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:39.781 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:39.781 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:57:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.768+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 msgr2=0x7f0c30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.768+0000 7f0c47220700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 0x7f0c30067290 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 rx=0x7f0c2c004630 tx=0x7f0c2c009b30).stop 2022-02-02T22:57:39.783 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.768+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 msgr2=0x7f0c400f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:57:39.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.768+0000 7f0c47220700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 secure :-1 s=READY pgs=4223 cs=0 l=1 rev1=1 rx=0x7f0c34002700 tx=0x7f0c34009d80).stop 2022-02-02T22:57:39.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 shutdown_connections 2022-02-02T22:57:39.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0c30064dd0 0x7f0c30067290 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c400f55c0 0x7f0c400f9f40 unknown :-1 s=CLOSED pgs=4223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 --2- 172.21.15.96:0/154266798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c400f6860 0x7f0c400f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:57:39.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 >> 172.21.15.96:0/154266798 conn(0x7f0c400f0d40 msgr2=0x7f0c4005f600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:57:39.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 shutdown_connections 2022-02-02T22:57:39.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:57:39.769+0000 7f0c47220700 1 -- 172.21.15.96:0/154266798 wait complete. 2022-02-02T22:57:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:57:40.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:39 smithi159 ceph-mon[69013]: from='client.42562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:40.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:39 smithi159 ceph-mon[69013]: from='client.42566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3577070895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:57:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:39 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/154266798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:57:40.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:39 smithi096 ceph-mon[101353]: from='client.42562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:40.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:39 smithi096 ceph-mon[101353]: from='client.42566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:57:40.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3577070895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:57:40.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:39 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/154266798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:57:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:40 smithi159 ceph-mon[69013]: pgmap v8266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:40 smithi096 ceph-mon[101353]: pgmap v8266: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:42 smithi096 ceph-mon[101353]: pgmap v8267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:42 smithi159 ceph-mon[69013]: pgmap v8267: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:44 smithi159 ceph-mon[69013]: pgmap v8268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:44 smithi096 ceph-mon[101353]: pgmap v8268: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:46 smithi159 ceph-mon[69013]: pgmap v8269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:46 smithi096 ceph-mon[101353]: pgmap v8269: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:48 smithi159 ceph-mon[69013]: pgmap v8270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:48 smithi096 ceph-mon[101353]: pgmap v8270: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:50 smithi159 ceph-mon[69013]: pgmap v8271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:50 smithi096 ceph-mon[101353]: pgmap v8271: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:52 smithi096 ceph-mon[101353]: pgmap v8272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:52 smithi159 ceph-mon[69013]: pgmap v8272: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:54 smithi159 ceph-mon[69013]: pgmap v8273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:54 smithi096 ceph-mon[101353]: pgmap v8273: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:56 smithi159 ceph-mon[69013]: pgmap v8274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:56 smithi096 ceph-mon[101353]: pgmap v8274: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:57:58 smithi159 ceph-mon[69013]: pgmap v8275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:57:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:57:58 smithi096 ceph-mon[101353]: pgmap v8275: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:00 smithi159 ceph-mon[69013]: pgmap v8276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:00 smithi096 ceph-mon[101353]: pgmap v8276: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:02 smithi096 ceph-mon[101353]: pgmap v8277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:02 smithi159 ceph-mon[69013]: pgmap v8277: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:04 smithi159 ceph-mon[69013]: pgmap v8278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:05.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:04 smithi096 ceph-mon[101353]: pgmap v8278: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:06 smithi159 ceph-mon[69013]: pgmap v8279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:06 smithi096 ceph-mon[101353]: pgmap v8279: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:08 smithi159 ceph-mon[69013]: pgmap v8280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:08 smithi096 ceph-mon[101353]: pgmap v8280: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:09.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 -- 172.21.15.96:0/2155358791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 msgr2=0x7f36140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:09.880 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 --2- 172.21.15.96:0/2155358791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f36140f7c30 secure :-1 s=READY pgs=4224 cs=0 l=1 rev1=1 rx=0x7f3600004660 tx=0x7f3600009b30).stop 2022-02-02T22:58:09.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 -- 172.21.15.96:0/2155358791 shutdown_connections 2022-02-02T22:58:09.881 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 --2- 172.21.15.96:0/2155358791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f36140f7c30 unknown :-1 s=CLOSED pgs=4224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 --2- 172.21.15.96:0/2155358791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f36140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 -- 172.21.15.96:0/2155358791 >> 172.21.15.96:0/2155358791 conn(0x7f36140f1c90 msgr2=0x7f36140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:09.882 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 -- 172.21.15.96:0/2155358791 shutdown_connections 2022-02-02T22:58:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.878+0000 7f3619a14700 1 -- 172.21.15.96:0/2155358791 wait complete. 2022-02-02T22:58:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 Processor -- start 2022-02-02T22:58:09.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 -- start start 2022-02-02T22:58:09.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f3614106d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:09.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36141077b0 con 0x7f36140f77d0 2022-02-02T22:58:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3619a14700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3614107fb0 con 0x7f36140f6530 2022-02-02T22:58:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3613fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.879+0000 7f3613fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51400/0 (socket says 172.21.15.96:51400) 2022-02-02T22:58:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3613fff700 1 -- 172.21.15.96:0/2975064683 learned_addr learned my addr 172.21.15.96:0/2975064683 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3618a12700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f3614106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3613fff700 1 -- 172.21.15.96:0/2975064683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 msgr2=0x7f3614106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3613fff700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f3614106d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:09.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3613fff700 1 -- 172.21.15.96:0/2975064683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600005040 con 0x7f36140f77d0 2022-02-02T22:58:09.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3618a12700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f3614106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:58:09.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3613fff700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 secure :-1 s=READY pgs=4225 cs=0 l=1 rev1=1 rx=0x7f3600009990 tx=0x7f3600009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3600018070 con 0x7f36140f77d0 2022-02-02T22:58:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3600007ba0 con 0x7f36140f77d0 2022-02-02T22:58:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3614108230 con 0x7f36140f77d0 2022-02-02T22:58:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360001c3c0 con 0x7f36140f77d0 2022-02-02T22:58:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.880+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3614108710 con 0x7f36140f77d0 2022-02-02T22:58:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.881+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3614045ad0 con 0x7f36140f77d0 2022-02-02T22:58:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.882+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f360001d420 con 0x7f36140f77d0 2022-02-02T22:58:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.882+0000 7f36117fa700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 0x7f360406b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.882+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3600083740 con 0x7f36140f77d0 2022-02-02T22:58:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.882+0000 7f3618a12700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 0x7f360406b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.883+0000 7f3618a12700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 0x7f360406b6f0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 rx=0x7f36140f7630 tx=0x7f3608009c80).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:09.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:09.887+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f36000552d0 con 0x7f36140f77d0 2022-02-02T22:58:10.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.064+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3614108900 con 0x7f3604069230 2022-02-02T22:58:10.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.066+0000 7f36117fa700 1 -- 172.21.15.96:0/2975064683 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3614108900 con 0x7f3604069230 2022-02-02T22:58:10.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.067+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 msgr2=0x7f360406b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.067+0000 7f3619a14700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 0x7f360406b6f0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 rx=0x7f36140f7630 tx=0x7f3608009c80).stop 2022-02-02T22:58:10.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 msgr2=0x7f3614107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 secure :-1 s=READY pgs=4225 cs=0 l=1 rev1=1 rx=0x7f3600009990 tx=0x7f3600009b30).stop 2022-02-02T22:58:10.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 shutdown_connections 2022-02-02T22:58:10.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3604069230 0x7f360406b6f0 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140f6530 0x7f3614106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 --2- 172.21.15.96:0/2975064683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36140f77d0 0x7f3614107200 unknown :-1 s=CLOSED pgs=4225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.071 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 >> 172.21.15.96:0/2975064683 conn(0x7f36140f1c90 msgr2=0x7f36140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 shutdown_connections 2022-02-02T22:58:10.072 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.068+0000 7f3619a14700 1 -- 172.21.15.96:0/2975064683 wait complete. 2022-02-02T22:58:10.079 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:58:10.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 -- 172.21.15.96:0/4218092544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f6860 msgr2=0x7f840c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 --2- 172.21.15.96:0/4218092544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f6860 0x7f840c0f6cc0 secure :-1 s=READY pgs=4226 cs=0 l=1 rev1=1 rx=0x7f8400004660 tx=0x7f8400009b30).stop 2022-02-02T22:58:10.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 -- 172.21.15.96:0/4218092544 shutdown_connections 2022-02-02T22:58:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 --2- 172.21.15.96:0/4218092544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f6860 0x7f840c0f6cc0 unknown :-1 s=CLOSED pgs=4226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 --2- 172.21.15.96:0/4218092544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f55c0 0x7f840c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 -- 172.21.15.96:0/4218092544 >> 172.21.15.96:0/4218092544 conn(0x7f840c0f0d40 msgr2=0x7f840c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 -- 172.21.15.96:0/4218092544 shutdown_connections 2022-02-02T22:58:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.165+0000 7f8411af1700 1 -- 172.21.15.96:0/4218092544 wait complete. 2022-02-02T22:58:10.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 Processor -- start 2022-02-02T22:58:10.172 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 -- start start 2022-02-02T22:58:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 0x7f840c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.173 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0603c0 con 0x7f840c0f55c0 2022-02-02T22:58:10.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f8411af1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c060500 con 0x7f840c0f6860 2022-02-02T22:58:10.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f840b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f840b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51408/0 (socket says 172.21.15.96:51408) 2022-02-02T22:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.166+0000 7f840b7fe700 1 -- 172.21.15.96:0/466964162 learned_addr learned my addr 172.21.15.96:0/466964162 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840affd700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 0x7f840c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840b7fe700 1 -- 172.21.15.96:0/466964162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 msgr2=0x7f840c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840b7fe700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 0x7f840c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840b7fe700 1 -- 172.21.15.96:0/466964162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400005040 con 0x7f840c0f55c0 2022-02-02T22:58:10.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840affd700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 0x7f840c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f840b7fe700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 secure :-1 s=READY pgs=4227 cs=0 l=1 rev1=1 rx=0x7f83fc00c530 tx=0x7f83fc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83fc00f650 con 0x7f840c0f55c0 2022-02-02T22:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c10c720 con 0x7f840c0f55c0 2022-02-02T22:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83fc00fc60 con 0x7f840c0f55c0 2022-02-02T22:58:10.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83fc012d20 con 0x7f840c0f55c0 2022-02-02T22:58:10.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.167+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c10ccb0 con 0x7f840c0f55c0 2022-02-02T22:58:10.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.168+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c0f49b0 con 0x7f840c0f55c0 2022-02-02T22:58:10.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.168+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83fc019030 con 0x7f840c0f55c0 2022-02-02T22:58:10.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.169+0000 7f83f3fff700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 0x7f83f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.169+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83fc0816f0 con 0x7f840c0f55c0 2022-02-02T22:58:10.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.169+0000 7f840affd700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 0x7f83f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.169+0000 7f840affd700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 0x7f83f4067290 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 rx=0x7f8400009da0 tx=0x7f8400009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.173+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83fc04f980 con 0x7f840c0f55c0 2022-02-02T22:58:10.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.344+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f840c0fdef0 con 0x7f83f4064dd0 2022-02-02T22:58:10.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.354+0000 7f83f3fff700 1 -- 172.21.15.96:0/466964162 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f840c0fdef0 con 0x7f83f4064dd0 2022-02-02T22:58:10.355 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:58:10.355 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:58:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:58:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:58:10.356 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:58:10.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:58:10.357 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:58:10.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:58:10.358 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:58:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:58:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:58:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:58:10.360 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:58:10.360 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:58:10.361 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:58:10.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:58:10.362 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:58:10.362 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:58:10.362 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:58:10.363 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:58:10.363 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:58:10.363 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:58:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.355+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 msgr2=0x7f83f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.355+0000 7f8411af1700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 0x7f83f4067290 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 rx=0x7f8400009da0 tx=0x7f8400009b30).stop 2022-02-02T22:58:10.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.355+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 msgr2=0x7f840c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.355+0000 7f8411af1700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 secure :-1 s=READY pgs=4227 cs=0 l=1 rev1=1 rx=0x7f83fc00c530 tx=0x7f83fc007e10).stop 2022-02-02T22:58:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 shutdown_connections 2022-02-02T22:58:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f83f4064dd0 0x7f83f4067290 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c0f55c0 0x7f840c109c70 unknown :-1 s=CLOSED pgs=4227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 --2- 172.21.15.96:0/466964162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f840c0f6860 0x7f840c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 >> 172.21.15.96:0/466964162 conn(0x7f840c0f0d40 msgr2=0x7f840c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 shutdown_connections 2022-02-02T22:58:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.356+0000 7f8411af1700 1 -- 172.21.15.96:0/466964162 wait complete. 2022-02-02T22:58:10.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 -- 172.21.15.96:0/589342600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f6860 msgr2=0x7f84b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/589342600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f6860 0x7f84b40f6cc0 secure :-1 s=READY pgs=4228 cs=0 l=1 rev1=1 rx=0x7f84b0004660 tx=0x7f84b0009b30).stop 2022-02-02T22:58:10.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 -- 172.21.15.96:0/589342600 shutdown_connections 2022-02-02T22:58:10.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/589342600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f6860 0x7f84b40f6cc0 unknown :-1 s=CLOSED pgs=4228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/589342600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f55c0 0x7f84b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 -- 172.21.15.96:0/589342600 >> 172.21.15.96:0/589342600 conn(0x7f84b40f0d40 msgr2=0x7f84b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 -- 172.21.15.96:0/589342600 shutdown_connections 2022-02-02T22:58:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.452+0000 7f84bbfdb700 1 -- 172.21.15.96:0/589342600 wait complete. 2022-02-02T22:58:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 Processor -- start 2022-02-02T22:58:10.458 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 -- start start 2022-02-02T22:58:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f6860 0x7f84b4109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.459 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4109c00 con 0x7f84b40f55c0 2022-02-02T22:58:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84bbfdb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4109d40 con 0x7f84b40f6860 2022-02-02T22:58:10.460 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51418/0 (socket says 172.21.15.96:51418) 2022-02-02T22:58:10.461 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 -- 172.21.15.96:0/3532713575 learned_addr learned my addr 172.21.15.96:0/3532713575 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9576700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f6860 0x7f84b4109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 -- 172.21.15.96:0/3532713575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f6860 msgr2=0x7f84b4109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.462 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f6860 0x7f84b4109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 -- 172.21.15.96:0/3532713575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0005040 con 0x7f84b40f55c0 2022-02-02T22:58:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.453+0000 7f84b9d77700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 secure :-1 s=READY pgs=4229 cs=0 l=1 rev1=1 rx=0x7f84a4002700 tx=0x7f84a4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.463 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.454+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a40079c0 con 0x7f84b40f55c0 2022-02-02T22:58:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.454+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84a400f040 con 0x7f84b40f55c0 2022-02-02T22:58:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.454+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a4014860 con 0x7f84b40f55c0 2022-02-02T22:58:10.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.454+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b410a6e0 con 0x7f84b40f55c0 2022-02-02T22:58:10.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.454+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b410aca0 con 0x7f84b40f55c0 2022-02-02T22:58:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.455+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4045ad0 con 0x7f84b40f55c0 2022-02-02T22:58:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.456+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84a401b060 con 0x7f84b40f55c0 2022-02-02T22:58:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.456+0000 7f84aa7fc700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 0x7f84a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.456+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84a4081b30 con 0x7f84b40f55c0 2022-02-02T22:58:10.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.456+0000 7f84b9576700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 0x7f84a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.457+0000 7f84b9576700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 0x7f84a0067290 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f84b0004630 tx=0x7f84b0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.460+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84a4053720 con 0x7f84b40f55c0 2022-02-02T22:58:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.690+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84b410f7b0 con 0x7f84b40f55c0 2022-02-02T22:58:10.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.691+0000 7f84aa7fc700 1 -- 172.21.15.96:0/3532713575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f84a4019020 con 0x7f84b40f55c0 2022-02-02T22:58:10.693 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:58:10.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:58:10.693 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:58:10.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:10.694 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:58:10.694 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:58:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:58:10.695 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:58:10.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:10.696 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:58:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:58:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:10.697 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:58:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:58:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:58:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:58:10.699 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:58:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 msgr2=0x7f84a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 0x7f84a0067290 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f84b0004630 tx=0x7f84b0009b30).stop 2022-02-02T22:58:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 msgr2=0x7f84b4109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 secure :-1 s=READY pgs=4229 cs=0 l=1 rev1=1 rx=0x7f84a4002700 tx=0x7f84a4009d80).stop 2022-02-02T22:58:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 shutdown_connections 2022-02-02T22:58:10.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f84a0064dd0 0x7f84a0067290 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b40f55c0 0x7f84b4109160 unknown :-1 s=CLOSED pgs=4229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 --2- 172.21.15.96:0/3532713575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b40f6860 0x7f84b4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 >> 172.21.15.96:0/3532713575 conn(0x7f84b40f0d40 msgr2=0x7f84b405fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 shutdown_connections 2022-02-02T22:58:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.693+0000 7f84bbfdb700 1 -- 172.21.15.96:0/3532713575 wait complete. 2022-02-02T22:58:10.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2910210939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f55c0 msgr2=0x7f9a240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2910210939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f55c0 0x7f9a240f59e0 secure :-1 s=READY pgs=4230 cs=0 l=1 rev1=1 rx=0x7f9a0c004660 tx=0x7f9a0c009b30).stop 2022-02-02T22:58:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2910210939 shutdown_connections 2022-02-02T22:58:10.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2910210939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f6860 0x7f9a240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2910210939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f55c0 0x7f9a240f59e0 unknown :-1 s=CLOSED pgs=4230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2910210939 >> 172.21.15.96:0/2910210939 conn(0x7f9a240f0d40 msgr2=0x7f9a240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:10.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2910210939 shutdown_connections 2022-02-02T22:58:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2910210939 wait complete. 2022-02-02T22:58:10.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.791+0000 7f9a2a5ed700 1 Processor -- start 2022-02-02T22:58:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a2a5ed700 1 -- start start 2022-02-02T22:58:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a2a5ed700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f55c0 0x7f9a2410c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a2a5ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a2a5ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240602b0 con 0x7f9a240f6860 2022-02-02T22:58:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a2a5ed700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240603f0 con 0x7f9a240f55c0 2022-02-02T22:58:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51430/0 (socket says 172.21.15.96:51430) 2022-02-02T22:58:10.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 -- 172.21.15.96:0/2472486666 learned_addr learned my addr 172.21.15.96:0/2472486666 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:10.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a23fff700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f55c0 0x7f9a2410c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 -- 172.21.15.96:0/2472486666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f55c0 msgr2=0x7f9a2410c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f55c0 0x7f9a2410c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.792+0000 7f9a237fe700 1 -- 172.21.15.96:0/2472486666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c005040 con 0x7f9a240f6860 2022-02-02T22:58:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a237fe700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 secure :-1 s=READY pgs=4231 cs=0 l=1 rev1=1 rx=0x7f9a1400c510 tx=0x7f9a14007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1400f650 con 0x7f9a240f6860 2022-02-02T22:58:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2410eac0 con 0x7f9a240f6860 2022-02-02T22:58:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a1400fc60 con 0x7f9a240f6860 2022-02-02T22:58:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a14012c50 con 0x7f9a240f6860 2022-02-02T22:58:10.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.793+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2410ef40 con 0x7f9a240f6860 2022-02-02T22:58:10.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.794+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a14010070 con 0x7f9a240f6860 2022-02-02T22:58:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.794+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24045ad0 con 0x7f9a240f6860 2022-02-02T22:58:10.807 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.795+0000 7f9a20ff9700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 0x7f9a10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.795+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a140817a0 con 0x7f9a240f6860 2022-02-02T22:58:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.795+0000 7f9a23fff700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 0x7f9a10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.795+0000 7f9a23fff700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 0x7f9a10067290 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 rx=0x7f9a0c013690 tx=0x7f9a0c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:10.799+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a1404f8a0 con 0x7f9a240f6860 2022-02-02T22:58:11.002 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.001+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a24027a00 con 0x7f9a240f6860 2022-02-02T22:58:11.003 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.002+0000 7f9a20ff9700 1 -- 172.21.15.96:0/2472486666 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f9a14052ec0 con 0x7f9a240f6860 2022-02-02T22:58:11.003 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:58:11.004 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:58:11.004 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:58:11.005 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:58:11.005 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:11.005 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:58:11.006 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:58:11.006 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:58:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:58:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:58:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:58:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:58:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:58:11.008 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:58:11.009 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:58:11.009 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:58:11.010 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:58:11.011 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:58:11.011 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:58:11.012 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:58:11.012 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:58:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:58:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:58:11.013 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:58:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:58:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:58:11.014 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:58:11.015 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:58:11.015 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:58:11.015 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:58:11.016 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:58:11.016 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:58:11.016 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:11.017 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:11.017 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:58:11.017 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:11.018 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:11.018 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:11.018 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 msgr2=0x7f9a10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 0x7f9a10067290 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 rx=0x7f9a0c013690 tx=0x7f9a0c009b30).stop 2022-02-02T22:58:11.020 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 msgr2=0x7f9a2410e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 secure :-1 s=READY pgs=4231 cs=0 l=1 rev1=1 rx=0x7f9a1400c510 tx=0x7f9a14007e00).stop 2022-02-02T22:58:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 shutdown_connections 2022-02-02T22:58:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9a10064dd0 0x7f9a10067290 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a240f55c0 0x7f9a2410c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.003+0000 7f9a2a5ed700 1 --2- 172.21.15.96:0/2472486666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a240f6860 0x7f9a2410e5d0 unknown :-1 s=CLOSED pgs=4231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:11.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.004+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 >> 172.21.15.96:0/2472486666 conn(0x7f9a240f0d40 msgr2=0x7f9a240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:11.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.004+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 shutdown_connections 2022-02-02T22:58:11.023 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:11.004+0000 7f9a2a5ed700 1 -- 172.21.15.96:0/2472486666 wait complete. 2022-02-02T22:58:11.024 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:58:11.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:10 smithi096 ceph-mon[101353]: pgmap v8281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:10 smithi096 ceph-mon[101353]: from='client.42578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:11.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:10 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3532713575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:58:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:10 smithi159 ceph-mon[69013]: pgmap v8281: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:10 smithi159 ceph-mon[69013]: from='client.42578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:11.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:10 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3532713575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:58:12.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:11 smithi159 ceph-mon[69013]: from='client.42582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:12.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:11 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2472486666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:58:12.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:11 smithi096 ceph-mon[101353]: from='client.42582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:12.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:11 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2472486666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:58:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:12 smithi096 ceph-mon[101353]: pgmap v8282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:12 smithi159 ceph-mon[69013]: pgmap v8282: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:14 smithi159 ceph-mon[69013]: pgmap v8283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:15.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:14 smithi096 ceph-mon[101353]: pgmap v8283: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:16 smithi159 ceph-mon[69013]: pgmap v8284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:16 smithi096 ceph-mon[101353]: pgmap v8284: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:18 smithi159 ceph-mon[69013]: pgmap v8285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:18 smithi096 ceph-mon[101353]: pgmap v8285: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:20 smithi159 ceph-mon[69013]: pgmap v8286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:20 smithi096 ceph-mon[101353]: pgmap v8286: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:23.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:22 smithi096 ceph-mon[101353]: pgmap v8287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:23.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:22 smithi159 ceph-mon[69013]: pgmap v8287: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:24 smithi159 ceph-mon[69013]: pgmap v8288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:24 smithi096 ceph-mon[101353]: pgmap v8288: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:26 smithi159 ceph-mon[69013]: pgmap v8289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:28.671 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:26 smithi096 ceph-mon[101353]: pgmap v8289: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:28 smithi159 ceph-mon[69013]: pgmap v8290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:58:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:58:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:28 smithi096 ceph-mon[101353]: pgmap v8290: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:58:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:58:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:30 smithi159 ceph-mon[69013]: pgmap v8291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:30 smithi096 ceph-mon[101353]: pgmap v8291: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:32 smithi096 ceph-mon[101353]: pgmap v8292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:32 smithi159 ceph-mon[69013]: pgmap v8292: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:34 smithi159 ceph-mon[69013]: pgmap v8293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:34 smithi096 ceph-mon[101353]: pgmap v8293: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:36 smithi159 ceph-mon[69013]: pgmap v8294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:36 smithi096 ceph-mon[101353]: pgmap v8294: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:38 smithi159 ceph-mon[69013]: pgmap v8295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:38 smithi096 ceph-mon[101353]: pgmap v8295: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:41.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- 172.21.15.96:0/784025265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 msgr2=0x7f84b00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 --2- 172.21.15.96:0/784025265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b00f5850 secure :-1 s=READY pgs=4232 cs=0 l=1 rev1=1 rx=0x7f84a0004660 tx=0x7f84a0009b30).stop 2022-02-02T22:58:41.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- 172.21.15.96:0/784025265 shutdown_connections 2022-02-02T22:58:41.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 --2- 172.21.15.96:0/784025265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 --2- 172.21.15.96:0/784025265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b00f5850 unknown :-1 s=CLOSED pgs=4232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- 172.21.15.96:0/784025265 >> 172.21.15.96:0/784025265 conn(0x7f84b00f0b90 msgr2=0x7f84b00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- 172.21.15.96:0/784025265 shutdown_connections 2022-02-02T22:58:41.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- 172.21.15.96:0/784025265 wait complete. 2022-02-02T22:58:41.116 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 Processor -- start 2022-02-02T22:58:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.110+0000 7f84affff700 1 -- start start 2022-02-02T22:58:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84affff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b0109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84affff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84affff700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00603e0 con 0x7f84b00f5430 2022-02-02T22:58:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84affff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0060520 con 0x7f84b00f66d0 2022-02-02T22:58:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:55552/0 (socket says 172.21.15.96:55552) 2022-02-02T22:58:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 -- 172.21.15.96:0/1785756577 learned_addr learned my addr 172.21.15.96:0/1785756577 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84aeffd700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b0109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 -- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 msgr2=0x7f84b0109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b0109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84ae7fc700 1 -- 172.21.15.96:0/1785756577 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0005040 con 0x7f84b00f66d0 2022-02-02T22:58:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.111+0000 7f84aeffd700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b0109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T22:58:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84ae7fc700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84a40026d0 tx=0x7f84a4009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a4009320 con 0x7f84b00f66d0 2022-02-02T22:58:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84a400f040 con 0x7f84b00f66d0 2022-02-02T22:58:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a40147e0 con 0x7f84b00f66d0 2022-02-02T22:58:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b010c4d0 con 0x7f84b00f66d0 2022-02-02T22:58:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.112+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b010ca40 con 0x7f84b00f66d0 2022-02-02T22:58:41.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.113+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b0045ad0 con 0x7f84b00f66d0 2022-02-02T22:58:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.113+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84a4009480 con 0x7f84b00f66d0 2022-02-02T22:58:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.114+0000 7f84977fe700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 0x7f84980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.114+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f84a4082120 con 0x7f84b00f66d0 2022-02-02T22:58:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.114+0000 7f84aeffd700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 0x7f84980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.114+0000 7f84aeffd700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 0x7f84980672e0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7f84a0004e30 tx=0x7f84a0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.118+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84a4050220 con 0x7f84b00f66d0 2022-02-02T22:58:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:40 smithi159 ceph-mon[69013]: pgmap v8296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:41.296 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.295+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b0057f10 con 0x7f8498064e20 2022-02-02T22:58:41.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:40 smithi096 ceph-mon[101353]: pgmap v8296: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:41.297 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.296+0000 7f84977fe700 1 -- 172.21.15.96:0/1785756577 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f84b0057f10 con 0x7f8498064e20 2022-02-02T22:58:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 msgr2=0x7f84980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 0x7f84980672e0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7f84a0004e30 tx=0x7f84a0009b30).stop 2022-02-02T22:58:41.300 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 msgr2=0x7f84b010bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84a40026d0 tx=0x7f84a4009de0).stop 2022-02-02T22:58:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 shutdown_connections 2022-02-02T22:58:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8498064e20 0x7f84980672e0 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84b00f5430 0x7f84b0109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 --2- 172.21.15.96:0/1785756577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b00f66d0 0x7f84b010bf20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 >> 172.21.15.96:0/1785756577 conn(0x7f84b00f0b90 msgr2=0x7f84b00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 shutdown_connections 2022-02-02T22:58:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.298+0000 7f84affff700 1 -- 172.21.15.96:0/1785756577 wait complete. 2022-02-02T22:58:41.309 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:58:41.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- 172.21.15.96:0/402275644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f55c0 msgr2=0x7f40a80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 --2- 172.21.15.96:0/402275644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f55c0 0x7f40a80f59e0 secure :-1 s=READY pgs=4233 cs=0 l=1 rev1=1 rx=0x7f409c004660 tx=0x7f409c009b30).stop 2022-02-02T22:58:41.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- 172.21.15.96:0/402275644 shutdown_connections 2022-02-02T22:58:41.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 --2- 172.21.15.96:0/402275644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f6860 0x7f40a80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:58:41.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 --2- 172.21.15.96:0/402275644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f55c0 0x7f40a80f59e0 unknown :-1 s=CLOSED pgs=4233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- 172.21.15.96:0/402275644 >> 172.21.15.96:0/402275644 conn(0x7f40a80f0d40 msgr2=0x7f40a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- 172.21.15.96:0/402275644 shutdown_connections 2022-02-02T22:58:41.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- 172.21.15.96:0/402275644 wait complete. 2022-02-02T22:58:41.401 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 Processor -- start 2022-02-02T22:58:41.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.397+0000 7f40aecdc700 1 -- start start 2022-02-02T22:58:41.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40aecdc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f55c0 0x7f40a80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40aecdc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40aecdc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80f8190 con 0x7f40a80f6860 2022-02-02T22:58:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40aecdc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80f82d0 con 0x7f40a80f55c0 2022-02-02T22:58:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51458/0 (socket says 172.21.15.96:51458) 2022-02-02T22:58:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 -- 172.21.15.96:0/3951862037 learned_addr learned my addr 172.21.15.96:0/3951862037 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40aca78700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f55c0 0x7f40a80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 -- 172.21.15.96:0/3951862037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f55c0 msgr2=0x7f40a80f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f55c0 0x7f40a80f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 -- 172.21.15.96:0/3951862037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c005040 con 0x7f40a80f6860 2022-02-02T22:58:41.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.398+0000 7f40a7fff700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 secure :-1 s=READY pgs=4234 cs=0 l=1 rev1=1 rx=0x7f409400b410 tx=0x7f4094006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.399+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40940125f0 con 0x7f40a80f6860 2022-02-02T22:58:41.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.399+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f409400be30 con 0x7f40a80f6860 2022-02-02T22:58:41.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.399+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80f85b0 con 0x7f40a80f6860 2022-02-02T22:58:41.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.399+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094002a70 con 0x7f40a80f6860 2022-02-02T22:58:41.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.399+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a810efc0 con 0x7f40a80f6860 2022-02-02T22:58:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.400+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8045ad0 con 0x7f40a80f6860 2022-02-02T22:58:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.400+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f409400f030 con 0x7f40a80f6860 2022-02-02T22:58:41.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.400+0000 7f40a57fa700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.400+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4094081d80 con 0x7f40a80f6860 2022-02-02T22:58:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.401+0000 7f40aca78700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.401+0000 7f40aca78700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 rx=0x7f409c013690 tx=0x7f409c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.405+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f409404fe80 con 0x7f40a80f6860 2022-02-02T22:58:41.579 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.579+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a80faca0 con 0x7f4098064dd0 2022-02-02T22:58:41.589 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.588+0000 7f40a57fa700 1 -- 172.21.15.96:0/3951862037 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f40a80faca0 con 0x7f4098064dd0 2022-02-02T22:58:41.589 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:58:41.590 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:58:41.590 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:58:41.590 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:58:41.591 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:58:41.591 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:58:41.592 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:58:41.592 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:58:41.592 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:58:41.593 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:58:41.593 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:58:41.593 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:58:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:58:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:58:41.594 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:58:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:58:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:58:41.595 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:58:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:58:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:58:41.596 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:58:41.597 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:58:41.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 msgr2=0x7f4098067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 rx=0x7f409c013690 tx=0x7f409c009b30).stop 2022-02-02T22:58:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 msgr2=0x7f40a80f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 secure :-1 s=READY pgs=4234 cs=0 l=1 rev1=1 rx=0x7f409400b410 tx=0x7f4094006ef0).stop 2022-02-02T22:58:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 shutdown_connections 2022-02-02T22:58:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f4098064dd0 0x7f4098067290 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40a80f55c0 0x7f40a80f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 --2- 172.21.15.96:0/3951862037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a80f6860 0x7f40a80f7ba0 unknown :-1 s=CLOSED pgs=4234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 >> 172.21.15.96:0/3951862037 conn(0x7f40a80f0d40 msgr2=0x7f40a805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 shutdown_connections 2022-02-02T22:58:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.590+0000 7f40aecdc700 1 -- 172.21.15.96:0/3951862037 wait complete. 2022-02-02T22:58:41.688 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- 172.21.15.96:0/3779961613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f55e0 msgr2=0x7fce840f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 --2- 172.21.15.96:0/3779961613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f55e0 0x7fce840f5a00 secure :-1 s=READY pgs=4235 cs=0 l=1 rev1=1 rx=0x7fce74004660 tx=0x7fce74009b30).stop 2022-02-02T22:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- 172.21.15.96:0/3779961613 shutdown_connections 2022-02-02T22:58:41.689 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 --2- 172.21.15.96:0/3779961613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f5ef0 0x7fce840f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:58:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 --2- 172.21.15.96:0/3779961613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f55e0 0x7fce840f5a00 unknown :-1 s=CLOSED pgs=4235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- 172.21.15.96:0/3779961613 >> 172.21.15.96:0/3779961613 conn(0x7fce840f0de0 msgr2=0x7fce840f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.690 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- 172.21.15.96:0/3779961613 shutdown_connections 2022-02-02T22:58:41.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- 172.21.15.96:0/3779961613 wait complete. 2022-02-02T22:58:41.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 Processor -- start 2022-02-02T22:58:41.691 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.687+0000 7fce8c087700 1 -- start start 2022-02-02T22:58:41.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce8c087700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f55e0 0x7fce8410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce8c087700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce8c087700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840603d0 con 0x7fce840f5ef0 2022-02-02T22:58:41.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce8c087700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84060510 con 0x7fce840f55e0 2022-02-02T22:58:41.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51468/0 (socket says 172.21.15.96:51468) 2022-02-02T22:58:41.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 -- 172.21.15.96:0/304175313 learned_addr learned my addr 172.21.15.96:0/304175313 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:41.696 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89e23700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f55e0 0x7fce8410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 -- 172.21.15.96:0/304175313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f55e0 msgr2=0x7fce8410c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f55e0 0x7fce8410c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.697 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 -- 172.21.15.96:0/304175313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74005040 con 0x7fce840f5ef0 2022-02-02T22:58:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce89622700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 secure :-1 s=READY pgs=4236 cs=0 l=1 rev1=1 rx=0x7fce8000b410 tx=0x7fce80006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce800125f0 con 0x7fce840f5ef0 2022-02-02T22:58:41.698 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce8000be30 con 0x7fce840f5ef0 2022-02-02T22:58:41.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce80002a70 con 0x7fce840f5ef0 2022-02-02T22:58:41.699 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.688+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8410ea80 con 0x7fce840f5ef0 2022-02-02T22:58:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.689+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8410ef60 con 0x7fce840f5ef0 2022-02-02T22:58:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.690+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce84045ad0 con 0x7fce840f5ef0 2022-02-02T22:58:41.700 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.690+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce8000f030 con 0x7fce840f5ef0 2022-02-02T22:58:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.690+0000 7fce7a7fc700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 0x7fce70067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.691+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fce80081dc0 con 0x7fce840f5ef0 2022-02-02T22:58:41.701 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.691+0000 7fce89e23700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 0x7fce70067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.691+0000 7fce89e23700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 0x7fce70067290 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 rx=0x7fce74004630 tx=0x7fce74009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:41.702 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.695+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce8004fec0 con 0x7fce840f5ef0 2022-02-02T22:58:41.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.925+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce840fdef0 con 0x7fce840f5ef0 2022-02-02T22:58:41.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.926+0000 7fce7a7fc700 1 -- 172.21.15.96:0/304175313 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fce800534e0 con 0x7fce840f5ef0 2022-02-02T22:58:41.928 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:58:41.928 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:58:41.929 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:58:41.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:41.929 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:58:41.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:58:41.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:41.930 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:58:41.931 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:58:41.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:41.931 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:58:41.932 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:58:41.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:58:41.932 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:58:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:58:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:58:41.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:58:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:58:41.934 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 msgr2=0x7fce70067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 0x7fce70067290 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 rx=0x7fce74004630 tx=0x7fce74009b30).stop 2022-02-02T22:58:41.935 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 msgr2=0x7fce8410e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 secure :-1 s=READY pgs=4236 cs=0 l=1 rev1=1 rx=0x7fce8000b410 tx=0x7fce80006ef0).stop 2022-02-02T22:58:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 shutdown_connections 2022-02-02T22:58:41.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fce70064dd0 0x7fce70067290 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840f55e0 0x7fce8410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 --2- 172.21.15.96:0/304175313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce840f5ef0 0x7fce8410e590 unknown :-1 s=CLOSED pgs=4236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:41.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 >> 172.21.15.96:0/304175313 conn(0x7fce840f0de0 msgr2=0x7fce840fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:41.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.928+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 shutdown_connections 2022-02-02T22:58:41.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:41.929+0000 7fce8c087700 1 -- 172.21.15.96:0/304175313 wait complete. 2022-02-02T22:58:42.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/2468856983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f7980 msgr2=0x7fc9d00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:42.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/2468856983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f7980 0x7fc9d00f7de0 secure :-1 s=READY pgs=4237 cs=0 l=1 rev1=1 rx=0x7fc9c0004660 tx=0x7fc9c0009b30).stop 2022-02-02T22:58:42.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/2468856983 shutdown_connections 2022-02-02T22:58:42.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/2468856983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f7980 0x7fc9d00f7de0 unknown :-1 s=CLOSED pgs=4237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.028 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/2468856983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f66e0 0x7fc9d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/2468856983 >> 172.21.15.96:0/2468856983 conn(0x7fc9d00f1e40 msgr2=0x7fc9d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:42.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/2468856983 shutdown_connections 2022-02-02T22:58:42.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/2468856983 wait complete. 2022-02-02T22:58:42.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.026+0000 7fc9d5d6c700 1 Processor -- start 2022-02-02T22:58:42.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9d5d6c700 1 -- start start 2022-02-02T22:58:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9d5d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9d5d6c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f7980 0x7fc9d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:42.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9d5d6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d006a380 con 0x7fc9d00f66e0 2022-02-02T22:58:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9d5d6c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d006a4c0 con 0x7fc9d00f7980 2022-02-02T22:58:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:42.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51476/0 (socket says 172.21.15.96:51476) 2022-02-02T22:58:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 -- 172.21.15.96:0/1201604598 learned_addr learned my addr 172.21.15.96:0/1201604598 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:58:42.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9ceffd700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f7980 0x7fc9d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 -- 172.21.15.96:0/1201604598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f7980 msgr2=0x7fc9d0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f7980 0x7fc9d0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 -- 172.21.15.96:0/1201604598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0005040 con 0x7fc9d00f66e0 2022-02-02T22:58:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.027+0000 7fc9cf7fe700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 secure :-1 s=READY pgs=4238 cs=0 l=1 rev1=1 rx=0x7fc9c4002700 tx=0x7fc9c4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.028+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c4009320 con 0x7fc9d00f66e0 2022-02-02T22:58:42.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.028+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc9c400f040 con 0x7fc9d00f66e0 2022-02-02T22:58:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.028+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d006a7a0 con 0x7fc9d00f66e0 2022-02-02T22:58:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.028+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c40148e0 con 0x7fc9d00f66e0 2022-02-02T22:58:42.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.028+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d010ef40 con 0x7fc9d00f66e0 2022-02-02T22:58:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.029+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0045ad0 con 0x7fc9d00f66e0 2022-02-02T22:58:42.039 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.029+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc9c4009480 con 0x7fc9d00f66e0 2022-02-02T22:58:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.029+0000 7fc9b7fff700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 0x7fc9b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:58:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.030+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc9c4081ca0 con 0x7fc9d00f66e0 2022-02-02T22:58:42.040 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.030+0000 7fc9ceffd700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 0x7fc9b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:58:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.030+0000 7fc9ceffd700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 0x7fc9b8067290 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 rx=0x7fc9c0004630 tx=0x7fc9c0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:58:42.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.034+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc9c4086070 con 0x7fc9d00f66e0 2022-02-02T22:58:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.237+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9d00fefa0 con 0x7fc9d00f66e0 2022-02-02T22:58:42.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:41 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/304175313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:58:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.237+0000 7fc9b7fff700 1 -- 172.21.15.96:0/1201604598 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fc9c404fe60 con 0x7fc9d00f66e0 2022-02-02T22:58:42.240 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:58:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:58:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:58:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:58:42.242 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:42.242 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:58:42.242 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:58:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:58:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:58:42.243 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:58:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:58:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:58:42.244 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:58:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:58:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:58:42.245 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:58:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:58:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:58:42.246 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:58:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:58:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:58:42.247 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:58:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:58:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:58:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:58:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:58:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:58:42.249 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:58:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:58:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:58:42.250 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:58:42.251 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:58:42.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:42.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:42.252 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:58:42.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:58:42.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:42.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:42.253 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:58:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 msgr2=0x7fc9b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 0x7fc9b8067290 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 rx=0x7fc9c0004630 tx=0x7fc9c0009b30).stop 2022-02-02T22:58:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 msgr2=0x7fc9d006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:58:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 secure :-1 s=READY pgs=4238 cs=0 l=1 rev1=1 rx=0x7fc9c4002700 tx=0x7fc9c4009e00).stop 2022-02-02T22:58:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 shutdown_connections 2022-02-02T22:58:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc9b8064dd0 0x7fc9b8067290 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9d00f66e0 0x7fc9d006b9a0 unknown :-1 s=CLOSED pgs=4238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 --2- 172.21.15.96:0/1201604598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d00f7980 0x7fc9d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:58:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 >> 172.21.15.96:0/1201604598 conn(0x7fc9d00f1e40 msgr2=0x7fc9d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:58:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 shutdown_connections 2022-02-02T22:58:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:58:42.240+0000 7fc9d5d6c700 1 -- 172.21.15.96:0/1201604598 wait complete. 2022-02-02T22:58:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:58:42.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:41 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/304175313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:58:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:42 smithi096 ceph-mon[101353]: from='client.49567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:42 smithi096 ceph-mon[101353]: from='client.42596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:43.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:42 smithi096 ceph-mon[101353]: pgmap v8297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:43.238 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:42 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1201604598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:58:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:42 smithi159 ceph-mon[69013]: from='client.49567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:42 smithi159 ceph-mon[69013]: from='client.42596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:58:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:42 smithi159 ceph-mon[69013]: pgmap v8297: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:43.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:42 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1201604598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:58:45.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:44 smithi159 ceph-mon[69013]: pgmap v8298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:44 smithi096 ceph-mon[101353]: pgmap v8298: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:46 smithi159 ceph-mon[69013]: pgmap v8299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:46 smithi096 ceph-mon[101353]: pgmap v8299: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:48 smithi159 ceph-mon[69013]: pgmap v8300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:48 smithi096 ceph-mon[101353]: pgmap v8300: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:50 smithi159 ceph-mon[69013]: pgmap v8301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:51.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:50 smithi096 ceph-mon[101353]: pgmap v8301: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:52 smithi096 ceph-mon[101353]: pgmap v8302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:52 smithi159 ceph-mon[69013]: pgmap v8302: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:54 smithi159 ceph-mon[69013]: pgmap v8303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:54 smithi096 ceph-mon[101353]: pgmap v8303: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:56 smithi159 ceph-mon[69013]: pgmap v8304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:56 smithi096 ceph-mon[101353]: pgmap v8304: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:58:58 smithi159 ceph-mon[69013]: pgmap v8305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:58:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:58:58 smithi096 ceph-mon[101353]: pgmap v8305: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:00 smithi159 ceph-mon[69013]: pgmap v8306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:00 smithi096 ceph-mon[101353]: pgmap v8306: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:02 smithi096 ceph-mon[101353]: pgmap v8307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:02 smithi159 ceph-mon[69013]: pgmap v8307: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:04 smithi159 ceph-mon[69013]: pgmap v8308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:04 smithi096 ceph-mon[101353]: pgmap v8308: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:07.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:06 smithi159 ceph-mon[69013]: pgmap v8309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:06 smithi096 ceph-mon[101353]: pgmap v8309: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:08 smithi159 ceph-mon[69013]: pgmap v8310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:08 smithi096 ceph-mon[101353]: pgmap v8310: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:10 smithi159 ceph-mon[69013]: pgmap v8311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:10 smithi096 ceph-mon[101353]: pgmap v8311: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:12.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 -- 172.21.15.96:0/1258715656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f7980 msgr2=0x7ff9d80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 --2- 172.21.15.96:0/1258715656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f7980 0x7ff9d80f7de0 secure :-1 s=READY pgs=4239 cs=0 l=1 rev1=1 rx=0x7ff9d4004660 tx=0x7ff9d4009b30).stop 2022-02-02T22:59:12.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 -- 172.21.15.96:0/1258715656 shutdown_connections 2022-02-02T22:59:12.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 --2- 172.21.15.96:0/1258715656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f7980 0x7ff9d80f7de0 unknown :-1 s=CLOSED pgs=4239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 --2- 172.21.15.96:0/1258715656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f66e0 0x7ff9d80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 -- 172.21.15.96:0/1258715656 >> 172.21.15.96:0/1258715656 conn(0x7ff9d80f1e40 msgr2=0x7ff9d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:12.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 -- 172.21.15.96:0/1258715656 shutdown_connections 2022-02-02T22:59:12.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.352+0000 7ff9e0069700 1 -- 172.21.15.96:0/1258715656 wait complete. 2022-02-02T22:59:12.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 Processor -- start 2022-02-02T22:59:12.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 -- start start 2022-02-02T22:59:12.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f7980 0x7ff9d8107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81079b0 con 0x7ff9d80f66e0 2022-02-02T22:59:12.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9e0069700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8107af0 con 0x7ff9d80f7980 2022-02-02T22:59:12.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51494/0 (socket says 172.21.15.96:51494) 2022-02-02T22:59:12.359 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 -- 172.21.15.96:0/4006336717 learned_addr learned my addr 172.21.15.96:0/4006336717 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:12.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dd604700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f7980 0x7ff9d8107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 -- 172.21.15.96:0/4006336717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f7980 msgr2=0x7ff9d8107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.360 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f7980 0x7ff9d8107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.353+0000 7ff9dde05700 1 -- 172.21.15.96:0/4006336717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4005040 con 0x7ff9d80f66e0 2022-02-02T22:59:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9dde05700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 secure :-1 s=READY pgs=4240 cs=0 l=1 rev1=1 rx=0x7ff9cc00e7c0 tx=0x7ff9cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.361 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc0092e0 con 0x7ff9d80f66e0 2022-02-02T22:59:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d8108490 con 0x7ff9d80f66e0 2022-02-02T22:59:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9cc00f040 con 0x7ff9d80f66e0 2022-02-02T22:59:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc014750 con 0x7ff9d80f66e0 2022-02-02T22:59:12.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.354+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d8108a50 con 0x7ff9d80f66e0 2022-02-02T22:59:12.364 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.355+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8045ad0 con 0x7ff9d80f66e0 2022-02-02T22:59:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.355+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9cc01b030 con 0x7ff9d80f66e0 2022-02-02T22:59:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.356+0000 7ff9ca7fc700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 0x7ff9c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.356+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff9cc081b00 con 0x7ff9d80f66e0 2022-02-02T22:59:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.356+0000 7ff9dd604700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 0x7ff9c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.356+0000 7ff9dd604700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 0x7ff9c4067290 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 rx=0x7ff9d4004d80 tx=0x7ff9d400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.360+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9cc053630 con 0x7ff9d80f66e0 2022-02-02T22:59:12.540 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.540+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d8108c70 con 0x7ff9c4064dd0 2022-02-02T22:59:12.541 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.541+0000 7ff9ca7fc700 1 -- 172.21.15.96:0/4006336717 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff9d8108c70 con 0x7ff9c4064dd0 2022-02-02T22:59:12.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 msgr2=0x7ff9c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 0x7ff9c4067290 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 rx=0x7ff9d4004d80 tx=0x7ff9d400b040).stop 2022-02-02T22:59:12.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 msgr2=0x7ff9d8106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 secure :-1 s=READY pgs=4240 cs=0 l=1 rev1=1 rx=0x7ff9cc00e7c0 tx=0x7ff9cc00b040).stop 2022-02-02T22:59:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 shutdown_connections 2022-02-02T22:59:12.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff9c4064dd0 0x7ff9c4067290 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80f66e0 0x7ff9d8106f10 unknown :-1 s=CLOSED pgs=4240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 --2- 172.21.15.96:0/4006336717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80f7980 0x7ff9d8107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 >> 172.21.15.96:0/4006336717 conn(0x7ff9d80f1e40 msgr2=0x7ff9d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:12.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 shutdown_connections 2022-02-02T22:59:12.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.543+0000 7ff9e0069700 1 -- 172.21.15.96:0/4006336717 wait complete. 2022-02-02T22:59:12.553 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:59:12.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.640+0000 7f3341258700 1 -- 172.21.15.96:0/2354452129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 msgr2=0x7f333c0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.640+0000 7f3341258700 1 --2- 172.21.15.96:0/2354452129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7000 secure :-1 s=READY pgs=4241 cs=0 l=1 rev1=1 rx=0x7f3330004660 tx=0x7f3330009b30).stop 2022-02-02T22:59:12.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 -- 172.21.15.96:0/2354452129 shutdown_connections 2022-02-02T22:59:12.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 --2- 172.21.15.96:0/2354452129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 0x7f333c0f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 --2- 172.21.15.96:0/2354452129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7000 unknown :-1 s=CLOSED pgs=4241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 -- 172.21.15.96:0/2354452129 >> 172.21.15.96:0/2354452129 conn(0x7f333c0f04c0 msgr2=0x7f333c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:12.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 -- 172.21.15.96:0/2354452129 shutdown_connections 2022-02-02T22:59:12.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 -- 172.21.15.96:0/2354452129 wait complete. 2022-02-02T22:59:12.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 Processor -- start 2022-02-02T22:59:12.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.641+0000 7f3341258700 1 -- start start 2022-02-02T22:59:12.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f3341258700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 0x7f333c0f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f3341258700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f3341258700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0f81e0 con 0x7f333c0f6be0 2022-02-02T22:59:12.648 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f3341258700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0f8320 con 0x7f333c0f5930 2022-02-02T22:59:12.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51504/0 (socket says 172.21.15.96:51504) 2022-02-02T22:59:12.649 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 -- 172.21.15.96:0/2703705477 learned_addr learned my addr 172.21.15.96:0/2703705477 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333ad9d700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 0x7f333c0f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 -- 172.21.15.96:0/2703705477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 msgr2=0x7f333c0f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 0x7f333c0f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 -- 172.21.15.96:0/2703705477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330005040 con 0x7f333c0f6be0 2022-02-02T22:59:12.651 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.642+0000 7f333a59c700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 secure :-1 s=READY pgs=4242 cs=0 l=1 rev1=1 rx=0x7f332c002700 tx=0x7f332c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.643+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f332c0079c0 con 0x7f333c0f6be0 2022-02-02T22:59:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.643+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f332c00f040 con 0x7f333c0f6be0 2022-02-02T22:59:12.652 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.643+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f332c014860 con 0x7f333c0f6be0 2022-02-02T22:59:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.643+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c0f8600 con 0x7f333c0f6be0 2022-02-02T22:59:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.643+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c10efc0 con 0x7f333c0f6be0 2022-02-02T22:59:12.653 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.644+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c045ad0 con 0x7f333c0f6be0 2022-02-02T22:59:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.644+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f332c01b060 con 0x7f333c0f6be0 2022-02-02T22:59:12.654 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.645+0000 7f33237fe700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 0x7f3324067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.645+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f332c081900 con 0x7f333c0f6be0 2022-02-02T22:59:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.645+0000 7f333ad9d700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 0x7f3324067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.655 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.645+0000 7f333ad9d700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 0x7f3324067290 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 rx=0x7f3330013690 tx=0x7f3330009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.656 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.649+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f332c04fa00 con 0x7f333c0f6be0 2022-02-02T22:59:12.821 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.821+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f333c0fad80 con 0x7f3324064dd0 2022-02-02T22:59:12.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.830+0000 7f33237fe700 1 -- 172.21.15.96:0/2703705477 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f333c0fad80 con 0x7f3324064dd0 2022-02-02T22:59:12.831 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:59:12.831 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:59:12.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:59:12.832 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:59:12.832 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:59:12.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:59:12.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:59:12.833 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:59:12.834 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:59:12.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:59:12.834 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:59:12.835 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:59:12.835 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:59:12.835 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:59:12.836 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:59:12.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:59:12.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:59:12.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:59:12.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:59:12.837 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:59:12.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:59:12.838 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:59:12.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 msgr2=0x7f3324067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 0x7f3324067290 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 rx=0x7f3330013690 tx=0x7f3330009b30).stop 2022-02-02T22:59:12.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 msgr2=0x7f333c0f7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.840 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 secure :-1 s=READY pgs=4242 cs=0 l=1 rev1=1 rx=0x7f332c002700 tx=0x7f332c009d80).stop 2022-02-02T22:59:12.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 shutdown_connections 2022-02-02T22:59:12.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3324064dd0 0x7f3324067290 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f333c0f5930 0x7f333c0f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 --2- 172.21.15.96:0/2703705477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333c0f6be0 0x7f333c0f7c80 unknown :-1 s=CLOSED pgs=4242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 >> 172.21.15.96:0/2703705477 conn(0x7f333c0f04c0 msgr2=0x7f333c0f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:12.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 shutdown_connections 2022-02-02T22:59:12.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.832+0000 7f3341258700 1 -- 172.21.15.96:0/2703705477 wait complete. 2022-02-02T22:59:12.930 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 -- 172.21.15.96:0/2088492624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f6860 msgr2=0x7f397c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 --2- 172.21.15.96:0/2088492624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f6860 0x7f397c0f6cc0 secure :-1 s=READY pgs=4243 cs=0 l=1 rev1=1 rx=0x7f3970004660 tx=0x7f3970009b30).stop 2022-02-02T22:59:12.931 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 -- 172.21.15.96:0/2088492624 shutdown_connections 2022-02-02T22:59:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 --2- 172.21.15.96:0/2088492624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f6860 0x7f397c0f6cc0 unknown :-1 s=CLOSED pgs=4243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 --2- 172.21.15.96:0/2088492624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f55c0 0x7f397c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:59:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 -- 172.21.15.96:0/2088492624 >> 172.21.15.96:0/2088492624 conn(0x7f397c0f0d40 msgr2=0x7f397c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 -- 172.21.15.96:0/2088492624 shutdown_connections 2022-02-02T22:59:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.930+0000 7f398166d700 1 -- 172.21.15.96:0/2088492624 wait complete. 2022-02-02T22:59:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 Processor -- start 2022-02-02T22:59:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 -- start start 2022-02-02T22:59:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f6860 0x7f397c10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c060450 con 0x7f397c0f55c0 2022-02-02T22:59:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.931+0000 7f398166d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c060590 con 0x7f397c0f6860 2022-02-02T22:59:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51510/0 (socket says 172.21.15.96:51510) 2022-02-02T22:59:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 -- 172.21.15.96:0/1683053062 learned_addr learned my addr 172.21.15.96:0/1683053062 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397a7fc700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f6860 0x7f397c10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 -- 172.21.15.96:0/1683053062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f6860 msgr2=0x7f397c10c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f6860 0x7f397c10c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 -- 172.21.15.96:0/1683053062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005040 con 0x7f397c0f55c0 2022-02-02T22:59:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f397affd700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 secure :-1 s=READY pgs=4244 cs=0 l=1 rev1=1 rx=0x7f396c0093f0 tx=0x7f396c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c013640 con 0x7f397c0f55c0 2022-02-02T22:59:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f396c013c50 con 0x7f397c0f55c0 2022-02-02T22:59:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c10c7e0 con 0x7f397c0f55c0 2022-02-02T22:59:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.932+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c012d10 con 0x7f397c0f55c0 2022-02-02T22:59:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.933+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c10cda0 con 0x7f397c0f55c0 2022-02-02T22:59:12.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.934+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c045ad0 con 0x7f397c0f55c0 2022-02-02T22:59:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.934+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f396c01a060 con 0x7f397c0f55c0 2022-02-02T22:59:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.934+0000 7f39637fe700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 0x7f3964067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:12.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.935+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f396c081ab0 con 0x7f397c0f55c0 2022-02-02T22:59:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.935+0000 7f397a7fc700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 0x7f3964067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:12.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.935+0000 7f397a7fc700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 0x7f3964067290 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 rx=0x7f3970004630 tx=0x7f3970009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:12.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:12.939+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f396c04fbb0 con 0x7f397c0f55c0 2022-02-02T22:59:13.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.169+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f397c027a00 con 0x7f397c0f55c0 2022-02-02T22:59:13.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.170+0000 7f39637fe700 1 -- 172.21.15.96:0/1683053062 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f396c018070 con 0x7f397c0f55c0 2022-02-02T22:59:13.171 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:59:13.171 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:59:13.171 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:59:13.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:13.172 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:59:13.172 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:59:13.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:13.173 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:59:13.173 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:59:13.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:13.174 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:59:13.174 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:59:13.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:13.175 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:59:13.175 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:59:13.176 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:59:13.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:59:13.177 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:59:13.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 msgr2=0x7f3964067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 0x7f3964067290 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 rx=0x7f3970004630 tx=0x7f3970009b30).stop 2022-02-02T22:59:13.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 msgr2=0x7f397c109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 secure :-1 s=READY pgs=4244 cs=0 l=1 rev1=1 rx=0x7f396c0093f0 tx=0x7f396c006ec0).stop 2022-02-02T22:59:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 shutdown_connections 2022-02-02T22:59:13.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3964064dd0 0x7f3964067290 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f397c0f55c0 0x7f397c109cd0 unknown :-1 s=CLOSED pgs=4244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 --2- 172.21.15.96:0/1683053062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f397c0f6860 0x7f397c10c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 >> 172.21.15.96:0/1683053062 conn(0x7f397c0f0d40 msgr2=0x7f397c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 shutdown_connections 2022-02-02T22:59:13.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.172+0000 7f398166d700 1 -- 172.21.15.96:0/1683053062 wait complete. 2022-02-02T22:59:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:12 smithi096 ceph-mon[101353]: pgmap v8312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:13.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 -- 172.21.15.96:0/3685789536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f7980 msgr2=0x7fe6480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 --2- 172.21.15.96:0/3685789536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f7980 0x7fe6480f7de0 secure :-1 s=READY pgs=4245 cs=0 l=1 rev1=1 rx=0x7fe63c004660 tx=0x7fe63c009b30).stop 2022-02-02T22:59:13.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 -- 172.21.15.96:0/3685789536 shutdown_connections 2022-02-02T22:59:13.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 --2- 172.21.15.96:0/3685789536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f7980 0x7fe6480f7de0 unknown :-1 s=CLOSED pgs=4245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 --2- 172.21.15.96:0/3685789536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f66e0 0x7fe6480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 -- 172.21.15.96:0/3685789536 >> 172.21.15.96:0/3685789536 conn(0x7fe6480f1e40 msgr2=0x7fe6480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:13.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 -- 172.21.15.96:0/3685789536 shutdown_connections 2022-02-02T22:59:13.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.271+0000 7fe64da43700 1 -- 172.21.15.96:0/3685789536 wait complete. 2022-02-02T22:59:13.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:12 smithi159 ceph-mon[69013]: pgmap v8312: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:13.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 Processor -- start 2022-02-02T22:59:13.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 -- start start 2022-02-02T22:59:13.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:13.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f7980 0x7fe648107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:13.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648107a00 con 0x7fe6480f66e0 2022-02-02T22:59:13.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe64da43700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648107b40 con 0x7fe6480f7980 2022-02-02T22:59:13.279 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:13.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe646ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51520/0 (socket says 172.21.15.96:51520) 2022-02-02T22:59:13.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.272+0000 7fe646ffd700 1 -- 172.21.15.96:0/3490833579 learned_addr learned my addr 172.21.15.96:0/3490833579 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:13.280 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe6467fc700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f7980 0x7fe648107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe646ffd700 1 -- 172.21.15.96:0/3490833579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f7980 msgr2=0x7fe648107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe646ffd700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f7980 0x7fe648107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.281 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe646ffd700 1 -- 172.21.15.96:0/3490833579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c005040 con 0x7fe6480f66e0 2022-02-02T22:59:13.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe646ffd700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 secure :-1 s=READY pgs=4246 cs=0 l=1 rev1=1 rx=0x7fe63800c530 tx=0x7fe638007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:13.282 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe63800f650 con 0x7fe6480f66e0 2022-02-02T22:59:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6481084e0 con 0x7fe6480f66e0 2022-02-02T22:59:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe63800fc60 con 0x7fe6480f66e0 2022-02-02T22:59:13.283 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe638012d20 con 0x7fe6480f66e0 2022-02-02T22:59:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.273+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe648108aa0 con 0x7fe6480f66e0 2022-02-02T22:59:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.274+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648045ad0 con 0x7fe6480f66e0 2022-02-02T22:59:13.284 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.274+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe638019030 con 0x7fe6480f66e0 2022-02-02T22:59:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.275+0000 7fe62f7fe700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 0x7fe630067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.275+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe6380816b0 con 0x7fe6480f66e0 2022-02-02T22:59:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.275+0000 7fe6467fc700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 0x7fe630067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:13.285 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.275+0000 7fe6467fc700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 0x7fe630067290 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 rx=0x7fe63c009da0 tx=0x7fe63c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:13.286 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.279+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe638053230 con 0x7fe6480f66e0 2022-02-02T22:59:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.480+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6480ff020 con 0x7fe6480f66e0 2022-02-02T22:59:13.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.481+0000 7fe62f7fe700 1 -- 172.21.15.96:0/3490833579 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fe638052e20 con 0x7fe6480f66e0 2022-02-02T22:59:13.482 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:59:13.482 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:59:13.482 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:59:13.483 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:59:13.483 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:13.483 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:59:13.484 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:59:13.484 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:59:13.484 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:59:13.485 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:59:13.485 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:59:13.486 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:59:13.486 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:59:13.486 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:59:13.487 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:59:13.487 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:59:13.487 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:59:13.488 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:59:13.488 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:59:13.488 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:59:13.489 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:59:13.489 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:59:13.489 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:59:13.490 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:59:13.490 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:59:13.490 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:59:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:59:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:59:13.491 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:59:13.492 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:59:13.492 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:59:13.493 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:59:13.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:13.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:59:13.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:13.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:13.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:13.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 msgr2=0x7fe630067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 0x7fe630067290 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 rx=0x7fe63c009da0 tx=0x7fe63c009b30).stop 2022-02-02T22:59:13.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 msgr2=0x7fe648106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:13.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 secure :-1 s=READY pgs=4246 cs=0 l=1 rev1=1 rx=0x7fe63800c530 tx=0x7fe638007e10).stop 2022-02-02T22:59:13.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 shutdown_connections 2022-02-02T22:59:13.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe630064dd0 0x7fe630067290 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6480f66e0 0x7fe648106f60 unknown :-1 s=CLOSED pgs=4246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 --2- 172.21.15.96:0/3490833579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6480f7980 0x7fe648107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:13.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 >> 172.21.15.96:0/3490833579 conn(0x7fe6480f1e40 msgr2=0x7fe6480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:13.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 shutdown_connections 2022-02-02T22:59:13.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:13.483+0000 7fe64da43700 1 -- 172.21.15.96:0/3490833579 wait complete. 2022-02-02T22:59:13.500 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:59:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:13 smithi159 ceph-mon[69013]: from='client.42608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:14.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:13 smithi159 ceph-mon[69013]: from='client.42612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1683053062' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:59:14.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:13 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3490833579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:59:14.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:13 smithi096 ceph-mon[101353]: from='client.42608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:13 smithi096 ceph-mon[101353]: from='client.42612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:14.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1683053062' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:59:14.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:13 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3490833579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:59:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:14 smithi159 ceph-mon[69013]: pgmap v8313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:14 smithi096 ceph-mon[101353]: pgmap v8313: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:16 smithi159 ceph-mon[69013]: pgmap v8314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:16 smithi096 ceph-mon[101353]: pgmap v8314: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:18 smithi159 ceph-mon[69013]: pgmap v8315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:18 smithi096 ceph-mon[101353]: pgmap v8315: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:21 smithi159 ceph-mon[69013]: pgmap v8316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:21 smithi096 ceph-mon[101353]: pgmap v8316: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:23 smithi159 ceph-mon[69013]: pgmap v8317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:23.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:23 smithi096 ceph-mon[101353]: pgmap v8317: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:25 smithi159 ceph-mon[69013]: pgmap v8318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:25 smithi096 ceph-mon[101353]: pgmap v8318: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:27.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:27 smithi159 ceph-mon[69013]: pgmap v8319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:27.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:27 smithi096 ceph-mon[101353]: pgmap v8319: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:59:28.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:59:28.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T22:59:28.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T22:59:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:29 smithi159 ceph-mon[69013]: pgmap v8320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:29 smithi096 ceph-mon[101353]: pgmap v8320: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:31 smithi159 ceph-mon[69013]: pgmap v8321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:31.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:31 smithi096 ceph-mon[101353]: pgmap v8321: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:33 smithi159 ceph-mon[69013]: pgmap v8322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:33.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:33 smithi096 ceph-mon[101353]: pgmap v8322: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:35 smithi096 ceph-mon[101353]: pgmap v8323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:35.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:35 smithi159 ceph-mon[69013]: pgmap v8323: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:37 smithi096 ceph-mon[101353]: pgmap v8324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:37 smithi159 ceph-mon[69013]: pgmap v8324: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:39 smithi096 ceph-mon[101353]: pgmap v8325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:39.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:39 smithi159 ceph-mon[69013]: pgmap v8325: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:41 smithi096 ceph-mon[101353]: pgmap v8326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:41.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:41 smithi159 ceph-mon[69013]: pgmap v8326: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:43.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:43 smithi096 ceph-mon[101353]: pgmap v8327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:43.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:43 smithi159 ceph-mon[69013]: pgmap v8327: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 -- 172.21.15.96:0/2881977244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 msgr2=0x7f7d6c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 --2- 172.21.15.96:0/2881977244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c0fbae0 secure :-1 s=READY pgs=4247 cs=0 l=1 rev1=1 rx=0x7f7d54004660 tx=0x7f7d54009b30).stop 2022-02-02T22:59:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 -- 172.21.15.96:0/2881977244 shutdown_connections 2022-02-02T22:59:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 --2- 172.21.15.96:0/2881977244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c0fbae0 unknown :-1 s=CLOSED pgs=4247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 --2- 172.21.15.96:0/2881977244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 0x7f7d6c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 -- 172.21.15.96:0/2881977244 >> 172.21.15.96:0/2881977244 conn(0x7f7d6c0f0b90 msgr2=0x7f7d6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 -- 172.21.15.96:0/2881977244 shutdown_connections 2022-02-02T22:59:43.596 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 -- 172.21.15.96:0/2881977244 wait complete. 2022-02-02T22:59:43.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.593+0000 7f7d7159e700 1 Processor -- start 2022-02-02T22:59:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d7159e700 1 -- start start 2022-02-02T22:59:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d7159e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 0x7f7d6c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d7159e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d7159e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c107870 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d7159e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c1080b0 con 0x7f7d6c0602b0 2022-02-02T22:59:43.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51538/0 (socket says 172.21.15.96:51538) 2022-02-02T22:59:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6b7fe700 1 -- 172.21.15.96:0/1598925977 learned_addr learned my addr 172.21.15.96:0/1598925977 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:43.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6bfff700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 0x7f7d6c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6b7fe700 1 -- 172.21.15.96:0/1598925977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 msgr2=0x7f7d6c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.594+0000 7f7d6b7fe700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 0x7f7d6c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d6b7fe700 1 -- 172.21.15.96:0/1598925977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54005040 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d6b7fe700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 secure :-1 s=READY pgs=4248 cs=0 l=1 rev1=1 rx=0x7f7d54004f60 tx=0x7f7d54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:43.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d54018070 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d54009770 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c108330 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d5401c3c0 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.595+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c108810 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.596+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c059100 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.596+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d5401d420 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.597+0000 7f7d68ff9700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 0x7f7d580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.597+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7d54083840 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.597+0000 7f7d6bfff700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 0x7f7d580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.597+0000 7f7d6bfff700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 0x7f7d580672e0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 rx=0x7f7d5c0041d0 tx=0x7f7d5c009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:43.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.601+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d54051a00 con 0x7f7d6c0f96f0 2022-02-02T22:59:43.780 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.780+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d6c0fee30 con 0x7f7d58064e20 2022-02-02T22:59:43.782 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.781+0000 7f7d68ff9700 1 -- 172.21.15.96:0/1598925977 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7d6c0fee30 con 0x7f7d58064e20 2022-02-02T22:59:43.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 msgr2=0x7f7d580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 0x7f7d580672e0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 rx=0x7f7d5c0041d0 tx=0x7f7d5c009040).stop 2022-02-02T22:59:43.785 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 msgr2=0x7f7d6c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 secure :-1 s=READY pgs=4248 cs=0 l=1 rev1=1 rx=0x7f7d54004f60 tx=0x7f7d54009b30).stop 2022-02-02T22:59:43.786 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 shutdown_connections 2022-02-02T22:59:43.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7d58064e20 0x7f7d580672e0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.787 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d6c0602b0 0x7f7d6c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 --2- 172.21.15.96:0/1598925977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d6c0f96f0 0x7f7d6c107270 unknown :-1 s=CLOSED pgs=4248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.788 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.783+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 >> 172.21.15.96:0/1598925977 conn(0x7f7d6c0f0b90 msgr2=0x7f7d6c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:43.789 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.784+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 shutdown_connections 2022-02-02T22:59:43.790 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.784+0000 7f7d7159e700 1 -- 172.21.15.96:0/1598925977 wait complete. 2022-02-02T22:59:43.793 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T22:59:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 -- 172.21.15.96:0/206509313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f55c0 msgr2=0x7f09080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 --2- 172.21.15.96:0/206509313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f55c0 0x7f09080f59e0 secure :-1 s=READY pgs=4249 cs=0 l=1 rev1=1 rx=0x7f08fc004660 tx=0x7f08fc009b30).stop 2022-02-02T22:59:43.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 -- 172.21.15.96:0/206509313 shutdown_connections 2022-02-02T22:59:43.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 --2- 172.21.15.96:0/206509313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f6860 0x7f09080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 --2- 172.21.15.96:0/206509313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f55c0 0x7f09080f59e0 unknown :-1 s=CLOSED pgs=4249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.880+0000 7f090d182700 1 -- 172.21.15.96:0/206509313 >> 172.21.15.96:0/206509313 conn(0x7f09080f0d40 msgr2=0x7f09080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:43.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.881+0000 7f090d182700 1 -- 172.21.15.96:0/206509313 shutdown_connections 2022-02-02T22:59:43.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.881+0000 7f090d182700 1 -- 172.21.15.96:0/206509313 wait complete. 2022-02-02T22:59:43.888 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.881+0000 7f090d182700 1 Processor -- start 2022-02-02T22:59:43.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.881+0000 7f090d182700 1 -- start start 2022-02-02T22:59:43.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f55c0 0x7f0908109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908060420 con 0x7f09080f6860 2022-02-02T22:59:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908060560 con 0x7f09080f55c0 2022-02-02T22:59:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51548/0 (socket says 172.21.15.96:51548) 2022-02-02T22:59:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 -- 172.21.15.96:0/493995637 learned_addr learned my addr 172.21.15.96:0/493995637 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f0906d9d700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f55c0 0x7f0908109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 -- 172.21.15.96:0/493995637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f55c0 msgr2=0x7f0908109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f55c0 0x7f0908109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 -- 172.21.15.96:0/493995637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc005040 con 0x7f09080f6860 2022-02-02T22:59:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090659c700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 secure :-1 s=READY pgs=4250 cs=0 l=1 rev1=1 rx=0x7f08f800c530 tx=0x7f08f8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f800f650 con 0x7f09080f6860 2022-02-02T22:59:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090810c740 con 0x7f09080f6860 2022-02-02T22:59:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.882+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090810ccd0 con 0x7f09080f6860 2022-02-02T22:59:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.883+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08f800fc60 con 0x7f09080f6860 2022-02-02T22:59:43.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.883+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f8012cd0 con 0x7f09080f6860 2022-02-02T22:59:43.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.884+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8004fa0 con 0x7f09080f6860 2022-02-02T22:59:43.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.884+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f08f8010070 con 0x7f09080f6860 2022-02-02T22:59:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.884+0000 7f08ef7fe700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 0x7f08f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:43.901 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.884+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f08f80815c0 con 0x7f09080f6860 2022-02-02T22:59:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.884+0000 7f0906d9d700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 0x7f08f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.885+0000 7f0906d9d700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 0x7f08f0067290 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 rx=0x7f08fc004e30 tx=0x7f08fc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:43.889+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08f80477d0 con 0x7f09080f6860 2022-02-02T22:59:44.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.061+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e8000bc0 con 0x7f08f0064dd0 2022-02-02T22:59:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.070+0000 7f08ef7fe700 1 -- 172.21.15.96:0/493995637 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f08e8000bc0 con 0x7f08f0064dd0 2022-02-02T22:59:44.072 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T22:59:44.072 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T22:59:44.073 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T22:59:44.074 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T22:59:44.074 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T22:59:44.075 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T22:59:44.075 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T22:59:44.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T22:59:44.076 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T22:59:44.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T22:59:44.077 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T22:59:44.077 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T22:59:44.078 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T22:59:44.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T22:59:44.078 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T22:59:44.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T22:59:44.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T22:59:44.079 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T22:59:44.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T22:59:44.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T22:59:44.080 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T22:59:44.081 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T22:59:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 msgr2=0x7f08f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 0x7f08f0067290 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 rx=0x7f08fc004e30 tx=0x7f08fc009b30).stop 2022-02-02T22:59:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 msgr2=0x7f090810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 secure :-1 s=READY pgs=4250 cs=0 l=1 rev1=1 rx=0x7f08f800c530 tx=0x7f08f8007e20).stop 2022-02-02T22:59:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 shutdown_connections 2022-02-02T22:59:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f08f0064dd0 0x7f08f0067290 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09080f55c0 0x7f0908109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 --2- 172.21.15.96:0/493995637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09080f6860 0x7f090810c130 unknown :-1 s=CLOSED pgs=4250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.072+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 >> 172.21.15.96:0/493995637 conn(0x7f09080f0d40 msgr2=0x7f09080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.073+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 shutdown_connections 2022-02-02T22:59:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.073+0000 7f090d182700 1 -- 172.21.15.96:0/493995637 wait complete. 2022-02-02T22:59:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 -- 172.21.15.96:0/1342739145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f77d0 msgr2=0x7f9b8c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 --2- 172.21.15.96:0/1342739145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c0f7c30 secure :-1 s=READY pgs=4251 cs=0 l=1 rev1=1 rx=0x7f9b78004660 tx=0x7f9b78009b30).stop 2022-02-02T22:59:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 -- 172.21.15.96:0/1342739145 shutdown_connections 2022-02-02T22:59:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 --2- 172.21.15.96:0/1342739145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c0f7c30 unknown :-1 s=CLOSED pgs=4251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 --2- 172.21.15.96:0/1342739145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.168+0000 7f9b91831700 1 -- 172.21.15.96:0/1342739145 >> 172.21.15.96:0/1342739145 conn(0x7f9b8c0f1c90 msgr2=0x7f9b8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.169+0000 7f9b91831700 1 -- 172.21.15.96:0/1342739145 shutdown_connections 2022-02-02T22:59:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.169+0000 7f9b91831700 1 -- 172.21.15.96:0/1342739145 wait complete. 2022-02-02T22:59:44.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.169+0000 7f9b91831700 1 Processor -- start 2022-02-02T22:59:44.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.169+0000 7f9b91831700 1 -- start start 2022-02-02T22:59:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b91831700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b91831700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b91831700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c107880 con 0x7f9b8c0f6530 2022-02-02T22:59:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b91831700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c108090 con 0x7f9b8c0f77d0 2022-02-02T22:59:44.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51556/0 (socket says 172.21.15.96:51556) 2022-02-02T22:59:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 -- 172.21.15.96:0/4265736825 learned_addr learned my addr 172.21.15.96:0/4265736825 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:44.177 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 -- 172.21.15.96:0/4265736825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f77d0 msgr2=0x7f9b8c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 -- 172.21.15.96:0/4265736825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78005040 con 0x7f9b8c0f6530 2022-02-02T22:59:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b9082f700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 secure :-1 s=READY pgs=4252 cs=0 l=1 rev1=1 rx=0x7f9b8000c790 tx=0x7f9b80007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:44.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.170+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8000e680 con 0x7f9b8c0f6530 2022-02-02T22:59:44.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.171+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c108310 con 0x7f9b8c0f6530 2022-02-02T22:59:44.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.171+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b8000ec90 con 0x7f9b8c0f6530 2022-02-02T22:59:44.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.171+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b80012d00 con 0x7f9b8c0f6530 2022-02-02T22:59:44.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.171+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c1088d0 con 0x7f9b8c0f6530 2022-02-02T22:59:44.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.172+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c059100 con 0x7f9b8c0f6530 2022-02-02T22:59:44.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.173+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b80010070 con 0x7f9b8c0f6530 2022-02-02T22:59:44.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.173+0000 7f9b897fa700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 0x7f9b7c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.173+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b80081b30 con 0x7f9b8c0f6530 2022-02-02T22:59:44.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.173+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 0x7f9b7c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.173+0000 7f9b8bfff700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 0x7f9b7c0672e0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 rx=0x7f9b78004e30 tx=0x7f9b78009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:44.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.177+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b8004fc30 con 0x7f9b8c0f6530 2022-02-02T22:59:44.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.403+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b8c0fecf0 con 0x7f9b8c0f6530 2022-02-02T22:59:44.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.404+0000 7f9b897fa700 1 -- 172.21.15.96:0/4265736825 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f9b80053250 con 0x7f9b8c0f6530 2022-02-02T22:59:44.404 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T22:59:44.405 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T22:59:44.405 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:59:44.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:44.405 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T22:59:44.406 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T22:59:44.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:44.407 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T22:59:44.407 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T22:59:44.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:44.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T22:59:44.408 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T22:59:44.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T22:59:44.408 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T22:59:44.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T22:59:44.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T22:59:44.409 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T22:59:44.410 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T22:59:44.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 msgr2=0x7f9b7c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 0x7f9b7c0672e0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 rx=0x7f9b78004e30 tx=0x7f9b78009b30).stop 2022-02-02T22:59:44.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 msgr2=0x7f9b8c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 secure :-1 s=READY pgs=4252 cs=0 l=1 rev1=1 rx=0x7f9b8000c790 tx=0x7f9b80007d90).stop 2022-02-02T22:59:44.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 shutdown_connections 2022-02-02T22:59:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f9b7c064e20 0x7f9b7c0672e0 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b8c0f6530 0x7f9b8c106d90 unknown :-1 s=CLOSED pgs=4252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 --2- 172.21.15.96:0/4265736825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b8c0f77d0 0x7f9b8c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 >> 172.21.15.96:0/4265736825 conn(0x7f9b8c0f1c90 msgr2=0x7f9b8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 shutdown_connections 2022-02-02T22:59:44.414 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.406+0000 7f9b91831700 1 -- 172.21.15.96:0/4265736825 wait complete. 2022-02-02T22:59:44.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 -- 172.21.15.96:0/3954695072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f5ef0 msgr2=0x7f62a00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.504 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 --2- 172.21.15.96:0/3954695072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f5ef0 0x7f62a00f6920 secure :-1 s=READY pgs=4253 cs=0 l=1 rev1=1 rx=0x7f6290004660 tx=0x7f6290009b30).stop 2022-02-02T22:59:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 -- 172.21.15.96:0/3954695072 shutdown_connections 2022-02-02T22:59:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 --2- 172.21.15.96:0/3954695072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f5ef0 0x7f62a00f6920 unknown :-1 s=CLOSED pgs=4253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 --2- 172.21.15.96:0/3954695072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f55e0 0x7f62a00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T22:59:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 -- 172.21.15.96:0/3954695072 >> 172.21.15.96:0/3954695072 conn(0x7f62a00f0de0 msgr2=0x7f62a00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 -- 172.21.15.96:0/3954695072 shutdown_connections 2022-02-02T22:59:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.503+0000 7f62a5971700 1 -- 172.21.15.96:0/3954695072 wait complete. 2022-02-02T22:59:44.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 Processor -- start 2022-02-02T22:59:44.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 -- start start 2022-02-02T22:59:44.507 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 0x7f62a010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0060570 con 0x7f62a00f55e0 2022-02-02T22:59:44.508 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f62a5971700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00606b0 con 0x7f62a00f5ef0 2022-02-02T22:59:44.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51566/0 (socket says 172.21.15.96:51566) 2022-02-02T22:59:44.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 -- 172.21.15.96:0/2135471189 learned_addr learned my addr 172.21.15.96:0/2135471189 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T22:59:44.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629e7fc700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 0x7f62a010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 -- 172.21.15.96:0/2135471189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 msgr2=0x7f62a010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 0x7f62a010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.504+0000 7f629effd700 1 -- 172.21.15.96:0/2135471189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005040 con 0x7f62a00f55e0 2022-02-02T22:59:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f629e7fc700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 0x7f62a010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T22:59:44.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f629effd700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 secure :-1 s=READY pgs=4254 cs=0 l=1 rev1=1 rx=0x7f629400b410 tx=0x7f6294006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:44.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62940125f0 con 0x7f62a00f55e0 2022-02-02T22:59:44.514 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a010c7c0 con 0x7f62a00f55e0 2022-02-02T22:59:44.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f629400be80 con 0x7f62a00f55e0 2022-02-02T22:59:44.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6294002ac0 con 0x7f62a00f55e0 2022-02-02T22:59:44.515 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.505+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a010cd80 con 0x7f62a00f55e0 2022-02-02T22:59:44.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.506+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a0045ad0 con 0x7f62a00f55e0 2022-02-02T22:59:44.516 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.506+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f629400f030 con 0x7f62a00f55e0 2022-02-02T22:59:44.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.507+0000 7f62877fe700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 0x7f6288067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T22:59:44.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.507+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6294081f80 con 0x7f62a00f55e0 2022-02-02T22:59:44.517 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.507+0000 7f629e7fc700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 0x7f6288067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T22:59:44.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.507+0000 7f629e7fc700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 0x7f6288067290 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 rx=0x7f6290004e30 tx=0x7f6290009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T22:59:44.518 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.511+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6294050080 con 0x7f62a00f55e0 2022-02-02T22:59:44.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.710+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62a00fde50 con 0x7f62a00f55e0 2022-02-02T22:59:44.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.710+0000 7f62877fe700 1 -- 172.21.15.96:0/2135471189 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f62940536a0 con 0x7f62a00f55e0 2022-02-02T22:59:44.711 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T22:59:44.711 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T22:59:44.712 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:59:44.712 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T22:59:44.713 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:44.713 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T22:59:44.714 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T22:59:44.714 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T22:59:44.715 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T22:59:44.715 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T22:59:44.715 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T22:59:44.716 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T22:59:44.716 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T22:59:44.716 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T22:59:44.717 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T22:59:44.717 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T22:59:44.718 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T22:59:44.718 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T22:59:44.719 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T22:59:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T22:59:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T22:59:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T22:59:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T22:59:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T22:59:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T22:59:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T22:59:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T22:59:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T22:59:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T22:59:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T22:59:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T22:59:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T22:59:44.725 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:44.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T22:59:44.726 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T22:59:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T22:59:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 msgr2=0x7f6288067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 0x7f6288067290 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 rx=0x7f6290004e30 tx=0x7f6290009b30).stop 2022-02-02T22:59:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 msgr2=0x7f62a0109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T22:59:44.729 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 secure :-1 s=READY pgs=4254 cs=0 l=1 rev1=1 rx=0x7f629400b410 tx=0x7f6294006ef0).stop 2022-02-02T22:59:44.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 shutdown_connections 2022-02-02T22:59:44.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6288064dd0 0x7f6288067290 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62a00f55e0 0x7f62a0109cb0 unknown :-1 s=CLOSED pgs=4254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 --2- 172.21.15.96:0/2135471189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62a00f5ef0 0x7f62a010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T22:59:44.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 >> 172.21.15.96:0/2135471189 conn(0x7f62a00f0de0 msgr2=0x7f62a00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T22:59:44.731 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 shutdown_connections 2022-02-02T22:59:44.732 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T22:59:44.712+0000 7f62a5971700 1 -- 172.21.15.96:0/2135471189 wait complete. 2022-02-02T22:59:44.732 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T22:59:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:45 smithi096 ceph-mon[101353]: pgmap v8328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:45 smithi096 ceph-mon[101353]: from='client.42624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:45.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:45 smithi096 ceph-mon[101353]: from='client.42628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4265736825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:59:45.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:45 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2135471189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:59:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:45 smithi159 ceph-mon[69013]: pgmap v8328: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:45 smithi159 ceph-mon[69013]: from='client.42624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:45 smithi159 ceph-mon[69013]: from='client.42628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T22:59:45.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4265736825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T22:59:45.526 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:45 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2135471189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T22:59:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:47 smithi096 ceph-mon[101353]: pgmap v8329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:47 smithi159 ceph-mon[69013]: pgmap v8329: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:49 smithi096 ceph-mon[101353]: pgmap v8330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:49 smithi159 ceph-mon[69013]: pgmap v8330: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:51 smithi096 ceph-mon[101353]: pgmap v8331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:51 smithi159 ceph-mon[69013]: pgmap v8331: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:53 smithi159 ceph-mon[69013]: pgmap v8332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:53.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:53 smithi096 ceph-mon[101353]: pgmap v8332: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:55 smithi159 ceph-mon[69013]: pgmap v8333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:55 smithi096 ceph-mon[101353]: pgmap v8333: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:57 smithi159 ceph-mon[69013]: pgmap v8334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:57 smithi096 ceph-mon[101353]: pgmap v8334: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 22:59:59 smithi159 ceph-mon[69013]: pgmap v8335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T22:59:59.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 22:59:59 smithi096 ceph-mon[101353]: pgmap v8335: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:00.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:00 smithi159 ceph-mon[69013]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T23:00:00.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:00 smithi096 ceph-mon[101353]: overall HEALTH_WARN 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 3 daemons have recently crashed 2022-02-02T23:00:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:01 smithi159 ceph-mon[69013]: pgmap v8336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:01 smithi096 ceph-mon[101353]: pgmap v8336: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:03 smithi159 ceph-mon[69013]: pgmap v8337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:03 smithi096 ceph-mon[101353]: pgmap v8337: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:05 smithi159 ceph-mon[69013]: pgmap v8338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:05.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:05 smithi096 ceph-mon[101353]: pgmap v8338: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:07 smithi159 ceph-mon[69013]: pgmap v8339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:07 smithi096 ceph-mon[101353]: pgmap v8339: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:09 smithi159 ceph-mon[69013]: pgmap v8340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:09.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:09 smithi096 ceph-mon[101353]: pgmap v8340: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:11 smithi159 ceph-mon[69013]: pgmap v8341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:11 smithi096 ceph-mon[101353]: pgmap v8341: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:13.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:13 smithi159 ceph-mon[69013]: pgmap v8342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:13 smithi096 ceph-mon[101353]: pgmap v8342: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:14.822 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 -- 172.21.15.96:0/249590576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 msgr2=0x7fe4600f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:14.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 --2- 172.21.15.96:0/249590576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f92e0 secure :-1 s=READY pgs=4255 cs=0 l=1 rev1=1 rx=0x7fe454004660 tx=0x7fe454009b30).stop 2022-02-02T23:00:14.823 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 -- 172.21.15.96:0/249590576 shutdown_connections 2022-02-02T23:00:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 --2- 172.21.15.96:0/249590576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 0x7fe4600fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 --2- 172.21.15.96:0/249590576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f92e0 unknown :-1 s=CLOSED pgs=4255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 -- 172.21.15.96:0/249590576 >> 172.21.15.96:0/249590576 conn(0x7fe4600f0d40 msgr2=0x7fe4600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 -- 172.21.15.96:0/249590576 shutdown_connections 2022-02-02T23:00:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.821+0000 7fe467084700 1 -- 172.21.15.96:0/249590576 wait complete. 2022-02-02T23:00:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 Processor -- start 2022-02-02T23:00:14.826 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 -- start start 2022-02-02T23:00:14.828 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 0x7fe4600f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600f5740 con 0x7fe4600602d0 2022-02-02T23:00:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe467084700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600f5880 con 0x7fe4600f9860 2022-02-02T23:00:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe464e20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe464e20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51584/0 (socket says 172.21.15.96:51584) 2022-02-02T23:00:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe464e20700 1 -- 172.21.15.96:0/1803281987 learned_addr learned my addr 172.21.15.96:0/1803281987 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.822+0000 7fe45ffff700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 0x7fe4600f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe464e20700 1 -- 172.21.15.96:0/1803281987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 msgr2=0x7fe4600f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe464e20700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 0x7fe4600f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe464e20700 1 -- 172.21.15.96:0/1803281987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454005040 con 0x7fe4600602d0 2022-02-02T23:00:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe464e20700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 secure :-1 s=READY pgs=4256 cs=0 l=1 rev1=1 rx=0x7fe454009990 tx=0x7fe454009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe454018070 con 0x7fe4600602d0 2022-02-02T23:00:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4600f5b00 con 0x7fe4600602d0 2022-02-02T23:00:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe454007ba0 con 0x7fe4600602d0 2022-02-02T23:00:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45401c3c0 con 0x7fe4600602d0 2022-02-02T23:00:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.823+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4600f6060 con 0x7fe4600602d0 2022-02-02T23:00:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.824+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe460045ad0 con 0x7fe4600602d0 2022-02-02T23:00:14.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.825+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe45401d420 con 0x7fe4600602d0 2022-02-02T23:00:14.835 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.825+0000 7fe45d7fa700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 0x7fe450067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:14.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.825+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe4540836b0 con 0x7fe4600602d0 2022-02-02T23:00:14.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.825+0000 7fe45ffff700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 0x7fe450067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:14.836 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.826+0000 7fe45ffff700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 0x7fe450067290 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 rx=0x7fe4600600a0 tx=0x7fe44c00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:14.837 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:14.830+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe454051810 con 0x7fe4600602d0 2022-02-02T23:00:15.009 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.008+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe460057f10 con 0x7fe450064dd0 2022-02-02T23:00:15.010 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.009+0000 7fe45d7fa700 1 -- 172.21.15.96:0/1803281987 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe460057f10 con 0x7fe450064dd0 2022-02-02T23:00:15.012 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 msgr2=0x7fe450067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 0x7fe450067290 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 rx=0x7fe4600600a0 tx=0x7fe44c00b040).stop 2022-02-02T23:00:15.013 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 msgr2=0x7fe4600f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 secure :-1 s=READY pgs=4256 cs=0 l=1 rev1=1 rx=0x7fe454009990 tx=0x7fe454009b30).stop 2022-02-02T23:00:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 shutdown_connections 2022-02-02T23:00:15.014 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fe450064dd0 0x7fe450067290 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4600602d0 0x7fe4600f6d60 unknown :-1 s=CLOSED pgs=4256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 --2- 172.21.15.96:0/1803281987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4600f9860 0x7fe4600f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.015 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.011+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 >> 172.21.15.96:0/1803281987 conn(0x7fe4600f0d40 msgr2=0x7fe4600f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.012+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 shutdown_connections 2022-02-02T23:00:15.016 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.012+0000 7fe467084700 1 -- 172.21.15.96:0/1803281987 wait complete. 2022-02-02T23:00:15.022 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:00:15.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 -- 172.21.15.96:0/215539372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 msgr2=0x7f7f000f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 --2- 172.21.15.96:0/215539372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f000f6920 secure :-1 s=READY pgs=4257 cs=0 l=1 rev1=1 rx=0x7f7efc004660 tx=0x7f7efc009b30).stop 2022-02-02T23:00:15.112 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 -- 172.21.15.96:0/215539372 shutdown_connections 2022-02-02T23:00:15.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 --2- 172.21.15.96:0/215539372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f000f6920 unknown :-1 s=CLOSED pgs=4257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.113 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 --2- 172.21.15.96:0/215539372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 0x7f7f000f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:00:15.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 -- 172.21.15.96:0/215539372 >> 172.21.15.96:0/215539372 conn(0x7f7f000f0de0 msgr2=0x7f7f000f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 -- 172.21.15.96:0/215539372 shutdown_connections 2022-02-02T23:00:15.114 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.110+0000 7f7f080bb700 1 -- 172.21.15.96:0/215539372 wait complete. 2022-02-02T23:00:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 Processor -- start 2022-02-02T23:00:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 -- start start 2022-02-02T23:00:15.117 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 0x7f7f00106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.118 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00107ad0 con 0x7f7f000f5ef0 2022-02-02T23:00:15.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f080bb700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00108380 con 0x7f7f000f55e0 2022-02-02T23:00:15.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f05656700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.119 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f05656700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51596/0 (socket says 172.21.15.96:51596) 2022-02-02T23:00:15.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.111+0000 7f7f05656700 1 -- 172.21.15.96:0/197876008 learned_addr learned my addr 172.21.15.96:0/197876008 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:15.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f05e57700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 0x7f7f00106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.120 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f05656700 1 -- 172.21.15.96:0/197876008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 msgr2=0x7f7f00106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f05656700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 0x7f7f00106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f05656700 1 -- 172.21.15.96:0/197876008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc005040 con 0x7f7f000f5ef0 2022-02-02T23:00:15.121 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f05656700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 secure :-1 s=READY pgs=4258 cs=0 l=1 rev1=1 rx=0x7f7efc009990 tx=0x7f7efc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc018070 con 0x7f7f000f5ef0 2022-02-02T23:00:15.122 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7efc007ca0 con 0x7f7f000f5ef0 2022-02-02T23:00:15.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f00108600 con 0x7f7f000f5ef0 2022-02-02T23:00:15.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc01c620 con 0x7f7f000f5ef0 2022-02-02T23:00:15.123 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.112+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f00108b60 con 0x7f7f000f5ef0 2022-02-02T23:00:15.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.113+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f000f4a70 con 0x7f7f000f5ef0 2022-02-02T23:00:15.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.114+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7efc01d960 con 0x7f7f000f5ef0 2022-02-02T23:00:15.124 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.114+0000 7f7ef67fc700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 0x7f7eec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.114+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7efc0838b0 con 0x7f7f000f5ef0 2022-02-02T23:00:15.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.115+0000 7f7f05e57700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 0x7f7eec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.115+0000 7f7f05e57700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 0x7f7eec067290 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 rx=0x7f7ef000a6f0 tx=0x7f7ef0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.118+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7efc0553e0 con 0x7f7f000f5ef0 2022-02-02T23:00:15.289 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.288+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f000fad60 con 0x7f7eec064dd0 2022-02-02T23:00:15.299 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.298+0000 7f7ef67fc700 1 -- 172.21.15.96:0/197876008 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7f000fad60 con 0x7f7eec064dd0 2022-02-02T23:00:15.299 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:00:15.299 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:00:15.300 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:00:15.300 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:00:15.301 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:00:15.301 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:00:15.301 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:00:15.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:00:15.302 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:00:15.302 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:00:15.303 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:00:15.303 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:00:15.303 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:00:15.304 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:00:15.304 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:00:15.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:00:15.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:00:15.305 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:00:15.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:00:15.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:00:15.306 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:00:15.307 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:00:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 msgr2=0x7f7eec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 0x7f7eec067290 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 rx=0x7f7ef000a6f0 tx=0x7f7ef0008040).stop 2022-02-02T23:00:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 msgr2=0x7f7f00107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 secure :-1 s=READY pgs=4258 cs=0 l=1 rev1=1 rx=0x7f7efc009990 tx=0x7f7efc009b30).stop 2022-02-02T23:00:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 shutdown_connections 2022-02-02T23:00:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f7eec064dd0 0x7f7eec067290 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f000f55e0 0x7f7f00106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 --2- 172.21.15.96:0/197876008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f000f5ef0 0x7f7f00107490 unknown :-1 s=CLOSED pgs=4258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 >> 172.21.15.96:0/197876008 conn(0x7f7f000f0de0 msgr2=0x7f7f0005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 shutdown_connections 2022-02-02T23:00:15.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.300+0000 7f7f080bb700 1 -- 172.21.15.96:0/197876008 wait complete. 2022-02-02T23:00:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.396+0000 7fd38100b700 1 -- 172.21.15.96:0/1982639367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f5430 msgr2=0x7fd37c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.396+0000 7fd38100b700 1 --2- 172.21.15.96:0/1982639367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f5430 0x7fd37c0f5850 secure :-1 s=READY pgs=4259 cs=0 l=1 rev1=1 rx=0x7fd370004660 tx=0x7fd370009b30).stop 2022-02-02T23:00:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 -- 172.21.15.96:0/1982639367 shutdown_connections 2022-02-02T23:00:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 --2- 172.21.15.96:0/1982639367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f66d0 0x7fd37c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 --2- 172.21.15.96:0/1982639367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f5430 0x7fd37c0f5850 unknown :-1 s=CLOSED pgs=4259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 -- 172.21.15.96:0/1982639367 >> 172.21.15.96:0/1982639367 conn(0x7fd37c0f0b90 msgr2=0x7fd37c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.400 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:15 smithi096 ceph-mon[101353]: pgmap v8343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:15.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 -- 172.21.15.96:0/1982639367 shutdown_connections 2022-02-02T23:00:15.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 -- 172.21.15.96:0/1982639367 wait complete. 2022-02-02T23:00:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.397+0000 7fd38100b700 1 Processor -- start 2022-02-02T23:00:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd38100b700 1 -- start start 2022-02-02T23:00:15.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd38100b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f5430 0x7fd37c105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd38100b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd38100b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1067d0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd38100b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c106fd0 con 0x7fd37c0f5430 2022-02-02T23:00:15.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51606/0 (socket says 172.21.15.96:51606) 2022-02-02T23:00:15.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 -- 172.21.15.96:0/2549881466 learned_addr learned my addr 172.21.15.96:0/2549881466 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:15.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37bfff700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f5430 0x7fd37c105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.407 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 -- 172.21.15.96:0/2549881466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f5430 msgr2=0x7fd37c105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f5430 0x7fd37c105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 -- 172.21.15.96:0/2549881466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370005040 con 0x7fd37c0f66d0 2022-02-02T23:00:15.408 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.398+0000 7fd37b7fe700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 secure :-1 s=READY pgs=4260 cs=0 l=1 rev1=1 rx=0x7fd36c00c530 tx=0x7fd36c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.399+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c00f650 con 0x7fd37c0f66d0 2022-02-02T23:00:15.409 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.399+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c107250 con 0x7fd37c0f66d0 2022-02-02T23:00:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.399+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd36c00fc60 con 0x7fd37c0f66d0 2022-02-02T23:00:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.399+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c012cd0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.399+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c1077c0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.400+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c059100 con 0x7fd37c0f66d0 2022-02-02T23:00:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.400+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd36c010070 con 0x7fd37c0f66d0 2022-02-02T23:00:15.411 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.401+0000 7fd378ff9700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 0x7fd3640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.401+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd36c0817b0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.401+0000 7fd37bfff700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 0x7fd3640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.412 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.401+0000 7fd37bfff700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 0x7fd3640672e0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 rx=0x7fd370004e30 tx=0x7fd370009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.413 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.405+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd36c0532e0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:15 smithi159 ceph-mon[69013]: pgmap v8343: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.633+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd37c107e00 con 0x7fd37c0f66d0 2022-02-02T23:00:15.635 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.634+0000 7fd378ff9700 1 -- 172.21.15.96:0/2549881466 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd36c052ed0 con 0x7fd37c0f66d0 2022-02-02T23:00:15.636 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:00:15.636 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:00:15.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:00:15.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:15.637 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:00:15.638 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:00:15.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:15.638 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:00:15.639 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:00:15.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:15.639 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:00:15.640 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:00:15.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:15.641 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:00:15.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:00:15.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:00:15.642 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:00:15.643 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:00:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 msgr2=0x7fd3640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 0x7fd3640672e0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 rx=0x7fd370004e30 tx=0x7fd370009b30).stop 2022-02-02T23:00:15.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 msgr2=0x7fd37c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 secure :-1 s=READY pgs=4260 cs=0 l=1 rev1=1 rx=0x7fd36c00c530 tx=0x7fd36c007e20).stop 2022-02-02T23:00:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 shutdown_connections 2022-02-02T23:00:15.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd364064e20 0x7fd3640672e0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd37c0f5430 0x7fd37c105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 --2- 172.21.15.96:0/2549881466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd37c0f66d0 0x7fd37c106220 unknown :-1 s=CLOSED pgs=4260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 >> 172.21.15.96:0/2549881466 conn(0x7fd37c0f0b90 msgr2=0x7fd37c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 shutdown_connections 2022-02-02T23:00:15.647 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.636+0000 7fd38100b700 1 -- 172.21.15.96:0/2549881466 wait complete. 2022-02-02T23:00:15.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 -- 172.21.15.96:0/4236850575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 msgr2=0x7fa1600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 --2- 172.21.15.96:0/4236850575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa1600f6b00 secure :-1 s=READY pgs=4261 cs=0 l=1 rev1=1 rx=0x7fa154004660 tx=0x7fa154009b30).stop 2022-02-02T23:00:15.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 -- 172.21.15.96:0/4236850575 shutdown_connections 2022-02-02T23:00:15.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 --2- 172.21.15.96:0/4236850575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa1600f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.736 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 --2- 172.21.15.96:0/4236850575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa1600f6b00 unknown :-1 s=CLOSED pgs=4261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 -- 172.21.15.96:0/4236850575 >> 172.21.15.96:0/4236850575 conn(0x7fa1600f1f00 msgr2=0x7fa1600f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 -- 172.21.15.96:0/4236850575 shutdown_connections 2022-02-02T23:00:15.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.734+0000 7fa167127700 1 -- 172.21.15.96:0/4236850575 wait complete. 2022-02-02T23:00:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 Processor -- start 2022-02-02T23:00:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 -- start start 2022-02-02T23:00:15.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa160107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160107a00 con 0x7fa1600f66e0 2022-02-02T23:00:15.742 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa167127700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160107b40 con 0x7fa1600f6ff0 2022-02-02T23:00:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa164ec3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa164ec3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51614/0 (socket says 172.21.15.96:51614) 2022-02-02T23:00:15.743 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.735+0000 7fa164ec3700 1 -- 172.21.15.96:0/3849719865 learned_addr learned my addr 172.21.15.96:0/3849719865 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:15.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa15ffff700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa160107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa164ec3700 1 -- 172.21.15.96:0/3849719865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 msgr2=0x7fa160107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.744 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa164ec3700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa160107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa164ec3700 1 -- 172.21.15.96:0/3849719865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154005040 con 0x7fa1600f66e0 2022-02-02T23:00:15.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa15ffff700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa160107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T23:00:15.745 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa164ec3700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 secure :-1 s=READY pgs=4262 cs=0 l=1 rev1=1 rx=0x7fa154009990 tx=0x7fa154009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa154018070 con 0x7fa1600f66e0 2022-02-02T23:00:15.746 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa154007ba0 con 0x7fa1600f66e0 2022-02-02T23:00:15.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa160108480 con 0x7fa1600f66e0 2022-02-02T23:00:15.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15401c3c0 con 0x7fa1600f66e0 2022-02-02T23:00:15.747 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.736+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1601089e0 con 0x7fa1600f66e0 2022-02-02T23:00:15.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.737+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa160045ad0 con 0x7fa1600f66e0 2022-02-02T23:00:15.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.738+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa15401d420 con 0x7fa1600f66e0 2022-02-02T23:00:15.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.738+0000 7fa15d7fa700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 0x7fa150067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:15.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.738+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa1540836c0 con 0x7fa1600f66e0 2022-02-02T23:00:15.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.738+0000 7fa15ffff700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 0x7fa150067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:15.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.738+0000 7fa15ffff700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 0x7fa150067290 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 rx=0x7fa14c009740 tx=0x7fa14c009be0).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:15.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.742+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa1540551f0 con 0x7fa1600f66e0 2022-02-02T23:00:15.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.941+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1600ff010 con 0x7fa1600f66e0 2022-02-02T23:00:15.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.942+0000 7fa15d7fa700 1 -- 172.21.15.96:0/3849719865 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fa154054de0 con 0x7fa1600f66e0 2022-02-02T23:00:15.943 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:00:15.944 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:00:15.944 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:00:15.944 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:00:15.945 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:15.945 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:00:15.945 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:00:15.946 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:00:15.946 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:00:15.946 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:00:15.947 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:00:15.947 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:00:15.948 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:00:15.948 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:00:15.948 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:00:15.948 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:00:15.949 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:00:15.949 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:00:15.949 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:00:15.950 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:00:15.950 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:00:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:00:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:00:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:00:15.952 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:00:15.952 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:00:15.952 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:00:15.953 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:00:15.953 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:00:15.953 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:00:15.953 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:00:15.954 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:00:15.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:15.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:15.955 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:00:15.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:15.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:15.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:15.956 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:15.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 msgr2=0x7fa150067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.957 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 0x7fa150067290 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 rx=0x7fa14c009740 tx=0x7fa14c009be0).stop 2022-02-02T23:00:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 msgr2=0x7fa160106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 secure :-1 s=READY pgs=4262 cs=0 l=1 rev1=1 rx=0x7fa154009990 tx=0x7fa154009b30).stop 2022-02-02T23:00:15.958 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 shutdown_connections 2022-02-02T23:00:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fa150064dd0 0x7fa150067290 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1600f66e0 0x7fa160106f60 unknown :-1 s=CLOSED pgs=4262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 --2- 172.21.15.96:0/3849719865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1600f6ff0 0x7fa160107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.943+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 >> 172.21.15.96:0/3849719865 conn(0x7fa1600f1f00 msgr2=0x7fa1600fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.944+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 shutdown_connections 2022-02-02T23:00:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:15.944+0000 7fa167127700 1 -- 172.21.15.96:0/3849719865 wait complete. 2022-02-02T23:00:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:00:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:16 smithi159 ceph-mon[69013]: from='client.42640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:16.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2549881466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:00:16.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:16 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3849719865' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:00:16.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:16 smithi096 ceph-mon[101353]: from='client.42640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2549881466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:00:16.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:16 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3849719865' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:00:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:17 smithi159 ceph-mon[69013]: from='client.42644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:17.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:17 smithi159 ceph-mon[69013]: pgmap v8344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:17.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:17 smithi096 ceph-mon[101353]: from='client.42644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:17.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:17 smithi096 ceph-mon[101353]: pgmap v8344: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:19 smithi159 ceph-mon[69013]: pgmap v8345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:19 smithi096 ceph-mon[101353]: pgmap v8345: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:21 smithi159 ceph-mon[69013]: pgmap v8346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:21 smithi096 ceph-mon[101353]: pgmap v8346: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:23.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:23 smithi159 ceph-mon[69013]: pgmap v8347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:23 smithi096 ceph-mon[101353]: pgmap v8347: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:25 smithi159 ceph-mon[69013]: pgmap v8348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:25.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:25 smithi096 ceph-mon[101353]: pgmap v8348: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:27 smithi159 ceph-mon[69013]: pgmap v8349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:27 smithi096 ceph-mon[101353]: pgmap v8349: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:00:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:00:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:00:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:00:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:29 smithi159 ceph-mon[69013]: pgmap v8350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:29.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:29 smithi096 ceph-mon[101353]: pgmap v8350: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:31 smithi159 ceph-mon[69013]: pgmap v8351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:31 smithi096 ceph-mon[101353]: pgmap v8351: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:33.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:33 smithi159 ceph-mon[69013]: pgmap v8352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:33 smithi096 ceph-mon[101353]: pgmap v8352: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:35.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:35 smithi159 ceph-mon[69013]: pgmap v8353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:35 smithi096 ceph-mon[101353]: pgmap v8353: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:37.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:37 smithi159 ceph-mon[69013]: pgmap v8354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:37.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:37 smithi096 ceph-mon[101353]: pgmap v8354: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:39.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:39 smithi159 ceph-mon[69013]: pgmap v8355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:39.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:39 smithi096 ceph-mon[101353]: pgmap v8355: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:41.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:41 smithi159 ceph-mon[69013]: pgmap v8356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:41.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:41 smithi096 ceph-mon[101353]: pgmap v8356: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:43.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:43 smithi159 ceph-mon[69013]: pgmap v8357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:43.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:43 smithi096 ceph-mon[101353]: pgmap v8357: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:45.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:45 smithi159 ceph-mon[69013]: pgmap v8358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:45.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:45 smithi096 ceph-mon[101353]: pgmap v8358: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:46.055 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 -- 172.21.15.96:0/362941854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f6ff0 msgr2=0x7f3b140f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 --2- 172.21.15.96:0/362941854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f6ff0 0x7f3b140f7a20 secure :-1 s=READY pgs=4263 cs=0 l=1 rev1=1 rx=0x7f3b04004660 tx=0x7f3b04009b30).stop 2022-02-02T23:00:46.056 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 -- 172.21.15.96:0/362941854 shutdown_connections 2022-02-02T23:00:46.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 --2- 172.21.15.96:0/362941854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f6ff0 0x7f3b140f7a20 unknown :-1 s=CLOSED pgs=4263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 --2- 172.21.15.96:0/362941854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f66e0 0x7f3b140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.057 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 -- 172.21.15.96:0/362941854 >> 172.21.15.96:0/362941854 conn(0x7f3b140f1f00 msgr2=0x7f3b140f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 -- 172.21.15.96:0/362941854 shutdown_connections 2022-02-02T23:00:46.058 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.054+0000 7f3b19a58700 1 -- 172.21.15.96:0/362941854 wait complete. 2022-02-02T23:00:46.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 Processor -- start 2022-02-02T23:00:46.061 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 -- start start 2022-02-02T23:00:46.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 0x7f3b14107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.062 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14107a10 con 0x7f3b140f66e0 2022-02-02T23:00:46.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.055+0000 7f3b19a58700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14107b50 con 0x7f3b140f6ff0 2022-02-02T23:00:46.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.063 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51632/0 (socket says 172.21.15.96:51632) 2022-02-02T23:00:46.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 -- 172.21.15.96:0/3809909567 learned_addr learned my addr 172.21.15.96:0/3809909567 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:46.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b127fc700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 0x7f3b14107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.064 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 -- 172.21.15.96:0/3809909567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 msgr2=0x7f3b14107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 0x7f3b14107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 -- 172.21.15.96:0/3809909567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04005040 con 0x7f3b140f66e0 2022-02-02T23:00:46.065 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b127fc700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 0x7f3b14107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T23:00:46.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b12ffd700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 secure :-1 s=READY pgs=4264 cs=0 l=1 rev1=1 rx=0x7f3b0800c790 tx=0x7f3b08007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0800e680 con 0x7f3b140f66e0 2022-02-02T23:00:46.066 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141084f0 con 0x7f3b140f66e0 2022-02-02T23:00:46.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b0800ec90 con 0x7f3b140f66e0 2022-02-02T23:00:46.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b08013d60 con 0x7f3b140f66e0 2022-02-02T23:00:46.067 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.056+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b14108ab0 con 0x7f3b140f66e0 2022-02-02T23:00:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.057+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14045ad0 con 0x7f3b140f66e0 2022-02-02T23:00:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.058+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b0801a060 con 0x7f3b140f66e0 2022-02-02T23:00:46.068 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.058+0000 7f3afb7fe700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 0x7f3afc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.058+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3b08081c90 con 0x7f3b140f66e0 2022-02-02T23:00:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.058+0000 7f3b127fc700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 0x7f3afc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.069 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.059+0000 7f3b127fc700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 0x7f3afc067290 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 rx=0x7f3b04004e30 tx=0x7f3b04009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.070 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.063+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b080537c0 con 0x7f3b140f66e0 2022-02-02T23:00:46.242 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.241+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b140ff050 con 0x7f3afc064dd0 2022-02-02T23:00:46.243 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.242+0000 7f3afb7fe700 1 -- 172.21.15.96:0/3809909567 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3b140ff050 con 0x7f3afc064dd0 2022-02-02T23:00:46.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 msgr2=0x7f3afc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.245 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 0x7f3afc067290 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 rx=0x7f3b04004e30 tx=0x7f3b04009b30).stop 2022-02-02T23:00:46.246 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 msgr2=0x7f3b14106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 secure :-1 s=READY pgs=4264 cs=0 l=1 rev1=1 rx=0x7f3b0800c790 tx=0x7f3b08007d70).stop 2022-02-02T23:00:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 shutdown_connections 2022-02-02T23:00:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3afc064dd0 0x7f3afc067290 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b140f66e0 0x7f3b14106f70 unknown :-1 s=CLOSED pgs=4264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 --2- 172.21.15.96:0/3809909567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b140f6ff0 0x7f3b14107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.248 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 >> 172.21.15.96:0/3809909567 conn(0x7f3b140f1f00 msgr2=0x7f3b140fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 shutdown_connections 2022-02-02T23:00:46.249 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.244+0000 7f3b19a58700 1 -- 172.21.15.96:0/3809909567 wait complete. 2022-02-02T23:00:46.255 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:00:46.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 -- 172.21.15.96:0/3335774030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 msgr2=0x7ff4580f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.345 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 --2- 172.21.15.96:0/3335774030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff4580f6b00 secure :-1 s=READY pgs=4265 cs=0 l=1 rev1=1 rx=0x7ff448004660 tx=0x7ff448009b30).stop 2022-02-02T23:00:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 -- 172.21.15.96:0/3335774030 shutdown_connections 2022-02-02T23:00:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 --2- 172.21.15.96:0/3335774030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 0x7ff4580f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 --2- 172.21.15.96:0/3335774030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff4580f6b00 unknown :-1 s=CLOSED pgs=4265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 -- 172.21.15.96:0/3335774030 >> 172.21.15.96:0/3335774030 conn(0x7ff4580f1e40 msgr2=0x7ff4580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 -- 172.21.15.96:0/3335774030 shutdown_connections 2022-02-02T23:00:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 -- 172.21.15.96:0/3335774030 wait complete. 2022-02-02T23:00:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.342+0000 7ff45f965700 1 Processor -- start 2022-02-02T23:00:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45f965700 1 -- start start 2022-02-02T23:00:46.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45f965700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45f965700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 0x7ff458107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.349 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45f965700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458107a00 con 0x7ff4580f66e0 2022-02-02T23:00:46.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45f965700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458107b40 con 0x7ff4580f7980 2022-02-02T23:00:46.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.350 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51642/0 (socket says 172.21.15.96:51642) 2022-02-02T23:00:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 -- 172.21.15.96:0/3619697819 learned_addr learned my addr 172.21.15.96:0/3619697819 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45cf00700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 0x7ff458107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 -- 172.21.15.96:0/3619697819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 msgr2=0x7ff458107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 0x7ff458107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.352 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 -- 172.21.15.96:0/3619697819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448005040 con 0x7ff4580f66e0 2022-02-02T23:00:46.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.343+0000 7ff45d701700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 secure :-1 s=READY pgs=4266 cs=0 l=1 rev1=1 rx=0x7ff448013a70 tx=0x7ff448009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.344+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff448018070 con 0x7ff4580f66e0 2022-02-02T23:00:46.353 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.344+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4480097d0 con 0x7ff4580f66e0 2022-02-02T23:00:46.354 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.344+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff458108480 con 0x7ff4580f66e0 2022-02-02T23:00:46.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.344+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff44801de80 con 0x7ff4580f66e0 2022-02-02T23:00:46.355 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.344+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4581089e0 con 0x7ff4580f66e0 2022-02-02T23:00:46.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.345+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff458045ad0 con 0x7ff4580f66e0 2022-02-02T23:00:46.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.346+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff448007ba0 con 0x7ff4580f66e0 2022-02-02T23:00:46.356 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.346+0000 7ff44dffb700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 0x7ff444067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.346+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff448083650 con 0x7ff4580f66e0 2022-02-02T23:00:46.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.346+0000 7ff45cf00700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 0x7ff444067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.357 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.347+0000 7ff45cf00700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 0x7ff444067290 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 rx=0x7ff454004ce0 tx=0x7ff45400b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.358 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.350+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff448055240 con 0x7ff4580f66e0 2022-02-02T23:00:46.525 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.524+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4580ff020 con 0x7ff444064dd0 2022-02-02T23:00:46.534 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.533+0000 7ff44dffb700 1 -- 172.21.15.96:0/3619697819 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4580ff020 con 0x7ff444064dd0 2022-02-02T23:00:46.535 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:00:46.535 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:00:46.535 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:00:46.536 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:00:46.536 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:00:46.536 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:00:46.537 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:00:46.537 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:00:46.537 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:00:46.538 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:00:46.538 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:00:46.539 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:00:46.539 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:00:46.539 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:00:46.540 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:00:46.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:00:46.540 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:00:46.541 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:00:46.541 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:00:46.541 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:00:46.542 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:00:46.542 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:00:46.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 msgr2=0x7ff444067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.543 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 0x7ff444067290 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 rx=0x7ff454004ce0 tx=0x7ff45400b040).stop 2022-02-02T23:00:46.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 msgr2=0x7ff458106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.544 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 secure :-1 s=READY pgs=4266 cs=0 l=1 rev1=1 rx=0x7ff448013a70 tx=0x7ff448009b30).stop 2022-02-02T23:00:46.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 shutdown_connections 2022-02-02T23:00:46.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ff444064dd0 0x7ff444067290 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.545 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580f66e0 0x7ff458106f60 unknown :-1 s=CLOSED pgs=4266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 --2- 172.21.15.96:0/3619697819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4580f7980 0x7ff458107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 >> 172.21.15.96:0/3619697819 conn(0x7ff4580f1e40 msgr2=0x7ff4580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.546 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 shutdown_connections 2022-02-02T23:00:46.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.535+0000 7ff45f965700 1 -- 172.21.15.96:0/3619697819 wait complete. 2022-02-02T23:00:46.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 -- 172.21.15.96:0/83305393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 msgr2=0x7f0e440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.632 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/83305393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e440f59e0 secure :-1 s=READY pgs=4267 cs=0 l=1 rev1=1 rx=0x7f0e34004660 tx=0x7f0e34009b30).stop 2022-02-02T23:00:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 -- 172.21.15.96:0/83305393 shutdown_connections 2022-02-02T23:00:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/83305393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 0x7f0e440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:00:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/83305393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e440f59e0 unknown :-1 s=CLOSED pgs=4267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 -- 172.21.15.96:0/83305393 >> 172.21.15.96:0/83305393 conn(0x7f0e440f0d40 msgr2=0x7f0e440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.634 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 -- 172.21.15.96:0/83305393 shutdown_connections 2022-02-02T23:00:46.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.631+0000 7f0e4a48a700 1 -- 172.21.15.96:0/83305393 wait complete. 2022-02-02T23:00:46.637 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.632+0000 7f0e4a48a700 1 Processor -- start 2022-02-02T23:00:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.632+0000 7f0e4a48a700 1 -- start start 2022-02-02T23:00:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.632+0000 7f0e4a48a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e4a48a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 0x7f0e4410c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e4a48a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44060450 con 0x7f0e440f55c0 2022-02-02T23:00:46.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e4a48a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44060590 con 0x7f0e440f6860 2022-02-02T23:00:46.639 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51652/0 (socket says 172.21.15.96:51652) 2022-02-02T23:00:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 -- 172.21.15.96:0/1588868080 learned_addr learned my addr 172.21.15.96:0/1588868080 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e437fe700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 0x7f0e4410c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 -- 172.21.15.96:0/1588868080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 msgr2=0x7f0e4410c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 0x7f0e4410c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 -- 172.21.15.96:0/1588868080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34005040 con 0x7f0e440f55c0 2022-02-02T23:00:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e43fff700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 secure :-1 s=READY pgs=4268 cs=0 l=1 rev1=1 rx=0x7f0e34004f60 tx=0x7f0e34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e34018070 con 0x7f0e440f55c0 2022-02-02T23:00:46.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4410c790 con 0x7f0e440f55c0 2022-02-02T23:00:46.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e340097d0 con 0x7f0e440f55c0 2022-02-02T23:00:46.643 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.633+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3401c3c0 con 0x7f0e440f55c0 2022-02-02T23:00:46.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.634+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4410ccf0 con 0x7f0e440f55c0 2022-02-02T23:00:46.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.635+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e44045ad0 con 0x7f0e440f55c0 2022-02-02T23:00:46.644 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.635+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e34007ba0 con 0x7f0e440f55c0 2022-02-02T23:00:46.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.635+0000 7f0e40ff9700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 0x7f0e30067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.635+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e34083780 con 0x7f0e440f55c0 2022-02-02T23:00:46.645 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.635+0000 7f0e437fe700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 0x7f0e30067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.636+0000 7f0e437fe700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 0x7f0e30067280 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 rx=0x7f0e2c006fd0 tx=0x7f0e2c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.646 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.640+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e34051880 con 0x7f0e440f55c0 2022-02-02T23:00:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.873+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e44027a00 con 0x7f0e440f55c0 2022-02-02T23:00:46.875 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.873+0000 7f0e40ff9700 1 -- 172.21.15.96:0/1588868080 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f0e34054ea0 con 0x7f0e440f55c0 2022-02-02T23:00:46.876 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:00:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:00:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:00:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:00:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:00:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:00:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:00:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:00:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:00:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:00:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:00:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:00:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:00:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:00:46.882 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:00:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 msgr2=0x7f0e30067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 0x7f0e30067280 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 rx=0x7f0e2c006fd0 tx=0x7f0e2c008040).stop 2022-02-02T23:00:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 msgr2=0x7f0e44109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 secure :-1 s=READY pgs=4268 cs=0 l=1 rev1=1 rx=0x7f0e34004f60 tx=0x7f0e34009b30).stop 2022-02-02T23:00:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 shutdown_connections 2022-02-02T23:00:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f0e30064dc0 0x7f0e30067280 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e440f55c0 0x7f0e44109ce0 unknown :-1 s=CLOSED pgs=4268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 --2- 172.21.15.96:0/1588868080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e440f6860 0x7f0e4410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.875+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 >> 172.21.15.96:0/1588868080 conn(0x7f0e440f0d40 msgr2=0x7f0e440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.876+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 shutdown_connections 2022-02-02T23:00:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.876+0000 7f0e4a48a700 1 -- 172.21.15.96:0/1588868080 wait complete. 2022-02-02T23:00:46.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 -- 172.21.15.96:0/4143576162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f66e0 msgr2=0x7fd07c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 --2- 172.21.15.96:0/4143576162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f66e0 0x7fd07c0f6b00 secure :-1 s=READY pgs=4269 cs=0 l=1 rev1=1 rx=0x7fd070004660 tx=0x7fd070009b30).stop 2022-02-02T23:00:46.977 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 -- 172.21.15.96:0/4143576162 shutdown_connections 2022-02-02T23:00:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 --2- 172.21.15.96:0/4143576162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f7980 0x7fd07c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 --2- 172.21.15.96:0/4143576162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f66e0 0x7fd07c0f6b00 unknown :-1 s=CLOSED pgs=4269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 -- 172.21.15.96:0/4143576162 >> 172.21.15.96:0/4143576162 conn(0x7fd07c0f1e40 msgr2=0x7fd07c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 -- 172.21.15.96:0/4143576162 shutdown_connections 2022-02-02T23:00:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.973+0000 7fd083165700 1 -- 172.21.15.96:0/4143576162 wait complete. 2022-02-02T23:00:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 Processor -- start 2022-02-02T23:00:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 -- start start 2022-02-02T23:00:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 0x7fd07c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c107a10 con 0x7fd07c0f7980 2022-02-02T23:00:46.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.974+0000 7fd083165700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c107b50 con 0x7fd07c0f66e0 2022-02-02T23:00:46.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51664/0 (socket says 172.21.15.96:51664) 2022-02-02T23:00:46.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 -- 172.21.15.96:0/3660579156 learned_addr learned my addr 172.21.15.96:0/3660579156 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:00:46.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd080f01700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 0x7fd07c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 -- 172.21.15.96:0/3660579156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 msgr2=0x7fd07c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:46.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 0x7fd07c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:46.983 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 -- 172.21.15.96:0/3660579156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070005040 con 0x7fd07c0f7980 2022-02-02T23:00:46.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd080f01700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 0x7fd07c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T23:00:46.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd07bfff700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 secure :-1 s=READY pgs=4270 cs=0 l=1 rev1=1 rx=0x7fd0680026d0 tx=0x7fd068009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.984 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd068009320 con 0x7fd07c0f7980 2022-02-02T23:00:46.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd06800f040 con 0x7fd07c0f7980 2022-02-02T23:00:46.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0680147e0 con 0x7fd07c0f7980 2022-02-02T23:00:46.985 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c1084f0 con 0x7fd07c0f7980 2022-02-02T23:00:46.986 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.975+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c108a60 con 0x7fd07c0f7980 2022-02-02T23:00:46.987 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.977+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c045ad0 con 0x7fd07c0f7980 2022-02-02T23:00:46.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.977+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd068009480 con 0x7fd07c0f7980 2022-02-02T23:00:46.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.977+0000 7fd0797fa700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 0x7fd06c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:00:46.988 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.978+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd068082110 con 0x7fd07c0f7980 2022-02-02T23:00:46.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.978+0000 7fd080f01700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 0x7fd06c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:00:46.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.978+0000 7fd080f01700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 0x7fd06c067290 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 rx=0x7fd070009da0 tx=0x7fd070009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:00:46.989 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:46.982+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd068053c40 con 0x7fd07c0f7980 2022-02-02T23:00:47.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.185+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd07c0ff020 con 0x7fd07c0f7980 2022-02-02T23:00:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.185+0000 7fd0797fa700 1 -- 172.21.15.96:0/3660579156 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fd068053830 con 0x7fd07c0f7980 2022-02-02T23:00:47.187 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:00:47.188 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:00:47.188 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:00:47.188 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:00:47.189 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:47.189 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:00:47.189 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:00:47.190 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:00:47.190 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:00:47.190 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:00:47.191 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:00:47.191 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:00:47.191 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:00:47.192 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:00:47.192 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:00:47.192 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:00:47.193 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:00:47.193 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:00:47.193 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:00:47.194 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:00:47.194 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:00:47.195 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:00:47.195 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:00:47.195 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:00:47.196 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:00:47.196 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:00:47.196 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:00:47.197 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:00:47.197 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:00:47.197 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:00:47.198 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:00:47.198 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:00:47.198 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:47.199 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:47.199 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:00:47.199 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:00:47.200 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:47.200 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:47.200 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:00:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 msgr2=0x7fd06c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 0x7fd06c067290 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 rx=0x7fd070009da0 tx=0x7fd070009b30).stop 2022-02-02T23:00:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 msgr2=0x7fd07c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:00:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 secure :-1 s=READY pgs=4270 cs=0 l=1 rev1=1 rx=0x7fd0680026d0 tx=0x7fd068009de0).stop 2022-02-02T23:00:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 shutdown_connections 2022-02-02T23:00:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd06c064dd0 0x7fd06c067290 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:47.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07c0f66e0 0x7fd07c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:47.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 --2- 172.21.15.96:0/3660579156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd07c0f7980 0x7fd07c107460 unknown :-1 s=CLOSED pgs=4270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:00:47.204 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 >> 172.21.15.96:0/3660579156 conn(0x7fd07c0f1e40 msgr2=0x7fd07c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:00:47.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 shutdown_connections 2022-02-02T23:00:47.205 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:00:47.187+0000 7fd083165700 1 -- 172.21.15.96:0/3660579156 wait complete. 2022-02-02T23:00:47.205 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:00:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:47 smithi096 ceph-mon[101353]: pgmap v8359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:47.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:47 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1588868080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:00:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:47 smithi159 ceph-mon[69013]: pgmap v8359: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:47.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:47 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1588868080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:00:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:48 smithi159 ceph-mon[69013]: from='client.42656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:48.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:48 smithi159 ceph-mon[69013]: from='client.42660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:48.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:48 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3660579156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:00:48.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:48 smithi096 ceph-mon[101353]: from='client.42656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:48 smithi096 ceph-mon[101353]: from='client.42660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:00:48.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:48 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3660579156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:00:49.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:49 smithi159 ceph-mon[69013]: pgmap v8360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:49.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:49 smithi096 ceph-mon[101353]: pgmap v8360: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:51.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:51 smithi159 ceph-mon[69013]: pgmap v8361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:51.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:51 smithi096 ceph-mon[101353]: pgmap v8361: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:53.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:53 smithi159 ceph-mon[69013]: pgmap v8362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:53.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:53 smithi096 ceph-mon[101353]: pgmap v8362: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:55.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:55 smithi159 ceph-mon[69013]: pgmap v8363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:55.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:55 smithi096 ceph-mon[101353]: pgmap v8363: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:57.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:57 smithi159 ceph-mon[69013]: pgmap v8364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:57.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:57 smithi096 ceph-mon[101353]: pgmap v8364: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:59.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:00:59 smithi159 ceph-mon[69013]: pgmap v8365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:00:59.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:00:59 smithi096 ceph-mon[101353]: pgmap v8365: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:01.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:01 smithi159 ceph-mon[69013]: pgmap v8366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:01.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:01 smithi096 ceph-mon[101353]: pgmap v8366: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:03.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:03 smithi159 ceph-mon[69013]: pgmap v8367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:03.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:03 smithi096 ceph-mon[101353]: pgmap v8367: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:05.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:05 smithi159 ceph-mon[69013]: pgmap v8368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:05.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:05 smithi096 ceph-mon[101353]: pgmap v8368: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:07.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:07 smithi159 ceph-mon[69013]: pgmap v8369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:07.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:07 smithi096 ceph-mon[101353]: pgmap v8369: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:09.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:09 smithi159 ceph-mon[69013]: pgmap v8370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:09.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:09 smithi096 ceph-mon[101353]: pgmap v8370: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:11.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:11 smithi159 ceph-mon[69013]: pgmap v8371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:11.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:11 smithi096 ceph-mon[101353]: pgmap v8371: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:13.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:13 smithi159 ceph-mon[69013]: pgmap v8372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:13.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:13 smithi096 ceph-mon[101353]: pgmap v8372: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:15.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:15 smithi159 ceph-mon[69013]: pgmap v8373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:15.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:15 smithi096 ceph-mon[101353]: pgmap v8373: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:17.301 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- 172.21.15.96:0/3705137203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f5430 msgr2=0x7f14400f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 --2- 172.21.15.96:0/3705137203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f5430 0x7f14400f5850 secure :-1 s=READY pgs=4271 cs=0 l=1 rev1=1 rx=0x7f1430004660 tx=0x7f1430009b30).stop 2022-02-02T23:01:17.302 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- 172.21.15.96:0/3705137203 shutdown_connections 2022-02-02T23:01:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 --2- 172.21.15.96:0/3705137203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f66d0 0x7f14400f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:01:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 --2- 172.21.15.96:0/3705137203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f5430 0x7f14400f5850 unknown :-1 s=CLOSED pgs=4271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- 172.21.15.96:0/3705137203 >> 172.21.15.96:0/3705137203 conn(0x7f14400f0b90 msgr2=0x7f14400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- 172.21.15.96:0/3705137203 shutdown_connections 2022-02-02T23:01:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- 172.21.15.96:0/3705137203 wait complete. 2022-02-02T23:01:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 Processor -- start 2022-02-02T23:01:17.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.299+0000 7f143f59e700 1 -- start start 2022-02-02T23:01:17.305 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 0x7f1440106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 0x7f14401072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440107950 con 0x7f14400f66d0 2022-02-02T23:01:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440108100 con 0x7f14400f5430 2022-02-02T23:01:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 0x7f1440106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 0x7f14401072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 0x7f1440106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.96:55788/0 (socket says 172.21.15.96:55788) 2022-02-02T23:01:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143e59c700 1 -- 172.21.15.96:0/1584758523 learned_addr learned my addr 172.21.15.96:0/1584758523 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143dd9b700 1 -- 172.21.15.96:0/1584758523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 msgr2=0x7f1440106dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143dd9b700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 0x7f1440106dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143dd9b700 1 -- 172.21.15.96:0/1584758523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430005040 con 0x7f14400f66d0 2022-02-02T23:01:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.300+0000 7f143dd9b700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 0x7f14401072c0 secure :-1 s=READY pgs=4272 cs=0 l=1 rev1=1 rx=0x7f1434009360 tx=0x7f1434006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.301+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1434013640 con 0x7f14400f66d0 2022-02-02T23:01:17.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.301+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1434013c50 con 0x7f14400f66d0 2022-02-02T23:01:17.310 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.301+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14401083e0 con 0x7f14400f66d0 2022-02-02T23:01:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.301+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1434012bc0 con 0x7f14400f66d0 2022-02-02T23:01:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.301+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401089a0 con 0x7f14400f66d0 2022-02-02T23:01:17.312 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.302+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440059100 con 0x7f14400f66d0 2022-02-02T23:01:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.302+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f143401a060 con 0x7f14400f66d0 2022-02-02T23:01:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.303+0000 7f142effd700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.303+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1434081930 con 0x7f14400f66d0 2022-02-02T23:01:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.303+0000 7f143e59c700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.303+0000 7f143e59c700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 rx=0x7f1430013690 tx=0x7f1430009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.307+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f143404fa30 con 0x7f14400f66d0 2022-02-02T23:01:17.495 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.494+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14400fab10 con 0x7f1428064e20 2022-02-02T23:01:17.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:17 smithi096 ceph-mon[101353]: pgmap v8374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:17.496 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.496+0000 7f142effd700 1 -- 172.21.15.96:0/1584758523 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f14400fab10 con 0x7f1428064e20 2022-02-02T23:01:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.497+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 msgr2=0x7f14280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.497+0000 7f143f59e700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 rx=0x7f1430013690 tx=0x7f1430009b30).stop 2022-02-02T23:01:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.497+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 msgr2=0x7f14401072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.497+0000 7f143f59e700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 0x7f14401072c0 secure :-1 s=READY pgs=4272 cs=0 l=1 rev1=1 rx=0x7f1434009360 tx=0x7f1434006e30).stop 2022-02-02T23:01:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.497+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 shutdown_connections 2022-02-02T23:01:17.499 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1428064e20 0x7f14280672e0 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400f5430 0x7f1440106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 --2- 172.21.15.96:0/1584758523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14400f66d0 0x7f14401072c0 unknown :-1 s=CLOSED pgs=4272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 >> 172.21.15.96:0/1584758523 conn(0x7f14400f0b90 msgr2=0x7f144005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 shutdown_connections 2022-02-02T23:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.498+0000 7f143f59e700 1 -- 172.21.15.96:0/1584758523 wait complete. 2022-02-02T23:01:17.507 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:01:17.523 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:17 smithi159 ceph-mon[69013]: pgmap v8374: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:17.597 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 -- 172.21.15.96:0/2066893641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f6860 msgr2=0x7f287c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 --2- 172.21.15.96:0/2066893641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f6860 0x7f287c0f6cc0 secure :-1 s=READY pgs=4273 cs=0 l=1 rev1=1 rx=0x7f286c004660 tx=0x7f286c009b30).stop 2022-02-02T23:01:17.598 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 -- 172.21.15.96:0/2066893641 shutdown_connections 2022-02-02T23:01:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 --2- 172.21.15.96:0/2066893641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f6860 0x7f287c0f6cc0 unknown :-1 s=CLOSED pgs=4273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 --2- 172.21.15.96:0/2066893641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f55c0 0x7f287c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 -- 172.21.15.96:0/2066893641 >> 172.21.15.96:0/2066893641 conn(0x7f287c0f0d40 msgr2=0x7f287c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 -- 172.21.15.96:0/2066893641 shutdown_connections 2022-02-02T23:01:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.595+0000 7f288339b700 1 -- 172.21.15.96:0/2066893641 wait complete. 2022-02-02T23:01:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 Processor -- start 2022-02-02T23:01:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 -- start start 2022-02-02T23:01:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f6860 0x7f287c0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0697b0 con 0x7f287c0f55c0 2022-02-02T23:01:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f288339b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0698f0 con 0x7f287c0f6860 2022-02-02T23:01:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51692/0 (socket says 172.21.15.96:51692) 2022-02-02T23:01:17.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 -- 172.21.15.96:0/465124580 learned_addr learned my addr 172.21.15.96:0/465124580 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:17.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2880936700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f6860 0x7f287c0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 -- 172.21.15.96:0/465124580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f6860 msgr2=0x7f287c0691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f6860 0x7f287c0691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 -- 172.21.15.96:0/465124580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c005040 con 0x7f287c0f55c0 2022-02-02T23:01:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.596+0000 7f2881137700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 secure :-1 s=READY pgs=4274 cs=0 l=1 rev1=1 rx=0x7f2878002700 tx=0x7f2878009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.597+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28780079c0 con 0x7f287c0f55c0 2022-02-02T23:01:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.597+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f287800f040 con 0x7f287c0f55c0 2022-02-02T23:01:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.597+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c10fbc0 con 0x7f287c0f55c0 2022-02-02T23:01:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.597+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2878014860 con 0x7f287c0f55c0 2022-02-02T23:01:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.597+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c110180 con 0x7f287c0f55c0 2022-02-02T23:01:17.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.598+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c045ad0 con 0x7f287c0f55c0 2022-02-02T23:01:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.598+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f287801b060 con 0x7f287c0f55c0 2022-02-02T23:01:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.598+0000 7f2871ffb700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 0x7f2868067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.599+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2878081800 con 0x7f287c0f55c0 2022-02-02T23:01:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.599+0000 7f2880936700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 0x7f2868067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.599+0000 7f2880936700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 0x7f2868067290 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 rx=0x7f286c004630 tx=0x7f286c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.603+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f287804f900 con 0x7f287c0f55c0 2022-02-02T23:01:17.775 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.775+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f287c110450 con 0x7f2868064dd0 2022-02-02T23:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.784+0000 7f2871ffb700 1 -- 172.21.15.96:0/465124580 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f287c110450 con 0x7f2868064dd0 2022-02-02T23:01:17.785 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:01:17.785 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:01:17.786 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:01:17.787 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:01:17.787 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:01:17.787 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:01:17.788 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:01:17.788 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:01:17.788 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:01:17.789 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:01:17.789 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:01:17.790 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:01:17.790 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:01:17.790 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:01:17.791 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:01:17.791 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:01:17.792 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:01:17.792 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:01:17.793 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:01:17.793 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:01:17.794 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:01:17.795 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:01:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 msgr2=0x7f2868067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 0x7f2868067290 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 rx=0x7f286c004630 tx=0x7f286c009b30).stop 2022-02-02T23:01:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 msgr2=0x7f287c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 secure :-1 s=READY pgs=4274 cs=0 l=1 rev1=1 rx=0x7f2878002700 tx=0x7f2878009d80).stop 2022-02-02T23:01:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 shutdown_connections 2022-02-02T23:01:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2868064dd0 0x7f2868067290 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f287c0f55c0 0x7f287c068ce0 unknown :-1 s=CLOSED pgs=4274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 --2- 172.21.15.96:0/465124580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c0f6860 0x7f287c0691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 >> 172.21.15.96:0/465124580 conn(0x7f287c0f0d40 msgr2=0x7f287c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 shutdown_connections 2022-02-02T23:01:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.786+0000 7f288339b700 1 -- 172.21.15.96:0/465124580 wait complete. 2022-02-02T23:01:17.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 -- 172.21.15.96:0/3322280156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f55c0 msgr2=0x7f12d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.883 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 --2- 172.21.15.96:0/3322280156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f55c0 0x7f12d80f59e0 secure :-1 s=READY pgs=4275 cs=0 l=1 rev1=1 rx=0x7f12cc004660 tx=0x7f12cc009b30).stop 2022-02-02T23:01:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 -- 172.21.15.96:0/3322280156 shutdown_connections 2022-02-02T23:01:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 --2- 172.21.15.96:0/3322280156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f6860 0x7f12d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 --2- 172.21.15.96:0/3322280156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f55c0 0x7f12d80f59e0 unknown :-1 s=CLOSED pgs=4275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 -- 172.21.15.96:0/3322280156 >> 172.21.15.96:0/3322280156 conn(0x7f12d80f0d40 msgr2=0x7f12d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 -- 172.21.15.96:0/3322280156 shutdown_connections 2022-02-02T23:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 -- 172.21.15.96:0/3322280156 wait complete. 2022-02-02T23:01:17.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.883+0000 7f12de95d700 1 Processor -- start 2022-02-02T23:01:17.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12de95d700 1 -- start start 2022-02-02T23:01:17.889 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12de95d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f55c0 0x7f12d8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.890 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12de95d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12de95d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80603c0 con 0x7f12d80f6860 2022-02-02T23:01:17.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12de95d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8060500 con 0x7f12d80f55c0 2022-02-02T23:01:17.891 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51702/0 (socket says 172.21.15.96:51702) 2022-02-02T23:01:17.892 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 -- 172.21.15.96:0/2974021573 learned_addr learned my addr 172.21.15.96:0/2974021573 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:17.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d7fff700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f55c0 0x7f12d8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 -- 172.21.15.96:0/2974021573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f55c0 msgr2=0x7f12d8109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:17.893 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f55c0 0x7f12d8109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:17.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.884+0000 7f12d77fe700 1 -- 172.21.15.96:0/2974021573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc005040 con 0x7f12d80f6860 2022-02-02T23:01:17.894 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12d77fe700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 secure :-1 s=READY pgs=4276 cs=0 l=1 rev1=1 rx=0x7f12c80026d0 tx=0x7f12c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c80079c0 con 0x7f12d80f6860 2022-02-02T23:01:17.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d810c740 con 0x7f12d80f6860 2022-02-02T23:01:17.895 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x7f12d80f6860 2022-02-02T23:01:17.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c80148b0 con 0x7f12d80f6860 2022-02-02T23:01:17.896 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.885+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d810ccd0 con 0x7f12d80f6860 2022-02-02T23:01:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.886+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80f49b0 con 0x7f12d80f6860 2022-02-02T23:01:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.886+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f12c8007b20 con 0x7f12d80f6860 2022-02-02T23:01:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.887+0000 7f12d4ff9700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 0x7f12c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.887+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f12c8081990 con 0x7f12d80f6860 2022-02-02T23:01:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.887+0000 7f12d7fff700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 0x7f12c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:17.899 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.887+0000 7f12d7fff700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 0x7f12c0067290 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 rx=0x7f12cc013690 tx=0x7f12cc009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:17.900 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:17.891+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f12c804fa90 con 0x7f12d80f6860 2022-02-02T23:01:18.125 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.125+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f12d80fdf10 con 0x7f12d80f6860 2022-02-02T23:01:18.126 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.126+0000 7f12d4ff9700 1 -- 172.21.15.96:0/2974021573 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f12d80fdf10 con 0x7f12d80f6860 2022-02-02T23:01:18.127 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:01:18.127 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:01:18.127 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:01:18.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:18.128 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:01:18.128 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:01:18.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:18.129 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:01:18.129 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:01:18.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:18.130 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:01:18.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:01:18.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:18.131 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:01:18.131 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:01:18.132 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:01:18.132 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:01:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:01:18.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.127+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 msgr2=0x7f12c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.127+0000 7f12de95d700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 0x7f12c0067290 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 rx=0x7f12cc013690 tx=0x7f12cc009b30).stop 2022-02-02T23:01:18.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.127+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 msgr2=0x7f12d810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.127+0000 7f12de95d700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 secure :-1 s=READY pgs=4276 cs=0 l=1 rev1=1 rx=0x7f12c80026d0 tx=0x7f12c8009de0).stop 2022-02-02T23:01:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 shutdown_connections 2022-02-02T23:01:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f12c0064dd0 0x7f12c0067290 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12d80f55c0 0x7f12d8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 --2- 172.21.15.96:0/2974021573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d80f6860 0x7f12d810c190 unknown :-1 s=CLOSED pgs=4276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 >> 172.21.15.96:0/2974021573 conn(0x7f12d80f0d40 msgr2=0x7f12d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 shutdown_connections 2022-02-02T23:01:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.128+0000 7f12de95d700 1 -- 172.21.15.96:0/2974021573 wait complete. 2022-02-02T23:01:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 -- 172.21.15.96:0/1108904585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 msgr2=0x7f8c200f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1108904585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c200f5a00 secure :-1 s=READY pgs=4277 cs=0 l=1 rev1=1 rx=0x7f8c10004660 tx=0x7f8c10009b30).stop 2022-02-02T23:01:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 -- 172.21.15.96:0/1108904585 shutdown_connections 2022-02-02T23:01:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1108904585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 0x7f8c200f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:01:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1108904585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c200f5a00 unknown :-1 s=CLOSED pgs=4277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 -- 172.21.15.96:0/1108904585 >> 172.21.15.96:0/1108904585 conn(0x7f8c200f0de0 msgr2=0x7f8c200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 -- 172.21.15.96:0/1108904585 shutdown_connections 2022-02-02T23:01:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.225+0000 7f8c2747a700 1 -- 172.21.15.96:0/1108904585 wait complete. 2022-02-02T23:01:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 Processor -- start 2022-02-02T23:01:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 -- start start 2022-02-02T23:01:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 0x7f8c2010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200605d0 con 0x7f8c200f55e0 2022-02-02T23:01:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c2747a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20060710 con 0x7f8c200f5ef0 2022-02-02T23:01:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c25216700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c25216700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51710/0 (socket says 172.21.15.96:51710) 2022-02-02T23:01:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.226+0000 7f8c25216700 1 -- 172.21.15.96:0/1404454528 learned_addr learned my addr 172.21.15.96:0/1404454528 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c24a15700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 0x7f8c2010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c25216700 1 -- 172.21.15.96:0/1404454528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 msgr2=0x7f8c2010c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c25216700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 0x7f8c2010c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c25216700 1 -- 172.21.15.96:0/1404454528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10005040 con 0x7f8c200f55e0 2022-02-02T23:01:18.234 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c25216700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 secure :-1 s=READY pgs=4278 cs=0 l=1 rev1=1 rx=0x7f8c10009990 tx=0x7f8c10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:18.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c10018070 con 0x7f8c200f55e0 2022-02-02T23:01:18.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c10007ca0 con 0x7f8c200f55e0 2022-02-02T23:01:18.235 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2010c730 con 0x7f8c200f55e0 2022-02-02T23:01:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1001c620 con 0x7f8c200f55e0 2022-02-02T23:01:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.227+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2010cc90 con 0x7f8c200f55e0 2022-02-02T23:01:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.228+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c20045ad0 con 0x7f8c200f55e0 2022-02-02T23:01:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.228+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c1001d960 con 0x7f8c200f55e0 2022-02-02T23:01:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.229+0000 7f8c15ffb700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 0x7f8c0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.229+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c10083710 con 0x7f8c200f55e0 2022-02-02T23:01:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.229+0000 7f8c24a15700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 0x7f8c0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.229+0000 7f8c24a15700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 0x7f8c0c067290 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 rx=0x7f8c1c00b790 tx=0x7f8c1c008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.233+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c100518d0 con 0x7f8c200f55e0 2022-02-02T23:01:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.434+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8c200fde50 con 0x7f8c200f55e0 2022-02-02T23:01:18.436 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:18 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2974021573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:01:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.435+0000 7f8c15ffb700 1 -- 172.21.15.96:0/1404454528 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f8c10054ef0 con 0x7f8c200f55e0 2022-02-02T23:01:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:01:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:01:18.439 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:01:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:01:18.440 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:01:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:01:18.442 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:01:18.443 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:01:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:01:18.444 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:01:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:01:18.445 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:01:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:01:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:01:18.447 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:01:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:01:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:01:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:01:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:01:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:01:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:01:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:01:18.452 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:01:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:01:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:01:18.454 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:01:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:01:18.455 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:01:18.456 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:01:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:01:18.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:01:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:18.459 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:01:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:18.460 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:18.462 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.436+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 msgr2=0x7f8c0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.436+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 0x7f8c0c067290 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 rx=0x7f8c1c00b790 tx=0x7f8c1c008040).stop 2022-02-02T23:01:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.436+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 msgr2=0x7f8c20109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.436+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 secure :-1 s=READY pgs=4278 cs=0 l=1 rev1=1 rx=0x7f8c10009990 tx=0x7f8c10009b30).stop 2022-02-02T23:01:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 shutdown_connections 2022-02-02T23:01:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f8c0c064dd0 0x7f8c0c067290 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c200f55e0 0x7f8c20109c30 unknown :-1 s=CLOSED pgs=4278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 --2- 172.21.15.96:0/1404454528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c200f5ef0 0x7f8c2010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 >> 172.21.15.96:0/1404454528 conn(0x7f8c200f0de0 msgr2=0x7f8c200fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 shutdown_connections 2022-02-02T23:01:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:18.437+0000 7f8c2747a700 1 -- 172.21.15.96:0/1404454528 wait complete. 2022-02-02T23:01:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:01:18.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:18 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2974021573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:01:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:19 smithi159 ceph-mon[69013]: from='client.42672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:19.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:19 smithi159 ceph-mon[69013]: pgmap v8375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:19 smithi159 ceph-mon[69013]: from='client.42676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:19.525 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:19 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1404454528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:01:19.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:19 smithi096 ceph-mon[101353]: from='client.42672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:19 smithi096 ceph-mon[101353]: pgmap v8375: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:19 smithi096 ceph-mon[101353]: from='client.42676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:19.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:19 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1404454528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:01:21.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:21 smithi159 ceph-mon[69013]: pgmap v8376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:21.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:21 smithi096 ceph-mon[101353]: pgmap v8376: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:23.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:23 smithi159 ceph-mon[69013]: pgmap v8377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:23.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:23 smithi096 ceph-mon[101353]: pgmap v8377: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:25.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:25 smithi159 ceph-mon[69013]: pgmap v8378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:25.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:25 smithi096 ceph-mon[101353]: pgmap v8378: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:27.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:27 smithi159 ceph-mon[69013]: pgmap v8379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:27.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:27 smithi096 ceph-mon[101353]: pgmap v8379: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:01:28.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:01:28.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:01:28.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:01:29.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:29 smithi159 ceph-mon[69013]: pgmap v8380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:29.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:29 smithi096 ceph-mon[101353]: pgmap v8380: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:31.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:31 smithi159 ceph-mon[69013]: pgmap v8381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:31.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:31 smithi096 ceph-mon[101353]: pgmap v8381: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:33 smithi159 ceph-mon[69013]: pgmap v8382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:33.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:33 smithi096 ceph-mon[101353]: pgmap v8382: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:35.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:35 smithi159 ceph-mon[69013]: pgmap v8383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:35.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:35 smithi096 ceph-mon[101353]: pgmap v8383: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:36.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:36 smithi096 ceph-mon[101353]: pgmap v8384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:36.773 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:36 smithi159 ceph-mon[69013]: pgmap v8384: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:39.024 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:38 smithi159 ceph-mon[69013]: pgmap v8385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:39.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:38 smithi096 ceph-mon[101353]: pgmap v8385: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:41.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:40 smithi096 ceph-mon[101353]: pgmap v8386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:40 smithi159 ceph-mon[69013]: pgmap v8386: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:43.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:42 smithi096 ceph-mon[101353]: pgmap v8387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:42 smithi159 ceph-mon[69013]: pgmap v8387: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:45.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:44 smithi096 ceph-mon[101353]: pgmap v8388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:45.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:44 smithi159 ceph-mon[69013]: pgmap v8388: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:47.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:46 smithi096 ceph-mon[101353]: pgmap v8389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:46 smithi159 ceph-mon[69013]: pgmap v8389: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:48.547 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 -- 172.21.15.96:0/4194600671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3234060310 msgr2=0x7f32340f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 --2- 172.21.15.96:0/4194600671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3234060310 0x7f32340f92a0 secure :-1 s=READY pgs=4279 cs=0 l=1 rev1=1 rx=0x7f3228004660 tx=0x7f3228009b30).stop 2022-02-02T23:01:48.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 -- 172.21.15.96:0/4194600671 shutdown_connections 2022-02-02T23:01:48.548 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 --2- 172.21.15.96:0/4194600671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32340f9820 0x7f32340fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 --2- 172.21.15.96:0/4194600671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3234060310 0x7f32340f92a0 unknown :-1 s=CLOSED pgs=4279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.549 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 -- 172.21.15.96:0/4194600671 >> 172.21.15.96:0/4194600671 conn(0x7f32340f0d40 msgr2=0x7f32340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:48.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 -- 172.21.15.96:0/4194600671 shutdown_connections 2022-02-02T23:01:48.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.547+0000 7f323b54d700 1 -- 172.21.15.96:0/4194600671 wait complete. 2022-02-02T23:01:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 Processor -- start 2022-02-02T23:01:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 -- start start 2022-02-02T23:01:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3234060310 0x7f3234106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.554 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341079f0 con 0x7f32340f9820 2022-02-02T23:01:48.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f323b54d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3234107b30 con 0x7f3234060310 2022-02-02T23:01:48.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.548+0000 7f3238ae8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51728/0 (socket says 172.21.15.96:51728) 2022-02-02T23:01:48.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 -- 172.21.15.96:0/335818630 learned_addr learned my addr 172.21.15.96:0/335818630 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:48.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f32392e9700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3234060310 0x7f3234106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 -- 172.21.15.96:0/335818630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3234060310 msgr2=0x7f3234106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3234060310 0x7f3234106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 -- 172.21.15.96:0/335818630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228005040 con 0x7f32340f9820 2022-02-02T23:01:48.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3238ae8700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 secure :-1 s=READY pgs=4280 cs=0 l=1 rev1=1 rx=0x7f3230002700 tx=0x7f3230009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:48.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32300079c0 con 0x7f32340f9820 2022-02-02T23:01:48.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f323000f040 con 0x7f32340f9820 2022-02-02T23:01:48.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32341084d0 con 0x7f32340f9820 2022-02-02T23:01:48.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3230014740 con 0x7f32340f9820 2022-02-02T23:01:48.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.549+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3234108a90 con 0x7f32340f9820 2022-02-02T23:01:48.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.550+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3234045ad0 con 0x7f32340f9820 2022-02-02T23:01:48.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.551+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f323001b060 con 0x7f32340f9820 2022-02-02T23:01:48.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.552+0000 7f3225ffb700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 0x7f3220067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.552+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3230081a00 con 0x7f32340f9820 2022-02-02T23:01:48.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.552+0000 7f32392e9700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 0x7f3220067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.552+0000 7f32392e9700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 0x7f3220067290 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 rx=0x7f3228004630 tx=0x7f3228009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:48.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.555+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3230053550 con 0x7f32340f9820 2022-02-02T23:01:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.734+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3234108d60 con 0x7f3220064dd0 2022-02-02T23:01:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.735+0000 7f3225ffb700 1 -- 172.21.15.96:0/335818630 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3234108d60 con 0x7f3220064dd0 2022-02-02T23:01:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 msgr2=0x7f3220067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 0x7f3220067290 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 rx=0x7f3228004630 tx=0x7f3228009b30).stop 2022-02-02T23:01:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 msgr2=0x7f3234107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 secure :-1 s=READY pgs=4280 cs=0 l=1 rev1=1 rx=0x7f3230002700 tx=0x7f3230009d60).stop 2022-02-02T23:01:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 shutdown_connections 2022-02-02T23:01:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3220064dd0 0x7f3220067290 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3234060310 0x7f3234106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 --2- 172.21.15.96:0/335818630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32340f9820 0x7f3234107440 unknown :-1 s=CLOSED pgs=4280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 >> 172.21.15.96:0/335818630 conn(0x7f32340f0d40 msgr2=0x7f32340f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 shutdown_connections 2022-02-02T23:01:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.737+0000 7f323b54d700 1 -- 172.21.15.96:0/335818630 wait complete. 2022-02-02T23:01:48.747 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:01:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 -- 172.21.15.96:0/3525728057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 msgr2=0x7f28fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 --2- 172.21.15.96:0/3525728057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc0f7c30 secure :-1 s=READY pgs=4281 cs=0 l=1 rev1=1 rx=0x7f28ec004660 tx=0x7f28ec009b30).stop 2022-02-02T23:01:48.842 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 -- 172.21.15.96:0/3525728057 shutdown_connections 2022-02-02T23:01:48.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 --2- 172.21.15.96:0/3525728057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc0f7c30 unknown :-1 s=CLOSED pgs=4281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 --2- 172.21.15.96:0/3525728057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 0x7f28fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:01:48.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 -- 172.21.15.96:0/3525728057 >> 172.21.15.96:0/3525728057 conn(0x7f28fc0f1c90 msgr2=0x7f28fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:48.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 -- 172.21.15.96:0/3525728057 shutdown_connections 2022-02-02T23:01:48.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.839+0000 7f290141e700 1 -- 172.21.15.96:0/3525728057 wait complete. 2022-02-02T23:01:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.840+0000 7f290141e700 1 Processor -- start 2022-02-02T23:01:48.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.840+0000 7f290141e700 1 -- start start 2022-02-02T23:01:48.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 0x7f28fc106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc107980 con 0x7f28fc0f77d0 2022-02-02T23:01:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc108100 con 0x7f28fc0f6530 2022-02-02T23:01:48.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51738/0 (socket says 172.21.15.96:51738) 2022-02-02T23:01:48.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 -- 172.21.15.96:0/2512330244 learned_addr learned my addr 172.21.15.96:0/2512330244 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:48.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fbfff700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 0x7f28fc106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 -- 172.21.15.96:0/2512330244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 msgr2=0x7f28fc106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:48.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 0x7f28fc106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:48.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 -- 172.21.15.96:0/2512330244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec005040 con 0x7f28fc0f77d0 2022-02-02T23:01:48.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28fb7fe700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 secure :-1 s=READY pgs=4282 cs=0 l=1 rev1=1 rx=0x7f28ec009990 tx=0x7f28ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:48.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28ec018070 con 0x7f28fc0f77d0 2022-02-02T23:01:48.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28ec007ca0 con 0x7f28fc0f77d0 2022-02-02T23:01:48.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc108320 con 0x7f28fc0f77d0 2022-02-02T23:01:48.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28ec01c620 con 0x7f28fc0f77d0 2022-02-02T23:01:48.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.841+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc108880 con 0x7f28fc0f77d0 2022-02-02T23:01:48.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.842+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc045ad0 con 0x7f28fc0f77d0 2022-02-02T23:01:48.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.843+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f28ec01d960 con 0x7f28fc0f77d0 2022-02-02T23:01:48.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.843+0000 7f28f8ff9700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 0x7f28e40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:48.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.844+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f28ec083970 con 0x7f28fc0f77d0 2022-02-02T23:01:48.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.844+0000 7f28fbfff700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 0x7f28e40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:48.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.844+0000 7f28fbfff700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 0x7f28e40672e0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 rx=0x7f28fc106b70 tx=0x7f28f0008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:48.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:48.847+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f28ec051a70 con 0x7f28fc0f77d0 2022-02-02T23:01:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.022+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28fc108aa0 con 0x7f28e4064e20 2022-02-02T23:01:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.031+0000 7f28f8ff9700 1 -- 172.21.15.96:0/2512330244 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f28fc108aa0 con 0x7f28e4064e20 2022-02-02T23:01:49.033 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:01:49.033 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:01:49.033 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:01:49.034 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:01:49.034 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:01:49.034 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:01:49.035 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:01:49.035 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:01:49.036 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:01:49.036 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:01:49.036 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:01:49.037 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:01:49.037 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:01:49.037 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:01:49.038 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:01:49.038 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:01:49.038 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:01:49.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:01:49.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:01:49.039 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:01:49.040 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:01:49.040 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:01:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 msgr2=0x7f28e40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 0x7f28e40672e0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 rx=0x7f28fc106b70 tx=0x7f28f0008040).stop 2022-02-02T23:01:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 msgr2=0x7f28fc1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 secure :-1 s=READY pgs=4282 cs=0 l=1 rev1=1 rx=0x7f28ec009990 tx=0x7f28ec009b30).stop 2022-02-02T23:01:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 shutdown_connections 2022-02-02T23:01:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f28e4064e20 0x7f28e40672e0 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc0f6530 0x7f28fc106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 --2- 172.21.15.96:0/2512330244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28fc0f77d0 0x7f28fc1072f0 unknown :-1 s=CLOSED pgs=4282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 >> 172.21.15.96:0/2512330244 conn(0x7f28fc0f1c90 msgr2=0x7f28fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 shutdown_connections 2022-02-02T23:01:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.033+0000 7f290141e700 1 -- 172.21.15.96:0/2512330244 wait complete. 2022-02-02T23:01:49.129 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 -- 172.21.15.96:0/1474721896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 msgr2=0x7fd7400f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 --2- 172.21.15.96:0/1474721896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7400f6b40 secure :-1 s=READY pgs=4283 cs=0 l=1 rev1=1 rx=0x7fd73c004660 tx=0x7fd73c009b30).stop 2022-02-02T23:01:49.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 -- 172.21.15.96:0/1474721896 shutdown_connections 2022-02-02T23:01:49.130 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 --2- 172.21.15.96:0/1474721896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7400f6b40 unknown :-1 s=CLOSED pgs=4283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 --2- 172.21.15.96:0/1474721896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 0x7fd7400f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.131 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.129+0000 7fd747304700 1 -- 172.21.15.96:0/1474721896 >> 172.21.15.96:0/1474721896 conn(0x7fd7400f0ba0 msgr2=0x7fd7400f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:49.132 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:48 smithi096 ceph-mon[101353]: pgmap v8390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:49.134 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 -- 172.21.15.96:0/1474721896 shutdown_connections 2022-02-02T23:01:49.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 -- 172.21.15.96:0/1474721896 wait complete. 2022-02-02T23:01:49.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 Processor -- start 2022-02-02T23:01:49.135 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 -- start start 2022-02-02T23:01:49.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 0x7fd740105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.136 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740106770 con 0x7fd7400f66e0 2022-02-02T23:01:49.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.130+0000 7fd747304700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740106f70 con 0x7fd7400f5440 2022-02-02T23:01:49.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.137 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51746/0 (socket says 172.21.15.96:51746) 2022-02-02T23:01:49.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 -- 172.21.15.96:0/184496823 learned_addr learned my addr 172.21.15.96:0/184496823 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:49.138 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd746302700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 0x7fd740105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 -- 172.21.15.96:0/184496823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 msgr2=0x7fd740105cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 0x7fd740105cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.139 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 -- 172.21.15.96:0/184496823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c005040 con 0x7fd7400f66e0 2022-02-02T23:01:49.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd745b01700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 secure :-1 s=READY pgs=4284 cs=0 l=1 rev1=1 rx=0x7fd73c009990 tx=0x7fd73c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:49.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c018070 con 0x7fd7400f66e0 2022-02-02T23:01:49.140 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd73c007ba0 con 0x7fd7400f66e0 2022-02-02T23:01:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c01c3c0 con 0x7fd7400f66e0 2022-02-02T23:01:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7401071f0 con 0x7fd7400f66e0 2022-02-02T23:01:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.131+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd740107750 con 0x7fd7400f66e0 2022-02-02T23:01:49.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.132+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740059100 con 0x7fd7400f66e0 2022-02-02T23:01:49.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.133+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd73c01d420 con 0x7fd7400f66e0 2022-02-02T23:01:49.142 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.134+0000 7fd736ffd700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 0x7fd72c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.134+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd73c083af0 con 0x7fd7400f66e0 2022-02-02T23:01:49.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.134+0000 7fd746302700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 0x7fd72c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.143 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.134+0000 7fd746302700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 0x7fd72c0672e0 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 rx=0x7fd7400f6540 tx=0x7fd730009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:49.144 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.137+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd73c055560 con 0x7fd7400f66e0 2022-02-02T23:01:49.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:48 smithi159 ceph-mon[69013]: pgmap v8390: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.367+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd740027a00 con 0x7fd7400f66e0 2022-02-02T23:01:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.368+0000 7fd736ffd700 1 -- 172.21.15.96:0/184496823 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd73c055150 con 0x7fd7400f66e0 2022-02-02T23:01:49.368 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:01:49.369 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:01:49.369 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:01:49.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:49.370 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:01:49.370 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:01:49.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:49.371 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:01:49.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:01:49.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:49.372 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:01:49.372 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:01:49.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:01:49.372 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:01:49.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:01:49.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:01:49.373 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:01:49.374 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:01:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 msgr2=0x7fd72c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 0x7fd72c0672e0 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 rx=0x7fd7400f6540 tx=0x7fd730009c00).stop 2022-02-02T23:01:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 msgr2=0x7fd7401061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 secure :-1 s=READY pgs=4284 cs=0 l=1 rev1=1 rx=0x7fd73c009990 tx=0x7fd73c009b30).stop 2022-02-02T23:01:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 shutdown_connections 2022-02-02T23:01:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd72c064e20 0x7fd72c0672e0 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7400f5440 0x7fd740105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 --2- 172.21.15.96:0/184496823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7400f66e0 0x7fd7401061c0 unknown :-1 s=CLOSED pgs=4284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 >> 172.21.15.96:0/184496823 conn(0x7fd7400f0ba0 msgr2=0x7fd7400fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 shutdown_connections 2022-02-02T23:01:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.370+0000 7fd747304700 1 -- 172.21.15.96:0/184496823 wait complete. 2022-02-02T23:01:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 -- 172.21.15.96:0/2039874435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 msgr2=0x7fe0080fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 --2- 172.21.15.96:0/2039874435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe0080fbaf0 secure :-1 s=READY pgs=4285 cs=0 l=1 rev1=1 rx=0x7fdff4004660 tx=0x7fdff4009b30).stop 2022-02-02T23:01:49.468 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 -- 172.21.15.96:0/2039874435 shutdown_connections 2022-02-02T23:01:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 --2- 172.21.15.96:0/2039874435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe0080fbaf0 unknown :-1 s=CLOSED pgs=4285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 --2- 172.21.15.96:0/2039874435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 0x7fe0080f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:01:49.469 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 -- 172.21.15.96:0/2039874435 >> 172.21.15.96:0/2039874435 conn(0x7fe0080f0ba0 msgr2=0x7fe0080f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:49.470 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 -- 172.21.15.96:0/2039874435 shutdown_connections 2022-02-02T23:01:49.472 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.468+0000 7fe00df69700 1 -- 172.21.15.96:0/2039874435 wait complete. 2022-02-02T23:01:49.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 Processor -- start 2022-02-02T23:01:49.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 -- start start 2022-02-02T23:01:49.473 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 0x7fe008106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008107920 con 0x7fe0080f96a0 2022-02-02T23:01:49.474 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.469+0000 7fe00df69700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081080d0 con 0x7fe008060310 2022-02-02T23:01:49.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51754/0 (socket says 172.21.15.96:51754) 2022-02-02T23:01:49.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 -- 172.21.15.96:0/4174532612 learned_addr learned my addr 172.21.15.96:0/4174532612 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:01:49.475 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe00cf67700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 0x7fe008106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 -- 172.21.15.96:0/4174532612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 msgr2=0x7fe008106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 0x7fe008106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.476 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 -- 172.21.15.96:0/4174532612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4005040 con 0x7fe0080f96a0 2022-02-02T23:01:49.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe007fff700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 secure :-1 s=READY pgs=4286 cs=0 l=1 rev1=1 rx=0x7fdff4004f60 tx=0x7fdff4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:49.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff4018070 con 0x7fe0080f96a0 2022-02-02T23:01:49.477 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe008108350 con 0x7fe0080f96a0 2022-02-02T23:01:49.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdff4007ba0 con 0x7fe0080f96a0 2022-02-02T23:01:49.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff401c620 con 0x7fe0080f96a0 2022-02-02T23:01:49.478 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.470+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0081088b0 con 0x7fe0080f96a0 2022-02-02T23:01:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.471+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe008059100 con 0x7fe0080f96a0 2022-02-02T23:01:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.472+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdff401c8e0 con 0x7fe0080f96a0 2022-02-02T23:01:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.472+0000 7fe0057fa700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 0x7fdff80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:01:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.472+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fdff4083960 con 0x7fe0080f96a0 2022-02-02T23:01:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.472+0000 7fe00cf67700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 0x7fdff80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:01:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.473+0000 7fe00cf67700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 0x7fdff80672e0 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 rx=0x7fe008107b60 tx=0x7fdffc008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:01:49.481 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.476+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdff4051a60 con 0x7fe0080f96a0 2022-02-02T23:01:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.676+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe0080fed80 con 0x7fe0080f96a0 2022-02-02T23:01:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.677+0000 7fe0057fa700 1 -- 172.21.15.96:0/4174532612 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fdff4055080 con 0x7fe0080f96a0 2022-02-02T23:01:49.677 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:01:49.678 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:01:49.678 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:01:49.679 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:01:49.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:49.679 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:01:49.680 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:01:49.680 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:01:49.680 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:01:49.681 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:01:49.681 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:01:49.681 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:01:49.682 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:01:49.682 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:01:49.682 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:01:49.683 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:01:49.683 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:01:49.683 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:01:49.684 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:01:49.684 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:01:49.684 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:01:49.685 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:01:49.685 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:01:49.685 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:01:49.686 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:01:49.686 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:01:49.686 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:01:49.687 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:01:49.687 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:01:49.687 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:01:49.688 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:01:49.688 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:01:49.688 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:49.689 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:01:49.689 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:01:49.690 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:49.690 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:49.690 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:01:49.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.678+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 msgr2=0x7fdff80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.678+0000 7fe00df69700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 0x7fdff80672e0 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 rx=0x7fe008107b60 tx=0x7fdffc008040).stop 2022-02-02T23:01:49.692 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.678+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 msgr2=0x7fe008107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:01:49.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.678+0000 7fe00df69700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 secure :-1 s=READY pgs=4286 cs=0 l=1 rev1=1 rx=0x7fdff4004f60 tx=0x7fdff4009b30).stop 2022-02-02T23:01:49.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 shutdown_connections 2022-02-02T23:01:49.693 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fdff8064e20 0x7fdff80672e0 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe008060310 0x7fe008106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 --2- 172.21.15.96:0/4174532612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0080f96a0 0x7fe008107290 unknown :-1 s=CLOSED pgs=4286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:01:49.694 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 >> 172.21.15.96:0/4174532612 conn(0x7fe0080f0ba0 msgr2=0x7fe0080f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:01:49.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 shutdown_connections 2022-02-02T23:01:49.695 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:01:49.679+0000 7fe00df69700 1 -- 172.21.15.96:0/4174532612 wait complete. 2022-02-02T23:01:49.695 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:01:50.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:49 smithi159 ceph-mon[69013]: from='client.42688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:50.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:49 smithi159 ceph-mon[69013]: from='client.42692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:50.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/184496823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:01:50.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:49 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4174532612' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:01:50.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:49 smithi096 ceph-mon[101353]: from='client.42688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:50.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:49 smithi096 ceph-mon[101353]: from='client.42692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:01:50.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/184496823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:01:50.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:49 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4174532612' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:01:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:50 smithi159 ceph-mon[69013]: pgmap v8391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:51.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:50 smithi096 ceph-mon[101353]: pgmap v8391: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:52 smithi096 ceph-mon[101353]: pgmap v8392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:52 smithi159 ceph-mon[69013]: pgmap v8392: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:54 smithi159 ceph-mon[69013]: pgmap v8393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:54 smithi096 ceph-mon[101353]: pgmap v8393: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:56 smithi159 ceph-mon[69013]: pgmap v8394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:56 smithi096 ceph-mon[101353]: pgmap v8394: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:01:58 smithi159 ceph-mon[69013]: pgmap v8395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:01:59.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:01:58 smithi096 ceph-mon[101353]: pgmap v8395: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:01.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:00 smithi159 ceph-mon[69013]: pgmap v8396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:00 smithi096 ceph-mon[101353]: pgmap v8396: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:02 smithi096 ceph-mon[101353]: pgmap v8397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:02 smithi159 ceph-mon[69013]: pgmap v8397: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:04 smithi159 ceph-mon[69013]: pgmap v8398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:04 smithi096 ceph-mon[101353]: pgmap v8398: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:06 smithi159 ceph-mon[69013]: pgmap v8399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:06 smithi096 ceph-mon[101353]: pgmap v8399: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:08 smithi159 ceph-mon[69013]: pgmap v8400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:08 smithi096 ceph-mon[101353]: pgmap v8400: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:10 smithi159 ceph-mon[69013]: pgmap v8401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:11.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:10 smithi096 ceph-mon[101353]: pgmap v8401: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:12 smithi096 ceph-mon[101353]: pgmap v8402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:13.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:12 smithi159 ceph-mon[69013]: pgmap v8402: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:14 smithi159 ceph-mon[69013]: pgmap v8403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:14 smithi096 ceph-mon[101353]: pgmap v8403: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:16 smithi159 ceph-mon[69013]: pgmap v8404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:17.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:16 smithi096 ceph-mon[101353]: pgmap v8404: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:18 smithi159 ceph-mon[69013]: pgmap v8405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:18 smithi096 ceph-mon[101353]: pgmap v8405: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:19.791 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- 172.21.15.96:0/3060914995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 msgr2=0x7f5a540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 --2- 172.21.15.96:0/3060914995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a540f7c30 secure :-1 s=READY pgs=4287 cs=0 l=1 rev1=1 rx=0x7f5a44004660 tx=0x7f5a44009b30).stop 2022-02-02T23:02:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- 172.21.15.96:0/3060914995 shutdown_connections 2022-02-02T23:02:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 --2- 172.21.15.96:0/3060914995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a540f7c30 unknown :-1 s=CLOSED pgs=4287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 --2- 172.21.15.96:0/3060914995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- 172.21.15.96:0/3060914995 >> 172.21.15.96:0/3060914995 conn(0x7f5a540f1c90 msgr2=0x7f5a540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- 172.21.15.96:0/3060914995 shutdown_connections 2022-02-02T23:02:19.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- 172.21.15.96:0/3060914995 wait complete. 2022-02-02T23:02:19.795 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 Processor -- start 2022-02-02T23:02:19.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 -- start start 2022-02-02T23:02:19.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.788+0000 7f5a5a917700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a54106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:19.796 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a5a917700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:19.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a5a917700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a54107880 con 0x7f5a540f77d0 2022-02-02T23:02:19.797 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a5a917700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a54108090 con 0x7f5a540f6530 2022-02-02T23:02:19.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:19.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51772/0 (socket says 172.21.15.96:51772) 2022-02-02T23:02:19.798 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 -- 172.21.15.96:0/4168952215 learned_addr learned my addr 172.21.15.96:0/4168952215 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:19.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59915700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a54106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:19.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 -- 172.21.15.96:0/4168952215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 msgr2=0x7f5a54106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:19.799 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a54106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 -- 172.21.15.96:0/4168952215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44005040 con 0x7f5a540f77d0 2022-02-02T23:02:19.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59915700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a54106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T23:02:19.800 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a59114700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 secure :-1 s=READY pgs=4288 cs=0 l=1 rev1=1 rx=0x7f5a44009990 tx=0x7f5a44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:19.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a44018070 con 0x7f5a540f77d0 2022-02-02T23:02:19.801 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a541082b0 con 0x7f5a540f77d0 2022-02-02T23:02:19.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a44007ba0 con 0x7f5a540f77d0 2022-02-02T23:02:19.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.789+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4401c3c0 con 0x7f5a540f77d0 2022-02-02T23:02:19.802 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.790+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a54108810 con 0x7f5a540f77d0 2022-02-02T23:02:19.803 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.790+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a54059100 con 0x7f5a540f77d0 2022-02-02T23:02:19.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.792+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a4401d420 con 0x7f5a540f77d0 2022-02-02T23:02:19.804 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.792+0000 7f5a4a7fc700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 0x7f5a400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:19.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.792+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5a44083900 con 0x7f5a540f77d0 2022-02-02T23:02:19.805 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.792+0000 7f5a59915700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 0x7f5a400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:19.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.792+0000 7f5a59915700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 0x7f5a400672e0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 rx=0x7f5a50009fd0 tx=0x7f5a5000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:19.806 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.796+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a44051a20 con 0x7f5a540f77d0 2022-02-02T23:02:19.975 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.974+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a540fee60 con 0x7f5a40064e20 2022-02-02T23:02:19.976 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.975+0000 7f5a4a7fc700 1 -- 172.21.15.96:0/4168952215 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5a540fee60 con 0x7f5a40064e20 2022-02-02T23:02:19.978 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 msgr2=0x7f5a400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:19.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 0x7f5a400672e0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 rx=0x7f5a50009fd0 tx=0x7f5a5000b040).stop 2022-02-02T23:02:19.979 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 msgr2=0x7f5a54107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 secure :-1 s=READY pgs=4288 cs=0 l=1 rev1=1 rx=0x7f5a44009990 tx=0x7f5a44009b30).stop 2022-02-02T23:02:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 shutdown_connections 2022-02-02T23:02:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f5a40064e20 0x7f5a400672e0 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a540f6530 0x7f5a54106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 --2- 172.21.15.96:0/4168952215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a540f77d0 0x7f5a54107280 unknown :-1 s=CLOSED pgs=4288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:19.981 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 >> 172.21.15.96:0/4168952215 conn(0x7f5a540f1c90 msgr2=0x7f5a540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:19.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 shutdown_connections 2022-02-02T23:02:19.982 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:19.977+0000 7f5a5a917700 1 -- 172.21.15.96:0/4168952215 wait complete. 2022-02-02T23:02:19.988 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:02:20.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- 172.21.15.96:0/998325588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f6860 msgr2=0x7f383c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.077 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 --2- 172.21.15.96:0/998325588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f6860 0x7f383c0f6cc0 secure :-1 s=READY pgs=4289 cs=0 l=1 rev1=1 rx=0x7f3838004660 tx=0x7f3838009b30).stop 2022-02-02T23:02:20.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- 172.21.15.96:0/998325588 shutdown_connections 2022-02-02T23:02:20.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 --2- 172.21.15.96:0/998325588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f6860 0x7f383c0f6cc0 unknown :-1 s=CLOSED pgs=4289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.078 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 --2- 172.21.15.96:0/998325588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f55c0 0x7f383c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- 172.21.15.96:0/998325588 >> 172.21.15.96:0/998325588 conn(0x7f383c0f0d40 msgr2=0x7f383c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- 172.21.15.96:0/998325588 shutdown_connections 2022-02-02T23:02:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- 172.21.15.96:0/998325588 wait complete. 2022-02-02T23:02:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 Processor -- start 2022-02-02T23:02:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- start start 2022-02-02T23:02:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f6860 0x7f383c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c107a10 con 0x7f383c0f55c0 2022-02-02T23:02:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.075+0000 7f3844301700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c107b50 con 0x7f383c0f6860 2022-02-02T23:02:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51778/0 (socket says 172.21.15.96:51778) 2022-02-02T23:02:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 -- 172.21.15.96:0/2239082562 learned_addr learned my addr 172.21.15.96:0/2239082562 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384189c700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f6860 0x7f383c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 -- 172.21.15.96:0/2239082562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f6860 msgr2=0x7f383c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f6860 0x7f383c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 -- 172.21.15.96:0/2239082562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838005040 con 0x7f383c0f55c0 2022-02-02T23:02:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f384209d700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 secure :-1 s=READY pgs=4290 cs=0 l=1 rev1=1 rx=0x7f382c002700 tx=0x7f382c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c009320 con 0x7f383c0f55c0 2022-02-02T23:02:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f382c00f040 con 0x7f383c0f55c0 2022-02-02T23:02:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c1084f0 con 0x7f383c0f55c0 2022-02-02T23:02:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c108ab0 con 0x7f383c0f55c0 2022-02-02T23:02:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.076+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c014900 con 0x7f383c0f55c0 2022-02-02T23:02:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.077+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824004fa0 con 0x7f383c0f55c0 2022-02-02T23:02:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.078+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f382c009480 con 0x7f383c0f55c0 2022-02-02T23:02:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.078+0000 7f3832ffd700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 0x7f3828067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.078+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f382c081c80 con 0x7f383c0f55c0 2022-02-02T23:02:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.078+0000 7f384189c700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 0x7f3828067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.078+0000 7f384189c700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 0x7f3828067290 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 rx=0x7f3838004630 tx=0x7f3838009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.082+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f382c0537b0 con 0x7f383c0f55c0 2022-02-02T23:02:20.256 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.255+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3824000bc0 con 0x7f3828064dd0 2022-02-02T23:02:20.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.264+0000 7f3832ffd700 1 -- 172.21.15.96:0/2239082562 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3824000bc0 con 0x7f3828064dd0 2022-02-02T23:02:20.265 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:02:20.265 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:02:20.266 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:02:20.266 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:02:20.267 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:02:20.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:02:20.267 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:02:20.268 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:02:20.268 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:02:20.268 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:02:20.269 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:02:20.269 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:02:20.269 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:02:20.270 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:02:20.270 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:02:20.270 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:02:20.271 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:02:20.271 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:02:20.271 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:02:20.272 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:02:20.272 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:02:20.272 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:02:20.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.265+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 msgr2=0x7f3828067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.265+0000 7f3844301700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 0x7f3828067290 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 rx=0x7f3838004630 tx=0x7f3838009b30).stop 2022-02-02T23:02:20.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.265+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 msgr2=0x7f383c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.274 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.265+0000 7f3844301700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 secure :-1 s=READY pgs=4290 cs=0 l=1 rev1=1 rx=0x7f382c002700 tx=0x7f382c009d80).stop 2022-02-02T23:02:20.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 shutdown_connections 2022-02-02T23:02:20.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f3828064dd0 0x7f3828067290 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f383c0f55c0 0x7f383c106f70 unknown :-1 s=CLOSED pgs=4290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 --2- 172.21.15.96:0/2239082562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c0f6860 0x7f383c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 >> 172.21.15.96:0/2239082562 conn(0x7f383c0f0d40 msgr2=0x7f383c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 shutdown_connections 2022-02-02T23:02:20.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.266+0000 7f3844301700 1 -- 172.21.15.96:0/2239082562 wait complete. 2022-02-02T23:02:20.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.363+0000 7fc68a392700 1 -- 172.21.15.96:0/1966270395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 msgr2=0x7fc6840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.363+0000 7fc68a392700 1 --2- 172.21.15.96:0/1966270395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc6840f5850 secure :-1 s=READY pgs=4291 cs=0 l=1 rev1=1 rx=0x7fc680004660 tx=0x7fc680009b30).stop 2022-02-02T23:02:20.367 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- 172.21.15.96:0/1966270395 shutdown_connections 2022-02-02T23:02:20.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 --2- 172.21.15.96:0/1966270395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc6840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.368 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 --2- 172.21.15.96:0/1966270395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc6840f5850 unknown :-1 s=CLOSED pgs=4291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- 172.21.15.96:0/1966270395 >> 172.21.15.96:0/1966270395 conn(0x7fc6840f0b90 msgr2=0x7fc6840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- 172.21.15.96:0/1966270395 shutdown_connections 2022-02-02T23:02:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- 172.21.15.96:0/1966270395 wait complete. 2022-02-02T23:02:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 Processor -- start 2022-02-02T23:02:20.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- start start 2022-02-02T23:02:20.370 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc68410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840602b0 con 0x7fc6840f5430 2022-02-02T23:02:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.364+0000 7fc68a392700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840603f0 con 0x7fc6840f66d0 2022-02-02T23:02:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51788/0 (socket says 172.21.15.96:51788) 2022-02-02T23:02:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 -- 172.21.15.96:0/3871694661 learned_addr learned my addr 172.21.15.96:0/3871694661 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:20.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc688b8f700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc68410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 -- 172.21.15.96:0/3871694661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 msgr2=0x7fc68410e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.373 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc68410e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 -- 172.21.15.96:0/3871694661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680005040 con 0x7fc6840f5430 2022-02-02T23:02:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc688b8f700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc68410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T23:02:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc689390700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 secure :-1 s=READY pgs=4292 cs=0 l=1 rev1=1 rx=0x7fc680004f60 tx=0x7fc680009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680018070 con 0x7fc6840f5430 2022-02-02T23:02:20.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc680007ba0 con 0x7fc6840f5430 2022-02-02T23:02:20.375 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68001c620 con 0x7fc6840f5430 2022-02-02T23:02:20.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.365+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68410e8a0 con 0x7fc6840f5430 2022-02-02T23:02:20.376 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.366+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68410ebf0 con 0x7fc6840f5430 2022-02-02T23:02:20.377 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.367+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684045ad0 con 0x7fc6840f5430 2022-02-02T23:02:20.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.367+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc68001c8e0 con 0x7fc6840f5430 2022-02-02T23:02:20.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.368+0000 7fc679ffb700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 0x7fc6700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.378 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.368+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc680083960 con 0x7fc6840f5430 2022-02-02T23:02:20.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.368+0000 7fc688b8f700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 0x7fc6700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.368+0000 7fc688b8f700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 0x7fc6700672e0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 rx=0x7fc6740041d0 tx=0x7fc674009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.379 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.372+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc680051a60 con 0x7fc6840f5430 2022-02-02T23:02:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.599+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc6840fdd70 con 0x7fc6840f5430 2022-02-02T23:02:20.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.600+0000 7fc679ffb700 1 -- 172.21.15.96:0/3871694661 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fc680055080 con 0x7fc6840f5430 2022-02-02T23:02:20.602 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:02:20.602 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:02:20.602 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:02:20.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:20.603 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:02:20.603 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:02:20.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:20.604 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:02:20.605 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:02:20.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:20.605 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:02:20.605 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:02:20.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:20.606 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:02:20.607 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:02:20.607 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:02:20.607 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:02:20.608 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:02:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 msgr2=0x7fc6700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 0x7fc6700672e0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 rx=0x7fc6740041d0 tx=0x7fc674009040).stop 2022-02-02T23:02:20.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 msgr2=0x7fc68410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 secure :-1 s=READY pgs=4292 cs=0 l=1 rev1=1 rx=0x7fc680004f60 tx=0x7fc680009b30).stop 2022-02-02T23:02:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 shutdown_connections 2022-02-02T23:02:20.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fc670064e20 0x7fc6700672e0 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6840f5430 0x7fc68410beb0 unknown :-1 s=CLOSED pgs=4292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 --2- 172.21.15.96:0/3871694661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840f66d0 0x7fc68410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 >> 172.21.15.96:0/3871694661 conn(0x7fc6840f0b90 msgr2=0x7fc6840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 shutdown_connections 2022-02-02T23:02:20.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.602+0000 7fc68a392700 1 -- 172.21.15.96:0/3871694661 wait complete. 2022-02-02T23:02:20.703 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 -- 172.21.15.96:0/4053631311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 msgr2=0x7f16d40f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 --2- 172.21.15.96:0/4053631311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d40f7fe0 secure :-1 s=READY pgs=4293 cs=0 l=1 rev1=1 rx=0x7f16c8004660 tx=0x7f16c8009b30).stop 2022-02-02T23:02:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 -- 172.21.15.96:0/4053631311 shutdown_connections 2022-02-02T23:02:20.704 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 --2- 172.21.15.96:0/4053631311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d40f7fe0 unknown :-1 s=CLOSED pgs=4293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 --2- 172.21.15.96:0/4053631311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 0x7f16d40f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 -- 172.21.15.96:0/4053631311 >> 172.21.15.96:0/4053631311 conn(0x7f16d40f2020 msgr2=0x7f16d40f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.705 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 -- 172.21.15.96:0/4053631311 shutdown_connections 2022-02-02T23:02:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.700+0000 7f16dc05b700 1 -- 172.21.15.96:0/4053631311 wait complete. 2022-02-02T23:02:20.706 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 Processor -- start 2022-02-02T23:02:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 -- start start 2022-02-02T23:02:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 0x7f16d4107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.707 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4107c10 con 0x7f16d40f7b80 2022-02-02T23:02:20.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16dc05b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4107d50 con 0x7f16d40f68e0 2022-02-02T23:02:20.708 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16d95f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16d95f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51800/0 (socket says 172.21.15.96:51800) 2022-02-02T23:02:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16d95f6700 1 -- 172.21.15.96:0/1017800103 learned_addr learned my addr 172.21.15.96:0/1017800103 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:20.709 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.701+0000 7f16d9df7700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 0x7f16d4107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16d95f6700 1 -- 172.21.15.96:0/1017800103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 msgr2=0x7f16d4107170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16d95f6700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 0x7f16d4107170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.710 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16d95f6700 1 -- 172.21.15.96:0/1017800103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8005040 con 0x7f16d40f7b80 2022-02-02T23:02:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16d95f6700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 secure :-1 s=READY pgs=4294 cs=0 l=1 rev1=1 rx=0x7f16c8009990 tx=0x7f16c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c8018070 con 0x7f16d40f7b80 2022-02-02T23:02:20.711 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d4108690 con 0x7f16d40f7b80 2022-02-02T23:02:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16c8007ba0 con 0x7f16d40f7b80 2022-02-02T23:02:20.712 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c801c620 con 0x7f16d40f7b80 2022-02-02T23:02:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.702+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4108bf0 con 0x7f16d40f7b80 2022-02-02T23:02:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.703+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d4045ad0 con 0x7f16d40f7b80 2022-02-02T23:02:20.715 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.703+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f16c801c8e0 con 0x7f16d40f7b80 2022-02-02T23:02:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.704+0000 7f16c67fc700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 0x7f16c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.704+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f16c8083890 con 0x7f16d40f7b80 2022-02-02T23:02:20.716 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.704+0000 7f16d9df7700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 0x7f16c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.704+0000 7f16d9df7700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 0x7f16c0067290 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 rx=0x7f16d40f79e0 tx=0x7f16d0009040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:20.717 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.708+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f16c80553c0 con 0x7f16d40f7b80 2022-02-02T23:02:20.910 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.909+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16d40612d0 con 0x7f16d40f7b80 2022-02-02T23:02:20.911 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.910+0000 7f16c67fc700 1 -- 172.21.15.96:0/1017800103 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f16c8054fb0 con 0x7f16d40f7b80 2022-02-02T23:02:20.912 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:02:20.912 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:02:20.912 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:02:20.913 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:02:20.913 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:20.913 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:02:20.914 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:02:20.914 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:02:20.914 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:02:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:02:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:02:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:02:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:02:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:02:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:02:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:02:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:02:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:02:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:02:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:02:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:02:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:02:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:02:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:02:20.920 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:02:20.920 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:02:20.920 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:02:20.920 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:02:20.921 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:02:20.921 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:02:20.921 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:02:20.922 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:02:20.922 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:20.922 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:20.923 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:02:20.923 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:20.924 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:20.924 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:20.924 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:20.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 msgr2=0x7f16c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.926 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 0x7f16c0067290 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 rx=0x7f16d40f79e0 tx=0x7f16d0009040).stop 2022-02-02T23:02:20.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 msgr2=0x7f16d4107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:20.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 secure :-1 s=READY pgs=4294 cs=0 l=1 rev1=1 rx=0x7f16c8009990 tx=0x7f16c8009b30).stop 2022-02-02T23:02:20.927 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 shutdown_connections 2022-02-02T23:02:20.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f16c0064dd0 0x7f16c0067290 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16d40f68e0 0x7f16d4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.928 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 --2- 172.21.15.96:0/1017800103 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f16d40f7b80 0x7f16d4107660 unknown :-1 s=CLOSED pgs=4294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 >> 172.21.15.96:0/1017800103 conn(0x7f16d40f2020 msgr2=0x7f16d40fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 shutdown_connections 2022-02-02T23:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:20.912+0000 7f16dc05b700 1 -- 172.21.15.96:0/1017800103 wait complete. 2022-02-02T23:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:02:21.054 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:20 smithi096 ceph-mon[101353]: pgmap v8406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:20 smithi096 ceph-mon[101353]: from='client.42704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:21.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:20 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3871694661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:02:21.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:20 smithi159 ceph-mon[69013]: pgmap v8406: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:20 smithi159 ceph-mon[69013]: from='client.42704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:20 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3871694661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:02:22.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:21 smithi159 ceph-mon[69013]: from='client.42708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:22.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:21 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/1017800103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:02:22.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:21 smithi096 ceph-mon[101353]: from='client.42708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:22.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:21 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/1017800103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:02:23.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:22 smithi096 ceph-mon[101353]: pgmap v8407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:23.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:22 smithi159 ceph-mon[69013]: pgmap v8407: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:24 smithi159 ceph-mon[69013]: pgmap v8408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:24 smithi096 ceph-mon[101353]: pgmap v8408: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:26 smithi159 ceph-mon[69013]: pgmap v8409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:26 smithi096 ceph-mon[101353]: pgmap v8409: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:28 smithi159 ceph-mon[69013]: pgmap v8410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:02:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:02:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:28 smithi096 ceph-mon[101353]: pgmap v8410: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:02:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:02:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:30 smithi159 ceph-mon[69013]: pgmap v8411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:30 smithi096 ceph-mon[101353]: pgmap v8411: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:32 smithi096 ceph-mon[101353]: pgmap v8412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:32 smithi159 ceph-mon[69013]: pgmap v8412: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:35.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:34 smithi159 ceph-mon[69013]: pgmap v8413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:34 smithi096 ceph-mon[101353]: pgmap v8413: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:36 smithi159 ceph-mon[69013]: pgmap v8414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:36 smithi096 ceph-mon[101353]: pgmap v8414: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:38 smithi159 ceph-mon[69013]: pgmap v8415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:39.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:38 smithi096 ceph-mon[101353]: pgmap v8415: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:40 smithi159 ceph-mon[69013]: pgmap v8416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:40 smithi096 ceph-mon[101353]: pgmap v8416: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:43.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:42 smithi096 ceph-mon[101353]: pgmap v8417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:42 smithi159 ceph-mon[69013]: pgmap v8417: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:44 smithi159 ceph-mon[69013]: pgmap v8418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:44 smithi096 ceph-mon[101353]: pgmap v8418: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:46 smithi159 ceph-mon[69013]: pgmap v8419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:46 smithi096 ceph-mon[101353]: pgmap v8419: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:48 smithi159 ceph-mon[69013]: pgmap v8420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:48 smithi096 ceph-mon[101353]: pgmap v8420: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.023+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3278857563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f7980 msgr2=0x7f85dc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.023+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3278857563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f7980 0x7f85dc0f7de0 secure :-1 s=READY pgs=4295 cs=0 l=1 rev1=1 rx=0x7f85d0004660 tx=0x7f85d0009b30).stop 2022-02-02T23:02:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.023+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3278857563 shutdown_connections 2022-02-02T23:02:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.023+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3278857563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f7980 0x7f85dc0f7de0 unknown :-1 s=CLOSED pgs=4295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3278857563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f66e0 0x7f85dc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3278857563 >> 172.21.15.96:0/3278857563 conn(0x7f85dc0f1e40 msgr2=0x7f85dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.026 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3278857563 shutdown_connections 2022-02-02T23:02:51.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3278857563 wait complete. 2022-02-02T23:02:51.027 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 Processor -- start 2022-02-02T23:02:51.029 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.024+0000 7f85e2a4f700 1 -- start start 2022-02-02T23:02:51.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f7980 0x7f85dc107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.030 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1079b0 con 0x7f85dc0f66e0 2022-02-02T23:02:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc107af0 con 0x7f85dc0f7980 2022-02-02T23:02:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51816/0 (socket says 172.21.15.96:51816) 2022-02-02T23:02:51.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 -- 172.21.15.96:0/3744700277 learned_addr learned my addr 172.21.15.96:0/3744700277 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:51.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85db7fe700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f7980 0x7f85dc107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.032 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 -- 172.21.15.96:0/3744700277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f7980 msgr2=0x7f85dc107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f7980 0x7f85dc107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 -- 172.21.15.96:0/3744700277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0005040 con 0x7f85dc0f66e0 2022-02-02T23:02:51.033 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85dbfff700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 secure :-1 s=READY pgs=4296 cs=0 l=1 rev1=1 rx=0x7f85cc00e7c0 tx=0x7f85cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc0092e0 con 0x7f85dc0f66e0 2022-02-02T23:02:51.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc108490 con 0x7f85dc0f66e0 2022-02-02T23:02:51.034 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85cc00f040 con 0x7f85dc0f66e0 2022-02-02T23:02:51.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc014750 con 0x7f85dc0f66e0 2022-02-02T23:02:51.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.025+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc108a50 con 0x7f85dc0f66e0 2022-02-02T23:02:51.035 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.027+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc045ad0 con 0x7f85dc0f66e0 2022-02-02T23:02:51.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.027+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85cc01b030 con 0x7f85dc0f66e0 2022-02-02T23:02:51.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.027+0000 7f85d8ff9700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 0x7f85c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.036 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.028+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85cc081b10 con 0x7f85dc0f66e0 2022-02-02T23:02:51.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.028+0000 7f85db7fe700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 0x7f85c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.037 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.028+0000 7f85db7fe700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 0x7f85c4067290 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 rx=0x7f85d00043d0 tx=0x7f85d000b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.038 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.032+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85cc053640 con 0x7f85dc0f66e0 2022-02-02T23:02:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.212+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85dc108c70 con 0x7f85c4064dd0 2022-02-02T23:02:51.214 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:50 smithi096 ceph-mon[101353]: pgmap v8421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.214+0000 7f85d8ff9700 1 -- 172.21.15.96:0/3744700277 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f85dc108c70 con 0x7f85c4064dd0 2022-02-02T23:02:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 msgr2=0x7f85c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 0x7f85c4067290 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 rx=0x7f85d00043d0 tx=0x7f85d000b040).stop 2022-02-02T23:02:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 msgr2=0x7f85dc106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 secure :-1 s=READY pgs=4296 cs=0 l=1 rev1=1 rx=0x7f85cc00e7c0 tx=0x7f85cc00b040).stop 2022-02-02T23:02:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 shutdown_connections 2022-02-02T23:02:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f85c4064dd0 0x7f85c4067290 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85dc0f66e0 0x7f85dc106f10 unknown :-1 s=CLOSED pgs=4296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 --2- 172.21.15.96:0/3744700277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85dc0f7980 0x7f85dc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.215+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 >> 172.21.15.96:0/3744700277 conn(0x7f85dc0f1e40 msgr2=0x7f85dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.216+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 shutdown_connections 2022-02-02T23:02:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.216+0000 7f85e2a4f700 1 -- 172.21.15.96:0/3744700277 wait complete. 2022-02-02T23:02:51.225 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:02:51.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:50 smithi159 ceph-mon[69013]: pgmap v8421: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:51.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 -- 172.21.15.96:0/4058595077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 msgr2=0x7f21200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.313 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 --2- 172.21.15.96:0/4058595077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f21200f7c30 secure :-1 s=READY pgs=4297 cs=0 l=1 rev1=1 rx=0x7f2114004660 tx=0x7f2114009b30).stop 2022-02-02T23:02:51.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 -- 172.21.15.96:0/4058595077 shutdown_connections 2022-02-02T23:02:51.314 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 --2- 172.21.15.96:0/4058595077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f21200f7c30 unknown :-1 s=CLOSED pgs=4297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 --2- 172.21.15.96:0/4058595077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f21200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 -- 172.21.15.96:0/4058595077 >> 172.21.15.96:0/4058595077 conn(0x7f21200f1c90 msgr2=0x7f21200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.315 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 -- 172.21.15.96:0/4058595077 shutdown_connections 2022-02-02T23:02:51.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.312+0000 7f211f59e700 1 -- 172.21.15.96:0/4058595077 wait complete. 2022-02-02T23:02:51.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 Processor -- start 2022-02-02T23:02:51.316 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 -- start start 2022-02-02T23:02:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f2120106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21201077f0 con 0x7f21200f77d0 2022-02-02T23:02:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211f59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120107ff0 con 0x7f21200f6530 2022-02-02T23:02:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.313+0000 7f211dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51828/0 (socket says 172.21.15.96:51828) 2022-02-02T23:02:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 -- 172.21.15.96:0/1559235352 learned_addr learned my addr 172.21.15.96:0/1559235352 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211e59c700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f2120106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 -- 172.21.15.96:0/1559235352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 msgr2=0x7f2120106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f2120106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 -- 172.21.15.96:0/1559235352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114005040 con 0x7f21200f77d0 2022-02-02T23:02:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211e59c700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f2120106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T23:02:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211dd9b700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 secure :-1 s=READY pgs=4298 cs=0 l=1 rev1=1 rx=0x7f2114009990 tx=0x7f2114009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2114018070 con 0x7f21200f77d0 2022-02-02T23:02:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2114007ba0 con 0x7f21200f77d0 2022-02-02T23:02:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211401c3c0 con 0x7f21200f77d0 2022-02-02T23:02:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2120108270 con 0x7f21200f77d0 2022-02-02T23:02:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.314+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201087d0 con 0x7f21200f77d0 2022-02-02T23:02:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.315+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120059100 con 0x7f21200f77d0 2022-02-02T23:02:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.316+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f211401d420 con 0x7f21200f77d0 2022-02-02T23:02:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.316+0000 7f210effd700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 0x7f21080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.316+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2114083760 con 0x7f21200f77d0 2022-02-02T23:02:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.316+0000 7f211e59c700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 0x7f21080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.316+0000 7f211e59c700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 0x7f21080672e0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 rx=0x7f21200f7630 tx=0x7f211800b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.320+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2114055230 con 0x7f21200f77d0 2022-02-02T23:02:51.491 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.491+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21200fecf0 con 0x7f2108064e20 2022-02-02T23:02:51.500 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.500+0000 7f210effd700 1 -- 172.21.15.96:0/1559235352 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f21200fecf0 con 0x7f2108064e20 2022-02-02T23:02:51.501 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:02:51.501 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:02:51.502 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:02:51.502 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:02:51.502 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:02:51.503 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:02:51.503 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:02:51.503 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:02:51.504 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:02:51.504 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:02:51.504 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:02:51.505 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:02:51.505 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:02:51.505 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:02:51.506 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:02:51.506 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:02:51.506 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:02:51.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:02:51.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:02:51.507 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:02:51.508 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:02:51.508 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:02:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 msgr2=0x7f21080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 0x7f21080672e0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 rx=0x7f21200f7630 tx=0x7f211800b040).stop 2022-02-02T23:02:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 msgr2=0x7f2120107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 secure :-1 s=READY pgs=4298 cs=0 l=1 rev1=1 rx=0x7f2114009990 tx=0x7f2114009b30).stop 2022-02-02T23:02:51.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 shutdown_connections 2022-02-02T23:02:51.511 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f2108064e20 0x7f21080672e0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21200f6530 0x7f2120106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 --2- 172.21.15.96:0/1559235352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21200f77d0 0x7f2120107240 unknown :-1 s=CLOSED pgs=4298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.512 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 >> 172.21.15.96:0/1559235352 conn(0x7f21200f1c90 msgr2=0x7f21200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 shutdown_connections 2022-02-02T23:02:51.513 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.502+0000 7f211f59e700 1 -- 172.21.15.96:0/1559235352 wait complete. 2022-02-02T23:02:51.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 -- 172.21.15.96:0/1826516479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f77d0 msgr2=0x7fd3800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.600 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 --2- 172.21.15.96:0/1826516479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f77d0 0x7fd3800f7c30 secure :-1 s=READY pgs=4299 cs=0 l=1 rev1=1 rx=0x7fd370004660 tx=0x7fd370009b30).stop 2022-02-02T23:02:51.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 -- 172.21.15.96:0/1826516479 shutdown_connections 2022-02-02T23:02:51.601 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 --2- 172.21.15.96:0/1826516479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f77d0 0x7fd3800f7c30 unknown :-1 s=CLOSED pgs=4299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 --2- 172.21.15.96:0/1826516479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f6530 0x7fd3800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.599+0000 7fd386746700 1 -- 172.21.15.96:0/1826516479 >> 172.21.15.96:0/1826516479 conn(0x7fd3800f1cd0 msgr2=0x7fd3800f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.602 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.600+0000 7fd386746700 1 -- 172.21.15.96:0/1826516479 shutdown_connections 2022-02-02T23:02:51.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.600+0000 7fd386746700 1 -- 172.21.15.96:0/1826516479 wait complete. 2022-02-02T23:02:51.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.600+0000 7fd386746700 1 Processor -- start 2022-02-02T23:02:51.603 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.600+0000 7fd386746700 1 -- start start 2022-02-02T23:02:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd386746700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd386746700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f77d0 0x7fd380107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd386746700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380107870 con 0x7fd3800f6530 2022-02-02T23:02:51.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd386746700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380108080 con 0x7fd3800f77d0 2022-02-02T23:02:51.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.607 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51836/0 (socket says 172.21.15.96:51836) 2022-02-02T23:02:51.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 -- 172.21.15.96:0/2213750982 learned_addr learned my addr 172.21.15.96:0/2213750982 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:51.608 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd384f43700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f77d0 0x7fd380107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 -- 172.21.15.96:0/2213750982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f77d0 msgr2=0x7fd380107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f77d0 0x7fd380107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.609 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 -- 172.21.15.96:0/2213750982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370005040 con 0x7fd3800f6530 2022-02-02T23:02:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd385744700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 secure :-1 s=READY pgs=4300 cs=0 l=1 rev1=1 rx=0x7fd37c002700 tx=0x7fd37c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c009320 con 0x7fd3800f6530 2022-02-02T23:02:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd37c00f040 con 0x7fd3800f6530 2022-02-02T23:02:51.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380108300 con 0x7fd3800f6530 2022-02-02T23:02:51.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.601+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c014900 con 0x7fd3800f6530 2022-02-02T23:02:51.611 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.602+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3801088c0 con 0x7fd3800f6530 2022-02-02T23:02:51.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.603+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd37c009480 con 0x7fd3800f6530 2022-02-02T23:02:51.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.603+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380059100 con 0x7fd3800f6530 2022-02-02T23:02:51.612 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.603+0000 7fd375ffb700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 0x7fd36c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.603+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd37c081cc0 con 0x7fd3800f6530 2022-02-02T23:02:51.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.604+0000 7fd384f43700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 0x7fd36c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.613 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.604+0000 7fd384f43700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 0x7fd36c0672e0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 rx=0x7fd370004630 tx=0x7fd370009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.614 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.608+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd37c04fe80 con 0x7fd3800f6530 2022-02-02T23:02:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.838+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd380045ad0 con 0x7fd3800f6530 2022-02-02T23:02:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.839+0000 7fd375ffb700 1 -- 172.21.15.96:0/2213750982 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7fd37c0534a0 con 0x7fd3800f6530 2022-02-02T23:02:51.840 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:02:51.840 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:02:51.841 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:02:51.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:51.841 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:02:51.842 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:02:51.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:51.843 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:02:51.843 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:02:51.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:51.844 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:02:51.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:02:51.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:02:51.845 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:02:51.845 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:02:51.845 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:02:51.846 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:02:51.846 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:02:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 msgr2=0x7fd36c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 0x7fd36c0672e0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 rx=0x7fd370004630 tx=0x7fd370009b30).stop 2022-02-02T23:02:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 msgr2=0x7fd380106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 secure :-1 s=READY pgs=4300 cs=0 l=1 rev1=1 rx=0x7fd37c002700 tx=0x7fd37c009d80).stop 2022-02-02T23:02:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 shutdown_connections 2022-02-02T23:02:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7fd36c064e20 0x7fd36c0672e0 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3800f6530 0x7fd380106d80 unknown :-1 s=CLOSED pgs=4300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 --2- 172.21.15.96:0/2213750982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800f77d0 0x7fd380107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 >> 172.21.15.96:0/2213750982 conn(0x7fd3800f1cd0 msgr2=0x7fd3800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 shutdown_connections 2022-02-02T23:02:51.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.841+0000 7fd386746700 1 -- 172.21.15.96:0/2213750982 wait complete. 2022-02-02T23:02:51.940 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.938+0000 7ffb1b59e700 1 -- 172.21.15.96:0/2144602670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 msgr2=0x7ffb1c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.938+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/2144602670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c0f6b30 secure :-1 s=READY pgs=4301 cs=0 l=1 rev1=1 rx=0x7ffb10004660 tx=0x7ffb10009b30).stop 2022-02-02T23:02:51.941 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- 172.21.15.96:0/2144602670 shutdown_connections 2022-02-02T23:02:51.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/2144602670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c0f6b30 unknown :-1 s=CLOSED pgs=4301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/2144602670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 0x7ffb1c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.942 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- 172.21.15.96:0/2144602670 >> 172.21.15.96:0/2144602670 conn(0x7ffb1c0f0b90 msgr2=0x7ffb1c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:51.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- 172.21.15.96:0/2144602670 shutdown_connections 2022-02-02T23:02:51.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- 172.21.15.96:0/2144602670 wait complete. 2022-02-02T23:02:51.943 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 Processor -- start 2022-02-02T23:02:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- start start 2022-02-02T23:02:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 0x7ffb1c109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0603c0 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.945 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb1b59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c060500 con 0x7ffb1c0f5430 2022-02-02T23:02:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.939+0000 7ffb19d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.946 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51848/0 (socket says 172.21.15.96:51848) 2022-02-02T23:02:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 -- 172.21.15.96:0/4057939437 learned_addr learned my addr 172.21.15.96:0/4057939437 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:02:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb1a59c700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 0x7ffb1c109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 -- 172.21.15.96:0/4057939437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 msgr2=0x7ffb1c109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 0x7ffb1c109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 -- 172.21.15.96:0/4057939437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10005040 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.948 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb19d9b700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 secure :-1 s=READY pgs=4302 cs=0 l=1 rev1=1 rx=0x7ffb10009990 tx=0x7ffb10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10018070 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c10c490 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb10007ba0 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb1001c3c0 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.940+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c10c9c0 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.941+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c059100 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.941+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb1001d420 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.942+0000 7ffb0affd700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 0x7ffb040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:02:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.942+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ffb10083740 con 0x7ffb1c0f66d0 2022-02-02T23:02:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.942+0000 7ffb1a59c700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 0x7ffb040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:02:51.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.942+0000 7ffb1a59c700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 0x7ffb040672e0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 rx=0x7ffb1c060040 tx=0x7ffb0c009c00).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:02:51.954 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:51.946+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb100517e0 con 0x7ffb1c0f66d0 2022-02-02T23:02:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.148+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb1c045ad0 con 0x7ffb1c0f66d0 2022-02-02T23:02:52.149 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:51 smithi096 ceph-mon[101353]: from='client.42720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:52.149 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:51 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/2213750982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:02:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.149+0000 7ffb0affd700 1 -- 172.21.15.96:0/4057939437 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ffb10054e00 con 0x7ffb1c0f66d0 2022-02-02T23:02:52.151 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:02:52.151 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:02:52.151 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:02:52.152 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:02:52.152 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:52.152 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:02:52.153 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:02:52.153 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:02:52.153 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:02:52.154 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:02:52.154 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:02:52.154 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:02:52.155 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:02:52.155 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:02:52.156 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:02:52.156 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:02:52.156 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:02:52.157 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:02:52.157 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:02:52.157 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:02:52.158 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:02:52.158 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:02:52.158 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:02:52.159 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:02:52.159 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:02:52.159 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:02:52.160 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:02:52.160 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:02:52.160 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:02:52.161 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:02:52.161 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:02:52.161 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:02:52.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:52.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:52.162 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:02:52.163 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:02:52.163 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:52.163 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:52.164 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:02:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 msgr2=0x7ffb040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 0x7ffb040672e0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 rx=0x7ffb1c060040 tx=0x7ffb0c009c00).stop 2022-02-02T23:02:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 msgr2=0x7ffb1c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:02:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 secure :-1 s=READY pgs=4302 cs=0 l=1 rev1=1 rx=0x7ffb10009990 tx=0x7ffb10009b30).stop 2022-02-02T23:02:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 shutdown_connections 2022-02-02T23:02:52.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7ffb04064e20 0x7ffb040672e0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:52.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb1c0f5430 0x7ffb1c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:52.167 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 --2- 172.21.15.96:0/4057939437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb1c0f66d0 0x7ffb1c10bf40 unknown :-1 s=CLOSED pgs=4302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:02:52.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.150+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 >> 172.21.15.96:0/4057939437 conn(0x7ffb1c0f0b90 msgr2=0x7ffb1c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:02:52.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.151+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 shutdown_connections 2022-02-02T23:02:52.168 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:02:52.151+0000 7ffb1b59e700 1 -- 172.21.15.96:0/4057939437 wait complete. 2022-02-02T23:02:52.169 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:02:52.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:51 smithi159 ceph-mon[69013]: from='client.42720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:52.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:51 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/2213750982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:02:53.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:52 smithi096 ceph-mon[101353]: from='client.42724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:52 smithi096 ceph-mon[101353]: pgmap v8422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:53.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:52 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4057939437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:02:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:52 smithi159 ceph-mon[69013]: from='client.42724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:02:53.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:52 smithi159 ceph-mon[69013]: pgmap v8422: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:53.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:52 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4057939437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:02:55.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:54 smithi159 ceph-mon[69013]: pgmap v8423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:55.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:54 smithi096 ceph-mon[101353]: pgmap v8423: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:57.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:56 smithi159 ceph-mon[69013]: pgmap v8424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:56 smithi096 ceph-mon[101353]: pgmap v8424: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:59.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:02:58 smithi159 ceph-mon[69013]: pgmap v8425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:02:59.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:02:58 smithi096 ceph-mon[101353]: pgmap v8425: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:01.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:00 smithi159 ceph-mon[69013]: pgmap v8426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:01.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:00 smithi096 ceph-mon[101353]: pgmap v8426: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:03.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:02 smithi096 ceph-mon[101353]: pgmap v8427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:03.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:02 smithi159 ceph-mon[69013]: pgmap v8427: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:05.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:04 smithi159 ceph-mon[69013]: pgmap v8428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:05.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:04 smithi096 ceph-mon[101353]: pgmap v8428: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:07.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:06 smithi159 ceph-mon[69013]: pgmap v8429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:07.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:06 smithi096 ceph-mon[101353]: pgmap v8429: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:09.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:08 smithi159 ceph-mon[69013]: pgmap v8430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:09.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:08 smithi096 ceph-mon[101353]: pgmap v8430: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:11.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:10 smithi159 ceph-mon[69013]: pgmap v8431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:11.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:10 smithi096 ceph-mon[101353]: pgmap v8431: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:13.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:12 smithi096 ceph-mon[101353]: pgmap v8432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:13.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:12 smithi159 ceph-mon[69013]: pgmap v8432: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:15.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:14 smithi159 ceph-mon[69013]: pgmap v8433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:15.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:14 smithi096 ceph-mon[101353]: pgmap v8433: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:17.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:16 smithi159 ceph-mon[69013]: pgmap v8434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:17.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:16 smithi096 ceph-mon[101353]: pgmap v8434: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:19.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:18 smithi159 ceph-mon[69013]: pgmap v8435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:19.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:18 smithi096 ceph-mon[101353]: pgmap v8435: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:21.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:20 smithi159 ceph-mon[69013]: pgmap v8436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:21.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:20 smithi096 ceph-mon[101353]: pgmap v8436: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:22.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 -- 172.21.15.96:0/3451386438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f77d0 msgr2=0x7f119c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.264 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 --2- 172.21.15.96:0/3451386438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f77d0 0x7f119c0f7c30 secure :-1 s=READY pgs=4303 cs=0 l=1 rev1=1 rx=0x7f118c004660 tx=0x7f118c009b30).stop 2022-02-02T23:03:22.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 -- 172.21.15.96:0/3451386438 shutdown_connections 2022-02-02T23:03:22.265 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 --2- 172.21.15.96:0/3451386438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f77d0 0x7f119c0f7c30 unknown :-1 s=CLOSED pgs=4303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 --2- 172.21.15.96:0/3451386438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f6530 0x7f119c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.260+0000 7f11a222a700 1 -- 172.21.15.96:0/3451386438 >> 172.21.15.96:0/3451386438 conn(0x7f119c0f1c90 msgr2=0x7f119c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:22.266 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.261+0000 7f11a222a700 1 -- 172.21.15.96:0/3451386438 shutdown_connections 2022-02-02T23:03:22.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.261+0000 7f11a222a700 1 -- 172.21.15.96:0/3451386438 wait complete. 2022-02-02T23:03:22.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.261+0000 7f11a222a700 1 Processor -- start 2022-02-02T23:03:22.267 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.261+0000 7f11a222a700 1 -- start start 2022-02-02T23:03:22.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a222a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a222a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f77d0 0x7f119c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.268 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a222a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c06a380 con 0x7f119c0f6530 2022-02-02T23:03:22.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a222a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c06a4c0 con 0x7f119c0f77d0 2022-02-02T23:03:22.269 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51864/0 (socket says 172.21.15.96:51864) 2022-02-02T23:03:22.270 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 -- 172.21.15.96:0/2036898660 learned_addr learned my addr 172.21.15.96:0/2036898660 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:03:22.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a0a27700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f77d0 0x7f119c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 -- 172.21.15.96:0/2036898660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f77d0 msgr2=0x7f119c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.271 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f77d0 0x7f119c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 -- 172.21.15.96:0/2036898660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c005040 con 0x7f119c0f6530 2022-02-02T23:03:22.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.262+0000 7f11a1228700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 secure :-1 s=READY pgs=4304 cs=0 l=1 rev1=1 rx=0x7f1198002700 tx=0x7f1198009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.272 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.263+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11980079c0 con 0x7f119c0f6530 2022-02-02T23:03:22.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.263+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f119800f040 con 0x7f119c0f6530 2022-02-02T23:03:22.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.263+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1198014860 con 0x7f119c0f6530 2022-02-02T23:03:22.273 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.263+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c06a7a0 con 0x7f119c0f6530 2022-02-02T23:03:22.275 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.263+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c10ed50 con 0x7f119c0f6530 2022-02-02T23:03:22.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.265+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c059100 con 0x7f119c0f6530 2022-02-02T23:03:22.276 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.265+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11980090d0 con 0x7f119c0f6530 2022-02-02T23:03:22.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.265+0000 7f1191ffb700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 0x7f11880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.265+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1198081ae0 con 0x7f119c0f6530 2022-02-02T23:03:22.277 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.265+0000 7f11a0a27700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 0x7f11880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.266+0000 7f11a0a27700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 0x7f11880672e0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 rx=0x7f118c004630 tx=0x7f118c009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.278 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.270+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f119804fbe0 con 0x7f119c0f6530 2022-02-02T23:03:22.450 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.449+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f119c057f10 con 0x7f1188064e20 2022-02-02T23:03:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.451+0000 7f1191ffb700 1 -- 172.21.15.96:0/2036898660 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f119c057f10 con 0x7f1188064e20 2022-02-02T23:03:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 msgr2=0x7f11880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 0x7f11880672e0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 rx=0x7f118c004630 tx=0x7f118c009b30).stop 2022-02-02T23:03:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 msgr2=0x7f119c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 secure :-1 s=READY pgs=4304 cs=0 l=1 rev1=1 rx=0x7f1198002700 tx=0x7f1198009d80).stop 2022-02-02T23:03:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 shutdown_connections 2022-02-02T23:03:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f1188064e20 0x7f11880672e0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c0f6530 0x7f119c06b9a0 unknown :-1 s=CLOSED pgs=4304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 --2- 172.21.15.96:0/2036898660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f119c0f77d0 0x7f119c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.452+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 >> 172.21.15.96:0/2036898660 conn(0x7f119c0f1c90 msgr2=0x7f119c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.453+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 shutdown_connections 2022-02-02T23:03:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.453+0000 7f11a222a700 1 -- 172.21.15.96:0/2036898660 wait complete. 2022-02-02T23:03:22.462 INFO:teuthology.orchestra.run.smithi096.stdout:true 2022-02-02T23:03:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.549+0000 7f26f7073700 1 -- 172.21.15.96:0/2593157659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 msgr2=0x7f26f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.549+0000 7f26f7073700 1 --2- 172.21.15.96:0/2593157659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f00f59e0 secure :-1 s=READY pgs=4305 cs=0 l=1 rev1=1 rx=0x7f26e4004660 tx=0x7f26e4009b30).stop 2022-02-02T23:03:22.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.550+0000 7f26f7073700 1 -- 172.21.15.96:0/2593157659 shutdown_connections 2022-02-02T23:03:22.551 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.550+0000 7f26f7073700 1 --2- 172.21.15.96:0/2593157659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 0x7f26f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.550+0000 7f26f7073700 1 --2- 172.21.15.96:0/2593157659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f00f59e0 unknown :-1 s=CLOSED pgs=4305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.550+0000 7f26f7073700 1 -- 172.21.15.96:0/2593157659 >> 172.21.15.96:0/2593157659 conn(0x7f26f00f0d40 msgr2=0x7f26f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:22.552 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.550+0000 7f26f7073700 1 -- 172.21.15.96:0/2593157659 shutdown_connections 2022-02-02T23:03:22.553 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 -- 172.21.15.96:0/2593157659 wait complete. 2022-02-02T23:03:22.555 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 Processor -- start 2022-02-02T23:03:22.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 -- start start 2022-02-02T23:03:22.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.556 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 0x7f26f010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00603c0 con 0x7f26f00f55c0 2022-02-02T23:03:22.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.551+0000 7f26f7073700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0060500 con 0x7f26f00f6860 2022-02-02T23:03:22.557 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51874/0 (socket says 172.21.15.96:51874) 2022-02-02T23:03:22.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 -- 172.21.15.96:0/3978725848 learned_addr learned my addr 172.21.15.96:0/3978725848 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:03:22.558 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26effff700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 0x7f26f010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 -- 172.21.15.96:0/3978725848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 msgr2=0x7f26f010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.559 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 0x7f26f010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 -- 172.21.15.96:0/3978725848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4005040 con 0x7f26f00f55c0 2022-02-02T23:03:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f4e0f700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 secure :-1 s=READY pgs=4306 cs=0 l=1 rev1=1 rx=0x7f26e4013a70 tx=0x7f26e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.560 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26e4018070 con 0x7f26f00f55c0 2022-02-02T23:03:22.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26e40097d0 con 0x7f26f00f55c0 2022-02-02T23:03:22.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f010c6e0 con 0x7f26f00f55c0 2022-02-02T23:03:22.561 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26e401c3c0 con 0x7f26f00f55c0 2022-02-02T23:03:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.552+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f010cc10 con 0x7f26f00f55c0 2022-02-02T23:03:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.553+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f00f49b0 con 0x7f26f00f55c0 2022-02-02T23:03:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.554+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f26e4007ba0 con 0x7f26f00f55c0 2022-02-02T23:03:22.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.554+0000 7f26ed7fa700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 0x7f26e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.563 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.554+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f26e40836d0 con 0x7f26f00f55c0 2022-02-02T23:03:22.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.554+0000 7f26effff700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 0x7f26e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.564 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.555+0000 7f26effff700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 0x7f26e0067290 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 rx=0x7f26dc004a70 tx=0x7f26dc00b040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.565 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.558+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f26e4051890 con 0x7f26f00f55c0 2022-02-02T23:03:22.730 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.730+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 --> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26f00fdf30 con 0x7f26e0064dd0 2022-02-02T23:03:22.739 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.739+0000 7f26ed7fa700 1 -- 172.21.15.96:0/3978725848 <== mgr.24491 v2:172.21.15.96:6800/4041210206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f26dc00f040 con 0x7f26e0064dd0 2022-02-02T23:03:22.740 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T23:03:22.740 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4h) 4h ago 4h 18.1M - 0.20.0 0881eb8f169f ca297c3b05cb 2022-02-02T23:03:22.741 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4h) 4h ago 4h 7209k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e c1433d766837 2022-02-02T23:03:22.741 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi159 smithi159 running (4h) 4h ago 4h 7205k - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 7154542c9cfb 2022-02-02T23:03:22.741 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4h) 4h ago 4h 42.2M - 6.7.4 557c83e11646 b9b40ca3564a 2022-02-02T23:03:22.742 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.ghwylx smithi096 running (4h) 4h ago 4h 570M - 16.2.4 8d91d370c2b8 a6c0de8243d9 2022-02-02T23:03:22.742 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pitrsc smithi096 running (4h) 4h ago 4h 20.0M - 16.2.4 8d91d370c2b8 aa7b475d570c 2022-02-02T23:03:22.742 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.omlhix smithi159 running (4h) 4h ago 4h 5342M - 16.2.4 8d91d370c2b8 eee33d834c40 2022-02-02T23:03:22.743 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi159.shbucd smithi159 running (4h) 4h ago 4h 20.8M - 16.2.4 8d91d370c2b8 c3a5bb489c81 2022-02-02T23:03:22.743 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.shfutl smithi096 *:8443,9283 running (4h) 4h ago 4h 496M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e 096688ec512b 2022-02-02T23:03:22.743 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi159.jrxkfz smithi159 *:8443,9283 running (4h) 4h ago 4h 425M - 17.0.0-10511-g78571b80 d5bc5e0e3c6e f33435c5754d 2022-02-02T23:03:22.744 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4h) 4h ago 4h 157M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 75d7f2d934b3 2022-02-02T23:03:22.744 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi159 smithi159 running (4h) 4h ago 4h 86.1M 2048M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 6ced22c3b347 2022-02-02T23:03:22.744 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4h) 4h ago 4h 18.5M - 0.18.1 e5a616e4b9cf c1d99a4c410d 2022-02-02T23:03:22.745 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi159 smithi159 *:9100 running (4h) 4h ago 4h 18.1M - 0.18.1 e5a616e4b9cf b5e5a000b7be 2022-02-02T23:03:22.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4h) 4h ago 4h 320M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d0a408a5a7fa 2022-02-02T23:03:22.745 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4h) 4h ago 4h 319M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e 2e0a36314fd8 2022-02-02T23:03:22.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4h) 4h ago 4h 260M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e c23723b53c21 2022-02-02T23:03:22.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi159 running (4h) 4h ago 4h 342M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e b9aab909b261 2022-02-02T23:03:22.746 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi159 running (4h) 4h ago 4h 305M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e d955549d76b3 2022-02-02T23:03:22.747 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi159 running (4h) 4h ago 4h 721M 4096M 17.0.0-10511-g78571b80 d5bc5e0e3c6e af68805d7b16 2022-02-02T23:03:22.747 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4h) 4h ago 4h 52.9M - 2.18.1 de242295e225 9a3ac799a848 2022-02-02T23:03:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.741+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 msgr2=0x7f26e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.741+0000 7f26f7073700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 0x7f26e0067290 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 rx=0x7f26dc004a70 tx=0x7f26dc00b040).stop 2022-02-02T23:03:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.741+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 msgr2=0x7f26f0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.741+0000 7f26f7073700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 secure :-1 s=READY pgs=4306 cs=0 l=1 rev1=1 rx=0x7f26e4013a70 tx=0x7f26e4009b30).stop 2022-02-02T23:03:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.741+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 shutdown_connections 2022-02-02T23:03:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f26e0064dd0 0x7f26e0067290 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f00f55c0 0x7f26f0109c90 unknown :-1 s=CLOSED pgs=4306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 --2- 172.21.15.96:0/3978725848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26f00f6860 0x7f26f010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 >> 172.21.15.96:0/3978725848 conn(0x7f26f00f0d40 msgr2=0x7f26f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 shutdown_connections 2022-02-02T23:03:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.742+0000 7f26f7073700 1 -- 172.21.15.96:0/3978725848 wait complete. 2022-02-02T23:03:22.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- 172.21.15.96:0/3075663154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 msgr2=0x7f52ec0f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.843 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 --2- 172.21.15.96:0/3075663154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec0f7080 secure :-1 s=READY pgs=4307 cs=0 l=1 rev1=1 rx=0x7f52e0004660 tx=0x7f52e0009b30).stop 2022-02-02T23:03:22.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- 172.21.15.96:0/3075663154 shutdown_connections 2022-02-02T23:03:22.844 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 --2- 172.21.15.96:0/3075663154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 0x7f52ec0f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 --2- 172.21.15.96:0/3075663154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec0f7080 unknown :-1 s=CLOSED pgs=4307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.845 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- 172.21.15.96:0/3075663154 >> 172.21.15.96:0/3075663154 conn(0x7f52ec0f04c0 msgr2=0x7f52ec0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:22.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- 172.21.15.96:0/3075663154 shutdown_connections 2022-02-02T23:03:22.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- 172.21.15.96:0/3075663154 wait complete. 2022-02-02T23:03:22.846 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 Processor -- start 2022-02-02T23:03:22.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.838+0000 7f52f400a700 1 -- start start 2022-02-02T23:03:22.847 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 0x7f52ec109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0f5620 con 0x7f52ec0f6c60 2022-02-02T23:03:22.848 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0f5760 con 0x7f52ec0f5970 2022-02-02T23:03:22.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51886/0 (socket says 172.21.15.96:51886) 2022-02-02T23:03:22.849 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 -- 172.21.15.96:0/4094262563 learned_addr learned my addr 172.21.15.96:0/4094262563 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:03:22.850 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f1da6700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 0x7f52ec109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 -- 172.21.15.96:0/4094262563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 msgr2=0x7f52ec109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:22.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 0x7f52ec109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:22.851 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 -- 172.21.15.96:0/4094262563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0005040 con 0x7f52ec0f6c60 2022-02-02T23:03:22.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f15a5700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 secure :-1 s=READY pgs=4308 cs=0 l=1 rev1=1 rx=0x7f52e80026d0 tx=0x7f52e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.852 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e80079c0 con 0x7f52ec0f6c60 2022-02-02T23:03:22.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec10c780 con 0x7f52ec0f6c60 2022-02-02T23:03:22.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec10cd40 con 0x7f52ec0f6c60 2022-02-02T23:03:22.853 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52e800f040 con 0x7f52ec0f6c60 2022-02-02T23:03:22.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.839+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e80137c0 con 0x7f52ec0f6c60 2022-02-02T23:03:22.854 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.840+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d4004fa0 con 0x7f52ec0f6c60 2022-02-02T23:03:22.855 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.841+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52e80090d0 con 0x7f52ec0f6c60 2022-02-02T23:03:22.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.841+0000 7f52de7fc700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 0x7f52d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:22.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.841+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f52e80818e0 con 0x7f52ec0f6c60 2022-02-02T23:03:22.856 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.841+0000 7f52f1da6700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 0x7f52d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:22.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.842+0000 7f52f1da6700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 0x7f52d8067290 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 rx=0x7f52e0004630 tx=0x7f52e0009b30).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:22.857 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:22.845+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52e804f920 con 0x7f52ec0f6c60 2022-02-02T23:03:23.074 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.074+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f52d4005e80 con 0x7f52ec0f6c60 2022-02-02T23:03:23.075 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.075+0000 7f52de7fc700 1 -- 172.21.15.96:0/4094262563 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7f52e8052f40 con 0x7f52ec0f6c60 2022-02-02T23:03:23.076 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2022-02-02T23:03:23.076 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2022-02-02T23:03:23.076 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:03:23.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:03:23.077 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2022-02-02T23:03:23.077 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 2 2022-02-02T23:03:23.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:03:23.078 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2022-02-02T23:03:23.078 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 6 2022-02-02T23:03:23.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:03:23.079 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2022-02-02T23:03:23.080 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T23:03:23.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2022-02-02T23:03:23.080 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2022-02-02T23:03:23.081 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2022-02-02T23:03:23.081 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 17.0.0-10511-g78571b80 (78571b80ad21c56cce214a3fbfb0b1a080f78167) quincy (dev)": 10 2022-02-02T23:03:23.082 INFO:teuthology.orchestra.run.smithi096.stdout: } 2022-02-02T23:03:23.082 INFO:teuthology.orchestra.run.smithi096.stdout:} 2022-02-02T23:03:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 msgr2=0x7f52d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 0x7f52d8067290 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 rx=0x7f52e0004630 tx=0x7f52e0009b30).stop 2022-02-02T23:03:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 msgr2=0x7f52ec10c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.084 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 secure :-1 s=READY pgs=4308 cs=0 l=1 rev1=1 rx=0x7f52e80026d0 tx=0x7f52e8009de0).stop 2022-02-02T23:03:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 shutdown_connections 2022-02-02T23:03:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f52d8064dd0 0x7f52d8067290 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.085 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52ec0f5970 0x7f52ec109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 --2- 172.21.15.96:0/4094262563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52ec0f6c60 0x7f52ec10c1d0 unknown :-1 s=CLOSED pgs=4308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 >> 172.21.15.96:0/4094262563 conn(0x7f52ec0f04c0 msgr2=0x7f52ec0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:23.086 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 shutdown_connections 2022-02-02T23:03:23.087 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.077+0000 7f52f400a700 1 -- 172.21.15.96:0/4094262563 wait complete. 2022-02-02T23:03:23.174 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 -- 172.21.15.96:0/2082888108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 msgr2=0x7f6cdc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/2082888108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc0f59e0 secure :-1 s=READY pgs=4309 cs=0 l=1 rev1=1 rx=0x7f6cd0004660 tx=0x7f6cd0009b30).stop 2022-02-02T23:03:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 -- 172.21.15.96:0/2082888108 shutdown_connections 2022-02-02T23:03:23.175 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/2082888108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 0x7f6cdc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T23:03:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/2082888108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc0f59e0 unknown :-1 s=CLOSED pgs=4309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.176 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 -- 172.21.15.96:0/2082888108 >> 172.21.15.96:0/2082888108 conn(0x7f6cdc0f0d40 msgr2=0x7f6cdc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:23.177 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:22 smithi096 ceph-mon[101353]: pgmap v8437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:23.179 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 -- 172.21.15.96:0/2082888108 shutdown_connections 2022-02-02T23:03:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.174+0000 7f6ce2c37700 1 -- 172.21.15.96:0/2082888108 wait complete. 2022-02-02T23:03:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 Processor -- start 2022-02-02T23:03:23.180 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 -- start start 2022-02-02T23:03:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 0x7f6cdc10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc060470 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce2c37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0605b0 con 0x7f6cdc0f6860 2022-02-02T23:03:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce09d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce09d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51894/0 (socket says 172.21.15.96:51894) 2022-02-02T23:03:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.175+0000 7f6ce09d3700 1 -- 172.21.15.96:0/3500150579 learned_addr learned my addr 172.21.15.96:0/3500150579 (peer_addr_for_me v2:172.21.15.96:0/0) 2022-02-02T23:03:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6cdbfff700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 0x7f6cdc10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce09d3700 1 -- 172.21.15.96:0/3500150579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 msgr2=0x7f6cdc10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce09d3700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 0x7f6cdc10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce09d3700 1 -- 172.21.15.96:0/3500150579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0005040 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce09d3700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 secure :-1 s=READY pgs=4310 cs=0 l=1 rev1=1 rx=0x7f6cd0004f60 tx=0x7f6cd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd0018070 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc10c7c0 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6cd0007ba0 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd001c620 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.186 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.176+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc10ccf0 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.177+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc045ad0 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.178+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 35) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6cd001c8e0 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.187 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.178+0000 7f6cd97fa700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 0x7f6ccc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T23:03:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.178+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6cd0083970 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.178+0000 7f6cdbfff700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 0x7f6ccc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T23:03:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.179+0000 7f6cdbfff700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 0x7f6ccc067290 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 rx=0x7f6cc800b790 tx=0x7f6cc8008040).ready entity=mgr.24491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T23:03:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.182+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6cd0051b30 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:22 smithi159 ceph-mon[69013]: pgmap v8437: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.386+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6cdc027a00 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.387 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.386+0000 7f6cd97fa700 1 -- 172.21.15.96:0/3500150579 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f6cd0055150 con 0x7f6cdc0f55c0 2022-02-02T23:03:23.387 INFO:teuthology.orchestra.run.smithi096.stdout:e41 2022-02-02T23:03:23.388 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T23:03:23.388 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:03:23.388 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2022-02-02T23:03:23.389 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:03:23.389 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2022-02-02T23:03:23.389 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2022-02-02T23:03:23.390 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 41 2022-02-02T23:03:23.390 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2022-02-02T23:03:23.390 INFO:teuthology.orchestra.run.smithi096.stdout:created 2022-02-02T18:19:21.963693+0000 2022-02-02T23:03:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2022-02-02T18:27:22.812484+0000 2022-02-02T23:03:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2022-02-02T23:03:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2022-02-02T23:03:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2022-02-02T23:03:23.392 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2022-02-02T23:03:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2022-02-02T23:03:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2022-02-02T23:03:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2022-02-02T23:03:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2022-02-02T23:03:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T23:03:23.394 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2022-02-02T23:03:23.395 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2022-02-02T23:03:23.395 INFO:teuthology.orchestra.run.smithi096.stdout:up {1=24273} 2022-02-02T23:03:23.395 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0 2022-02-02T23:03:23.396 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2022-02-02T23:03:23.396 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2022-02-02T23:03:23.397 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2022-02-02T23:03:23.397 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2022-02-02T23:03:23.397 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2022-02-02T23:03:23.398 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2022-02-02T23:03:23.398 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2022-02-02T23:03:23.398 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.omlhix{1:24273} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/1698563654,v1:172.21.15.159:6827/1698563654] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T23:03:23.399 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:03:23.399 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:03:23.399 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2022-02-02T23:03:23.400 INFO:teuthology.orchestra.run.smithi096.stdout: 2022-02-02T23:03:23.400 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi159.shbucd{-1:34126} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/677509218,v1:172.21.15.159:6825/677509218] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:03:23.401 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pitrsc{-1:34146} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/985098340,v1:172.21.15.96:6827/985098340] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:03:23.401 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.ghwylx{-1:34280} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/48650275,v1:172.21.15.96:6829/48650275] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T23:03:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 msgr2=0x7f6ccc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 0x7f6ccc067290 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 rx=0x7f6cc800b790 tx=0x7f6cc8008040).stop 2022-02-02T23:03:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 msgr2=0x7f6cdc109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T23:03:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 secure :-1 s=READY pgs=4310 cs=0 l=1 rev1=1 rx=0x7f6cd0004f60 tx=0x7f6cd0009b30).stop 2022-02-02T23:03:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 shutdown_connections 2022-02-02T23:03:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:6800/4041210206,v1:172.21.15.96:6801/4041210206] conn(0x7f6ccc064dd0 0x7f6ccc067290 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6cdc0f55c0 0x7f6cdc109cc0 unknown :-1 s=CLOSED pgs=4310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 --2- 172.21.15.96:0/3500150579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cdc0f6860 0x7f6cdc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T23:03:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.388+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 >> 172.21.15.96:0/3500150579 conn(0x7f6cdc0f0d40 msgr2=0x7f6cdc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T23:03:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.389+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 shutdown_connections 2022-02-02T23:03:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2022-02-02T23:03:23.389+0000 7f6ce2c37700 1 -- 172.21.15.96:0/3500150579 wait complete. 2022-02-02T23:03:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 41 2022-02-02T23:03:24.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:23 smithi159 ceph-mon[69013]: from='client.42736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:03:24.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:23 smithi159 ceph-mon[69013]: from='client.42740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:03:24.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/4094262563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:03:24.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:23 smithi159 ceph-mon[69013]: from='client.? 172.21.15.96:0/3500150579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:03:24.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:23 smithi096 ceph-mon[101353]: from='client.42736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:03:24.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:23 smithi096 ceph-mon[101353]: from='client.42740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T23:03:24.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/4094262563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T23:03:24.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:23 smithi096 ceph-mon[101353]: from='client.? 172.21.15.96:0/3500150579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T23:03:25.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:24 smithi159 ceph-mon[69013]: pgmap v8438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:25.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:24 smithi096 ceph-mon[101353]: pgmap v8438: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:27.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:26 smithi159 ceph-mon[69013]: pgmap v8439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:27.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:26 smithi096 ceph-mon[101353]: pgmap v8439: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:28 smithi159 ceph-mon[69013]: pgmap v8440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:29.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:03:29.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:28 smithi159 ceph-mon[69013]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:03:29.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:28 smithi096 ceph-mon[101353]: pgmap v8440: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/trash_purge_schedule"}]: dispatch 2022-02-02T23:03:29.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:28 smithi096 ceph-mon[101353]: from='mgr.24491 172.21.15.96:0/3388264126' entity='mgr.smithi096.shfutl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.shfutl/mirror_snapshot_schedule"}]: dispatch 2022-02-02T23:03:31.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:30 smithi159 ceph-mon[69013]: pgmap v8441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:31.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:30 smithi096 ceph-mon[101353]: pgmap v8441: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:33.236 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:32 smithi096 ceph-mon[101353]: pgmap v8442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:33.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:32 smithi159 ceph-mon[69013]: pgmap v8442: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:35.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:34 smithi159 ceph-mon[69013]: pgmap v8443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:35.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:34 smithi096 ceph-mon[101353]: pgmap v8443: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:37.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:36 smithi159 ceph-mon[69013]: pgmap v8444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:37.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:36 smithi096 ceph-mon[101353]: pgmap v8444: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:39.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:38 smithi159 ceph-mon[69013]: pgmap v8445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:39.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:38 smithi096 ceph-mon[101353]: pgmap v8445: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:41.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:40 smithi159 ceph-mon[69013]: pgmap v8446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:41.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:40 smithi096 ceph-mon[101353]: pgmap v8446: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:43.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:42 smithi159 ceph-mon[69013]: pgmap v8447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:43.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:42 smithi096 ceph-mon[101353]: pgmap v8447: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:45.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:44 smithi159 ceph-mon[69013]: pgmap v8448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:45.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:44 smithi096 ceph-mon[101353]: pgmap v8448: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:47.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:47 smithi159 ceph-mon[69013]: pgmap v8449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:47.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:47 smithi096 ceph-mon[101353]: pgmap v8449: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:49.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 02 23:03:49 smithi159 ceph-mon[69013]: pgmap v8450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:49.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 02 23:03:49 smithi096 ceph-mon[101353]: pgmap v8450: 65 pgs: 65 active+clean; 741 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2022-02-02T23:03:50.655 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-02-02T23:03:50.656 DEBUG:teuthology.task.console_log:Killing console logger for smithi096 2022-02-02T23:03:50.657 DEBUG:teuthology.task.console_log:Killing console logger for smithi159 2022-02-02T23:03:50.658 DEBUG:teuthology.exit:Finished running handlers